2024-04-01T19:01:35.127 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-04-01T19:01:35.127 DEBUG:teuthology.run:Teuthology command: teuthology --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/radosbench} --archive /home/teuthworker/archive/lflores-2024-04-01_18:07:25-rados-wip-yuri8-testing-2024-03-25-1419-distro-default-smithi/7634085 --owner scheduled_lflores@teuthology --name lflores-2024-04-01_18:07:25-rados-wip-yuri8-testing-2024-03-25-1419-distro-default-smithi --verbose -- /home/teuthworker/archive/lflores-2024-04-01_18:07:25-rados-wip-yuri8-testing-2024-03-25-1419-distro-default-smithi/7634085/orig.config.yaml 2024-04-01T19:01:35.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T19:01:35.259 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/lflores-2024-04-01_18:07:25-rados-wip-yuri8-testing-2024-03-25-1419-distro-default-smithi/7634085 branch: wip-yuri8-testing-2024-03-25-1419 description: rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/radosbench} email: null first_in_suite: false job_id: '7634085' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: lflores-2024-04-01_18:07:25-rados-wip-yuri8-testing-2024-03-25-1419-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 30 - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri8-testing-2024-03-25-1419 ceph: conf: client.2: debug ms: 1 debug objecter: 20 debug rados: 20 global: mon client directed command retry: 5 mon election default strategy: 1 ms bind msgr2: false ms inject socket failures: 5000 ms type: async osd_pool_default_min_size: 2 osd_pool_default_size: 2 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 paxos service trim min: 10 osd: bluestore zero block detection: true debug ms: 1 debug osd: 20 osd backoff on peering: true osd blocked scrub grace period: 3600 osd debug verify cached snaps: true osd debug verify missing on start: true osd heartbeat use min delay socket: true osd map cache size: 1 osd max backfills: 6 osd max markdown count: 1000 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd op queue: debug_random osd op queue cut off: debug_random osd scrub during recovery: false osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(REQUEST_STUCK\) - \(MON_DOWN\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - osd_map_cache_size - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum mon_bind_msgr2: false sha1: e142085d06ebbedb32196116c9f19e2d28f93430 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: e142085d06ebbedb32196116c9f19e2d28f93430 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-tracker-64864 sha1: b64378df0aa36ce626cf358e9d2b6f4658480c2f owner: scheduled_lflores@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - - mon.c - osd.8 - osd.9 - osd.10 - osd.11 - client.2 seed: 3833 sha1: e142085d06ebbedb32196116c9f19e2d28f93430 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-tracker-64864 suite_path: /home/teuthworker/src/github.com_ljflores_ceph_b64378df0aa36ce626cf358e9d2b6f4658480c2f/qa suite_relpath: qa suite_repo: https://github.com/ljflores/ceph.git suite_sha1: b64378df0aa36ce626cf358e9d2b6f4658480c2f targets: smithi022.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL3B9TtcQuNj1cc6k5Zi2wTmAHzazC3Lbyp2jBJlw7Go7YvNG0g7YIIcL/GRb1i0UXE5D/1tiGZUhvtk5N4XHD0= smithi062.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMn1aqZNxsGFja+d3n+U7smqmDwlNh0H6se6X3nqixSF/bHkGQNCt1oN6CB2nJ+prLBTLpk6pdH9SBby6YgMAnM= smithi188.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHm5gNcPYRhquJDz3z10kDYUFmOVxzpVEiI6fusN4kgdmPSbKls5kf0/AsSmUhw6il3CZxePI2Xx3CdbifZ4rpk= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: branch: nautilus exclude_packages: - cephadm - ceph-mgr-cephadm - ceph-immutable-object-cache - python3-rados - python3-rgw - python3-rbd - python3-cephfs - ceph-volume extra_packages: - python-rados - python-rgw - python-rbd - python-cephfs - cephadm: conf: mon: auth allow insecure global id reclaim: true - exec: mon.a: - while ! ceph balancer status ; do sleep 1 ; done - ceph balancer mode crush-compat - ceph balancer on - thrashosds: chance_pgnum_grow: 0.25 chance_pgpnum_fix: 0.25 chance_test_map_discontinuity: 2 timeout: 1800 - full_sequential: - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 - radosbench: clients: - client.2 time: 90 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-04-01_18:07:25 tube: smithi user: lflores verbose: true verify_ceph_hash: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-01T19:01:35.259 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ljflores_ceph_b64378df0aa36ce626cf358e9d2b6f4658480c2f/qa; will attempt to use it 2024-04-01T19:01:35.260 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ljflores_ceph_b64378df0aa36ce626cf358e9d2b6f4658480c2f/qa/tasks 2024-04-01T19:01:35.260 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-01T19:01:35.261 INFO:teuthology.task.internal:Saving configuration 2024-04-01T19:01:35.278 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-01T19:01:35.289 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-01T19:01:35.310 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-04-01_18:07:25-rados-wip-yuri8-testing-2024-03-25-1419-distro-default-smithi/7634085', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 18:56:27.009722', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL3B9TtcQuNj1cc6k5Zi2wTmAHzazC3Lbyp2jBJlw7Go7YvNG0g7YIIcL/GRb1i0UXE5D/1tiGZUhvtk5N4XHD0='} 2024-04-01T19:01:35.331 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-04-01_18:07:25-rados-wip-yuri8-testing-2024-03-25-1419-distro-default-smithi/7634085', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 18:56:27.010850', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMn1aqZNxsGFja+d3n+U7smqmDwlNh0H6se6X3nqixSF/bHkGQNCt1oN6CB2nJ+prLBTLpk6pdH9SBby6YgMAnM='} 2024-04-01T19:01:35.350 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-04-01_18:07:25-rados-wip-yuri8-testing-2024-03-25-1419-distro-default-smithi/7634085', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 18:56:27.007453', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHm5gNcPYRhquJDz3z10kDYUFmOVxzpVEiI6fusN4kgdmPSbKls5kf0/AsSmUhw6il3CZxePI2Xx3CdbifZ4rpk='} 2024-04-01T19:01:35.350 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-01T19:01:35.361 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-01T19:01:35.362 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2024-04-01T19:01:35.362 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.c', 'osd.8', 'osd.9', 'osd.10', 'osd.11', 'client.2'] 2024-04-01T19:01:35.362 INFO:teuthology.run_tasks:Running task console_log... 2024-04-01T19:01:35.464 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f714bcbef70>, signals=[15]) 2024-04-01T19:01:35.465 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-01T19:01:35.475 INFO:teuthology.task.internal:Opening connections... 2024-04-01T19:01:35.476 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi022.front.sepia.ceph.com 2024-04-01T19:01:35.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T19:01:35.554 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2024-04-01T19:01:35.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T19:01:35.628 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi188.front.sepia.ceph.com 2024-04-01T19:01:35.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T19:01:35.701 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-01T19:01:35.710 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2024-04-01T19:01:35.733 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2024-04-01T19:01:35.733 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2024-04-01T19:01:35.795 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2024-04-01T19:01:35.795 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8" 2024-04-01T19:01:35.795 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2024-04-01T19:01:35.795 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2024-04-01T19:01:35.795 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8" 2024-04-01T19:01:35.795 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2024-04-01T19:01:35.795 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-01T19:01:35.796 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2024-04-01T19:01:35.796 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-01T19:01:35.796 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2024-04-01T19:01:35.796 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T19:01:35.796 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-01T19:01:35.796 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T19:01:35.796 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2024-04-01T19:01:35.816 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2024-04-01T19:01:35.839 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2024-04-01T19:01:35.840 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2024-04-01T19:01:35.901 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2024-04-01T19:01:35.901 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8" 2024-04-01T19:01:35.901 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2024-04-01T19:01:35.901 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2024-04-01T19:01:35.901 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8" 2024-04-01T19:01:35.901 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2024-04-01T19:01:35.901 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-01T19:01:35.901 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2024-04-01T19:01:35.902 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-01T19:01:35.902 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2024-04-01T19:01:35.902 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T19:01:35.902 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-01T19:01:35.902 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T19:01:35.902 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2024-04-01T19:01:35.924 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2024-04-01T19:01:35.947 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2024-04-01T19:01:35.947 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2024-04-01T19:01:36.007 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2024-04-01T19:01:36.008 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8" 2024-04-01T19:01:36.008 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2024-04-01T19:01:36.008 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2024-04-01T19:01:36.008 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8" 2024-04-01T19:01:36.008 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8" 2024-04-01T19:01:36.008 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-01T19:01:36.008 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2024-04-01T19:01:36.008 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-01T19:01:36.008 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2024-04-01T19:01:36.008 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T19:01:36.008 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-01T19:01:36.008 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T19:01:36.009 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2024-04-01T19:01:36.034 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-01T19:01:36.046 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-01T19:01:36.058 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-01T19:01:36.058 DEBUG:teuthology.orchestra.run.smithi022:> test '!' -e /home/ubuntu/cephtest 2024-04-01T19:01:36.061 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2024-04-01T19:01:36.063 DEBUG:teuthology.orchestra.run.smithi188:> test '!' -e /home/ubuntu/cephtest 2024-04-01T19:01:36.083 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-01T19:01:36.091 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-01T19:01:36.091 DEBUG:teuthology.orchestra.run.smithi022:> test -z $(ls -A /var/lib/ceph) 2024-04-01T19:01:36.122 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2024-04-01T19:01:36.125 DEBUG:teuthology.orchestra.run.smithi188:> test -z $(ls -A /var/lib/ceph) 2024-04-01T19:01:36.153 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-01T19:01:36.218 INFO:teuthology.run_tasks:Running task kernel... 2024-04-01T19:01:36.239 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-01T19:01:36.240 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-01T19:01:36.240 DEBUG:teuthology.orchestra.run.smithi022:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-01T19:01:36.240 DEBUG:teuthology.orchestra.run.smithi062:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-01T19:01:36.241 DEBUG:teuthology.orchestra.run.smithi188:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-01T19:01:36.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T19:01:36.261 DEBUG:teuthology.orchestra.run.smithi188:> uname -r 2024-04-01T19:01:36.262 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T19:01:36.262 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-04-01T19:01:36.263 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T19:01:36.263 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2024-04-01T19:01:36.321 INFO:teuthology.orchestra.run.smithi188.stdout:4.18.0-489.el8.x86_64 2024-04-01T19:01:36.321 INFO:teuthology.task.kernel:Running kernel on smithi188: 4.18.0-489.el8.x86_64 2024-04-01T19:01:36.321 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum install -y kernel 2024-04-01T19:01:36.325 INFO:teuthology.orchestra.run.smithi062.stdout:4.18.0-489.el8.x86_64 2024-04-01T19:01:36.325 INFO:teuthology.task.kernel:Running kernel on smithi062: 4.18.0-489.el8.x86_64 2024-04-01T19:01:36.325 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum install -y kernel 2024-04-01T19:01:36.327 INFO:teuthology.orchestra.run.smithi022.stdout:4.18.0-489.el8.x86_64 2024-04-01T19:01:36.327 INFO:teuthology.task.kernel:Running kernel on smithi022: 4.18.0-489.el8.x86_64 2024-04-01T19:01:36.328 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum install -y kernel 2024-04-01T19:01:41.394 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 8 - AppStream 11 MB/s | 28 MB 00:02 2024-04-01T19:01:41.433 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 8 - AppStream 11 MB/s | 28 MB 00:02 2024-04-01T19:01:41.470 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 8 - AppStream 11 MB/s | 28 MB 00:02 2024-04-01T19:01:47.754 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 8 - BaseOS 8.8 MB/s | 10 MB 00:01 2024-04-01T19:01:47.994 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 8 - BaseOS 7.9 MB/s | 10 MB 00:01 2024-04-01T19:01:48.049 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 8 - BaseOS 8.3 MB/s | 10 MB 00:01 2024-04-01T19:01:49.779 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 8 - Extras 47 kB/s | 18 kB 00:00 2024-04-01T19:01:50.136 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 8 - Extras 44 kB/s | 18 kB 00:00 2024-04-01T19:01:50.191 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 8 - Extras 42 kB/s | 18 kB 00:00 2024-04-01T19:01:50.229 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 8 - Extras common packages 22 kB/s | 7.5 kB 00:00 2024-04-01T19:01:50.456 INFO:teuthology.orchestra.run.smithi188.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2024-04-01T19:01:50.478 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 8 - Extras common packages 33 kB/s | 7.5 kB 00:00 2024-04-01T19:01:50.675 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 8 - Extras common packages 20 kB/s | 7.5 kB 00:00 2024-04-01T19:01:50.713 INFO:teuthology.orchestra.run.smithi022.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2024-04-01T19:01:50.919 INFO:teuthology.orchestra.run.smithi062.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2024-04-01T19:01:51.674 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 19 MB/s | 16 MB 00:00 2024-04-01T19:01:52.305 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2024-04-01T19:01:52.792 INFO:teuthology.orchestra.run.smithi188.stdout:Extra Packages for Enterprise Linux 7.2 MB/s | 16 MB 00:02 2024-04-01T19:01:55.656 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 290 kB/s | 24 kB 00:00 2024-04-01T19:01:56.261 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 403 kB/s | 24 kB 00:00 2024-04-01T19:01:56.747 INFO:teuthology.orchestra.run.smithi188.stdout:lab-extras 430 kB/s | 24 kB 00:00 2024-04-01T19:01:59.045 INFO:teuthology.orchestra.run.smithi022.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-01T19:01:59.045 INFO:teuthology.orchestra.run.smithi022.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-01T19:01:59.176 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-01T19:01:59.177 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:01:59.177 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2024-04-01T19:01:59.177 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:01:59.177 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-04-01T19:01:59.177 INFO:teuthology.orchestra.run.smithi022.stdout: kernel x86_64 4.18.0-547.el8 baseos 10 M 2024-04-01T19:01:59.177 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-04-01T19:01:59.177 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-core x86_64 4.18.0-547.el8 baseos 44 M 2024-04-01T19:01:59.177 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-modules x86_64 4.18.0-547.el8 baseos 36 M 2024-04-01T19:01:59.177 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:01:59.177 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-04-01T19:01:59.177 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:01:59.177 INFO:teuthology.orchestra.run.smithi022.stdout:Install 3 Packages 2024-04-01T19:01:59.178 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:01:59.178 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 90 M 2024-04-01T19:01:59.178 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 96 M 2024-04-01T19:01:59.178 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-04-01T19:01:59.492 INFO:teuthology.orchestra.run.smithi062.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-01T19:01:59.492 INFO:teuthology.orchestra.run.smithi062.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-01T19:01:59.602 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-01T19:01:59.603 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:01:59.603 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-04-01T19:01:59.603 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:01:59.603 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-01T19:01:59.603 INFO:teuthology.orchestra.run.smithi062.stdout: kernel x86_64 4.18.0-547.el8 baseos 10 M 2024-04-01T19:01:59.603 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-01T19:01:59.603 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-core x86_64 4.18.0-547.el8 baseos 44 M 2024-04-01T19:01:59.604 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules x86_64 4.18.0-547.el8 baseos 36 M 2024-04-01T19:01:59.604 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:01:59.604 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-01T19:01:59.604 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:01:59.604 INFO:teuthology.orchestra.run.smithi062.stdout:Install 3 Packages 2024-04-01T19:01:59.604 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:01:59.604 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 90 M 2024-04-01T19:01:59.604 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 96 M 2024-04-01T19:01:59.605 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-01T19:01:59.778 INFO:teuthology.orchestra.run.smithi188.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-01T19:01:59.778 INFO:teuthology.orchestra.run.smithi188.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-01T19:01:59.908 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-04-01T19:01:59.909 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:01:59.909 INFO:teuthology.orchestra.run.smithi188.stdout: Package Architecture Version Repository Size 2024-04-01T19:01:59.909 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:01:59.909 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-04-01T19:01:59.909 INFO:teuthology.orchestra.run.smithi188.stdout: kernel x86_64 4.18.0-547.el8 baseos 10 M 2024-04-01T19:01:59.909 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-04-01T19:01:59.909 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-core x86_64 4.18.0-547.el8 baseos 44 M 2024-04-01T19:01:59.909 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-modules x86_64 4.18.0-547.el8 baseos 36 M 2024-04-01T19:01:59.909 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:01:59.910 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-04-01T19:01:59.910 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:01:59.910 INFO:teuthology.orchestra.run.smithi188.stdout:Install 3 Packages 2024-04-01T19:01:59.910 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:01:59.910 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 90 M 2024-04-01T19:01:59.910 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 96 M 2024-04-01T19:01:59.910 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-04-01T19:02:00.507 INFO:teuthology.orchestra.run.smithi022.stdout:(1/3): kernel-4.18.0-547.el8.x86_64.rpm 9.1 MB/s | 10 MB 00:01 2024-04-01T19:02:01.621 INFO:teuthology.orchestra.run.smithi062.stdout:(1/3): kernel-4.18.0-547.el8.x86_64.rpm 5.3 MB/s | 10 MB 00:01 2024-04-01T19:02:01.674 INFO:teuthology.orchestra.run.smithi022.stdout:(2/3): kernel-modules-4.18.0-547.el8.x86_64.rpm 16 MB/s | 36 MB 00:02 2024-04-01T19:02:02.091 INFO:teuthology.orchestra.run.smithi022.stdout:(3/3): kernel-core-4.18.0-547.el8.x86_64.rpm 16 MB/s | 44 MB 00:02 2024-04-01T19:02:02.091 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:02:02.091 INFO:teuthology.orchestra.run.smithi022.stdout:Total 31 MB/s | 90 MB 00:02 2024-04-01T19:02:02.806 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-04-01T19:02:02.963 INFO:teuthology.orchestra.run.smithi062.stdout:(2/3): kernel-modules-4.18.0-547.el8.x86_64.rpm 11 MB/s | 36 MB 00:03 2024-04-01T19:02:03.252 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-04-01T19:02:03.252 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-04-01T19:02:03.538 INFO:teuthology.orchestra.run.smithi062.stdout:(3/3): kernel-core-4.18.0-547.el8.x86_64.rpm 11 MB/s | 44 MB 00:03 2024-04-01T19:02:03.538 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:02:03.539 INFO:teuthology.orchestra.run.smithi062.stdout:Total 23 MB/s | 90 MB 00:03 2024-04-01T19:02:04.257 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-01T19:02:04.548 INFO:teuthology.orchestra.run.smithi188.stdout:(1/3): kernel-4.18.0-547.el8.x86_64.rpm 2.3 MB/s | 10 MB 00:04 2024-04-01T19:02:04.567 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-04-01T19:02:04.595 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-04-01T19:02:04.716 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-01T19:02:04.716 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-01T19:02:06.038 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-01T19:02:06.064 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-01T19:02:07.065 INFO:teuthology.orchestra.run.smithi188.stdout:(2/3): kernel-modules-4.18.0-547.el8.x86_64.rpm 5.1 MB/s | 36 MB 00:07 2024-04-01T19:02:07.498 INFO:teuthology.orchestra.run.smithi188.stdout:(3/3): kernel-core-4.18.0-547.el8.x86_64.rpm 5.8 MB/s | 44 MB 00:07 2024-04-01T19:02:07.499 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:02:07.499 INFO:teuthology.orchestra.run.smithi188.stdout:Total 12 MB/s | 90 MB 00:07 2024-04-01T19:02:07.566 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-04-01T19:02:08.108 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : kernel-core-4.18.0-547.el8.x86_64 1/3 2024-04-01T19:02:08.186 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-04-01T19:02:08.590 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-04-01T19:02:08.590 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-04-01T19:02:09.079 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-01T19:02:09.599 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-core-4.18.0-547.el8.x86_64 1/3 2024-04-01T19:02:09.816 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-04-01T19:02:09.846 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-04-01T19:02:11.868 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-core-4.18.0-547.el8.x86_64 1/3 2024-04-01T19:02:12.282 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : kernel-modules-4.18.0-547.el8.x86_64 2/3 2024-04-01T19:02:12.714 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-04-01T19:02:13.247 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : kernel-core-4.18.0-547.el8.x86_64 1/3 2024-04-01T19:02:13.383 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-core-4.18.0-547.el8.x86_64 1/3 2024-04-01T19:02:13.748 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-modules-4.18.0-547.el8.x86_64 2/3 2024-04-01T19:02:15.970 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-modules-4.18.0-547.el8.x86_64 2/3 2024-04-01T19:02:16.454 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : kernel-4.18.0-547.el8.x86_64 3/3 2024-04-01T19:02:16.875 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-core-4.18.0-547.el8.x86_64 1/3 2024-04-01T19:02:17.271 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : kernel-modules-4.18.0-547.el8.x86_64 2/3 2024-04-01T19:02:17.439 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-modules-4.18.0-547.el8.x86_64 2/3 2024-04-01T19:02:17.729 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-4.18.0-547.el8.x86_64 3/3 2024-04-01T19:02:20.713 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-modules-4.18.0-547.el8.x86_64 2/3 2024-04-01T19:02:20.993 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : kernel-4.18.0-547.el8.x86_64 3/3 2024-04-01T19:02:40.008 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-core-4.18.0-547.el8.x86_64 3/3 2024-04-01T19:02:40.032 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-modules-4.18.0-547.el8.x86_64 3/3 2024-04-01T19:02:40.422 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-4.18.0-547.el8.x86_64 3/3 2024-04-01T19:02:40.422 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-4.18.0-547.el8.x86_64 1/3 2024-04-01T19:02:40.422 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-core-4.18.0-547.el8.x86_64 2/3 2024-04-01T19:02:40.869 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-modules-4.18.0-547.el8.x86_64 3/3 2024-04-01T19:02:40.869 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:02:40.869 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-04-01T19:02:40.869 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-4.18.0-547.el8.x86_64 kernel-core-4.18.0-547.el8.x86_64 2024-04-01T19:02:40.870 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-modules-4.18.0-547.el8.x86_64 2024-04-01T19:02:40.870 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:02:40.870 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-01T19:02:41.018 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q kernel | sort -rV | head -n 1 2024-04-01T19:02:41.072 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-core-4.18.0-547.el8.x86_64 3/3 2024-04-01T19:02:41.096 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-modules-4.18.0-547.el8.x86_64 3/3 2024-04-01T19:02:41.244 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-4.18.0-547.el8.x86_64 2024-04-01T19:02:41.244 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-547.el8.x86_64 2024-04-01T19:02:41.244 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-547.el8.x86_64 2024-04-01T19:02:41.245 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-01T19:02:41.245 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-01T19:02:41.245 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-01T19:02:41.245 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi022.front.sepia.ceph.com, path=None, version=distro) 2024-04-01T19:02:41.245 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q kernel | sort -rV | head -n 1 2024-04-01T19:02:41.466 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-4.18.0-547.el8.x86_64 2024-04-01T19:02:41.466 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-547.el8.x86_64 2024-04-01T19:02:41.467 DEBUG:teuthology.orchestra.run.smithi022:> sudo rpm -qi grub2-tools 2024-04-01T19:02:41.473 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-4.18.0-547.el8.x86_64 3/3 2024-04-01T19:02:41.473 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-4.18.0-547.el8.x86_64 1/3 2024-04-01T19:02:41.473 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-core-4.18.0-547.el8.x86_64 2/3 2024-04-01T19:02:41.501 INFO:teuthology.orchestra.run.smithi022.stdout:Name : grub2-tools 2024-04-01T19:02:41.501 INFO:teuthology.orchestra.run.smithi022.stdout:Epoch : 1 2024-04-01T19:02:41.501 INFO:teuthology.orchestra.run.smithi022.stdout:Version : 2.02 2024-04-01T19:02:41.501 INFO:teuthology.orchestra.run.smithi022.stdout:Release : 129.el8 2024-04-01T19:02:41.501 INFO:teuthology.orchestra.run.smithi022.stdout:Architecture: x86_64 2024-04-01T19:02:41.501 INFO:teuthology.orchestra.run.smithi022.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-01T19:02:41.501 INFO:teuthology.orchestra.run.smithi022.stdout:Group : System Environment/Base 2024-04-01T19:02:41.501 INFO:teuthology.orchestra.run.smithi022.stdout:Size : 9265586 2024-04-01T19:02:41.501 INFO:teuthology.orchestra.run.smithi022.stdout:License : GPLv3+ 2024-04-01T19:02:41.501 INFO:teuthology.orchestra.run.smithi022.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-01T19:02:41.501 INFO:teuthology.orchestra.run.smithi022.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-01T19:02:41.502 INFO:teuthology.orchestra.run.smithi022.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-01T19:02:41.502 INFO:teuthology.orchestra.run.smithi022.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-01T19:02:41.502 INFO:teuthology.orchestra.run.smithi022.stdout:Relocations : (not relocatable) 2024-04-01T19:02:41.502 INFO:teuthology.orchestra.run.smithi022.stdout:Packager : CentOS BuildSystem 2024-04-01T19:02:41.502 INFO:teuthology.orchestra.run.smithi022.stdout:Vendor : CentOS 2024-04-01T19:02:41.502 INFO:teuthology.orchestra.run.smithi022.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-01T19:02:41.502 INFO:teuthology.orchestra.run.smithi022.stdout:Summary : Support tools for GRUB. 2024-04-01T19:02:41.502 INFO:teuthology.orchestra.run.smithi022.stdout:Description : 2024-04-01T19:02:41.502 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:02:41.502 INFO:teuthology.orchestra.run.smithi022.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-01T19:02:41.502 INFO:teuthology.orchestra.run.smithi022.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-01T19:02:41.502 INFO:teuthology.orchestra.run.smithi022.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-01T19:02:41.502 INFO:teuthology.orchestra.run.smithi022.stdout:hardware devices. 2024-04-01T19:02:41.502 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:02:41.503 INFO:teuthology.orchestra.run.smithi022.stdout:This subpackage provides tools for support of all platforms. 2024-04-01T19:02:41.503 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-01T19:02:41.503 INFO:teuthology.task.kernel:Updating grub on smithi022 to boot 4.18.0-547.el8.x86_64 2024-04-01T19:02:41.504 DEBUG:teuthology.orchestra.run.smithi022:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-01T19:02:41.995 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-modules-4.18.0-547.el8.x86_64 3/3 2024-04-01T19:02:41.995 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:02:41.995 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-01T19:02:41.995 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-4.18.0-547.el8.x86_64 kernel-core-4.18.0-547.el8.x86_64 2024-04-01T19:02:41.996 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules-4.18.0-547.el8.x86_64 2024-04-01T19:02:41.996 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:02:41.996 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-01T19:02:42.148 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q kernel | sort -rV | head -n 1 2024-04-01T19:02:42.381 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-4.18.0-547.el8.x86_64 2024-04-01T19:02:42.381 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-547.el8.x86_64 2024-04-01T19:02:42.382 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-547.el8.x86_64 2024-04-01T19:02:42.382 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-01T19:02:42.382 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-01T19:02:42.382 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-01T19:02:42.382 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi062.front.sepia.ceph.com, path=None, version=distro) 2024-04-01T19:02:42.382 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q kernel | sort -rV | head -n 1 2024-04-01T19:02:42.603 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-4.18.0-547.el8.x86_64 2024-04-01T19:02:42.603 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-547.el8.x86_64 2024-04-01T19:02:42.603 DEBUG:teuthology.orchestra.run.smithi062:> sudo rpm -qi grub2-tools 2024-04-01T19:02:42.638 INFO:teuthology.orchestra.run.smithi062.stdout:Name : grub2-tools 2024-04-01T19:02:42.638 INFO:teuthology.orchestra.run.smithi062.stdout:Epoch : 1 2024-04-01T19:02:42.638 INFO:teuthology.orchestra.run.smithi062.stdout:Version : 2.02 2024-04-01T19:02:42.638 INFO:teuthology.orchestra.run.smithi062.stdout:Release : 129.el8 2024-04-01T19:02:42.638 INFO:teuthology.orchestra.run.smithi062.stdout:Architecture: x86_64 2024-04-01T19:02:42.638 INFO:teuthology.orchestra.run.smithi062.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-01T19:02:42.639 INFO:teuthology.orchestra.run.smithi062.stdout:Group : System Environment/Base 2024-04-01T19:02:42.639 INFO:teuthology.orchestra.run.smithi062.stdout:Size : 9265586 2024-04-01T19:02:42.639 INFO:teuthology.orchestra.run.smithi062.stdout:License : GPLv3+ 2024-04-01T19:02:42.639 INFO:teuthology.orchestra.run.smithi062.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-01T19:02:42.639 INFO:teuthology.orchestra.run.smithi062.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-01T19:02:42.639 INFO:teuthology.orchestra.run.smithi062.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-01T19:02:42.639 INFO:teuthology.orchestra.run.smithi062.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-01T19:02:42.639 INFO:teuthology.orchestra.run.smithi062.stdout:Relocations : (not relocatable) 2024-04-01T19:02:42.639 INFO:teuthology.orchestra.run.smithi062.stdout:Packager : CentOS BuildSystem 2024-04-01T19:02:42.639 INFO:teuthology.orchestra.run.smithi062.stdout:Vendor : CentOS 2024-04-01T19:02:42.639 INFO:teuthology.orchestra.run.smithi062.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-01T19:02:42.639 INFO:teuthology.orchestra.run.smithi062.stdout:Summary : Support tools for GRUB. 2024-04-01T19:02:42.639 INFO:teuthology.orchestra.run.smithi062.stdout:Description : 2024-04-01T19:02:42.639 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:02:42.640 INFO:teuthology.orchestra.run.smithi062.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-01T19:02:42.640 INFO:teuthology.orchestra.run.smithi062.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-01T19:02:42.640 INFO:teuthology.orchestra.run.smithi062.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-01T19:02:42.640 INFO:teuthology.orchestra.run.smithi062.stdout:hardware devices. 2024-04-01T19:02:42.640 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:02:42.640 INFO:teuthology.orchestra.run.smithi062.stdout:This subpackage provides tools for support of all platforms. 2024-04-01T19:02:42.641 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-01T19:02:42.641 INFO:teuthology.task.kernel:Updating grub on smithi062 to boot 4.18.0-547.el8.x86_64 2024-04-01T19:02:42.641 DEBUG:teuthology.orchestra.run.smithi062:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-01T19:02:43.011 INFO:teuthology.orchestra.run.smithi022.stderr:Generating grub configuration file ... 2024-04-01T19:02:43.016 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-core-4.18.0-547.el8.x86_64 3/3 2024-04-01T19:02:43.039 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-modules-4.18.0-547.el8.x86_64 3/3 2024-04-01T19:02:43.391 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-4.18.0-547.el8.x86_64 3/3 2024-04-01T19:02:43.392 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : kernel-4.18.0-547.el8.x86_64 1/3 2024-04-01T19:02:43.392 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : kernel-core-4.18.0-547.el8.x86_64 2/3 2024-04-01T19:02:43.873 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : kernel-modules-4.18.0-547.el8.x86_64 3/3 2024-04-01T19:02:43.873 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:02:43.873 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-04-01T19:02:43.874 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-4.18.0-547.el8.x86_64 kernel-core-4.18.0-547.el8.x86_64 2024-04-01T19:02:43.874 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-modules-4.18.0-547.el8.x86_64 2024-04-01T19:02:43.874 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:02:43.874 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-04-01T19:02:43.965 INFO:teuthology.orchestra.run.smithi062.stderr:Generating grub configuration file ... 2024-04-01T19:02:44.019 DEBUG:teuthology.orchestra.run.smithi188:> rpm -q kernel | sort -rV | head -n 1 2024-04-01T19:02:44.236 INFO:teuthology.orchestra.run.smithi188.stdout:kernel-4.18.0-547.el8.x86_64 2024-04-01T19:02:44.236 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-547.el8.x86_64 2024-04-01T19:02:44.236 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-547.el8.x86_64 2024-04-01T19:02:44.236 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-01T19:02:44.236 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-01T19:02:44.236 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-04-01T19:02:44.237 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi188.front.sepia.ceph.com, path=None, version=distro) 2024-04-01T19:02:44.237 DEBUG:teuthology.orchestra.run.smithi188:> rpm -q kernel | sort -rV | head -n 1 2024-04-01T19:02:44.448 INFO:teuthology.orchestra.run.smithi188.stdout:kernel-4.18.0-547.el8.x86_64 2024-04-01T19:02:44.448 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-547.el8.x86_64 2024-04-01T19:02:44.449 DEBUG:teuthology.orchestra.run.smithi188:> sudo rpm -qi grub2-tools 2024-04-01T19:02:44.482 INFO:teuthology.orchestra.run.smithi188.stdout:Name : grub2-tools 2024-04-01T19:02:44.482 INFO:teuthology.orchestra.run.smithi188.stdout:Epoch : 1 2024-04-01T19:02:44.482 INFO:teuthology.orchestra.run.smithi188.stdout:Version : 2.02 2024-04-01T19:02:44.482 INFO:teuthology.orchestra.run.smithi188.stdout:Release : 129.el8 2024-04-01T19:02:44.482 INFO:teuthology.orchestra.run.smithi188.stdout:Architecture: x86_64 2024-04-01T19:02:44.482 INFO:teuthology.orchestra.run.smithi188.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-01T19:02:44.482 INFO:teuthology.orchestra.run.smithi188.stdout:Group : System Environment/Base 2024-04-01T19:02:44.482 INFO:teuthology.orchestra.run.smithi188.stdout:Size : 9265586 2024-04-01T19:02:44.483 INFO:teuthology.orchestra.run.smithi188.stdout:License : GPLv3+ 2024-04-01T19:02:44.483 INFO:teuthology.orchestra.run.smithi188.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-01T19:02:44.483 INFO:teuthology.orchestra.run.smithi188.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-01T19:02:44.483 INFO:teuthology.orchestra.run.smithi188.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-01T19:02:44.483 INFO:teuthology.orchestra.run.smithi188.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-01T19:02:44.483 INFO:teuthology.orchestra.run.smithi188.stdout:Relocations : (not relocatable) 2024-04-01T19:02:44.483 INFO:teuthology.orchestra.run.smithi188.stdout:Packager : CentOS BuildSystem 2024-04-01T19:02:44.483 INFO:teuthology.orchestra.run.smithi188.stdout:Vendor : CentOS 2024-04-01T19:02:44.483 INFO:teuthology.orchestra.run.smithi188.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-01T19:02:44.483 INFO:teuthology.orchestra.run.smithi188.stdout:Summary : Support tools for GRUB. 2024-04-01T19:02:44.483 INFO:teuthology.orchestra.run.smithi188.stdout:Description : 2024-04-01T19:02:44.483 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:02:44.483 INFO:teuthology.orchestra.run.smithi188.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-01T19:02:44.484 INFO:teuthology.orchestra.run.smithi188.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-01T19:02:44.484 INFO:teuthology.orchestra.run.smithi188.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-01T19:02:44.484 INFO:teuthology.orchestra.run.smithi188.stdout:hardware devices. 2024-04-01T19:02:44.484 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:02:44.484 INFO:teuthology.orchestra.run.smithi188.stdout:This subpackage provides tools for support of all platforms. 2024-04-01T19:02:44.485 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-01T19:02:44.485 INFO:teuthology.task.kernel:Updating grub on smithi188 to boot 4.18.0-547.el8.x86_64 2024-04-01T19:02:44.485 DEBUG:teuthology.orchestra.run.smithi188:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-01T19:02:45.005 INFO:teuthology.orchestra.run.smithi022.stderr:done 2024-04-01T19:02:45.007 DEBUG:teuthology.orchestra.run.smithi022:> mktemp 2024-04-01T19:02:45.036 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.AoA5gYlcxi 2024-04-01T19:02:45.036 DEBUG:teuthology.orchestra.run.smithi022:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.AoA5gYlcxi 2024-04-01T19:02:45.110 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.AoA5gYlcxi 2024-04-01T19:02:45.254 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.AoA5gYlcxi is 6KB 2024-04-01T19:02:45.303 DEBUG:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.AoA5gYlcxi 2024-04-01T19:02:45.322 DEBUG:teuthology.orchestra.run.smithi022:> sudo /bin/ls /boot/loader/entries || true 2024-04-01T19:02:45.471 INFO:teuthology.orchestra.run.smithi022.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-01T19:02:45.472 INFO:teuthology.orchestra.run.smithi022.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-01T19:02:45.472 INFO:teuthology.orchestra.run.smithi022.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-01T19:02:45.472 INFO:teuthology.orchestra.run.smithi022.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-547.el8.x86_64.conf 2024-04-01T19:02:45.473 DEBUG:teuthology.orchestra.run.smithi022:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-547.el8.x86_64 2024-04-01T19:02:45.588 DEBUG:teuthology.orchestra.run.smithi022:> sudo shutdown -r now 2024-04-01T19:02:46.071 INFO:teuthology.orchestra.run.smithi062.stderr:done 2024-04-01T19:02:46.072 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-04-01T19:02:46.101 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.L6azt4ymFe 2024-04-01T19:02:46.102 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.L6azt4ymFe 2024-04-01T19:02:46.104 INFO:teuthology.orchestra.run.smithi188.stderr:Generating grub configuration file ... 2024-04-01T19:02:46.194 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.L6azt4ymFe 2024-04-01T19:02:46.294 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.L6azt4ymFe is 6KB 2024-04-01T19:02:46.346 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.L6azt4ymFe 2024-04-01T19:02:46.364 DEBUG:teuthology.orchestra.run.smithi062:> sudo /bin/ls /boot/loader/entries || true 2024-04-01T19:02:46.434 INFO:teuthology.orchestra.run.smithi062.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-01T19:02:46.434 INFO:teuthology.orchestra.run.smithi062.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-01T19:02:46.434 INFO:teuthology.orchestra.run.smithi062.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-01T19:02:46.434 INFO:teuthology.orchestra.run.smithi062.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-547.el8.x86_64.conf 2024-04-01T19:02:46.435 DEBUG:teuthology.orchestra.run.smithi062:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-547.el8.x86_64 2024-04-01T19:02:46.597 DEBUG:teuthology.orchestra.run.smithi062:> sudo shutdown -r now 2024-04-01T19:02:48.279 INFO:teuthology.orchestra.run.smithi188.stderr:done 2024-04-01T19:02:48.281 DEBUG:teuthology.orchestra.run.smithi188:> mktemp 2024-04-01T19:02:48.313 INFO:teuthology.orchestra.run.smithi188.stdout:/tmp/tmp.SmQfiipYfu 2024-04-01T19:02:48.314 DEBUG:teuthology.orchestra.run.smithi188:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.SmQfiipYfu 2024-04-01T19:02:48.388 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0666 /tmp/tmp.SmQfiipYfu 2024-04-01T19:02:48.522 DEBUG:teuthology.orchestra.remote:smithi188:/tmp/tmp.SmQfiipYfu is 6KB 2024-04-01T19:02:48.569 DEBUG:teuthology.orchestra.run.smithi188:> rm -fr /tmp/tmp.SmQfiipYfu 2024-04-01T19:02:48.587 DEBUG:teuthology.orchestra.run.smithi188:> sudo /bin/ls /boot/loader/entries || true 2024-04-01T19:02:48.659 INFO:teuthology.orchestra.run.smithi188.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-01T19:02:48.659 INFO:teuthology.orchestra.run.smithi188.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-01T19:02:48.660 INFO:teuthology.orchestra.run.smithi188.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-01T19:02:48.660 INFO:teuthology.orchestra.run.smithi188.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-547.el8.x86_64.conf 2024-04-01T19:02:48.661 DEBUG:teuthology.orchestra.run.smithi188:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-547.el8.x86_64 2024-04-01T19:02:48.792 DEBUG:teuthology.orchestra.run.smithi188:> sudo shutdown -r now 2024-04-01T19:03:15.600 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-01T19:03:15.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-04-01T19:03:15.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T19:03:16.599 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-01T19:03:16.600 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-04-01T19:03:16.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T19:03:18.798 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-04-01T19:03:18.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-04-01T19:03:18.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T19:03:33.918 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-04-01T19:03:34.942 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-04-01T19:03:37.246 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-04-01T19:03:42.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-04-01T19:03:42.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T19:03:43.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-04-01T19:03:43.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T19:03:46.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-04-01T19:03:46.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T19:03:47.006 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-04-01T19:03:59.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-04-01T19:03:59.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T19:04:17.438 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-04-01T19:04:32.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-04-01T19:04:32.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T19:04:33.275 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-04-01T19:04:34.196 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-04-01T19:04:34.197 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-547.el8.x86_64"... 2024-04-01T19:04:34.197 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-04-01T19:04:34.214 INFO:teuthology.orchestra.run.smithi062.stdout:4.18.0-547.el8.x86_64 2024-04-01T19:04:34.214 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-547.el8.x86_64 vs 4.18.0-547.el8.x86_64 2024-04-01T19:04:34.214 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-01T19:04:34.214 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-01T19:04:35.215 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-01T19:04:35.216 DEBUG:teuthology.orchestra.run.smithi062:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-01T19:04:35.306 INFO:teuthology.orchestra.run.smithi062.stdout:ttyS1 2024-04-01T19:04:35.322 DEBUG:teuthology.parallel:result is None 2024-04-01T19:04:42.925 DEBUG:teuthology.orchestra.remote:timed out 2024-04-01T19:04:46.251 DEBUG:teuthology.orchestra.remote:timed out 2024-04-01T19:04:54.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-04-01T19:04:54.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T19:04:55.202 DEBUG:teuthology.orchestra.run.smithi022:> true 2024-04-01T19:04:55.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-04-01T19:04:55.497 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-547.el8.x86_64"... 2024-04-01T19:04:55.498 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2024-04-01T19:04:55.517 INFO:teuthology.orchestra.run.smithi022.stdout:4.18.0-547.el8.x86_64 2024-04-01T19:04:55.517 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-547.el8.x86_64 vs 4.18.0-547.el8.x86_64 2024-04-01T19:04:55.517 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-01T19:04:55.517 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-01T19:04:56.518 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-01T19:04:56.518 DEBUG:teuthology.orchestra.run.smithi022:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-01T19:04:56.592 INFO:teuthology.orchestra.run.smithi022.stdout:ttyS1 2024-04-01T19:04:56.605 DEBUG:teuthology.parallel:result is None 2024-04-01T19:04:58.252 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-04-01T19:04:58.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T19:04:58.640 DEBUG:teuthology.orchestra.run.smithi188:> true 2024-04-01T19:04:58.933 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-04-01T19:04:58.933 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "4.18.0-547.el8.x86_64"... 2024-04-01T19:04:58.933 DEBUG:teuthology.orchestra.run.smithi188:> uname -r 2024-04-01T19:04:58.952 INFO:teuthology.orchestra.run.smithi188.stdout:4.18.0-547.el8.x86_64 2024-04-01T19:04:58.952 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-547.el8.x86_64 vs 4.18.0-547.el8.x86_64 2024-04-01T19:04:58.952 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-01T19:04:58.953 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-01T19:04:59.953 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-04-01T19:04:59.953 DEBUG:teuthology.orchestra.run.smithi188:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-01T19:05:00.013 INFO:teuthology.orchestra.run.smithi188.stdout:ttyS1 2024-04-01T19:05:00.026 DEBUG:teuthology.parallel:result is None 2024-04-01T19:05:00.026 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-01T19:05:00.035 INFO:teuthology.task.internal:Creating test directory... 2024-04-01T19:05:00.035 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-01T19:05:00.037 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-01T19:05:00.040 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-01T19:05:00.061 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-01T19:05:00.068 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-01T19:05:00.086 INFO:teuthology.task.internal:Creating archive directory... 2024-04-01T19:05:00.086 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-01T19:05:00.100 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-01T19:05:00.104 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-01T19:05:00.145 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-01T19:05:00.154 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-01T19:05:00.154 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-01T19:05:00.169 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-01T19:05:00.175 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-01T19:05:00.207 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T19:05:00.210 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T19:05:00.219 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T19:05:00.222 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T19:05:00.225 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T19:05:00.236 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T19:05:00.238 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-01T19:05:00.247 INFO:teuthology.task.internal:Configuring sudo... 2024-04-01T19:05:00.247 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-01T19:05:00.263 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-01T19:05:00.266 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-01T19:05:00.295 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-01T19:05:00.376 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-01T19:05:00.376 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-01T19:05:00.379 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-01T19:05:00.381 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-01T19:05:00.399 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T19:05:00.486 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T19:05:00.543 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T19:05:00.630 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T19:05:00.677 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-01T19:05:00.678 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-01T19:05:00.747 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T19:05:00.795 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T19:05:00.853 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T19:05:00.939 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T19:05:00.984 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-01T19:05:00.984 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-01T19:05:01.052 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T19:05:01.099 DEBUG:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T19:05:01.155 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T19:05:01.240 DEBUG:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T19:05:01.286 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-01T19:05:01.286 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-01T19:05:01.355 DEBUG:teuthology.orchestra.run.smithi022:> sudo service rsyslog restart 2024-04-01T19:05:01.357 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2024-04-01T19:05:01.359 DEBUG:teuthology.orchestra.run.smithi188:> sudo service rsyslog restart 2024-04-01T19:05:01.419 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T19:05:01.432 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T19:05:01.449 INFO:teuthology.orchestra.run.smithi188.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T19:05:01.885 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-01T19:05:01.896 INFO:teuthology.task.internal:Starting timer... 2024-04-01T19:05:01.896 INFO:teuthology.run_tasks:Running task pcp... 2024-04-01T19:05:01.913 INFO:teuthology.run_tasks:Running task selinux... 2024-04-01T19:05:01.925 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-04-01T19:05:01.926 DEBUG:teuthology.orchestra.run.smithi022:> sudo service auditd rotate 2024-04-01T19:05:02.029 INFO:teuthology.orchestra.run.smithi022.stdout:Rotating logs: 2024-04-01T19:05:02.031 DEBUG:teuthology.orchestra.run.smithi062:> sudo service auditd rotate 2024-04-01T19:05:02.115 INFO:teuthology.orchestra.run.smithi062.stdout:Rotating logs: 2024-04-01T19:05:02.117 DEBUG:teuthology.orchestra.run.smithi188:> sudo service auditd rotate 2024-04-01T19:05:02.216 INFO:teuthology.orchestra.run.smithi188.stdout:Rotating logs: 2024-04-01T19:05:02.217 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-01T19:05:02.218 DEBUG:teuthology.orchestra.run.smithi022:> /usr/sbin/getenforce 2024-04-01T19:05:02.267 INFO:teuthology.orchestra.run.smithi022.stdout:Permissive 2024-04-01T19:05:02.268 DEBUG:teuthology.orchestra.run.smithi062:> /usr/sbin/getenforce 2024-04-01T19:05:02.337 INFO:teuthology.orchestra.run.smithi062.stdout:Permissive 2024-04-01T19:05:02.337 DEBUG:teuthology.orchestra.run.smithi188:> /usr/sbin/getenforce 2024-04-01T19:05:02.388 INFO:teuthology.orchestra.run.smithi188.stdout:Permissive 2024-04-01T19:05:02.388 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi022.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi062.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi188.front.sepia.ceph.com': 'permissive'} 2024-04-01T19:05:02.388 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-01T19:05:02.417 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T19:05:02.418 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-01T19:05:02.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T19:05:02.447 DEBUG:teuthology.orchestra.run.smithi188:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-01T19:05:02.475 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T19:05:02.475 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-01T19:05:02.476 DEBUG:teuthology.orchestra.run.smithi022:> sudo /usr/sbin/setenforce permissive 2024-04-01T19:05:02.504 DEBUG:teuthology.orchestra.run.smithi062:> sudo /usr/sbin/setenforce permissive 2024-04-01T19:05:02.531 DEBUG:teuthology.orchestra.run.smithi188:> sudo /usr/sbin/setenforce permissive 2024-04-01T19:05:02.559 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-01T19:05:02.568 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-01T19:05:02.573 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-01T19:05:02.694 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-01T19:05:02.708 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-01T19:05:02.709 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi022.front.sepia.ceph.com,smithi062.front.sepia.ceph.com,smithi188.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-01T19:11:11.264 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi022.front.sepia.ceph.com'), Remote(name='ubuntu@smithi062.front.sepia.ceph.com'), Remote(name='ubuntu@smithi188.front.sepia.ceph.com')] 2024-04-01T19:11:11.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-04-01T19:11:11.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T19:11:11.341 DEBUG:teuthology.orchestra.run.smithi022:> true 2024-04-01T19:11:11.413 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-04-01T19:11:11.413 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-04-01T19:11:11.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T19:11:11.487 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-04-01T19:11:11.557 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-04-01T19:11:11.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-04-01T19:11:11.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T19:11:11.628 DEBUG:teuthology.orchestra.run.smithi188:> true 2024-04-01T19:11:11.697 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-04-01T19:11:11.698 INFO:teuthology.run_tasks:Running task clock... 2024-04-01T19:11:11.708 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-01T19:11:11.708 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-01T19:11:11.709 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T19:11:11.711 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-01T19:11:11.711 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T19:11:11.713 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-01T19:11:11.713 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T19:11:11.745 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-01T19:11:11.746 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-01T19:11:11.760 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-01T19:11:11.762 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-01T19:11:11.771 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-01T19:11:11.785 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-01T19:11:11.833 INFO:teuthology.orchestra.run.smithi022.stderr:sudo: ntpd: command not found 2024-04-01T19:11:11.837 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: ntpd: command not found 2024-04-01T19:11:11.845 INFO:teuthology.orchestra.run.smithi022.stdout:506 Cannot talk to daemon 2024-04-01T19:11:11.848 INFO:teuthology.orchestra.run.smithi062.stdout:506 Cannot talk to daemon 2024-04-01T19:11:11.861 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-01T19:11:11.862 INFO:teuthology.orchestra.run.smithi188.stderr:sudo: ntpd: command not found 2024-04-01T19:11:11.862 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-01T19:11:11.873 INFO:teuthology.orchestra.run.smithi188.stdout:506 Cannot talk to daemon 2024-04-01T19:11:11.875 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-01T19:11:11.876 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-01T19:11:11.887 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-01T19:11:11.900 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-01T19:11:11.939 INFO:teuthology.orchestra.run.smithi022.stderr:bash: ntpq: command not found 2024-04-01T19:11:11.944 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T19:11:11.944 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2024-04-01T19:11:11.944 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T19:11:11.944 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T19:11:11.945 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T19:11:11.945 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T19:11:11.945 INFO:teuthology.orchestra.run.smithi062.stderr:bash: ntpq: command not found 2024-04-01T19:11:11.948 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T19:11:11.948 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-04-01T19:11:11.948 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T19:11:11.948 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T19:11:11.949 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T19:11:11.949 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T19:11:11.965 INFO:teuthology.orchestra.run.smithi188.stderr:bash: ntpq: command not found 2024-04-01T19:11:11.968 INFO:teuthology.orchestra.run.smithi188.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T19:11:11.968 INFO:teuthology.orchestra.run.smithi188.stdout:=============================================================================== 2024-04-01T19:11:11.968 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T19:11:11.968 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T19:11:11.968 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T19:11:11.969 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T19:11:11.969 INFO:teuthology.run_tasks:Running task pexec... 2024-04-01T19:11:11.979 INFO:teuthology.task.pexec:Executing custom commands... 2024-04-01T19:11:11.979 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi022.front.sepia.ceph.com 2024-04-01T19:11:11.980 DEBUG:teuthology.orchestra.run.smithi022:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-04-01T19:11:11.980 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi062.front.sepia.ceph.com 2024-04-01T19:11:11.980 DEBUG:teuthology.orchestra.run.smithi062:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-04-01T19:11:11.980 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi188.front.sepia.ceph.com 2024-04-01T19:11:11.980 DEBUG:teuthology.orchestra.run.smithi188:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-04-01T19:11:12.768 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:44 ago on Mon 01 Apr 2024 07:09:28 PM UTC. 2024-04-01T19:11:12.773 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:23 ago on Mon 01 Apr 2024 07:09:49 PM UTC. 2024-04-01T19:11:12.783 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:34 ago on Mon 01 Apr 2024 07:09:38 PM UTC. 2024-04-01T19:11:14.834 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-04-01T19:11:14.835 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:11:14.835 INFO:teuthology.orchestra.run.smithi188.stdout: Package Architecture Version Repository Size 2024-04-01T19:11:14.835 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:11:14.835 INFO:teuthology.orchestra.run.smithi188.stdout:Resetting modules: 2024-04-01T19:11:14.835 INFO:teuthology.orchestra.run.smithi188.stdout: container-tools 2024-04-01T19:11:14.835 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:11:14.835 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-04-01T19:11:14.835 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:11:14.835 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:11:15.062 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-01T19:11:15.063 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:11:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2024-04-01T19:11:15.063 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:11:15.063 INFO:teuthology.orchestra.run.smithi022.stdout:Resetting modules: 2024-04-01T19:11:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: container-tools 2024-04-01T19:11:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:11:15.064 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-04-01T19:11:15.064 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:11:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:11:15.067 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-01T19:11:15.069 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:11:15.069 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-04-01T19:11:15.069 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:11:15.069 INFO:teuthology.orchestra.run.smithi062.stdout:Resetting modules: 2024-04-01T19:11:15.069 INFO:teuthology.orchestra.run.smithi062.stdout: container-tools 2024-04-01T19:11:15.069 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:11:15.069 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-01T19:11:15.069 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:11:15.069 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:11:15.082 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-04-01T19:11:15.324 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-01T19:11:15.335 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-01T19:11:15.905 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:47 ago on Mon 01 Apr 2024 07:09:28 PM UTC. 2024-04-01T19:11:16.175 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:27 ago on Mon 01 Apr 2024 07:09:49 PM UTC. 2024-04-01T19:11:16.178 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:38 ago on Mon 01 Apr 2024 07:09:38 PM UTC. 2024-04-01T19:11:18.053 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-04-01T19:11:18.090 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:11:18.090 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-04-01T19:11:18.090 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:11:18.090 INFO:teuthology.orchestra.run.smithi188.stdout:Installing group/module packages: 2024-04-01T19:11:18.090 INFO:teuthology.orchestra.run.smithi188.stdout: aardvark-dns x86_64 2:1.10.0-1.module_el8+871+552be958 appstream 1.0 M 2024-04-01T19:11:18.090 INFO:teuthology.orchestra.run.smithi188.stdout: buildah x86_64 2:1.33.6-2.module_el8+976+11360731 appstream 9.6 M 2024-04-01T19:11:18.091 INFO:teuthology.orchestra.run.smithi188.stdout: cockpit-podman noarch 84.1-1.module_el8+977+8ab54275 appstream 689 k 2024-04-01T19:11:18.091 INFO:teuthology.orchestra.run.smithi188.stdout: crun x86_64 1.14.3-2.module_el8+968+fbb249c7 appstream 258 k 2024-04-01T19:11:18.091 INFO:teuthology.orchestra.run.smithi188.stdout: netavark x86_64 2:1.10.3-1.module_el8+951+32019cde appstream 4.1 M 2024-04-01T19:11:18.091 INFO:teuthology.orchestra.run.smithi188.stdout: python3-podman noarch 4.9.0-1.module_el8+847+7863d4e6 appstream 180 k 2024-04-01T19:11:18.091 INFO:teuthology.orchestra.run.smithi188.stdout: skopeo x86_64 2:1.14.3-0.1.module_el8+885+7da147f3 appstream 8.8 M 2024-04-01T19:11:18.091 INFO:teuthology.orchestra.run.smithi188.stdout: toolbox x86_64 0.0.99.5-2.module_el8+971+3d3df00d appstream 2.5 M 2024-04-01T19:11:18.091 INFO:teuthology.orchestra.run.smithi188.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-04-01T19:11:18.091 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-04-01T19:11:18.091 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-04-01T19:11:18.091 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-04-01T19:11:18.091 INFO:teuthology.orchestra.run.smithi188.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-04-01T19:11:18.091 INFO:teuthology.orchestra.run.smithi188.stdout:Installing weak dependencies: 2024-04-01T19:11:18.091 INFO:teuthology.orchestra.run.smithi188.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2024-04-01T19:11:18.091 INFO:teuthology.orchestra.run.smithi188.stdout:Installing module profiles: 2024-04-01T19:11:18.091 INFO:teuthology.orchestra.run.smithi188.stdout: container-tools/common 2024-04-01T19:11:18.092 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:11:18.092 INFO:teuthology.orchestra.run.smithi188.stdout:Enabling module streams: 2024-04-01T19:11:18.092 INFO:teuthology.orchestra.run.smithi188.stdout: container-tools rhel8 2024-04-01T19:11:18.092 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:11:18.092 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-04-01T19:11:18.092 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:11:18.092 INFO:teuthology.orchestra.run.smithi188.stdout:Install 13 Packages 2024-04-01T19:11:18.092 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:11:18.093 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 27 M 2024-04-01T19:11:18.093 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 91 M 2024-04-01T19:11:18.093 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-04-01T19:11:18.462 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-01T19:11:18.486 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-01T19:11:18.502 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:11:18.502 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2024-04-01T19:11:18.502 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:11:18.502 INFO:teuthology.orchestra.run.smithi022.stdout:Installing group/module packages: 2024-04-01T19:11:18.502 INFO:teuthology.orchestra.run.smithi022.stdout: aardvark-dns x86_64 2:1.10.0-1.module_el8+871+552be958 appstream 1.0 M 2024-04-01T19:11:18.503 INFO:teuthology.orchestra.run.smithi022.stdout: buildah x86_64 2:1.33.6-2.module_el8+976+11360731 appstream 9.6 M 2024-04-01T19:11:18.503 INFO:teuthology.orchestra.run.smithi022.stdout: cockpit-podman noarch 84.1-1.module_el8+977+8ab54275 appstream 689 k 2024-04-01T19:11:18.503 INFO:teuthology.orchestra.run.smithi022.stdout: crun x86_64 1.14.3-2.module_el8+968+fbb249c7 appstream 258 k 2024-04-01T19:11:18.503 INFO:teuthology.orchestra.run.smithi022.stdout: netavark x86_64 2:1.10.3-1.module_el8+951+32019cde appstream 4.1 M 2024-04-01T19:11:18.503 INFO:teuthology.orchestra.run.smithi022.stdout: python3-podman noarch 4.9.0-1.module_el8+847+7863d4e6 appstream 180 k 2024-04-01T19:11:18.503 INFO:teuthology.orchestra.run.smithi022.stdout: skopeo x86_64 2:1.14.3-0.1.module_el8+885+7da147f3 appstream 8.8 M 2024-04-01T19:11:18.503 INFO:teuthology.orchestra.run.smithi022.stdout: toolbox x86_64 0.0.99.5-2.module_el8+971+3d3df00d appstream 2.5 M 2024-04-01T19:11:18.503 INFO:teuthology.orchestra.run.smithi022.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-04-01T19:11:18.503 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-04-01T19:11:18.503 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-04-01T19:11:18.503 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-04-01T19:11:18.503 INFO:teuthology.orchestra.run.smithi022.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-04-01T19:11:18.504 INFO:teuthology.orchestra.run.smithi022.stdout:Installing weak dependencies: 2024-04-01T19:11:18.504 INFO:teuthology.orchestra.run.smithi022.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2024-04-01T19:11:18.504 INFO:teuthology.orchestra.run.smithi022.stdout:Installing module profiles: 2024-04-01T19:11:18.504 INFO:teuthology.orchestra.run.smithi022.stdout: container-tools/common 2024-04-01T19:11:18.504 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:11:18.504 INFO:teuthology.orchestra.run.smithi022.stdout:Enabling module streams: 2024-04-01T19:11:18.504 INFO:teuthology.orchestra.run.smithi022.stdout: container-tools rhel8 2024-04-01T19:11:18.504 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:11:18.504 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-04-01T19:11:18.504 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:11:18.504 INFO:teuthology.orchestra.run.smithi022.stdout:Install 13 Packages 2024-04-01T19:11:18.504 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:11:18.505 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 27 M 2024-04-01T19:11:18.505 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 91 M 2024-04-01T19:11:18.505 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-04-01T19:11:18.526 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:11:18.526 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-01T19:11:18.527 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:11:18.527 INFO:teuthology.orchestra.run.smithi062.stdout:Installing group/module packages: 2024-04-01T19:11:18.527 INFO:teuthology.orchestra.run.smithi062.stdout: aardvark-dns x86_64 2:1.10.0-1.module_el8+871+552be958 appstream 1.0 M 2024-04-01T19:11:18.527 INFO:teuthology.orchestra.run.smithi062.stdout: buildah x86_64 2:1.33.6-2.module_el8+976+11360731 appstream 9.6 M 2024-04-01T19:11:18.527 INFO:teuthology.orchestra.run.smithi062.stdout: cockpit-podman noarch 84.1-1.module_el8+977+8ab54275 appstream 689 k 2024-04-01T19:11:18.527 INFO:teuthology.orchestra.run.smithi062.stdout: crun x86_64 1.14.3-2.module_el8+968+fbb249c7 appstream 258 k 2024-04-01T19:11:18.527 INFO:teuthology.orchestra.run.smithi062.stdout: netavark x86_64 2:1.10.3-1.module_el8+951+32019cde appstream 4.1 M 2024-04-01T19:11:18.527 INFO:teuthology.orchestra.run.smithi062.stdout: python3-podman noarch 4.9.0-1.module_el8+847+7863d4e6 appstream 180 k 2024-04-01T19:11:18.527 INFO:teuthology.orchestra.run.smithi062.stdout: skopeo x86_64 2:1.14.3-0.1.module_el8+885+7da147f3 appstream 8.8 M 2024-04-01T19:11:18.527 INFO:teuthology.orchestra.run.smithi062.stdout: toolbox x86_64 0.0.99.5-2.module_el8+971+3d3df00d appstream 2.5 M 2024-04-01T19:11:18.527 INFO:teuthology.orchestra.run.smithi062.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-04-01T19:11:18.528 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-01T19:11:18.528 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-04-01T19:11:18.528 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-04-01T19:11:18.528 INFO:teuthology.orchestra.run.smithi062.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-04-01T19:11:18.528 INFO:teuthology.orchestra.run.smithi062.stdout:Installing weak dependencies: 2024-04-01T19:11:18.528 INFO:teuthology.orchestra.run.smithi062.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2024-04-01T19:11:18.528 INFO:teuthology.orchestra.run.smithi062.stdout:Installing module profiles: 2024-04-01T19:11:18.528 INFO:teuthology.orchestra.run.smithi062.stdout: container-tools/common 2024-04-01T19:11:18.528 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:11:18.528 INFO:teuthology.orchestra.run.smithi062.stdout:Enabling module streams: 2024-04-01T19:11:18.528 INFO:teuthology.orchestra.run.smithi062.stdout: container-tools rhel8 2024-04-01T19:11:18.528 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:11:18.528 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-01T19:11:18.529 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:11:18.529 INFO:teuthology.orchestra.run.smithi062.stdout:Install 13 Packages 2024-04-01T19:11:18.529 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:11:18.529 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 27 M 2024-04-01T19:11:18.529 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 91 M 2024-04-01T19:11:18.529 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-01T19:11:18.574 INFO:teuthology.orchestra.run.smithi188.stdout:(1/13): cockpit-podman-84.1-1.module_el8+977+8a 2.3 MB/s | 689 kB 00:00 2024-04-01T19:11:18.608 INFO:teuthology.orchestra.run.smithi188.stdout:(2/13): aardvark-dns-1.10.0-1.module_el8+871+55 3.1 MB/s | 1.0 MB 00:00 2024-04-01T19:11:18.633 INFO:teuthology.orchestra.run.smithi188.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 648 kB/s | 38 kB 00:00 2024-04-01T19:11:18.683 INFO:teuthology.orchestra.run.smithi188.stdout:(4/13): crun-1.14.3-2.module_el8+968+fbb249c7.x 3.3 MB/s | 258 kB 00:00 2024-04-01T19:11:18.742 INFO:teuthology.orchestra.run.smithi188.stdout:(5/13): python3-podman-4.9.0-1.module_el8+847+7 3.0 MB/s | 180 kB 00:00 2024-04-01T19:11:18.792 INFO:teuthology.orchestra.run.smithi188.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 494 kB/s | 25 kB 00:00 2024-04-01T19:11:18.859 INFO:teuthology.orchestra.run.smithi188.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 1.4 MB/s | 94 kB 00:00 2024-04-01T19:11:18.885 INFO:teuthology.orchestra.run.smithi022.stdout:(1/13): cockpit-podman-84.1-1.module_el8+977+8a 2.1 MB/s | 689 kB 00:00 2024-04-01T19:11:18.920 INFO:teuthology.orchestra.run.smithi062.stdout:(1/13): cockpit-podman-84.1-1.module_el8+977+8a 2.0 MB/s | 689 kB 00:00 2024-04-01T19:11:18.952 INFO:teuthology.orchestra.run.smithi022.stdout:(2/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 569 kB/s | 38 kB 00:00 2024-04-01T19:11:18.953 INFO:teuthology.orchestra.run.smithi062.stdout:(2/13): aardvark-dns-1.10.0-1.module_el8+871+55 2.8 MB/s | 1.0 MB 00:00 2024-04-01T19:11:18.978 INFO:teuthology.orchestra.run.smithi062.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 649 kB/s | 38 kB 00:00 2024-04-01T19:11:19.001 INFO:teuthology.orchestra.run.smithi188.stdout:(8/13): netavark-1.10.3-1.module_el8+951+32019c 11 MB/s | 4.1 MB 00:00 2024-04-01T19:11:19.020 INFO:teuthology.orchestra.run.smithi062.stdout:(4/13): crun-1.14.3-2.module_el8+968+fbb249c7.x 3.8 MB/s | 258 kB 00:00 2024-04-01T19:11:19.027 INFO:teuthology.orchestra.run.smithi022.stdout:(3/13): crun-1.14.3-2.module_el8+968+fbb249c7.x 3.4 MB/s | 258 kB 00:00 2024-04-01T19:11:19.087 INFO:teuthology.orchestra.run.smithi062.stdout:(5/13): python3-podman-4.9.0-1.module_el8+847+7 2.7 MB/s | 180 kB 00:00 2024-04-01T19:11:19.146 INFO:teuthology.orchestra.run.smithi062.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 424 kB/s | 25 kB 00:00 2024-04-01T19:11:19.229 INFO:teuthology.orchestra.run.smithi062.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 1.1 MB/s | 94 kB 00:00 2024-04-01T19:11:19.235 INFO:teuthology.orchestra.run.smithi188.stdout:(9/13): buildah-1.33.6-2.module_el8+976+1136073 10 MB/s | 9.6 MB 00:00 2024-04-01T19:11:19.285 INFO:teuthology.orchestra.run.smithi188.stdout:(10/13): toolbox-0.0.99.5-2.module_el8+971+3d3d 8.9 MB/s | 2.5 MB 00:00 2024-04-01T19:11:19.285 INFO:teuthology.orchestra.run.smithi022.stdout:(4/13): aardvark-dns-1.10.0-1.module_el8+871+55 1.4 MB/s | 1.0 MB 00:00 2024-04-01T19:11:19.343 INFO:teuthology.orchestra.run.smithi188.stdout:(11/13): udica-0.2.6-20.module_el8+804+f131391c 486 kB/s | 53 kB 00:00 2024-04-01T19:11:19.369 INFO:teuthology.orchestra.run.smithi188.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 490 kB/s | 41 kB 00:00 2024-04-01T19:11:19.469 INFO:teuthology.orchestra.run.smithi022.stdout:(5/13): buildah-1.33.6-2.module_el8+976+1136073 11 MB/s | 9.6 MB 00:00 2024-04-01T19:11:19.495 INFO:teuthology.orchestra.run.smithi022.stdout:(6/13): python3-podman-4.9.0-1.module_el8+847+7 864 kB/s | 180 kB 00:00 2024-04-01T19:11:19.520 INFO:teuthology.orchestra.run.smithi022.stdout:(7/13): python3-pytoml-0.1.14-5.git7dea353.el8. 493 kB/s | 25 kB 00:00 2024-04-01T19:11:19.538 INFO:teuthology.orchestra.run.smithi062.stdout:(8/13): netavark-1.10.3-1.module_el8+951+32019c 7.3 MB/s | 4.1 MB 00:00 2024-04-01T19:11:19.553 INFO:teuthology.orchestra.run.smithi022.stdout:(8/13): python3-pyxdg-0.25-16.el8.noarch.rpm 1.6 MB/s | 94 kB 00:00 2024-04-01T19:11:19.586 INFO:teuthology.orchestra.run.smithi188.stdout:(13/13): skopeo-1.14.3-0.1.module_el8+885+7da14 12 MB/s | 8.8 MB 00:00 2024-04-01T19:11:19.586 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:11:19.586 INFO:teuthology.orchestra.run.smithi188.stdout:Total 18 MB/s | 27 MB 00:01 2024-04-01T19:11:19.612 INFO:teuthology.orchestra.run.smithi022.stdout:(9/13): netavark-1.10.3-1.module_el8+951+32019c 7.0 MB/s | 4.1 MB 00:00 2024-04-01T19:11:19.671 INFO:teuthology.orchestra.run.smithi022.stdout:(10/13): udica-0.2.6-20.module_el8+804+f131391c 903 kB/s | 53 kB 00:00 2024-04-01T19:11:19.729 INFO:teuthology.orchestra.run.smithi022.stdout:(11/13): yajl-2.1.0-12.el8.x86_64.rpm 704 kB/s | 41 kB 00:00 2024-04-01T19:11:19.805 INFO:teuthology.orchestra.run.smithi062.stdout:(9/13): buildah-1.33.6-2.module_el8+976+1136073 7.9 MB/s | 9.6 MB 00:01 2024-04-01T19:11:19.853 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-04-01T19:11:19.864 INFO:teuthology.orchestra.run.smithi062.stdout:(10/13): toolbox-0.0.99.5-2.module_el8+971+3d3d 7.8 MB/s | 2.5 MB 00:00 2024-04-01T19:11:19.874 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-04-01T19:11:19.874 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-04-01T19:11:19.881 INFO:teuthology.orchestra.run.smithi062.stdout:(11/13): udica-0.2.6-20.module_el8+804+f131391c 699 kB/s | 53 kB 00:00 2024-04-01T19:11:19.980 INFO:teuthology.orchestra.run.smithi022.stdout:(12/13): skopeo-1.14.3-0.1.module_el8+885+7da14 19 MB/s | 8.8 MB 00:00 2024-04-01T19:11:19.989 INFO:teuthology.orchestra.run.smithi062.stdout:(12/13): skopeo-1.14.3-0.1.module_el8+885+7da14 12 MB/s | 8.8 MB 00:00 2024-04-01T19:11:20.006 INFO:teuthology.orchestra.run.smithi062.stdout:(13/13): yajl-2.1.0-12.el8.x86_64.rpm 288 kB/s | 41 kB 00:00 2024-04-01T19:11:20.006 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:11:20.006 INFO:teuthology.orchestra.run.smithi062.stdout:Total 19 MB/s | 27 MB 00:01 2024-04-01T19:11:20.128 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-04-01T19:11:20.131 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-04-01T19:11:20.283 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-01T19:11:20.288 INFO:teuthology.orchestra.run.smithi022.stdout:(13/13): toolbox-0.0.99.5-2.module_el8+971+3d3d 3.4 MB/s | 2.5 MB 00:00 2024-04-01T19:11:20.288 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:11:20.288 INFO:teuthology.orchestra.run.smithi022.stdout:Total 15 MB/s | 27 MB 00:01 2024-04-01T19:11:20.306 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-01T19:11:20.307 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-01T19:11:20.568 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-04-01T19:11:20.584 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-01T19:11:20.587 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-01T19:11:20.592 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-04-01T19:11:20.592 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-04-01T19:11:20.827 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-04-01T19:11:20.863 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-04-01T19:11:20.867 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-04-01T19:11:21.341 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-01T19:11:21.593 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-04-01T19:11:21.799 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2024-04-01T19:11:22.017 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2/13 2024-04-01T19:11:22.196 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/13 2024-04-01T19:11:22.309 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2024-04-01T19:11:22.381 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 4/13 2024-04-01T19:11:22.504 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2/13 2024-04-01T19:11:22.582 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2024-04-01T19:11:22.631 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 5/13 2024-04-01T19:11:22.674 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/13 2024-04-01T19:11:22.780 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2/13 2024-04-01T19:11:22.887 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 4/13 2024-04-01T19:11:22.989 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/13 2024-04-01T19:11:23.105 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 5/13 2024-04-01T19:11:23.188 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 6/13 2024-04-01T19:11:23.189 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 4/13 2024-04-01T19:11:23.429 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 5/13 2024-04-01T19:11:23.691 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 6/13 2024-04-01T19:11:24.022 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 6/13 2024-04-01T19:11:24.157 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 7/13 2024-04-01T19:11:24.383 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 8/13 2024-04-01T19:11:24.620 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 9/13 2024-04-01T19:11:24.730 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 7/13 2024-04-01T19:11:24.947 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 8/13 2024-04-01T19:11:25.034 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 7/13 2024-04-01T19:11:25.052 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 10/13 2024-04-01T19:11:25.188 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 9/13 2024-04-01T19:11:25.249 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-04-01T19:11:25.256 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 8/13 2024-04-01T19:11:25.499 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-04-01T19:11:25.597 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 9/13 2024-04-01T19:11:25.619 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 10/13 2024-04-01T19:11:25.678 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-04-01T19:11:25.830 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-04-01T19:11:26.050 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-04-01T19:11:26.052 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 10/13 2024-04-01T19:11:26.102 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-04-01T19:11:26.102 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 1/13 2024-04-01T19:11:26.103 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2/13 2024-04-01T19:11:26.103 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 3/13 2024-04-01T19:11:26.103 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-04-01T19:11:26.103 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 5/13 2024-04-01T19:11:26.103 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 6/13 2024-04-01T19:11:26.103 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 7/13 2024-04-01T19:11:26.103 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2024-04-01T19:11:26.103 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2024-04-01T19:11:26.103 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 10/13 2024-04-01T19:11:26.103 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-04-01T19:11:26.103 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-04-01T19:11:26.291 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-04-01T19:11:26.517 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-04-01T19:11:26.599 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2024-04-01T19:11:26.599 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:11:26.600 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-04-01T19:11:26.600 INFO:teuthology.orchestra.run.smithi188.stdout: aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x86_64 2024-04-01T19:11:26.600 INFO:teuthology.orchestra.run.smithi188.stdout: buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2024-04-01T19:11:26.600 INFO:teuthology.orchestra.run.smithi188.stdout: cockpit-podman-84.1-1.module_el8+977+8ab54275.noarch 2024-04-01T19:11:26.600 INFO:teuthology.orchestra.run.smithi188.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2024-04-01T19:11:26.600 INFO:teuthology.orchestra.run.smithi188.stdout: crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 2024-04-01T19:11:26.600 INFO:teuthology.orchestra.run.smithi188.stdout: netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 2024-04-01T19:11:26.600 INFO:teuthology.orchestra.run.smithi188.stdout: python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch 2024-04-01T19:11:26.600 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-04-01T19:11:26.600 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-04-01T19:11:26.600 INFO:teuthology.orchestra.run.smithi188.stdout: skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2024-04-01T19:11:26.601 INFO:teuthology.orchestra.run.smithi188.stdout: toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 2024-04-01T19:11:26.601 INFO:teuthology.orchestra.run.smithi188.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-04-01T19:11:26.601 INFO:teuthology.orchestra.run.smithi188.stdout: yajl-2.1.0-12.el8.x86_64 2024-04-01T19:11:26.601 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:11:26.601 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-04-01T19:11:26.656 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-04-01T19:11:26.729 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-04-01T19:11:26.873 DEBUG:teuthology.parallel:result is None 2024-04-01T19:11:27.105 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-04-01T19:11:27.105 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 1/13 2024-04-01T19:11:27.105 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2/13 2024-04-01T19:11:27.105 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 3/13 2024-04-01T19:11:27.105 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-04-01T19:11:27.105 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 5/13 2024-04-01T19:11:27.105 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 6/13 2024-04-01T19:11:27.105 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 7/13 2024-04-01T19:11:27.105 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2024-04-01T19:11:27.105 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2024-04-01T19:11:27.105 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 10/13 2024-04-01T19:11:27.105 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-04-01T19:11:27.106 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-04-01T19:11:27.169 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-04-01T19:11:27.170 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 1/13 2024-04-01T19:11:27.170 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2/13 2024-04-01T19:11:27.170 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 3/13 2024-04-01T19:11:27.170 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-04-01T19:11:27.170 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 5/13 2024-04-01T19:11:27.170 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 6/13 2024-04-01T19:11:27.170 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 7/13 2024-04-01T19:11:27.170 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2024-04-01T19:11:27.170 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2024-04-01T19:11:27.170 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 10/13 2024-04-01T19:11:27.170 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-04-01T19:11:27.170 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-04-01T19:11:27.636 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2024-04-01T19:11:27.636 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:11:27.636 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-01T19:11:27.636 INFO:teuthology.orchestra.run.smithi062.stdout: aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x86_64 2024-04-01T19:11:27.637 INFO:teuthology.orchestra.run.smithi062.stdout: buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2024-04-01T19:11:27.637 INFO:teuthology.orchestra.run.smithi062.stdout: cockpit-podman-84.1-1.module_el8+977+8ab54275.noarch 2024-04-01T19:11:27.637 INFO:teuthology.orchestra.run.smithi062.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2024-04-01T19:11:27.637 INFO:teuthology.orchestra.run.smithi062.stdout: crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 2024-04-01T19:11:27.637 INFO:teuthology.orchestra.run.smithi062.stdout: netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 2024-04-01T19:11:27.637 INFO:teuthology.orchestra.run.smithi062.stdout: python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch 2024-04-01T19:11:27.637 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-04-01T19:11:27.637 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-04-01T19:11:27.637 INFO:teuthology.orchestra.run.smithi062.stdout: skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2024-04-01T19:11:27.637 INFO:teuthology.orchestra.run.smithi062.stdout: toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 2024-04-01T19:11:27.637 INFO:teuthology.orchestra.run.smithi062.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-04-01T19:11:27.637 INFO:teuthology.orchestra.run.smithi062.stdout: yajl-2.1.0-12.el8.x86_64 2024-04-01T19:11:27.638 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:11:27.638 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-01T19:11:27.700 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2024-04-01T19:11:27.700 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:11:27.701 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-04-01T19:11:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x86_64 2024-04-01T19:11:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2024-04-01T19:11:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: cockpit-podman-84.1-1.module_el8+977+8ab54275.noarch 2024-04-01T19:11:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2024-04-01T19:11:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 2024-04-01T19:11:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 2024-04-01T19:11:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch 2024-04-01T19:11:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-04-01T19:11:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-04-01T19:11:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2024-04-01T19:11:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 2024-04-01T19:11:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-04-01T19:11:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: yajl-2.1.0-12.el8.x86_64 2024-04-01T19:11:27.702 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:11:27.702 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-01T19:11:27.930 DEBUG:teuthology.parallel:result is None 2024-04-01T19:11:27.991 DEBUG:teuthology.parallel:result is None 2024-04-01T19:11:27.991 INFO:teuthology.run_tasks:Running task install... 2024-04-01T19:11:28.000 DEBUG:teuthology.task.install:project ceph 2024-04-01T19:11:28.000 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e142085d06ebbedb32196116c9f19e2d28f93430'}} 2024-04-01T19:11:28.000 DEBUG:teuthology.task.install:config {'branch': 'nautilus', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'flavor': 'default', 'sha1': 'e142085d06ebbedb32196116c9f19e2d28f93430'} 2024-04-01T19:11:28.000 INFO:teuthology.task.install:Using flavor: default 2024-04-01T19:11:28.006 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-01T19:11:28.006 INFO:teuthology.task.install:extra packages: ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'] 2024-04-01T19:11:28.006 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'nautilus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e142085d06ebbedb32196116c9f19e2d28f93430', 'tag': None, 'wait_for_package': False} 2024-04-01T19:11:28.006 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-01T19:11:28.006 INFO:teuthology.packaging:ref: None 2024-04-01T19:11:28.007 INFO:teuthology.packaging:tag: None 2024-04-01T19:11:28.007 INFO:teuthology.packaging:branch: nautilus 2024-04-01T19:11:28.007 INFO:teuthology.packaging:sha1: e142085d06ebbedb32196116c9f19e2d28f93430 2024-04-01T19:11:28.007 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2024-04-01T19:11:28.008 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'nautilus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e142085d06ebbedb32196116c9f19e2d28f93430', 'tag': None, 'wait_for_package': False} 2024-04-01T19:11:28.009 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-01T19:11:28.009 INFO:teuthology.packaging:ref: None 2024-04-01T19:11:28.009 INFO:teuthology.packaging:tag: None 2024-04-01T19:11:28.009 INFO:teuthology.packaging:branch: nautilus 2024-04-01T19:11:28.009 INFO:teuthology.packaging:sha1: e142085d06ebbedb32196116c9f19e2d28f93430 2024-04-01T19:11:28.009 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2024-04-01T19:11:28.010 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'nautilus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e142085d06ebbedb32196116c9f19e2d28f93430', 'tag': None, 'wait_for_package': False} 2024-04-01T19:11:28.010 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-01T19:11:28.010 INFO:teuthology.packaging:ref: None 2024-04-01T19:11:28.010 INFO:teuthology.packaging:tag: None 2024-04-01T19:11:28.010 INFO:teuthology.packaging:branch: nautilus 2024-04-01T19:11:28.010 INFO:teuthology.packaging:sha1: e142085d06ebbedb32196116c9f19e2d28f93430 2024-04-01T19:11:28.010 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2024-04-01T19:11:28.190 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/ 2024-04-01T19:11:28.190 INFO:teuthology.task.install.rpm:Package version is 14.2.22-0 2024-04-01T19:11:28.204 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/ 2024-04-01T19:11:28.204 INFO:teuthology.task.install.rpm:Package version is 14.2.22-0 2024-04-01T19:11:28.208 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/ 2024-04-01T19:11:28.208 INFO:teuthology.task.install.rpm:Package version is 14.2.22-0 2024-04-01T19:11:28.227 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-01T19:11:28.227 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-01T19:11:28.227 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-01T19:11:28.242 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-01T19:11:28.242 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-01T19:11:28.242 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-01T19:11:28.254 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-01T19:11:28.255 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-01T19:11:28.255 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-01T19:11:28.256 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs on remote rpm x86_64 2024-04-01T19:11:28.256 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-01T19:11:28.256 INFO:teuthology.packaging:ref: None 2024-04-01T19:11:28.256 INFO:teuthology.packaging:tag: None 2024-04-01T19:11:28.256 INFO:teuthology.packaging:branch: nautilus 2024-04-01T19:11:28.256 INFO:teuthology.packaging:sha1: e142085d06ebbedb32196116c9f19e2d28f93430 2024-04-01T19:11:28.257 DEBUG:teuthology.orchestra.run.smithi022:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/nautilus/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-01T19:11:28.275 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs on remote rpm x86_64 2024-04-01T19:11:28.275 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-01T19:11:28.275 INFO:teuthology.packaging:ref: None 2024-04-01T19:11:28.275 INFO:teuthology.packaging:tag: None 2024-04-01T19:11:28.275 INFO:teuthology.packaging:branch: nautilus 2024-04-01T19:11:28.276 INFO:teuthology.packaging:sha1: e142085d06ebbedb32196116c9f19e2d28f93430 2024-04-01T19:11:28.276 DEBUG:teuthology.orchestra.run.smithi188:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/nautilus/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-01T19:11:28.284 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs on remote rpm x86_64 2024-04-01T19:11:28.284 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-01T19:11:28.284 INFO:teuthology.packaging:ref: None 2024-04-01T19:11:28.284 INFO:teuthology.packaging:tag: None 2024-04-01T19:11:28.284 INFO:teuthology.packaging:branch: nautilus 2024-04-01T19:11:28.284 INFO:teuthology.packaging:sha1: e142085d06ebbedb32196116c9f19e2d28f93430 2024-04-01T19:11:28.284 DEBUG:teuthology.orchestra.run.smithi062:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/nautilus/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-01T19:11:28.325 DEBUG:teuthology.orchestra.run.smithi022:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-01T19:11:28.346 DEBUG:teuthology.orchestra.run.smithi188:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-01T19:11:28.352 DEBUG:teuthology.orchestra.run.smithi062:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-01T19:11:28.402 DEBUG:teuthology.orchestra.run.smithi022:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-01T19:11:28.426 DEBUG:teuthology.orchestra.run.smithi188:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-01T19:11:28.430 DEBUG:teuthology.orchestra.run.smithi062:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-01T19:11:28.469 INFO:teuthology.orchestra.run.smithi022.stdout:check_obsoletes = 1 2024-04-01T19:11:28.471 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum clean all 2024-04-01T19:11:28.494 INFO:teuthology.orchestra.run.smithi188.stdout:check_obsoletes = 1 2024-04-01T19:11:28.496 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum clean all 2024-04-01T19:11:28.497 INFO:teuthology.orchestra.run.smithi062.stdout:check_obsoletes = 1 2024-04-01T19:11:28.499 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum clean all 2024-04-01T19:11:28.742 INFO:teuthology.orchestra.run.smithi022.stdout:76 files removed 2024-04-01T19:11:28.768 INFO:teuthology.orchestra.run.smithi188.stdout:76 files removed 2024-04-01T19:11:28.771 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-radosgw 2024-04-01T19:11:28.774 INFO:teuthology.orchestra.run.smithi062.stdout:76 files removed 2024-04-01T19:11:28.798 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-radosgw 2024-04-01T19:11:28.803 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-radosgw 2024-04-01T19:11:29.279 INFO:teuthology.orchestra.run.smithi188.stdout:ceph packages for x86_64 873 kB/s | 65 kB 00:00 2024-04-01T19:11:29.287 INFO:teuthology.orchestra.run.smithi022.stdout:ceph packages for x86_64 761 kB/s | 65 kB 00:00 2024-04-01T19:11:29.317 INFO:teuthology.orchestra.run.smithi062.stdout:ceph packages for x86_64 786 kB/s | 65 kB 00:00 2024-04-01T19:11:29.388 INFO:teuthology.orchestra.run.smithi188.stdout:ceph noarch packages 158 kB/s | 11 kB 00:00 2024-04-01T19:11:29.404 INFO:teuthology.orchestra.run.smithi022.stdout:ceph noarch packages 147 kB/s | 11 kB 00:00 2024-04-01T19:11:29.425 INFO:teuthology.orchestra.run.smithi062.stdout:ceph noarch packages 164 kB/s | 11 kB 00:00 2024-04-01T19:11:29.505 INFO:teuthology.orchestra.run.smithi022.stdout:ceph source packages 24 kB/s | 1.7 kB 00:00 2024-04-01T19:11:29.510 INFO:teuthology.orchestra.run.smithi188.stdout:ceph source packages 18 kB/s | 1.7 kB 00:00 2024-04-01T19:11:29.534 INFO:teuthology.orchestra.run.smithi062.stdout:ceph source packages 21 kB/s | 1.7 kB 00:00 2024-04-01T19:11:31.823 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 8 - AppStream 12 MB/s | 28 MB 00:02 2024-04-01T19:11:31.855 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 8 - AppStream 12 MB/s | 28 MB 00:02 2024-04-01T19:11:31.978 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 8 - AppStream 12 MB/s | 28 MB 00:02 2024-04-01T19:11:38.165 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 8 - BaseOS 7.7 MB/s | 10 MB 00:01 2024-04-01T19:11:38.420 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 8 - BaseOS 8.8 MB/s | 10 MB 00:01 2024-04-01T19:11:38.481 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 8 - BaseOS 7.7 MB/s | 10 MB 00:01 2024-04-01T19:11:40.315 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 8 - Extras 32 kB/s | 18 kB 00:00 2024-04-01T19:11:40.598 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 8 - Extras 42 kB/s | 18 kB 00:00 2024-04-01T19:11:40.662 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 8 - Extras 32 kB/s | 18 kB 00:00 2024-04-01T19:11:40.724 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 8 - Extras common packages 25 kB/s | 7.5 kB 00:00 2024-04-01T19:11:40.946 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 8 - Extras common packages 45 kB/s | 7.5 kB 00:00 2024-04-01T19:11:40.990 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 8 - Extras common packages 27 kB/s | 7.5 kB 00:00 2024-04-01T19:11:41.325 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 8 - PowerTools 9.6 MB/s | 4.9 MB 00:00 2024-04-01T19:11:41.514 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 8 - PowerTools 10 MB/s | 4.9 MB 00:00 2024-04-01T19:11:41.575 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 8 - PowerTools 10 MB/s | 4.9 MB 00:00 2024-04-01T19:11:42.377 INFO:teuthology.orchestra.run.smithi188.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-04-01T19:11:42.649 INFO:teuthology.orchestra.run.smithi062.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2024-04-01T19:11:42.701 INFO:teuthology.orchestra.run.smithi022.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2024-04-01T19:11:44.069 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2024-04-01T19:11:44.455 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 16 MB 00:01 2024-04-01T19:11:45.288 INFO:teuthology.orchestra.run.smithi188.stdout:Extra Packages for Enterprise Linux 5.8 MB/s | 16 MB 00:02 2024-04-01T19:11:48.310 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 146 kB/s | 24 kB 00:00 2024-04-01T19:11:48.477 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 565 kB/s | 24 kB 00:00 2024-04-01T19:11:49.285 INFO:teuthology.orchestra.run.smithi188.stdout:lab-extras 94 kB/s | 24 kB 00:00 2024-04-01T19:11:52.211 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-01T19:11:52.214 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:11:52.214 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-01T19:11:52.214 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:11:52.214 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-01T19:11:52.214 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw x86_64 2:14.2.22-0.el8 ceph 6.0 M 2024-04-01T19:11:52.214 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrading: 2024-04-01T19:11:52.214 INFO:teuthology.orchestra.run.smithi062.stdout: librados2 x86_64 2:14.2.22-0.el8 ceph 3.5 M 2024-04-01T19:11:52.214 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1 x86_64 2:14.2.22-0.el8 ceph 1.7 M 2024-04-01T19:11:52.214 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-01T19:11:52.214 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base x86_64 2:14.2.22-0.el8 ceph 5.4 M 2024-04-01T19:11:52.215 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common x86_64 2:14.2.22-0.el8 ceph 19 M 2024-04-01T19:11:52.215 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux x86_64 2:14.2.22-0.el8 ceph 25 k 2024-04-01T19:11:52.215 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-01T19:11:52.215 INFO:teuthology.orchestra.run.smithi062.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-04-01T19:11:52.215 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2 x86_64 2:14.2.22-0.el8 ceph 520 k 2024-04-01T19:11:52.215 INFO:teuthology.orchestra.run.smithi062.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-01T19:11:52.215 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-01T19:11:52.215 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1 x86_64 2:14.2.22-0.el8 ceph 376 k 2024-04-01T19:11:52.215 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-01T19:11:52.215 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2 x86_64 2:14.2.22-0.el8 ceph 5.3 M 2024-04-01T19:11:52.215 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-01T19:11:52.215 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-01T19:11:52.215 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse x86_64 2:14.2.22-0.el8 ceph 39 k 2024-04-01T19:11:52.216 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs x86_64 2:14.2.22-0.el8 ceph 159 k 2024-04-01T19:11:52.216 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-01T19:11:52.216 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados x86_64 2:14.2.22-0.el8 ceph 323 k 2024-04-01T19:11:52.216 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd x86_64 2:14.2.22-0.el8 ceph 291 k 2024-04-01T19:11:52.216 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw x86_64 2:14.2.22-0.el8 ceph 113 k 2024-04-01T19:11:52.216 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:11:52.216 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-01T19:11:52.216 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:11:52.216 INFO:teuthology.orchestra.run.smithi062.stdout:Install 20 Packages 2024-04-01T19:11:52.216 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrade 2 Packages 2024-04-01T19:11:52.216 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:11:52.217 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 45 M 2024-04-01T19:11:52.217 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-01T19:11:52.557 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-01T19:11:52.560 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:11:52.560 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2024-04-01T19:11:52.560 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:11:52.560 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-04-01T19:11:52.560 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw x86_64 2:14.2.22-0.el8 ceph 6.0 M 2024-04-01T19:11:52.560 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrading: 2024-04-01T19:11:52.561 INFO:teuthology.orchestra.run.smithi022.stdout: librados2 x86_64 2:14.2.22-0.el8 ceph 3.5 M 2024-04-01T19:11:52.561 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1 x86_64 2:14.2.22-0.el8 ceph 1.7 M 2024-04-01T19:11:52.561 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-04-01T19:11:52.561 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base x86_64 2:14.2.22-0.el8 ceph 5.4 M 2024-04-01T19:11:52.561 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common x86_64 2:14.2.22-0.el8 ceph 19 M 2024-04-01T19:11:52.561 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux x86_64 2:14.2.22-0.el8 ceph 25 k 2024-04-01T19:11:52.561 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-01T19:11:52.561 INFO:teuthology.orchestra.run.smithi022.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-04-01T19:11:52.561 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2 x86_64 2:14.2.22-0.el8 ceph 520 k 2024-04-01T19:11:52.561 INFO:teuthology.orchestra.run.smithi022.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-01T19:11:52.561 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-01T19:11:52.561 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1 x86_64 2:14.2.22-0.el8 ceph 376 k 2024-04-01T19:11:52.561 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-01T19:11:52.561 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2 x86_64 2:14.2.22-0.el8 ceph 5.3 M 2024-04-01T19:11:52.561 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-01T19:11:52.562 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-01T19:11:52.562 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse x86_64 2:14.2.22-0.el8 ceph 39 k 2024-04-01T19:11:52.562 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs x86_64 2:14.2.22-0.el8 ceph 159 k 2024-04-01T19:11:52.562 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-01T19:11:52.562 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados x86_64 2:14.2.22-0.el8 ceph 323 k 2024-04-01T19:11:52.562 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd x86_64 2:14.2.22-0.el8 ceph 291 k 2024-04-01T19:11:52.562 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw x86_64 2:14.2.22-0.el8 ceph 113 k 2024-04-01T19:11:52.562 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:11:52.562 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-04-01T19:11:52.562 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:11:52.562 INFO:teuthology.orchestra.run.smithi022.stdout:Install 20 Packages 2024-04-01T19:11:52.562 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrade 2 Packages 2024-04-01T19:11:52.563 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:11:52.563 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 45 M 2024-04-01T19:11:52.563 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-04-01T19:11:52.915 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-04-01T19:11:52.918 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:11:52.918 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-04-01T19:11:52.918 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:11:52.918 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-04-01T19:11:52.918 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-radosgw x86_64 2:14.2.22-0.el8 ceph 6.0 M 2024-04-01T19:11:52.918 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrading: 2024-04-01T19:11:52.918 INFO:teuthology.orchestra.run.smithi188.stdout: librados2 x86_64 2:14.2.22-0.el8 ceph 3.5 M 2024-04-01T19:11:52.918 INFO:teuthology.orchestra.run.smithi188.stdout: librbd1 x86_64 2:14.2.22-0.el8 ceph 1.7 M 2024-04-01T19:11:52.918 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-04-01T19:11:52.918 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base x86_64 2:14.2.22-0.el8 ceph 5.4 M 2024-04-01T19:11:52.918 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-common x86_64 2:14.2.22-0.el8 ceph 19 M 2024-04-01T19:11:52.919 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-selinux x86_64 2:14.2.22-0.el8 ceph 25 k 2024-04-01T19:11:52.919 INFO:teuthology.orchestra.run.smithi188.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-01T19:11:52.919 INFO:teuthology.orchestra.run.smithi188.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-04-01T19:11:52.919 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs2 x86_64 2:14.2.22-0.el8 ceph 520 k 2024-04-01T19:11:52.919 INFO:teuthology.orchestra.run.smithi188.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-01T19:11:52.919 INFO:teuthology.orchestra.run.smithi188.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-01T19:11:52.919 INFO:teuthology.orchestra.run.smithi188.stdout: libradosstriper1 x86_64 2:14.2.22-0.el8 ceph 376 k 2024-04-01T19:11:52.919 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-01T19:11:52.919 INFO:teuthology.orchestra.run.smithi188.stdout: librgw2 x86_64 2:14.2.22-0.el8 ceph 5.3 M 2024-04-01T19:11:52.919 INFO:teuthology.orchestra.run.smithi188.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-01T19:11:52.919 INFO:teuthology.orchestra.run.smithi188.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-01T19:11:52.919 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse x86_64 2:14.2.22-0.el8 ceph 39 k 2024-04-01T19:11:52.919 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cephfs x86_64 2:14.2.22-0.el8 ceph 159 k 2024-04-01T19:11:52.919 INFO:teuthology.orchestra.run.smithi188.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-01T19:11:52.920 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rados x86_64 2:14.2.22-0.el8 ceph 323 k 2024-04-01T19:11:52.920 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rbd x86_64 2:14.2.22-0.el8 ceph 291 k 2024-04-01T19:11:52.920 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rgw x86_64 2:14.2.22-0.el8 ceph 113 k 2024-04-01T19:11:52.920 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:11:52.920 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-04-01T19:11:52.920 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:11:52.920 INFO:teuthology.orchestra.run.smithi188.stdout:Install 20 Packages 2024-04-01T19:11:52.920 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrade 2 Packages 2024-04-01T19:11:52.920 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:11:52.920 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 45 M 2024-04-01T19:11:52.921 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-04-01T19:11:53.001 INFO:teuthology.orchestra.run.smithi062.stdout:(1/22): ceph-base-14.2.22-0.el8.x86_64.rpm 16 MB/s | 5.4 MB 00:00 2024-04-01T19:11:53.027 INFO:teuthology.orchestra.run.smithi062.stdout:(2/22): ceph-selinux-14.2.22-0.el8.x86_64.rpm 987 kB/s | 25 kB 00:00 2024-04-01T19:11:53.060 INFO:teuthology.orchestra.run.smithi062.stdout:(3/22): libcephfs2-14.2.22-0.el8.x86_64.rpm 15 MB/s | 520 kB 00:00 2024-04-01T19:11:53.094 INFO:teuthology.orchestra.run.smithi062.stdout:(4/22): libradosstriper1-14.2.22-0.el8.x86_64.r 11 MB/s | 376 kB 00:00 2024-04-01T19:11:53.162 INFO:teuthology.orchestra.run.smithi022.stdout:(1/22): ceph-base-14.2.22-0.el8.x86_64.rpm 40 MB/s | 5.4 MB 00:00 2024-04-01T19:11:53.187 INFO:teuthology.orchestra.run.smithi022.stdout:(2/22): ceph-selinux-14.2.22-0.el8.x86_64.rpm 1.0 MB/s | 25 kB 00:00 2024-04-01T19:11:53.203 INFO:teuthology.orchestra.run.smithi062.stdout:(5/22): ceph-radosgw-14.2.22-0.el8.x86_64.rpm 11 MB/s | 6.0 MB 00:00 2024-04-01T19:11:53.221 INFO:teuthology.orchestra.run.smithi022.stdout:(3/22): libcephfs2-14.2.22-0.el8.x86_64.rpm 15 MB/s | 520 kB 00:00 2024-04-01T19:11:53.228 INFO:teuthology.orchestra.run.smithi062.stdout:(6/22): python3-ceph-argparse-14.2.22-0.el8.x86 1.6 MB/s | 39 kB 00:00 2024-04-01T19:11:53.253 INFO:teuthology.orchestra.run.smithi062.stdout:(7/22): python3-cephfs-14.2.22-0.el8.x86_64.rpm 6.2 MB/s | 159 kB 00:00 2024-04-01T19:11:53.262 INFO:teuthology.orchestra.run.smithi022.stdout:(4/22): libradosstriper1-14.2.22-0.el8.x86_64.r 8.9 MB/s | 376 kB 00:00 2024-04-01T19:11:53.295 INFO:teuthology.orchestra.run.smithi062.stdout:(8/22): python3-rados-14.2.22-0.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2024-04-01T19:11:53.329 INFO:teuthology.orchestra.run.smithi062.stdout:(9/22): python3-rbd-14.2.22-0.el8.x86_64.rpm 8.5 MB/s | 291 kB 00:00 2024-04-01T19:11:53.346 INFO:teuthology.orchestra.run.smithi022.stdout:(5/22): ceph-radosgw-14.2.22-0.el8.x86_64.rpm 19 MB/s | 6.0 MB 00:00 2024-04-01T19:11:53.354 INFO:teuthology.orchestra.run.smithi062.stdout:(10/22): python3-rgw-14.2.22-0.el8.x86_64.rpm 4.4 MB/s | 113 kB 00:00 2024-04-01T19:11:53.371 INFO:teuthology.orchestra.run.smithi022.stdout:(6/22): python3-ceph-argparse-14.2.22-0.el8.x86 1.5 MB/s | 39 kB 00:00 2024-04-01T19:11:53.405 INFO:teuthology.orchestra.run.smithi022.stdout:(7/22): python3-cephfs-14.2.22-0.el8.x86_64.rpm 4.7 MB/s | 159 kB 00:00 2024-04-01T19:11:53.438 INFO:teuthology.orchestra.run.smithi062.stdout:(11/22): librgw2-14.2.22-0.el8.x86_64.rpm 15 MB/s | 5.3 MB 00:00 2024-04-01T19:11:53.438 INFO:teuthology.orchestra.run.smithi022.stdout:(8/22): python3-rados-14.2.22-0.el8.x86_64.rpm 9.5 MB/s | 323 kB 00:00 2024-04-01T19:11:53.472 INFO:teuthology.orchestra.run.smithi022.stdout:(9/22): python3-rbd-14.2.22-0.el8.x86_64.rpm 8.6 MB/s | 291 kB 00:00 2024-04-01T19:11:53.489 INFO:teuthology.orchestra.run.smithi022.stdout:(10/22): python3-rgw-14.2.22-0.el8.x86_64.rpm 6.6 MB/s | 113 kB 00:00 2024-04-01T19:11:53.628 INFO:teuthology.orchestra.run.smithi188.stdout:(1/22): ceph-radosgw-14.2.22-0.el8.x86_64.rpm 43 MB/s | 6.0 MB 00:00 2024-04-01T19:11:53.631 INFO:teuthology.orchestra.run.smithi022.stdout:(11/22): librgw2-14.2.22-0.el8.x86_64.rpm 14 MB/s | 5.3 MB 00:00 2024-04-01T19:11:53.661 INFO:teuthology.orchestra.run.smithi188.stdout:(2/22): ceph-selinux-14.2.22-0.el8.x86_64.rpm 745 kB/s | 25 kB 00:00 2024-04-01T19:11:53.698 INFO:teuthology.orchestra.run.smithi062.stdout:(12/22): ceph-common-14.2.22-0.el8.x86_64.rpm 19 MB/s | 19 MB 00:01 2024-04-01T19:11:53.703 INFO:teuthology.orchestra.run.smithi188.stdout:(3/22): libcephfs2-14.2.22-0.el8.x86_64.rpm 12 MB/s | 520 kB 00:00 2024-04-01T19:11:53.728 INFO:teuthology.orchestra.run.smithi188.stdout:(4/22): libradosstriper1-14.2.22-0.el8.x86_64.r 15 MB/s | 376 kB 00:00 2024-04-01T19:11:53.788 INFO:teuthology.orchestra.run.smithi062.stdout:(13/22): lttng-ust-2.8.1-11.el8.x86_64.rpm 741 kB/s | 259 kB 00:00 2024-04-01T19:11:53.820 INFO:teuthology.orchestra.run.smithi188.stdout:(5/22): ceph-base-14.2.22-0.el8.x86_64.rpm 16 MB/s | 5.4 MB 00:00 2024-04-01T19:11:53.846 INFO:teuthology.orchestra.run.smithi188.stdout:(6/22): python3-ceph-argparse-14.2.22-0.el8.x86 1.5 MB/s | 39 kB 00:00 2024-04-01T19:11:53.855 INFO:teuthology.orchestra.run.smithi062.stdout:(14/22): python3-prettytable-0.7.2-14.el8.noarc 277 kB/s | 44 kB 00:00 2024-04-01T19:11:53.856 INFO:teuthology.orchestra.run.smithi022.stdout:(12/22): ceph-common-14.2.22-0.el8.x86_64.rpm 23 MB/s | 19 MB 00:00 2024-04-01T19:11:53.863 INFO:teuthology.orchestra.run.smithi188.stdout:(7/22): python3-cephfs-14.2.22-0.el8.x86_64.rpm 9.3 MB/s | 159 kB 00:00 2024-04-01T19:11:53.896 INFO:teuthology.orchestra.run.smithi188.stdout:(8/22): python3-rados-14.2.22-0.el8.x86_64.rpm 9.5 MB/s | 323 kB 00:00 2024-04-01T19:11:53.897 INFO:teuthology.orchestra.run.smithi062.stdout:(15/22): librdkafka-1.6.1-1.el8.x86_64.rpm 1.2 MB/s | 677 kB 00:00 2024-04-01T19:11:53.922 INFO:teuthology.orchestra.run.smithi188.stdout:(9/22): python3-rbd-14.2.22-0.el8.x86_64.rpm 11 MB/s | 291 kB 00:00 2024-04-01T19:11:53.947 INFO:teuthology.orchestra.run.smithi188.stdout:(10/22): python3-rgw-14.2.22-0.el8.x86_64.rpm 4.4 MB/s | 113 kB 00:00 2024-04-01T19:11:53.965 INFO:teuthology.orchestra.run.smithi022.stdout:(13/22): librdkafka-1.6.1-1.el8.x86_64.rpm 1.4 MB/s | 677 kB 00:00 2024-04-01T19:11:54.015 INFO:teuthology.orchestra.run.smithi022.stdout:(14/22): python3-prettytable-0.7.2-14.el8.noarc 277 kB/s | 44 kB 00:00 2024-04-01T19:11:54.031 INFO:teuthology.orchestra.run.smithi188.stdout:(11/22): librgw2-14.2.22-0.el8.x86_64.rpm 17 MB/s | 5.3 MB 00:00 2024-04-01T19:11:54.049 INFO:teuthology.orchestra.run.smithi022.stdout:(15/22): lttng-ust-2.8.1-11.el8.x86_64.rpm 622 kB/s | 259 kB 00:00 2024-04-01T19:11:54.073 INFO:teuthology.orchestra.run.smithi062.stdout:(16/22): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2024-04-01T19:11:54.098 INFO:teuthology.orchestra.run.smithi062.stdout:(17/22): leveldb-1.22-1.el8.x86_64.rpm 925 kB/s | 181 kB 00:00 2024-04-01T19:11:54.124 INFO:teuthology.orchestra.run.smithi062.stdout:(18/22): liboath-2.6.2-3.el8.x86_64.rpm 1.1 MB/s | 59 kB 00:00 2024-04-01T19:11:54.157 INFO:teuthology.orchestra.run.smithi062.stdout:(19/22): libunwind-1.3.1-3.el8.x86_64.rpm 1.2 MB/s | 75 kB 00:00 2024-04-01T19:11:54.182 INFO:teuthology.orchestra.run.smithi062.stdout:(20/22): librabbitmq-0.9.0-5.el8.x86_64.rpm 119 kB/s | 47 kB 00:00 2024-04-01T19:11:54.265 INFO:teuthology.orchestra.run.smithi062.stdout:(21/22): librbd1-14.2.22-0.el8.x86_64.rpm 16 MB/s | 1.7 MB 00:00 2024-04-01T19:11:54.324 INFO:teuthology.orchestra.run.smithi188.stdout:(12/22): ceph-common-14.2.22-0.el8.x86_64.rpm 23 MB/s | 19 MB 00:00 2024-04-01T19:11:54.333 INFO:teuthology.orchestra.run.smithi062.stdout:(22/22): librados2-14.2.22-0.el8.x86_64.rpm 17 MB/s | 3.5 MB 00:00 2024-04-01T19:11:54.337 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:11:54.337 INFO:teuthology.orchestra.run.smithi062.stdout:Total 21 MB/s | 45 MB 00:02 2024-04-01T19:11:54.373 INFO:teuthology.orchestra.run.smithi022.stdout:(16/22): librabbitmq-0.9.0-5.el8.x86_64.rpm 115 kB/s | 47 kB 00:00 2024-04-01T19:11:54.383 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-01T19:11:54.435 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-01T19:11:54.436 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-01T19:11:54.739 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-01T19:11:54.740 INFO:teuthology.orchestra.run.smithi188.stdout:(13/22): librdkafka-1.6.1-1.el8.x86_64.rpm 854 kB/s | 677 kB 00:00 2024-04-01T19:11:54.743 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-01T19:11:55.076 INFO:teuthology.orchestra.run.smithi188.stdout:(14/22): python3-prettytable-0.7.2-14.el8.noarc 58 kB/s | 44 kB 00:00 2024-04-01T19:11:55.083 INFO:teuthology.orchestra.run.smithi022.stdout:(17/22): liboath-2.6.2-3.el8.x86_64.rpm 83 kB/s | 59 kB 00:00 2024-04-01T19:11:55.217 INFO:teuthology.orchestra.run.smithi022.stdout:(18/22): leveldb-1.22-1.el8.x86_64.rpm 155 kB/s | 181 kB 00:01 2024-04-01T19:11:55.266 INFO:teuthology.orchestra.run.smithi188.stdout:(15/22): lttng-ust-2.8.1-11.el8.x86_64.rpm 210 kB/s | 259 kB 00:01 2024-04-01T19:11:55.292 INFO:teuthology.orchestra.run.smithi022.stdout:(19/22): librados2-14.2.22-0.el8.x86_64.rpm 47 MB/s | 3.5 MB 00:00 2024-04-01T19:11:55.317 INFO:teuthology.orchestra.run.smithi022.stdout:(20/22): libunwind-1.3.1-3.el8.x86_64.rpm 321 kB/s | 75 kB 00:00 2024-04-01T19:11:55.367 INFO:teuthology.orchestra.run.smithi022.stdout:(21/22): librbd1-14.2.22-0.el8.x86_64.rpm 23 MB/s | 1.7 MB 00:00 2024-04-01T19:11:55.467 INFO:teuthology.orchestra.run.smithi022.stdout:(22/22): gperftools-libs-2.7-9.el8.x86_64.rpm 211 kB/s | 306 kB 00:01 2024-04-01T19:11:55.472 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:11:55.472 INFO:teuthology.orchestra.run.smithi022.stdout:Total 15 MB/s | 45 MB 00:02 2024-04-01T19:11:55.516 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-04-01T19:11:55.533 INFO:teuthology.orchestra.run.smithi188.stdout:(16/22): librabbitmq-0.9.0-5.el8.x86_64.rpm 59 kB/s | 47 kB 00:00 2024-04-01T19:11:55.569 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-04-01T19:11:55.569 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-04-01T19:11:55.672 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-01T19:11:55.873 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/24 2024-04-01T19:11:55.890 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-04-01T19:11:55.893 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-04-01T19:11:56.061 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/24 2024-04-01T19:11:56.333 INFO:teuthology.orchestra.run.smithi188.stdout:(17/22): liboath-2.6.2-3.el8.x86_64.rpm 73 kB/s | 59 kB 00:00 2024-04-01T19:11:56.439 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/24 2024-04-01T19:11:56.669 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librados2-2:14.2.22-0.el8.x86_64 3/24 2024-04-01T19:11:56.745 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:14.2.22-0.el8.x86_64 3/24 2024-04-01T19:11:56.865 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-04-01T19:11:56.963 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rados-2:14.2.22-0.el8.x86_64 4/24 2024-04-01T19:11:57.066 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/24 2024-04-01T19:11:57.127 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2024-04-01T19:11:57.248 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/24 2024-04-01T19:11:57.332 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2024-04-01T19:11:57.535 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librbd1-2:14.2.22-0.el8.x86_64 6/24 2024-04-01T19:11:57.607 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:14.2.22-0.el8.x86_64 6/24 2024-04-01T19:11:57.639 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/24 2024-04-01T19:11:58.223 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/24 2024-04-01T19:11:58.318 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librados2-2:14.2.22-0.el8.x86_64 3/24 2024-04-01T19:11:58.642 INFO:teuthology.orchestra.run.smithi188.stdout:(18/22): libunwind-1.3.1-3.el8.x86_64.rpm 33 kB/s | 75 kB 00:02 2024-04-01T19:11:58.667 INFO:teuthology.orchestra.run.smithi188.stdout:(19/22): leveldb-1.22-1.el8.x86_64.rpm 53 kB/s | 181 kB 00:03 2024-04-01T19:11:58.673 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:14.2.22-0.el8.x86_64 3/24 2024-04-01T19:11:58.692 INFO:teuthology.orchestra.run.smithi188.stdout:(20/22): gperftools-libs-2.7-9.el8.x86_64.rpm 85 kB/s | 306 kB 00:03 2024-04-01T19:11:58.742 INFO:teuthology.orchestra.run.smithi188.stdout:(21/22): librbd1-14.2.22-0.el8.x86_64.rpm 23 MB/s | 1.7 MB 00:00 2024-04-01T19:11:58.801 INFO:teuthology.orchestra.run.smithi188.stdout:(22/22): librados2-14.2.22-0.el8.x86_64.rpm 22 MB/s | 3.5 MB 00:00 2024-04-01T19:11:58.806 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:11:58.806 INFO:teuthology.orchestra.run.smithi188.stdout:Total 7.6 MB/s | 45 MB 00:05 2024-04-01T19:11:58.847 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-04-01T19:11:58.876 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rados-2:14.2.22-0.el8.x86_64 4/24 2024-04-01T19:11:58.895 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-04-01T19:11:58.895 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-04-01T19:11:58.912 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librgw2-2:14.2.22-0.el8.x86_64 8/24 2024-04-01T19:11:59.081 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2024-04-01T19:11:59.208 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-04-01T19:11:59.211 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-04-01T19:11:59.299 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librgw2-2:14.2.22-0.el8.x86_64 8/24 2024-04-01T19:11:59.300 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2024-04-01T19:11:59.489 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librbd1-2:14.2.22-0.el8.x86_64 6/24 2024-04-01T19:11:59.507 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : leveldb-1.22-1.el8.x86_64 9/24 2024-04-01T19:11:59.557 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:14.2.22-0.el8.x86_64 6/24 2024-04-01T19:11:59.733 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 10/24 2024-04-01T19:11:59.914 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cephfs-2:14.2.22-0.el8.x86_64 11/24 2024-04-01T19:12:00.116 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rgw-2:14.2.22-0.el8.x86_64 12/24 2024-04-01T19:12:00.128 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-04-01T19:12:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/24 2024-04-01T19:12:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librgw2-2:14.2.22-0.el8.x86_64 8/24 2024-04-01T19:12:00.354 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rbd-2:14.2.22-0.el8.x86_64 13/24 2024-04-01T19:12:00.387 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/24 2024-04-01T19:12:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librgw2-2:14.2.22-0.el8.x86_64 8/24 2024-04-01T19:12:00.493 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libradosstriper1-2:14.2.22-0.el8.x86_64 14/24 2024-04-01T19:12:00.553 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libradosstriper1-2:14.2.22-0.el8.x86_64 14/24 2024-04-01T19:12:00.571 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/24 2024-04-01T19:12:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : leveldb-1.22-1.el8.x86_64 9/24 2024-04-01T19:12:00.756 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 15/24 2024-04-01T19:12:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 10/24 2024-04-01T19:12:00.943 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/24 2024-04-01T19:12:00.953 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 16/24 2024-04-01T19:12:01.018 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cephfs-2:14.2.22-0.el8.x86_64 11/24 2024-04-01T19:12:01.141 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 17/24 2024-04-01T19:12:01.170 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : librados2-2:14.2.22-0.el8.x86_64 3/24 2024-04-01T19:12:01.211 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rgw-2:14.2.22-0.el8.x86_64 12/24 2024-04-01T19:12:01.261 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados2-2:14.2.22-0.el8.x86_64 3/24 2024-04-01T19:12:01.294 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 18/24 2024-04-01T19:12:01.436 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rbd-2:14.2.22-0.el8.x86_64 13/24 2024-04-01T19:12:01.470 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rados-2:14.2.22-0.el8.x86_64 4/24 2024-04-01T19:12:01.597 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libradosstriper1-2:14.2.22-0.el8.x86_64 14/24 2024-04-01T19:12:01.662 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2024-04-01T19:12:01.667 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libradosstriper1-2:14.2.22-0.el8.x86_64 14/24 2024-04-01T19:12:01.868 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 15/24 2024-04-01T19:12:01.913 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2024-04-01T19:12:02.031 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 16/24 2024-04-01T19:12:02.128 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : librbd1-2:14.2.22-0.el8.x86_64 6/24 2024-04-01T19:12:02.198 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librbd1-2:14.2.22-0.el8.x86_64 6/24 2024-04-01T19:12:02.262 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 17/24 2024-04-01T19:12:02.415 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 18/24 2024-04-01T19:12:02.801 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/24 2024-04-01T19:12:02.962 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librgw2-2:14.2.22-0.el8.x86_64 8/24 2024-04-01T19:12:03.037 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librgw2-2:14.2.22-0.el8.x86_64 8/24 2024-04-01T19:12:03.241 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : leveldb-1.22-1.el8.x86_64 9/24 2024-04-01T19:12:03.404 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 10/24 2024-04-01T19:12:03.494 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 19/24 2024-04-01T19:12:03.598 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cephfs-2:14.2.22-0.el8.x86_64 11/24 2024-04-01T19:12:03.677 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-common-2:14.2.22-0.el8.x86_64 19/24 2024-04-01T19:12:03.798 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rgw-2:14.2.22-0.el8.x86_64 12/24 2024-04-01T19:12:04.001 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rbd-2:14.2.22-0.el8.x86_64 13/24 2024-04-01T19:12:04.154 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libradosstriper1-2:14.2.22-0.el8.x86_64 14/24 2024-04-01T19:12:04.225 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libradosstriper1-2:14.2.22-0.el8.x86_64 14/24 2024-04-01T19:12:04.337 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 19/24 2024-04-01T19:12:04.429 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 15/24 2024-04-01T19:12:04.561 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 19/24 2024-04-01T19:12:04.636 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 16/24 2024-04-01T19:12:04.704 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-base-2:14.2.22-0.el8.x86_64 20/24 2024-04-01T19:12:04.781 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-common-2:14.2.22-0.el8.x86_64 19/24 2024-04-01T19:12:04.804 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-base-2:14.2.22-0.el8.x86_64 20/24 2024-04-01T19:12:04.836 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 17/24 2024-04-01T19:12:04.945 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-selinux-2:14.2.22-0.el8.x86_64 21/24 2024-04-01T19:12:04.995 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 18/24 2024-04-01T19:12:05.431 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 19/24 2024-04-01T19:12:05.686 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-base-2:14.2.22-0.el8.x86_64 20/24 2024-04-01T19:12:05.794 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-base-2:14.2.22-0.el8.x86_64 20/24 2024-04-01T19:12:05.947 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-selinux-2:14.2.22-0.el8.x86_64 21/24 2024-04-01T19:12:07.121 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 19/24 2024-04-01T19:12:07.370 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-common-2:14.2.22-0.el8.x86_64 19/24 2024-04-01T19:12:08.011 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 19/24 2024-04-01T19:12:08.311 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-base-2:14.2.22-0.el8.x86_64 20/24 2024-04-01T19:12:08.416 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-base-2:14.2.22-0.el8.x86_64 20/24 2024-04-01T19:12:08.569 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-selinux-2:14.2.22-0.el8.x86_64 21/24 2024-04-01T19:12:25.011 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-selinux-2:14.2.22-0.el8.x86_64 21/24 2024-04-01T19:12:25.011 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /sys 2024-04-01T19:12:25.011 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /proc 2024-04-01T19:12:25.011 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /dev 2024-04-01T19:12:25.011 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /run 2024-04-01T19:12:25.012 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /mnt 2024-04-01T19:12:25.012 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /var/tmp 2024-04-01T19:12:25.012 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /home 2024-04-01T19:12:25.012 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /tmp 2024-04-01T19:12:25.012 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /dev 2024-04-01T19:12:25.012 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:12:25.701 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-selinux-2:14.2.22-0.el8.x86_64 21/24 2024-04-01T19:12:25.701 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /sys 2024-04-01T19:12:25.702 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /proc 2024-04-01T19:12:25.702 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /dev 2024-04-01T19:12:25.702 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /run 2024-04-01T19:12:25.702 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /mnt 2024-04-01T19:12:25.702 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /var/tmp 2024-04-01T19:12:25.702 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /home 2024-04-01T19:12:25.702 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /tmp 2024-04-01T19:12:25.702 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /dev 2024-04-01T19:12:25.702 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:12:25.792 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-radosgw-2:14.2.22-0.el8.x86_64 22/24 2024-04-01T19:12:25.813 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-radosgw-2:14.2.22-0.el8.x86_64 22/24 2024-04-01T19:12:25.813 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 23/24 2024-04-01T19:12:26.016 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 23/24 2024-04-01T19:12:26.016 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 24/24 2024-04-01T19:12:26.424 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-radosgw-2:14.2.22-0.el8.x86_64 22/24 2024-04-01T19:12:26.445 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-radosgw-2:14.2.22-0.el8.x86_64 22/24 2024-04-01T19:12:26.445 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 23/24 2024-04-01T19:12:26.661 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 23/24 2024-04-01T19:12:26.661 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 24/24 2024-04-01T19:12:26.701 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 24/24 2024-04-01T19:12:26.701 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-base-2:14.2.22-0.el8.x86_64 1/24 2024-04-01T19:12:26.702 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-common-2:14.2.22-0.el8.x86_64 2/24 2024-04-01T19:12:26.702 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-radosgw-2:14.2.22-0.el8.x86_64 3/24 2024-04-01T19:12:26.702 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-selinux-2:14.2.22-0.el8.x86_64 4/24 2024-04-01T19:12:26.702 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2024-04-01T19:12:26.702 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libradosstriper1-2:14.2.22-0.el8.x86_64 6/24 2024-04-01T19:12:26.702 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librgw2-2:14.2.22-0.el8.x86_64 7/24 2024-04-01T19:12:26.702 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 8/24 2024-04-01T19:12:26.702 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cephfs-2:14.2.22-0.el8.x86_64 9/24 2024-04-01T19:12:26.702 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rados-2:14.2.22-0.el8.x86_64 10/24 2024-04-01T19:12:26.702 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rbd-2:14.2.22-0.el8.x86_64 11/24 2024-04-01T19:12:26.702 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rgw-2:14.2.22-0.el8.x86_64 12/24 2024-04-01T19:12:26.702 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 13/24 2024-04-01T19:12:26.703 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 14/24 2024-04-01T19:12:26.703 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 15/24 2024-04-01T19:12:26.703 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 16/24 2024-04-01T19:12:26.703 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 17/24 2024-04-01T19:12:26.703 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : leveldb-1.22-1.el8.x86_64 18/24 2024-04-01T19:12:26.703 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/24 2024-04-01T19:12:26.703 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/24 2024-04-01T19:12:26.703 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:14.2.22-0.el8.x86_64 21/24 2024-04-01T19:12:26.703 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 22/24 2024-04-01T19:12:26.703 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:14.2.22-0.el8.x86_64 23/24 2024-04-01T19:12:27.392 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 24/24 2024-04-01T19:12:27.392 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-base-2:14.2.22-0.el8.x86_64 1/24 2024-04-01T19:12:27.392 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-common-2:14.2.22-0.el8.x86_64 2/24 2024-04-01T19:12:27.392 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-radosgw-2:14.2.22-0.el8.x86_64 3/24 2024-04-01T19:12:27.392 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-selinux-2:14.2.22-0.el8.x86_64 4/24 2024-04-01T19:12:27.392 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2024-04-01T19:12:27.392 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libradosstriper1-2:14.2.22-0.el8.x86_64 6/24 2024-04-01T19:12:27.392 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librgw2-2:14.2.22-0.el8.x86_64 7/24 2024-04-01T19:12:27.393 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 8/24 2024-04-01T19:12:27.393 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cephfs-2:14.2.22-0.el8.x86_64 9/24 2024-04-01T19:12:27.393 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rados-2:14.2.22-0.el8.x86_64 10/24 2024-04-01T19:12:27.393 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rbd-2:14.2.22-0.el8.x86_64 11/24 2024-04-01T19:12:27.393 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rgw-2:14.2.22-0.el8.x86_64 12/24 2024-04-01T19:12:27.393 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 13/24 2024-04-01T19:12:27.393 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 14/24 2024-04-01T19:12:27.393 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 15/24 2024-04-01T19:12:27.393 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 16/24 2024-04-01T19:12:27.393 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 17/24 2024-04-01T19:12:27.393 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : leveldb-1.22-1.el8.x86_64 18/24 2024-04-01T19:12:27.393 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/24 2024-04-01T19:12:27.393 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/24 2024-04-01T19:12:27.393 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:14.2.22-0.el8.x86_64 21/24 2024-04-01T19:12:27.393 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 22/24 2024-04-01T19:12:27.394 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:14.2.22-0.el8.x86_64 23/24 2024-04-01T19:12:27.514 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 24/24 2024-04-01T19:12:27.514 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:12:27.514 INFO:teuthology.orchestra.run.smithi062.stdout:Upgraded: 2024-04-01T19:12:27.514 INFO:teuthology.orchestra.run.smithi062.stdout: librados2-2:14.2.22-0.el8.x86_64 librbd1-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:27.514 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-01T19:12:27.514 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:27.514 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:27.515 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:27.515 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:27.515 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-01T19:12:27.515 INFO:teuthology.orchestra.run.smithi062.stdout: leveldb-1.22-1.el8.x86_64 2024-04-01T19:12:27.515 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:27.515 INFO:teuthology.orchestra.run.smithi062.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-01T19:12:27.515 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-01T19:12:27.515 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:27.515 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-01T19:12:27.515 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:27.515 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-01T19:12:27.515 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-01T19:12:27.515 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:27.516 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:27.516 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-01T19:12:27.516 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:27.516 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:27.516 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:27.516 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:12:27.516 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-01T19:12:27.576 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-selinux-2:14.2.22-0.el8.x86_64 21/24 2024-04-01T19:12:27.576 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /sys 2024-04-01T19:12:27.576 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /proc 2024-04-01T19:12:27.576 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /dev 2024-04-01T19:12:27.576 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /run 2024-04-01T19:12:27.576 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /mnt 2024-04-01T19:12:27.576 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /var/tmp 2024-04-01T19:12:27.576 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /home 2024-04-01T19:12:27.576 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /tmp 2024-04-01T19:12:27.576 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /dev 2024-04-01T19:12:27.576 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:12:27.789 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-test 2024-04-01T19:12:28.197 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 24/24 2024-04-01T19:12:28.226 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:12:28.226 INFO:teuthology.orchestra.run.smithi022.stdout:Upgraded: 2024-04-01T19:12:28.226 INFO:teuthology.orchestra.run.smithi022.stdout: librados2-2:14.2.22-0.el8.x86_64 librbd1-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:28.227 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-04-01T19:12:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-01T19:12:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: leveldb-1.22-1.el8.x86_64 2024-04-01T19:12:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-01T19:12:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-01T19:12:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-01T19:12:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-01T19:12:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-01T19:12:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-01T19:12:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:12:28.228 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-01T19:12:28.315 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-radosgw-2:14.2.22-0.el8.x86_64 22/24 2024-04-01T19:12:28.334 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-radosgw-2:14.2.22-0.el8.x86_64 22/24 2024-04-01T19:12:28.334 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 23/24 2024-04-01T19:12:28.466 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-test 2024-04-01T19:12:28.515 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 23/24 2024-04-01T19:12:28.515 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 24/24 2024-04-01T19:12:28.554 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:00:40 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:12:29.236 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:00:41 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:12:29.241 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 24/24 2024-04-01T19:12:29.241 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-base-2:14.2.22-0.el8.x86_64 1/24 2024-04-01T19:12:29.241 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-common-2:14.2.22-0.el8.x86_64 2/24 2024-04-01T19:12:29.241 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-radosgw-2:14.2.22-0.el8.x86_64 3/24 2024-04-01T19:12:29.241 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-selinux-2:14.2.22-0.el8.x86_64 4/24 2024-04-01T19:12:29.241 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2024-04-01T19:12:29.241 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libradosstriper1-2:14.2.22-0.el8.x86_64 6/24 2024-04-01T19:12:29.241 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librgw2-2:14.2.22-0.el8.x86_64 7/24 2024-04-01T19:12:29.241 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 8/24 2024-04-01T19:12:29.242 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cephfs-2:14.2.22-0.el8.x86_64 9/24 2024-04-01T19:12:29.242 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rados-2:14.2.22-0.el8.x86_64 10/24 2024-04-01T19:12:29.242 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rbd-2:14.2.22-0.el8.x86_64 11/24 2024-04-01T19:12:29.242 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rgw-2:14.2.22-0.el8.x86_64 12/24 2024-04-01T19:12:29.242 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 13/24 2024-04-01T19:12:29.242 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 14/24 2024-04-01T19:12:29.242 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 15/24 2024-04-01T19:12:29.242 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 16/24 2024-04-01T19:12:29.242 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 17/24 2024-04-01T19:12:29.242 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : leveldb-1.22-1.el8.x86_64 18/24 2024-04-01T19:12:29.242 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/24 2024-04-01T19:12:29.242 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/24 2024-04-01T19:12:29.242 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados2-2:14.2.22-0.el8.x86_64 21/24 2024-04-01T19:12:29.243 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 22/24 2024-04-01T19:12:29.243 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librbd1-2:14.2.22-0.el8.x86_64 23/24 2024-04-01T19:12:30.095 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 24/24 2024-04-01T19:12:30.095 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:12:30.096 INFO:teuthology.orchestra.run.smithi188.stdout:Upgraded: 2024-04-01T19:12:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: librados2-2:14.2.22-0.el8.x86_64 librbd1-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:30.096 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-04-01T19:12:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-common-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-radosgw-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-selinux-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-01T19:12:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: leveldb-1.22-1.el8.x86_64 2024-04-01T19:12:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs2-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-01T19:12:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-01T19:12:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: libradosstriper1-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:30.097 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-01T19:12:30.097 INFO:teuthology.orchestra.run.smithi188.stdout: librgw2-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:30.097 INFO:teuthology.orchestra.run.smithi188.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-01T19:12:30.097 INFO:teuthology.orchestra.run.smithi188.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-01T19:12:30.097 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:30.097 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cephfs-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:30.097 INFO:teuthology.orchestra.run.smithi188.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-01T19:12:30.097 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rados-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:30.097 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rbd-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:30.097 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rgw-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:30.097 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:12:30.097 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-04-01T19:12:30.287 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-01T19:12:30.288 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:12:30.288 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-04-01T19:12:30.288 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:12:30.288 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-01T19:12:30.288 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test x86_64 2:14.2.22-0.el8 ceph 35 M 2024-04-01T19:12:30.288 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-01T19:12:30.288 INFO:teuthology.orchestra.run.smithi062.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-01T19:12:30.288 INFO:teuthology.orchestra.run.smithi062.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-01T19:12:30.288 INFO:teuthology.orchestra.run.smithi062.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-01T19:12:30.288 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-01T19:12:30.289 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:12:30.289 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-01T19:12:30.289 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:12:30.289 INFO:teuthology.orchestra.run.smithi062.stdout:Install 5 Packages 2024-04-01T19:12:30.289 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:12:30.289 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 36 M 2024-04-01T19:12:30.290 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 127 M 2024-04-01T19:12:30.290 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-01T19:12:30.370 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-test 2024-04-01T19:12:30.965 INFO:teuthology.orchestra.run.smithi062.stdout:(1/5): ceph-test-14.2.22-0.el8.x86_64.rpm 71 MB/s | 35 MB 00:00 2024-04-01T19:12:30.984 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-01T19:12:30.985 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:12:30.985 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2024-04-01T19:12:30.985 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:12:30.986 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-04-01T19:12:30.986 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test x86_64 2:14.2.22-0.el8 ceph 35 M 2024-04-01T19:12:30.986 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-04-01T19:12:30.986 INFO:teuthology.orchestra.run.smithi022.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-01T19:12:30.986 INFO:teuthology.orchestra.run.smithi022.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-01T19:12:30.986 INFO:teuthology.orchestra.run.smithi022.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-01T19:12:30.986 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-01T19:12:30.986 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:12:30.986 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-04-01T19:12:30.986 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:12:30.986 INFO:teuthology.orchestra.run.smithi022.stdout:Install 5 Packages 2024-04-01T19:12:30.986 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:12:30.987 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 36 M 2024-04-01T19:12:30.987 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 127 M 2024-04-01T19:12:30.987 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-04-01T19:12:30.990 INFO:teuthology.orchestra.run.smithi062.stdout:(2/5): oniguruma-6.8.2-3.el8.x86_64.rpm 364 kB/s | 188 kB 00:00 2024-04-01T19:12:31.016 INFO:teuthology.orchestra.run.smithi062.stdout:(3/5): jq-1.6-8.el8.x86_64.rpm 375 kB/s | 203 kB 00:00 2024-04-01T19:12:31.069 INFO:teuthology.orchestra.run.smithi062.stdout:(4/5): xmlstarlet-1.6.1-20.el8.x86_64.rpm 908 kB/s | 71 kB 00:00 2024-04-01T19:12:31.105 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:00:42 ago on Mon 01 Apr 2024 07:11:49 PM UTC. 2024-04-01T19:12:31.208 INFO:teuthology.orchestra.run.smithi062.stdout:(5/5): socat-1.7.4.1-1.el8.x86_64.rpm 1.3 MB/s | 323 kB 00:00 2024-04-01T19:12:31.210 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:12:31.210 INFO:teuthology.orchestra.run.smithi062.stdout:Total 39 MB/s | 36 MB 00:00 2024-04-01T19:12:31.253 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-01T19:12:31.276 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-01T19:12:31.276 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-01T19:12:31.510 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-01T19:12:31.513 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-01T19:12:31.521 INFO:teuthology.orchestra.run.smithi022.stdout:(1/5): ceph-test-14.2.22-0.el8.x86_64.rpm 73 MB/s | 35 MB 00:00 2024-04-01T19:12:31.546 INFO:teuthology.orchestra.run.smithi022.stdout:(2/5): oniguruma-6.8.2-3.el8.x86_64.rpm 376 kB/s | 188 kB 00:00 2024-04-01T19:12:31.596 INFO:teuthology.orchestra.run.smithi022.stdout:(3/5): jq-1.6-8.el8.x86_64.rpm 369 kB/s | 203 kB 00:00 2024-04-01T19:12:31.622 INFO:teuthology.orchestra.run.smithi022.stdout:(4/5): xmlstarlet-1.6.1-20.el8.x86_64.rpm 940 kB/s | 71 kB 00:00 2024-04-01T19:12:31.839 INFO:teuthology.orchestra.run.smithi022.stdout:(5/5): socat-1.7.4.1-1.el8.x86_64.rpm 1.0 MB/s | 323 kB 00:00 2024-04-01T19:12:31.840 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:12:31.840 INFO:teuthology.orchestra.run.smithi022.stdout:Total 42 MB/s | 36 MB 00:00 2024-04-01T19:12:31.884 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-04-01T19:12:31.907 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-04-01T19:12:31.907 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-04-01T19:12:31.922 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-01T19:12:32.140 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/5 2024-04-01T19:12:32.143 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-04-01T19:12:32.146 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-04-01T19:12:32.360 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2024-04-01T19:12:32.464 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-01T19:12:32.530 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-01T19:12:32.540 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-04-01T19:12:32.727 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-04-01T19:12:32.728 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:12:32.729 INFO:teuthology.orchestra.run.smithi188.stdout: Package Architecture Version Repository Size 2024-04-01T19:12:32.729 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:12:32.729 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-04-01T19:12:32.729 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-test x86_64 2:14.2.22-0.el8 ceph 35 M 2024-04-01T19:12:32.729 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-04-01T19:12:32.729 INFO:teuthology.orchestra.run.smithi188.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-01T19:12:32.729 INFO:teuthology.orchestra.run.smithi188.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-01T19:12:32.729 INFO:teuthology.orchestra.run.smithi188.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-01T19:12:32.729 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-01T19:12:32.729 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:12:32.729 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-04-01T19:12:32.729 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:12:32.730 INFO:teuthology.orchestra.run.smithi188.stdout:Install 5 Packages 2024-04-01T19:12:32.730 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:12:32.730 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 36 M 2024-04-01T19:12:32.730 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 127 M 2024-04-01T19:12:32.730 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-04-01T19:12:32.759 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/5 2024-04-01T19:12:32.947 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2024-04-01T19:12:33.076 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-01T19:12:33.187 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-01T19:12:33.239 INFO:teuthology.orchestra.run.smithi188.stdout:(1/5): ceph-test-14.2.22-0.el8.x86_64.rpm 77 MB/s | 35 MB 00:00 2024-04-01T19:12:33.281 INFO:teuthology.orchestra.run.smithi188.stdout:(2/5): jq-1.6-8.el8.x86_64.rpm 413 kB/s | 203 kB 00:00 2024-04-01T19:12:33.306 INFO:teuthology.orchestra.run.smithi188.stdout:(3/5): oniguruma-6.8.2-3.el8.x86_64.rpm 364 kB/s | 188 kB 00:00 2024-04-01T19:12:33.398 INFO:teuthology.orchestra.run.smithi188.stdout:(4/5): xmlstarlet-1.6.1-20.el8.x86_64.rpm 771 kB/s | 71 kB 00:00 2024-04-01T19:12:33.498 INFO:teuthology.orchestra.run.smithi188.stdout:(5/5): socat-1.7.4.1-1.el8.x86_64.rpm 1.2 MB/s | 323 kB 00:00 2024-04-01T19:12:33.499 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:12:33.499 INFO:teuthology.orchestra.run.smithi188.stdout:Total 46 MB/s | 36 MB 00:00 2024-04-01T19:12:33.542 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-04-01T19:12:33.562 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-04-01T19:12:33.562 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-04-01T19:12:33.784 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-04-01T19:12:33.787 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-04-01T19:12:34.168 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-04-01T19:12:34.417 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/5 2024-04-01T19:12:34.599 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2024-04-01T19:12:34.713 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-01T19:12:34.818 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-01T19:12:35.928 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : jq-1.6-8.el8.x86_64 4/5 2024-04-01T19:12:36.171 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-test-2:14.2.22-0.el8.x86_64 5/5 2024-04-01T19:12:36.468 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-test-2:14.2.22-0.el8.x86_64 5/5 2024-04-01T19:12:36.468 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-test-2:14.2.22-0.el8.x86_64 1/5 2024-04-01T19:12:36.468 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : jq-1.6-8.el8.x86_64 2/5 2024-04-01T19:12:36.468 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-01T19:12:36.468 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2024-04-01T19:12:36.577 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : jq-1.6-8.el8.x86_64 4/5 2024-04-01T19:12:36.816 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-test-2:14.2.22-0.el8.x86_64 5/5 2024-04-01T19:12:36.922 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2024-04-01T19:12:36.922 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:12:36.922 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-01T19:12:36.922 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test-2:14.2.22-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-04-01T19:12:36.922 INFO:teuthology.orchestra.run.smithi062.stdout: oniguruma-6.8.2-3.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2024-04-01T19:12:36.922 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-01T19:12:36.922 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:12:36.922 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-01T19:12:37.112 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-test-2:14.2.22-0.el8.x86_64 5/5 2024-04-01T19:12:37.112 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-test-2:14.2.22-0.el8.x86_64 1/5 2024-04-01T19:12:37.112 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : jq-1.6-8.el8.x86_64 2/5 2024-04-01T19:12:37.112 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-01T19:12:37.112 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2024-04-01T19:12:37.206 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph 2024-04-01T19:12:37.558 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2024-04-01T19:12:37.558 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:12:37.558 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-04-01T19:12:37.558 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test-2:14.2.22-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-04-01T19:12:37.558 INFO:teuthology.orchestra.run.smithi022.stdout: oniguruma-6.8.2-3.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2024-04-01T19:12:37.558 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-01T19:12:37.558 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:12:37.558 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-01T19:12:37.792 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph 2024-04-01T19:12:37.959 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:00:49 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:12:38.034 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : jq-1.6-8.el8.x86_64 4/5 2024-04-01T19:12:38.245 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-test-2:14.2.22-0.el8.x86_64 5/5 2024-04-01T19:12:38.515 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-test-2:14.2.22-0.el8.x86_64 5/5 2024-04-01T19:12:38.515 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-test-2:14.2.22-0.el8.x86_64 1/5 2024-04-01T19:12:38.516 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : jq-1.6-8.el8.x86_64 2/5 2024-04-01T19:12:38.516 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-01T19:12:38.516 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2024-04-01T19:12:38.549 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:00:50 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:12:38.958 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2024-04-01T19:12:38.958 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:12:38.959 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-04-01T19:12:38.959 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-test-2:14.2.22-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-04-01T19:12:38.959 INFO:teuthology.orchestra.run.smithi188.stdout: oniguruma-6.8.2-3.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2024-04-01T19:12:38.959 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-01T19:12:38.959 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:12:38.959 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-04-01T19:12:39.186 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph 2024-04-01T19:12:39.706 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-01T19:12:39.710 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:12:39.710 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-01T19:12:39.710 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:12:39.710 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-01T19:12:39.710 INFO:teuthology.orchestra.run.smithi062.stdout: ceph x86_64 2:14.2.22-0.el8 ceph 6.3 k 2024-04-01T19:12:39.710 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-01T19:12:39.710 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds x86_64 2:14.2.22-0.el8 ceph 2.0 M 2024-04-01T19:12:39.710 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr x86_64 2:14.2.22-0.el8 ceph 1.6 M 2024-04-01T19:12:39.710 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon x86_64 2:14.2.22-0.el8 ceph 4.5 M 2024-04-01T19:12:39.710 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd x86_64 2:14.2.22-0.el8 ceph 17 M 2024-04-01T19:12:39.711 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-01T19:12:39.711 INFO:teuthology.orchestra.run.smithi062.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-01T19:12:39.711 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-01T19:12:39.711 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-01T19:12:39.711 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-01T19:12:39.711 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-01T19:12:39.711 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-01T19:12:39.711 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-01T19:12:39.711 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-01T19:12:39.711 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-01T19:12:39.711 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-01T19:12:39.711 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-01T19:12:39.711 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-01T19:12:39.712 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-01T19:12:39.712 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-01T19:12:39.712 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-01T19:12:39.712 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-01T19:12:39.712 INFO:teuthology.orchestra.run.smithi062.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-01T19:12:39.712 INFO:teuthology.orchestra.run.smithi062.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-01T19:12:39.712 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-01T19:12:39.712 INFO:teuthology.orchestra.run.smithi062.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-01T19:12:39.712 INFO:teuthology.orchestra.run.smithi062.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-01T19:12:39.712 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-01T19:12:39.712 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-01T19:12:39.712 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-01T19:12:39.712 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-01T19:12:39.712 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:12:39.712 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-01T19:12:39.713 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:12:39.713 INFO:teuthology.orchestra.run.smithi062.stdout:Install 31 Packages 2024-04-01T19:12:39.713 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:12:39.713 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 28 M 2024-04-01T19:12:39.713 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 93 M 2024-04-01T19:12:39.713 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-01T19:12:39.921 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:00:50 ago on Mon 01 Apr 2024 07:11:49 PM UTC. 2024-04-01T19:12:40.017 INFO:teuthology.orchestra.run.smithi062.stdout:(1/31): ceph-14.2.22-0.el8.x86_64.rpm 119 kB/s | 6.3 kB 00:00 2024-04-01T19:12:40.069 INFO:teuthology.orchestra.run.smithi062.stdout:(2/31): ceph-mgr-14.2.22-0.el8.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-04-01T19:12:40.110 INFO:teuthology.orchestra.run.smithi062.stdout:(3/31): ceph-mds-14.2.22-0.el8.x86_64.rpm 14 MB/s | 2.0 MB 00:00 2024-04-01T19:12:40.210 INFO:teuthology.orchestra.run.smithi062.stdout:(4/31): ceph-mon-14.2.22-0.el8.x86_64.rpm 23 MB/s | 4.5 MB 00:00 2024-04-01T19:12:40.310 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-01T19:12:40.313 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:12:40.313 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2024-04-01T19:12:40.313 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:12:40.313 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-04-01T19:12:40.313 INFO:teuthology.orchestra.run.smithi022.stdout: ceph x86_64 2:14.2.22-0.el8 ceph 6.3 k 2024-04-01T19:12:40.313 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-04-01T19:12:40.314 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds x86_64 2:14.2.22-0.el8 ceph 2.0 M 2024-04-01T19:12:40.314 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr x86_64 2:14.2.22-0.el8 ceph 1.6 M 2024-04-01T19:12:40.314 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon x86_64 2:14.2.22-0.el8 ceph 4.5 M 2024-04-01T19:12:40.314 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd x86_64 2:14.2.22-0.el8 ceph 17 M 2024-04-01T19:12:40.314 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-01T19:12:40.314 INFO:teuthology.orchestra.run.smithi022.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-01T19:12:40.314 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-01T19:12:40.314 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-01T19:12:40.314 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-01T19:12:40.314 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-01T19:12:40.314 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-01T19:12:40.314 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-01T19:12:40.315 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-01T19:12:40.315 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-01T19:12:40.315 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-01T19:12:40.315 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-01T19:12:40.315 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-01T19:12:40.315 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-01T19:12:40.315 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-01T19:12:40.315 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-01T19:12:40.315 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-01T19:12:40.315 INFO:teuthology.orchestra.run.smithi022.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-01T19:12:40.315 INFO:teuthology.orchestra.run.smithi022.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-01T19:12:40.315 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-01T19:12:40.315 INFO:teuthology.orchestra.run.smithi022.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-01T19:12:40.315 INFO:teuthology.orchestra.run.smithi022.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-01T19:12:40.316 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-01T19:12:40.316 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-01T19:12:40.316 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-01T19:12:40.316 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-01T19:12:40.316 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:12:40.316 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-04-01T19:12:40.316 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:12:40.316 INFO:teuthology.orchestra.run.smithi022.stdout:Install 31 Packages 2024-04-01T19:12:40.316 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:12:40.317 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 28 M 2024-04-01T19:12:40.317 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 93 M 2024-04-01T19:12:40.317 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-04-01T19:12:40.444 INFO:teuthology.orchestra.run.smithi062.stdout:(5/31): ceph-osd-14.2.22-0.el8.x86_64.rpm 45 MB/s | 17 MB 00:00 2024-04-01T19:12:40.469 INFO:teuthology.orchestra.run.smithi062.stdout:(6/31): python3-markupsafe-0.23-19.el8.x86_64.r 150 kB/s | 39 kB 00:00 2024-04-01T19:12:40.494 INFO:teuthology.orchestra.run.smithi062.stdout:(7/31): python3-mako-1.0.6-14.el8.noarch.rpm 409 kB/s | 157 kB 00:00 2024-04-01T19:12:40.553 INFO:teuthology.orchestra.run.smithi062.stdout:(8/31): python3-pytz-2017.2-11.el8.noarch.rpm 681 kB/s | 57 kB 00:00 2024-04-01T19:12:40.619 INFO:teuthology.orchestra.run.smithi062.stdout:(9/31): python3-werkzeug-0.12.2-4.el8.noarch.rp 3.6 MB/s | 457 kB 00:00 2024-04-01T19:12:40.653 INFO:teuthology.orchestra.run.smithi062.stdout:(10/31): python3-pyOpenSSL-19.0.0-1.el8.noarch. 494 kB/s | 103 kB 00:00 2024-04-01T19:12:40.747 INFO:teuthology.orchestra.run.smithi022.stdout:(1/31): ceph-14.2.22-0.el8.x86_64.rpm 116 kB/s | 6.3 kB 00:00 2024-04-01T19:12:40.822 INFO:teuthology.orchestra.run.smithi022.stdout:(2/31): ceph-mds-14.2.22-0.el8.x86_64.rpm 15 MB/s | 2.0 MB 00:00 2024-04-01T19:12:40.864 INFO:teuthology.orchestra.run.smithi022.stdout:(3/31): ceph-mgr-14.2.22-0.el8.x86_64.rpm 9.1 MB/s | 1.6 MB 00:00 2024-04-01T19:12:40.948 INFO:teuthology.orchestra.run.smithi022.stdout:(4/31): ceph-mon-14.2.22-0.el8.x86_64.rpm 22 MB/s | 4.5 MB 00:00 2024-04-01T19:12:41.095 INFO:teuthology.orchestra.run.smithi062.stdout:(11/31): python3-cffi-1.11.5-6.el8.x86_64.rpm 459 kB/s | 249 kB 00:00 2024-04-01T19:12:41.112 INFO:teuthology.orchestra.run.smithi062.stdout:(12/31): python3-pycparser-2.14-14.el8.noarch.r 238 kB/s | 109 kB 00:00 2024-04-01T19:12:41.165 INFO:teuthology.orchestra.run.smithi022.stdout:(5/31): ceph-osd-14.2.22-0.el8.x86_64.rpm 49 MB/s | 17 MB 00:00 2024-04-01T19:12:41.190 INFO:teuthology.orchestra.run.smithi022.stdout:(6/31): python3-markupsafe-0.23-19.el8.x86_64.r 160 kB/s | 39 kB 00:00 2024-04-01T19:12:41.215 INFO:teuthology.orchestra.run.smithi022.stdout:(7/31): python3-mako-1.0.6-14.el8.noarch.rpm 447 kB/s | 157 kB 00:00 2024-04-01T19:12:41.221 INFO:teuthology.orchestra.run.smithi062.stdout:(13/31): python3-cryptography-3.2.1-7.el8.x86_6 1.0 MB/s | 641 kB 00:00 2024-04-01T19:12:41.282 INFO:teuthology.orchestra.run.smithi022.stdout:(8/31): python3-pytz-2017.2-11.el8.noarch.rpm 619 kB/s | 57 kB 00:00 2024-04-01T19:12:41.349 INFO:teuthology.orchestra.run.smithi022.stdout:(9/31): python3-werkzeug-0.12.2-4.el8.noarch.rp 3.3 MB/s | 457 kB 00:00 2024-04-01T19:12:41.374 INFO:teuthology.orchestra.run.smithi022.stdout:(10/31): python3-pyOpenSSL-19.0.0-1.el8.noarch. 494 kB/s | 103 kB 00:00 2024-04-01T19:12:41.534 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-04-01T19:12:41.537 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:12:41.537 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-04-01T19:12:41.537 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:12:41.537 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-04-01T19:12:41.537 INFO:teuthology.orchestra.run.smithi188.stdout: ceph x86_64 2:14.2.22-0.el8 ceph 6.3 k 2024-04-01T19:12:41.538 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-04-01T19:12:41.538 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mds x86_64 2:14.2.22-0.el8 ceph 2.0 M 2024-04-01T19:12:41.538 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr x86_64 2:14.2.22-0.el8 ceph 1.6 M 2024-04-01T19:12:41.538 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mon x86_64 2:14.2.22-0.el8 ceph 4.5 M 2024-04-01T19:12:41.538 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-osd x86_64 2:14.2.22-0.el8 ceph 17 M 2024-04-01T19:12:41.538 INFO:teuthology.orchestra.run.smithi188.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-01T19:12:41.538 INFO:teuthology.orchestra.run.smithi188.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-01T19:12:41.538 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-01T19:12:41.538 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-01T19:12:41.538 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-01T19:12:41.538 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-01T19:12:41.538 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-01T19:12:41.538 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-01T19:12:41.539 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-01T19:12:41.539 INFO:teuthology.orchestra.run.smithi188.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-01T19:12:41.539 INFO:teuthology.orchestra.run.smithi188.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-01T19:12:41.539 INFO:teuthology.orchestra.run.smithi188.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-01T19:12:41.539 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-01T19:12:41.539 INFO:teuthology.orchestra.run.smithi188.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-01T19:12:41.539 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-01T19:12:41.539 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-01T19:12:41.539 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-01T19:12:41.539 INFO:teuthology.orchestra.run.smithi188.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-01T19:12:41.539 INFO:teuthology.orchestra.run.smithi188.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-01T19:12:41.539 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-01T19:12:41.539 INFO:teuthology.orchestra.run.smithi188.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-01T19:12:41.540 INFO:teuthology.orchestra.run.smithi188.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-01T19:12:41.540 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-01T19:12:41.540 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-01T19:12:41.540 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-01T19:12:41.540 INFO:teuthology.orchestra.run.smithi188.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-01T19:12:41.540 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:12:41.540 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-04-01T19:12:41.540 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:12:41.540 INFO:teuthology.orchestra.run.smithi188.stdout:Install 31 Packages 2024-04-01T19:12:41.540 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:12:41.541 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 28 M 2024-04-01T19:12:41.541 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 93 M 2024-04-01T19:12:41.541 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-04-01T19:12:41.546 INFO:teuthology.orchestra.run.smithi062.stdout:(14/31): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 97 kB/s | 44 kB 00:00 2024-04-01T19:12:41.663 INFO:teuthology.orchestra.run.smithi062.stdout:(15/31): python3-beautifulsoup4-4.6.3-2.el8.1.n 336 kB/s | 185 kB 00:00 2024-04-01T19:12:41.791 INFO:teuthology.orchestra.run.smithi022.stdout:(11/31): python3-pycparser-2.14-14.el8.noarch.r 262 kB/s | 109 kB 00:00 2024-04-01T19:12:41.805 INFO:teuthology.orchestra.run.smithi062.stdout:(16/31): python3-cheroot-8.5.2-1.el8.noarch.rpm 298 kB/s | 173 kB 00:00 2024-04-01T19:12:41.817 INFO:teuthology.orchestra.run.smithi022.stdout:(12/31): python3-cffi-1.11.5-6.el8.x86_64.rpm 466 kB/s | 249 kB 00:00 2024-04-01T19:12:41.822 INFO:teuthology.orchestra.run.smithi062.stdout:(17/31): python3-jaraco-6.2-6.el8.noarch.rpm 70 kB/s | 11 kB 00:00 2024-04-01T19:12:41.907 INFO:teuthology.orchestra.run.smithi188.stdout:(1/31): ceph-14.2.22-0.el8.x86_64.rpm 103 kB/s | 6.3 kB 00:00 2024-04-01T19:12:41.950 INFO:teuthology.orchestra.run.smithi022.stdout:(13/31): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 275 kB/s | 44 kB 00:00 2024-04-01T19:12:41.957 INFO:teuthology.orchestra.run.smithi188.stdout:(2/31): ceph-mgr-14.2.22-0.el8.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-04-01T19:12:41.975 INFO:teuthology.orchestra.run.smithi022.stdout:(14/31): python3-cryptography-3.2.1-7.el8.x86_6 1.0 MB/s | 641 kB 00:00 2024-04-01T19:12:41.980 INFO:teuthology.orchestra.run.smithi062.stdout:(18/31): python3-cherrypy-18.4.0-1.el8.noarch.r 886 kB/s | 384 kB 00:00 2024-04-01T19:12:41.999 INFO:teuthology.orchestra.run.smithi188.stdout:(3/31): ceph-mds-14.2.22-0.el8.x86_64.rpm 13 MB/s | 2.0 MB 00:00 2024-04-01T19:12:42.001 INFO:teuthology.orchestra.run.smithi022.stdout:(15/31): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.0 MB/s | 185 kB 00:00 2024-04-01T19:12:42.006 INFO:teuthology.orchestra.run.smithi062.stdout:(19/31): python3-jaraco-functools-2.0-4.el8.noa 87 kB/s | 18 kB 00:00 2024-04-01T19:12:42.031 INFO:teuthology.orchestra.run.smithi062.stdout:(20/31): python3-logutils-0.3.5-11.el8.noarch.r 233 kB/s | 49 kB 00:00 2024-04-01T19:12:42.043 INFO:teuthology.orchestra.run.smithi022.stdout:(16/31): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.8 MB/s | 173 kB 00:00 2024-04-01T19:12:42.068 INFO:teuthology.orchestra.run.smithi022.stdout:(17/31): python3-jaraco-6.2-6.el8.noarch.rpm 181 kB/s | 11 kB 00:00 2024-04-01T19:12:42.093 INFO:teuthology.orchestra.run.smithi022.stdout:(18/31): python3-jaraco-functools-2.0-4.el8.noa 354 kB/s | 18 kB 00:00 2024-04-01T19:12:42.100 INFO:teuthology.orchestra.run.smithi188.stdout:(4/31): ceph-mon-14.2.22-0.el8.x86_64.rpm 23 MB/s | 4.5 MB 00:00 2024-04-01T19:12:42.115 INFO:teuthology.orchestra.run.smithi062.stdout:(21/31): python3-more-itertools-7.2.0-3.el8.noa 438 kB/s | 59 kB 00:00 2024-04-01T19:12:42.119 INFO:teuthology.orchestra.run.smithi022.stdout:(19/31): python3-logutils-0.3.5-11.el8.noarch.r 977 kB/s | 49 kB 00:00 2024-04-01T19:12:42.144 INFO:teuthology.orchestra.run.smithi022.stdout:(20/31): python3-more-itertools-7.2.0-3.el8.noa 1.1 MB/s | 59 kB 00:00 2024-04-01T19:12:42.165 INFO:teuthology.orchestra.run.smithi062.stdout:(22/31): python3-portend-2.6-1.el8.noarch.rpm 116 kB/s | 16 kB 00:00 2024-04-01T19:12:42.194 INFO:teuthology.orchestra.run.smithi022.stdout:(21/31): python3-portend-2.6-1.el8.noarch.rpm 311 kB/s | 16 kB 00:00 2024-04-01T19:12:42.240 INFO:teuthology.orchestra.run.smithi062.stdout:(23/31): python3-pecan-1.3.2-9.el8.noarch.rpm 1.2 MB/s | 283 kB 00:00 2024-04-01T19:12:42.244 INFO:teuthology.orchestra.run.smithi022.stdout:(22/31): python3-simplegeneric-0.8.1-17.el8.noa 376 kB/s | 19 kB 00:00 2024-04-01T19:12:42.270 INFO:teuthology.orchestra.run.smithi022.stdout:(23/31): python3-pecan-1.3.2-9.el8.noarch.rpm 1.8 MB/s | 283 kB 00:00 2024-04-01T19:12:42.274 INFO:teuthology.orchestra.run.smithi062.stdout:(24/31): python3-simplegeneric-0.8.1-17.el8.noa 118 kB/s | 19 kB 00:00 2024-04-01T19:12:42.295 INFO:teuthology.orchestra.run.smithi022.stdout:(24/31): python3-cherrypy-18.4.0-1.el8.noarch.r 1.2 MB/s | 384 kB 00:00 2024-04-01T19:12:42.308 INFO:teuthology.orchestra.run.smithi062.stdout:(25/31): python3-singledispatch-3.4.0.3-18.el8. 168 kB/s | 24 kB 00:00 2024-04-01T19:12:42.317 INFO:teuthology.orchestra.run.smithi188.stdout:(5/31): ceph-osd-14.2.22-0.el8.x86_64.rpm 47 MB/s | 17 MB 00:00 2024-04-01T19:12:42.343 INFO:teuthology.orchestra.run.smithi022.stdout:(25/31): python3-singledispatch-3.4.0.3-18.el8. 242 kB/s | 24 kB 00:00 2024-04-01T19:12:42.358 INFO:teuthology.orchestra.run.smithi062.stdout:(26/31): python3-tempora-1.14.1-5.el8.noarch.rp 249 kB/s | 29 kB 00:00 2024-04-01T19:12:42.371 INFO:teuthology.orchestra.run.smithi022.stdout:(26/31): python3-tempora-1.14.1-5.el8.noarch.rp 289 kB/s | 29 kB 00:00 2024-04-01T19:12:42.375 INFO:teuthology.orchestra.run.smithi188.stdout:(6/31): python3-mako-1.0.6-14.el8.noarch.rpm 418 kB/s | 157 kB 00:00 2024-04-01T19:12:42.396 INFO:teuthology.orchestra.run.smithi022.stdout:(27/31): python3-trustme-0.6.0-4.el8.noarch.rpm 274 kB/s | 27 kB 00:00 2024-04-01T19:12:42.400 INFO:teuthology.orchestra.run.smithi062.stdout:(27/31): python3-trustme-0.6.0-4.el8.noarch.rpm 219 kB/s | 27 kB 00:00 2024-04-01T19:12:42.434 INFO:teuthology.orchestra.run.smithi188.stdout:(7/31): python3-markupsafe-0.23-19.el8.x86_64.r 116 kB/s | 39 kB 00:00 2024-04-01T19:12:42.438 INFO:teuthology.orchestra.run.smithi022.stdout:(28/31): python3-webtest-2.0.33-1.el8.noarch.rp 2.0 MB/s | 85 kB 00:00 2024-04-01T19:12:42.459 INFO:teuthology.orchestra.run.smithi188.stdout:(8/31): python3-pytz-2017.2-11.el8.noarch.rpm 681 kB/s | 57 kB 00:00 2024-04-01T19:12:42.463 INFO:teuthology.orchestra.run.smithi022.stdout:(29/31): python3-waitress-1.4.3-1.el8.noarch.rp 2.1 MB/s | 255 kB 00:00 2024-04-01T19:12:42.488 INFO:teuthology.orchestra.run.smithi022.stdout:(30/31): python3-zc-lockfile-2.0-2.el8.noarch.r 459 kB/s | 23 kB 00:00 2024-04-01T19:12:42.508 INFO:teuthology.orchestra.run.smithi062.stdout:(28/31): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.6 MB/s | 251 kB 00:00 2024-04-01T19:12:42.510 INFO:teuthology.orchestra.run.smithi188.stdout:(9/31): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 538 kB/s | 103 kB 00:00 2024-04-01T19:12:42.513 INFO:teuthology.orchestra.run.smithi022.stdout:(31/31): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.1 MB/s | 251 kB 00:00 2024-04-01T19:12:42.517 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:12:42.518 INFO:teuthology.orchestra.run.smithi022.stdout:Total 13 MB/s | 28 MB 00:02 2024-04-01T19:12:42.534 INFO:teuthology.orchestra.run.smithi062.stdout:(29/31): python3-webtest-2.0.33-1.el8.noarch.rp 639 kB/s | 85 kB 00:00 2024-04-01T19:12:42.567 INFO:teuthology.orchestra.run.smithi062.stdout:(30/31): python3-waitress-1.4.3-1.el8.noarch.rp 985 kB/s | 255 kB 00:00 2024-04-01T19:12:42.603 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-04-01T19:12:42.635 INFO:teuthology.orchestra.run.smithi188.stdout:(10/31): python3-werkzeug-0.12.2-4.el8.noarch.r 2.2 MB/s | 457 kB 00:00 2024-04-01T19:12:42.646 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-04-01T19:12:42.646 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-04-01T19:12:42.667 INFO:teuthology.orchestra.run.smithi062.stdout:(31/31): python3-zc-lockfile-2.0-2.el8.noarch.r 145 kB/s | 23 kB 00:00 2024-04-01T19:12:42.672 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:12:42.672 INFO:teuthology.orchestra.run.smithi062.stdout:Total 9.6 MB/s | 28 MB 00:02 2024-04-01T19:12:42.756 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-01T19:12:42.799 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-01T19:12:42.799 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-01T19:12:42.970 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-04-01T19:12:42.973 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-04-01T19:12:42.977 INFO:teuthology.orchestra.run.smithi188.stdout:(11/31): python3-cffi-1.11.5-6.el8.x86_64.rpm 481 kB/s | 249 kB 00:00 2024-04-01T19:12:43.069 INFO:teuthology.orchestra.run.smithi188.stdout:(12/31): python3-pycparser-2.14-14.el8.noarch.r 251 kB/s | 109 kB 00:00 2024-04-01T19:12:43.119 INFO:teuthology.orchestra.run.smithi188.stdout:(13/31): python3-cryptography-3.2.1-7.el8.x86_6 1.0 MB/s | 641 kB 00:00 2024-04-01T19:12:43.123 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-01T19:12:43.126 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-01T19:12:43.378 INFO:teuthology.orchestra.run.smithi188.stdout:(14/31): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 109 kB/s | 44 kB 00:00 2024-04-01T19:12:43.587 INFO:teuthology.orchestra.run.smithi188.stdout:(15/31): python3-beautifulsoup4-4.6.3-2.el8.1.n 358 kB/s | 185 kB 00:00 2024-04-01T19:12:44.051 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-04-01T19:12:44.203 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-01T19:12:44.284 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/31 2024-04-01T19:12:44.422 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/31 2024-04-01T19:12:44.515 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/31 2024-04-01T19:12:44.644 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/31 2024-04-01T19:12:44.771 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/31 2024-04-01T19:12:44.942 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/31 2024-04-01T19:12:44.964 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/31 2024-04-01T19:12:45.153 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/31 2024-04-01T19:12:45.170 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/31 2024-04-01T19:12:45.369 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/31 2024-04-01T19:12:45.409 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/31 2024-04-01T19:12:45.544 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/31 2024-04-01T19:12:45.607 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/31 2024-04-01T19:12:45.621 INFO:teuthology.orchestra.run.smithi188.stdout:(16/31): python3-cheroot-8.5.2-1.el8.noarch.rpm 69 kB/s | 173 kB 00:02 2024-04-01T19:12:45.705 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/31 2024-04-01T19:12:45.720 INFO:teuthology.orchestra.run.smithi188.stdout:(17/31): python3-cherrypy-18.4.0-1.el8.noarch.r 164 kB/s | 384 kB 00:02 2024-04-01T19:12:45.799 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/31 2024-04-01T19:12:45.912 INFO:teuthology.orchestra.run.smithi188.stdout:(18/31): python3-jaraco-functools-2.0-4.el8.noa 60 kB/s | 18 kB 00:00 2024-04-01T19:12:45.951 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/31 2024-04-01T19:12:45.986 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/31 2024-04-01T19:12:46.104 INFO:teuthology.orchestra.run.smithi188.stdout:(19/31): python3-more-itertools-7.2.0-3.el8.noa 306 kB/s | 59 kB 00:00 2024-04-01T19:12:46.129 INFO:teuthology.orchestra.run.smithi188.stdout:(20/31): python3-logutils-0.3.5-11.el8.noarch.r 119 kB/s | 49 kB 00:00 2024-04-01T19:12:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/31 2024-04-01T19:12:46.214 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/31 2024-04-01T19:12:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/31 2024-04-01T19:12:46.434 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/31 2024-04-01T19:12:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/31 2024-04-01T19:12:46.689 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/31 2024-04-01T19:12:46.922 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/31 2024-04-01T19:12:47.054 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/31 2024-04-01T19:12:47.263 INFO:teuthology.orchestra.run.smithi188.stdout:(21/31): python3-jaraco-6.2-6.el8.noarch.rpm 3.0 kB/s | 11 kB 00:03 2024-04-01T19:12:47.302 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/31 2024-04-01T19:12:47.357 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/31 2024-04-01T19:12:47.363 INFO:teuthology.orchestra.run.smithi188.stdout:(22/31): python3-pecan-1.3.2-9.el8.noarch.rpm 225 kB/s | 283 kB 00:01 2024-04-01T19:12:47.413 INFO:teuthology.orchestra.run.smithi188.stdout:(23/31): python3-portend-2.6-1.el8.noarch.rpm 12 kB/s | 16 kB 00:01 2024-04-01T19:12:47.430 INFO:teuthology.orchestra.run.smithi188.stdout:(24/31): python3-simplegeneric-0.8.1-17.el8.noa 112 kB/s | 19 kB 00:00 2024-04-01T19:12:47.482 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/31 2024-04-01T19:12:47.600 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/31 2024-04-01T19:12:47.782 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/31 2024-04-01T19:12:47.812 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/31 2024-04-01T19:12:47.993 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/31 2024-04-01T19:12:48.084 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/31 2024-04-01T19:12:48.113 INFO:teuthology.orchestra.run.smithi188.stdout:(25/31): python3-tempora-1.14.1-5.el8.noarch.rp 42 kB/s | 29 kB 00:00 2024-04-01T19:12:48.139 INFO:teuthology.orchestra.run.smithi188.stdout:(26/31): python3-singledispatch-3.4.0.3-18.el8. 31 kB/s | 24 kB 00:00 2024-04-01T19:12:48.156 INFO:teuthology.orchestra.run.smithi188.stdout:(27/31): python3-trustme-0.6.0-4.el8.noarch.rpm 38 kB/s | 27 kB 00:00 2024-04-01T19:12:48.298 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/31 2024-04-01T19:12:48.335 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/31 2024-04-01T19:12:48.531 INFO:teuthology.orchestra.run.smithi188.stdout:(28/31): python3-webtest-2.0.33-1.el8.noarch.rp 228 kB/s | 85 kB 00:00 2024-04-01T19:12:48.564 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/31 2024-04-01T19:12:48.688 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/31 2024-04-01T19:12:48.746 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/31 2024-04-01T19:12:48.840 INFO:teuthology.orchestra.run.smithi188.stdout:(29/31): python3-zc-lockfile-2.0-2.el8.noarch.r 74 kB/s | 23 kB 00:00 2024-04-01T19:12:48.913 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/31 2024-04-01T19:12:48.919 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/31 2024-04-01T19:12:48.998 INFO:teuthology.orchestra.run.smithi188.stdout:(30/31): python3-waitress-1.4.3-1.el8.noarch.rp 289 kB/s | 255 kB 00:00 2024-04-01T19:12:49.023 INFO:teuthology.orchestra.run.smithi188.stdout:(31/31): python3-webob-1.8.5-1.el8.1.noarch.rpm 284 kB/s | 251 kB 00:00 2024-04-01T19:12:49.024 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:12:49.025 INFO:teuthology.orchestra.run.smithi188.stdout:Total 3.8 MB/s | 28 MB 00:07 2024-04-01T19:12:49.106 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-04-01T19:12:49.117 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/31 2024-04-01T19:12:49.146 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-04-01T19:12:49.146 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-04-01T19:12:49.160 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/31 2024-04-01T19:12:49.302 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/31 2024-04-01T19:12:49.370 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/31 2024-04-01T19:12:49.457 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-04-01T19:12:49.460 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-04-01T19:12:49.556 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/31 2024-04-01T19:12:49.574 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/31 2024-04-01T19:12:49.776 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/31 2024-04-01T19:12:49.919 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/31 2024-04-01T19:12:49.997 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/31 2024-04-01T19:12:50.347 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/31 2024-04-01T19:12:50.380 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/31 2024-04-01T19:12:50.547 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-04-01T19:12:50.578 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-2:14.2.22-0.el8.x86_64 27/31 2024-04-01T19:12:50.789 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/31 2024-04-01T19:12:50.793 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/31 2024-04-01T19:12:51.031 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-2:14.2.22-0.el8.x86_64 27/31 2024-04-01T19:12:51.050 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/31 2024-04-01T19:12:51.325 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/31 2024-04-01T19:12:51.574 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/31 2024-04-01T19:12:51.780 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/31 2024-04-01T19:12:51.985 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/31 2024-04-01T19:12:52.032 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-2:14.2.22-0.el8.x86_64 27/31 2024-04-01T19:12:52.211 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-osd-2:14.2.22-0.el8.x86_64 28/31 2024-04-01T19:12:52.212 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/31 2024-04-01T19:12:52.358 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/31 2024-04-01T19:12:52.487 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-2:14.2.22-0.el8.x86_64 27/31 2024-04-01T19:12:52.607 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/31 2024-04-01T19:12:52.625 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-osd-2:14.2.22-0.el8.x86_64 28/31 2024-04-01T19:12:52.689 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-osd-2:14.2.22-0.el8.x86_64 28/31 2024-04-01T19:12:52.773 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mon-2:14.2.22-0.el8.x86_64 29/31 2024-04-01T19:12:52.827 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/31 2024-04-01T19:12:52.970 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mon-2:14.2.22-0.el8.x86_64 29/31 2024-04-01T19:12:53.041 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/31 2024-04-01T19:12:53.110 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-osd-2:14.2.22-0.el8.x86_64 28/31 2024-04-01T19:12:53.164 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mds-2:14.2.22-0.el8.x86_64 30/31 2024-04-01T19:12:53.183 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mds-2:14.2.22-0.el8.x86_64 30/31 2024-04-01T19:12:53.295 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mon-2:14.2.22-0.el8.x86_64 29/31 2024-04-01T19:12:53.305 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/31 2024-04-01T19:12:53.306 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-2:14.2.22-0.el8.x86_64 31/31 2024-04-01T19:12:53.495 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mon-2:14.2.22-0.el8.x86_64 29/31 2024-04-01T19:12:53.678 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mds-2:14.2.22-0.el8.x86_64 30/31 2024-04-01T19:12:53.689 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/31 2024-04-01T19:12:53.697 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mds-2:14.2.22-0.el8.x86_64 30/31 2024-04-01T19:12:53.716 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-2:14.2.22-0.el8.x86_64 31/31 2024-04-01T19:12:53.717 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-2:14.2.22-0.el8.x86_64 1/31 2024-04-01T19:12:53.717 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mds-2:14.2.22-0.el8.x86_64 2/31 2024-04-01T19:12:53.717 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-2:14.2.22-0.el8.x86_64 3/31 2024-04-01T19:12:53.717 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mon-2:14.2.22-0.el8.x86_64 4/31 2024-04-01T19:12:53.717 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-osd-2:14.2.22-0.el8.x86_64 5/31 2024-04-01T19:12:53.717 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 6/31 2024-04-01T19:12:53.717 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 7/31 2024-04-01T19:12:53.717 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 8/31 2024-04-01T19:12:53.717 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 9/31 2024-04-01T19:12:53.717 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 10/31 2024-04-01T19:12:53.717 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 11/31 2024-04-01T19:12:53.717 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 12/31 2024-04-01T19:12:53.718 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 13/31 2024-04-01T19:12:53.718 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 14/31 2024-04-01T19:12:53.718 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 15/31 2024-04-01T19:12:53.718 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 16/31 2024-04-01T19:12:53.718 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 17/31 2024-04-01T19:12:53.718 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 18/31 2024-04-01T19:12:53.718 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 19/31 2024-04-01T19:12:53.718 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 20/31 2024-04-01T19:12:53.718 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 21/31 2024-04-01T19:12:53.718 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 22/31 2024-04-01T19:12:53.718 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-portend-2.6-1.el8.noarch 23/31 2024-04-01T19:12:53.718 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 24/31 2024-04-01T19:12:53.718 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 25/31 2024-04-01T19:12:53.719 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 26/31 2024-04-01T19:12:53.719 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 27/31 2024-04-01T19:12:53.719 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 28/31 2024-04-01T19:12:53.719 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 29/31 2024-04-01T19:12:53.719 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 30/31 2024-04-01T19:12:53.845 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-2:14.2.22-0.el8.x86_64 31/31 2024-04-01T19:12:53.969 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/31 2024-04-01T19:12:54.208 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/31 2024-04-01T19:12:54.268 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-2:14.2.22-0.el8.x86_64 31/31 2024-04-01T19:12:54.268 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-2:14.2.22-0.el8.x86_64 1/31 2024-04-01T19:12:54.268 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mds-2:14.2.22-0.el8.x86_64 2/31 2024-04-01T19:12:54.268 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-2:14.2.22-0.el8.x86_64 3/31 2024-04-01T19:12:54.268 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mon-2:14.2.22-0.el8.x86_64 4/31 2024-04-01T19:12:54.269 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-osd-2:14.2.22-0.el8.x86_64 5/31 2024-04-01T19:12:54.269 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 6/31 2024-04-01T19:12:54.269 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 7/31 2024-04-01T19:12:54.269 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 8/31 2024-04-01T19:12:54.269 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 9/31 2024-04-01T19:12:54.269 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 10/31 2024-04-01T19:12:54.269 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 11/31 2024-04-01T19:12:54.269 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 12/31 2024-04-01T19:12:54.269 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 13/31 2024-04-01T19:12:54.269 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 14/31 2024-04-01T19:12:54.269 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 15/31 2024-04-01T19:12:54.270 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 16/31 2024-04-01T19:12:54.270 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 17/31 2024-04-01T19:12:54.270 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 18/31 2024-04-01T19:12:54.270 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 19/31 2024-04-01T19:12:54.270 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 20/31 2024-04-01T19:12:54.270 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 21/31 2024-04-01T19:12:54.270 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 22/31 2024-04-01T19:12:54.270 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-portend-2.6-1.el8.noarch 23/31 2024-04-01T19:12:54.270 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 24/31 2024-04-01T19:12:54.270 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 25/31 2024-04-01T19:12:54.270 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 26/31 2024-04-01T19:12:54.270 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 27/31 2024-04-01T19:12:54.271 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 28/31 2024-04-01T19:12:54.271 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 29/31 2024-04-01T19:12:54.271 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 30/31 2024-04-01T19:12:54.441 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/31 2024-04-01T19:12:54.650 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 31/31 2024-04-01T19:12:54.650 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:12:54.650 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-04-01T19:12:54.651 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:54.651 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:54.651 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:54.651 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:54.651 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:54.651 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-01T19:12:54.651 INFO:teuthology.orchestra.run.smithi022.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-01T19:12:54.651 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-01T19:12:54.651 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-01T19:12:54.651 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-01T19:12:54.651 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-01T19:12:54.651 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-01T19:12:54.651 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-01T19:12:54.651 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-01T19:12:54.652 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-01T19:12:54.652 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-01T19:12:54.652 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-01T19:12:54.652 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-01T19:12:54.652 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend-2.6-1.el8.noarch 2024-04-01T19:12:54.652 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-01T19:12:54.652 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-01T19:12:54.652 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-01T19:12:54.652 INFO:teuthology.orchestra.run.smithi022.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-01T19:12:54.652 INFO:teuthology.orchestra.run.smithi022.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-01T19:12:54.652 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-01T19:12:54.652 INFO:teuthology.orchestra.run.smithi022.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-01T19:12:54.652 INFO:teuthology.orchestra.run.smithi022.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-01T19:12:54.653 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-01T19:12:54.653 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-01T19:12:54.653 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-01T19:12:54.653 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-01T19:12:54.653 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:12:54.653 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-01T19:12:54.684 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/31 2024-04-01T19:12:54.851 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-base 2024-04-01T19:12:55.010 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/31 2024-04-01T19:12:55.173 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 31/31 2024-04-01T19:12:55.173 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:12:55.173 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-01T19:12:55.173 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:55.174 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:55.174 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:55.174 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:55.174 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd-2:14.2.22-0.el8.x86_64 2024-04-01T19:12:55.174 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-01T19:12:55.174 INFO:teuthology.orchestra.run.smithi062.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-01T19:12:55.174 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-01T19:12:55.174 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-01T19:12:55.174 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-01T19:12:55.174 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-01T19:12:55.174 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-01T19:12:55.175 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-01T19:12:55.175 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-01T19:12:55.175 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-01T19:12:55.175 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-01T19:12:55.175 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-01T19:12:55.175 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-01T19:12:55.175 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend-2.6-1.el8.noarch 2024-04-01T19:12:55.175 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-01T19:12:55.175 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-01T19:12:55.175 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-01T19:12:55.175 INFO:teuthology.orchestra.run.smithi062.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-01T19:12:55.176 INFO:teuthology.orchestra.run.smithi062.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-01T19:12:55.176 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-01T19:12:55.176 INFO:teuthology.orchestra.run.smithi062.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-01T19:12:55.176 INFO:teuthology.orchestra.run.smithi062.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-01T19:12:55.176 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-01T19:12:55.176 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-01T19:12:55.176 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-01T19:12:55.176 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-01T19:12:55.176 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:12:55.176 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-01T19:12:55.264 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/31 2024-04-01T19:12:55.436 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/31 2024-04-01T19:12:55.443 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-base 2024-04-01T19:12:55.616 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:07 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:12:55.630 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/31 2024-04-01T19:12:55.902 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/31 2024-04-01T19:12:56.104 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/31 2024-04-01T19:12:56.213 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:08 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:12:56.346 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/31 2024-04-01T19:12:56.686 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/31 2024-04-01T19:12:57.118 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/31 2024-04-01T19:12:57.304 INFO:teuthology.orchestra.run.smithi022.stdout:Package ceph-base-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:12:57.357 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-01T19:12:57.358 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2024-04-01T19:12:57.358 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-01T19:12:57.366 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-2:14.2.22-0.el8.x86_64 27/31 2024-04-01T19:12:57.466 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-mgr 2024-04-01T19:12:57.908 INFO:teuthology.orchestra.run.smithi062.stdout:Package ceph-base-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:12:57.961 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-01T19:12:57.963 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-01T19:12:57.963 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-01T19:12:58.076 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr 2024-04-01T19:12:58.226 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:10 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:12:58.734 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-2:14.2.22-0.el8.x86_64 27/31 2024-04-01T19:12:58.839 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:10 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:12:58.916 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-osd-2:14.2.22-0.el8.x86_64 28/31 2024-04-01T19:12:59.313 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-osd-2:14.2.22-0.el8.x86_64 28/31 2024-04-01T19:12:59.483 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mon-2:14.2.22-0.el8.x86_64 29/31 2024-04-01T19:12:59.670 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mon-2:14.2.22-0.el8.x86_64 29/31 2024-04-01T19:12:59.874 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mds-2:14.2.22-0.el8.x86_64 30/31 2024-04-01T19:12:59.892 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mds-2:14.2.22-0.el8.x86_64 30/31 2024-04-01T19:12:59.912 INFO:teuthology.orchestra.run.smithi022.stdout:Package ceph-mgr-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:12:59.965 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-01T19:12:59.966 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2024-04-01T19:12:59.967 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-01T19:13:00.007 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-2:14.2.22-0.el8.x86_64 31/31 2024-04-01T19:13:00.119 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-mgr-dashboard 2024-04-01T19:13:00.418 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-2:14.2.22-0.el8.x86_64 31/31 2024-04-01T19:13:00.418 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-2:14.2.22-0.el8.x86_64 1/31 2024-04-01T19:13:00.419 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mds-2:14.2.22-0.el8.x86_64 2/31 2024-04-01T19:13:00.419 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-2:14.2.22-0.el8.x86_64 3/31 2024-04-01T19:13:00.419 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mon-2:14.2.22-0.el8.x86_64 4/31 2024-04-01T19:13:00.419 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-osd-2:14.2.22-0.el8.x86_64 5/31 2024-04-01T19:13:00.419 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 6/31 2024-04-01T19:13:00.419 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 7/31 2024-04-01T19:13:00.419 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 8/31 2024-04-01T19:13:00.419 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 9/31 2024-04-01T19:13:00.419 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 10/31 2024-04-01T19:13:00.419 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 11/31 2024-04-01T19:13:00.419 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 12/31 2024-04-01T19:13:00.419 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 13/31 2024-04-01T19:13:00.419 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 14/31 2024-04-01T19:13:00.419 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 15/31 2024-04-01T19:13:00.420 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 16/31 2024-04-01T19:13:00.420 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 17/31 2024-04-01T19:13:00.420 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 18/31 2024-04-01T19:13:00.420 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 19/31 2024-04-01T19:13:00.420 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 20/31 2024-04-01T19:13:00.420 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 21/31 2024-04-01T19:13:00.420 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 22/31 2024-04-01T19:13:00.420 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-portend-2.6-1.el8.noarch 23/31 2024-04-01T19:13:00.420 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 24/31 2024-04-01T19:13:00.420 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 25/31 2024-04-01T19:13:00.420 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 26/31 2024-04-01T19:13:00.420 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 27/31 2024-04-01T19:13:00.420 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 28/31 2024-04-01T19:13:00.420 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 29/31 2024-04-01T19:13:00.421 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 30/31 2024-04-01T19:13:00.530 INFO:teuthology.orchestra.run.smithi062.stdout:Package ceph-mgr-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:13:00.584 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-01T19:13:00.585 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-01T19:13:00.585 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-01T19:13:00.696 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-dashboard 2024-04-01T19:13:00.888 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:12 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:13:01.288 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 31/31 2024-04-01T19:13:01.288 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:01.288 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-04-01T19:13:01.288 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-2:14.2.22-0.el8.x86_64 2024-04-01T19:13:01.288 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mds-2:14.2.22-0.el8.x86_64 2024-04-01T19:13:01.288 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-2:14.2.22-0.el8.x86_64 2024-04-01T19:13:01.288 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mon-2:14.2.22-0.el8.x86_64 2024-04-01T19:13:01.288 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-osd-2:14.2.22-0.el8.x86_64 2024-04-01T19:13:01.288 INFO:teuthology.orchestra.run.smithi188.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-01T19:13:01.288 INFO:teuthology.orchestra.run.smithi188.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-01T19:13:01.289 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-01T19:13:01.289 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-01T19:13:01.289 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-01T19:13:01.289 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-01T19:13:01.289 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-01T19:13:01.289 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-01T19:13:01.289 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-01T19:13:01.289 INFO:teuthology.orchestra.run.smithi188.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-01T19:13:01.289 INFO:teuthology.orchestra.run.smithi188.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-01T19:13:01.289 INFO:teuthology.orchestra.run.smithi188.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-01T19:13:01.289 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-01T19:13:01.289 INFO:teuthology.orchestra.run.smithi188.stdout: python3-portend-2.6-1.el8.noarch 2024-04-01T19:13:01.289 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-01T19:13:01.289 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-01T19:13:01.289 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-01T19:13:01.290 INFO:teuthology.orchestra.run.smithi188.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-01T19:13:01.290 INFO:teuthology.orchestra.run.smithi188.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-01T19:13:01.290 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-01T19:13:01.290 INFO:teuthology.orchestra.run.smithi188.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-01T19:13:01.290 INFO:teuthology.orchestra.run.smithi188.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-01T19:13:01.290 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-01T19:13:01.290 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-01T19:13:01.290 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-01T19:13:01.290 INFO:teuthology.orchestra.run.smithi188.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-01T19:13:01.290 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:01.290 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-04-01T19:13:01.456 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:13 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:13:01.524 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-base 2024-04-01T19:13:02.269 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:13 ago on Mon 01 Apr 2024 07:11:49 PM UTC. 2024-04-01T19:13:02.625 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-01T19:13:02.626 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:13:02.626 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2024-04-01T19:13:02.626 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:13:02.626 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-04-01T19:13:02.626 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard noarch 2:14.2.22-0.el8 ceph-noarch 3.7 M 2024-04-01T19:13:02.626 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-04-01T19:13:02.627 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards noarch 2:14.2.22-0.el8 ceph-noarch 24 k 2024-04-01T19:13:02.627 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-01T19:13:02.627 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-01T19:13:02.627 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-01T19:13:02.627 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:02.627 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-04-01T19:13:02.627 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:13:02.627 INFO:teuthology.orchestra.run.smithi022.stdout:Install 5 Packages 2024-04-01T19:13:02.627 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:02.628 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 4.0 M 2024-04-01T19:13:02.628 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 17 M 2024-04-01T19:13:02.628 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-04-01T19:13:03.186 INFO:teuthology.orchestra.run.smithi022.stdout:(1/5): ceph-grafana-dashboards-14.2.22-0.el8.no 472 kB/s | 24 kB 00:00 2024-04-01T19:13:03.196 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-01T19:13:03.197 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:13:03.197 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-01T19:13:03.198 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:13:03.198 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-01T19:13:03.198 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard noarch 2:14.2.22-0.el8 ceph-noarch 3.7 M 2024-04-01T19:13:03.198 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-01T19:13:03.198 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards noarch 2:14.2.22-0.el8 ceph-noarch 24 k 2024-04-01T19:13:03.198 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-01T19:13:03.198 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-01T19:13:03.198 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-01T19:13:03.198 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:03.198 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-01T19:13:03.198 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:13:03.198 INFO:teuthology.orchestra.run.smithi062.stdout:Install 5 Packages 2024-04-01T19:13:03.199 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:03.199 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 4.0 M 2024-04-01T19:13:03.199 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 17 M 2024-04-01T19:13:03.199 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-01T19:13:03.261 INFO:teuthology.orchestra.run.smithi022.stdout:(2/5): ceph-mgr-dashboard-14.2.22-0.el8.noarch. 30 MB/s | 3.7 MB 00:00 2024-04-01T19:13:03.500 INFO:teuthology.orchestra.run.smithi062.stdout:(1/5): ceph-grafana-dashboards-14.2.22-0.el8.no 491 kB/s | 24 kB 00:00 2024-04-01T19:13:03.536 INFO:teuthology.orchestra.run.smithi022.stdout:(3/5): python3-jwt-1.6.1-2.el8.noarch.rpm 106 kB/s | 43 kB 00:00 2024-04-01T19:13:03.609 INFO:teuthology.orchestra.run.smithi062.stdout:(2/5): ceph-mgr-dashboard-14.2.22-0.el8.noarch. 24 MB/s | 3.7 MB 00:00 2024-04-01T19:13:03.661 INFO:teuthology.orchestra.run.smithi022.stdout:(4/5): python3-repoze-lru-0.7-6.el8.noarch.rpm 71 kB/s | 34 kB 00:00 2024-04-01T19:13:03.726 INFO:teuthology.orchestra.run.smithi062.stdout:(3/5): python3-repoze-lru-0.7-6.el8.noarch.rpm 149 kB/s | 34 kB 00:00 2024-04-01T19:13:03.834 INFO:teuthology.orchestra.run.smithi062.stdout:(4/5): python3-routes-2.4.1-12.el8.noarch.rpm 873 kB/s | 196 kB 00:00 2024-04-01T19:13:03.840 INFO:teuthology.orchestra.run.smithi188.stdout:Package ceph-base-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:13:03.876 INFO:teuthology.orchestra.run.smithi062.stdout:(5/5): python3-jwt-1.6.1-2.el8.noarch.rpm 100 kB/s | 43 kB 00:00 2024-04-01T19:13:03.877 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:13:03.877 INFO:teuthology.orchestra.run.smithi062.stdout:Total 5.9 MB/s | 4.0 MB 00:00 2024-04-01T19:13:03.886 INFO:teuthology.orchestra.run.smithi022.stdout:(5/5): python3-routes-2.4.1-12.el8.noarch.rpm 314 kB/s | 196 kB 00:00 2024-04-01T19:13:03.887 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-04-01T19:13:03.888 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-01T19:13:03.888 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-04-01T19:13:03.888 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-04-01T19:13:03.889 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:13:03.889 INFO:teuthology.orchestra.run.smithi022.stdout:Total 3.2 MB/s | 4.0 MB 00:01 2024-04-01T19:13:03.898 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-01T19:13:03.898 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-01T19:13:03.902 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-04-01T19:13:03.913 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-04-01T19:13:03.913 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-04-01T19:13:04.010 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-mgr 2024-04-01T19:13:04.065 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-01T19:13:04.069 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-01T19:13:04.090 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-04-01T19:13:04.094 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-04-01T19:13:04.354 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-04-01T19:13:04.358 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-01T19:13:04.554 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/5 2024-04-01T19:13:04.577 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/5 2024-04-01T19:13:04.742 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:15 ago on Mon 01 Apr 2024 07:11:49 PM UTC. 2024-04-01T19:13:04.798 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/5 2024-04-01T19:13:04.837 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/5 2024-04-01T19:13:04.970 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/5 2024-04-01T19:13:05.918 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-grafana-dashboards-2:14.2.22-0.el8.noarch 4/5 2024-04-01T19:13:06.330 INFO:teuthology.orchestra.run.smithi188.stdout:Package ceph-mgr-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:13:06.368 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/5 2024-04-01T19:13:06.378 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-04-01T19:13:06.380 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-04-01T19:13:06.380 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-04-01T19:13:06.498 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-mgr-dashboard 2024-04-01T19:13:06.784 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 5/5 2024-04-01T19:13:07.096 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 5/5 2024-04-01T19:13:07.097 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-grafana-dashboards-2:14.2.22-0.el8.noarch 1/5 2024-04-01T19:13:07.097 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 2/5 2024-04-01T19:13:07.097 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 3/5 2024-04-01T19:13:07.097 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/5 2024-04-01T19:13:07.223 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:18 ago on Mon 01 Apr 2024 07:11:49 PM UTC. 2024-04-01T19:13:07.495 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/5 2024-04-01T19:13:07.495 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:07.495 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-04-01T19:13:07.495 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards-2:14.2.22-0.el8.noarch 2024-04-01T19:13:07.495 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 2024-04-01T19:13:07.495 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-01T19:13:07.495 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-01T19:13:07.495 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-01T19:13:07.495 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:07.495 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-01T19:13:07.505 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-grafana-dashboards-2:14.2.22-0.el8.noarch 4/5 2024-04-01T19:13:07.626 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-01T19:13:07.753 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 5/5 2024-04-01T19:13:08.066 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 5/5 2024-04-01T19:13:08.066 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-grafana-dashboards-2:14.2.22-0.el8.noarch 1/5 2024-04-01T19:13:08.066 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 2/5 2024-04-01T19:13:08.066 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 3/5 2024-04-01T19:13:08.066 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/5 2024-04-01T19:13:08.402 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:20 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:13:08.493 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/5 2024-04-01T19:13:08.494 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:08.494 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-01T19:13:08.494 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards-2:14.2.22-0.el8.noarch 2024-04-01T19:13:08.494 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 2024-04-01T19:13:08.494 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-01T19:13:08.494 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-01T19:13:08.494 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-01T19:13:08.494 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:08.494 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-01T19:13:08.622 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-01T19:13:08.870 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-04-01T19:13:08.870 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:13:08.870 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-04-01T19:13:08.870 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:13:08.870 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-04-01T19:13:08.871 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard noarch 2:14.2.22-0.el8 ceph-noarch 3.7 M 2024-04-01T19:13:08.871 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-04-01T19:13:08.871 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-grafana-dashboards noarch 2:14.2.22-0.el8 ceph-noarch 24 k 2024-04-01T19:13:08.871 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-01T19:13:08.871 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-01T19:13:08.871 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-01T19:13:08.871 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:08.871 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-04-01T19:13:08.871 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:13:08.871 INFO:teuthology.orchestra.run.smithi188.stdout:Install 5 Packages 2024-04-01T19:13:08.871 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:08.872 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 4.0 M 2024-04-01T19:13:08.872 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 17 M 2024-04-01T19:13:08.872 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-04-01T19:13:09.282 INFO:teuthology.orchestra.run.smithi188.stdout:(1/5): ceph-grafana-dashboards-14.2.22-0.el8.no 536 kB/s | 24 kB 00:00 2024-04-01T19:13:09.349 INFO:teuthology.orchestra.run.smithi188.stdout:(2/5): ceph-mgr-dashboard-14.2.22-0.el8.noarch. 33 MB/s | 3.7 MB 00:00 2024-04-01T19:13:09.387 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:21 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:13:09.624 INFO:teuthology.orchestra.run.smithi188.stdout:(3/5): python3-jwt-1.6.1-2.el8.noarch.rpm 110 kB/s | 43 kB 00:00 2024-04-01T19:13:09.691 INFO:teuthology.orchestra.run.smithi188.stdout:(4/5): python3-repoze-lru-0.7-6.el8.noarch.rpm 82 kB/s | 34 kB 00:00 2024-04-01T19:13:09.974 INFO:teuthology.orchestra.run.smithi188.stdout:(5/5): python3-routes-2.4.1-12.el8.noarch.rpm 314 kB/s | 196 kB 00:00 2024-04-01T19:13:09.976 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:13:09.976 INFO:teuthology.orchestra.run.smithi188.stdout:Total 3.6 MB/s | 4.0 MB 00:01 2024-04-01T19:13:09.987 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-04-01T19:13:09.996 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-04-01T19:13:09.996 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-04-01T19:13:10.142 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-01T19:13:10.142 INFO:teuthology.orchestra.run.smithi022.stdout:============================================================================================ 2024-04-01T19:13:10.142 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2024-04-01T19:13:10.142 INFO:teuthology.orchestra.run.smithi022.stdout:============================================================================================ 2024-04-01T19:13:10.142 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-04-01T19:13:10.142 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local noarch 2:14.2.22-0.el8 ceph-noarch 1.1 M 2024-04-01T19:13:10.143 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-04-01T19:13:10.143 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-04-01T19:13:10.143 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-04-01T19:13:10.143 INFO:teuthology.orchestra.run.smithi022.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-01T19:13:10.143 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-01T19:13:10.143 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-01T19:13:10.143 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-01T19:13:10.143 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-01T19:13:10.143 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:10.143 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-04-01T19:13:10.143 INFO:teuthology.orchestra.run.smithi022.stdout:============================================================================================ 2024-04-01T19:13:10.143 INFO:teuthology.orchestra.run.smithi022.stdout:Install 8 Packages 2024-04-01T19:13:10.143 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:10.144 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 30 M 2024-04-01T19:13:10.144 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 172 M 2024-04-01T19:13:10.144 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-04-01T19:13:10.172 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-04-01T19:13:10.175 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-04-01T19:13:10.431 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-04-01T19:13:10.439 INFO:teuthology.orchestra.run.smithi022.stdout:(1/8): ceph-mgr-diskprediction-local-14.2.22-0. 20 MB/s | 1.1 MB 00:00 2024-04-01T19:13:10.652 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/5 2024-04-01T19:13:10.872 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/5 2024-04-01T19:13:10.906 INFO:teuthology.orchestra.run.smithi022.stdout:(2/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 8.0 MB/s | 3.7 MB 00:00 2024-04-01T19:13:10.973 INFO:teuthology.orchestra.run.smithi022.stdout:(3/8): openblas-0.3.15-4.el8.x86_64.rpm 8.0 MB/s | 4.7 MB 00:00 2024-04-01T19:13:11.032 INFO:teuthology.orchestra.run.smithi022.stdout:(4/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 7.5 MB/s | 4.9 MB 00:00 2024-04-01T19:13:11.057 INFO:teuthology.orchestra.run.smithi022.stdout:(5/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 1.5 MB/s | 225 kB 00:00 2024-04-01T19:13:11.095 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/5 2024-04-01T19:13:11.139 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-01T19:13:11.140 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================================ 2024-04-01T19:13:11.141 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-01T19:13:11.141 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================================ 2024-04-01T19:13:11.141 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-01T19:13:11.141 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local noarch 2:14.2.22-0.el8 ceph-noarch 1.1 M 2024-04-01T19:13:11.141 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-01T19:13:11.141 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-04-01T19:13:11.141 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-04-01T19:13:11.141 INFO:teuthology.orchestra.run.smithi062.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-01T19:13:11.141 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-01T19:13:11.141 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-01T19:13:11.141 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-01T19:13:11.141 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-01T19:13:11.142 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:11.142 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-01T19:13:11.142 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================================ 2024-04-01T19:13:11.142 INFO:teuthology.orchestra.run.smithi062.stdout:Install 8 Packages 2024-04-01T19:13:11.142 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:11.142 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 30 M 2024-04-01T19:13:11.142 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 172 M 2024-04-01T19:13:11.143 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-01T19:13:11.563 INFO:teuthology.orchestra.run.smithi062.stdout:(1/8): ceph-mgr-diskprediction-local-14.2.22-0. 20 MB/s | 1.1 MB 00:00 2024-04-01T19:13:11.591 INFO:teuthology.orchestra.run.smithi022.stdout:(6/8): python3-scipy-1.0.0-21.module_el8+762+77 23 MB/s | 14 MB 00:00 2024-04-01T19:13:11.648 INFO:teuthology.orchestra.run.smithi022.stdout:(7/8): libquadmath-8.5.0-21.el8.x86_64.rpm 292 kB/s | 172 kB 00:00 2024-04-01T19:13:11.792 INFO:teuthology.orchestra.run.smithi022.stdout:(8/8): libgfortran-8.5.0-21.el8.x86_64.rpm 850 kB/s | 645 kB 00:00 2024-04-01T19:13:11.792 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:13:11.792 INFO:teuthology.orchestra.run.smithi022.stdout:Total 18 MB/s | 30 MB 00:01 2024-04-01T19:13:11.990 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-grafana-dashboards-2:14.2.22-0.el8.noarch 4/5 2024-04-01T19:13:12.013 INFO:teuthology.orchestra.run.smithi062.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 9.6 MB/s | 4.9 MB 00:00 2024-04-01T19:13:12.030 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-04-01T19:13:12.050 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-04-01T19:13:12.050 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-04-01T19:13:12.080 INFO:teuthology.orchestra.run.smithi062.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 3.3 MB/s | 225 kB 00:00 2024-04-01T19:13:12.147 INFO:teuthology.orchestra.run.smithi062.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 6.4 MB/s | 3.7 MB 00:00 2024-04-01T19:13:12.214 INFO:teuthology.orchestra.run.smithi062.stdout:(5/8): openblas-0.3.15-4.el8.x86_64.rpm 6.7 MB/s | 4.7 MB 00:00 2024-04-01T19:13:12.271 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 5/5 2024-04-01T19:13:12.372 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-04-01T19:13:12.375 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-04-01T19:13:12.540 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 5/5 2024-04-01T19:13:12.540 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-grafana-dashboards-2:14.2.22-0.el8.noarch 1/5 2024-04-01T19:13:12.540 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 2/5 2024-04-01T19:13:12.540 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 3/5 2024-04-01T19:13:12.540 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/5 2024-04-01T19:13:12.681 INFO:teuthology.orchestra.run.smithi062.stdout:(6/8): python3-scipy-1.0.0-21.module_el8+762+77 24 MB/s | 14 MB 00:00 2024-04-01T19:13:12.706 INFO:teuthology.orchestra.run.smithi062.stdout:(7/8): libquadmath-8.5.0-21.el8.x86_64.rpm 350 kB/s | 172 kB 00:00 2024-04-01T19:13:12.899 INFO:teuthology.orchestra.run.smithi062.stdout:(8/8): libgfortran-8.5.0-21.el8.x86_64.rpm 859 kB/s | 645 kB 00:00 2024-04-01T19:13:12.899 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:13:12.899 INFO:teuthology.orchestra.run.smithi062.stdout:Total 17 MB/s | 30 MB 00:01 2024-04-01T19:13:12.944 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-04-01T19:13:12.945 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/5 2024-04-01T19:13:12.945 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:12.946 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-04-01T19:13:12.946 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-grafana-dashboards-2:14.2.22-0.el8.noarch 2024-04-01T19:13:12.946 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 2024-04-01T19:13:12.946 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-01T19:13:12.946 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-01T19:13:12.946 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-01T19:13:12.946 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:12.946 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-04-01T19:13:13.080 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-01T19:13:13.094 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2024-04-01T19:13:13.135 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-01T19:13:13.154 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-01T19:13:13.154 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-01T19:13:13.234 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2024-04-01T19:13:13.369 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2024-04-01T19:13:13.479 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-01T19:13:13.482 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-01T19:13:13.811 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:24 ago on Mon 01 Apr 2024 07:11:49 PM UTC. 2024-04-01T19:13:14.006 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2024-04-01T19:13:14.047 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-01T19:13:14.152 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-04-01T19:13:14.183 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2024-04-01T19:13:14.350 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2024-04-01T19:13:14.500 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2024-04-01T19:13:14.804 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-04-01T19:13:14.927 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-04-01T19:13:15.150 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2024-04-01T19:13:15.292 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-04-01T19:13:15.429 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-04-01T19:13:15.430 INFO:teuthology.orchestra.run.smithi188.stdout:============================================================================================ 2024-04-01T19:13:15.430 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-04-01T19:13:15.430 INFO:teuthology.orchestra.run.smithi188.stdout:============================================================================================ 2024-04-01T19:13:15.430 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-04-01T19:13:15.431 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-diskprediction-local noarch 2:14.2.22-0.el8 ceph-noarch 1.1 M 2024-04-01T19:13:15.431 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-04-01T19:13:15.431 INFO:teuthology.orchestra.run.smithi188.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-04-01T19:13:15.431 INFO:teuthology.orchestra.run.smithi188.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-04-01T19:13:15.431 INFO:teuthology.orchestra.run.smithi188.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-01T19:13:15.431 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-01T19:13:15.431 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-01T19:13:15.431 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-01T19:13:15.431 INFO:teuthology.orchestra.run.smithi188.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-01T19:13:15.431 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:15.431 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-04-01T19:13:15.431 INFO:teuthology.orchestra.run.smithi188.stdout:============================================================================================ 2024-04-01T19:13:15.431 INFO:teuthology.orchestra.run.smithi188.stdout:Install 8 Packages 2024-04-01T19:13:15.432 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:15.432 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 30 M 2024-04-01T19:13:15.432 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 172 M 2024-04-01T19:13:15.432 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-04-01T19:13:15.654 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-04-01T19:13:15.735 INFO:teuthology.orchestra.run.smithi188.stdout:(1/8): ceph-mgr-diskprediction-local-14.2.22-0. 18 MB/s | 1.1 MB 00:00 2024-04-01T19:13:15.949 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-04-01T19:13:15.986 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-04-01T19:13:16.108 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-04-01T19:13:16.152 INFO:teuthology.orchestra.run.smithi188.stdout:(2/8): openblas-0.3.15-4.el8.x86_64.rpm 9.9 MB/s | 4.7 MB 00:00 2024-04-01T19:13:16.210 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-01T19:13:16.236 INFO:teuthology.orchestra.run.smithi188.stdout:(3/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 8.6 MB/s | 4.9 MB 00:00 2024-04-01T19:13:16.261 INFO:teuthology.orchestra.run.smithi188.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 2.0 MB/s | 225 kB 00:00 2024-04-01T19:13:16.328 INFO:teuthology.orchestra.run.smithi188.stdout:(5/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 6.3 MB/s | 3.7 MB 00:00 2024-04-01T19:13:16.795 INFO:teuthology.orchestra.run.smithi188.stdout:(6/8): python3-scipy-1.0.0-21.module_el8+762+77 25 MB/s | 14 MB 00:00 2024-04-01T19:13:16.820 INFO:teuthology.orchestra.run.smithi188.stdout:(7/8): libquadmath-8.5.0-21.el8.x86_64.rpm 351 kB/s | 172 kB 00:00 2024-04-01T19:13:16.832 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-04-01T19:13:16.988 INFO:teuthology.orchestra.run.smithi188.stdout:(8/8): libgfortran-8.5.0-21.el8.x86_64.rpm 889 kB/s | 645 kB 00:00 2024-04-01T19:13:16.988 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:13:16.988 INFO:teuthology.orchestra.run.smithi188.stdout:Total 19 MB/s | 30 MB 00:01 2024-04-01T19:13:17.174 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-04-01T19:13:17.218 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-04-01T19:13:17.237 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-04-01T19:13:17.237 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-04-01T19:13:17.417 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-01T19:13:17.548 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-04-01T19:13:17.551 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-04-01T19:13:18.089 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-01T19:13:18.105 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-04-01T19:13:18.286 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2024-04-01T19:13:18.417 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2024-04-01T19:13:18.553 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2024-04-01T19:13:18.667 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-04-01T19:13:18.860 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-diskprediction-local-2:14.2.22-0.el8.noarch 8/8 2024-04-01T19:13:19.168 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:14.2.22-0.el8.noarch 8/8 2024-04-01T19:13:19.169 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-diskprediction-local-2:14.2.22-0.el8.noarch 1/8 2024-04-01T19:13:19.169 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-04-01T19:13:19.169 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-04-01T19:13:19.169 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-04-01T19:13:19.169 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-04-01T19:13:19.169 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-04-01T19:13:19.169 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2024-04-01T19:13:19.180 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2024-04-01T19:13:19.298 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-01T19:13:19.328 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-04-01T19:13:19.594 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2024-04-01T19:13:19.594 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:19.594 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-04-01T19:13:19.594 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local-2:14.2.22-0.el8.noarch 2024-04-01T19:13:19.594 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-04-01T19:13:19.594 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-04-01T19:13:19.594 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-01T19:13:19.594 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-01T19:13:19.595 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-01T19:13:19.595 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-01T19:13:19.595 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-01T19:13:19.595 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:19.595 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-01T19:13:19.728 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-mgr-rook 2024-04-01T19:13:19.924 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-04-01T19:13:19.948 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-04-01T19:13:20.103 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-04-01T19:13:20.133 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-diskprediction-local-2:14.2.22-0.el8.noarch 8/8 2024-04-01T19:13:20.458 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:14.2.22-0.el8.noarch 8/8 2024-04-01T19:13:20.458 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-diskprediction-local-2:14.2.22-0.el8.noarch 1/8 2024-04-01T19:13:20.458 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-04-01T19:13:20.458 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-04-01T19:13:20.458 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-04-01T19:13:20.458 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-04-01T19:13:20.458 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-04-01T19:13:20.459 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2024-04-01T19:13:20.491 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:32 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:13:20.820 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-04-01T19:13:20.882 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2024-04-01T19:13:20.882 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:20.882 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-01T19:13:20.882 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local-2:14.2.22-0.el8.noarch 2024-04-01T19:13:20.882 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-04-01T19:13:20.882 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-04-01T19:13:20.882 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-01T19:13:20.883 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-01T19:13:20.883 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-01T19:13:20.883 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-01T19:13:20.883 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-01T19:13:20.883 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:20.883 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-01T19:13:21.021 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-rook 2024-04-01T19:13:21.155 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-04-01T19:13:21.444 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-01T19:13:21.783 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:33 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:13:22.252 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-01T19:13:22.254 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:13:22.254 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2024-04-01T19:13:22.254 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:13:22.254 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-04-01T19:13:22.255 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook noarch 2:14.2.22-0.el8 ceph-noarch 15 k 2024-04-01T19:13:22.255 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-04-01T19:13:22.255 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-01T19:13:22.255 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-01T19:13:22.255 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-01T19:13:22.255 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-01T19:13:22.255 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-01T19:13:22.255 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-01T19:13:22.255 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-01T19:13:22.255 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-01T19:13:22.256 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-01T19:13:22.256 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-01T19:13:22.256 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:22.256 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-04-01T19:13:22.256 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:13:22.256 INFO:teuthology.orchestra.run.smithi022.stdout:Install 11 Packages 2024-04-01T19:13:22.256 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:22.257 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 1.9 M 2024-04-01T19:13:22.257 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 24 M 2024-04-01T19:13:22.257 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-04-01T19:13:23.058 INFO:teuthology.orchestra.run.smithi022.stdout:(1/11): ceph-mgr-rook-14.2.22-0.el8.noarch.rpm 72 kB/s | 15 kB 00:00 2024-04-01T19:13:23.189 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-01T19:13:23.250 INFO:teuthology.orchestra.run.smithi022.stdout:(2/11): python3-pyasn1-modules-0.3.7-6.el8.noar 272 kB/s | 110 kB 00:00 2024-04-01T19:13:23.295 INFO:teuthology.orchestra.run.smithi022.stdout:(3/11): python3-pyasn1-0.3.7-6.el8.noarch.rpm 281 kB/s | 126 kB 00:00 2024-04-01T19:13:23.509 INFO:teuthology.orchestra.run.smithi022.stdout:(4/11): python3-oauthlib-2.1.0-1.el8.noarch.rpm 344 kB/s | 155 kB 00:00 2024-04-01T19:13:23.521 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-01T19:13:23.523 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:13:23.523 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-01T19:13:23.523 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:13:23.523 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-01T19:13:23.523 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook noarch 2:14.2.22-0.el8 ceph-noarch 15 k 2024-04-01T19:13:23.523 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-01T19:13:23.523 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-01T19:13:23.523 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-01T19:13:23.524 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-01T19:13:23.524 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-01T19:13:23.524 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-01T19:13:23.524 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-01T19:13:23.524 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-01T19:13:23.524 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-01T19:13:23.524 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-01T19:13:23.524 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-01T19:13:23.524 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:23.524 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-01T19:13:23.524 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:13:23.524 INFO:teuthology.orchestra.run.smithi062.stdout:Install 11 Packages 2024-04-01T19:13:23.524 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:23.525 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 1.9 M 2024-04-01T19:13:23.525 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 24 M 2024-04-01T19:13:23.525 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-01T19:13:23.526 INFO:teuthology.orchestra.run.smithi022.stdout:(5/11): python3-cachetools-3.1.1-4.el8.noarch.r 143 kB/s | 33 kB 00:00 2024-04-01T19:13:23.585 INFO:teuthology.orchestra.run.smithi022.stdout:(6/11): python3-requests-oauthlib-1.0.0-1.el8.n 128 kB/s | 43 kB 00:00 2024-04-01T19:13:23.668 INFO:teuthology.orchestra.run.smithi022.stdout:(7/11): python3-certifi-2018.10.15-7.el8.noarch 103 kB/s | 16 kB 00:00 2024-04-01T19:13:23.781 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-04-01T19:13:24.052 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-diskprediction-local-2:14.2.22-0.el8.noarch 8/8 2024-04-01T19:13:24.115 INFO:teuthology.orchestra.run.smithi062.stdout:(1/11): ceph-mgr-rook-14.2.22-0.el8.noarch.rpm 316 kB/s | 15 kB 00:00 2024-04-01T19:13:24.268 INFO:teuthology.orchestra.run.smithi022.stdout:(8/11): python3-rsa-4.9-2.el8.noarch.rpm 107 kB/s | 64 kB 00:00 2024-04-01T19:13:24.282 INFO:teuthology.orchestra.run.smithi062.stdout:(2/11): python3-pyasn1-modules-0.3.7-6.el8.noar 511 kB/s | 110 kB 00:00 2024-04-01T19:13:24.307 INFO:teuthology.orchestra.run.smithi062.stdout:(3/11): python3-pyasn1-0.3.7-6.el8.noarch.rpm 525 kB/s | 126 kB 00:00 2024-04-01T19:13:24.370 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:14.2.22-0.el8.noarch 8/8 2024-04-01T19:13:24.370 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-diskprediction-local-2:14.2.22-0.el8.noarch 1/8 2024-04-01T19:13:24.370 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-04-01T19:13:24.370 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-04-01T19:13:24.370 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-04-01T19:13:24.370 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-04-01T19:13:24.370 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-04-01T19:13:24.370 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2024-04-01T19:13:24.541 INFO:teuthology.orchestra.run.smithi062.stdout:(4/11): python3-oauthlib-2.1.0-1.el8.noarch.rpm 364 kB/s | 155 kB 00:00 2024-04-01T19:13:24.543 INFO:teuthology.orchestra.run.smithi022.stdout:(9/11): python3-websocket-client-0.56.0-5.el8.n 222 kB/s | 61 kB 00:00 2024-04-01T19:13:24.633 INFO:teuthology.orchestra.run.smithi062.stdout:(5/11): python3-requests-oauthlib-1.0.0-1.el8.n 122 kB/s | 43 kB 00:00 2024-04-01T19:13:24.658 INFO:teuthology.orchestra.run.smithi062.stdout:(6/11): python3-certifi-2018.10.15-7.el8.noarch 139 kB/s | 16 kB 00:00 2024-04-01T19:13:24.725 INFO:teuthology.orchestra.run.smithi062.stdout:(7/11): python3-google-auth-1.1.1-10.el8.noarch 884 kB/s | 81 kB 00:00 2024-04-01T19:13:24.770 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2024-04-01T19:13:24.770 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:24.770 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-04-01T19:13:24.770 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-diskprediction-local-2:14.2.22-0.el8.noarch 2024-04-01T19:13:24.770 INFO:teuthology.orchestra.run.smithi188.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-04-01T19:13:24.771 INFO:teuthology.orchestra.run.smithi188.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-04-01T19:13:24.771 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-01T19:13:24.771 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-01T19:13:24.771 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-01T19:13:24.771 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-01T19:13:24.771 INFO:teuthology.orchestra.run.smithi188.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-01T19:13:24.771 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:24.771 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-04-01T19:13:24.784 INFO:teuthology.orchestra.run.smithi062.stdout:(8/11): python3-rsa-4.9-2.el8.noarch.rpm 1.1 MB/s | 64 kB 00:00 2024-04-01T19:13:24.794 INFO:teuthology.orchestra.run.smithi022.stdout:(10/11): python3-kubernetes-11.0.0-6.el8.noarch 987 kB/s | 1.2 MB 00:01 2024-04-01T19:13:24.842 INFO:teuthology.orchestra.run.smithi062.stdout:(9/11): python3-websocket-client-0.56.0-5.el8.n 1.0 MB/s | 61 kB 00:00 2024-04-01T19:13:24.909 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-mgr-rook 2024-04-01T19:13:25.635 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:36 ago on Mon 01 Apr 2024 07:11:49 PM UTC. 2024-04-01T19:13:25.836 INFO:teuthology.orchestra.run.smithi022.stdout:(11/11): python3-google-auth-1.1.1-10.el8.noarc 35 kB/s | 81 kB 00:02 2024-04-01T19:13:25.836 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:13:25.836 INFO:teuthology.orchestra.run.smithi022.stdout:Total 530 kB/s | 1.9 MB 00:03 2024-04-01T19:13:25.879 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-04-01T19:13:25.895 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-04-01T19:13:25.895 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-04-01T19:13:25.976 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-04-01T19:13:25.980 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-04-01T19:13:26.448 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-04-01T19:13:26.680 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/11 2024-04-01T19:13:26.886 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/11 2024-04-01T19:13:27.112 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/11 2024-04-01T19:13:27.260 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-04-01T19:13:27.261 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:13:27.261 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-04-01T19:13:27.262 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:13:27.262 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-04-01T19:13:27.262 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-rook noarch 2:14.2.22-0.el8 ceph-noarch 15 k 2024-04-01T19:13:27.262 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-04-01T19:13:27.262 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-01T19:13:27.262 INFO:teuthology.orchestra.run.smithi188.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-01T19:13:27.262 INFO:teuthology.orchestra.run.smithi188.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-01T19:13:27.262 INFO:teuthology.orchestra.run.smithi188.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-01T19:13:27.262 INFO:teuthology.orchestra.run.smithi188.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-01T19:13:27.262 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-01T19:13:27.262 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-01T19:13:27.262 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-01T19:13:27.263 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-01T19:13:27.263 INFO:teuthology.orchestra.run.smithi188.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-01T19:13:27.263 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:27.263 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-04-01T19:13:27.263 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:13:27.263 INFO:teuthology.orchestra.run.smithi188.stdout:Install 11 Packages 2024-04-01T19:13:27.263 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:27.263 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 1.9 M 2024-04-01T19:13:27.263 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 24 M 2024-04-01T19:13:27.264 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-04-01T19:13:27.341 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/11 2024-04-01T19:13:27.553 INFO:teuthology.orchestra.run.smithi188.stdout:(1/11): ceph-mgr-rook-14.2.22-0.el8.noarch.rpm 352 kB/s | 15 kB 00:00 2024-04-01T19:13:27.557 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/11 2024-04-01T19:13:27.576 INFO:teuthology.orchestra.run.smithi062.stdout:(10/11): python3-cachetools-3.1.1-4.el8.noarch. 10 kB/s | 33 kB 00:03 2024-04-01T19:13:27.704 INFO:teuthology.orchestra.run.smithi188.stdout:(2/11): python3-pyasn1-0.3.7-6.el8.noarch.rpm 652 kB/s | 126 kB 00:00 2024-04-01T19:13:27.729 INFO:teuthology.orchestra.run.smithi188.stdout:(3/11): python3-pyasn1-modules-0.3.7-6.el8.noar 502 kB/s | 110 kB 00:00 2024-04-01T19:13:27.801 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/11 2024-04-01T19:13:27.980 INFO:teuthology.orchestra.run.smithi188.stdout:(4/11): python3-oauthlib-2.1.0-1.el8.noarch.rpm 364 kB/s | 155 kB 00:00 2024-04-01T19:13:28.051 INFO:teuthology.orchestra.run.smithi062.stdout:(11/11): python3-kubernetes-11.0.0-6.el8.noarch 352 kB/s | 1.2 MB 00:03 2024-04-01T19:13:28.052 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:13:28.052 INFO:teuthology.orchestra.run.smithi062.stdout:Total 419 kB/s | 1.9 MB 00:04 2024-04-01T19:13:28.054 INFO:teuthology.orchestra.run.smithi188.stdout:(5/11): python3-requests-oauthlib-1.0.0-1.el8.n 122 kB/s | 43 kB 00:00 2024-04-01T19:13:28.095 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-01T19:13:28.111 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-01T19:13:28.111 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-01T19:13:28.146 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/11 2024-04-01T19:13:28.193 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-01T19:13:28.196 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-01T19:13:28.298 INFO:teuthology.orchestra.run.smithi188.stdout:(6/11): python3-cachetools-3.1.1-4.el8.noarch.r 58 kB/s | 33 kB 00:00 2024-04-01T19:13:28.347 INFO:teuthology.orchestra.run.smithi188.stdout:(7/11): python3-certifi-2018.10.15-7.el8.noarch 44 kB/s | 16 kB 00:00 2024-04-01T19:13:28.383 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/11 2024-04-01T19:13:28.547 INFO:teuthology.orchestra.run.smithi188.stdout:(8/11): python3-google-auth-1.1.1-10.el8.noarch 165 kB/s | 81 kB 00:00 2024-04-01T19:13:28.572 INFO:teuthology.orchestra.run.smithi188.stdout:(9/11): python3-rsa-4.9-2.el8.noarch.rpm 285 kB/s | 64 kB 00:00 2024-04-01T19:13:28.722 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-01T19:13:28.739 INFO:teuthology.orchestra.run.smithi188.stdout:(10/11): python3-websocket-client-0.56.0-5.el8. 319 kB/s | 61 kB 00:00 2024-04-01T19:13:28.840 INFO:teuthology.orchestra.run.smithi188.stdout:(11/11): python3-kubernetes-11.0.0-6.el8.noarch 2.2 MB/s | 1.2 MB 00:00 2024-04-01T19:13:28.842 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:13:28.843 INFO:teuthology.orchestra.run.smithi188.stdout:Total 1.2 MB/s | 1.9 MB 00:01 2024-04-01T19:13:28.885 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-04-01T19:13:28.901 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-04-01T19:13:28.901 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-04-01T19:13:28.937 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/11 2024-04-01T19:13:28.990 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-04-01T19:13:28.995 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-04-01T19:13:29.159 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/11 2024-04-01T19:13:29.385 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/11 2024-04-01T19:13:29.459 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/11 2024-04-01T19:13:29.622 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/11 2024-04-01T19:13:29.736 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/11 2024-04-01T19:13:29.864 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/11 2024-04-01T19:13:29.891 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-rook-2:14.2.22-0.el8.noarch 11/11 2024-04-01T19:13:30.106 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/11 2024-04-01T19:13:30.198 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-rook-2:14.2.22-0.el8.noarch 11/11 2024-04-01T19:13:30.198 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-rook-2:14.2.22-0.el8.noarch 1/11 2024-04-01T19:13:30.199 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 2/11 2024-04-01T19:13:30.199 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/11 2024-04-01T19:13:30.199 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 4/11 2024-04-01T19:13:30.199 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 5/11 2024-04-01T19:13:30.199 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 6/11 2024-04-01T19:13:30.199 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 7/11 2024-04-01T19:13:30.199 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 8/11 2024-04-01T19:13:30.199 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 9/11 2024-04-01T19:13:30.199 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 10/11 2024-04-01T19:13:30.418 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/11 2024-04-01T19:13:30.532 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-04-01T19:13:30.663 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/11 2024-04-01T19:13:30.667 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 11/11 2024-04-01T19:13:30.667 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:30.667 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-04-01T19:13:30.667 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook-2:14.2.22-0.el8.noarch 2024-04-01T19:13:30.667 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-01T19:13:30.667 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-01T19:13:30.667 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-01T19:13:30.668 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-01T19:13:30.668 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-01T19:13:30.668 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-01T19:13:30.668 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-01T19:13:30.668 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-01T19:13:30.668 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-01T19:13:30.668 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-01T19:13:30.668 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:30.668 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-01T19:13:30.783 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-fuse 2024-04-01T19:13:30.786 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/11 2024-04-01T19:13:30.991 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/11 2024-04-01T19:13:31.235 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/11 2024-04-01T19:13:31.481 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/11 2024-04-01T19:13:31.546 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:43 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:13:31.730 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/11 2024-04-01T19:13:31.875 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/11 2024-04-01T19:13:31.952 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/11 2024-04-01T19:13:32.209 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/11 2024-04-01T19:13:32.288 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/11 2024-04-01T19:13:32.381 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-rook-2:14.2.22-0.el8.noarch 11/11 2024-04-01T19:13:32.554 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/11 2024-04-01T19:13:32.690 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-rook-2:14.2.22-0.el8.noarch 11/11 2024-04-01T19:13:32.690 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-rook-2:14.2.22-0.el8.noarch 1/11 2024-04-01T19:13:32.690 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 2/11 2024-04-01T19:13:32.690 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/11 2024-04-01T19:13:32.690 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 4/11 2024-04-01T19:13:32.690 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 5/11 2024-04-01T19:13:32.690 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 6/11 2024-04-01T19:13:32.690 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 7/11 2024-04-01T19:13:32.690 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 8/11 2024-04-01T19:13:32.690 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 9/11 2024-04-01T19:13:32.690 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 10/11 2024-04-01T19:13:33.173 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 11/11 2024-04-01T19:13:33.173 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:33.174 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-01T19:13:33.174 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook-2:14.2.22-0.el8.noarch 2024-04-01T19:13:33.174 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-01T19:13:33.174 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-01T19:13:33.174 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-01T19:13:33.174 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-01T19:13:33.174 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-01T19:13:33.174 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-01T19:13:33.174 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-01T19:13:33.174 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-01T19:13:33.174 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-01T19:13:33.174 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-01T19:13:33.175 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:33.175 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-01T19:13:33.293 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-01T19:13:33.294 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:13:33.294 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2024-04-01T19:13:33.294 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:13:33.294 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-04-01T19:13:33.295 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse x86_64 2:14.2.22-0.el8 ceph 590 k 2024-04-01T19:13:33.295 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-04-01T19:13:33.295 INFO:teuthology.orchestra.run.smithi022.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-01T19:13:33.295 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:33.295 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-04-01T19:13:33.295 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:13:33.295 INFO:teuthology.orchestra.run.smithi022.stdout:Install 2 Packages 2024-04-01T19:13:33.295 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:33.296 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 673 k 2024-04-01T19:13:33.296 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 1.9 M 2024-04-01T19:13:33.296 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-04-01T19:13:33.297 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-fuse 2024-04-01T19:13:33.408 INFO:teuthology.orchestra.run.smithi022.stdout:(1/2): ceph-fuse-14.2.22-0.el8.x86_64.rpm 11 MB/s | 590 kB 00:00 2024-04-01T19:13:33.622 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/11 2024-04-01T19:13:33.699 INFO:teuthology.orchestra.run.smithi022.stdout:(2/2): fuse-2.9.7-19.el8.x86_64.rpm 241 kB/s | 83 kB 00:00 2024-04-01T19:13:33.700 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:13:33.700 INFO:teuthology.orchestra.run.smithi022.stdout:Total 1.6 MB/s | 673 kB 00:00 2024-04-01T19:13:33.711 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-04-01T19:13:33.734 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-04-01T19:13:33.734 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-04-01T19:13:33.826 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-04-01T19:13:33.829 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-04-01T19:13:33.910 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/11 2024-04-01T19:13:34.008 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-04-01T19:13:34.041 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-rook-2:14.2.22-0.el8.noarch 11/11 2024-04-01T19:13:34.063 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:46 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:13:34.242 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-04-01T19:13:34.312 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-rook-2:14.2.22-0.el8.noarch 11/11 2024-04-01T19:13:34.313 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-rook-2:14.2.22-0.el8.noarch 1/11 2024-04-01T19:13:34.313 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 2/11 2024-04-01T19:13:34.313 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/11 2024-04-01T19:13:34.313 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 4/11 2024-04-01T19:13:34.313 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 5/11 2024-04-01T19:13:34.313 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 6/11 2024-04-01T19:13:34.313 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 7/11 2024-04-01T19:13:34.313 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 8/11 2024-04-01T19:13:34.313 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 9/11 2024-04-01T19:13:34.313 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 10/11 2024-04-01T19:13:34.433 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-fuse-2:14.2.22-0.el8.x86_64 2/2 2024-04-01T19:13:34.778 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 11/11 2024-04-01T19:13:34.778 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:34.778 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-04-01T19:13:34.778 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-rook-2:14.2.22-0.el8.noarch 2024-04-01T19:13:34.778 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-01T19:13:34.778 INFO:teuthology.orchestra.run.smithi188.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-01T19:13:34.778 INFO:teuthology.orchestra.run.smithi188.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-01T19:13:34.778 INFO:teuthology.orchestra.run.smithi188.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-01T19:13:34.779 INFO:teuthology.orchestra.run.smithi188.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-01T19:13:34.779 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-01T19:13:34.779 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-01T19:13:34.779 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-01T19:13:34.779 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-01T19:13:34.779 INFO:teuthology.orchestra.run.smithi188.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-01T19:13:34.779 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:34.779 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-04-01T19:13:34.843 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-fuse-2:14.2.22-0.el8.x86_64 2/2 2024-04-01T19:13:34.844 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-fuse-2:14.2.22-0.el8.x86_64 1/2 2024-04-01T19:13:34.892 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-fuse 2024-04-01T19:13:35.284 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-04-01T19:13:35.285 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:35.285 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-04-01T19:13:35.285 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse-2:14.2.22-0.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-04-01T19:13:35.285 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:35.285 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-01T19:13:35.503 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install librados-devel 2024-04-01T19:13:35.625 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:46 ago on Mon 01 Apr 2024 07:11:49 PM UTC. 2024-04-01T19:13:35.807 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-01T19:13:35.808 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:13:35.808 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-04-01T19:13:35.808 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:13:35.808 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-01T19:13:35.808 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse x86_64 2:14.2.22-0.el8 ceph 590 k 2024-04-01T19:13:35.808 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-01T19:13:35.808 INFO:teuthology.orchestra.run.smithi062.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-01T19:13:35.808 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:35.808 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-01T19:13:35.808 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:13:35.808 INFO:teuthology.orchestra.run.smithi062.stdout:Install 2 Packages 2024-04-01T19:13:35.808 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:35.809 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 673 k 2024-04-01T19:13:35.809 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 1.9 M 2024-04-01T19:13:35.809 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-01T19:13:36.057 INFO:teuthology.orchestra.run.smithi062.stdout:(1/2): ceph-fuse-14.2.22-0.el8.x86_64.rpm 10 MB/s | 590 kB 00:00 2024-04-01T19:13:36.272 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:48 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:13:36.374 INFO:teuthology.orchestra.run.smithi062.stdout:(2/2): fuse-2.9.7-19.el8.x86_64.rpm 223 kB/s | 83 kB 00:00 2024-04-01T19:13:36.375 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:13:36.375 INFO:teuthology.orchestra.run.smithi062.stdout:Total 1.2 MB/s | 673 kB 00:00 2024-04-01T19:13:36.385 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-01T19:13:36.409 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-01T19:13:36.409 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-01T19:13:36.502 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-01T19:13:36.505 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-01T19:13:36.725 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-01T19:13:36.966 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-04-01T19:13:37.181 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-fuse-2:14.2.22-0.el8.x86_64 2/2 2024-04-01T19:13:37.226 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-04-01T19:13:37.228 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:13:37.228 INFO:teuthology.orchestra.run.smithi188.stdout: Package Architecture Version Repository Size 2024-04-01T19:13:37.228 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:13:37.228 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-04-01T19:13:37.228 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-fuse x86_64 2:14.2.22-0.el8 ceph 590 k 2024-04-01T19:13:37.228 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-04-01T19:13:37.228 INFO:teuthology.orchestra.run.smithi188.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-01T19:13:37.228 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:37.228 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-04-01T19:13:37.228 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:13:37.228 INFO:teuthology.orchestra.run.smithi188.stdout:Install 2 Packages 2024-04-01T19:13:37.228 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:37.229 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 673 k 2024-04-01T19:13:37.229 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 1.9 M 2024-04-01T19:13:37.229 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-04-01T19:13:37.339 INFO:teuthology.orchestra.run.smithi188.stdout:(1/2): ceph-fuse-14.2.22-0.el8.x86_64.rpm 11 MB/s | 590 kB 00:00 2024-04-01T19:13:37.597 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-fuse-2:14.2.22-0.el8.x86_64 2/2 2024-04-01T19:13:37.598 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-fuse-2:14.2.22-0.el8.x86_64 1/2 2024-04-01T19:13:37.639 INFO:teuthology.orchestra.run.smithi188.stdout:(2/2): fuse-2.9.7-19.el8.x86_64.rpm 236 kB/s | 83 kB 00:00 2024-04-01T19:13:37.640 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:13:37.640 INFO:teuthology.orchestra.run.smithi188.stdout:Total 1.6 MB/s | 673 kB 00:00 2024-04-01T19:13:37.649 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-04-01T19:13:37.671 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-04-01T19:13:37.672 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-04-01T19:13:37.756 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-04-01T19:13:37.759 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-04-01T19:13:37.937 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-04-01T19:13:37.998 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-04-01T19:13:37.998 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:37.998 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-01T19:13:37.998 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse-2:14.2.22-0.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-04-01T19:13:37.998 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:37.998 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-01T19:13:38.013 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-01T19:13:38.014 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:13:38.014 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2024-04-01T19:13:38.014 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:13:38.014 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-04-01T19:13:38.014 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel x86_64 2:14.2.22-0.el8 ceph 90 k 2024-04-01T19:13:38.014 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:38.014 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-04-01T19:13:38.014 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:13:38.014 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2024-04-01T19:13:38.014 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:38.015 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 90 k 2024-04-01T19:13:38.015 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 310 k 2024-04-01T19:13:38.015 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-04-01T19:13:38.052 INFO:teuthology.orchestra.run.smithi022.stdout:librados-devel-14.2.22-0.el8.x86_64.rpm 2.4 MB/s | 90 kB 00:00 2024-04-01T19:13:38.053 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:13:38.053 INFO:teuthology.orchestra.run.smithi022.stdout:Total 2.3 MB/s | 90 kB 00:00 2024-04-01T19:13:38.053 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-04-01T19:13:38.065 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-04-01T19:13:38.065 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-04-01T19:13:38.119 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-04-01T19:13:38.122 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-04-01T19:13:38.188 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-04-01T19:13:38.233 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-04-01T19:13:38.415 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-fuse-2:14.2.22-0.el8.x86_64 2/2 2024-04-01T19:13:38.507 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install librados-devel 2024-04-01T19:13:38.581 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librados-devel-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:38.803 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-fuse-2:14.2.22-0.el8.x86_64 2/2 2024-04-01T19:13:38.803 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-fuse-2:14.2.22-0.el8.x86_64 1/2 2024-04-01T19:13:38.893 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados-devel-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:39.187 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-04-01T19:13:39.187 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:39.187 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-04-01T19:13:39.187 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-fuse-2:14.2.22-0.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-04-01T19:13:39.187 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:39.187 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-04-01T19:13:39.291 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:51 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:13:39.294 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados-devel-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:39.294 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:39.294 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-04-01T19:13:39.294 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel-2:14.2.22-0.el8.x86_64 2024-04-01T19:13:39.294 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:39.294 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-01T19:13:39.422 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install librados-devel 2024-04-01T19:13:39.523 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install libcephfs2 2024-04-01T19:13:40.162 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:51 ago on Mon 01 Apr 2024 07:11:49 PM UTC. 2024-04-01T19:13:40.289 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:52 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:13:41.040 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-01T19:13:41.040 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:13:41.041 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-04-01T19:13:41.041 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:13:41.041 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-01T19:13:41.041 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel x86_64 2:14.2.22-0.el8 ceph 90 k 2024-04-01T19:13:41.041 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:41.041 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-01T19:13:41.041 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:13:41.041 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-04-01T19:13:41.041 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:41.042 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 90 k 2024-04-01T19:13:41.042 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 310 k 2024-04-01T19:13:41.042 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-01T19:13:41.080 INFO:teuthology.orchestra.run.smithi062.stdout:librados-devel-14.2.22-0.el8.x86_64.rpm 2.3 MB/s | 90 kB 00:00 2024-04-01T19:13:41.081 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:13:41.081 INFO:teuthology.orchestra.run.smithi062.stdout:Total 2.2 MB/s | 90 kB 00:00 2024-04-01T19:13:41.081 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-01T19:13:41.093 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-01T19:13:41.093 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-01T19:13:41.147 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-01T19:13:41.151 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-01T19:13:41.272 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-01T19:13:41.513 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librados-devel-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:41.795 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados-devel-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:41.804 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-04-01T19:13:41.804 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:13:41.804 INFO:teuthology.orchestra.run.smithi188.stdout: Package Architecture Version Repository Size 2024-04-01T19:13:41.805 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:13:41.805 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-04-01T19:13:41.805 INFO:teuthology.orchestra.run.smithi188.stdout: librados-devel x86_64 2:14.2.22-0.el8 ceph 90 k 2024-04-01T19:13:41.805 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:41.805 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-04-01T19:13:41.805 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:13:41.805 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2024-04-01T19:13:41.805 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:41.806 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 90 k 2024-04-01T19:13:41.806 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 310 k 2024-04-01T19:13:41.806 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-04-01T19:13:41.852 INFO:teuthology.orchestra.run.smithi188.stdout:librados-devel-14.2.22-0.el8.x86_64.rpm 1.9 MB/s | 90 kB 00:00 2024-04-01T19:13:41.852 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:13:41.853 INFO:teuthology.orchestra.run.smithi188.stdout:Total 1.9 MB/s | 90 kB 00:00 2024-04-01T19:13:41.853 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-04-01T19:13:41.863 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-04-01T19:13:41.863 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-04-01T19:13:41.912 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-04-01T19:13:41.915 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-04-01T19:13:41.972 INFO:teuthology.orchestra.run.smithi022.stdout:Package libcephfs2-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:13:42.023 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-01T19:13:42.025 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2024-04-01T19:13:42.025 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-01T19:13:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-04-01T19:13:42.120 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install libcephfs-devel 2024-04-01T19:13:42.179 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados-devel-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:42.179 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:42.179 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-01T19:13:42.179 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel-2:14.2.22-0.el8.x86_64 2024-04-01T19:13:42.179 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:42.179 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-01T19:13:42.263 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librados-devel-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:42.382 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install libcephfs2 2024-04-01T19:13:42.584 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados-devel-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:42.879 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:54 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:13:43.000 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados-devel-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:43.000 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:43.000 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-04-01T19:13:43.001 INFO:teuthology.orchestra.run.smithi188.stdout: librados-devel-2:14.2.22-0.el8.x86_64 2024-04-01T19:13:43.001 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:43.001 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-04-01T19:13:43.147 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:55 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:13:43.201 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install libcephfs2 2024-04-01T19:13:43.942 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:54 ago on Mon 01 Apr 2024 07:11:49 PM UTC. 2024-04-01T19:13:44.647 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-01T19:13:44.648 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:13:44.648 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2024-04-01T19:13:44.648 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:13:44.648 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-04-01T19:13:44.648 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel x86_64 2:14.2.22-0.el8 ceph 22 k 2024-04-01T19:13:44.648 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:44.648 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-04-01T19:13:44.648 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:13:44.648 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2024-04-01T19:13:44.648 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:44.649 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 22 k 2024-04-01T19:13:44.649 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 77 k 2024-04-01T19:13:44.649 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-04-01T19:13:44.699 INFO:teuthology.orchestra.run.smithi022.stdout:libcephfs-devel-14.2.22-0.el8.x86_64.rpm 434 kB/s | 22 kB 00:00 2024-04-01T19:13:44.699 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:13:44.700 INFO:teuthology.orchestra.run.smithi022.stdout:Total 424 kB/s | 22 kB 00:00 2024-04-01T19:13:44.700 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-04-01T19:13:44.703 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-04-01T19:13:44.703 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-04-01T19:13:44.705 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-04-01T19:13:44.709 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-04-01T19:13:44.759 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-04-01T19:13:44.834 INFO:teuthology.orchestra.run.smithi062.stdout:Package libcephfs2-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:13:44.885 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-01T19:13:44.887 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-01T19:13:44.887 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-01T19:13:44.946 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:45.121 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install libcephfs-devel 2024-04-01T19:13:45.207 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:45.510 INFO:teuthology.orchestra.run.smithi188.stdout:Package libcephfs2-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:13:45.558 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-04-01T19:13:45.559 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-04-01T19:13:45.559 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-04-01T19:13:45.570 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:45.571 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-04-01T19:13:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel-2:14.2.22-0.el8.x86_64 2024-04-01T19:13:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:45.571 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-01T19:13:45.659 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install libcephfs-devel 2024-04-01T19:13:45.721 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install librados2 2024-04-01T19:13:45.884 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:57 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:13:46.391 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:57 ago on Mon 01 Apr 2024 07:11:49 PM UTC. 2024-04-01T19:13:46.483 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:58 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:13:47.640 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-01T19:13:47.640 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:13:47.640 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-04-01T19:13:47.641 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:13:47.641 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-01T19:13:47.641 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel x86_64 2:14.2.22-0.el8 ceph 22 k 2024-04-01T19:13:47.641 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:47.641 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-01T19:13:47.641 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:13:47.641 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-04-01T19:13:47.641 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:47.642 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 22 k 2024-04-01T19:13:47.642 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 77 k 2024-04-01T19:13:47.642 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-01T19:13:47.733 INFO:teuthology.orchestra.run.smithi062.stdout:libcephfs-devel-14.2.22-0.el8.x86_64.rpm 236 kB/s | 22 kB 00:00 2024-04-01T19:13:47.734 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:13:47.734 INFO:teuthology.orchestra.run.smithi062.stdout:Total 233 kB/s | 22 kB 00:00 2024-04-01T19:13:47.734 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-01T19:13:47.737 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-01T19:13:47.738 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-01T19:13:47.740 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-01T19:13:47.743 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-01T19:13:47.850 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-01T19:13:48.003 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:48.005 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-04-01T19:13:48.006 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:13:48.006 INFO:teuthology.orchestra.run.smithi188.stdout: Package Architecture Version Repository Size 2024-04-01T19:13:48.006 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:13:48.006 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-04-01T19:13:48.006 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-devel x86_64 2:14.2.22-0.el8 ceph 22 k 2024-04-01T19:13:48.006 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:48.006 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-04-01T19:13:48.006 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:13:48.007 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2024-04-01T19:13:48.007 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:48.007 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 22 k 2024-04-01T19:13:48.007 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 77 k 2024-04-01T19:13:48.007 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-04-01T19:13:48.048 INFO:teuthology.orchestra.run.smithi188.stdout:libcephfs-devel-14.2.22-0.el8.x86_64.rpm 532 kB/s | 22 kB 00:00 2024-04-01T19:13:48.049 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:13:48.049 INFO:teuthology.orchestra.run.smithi188.stdout:Total 516 kB/s | 22 kB 00:00 2024-04-01T19:13:48.049 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-04-01T19:13:48.052 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-04-01T19:13:48.053 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-04-01T19:13:48.054 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-04-01T19:13:48.057 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-04-01T19:13:48.108 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-04-01T19:13:48.171 INFO:teuthology.orchestra.run.smithi022.stdout:Package librados2-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:13:48.223 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-01T19:13:48.224 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2024-04-01T19:13:48.224 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-01T19:13:48.253 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:48.279 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:48.323 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install librbd1 2024-04-01T19:13:48.511 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:48.684 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:48.684 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:48.684 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-01T19:13:48.684 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel-2:14.2.22-0.el8.x86_64 2024-04-01T19:13:48.684 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:48.684 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-01T19:13:48.856 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:48.857 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:48.857 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-04-01T19:13:48.857 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-devel-2:14.2.22-0.el8.x86_64 2024-04-01T19:13:48.857 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:48.857 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-04-01T19:13:48.918 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install librados2 2024-04-01T19:13:48.967 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install librados2 2024-04-01T19:13:49.096 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:02:01 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:13:49.681 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:01 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:13:49.699 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:02:00 ago on Mon 01 Apr 2024 07:11:49 PM UTC. 2024-04-01T19:13:50.785 INFO:teuthology.orchestra.run.smithi022.stdout:Package librbd1-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:13:50.837 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-01T19:13:50.838 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2024-04-01T19:13:50.838 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-01T19:13:50.937 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install rbd-fuse 2024-04-01T19:13:51.266 INFO:teuthology.orchestra.run.smithi188.stdout:Package librados2-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:13:51.314 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-04-01T19:13:51.315 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-04-01T19:13:51.315 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-04-01T19:13:51.365 INFO:teuthology.orchestra.run.smithi062.stdout:Package librados2-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:13:51.416 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-01T19:13:51.417 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-01T19:13:51.417 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-01T19:13:51.509 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install librbd1 2024-04-01T19:13:51.702 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:02:03 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:13:51.808 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install librbd1 2024-04-01T19:13:52.277 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:04 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:13:52.544 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:02:03 ago on Mon 01 Apr 2024 07:11:49 PM UTC. 2024-04-01T19:13:53.436 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-01T19:13:53.437 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:13:53.437 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2024-04-01T19:13:53.437 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:13:53.437 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-04-01T19:13:53.437 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse x86_64 2:14.2.22-0.el8 ceph 73 k 2024-04-01T19:13:53.437 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:53.437 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-04-01T19:13:53.437 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:13:53.437 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2024-04-01T19:13:53.438 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:53.438 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 73 k 2024-04-01T19:13:53.438 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 188 k 2024-04-01T19:13:53.438 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-04-01T19:13:53.479 INFO:teuthology.orchestra.run.smithi022.stdout:rbd-fuse-14.2.22-0.el8.x86_64.rpm 1.8 MB/s | 73 kB 00:00 2024-04-01T19:13:53.479 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:13:53.480 INFO:teuthology.orchestra.run.smithi022.stdout:Total 1.7 MB/s | 73 kB 00:00 2024-04-01T19:13:53.480 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-04-01T19:13:53.491 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-04-01T19:13:53.491 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-04-01T19:13:53.545 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-04-01T19:13:53.548 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-04-01T19:13:53.664 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-04-01T19:13:53.870 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:53.967 INFO:teuthology.orchestra.run.smithi062.stdout:Package librbd1-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:13:54.019 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-01T19:13:54.020 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-01T19:13:54.020 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-01T19:13:54.097 INFO:teuthology.orchestra.run.smithi188.stdout:Package librbd1-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:13:54.110 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install rbd-fuse 2024-04-01T19:13:54.144 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-04-01T19:13:54.145 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-04-01T19:13:54.145 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-04-01T19:13:54.170 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:54.241 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install rbd-fuse 2024-04-01T19:13:54.612 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:54.612 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:54.612 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-04-01T19:13:54.612 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse-2:14.2.22-0.el8.x86_64 2024-04-01T19:13:54.612 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:54.612 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-01T19:13:54.838 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install rbd-mirror 2024-04-01T19:13:54.875 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:06 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:13:54.975 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:02:05 ago on Mon 01 Apr 2024 07:11:49 PM UTC. 2024-04-01T19:13:55.614 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:02:07 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:13:56.606 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-04-01T19:13:56.607 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:13:56.607 INFO:teuthology.orchestra.run.smithi188.stdout: Package Architecture Version Repository Size 2024-04-01T19:13:56.607 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:13:56.607 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-04-01T19:13:56.607 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-fuse x86_64 2:14.2.22-0.el8 ceph 73 k 2024-04-01T19:13:56.607 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:56.607 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-04-01T19:13:56.607 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:13:56.607 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2024-04-01T19:13:56.607 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:56.608 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 73 k 2024-04-01T19:13:56.608 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 188 k 2024-04-01T19:13:56.608 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-04-01T19:13:56.617 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-01T19:13:56.617 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:13:56.618 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-04-01T19:13:56.618 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:13:56.618 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-01T19:13:56.618 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse x86_64 2:14.2.22-0.el8 ceph 73 k 2024-04-01T19:13:56.618 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:56.618 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-01T19:13:56.618 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:13:56.618 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-04-01T19:13:56.618 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:56.619 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 73 k 2024-04-01T19:13:56.619 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 188 k 2024-04-01T19:13:56.619 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-01T19:13:56.651 INFO:teuthology.orchestra.run.smithi188.stdout:rbd-fuse-14.2.22-0.el8.x86_64.rpm 1.6 MB/s | 73 kB 00:00 2024-04-01T19:13:56.652 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:13:56.652 INFO:teuthology.orchestra.run.smithi188.stdout:Total 1.6 MB/s | 73 kB 00:00 2024-04-01T19:13:56.652 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-04-01T19:13:56.663 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-04-01T19:13:56.663 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-04-01T19:13:56.663 INFO:teuthology.orchestra.run.smithi062.stdout:rbd-fuse-14.2.22-0.el8.x86_64.rpm 1.6 MB/s | 73 kB 00:00 2024-04-01T19:13:56.664 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:13:56.664 INFO:teuthology.orchestra.run.smithi062.stdout:Total 1.6 MB/s | 73 kB 00:00 2024-04-01T19:13:56.664 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-01T19:13:56.676 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-01T19:13:56.676 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-01T19:13:56.712 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-04-01T19:13:56.714 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-04-01T19:13:56.729 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-01T19:13:56.732 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-01T19:13:56.824 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-04-01T19:13:56.837 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-01T19:13:57.069 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:57.251 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:57.362 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-01T19:13:57.366 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:13:57.366 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2024-04-01T19:13:57.366 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:13:57.366 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-04-01T19:13:57.366 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror x86_64 2:14.2.22-0.el8 ceph 2.3 M 2024-04-01T19:13:57.366 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:57.366 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-04-01T19:13:57.366 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:13:57.366 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2024-04-01T19:13:57.366 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:57.367 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 2.3 M 2024-04-01T19:13:57.367 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 8.4 M 2024-04-01T19:13:57.367 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-04-01T19:13:57.380 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:57.432 INFO:teuthology.orchestra.run.smithi022.stdout:rbd-mirror-14.2.22-0.el8.x86_64.rpm 34 MB/s | 2.3 MB 00:00 2024-04-01T19:13:57.433 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:13:57.433 INFO:teuthology.orchestra.run.smithi022.stdout:Total 33 MB/s | 2.3 MB 00:00 2024-04-01T19:13:57.433 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-04-01T19:13:57.446 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-04-01T19:13:57.446 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-04-01T19:13:57.510 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-04-01T19:13:57.513 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-04-01T19:13:57.771 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:57.771 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:57.771 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-01T19:13:57.771 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse-2:14.2.22-0.el8.x86_64 2024-04-01T19:13:57.771 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:13:57.771 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-01T19:13:57.838 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-04-01T19:13:57.846 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:57.993 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install rbd-mirror 2024-04-01T19:13:58.020 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:58.204 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:58.204 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:58.204 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-04-01T19:13:58.204 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-fuse-2:14.2.22-0.el8.x86_64 2024-04-01T19:13:58.204 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:13:58.205 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-04-01T19:13:58.449 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install rbd-mirror 2024-04-01T19:13:58.480 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:58.768 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:10 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:13:58.928 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:13:58.929 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:58.929 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-04-01T19:13:58.929 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror-2:14.2.22-0.el8.x86_64 2024-04-01T19:13:58.929 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:13:58.929 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-01T19:13:59.118 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install rbd-nbd 2024-04-01T19:13:59.195 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:02:10 ago on Mon 01 Apr 2024 07:11:49 PM UTC. 2024-04-01T19:13:59.882 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:02:11 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:14:00.520 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-01T19:14:00.521 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:14:00.521 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-04-01T19:14:00.521 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:14:00.521 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-01T19:14:00.521 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror x86_64 2:14.2.22-0.el8 ceph 2.3 M 2024-04-01T19:14:00.521 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:14:00.521 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-01T19:14:00.521 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:14:00.522 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-04-01T19:14:00.522 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:14:00.522 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 2.3 M 2024-04-01T19:14:00.522 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 8.4 M 2024-04-01T19:14:00.522 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-01T19:14:00.617 INFO:teuthology.orchestra.run.smithi062.stdout:rbd-mirror-14.2.22-0.el8.x86_64.rpm 25 MB/s | 2.3 MB 00:00 2024-04-01T19:14:00.617 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:14:00.618 INFO:teuthology.orchestra.run.smithi062.stdout:Total 24 MB/s | 2.3 MB 00:00 2024-04-01T19:14:00.618 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-01T19:14:00.631 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-01T19:14:00.631 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-01T19:14:00.695 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-01T19:14:00.698 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-01T19:14:00.816 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-04-01T19:14:00.818 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:14:00.818 INFO:teuthology.orchestra.run.smithi188.stdout: Package Architecture Version Repository Size 2024-04-01T19:14:00.818 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:14:00.818 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-04-01T19:14:00.818 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-mirror x86_64 2:14.2.22-0.el8 ceph 2.3 M 2024-04-01T19:14:00.818 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:14:00.818 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-04-01T19:14:00.818 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:14:00.818 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2024-04-01T19:14:00.818 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:14:00.818 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 2.3 M 2024-04-01T19:14:00.819 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 8.4 M 2024-04-01T19:14:00.819 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-04-01T19:14:00.892 INFO:teuthology.orchestra.run.smithi188.stdout:rbd-mirror-14.2.22-0.el8.x86_64.rpm 32 MB/s | 2.3 MB 00:00 2024-04-01T19:14:00.893 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:14:00.893 INFO:teuthology.orchestra.run.smithi188.stdout:Total 31 MB/s | 2.3 MB 00:00 2024-04-01T19:14:00.893 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-04-01T19:14:00.905 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-04-01T19:14:00.905 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-04-01T19:14:00.963 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-04-01T19:14:00.966 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-04-01T19:14:01.028 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-01T19:14:01.236 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:14:01.275 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-04-01T19:14:01.518 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:14:01.636 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-01T19:14:01.636 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:14:01.636 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2024-04-01T19:14:01.636 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:14:01.636 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-04-01T19:14:01.636 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd x86_64 2:14.2.22-0.el8 ceph 142 k 2024-04-01T19:14:01.637 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:14:01.637 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-04-01T19:14:01.637 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-04-01T19:14:01.637 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2024-04-01T19:14:01.637 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:14:01.637 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 142 k 2024-04-01T19:14:01.638 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 422 k 2024-04-01T19:14:01.638 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-04-01T19:14:01.657 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:14:01.696 INFO:teuthology.orchestra.run.smithi022.stdout:rbd-nbd-14.2.22-0.el8.x86_64.rpm 2.4 MB/s | 142 kB 00:00 2024-04-01T19:14:01.697 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:14:01.697 INFO:teuthology.orchestra.run.smithi022.stdout:Total 2.3 MB/s | 142 kB 00:00 2024-04-01T19:14:01.697 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-04-01T19:14:01.709 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-04-01T19:14:01.710 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-04-01T19:14:01.774 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-04-01T19:14:01.777 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-04-01T19:14:01.903 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-04-01T19:14:01.947 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:14:02.094 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:14:02.107 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:14:02.107 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:14:02.107 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-01T19:14:02.107 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror-2:14.2.22-0.el8.x86_64 2024-04-01T19:14:02.107 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:14:02.108 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-01T19:14:02.303 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install rbd-nbd 2024-04-01T19:14:02.337 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:14:02.337 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:14:02.337 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-04-01T19:14:02.337 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-mirror-2:14.2.22-0.el8.x86_64 2024-04-01T19:14:02.337 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:14:02.337 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-04-01T19:14:02.390 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:14:02.568 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install rbd-nbd 2024-04-01T19:14:02.790 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:14:02.790 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:14:02.790 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-04-01T19:14:02.790 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd-2:14.2.22-0.el8.x86_64 2024-04-01T19:14:02.790 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:14:02.790 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-01T19:14:02.997 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install python-rados 2024-04-01T19:14:03.068 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:15 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:14:03.314 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:02:14 ago on Mon 01 Apr 2024 07:11:49 PM UTC. 2024-04-01T19:14:03.766 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:02:15 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:14:04.806 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-01T19:14:04.807 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:14:04.807 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-04-01T19:14:04.807 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:14:04.807 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-01T19:14:04.807 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd x86_64 2:14.2.22-0.el8 ceph 142 k 2024-04-01T19:14:04.807 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:14:04.807 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-01T19:14:04.807 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-01T19:14:04.807 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-04-01T19:14:04.808 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:14:04.808 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 142 k 2024-04-01T19:14:04.808 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 422 k 2024-04-01T19:14:04.808 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-01T19:14:04.846 INFO:teuthology.orchestra.run.smithi062.stdout:rbd-nbd-14.2.22-0.el8.x86_64.rpm 3.7 MB/s | 142 kB 00:00 2024-04-01T19:14:04.846 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:14:04.846 INFO:teuthology.orchestra.run.smithi062.stdout:Total 3.6 MB/s | 142 kB 00:00 2024-04-01T19:14:04.847 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-01T19:14:04.859 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-01T19:14:04.859 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-01T19:14:04.923 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-01T19:14:04.926 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-01T19:14:04.942 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-04-01T19:14:04.943 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:14:04.943 INFO:teuthology.orchestra.run.smithi188.stdout: Package Architecture Version Repository Size 2024-04-01T19:14:04.943 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:14:04.943 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-04-01T19:14:04.943 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-nbd x86_64 2:14.2.22-0.el8 ceph 142 k 2024-04-01T19:14:04.943 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:14:04.943 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-04-01T19:14:04.943 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-04-01T19:14:04.943 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2024-04-01T19:14:04.944 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:14:04.944 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 142 k 2024-04-01T19:14:04.944 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 422 k 2024-04-01T19:14:04.944 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-04-01T19:14:04.990 INFO:teuthology.orchestra.run.smithi188.stdout:rbd-nbd-14.2.22-0.el8.x86_64.rpm 3.0 MB/s | 142 kB 00:00 2024-04-01T19:14:04.990 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:14:04.991 INFO:teuthology.orchestra.run.smithi188.stdout:Total 3.0 MB/s | 142 kB 00:00 2024-04-01T19:14:04.991 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-04-01T19:14:05.001 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-04-01T19:14:05.002 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-04-01T19:14:05.051 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-01T19:14:05.061 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-04-01T19:14:05.064 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-04-01T19:14:05.179 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-04-01T19:14:05.251 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:14:05.391 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:14:05.448 INFO:teuthology.orchestra.run.smithi022.stdout:Package python3-rados-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:14:05.500 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-01T19:14:05.502 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2024-04-01T19:14:05.502 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-01T19:14:05.562 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:14:05.597 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install python-rgw 2024-04-01T19:14:05.732 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:14:06.125 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:14:06.126 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:14:06.126 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-04-01T19:14:06.126 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-nbd-2:14.2.22-0.el8.x86_64 2024-04-01T19:14:06.126 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:14:06.126 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-04-01T19:14:06.200 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2024-04-01T19:14:06.201 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:14:06.201 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-01T19:14:06.201 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd-2:14.2.22-0.el8.x86_64 2024-04-01T19:14:06.201 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-01T19:14:06.201 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-01T19:14:06.314 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install python-rados 2024-04-01T19:14:06.362 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:02:18 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:14:06.598 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install python-rados 2024-04-01T19:14:07.055 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:02:18 ago on Mon 01 Apr 2024 07:11:49 PM UTC. 2024-04-01T19:14:07.372 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:19 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:14:08.060 INFO:teuthology.orchestra.run.smithi022.stdout:Package python3-rgw-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:14:08.113 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-01T19:14:08.115 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2024-04-01T19:14:08.115 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-01T19:14:08.218 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install python-rbd 2024-04-01T19:14:08.633 INFO:teuthology.orchestra.run.smithi188.stdout:Package python3-rados-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:14:08.682 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-04-01T19:14:08.683 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-04-01T19:14:08.683 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-04-01T19:14:08.785 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install python-rgw 2024-04-01T19:14:08.987 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:02:20 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:14:09.058 INFO:teuthology.orchestra.run.smithi062.stdout:Package python3-rados-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:14:09.112 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-01T19:14:09.113 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-01T19:14:09.113 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-01T19:14:09.216 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install python-rgw 2024-04-01T19:14:09.521 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:02:20 ago on Mon 01 Apr 2024 07:11:49 PM UTC. 2024-04-01T19:14:09.988 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:21 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:14:10.681 INFO:teuthology.orchestra.run.smithi022.stdout:Package python3-rbd-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:14:10.734 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-01T19:14:10.735 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2024-04-01T19:14:10.735 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-01T19:14:10.833 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install python-cephfs 2024-04-01T19:14:11.092 INFO:teuthology.orchestra.run.smithi188.stdout:Package python3-rgw-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:14:11.141 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-04-01T19:14:11.142 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-04-01T19:14:11.142 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-04-01T19:14:11.248 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install python-rbd 2024-04-01T19:14:11.601 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:02:23 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:14:11.706 INFO:teuthology.orchestra.run.smithi062.stdout:Package python3-rgw-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:14:11.761 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-01T19:14:11.762 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-01T19:14:11.762 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-01T19:14:11.895 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install python-rbd 2024-04-01T19:14:11.981 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:02:22 ago on Mon 01 Apr 2024 07:11:49 PM UTC. 2024-04-01T19:14:12.662 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:24 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:14:13.296 INFO:teuthology.orchestra.run.smithi022.stdout:Package python3-cephfs-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:14:13.350 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-04-01T19:14:13.351 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2024-04-01T19:14:13.351 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-04-01T19:14:13.444 DEBUG:teuthology.parallel:result is None 2024-04-01T19:14:13.556 INFO:teuthology.orchestra.run.smithi188.stdout:Package python3-rbd-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:14:13.605 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-04-01T19:14:13.606 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-04-01T19:14:13.606 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-04-01T19:14:13.705 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install python-cephfs 2024-04-01T19:14:14.346 INFO:teuthology.orchestra.run.smithi062.stdout:Package python3-rbd-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:14:14.399 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-01T19:14:14.400 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-01T19:14:14.400 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-01T19:14:14.442 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:02:25 ago on Mon 01 Apr 2024 07:11:49 PM UTC. 2024-04-01T19:14:14.499 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install python-cephfs 2024-04-01T19:14:15.269 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:27 ago on Mon 01 Apr 2024 07:11:48 PM UTC. 2024-04-01T19:14:16.018 INFO:teuthology.orchestra.run.smithi188.stdout:Package python3-cephfs-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:14:16.069 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-04-01T19:14:16.070 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-04-01T19:14:16.070 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-04-01T19:14:16.190 DEBUG:teuthology.parallel:result is None 2024-04-01T19:14:16.954 INFO:teuthology.orchestra.run.smithi062.stdout:Package python3-cephfs-2:14.2.22-0.el8.x86_64 is already installed. 2024-04-01T19:14:17.007 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-01T19:14:17.009 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-01T19:14:17.009 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-01T19:14:17.100 DEBUG:teuthology.parallel:result is None 2024-04-01T19:14:17.100 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-01T19:14:17.100 INFO:teuthology.packaging:ref: None 2024-04-01T19:14:17.101 INFO:teuthology.packaging:tag: None 2024-04-01T19:14:17.101 INFO:teuthology.packaging:branch: nautilus 2024-04-01T19:14:17.101 INFO:teuthology.packaging:sha1: e142085d06ebbedb32196116c9f19e2d28f93430 2024-04-01T19:14:17.101 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2024-04-01T19:14:17.283 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-01T19:14:17.310 INFO:teuthology.orchestra.run.smithi022.stdout:14.2.22-0.el8 2024-04-01T19:14:17.311 INFO:teuthology.packaging:The installed version of ceph is 14.2.22-0.el8 2024-04-01T19:14:17.311 INFO:teuthology.task.install:The correct ceph version 14.2.22-0 is installed. 2024-04-01T19:14:17.313 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-01T19:14:17.313 INFO:teuthology.packaging:ref: None 2024-04-01T19:14:17.313 INFO:teuthology.packaging:tag: None 2024-04-01T19:14:17.313 INFO:teuthology.packaging:branch: nautilus 2024-04-01T19:14:17.313 INFO:teuthology.packaging:sha1: e142085d06ebbedb32196116c9f19e2d28f93430 2024-04-01T19:14:17.313 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2024-04-01T19:14:17.567 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-01T19:14:17.591 INFO:teuthology.orchestra.run.smithi062.stdout:14.2.22-0.el8 2024-04-01T19:14:17.591 INFO:teuthology.packaging:The installed version of ceph is 14.2.22-0.el8 2024-04-01T19:14:17.591 INFO:teuthology.task.install:The correct ceph version 14.2.22-0 is installed. 2024-04-01T19:14:17.593 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-01T19:14:17.593 INFO:teuthology.packaging:ref: None 2024-04-01T19:14:17.593 INFO:teuthology.packaging:tag: None 2024-04-01T19:14:17.593 INFO:teuthology.packaging:branch: nautilus 2024-04-01T19:14:17.593 INFO:teuthology.packaging:sha1: e142085d06ebbedb32196116c9f19e2d28f93430 2024-04-01T19:14:17.593 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2024-04-01T19:14:17.845 DEBUG:teuthology.orchestra.run.smithi188:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-01T19:14:17.872 INFO:teuthology.orchestra.run.smithi188.stdout:14.2.22-0.el8 2024-04-01T19:14:17.872 INFO:teuthology.packaging:The installed version of ceph is 14.2.22-0.el8 2024-04-01T19:14:17.872 INFO:teuthology.task.install:The correct ceph version 14.2.22-0 is installed. 2024-04-01T19:14:17.874 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-01T19:14:17.874 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-01T19:14:17.874 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-01T19:14:17.908 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-01T19:14:17.908 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-01T19:14:17.938 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-01T19:14:17.938 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-01T19:14:17.970 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-01T19:14:17.971 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-01T19:14:17.971 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/daemon-helper 2024-04-01T19:14:18.003 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-01T19:14:18.075 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-01T19:14:18.075 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2024-04-01T19:14:18.104 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-01T19:14:18.173 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-01T19:14:18.173 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/daemon-helper 2024-04-01T19:14:18.205 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-01T19:14:18.277 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-01T19:14:18.277 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-01T19:14:18.277 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-01T19:14:18.311 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-01T19:14:18.384 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-01T19:14:18.384 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-01T19:14:18.413 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-01T19:14:18.483 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-01T19:14:18.483 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-01T19:14:18.515 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-01T19:14:18.585 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-01T19:14:18.585 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-01T19:14:18.585 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/stdin-killer 2024-04-01T19:14:18.618 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-01T19:14:18.691 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-01T19:14:18.692 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/stdin-killer 2024-04-01T19:14:18.722 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-01T19:14:18.792 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-01T19:14:18.792 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/stdin-killer 2024-04-01T19:14:18.827 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-01T19:14:18.899 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-01T19:14:18.987 INFO:tasks.cephadm:Config: {'conf': {'mon': {'auth allow insecure global id reclaim': True, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'client.2': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'osd': {'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd heartbeat use min delay socket': True, 'osd map cache size': 1, 'osd max backfills': 6, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub during recovery': False, 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', '\\(MON_DOWN\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'osd_map_cache_size', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'mon_bind_msgr2': False, 'sha1': 'e142085d06ebbedb32196116c9f19e2d28f93430'} 2024-04-01T19:14:18.988 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 2024-04-01T19:14:18.988 INFO:tasks.cephadm:Cluster fsid is 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:14:18.988 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-01T19:14:18.988 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '[v1:172.21.15.22:6789]', 'mon.b': '[v1:172.21.15.62:6789]', 'mon.c': '[v1:172.21.15.188:6789]'} 2024-04-01T19:14:18.988 INFO:tasks.cephadm:First mon is mon.a on smithi022 2024-04-01T19:14:18.989 INFO:tasks.cephadm:First mgr is y 2024-04-01T19:14:18.989 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-01T19:14:18.989 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname $(hostname -s) 2024-04-01T19:14:19.022 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname $(hostname -s) 2024-04-01T19:14:19.056 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname $(hostname -s) 2024-04-01T19:14:19.088 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-04-01T19:14:19.088 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=e142085d06ebbedb32196116c9f19e2d28f93430 2024-04-01T19:14:19.226 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'e142085d06ebbedb32196116c9f19e2d28f93430', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/77964/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-2492-ge142085d', 'node_name': '172.21.4.63+confusa01', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-2492.ge142085d'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-03-25-1419/e142085d06ebbedb32196116c9f19e2d28f93430/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2024-03-26 03:47:19.096735', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-yuri8-testing-2024-03-25-1419', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-yuri8-testing-2024-03-25-1419/e142085d06ebbedb32196116c9f19e2d28f93430/centos/8/flavors/default/', 'archs': ['arm64', 'source', 'x86_64'], 'distro': 'centos'}] 2024-04-01T19:14:19.369 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-yuri8-testing-2024-03-25-1419, sha1 e142085d06ebbedb32196116c9f19e2d28f93430 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=e142085d06ebbedb32196116c9f19e2d28f93430 2024-04-01T19:14:19.370 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-yuri8-testing-2024-03-25-1419/e142085d06ebbedb32196116c9f19e2d28f93430/centos/8/x86_64/flavors/default/cephadm 2024-04-01T19:14:19.370 DEBUG:teuthology.orchestra.run.smithi022:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-yuri8-testing-2024-03-25-1419/e142085d06ebbedb32196116c9f19e2d28f93430/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-01T19:14:19.847 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-rw-r--. 1 ubuntu ubuntu 2293632 Apr 1 19:14 /home/ubuntu/cephtest/cephadm 2024-04-01T19:14:19.848 DEBUG:teuthology.orchestra.run.smithi062:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-yuri8-testing-2024-03-25-1419/e142085d06ebbedb32196116c9f19e2d28f93430/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-01T19:14:20.531 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-rw-r--. 1 ubuntu ubuntu 2293632 Apr 1 19:14 /home/ubuntu/cephtest/cephadm 2024-04-01T19:14:20.531 DEBUG:teuthology.orchestra.run.smithi188:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-yuri8-testing-2024-03-25-1419/e142085d06ebbedb32196116c9f19e2d28f93430/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-01T19:14:21.015 INFO:teuthology.orchestra.run.smithi188.stdout:-rw-rw-r--. 1 ubuntu ubuntu 2293632 Apr 1 19:14 /home/ubuntu/cephtest/cephadm 2024-04-01T19:14:21.015 DEBUG:teuthology.orchestra.run.smithi022:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-01T19:14:21.041 DEBUG:teuthology.orchestra.run.smithi062:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-01T19:14:21.072 DEBUG:teuthology.orchestra.run.smithi188:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-01T19:14:21.123 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 on all hosts... 2024-04-01T19:14:21.123 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 pull 2024-04-01T19:14:21.126 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 pull 2024-04-01T19:14:21.128 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 pull 2024-04-01T19:14:22.291 INFO:teuthology.orchestra.run.smithi062.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430... 2024-04-01T19:14:22.342 INFO:teuthology.orchestra.run.smithi188.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430... 2024-04-01T19:14:22.372 INFO:teuthology.orchestra.run.smithi022.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430... 2024-04-01T19:14:51.725 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:14:51.726 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_version": "ceph version 19.0.0-2492-ge142085d (e142085d06ebbedb32196116c9f19e2d28f93430) squid (dev)", 2024-04-01T19:14:51.726 INFO:teuthology.orchestra.run.smithi022.stdout: "image_id": "5b728cd5ea451706424aff60a1e68bd7bfe88e0a9a9944c1a21e96706a375206", 2024-04-01T19:14:51.726 INFO:teuthology.orchestra.run.smithi022.stdout: "repo_digests": [ 2024-04-01T19:14:51.726 INFO:teuthology.orchestra.run.smithi022.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:0695e7c5d663dadca19983359d9ec9c0b57bc12893996bd1fbc1456ad5ed6600" 2024-04-01T19:14:51.726 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:14:51.726 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:15:16.105 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:15:16.106 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_version": "ceph version 19.0.0-2492-ge142085d (e142085d06ebbedb32196116c9f19e2d28f93430) squid (dev)", 2024-04-01T19:15:16.106 INFO:teuthology.orchestra.run.smithi188.stdout: "image_id": "5b728cd5ea451706424aff60a1e68bd7bfe88e0a9a9944c1a21e96706a375206", 2024-04-01T19:15:16.106 INFO:teuthology.orchestra.run.smithi188.stdout: "repo_digests": [ 2024-04-01T19:15:16.106 INFO:teuthology.orchestra.run.smithi188.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:0695e7c5d663dadca19983359d9ec9c0b57bc12893996bd1fbc1456ad5ed6600" 2024-04-01T19:15:16.106 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:15:16.106 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:15:20.069 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:15:20.070 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_version": "ceph version 19.0.0-2492-ge142085d (e142085d06ebbedb32196116c9f19e2d28f93430) squid (dev)", 2024-04-01T19:15:20.070 INFO:teuthology.orchestra.run.smithi062.stdout: "image_id": "5b728cd5ea451706424aff60a1e68bd7bfe88e0a9a9944c1a21e96706a375206", 2024-04-01T19:15:20.070 INFO:teuthology.orchestra.run.smithi062.stdout: "repo_digests": [ 2024-04-01T19:15:20.070 INFO:teuthology.orchestra.run.smithi062.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:0695e7c5d663dadca19983359d9ec9c0b57bc12893996bd1fbc1456ad5ed6600" 2024-04-01T19:15:20.070 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:15:20.070 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:15:20.100 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /etc/ceph 2024-04-01T19:15:20.139 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph 2024-04-01T19:15:20.172 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /etc/ceph 2024-04-01T19:15:20.208 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 777 /etc/ceph 2024-04-01T19:15:20.241 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /etc/ceph 2024-04-01T19:15:20.270 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 777 /etc/ceph 2024-04-01T19:15:20.300 INFO:tasks.cephadm:Writing seed config... 2024-04-01T19:15:20.301 INFO:tasks.cephadm: override: [mon] auth allow insecure global id reclaim = True 2024-04-01T19:15:20.301 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-01T19:15:20.301 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-01T19:15:20.301 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-01T19:15:20.301 INFO:tasks.cephadm: override: [mon] mon min osdmap epochs = 50 2024-04-01T19:15:20.301 INFO:tasks.cephadm: override: [mon] mon osdmap full prune interval = 2 2024-04-01T19:15:20.301 INFO:tasks.cephadm: override: [mon] mon osdmap full prune min = 15 2024-04-01T19:15:20.301 INFO:tasks.cephadm: override: [mon] mon osdmap full prune txsize = 2 2024-04-01T19:15:20.302 INFO:tasks.cephadm: override: [mon] mon scrub interval = 300 2024-04-01T19:15:20.302 INFO:tasks.cephadm: override: [mon] paxos service trim min = 10 2024-04-01T19:15:20.302 INFO:tasks.cephadm: override: [client.2] debug ms = 1 2024-04-01T19:15:20.302 INFO:tasks.cephadm: override: [client.2] debug objecter = 20 2024-04-01T19:15:20.302 INFO:tasks.cephadm: override: [client.2] debug rados = 20 2024-04-01T19:15:20.302 INFO:tasks.cephadm: override: [global] mon client directed command retry = 5 2024-04-01T19:15:20.302 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2024-04-01T19:15:20.302 INFO:tasks.cephadm: override: [global] ms bind msgr2 = False 2024-04-01T19:15:20.302 INFO:tasks.cephadm: override: [global] ms inject socket failures = 5000 2024-04-01T19:15:20.302 INFO:tasks.cephadm: override: [global] ms type = async 2024-04-01T19:15:20.302 INFO:tasks.cephadm: override: [global] osd_pool_default_min_size = 2 2024-04-01T19:15:20.302 INFO:tasks.cephadm: override: [global] osd_pool_default_size = 2 2024-04-01T19:15:20.302 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-01T19:15:20.303 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-01T19:15:20.303 INFO:tasks.cephadm: override: [osd] bluestore zero block detection = True 2024-04-01T19:15:20.303 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-01T19:15:20.303 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-01T19:15:20.303 INFO:tasks.cephadm: override: [osd] osd backoff on peering = True 2024-04-01T19:15:20.303 INFO:tasks.cephadm: override: [osd] osd blocked scrub grace period = 3600 2024-04-01T19:15:20.303 INFO:tasks.cephadm: override: [osd] osd debug verify cached snaps = True 2024-04-01T19:15:20.303 INFO:tasks.cephadm: override: [osd] osd debug verify missing on start = True 2024-04-01T19:15:20.303 INFO:tasks.cephadm: override: [osd] osd heartbeat use min delay socket = True 2024-04-01T19:15:20.303 INFO:tasks.cephadm: override: [osd] osd map cache size = 1 2024-04-01T19:15:20.303 INFO:tasks.cephadm: override: [osd] osd max backfills = 6 2024-04-01T19:15:20.303 INFO:tasks.cephadm: override: [osd] osd max markdown count = 1000 2024-04-01T19:15:20.303 INFO:tasks.cephadm: override: [osd] osd mclock override recovery settings = True 2024-04-01T19:15:20.304 INFO:tasks.cephadm: override: [osd] osd mclock profile = high_recovery_ops 2024-04-01T19:15:20.304 INFO:tasks.cephadm: override: [osd] osd op queue = debug_random 2024-04-01T19:15:20.304 INFO:tasks.cephadm: override: [osd] osd op queue cut off = debug_random 2024-04-01T19:15:20.304 INFO:tasks.cephadm: override: [osd] osd scrub during recovery = False 2024-04-01T19:15:20.304 INFO:tasks.cephadm: override: [osd] osd scrub max interval = 120 2024-04-01T19:15:20.304 INFO:tasks.cephadm: override: [osd] osd scrub min interval = 60 2024-04-01T19:15:20.304 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-04-01T19:15:20.305 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-01T19:15:20.305 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-01T19:15:20.327 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 09f6b846-f05c-11ee-b647-cb9ed24678a4 mon client directed command retry = 5 mon election default strategy = 1 ms bind msgr2 = False ms inject socket failures = 5000 ms type = async osd_pool_default_min_size = 2 osd_pool_default_size = 2 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 120 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = True osd debug verify missing on start = True osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore zero block detection = True debug ms = 1 debug osd = 20 osd backoff on peering = True osd blocked scrub grace period = 3600 osd heartbeat use min delay socket = True osd map cache size = 1 osd max backfills = 6 osd max markdown count = 1000 osd mclock override recovery settings = True osd scrub during recovery = False osd scrub min interval = 60 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false auth allow insecure global id reclaim = True debug mon = 20 debug ms = 1 debug paxos = 20 mon min osdmap epochs = 50 mon osdmap full prune interval = 2 mon osdmap full prune min = 15 mon osdmap full prune txsize = 2 mon scrub interval = 300 paxos service trim min = 10 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client.2] debug ms = 1 debug objecter = 20 debug rados = 20 2024-04-01T19:15:20.327 DEBUG:teuthology.orchestra.run.smithi022:mon.a> sudo journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mon.a.service 2024-04-01T19:15:20.370 DEBUG:teuthology.orchestra.run.smithi022:mgr.y> sudo journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mgr.y.service 2024-04-01T19:15:20.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:-- Logs begin at Mon 2024-04-01 19:04:04 UTC. -- 2024-04-01T19:15:20.404 INFO:tasks.cephadm:Bootstrapping... 2024-04-01T19:15:20.404 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 -v bootstrap --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.22:6789]' --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-01T19:15:20.434 INFO:journalctl@ceph.mgr.y.smithi022.stdout:-- Logs begin at Mon 2024-04-01 19:04:04 UTC. -- 2024-04-01T19:15:20.625 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-04-01T19:15:20.625 INFO:teuthology.orchestra.run.smithi022.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430', '-v', 'bootstrap', '--fsid', '09f6b846-f05c-11ee-b647-cb9ed24678a4', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-addrv', '[v1:172.21.15.22:6789]', '--skip-admin-label'] 2024-04-01T19:15:20.625 INFO:teuthology.orchestra.run.smithi022.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-01T19:15:20.626 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying podman|docker is present... 2024-04-01T19:15:20.672 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-01T19:15:20.672 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying lvm2 is present... 2024-04-01T19:15:20.672 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying time synchronization is in place... 2024-04-01T19:15:20.679 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-01T19:15:20.679 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-01T19:15:20.685 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-01T19:15:20.685 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-04-01T19:15:20.691 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout enabled 2024-04-01T19:15:20.697 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout active 2024-04-01T19:15:20.697 INFO:teuthology.orchestra.run.smithi022.stdout:Unit chronyd.service is enabled and running 2024-04-01T19:15:20.697 INFO:teuthology.orchestra.run.smithi022.stdout:Repeating the final host check... 2024-04-01T19:15:20.738 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-01T19:15:20.738 INFO:teuthology.orchestra.run.smithi022.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-01T19:15:20.739 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl is present 2024-04-01T19:15:20.739 INFO:teuthology.orchestra.run.smithi022.stdout:lvcreate is present 2024-04-01T19:15:20.745 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-01T19:15:20.745 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-01T19:15:20.750 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-01T19:15:20.750 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-04-01T19:15:20.756 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout enabled 2024-04-01T19:15:20.762 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout active 2024-04-01T19:15:20.763 INFO:teuthology.orchestra.run.smithi022.stdout:Unit chronyd.service is enabled and running 2024-04-01T19:15:20.763 INFO:teuthology.orchestra.run.smithi022.stdout:Host looks OK 2024-04-01T19:15:20.763 INFO:teuthology.orchestra.run.smithi022.stdout:Cluster fsid: 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:15:20.763 INFO:teuthology.orchestra.run.smithi022.stdout:Acquiring lock 139836157124224 on /run/cephadm/09f6b846-f05c-11ee-b647-cb9ed24678a4.lock 2024-04-01T19:15:20.763 INFO:teuthology.orchestra.run.smithi022.stdout:Lock 139836157124224 acquired on /run/cephadm/09f6b846-f05c-11ee-b647-cb9ed24678a4.lock 2024-04-01T19:15:20.763 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying IP 172.21.15.22 port 6789 ... 2024-04-01T19:15:20.764 INFO:teuthology.orchestra.run.smithi022.stdout:Base mon IP(s) is [172.21.15.22:6789], mon addrv is [v1:172.21.15.22:6789] 2024-04-01T19:15:20.767 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.22 metric 100 2024-04-01T19:15:20.768 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.22 metric 100 2024-04-01T19:15:20.770 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-01T19:15:20.770 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-04-01T19:15:20.771 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1797sec hoplimit 64 pref medium 2024-04-01T19:15:20.773 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-01T19:15:20.774 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-01T19:15:20.774 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-01T19:15:20.774 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-04-01T19:15:20.774 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2024-04-01T19:15:20.774 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-01T19:15:20.774 INFO:teuthology.orchestra.run.smithi022.stdout:Mon IP `172.21.15.22` is in CIDR network `172.21.0.0/20` 2024-04-01T19:15:20.774 INFO:teuthology.orchestra.run.smithi022.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20'] 2024-04-01T19:15:20.775 INFO:teuthology.orchestra.run.smithi022.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-01T19:15:20.776 INFO:teuthology.orchestra.run.smithi022.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430... 2024-04-01T19:15:23.471 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stdout 5b728cd5ea451706424aff60a1e68bd7bfe88e0a9a9944c1a21e96706a375206 2024-04-01T19:15:23.472 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430... 2024-04-01T19:15:23.472 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Getting image source signatures 2024-04-01T19:15:23.472 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Copying blob sha256:1509ec6dfa8ebe667c4d5652026a8b678c1ef555a8f22f7c2f809af2e27e313d 2024-04-01T19:15:23.472 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Copying blob sha256:9516588f908cdb14b5e4062a6063db2d9291b355c3f32e2a99864608a4a7b649 2024-04-01T19:15:23.472 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Copying config sha256:5b728cd5ea451706424aff60a1e68bd7bfe88e0a9a9944c1a21e96706a375206 2024-04-01T19:15:23.472 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-01T19:15:26.578 INFO:teuthology.orchestra.run.smithi022.stdout:ceph: stdout ceph version 19.0.0-2492-ge142085d (e142085d06ebbedb32196116c9f19e2d28f93430) squid (dev) 2024-04-01T19:15:26.578 INFO:teuthology.orchestra.run.smithi022.stdout:Ceph version: ceph version 19.0.0-2492-ge142085d (e142085d06ebbedb32196116c9f19e2d28f93430) squid (dev) 2024-04-01T19:15:26.579 INFO:teuthology.orchestra.run.smithi022.stdout:Extracting ceph user uid/gid from container image... 2024-04-01T19:15:27.823 INFO:teuthology.orchestra.run.smithi022.stdout:stat: stdout 167 167 2024-04-01T19:15:27.823 INFO:teuthology.orchestra.run.smithi022.stdout:Creating initial keys... 2024-04-01T19:15:28.760 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-authtool: stdout AQDQBwtmU922DhAAZiRZNbKhzKHwsUlHtoAfYg== 2024-04-01T19:15:29.924 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-authtool: stdout AQDRBwtmH89ODRAAahBhktVi8sjb/ezIbv2KoQ== 2024-04-01T19:15:31.054 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-authtool: stdout AQDSBwtmZOGDGBAAz8HelFTW8S1w51Sii0S9Sw== 2024-04-01T19:15:31.055 INFO:teuthology.orchestra.run.smithi022.stdout:Creating initial monmap... 2024-04-01T19:15:32.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-01T19:15:32.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-04-01T19:15:32.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:15:32.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-01T19:15:32.093 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool for a [v1:172.21.15.22:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-01T19:15:32.093 INFO:teuthology.orchestra.run.smithi022.stdout:setting min_mon_release = quincy 2024-04-01T19:15:32.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: set fsid to 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:15:32.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-01T19:15:32.093 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:15:32.093 INFO:teuthology.orchestra.run.smithi022.stdout:Creating mon... 2024-04-01T19:15:33.132 INFO:teuthology.orchestra.run.smithi022.stdout:create mon.a on 2024-04-01T19:15:33.267 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-04-01T19:15:33.357 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-01T19:15:33.480 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4.target → /etc/systemd/system/ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4.target. 2024-04-01T19:15:33.481 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4.target → /etc/systemd/system/ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4.target. 2024-04-01T19:15:33.690 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mon.a 2024-04-01T19:15:33.690 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to reset failed state of unit ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mon.a.service: Unit ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mon.a.service not loaded. 2024-04-01T19:15:33.786 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4.target.wants/ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mon.a.service → /etc/systemd/system/ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@.service. 2024-04-01T19:15:34.375 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-01T19:15:34.375 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout disabled 2024-04-01T19:15:34.382 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-01T19:15:34.383 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-04-01T19:15:34.383 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld.service is not enabled 2024-04-01T19:15:34.383 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to enable service . firewalld.service is not available 2024-04-01T19:15:34.383 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mon to start... 2024-04-01T19:15:34.383 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mon... 2024-04-01T19:15:34.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:34 smithi022 bash[38914]: fa613c682c4fec68b50984f672b28854ed0b4d7d4ebb5f4d795a41916091c62d 2024-04-01T19:15:34.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:34 smithi022 systemd[1]: Started Ceph mon.a for 09f6b846-f05c-11ee-b647-cb9ed24678a4. 2024-04-01T19:15:35.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout cluster: 2024-04-01T19:15:35.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout id: 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:15:35.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-01T19:15:35.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-04-01T19:15:35.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout services: 2024-04-01T19:15:35.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.685328s) 2024-04-01T19:15:35.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-01T19:15:35.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-01T19:15:35.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-04-01T19:15:35.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout data: 2024-04-01T19:15:35.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-01T19:15:35.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-01T19:15:35.613 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-01T19:15:35.614 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout pgs: 2024-04-01T19:15:35.614 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-04-01T19:15:35.614 INFO:teuthology.orchestra.run.smithi022.stdout:mon is available 2024-04-01T19:15:35.614 INFO:teuthology.orchestra.run.smithi022.stdout:Assimilating anything we can from ceph.conf... 2024-04-01T19:15:35.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:35 smithi022 ceph-mon[38952]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-01T19:15:35.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:35 smithi022 ceph-mon[38952]: monmap epoch 1 2024-04-01T19:15:35.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:35 smithi022 ceph-mon[38952]: fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:15:35.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:35 smithi022 ceph-mon[38952]: last_changed 2024-04-01T19:15:31.526632+0000 2024-04-01T19:15:35.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:35 smithi022 ceph-mon[38952]: created 2024-04-01T19:15:31.526632+0000 2024-04-01T19:15:35.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:35 smithi022 ceph-mon[38952]: min_mon_release 19 (squid) 2024-04-01T19:15:35.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:35 smithi022 ceph-mon[38952]: election_strategy: 1 2024-04-01T19:15:35.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:35 smithi022 ceph-mon[38952]: 0: v1:172.21.15.22:6789/0 mon.a 2024-04-01T19:15:35.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:35 smithi022 ceph-mon[38952]: fsmap 2024-04-01T19:15:35.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:35 smithi022 ceph-mon[38952]: osdmap e1: 0 total, 0 up, 0 in 2024-04-01T19:15:35.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:35 smithi022 ceph-mon[38952]: mgrmap e1: no daemons active 2024-04-01T19:15:35.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:35 smithi022 ceph-mon[38952]: from='client.? v1:172.21.15.22:0/3744858651' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-01T19:15:36.531 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:36 smithi022 ceph-mon[38952]: from='client.? v1:172.21.15.22:0/2816811173' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-01T19:15:36.531 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:36 smithi022 ceph-mon[38952]: from='client.? v1:172.21.15.22:0/2816811173' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-01T19:15:36.742 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-04-01T19:15:36.744 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [global] 2024-04-01T19:15:36.744 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout fsid = 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:15:36.744 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_host = [v1:172.21.15.22:6789] 2024-04-01T19:15:36.744 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-01T19:15:36.744 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-01T19:15:36.744 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-01T19:15:36.744 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-01T19:15:36.744 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-04-01T19:15:36.744 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-01T19:15:36.744 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-01T19:15:36.744 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-04-01T19:15:36.745 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [osd] 2024-04-01T19:15:36.745 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-01T19:15:36.745 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-01T19:15:36.745 INFO:teuthology.orchestra.run.smithi022.stdout:Generating new minimal ceph.conf... 2024-04-01T19:15:37.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:37 smithi022 ceph-mon[38952]: from='client.? v1:172.21.15.22:0/2508610714' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:15:37.932 INFO:teuthology.orchestra.run.smithi022.stdout:Restarting the monitor... 2024-04-01T19:15:38.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:37 smithi022 systemd[1]: Stopping Ceph mon.a for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T19:15:38.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:38 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[38929]: 2024-04-01T19:15:38.161+0000 7f163a61f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T19:15:38.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:38 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[38929]: 2024-04-01T19:15:38.161+0000 7f163a61f700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-01T19:15:39.067 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:38 smithi022 bash[39276]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a 2024-04-01T19:15:39.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 systemd[1]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mon.a.service: Succeeded. 2024-04-01T19:15:39.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 systemd[1]: Stopped Ceph mon.a for 09f6b846-f05c-11ee-b647-cb9ed24678a4. 2024-04-01T19:15:39.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 systemd[1]: Starting Ceph mon.a for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T19:15:39.623 INFO:teuthology.orchestra.run.smithi022.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-01T19:15:39.848 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: set uid:gid to 167:167 (ceph:ceph) 2024-04-01T19:15:39.848 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: ceph version 19.0.0-2492-ge142085d (e142085d06ebbedb32196116c9f19e2d28f93430) squid (dev), process ceph-mon, pid 7 2024-04-01T19:15:39.848 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: pidfile_write: ignore empty --pid-file 2024-04-01T19:15:39.848 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: load: jerasure load: lrc 2024-04-01T19:15:39.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: RocksDB version: 7.9.2 2024-04-01T19:15:39.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Git sha 0 2024-04-01T19:15:39.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Compile date 2024-03-25 23:49:44 2024-04-01T19:15:39.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: DB SUMMARY 2024-04-01T19:15:39.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: DB Session ID: 1W9C709ENR1A2BWURE9J 2024-04-01T19:15:39.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: CURRENT file: CURRENT 2024-04-01T19:15:39.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: IDENTITY file: IDENTITY 2024-04-01T19:15:39.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-04-01T19:15:39.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-04-01T19:15:39.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 98842 ; 2024-04-01T19:15:39.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.error_if_exists: 0 2024-04-01T19:15:39.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.create_if_missing: 0 2024-04-01T19:15:39.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.paranoid_checks: 1 2024-04-01T19:15:39.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-01T19:15:39.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-01T19:15:39.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-01T19:15:39.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.env: 0x561948411c60 2024-04-01T19:15:39.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.fs: PosixFileSystem 2024-04-01T19:15:39.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.info_log: 0x5619497f1ca0 2024-04-01T19:15:39.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_file_opening_threads: 16 2024-04-01T19:15:39.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.statistics: (nil) 2024-04-01T19:15:39.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.use_fsync: 0 2024-04-01T19:15:39.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_log_file_size: 0 2024-04-01T19:15:39.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-01T19:15:39.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-01T19:15:39.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.keep_log_file_num: 1000 2024-04-01T19:15:39.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.recycle_log_file_num: 0 2024-04-01T19:15:39.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.allow_fallocate: 1 2024-04-01T19:15:39.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.allow_mmap_reads: 0 2024-04-01T19:15:39.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.allow_mmap_writes: 0 2024-04-01T19:15:39.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.use_direct_reads: 0 2024-04-01T19:15:39.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-01T19:15:39.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.create_missing_column_families: 0 2024-04-01T19:15:39.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.db_log_dir: 2024-04-01T19:15:39.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.wal_dir: 2024-04-01T19:15:39.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-01T19:15:39.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-01T19:15:39.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-01T19:15:39.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-01T19:15:39.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-01T19:15:39.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-01T19:15:39.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.advise_random_on_open: 1 2024-04-01T19:15:39.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.db_write_buffer_size: 0 2024-04-01T19:15:39.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.write_buffer_manager: 0x5619497c61e0 2024-04-01T19:15:39.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-01T19:15:39.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-01T19:15:39.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-01T19:15:39.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.rate_limiter: (nil) 2024-04-01T19:15:39.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-01T19:15:39.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.wal_recovery_mode: 2 2024-04-01T19:15:39.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.enable_thread_tracking: 0 2024-04-01T19:15:39.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.enable_pipelined_write: 0 2024-04-01T19:15:39.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.unordered_write: 0 2024-04-01T19:15:39.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-01T19:15:39.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-01T19:15:39.854 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-01T19:15:39.854 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-01T19:15:39.854 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.row_cache: None 2024-04-01T19:15:39.854 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.wal_filter: None 2024-04-01T19:15:39.854 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-01T19:15:39.854 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.allow_ingest_behind: 0 2024-04-01T19:15:39.854 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.two_write_queues: 0 2024-04-01T19:15:39.854 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.manual_wal_flush: 0 2024-04-01T19:15:39.854 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.wal_compression: 0 2024-04-01T19:15:39.854 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.atomic_flush: 0 2024-04-01T19:15:39.854 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-01T19:15:39.854 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-01T19:15:39.854 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-01T19:15:39.854 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.log_readahead_size: 0 2024-04-01T19:15:39.855 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-01T19:15:39.855 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.best_efforts_recovery: 0 2024-04-01T19:15:39.855 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-01T19:15:39.855 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-01T19:15:39.855 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.allow_data_in_errors: 0 2024-04-01T19:15:39.855 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.db_host_id: __hostname__ 2024-04-01T19:15:39.855 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-01T19:15:39.855 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_background_jobs: 2 2024-04-01T19:15:39.855 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_background_compactions: -1 2024-04-01T19:15:39.855 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_subcompactions: 1 2024-04-01T19:15:39.855 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-01T19:15:39.855 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-01T19:15:39.855 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-01T19:15:39.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_total_wal_size: 0 2024-04-01T19:15:39.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-01T19:15:39.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-01T19:15:39.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-01T19:15:39.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-01T19:15:39.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_open_files: -1 2024-04-01T19:15:39.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.bytes_per_sync: 0 2024-04-01T19:15:39.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-01T19:15:39.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-01T19:15:39.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.compaction_readahead_size: 0 2024-04-01T19:15:39.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_background_flushes: -1 2024-04-01T19:15:39.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Compression algorithms supported: 2024-04-01T19:15:39.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-01T19:15:39.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: kZSTD supported: 0 2024-04-01T19:15:39.857 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: kXpressCompression supported: 0 2024-04-01T19:15:39.857 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: kLZ4HCCompression supported: 1 2024-04-01T19:15:39.857 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: kZlibCompression supported: 1 2024-04-01T19:15:39.857 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: kSnappyCompression supported: 1 2024-04-01T19:15:39.857 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: kLZ4Compression supported: 1 2024-04-01T19:15:39.857 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: kBZip2Compression supported: 0 2024-04-01T19:15:39.857 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-01T19:15:39.857 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-01T19:15:39.857 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-01T19:15:39.857 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-01T19:15:39.857 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-01T19:15:39.857 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.merge_operator: 2024-04-01T19:15:39.857 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.compaction_filter: None 2024-04-01T19:15:39.857 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.compaction_filter_factory: None 2024-04-01T19:15:39.858 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.sst_partitioner_factory: None 2024-04-01T19:15:39.858 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-01T19:15:39.858 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-01T19:15:39.858 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5619497f1e60) 2024-04-01T19:15:39.858 INFO:journalctl@ceph.mon.a.smithi022.stdout: cache_index_and_filter_blocks: 1 2024-04-01T19:15:39.858 INFO:journalctl@ceph.mon.a.smithi022.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-01T19:15:39.858 INFO:journalctl@ceph.mon.a.smithi022.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-01T19:15:39.858 INFO:journalctl@ceph.mon.a.smithi022.stdout: pin_top_level_index_and_filter: 1 2024-04-01T19:15:39.858 INFO:journalctl@ceph.mon.a.smithi022.stdout: index_type: 0 2024-04-01T19:15:39.858 INFO:journalctl@ceph.mon.a.smithi022.stdout: data_block_index_type: 0 2024-04-01T19:15:39.858 INFO:journalctl@ceph.mon.a.smithi022.stdout: index_shortening: 1 2024-04-01T19:15:39.858 INFO:journalctl@ceph.mon.a.smithi022.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-01T19:15:39.859 INFO:journalctl@ceph.mon.a.smithi022.stdout: checksum: 4 2024-04-01T19:15:39.859 INFO:journalctl@ceph.mon.a.smithi022.stdout: no_block_cache: 0 2024-04-01T19:15:39.859 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_cache: 0x5619497f91f0 2024-04-01T19:15:39.859 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_cache_name: BinnedLRUCache 2024-04-01T19:15:39.859 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_cache_options: 2024-04-01T19:15:39.859 INFO:journalctl@ceph.mon.a.smithi022.stdout: capacity : 536870912 2024-04-01T19:15:39.859 INFO:journalctl@ceph.mon.a.smithi022.stdout: num_shard_bits : 4 2024-04-01T19:15:39.859 INFO:journalctl@ceph.mon.a.smithi022.stdout: strict_capacity_limit : 0 2024-04-01T19:15:39.859 INFO:journalctl@ceph.mon.a.smithi022.stdout: high_pri_pool_ratio: 0.000 2024-04-01T19:15:39.859 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_cache_compressed: (nil) 2024-04-01T19:15:39.859 INFO:journalctl@ceph.mon.a.smithi022.stdout: persistent_cache: (nil) 2024-04-01T19:15:39.859 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_size: 4096 2024-04-01T19:15:39.859 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_size_deviation: 10 2024-04-01T19:15:39.859 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_restart_interval: 16 2024-04-01T19:15:39.860 INFO:journalctl@ceph.mon.a.smithi022.stdout: index_block_restart_interval: 1 2024-04-01T19:15:39.860 INFO:journalctl@ceph.mon.a.smithi022.stdout: metadata_block_size: 4096 2024-04-01T19:15:39.860 INFO:journalctl@ceph.mon.a.smithi022.stdout: partition_filters: 0 2024-04-01T19:15:39.860 INFO:journalctl@ceph.mon.a.smithi022.stdout: use_delta_encoding: 1 2024-04-01T19:15:39.860 INFO:journalctl@ceph.mon.a.smithi022.stdout: filter_policy: bloomfilter 2024-04-01T19:15:39.860 INFO:journalctl@ceph.mon.a.smithi022.stdout: whole_key_filtering: 1 2024-04-01T19:15:39.860 INFO:journalctl@ceph.mon.a.smithi022.stdout: verify_compression: 0 2024-04-01T19:15:39.860 INFO:journalctl@ceph.mon.a.smithi022.stdout: read_amp_bytes_per_bit: 0 2024-04-01T19:15:39.860 INFO:journalctl@ceph.mon.a.smithi022.stdout: format_version: 5 2024-04-01T19:15:39.860 INFO:journalctl@ceph.mon.a.smithi022.stdout: enable_index_compression: 1 2024-04-01T19:15:39.860 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_align: 0 2024-04-01T19:15:39.860 INFO:journalctl@ceph.mon.a.smithi022.stdout: max_auto_readahead_size: 262144 2024-04-01T19:15:39.860 INFO:journalctl@ceph.mon.a.smithi022.stdout: prepopulate_block_cache: 0 2024-04-01T19:15:39.860 INFO:journalctl@ceph.mon.a.smithi022.stdout: initial_auto_readahead_size: 8192 2024-04-01T19:15:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout: num_file_reads_for_auto_readahead: 2 2024-04-01T19:15:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.write_buffer_size: 33554432 2024-04-01T19:15:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_write_buffer_number: 2 2024-04-01T19:15:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.compression: NoCompression 2024-04-01T19:15:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.bottommost_compression: Disabled 2024-04-01T19:15:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.prefix_extractor: nullptr 2024-04-01T19:15:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-01T19:15:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.num_levels: 7 2024-04-01T19:15:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-01T19:15:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-01T19:15:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-01T19:15:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-01T19:15:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-01T19:15:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-01T19:15:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-01T19:15:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-01T19:15:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-01T19:15:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-01T19:15:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-01T19:15:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-01T19:15:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-01T19:15:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.compression_opts.level: 32767 2024-04-01T19:15:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.compression_opts.strategy: 0 2024-04-01T19:15:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-01T19:15:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-01T19:15:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-01T19:15:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-01T19:15:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.compression_opts.enabled: false 2024-04-01T19:15:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-01T19:15:39.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-01T19:15:39.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-01T19:15:39.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-01T19:15:39.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.target_file_size_base: 67108864 2024-04-01T19:15:39.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-01T19:15:39.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-01T19:15:39.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-01T19:15:39.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-01T19:15:39.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-01T19:15:39.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-01T19:15:39.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-01T19:15:39.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-01T19:15:39.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-01T19:15:39.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-01T19:15:39.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-01T19:15:39.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-01T19:15:39.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-01T19:15:39.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-01T19:15:39.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.arena_block_size: 1048576 2024-04-01T19:15:39.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-01T19:15:39.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-01T19:15:39.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.disable_auto_compactions: 0 2024-04-01T19:15:39.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-01T19:15:39.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-01T19:15:39.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-01T19:15:39.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-01T19:15:39.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-01T19:15:39.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-01T19:15:39.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-01T19:15:39.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-01T19:15:39.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-01T19:15:39.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-01T19:15:39.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-01T19:15:39.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.inplace_update_support: 0 2024-04-01T19:15:39.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-01T19:15:39.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-01T19:15:39.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-01T19:15:39.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-01T19:15:39.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.bloom_locality: 0 2024-04-01T19:15:39.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.max_successive_merges: 0 2024-04-01T19:15:39.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-01T19:15:39.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.paranoid_file_checks: 0 2024-04-01T19:15:39.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.force_consistency_checks: 1 2024-04-01T19:15:39.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.report_bg_io_stats: 0 2024-04-01T19:15:39.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.ttl: 2592000 2024-04-01T19:15:39.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-01T19:15:39.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-01T19:15:39.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-01T19:15:39.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.enable_blob_files: false 2024-04-01T19:15:39.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.min_blob_size: 0 2024-04-01T19:15:39.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.blob_file_size: 268435456 2024-04-01T19:15:39.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-01T19:15:39.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-01T19:15:39.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-01T19:15:39.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-01T19:15:39.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-01T19:15:39.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.blob_file_starting_level: 0 2024-04-01T19:15:39.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-01T19:15:39.867 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-04-01T19:15:39.867 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-04-01T19:15:39.867 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e5cb6d74-d6bb-41e8-a751-958c4ee59993 2024-04-01T19:15:39.867 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711998939576066, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-04-01T19:15:39.867 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-04-01T19:15:39.867 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711998939577579, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94125, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 308, "table_properties": {"data_size": 92128, "index_size": 253, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13358, "raw_average_key_size": 50, "raw_value_size": 84905, "raw_average_value_size": 317, "num_data_blocks": 11, "num_entries": 267, "num_filter_entries": 267, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711998939, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e5cb6d74-d6bb-41e8-a751-958c4ee59993", "db_session_id": "1W9C709ENR1A2BWURE9J", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-04-01T19:15:39.867 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711998939577690, "job": 1, "event": "recovery_finished"} 2024-04-01T19:15:39.867 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-04-01T19:15:39.867 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-01T19:15:39.867 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5619498ee000 2024-04-01T19:15:39.867 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: DB pointer 0x5619498d8000 2024-04-01T19:15:39.867 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-01T19:15:39.867 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-01T19:15:39.867 INFO:journalctl@ceph.mon.a.smithi022.stdout: ** DB Stats ** 2024-04-01T19:15:39.868 INFO:journalctl@ceph.mon.a.smithi022.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-01T19:15:39.868 INFO:journalctl@ceph.mon.a.smithi022.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-01T19:15:39.868 INFO:journalctl@ceph.mon.a.smithi022.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-01T19:15:39.868 INFO:journalctl@ceph.mon.a.smithi022.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-01T19:15:39.868 INFO:journalctl@ceph.mon.a.smithi022.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-01T19:15:39.868 INFO:journalctl@ceph.mon.a.smithi022.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-01T19:15:39.868 INFO:journalctl@ceph.mon.a.smithi022.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-01T19:15:39.868 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-04-01T19:15:39.868 INFO:journalctl@ceph.mon.a.smithi022.stdout: ** Compaction Stats [default] ** 2024-04-01T19:15:39.868 INFO:journalctl@ceph.mon.a.smithi022.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-01T19:15:39.868 INFO:journalctl@ceph.mon.a.smithi022.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-01T19:15:39.869 INFO:journalctl@ceph.mon.a.smithi022.stdout: L0 2/0 93.75 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 104.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-01T19:15:39.869 INFO:journalctl@ceph.mon.a.smithi022.stdout: Sum 2/0 93.75 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 104.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-01T19:15:39.869 INFO:journalctl@ceph.mon.a.smithi022.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 104.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-01T19:15:39.869 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-04-01T19:15:39.869 INFO:journalctl@ceph.mon.a.smithi022.stdout: ** Compaction Stats [default] ** 2024-04-01T19:15:39.869 INFO:journalctl@ceph.mon.a.smithi022.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-01T19:15:39.869 INFO:journalctl@ceph.mon.a.smithi022.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-01T19:15:39.869 INFO:journalctl@ceph.mon.a.smithi022.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 104.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-01T19:15:39.869 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-04-01T19:15:39.869 INFO:journalctl@ceph.mon.a.smithi022.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-01T19:15:39.869 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-04-01T19:15:39.869 INFO:journalctl@ceph.mon.a.smithi022.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-01T19:15:39.869 INFO:journalctl@ceph.mon.a.smithi022.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-01T19:15:39.869 INFO:journalctl@ceph.mon.a.smithi022.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-01T19:15:39.869 INFO:journalctl@ceph.mon.a.smithi022.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-01T19:15:39.870 INFO:journalctl@ceph.mon.a.smithi022.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-01T19:15:39.870 INFO:journalctl@ceph.mon.a.smithi022.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-01T19:15:39.870 INFO:journalctl@ceph.mon.a.smithi022.stdout: Cumulative compaction: 0.00 GB write, 20.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-01T19:15:39.870 INFO:journalctl@ceph.mon.a.smithi022.stdout: Interval compaction: 0.00 GB write, 20.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-01T19:15:39.870 INFO:journalctl@ceph.mon.a.smithi022.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-01T19:15:39.870 INFO:journalctl@ceph.mon.a.smithi022.stdout: Block cache BinnedLRUCache@0x5619497f91f0#7 capacity: 512.00 MB usage: 1.33 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-04-01T19:15:39.870 INFO:journalctl@ceph.mon.a.smithi022.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2024-04-01T19:15:39.870 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-04-01T19:15:39.870 INFO:journalctl@ceph.mon.a.smithi022.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-01T19:15:39.870 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: starting mon.a rank 0 at public addrs v1:172.21.15.22:6789/0 at bind addrs v1:172.21.15.22:6789/0 mon_data /var/lib/ceph/mon/ceph-a fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:15:39.870 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: mon.a@-1(???) e1 preinit fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:15:39.870 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: mon.a@-1(???).mds e1 new map 2024-04-01T19:15:39.870 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: mon.a@-1(???).mds e1 print_map 2024-04-01T19:15:39.870 INFO:journalctl@ceph.mon.a.smithi022.stdout: e1 2024-04-01T19:15:39.870 INFO:journalctl@ceph.mon.a.smithi022.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-01T19:15:39.871 INFO:journalctl@ceph.mon.a.smithi022.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-01T19:15:39.871 INFO:journalctl@ceph.mon.a.smithi022.stdout: legacy client fscid: -1 2024-04-01T19:15:39.871 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-04-01T19:15:39.871 INFO:journalctl@ceph.mon.a.smithi022.stdout: No filesystems configured 2024-04-01T19:15:39.871 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-01T19:15:39.871 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-01T19:15:39.871 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-01T19:15:39.871 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-01T19:15:39.871 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-01T19:15:39.871 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 bash[39401]: 1aec193e64303a3c3cbede936c968bc8369bda0c96e8b7b40d92dadae72b7100 2024-04-01T19:15:39.871 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 systemd[1]: Started Ceph mon.a for 09f6b846-f05c-11ee-b647-cb9ed24678a4. 2024-04-01T19:15:39.871 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-01T19:15:39.871 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: monmap epoch 1 2024-04-01T19:15:39.871 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:15:39.871 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: last_changed 2024-04-01T19:15:31.526632+0000 2024-04-01T19:15:39.871 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: created 2024-04-01T19:15:31.526632+0000 2024-04-01T19:15:39.872 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: min_mon_release 19 (squid) 2024-04-01T19:15:39.872 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: election_strategy: 1 2024-04-01T19:15:39.872 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: 0: v1:172.21.15.22:6789/0 mon.a 2024-04-01T19:15:39.872 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: fsmap 2024-04-01T19:15:39.872 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: osdmap e1: 0 total, 0 up, 0 in 2024-04-01T19:15:39.872 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:39 smithi022 ceph-mon[39439]: mgrmap e1: no daemons active 2024-04-01T19:15:40.844 INFO:teuthology.orchestra.run.smithi022.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-01T19:15:40.866 INFO:teuthology.orchestra.run.smithi022.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-01T19:15:40.866 INFO:teuthology.orchestra.run.smithi022.stdout:Creating mgr... 2024-04-01T19:15:40.866 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying port 0.0.0.0:9283 ... 2024-04-01T19:15:40.867 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying port 0.0.0.0:8765 ... 2024-04-01T19:15:41.077 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mgr.y 2024-04-01T19:15:41.077 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to reset failed state of unit ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mgr.y.service: Unit ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mgr.y.service not loaded. 2024-04-01T19:15:41.171 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4.target.wants/ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mgr.y.service → /etc/systemd/system/ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@.service. 2024-04-01T19:15:41.575 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:41 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3436376797' entity='client.admin' 2024-04-01T19:15:41.575 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:41 smithi022 systemd[1]: Starting Ceph mgr.y for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T19:15:41.820 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-01T19:15:41.820 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout disabled 2024-04-01T19:15:41.829 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-01T19:15:41.829 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-04-01T19:15:41.830 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld.service is not enabled 2024-04-01T19:15:41.830 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to enable service . firewalld.service is not available 2024-04-01T19:15:41.839 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-01T19:15:41.839 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout disabled 2024-04-01T19:15:41.848 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-01T19:15:41.848 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-04-01T19:15:41.848 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld.service is not enabled 2024-04-01T19:15:41.848 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-04-01T19:15:41.848 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr to start... 2024-04-01T19:15:41.848 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr... 2024-04-01T19:15:42.064 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:41 smithi022 bash[39672]: 86372323e23dadac6241968cfacfd030fe174afcbae519052c02f32df69cd11c 2024-04-01T19:15:42.065 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:41 smithi022 systemd[1]: Started Ceph mgr.y for 09f6b846-f05c-11ee-b647-cb9ed24678a4. 2024-04-01T19:15:42.065 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:41 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:41.903+0000 7f0932b88200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-01T19:15:42.362 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:42 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:42.090+0000 7f0932b88200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-01T19:15:42.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:42 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4056503551' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-01T19:15:42.753 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:42 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:42.441+0000 7f0932b88200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-01T19:15:43.025 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-04-01T19:15:43.025 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-04-01T19:15:43.025 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsid": "09f6b846-f05c-11ee-b647-cb9ed24678a4", 2024-04-01T19:15:43.025 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "health": { 2024-04-01T19:15:43.025 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-01T19:15:43.025 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-01T19:15:43.025 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-01T19:15:43.025 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-04-01T19:15:43.026 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-01T19:15:43.026 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-01T19:15:43.026 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 0 2024-04-01T19:15:43.026 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-04-01T19:15:43.026 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-01T19:15:43.026 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "a" 2024-04-01T19:15:43.026 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-04-01T19:15:43.026 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-04-01T19:15:43.026 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-01T19:15:43.026 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T19:15:43.027 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-01T19:15:43.027 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-01T19:15:43.027 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-04-01T19:15:43.027 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-01T19:15:43.027 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T19:15:43.027 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-01T19:15:43.027 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-01T19:15:43.027 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-01T19:15:43.027 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-01T19:15:43.027 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-01T19:15:43.027 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-01T19:15:43.030 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-04-01T19:15:43.030 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-01T19:15:43.030 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-01T19:15:43.030 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-01T19:15:43.030 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-01T19:15:43.030 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-01T19:15:43.031 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-01T19:15:43.031 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-01T19:15:43.031 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-01T19:15:43.031 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-01T19:15:43.031 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-04-01T19:15:43.031 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-01T19:15:43.031 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T19:15:43.031 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-01T19:15:43.031 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-01T19:15:43.031 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-04-01T19:15:43.031 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-01T19:15:43.031 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-01T19:15:43.031 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-01T19:15:43.031 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-01T19:15:43.031 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-01T19:15:43.032 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-01T19:15:43.032 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "restful" 2024-04-01T19:15:43.032 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-04-01T19:15:43.032 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-01T19:15:43.032 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-04-01T19:15:43.032 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-01T19:15:43.032 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T19:15:43.032 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modified": "2024-04-01T19:15:34.344731+0000", 2024-04-01T19:15:43.032 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-01T19:15:43.032 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:42 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:42.980+0000 7f0932b88200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-01T19:15:43.033 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-04-01T19:15:43.033 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-01T19:15:43.033 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-04-01T19:15:43.033 INFO:teuthology.orchestra.run.smithi022.stdout:mgr not available, waiting (1/15)... 2024-04-01T19:15:43.362 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:43 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:43.241+0000 7f0932b88200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-01T19:15:44.112 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:43 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:43.694+0000 7f0932b88200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-01T19:15:44.862 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:44 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:44.445+0000 7f0932b88200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-01T19:15:44.862 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:44 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:44.534+0000 7f0932b88200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-01T19:15:45.592 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:45 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:45.168+0000 7f0932b88200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-01T19:15:45.592 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:45 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:45.256+0000 7f0932b88200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-01T19:15:45.592 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:45 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:45.353+0000 7f0932b88200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-01T19:15:45.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:45 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2765583172' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-01T19:15:45.862 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:45 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:45.593+0000 7f0932b88200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-01T19:15:45.862 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:45 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:45.691+0000 7f0932b88200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-01T19:15:45.863 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:45 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:45.792+0000 7f0932b88200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-01T19:15:46.330 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:46 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:46.036+0000 7f0932b88200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-01T19:15:46.330 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:46 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:46.137+0000 7f0932b88200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-01T19:15:46.356 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-04-01T19:15:46.356 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-04-01T19:15:46.356 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsid": "09f6b846-f05c-11ee-b647-cb9ed24678a4", 2024-04-01T19:15:46.356 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "health": { 2024-04-01T19:15:46.356 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-01T19:15:46.356 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-01T19:15:46.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-01T19:15:46.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-04-01T19:15:46.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-01T19:15:46.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-01T19:15:46.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 0 2024-04-01T19:15:46.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-04-01T19:15:46.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-01T19:15:46.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "a" 2024-04-01T19:15:46.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-04-01T19:15:46.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-04-01T19:15:46.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-01T19:15:46.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T19:15:46.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-01T19:15:46.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-01T19:15:46.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-04-01T19:15:46.358 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-01T19:15:46.358 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T19:15:46.358 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-01T19:15:46.358 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-01T19:15:46.358 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-01T19:15:46.358 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-01T19:15:46.358 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-01T19:15:46.358 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-01T19:15:46.361 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-04-01T19:15:46.361 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-01T19:15:46.362 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-01T19:15:46.362 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-01T19:15:46.362 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-01T19:15:46.362 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-01T19:15:46.362 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-01T19:15:46.362 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-01T19:15:46.362 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-01T19:15:46.362 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-01T19:15:46.362 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-04-01T19:15:46.362 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-01T19:15:46.362 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T19:15:46.362 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-01T19:15:46.362 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-01T19:15:46.362 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-04-01T19:15:46.363 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-01T19:15:46.363 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-01T19:15:46.363 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-01T19:15:46.363 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-01T19:15:46.363 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-01T19:15:46.363 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-01T19:15:46.363 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "restful" 2024-04-01T19:15:46.363 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-04-01T19:15:46.363 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-01T19:15:46.363 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-04-01T19:15:46.363 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-01T19:15:46.363 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T19:15:46.363 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modified": "2024-04-01T19:15:34.344731+0000", 2024-04-01T19:15:46.363 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-01T19:15:46.364 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-04-01T19:15:46.364 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-01T19:15:46.364 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-04-01T19:15:46.364 INFO:teuthology.orchestra.run.smithi022.stdout:mgr not available, waiting (2/15)... 2024-04-01T19:15:46.593 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:46 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:46.331+0000 7f0932b88200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-01T19:15:46.862 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:46 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:46.594+0000 7f0932b88200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-01T19:15:47.612 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:47 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:47.207+0000 7f0932b88200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-01T19:15:47.612 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:47 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:47.426+0000 7f0932b88200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-01T19:15:48.112 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:47 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:47.628+0000 7f0932b88200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-01T19:15:48.580 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:48 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:48.318+0000 7f0932b88200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-01T19:15:48.580 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:48 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:48.532+0000 7f0932b88200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-01T19:15:48.859 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:48 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:48.739+0000 7f0932b88200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-01T19:15:49.112 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:48 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:48.860+0000 7f0932b88200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-01T19:15:49.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:48 smithi022 ceph-mon[39439]: Activating manager daemon y 2024-04-01T19:15:49.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:48 smithi022 ceph-mon[39439]: mgrmap e2: y(active, starting, since 0.00320722s) 2024-04-01T19:15:49.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:48 smithi022 ceph-mon[39439]: from='mgr.14100 v1:172.21.15.22:0/3255577288' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-01T19:15:49.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:48 smithi022 ceph-mon[39439]: from='mgr.14100 v1:172.21.15.22:0/3255577288' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-01T19:15:49.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:48 smithi022 ceph-mon[39439]: from='mgr.14100 v1:172.21.15.22:0/3255577288' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-01T19:15:49.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:48 smithi022 ceph-mon[39439]: from='mgr.14100 v1:172.21.15.22:0/3255577288' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-01T19:15:49.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:48 smithi022 ceph-mon[39439]: from='mgr.14100 v1:172.21.15.22:0/3255577288' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-01T19:15:49.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:48 smithi022 ceph-mon[39439]: from='mgr.14100 v1:172.21.15.22:0/3255577288' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-01T19:15:49.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:48 smithi022 ceph-mon[39439]: from='mgr.14100 v1:172.21.15.22:0/3255577288' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:15:49.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:48 smithi022 ceph-mon[39439]: from='mgr.14100 v1:172.21.15.22:0/3255577288' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-01T19:15:49.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:48 smithi022 ceph-mon[39439]: Manager daemon y is now available 2024-04-01T19:15:49.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:48 smithi022 ceph-mon[39439]: from='mgr.14100 v1:172.21.15.22:0/3255577288' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-04-01T19:15:49.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:48 smithi022 ceph-mon[39439]: from='mgr.14100 v1:172.21.15.22:0/3255577288' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-04-01T19:15:49.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:48 smithi022 ceph-mon[39439]: from='mgr.14100 v1:172.21.15.22:0/3255577288' entity='mgr.y' 2024-04-01T19:15:49.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:48 smithi022 ceph-mon[39439]: from='mgr.14100 v1:172.21.15.22:0/3255577288' entity='mgr.y' 2024-04-01T19:15:49.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:48 smithi022 ceph-mon[39439]: from='mgr.14100 v1:172.21.15.22:0/3255577288' entity='mgr.y' 2024-04-01T19:15:51.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:50 smithi022 ceph-mon[39439]: mgrmap e3: y(active, since 1.0074s) 2024-04-01T19:15:52.753 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-04-01T19:15:52.753 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-04-01T19:15:52.753 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsid": "09f6b846-f05c-11ee-b647-cb9ed24678a4", 2024-04-01T19:15:52.753 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "health": { 2024-04-01T19:15:52.753 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-01T19:15:52.753 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-01T19:15:52.753 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-01T19:15:52.753 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-04-01T19:15:52.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-01T19:15:52.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-01T19:15:52.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 0 2024-04-01T19:15:52.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-04-01T19:15:52.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-01T19:15:52.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "a" 2024-04-01T19:15:52.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-04-01T19:15:52.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-04-01T19:15:52.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-01T19:15:52.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T19:15:52.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-01T19:15:52.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-01T19:15:52.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-04-01T19:15:52.755 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-01T19:15:52.755 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T19:15:52.755 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-01T19:15:52.755 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-01T19:15:52.755 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-01T19:15:52.755 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-01T19:15:52.759 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-01T19:15:52.760 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-01T19:15:52.760 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-04-01T19:15:52.760 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-01T19:15:52.760 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-01T19:15:52.760 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-01T19:15:52.760 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-01T19:15:52.760 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-01T19:15:52.760 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-01T19:15:52.760 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-01T19:15:52.760 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-01T19:15:52.761 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-01T19:15:52.761 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-04-01T19:15:52.761 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-01T19:15:52.761 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T19:15:52.761 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-01T19:15:52.761 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-01T19:15:52.761 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-04-01T19:15:52.761 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-01T19:15:52.761 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-01T19:15:52.761 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-01T19:15:52.761 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-01T19:15:52.761 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-01T19:15:52.761 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-01T19:15:52.762 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "restful" 2024-04-01T19:15:52.762 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-04-01T19:15:52.762 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-01T19:15:52.762 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-04-01T19:15:52.762 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-01T19:15:52.762 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T19:15:52.762 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modified": "2024-04-01T19:15:34.344731+0000", 2024-04-01T19:15:52.762 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-01T19:15:52.762 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-04-01T19:15:52.762 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-01T19:15:52.762 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-04-01T19:15:52.762 INFO:teuthology.orchestra.run.smithi022.stdout:mgr is available 2024-04-01T19:15:53.023 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:52 smithi022 ceph-mon[39439]: mgrmap e4: y(active, since 3s) 2024-04-01T19:15:53.023 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:52 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/711162867' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-01T19:15:54.020 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:53 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/715140197' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-01T19:15:54.241 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-04-01T19:15:54.241 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [global] 2024-04-01T19:15:54.241 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout fsid = 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:15:54.241 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-01T19:15:54.242 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-01T19:15:54.242 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-01T19:15:54.242 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-01T19:15:54.242 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-04-01T19:15:54.242 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-01T19:15:54.242 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-01T19:15:54.242 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-04-01T19:15:54.242 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [osd] 2024-04-01T19:15:54.242 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-01T19:15:54.242 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-01T19:15:54.242 INFO:teuthology.orchestra.run.smithi022.stdout:Enabling cephadm module... 2024-04-01T19:15:55.477 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:55 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2655131507' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-01T19:15:55.478 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:55 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: ignoring --setuser ceph since I am not root 2024-04-01T19:15:55.478 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:55 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: ignoring --setgroup ceph since I am not root 2024-04-01T19:15:55.478 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:55 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:55.294+0000 7f8a9f2c2200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-01T19:15:55.757 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:55 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:55.477+0000 7f8a9f2c2200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-01T19:15:56.112 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:55 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:55.819+0000 7f8a9f2c2200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-01T19:15:56.563 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:56 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:56.344+0000 7f8a9f2c2200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-01T19:15:56.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:56 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2655131507' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-01T19:15:56.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:56 smithi022 ceph-mon[39439]: mgrmap e5: y(active, since 6s) 2024-04-01T19:15:56.862 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:56 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:56.601+0000 7f8a9f2c2200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-01T19:15:57.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:15:57 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2099425162' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-01T19:15:57.362 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:57 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:57.063+0000 7f8a9f2c2200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-01T19:15:57.470 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-04-01T19:15:57.470 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-01T19:15:57.470 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-01T19:15:57.470 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-04-01T19:15:57.470 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-01T19:15:57.470 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-04-01T19:15:57.470 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for the mgr to restart... 2024-04-01T19:15:57.470 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr epoch 5... 2024-04-01T19:15:58.113 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:57 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:57.832+0000 7f8a9f2c2200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-01T19:15:58.114 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:57 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:57.924+0000 7f8a9f2c2200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-01T19:15:58.862 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:58 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:58.554+0000 7f8a9f2c2200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-01T19:15:58.862 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:58 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:58.642+0000 7f8a9f2c2200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-01T19:15:58.862 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:58 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:58.736+0000 7f8a9f2c2200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-01T19:15:59.362 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:58 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:58.984+0000 7f8a9f2c2200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-01T19:15:59.362 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:59 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:59.080+0000 7f8a9f2c2200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-01T19:15:59.362 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:59 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:59.179+0000 7f8a9f2c2200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-01T19:15:59.720 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:59 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:59.425+0000 7f8a9f2c2200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-01T19:15:59.721 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:59 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:59.526+0000 7f8a9f2c2200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-01T19:16:00.004 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:15:59 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:15:59.720+0000 7f8a9f2c2200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-01T19:16:00.362 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:00 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:00.004+0000 7f8a9f2c2200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-01T19:16:01.046 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:00 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:00.617+0000 7f8a9f2c2200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-01T19:16:01.046 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:00 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:00.839+0000 7f8a9f2c2200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-01T19:16:01.362 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:01 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:01.046+0000 7f8a9f2c2200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-01T19:16:02.112 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:01 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:01.766+0000 7f8a9f2c2200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-01T19:16:02.112 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:01 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:01.976+0000 7f8a9f2c2200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-01T19:16:02.612 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:02 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:02.167+0000 7f8a9f2c2200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-01T19:16:02.612 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:02 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:02.288+0000 7f8a9f2c2200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-01T19:16:02.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:02 smithi022 ceph-mon[39439]: Active manager daemon y restarted 2024-04-01T19:16:02.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:02 smithi022 ceph-mon[39439]: Activating manager daemon y 2024-04-01T19:16:02.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:02 smithi022 ceph-mon[39439]: osdmap e2: 0 total, 0 up, 0 in 2024-04-01T19:16:02.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:02 smithi022 ceph-mon[39439]: mgrmap e6: y(active, starting, since 0.00335152s) 2024-04-01T19:16:02.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:02 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:16:02.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:02 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-01T19:16:02.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:02 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-01T19:16:02.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:02 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-01T19:16:02.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:02 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-01T19:16:02.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:02 smithi022 ceph-mon[39439]: Manager daemon y is now available 2024-04-01T19:16:02.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:02 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' 2024-04-01T19:16:02.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:02 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' 2024-04-01T19:16:02.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:02 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:16:03.597 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:03 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:16:03.597 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:03 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:16:03.597 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:03 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:16:03.597 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:03 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-04-01T19:16:03.598 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:03 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-04-01T19:16:03.598 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:03 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' 2024-04-01T19:16:03.598 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:03 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' 2024-04-01T19:16:03.598 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:03 smithi022 ceph-mon[39439]: [01/Apr/2024:19:16:02] ENGINE Bus STARTING 2024-04-01T19:16:03.598 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:03 smithi022 ceph-mon[39439]: [01/Apr/2024:19:16:03] ENGINE Serving on http://172.21.15.22:8765 2024-04-01T19:16:03.598 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:03 smithi022 ceph-mon[39439]: [01/Apr/2024:19:16:03] ENGINE Serving on https://172.21.15.22:7150 2024-04-01T19:16:03.598 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:03 smithi022 ceph-mon[39439]: [01/Apr/2024:19:16:03] ENGINE Bus STARTED 2024-04-01T19:16:03.598 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:03 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:16:03.598 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:03 smithi022 ceph-mon[39439]: mgrmap e7: y(active, since 1.00598s) 2024-04-01T19:16:03.910 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-04-01T19:16:03.910 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-01T19:16:03.910 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-01T19:16:03.910 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-04-01T19:16:03.910 INFO:teuthology.orchestra.run.smithi022.stdout:mgr epoch 5 is available 2024-04-01T19:16:03.910 INFO:teuthology.orchestra.run.smithi022.stdout:Setting orchestrator backend to cephadm... 2024-04-01T19:16:04.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:04 smithi022 ceph-mon[39439]: from='client.14123 v1:172.21.15.22:0/100807447' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-01T19:16:04.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:04 smithi022 ceph-mon[39439]: from='client.14123 v1:172.21.15.22:0/100807447' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-01T19:16:05.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:05 smithi022 ceph-mon[39439]: mgrmap e8: y(active, since 2s) 2024-04-01T19:16:05.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:05 smithi022 ceph-mon[39439]: from='client.14131 v1:172.21.15.22:0/1050322376' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:16:05.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:05 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' 2024-04-01T19:16:05.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:05 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:16:06.529 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-01T19:16:06.529 INFO:teuthology.orchestra.run.smithi022.stdout:Generating ssh key... 2024-04-01T19:16:06.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:06 smithi022 ceph-mon[39439]: from='client.14133 v1:172.21.15.22:0/3796900711' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:16:07.862 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:07 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: Generating public/private rsa key pair. 2024-04-01T19:16:07.862 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:07 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: Your identification has been saved in /tmp/tmps7bswig2/key. 2024-04-01T19:16:07.862 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:07 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: Your public key has been saved in /tmp/tmps7bswig2/key.pub. 2024-04-01T19:16:07.863 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:07 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: The key fingerprint is: 2024-04-01T19:16:07.863 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:07 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: SHA256:dkffMGplGXK0ZVMlLff7HR9TWu2Szge3mg2Cui5v3ZQ ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:16:07.863 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:07 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: The key's randomart image is: 2024-04-01T19:16:07.863 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:07 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: +---[RSA 3072]----+ 2024-04-01T19:16:07.863 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:07 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: | ..=oB| 2024-04-01T19:16:07.863 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:07 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: | o.B+| 2024-04-01T19:16:07.863 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:07 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: | . Boo| 2024-04-01T19:16:07.863 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:07 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: | . = +=| 2024-04-01T19:16:07.863 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:07 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: | S . = .=+| 2024-04-01T19:16:07.863 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:07 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: | . ..E ==o| 2024-04-01T19:16:07.863 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:07 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: | ..o. + +O| 2024-04-01T19:16:07.863 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:07 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: | . ... .. *.=| 2024-04-01T19:16:07.863 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:07 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: | ==. o.o | 2024-04-01T19:16:07.863 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:07 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: +----[SHA256]-----+ 2024-04-01T19:16:08.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:08 smithi022 ceph-mon[39439]: from='client.14135 v1:172.21.15.22:0/2182776379' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:16:08.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:08 smithi022 ceph-mon[39439]: Generating ssh key... 2024-04-01T19:16:08.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:08 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' 2024-04-01T19:16:08.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:08 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' 2024-04-01T19:16:09.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDd0FtvqGK24r/gWT4g2KI0+euKa6Wf2nB7raWj9P5a2rfZHAy4+hQX/UuYVj2e8UW8MqZjvgnTigX7AbLlxFZZHfBTwa4YPR9a1SmujZ+9mHD/CmerSwKolG7FYz7VshfrCAUkDOYampUS2bqcreafMYg1MkHi8aE9zHCMixsL8dmrFbcdcwQBB4b9Tyw7cIDRrwbV9okuyK5LGWc8+03Evuda9/QAaCDqvDbBMnjT10FlNyZHvz1KDZ19uywehezoDQexasEjx07T2a9fw1fSI3AOBAEoek52on8xbU13gqJCVaJPuX8mGPivEZAE+w9oKrsU+7mLarrnuekjQb4zsV6AlTdOQ3yDwAJDfG3NhEv4NPq3QJb8Iek3muQDeWKVLB6vctHaC1dWyej6lYSNAPF3zuLtJ2XkxQ7EiexU830xtUnRLpEqU7K9e+ivBQkbIcsLbNefX4Zk7PhgTDZONpSceFE0y8VS5nS28R0jgKQpIbWY0Pg5ZuT6p5WNYsc= ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:16:09.466 INFO:teuthology.orchestra.run.smithi022.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-01T19:16:09.466 INFO:teuthology.orchestra.run.smithi022.stdout:Adding key to root@localhost authorized_keys... 2024-04-01T19:16:09.467 INFO:teuthology.orchestra.run.smithi022.stdout:Adding host smithi022... 2024-04-01T19:16:09.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:09 smithi022 ceph-mon[39439]: from='client.14137 v1:172.21.15.22:0/2204595358' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:16:11.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:11 smithi022 ceph-mon[39439]: from='client.14139 v1:172.21.15.22:0/3858960621' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi022", "addr": "172.21.15.22", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:16:11.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:11 smithi022 ceph-mon[39439]: Deploying cephadm binary to smithi022 2024-04-01T19:16:14.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Added host 'smithi022' with addr '172.21.15.22' 2024-04-01T19:16:14.715 INFO:teuthology.orchestra.run.smithi022.stdout:Deploying unmanaged mon service... 2024-04-01T19:16:15.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:15 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' 2024-04-01T19:16:15.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:15 smithi022 ceph-mon[39439]: Added host smithi022 2024-04-01T19:16:15.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:15 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:16:16.385 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-01T19:16:16.385 INFO:teuthology.orchestra.run.smithi022.stdout:Deploying unmanaged mgr service... 2024-04-01T19:16:16.644 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:16 smithi022 ceph-mon[39439]: from='client.14141 v1:172.21.15.22:0/260490410' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:16:16.644 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:16 smithi022 ceph-mon[39439]: Saving service mon spec with placement count:5 2024-04-01T19:16:16.644 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:16 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' 2024-04-01T19:16:18.055 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:17 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' 2024-04-01T19:16:18.055 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:17 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' 2024-04-01T19:16:18.055 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:17 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' 2024-04-01T19:16:18.981 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-01T19:16:18.985 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:18 smithi022 ceph-mon[39439]: from='client.14143 v1:172.21.15.22:0/2602000112' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:16:18.985 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:18 smithi022 ceph-mon[39439]: Saving service mgr spec with placement count:2 2024-04-01T19:16:18.985 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:18 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' 2024-04-01T19:16:21.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:20 smithi022 ceph-mon[39439]: from='mgr.14119 v1:172.21.15.22:0/2368523403' entity='mgr.y' 2024-04-01T19:16:21.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:20 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/579110443' entity='client.admin' 2024-04-01T19:16:21.796 INFO:teuthology.orchestra.run.smithi022.stdout:Enabling the dashboard module... 2024-04-01T19:16:22.482 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:22 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/849759028' entity='client.admin' 2024-04-01T19:16:23.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:23 smithi022 ceph-mon[39439]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:16:23.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:23 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1731778570' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-01T19:16:23.614 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:23 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: ignoring --setuser ceph since I am not root 2024-04-01T19:16:23.614 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:23 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: ignoring --setgroup ceph since I am not root 2024-04-01T19:16:23.614 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:23 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:23.497+0000 7f98de1da200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-01T19:16:23.935 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:23 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:23.686+0000 7f98de1da200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-01T19:16:24.314 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:24 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:24.028+0000 7f98de1da200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-01T19:16:24.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:24 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1731778570' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-01T19:16:24.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:24 smithi022 ceph-mon[39439]: mgrmap e9: y(active, since 21s) 2024-04-01T19:16:24.612 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:24 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:24.563+0000 7f98de1da200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-01T19:16:25.077 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:24 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:24.828+0000 7f98de1da200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-01T19:16:25.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:25 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1811248269' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-01T19:16:25.362 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:25 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:25.287+0000 7f98de1da200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-01T19:16:25.391 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-04-01T19:16:25.392 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-01T19:16:25.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-01T19:16:25.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-04-01T19:16:25.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-01T19:16:25.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-04-01T19:16:25.393 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for the mgr to restart... 2024-04-01T19:16:25.393 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr epoch 9... 2024-04-01T19:16:26.362 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:26 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:26.058+0000 7f98de1da200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-01T19:16:26.362 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:26 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:26.149+0000 7f98de1da200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-01T19:16:27.112 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:26 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:26.781+0000 7f98de1da200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-01T19:16:27.112 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:26 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:26.870+0000 7f98de1da200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-01T19:16:27.112 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:26 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:26.962+0000 7f98de1da200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-01T19:16:27.612 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:27 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:27.198+0000 7f98de1da200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-01T19:16:27.612 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:27 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:27.295+0000 7f98de1da200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-01T19:16:27.612 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:27 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:27.393+0000 7f98de1da200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-01T19:16:27.932 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:27 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:27.637+0000 7f98de1da200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-01T19:16:27.932 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:27 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:27.737+0000 7f98de1da200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-01T19:16:28.612 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:27 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:27.932+0000 7f98de1da200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-01T19:16:28.612 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:28 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:28.194+0000 7f98de1da200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-01T19:16:29.112 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:28 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:28.810+0000 7f98de1da200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-01T19:16:29.112 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:29 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:29.036+0000 7f98de1da200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-01T19:16:29.612 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:29 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:29.245+0000 7f98de1da200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-01T19:16:30.362 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:29 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:29.971+0000 7f98de1da200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-01T19:16:30.362 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:30 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:30.183+0000 7f98de1da200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-01T19:16:30.629 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:30 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:30.378+0000 7f98de1da200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-01T19:16:30.629 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:16:30 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:16:30.499+0000 7f98de1da200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-01T19:16:30.629 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:30 smithi022 ceph-mon[39439]: Active manager daemon y restarted 2024-04-01T19:16:30.629 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:30 smithi022 ceph-mon[39439]: Activating manager daemon y 2024-04-01T19:16:30.629 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:30 smithi022 ceph-mon[39439]: osdmap e3: 0 total, 0 up, 0 in 2024-04-01T19:16:30.629 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:30 smithi022 ceph-mon[39439]: mgrmap e10: y(active, starting, since 0.0034134s) 2024-04-01T19:16:30.630 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:30 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:16:30.630 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:30 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-01T19:16:30.630 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:30 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-01T19:16:30.630 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:30 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-01T19:16:30.630 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:30 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-01T19:16:30.630 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:30 smithi022 ceph-mon[39439]: Manager daemon y is now available 2024-04-01T19:16:30.630 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:30 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:16:31.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:31 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-04-01T19:16:31.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:31 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-04-01T19:16:31.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:31 smithi022 ceph-mon[39439]: [01/Apr/2024:19:16:30] ENGINE Bus STARTING 2024-04-01T19:16:31.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:31 smithi022 ceph-mon[39439]: [01/Apr/2024:19:16:30] ENGINE Serving on http://172.21.15.22:8765 2024-04-01T19:16:31.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:31 smithi022 ceph-mon[39439]: [01/Apr/2024:19:16:30] ENGINE Serving on https://172.21.15.22:7150 2024-04-01T19:16:31.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:31 smithi022 ceph-mon[39439]: [01/Apr/2024:19:16:30] ENGINE Bus STARTED 2024-04-01T19:16:31.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:31 smithi022 ceph-mon[39439]: mgrmap e11: y(active, since 1.00586s) 2024-04-01T19:16:32.347 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-04-01T19:16:32.347 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-01T19:16:32.347 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-01T19:16:32.347 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-04-01T19:16:32.347 INFO:teuthology.orchestra.run.smithi022.stdout:mgr epoch 9 is available 2024-04-01T19:16:32.348 INFO:teuthology.orchestra.run.smithi022.stdout:Generating a dashboard self-signed certificate... 2024-04-01T19:16:33.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:32 smithi022 ceph-mon[39439]: from='client.14155 v1:172.21.15.22:0/2698954262' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-01T19:16:33.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:32 smithi022 ceph-mon[39439]: from='client.14155 v1:172.21.15.22:0/2698954262' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-01T19:16:33.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:16:33.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:16:33.761 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-01T19:16:33.762 INFO:teuthology.orchestra.run.smithi022.stdout:Creating initial admin user... 2024-04-01T19:16:34.050 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:33 smithi022 ceph-mon[39439]: mgrmap e12: y(active, since 2s) 2024-04-01T19:16:34.050 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:33 smithi022 ceph-mon[39439]: from='client.14163 v1:172.21.15.22:0/4064702080' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:16:34.050 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:16:34.050 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:16:35.554 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$4egRtch3Yysc2pbM3PKKeOUs8bZYVA1oxdEwYcX.Nq27LUmmoEoeu", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1711998994, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-01T19:16:35.555 INFO:teuthology.orchestra.run.smithi022.stdout:Fetching dashboard port number... 2024-04-01T19:16:36.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:35 smithi022 ceph-mon[39439]: from='client.14165 v1:172.21.15.22:0/699904673' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:16:36.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:16:37.069 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:36 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2859103245' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-01T19:16:37.313 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 8443 2024-04-01T19:16:37.323 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-01T19:16:37.323 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout disabled 2024-04-01T19:16:37.331 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-01T19:16:37.332 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-04-01T19:16:37.332 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld.service is not enabled 2024-04-01T19:16:37.332 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-01T19:16:37.334 INFO:teuthology.orchestra.run.smithi022.stdout:Ceph Dashboard is now available at: 2024-04-01T19:16:37.334 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:16:37.334 INFO:teuthology.orchestra.run.smithi022.stdout: URL: https://smithi022.front.sepia.ceph.com:8443/ 2024-04-01T19:16:37.334 INFO:teuthology.orchestra.run.smithi022.stdout: User: admin 2024-04-01T19:16:37.334 INFO:teuthology.orchestra.run.smithi022.stdout: Password: wsjqyz6w7f 2024-04-01T19:16:37.334 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:16:37.335 INFO:teuthology.orchestra.run.smithi022.stdout:Saving cluster configuration to /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/config directory 2024-04-01T19:16:37.335 INFO:teuthology.orchestra.run.smithi022.stdout:Enabling autotune for osd_memory_target 2024-04-01T19:16:38.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:37 smithi022 ceph-mon[39439]: mgrmap e13: y(active, since 6s) 2024-04-01T19:16:40.134 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-01T19:16:40.134 INFO:teuthology.orchestra.run.smithi022.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-01T19:16:40.135 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:16:40.135 INFO:teuthology.orchestra.run.smithi022.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-01T19:16:40.135 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:16:40.135 INFO:teuthology.orchestra.run.smithi022.stdout:Or, if you are only running a single cluster on this host: 2024-04-01T19:16:40.135 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:16:40.135 INFO:teuthology.orchestra.run.smithi022.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-01T19:16:40.135 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:16:40.135 INFO:teuthology.orchestra.run.smithi022.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-01T19:16:40.135 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:16:40.135 INFO:teuthology.orchestra.run.smithi022.stdout: ceph telemetry on 2024-04-01T19:16:40.135 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:16:40.135 INFO:teuthology.orchestra.run.smithi022.stdout:For more information see: 2024-04-01T19:16:40.135 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:16:40.135 INFO:teuthology.orchestra.run.smithi022.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-04-01T19:16:40.136 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:16:40.136 INFO:teuthology.orchestra.run.smithi022.stdout:Bootstrap complete. 2024-04-01T19:16:40.185 INFO:tasks.cephadm:Fetching config... 2024-04-01T19:16:40.185 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-01T19:16:40.185 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-01T19:16:40.205 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-01T19:16:40.205 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-01T19:16:40.205 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-01T19:16:40.265 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-01T19:16:40.265 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-01T19:16:40.265 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/keyring of=/dev/stdout 2024-04-01T19:16:40.333 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-01T19:16:40.333 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-01T19:16:40.333 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-01T19:16:40.391 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-01T19:16:40.391 DEBUG:teuthology.orchestra.run.smithi022:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDd0FtvqGK24r/gWT4g2KI0+euKa6Wf2nB7raWj9P5a2rfZHAy4+hQX/UuYVj2e8UW8MqZjvgnTigX7AbLlxFZZHfBTwa4YPR9a1SmujZ+9mHD/CmerSwKolG7FYz7VshfrCAUkDOYampUS2bqcreafMYg1MkHi8aE9zHCMixsL8dmrFbcdcwQBB4b9Tyw7cIDRrwbV9okuyK5LGWc8+03Evuda9/QAaCDqvDbBMnjT10FlNyZHvz1KDZ19uywehezoDQexasEjx07T2a9fw1fSI3AOBAEoek52on8xbU13gqJCVaJPuX8mGPivEZAE+w9oKrsU+7mLarrnuekjQb4zsV6AlTdOQ3yDwAJDfG3NhEv4NPq3QJb8Iek3muQDeWKVLB6vctHaC1dWyej6lYSNAPF3zuLtJ2XkxQ7EiexU830xtUnRLpEqU7K9e+ivBQkbIcsLbNefX4Zk7PhgTDZONpSceFE0y8VS5nS28R0jgKQpIbWY0Pg5ZuT6p5WNYsc= ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-01T19:16:40.473 INFO:teuthology.orchestra.run.smithi022.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDd0FtvqGK24r/gWT4g2KI0+euKa6Wf2nB7raWj9P5a2rfZHAy4+hQX/UuYVj2e8UW8MqZjvgnTigX7AbLlxFZZHfBTwa4YPR9a1SmujZ+9mHD/CmerSwKolG7FYz7VshfrCAUkDOYampUS2bqcreafMYg1MkHi8aE9zHCMixsL8dmrFbcdcwQBB4b9Tyw7cIDRrwbV9okuyK5LGWc8+03Evuda9/QAaCDqvDbBMnjT10FlNyZHvz1KDZ19uywehezoDQexasEjx07T2a9fw1fSI3AOBAEoek52on8xbU13gqJCVaJPuX8mGPivEZAE+w9oKrsU+7mLarrnuekjQb4zsV6AlTdOQ3yDwAJDfG3NhEv4NPq3QJb8Iek3muQDeWKVLB6vctHaC1dWyej6lYSNAPF3zuLtJ2XkxQ7EiexU830xtUnRLpEqU7K9e+ivBQkbIcsLbNefX4Zk7PhgTDZONpSceFE0y8VS5nS28R0jgKQpIbWY0Pg5ZuT6p5WNYsc= ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:16:40.485 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDd0FtvqGK24r/gWT4g2KI0+euKa6Wf2nB7raWj9P5a2rfZHAy4+hQX/UuYVj2e8UW8MqZjvgnTigX7AbLlxFZZHfBTwa4YPR9a1SmujZ+9mHD/CmerSwKolG7FYz7VshfrCAUkDOYampUS2bqcreafMYg1MkHi8aE9zHCMixsL8dmrFbcdcwQBB4b9Tyw7cIDRrwbV9okuyK5LGWc8+03Evuda9/QAaCDqvDbBMnjT10FlNyZHvz1KDZ19uywehezoDQexasEjx07T2a9fw1fSI3AOBAEoek52on8xbU13gqJCVaJPuX8mGPivEZAE+w9oKrsU+7mLarrnuekjQb4zsV6AlTdOQ3yDwAJDfG3NhEv4NPq3QJb8Iek3muQDeWKVLB6vctHaC1dWyej6lYSNAPF3zuLtJ2XkxQ7EiexU830xtUnRLpEqU7K9e+ivBQkbIcsLbNefX4Zk7PhgTDZONpSceFE0y8VS5nS28R0jgKQpIbWY0Pg5ZuT6p5WNYsc= ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-01T19:16:40.533 INFO:teuthology.orchestra.run.smithi062.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDd0FtvqGK24r/gWT4g2KI0+euKa6Wf2nB7raWj9P5a2rfZHAy4+hQX/UuYVj2e8UW8MqZjvgnTigX7AbLlxFZZHfBTwa4YPR9a1SmujZ+9mHD/CmerSwKolG7FYz7VshfrCAUkDOYampUS2bqcreafMYg1MkHi8aE9zHCMixsL8dmrFbcdcwQBB4b9Tyw7cIDRrwbV9okuyK5LGWc8+03Evuda9/QAaCDqvDbBMnjT10FlNyZHvz1KDZ19uywehezoDQexasEjx07T2a9fw1fSI3AOBAEoek52on8xbU13gqJCVaJPuX8mGPivEZAE+w9oKrsU+7mLarrnuekjQb4zsV6AlTdOQ3yDwAJDfG3NhEv4NPq3QJb8Iek3muQDeWKVLB6vctHaC1dWyej6lYSNAPF3zuLtJ2XkxQ7EiexU830xtUnRLpEqU7K9e+ivBQkbIcsLbNefX4Zk7PhgTDZONpSceFE0y8VS5nS28R0jgKQpIbWY0Pg5ZuT6p5WNYsc= ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:16:40.545 DEBUG:teuthology.orchestra.run.smithi188:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDd0FtvqGK24r/gWT4g2KI0+euKa6Wf2nB7raWj9P5a2rfZHAy4+hQX/UuYVj2e8UW8MqZjvgnTigX7AbLlxFZZHfBTwa4YPR9a1SmujZ+9mHD/CmerSwKolG7FYz7VshfrCAUkDOYampUS2bqcreafMYg1MkHi8aE9zHCMixsL8dmrFbcdcwQBB4b9Tyw7cIDRrwbV9okuyK5LGWc8+03Evuda9/QAaCDqvDbBMnjT10FlNyZHvz1KDZ19uywehezoDQexasEjx07T2a9fw1fSI3AOBAEoek52on8xbU13gqJCVaJPuX8mGPivEZAE+w9oKrsU+7mLarrnuekjQb4zsV6AlTdOQ3yDwAJDfG3NhEv4NPq3QJb8Iek3muQDeWKVLB6vctHaC1dWyej6lYSNAPF3zuLtJ2XkxQ7EiexU830xtUnRLpEqU7K9e+ivBQkbIcsLbNefX4Zk7PhgTDZONpSceFE0y8VS5nS28R0jgKQpIbWY0Pg5ZuT6p5WNYsc= ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-01T19:16:40.590 INFO:teuthology.orchestra.run.smithi188.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDd0FtvqGK24r/gWT4g2KI0+euKa6Wf2nB7raWj9P5a2rfZHAy4+hQX/UuYVj2e8UW8MqZjvgnTigX7AbLlxFZZHfBTwa4YPR9a1SmujZ+9mHD/CmerSwKolG7FYz7VshfrCAUkDOYampUS2bqcreafMYg1MkHi8aE9zHCMixsL8dmrFbcdcwQBB4b9Tyw7cIDRrwbV9okuyK5LGWc8+03Evuda9/QAaCDqvDbBMnjT10FlNyZHvz1KDZ19uywehezoDQexasEjx07T2a9fw1fSI3AOBAEoek52on8xbU13gqJCVaJPuX8mGPivEZAE+w9oKrsU+7mLarrnuekjQb4zsV6AlTdOQ3yDwAJDfG3NhEv4NPq3QJb8Iek3muQDeWKVLB6vctHaC1dWyej6lYSNAPF3zuLtJ2XkxQ7EiexU830xtUnRLpEqU7K9e+ivBQkbIcsLbNefX4Zk7PhgTDZONpSceFE0y8VS5nS28R0jgKQpIbWY0Pg5ZuT6p5WNYsc= ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:16:40.601 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-01T19:16:40.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:40 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/255545177' entity='client.admin' 2024-04-01T19:16:40.877 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:16:44.369 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-01T19:16:44.370 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-01T19:16:44.981 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:44 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1108231237' entity='client.admin' 2024-04-01T19:16:45.086 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:16:46.293 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:16:46.293 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:16:46.294 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi022", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:16:46.294 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:16:46.294 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:16:46.294 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:16:47.475 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi062 2024-04-01T19:16:47.475 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-01T19:16:47.475 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/etc/ceph/ceph.conf 2024-04-01T19:16:47.497 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-01T19:16:47.497 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-01T19:16:47.558 INFO:tasks.cephadm:Adding host smithi062 to orchestrator... 2024-04-01T19:16:47.558 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph orch host add smithi062 2024-04-01T19:16:47.849 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:16:48.059 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:47 smithi022 ceph-mon[39439]: from='client.14175 v1:172.21.15.22:0/1201325299' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:16:48.059 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:16:48.059 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:16:48.060 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:16:48.060 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:16:48.060 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:47 smithi022 ceph-mon[39439]: Updating smithi022:/etc/ceph/ceph.conf 2024-04-01T19:16:48.060 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:47 smithi022 ceph-mon[39439]: Updating smithi022:/var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T19:16:48.060 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:47 smithi022 ceph-mon[39439]: Updating smithi022:/etc/ceph/ceph.client.admin.keyring 2024-04-01T19:16:49.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:48 smithi022 ceph-mon[39439]: Updating smithi022:/var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-01T19:16:49.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:48 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:16:49.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:48 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:16:49.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:48 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:16:50.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:50 smithi022 ceph-mon[39439]: from='client.14177 v1:172.21.15.22:0/3363139787' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi062", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:16:50.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:50 smithi022 ceph-mon[39439]: Deploying cephadm binary to smithi062 2024-04-01T19:16:51.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:51 smithi022 ceph-mon[39439]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:16:53.664 INFO:teuthology.orchestra.run.smithi022.stdout:Added host 'smithi062' with addr '172.21.15.62' 2024-04-01T19:16:53.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:53 smithi022 ceph-mon[39439]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:16:54.345 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph orch host ls --format=json 2024-04-01T19:16:54.624 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:16:54.917 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:54 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:16:54.917 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:54 smithi022 ceph-mon[39439]: Added host smithi062 2024-04-01T19:16:54.917 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:54 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:16:54.917 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:54 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:16:54.917 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:54 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:16:56.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:56 smithi022 ceph-mon[39439]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:16:56.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:56 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:16:56.515 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:16:56.515 INFO:teuthology.orchestra.run.smithi022.stdout:[{"addr": "172.21.15.22", "hostname": "smithi022", "labels": [], "status": ""}, {"addr": "172.21.15.62", "hostname": "smithi062", "labels": [], "status": ""}] 2024-04-01T19:16:57.135 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi188 2024-04-01T19:16:57.135 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-01T19:16:57.135 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/etc/ceph/ceph.conf 2024-04-01T19:16:57.157 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-01T19:16:57.157 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-01T19:16:57.218 INFO:tasks.cephadm:Adding host smithi188 to orchestrator... 2024-04-01T19:16:57.218 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph orch host add smithi188 2024-04-01T19:16:57.495 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:16:58.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:58 smithi022 ceph-mon[39439]: from='client.14179 v1:172.21.15.22:0/3023202628' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:16:58.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:58 smithi022 ceph-mon[39439]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:16:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:59 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:16:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:59 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:16:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:59 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:16:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:59 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:16:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:59 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi062", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:16:59.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:59 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:16:59.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:59 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:16:59.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:59 smithi022 ceph-mon[39439]: Updating smithi062:/etc/ceph/ceph.conf 2024-04-01T19:16:59.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:59 smithi022 ceph-mon[39439]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:16:59.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:59 smithi022 ceph-mon[39439]: Updating smithi062:/var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T19:16:59.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:59 smithi022 ceph-mon[39439]: Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-04-01T19:16:59.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:16:59 smithi022 ceph-mon[39439]: Updating smithi062:/var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-01T19:17:00.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:00 smithi022 ceph-mon[39439]: from='client.14181 v1:172.21.15.22:0/1383109015' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi188", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:17:00.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:00 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:00.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:00 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:00.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:00 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:00.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:00 smithi022 ceph-mon[39439]: Deploying cephadm binary to smithi188 2024-04-01T19:17:01.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:01 smithi022 ceph-mon[39439]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:03.261 INFO:teuthology.orchestra.run.smithi022.stdout:Added host 'smithi188' with addr '172.21.15.188' 2024-04-01T19:17:04.149 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph orch host ls --format=json 2024-04-01T19:17:04.432 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:17:04.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:04 smithi022 ceph-mon[39439]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:04.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:04 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:04.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:04 smithi022 ceph-mon[39439]: Added host smithi188 2024-04-01T19:17:04.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:04 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:17:04.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:04 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:04.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:04 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:05.791 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:05 smithi022 ceph-mon[39439]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:05.791 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:05 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:06.269 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:17:06.694 INFO:teuthology.orchestra.run.smithi022.stdout:[{"addr": "172.21.15.22", "hostname": "smithi022", "labels": [], "status": ""}, {"addr": "172.21.15.62", "hostname": "smithi062", "labels": [], "status": ""}, {"addr": "172.21.15.188", "hostname": "smithi188", "labels": [], "status": ""}] 2024-04-01T19:17:06.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:06 smithi022 ceph-mon[39439]: from='client.14183 v1:172.21.15.22:0/2381193746' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:17:06.913 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-01T19:17:06.913 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd crush tunables default 2024-04-01T19:17:07.187 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:17:08.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:07 smithi022 ceph-mon[39439]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:09.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:09 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:09.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:09 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:09.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:09 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:09.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:09 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:09.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:09 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi188", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:17:09.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:09 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:09.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:09 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:17:09.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:09 smithi022 ceph-mon[39439]: Updating smithi188:/etc/ceph/ceph.conf 2024-04-01T19:17:09.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:09 smithi022 ceph-mon[39439]: Updating smithi188:/var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T19:17:09.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:09 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:09.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:09 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:09.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:09 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:10.049 INFO:teuthology.orchestra.run.smithi022.stderr:adjusted tunables profile to default 2024-04-01T19:17:10.341 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:10 smithi022 ceph-mon[39439]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:10.341 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:10 smithi022 ceph-mon[39439]: Updating smithi188:/etc/ceph/ceph.client.admin.keyring 2024-04-01T19:17:10.341 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:10 smithi022 ceph-mon[39439]: Updating smithi188:/var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-01T19:17:10.342 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:10 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1770386734' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-01T19:17:10.631 INFO:tasks.cephadm:Adding mon.a on smithi022 2024-04-01T19:17:10.632 INFO:tasks.cephadm:Adding mon.b on smithi062 2024-04-01T19:17:10.632 INFO:tasks.cephadm:Adding mon.c on smithi188 2024-04-01T19:17:10.632 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph orch apply mon '3;smithi022:[v1:172.21.15.22:6789]=a;smithi062:[v1:172.21.15.62:6789]=b;smithi188:[v1:172.21.15.188:6789]=c' 2024-04-01T19:17:10.931 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T19:17:11.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:11 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1770386734' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-01T19:17:11.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:11 smithi022 ceph-mon[39439]: osdmap e4: 0 total, 0 up, 0 in 2024-04-01T19:17:12.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:12 smithi022 ceph-mon[39439]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:12.861 INFO:teuthology.orchestra.run.smithi188.stdout:Scheduled mon update... 2024-04-01T19:17:13.517 DEBUG:teuthology.orchestra.run.smithi062:mon.b> sudo journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mon.b.service 2024-04-01T19:17:13.523 DEBUG:teuthology.orchestra.run.smithi188:mon.c> sudo journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mon.c.service 2024-04-01T19:17:13.525 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-01T19:17:13.525 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph mon dump -f json 2024-04-01T19:17:13.557 INFO:journalctl@ceph.mon.c.smithi188.stdout:-- Logs begin at Mon 2024-04-01 19:04:09 UTC. -- 2024-04-01T19:17:13.560 INFO:journalctl@ceph.mon.b.smithi062.stdout:-- Logs begin at Mon 2024-04-01 19:04:11 UTC. -- 2024-04-01T19:17:14.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:13 smithi022 ceph-mon[39439]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:14.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:13 smithi022 ceph-mon[39439]: from='client.14187 v1:172.21.15.188:0/2133467586' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi022:[v1:172.21.15.22:6789]=a;smithi062:[v1:172.21.15.62:6789]=b;smithi188:[v1:172.21.15.188:6789]=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:17:14.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:13 smithi022 ceph-mon[39439]: Saving service mon spec with placement smithi022:[v1:172.21.15.22:6789]=a;smithi062:[v1:172.21.15.62:6789]=b;smithi188:[v1:172.21.15.188:6789]=c;count:3 2024-04-01T19:17:14.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:13 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:14.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:13 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:17:14.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:13 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:14.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:13 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:17:14.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:13 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:14.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:13 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-01T19:17:14.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:13 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:14.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:13 smithi022 ceph-mon[39439]: Deploying daemon mon.c on smithi188 2024-04-01T19:17:14.689 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T19:17:16.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:15 smithi022 ceph-mon[39439]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:17.540 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:17 smithi188 systemd[1]: Starting Ceph mon.c for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T19:17:17.733 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:17:17.734 INFO:teuthology.orchestra.run.smithi188.stdout:{"epoch":1,"fsid":"09f6b846-f05c-11ee-b647-cb9ed24678a4","modified":"2024-04-01T19:15:31.526632Z","created":"2024-04-01T19:15:31.526632Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-01T19:17:17.735 INFO:teuthology.orchestra.run.smithi188.stderr:dumped monmap epoch 1 2024-04-01T19:17:18.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:17 smithi022 ceph-mon[39439]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:18.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:17 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.188:0/2324246519' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-01T19:17:18.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: set uid:gid to 167:167 (ceph:ceph) 2024-04-01T19:17:18.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: ceph version 19.0.0-2492-ge142085d (e142085d06ebbedb32196116c9f19e2d28f93430) squid (dev), process ceph-mon, pid 7 2024-04-01T19:17:18.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: pidfile_write: ignore empty --pid-file 2024-04-01T19:17:18.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: load: jerasure load: lrc 2024-04-01T19:17:18.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: RocksDB version: 7.9.2 2024-04-01T19:17:18.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Git sha 0 2024-04-01T19:17:18.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Compile date 2024-03-25 23:49:44 2024-04-01T19:17:18.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: DB SUMMARY 2024-04-01T19:17:18.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: DB Session ID: XGCOT3R0TP03G208A71E 2024-04-01T19:17:18.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: CURRENT file: CURRENT 2024-04-01T19:17:18.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: IDENTITY file: IDENTITY 2024-04-01T19:17:18.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-04-01T19:17:18.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-04-01T19:17:18.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 476 ; 2024-04-01T19:17:18.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.error_if_exists: 0 2024-04-01T19:17:18.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.create_if_missing: 0 2024-04-01T19:17:18.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.paranoid_checks: 1 2024-04-01T19:17:18.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-01T19:17:18.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-01T19:17:18.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-01T19:17:18.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.env: 0x55862030cc60 2024-04-01T19:17:18.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.fs: PosixFileSystem 2024-04-01T19:17:18.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.info_log: 0x558621d5dcc0 2024-04-01T19:17:18.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_file_opening_threads: 16 2024-04-01T19:17:18.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.statistics: (nil) 2024-04-01T19:17:18.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.use_fsync: 0 2024-04-01T19:17:18.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_log_file_size: 0 2024-04-01T19:17:18.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-01T19:17:18.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-01T19:17:18.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.keep_log_file_num: 1000 2024-04-01T19:17:18.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.recycle_log_file_num: 0 2024-04-01T19:17:18.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.allow_fallocate: 1 2024-04-01T19:17:18.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.allow_mmap_reads: 0 2024-04-01T19:17:18.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.allow_mmap_writes: 0 2024-04-01T19:17:18.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.use_direct_reads: 0 2024-04-01T19:17:18.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-01T19:17:18.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.create_missing_column_families: 0 2024-04-01T19:17:18.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.db_log_dir: 2024-04-01T19:17:18.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.wal_dir: 2024-04-01T19:17:18.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-01T19:17:18.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-01T19:17:18.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-01T19:17:18.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-01T19:17:18.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-01T19:17:18.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-01T19:17:18.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.advise_random_on_open: 1 2024-04-01T19:17:18.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.db_write_buffer_size: 0 2024-04-01T19:17:18.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.write_buffer_manager: 0x558621d321e0 2024-04-01T19:17:18.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-01T19:17:18.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-01T19:17:18.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-01T19:17:18.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.rate_limiter: (nil) 2024-04-01T19:17:18.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-01T19:17:18.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.wal_recovery_mode: 2 2024-04-01T19:17:18.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.enable_thread_tracking: 0 2024-04-01T19:17:18.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.enable_pipelined_write: 0 2024-04-01T19:17:18.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.unordered_write: 0 2024-04-01T19:17:18.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-01T19:17:18.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-01T19:17:18.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-01T19:17:18.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-01T19:17:18.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.row_cache: None 2024-04-01T19:17:18.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.wal_filter: None 2024-04-01T19:17:18.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-01T19:17:18.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.allow_ingest_behind: 0 2024-04-01T19:17:18.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.two_write_queues: 0 2024-04-01T19:17:18.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.manual_wal_flush: 0 2024-04-01T19:17:18.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.wal_compression: 0 2024-04-01T19:17:18.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.atomic_flush: 0 2024-04-01T19:17:18.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-01T19:17:18.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-01T19:17:18.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-01T19:17:18.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.log_readahead_size: 0 2024-04-01T19:17:18.632 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-01T19:17:18.632 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.best_efforts_recovery: 0 2024-04-01T19:17:18.632 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-01T19:17:18.632 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-01T19:17:18.632 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.allow_data_in_errors: 0 2024-04-01T19:17:18.632 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.db_host_id: __hostname__ 2024-04-01T19:17:18.632 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-01T19:17:18.632 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_background_jobs: 2 2024-04-01T19:17:18.632 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_background_compactions: -1 2024-04-01T19:17:18.632 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_subcompactions: 1 2024-04-01T19:17:18.632 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-01T19:17:18.632 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-01T19:17:18.632 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-01T19:17:18.633 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_total_wal_size: 0 2024-04-01T19:17:18.633 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-01T19:17:18.633 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-01T19:17:18.633 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-01T19:17:18.633 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-01T19:17:18.633 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_open_files: -1 2024-04-01T19:17:18.633 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.bytes_per_sync: 0 2024-04-01T19:17:18.633 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-01T19:17:18.633 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-01T19:17:18.633 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.compaction_readahead_size: 0 2024-04-01T19:17:18.633 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_background_flushes: -1 2024-04-01T19:17:18.633 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Compression algorithms supported: 2024-04-01T19:17:18.633 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-01T19:17:18.634 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: kZSTD supported: 0 2024-04-01T19:17:18.634 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: kXpressCompression supported: 0 2024-04-01T19:17:18.634 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: kLZ4HCCompression supported: 1 2024-04-01T19:17:18.634 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: kZlibCompression supported: 1 2024-04-01T19:17:18.634 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: kSnappyCompression supported: 1 2024-04-01T19:17:18.634 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: kLZ4Compression supported: 1 2024-04-01T19:17:18.634 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: kBZip2Compression supported: 0 2024-04-01T19:17:18.634 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-01T19:17:18.634 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-01T19:17:18.634 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-04-01T19:17:18.634 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-01T19:17:18.634 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-01T19:17:18.634 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.merge_operator: 2024-04-01T19:17:18.635 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.compaction_filter: None 2024-04-01T19:17:18.635 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.compaction_filter_factory: None 2024-04-01T19:17:18.635 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.sst_partitioner_factory: None 2024-04-01T19:17:18.635 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-01T19:17:18.635 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-01T19:17:18.635 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558621d5de80) 2024-04-01T19:17:18.635 INFO:journalctl@ceph.mon.c.smithi188.stdout: cache_index_and_filter_blocks: 1 2024-04-01T19:17:18.635 INFO:journalctl@ceph.mon.c.smithi188.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-01T19:17:18.635 INFO:journalctl@ceph.mon.c.smithi188.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-01T19:17:18.635 INFO:journalctl@ceph.mon.c.smithi188.stdout: pin_top_level_index_and_filter: 1 2024-04-01T19:17:18.635 INFO:journalctl@ceph.mon.c.smithi188.stdout: index_type: 0 2024-04-01T19:17:18.635 INFO:journalctl@ceph.mon.c.smithi188.stdout: data_block_index_type: 0 2024-04-01T19:17:18.635 INFO:journalctl@ceph.mon.c.smithi188.stdout: index_shortening: 1 2024-04-01T19:17:18.636 INFO:journalctl@ceph.mon.c.smithi188.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-01T19:17:18.636 INFO:journalctl@ceph.mon.c.smithi188.stdout: checksum: 4 2024-04-01T19:17:18.636 INFO:journalctl@ceph.mon.c.smithi188.stdout: no_block_cache: 0 2024-04-01T19:17:18.636 INFO:journalctl@ceph.mon.c.smithi188.stdout: block_cache: 0x558621d651f0 2024-04-01T19:17:18.636 INFO:journalctl@ceph.mon.c.smithi188.stdout: block_cache_name: BinnedLRUCache 2024-04-01T19:17:18.636 INFO:journalctl@ceph.mon.c.smithi188.stdout: block_cache_options: 2024-04-01T19:17:18.636 INFO:journalctl@ceph.mon.c.smithi188.stdout: capacity : 536870912 2024-04-01T19:17:18.636 INFO:journalctl@ceph.mon.c.smithi188.stdout: num_shard_bits : 4 2024-04-01T19:17:18.636 INFO:journalctl@ceph.mon.c.smithi188.stdout: strict_capacity_limit : 0 2024-04-01T19:17:18.636 INFO:journalctl@ceph.mon.c.smithi188.stdout: high_pri_pool_ratio: 0.000 2024-04-01T19:17:18.636 INFO:journalctl@ceph.mon.c.smithi188.stdout: block_cache_compressed: (nil) 2024-04-01T19:17:18.636 INFO:journalctl@ceph.mon.c.smithi188.stdout: persistent_cache: (nil) 2024-04-01T19:17:18.636 INFO:journalctl@ceph.mon.c.smithi188.stdout: block_size: 4096 2024-04-01T19:17:18.636 INFO:journalctl@ceph.mon.c.smithi188.stdout: block_size_deviation: 10 2024-04-01T19:17:18.637 INFO:journalctl@ceph.mon.c.smithi188.stdout: block_restart_interval: 16 2024-04-01T19:17:18.637 INFO:journalctl@ceph.mon.c.smithi188.stdout: index_block_restart_interval: 1 2024-04-01T19:17:18.637 INFO:journalctl@ceph.mon.c.smithi188.stdout: metadata_block_size: 4096 2024-04-01T19:17:18.637 INFO:journalctl@ceph.mon.c.smithi188.stdout: partition_filters: 0 2024-04-01T19:17:18.637 INFO:journalctl@ceph.mon.c.smithi188.stdout: use_delta_encoding: 1 2024-04-01T19:17:18.637 INFO:journalctl@ceph.mon.c.smithi188.stdout: filter_policy: bloomfilter 2024-04-01T19:17:18.637 INFO:journalctl@ceph.mon.c.smithi188.stdout: whole_key_filtering: 1 2024-04-01T19:17:18.637 INFO:journalctl@ceph.mon.c.smithi188.stdout: verify_compression: 0 2024-04-01T19:17:18.637 INFO:journalctl@ceph.mon.c.smithi188.stdout: read_amp_bytes_per_bit: 0 2024-04-01T19:17:18.637 INFO:journalctl@ceph.mon.c.smithi188.stdout: format_version: 5 2024-04-01T19:17:18.637 INFO:journalctl@ceph.mon.c.smithi188.stdout: enable_index_compression: 1 2024-04-01T19:17:18.637 INFO:journalctl@ceph.mon.c.smithi188.stdout: block_align: 0 2024-04-01T19:17:18.637 INFO:journalctl@ceph.mon.c.smithi188.stdout: max_auto_readahead_size: 262144 2024-04-01T19:17:18.638 INFO:journalctl@ceph.mon.c.smithi188.stdout: prepopulate_block_cache: 0 2024-04-01T19:17:18.638 INFO:journalctl@ceph.mon.c.smithi188.stdout: initial_auto_readahead_size: 8192 2024-04-01T19:17:18.638 INFO:journalctl@ceph.mon.c.smithi188.stdout: num_file_reads_for_auto_readahead: 2 2024-04-01T19:17:18.638 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.write_buffer_size: 33554432 2024-04-01T19:17:18.638 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_write_buffer_number: 2 2024-04-01T19:17:18.638 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.compression: NoCompression 2024-04-01T19:17:18.638 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.bottommost_compression: Disabled 2024-04-01T19:17:18.638 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.prefix_extractor: nullptr 2024-04-01T19:17:18.638 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-01T19:17:18.638 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.num_levels: 7 2024-04-01T19:17:18.638 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-01T19:17:18.638 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-01T19:17:18.638 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-01T19:17:18.639 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-01T19:17:18.639 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-01T19:17:18.639 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-01T19:17:18.639 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-01T19:17:18.639 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-01T19:17:18.639 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-01T19:17:18.639 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-01T19:17:18.639 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-01T19:17:18.639 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-01T19:17:18.639 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-01T19:17:18.639 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.compression_opts.level: 32767 2024-04-01T19:17:18.639 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.compression_opts.strategy: 0 2024-04-01T19:17:18.639 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-01T19:17:18.640 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-01T19:17:18.640 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-01T19:17:18.640 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-01T19:17:18.640 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.compression_opts.enabled: false 2024-04-01T19:17:18.640 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-01T19:17:18.640 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-01T19:17:18.640 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-01T19:17:18.640 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-01T19:17:18.640 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.target_file_size_base: 67108864 2024-04-01T19:17:18.640 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-01T19:17:18.640 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-01T19:17:18.640 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-01T19:17:18.640 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-01T19:17:18.640 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-01T19:17:18.641 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-01T19:17:18.641 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-01T19:17:18.641 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-01T19:17:18.641 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-01T19:17:18.641 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-01T19:17:18.641 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-01T19:17:18.641 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-01T19:17:18.641 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-01T19:17:18.641 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-01T19:17:18.641 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.arena_block_size: 1048576 2024-04-01T19:17:18.641 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-01T19:17:18.641 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-01T19:17:18.641 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.disable_auto_compactions: 0 2024-04-01T19:17:18.641 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-01T19:17:18.642 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-01T19:17:18.642 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-01T19:17:18.643 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-01T19:17:18.643 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-01T19:17:18.643 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-01T19:17:18.643 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-01T19:17:18.643 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-01T19:17:18.643 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-01T19:17:18.643 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-01T19:17:18.643 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-01T19:17:18.643 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.inplace_update_support: 0 2024-04-01T19:17:18.644 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-01T19:17:18.644 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-01T19:17:18.644 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-01T19:17:18.644 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-01T19:17:18.644 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.bloom_locality: 0 2024-04-01T19:17:18.644 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.max_successive_merges: 0 2024-04-01T19:17:18.644 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-01T19:17:18.644 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.paranoid_file_checks: 0 2024-04-01T19:17:18.644 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.force_consistency_checks: 1 2024-04-01T19:17:18.644 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.report_bg_io_stats: 0 2024-04-01T19:17:18.644 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.ttl: 2592000 2024-04-01T19:17:18.644 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-01T19:17:18.644 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-01T19:17:18.644 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-01T19:17:18.645 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.enable_blob_files: false 2024-04-01T19:17:18.645 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.min_blob_size: 0 2024-04-01T19:17:18.645 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.blob_file_size: 268435456 2024-04-01T19:17:18.645 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-01T19:17:18.645 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-01T19:17:18.645 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-01T19:17:18.645 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-01T19:17:18.645 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-01T19:17:18.645 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.blob_file_starting_level: 0 2024-04-01T19:17:18.645 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-01T19:17:18.645 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-01T19:17:18.645 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-04-01T19:17:18.645 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e0b4e4cb-a971-4f48-9788-c9027bba8da7 2024-04-01T19:17:18.646 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711999038209855, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-01T19:17:18.646 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-04-01T19:17:18.646 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711999038210251, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1613, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 488, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 366, "raw_average_value_size": 73, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711999038, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e0b4e4cb-a971-4f48-9788-c9027bba8da7", "db_session_id": "XGCOT3R0TP03G208A71E", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-04-01T19:17:18.646 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711999038210327, "job": 1, "event": "recovery_finished"} 2024-04-01T19:17:18.646 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-04-01T19:17:18.646 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-01T19:17:18.646 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558621e5a000 2024-04-01T19:17:18.646 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: DB pointer 0x558621e44000 2024-04-01T19:17:18.646 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-01T19:17:18.646 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-01T19:17:18.646 INFO:journalctl@ceph.mon.c.smithi188.stdout: ** DB Stats ** 2024-04-01T19:17:18.646 INFO:journalctl@ceph.mon.c.smithi188.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-01T19:17:18.646 INFO:journalctl@ceph.mon.c.smithi188.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-01T19:17:18.647 INFO:journalctl@ceph.mon.c.smithi188.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-01T19:17:18.647 INFO:journalctl@ceph.mon.c.smithi188.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-01T19:17:18.647 INFO:journalctl@ceph.mon.c.smithi188.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-01T19:17:18.647 INFO:journalctl@ceph.mon.c.smithi188.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-01T19:17:18.647 INFO:journalctl@ceph.mon.c.smithi188.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-01T19:17:18.647 INFO:journalctl@ceph.mon.c.smithi188.stdout: 2024-04-01T19:17:18.647 INFO:journalctl@ceph.mon.c.smithi188.stdout: ** Compaction Stats [default] ** 2024-04-01T19:17:18.647 INFO:journalctl@ceph.mon.c.smithi188.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-01T19:17:18.647 INFO:journalctl@ceph.mon.c.smithi188.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-01T19:17:18.647 INFO:journalctl@ceph.mon.c.smithi188.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-01T19:17:18.647 INFO:journalctl@ceph.mon.c.smithi188.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-01T19:17:18.647 INFO:journalctl@ceph.mon.c.smithi188.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-01T19:17:18.647 INFO:journalctl@ceph.mon.c.smithi188.stdout: 2024-04-01T19:17:18.647 INFO:journalctl@ceph.mon.c.smithi188.stdout: ** Compaction Stats [default] ** 2024-04-01T19:17:18.648 INFO:journalctl@ceph.mon.c.smithi188.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-01T19:17:18.648 INFO:journalctl@ceph.mon.c.smithi188.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-01T19:17:18.648 INFO:journalctl@ceph.mon.c.smithi188.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-01T19:17:18.648 INFO:journalctl@ceph.mon.c.smithi188.stdout: 2024-04-01T19:17:18.648 INFO:journalctl@ceph.mon.c.smithi188.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-01T19:17:18.648 INFO:journalctl@ceph.mon.c.smithi188.stdout: 2024-04-01T19:17:18.648 INFO:journalctl@ceph.mon.c.smithi188.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-01T19:17:18.648 INFO:journalctl@ceph.mon.c.smithi188.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-01T19:17:18.648 INFO:journalctl@ceph.mon.c.smithi188.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-01T19:17:18.648 INFO:journalctl@ceph.mon.c.smithi188.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-01T19:17:18.648 INFO:journalctl@ceph.mon.c.smithi188.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-01T19:17:18.648 INFO:journalctl@ceph.mon.c.smithi188.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-01T19:17:18.648 INFO:journalctl@ceph.mon.c.smithi188.stdout: Cumulative compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-01T19:17:18.649 INFO:journalctl@ceph.mon.c.smithi188.stdout: Interval compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-01T19:17:18.649 INFO:journalctl@ceph.mon.c.smithi188.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-01T19:17:18.649 INFO:journalctl@ceph.mon.c.smithi188.stdout: Block cache BinnedLRUCache@0x558621d651f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-04-01T19:17:18.649 INFO:journalctl@ceph.mon.c.smithi188.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-04-01T19:17:18.649 INFO:journalctl@ceph.mon.c.smithi188.stdout: 2024-04-01T19:17:18.649 INFO:journalctl@ceph.mon.c.smithi188.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-01T19:17:18.649 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-04-01T19:17:18.649 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: using public_addrv v1:172.21.15.188:6789/0 2024-04-01T19:17:18.649 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: starting mon.c rank -1 at public addrs v1:172.21.15.188:6789/0 at bind addrs v1:172.21.15.188:6789/0 mon_data /var/lib/ceph/mon/ceph-c fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:17:18.649 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: mon.c@-1(???) e0 preinit fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:17:18.649 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: mon.c@-1(synchronizing).mds e1 new map 2024-04-01T19:17:18.649 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: mon.c@-1(synchronizing).mds e1 print_map 2024-04-01T19:17:18.649 INFO:journalctl@ceph.mon.c.smithi188.stdout: e1 2024-04-01T19:17:18.649 INFO:journalctl@ceph.mon.c.smithi188.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-01T19:17:18.650 INFO:journalctl@ceph.mon.c.smithi188.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-01T19:17:18.650 INFO:journalctl@ceph.mon.c.smithi188.stdout: legacy client fscid: -1 2024-04-01T19:17:18.650 INFO:journalctl@ceph.mon.c.smithi188.stdout: 2024-04-01T19:17:18.650 INFO:journalctl@ceph.mon.c.smithi188.stdout: No filesystems configured 2024-04-01T19:17:18.650 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: [db/db_impl/db_impl_write.cc:2098] [default] New memtable created with log file: #13. Immutable memtables: 0. 2024-04-01T19:17:18.650 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:18.650 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:18.650 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:18.650 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:18.650 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi062", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:17:18.650 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:18.650 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:17:18.651 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: Updating smithi062:/etc/ceph/ceph.conf 2024-04-01T19:17:18.651 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:18.651 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: Updating smithi062:/var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T19:17:18.651 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-04-01T19:17:18.651 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: Updating smithi062:/var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-01T19:17:18.651 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='client.14181 v1:172.21.15.22:0/1383109015' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi188", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:17:18.651 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:18.651 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:18.651 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:18.651 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: Deploying cephadm binary to smithi188 2024-04-01T19:17:18.651 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:18.651 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:18.651 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:18.651 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: Added host smithi188 2024-04-01T19:17:18.652 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:17:18.652 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:18.652 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:18.652 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:18.652 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:18.652 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='client.14183 v1:172.21.15.22:0/2381193746' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:17:18.652 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:18.652 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:18.652 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:18.652 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:18.652 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:18.652 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi188", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:17:18.652 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:18.652 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:17:18.653 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: Updating smithi188:/etc/ceph/ceph.conf 2024-04-01T19:17:18.653 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: Updating smithi188:/var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T19:17:18.653 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:18.653 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:18.653 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:18.653 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 bash[43880]: 4df05baf2aa2e57a1966397f13ab95ef111dc1badd72c38485db0d87752f71a7 2024-04-01T19:17:18.653 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:18.653 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: Updating smithi188:/etc/ceph/ceph.client.admin.keyring 2024-04-01T19:17:18.653 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: Updating smithi188:/var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-01T19:17:18.653 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1770386734' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-01T19:17:18.653 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1770386734' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-01T19:17:18.653 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: osdmap e4: 0 total, 0 up, 0 in 2024-04-01T19:17:18.653 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:18.653 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:18.654 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='client.14187 v1:172.21.15.188:0/2133467586' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi022:[v1:172.21.15.22:6789]=a;smithi062:[v1:172.21.15.62:6789]=b;smithi188:[v1:172.21.15.188:6789]=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:17:18.654 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: Saving service mon spec with placement smithi022:[v1:172.21.15.22:6789]=a;smithi062:[v1:172.21.15.62:6789]=b;smithi188:[v1:172.21.15.188:6789]=c;count:3 2024-04-01T19:17:18.654 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:18.654 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:17:18.654 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:18.654 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:17:18.654 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:18.654 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-01T19:17:18.654 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:18.654 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: Deploying daemon mon.c on smithi188 2024-04-01T19:17:18.654 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:18.654 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:18.654 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.188:0/2324246519' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-01T19:17:18.654 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-01T19:17:18.655 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: (Original Log Time 2024/04/01-19:17:18.230834) [db/db_impl/db_impl_compaction_flush.cc:2832] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 0 2024-04-01T19:17:18.655 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: [db/flush_job.cc:856] [default] [JOB 3] Flushing memtable with next log file: 13 2024-04-01T19:17:18.655 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711999038230957, "job": 3, "event": "flush_started", "num_memtables": 1, "num_entries": 1093, "num_deletes": 13, "total_data_size": 2253268, "memory_usage": 2273640, "flush_reason": "Manual Compaction"} 2024-04-01T19:17:18.655 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: rocksdb: [db/flush_job.cc:885] [default] [JOB 3] Level-0 flush table #14: started 2024-04-01T19:17:18.655 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-01T19:17:18.655 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-01T19:17:18.655 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-01T19:17:18.655 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-01T19:17:18.655 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-01T19:17:18.655 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-01T19:17:18.655 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-01T19:17:18.655 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-01T19:17:18.655 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-01T19:17:18.656 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 ceph-mon[43939]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-01T19:17:18.656 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:18 smithi188 systemd[1]: Started Ceph mon.c for 09f6b846-f05c-11ee-b647-cb9ed24678a4. 2024-04-01T19:17:19.688 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-01T19:17:19.688 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph mon dump -f json 2024-04-01T19:17:19.959 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:17:23.577 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:17:23.577 INFO:teuthology.orchestra.run.smithi188.stdout:{"epoch":2,"fsid":"09f6b846-f05c-11ee-b647-cb9ed24678a4","modified":"2024-04-01T19:17:18.235840Z","created":"2024-04-01T19:15:31.526632Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6789","nonce":0}]},"addr":"172.21.15.188:6789/0","public_addr":"172.21.15.188:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-01T19:17:23.579 INFO:teuthology.orchestra.run.smithi188.stderr:dumped monmap epoch 2 2024-04-01T19:17:23.602 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:17:23.602 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: mon.a calling monitor election 2024-04-01T19:17:23.602 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:17:23.602 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:23.602 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:17:23.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:17:23.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: mon.c calling monitor election 2024-04-01T19:17:23.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:23.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:17:23.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:17:23.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:17:23.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-01T19:17:23.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: monmap epoch 2 2024-04-01T19:17:23.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:17:23.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: last_changed 2024-04-01T19:17:18.235840+0000 2024-04-01T19:17:23.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: created 2024-04-01T19:15:31.526632+0000 2024-04-01T19:17:23.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: min_mon_release 19 (squid) 2024-04-01T19:17:23.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: election_strategy: 1 2024-04-01T19:17:23.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: 0: v1:172.21.15.22:6789/0 mon.a 2024-04-01T19:17:23.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: 1: v1:172.21.15.188:6789/0 mon.c 2024-04-01T19:17:23.604 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: fsmap 2024-04-01T19:17:23.604 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: osdmap e4: 0 total, 0 up, 0 in 2024-04-01T19:17:23.604 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: mgrmap e13: y(active, since 52s) 2024-04-01T19:17:23.604 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: overall HEALTH_OK 2024-04-01T19:17:23.604 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:23.604 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:23 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:23.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:17:23.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: mon.a calling monitor election 2024-04-01T19:17:23.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:17:23.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:23.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:17:23.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:17:23.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: mon.c calling monitor election 2024-04-01T19:17:23.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:23.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:17:23.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:17:23.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:17:23.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-01T19:17:23.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: monmap epoch 2 2024-04-01T19:17:23.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:17:23.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: last_changed 2024-04-01T19:17:18.235840+0000 2024-04-01T19:17:23.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: created 2024-04-01T19:15:31.526632+0000 2024-04-01T19:17:23.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: min_mon_release 19 (squid) 2024-04-01T19:17:23.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: election_strategy: 1 2024-04-01T19:17:23.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: 0: v1:172.21.15.22:6789/0 mon.a 2024-04-01T19:17:23.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: 1: v1:172.21.15.188:6789/0 mon.c 2024-04-01T19:17:23.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: fsmap 2024-04-01T19:17:23.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: osdmap e4: 0 total, 0 up, 0 in 2024-04-01T19:17:23.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: mgrmap e13: y(active, since 52s) 2024-04-01T19:17:23.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: overall HEALTH_OK 2024-04-01T19:17:23.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:23.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:23 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:24.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:24 smithi022 ceph-mon[39439]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:24.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:24.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-01T19:17:24.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:24.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:24 smithi022 ceph-mon[39439]: Deploying daemon mon.b on smithi062 2024-04-01T19:17:24.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:24 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.188:0/2156813294' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-01T19:17:24.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:17:24.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:24 smithi188 ceph-mon[43939]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:24.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:24.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-01T19:17:24.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:24.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:24 smithi188 ceph-mon[43939]: Deploying daemon mon.b on smithi062 2024-04-01T19:17:24.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:24 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.188:0/2156813294' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-01T19:17:24.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:17:25.258 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-01T19:17:25.258 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph mon dump -f json 2024-04-01T19:17:25.519 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:17:26.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:26 smithi022 ceph-mon[39439]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:26.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:26 smithi188 ceph-mon[43939]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:27.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:27 smithi062 bash[44173]: f18dc56918e32fcd72083e107f870a1671e9f49c75bc4d78941ff24f55f9a79e 2024-04-01T19:17:27.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:27 smithi062 systemd[1]: Started Ceph mon.b for 09f6b846-f05c-11ee-b647-cb9ed24678a4. 2024-04-01T19:17:32.481 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-01T19:17:32.482 INFO:teuthology.orchestra.run.smithi188.stdout:{"epoch":3,"fsid":"09f6b846-f05c-11ee-b647-cb9ed24678a4","modified":"2024-04-01T19:17:27.133386Z","created":"2024-04-01T19:15:31.526632Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6789","nonce":0}]},"addr":"172.21.15.188:6789/0","public_addr":"172.21.15.188:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-04-01T19:17:32.484 INFO:teuthology.orchestra.run.smithi188.stderr:dumped monmap epoch 3 2024-04-01T19:17:32.509 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:32.510 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:17:32.510 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: mon.a calling monitor election 2024-04-01T19:17:32.510 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: mon.c calling monitor election 2024-04-01T19:17:32.510 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:17:32.510 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:17:32.510 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:17:32.510 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:32.510 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:17:32.510 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: mon.b calling monitor election 2024-04-01T19:17:32.510 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:17:32.510 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:32.511 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:17:32.511 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:17:32.511 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-01T19:17:32.511 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: monmap epoch 3 2024-04-01T19:17:32.511 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:17:32.511 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: last_changed 2024-04-01T19:17:27.133386+0000 2024-04-01T19:17:32.511 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: created 2024-04-01T19:15:31.526632+0000 2024-04-01T19:17:32.511 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: min_mon_release 19 (squid) 2024-04-01T19:17:32.511 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: election_strategy: 1 2024-04-01T19:17:32.511 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: 0: v1:172.21.15.22:6789/0 mon.a 2024-04-01T19:17:32.511 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: 1: v1:172.21.15.188:6789/0 mon.c 2024-04-01T19:17:32.511 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: 2: v1:172.21.15.62:6789/0 mon.b 2024-04-01T19:17:32.511 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: fsmap 2024-04-01T19:17:32.512 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: osdmap e4: 0 total, 0 up, 0 in 2024-04-01T19:17:32.512 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: mgrmap e13: y(active, since 61s) 2024-04-01T19:17:32.512 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: overall HEALTH_OK 2024-04-01T19:17:32.512 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:32.512 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:32.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:32.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:17:32.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: mon.a calling monitor election 2024-04-01T19:17:32.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: mon.c calling monitor election 2024-04-01T19:17:32.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:17:32.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:17:32.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:17:32.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:32.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:17:32.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: mon.b calling monitor election 2024-04-01T19:17:32.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:17:32.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:32.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:17:32.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:17:32.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-01T19:17:32.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: monmap epoch 3 2024-04-01T19:17:32.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:17:32.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: last_changed 2024-04-01T19:17:27.133386+0000 2024-04-01T19:17:32.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: created 2024-04-01T19:15:31.526632+0000 2024-04-01T19:17:32.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: min_mon_release 19 (squid) 2024-04-01T19:17:32.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: election_strategy: 1 2024-04-01T19:17:32.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: 0: v1:172.21.15.22:6789/0 mon.a 2024-04-01T19:17:32.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: 1: v1:172.21.15.188:6789/0 mon.c 2024-04-01T19:17:32.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: 2: v1:172.21.15.62:6789/0 mon.b 2024-04-01T19:17:32.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: fsmap 2024-04-01T19:17:32.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: osdmap e4: 0 total, 0 up, 0 in 2024-04-01T19:17:32.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: mgrmap e13: y(active, since 61s) 2024-04-01T19:17:32.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: overall HEALTH_OK 2024-04-01T19:17:32.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:32.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:32.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:32.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:17:32.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: mon.a calling monitor election 2024-04-01T19:17:32.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: mon.c calling monitor election 2024-04-01T19:17:32.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:17:32.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:17:32.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:17:32.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:32.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:17:32.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: mon.b calling monitor election 2024-04-01T19:17:32.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:17:32.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:32.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:17:32.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:17:32.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-01T19:17:32.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: monmap epoch 3 2024-04-01T19:17:32.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:17:32.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: last_changed 2024-04-01T19:17:27.133386+0000 2024-04-01T19:17:32.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: created 2024-04-01T19:15:31.526632+0000 2024-04-01T19:17:32.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: min_mon_release 19 (squid) 2024-04-01T19:17:32.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: election_strategy: 1 2024-04-01T19:17:32.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: 0: v1:172.21.15.22:6789/0 mon.a 2024-04-01T19:17:32.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: 1: v1:172.21.15.188:6789/0 mon.c 2024-04-01T19:17:32.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: 2: v1:172.21.15.62:6789/0 mon.b 2024-04-01T19:17:32.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: fsmap 2024-04-01T19:17:32.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: osdmap e4: 0 total, 0 up, 0 in 2024-04-01T19:17:32.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: mgrmap e13: y(active, since 61s) 2024-04-01T19:17:32.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: overall HEALTH_OK 2024-04-01T19:17:32.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:32.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:33.347 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-01T19:17:33.348 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph config generate-minimal-conf 2024-04-01T19:17:33.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:33.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:33.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:17:33.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:33 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.188:0/2290263754' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-01T19:17:33.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:17:33.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:33.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:33.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:17:33.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:33 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.188:0/2290263754' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-01T19:17:33.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:17:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:17:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:33 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.188:0/2290263754' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-01T19:17:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:17:33.634 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:17:34.239 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 19:17:34 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T19:17:34.132+0000 7f98a93b0700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-01T19:17:34.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:34 smithi062 ceph-mon[44211]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:34.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:34 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:34.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:34 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:34.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:34 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:34.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:34 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:34.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:34 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:34.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:34 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:17:34.572 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:34 smithi022 ceph-mon[39439]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:34.572 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:34 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:34.572 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:34 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:34.572 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:34 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:34.572 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:34 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:34.572 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:34 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:34.572 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:34 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:17:34.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:34 smithi188 ceph-mon[43939]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:34.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:34 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:34.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:34 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:34.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:34 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:34.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:34 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:34.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:34 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:34.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:34 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:17:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:35 smithi062 ceph-mon[44211]: Updating smithi022:/etc/ceph/ceph.conf 2024-04-01T19:17:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:35 smithi062 ceph-mon[44211]: Updating smithi062:/etc/ceph/ceph.conf 2024-04-01T19:17:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:35 smithi062 ceph-mon[44211]: Updating smithi188:/etc/ceph/ceph.conf 2024-04-01T19:17:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-01T19:17:35.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-01T19:17:35.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:35.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:35 smithi022 ceph-mon[39439]: Updating smithi022:/etc/ceph/ceph.conf 2024-04-01T19:17:35.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:35 smithi022 ceph-mon[39439]: Updating smithi062:/etc/ceph/ceph.conf 2024-04-01T19:17:35.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:35 smithi022 ceph-mon[39439]: Updating smithi188:/etc/ceph/ceph.conf 2024-04-01T19:17:35.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-01T19:17:35.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-01T19:17:35.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:35.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:35 smithi188 ceph-mon[43939]: Updating smithi022:/etc/ceph/ceph.conf 2024-04-01T19:17:35.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:35 smithi188 ceph-mon[43939]: Updating smithi062:/etc/ceph/ceph.conf 2024-04-01T19:17:35.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:35 smithi188 ceph-mon[43939]: Updating smithi188:/etc/ceph/ceph.conf 2024-04-01T19:17:35.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:35.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-01T19:17:35.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-01T19:17:35.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:35.678 INFO:teuthology.orchestra.run.smithi022.stdout:# minimal ceph.conf for 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:17:35.678 INFO:teuthology.orchestra.run.smithi022.stdout:[global] 2024-04-01T19:17:35.678 INFO:teuthology.orchestra.run.smithi022.stdout: fsid = 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:17:35.678 INFO:teuthology.orchestra.run.smithi022.stdout: mon_host = 172.21.15.22:6789/0 172.21.15.62:6789/0 172.21.15.188:6789/0 2024-04-01T19:17:36.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:36 smithi022 ceph-mon[39439]: Updating smithi022:/var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T19:17:36.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:36 smithi022 ceph-mon[39439]: Updating smithi188:/var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T19:17:36.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:36 smithi022 ceph-mon[39439]: Updating smithi062:/var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T19:17:36.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:36 smithi022 ceph-mon[39439]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:36.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:36 smithi022 ceph-mon[39439]: Reconfiguring mon.a (unknown last config time)... 2024-04-01T19:17:36.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:36 smithi022 ceph-mon[39439]: Reconfiguring daemon mon.a on smithi022 2024-04-01T19:17:36.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:36 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:36.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:36 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3487867282' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:36.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:36 smithi062 ceph-mon[44211]: Updating smithi022:/var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T19:17:36.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:36 smithi062 ceph-mon[44211]: Updating smithi188:/var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T19:17:36.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:36 smithi062 ceph-mon[44211]: Updating smithi062:/var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T19:17:36.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:36 smithi062 ceph-mon[44211]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:36.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:36 smithi062 ceph-mon[44211]: Reconfiguring mon.a (unknown last config time)... 2024-04-01T19:17:36.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:36 smithi062 ceph-mon[44211]: Reconfiguring daemon mon.a on smithi022 2024-04-01T19:17:36.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:36 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:36.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:36 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3487867282' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:36.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:36 smithi188 ceph-mon[43939]: Updating smithi022:/var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T19:17:36.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:36 smithi188 ceph-mon[43939]: Updating smithi188:/var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T19:17:36.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:36 smithi188 ceph-mon[43939]: Updating smithi062:/var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T19:17:36.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:36 smithi188 ceph-mon[43939]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:36.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:36 smithi188 ceph-mon[43939]: Reconfiguring mon.a (unknown last config time)... 2024-04-01T19:17:36.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:36 smithi188 ceph-mon[43939]: Reconfiguring daemon mon.a on smithi022 2024-04-01T19:17:36.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:36 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:36.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:36 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3487867282' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:37.038 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-01T19:17:37.038 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-01T19:17:37.039 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.conf 2024-04-01T19:17:37.070 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-01T19:17:37.071 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-01T19:17:37.139 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-01T19:17:37.139 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.conf 2024-04-01T19:17:37.170 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-01T19:17:37.171 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-01T19:17:37.243 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-01T19:17:37.318 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/ceph/ceph.conf 2024-04-01T19:17:37.362 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-01T19:17:37.362 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-01T19:17:37.437 INFO:tasks.cephadm:Adding mgr.y on smithi022 2024-04-01T19:17:37.437 INFO:tasks.cephadm:Adding mgr.x on smithi062 2024-04-01T19:17:37.437 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph orch apply mgr '2;smithi022=y;smithi062=x' 2024-04-01T19:17:37.739 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:17:37.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:37 smithi062 ceph-mon[44211]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:37.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:37.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:37.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:37 smithi062 ceph-mon[44211]: Reconfiguring mon.b (monmap changed)... 2024-04-01T19:17:37.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-01T19:17:37.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-01T19:17:37.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:37.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:37 smithi062 ceph-mon[44211]: Reconfiguring daemon mon.b on smithi062 2024-04-01T19:17:37.934 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:37 smithi188 ceph-mon[43939]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:37.934 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:37.934 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:37.934 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:37 smithi188 ceph-mon[43939]: Reconfiguring mon.b (monmap changed)... 2024-04-01T19:17:37.935 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-01T19:17:37.935 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-01T19:17:37.935 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:37.935 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:37 smithi188 ceph-mon[43939]: Reconfiguring daemon mon.b on smithi062 2024-04-01T19:17:38.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:37 smithi022 ceph-mon[39439]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:38.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:38.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:38.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:37 smithi022 ceph-mon[39439]: Reconfiguring mon.b (monmap changed)... 2024-04-01T19:17:38.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-01T19:17:38.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-01T19:17:38.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:38.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:37 smithi022 ceph-mon[39439]: Reconfiguring daemon mon.b on smithi062 2024-04-01T19:17:39.498 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:39 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:39.499 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:39 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:39.499 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:39 smithi188 ceph-mon[43939]: Reconfiguring mon.c (monmap changed)... 2024-04-01T19:17:39.499 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:39 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-01T19:17:39.499 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:39 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-01T19:17:39.499 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:39 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:39.499 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:39 smithi188 ceph-mon[43939]: Reconfiguring daemon mon.c on smithi188 2024-04-01T19:17:39.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:39 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:39.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:39 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:39.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:39 smithi062 ceph-mon[44211]: Reconfiguring mon.c (monmap changed)... 2024-04-01T19:17:39.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:39 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-01T19:17:39.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:39 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-01T19:17:39.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:39 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:39.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:39 smithi062 ceph-mon[44211]: Reconfiguring daemon mon.c on smithi188 2024-04-01T19:17:39.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:39 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:39.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:39 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:39.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:39 smithi022 ceph-mon[39439]: Reconfiguring mon.c (monmap changed)... 2024-04-01T19:17:39.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:39 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-01T19:17:39.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:39 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-01T19:17:39.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:39 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:39.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:39 smithi022 ceph-mon[39439]: Reconfiguring daemon mon.c on smithi188 2024-04-01T19:17:40.248 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:40 smithi188 ceph-mon[43939]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:40.248 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:40 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:40.248 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:40 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:40.249 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:40 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:17:40.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:40 smithi062 ceph-mon[44211]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:40.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:40 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:40.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:40 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:40.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:40 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:17:40.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:40 smithi022 ceph-mon[39439]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:40.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:40 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:40.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:40 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:40.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:40 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:17:40.694 INFO:teuthology.orchestra.run.smithi188.stdout:Scheduled mgr update... 2024-04-01T19:17:41.308 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:41 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:41.308 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:41 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:17:41.308 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:41 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:41.308 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:41 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:41.308 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:41 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-01T19:17:41.308 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:41 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-01T19:17:41.308 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:41 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:41.333 DEBUG:teuthology.orchestra.run.smithi062:mgr.x> sudo journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mgr.x.service 2024-04-01T19:17:41.336 INFO:tasks.cephadm:Deploying OSDs... 2024-04-01T19:17:41.336 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-01T19:17:41.336 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/scratch_devs of=/dev/stdout 2024-04-01T19:17:41.355 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-01T19:17:41.356 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_1 2024-04-01T19:17:41.372 INFO:journalctl@ceph.mgr.x.smithi062.stdout:-- Logs begin at Mon 2024-04-01 19:04:11 UTC. -- 2024-04-01T19:17:41.414 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-01T19:17:41.414 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T19:17:41.415 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 6h/6d Inode: 164686 Links: 1 2024-04-01T19:17:41.415 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T19:17:41.415 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T19:17:41.415 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-04-01 19:16:43.725376940 +0000 2024-04-01T19:17:41.415 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-04-01 19:10:39.582769771 +0000 2024-04-01T19:17:41.415 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-04-01 19:10:39.582769771 +0000 2024-04-01T19:17:41.415 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2024-04-01T19:17:41.415 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-01T19:17:41.480 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:41 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:41.480 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:41 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:17:41.480 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:41 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:41.480 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:41 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:41.480 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:41 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-01T19:17:41.480 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:41 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-01T19:17:41.480 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:41 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:41.481 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-01T19:17:41.482 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-01T19:17:41.482 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 8.2139e-05 s, 6.2 MB/s 2024-04-01T19:17:41.483 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-01T19:17:41.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:41 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:41.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:41 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:17:41.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:41 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:41.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:41 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:41.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:41 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-01T19:17:41.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:41 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-01T19:17:41.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:41 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:41.543 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_2 2024-04-01T19:17:41.602 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-01T19:17:41.602 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T19:17:41.603 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 6h/6d Inode: 162618 Links: 1 2024-04-01T19:17:41.603 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T19:17:41.603 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T19:17:41.603 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-04-01 19:16:43.787376143 +0000 2024-04-01T19:17:41.603 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-04-01 19:10:39.906765570 +0000 2024-04-01T19:17:41.603 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-04-01 19:10:39.906765570 +0000 2024-04-01T19:17:41.603 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2024-04-01T19:17:41.603 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-01T19:17:41.670 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-01T19:17:41.670 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-01T19:17:41.670 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.00010482 s, 4.9 MB/s 2024-04-01T19:17:41.671 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-01T19:17:41.731 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_3 2024-04-01T19:17:41.790 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-01T19:17:41.790 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T19:17:41.790 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 6h/6d Inode: 164749 Links: 1 2024-04-01T19:17:41.790 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T19:17:41.790 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T19:17:41.790 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-04-01 19:16:43.847375371 +0000 2024-04-01T19:17:41.791 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-04-01 19:10:40.248761136 +0000 2024-04-01T19:17:41.791 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-04-01 19:10:40.248761136 +0000 2024-04-01T19:17:41.791 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2024-04-01T19:17:41.791 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-01T19:17:41.857 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-01T19:17:41.857 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-01T19:17:41.857 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 9.9216e-05 s, 5.2 MB/s 2024-04-01T19:17:41.859 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-01T19:17:41.918 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_4 2024-04-01T19:17:41.976 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-01T19:17:41.976 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T19:17:41.976 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 6h/6d Inode: 166730 Links: 1 2024-04-01T19:17:41.976 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T19:17:41.977 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T19:17:41.977 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-04-01 19:16:43.903374651 +0000 2024-04-01T19:17:41.977 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-04-01 19:10:40.588756728 +0000 2024-04-01T19:17:41.977 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-04-01 19:10:40.588756728 +0000 2024-04-01T19:17:41.977 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2024-04-01T19:17:41.977 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-01T19:17:42.043 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-04-01T19:17:42.043 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-04-01T19:17:42.044 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 9.118e-05 s, 5.6 MB/s 2024-04-01T19:17:42.044 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-01T19:17:42.104 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-01T19:17:42.104 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/scratch_devs of=/dev/stdout 2024-04-01T19:17:42.127 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-01T19:17:42.127 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 2024-04-01T19:17:42.189 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-01T19:17:42.189 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T19:17:42.189 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 155541 Links: 1 2024-04-01T19:17:42.189 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T19:17:42.189 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T19:17:42.189 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-04-01 19:17:26.516689579 +0000 2024-04-01T19:17:42.189 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-04-01 19:10:27.982370134 +0000 2024-04-01T19:17:42.189 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-04-01 19:10:27.982370134 +0000 2024-04-01T19:17:42.189 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2024-04-01T19:17:42.190 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-01T19:17:42.260 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-04-01T19:17:42.260 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-04-01T19:17:42.260 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000219574 s, 2.3 MB/s 2024-04-01T19:17:42.261 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-01T19:17:42.325 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 2024-04-01T19:17:42.386 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-01T19:17:42.386 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T19:17:42.386 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 166118 Links: 1 2024-04-01T19:17:42.386 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T19:17:42.386 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T19:17:42.386 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-04-01 19:17:26.517689563 +0000 2024-04-01T19:17:42.386 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-04-01 19:10:28.356364288 +0000 2024-04-01T19:17:42.386 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-04-01 19:10:28.356364288 +0000 2024-04-01T19:17:42.387 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2024-04-01T19:17:42.387 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-01T19:17:42.453 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:42 smithi062 ceph-mon[44211]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:42.453 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:42 smithi062 ceph-mon[44211]: from='client.24106 v1:172.21.15.188:0/732766732' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi022=y;smithi062=x", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:17:42.453 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:42 smithi062 ceph-mon[44211]: Saving service mgr spec with placement smithi022=y;smithi062=x;count:2 2024-04-01T19:17:42.453 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:42 smithi062 ceph-mon[44211]: Reconfiguring mgr.y (unknown last config time)... 2024-04-01T19:17:42.453 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:42 smithi062 ceph-mon[44211]: Reconfiguring daemon mgr.y on smithi022 2024-04-01T19:17:42.455 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-04-01T19:17:42.455 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-04-01T19:17:42.455 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000222857 s, 2.3 MB/s 2024-04-01T19:17:42.456 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-01T19:17:42.518 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 2024-04-01T19:17:42.576 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-01T19:17:42.576 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T19:17:42.576 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 167280 Links: 1 2024-04-01T19:17:42.576 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T19:17:42.576 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T19:17:42.576 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-04-01 19:17:26.517689563 +0000 2024-04-01T19:17:42.577 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-04-01 19:10:28.711358739 +0000 2024-04-01T19:17:42.577 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-04-01 19:10:28.711358739 +0000 2024-04-01T19:17:42.577 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2024-04-01T19:17:42.577 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-01T19:17:42.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:42 smithi022 ceph-mon[39439]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:42.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:42 smithi022 ceph-mon[39439]: from='client.24106 v1:172.21.15.188:0/732766732' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi022=y;smithi062=x", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:17:42.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:42 smithi022 ceph-mon[39439]: Saving service mgr spec with placement smithi022=y;smithi062=x;count:2 2024-04-01T19:17:42.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:42 smithi022 ceph-mon[39439]: Reconfiguring mgr.y (unknown last config time)... 2024-04-01T19:17:42.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:42 smithi022 ceph-mon[39439]: Reconfiguring daemon mgr.y on smithi022 2024-04-01T19:17:42.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:42 smithi188 ceph-mon[43939]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:42.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:42 smithi188 ceph-mon[43939]: from='client.24106 v1:172.21.15.188:0/732766732' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi022=y;smithi062=x", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:17:42.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:42 smithi188 ceph-mon[43939]: Saving service mgr spec with placement smithi022=y;smithi062=x;count:2 2024-04-01T19:17:42.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:42 smithi188 ceph-mon[43939]: Reconfiguring mgr.y (unknown last config time)... 2024-04-01T19:17:42.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:42 smithi188 ceph-mon[43939]: Reconfiguring daemon mgr.y on smithi022 2024-04-01T19:17:42.645 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-04-01T19:17:42.645 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-04-01T19:17:42.645 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.00017182 s, 3.0 MB/s 2024-04-01T19:17:42.646 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-01T19:17:42.707 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 2024-04-01T19:17:42.766 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-01T19:17:42.767 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T19:17:42.767 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 166167 Links: 1 2024-04-01T19:17:42.767 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T19:17:42.767 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T19:17:42.767 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-04-01 19:17:26.517689563 +0000 2024-04-01T19:17:42.767 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-04-01 19:10:29.066353190 +0000 2024-04-01T19:17:42.767 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-04-01 19:10:29.066353190 +0000 2024-04-01T19:17:42.767 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2024-04-01T19:17:42.768 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-01T19:17:42.835 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-04-01T19:17:42.835 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-04-01T19:17:42.835 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000232413 s, 2.2 MB/s 2024-04-01T19:17:42.836 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-01T19:17:42.896 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-01T19:17:42.896 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/scratch_devs of=/dev/stdout 2024-04-01T19:17:42.919 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-01T19:17:42.919 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_1 2024-04-01T19:17:42.980 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-01T19:17:42.980 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T19:17:42.981 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 6h/6d Inode: 166243 Links: 1 2024-04-01T19:17:42.981 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T19:17:42.981 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T19:17:42.981 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-04-01 19:17:17.481357179 +0000 2024-04-01T19:17:42.981 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-04-01 19:10:17.205129730 +0000 2024-04-01T19:17:42.981 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-04-01 19:10:17.205129730 +0000 2024-04-01T19:17:42.981 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2024-04-01T19:17:42.981 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-01T19:17:43.053 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-04-01T19:17:43.053 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-04-01T19:17:43.053 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000273486 s, 1.9 MB/s 2024-04-01T19:17:43.054 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-01T19:17:43.116 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_2 2024-04-01T19:17:43.176 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-01T19:17:43.176 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T19:17:43.176 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 6h/6d Inode: 170107 Links: 1 2024-04-01T19:17:43.176 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T19:17:43.176 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T19:17:43.176 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-04-01 19:17:17.481357179 +0000 2024-04-01T19:17:43.176 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-04-01 19:10:17.534123769 +0000 2024-04-01T19:17:43.176 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-04-01 19:10:17.534123769 +0000 2024-04-01T19:17:43.176 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2024-04-01T19:17:43.177 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-01T19:17:43.246 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-04-01T19:17:43.247 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-04-01T19:17:43.247 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000254423 s, 2.0 MB/s 2024-04-01T19:17:43.248 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-01T19:17:43.308 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_3 2024-04-01T19:17:43.368 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-01T19:17:43.368 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T19:17:43.368 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 6h/6d Inode: 169166 Links: 1 2024-04-01T19:17:43.368 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T19:17:43.368 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T19:17:43.368 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-04-01 19:17:17.481357179 +0000 2024-04-01T19:17:43.368 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-04-01 19:10:17.884117428 +0000 2024-04-01T19:17:43.368 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-04-01 19:10:17.884117428 +0000 2024-04-01T19:17:43.368 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2024-04-01T19:17:43.369 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-01T19:17:43.436 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-04-01T19:17:43.436 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-04-01T19:17:43.437 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000168109 s, 3.0 MB/s 2024-04-01T19:17:43.437 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-01T19:17:43.497 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_4 2024-04-01T19:17:43.556 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-01T19:17:43.556 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T19:17:43.556 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 6h/6d Inode: 169227 Links: 1 2024-04-01T19:17:43.556 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T19:17:43.556 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T19:17:43.556 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-04-01 19:17:17.481357179 +0000 2024-04-01T19:17:43.556 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-04-01 19:10:18.232111122 +0000 2024-04-01T19:17:43.556 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-04-01 19:10:18.232111122 +0000 2024-04-01T19:17:43.556 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2024-04-01T19:17:43.557 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-01T19:17:43.623 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-04-01T19:17:43.623 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-04-01T19:17:43.623 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000229875 s, 2.2 MB/s 2024-04-01T19:17:43.624 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-01T19:17:43.683 INFO:tasks.cephadm:Deploying osd.0 on smithi022 with /dev/vg_nvme/lv_4... 2024-04-01T19:17:43.683 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-01T19:17:43.715 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:43 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:43.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:43 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:43.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:43 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:17:43.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:43 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:43.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:43 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:17:43.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:43 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:43.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:43 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-01T19:17:43.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:43 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-01T19:17:43.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:43 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-01T19:17:43.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:43 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:43.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:43 smithi022 ceph-mon[39439]: Deploying daemon mgr.x on smithi062 2024-04-01T19:17:43.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:43 smithi022 ceph-mon[39439]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:43.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:43 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:43.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:43 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:43.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:43 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:17:43.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:43 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:43.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:43 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:17:43.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:43 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:43.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:43 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-01T19:17:43.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:43 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-01T19:17:43.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:43 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-01T19:17:43.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:43 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:43.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:43 smithi062 ceph-mon[44211]: Deploying daemon mgr.x on smithi062 2024-04-01T19:17:43.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:43 smithi062 ceph-mon[44211]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:43.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:43 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:43.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:43 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:43.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:43 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:17:43.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:43 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:43.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:43 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:17:43.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:43 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:43.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:43 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-01T19:17:43.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:43 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-01T19:17:43.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:43 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-01T19:17:43.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:43 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:43.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:43 smithi188 ceph-mon[43939]: Deploying daemon mgr.x on smithi062 2024-04-01T19:17:43.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:43 smithi188 ceph-mon[43939]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:43.967 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:17:44.762 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:44 smithi062 systemd[1]: Starting Ceph mgr.x for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T19:17:45.359 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:45 smithi062 bash[45855]: edcdee8d15692df1af69a8595ba7068d5413bcb89772256fab9359322b1f8962 2024-04-01T19:17:45.359 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:45 smithi062 systemd[1]: Started Ceph mgr.x for 09f6b846-f05c-11ee-b647-cb9ed24678a4. 2024-04-01T19:17:45.359 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:45 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x[45870]: 2024-04-01T19:17:45.172+0000 7f00ed65b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-01T19:17:45.359 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:45 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x[45870]: 2024-04-01T19:17:45.359+0000 7f00ed65b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-01T19:17:45.985 INFO:teuthology.orchestra.run.smithi022.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-01T19:17:45.986 INFO:teuthology.orchestra.run.smithi022.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-01T19:17:45.986 INFO:teuthology.orchestra.run.smithi022.stderr: stderr: 10+0 records in 2024-04-01T19:17:45.986 INFO:teuthology.orchestra.run.smithi022.stderr:10+0 records out 2024-04-01T19:17:45.986 INFO:teuthology.orchestra.run.smithi022.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00806502 s, 1.3 GB/s 2024-04-01T19:17:45.986 INFO:teuthology.orchestra.run.smithi022.stderr:--> Zapping successful for: 2024-04-01T19:17:46.011 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:45 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x[45870]: 2024-04-01T19:17:45.716+0000 7f00ed65b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-01T19:17:46.299 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:46 smithi022 ceph-mon[39439]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:46.299 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:46.299 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:46.299 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:46.300 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:46.300 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:17:46.300 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:46.511 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:46 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x[45870]: 2024-04-01T19:17:46.263+0000 7f00ed65b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-01T19:17:46.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:46 smithi062 ceph-mon[44211]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:46.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:46 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:46.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:46 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:46.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:46 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:46.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:46 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:46.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:46 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:17:46.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:46 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:46.566 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi022:vg_nvme/lv_4 2024-04-01T19:17:46.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:46 smithi188 ceph-mon[43939]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:46.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:46 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:46.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:46 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:46.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:46 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:46.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:46 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:46.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:46 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:17:46.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:46 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:46.879 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:17:46.979 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:46 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x[45870]: 2024-04-01T19:17:46.523+0000 7f00ed65b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-01T19:17:47.261 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:46 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x[45870]: 2024-04-01T19:17:46.980+0000 7f00ed65b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-01T19:17:47.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:47 smithi022 ceph-mon[39439]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:47.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:47.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:47.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:47.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:17:47.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:47.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:17:47.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:47.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:17:47.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:47.824 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:47 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x[45870]: 2024-04-01T19:17:47.735+0000 7f00ed65b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-01T19:17:47.825 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:47 smithi062 ceph-mon[44211]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:47.825 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:47.825 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:47.825 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:47.825 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:17:47.825 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:47.825 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:17:47.825 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:47.825 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:17:47.825 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:47.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:47 smithi188 ceph-mon[43939]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:47.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:47.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:47.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:47.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:17:47.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:47.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:17:47.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:47.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:17:47.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:17:48.261 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:47 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x[45870]: 2024-04-01T19:17:47.825+0000 7f00ed65b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-01T19:17:48.761 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:48 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x[45870]: 2024-04-01T19:17:48.453+0000 7f00ed65b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-01T19:17:48.762 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:48 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x[45870]: 2024-04-01T19:17:48.541+0000 7f00ed65b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-01T19:17:48.762 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:48 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x[45870]: 2024-04-01T19:17:48.632+0000 7f00ed65b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-01T19:17:49.261 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:48 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x[45870]: 2024-04-01T19:17:48.872+0000 7f00ed65b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-01T19:17:49.262 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:48 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x[45870]: 2024-04-01T19:17:48.967+0000 7f00ed65b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-01T19:17:49.262 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:49 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x[45870]: 2024-04-01T19:17:49.064+0000 7f00ed65b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-01T19:17:49.573 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:49 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x[45870]: 2024-04-01T19:17:49.306+0000 7f00ed65b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-01T19:17:49.573 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:49 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x[45870]: 2024-04-01T19:17:49.406+0000 7f00ed65b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-01T19:17:49.861 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:49 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x[45870]: 2024-04-01T19:17:49.599+0000 7f00ed65b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-01T19:17:49.862 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:49 smithi062 ceph-mon[44211]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:49.862 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:49 smithi062 ceph-mon[44211]: from='client.14220 v1:172.21.15.22:0/3088502255' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:17:49.862 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:49 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:17:49.862 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:49 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:17:49.862 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:49 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:49.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:49 smithi022 ceph-mon[39439]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:49.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:49 smithi022 ceph-mon[39439]: from='client.14220 v1:172.21.15.22:0/3088502255' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:17:49.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:49 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:17:49.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:49 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:17:49.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:49 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:49.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:49 smithi188 ceph-mon[43939]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:49.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:49 smithi188 ceph-mon[43939]: from='client.14220 v1:172.21.15.22:0/3088502255' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:17:49.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:49 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:17:49.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:49 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:17:49.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:49 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:50.261 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:49 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x[45870]: 2024-04-01T19:17:49.862+0000 7f00ed65b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-01T19:17:50.762 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:50 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x[45870]: 2024-04-01T19:17:50.476+0000 7f00ed65b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-01T19:17:50.762 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:50 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x[45870]: 2024-04-01T19:17:50.696+0000 7f00ed65b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-01T19:17:51.261 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:50 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x[45870]: 2024-04-01T19:17:50.899+0000 7f00ed65b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-01T19:17:51.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:51 smithi022 ceph-mon[39439]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:51.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:51 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3990061301' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfd4aa7e-a933-42e2-aac8-f93a3d9fcc3d"}]: dispatch 2024-04-01T19:17:51.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:51 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3990061301' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cfd4aa7e-a933-42e2-aac8-f93a3d9fcc3d"}]': finished 2024-04-01T19:17:51.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:51 smithi022 ceph-mon[39439]: osdmap e5: 1 total, 0 up, 1 in 2024-04-01T19:17:51.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:51 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T19:17:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:51 smithi188 ceph-mon[43939]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:51 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3990061301' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfd4aa7e-a933-42e2-aac8-f93a3d9fcc3d"}]: dispatch 2024-04-01T19:17:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:51 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3990061301' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cfd4aa7e-a933-42e2-aac8-f93a3d9fcc3d"}]': finished 2024-04-01T19:17:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:51 smithi188 ceph-mon[43939]: osdmap e5: 1 total, 0 up, 1 in 2024-04-01T19:17:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:51 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T19:17:51.988 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:51 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x[45870]: 2024-04-01T19:17:51.593+0000 7f00ed65b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-01T19:17:51.988 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:51 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x[45870]: 2024-04-01T19:17:51.800+0000 7f00ed65b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-01T19:17:51.989 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:51 smithi062 ceph-mon[44211]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:51.989 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:51 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3990061301' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfd4aa7e-a933-42e2-aac8-f93a3d9fcc3d"}]: dispatch 2024-04-01T19:17:51.989 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:51 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3990061301' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cfd4aa7e-a933-42e2-aac8-f93a3d9fcc3d"}]': finished 2024-04-01T19:17:51.989 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:51 smithi062 ceph-mon[44211]: osdmap e5: 1 total, 0 up, 1 in 2024-04-01T19:17:51.989 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:51 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T19:17:52.262 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:51 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x[45870]: 2024-04-01T19:17:51.989+0000 7f00ed65b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-01T19:17:52.262 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 19:17:52 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x[45870]: 2024-04-01T19:17:52.108+0000 7f00ed65b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-01T19:17:52.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:52 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3133063240' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:17:52.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:52 smithi022 ceph-mon[39439]: Standby manager daemon x started 2024-04-01T19:17:52.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:52 smithi022 ceph-mon[39439]: from='mgr.? v1:172.21.15.62:0/508673620' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-04-01T19:17:52.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:52 smithi022 ceph-mon[39439]: from='mgr.? v1:172.21.15.62:0/508673620' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-01T19:17:52.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:52 smithi022 ceph-mon[39439]: from='mgr.? v1:172.21.15.62:0/508673620' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-04-01T19:17:52.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:52 smithi022 ceph-mon[39439]: from='mgr.? v1:172.21.15.62:0/508673620' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-01T19:17:52.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:52 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3133063240' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:17:52.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:52 smithi188 ceph-mon[43939]: Standby manager daemon x started 2024-04-01T19:17:52.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:52 smithi188 ceph-mon[43939]: from='mgr.? v1:172.21.15.62:0/508673620' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-04-01T19:17:52.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:52 smithi188 ceph-mon[43939]: from='mgr.? v1:172.21.15.62:0/508673620' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-01T19:17:52.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:52 smithi188 ceph-mon[43939]: from='mgr.? v1:172.21.15.62:0/508673620' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-04-01T19:17:52.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:52 smithi188 ceph-mon[43939]: from='mgr.? v1:172.21.15.62:0/508673620' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-01T19:17:53.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:52 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3133063240' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:17:53.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:52 smithi062 ceph-mon[44211]: Standby manager daemon x started 2024-04-01T19:17:53.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:52 smithi062 ceph-mon[44211]: from='mgr.? v1:172.21.15.62:0/508673620' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-04-01T19:17:53.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:52 smithi062 ceph-mon[44211]: from='mgr.? v1:172.21.15.62:0/508673620' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-01T19:17:53.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:52 smithi062 ceph-mon[44211]: from='mgr.? v1:172.21.15.62:0/508673620' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-04-01T19:17:53.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:52 smithi062 ceph-mon[44211]: from='mgr.? v1:172.21.15.62:0/508673620' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-01T19:17:53.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:53 smithi022 ceph-mon[39439]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:53.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:53 smithi022 ceph-mon[39439]: mgrmap e14: y(active, since 82s), standbys: x 2024-04-01T19:17:53.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:53 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-01T19:17:53.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:53 smithi188 ceph-mon[43939]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:53.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:53 smithi188 ceph-mon[43939]: mgrmap e14: y(active, since 82s), standbys: x 2024-04-01T19:17:53.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:53 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-01T19:17:54.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:53 smithi062 ceph-mon[44211]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:54.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:53 smithi062 ceph-mon[44211]: mgrmap e14: y(active, since 82s), standbys: x 2024-04-01T19:17:54.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:53 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-01T19:17:55.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:55 smithi022 ceph-mon[39439]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:55.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:55 smithi188 ceph-mon[43939]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:56.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:55 smithi062 ceph-mon[44211]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:57.704 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:57 smithi022 ceph-mon[39439]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:57.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:57 smithi188 ceph-mon[43939]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:58.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:57 smithi062 ceph-mon[44211]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:58.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:58 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-01T19:17:58.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:58 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:58.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:58 smithi022 ceph-mon[39439]: Deploying daemon osd.0 on smithi022 2024-04-01T19:17:58.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:58 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-01T19:17:58.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:58 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:58.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:58 smithi188 ceph-mon[43939]: Deploying daemon osd.0 on smithi022 2024-04-01T19:17:59.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:58 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-01T19:17:59.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:58 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:17:59.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:58 smithi062 ceph-mon[44211]: Deploying daemon osd.0 on smithi022 2024-04-01T19:17:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:17:59 smithi022 ceph-mon[39439]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:17:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:17:59 smithi188 ceph-mon[43939]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:18:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:17:59 smithi062 ceph-mon[44211]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:18:01.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:01 smithi022 ceph-mon[39439]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:18:01.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:01 smithi188 ceph-mon[43939]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:18:02.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:01 smithi062 ceph-mon[44211]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:18:03.826 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:03 smithi022 ceph-mon[39439]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:18:03.826 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:03 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:03.826 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:03 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:03.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:03 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:18:04.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:03 smithi062 ceph-mon[44211]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:18:04.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:03 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:04.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:03 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:04.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:03 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:18:04.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:03 smithi188 ceph-mon[43939]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:18:04.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:03 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:04.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:03 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:04.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:03 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:18:05.714 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:05 smithi022 ceph-mon[39439]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:18:06.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:05 smithi062 ceph-mon[44211]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:18:06.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:05 smithi188 ceph-mon[43939]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:18:06.898 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 0 on host 'smithi022' 2024-04-01T19:18:06.925 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:06 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:06.925 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:06 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:06.925 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:06 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:06.925 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:06 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:18:06.925 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:06 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:06.925 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:06 smithi022 ceph-mon[39439]: from='osd.0 v1:172.21.15.22:6801/1419201649' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-01T19:18:07.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:06 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:07.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:06 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:07.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:06 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:07.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:06 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:18:07.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:06 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:07.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:06 smithi188 ceph-mon[43939]: from='osd.0 v1:172.21.15.22:6801/1419201649' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-01T19:18:07.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:06 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:07.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:06 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:07.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:06 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:07.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:06 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:18:07.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:06 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:07.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:06 smithi062 ceph-mon[44211]: from='osd.0 v1:172.21.15.22:6801/1419201649' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-01T19:18:07.691 DEBUG:teuthology.orchestra.run.smithi022:osd.0> sudo journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.0.service 2024-04-01T19:18:07.693 INFO:tasks.cephadm:Deploying osd.1 on smithi022 with /dev/vg_nvme/lv_3... 2024-04-01T19:18:07.693 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-01T19:18:07.723 INFO:journalctl@ceph.osd.0.smithi022.stdout:-- Logs begin at Mon 2024-04-01 19:04:04 UTC. -- 2024-04-01T19:18:07.917 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:07 smithi022 ceph-mon[39439]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:18:07.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:07 smithi022 ceph-mon[39439]: from='osd.0 v1:172.21.15.22:6801/1419201649' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-01T19:18:07.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:07 smithi022 ceph-mon[39439]: osdmap e6: 1 total, 0 up, 1 in 2024-04-01T19:18:07.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:07 smithi022 ceph-mon[39439]: from='osd.0 v1:172.21.15.22:6801/1419201649' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-04-01T19:18:07.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:07 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T19:18:07.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:07 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:07.919 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:07 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:07.919 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:07 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:18:07.919 INFO:journalctl@ceph.osd.0.smithi022.stdout:Apr 01 19:18:07 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-0[58221]: 2024-04-01T19:18:07.819+0000 7f88e8594700 -1 osd.0 0 waiting for initial osdmap 2024-04-01T19:18:07.919 INFO:journalctl@ceph.osd.0.smithi022.stdout:Apr 01 19:18:07 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-0[58221]: 2024-04-01T19:18:07.821+0000 7f88e4387700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T19:18:08.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:07 smithi188 ceph-mon[43939]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:18:08.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:07 smithi188 ceph-mon[43939]: from='osd.0 v1:172.21.15.22:6801/1419201649' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-01T19:18:08.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:07 smithi188 ceph-mon[43939]: osdmap e6: 1 total, 0 up, 1 in 2024-04-01T19:18:08.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:07 smithi188 ceph-mon[43939]: from='osd.0 v1:172.21.15.22:6801/1419201649' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-04-01T19:18:08.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:07 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T19:18:08.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:07 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:08.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:07 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:08.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:07 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:18:08.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:07 smithi062 ceph-mon[44211]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:18:08.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:07 smithi062 ceph-mon[44211]: from='osd.0 v1:172.21.15.22:6801/1419201649' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-01T19:18:08.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:07 smithi062 ceph-mon[44211]: osdmap e6: 1 total, 0 up, 1 in 2024-04-01T19:18:08.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:07 smithi062 ceph-mon[44211]: from='osd.0 v1:172.21.15.22:6801/1419201649' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-04-01T19:18:08.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:07 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T19:18:08.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:07 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:08.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:07 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:08.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:07 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:18:08.800 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:18:09.074 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:08 smithi022 ceph-mon[39439]: from='osd.0 v1:172.21.15.22:6801/1419201649' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-04-01T19:18:09.074 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:08 smithi022 ceph-mon[39439]: osdmap e7: 1 total, 0 up, 1 in 2024-04-01T19:18:09.074 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:08 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T19:18:09.074 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:08 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T19:18:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:08 smithi188 ceph-mon[43939]: from='osd.0 v1:172.21.15.22:6801/1419201649' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-04-01T19:18:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:08 smithi188 ceph-mon[43939]: osdmap e7: 1 total, 0 up, 1 in 2024-04-01T19:18:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:08 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T19:18:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:08 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T19:18:09.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:08 smithi062 ceph-mon[44211]: from='osd.0 v1:172.21.15.22:6801/1419201649' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-04-01T19:18:09.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:08 smithi062 ceph-mon[44211]: osdmap e7: 1 total, 0 up, 1 in 2024-04-01T19:18:09.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:08 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T19:18:09.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:08 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T19:18:10.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:09 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:18:10.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:09 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:18:10.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:18:10.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:09 smithi022 ceph-mon[39439]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:18:10.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:09 smithi022 ceph-mon[39439]: osd.0 v1:172.21.15.22:6801/1419201649 boot 2024-04-01T19:18:10.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:09 smithi022 ceph-mon[39439]: osdmap e8: 1 total, 1 up, 1 in 2024-04-01T19:18:10.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:09 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T19:18:10.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:09 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:18:10.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:09 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:18:10.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:18:10.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:09 smithi188 ceph-mon[43939]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:18:10.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:09 smithi188 ceph-mon[43939]: osd.0 v1:172.21.15.22:6801/1419201649 boot 2024-04-01T19:18:10.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:09 smithi188 ceph-mon[43939]: osdmap e8: 1 total, 1 up, 1 in 2024-04-01T19:18:10.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:09 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T19:18:10.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:09 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:18:10.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:09 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:18:10.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:18:10.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:09 smithi062 ceph-mon[44211]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T19:18:10.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:09 smithi062 ceph-mon[44211]: osd.0 v1:172.21.15.22:6801/1419201649 boot 2024-04-01T19:18:10.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:09 smithi062 ceph-mon[44211]: osdmap e8: 1 total, 1 up, 1 in 2024-04-01T19:18:10.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:09 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T19:18:11.108 INFO:teuthology.orchestra.run.smithi022.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-01T19:18:11.109 INFO:teuthology.orchestra.run.smithi022.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-01T19:18:11.109 INFO:teuthology.orchestra.run.smithi022.stderr: stderr: 10+0 records in 2024-04-01T19:18:11.109 INFO:teuthology.orchestra.run.smithi022.stderr:10+0 records out 2024-04-01T19:18:11.109 INFO:teuthology.orchestra.run.smithi022.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00864353 s, 1.2 GB/s 2024-04-01T19:18:11.109 INFO:teuthology.orchestra.run.smithi022.stderr:--> Zapping successful for: 2024-04-01T19:18:11.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:11 smithi022 ceph-mon[39439]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:11.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:11 smithi022 ceph-mon[39439]: osdmap e9: 1 total, 1 up, 1 in 2024-04-01T19:18:11.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:11 smithi188 ceph-mon[43939]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:11.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:11 smithi188 ceph-mon[43939]: osdmap e9: 1 total, 1 up, 1 in 2024-04-01T19:18:12.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:11 smithi062 ceph-mon[44211]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:12.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:11 smithi062 ceph-mon[44211]: osdmap e9: 1 total, 1 up, 1 in 2024-04-01T19:18:12.518 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi022:vg_nvme/lv_3 2024-04-01T19:18:12.794 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:18:13.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:13 smithi022 ceph-mon[39439]: Detected new or changed devices on smithi022 2024-04-01T19:18:13.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:13 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:13.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:13 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:13.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:13 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:18:13.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:13 smithi022 ceph-mon[39439]: Adjusting osd_memory_target on smithi022 to 17126M 2024-04-01T19:18:13.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:13 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:13.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:13 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:13.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:13 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:18:13.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:13 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:13.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:13 smithi188 ceph-mon[43939]: Detected new or changed devices on smithi022 2024-04-01T19:18:13.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:13 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:13.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:13 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:13.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:13 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:18:13.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:13 smithi188 ceph-mon[43939]: Adjusting osd_memory_target on smithi022 to 17126M 2024-04-01T19:18:13.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:13 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:13.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:13 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:13.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:13 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:18:13.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:13 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:13.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:13 smithi062 ceph-mon[44211]: Detected new or changed devices on smithi022 2024-04-01T19:18:13.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:13 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:13.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:13 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:13.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:13 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:18:13.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:13 smithi062 ceph-mon[44211]: Adjusting osd_memory_target on smithi022 to 17126M 2024-04-01T19:18:13.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:13 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:13.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:13 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:13.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:13 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:18:13.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:13 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:14.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:14 smithi022 ceph-mon[39439]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:14.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:14 smithi188 ceph-mon[43939]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:14.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:14 smithi062 ceph-mon[44211]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:15.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:15 smithi022 ceph-mon[39439]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:15.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:15 smithi022 ceph-mon[39439]: from='client.14247 v1:172.21.15.22:0/21103893' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:18:15.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:15 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:18:15.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:15 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:18:15.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:15 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:15 smithi188 ceph-mon[43939]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:15 smithi188 ceph-mon[43939]: from='client.14247 v1:172.21.15.22:0/21103893' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:18:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:15 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:18:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:15 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:18:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:15 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:16.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:15 smithi062 ceph-mon[44211]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:16.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:15 smithi062 ceph-mon[44211]: from='client.14247 v1:172.21.15.22:0/21103893' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:18:16.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:15 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:18:16.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:15 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:18:16.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:15 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:17.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:17 smithi022 ceph-mon[39439]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:17.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:17 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/34654420' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6ddadf19-2b4e-4c01-8918-9d51c323925b"}]: dispatch 2024-04-01T19:18:17.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:17 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/34654420' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6ddadf19-2b4e-4c01-8918-9d51c323925b"}]': finished 2024-04-01T19:18:17.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:17 smithi022 ceph-mon[39439]: osdmap e10: 2 total, 1 up, 2 in 2024-04-01T19:18:17.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:17 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T19:18:17.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:17 smithi188 ceph-mon[43939]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:17.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:17 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/34654420' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6ddadf19-2b4e-4c01-8918-9d51c323925b"}]: dispatch 2024-04-01T19:18:17.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:17 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/34654420' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6ddadf19-2b4e-4c01-8918-9d51c323925b"}]': finished 2024-04-01T19:18:17.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:17 smithi188 ceph-mon[43939]: osdmap e10: 2 total, 1 up, 2 in 2024-04-01T19:18:17.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:17 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T19:18:18.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:17 smithi062 ceph-mon[44211]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:18.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:17 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/34654420' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6ddadf19-2b4e-4c01-8918-9d51c323925b"}]: dispatch 2024-04-01T19:18:18.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:17 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/34654420' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6ddadf19-2b4e-4c01-8918-9d51c323925b"}]': finished 2024-04-01T19:18:18.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:17 smithi062 ceph-mon[44211]: osdmap e10: 2 total, 1 up, 2 in 2024-04-01T19:18:18.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:17 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T19:18:18.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:18 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/561200803' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:18:19.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:18 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/561200803' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:18:19.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:18 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/561200803' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:18:19.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:19 smithi188 ceph-mon[43939]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:20.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:19 smithi062 ceph-mon[44211]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:20.090 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:19 smithi022 ceph-mon[39439]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:21 smithi188 ceph-mon[43939]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:21.962 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:21 smithi022 ceph-mon[39439]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:22.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:21 smithi062 ceph-mon[44211]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:23.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:23 smithi188 ceph-mon[43939]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:23.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:23 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-01T19:18:23.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:23 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:23.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:23 smithi188 ceph-mon[43939]: Deploying daemon osd.1 on smithi022 2024-04-01T19:18:23.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:23 smithi022 ceph-mon[39439]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:23.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:23 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-01T19:18:23.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:23 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:23.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:23 smithi022 ceph-mon[39439]: Deploying daemon osd.1 on smithi022 2024-04-01T19:18:24.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:23 smithi062 ceph-mon[44211]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:24.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:23 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-01T19:18:24.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:23 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:24.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:23 smithi062 ceph-mon[44211]: Deploying daemon osd.1 on smithi022 2024-04-01T19:18:25.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:25 smithi022 ceph-mon[39439]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:26.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:25 smithi062 ceph-mon[44211]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:26.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:25 smithi188 ceph-mon[43939]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:27.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:27 smithi022 ceph-mon[39439]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:28.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:27 smithi062 ceph-mon[44211]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:28.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:27 smithi188 ceph-mon[43939]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:29 smithi062 ceph-mon[44211]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:29 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:29 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:29 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:18:30.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:29 smithi022 ceph-mon[39439]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:30.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:29 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:30.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:29 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:30.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:29 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:18:30.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:29 smithi188 ceph-mon[43939]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:30.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:29 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:30.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:29 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:30.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:29 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:18:32.465 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:32 smithi022 ceph-mon[39439]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:32.465 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:32.465 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:32.465 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:32.465 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:18:32.465 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:32.465 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:32 smithi022 ceph-mon[39439]: from='osd.1 v1:172.21.15.22:6805/2579227110' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-01T19:18:32.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:32 smithi062 ceph-mon[44211]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:32.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:32.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:32.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:32.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:18:32.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:32.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:32 smithi062 ceph-mon[44211]: from='osd.1 v1:172.21.15.22:6805/2579227110' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-01T19:18:32.532 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 1 on host 'smithi022' 2024-04-01T19:18:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:32 smithi188 ceph-mon[43939]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:18:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:32 smithi188 ceph-mon[43939]: from='osd.1 v1:172.21.15.22:6805/2579227110' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-01T19:18:33.270 DEBUG:teuthology.orchestra.run.smithi022:osd.1> sudo journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.1.service 2024-04-01T19:18:33.273 INFO:tasks.cephadm:Deploying osd.2 on smithi022 with /dev/vg_nvme/lv_2... 2024-04-01T19:18:33.273 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-01T19:18:33.307 INFO:journalctl@ceph.osd.1.smithi022.stdout:-- Logs begin at Mon 2024-04-01 19:04:04 UTC. -- 2024-04-01T19:18:33.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:18:33.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:18:33.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:18:33.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:33 smithi062 ceph-mon[44211]: from='osd.1 v1:172.21.15.22:6805/2579227110' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-01T19:18:33.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:33 smithi062 ceph-mon[44211]: osdmap e11: 2 total, 1 up, 2 in 2024-04-01T19:18:33.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:33 smithi062 ceph-mon[44211]: from='osd.1 v1:172.21.15.22:6805/2579227110' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-04-01T19:18:33.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T19:18:33.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:18:33.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:18:33.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:18:33.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:18:33.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:18:33.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:18:33.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:18:33.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:33.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:18:33.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:33.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:18:33.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:33.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:18:33.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:33.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:33.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:33.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:18:33.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:18:33.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:18:33.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:18:33.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:33 smithi022 ceph-mon[39439]: from='osd.1 v1:172.21.15.22:6805/2579227110' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-01T19:18:33.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:33 smithi022 ceph-mon[39439]: osdmap e11: 2 total, 1 up, 2 in 2024-04-01T19:18:33.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:33 smithi022 ceph-mon[39439]: from='osd.1 v1:172.21.15.22:6805/2579227110' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-04-01T19:18:33.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T19:18:33.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:18:33.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:18:33.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:18:33.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:18:33.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:18:33.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:18:33.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:18:33.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:33.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:18:33.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:33.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:18:33.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:33.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:18:33.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:33.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:33.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:33.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:18:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:18:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:18:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:18:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:33 smithi188 ceph-mon[43939]: from='osd.1 v1:172.21.15.22:6805/2579227110' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-01T19:18:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:33 smithi188 ceph-mon[43939]: osdmap e11: 2 total, 1 up, 2 in 2024-04-01T19:18:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:33 smithi188 ceph-mon[43939]: from='osd.1 v1:172.21.15.22:6805/2579227110' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-04-01T19:18:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T19:18:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:18:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:18:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:18:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:18:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:18:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:18:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:18:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:18:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:18:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:18:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:18:34.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:34 smithi022 ceph-mon[39439]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:34.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:34 smithi022 ceph-mon[39439]: from='osd.1 v1:172.21.15.22:6805/2579227110' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-04-01T19:18:34.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:34 smithi022 ceph-mon[39439]: osdmap e12: 2 total, 1 up, 2 in 2024-04-01T19:18:34.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:34 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T19:18:34.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:34 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T19:18:34.428 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:18:34.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:34 smithi062 ceph-mon[44211]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:34.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:34 smithi062 ceph-mon[44211]: from='osd.1 v1:172.21.15.22:6805/2579227110' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-04-01T19:18:34.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:34 smithi062 ceph-mon[44211]: osdmap e12: 2 total, 1 up, 2 in 2024-04-01T19:18:34.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:34 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T19:18:34.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:34 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T19:18:34.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:34 smithi188 ceph-mon[43939]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T19:18:34.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:34 smithi188 ceph-mon[43939]: from='osd.1 v1:172.21.15.22:6805/2579227110' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-04-01T19:18:34.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:34 smithi188 ceph-mon[43939]: osdmap e12: 2 total, 1 up, 2 in 2024-04-01T19:18:34.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:34 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T19:18:34.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:34 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T19:18:35.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:35 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:18:35.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:35 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:18:35.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:18:35.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:35 smithi022 ceph-mon[39439]: osd.1 v1:172.21.15.22:6805/2579227110 boot 2024-04-01T19:18:35.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:35 smithi022 ceph-mon[39439]: osdmap e13: 2 total, 2 up, 2 in 2024-04-01T19:18:35.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T19:18:35.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:18:35.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:35 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:18:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:35 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:18:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:18:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:35 smithi062 ceph-mon[44211]: osd.1 v1:172.21.15.22:6805/2579227110 boot 2024-04-01T19:18:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:35 smithi062 ceph-mon[44211]: osdmap e13: 2 total, 2 up, 2 in 2024-04-01T19:18:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T19:18:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:18:35.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:35 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:18:35.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:35 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:18:35.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:18:35.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:35 smithi188 ceph-mon[43939]: osd.1 v1:172.21.15.22:6805/2579227110 boot 2024-04-01T19:18:35.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:35 smithi188 ceph-mon[43939]: osdmap e13: 2 total, 2 up, 2 in 2024-04-01T19:18:35.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T19:18:35.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:18:36.506 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:36 smithi188 ceph-mon[43939]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:36.506 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:36 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-01T19:18:36.507 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:36 smithi188 ceph-mon[43939]: osdmap e14: 2 total, 2 up, 2 in 2024-04-01T19:18:36.507 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:36 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:18:36.507 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:36 smithi188 sudo[46331]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-01T19:18:36.507 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:36 smithi188 sudo[46331]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-01T19:18:36.507 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:36 smithi188 sudo[46331]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-01T19:18:36.507 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:36 smithi188 sudo[46331]: pam_unix(sudo:session): session closed for user root 2024-04-01T19:18:36.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:36 smithi062 ceph-mon[44211]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:36.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:36 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-01T19:18:36.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:36 smithi062 ceph-mon[44211]: osdmap e14: 2 total, 2 up, 2 in 2024-04-01T19:18:36.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:36 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:18:36.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:36 smithi022 ceph-mon[39439]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:36.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:36 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-01T19:18:36.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:36 smithi022 ceph-mon[39439]: osdmap e14: 2 total, 2 up, 2 in 2024-04-01T19:18:36.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:36 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:18:36.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:36 smithi022 sudo[70485]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-01T19:18:36.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:36 smithi022 sudo[70485]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-01T19:18:36.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:36 smithi022 sudo[70485]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-01T19:18:36.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:36 smithi022 sudo[70485]: pam_unix(sudo:session): session closed for user root 2024-04-01T19:18:36.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:36 smithi022 sudo[70497]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-01T19:18:36.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:36 smithi022 sudo[70497]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-01T19:18:36.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:36 smithi022 sudo[70497]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-01T19:18:36.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:36 smithi022 sudo[70497]: pam_unix(sudo:session): session closed for user root 2024-04-01T19:18:36.614 INFO:journalctl@ceph.osd.0.smithi022.stdout:Apr 01 19:18:36 smithi022 sudo[70463]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-01T19:18:36.614 INFO:journalctl@ceph.osd.0.smithi022.stdout:Apr 01 19:18:36 smithi022 sudo[70463]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-01T19:18:36.614 INFO:journalctl@ceph.osd.0.smithi022.stdout:Apr 01 19:18:36 smithi022 sudo[70463]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-01T19:18:36.614 INFO:journalctl@ceph.osd.0.smithi022.stdout:Apr 01 19:18:36 smithi022 sudo[70463]: pam_unix(sudo:session): session closed for user root 2024-04-01T19:18:36.614 INFO:journalctl@ceph.osd.0.smithi022.stdout:Apr 01 19:18:36 smithi022 sudo[70466]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-01T19:18:36.614 INFO:journalctl@ceph.osd.0.smithi022.stdout:Apr 01 19:18:36 smithi022 sudo[70466]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-01T19:18:36.614 INFO:journalctl@ceph.osd.0.smithi022.stdout:Apr 01 19:18:36 smithi022 sudo[70466]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-01T19:18:36.615 INFO:journalctl@ceph.osd.0.smithi022.stdout:Apr 01 19:18:36 smithi022 sudo[70466]: pam_unix(sudo:session): session closed for user root 2024-04-01T19:18:36.615 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:18:36 smithi022 sudo[70469]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-01T19:18:36.615 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:18:36 smithi022 sudo[70469]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-01T19:18:36.615 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:18:36 smithi022 sudo[70469]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-01T19:18:36.615 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:18:36 smithi022 sudo[70469]: pam_unix(sudo:session): session closed for user root 2024-04-01T19:18:36.615 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:18:36 smithi022 sudo[70481]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-01T19:18:36.615 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:18:36 smithi022 sudo[70481]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-01T19:18:36.615 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:18:36 smithi022 sudo[70481]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-01T19:18:36.615 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:18:36 smithi022 sudo[70481]: pam_unix(sudo:session): session closed for user root 2024-04-01T19:18:36.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:36 smithi188 sudo[46334]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-01T19:18:36.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:36 smithi188 sudo[46334]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-01T19:18:36.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:36 smithi188 sudo[46334]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-01T19:18:36.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:36 smithi188 sudo[46334]: pam_unix(sudo:session): session closed for user root 2024-04-01T19:18:37.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:36 smithi062 sudo[46619]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-01T19:18:37.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:36 smithi062 sudo[46619]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-01T19:18:37.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:36 smithi062 sudo[46619]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-01T19:18:37.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:36 smithi062 sudo[46619]: pam_unix(sudo:session): session closed for user root 2024-04-01T19:18:37.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:36 smithi062 sudo[46622]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-01T19:18:37.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:36 smithi062 sudo[46622]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-01T19:18:37.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:36 smithi062 sudo[46622]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-01T19:18:37.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:36 smithi062 sudo[46622]: pam_unix(sudo:session): session closed for user root 2024-04-01T19:18:37.032 INFO:teuthology.orchestra.run.smithi022.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-01T19:18:37.032 INFO:teuthology.orchestra.run.smithi022.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-01T19:18:37.032 INFO:teuthology.orchestra.run.smithi022.stderr: stderr: 10+0 records in 2024-04-01T19:18:37.032 INFO:teuthology.orchestra.run.smithi022.stderr:10+0 records out 2024-04-01T19:18:37.032 INFO:teuthology.orchestra.run.smithi022.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00801581 s, 1.3 GB/s 2024-04-01T19:18:37.032 INFO:teuthology.orchestra.run.smithi022.stderr:--> Zapping successful for: 2024-04-01T19:18:37.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:18:37.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: osdmap e15: 2 total, 2 up, 2 in 2024-04-01T19:18:37.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:37.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:18:37.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:18:37.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:18:37.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-01T19:18:37.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-01T19:18:37.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:18:37.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:18:37.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-01T19:18:37.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:18:37.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-01T19:18:37.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:37.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:18:37.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:18:37.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-01T19:18:37.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:18:37.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-01T19:18:37.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:37.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:37.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:37.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:18:37.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:18:37.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:37.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:37.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:18:37.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:37.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:18:37.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: osdmap e15: 2 total, 2 up, 2 in 2024-04-01T19:18:37.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:37.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:18:37.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:18:37.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:18:37.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-01T19:18:37.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-01T19:18:37.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:18:37.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:18:37.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-01T19:18:37.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:18:37.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-01T19:18:37.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:37.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:18:37.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:18:37.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-01T19:18:37.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:18:37.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-01T19:18:37.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:37.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:37.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:37.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:18:37.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:18:37.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:37.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:37.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:18:37.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:37.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:18:37.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: osdmap e15: 2 total, 2 up, 2 in 2024-04-01T19:18:37.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:37.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:18:37.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:18:37.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:18:37.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-01T19:18:37.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-01T19:18:37.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:18:37.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:18:37.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-01T19:18:37.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:18:37.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-01T19:18:37.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:37.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:18:37.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:18:37.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-01T19:18:37.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:18:37.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-01T19:18:37.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:37.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:37.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:37.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:18:37.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:18:37.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:37.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:37.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:18:37.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:37.827 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi022:vg_nvme/lv_2 2024-04-01T19:18:38.102 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:18:38.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:38 smithi062 ceph-mon[44211]: pgmap v68: 1 pgs: 1 unknown; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:38.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:38 smithi062 ceph-mon[44211]: Detected new or changed devices on smithi022 2024-04-01T19:18:38.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:38 smithi062 ceph-mon[44211]: Adjusting osd_memory_target on smithi022 to 8563M 2024-04-01T19:18:38.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:38 smithi062 ceph-mon[44211]: osdmap e16: 2 total, 2 up, 2 in 2024-04-01T19:18:38.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:38 smithi062 ceph-mon[44211]: mgrmap e15: y(active, since 2m), standbys: x 2024-04-01T19:18:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:38 smithi022 ceph-mon[39439]: pgmap v68: 1 pgs: 1 unknown; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:38 smithi022 ceph-mon[39439]: Detected new or changed devices on smithi022 2024-04-01T19:18:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:38 smithi022 ceph-mon[39439]: Adjusting osd_memory_target on smithi022 to 8563M 2024-04-01T19:18:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:38 smithi022 ceph-mon[39439]: osdmap e16: 2 total, 2 up, 2 in 2024-04-01T19:18:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:38 smithi022 ceph-mon[39439]: mgrmap e15: y(active, since 2m), standbys: x 2024-04-01T19:18:38.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:38 smithi188 ceph-mon[43939]: pgmap v68: 1 pgs: 1 unknown; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:38.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:38 smithi188 ceph-mon[43939]: Detected new or changed devices on smithi022 2024-04-01T19:18:38.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:38 smithi188 ceph-mon[43939]: Adjusting osd_memory_target on smithi022 to 8563M 2024-04-01T19:18:38.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:38 smithi188 ceph-mon[43939]: osdmap e16: 2 total, 2 up, 2 in 2024-04-01T19:18:38.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:38 smithi188 ceph-mon[43939]: mgrmap e15: y(active, since 2m), standbys: x 2024-04-01T19:18:40.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:40 smithi022 ceph-mon[39439]: pgmap v70: 1 pgs: 1 unknown; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:40.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:40 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:18:40.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:40 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:18:40.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:40 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:40.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:40 smithi188 ceph-mon[43939]: pgmap v70: 1 pgs: 1 unknown; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:40.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:40 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:18:40.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:40 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:18:40.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:40 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:40.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:40 smithi062 ceph-mon[44211]: pgmap v70: 1 pgs: 1 unknown; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:40.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:40 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:18:40.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:40 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:18:40.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:40 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:41.522 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:41 smithi022 ceph-mon[39439]: from='client.14283 v1:172.21.15.22:0/2739774415' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:18:41.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:41 smithi188 ceph-mon[43939]: from='client.14283 v1:172.21.15.22:0/2739774415' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:18:41.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:41 smithi062 ceph-mon[44211]: from='client.14283 v1:172.21.15.22:0/2739774415' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:18:42.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:42 smithi022 ceph-mon[39439]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:42 smithi188 ceph-mon[43939]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:42.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:42 smithi062 ceph-mon[44211]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:43.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:43 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3585109597' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4af1f44c-f47c-4ce6-87ba-1aeec3960969"}]: dispatch 2024-04-01T19:18:43.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:43 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3585109597' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4af1f44c-f47c-4ce6-87ba-1aeec3960969"}]': finished 2024-04-01T19:18:43.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:43 smithi022 ceph-mon[39439]: osdmap e17: 3 total, 2 up, 3 in 2024-04-01T19:18:43.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:43 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T19:18:43.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:43 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3585109597' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4af1f44c-f47c-4ce6-87ba-1aeec3960969"}]: dispatch 2024-04-01T19:18:43.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:43 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3585109597' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4af1f44c-f47c-4ce6-87ba-1aeec3960969"}]': finished 2024-04-01T19:18:43.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:43 smithi188 ceph-mon[43939]: osdmap e17: 3 total, 2 up, 3 in 2024-04-01T19:18:43.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:43 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T19:18:43.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:43 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3585109597' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4af1f44c-f47c-4ce6-87ba-1aeec3960969"}]: dispatch 2024-04-01T19:18:43.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:43 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3585109597' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4af1f44c-f47c-4ce6-87ba-1aeec3960969"}]': finished 2024-04-01T19:18:43.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:43 smithi062 ceph-mon[44211]: osdmap e17: 3 total, 2 up, 3 in 2024-04-01T19:18:43.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:43 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T19:18:44.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:44 smithi022 ceph-mon[39439]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:44.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:44 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/984888415' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:18:44.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:44 smithi188 ceph-mon[43939]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:44.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:44 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/984888415' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:18:44.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:44 smithi062 ceph-mon[44211]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:44.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:44 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/984888415' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:18:46.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:46 smithi022 ceph-mon[39439]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:46.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:46 smithi188 ceph-mon[43939]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:46.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:46 smithi062 ceph-mon[44211]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:48.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:48 smithi022 ceph-mon[39439]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:48.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:48 smithi188 ceph-mon[43939]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:48.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:48 smithi062 ceph-mon[44211]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:49.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:49 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-01T19:18:49.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:49 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:49.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:49 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-01T19:18:49.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:49 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:49.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:49 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-01T19:18:49.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:49 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:50.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:50 smithi022 ceph-mon[39439]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:50.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:50 smithi022 ceph-mon[39439]: Deploying daemon osd.2 on smithi022 2024-04-01T19:18:50.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:50 smithi188 ceph-mon[43939]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:50.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:50 smithi188 ceph-mon[43939]: Deploying daemon osd.2 on smithi022 2024-04-01T19:18:50.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:50 smithi062 ceph-mon[44211]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:50.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:50 smithi062 ceph-mon[44211]: Deploying daemon osd.2 on smithi022 2024-04-01T19:18:52.321 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:52 smithi022 ceph-mon[39439]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:52.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:52 smithi188 ceph-mon[43939]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:52.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:52 smithi062 ceph-mon[44211]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:54.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:54 smithi022 ceph-mon[39439]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:54.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:54 smithi188 ceph-mon[43939]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:54.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:54 smithi062 ceph-mon[44211]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:55.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:55 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:55.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:55 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:55.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:55 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:18:55.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:55 smithi062 ceph-mon[44211]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:55.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:55 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:55.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:55 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:55.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:55 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:18:55.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:55 smithi022 ceph-mon[39439]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:55.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:55 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:55.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:55 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:55.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:55 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:18:55.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:55 smithi188 ceph-mon[43939]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:58.039 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 2 on host 'smithi022' 2024-04-01T19:18:58.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:58 smithi022 ceph-mon[39439]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:58.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:58 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:58.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:58 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:58.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:58 smithi022 ceph-mon[39439]: from='osd.2 v1:172.21.15.22:6809/835455757' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-01T19:18:58.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:58 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:58.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:58 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:18:58.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:58 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:58.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:58 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:58.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:58 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:18:58.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:58 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:58.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:58 smithi062 ceph-mon[44211]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:58.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:58 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:58.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:58 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:58.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:58 smithi062 ceph-mon[44211]: from='osd.2 v1:172.21.15.22:6809/835455757' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-01T19:18:58.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:58 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:58.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:58 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:18:58.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:58 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:58.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:58 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:58.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:58 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:18:58.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:58 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:58.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:58 smithi188 ceph-mon[43939]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:18:58.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:58 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:58.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:58 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:58.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:58 smithi188 ceph-mon[43939]: from='osd.2 v1:172.21.15.22:6809/835455757' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-01T19:18:58.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:58 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:18:58.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:58 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:18:58.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:58 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:58.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:58 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:58.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:58 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:18:58.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:58 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:18:58.823 DEBUG:teuthology.orchestra.run.smithi022:osd.2> sudo journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.2.service 2024-04-01T19:18:58.827 INFO:tasks.cephadm:Deploying osd.3 on smithi022 with /dev/vg_nvme/lv_1... 2024-04-01T19:18:58.827 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-01T19:18:58.861 INFO:journalctl@ceph.osd.2.smithi022.stdout:-- Logs begin at Mon 2024-04-01 19:04:04 UTC. -- 2024-04-01T19:18:59.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:59 smithi022 ceph-mon[39439]: from='osd.2 v1:172.21.15.22:6809/835455757' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-01T19:18:59.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:59 smithi022 ceph-mon[39439]: osdmap e18: 3 total, 2 up, 3 in 2024-04-01T19:18:59.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:59 smithi022 ceph-mon[39439]: from='osd.2 v1:172.21.15.22:6809/835455757' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-04-01T19:18:59.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:18:59 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T19:18:59.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:59 smithi062 ceph-mon[44211]: from='osd.2 v1:172.21.15.22:6809/835455757' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-01T19:18:59.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:59 smithi062 ceph-mon[44211]: osdmap e18: 3 total, 2 up, 3 in 2024-04-01T19:18:59.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:59 smithi062 ceph-mon[44211]: from='osd.2 v1:172.21.15.22:6809/835455757' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-04-01T19:18:59.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:18:59 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T19:18:59.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:59 smithi188 ceph-mon[43939]: from='osd.2 v1:172.21.15.22:6809/835455757' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-01T19:18:59.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:59 smithi188 ceph-mon[43939]: osdmap e18: 3 total, 2 up, 3 in 2024-04-01T19:18:59.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:59 smithi188 ceph-mon[43939]: from='osd.2 v1:172.21.15.22:6809/835455757' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-04-01T19:18:59.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:18:59 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T19:18:59.862 INFO:journalctl@ceph.osd.2.smithi022.stdout:Apr 01 19:18:59 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-2[73101]: 2024-04-01T19:18:59.494+0000 7fbcd7950700 -1 osd.2 0 waiting for initial osdmap 2024-04-01T19:18:59.862 INFO:journalctl@ceph.osd.2.smithi022.stdout:Apr 01 19:18:59 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-2[73101]: 2024-04-01T19:18:59.498+0000 7fbccf73b700 -1 osd.2 19 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T19:18:59.908 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:19:00.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:00 smithi062 ceph-mon[44211]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:19:00.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:00 smithi062 ceph-mon[44211]: from='osd.2 v1:172.21.15.22:6809/835455757' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-04-01T19:19:00.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:00 smithi062 ceph-mon[44211]: osdmap e19: 3 total, 2 up, 3 in 2024-04-01T19:19:00.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:00 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T19:19:00.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:00 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T19:19:00.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:00 smithi062 ceph-mon[44211]: from='osd.2 v1:172.21.15.22:6809/835455757' entity='osd.2' 2024-04-01T19:19:00.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:00 smithi022 ceph-mon[39439]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:19:00.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:00 smithi022 ceph-mon[39439]: from='osd.2 v1:172.21.15.22:6809/835455757' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-04-01T19:19:00.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:00 smithi022 ceph-mon[39439]: osdmap e19: 3 total, 2 up, 3 in 2024-04-01T19:19:00.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:00 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T19:19:00.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:00 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T19:19:00.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:00 smithi022 ceph-mon[39439]: from='osd.2 v1:172.21.15.22:6809/835455757' entity='osd.2' 2024-04-01T19:19:00.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:00 smithi188 ceph-mon[43939]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:19:00.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:00 smithi188 ceph-mon[43939]: from='osd.2 v1:172.21.15.22:6809/835455757' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-04-01T19:19:00.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:00 smithi188 ceph-mon[43939]: osdmap e19: 3 total, 2 up, 3 in 2024-04-01T19:19:00.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:00 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T19:19:00.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:00 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T19:19:00.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:00 smithi188 ceph-mon[43939]: from='osd.2 v1:172.21.15.22:6809/835455757' entity='osd.2' 2024-04-01T19:19:01.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:01 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:19:01.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:01 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:19:01.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:19:01.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:19:01.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:01 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T19:19:01.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:01 smithi022 ceph-mon[39439]: osd.2 v1:172.21.15.22:6809/835455757 boot 2024-04-01T19:19:01.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:01 smithi022 ceph-mon[39439]: osdmap e20: 3 total, 3 up, 3 in 2024-04-01T19:19:01.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:01 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T19:19:01.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:01 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:19:01.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:01 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:19:01.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:19:01.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:19:01.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:01 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T19:19:01.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:01 smithi062 ceph-mon[44211]: osd.2 v1:172.21.15.22:6809/835455757 boot 2024-04-01T19:19:01.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:01 smithi062 ceph-mon[44211]: osdmap e20: 3 total, 3 up, 3 in 2024-04-01T19:19:01.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:01 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T19:19:01.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:01 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:19:01.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:01 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:19:01.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:19:01.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:19:01.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:01 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T19:19:01.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:01 smithi188 ceph-mon[43939]: osd.2 v1:172.21.15.22:6809/835455757 boot 2024-04-01T19:19:01.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:01 smithi188 ceph-mon[43939]: osdmap e20: 3 total, 3 up, 3 in 2024-04-01T19:19:01.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:01 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T19:19:02.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:02 smithi062 ceph-mon[44211]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:19:02.607 INFO:teuthology.orchestra.run.smithi022.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-01T19:19:02.607 INFO:teuthology.orchestra.run.smithi022.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-01T19:19:02.607 INFO:teuthology.orchestra.run.smithi022.stderr: stderr: 10+0 records in 2024-04-01T19:19:02.607 INFO:teuthology.orchestra.run.smithi022.stderr:10+0 records out 2024-04-01T19:19:02.607 INFO:teuthology.orchestra.run.smithi022.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00835758 s, 1.3 GB/s 2024-04-01T19:19:02.607 INFO:teuthology.orchestra.run.smithi022.stderr:--> Zapping successful for: 2024-04-01T19:19:02.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:02 smithi022 ceph-mon[39439]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:19:02.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:02 smithi188 ceph-mon[43939]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2024-04-01T19:19:03.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:03 smithi062 ceph-mon[44211]: osdmap e21: 3 total, 3 up, 3 in 2024-04-01T19:19:03.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:03 smithi022 ceph-mon[39439]: osdmap e21: 3 total, 3 up, 3 in 2024-04-01T19:19:03.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:03 smithi188 ceph-mon[43939]: osdmap e21: 3 total, 3 up, 3 in 2024-04-01T19:19:03.802 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi022:vg_nvme/lv_1 2024-04-01T19:19:04.076 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:19:04.539 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:04 smithi022 ceph-mon[39439]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:04.539 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:04 smithi022 ceph-mon[39439]: Detected new or changed devices on smithi022 2024-04-01T19:19:04.539 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:04 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:04.540 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:04 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:04.540 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:04 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:19:04.540 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:04 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:19:04.540 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:04 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:19:04.540 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:04 smithi022 ceph-mon[39439]: Adjusting osd_memory_target on smithi022 to 5708M 2024-04-01T19:19:04.540 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:04 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:04.540 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:04 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:04.540 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:04 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:19:04.540 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:04 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:04.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:04 smithi188 ceph-mon[43939]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:04.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:04 smithi188 ceph-mon[43939]: Detected new or changed devices on smithi022 2024-04-01T19:19:04.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:04 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:04.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:04 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:04.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:04 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:19:04.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:04 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:19:04.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:04 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:19:04.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:04 smithi188 ceph-mon[43939]: Adjusting osd_memory_target on smithi022 to 5708M 2024-04-01T19:19:04.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:04 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:04.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:04 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:04.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:04 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:19:04.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:04 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:04.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:04 smithi062 ceph-mon[44211]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:04.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:04 smithi062 ceph-mon[44211]: Detected new or changed devices on smithi022 2024-04-01T19:19:04.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:04 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:04.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:04 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:04.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:04 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:19:04.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:04 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:19:04.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:04 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:19:04.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:04 smithi062 ceph-mon[44211]: Adjusting osd_memory_target on smithi022 to 5708M 2024-04-01T19:19:04.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:04 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:04.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:04 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:04.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:04 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:19:04.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:04 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:06.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:06 smithi022 ceph-mon[39439]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:06.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:06 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:19:06.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:06 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:19:06.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:06 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:06.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:06 smithi188 ceph-mon[43939]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:06.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:06 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:19:06.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:06 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:19:06.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:06 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:06.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:06 smithi062 ceph-mon[44211]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:06.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:06 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:19:06.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:06 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:19:06.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:06 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:07.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:07 smithi022 ceph-mon[39439]: from='client.14310 v1:172.21.15.22:0/825127618' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:19:07.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:07 smithi188 ceph-mon[43939]: from='client.14310 v1:172.21.15.22:0/825127618' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:19:07.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:07 smithi062 ceph-mon[44211]: from='client.14310 v1:172.21.15.22:0/825127618' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:19:08.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:08 smithi022 ceph-mon[39439]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:08.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:08 smithi188 ceph-mon[43939]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:08.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:08 smithi062 ceph-mon[44211]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:09.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:09 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/6487090' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c399f336-23c7-414a-822e-63793daf85c1"}]: dispatch 2024-04-01T19:19:09.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:09 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/6487090' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c399f336-23c7-414a-822e-63793daf85c1"}]': finished 2024-04-01T19:19:09.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:09 smithi022 ceph-mon[39439]: osdmap e22: 4 total, 3 up, 4 in 2024-04-01T19:19:09.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:09 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T19:19:09.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:09 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2580094435' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:19:09.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:09 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/6487090' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c399f336-23c7-414a-822e-63793daf85c1"}]: dispatch 2024-04-01T19:19:09.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:09 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/6487090' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c399f336-23c7-414a-822e-63793daf85c1"}]': finished 2024-04-01T19:19:09.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:09 smithi188 ceph-mon[43939]: osdmap e22: 4 total, 3 up, 4 in 2024-04-01T19:19:09.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:09 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T19:19:09.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:09 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2580094435' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:19:09.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:09 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/6487090' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c399f336-23c7-414a-822e-63793daf85c1"}]: dispatch 2024-04-01T19:19:09.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:09 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/6487090' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c399f336-23c7-414a-822e-63793daf85c1"}]': finished 2024-04-01T19:19:09.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:09 smithi062 ceph-mon[44211]: osdmap e22: 4 total, 3 up, 4 in 2024-04-01T19:19:09.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:09 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T19:19:09.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:09 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2580094435' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:19:10.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:10 smithi022 ceph-mon[39439]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:10.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:10 smithi188 ceph-mon[43939]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:10.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:10 smithi062 ceph-mon[44211]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:12.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:12 smithi022 ceph-mon[39439]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:12 smithi188 ceph-mon[43939]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:12.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:12 smithi062 ceph-mon[44211]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:14.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:14 smithi022 ceph-mon[39439]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:14.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:14 smithi188 ceph-mon[43939]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:14.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:14 smithi062 ceph-mon[44211]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:15.583 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:15 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-01T19:19:15.583 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:15 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:15.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:15 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-01T19:19:15.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:15 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:15.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:15 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-01T19:19:15.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:15 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:16.469 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:16 smithi022 ceph-mon[39439]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:16.469 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:16 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:19:16.469 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:16 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:19:16.469 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:16 smithi022 ceph-mon[39439]: Deploying daemon osd.3 on smithi022 2024-04-01T19:19:16.469 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:16 smithi022 ceph-mon[39439]: osdmap e23: 4 total, 3 up, 4 in 2024-04-01T19:19:16.470 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:16 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T19:19:16.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:16 smithi188 ceph-mon[43939]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:16.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:16 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:19:16.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:16 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:19:16.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:16 smithi188 ceph-mon[43939]: Deploying daemon osd.3 on smithi022 2024-04-01T19:19:16.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:16 smithi188 ceph-mon[43939]: osdmap e23: 4 total, 3 up, 4 in 2024-04-01T19:19:16.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:16 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T19:19:16.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:16 smithi062 ceph-mon[44211]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:16.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:16 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:19:16.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:16 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:19:16.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:16 smithi062 ceph-mon[44211]: Deploying daemon osd.3 on smithi022 2024-04-01T19:19:16.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:16 smithi062 ceph-mon[44211]: osdmap e23: 4 total, 3 up, 4 in 2024-04-01T19:19:16.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:16 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T19:19:18.573 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:18 smithi022 ceph-mon[39439]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:18.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:18 smithi188 ceph-mon[43939]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:18.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:18 smithi062 ceph-mon[44211]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:20.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:20 smithi022 ceph-mon[39439]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:20.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:20 smithi188 ceph-mon[43939]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:20 smithi062 ceph-mon[44211]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:21 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:21 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:19:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:21 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:19:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:21 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:21 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:19:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:21 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:21 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:19:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:21 smithi062 ceph-mon[44211]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:21.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:21 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:21.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:21 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:19:21.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:21 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:19:21.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:21 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:21.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:21 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:19:21.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:21 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:21.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:21 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:19:21.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:21 smithi022 ceph-mon[39439]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:21.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:21 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:21.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:21 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:19:21.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:21 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:19:21.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:21 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:21.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:21 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:19:21.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:21 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:21.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:21 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:19:21.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:21 smithi188 ceph-mon[43939]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:24.215 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 3 on host 'smithi022' 2024-04-01T19:19:24.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:24 smithi062 ceph-mon[44211]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:24.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:24.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:24.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:24.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:19:24.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:24.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:19:24.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:24.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:19:24.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:24.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:24 smithi062 ceph-mon[44211]: from='osd.3 v1:172.21.15.22:6813/90988887' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-01T19:19:24.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:24.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:24.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:19:24.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:24 smithi022 ceph-mon[39439]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:24.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:24.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:24.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:24.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:19:24.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:24.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:19:24.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:24.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:19:24.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:24.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:24 smithi022 ceph-mon[39439]: from='osd.3 v1:172.21.15.22:6813/90988887' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-01T19:19:24.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:24.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:24.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:19:24.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:24 smithi188 ceph-mon[43939]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:24.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:24.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:24.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:24.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:19:24.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:24.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:19:24.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:24.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:19:24.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:24.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:24 smithi188 ceph-mon[43939]: from='osd.3 v1:172.21.15.22:6813/90988887' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-01T19:19:24.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:24.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:24.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:19:25.045 DEBUG:teuthology.orchestra.run.smithi022:osd.3> sudo journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.3.service 2024-04-01T19:19:25.048 INFO:tasks.cephadm:Deploying osd.4 on smithi062 with /dev/vg_nvme/lv_4... 2024-04-01T19:19:25.048 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-01T19:19:25.082 INFO:journalctl@ceph.osd.3.smithi022.stdout:-- Logs begin at Mon 2024-04-01 19:04:04 UTC. -- 2024-04-01T19:19:25.330 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:19:25.547 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 19:19:25 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-3[80363]: 2024-04-01T19:19:25.444+0000 7f79ca5ff700 -1 osd.3 0 waiting for initial osdmap 2024-04-01T19:19:25.547 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 19:19:25 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-3[80363]: 2024-04-01T19:19:25.448+0000 7f79c63f2700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T19:19:25.548 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:25 smithi022 ceph-mon[39439]: from='osd.3 v1:172.21.15.22:6813/90988887' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-01T19:19:25.548 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:25 smithi022 ceph-mon[39439]: osdmap e24: 4 total, 3 up, 4 in 2024-04-01T19:19:25.548 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:25 smithi022 ceph-mon[39439]: from='osd.3 v1:172.21.15.22:6813/90988887' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-04-01T19:19:25.548 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:25 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T19:19:25.548 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:25 smithi022 ceph-mon[39439]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:25.746 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:25 smithi062 ceph-mon[44211]: from='osd.3 v1:172.21.15.22:6813/90988887' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-01T19:19:25.746 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:25 smithi062 ceph-mon[44211]: osdmap e24: 4 total, 3 up, 4 in 2024-04-01T19:19:25.746 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:25 smithi062 ceph-mon[44211]: from='osd.3 v1:172.21.15.22:6813/90988887' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-04-01T19:19:25.746 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:25 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T19:19:25.746 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:25 smithi062 ceph-mon[44211]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:25.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:25 smithi188 ceph-mon[43939]: from='osd.3 v1:172.21.15.22:6813/90988887' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-01T19:19:25.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:25 smithi188 ceph-mon[43939]: osdmap e24: 4 total, 3 up, 4 in 2024-04-01T19:19:25.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:25 smithi188 ceph-mon[43939]: from='osd.3 v1:172.21.15.22:6813/90988887' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-04-01T19:19:25.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:25 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T19:19:25.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:25 smithi188 ceph-mon[43939]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:26.575 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:26 smithi062 ceph-mon[44211]: from='osd.3 v1:172.21.15.22:6813/90988887' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-04-01T19:19:26.575 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:26 smithi062 ceph-mon[44211]: osdmap e25: 4 total, 3 up, 4 in 2024-04-01T19:19:26.576 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:26 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T19:19:26.576 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:26 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T19:19:26.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:26 smithi022 ceph-mon[39439]: from='osd.3 v1:172.21.15.22:6813/90988887' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-04-01T19:19:26.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:26 smithi022 ceph-mon[39439]: osdmap e25: 4 total, 3 up, 4 in 2024-04-01T19:19:26.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:26 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T19:19:26.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:26 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T19:19:26.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:26 smithi188 ceph-mon[43939]: from='osd.3 v1:172.21.15.22:6813/90988887' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-04-01T19:19:26.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:26 smithi188 ceph-mon[43939]: osdmap e25: 4 total, 3 up, 4 in 2024-04-01T19:19:26.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:26 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T19:19:26.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:26 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T19:19:27.441 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-01T19:19:27.441 INFO:teuthology.orchestra.run.smithi062.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-01T19:19:27.441 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10+0 records in 2024-04-01T19:19:27.442 INFO:teuthology.orchestra.run.smithi062.stderr:10+0 records out 2024-04-01T19:19:27.442 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110927 s, 945 MB/s 2024-04-01T19:19:27.442 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping successful for: 2024-04-01T19:19:27.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:27 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:19:27.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:27 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:19:27.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:19:27.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:27 smithi062 ceph-mon[44211]: osd.3 v1:172.21.15.22:6813/90988887 boot 2024-04-01T19:19:27.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:27 smithi062 ceph-mon[44211]: osdmap e26: 4 total, 4 up, 4 in 2024-04-01T19:19:27.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:27 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T19:19:27.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:27 smithi062 ceph-mon[44211]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:27.766 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:27 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:19:27.766 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:27 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:19:27.766 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:19:27.766 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:27 smithi022 ceph-mon[39439]: osd.3 v1:172.21.15.22:6813/90988887 boot 2024-04-01T19:19:27.766 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:27 smithi022 ceph-mon[39439]: osdmap e26: 4 total, 4 up, 4 in 2024-04-01T19:19:27.766 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:27 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T19:19:27.766 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:27 smithi022 ceph-mon[39439]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:27.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:27 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:19:27.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:27 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:19:27.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:19:27.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:27 smithi188 ceph-mon[43939]: osd.3 v1:172.21.15.22:6813/90988887 boot 2024-04-01T19:19:27.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:27 smithi188 ceph-mon[43939]: osdmap e26: 4 total, 4 up, 4 in 2024-04-01T19:19:27.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:27 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T19:19:27.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:27 smithi188 ceph-mon[43939]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-01T19:19:28.106 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi062:vg_nvme/lv_4 2024-04-01T19:19:28.382 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:19:28.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:28 smithi062 ceph-mon[44211]: osdmap e27: 4 total, 4 up, 4 in 2024-04-01T19:19:28.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:28 smithi062 ceph-mon[44211]: Detected new or changed devices on smithi022 2024-04-01T19:19:28.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:28.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:28.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:19:28.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:19:28.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:19:28.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:19:28.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:28 smithi062 ceph-mon[44211]: Adjusting osd_memory_target on smithi022 to 4281M 2024-04-01T19:19:28.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:28.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:28.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:19:28.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:28.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:28 smithi022 ceph-mon[39439]: osdmap e27: 4 total, 4 up, 4 in 2024-04-01T19:19:28.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:28 smithi022 ceph-mon[39439]: Detected new or changed devices on smithi022 2024-04-01T19:19:28.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:28.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:28.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:19:28.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:19:28.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:19:28.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:19:28.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:28 smithi022 ceph-mon[39439]: Adjusting osd_memory_target on smithi022 to 4281M 2024-04-01T19:19:28.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:28.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:28.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:19:28.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:28.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:28 smithi188 ceph-mon[43939]: osdmap e27: 4 total, 4 up, 4 in 2024-04-01T19:19:28.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:28 smithi188 ceph-mon[43939]: Detected new or changed devices on smithi022 2024-04-01T19:19:28.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:28.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:28.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:19:28.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:19:28.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:19:28.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:19:28.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:28 smithi188 ceph-mon[43939]: Adjusting osd_memory_target on smithi022 to 4281M 2024-04-01T19:19:28.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:28.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:28.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:19:28.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:29.568 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:29 smithi062 ceph-mon[44211]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:29.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:29 smithi022 ceph-mon[39439]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:29.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:29 smithi188 ceph-mon[43939]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:30.884 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:30 smithi062 ceph-mon[44211]: from='client.34235 v1:172.21.15.62:0/1129093765' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:19:30.884 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:30 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:19:30.884 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:30 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:19:30.884 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:30 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:31.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:30 smithi022 ceph-mon[39439]: from='client.34235 v1:172.21.15.62:0/1129093765' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:19:31.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:30 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:19:31.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:30 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:19:31.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:30 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:31.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:30 smithi188 ceph-mon[43939]: from='client.34235 v1:172.21.15.62:0/1129093765' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:19:31.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:30 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:19:31.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:30 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:19:31.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:30 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:31.754 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:31 smithi062 ceph-mon[44211]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:32.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:31 smithi022 ceph-mon[39439]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:32.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:31 smithi188 ceph-mon[43939]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:33 smithi062 ceph-mon[44211]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:33 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.62:0/153062696' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a2690dc-e5b6-4d29-b517-980018519d76"}]: dispatch 2024-04-01T19:19:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:33 smithi062 ceph-mon[44211]: from='client.34241 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a2690dc-e5b6-4d29-b517-980018519d76"}]: dispatch 2024-04-01T19:19:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:33 smithi062 ceph-mon[44211]: from='client.34241 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a2690dc-e5b6-4d29-b517-980018519d76"}]': finished 2024-04-01T19:19:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:33 smithi062 ceph-mon[44211]: osdmap e28: 5 total, 4 up, 5 in 2024-04-01T19:19:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T19:19:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:33 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.62:0/1351421549' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:19:34.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:33 smithi022 ceph-mon[39439]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:34.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:33 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.62:0/153062696' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a2690dc-e5b6-4d29-b517-980018519d76"}]: dispatch 2024-04-01T19:19:34.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:33 smithi022 ceph-mon[39439]: from='client.34241 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a2690dc-e5b6-4d29-b517-980018519d76"}]: dispatch 2024-04-01T19:19:34.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:33 smithi022 ceph-mon[39439]: from='client.34241 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a2690dc-e5b6-4d29-b517-980018519d76"}]': finished 2024-04-01T19:19:34.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:33 smithi022 ceph-mon[39439]: osdmap e28: 5 total, 4 up, 5 in 2024-04-01T19:19:34.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T19:19:34.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:33 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.62:0/1351421549' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:19:34.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:33 smithi188 ceph-mon[43939]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:34.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:33 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.62:0/153062696' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a2690dc-e5b6-4d29-b517-980018519d76"}]: dispatch 2024-04-01T19:19:34.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:33 smithi188 ceph-mon[43939]: from='client.34241 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a2690dc-e5b6-4d29-b517-980018519d76"}]: dispatch 2024-04-01T19:19:34.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:33 smithi188 ceph-mon[43939]: from='client.34241 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a2690dc-e5b6-4d29-b517-980018519d76"}]': finished 2024-04-01T19:19:34.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:33 smithi188 ceph-mon[43939]: osdmap e28: 5 total, 4 up, 5 in 2024-04-01T19:19:34.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T19:19:34.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:33 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.62:0/1351421549' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:19:36.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:35 smithi062 ceph-mon[44211]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:36.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:35 smithi022 ceph-mon[39439]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:36.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:35 smithi188 ceph-mon[43939]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:36.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:36 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:19:36.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:36 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:19:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:36 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:19:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:36 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:19:37.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:36 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:19:37.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:36 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:19:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:37 smithi062 ceph-mon[44211]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:37 smithi062 ceph-mon[44211]: osdmap e29: 5 total, 4 up, 5 in 2024-04-01T19:19:38.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T19:19:38.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:37 smithi022 ceph-mon[39439]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:38.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:37 smithi022 ceph-mon[39439]: osdmap e29: 5 total, 4 up, 5 in 2024-04-01T19:19:38.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T19:19:38.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:37 smithi188 ceph-mon[43939]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:38.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:37 smithi188 ceph-mon[43939]: osdmap e29: 5 total, 4 up, 5 in 2024-04-01T19:19:38.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T19:19:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:39 smithi062 ceph-mon[44211]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:39.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:39 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-01T19:19:39.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:39 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:40.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:39 smithi022 ceph-mon[39439]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:40.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:39 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-01T19:19:40.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:39 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:40.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:39 smithi188 ceph-mon[43939]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:40.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:39 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-01T19:19:40.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:39 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:40.933 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:40 smithi062 ceph-mon[44211]: Deploying daemon osd.4 on smithi062 2024-04-01T19:19:41.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:40 smithi022 ceph-mon[39439]: Deploying daemon osd.4 on smithi062 2024-04-01T19:19:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:40 smithi188 ceph-mon[43939]: Deploying daemon osd.4 on smithi062 2024-04-01T19:19:42.000 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:41 smithi062 ceph-mon[44211]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:42.000 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:41 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T19:19:42.001 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:41 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T19:19:42.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:41 smithi022 ceph-mon[39439]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:42.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:41 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T19:19:42.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:41 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T19:19:42.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:41 smithi188 ceph-mon[43939]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:42.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:41 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T19:19:42.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:41 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T19:19:43.968 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:43 smithi062 ceph-mon[44211]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:44.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:43 smithi022 ceph-mon[39439]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:44.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:43 smithi188 ceph-mon[43939]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:46.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:45 smithi022 ceph-mon[39439]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:46.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:45 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:46.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:45 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:46.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:45 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:19:46.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:45 smithi188 ceph-mon[43939]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:46.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:45 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:46.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:45 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:46.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:45 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:19:46.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:45 smithi062 ceph-mon[44211]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:46.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:45 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:46.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:45 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:46.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:45 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:19:48.211 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:48 smithi062 ceph-mon[44211]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:48.211 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:48 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:48.211 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:48 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:48.211 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:48 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:48.211 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:48 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:19:48.211 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:48 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:48.211 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:48 smithi062 ceph-mon[44211]: from='osd.4 v1:172.21.15.62:6800/2408168690' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-01T19:19:48.211 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:48 smithi062 ceph-mon[44211]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-01T19:19:48.286 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 4 on host 'smithi062' 2024-04-01T19:19:48.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:48 smithi188 ceph-mon[43939]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:48.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:48 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:48.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:48 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:48.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:48 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:48.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:48 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:19:48.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:48 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:48.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:48 smithi188 ceph-mon[43939]: from='osd.4 v1:172.21.15.62:6800/2408168690' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-01T19:19:48.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:48 smithi188 ceph-mon[43939]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-01T19:19:48.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:48 smithi022 ceph-mon[39439]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:48.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:48 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:48.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:48 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:48.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:48 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:48.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:48 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:19:48.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:48 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:48.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:48 smithi022 ceph-mon[39439]: from='osd.4 v1:172.21.15.62:6800/2408168690' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-01T19:19:48.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:48 smithi022 ceph-mon[39439]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-01T19:19:48.927 DEBUG:teuthology.orchestra.run.smithi062:osd.4> sudo journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.4.service 2024-04-01T19:19:48.930 INFO:tasks.cephadm:Deploying osd.5 on smithi062 with /dev/vg_nvme/lv_3... 2024-04-01T19:19:48.930 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-01T19:19:48.960 INFO:journalctl@ceph.osd.4.smithi062.stdout:-- Logs begin at Mon 2024-04-01 19:04:11 UTC. -- 2024-04-01T19:19:49.138 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:49 smithi062 ceph-mon[44211]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-01T19:19:49.138 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:49 smithi062 ceph-mon[44211]: from='osd.4 v1:172.21.15.62:6800/2408168690' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:19:49.139 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:49 smithi062 ceph-mon[44211]: osdmap e30: 5 total, 4 up, 5 in 2024-04-01T19:19:49.139 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:49 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T19:19:49.139 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:49 smithi062 ceph-mon[44211]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:19:49.139 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:49 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:19:49.139 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:49 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:49.139 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:49 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:49.511 INFO:journalctl@ceph.osd.4.smithi062.stdout:Apr 01 19:19:49 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-4[49665]: 2024-04-01T19:19:49.142+0000 7fd68cd6b700 -1 osd.4 0 waiting for initial osdmap 2024-04-01T19:19:49.512 INFO:journalctl@ceph.osd.4.smithi062.stdout:Apr 01 19:19:49 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-4[49665]: 2024-04-01T19:19:49.147+0000 7fd688b5e700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T19:19:49.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:49 smithi022 ceph-mon[39439]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-01T19:19:49.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:49 smithi022 ceph-mon[39439]: from='osd.4 v1:172.21.15.62:6800/2408168690' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:19:49.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:49 smithi022 ceph-mon[39439]: osdmap e30: 5 total, 4 up, 5 in 2024-04-01T19:19:49.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:49 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T19:19:49.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:49 smithi022 ceph-mon[39439]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:19:49.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:49 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:19:49.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:49 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:49.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:49 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:49.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:49 smithi188 ceph-mon[43939]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-01T19:19:49.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:49 smithi188 ceph-mon[43939]: from='osd.4 v1:172.21.15.62:6800/2408168690' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:19:49.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:49 smithi188 ceph-mon[43939]: osdmap e30: 5 total, 4 up, 5 in 2024-04-01T19:19:49.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:49 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T19:19:49.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:49 smithi188 ceph-mon[43939]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:19:49.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:49 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:19:49.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:49 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:49.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:49 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:50.005 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:19:50.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:50 smithi062 ceph-mon[44211]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:50.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:50 smithi062 ceph-mon[44211]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-04-01T19:19:50.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:50 smithi062 ceph-mon[44211]: osdmap e31: 5 total, 4 up, 5 in 2024-04-01T19:19:50.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:50 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T19:19:50.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:50 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T19:19:50.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:50 smithi022 ceph-mon[39439]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:50.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:50 smithi022 ceph-mon[39439]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-04-01T19:19:50.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:50 smithi022 ceph-mon[39439]: osdmap e31: 5 total, 4 up, 5 in 2024-04-01T19:19:50.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:50 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T19:19:50.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:50 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T19:19:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:50 smithi188 ceph-mon[43939]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:50.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:50 smithi188 ceph-mon[43939]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-04-01T19:19:50.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:50 smithi188 ceph-mon[43939]: osdmap e31: 5 total, 4 up, 5 in 2024-04-01T19:19:50.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:50 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T19:19:50.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:50 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T19:19:51.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:51 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:19:51.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:51 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:19:51.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:19:51.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:51 smithi062 ceph-mon[44211]: osd.4 v1:172.21.15.62:6800/2408168690 boot 2024-04-01T19:19:51.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:51 smithi062 ceph-mon[44211]: osdmap e32: 5 total, 5 up, 5 in 2024-04-01T19:19:51.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:51 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T19:19:51.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:51 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:19:51.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:51 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:19:51.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:19:51.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:51 smithi022 ceph-mon[39439]: osd.4 v1:172.21.15.62:6800/2408168690 boot 2024-04-01T19:19:51.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:51 smithi022 ceph-mon[39439]: osdmap e32: 5 total, 5 up, 5 in 2024-04-01T19:19:51.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:51 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T19:19:51.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:51 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:19:51.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:51 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:19:51.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:19:51.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:51 smithi188 ceph-mon[43939]: osd.4 v1:172.21.15.62:6800/2408168690 boot 2024-04-01T19:19:51.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:51 smithi188 ceph-mon[43939]: osdmap e32: 5 total, 5 up, 5 in 2024-04-01T19:19:51.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:51 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T19:19:52.340 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-01T19:19:52.341 INFO:teuthology.orchestra.run.smithi062.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-01T19:19:52.341 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10+0 records in 2024-04-01T19:19:52.341 INFO:teuthology.orchestra.run.smithi062.stderr:10+0 records out 2024-04-01T19:19:52.341 INFO:teuthology.orchestra.run.smithi062.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0132769 s, 790 MB/s 2024-04-01T19:19:52.341 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping successful for: 2024-04-01T19:19:52.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:52 smithi062 ceph-mon[44211]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:52.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:52 smithi062 ceph-mon[44211]: osdmap e33: 5 total, 5 up, 5 in 2024-04-01T19:19:52.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:52 smithi022 ceph-mon[39439]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:52.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:52 smithi022 ceph-mon[39439]: osdmap e33: 5 total, 5 up, 5 in 2024-04-01T19:19:52.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:52 smithi188 ceph-mon[43939]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-04-01T19:19:52.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:52 smithi188 ceph-mon[43939]: osdmap e33: 5 total, 5 up, 5 in 2024-04-01T19:19:53.099 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi062:vg_nvme/lv_3 2024-04-01T19:19:53.704 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:19:54.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:54 smithi062 ceph-mon[44211]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:19:54.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:54 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:54.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:54 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:54.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:54 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:19:54.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:54 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:54.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:54 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:54.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:54 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:19:54.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:54 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:54.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:54 smithi022 ceph-mon[39439]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:19:54.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:54 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:54.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:54 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:54.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:54 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:19:54.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:54 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:54.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:54 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:54.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:54 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:19:54.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:54 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:54.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:54 smithi188 ceph-mon[43939]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:19:54.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:54 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:54.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:54 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:54.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:54 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:19:54.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:54 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:54.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:54 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:54.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:54 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:19:54.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:54 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:19:55.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:55 smithi062 ceph-mon[44211]: Detected new or changed devices on smithi062 2024-04-01T19:19:55.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:55 smithi062 ceph-mon[44211]: Adjusting osd_memory_target on smithi062 to 17122M 2024-04-01T19:19:55.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:55 smithi022 ceph-mon[39439]: Detected new or changed devices on smithi062 2024-04-01T19:19:55.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:55 smithi022 ceph-mon[39439]: Adjusting osd_memory_target on smithi062 to 17122M 2024-04-01T19:19:55.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:55 smithi188 ceph-mon[43939]: Detected new or changed devices on smithi062 2024-04-01T19:19:55.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:55 smithi188 ceph-mon[43939]: Adjusting osd_memory_target on smithi062 to 17122M 2024-04-01T19:19:56.316 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:56 smithi062 ceph-mon[44211]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:19:56.316 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:56 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:19:56.316 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:56 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:19:56.316 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:56 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:56.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:56 smithi022 ceph-mon[39439]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:19:56.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:56 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:19:56.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:56 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:19:56.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:56 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:56 smithi188 ceph-mon[43939]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:19:56.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:56 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:19:56.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:56 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:19:56.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:56 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:19:57.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:57 smithi062 ceph-mon[44211]: from='client.34262 v1:172.21.15.62:0/2538135615' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:19:57.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:57 smithi022 ceph-mon[39439]: from='client.34262 v1:172.21.15.62:0/2538135615' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:19:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:57 smithi188 ceph-mon[43939]: from='client.34262 v1:172.21.15.62:0/2538135615' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:19:58.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:58 smithi062 ceph-mon[44211]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:19:58.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:58 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.62:0/1317761136' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6830412-959a-4f1e-8c3d-f4b2d88673e6"}]: dispatch 2024-04-01T19:19:58.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:58 smithi062 ceph-mon[44211]: from='client.34268 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6830412-959a-4f1e-8c3d-f4b2d88673e6"}]: dispatch 2024-04-01T19:19:58.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:58 smithi062 ceph-mon[44211]: from='client.34268 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c6830412-959a-4f1e-8c3d-f4b2d88673e6"}]': finished 2024-04-01T19:19:58.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:58 smithi022 ceph-mon[39439]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:19:58.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:58 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.62:0/1317761136' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6830412-959a-4f1e-8c3d-f4b2d88673e6"}]: dispatch 2024-04-01T19:19:58.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:58 smithi022 ceph-mon[39439]: from='client.34268 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6830412-959a-4f1e-8c3d-f4b2d88673e6"}]: dispatch 2024-04-01T19:19:58.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:58 smithi022 ceph-mon[39439]: from='client.34268 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c6830412-959a-4f1e-8c3d-f4b2d88673e6"}]': finished 2024-04-01T19:19:58.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:58 smithi188 ceph-mon[43939]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:19:58.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:58 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.62:0/1317761136' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6830412-959a-4f1e-8c3d-f4b2d88673e6"}]: dispatch 2024-04-01T19:19:58.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:58 smithi188 ceph-mon[43939]: from='client.34268 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6830412-959a-4f1e-8c3d-f4b2d88673e6"}]: dispatch 2024-04-01T19:19:58.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:58 smithi188 ceph-mon[43939]: from='client.34268 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c6830412-959a-4f1e-8c3d-f4b2d88673e6"}]': finished 2024-04-01T19:19:59.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:59 smithi062 ceph-mon[44211]: osdmap e34: 6 total, 5 up, 6 in 2024-04-01T19:19:59.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:59 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T19:19:59.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:19:59 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.62:0/3302575700' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:19:59.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:59 smithi022 ceph-mon[39439]: osdmap e34: 6 total, 5 up, 6 in 2024-04-01T19:19:59.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:59 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T19:19:59.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:19:59 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.62:0/3302575700' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:19:59.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:59 smithi188 ceph-mon[43939]: osdmap e34: 6 total, 5 up, 6 in 2024-04-01T19:19:59.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:59 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T19:19:59.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:19:59 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.62:0/3302575700' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:20:00.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:00 smithi062 ceph-mon[44211]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:00.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:00 smithi062 ceph-mon[44211]: overall HEALTH_OK 2024-04-01T19:20:00.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:00 smithi022 ceph-mon[39439]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:00.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:00 smithi022 ceph-mon[39439]: overall HEALTH_OK 2024-04-01T19:20:00.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:00 smithi188 ceph-mon[43939]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:00.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:00 smithi188 ceph-mon[43939]: overall HEALTH_OK 2024-04-01T19:20:02.491 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:02 smithi062 ceph-mon[44211]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:02.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:02 smithi022 ceph-mon[39439]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:02 smithi188 ceph-mon[43939]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:04.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:04 smithi062 ceph-mon[44211]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:04.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:04 smithi022 ceph-mon[39439]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:04.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:04 smithi188 ceph-mon[43939]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:05.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:05 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-01T19:20:05.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:05 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:05.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:05 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-01T19:20:05.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:05 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:05.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:05 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-01T19:20:05.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:05 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:06.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:06 smithi062 ceph-mon[44211]: Deploying daemon osd.5 on smithi062 2024-04-01T19:20:06.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:06 smithi062 ceph-mon[44211]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:06.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:06 smithi022 ceph-mon[39439]: Deploying daemon osd.5 on smithi062 2024-04-01T19:20:06.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:06 smithi022 ceph-mon[39439]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:06.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:06 smithi188 ceph-mon[43939]: Deploying daemon osd.5 on smithi062 2024-04-01T19:20:06.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:06 smithi188 ceph-mon[43939]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:08.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:08 smithi062 ceph-mon[44211]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:08.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:08 smithi022 ceph-mon[39439]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:08.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:08 smithi188 ceph-mon[43939]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:10.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:10 smithi062 ceph-mon[44211]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:10.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:10 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:10.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:10 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:10.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:10 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:20:10.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:10 smithi022 ceph-mon[39439]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:10.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:10 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:10.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:10 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:10.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:10 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:20:10.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:10 smithi188 ceph-mon[43939]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:10.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:10 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:10.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:10 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:10.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:10 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:20:12.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:12 smithi062 ceph-mon[44211]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:12.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:12 smithi022 ceph-mon[39439]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:12 smithi188 ceph-mon[43939]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:13.478 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 5 on host 'smithi062' 2024-04-01T19:20:13.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:13 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:13.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:13 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:13.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:13 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:13.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:13 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:20:13.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:13 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:13.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:13 smithi062 ceph-mon[44211]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:13.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:13 smithi062 ceph-mon[44211]: from='osd.5 v1:172.21.15.62:6804/386874616' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-01T19:20:13.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:13 smithi062 ceph-mon[44211]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-01T19:20:13.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:13 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:13.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:13 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:13.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:13 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:13.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:13 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:13.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:13 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:13.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:13 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:20:13.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:13 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:13.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:13 smithi022 ceph-mon[39439]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:13.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:13 smithi022 ceph-mon[39439]: from='osd.5 v1:172.21.15.62:6804/386874616' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-01T19:20:13.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:13 smithi022 ceph-mon[39439]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-01T19:20:13.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:13 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:13.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:13 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:13.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:13 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:13.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:13 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:13.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:13 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:13.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:13 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:20:13.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:13 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:13.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:13 smithi188 ceph-mon[43939]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:13.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:13 smithi188 ceph-mon[43939]: from='osd.5 v1:172.21.15.62:6804/386874616' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-01T19:20:13.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:13 smithi188 ceph-mon[43939]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-01T19:20:13.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:13 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:13.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:13 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:14.086 DEBUG:teuthology.orchestra.run.smithi062:osd.5> sudo journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.5.service 2024-04-01T19:20:14.088 INFO:tasks.cephadm:Deploying osd.6 on smithi062 with /dev/vg_nvme/lv_2... 2024-04-01T19:20:14.088 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-01T19:20:14.122 INFO:journalctl@ceph.osd.5.smithi062.stdout:-- Logs begin at Mon 2024-04-01 19:04:11 UTC. -- 2024-04-01T19:20:14.761 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 19:20:14 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T19:20:14.497+0000 7f23750c6700 -1 osd.5 0 waiting for initial osdmap 2024-04-01T19:20:14.761 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 19:20:14 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T19:20:14.502+0000 7f2370eb9700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T19:20:14.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:14 smithi062 ceph-mon[44211]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-01T19:20:14.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:14 smithi062 ceph-mon[44211]: osdmap e35: 6 total, 5 up, 6 in 2024-04-01T19:20:14.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:14 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T19:20:14.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:14 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:20:14.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:14 smithi062 ceph-mon[44211]: from='osd.5 v1:172.21.15.62:6804/386874616' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:20:14.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:14 smithi062 ceph-mon[44211]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:20:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:14 smithi022 ceph-mon[39439]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-01T19:20:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:14 smithi022 ceph-mon[39439]: osdmap e35: 6 total, 5 up, 6 in 2024-04-01T19:20:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:14 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T19:20:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:14 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:20:14.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:14 smithi022 ceph-mon[39439]: from='osd.5 v1:172.21.15.62:6804/386874616' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:20:14.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:14 smithi022 ceph-mon[39439]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:20:14.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:14 smithi188 ceph-mon[43939]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-01T19:20:14.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:14 smithi188 ceph-mon[43939]: osdmap e35: 6 total, 5 up, 6 in 2024-04-01T19:20:14.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:14 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T19:20:14.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:14 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:20:14.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:14 smithi188 ceph-mon[43939]: from='osd.5 v1:172.21.15.62:6804/386874616' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:20:14.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:14 smithi188 ceph-mon[43939]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:20:15.341 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:20:15.595 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:15 smithi062 ceph-mon[44211]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-04-01T19:20:15.595 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:15 smithi062 ceph-mon[44211]: osdmap e36: 6 total, 5 up, 6 in 2024-04-01T19:20:15.595 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:15 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T19:20:15.595 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:15 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T19:20:15.595 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:15 smithi062 ceph-mon[44211]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:15.595 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:15 smithi062 ceph-mon[44211]: osd.5 v1:172.21.15.62:6804/386874616 boot 2024-04-01T19:20:15.595 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:15 smithi062 ceph-mon[44211]: osdmap e37: 6 total, 6 up, 6 in 2024-04-01T19:20:15.596 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:15 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T19:20:15.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:15 smithi022 ceph-mon[39439]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-04-01T19:20:15.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:15 smithi022 ceph-mon[39439]: osdmap e36: 6 total, 5 up, 6 in 2024-04-01T19:20:15.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:15 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T19:20:15.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:15 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T19:20:15.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:15 smithi022 ceph-mon[39439]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:15.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:15 smithi022 ceph-mon[39439]: osd.5 v1:172.21.15.62:6804/386874616 boot 2024-04-01T19:20:15.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:15 smithi022 ceph-mon[39439]: osdmap e37: 6 total, 6 up, 6 in 2024-04-01T19:20:15.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:15 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T19:20:15.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:15 smithi188 ceph-mon[43939]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-04-01T19:20:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:15 smithi188 ceph-mon[43939]: osdmap e36: 6 total, 5 up, 6 in 2024-04-01T19:20:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:15 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T19:20:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:15 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T19:20:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:15 smithi188 ceph-mon[43939]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-04-01T19:20:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:15 smithi188 ceph-mon[43939]: osd.5 v1:172.21.15.62:6804/386874616 boot 2024-04-01T19:20:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:15 smithi188 ceph-mon[43939]: osdmap e37: 6 total, 6 up, 6 in 2024-04-01T19:20:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:15 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T19:20:16.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:16 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:20:16.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:16 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:20:16.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:16 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:20:16.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:16 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:20:16.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:16 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:20:16.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:16 smithi062 ceph-mon[44211]: osdmap e38: 6 total, 6 up, 6 in 2024-04-01T19:20:16.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:16 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:20:16.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:16 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:20:16.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:16 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:20:16.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:16 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:20:16.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:16 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:20:16.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:16 smithi022 ceph-mon[39439]: osdmap e38: 6 total, 6 up, 6 in 2024-04-01T19:20:16.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:16 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:20:16.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:16 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:20:16.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:16 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:20:16.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:16 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:20:16.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:16 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:20:16.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:16 smithi188 ceph-mon[43939]: osdmap e38: 6 total, 6 up, 6 in 2024-04-01T19:20:17.765 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-01T19:20:17.765 INFO:teuthology.orchestra.run.smithi062.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-01T19:20:17.765 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10+0 records in 2024-04-01T19:20:17.765 INFO:teuthology.orchestra.run.smithi062.stderr:10+0 records out 2024-04-01T19:20:17.765 INFO:teuthology.orchestra.run.smithi062.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0108725 s, 964 MB/s 2024-04-01T19:20:17.765 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 2024-04-01T19:20:17.765 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping successful for: 2024-04-01T19:20:18.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:17 smithi062 ceph-mon[44211]: pgmap v141: 1 pgs: 1 remapped; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:18.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:17 smithi062 ceph-mon[44211]: osdmap e39: 6 total, 6 up, 6 in 2024-04-01T19:20:18.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:17 smithi022 ceph-mon[39439]: pgmap v141: 1 pgs: 1 remapped; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:18.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:17 smithi022 ceph-mon[39439]: osdmap e39: 6 total, 6 up, 6 in 2024-04-01T19:20:18.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:17 smithi188 ceph-mon[43939]: pgmap v141: 1 pgs: 1 remapped; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:18.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:17 smithi188 ceph-mon[43939]: osdmap e39: 6 total, 6 up, 6 in 2024-04-01T19:20:18.710 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi062:vg_nvme/lv_2 2024-04-01T19:20:18.986 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:20:19.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:18 smithi062 ceph-mon[44211]: osdmap e40: 6 total, 6 up, 6 in 2024-04-01T19:20:19.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:18 smithi062 ceph-mon[44211]: Detected new or changed devices on smithi062 2024-04-01T19:20:19.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:18 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:19.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:18 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:19.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:18 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:20:19.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:18 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:20:19.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:18 smithi062 ceph-mon[44211]: Adjusting osd_memory_target on smithi062 to 8561M 2024-04-01T19:20:19.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:18 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:19.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:18 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:19.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:18 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:20:19.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:18 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:19.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:18 smithi022 ceph-mon[39439]: osdmap e40: 6 total, 6 up, 6 in 2024-04-01T19:20:19.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:18 smithi022 ceph-mon[39439]: Detected new or changed devices on smithi062 2024-04-01T19:20:19.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:18 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:19.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:18 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:19.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:18 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:20:19.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:18 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:20:19.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:18 smithi022 ceph-mon[39439]: Adjusting osd_memory_target on smithi062 to 8561M 2024-04-01T19:20:19.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:18 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:19.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:18 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:19.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:18 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:20:19.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:18 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:19.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:18 smithi188 ceph-mon[43939]: osdmap e40: 6 total, 6 up, 6 in 2024-04-01T19:20:19.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:18 smithi188 ceph-mon[43939]: Detected new or changed devices on smithi062 2024-04-01T19:20:19.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:19.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:19.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:20:19.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:20:19.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:18 smithi188 ceph-mon[43939]: Adjusting osd_memory_target on smithi062 to 8561M 2024-04-01T19:20:19.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:19.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:19.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:20:19.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:20.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:19 smithi062 ceph-mon[44211]: pgmap v144: 1 pgs: 1 remapped; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:20.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:19 smithi062 ceph-mon[44211]: osdmap e41: 6 total, 6 up, 6 in 2024-04-01T19:20:20.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:19 smithi022 ceph-mon[39439]: pgmap v144: 1 pgs: 1 remapped; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:20.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:19 smithi022 ceph-mon[39439]: osdmap e41: 6 total, 6 up, 6 in 2024-04-01T19:20:20.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:19 smithi188 ceph-mon[43939]: pgmap v144: 1 pgs: 1 remapped; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:20.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:19 smithi188 ceph-mon[43939]: osdmap e41: 6 total, 6 up, 6 in 2024-04-01T19:20:22.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:21 smithi062 ceph-mon[44211]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:22.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:21 smithi062 ceph-mon[44211]: from='client.34289 v1:172.21.15.62:0/1281629256' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:20:22.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:21 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:20:22.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:21 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:20:22.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:21 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:22.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:21 smithi022 ceph-mon[39439]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:22.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:21 smithi022 ceph-mon[39439]: from='client.34289 v1:172.21.15.62:0/1281629256' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:20:22.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:21 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:20:22.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:21 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:20:22.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:21 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:22.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:21 smithi188 ceph-mon[43939]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:22.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:21 smithi188 ceph-mon[43939]: from='client.34289 v1:172.21.15.62:0/1281629256' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:20:22.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:21 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:20:22.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:21 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:20:22.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:21 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:24.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:23 smithi062 ceph-mon[44211]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:24.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:23 smithi022 ceph-mon[39439]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:24.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:23 smithi188 ceph-mon[43939]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:25.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:24 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.62:0/915788230' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f646310b-91a4-4259-a51f-6a0e92b7cba8"}]: dispatch 2024-04-01T19:20:25.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:24 smithi062 ceph-mon[44211]: from='client.34295 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f646310b-91a4-4259-a51f-6a0e92b7cba8"}]: dispatch 2024-04-01T19:20:25.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:24 smithi062 ceph-mon[44211]: from='client.34295 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f646310b-91a4-4259-a51f-6a0e92b7cba8"}]': finished 2024-04-01T19:20:25.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:24 smithi062 ceph-mon[44211]: osdmap e42: 7 total, 6 up, 7 in 2024-04-01T19:20:25.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:20:25.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:24 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.62:0/685364285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:20:25.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:24 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.62:0/915788230' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f646310b-91a4-4259-a51f-6a0e92b7cba8"}]: dispatch 2024-04-01T19:20:25.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:24 smithi022 ceph-mon[39439]: from='client.34295 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f646310b-91a4-4259-a51f-6a0e92b7cba8"}]: dispatch 2024-04-01T19:20:25.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:24 smithi022 ceph-mon[39439]: from='client.34295 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f646310b-91a4-4259-a51f-6a0e92b7cba8"}]': finished 2024-04-01T19:20:25.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:24 smithi022 ceph-mon[39439]: osdmap e42: 7 total, 6 up, 7 in 2024-04-01T19:20:25.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:20:25.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:24 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.62:0/685364285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:20:25.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:24 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.62:0/915788230' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f646310b-91a4-4259-a51f-6a0e92b7cba8"}]: dispatch 2024-04-01T19:20:25.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:24 smithi188 ceph-mon[43939]: from='client.34295 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f646310b-91a4-4259-a51f-6a0e92b7cba8"}]: dispatch 2024-04-01T19:20:25.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:24 smithi188 ceph-mon[43939]: from='client.34295 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f646310b-91a4-4259-a51f-6a0e92b7cba8"}]': finished 2024-04-01T19:20:25.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:24 smithi188 ceph-mon[43939]: osdmap e42: 7 total, 6 up, 7 in 2024-04-01T19:20:25.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:20:25.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:24 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.62:0/685364285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:20:26.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:25 smithi062 ceph-mon[44211]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:26.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:25 smithi022 ceph-mon[39439]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:26.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:25 smithi188 ceph-mon[43939]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:28.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:27 smithi062 ceph-mon[44211]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:28.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:27 smithi022 ceph-mon[39439]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:28.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:27 smithi188 ceph-mon[43939]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:29 smithi062 ceph-mon[44211]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:30.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:29 smithi022 ceph-mon[39439]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:30.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:29 smithi188 ceph-mon[43939]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:30.959 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:30 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-01T19:20:30.960 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:30 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:30.960 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:30 smithi062 ceph-mon[44211]: Deploying daemon osd.6 on smithi062 2024-04-01T19:20:31.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:30 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-01T19:20:31.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:30 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:31.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:30 smithi022 ceph-mon[39439]: Deploying daemon osd.6 on smithi062 2024-04-01T19:20:31.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:30 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-01T19:20:31.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:30 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:31.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:30 smithi188 ceph-mon[43939]: Deploying daemon osd.6 on smithi062 2024-04-01T19:20:32.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:31 smithi062 ceph-mon[44211]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:32.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:31 smithi022 ceph-mon[39439]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:32.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:31 smithi188 ceph-mon[43939]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:33 smithi062 ceph-mon[44211]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:34.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:33 smithi022 ceph-mon[39439]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:34.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:33 smithi188 ceph-mon[43939]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:35.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:35 smithi062 ceph-mon[44211]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:35.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:35.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:35.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:20:36.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:35 smithi022 ceph-mon[39439]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:36.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:36.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:36.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:20:36.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:35 smithi188 ceph-mon[43939]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:36.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:36.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:36.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:20:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:37 smithi062 ceph-mon[44211]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:38.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:37 smithi022 ceph-mon[39439]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:38.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:37 smithi188 ceph-mon[43939]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:39.154 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 6 on host 'smithi062' 2024-04-01T19:20:39.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:39 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:20:39.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:39 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:20:39.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:39 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:39.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:39 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:39.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:39 smithi062 ceph-mon[44211]: from='osd.6 v1:172.21.15.62:6808/90097362' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-01T19:20:39.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:39 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:39.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:39 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:20:39.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:39 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:39.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:39 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:39.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:39 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:39.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:39 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:20:39.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:39 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:20:39.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:39 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:20:39.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:39 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:39.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:39 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:39.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:39 smithi022 ceph-mon[39439]: from='osd.6 v1:172.21.15.62:6808/90097362' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-01T19:20:39.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:39 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:39.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:39 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:20:39.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:39 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:39.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:39 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:39.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:39 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:39.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:39 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:20:39.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:39 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:20:39.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:39 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:20:39.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:39 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:39.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:39 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:39.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:39 smithi188 ceph-mon[43939]: from='osd.6 v1:172.21.15.62:6808/90097362' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-01T19:20:39.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:39 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:39.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:39 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:20:39.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:39 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:39.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:39 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:39.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:39 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:39.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:39 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:20:39.813 DEBUG:teuthology.orchestra.run.smithi062:osd.6> sudo journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.6.service 2024-04-01T19:20:39.815 INFO:tasks.cephadm:Deploying osd.7 on smithi062 with /dev/vg_nvme/lv_1... 2024-04-01T19:20:39.816 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-01T19:20:39.847 INFO:journalctl@ceph.osd.6.smithi062.stdout:-- Logs begin at Mon 2024-04-01 19:04:11 UTC. -- 2024-04-01T19:20:40.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:40 smithi022 ceph-mon[39439]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:40.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:40 smithi022 ceph-mon[39439]: from='osd.6 v1:172.21.15.62:6808/90097362' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-01T19:20:40.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:40 smithi022 ceph-mon[39439]: osdmap e43: 7 total, 6 up, 7 in 2024-04-01T19:20:40.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:40 smithi022 ceph-mon[39439]: from='osd.6 v1:172.21.15.62:6808/90097362' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:20:40.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:40 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:20:40.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:40 smithi188 ceph-mon[43939]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:40.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:40 smithi188 ceph-mon[43939]: from='osd.6 v1:172.21.15.62:6808/90097362' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-01T19:20:40.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:40 smithi188 ceph-mon[43939]: osdmap e43: 7 total, 6 up, 7 in 2024-04-01T19:20:40.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:40 smithi188 ceph-mon[43939]: from='osd.6 v1:172.21.15.62:6808/90097362' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:20:40.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:40 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:20:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:40 smithi062 ceph-mon[44211]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:40.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:40 smithi062 ceph-mon[44211]: from='osd.6 v1:172.21.15.62:6808/90097362' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-01T19:20:40.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:40 smithi062 ceph-mon[44211]: osdmap e43: 7 total, 6 up, 7 in 2024-04-01T19:20:40.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:40 smithi062 ceph-mon[44211]: from='osd.6 v1:172.21.15.62:6808/90097362' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:20:40.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:40 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:20:40.762 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:20:40 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[65334]: 2024-04-01T19:20:40.285+0000 7f4520bef700 -1 osd.6 0 waiting for initial osdmap 2024-04-01T19:20:40.762 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:20:40 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[65334]: 2024-04-01T19:20:40.292+0000 7f451c9e2700 -1 osd.6 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T19:20:41.184 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:20:41.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:41 smithi022 ceph-mon[39439]: from='osd.6 v1:172.21.15.62:6808/90097362' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-04-01T19:20:41.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:41 smithi022 ceph-mon[39439]: osdmap e44: 7 total, 6 up, 7 in 2024-04-01T19:20:41.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:41 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:20:41.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:41 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:20:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:41 smithi188 ceph-mon[43939]: from='osd.6 v1:172.21.15.62:6808/90097362' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-04-01T19:20:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:41 smithi188 ceph-mon[43939]: osdmap e44: 7 total, 6 up, 7 in 2024-04-01T19:20:41.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:41 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:20:41.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:41 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:20:41.651 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:41 smithi062 ceph-mon[44211]: from='osd.6 v1:172.21.15.62:6808/90097362' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-04-01T19:20:41.651 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:41 smithi062 ceph-mon[44211]: osdmap e44: 7 total, 6 up, 7 in 2024-04-01T19:20:41.651 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:41 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:20:41.651 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:41 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:20:42.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:42 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:20:42.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:42 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:20:42.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:20:42.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:42 smithi022 ceph-mon[39439]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:42.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:42 smithi022 ceph-mon[39439]: osd.6 v1:172.21.15.62:6808/90097362 boot 2024-04-01T19:20:42.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:42 smithi022 ceph-mon[39439]: osdmap e45: 7 total, 7 up, 7 in 2024-04-01T19:20:42.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:42 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:20:42.620 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:42 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:20:42.620 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:42 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:20:42.620 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:20:42.620 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:42 smithi062 ceph-mon[44211]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:42.620 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:42 smithi062 ceph-mon[44211]: osd.6 v1:172.21.15.62:6808/90097362 boot 2024-04-01T19:20:42.620 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:42 smithi062 ceph-mon[44211]: osdmap e45: 7 total, 7 up, 7 in 2024-04-01T19:20:42.620 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:42 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:20:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:42 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:20:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:42 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:20:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:20:42.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:42 smithi188 ceph-mon[43939]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-04-01T19:20:42.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:42 smithi188 ceph-mon[43939]: osd.6 v1:172.21.15.62:6808/90097362 boot 2024-04-01T19:20:42.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:42 smithi188 ceph-mon[43939]: osdmap e45: 7 total, 7 up, 7 in 2024-04-01T19:20:42.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:42 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:20:43.390 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:43 smithi062 ceph-mon[44211]: osdmap e46: 7 total, 7 up, 7 in 2024-04-01T19:20:43.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:43 smithi022 ceph-mon[39439]: osdmap e46: 7 total, 7 up, 7 in 2024-04-01T19:20:43.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:43 smithi188 ceph-mon[43939]: osdmap e46: 7 total, 7 up, 7 in 2024-04-01T19:20:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-01T19:20:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-01T19:20:44.229 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10+0 records in 2024-04-01T19:20:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:10+0 records out 2024-04-01T19:20:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110734 s, 947 MB/s 2024-04-01T19:20:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping successful for: 2024-04-01T19:20:44.574 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:44 smithi062 ceph-mon[44211]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-01T19:20:44.574 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:44 smithi062 ceph-mon[44211]: osdmap e47: 7 total, 7 up, 7 in 2024-04-01T19:20:44.574 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:44 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:44.575 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:44 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:44.575 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:44 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:20:44.575 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:44 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:20:44.575 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:44 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:20:44.575 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:44 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:44.575 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:44 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:44.575 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:44 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:20:44.575 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:44 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:44.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:44 smithi022 ceph-mon[39439]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-01T19:20:44.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:44 smithi022 ceph-mon[39439]: osdmap e47: 7 total, 7 up, 7 in 2024-04-01T19:20:44.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:44 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:44.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:44 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:44.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:44 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:20:44.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:44 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:20:44.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:44 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:20:44.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:44 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:44.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:44 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:44.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:44 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:20:44.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:44 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:44.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:44 smithi188 ceph-mon[43939]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-01T19:20:44.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:44 smithi188 ceph-mon[43939]: osdmap e47: 7 total, 7 up, 7 in 2024-04-01T19:20:44.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:44 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:44.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:44 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:44.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:44 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:20:44.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:44 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:20:44.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:44 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:20:44.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:44 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:44.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:44 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:44.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:44 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:20:44.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:44 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:20:44.916 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi062:vg_nvme/lv_1 2024-04-01T19:20:45.191 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:20:45.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:45 smithi022 ceph-mon[39439]: Detected new or changed devices on smithi062 2024-04-01T19:20:45.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:45 smithi022 ceph-mon[39439]: Adjusting osd_memory_target on smithi062 to 5707M 2024-04-01T19:20:45.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:45 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:20:45.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:45 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:20:45.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:45 smithi022 ceph-mon[39439]: osdmap e48: 7 total, 7 up, 7 in 2024-04-01T19:20:45.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:45 smithi022 ceph-mon[39439]: osdmap e49: 7 total, 7 up, 7 in 2024-04-01T19:20:45.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:45 smithi188 ceph-mon[43939]: Detected new or changed devices on smithi062 2024-04-01T19:20:45.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:45 smithi188 ceph-mon[43939]: Adjusting osd_memory_target on smithi062 to 5707M 2024-04-01T19:20:45.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:45 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:20:45.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:45 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:20:45.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:45 smithi188 ceph-mon[43939]: osdmap e48: 7 total, 7 up, 7 in 2024-04-01T19:20:45.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:45 smithi188 ceph-mon[43939]: osdmap e49: 7 total, 7 up, 7 in 2024-04-01T19:20:45.692 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:45 smithi062 ceph-mon[44211]: Detected new or changed devices on smithi062 2024-04-01T19:20:45.692 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:45 smithi062 ceph-mon[44211]: Adjusting osd_memory_target on smithi062 to 5707M 2024-04-01T19:20:45.692 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:45 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:20:45.692 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:45 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:20:45.692 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:45 smithi062 ceph-mon[44211]: osdmap e48: 7 total, 7 up, 7 in 2024-04-01T19:20:45.693 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:45 smithi062 ceph-mon[44211]: osdmap e49: 7 total, 7 up, 7 in 2024-04-01T19:20:46.413 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:46 smithi062 ceph-mon[44211]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-01T19:20:46.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:46 smithi022 ceph-mon[39439]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-01T19:20:46.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:46 smithi188 ceph-mon[43939]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-01T19:20:47.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:20:47.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:20:47.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:47.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:20:47.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:20:47.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:47.736 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:20:47.736 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:20:47.736 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:48.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:48 smithi022 ceph-mon[39439]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-01T19:20:48.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:48 smithi022 ceph-mon[39439]: from='client.34316 v1:172.21.15.62:0/336211195' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:20:48.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:48 smithi188 ceph-mon[43939]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-01T19:20:48.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:48 smithi188 ceph-mon[43939]: from='client.34316 v1:172.21.15.62:0/336211195' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:20:48.637 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:48 smithi062 ceph-mon[44211]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-04-01T19:20:48.637 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:48 smithi062 ceph-mon[44211]: from='client.34316 v1:172.21.15.62:0/336211195' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:20:49.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:49 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:20:49.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:49 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:20:49.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:49 smithi022 ceph-mon[39439]: osdmap e50: 7 total, 7 up, 7 in 2024-04-01T19:20:49.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:49 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:20:49.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:49 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:20:49.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:49 smithi188 ceph-mon[43939]: osdmap e50: 7 total, 7 up, 7 in 2024-04-01T19:20:49.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:49 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:20:49.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:49 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:20:49.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:49 smithi062 ceph-mon[44211]: osdmap e50: 7 total, 7 up, 7 in 2024-04-01T19:20:50.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:50 smithi022 ceph-mon[39439]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-04-01T19:20:50.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:50 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.62:0/3159221681' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "afe5f371-c892-43e9-b82e-c2d911354e9a"}]: dispatch 2024-04-01T19:20:50.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:50 smithi022 ceph-mon[39439]: from='client.34322 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "afe5f371-c892-43e9-b82e-c2d911354e9a"}]: dispatch 2024-04-01T19:20:50.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:50 smithi022 ceph-mon[39439]: from='client.34322 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "afe5f371-c892-43e9-b82e-c2d911354e9a"}]': finished 2024-04-01T19:20:50.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:50 smithi022 ceph-mon[39439]: osdmap e51: 8 total, 7 up, 8 in 2024-04-01T19:20:50.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:50 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T19:20:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:50 smithi188 ceph-mon[43939]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-04-01T19:20:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:50 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.62:0/3159221681' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "afe5f371-c892-43e9-b82e-c2d911354e9a"}]: dispatch 2024-04-01T19:20:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:50 smithi188 ceph-mon[43939]: from='client.34322 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "afe5f371-c892-43e9-b82e-c2d911354e9a"}]: dispatch 2024-04-01T19:20:50.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:50 smithi188 ceph-mon[43939]: from='client.34322 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "afe5f371-c892-43e9-b82e-c2d911354e9a"}]': finished 2024-04-01T19:20:50.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:50 smithi188 ceph-mon[43939]: osdmap e51: 8 total, 7 up, 8 in 2024-04-01T19:20:50.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:50 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T19:20:50.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:50 smithi062 ceph-mon[44211]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-04-01T19:20:50.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:50 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.62:0/3159221681' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "afe5f371-c892-43e9-b82e-c2d911354e9a"}]: dispatch 2024-04-01T19:20:50.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:50 smithi062 ceph-mon[44211]: from='client.34322 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "afe5f371-c892-43e9-b82e-c2d911354e9a"}]: dispatch 2024-04-01T19:20:50.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:50 smithi062 ceph-mon[44211]: from='client.34322 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "afe5f371-c892-43e9-b82e-c2d911354e9a"}]': finished 2024-04-01T19:20:50.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:50 smithi062 ceph-mon[44211]: osdmap e51: 8 total, 7 up, 8 in 2024-04-01T19:20:50.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:50 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T19:20:51.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:51 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.62:0/3503457801' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:20:51.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:51 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.62:0/3503457801' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:20:51.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:51 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.62:0/3503457801' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:20:52.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:52 smithi022 ceph-mon[39439]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-01T19:20:52.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:52 smithi188 ceph-mon[43939]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-01T19:20:52.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:52 smithi062 ceph-mon[44211]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-01T19:20:54.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:54 smithi022 ceph-mon[39439]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-04-01T19:20:54.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:54 smithi188 ceph-mon[43939]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-04-01T19:20:54.705 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:54 smithi062 ceph-mon[44211]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-04-01T19:20:56.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:56 smithi062 ceph-mon[44211]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-04-01T19:20:56.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:56 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T19:20:56.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:56 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T19:20:56.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:56 smithi022 ceph-mon[39439]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-04-01T19:20:56.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:56 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T19:20:56.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:56 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T19:20:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:56 smithi188 ceph-mon[43939]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-04-01T19:20:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:56 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T19:20:56.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:56 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T19:20:57.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:57 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-01T19:20:57.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:57 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:57 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-01T19:20:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:57 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:57.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:57 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-01T19:20:57.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:57 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:20:58.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:58 smithi022 ceph-mon[39439]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-01T19:20:58.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:20:58 smithi022 ceph-mon[39439]: Deploying daemon osd.7 on smithi062 2024-04-01T19:20:58.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:58 smithi188 ceph-mon[43939]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-01T19:20:58.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:20:58 smithi188 ceph-mon[43939]: Deploying daemon osd.7 on smithi062 2024-04-01T19:20:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:58 smithi062 ceph-mon[44211]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-01T19:20:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:20:58 smithi062 ceph-mon[44211]: Deploying daemon osd.7 on smithi062 2024-04-01T19:21:00.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:00 smithi062 ceph-mon[44211]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-01T19:21:00.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:00 smithi022 ceph-mon[39439]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-01T19:21:00.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:00 smithi188 ceph-mon[43939]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-01T19:21:02.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:02 smithi022 ceph-mon[39439]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-01T19:21:02.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:02 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:21:02.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:02 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:21:02.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:02 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:21:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:02 smithi188 ceph-mon[43939]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-01T19:21:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:02 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:21:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:02 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:21:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:02 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:21:02.730 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:02 smithi062 ceph-mon[44211]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-01T19:21:02.730 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:02 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:21:02.730 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:02 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:21:02.730 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:02 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:21:04.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:04 smithi022 ceph-mon[39439]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-01T19:21:04.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:04 smithi188 ceph-mon[43939]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-01T19:21:04.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:04 smithi062 ceph-mon[44211]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-01T19:21:05.673 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 7 on host 'smithi062' 2024-04-01T19:21:06.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:05 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:21:06.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:05 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:21:06.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:05 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:21:06.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:05 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:21:06.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:05 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:06.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:05 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:06.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:05 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:06.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:05 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:21:06.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:05 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:06.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:05 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:21:06.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:05 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:06.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:05 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:21:06.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:05 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:06.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:05 smithi062 ceph-mon[44211]: from='osd.7 v1:172.21.15.62:6812/2055487337' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-01T19:21:06.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:05 smithi062 ceph-mon[44211]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-01T19:21:06.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:05 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:06.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:05 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:06.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:05 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:21:06.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:05 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:21:06.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:05 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:21:06.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:05 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:21:06.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:05 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:21:06.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:05 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:06.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:05 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:06.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:05 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:06.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:05 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:21:06.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:05 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:06.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:05 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:21:06.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:05 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:06.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:05 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:21:06.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:05 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:06.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:05 smithi022 ceph-mon[39439]: from='osd.7 v1:172.21.15.62:6812/2055487337' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-01T19:21:06.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:05 smithi022 ceph-mon[39439]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-01T19:21:06.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:05 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:06.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:05 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:06.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:05 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:21:06.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:05 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:21:06.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:05 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:21:06.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:05 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:21:06.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:05 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:21:06.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:05 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:06.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:05 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:06.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:05 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:06.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:05 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:21:06.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:05 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:06.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:05 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:21:06.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:05 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:06.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:05 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:21:06.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:05 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:06.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:05 smithi188 ceph-mon[43939]: from='osd.7 v1:172.21.15.62:6812/2055487337' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-01T19:21:06.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:05 smithi188 ceph-mon[43939]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-01T19:21:06.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:05 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:06.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:05 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:06.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:05 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:21:06.464 DEBUG:teuthology.orchestra.run.smithi062:osd.7> sudo journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.7.service 2024-04-01T19:21:06.466 INFO:tasks.cephadm:Deploying osd.8 on smithi188 with /dev/vg_nvme/lv_4... 2024-04-01T19:21:06.466 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-01T19:21:06.497 INFO:journalctl@ceph.osd.7.smithi062.stdout:-- Logs begin at Mon 2024-04-01 19:04:11 UTC. -- 2024-04-01T19:21:06.738 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:21:06.963 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 19:21:06 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T19:21:06.833+0000 7f8acbb20700 -1 osd.7 0 waiting for initial osdmap 2024-04-01T19:21:06.963 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 19:21:06 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T19:21:06.840+0000 7f8ac7913700 -1 osd.7 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T19:21:06.963 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:06 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:21:06.964 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:06 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:21:06.964 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:06 smithi062 ceph-mon[44211]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-01T19:21:06.964 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:06 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T19:21:06.964 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:06 smithi062 ceph-mon[44211]: osdmap e52: 8 total, 7 up, 8 in 2024-04-01T19:21:06.964 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:06 smithi062 ceph-mon[44211]: from='osd.7 v1:172.21.15.62:6812/2055487337' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:21:06.964 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:06 smithi062 ceph-mon[44211]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:21:07.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:06 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:21:07.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:06 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:21:07.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:06 smithi022 ceph-mon[39439]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-01T19:21:07.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:06 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T19:21:07.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:06 smithi022 ceph-mon[39439]: osdmap e52: 8 total, 7 up, 8 in 2024-04-01T19:21:07.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:06 smithi022 ceph-mon[39439]: from='osd.7 v1:172.21.15.62:6812/2055487337' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:21:07.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:06 smithi022 ceph-mon[39439]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:21:07.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:06 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:21:07.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:06 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:21:07.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:06 smithi188 ceph-mon[43939]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-01T19:21:07.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:06 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T19:21:07.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:06 smithi188 ceph-mon[43939]: osdmap e52: 8 total, 7 up, 8 in 2024-04-01T19:21:07.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:06 smithi188 ceph-mon[43939]: from='osd.7 v1:172.21.15.62:6812/2055487337' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:21:07.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:06 smithi188 ceph-mon[43939]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:21:07.931 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:07 smithi062 ceph-mon[44211]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-01T19:21:07.931 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:07 smithi062 ceph-mon[44211]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-04-01T19:21:07.931 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:07 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T19:21:07.932 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:07 smithi062 ceph-mon[44211]: osdmap e53: 8 total, 7 up, 8 in 2024-04-01T19:21:07.932 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:07 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T19:21:08.014 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:07 smithi188 ceph-mon[43939]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-01T19:21:08.014 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:07 smithi188 ceph-mon[43939]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-04-01T19:21:08.014 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:07 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T19:21:08.015 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:07 smithi188 ceph-mon[43939]: osdmap e53: 8 total, 7 up, 8 in 2024-04-01T19:21:08.015 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:07 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T19:21:08.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:07 smithi022 ceph-mon[39439]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-01T19:21:08.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:07 smithi022 ceph-mon[39439]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-04-01T19:21:08.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:07 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T19:21:08.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:07 smithi022 ceph-mon[39439]: osdmap e53: 8 total, 7 up, 8 in 2024-04-01T19:21:08.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:07 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T19:21:08.880 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-01T19:21:08.881 INFO:teuthology.orchestra.run.smithi188.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-01T19:21:08.881 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10+0 records in 2024-04-01T19:21:08.881 INFO:teuthology.orchestra.run.smithi188.stderr:10+0 records out 2024-04-01T19:21:08.881 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0108959 s, 962 MB/s 2024-04-01T19:21:08.881 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping successful for: 2024-04-01T19:21:09.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:08 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:21:09.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:08 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:21:09.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:21:09.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:08 smithi022 ceph-mon[39439]: osd.7 v1:172.21.15.62:6812/2055487337 boot 2024-04-01T19:21:09.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:08 smithi022 ceph-mon[39439]: osdmap e54: 8 total, 8 up, 8 in 2024-04-01T19:21:09.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:08 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T19:21:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:08 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:21:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:08 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:21:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:21:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:08 smithi188 ceph-mon[43939]: osd.7 v1:172.21.15.62:6812/2055487337 boot 2024-04-01T19:21:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:08 smithi188 ceph-mon[43939]: osdmap e54: 8 total, 8 up, 8 in 2024-04-01T19:21:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:08 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T19:21:09.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:08 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:21:09.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:08 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:21:09.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:21:09.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:08 smithi062 ceph-mon[44211]: osd.7 v1:172.21.15.62:6812/2055487337 boot 2024-04-01T19:21:09.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:08 smithi062 ceph-mon[44211]: osdmap e54: 8 total, 8 up, 8 in 2024-04-01T19:21:09.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:08 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T19:21:09.539 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi188:vg_nvme/lv_4 2024-04-01T19:21:09.802 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:21:10.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:09 smithi062 ceph-mon[44211]: pgmap v183: 1 pgs: 1 peering; 0 B data, 219 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:10.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:09 smithi062 ceph-mon[44211]: osdmap e55: 8 total, 8 up, 8 in 2024-04-01T19:21:10.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:09 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:10.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:09 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:10.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:09 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:10.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:09 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:10.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:09 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:10.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:09 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:10.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:09 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:10.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:09 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:10.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:09 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:10.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:09 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:10.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:09 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:10.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:09 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:10.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:09 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:21:10.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:09 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:10.102 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:09 smithi188 ceph-mon[43939]: pgmap v183: 1 pgs: 1 peering; 0 B data, 219 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:10.102 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:09 smithi188 ceph-mon[43939]: osdmap e55: 8 total, 8 up, 8 in 2024-04-01T19:21:10.103 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:09 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:10.103 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:09 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:10.103 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:09 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:10.103 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:09 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:10.103 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:09 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:10.103 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:09 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:10.103 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:09 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:10.103 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:09 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:10.103 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:09 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:10.103 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:09 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:10.103 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:09 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:10.103 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:09 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:10.103 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:09 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:21:10.104 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:09 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:10.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:09 smithi022 ceph-mon[39439]: pgmap v183: 1 pgs: 1 peering; 0 B data, 219 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:10.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:09 smithi022 ceph-mon[39439]: osdmap e55: 8 total, 8 up, 8 in 2024-04-01T19:21:10.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:09 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:10.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:09 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:10.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:09 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:10.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:09 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:10.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:09 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:10.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:09 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:10.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:09 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:10.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:09 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:10.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:09 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:10.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:09 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:10.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:09 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:10.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:09 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:10.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:09 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:21:10.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:09 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:11.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:10 smithi022 ceph-mon[39439]: Detected new or changed devices on smithi062 2024-04-01T19:21:11.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:10 smithi022 ceph-mon[39439]: Adjusting osd_memory_target on smithi062 to 4280M 2024-04-01T19:21:11.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:10 smithi022 ceph-mon[39439]: osdmap e56: 8 total, 8 up, 8 in 2024-04-01T19:21:11.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:10 smithi188 ceph-mon[43939]: Detected new or changed devices on smithi062 2024-04-01T19:21:11.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:10 smithi188 ceph-mon[43939]: Adjusting osd_memory_target on smithi062 to 4280M 2024-04-01T19:21:11.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:10 smithi188 ceph-mon[43939]: osdmap e56: 8 total, 8 up, 8 in 2024-04-01T19:21:11.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:10 smithi062 ceph-mon[44211]: Detected new or changed devices on smithi062 2024-04-01T19:21:11.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:10 smithi062 ceph-mon[44211]: Adjusting osd_memory_target on smithi062 to 4280M 2024-04-01T19:21:11.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:10 smithi062 ceph-mon[44211]: osdmap e56: 8 total, 8 up, 8 in 2024-04-01T19:21:12.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:11 smithi022 ceph-mon[39439]: pgmap v186: 1 pgs: 1 peering; 0 B data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:12.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:11 smithi022 ceph-mon[39439]: osdmap e57: 8 total, 8 up, 8 in 2024-04-01T19:21:12.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:11 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:21:12.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:11 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:21:12.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:11 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:12.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:11 smithi188 ceph-mon[43939]: pgmap v186: 1 pgs: 1 peering; 0 B data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:12.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:11 smithi188 ceph-mon[43939]: osdmap e57: 8 total, 8 up, 8 in 2024-04-01T19:21:12.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:11 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:21:12.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:11 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:21:12.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:11 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:11 smithi062 ceph-mon[44211]: pgmap v186: 1 pgs: 1 peering; 0 B data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:11 smithi062 ceph-mon[44211]: osdmap e57: 8 total, 8 up, 8 in 2024-04-01T19:21:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:11 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:21:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:11 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:21:12.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:11 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:13.043 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:12 smithi188 ceph-mon[43939]: from='client.24334 v1:172.21.15.188:0/1031493' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:21:13.043 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:12 smithi188 ceph-mon[43939]: osdmap e58: 8 total, 8 up, 8 in 2024-04-01T19:21:13.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:12 smithi022 ceph-mon[39439]: from='client.24334 v1:172.21.15.188:0/1031493' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:21:13.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:12 smithi022 ceph-mon[39439]: osdmap e58: 8 total, 8 up, 8 in 2024-04-01T19:21:13.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:12 smithi062 ceph-mon[44211]: from='client.24334 v1:172.21.15.188:0/1031493' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:21:13.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:12 smithi062 ceph-mon[44211]: osdmap e58: 8 total, 8 up, 8 in 2024-04-01T19:21:14.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:13 smithi022 ceph-mon[39439]: pgmap v189: 1 pgs: 1 peering; 0 B data, 219 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:14.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:13 smithi188 ceph-mon[43939]: pgmap v189: 1 pgs: 1 peering; 0 B data, 219 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:14.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:13 smithi062 ceph-mon[44211]: pgmap v189: 1 pgs: 1 peering; 0 B data, 219 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:15.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:14 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.188:0/2133111976' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b7eb6461-f6fa-4a12-864c-6e6748e6337e"}]: dispatch 2024-04-01T19:21:15.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:14 smithi188 ceph-mon[43939]: from='client.24340 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b7eb6461-f6fa-4a12-864c-6e6748e6337e"}]: dispatch 2024-04-01T19:21:15.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:14 smithi188 ceph-mon[43939]: from='client.24340 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b7eb6461-f6fa-4a12-864c-6e6748e6337e"}]': finished 2024-04-01T19:21:15.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:14 smithi188 ceph-mon[43939]: osdmap e59: 9 total, 8 up, 9 in 2024-04-01T19:21:15.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:14 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:21:15.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:14 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.188:0/2133111976' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b7eb6461-f6fa-4a12-864c-6e6748e6337e"}]: dispatch 2024-04-01T19:21:15.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:14 smithi062 ceph-mon[44211]: from='client.24340 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b7eb6461-f6fa-4a12-864c-6e6748e6337e"}]: dispatch 2024-04-01T19:21:15.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:14 smithi062 ceph-mon[44211]: from='client.24340 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b7eb6461-f6fa-4a12-864c-6e6748e6337e"}]': finished 2024-04-01T19:21:15.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:14 smithi062 ceph-mon[44211]: osdmap e59: 9 total, 8 up, 9 in 2024-04-01T19:21:15.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:14 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:21:15.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:14 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.188:0/2133111976' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b7eb6461-f6fa-4a12-864c-6e6748e6337e"}]: dispatch 2024-04-01T19:21:15.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:14 smithi022 ceph-mon[39439]: from='client.24340 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b7eb6461-f6fa-4a12-864c-6e6748e6337e"}]: dispatch 2024-04-01T19:21:15.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:14 smithi022 ceph-mon[39439]: from='client.24340 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b7eb6461-f6fa-4a12-864c-6e6748e6337e"}]': finished 2024-04-01T19:21:15.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:14 smithi022 ceph-mon[39439]: osdmap e59: 9 total, 8 up, 9 in 2024-04-01T19:21:15.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:14 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:21:16.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:15 smithi188 ceph-mon[43939]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:16.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:15 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.188:0/2170520505' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:21:16.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:15 smithi062 ceph-mon[44211]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:16.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:15 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.188:0/2170520505' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:21:16.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:15 smithi022 ceph-mon[39439]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:16.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:15 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.188:0/2170520505' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:21:18.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:17 smithi188 ceph-mon[43939]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:18.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:17 smithi062 ceph-mon[44211]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:18.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:17 smithi022 ceph-mon[39439]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:20.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:19 smithi188 ceph-mon[43939]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:20.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:19 smithi062 ceph-mon[44211]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:20.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:19 smithi022 ceph-mon[39439]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:21.193 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:20 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-01T19:21:21.193 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:20 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:21.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:20 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-01T19:21:21.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:20 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:21.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:20 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-01T19:21:21.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:20 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:22.195 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:21 smithi188 ceph-mon[43939]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:22.195 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:21 smithi188 ceph-mon[43939]: Deploying daemon osd.8 on smithi188 2024-04-01T19:21:22.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:21 smithi062 ceph-mon[44211]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:22.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:21 smithi062 ceph-mon[44211]: Deploying daemon osd.8 on smithi188 2024-04-01T19:21:22.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:21 smithi022 ceph-mon[39439]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:22.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:21 smithi022 ceph-mon[39439]: Deploying daemon osd.8 on smithi188 2024-04-01T19:21:23.964 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:23 smithi188 ceph-mon[43939]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:24.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:23 smithi062 ceph-mon[44211]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:24.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:23 smithi022 ceph-mon[39439]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:25.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:24 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:21:25.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:24 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:21:25.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:24 smithi188 ceph-mon[43939]: osdmap e60: 9 total, 8 up, 9 in 2024-04-01T19:21:25.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:21:25.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:24 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:21:25.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:24 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:21:25.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:24 smithi062 ceph-mon[44211]: osdmap e60: 9 total, 8 up, 9 in 2024-04-01T19:21:25.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:21:25.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:24 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:21:25.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:24 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:21:25.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:24 smithi022 ceph-mon[39439]: osdmap e60: 9 total, 8 up, 9 in 2024-04-01T19:21:25.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:21:26.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:25 smithi062 ceph-mon[44211]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:26.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:25 smithi022 ceph-mon[39439]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:26.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:25 smithi188 ceph-mon[43939]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:27.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:27 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:27.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:27 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:27.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:27 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:21:27.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:27 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:27.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:27 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:27.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:27 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:21:27.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:27 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:27.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:27 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:27.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:27 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:21:28.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:28 smithi022 ceph-mon[39439]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:28 smithi188 ceph-mon[43939]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:28.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:28 smithi062 ceph-mon[44211]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:29.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:29 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:29.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:29 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:29.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:29 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:29.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:29 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:21:29.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:29 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:29.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:29 smithi188 ceph-mon[43939]: from='osd.8 v1:172.21.15.188:6800/2108324328' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-01T19:21:29.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:29 smithi188 ceph-mon[43939]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-01T19:21:29.727 INFO:teuthology.orchestra.run.smithi188.stdout:Created osd(s) 8 on host 'smithi188' 2024-04-01T19:21:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:29 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:29 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:29 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:29.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:29 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:21:29.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:29 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:29.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:29 smithi062 ceph-mon[44211]: from='osd.8 v1:172.21.15.188:6800/2108324328' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-01T19:21:29.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:29 smithi062 ceph-mon[44211]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-01T19:21:29.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:29 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:29.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:29 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:29.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:29 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:29.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:29 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:21:29.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:29 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:29.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:29 smithi022 ceph-mon[39439]: from='osd.8 v1:172.21.15.188:6800/2108324328' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-01T19:21:29.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:29 smithi022 ceph-mon[39439]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-01T19:21:30.468 DEBUG:teuthology.orchestra.run.smithi188:osd.8> sudo journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.8.service 2024-04-01T19:21:30.470 INFO:tasks.cephadm:Deploying osd.9 on smithi188 with /dev/vg_nvme/lv_3... 2024-04-01T19:21:30.471 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-01T19:21:30.503 INFO:journalctl@ceph.osd.8.smithi188.stdout:-- Logs begin at Mon 2024-04-01 19:04:09 UTC. -- 2024-04-01T19:21:30.729 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:30 smithi188 ceph-mon[43939]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:30.729 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:30 smithi188 ceph-mon[43939]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-01T19:21:30.729 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:30 smithi188 ceph-mon[43939]: osdmap e61: 9 total, 8 up, 9 in 2024-04-01T19:21:30.729 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:30 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:21:30.729 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:30 smithi188 ceph-mon[43939]: from='osd.8 v1:172.21.15.188:6800/2108324328' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:21:30.729 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:30 smithi188 ceph-mon[43939]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:21:30.729 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:30 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:30.730 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:30 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:30.730 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:30 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:21:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:30 smithi062 ceph-mon[44211]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:30.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:30 smithi062 ceph-mon[44211]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-01T19:21:30.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:30 smithi062 ceph-mon[44211]: osdmap e61: 9 total, 8 up, 9 in 2024-04-01T19:21:30.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:30 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:21:30.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:30 smithi062 ceph-mon[44211]: from='osd.8 v1:172.21.15.188:6800/2108324328' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:21:30.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:30 smithi062 ceph-mon[44211]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:21:30.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:30 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:30.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:30 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:30.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:30 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:21:30.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:30 smithi022 ceph-mon[39439]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:30.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:30 smithi022 ceph-mon[39439]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-01T19:21:30.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:30 smithi022 ceph-mon[39439]: osdmap e61: 9 total, 8 up, 9 in 2024-04-01T19:21:30.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:30 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:21:30.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:30 smithi022 ceph-mon[39439]: from='osd.8 v1:172.21.15.188:6800/2108324328' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:21:30.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:30 smithi022 ceph-mon[39439]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:21:30.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:30 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:30.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:30 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:30.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:30 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:21:31.125 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 19:21:30 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[49836]: 2024-04-01T19:21:30.824+0000 7f3bcd5b6700 -1 osd.8 0 waiting for initial osdmap 2024-04-01T19:21:31.125 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 19:21:30 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[49836]: 2024-04-01T19:21:30.825+0000 7f3bc0d31700 -1 osd.8 0 failed to load OSD map for epoch 10, got 0 bytes 2024-04-01T19:21:31.125 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 19:21:30 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[49836]: 2024-04-01T19:21:30.834+0000 7f3bc53a1700 -1 osd.8 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T19:21:31.687 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:21:31.689 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:31 smithi188 ceph-mon[43939]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-04-01T19:21:31.689 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:31 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:21:31.689 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:31 smithi188 ceph-mon[43939]: osdmap e62: 9 total, 8 up, 9 in 2024-04-01T19:21:31.689 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:31 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:21:31.689 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:31 smithi188 ceph-mon[43939]: from='osd.8 ' entity='osd.8' 2024-04-01T19:21:31.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:31 smithi062 ceph-mon[44211]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-04-01T19:21:31.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:31 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:21:31.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:31 smithi062 ceph-mon[44211]: osdmap e62: 9 total, 8 up, 9 in 2024-04-01T19:21:31.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:31 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:21:31.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:31 smithi062 ceph-mon[44211]: from='osd.8 ' entity='osd.8' 2024-04-01T19:21:31.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:31 smithi022 ceph-mon[39439]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-04-01T19:21:31.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:31 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:21:31.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:31 smithi022 ceph-mon[39439]: osdmap e62: 9 total, 8 up, 9 in 2024-04-01T19:21:31.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:31 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:21:31.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:31 smithi022 ceph-mon[39439]: from='osd.8 ' entity='osd.8' 2024-04-01T19:21:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:32 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:21:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:32 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:21:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:21:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:32 smithi188 ceph-mon[43939]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:21:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:21:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:32 smithi188 ceph-mon[43939]: osd.8 v1:172.21.15.188:6800/2108324328 boot 2024-04-01T19:21:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:32 smithi188 ceph-mon[43939]: osdmap e63: 9 total, 9 up, 9 in 2024-04-01T19:21:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:21:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:32 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:21:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:32 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:21:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:21:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:32 smithi062 ceph-mon[44211]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:21:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:21:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:32 smithi062 ceph-mon[44211]: osd.8 v1:172.21.15.188:6800/2108324328 boot 2024-04-01T19:21:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:32 smithi062 ceph-mon[44211]: osdmap e63: 9 total, 9 up, 9 in 2024-04-01T19:21:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:21:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:32 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:21:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:32 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:21:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:21:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:32 smithi022 ceph-mon[39439]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-04-01T19:21:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:21:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:21:32.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:32 smithi022 ceph-mon[39439]: osd.8 v1:172.21.15.188:6800/2108324328 boot 2024-04-01T19:21:32.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:32 smithi022 ceph-mon[39439]: osdmap e63: 9 total, 9 up, 9 in 2024-04-01T19:21:32.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:21:34.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:33 smithi022 ceph-mon[39439]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:34.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:33 smithi022 ceph-mon[39439]: osdmap e64: 9 total, 9 up, 9 in 2024-04-01T19:21:34.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:33 smithi188 ceph-mon[43939]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:34.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:33 smithi188 ceph-mon[43939]: osdmap e64: 9 total, 9 up, 9 in 2024-04-01T19:21:34.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:33 smithi062 ceph-mon[44211]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:34.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:33 smithi062 ceph-mon[44211]: osdmap e64: 9 total, 9 up, 9 in 2024-04-01T19:21:34.760 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-01T19:21:34.760 INFO:teuthology.orchestra.run.smithi188.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-01T19:21:34.761 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10+0 records in 2024-04-01T19:21:34.761 INFO:teuthology.orchestra.run.smithi188.stderr:10+0 records out 2024-04-01T19:21:34.761 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0109633 s, 956 MB/s 2024-04-01T19:21:34.761 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping successful for: 2024-04-01T19:21:35.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:34 smithi022 ceph-mon[39439]: osdmap e65: 9 total, 9 up, 9 in 2024-04-01T19:21:35.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:34 smithi022 ceph-mon[39439]: Detected new or changed devices on smithi188 2024-04-01T19:21:35.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:34 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:35.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:34 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:35.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:34 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:35.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:34 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:35.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:34 smithi022 ceph-mon[39439]: Adjusting osd_memory_target on smithi188 to 21218M 2024-04-01T19:21:35.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:34 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:35.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:34 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:35.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:34 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:21:35.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:34 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:35.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:34 smithi188 ceph-mon[43939]: osdmap e65: 9 total, 9 up, 9 in 2024-04-01T19:21:35.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:34 smithi188 ceph-mon[43939]: Detected new or changed devices on smithi188 2024-04-01T19:21:35.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:34 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:35.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:34 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:35.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:34 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:35.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:34 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:35.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:34 smithi188 ceph-mon[43939]: Adjusting osd_memory_target on smithi188 to 21218M 2024-04-01T19:21:35.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:34 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:35.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:34 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:35.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:34 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:21:35.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:34 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:35.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:34 smithi062 ceph-mon[44211]: osdmap e65: 9 total, 9 up, 9 in 2024-04-01T19:21:35.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:34 smithi062 ceph-mon[44211]: Detected new or changed devices on smithi188 2024-04-01T19:21:35.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:34 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:35.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:34 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:35.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:34 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:35.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:34 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:21:35.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:34 smithi062 ceph-mon[44211]: Adjusting osd_memory_target on smithi188 to 21218M 2024-04-01T19:21:35.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:34 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:35.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:34 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:35.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:34 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:21:35.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:34 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:35.604 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi188:vg_nvme/lv_3 2024-04-01T19:21:35.867 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:21:36.426 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:36 smithi188 ceph-mon[43939]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:36.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:36 smithi062 ceph-mon[44211]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:36.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:36 smithi022 ceph-mon[39439]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:38.507 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:38 smithi188 ceph-mon[43939]: pgmap v208: 1 pgs: 1 peering; 577 KiB data, 246 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:38.507 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:38 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:21:38.508 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:38 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:21:38.508 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:38 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:38.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:38 smithi062 ceph-mon[44211]: pgmap v208: 1 pgs: 1 peering; 577 KiB data, 246 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:38.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:38 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:21:38.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:38 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:21:38.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:38 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:38 smithi022 ceph-mon[39439]: pgmap v208: 1 pgs: 1 peering; 577 KiB data, 246 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:38 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:21:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:38 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:21:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:38 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:39.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:39 smithi188 ceph-mon[43939]: from='client.24361 v1:172.21.15.188:0/3185285403' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:21:39.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:39 smithi022 ceph-mon[39439]: from='client.24361 v1:172.21.15.188:0/3185285403' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:21:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:39 smithi062 ceph-mon[44211]: from='client.24361 v1:172.21.15.188:0/3185285403' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:21:40.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:40 smithi062 ceph-mon[44211]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-04-01T19:21:40.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:40 smithi022 ceph-mon[39439]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-04-01T19:21:40.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:40 smithi188 ceph-mon[43939]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-04-01T19:21:41.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:41 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.188:0/1057254497' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d496ad5-46bf-485a-81d9-2b9da2a59882"}]: dispatch 2024-04-01T19:21:41.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:41 smithi022 ceph-mon[39439]: from='client.24367 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d496ad5-46bf-485a-81d9-2b9da2a59882"}]: dispatch 2024-04-01T19:21:41.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:41 smithi022 ceph-mon[39439]: from='client.24367 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7d496ad5-46bf-485a-81d9-2b9da2a59882"}]': finished 2024-04-01T19:21:41.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:41 smithi022 ceph-mon[39439]: osdmap e66: 10 total, 9 up, 10 in 2024-04-01T19:21:41.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:41 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T19:21:41.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:41 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.188:0/1570892774' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:21:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:41 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.188:0/1057254497' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d496ad5-46bf-485a-81d9-2b9da2a59882"}]: dispatch 2024-04-01T19:21:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:41 smithi188 ceph-mon[43939]: from='client.24367 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d496ad5-46bf-485a-81d9-2b9da2a59882"}]: dispatch 2024-04-01T19:21:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:41 smithi188 ceph-mon[43939]: from='client.24367 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7d496ad5-46bf-485a-81d9-2b9da2a59882"}]': finished 2024-04-01T19:21:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:41 smithi188 ceph-mon[43939]: osdmap e66: 10 total, 9 up, 10 in 2024-04-01T19:21:41.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:41 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T19:21:41.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:41 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.188:0/1570892774' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:21:41.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:41 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.188:0/1057254497' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d496ad5-46bf-485a-81d9-2b9da2a59882"}]: dispatch 2024-04-01T19:21:41.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:41 smithi062 ceph-mon[44211]: from='client.24367 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d496ad5-46bf-485a-81d9-2b9da2a59882"}]: dispatch 2024-04-01T19:21:41.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:41 smithi062 ceph-mon[44211]: from='client.24367 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7d496ad5-46bf-485a-81d9-2b9da2a59882"}]': finished 2024-04-01T19:21:41.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:41 smithi062 ceph-mon[44211]: osdmap e66: 10 total, 9 up, 10 in 2024-04-01T19:21:41.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:41 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T19:21:41.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:41 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.188:0/1570892774' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:21:42.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:42 smithi022 ceph-mon[39439]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-04-01T19:21:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:42 smithi188 ceph-mon[43939]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-04-01T19:21:42.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:42 smithi062 ceph-mon[44211]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-04-01T19:21:43.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:43 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:21:43.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:43 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:21:43.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:43 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:21:43.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:43 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:21:43.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:43 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:21:43.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:43 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:21:44.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:44 smithi188 ceph-mon[43939]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-01T19:21:44.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:44 smithi188 ceph-mon[43939]: osdmap e67: 10 total, 9 up, 10 in 2024-04-01T19:21:44.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:44 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T19:21:44.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:44 smithi022 ceph-mon[39439]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-01T19:21:44.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:44 smithi022 ceph-mon[39439]: osdmap e67: 10 total, 9 up, 10 in 2024-04-01T19:21:44.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:44 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T19:21:44.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:44 smithi062 ceph-mon[44211]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-01T19:21:44.801 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:44 smithi062 ceph-mon[44211]: osdmap e67: 10 total, 9 up, 10 in 2024-04-01T19:21:44.801 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:44 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T19:21:46.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:46 smithi022 ceph-mon[39439]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-04-01T19:21:46.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:46 smithi188 ceph-mon[43939]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-04-01T19:21:46.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:46 smithi062 ceph-mon[44211]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-04-01T19:21:47.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-01T19:21:47.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:47.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-01T19:21:47.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:47.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-01T19:21:47.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:48.547 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:48 smithi188 ceph-mon[43939]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:48.547 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:48 smithi188 ceph-mon[43939]: Deploying daemon osd.9 on smithi188 2024-04-01T19:21:48.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:48 smithi022 ceph-mon[39439]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:48.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:48 smithi022 ceph-mon[39439]: Deploying daemon osd.9 on smithi188 2024-04-01T19:21:48.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:48 smithi062 ceph-mon[44211]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:48.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:48 smithi062 ceph-mon[44211]: Deploying daemon osd.9 on smithi188 2024-04-01T19:21:50.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:50 smithi022 ceph-mon[39439]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:50 smithi188 ceph-mon[43939]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:50.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:50 smithi062 ceph-mon[44211]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:51.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:51 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:21:51.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:51 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:21:51.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:51 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:21:51.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:51 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:21:51.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:51 smithi022 ceph-mon[39439]: osdmap e68: 10 total, 9 up, 10 in 2024-04-01T19:21:51.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:51 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T19:21:51.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:51 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:21:51.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:51 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:21:51.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:51 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:21:51.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:51 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:21:51.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:51 smithi188 ceph-mon[43939]: osdmap e68: 10 total, 9 up, 10 in 2024-04-01T19:21:51.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:51 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T19:21:51.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:51 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:21:51.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:51 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:21:51.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:51 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:21:51.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:51 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:21:51.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:51 smithi062 ceph-mon[44211]: osdmap e68: 10 total, 9 up, 10 in 2024-04-01T19:21:51.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:51 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T19:21:52.594 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:52 smithi188 ceph-mon[43939]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:52.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:52 smithi022 ceph-mon[39439]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:52.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:52 smithi062 ceph-mon[44211]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:53.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:53 smithi188 ceph-mon[43939]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:53.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:53 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:53.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:53 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:21:53.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:53 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:54.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:53 smithi062 ceph-mon[44211]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:54.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:53 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:54.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:53 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:21:54.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:53 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:54.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:53 smithi022 ceph-mon[39439]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:54.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:53 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:54.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:53 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:21:54.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:53 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:56.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:55 smithi188 ceph-mon[43939]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:56.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:55 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:56.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:55 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:56.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:55 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:56.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:55 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:21:56.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:55 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:56.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:55 smithi188 ceph-mon[43939]: from='osd.9 v1:172.21.15.188:6804/1755990887' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-01T19:21:56.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:55 smithi188 ceph-mon[43939]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-01T19:21:56.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:55 smithi062 ceph-mon[44211]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:56.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:55 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:56.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:55 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:56.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:55 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:56.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:55 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:21:56.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:55 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:56.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:55 smithi062 ceph-mon[44211]: from='osd.9 v1:172.21.15.188:6804/1755990887' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-01T19:21:56.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:55 smithi062 ceph-mon[44211]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-01T19:21:56.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:55 smithi022 ceph-mon[39439]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:56.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:55 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:56.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:55 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:56.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:55 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:21:56.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:55 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:21:56.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:55 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:56.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:55 smithi022 ceph-mon[39439]: from='osd.9 v1:172.21.15.188:6804/1755990887' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-01T19:21:56.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:55 smithi022 ceph-mon[39439]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-01T19:21:56.632 INFO:teuthology.orchestra.run.smithi188.stdout:Created osd(s) 9 on host 'smithi188' 2024-04-01T19:21:57.296 DEBUG:teuthology.orchestra.run.smithi188:osd.9> sudo journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.9.service 2024-04-01T19:21:57.298 INFO:tasks.cephadm:Deploying osd.10 on smithi188 with /dev/vg_nvme/lv_2... 2024-04-01T19:21:57.298 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-01T19:21:57.331 INFO:journalctl@ceph.osd.9.smithi188.stdout:-- Logs begin at Mon 2024-04-01 19:04:09 UTC. -- 2024-04-01T19:21:57.578 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:57 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:21:57.578 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:57 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:21:57.578 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:57 smithi188 ceph-mon[43939]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-01T19:21:57.578 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:57 smithi188 ceph-mon[43939]: osdmap e69: 10 total, 9 up, 10 in 2024-04-01T19:21:57.578 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:57 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T19:21:57.578 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:57 smithi188 ceph-mon[43939]: from='osd.9 v1:172.21.15.188:6804/1755990887' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:21:57.578 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:57 smithi188 ceph-mon[43939]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:21:57.578 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:57 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:57.579 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:57 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:57.579 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:57 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:21:57.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:57 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:21:57.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:57 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:21:57.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:57 smithi062 ceph-mon[44211]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-01T19:21:57.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:57 smithi062 ceph-mon[44211]: osdmap e69: 10 total, 9 up, 10 in 2024-04-01T19:21:57.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:57 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T19:21:57.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:57 smithi062 ceph-mon[44211]: from='osd.9 v1:172.21.15.188:6804/1755990887' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:21:57.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:57 smithi062 ceph-mon[44211]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:21:57.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:57 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:57.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:57 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:57.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:57 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:21:57.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:57 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:21:57.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:57 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:21:57.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:57 smithi022 ceph-mon[39439]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-01T19:21:57.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:57 smithi022 ceph-mon[39439]: osdmap e69: 10 total, 9 up, 10 in 2024-04-01T19:21:57.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:57 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T19:21:57.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:57 smithi022 ceph-mon[39439]: from='osd.9 v1:172.21.15.188:6804/1755990887' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:21:57.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:57 smithi022 ceph-mon[39439]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:21:57.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:57 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:57.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:57 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:21:57.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:57 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:21:58.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 19:21:57 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T19:21:57.840+0000 7f0ce145b700 -1 osd.9 0 waiting for initial osdmap 2024-04-01T19:21:58.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 19:21:57 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T19:21:57.840+0000 7f0cd4bd6700 -1 osd.9 0 failed to load OSD map for epoch 10, got 0 bytes 2024-04-01T19:21:58.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 19:21:57 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T19:21:57.849+0000 7f0cd9246700 -1 osd.9 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T19:21:58.198 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:21:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:58 smithi062 ceph-mon[44211]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:58.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:58 smithi062 ceph-mon[44211]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-04-01T19:21:58.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:58 smithi062 ceph-mon[44211]: osdmap e70: 10 total, 9 up, 10 in 2024-04-01T19:21:58.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:58 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T19:21:58.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:58 smithi062 ceph-mon[44211]: from='osd.9 ' entity='osd.9' 2024-04-01T19:21:58.847 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:58 smithi188 ceph-mon[43939]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:58.847 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:58 smithi188 ceph-mon[43939]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-04-01T19:21:58.847 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:58 smithi188 ceph-mon[43939]: osdmap e70: 10 total, 9 up, 10 in 2024-04-01T19:21:58.847 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:58 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T19:21:58.847 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:58 smithi188 ceph-mon[43939]: from='osd.9 ' entity='osd.9' 2024-04-01T19:21:58.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:58 smithi022 ceph-mon[39439]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:21:58.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:58 smithi022 ceph-mon[39439]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-04-01T19:21:58.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:58 smithi022 ceph-mon[39439]: osdmap e70: 10 total, 9 up, 10 in 2024-04-01T19:21:58.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:58 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T19:21:58.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:58 smithi022 ceph-mon[39439]: from='osd.9 ' entity='osd.9' 2024-04-01T19:21:59.658 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:59 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:21:59.658 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:59 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:21:59.658 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:21:59.659 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:21:59.659 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:59 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T19:21:59.659 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:59 smithi188 ceph-mon[43939]: osd.9 v1:172.21.15.188:6804/1755990887 boot 2024-04-01T19:21:59.659 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:59 smithi188 ceph-mon[43939]: osdmap e71: 10 total, 10 up, 10 in 2024-04-01T19:21:59.659 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:21:59 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T19:21:59.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:59 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:21:59.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:59 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:21:59.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:21:59.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:21:59.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:59 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T19:21:59.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:59 smithi062 ceph-mon[44211]: osd.9 v1:172.21.15.188:6804/1755990887 boot 2024-04-01T19:21:59.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:59 smithi062 ceph-mon[44211]: osdmap e71: 10 total, 10 up, 10 in 2024-04-01T19:21:59.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:21:59 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T19:21:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:59 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:21:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:59 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:21:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:21:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:21:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:59 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T19:21:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:59 smithi022 ceph-mon[39439]: osd.9 v1:172.21.15.188:6804/1755990887 boot 2024-04-01T19:21:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:59 smithi022 ceph-mon[39439]: osdmap e71: 10 total, 10 up, 10 in 2024-04-01T19:21:59.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:21:59 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T19:22:00.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:00 smithi188 ceph-mon[43939]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:22:00.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:00 smithi062 ceph-mon[44211]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:22:00.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:00 smithi022 ceph-mon[39439]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 247 MiB used, 804 GiB / 805 GiB avail 2024-04-01T19:22:01.254 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-01T19:22:01.254 INFO:teuthology.orchestra.run.smithi188.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-01T19:22:01.254 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10+0 records in 2024-04-01T19:22:01.254 INFO:teuthology.orchestra.run.smithi188.stderr:10+0 records out 2024-04-01T19:22:01.254 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0109737 s, 956 MB/s 2024-04-01T19:22:01.254 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping successful for: 2024-04-01T19:22:02.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:01 smithi062 ceph-mon[44211]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:02.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:01 smithi062 ceph-mon[44211]: osdmap e72: 10 total, 10 up, 10 in 2024-04-01T19:22:02.027 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:01 smithi188 ceph-mon[43939]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:02.027 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:01 smithi188 ceph-mon[43939]: osdmap e72: 10 total, 10 up, 10 in 2024-04-01T19:22:02.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:01 smithi022 ceph-mon[39439]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:02.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:01 smithi022 ceph-mon[39439]: osdmap e72: 10 total, 10 up, 10 in 2024-04-01T19:22:02.383 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi188:vg_nvme/lv_2 2024-04-01T19:22:02.643 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:22:03.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:02 smithi062 ceph-mon[44211]: Detected new or changed devices on smithi188 2024-04-01T19:22:03.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:02 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:03.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:02 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:03.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:02 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:03.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:02 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:03.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:02 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:03.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:02 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:03.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:02 smithi062 ceph-mon[44211]: Adjusting osd_memory_target on smithi188 to 10609M 2024-04-01T19:22:03.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:02 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:03.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:02 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:03.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:02 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:22:03.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:02 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:03.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:02 smithi022 ceph-mon[39439]: Detected new or changed devices on smithi188 2024-04-01T19:22:03.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:02 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:03.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:02 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:03.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:02 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:03.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:02 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:03.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:02 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:03.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:02 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:03.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:02 smithi022 ceph-mon[39439]: Adjusting osd_memory_target on smithi188 to 10609M 2024-04-01T19:22:03.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:02 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:03.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:02 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:03.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:02 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:22:03.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:02 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:03.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:02 smithi188 ceph-mon[43939]: Detected new or changed devices on smithi188 2024-04-01T19:22:03.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:02 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:03.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:02 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:03.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:02 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:03.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:02 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:03.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:02 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:03.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:02 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:03.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:02 smithi188 ceph-mon[43939]: Adjusting osd_memory_target on smithi188 to 10609M 2024-04-01T19:22:03.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:02 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:03.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:02 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:03.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:02 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:22:03.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:02 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:03.847 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:03 smithi188 ceph-mon[43939]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:04.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:03 smithi062 ceph-mon[44211]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:04.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:03 smithi022 ceph-mon[39439]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:05.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:04 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:22:05.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:04 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:22:05.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:04 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:05.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:04 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:22:05.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:04 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:22:05.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:04 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:05.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:04 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:22:05.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:04 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:22:05.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:04 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:06.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:05 smithi062 ceph-mon[44211]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:06.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:05 smithi062 ceph-mon[44211]: from='client.24388 v1:172.21.15.188:0/3900018012' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:22:06.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:05 smithi022 ceph-mon[39439]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:06.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:05 smithi022 ceph-mon[39439]: from='client.24388 v1:172.21.15.188:0/3900018012' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:22:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:05 smithi188 ceph-mon[43939]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:05 smithi188 ceph-mon[43939]: from='client.24388 v1:172.21.15.188:0/3900018012' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:22:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:07 smithi062 ceph-mon[44211]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:07 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T19:22:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:07 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T19:22:08.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:07 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.188:0/2989802538' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6cbb80ce-37f7-48df-9090-09a6068e4490"}]: dispatch 2024-04-01T19:22:08.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:07 smithi062 ceph-mon[44211]: from='client.24394 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6cbb80ce-37f7-48df-9090-09a6068e4490"}]: dispatch 2024-04-01T19:22:08.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:07 smithi062 ceph-mon[44211]: from='client.24394 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6cbb80ce-37f7-48df-9090-09a6068e4490"}]': finished 2024-04-01T19:22:08.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:07 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T19:22:08.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:07 smithi062 ceph-mon[44211]: osdmap e73: 11 total, 10 up, 11 in 2024-04-01T19:22:08.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:07 smithi022 ceph-mon[39439]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:08.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:07 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T19:22:08.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:07 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T19:22:08.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:07 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.188:0/2989802538' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6cbb80ce-37f7-48df-9090-09a6068e4490"}]: dispatch 2024-04-01T19:22:08.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:07 smithi022 ceph-mon[39439]: from='client.24394 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6cbb80ce-37f7-48df-9090-09a6068e4490"}]: dispatch 2024-04-01T19:22:08.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:07 smithi022 ceph-mon[39439]: from='client.24394 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6cbb80ce-37f7-48df-9090-09a6068e4490"}]': finished 2024-04-01T19:22:08.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:07 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T19:22:08.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:07 smithi022 ceph-mon[39439]: osdmap e73: 11 total, 10 up, 11 in 2024-04-01T19:22:08.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:07 smithi188 ceph-mon[43939]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:08.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:07 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T19:22:08.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:07 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T19:22:08.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:07 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.188:0/2989802538' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6cbb80ce-37f7-48df-9090-09a6068e4490"}]: dispatch 2024-04-01T19:22:08.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:07 smithi188 ceph-mon[43939]: from='client.24394 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6cbb80ce-37f7-48df-9090-09a6068e4490"}]: dispatch 2024-04-01T19:22:08.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:07 smithi188 ceph-mon[43939]: from='client.24394 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6cbb80ce-37f7-48df-9090-09a6068e4490"}]': finished 2024-04-01T19:22:08.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:07 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T19:22:08.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:07 smithi188 ceph-mon[43939]: osdmap e73: 11 total, 10 up, 11 in 2024-04-01T19:22:09.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:08 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.188:0/3214567030' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:22:09.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:08 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.188:0/3214567030' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:22:09.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:08 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.188:0/3214567030' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:22:10.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:09 smithi062 ceph-mon[44211]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:10.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:09 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:22:10.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:09 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:22:10.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:09 smithi062 ceph-mon[44211]: osdmap e74: 11 total, 10 up, 11 in 2024-04-01T19:22:10.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:09 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T19:22:10.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:09 smithi022 ceph-mon[39439]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:10.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:09 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:22:10.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:09 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:22:10.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:09 smithi022 ceph-mon[39439]: osdmap e74: 11 total, 10 up, 11 in 2024-04-01T19:22:10.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:09 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T19:22:10.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:09 smithi188 ceph-mon[43939]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:10.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:09 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:22:10.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:09 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:22:10.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:09 smithi188 ceph-mon[43939]: osdmap e74: 11 total, 10 up, 11 in 2024-04-01T19:22:10.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:09 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T19:22:11.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:11 smithi188 ceph-mon[43939]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:12.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:11 smithi022 ceph-mon[39439]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:11 smithi062 ceph-mon[44211]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:14.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:13 smithi022 ceph-mon[39439]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:14.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:13 smithi188 ceph-mon[43939]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:14.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:13 smithi062 ceph-mon[44211]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:15.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:14 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-01T19:22:15.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:14 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:15.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:14 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-01T19:22:15.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:14 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:15.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:14 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-01T19:22:15.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:14 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:16.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:15 smithi022 ceph-mon[39439]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:16.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:15 smithi022 ceph-mon[39439]: Deploying daemon osd.10 on smithi188 2024-04-01T19:22:16.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:15 smithi188 ceph-mon[43939]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:16.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:15 smithi188 ceph-mon[43939]: Deploying daemon osd.10 on smithi188 2024-04-01T19:22:16.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:15 smithi062 ceph-mon[44211]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:16.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:15 smithi062 ceph-mon[44211]: Deploying daemon osd.10 on smithi188 2024-04-01T19:22:18.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:17 smithi022 ceph-mon[39439]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:18.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:17 smithi188 ceph-mon[43939]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:18.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:17 smithi062 ceph-mon[44211]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:19.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:19 smithi188 ceph-mon[43939]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:20.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:19 smithi022 ceph-mon[39439]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:20.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:19 smithi062 ceph-mon[44211]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:21.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:21 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:21.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:21 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:21.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:21 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:22:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:21 smithi062 ceph-mon[44211]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:21.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:21 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:21.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:21 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:21.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:21 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:22:21.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:21 smithi022 ceph-mon[39439]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:21.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:21 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:21.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:21 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:21 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:22:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:21 smithi188 ceph-mon[43939]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:24.346 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:24 smithi188 ceph-mon[43939]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:24.346 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:24 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:24.346 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:24 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:24.346 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:24.347 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:22:24.347 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:24 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:24.347 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:24 smithi188 ceph-mon[43939]: from='osd.10 v1:172.21.15.188:6808/3777340429' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-01T19:22:24.347 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:24 smithi188 ceph-mon[43939]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-01T19:22:24.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:24 smithi022 ceph-mon[39439]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:24.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:24 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:24.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:24 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:24.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:24.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:22:24.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:24 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:24.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:24 smithi022 ceph-mon[39439]: from='osd.10 v1:172.21.15.188:6808/3777340429' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-01T19:22:24.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:24 smithi022 ceph-mon[39439]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-01T19:22:24.402 INFO:teuthology.orchestra.run.smithi188.stdout:Created osd(s) 10 on host 'smithi188' 2024-04-01T19:22:24.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:24 smithi062 ceph-mon[44211]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:24.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:24 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:24.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:24 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:24.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:24.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:22:24.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:24 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:24.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:24 smithi062 ceph-mon[44211]: from='osd.10 v1:172.21.15.188:6808/3777340429' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-01T19:22:24.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:24 smithi062 ceph-mon[44211]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-01T19:22:25.309 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:25 smithi188 ceph-mon[43939]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-01T19:22:25.309 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:25 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T19:22:25.309 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:25 smithi188 ceph-mon[43939]: osdmap e75: 11 total, 10 up, 11 in 2024-04-01T19:22:25.310 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:25 smithi188 ceph-mon[43939]: from='osd.10 v1:172.21.15.188:6808/3777340429' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:22:25.310 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:25 smithi188 ceph-mon[43939]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:22:25.310 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:25 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:25.310 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:25 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:25.310 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:25 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:22:25.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:25 smithi022 ceph-mon[39439]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-01T19:22:25.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:25 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T19:22:25.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:25 smithi022 ceph-mon[39439]: osdmap e75: 11 total, 10 up, 11 in 2024-04-01T19:22:25.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:25 smithi022 ceph-mon[39439]: from='osd.10 v1:172.21.15.188:6808/3777340429' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:22:25.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:25 smithi022 ceph-mon[39439]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:22:25.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:25 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:25.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:25 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:25.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:25 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:22:25.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:25 smithi062 ceph-mon[44211]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-01T19:22:25.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:25 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T19:22:25.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:25 smithi062 ceph-mon[44211]: osdmap e75: 11 total, 10 up, 11 in 2024-04-01T19:22:25.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:25 smithi062 ceph-mon[44211]: from='osd.10 v1:172.21.15.188:6808/3777340429' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:22:25.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:25 smithi062 ceph-mon[44211]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:22:25.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:25 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:25.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:25 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:25.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:25 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:22:25.930 DEBUG:teuthology.orchestra.run.smithi188:osd.10> sudo journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.10.service 2024-04-01T19:22:25.932 INFO:tasks.cephadm:Deploying osd.11 on smithi188 with /dev/vg_nvme/lv_1... 2024-04-01T19:22:25.933 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-01T19:22:25.961 INFO:journalctl@ceph.osd.10.smithi188.stdout:-- Logs begin at Mon 2024-04-01 19:04:09 UTC. -- 2024-04-01T19:22:26.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:26 smithi022 ceph-mon[39439]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:26.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:26 smithi022 ceph-mon[39439]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-04-01T19:22:26.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:26 smithi022 ceph-mon[39439]: osdmap e76: 11 total, 10 up, 11 in 2024-04-01T19:22:26.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:26 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T19:22:26.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:26 smithi022 ceph-mon[39439]: from='osd.10 ' entity='osd.10' 2024-04-01T19:22:26.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:26 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:22:26.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:26 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:22:26.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:26 smithi188 ceph-mon[43939]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:26.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:26 smithi188 ceph-mon[43939]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-04-01T19:22:26.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:26 smithi188 ceph-mon[43939]: osdmap e76: 11 total, 10 up, 11 in 2024-04-01T19:22:26.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:26 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T19:22:26.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:26 smithi188 ceph-mon[43939]: from='osd.10 ' entity='osd.10' 2024-04-01T19:22:26.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:26 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:22:26.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:26 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:22:26.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:26 smithi062 ceph-mon[44211]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:26.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:26 smithi062 ceph-mon[44211]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-04-01T19:22:26.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:26 smithi062 ceph-mon[44211]: osdmap e76: 11 total, 10 up, 11 in 2024-04-01T19:22:26.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:26 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T19:22:26.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:26 smithi062 ceph-mon[44211]: from='osd.10 ' entity='osd.10' 2024-04-01T19:22:26.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:26 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:22:26.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:26 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:22:27.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:27 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:22:27.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:27 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:22:27.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:22:27.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:22:27.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:27 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T19:22:27.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:27 smithi188 ceph-mon[43939]: osd.10 v1:172.21.15.188:6808/3777340429 boot 2024-04-01T19:22:27.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:27 smithi188 ceph-mon[43939]: osdmap e77: 11 total, 11 up, 11 in 2024-04-01T19:22:27.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:27 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T19:22:27.141 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:22:27.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:27 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:22:27.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:27 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:22:27.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:22:27.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:22:27.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:27 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T19:22:27.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:27 smithi022 ceph-mon[39439]: osd.10 v1:172.21.15.188:6808/3777340429 boot 2024-04-01T19:22:27.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:27 smithi022 ceph-mon[39439]: osdmap e77: 11 total, 11 up, 11 in 2024-04-01T19:22:27.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:27 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T19:22:27.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:27 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:22:27.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:27 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:22:27.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:22:27.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:22:27.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:27 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T19:22:27.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:27 smithi062 ceph-mon[44211]: osd.10 v1:172.21.15.188:6808/3777340429 boot 2024-04-01T19:22:27.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:27 smithi062 ceph-mon[44211]: osdmap e77: 11 total, 11 up, 11 in 2024-04-01T19:22:27.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:27 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T19:22:28.330 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:28 smithi188 ceph-mon[43939]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:28.330 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:28 smithi188 ceph-mon[43939]: osdmap e78: 11 total, 11 up, 11 in 2024-04-01T19:22:28.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:28 smithi022 ceph-mon[39439]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:28.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:28 smithi022 ceph-mon[39439]: osdmap e78: 11 total, 11 up, 11 in 2024-04-01T19:22:28.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:28 smithi062 ceph-mon[44211]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 894 GiB / 894 GiB avail 2024-04-01T19:22:28.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:28 smithi062 ceph-mon[44211]: osdmap e78: 11 total, 11 up, 11 in 2024-04-01T19:22:30.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:29 smithi062 ceph-mon[44211]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:30.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:29 smithi062 ceph-mon[44211]: Detected new or changed devices on smithi188 2024-04-01T19:22:30.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:29 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:30.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:29 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:29 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:29 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:29 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:29 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:29 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:29 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:29 smithi062 ceph-mon[44211]: Adjusting osd_memory_target on smithi188 to 7072M 2024-04-01T19:22:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:29 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:29 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:29 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:22:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:29 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:30.023 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-01T19:22:30.023 INFO:teuthology.orchestra.run.smithi188.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-01T19:22:30.023 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10+0 records in 2024-04-01T19:22:30.023 INFO:teuthology.orchestra.run.smithi188.stderr:10+0 records out 2024-04-01T19:22:30.023 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111676 s, 939 MB/s 2024-04-01T19:22:30.023 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping successful for: 2024-04-01T19:22:30.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:29 smithi188 ceph-mon[43939]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:30.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:29 smithi188 ceph-mon[43939]: Detected new or changed devices on smithi188 2024-04-01T19:22:30.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:29 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:30.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:29 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:30.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:29 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:30.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:29 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:30.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:29 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:30.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:29 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:30.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:29 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:30.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:29 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:30.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:29 smithi188 ceph-mon[43939]: Adjusting osd_memory_target on smithi188 to 7072M 2024-04-01T19:22:30.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:29 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:30.060 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:29 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:30.060 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:29 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:22:30.060 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:29 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:30.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:29 smithi022 ceph-mon[39439]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:30.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:29 smithi022 ceph-mon[39439]: Detected new or changed devices on smithi188 2024-04-01T19:22:30.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:29 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:30.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:29 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:30.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:29 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:30.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:29 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:30.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:29 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:30.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:29 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:30.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:29 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:30.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:29 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:30.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:29 smithi022 ceph-mon[39439]: Adjusting osd_memory_target on smithi188 to 7072M 2024-04-01T19:22:30.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:29 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:30.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:29 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:30.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:29 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:22:30.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:29 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:22:30.714 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi188:vg_nvme/lv_1 2024-04-01T19:22:30.980 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:22:31.954 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:31 smithi188 ceph-mon[43939]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:32.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:31 smithi062 ceph-mon[44211]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:32.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:31 smithi022 ceph-mon[39439]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:33.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {auth=22,config=2,health=12,kv=53,logm=11} crc {auth=2716926638,config=1548763834,health=861809967,kv=3811011908,logm=1652114795}) 2024-04-01T19:22:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=553846630}) 2024-04-01T19:22:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1426141844}) 2024-04-01T19:22:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3846412267}) 2024-04-01T19:22:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2566689619}) 2024-04-01T19:22:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2503654457}) 2024-04-01T19:22:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1961360069}) 2024-04-01T19:22:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=548896216}) 2024-04-01T19:22:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3100492775}) 2024-04-01T19:22:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2096510660}) 2024-04-01T19:22:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=765999308}) 2024-04-01T19:22:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3932619746}) 2024-04-01T19:22:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1113091781}) 2024-04-01T19:22:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2523657132}) 2024-04-01T19:22:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=982137354}) 2024-04-01T19:22:33.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=301869241}) 2024-04-01T19:22:33.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=32,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=2,mgrstat=9,mon_config_key=35} crc {logm=1575326297,mdsmap=2840952586,mgr=1734247563,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=54228577,mon_config_key=1161384585}) 2024-04-01T19:22:33.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=3299149356}) 2024-04-01T19:22:33.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=30565547}) 2024-04-01T19:22:33.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=39,monmap=5,osd_metadata=11,osd_pg_creating=1,osdmap=44} crc {mon_config_key=655914238,monmap=3338646291,osd_metadata=3144036293,osd_pg_creating=2290527312,osdmap=4119933582}) 2024-04-01T19:22:33.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=75} crc {osdmap=1460031165}) 2024-04-01T19:22:33.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {auth=22,config=2,health=12,kv=53,logm=11} crc {auth=2716926638,config=1548763834,health=861809967,kv=3811011908,logm=1652114795}) 2024-04-01T19:22:33.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=553846630}) 2024-04-01T19:22:33.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1426141844}) 2024-04-01T19:22:33.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3846412267}) 2024-04-01T19:22:33.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2566689619}) 2024-04-01T19:22:33.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2503654457}) 2024-04-01T19:22:33.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1961360069}) 2024-04-01T19:22:33.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=548896216}) 2024-04-01T19:22:33.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3100492775}) 2024-04-01T19:22:33.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2096510660}) 2024-04-01T19:22:33.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=765999308}) 2024-04-01T19:22:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3932619746}) 2024-04-01T19:22:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1113091781}) 2024-04-01T19:22:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2523657132}) 2024-04-01T19:22:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=982137354}) 2024-04-01T19:22:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=301869241}) 2024-04-01T19:22:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=32,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=2,mgrstat=9,mon_config_key=35} crc {logm=1575326297,mdsmap=2840952586,mgr=1734247563,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=54228577,mon_config_key=1161384585}) 2024-04-01T19:22:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=3299149356}) 2024-04-01T19:22:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=30565547}) 2024-04-01T19:22:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=39,monmap=5,osd_metadata=11,osd_pg_creating=1,osdmap=44} crc {mon_config_key=655914238,monmap=3338646291,osd_metadata=3144036293,osd_pg_creating=2290527312,osdmap=4119933582}) 2024-04-01T19:22:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=75} crc {osdmap=1460031165}) 2024-04-01T19:22:33.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {auth=22,config=2,health=12,kv=53,logm=11} crc {auth=2716926638,config=1548763834,health=861809967,kv=3811011908,logm=1652114795}) 2024-04-01T19:22:33.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=553846630}) 2024-04-01T19:22:33.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1426141844}) 2024-04-01T19:22:33.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3846412267}) 2024-04-01T19:22:33.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2566689619}) 2024-04-01T19:22:33.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2503654457}) 2024-04-01T19:22:33.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1961360069}) 2024-04-01T19:22:33.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=548896216}) 2024-04-01T19:22:33.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3100492775}) 2024-04-01T19:22:33.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2096510660}) 2024-04-01T19:22:33.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=765999308}) 2024-04-01T19:22:33.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3932619746}) 2024-04-01T19:22:33.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1113091781}) 2024-04-01T19:22:33.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2523657132}) 2024-04-01T19:22:33.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=982137354}) 2024-04-01T19:22:33.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=301869241}) 2024-04-01T19:22:33.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=32,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=2,mgrstat=9,mon_config_key=35} crc {logm=1575326297,mdsmap=2840952586,mgr=1734247563,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=54228577,mon_config_key=1161384585}) 2024-04-01T19:22:33.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=3299149356}) 2024-04-01T19:22:33.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=30565547}) 2024-04-01T19:22:33.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=39,monmap=5,osd_metadata=11,osd_pg_creating=1,osdmap=44} crc {mon_config_key=655914238,monmap=3338646291,osd_metadata=3144036293,osd_pg_creating=2290527312,osdmap=4119933582}) 2024-04-01T19:22:33.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=75} crc {osdmap=1460031165}) 2024-04-01T19:22:33.989 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:33 smithi188 ceph-mon[43939]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:33.990 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:33 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:22:33.990 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:33 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:22:33.990 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:33 smithi188 ceph-mon[43939]: from='client.24415 v1:172.21.15.188:0/1508641933' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:22:33.990 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:22:33.990 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:22:33.990 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:34.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:33 smithi062 ceph-mon[44211]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:34.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:33 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:22:34.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:33 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:22:34.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:33 smithi062 ceph-mon[44211]: from='client.24415 v1:172.21.15.188:0/1508641933' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:22:34.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:22:34.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:22:34.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:34.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:33 smithi022 ceph-mon[39439]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:34.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:33 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:22:34.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:33 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:22:34.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:33 smithi022 ceph-mon[39439]: from='client.24415 v1:172.21.15.188:0/1508641933' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T19:22:34.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T19:22:34.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T19:22:34.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:34.761 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:34 smithi188 ceph-mon[43939]: osdmap e79: 11 total, 11 up, 11 in 2024-04-01T19:22:35.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:34 smithi062 ceph-mon[44211]: osdmap e79: 11 total, 11 up, 11 in 2024-04-01T19:22:35.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:34 smithi022 ceph-mon[39439]: osdmap e79: 11 total, 11 up, 11 in 2024-04-01T19:22:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:35 smithi062 ceph-mon[44211]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:36.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:35 smithi022 ceph-mon[39439]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:36.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:35 smithi188 ceph-mon[43939]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:37.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:36 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.188:0/82683902' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c03517c4-fdb0-4587-96c1-b959041c4344"}]: dispatch 2024-04-01T19:22:37.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:36 smithi062 ceph-mon[44211]: from='client.24421 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c03517c4-fdb0-4587-96c1-b959041c4344"}]: dispatch 2024-04-01T19:22:37.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:36 smithi062 ceph-mon[44211]: from='client.24421 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c03517c4-fdb0-4587-96c1-b959041c4344"}]': finished 2024-04-01T19:22:37.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:36 smithi062 ceph-mon[44211]: osdmap e80: 12 total, 11 up, 12 in 2024-04-01T19:22:37.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:36 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T19:22:37.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:36 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.188:0/3984174614' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:22:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:36 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.188:0/82683902' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c03517c4-fdb0-4587-96c1-b959041c4344"}]: dispatch 2024-04-01T19:22:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:36 smithi022 ceph-mon[39439]: from='client.24421 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c03517c4-fdb0-4587-96c1-b959041c4344"}]: dispatch 2024-04-01T19:22:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:36 smithi022 ceph-mon[39439]: from='client.24421 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c03517c4-fdb0-4587-96c1-b959041c4344"}]': finished 2024-04-01T19:22:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:36 smithi022 ceph-mon[39439]: osdmap e80: 12 total, 11 up, 12 in 2024-04-01T19:22:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:36 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T19:22:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:36 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.188:0/3984174614' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:22:37.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:36 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.188:0/82683902' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c03517c4-fdb0-4587-96c1-b959041c4344"}]: dispatch 2024-04-01T19:22:37.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:36 smithi188 ceph-mon[43939]: from='client.24421 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c03517c4-fdb0-4587-96c1-b959041c4344"}]: dispatch 2024-04-01T19:22:37.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:36 smithi188 ceph-mon[43939]: from='client.24421 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c03517c4-fdb0-4587-96c1-b959041c4344"}]': finished 2024-04-01T19:22:37.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:36 smithi188 ceph-mon[43939]: osdmap e80: 12 total, 11 up, 12 in 2024-04-01T19:22:37.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:36 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T19:22:37.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:36 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.188:0/3984174614' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T19:22:38.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:37 smithi062 ceph-mon[44211]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:38.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:37 smithi022 ceph-mon[39439]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:38.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:37 smithi188 ceph-mon[43939]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:40.198 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:39 smithi188 ceph-mon[43939]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:40.198 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:39 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:22:40.198 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:39 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:22:40.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:39 smithi062 ceph-mon[44211]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:40.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:39 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:22:40.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:39 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:22:40.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:39 smithi022 ceph-mon[39439]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:40.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:39 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:22:40.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:39 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:22:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:40 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T19:22:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:40 smithi188 ceph-mon[43939]: osdmap e81: 12 total, 11 up, 12 in 2024-04-01T19:22:41.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:40 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:22:41.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:40 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:22:41.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:40 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:22:41.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:40 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:22:41.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:40 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T19:22:41.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:40 smithi062 ceph-mon[44211]: osdmap e81: 12 total, 11 up, 12 in 2024-04-01T19:22:41.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:40 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:22:41.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:40 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:22:41.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:40 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:22:41.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:40 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:22:41.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:40 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T19:22:41.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:40 smithi022 ceph-mon[39439]: osdmap e81: 12 total, 11 up, 12 in 2024-04-01T19:22:41.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:40 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:22:41.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:40 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:22:41.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:40 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:22:41.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:40 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:22:42.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:41 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:42.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:41 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:22:42.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:41 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:42.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:41 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:42.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:41 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:22:42.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:41 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:42.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:41 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:42.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:41 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:22:42.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:41 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:43.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:42 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-01T19:22:43.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:42 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:43.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:42 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-01T19:22:43.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:42 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:43.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:42 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-01T19:22:43.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:42 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:44.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:43 smithi062 ceph-mon[44211]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:44.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:43 smithi062 ceph-mon[44211]: Deploying daemon osd.11 on smithi188 2024-04-01T19:22:44.282 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:43 smithi188 ceph-mon[43939]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:44.282 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:43 smithi188 ceph-mon[43939]: Deploying daemon osd.11 on smithi188 2024-04-01T19:22:44.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:43 smithi022 ceph-mon[39439]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:44.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:43 smithi022 ceph-mon[39439]: Deploying daemon osd.11 on smithi188 2024-04-01T19:22:46.017 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:45 smithi188 ceph-mon[43939]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:46.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:45 smithi062 ceph-mon[44211]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:46.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:45 smithi022 ceph-mon[39439]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:48.227 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:47 smithi188 ceph-mon[43939]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:48.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:47 smithi062 ceph-mon[44211]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:48.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:47 smithi022 ceph-mon[39439]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:49.163 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:48 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:22:49.163 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:48 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:22:49.164 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:48 smithi188 ceph-mon[43939]: osdmap e82: 12 total, 11 up, 12 in 2024-04-01T19:22:49.164 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:48 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T19:22:49.164 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:48 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:49.164 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:48 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:49.164 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:48 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:22:49.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:48 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:22:49.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:48 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:22:49.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:48 smithi062 ceph-mon[44211]: osdmap e82: 12 total, 11 up, 12 in 2024-04-01T19:22:49.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:48 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T19:22:49.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:48 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:49.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:48 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:49.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:48 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:22:49.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:48 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:22:49.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:48 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:22:49.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:48 smithi022 ceph-mon[39439]: osdmap e82: 12 total, 11 up, 12 in 2024-04-01T19:22:49.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:48 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T19:22:49.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:48 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:49.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:48 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:49.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:48 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:22:50.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:49 smithi062 ceph-mon[44211]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:50.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:49 smithi022 ceph-mon[39439]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:50.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:49 smithi188 ceph-mon[43939]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:51.957 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:51 smithi188 ceph-mon[43939]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:51.957 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:51 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:51.957 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:51 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:51.958 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:51 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:51.958 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:51 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:22:51.958 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:51 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:51.958 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:51 smithi188 ceph-mon[43939]: from='osd.11 v1:172.21.15.188:6812/3987199514' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-01T19:22:51.958 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:51 smithi188 ceph-mon[43939]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-01T19:22:52.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:51 smithi062 ceph-mon[44211]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:52.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:51 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:52.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:51 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:52.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:51 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:52.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:51 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:22:52.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:51 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:52.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:51 smithi062 ceph-mon[44211]: from='osd.11 v1:172.21.15.188:6812/3987199514' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-01T19:22:52.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:51 smithi062 ceph-mon[44211]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-01T19:22:52.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:51 smithi022 ceph-mon[39439]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:52.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:51 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:52.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:51 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:52.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:51 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:52.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:51 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:22:52.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:51 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:52.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:51 smithi022 ceph-mon[39439]: from='osd.11 v1:172.21.15.188:6812/3987199514' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-01T19:22:52.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:51 smithi022 ceph-mon[39439]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-01T19:22:52.376 INFO:teuthology.orchestra.run.smithi188.stdout:Created osd(s) 11 on host 'smithi188' 2024-04-01T19:22:53.081 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:52 smithi188 ceph-mon[43939]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-01T19:22:53.082 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:52 smithi188 ceph-mon[43939]: osdmap e83: 12 total, 11 up, 12 in 2024-04-01T19:22:53.082 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:52 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T19:22:53.082 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:52 smithi188 ceph-mon[43939]: from='osd.11 v1:172.21.15.188:6812/3987199514' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:22:53.082 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:52 smithi188 ceph-mon[43939]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:22:53.082 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:52 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:53.082 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:52 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:53.082 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:52 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:22:53.110 DEBUG:teuthology.orchestra.run.smithi188:osd.11> sudo journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.11.service 2024-04-01T19:22:53.112 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-04-01T19:22:53.112 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd stat -f json 2024-04-01T19:22:53.142 INFO:journalctl@ceph.osd.11.smithi188.stdout:-- Logs begin at Mon 2024-04-01 19:04:09 UTC. -- 2024-04-01T19:22:53.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:52 smithi062 ceph-mon[44211]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-01T19:22:53.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:52 smithi062 ceph-mon[44211]: osdmap e83: 12 total, 11 up, 12 in 2024-04-01T19:22:53.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:52 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T19:22:53.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:52 smithi062 ceph-mon[44211]: from='osd.11 v1:172.21.15.188:6812/3987199514' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:22:53.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:52 smithi062 ceph-mon[44211]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:22:53.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:52 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:53.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:52 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:53.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:52 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:22:53.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:52 smithi022 ceph-mon[39439]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-01T19:22:53.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:52 smithi022 ceph-mon[39439]: osdmap e83: 12 total, 11 up, 12 in 2024-04-01T19:22:53.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:52 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T19:22:53.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:52 smithi022 ceph-mon[39439]: from='osd.11 v1:172.21.15.188:6812/3987199514' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:22:53.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:52 smithi022 ceph-mon[39439]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:22:53.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:52 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:53.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:52 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:53.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:52 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:22:53.401 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:22:53.668 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 19:22:53 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T19:22:53.397+0000 7fdaf2233700 -1 osd.11 0 waiting for initial osdmap 2024-04-01T19:22:53.668 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 19:22:53 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T19:22:53.397+0000 7fdae59ae700 -1 osd.11 0 failed to load OSD map for epoch 30, got 0 bytes 2024-04-01T19:22:53.668 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 19:22:53 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T19:22:53.406+0000 7fdaea01e700 -1 osd.11 84 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T19:22:54.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:53 smithi022 ceph-mon[39439]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:54.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:53 smithi022 ceph-mon[39439]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-04-01T19:22:54.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:53 smithi022 ceph-mon[39439]: osdmap e84: 12 total, 11 up, 12 in 2024-04-01T19:22:54.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:53 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T19:22:54.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:53 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T19:22:54.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:53 smithi022 ceph-mon[39439]: from='osd.11 ' entity='osd.11' 2024-04-01T19:22:54.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:53 smithi062 ceph-mon[44211]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:54.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:53 smithi062 ceph-mon[44211]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-04-01T19:22:54.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:53 smithi062 ceph-mon[44211]: osdmap e84: 12 total, 11 up, 12 in 2024-04-01T19:22:54.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:53 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T19:22:54.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:53 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T19:22:54.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:53 smithi062 ceph-mon[44211]: from='osd.11 ' entity='osd.11' 2024-04-01T19:22:54.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:53 smithi188 ceph-mon[43939]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:54.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:53 smithi188 ceph-mon[43939]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-04-01T19:22:54.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:53 smithi188 ceph-mon[43939]: osdmap e84: 12 total, 11 up, 12 in 2024-04-01T19:22:54.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:53 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T19:22:54.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:53 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T19:22:54.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:53 smithi188 ceph-mon[43939]: from='osd.11 ' entity='osd.11' 2024-04-01T19:22:55.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:54 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:22:55.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:54 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:22:55.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:22:55.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:22:55.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:54 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T19:22:55.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:54 smithi022 ceph-mon[39439]: osd.11 v1:172.21.15.188:6812/3987199514 boot 2024-04-01T19:22:55.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:54 smithi022 ceph-mon[39439]: osdmap e85: 12 total, 12 up, 12 in 2024-04-01T19:22:55.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:54 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T19:22:55.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:54 smithi022 ceph-mon[39439]: osdmap e86: 12 total, 12 up, 12 in 2024-04-01T19:22:55.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:54 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:22:55.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:54 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:22:55.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:22:55.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:22:55.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:54 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T19:22:55.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:54 smithi062 ceph-mon[44211]: osd.11 v1:172.21.15.188:6812/3987199514 boot 2024-04-01T19:22:55.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:54 smithi062 ceph-mon[44211]: osdmap e85: 12 total, 12 up, 12 in 2024-04-01T19:22:55.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:54 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T19:22:55.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:54 smithi062 ceph-mon[44211]: osdmap e86: 12 total, 12 up, 12 in 2024-04-01T19:22:55.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:54 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:22:55.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:54 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:22:55.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:22:55.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:22:55.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:54 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T19:22:55.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:54 smithi188 ceph-mon[43939]: osd.11 v1:172.21.15.188:6812/3987199514 boot 2024-04-01T19:22:55.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:54 smithi188 ceph-mon[43939]: osdmap e85: 12 total, 12 up, 12 in 2024-04-01T19:22:55.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:54 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T19:22:55.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:54 smithi188 ceph-mon[43939]: osdmap e86: 12 total, 12 up, 12 in 2024-04-01T19:22:55.693 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:22:56.066 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:55 smithi188 ceph-mon[43939]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:56.066 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:55 smithi188 ceph-mon[43939]: osdmap e87: 12 total, 12 up, 12 in 2024-04-01T19:22:56.066 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:55 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3167356382' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-01T19:22:56.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:55 smithi062 ceph-mon[44211]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:56.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:55 smithi062 ceph-mon[44211]: osdmap e87: 12 total, 12 up, 12 in 2024-04-01T19:22:56.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:55 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3167356382' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-01T19:22:56.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:55 smithi022 ceph-mon[39439]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 983 GiB / 983 GiB avail 2024-04-01T19:22:56.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:55 smithi022 ceph-mon[39439]: osdmap e87: 12 total, 12 up, 12 in 2024-04-01T19:22:56.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:55 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3167356382' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-01T19:22:56.659 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":87,"num_osds":12,"num_up_osds":12,"osd_up_since":1711999373,"num_in_osds":12,"osd_in_since":1711999355,"num_remapped_pgs":0} 2024-04-01T19:22:56.660 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-04-01T19:22:56.938 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:22:57.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:57 smithi062 ceph-mon[44211]: Detected new or changed devices on smithi188 2024-04-01T19:22:57.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:57 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:57.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:57 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:57.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:57 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:57.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:57 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:57.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:57 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:57.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:57 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:57.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:57 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:57.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:57 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:57.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:57 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:22:57.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:57 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:57.825 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:57 smithi022 ceph-mon[39439]: Detected new or changed devices on smithi188 2024-04-01T19:22:57.826 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:57 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:57.826 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:57 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:57.826 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:57 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:57.826 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:57 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:57.826 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:57 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:57.826 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:57 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:57.826 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:57 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:57.826 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:57 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:57.826 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:57 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:22:57.826 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:57 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:57.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:57 smithi188 ceph-mon[43939]: Detected new or changed devices on smithi188 2024-04-01T19:22:57.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:57 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:57.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:57 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:57.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:57 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:57.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:57 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:57.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:57 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:57.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:57 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-01T19:22:57.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:57 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:57.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:57 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:22:57.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:57 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:22:57.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:57 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:22:58.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:58 smithi022 ceph-mon[39439]: Adjusting osd_memory_target on smithi188 to 5304M 2024-04-01T19:22:58.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:58 smithi022 ceph-mon[39439]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:22:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:58 smithi062 ceph-mon[44211]: Adjusting osd_memory_target on smithi188 to 5304M 2024-04-01T19:22:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:58 smithi062 ceph-mon[44211]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:22:58.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:58 smithi188 ceph-mon[43939]: Adjusting osd_memory_target on smithi188 to 5304M 2024-04-01T19:22:58.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:58 smithi188 ceph-mon[43939]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:22:59.123 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:22:59.123 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":87,"fsid":"09f6b846-f05c-11ee-b647-cb9ed24678a4","created":"2024-04-01T19:15:34.344221+0000","modified":"2024-04-01T19:22:55.665575+0000","last_up_change":"2024-04-01T19:22:53.958497+0000","last_in_change":"2024-04-01T19:22:35.912273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T19:18:34.605751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfd4aa7e-a933-42e2-aac8-f93a3d9fcc3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":1419201649}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":1419201649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":1419201649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":1419201649}]},"public_addr":"172.21.15.22:6801/1419201649","cluster_addr":"172.21.15.22:6802/1419201649","heartbeat_back_addr":"172.21.15.22:6804/1419201649","heartbeat_front_addr":"172.21.15.22:6803/1419201649","state":["exists","up"]},{"osd":1,"uuid":"6ddadf19-2b4e-4c01-8918-9d51c323925b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":2579227110}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":2579227110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6808","nonce":2579227110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":2579227110}]},"public_addr":"172.21.15.22:6805/2579227110","cluster_addr":"172.21.15.22:6806/2579227110","heartbeat_back_addr":"172.21.15.22:6808/2579227110","heartbeat_front_addr":"172.21.15.22:6807/2579227110","state":["exists","up"]},{"osd":2,"uuid":"4af1f44c-f47c-4ce6-87ba-1aeec3960969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":835455757}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":835455757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":835455757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":835455757}]},"public_addr":"172.21.15.22:6809/835455757","cluster_addr":"172.21.15.22:6810/835455757","heartbeat_back_addr":"172.21.15.22:6812/835455757","heartbeat_front_addr":"172.21.15.22:6811/835455757","state":["exists","up"]},{"osd":3,"uuid":"c399f336-23c7-414a-822e-63793daf85c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":90988887}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":90988887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":90988887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":90988887}]},"public_addr":"172.21.15.22:6813/90988887","cluster_addr":"172.21.15.22:6814/90988887","heartbeat_back_addr":"172.21.15.22:6816/90988887","heartbeat_front_addr":"172.21.15.22:6815/90988887","state":["exists","up"]},{"osd":4,"uuid":"0a2690dc-e5b6-4d29-b517-980018519d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6800","nonce":2408168690}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6801","nonce":2408168690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6803","nonce":2408168690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6802","nonce":2408168690}]},"public_addr":"172.21.15.62:6800/2408168690","cluster_addr":"172.21.15.62:6801/2408168690","heartbeat_back_addr":"172.21.15.62:6803/2408168690","heartbeat_front_addr":"172.21.15.62:6802/2408168690","state":["exists","up"]},{"osd":5,"uuid":"c6830412-959a-4f1e-8c3d-f4b2d88673e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6804","nonce":386874616}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6805","nonce":386874616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6807","nonce":386874616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6806","nonce":386874616}]},"public_addr":"172.21.15.62:6804/386874616","cluster_addr":"172.21.15.62:6805/386874616","heartbeat_back_addr":"172.21.15.62:6807/386874616","heartbeat_front_addr":"172.21.15.62:6806/386874616","state":["exists","up"]},{"osd":6,"uuid":"f646310b-91a4-4259-a51f-6a0e92b7cba8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6808","nonce":90097362}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6809","nonce":90097362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6811","nonce":90097362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6810","nonce":90097362}]},"public_addr":"172.21.15.62:6808/90097362","cluster_addr":"172.21.15.62:6809/90097362","heartbeat_back_addr":"172.21.15.62:6811/90097362","heartbeat_front_addr":"172.21.15.62:6810/90097362","state":["exists","up"]},{"osd":7,"uuid":"afe5f371-c892-43e9-b82e-c2d911354e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6812","nonce":2055487337}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6813","nonce":2055487337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6815","nonce":2055487337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6814","nonce":2055487337}]},"public_addr":"172.21.15.62:6812/2055487337","cluster_addr":"172.21.15.62:6813/2055487337","heartbeat_back_addr":"172.21.15.62:6815/2055487337","heartbeat_front_addr":"172.21.15.62:6814/2055487337","state":["exists","up"]},{"osd":8,"uuid":"b7eb6461-f6fa-4a12-864c-6e6748e6337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6800","nonce":2108324328}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6801","nonce":2108324328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6803","nonce":2108324328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6802","nonce":2108324328}]},"public_addr":"172.21.15.188:6800/2108324328","cluster_addr":"172.21.15.188:6801/2108324328","heartbeat_back_addr":"172.21.15.188:6803/2108324328","heartbeat_front_addr":"172.21.15.188:6802/2108324328","state":["exists","up"]},{"osd":9,"uuid":"7d496ad5-46bf-485a-81d9-2b9da2a59882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6804","nonce":1755990887}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6805","nonce":1755990887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6807","nonce":1755990887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6806","nonce":1755990887}]},"public_addr":"172.21.15.188:6804/1755990887","cluster_addr":"172.21.15.188:6805/1755990887","heartbeat_back_addr":"172.21.15.188:6807/1755990887","heartbeat_front_addr":"172.21.15.188:6806/1755990887","state":["exists","up"]},{"osd":10,"uuid":"6cbb80ce-37f7-48df-9090-09a6068e4490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6808","nonce":3777340429}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6809","nonce":3777340429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6811","nonce":3777340429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6810","nonce":3777340429}]},"public_addr":"172.21.15.188:6808/3777340429","cluster_addr":"172.21.15.188:6809/3777340429","heartbeat_back_addr":"172.21.15.188:6811/3777340429","heartbeat_front_addr":"172.21.15.188:6810/3777340429","state":["exists","up"]},{"osd":11,"uuid":"c03517c4-fdb0-4587-96c1-b959041c4344","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6812","nonce":3987199514}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6813","nonce":3987199514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6815","nonce":3987199514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6814","nonce":3987199514}]},"public_addr":"172.21.15.188:6812/3987199514","cluster_addr":"172.21.15.188:6813/3987199514","heartbeat_back_addr":"172.21.15.188:6815/3987199514","heartbeat_front_addr":"172.21.15.188:6814/3987199514","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:22:08.710248+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:21:55.789660+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:21:42.549754+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:21:50.245807+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:22:25.775406+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:22:38.930203+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:21:50.365122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:22:32.784412+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:22:47.368327+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:21:56.757541+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:22:24.658086+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:22:52.675419+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/3735983556":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/3575578250":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/2493529775":"2024-04-02T19:16:02.302343+0000","172.21.15.22:6800/2678666836":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/2389537847":"2024-04-02T19:16:02.302343+0000","172.21.15.22:0/798807675":"2024-04-02T19:16:02.302343+0000","172.21.15.22:6800/1090179981":"2024-04-02T19:16:02.302343+0000","172.21.15.22:0/51907384":"2024-04-02T19:16:30.513384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T19:22:59.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:59 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:22:59.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:59 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:22:59.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:22:59 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1056583370' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T19:22:59.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:59 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:22:59.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:59 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:22:59.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:22:59 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1056583370' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T19:22:59.781 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T19:18:34.605751+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T19:22:59.781 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pool get .mgr pg_num 2024-04-01T19:22:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:59 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:22:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:59 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:22:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:22:59 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1056583370' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T19:23:00.054 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:00.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:00 smithi022 ceph-mon[39439]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s, 0 objects/s recovering 2024-04-01T19:23:00.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:00 smithi022 ceph-mon[39439]: osdmap e88: 12 total, 12 up, 12 in 2024-04-01T19:23:00.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:00 smithi062 ceph-mon[44211]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s, 0 objects/s recovering 2024-04-01T19:23:00.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:00 smithi062 ceph-mon[44211]: osdmap e88: 12 total, 12 up, 12 in 2024-04-01T19:23:00.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:00 smithi188 ceph-mon[43939]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s, 0 objects/s recovering 2024-04-01T19:23:00.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:00 smithi188 ceph-mon[43939]: osdmap e88: 12 total, 12 up, 12 in 2024-04-01T19:23:01.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:01 smithi022 ceph-mon[39439]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-01T19:23:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:01 smithi062 ceph-mon[44211]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-01T19:23:01.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:01 smithi188 ceph-mon[43939]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-01T19:23:01.973 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-04-01T19:23:02.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:02 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1753591204' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T19:23:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:02 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1753591204' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T19:23:02.826 INFO:tasks.cephadm:Setting up client nodes... 2024-04-01T19:23:02.826 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-01T19:23:02.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:02 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1753591204' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T19:23:03.105 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:03.579 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:03 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:23:03.579 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:03 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:23:03.579 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:03 smithi022 ceph-mon[39439]: osdmap e89: 12 total, 12 up, 12 in 2024-04-01T19:23:03.579 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:03 smithi022 ceph-mon[39439]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s, 0 objects/s recovering 2024-04-01T19:23:03.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:03 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:23:03.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:03 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:23:03.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:03 smithi062 ceph-mon[44211]: osdmap e89: 12 total, 12 up, 12 in 2024-04-01T19:23:03.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:03 smithi062 ceph-mon[44211]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s, 0 objects/s recovering 2024-04-01T19:23:03.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:03 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:23:03.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:03 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:23:03.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:03 smithi188 ceph-mon[43939]: osdmap e89: 12 total, 12 up, 12 in 2024-04-01T19:23:03.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:03 smithi188 ceph-mon[43939]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s, 0 objects/s recovering 2024-04-01T19:23:05.033 INFO:teuthology.orchestra.run.smithi022.stdout:[client.0] 2024-04-01T19:23:05.033 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCZCQtma9IEAhAAHGCEVqWCz65d4q85P+TDYw== 2024-04-01T19:23:05.831 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-04-01T19:23:05.831 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-01T19:23:05.831 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-01T19:23:05.877 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-01T19:23:05.911 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:05 smithi062 ceph-mon[44211]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s, 0 objects/s recovering 2024-04-01T19:23:05.911 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:05 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4270299963' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-01T19:23:05.911 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:05 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4270299963' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-01T19:23:06.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:05 smithi022 ceph-mon[39439]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s, 0 objects/s recovering 2024-04-01T19:23:06.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:05 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4270299963' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-01T19:23:06.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:05 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4270299963' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-01T19:23:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:05 smithi188 ceph-mon[43939]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s, 0 objects/s recovering 2024-04-01T19:23:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:05 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4270299963' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-01T19:23:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:05 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4270299963' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-01T19:23:06.165 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:23:07.803 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:07 smithi062 ceph-mon[44211]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:08.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:07 smithi022 ceph-mon[39439]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:08.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:07 smithi188 ceph-mon[43939]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:08.394 INFO:teuthology.orchestra.run.smithi062.stdout:[client.1] 2024-04-01T19:23:08.395 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCcCQtmIeVhFxAAb4FNz1Qb2to4BmYf6T296Q== 2024-04-01T19:23:08.704 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:08 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:23:08.704 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:08 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:23:08.704 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:08 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.62:0/463868623' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-01T19:23:08.704 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:08 smithi062 ceph-mon[44211]: from='client.34460 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-01T19:23:08.704 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:08 smithi062 ceph-mon[44211]: from='client.34460 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-01T19:23:09.027 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-01T19:23:09.028 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-04-01T19:23:09.028 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-01T19:23:09.111 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph auth get-or-create client.2 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-01T19:23:09.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:08 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:23:09.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:08 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:23:09.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:08 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.62:0/463868623' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-01T19:23:09.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:08 smithi022 ceph-mon[39439]: from='client.34460 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-01T19:23:09.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:08 smithi022 ceph-mon[39439]: from='client.34460 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-01T19:23:09.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:08 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:23:09.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:08 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:23:09.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:08 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.62:0/463868623' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-01T19:23:09.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:08 smithi188 ceph-mon[43939]: from='client.34460 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-01T19:23:09.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:08 smithi188 ceph-mon[43939]: from='client.34460 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-01T19:23:09.388 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:23:09.913 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:09 smithi188 ceph-mon[43939]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:09.914 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:09 smithi188 ceph-mon[43939]: osdmap e90: 12 total, 12 up, 12 in 2024-04-01T19:23:10.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:09 smithi062 ceph-mon[44211]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:10.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:09 smithi062 ceph-mon[44211]: osdmap e90: 12 total, 12 up, 12 in 2024-04-01T19:23:10.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:09 smithi022 ceph-mon[39439]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:10.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:09 smithi022 ceph-mon[39439]: osdmap e90: 12 total, 12 up, 12 in 2024-04-01T19:23:11.416 INFO:teuthology.orchestra.run.smithi188.stdout:[client.2] 2024-04-01T19:23:11.416 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCfCQtmuKKqGBAA6DDl36OoEudnWVLMHa+9LA== 2024-04-01T19:23:11.786 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:11 smithi188 ceph-mon[43939]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:11.786 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:11 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:23:11.786 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:11 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:23:11.786 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:11 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:23:11.786 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:11 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:23:11.786 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:11 smithi188 ceph-mon[43939]: osdmap e91: 12 total, 12 up, 12 in 2024-04-01T19:23:11.786 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:11 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.188:0/3530125925' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-01T19:23:11.786 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:11 smithi188 ceph-mon[43939]: from='client.24472 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-01T19:23:11.786 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:11 smithi188 ceph-mon[43939]: from='client.24472 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-01T19:23:12.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:11 smithi062 ceph-mon[44211]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:12.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:11 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:23:12.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:11 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:23:12.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:11 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:23:12.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:11 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:23:12.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:11 smithi062 ceph-mon[44211]: osdmap e91: 12 total, 12 up, 12 in 2024-04-01T19:23:12.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:11 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.188:0/3530125925' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-01T19:23:12.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:11 smithi062 ceph-mon[44211]: from='client.24472 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-01T19:23:12.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:11 smithi062 ceph-mon[44211]: from='client.24472 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-01T19:23:12.092 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-01T19:23:12.092 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/ceph/ceph.client.2.keyring 2024-04-01T19:23:12.092 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-01T19:23:12.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:11 smithi022 ceph-mon[39439]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:12.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:11 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:23:12.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:11 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:23:12.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:11 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:23:12.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:11 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:23:12.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:11 smithi022 ceph-mon[39439]: osdmap e91: 12 total, 12 up, 12 in 2024-04-01T19:23:12.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:11 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.188:0/3530125925' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-01T19:23:12.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:11 smithi022 ceph-mon[39439]: from='client.24472 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-01T19:23:12.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:11 smithi022 ceph-mon[39439]: from='client.24472 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-01T19:23:12.170 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-01T19:23:12.171 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-01T19:23:12.171 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph mgr dump --format=json 2024-04-01T19:23:12.459 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:13.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:13 smithi022 ceph-mon[39439]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:14.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:13 smithi062 ceph-mon[44211]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:14.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:13 smithi188 ceph-mon[43939]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:14.789 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:23:15.561 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":15,"flags":0,"active_gid":14151,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6800","nonce":3190859705}]},"active_addr":"172.21.15.22:6800/3190859705","active_change":"2024-04-01T19:16:30.513494+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":34112,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.22:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":4198368181}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":879400155}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":4037916440}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":2764632891}]}]} 2024-04-01T19:23:15.565 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-01T19:23:15.565 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-01T19:23:15.566 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-04-01T19:23:15.848 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:15.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:15 smithi022 ceph-mon[39439]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:15.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:15 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4076696156' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-01T19:23:16.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:15 smithi062 ceph-mon[44211]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:16.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:15 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4076696156' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-01T19:23:16.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:15 smithi188 ceph-mon[43939]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:16.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:15 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4076696156' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-01T19:23:17.737 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:23:17.738 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":91,"fsid":"09f6b846-f05c-11ee-b647-cb9ed24678a4","created":"2024-04-01T19:15:34.344221+0000","modified":"2024-04-01T19:23:10.670379+0000","last_up_change":"2024-04-01T19:22:53.958497+0000","last_in_change":"2024-04-01T19:22:35.912273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T19:18:34.605751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfd4aa7e-a933-42e2-aac8-f93a3d9fcc3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":1419201649}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":1419201649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":1419201649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":1419201649}]},"public_addr":"172.21.15.22:6801/1419201649","cluster_addr":"172.21.15.22:6802/1419201649","heartbeat_back_addr":"172.21.15.22:6804/1419201649","heartbeat_front_addr":"172.21.15.22:6803/1419201649","state":["exists","up"]},{"osd":1,"uuid":"6ddadf19-2b4e-4c01-8918-9d51c323925b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":2579227110}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":2579227110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6808","nonce":2579227110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":2579227110}]},"public_addr":"172.21.15.22:6805/2579227110","cluster_addr":"172.21.15.22:6806/2579227110","heartbeat_back_addr":"172.21.15.22:6808/2579227110","heartbeat_front_addr":"172.21.15.22:6807/2579227110","state":["exists","up"]},{"osd":2,"uuid":"4af1f44c-f47c-4ce6-87ba-1aeec3960969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":835455757}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":835455757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":835455757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":835455757}]},"public_addr":"172.21.15.22:6809/835455757","cluster_addr":"172.21.15.22:6810/835455757","heartbeat_back_addr":"172.21.15.22:6812/835455757","heartbeat_front_addr":"172.21.15.22:6811/835455757","state":["exists","up"]},{"osd":3,"uuid":"c399f336-23c7-414a-822e-63793daf85c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":90988887}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":90988887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":90988887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":90988887}]},"public_addr":"172.21.15.22:6813/90988887","cluster_addr":"172.21.15.22:6814/90988887","heartbeat_back_addr":"172.21.15.22:6816/90988887","heartbeat_front_addr":"172.21.15.22:6815/90988887","state":["exists","up"]},{"osd":4,"uuid":"0a2690dc-e5b6-4d29-b517-980018519d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6800","nonce":2408168690}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6801","nonce":2408168690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6803","nonce":2408168690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6802","nonce":2408168690}]},"public_addr":"172.21.15.62:6800/2408168690","cluster_addr":"172.21.15.62:6801/2408168690","heartbeat_back_addr":"172.21.15.62:6803/2408168690","heartbeat_front_addr":"172.21.15.62:6802/2408168690","state":["exists","up"]},{"osd":5,"uuid":"c6830412-959a-4f1e-8c3d-f4b2d88673e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6804","nonce":386874616}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6805","nonce":386874616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6807","nonce":386874616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6806","nonce":386874616}]},"public_addr":"172.21.15.62:6804/386874616","cluster_addr":"172.21.15.62:6805/386874616","heartbeat_back_addr":"172.21.15.62:6807/386874616","heartbeat_front_addr":"172.21.15.62:6806/386874616","state":["exists","up"]},{"osd":6,"uuid":"f646310b-91a4-4259-a51f-6a0e92b7cba8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6808","nonce":90097362}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6809","nonce":90097362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6811","nonce":90097362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6810","nonce":90097362}]},"public_addr":"172.21.15.62:6808/90097362","cluster_addr":"172.21.15.62:6809/90097362","heartbeat_back_addr":"172.21.15.62:6811/90097362","heartbeat_front_addr":"172.21.15.62:6810/90097362","state":["exists","up"]},{"osd":7,"uuid":"afe5f371-c892-43e9-b82e-c2d911354e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6812","nonce":2055487337}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6813","nonce":2055487337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6815","nonce":2055487337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6814","nonce":2055487337}]},"public_addr":"172.21.15.62:6812/2055487337","cluster_addr":"172.21.15.62:6813/2055487337","heartbeat_back_addr":"172.21.15.62:6815/2055487337","heartbeat_front_addr":"172.21.15.62:6814/2055487337","state":["exists","up"]},{"osd":8,"uuid":"b7eb6461-f6fa-4a12-864c-6e6748e6337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6800","nonce":2108324328}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6801","nonce":2108324328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6803","nonce":2108324328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6802","nonce":2108324328}]},"public_addr":"172.21.15.188:6800/2108324328","cluster_addr":"172.21.15.188:6801/2108324328","heartbeat_back_addr":"172.21.15.188:6803/2108324328","heartbeat_front_addr":"172.21.15.188:6802/2108324328","state":["exists","up"]},{"osd":9,"uuid":"7d496ad5-46bf-485a-81d9-2b9da2a59882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6804","nonce":1755990887}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6805","nonce":1755990887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6807","nonce":1755990887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6806","nonce":1755990887}]},"public_addr":"172.21.15.188:6804/1755990887","cluster_addr":"172.21.15.188:6805/1755990887","heartbeat_back_addr":"172.21.15.188:6807/1755990887","heartbeat_front_addr":"172.21.15.188:6806/1755990887","state":["exists","up"]},{"osd":10,"uuid":"6cbb80ce-37f7-48df-9090-09a6068e4490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6808","nonce":3777340429}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6809","nonce":3777340429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6811","nonce":3777340429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6810","nonce":3777340429}]},"public_addr":"172.21.15.188:6808/3777340429","cluster_addr":"172.21.15.188:6809/3777340429","heartbeat_back_addr":"172.21.15.188:6811/3777340429","heartbeat_front_addr":"172.21.15.188:6810/3777340429","state":["exists","up"]},{"osd":11,"uuid":"c03517c4-fdb0-4587-96c1-b959041c4344","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6812","nonce":3987199514}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6813","nonce":3987199514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6815","nonce":3987199514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6814","nonce":3987199514}]},"public_addr":"172.21.15.188:6812/3987199514","cluster_addr":"172.21.15.188:6813/3987199514","heartbeat_back_addr":"172.21.15.188:6815/3987199514","heartbeat_front_addr":"172.21.15.188:6814/3987199514","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:22:08.710248+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:23:07.811899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:23:10.595170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:23:10.619938+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:22:25.775406+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:22:38.930203+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:23:02.137961+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:22:32.784412+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:22:47.368327+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:22:58.561472+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:22:24.658086+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:22:52.675419+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/3735983556":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/3575578250":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/2493529775":"2024-04-02T19:16:02.302343+0000","172.21.15.22:6800/2678666836":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/2389537847":"2024-04-02T19:16:02.302343+0000","172.21.15.22:0/798807675":"2024-04-02T19:16:02.302343+0000","172.21.15.22:6800/1090179981":"2024-04-02T19:16:02.302343+0000","172.21.15.22:0/51907384":"2024-04-02T19:16:30.513384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T19:23:18.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:17 smithi062 ceph-mon[44211]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:18.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:17 smithi022 ceph-mon[39439]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:18.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:17 smithi188 ceph-mon[43939]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:18.455 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-01T19:23:18.455 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-04-01T19:23:18.689 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:18 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3563994303' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T19:23:18.733 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:19.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:18 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3563994303' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T19:23:19.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:18 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3563994303' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T19:23:19.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:19 smithi022 ceph-mon[39439]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:20.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:19 smithi062 ceph-mon[44211]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:20.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:19 smithi188 ceph-mon[43939]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:20.587 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:23:20.587 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":91,"fsid":"09f6b846-f05c-11ee-b647-cb9ed24678a4","created":"2024-04-01T19:15:34.344221+0000","modified":"2024-04-01T19:23:10.670379+0000","last_up_change":"2024-04-01T19:22:53.958497+0000","last_in_change":"2024-04-01T19:22:35.912273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T19:18:34.605751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfd4aa7e-a933-42e2-aac8-f93a3d9fcc3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":1419201649}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":1419201649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":1419201649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":1419201649}]},"public_addr":"172.21.15.22:6801/1419201649","cluster_addr":"172.21.15.22:6802/1419201649","heartbeat_back_addr":"172.21.15.22:6804/1419201649","heartbeat_front_addr":"172.21.15.22:6803/1419201649","state":["exists","up"]},{"osd":1,"uuid":"6ddadf19-2b4e-4c01-8918-9d51c323925b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":2579227110}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":2579227110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6808","nonce":2579227110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":2579227110}]},"public_addr":"172.21.15.22:6805/2579227110","cluster_addr":"172.21.15.22:6806/2579227110","heartbeat_back_addr":"172.21.15.22:6808/2579227110","heartbeat_front_addr":"172.21.15.22:6807/2579227110","state":["exists","up"]},{"osd":2,"uuid":"4af1f44c-f47c-4ce6-87ba-1aeec3960969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":835455757}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":835455757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":835455757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":835455757}]},"public_addr":"172.21.15.22:6809/835455757","cluster_addr":"172.21.15.22:6810/835455757","heartbeat_back_addr":"172.21.15.22:6812/835455757","heartbeat_front_addr":"172.21.15.22:6811/835455757","state":["exists","up"]},{"osd":3,"uuid":"c399f336-23c7-414a-822e-63793daf85c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":90988887}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":90988887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":90988887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":90988887}]},"public_addr":"172.21.15.22:6813/90988887","cluster_addr":"172.21.15.22:6814/90988887","heartbeat_back_addr":"172.21.15.22:6816/90988887","heartbeat_front_addr":"172.21.15.22:6815/90988887","state":["exists","up"]},{"osd":4,"uuid":"0a2690dc-e5b6-4d29-b517-980018519d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6800","nonce":2408168690}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6801","nonce":2408168690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6803","nonce":2408168690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6802","nonce":2408168690}]},"public_addr":"172.21.15.62:6800/2408168690","cluster_addr":"172.21.15.62:6801/2408168690","heartbeat_back_addr":"172.21.15.62:6803/2408168690","heartbeat_front_addr":"172.21.15.62:6802/2408168690","state":["exists","up"]},{"osd":5,"uuid":"c6830412-959a-4f1e-8c3d-f4b2d88673e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6804","nonce":386874616}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6805","nonce":386874616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6807","nonce":386874616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6806","nonce":386874616}]},"public_addr":"172.21.15.62:6804/386874616","cluster_addr":"172.21.15.62:6805/386874616","heartbeat_back_addr":"172.21.15.62:6807/386874616","heartbeat_front_addr":"172.21.15.62:6806/386874616","state":["exists","up"]},{"osd":6,"uuid":"f646310b-91a4-4259-a51f-6a0e92b7cba8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6808","nonce":90097362}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6809","nonce":90097362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6811","nonce":90097362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6810","nonce":90097362}]},"public_addr":"172.21.15.62:6808/90097362","cluster_addr":"172.21.15.62:6809/90097362","heartbeat_back_addr":"172.21.15.62:6811/90097362","heartbeat_front_addr":"172.21.15.62:6810/90097362","state":["exists","up"]},{"osd":7,"uuid":"afe5f371-c892-43e9-b82e-c2d911354e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6812","nonce":2055487337}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6813","nonce":2055487337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6815","nonce":2055487337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6814","nonce":2055487337}]},"public_addr":"172.21.15.62:6812/2055487337","cluster_addr":"172.21.15.62:6813/2055487337","heartbeat_back_addr":"172.21.15.62:6815/2055487337","heartbeat_front_addr":"172.21.15.62:6814/2055487337","state":["exists","up"]},{"osd":8,"uuid":"b7eb6461-f6fa-4a12-864c-6e6748e6337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6800","nonce":2108324328}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6801","nonce":2108324328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6803","nonce":2108324328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6802","nonce":2108324328}]},"public_addr":"172.21.15.188:6800/2108324328","cluster_addr":"172.21.15.188:6801/2108324328","heartbeat_back_addr":"172.21.15.188:6803/2108324328","heartbeat_front_addr":"172.21.15.188:6802/2108324328","state":["exists","up"]},{"osd":9,"uuid":"7d496ad5-46bf-485a-81d9-2b9da2a59882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6804","nonce":1755990887}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6805","nonce":1755990887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6807","nonce":1755990887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6806","nonce":1755990887}]},"public_addr":"172.21.15.188:6804/1755990887","cluster_addr":"172.21.15.188:6805/1755990887","heartbeat_back_addr":"172.21.15.188:6807/1755990887","heartbeat_front_addr":"172.21.15.188:6806/1755990887","state":["exists","up"]},{"osd":10,"uuid":"6cbb80ce-37f7-48df-9090-09a6068e4490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6808","nonce":3777340429}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6809","nonce":3777340429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6811","nonce":3777340429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6810","nonce":3777340429}]},"public_addr":"172.21.15.188:6808/3777340429","cluster_addr":"172.21.15.188:6809/3777340429","heartbeat_back_addr":"172.21.15.188:6811/3777340429","heartbeat_front_addr":"172.21.15.188:6810/3777340429","state":["exists","up"]},{"osd":11,"uuid":"c03517c4-fdb0-4587-96c1-b959041c4344","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6812","nonce":3987199514}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6813","nonce":3987199514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6815","nonce":3987199514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6814","nonce":3987199514}]},"public_addr":"172.21.15.188:6812/3987199514","cluster_addr":"172.21.15.188:6813/3987199514","heartbeat_back_addr":"172.21.15.188:6815/3987199514","heartbeat_front_addr":"172.21.15.188:6814/3987199514","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:22:08.710248+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:23:07.811899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:23:10.595170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:23:10.619938+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:22:25.775406+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:22:38.930203+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:23:02.137961+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:22:32.784412+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:22:47.368327+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:22:58.561472+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:22:24.658086+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:22:52.675419+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/3735983556":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/3575578250":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/2493529775":"2024-04-02T19:16:02.302343+0000","172.21.15.22:6800/2678666836":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/2389537847":"2024-04-02T19:16:02.302343+0000","172.21.15.22:0/798807675":"2024-04-02T19:16:02.302343+0000","172.21.15.22:6800/1090179981":"2024-04-02T19:16:02.302343+0000","172.21.15.22:0/51907384":"2024-04-02T19:16:30.513384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T19:23:20.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:20 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1137576905' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T19:23:21.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:20 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1137576905' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T19:23:21.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:20 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1137576905' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T19:23:21.293 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.0 flush_pg_stats 2024-04-01T19:23:21.294 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.1 flush_pg_stats 2024-04-01T19:23:21.294 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.2 flush_pg_stats 2024-04-01T19:23:21.295 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.3 flush_pg_stats 2024-04-01T19:23:21.295 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.4 flush_pg_stats 2024-04-01T19:23:21.296 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.5 flush_pg_stats 2024-04-01T19:23:21.296 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.6 flush_pg_stats 2024-04-01T19:23:21.296 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.7 flush_pg_stats 2024-04-01T19:23:21.297 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.8 flush_pg_stats 2024-04-01T19:23:21.297 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.9 flush_pg_stats 2024-04-01T19:23:21.298 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.10 flush_pg_stats 2024-04-01T19:23:21.298 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.11 flush_pg_stats 2024-04-01T19:23:22.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:21 smithi062 ceph-mon[44211]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:22.075 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:22.120 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:22.121 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:22.121 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:22.121 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:22.122 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:22.122 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:22.122 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:22.122 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:21 smithi022 ceph-mon[39439]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:22.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:21 smithi188 ceph-mon[43939]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:22.426 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:22.426 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:22.427 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:22.428 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:24.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:23 smithi062 ceph-mon[44211]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:24.063 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:23 smithi022 ceph-mon[39439]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:24.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:23 smithi188 ceph-mon[43939]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:26.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:25 smithi062 ceph-mon[44211]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:26.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:25 smithi022 ceph-mon[39439]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:26.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:25 smithi188 ceph-mon[43939]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:28.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:27 smithi062 ceph-mon[44211]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:28.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:27 smithi022 ceph-mon[39439]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:28.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:27 smithi188 ceph-mon[43939]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:29.957 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:29 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T19:23:29.957 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:29 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T19:23:29.957 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:29 smithi022 ceph-mon[39439]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:30.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:29 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T19:23:30.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:29 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T19:23:30.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:29 smithi062 ceph-mon[44211]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:30.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:29 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T19:23:30.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:29 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T19:23:30.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:29 smithi188 ceph-mon[43939]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:31.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:31 smithi022 ceph-mon[39439]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:32.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:31 smithi062 ceph-mon[44211]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:32.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:31 smithi188 ceph-mon[43939]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:33.717 INFO:teuthology.orchestra.run.smithi022.stdout:34359738433 2024-04-01T19:23:33.717 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.0 2024-04-01T19:23:33.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:33 smithi022 ceph-mon[39439]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:34.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:33 smithi062 ceph-mon[44211]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:34.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:33 smithi188 ceph-mon[43939]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:35.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:34 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:23:35.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:34 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:23:35.051 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:34 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:23:35.051 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:34 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:23:35.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:34 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:23:35.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:34 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:23:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:35 smithi062 ceph-mon[44211]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:35 smithi062 ceph-mon[44211]: osdmap e92: 12 total, 12 up, 12 in 2024-04-01T19:23:36.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:35 smithi022 ceph-mon[39439]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:36.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:35 smithi022 ceph-mon[39439]: osdmap e92: 12 total, 12 up, 12 in 2024-04-01T19:23:36.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:35 smithi188 ceph-mon[43939]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:36.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:35 smithi188 ceph-mon[43939]: osdmap e92: 12 total, 12 up, 12 in 2024-04-01T19:23:37.679 INFO:teuthology.orchestra.run.smithi022.stdout:85899345978 2024-04-01T19:23:37.681 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.2 2024-04-01T19:23:37.868 INFO:teuthology.orchestra.run.smithi022.stdout:365072220170 2024-04-01T19:23:37.868 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.11 2024-04-01T19:23:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:37 smithi062 ceph-mon[44211]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:38.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:37 smithi022 ceph-mon[39439]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:38.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:37 smithi188 ceph-mon[43939]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:40.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:39 smithi022 ceph-mon[39439]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:40.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:39 smithi188 ceph-mon[43939]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:40.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:39 smithi062 ceph-mon[44211]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:41.896 INFO:teuthology.orchestra.run.smithi022.stdout:193273528358 2024-04-01T19:23:41.897 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.6 2024-04-01T19:23:42.070 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:41 smithi022 ceph-mon[39439]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:42.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:41 smithi188 ceph-mon[43939]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:42.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:41 smithi062 ceph-mon[44211]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:42.401 INFO:teuthology.orchestra.run.smithi022.stdout:111669149748 2024-04-01T19:23:42.401 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.3 2024-04-01T19:23:42.896 INFO:teuthology.orchestra.run.smithi022.stdout:137438953519 2024-04-01T19:23:42.897 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.4 2024-04-01T19:23:43.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:43 smithi022 ceph-mon[39439]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:43.885 INFO:teuthology.orchestra.run.smithi022.stdout:270582939675 2024-04-01T19:23:43.886 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.8 2024-04-01T19:23:44.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:43 smithi188 ceph-mon[43939]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:44.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:43 smithi062 ceph-mon[44211]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:44.699 INFO:teuthology.orchestra.run.smithi022.stdout:55834574911 2024-04-01T19:23:44.700 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.1 2024-04-01T19:23:45.359 INFO:teuthology.orchestra.run.smithi022.stdout:231928234015 2024-04-01T19:23:45.360 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.7 2024-04-01T19:23:46.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:45 smithi022 ceph-mon[39439]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:46.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:45 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:23:46.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:45 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:23:46.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:45 smithi188 ceph-mon[43939]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:46.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:45 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:23:46.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:45 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:23:46.220 INFO:teuthology.orchestra.run.smithi022.stdout:304942678039 2024-04-01T19:23:46.220 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.9 2024-04-01T19:23:46.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:45 smithi062 ceph-mon[44211]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:46.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:45 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:23:46.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:45 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:23:46.503 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:46.503 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:46.507 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:47.072 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:46 smithi022 ceph-mon[39439]: osdmap e93: 12 total, 12 up, 12 in 2024-04-01T19:23:47.107 INFO:teuthology.orchestra.run.smithi022.stdout:158913789996 2024-04-01T19:23:47.107 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.5 2024-04-01T19:23:47.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:46 smithi188 ceph-mon[43939]: osdmap e93: 12 total, 12 up, 12 in 2024-04-01T19:23:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:46 smithi062 ceph-mon[44211]: osdmap e93: 12 total, 12 up, 12 in 2024-04-01T19:23:47.997 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:47.998 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:48.018 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:48.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:47 smithi022 ceph-mon[39439]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:48.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:47 smithi188 ceph-mon[43939]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:48.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:47 smithi062 ceph-mon[44211]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:49.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:49 smithi022 ceph-mon[39439]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:50.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:49 smithi188 ceph-mon[43939]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:50.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:49 smithi062 ceph-mon[44211]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:50.307 INFO:teuthology.orchestra.run.smithi022.stdout:330712481809 2024-04-01T19:23:50.307 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.10 2024-04-01T19:23:50.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:50 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:23:50.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:50 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:23:50.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:50 smithi022 ceph-mon[39439]: osdmap e94: 12 total, 12 up, 12 in 2024-04-01T19:23:51.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:50 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:23:51.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:50 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:23:51.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:50 smithi188 ceph-mon[43939]: osdmap e94: 12 total, 12 up, 12 in 2024-04-01T19:23:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:50 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:23:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:50 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:23:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:50 smithi062 ceph-mon[44211]: osdmap e94: 12 total, 12 up, 12 in 2024-04-01T19:23:51.924 INFO:teuthology.orchestra.run.smithi022.stdout:193273528360 2024-04-01T19:23:52.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:51 smithi022 ceph-mon[39439]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:52.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:51 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1498679515' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-01T19:23:52.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:51 smithi188 ceph-mon[43939]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:52.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:51 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1498679515' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-01T19:23:52.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:51 smithi062 ceph-mon[44211]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:52.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:51 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1498679515' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-01T19:23:53.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:52 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:23:53.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:52 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:23:53.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:52 smithi022 ceph-mon[39439]: osdmap e95: 12 total, 12 up, 12 in 2024-04-01T19:23:53.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:52 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:23:53.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:52 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:23:53.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:52 smithi188 ceph-mon[43939]: osdmap e95: 12 total, 12 up, 12 in 2024-04-01T19:23:53.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:52 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:23:53.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:52 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:23:53.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:52 smithi062 ceph-mon[44211]: osdmap e95: 12 total, 12 up, 12 in 2024-04-01T19:23:53.475 INFO:teuthology.orchestra.run.smithi022.stdout:34359738439 2024-04-01T19:23:53.892 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528358 got 193273528360 for osd.6 2024-04-01T19:23:53.892 DEBUG:teuthology.parallel:result is None 2024-04-01T19:23:54.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:53 smithi022 ceph-mon[39439]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:54.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:53 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1859725958' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-01T19:23:54.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:53 smithi188 ceph-mon[43939]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:54.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:53 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1859725958' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-01T19:23:54.161 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:54.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:53 smithi062 ceph-mon[44211]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:54.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:53 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1859725958' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-01T19:23:54.808 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:54.811 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:54.812 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:23:56.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:55 smithi022 ceph-mon[39439]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:56.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:55 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:23:56.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:55 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:23:56.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:55 smithi022 ceph-mon[39439]: osdmap e96: 12 total, 12 up, 12 in 2024-04-01T19:23:56.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:55 smithi188 ceph-mon[43939]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:56.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:55 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:23:56.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:55 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:23:56.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:55 smithi188 ceph-mon[43939]: osdmap e96: 12 total, 12 up, 12 in 2024-04-01T19:23:56.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:55 smithi062 ceph-mon[44211]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:56.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:55 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:23:56.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:55 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:23:56.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:55 smithi062 ceph-mon[44211]: osdmap e96: 12 total, 12 up, 12 in 2024-04-01T19:23:57.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:56 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:23:57.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:56 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:23:57.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:56 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:23:58.050 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:57 smithi022 ceph-mon[39439]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:58.050 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:57 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:23:58.050 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:57 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:23:58.050 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:57 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:23:58.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:57 smithi188 ceph-mon[43939]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:58.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:57 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:23:58.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:57 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:23:58.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:57 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:23:58.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:57 smithi062 ceph-mon[44211]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:23:58.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:57 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:23:58.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:57 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:23:58.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:57 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:23:58.495 INFO:teuthology.orchestra.run.smithi022.stdout:365072220175 2024-04-01T19:23:59.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:58 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3571010096' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-01T19:23:59.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:58 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3660767186' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-01T19:23:59.123 INFO:teuthology.orchestra.run.smithi022.stdout:137438953523 2024-04-01T19:23:59.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:58 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3571010096' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-01T19:23:59.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:58 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3660767186' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-01T19:23:59.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:58 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3571010096' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-01T19:23:59.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:58 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3660767186' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-01T19:23:59.748 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738433 got 34359738439 for osd.0 2024-04-01T19:23:59.748 DEBUG:teuthology.parallel:result is None 2024-04-01T19:24:00.002 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:59 smithi022 ceph-mon[39439]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:00.002 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:23:59 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/930018727' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-01T19:24:00.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:59 smithi188 ceph-mon[43939]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:00.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:23:59 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/930018727' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-01T19:24:00.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:59 smithi062 ceph-mon[44211]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:00.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:23:59 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/930018727' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-01T19:24:00.766 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953519 got 137438953523 for osd.4 2024-04-01T19:24:00.766 DEBUG:teuthology.parallel:result is None 2024-04-01T19:24:01.459 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:24:02.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:01 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:24:02.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:01 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:24:02.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:01 smithi022 ceph-mon[39439]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:02.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:01 smithi022 ceph-mon[39439]: osdmap e97: 12 total, 12 up, 12 in 2024-04-01T19:24:02.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:01 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:24:02.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:01 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:24:02.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:01 smithi188 ceph-mon[43939]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:02.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:01 smithi188 ceph-mon[43939]: osdmap e97: 12 total, 12 up, 12 in 2024-04-01T19:24:02.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:01 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:24:02.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:01 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:24:02.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:01 smithi062 ceph-mon[44211]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:02.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:01 smithi062 ceph-mon[44211]: osdmap e97: 12 total, 12 up, 12 in 2024-04-01T19:24:02.371 INFO:teuthology.orchestra.run.smithi022.stdout:270582939679 2024-04-01T19:24:02.682 INFO:teuthology.orchestra.run.smithi022.stdout:231928234020 2024-04-01T19:24:02.999 INFO:teuthology.orchestra.run.smithi022.stdout:111669149753 2024-04-01T19:24:03.021 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:02 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/671146460' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-01T19:24:03.021 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:02 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1335441806' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-01T19:24:03.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:02 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/671146460' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-01T19:24:03.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:02 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1335441806' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-01T19:24:03.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:02 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/671146460' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-01T19:24:03.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:02 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1335441806' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-01T19:24:04.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:03 smithi022 ceph-mon[39439]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:04.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:03 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1671850258' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-01T19:24:04.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:03 smithi188 ceph-mon[43939]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:04.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:03 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1671850258' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-01T19:24:04.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:03 smithi062 ceph-mon[44211]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:04.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:03 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1671850258' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-01T19:24:04.356 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149748 got 111669149753 for osd.3 2024-04-01T19:24:04.356 DEBUG:teuthology.parallel:result is None 2024-04-01T19:24:04.826 INFO:tasks.cephadm.ceph_manager.ceph:need seq 365072220170 got 365072220175 for osd.11 2024-04-01T19:24:04.827 DEBUG:teuthology.parallel:result is None 2024-04-01T19:24:04.839 INFO:teuthology.orchestra.run.smithi022.stdout:85899345983 2024-04-01T19:24:05.055 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:24:05.992 INFO:tasks.cephadm.ceph_manager.ceph:need seq 85899345978 got 85899345983 for osd.2 2024-04-01T19:24:05.992 DEBUG:teuthology.parallel:result is None 2024-04-01T19:24:06.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:05 smithi022 ceph-mon[39439]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:05 smithi188 ceph-mon[43939]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:06.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:05 smithi062 ceph-mon[44211]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:06.792 INFO:teuthology.orchestra.run.smithi022.stdout:55834574916 2024-04-01T19:24:07.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:06 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1539120474' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-01T19:24:07.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:06 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1539120474' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-01T19:24:07.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:06 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1539120474' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-01T19:24:07.601 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574911 got 55834574916 for osd.1 2024-04-01T19:24:07.602 DEBUG:teuthology.parallel:result is None 2024-04-01T19:24:08.015 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234015 got 231928234020 for osd.7 2024-04-01T19:24:08.015 DEBUG:teuthology.parallel:result is None 2024-04-01T19:24:08.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:07 smithi022 ceph-mon[39439]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:08.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:07 smithi188 ceph-mon[43939]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:08.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:07 smithi062 ceph-mon[44211]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:09.264 INFO:teuthology.orchestra.run.smithi022.stdout:304942678044 2024-04-01T19:24:09.651 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939675 got 270582939679 for osd.8 2024-04-01T19:24:09.651 DEBUG:teuthology.parallel:result is None 2024-04-01T19:24:09.894 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:09 smithi022 ceph-mon[39439]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:09.894 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:09 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:24:09.894 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:09 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:24:09.894 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:09 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1445632977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-01T19:24:10.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:09 smithi188 ceph-mon[43939]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:10.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:09 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:24:10.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:09 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:24:10.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:09 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1445632977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-01T19:24:10.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:09 smithi062 ceph-mon[44211]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:10.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:09 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:24:10.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:09 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:24:10.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:09 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1445632977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-01T19:24:10.848 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678039 got 304942678044 for osd.9 2024-04-01T19:24:10.848 DEBUG:teuthology.parallel:result is None 2024-04-01T19:24:11.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:10 smithi022 ceph-mon[39439]: osdmap e98: 12 total, 12 up, 12 in 2024-04-01T19:24:11.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:10 smithi188 ceph-mon[43939]: osdmap e98: 12 total, 12 up, 12 in 2024-04-01T19:24:11.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:10 smithi062 ceph-mon[44211]: osdmap e98: 12 total, 12 up, 12 in 2024-04-01T19:24:11.331 INFO:teuthology.orchestra.run.smithi022.stdout:330712481814 2024-04-01T19:24:12.094 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:11 smithi022 ceph-mon[39439]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:12.094 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:11 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/530229060' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-01T19:24:12.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:11 smithi188 ceph-mon[43939]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:12.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:11 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/530229060' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-01T19:24:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:11 smithi062 ceph-mon[44211]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:11 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/530229060' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-01T19:24:12.569 INFO:teuthology.orchestra.run.smithi022.stdout:158913790002 2024-04-01T19:24:12.826 INFO:tasks.cephadm.ceph_manager.ceph:need seq 330712481809 got 330712481814 for osd.10 2024-04-01T19:24:12.826 DEBUG:teuthology.parallel:result is None 2024-04-01T19:24:13.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:12 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3767682421' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-01T19:24:13.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:12 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3767682421' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-01T19:24:13.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:12 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3767682421' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-01T19:24:13.586 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789996 got 158913790002 for osd.5 2024-04-01T19:24:13.586 DEBUG:teuthology.parallel:result is None 2024-04-01T19:24:13.586 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-01T19:24:13.587 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:24:13.867 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:24:14.124 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:13 smithi022 ceph-mon[39439]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:14.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:13 smithi188 ceph-mon[43939]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:14.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:13 smithi062 ceph-mon[44211]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:15.945 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:24:15.947 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:24:16.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:15 smithi188 ceph-mon[43939]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:16.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:15 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:24:16.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:15 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:24:16.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:15 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:24:16.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:15 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:24:16.212 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:15 smithi022 ceph-mon[39439]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:16.212 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:15 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:24:16.212 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:15 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:24:16.213 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:15 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:24:16.213 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:15 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:24:16.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:15 smithi062 ceph-mon[44211]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:16.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:15 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:24:16.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:15 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:24:16.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:15 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:24:16.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:15 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:24:16.666 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":321,"stamp":"2024-04-01T19:24:15.869735+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":2,"kb":1124941824,"kb_used":337012,"kb_used_data":8612,"kb_used_omap":18,"kb_used_meta":328237,"kb_avail":1124604812,"statfs":{"total":1151940427776,"available":1151595327488,"internally_reserved":0,"allocated":8818688,"data_stored":4615701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":336115001},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.269154"},"pg_stats":[{"pgid":"1.0","version":"15'137","reported_seq":339,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-01T19:24:09.857991+0000","last_change":"2024-04-01T19:23:28.441949+0000","last_active":"2024-04-01T19:24:09.857991+0000","last_peered":"2024-04-01T19:24:09.857991+0000","last_clean":"2024-04-01T19:24:09.857991+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:24:09.857991+0000","last_undegraded":"2024-04-01T19:24:09.857991+0000","last_fullsized":"2024-04-01T19:24:09.857991+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'137","last_scrub_stamp":"2024-04-01T19:23:28.441799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:18:35.244165+0000","last_clean_scrub_stamp":"2024-04-01T19:23:28.441799+0000","objects_scrubbed":2,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:24:39.943277+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28172,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716980,"statfs":{"total":95995035648,"available":95966187520,"internally_reserved":0,"allocated":1179648,"data_stored":825866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":77,"seq":330712481815,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717500,"statfs":{"total":95995035648,"available":95966720000,"internally_reserved":0,"allocated":647168,"data_stored":296938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678046,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717500,"statfs":{"total":95995035648,"available":95966720000,"internally_reserved":0,"allocated":647168,"data_stored":296958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":63,"seq":270582939682,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717500,"statfs":{"total":95995035648,"available":95966720000,"internally_reserved":0,"allocated":647168,"data_stored":296958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234024,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28172,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716980,"statfs":{"total":95995035648,"available":95966187520,"internally_reserved":0,"allocated":1179648,"data_stored":825886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528365,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717500,"statfs":{"total":95995035648,"available":95966720000,"internally_reserved":0,"allocated":647168,"data_stored":296958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717500,"statfs":{"total":95995035648,"available":95966720000,"internally_reserved":0,"allocated":647168,"data_stored":296958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717500,"statfs":{"total":95995035648,"available":95966720000,"internally_reserved":0,"allocated":647168,"data_stored":296958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899345986,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713340,"statfs":{"total":95995035648,"available":95962460160,"internally_reserved":0,"allocated":647168,"data_stored":296958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149755,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717500,"statfs":{"total":95995035648,"available":95966720000,"internally_reserved":0,"allocated":647168,"data_stored":296958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953526,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27640,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717512,"statfs":{"total":95995035648,"available":95966732288,"internally_reserved":0,"allocated":634880,"data_stored":291347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790003,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717500,"statfs":{"total":95995035648,"available":95966720000,"internally_reserved":0,"allocated":647168,"data_stored":296958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:24:16.667 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:24:16.945 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:24:17.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:16 smithi022 ceph-mon[39439]: osdmap e99: 12 total, 12 up, 12 in 2024-04-01T19:24:17.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:16 smithi022 ceph-mon[39439]: from='client.14748 v1:172.21.15.22:0/1000862296' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:24:17.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:16 smithi062 ceph-mon[44211]: osdmap e99: 12 total, 12 up, 12 in 2024-04-01T19:24:17.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:16 smithi062 ceph-mon[44211]: from='client.14748 v1:172.21.15.22:0/1000862296' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:24:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:16 smithi188 ceph-mon[43939]: osdmap e99: 12 total, 12 up, 12 in 2024-04-01T19:24:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:16 smithi188 ceph-mon[43939]: from='client.14748 v1:172.21.15.22:0/1000862296' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:24:18.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:17 smithi022 ceph-mon[39439]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:18.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:17 smithi062 ceph-mon[44211]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:17 smithi188 ceph-mon[43939]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:18.909 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:24:18.910 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:24:19.712 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2024-04-01T19:24:18.602780+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":2,"kb":1124941824,"kb_used":337084,"kb_used_data":8684,"kb_used_omap":18,"kb_used_meta":328237,"kb_avail":1124604740,"statfs":{"total":1151940427776,"available":1151595253760,"internally_reserved":0,"allocated":8892416,"data_stored":4649617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":336115001},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.746531"},"pg_stats":[{"pgid":"1.0","version":"15'137","reported_seq":341,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-01T19:24:15.976047+0000","last_change":"2024-04-01T19:23:28.441949+0000","last_active":"2024-04-01T19:24:15.976047+0000","last_peered":"2024-04-01T19:24:15.976047+0000","last_clean":"2024-04-01T19:24:15.976047+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:24:15.976047+0000","last_undegraded":"2024-04-01T19:24:15.976047+0000","last_fullsized":"2024-04-01T19:24:15.976047+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'137","last_scrub_stamp":"2024-04-01T19:23:28.441799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:18:35.244165+0000","last_clean_scrub_stamp":"2024-04-01T19:23:28.441799+0000","objects_scrubbed":2,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:24:39.943277+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28172,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716980,"statfs":{"total":95995035648,"available":95966187520,"internally_reserved":0,"allocated":1179648,"data_stored":825866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":77,"seq":330712481816,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27664,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717488,"statfs":{"total":95995035648,"available":95966707712,"internally_reserved":0,"allocated":659456,"data_stored":302599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678046,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717500,"statfs":{"total":95995035648,"available":95966720000,"internally_reserved":0,"allocated":647168,"data_stored":296958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":63,"seq":270582939683,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27664,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717488,"statfs":{"total":95995035648,"available":95966707712,"internally_reserved":0,"allocated":659456,"data_stored":302619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234025,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28184,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716968,"statfs":{"total":95995035648,"available":95966175232,"internally_reserved":0,"allocated":1191936,"data_stored":831547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528366,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27664,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717488,"statfs":{"total":95995035648,"available":95966707712,"internally_reserved":0,"allocated":659456,"data_stored":302619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717500,"statfs":{"total":95995035648,"available":95966720000,"internally_reserved":0,"allocated":647168,"data_stored":296958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717500,"statfs":{"total":95995035648,"available":95966720000,"internally_reserved":0,"allocated":647168,"data_stored":296958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899345987,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713340,"statfs":{"total":95995035648,"available":95962460160,"internally_reserved":0,"allocated":647168,"data_stored":296958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149756,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27664,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717488,"statfs":{"total":95995035648,"available":95966707712,"internally_reserved":0,"allocated":659456,"data_stored":302619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953527,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717500,"statfs":{"total":95995035648,"available":95966720000,"internally_reserved":0,"allocated":647168,"data_stored":296958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790003,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717500,"statfs":{"total":95995035648,"available":95966720000,"internally_reserved":0,"allocated":647168,"data_stored":296958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:24:19.712 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-01T19:24:19.713 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-01T19:24:19.713 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-01T19:24:19.713 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph health --format=json 2024-04-01T19:24:19.990 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:24:20.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:19 smithi022 ceph-mon[39439]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:20.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:19 smithi022 ceph-mon[39439]: from='client.14754 v1:172.21.15.22:0/3505552309' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:24:20.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:19 smithi062 ceph-mon[44211]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:20.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:19 smithi062 ceph-mon[44211]: from='client.14754 v1:172.21.15.22:0/3505552309' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:24:20.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:19 smithi188 ceph-mon[43939]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:20.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:19 smithi188 ceph-mon[43939]: from='client.14754 v1:172.21.15.22:0/3505552309' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:24:21.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:20 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:24:21.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:20 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:24:21.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:20 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:24:21.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:20 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:24:21.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:20 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:24:21.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:20 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:24:21.905 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:24:21.905 INFO:teuthology.orchestra.run.smithi022.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-01T19:24:22.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:21 smithi062 ceph-mon[44211]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:22.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:21 smithi062 ceph-mon[44211]: osdmap e100: 12 total, 12 up, 12 in 2024-04-01T19:24:22.281 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:21 smithi022 ceph-mon[39439]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:22.281 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:21 smithi022 ceph-mon[39439]: osdmap e100: 12 total, 12 up, 12 in 2024-04-01T19:24:22.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:21 smithi188 ceph-mon[43939]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:22.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:21 smithi188 ceph-mon[43939]: osdmap e100: 12 total, 12 up, 12 in 2024-04-01T19:24:22.727 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-01T19:24:22.728 INFO:tasks.cephadm:Setup complete, yielding 2024-04-01T19:24:22.728 INFO:teuthology.run_tasks:Running task exec... 2024-04-01T19:24:22.738 INFO:teuthology.task.exec:Executing custom commands... 2024-04-01T19:24:22.738 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi022.front.sepia.ceph.com 2024-04-01T19:24:22.738 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'while ! ceph balancer status ; do sleep 1 ; done' 2024-04-01T19:24:23.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:22 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/555768820' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-01T19:24:23.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:22 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/555768820' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-01T19:24:23.284 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:24:23.284 INFO:teuthology.orchestra.run.smithi022.stdout: "active": true, 2024-04-01T19:24:23.284 INFO:teuthology.orchestra.run.smithi022.stdout: "last_optimize_duration": "0:00:00.000354", 2024-04-01T19:24:23.284 INFO:teuthology.orchestra.run.smithi022.stdout: "last_optimize_started": "Mon Apr 1 19:23:30 2024", 2024-04-01T19:24:23.284 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "upmap", 2024-04-01T19:24:23.284 INFO:teuthology.orchestra.run.smithi022.stdout: "no_optimization_needed": true, 2024-04-01T19:24:23.284 INFO:teuthology.orchestra.run.smithi022.stdout: "optimize_result": "Unable to find further optimization, or pool(s) pg_num is decreasing, or distribution is already perfect", 2024-04-01T19:24:23.284 INFO:teuthology.orchestra.run.smithi022.stdout: "plans": [] 2024-04-01T19:24:23.284 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:24:23.298 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph balancer mode crush-compat' 2024-04-01T19:24:23.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:22 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/555768820' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-01T19:24:23.916 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph balancer on' 2024-04-01T19:24:24.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:23 smithi062 ceph-mon[44211]: pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:24.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:23 smithi062 ceph-mon[44211]: from='client.14766 v1:172.21.15.22:0/1340345914' entity='client.admin' cmd=[{"prefix": "balancer status", "target": ["mgr", ""]}]: dispatch 2024-04-01T19:24:24.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:23 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set create-compat", "format": "json"}]: dispatch 2024-04-01T19:24:24.298 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:23 smithi022 ceph-mon[39439]: pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:24.298 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:23 smithi022 ceph-mon[39439]: from='client.14766 v1:172.21.15.22:0/1340345914' entity='client.admin' cmd=[{"prefix": "balancer status", "target": ["mgr", ""]}]: dispatch 2024-04-01T19:24:24.298 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:23 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set create-compat", "format": "json"}]: dispatch 2024-04-01T19:24:24.299 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-01T19:24:24.309 INFO:tasks.thrashosds:config is {'chance_pgnum_grow': 0.25, 'chance_pgpnum_fix': 0.25, 'chance_test_map_discontinuity': 2, 'timeout': 1800, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-01T19:24:24.310 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-yuri8-testing-2024-03-25-1419'}, 'ceph': {'conf': {'client.2': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd heartbeat use min delay socket': True, 'osd map cache size': 1, 'osd max backfills': 6, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub during recovery': False, 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', '\\(MON_DOWN\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'osd_map_cache_size', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'mon_bind_msgr2': False, 'sha1': 'e142085d06ebbedb32196116c9f19e2d28f93430'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'e142085d06ebbedb32196116c9f19e2d28f93430'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'workunit': {'branch': 'wip-tracker-64864', 'sha1': 'b64378df0aa36ce626cf358e9d2b6f4658480c2f'}} 2024-04-01T19:24:24.310 INFO:tasks.thrashosds:config is {'chance_pgnum_grow': 0.25, 'chance_pgpnum_fix': 0.25, 'chance_test_map_discontinuity': 2, 'timeout': 1800, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-01T19:24:24.310 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-01T19:24:24.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:23 smithi188 ceph-mon[43939]: pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:24.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:23 smithi188 ceph-mon[43939]: from='client.14766 v1:172.21.15.22:0/1340345914' entity='client.admin' cmd=[{"prefix": "balancer status", "target": ["mgr", ""]}]: dispatch 2024-04-01T19:24:24.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:23 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set create-compat", "format": "json"}]: dispatch 2024-04-01T19:24:24.581 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:24:25.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:24 smithi022 ceph-mon[39439]: from='client.14772 v1:172.21.15.22:0/3616632175' entity='client.admin' cmd=[{"prefix": "balancer mode", "mode": "crush-compat", "target": ["mgr", ""]}]: dispatch 2024-04-01T19:24:25.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set create-compat", "format": "json"}]': finished 2024-04-01T19:24:25.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:24 smithi022 ceph-mon[39439]: osdmap e101: 12 total, 12 up, 12 in 2024-04-01T19:24:25.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush dump", "format": "json"}]: dispatch 2024-04-01T19:24:25.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:24:25.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:24:25.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:24:25.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:24:25.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:24:25.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:24 smithi022 ceph-mon[39439]: from='client.14778 v1:172.21.15.22:0/1910373829' entity='client.admin' cmd=[{"prefix": "balancer on", "target": ["mgr", ""]}]: dispatch 2024-04-01T19:24:25.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:24 smithi062 ceph-mon[44211]: from='client.14772 v1:172.21.15.22:0/3616632175' entity='client.admin' cmd=[{"prefix": "balancer mode", "mode": "crush-compat", "target": ["mgr", ""]}]: dispatch 2024-04-01T19:24:25.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set create-compat", "format": "json"}]': finished 2024-04-01T19:24:25.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:24 smithi062 ceph-mon[44211]: osdmap e101: 12 total, 12 up, 12 in 2024-04-01T19:24:25.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush dump", "format": "json"}]: dispatch 2024-04-01T19:24:25.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:24:25.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:24:25.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:24:25.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:24:25.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:24:25.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:24 smithi062 ceph-mon[44211]: from='client.14778 v1:172.21.15.22:0/1910373829' entity='client.admin' cmd=[{"prefix": "balancer on", "target": ["mgr", ""]}]: dispatch 2024-04-01T19:24:25.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:24 smithi188 ceph-mon[43939]: from='client.14772 v1:172.21.15.22:0/3616632175' entity='client.admin' cmd=[{"prefix": "balancer mode", "mode": "crush-compat", "target": ["mgr", ""]}]: dispatch 2024-04-01T19:24:25.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set create-compat", "format": "json"}]': finished 2024-04-01T19:24:25.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:24 smithi188 ceph-mon[43939]: osdmap e101: 12 total, 12 up, 12 in 2024-04-01T19:24:25.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush dump", "format": "json"}]: dispatch 2024-04-01T19:24:25.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:24:25.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:24:25.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:24:25.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:24:25.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:24:25.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:24 smithi188 ceph-mon[43939]: from='client.14778 v1:172.21.15.22:0/1910373829' entity='client.admin' cmd=[{"prefix": "balancer on", "target": ["mgr", ""]}]: dispatch 2024-04-01T19:24:26.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:25 smithi022 ceph-mon[39439]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:26.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:25 smithi062 ceph-mon[44211]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:26.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:25 smithi188 ceph-mon[43939]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:27.643 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-01T19:24:27.644 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-01T19:24:27.644 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:24:27.925 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:24:28.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:27 smithi022 ceph-mon[39439]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:28.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:27 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4150555123' entity='client.admin' 2024-04-01T19:24:28.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:27 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:24:28.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:27 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:24:28.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:27 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:24:28.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:27 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:24:28.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:27 smithi188 ceph-mon[43939]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:28.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:27 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4150555123' entity='client.admin' 2024-04-01T19:24:28.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:27 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:24:28.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:27 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:24:28.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:27 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:24:28.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:27 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:24:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:27 smithi062 ceph-mon[44211]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:27 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4150555123' entity='client.admin' 2024-04-01T19:24:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:27 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:24:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:27 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:24:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:27 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:24:28.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:27 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:24:29.755 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:24:29.757 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:24:30.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:29 smithi022 ceph-mon[39439]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:30.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:29 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:24:30.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:29 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:24:30.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:29 smithi188 ceph-mon[43939]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:30.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:29 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:24:30.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:29 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:24:30.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:29 smithi062 ceph-mon[44211]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:30.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:29 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:24:30.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:29 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:24:30.453 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":330,"stamp":"2024-04-01T19:24:28.604767+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":2,"kb":1124941824,"kb_used":337412,"kb_used_data":9008,"kb_used_omap":18,"kb_used_meta":328237,"kb_avail":1124604412,"statfs":{"total":1151940427776,"available":1151594917888,"internally_reserved":0,"allocated":9224192,"data_stored":4814872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":336115001},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001452"},"pg_stats":[{"pgid":"1.0","version":"15'137","reported_seq":345,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-01T19:24:25.650347+0000","last_change":"2024-04-01T19:23:28.441949+0000","last_active":"2024-04-01T19:24:25.650347+0000","last_peered":"2024-04-01T19:24:25.650347+0000","last_clean":"2024-04-01T19:24:25.650347+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:24:25.650347+0000","last_undegraded":"2024-04-01T19:24:25.650347+0000","last_fullsized":"2024-04-01T19:24:25.650347+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'137","last_scrub_stamp":"2024-04-01T19:23:28.441799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:18:35.244165+0000","last_clean_scrub_stamp":"2024-04-01T19:23:28.441799+0000","objects_scrubbed":2,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:24:39.943277+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220181,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28208,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716944,"statfs":{"total":95995035648,"available":95966150656,"internally_reserved":0,"allocated":1216512,"data_stored":844425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":77,"seq":330712481818,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717464,"statfs":{"total":95995035648,"available":95966683136,"internally_reserved":0,"allocated":684032,"data_stored":315497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678048,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717476,"statfs":{"total":95995035648,"available":95966695424,"internally_reserved":0,"allocated":671744,"data_stored":308230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":63,"seq":270582939685,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717464,"statfs":{"total":95995035648,"available":95966683136,"internally_reserved":0,"allocated":684032,"data_stored":315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234027,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28208,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716944,"statfs":{"total":95995035648,"available":95966150656,"internally_reserved":0,"allocated":1216512,"data_stored":844445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528368,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27692,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717460,"statfs":{"total":95995035648,"available":95966679040,"internally_reserved":0,"allocated":684032,"data_stored":315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717476,"statfs":{"total":95995035648,"available":95966695424,"internally_reserved":0,"allocated":671744,"data_stored":308230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717476,"statfs":{"total":95995035648,"available":95966695424,"internally_reserved":0,"allocated":671744,"data_stored":308230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899345989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31836,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713316,"statfs":{"total":95995035648,"available":95962435584,"internally_reserved":0,"allocated":671744,"data_stored":308230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149758,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717464,"statfs":{"total":95995035648,"available":95966683136,"internally_reserved":0,"allocated":684032,"data_stored":315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717464,"statfs":{"total":95995035648,"available":95966683136,"internally_reserved":0,"allocated":684032,"data_stored":315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717464,"statfs":{"total":95995035648,"available":95966683136,"internally_reserved":0,"allocated":684032,"data_stored":315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:24:30.454 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:24:30.733 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:24:31.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:30 smithi022 ceph-mon[39439]: from='client.14790 v1:172.21.15.22:0/1311769282' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:24:31.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:30 smithi022 ceph-mon[39439]: osdmap e102: 12 total, 12 up, 12 in 2024-04-01T19:24:31.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:30 smithi188 ceph-mon[43939]: from='client.14790 v1:172.21.15.22:0/1311769282' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:24:31.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:30 smithi188 ceph-mon[43939]: osdmap e102: 12 total, 12 up, 12 in 2024-04-01T19:24:31.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:30 smithi062 ceph-mon[44211]: from='client.14790 v1:172.21.15.22:0/1311769282' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:24:31.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:30 smithi062 ceph-mon[44211]: osdmap e102: 12 total, 12 up, 12 in 2024-04-01T19:24:31.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:31 smithi022 ceph-mon[39439]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:32.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:31 smithi188 ceph-mon[43939]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:32.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:31 smithi062 ceph-mon[44211]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:32.653 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:24:32.655 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:24:33.265 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2024-04-01T19:24:32.605296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":2,"kb":1124941824,"kb_used":337540,"kb_used_data":8580,"kb_used_omap":18,"kb_used_meta":328237,"kb_avail":1124604284,"statfs":{"total":1151940427776,"available":1151594786816,"internally_reserved":0,"allocated":8785920,"data_stored":4593693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":336115001},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.707789"},"pg_stats":[{"pgid":"1.0","version":"15'137","reported_seq":345,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-01T19:24:25.650347+0000","last_change":"2024-04-01T19:23:28.441949+0000","last_active":"2024-04-01T19:24:25.650347+0000","last_peered":"2024-04-01T19:24:25.650347+0000","last_clean":"2024-04-01T19:24:25.650347+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:24:25.650347+0000","last_undegraded":"2024-04-01T19:24:25.650347+0000","last_fullsized":"2024-04-01T19:24:25.650347+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'137","last_scrub_stamp":"2024-04-01T19:23:28.441799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:18:35.244165+0000","last_clean_scrub_stamp":"2024-04-01T19:23:28.441799+0000","objects_scrubbed":2,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:24:39.943277+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220182,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28208,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716944,"statfs":{"total":95995035648,"available":95966150656,"internally_reserved":0,"allocated":1216512,"data_stored":844425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":77,"seq":330712481819,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27700,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717452,"statfs":{"total":95995035648,"available":95966670848,"internally_reserved":0,"allocated":614400,"data_stored":279736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678049,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717464,"statfs":{"total":95995035648,"available":95966683136,"internally_reserved":0,"allocated":684032,"data_stored":315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":63,"seq":270582939686,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27700,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717452,"statfs":{"total":95995035648,"available":95966670848,"internally_reserved":0,"allocated":614400,"data_stored":279756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234027,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28208,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716944,"statfs":{"total":95995035648,"available":95966150656,"internally_reserved":0,"allocated":1216512,"data_stored":844445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528369,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27700,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717452,"statfs":{"total":95995035648,"available":95966670848,"internally_reserved":0,"allocated":614400,"data_stored":279756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717464,"statfs":{"total":95995035648,"available":95966683136,"internally_reserved":0,"allocated":684032,"data_stored":315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717464,"statfs":{"total":95995035648,"available":95966683136,"internally_reserved":0,"allocated":684032,"data_stored":315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899345990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31860,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713292,"statfs":{"total":95995035648,"available":95962411008,"internally_reserved":0,"allocated":614400,"data_stored":279756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149759,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27700,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717452,"statfs":{"total":95995035648,"available":95966670848,"internally_reserved":0,"allocated":614400,"data_stored":279756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953530,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27700,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717452,"statfs":{"total":95995035648,"available":95966670848,"internally_reserved":0,"allocated":614400,"data_stored":279756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790006,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27700,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717452,"statfs":{"total":95995035648,"available":95966670848,"internally_reserved":0,"allocated":614400,"data_stored":279756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:24:33.266 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-01T19:24:33.266 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd dump 2024-04-01T19:24:33.544 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:24:34.037 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:33 smithi022 ceph-mon[39439]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:34.038 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:33 smithi022 ceph-mon[39439]: from='client.14796 v1:172.21.15.22:0/4282532758' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:24:34.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:33 smithi188 ceph-mon[43939]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:34.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:33 smithi188 ceph-mon[43939]: from='client.14796 v1:172.21.15.22:0/4282532758' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:24:34.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:33 smithi062 ceph-mon[44211]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:34.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:33 smithi062 ceph-mon[44211]: from='client.14796 v1:172.21.15.22:0/4282532758' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:24:35.452 INFO:teuthology.orchestra.run.smithi022.stdout:epoch 102 2024-04-01T19:24:35.452 INFO:teuthology.orchestra.run.smithi022.stdout:fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T19:24:35.452 INFO:teuthology.orchestra.run.smithi022.stdout:created 2024-04-01T19:15:34.344221+0000 2024-04-01T19:24:35.452 INFO:teuthology.orchestra.run.smithi022.stdout:modified 2024-04-01T19:24:29.784398+0000 2024-04-01T19:24:35.453 INFO:teuthology.orchestra.run.smithi022.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-01T19:24:35.453 INFO:teuthology.orchestra.run.smithi022.stdout:crush_version 27 2024-04-01T19:24:35.453 INFO:teuthology.orchestra.run.smithi022.stdout:full_ratio 0.95 2024-04-01T19:24:35.453 INFO:teuthology.orchestra.run.smithi022.stdout:backfillfull_ratio 0.9 2024-04-01T19:24:35.453 INFO:teuthology.orchestra.run.smithi022.stdout:nearfull_ratio 0.85 2024-04-01T19:24:35.453 INFO:teuthology.orchestra.run.smithi022.stdout:require_min_compat_client luminous 2024-04-01T19:24:35.453 INFO:teuthology.orchestra.run.smithi022.stdout:min_compat_client jewel 2024-04-01T19:24:35.453 INFO:teuthology.orchestra.run.smithi022.stdout:require_osd_release squid 2024-04-01T19:24:35.453 INFO:teuthology.orchestra.run.smithi022.stdout:stretch_mode_enabled false 2024-04-01T19:24:35.453 INFO:teuthology.orchestra.run.smithi022.stdout:pool 1 '.mgr' replicated size 2 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 16 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 11.76 2024-04-01T19:24:35.453 INFO:teuthology.orchestra.run.smithi022.stdout:max_osd 12 2024-04-01T19:24:35.453 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0 up in weight 1 up_from 8 up_thru 56 down_at 0 last_clean_interval [0,0) v1:172.21.15.22:6801/1419201649 v1:172.21.15.22:6802/1419201649 exists,up cfd4aa7e-a933-42e2-aac8-f93a3d9fcc3d 2024-04-01T19:24:35.453 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1 up in weight 1 up_from 13 up_thru 14 down_at 0 last_clean_interval [0,0) v1:172.21.15.22:6805/2579227110 v1:172.21.15.22:6806/2579227110 exists,up 6ddadf19-2b4e-4c01-8918-9d51c323925b 2024-04-01T19:24:35.453 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.22:6809/835455757 v1:172.21.15.22:6810/835455757 exists,up 4af1f44c-f47c-4ce6-87ba-1aeec3960969 2024-04-01T19:24:35.453 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3 up in weight 1 up_from 26 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.22:6813/90988887 v1:172.21.15.22:6814/90988887 exists,up c399f336-23c7-414a-822e-63793daf85c1 2024-04-01T19:24:35.454 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4 up in weight 1 up_from 32 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.62:6800/2408168690 v1:172.21.15.62:6801/2408168690 exists,up 0a2690dc-e5b6-4d29-b517-980018519d76 2024-04-01T19:24:35.454 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5 up in weight 1 up_from 37 up_thru 40 down_at 0 last_clean_interval [0,0) v1:172.21.15.62:6804/386874616 v1:172.21.15.62:6805/386874616 exists,up c6830412-959a-4f1e-8c3d-f4b2d88673e6 2024-04-01T19:24:35.454 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6 up in weight 1 up_from 45 up_thru 48 down_at 0 last_clean_interval [0,0) v1:172.21.15.62:6808/90097362 v1:172.21.15.62:6809/90097362 exists,up f646310b-91a4-4259-a51f-6a0e92b7cba8 2024-04-01T19:24:35.454 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7 up in weight 1 up_from 54 up_thru 86 down_at 0 last_clean_interval [0,0) v1:172.21.15.62:6812/2055487337 v1:172.21.15.62:6813/2055487337 exists,up afe5f371-c892-43e9-b82e-c2d911354e9a 2024-04-01T19:24:35.454 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8 up in weight 1 up_from 63 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.188:6800/2108324328 v1:172.21.15.188:6801/2108324328 exists,up b7eb6461-f6fa-4a12-864c-6e6748e6337e 2024-04-01T19:24:35.454 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9 up in weight 1 up_from 71 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.188:6804/1755990887 v1:172.21.15.188:6805/1755990887 exists,up 7d496ad5-46bf-485a-81d9-2b9da2a59882 2024-04-01T19:24:35.454 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10 up in weight 1 up_from 77 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.188:6808/3777340429 v1:172.21.15.188:6809/3777340429 exists,up 6cbb80ce-37f7-48df-9090-09a6068e4490 2024-04-01T19:24:35.454 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11 up in weight 1 up_from 85 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.188:6812/3987199514 v1:172.21.15.188:6813/3987199514 exists,up c03517c4-fdb0-4587-96c1-b959041c4344 2024-04-01T19:24:35.454 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/3735983556 expires 2024-04-02T19:16:30.513384+0000 2024-04-01T19:24:35.454 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/3575578250 expires 2024-04-02T19:16:30.513384+0000 2024-04-01T19:24:35.454 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/2493529775 expires 2024-04-02T19:16:02.302343+0000 2024-04-01T19:24:35.454 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:6800/2678666836 expires 2024-04-02T19:16:30.513384+0000 2024-04-01T19:24:35.454 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/2389537847 expires 2024-04-02T19:16:02.302343+0000 2024-04-01T19:24:35.454 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/798807675 expires 2024-04-02T19:16:02.302343+0000 2024-04-01T19:24:35.454 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:6800/1090179981 expires 2024-04-02T19:16:02.302343+0000 2024-04-01T19:24:35.455 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/51907384 expires 2024-04-02T19:16:30.513384+0000 2024-04-01T19:24:36.077 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:35 smithi022 ceph-mon[39439]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:36.077 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:35 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3665904112' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-01T19:24:36.104 INFO:tasks.cephadm.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 56 down_at 0 last_clean_interval [0,0) v1:172.21.15.22:6801/1419201649 v1:172.21.15.22:6802/1419201649 exists,up cfd4aa7e-a933-42e2-aac8-f93a3d9fcc3d', 'osd.1 up in weight 1 up_from 13 up_thru 14 down_at 0 last_clean_interval [0,0) v1:172.21.15.22:6805/2579227110 v1:172.21.15.22:6806/2579227110 exists,up 6ddadf19-2b4e-4c01-8918-9d51c323925b', 'osd.2 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.22:6809/835455757 v1:172.21.15.22:6810/835455757 exists,up 4af1f44c-f47c-4ce6-87ba-1aeec3960969', 'osd.3 up in weight 1 up_from 26 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.22:6813/90988887 v1:172.21.15.22:6814/90988887 exists,up c399f336-23c7-414a-822e-63793daf85c1', 'osd.4 up in weight 1 up_from 32 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.62:6800/2408168690 v1:172.21.15.62:6801/2408168690 exists,up 0a2690dc-e5b6-4d29-b517-980018519d76', 'osd.5 up in weight 1 up_from 37 up_thru 40 down_at 0 last_clean_interval [0,0) v1:172.21.15.62:6804/386874616 v1:172.21.15.62:6805/386874616 exists,up c6830412-959a-4f1e-8c3d-f4b2d88673e6', 'osd.6 up in weight 1 up_from 45 up_thru 48 down_at 0 last_clean_interval [0,0) v1:172.21.15.62:6808/90097362 v1:172.21.15.62:6809/90097362 exists,up f646310b-91a4-4259-a51f-6a0e92b7cba8', 'osd.7 up in weight 1 up_from 54 up_thru 86 down_at 0 last_clean_interval [0,0) v1:172.21.15.62:6812/2055487337 v1:172.21.15.62:6813/2055487337 exists,up afe5f371-c892-43e9-b82e-c2d911354e9a', 'osd.8 up in weight 1 up_from 63 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.188:6800/2108324328 v1:172.21.15.188:6801/2108324328 exists,up b7eb6461-f6fa-4a12-864c-6e6748e6337e', 'osd.9 up in weight 1 up_from 71 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.188:6804/1755990887 v1:172.21.15.188:6805/1755990887 exists,up 7d496ad5-46bf-485a-81d9-2b9da2a59882', 'osd.10 up in weight 1 up_from 77 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.188:6808/3777340429 v1:172.21.15.188:6809/3777340429 exists,up 6cbb80ce-37f7-48df-9090-09a6068e4490', 'osd.11 up in weight 1 up_from 85 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.188:6812/3987199514 v1:172.21.15.188:6813/3987199514 exists,up c03517c4-fdb0-4587-96c1-b959041c4344'] 2024-04-01T19:24:36.105 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon mon.a config show 2024-04-01T19:24:36.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:35 smithi188 ceph-mon[43939]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:36.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:35 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3665904112' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-01T19:24:36.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:35 smithi062 ceph-mon[44211]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:36.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:35 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3665904112' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-01T19:24:36.381 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:24:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:36 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:24:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:36 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:24:37.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:36 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:24:37.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:36 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:24:37.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:36 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:24:37.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:36 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:24:38.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:37 smithi022 ceph-mon[39439]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:38.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:37 smithi022 ceph-mon[39439]: osdmap e103: 12 total, 12 up, 12 in 2024-04-01T19:24:38.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:37 smithi188 ceph-mon[43939]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:38.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:37 smithi188 ceph-mon[43939]: osdmap e103: 12 total, 12 up, 12 in 2024-04-01T19:24:38.142 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:24:38.142 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mon.a", 2024-04-01T19:24:38.142 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster": "ceph", 2024-04-01T19:24:38.142 INFO:teuthology.orchestra.run.smithi022.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-01T19:24:38.143 INFO:teuthology.orchestra.run.smithi022.stdout: "admin_socket_mode": "", 2024-04-01T19:24:38.143 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-01T19:24:38.143 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_client_required": "cephx, none", 2024-04-01T19:24:38.143 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_cluster_required": "cephx", 2024-04-01T19:24:38.143 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_debug": "true", 2024-04-01T19:24:38.143 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-01T19:24:38.143 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-01T19:24:38.143 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_service_required": "cephx", 2024-04-01T19:24:38.143 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-01T19:24:38.143 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_supported": "", 2024-04-01T19:24:38.143 INFO:teuthology.orchestra.run.smithi022.stdout: "bdev_aio": "true", 2024-04-01T19:24:38.143 INFO:teuthology.orchestra.run.smithi022.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-01T19:24:38.143 INFO:teuthology.orchestra.run.smithi022.stdout: "bdev_aio_poll_ms": "250", 2024-04-01T19:24:38.143 INFO:teuthology.orchestra.run.smithi022.stdout: "bdev_aio_reap_max": "16", 2024-04-01T19:24:38.144 INFO:teuthology.orchestra.run.smithi022.stdout: "bdev_async_discard_threads": "0", 2024-04-01T19:24:38.144 INFO:teuthology.orchestra.run.smithi022.stdout: "bdev_block_size": "4096", 2024-04-01T19:24:38.144 INFO:teuthology.orchestra.run.smithi022.stdout: "bdev_debug_aio": "false", 2024-04-01T19:24:38.144 INFO:teuthology.orchestra.run.smithi022.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-01T19:24:38.144 INFO:teuthology.orchestra.run.smithi022.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-01T19:24:38.144 INFO:teuthology.orchestra.run.smithi022.stdout: "bdev_debug_inflight_ios": "false", 2024-04-01T19:24:38.144 INFO:teuthology.orchestra.run.smithi022.stdout: "bdev_enable_discard": "false", 2024-04-01T19:24:38.144 INFO:teuthology.orchestra.run.smithi022.stdout: "bdev_flock_retry": "3", 2024-04-01T19:24:38.144 INFO:teuthology.orchestra.run.smithi022.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-01T19:24:38.144 INFO:teuthology.orchestra.run.smithi022.stdout: "bdev_inject_crash": "0", 2024-04-01T19:24:38.144 INFO:teuthology.orchestra.run.smithi022.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-01T19:24:38.144 INFO:teuthology.orchestra.run.smithi022.stdout: "bdev_ioring": "false", 2024-04-01T19:24:38.144 INFO:teuthology.orchestra.run.smithi022.stdout: "bdev_ioring_hipri": "false", 2024-04-01T19:24:38.144 INFO:teuthology.orchestra.run.smithi022.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-01T19:24:38.145 INFO:teuthology.orchestra.run.smithi022.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-01T19:24:38.145 INFO:teuthology.orchestra.run.smithi022.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-01T19:24:38.145 INFO:teuthology.orchestra.run.smithi022.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-01T19:24:38.145 INFO:teuthology.orchestra.run.smithi022.stdout: "bdev_type": "", 2024-04-01T19:24:38.145 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_alloc_size": "1048576", 2024-04-01T19:24:38.145 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_allocator": "hybrid", 2024-04-01T19:24:38.145 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_buffered_io": "true", 2024-04-01T19:24:38.145 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_check_for_zeros": "false", 2024-04-01T19:24:38.145 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-01T19:24:38.145 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-01T19:24:38.145 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_compact_log_sync": "false", 2024-04-01T19:24:38.146 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-01T19:24:38.146 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-01T19:24:38.146 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-01T19:24:38.146 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-01T19:24:38.146 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_max_log_runway": "4194304", 2024-04-01T19:24:38.146 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_max_prefetch": "1048576", 2024-04-01T19:24:38.146 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_min_flush_size": "524288", 2024-04-01T19:24:38.146 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_min_log_runway": "1048576", 2024-04-01T19:24:38.146 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_replay_recovery": "false", 2024-04-01T19:24:38.146 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-01T19:24:38.146 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-01T19:24:38.146 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_sync_write": "false", 2024-04-01T19:24:38.146 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-01T19:24:38.147 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-01T19:24:38.147 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-01T19:24:38.147 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_allocation_from_file": "true", 2024-04-01T19:24:38.147 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_allocator": "hybrid", 2024-04-01T19:24:38.147 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-01T19:24:38.147 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-01T19:24:38.147 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-01T19:24:38.147 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-01T19:24:38.147 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-01T19:24:38.147 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-01T19:24:38.147 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-01T19:24:38.147 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_block_create": "true", 2024-04-01T19:24:38.147 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_block_db_create": "false", 2024-04-01T19:24:38.148 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_block_db_path": "", 2024-04-01T19:24:38.148 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_block_db_size": "0", 2024-04-01T19:24:38.148 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_block_path": "", 2024-04-01T19:24:38.148 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_block_preallocate_file": "false", 2024-04-01T19:24:38.148 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_block_size": "107374182400", 2024-04-01T19:24:38.148 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_block_wal_create": "false", 2024-04-01T19:24:38.148 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_block_wal_path": "", 2024-04-01T19:24:38.148 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_block_wal_size": "100663296", 2024-04-01T19:24:38.148 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_bluefs": "true", 2024-04-01T19:24:38.148 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-01T19:24:38.148 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-01T19:24:38.148 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-01T19:24:38.148 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-01T19:24:38.148 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-01T19:24:38.149 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-01T19:24:38.149 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-01T19:24:38.149 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-01T19:24:38.149 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_autotune": "true", 2024-04-01T19:24:38.149 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-01T19:24:38.149 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-01T19:24:38.149 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-01T19:24:38.149 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-01T19:24:38.149 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_size": "0", 2024-04-01T19:24:38.149 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-01T19:24:38.149 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-01T19:24:38.149 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-01T19:24:38.149 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-01T19:24:38.149 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_type": "2q", 2024-04-01T19:24:38.150 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-01T19:24:38.150 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_clone_cow": "true", 2024-04-01T19:24:38.150 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-01T19:24:38.150 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-01T19:24:38.150 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-01T19:24:38.150 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-01T19:24:38.150 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-01T19:24:38.150 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-01T19:24:38.150 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-01T19:24:38.150 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_compression_mode": "none", 2024-04-01T19:24:38.150 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-01T19:24:38.150 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_csum_type": "crc32c", 2024-04-01T19:24:38.150 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-04-01T19:24:38.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-01T19:24:38.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_debug_freelist": "false", 2024-04-01T19:24:38.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-01T19:24:38.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-01T19:24:38.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-01T19:24:38.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-01T19:24:38.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-01T19:24:38.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-01T19:24:38.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-01T19:24:38.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-01T19:24:38.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-01T19:24:38.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-01T19:24:38.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-01T19:24:38.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-01T19:24:38.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-01T19:24:38.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_debug_small_allocations": "0", 2024-04-01T19:24:38.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-01T19:24:38.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_default_buffered_read": "true", 2024-04-01T19:24:38.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_default_buffered_write": "false", 2024-04-01T19:24:38.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-01T19:24:38.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-01T19:24:38.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-01T19:24:38.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_elastic_shared_blobs": "true", 2024-04-01T19:24:38.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-01T19:24:38.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-01T19:24:38.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-01T19:24:38.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-01T19:24:38.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-01T19:24:38.153 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fail_eio": "false", 2024-04-01T19:24:38.153 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-01T19:24:38.153 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-01T19:24:38.153 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-01T19:24:38.153 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-01T19:24:38.153 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-01T19:24:38.153 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-01T19:24:38.153 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_on_mount": "false", 2024-04-01T19:24:38.153 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-01T19:24:38.153 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_on_umount": "false", 2024-04-01T19:24:38.153 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-01T19:24:38.153 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-01T19:24:38.153 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-01T19:24:38.153 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-01T19:24:38.154 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-01T19:24:38.154 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-01T19:24:38.154 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-01T19:24:38.154 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-01T19:24:38.154 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_ignore_data_csum": "false", 2024-04-01T19:24:38.154 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-01T19:24:38.154 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-01T19:24:38.154 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-01T19:24:38.154 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-01T19:24:38.154 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_log_op_age": "5.000000", 2024-04-01T19:24:38.154 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_max_alloc_size": "0", 2024-04-01T19:24:38.154 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_max_blob_size": "0", 2024-04-01T19:24:38.154 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-01T19:24:38.154 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-01T19:24:38.155 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-01T19:24:38.155 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_max_deferred_txc": "32", 2024-04-01T19:24:38.155 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_min_alloc_size": "0", 2024-04-01T19:24:38.155 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-01T19:24:38.155 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-01T19:24:38.155 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_nid_prealloc": "1024", 2024-04-01T19:24:38.155 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-01T19:24:38.155 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-01T19:24:38.155 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-01T19:24:38.155 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-01T19:24:38.155 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_retry_disk_reads": "3", 2024-04-01T19:24:38.155 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_rocksdb_cf": "true", 2024-04-01T19:24:38.155 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-01T19:24:38.155 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-01T19:24:38.156 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-01T19:24:38.156 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-01T19:24:38.156 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-01T19:24:38.156 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-01T19:24:38.156 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_spdk_mem": "512", 2024-04-01T19:24:38.156 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-01T19:24:38.156 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-01T19:24:38.156 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-01T19:24:38.156 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-01T19:24:38.156 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-01T19:24:38.156 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-01T19:24:38.156 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-01T19:24:38.156 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_tracing": "false", 2024-04-01T19:24:38.156 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-01T19:24:38.157 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-01T19:24:38.157 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-01T19:24:38.157 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-01T19:24:38.157 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-01T19:24:38.157 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-01T19:24:38.157 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-01T19:24:38.157 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-01T19:24:38.157 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-01T19:24:38.157 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_zero_block_detection": "false", 2024-04-01T19:24:38.157 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-01T19:24:38.157 INFO:teuthology.orchestra.run.smithi022.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-01T19:24:38.157 INFO:teuthology.orchestra.run.smithi022.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-01T19:24:38.157 INFO:teuthology.orchestra.run.smithi022.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-01T19:24:38.157 INFO:teuthology.orchestra.run.smithi022.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-01T19:24:38.157 INFO:teuthology.orchestra.run.smithi022.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-01T19:24:38.158 INFO:teuthology.orchestra.run.smithi022.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-01T19:24:38.158 INFO:teuthology.orchestra.run.smithi022.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-01T19:24:38.158 INFO:teuthology.orchestra.run.smithi022.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-01T19:24:38.158 INFO:teuthology.orchestra.run.smithi022.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-01T19:24:38.158 INFO:teuthology.orchestra.run.smithi022.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-01T19:24:38.158 INFO:teuthology.orchestra.run.smithi022.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-01T19:24:38.158 INFO:teuthology.orchestra.run.smithi022.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-01T19:24:38.158 INFO:teuthology.orchestra.run.smithi022.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-01T19:24:38.158 INFO:teuthology.orchestra.run.smithi022.stdout: "cephx_cluster_require_signatures": "false", 2024-04-01T19:24:38.158 INFO:teuthology.orchestra.run.smithi022.stdout: "cephx_cluster_require_version": "2", 2024-04-01T19:24:38.158 INFO:teuthology.orchestra.run.smithi022.stdout: "cephx_require_signatures": "false", 2024-04-01T19:24:38.158 INFO:teuthology.orchestra.run.smithi022.stdout: "cephx_require_version": "2", 2024-04-01T19:24:38.158 INFO:teuthology.orchestra.run.smithi022.stdout: "cephx_service_require_signatures": "false", 2024-04-01T19:24:38.159 INFO:teuthology.orchestra.run.smithi022.stdout: "cephx_service_require_version": "2", 2024-04-01T19:24:38.159 INFO:teuthology.orchestra.run.smithi022.stdout: "cephx_sign_messages": "true", 2024-04-01T19:24:38.159 INFO:teuthology.orchestra.run.smithi022.stdout: "chdir": "", 2024-04-01T19:24:38.159 INFO:teuthology.orchestra.run.smithi022.stdout: "client_acl_type": "", 2024-04-01T19:24:38.159 INFO:teuthology.orchestra.run.smithi022.stdout: "client_asio_thread_count": "2", 2024-04-01T19:24:38.159 INFO:teuthology.orchestra.run.smithi022.stdout: "client_cache_mid": "0.750000", 2024-04-01T19:24:38.159 INFO:teuthology.orchestra.run.smithi022.stdout: "client_cache_size": "16384", 2024-04-01T19:24:38.159 INFO:teuthology.orchestra.run.smithi022.stdout: "client_caps_release_delay": "5", 2024-04-01T19:24:38.159 INFO:teuthology.orchestra.run.smithi022.stdout: "client_check_pool_perm": "true", 2024-04-01T19:24:38.159 INFO:teuthology.orchestra.run.smithi022.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-01T19:24:38.159 INFO:teuthology.orchestra.run.smithi022.stdout: "client_debug_force_sync_read": "false", 2024-04-01T19:24:38.159 INFO:teuthology.orchestra.run.smithi022.stdout: "client_debug_getattr_caps": "false", 2024-04-01T19:24:38.159 INFO:teuthology.orchestra.run.smithi022.stdout: "client_debug_inject_tick_delay": "0", 2024-04-01T19:24:38.159 INFO:teuthology.orchestra.run.smithi022.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-01T19:24:38.160 INFO:teuthology.orchestra.run.smithi022.stdout: "client_die_on_failed_remount": "false", 2024-04-01T19:24:38.160 INFO:teuthology.orchestra.run.smithi022.stdout: "client_dirsize_rbytes": "true", 2024-04-01T19:24:38.160 INFO:teuthology.orchestra.run.smithi022.stdout: "client_force_lazyio": "false", 2024-04-01T19:24:38.160 INFO:teuthology.orchestra.run.smithi022.stdout: "client_fs": "", 2024-04-01T19:24:38.160 INFO:teuthology.orchestra.run.smithi022.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-01T19:24:38.160 INFO:teuthology.orchestra.run.smithi022.stdout: "client_inject_release_failure": "false", 2024-04-01T19:24:38.160 INFO:teuthology.orchestra.run.smithi022.stdout: "client_max_inline_size": "4096", 2024-04-01T19:24:38.160 INFO:teuthology.orchestra.run.smithi022.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-01T19:24:38.160 INFO:teuthology.orchestra.run.smithi022.stdout: "client_mds_namespace": "", 2024-04-01T19:24:38.160 INFO:teuthology.orchestra.run.smithi022.stdout: "client_metadata": "", 2024-04-01T19:24:38.160 INFO:teuthology.orchestra.run.smithi022.stdout: "client_mount_gid": "-1", 2024-04-01T19:24:38.160 INFO:teuthology.orchestra.run.smithi022.stdout: "client_mount_timeout": "300", 2024-04-01T19:24:38.160 INFO:teuthology.orchestra.run.smithi022.stdout: "client_mount_uid": "-1", 2024-04-01T19:24:38.160 INFO:teuthology.orchestra.run.smithi022.stdout: "client_mountpoint": "/", 2024-04-01T19:24:38.161 INFO:teuthology.orchestra.run.smithi022.stdout: "client_notify_timeout": "10", 2024-04-01T19:24:38.161 INFO:teuthology.orchestra.run.smithi022.stdout: "client_oc": "true", 2024-04-01T19:24:38.161 INFO:teuthology.orchestra.run.smithi022.stdout: "client_oc_max_dirty": "104857600", 2024-04-01T19:24:38.161 INFO:teuthology.orchestra.run.smithi022.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-01T19:24:38.161 INFO:teuthology.orchestra.run.smithi022.stdout: "client_oc_max_objects": "1000", 2024-04-01T19:24:38.161 INFO:teuthology.orchestra.run.smithi022.stdout: "client_oc_size": "209715200", 2024-04-01T19:24:38.161 INFO:teuthology.orchestra.run.smithi022.stdout: "client_oc_target_dirty": "8388608", 2024-04-01T19:24:38.161 INFO:teuthology.orchestra.run.smithi022.stdout: "client_permissions": "true", 2024-04-01T19:24:38.161 INFO:teuthology.orchestra.run.smithi022.stdout: "client_quota": "true", 2024-04-01T19:24:38.161 INFO:teuthology.orchestra.run.smithi022.stdout: "client_quota_df": "true", 2024-04-01T19:24:38.161 INFO:teuthology.orchestra.run.smithi022.stdout: "client_readahead_max_bytes": "0", 2024-04-01T19:24:38.161 INFO:teuthology.orchestra.run.smithi022.stdout: "client_readahead_max_periods": "4", 2024-04-01T19:24:38.161 INFO:teuthology.orchestra.run.smithi022.stdout: "client_readahead_min": "131072", 2024-04-01T19:24:38.161 INFO:teuthology.orchestra.run.smithi022.stdout: "client_reconnect_stale": "false", 2024-04-01T19:24:38.161 INFO:teuthology.orchestra.run.smithi022.stdout: "client_shutdown_timeout": "30", 2024-04-01T19:24:38.162 INFO:teuthology.orchestra.run.smithi022.stdout: "client_snapdir": ".snap", 2024-04-01T19:24:38.162 INFO:teuthology.orchestra.run.smithi022.stdout: "client_tick_interval": "1", 2024-04-01T19:24:38.162 INFO:teuthology.orchestra.run.smithi022.stdout: "client_trace": "", 2024-04-01T19:24:38.162 INFO:teuthology.orchestra.run.smithi022.stdout: "client_try_dentry_invalidate": "false", 2024-04-01T19:24:38.162 INFO:teuthology.orchestra.run.smithi022.stdout: "client_use_faked_inos": "false", 2024-04-01T19:24:38.162 INFO:teuthology.orchestra.run.smithi022.stdout: "client_use_random_mds": "false", 2024-04-01T19:24:38.162 INFO:teuthology.orchestra.run.smithi022.stdout: "clog_to_graylog": "false", 2024-04-01T19:24:38.162 INFO:teuthology.orchestra.run.smithi022.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-01T19:24:38.162 INFO:teuthology.orchestra.run.smithi022.stdout: "clog_to_graylog_port": "12201", 2024-04-01T19:24:38.162 INFO:teuthology.orchestra.run.smithi022.stdout: "clog_to_monitors": "default=true", 2024-04-01T19:24:38.162 INFO:teuthology.orchestra.run.smithi022.stdout: "clog_to_syslog": "false", 2024-04-01T19:24:38.162 INFO:teuthology.orchestra.run.smithi022.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-01T19:24:38.162 INFO:teuthology.orchestra.run.smithi022.stdout: "clog_to_syslog_level": "info", 2024-04-01T19:24:38.162 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "-", 2024-04-01T19:24:38.163 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_network": "", 2024-04-01T19:24:38.163 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_network_interface": "", 2024-04-01T19:24:38.163 INFO:teuthology.orchestra.run.smithi022.stdout: "compressor_zlib_isal": "false", 2024-04-01T19:24:38.163 INFO:teuthology.orchestra.run.smithi022.stdout: "compressor_zlib_level": "5", 2024-04-01T19:24:38.163 INFO:teuthology.orchestra.run.smithi022.stdout: "compressor_zlib_winsize": "-15", 2024-04-01T19:24:38.163 INFO:teuthology.orchestra.run.smithi022.stdout: "compressor_zstd_level": "1", 2024-04-01T19:24:38.163 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:0695e7c5d663dadca19983359d9ec9c0b57bc12893996bd1fbc1456ad5ed6600", 2024-04-01T19:24:38.163 INFO:teuthology.orchestra.run.smithi022.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-01T19:24:38.163 INFO:teuthology.orchestra.run.smithi022.stdout: "crimson_alien_op_num_threads": "6", 2024-04-01T19:24:38.163 INFO:teuthology.orchestra.run.smithi022.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-01T19:24:38.163 INFO:teuthology.orchestra.run.smithi022.stdout: "crimson_osd_obc_lru_size": "512", 2024-04-01T19:24:38.163 INFO:teuthology.orchestra.run.smithi022.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-01T19:24:38.163 INFO:teuthology.orchestra.run.smithi022.stdout: "crimson_seastar_cpu_cores": "", 2024-04-01T19:24:38.163 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_location": "", 2024-04-01T19:24:38.164 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_location_hook": "", 2024-04-01T19:24:38.164 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_location_hook_timeout": "10", 2024-04-01T19:24:38.164 INFO:teuthology.orchestra.run.smithi022.stdout: "daemonize": "false", 2024-04-01T19:24:38.164 INFO:teuthology.orchestra.run.smithi022.stdout: "daos_pool": "tank", 2024-04-01T19:24:38.164 INFO:teuthology.orchestra.run.smithi022.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-01T19:24:38.164 INFO:teuthology.orchestra.run.smithi022.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-01T19:24:38.164 INFO:teuthology.orchestra.run.smithi022.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-01T19:24:38.164 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_alienstore": "0/5", 2024-04-01T19:24:38.164 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_allow_any_pool_priority": "false", 2024-04-01T19:24:38.164 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_asok": "1/5", 2024-04-01T19:24:38.164 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_asok_assert_abort": "false", 2024-04-01T19:24:38.164 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_asserts_on_shutdown": "true", 2024-04-01T19:24:38.164 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_auth": "1/5", 2024-04-01T19:24:38.164 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_bdev": "1/3", 2024-04-01T19:24:38.164 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_bluefs": "1/5", 2024-04-01T19:24:38.164 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_bluestore": "1/5", 2024-04-01T19:24:38.165 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_buffer": "0/1", 2024-04-01T19:24:38.165 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_ceph_dedup": "0/5", 2024-04-01T19:24:38.165 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_ceph_exporter": "1/5", 2024-04-01T19:24:38.165 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_cephfs_mirror": "0/5", 2024-04-01T19:24:38.165 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_cephsqlite": "0/5", 2024-04-01T19:24:38.165 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_client": "0/5", 2024-04-01T19:24:38.165 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_compressor": "1/5", 2024-04-01T19:24:38.165 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_context": "0/1", 2024-04-01T19:24:38.165 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_crimson_interrupt": "0/5", 2024-04-01T19:24:38.165 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_crush": "1/1", 2024-04-01T19:24:38.165 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_crypto": "1/5", 2024-04-01T19:24:38.165 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_cyanstore": "0/5", 2024-04-01T19:24:38.165 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_deliberately_leak_memory": "false", 2024-04-01T19:24:38.165 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_disable_randomized_ping": "false", 2024-04-01T19:24:38.165 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_dpdk": "1/5", 2024-04-01T19:24:38.165 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_eventtrace": "1/5", 2024-04-01T19:24:38.166 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_filer": "0/1", 2024-04-01T19:24:38.166 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_filestore": "1/3", 2024-04-01T19:24:38.166 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_finisher": "1/1", 2024-04-01T19:24:38.166 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_fuse": "1/5", 2024-04-01T19:24:38.166 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_heartbeat_testing_span": "0", 2024-04-01T19:24:38.166 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_heartbeatmap": "1/5", 2024-04-01T19:24:38.166 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-01T19:24:38.166 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_javaclient": "1/5", 2024-04-01T19:24:38.166 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_journal": "1/3", 2024-04-01T19:24:38.166 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_journaler": "0/5", 2024-04-01T19:24:38.166 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_kstore": "1/5", 2024-04-01T19:24:38.166 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_lockdep": "0/1", 2024-04-01T19:24:38.166 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_mclock": "1/5", 2024-04-01T19:24:38.166 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_mds": "1/5", 2024-04-01T19:24:38.167 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_mds_balancer": "1/5", 2024-04-01T19:24:38.167 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_mds_locker": "1/5", 2024-04-01T19:24:38.167 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_mds_log": "1/5", 2024-04-01T19:24:38.167 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_mds_log_expire": "1/5", 2024-04-01T19:24:38.167 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_mds_migrator": "1/5", 2024-04-01T19:24:38.167 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_mds_quiesce": "3/5", 2024-04-01T19:24:38.167 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_memstore": "1/5", 2024-04-01T19:24:38.167 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_mgr": "2/5", 2024-04-01T19:24:38.167 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_mgrc": "1/5", 2024-04-01T19:24:38.167 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_mon": "20/20", 2024-04-01T19:24:38.167 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_monc": "0/10", 2024-04-01T19:24:38.167 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_ms": "1/1", 2024-04-01T19:24:38.167 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_none": "0/5", 2024-04-01T19:24:38.167 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_objclass": "0/5", 2024-04-01T19:24:38.167 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_objectcacher": "0/5", 2024-04-01T19:24:38.168 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_objecter": "0/1", 2024-04-01T19:24:38.168 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_optracker": "0/5", 2024-04-01T19:24:38.168 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_osd": "1/5", 2024-04-01T19:24:38.168 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_paxos": "20/20", 2024-04-01T19:24:38.168 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_perfcounter": "1/5", 2024-04-01T19:24:38.168 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_prioritycache": "1/5", 2024-04-01T19:24:38.168 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_rados": "0/5", 2024-04-01T19:24:38.168 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_rbd": "0/5", 2024-04-01T19:24:38.168 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_rbd_mirror": "0/5", 2024-04-01T19:24:38.168 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_rbd_pwl": "0/5", 2024-04-01T19:24:38.168 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_rbd_replay": "0/5", 2024-04-01T19:24:38.168 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_refs": "0/0", 2024-04-01T19:24:38.168 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_reserver": "1/1", 2024-04-01T19:24:38.168 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_rgw": "1/5", 2024-04-01T19:24:38.169 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_rgw_access": "1/5", 2024-04-01T19:24:38.169 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_rgw_datacache": "1/5", 2024-04-01T19:24:38.169 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_rgw_dbstore": "1/5", 2024-04-01T19:24:38.169 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_rgw_flight": "1/5", 2024-04-01T19:24:38.169 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_rgw_lifecycle": "1/5", 2024-04-01T19:24:38.169 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_rgw_notification": "1/5", 2024-04-01T19:24:38.169 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_rgw_sync": "1/5", 2024-04-01T19:24:38.169 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_rocksdb": "4/5", 2024-04-01T19:24:38.169 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_seastore": "0/5", 2024-04-01T19:24:38.169 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_seastore_backref": "0/5", 2024-04-01T19:24:38.169 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_seastore_cache": "0/5", 2024-04-01T19:24:38.169 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_seastore_cleaner": "0/5", 2024-04-01T19:24:38.169 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_seastore_device": "0/5", 2024-04-01T19:24:38.169 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_seastore_epm": "0/5", 2024-04-01T19:24:38.169 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-01T19:24:38.170 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_seastore_journal": "0/5", 2024-04-01T19:24:38.170 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_seastore_lba": "0/5", 2024-04-01T19:24:38.170 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_seastore_odata": "0/5", 2024-04-01T19:24:38.170 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_seastore_omap": "0/5", 2024-04-01T19:24:38.170 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_seastore_onode": "0/5", 2024-04-01T19:24:38.170 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_seastore_t": "0/5", 2024-04-01T19:24:38.170 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_seastore_tm": "0/5", 2024-04-01T19:24:38.170 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_striper": "0/1", 2024-04-01T19:24:38.170 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_test": "0/5", 2024-04-01T19:24:38.170 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_throttle": "1/1", 2024-04-01T19:24:38.170 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_timer": "0/1", 2024-04-01T19:24:38.170 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_tp": "0/5", 2024-04-01T19:24:38.170 INFO:teuthology.orchestra.run.smithi022.stdout: "debug_trace": "1/5", 2024-04-01T19:24:38.171 INFO:teuthology.orchestra.run.smithi022.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-01T19:24:38.171 INFO:teuthology.orchestra.run.smithi022.stdout: "device_failure_prediction_mode": "none", 2024-04-01T19:24:38.171 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-01T19:24:38.171 INFO:teuthology.orchestra.run.smithi022.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-04-01T19:24:38.171 INFO:teuthology.orchestra.run.smithi022.stdout: "err_to_graylog": "false", 2024-04-01T19:24:38.171 INFO:teuthology.orchestra.run.smithi022.stdout: "err_to_journald": "false", 2024-04-01T19:24:38.171 INFO:teuthology.orchestra.run.smithi022.stdout: "err_to_stderr": "true", 2024-04-01T19:24:38.171 INFO:teuthology.orchestra.run.smithi022.stdout: "err_to_syslog": "false", 2024-04-01T19:24:38.171 INFO:teuthology.orchestra.run.smithi022.stdout: "event_tracing": "false", 2024-04-01T19:24:38.171 INFO:teuthology.orchestra.run.smithi022.stdout: "exporter_addr": "0.0.0.0", 2024-04-01T19:24:38.171 INFO:teuthology.orchestra.run.smithi022.stdout: "exporter_http_port": "9926", 2024-04-01T19:24:38.171 INFO:teuthology.orchestra.run.smithi022.stdout: "exporter_prio_limit": "5", 2024-04-01T19:24:38.171 INFO:teuthology.orchestra.run.smithi022.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-01T19:24:38.172 INFO:teuthology.orchestra.run.smithi022.stdout: "exporter_sort_metrics": "true", 2024-04-01T19:24:38.172 INFO:teuthology.orchestra.run.smithi022.stdout: "exporter_stats_period": "5", 2024-04-01T19:24:38.172 INFO:teuthology.orchestra.run.smithi022.stdout: "fake_statfs_for_testing": "0", 2024-04-01T19:24:38.172 INFO:teuthology.orchestra.run.smithi022.stdout: "fatal_signal_handlers": "true", 2024-04-01T19:24:38.172 INFO:teuthology.orchestra.run.smithi022.stdout: "filer_max_purge_ops": "10", 2024-04-01T19:24:38.172 INFO:teuthology.orchestra.run.smithi022.stdout: "filer_max_truncate_ops": "128", 2024-04-01T19:24:38.172 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_apply_finisher_threads": "1", 2024-04-01T19:24:38.172 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_blackhole": "false", 2024-04-01T19:24:38.172 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_btrfs_clone_range": "true", 2024-04-01T19:24:38.172 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_btrfs_snap": "true", 2024-04-01T19:24:38.172 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_caller_concurrency": "10", 2024-04-01T19:24:38.172 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_collect_device_partition_information": "true", 2024-04-01T19:24:38.172 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_commit_timeout": "600.000000", 2024-04-01T19:24:38.172 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_debug_inject_read_err": "false", 2024-04-01T19:24:38.173 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_debug_omap_check": "false", 2024-04-01T19:24:38.173 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_debug_verify_split": "false", 2024-04-01T19:24:38.173 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_dump_file": "", 2024-04-01T19:24:38.173 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-01T19:24:38.173 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-01T19:24:38.173 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_fadvise": "true", 2024-04-01T19:24:38.173 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_fail_eio": "true", 2024-04-01T19:24:38.173 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_fd_cache_shards": "16", 2024-04-01T19:24:38.173 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_fd_cache_size": "128", 2024-04-01T19:24:38.173 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_fiemap": "false", 2024-04-01T19:24:38.173 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_fiemap_threshold": "4096", 2024-04-01T19:24:38.173 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-01T19:24:38.173 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-01T19:24:38.173 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_inject_stall": "0", 2024-04-01T19:24:38.174 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_journal_parallel": "false", 2024-04-01T19:24:38.174 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_journal_trailing": "false", 2024-04-01T19:24:38.174 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_journal_writeahead": "false", 2024-04-01T19:24:38.174 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_kill_at": "0", 2024-04-01T19:24:38.174 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-01T19:24:38.174 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-01T19:24:38.174 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-01T19:24:38.174 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-01T19:24:38.174 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-01T19:24:38.174 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_max_inline_xattrs": "0", 2024-04-01T19:24:38.175 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-01T19:24:38.175 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-01T19:24:38.175 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-01T19:24:38.175 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-01T19:24:38.175 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_max_xattr_value_size": "0", 2024-04-01T19:24:38.175 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-01T19:24:38.175 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-01T19:24:38.175 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-01T19:24:38.175 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_merge_threshold": "-10", 2024-04-01T19:24:38.175 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-01T19:24:38.175 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_odsync_write": "false", 2024-04-01T19:24:38.176 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_omap_backend": "rocksdb", 2024-04-01T19:24:38.176 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_omap_backend_path": "", 2024-04-01T19:24:38.176 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-01T19:24:38.176 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-01T19:24:38.176 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-01T19:24:38.176 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_op_thread_timeout": "60", 2024-04-01T19:24:38.176 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_op_threads": "2", 2024-04-01T19:24:38.176 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_punch_hole": "false", 2024-04-01T19:24:38.176 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-01T19:24:38.176 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-01T19:24:38.176 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-01T19:24:38.176 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-01T19:24:38.176 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-01T19:24:38.177 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-01T19:24:38.177 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-01T19:24:38.177 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-01T19:24:38.177 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-01T19:24:38.177 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_queue_max_ops": "50", 2024-04-01T19:24:38.177 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-01T19:24:38.177 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_seek_data_hole": "false", 2024-04-01T19:24:38.177 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_sloppy_crc": "false", 2024-04-01T19:24:38.177 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-01T19:24:38.177 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_splice": "false", 2024-04-01T19:24:38.177 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_split_multiple": "2", 2024-04-01T19:24:38.177 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_split_rand_factor": "20", 2024-04-01T19:24:38.177 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_update_to": "1000", 2024-04-01T19:24:38.177 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-01T19:24:38.178 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-01T19:24:38.178 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-01T19:24:38.178 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-01T19:24:38.178 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-01T19:24:38.178 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-01T19:24:38.178 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_wbthrottle_enable": "true", 2024-04-01T19:24:38.178 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-01T19:24:38.178 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-01T19:24:38.178 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-01T19:24:38.178 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-01T19:24:38.178 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-01T19:24:38.178 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-01T19:24:38.178 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_xfs_extsize": "false", 2024-04-01T19:24:38.178 INFO:teuthology.orchestra.run.smithi022.stdout: "filestore_zfs_snap": "false", 2024-04-01T19:24:38.179 INFO:teuthology.orchestra.run.smithi022.stdout: "fio_dir": "/tmp/fio", 2024-04-01T19:24:38.179 INFO:teuthology.orchestra.run.smithi022.stdout: "fsid": "09f6b846-f05c-11ee-b647-cb9ed24678a4", 2024-04-01T19:24:38.179 INFO:teuthology.orchestra.run.smithi022.stdout: "fuse_allow_other": "true", 2024-04-01T19:24:38.179 INFO:teuthology.orchestra.run.smithi022.stdout: "fuse_atomic_o_trunc": "true", 2024-04-01T19:24:38.179 INFO:teuthology.orchestra.run.smithi022.stdout: "fuse_big_writes": "true", 2024-04-01T19:24:38.179 INFO:teuthology.orchestra.run.smithi022.stdout: "fuse_debug": "false", 2024-04-01T19:24:38.179 INFO:teuthology.orchestra.run.smithi022.stdout: "fuse_default_permissions": "false", 2024-04-01T19:24:38.179 INFO:teuthology.orchestra.run.smithi022.stdout: "fuse_disable_pagecache": "false", 2024-04-01T19:24:38.179 INFO:teuthology.orchestra.run.smithi022.stdout: "fuse_max_write": "0", 2024-04-01T19:24:38.179 INFO:teuthology.orchestra.run.smithi022.stdout: "fuse_multithreaded": "true", 2024-04-01T19:24:38.179 INFO:teuthology.orchestra.run.smithi022.stdout: "fuse_require_active_mds": "true", 2024-04-01T19:24:38.179 INFO:teuthology.orchestra.run.smithi022.stdout: "fuse_set_user_groups": "true", 2024-04-01T19:24:38.179 INFO:teuthology.orchestra.run.smithi022.stdout: "fuse_splice_move": "true", 2024-04-01T19:24:38.179 INFO:teuthology.orchestra.run.smithi022.stdout: "fuse_splice_read": "true", 2024-04-01T19:24:38.180 INFO:teuthology.orchestra.run.smithi022.stdout: "fuse_splice_write": "true", 2024-04-01T19:24:38.180 INFO:teuthology.orchestra.run.smithi022.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-01T19:24:38.180 INFO:teuthology.orchestra.run.smithi022.stdout: "fuse_use_invalidate_cb": "true", 2024-04-01T19:24:38.180 INFO:teuthology.orchestra.run.smithi022.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-01T19:24:38.180 INFO:teuthology.orchestra.run.smithi022.stdout: "gss_target_name": "ceph", 2024-04-01T19:24:38.180 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_file": "", 2024-04-01T19:24:38.180 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_inject_failure": "0", 2024-04-01T19:24:38.180 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_interval": "5", 2024-04-01T19:24:38.180 INFO:teuthology.orchestra.run.smithi022.stdout: "host": "smithi022", 2024-04-01T19:24:38.180 INFO:teuthology.orchestra.run.smithi022.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-01T19:24:38.180 INFO:teuthology.orchestra.run.smithi022.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-01T19:24:38.181 INFO:teuthology.orchestra.run.smithi022.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-01T19:24:38.181 INFO:teuthology.orchestra.run.smithi022.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-01T19:24:38.181 INFO:teuthology.orchestra.run.smithi022.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-01T19:24:38.181 INFO:teuthology.orchestra.run.smithi022.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-01T19:24:38.181 INFO:teuthology.orchestra.run.smithi022.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-01T19:24:38.181 INFO:teuthology.orchestra.run.smithi022.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-01T19:24:38.181 INFO:teuthology.orchestra.run.smithi022.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-01T19:24:38.181 INFO:teuthology.orchestra.run.smithi022.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-01T19:24:38.181 INFO:teuthology.orchestra.run.smithi022.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-01T19:24:38.181 INFO:teuthology.orchestra.run.smithi022.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-01T19:24:38.181 INFO:teuthology.orchestra.run.smithi022.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-01T19:24:38.182 INFO:teuthology.orchestra.run.smithi022.stdout: "inject_early_sigterm": "false", 2024-04-01T19:24:38.182 INFO:teuthology.orchestra.run.smithi022.stdout: "jaeger_agent_port": "6799", 2024-04-01T19:24:38.182 INFO:teuthology.orchestra.run.smithi022.stdout: "jaeger_tracing_enable": "false", 2024-04-01T19:24:38.182 INFO:teuthology.orchestra.run.smithi022.stdout: "journal_aio": "true", 2024-04-01T19:24:38.182 INFO:teuthology.orchestra.run.smithi022.stdout: "journal_align_min_size": "65536", 2024-04-01T19:24:38.182 INFO:teuthology.orchestra.run.smithi022.stdout: "journal_block_align": "true", 2024-04-01T19:24:38.182 INFO:teuthology.orchestra.run.smithi022.stdout: "journal_block_size": "4096", 2024-04-01T19:24:38.182 INFO:teuthology.orchestra.run.smithi022.stdout: "journal_dio": "true", 2024-04-01T19:24:38.182 INFO:teuthology.orchestra.run.smithi022.stdout: "journal_discard": "false", 2024-04-01T19:24:38.182 INFO:teuthology.orchestra.run.smithi022.stdout: "journal_force_aio": "false", 2024-04-01T19:24:38.182 INFO:teuthology.orchestra.run.smithi022.stdout: "journal_ignore_corruption": "false", 2024-04-01T19:24:38.182 INFO:teuthology.orchestra.run.smithi022.stdout: "journal_max_write_bytes": "10485760", 2024-04-01T19:24:38.182 INFO:teuthology.orchestra.run.smithi022.stdout: "journal_max_write_entries": "100", 2024-04-01T19:24:38.182 INFO:teuthology.orchestra.run.smithi022.stdout: "journal_replay_from": "0", 2024-04-01T19:24:38.183 INFO:teuthology.orchestra.run.smithi022.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-01T19:24:38.183 INFO:teuthology.orchestra.run.smithi022.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-01T19:24:38.183 INFO:teuthology.orchestra.run.smithi022.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-01T19:24:38.183 INFO:teuthology.orchestra.run.smithi022.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-01T19:24:38.183 INFO:teuthology.orchestra.run.smithi022.stdout: "journal_write_header_frequency": "0", 2024-04-01T19:24:38.183 INFO:teuthology.orchestra.run.smithi022.stdout: "journal_zero_on_create": "false", 2024-04-01T19:24:38.183 INFO:teuthology.orchestra.run.smithi022.stdout: "journaler_prefetch_periods": "10", 2024-04-01T19:24:38.183 INFO:teuthology.orchestra.run.smithi022.stdout: "journaler_prezero_periods": "5", 2024-04-01T19:24:38.183 INFO:teuthology.orchestra.run.smithi022.stdout: "journaler_write_head_interval": "15", 2024-04-01T19:24:38.183 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "", 2024-04-01T19:24:38.183 INFO:teuthology.orchestra.run.smithi022.stdout: "keyfile": "", 2024-04-01T19:24:38.183 INFO:teuthology.orchestra.run.smithi022.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-01T19:24:38.183 INFO:teuthology.orchestra.run.smithi022.stdout: "kstore_backend": "rocksdb", 2024-04-01T19:24:38.184 INFO:teuthology.orchestra.run.smithi022.stdout: "kstore_default_stripe_size": "65536", 2024-04-01T19:24:38.184 INFO:teuthology.orchestra.run.smithi022.stdout: "kstore_fsck_on_mount": "false", 2024-04-01T19:24:38.184 INFO:teuthology.orchestra.run.smithi022.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-01T19:24:38.184 INFO:teuthology.orchestra.run.smithi022.stdout: "kstore_max_bytes": "67108864", 2024-04-01T19:24:38.184 INFO:teuthology.orchestra.run.smithi022.stdout: "kstore_max_ops": "512", 2024-04-01T19:24:38.184 INFO:teuthology.orchestra.run.smithi022.stdout: "kstore_nid_prealloc": "1024", 2024-04-01T19:24:38.184 INFO:teuthology.orchestra.run.smithi022.stdout: "kstore_onode_map_size": "1024", 2024-04-01T19:24:38.184 INFO:teuthology.orchestra.run.smithi022.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-01T19:24:38.184 INFO:teuthology.orchestra.run.smithi022.stdout: "kstore_sync_submit_transaction": "false", 2024-04-01T19:24:38.184 INFO:teuthology.orchestra.run.smithi022.stdout: "kstore_sync_transaction": "false", 2024-04-01T19:24:38.184 INFO:teuthology.orchestra.run.smithi022.stdout: "librados_thread_count": "2", 2024-04-01T19:24:38.184 INFO:teuthology.orchestra.run.smithi022.stdout: "lockdep": "false", 2024-04-01T19:24:38.184 INFO:teuthology.orchestra.run.smithi022.stdout: "lockdep_force_backtrace": "false", 2024-04-01T19:24:38.184 INFO:teuthology.orchestra.run.smithi022.stdout: "log_coarse_timestamps": "true", 2024-04-01T19:24:38.185 INFO:teuthology.orchestra.run.smithi022.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-01T19:24:38.185 INFO:teuthology.orchestra.run.smithi022.stdout: "log_flush_on_exit": "false", 2024-04-01T19:24:38.185 INFO:teuthology.orchestra.run.smithi022.stdout: "log_graylog_host": "127.0.0.1", 2024-04-01T19:24:38.185 INFO:teuthology.orchestra.run.smithi022.stdout: "log_graylog_port": "12201", 2024-04-01T19:24:38.185 INFO:teuthology.orchestra.run.smithi022.stdout: "log_max_new": "1000", 2024-04-01T19:24:38.185 INFO:teuthology.orchestra.run.smithi022.stdout: "log_max_recent": "10000", 2024-04-01T19:24:38.185 INFO:teuthology.orchestra.run.smithi022.stdout: "log_stderr_prefix": "", 2024-04-01T19:24:38.185 INFO:teuthology.orchestra.run.smithi022.stdout: "log_stop_at_utilization": "0.970000", 2024-04-01T19:24:38.185 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": "true", 2024-04-01T19:24:38.185 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_graylog": "false", 2024-04-01T19:24:38.185 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_journald": "false", 2024-04-01T19:24:38.186 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_stderr": "false", 2024-04-01T19:24:38.186 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_syslog": "false", 2024-04-01T19:24:38.186 INFO:teuthology.orchestra.run.smithi022.stdout: "max_rotating_auth_attempts": "10", 2024-04-01T19:24:38.186 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-01T19:24:38.186 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_action_on_write_error": "1", 2024-04-01T19:24:38.186 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_alternate_name_max": "8192", 2024-04-01T19:24:38.186 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_asio_thread_count": "2", 2024-04-01T19:24:38.186 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_export_pin": "true", 2024-04-01T19:24:38.186 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_fragment_dirs": "true", 2024-04-01T19:24:38.186 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-01T19:24:38.186 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_fragment_interval": "5", 2024-04-01T19:24:38.186 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-01T19:24:38.186 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-01T19:24:38.186 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_interval": "10", 2024-04-01T19:24:38.187 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_max": "-1", 2024-04-01T19:24:38.187 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_max_until": "-1", 2024-04-01T19:24:38.187 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_merge_size": "50", 2024-04-01T19:24:38.187 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_midchunk": "0.300000", 2024-04-01T19:24:38.187 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-01T19:24:38.187 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_min_start": "0.200000", 2024-04-01T19:24:38.187 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_minchunk": "0.001000", 2024-04-01T19:24:38.187 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_mode": "0", 2024-04-01T19:24:38.187 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_need_max": "1.200000", 2024-04-01T19:24:38.187 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_need_min": "0.800000", 2024-04-01T19:24:38.187 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_overload_epochs": "2", 2024-04-01T19:24:38.187 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-01T19:24:38.188 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-01T19:24:38.188 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_split_bits": "3", 2024-04-01T19:24:38.188 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-01T19:24:38.188 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_split_size": "10000", 2024-04-01T19:24:38.188 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-01T19:24:38.188 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_target_decay": "10.000000", 2024-04-01T19:24:38.188 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-01T19:24:38.188 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_beacon_grace": "15.000000", 2024-04-01T19:24:38.188 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_beacon_interval": "4.000000", 2024-04-01T19:24:38.188 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-01T19:24:38.188 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-01T19:24:38.188 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_cache_mid": "0.700000", 2024-04-01T19:24:38.188 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-04-01T19:24:38.188 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_cache_quiesce_delay": "0", 2024-04-01T19:24:38.188 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_cache_quiesce_sleep": "200", 2024-04-01T19:24:38.189 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_cache_quiesce_splitauth": "true", 2024-04-01T19:24:38.189 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_cache_quiesce_threshold": "524288", 2024-04-01T19:24:38.189 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_cache_release_free_interval": "10", 2024-04-01T19:24:38.189 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_cache_reservation": "0.050000", 2024-04-01T19:24:38.189 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-01T19:24:38.189 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_cache_trim_interval": "1", 2024-04-01T19:24:38.189 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_cache_trim_threshold": "262144", 2024-04-01T19:24:38.189 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-01T19:24:38.189 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-01T19:24:38.189 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-01T19:24:38.189 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_client_prealloc_inos": "1000", 2024-04-01T19:24:38.189 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-01T19:24:38.189 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_connect_bootstrapping": "false", 2024-04-01T19:24:38.189 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_damage_table_max_entries": "10000", 2024-04-01T19:24:38.190 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-01T19:24:38.190 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_debug_auth_pins": "false", 2024-04-01T19:24:38.190 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_debug_frag": "false", 2024-04-01T19:24:38.190 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_debug_scatterstat": "false", 2024-04-01T19:24:38.190 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_debug_subtrees": "false", 2024-04-01T19:24:38.190 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_decay_halflife": "5.000000", 2024-04-01T19:24:38.190 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_default_dir_hash": "2", 2024-04-01T19:24:38.190 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_defer_session_stale": "true", 2024-04-01T19:24:38.190 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_deny_all_reconnect": "false", 2024-04-01T19:24:38.190 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_dir_keys_per_op": "16384", 2024-04-01T19:24:38.190 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_dir_max_commit_size": "10", 2024-04-01T19:24:38.190 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_dir_max_entries": "0", 2024-04-01T19:24:38.190 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_dir_prefetch": "true", 2024-04-01T19:24:38.190 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-01T19:24:38.191 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-01T19:24:38.191 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_dump_cache_on_map": "false", 2024-04-01T19:24:38.191 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-01T19:24:38.191 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-01T19:24:38.191 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_early_reply": "true", 2024-04-01T19:24:38.191 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_enable_op_tracker": "true", 2024-04-01T19:24:38.191 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_enforce_unique_name": "true", 2024-04-01T19:24:38.191 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-01T19:24:38.191 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-01T19:24:38.191 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_export_ephemeral_random": "true", 2024-04-01T19:24:38.191 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-01T19:24:38.191 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-01T19:24:38.191 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-01T19:24:38.191 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-01T19:24:38.192 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-01T19:24:38.192 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-01T19:24:38.192 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-01T19:24:38.192 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-01T19:24:38.192 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_health_summarize_threshold": "10", 2024-04-01T19:24:38.192 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-01T19:24:38.192 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-01T19:24:38.192 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_inject_health_dummy": "false", 2024-04-01T19:24:38.192 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-01T19:24:38.192 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_inject_migrator_session_race": "false", 2024-04-01T19:24:38.192 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-01T19:24:38.192 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-01T19:24:38.192 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-01T19:24:38.192 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_join_fs": "", 2024-04-01T19:24:38.193 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_journal_format": "1", 2024-04-01T19:24:38.193 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_kill_create_at": "0", 2024-04-01T19:24:38.193 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_kill_export_at": "0", 2024-04-01T19:24:38.193 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_kill_import_at": "0", 2024-04-01T19:24:38.193 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_kill_journal_at": "0", 2024-04-01T19:24:38.193 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_kill_journal_expire_at": "0", 2024-04-01T19:24:38.193 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_kill_journal_replay_at": "0", 2024-04-01T19:24:38.193 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_kill_link_at": "0", 2024-04-01T19:24:38.193 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_kill_mdstable_at": "0", 2024-04-01T19:24:38.193 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_kill_openc_at": "0", 2024-04-01T19:24:38.193 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_kill_rename_at": "0", 2024-04-01T19:24:38.193 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_kill_shutdown_at": "0", 2024-04-01T19:24:38.193 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-01T19:24:38.193 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_log_event_large_threshold": "524288", 2024-04-01T19:24:38.194 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_log_events_per_segment": "1024", 2024-04-01T19:24:38.194 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_log_major_segment_event_ratio": "12", 2024-04-01T19:24:38.194 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_log_max_events": "-1", 2024-04-01T19:24:38.194 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_log_max_segments": "128", 2024-04-01T19:24:38.194 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_log_pause": "false", 2024-04-01T19:24:38.194 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_log_segment_size": "0", 2024-04-01T19:24:38.194 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-01T19:24:38.194 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_log_skip_unbounded_events": "false", 2024-04-01T19:24:38.194 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-04-01T19:24:38.194 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_log_trim_threshold": "128", 2024-04-01T19:24:38.194 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-04-01T19:24:38.194 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_log_warn_factor": "2.000000", 2024-04-01T19:24:38.194 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_max_caps_per_client": "1048576", 2024-04-01T19:24:38.194 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_max_completed_flushes": "100000", 2024-04-01T19:24:38.195 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_max_completed_requests": "100000", 2024-04-01T19:24:38.195 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_max_export_size": "20971520", 2024-04-01T19:24:38.195 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_max_file_recover": "32", 2024-04-01T19:24:38.195 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_max_purge_files": "64", 2024-04-01T19:24:38.195 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_max_purge_ops": "8192", 2024-04-01T19:24:38.195 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-01T19:24:38.195 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-01T19:24:38.195 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_max_snaps_per_dir": "100", 2024-04-01T19:24:38.195 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_metrics_update_interval": "2", 2024-04-01T19:24:38.195 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_min_caps_per_client": "100", 2024-04-01T19:24:38.195 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_min_caps_working_set": "10000", 2024-04-01T19:24:38.195 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-01T19:24:38.195 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_numa_node": "-1", 2024-04-01T19:24:38.195 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-01T19:24:38.196 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_op_complaint_time": "30.000000", 2024-04-01T19:24:38.196 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_op_history_duration": "600", 2024-04-01T19:24:38.196 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_op_history_size": "20", 2024-04-01T19:24:38.196 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_op_history_slow_op_size": "20", 2024-04-01T19:24:38.196 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-01T19:24:38.196 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_op_log_threshold": "5", 2024-04-01T19:24:38.196 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_ping_grace": "15", 2024-04-01T19:24:38.196 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_ping_interval": "5", 2024-04-01T19:24:38.196 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-01T19:24:38.196 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-01T19:24:38.196 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_recall_max_caps": "30000", 2024-04-01T19:24:38.196 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-01T19:24:38.196 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-01T19:24:38.196 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-01T19:24:38.197 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_recall_warning_threshold": "262144", 2024-04-01T19:24:38.197 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-01T19:24:38.197 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_replay_interval": "1.000000", 2024-04-01T19:24:38.197 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-01T19:24:38.197 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-01T19:24:38.197 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_root_ino_gid": "0", 2024-04-01T19:24:38.197 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_root_ino_uid": "0", 2024-04-01T19:24:38.197 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-01T19:24:38.197 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-01T19:24:38.197 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-01T19:24:38.197 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-01T19:24:38.197 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-01T19:24:38.197 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-01T19:24:38.197 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-01T19:24:38.198 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-01T19:24:38.198 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-01T19:24:38.198 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-01T19:24:38.198 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_shutdown_check": "0", 2024-04-01T19:24:38.198 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_skip_ino": "0", 2024-04-01T19:24:38.198 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-01T19:24:38.198 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_snap_max_uid": "4294967294", 2024-04-01T19:24:38.198 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_snap_min_uid": "0", 2024-04-01T19:24:38.198 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_snap_rstat": "false", 2024-04-01T19:24:38.198 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_standby_replay_damaged": "false", 2024-04-01T19:24:38.198 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_symlink_recovery": "true", 2024-04-01T19:24:38.198 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-01T19:24:38.198 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_thrash_exports": "0", 2024-04-01T19:24:38.199 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_thrash_fragments": "0", 2024-04-01T19:24:38.199 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_tick_interval": "5.000000", 2024-04-01T19:24:38.199 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_valgrind_exit": "false", 2024-04-01T19:24:38.199 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_verify_backtrace": "1", 2024-04-01T19:24:38.199 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_verify_scatter": "false", 2024-04-01T19:24:38.199 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-01T19:24:38.199 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_wipe_sessions": "false", 2024-04-01T19:24:38.199 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool_debug": "false", 2024-04-01T19:24:38.199 INFO:teuthology.orchestra.run.smithi022.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-01T19:24:38.199 INFO:teuthology.orchestra.run.smithi022.stdout: "memstore_device_bytes": "1073741824", 2024-04-01T19:24:38.199 INFO:teuthology.orchestra.run.smithi022.stdout: "memstore_page_set": "false", 2024-04-01T19:24:38.199 INFO:teuthology.orchestra.run.smithi022.stdout: "memstore_page_size": "65536", 2024-04-01T19:24:38.199 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_client_bytes": "134217728", 2024-04-01T19:24:38.199 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_client_messages": "512", 2024-04-01T19:24:38.200 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-01T19:24:38.200 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-01T19:24:38.200 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-01T19:24:38.200 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-01T19:24:38.200 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_disabled_modules": "", 2024-04-01T19:24:38.200 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_enable_op_tracker": "true", 2024-04-01T19:24:38.200 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-01T19:24:38.200 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_max_pg_num_change": "128", 2024-04-01T19:24:38.200 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_mds_bytes": "134217728", 2024-04-01T19:24:38.200 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_mds_messages": "128", 2024-04-01T19:24:38.200 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-01T19:24:38.200 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_mon_bytes": "134217728", 2024-04-01T19:24:38.200 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_mon_messages": "128", 2024-04-01T19:24:38.200 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_num_op_tracker_shard": "32", 2024-04-01T19:24:38.201 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_op_complaint_time": "30.000000", 2024-04-01T19:24:38.201 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_op_history_duration": "600", 2024-04-01T19:24:38.201 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_op_history_size": "20", 2024-04-01T19:24:38.201 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_op_history_slow_op_size": "20", 2024-04-01T19:24:38.201 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-04-01T19:24:38.201 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_op_log_threshold": "5", 2024-04-01T19:24:38.201 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_osd_bytes": "536870912", 2024-04-01T19:24:38.201 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_osd_messages": "8192", 2024-04-01T19:24:38.201 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_pool": "true", 2024-04-01T19:24:38.201 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-01T19:24:38.201 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_standby_modules": "true", 2024-04-01T19:24:38.201 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_stats_period": "5", 2024-04-01T19:24:38.201 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_stats_threshold": "5", 2024-04-01T19:24:38.201 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_tick_period": "2", 2024-04-01T19:24:38.201 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-01T19:24:38.202 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-01T19:24:38.202 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_allow_pool_delete": "true", 2024-04-01T19:24:38.202 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_allow_pool_size_one": "false", 2024-04-01T19:24:38.202 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_auth_validate_all_caps": "true", 2024-04-01T19:24:38.202 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-01T19:24:38.202 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-01T19:24:38.202 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_client_bytes": "104857600", 2024-04-01T19:24:38.202 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_client_directed_command_retry": "5", 2024-04-01T19:24:38.202 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-01T19:24:38.202 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-01T19:24:38.202 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-01T19:24:38.202 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-01T19:24:38.202 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_client_hunt_parallel": "3", 2024-04-01T19:24:38.202 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_client_log_interval": "1.000000", 2024-04-01T19:24:38.203 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-01T19:24:38.203 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_client_ping_interval": "10.000000", 2024-04-01T19:24:38.203 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-01T19:24:38.203 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_client_target_rank": "-1", 2024-04-01T19:24:38.203 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-01T19:24:38.203 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-01T19:24:38.203 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-01T19:24:38.203 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_cluster_log_file_level": "debug", 2024-04-01T19:24:38.203 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_cluster_log_to_file": "true", 2024-04-01T19:24:38.203 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-01T19:24:38.203 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-01T19:24:38.203 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-01T19:24:38.203 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_cluster_log_to_journald": "true", 2024-04-01T19:24:38.203 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-01T19:24:38.203 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-01T19:24:38.204 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-01T19:24:38.204 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-01T19:24:38.204 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_compact_on_bootstrap": "false", 2024-04-01T19:24:38.204 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_compact_on_start": "false", 2024-04-01T19:24:38.204 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_compact_on_trim": "true", 2024-04-01T19:24:38.204 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-01T19:24:38.204 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-01T19:24:38.204 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-01T19:24:38.204 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_cpu_threads": "4", 2024-04-01T19:24:38.204 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_crush_min_required_version": "hammer", 2024-04-01T19:24:38.204 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_daemon_bytes": "419430400", 2024-04-01T19:24:38.204 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-01T19:24:38.204 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_data_avail_crit": "5", 2024-04-01T19:24:38.204 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_data_avail_warn": "5", 2024-04-01T19:24:38.205 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_data_size_warn": "16106127360", 2024-04-01T19:24:38.205 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-01T19:24:38.205 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-01T19:24:38.205 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_debug_dump_json": "false", 2024-04-01T19:24:38.205 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-01T19:24:38.205 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_debug_dump_transactions": "false", 2024-04-01T19:24:38.205 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_debug_extra_checks": "false", 2024-04-01T19:24:38.205 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-01T19:24:38.205 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-01T19:24:38.205 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_debug_no_require_reef": "false", 2024-04-01T19:24:38.205 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_debug_no_require_squid": "false", 2024-04-01T19:24:38.205 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-01T19:24:38.205 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-01T19:24:38.205 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-01T19:24:38.206 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_down_mkfs_grace": "60", 2024-04-01T19:24:38.206 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_down_uptime_grace": "60", 2024-04-01T19:24:38.206 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_election_default_strategy": "1", 2024-04-01T19:24:38.206 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_election_timeout": "5.000000", 2024-04-01T19:24:38.206 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-01T19:24:38.206 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_elector_ping_divisor": "2", 2024-04-01T19:24:38.206 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-01T19:24:38.206 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_enable_op_tracker": "true", 2024-04-01T19:24:38.206 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_fake_pool_delete": "false", 2024-04-01T19:24:38.206 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_force_quorum_join": "false", 2024-04-01T19:24:38.206 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_globalid_prealloc": "10000", 2024-04-01T19:24:38.206 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_health_detail_to_clog": "true", 2024-04-01T19:24:38.207 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_health_log_update_period": "5", 2024-04-01T19:24:38.207 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_health_max_detail": "50", 2024-04-01T19:24:38.207 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_health_to_clog": "true", 2024-04-01T19:24:38.207 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_health_to_clog_interval": "600", 2024-04-01T19:24:38.207 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-01T19:24:38.207 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_host": "172.21.15.22:6789/0", 2024-04-01T19:24:38.207 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_host_override": "", 2024-04-01T19:24:38.207 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_initial_members": "", 2024-04-01T19:24:38.207 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-01T19:24:38.207 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-01T19:24:38.207 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-01T19:24:38.207 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-01T19:24:38.207 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-01T19:24:38.207 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_lease": "5.000000", 2024-04-01T19:24:38.208 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-01T19:24:38.208 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-01T19:24:38.208 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_log_full_interval": "50", 2024-04-01T19:24:38.208 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_log_max": "10000", 2024-04-01T19:24:38.208 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_log_max_summary": "50", 2024-04-01T19:24:38.208 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-01T19:24:38.208 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_max_log_epochs": "500", 2024-04-01T19:24:38.208 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-01T19:24:38.208 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-01T19:24:38.208 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_max_osd": "10000", 2024-04-01T19:24:38.208 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_max_pg_per_osd": "10000", 2024-04-01T19:24:38.208 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_max_pool_pg_num": "65536", 2024-04-01T19:24:38.208 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-01T19:24:38.208 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-01T19:24:38.209 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_mds_force_trim_to": "0", 2024-04-01T19:24:38.209 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_mds_skip_sanity": "false", 2024-04-01T19:24:38.209 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_memory_autotune": "true", 2024-04-01T19:24:38.209 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_memory_target": "2147483648", 2024-04-01T19:24:38.209 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_mgr_beacon_grace": "30", 2024-04-01T19:24:38.209 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-01T19:24:38.209 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_mgr_digest_period": "5", 2024-04-01T19:24:38.209 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_mgr_inactive_grace": "60", 2024-04-01T19:24:38.209 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-01T19:24:38.209 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-01T19:24:38.209 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_min_osdmap_epochs": "50", 2024-04-01T19:24:38.209 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_op_complaint_time": "30", 2024-04-01T19:24:38.209 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_op_history_duration": "600", 2024-04-01T19:24:38.210 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_op_history_size": "20", 2024-04-01T19:24:38.210 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_op_history_slow_op_size": "20", 2024-04-01T19:24:38.210 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-01T19:24:38.210 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_op_log_threshold": "5", 2024-04-01T19:24:38.210 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-01T19:24:38.210 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-01T19:24:38.210 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-01T19:24:38.210 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_auto_mark_in": "false", 2024-04-01T19:24:38.210 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-01T19:24:38.210 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-01T19:24:38.210 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-01T19:24:38.210 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_cache_size": "500", 2024-04-01T19:24:38.211 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-01T19:24:38.211 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-01T19:24:38.211 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-01T19:24:38.211 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_down_out_interval": "600", 2024-04-01T19:24:38.211 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-01T19:24:38.211 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-01T19:24:38.211 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_force_trim_to": "0", 2024-04-01T19:24:38.211 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-01T19:24:38.211 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-01T19:24:38.211 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-01T19:24:38.211 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-01T19:24:38.211 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-01T19:24:38.211 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-01T19:24:38.211 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-01T19:24:38.211 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-01T19:24:38.211 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_min_down_reporters": "2", 2024-04-01T19:24:38.212 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-01T19:24:38.212 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-01T19:24:38.212 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-01T19:24:38.212 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-01T19:24:38.212 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-01T19:24:38.212 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-01T19:24:38.212 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_report_timeout": "900", 2024-04-01T19:24:38.212 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-01T19:24:38.212 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-01T19:24:38.212 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-01T19:24:38.212 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-01T19:24:38.212 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-01T19:24:38.212 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osdmap_full_prune_interval": "2", 2024-04-01T19:24:38.212 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osdmap_full_prune_min": "15", 2024-04-01T19:24:38.212 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_osdmap_full_prune_txsize": "2", 2024-04-01T19:24:38.213 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-01T19:24:38.213 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_pg_stuck_threshold": "60", 2024-04-01T19:24:38.213 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-01T19:24:38.213 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-01T19:24:38.213 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-01T19:24:38.213 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-01T19:24:38.213 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-01T19:24:38.213 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-01T19:24:38.213 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_probe_timeout": "2.000000", 2024-04-01T19:24:38.213 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_reweight_max_change": "0.050000", 2024-04-01T19:24:38.213 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_reweight_max_osds": "4", 2024-04-01T19:24:38.213 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-01T19:24:38.213 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-01T19:24:38.213 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-01T19:24:38.214 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-01T19:24:38.214 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-01T19:24:38.214 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_scrub_interval": "300", 2024-04-01T19:24:38.214 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_scrub_max_keys": "100", 2024-04-01T19:24:38.214 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_scrub_timeout": "300", 2024-04-01T19:24:38.214 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_session_timeout": "300", 2024-04-01T19:24:38.214 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_smart_report_timeout": "5", 2024-04-01T19:24:38.214 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_stat_smooth_intervals": "6", 2024-04-01T19:24:38.214 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-01T19:24:38.214 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_stretch_pool_min_size": "2", 2024-04-01T19:24:38.214 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_stretch_pool_size": "4", 2024-04-01T19:24:38.214 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-01T19:24:38.214 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-01T19:24:38.215 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_sync_debug": "false", 2024-04-01T19:24:38.215 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-01T19:24:38.215 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-01T19:24:38.215 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_sync_provider_kill_at": "0", 2024-04-01T19:24:38.215 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_sync_requester_kill_at": "0", 2024-04-01T19:24:38.215 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_sync_timeout": "60.000000", 2024-04-01T19:24:38.215 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_target_pg_per_osd": "100", 2024-04-01T19:24:38.215 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_tick_interval": "5", 2024-04-01T19:24:38.215 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_timecheck_interval": "300.000000", 2024-04-01T19:24:38.215 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-01T19:24:38.215 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_use_min_delay_socket": "false", 2024-04-01T19:24:38.216 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_warn_older_version_delay": "604800", 2024-04-01T19:24:38.216 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-01T19:24:38.216 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-01T19:24:38.216 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-01T19:24:38.216 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_warn_on_filestore_osds": "true", 2024-04-01T19:24:38.216 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-01T19:24:38.216 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-01T19:24:38.216 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-01T19:24:38.216 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_warn_on_misplaced": "false", 2024-04-01T19:24:38.216 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-01T19:24:38.216 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_warn_on_older_version": "true", 2024-04-01T19:24:38.216 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-01T19:24:38.216 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-01T19:24:38.217 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_warn_on_pool_no_redundancy": "true", 2024-04-01T19:24:38.217 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-01T19:24:38.217 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-01T19:24:38.217 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-01T19:24:38.217 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-01T19:24:38.217 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-01T19:24:38.217 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-01T19:24:38.217 INFO:teuthology.orchestra.run.smithi022.stdout: "monmap": "", 2024-04-01T19:24:38.217 INFO:teuthology.orchestra.run.smithi022.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-01T19:24:38.217 INFO:teuthology.orchestra.run.smithi022.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-01T19:24:38.217 INFO:teuthology.orchestra.run.smithi022.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-01T19:24:38.218 INFO:teuthology.orchestra.run.smithi022.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-01T19:24:38.218 INFO:teuthology.orchestra.run.smithi022.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-01T19:24:38.218 INFO:teuthology.orchestra.run.smithi022.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-01T19:24:38.218 INFO:teuthology.orchestra.run.smithi022.stdout: "motr_tracing_enabled": "false", 2024-04-01T19:24:38.218 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_async_op_threads": "3", 2024-04-01T19:24:38.218 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-01T19:24:38.218 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_async_rdma_cm": "false", 2024-04-01T19:24:38.218 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_async_rdma_device_name": "", 2024-04-01T19:24:38.218 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_async_rdma_dscp": "96", 2024-04-01T19:24:38.218 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-01T19:24:38.218 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-01T19:24:38.218 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_async_rdma_local_gid": "", 2024-04-01T19:24:38.219 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-01T19:24:38.219 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_async_rdma_port_num": "1", 2024-04-01T19:24:38.219 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-01T19:24:38.219 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-01T19:24:38.219 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-01T19:24:38.219 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-01T19:24:38.219 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_async_rdma_sl": "3", 2024-04-01T19:24:38.219 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_async_rdma_support_srq": "true", 2024-04-01T19:24:38.219 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_async_rdma_type": "ib", 2024-04-01T19:24:38.219 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_async_reap_threshold": "5", 2024-04-01T19:24:38.219 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_bind_before_connect": "false", 2024-04-01T19:24:38.219 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_bind_ipv4": "true", 2024-04-01T19:24:38.219 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_bind_ipv6": "false", 2024-04-01T19:24:38.220 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_bind_msgr1": "true", 2024-04-01T19:24:38.220 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_bind_msgr2": "false", 2024-04-01T19:24:38.220 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_bind_port_max": "7568", 2024-04-01T19:24:38.220 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_bind_port_min": "6800", 2024-04-01T19:24:38.220 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-01T19:24:38.220 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_bind_retry_count": "3", 2024-04-01T19:24:38.220 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_bind_retry_delay": "5", 2024-04-01T19:24:38.220 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_blackhole_client": "false", 2024-04-01T19:24:38.220 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_blackhole_mds": "false", 2024-04-01T19:24:38.220 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_blackhole_mgr": "false", 2024-04-01T19:24:38.220 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_blackhole_mon": "false", 2024-04-01T19:24:38.220 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_blackhole_osd": "false", 2024-04-01T19:24:38.220 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_client_mode": "crc secure", 2024-04-01T19:24:38.221 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_cluster_mode": "crc secure", 2024-04-01T19:24:38.221 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_cluster_type": "", 2024-04-01T19:24:38.221 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_compress_secure": "false", 2024-04-01T19:24:38.221 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_connection_idle_timeout": "900", 2024-04-01T19:24:38.221 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_connection_ready_timeout": "10", 2024-04-01T19:24:38.221 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_crc_data": "true", 2024-04-01T19:24:38.221 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_crc_header": "true", 2024-04-01T19:24:38.221 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_die_on_bad_msg": "false", 2024-04-01T19:24:38.221 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_die_on_bug": "true", 2024-04-01T19:24:38.221 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_die_on_old_message": "true", 2024-04-01T19:24:38.221 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_die_on_skipped_message": "false", 2024-04-01T19:24:38.221 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-01T19:24:38.221 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-01T19:24:38.221 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_dpdk_coremask": "0xF", 2024-04-01T19:24:38.222 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-01T19:24:38.222 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-01T19:24:38.222 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_dpdk_enable_tso": "true", 2024-04-01T19:24:38.222 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-01T19:24:38.222 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-01T19:24:38.222 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_dpdk_hugepages": "", 2024-04-01T19:24:38.222 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-01T19:24:38.222 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-01T19:24:38.222 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_dpdk_lro": "true", 2024-04-01T19:24:38.222 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_dpdk_memory_channel": "4", 2024-04-01T19:24:38.222 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-01T19:24:38.222 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_dpdk_pmd": "", 2024-04-01T19:24:38.222 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_dpdk_port_id": "0", 2024-04-01T19:24:38.222 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-01T19:24:38.223 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-01T19:24:38.223 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_dump_on_send": "false", 2024-04-01T19:24:38.223 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_initial_backoff": "0.200000", 2024-04-01T19:24:38.223 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_inject_delay_max": "1.000000", 2024-04-01T19:24:38.223 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-01T19:24:38.223 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_inject_delay_type": "", 2024-04-01T19:24:38.223 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-01T19:24:38.223 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_inject_network_congestion": "0", 2024-04-01T19:24:38.223 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_inject_socket_failures": "5000", 2024-04-01T19:24:38.223 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_learn_addr_from_peer": "true", 2024-04-01T19:24:38.223 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_max_accept_failures": "4", 2024-04-01T19:24:38.223 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_max_backoff": "15.000000", 2024-04-01T19:24:38.223 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_mon_client_mode": "secure crc", 2024-04-01T19:24:38.223 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-01T19:24:38.224 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_mon_service_mode": "secure crc", 2024-04-01T19:24:38.224 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_osd_compress_min_size": "1024", 2024-04-01T19:24:38.224 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_osd_compress_mode": "none", 2024-04-01T19:24:38.224 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-01T19:24:38.224 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-01T19:24:38.224 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_pq_min_cost": "65536", 2024-04-01T19:24:38.224 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_public_type": "", 2024-04-01T19:24:38.224 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_service_mode": "crc secure", 2024-04-01T19:24:38.224 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_tcp_listen_backlog": "512", 2024-04-01T19:24:38.224 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_tcp_nodelay": "true", 2024-04-01T19:24:38.224 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-01T19:24:38.224 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_tcp_rcvbuf": "0", 2024-04-01T19:24:38.224 INFO:teuthology.orchestra.run.smithi022.stdout: "ms_type": "async+posix", 2024-04-01T19:24:38.224 INFO:teuthology.orchestra.run.smithi022.stdout: "no_config_file": "false", 2024-04-01T19:24:38.225 INFO:teuthology.orchestra.run.smithi022.stdout: "objecter_completion_locks_per_session": "32", 2024-04-01T19:24:38.225 INFO:teuthology.orchestra.run.smithi022.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-01T19:24:38.225 INFO:teuthology.orchestra.run.smithi022.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-01T19:24:38.225 INFO:teuthology.orchestra.run.smithi022.stdout: "objecter_inflight_ops": "1024", 2024-04-01T19:24:38.225 INFO:teuthology.orchestra.run.smithi022.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-01T19:24:38.225 INFO:teuthology.orchestra.run.smithi022.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-01T19:24:38.225 INFO:teuthology.orchestra.run.smithi022.stdout: "objecter_tick_interval": "5.000000", 2024-04-01T19:24:38.225 INFO:teuthology.orchestra.run.smithi022.stdout: "objecter_timeout": "10.000000", 2024-04-01T19:24:38.225 INFO:teuthology.orchestra.run.smithi022.stdout: "objectstore_blackhole": "false", 2024-04-01T19:24:38.225 INFO:teuthology.orchestra.run.smithi022.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-04-01T19:24:38.225 INFO:teuthology.orchestra.run.smithi022.stdout: "openssl_engine_opts": "", 2024-04-01T19:24:38.225 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_agent_delay_time": "5.000000", 2024-04-01T19:24:38.225 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_agent_hist_halflife": "1000", 2024-04-01T19:24:38.225 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_agent_max_low_ops": "2", 2024-04-01T19:24:38.226 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_agent_max_ops": "4", 2024-04-01T19:24:38.226 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-01T19:24:38.226 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-01T19:24:38.226 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_agent_slop": "0.020000", 2024-04-01T19:24:38.226 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-01T19:24:38.226 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-01T19:24:38.226 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_asio_thread_count": "2", 2024-04-01T19:24:38.226 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_async_recovery_min_cost": "100", 2024-04-01T19:24:38.226 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-01T19:24:38.226 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-01T19:24:38.226 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_backfill_scan_max": "512", 2024-04-01T19:24:38.226 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_backfill_scan_min": "64", 2024-04-01T19:24:38.226 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_backoff_on_degraded": "false", 2024-04-01T19:24:38.226 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_backoff_on_peering": "false", 2024-04-01T19:24:38.227 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_backoff_on_unfound": "true", 2024-04-01T19:24:38.227 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_beacon_report_interval": "300", 2024-04-01T19:24:38.227 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bench_duration": "30", 2024-04-01T19:24:38.227 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-01T19:24:38.227 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bench_max_block_size": "67108864", 2024-04-01T19:24:38.227 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-01T19:24:38.227 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_blkin_trace_all": "false", 2024-04-01T19:24:38.227 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-01T19:24:38.227 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-01T19:24:38.227 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-01T19:24:38.227 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-01T19:24:38.227 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_check_for_log_corruption": "false", 2024-04-01T19:24:38.227 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-01T19:24:38.227 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-01T19:24:38.227 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-04-01T19:24:38.228 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-01T19:24:38.228 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_class_update_on_start": "true", 2024-04-01T19:24:38.228 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_client_message_cap": "256", 2024-04-01T19:24:38.228 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_client_message_size_cap": "524288000", 2024-04-01T19:24:38.228 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_client_op_priority": "63", 2024-04-01T19:24:38.228 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_client_watch_timeout": "30", 2024-04-01T19:24:38.228 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_command_max_records": "256", 2024-04-01T19:24:38.228 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_compact_on_start": "false", 2024-04-01T19:24:38.228 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-01T19:24:38.228 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_crush_chooseleaf_type": "1", 2024-04-01T19:24:38.228 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-01T19:24:38.228 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_crush_update_on_start": "true", 2024-04-01T19:24:38.228 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_crush_update_weight_set": "true", 2024-04-01T19:24:38.228 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-01T19:24:38.229 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-01T19:24:38.229 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-01T19:24:38.229 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-01T19:24:38.229 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-01T19:24:38.229 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_debug_feed_pullee": "-1", 2024-04-01T19:24:38.229 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-01T19:24:38.229 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-01T19:24:38.229 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-01T19:24:38.229 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_debug_misdirected_ops": "false", 2024-04-01T19:24:38.229 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_debug_no_acting_change": "false", 2024-04-01T19:24:38.229 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_debug_no_purge_strays": "false", 2024-04-01T19:24:38.229 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_debug_op_order": "false", 2024-04-01T19:24:38.229 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-01T19:24:38.230 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-01T19:24:38.230 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-01T19:24:38.230 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-01T19:24:38.230 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_debug_shutdown": "false", 2024-04-01T19:24:38.230 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-01T19:24:38.230 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-01T19:24:38.230 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_debug_trim_objects": "false", 2024-04-01T19:24:38.230 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-01T19:24:38.230 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-01T19:24:38.230 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_debug_verify_snaps": "false", 2024-04-01T19:24:38.230 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-01T19:24:38.230 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-01T19:24:38.230 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_deep_scrub_keys": "1024", 2024-04-01T19:24:38.231 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-01T19:24:38.231 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-01T19:24:38.231 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-01T19:24:38.231 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_deep_scrub_stride": "524288", 2024-04-01T19:24:38.231 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-01T19:24:38.231 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_default_data_pool_replay_window": "45", 2024-04-01T19:24:38.231 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_default_notify_timeout": "30", 2024-04-01T19:24:38.231 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_delete_sleep": "0.000000", 2024-04-01T19:24:38.231 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-01T19:24:38.231 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-01T19:24:38.231 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-01T19:24:38.231 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_discard_disconnected_ops": "true", 2024-04-01T19:24:38.231 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_enable_op_tracker": "true", 2024-04-01T19:24:38.231 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-01T19:24:38.231 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-01T19:24:38.232 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-01T19:24:38.232 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-01T19:24:38.232 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_fast_info": "true", 2024-04-01T19:24:38.232 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_fast_shutdown": "true", 2024-04-01T19:24:38.232 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-01T19:24:38.232 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-01T19:24:38.232 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-01T19:24:38.232 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-01T19:24:38.232 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-01T19:24:38.232 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_function_tracing": "false", 2024-04-01T19:24:38.232 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_heartbeat_grace": "20", 2024-04-01T19:24:38.232 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_heartbeat_interval": "6", 2024-04-01T19:24:38.233 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-01T19:24:38.233 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_heartbeat_min_peers": "10", 2024-04-01T19:24:38.233 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_heartbeat_min_size": "2000", 2024-04-01T19:24:38.233 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_heartbeat_stale": "600", 2024-04-01T19:24:38.233 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-01T19:24:38.233 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_hit_set_max_size": "100000", 2024-04-01T19:24:38.233 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_hit_set_min_size": "1000", 2024-04-01T19:24:38.233 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-01T19:24:38.233 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-01T19:24:38.233 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-01T19:24:38.233 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-01T19:24:38.233 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-01T19:24:38.233 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-01T19:24:38.234 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_journal_size": "5120", 2024-04-01T19:24:38.234 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_kill_backfill_at": "0", 2024-04-01T19:24:38.234 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-01T19:24:38.234 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_map_cache_size": "50", 2024-04-01T19:24:38.234 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_map_dedup": "true", 2024-04-01T19:24:38.234 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_map_message_max": "40", 2024-04-01T19:24:38.234 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-01T19:24:38.234 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_map_share_max_epochs": "40", 2024-04-01T19:24:38.234 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_max_attr_name_len": "100", 2024-04-01T19:24:38.234 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_max_attr_size": "0", 2024-04-01T19:24:38.234 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_max_backfills": "1", 2024-04-01T19:24:38.234 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_max_markdown_count": "5", 2024-04-01T19:24:38.234 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_max_markdown_period": "600", 2024-04-01T19:24:38.235 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_max_object_name_len": "2048", 2024-04-01T19:24:38.235 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_max_object_namespace_len": "256", 2024-04-01T19:24:38.235 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_max_object_size": "134217728", 2024-04-01T19:24:38.235 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-01T19:24:38.235 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-01T19:24:38.235 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_max_pg_blocked_by": "16", 2024-04-01T19:24:38.235 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_max_pg_log_entries": "10000", 2024-04-01T19:24:38.235 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-01T19:24:38.235 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_max_pgls": "1024", 2024-04-01T19:24:38.235 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_max_push_cost": "8388608", 2024-04-01T19:24:38.235 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_max_push_objects": "10", 2024-04-01T19:24:38.235 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_max_scrubs": "3", 2024-04-01T19:24:38.235 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-01T19:24:38.235 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_max_trimming_pgs": "2", 2024-04-01T19:24:38.236 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_max_write_op_reply_len": "64", 2024-04-01T19:24:38.236 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_max_write_size": "90", 2024-04-01T19:24:38.236 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-01T19:24:38.236 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-01T19:24:38.236 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-01T19:24:38.236 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-01T19:24:38.236 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-01T19:24:38.236 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-01T19:24:38.236 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-01T19:24:38.236 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-01T19:24:38.236 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mclock_profile": "balanced", 2024-04-01T19:24:38.236 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-01T19:24:38.236 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-01T19:24:38.237 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-01T19:24:38.237 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-01T19:24:38.237 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-01T19:24:38.237 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-01T19:24:38.237 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-01T19:24:38.237 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-01T19:24:38.237 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-01T19:24:38.237 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-01T19:24:38.237 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-01T19:24:38.237 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_memory_base": "805306368", 2024-04-01T19:24:38.237 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_memory_cache_min": "134217728", 2024-04-01T19:24:38.238 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-01T19:24:38.238 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-01T19:24:38.238 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_memory_target": "4294967296", 2024-04-01T19:24:38.238 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_memory_target_autotune": "false", 2024-04-01T19:24:38.238 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-01T19:24:38.238 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_min_pg_log_entries": "250", 2024-04-01T19:24:38.238 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_min_recovery_priority": "0", 2024-04-01T19:24:38.238 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-01T19:24:38.238 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-01T19:24:38.238 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mon_report_interval": "5", 2024-04-01T19:24:38.238 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-01T19:24:38.238 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-01T19:24:38.238 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_num_cache_shards": "32", 2024-04-01T19:24:38.239 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_num_op_tracker_shard": "32", 2024-04-01T19:24:38.239 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_numa_auto_affinity": "true", 2024-04-01T19:24:38.239 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_numa_node": "-1", 2024-04-01T19:24:38.239 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_numa_prefer_iface": "true", 2024-04-01T19:24:38.239 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-01T19:24:38.239 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_objecter_finishers": "1", 2024-04-01T19:24:38.239 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_objectstore": "bluestore", 2024-04-01T19:24:38.239 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_objectstore_fuse": "false", 2024-04-01T19:24:38.239 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_objectstore_tracing": "false", 2024-04-01T19:24:38.239 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_op_complaint_time": "30.000000", 2024-04-01T19:24:38.239 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_op_history_duration": "600", 2024-04-01T19:24:38.239 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_op_history_size": "20", 2024-04-01T19:24:38.239 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_op_history_slow_op_size": "20", 2024-04-01T19:24:38.239 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-01T19:24:38.239 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_op_log_threshold": "5", 2024-04-01T19:24:38.240 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_op_num_shards": "0", 2024-04-01T19:24:38.240 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_op_num_shards_hdd": "5", 2024-04-01T19:24:38.240 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_op_num_shards_ssd": "8", 2024-04-01T19:24:38.240 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-01T19:24:38.240 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-01T19:24:38.240 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-01T19:24:38.240 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-01T19:24:38.240 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_op_pq_min_cost": "65536", 2024-04-01T19:24:38.240 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-01T19:24:38.240 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_op_queue_cut_off": "high", 2024-04-01T19:24:38.240 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-01T19:24:38.240 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_op_thread_timeout": "15", 2024-04-01T19:24:38.240 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_open_classes_on_start": "true", 2024-04-01T19:24:38.240 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_os_flags": "0", 2024-04-01T19:24:38.241 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_peering_op_priority": "255", 2024-04-01T19:24:38.241 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pg_delete_cost": "1048576", 2024-04-01T19:24:38.241 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pg_delete_priority": "5", 2024-04-01T19:24:38.241 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-01T19:24:38.241 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-01T19:24:38.241 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-01T19:24:38.241 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pg_log_trim_max": "10000", 2024-04-01T19:24:38.241 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pg_log_trim_min": "100", 2024-04-01T19:24:38.241 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-01T19:24:38.241 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-01T19:24:38.241 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-04-01T19:24:38.241 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-04-01T19:24:38.241 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-01T19:24:38.241 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-01T19:24:38.241 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-01T19:24:38.242 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-01T19:24:38.242 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-01T19:24:38.242 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-01T19:24:38.242 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_default_crimson": "false", 2024-04-01T19:24:38.242 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-01T19:24:38.242 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-01T19:24:38.242 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-01T19:24:38.242 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-01T19:24:38.242 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-01T19:24:38.242 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-01T19:24:38.242 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-01T19:24:38.242 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-01T19:24:38.243 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_default_flags": "0", 2024-04-01T19:24:38.243 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-01T19:24:38.243 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_default_min_size": "2", 2024-04-01T19:24:38.243 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-01T19:24:38.243 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_default_pg_num": "32", 2024-04-01T19:24:38.243 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_default_pgp_num": "0", 2024-04-01T19:24:38.243 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-01T19:24:38.243 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_default_read_ratio": "70", 2024-04-01T19:24:38.243 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_default_size": "2", 2024-04-01T19:24:38.243 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_default_type": "replicated", 2024-04-01T19:24:38.243 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-01T19:24:38.243 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-01T19:24:38.244 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_push_per_object_cost": "1000", 2024-04-01T19:24:38.244 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-01T19:24:38.244 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_recover_clone_overlap": "true", 2024-04-01T19:24:38.244 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-01T19:24:38.244 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_recovery_cost": "20971520", 2024-04-01T19:24:38.244 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-01T19:24:38.244 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_recovery_max_active": "0", 2024-04-01T19:24:38.244 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-01T19:24:38.244 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-01T19:24:38.244 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-01T19:24:38.244 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-01T19:24:38.244 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_recovery_max_single_start": "1", 2024-04-01T19:24:38.244 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_recovery_op_priority": "3", 2024-04-01T19:24:38.244 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-01T19:24:38.244 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_recovery_priority": "5", 2024-04-01T19:24:38.245 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-01T19:24:38.245 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_recovery_sleep": "0.000000", 2024-04-01T19:24:38.245 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-01T19:24:38.245 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-01T19:24:38.245 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-01T19:24:38.245 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_repair_during_recovery": "false", 2024-04-01T19:24:38.245 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_requested_scrub_priority": "120", 2024-04-01T19:24:38.245 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-01T19:24:38.245 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-01T19:24:38.245 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_scrub_auto_repair": "false", 2024-04-01T19:24:38.245 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-01T19:24:38.245 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-01T19:24:38.245 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_scrub_begin_hour": "0", 2024-04-01T19:24:38.245 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_scrub_begin_week_day": "0", 2024-04-01T19:24:38.246 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_scrub_chunk_max": "25", 2024-04-01T19:24:38.246 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_scrub_chunk_min": "5", 2024-04-01T19:24:38.246 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_scrub_cost": "52428800", 2024-04-01T19:24:38.246 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-04-01T19:24:38.246 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_scrub_during_recovery": "false", 2024-04-01T19:24:38.246 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_scrub_end_hour": "0", 2024-04-01T19:24:38.246 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_scrub_end_week_day": "0", 2024-04-01T19:24:38.246 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_scrub_event_cost": "4096", 2024-04-01T19:24:38.246 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-01T19:24:38.246 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-01T19:24:38.246 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_scrub_invalid_stats": "true", 2024-04-01T19:24:38.246 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-01T19:24:38.246 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-01T19:24:38.247 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_scrub_max_preemptions": "5", 2024-04-01T19:24:38.247 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-01T19:24:38.247 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_scrub_priority": "5", 2024-04-01T19:24:38.247 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_scrub_reservation_timeout": "300000", 2024-04-01T19:24:38.247 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_scrub_sleep": "0.000000", 2024-04-01T19:24:38.247 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-01T19:24:38.247 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-01T19:24:38.247 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-01T19:24:38.247 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-04-01T19:24:38.247 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_skip_data_digest": "false", 2024-04-01T19:24:38.247 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_smart_report_timeout": "5", 2024-04-01T19:24:38.247 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_snap_trim_cost": "1048576", 2024-04-01T19:24:38.247 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_snap_trim_priority": "5", 2024-04-01T19:24:38.248 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-01T19:24:38.248 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-01T19:24:38.248 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-01T19:24:38.248 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-01T19:24:38.248 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-01T19:24:38.248 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-01T19:24:38.248 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-01T19:24:38.248 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_target_transaction_size": "30", 2024-04-01T19:24:38.248 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-01T19:24:38.248 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-01T19:24:38.248 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-01T19:24:38.248 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-01T19:24:38.248 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-01T19:24:38.248 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-01T19:24:38.249 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-01T19:24:38.249 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-01T19:24:38.249 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-01T19:24:38.249 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-01T19:24:38.249 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_tracing": "false", 2024-04-01T19:24:38.249 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_use_stale_snap": "false", 2024-04-01T19:24:38.249 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-01T19:24:38.249 INFO:teuthology.orchestra.run.smithi022.stdout: "osdc_blkin_trace_all": "false", 2024-04-01T19:24:38.249 INFO:teuthology.orchestra.run.smithi022.stdout: "paxos_kill_at": "0", 2024-04-01T19:24:38.249 INFO:teuthology.orchestra.run.smithi022.stdout: "paxos_max_join_drift": "10", 2024-04-01T19:24:38.249 INFO:teuthology.orchestra.run.smithi022.stdout: "paxos_min": "500", 2024-04-01T19:24:38.249 INFO:teuthology.orchestra.run.smithi022.stdout: "paxos_min_wait": "0.050000", 2024-04-01T19:24:38.249 INFO:teuthology.orchestra.run.smithi022.stdout: "paxos_propose_interval": "1.000000", 2024-04-01T19:24:38.249 INFO:teuthology.orchestra.run.smithi022.stdout: "paxos_service_trim_max": "500", 2024-04-01T19:24:38.250 INFO:teuthology.orchestra.run.smithi022.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-01T19:24:38.250 INFO:teuthology.orchestra.run.smithi022.stdout: "paxos_service_trim_min": "10", 2024-04-01T19:24:38.250 INFO:teuthology.orchestra.run.smithi022.stdout: "paxos_stash_full_interval": "25", 2024-04-01T19:24:38.250 INFO:teuthology.orchestra.run.smithi022.stdout: "paxos_trim_max": "500", 2024-04-01T19:24:38.250 INFO:teuthology.orchestra.run.smithi022.stdout: "paxos_trim_min": "250", 2024-04-01T19:24:38.250 INFO:teuthology.orchestra.run.smithi022.stdout: "perf": "true", 2024-04-01T19:24:38.250 INFO:teuthology.orchestra.run.smithi022.stdout: "pid_file": "", 2024-04-01T19:24:38.250 INFO:teuthology.orchestra.run.smithi022.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-01T19:24:38.250 INFO:teuthology.orchestra.run.smithi022.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-04-01T19:24:38.250 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "-", 2024-04-01T19:24:38.250 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrv": "", 2024-04-01T19:24:38.250 INFO:teuthology.orchestra.run.smithi022.stdout: "public_bind_addr": "-", 2024-04-01T19:24:38.250 INFO:teuthology.orchestra.run.smithi022.stdout: "public_network": "", 2024-04-01T19:24:38.250 INFO:teuthology.orchestra.run.smithi022.stdout: "public_network_interface": "", 2024-04-01T19:24:38.251 INFO:teuthology.orchestra.run.smithi022.stdout: "qat_compressor_enabled": "false", 2024-04-01T19:24:38.251 INFO:teuthology.orchestra.run.smithi022.stdout: "qat_compressor_session_max_number": "256", 2024-04-01T19:24:38.251 INFO:teuthology.orchestra.run.smithi022.stdout: "rados_mon_op_timeout": "0", 2024-04-01T19:24:38.251 INFO:teuthology.orchestra.run.smithi022.stdout: "rados_osd_op_timeout": "0", 2024-04-01T19:24:38.251 INFO:teuthology.orchestra.run.smithi022.stdout: "rados_tracing": "false", 2024-04-01T19:24:38.251 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_atime_update_interval": "60", 2024-04-01T19:24:38.251 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-01T19:24:38.251 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_balance_parent_reads": "false", 2024-04-01T19:24:38.251 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_balance_snap_reads": "false", 2024-04-01T19:24:38.251 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_blkin_trace_all": "false", 2024-04-01T19:24:38.251 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-01T19:24:38.251 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-01T19:24:38.251 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_cache": "true", 2024-04-01T19:24:38.251 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-01T19:24:38.251 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-01T19:24:38.252 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-01T19:24:38.252 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-01T19:24:38.252 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_cache_policy": "writearound", 2024-04-01T19:24:38.252 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_cache_size": "33554432", 2024-04-01T19:24:38.252 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-01T19:24:38.252 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-01T19:24:38.252 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_clone_copy_on_read": "false", 2024-04-01T19:24:38.252 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_compression_hint": "none", 2024-04-01T19:24:38.252 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_concurrent_management_ops": "10", 2024-04-01T19:24:38.252 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-01T19:24:38.252 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_default_clone_format": "auto", 2024-04-01T19:24:38.252 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_default_data_pool": "", 2024-04-01T19:24:38.252 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_default_features": "61", 2024-04-01T19:24:38.252 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_default_format": "2", 2024-04-01T19:24:38.253 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_default_map_options": "", 2024-04-01T19:24:38.253 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_default_order": "22", 2024-04-01T19:24:38.253 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_default_pool": "rbd", 2024-04-01T19:24:38.253 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-01T19:24:38.253 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_default_stripe_count": "0", 2024-04-01T19:24:38.253 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_default_stripe_unit": "0", 2024-04-01T19:24:38.253 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-01T19:24:38.253 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-01T19:24:38.253 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-01T19:24:38.253 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_enable_alloc_hint": "true", 2024-04-01T19:24:38.253 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-01T19:24:38.253 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_io_scheduler": "simple", 2024-04-01T19:24:38.253 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-01T19:24:38.253 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-01T19:24:38.254 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-01T19:24:38.254 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-01T19:24:38.254 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-01T19:24:38.254 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-01T19:24:38.254 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-01T19:24:38.254 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-01T19:24:38.254 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-01T19:24:38.254 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_journal_order": "24", 2024-04-01T19:24:38.254 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_journal_pool": "", 2024-04-01T19:24:38.254 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_journal_splay_width": "4", 2024-04-01T19:24:38.254 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_localize_parent_reads": "false", 2024-04-01T19:24:38.255 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_localize_snap_reads": "false", 2024-04-01T19:24:38.255 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-01T19:24:38.255 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-01T19:24:38.255 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-01T19:24:38.255 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-01T19:24:38.255 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-01T19:24:38.255 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-01T19:24:38.255 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-01T19:24:38.255 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-01T19:24:38.255 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-01T19:24:38.255 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-01T19:24:38.255 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-01T19:24:38.255 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-01T19:24:38.255 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-01T19:24:38.256 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-01T19:24:38.256 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-01T19:24:38.256 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-01T19:24:38.256 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-01T19:24:38.256 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-01T19:24:38.256 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-01T19:24:38.256 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-01T19:24:38.256 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-01T19:24:38.256 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-01T19:24:38.256 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-01T19:24:38.256 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-01T19:24:38.256 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-01T19:24:38.256 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-01T19:24:38.257 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-01T19:24:38.257 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-01T19:24:38.257 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-01T19:24:38.257 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-01T19:24:38.257 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-01T19:24:38.257 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_mtime_update_interval": "60", 2024-04-01T19:24:38.257 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_non_blocking_aio": "true", 2024-04-01T19:24:38.257 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_op_thread_timeout": "60", 2024-04-01T19:24:38.257 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_op_threads": "1", 2024-04-01T19:24:38.257 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_parent_cache_enabled": "false", 2024-04-01T19:24:38.257 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-01T19:24:38.257 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-01T19:24:38.257 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-01T19:24:38.257 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_plugins": "", 2024-04-01T19:24:38.257 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_qos_bps_burst": "0", 2024-04-01T19:24:38.258 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-01T19:24:38.258 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_qos_bps_limit": "0", 2024-04-01T19:24:38.258 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_qos_exclude_ops": "0", 2024-04-01T19:24:38.258 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_qos_iops_burst": "0", 2024-04-01T19:24:38.258 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-01T19:24:38.258 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_qos_iops_limit": "0", 2024-04-01T19:24:38.258 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-01T19:24:38.258 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-01T19:24:38.259 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-01T19:24:38.259 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-01T19:24:38.259 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-01T19:24:38.259 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-01T19:24:38.259 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-01T19:24:38.259 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-01T19:24:38.259 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-01T19:24:38.259 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-01T19:24:38.259 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-01T19:24:38.259 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-01T19:24:38.259 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-01T19:24:38.259 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-01T19:24:38.259 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_read_from_replica_policy": "default", 2024-04-01T19:24:38.259 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-01T19:24:38.260 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-01T19:24:38.260 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-01T19:24:38.260 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-01T19:24:38.260 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_skip_partial_discard": "true", 2024-04-01T19:24:38.260 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-01T19:24:38.260 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_tracing": "false", 2024-04-01T19:24:38.260 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_validate_names": "true", 2024-04-01T19:24:38.260 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_validate_pool": "true", 2024-04-01T19:24:38.260 INFO:teuthology.orchestra.run.smithi022.stdout: "restapi_base_url": "", 2024-04-01T19:24:38.260 INFO:teuthology.orchestra.run.smithi022.stdout: "restapi_log_level": "", 2024-04-01T19:24:38.260 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_acl_grants_max_num": "100", 2024-04-01T19:24:38.260 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_admin_entry": "admin", 2024-04-01T19:24:38.260 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-01T19:24:38.261 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_backend_store": "rados", 2024-04-01T19:24:38.261 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_barbican_url": "", 2024-04-01T19:24:38.261 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_beast_enable_async": "true", 2024-04-01T19:24:38.261 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_bucket_counters_cache": "false", 2024-04-01T19:24:38.261 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-04-01T19:24:38.261 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-01T19:24:38.261 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-01T19:24:38.261 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-01T19:24:38.261 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-01T19:24:38.261 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-01T19:24:38.261 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-01T19:24:38.261 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-01T19:24:38.261 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_cache_enabled": "true", 2024-04-01T19:24:38.261 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_cache_expiry_interval": "900", 2024-04-01T19:24:38.261 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_cache_lru_size": "10000", 2024-04-01T19:24:38.262 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_config_store": "rados", 2024-04-01T19:24:38.262 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_content_length_compat": "false", 2024-04-01T19:24:38.262 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_copy_obj_progress": "true", 2024-04-01T19:24:38.262 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-01T19:24:38.262 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_cors_rules_max_num": "100", 2024-04-01T19:24:38.262 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_cross_domain_policy": "", 2024-04-01T19:24:38.262 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-01T19:24:38.262 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_kmip_addr": "", 2024-04-01T19:24:38.262 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-01T19:24:38.262 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-01T19:24:38.262 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-01T19:24:38.262 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-01T19:24:38.262 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_kmip_password": "", 2024-04-01T19:24:38.263 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-01T19:24:38.263 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_kmip_username": "", 2024-04-01T19:24:38.263 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_require_ssl": "true", 2024-04-01T19:24:38.263 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-01T19:24:38.263 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-01T19:24:38.263 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-01T19:24:38.263 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-01T19:24:38.263 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-01T19:24:38.263 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-01T19:24:38.263 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-01T19:24:38.263 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-01T19:24:38.263 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-01T19:24:38.263 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-01T19:24:38.264 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-01T19:24:38.264 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-01T19:24:38.264 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-01T19:24:38.264 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-01T19:24:38.264 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-01T19:24:38.264 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_vault_addr": "", 2024-04-01T19:24:38.264 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_vault_auth": "token", 2024-04-01T19:24:38.264 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_vault_namespace": "", 2024-04-01T19:24:38.265 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_vault_prefix": "", 2024-04-01T19:24:38.265 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-01T19:24:38.265 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-01T19:24:38.265 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-01T19:24:38.265 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-01T19:24:38.265 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_vault_token_file": "", 2024-04-01T19:24:38.265 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-01T19:24:38.265 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_curl_buffersize": "524288", 2024-04-01T19:24:38.265 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-01T19:24:38.265 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_curl_low_speed_time": "300", 2024-04-01T19:24:38.265 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-01T19:24:38.265 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-01T19:24:38.265 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-01T19:24:38.265 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-01T19:24:38.266 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-01T19:24:38.266 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-01T19:24:38.266 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-01T19:24:38.266 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-01T19:24:38.266 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-01T19:24:38.266 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-01T19:24:38.266 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_d4n_host": "127.0.0.1", 2024-04-01T19:24:38.266 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_d4n_port": "6379", 2024-04-01T19:24:38.266 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-01T19:24:38.266 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_data_log_changes_size": "1000", 2024-04-01T19:24:38.266 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_data_log_num_shards": "128", 2024-04-01T19:24:38.266 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-01T19:24:38.266 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_data_log_window": "30", 2024-04-01T19:24:38.266 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-01T19:24:38.267 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-01T19:24:38.267 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-01T19:24:38.267 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-04-01T19:24:38.267 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-01T19:24:38.267 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-01T19:24:38.267 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-01T19:24:38.267 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-01T19:24:38.267 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-01T19:24:38.267 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-01T19:24:38.267 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-01T19:24:38.267 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-01T19:24:38.267 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-01T19:24:38.267 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-01T19:24:38.267 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-01T19:24:38.267 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-01T19:24:38.267 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-01T19:24:38.268 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-01T19:24:38.268 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-01T19:24:38.268 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-01T19:24:38.268 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-01T19:24:38.268 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-01T19:24:38.268 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-01T19:24:38.268 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-01T19:24:38.268 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-01T19:24:38.268 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_dns_name": "", 2024-04-01T19:24:38.268 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_dns_s3website_name": "", 2024-04-01T19:24:38.268 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_dynamic_resharding": "true", 2024-04-01T19:24:38.268 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-01T19:24:38.268 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_enable_gc_threads": "true", 2024-04-01T19:24:38.269 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_enable_lc_threads": "true", 2024-04-01T19:24:38.269 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_enable_ops_log": "false", 2024-04-01T19:24:38.269 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_enable_quota_threads": "true", 2024-04-01T19:24:38.269 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_enable_static_website": "false", 2024-04-01T19:24:38.269 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_enable_usage_log": "false", 2024-04-01T19:24:38.269 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_enforce_swift_acls": "true", 2024-04-01T19:24:38.269 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_exit_timeout_secs": "120", 2024-04-01T19:24:38.269 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_expose_bucket": "false", 2024-04-01T19:24:38.269 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_extended_http_attrs": "", 2024-04-01T19:24:38.269 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_filter": "none", 2024-04-01T19:24:38.269 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-01T19:24:38.269 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_frontends": "beast port=7480", 2024-04-01T19:24:38.269 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-01T19:24:38.269 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_gc_max_deferred": "50", 2024-04-01T19:24:38.269 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-01T19:24:38.270 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_gc_max_objs": "32", 2024-04-01T19:24:38.270 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-01T19:24:38.270 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-01T19:24:38.270 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-01T19:24:38.270 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-01T19:24:38.270 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_gc_processor_period": "3600", 2024-04-01T19:24:38.270 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-01T19:24:38.270 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-01T19:24:38.270 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-01T19:24:38.270 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-01T19:24:38.270 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_init_timeout": "300", 2024-04-01T19:24:38.270 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-01T19:24:38.271 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-01T19:24:38.271 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_kafka_connection_idle": "300", 2024-04-01T19:24:38.271 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_kafka_message_timeout": "5000", 2024-04-01T19:24:38.271 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_kafka_sleep_timeout": "10", 2024-04-01T19:24:38.271 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-01T19:24:38.271 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-04-01T19:24:38.271 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-01T19:24:38.271 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_keystone_admin_domain": "", 2024-04-01T19:24:38.271 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_keystone_admin_password": "", 2024-04-01T19:24:38.271 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_keystone_admin_password_path": "", 2024-04-01T19:24:38.271 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_keystone_admin_project": "", 2024-04-01T19:24:38.271 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_keystone_admin_tenant": "", 2024-04-01T19:24:38.271 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_keystone_admin_token": "", 2024-04-01T19:24:38.272 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_keystone_admin_token_path": "", 2024-04-01T19:24:38.272 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_keystone_admin_user": "", 2024-04-01T19:24:38.272 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_keystone_api_version": "2", 2024-04-01T19:24:38.272 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_keystone_barbican_domain": "", 2024-04-01T19:24:38.272 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_keystone_barbican_password": "", 2024-04-01T19:24:38.272 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_keystone_barbican_project": "", 2024-04-01T19:24:38.272 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-01T19:24:38.272 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_keystone_barbican_user": "", 2024-04-01T19:24:38.272 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-01T19:24:38.272 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-01T19:24:38.272 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-01T19:24:38.272 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-01T19:24:38.272 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-01T19:24:38.272 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_keystone_url": "", 2024-04-01T19:24:38.273 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-01T19:24:38.273 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_lc_debug_interval": "-1", 2024-04-01T19:24:38.273 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_lc_lock_max_time": "90", 2024-04-01T19:24:38.273 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_lc_max_objs": "32", 2024-04-01T19:24:38.273 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_lc_max_rules": "1000", 2024-04-01T19:24:38.273 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_lc_max_worker": "3", 2024-04-01T19:24:38.273 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-01T19:24:38.273 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_lc_thread_delay": "0", 2024-04-01T19:24:38.273 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-01T19:24:38.273 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_ldap_dnattr": "uid", 2024-04-01T19:24:38.273 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-01T19:24:38.273 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_ldap_searchfilter": "", 2024-04-01T19:24:38.273 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-01T19:24:38.273 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_ldap_uri": "ldaps://", 2024-04-01T19:24:38.273 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-01T19:24:38.274 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-01T19:24:38.274 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-01T19:24:38.274 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_log_http_headers": "", 2024-04-01T19:24:38.274 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-01T19:24:38.274 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-01T19:24:38.274 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_log_object_name_utc": "false", 2024-04-01T19:24:38.274 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-04-01T19:24:38.274 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-04-01T19:24:38.274 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_max_attr_name_len": "0", 2024-04-01T19:24:38.274 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_max_attr_size": "0", 2024-04-01T19:24:38.274 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-01T19:24:38.274 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_max_chunk_size": "4194304", 2024-04-01T19:24:38.274 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-01T19:24:38.275 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-01T19:24:38.275 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-01T19:24:38.275 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_max_listing_results": "1000", 2024-04-01T19:24:38.275 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_max_notify_retries": "10", 2024-04-01T19:24:38.275 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-01T19:24:38.275 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_max_put_param_size": "1048576", 2024-04-01T19:24:38.275 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_max_put_size": "5368709120", 2024-04-01T19:24:38.275 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_max_slo_entries": "1000", 2024-04-01T19:24:38.275 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_md_log_max_shards": "64", 2024-04-01T19:24:38.275 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-01T19:24:38.275 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-01T19:24:38.275 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-01T19:24:38.276 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-01T19:24:38.276 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_mp_lock_max_time": "600", 2024-04-01T19:24:38.276 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-01T19:24:38.276 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-01T19:24:38.276 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-01T19:24:38.276 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-01T19:24:38.276 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-01T19:24:38.276 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-01T19:24:38.276 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-01T19:24:38.276 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-01T19:24:38.276 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_nfs_max_gc": "300", 2024-04-01T19:24:38.277 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-01T19:24:38.277 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-01T19:24:38.277 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-01T19:24:38.277 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-01T19:24:38.277 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-01T19:24:38.277 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-01T19:24:38.277 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-01T19:24:38.277 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_num_async_rados_threads": "32", 2024-04-01T19:24:38.277 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_num_control_oids": "8", 2024-04-01T19:24:38.277 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_numa_node": "-1", 2024-04-01T19:24:38.277 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-01T19:24:38.277 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-01T19:24:38.277 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_objexp_chunk_size": "100", 2024-04-01T19:24:38.277 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_objexp_gc_interval": "600", 2024-04-01T19:24:38.277 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-01T19:24:38.278 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-01T19:24:38.278 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-01T19:24:38.278 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_op_thread_timeout": "600", 2024-04-01T19:24:38.278 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_op_tracing": "false", 2024-04-01T19:24:38.278 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_opa_token": "", 2024-04-01T19:24:38.278 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_opa_url": "", 2024-04-01T19:24:38.278 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_opa_verify_ssl": "true", 2024-04-01T19:24:38.278 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-01T19:24:38.278 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-01T19:24:38.278 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_ops_log_rados": "false", 2024-04-01T19:24:38.278 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_ops_log_socket_path": "", 2024-04-01T19:24:38.278 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-01T19:24:38.278 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-01T19:24:38.279 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-01T19:24:38.279 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_period_push_interval": "2.000000", 2024-04-01T19:24:38.279 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-01T19:24:38.279 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-01T19:24:38.279 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-01T19:24:38.279 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-04-01T19:24:38.279 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_posix_cache_lanes": "3", 2024-04-01T19:24:38.279 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-04-01T19:24:38.279 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_posix_cache_max_buckets": "100", 2024-04-01T19:24:38.279 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_posix_cache_partitions": "3", 2024-04-01T19:24:38.279 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-04-01T19:24:38.279 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_print_continue": "true", 2024-04-01T19:24:38.279 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-01T19:24:38.279 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-01T19:24:38.279 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-01T19:24:38.279 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-01T19:24:38.280 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-01T19:24:38.280 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_rados_tracing": "false", 2024-04-01T19:24:38.280 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_realm": "", 2024-04-01T19:24:38.280 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_realm_id": "", 2024-04-01T19:24:38.280 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-01T19:24:38.280 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_region": "", 2024-04-01T19:24:38.280 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-01T19:24:38.280 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-01T19:24:38.280 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-01T19:24:38.280 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-01T19:24:38.280 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_request_uri": "", 2024-04-01T19:24:38.280 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_reshard_batch_size": "64", 2024-04-01T19:24:38.280 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-01T19:24:38.280 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_reshard_max_aio": "128", 2024-04-01T19:24:38.281 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_reshard_num_logs": "16", 2024-04-01T19:24:38.281 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_reshard_thread_interval": "600", 2024-04-01T19:24:38.281 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_resolve_cname": "false", 2024-04-01T19:24:38.281 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-01T19:24:38.281 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_run_sync_thread": "true", 2024-04-01T19:24:38.281 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-04-01T19:24:38.281 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-01T19:24:38.281 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-01T19:24:38.281 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-01T19:24:38.281 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-01T19:24:38.281 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-01T19:24:38.281 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-01T19:24:38.281 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-01T19:24:38.281 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-01T19:24:38.282 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_scheduler_type": "throttler", 2024-04-01T19:24:38.282 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_script_uri": "", 2024-04-01T19:24:38.282 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_service_provider_name": "", 2024-04-01T19:24:38.282 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-01T19:24:38.282 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_sts_client_id": "", 2024-04-01T19:24:38.282 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_sts_client_secret": "", 2024-04-01T19:24:38.282 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_sts_entry": "sts", 2024-04-01T19:24:38.282 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_sts_key": "sts", 2024-04-01T19:24:38.282 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-01T19:24:38.282 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_sts_min_session_duration": "900", 2024-04-01T19:24:38.282 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_sts_token_introspection_url": "", 2024-04-01T19:24:38.283 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_swift_account_in_url": "false", 2024-04-01T19:24:38.283 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_swift_auth_entry": "auth", 2024-04-01T19:24:38.283 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_swift_auth_url": "", 2024-04-01T19:24:38.283 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_swift_custom_header": "", 2024-04-01T19:24:38.283 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-01T19:24:38.283 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_swift_need_stats": "true", 2024-04-01T19:24:38.283 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_swift_tenant_name": "", 2024-04-01T19:24:38.283 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_swift_token_expiration": "86400", 2024-04-01T19:24:38.283 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_swift_url": "", 2024-04-01T19:24:38.283 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_swift_url_prefix": "swift", 2024-04-01T19:24:38.283 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-01T19:24:38.283 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-01T19:24:38.283 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-01T19:24:38.284 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_sync_lease_period": "120", 2024-04-01T19:24:38.284 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-01T19:24:38.284 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-01T19:24:38.284 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-01T19:24:38.284 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-01T19:24:38.284 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-01T19:24:38.284 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-01T19:24:38.284 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-01T19:24:38.284 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-01T19:24:38.284 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-01T19:24:38.284 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_thread_pool_size": "512", 2024-04-01T19:24:38.284 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_topic_persistency_max_retries": "0", 2024-04-01T19:24:38.284 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-04-01T19:24:38.285 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-04-01T19:24:38.285 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_topic_require_publish_policy": "false", 2024-04-01T19:24:38.285 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_torrent_comment": "", 2024-04-01T19:24:38.285 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_torrent_createby": "", 2024-04-01T19:24:38.285 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_torrent_encoding": "", 2024-04-01T19:24:38.285 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_torrent_flag": "false", 2024-04-01T19:24:38.285 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_torrent_max_size": "5368709120", 2024-04-01T19:24:38.285 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_torrent_origin": "", 2024-04-01T19:24:38.285 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-01T19:24:38.285 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_torrent_tracker": "", 2024-04-01T19:24:38.285 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_trust_forwarded_https": "false", 2024-04-01T19:24:38.285 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-01T19:24:38.285 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-01T19:24:38.285 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_usage_max_shards": "32", 2024-04-01T19:24:38.285 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_usage_max_user_shards": "1", 2024-04-01T19:24:38.286 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_use_opa_authz": "false", 2024-04-01T19:24:38.286 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_user_counters_cache": "false", 2024-04-01T19:24:38.286 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_user_counters_cache_size": "10000", 2024-04-01T19:24:38.286 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-01T19:24:38.286 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-01T19:24:38.286 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_user_max_buckets": "1000", 2024-04-01T19:24:38.286 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_user_policies_max_num": "100", 2024-04-01T19:24:38.286 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-01T19:24:38.286 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-01T19:24:38.286 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-01T19:24:38.286 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-01T19:24:38.286 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_user_unique_email": "true", 2024-04-01T19:24:38.286 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_verify_ssl": "true", 2024-04-01T19:24:38.286 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-01T19:24:38.286 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_zone": "", 2024-04-01T19:24:38.287 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_zone_id": "", 2024-04-01T19:24:38.287 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-01T19:24:38.287 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_zonegroup": "", 2024-04-01T19:24:38.287 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_zonegroup_id": "", 2024-04-01T19:24:38.287 INFO:teuthology.orchestra.run.smithi022.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-01T19:24:38.287 INFO:teuthology.orchestra.run.smithi022.stdout: "rgwlc_auto_session_clear": "true", 2024-04-01T19:24:38.287 INFO:teuthology.orchestra.run.smithi022.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-01T19:24:38.287 INFO:teuthology.orchestra.run.smithi022.stdout: "rocksdb_block_size": "4096", 2024-04-01T19:24:38.287 INFO:teuthology.orchestra.run.smithi022.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-01T19:24:38.287 INFO:teuthology.orchestra.run.smithi022.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-01T19:24:38.287 INFO:teuthology.orchestra.run.smithi022.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-01T19:24:38.287 INFO:teuthology.orchestra.run.smithi022.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-01T19:24:38.287 INFO:teuthology.orchestra.run.smithi022.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-01T19:24:38.287 INFO:teuthology.orchestra.run.smithi022.stdout: "rocksdb_cache_size": "536870912", 2024-04-01T19:24:38.287 INFO:teuthology.orchestra.run.smithi022.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-01T19:24:38.288 INFO:teuthology.orchestra.run.smithi022.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-01T19:24:38.288 INFO:teuthology.orchestra.run.smithi022.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-01T19:24:38.288 INFO:teuthology.orchestra.run.smithi022.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-01T19:24:38.288 INFO:teuthology.orchestra.run.smithi022.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-01T19:24:38.288 INFO:teuthology.orchestra.run.smithi022.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-01T19:24:38.288 INFO:teuthology.orchestra.run.smithi022.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-01T19:24:38.288 INFO:teuthology.orchestra.run.smithi022.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-01T19:24:38.288 INFO:teuthology.orchestra.run.smithi022.stdout: "rocksdb_index_type": "binary_search", 2024-04-01T19:24:38.288 INFO:teuthology.orchestra.run.smithi022.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-01T19:24:38.288 INFO:teuthology.orchestra.run.smithi022.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-01T19:24:38.288 INFO:teuthology.orchestra.run.smithi022.stdout: "rocksdb_partition_filters": "false", 2024-04-01T19:24:38.288 INFO:teuthology.orchestra.run.smithi022.stdout: "rocksdb_perf": "false", 2024-04-01T19:24:38.288 INFO:teuthology.orchestra.run.smithi022.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-01T19:24:38.288 INFO:teuthology.orchestra.run.smithi022.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-01T19:24:38.289 INFO:teuthology.orchestra.run.smithi022.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-01T19:24:38.289 INFO:teuthology.orchestra.run.smithi022.stdout: "run_dir": "/var/run/ceph", 2024-04-01T19:24:38.289 INFO:teuthology.orchestra.run.smithi022.stdout: "seastore_block_create": "true", 2024-04-01T19:24:38.289 INFO:teuthology.orchestra.run.smithi022.stdout: "seastore_cache_lru_size": "67108864", 2024-04-01T19:24:38.289 INFO:teuthology.orchestra.run.smithi022.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-01T19:24:38.289 INFO:teuthology.orchestra.run.smithi022.stdout: "seastore_data_delta_based_overwrite": "0", 2024-04-01T19:24:38.289 INFO:teuthology.orchestra.run.smithi022.stdout: "seastore_default_max_object_size": "16777216", 2024-04-01T19:24:38.289 INFO:teuthology.orchestra.run.smithi022.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-01T19:24:38.289 INFO:teuthology.orchestra.run.smithi022.stdout: "seastore_device_size": "53687091200", 2024-04-01T19:24:38.289 INFO:teuthology.orchestra.run.smithi022.stdout: "seastore_journal_batch_capacity": "16", 2024-04-01T19:24:38.289 INFO:teuthology.orchestra.run.smithi022.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-01T19:24:38.289 INFO:teuthology.orchestra.run.smithi022.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-01T19:24:38.289 INFO:teuthology.orchestra.run.smithi022.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-01T19:24:38.289 INFO:teuthology.orchestra.run.smithi022.stdout: "seastore_main_device_type": "SSD", 2024-04-01T19:24:38.289 INFO:teuthology.orchestra.run.smithi022.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-01T19:24:38.289 INFO:teuthology.orchestra.run.smithi022.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-01T19:24:38.290 INFO:teuthology.orchestra.run.smithi022.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-01T19:24:38.290 INFO:teuthology.orchestra.run.smithi022.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-01T19:24:38.290 INFO:teuthology.orchestra.run.smithi022.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-01T19:24:38.290 INFO:teuthology.orchestra.run.smithi022.stdout: "seastore_segment_size": "67108864", 2024-04-01T19:24:38.290 INFO:teuthology.orchestra.run.smithi022.stdout: "set_keepcaps": "false", 2024-04-01T19:24:38.290 INFO:teuthology.orchestra.run.smithi022.stdout: "setgroup": "ceph", 2024-04-01T19:24:38.290 INFO:teuthology.orchestra.run.smithi022.stdout: "setuser": "ceph", 2024-04-01T19:24:38.290 INFO:teuthology.orchestra.run.smithi022.stdout: "setuser_match_path": "", 2024-04-01T19:24:38.290 INFO:teuthology.orchestra.run.smithi022.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-01T19:24:38.290 INFO:teuthology.orchestra.run.smithi022.stdout: "thp": "false", 2024-04-01T19:24:38.290 INFO:teuthology.orchestra.run.smithi022.stdout: "threadpool_default_timeout": "60", 2024-04-01T19:24:38.290 INFO:teuthology.orchestra.run.smithi022.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-01T19:24:38.290 INFO:teuthology.orchestra.run.smithi022.stdout: "throttler_perf_counter": "true" 2024-04-01T19:24:38.290 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:24:38.291 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:37 smithi062 ceph-mon[44211]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:38.291 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:37 smithi062 ceph-mon[44211]: osdmap e103: 12 total, 12 up, 12 in 2024-04-01T19:24:38.831 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-01T19:24:39.116 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:24:40.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:39 smithi022 ceph-mon[39439]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:40.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:39 smithi188 ceph-mon[43939]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:40.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:39 smithi062 ceph-mon[44211]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:41.010 INFO:teuthology.orchestra.run.smithi022.stdout:mon.a: {} 2024-04-01T19:24:41.021 INFO:teuthology.orchestra.run.smithi022.stdout:mon.c: {} 2024-04-01T19:24:41.031 INFO:teuthology.orchestra.run.smithi022.stdout:mon.b: {} 2024-04-01T19:24:41.032 INFO:teuthology.orchestra.run.smithi022.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-01T19:24:41.033 INFO:teuthology.orchestra.run.smithi022.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-01T19:24:41.033 INFO:teuthology.orchestra.run.smithi022.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-01T19:24:41.683 INFO:teuthology.run_tasks:Running task full_sequential... 2024-04-01T19:24:41.694 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-04-01T19:24:41.704 INFO:tasks.radosbench:Beginning radosbench... 2024-04-01T19:24:41.705 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_0 2024-04-01T19:24:41.705 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pool create unique_pool_0 16 2024-04-01T19:24:41.705 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-01T19:24:41.705 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] 2024-04-01T19:24:41.705 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-01T19:24:41.706 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-04-01T19:24:41.706 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-01T19:24:41.706 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-01T19:24:41.706 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 config set filestore_inject_stall 3 2024-04-01T19:24:41.706 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-01T19:24:41.707 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:24:41.707 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-01T19:24:41.707 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:24:41.707 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-01T19:24:41.708 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_ops_in_flight 2024-04-01T19:24:41.708 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-01T19:24:41.708 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:24:41.743 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:41.764 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:24:41.767 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:41.767 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:24:41.868 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:24:41.903 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:41.928 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:24:41.930 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:41.931 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:24:42.032 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:24:42.062 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:41 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T19:24:42.062 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:41 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T19:24:42.062 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:41 smithi188 ceph-mon[43939]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:42.062 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:41 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1101844956' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-01T19:24:42.064 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:42.080 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:24:42.085 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:24:42.085 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:24:42.088 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:42.089 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:24:42.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:41 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T19:24:42.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:41 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T19:24:42.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:41 smithi022 ceph-mon[39439]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:42.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:41 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1101844956' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-01T19:24:42.130 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:24:42.131 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:24:42.189 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:24:42.218 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:42.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:41 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T19:24:42.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:41 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T19:24:42.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:41 smithi062 ceph-mon[44211]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:42.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:41 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1101844956' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-01T19:24:42.343 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:24:42.348 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:42.349 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:24:42.450 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:24:42.483 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:42.505 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:24:42.507 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:42.508 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:24:42.609 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:24:42.640 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:42.661 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:24:42.663 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:42.664 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:24:42.765 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:24:42.797 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:42.818 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:24:42.821 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:42.822 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:24:42.923 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:24:42.956 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:42.979 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:24:42.981 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:42.982 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:24:43.083 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:24:43.113 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:43.186 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:24:43.189 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:43.189 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:24:43.290 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:24:43.317 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:44.045 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:24:44.047 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:43 smithi022 ceph-mon[39439]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:44.049 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:44.049 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:24:44.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:43 smithi188 ceph-mon[43939]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:44.149 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:24:44.181 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:43 smithi062 ceph-mon[44211]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:44.183 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:44.205 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:24:44.208 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:44.209 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:24:44.310 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:24:44.338 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:44.487 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:24:44.489 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:44.490 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:24:44.591 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:24:44.624 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:44.645 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:24:44.648 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:44.648 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:24:44.749 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:24:44.777 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:44.799 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:24:44.802 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:44.802 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:24:44.903 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:24:44.936 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:44.958 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:24:44.961 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:44.961 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:24:45.062 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:24:45.094 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:45.115 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:24:45.117 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:45.118 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:24:45.219 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:24:45.252 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:45.273 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:24:45.275 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:45.276 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:24:45.377 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:24:45.409 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:45.431 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:24:45.434 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:45.435 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:24:45.536 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:24:45.565 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:45.585 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:24:45.588 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:45.588 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:24:45.689 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:24:45.712 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:24:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:24:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 0 2024-04-01T19:24:45.713 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:24:45.721 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:45.920 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:24:45.922 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:45.922 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:24:46.023 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:24:46.055 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:46.065 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:24:46.076 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:24:46.078 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:45 smithi188 ceph-mon[43939]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:46.079 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:46.080 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:24:46.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:45 smithi022 ceph-mon[39439]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:46.181 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:24:46.209 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:46.246 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:24:46.253 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:46.253 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:24:46.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:45 smithi062 ceph-mon[44211]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:46.354 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:24:46.383 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:46.691 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_blocked_ops 2024-04-01T19:24:46.822 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:24:46.945 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:46 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/240882550' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:24:47.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:46 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/240882550' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:24:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:46 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/240882550' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:24:47.432 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:24:47.435 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:47.437 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:24:47.539 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:24:47.572 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:47.594 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:24:47.596 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:47.597 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:24:47.698 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:24:47.730 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:47.752 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:24:47.755 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:47.755 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:24:47.856 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:24:47.886 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:48.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:47 smithi062 ceph-mon[44211]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:48.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:47 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:24:48.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:47 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/240882550' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:24:48.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:47 smithi062 ceph-mon[44211]: osdmap e104: 12 total, 12 up, 12 in 2024-04-01T19:24:48.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:47 smithi022 ceph-mon[39439]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:48.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:47 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:24:48.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:47 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/240882550' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:24:48.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:47 smithi022 ceph-mon[39439]: osdmap e104: 12 total, 12 up, 12 in 2024-04-01T19:24:48.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:47 smithi188 ceph-mon[43939]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:48.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:47 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:24:48.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:47 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/240882550' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:24:48.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:47 smithi188 ceph-mon[43939]: osdmap e104: 12 total, 12 up, 12 in 2024-04-01T19:24:48.235 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:24:48.238 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:48.238 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:24:48.339 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:24:48.371 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:48.391 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:24:48.394 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:48.395 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:24:48.496 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:24:48.524 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:48.544 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:24:48.547 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:48.547 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:24:48.648 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:24:48.676 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:48.695 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:24:48.697 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:48.698 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:24:48.799 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:24:48.826 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:48.845 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:24:48.848 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:48.848 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:24:48.949 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:24:48.982 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:49.005 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:24:49.007 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:49.008 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:24:49.108 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:24:49.173 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:48 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:24:49.174 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:48 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:24:49.174 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:48 smithi188 ceph-mon[43939]: osdmap e105: 12 total, 12 up, 12 in 2024-04-01T19:24:49.174 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:48 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:24:49.174 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:48 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:24:49.174 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:48 smithi022 ceph-mon[39439]: osdmap e105: 12 total, 12 up, 12 in 2024-04-01T19:24:49.204 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:48 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:24:49.205 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:48 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:24:49.205 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:48 smithi062 ceph-mon[44211]: osdmap e105: 12 total, 12 up, 12 in 2024-04-01T19:24:49.207 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:49.232 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:24:49.234 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:49.234 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:24:49.335 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:24:49.366 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:49.387 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:24:49.389 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:49.389 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:24:49.490 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:24:49.530 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:49.734 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:24:49.738 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:49.738 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:24:49.839 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:24:49.871 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:49.892 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:24:49.895 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:49.895 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:24:49.996 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:24:50.030 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:50.051 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:24:50.053 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:50.054 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:24:50.090 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:24:50.090 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:24:50.091 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:24:50.103 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:24:50.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:49 smithi022 ceph-mon[39439]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:50.123 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:24:50.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:49 smithi188 ceph-mon[43939]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:50.144 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:24:50.155 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:24:50.164 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:24:50.185 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:50.187 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:24:50.218 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:24:50.239 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:24:50.259 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:24:50.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:49 smithi062 ceph-mon[44211]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:50.280 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:24:50.281 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:24:50.282 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:24:50.282 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:24:50.282 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:24:50.282 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:24:50.282 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:24:50.282 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:24:50.282 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:24:50.282 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:24:50.282 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:24:50.282 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:24:50.282 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:24:50.642 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:24:50.645 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:50.646 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:24:50.747 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:24:50.780 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:50.801 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:24:50.802 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:24:50.804 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:50.804 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:24:50.836 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'unique_pool_0' created 2024-04-01T19:24:50.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:50 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2953459122' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:24:50.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:50.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:50.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:50.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:50.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:50.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:50.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:50.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:50 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1357401491' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]: dispatch 2024-04-01T19:24:50.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:50.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:50.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:50.905 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:24:50.935 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:51.044 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:24:51.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:50 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2953459122' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:24:51.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:51.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:51.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:51.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:51.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:51.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:51.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:51.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:50 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1357401491' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]: dispatch 2024-04-01T19:24:51.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:51.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:51.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:50 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2953459122' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:24:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:51.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:51.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:51.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:51.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:50 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1357401491' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]: dispatch 2024-04-01T19:24:51.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:51.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:51.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:51.486 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:24:51.489 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:51.490 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:24:51.591 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:24:51.619 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:51.841 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:51.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:51.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:51 smithi022 ceph-mon[39439]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:51.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:51 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1357401491' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]': finished 2024-04-01T19:24:51.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:51 smithi022 ceph-mon[39439]: osdmap e106: 12 total, 12 up, 12 in 2024-04-01T19:24:52.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:52.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:52.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:51 smithi188 ceph-mon[43939]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:52.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:51 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1357401491' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]': finished 2024-04-01T19:24:52.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:51 smithi188 ceph-mon[43939]: osdmap e106: 12 total, 12 up, 12 in 2024-04-01T19:24:52.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:52.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:24:52.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:51 smithi062 ceph-mon[44211]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:52.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:51 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1357401491' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]': finished 2024-04-01T19:24:52.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:51 smithi062 ceph-mon[44211]: osdmap e106: 12 total, 12 up, 12 in 2024-04-01T19:24:52.369 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:24:52.371 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:52.372 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:24:52.472 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:24:52.506 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:52.528 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:24:52.530 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:52.531 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:24:52.632 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:24:52.666 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:52.766 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:24:52.770 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:52.770 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:24:52.788 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-04-01T19:24:52.871 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:24:52.899 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:53.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:52 smithi022 ceph-mon[39439]: osdmap e107: 12 total, 12 up, 12 in 2024-04-01T19:24:53.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:52 smithi022 ceph-mon[39439]: osdmap e108: 12 total, 12 up, 12 in 2024-04-01T19:24:53.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:52 smithi188 ceph-mon[43939]: osdmap e107: 12 total, 12 up, 12 in 2024-04-01T19:24:53.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:52 smithi188 ceph-mon[43939]: osdmap e108: 12 total, 12 up, 12 in 2024-04-01T19:24:53.149 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:24:53.152 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:53.152 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:24:53.253 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:24:53.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:52 smithi062 ceph-mon[44211]: osdmap e107: 12 total, 12 up, 12 in 2024-04-01T19:24:53.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:52 smithi062 ceph-mon[44211]: osdmap e108: 12 total, 12 up, 12 in 2024-04-01T19:24:53.286 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:53.308 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:24:53.311 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:53.312 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:24:53.413 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:24:53.442 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:53.502 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:24:53.502 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-01T19:24:53.502 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:24:54.017 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:53 smithi022 ceph-mon[39439]: pgmap v348: 17 pgs: 2 creating+peering, 5 active+clean, 10 unknown; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:54.017 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:53 smithi022 ceph-mon[39439]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T19:24:54.111 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:24:54.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:53 smithi188 ceph-mon[43939]: pgmap v348: 17 pgs: 2 creating+peering, 5 active+clean, 10 unknown; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:54.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:53 smithi188 ceph-mon[43939]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T19:24:54.141 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:24:54.141 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:24:54.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:53 smithi062 ceph-mon[44211]: pgmap v348: 17 pgs: 2 creating+peering, 5 active+clean, 10 unknown; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:54.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:53 smithi062 ceph-mon[44211]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T19:24:54.741 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_historic_ops 2024-04-01T19:24:55.086 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:54 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:24:55.087 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:54 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:24:55.087 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:54 smithi022 ceph-mon[39439]: osdmap e109: 12 total, 12 up, 12 in 2024-04-01T19:24:55.102 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:24:55.106 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:55.106 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:24:55.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:54 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:24:55.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:54 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:24:55.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:54 smithi188 ceph-mon[43939]: osdmap e109: 12 total, 12 up, 12 in 2024-04-01T19:24:55.124 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:24:55.129 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:24:55.131 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:24:55.207 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:24:55.237 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:55.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:54 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:24:55.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:54 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:24:55.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:54 smithi062 ceph-mon[44211]: osdmap e109: 12 total, 12 up, 12 in 2024-04-01T19:24:55.335 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:24:55.338 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:55.338 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:24:55.439 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:24:55.471 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:55.492 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:24:55.495 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:55.496 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:24:55.597 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:24:55.625 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:55.644 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:24:55.646 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:55.647 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:24:55.748 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:24:55.776 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:55.795 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:24:55.797 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:55.798 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:24:55.899 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:24:55.928 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:56.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:55 smithi022 ceph-mon[39439]: pgmap v351: 17 pgs: 2 creating+peering, 11 active+clean, 4 unknown; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:56.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:55 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:24:56.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:55 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:24:56.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:55 smithi188 ceph-mon[43939]: pgmap v351: 17 pgs: 2 creating+peering, 11 active+clean, 4 unknown; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:56.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:55 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:24:56.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:55 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:24:56.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:55 smithi062 ceph-mon[44211]: pgmap v351: 17 pgs: 2 creating+peering, 11 active+clean, 4 unknown; 577 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:56.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:55 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:24:56.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:55 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:24:56.612 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:24:57.061 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:56 smithi022 ceph-mon[39439]: osdmap e110: 12 total, 12 up, 12 in 2024-04-01T19:24:57.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:56 smithi188 ceph-mon[43939]: osdmap e110: 12 total, 12 up, 12 in 2024-04-01T19:24:57.207 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:24:57.211 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:57.212 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:24:57.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:56 smithi062 ceph-mon[44211]: osdmap e110: 12 total, 12 up, 12 in 2024-04-01T19:24:57.312 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:24:57.344 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:57.695 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:24:57.698 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:57.699 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:24:57.800 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:24:57.834 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:57.855 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:24:57.858 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:57.858 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:24:57.959 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:24:57.980 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:57 smithi022 ceph-mon[39439]: pgmap v353: 17 pgs: 17 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:57.997 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:58.249 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:24:58.252 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:58.252 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:24:58.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:57 smithi062 ceph-mon[44211]: pgmap v353: 17 pgs: 17 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:58.353 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:24:58.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:57 smithi188 ceph-mon[43939]: pgmap v353: 17 pgs: 17 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:24:58.386 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:58.407 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:24:58.410 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:58.410 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:24:58.511 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:24:58.543 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:58.563 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:24:58.566 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:58.567 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:24:58.668 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:24:58.699 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:58.719 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:24:58.721 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:58.722 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:24:58.823 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:24:58.853 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:59.051 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:24:59.055 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:59.055 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:24:59.156 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:24:59.184 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:59.203 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:24:59.224 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:59.224 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:24:59.325 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:24:59.358 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:59.380 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:24:59.383 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:59.383 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:24:59.484 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:24:59.513 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:59.555 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:24:59.575 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:24:59.594 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:24:59.613 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:24:59.633 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:24:59.640 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:24:59.643 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:59.644 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:24:59.654 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:24:59.675 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:24:59.695 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:24:59.715 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:24:59.736 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:24:59.744 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:24:59.757 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:24:59.776 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:59.777 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:24:59.779 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:24:59.779 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:24:59.779 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:24:59.779 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:24:59.779 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:24:59.779 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:24:59.779 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:24:59.779 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:24:59.779 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:24:59.779 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:24:59.779 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:24:59.779 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:24:59.798 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:24:59.800 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:59.801 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:24:59.882 INFO:teuthology.orchestra.run.smithi022.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-04-01T19:24:59.902 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:24:59.934 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:24:59.956 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:24:59.958 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:24:59.959 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:25:00.060 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:25:00.089 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:59 smithi188 ceph-mon[43939]: pgmap v354: 17 pgs: 17 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:25:00.089 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:59 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3793532747' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:25:00.089 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:00.089 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:00.089 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:00.089 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:59 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4191199026' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:25:00.089 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:00.089 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:24:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:00.091 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:00.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:59 smithi022 ceph-mon[39439]: pgmap v354: 17 pgs: 17 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:25:00.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:59 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3793532747' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:25:00.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:00.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:00.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:00.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:59 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4191199026' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:25:00.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:00.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:24:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:00.112 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:25:00.114 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:00.114 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:25:00.126 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] 2024-04-01T19:25:00.126 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-01T19:25:00.126 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-04-01T19:25:00.126 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-01T19:25:00.126 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-01T19:25:00.127 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 config set filestore_inject_stall 3 2024-04-01T19:25:00.215 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:25:00.246 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:59 smithi062 ceph-mon[44211]: pgmap v354: 17 pgs: 17 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:25:00.246 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:59 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3793532747' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:25:00.246 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:00.246 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:00.246 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:00.246 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:59 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4191199026' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:25:00.246 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:00.247 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:24:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:00.249 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:00.270 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:25:00.273 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:00.273 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:25:00.374 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:25:00.407 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:00.429 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:25:00.432 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:00.432 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:25:00.533 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:25:00.564 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:00.637 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:25:00.646 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:00.647 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:25:00.748 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:25:00.780 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:00.801 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:25:00.804 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:00.805 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:25:00.906 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:25:00.934 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:00.953 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:25:00.956 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:00.956 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:25:01.057 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:25:01.090 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:01.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:01.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:01.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:01.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:01.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:01.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:01.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:01.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:00 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4191199026' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:25:01.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:00 smithi188 ceph-mon[43939]: osdmap e111: 12 total, 12 up, 12 in 2024-04-01T19:25:01.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:01.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:01.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:01.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:01.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:01.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:01.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:01.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:00 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4191199026' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:25:01.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:00 smithi062 ceph-mon[44211]: osdmap e111: 12 total, 12 up, 12 in 2024-04-01T19:25:01.290 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:01.290 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:01.290 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:01.290 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:01.290 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:01.290 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:01.291 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:01.291 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:00 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4191199026' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:25:01.291 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:00 smithi022 ceph-mon[39439]: osdmap e111: 12 total, 12 up, 12 in 2024-04-01T19:25:01.291 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:25:01.294 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:01.295 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:25:01.396 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:25:01.429 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:01.450 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:25:01.453 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:01.454 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:25:01.554 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:25:01.585 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:01.680 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:25:01.688 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:25:01.691 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:01.691 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:25:01.729 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:25:01.730 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 20, 2024-04-01T19:25:01.730 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 600, 2024-04-01T19:25:01.730 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:25:01.730 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.730 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.14157.0:38 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'24, mlcod=15'22)", 2024-04-01T19:25:01.730 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:18:36.287406+0000", 2024-04-01T19:25:01.730 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 385.44268353699999, 2024-04-01T19:25:01.730 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00066551700000000002, 2024-04-01T19:25:01.730 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:01.730 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:01.730 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:01.730 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:01.731 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.731 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:01.731 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.287406+0000", 2024-04-01T19:25:01.731 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.731 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.731 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.731 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:01.731 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.287406+0000", 2024-04-01T19:25:01.731 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.731 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.731 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.732 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:01.732 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.287407+0000", 2024-04-01T19:25:01.732 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.6200000000000006e-07 2024-04-01T19:25:01.732 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.732 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.732 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:01.732 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.287446+0000", 2024-04-01T19:25:01.732 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9601999999999998e-05 2024-04-01T19:25:01.732 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.732 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.732 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:01.732 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.287455+0000", 2024-04-01T19:25:01.732 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.0690000000000008e-06 2024-04-01T19:25:01.732 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.733 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.733 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:01.733 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.287460+0000", 2024-04-01T19:25:01.733 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9579999999999998e-06 2024-04-01T19:25:01.733 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.733 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.733 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:01.733 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.287506+0000", 2024-04-01T19:25:01.733 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5954000000000001e-05 2024-04-01T19:25:01.733 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.733 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.733 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:01.734 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.287537+0000", 2024-04-01T19:25:01.734 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.0485e-05 2024-04-01T19:25:01.734 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.734 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.734 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:01.734 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.288039+0000", 2024-04-01T19:25:01.734 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00050278499999999995 2024-04-01T19:25:01.734 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.734 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.734 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:01.734 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.288071+0000", 2024-04-01T19:25:01.734 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.1702000000000002e-05 2024-04-01T19:25:01.735 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.735 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:01.735 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.735 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.735 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.735 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.14157.0:68 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'42, mlcod=15'39)", 2024-04-01T19:25:01.735 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:18:36.305407+0000", 2024-04-01T19:25:01.735 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 385.42468189800002, 2024-04-01T19:25:01.735 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00058772399999999997, 2024-04-01T19:25:01.735 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:01.735 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:01.735 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:01.736 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:01.736 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.736 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:01.736 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.305407+0000", 2024-04-01T19:25:01.736 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.736 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.736 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.736 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:01.736 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.305407+0000", 2024-04-01T19:25:01.736 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.736 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.736 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.736 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:01.736 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.305409+0000", 2024-04-01T19:25:01.737 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2810000000000001e-06 2024-04-01T19:25:01.737 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.737 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.737 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:01.737 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.305419+0000", 2024-04-01T19:25:01.737 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0755e-05 2024-04-01T19:25:01.737 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.737 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.737 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:01.737 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.305431+0000", 2024-04-01T19:25:01.737 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.116e-05 2024-04-01T19:25:01.737 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.737 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.737 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:01.737 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.305437+0000", 2024-04-01T19:25:01.738 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1999999999999999e-06 2024-04-01T19:25:01.738 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.738 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.738 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:01.738 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.305499+0000", 2024-04-01T19:25:01.738 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2225999999999997e-05 2024-04-01T19:25:01.738 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.738 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.738 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:01.738 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.305528+0000", 2024-04-01T19:25:01.738 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.9249000000000001e-05 2024-04-01T19:25:01.738 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.738 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.738 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:01.738 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.305962+0000", 2024-04-01T19:25:01.739 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00043408800000000001 2024-04-01T19:25:01.739 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.739 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.739 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:01.739 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.305995+0000", 2024-04-01T19:25:01.739 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.2765000000000002e-05 2024-04-01T19:25:01.739 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.739 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:01.739 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.739 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.739 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.739 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.14157.0:69 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'43, mlcod=15'39)", 2024-04-01T19:25:01.739 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:18:36.305455+0000", 2024-04-01T19:25:01.739 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 385.424633728, 2024-04-01T19:25:01.739 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00087735099999999996, 2024-04-01T19:25:01.740 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:01.740 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:01.740 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:01.740 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:01.740 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.740 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:01.740 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.305455+0000", 2024-04-01T19:25:01.740 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.740 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.740 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.740 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:01.740 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.305455+0000", 2024-04-01T19:25:01.740 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.740 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.740 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.741 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:01.741 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.305456+0000", 2024-04-01T19:25:01.741 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7899999999999998e-07 2024-04-01T19:25:01.741 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.741 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.741 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:01.741 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.305480+0000", 2024-04-01T19:25:01.741 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3757e-05 2024-04-01T19:25:01.741 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.741 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.741 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:01.741 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.305487+0000", 2024-04-01T19:25:01.741 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6429999999999995e-06 2024-04-01T19:25:01.741 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.741 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.742 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:01.742 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.305500+0000", 2024-04-01T19:25:01.742 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2921e-05 2024-04-01T19:25:01.742 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.742 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.742 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:01.742 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.305762+0000", 2024-04-01T19:25:01.742 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00026133999999999999 2024-04-01T19:25:01.742 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.742 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.742 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:01.742 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.305779+0000", 2024-04-01T19:25:01.742 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7354999999999999e-05 2024-04-01T19:25:01.742 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.742 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.743 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:01.743 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.306293+0000", 2024-04-01T19:25:01.743 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00051370699999999997 2024-04-01T19:25:01.743 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.743 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.743 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:01.743 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.306333+0000", 2024-04-01T19:25:01.743 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.0049000000000002e-05 2024-04-01T19:25:01.743 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.743 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:01.743 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.743 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.743 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.743 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.14157.0:70 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'44, mlcod=15'39)", 2024-04-01T19:25:01.743 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:18:36.305982+0000", 2024-04-01T19:25:01.743 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 385.42410704500003, 2024-04-01T19:25:01.744 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00053870399999999998, 2024-04-01T19:25:01.744 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:01.744 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:01.744 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:01.744 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:01.744 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.744 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:01.744 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.305982+0000", 2024-04-01T19:25:01.744 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.744 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.744 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.744 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:01.744 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.305982+0000", 2024-04-01T19:25:01.745 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.745 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.745 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.745 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:01.745 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.305984+0000", 2024-04-01T19:25:01.745 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.424e-06 2024-04-01T19:25:01.745 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.745 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.745 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:01.745 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.305995+0000", 2024-04-01T19:25:01.745 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1729000000000001e-05 2024-04-01T19:25:01.745 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.745 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.745 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:01.746 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.306005+0000", 2024-04-01T19:25:01.746 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.4779999999999997e-06 2024-04-01T19:25:01.746 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.746 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.746 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:01.746 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.306013+0000", 2024-04-01T19:25:01.746 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5320000000000006e-06 2024-04-01T19:25:01.746 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.746 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.746 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:01.746 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.306072+0000", 2024-04-01T19:25:01.746 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9030999999999998e-05 2024-04-01T19:25:01.746 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.747 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.747 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:01.747 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.306098+0000", 2024-04-01T19:25:01.747 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5709999999999999e-05 2024-04-01T19:25:01.747 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.747 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.747 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:01.747 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.306473+0000", 2024-04-01T19:25:01.747 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000374535 2024-04-01T19:25:01.747 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.747 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.747 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:01.747 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.306521+0000", 2024-04-01T19:25:01.747 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8265e-05 2024-04-01T19:25:01.748 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.748 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:01.748 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.748 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.748 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.748 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.14157.0:87 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'57, mlcod=15'54)", 2024-04-01T19:25:01.748 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:18:36.315483+0000", 2024-04-01T19:25:01.748 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 385.41460668600001, 2024-04-01T19:25:01.748 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00055921300000000003, 2024-04-01T19:25:01.748 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:01.748 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:01.748 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:01.748 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:01.748 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.748 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:01.749 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.315483+0000", 2024-04-01T19:25:01.749 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.749 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.749 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.749 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:01.749 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.315483+0000", 2024-04-01T19:25:01.749 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.749 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.749 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.749 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:01.749 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.315483+0000", 2024-04-01T19:25:01.749 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.5099999999999998e-07 2024-04-01T19:25:01.749 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.749 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.749 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:01.750 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.315501+0000", 2024-04-01T19:25:01.750 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7700999999999999e-05 2024-04-01T19:25:01.750 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.750 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.750 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:01.750 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.315509+0000", 2024-04-01T19:25:01.750 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6580000000000002e-06 2024-04-01T19:25:01.750 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.750 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.750 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:01.750 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.315523+0000", 2024-04-01T19:25:01.750 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3899e-05 2024-04-01T19:25:01.750 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.750 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.751 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:01.751 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.315558+0000", 2024-04-01T19:25:01.751 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5735999999999998e-05 2024-04-01T19:25:01.751 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.751 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.751 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:01.751 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.315570+0000", 2024-04-01T19:25:01.751 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1887e-05 2024-04-01T19:25:01.751 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.751 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.751 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:01.751 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.316003+0000", 2024-04-01T19:25:01.751 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00043235600000000001 2024-04-01T19:25:01.751 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.752 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.752 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:01.752 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.316042+0000", 2024-04-01T19:25:01.752 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9025e-05 2024-04-01T19:25:01.752 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.752 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:01.752 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.752 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.752 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.752 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.14157.0:89 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'59, mlcod=15'57)", 2024-04-01T19:25:01.752 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:18:36.316918+0000", 2024-04-01T19:25:01.752 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 385.413171009, 2024-04-01T19:25:01.752 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00058776100000000001, 2024-04-01T19:25:01.752 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:01.752 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:01.753 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:01.753 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:01.753 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.753 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:01.753 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.316918+0000", 2024-04-01T19:25:01.753 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.753 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.753 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.753 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:01.753 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.316918+0000", 2024-04-01T19:25:01.753 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.753 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.753 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.753 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:01.753 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.316919+0000", 2024-04-01T19:25:01.754 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4300000000000002e-07 2024-04-01T19:25:01.754 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.754 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.754 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:01.754 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.316957+0000", 2024-04-01T19:25:01.754 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7945999999999999e-05 2024-04-01T19:25:01.754 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.754 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.754 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:01.754 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.316966+0000", 2024-04-01T19:25:01.754 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8410000000000006e-06 2024-04-01T19:25:01.754 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.754 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.755 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:01.755 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.316974+0000", 2024-04-01T19:25:01.755 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9689999999999994e-06 2024-04-01T19:25:01.755 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.755 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.755 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:01.755 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.317007+0000", 2024-04-01T19:25:01.755 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3665999999999999e-05 2024-04-01T19:25:01.755 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.755 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.755 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:01.755 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.317024+0000", 2024-04-01T19:25:01.755 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6446000000000001e-05 2024-04-01T19:25:01.755 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.755 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.755 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:01.756 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.317467+0000", 2024-04-01T19:25:01.756 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00044265199999999998 2024-04-01T19:25:01.756 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.756 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.756 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:01.756 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.317506+0000", 2024-04-01T19:25:01.756 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9397999999999998e-05 2024-04-01T19:25:01.756 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.756 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:01.756 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.756 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.756 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.756 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.14157.0:99 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'65, mlcod=15'63)", 2024-04-01T19:25:01.756 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:18:36.372201+0000", 2024-04-01T19:25:01.756 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 385.35788829799998, 2024-04-01T19:25:01.757 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00055480299999999998, 2024-04-01T19:25:01.757 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:01.757 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:01.757 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:01.757 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:01.757 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.757 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:01.757 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.372201+0000", 2024-04-01T19:25:01.757 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.757 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.757 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.757 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:01.757 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.372201+0000", 2024-04-01T19:25:01.757 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.757 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.758 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.758 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:01.758 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.372205+0000", 2024-04-01T19:25:01.758 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.6509999999999999e-06 2024-04-01T19:25:01.758 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.758 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.758 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:01.758 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.372215+0000", 2024-04-01T19:25:01.758 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0556e-05 2024-04-01T19:25:01.758 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.758 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.758 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:01.758 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.372230+0000", 2024-04-01T19:25:01.758 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4473e-05 2024-04-01T19:25:01.758 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.759 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.759 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:01.759 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.372242+0000", 2024-04-01T19:25:01.759 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2607e-05 2024-04-01T19:25:01.759 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.759 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.759 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:01.759 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.372328+0000", 2024-04-01T19:25:01.759 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5865000000000005e-05 2024-04-01T19:25:01.759 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.759 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.759 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:01.759 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.372358+0000", 2024-04-01T19:25:01.759 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.0185999999999999e-05 2024-04-01T19:25:01.759 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.759 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.760 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:01.760 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.372716+0000", 2024-04-01T19:25:01.760 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00035771799999999998 2024-04-01T19:25:01.760 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.760 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.760 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:01.760 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.372756+0000", 2024-04-01T19:25:01.760 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9746999999999997e-05 2024-04-01T19:25:01.760 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.760 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:01.760 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.760 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.760 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.760 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.14157.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'91)", 2024-04-01T19:25:01.760 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:18:36.519928+0000", 2024-04-01T19:25:01.760 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 385.21016144999999, 2024-04-01T19:25:01.761 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00051476899999999999, 2024-04-01T19:25:01.761 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:01.761 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:01.761 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:01.761 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:01.761 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.761 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:01.761 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.519928+0000", 2024-04-01T19:25:01.761 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.761 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.761 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.761 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:01.761 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.519928+0000", 2024-04-01T19:25:01.761 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.761 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.761 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.762 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:01.762 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.519928+0000", 2024-04-01T19:25:01.762 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8599999999999998e-07 2024-04-01T19:25:01.762 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.762 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.762 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:01.762 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.519968+0000", 2024-04-01T19:25:01.762 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9099e-05 2024-04-01T19:25:01.762 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.762 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.762 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:01.762 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.519976+0000", 2024-04-01T19:25:01.762 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2490000000000001e-06 2024-04-01T19:25:01.762 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.762 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.763 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:01.763 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.519982+0000", 2024-04-01T19:25:01.763 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4169999999999997e-06 2024-04-01T19:25:01.763 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.763 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.763 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:01.763 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.520016+0000", 2024-04-01T19:25:01.763 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3362999999999999e-05 2024-04-01T19:25:01.763 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.763 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.763 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:01.763 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.520027+0000", 2024-04-01T19:25:01.763 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1181e-05 2024-04-01T19:25:01.763 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.763 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.763 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:01.763 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.520413+0000", 2024-04-01T19:25:01.764 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00038632500000000003 2024-04-01T19:25:01.764 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.764 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.764 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:01.764 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.520443+0000", 2024-04-01T19:25:01.764 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.9448999999999999e-05 2024-04-01T19:25:01.764 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.764 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:01.764 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.764 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.764 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.764 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.14157.0:156 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'110, mlcod=15'107)", 2024-04-01T19:25:01.764 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:18:36.578786+0000", 2024-04-01T19:25:01.764 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 385.15130306700001, 2024-04-01T19:25:01.765 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00066347599999999997, 2024-04-01T19:25:01.765 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:01.765 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:01.765 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:01.765 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:01.765 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.765 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:01.765 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.578786+0000", 2024-04-01T19:25:01.765 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.765 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.765 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.765 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:01.765 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.578786+0000", 2024-04-01T19:25:01.765 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.765 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.765 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.766 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:01.766 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.578787+0000", 2024-04-01T19:25:01.766 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.251e-06 2024-04-01T19:25:01.766 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.766 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.766 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:01.766 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.578794+0000", 2024-04-01T19:25:01.766 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.7379999999999997e-06 2024-04-01T19:25:01.766 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.766 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.766 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:01.766 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.578805+0000", 2024-04-01T19:25:01.766 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0473e-05 2024-04-01T19:25:01.766 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.767 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.767 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:01.767 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.578811+0000", 2024-04-01T19:25:01.767 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8070000000000002e-06 2024-04-01T19:25:01.767 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.767 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.767 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:01.767 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.578869+0000", 2024-04-01T19:25:01.767 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7831999999999998e-05 2024-04-01T19:25:01.767 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.767 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.767 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:01.767 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.578889+0000", 2024-04-01T19:25:01.767 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0020000000000001e-05 2024-04-01T19:25:01.767 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.768 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.768 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:01.768 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.579413+0000", 2024-04-01T19:25:01.768 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00052361599999999997 2024-04-01T19:25:01.768 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.768 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.768 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:01.768 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.579450+0000", 2024-04-01T19:25:01.768 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.6739000000000002e-05 2024-04-01T19:25:01.768 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.768 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:01.768 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.768 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.768 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.769 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.14157.0:158 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'112, mlcod=15'108)", 2024-04-01T19:25:01.769 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:18:36.579743+0000", 2024-04-01T19:25:01.769 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 385.15034621799998, 2024-04-01T19:25:01.769 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00075322799999999999, 2024-04-01T19:25:01.769 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:01.769 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:01.769 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:01.769 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:01.769 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.769 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:01.769 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.579743+0000", 2024-04-01T19:25:01.769 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.769 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.769 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.770 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:01.770 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.579743+0000", 2024-04-01T19:25:01.770 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.770 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.770 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.770 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:01.770 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.579744+0000", 2024-04-01T19:25:01.770 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0999999999999997e-07 2024-04-01T19:25:01.770 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.770 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.770 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:01.770 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.579766+0000", 2024-04-01T19:25:01.770 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2518e-05 2024-04-01T19:25:01.770 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.771 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.771 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:01.771 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.579774+0000", 2024-04-01T19:25:01.771 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7649999999999993e-06 2024-04-01T19:25:01.771 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.771 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.771 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:01.771 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.579779+0000", 2024-04-01T19:25:01.771 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7940000000000002e-06 2024-04-01T19:25:01.771 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.771 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.771 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:01.771 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.579820+0000", 2024-04-01T19:25:01.771 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.0680999999999999e-05 2024-04-01T19:25:01.771 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.772 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.772 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:01.772 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.579840+0000", 2024-04-01T19:25:01.772 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0157999999999999e-05 2024-04-01T19:25:01.772 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.772 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.772 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:01.772 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.580450+0000", 2024-04-01T19:25:01.772 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00061074000000000002 2024-04-01T19:25:01.772 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.772 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.772 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:01.772 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.580496+0000", 2024-04-01T19:25:01.772 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5762e-05 2024-04-01T19:25:01.772 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.773 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:01.773 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.773 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.773 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.773 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.14157.0:161 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'115, mlcod=15'110)", 2024-04-01T19:25:01.773 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:18:36.581207+0000", 2024-04-01T19:25:01.773 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 385.148882372, 2024-04-01T19:25:01.773 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.003582315, 2024-04-01T19:25:01.773 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:01.773 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:01.773 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:01.773 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:01.773 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.773 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:01.773 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.581207+0000", 2024-04-01T19:25:01.774 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.774 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.774 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.774 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:01.774 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.581207+0000", 2024-04-01T19:25:01.774 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.774 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.774 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.774 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:01.774 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.581208+0000", 2024-04-01T19:25:01.774 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.04e-06 2024-04-01T19:25:01.774 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.774 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.775 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:01.775 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.581234+0000", 2024-04-01T19:25:01.775 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6203e-05 2024-04-01T19:25:01.775 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.775 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.775 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:01.775 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.581243+0000", 2024-04-01T19:25:01.775 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.3400000000000004e-06 2024-04-01T19:25:01.775 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.775 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.775 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:01.775 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.581250+0000", 2024-04-01T19:25:01.775 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.7710000000000001e-06 2024-04-01T19:25:01.776 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.776 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.776 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:01.776 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.581293+0000", 2024-04-01T19:25:01.776 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.3103999999999999e-05 2024-04-01T19:25:01.776 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.776 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.776 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:01.776 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.581314+0000", 2024-04-01T19:25:01.776 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1118999999999999e-05 2024-04-01T19:25:01.776 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.776 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.776 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:01.776 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.584754+0000", 2024-04-01T19:25:01.777 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0034394719999999998 2024-04-01T19:25:01.777 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.777 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.777 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:01.777 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.584789+0000", 2024-04-01T19:25:01.777 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5265999999999997e-05 2024-04-01T19:25:01.777 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.777 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:01.777 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.777 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.777 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.777 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.14157.0:162 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'116, mlcod=15'113)", 2024-04-01T19:25:01.777 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:18:36.581974+0000", 2024-04-01T19:25:01.777 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 385.148115104, 2024-04-01T19:25:01.778 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0028331290000000002, 2024-04-01T19:25:01.778 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:01.778 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:01.778 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:01.778 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:01.778 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.778 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:01.778 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.581974+0000", 2024-04-01T19:25:01.778 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.778 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.778 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.778 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:01.778 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.581974+0000", 2024-04-01T19:25:01.778 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.779 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.779 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.779 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:01.779 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.581975+0000", 2024-04-01T19:25:01.779 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.184e-06 2024-04-01T19:25:01.779 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.779 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.779 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:01.779 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.581982+0000", 2024-04-01T19:25:01.779 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.6069999999999996e-06 2024-04-01T19:25:01.779 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.779 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.779 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:01.780 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.581992+0000", 2024-04-01T19:25:01.780 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.8460000000000003e-06 2024-04-01T19:25:01.780 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.780 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.780 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:01.780 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.581999+0000", 2024-04-01T19:25:01.780 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.046e-06 2024-04-01T19:25:01.780 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.780 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.780 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:01.780 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.582049+0000", 2024-04-01T19:25:01.780 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0096999999999998e-05 2024-04-01T19:25:01.780 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.780 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.780 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:01.781 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.582071+0000", 2024-04-01T19:25:01.781 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2056e-05 2024-04-01T19:25:01.781 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.781 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.781 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:01.781 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.584791+0000", 2024-04-01T19:25:01.781 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0027203589999999999 2024-04-01T19:25:01.781 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.781 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.781 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:01.781 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.584807+0000", 2024-04-01T19:25:01.781 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5934e-05 2024-04-01T19:25:01.781 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.781 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:01.781 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.782 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.782 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.782 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.14157.0:163 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'117, mlcod=15'113)", 2024-04-01T19:25:01.782 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:18:36.582429+0000", 2024-04-01T19:25:01.782 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 385.14766005000001, 2024-04-01T19:25:01.782 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0023965200000000001, 2024-04-01T19:25:01.782 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:01.782 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:01.782 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:01.782 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:01.782 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.782 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:01.782 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.582429+0000", 2024-04-01T19:25:01.782 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.783 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.783 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.783 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:01.783 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.582429+0000", 2024-04-01T19:25:01.783 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.783 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.783 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.783 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:01.783 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.582430+0000", 2024-04-01T19:25:01.783 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.17e-06 2024-04-01T19:25:01.783 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.783 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.783 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:01.783 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.582438+0000", 2024-04-01T19:25:01.783 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4340000000000003e-06 2024-04-01T19:25:01.784 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.784 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.784 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:01.784 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.582449+0000", 2024-04-01T19:25:01.784 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1078e-05 2024-04-01T19:25:01.784 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.784 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.784 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:01.784 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.582456+0000", 2024-04-01T19:25:01.784 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2280000000000001e-06 2024-04-01T19:25:01.784 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.784 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.784 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:01.784 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.582517+0000", 2024-04-01T19:25:01.784 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1192999999999995e-05 2024-04-01T19:25:01.785 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.785 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.785 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:01.785 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.582536+0000", 2024-04-01T19:25:01.785 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8683000000000001e-05 2024-04-01T19:25:01.785 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.785 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.785 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:01.785 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.584808+0000", 2024-04-01T19:25:01.785 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0022723650000000001 2024-04-01T19:25:01.785 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.785 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.785 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:01.785 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.584826+0000", 2024-04-01T19:25:01.786 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7368999999999999e-05 2024-04-01T19:25:01.786 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.786 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:01.786 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.786 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.786 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.786 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.14157.0:164 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'118, mlcod=15'113)", 2024-04-01T19:25:01.786 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:18:36.582818+0000", 2024-04-01T19:25:01.786 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 385.14727088699999, 2024-04-01T19:25:01.786 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0020192090000000001, 2024-04-01T19:25:01.786 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:01.786 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:01.787 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:01.787 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:01.787 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.787 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:01.787 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.582818+0000", 2024-04-01T19:25:01.787 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.787 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.787 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.787 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:01.787 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.582818+0000", 2024-04-01T19:25:01.787 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.787 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.787 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.787 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:01.788 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.582819+0000", 2024-04-01T19:25:01.788 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.142e-06 2024-04-01T19:25:01.788 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.788 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.788 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:01.788 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.582867+0000", 2024-04-01T19:25:01.788 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7957999999999997e-05 2024-04-01T19:25:01.788 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.788 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.788 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:01.788 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.582878+0000", 2024-04-01T19:25:01.788 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.012e-05 2024-04-01T19:25:01.788 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.788 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.789 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:01.789 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.582884+0000", 2024-04-01T19:25:01.789 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0290000000000002e-06 2024-04-01T19:25:01.789 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.789 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.789 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:01.789 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.582933+0000", 2024-04-01T19:25:01.789 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9574999999999999e-05 2024-04-01T19:25:01.789 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.789 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.789 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:01.789 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.582954+0000", 2024-04-01T19:25:01.789 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0931e-05 2024-04-01T19:25:01.789 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.789 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.790 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:01.790 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.584827+0000", 2024-04-01T19:25:01.790 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0018724429999999999 2024-04-01T19:25:01.790 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.790 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.790 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:01.790 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.584838+0000", 2024-04-01T19:25:01.790 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1011e-05 2024-04-01T19:25:01.790 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.790 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:01.790 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.790 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.790 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.790 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.14157.0:165 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'119, mlcod=15'113)", 2024-04-01T19:25:01.791 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:18:36.583343+0000", 2024-04-01T19:25:01.791 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 385.146745931, 2024-04-01T19:25:01.791 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.001512563, 2024-04-01T19:25:01.791 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:01.791 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:01.791 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:01.791 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:01.791 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.791 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:01.791 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.583343+0000", 2024-04-01T19:25:01.791 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.791 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.791 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.791 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:01.792 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.583343+0000", 2024-04-01T19:25:01.792 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.792 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.792 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.792 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:01.792 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.583345+0000", 2024-04-01T19:25:01.792 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2750000000000001e-06 2024-04-01T19:25:01.792 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.792 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.792 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:01.792 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.583351+0000", 2024-04-01T19:25:01.792 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5529999999999998e-06 2024-04-01T19:25:01.792 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.792 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.793 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:01.793 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.583364+0000", 2024-04-01T19:25:01.793 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2490999999999999e-05 2024-04-01T19:25:01.793 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.793 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.793 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:01.793 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.583370+0000", 2024-04-01T19:25:01.793 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8920000000000003e-06 2024-04-01T19:25:01.793 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.793 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.793 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:01.793 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.583437+0000", 2024-04-01T19:25:01.793 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.6482000000000005e-05 2024-04-01T19:25:01.793 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.794 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.794 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:01.794 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.583457+0000", 2024-04-01T19:25:01.794 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9649000000000001e-05 2024-04-01T19:25:01.794 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.794 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.794 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:01.794 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.584838+0000", 2024-04-01T19:25:01.794 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00138156 2024-04-01T19:25:01.794 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.794 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.794 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:01.794 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.584856+0000", 2024-04-01T19:25:01.795 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7660999999999999e-05 2024-04-01T19:25:01.795 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.795 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:01.795 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.795 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.795 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.795 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.14157.0:166 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'120, mlcod=15'118)", 2024-04-01T19:25:01.795 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:18:36.586154+0000", 2024-04-01T19:25:01.795 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 385.14393571199997, 2024-04-01T19:25:01.795 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00064023300000000003, 2024-04-01T19:25:01.795 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:01.795 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:01.795 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:01.795 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:01.796 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.796 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:01.796 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.586154+0000", 2024-04-01T19:25:01.796 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.796 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.796 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.796 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:01.796 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.586154+0000", 2024-04-01T19:25:01.796 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.796 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.796 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.796 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:01.796 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.586156+0000", 2024-04-01T19:25:01.796 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3590000000000002e-06 2024-04-01T19:25:01.797 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.797 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.797 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:01.797 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.586212+0000", 2024-04-01T19:25:01.797 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6530000000000003e-05 2024-04-01T19:25:01.797 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.797 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.797 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:01.797 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.586223+0000", 2024-04-01T19:25:01.797 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.049e-05 2024-04-01T19:25:01.797 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.797 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.797 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:01.797 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.586229+0000", 2024-04-01T19:25:01.797 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9529999999999996e-06 2024-04-01T19:25:01.798 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.798 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.798 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:01.798 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.586282+0000", 2024-04-01T19:25:01.798 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2799000000000001e-05 2024-04-01T19:25:01.798 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.798 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.798 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:01.798 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.586307+0000", 2024-04-01T19:25:01.798 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5065000000000001e-05 2024-04-01T19:25:01.798 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.798 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.798 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.586759+0000", 2024-04-01T19:25:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00045240500000000002 2024-04-01T19:25:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.586794+0000", 2024-04-01T19:25:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.4632000000000003e-05 2024-04-01T19:25:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.799 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.14157.0:167 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'121, mlcod=15'118)", 2024-04-01T19:25:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:18:36.586753+0000", 2024-04-01T19:25:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 385.14333587599998, 2024-04-01T19:25:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000537672, 2024-04-01T19:25:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.586753+0000", 2024-04-01T19:25:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.586753+0000", 2024-04-01T19:25:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.586755+0000", 2024-04-01T19:25:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.358e-06 2024-04-01T19:25:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.586807+0000", 2024-04-01T19:25:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2624000000000003e-05 2024-04-01T19:25:01.801 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.586820+0000", 2024-04-01T19:25:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2830000000000001e-05 2024-04-01T19:25:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.586828+0000", 2024-04-01T19:25:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3000000000000002e-06 2024-04-01T19:25:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:01.802 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.586888+0000", 2024-04-01T19:25:01.803 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9264e-05 2024-04-01T19:25:01.803 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.803 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.803 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:01.803 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.586909+0000", 2024-04-01T19:25:01.803 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1268e-05 2024-04-01T19:25:01.803 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.803 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.803 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:01.803 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.587244+0000", 2024-04-01T19:25:01.803 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00033547699999999999 2024-04-01T19:25:01.803 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.803 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.587291+0000", 2024-04-01T19:25:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6551000000000002e-05 2024-04-01T19:25:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.14157.0:168 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'122, mlcod=15'118)", 2024-04-01T19:25:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:18:36.587215+0000", 2024-04-01T19:25:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 385.14287435199998, 2024-04-01T19:25:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00051354299999999999, 2024-04-01T19:25:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.587215+0000", 2024-04-01T19:25:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.587215+0000", 2024-04-01T19:25:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.805 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.587216+0000", 2024-04-01T19:25:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.319e-06 2024-04-01T19:25:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.587240+0000", 2024-04-01T19:25:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3836999999999999e-05 2024-04-01T19:25:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.587262+0000", 2024-04-01T19:25:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2469000000000001e-05 2024-04-01T19:25:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.806 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.587269+0000", 2024-04-01T19:25:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0129999999999999e-06 2024-04-01T19:25:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.587315+0000", 2024-04-01T19:25:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6798999999999997e-05 2024-04-01T19:25:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.587338+0000", 2024-04-01T19:25:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2668e-05 2024-04-01T19:25:01.807 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.587688+0000", 2024-04-01T19:25:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00035007000000000001 2024-04-01T19:25:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.587728+0000", 2024-04-01T19:25:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.0367999999999997e-05 2024-04-01T19:25:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.808 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.809 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.809 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.14157.0:177 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'127, mlcod=15'125)", 2024-04-01T19:25:01.809 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:18:36.598443+0000", 2024-04-01T19:25:01.809 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 385.13164664499999, 2024-04-01T19:25:01.809 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00062454000000000003, 2024-04-01T19:25:01.809 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:01.809 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:01.809 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:01.809 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:01.809 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.809 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:01.809 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.598443+0000", 2024-04-01T19:25:01.809 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.809 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.598443+0000", 2024-04-01T19:25:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.598444+0000", 2024-04-01T19:25:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0750000000000001e-06 2024-04-01T19:25:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.598450+0000", 2024-04-01T19:25:01.810 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0070000000000003e-06 2024-04-01T19:25:01.811 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.811 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.811 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:01.811 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.598460+0000", 2024-04-01T19:25:01.811 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.9480000000000003e-06 2024-04-01T19:25:01.811 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.811 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.811 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:01.811 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.598467+0000", 2024-04-01T19:25:01.811 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3350000000000001e-06 2024-04-01T19:25:01.811 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.811 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.811 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:01.811 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.598536+0000", 2024-04-01T19:25:01.811 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8603999999999996e-05 2024-04-01T19:25:01.812 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.812 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.812 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:01.812 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.598557+0000", 2024-04-01T19:25:01.812 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1060000000000002e-05 2024-04-01T19:25:01.812 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.812 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.812 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:01.812 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.599043+0000", 2024-04-01T19:25:01.812 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00048683100000000002 2024-04-01T19:25:01.812 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.812 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.812 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:01.812 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.599067+0000", 2024-04-01T19:25:01.812 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.368e-05 2024-04-01T19:25:01.812 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.813 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:01.813 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.813 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.813 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.813 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.14157.0:182 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'132, mlcod=15'129)", 2024-04-01T19:25:01.813 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:18:36.600943+0000", 2024-04-01T19:25:01.813 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 385.12914670399999, 2024-04-01T19:25:01.813 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000531289, 2024-04-01T19:25:01.813 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:01.813 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:01.813 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:01.813 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:01.813 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.813 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:01.813 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.600943+0000", 2024-04-01T19:25:01.814 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.814 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.814 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.814 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:01.814 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.600943+0000", 2024-04-01T19:25:01.814 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:01.814 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.814 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.814 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:01.814 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.600943+0000", 2024-04-01T19:25:01.814 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6499999999999998e-07 2024-04-01T19:25:01.814 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.814 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.814 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:01.815 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.600963+0000", 2024-04-01T19:25:01.815 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9686000000000001e-05 2024-04-01T19:25:01.815 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.815 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.815 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:01.815 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.600971+0000", 2024-04-01T19:25:01.815 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.1899999999999995e-06 2024-04-01T19:25:01.815 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.815 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.815 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:01.815 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.600976+0000", 2024-04-01T19:25:01.815 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6299999999999997e-06 2024-04-01T19:25:01.815 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.815 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.816 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:01.816 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.601019+0000", 2024-04-01T19:25:01.816 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.3204999999999997e-05 2024-04-01T19:25:01.816 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.816 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.816 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:01.816 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.601033+0000", 2024-04-01T19:25:01.816 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3912e-05 2024-04-01T19:25:01.816 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.816 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.816 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:01.816 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.601438+0000", 2024-04-01T19:25:01.816 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00040471499999999999 2024-04-01T19:25:01.816 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:01.817 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:01.817 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:01.817 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:18:36.601474+0000", 2024-04-01T19:25:01.817 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.6086e-05 2024-04-01T19:25:01.817 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.817 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:01.817 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.817 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:01.817 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:01.817 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:25:01.817 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:25:01.846 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:01.897 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:25:02.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:01 smithi022 ceph-mon[39439]: pgmap v356: 17 pgs: 17 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:25:02.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:01 smithi022 ceph-mon[39439]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T19:25:02.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:01 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/992688093' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:25:02.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:01 smithi022 ceph-mon[39439]: from='client.24742 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:25:02.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:01 smithi062 ceph-mon[44211]: pgmap v356: 17 pgs: 17 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:25:02.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:01 smithi062 ceph-mon[44211]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T19:25:02.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:01 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/992688093' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:25:02.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:01 smithi062 ceph-mon[44211]: from='client.24742 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:25:02.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:01 smithi188 ceph-mon[43939]: pgmap v356: 17 pgs: 17 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:25:02.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:01 smithi188 ceph-mon[43939]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T19:25:02.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:01 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/992688093' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:25:02.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:01 smithi188 ceph-mon[43939]: from='client.24742 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:25:02.919 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:25:02.949 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:02 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:25:02.949 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:02 smithi022 ceph-mon[39439]: from='client.24742 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:25:02.949 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:02 smithi022 ceph-mon[39439]: osdmap e112: 12 total, 12 up, 12 in 2024-04-01T19:25:03.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:02 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:25:03.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:02 smithi062 ceph-mon[44211]: from='client.24742 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:25:03.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:02 smithi062 ceph-mon[44211]: osdmap e112: 12 total, 12 up, 12 in 2024-04-01T19:25:03.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:02 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:25:03.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:02 smithi188 ceph-mon[43939]: from='client.24742 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:25:03.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:02 smithi188 ceph-mon[43939]: osdmap e112: 12 total, 12 up, 12 in 2024-04-01T19:25:03.597 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:25:03.600 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:03.601 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:25:03.702 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:25:03.731 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:03.805 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:25:03.819 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:03.819 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:25:03.920 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:25:03.948 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:04.239 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:03 smithi022 ceph-mon[39439]: pgmap v358: 17 pgs: 17 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:25:04.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:03 smithi062 ceph-mon[44211]: pgmap v358: 17 pgs: 17 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:25:04.267 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_ops_in_flight 2024-04-01T19:25:04.373 DEBUG:teuthology.orchestra.run.smithi188:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.2 -b 65536 --object-size 65536 -p unique_pool_0 bench 90 write' 2024-04-01T19:25:04.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:03 smithi188 ceph-mon[43939]: pgmap v358: 17 pgs: 17 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:25:04.376 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-04-01T19:25:04.376 INFO:teuthology.orchestra.run:waiting for 3000 2024-04-01T19:25:04.467 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:25:04.467 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "" 2024-04-01T19:25:04.467 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:25:04.662 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:hints = 1 2024-04-01T19:25:04.662 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-04-01T19:25:04.662 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Object prefix: benchmark_data_smithi188_77607 2024-04-01T19:25:04.662 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:25:04.662 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 0 0 0 0 0 0 - 0 2024-04-01T19:25:04.817 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:25:04.821 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:04.821 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:25:04.922 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:25:04.964 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:04.987 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:25:04.990 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:04.990 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:25:05.091 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:25:05.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:04 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:25:05.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:04 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:25:05.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:04 smithi022 ceph-mon[39439]: osdmap e113: 12 total, 12 up, 12 in 2024-04-01T19:25:05.130 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:05.157 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:25:05.160 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:04 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:25:05.160 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:04 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:25:05.160 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:04 smithi188 ceph-mon[43939]: osdmap e113: 12 total, 12 up, 12 in 2024-04-01T19:25:05.160 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:05.161 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:25:05.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:04 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:25:05.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:04 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:25:05.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:04 smithi062 ceph-mon[44211]: osdmap e113: 12 total, 12 up, 12 in 2024-04-01T19:25:05.261 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:25:05.299 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:05.324 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:25:05.328 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:05.328 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:25:05.429 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:25:05.473 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:05.518 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:25:05.532 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:05.533 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:25:05.533 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:25:05.634 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:25:05.662 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 1 15 5869 5854 365.848 365.875 0.00207119 0.00272738 2024-04-01T19:25:05.674 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:05.837 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:25:05.843 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:05.844 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:25:05.945 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:25:05.988 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:06.103 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:05 smithi022 ceph-mon[39439]: pgmap v360: 17 pgs: 17 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:25:06.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:05 smithi062 ceph-mon[44211]: pgmap v360: 17 pgs: 17 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:25:06.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:05 smithi188 ceph-mon[43939]: pgmap v360: 17 pgs: 17 active+clean; 577 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:25:06.393 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:25:06.653 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:25:06.658 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:06.659 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:25:06.662 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 2 16 11273 11257 351.686 337.688 0.00259366 0.00283934 2024-04-01T19:25:06.759 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:25:06.801 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:06.815 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:25:07.169 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:25:07.175 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:07.175 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:25:07.276 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:25:07.315 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:07.336 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:25:07.340 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:07.340 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:25:07.441 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:25:07.483 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:07.642 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:25:07.647 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:07.648 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:25:07.662 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 3 16 15991 15975 332.721 294.875 0.00443302 0.00300249 2024-04-01T19:25:07.749 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:25:07.788 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:07.816 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:25:07.818 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:07.818 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:25:07.919 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:25:07.953 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:07.976 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:25:07.980 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:07.980 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:25:08.081 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:25:08.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:07 smithi188 ceph-mon[43939]: pgmap v361: 17 pgs: 17 active+clean; 130 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s wr, 306 op/s 2024-04-01T19:25:08.132 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:08.176 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:07 smithi022 ceph-mon[39439]: pgmap v361: 17 pgs: 17 active+clean; 130 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s wr, 306 op/s 2024-04-01T19:25:08.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:07 smithi062 ceph-mon[44211]: pgmap v361: 17 pgs: 17 active+clean; 130 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s wr, 306 op/s 2024-04-01T19:25:08.285 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:25:08.296 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:25:08.303 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:08.303 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:25:08.317 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:25:08.348 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:25:08.390 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:25:08.404 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:25:08.426 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:25:08.447 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:08.458 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:25:08.476 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:25:08.478 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:08.479 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:25:08.488 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:25:08.523 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:25:08.558 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:25:08.580 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:25:08.597 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:25:08.626 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:25:08.657 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:08.662 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 4 16 20224 20208 315.678 264.562 0.0015285 0.0031635 2024-04-01T19:25:08.666 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:25:08.675 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:25:08.675 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:25:08.675 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:25:08.675 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:25:08.675 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:25:08.675 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:25:08.675 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:25:08.675 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:25:08.675 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:25:08.675 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:25:08.675 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:25:08.675 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:25:08.676 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:25:08.692 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:25:08.700 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:08.700 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:25:08.801 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:25:08.836 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:08.859 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:25:08.862 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:08.862 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:25:08.963 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:25:08.999 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:09.031 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:25:09.035 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:09.036 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:25:09.137 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:25:09.176 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:09.181 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:08 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/866841939' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:25:09.181 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:09.181 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:09.182 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:09.182 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:09.182 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:09.182 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:09.182 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:09.203 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:25:09.205 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:08 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/866841939' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:25:09.205 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:09.205 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:09.205 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:09.205 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:09.205 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:09.205 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:09.205 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:09.206 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:09.206 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:25:09.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:08 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/866841939' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:25:09.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:09.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:09.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:09.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:09.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:09.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:09.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:09.307 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:25:09.348 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:09.374 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:25:09.378 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:09.379 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:25:09.480 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:25:09.513 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:09.539 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:25:09.541 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:09.542 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:25:09.643 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:25:09.662 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 5 15 24178 24163 301.978 247.188 0.00250387 0.00330873 2024-04-01T19:25:09.680 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:09.706 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:25:09.710 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:09.710 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:25:09.811 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:25:09.833 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:25:09.833 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:25:09.860 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:10.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:10.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:10.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:10.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:10.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:09 smithi022 ceph-mon[39439]: pgmap v362: 17 pgs: 17 active+clean; 492 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 61 MiB/s wr, 982 op/s 2024-04-01T19:25:10.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:10.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:10.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:10.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:10.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:10.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:09 smithi062 ceph-mon[44211]: pgmap v362: 17 pgs: 17 active+clean; 492 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 61 MiB/s wr, 982 op/s 2024-04-01T19:25:10.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:10.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:10.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:10.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:10.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:10.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:09 smithi188 ceph-mon[43939]: pgmap v362: 17 pgs: 17 active+clean; 492 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 61 MiB/s wr, 982 op/s 2024-04-01T19:25:10.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:10.529 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_blocked_ops 2024-04-01T19:25:10.582 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] 2024-04-01T19:25:10.583 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 0 1 2024-04-01T19:25:10.663 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 6 16 28189 28173 293.417 250.625 0.00318459 0.00340631 2024-04-01T19:25:10.728 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:25:10.743 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:10.744 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:25:10.845 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:25:10.886 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:10.913 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:25:10.917 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:10.918 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:25:11.018 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:25:11.050 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:11.075 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:25:11.079 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:11.079 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:25:11.180 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:25:11.221 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:11.663 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 7 16 31756 31740 283.346 222.938 0.00233409 0.00352694 2024-04-01T19:25:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:11 smithi062 ceph-mon[44211]: pgmap v363: 17 pgs: 17 active+clean; 1.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 137 MiB/s wr, 2.20k op/s 2024-04-01T19:25:12.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:11 smithi022 ceph-mon[39439]: pgmap v363: 17 pgs: 17 active+clean; 1.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 137 MiB/s wr, 2.20k op/s 2024-04-01T19:25:12.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:11 smithi188 ceph-mon[43939]: pgmap v363: 17 pgs: 17 active+clean; 1.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 137 MiB/s wr, 2.20k op/s 2024-04-01T19:25:12.664 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 8 16 35226 35210 275.006 216.875 0.00346486 0.00363455 2024-04-01T19:25:13.664 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 9 16 38580 38564 267.724 209.625 0.00204684 0.00373373 2024-04-01T19:25:14.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:13 smithi062 ceph-mon[44211]: pgmap v364: 17 pgs: 17 active+clean; 1.6 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 167 MiB/s wr, 2.68k op/s 2024-04-01T19:25:14.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:13 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:25:14.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:13 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:25:14.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:13 smithi022 ceph-mon[39439]: pgmap v364: 17 pgs: 17 active+clean; 1.6 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 167 MiB/s wr, 2.68k op/s 2024-04-01T19:25:14.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:13 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:25:14.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:13 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:25:14.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:13 smithi188 ceph-mon[43939]: pgmap v364: 17 pgs: 17 active+clean; 1.6 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 167 MiB/s wr, 2.68k op/s 2024-04-01T19:25:14.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:13 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:25:14.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:13 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:25:14.665 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 10 16 41932 41916 261.901 209.5 0.00328633 0.00381652 2024-04-01T19:25:15.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:14 smithi062 ceph-mon[44211]: osdmap e114: 12 total, 12 up, 12 in 2024-04-01T19:25:15.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:14 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:25:15.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:14 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:25:15.360 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:14 smithi022 ceph-mon[39439]: osdmap e114: 12 total, 12 up, 12 in 2024-04-01T19:25:15.360 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:14 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:25:15.360 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:14 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:25:15.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:14 smithi188 ceph-mon[43939]: osdmap e114: 12 total, 12 up, 12 in 2024-04-01T19:25:15.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:14 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:25:15.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:14 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:25:15.585 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:25:15.588 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:15.589 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:25:15.665 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 11 16 45042 45026 255.759 194.375 0.00598708 0.00390806 2024-04-01T19:25:15.689 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:25:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:15.751 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:25:15.754 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:15.754 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:25:15.855 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:25:15.914 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:16.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:15 smithi062 ceph-mon[44211]: pgmap v366: 17 pgs: 17 active+clean; 2.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 211 MiB/s wr, 3.37k op/s 2024-04-01T19:25:16.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:15 smithi062 ceph-mon[44211]: osdmap e115: 12 total, 12 up, 12 in 2024-04-01T19:25:16.138 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:25:16.138 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:25:16.180 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:25:16.186 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:16.186 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:25:16.189 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:15 smithi022 ceph-mon[39439]: pgmap v366: 17 pgs: 17 active+clean; 2.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 211 MiB/s wr, 3.37k op/s 2024-04-01T19:25:16.189 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:15 smithi022 ceph-mon[39439]: osdmap e115: 12 total, 12 up, 12 in 2024-04-01T19:25:16.287 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:25:16.344 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:16.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:15 smithi188 ceph-mon[43939]: pgmap v366: 17 pgs: 17 active+clean; 2.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 211 MiB/s wr, 3.37k op/s 2024-04-01T19:25:16.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:15 smithi188 ceph-mon[43939]: osdmap e115: 12 total, 12 up, 12 in 2024-04-01T19:25:16.416 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:25:16.418 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:16.419 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:25:16.520 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:25:16.553 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:16.578 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:25:16.581 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:16.581 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:25:16.665 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 12 16 47818 47802 248.904 173.5 0.00373709 0.00401607 2024-04-01T19:25:16.682 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:25:16.725 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:16.774 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:25:16.777 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:16.778 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:25:16.879 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:25:16.921 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:16.960 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:16 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/730965992' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:25:16.960 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:16 smithi062 ceph-mon[44211]: from='client.34751 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:25:16.984 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:25:17.010 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:16 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/730965992' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:25:17.010 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:16 smithi022 ceph-mon[39439]: from='client.34751 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:25:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:16 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/730965992' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:25:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:16 smithi188 ceph-mon[43939]: from='client.34751 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:25:17.395 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:25:17.665 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 13 16 50590 50574 243.084 173.25 0.0056729 0.0041122 2024-04-01T19:25:18.227 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:17 smithi022 ceph-mon[39439]: pgmap v368: 17 pgs: 17 active+clean; 2.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 252 MiB/s wr, 4.03k op/s 2024-04-01T19:25:18.227 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:17 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:25:18.227 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:17 smithi022 ceph-mon[39439]: from='client.34751 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:25:18.227 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:17 smithi022 ceph-mon[39439]: osdmap e116: 12 total, 12 up, 12 in 2024-04-01T19:25:18.227 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:17 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:25:18.228 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:17 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:25:18.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:17 smithi062 ceph-mon[44211]: pgmap v368: 17 pgs: 17 active+clean; 2.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 252 MiB/s wr, 4.03k op/s 2024-04-01T19:25:18.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:17 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:25:18.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:17 smithi062 ceph-mon[44211]: from='client.34751 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:25:18.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:17 smithi062 ceph-mon[44211]: osdmap e116: 12 total, 12 up, 12 in 2024-04-01T19:25:18.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:17 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:25:18.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:17 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:25:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:17 smithi188 ceph-mon[43939]: pgmap v368: 17 pgs: 17 active+clean; 2.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 252 MiB/s wr, 4.03k op/s 2024-04-01T19:25:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:17 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:25:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:17 smithi188 ceph-mon[43939]: from='client.34751 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:25:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:17 smithi188 ceph-mon[43939]: osdmap e116: 12 total, 12 up, 12 in 2024-04-01T19:25:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:17 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:25:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:17 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:25:18.385 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:25:18.392 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:18.392 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:25:18.493 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:25:18.535 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:18.562 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:25:18.568 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:18.568 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:25:18.665 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 14 16 53379 53363 238.172 174.312 0.00268515 0.0041974 2024-04-01T19:25:18.669 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:25:18.728 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:18.766 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:25:18.770 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:18.770 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:25:18.871 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:25:18.915 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:18.942 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:25:18.946 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:18.946 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:25:19.047 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:25:19.086 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:19.113 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:25:19.116 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:19.117 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:25:19.218 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:25:19.232 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:25:19.252 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:18 smithi188 ceph-mon[43939]: osdmap e117: 12 total, 12 up, 12 in 2024-04-01T19:25:19.255 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:19.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:18 smithi062 ceph-mon[44211]: osdmap e117: 12 total, 12 up, 12 in 2024-04-01T19:25:19.284 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:25:19.289 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:19.290 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:25:19.315 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:25:19.316 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:25:19.340 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:18 smithi022 ceph-mon[39439]: osdmap e117: 12 total, 12 up, 12 in 2024-04-01T19:25:19.391 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:25:19.444 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:19.467 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:25:19.470 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:19.471 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:25:19.572 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:25:19.605 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:19.628 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:25:19.631 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:19.631 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:25:19.665 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 15 16 55919 55903 232.877 158.75 0.00714262 0.0042925 2024-04-01T19:25:19.732 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:25:19.789 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:20.042 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:19 smithi022 ceph-mon[39439]: pgmap v371: 17 pgs: 17 active+clean; 2.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 224 MiB/s wr, 3.58k op/s 2024-04-01T19:25:20.043 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:19 smithi022 ceph-mon[39439]: osdmap e118: 12 total, 12 up, 12 in 2024-04-01T19:25:20.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:19 smithi062 ceph-mon[44211]: pgmap v371: 17 pgs: 17 active+clean; 2.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 224 MiB/s wr, 3.58k op/s 2024-04-01T19:25:20.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:19 smithi062 ceph-mon[44211]: osdmap e118: 12 total, 12 up, 12 in 2024-04-01T19:25:20.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:19 smithi188 ceph-mon[43939]: pgmap v371: 17 pgs: 17 active+clean; 2.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 224 MiB/s wr, 3.58k op/s 2024-04-01T19:25:20.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:19 smithi188 ceph-mon[43939]: osdmap e118: 12 total, 12 up, 12 in 2024-04-01T19:25:20.556 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_historic_ops 2024-04-01T19:25:20.665 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 16 16 58558 58542 228.63 164.938 0.0151863 0.00437236 2024-04-01T19:25:20.759 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:25:20.764 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:25:20.775 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:20.775 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:25:20.876 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:25:20.909 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:20.933 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:25:20.937 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:20.937 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:25:21.038 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:25:21.076 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:21.101 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:25:21.105 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:21.105 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:25:21.206 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:25:21.238 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:21.268 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:25:21.272 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:21.272 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:25:21.373 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:25:21.419 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:21.665 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 17 16 60887 60871 223.744 145.562 0.00339557 0.00446787 2024-04-01T19:25:21.690 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:25:21.704 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:21.704 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:25:21.805 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:25:21.839 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:21.864 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:25:21.867 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:21.867 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:25:21.968 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:25:22.029 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:22.171 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.0 to 1 (10000) 2024-04-01T19:25:22.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:22 smithi062 ceph-mon[44211]: pgmap v373: 17 pgs: 17 active+clean; 3.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 211 MiB/s wr, 3.37k op/s 2024-04-01T19:25:22.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:22 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3033565082' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T19:25:22.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:22 smithi062 ceph-mon[44211]: from='client.34757 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T19:25:22.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:22 smithi022 ceph-mon[39439]: pgmap v373: 17 pgs: 17 active+clean; 3.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 211 MiB/s wr, 3.37k op/s 2024-04-01T19:25:22.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:22 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3033565082' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T19:25:22.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:22 smithi022 ceph-mon[39439]: from='client.34757 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T19:25:22.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:22 smithi188 ceph-mon[43939]: pgmap v373: 17 pgs: 17 active+clean; 3.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 211 MiB/s wr, 3.37k op/s 2024-04-01T19:25:22.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:22 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3033565082' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T19:25:22.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:22 smithi188 ceph-mon[43939]: from='client.34757 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T19:25:22.418 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:25:22.422 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:22.423 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:25:22.524 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:25:22.564 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:22.665 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 18 15 63257 63242 219.546 148.188 0.00860034 0.00455318 2024-04-01T19:25:22.700 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:25:22.702 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:22.703 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:25:22.804 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:25:22.855 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:22.899 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:25:22.903 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:22.903 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:25:23.004 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:25:23.021 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:23 smithi022 ceph-mon[39439]: from='client.34757 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-04-01T19:25:23.021 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:23 smithi022 ceph-mon[39439]: osdmap e119: 12 total, 12 up, 12 in 2024-04-01T19:25:23.059 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:23.249 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:25:23.292 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 1 1 2024-04-01T19:25:23.339 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:25:23.339 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:25:23.339 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:25:23.339 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:25:23.339 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:25:23.339 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:25:23.339 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:25:23.353 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:25:23.372 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:25:23.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:23 smithi188 ceph-mon[43939]: from='client.34757 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-04-01T19:25:23.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:23 smithi188 ceph-mon[43939]: osdmap e119: 12 total, 12 up, 12 in 2024-04-01T19:25:23.401 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:25:23.441 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:25:23.479 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:25:23.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:23 smithi062 ceph-mon[44211]: from='client.34757 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-04-01T19:25:23.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:23 smithi062 ceph-mon[44211]: osdmap e119: 12 total, 12 up, 12 in 2024-04-01T19:25:23.519 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:25:23.529 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:25:23.530 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:25:23.530 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:25:23.530 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:25:23.530 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:25:23.530 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:25:23.530 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:25:23.530 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:25:23.530 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:25:23.530 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:25:23.530 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:25:23.530 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:25:23.622 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:25:23.626 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:23.627 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:25:23.665 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 19 16 65456 65440 215.221 137.375 0.00276198 0.00464456 2024-04-01T19:25:23.727 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:25:23.774 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:23.801 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:25:23.804 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:23.805 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:25:23.906 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:25:23.940 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:23.962 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:25:23.964 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:23.965 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:25:24.066 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:25:24.114 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:24.146 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:25:24.154 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:24.154 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:25:24.255 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:25:24.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:24 smithi062 ceph-mon[44211]: pgmap v375: 17 pgs: 17 active+clean; 3.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 194 MiB/s wr, 3.10k op/s 2024-04-01T19:25:24.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:24 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1450430840' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:25:24.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.297 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:24.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:24 smithi188 ceph-mon[43939]: pgmap v375: 17 pgs: 17 active+clean; 3.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 194 MiB/s wr, 3.10k op/s 2024-04-01T19:25:24.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:24 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1450430840' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:25:24.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.299 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.324 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:25:24.330 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:24.331 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:25:24.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:24 smithi022 ceph-mon[39439]: pgmap v375: 17 pgs: 17 active+clean; 3.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 194 MiB/s wr, 3.10k op/s 2024-04-01T19:25:24.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:24 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1450430840' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:25:24.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:24.431 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:25:24.465 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:24.490 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:25:24.495 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:24.495 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:25:24.596 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:25:24.647 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:24.665 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:25:24.668313 min lat: 0.00106051 max lat: 0.0543745 avg lat: 0.00472099 2024-04-01T19:25:24.665 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:25:24.665 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 20 16 67782 67766 211.729 145.375 0.00388072 0.00472099 2024-04-01T19:25:25.209 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:25.210 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:25.210 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:25.210 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:25 smithi022 ceph-mon[39439]: osdmap e120: 12 total, 12 up, 12 in 2024-04-01T19:25:25.211 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:25:25.218 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:25.219 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:25:25.320 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:25:25.357 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:25.357 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:25.357 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:25.357 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:25 smithi188 ceph-mon[43939]: osdmap e120: 12 total, 12 up, 12 in 2024-04-01T19:25:25.359 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:25.385 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:25:25.388 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:25.389 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:25:25.489 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:25:25.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:25.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:25.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:25.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:25 smithi062 ceph-mon[44211]: osdmap e120: 12 total, 12 up, 12 in 2024-04-01T19:25:25.532 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:25.559 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:25:25.562 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:25.562 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:25:25.663 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:25:25.665 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 21 16 70074 70058 208.467 143.25 0.0069207 0.00479542 2024-04-01T19:25:25.714 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:25.785 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:25:25.789 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:25.789 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:25:25.890 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:25:25.940 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:26.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:26 smithi022 ceph-mon[39439]: pgmap v376: 17 pgs: 17 active+clean; 3.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 153 MiB/s wr, 2.45k op/s 2024-04-01T19:25:26.308 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:25:26.312 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:26.312 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:25:26.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:26 smithi188 ceph-mon[43939]: pgmap v376: 17 pgs: 17 active+clean; 3.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 153 MiB/s wr, 2.45k op/s 2024-04-01T19:25:26.413 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:25:26.448 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:25:26.450 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:26.476 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:25:26.480 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:26.480 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:25:26.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:26 smithi062 ceph-mon[44211]: pgmap v376: 17 pgs: 17 active+clean; 3.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 153 MiB/s wr, 2.45k op/s 2024-04-01T19:25:26.580 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:25:26.640 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:26.665 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 22 16 72188 72172 204.997 132.125 0.00963699 0.00487609 2024-04-01T19:25:27.021 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:25:27.029 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:27.030 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:25:27.091 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:25:27.122 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:25:27.131 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:25:27.162 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:27.185 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:25:27.189 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:27.189 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:25:27.290 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:25:27.328 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:27 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:25:27.328 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:27 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3084847208' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:25:27.329 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:27.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:27 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:25:27.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:27 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3084847208' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:25:27.362 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:25:27.365 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:27.365 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:25:27.466 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:25:27.496 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:27 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:25:27.496 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:27 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3084847208' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:25:27.498 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:27.521 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:25:27.525 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:27.525 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:25:27.626 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:25:27.664 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:27.665 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 23 16 74033 74017 201.098 115.312 0.00709102 0.00497119 2024-04-01T19:25:27.690 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:25:27.694 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:27.694 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:25:27.795 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:25:27.825 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:27.857 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:25:27.860 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:27.860 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:25:27.961 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:25:27.993 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:28.016 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:25:28.018 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:28.019 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:25:28.068 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:28 smithi188 ceph-mon[43939]: pgmap v378: 17 pgs: 17 active+clean; 4.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 154 MiB/s wr, 2.46k op/s 2024-04-01T19:25:28.068 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:28 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:25:28.068 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:28 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:25:28.069 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:28 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3084847208' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:25:28.069 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:28 smithi188 ceph-mon[43939]: osdmap e121: 12 total, 12 up, 12 in 2024-04-01T19:25:28.069 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:28 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:25:28.069 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:28 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:25:28.069 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:25:28.069 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:25:28.069 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:25:28.117 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:25:28.117 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 20, 2024-04-01T19:25:28.117 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 600, 2024-04-01T19:25:28.117 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:25:28.117 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.117 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:64649 2.6 2:68969fc4:::benchmark_data_smithi188_77607_object64648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e119)", 2024-04-01T19:25:28.117 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:25:23.271404+0000", 2024-04-01T19:25:28.117 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 4.8097645570000003, 2024-04-01T19:25:28.117 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.026259667, 2024-04-01T19:25:28.117 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:28.117 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:28.118 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:28.118 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:25:28.118 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:25:28.118 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:25:28.118 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 64649 2024-04-01T19:25:28.118 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.118 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:28.118 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.118 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:28.118 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.271404+0000", 2024-04-01T19:25:28.118 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.118 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.118 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.119 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:28.119 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.271404+0000", 2024-04-01T19:25:28.119 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.119 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.119 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.119 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:28.119 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.271407+0000", 2024-04-01T19:25:28.119 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0999999999999998e-06 2024-04-01T19:25:28.119 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.119 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.119 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:28.119 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.271452+0000", 2024-04-01T19:25:28.119 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5946999999999999e-05 2024-04-01T19:25:28.120 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.120 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.120 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:28.120 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.271467+0000", 2024-04-01T19:25:28.120 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4489e-05 2024-04-01T19:25:28.120 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.120 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.120 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:28.120 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.271476+0000", 2024-04-01T19:25:28.120 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6060000000000003e-06 2024-04-01T19:25:28.120 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.120 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.120 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:28.120 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.271593+0000", 2024-04-01T19:25:28.121 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00011752 2024-04-01T19:25:28.121 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.121 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.121 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:28.121 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.271748+0000", 2024-04-01T19:25:28.121 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000154959 2024-04-01T19:25:28.121 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.121 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.121 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 8", 2024-04-01T19:25:28.121 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.271898+0000", 2024-04-01T19:25:28.121 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014995899999999999 2024-04-01T19:25:28.121 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.121 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.122 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:25:28.122 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.280687+0000", 2024-04-01T19:25:28.122 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0087889820000000007 2024-04-01T19:25:28.122 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.122 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.122 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:25:28.122 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.297560+0000", 2024-04-01T19:25:28.122 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.016872682 2024-04-01T19:25:28.122 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.122 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.122 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:28.122 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.297615+0000", 2024-04-01T19:25:28.122 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5061e-05 2024-04-01T19:25:28.122 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.123 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.123 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:28.123 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.297664+0000", 2024-04-01T19:25:28.123 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9361999999999999e-05 2024-04-01T19:25:28.123 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.123 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:28.123 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.123 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.123 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.123 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:64654 2.6 2:6b689bc1:::benchmark_data_smithi188_77607_object64653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e119)", 2024-04-01T19:25:28.123 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:25:23.271720+0000", 2024-04-01T19:25:28.123 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 4.8094489249999999, 2024-04-01T19:25:28.123 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.026048953, 2024-04-01T19:25:28.123 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:28.124 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:28.124 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:28.124 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:25:28.124 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:25:28.124 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:25:28.124 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 64654 2024-04-01T19:25:28.124 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.124 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:28.124 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.124 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:28.124 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.271720+0000", 2024-04-01T19:25:28.124 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.124 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.124 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.124 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:28.125 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.271720+0000", 2024-04-01T19:25:28.125 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.125 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.125 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.125 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:28.125 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.271721+0000", 2024-04-01T19:25:28.125 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.71e-07 2024-04-01T19:25:28.125 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.125 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.125 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:28.125 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.271754+0000", 2024-04-01T19:25:28.125 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3136999999999998e-05 2024-04-01T19:25:28.125 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.126 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.126 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:28.126 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.271763+0000", 2024-04-01T19:25:28.126 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5960000000000004e-06 2024-04-01T19:25:28.126 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.126 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.126 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:28.126 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.271769+0000", 2024-04-01T19:25:28.126 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9900000000000002e-06 2024-04-01T19:25:28.126 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.126 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.126 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:28.126 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.273668+0000", 2024-04-01T19:25:28.126 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.001899721 2024-04-01T19:25:28.127 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.127 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.127 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:28.127 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.273818+0000", 2024-04-01T19:25:28.127 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014934400000000001 2024-04-01T19:25:28.127 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.127 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.127 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 8", 2024-04-01T19:25:28.127 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.273958+0000", 2024-04-01T19:25:28.127 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013979199999999999 2024-04-01T19:25:28.127 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.127 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.127 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:25:28.127 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.280725+0000", 2024-04-01T19:25:28.127 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0067677600000000003 2024-04-01T19:25:28.128 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.128 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.128 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:25:28.128 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.297674+0000", 2024-04-01T19:25:28.128 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.016949095000000001 2024-04-01T19:25:28.128 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.128 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.128 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:28.128 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.297725+0000", 2024-04-01T19:25:28.128 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0797000000000002e-05 2024-04-01T19:25:28.128 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.128 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.128 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:28.128 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.297769+0000", 2024-04-01T19:25:28.129 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.3850000000000002e-05 2024-04-01T19:25:28.129 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.129 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:28.129 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.129 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.129 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.129 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:65058 2.4 2:2f6d4c71:::benchmark_data_smithi188_77607_object65057:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e119)", 2024-04-01T19:25:28.129 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:25:23.478663+0000", 2024-04-01T19:25:28.129 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 4.6025063179999997, 2024-04-01T19:25:28.129 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.02895375, 2024-04-01T19:25:28.129 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:28.129 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:28.129 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:28.129 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:25:28.130 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:25:28.130 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:25:28.130 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 65058 2024-04-01T19:25:28.130 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.130 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:28.130 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.130 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:28.130 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.478663+0000", 2024-04-01T19:25:28.130 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.130 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.130 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.130 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:28.130 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.478663+0000", 2024-04-01T19:25:28.130 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.131 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.131 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.131 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:28.131 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.478664+0000", 2024-04-01T19:25:28.131 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4869999999999999e-06 2024-04-01T19:25:28.131 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.131 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.131 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:28.131 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.478711+0000", 2024-04-01T19:25:28.131 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7033000000000002e-05 2024-04-01T19:25:28.131 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.131 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.131 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:28.131 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.478720+0000", 2024-04-01T19:25:28.131 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.2669999999999995e-06 2024-04-01T19:25:28.132 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.132 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.132 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:28.132 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.478726+0000", 2024-04-01T19:25:28.132 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9549999999999997e-06 2024-04-01T19:25:28.132 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.132 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.132 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:28.132 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.478944+0000", 2024-04-01T19:25:28.132 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00021807799999999999 2024-04-01T19:25:28.132 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.132 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.132 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:28.132 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.479108+0000", 2024-04-01T19:25:28.133 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00016391600000000001 2024-04-01T19:25:28.133 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.133 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.133 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:25:28.133 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.482158+0000", 2024-04-01T19:25:28.133 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0030496339999999999 2024-04-01T19:25:28.133 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.133 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.133 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:25:28.133 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.487564+0000", 2024-04-01T19:25:28.133 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0054060169999999999 2024-04-01T19:25:28.133 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.133 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.133 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:25:28.134 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.507532+0000", 2024-04-01T19:25:28.134 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.019968079999999999 2024-04-01T19:25:28.134 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.134 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.134 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:28.134 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.507578+0000", 2024-04-01T19:25:28.134 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6047999999999997e-05 2024-04-01T19:25:28.134 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.134 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.134 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:28.134 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.507616+0000", 2024-04-01T19:25:28.134 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.8235000000000002e-05 2024-04-01T19:25:28.134 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.134 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:28.135 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.135 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.135 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.135 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:65064 2.4 2:27cc6a1c:::benchmark_data_smithi188_77607_object65063:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e119)", 2024-04-01T19:25:28.135 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:25:23.480434+0000", 2024-04-01T19:25:28.135 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 4.6007354080000002, 2024-04-01T19:25:28.135 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.027293648, 2024-04-01T19:25:28.135 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:28.135 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:28.135 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:28.135 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:25:28.135 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:25:28.135 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:25:28.135 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 65064 2024-04-01T19:25:28.136 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.136 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:28.136 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.136 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:28.136 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.480434+0000", 2024-04-01T19:25:28.136 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.136 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.136 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.136 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:28.136 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.480434+0000", 2024-04-01T19:25:28.136 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.136 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.136 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.136 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:28.137 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.480435+0000", 2024-04-01T19:25:28.137 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9209999999999999e-06 2024-04-01T19:25:28.137 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.137 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.137 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:28.137 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.480475+0000", 2024-04-01T19:25:28.137 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9987999999999997e-05 2024-04-01T19:25:28.137 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.137 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.137 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:28.137 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.480488+0000", 2024-04-01T19:25:28.137 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2194e-05 2024-04-01T19:25:28.137 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.137 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.138 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:28.138 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.480495+0000", 2024-04-01T19:25:28.138 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7659999999999998e-06 2024-04-01T19:25:28.138 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.138 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.138 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:28.138 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.484061+0000", 2024-04-01T19:25:28.138 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0035651160000000001 2024-04-01T19:25:28.138 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.138 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.138 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:28.138 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.484175+0000", 2024-04-01T19:25:28.138 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000114629 2024-04-01T19:25:28.138 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.139 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.139 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:25:28.139 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.484299+0000", 2024-04-01T19:25:28.139 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000123678 2024-04-01T19:25:28.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.139 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.139 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:25:28.139 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.487576+0000", 2024-04-01T19:25:28.139 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0032770049999999999 2024-04-01T19:25:28.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.139 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.139 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:25:28.139 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.507651+0000", 2024-04-01T19:25:28.139 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.020075496000000002 2024-04-01T19:25:28.140 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.140 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.140 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:28.140 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.507696+0000", 2024-04-01T19:25:28.140 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4946e-05 2024-04-01T19:25:28.140 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.140 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.140 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:28.140 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:23.507727+0000", 2024-04-01T19:25:28.140 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.0908999999999998e-05 2024-04-01T19:25:28.140 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.140 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:28.140 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.140 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.141 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.141 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:70045 2.4 2:23a7c70c:::benchmark_data_smithi188_77607_object70044:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e120)", 2024-04-01T19:25:28.141 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:25:25.657621+0000", 2024-04-01T19:25:28.141 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 2.423548351, 2024-04-01T19:25:28.141 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.023151075, 2024-04-01T19:25:28.141 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:28.141 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:28.141 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:28.141 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:25:28.141 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:25:28.141 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:25:28.141 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 70045 2024-04-01T19:25:28.141 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.141 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:28.141 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.142 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:28.142 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.657621+0000", 2024-04-01T19:25:28.142 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.142 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.142 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.142 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:28.142 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.657621+0000", 2024-04-01T19:25:28.142 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.142 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.142 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.142 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:28.142 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.657622+0000", 2024-04-01T19:25:28.142 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.9500000000000001e-07 2024-04-01T19:25:28.142 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.143 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.143 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:28.143 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.657656+0000", 2024-04-01T19:25:28.143 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.4898999999999999e-05 2024-04-01T19:25:28.143 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.143 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.143 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:28.143 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.657664+0000", 2024-04-01T19:25:28.143 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5739999999999998e-06 2024-04-01T19:25:28.143 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.143 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.143 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:28.143 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.657671+0000", 2024-04-01T19:25:28.143 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8480000000000003e-06 2024-04-01T19:25:28.144 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.144 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.144 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:28.144 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.659704+0000", 2024-04-01T19:25:28.144 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0020332890000000002 2024-04-01T19:25:28.144 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.144 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.144 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:28.144 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.659803+0000", 2024-04-01T19:25:28.144 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.9333999999999995e-05 2024-04-01T19:25:28.144 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.144 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.144 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:25:28.144 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.659898+0000", 2024-04-01T19:25:28.145 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.4067000000000006e-05 2024-04-01T19:25:28.145 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.145 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.145 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:25:28.145 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.665764+0000", 2024-04-01T19:25:28.145 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0058668360000000003 2024-04-01T19:25:28.145 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.145 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.145 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:25:28.145 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.680669+0000", 2024-04-01T19:25:28.145 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014904482 2024-04-01T19:25:28.145 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.145 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.145 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:28.145 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.680723+0000", 2024-04-01T19:25:28.146 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3823000000000003e-05 2024-04-01T19:25:28.146 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.146 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.146 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:28.146 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.680772+0000", 2024-04-01T19:25:28.146 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9027999999999999e-05 2024-04-01T19:25:28.146 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.146 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:28.146 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.146 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.146 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.146 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:70679 2.4 2:248f994e:::benchmark_data_smithi188_77607_object70678:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e120)", 2024-04-01T19:25:28.146 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:25:25.936972+0000", 2024-04-01T19:25:28.146 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 2.1441968689999999, 2024-04-01T19:25:28.147 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.028998291999999998, 2024-04-01T19:25:28.147 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:28.147 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:28.147 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:28.147 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:25:28.147 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:25:28.147 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:25:28.147 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 70679 2024-04-01T19:25:28.147 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.147 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:28.147 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.147 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:28.147 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.936972+0000", 2024-04-01T19:25:28.147 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.148 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.148 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.148 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:28.148 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.936972+0000", 2024-04-01T19:25:28.148 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.148 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.148 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.148 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:28.148 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.936973+0000", 2024-04-01T19:25:28.148 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0100000000000004e-07 2024-04-01T19:25:28.148 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.148 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.148 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:28.148 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.937005+0000", 2024-04-01T19:25:28.149 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.2107999999999998e-05 2024-04-01T19:25:28.149 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.149 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.149 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:28.149 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.937011+0000", 2024-04-01T19:25:28.149 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4150000000000004e-06 2024-04-01T19:25:28.149 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.149 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.149 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:28.149 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.937017+0000", 2024-04-01T19:25:28.149 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8540000000000002e-06 2024-04-01T19:25:28.149 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.149 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.149 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:28.149 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.944841+0000", 2024-04-01T19:25:28.150 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0078237480000000002 2024-04-01T19:25:28.150 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.150 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.150 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:28.150 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.944981+0000", 2024-04-01T19:25:28.150 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000139949 2024-04-01T19:25:28.150 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.150 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.150 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:25:28.150 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.945152+0000", 2024-04-01T19:25:28.150 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00017072699999999999 2024-04-01T19:25:28.150 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.150 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.150 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:25:28.151 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.954923+0000", 2024-04-01T19:25:28.151 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00977162 2024-04-01T19:25:28.151 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.151 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.151 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:25:28.151 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.965864+0000", 2024-04-01T19:25:28.151 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010940557 2024-04-01T19:25:28.151 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.151 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.151 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:28.151 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.965927+0000", 2024-04-01T19:25:28.151 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2700000000000006e-05 2024-04-01T19:25:28.151 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.151 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.151 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:28.152 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.965970+0000", 2024-04-01T19:25:28.152 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.3813000000000002e-05 2024-04-01T19:25:28.152 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.152 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:28.152 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.152 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.152 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.152 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:70680 2.4 2:25348b1e:::benchmark_data_smithi188_77607_object70679:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e120)", 2024-04-01T19:25:28.152 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:25:25.939473+0000", 2024-04-01T19:25:28.152 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 2.14169593, 2024-04-01T19:25:28.152 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.02662517, 2024-04-01T19:25:28.152 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:28.152 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:28.153 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:28.153 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:25:28.153 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:25:28.153 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:25:28.153 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 70680 2024-04-01T19:25:28.153 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.153 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:28.153 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.153 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:28.153 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.939473+0000", 2024-04-01T19:25:28.153 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.153 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.153 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.153 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:28.153 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.939473+0000", 2024-04-01T19:25:28.154 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.154 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.154 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.154 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:28.154 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.939475+0000", 2024-04-01T19:25:28.154 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4109999999999999e-06 2024-04-01T19:25:28.154 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.154 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.154 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:28.154 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.939520+0000", 2024-04-01T19:25:28.154 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5028000000000003e-05 2024-04-01T19:25:28.154 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.154 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.155 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:28.155 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.939531+0000", 2024-04-01T19:25:28.155 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.058e-05 2024-04-01T19:25:28.155 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.155 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.155 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:28.155 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.939541+0000", 2024-04-01T19:25:28.155 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.5149999999999995e-06 2024-04-01T19:25:28.155 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.155 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.155 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:28.155 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.947699+0000", 2024-04-01T19:25:28.155 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0081582860000000007 2024-04-01T19:25:28.155 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.156 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.156 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:28.156 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.947812+0000", 2024-04-01T19:25:28.156 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00011304 2024-04-01T19:25:28.156 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.156 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.156 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:25:28.156 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.947951+0000", 2024-04-01T19:25:28.156 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000138997 2024-04-01T19:25:28.156 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.156 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.156 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:25:28.156 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.954929+0000", 2024-04-01T19:25:28.156 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0069776869999999998 2024-04-01T19:25:28.157 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.157 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.157 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:25:28.157 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.966016+0000", 2024-04-01T19:25:28.157 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.011087837 2024-04-01T19:25:28.157 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.157 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.157 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:28.157 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.966064+0000", 2024-04-01T19:25:28.157 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7516999999999999e-05 2024-04-01T19:25:28.157 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.157 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.157 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:28.158 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:25.966098+0000", 2024-04-01T19:25:28.158 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.4272e-05 2024-04-01T19:25:28.158 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.158 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:28.158 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.158 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.158 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.158 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:71974 2.4 2:2aa74011:::benchmark_data_smithi188_77607_object71973:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e120)", 2024-04-01T19:25:28.158 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:25:26.537175+0000", 2024-04-01T19:25:28.158 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 1.5439943789999999, 2024-04-01T19:25:28.158 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.025706646999999999, 2024-04-01T19:25:28.158 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:28.158 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:28.158 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:28.159 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:25:28.159 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:25:28.159 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:25:28.159 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 71974 2024-04-01T19:25:28.159 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.159 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:28.161 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.161 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:28.161 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.537175+0000", 2024-04-01T19:25:28.161 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.161 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.162 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.162 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:28.162 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.537175+0000", 2024-04-01T19:25:28.162 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.162 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.162 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.162 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:28.162 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.537182+0000", 2024-04-01T19:25:28.162 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3699999999999997e-06 2024-04-01T19:25:28.162 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.162 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.162 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:28.162 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.537228+0000", 2024-04-01T19:25:28.163 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6264999999999998e-05 2024-04-01T19:25:28.163 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.163 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.163 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:28.163 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.537242+0000", 2024-04-01T19:25:28.163 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3854e-05 2024-04-01T19:25:28.163 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.163 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.163 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:28.163 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.537254+0000", 2024-04-01T19:25:28.163 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1501000000000001e-05 2024-04-01T19:25:28.163 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.163 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.163 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:28.164 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.537327+0000", 2024-04-01T19:25:28.164 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2976000000000001e-05 2024-04-01T19:25:28.164 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.164 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.164 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:28.164 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.537470+0000", 2024-04-01T19:25:28.164 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000143857 2024-04-01T19:25:28.164 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.164 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.164 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:25:28.164 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.537589+0000", 2024-04-01T19:25:28.164 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00011896900000000001 2024-04-01T19:25:28.164 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.164 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.165 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:25:28.165 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.547018+0000", 2024-04-01T19:25:28.165 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.009429036 2024-04-01T19:25:28.165 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.165 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.165 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:25:28.165 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.562794+0000", 2024-04-01T19:25:28.165 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.015776049 2024-04-01T19:25:28.165 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.165 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.165 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:28.165 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.562846+0000", 2024-04-01T19:25:28.165 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.1246999999999999e-05 2024-04-01T19:25:28.165 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.166 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.166 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:28.166 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.562881+0000", 2024-04-01T19:25:28.166 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5522999999999999e-05 2024-04-01T19:25:28.166 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.166 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:28.166 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.166 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.166 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.166 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:71975 2.6 2:6faa300f:::benchmark_data_smithi188_77607_object71974:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e120)", 2024-04-01T19:25:28.166 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:25:26.537282+0000", 2024-04-01T19:25:28.166 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 1.5438872020000001, 2024-04-01T19:25:28.167 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.024260925999999999, 2024-04-01T19:25:28.167 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:28.167 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:28.167 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:28.167 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:25:28.167 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:25:28.167 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:25:28.167 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 71975 2024-04-01T19:25:28.167 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.167 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:28.167 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.167 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:28.167 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.537282+0000", 2024-04-01T19:25:28.167 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.168 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.168 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.168 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:28.168 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.537282+0000", 2024-04-01T19:25:28.168 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.168 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.168 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.168 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:28.168 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.537283+0000", 2024-04-01T19:25:28.168 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.7899999999999997e-07 2024-04-01T19:25:28.168 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.168 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.168 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:28.168 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.537327+0000", 2024-04-01T19:25:28.169 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4433e-05 2024-04-01T19:25:28.169 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.169 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.169 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:28.169 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.537335+0000", 2024-04-01T19:25:28.169 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6599999999999995e-06 2024-04-01T19:25:28.169 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.169 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.169 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:28.169 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.537341+0000", 2024-04-01T19:25:28.169 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.229e-06 2024-04-01T19:25:28.169 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.169 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.169 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:28.170 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.540038+0000", 2024-04-01T19:25:28.170 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0026973750000000001 2024-04-01T19:25:28.170 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.170 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.170 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:28.170 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.540178+0000", 2024-04-01T19:25:28.170 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000140106 2024-04-01T19:25:28.170 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.170 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.170 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 8", 2024-04-01T19:25:28.170 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.540335+0000", 2024-04-01T19:25:28.170 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015653499999999999 2024-04-01T19:25:28.170 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.170 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.171 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:25:28.171 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.561400+0000", 2024-04-01T19:25:28.171 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.021065474000000001 2024-04-01T19:25:28.171 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.171 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.171 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:25:28.171 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.561416+0000", 2024-04-01T19:25:28.171 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.52e-05 2024-04-01T19:25:28.171 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.171 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.171 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:28.171 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.561473+0000", 2024-04-01T19:25:28.171 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6847e-05 2024-04-01T19:25:28.171 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.171 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.171 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:28.171 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.561543+0000", 2024-04-01T19:25:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0188e-05 2024-04-01T19:25:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:71976 2.6 2:63c59735:::benchmark_data_smithi188_77607_object71975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e120)", 2024-04-01T19:25:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:25:26.539824+0000", 2024-04-01T19:25:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 1.541344789, 2024-04-01T19:25:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.030826570000000001, 2024-04-01T19:25:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:25:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:25:28.173 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:25:28.173 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 71976 2024-04-01T19:25:28.173 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.173 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:28.173 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.173 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:28.173 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.539824+0000", 2024-04-01T19:25:28.173 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.173 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.173 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.173 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:28.173 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.539824+0000", 2024-04-01T19:25:28.174 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.174 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.174 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.174 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:28.174 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.539826+0000", 2024-04-01T19:25:28.174 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.818e-06 2024-04-01T19:25:28.174 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.174 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.174 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:28.174 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.539871+0000", 2024-04-01T19:25:28.174 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4885999999999997e-05 2024-04-01T19:25:28.174 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.174 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.174 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:28.175 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.539884+0000", 2024-04-01T19:25:28.175 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2771e-05 2024-04-01T19:25:28.175 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.175 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.175 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:28.175 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.539893+0000", 2024-04-01T19:25:28.175 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.3640000000000005e-06 2024-04-01T19:25:28.175 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.175 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.175 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:28.175 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.542585+0000", 2024-04-01T19:25:28.175 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0026924520000000001 2024-04-01T19:25:28.176 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.176 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.176 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:28.176 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.542704+0000", 2024-04-01T19:25:28.176 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000118832 2024-04-01T19:25:28.176 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.176 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.176 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 8", 2024-04-01T19:25:28.176 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.542841+0000", 2024-04-01T19:25:28.176 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013682700000000001 2024-04-01T19:25:28.176 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.176 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.176 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:25:28.176 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.564204+0000", 2024-04-01T19:25:28.177 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.021362985000000001 2024-04-01T19:25:28.177 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.177 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.177 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:25:28.177 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.570534+0000", 2024-04-01T19:25:28.177 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.006329721 2024-04-01T19:25:28.177 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.177 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.177 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:28.177 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.570597+0000", 2024-04-01T19:25:28.177 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2893999999999998e-05 2024-04-01T19:25:28.177 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.177 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.177 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:28.178 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.570651+0000", 2024-04-01T19:25:28.178 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4020000000000001e-05 2024-04-01T19:25:28.178 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.178 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:28.178 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.178 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.178 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.178 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:71983 2.6 2:64ee6610:::benchmark_data_smithi188_77607_object71982:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e120)", 2024-04-01T19:25:28.178 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:25:26.547525+0000", 2024-04-01T19:25:28.178 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 1.5336441330000001, 2024-04-01T19:25:28.178 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.023224597999999999, 2024-04-01T19:25:28.178 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:28.178 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:28.178 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:28.179 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:25:28.179 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:25:28.179 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:25:28.179 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 71983 2024-04-01T19:25:28.179 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.179 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:28.179 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.179 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:28.179 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.547525+0000", 2024-04-01T19:25:28.179 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.179 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.179 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.179 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:28.179 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.547525+0000", 2024-04-01T19:25:28.179 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.179 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.180 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.180 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:28.180 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.547526+0000", 2024-04-01T19:25:28.180 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5899999999999995e-07 2024-04-01T19:25:28.180 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.180 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.180 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:28.180 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.547559+0000", 2024-04-01T19:25:28.180 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3710000000000001e-05 2024-04-01T19:25:28.180 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.180 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.180 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:28.180 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.547566+0000", 2024-04-01T19:25:28.181 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.7710000000000001e-06 2024-04-01T19:25:28.181 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.181 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.181 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:28.181 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.547572+0000", 2024-04-01T19:25:28.181 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8799999999999996e-06 2024-04-01T19:25:28.181 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.181 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.181 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:28.181 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.547804+0000", 2024-04-01T19:25:28.181 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000232031 2024-04-01T19:25:28.181 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.181 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.181 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:28.182 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.547885+0000", 2024-04-01T19:25:28.182 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0712999999999998e-05 2024-04-01T19:25:28.182 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.182 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.182 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 8", 2024-04-01T19:25:28.182 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.547969+0000", 2024-04-01T19:25:28.182 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3869999999999995e-05 2024-04-01T19:25:28.182 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.182 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.182 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:25:28.182 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.564252+0000", 2024-04-01T19:25:28.182 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.016283328999999999 2024-04-01T19:25:28.182 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.182 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.183 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:25:28.183 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.570660+0000", 2024-04-01T19:25:28.183 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0064079569999999997 2024-04-01T19:25:28.183 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.183 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.183 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:28.183 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.570706+0000", 2024-04-01T19:25:28.183 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6452999999999997e-05 2024-04-01T19:25:28.183 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.183 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.183 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:28.183 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.570749+0000", 2024-04-01T19:25:28.183 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.3025000000000002e-05 2024-04-01T19:25:28.183 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.183 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:28.184 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.184 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.184 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.184 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:72006 2.4 2:27c3f54b:::benchmark_data_smithi188_77607_object72005:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e120)", 2024-04-01T19:25:28.184 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:25:26.563025+0000", 2024-04-01T19:25:28.184 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 1.5181444339999999, 2024-04-01T19:25:28.184 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.024935770999999999, 2024-04-01T19:25:28.184 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:28.184 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:28.184 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:28.184 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:25:28.184 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:25:28.184 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:25:28.184 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 72006 2024-04-01T19:25:28.184 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.184 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:28.185 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.185 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:28.185 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.563025+0000", 2024-04-01T19:25:28.185 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.185 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.185 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.185 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:28.185 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.563025+0000", 2024-04-01T19:25:28.185 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.185 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.185 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.185 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:28.185 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.563026+0000", 2024-04-01T19:25:28.185 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6440000000000001e-06 2024-04-01T19:25:28.185 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.185 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.186 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:28.186 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.563058+0000", 2024-04-01T19:25:28.186 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.2075e-05 2024-04-01T19:25:28.186 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.186 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.186 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:28.186 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.563067+0000", 2024-04-01T19:25:28.186 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6340000000000007e-06 2024-04-01T19:25:28.186 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.186 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.186 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:28.186 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.563074+0000", 2024-04-01T19:25:28.186 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9770000000000003e-06 2024-04-01T19:25:28.186 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.186 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.187 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:28.187 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.563195+0000", 2024-04-01T19:25:28.187 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000121521 2024-04-01T19:25:28.187 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.187 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.187 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:28.187 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.563344+0000", 2024-04-01T19:25:28.187 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014854700000000001 2024-04-01T19:25:28.187 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.187 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.187 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:25:28.187 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.563516+0000", 2024-04-01T19:25:28.187 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000172227 2024-04-01T19:25:28.187 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.187 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.188 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:25:28.188 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.567740+0000", 2024-04-01T19:25:28.188 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0042237250000000002 2024-04-01T19:25:28.188 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.188 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.188 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:25:28.188 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.587853+0000", 2024-04-01T19:25:28.188 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.020112851000000001 2024-04-01T19:25:28.188 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.188 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.188 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:28.188 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.587914+0000", 2024-04-01T19:25:28.188 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0760000000000001e-05 2024-04-01T19:25:28.188 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.188 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.189 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:28.189 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.587960+0000", 2024-04-01T19:25:28.189 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6810000000000001e-05 2024-04-01T19:25:28.189 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.189 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:28.189 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.189 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.189 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.189 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:72068 2.9 2:9e560d89:::benchmark_data_smithi188_77607_object72067:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e120)", 2024-04-01T19:25:28.189 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:25:26.594616+0000", 2024-04-01T19:25:28.189 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 1.4865533, 2024-04-01T19:25:28.189 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.028640274, 2024-04-01T19:25:28.189 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:28.189 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:28.190 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:28.190 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:25:28.190 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:25:28.190 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:25:28.190 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 72068 2024-04-01T19:25:28.190 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.190 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:28.190 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.190 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:28.190 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.594616+0000", 2024-04-01T19:25:28.190 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.190 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.190 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.190 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:28.191 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.594616+0000", 2024-04-01T19:25:28.191 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.191 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.191 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.191 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:28.191 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.594618+0000", 2024-04-01T19:25:28.191 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8449999999999999e-06 2024-04-01T19:25:28.191 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.191 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.191 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:28.191 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.594677+0000", 2024-04-01T19:25:28.191 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9107999999999997e-05 2024-04-01T19:25:28.191 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.191 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.191 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:28.191 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.594690+0000", 2024-04-01T19:25:28.192 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3171e-05 2024-04-01T19:25:28.192 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.192 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.192 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:28.192 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.594698+0000", 2024-04-01T19:25:28.192 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.8609999999999998e-06 2024-04-01T19:25:28.192 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.192 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.192 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:28.192 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.602901+0000", 2024-04-01T19:25:28.192 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0082033320000000007 2024-04-01T19:25:28.192 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.192 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.192 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:28.192 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.603032+0000", 2024-04-01T19:25:28.193 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000131187 2024-04-01T19:25:28.193 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.193 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.193 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 7", 2024-04-01T19:25:28.193 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.603165+0000", 2024-04-01T19:25:28.193 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013284700000000001 2024-04-01T19:25:28.193 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.193 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.193 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:25:28.193 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.611859+0000", 2024-04-01T19:25:28.193 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0086937669999999998 2024-04-01T19:25:28.193 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.193 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.193 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:25:28.193 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.623156+0000", 2024-04-01T19:25:28.193 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.011297588000000001 2024-04-01T19:25:28.194 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.194 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.194 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:28.194 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.623211+0000", 2024-04-01T19:25:28.194 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.499e-05 2024-04-01T19:25:28.194 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.194 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.194 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:28.194 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.623256+0000", 2024-04-01T19:25:28.194 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4577999999999999e-05 2024-04-01T19:25:28.194 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.194 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:28.194 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.194 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.195 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.195 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:72073 2.9 2:99e37d44:::benchmark_data_smithi188_77607_object72072:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e120)", 2024-04-01T19:25:28.195 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:25:26.598235+0000", 2024-04-01T19:25:28.195 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 1.482934339, 2024-04-01T19:25:28.195 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.025143548000000002, 2024-04-01T19:25:28.195 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:28.195 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:28.195 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:28.195 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:25:28.195 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:25:28.195 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:25:28.195 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 72073 2024-04-01T19:25:28.195 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.196 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:28.196 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.196 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:28.196 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.598235+0000", 2024-04-01T19:25:28.196 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.196 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.196 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.196 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:28.196 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.598235+0000", 2024-04-01T19:25:28.196 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.196 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.196 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.196 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:28.196 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.598236+0000", 2024-04-01T19:25:28.196 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.5799999999999998e-07 2024-04-01T19:25:28.196 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.197 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.197 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:28.197 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.598275+0000", 2024-04-01T19:25:28.197 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.8952000000000002e-05 2024-04-01T19:25:28.197 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.197 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.197 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:28.197 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.598286+0000", 2024-04-01T19:25:28.197 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1932e-05 2024-04-01T19:25:28.197 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.197 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.197 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:28.197 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.598293+0000", 2024-04-01T19:25:28.197 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8580000000000002e-06 2024-04-01T19:25:28.197 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.198 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.198 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:28.198 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.605524+0000", 2024-04-01T19:25:28.198 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0072305779999999997 2024-04-01T19:25:28.198 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.198 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.198 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:28.198 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.605674+0000", 2024-04-01T19:25:28.198 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015029099999999999 2024-04-01T19:25:28.198 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.198 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.198 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 7", 2024-04-01T19:25:28.198 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.607082+0000", 2024-04-01T19:25:28.198 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.001408051 2024-04-01T19:25:28.199 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.199 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.199 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:25:28.199 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.611864+0000", 2024-04-01T19:25:28.199 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0047821460000000001 2024-04-01T19:25:28.199 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.199 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.199 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:25:28.199 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.623301+0000", 2024-04-01T19:25:28.199 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.011436429999999999 2024-04-01T19:25:28.199 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.199 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.199 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:28.199 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.623343+0000", 2024-04-01T19:25:28.200 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.2589999999999997e-05 2024-04-01T19:25:28.200 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.200 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.200 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:28.200 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.623378+0000", 2024-04-01T19:25:28.200 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.4761999999999997e-05 2024-04-01T19:25:28.200 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.200 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:28.200 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.200 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.200 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.200 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:72178 2.4 2:2c4b360b:::benchmark_data_smithi188_77607_object72177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e120)", 2024-04-01T19:25:28.200 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:25:26.661808+0000", 2024-04-01T19:25:28.200 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 1.4193607619999999, 2024-04-01T19:25:28.201 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.026575043, 2024-04-01T19:25:28.201 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:28.201 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:28.201 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:28.201 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:25:28.201 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:25:28.201 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:25:28.201 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 72178 2024-04-01T19:25:28.201 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.201 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:28.201 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.201 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:28.201 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.661808+0000", 2024-04-01T19:25:28.201 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.202 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.202 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.202 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:28.202 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.661808+0000", 2024-04-01T19:25:28.202 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.202 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.202 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.202 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:28.202 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.661810+0000", 2024-04-01T19:25:28.202 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.469e-06 2024-04-01T19:25:28.202 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.202 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.202 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:28.203 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.661863+0000", 2024-04-01T19:25:28.203 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3282999999999998e-05 2024-04-01T19:25:28.203 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.203 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.203 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:28.203 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.661873+0000", 2024-04-01T19:25:28.203 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0379e-05 2024-04-01T19:25:28.203 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.203 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.203 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:28.203 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.661881+0000", 2024-04-01T19:25:28.203 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7200000000000006e-06 2024-04-01T19:25:28.203 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.203 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.203 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:28.204 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.661941+0000", 2024-04-01T19:25:28.204 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0127999999999998e-05 2024-04-01T19:25:28.204 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.204 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.204 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:28.204 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.662066+0000", 2024-04-01T19:25:28.204 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012431599999999999 2024-04-01T19:25:28.204 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.204 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.204 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:25:28.204 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.662205+0000", 2024-04-01T19:25:28.204 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013915800000000001 2024-04-01T19:25:28.204 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.204 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.205 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:25:28.205 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.673705+0000", 2024-04-01T19:25:28.205 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.011499855999999999 2024-04-01T19:25:28.205 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.205 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.205 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:25:28.205 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.688280+0000", 2024-04-01T19:25:28.205 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014575820999999999 2024-04-01T19:25:28.205 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.205 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.205 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:28.205 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.688338+0000", 2024-04-01T19:25:28.205 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7646999999999999e-05 2024-04-01T19:25:28.206 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.206 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.206 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:28.206 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:26.688383+0000", 2024-04-01T19:25:28.206 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5266000000000003e-05 2024-04-01T19:25:28.206 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.206 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:28.206 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.206 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.206 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.206 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:72969 2.6 2:6467a7e0:::benchmark_data_smithi188_77607_object72968:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e121)", 2024-04-01T19:25:28.206 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:25:27.073110+0000", 2024-04-01T19:25:28.206 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 1.0080587750000001, 2024-04-01T19:25:28.207 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.024742955000000001, 2024-04-01T19:25:28.207 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:28.207 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:28.207 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:28.207 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:25:28.207 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:25:28.207 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:25:28.207 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 72969 2024-04-01T19:25:28.207 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.207 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:28.207 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.207 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:28.207 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.073110+0000", 2024-04-01T19:25:28.208 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.208 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.208 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.208 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:28.208 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.073110+0000", 2024-04-01T19:25:28.208 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.208 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.208 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.208 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:28.208 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.073112+0000", 2024-04-01T19:25:28.208 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.669e-06 2024-04-01T19:25:28.208 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.208 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.208 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:28.208 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.073151+0000", 2024-04-01T19:25:28.208 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.888e-05 2024-04-01T19:25:28.209 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.209 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.209 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:28.209 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.073159+0000", 2024-04-01T19:25:28.209 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6899999999999998e-06 2024-04-01T19:25:28.209 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.209 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.209 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:28.209 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.073168+0000", 2024-04-01T19:25:28.209 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8939999999999999e-06 2024-04-01T19:25:28.209 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.209 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.209 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:28.209 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.085148+0000", 2024-04-01T19:25:28.210 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.01197929 2024-04-01T19:25:28.210 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.210 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.210 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:28.210 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.085264+0000", 2024-04-01T19:25:28.210 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000116439 2024-04-01T19:25:28.210 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.210 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.210 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 8", 2024-04-01T19:25:28.210 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.085384+0000", 2024-04-01T19:25:28.210 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000119979 2024-04-01T19:25:28.210 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.210 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.210 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:25:28.211 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.090207+0000", 2024-04-01T19:25:28.211 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0048231799999999998 2024-04-01T19:25:28.211 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.211 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.211 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:25:28.211 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.097738+0000", 2024-04-01T19:25:28.211 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0075308900000000002 2024-04-01T19:25:28.211 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.211 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.211 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:28.211 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.097803+0000", 2024-04-01T19:25:28.211 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5141000000000005e-05 2024-04-01T19:25:28.211 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.211 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.212 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:28.212 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.097853+0000", 2024-04-01T19:25:28.212 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9903e-05 2024-04-01T19:25:28.212 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.212 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:28.212 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.212 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.212 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.212 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:72972 2.6 2:65cedea4:::benchmark_data_smithi188_77607_object72971:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e121)", 2024-04-01T19:25:28.212 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:25:27.073183+0000", 2024-04-01T19:25:28.212 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 1.007985753, 2024-04-01T19:25:28.212 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.029145278, 2024-04-01T19:25:28.212 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:28.212 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:28.213 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:28.213 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:25:28.213 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:25:28.213 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:25:28.213 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 72972 2024-04-01T19:25:28.213 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.213 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:28.213 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.213 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:28.213 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.073183+0000", 2024-04-01T19:25:28.213 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.213 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.213 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.214 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:28.214 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.073183+0000", 2024-04-01T19:25:28.214 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.214 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.214 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.214 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:28.214 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.073184+0000", 2024-04-01T19:25:28.214 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5799999999999998e-07 2024-04-01T19:25:28.214 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.214 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.214 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:28.214 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.073210+0000", 2024-04-01T19:25:28.214 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6118999999999998e-05 2024-04-01T19:25:28.214 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.215 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.215 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:28.215 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.073217+0000", 2024-04-01T19:25:28.215 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5640000000000002e-06 2024-04-01T19:25:28.215 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.215 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.215 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:28.215 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.073223+0000", 2024-04-01T19:25:28.215 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.7549999999999997e-06 2024-04-01T19:25:28.215 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.215 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.215 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:28.215 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.087481+0000", 2024-04-01T19:25:28.215 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014257611999999999 2024-04-01T19:25:28.216 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.216 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.216 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:28.216 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.087597+0000", 2024-04-01T19:25:28.216 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00011570600000000001 2024-04-01T19:25:28.216 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.216 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.216 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 8", 2024-04-01T19:25:28.216 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.087728+0000", 2024-04-01T19:25:28.216 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000131419 2024-04-01T19:25:28.216 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.216 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.216 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:25:28.217 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.093046+0000", 2024-04-01T19:25:28.217 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0053182780000000001 2024-04-01T19:25:28.217 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.217 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.217 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:25:28.217 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.102218+0000", 2024-04-01T19:25:28.217 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.009171996 2024-04-01T19:25:28.217 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.217 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.217 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:28.217 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.102278+0000", 2024-04-01T19:25:28.217 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9077999999999999e-05 2024-04-01T19:25:28.217 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.217 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.218 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:28.218 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.102329+0000", 2024-04-01T19:25:28.218 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0992999999999998e-05 2024-04-01T19:25:28.218 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.218 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:28.218 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.218 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.218 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.218 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:72986 2.4 2:281ae8e0:::benchmark_data_smithi188_77607_object72985:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e121)", 2024-04-01T19:25:28.218 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:25:27.084139+0000", 2024-04-01T19:25:28.218 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.99703004399999995, 2024-04-01T19:25:28.218 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.027792383, 2024-04-01T19:25:28.219 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:28.219 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:28.219 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:28.219 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:25:28.219 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:25:28.219 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:25:28.219 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 72986 2024-04-01T19:25:28.219 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.219 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:28.219 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.219 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:28.219 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.084139+0000", 2024-04-01T19:25:28.219 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.219 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.220 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.220 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:28.220 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.084139+0000", 2024-04-01T19:25:28.220 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.220 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.220 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.220 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:28.220 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.084140+0000", 2024-04-01T19:25:28.220 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.406e-06 2024-04-01T19:25:28.220 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.220 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.220 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:28.220 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.084176+0000", 2024-04-01T19:25:28.220 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5499e-05 2024-04-01T19:25:28.220 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.221 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.221 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:28.221 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.084187+0000", 2024-04-01T19:25:28.221 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1401e-05 2024-04-01T19:25:28.221 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.221 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.221 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:28.221 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.084198+0000", 2024-04-01T19:25:28.221 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0268000000000001e-05 2024-04-01T19:25:28.221 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.221 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.221 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:28.221 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.084259+0000", 2024-04-01T19:25:28.221 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1548000000000001e-05 2024-04-01T19:25:28.222 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.222 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.222 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:28.222 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.084466+0000", 2024-04-01T19:25:28.222 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000206782 2024-04-01T19:25:28.222 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.222 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.222 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:25:28.222 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.084626+0000", 2024-04-01T19:25:28.222 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00016035499999999999 2024-04-01T19:25:28.222 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.222 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.222 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:25:28.223 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.098309+0000", 2024-04-01T19:25:28.223 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.013683178000000001 2024-04-01T19:25:28.223 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.223 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.223 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:25:28.223 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.111817+0000", 2024-04-01T19:25:28.223 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.013507485 2024-04-01T19:25:28.223 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.223 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.223 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:28.223 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.111879+0000", 2024-04-01T19:25:28.223 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2160000000000001e-05 2024-04-01T19:25:28.223 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.223 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.223 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:28.224 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.111931+0000", 2024-04-01T19:25:28.224 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2301e-05 2024-04-01T19:25:28.224 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.224 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:28.224 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.224 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.224 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.224 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:72987 2.4 2:208a21f2:::benchmark_data_smithi188_77607_object72986:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e121)", 2024-04-01T19:25:28.224 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:25:27.084222+0000", 2024-04-01T19:25:28.224 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.99694715499999997, 2024-04-01T19:25:28.224 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.027864060999999999, 2024-04-01T19:25:28.224 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:28.224 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:28.224 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:28.225 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:25:28.225 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:25:28.225 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:25:28.225 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 72987 2024-04-01T19:25:28.225 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.225 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:28.225 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.225 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:28.225 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.084222+0000", 2024-04-01T19:25:28.225 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.225 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.225 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.225 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:28.225 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.084222+0000", 2024-04-01T19:25:28.225 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.226 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.226 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.226 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:28.226 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.084223+0000", 2024-04-01T19:25:28.226 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.266e-06 2024-04-01T19:25:28.226 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.226 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.226 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:28.226 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.084287+0000", 2024-04-01T19:25:28.226 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3987999999999998e-05 2024-04-01T19:25:28.226 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.226 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.226 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:28.226 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.084295+0000", 2024-04-01T19:25:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7340000000000008e-06 2024-04-01T19:25:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.084307+0000", 2024-04-01T19:25:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2666999999999999e-05 2024-04-01T19:25:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.086954+0000", 2024-04-01T19:25:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0026465960000000002 2024-04-01T19:25:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.087065+0000", 2024-04-01T19:25:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000111174 2024-04-01T19:25:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:25:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.087195+0000", 2024-04-01T19:25:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012982900000000001 2024-04-01T19:25:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:25:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.100739+0000", 2024-04-01T19:25:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.01354436 2024-04-01T19:25:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:25:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.111970+0000", 2024-04-01T19:25:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.011230983 2024-04-01T19:25:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.112021+0000", 2024-04-01T19:25:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0532999999999999e-05 2024-04-01T19:25:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.112086+0000", 2024-04-01T19:25:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4931000000000006e-05 2024-04-01T19:25:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:72995 2.4 2:205aef54:::benchmark_data_smithi188_77607_object72994:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e121)", 2024-04-01T19:25:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:25:27.088167+0000", 2024-04-01T19:25:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.99300173800000002, 2024-04-01T19:25:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.024037422999999999, 2024-04-01T19:25:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:25:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:25:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:25:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:25:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:25:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:25:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 72995 2024-04-01T19:25:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:25:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:25:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.088167+0000", 2024-04-01T19:25:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:25:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.088167+0000", 2024-04-01T19:25:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:25:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:25:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.088170+0000", 2024-04-01T19:25:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6740000000000001e-06 2024-04-01T19:25:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:25:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.088200+0000", 2024-04-01T19:25:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.9838000000000001e-05 2024-04-01T19:25:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:25:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.088211+0000", 2024-04-01T19:25:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1471000000000001e-05 2024-04-01T19:25:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:25:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.088220+0000", 2024-04-01T19:25:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6549999999999993e-06 2024-04-01T19:25:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:25:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.089453+0000", 2024-04-01T19:25:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0012329660000000001 2024-04-01T19:25:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:25:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.089575+0000", 2024-04-01T19:25:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012223799999999999 2024-04-01T19:25:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:25:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.089702+0000", 2024-04-01T19:25:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012713500000000001 2024-04-01T19:25:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:25:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.100751+0000", 2024-04-01T19:25:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.011048383 2024-04-01T19:25:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:25:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.112145+0000", 2024-04-01T19:25:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.011394639999999999 2024-04-01T19:25:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:25:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.112180+0000", 2024-04-01T19:25:28.235 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.4999999999999997e-05 2024-04-01T19:25:28.235 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:25:28.235 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:25:28.235 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:25:28.235 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:25:27.112205+0000", 2024-04-01T19:25:28.235 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4423e-05 2024-04-01T19:25:28.235 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.235 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:28.235 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.235 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:25:28.235 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:25:28.235 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:25:28.235 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:25:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:28 smithi062 ceph-mon[44211]: pgmap v378: 17 pgs: 17 active+clean; 4.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 154 MiB/s wr, 2.46k op/s 2024-04-01T19:25:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:28 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:25:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:28 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:25:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:28 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3084847208' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:25:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:28 smithi062 ceph-mon[44211]: osdmap e121: 12 total, 12 up, 12 in 2024-04-01T19:25:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:28 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:25:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:28 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:25:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:25:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:25:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:25:28.286 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:28.314 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:25:28.318 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:28.319 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:25:28.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:28 smithi022 ceph-mon[39439]: pgmap v378: 17 pgs: 17 active+clean; 4.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 154 MiB/s wr, 2.46k op/s 2024-04-01T19:25:28.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:28 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:25:28.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:28 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:25:28.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:28 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3084847208' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:25:28.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:28 smithi022 ceph-mon[39439]: osdmap e121: 12 total, 12 up, 12 in 2024-04-01T19:25:28.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:28 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:25:28.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:28 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:25:28.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:25:28.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:25:28.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:25:28.420 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:25:28.463 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:28.494 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:25:28.500 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:28.500 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:25:28.601 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:25:28.646 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:28.666 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 24 16 76106 76090 198.117 129.562 0.00468945 0.00504582 2024-04-01T19:25:28.676 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:25:28.681 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:28.681 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:25:28.782 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:25:28.832 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:28.920 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:25:28.936 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:28.937 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:25:29.038 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:25:29.069 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:29.095 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:25:29.097 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:29.098 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:25:29.199 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:25:29.268 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:29.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:29 smithi022 ceph-mon[39439]: osdmap e122: 12 total, 12 up, 12 in 2024-04-01T19:25:29.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:29 smithi188 ceph-mon[43939]: osdmap e122: 12 total, 12 up, 12 in 2024-04-01T19:25:29.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:29 smithi062 ceph-mon[44211]: osdmap e122: 12 total, 12 up, 12 in 2024-04-01T19:25:29.666 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 25 16 78295 78279 195.665 136.812 0.00711171 0.00510896 2024-04-01T19:25:29.678 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:25:29.685 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:25:29.694 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:29.695 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:25:29.797 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:25:29.841 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:30.243 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_ops_in_flight 2024-04-01T19:25:30.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:30 smithi022 ceph-mon[39439]: pgmap v381: 17 pgs: 17 active+clean; 4.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 135 MiB/s wr, 2.16k op/s 2024-04-01T19:25:30.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:30 smithi188 ceph-mon[43939]: pgmap v381: 17 pgs: 17 active+clean; 4.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 135 MiB/s wr, 2.16k op/s 2024-04-01T19:25:30.417 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:25:30.419 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:30.420 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:25:30.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:30 smithi062 ceph-mon[44211]: pgmap v381: 17 pgs: 17 active+clean; 4.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 135 MiB/s wr, 2.16k op/s 2024-04-01T19:25:30.520 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:25:30.550 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:30.573 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:25:30.578 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:30.578 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:25:30.666 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 26 16 80323 80307 193.014 126.75 0.00321053 0.00517875 2024-04-01T19:25:30.678 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:25:30.724 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:30.746 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:25:30.750 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:30.751 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:25:30.852 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:25:30.905 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:30.939 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:25:30.942 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:30.943 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:25:31.044 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:25:31.088 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:31.115 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:25:31.119 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:31.120 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:25:31.220 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:25:31.256 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:31.282 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:25:31.283 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:25:31.286 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:31.286 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:25:31.387 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:25:31.416 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:31.439 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:25:31.441 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:31.442 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:25:31.543 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:25:31.572 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:31.596 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:25:31.600 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:31.600 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:25:31.666 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 27 16 82299 82283 190.439 123.5 0.00331239 0.00524969 2024-04-01T19:25:31.700 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:25:31.732 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:31.753 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:25:31.758 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:31.759 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:25:31.860 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:25:31.893 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:31.917 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:25:31.921 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:31.922 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:25:32.023 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:25:32.052 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:32.075 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:25:32.079 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:32.079 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:25:32.108 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.1 to 1 (10000) 2024-04-01T19:25:32.181 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:25:32.238 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:32.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:32 smithi022 ceph-mon[39439]: pgmap v382: 17 pgs: 17 active+clean; 4.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 142 MiB/s wr, 2.28k op/s 2024-04-01T19:25:32.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:32 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/414650796' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T19:25:32.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:32 smithi022 ceph-mon[39439]: from='client.34769 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T19:25:32.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:32 smithi188 ceph-mon[43939]: pgmap v382: 17 pgs: 17 active+clean; 4.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 142 MiB/s wr, 2.28k op/s 2024-04-01T19:25:32.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:32 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/414650796' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T19:25:32.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:32 smithi188 ceph-mon[43939]: from='client.34769 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T19:25:32.459 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:25:32.488 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:25:32.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:32 smithi062 ceph-mon[44211]: pgmap v382: 17 pgs: 17 active+clean; 4.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 142 MiB/s wr, 2.28k op/s 2024-04-01T19:25:32.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:32 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/414650796' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T19:25:32.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:32 smithi062 ceph-mon[44211]: from='client.34769 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T19:25:32.515 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:25:32.555 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:25:32.583 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:25:32.615 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:25:32.620 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:32.621 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:25:32.622 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:25:32.661 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:25:32.666 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 28 16 84162 84146 187.796 116.438 0.00471997 0.00532316 2024-04-01T19:25:32.695 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:25:32.721 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:25:32.727 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:25:32.752 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:32.757 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:25:32.774 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:25:32.778 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:32.779 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:25:32.791 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:25:32.831 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:25:32.833 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:25:32.833 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:25:32.833 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:25:32.833 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:25:32.833 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:25:32.834 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:25:32.834 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:25:32.834 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:25:32.834 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:25:32.834 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:25:32.834 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:25:32.834 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:25:32.880 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:25:32.910 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:32.937 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:25:32.940 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:32.940 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:25:33.041 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:25:33.080 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:33.096 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 2 1 2024-04-01T19:25:33.110 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:25:33.114 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:33.115 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:25:33.216 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:25:33.260 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:33.283 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:25:33.287 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:33.288 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:25:33.293 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:25:33.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:33 smithi022 ceph-mon[39439]: from='client.34769 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-04-01T19:25:33.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:33 smithi022 ceph-mon[39439]: osdmap e123: 12 total, 12 up, 12 in 2024-04-01T19:25:33.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:33 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2174332821' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:25:33.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:33.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:33.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:33.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:33.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:33.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:33.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:33.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:33 smithi188 ceph-mon[43939]: from='client.34769 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-04-01T19:25:33.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:33 smithi188 ceph-mon[43939]: osdmap e123: 12 total, 12 up, 12 in 2024-04-01T19:25:33.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:33 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2174332821' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:25:33.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:33.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:33.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:33.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:33.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:33.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:33.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:33.389 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:25:33.426 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:33.453 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:25:33.458 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:33.458 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:25:33.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:33 smithi062 ceph-mon[44211]: from='client.34769 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-04-01T19:25:33.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:33 smithi062 ceph-mon[44211]: osdmap e123: 12 total, 12 up, 12 in 2024-04-01T19:25:33.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:33 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2174332821' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:25:33.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:33.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:33.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:33.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:33.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:33.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:33.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:33.559 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:25:33.600 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:33.666 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 29 16 86105 86089 185.508 121.438 0.00948784 0.00538928 2024-04-01T19:25:33.761 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:25:33.766 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:33.767 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:25:33.868 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:25:33.915 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:33.945 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:25:33.950 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:33.950 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:25:34.036 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:25:34.050 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:25:34.095 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:34.123 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:25:34.126 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:34.127 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:25:34.228 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:25:34.280 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:34.311 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:34.311 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:34 smithi022 ceph-mon[39439]: pgmap v384: 17 pgs: 17 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 136 MiB/s wr, 2.18k op/s 2024-04-01T19:25:34.311 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:34.311 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:34.311 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:34.311 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:34.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:34.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:34 smithi188 ceph-mon[43939]: pgmap v384: 17 pgs: 17 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 136 MiB/s wr, 2.18k op/s 2024-04-01T19:25:34.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:34.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:34.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:34.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:34.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:34.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:34 smithi062 ceph-mon[44211]: pgmap v384: 17 pgs: 17 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 136 MiB/s wr, 2.18k op/s 2024-04-01T19:25:34.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:34.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:34.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:34.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:34.666 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 30 16 88044 88028 183.364 121.188 0.00291625 0.00545198 2024-04-01T19:25:35.666 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 31 16 90050 90034 181.493 125.375 0.00344937 0.00550868 2024-04-01T19:25:35.751 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:25:35.759 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:35.760 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:25:35.797 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:25:35.861 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:25:35.909 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:35 smithi062 ceph-mon[44211]: pgmap v385: 17 pgs: 17 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 139 MiB/s wr, 2.23k op/s 2024-04-01T19:25:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:35 smithi062 ceph-mon[44211]: osdmap e124: 12 total, 12 up, 12 in 2024-04-01T19:25:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:35 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:25:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:35 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:25:36.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:35 smithi022 ceph-mon[39439]: pgmap v385: 17 pgs: 17 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 139 MiB/s wr, 2.23k op/s 2024-04-01T19:25:36.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:35 smithi022 ceph-mon[39439]: osdmap e124: 12 total, 12 up, 12 in 2024-04-01T19:25:36.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:35 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:25:36.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:35 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:25:36.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:35 smithi188 ceph-mon[43939]: pgmap v385: 17 pgs: 17 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 139 MiB/s wr, 2.23k op/s 2024-04-01T19:25:36.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:35 smithi188 ceph-mon[43939]: osdmap e124: 12 total, 12 up, 12 in 2024-04-01T19:25:36.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:35 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:25:36.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:35 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:25:36.668 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 32 15 91900 91885 179.436 115.688 0.00733138 0.00557188 2024-04-01T19:25:36.694 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:25:36.703 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:36.704 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:25:36.805 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:25:36.834 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:36.856 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:25:36.860 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:36.860 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:25:36.961 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:25:37.000 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:37.025 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:25:37.029 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:37.030 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:25:37.130 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:25:37.186 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:37.188 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:25:37.276 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:25:37.276 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:25:37.300 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:37 smithi022 ceph-mon[39439]: osdmap e125: 12 total, 12 up, 12 in 2024-04-01T19:25:37.320 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:25:37.324 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:37.325 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:25:37.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:37 smithi188 ceph-mon[43939]: osdmap e125: 12 total, 12 up, 12 in 2024-04-01T19:25:37.425 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:25:37.455 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:37 smithi062 ceph-mon[44211]: osdmap e125: 12 total, 12 up, 12 in 2024-04-01T19:25:37.458 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:37.482 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:25:37.485 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:37.486 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:25:37.587 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:25:37.627 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:37.656 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:25:37.661 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:37.662 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:25:37.666 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 33 16 93704 93688 177.414 112.688 0.00350061 0.00563476 2024-04-01T19:25:37.762 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:25:37.814 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:37.898 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:25:37.903 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:37.904 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:25:38.005 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:25:38.044 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:38.077 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:25:38.080 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:38.081 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:25:38.181 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:25:38.185 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:25:38.235 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:38.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:38 smithi188 ceph-mon[43939]: pgmap v388: 17 pgs: 17 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 116 MiB/s wr, 1.85k op/s 2024-04-01T19:25:38.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:38 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2934609977' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:25:38.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:38 smithi188 ceph-mon[43939]: from='client.34781 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:25:38.508 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:25:38.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:38 smithi062 ceph-mon[44211]: pgmap v388: 17 pgs: 17 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 116 MiB/s wr, 1.85k op/s 2024-04-01T19:25:38.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:38 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2934609977' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:25:38.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:38 smithi062 ceph-mon[44211]: from='client.34781 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:25:38.513 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:38.514 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:38 smithi022 ceph-mon[39439]: pgmap v388: 17 pgs: 17 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 116 MiB/s wr, 1.85k op/s 2024-04-01T19:25:38.514 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:38 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2934609977' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:25:38.514 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:38 smithi022 ceph-mon[39439]: from='client.34781 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:25:38.514 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:25:38.615 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:25:38.658 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:38.666 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 34 15 95503 95488 175.504 112.5 0.0169216 0.00569632 2024-04-01T19:25:39.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:39 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:25:39.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:39 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:25:39.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:39 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:25:39.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:39 smithi022 ceph-mon[39439]: from='client.34781 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:25:39.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:39 smithi022 ceph-mon[39439]: osdmap e126: 12 total, 12 up, 12 in 2024-04-01T19:25:39.484 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_blocked_ops 2024-04-01T19:25:39.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:39 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:25:39.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:39 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:25:39.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:39 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:25:39.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:39 smithi062 ceph-mon[44211]: from='client.34781 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:25:39.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:39 smithi062 ceph-mon[44211]: osdmap e126: 12 total, 12 up, 12 in 2024-04-01T19:25:39.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:39 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:25:39.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:39 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:25:39.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:39 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:25:39.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:39 smithi188 ceph-mon[43939]: from='client.34781 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:25:39.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:39 smithi188 ceph-mon[43939]: osdmap e126: 12 total, 12 up, 12 in 2024-04-01T19:25:39.666 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 35 16 97376 97360 173.832 117 0.00812692 0.00575147 2024-04-01T19:25:39.704 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:25:40.126 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:25:40.136 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:40.136 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:25:40.237 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:25:40.295 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:40.383 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:25:40.389 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:40.390 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:25:40.393 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:40 smithi022 ceph-mon[39439]: pgmap v390: 17 pgs: 17 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 115 MiB/s wr, 1.84k op/s 2024-04-01T19:25:40.490 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:25:40.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:40 smithi062 ceph-mon[44211]: pgmap v390: 17 pgs: 17 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 115 MiB/s wr, 1.84k op/s 2024-04-01T19:25:40.531 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:40 smithi188 ceph-mon[43939]: pgmap v390: 17 pgs: 17 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 115 MiB/s wr, 1.84k op/s 2024-04-01T19:25:40.534 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:40.563 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:25:40.567 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:40.567 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:25:40.666 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 36 16 99133 99117 172.054 109.812 0.0155719 0.0058104 2024-04-01T19:25:40.668 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:25:40.708 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:40.737 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:25:40.741 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:40.742 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:25:40.842 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:25:40.901 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:41.037 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:25:41.038 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:25:41.042 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:41.043 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:25:41.143 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:25:41.174 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:41.185 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.2 to 1 (10000) 2024-04-01T19:25:41.198 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:25:41.203 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:41.203 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:25:41.304 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:25:41.339 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:41.342 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:41 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3362478711' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:25:41.342 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:41 smithi022 ceph-mon[39439]: from='client.34787 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:25:41.364 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:25:41.367 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:41.367 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:25:41.468 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:25:41.502 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:41 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3362478711' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:25:41.502 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:41 smithi062 ceph-mon[44211]: from='client.34787 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:25:41.505 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:41.527 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:25:41.532 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:41.533 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:25:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:41 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3362478711' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:25:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:41 smithi188 ceph-mon[43939]: from='client.34787 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:25:41.633 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:25:41.667 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 37 16 100819 100803 170.249 105.375 0.00611935 0.00587184 2024-04-01T19:25:41.685 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:41.711 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:25:41.714 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:41.714 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:25:41.815 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:25:41.855 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:41.880 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:25:41.883 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:41.883 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:25:41.984 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:25:42.016 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:42.038 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:25:42.043 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:42.043 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:25:42.144 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:25:42.182 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:42.213 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:25:42.218 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:42.219 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:25:42.320 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:25:42.348 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:42 smithi062 ceph-mon[44211]: pgmap v391: 17 pgs: 17 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 124 MiB/s wr, 1.99k op/s 2024-04-01T19:25:42.348 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:42 smithi062 ceph-mon[44211]: from='client.34787 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-04-01T19:25:42.348 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:42 smithi062 ceph-mon[44211]: osdmap e127: 12 total, 12 up, 12 in 2024-04-01T19:25:42.348 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:42 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:25:42.348 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:42 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:25:42.351 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:42.374 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:25:42.377 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:42.378 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:25:42.479 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:25:42.511 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:42 smithi188 ceph-mon[43939]: pgmap v391: 17 pgs: 17 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 124 MiB/s wr, 1.99k op/s 2024-04-01T19:25:42.511 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:42 smithi188 ceph-mon[43939]: from='client.34787 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-04-01T19:25:42.511 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:42 smithi188 ceph-mon[43939]: osdmap e127: 12 total, 12 up, 12 in 2024-04-01T19:25:42.511 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:42 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:25:42.511 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:42 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:25:42.513 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:42.543 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:25:42.547 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:42.548 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:25:42.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:42 smithi022 ceph-mon[39439]: pgmap v391: 17 pgs: 17 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 124 MiB/s wr, 1.99k op/s 2024-04-01T19:25:42.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:42 smithi022 ceph-mon[39439]: from='client.34787 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-04-01T19:25:42.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:42 smithi022 ceph-mon[39439]: osdmap e127: 12 total, 12 up, 12 in 2024-04-01T19:25:42.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:42 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:25:42.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:42 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:25:42.649 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:25:42.659 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:25:42.667 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 38 16 102551 102535 168.617 108.25 0.006873 0.00592927 2024-04-01T19:25:42.692 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:42.722 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:25:42.725 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:42.725 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:25:42.826 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:25:42.885 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:43.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:43 smithi062 ceph-mon[44211]: osdmap e128: 12 total, 12 up, 12 in 2024-04-01T19:25:43.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:43 smithi022 ceph-mon[39439]: osdmap e128: 12 total, 12 up, 12 in 2024-04-01T19:25:43.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:43 smithi188 ceph-mon[43939]: osdmap e128: 12 total, 12 up, 12 in 2024-04-01T19:25:43.667 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 39 15 104259 104244 167.033 106.812 0.00398606 0.00598474 2024-04-01T19:25:44.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:44 smithi062 ceph-mon[44211]: pgmap v394: 17 pgs: 17 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 121 MiB/s wr, 1.94k op/s 2024-04-01T19:25:44.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:44 smithi022 ceph-mon[39439]: pgmap v394: 17 pgs: 17 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 121 MiB/s wr, 1.94k op/s 2024-04-01T19:25:44.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:44 smithi188 ceph-mon[43939]: pgmap v394: 17 pgs: 17 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 121 MiB/s wr, 1.94k op/s 2024-04-01T19:25:44.668 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:25:44.670486 min lat: 0.00106051 max lat: 0.0891891 avg lat: 0.00603928 2024-04-01T19:25:44.668 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:25:44.668 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 40 16 105975 105959 165.536 107.188 0.00680163 0.00603928 2024-04-01T19:25:45.668 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 41 16 107661 107645 164.069 105.375 0.0032827 0.00609265 2024-04-01T19:25:46.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:46 smithi062 ceph-mon[44211]: pgmap v395: 17 pgs: 17 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 108 MiB/s wr, 1.73k op/s 2024-04-01T19:25:46.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:46 smithi022 ceph-mon[39439]: pgmap v395: 17 pgs: 17 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 108 MiB/s wr, 1.73k op/s 2024-04-01T19:25:46.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:46 smithi188 ceph-mon[43939]: pgmap v395: 17 pgs: 17 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 108 MiB/s wr, 1.73k op/s 2024-04-01T19:25:46.669 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 42 16 109380 109364 162.715 107.438 0.00461387 0.00614424 2024-04-01T19:25:47.669 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 43 16 111011 110995 161.302 101.938 0.00398911 0.00619805 2024-04-01T19:25:48.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:48 smithi062 ceph-mon[44211]: pgmap v396: 17 pgs: 17 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 112 MiB/s wr, 1.80k op/s 2024-04-01T19:25:48.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:48 smithi022 ceph-mon[39439]: pgmap v396: 17 pgs: 17 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 112 MiB/s wr, 1.80k op/s 2024-04-01T19:25:48.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:48 smithi188 ceph-mon[43939]: pgmap v396: 17 pgs: 17 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 112 MiB/s wr, 1.80k op/s 2024-04-01T19:25:48.669 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 44 15 112683 112668 160.012 104.562 0.00530614 0.00624806 2024-04-01T19:25:48.872 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:25:48.875 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:48.875 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:25:48.976 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:25:49.020 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:49.295 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:25:49.299 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:49.299 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:25:49.333 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 3 1 2024-04-01T19:25:49.400 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:25:49.443 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:49.475 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:25:49.483 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:49.483 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:25:49.584 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:25:49.665 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:49.672 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 45 16 114280 114264 158.662 99.75 0.00992892 0.00630075 2024-04-01T19:25:49.698 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:25:49.712 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:49.712 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:25:49.814 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:25:49.849 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:49.878 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:25:49.882 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:49.883 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:25:49.984 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:25:50.019 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:50.046 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:25:50.049 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:50.049 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:25:50.150 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:25:50.196 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:50.224 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:25:50.229 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:50.230 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:25:50.286 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:50 smithi022 ceph-mon[39439]: pgmap v397: 17 pgs: 17 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 101 MiB/s wr, 1.62k op/s 2024-04-01T19:25:50.330 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:25:50.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:50 smithi188 ceph-mon[43939]: pgmap v397: 17 pgs: 17 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 101 MiB/s wr, 1.62k op/s 2024-04-01T19:25:50.389 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:50.455 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:25:50.461 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:50.462 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:25:50.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:50 smithi062 ceph-mon[44211]: pgmap v397: 17 pgs: 17 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 101 MiB/s wr, 1.62k op/s 2024-04-01T19:25:50.577 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:25:50.636 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:50.672 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 46 16 115823 115807 157.31 96.4375 0.00504166 0.00635524 2024-04-01T19:25:50.906 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:25:50.906 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:25:50.922 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:25:51.055 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:25:51.063 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:25:51.098 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:25:51.139 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:25:51.171 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:25:51.197 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:25:51.237 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:25:51.277 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:25:51.298 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:25:51.307 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:51.307 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:25:51.316 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:25:51.320 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:25:51.360 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:25:51.405 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:25:51.408 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:25:51.432 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:25:51.454 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:25:51.455 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:25:51.455 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:25:51.455 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:25:51.455 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:25:51.455 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:25:51.455 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:25:51.455 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:25:51.455 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:25:51.455 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:25:51.455 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:25:51.455 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:25:51.461 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:51.478 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:51 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3411023654' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:25:51.478 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:51.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:51 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3411023654' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:25:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:51.544 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:25:51.551 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:51.551 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:25:51.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:51 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3411023654' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:25:51.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:51.652 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:25:51.672 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 47 16 117274 117258 155.892 90.6875 0.0076744 0.00641296 2024-04-01T19:25:51.687 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:51.710 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:25:51.713 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:51.714 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:25:51.815 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:25:51.867 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:51.896 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:25:51.898 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:51.899 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:25:52.000 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:25:52.030 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:52.054 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:25:52.057 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:52.057 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:25:52.158 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:25:52.215 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:52.327 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:25:52.330 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:52.331 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:25:52.432 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:25:52.469 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:52.485 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:52 smithi022 ceph-mon[39439]: pgmap v398: 17 pgs: 17 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 113 MiB/s wr, 1.80k op/s 2024-04-01T19:25:52.485 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.485 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.485 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.485 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.486 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.486 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.486 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.486 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.486 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.490 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:25:52.492 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:52 smithi188 ceph-mon[43939]: pgmap v398: 17 pgs: 17 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 113 MiB/s wr, 1.80k op/s 2024-04-01T19:25:52.492 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.492 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.492 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.492 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.492 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.492 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.492 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.492 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.492 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.493 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:52.493 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:25:52.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:52 smithi062 ceph-mon[44211]: pgmap v398: 17 pgs: 17 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 113 MiB/s wr, 1.80k op/s 2024-04-01T19:25:52.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:52.594 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:25:52.622 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:52.653 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:25:52.656 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:52.657 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:25:52.672 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 48 15 118740 118725 154.555 91.6875 0.00491532 0.00646896 2024-04-01T19:25:52.757 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:25:52.799 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:53.279 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_historic_ops 2024-04-01T19:25:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:53.574 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:25:53.586 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:53.586 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:25:53.587 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:53.587 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:25:53.672 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 49 16 120253 120237 153.329 94.5 0.0129586 0.00652053 2024-04-01T19:25:53.688 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:25:53.739 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:54.361 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:25:54.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:54 smithi022 ceph-mon[39439]: pgmap v399: 17 pgs: 17 active+clean; 7.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 113 MiB/s wr, 1.81k op/s 2024-04-01T19:25:54.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:54 smithi188 ceph-mon[43939]: pgmap v399: 17 pgs: 17 active+clean; 7.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 113 MiB/s wr, 1.81k op/s 2024-04-01T19:25:54.673 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 50 16 121801 121785 152.198 96.75 0.0117511 0.00656856 2024-04-01T19:25:54.717 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:25:54.722 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:54.723 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:25:54.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:54 smithi062 ceph-mon[44211]: pgmap v399: 17 pgs: 17 active+clean; 7.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 113 MiB/s wr, 1.81k op/s 2024-04-01T19:25:54.824 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:25:54.854 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:54.876 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:25:54.881 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:54.881 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:25:54.982 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:25:55.026 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:55.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:55 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:25:55.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:55 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:25:55.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:55 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:25:55.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:55 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:25:55.671 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:25:55.673 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 51 16 123186 123170 150.911 86.5625 0.00610225 0.00662511 2024-04-01T19:25:55.707 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:25:55.716 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:55.717 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:25:55.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:55 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:25:55.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:55 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:25:55.817 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:25:55.850 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:55.882 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:25:55.885 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:55.885 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:25:55.986 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:25:56.016 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:56.041 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:25:56.044 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:56.044 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:25:56.145 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:25:56.178 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:56.204 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:25:56.206 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:56.206 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:25:56.292 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:56 smithi022 ceph-mon[39439]: pgmap v400: 17 pgs: 17 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 102 MiB/s wr, 1.63k op/s 2024-04-01T19:25:56.292 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:56 smithi022 ceph-mon[39439]: osdmap e129: 12 total, 12 up, 12 in 2024-04-01T19:25:56.292 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:56 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3437305770' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:25:56.292 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:56 smithi022 ceph-mon[39439]: from='client.24799 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:25:56.292 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:56 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1913355659' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:25:56.292 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:56 smithi022 ceph-mon[39439]: from='client.34805 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:25:56.300 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.3 to 1 (10000) 2024-04-01T19:25:56.307 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:25:56.308 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:25:56.349 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:56.378 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:25:56.382 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:56.383 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:25:56.483 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:25:56.516 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:56.541 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:25:56.543 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:56 smithi062 ceph-mon[44211]: pgmap v400: 17 pgs: 17 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 102 MiB/s wr, 1.63k op/s 2024-04-01T19:25:56.543 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:56 smithi062 ceph-mon[44211]: osdmap e129: 12 total, 12 up, 12 in 2024-04-01T19:25:56.543 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:56 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3437305770' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:25:56.543 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:56 smithi062 ceph-mon[44211]: from='client.24799 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:25:56.543 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:56 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1913355659' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:25:56.543 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:56 smithi062 ceph-mon[44211]: from='client.34805 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:25:56.544 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:56.544 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:25:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:56 smithi188 ceph-mon[43939]: pgmap v400: 17 pgs: 17 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 102 MiB/s wr, 1.63k op/s 2024-04-01T19:25:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:56 smithi188 ceph-mon[43939]: osdmap e129: 12 total, 12 up, 12 in 2024-04-01T19:25:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:56 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3437305770' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:25:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:56 smithi188 ceph-mon[43939]: from='client.24799 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:25:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:56 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1913355659' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:25:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:56 smithi188 ceph-mon[43939]: from='client.34805 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:25:56.645 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:25:56.673 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 52 16 124641 124625 149.757 90.9375 0.0252841 0.00667626 2024-04-01T19:25:56.687 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:56.713 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:25:56.717 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:56.717 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:25:56.818 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:25:56.850 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:56.873 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:25:56.877 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:56.877 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:25:56.978 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:25:57.004 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:25:57.061 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:57.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:57 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:25:57.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:57 smithi022 ceph-mon[39439]: from='client.24799 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:25:57.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:57 smithi022 ceph-mon[39439]: from='client.34805 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-04-01T19:25:57.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:57 smithi022 ceph-mon[39439]: osdmap e130: 12 total, 12 up, 12 in 2024-04-01T19:25:57.525 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:25:57.535 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:57.535 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:25:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:57 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:25:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:57 smithi188 ceph-mon[43939]: from='client.24799 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:25:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:57 smithi188 ceph-mon[43939]: from='client.34805 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-04-01T19:25:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:57 smithi188 ceph-mon[43939]: osdmap e130: 12 total, 12 up, 12 in 2024-04-01T19:25:57.635 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:25:57.673 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 53 16 126148 126132 148.709 94.1875 0.00747227 0.00672292 2024-04-01T19:25:57.687 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:57.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:57 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:25:57.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:57 smithi062 ceph-mon[44211]: from='client.24799 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:25:57.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:57 smithi062 ceph-mon[44211]: from='client.34805 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-04-01T19:25:57.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:57 smithi062 ceph-mon[44211]: osdmap e130: 12 total, 12 up, 12 in 2024-04-01T19:25:58.309 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:58 smithi022 ceph-mon[39439]: pgmap v403: 17 pgs: 17 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 99 MiB/s wr, 1.59k op/s 2024-04-01T19:25:58.351 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:25:58.354 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:58.355 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:25:58.455 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:25:58.490 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:58.518 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:25:58.521 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:58.521 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:25:58.622 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:25:58.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:58 smithi188 ceph-mon[43939]: pgmap v403: 17 pgs: 17 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 99 MiB/s wr, 1.59k op/s 2024-04-01T19:25:58.673 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 54 15 127639 127624 147.682 93.25 0.00430128 0.00676963 2024-04-01T19:25:58.682 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:58 smithi062 ceph-mon[44211]: pgmap v403: 17 pgs: 17 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 99 MiB/s wr, 1.59k op/s 2024-04-01T19:25:59.063 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:25:59.105 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:25:59.151 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:25:59.184 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:25:59.221 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:25:59.256 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:25:59.297 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:25:59.332 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:25:59.358 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:25:59.360 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 4 1 2024-04-01T19:25:59.362 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:25:59.364 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:59.365 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:25:59.397 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:25:59.436 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:25:59.461 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:25:59.466 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:25:59.479 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:25:59.479 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:25:59.479 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:25:59.479 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:25:59.479 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:25:59.479 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:25:59.480 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:25:59.480 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:25:59.480 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:25:59.480 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:25:59.480 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:25:59.480 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:25:59.503 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:59.531 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:25:59.536 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:59.537 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:25:59.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:25:59 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2321207062' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:25:59.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:25:59 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2321207062' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:25:59.637 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:25:59.667 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:25:59 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2321207062' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:25:59.669 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:25:59.673 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 55 16 129038 129022 146.585 87.375 0.00887547 0.00682068 2024-04-01T19:25:59.694 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:25:59.697 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:25:59.697 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:25:59.798 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:25:59.866 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:00.034 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:26:00.092 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:26:00.108 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:00.108 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:26:00.209 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:26:00.257 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:00.282 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:26:00.286 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:00.286 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:26:00.387 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:26:00.432 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:00.453 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:26:00.455 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:00.456 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:26:00.556 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:26:00.584 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:00 smithi062 ceph-mon[44211]: pgmap v404: 17 pgs: 17 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s wr, 1.42k op/s 2024-04-01T19:26:00.584 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.584 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.584 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.584 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.585 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.585 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.585 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.585 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.585 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.585 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.585 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.585 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.587 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:00.610 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:26:00.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:00 smithi022 ceph-mon[39439]: pgmap v404: 17 pgs: 17 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s wr, 1.42k op/s 2024-04-01T19:26:00.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.614 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:00.614 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:26:00.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:00 smithi188 ceph-mon[43939]: pgmap v404: 17 pgs: 17 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s wr, 1.42k op/s 2024-04-01T19:26:00.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:00.673 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 56 16 130453 130437 145.547 88.4375 0.0109416 0.00686913 2024-04-01T19:26:00.715 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:26:00.745 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:00.767 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:26:00.770 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:00.771 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:26:00.872 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:26:00.910 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:00.934 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:26:00.935 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:26:00.940 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:00.941 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:26:01.041 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:26:01.073 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:01.102 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:26:01.111 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:01.111 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:26:01.212 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:26:01.242 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:26:01.260 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:01.285 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:26:01.289 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:01.289 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:26:01.390 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:26:01.459 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:01.673 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 57 16 131870 131854 144.547 88.5625 0.0126754 0.00691687 2024-04-01T19:26:01.936 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:26:01.941 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:01.942 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:26:02.043 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:26:02.074 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:02.096 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:26:02.100 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:02.101 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:26:02.202 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:26:02.232 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:02.254 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:26:02.257 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:02.258 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:26:02.359 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:26:02.405 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:02.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:02 smithi022 ceph-mon[39439]: pgmap v405: 17 pgs: 17 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 93 MiB/s wr, 1.49k op/s 2024-04-01T19:26:02.620 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:26:02.625 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:02.626 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:26:02.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:02 smithi188 ceph-mon[43939]: pgmap v405: 17 pgs: 17 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 93 MiB/s wr, 1.49k op/s 2024-04-01T19:26:02.674 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 58 16 133364 133348 143.662 93.375 0.00498965 0.00695924 2024-04-01T19:26:02.727 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:26:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:02 smithi062 ceph-mon[44211]: pgmap v405: 17 pgs: 17 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 93 MiB/s wr, 1.49k op/s 2024-04-01T19:26:02.775 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:02.844 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:26:02.852 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:02.853 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:26:02.919 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:26:02.919 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:26:02.954 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:26:02.977 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:26:02.986 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:03.009 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:26:03.013 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:03.013 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:26:03.114 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:26:03.174 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:03.286 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:26:03.290 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:03.290 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:26:03.391 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:26:03.433 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:03.675 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 59 16 134702 134686 142.644 83.625 0.00482886 0.00700932 2024-04-01T19:26:03.811 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:26:03.814 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:03.814 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:26:03.915 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:26:03.948 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:04.477 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:04 smithi022 ceph-mon[39439]: pgmap v406: 17 pgs: 17 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 93 MiB/s wr, 1.49k op/s 2024-04-01T19:26:04.517 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_ops_in_flight 2024-04-01T19:26:04.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:04 smithi188 ceph-mon[43939]: pgmap v406: 17 pgs: 17 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 93 MiB/s wr, 1.49k op/s 2024-04-01T19:26:04.675 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:26:04.677758 min lat: 0.00106051 max lat: 0.213588 avg lat: 0.00705312 2024-04-01T19:26:04.675 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:26:04.675 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 60 16 136124 136108 141.748 88.875 0.0106983 0.00705312 2024-04-01T19:26:04.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:04 smithi062 ceph-mon[44211]: pgmap v406: 17 pgs: 17 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 93 MiB/s wr, 1.49k op/s 2024-04-01T19:26:05.407 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:26:05.675 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 61 16 137441 137425 140.774 82.3125 0.010575 0.00710181 2024-04-01T19:26:05.745 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:26:05.748 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:05.748 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:26:05.750 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:05 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:26:05.750 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:05 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:26:05.750 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:05 smithi022 ceph-mon[39439]: osdmap e131: 12 total, 12 up, 12 in 2024-04-01T19:26:05.750 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:05 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:26:05.750 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:05 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:26:05.750 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:05 smithi022 ceph-mon[39439]: osdmap e132: 12 total, 12 up, 12 in 2024-04-01T19:26:05.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:05 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:26:05.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:05 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:26:05.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:05 smithi062 ceph-mon[44211]: osdmap e131: 12 total, 12 up, 12 in 2024-04-01T19:26:05.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:05 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:26:05.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:05 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:26:05.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:05 smithi062 ceph-mon[44211]: osdmap e132: 12 total, 12 up, 12 in 2024-04-01T19:26:05.850 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:26:05.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:05 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:26:05.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:05 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:26:05.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:05 smithi188 ceph-mon[43939]: osdmap e131: 12 total, 12 up, 12 in 2024-04-01T19:26:05.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:05 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:26:05.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:05 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:26:05.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:05 smithi188 ceph-mon[43939]: osdmap e132: 12 total, 12 up, 12 in 2024-04-01T19:26:05.889 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:05.922 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:26:05.929 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:05.929 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:26:06.030 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:26:06.063 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:06.096 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:26:06.099 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:06.100 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:26:06.201 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:26:06.238 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:06.268 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:26:06.275 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:06.276 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:26:06.377 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:26:06.407 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.4 to 1 (10000) 2024-04-01T19:26:06.409 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:26:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:06.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:06 smithi188 ceph-mon[43939]: pgmap v408: 17 pgs: 17 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 95 MiB/s wr, 1.52k op/s 2024-04-01T19:26:06.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:06 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4019274150' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T19:26:06.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:06 smithi188 ceph-mon[43939]: from='client.24811 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T19:26:06.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:06 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2701691233' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:26:06.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:06 smithi188 ceph-mon[43939]: from='client.34817 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:26:06.675 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 62 16 138799 138783 139.872 84.875 0.0138678 0.00714791 2024-04-01T19:26:06.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:06 smithi062 ceph-mon[44211]: pgmap v408: 17 pgs: 17 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 95 MiB/s wr, 1.52k op/s 2024-04-01T19:26:06.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:06 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4019274150' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T19:26:06.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:06 smithi062 ceph-mon[44211]: from='client.24811 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T19:26:06.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:06 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2701691233' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:26:06.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:06 smithi062 ceph-mon[44211]: from='client.34817 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:26:06.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:06 smithi022 ceph-mon[39439]: pgmap v408: 17 pgs: 17 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 95 MiB/s wr, 1.52k op/s 2024-04-01T19:26:06.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:06 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4019274150' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T19:26:06.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:06 smithi022 ceph-mon[39439]: from='client.24811 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T19:26:06.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:06 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2701691233' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:26:06.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:06 smithi022 ceph-mon[39439]: from='client.34817 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:26:07.024 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:26:07.026 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:07.027 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:26:07.128 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:26:07.169 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:07.239 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:26:07.246 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:07.247 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:26:07.347 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:26:07.379 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:07.403 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:26:07.406 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:07.406 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:26:07.507 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:26:07.569 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:07.675 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 63 16 140040 140024 138.883 77.5625 0.00498936 0.00719852 2024-04-01T19:26:07.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:07 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:26:07.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:07 smithi062 ceph-mon[44211]: from='client.24811 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-04-01T19:26:07.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:07 smithi062 ceph-mon[44211]: from='client.34817 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:26:07.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:07 smithi062 ceph-mon[44211]: osdmap e133: 12 total, 12 up, 12 in 2024-04-01T19:26:07.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:07 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:26:07.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:07 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:26:07.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:07 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:26:07.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:07 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:26:07.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:07 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:26:07.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:07 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:26:07.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:07 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:26:07.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:07 smithi062 ceph-mon[44211]: 2.1 scrub starts 2024-04-01T19:26:07.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:07 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:26:07.828 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:07 smithi022 ceph-mon[39439]: from='client.24811 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-04-01T19:26:07.828 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:07 smithi022 ceph-mon[39439]: from='client.34817 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:26:07.828 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:07 smithi022 ceph-mon[39439]: osdmap e133: 12 total, 12 up, 12 in 2024-04-01T19:26:07.828 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:07 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:26:07.828 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:07 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:26:07.828 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:07 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:26:07.828 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:07 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:26:07.828 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:07 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:26:07.828 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:07 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:26:07.828 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:07 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:26:07.828 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:07 smithi022 ceph-mon[39439]: 2.1 scrub starts 2024-04-01T19:26:07.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:07 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:26:07.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:07 smithi188 ceph-mon[43939]: from='client.24811 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-04-01T19:26:07.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:07 smithi188 ceph-mon[43939]: from='client.34817 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:26:07.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:07 smithi188 ceph-mon[43939]: osdmap e133: 12 total, 12 up, 12 in 2024-04-01T19:26:07.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:07 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:26:07.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:07 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:26:07.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:07 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:26:07.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:07 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:26:07.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:07 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:26:07.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:07 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:26:07.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:07 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:26:07.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:07 smithi188 ceph-mon[43939]: 2.1 scrub starts 2024-04-01T19:26:08.294 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:26:08.386 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:26:08.422 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:26:08.472 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:26:08.520 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:26:08.565 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:26:08.597 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:26:08.647 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:26:08.660 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:26:08.670 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:08.671 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:26:08.672 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:08 smithi022 ceph-mon[39439]: pgmap v411: 17 pgs: 17 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 84 MiB/s wr, 1.34k op/s 2024-04-01T19:26:08.672 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:08 smithi022 ceph-mon[39439]: 2.c scrub starts 2024-04-01T19:26:08.672 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:08 smithi022 ceph-mon[39439]: 2.9 scrub starts 2024-04-01T19:26:08.672 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:08 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:26:08.673 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:08 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:26:08.673 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:08 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2364343564' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:26:08.675 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 64 15 141133 141118 137.781 68.375 0.0125285 0.00725643 2024-04-01T19:26:08.697 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:26:08.711 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 5 1 2024-04-01T19:26:08.741 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:26:08.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:08 smithi062 ceph-mon[44211]: pgmap v411: 17 pgs: 17 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 84 MiB/s wr, 1.34k op/s 2024-04-01T19:26:08.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:08 smithi062 ceph-mon[44211]: 2.c scrub starts 2024-04-01T19:26:08.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:08 smithi062 ceph-mon[44211]: 2.9 scrub starts 2024-04-01T19:26:08.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:08 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:26:08.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:08 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:26:08.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:08 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2364343564' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:26:08.771 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:26:08.792 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:26:08.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:08 smithi188 ceph-mon[43939]: pgmap v411: 17 pgs: 17 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 84 MiB/s wr, 1.34k op/s 2024-04-01T19:26:08.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:08 smithi188 ceph-mon[43939]: 2.c scrub starts 2024-04-01T19:26:08.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:08 smithi188 ceph-mon[43939]: 2.9 scrub starts 2024-04-01T19:26:08.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:08 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:26:08.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:08 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:26:08.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:08 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2364343564' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:26:08.803 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:08.824 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:26:08.831 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:26:08.836 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:08.836 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:26:08.878 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:26:08.904 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:26:08.904 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:26:08.904 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:26:08.904 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:26:08.904 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:26:08.904 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:26:08.904 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:26:08.904 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:26:08.904 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:26:08.904 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:26:08.904 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:26:08.904 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:26:08.937 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:26:09.057 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:09.197 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:26:09.205 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:09.205 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:26:09.306 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:26:09.335 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:09.359 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:26:09.364 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:09.365 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:26:09.466 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:26:09.526 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:09.675 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 65 16 142298 142282 136.781 72.75 0.0275007 0.00730955 2024-04-01T19:26:09.742 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:26:09.751 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:09.751 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:26:09.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:09 smithi062 ceph-mon[44211]: osdmap e134: 12 total, 12 up, 12 in 2024-04-01T19:26:09.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:09 smithi062 ceph-mon[44211]: pgmap v413: 17 pgs: 17 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 81 MiB/s wr, 1.30k op/s 2024-04-01T19:26:09.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.852 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:26:09.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:09 smithi022 ceph-mon[39439]: osdmap e134: 12 total, 12 up, 12 in 2024-04-01T19:26:09.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:09 smithi022 ceph-mon[39439]: pgmap v413: 17 pgs: 17 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 81 MiB/s wr, 1.30k op/s 2024-04-01T19:26:09.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.871 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:26:09.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:09 smithi188 ceph-mon[43939]: osdmap e134: 12 total, 12 up, 12 in 2024-04-01T19:26:09.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:09 smithi188 ceph-mon[43939]: pgmap v413: 17 pgs: 17 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 81 MiB/s wr, 1.30k op/s 2024-04-01T19:26:09.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:09.892 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:09.917 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:26:09.921 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:09.922 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:26:10.023 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:26:10.055 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:10.079 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:26:10.082 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:10.082 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:26:10.183 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:26:10.262 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:10.315 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:26:10.320 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:10.320 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:26:10.421 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:26:10.491 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:10.675 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 66 16 143492 143476 135.839 74.625 0.0088259 0.00736012 2024-04-01T19:26:10.757 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:26:10.763 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:10.764 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:26:10.832 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:26:10.840 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:26:10.864 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:26:10.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:10 smithi022 ceph-mon[39439]: 2.1 scrub ok 2024-04-01T19:26:10.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:10 smithi022 ceph-mon[39439]: 2.c scrub ok 2024-04-01T19:26:10.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:10.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:10.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:10 smithi022 ceph-mon[39439]: 2.6 scrub starts 2024-04-01T19:26:10.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:10 smithi022 ceph-mon[39439]: 2.9 scrub ok 2024-04-01T19:26:10.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:10 smithi022 ceph-mon[39439]: 2.3 scrub starts 2024-04-01T19:26:10.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:10 smithi188 ceph-mon[43939]: 2.1 scrub ok 2024-04-01T19:26:10.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:10 smithi188 ceph-mon[43939]: 2.c scrub ok 2024-04-01T19:26:10.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:10.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:10.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:10 smithi188 ceph-mon[43939]: 2.6 scrub starts 2024-04-01T19:26:10.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:10 smithi188 ceph-mon[43939]: 2.9 scrub ok 2024-04-01T19:26:10.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:10 smithi188 ceph-mon[43939]: 2.3 scrub starts 2024-04-01T19:26:10.901 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:10.929 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:26:10.932 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:10.932 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:26:11.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:10 smithi062 ceph-mon[44211]: 2.1 scrub ok 2024-04-01T19:26:11.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:10 smithi062 ceph-mon[44211]: 2.c scrub ok 2024-04-01T19:26:11.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:11.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:11.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:10 smithi062 ceph-mon[44211]: 2.6 scrub starts 2024-04-01T19:26:11.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:10 smithi062 ceph-mon[44211]: 2.9 scrub ok 2024-04-01T19:26:11.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:10 smithi062 ceph-mon[44211]: 2.3 scrub starts 2024-04-01T19:26:11.032 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:26:11.068 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:11.093 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:26:11.096 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:11.097 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:26:11.197 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:26:11.241 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:11.273 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:26:11.277 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:11.277 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:26:11.378 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:26:11.448 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:11.590 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:11 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T19:26:11.590 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:11 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T19:26:11.590 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:11 smithi188 ceph-mon[43939]: 2.7 scrub starts 2024-04-01T19:26:11.590 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:11 smithi188 ceph-mon[43939]: pgmap v414: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 85 MiB/s wr, 1.36k op/s 2024-04-01T19:26:11.675 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 67 16 144688 144672 134.927 74.75 0.011585 0.00740997 2024-04-01T19:26:11.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:11 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T19:26:11.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:11 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T19:26:11.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:11 smithi022 ceph-mon[39439]: 2.7 scrub starts 2024-04-01T19:26:11.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:11 smithi022 ceph-mon[39439]: pgmap v414: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 85 MiB/s wr, 1.36k op/s 2024-04-01T19:26:12.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:11 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T19:26:12.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:11 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T19:26:12.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:11 smithi062 ceph-mon[44211]: 2.7 scrub starts 2024-04-01T19:26:12.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:11 smithi062 ceph-mon[44211]: pgmap v414: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 85 MiB/s wr, 1.36k op/s 2024-04-01T19:26:12.298 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:26:12.675 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 68 16 145957 145941 134.11 79.3125 0.013155 0.00745559 2024-04-01T19:26:12.826 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:26:12.826 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:26:12.826 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.826 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:145706 2.1 e134/106 2:8f4c47ff:::benchmark_data_smithi188_77607_object145705:head v 134'9098, mlcod=134'9096)", 2024-04-01T19:26:12.826 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:12.484319+0000", 2024-04-01T19:26:12.827 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0084076359999999996, 2024-04-01T19:26:12.827 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0084407019999999996, 2024-04-01T19:26:12.827 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:26:12.827 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:26:12.827 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:26:12.827 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:26:12.827 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.827 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:26:12.827 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.484319+0000", 2024-04-01T19:26:12.827 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:26:12.827 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.827 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.827 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:26:12.827 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.484319+0000", 2024-04-01T19:26:12.828 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:26:12.828 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.828 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.828 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:26:12.828 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.484321+0000", 2024-04-01T19:26:12.828 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.041e-06 2024-04-01T19:26:12.828 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.828 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.828 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:26:12.828 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.484351+0000", 2024-04-01T19:26:12.828 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.0558000000000001e-05 2024-04-01T19:26:12.828 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.828 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.828 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:26:12.828 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.484365+0000", 2024-04-01T19:26:12.828 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3582e-05 2024-04-01T19:26:12.829 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.829 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.829 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:26:12.829 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.484374+0000", 2024-04-01T19:26:12.829 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5369999999999997e-06 2024-04-01T19:26:12.829 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.829 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.829 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:26:12.829 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.484438+0000", 2024-04-01T19:26:12.829 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3903000000000001e-05 2024-04-01T19:26:12.829 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.829 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.829 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:26:12.829 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.484464+0000", 2024-04-01T19:26:12.829 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6169e-05 2024-04-01T19:26:12.830 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:26:12.830 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:26:12.830 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:26:12.830 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.830 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.830 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:145715 2.1 e134/106 2:8b723254:::benchmark_data_smithi188_77607_object145714:head v 134'9099, mlcod=134'9096)", 2024-04-01T19:26:12.830 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:12.485619+0000", 2024-04-01T19:26:12.830 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0071071870000000001, 2024-04-01T19:26:12.830 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0072089329999999998, 2024-04-01T19:26:12.830 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:26:12.830 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:26:12.830 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:26:12.831 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:26:12.831 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.831 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:26:12.831 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.485619+0000", 2024-04-01T19:26:12.831 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:26:12.831 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.831 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.831 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:26:12.831 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.485619+0000", 2024-04-01T19:26:12.831 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:26:12.831 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.831 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.831 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:26:12.831 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.485621+0000", 2024-04-01T19:26:12.831 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6270000000000001e-06 2024-04-01T19:26:12.832 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.832 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.832 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:26:12.832 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.485647+0000", 2024-04-01T19:26:12.832 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6227000000000001e-05 2024-04-01T19:26:12.832 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.832 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.832 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:26:12.832 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.485663+0000", 2024-04-01T19:26:12.832 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5724000000000001e-05 2024-04-01T19:26:12.832 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.832 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.832 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:26:12.832 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.485672+0000", 2024-04-01T19:26:12.832 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8640000000000002e-06 2024-04-01T19:26:12.832 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.833 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.833 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:26:12.833 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.487982+0000", 2024-04-01T19:26:12.833 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0023100180000000001 2024-04-01T19:26:12.833 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.833 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.833 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:26:12.833 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.488005+0000", 2024-04-01T19:26:12.833 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3397e-05 2024-04-01T19:26:12.833 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:26:12.833 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:26:12.833 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:26:12.833 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.833 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.833 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:145719 2.e e134/106 2:73e7c42d:::benchmark_data_smithi188_77607_object145718:head v 134'9218, mlcod=134'9215)", 2024-04-01T19:26:12.834 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:12.490158+0000", 2024-04-01T19:26:12.834 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0025680429999999999, 2024-04-01T19:26:12.834 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.002733054, 2024-04-01T19:26:12.834 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:26:12.834 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:26:12.834 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:26:12.834 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:26:12.834 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.834 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:26:12.834 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.490158+0000", 2024-04-01T19:26:12.834 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:26:12.834 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.834 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.834 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:26:12.834 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.490158+0000", 2024-04-01T19:26:12.835 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:26:12.835 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.835 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.835 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:26:12.835 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.490161+0000", 2024-04-01T19:26:12.835 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.458e-06 2024-04-01T19:26:12.835 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.835 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.835 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:26:12.835 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.490203+0000", 2024-04-01T19:26:12.835 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1730000000000002e-05 2024-04-01T19:26:12.835 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.835 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.836 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:26:12.836 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.490222+0000", 2024-04-01T19:26:12.836 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9717000000000001e-05 2024-04-01T19:26:12.836 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.836 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.836 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:26:12.836 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.490233+0000", 2024-04-01T19:26:12.836 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.057e-05 2024-04-01T19:26:12.836 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.836 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.836 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:26:12.836 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.490399+0000", 2024-04-01T19:26:12.836 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00016636999999999999 2024-04-01T19:26:12.837 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.837 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.837 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:26:12.837 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.490423+0000", 2024-04-01T19:26:12.837 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3598999999999999e-05 2024-04-01T19:26:12.837 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:26:12.837 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:26:12.837 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:26:12.837 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.837 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.837 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:145716 2.1 e134/106 2:8d40872c:::benchmark_data_smithi188_77607_object145715:head v 134'9100, mlcod=134'9096)", 2024-04-01T19:26:12.837 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:12.490258+0000", 2024-04-01T19:26:12.837 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.002468114, 2024-04-01T19:26:12.838 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0026946159999999999, 2024-04-01T19:26:12.838 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:26:12.838 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:26:12.838 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:26:12.838 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:26:12.838 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.838 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:26:12.838 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.490258+0000", 2024-04-01T19:26:12.838 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:26:12.838 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.838 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.838 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:26:12.838 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.490258+0000", 2024-04-01T19:26:12.838 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:26:12.838 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.838 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.839 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:26:12.839 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.490259+0000", 2024-04-01T19:26:12.839 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.8999999999999995e-07 2024-04-01T19:26:12.839 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.839 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.839 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:26:12.839 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.490282+0000", 2024-04-01T19:26:12.839 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3264e-05 2024-04-01T19:26:12.839 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.839 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.839 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:26:12.839 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.490289+0000", 2024-04-01T19:26:12.839 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.7449999999999998e-06 2024-04-01T19:26:12.839 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.840 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.840 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:26:12.840 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.490295+0000", 2024-04-01T19:26:12.840 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6149999999999996e-06 2024-04-01T19:26:12.840 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.840 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.840 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:26:12.840 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.491140+0000", 2024-04-01T19:26:12.840 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00084499599999999998 2024-04-01T19:26:12.840 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:26:12.840 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:26:12.840 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:26:12.840 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:12.491159+0000", 2024-04-01T19:26:12.840 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9334000000000002e-05 2024-04-01T19:26:12.840 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:26:12.840 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:26:12.840 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:26:12.841 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:26:12.841 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T19:26:12.841 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 4 2024-04-01T19:26:12.841 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:26:12.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:12 smithi022 ceph-mon[39439]: 2.3 scrub ok 2024-04-01T19:26:12.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:12 smithi022 ceph-mon[39439]: 2.6 scrub ok 2024-04-01T19:26:12.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:12 smithi022 ceph-mon[39439]: 2.2 scrub starts 2024-04-01T19:26:12.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:12 smithi188 ceph-mon[43939]: 2.3 scrub ok 2024-04-01T19:26:12.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:12 smithi188 ceph-mon[43939]: 2.6 scrub ok 2024-04-01T19:26:12.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:12 smithi188 ceph-mon[43939]: 2.2 scrub starts 2024-04-01T19:26:13.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:12 smithi062 ceph-mon[44211]: 2.3 scrub ok 2024-04-01T19:26:13.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:12 smithi062 ceph-mon[44211]: 2.6 scrub ok 2024-04-01T19:26:13.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:12 smithi062 ceph-mon[44211]: 2.2 scrub starts 2024-04-01T19:26:13.504 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_blocked_ops 2024-04-01T19:26:13.675 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 69 16 147222 147206 133.312 79.0625 0.00843194 0.00749943 2024-04-01T19:26:13.779 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:26:13.787 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:13.788 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:13 smithi022 ceph-mon[39439]: 2.7 scrub ok 2024-04-01T19:26:13.788 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:13 smithi022 ceph-mon[39439]: 2.8 scrub starts 2024-04-01T19:26:13.788 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:13 smithi022 ceph-mon[39439]: pgmap v415: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 MiB/s wr, 1.31k op/s 2024-04-01T19:26:13.788 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:26:13.889 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:26:13.918 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:13 smithi188 ceph-mon[43939]: 2.7 scrub ok 2024-04-01T19:26:13.918 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:13 smithi188 ceph-mon[43939]: 2.8 scrub starts 2024-04-01T19:26:13.918 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:13 smithi188 ceph-mon[43939]: pgmap v415: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 MiB/s wr, 1.31k op/s 2024-04-01T19:26:13.921 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:13.949 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:26:13.955 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:13.955 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:26:14.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:13 smithi062 ceph-mon[44211]: 2.7 scrub ok 2024-04-01T19:26:14.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:13 smithi062 ceph-mon[44211]: 2.8 scrub starts 2024-04-01T19:26:14.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:13 smithi062 ceph-mon[44211]: pgmap v415: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 MiB/s wr, 1.31k op/s 2024-04-01T19:26:14.056 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:26:14.087 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:14.113 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:26:14.116 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:14.116 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:26:14.217 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:26:14.253 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:14.276 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:26:14.279 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:14.279 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:26:14.380 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:26:14.395 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:26:14.408 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:14.434 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:26:14.440 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:14.440 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:26:14.541 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:26:14.581 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:14.604 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:26:14.609 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:14.610 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:26:14.675 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 70 16 148412 148396 132.47 74.375 0.00645298 0.00754784 2024-04-01T19:26:14.710 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:26:14.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:14 smithi062 ceph-mon[44211]: 2.2 scrub ok 2024-04-01T19:26:14.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:14 smithi062 ceph-mon[44211]: 2.e scrub starts 2024-04-01T19:26:14.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:14 smithi062 ceph-mon[44211]: 2.8 scrub ok 2024-04-01T19:26:14.767 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:14.856 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:26:14.864 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:14.865 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:26:14.871 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:26:14.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:14 smithi188 ceph-mon[43939]: 2.2 scrub ok 2024-04-01T19:26:14.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:14 smithi188 ceph-mon[43939]: 2.e scrub starts 2024-04-01T19:26:14.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:14 smithi188 ceph-mon[43939]: 2.8 scrub ok 2024-04-01T19:26:14.932 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:14 smithi022 ceph-mon[39439]: 2.2 scrub ok 2024-04-01T19:26:14.933 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:14 smithi022 ceph-mon[39439]: 2.e scrub starts 2024-04-01T19:26:14.933 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:14 smithi022 ceph-mon[39439]: 2.8 scrub ok 2024-04-01T19:26:14.965 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:26:14.996 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:15.023 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:26:15.028 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:15.029 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:26:15.130 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:26:15.172 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:15.205 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:26:15.211 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:15.212 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:26:15.313 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:26:15.346 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:15.367 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:26:15.373 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:15.374 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:26:15.475 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:26:15.505 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:15.532 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:26:15.535 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:15.535 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:26:15.636 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:26:15.669 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:15.676 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 71 16 149564 149548 131.618 72 0.0112669 0.00759633 2024-04-01T19:26:15.692 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:26:15.695 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:15.695 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:26:15.796 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:26:15.840 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:15.873 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:26:15.878 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:15.879 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:26:15.980 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:26:16.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:15 smithi062 ceph-mon[44211]: pgmap v416: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s wr, 1.22k op/s 2024-04-01T19:26:16.016 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:15 smithi022 ceph-mon[39439]: pgmap v416: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s wr, 1.22k op/s 2024-04-01T19:26:16.060 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:16.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:15 smithi188 ceph-mon[43939]: pgmap v416: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s wr, 1.22k op/s 2024-04-01T19:26:16.173 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:16.174 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:26:16.174 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:26:16.276 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:26:16.333 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:16.365 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:26:16.371 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:16.371 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:26:16.472 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:26:16.506 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:16.536 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:26:16.539 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:16.539 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:26:16.640 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:26:16.676 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 72 16 150670 150654 130.75 69.125 0.00772982 0.00764673 2024-04-01T19:26:16.680 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:16.712 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:26:16.719 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:16.720 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:26:16.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:16 smithi062 ceph-mon[44211]: 2.d scrub starts 2024-04-01T19:26:16.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:16 smithi062 ceph-mon[44211]: 2.e scrub ok 2024-04-01T19:26:16.820 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:26:16.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:16 smithi022 ceph-mon[39439]: 2.d scrub starts 2024-04-01T19:26:16.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:16 smithi022 ceph-mon[39439]: 2.e scrub ok 2024-04-01T19:26:16.894 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:16.925 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:26:16.928 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:16 smithi188 ceph-mon[43939]: 2.d scrub starts 2024-04-01T19:26:16.928 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:16 smithi188 ceph-mon[43939]: 2.e scrub ok 2024-04-01T19:26:16.930 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:16.930 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:26:17.031 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:26:17.072 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:17.111 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:26:17.120 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:17.121 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:26:17.221 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:26:17.269 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:17.679 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 73 16 151761 151745 129.889 68.1875 0.0173039 0.00769774 2024-04-01T19:26:17.784 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.5 to 1 (10000) 2024-04-01T19:26:17.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:17 smithi022 ceph-mon[39439]: 2.a scrub starts 2024-04-01T19:26:17.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:17 smithi022 ceph-mon[39439]: 2.d scrub ok 2024-04-01T19:26:17.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:17 smithi022 ceph-mon[39439]: pgmap v417: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 77 MiB/s wr, 1.24k op/s 2024-04-01T19:26:17.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:17 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2938370122' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T19:26:17.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:17 smithi022 ceph-mon[39439]: from='client.34829 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T19:26:17.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:17 smithi022 ceph-mon[39439]: 2.b scrub starts 2024-04-01T19:26:18.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:17 smithi062 ceph-mon[44211]: 2.a scrub starts 2024-04-01T19:26:18.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:17 smithi062 ceph-mon[44211]: 2.d scrub ok 2024-04-01T19:26:18.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:17 smithi062 ceph-mon[44211]: pgmap v417: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 77 MiB/s wr, 1.24k op/s 2024-04-01T19:26:18.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:17 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2938370122' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T19:26:18.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:17 smithi062 ceph-mon[44211]: from='client.34829 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T19:26:18.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:17 smithi062 ceph-mon[44211]: 2.b scrub starts 2024-04-01T19:26:18.129 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:17 smithi188 ceph-mon[43939]: 2.a scrub starts 2024-04-01T19:26:18.129 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:17 smithi188 ceph-mon[43939]: 2.d scrub ok 2024-04-01T19:26:18.129 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:17 smithi188 ceph-mon[43939]: pgmap v417: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 77 MiB/s wr, 1.24k op/s 2024-04-01T19:26:18.129 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:17 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2938370122' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T19:26:18.129 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:17 smithi188 ceph-mon[43939]: from='client.34829 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T19:26:18.129 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:17 smithi188 ceph-mon[43939]: 2.b scrub starts 2024-04-01T19:26:18.670 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:26:18.670 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:26:18.670 INFO:teuthology.orchestra.run.smithi022.stdout: "complaint_time": 30, 2024-04-01T19:26:18.670 INFO:teuthology.orchestra.run.smithi022.stdout: "num_blocked_ops": 0 2024-04-01T19:26:18.671 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:26:18.678 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 74 16 152906 152890 129.101 71.5625 0.00718464 0.00774447 2024-04-01T19:26:18.715 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:26:19.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:18 smithi062 ceph-mon[44211]: from='client.34829 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-04-01T19:26:19.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:18 smithi062 ceph-mon[44211]: osdmap e135: 12 total, 12 up, 12 in 2024-04-01T19:26:19.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:18 smithi062 ceph-mon[44211]: 2.a scrub ok 2024-04-01T19:26:19.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:18 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2619963276' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:26:19.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:18 smithi062 ceph-mon[44211]: from='client.24826 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:26:19.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:18 smithi022 ceph-mon[39439]: from='client.34829 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-04-01T19:26:19.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:18 smithi022 ceph-mon[39439]: osdmap e135: 12 total, 12 up, 12 in 2024-04-01T19:26:19.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:18 smithi022 ceph-mon[39439]: 2.a scrub ok 2024-04-01T19:26:19.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:18 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2619963276' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:26:19.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:18 smithi022 ceph-mon[39439]: from='client.24826 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:26:19.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:18 smithi188 ceph-mon[43939]: from='client.34829 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-04-01T19:26:19.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:18 smithi188 ceph-mon[43939]: osdmap e135: 12 total, 12 up, 12 in 2024-04-01T19:26:19.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:18 smithi188 ceph-mon[43939]: 2.a scrub ok 2024-04-01T19:26:19.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:18 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2619963276' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:26:19.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:18 smithi188 ceph-mon[43939]: from='client.24826 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:26:19.640 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:26:19.646 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:19.646 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:26:19.672 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 6 1 2024-04-01T19:26:19.678 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 75 16 154121 154105 128.392 75.9375 0.0199078 0.00778523 2024-04-01T19:26:19.748 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:26:19.777 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:19.797 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:26:19.800 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:19.800 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:26:19.901 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:26:19.929 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:19 smithi062 ceph-mon[44211]: pgmap v419: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 75 MiB/s wr, 1.21k op/s 2024-04-01T19:26:19.930 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:19 smithi062 ceph-mon[44211]: 2.b scrub ok 2024-04-01T19:26:19.930 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:19 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:26:19.930 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:19 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:26:19.930 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:19 smithi062 ceph-mon[44211]: from='client.24826 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:26:19.930 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:19 smithi062 ceph-mon[44211]: osdmap e136: 12 total, 12 up, 12 in 2024-04-01T19:26:19.932 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:19.957 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:26:19.962 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:19.963 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:26:20.063 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:26:20.101 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:19 smithi188 ceph-mon[43939]: pgmap v419: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 75 MiB/s wr, 1.21k op/s 2024-04-01T19:26:20.101 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:19 smithi188 ceph-mon[43939]: 2.b scrub ok 2024-04-01T19:26:20.101 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:19 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:26:20.101 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:19 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:26:20.101 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:19 smithi188 ceph-mon[43939]: from='client.24826 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:26:20.101 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:19 smithi188 ceph-mon[43939]: osdmap e136: 12 total, 12 up, 12 in 2024-04-01T19:26:20.103 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:20.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:19 smithi022 ceph-mon[39439]: pgmap v419: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 75 MiB/s wr, 1.21k op/s 2024-04-01T19:26:20.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:19 smithi022 ceph-mon[39439]: 2.b scrub ok 2024-04-01T19:26:20.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:19 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:26:20.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:19 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:26:20.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:19 smithi022 ceph-mon[39439]: from='client.24826 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:26:20.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:19 smithi022 ceph-mon[39439]: osdmap e136: 12 total, 12 up, 12 in 2024-04-01T19:26:20.130 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:26:20.136 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:20.136 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:26:20.237 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:26:20.270 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:20.293 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:26:20.301 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:20.302 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:26:20.403 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:26:20.433 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:20.456 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:26:20.458 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:20.459 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:26:20.560 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:26:20.590 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:20.611 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:26:20.614 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:20.614 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:26:20.678 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 76 16 155146 155130 127.545 64.0625 0.0265421 0.00783943 2024-04-01T19:26:20.715 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:26:20.743 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:20.764 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:26:20.769 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:20.770 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:26:20.871 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:26:20.900 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:20.922 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:26:20.924 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:20.924 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:26:20.986 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:20 smithi022 ceph-mon[39439]: 2.4 deep-scrub starts 2024-04-01T19:26:21.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:20 smithi062 ceph-mon[44211]: 2.4 deep-scrub starts 2024-04-01T19:26:21.025 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:26:21.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:20 smithi188 ceph-mon[43939]: 2.4 deep-scrub starts 2024-04-01T19:26:21.062 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:21.085 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:26:21.090 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:21.090 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:26:21.191 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:26:21.221 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:21.245 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:26:21.247 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:21.248 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:26:21.349 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:26:21.381 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:21.403 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:26:21.405 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:21.406 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:26:21.507 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:26:21.543 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:21.569 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:26:21.576 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:21.576 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:26:21.639 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_historic_ops 2024-04-01T19:26:21.677 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:26:21.678 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 77 16 156134 156118 126.691 61.75 0.00520677 0.00788724 2024-04-01T19:26:21.707 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:21.728 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:26:21.733 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:21.733 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:26:21.745 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:26:21.745 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:26:21.745 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:26:21.745 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:26:21.745 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:26:21.745 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:26:21.745 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:26:21.745 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:26:21.746 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:26:21.748 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:26:21.779 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:26:21.816 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:26:21.827 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:26:21.828 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:26:21.828 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:26:21.828 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:26:21.828 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:26:21.828 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:26:21.828 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:26:21.828 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:26:21.828 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:26:21.828 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:26:21.828 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:26:21.828 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:26:21.834 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:26:21.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:21 smithi022 ceph-mon[39439]: pgmap v421: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 75 MiB/s wr, 1.21k op/s 2024-04-01T19:26:21.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:21 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1666073666' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:26:21.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:21.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:21.862 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:21 smithi188 ceph-mon[43939]: pgmap v421: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 75 MiB/s wr, 1.21k op/s 2024-04-01T19:26:21.863 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:21 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1666073666' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:26:21.863 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:21.863 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:21.867 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:21.901 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:26:21.904 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:21.905 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:26:22.006 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:26:22.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:21 smithi062 ceph-mon[44211]: pgmap v421: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 75 MiB/s wr, 1.21k op/s 2024-04-01T19:26:22.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:21 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1666073666' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:26:22.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:22.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:22.052 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:22.463 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:26:22.611 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:26:22.626 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:22.626 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:26:22.679 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 78 16 157078 157062 125.823 59 0.00885628 0.00794597 2024-04-01T19:26:22.726 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:26:22.762 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:22.791 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:26:22.797 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:22.798 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:26:22.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:22.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:22.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:22.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:22.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:22.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:22.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:22.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:22.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:22.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:22.899 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:26:22.932 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:22.956 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:26:22.957 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:22.957 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:22.958 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:22.958 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:22.958 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:22.958 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:22.958 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:22.958 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:22.958 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:22.958 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:22.959 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:22.959 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:26:23.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:23.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:23.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:23.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:23.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:23.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:23.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:23.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:23.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:23.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:23.060 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:26:23.089 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:23.122 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:26:23.126 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:23.126 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:26:23.227 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:26:23.254 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:23.275 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:26:23.278 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:23.278 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:26:23.379 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:26:23.405 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:23.431 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:26:23.433 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:23.434 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:26:23.535 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:26:23.571 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:23.593 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:26:23.599 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:23.600 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:26:23.679 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 79 16 158077 158061 125.021 62.4375 0.00553074 0.00799575 2024-04-01T19:26:23.700 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:26:23.729 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:23.749 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:26:23.751 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:23.751 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:26:23.852 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:26:23.885 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:23.913 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:26:23.921 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:23.922 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:26:24.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:23 smithi062 ceph-mon[44211]: pgmap v422: 17 pgs: 17 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 MiB/s wr, 1.17k op/s 2024-04-01T19:26:24.022 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:26:24.057 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:23 smithi188 ceph-mon[43939]: pgmap v422: 17 pgs: 17 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 MiB/s wr, 1.17k op/s 2024-04-01T19:26:24.058 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:24.099 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:26:24.103 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:24.103 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:26:24.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:23 smithi022 ceph-mon[39439]: pgmap v422: 17 pgs: 17 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 MiB/s wr, 1.17k op/s 2024-04-01T19:26:24.155 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:26:24.204 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:26:24.263 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:24.274 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:26:24.486 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:26:24.492 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:24.493 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:26:24.593 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:26:24.621 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:24.641 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:26:24.644 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:24.644 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:26:24.679 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:26:24.681928 min lat: 0.00106051 max lat: 0.213588 avg lat: 0.00804944 2024-04-01T19:26:24.679 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:26:24.679 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 80 16 158997 158981 124.177 57.5 0.0192158 0.00804944 2024-04-01T19:26:24.745 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:26:24.776 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:24.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:24 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:26:24.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:24 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:26:24.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:24 smithi022 ceph-mon[39439]: osdmap e137: 12 total, 12 up, 12 in 2024-04-01T19:26:24.805 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:26:24.811 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:24.811 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:26:24.912 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:26:24.944 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:24.973 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:26:24.978 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:24 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:26:24.978 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:24 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:26:24.978 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:24 smithi188 ceph-mon[43939]: osdmap e137: 12 total, 12 up, 12 in 2024-04-01T19:26:24.978 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:24.979 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:26:25.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:24 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:26:25.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:24 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:26:25.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:24 smithi062 ceph-mon[44211]: osdmap e137: 12 total, 12 up, 12 in 2024-04-01T19:26:25.079 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:26:25.108 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:25.129 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:26:25.132 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:25.132 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:26:25.233 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:26:25.262 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:25.268 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:26:25.287 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:26:25.289 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:25.289 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:26:25.390 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:26:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:25.679 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 81 16 159882 159866 123.327 55.3125 0.0175076 0.00810546 2024-04-01T19:26:25.894 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.6 to 1 (10000) 2024-04-01T19:26:26.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:25 smithi062 ceph-mon[44211]: pgmap v424: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 MiB/s wr, 1.07k op/s 2024-04-01T19:26:26.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:25 smithi062 ceph-mon[44211]: 2.5 scrub starts 2024-04-01T19:26:26.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:25 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1277292549' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T19:26:26.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:25 smithi022 ceph-mon[39439]: pgmap v424: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 MiB/s wr, 1.07k op/s 2024-04-01T19:26:26.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:25 smithi022 ceph-mon[39439]: 2.5 scrub starts 2024-04-01T19:26:26.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:25 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1277292549' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T19:26:26.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:25 smithi188 ceph-mon[43939]: pgmap v424: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 MiB/s wr, 1.07k op/s 2024-04-01T19:26:26.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:25 smithi188 ceph-mon[43939]: 2.5 scrub starts 2024-04-01T19:26:26.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:25 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1277292549' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T19:26:26.141 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:26:26.153 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:26.153 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:26:26.254 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:26:26.296 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:26.320 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:26:26.324 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:26.324 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:26:26.425 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:26:26.455 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:26.478 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:26:26.481 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:26.482 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:26:26.583 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:26:26.620 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:26.649 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:26:26.657 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:26.658 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:26:26.679 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 82 15 160736 160721 122.475 53.4375 0.014154 0.00816167 2024-04-01T19:26:26.731 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:26 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1277292549' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-04-01T19:26:26.731 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:26 smithi022 ceph-mon[39439]: osdmap e138: 12 total, 12 up, 12 in 2024-04-01T19:26:26.731 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:26 smithi022 ceph-mon[39439]: 2.f deep-scrub starts 2024-04-01T19:26:26.759 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:26:26.788 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:26.810 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:26:26.813 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:26.813 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:26:26.866 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:26:26.867 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:26:26.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:26 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1277292549' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-04-01T19:26:26.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:26 smithi188 ceph-mon[43939]: osdmap e138: 12 total, 12 up, 12 in 2024-04-01T19:26:26.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:26 smithi188 ceph-mon[43939]: 2.f deep-scrub starts 2024-04-01T19:26:26.914 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:26:26.943 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:26.966 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:26:26.969 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:26.969 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:26:27.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:26 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1277292549' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-04-01T19:26:27.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:26 smithi062 ceph-mon[44211]: osdmap e138: 12 total, 12 up, 12 in 2024-04-01T19:26:27.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:26 smithi062 ceph-mon[44211]: 2.f deep-scrub starts 2024-04-01T19:26:27.071 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:26:27.116 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:27.234 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:26:27.241 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:27.241 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:26:27.263 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 7 1 2024-04-01T19:26:27.343 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:26:27.370 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:27.391 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:26:27.394 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:27.394 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:26:27.491 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:26:27.495 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:26:27.589 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:27.661 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:26:27.675 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:27.675 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:26:27.679 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 83 15 161606 161591 121.654 54.375 0.0119023 0.00821841 2024-04-01T19:26:27.776 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:26:27.805 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:27.829 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:26:27.832 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:27.832 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:26:27.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:27 smithi022 ceph-mon[39439]: 2.5 scrub ok 2024-04-01T19:26:27.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:27 smithi022 ceph-mon[39439]: pgmap v426: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 MiB/s wr, 1.07k op/s 2024-04-01T19:26:27.933 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:26:27.960 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:27.972 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_ops_in_flight 2024-04-01T19:26:27.982 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:26:27.986 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:27.987 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:26:28.000 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:27 smithi062 ceph-mon[44211]: 2.5 scrub ok 2024-04-01T19:26:28.000 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:27 smithi062 ceph-mon[44211]: pgmap v426: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 MiB/s wr, 1.07k op/s 2024-04-01T19:26:28.087 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:26:28.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:27 smithi188 ceph-mon[43939]: 2.5 scrub ok 2024-04-01T19:26:28.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:27 smithi188 ceph-mon[43939]: pgmap v426: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 MiB/s wr, 1.07k op/s 2024-04-01T19:26:28.133 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:28.160 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:26:28.163 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:28.163 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:26:28.188 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:26:28.264 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:26:28.286 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:26:28.294 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:28.317 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:26:28.322 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:28.323 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:26:28.424 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:26:28.456 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:28.483 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:26:28.490 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:28.490 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:26:28.591 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:26:28.632 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:28.651 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:26:28.654 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:28.655 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:26:28.679 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 84 16 162441 162425 120.826 52.125 0.0193802 0.00827319 2024-04-01T19:26:28.756 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:26:28.799 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:28.935 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:26:28.943 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:28.944 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:26:28.946 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:26:29.045 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:26:29.074 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:29.174 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:26:29.179 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:29.180 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:26:29.281 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:26:29.321 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:29.347 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:26:29.349 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:29.350 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:26:29.451 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:26:29.495 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:29.535 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:26:29.542 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:29.543 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:26:29.644 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:26:29.673 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:29.679 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 85 16 163294 163278 120.032 53.3125 0.0794492 0.0083283 2024-04-01T19:26:29.875 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:26:29.878 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:29.878 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:26:29.979 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:26:30.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:29 smithi062 ceph-mon[44211]: pgmap v427: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 MiB/s wr, 924 op/s 2024-04-01T19:26:30.014 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:29 smithi188 ceph-mon[43939]: pgmap v427: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 MiB/s wr, 924 op/s 2024-04-01T19:26:30.017 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:30.045 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:26:30.048 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:30.049 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:26:30.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:29 smithi022 ceph-mon[39439]: pgmap v427: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 MiB/s wr, 924 op/s 2024-04-01T19:26:30.149 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:26:30.200 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:30.227 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:26:30.231 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:30.231 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:26:30.332 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:26:30.362 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:30.582 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:26:30.583 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:26:30.679 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 86 16 164155 164139 119.262 53.8125 0.00632793 0.00838081 2024-04-01T19:26:30.816 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:26:30.818 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:30.818 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:26:30.919 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:26:30.952 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:31.304 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:26:31.308 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:31.308 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:26:31.335 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_blocked_ops 2024-04-01T19:26:31.409 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:26:31.467 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:31.495 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:26:31.498 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:31.498 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:26:31.599 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:26:31.678 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:31.679 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 87 16 165001 164985 118.499 52.875 0.0452973 0.00843744 2024-04-01T19:26:31.709 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:26:31.740 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:31.740 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:26:31.740 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:26:31.841 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:26:31.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:31 smithi022 ceph-mon[39439]: pgmap v428: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 MiB/s wr, 940 op/s 2024-04-01T19:26:31.875 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:31.955 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:26:31.958 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:31.959 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:26:32.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:31 smithi062 ceph-mon[44211]: pgmap v428: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 MiB/s wr, 940 op/s 2024-04-01T19:26:32.060 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:26:32.116 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:32.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:31 smithi188 ceph-mon[43939]: pgmap v428: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 MiB/s wr, 940 op/s 2024-04-01T19:26:32.172 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:26:32.199 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:32.199 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:26:32.300 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:26:32.340 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:32.510 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:26:32.512 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:32.513 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:26:32.613 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:26:32.651 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:32.680 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 88 16 165753 165737 117.687 47 0.00902924 0.00849291 2024-04-01T19:26:32.767 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:32 smithi022 ceph-mon[39439]: 2.0 scrub starts 2024-04-01T19:26:32.767 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:32 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/50770153' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:26:32.767 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:32 smithi022 ceph-mon[39439]: from='client.34850 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:26:32.767 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:32 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1108444637' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T19:26:32.767 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:32 smithi022 ceph-mon[39439]: from='client.34856 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T19:26:32.795 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:26:32.806 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.7 to 1 (10000) 2024-04-01T19:26:33.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:32 smithi062 ceph-mon[44211]: 2.0 scrub starts 2024-04-01T19:26:33.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:32 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/50770153' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:26:33.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:32 smithi062 ceph-mon[44211]: from='client.34850 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:26:33.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:32 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1108444637' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T19:26:33.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:32 smithi062 ceph-mon[44211]: from='client.34856 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T19:26:33.112 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:26:33.115 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:33.115 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:26:33.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:32 smithi188 ceph-mon[43939]: 2.0 scrub starts 2024-04-01T19:26:33.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:32 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/50770153' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:26:33.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:32 smithi188 ceph-mon[43939]: from='client.34850 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:26:33.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:32 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1108444637' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T19:26:33.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:32 smithi188 ceph-mon[43939]: from='client.34856 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T19:26:33.216 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:26:33.297 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:33.569 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:26:33.574 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:33.575 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:26:33.610 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 8 1 2024-04-01T19:26:33.675 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:26:33.679 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 89 16 166616 166600 116.971 53.9375 0.0221509 0.0085474 2024-04-01T19:26:33.700 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:26:33.700 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:26:33.755 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:33.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:33 smithi022 ceph-mon[39439]: pgmap v429: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 MiB/s wr, 948 op/s 2024-04-01T19:26:33.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:33 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:26:33.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:33 smithi022 ceph-mon[39439]: from='client.34850 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:26:33.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:33 smithi022 ceph-mon[39439]: from='client.34856 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-04-01T19:26:33.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:33 smithi022 ceph-mon[39439]: osdmap e139: 12 total, 12 up, 12 in 2024-04-01T19:26:33.875 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:26:33.883 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:33.883 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:26:33.984 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:26:34.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:33 smithi062 ceph-mon[44211]: pgmap v429: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 MiB/s wr, 948 op/s 2024-04-01T19:26:34.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:33 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:26:34.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:33 smithi062 ceph-mon[44211]: from='client.34850 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:26:34.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:33 smithi062 ceph-mon[44211]: from='client.34856 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-04-01T19:26:34.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:33 smithi062 ceph-mon[44211]: osdmap e139: 12 total, 12 up, 12 in 2024-04-01T19:26:34.019 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:34.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:33 smithi188 ceph-mon[43939]: pgmap v429: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 MiB/s wr, 948 op/s 2024-04-01T19:26:34.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:33 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:26:34.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:33 smithi188 ceph-mon[43939]: from='client.34850 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:26:34.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:33 smithi188 ceph-mon[43939]: from='client.34856 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-04-01T19:26:34.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:33 smithi188 ceph-mon[43939]: osdmap e139: 12 total, 12 up, 12 in 2024-04-01T19:26:34.472 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:26:34.475 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:34.476 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:26:34.496 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_historic_ops 2024-04-01T19:26:34.577 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:26:34.607 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:34.635 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:26:34.639 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:34.640 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:26:34.642 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:26:34.661 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:26:34.680 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 90 14 167401 167387 116.217 49.1875 0.0408181 0.00860158 2024-04-01T19:26:34.698 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:26:34.732 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:26:34.741 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:26:34.753 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:26:34.767 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:34.775 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:26:34.787 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:26:34.789 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:34.790 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:26:34.797 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:26:34.823 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:26:34.829 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:26:34.846 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:26:34.872 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:26:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:34 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/807109467' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:26:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:34.890 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:26:34.893 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:26:34.921 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:26:34.927 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:34.954 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:26:34.954 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:26:34.957 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:34.957 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:26:34.959 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:26:34.960 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:26:34.960 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:26:34.960 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:26:34.960 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:26:34.960 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:26:34.960 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:26:34.960 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:26:34.960 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:26:34.960 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:26:34.960 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:26:34.960 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:26:35.058 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:26:35.070 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:34 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/807109467' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:26:35.070 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:35.070 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:35.084 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:35.103 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:26:35.105 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:35.105 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:26:35.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:34 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/807109467' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:26:35.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:35.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:35.206 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:26:35.233 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:35.254 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:26:35.256 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:35.257 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:26:35.357 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:26:35.385 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:35.406 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:26:35.409 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:35.409 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:26:35.510 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:26:35.541 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:35.642 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:26:35.645 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:35.645 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:26:35.680 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Total time run: 90.024 2024-04-01T19:26:35.680 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Total writes made: 167401 2024-04-01T19:26:35.680 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Write size: 65536 2024-04-01T19:26:35.680 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Object size: 65536 2024-04-01T19:26:35.680 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Bandwidth (MB/sec): 116.22 2024-04-01T19:26:35.680 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Stddev Bandwidth: 63.3735 2024-04-01T19:26:35.680 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Max bandwidth (MB/sec): 365.875 2024-04-01T19:26:35.680 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Min bandwidth (MB/sec): 47 2024-04-01T19:26:35.680 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Average IOPS: 1859 2024-04-01T19:26:35.681 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Stddev IOPS: 1013.98 2024-04-01T19:26:35.681 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Max IOPS: 5854 2024-04-01T19:26:35.681 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Min IOPS: 752 2024-04-01T19:26:35.681 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Average Latency(s): 0.00860358 2024-04-01T19:26:35.681 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Stddev Latency(s): 0.00869789 2024-04-01T19:26:35.681 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Max latency(s): 0.213588 2024-04-01T19:26:35.681 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Min latency(s): 0.00106051 2024-04-01T19:26:35.687 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Cleaning up (deleting benchmark objects) 2024-04-01T19:26:35.745 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:26:35.777 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:35 smithi062 ceph-mon[44211]: pgmap v431: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 MiB/s wr, 840 op/s 2024-04-01T19:26:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.028 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:26:36.035 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:36.035 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:26:36.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:35 smithi022 ceph-mon[39439]: pgmap v431: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 MiB/s wr, 840 op/s 2024-04-01T19:26:36.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:35 smithi188 ceph-mon[43939]: pgmap v431: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 MiB/s wr, 840 op/s 2024-04-01T19:26:36.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.127 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.127 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.127 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.127 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.127 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.127 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.127 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.127 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:36.136 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:26:36.173 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:36.197 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:26:36.203 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:36.203 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:26:36.304 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:26:36.333 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:26:36.334 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:36.356 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:26:36.362 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:36.362 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:26:36.463 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:26:36.523 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:36.639 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:26:36.639 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 20, 2024-04-01T19:26:36.639 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 600, 2024-04-01T19:26:36.639 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:26:36.639 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.640 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.24751.0:116556 2.d e128/106 2:bc701d94:::benchmark_data_smithi188_77607_object116555:head v 128'7197, mlcod=128'7194)", 2024-04-01T19:26:36.640 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:25:51.194935+0000", 2024-04-01T19:26:36.640 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 45.444481564999997, 2024-04-01T19:26:36.640 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0082379649999999999, 2024-04-01T19:26:36.640 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:36.640 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:36.640 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:36.640 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:36.640 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.640 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:36.640 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:51.194935+0000", 2024-04-01T19:26:36.640 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.641 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.641 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.641 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:36.641 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:51.194935+0000", 2024-04-01T19:26:36.641 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.641 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.641 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.641 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:36.641 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:51.194936+0000", 2024-04-01T19:26:36.641 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8100000000000002e-07 2024-04-01T19:26:36.641 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.641 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.642 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:36.642 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:51.195011+0000", 2024-04-01T19:26:36.642 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.4759999999999996e-05 2024-04-01T19:26:36.642 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.642 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.642 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:36.642 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:51.195019+0000", 2024-04-01T19:26:36.642 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.7810000000000005e-06 2024-04-01T19:26:36.642 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.642 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.642 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:36.643 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:51.195024+0000", 2024-04-01T19:26:36.643 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.4569999999999996e-06 2024-04-01T19:26:36.643 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.643 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.643 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:36.643 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:51.196872+0000", 2024-04-01T19:26:36.643 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.001847682 2024-04-01T19:26:36.643 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.643 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.643 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:36.643 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:51.196885+0000", 2024-04-01T19:26:36.643 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3081000000000001e-05 2024-04-01T19:26:36.643 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.643 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.643 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:36.644 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:51.203125+0000", 2024-04-01T19:26:36.644 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0062402270000000001 2024-04-01T19:26:36.644 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.644 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.644 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:36.644 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:51.203173+0000", 2024-04-01T19:26:36.644 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8296e-05 2024-04-01T19:26:36.644 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.644 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:36.644 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.644 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.644 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.644 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.24751.0:116565 2.d e128/106 2:b63e1d43:::benchmark_data_smithi188_77607_object116564:head v 128'7198, mlcod=128'7194)", 2024-04-01T19:26:36.644 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:25:51.195083+0000", 2024-04-01T19:26:36.644 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 45.444333503999999, 2024-04-01T19:26:36.645 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0081203950000000007, 2024-04-01T19:26:36.645 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:36.645 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:36.645 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:36.645 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:36.645 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.645 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:36.645 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:51.195083+0000", 2024-04-01T19:26:36.645 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.645 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.645 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.645 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:36.645 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:51.195083+0000", 2024-04-01T19:26:36.645 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.645 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.645 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.646 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:36.646 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:51.195084+0000", 2024-04-01T19:26:36.646 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.8700000000000004e-07 2024-04-01T19:26:36.646 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.646 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.646 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:36.646 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:51.195153+0000", 2024-04-01T19:26:36.646 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8324999999999994e-05 2024-04-01T19:26:36.646 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.646 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.646 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:36.646 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:51.195161+0000", 2024-04-01T19:26:36.646 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9179999999999994e-06 2024-04-01T19:26:36.646 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.646 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.647 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:36.647 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:51.195166+0000", 2024-04-01T19:26:36.647 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0810000000000001e-06 2024-04-01T19:26:36.647 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.647 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.647 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:36.647 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:51.198333+0000", 2024-04-01T19:26:36.647 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0031672549999999999 2024-04-01T19:26:36.647 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.647 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.647 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:36.647 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:51.198353+0000", 2024-04-01T19:26:36.647 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.9933999999999999e-05 2024-04-01T19:26:36.648 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.648 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.648 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:36.648 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:51.203176+0000", 2024-04-01T19:26:36.648 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.004823244 2024-04-01T19:26:36.648 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.648 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.648 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:36.648 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:51.203204+0000", 2024-04-01T19:26:36.648 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.7750999999999999e-05 2024-04-01T19:26:36.648 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.648 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:36.648 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.649 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.649 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.649 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.24751.0:122713 2.d e129/106 2:bf2516a1:::benchmark_data_smithi188_77607_object122712:head v 129'7577, mlcod=129'7575)", 2024-04-01T19:26:36.649 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:25:55.321818+0000", 2024-04-01T19:26:36.649 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 41.317598783999998, 2024-04-01T19:26:36.649 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0081810930000000004, 2024-04-01T19:26:36.649 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:36.649 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:36.649 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:36.649 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:36.649 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.649 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:36.649 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:55.321818+0000", 2024-04-01T19:26:36.649 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.650 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.650 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.650 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:36.650 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:55.321818+0000", 2024-04-01T19:26:36.650 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.650 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.650 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.650 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:36.650 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:55.321822+0000", 2024-04-01T19:26:36.650 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0670000000000002e-06 2024-04-01T19:26:36.650 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.650 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.650 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:36.651 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:55.321901+0000", 2024-04-01T19:26:36.651 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9201000000000003e-05 2024-04-01T19:26:36.651 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.651 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.651 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:36.651 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:55.321915+0000", 2024-04-01T19:26:36.651 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3388e-05 2024-04-01T19:26:36.651 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.651 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.651 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:36.651 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:55.321922+0000", 2024-04-01T19:26:36.651 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.131e-06 2024-04-01T19:26:36.651 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.651 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.651 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:36.652 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:55.321973+0000", 2024-04-01T19:26:36.652 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1070999999999999e-05 2024-04-01T19:26:36.652 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.652 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.652 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:36.652 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:55.321997+0000", 2024-04-01T19:26:36.652 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.4006999999999999e-05 2024-04-01T19:26:36.652 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.652 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.652 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:36.652 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:55.329949+0000", 2024-04-01T19:26:36.652 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0079515899999999997 2024-04-01T19:26:36.652 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.652 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.652 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:36.652 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:55.329999+0000", 2024-04-01T19:26:36.653 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0637999999999999e-05 2024-04-01T19:26:36.653 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.653 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:36.653 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.653 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.653 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.653 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.24751.0:143517 2.d e134/106 2:b7c8aa5f:::benchmark_data_smithi188_77607_object143516:head v 134'8874, mlcod=134'8872)", 2024-04-01T19:26:36.653 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:10.696380+0000", 2024-04-01T19:26:36.653 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 25.943037365999999, 2024-04-01T19:26:36.653 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.008713396, 2024-04-01T19:26:36.653 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:36.653 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:36.653 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:36.653 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:36.653 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.654 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:36.654 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.696380+0000", 2024-04-01T19:26:36.654 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.654 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.654 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.654 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:36.654 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.696380+0000", 2024-04-01T19:26:36.654 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.654 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.654 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.654 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:36.654 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.696382+0000", 2024-04-01T19:26:36.654 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.7709999999999998e-06 2024-04-01T19:26:36.655 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.655 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.655 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:36.655 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.696442+0000", 2024-04-01T19:26:36.655 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.9237999999999998e-05 2024-04-01T19:26:36.655 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.655 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.655 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:36.655 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.696460+0000", 2024-04-01T19:26:36.655 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8168999999999998e-05 2024-04-01T19:26:36.655 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.655 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.655 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:36.655 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.696470+0000", 2024-04-01T19:26:36.655 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.7419999999999992e-06 2024-04-01T19:26:36.655 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.656 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.656 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:36.656 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.696532+0000", 2024-04-01T19:26:36.656 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2336999999999996e-05 2024-04-01T19:26:36.656 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.656 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.656 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:36.656 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.696555+0000", 2024-04-01T19:26:36.656 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3428999999999999e-05 2024-04-01T19:26:36.656 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.656 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.657 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:36.657 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.705039+0000", 2024-04-01T19:26:36.657 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0084832599999999994 2024-04-01T19:26:36.657 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.657 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.657 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:36.657 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.705093+0000", 2024-04-01T19:26:36.657 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.4450000000000002e-05 2024-04-01T19:26:36.657 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.657 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:36.657 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.657 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.657 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.657 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.24751.0:143522 2.d e134/106 2:beecc269:::benchmark_data_smithi188_77607_object143521:head v 134'8875, mlcod=134'8872)", 2024-04-01T19:26:36.657 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:10.700882+0000", 2024-04-01T19:26:36.658 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 25.938534882999999, 2024-04-01T19:26:36.658 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0078703349999999991, 2024-04-01T19:26:36.658 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:36.658 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:36.658 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:36.658 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:36.658 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.658 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:36.658 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.700882+0000", 2024-04-01T19:26:36.658 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.658 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.658 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.658 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:36.658 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.700882+0000", 2024-04-01T19:26:36.658 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.659 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.659 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.659 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:36.659 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.700884+0000", 2024-04-01T19:26:36.659 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.2520000000000002e-06 2024-04-01T19:26:36.659 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.659 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.659 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:36.659 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.700932+0000", 2024-04-01T19:26:36.659 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7828999999999999e-05 2024-04-01T19:26:36.659 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.659 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.659 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:36.659 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.700950+0000", 2024-04-01T19:26:36.659 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.7935e-05 2024-04-01T19:26:36.660 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.660 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.660 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:36.660 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.700959+0000", 2024-04-01T19:26:36.660 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.5250000000000005e-06 2024-04-01T19:26:36.660 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.660 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.660 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:36.660 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.702570+0000", 2024-04-01T19:26:36.660 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0016116100000000001 2024-04-01T19:26:36.660 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.660 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.660 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:36.660 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.702593+0000", 2024-04-01T19:26:36.660 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.2853999999999998e-05 2024-04-01T19:26:36.660 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.661 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.661 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:36.661 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.708699+0000", 2024-04-01T19:26:36.661 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.006106083 2024-04-01T19:26:36.661 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.661 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.661 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:36.661 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.708752+0000", 2024-04-01T19:26:36.661 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3247e-05 2024-04-01T19:26:36.661 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.661 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:36.661 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.661 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.661 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.661 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.24751.0:143850 2.d e134/106 2:b7791954:::benchmark_data_smithi188_77607_object143849:head v 134'8900, mlcod=134'8898)", 2024-04-01T19:26:36.662 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:11.004861+0000", 2024-04-01T19:26:36.662 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 25.634555881000001, 2024-04-01T19:26:36.662 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0089747809999999994, 2024-04-01T19:26:36.662 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:36.662 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:36.662 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:36.662 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:36.662 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.662 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:36.662 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.004861+0000", 2024-04-01T19:26:36.662 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.662 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.662 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.662 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:36.662 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.004861+0000", 2024-04-01T19:26:36.662 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.663 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.663 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.663 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:36.663 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.004863+0000", 2024-04-01T19:26:36.663 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1610000000000001e-06 2024-04-01T19:26:36.663 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.663 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.663 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:36.663 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.004930+0000", 2024-04-01T19:26:36.663 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6910999999999997e-05 2024-04-01T19:26:36.663 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.663 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.663 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:36.663 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.004944+0000", 2024-04-01T19:26:36.664 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3974999999999999e-05 2024-04-01T19:26:36.664 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.664 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.664 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:36.664 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.004954+0000", 2024-04-01T19:26:36.664 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.5869999999999999e-06 2024-04-01T19:26:36.664 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.664 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.664 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:36.664 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.005019+0000", 2024-04-01T19:26:36.664 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5195000000000002e-05 2024-04-01T19:26:36.664 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.664 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.664 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:36.664 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.005045+0000", 2024-04-01T19:26:36.664 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.6508000000000001e-05 2024-04-01T19:26:36.665 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.665 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.665 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:36.665 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.013782+0000", 2024-04-01T19:26:36.665 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0087362350000000002 2024-04-01T19:26:36.665 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.665 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.665 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:36.665 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.013836+0000", 2024-04-01T19:26:36.665 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.4209000000000002e-05 2024-04-01T19:26:36.665 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.665 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:36.665 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.665 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.666 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.666 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.24751.0:143876 2.d e134/106 2:b0cd52ea:::benchmark_data_smithi188_77607_object143875:head v 134'8904, mlcod=134'8902)", 2024-04-01T19:26:36.666 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:11.021961+0000", 2024-04-01T19:26:36.666 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 25.617456441000002, 2024-04-01T19:26:36.666 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0079577090000000003, 2024-04-01T19:26:36.666 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:36.666 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:36.666 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:36.666 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:36.666 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.666 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:36.666 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.021961+0000", 2024-04-01T19:26:36.666 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.667 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.667 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.667 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:36.667 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.021961+0000", 2024-04-01T19:26:36.667 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.667 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.667 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.667 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:36.667 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.021962+0000", 2024-04-01T19:26:36.667 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.491e-06 2024-04-01T19:26:36.667 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.667 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.667 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:36.667 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.022138+0000", 2024-04-01T19:26:36.668 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000176207 2024-04-01T19:26:36.668 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.668 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.668 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:36.668 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.022151+0000", 2024-04-01T19:26:36.668 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2831e-05 2024-04-01T19:26:36.668 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.668 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.668 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:36.668 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.022159+0000", 2024-04-01T19:26:36.668 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.8460000000000008e-06 2024-04-01T19:26:36.668 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.669 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.669 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:36.669 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.022221+0000", 2024-04-01T19:26:36.669 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2577999999999996e-05 2024-04-01T19:26:36.669 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.669 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.669 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:36.669 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.022245+0000", 2024-04-01T19:26:36.669 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3873999999999999e-05 2024-04-01T19:26:36.669 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.669 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.670 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:36.670 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.029867+0000", 2024-04-01T19:26:36.670 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0076216729999999998 2024-04-01T19:26:36.670 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.670 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.670 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:36.670 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.029918+0000", 2024-04-01T19:26:36.670 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1208999999999997e-05 2024-04-01T19:26:36.670 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.670 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:36.670 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.670 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.670 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.671 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.24751.0:143949 2.d e134/106 2:b18ee8eb:::benchmark_data_smithi188_77607_object143948:head v 134'8909, mlcod=134'8907)", 2024-04-01T19:26:36.671 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:11.083802+0000", 2024-04-01T19:26:36.671 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 25.555615276000001, 2024-04-01T19:26:36.671 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0081670170000000004, 2024-04-01T19:26:36.671 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:36.671 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:36.671 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:36.671 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:36.671 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.671 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:36.671 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.083802+0000", 2024-04-01T19:26:36.671 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.672 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.672 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.672 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:36.672 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.083802+0000", 2024-04-01T19:26:36.672 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.672 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.672 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.672 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:36.672 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.083804+0000", 2024-04-01T19:26:36.672 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.6189999999999998e-06 2024-04-01T19:26:36.672 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.672 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.672 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:36.672 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.083842+0000", 2024-04-01T19:26:36.673 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8062999999999998e-05 2024-04-01T19:26:36.673 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.673 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.673 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:36.673 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.083859+0000", 2024-04-01T19:26:36.673 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.6585000000000001e-05 2024-04-01T19:26:36.673 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.673 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.673 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:36.673 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.083868+0000", 2024-04-01T19:26:36.673 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1009999999999998e-06 2024-04-01T19:26:36.673 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.673 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.673 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:36.674 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.084681+0000", 2024-04-01T19:26:36.674 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00081277200000000002 2024-04-01T19:26:36.674 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.674 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.674 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:36.674 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.084707+0000", 2024-04-01T19:26:36.674 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.5729e-05 2024-04-01T19:26:36.674 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.674 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.674 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:36.674 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.091903+0000", 2024-04-01T19:26:36.674 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0071959479999999998 2024-04-01T19:26:36.674 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.674 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.675 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:36.675 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.091969+0000", 2024-04-01T19:26:36.675 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6199999999999996e-05 2024-04-01T19:26:36.675 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.675 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:36.675 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.675 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.675 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.675 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.24751.0:144106 2.d e134/106 2:ba552d3c:::benchmark_data_smithi188_77607_object144105:head v 134'8922, mlcod=134'8920)", 2024-04-01T19:26:36.675 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:11.220595+0000", 2024-04-01T19:26:36.675 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 25.418822064, 2024-04-01T19:26:36.675 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0089698590000000002, 2024-04-01T19:26:36.675 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:36.675 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:36.675 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:36.675 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:36.676 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.676 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:36.676 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.220595+0000", 2024-04-01T19:26:36.676 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.676 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.676 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.676 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:36.676 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.220595+0000", 2024-04-01T19:26:36.676 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.676 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.676 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.676 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:36.676 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.220602+0000", 2024-04-01T19:26:36.676 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6229999999999999e-06 2024-04-01T19:26:36.676 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.676 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.677 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:36.677 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.220637+0000", 2024-04-01T19:26:36.677 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.5879e-05 2024-04-01T19:26:36.677 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.677 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.677 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:36.677 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.220656+0000", 2024-04-01T19:26:36.677 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8184000000000001e-05 2024-04-01T19:26:36.677 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.677 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.677 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:36.677 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.220665+0000", 2024-04-01T19:26:36.677 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.7520000000000008e-06 2024-04-01T19:26:36.677 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.677 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.678 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:36.678 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.223236+0000", 2024-04-01T19:26:36.678 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.002571154 2024-04-01T19:26:36.678 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.678 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.678 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:36.678 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.223265+0000", 2024-04-01T19:26:36.678 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8935e-05 2024-04-01T19:26:36.678 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.678 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.678 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:36.678 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.229510+0000", 2024-04-01T19:26:36.678 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0062448340000000003 2024-04-01T19:26:36.678 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.679 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.679 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:36.679 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.229565+0000", 2024-04-01T19:26:36.679 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.4497999999999999e-05 2024-04-01T19:26:36.679 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.679 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:36.679 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.679 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.679 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.679 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.24751.0:144109 2.d e134/106 2:b430f3b8:::benchmark_data_smithi188_77607_object144108:head v 134'8923, mlcod=134'8920)", 2024-04-01T19:26:36.679 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:11.221704+0000", 2024-04-01T19:26:36.679 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 25.417713302999999, 2024-04-01T19:26:36.679 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0086744119999999994, 2024-04-01T19:26:36.679 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:36.679 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:36.680 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:36.680 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:36.680 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.680 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:36.680 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.221704+0000", 2024-04-01T19:26:36.680 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.680 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.680 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.680 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:36.680 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.221704+0000", 2024-04-01T19:26:36.680 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.680 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.680 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.680 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:36.680 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.221705+0000", 2024-04-01T19:26:36.681 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1340000000000001e-06 2024-04-01T19:26:36.681 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.681 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.681 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:36.681 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.221733+0000", 2024-04-01T19:26:36.681 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8274000000000001e-05 2024-04-01T19:26:36.681 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.681 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.681 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:36.681 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.221743+0000", 2024-04-01T19:26:36.681 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0312999999999999e-05 2024-04-01T19:26:36.681 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.681 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.682 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:36.682 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.221750+0000", 2024-04-01T19:26:36.682 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9519999999999997e-06 2024-04-01T19:26:36.682 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.682 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.682 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:36.682 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.226090+0000", 2024-04-01T19:26:36.682 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0043400089999999997 2024-04-01T19:26:36.682 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.682 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.682 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:36.682 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.226114+0000", 2024-04-01T19:26:36.682 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3915000000000001e-05 2024-04-01T19:26:36.683 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.683 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.683 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:36.683 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.230331+0000", 2024-04-01T19:26:36.683 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0042166820000000002 2024-04-01T19:26:36.683 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.683 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.683 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:36.683 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.230378+0000", 2024-04-01T19:26:36.683 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7132999999999997e-05 2024-04-01T19:26:36.683 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.683 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:36.683 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.684 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.684 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.684 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.24751.0:144867 2.d e134/106 2:ba11fd26:::benchmark_data_smithi188_77607_object144866:head v 134'8972, mlcod=134'8968)", 2024-04-01T19:26:36.684 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:11.814454+0000", 2024-04-01T19:26:36.684 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 24.824962847999998, 2024-04-01T19:26:36.684 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0078282620000000008, 2024-04-01T19:26:36.684 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:36.684 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:36.684 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:36.684 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:36.684 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.685 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:36.685 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.814454+0000", 2024-04-01T19:26:36.685 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.685 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.685 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.685 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:36.685 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.814454+0000", 2024-04-01T19:26:36.685 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.685 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.685 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.685 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:36.685 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.814455+0000", 2024-04-01T19:26:36.685 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.268e-06 2024-04-01T19:26:36.685 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.686 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.686 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:36.686 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.814512+0000", 2024-04-01T19:26:36.686 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6351000000000003e-05 2024-04-01T19:26:36.686 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.686 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.686 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:36.686 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.814521+0000", 2024-04-01T19:26:36.686 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.6800000000000005e-06 2024-04-01T19:26:36.686 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.686 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.686 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:36.686 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.814528+0000", 2024-04-01T19:26:36.686 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3029999999999996e-06 2024-04-01T19:26:36.687 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.687 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.687 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:36.687 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.815724+0000", 2024-04-01T19:26:36.687 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.001196321 2024-04-01T19:26:36.687 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.687 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.687 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:36.687 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.815751+0000", 2024-04-01T19:26:36.687 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.7056999999999999e-05 2024-04-01T19:26:36.687 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.687 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.687 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:36.687 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.822226+0000", 2024-04-01T19:26:36.688 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.006474568 2024-04-01T19:26:36.688 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.688 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.688 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:36.688 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.822282+0000", 2024-04-01T19:26:36.688 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6713999999999999e-05 2024-04-01T19:26:36.688 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.688 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:36.688 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.688 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.688 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.688 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.24751.0:145329 2.d e134/106 2:b2d1c6ca:::benchmark_data_smithi188_77607_object145328:head v 134'9001, mlcod=134'8999)", 2024-04-01T19:26:36.688 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:12.169705+0000", 2024-04-01T19:26:36.689 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 24.469711823000001, 2024-04-01T19:26:36.689 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0082767159999999999, 2024-04-01T19:26:36.689 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:36.689 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:36.689 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:36.689 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:36.689 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.689 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:36.689 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.169705+0000", 2024-04-01T19:26:36.689 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.689 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.689 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.689 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:36.689 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.169705+0000", 2024-04-01T19:26:36.689 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.689 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.690 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.690 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:36.690 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.169708+0000", 2024-04-01T19:26:36.690 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.4150000000000002e-06 2024-04-01T19:26:36.690 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.690 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.690 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:36.690 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.169749+0000", 2024-04-01T19:26:36.690 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.1671999999999997e-05 2024-04-01T19:26:36.690 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.690 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.690 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:36.690 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.169775+0000", 2024-04-01T19:26:36.690 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.5541000000000002e-05 2024-04-01T19:26:36.690 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.691 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.691 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:36.691 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.169785+0000", 2024-04-01T19:26:36.691 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.043e-05 2024-04-01T19:26:36.691 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.691 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.691 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:36.691 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.169856+0000", 2024-04-01T19:26:36.691 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.0339999999999994e-05 2024-04-01T19:26:36.691 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.691 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.691 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:36.691 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.169879+0000", 2024-04-01T19:26:36.691 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3492000000000001e-05 2024-04-01T19:26:36.691 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.691 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.692 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:36.692 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.177936+0000", 2024-04-01T19:26:36.692 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0080568110000000005 2024-04-01T19:26:36.692 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.692 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.692 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:36.692 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.177982+0000", 2024-04-01T19:26:36.692 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6014999999999999e-05 2024-04-01T19:26:36.692 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.692 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:36.692 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.692 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.692 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.692 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.24751.0:146242 2.d e134/106 2:bede72c2:::benchmark_data_smithi188_77607_object146241:head v 134'9062, mlcod=134'9059)", 2024-04-01T19:26:36.692 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:12.901081+0000", 2024-04-01T19:26:36.692 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 23.738335706000001, 2024-04-01T19:26:36.693 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0081669759999999994, 2024-04-01T19:26:36.693 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:36.693 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:36.693 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:36.693 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:36.693 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.693 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:36.693 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.901081+0000", 2024-04-01T19:26:36.693 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.693 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.693 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.693 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:36.693 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.901081+0000", 2024-04-01T19:26:36.694 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.694 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.694 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.694 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:36.694 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.901083+0000", 2024-04-01T19:26:36.694 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.801e-06 2024-04-01T19:26:36.694 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.694 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.694 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:36.694 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.901134+0000", 2024-04-01T19:26:36.694 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0523999999999999e-05 2024-04-01T19:26:36.694 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.694 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.694 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:36.694 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.901146+0000", 2024-04-01T19:26:36.695 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2683e-05 2024-04-01T19:26:36.695 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.695 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.695 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:36.695 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.901154+0000", 2024-04-01T19:26:36.695 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9449999999999993e-06 2024-04-01T19:26:36.695 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.695 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.695 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:36.695 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.901226+0000", 2024-04-01T19:26:36.695 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.2162999999999993e-05 2024-04-01T19:26:36.695 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.695 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.695 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:36.695 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.901252+0000", 2024-04-01T19:26:36.695 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.5293e-05 2024-04-01T19:26:36.696 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.696 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.696 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:36.696 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.909191+0000", 2024-04-01T19:26:36.696 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.007939046 2024-04-01T19:26:36.696 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.696 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.696 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:36.696 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.909248+0000", 2024-04-01T19:26:36.696 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7521e-05 2024-04-01T19:26:36.696 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.696 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:36.696 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.696 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.696 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.696 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.24751.0:146373 2.d e134/106 2:b4021adc:::benchmark_data_smithi188_77607_object146372:head v 134'9066, mlcod=134'9064)", 2024-04-01T19:26:36.697 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:12.995702+0000", 2024-04-01T19:26:36.697 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 23.643715180000001, 2024-04-01T19:26:36.697 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0083593490000000003, 2024-04-01T19:26:36.697 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:36.697 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:36.697 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:36.697 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:36.697 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.697 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:36.697 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.995702+0000", 2024-04-01T19:26:36.697 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.697 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.697 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.697 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:36.697 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.995702+0000", 2024-04-01T19:26:36.697 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.698 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.698 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.698 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:36.698 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.995703+0000", 2024-04-01T19:26:36.698 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.6190000000000001e-06 2024-04-01T19:26:36.698 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.698 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.698 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:36.698 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.995773+0000", 2024-04-01T19:26:36.698 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9881000000000004e-05 2024-04-01T19:26:36.698 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.698 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.698 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:36.698 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.995787+0000", 2024-04-01T19:26:36.699 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3988999999999999e-05 2024-04-01T19:26:36.699 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.699 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.699 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:36.699 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.995800+0000", 2024-04-01T19:26:36.699 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2325e-05 2024-04-01T19:26:36.699 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.699 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.699 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:36.699 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.997821+0000", 2024-04-01T19:26:36.699 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0020210110000000001 2024-04-01T19:26:36.699 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.699 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.699 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:36.700 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.997838+0000", 2024-04-01T19:26:36.700 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.7322000000000001e-05 2024-04-01T19:26:36.700 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.700 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.700 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:36.700 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.004016+0000", 2024-04-01T19:26:36.700 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0061779189999999996 2024-04-01T19:26:36.700 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.700 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.700 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:36.700 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.004061+0000", 2024-04-01T19:26:36.700 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.5283e-05 2024-04-01T19:26:36.700 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.700 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:36.700 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.700 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.701 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.701 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.24751.0:146631 2.d e134/106 2:b3c9e885:::benchmark_data_smithi188_77607_object146630:head v 134'9083, mlcod=134'9081)", 2024-04-01T19:26:36.701 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:13.194197+0000", 2024-04-01T19:26:36.701 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 23.445220342999999, 2024-04-01T19:26:36.701 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0081000099999999995, 2024-04-01T19:26:36.701 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:36.701 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:36.701 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:36.701 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:36.701 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.701 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:36.701 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.194197+0000", 2024-04-01T19:26:36.701 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.701 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.701 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.701 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:36.702 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.194197+0000", 2024-04-01T19:26:36.702 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.702 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.702 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.702 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:36.702 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.194205+0000", 2024-04-01T19:26:36.702 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.7110000000000001e-06 2024-04-01T19:26:36.702 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.702 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.702 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:36.702 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.194248+0000", 2024-04-01T19:26:36.702 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.2858999999999997e-05 2024-04-01T19:26:36.702 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.702 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.702 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:36.703 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.194265+0000", 2024-04-01T19:26:36.703 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.7209000000000001e-05 2024-04-01T19:26:36.703 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.703 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.703 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:36.703 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.194275+0000", 2024-04-01T19:26:36.703 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.6229999999999992e-06 2024-04-01T19:26:36.703 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.703 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.703 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:36.703 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.196160+0000", 2024-04-01T19:26:36.703 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.001885421 2024-04-01T19:26:36.703 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.703 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.703 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:36.703 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.196188+0000", 2024-04-01T19:26:36.704 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.7189e-05 2024-04-01T19:26:36.704 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.704 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.704 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:36.704 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.202244+0000", 2024-04-01T19:26:36.704 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0060564039999999996 2024-04-01T19:26:36.704 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.704 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.704 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:36.704 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.202297+0000", 2024-04-01T19:26:36.704 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2593999999999998e-05 2024-04-01T19:26:36.704 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.704 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:36.704 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.704 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.704 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.705 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.24751.0:146642 2.d e134/106 2:bc350f95:::benchmark_data_smithi188_77607_object146641:head v 134'9084, mlcod=134'9081)", 2024-04-01T19:26:36.705 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:13.197392+0000", 2024-04-01T19:26:36.705 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 23.442024497999999, 2024-04-01T19:26:36.705 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0083086589999999995, 2024-04-01T19:26:36.705 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:36.705 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:36.705 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:36.705 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:36.705 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.705 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:36.705 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.197392+0000", 2024-04-01T19:26:36.705 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.705 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.705 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.706 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:36.706 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.197392+0000", 2024-04-01T19:26:36.706 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.706 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.706 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.706 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:36.706 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.197394+0000", 2024-04-01T19:26:36.706 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8369999999999999e-06 2024-04-01T19:26:36.706 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.706 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.706 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:36.706 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.197450+0000", 2024-04-01T19:26:36.706 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5612999999999998e-05 2024-04-01T19:26:36.706 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.706 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.706 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:36.707 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.197460+0000", 2024-04-01T19:26:36.707 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0346999999999999e-05 2024-04-01T19:26:36.707 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.707 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.707 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:36.707 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.197469+0000", 2024-04-01T19:26:36.707 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.6300000000000004e-06 2024-04-01T19:26:36.707 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.707 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.707 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:36.707 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.199744+0000", 2024-04-01T19:26:36.707 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0022749039999999999 2024-04-01T19:26:36.707 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.707 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.707 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:36.708 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.199774+0000", 2024-04-01T19:26:36.708 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.0148999999999999e-05 2024-04-01T19:26:36.708 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.708 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.708 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:36.708 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.205645+0000", 2024-04-01T19:26:36.708 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0058709490000000003 2024-04-01T19:26:36.708 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.708 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.708 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:36.708 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.205701+0000", 2024-04-01T19:26:36.708 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6230000000000002e-05 2024-04-01T19:26:36.708 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.708 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:36.708 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.708 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.709 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.709 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.24751.0:146648 2.d e134/106 2:b5a99137:::benchmark_data_smithi188_77607_object146647:head v 134'9085, mlcod=134'9081)", 2024-04-01T19:26:36.709 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:13.201262+0000", 2024-04-01T19:26:36.709 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 23.438155119000001, 2024-04-01T19:26:36.709 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0098481160000000005, 2024-04-01T19:26:36.709 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:36.709 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:36.709 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:36.709 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:36.709 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.709 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:36.709 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.201262+0000", 2024-04-01T19:26:36.709 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.709 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.710 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.710 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:36.710 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.201262+0000", 2024-04-01T19:26:36.710 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.710 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.710 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.710 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:36.710 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.201264+0000", 2024-04-01T19:26:36.710 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8300000000000001e-06 2024-04-01T19:26:36.710 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.710 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.710 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:36.710 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.201333+0000", 2024-04-01T19:26:36.710 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9418000000000005e-05 2024-04-01T19:26:36.711 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.711 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.711 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:36.711 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.201344+0000", 2024-04-01T19:26:36.711 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0641e-05 2024-04-01T19:26:36.711 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.711 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.711 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:36.711 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.201350+0000", 2024-04-01T19:26:36.711 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.55e-06 2024-04-01T19:26:36.711 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.711 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.711 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:36.711 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.202323+0000", 2024-04-01T19:26:36.712 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00097249200000000004 2024-04-01T19:26:36.712 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.712 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.712 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:36.712 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.202337+0000", 2024-04-01T19:26:36.712 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.452e-05 2024-04-01T19:26:36.712 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.712 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.712 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:36.712 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.211070+0000", 2024-04-01T19:26:36.712 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0087322200000000006 2024-04-01T19:26:36.712 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.712 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.712 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:36.712 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.211110+0000", 2024-04-01T19:26:36.713 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0445000000000003e-05 2024-04-01T19:26:36.713 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.713 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:36.713 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.713 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.713 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.713 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.24751.0:149898 2.d e134/106 2:bf4e8f2f:::benchmark_data_smithi188_77607_object149897:head v 134'9276, mlcod=134'9272)", 2024-04-01T19:26:36.713 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:15.976917+0000", 2024-04-01T19:26:36.713 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 20.662500262999998, 2024-04-01T19:26:36.713 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0085581830000000005, 2024-04-01T19:26:36.713 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:36.713 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:36.713 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:36.713 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:36.714 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.714 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:36.714 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:15.976917+0000", 2024-04-01T19:26:36.714 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.714 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.714 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.714 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:36.714 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:15.976917+0000", 2024-04-01T19:26:36.714 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.714 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.714 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.714 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:36.714 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:15.976919+0000", 2024-04-01T19:26:36.715 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.491e-06 2024-04-01T19:26:36.715 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.715 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.715 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:36.715 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:15.977005+0000", 2024-04-01T19:26:36.715 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.5580000000000004e-05 2024-04-01T19:26:36.715 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.715 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.715 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:36.715 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:15.977016+0000", 2024-04-01T19:26:36.715 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0878e-05 2024-04-01T19:26:36.715 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.715 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.715 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:36.715 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:15.977025+0000", 2024-04-01T19:26:36.716 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.8699999999999998e-06 2024-04-01T19:26:36.716 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.716 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.716 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:36.716 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:15.978742+0000", 2024-04-01T19:26:36.716 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.001717819 2024-04-01T19:26:36.716 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.716 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.716 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:36.716 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:15.978773+0000", 2024-04-01T19:26:36.716 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.0948999999999998e-05 2024-04-01T19:26:36.716 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.716 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.716 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:36.717 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:15.985424+0000", 2024-04-01T19:26:36.717 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0066502840000000002 2024-04-01T19:26:36.717 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.717 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.717 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:36.717 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:15.985475+0000", 2024-04-01T19:26:36.717 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1311999999999999e-05 2024-04-01T19:26:36.717 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.717 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:36.717 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.717 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.717 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.717 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.24751.0:154876 2.d e136/106 2:bd02f9eb:::benchmark_data_smithi188_77607_object154875:head v 136'9590, mlcod=136'9587)", 2024-04-01T19:26:36.717 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:20.442524+0000", 2024-04-01T19:26:36.717 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 16.196892794, 2024-04-01T19:26:36.718 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0098802660000000004, 2024-04-01T19:26:36.718 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:36.718 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:36.718 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:36.718 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:36.718 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.718 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:36.718 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:20.442524+0000", 2024-04-01T19:26:36.718 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.718 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.718 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.718 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:36.718 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:20.442524+0000", 2024-04-01T19:26:36.718 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.718 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.719 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.719 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:36.719 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:20.442526+0000", 2024-04-01T19:26:36.719 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1019999999999999e-06 2024-04-01T19:26:36.719 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.719 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.719 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:36.719 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:20.442577+0000", 2024-04-01T19:26:36.719 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1073999999999999e-05 2024-04-01T19:26:36.719 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.719 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.719 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:36.719 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:20.442591+0000", 2024-04-01T19:26:36.719 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.344e-05 2024-04-01T19:26:36.719 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.719 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.719 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:36.720 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:20.442604+0000", 2024-04-01T19:26:36.720 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2721000000000001e-05 2024-04-01T19:26:36.720 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.720 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.720 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:36.720 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:20.442664+0000", 2024-04-01T19:26:36.720 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.0069999999999999e-05 2024-04-01T19:26:36.720 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.720 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.720 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:36.720 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:20.442682+0000", 2024-04-01T19:26:36.720 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8017e-05 2024-04-01T19:26:36.720 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.720 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.720 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:36.721 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:20.452356+0000", 2024-04-01T19:26:36.721 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0096747139999999992 2024-04-01T19:26:36.721 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.721 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.721 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:36.721 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:20.452404+0000", 2024-04-01T19:26:36.721 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8127999999999997e-05 2024-04-01T19:26:36.721 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.721 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:36.721 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.721 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.721 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.721 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.24751.0:154881 2.d e136/106 2:b009e3b4:::benchmark_data_smithi188_77607_object154880:head v 136'9591, mlcod=136'9588)", 2024-04-01T19:26:36.721 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:20.444631+0000", 2024-04-01T19:26:36.721 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 16.194785512999999, 2024-04-01T19:26:36.721 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0078091840000000003, 2024-04-01T19:26:36.722 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:36.722 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:36.722 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:36.722 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:36.722 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.722 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:36.722 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:20.444631+0000", 2024-04-01T19:26:36.722 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.722 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.722 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.722 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:36.722 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:20.444631+0000", 2024-04-01T19:26:36.722 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:36.722 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.722 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.723 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:36.723 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:20.444639+0000", 2024-04-01T19:26:36.723 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.8879999999999997e-06 2024-04-01T19:26:36.723 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.723 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.723 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:36.723 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:20.444735+0000", 2024-04-01T19:26:36.723 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.5397999999999997e-05 2024-04-01T19:26:36.723 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.723 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.723 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:36.723 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:20.444749+0000", 2024-04-01T19:26:36.723 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4450000000000001e-05 2024-04-01T19:26:36.723 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.723 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.724 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:36.724 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:20.444758+0000", 2024-04-01T19:26:36.724 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.0059999999999998e-06 2024-04-01T19:26:36.724 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.724 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.724 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:36.724 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:20.445447+0000", 2024-04-01T19:26:36.724 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00068882800000000005 2024-04-01T19:26:36.724 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.724 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.724 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:36.724 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:20.445470+0000", 2024-04-01T19:26:36.724 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3047000000000001e-05 2024-04-01T19:26:36.724 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.724 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.724 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:36.724 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:20.452411+0000", 2024-04-01T19:26:36.725 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0069408270000000001 2024-04-01T19:26:36.725 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:36.725 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:36.725 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:36.725 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:20.452441+0000", 2024-04-01T19:26:36.725 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.974e-05 2024-04-01T19:26:36.725 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.725 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:36.725 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.725 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:36.725 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:36.725 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:26:37.000 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:26:37.002 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:37.003 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:26:37.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:36 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:37.100 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:26:37.104 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:26:37.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:36 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:37.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:36 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:37.150 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:37.294 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:26:37.306 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:37.307 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:26:37.407 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:26:37.432 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_ops_in_flight 2024-04-01T19:26:37.448 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:37.479 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:26:37.482 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:37.482 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:26:37.583 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:26:37.624 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:37.714 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:26:37.720 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:37.720 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:26:37.751 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:26:37.821 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:26:37.856 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:37.882 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:37 smithi022 ceph-mon[39439]: pgmap v432: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 MiB/s wr, 831 op/s 2024-04-01T19:26:38.004 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:26:38.007 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:38.007 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:26:38.050 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:37 smithi062 ceph-mon[44211]: pgmap v432: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 MiB/s wr, 831 op/s 2024-04-01T19:26:38.108 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:26:38.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:37 smithi188 ceph-mon[43939]: pgmap v432: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 MiB/s wr, 831 op/s 2024-04-01T19:26:38.155 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:38.181 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:26:38.185 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:38.185 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:26:38.208 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:26:38.286 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:26:38.314 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:38.514 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:26:38.517 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:38.517 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:26:38.618 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:26:38.701 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:38.812 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.8 to 1 (10000) 2024-04-01T19:26:39.020 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:38 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/60646298' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T19:26:39.021 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:38 smithi022 ceph-mon[39439]: from='client.34868 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T19:26:39.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:38 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/60646298' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T19:26:39.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:38 smithi188 ceph-mon[43939]: from='client.34868 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T19:26:39.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:38 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/60646298' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T19:26:39.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:38 smithi062 ceph-mon[44211]: from='client.34868 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T19:26:39.616 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:26:39.616 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:26:39.616 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:39.616 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:170795 2.3 2:c35ec6a8:::benchmark_data_smithi188_77607_object3391:head [delete] snapc 0=[] ondisk+write+known_if_redirected e140)", 2024-04-01T19:26:39.616 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:39.614451+0000", 2024-04-01T19:26:39.616 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0035302860000000001, 2024-04-01T19:26:39.616 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0035550830000000001, 2024-04-01T19:26:39.616 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:39.616 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:39.616 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:26:39.616 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:26:39.616 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:26:39.616 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:26:39.617 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 170795 2024-04-01T19:26:39.617 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:39.617 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:39.617 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:39.617 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:39.617 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:39.614451+0000", 2024-04-01T19:26:39.617 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:39.617 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:39.617 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:39.617 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:39.617 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:39.614451+0000", 2024-04-01T19:26:39.617 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:39.617 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:39.618 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:39.618 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:39.618 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:39.614454+0000", 2024-04-01T19:26:39.618 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.599e-06 2024-04-01T19:26:39.618 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:39.618 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:39.618 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:39.618 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:39.614462+0000", 2024-04-01T19:26:39.618 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.2369999999999992e-06 2024-04-01T19:26:39.618 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:39.618 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:39.618 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:39.618 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:39.614482+0000", 2024-04-01T19:26:39.618 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.9684e-05 2024-04-01T19:26:39.619 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:39.619 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:39.619 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:39.619 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:39.614493+0000", 2024-04-01T19:26:39.619 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1114000000000001e-05 2024-04-01T19:26:39.619 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:39.619 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:39.619 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:39.619 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:39.614566+0000", 2024-04-01T19:26:39.619 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.2853000000000002e-05 2024-04-01T19:26:39.619 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:39.619 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:39.619 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:39.620 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:39.614705+0000", 2024-04-01T19:26:39.620 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013946400000000001 2024-04-01T19:26:39.620 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:39.620 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:39.620 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 2", 2024-04-01T19:26:39.620 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:39.614834+0000", 2024-04-01T19:26:39.620 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012899299999999999 2024-04-01T19:26:39.620 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:39.620 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:39.620 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:39.620 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:39.620 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-04-01T19:26:39.620 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 1 2024-04-01T19:26:39.620 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:26:39.645 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:26:39.687 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 9 1 2024-04-01T19:26:39.907 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:39 smithi022 ceph-mon[39439]: pgmap v433: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 45 MiB/s wr, 789 op/s 2024-04-01T19:26:39.907 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:39 smithi022 ceph-mon[39439]: from='client.34868 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]': finished 2024-04-01T19:26:39.907 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:39 smithi022 ceph-mon[39439]: osdmap e140: 12 total, 12 up, 12 in 2024-04-01T19:26:40.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:39 smithi062 ceph-mon[44211]: pgmap v433: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 45 MiB/s wr, 789 op/s 2024-04-01T19:26:40.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:39 smithi062 ceph-mon[44211]: from='client.34868 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]': finished 2024-04-01T19:26:40.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:39 smithi062 ceph-mon[44211]: osdmap e140: 12 total, 12 up, 12 in 2024-04-01T19:26:40.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:39 smithi188 ceph-mon[43939]: pgmap v433: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 45 MiB/s wr, 789 op/s 2024-04-01T19:26:40.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:39 smithi188 ceph-mon[43939]: from='client.34868 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]': finished 2024-04-01T19:26:40.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:39 smithi188 ceph-mon[43939]: osdmap e140: 12 total, 12 up, 12 in 2024-04-01T19:26:40.376 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:26:40.389 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:40.389 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:26:40.399 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_blocked_ops 2024-04-01T19:26:40.491 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:26:40.542 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:40.706 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:26:40.832 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:26:41.099 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:26:41.120 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:40 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:26:41.120 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:40 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:26:41.120 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:40 smithi022 ceph-mon[39439]: osdmap e141: 12 total, 12 up, 12 in 2024-04-01T19:26:41.120 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:40 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:26:41.120 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:40 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:26:41.120 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:40 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/397024180' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:26:41.120 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:40 smithi022 ceph-mon[39439]: from='client.24862 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:26:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:40 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:26:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:40 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:26:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:40 smithi188 ceph-mon[43939]: osdmap e141: 12 total, 12 up, 12 in 2024-04-01T19:26:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:40 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:26:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:40 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:26:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:40 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/397024180' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:26:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:40 smithi188 ceph-mon[43939]: from='client.24862 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:26:41.243 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:40 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:26:41.243 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:40 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:26:41.243 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:40 smithi062 ceph-mon[44211]: osdmap e141: 12 total, 12 up, 12 in 2024-04-01T19:26:41.243 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:40 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:26:41.243 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:40 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:26:41.243 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:40 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/397024180' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:26:41.243 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:40 smithi062 ceph-mon[44211]: from='client.24862 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:26:41.248 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:26:41.252 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:41.252 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:26:41.353 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:26:41.388 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:41.415 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:26:41.419 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:41.419 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:26:41.520 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:26:41.558 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:41.582 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:26:41.585 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:41.585 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:26:41.686 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:26:41.722 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:41.749 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:26:41.754 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:41.754 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:26:41.855 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:26:41.917 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:41 smithi022 ceph-mon[39439]: pgmap v436: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 B/s rd, 27 MiB/s wr, 755 op/s 2024-04-01T19:26:41.917 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:41 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:26:41.917 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:41 smithi022 ceph-mon[39439]: from='client.24862 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:26:41.917 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:41 smithi022 ceph-mon[39439]: osdmap e142: 12 total, 12 up, 12 in 2024-04-01T19:26:41.920 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:41.954 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:41 smithi062 ceph-mon[44211]: pgmap v436: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 B/s rd, 27 MiB/s wr, 755 op/s 2024-04-01T19:26:41.954 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:41 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:26:41.955 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:41 smithi062 ceph-mon[44211]: from='client.24862 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:26:41.955 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:41 smithi062 ceph-mon[44211]: osdmap e142: 12 total, 12 up, 12 in 2024-04-01T19:26:42.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:41 smithi188 ceph-mon[43939]: pgmap v436: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 B/s rd, 27 MiB/s wr, 755 op/s 2024-04-01T19:26:42.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:41 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:26:42.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:41 smithi188 ceph-mon[43939]: from='client.24862 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:26:42.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:41 smithi188 ceph-mon[43939]: osdmap e142: 12 total, 12 up, 12 in 2024-04-01T19:26:42.635 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:26:42.635 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:26:42.635 INFO:teuthology.orchestra.run.smithi062.stdout: "complaint_time": 30, 2024-04-01T19:26:42.635 INFO:teuthology.orchestra.run.smithi062.stdout: "num_blocked_ops": 0 2024-04-01T19:26:42.635 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:26:43.382 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_historic_ops 2024-04-01T19:26:43.680 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:26:43.708 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:26:44.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:43 smithi022 ceph-mon[39439]: pgmap v438: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 6.9 MiB/s wr, 802 op/s 2024-04-01T19:26:44.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:43 smithi188 ceph-mon[43939]: pgmap v438: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 6.9 MiB/s wr, 802 op/s 2024-04-01T19:26:44.245 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:43 smithi062 ceph-mon[44211]: pgmap v438: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 6.9 MiB/s wr, 802 op/s 2024-04-01T19:26:45.965 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:26:45.965 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 20, 2024-04-01T19:26:45.965 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 600, 2024-04-01T19:26:45.965 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:26:45.965 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.965 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:122983 2.3 2:c59a2203:::benchmark_data_smithi188_77607_object122982:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e129)", 2024-04-01T19:26:45.965 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:25:55.514577+0000", 2024-04-01T19:26:45.965 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 50.209405549000003, 2024-04-01T19:26:45.965 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.037325753000000003, 2024-04-01T19:26:45.965 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:45.966 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:45.966 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:45.966 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:26:45.966 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:26:45.966 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:26:45.966 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 122983 2024-04-01T19:26:45.966 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.966 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:45.966 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.966 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:45.966 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:55.514577+0000", 2024-04-01T19:26:45.966 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:45.966 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.967 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.967 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:45.967 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:55.514577+0000", 2024-04-01T19:26:45.967 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:45.967 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.967 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.967 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:45.967 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:55.514579+0000", 2024-04-01T19:26:45.967 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.669e-06 2024-04-01T19:26:45.967 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.967 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.967 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:45.967 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:55.514641+0000", 2024-04-01T19:26:45.968 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.1953999999999997e-05 2024-04-01T19:26:45.968 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.968 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.968 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:45.968 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:55.514650+0000", 2024-04-01T19:26:45.968 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.8050000000000001e-06 2024-04-01T19:26:45.968 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.968 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.968 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:45.968 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:55.514656+0000", 2024-04-01T19:26:45.968 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6790000000000002e-06 2024-04-01T19:26:45.968 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.968 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.969 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:45.969 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:55.514695+0000", 2024-04-01T19:26:45.969 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9415000000000001e-05 2024-04-01T19:26:45.969 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.969 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.969 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:45.969 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:55.514820+0000", 2024-04-01T19:26:45.969 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000124986 2024-04-01T19:26:45.969 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.969 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.969 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 2", 2024-04-01T19:26:45.969 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:55.514905+0000", 2024-04-01T19:26:45.969 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.4815999999999996e-05 2024-04-01T19:26:45.969 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.970 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.970 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:26:45.970 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:55.517422+0000", 2024-04-01T19:26:45.970 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.002516767 2024-04-01T19:26:45.970 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.970 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.970 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:26:45.970 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:55.551834+0000", 2024-04-01T19:26:45.970 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.034411866999999999 2024-04-01T19:26:45.970 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.970 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.970 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:45.970 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:55.551872+0000", 2024-04-01T19:26:45.971 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8177999999999999e-05 2024-04-01T19:26:45.971 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.971 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.971 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:45.971 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:25:55.551903+0000", 2024-04-01T19:26:45.971 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.0617000000000002e-05 2024-04-01T19:26:45.971 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:45.971 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:45.971 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:45.971 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.971 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.971 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:141482 2.3 2:cd47f646:::benchmark_data_smithi188_77607_object141481:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:26:45.971 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:09.000819+0000", 2024-04-01T19:26:45.972 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 36.723163814000003, 2024-04-01T19:26:45.972 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.044661365000000001, 2024-04-01T19:26:45.972 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:45.972 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:45.972 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:45.972 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:26:45.972 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:26:45.972 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:26:45.972 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 141482 2024-04-01T19:26:45.972 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.972 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:45.972 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.972 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:45.972 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.000819+0000", 2024-04-01T19:26:45.973 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:45.973 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.973 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.973 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:45.973 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.000819+0000", 2024-04-01T19:26:45.973 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:45.973 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.973 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.973 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:45.973 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.000821+0000", 2024-04-01T19:26:45.973 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.866e-06 2024-04-01T19:26:45.973 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.973 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.973 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:45.974 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.000938+0000", 2024-04-01T19:26:45.974 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000117837 2024-04-01T19:26:45.974 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.974 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.974 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:45.974 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.000950+0000", 2024-04-01T19:26:45.974 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1965e-05 2024-04-01T19:26:45.974 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.974 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.974 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:45.974 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.000958+0000", 2024-04-01T19:26:45.974 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.6090000000000003e-06 2024-04-01T19:26:45.974 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.975 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.975 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:45.975 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.001007+0000", 2024-04-01T19:26:45.975 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9070000000000003e-05 2024-04-01T19:26:45.975 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.975 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.975 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:45.975 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.001107+0000", 2024-04-01T19:26:45.975 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00010006200000000001 2024-04-01T19:26:45.975 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.975 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.975 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 2", 2024-04-01T19:26:45.975 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.001224+0000", 2024-04-01T19:26:45.975 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000117286 2024-04-01T19:26:45.976 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.976 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.976 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:26:45.976 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.004326+0000", 2024-04-01T19:26:45.976 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.003101206 2024-04-01T19:26:45.976 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.976 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.976 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:26:45.976 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.045412+0000", 2024-04-01T19:26:45.976 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.041086217000000001 2024-04-01T19:26:45.976 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.976 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.976 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:45.976 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.045444+0000", 2024-04-01T19:26:45.976 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.2121e-05 2024-04-01T19:26:45.977 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.977 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.977 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:45.977 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.045480+0000", 2024-04-01T19:26:45.977 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.6125999999999999e-05 2024-04-01T19:26:45.977 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:45.977 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:45.977 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:45.977 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.977 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.977 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:141487 2.2 2:4e04f9d1:::benchmark_data_smithi188_77607_object141486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:26:45.977 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:09.005598+0000", 2024-04-01T19:26:45.977 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 36.718384378000003, 2024-04-01T19:26:45.977 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.044332270999999999, 2024-04-01T19:26:45.978 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:45.978 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:45.978 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:45.978 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:26:45.978 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:26:45.978 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:26:45.978 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 141487 2024-04-01T19:26:45.978 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.978 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:45.978 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.978 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:45.978 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005598+0000", 2024-04-01T19:26:45.978 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:45.978 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.979 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.979 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:45.979 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005598+0000", 2024-04-01T19:26:45.979 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:45.979 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.979 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.979 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:45.979 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005599+0000", 2024-04-01T19:26:45.979 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.172e-06 2024-04-01T19:26:45.979 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.979 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.979 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:45.980 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005662+0000", 2024-04-01T19:26:45.980 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2823999999999993e-05 2024-04-01T19:26:45.980 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.980 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.980 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:45.980 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005671+0000", 2024-04-01T19:26:45.980 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.0759999999999992e-06 2024-04-01T19:26:45.980 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.980 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.980 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:45.980 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005676+0000", 2024-04-01T19:26:45.980 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.831e-06 2024-04-01T19:26:45.980 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.980 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.981 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:45.981 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.009972+0000", 2024-04-01T19:26:45.981 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.004295465 2024-04-01T19:26:45.981 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.981 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.981 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:45.981 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.010055+0000", 2024-04-01T19:26:45.981 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.3053000000000006e-05 2024-04-01T19:26:45.981 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.981 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.981 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:26:45.981 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.010159+0000", 2024-04-01T19:26:45.981 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000104505 2024-04-01T19:26:45.981 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.982 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.982 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:26:45.982 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.014280+0000", 2024-04-01T19:26:45.982 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0041208319999999996 2024-04-01T19:26:45.982 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.982 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.982 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:26:45.982 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.049825+0000", 2024-04-01T19:26:45.982 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.035545531999999998 2024-04-01T19:26:45.982 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.982 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.982 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:45.982 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.049884+0000", 2024-04-01T19:26:45.983 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8406999999999998e-05 2024-04-01T19:26:45.983 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.983 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.983 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:45.983 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.049930+0000", 2024-04-01T19:26:45.983 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6573999999999998e-05 2024-04-01T19:26:45.983 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:45.983 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:45.983 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:45.983 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.983 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.983 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:141489 2.2 2:420ebb95:::benchmark_data_smithi188_77607_object141488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:26:45.983 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:09.005826+0000", 2024-04-01T19:26:45.983 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 36.718156356000001, 2024-04-01T19:26:45.983 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.044204885999999999, 2024-04-01T19:26:45.984 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:45.984 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:45.984 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:45.984 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:26:45.984 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:26:45.984 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:26:45.984 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 141489 2024-04-01T19:26:45.984 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.984 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:45.984 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.984 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:45.984 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005826+0000", 2024-04-01T19:26:45.984 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:45.985 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.985 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.985 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:45.985 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005826+0000", 2024-04-01T19:26:45.985 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:45.985 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.985 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.985 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:45.985 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005827+0000", 2024-04-01T19:26:45.985 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1060000000000001e-06 2024-04-01T19:26:45.985 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.985 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.985 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:45.985 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005942+0000", 2024-04-01T19:26:45.986 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000114608 2024-04-01T19:26:45.986 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.986 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.986 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:45.986 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005950+0000", 2024-04-01T19:26:45.986 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9650000000000008e-06 2024-04-01T19:26:45.986 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.986 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.986 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:45.986 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005954+0000", 2024-04-01T19:26:45.986 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3329999999999998e-06 2024-04-01T19:26:45.986 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.986 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.986 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:45.987 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.012460+0000", 2024-04-01T19:26:45.987 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.006505856 2024-04-01T19:26:45.987 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.987 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.987 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:45.987 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.012536+0000", 2024-04-01T19:26:45.987 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.5524000000000004e-05 2024-04-01T19:26:45.987 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.987 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.987 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:26:45.987 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.012629+0000", 2024-04-01T19:26:45.987 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.3004000000000006e-05 2024-04-01T19:26:45.987 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.987 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.988 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:26:45.988 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.014425+0000", 2024-04-01T19:26:45.988 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.001796139 2024-04-01T19:26:45.988 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.988 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.988 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:26:45.988 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.049966+0000", 2024-04-01T19:26:45.988 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.035541352999999998 2024-04-01T19:26:45.988 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.988 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.988 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:45.988 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.050003+0000", 2024-04-01T19:26:45.988 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.6551000000000003e-05 2024-04-01T19:26:45.988 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.989 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.989 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:45.989 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.050031+0000", 2024-04-01T19:26:45.989 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8447000000000001e-05 2024-04-01T19:26:45.989 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:45.989 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:45.989 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:45.989 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.989 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.989 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:141491 2.3 2:ca67c7a4:::benchmark_data_smithi188_77607_object141490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:26:45.989 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:09.005961+0000", 2024-04-01T19:26:45.989 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 36.718021426999996, 2024-04-01T19:26:45.989 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.039631894000000001, 2024-04-01T19:26:45.989 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:45.990 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:45.990 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:45.990 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:26:45.990 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:26:45.990 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:26:45.990 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 141491 2024-04-01T19:26:45.990 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.990 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:45.990 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.990 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:45.990 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005961+0000", 2024-04-01T19:26:45.990 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:45.990 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.990 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.990 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:45.990 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005961+0000", 2024-04-01T19:26:45.991 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:45.991 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.991 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.991 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:45.991 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005962+0000", 2024-04-01T19:26:45.991 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.8700000000000005e-07 2024-04-01T19:26:45.991 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.991 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.991 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:45.991 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.006021+0000", 2024-04-01T19:26:45.991 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.9064999999999998e-05 2024-04-01T19:26:45.991 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.991 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.991 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:45.991 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.006031+0000", 2024-04-01T19:26:45.991 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.8539999999999992e-06 2024-04-01T19:26:45.992 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.992 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.992 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:45.992 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.006038+0000", 2024-04-01T19:26:45.992 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.4120000000000004e-06 2024-04-01T19:26:45.992 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.992 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.992 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:45.992 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.006092+0000", 2024-04-01T19:26:45.992 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3322999999999998e-05 2024-04-01T19:26:45.992 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.992 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.992 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:45.992 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.006224+0000", 2024-04-01T19:26:45.992 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000131991 2024-04-01T19:26:45.993 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.993 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.993 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 2", 2024-04-01T19:26:45.993 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.006415+0000", 2024-04-01T19:26:45.993 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000191349 2024-04-01T19:26:45.993 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.993 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.993 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:26:45.993 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.009539+0000", 2024-04-01T19:26:45.993 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0031242069999999999 2024-04-01T19:26:45.993 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.993 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.993 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:26:45.993 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.045520+0000", 2024-04-01T19:26:45.993 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.035981045000000003 2024-04-01T19:26:45.994 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.994 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.994 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:45.994 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.045556+0000", 2024-04-01T19:26:45.994 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.5719999999999997e-05 2024-04-01T19:26:45.994 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.994 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.994 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:45.994 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.045593+0000", 2024-04-01T19:26:45.994 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.7141000000000002e-05 2024-04-01T19:26:45.994 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:45.994 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:45.994 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:45.994 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.994 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.994 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:141499 2.3 2:cbf3823f:::benchmark_data_smithi188_77607_object141498:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:26:45.995 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:09.017628+0000", 2024-04-01T19:26:45.995 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 36.706354142000002, 2024-04-01T19:26:45.995 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.036354125000000001, 2024-04-01T19:26:45.995 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:45.995 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:45.995 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:45.995 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:26:45.995 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:26:45.995 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:26:45.995 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 141499 2024-04-01T19:26:45.995 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.995 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:45.995 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.995 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:45.995 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.017628+0000", 2024-04-01T19:26:45.996 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:45.996 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.996 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.996 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:45.996 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.017628+0000", 2024-04-01T19:26:45.996 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:45.996 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.996 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.996 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:45.996 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.017629+0000", 2024-04-01T19:26:45.996 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.7199999999999997e-07 2024-04-01T19:26:45.996 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.996 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.996 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:45.996 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.017702+0000", 2024-04-01T19:26:45.997 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.2935000000000006e-05 2024-04-01T19:26:45.997 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.997 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.997 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:45.997 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.017709+0000", 2024-04-01T19:26:45.997 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3459999999999999e-06 2024-04-01T19:26:45.997 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.997 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.997 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:45.997 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.017713+0000", 2024-04-01T19:26:45.997 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7060000000000003e-06 2024-04-01T19:26:45.997 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.997 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.997 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:45.998 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.020647+0000", 2024-04-01T19:26:45.998 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0029342399999999999 2024-04-01T19:26:45.998 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.998 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.998 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:45.998 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.020728+0000", 2024-04-01T19:26:45.998 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0468000000000003e-05 2024-04-01T19:26:45.998 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.998 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.998 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 2", 2024-04-01T19:26:45.998 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.020829+0000", 2024-04-01T19:26:45.998 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000100584 2024-04-01T19:26:45.998 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.998 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.998 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:26:45.999 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.023099+0000", 2024-04-01T19:26:45.999 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00227064 2024-04-01T19:26:45.999 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.999 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.999 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:26:45.999 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.053902+0000", 2024-04-01T19:26:45.999 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.030802820000000002 2024-04-01T19:26:45.999 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.999 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.999 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:45.999 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.053939+0000", 2024-04-01T19:26:45.999 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.7259999999999999e-05 2024-04-01T19:26:45.999 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:45.999 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:45.999 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:46.000 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.053982+0000", 2024-04-01T19:26:46.000 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3254000000000003e-05 2024-04-01T19:26:46.000 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.000 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:46.000 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.000 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.000 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.000 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:142629 2.3 2:c6ae461e:::benchmark_data_smithi188_77607_object142628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:26:46.000 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:09.945148+0000", 2024-04-01T19:26:46.000 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 35.778834134, 2024-04-01T19:26:46.000 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.039715299000000003, 2024-04-01T19:26:46.000 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:46.000 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:46.000 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:46.000 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:26:46.001 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:26:46.001 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:26:46.001 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 142629 2024-04-01T19:26:46.001 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.001 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:46.001 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.001 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:46.001 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.945148+0000", 2024-04-01T19:26:46.001 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.001 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.001 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.001 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:46.001 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.945148+0000", 2024-04-01T19:26:46.001 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.001 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.001 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.002 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:46.002 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.945149+0000", 2024-04-01T19:26:46.002 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.1500000000000003e-07 2024-04-01T19:26:46.002 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.002 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.002 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:46.002 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.945258+0000", 2024-04-01T19:26:46.002 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000109201 2024-04-01T19:26:46.002 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.002 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.002 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:46.002 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.945265+0000", 2024-04-01T19:26:46.002 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.1530000000000002e-06 2024-04-01T19:26:46.002 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.002 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.003 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:46.003 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.945269+0000", 2024-04-01T19:26:46.003 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0570000000000003e-06 2024-04-01T19:26:46.003 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.003 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.003 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:46.003 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.945943+0000", 2024-04-01T19:26:46.003 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00067445799999999996 2024-04-01T19:26:46.003 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.003 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.003 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:46.003 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.946027+0000", 2024-04-01T19:26:46.003 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.3899000000000004e-05 2024-04-01T19:26:46.003 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.003 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.004 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 2", 2024-04-01T19:26:46.004 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.946115+0000", 2024-04-01T19:26:46.004 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.8472000000000003e-05 2024-04-01T19:26:46.004 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.004 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.004 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:26:46.004 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.948629+0000", 2024-04-01T19:26:46.004 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0025137419999999998 2024-04-01T19:26:46.004 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.004 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.004 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:26:46.004 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.984782+0000", 2024-04-01T19:26:46.004 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.036153268000000002 2024-04-01T19:26:46.004 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.004 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.004 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:46.005 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.984821+0000", 2024-04-01T19:26:46.005 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8089000000000001e-05 2024-04-01T19:26:46.005 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.005 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.005 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:46.005 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.984864+0000", 2024-04-01T19:26:46.005 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3145000000000001e-05 2024-04-01T19:26:46.005 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.005 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:46.005 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.005 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.005 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.005 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:142631 2.3 2:c8836fef:::benchmark_data_smithi188_77607_object142630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:26:46.005 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:09.949205+0000", 2024-04-01T19:26:46.005 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 35.774777493999999, 2024-04-01T19:26:46.006 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.035775016, 2024-04-01T19:26:46.006 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:46.006 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:46.006 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:46.006 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:26:46.006 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:26:46.006 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:26:46.006 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 142631 2024-04-01T19:26:46.006 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.006 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:46.006 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.006 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:46.006 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.949205+0000", 2024-04-01T19:26:46.006 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.006 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.007 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.007 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:46.007 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.949205+0000", 2024-04-01T19:26:46.007 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.007 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.007 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.007 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:46.007 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.949207+0000", 2024-04-01T19:26:46.007 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.843e-06 2024-04-01T19:26:46.007 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.007 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.007 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:46.007 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.949252+0000", 2024-04-01T19:26:46.007 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.4951999999999999e-05 2024-04-01T19:26:46.007 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.008 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.008 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:46.008 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.949270+0000", 2024-04-01T19:26:46.008 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8128e-05 2024-04-01T19:26:46.008 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.008 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.008 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:46.008 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.949277+0000", 2024-04-01T19:26:46.008 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.2799999999999998e-06 2024-04-01T19:26:46.008 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.008 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.008 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:46.008 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.949323+0000", 2024-04-01T19:26:46.008 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6241e-05 2024-04-01T19:26:46.008 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.009 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.009 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:46.009 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.949408+0000", 2024-04-01T19:26:46.009 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.4345999999999995e-05 2024-04-01T19:26:46.009 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.009 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.009 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 2", 2024-04-01T19:26:46.009 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.949501+0000", 2024-04-01T19:26:46.009 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.2923999999999993e-05 2024-04-01T19:26:46.009 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.009 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.009 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:26:46.009 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.954197+0000", 2024-04-01T19:26:46.009 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.004695823 2024-04-01T19:26:46.010 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.010 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.010 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:26:46.010 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.984909+0000", 2024-04-01T19:26:46.010 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.030712696000000001 2024-04-01T19:26:46.010 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.010 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.010 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:46.010 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.984943+0000", 2024-04-01T19:26:46.010 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.4062e-05 2024-04-01T19:26:46.010 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.010 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.010 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:46.011 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.984980+0000", 2024-04-01T19:26:46.011 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.6721000000000003e-05 2024-04-01T19:26:46.011 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.011 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:46.011 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.011 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.011 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.011 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:142632 2.3 2:c67edcc1:::benchmark_data_smithi188_77607_object142631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:26:46.011 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:09.949295+0000", 2024-04-01T19:26:46.011 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 35.774687407000002, 2024-04-01T19:26:46.011 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.035878071999999997, 2024-04-01T19:26:46.011 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:46.011 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:46.011 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:46.011 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:26:46.012 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:26:46.012 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:26:46.012 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 142632 2024-04-01T19:26:46.012 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.012 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:46.012 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.012 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:46.012 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.949295+0000", 2024-04-01T19:26:46.012 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.012 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.012 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.012 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:46.012 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.949295+0000", 2024-04-01T19:26:46.012 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.012 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.013 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.013 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:46.013 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.949296+0000", 2024-04-01T19:26:46.013 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8800000000000002e-07 2024-04-01T19:26:46.013 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.013 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.013 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:46.013 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.949319+0000", 2024-04-01T19:26:46.013 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3249999999999999e-05 2024-04-01T19:26:46.013 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.013 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.013 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:46.013 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.949324+0000", 2024-04-01T19:26:46.013 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0969999999999996e-06 2024-04-01T19:26:46.013 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.014 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.014 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:46.014 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.949328+0000", 2024-04-01T19:26:46.014 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.7589999999999999e-06 2024-04-01T19:26:46.014 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.014 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.014 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:46.014 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.952004+0000", 2024-04-01T19:26:46.014 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0026759330000000001 2024-04-01T19:26:46.014 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.014 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.014 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:46.014 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.952093+0000", 2024-04-01T19:26:46.014 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.9639e-05 2024-04-01T19:26:46.014 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.015 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.015 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 2", 2024-04-01T19:26:46.015 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.952207+0000", 2024-04-01T19:26:46.015 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00011356700000000001 2024-04-01T19:26:46.015 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.015 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.015 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:26:46.015 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.956504+0000", 2024-04-01T19:26:46.015 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0042967839999999997 2024-04-01T19:26:46.015 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.015 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.015 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:26:46.015 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.985046+0000", 2024-04-01T19:26:46.015 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.028542121 2024-04-01T19:26:46.015 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.016 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.016 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:46.016 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.985108+0000", 2024-04-01T19:26:46.016 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2187000000000006e-05 2024-04-01T19:26:46.016 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.016 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.016 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:46.016 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.985173+0000", 2024-04-01T19:26:46.016 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5147000000000005e-05 2024-04-01T19:26:46.016 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.016 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:46.016 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.016 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.016 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.016 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:142634 2.3 2:c0d52aa6:::benchmark_data_smithi188_77607_object142633:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:26:46.016 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:09.949388+0000", 2024-04-01T19:26:46.016 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 35.774594041999997, 2024-04-01T19:26:46.017 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.03588848, 2024-04-01T19:26:46.017 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:46.017 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:46.017 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:46.017 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:26:46.017 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:26:46.017 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:26:46.017 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 142634 2024-04-01T19:26:46.017 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.017 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:46.017 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.017 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:46.017 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.949388+0000", 2024-04-01T19:26:46.017 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.018 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.018 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.018 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:46.018 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.949388+0000", 2024-04-01T19:26:46.018 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.018 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.018 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.018 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:46.018 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.949389+0000", 2024-04-01T19:26:46.018 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.7100000000000001e-07 2024-04-01T19:26:46.018 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.018 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.018 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:46.019 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.949476+0000", 2024-04-01T19:26:46.019 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.6466999999999997e-05 2024-04-01T19:26:46.019 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.019 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.019 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:46.019 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.949481+0000", 2024-04-01T19:26:46.019 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5690000000000004e-06 2024-04-01T19:26:46.019 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.019 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.019 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:46.019 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.949485+0000", 2024-04-01T19:26:46.019 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8759999999999998e-06 2024-04-01T19:26:46.019 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.019 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.019 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:46.020 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.954245+0000", 2024-04-01T19:26:46.020 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0047603130000000004 2024-04-01T19:26:46.020 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.020 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.020 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:46.020 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.954361+0000", 2024-04-01T19:26:46.020 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000115771 2024-04-01T19:26:46.020 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.020 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.020 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 2", 2024-04-01T19:26:46.020 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.954470+0000", 2024-04-01T19:26:46.020 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000108359 2024-04-01T19:26:46.020 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.020 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.020 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:26:46.021 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.959291+0000", 2024-04-01T19:26:46.021 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0048211299999999999 2024-04-01T19:26:46.021 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.021 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.021 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:26:46.021 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.985215+0000", 2024-04-01T19:26:46.021 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.025924322 2024-04-01T19:26:46.021 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.021 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.021 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:46.021 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.985246+0000", 2024-04-01T19:26:46.021 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.1266999999999997e-05 2024-04-01T19:26:46.021 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.021 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.021 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:46.022 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.985277+0000", 2024-04-01T19:26:46.022 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.0735000000000003e-05 2024-04-01T19:26:46.022 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.022 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:46.022 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.022 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.022 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.022 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:143475 2.3 2:cb4a7445:::benchmark_data_smithi188_77607_object143474:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:26:46.022 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:10.665885+0000", 2024-04-01T19:26:46.022 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 35.058097783999997, 2024-04-01T19:26:46.022 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.038639314000000001, 2024-04-01T19:26:46.022 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:46.022 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:46.022 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:46.023 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:26:46.023 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:26:46.023 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:26:46.023 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 143475 2024-04-01T19:26:46.023 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.023 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:46.023 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.023 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:46.023 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.665885+0000", 2024-04-01T19:26:46.023 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.023 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.023 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.023 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:46.023 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.665885+0000", 2024-04-01T19:26:46.023 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.024 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.024 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.024 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:46.024 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.665887+0000", 2024-04-01T19:26:46.024 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3300000000000001e-06 2024-04-01T19:26:46.024 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.024 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.024 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:46.024 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.665933+0000", 2024-04-01T19:26:46.024 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.5589e-05 2024-04-01T19:26:46.024 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.024 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.024 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:46.024 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.665945+0000", 2024-04-01T19:26:46.024 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2651e-05 2024-04-01T19:26:46.025 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.025 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.025 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:46.025 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.665955+0000", 2024-04-01T19:26:46.025 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.2709999999999998e-06 2024-04-01T19:26:46.025 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.025 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.025 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:46.025 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.667396+0000", 2024-04-01T19:26:46.025 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0014419159999999999 2024-04-01T19:26:46.025 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.025 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.025 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:46.025 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.667533+0000", 2024-04-01T19:26:46.025 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000136229 2024-04-01T19:26:46.026 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.026 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.026 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 2", 2024-04-01T19:26:46.026 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.667677+0000", 2024-04-01T19:26:46.026 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014425399999999999 2024-04-01T19:26:46.026 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.026 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.026 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:26:46.026 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.672525+0000", 2024-04-01T19:26:46.026 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0048481569999999996 2024-04-01T19:26:46.026 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.026 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.026 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:26:46.026 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.704434+0000", 2024-04-01T19:26:46.027 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.031908806999999997 2024-04-01T19:26:46.027 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.027 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.027 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:46.027 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.704468+0000", 2024-04-01T19:26:46.027 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.3754999999999998e-05 2024-04-01T19:26:46.027 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.027 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.027 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:46.027 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:10.704524+0000", 2024-04-01T19:26:46.027 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6354999999999998e-05 2024-04-01T19:26:46.027 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.027 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:46.027 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.027 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.027 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.028 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:143867 2.3 2:c20324ee:::benchmark_data_smithi188_77607_object143866:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:26:46.028 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:11.011216+0000", 2024-04-01T19:26:46.028 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 34.712766934000001, 2024-04-01T19:26:46.028 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.037990603999999997, 2024-04-01T19:26:46.028 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:46.028 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:46.028 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:46.028 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:26:46.028 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:26:46.028 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:26:46.028 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 143867 2024-04-01T19:26:46.028 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.028 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:46.028 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.029 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:46.029 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.011216+0000", 2024-04-01T19:26:46.029 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.029 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.029 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.029 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:46.029 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.011216+0000", 2024-04-01T19:26:46.029 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.029 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.029 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.029 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:46.029 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.011217+0000", 2024-04-01T19:26:46.029 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.068e-06 2024-04-01T19:26:46.029 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.030 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.030 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:46.030 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.011309+0000", 2024-04-01T19:26:46.030 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1921000000000003e-05 2024-04-01T19:26:46.030 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.030 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.030 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:46.030 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.011318+0000", 2024-04-01T19:26:46.030 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.0699999999999996e-06 2024-04-01T19:26:46.030 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.030 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.030 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:46.030 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.011325+0000", 2024-04-01T19:26:46.030 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.7079999999999997e-06 2024-04-01T19:26:46.030 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.031 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.031 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:46.031 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.026580+0000", 2024-04-01T19:26:46.031 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.015255044000000001 2024-04-01T19:26:46.031 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.031 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.031 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:46.031 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.026693+0000", 2024-04-01T19:26:46.031 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000112792 2024-04-01T19:26:46.031 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.031 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.031 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 2", 2024-04-01T19:26:46.031 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.026852+0000", 2024-04-01T19:26:46.031 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000158985 2024-04-01T19:26:46.031 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.032 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.032 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:26:46.032 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.032114+0000", 2024-04-01T19:26:46.032 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0052618370000000001 2024-04-01T19:26:46.032 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.032 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.032 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:26:46.032 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.049086+0000", 2024-04-01T19:26:46.032 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.016972312999999999 2024-04-01T19:26:46.032 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.032 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.032 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:46.032 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.049137+0000", 2024-04-01T19:26:46.032 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0563999999999999e-05 2024-04-01T19:26:46.032 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.033 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.033 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:46.033 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.049206+0000", 2024-04-01T19:26:46.033 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9301999999999995e-05 2024-04-01T19:26:46.033 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.033 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:46.033 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.033 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.033 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.033 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:145301 2.3 2:c5b0410c:::benchmark_data_smithi188_77607_object145300:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:26:46.033 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:12.145791+0000", 2024-04-01T19:26:46.033 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 33.578191169999997, 2024-04-01T19:26:46.033 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.039197556000000001, 2024-04-01T19:26:46.033 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:46.034 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:46.034 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:46.034 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:26:46.034 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:26:46.034 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:26:46.034 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 145301 2024-04-01T19:26:46.034 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.034 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:46.034 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.034 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:46.034 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.145791+0000", 2024-04-01T19:26:46.034 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.034 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.034 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.034 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:46.034 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.145791+0000", 2024-04-01T19:26:46.035 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.035 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.035 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.035 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:46.035 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.145793+0000", 2024-04-01T19:26:46.035 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1850000000000001e-06 2024-04-01T19:26:46.035 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.035 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.035 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:46.035 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.145860+0000", 2024-04-01T19:26:46.035 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.7759e-05 2024-04-01T19:26:46.035 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.035 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.035 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:46.035 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.145869+0000", 2024-04-01T19:26:46.035 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.9800000000000004e-06 2024-04-01T19:26:46.036 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.036 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.036 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:46.036 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.145877+0000", 2024-04-01T19:26:46.036 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.593e-06 2024-04-01T19:26:46.036 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.036 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.036 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:46.036 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.149140+0000", 2024-04-01T19:26:46.036 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0032628879999999998 2024-04-01T19:26:46.036 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.036 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.036 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:46.036 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.149248+0000", 2024-04-01T19:26:46.036 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000108362 2024-04-01T19:26:46.036 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.037 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.037 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 2", 2024-04-01T19:26:46.037 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.149357+0000", 2024-04-01T19:26:46.037 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000108949 2024-04-01T19:26:46.037 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.037 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.037 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:26:46.037 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.154621+0000", 2024-04-01T19:26:46.037 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0052642119999999999 2024-04-01T19:26:46.037 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.037 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.037 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:26:46.037 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.184923+0000", 2024-04-01T19:26:46.037 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.030301794 2024-04-01T19:26:46.038 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.038 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.038 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:46.038 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.184961+0000", 2024-04-01T19:26:46.038 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.7524999999999997e-05 2024-04-01T19:26:46.038 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.038 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.038 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:46.038 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.184989+0000", 2024-04-01T19:26:46.038 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8309e-05 2024-04-01T19:26:46.038 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.038 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:46.038 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.038 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.038 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.039 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:145302 2.3 2:c94199eb:::benchmark_data_smithi188_77607_object145301:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:26:46.039 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:12.145890+0000", 2024-04-01T19:26:46.039 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 33.578092101000003, 2024-04-01T19:26:46.039 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.039206256000000002, 2024-04-01T19:26:46.039 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:46.039 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:46.039 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:46.039 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:26:46.039 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:26:46.039 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:26:46.039 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 145302 2024-04-01T19:26:46.039 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.039 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:46.039 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.039 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:46.040 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.145890+0000", 2024-04-01T19:26:46.040 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.040 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.040 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.040 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:46.040 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.145890+0000", 2024-04-01T19:26:46.040 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.040 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.040 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.040 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:46.040 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.145892+0000", 2024-04-01T19:26:46.040 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0950000000000001e-06 2024-04-01T19:26:46.040 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.040 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.040 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:46.041 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.145940+0000", 2024-04-01T19:26:46.041 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8009000000000001e-05 2024-04-01T19:26:46.041 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.041 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.041 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:46.041 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.145947+0000", 2024-04-01T19:26:46.041 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.8019999999999992e-06 2024-04-01T19:26:46.041 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.041 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.041 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:46.041 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.145954+0000", 2024-04-01T19:26:46.041 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.0219999999999999e-06 2024-04-01T19:26:46.041 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.041 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.042 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:46.042 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.151931+0000", 2024-04-01T19:26:46.042 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.005976543 2024-04-01T19:26:46.042 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.042 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.042 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:46.042 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.152019+0000", 2024-04-01T19:26:46.042 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.8362000000000005e-05 2024-04-01T19:26:46.042 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.042 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.042 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 2", 2024-04-01T19:26:46.042 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.152144+0000", 2024-04-01T19:26:46.042 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012442700000000001 2024-04-01T19:26:46.043 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.043 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.043 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:26:46.043 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.157518+0000", 2024-04-01T19:26:46.043 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0053745360000000001 2024-04-01T19:26:46.043 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.043 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.043 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:26:46.043 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.185036+0000", 2024-04-01T19:26:46.043 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.027517831 2024-04-01T19:26:46.043 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.043 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.043 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:46.043 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.185068+0000", 2024-04-01T19:26:46.044 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.1976e-05 2024-04-01T19:26:46.044 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.044 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.044 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:46.044 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:12.185097+0000", 2024-04-01T19:26:46.044 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8653000000000002e-05 2024-04-01T19:26:46.044 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.044 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:46.044 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.044 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.044 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.044 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:147065 2.2 2:4ee23461:::benchmark_data_smithi188_77607_object147064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:26:46.044 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:13.529512+0000", 2024-04-01T19:26:46.044 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 32.194470615, 2024-04-01T19:26:46.044 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.036485587, 2024-04-01T19:26:46.045 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:46.045 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:46.045 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:46.045 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:26:46.045 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:26:46.045 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:26:46.045 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 147065 2024-04-01T19:26:46.045 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.045 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:46.045 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.045 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:46.045 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.529512+0000", 2024-04-01T19:26:46.045 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.045 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.046 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.046 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:46.046 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.529512+0000", 2024-04-01T19:26:46.046 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.046 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.046 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.046 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:46.046 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.529515+0000", 2024-04-01T19:26:46.046 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.9960000000000002e-06 2024-04-01T19:26:46.046 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.046 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.046 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:46.046 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.529558+0000", 2024-04-01T19:26:46.046 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3327e-05 2024-04-01T19:26:46.047 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.047 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.047 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:46.047 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.529580+0000", 2024-04-01T19:26:46.047 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1721000000000001e-05 2024-04-01T19:26:46.047 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.047 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.047 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:46.047 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.529590+0000", 2024-04-01T19:26:46.047 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0305e-05 2024-04-01T19:26:46.047 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.047 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.047 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:46.047 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.529699+0000", 2024-04-01T19:26:46.048 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000108453 2024-04-01T19:26:46.048 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.048 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.048 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:46.048 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.529868+0000", 2024-04-01T19:26:46.048 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000169011 2024-04-01T19:26:46.048 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.048 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.048 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:26:46.048 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.530027+0000", 2024-04-01T19:26:46.048 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00015919400000000001 2024-04-01T19:26:46.048 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.048 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.048 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:26:46.048 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.536840+0000", 2024-04-01T19:26:46.049 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0068130070000000003 2024-04-01T19:26:46.049 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.049 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.049 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:26:46.049 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.565892+0000", 2024-04-01T19:26:46.049 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.029051819999999999 2024-04-01T19:26:46.049 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.049 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.049 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:46.049 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.565949+0000", 2024-04-01T19:26:46.049 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7351e-05 2024-04-01T19:26:46.049 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.049 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.049 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:46.050 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.565997+0000", 2024-04-01T19:26:46.050 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8402000000000002e-05 2024-04-01T19:26:46.050 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.050 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:46.050 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.050 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.050 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.050 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:148142 2.3 2:c77187ad:::benchmark_data_smithi188_77607_object148141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:26:46.050 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:14.462669+0000", 2024-04-01T19:26:46.050 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 31.261313779000002, 2024-04-01T19:26:46.050 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.052882452000000003, 2024-04-01T19:26:46.050 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:46.050 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:46.050 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:46.051 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:26:46.051 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:26:46.051 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:26:46.051 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 148142 2024-04-01T19:26:46.051 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.051 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:46.051 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.051 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:46.051 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.462669+0000", 2024-04-01T19:26:46.051 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.051 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.051 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.051 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:46.051 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.462669+0000", 2024-04-01T19:26:46.051 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.052 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.052 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.052 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:46.052 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.462679+0000", 2024-04-01T19:26:46.052 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.9480000000000003e-06 2024-04-01T19:26:46.052 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.052 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.052 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:46.052 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.462722+0000", 2024-04-01T19:26:46.052 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3210999999999997e-05 2024-04-01T19:26:46.052 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.052 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.052 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:46.052 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.462733+0000", 2024-04-01T19:26:46.052 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1158999999999999e-05 2024-04-01T19:26:46.052 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.053 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.053 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:46.053 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.462739+0000", 2024-04-01T19:26:46.053 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3069999999999999e-06 2024-04-01T19:26:46.053 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.053 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.053 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:46.053 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.462797+0000", 2024-04-01T19:26:46.053 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7893999999999998e-05 2024-04-01T19:26:46.053 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.053 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.053 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:46.053 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.462878+0000", 2024-04-01T19:26:46.053 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0728000000000004e-05 2024-04-01T19:26:46.053 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.054 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.054 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 2", 2024-04-01T19:26:46.054 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.462975+0000", 2024-04-01T19:26:46.054 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.7013000000000001e-05 2024-04-01T19:26:46.054 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.054 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.054 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:26:46.054 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.466973+0000", 2024-04-01T19:26:46.054 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0039982189999999999 2024-04-01T19:26:46.054 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.054 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.054 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:26:46.054 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.515449+0000", 2024-04-01T19:26:46.054 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.048476205000000001 2024-04-01T19:26:46.055 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.055 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.055 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:46.055 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.515508+0000", 2024-04-01T19:26:46.055 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8967e-05 2024-04-01T19:26:46.055 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.055 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.055 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:46.055 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.515551+0000", 2024-04-01T19:26:46.055 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.2800999999999999e-05 2024-04-01T19:26:46.055 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.055 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:46.055 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.055 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.055 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.055 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:148155 2.3 2:ccff6a2f:::benchmark_data_smithi188_77607_object148154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:26:46.056 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:14.470808+0000", 2024-04-01T19:26:46.056 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 31.253174734000002, 2024-04-01T19:26:46.056 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.044919413999999998, 2024-04-01T19:26:46.056 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:46.056 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:46.056 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:46.056 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:26:46.056 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:26:46.056 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:26:46.056 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 148155 2024-04-01T19:26:46.056 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.056 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:46.056 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.056 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:46.057 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.470808+0000", 2024-04-01T19:26:46.057 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.057 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.057 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.057 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:46.057 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.470808+0000", 2024-04-01T19:26:46.057 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.057 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.057 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.057 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:46.057 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.470810+0000", 2024-04-01T19:26:46.057 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1399999999999998e-06 2024-04-01T19:26:46.057 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.057 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.057 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:46.058 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.470857+0000", 2024-04-01T19:26:46.058 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7367999999999998e-05 2024-04-01T19:26:46.058 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.058 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.058 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:46.058 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.470870+0000", 2024-04-01T19:26:46.058 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2672e-05 2024-04-01T19:26:46.058 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.058 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.058 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:46.058 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.470878+0000", 2024-04-01T19:26:46.058 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.5449999999999998e-06 2024-04-01T19:26:46.058 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.059 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.059 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:46.059 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.470933+0000", 2024-04-01T19:26:46.059 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5037999999999997e-05 2024-04-01T19:26:46.059 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.059 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.059 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:46.059 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.471026+0000", 2024-04-01T19:26:46.059 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.3801999999999994e-05 2024-04-01T19:26:46.059 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.059 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.059 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 2", 2024-04-01T19:26:46.059 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.471124+0000", 2024-04-01T19:26:46.059 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.7418999999999997e-05 2024-04-01T19:26:46.060 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.060 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.060 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:26:46.060 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.474254+0000", 2024-04-01T19:26:46.060 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0031303030000000001 2024-04-01T19:26:46.060 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.060 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.060 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:26:46.060 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.515616+0000", 2024-04-01T19:26:46.060 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.041361653999999998 2024-04-01T19:26:46.060 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.060 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.060 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:46.060 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.515681+0000", 2024-04-01T19:26:46.061 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5426999999999995e-05 2024-04-01T19:26:46.061 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.061 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.061 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:46.061 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.515727+0000", 2024-04-01T19:26:46.061 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6045999999999999e-05 2024-04-01T19:26:46.061 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.061 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:46.061 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.061 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.061 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.061 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:148161 2.3 2:c139037c:::benchmark_data_smithi188_77607_object148160:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:26:46.061 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:14.474361+0000", 2024-04-01T19:26:46.061 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 31.249621897000001, 2024-04-01T19:26:46.062 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.041525956000000003, 2024-04-01T19:26:46.062 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:46.062 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:46.062 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:46.062 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:26:46.062 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:26:46.062 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:26:46.062 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 148161 2024-04-01T19:26:46.062 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.062 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:46.062 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.062 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:46.062 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.474361+0000", 2024-04-01T19:26:46.062 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.062 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.063 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.063 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:46.063 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.474361+0000", 2024-04-01T19:26:46.063 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.063 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.063 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.063 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:46.063 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.474363+0000", 2024-04-01T19:26:46.063 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1380000000000001e-06 2024-04-01T19:26:46.063 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.063 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.063 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:46.063 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.474409+0000", 2024-04-01T19:26:46.063 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6233999999999998e-05 2024-04-01T19:26:46.063 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.064 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.064 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:46.064 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.474420+0000", 2024-04-01T19:26:46.064 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0812000000000001e-05 2024-04-01T19:26:46.064 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.064 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.064 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:46.064 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.474426+0000", 2024-04-01T19:26:46.064 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8549999999999998e-06 2024-04-01T19:26:46.064 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.064 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.064 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:46.064 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.474472+0000", 2024-04-01T19:26:46.064 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6244e-05 2024-04-01T19:26:46.064 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.065 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.065 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:46.065 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.474563+0000", 2024-04-01T19:26:46.065 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1278000000000003e-05 2024-04-01T19:26:46.065 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.065 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.065 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 2", 2024-04-01T19:26:46.065 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.474656+0000", 2024-04-01T19:26:46.065 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.2978000000000003e-05 2024-04-01T19:26:46.065 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.065 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.065 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:26:46.065 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.477852+0000", 2024-04-01T19:26:46.065 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0031960830000000002 2024-04-01T19:26:46.065 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.065 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.066 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:26:46.066 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.515780+0000", 2024-04-01T19:26:46.066 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.037928153999999999 2024-04-01T19:26:46.066 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.066 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.066 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:46.066 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.515838+0000", 2024-04-01T19:26:46.066 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7442999999999999e-05 2024-04-01T19:26:46.066 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.066 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.066 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:46.066 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.515887+0000", 2024-04-01T19:26:46.066 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8736999999999998e-05 2024-04-01T19:26:46.066 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.066 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:46.067 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.067 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.067 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.067 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:148949 2.2 2:4c450ee0:::benchmark_data_smithi188_77607_object148948:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:26:46.067 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:15.138877+0000", 2024-04-01T19:26:46.067 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 30.585105243000001, 2024-04-01T19:26:46.067 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.038905584, 2024-04-01T19:26:46.067 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:46.067 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:46.067 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:46.067 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:26:46.067 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:26:46.067 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:26:46.067 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 148949 2024-04-01T19:26:46.067 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.068 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:46.068 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.068 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:46.068 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:15.138877+0000", 2024-04-01T19:26:46.068 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.068 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.068 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.068 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:46.068 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:15.138877+0000", 2024-04-01T19:26:46.068 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.068 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.068 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.068 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:46.068 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:15.138878+0000", 2024-04-01T19:26:46.069 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.9399999999999993e-07 2024-04-01T19:26:46.069 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.069 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.069 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:46.069 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:15.138917+0000", 2024-04-01T19:26:46.069 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8435e-05 2024-04-01T19:26:46.069 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.069 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.069 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:46.069 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:15.138925+0000", 2024-04-01T19:26:46.069 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0399999999999993e-06 2024-04-01T19:26:46.069 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.069 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.069 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:46.069 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:15.138933+0000", 2024-04-01T19:26:46.070 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.8299999999999996e-06 2024-04-01T19:26:46.070 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.070 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.070 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:46.070 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:15.142380+0000", 2024-04-01T19:26:46.070 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00344707 2024-04-01T19:26:46.070 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.070 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.070 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:46.070 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:15.142524+0000", 2024-04-01T19:26:46.070 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000144473 2024-04-01T19:26:46.070 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.070 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.071 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:26:46.071 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:15.142692+0000", 2024-04-01T19:26:46.071 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00016740200000000001 2024-04-01T19:26:46.071 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.071 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.071 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:26:46.071 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:15.145625+0000", 2024-04-01T19:26:46.071 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0029330860000000001 2024-04-01T19:26:46.071 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.071 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.071 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:26:46.071 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:15.177696+0000", 2024-04-01T19:26:46.071 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.032070912 2024-04-01T19:26:46.071 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.072 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.072 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:46.072 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:15.177731+0000", 2024-04-01T19:26:46.072 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.5583000000000001e-05 2024-04-01T19:26:46.072 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.072 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.072 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:46.072 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:15.177783+0000", 2024-04-01T19:26:46.072 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1758999999999997e-05 2024-04-01T19:26:46.072 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.072 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:46.072 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.072 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.072 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.072 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:175101 2.2 2:4e4e748c:::benchmark_data_smithi188_77607_object7697:head [delete] snapc 0=[] ondisk+write+known_if_redirected e142)", 2024-04-01T19:26:46.073 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:43.409250+0000", 2024-04-01T19:26:46.073 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 2.3147323069999999, 2024-04-01T19:26:46.073 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.05683469, 2024-04-01T19:26:46.073 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:46.073 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:46.073 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:46.073 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:26:46.073 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:26:46.073 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:26:46.073 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 175101 2024-04-01T19:26:46.073 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.073 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:46.073 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.073 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:46.073 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.409250+0000", 2024-04-01T19:26:46.074 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.074 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.074 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.074 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:46.074 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.409250+0000", 2024-04-01T19:26:46.074 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:46.074 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.074 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.074 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:46.074 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.409251+0000", 2024-04-01T19:26:46.074 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3099999999999997e-07 2024-04-01T19:26:46.074 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.074 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.074 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:46.074 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.409253+0000", 2024-04-01T19:26:46.075 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3949999999999999e-06 2024-04-01T19:26:46.075 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.075 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.075 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:46.075 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.409260+0000", 2024-04-01T19:26:46.075 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9140000000000002e-06 2024-04-01T19:26:46.075 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.075 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.075 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:46.075 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.409264+0000", 2024-04-01T19:26:46.075 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8639999999999998e-06 2024-04-01T19:26:46.075 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.075 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.075 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:46.075 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.413507+0000", 2024-04-01T19:26:46.075 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0042429659999999999 2024-04-01T19:26:46.076 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.076 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.076 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:46.076 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.413614+0000", 2024-04-01T19:26:46.076 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00010660800000000001 2024-04-01T19:26:46.076 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.076 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.076 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:26:46.076 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.413729+0000", 2024-04-01T19:26:46.076 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000114924 2024-04-01T19:26:46.076 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.076 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.076 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:26:46.076 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.418717+0000", 2024-04-01T19:26:46.076 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0049883330000000002 2024-04-01T19:26:46.076 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.077 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.077 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:26:46.077 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.466007+0000", 2024-04-01T19:26:46.077 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.047289987999999998 2024-04-01T19:26:46.077 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.077 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.077 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:46.077 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.466046+0000", 2024-04-01T19:26:46.077 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8940000000000003e-05 2024-04-01T19:26:46.077 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:46.077 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:46.077 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:26:46.077 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.466085+0000", 2024-04-01T19:26:46.077 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9127e-05 2024-04-01T19:26:46.077 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.077 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:46.078 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.078 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:46.078 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:46.078 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:26:46.078 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:45 smithi062 ceph-mon[44211]: pgmap v439: 17 pgs: 17 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 320 KiB/s wr, 937 op/s 2024-04-01T19:26:46.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:45 smithi022 ceph-mon[39439]: pgmap v439: 17 pgs: 17 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 320 KiB/s wr, 937 op/s 2024-04-01T19:26:46.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:45 smithi188 ceph-mon[43939]: pgmap v439: 17 pgs: 17 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 320 KiB/s wr, 937 op/s 2024-04-01T19:26:46.723 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_ops_in_flight 2024-04-01T19:26:47.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:46 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:26:47.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:46 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:26:47.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:46 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:26:47.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:46 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:26:47.069 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:26:47.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:46 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:26:47.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:46 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:26:47.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:46 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:26:47.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:46 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:26:47.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:46 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:26:47.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:46 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:26:47.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:46 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:26:47.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:46 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:26:47.853 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:47 smithi062 ceph-mon[44211]: pgmap v440: 17 pgs: 17 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 B/s rd, 244 KiB/s wr, 1.02k op/s 2024-04-01T19:26:47.853 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:47 smithi062 ceph-mon[44211]: osdmap e143: 12 total, 12 up, 12 in 2024-04-01T19:26:47.853 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:47 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:26:48.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:47 smithi022 ceph-mon[39439]: pgmap v440: 17 pgs: 17 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 B/s rd, 244 KiB/s wr, 1.02k op/s 2024-04-01T19:26:48.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:47 smithi022 ceph-mon[39439]: osdmap e143: 12 total, 12 up, 12 in 2024-04-01T19:26:48.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:47 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:26:48.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:47 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:26:48.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:47 smithi188 ceph-mon[43939]: pgmap v440: 17 pgs: 17 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 B/s rd, 244 KiB/s wr, 1.02k op/s 2024-04-01T19:26:48.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:47 smithi188 ceph-mon[43939]: osdmap e143: 12 total, 12 up, 12 in 2024-04-01T19:26:48.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:47 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:26:48.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:47 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:26:48.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:47 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:26:48.977 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:26:48.977 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:26:48.977 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.977 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:182222 2.7 2:e3722fb5:::benchmark_data_smithi188_77607_object14818:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-04-01T19:26:48.977 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:48.969668+0000", 2024-04-01T19:26:48.977 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0087408290000000003, 2024-04-01T19:26:48.977 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0087628759999999993, 2024-04-01T19:26:48.977 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:48.977 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:48.977 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:26:48.977 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:26:48.978 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:26:48.978 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:26:48.978 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 182222 2024-04-01T19:26:48.978 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.978 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:48.978 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.978 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:48.978 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.969668+0000", 2024-04-01T19:26:48.978 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:48.978 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.978 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.978 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:48.978 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.969668+0000", 2024-04-01T19:26:48.979 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:48.979 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.979 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.979 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:48.979 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.969669+0000", 2024-04-01T19:26:48.979 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4309999999999999e-06 2024-04-01T19:26:48.979 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.979 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.979 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:48.979 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.969674+0000", 2024-04-01T19:26:48.979 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.011e-06 2024-04-01T19:26:48.979 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.979 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.980 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:48.980 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.969686+0000", 2024-04-01T19:26:48.980 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1865000000000001e-05 2024-04-01T19:26:48.980 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.980 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.980 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:48.980 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.969694+0000", 2024-04-01T19:26:48.980 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9249999999999995e-06 2024-04-01T19:26:48.980 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.980 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.980 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:48.980 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.974665+0000", 2024-04-01T19:26:48.980 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0049704409999999999 2024-04-01T19:26:48.980 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.981 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.981 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:48.981 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.974797+0000", 2024-04-01T19:26:48.981 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000132645 2024-04-01T19:26:48.981 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.981 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.981 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 10", 2024-04-01T19:26:48.981 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.974931+0000", 2024-04-01T19:26:48.981 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000133552 2024-04-01T19:26:48.981 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:48.981 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:48.981 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:48.981 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.981 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.981 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop_reply(client.24751.0:182217 2.7 e144/106)", 2024-04-01T19:26:48.981 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:48.974898+0000", 2024-04-01T19:26:48.982 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0035105259999999999, 2024-04-01T19:26:48.982 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0035813450000000001, 2024-04-01T19:26:48.982 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:48.982 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:48.982 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "queued for pg", 2024-04-01T19:26:48.982 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:48.982 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.982 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:48.982 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.974898+0000", 2024-04-01T19:26:48.982 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:48.982 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.982 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.982 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:48.982 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.974898+0000", 2024-04-01T19:26:48.983 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:48.983 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.983 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.983 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:48.983 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.974900+0000", 2024-04-01T19:26:48.983 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.827e-06 2024-04-01T19:26:48.983 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.983 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.983 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:48.983 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.974908+0000", 2024-04-01T19:26:48.983 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.5820000000000004e-06 2024-04-01T19:26:48.983 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.983 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.983 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:48.984 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.974920+0000", 2024-04-01T19:26:48.984 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1918e-05 2024-04-01T19:26:48.984 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.984 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.984 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:48.984 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.974931+0000", 2024-04-01T19:26:48.984 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1447999999999999e-05 2024-04-01T19:26:48.984 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:48.984 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:48.984 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:48.984 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.984 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.984 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop_reply(client.24751.0:182221 2.7 e144/106)", 2024-04-01T19:26:48.984 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:48.974963+0000", 2024-04-01T19:26:48.984 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0034458190000000001, 2024-04-01T19:26:48.985 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0035461450000000001, 2024-04-01T19:26:48.985 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:48.985 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:48.985 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "queued for pg", 2024-04-01T19:26:48.985 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:48.985 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.985 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:48.985 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.974963+0000", 2024-04-01T19:26:48.985 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:48.985 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.985 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.985 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:48.985 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.974963+0000", 2024-04-01T19:26:48.985 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:48.985 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.986 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.986 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:48.986 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.974964+0000", 2024-04-01T19:26:48.986 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1500000000000004e-07 2024-04-01T19:26:48.986 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.986 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.986 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:48.986 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.974967+0000", 2024-04-01T19:26:48.986 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.943e-06 2024-04-01T19:26:48.986 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.986 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.986 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:48.986 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.974974+0000", 2024-04-01T19:26:48.986 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9229999999999996e-06 2024-04-01T19:26:48.987 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.987 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.987 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:48.987 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.974979+0000", 2024-04-01T19:26:48.987 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3739999999999997e-06 2024-04-01T19:26:48.987 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:48.987 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:48.987 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:48.987 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.987 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.987 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:182234 2.7 2.8e3052d7 (undecoded) ondisk+write+known_if_redirected e144)", 2024-04-01T19:26:48.987 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:48.978017+0000", 2024-04-01T19:26:48.987 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.00039166599999999999, 2024-04-01T19:26:48.988 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00052178800000000003, 2024-04-01T19:26:48.988 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:48.988 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:48.988 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "queued for pg", 2024-04-01T19:26:48.988 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:26:48.988 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:26:48.988 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:26:48.988 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 182234 2024-04-01T19:26:48.988 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.988 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:48.988 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.988 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:48.988 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.978017+0000", 2024-04-01T19:26:48.989 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:48.989 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.989 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.989 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:48.989 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.978017+0000", 2024-04-01T19:26:48.989 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:48.989 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.989 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.989 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:48.989 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.978020+0000", 2024-04-01T19:26:48.989 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.7190000000000001e-06 2024-04-01T19:26:48.989 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.989 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.989 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:48.989 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.978031+0000", 2024-04-01T19:26:48.990 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0778000000000001e-05 2024-04-01T19:26:48.990 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.990 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.990 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:48.990 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.978047+0000", 2024-04-01T19:26:48.990 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.5919000000000001e-05 2024-04-01T19:26:48.990 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.990 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.990 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:48.990 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.978055+0000", 2024-04-01T19:26:48.990 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.8939999999999999e-06 2024-04-01T19:26:48.990 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:48.990 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:48.990 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:48.991 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.991 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.991 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:182217 2.7 2:e0887a6f:::benchmark_data_smithi188_77607_object14813:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-04-01T19:26:48.991 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:48.965635+0000", 2024-04-01T19:26:48.991 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.012774208, 2024-04-01T19:26:48.991 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.012952506000000001, 2024-04-01T19:26:48.991 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:48.991 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:48.991 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:26:48.991 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:26:48.991 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:26:48.991 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:26:48.992 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 182217 2024-04-01T19:26:48.992 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.992 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:48.992 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.992 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:48.992 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.965635+0000", 2024-04-01T19:26:48.992 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:48.992 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.992 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.992 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:48.992 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.965635+0000", 2024-04-01T19:26:48.992 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:48.992 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.992 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.992 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:48.993 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.965638+0000", 2024-04-01T19:26:48.993 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.3689999999999998e-06 2024-04-01T19:26:48.993 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.993 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.993 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:48.993 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.965647+0000", 2024-04-01T19:26:48.993 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.8820000000000007e-06 2024-04-01T19:26:48.993 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.993 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.993 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:48.993 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.965666+0000", 2024-04-01T19:26:48.993 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8981999999999999e-05 2024-04-01T19:26:48.993 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.993 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.994 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:48.994 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.965675+0000", 2024-04-01T19:26:48.994 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.577e-06 2024-04-01T19:26:48.994 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.994 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.994 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:48.994 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.965725+0000", 2024-04-01T19:26:48.994 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9258999999999997e-05 2024-04-01T19:26:48.994 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.994 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.994 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:48.994 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.965815+0000", 2024-04-01T19:26:48.994 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.9922999999999999e-05 2024-04-01T19:26:48.994 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.994 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.995 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 10", 2024-04-01T19:26:48.995 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.965880+0000", 2024-04-01T19:26:48.995 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5868e-05 2024-04-01T19:26:48.995 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.995 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.995 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:26:48.995 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.974629+0000", 2024-04-01T19:26:48.995 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0087489909999999994 2024-04-01T19:26:48.995 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.995 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.995 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:26:48.995 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.978523+0000", 2024-04-01T19:26:48.995 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0038932110000000002 2024-04-01T19:26:48.995 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.995 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.995 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:26:48.996 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.978576+0000", 2024-04-01T19:26:48.996 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3677000000000001e-05 2024-04-01T19:26:48.996 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:48.996 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:48.996 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:48.996 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.996 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.996 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:182221 2.7 2:e5814f1e:::benchmark_data_smithi188_77607_object14817:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-04-01T19:26:48.996 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:48.969108+0000", 2024-04-01T19:26:48.996 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0093011989999999996, 2024-04-01T19:26:48.996 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0095464999999999994, 2024-04-01T19:26:48.996 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:26:48.996 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:26:48.996 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:26:48.997 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:26:48.997 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:26:48.997 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:26:48.997 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 182221 2024-04-01T19:26:48.997 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.997 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:26:48.997 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.997 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:26:48.997 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.969108+0000", 2024-04-01T19:26:48.997 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:48.997 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.997 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.997 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:26:48.997 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.969108+0000", 2024-04-01T19:26:48.997 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:26:48.998 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.998 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.998 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:26:48.998 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.969110+0000", 2024-04-01T19:26:48.998 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8619999999999999e-06 2024-04-01T19:26:48.998 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.998 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.998 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:26:48.998 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.969121+0000", 2024-04-01T19:26:48.998 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0803e-05 2024-04-01T19:26:48.998 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.998 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.998 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:26:48.998 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.969140+0000", 2024-04-01T19:26:48.999 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8681999999999998e-05 2024-04-01T19:26:48.999 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.999 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.999 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:26:48.999 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.969151+0000", 2024-04-01T19:26:48.999 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0859000000000001e-05 2024-04-01T19:26:48.999 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.999 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.999 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:26:48.999 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.969945+0000", 2024-04-01T19:26:48.999 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00079447700000000003 2024-04-01T19:26:48.999 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:48.999 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:48.999 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:26:48.999 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.970078+0000", 2024-04-01T19:26:48.999 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000132364 2024-04-01T19:26:49.000 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:49.000 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:49.000 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 10", 2024-04-01T19:26:49.000 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.970204+0000", 2024-04-01T19:26:49.000 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000125974 2024-04-01T19:26:49.000 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:26:49.000 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:26:49.000 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:26:49.000 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:48.978470+0000", 2024-04-01T19:26:49.000 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0082659440000000008 2024-04-01T19:26:49.000 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:49.000 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:26:49.000 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:49.000 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:26:49.000 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-04-01T19:26:49.000 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 6 2024-04-01T19:26:49.001 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:26:49.001 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:48 smithi062 ceph-mon[44211]: osdmap e144: 12 total, 12 up, 12 in 2024-04-01T19:26:49.125 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:26:49.131 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:49.132 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:26:49.233 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:26:49.272 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:48 smithi022 ceph-mon[39439]: osdmap e144: 12 total, 12 up, 12 in 2024-04-01T19:26:49.273 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:49.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:48 smithi188 ceph-mon[43939]: osdmap e144: 12 total, 12 up, 12 in 2024-04-01T19:26:49.755 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_blocked_ops 2024-04-01T19:26:50.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:49 smithi062 ceph-mon[44211]: pgmap v443: 17 pgs: 17 active+clean; 9.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:26:50.081 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:26:50.206 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:49 smithi022 ceph-mon[39439]: pgmap v443: 17 pgs: 17 active+clean; 9.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:26:50.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:49 smithi188 ceph-mon[43939]: pgmap v443: 17 pgs: 17 active+clean; 9.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:26:51.726 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:26:51.763 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:26:51.771 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:51.772 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:26:51.873 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:26:51.911 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:51.942 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:26:51.945 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:51.945 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:26:52.046 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:26:52.067 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:51 smithi022 ceph-mon[39439]: pgmap v444: 17 pgs: 17 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.26k op/s 2024-04-01T19:26:52.081 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:52.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:51 smithi062 ceph-mon[44211]: pgmap v444: 17 pgs: 17 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.26k op/s 2024-04-01T19:26:52.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:51 smithi188 ceph-mon[43939]: pgmap v444: 17 pgs: 17 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.26k op/s 2024-04-01T19:26:52.455 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:26:52.481 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:26:52.522 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:26:52.557 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:26:52.595 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:26:52.636 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:26:52.663 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:26:52.705 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:26:52.737 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:26:52.771 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:26:52.802 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:26:52.838 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:26:52.866 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:26:52.866 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:26:52.866 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:26:52.866 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:26:52.866 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:26:52.866 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:26:52.866 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:26:52.866 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:26:52.866 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:26:52.866 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:26:52.867 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:26:52.867 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:26:53.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:52 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2151327826' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:26:53.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:53.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:53.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:53.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:53.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:53.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:53.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:52 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2151327826' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:26:53.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:53.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:53.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:53.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:53.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:53.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:53.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:52 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2151327826' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:26:53.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:53.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:53.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:53.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:53.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:53.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:53.834 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:26:53.837 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:53.838 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:26:53.918 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.9 to 1 (10000) 2024-04-01T19:26:53.938 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:26:53.984 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:54.009 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:26:54.015 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:54.015 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:26:54.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:54.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:54.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:53 smithi022 ceph-mon[39439]: pgmap v445: 17 pgs: 17 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.31k op/s 2024-04-01T19:26:54.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:54.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:54.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:54.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:54.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:53 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2198265351' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T19:26:54.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:53 smithi022 ceph-mon[39439]: from='client.34883 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T19:26:54.116 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:26:54.144 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:54.144 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:54.144 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:53 smithi062 ceph-mon[44211]: pgmap v445: 17 pgs: 17 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.31k op/s 2024-04-01T19:26:54.144 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:54.144 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:54.144 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:54.144 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:54.144 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:53 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2198265351' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T19:26:54.145 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:53 smithi062 ceph-mon[44211]: from='client.34883 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T19:26:54.146 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:54.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:54.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:54.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:53 smithi188 ceph-mon[43939]: pgmap v445: 17 pgs: 17 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.31k op/s 2024-04-01T19:26:54.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:54.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:54.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:54.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:26:54.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:53 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2198265351' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T19:26:54.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:53 smithi188 ceph-mon[43939]: from='client.34883 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T19:26:54.499 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:26:54.504 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:54.504 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:26:54.605 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:26:54.662 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:54.796 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:26:54.796 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:26:54.830 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:26:54.838 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:54.839 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:26:54.940 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:26:54.972 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:55.075 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:26:55.080 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:55.080 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:54 smithi062 ceph-mon[44211]: from='client.34883 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]': finished 2024-04-01T19:26:55.080 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:54 smithi062 ceph-mon[44211]: osdmap e145: 12 total, 12 up, 12 in 2024-04-01T19:26:55.080 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:26:55.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:54 smithi022 ceph-mon[39439]: from='client.34883 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]': finished 2024-04-01T19:26:55.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:54 smithi022 ceph-mon[39439]: osdmap e145: 12 total, 12 up, 12 in 2024-04-01T19:26:55.181 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:26:55.213 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:55.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:54 smithi188 ceph-mon[43939]: from='client.34883 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]': finished 2024-04-01T19:26:55.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:54 smithi188 ceph-mon[43939]: osdmap e145: 12 total, 12 up, 12 in 2024-04-01T19:26:55.378 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 10 1 2024-04-01T19:26:55.631 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_historic_ops 2024-04-01T19:26:55.666 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:26:55.668 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:55.668 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:26:55.769 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:26:55.800 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:55.820 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:26:55.824 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:26:55.830 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:55.831 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:26:55.932 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:26:55.935 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:55 smithi062 ceph-mon[44211]: pgmap v447: 17 pgs: 17 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.33k op/s 2024-04-01T19:26:55.935 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:55 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:26:55.935 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:55 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:26:55.998 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:26:56.003 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:26:56.005 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:56.052 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:26:56.055 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:56.056 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:26:56.157 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:26:56.192 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:56.273 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:26:56.277 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:56.278 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:26:56.334 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:55 smithi022 ceph-mon[39439]: pgmap v447: 17 pgs: 17 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.33k op/s 2024-04-01T19:26:56.334 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:55 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:26:56.335 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:55 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:26:56.378 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:26:56.379 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:55 smithi188 ceph-mon[43939]: pgmap v447: 17 pgs: 17 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.33k op/s 2024-04-01T19:26:56.379 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:55 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:26:56.379 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:55 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:26:56.415 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:56.870 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:26:56.874 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:56.874 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:26:56.975 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:26:56.999 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:26:57.034 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:57.245 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:26:57.248 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:56 smithi022 ceph-mon[39439]: osdmap e146: 12 total, 12 up, 12 in 2024-04-01T19:26:57.248 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:56 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3956432617' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:26:57.248 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:57.249 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:26:57.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:56 smithi062 ceph-mon[44211]: osdmap e146: 12 total, 12 up, 12 in 2024-04-01T19:26:57.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:56 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3956432617' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:26:57.349 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:26:57.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:56 smithi188 ceph-mon[43939]: osdmap e146: 12 total, 12 up, 12 in 2024-04-01T19:26:57.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:56 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3956432617' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:26:57.403 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:57.429 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:26:57.434 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:57.435 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:26:57.536 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:26:57.569 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:57.616 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:26:57.726 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:26:57.729 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:57.729 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:26:57.830 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:26:57.862 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:57.893 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:26:57.897 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:57.898 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:26:57.998 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:26:58.031 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:26:58.031 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:26:58.043 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:58.073 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:26:58.080 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:58.081 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:26:58.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:57 smithi188 ceph-mon[43939]: pgmap v449: 17 pgs: 17 active+clean; 8.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.29k op/s 2024-04-01T19:26:58.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:57 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:26:58.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:57 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3956432617' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:26:58.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:57 smithi188 ceph-mon[43939]: osdmap e147: 12 total, 12 up, 12 in 2024-04-01T19:26:58.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:26:57 smithi188 ceph-mon[43939]: 2.4 scrub starts 2024-04-01T19:26:58.182 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:26:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:58.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:57 smithi062 ceph-mon[44211]: pgmap v449: 17 pgs: 17 active+clean; 8.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.29k op/s 2024-04-01T19:26:58.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:57 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:26:58.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:57 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3956432617' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:26:58.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:57 smithi062 ceph-mon[44211]: osdmap e147: 12 total, 12 up, 12 in 2024-04-01T19:26:58.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:26:57 smithi062 ceph-mon[44211]: 2.4 scrub starts 2024-04-01T19:26:58.352 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:26:58.360 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:58.360 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:57 smithi022 ceph-mon[39439]: pgmap v449: 17 pgs: 17 active+clean; 8.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.29k op/s 2024-04-01T19:26:58.360 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:57 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:26:58.360 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:57 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3956432617' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:26:58.360 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:57 smithi022 ceph-mon[39439]: osdmap e147: 12 total, 12 up, 12 in 2024-04-01T19:26:58.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:26:57 smithi022 ceph-mon[39439]: 2.4 scrub starts 2024-04-01T19:26:58.361 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:26:58.462 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:26:58.516 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:58.559 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:26:58.573 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:58.573 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:26:58.674 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:26:58.738 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:58.785 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:26:58.793 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:58.793 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:26:58.843 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_ops_in_flight 2024-04-01T19:26:58.894 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:26:58.930 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:58.958 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:26:58.962 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:58.963 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:26:59.063 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:26:59.121 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:26:59.215 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:26:59.897 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:26:59.902 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:26:59.903 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:27:00.000 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:00 smithi062 ceph-mon[44211]: pgmap v451: 17 pgs: 17 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:27:00.000 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:00 smithi062 ceph-mon[44211]: 2.0 scrub starts 2024-04-01T19:27:00.000 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:00 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/446468923' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T19:27:00.000 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:00 smithi062 ceph-mon[44211]: from='client.24883 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T19:27:00.000 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:00 smithi062 ceph-mon[44211]: 2.4 scrub ok 2024-04-01T19:27:00.004 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:27:00.026 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.10 to 1 (10000) 2024-04-01T19:27:00.032 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:00.058 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:27:00.066 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:00.066 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:27:00.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:00 smithi022 ceph-mon[39439]: pgmap v451: 17 pgs: 17 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:27:00.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:00 smithi022 ceph-mon[39439]: 2.0 scrub starts 2024-04-01T19:27:00.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:00 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/446468923' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T19:27:00.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:00 smithi022 ceph-mon[39439]: from='client.24883 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T19:27:00.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:00 smithi022 ceph-mon[39439]: 2.4 scrub ok 2024-04-01T19:27:00.118 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:27:00.167 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:27:00.231 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:00.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:00 smithi188 ceph-mon[43939]: pgmap v451: 17 pgs: 17 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:27:00.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:00 smithi188 ceph-mon[43939]: 2.0 scrub starts 2024-04-01T19:27:00.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:00 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/446468923' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T19:27:00.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:00 smithi188 ceph-mon[43939]: from='client.24883 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T19:27:00.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:00 smithi188 ceph-mon[43939]: 2.4 scrub ok 2024-04-01T19:27:00.379 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:27:00.382 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:00.383 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:27:00.484 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:27:00.533 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:00.559 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:27:00.562 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:00.562 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:27:00.663 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:27:00.709 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:00.734 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:27:00.739 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:00.739 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:27:00.840 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:27:00.862 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:27:00.874 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:00.898 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:27:00.899 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:27:00.901 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:00.902 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:27:00.941 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:27:00.987 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:27:01.003 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:27:01.018 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:27:01.035 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:01.056 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:27:01.063 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:27:01.067 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:01.067 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:27:01.087 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:27:01.125 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:27:01.167 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:27:01.168 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:27:01.207 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:27:01.208 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 11 1 2024-04-01T19:27:01.213 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:27:01.216 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:27:01.216 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:27:01.216 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 0 2024-04-01T19:27:01.216 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:27:01.236 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:01 smithi062 ceph-mon[44211]: from='client.24883 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]': finished 2024-04-01T19:27:01.236 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:01 smithi062 ceph-mon[44211]: osdmap e148: 12 total, 12 up, 12 in 2024-04-01T19:27:01.236 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:01 smithi062 ceph-mon[44211]: 2.0 scrub ok 2024-04-01T19:27:01.236 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:01 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/771057392' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:27:01.261 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:27:01.270 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:01 smithi022 ceph-mon[39439]: from='client.24883 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]': finished 2024-04-01T19:27:01.270 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:01 smithi022 ceph-mon[39439]: osdmap e148: 12 total, 12 up, 12 in 2024-04-01T19:27:01.270 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:01 smithi022 ceph-mon[39439]: 2.0 scrub ok 2024-04-01T19:27:01.270 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:01 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/771057392' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:27:01.273 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:01.296 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:27:01.333 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:27:01.333 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:27:01.333 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:27:01.333 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:27:01.333 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:27:01.333 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:27:01.333 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:27:01.333 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:27:01.333 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:27:01.333 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:27:01.334 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:27:01.334 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:27:01.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:01 smithi188 ceph-mon[43939]: from='client.24883 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]': finished 2024-04-01T19:27:01.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:01 smithi188 ceph-mon[43939]: osdmap e148: 12 total, 12 up, 12 in 2024-04-01T19:27:01.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:01 smithi188 ceph-mon[43939]: 2.0 scrub ok 2024-04-01T19:27:01.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:01 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/771057392' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:27:01.920 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_blocked_ops 2024-04-01T19:27:02.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:02 smithi022 ceph-mon[39439]: pgmap v453: 17 pgs: 17 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:27:02.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:02 smithi062 ceph-mon[44211]: pgmap v453: 17 pgs: 17 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:27:02.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.264 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:27:02.280 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:27:02.299 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:02.300 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:27:02.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:02 smithi188 ceph-mon[43939]: pgmap v453: 17 pgs: 17 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:27:02.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:02.400 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:27:02.444 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:02.471 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:27:02.473 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:02.474 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:27:02.575 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:27:02.622 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:02.672 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:27:02.676 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:02.676 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:27:02.681 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:27:02.777 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:27:02.849 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:02.938 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:27:02.942 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:02.942 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:27:03.043 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:27:03.079 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:03.105 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:27:03.108 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:03.108 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:27:03.209 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:27:03.275 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:03.363 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:27:03.373 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:03.374 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:27:03.474 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:27:03.544 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:04.215 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:27:04.215 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:27:04.215 INFO:teuthology.orchestra.run.smithi062.stdout: "complaint_time": 30, 2024-04-01T19:27:04.215 INFO:teuthology.orchestra.run.smithi062.stdout: "num_blocked_ops": 0 2024-04-01T19:27:04.215 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:27:04.240 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:04 smithi062 ceph-mon[44211]: pgmap v454: 17 pgs: 17 active+clean; 8.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:27:04.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:04 smithi022 ceph-mon[39439]: pgmap v454: 17 pgs: 17 active+clean; 8.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:27:04.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:04 smithi188 ceph-mon[43939]: pgmap v454: 17 pgs: 17 active+clean; 8.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:27:04.729 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:27:04.835 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:27:04.840 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:04.841 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:27:04.934 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_historic_ops 2024-04-01T19:27:04.941 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:27:05.031 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:05.065 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:05 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:27:05.065 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:05 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:27:05.122 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:27:05.133 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:05.134 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:27:05.235 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:27:05.256 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:27:05.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:05 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:27:05.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:05 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:27:05.264 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:05.291 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:27:05.294 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:05.294 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:27:05.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:05 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:27:05.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:05 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:27:05.395 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:27:05.427 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:05.477 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:27:05.529 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:27:05.531 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:05.532 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:27:05.633 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:27:05.698 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:05.768 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:27:05.777 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:05.778 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:27:05.879 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:27:05.909 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:05.944 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:05.944 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:27:05.944 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:27:06.046 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:27:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.11 to 1 (10000) 2024-04-01T19:27:06.102 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:27:06.118 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:06.316 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:06 smithi062 ceph-mon[44211]: pgmap v455: 17 pgs: 17 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:27:06.316 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:06 smithi062 ceph-mon[44211]: osdmap e149: 12 total, 12 up, 12 in 2024-04-01T19:27:06.316 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:06 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2663957289' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:27:06.316 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:06 smithi062 ceph-mon[44211]: from='client.34895 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:27:06.317 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:06 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/131739589' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T19:27:06.317 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:06 smithi062 ceph-mon[44211]: from='client.34901 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T19:27:06.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:06 smithi022 ceph-mon[39439]: pgmap v455: 17 pgs: 17 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:27:06.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:06 smithi022 ceph-mon[39439]: osdmap e149: 12 total, 12 up, 12 in 2024-04-01T19:27:06.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:06 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2663957289' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:27:06.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:06 smithi022 ceph-mon[39439]: from='client.34895 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:27:06.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:06 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/131739589' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T19:27:06.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:06 smithi022 ceph-mon[39439]: from='client.34901 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T19:27:06.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:06 smithi188 ceph-mon[43939]: pgmap v455: 17 pgs: 17 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:27:06.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:06 smithi188 ceph-mon[43939]: osdmap e149: 12 total, 12 up, 12 in 2024-04-01T19:27:06.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:06 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2663957289' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:27:06.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:06 smithi188 ceph-mon[43939]: from='client.34895 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:27:06.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:06 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/131739589' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T19:27:06.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:06 smithi188 ceph-mon[43939]: from='client.34901 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T19:27:06.878 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:27:06.882 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:06.883 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:27:06.984 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:27:07.026 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:07.060 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:27:07.069 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:07.070 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:27:07.171 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:27:07.193 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:07 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:27:07.193 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:07 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:27:07.193 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:07 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:27:07.193 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:07 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:27:07.193 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:07 smithi022 ceph-mon[39439]: from='client.34895 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:27:07.193 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:07 smithi022 ceph-mon[39439]: from='client.34901 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]': finished 2024-04-01T19:27:07.193 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:07 smithi022 ceph-mon[39439]: osdmap e150: 12 total, 12 up, 12 in 2024-04-01T19:27:07.193 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:07 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:27:07.208 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:07.245 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:27:07.248 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:07.249 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:27:07.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:07 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:27:07.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:07 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:27:07.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:07 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:27:07.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:07 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:27:07.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:07 smithi062 ceph-mon[44211]: from='client.34895 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:27:07.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:07 smithi062 ceph-mon[44211]: from='client.34901 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]': finished 2024-04-01T19:27:07.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:07 smithi062 ceph-mon[44211]: osdmap e150: 12 total, 12 up, 12 in 2024-04-01T19:27:07.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:07 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:27:07.297 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:27:07.357 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 20, 2024-04-01T19:27:07.357 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 600, 2024-04-01T19:27:07.357 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:27:07.358 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.358 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:145002 2.0 2:09849a2f:::benchmark_data_smithi188_77607_object145001:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:27:07.358 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:11.909680+0000", 2024-04-01T19:27:07.358 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 55.384720680000001, 2024-04-01T19:27:07.358 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.033556533999999999, 2024-04-01T19:27:07.358 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:27:07.358 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:27:07.358 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:07.358 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:27:07.358 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:27:07.358 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:07.358 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 145002 2024-04-01T19:27:07.359 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.359 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:27:07.359 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.359 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:27:07.359 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.909680+0000", 2024-04-01T19:27:07.359 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.359 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.359 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.359 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:27:07.359 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.909680+0000", 2024-04-01T19:27:07.359 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.359 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.359 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.359 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:27:07.359 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.909692+0000", 2024-04-01T19:27:07.360 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1467e-05 2024-04-01T19:27:07.360 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.360 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.360 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:27:07.360 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.909751+0000", 2024-04-01T19:27:07.360 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.9215000000000001e-05 2024-04-01T19:27:07.360 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.360 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.360 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:27:07.360 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.909772+0000", 2024-04-01T19:27:07.360 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1481e-05 2024-04-01T19:27:07.360 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.360 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.360 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:27:07.360 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.909781+0000", 2024-04-01T19:27:07.361 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.4300000000000006e-06 2024-04-01T19:27:07.361 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.361 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.361 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:27:07.361 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.921204+0000", 2024-04-01T19:27:07.361 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.011422722 2024-04-01T19:27:07.361 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.361 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.361 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:27:07.361 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.921341+0000", 2024-04-01T19:27:07.361 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013718700000000001 2024-04-01T19:27:07.361 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.361 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.361 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 10", 2024-04-01T19:27:07.362 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.921493+0000", 2024-04-01T19:27:07.362 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00015259200000000001 2024-04-01T19:27:07.362 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.362 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.362 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:27:07.362 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.933997+0000", 2024-04-01T19:27:07.362 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.012504082 2024-04-01T19:27:07.362 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.362 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.362 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:07.362 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.943142+0000", 2024-04-01T19:27:07.362 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0091446159999999995 2024-04-01T19:27:07.362 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.362 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.363 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:27:07.363 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.943196+0000", 2024-04-01T19:27:07.363 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3603000000000002e-05 2024-04-01T19:27:07.363 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.363 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.363 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:27:07.363 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.943237+0000", 2024-04-01T19:27:07.363 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.1139e-05 2024-04-01T19:27:07.363 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.363 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:27:07.363 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.363 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.363 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.363 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:145003 2.0 2:0c5677f7:::benchmark_data_smithi188_77607_object145002:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:27:07.363 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:11.909900+0000", 2024-04-01T19:27:07.363 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 55.384500649000003, 2024-04-01T19:27:07.364 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.033463985000000002, 2024-04-01T19:27:07.364 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:27:07.364 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:27:07.364 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:07.364 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:27:07.364 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:27:07.364 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:07.364 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 145003 2024-04-01T19:27:07.364 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.364 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:27:07.364 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.364 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:27:07.364 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.909900+0000", 2024-04-01T19:27:07.364 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.365 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.365 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.365 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:27:07.365 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.909900+0000", 2024-04-01T19:27:07.365 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.365 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.365 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.365 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:27:07.365 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.909901+0000", 2024-04-01T19:27:07.365 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.2999999999999999e-07 2024-04-01T19:27:07.365 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.365 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.365 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:27:07.366 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.910055+0000", 2024-04-01T19:27:07.366 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00015390400000000001 2024-04-01T19:27:07.366 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.366 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.366 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:27:07.366 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.910063+0000", 2024-04-01T19:27:07.366 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.7710000000000006e-06 2024-04-01T19:27:07.366 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.366 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.366 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:27:07.366 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.910070+0000", 2024-04-01T19:27:07.366 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8199999999999999e-06 2024-04-01T19:27:07.366 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.366 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.367 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:27:07.367 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.924964+0000", 2024-04-01T19:27:07.367 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.014894315999999999 2024-04-01T19:27:07.367 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.367 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.367 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:27:07.367 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.925112+0000", 2024-04-01T19:27:07.367 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000147513 2024-04-01T19:27:07.367 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.367 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.367 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 10", 2024-04-01T19:27:07.367 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.925310+0000", 2024-04-01T19:27:07.367 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000198495 2024-04-01T19:27:07.367 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.368 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.368 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:27:07.368 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.934001+0000", 2024-04-01T19:27:07.368 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0086907960000000006 2024-04-01T19:27:07.368 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.368 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.368 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:07.368 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.943282+0000", 2024-04-01T19:27:07.368 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0092814179999999996 2024-04-01T19:27:07.368 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.368 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.368 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:27:07.368 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.943330+0000", 2024-04-01T19:27:07.368 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8003000000000001e-05 2024-04-01T19:27:07.368 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.369 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.369 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:27:07.369 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:11.943364+0000", 2024-04-01T19:27:07.369 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.4019000000000001e-05 2024-04-01T19:27:07.369 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.369 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:27:07.369 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.369 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.369 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.369 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:147327 2.8 2:1949007b:::benchmark_data_smithi188_77607_object147326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:27:07.369 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:13.762917+0000", 2024-04-01T19:27:07.369 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 53.531483811000001, 2024-04-01T19:27:07.370 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.03268484, 2024-04-01T19:27:07.370 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:27:07.370 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:27:07.370 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:07.370 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:27:07.370 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:27:07.370 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:07.370 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 147327 2024-04-01T19:27:07.370 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.370 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:27:07.370 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.370 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:27:07.370 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.762917+0000", 2024-04-01T19:27:07.370 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.371 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.371 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.371 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:27:07.371 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.762917+0000", 2024-04-01T19:27:07.371 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.371 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.371 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.371 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:27:07.371 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.762918+0000", 2024-04-01T19:27:07.371 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7100000000000002e-07 2024-04-01T19:27:07.371 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.371 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.371 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:27:07.371 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.762970+0000", 2024-04-01T19:27:07.372 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2258e-05 2024-04-01T19:27:07.372 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.372 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.372 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:27:07.372 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.762978+0000", 2024-04-01T19:27:07.372 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.7209999999999994e-06 2024-04-01T19:27:07.372 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.372 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.372 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:27:07.372 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.762982+0000", 2024-04-01T19:27:07.372 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.2889999999999999e-06 2024-04-01T19:27:07.372 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.372 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.372 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:27:07.373 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.771568+0000", 2024-04-01T19:27:07.373 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0085856730000000003 2024-04-01T19:27:07.373 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.373 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.373 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:27:07.373 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.771709+0000", 2024-04-01T19:27:07.373 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014145600000000001 2024-04-01T19:27:07.373 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.373 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.373 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:07.373 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.771820+0000", 2024-04-01T19:27:07.373 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00011111399999999999 2024-04-01T19:27:07.373 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.373 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.373 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:27:07.374 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.779201+0000", 2024-04-01T19:27:07.374 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0073811399999999996 2024-04-01T19:27:07.374 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.374 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.374 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:07.374 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.795473+0000", 2024-04-01T19:27:07.374 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.016271557999999998 2024-04-01T19:27:07.374 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.374 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.374 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:27:07.374 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.795538+0000", 2024-04-01T19:27:07.374 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5091000000000004e-05 2024-04-01T19:27:07.374 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.375 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.375 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:27:07.375 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:13.795602+0000", 2024-04-01T19:27:07.375 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.4068999999999999e-05 2024-04-01T19:27:07.375 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.375 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:27:07.375 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.375 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.375 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.375 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:150262 2.8 2:1aa6bb28:::benchmark_data_smithi188_77607_object150261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:27:07.375 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:16.295660+0000", 2024-04-01T19:27:07.375 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 50.998740785999999, 2024-04-01T19:27:07.375 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.037889106999999998, 2024-04-01T19:27:07.375 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:27:07.375 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:27:07.376 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:07.376 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:27:07.376 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:27:07.376 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:07.376 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 150262 2024-04-01T19:27:07.376 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.376 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:27:07.376 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.376 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:27:07.376 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.295660+0000", 2024-04-01T19:27:07.376 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.376 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.376 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.376 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:27:07.376 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.295660+0000", 2024-04-01T19:27:07.377 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.377 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.377 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.377 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:27:07.377 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.295661+0000", 2024-04-01T19:27:07.377 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.7400000000000003e-07 2024-04-01T19:27:07.377 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.377 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.377 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:27:07.377 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.295723+0000", 2024-04-01T19:27:07.377 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.266e-05 2024-04-01T19:27:07.377 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.377 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.377 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:27:07.378 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.295731+0000", 2024-04-01T19:27:07.378 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.0949999999999998e-06 2024-04-01T19:27:07.378 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.378 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.378 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:27:07.378 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.295734+0000", 2024-04-01T19:27:07.378 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9190000000000001e-06 2024-04-01T19:27:07.378 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.378 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.378 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:27:07.378 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.299281+0000", 2024-04-01T19:27:07.378 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0035468050000000001 2024-04-01T19:27:07.378 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.378 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.378 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:27:07.379 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.299354+0000", 2024-04-01T19:27:07.379 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.2391000000000005e-05 2024-04-01T19:27:07.379 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.379 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.379 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:07.379 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.299435+0000", 2024-04-01T19:27:07.379 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.1478999999999997e-05 2024-04-01T19:27:07.379 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.379 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.379 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:27:07.379 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.303730+0000", 2024-04-01T19:27:07.379 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0042952010000000002 2024-04-01T19:27:07.379 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.379 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.379 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:07.380 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.333486+0000", 2024-04-01T19:27:07.380 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.029755404999999999 2024-04-01T19:27:07.380 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.380 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.380 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:27:07.380 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.333519+0000", 2024-04-01T19:27:07.380 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.2898000000000002e-05 2024-04-01T19:27:07.380 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.380 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.380 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:27:07.380 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.333549+0000", 2024-04-01T19:27:07.380 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.0580000000000002e-05 2024-04-01T19:27:07.380 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.380 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:27:07.380 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.381 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.381 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.381 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:150269 2.8 2:18b2d2d2:::benchmark_data_smithi188_77607_object150268:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:27:07.381 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:16.300790+0000", 2024-04-01T19:27:07.381 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 50.993610752000002, 2024-04-01T19:27:07.381 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.032836351999999999, 2024-04-01T19:27:07.381 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:27:07.381 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:27:07.381 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:07.381 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:27:07.381 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:27:07.381 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:07.381 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 150269 2024-04-01T19:27:07.381 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.381 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:27:07.382 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.382 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:27:07.382 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.300790+0000", 2024-04-01T19:27:07.382 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.382 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.382 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.382 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:27:07.382 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.300790+0000", 2024-04-01T19:27:07.382 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.382 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.382 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.382 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:27:07.382 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.300792+0000", 2024-04-01T19:27:07.383 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.7209999999999999e-06 2024-04-01T19:27:07.383 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.383 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.383 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:27:07.383 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.300833+0000", 2024-04-01T19:27:07.383 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.1436000000000001e-05 2024-04-01T19:27:07.383 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.383 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.383 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:27:07.383 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.300846+0000", 2024-04-01T19:27:07.383 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2469e-05 2024-04-01T19:27:07.383 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.383 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.383 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:27:07.383 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.300854+0000", 2024-04-01T19:27:07.383 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.2849999999999995e-06 2024-04-01T19:27:07.384 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.384 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.384 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:27:07.384 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.301486+0000", 2024-04-01T19:27:07.384 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00063152900000000003 2024-04-01T19:27:07.384 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.384 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.384 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:27:07.384 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.301579+0000", 2024-04-01T19:27:07.384 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.3374000000000004e-05 2024-04-01T19:27:07.384 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.384 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.384 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:07.384 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.301668+0000", 2024-04-01T19:27:07.384 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.9129000000000007e-05 2024-04-01T19:27:07.384 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.385 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.385 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:27:07.385 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.303826+0000", 2024-04-01T19:27:07.385 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0021579619999999998 2024-04-01T19:27:07.385 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.385 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.385 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:07.385 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.333577+0000", 2024-04-01T19:27:07.385 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.029751191999999999 2024-04-01T19:27:07.385 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.385 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.385 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:27:07.385 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.333605+0000", 2024-04-01T19:27:07.385 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8228000000000001e-05 2024-04-01T19:27:07.385 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.385 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.386 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:27:07.386 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.333626+0000", 2024-04-01T19:27:07.386 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1027e-05 2024-04-01T19:27:07.386 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.386 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:27:07.386 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.386 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.386 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.386 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:150274 2.8 2:104962b8:::benchmark_data_smithi188_77607_object150273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:27:07.386 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:16.311507+0000", 2024-04-01T19:27:07.386 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 50.982893478000001, 2024-04-01T19:27:07.386 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.030762126000000001, 2024-04-01T19:27:07.386 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:27:07.386 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:27:07.387 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:07.387 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:27:07.387 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:27:07.387 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:07.387 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 150274 2024-04-01T19:27:07.387 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.387 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:27:07.387 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.387 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:27:07.387 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.311507+0000", 2024-04-01T19:27:07.387 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.387 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.387 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.387 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:27:07.387 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.311507+0000", 2024-04-01T19:27:07.388 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.388 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.388 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.388 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:27:07.388 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.311509+0000", 2024-04-01T19:27:07.388 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4410000000000001e-06 2024-04-01T19:27:07.388 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.388 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.388 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:27:07.388 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.311530+0000", 2024-04-01T19:27:07.388 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1532e-05 2024-04-01T19:27:07.388 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.388 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.388 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:27:07.389 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.311541+0000", 2024-04-01T19:27:07.389 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0682999999999999e-05 2024-04-01T19:27:07.389 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.389 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.389 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:27:07.389 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.311548+0000", 2024-04-01T19:27:07.389 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.3939999999999998e-06 2024-04-01T19:27:07.389 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.389 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.389 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:27:07.389 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.311602+0000", 2024-04-01T19:27:07.389 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3224999999999999e-05 2024-04-01T19:27:07.389 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.389 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.389 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:27:07.389 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.311704+0000", 2024-04-01T19:27:07.390 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00010274 2024-04-01T19:27:07.390 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.390 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.390 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:07.390 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.311866+0000", 2024-04-01T19:27:07.390 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00016157699999999999 2024-04-01T19:27:07.390 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.390 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.390 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:27:07.390 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.318178+0000", 2024-04-01T19:27:07.390 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0063123279999999999 2024-04-01T19:27:07.390 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.390 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.390 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:07.391 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.342211+0000", 2024-04-01T19:27:07.391 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.024032367999999998 2024-04-01T19:27:07.391 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.391 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.391 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:27:07.391 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.342245+0000", 2024-04-01T19:27:07.391 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.4056000000000001e-05 2024-04-01T19:27:07.391 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.391 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.391 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:27:07.391 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.342270+0000", 2024-04-01T19:27:07.391 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.4782000000000001e-05 2024-04-01T19:27:07.391 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.391 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:27:07.391 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.392 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.392 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.392 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:150978 2.8 2:1c483fe3:::benchmark_data_smithi188_77607_object150977:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:27:07.392 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:16.950379+0000", 2024-04-01T19:27:07.392 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 50.344022072000001, 2024-04-01T19:27:07.392 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.030659146000000002, 2024-04-01T19:27:07.392 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:27:07.392 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:27:07.392 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:07.392 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:27:07.392 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:27:07.392 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:07.392 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 150978 2024-04-01T19:27:07.392 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.392 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:27:07.392 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.393 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:27:07.393 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.950379+0000", 2024-04-01T19:27:07.393 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.393 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.393 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.393 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:27:07.393 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.950379+0000", 2024-04-01T19:27:07.393 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.393 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.393 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.393 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:27:07.393 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.950379+0000", 2024-04-01T19:27:07.393 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7899999999999999e-07 2024-04-01T19:27:07.393 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.393 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.394 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:27:07.394 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.951488+0000", 2024-04-01T19:27:07.394 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0011086990000000001 2024-04-01T19:27:07.394 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.394 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.394 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:27:07.394 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.951498+0000", 2024-04-01T19:27:07.394 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.5799999999999998e-06 2024-04-01T19:27:07.394 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.394 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.394 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:27:07.394 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.951503+0000", 2024-04-01T19:27:07.394 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1340000000000003e-06 2024-04-01T19:27:07.394 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.395 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.395 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:27:07.395 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.961786+0000", 2024-04-01T19:27:07.395 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.01028334 2024-04-01T19:27:07.395 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.395 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.395 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:27:07.395 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.961940+0000", 2024-04-01T19:27:07.395 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00015384900000000001 2024-04-01T19:27:07.395 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.395 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.395 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:07.395 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.962096+0000", 2024-04-01T19:27:07.395 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000156508 2024-04-01T19:27:07.395 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.395 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.396 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:27:07.396 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.969481+0000", 2024-04-01T19:27:07.396 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0073845830000000001 2024-04-01T19:27:07.396 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.396 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.396 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:07.396 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.980872+0000", 2024-04-01T19:27:07.396 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.011391179 2024-04-01T19:27:07.396 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.396 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.396 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:27:07.396 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.980967+0000", 2024-04-01T19:27:07.396 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.4827999999999994e-05 2024-04-01T19:27:07.396 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.396 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.396 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:27:07.397 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:16.981038+0000", 2024-04-01T19:27:07.397 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.0967e-05 2024-04-01T19:27:07.397 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.397 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:27:07.397 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.397 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.397 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.397 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:185346 2.8 2:1e780503:::benchmark_data_smithi188_77607_object17942:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-04-01T19:27:07.397 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:51.369745+0000", 2024-04-01T19:27:07.397 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 15.924655436, 2024-04-01T19:27:07.397 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.031211207000000001, 2024-04-01T19:27:07.397 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:27:07.397 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:27:07.397 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:07.397 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:27:07.398 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:27:07.398 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:07.398 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 185346 2024-04-01T19:27:07.398 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.398 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:27:07.398 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.398 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:27:07.398 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.369745+0000", 2024-04-01T19:27:07.398 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.398 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.398 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.398 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:27:07.398 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.369745+0000", 2024-04-01T19:27:07.399 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.399 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.399 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.399 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:27:07.399 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.369747+0000", 2024-04-01T19:27:07.399 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.328e-06 2024-04-01T19:27:07.399 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.399 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.399 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:27:07.399 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.369750+0000", 2024-04-01T19:27:07.399 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.6540000000000001e-06 2024-04-01T19:27:07.399 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.399 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.399 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:27:07.399 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.369769+0000", 2024-04-01T19:27:07.399 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8989000000000001e-05 2024-04-01T19:27:07.400 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.400 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.400 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:27:07.400 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.369777+0000", 2024-04-01T19:27:07.400 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.4590000000000001e-06 2024-04-01T19:27:07.400 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.400 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.400 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:27:07.400 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.377973+0000", 2024-04-01T19:27:07.400 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0081960739999999994 2024-04-01T19:27:07.400 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.400 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.400 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:27:07.400 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.378107+0000", 2024-04-01T19:27:07.401 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000134139 2024-04-01T19:27:07.401 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.401 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.401 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:07.401 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.378227+0000", 2024-04-01T19:27:07.401 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000119515 2024-04-01T19:27:07.401 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.401 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.401 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:27:07.401 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.393402+0000", 2024-04-01T19:27:07.401 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.015175296 2024-04-01T19:27:07.401 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.401 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.401 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:07.401 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.400837+0000", 2024-04-01T19:27:07.402 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0074348169999999998 2024-04-01T19:27:07.402 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.402 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.402 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:27:07.402 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.400896+0000", 2024-04-01T19:27:07.402 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.9747999999999998e-05 2024-04-01T19:27:07.402 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.402 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.402 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:27:07.402 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.400957+0000", 2024-04-01T19:27:07.402 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.0188e-05 2024-04-01T19:27:07.402 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.402 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:27:07.402 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.403 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.403 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.403 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:185352 2.8 2:1745b70b:::benchmark_data_smithi188_77607_object17948:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-04-01T19:27:07.403 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:51.374619+0000", 2024-04-01T19:27:07.403 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 15.919781814, 2024-04-01T19:27:07.403 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.034453704000000002, 2024-04-01T19:27:07.403 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:27:07.403 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:27:07.403 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:07.403 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:27:07.403 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:27:07.403 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:07.403 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 185352 2024-04-01T19:27:07.403 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.403 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:27:07.403 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.404 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:27:07.404 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.374619+0000", 2024-04-01T19:27:07.404 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.404 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.404 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.404 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:27:07.404 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.374619+0000", 2024-04-01T19:27:07.404 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.404 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.404 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.404 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:27:07.404 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.374620+0000", 2024-04-01T19:27:07.404 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.3699999999999999e-07 2024-04-01T19:27:07.404 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.404 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.404 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:27:07.405 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.374624+0000", 2024-04-01T19:27:07.405 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.4929999999999998e-06 2024-04-01T19:27:07.405 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.405 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.405 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:27:07.405 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.374632+0000", 2024-04-01T19:27:07.405 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.3499999999999997e-06 2024-04-01T19:27:07.405 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.405 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.405 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:27:07.405 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.374638+0000", 2024-04-01T19:27:07.405 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.9529999999999996e-06 2024-04-01T19:27:07.405 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.405 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.405 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:27:07.405 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.384908+0000", 2024-04-01T19:27:07.406 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.010269815999999999 2024-04-01T19:27:07.406 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.406 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.406 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:27:07.406 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.385010+0000", 2024-04-01T19:27:07.406 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000102054 2024-04-01T19:27:07.406 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.406 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.406 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:07.406 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.385079+0000", 2024-04-01T19:27:07.406 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8940000000000001e-05 2024-04-01T19:27:07.406 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.406 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.406 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:27:07.406 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.393416+0000", 2024-04-01T19:27:07.407 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0083374390000000003 2024-04-01T19:27:07.407 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.407 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.407 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:07.407 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.408988+0000", 2024-04-01T19:27:07.407 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.015571493 2024-04-01T19:27:07.407 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.407 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.407 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:27:07.407 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.409023+0000", 2024-04-01T19:27:07.407 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.5429999999999998e-05 2024-04-01T19:27:07.407 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.407 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.407 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:27:07.407 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.409073+0000", 2024-04-01T19:27:07.407 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9799000000000002e-05 2024-04-01T19:27:07.408 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.408 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:27:07.408 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.408 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.408 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.408 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:185360 2.8 2:17311ebd:::benchmark_data_smithi188_77607_object17956:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-04-01T19:27:07.408 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:51.381478+0000", 2024-04-01T19:27:07.408 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 15.912922934999999, 2024-04-01T19:27:07.408 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.033967342999999997, 2024-04-01T19:27:07.408 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:27:07.408 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:27:07.408 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:07.408 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:27:07.408 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:27:07.408 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:07.409 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 185360 2024-04-01T19:27:07.409 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.409 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:27:07.409 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.409 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:27:07.409 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.381478+0000", 2024-04-01T19:27:07.409 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.409 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.409 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.409 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:27:07.409 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.381478+0000", 2024-04-01T19:27:07.409 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.409 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.409 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.410 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:27:07.410 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.381479+0000", 2024-04-01T19:27:07.410 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2810000000000001e-06 2024-04-01T19:27:07.410 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.410 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.410 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:27:07.410 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.381484+0000", 2024-04-01T19:27:07.410 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7060000000000003e-06 2024-04-01T19:27:07.410 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.410 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.410 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:27:07.410 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.381492+0000", 2024-04-01T19:27:07.410 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.7319999999999998e-06 2024-04-01T19:27:07.410 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.411 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.411 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:27:07.411 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.381497+0000", 2024-04-01T19:27:07.411 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9899999999999997e-06 2024-04-01T19:27:07.411 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.411 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.411 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:27:07.411 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.391172+0000", 2024-04-01T19:27:07.411 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0096753519999999999 2024-04-01T19:27:07.411 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.411 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.411 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:27:07.411 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.391281+0000", 2024-04-01T19:27:07.411 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000108874 2024-04-01T19:27:07.411 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.411 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.412 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:07.412 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.391362+0000", 2024-04-01T19:27:07.412 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.1043000000000003e-05 2024-04-01T19:27:07.412 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.412 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.412 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:27:07.412 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.396692+0000", 2024-04-01T19:27:07.412 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0053302599999999999 2024-04-01T19:27:07.412 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.412 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.412 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:07.412 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.415377+0000", 2024-04-01T19:27:07.412 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.018684768000000001 2024-04-01T19:27:07.412 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.412 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.413 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:27:07.413 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.415408+0000", 2024-04-01T19:27:07.413 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.1433000000000002e-05 2024-04-01T19:27:07.413 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.413 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.413 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:27:07.413 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:51.415445+0000", 2024-04-01T19:27:07.413 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.6903999999999998e-05 2024-04-01T19:27:07.413 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.413 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:27:07.413 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.413 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.413 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.413 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:186608 2.0 2:0b57091c:::benchmark_data_smithi188_77607_object19204:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-04-01T19:27:07.413 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:52.407461+0000", 2024-04-01T19:27:07.414 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 14.886939411, 2024-04-01T19:27:07.414 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.050725640000000002, 2024-04-01T19:27:07.414 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:27:07.414 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:27:07.414 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:07.414 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:27:07.414 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:27:07.414 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:07.414 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 186608 2024-04-01T19:27:07.414 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.414 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:27:07.414 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.414 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:27:07.415 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407461+0000", 2024-04-01T19:27:07.415 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.415 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.415 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.415 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:27:07.415 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407461+0000", 2024-04-01T19:27:07.415 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.415 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.415 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.415 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:27:07.415 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407463+0000", 2024-04-01T19:27:07.415 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.207e-06 2024-04-01T19:27:07.415 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.415 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.415 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:27:07.415 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407467+0000", 2024-04-01T19:27:07.416 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.2030000000000002e-06 2024-04-01T19:27:07.416 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.416 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.416 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:27:07.416 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407474+0000", 2024-04-01T19:27:07.416 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.3159999999999999e-06 2024-04-01T19:27:07.416 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.416 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.416 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:27:07.416 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407479+0000", 2024-04-01T19:27:07.416 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2220000000000001e-06 2024-04-01T19:27:07.416 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.416 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.416 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:27:07.416 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.410428+0000", 2024-04-01T19:27:07.416 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0029484860000000002 2024-04-01T19:27:07.417 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.417 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.417 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:27:07.417 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.410493+0000", 2024-04-01T19:27:07.417 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.4925999999999995e-05 2024-04-01T19:27:07.417 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.417 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.417 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 10", 2024-04-01T19:27:07.417 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.410553+0000", 2024-04-01T19:27:07.417 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.0599e-05 2024-04-01T19:27:07.417 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.417 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.417 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:27:07.417 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.419683+0000", 2024-04-01T19:27:07.418 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0091298879999999992 2024-04-01T19:27:07.418 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.418 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.418 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:07.418 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.422096+0000", 2024-04-01T19:27:07.418 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0024130449999999999 2024-04-01T19:27:07.418 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.418 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.418 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:27:07.418 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.422135+0000", 2024-04-01T19:27:07.418 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8466000000000001e-05 2024-04-01T19:27:07.418 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.418 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.418 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:27:07.419 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458187+0000", 2024-04-01T19:27:07.419 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.036052281999999998 2024-04-01T19:27:07.419 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.419 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:27:07.419 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.419 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.419 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.419 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:186611 2.0 2:078ce2d5:::benchmark_data_smithi188_77607_object19207:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-04-01T19:27:07.419 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:52.407570+0000", 2024-04-01T19:27:07.419 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 14.886830935999999, 2024-04-01T19:27:07.419 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.050783633000000002, 2024-04-01T19:27:07.419 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:27:07.419 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:27:07.419 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:07.419 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:27:07.419 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:27:07.420 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:07.420 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 186611 2024-04-01T19:27:07.420 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.420 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:27:07.420 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.420 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:27:07.420 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407570+0000", 2024-04-01T19:27:07.420 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.420 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.420 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.420 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:27:07.420 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407570+0000", 2024-04-01T19:27:07.420 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.420 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.421 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.421 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:27:07.421 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407571+0000", 2024-04-01T19:27:07.421 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.8100000000000001e-07 2024-04-01T19:27:07.421 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.421 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.421 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:27:07.421 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407574+0000", 2024-04-01T19:27:07.421 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.6270000000000002e-06 2024-04-01T19:27:07.421 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.421 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.421 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:27:07.421 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407581+0000", 2024-04-01T19:27:07.421 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.319e-06 2024-04-01T19:27:07.421 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.421 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.422 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:27:07.422 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407585+0000", 2024-04-01T19:27:07.422 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.1069999999999998e-06 2024-04-01T19:27:07.422 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.422 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.422 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:27:07.422 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.413627+0000", 2024-04-01T19:27:07.422 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0060416410000000004 2024-04-01T19:27:07.422 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.422 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.422 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:27:07.422 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.413716+0000", 2024-04-01T19:27:07.422 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.9766999999999996e-05 2024-04-01T19:27:07.423 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.423 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.423 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 10", 2024-04-01T19:27:07.423 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.413824+0000", 2024-04-01T19:27:07.423 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000108083 2024-04-01T19:27:07.423 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.423 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.423 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:27:07.423 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.419696+0000", 2024-04-01T19:27:07.423 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0058718659999999999 2024-04-01T19:27:07.423 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.423 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.423 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:07.423 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458253+0000", 2024-04-01T19:27:07.423 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.038557033999999997 2024-04-01T19:27:07.423 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.424 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.424 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:27:07.424 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458311+0000", 2024-04-01T19:27:07.424 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7343000000000003e-05 2024-04-01T19:27:07.424 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.424 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.424 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:27:07.424 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458354+0000", 2024-04-01T19:27:07.424 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.2964999999999999e-05 2024-04-01T19:27:07.424 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.424 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:27:07.424 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.424 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.424 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.424 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:186612 2.8 2:1889545c:::benchmark_data_smithi188_77607_object19208:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-04-01T19:27:07.424 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:52.407666+0000", 2024-04-01T19:27:07.425 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 14.886734979, 2024-04-01T19:27:07.425 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.050818611, 2024-04-01T19:27:07.425 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:27:07.425 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:27:07.425 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:07.425 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:27:07.425 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:27:07.425 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:07.425 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 186612 2024-04-01T19:27:07.425 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.425 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:27:07.425 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.425 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:27:07.425 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407666+0000", 2024-04-01T19:27:07.425 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.425 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.426 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.426 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:27:07.426 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407666+0000", 2024-04-01T19:27:07.426 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.426 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.426 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.426 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:27:07.426 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407666+0000", 2024-04-01T19:27:07.426 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6100000000000001e-07 2024-04-01T19:27:07.426 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.426 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.426 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:27:07.426 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407669+0000", 2024-04-01T19:27:07.426 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.4609999999999998e-06 2024-04-01T19:27:07.426 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.427 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.427 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:27:07.427 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407673+0000", 2024-04-01T19:27:07.427 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.6200000000000001e-06 2024-04-01T19:27:07.427 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.427 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.427 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:27:07.427 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407676+0000", 2024-04-01T19:27:07.427 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.1829999999999998e-06 2024-04-01T19:27:07.427 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.427 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.427 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:27:07.427 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.413621+0000", 2024-04-01T19:27:07.427 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.005945405 2024-04-01T19:27:07.427 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.428 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.428 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:27:07.428 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.413710+0000", 2024-04-01T19:27:07.428 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.9265000000000007e-05 2024-04-01T19:27:07.428 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.428 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.428 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:07.428 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.413824+0000", 2024-04-01T19:27:07.428 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00011393 2024-04-01T19:27:07.428 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.428 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.428 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:27:07.428 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.419692+0000", 2024-04-01T19:27:07.428 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0058677219999999997 2024-04-01T19:27:07.429 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.429 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.429 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:07.429 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458399+0000", 2024-04-01T19:27:07.429 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.038707273 2024-04-01T19:27:07.429 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.429 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.429 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:27:07.429 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458448+0000", 2024-04-01T19:27:07.429 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8229000000000002e-05 2024-04-01T19:27:07.429 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.429 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.429 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:27:07.429 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458485+0000", 2024-04-01T19:27:07.429 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.6962000000000003e-05 2024-04-01T19:27:07.430 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.430 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:27:07.430 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.430 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.430 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.430 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:186613 2.0 2:04a34076:::benchmark_data_smithi188_77607_object19209:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-04-01T19:27:07.430 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:52.410598+0000", 2024-04-01T19:27:07.430 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 14.883802490000001, 2024-04-01T19:27:07.430 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.047997257000000002, 2024-04-01T19:27:07.430 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:27:07.430 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:27:07.430 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:07.430 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:27:07.430 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:27:07.431 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:07.431 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 186613 2024-04-01T19:27:07.431 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.431 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:27:07.431 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.431 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:27:07.431 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.410598+0000", 2024-04-01T19:27:07.431 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.431 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.431 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.431 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:27:07.431 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.410598+0000", 2024-04-01T19:27:07.431 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.431 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.431 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.431 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:27:07.432 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.410600+0000", 2024-04-01T19:27:07.432 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4160000000000001e-06 2024-04-01T19:27:07.432 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.432 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.432 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:27:07.432 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.410605+0000", 2024-04-01T19:27:07.432 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2249999999999999e-06 2024-04-01T19:27:07.432 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.432 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.432 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:27:07.432 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.410614+0000", 2024-04-01T19:27:07.432 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1800000000000002e-06 2024-04-01T19:27:07.432 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.432 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.432 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:27:07.433 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.410624+0000", 2024-04-01T19:27:07.433 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.7270000000000002e-06 2024-04-01T19:27:07.433 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.433 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.433 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:27:07.433 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.416723+0000", 2024-04-01T19:27:07.433 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0060989759999999999 2024-04-01T19:27:07.433 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.433 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.433 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:27:07.433 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.416844+0000", 2024-04-01T19:27:07.433 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000121107 2024-04-01T19:27:07.433 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.433 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.433 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 10", 2024-04-01T19:27:07.433 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.416919+0000", 2024-04-01T19:27:07.434 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.5060000000000003e-05 2024-04-01T19:27:07.434 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.434 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.434 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:27:07.434 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.419832+0000", 2024-04-01T19:27:07.434 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0029129640000000001 2024-04-01T19:27:07.434 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.434 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.434 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:07.434 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458508+0000", 2024-04-01T19:27:07.434 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.038675543999999999 2024-04-01T19:27:07.434 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.434 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.434 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:27:07.434 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458557+0000", 2024-04-01T19:27:07.435 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9132999999999999e-05 2024-04-01T19:27:07.435 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.435 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.435 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:27:07.435 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458596+0000", 2024-04-01T19:27:07.435 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8924999999999997e-05 2024-04-01T19:27:07.435 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.435 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:27:07.435 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.435 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.435 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.435 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop_reply(client.24751.0:186608 2.0 e144/106 ondisk, result = 0)", 2024-04-01T19:27:07.435 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:52.421933+0000", 2024-04-01T19:27:07.435 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 14.872468093, 2024-04-01T19:27:07.435 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.036267951, 2024-04-01T19:27:07.435 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:27:07.436 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:27:07.436 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "started", 2024-04-01T19:27:07.436 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:27:07.436 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.436 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:27:07.436 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.421933+0000", 2024-04-01T19:27:07.436 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.436 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.436 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.436 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:27:07.436 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.421933+0000", 2024-04-01T19:27:07.436 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.436 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.436 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.436 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:27:07.436 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.421935+0000", 2024-04-01T19:27:07.437 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.734e-06 2024-04-01T19:27:07.437 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.437 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.437 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:27:07.437 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.421942+0000", 2024-04-01T19:27:07.437 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.5059999999999998e-06 2024-04-01T19:27:07.437 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.437 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.437 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:27:07.437 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.421956+0000", 2024-04-01T19:27:07.437 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3477e-05 2024-04-01T19:27:07.437 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.437 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.437 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:27:07.437 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.421964+0000", 2024-04-01T19:27:07.438 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.9630000000000004e-06 2024-04-01T19:27:07.438 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.438 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.438 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:27:07.438 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.422084+0000", 2024-04-01T19:27:07.438 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000119156 2024-04-01T19:27:07.438 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.438 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.438 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:27:07.438 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.422093+0000", 2024-04-01T19:27:07.438 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.397e-06 2024-04-01T19:27:07.438 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.438 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.438 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:27:07.439 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458201+0000", 2024-04-01T19:27:07.439 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.036107717999999997 2024-04-01T19:27:07.439 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.439 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:27:07.439 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.439 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.439 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.439 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop_reply(client.24751.0:186611 2.0 e144/106 ondisk, result = 0)", 2024-04-01T19:27:07.439 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:52.421990+0000", 2024-04-01T19:27:07.439 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 14.872411344, 2024-04-01T19:27:07.439 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.036370690999999997, 2024-04-01T19:27:07.439 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:27:07.439 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:27:07.439 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "started", 2024-04-01T19:27:07.439 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:27:07.439 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.440 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:27:07.440 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.421990+0000", 2024-04-01T19:27:07.440 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.440 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.440 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.440 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:27:07.440 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.421990+0000", 2024-04-01T19:27:07.440 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.440 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.440 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.440 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:27:07.440 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.421990+0000", 2024-04-01T19:27:07.440 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.9400000000000004e-07 2024-04-01T19:27:07.440 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.440 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.440 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:27:07.441 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.421994+0000", 2024-04-01T19:27:07.441 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.58e-06 2024-04-01T19:27:07.441 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.441 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.441 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:27:07.441 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.422002+0000", 2024-04-01T19:27:07.441 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0800000000000006e-06 2024-04-01T19:27:07.441 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.441 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.441 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:27:07.441 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.422009+0000", 2024-04-01T19:27:07.441 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5629999999999997e-06 2024-04-01T19:27:07.441 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.441 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.441 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:27:07.441 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458238+0000", 2024-04-01T19:27:07.442 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.036229113 2024-04-01T19:27:07.442 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.442 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.442 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:27:07.442 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458247+0000", 2024-04-01T19:27:07.442 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.0089999999999996e-06 2024-04-01T19:27:07.442 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.442 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.442 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:27:07.442 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458360+0000", 2024-04-01T19:27:07.442 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000113452 2024-04-01T19:27:07.442 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.442 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:27:07.442 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.442 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.443 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.443 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop_reply(client.24751.0:186613 2.0 e144/106 ondisk, result = 0)", 2024-04-01T19:27:07.443 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:52.422073+0000", 2024-04-01T19:27:07.443 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 14.872327635, 2024-04-01T19:27:07.443 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.036527965000000003, 2024-04-01T19:27:07.443 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:27:07.443 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:27:07.443 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "started", 2024-04-01T19:27:07.443 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:27:07.443 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.443 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:27:07.443 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.422073+0000", 2024-04-01T19:27:07.443 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.443 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.443 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.444 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:27:07.444 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.422073+0000", 2024-04-01T19:27:07.444 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.444 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.444 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.444 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:27:07.444 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.422074+0000", 2024-04-01T19:27:07.444 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.46e-07 2024-04-01T19:27:07.444 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.444 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.444 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:27:07.444 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.422075+0000", 2024-04-01T19:27:07.444 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8530000000000001e-06 2024-04-01T19:27:07.444 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.444 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.444 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:27:07.444 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.422079+0000", 2024-04-01T19:27:07.445 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.456e-06 2024-04-01T19:27:07.445 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.445 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.445 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:27:07.445 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.422083+0000", 2024-04-01T19:27:07.445 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3250000000000001e-06 2024-04-01T19:27:07.445 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.445 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.445 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:27:07.445 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458495+0000", 2024-04-01T19:27:07.445 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.036411342999999999 2024-04-01T19:27:07.445 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.445 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.445 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:27:07.445 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458502+0000", 2024-04-01T19:27:07.445 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.4370000000000001e-06 2024-04-01T19:27:07.446 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.446 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.446 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:27:07.446 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458601+0000", 2024-04-01T19:27:07.446 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.9204999999999996e-05 2024-04-01T19:27:07.446 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.446 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:27:07.446 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.446 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.446 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.446 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop_reply(client.24751.0:186612 2.8 e144/106 ondisk, result = 0)", 2024-04-01T19:27:07.446 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:52.422118+0000", 2024-04-01T19:27:07.446 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 14.872282893, 2024-04-01T19:27:07.446 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.036372293999999999, 2024-04-01T19:27:07.446 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:27:07.447 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:27:07.447 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "started", 2024-04-01T19:27:07.447 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:27:07.447 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.447 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:27:07.447 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.422118+0000", 2024-04-01T19:27:07.447 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.447 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.447 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.447 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:27:07.447 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.422118+0000", 2024-04-01T19:27:07.447 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.447 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.447 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.447 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:27:07.448 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.422119+0000", 2024-04-01T19:27:07.448 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.0999999999999998e-07 2024-04-01T19:27:07.448 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.448 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.448 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:27:07.448 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.422121+0000", 2024-04-01T19:27:07.448 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.4940000000000002e-06 2024-04-01T19:27:07.448 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.448 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.448 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:27:07.448 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.422125+0000", 2024-04-01T19:27:07.448 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3420000000000001e-06 2024-04-01T19:27:07.448 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.448 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.449 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:27:07.449 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.422128+0000", 2024-04-01T19:27:07.449 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.9160000000000001e-06 2024-04-01T19:27:07.449 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.449 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.449 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:27:07.449 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458386+0000", 2024-04-01T19:27:07.449 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.036257946999999999 2024-04-01T19:27:07.449 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.449 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.449 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:27:07.449 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458394+0000", 2024-04-01T19:27:07.449 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.5680000000000002e-06 2024-04-01T19:27:07.449 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.449 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.449 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:27:07.450 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458490+0000", 2024-04-01T19:27:07.450 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.6416999999999995e-05 2024-04-01T19:27:07.450 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.450 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:27:07.450 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.450 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.450 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.450 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:186641 2.8 2:1f25a915:::benchmark_data_smithi188_77607_object19237:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-04-01T19:27:07.450 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:52.436274+0000", 2024-04-01T19:27:07.450 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 14.858127057000001, 2024-04-01T19:27:07.450 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.030961836, 2024-04-01T19:27:07.450 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:27:07.450 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:27:07.450 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:07.451 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:27:07.451 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:27:07.451 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:07.451 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 186641 2024-04-01T19:27:07.451 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.451 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:27:07.451 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.451 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:27:07.451 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.436274+0000", 2024-04-01T19:27:07.451 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.451 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.451 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.451 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:27:07.451 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.436274+0000", 2024-04-01T19:27:07.451 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.452 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.452 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.452 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:27:07.452 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.436276+0000", 2024-04-01T19:27:07.452 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.933e-06 2024-04-01T19:27:07.452 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.452 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.452 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:27:07.452 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.436282+0000", 2024-04-01T19:27:07.452 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5400000000000001e-06 2024-04-01T19:27:07.452 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.452 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.452 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:27:07.452 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458143+0000", 2024-04-01T19:27:07.452 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.021860739000000001 2024-04-01T19:27:07.452 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.453 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.453 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:27:07.453 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458160+0000", 2024-04-01T19:27:07.453 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.6928000000000001e-05 2024-04-01T19:27:07.453 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.453 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.453 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:27:07.453 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458518+0000", 2024-04-01T19:27:07.453 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00035775200000000003 2024-04-01T19:27:07.453 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.453 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.453 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:27:07.453 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458607+0000", 2024-04-01T19:27:07.453 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.9501999999999998e-05 2024-04-01T19:27:07.453 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.453 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.454 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:07.454 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458679+0000", 2024-04-01T19:27:07.454 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1625000000000006e-05 2024-04-01T19:27:07.454 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.454 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.454 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:07.454 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.467120+0000", 2024-04-01T19:27:07.454 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0084414690000000001 2024-04-01T19:27:07.454 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.454 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.454 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:27:07.454 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.467137+0000", 2024-04-01T19:27:07.454 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.6969e-05 2024-04-01T19:27:07.454 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.455 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.455 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:27:07.455 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.467190+0000", 2024-04-01T19:27:07.455 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2466000000000002e-05 2024-04-01T19:27:07.455 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.455 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.455 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:27:07.455 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.467236+0000", 2024-04-01T19:27:07.455 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.5912999999999999e-05 2024-04-01T19:27:07.455 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.455 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:27:07.455 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.455 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.455 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.455 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:204350 2.8 2:1c7c88a8:::benchmark_data_smithi188_77607_object36946:head [delete] snapc 0=[] ondisk+write+known_if_redirected e150)", 2024-04-01T19:27:07.455 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:27:07.198484+0000", 2024-04-01T19:27:07.456 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.095916629000000003, 2024-04-01T19:27:07.456 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.035498882000000002, 2024-04-01T19:27:07.456 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:27:07.456 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:27:07.456 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:07.456 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:27:07.456 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:27:07.456 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:07.456 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 204350 2024-04-01T19:27:07.456 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.456 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:27:07.456 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.456 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:27:07.456 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:27:07.198484+0000", 2024-04-01T19:27:07.456 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.456 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.456 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.457 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:27:07.457 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:27:07.198484+0000", 2024-04-01T19:27:07.457 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:27:07.457 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.457 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.457 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:27:07.457 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:27:07.198485+0000", 2024-04-01T19:27:07.457 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.2800000000000005e-07 2024-04-01T19:27:07.457 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.457 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.457 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:27:07.457 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:27:07.198489+0000", 2024-04-01T19:27:07.457 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.7100000000000001e-06 2024-04-01T19:27:07.457 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.457 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.457 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:27:07.458 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:27:07.198497+0000", 2024-04-01T19:27:07.458 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.8669999999999994e-06 2024-04-01T19:27:07.458 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.458 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.458 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:27:07.458 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:27:07.198503+0000", 2024-04-01T19:27:07.458 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.7190000000000004e-06 2024-04-01T19:27:07.458 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.458 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.458 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:27:07.458 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:27:07.199287+0000", 2024-04-01T19:27:07.458 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00078388299999999998 2024-04-01T19:27:07.458 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.458 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.459 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:27:07.459 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:27:07.199412+0000", 2024-04-01T19:27:07.459 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012415899999999999 2024-04-01T19:27:07.459 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.459 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.459 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:07.459 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:27:07.199529+0000", 2024-04-01T19:27:07.459 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00011786900000000001 2024-04-01T19:27:07.459 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.459 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.459 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:27:07.459 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:27:07.203527+0000", 2024-04-01T19:27:07.459 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0039976810000000003 2024-04-01T19:27:07.459 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.459 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.460 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:07.460 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:27:07.233909+0000", 2024-04-01T19:27:07.460 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.030382378000000002 2024-04-01T19:27:07.460 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.460 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.460 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:27:07.460 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:27:07.233949+0000", 2024-04-01T19:27:07.460 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9743000000000002e-05 2024-04-01T19:27:07.460 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:27:07.460 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:27:07.460 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:27:07.460 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:27:07.233983+0000", 2024-04-01T19:27:07.460 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.3945000000000001e-05 2024-04-01T19:27:07.460 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.460 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:27:07.460 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.460 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:27:07.461 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:27:07.461 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:27:07.461 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:27:07.462 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:07 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:27:07.462 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:07 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:27:07.462 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:07 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:27:07.462 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:07 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:27:07.462 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:07 smithi188 ceph-mon[43939]: from='client.34895 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:27:07.462 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:07 smithi188 ceph-mon[43939]: from='client.34901 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]': finished 2024-04-01T19:27:07.462 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:07 smithi188 ceph-mon[43939]: osdmap e150: 12 total, 12 up, 12 in 2024-04-01T19:27:07.462 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:07 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:27:07.539 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:07.978 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:27:07.983 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:07.983 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:27:08.046 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_ops_in_flight 2024-04-01T19:27:08.084 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:27:08.126 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:08.158 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:27:08.164 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:08.164 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:27:08.265 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:27:08.299 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:08.324 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:27:08.328 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:08.329 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:27:08.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:08 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:08.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:08 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:08.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:08 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:08.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:08 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:08.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:08 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:08.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:08 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:08.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:08 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:27:08.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:08 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:27:08.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:08 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:27:08.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:08 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:08.416 INFO:tasks.thrashosds.thrasher:test_map_discontinuity 2024-04-01T19:27:08.416 INFO:tasks.thrashosds.thrasher:Waiting for recovery 2024-04-01T19:27:08.417 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-01T19:27:08.417 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-04-01T19:27:08.420 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:27:08.429 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:27:08.518 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:08.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:08 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:08.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:08 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:08.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:08 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:08.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:08 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:08.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:08 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:08.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:08 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:08.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:08 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:27:08.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:08 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:27:08.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:08 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:27:08.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:08 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:08.684 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:27:08.687 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:08.687 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:27:08.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:08 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:08.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:08 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:08.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:08 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:08.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:08 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:08.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:08 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:08.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:08 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:08.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:08 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:27:08.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:08 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:27:08.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:08 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:27:08.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:08 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:08.788 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:27:08.836 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:09.001 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:27:09.005 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:09.006 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:27:09.062 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:27:09.081 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:27:09.098 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:27:09.107 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:27:09.127 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:27:09.160 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:27:09.161 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:09.194 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:27:09.237 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:27:09.273 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:27:09.301 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:27:09.344 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:27:09.389 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:27:09.430 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:27:09.436 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:27:09.440 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:09.440 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:27:09.480 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:27:09.484 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:27:09.484 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:27:09.484 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:27:09.484 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:27:09.484 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:27:09.484 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:27:09.484 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:27:09.484 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:27:09.484 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:27:09.484 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:27:09.484 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:27:09.485 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:27:09.541 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:27:09.591 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:09 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:27:09.591 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:09 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:27:09.591 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:09 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:09.591 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:09 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:27:09.591 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:09 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:27:09.591 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:09 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:27:09.591 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:09 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:09.591 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:09 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/923024617' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:27:09.601 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:09.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:09 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:27:09.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:09 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:27:09.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:09 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:09.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:09 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:27:09.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:09 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:27:09.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:09 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:27:09.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:09 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:09.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:09 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/923024617' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:27:09.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:09 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:27:09.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:09 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:27:09.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:09 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:09.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:09 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:27:09.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:09 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:27:09.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:09 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:27:09.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:09 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:27:09.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:09 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/923024617' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:27:09.764 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:27:09.767 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:09.767 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:27:09.868 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:27:09.940 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:10.021 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:27:10.177 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:27:10.180 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:10.181 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:27:10.281 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:27:10.314 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:10.335 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:27:10.341 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:10.341 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:27:10.442 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:27:10.487 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:10.570 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:27:10.575 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:10.576 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:27:10.576 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:10 smithi188 ceph-mon[43939]: pgmap v459: 17 pgs: 17 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:27:10.576 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.576 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.576 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.577 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.577 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.577 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.577 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.577 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.577 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.577 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.577 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.577 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:10 smithi022 ceph-mon[39439]: pgmap v459: 17 pgs: 17 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:27:10.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.655 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:27:10.655 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:27:10.677 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:27:10.706 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:10 smithi062 ceph-mon[44211]: pgmap v459: 17 pgs: 17 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:27:10.706 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.706 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.706 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.706 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.706 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.706 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.706 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.707 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.707 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.707 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.707 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.707 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:10.708 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:10.731 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:27:10.733 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:10.734 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:27:10.835 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:27:10.868 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:10.973 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:27:10.977 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:10.978 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:27:11.078 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:27:11.109 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:11.131 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:27:11.134 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:11.135 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:27:11.235 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:27:11.281 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:11.595 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_blocked_ops 2024-04-01T19:27:11.636 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:27:11.643 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:11.643 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:27:11.744 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:27:11.757 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:27:11.773 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:11.798 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:27:11.800 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:11.800 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:27:11.901 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:27:11.947 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:11.984 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:27:11.984 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:27:11.988 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:11.988 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:27:12.052 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:27:12.052 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":150,"fsid":"09f6b846-f05c-11ee-b647-cb9ed24678a4","created":"2024-04-01T19:15:34.344221+0000","modified":"2024-04-01T19:27:06.065683+0000","last_up_change":"2024-04-01T19:22:53.958497+0000","last_in_change":"2024-04-01T19:22:35.912273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T19:18:34.605751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"unique_pool_0","create_time":"2024-04-01T19:24:50.196885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfd4aa7e-a933-42e2-aac8-f93a3d9fcc3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":1419201649}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":1419201649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":1419201649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":1419201649}]},"public_addr":"172.21.15.22:6801/1419201649","cluster_addr":"172.21.15.22:6802/1419201649","heartbeat_back_addr":"172.21.15.22:6804/1419201649","heartbeat_front_addr":"172.21.15.22:6803/1419201649","state":["exists","up"]},{"osd":1,"uuid":"6ddadf19-2b4e-4c01-8918-9d51c323925b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":2579227110}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":2579227110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6808","nonce":2579227110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":2579227110}]},"public_addr":"172.21.15.22:6805/2579227110","cluster_addr":"172.21.15.22:6806/2579227110","heartbeat_back_addr":"172.21.15.22:6808/2579227110","heartbeat_front_addr":"172.21.15.22:6807/2579227110","state":["exists","up"]},{"osd":2,"uuid":"4af1f44c-f47c-4ce6-87ba-1aeec3960969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":835455757}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":835455757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":835455757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":835455757}]},"public_addr":"172.21.15.22:6809/835455757","cluster_addr":"172.21.15.22:6810/835455757","heartbeat_back_addr":"172.21.15.22:6812/835455757","heartbeat_front_addr":"172.21.15.22:6811/835455757","state":["exists","up"]},{"osd":3,"uuid":"c399f336-23c7-414a-822e-63793daf85c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":90988887}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":90988887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":90988887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":90988887}]},"public_addr":"172.21.15.22:6813/90988887","cluster_addr":"172.21.15.22:6814/90988887","heartbeat_back_addr":"172.21.15.22:6816/90988887","heartbeat_front_addr":"172.21.15.22:6815/90988887","state":["exists","up"]},{"osd":4,"uuid":"0a2690dc-e5b6-4d29-b517-980018519d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6800","nonce":2408168690}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6801","nonce":2408168690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6803","nonce":2408168690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6802","nonce":2408168690}]},"public_addr":"172.21.15.62:6800/2408168690","cluster_addr":"172.21.15.62:6801/2408168690","heartbeat_back_addr":"172.21.15.62:6803/2408168690","heartbeat_front_addr":"172.21.15.62:6802/2408168690","state":["exists","up"]},{"osd":5,"uuid":"c6830412-959a-4f1e-8c3d-f4b2d88673e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6804","nonce":386874616}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6805","nonce":386874616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6807","nonce":386874616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6806","nonce":386874616}]},"public_addr":"172.21.15.62:6804/386874616","cluster_addr":"172.21.15.62:6805/386874616","heartbeat_back_addr":"172.21.15.62:6807/386874616","heartbeat_front_addr":"172.21.15.62:6806/386874616","state":["exists","up"]},{"osd":6,"uuid":"f646310b-91a4-4259-a51f-6a0e92b7cba8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6808","nonce":90097362}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6809","nonce":90097362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6811","nonce":90097362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6810","nonce":90097362}]},"public_addr":"172.21.15.62:6808/90097362","cluster_addr":"172.21.15.62:6809/90097362","heartbeat_back_addr":"172.21.15.62:6811/90097362","heartbeat_front_addr":"172.21.15.62:6810/90097362","state":["exists","up"]},{"osd":7,"uuid":"afe5f371-c892-43e9-b82e-c2d911354e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6812","nonce":2055487337}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6813","nonce":2055487337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6815","nonce":2055487337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6814","nonce":2055487337}]},"public_addr":"172.21.15.62:6812/2055487337","cluster_addr":"172.21.15.62:6813/2055487337","heartbeat_back_addr":"172.21.15.62:6815/2055487337","heartbeat_front_addr":"172.21.15.62:6814/2055487337","state":["exists","up"]},{"osd":8,"uuid":"b7eb6461-f6fa-4a12-864c-6e6748e6337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6800","nonce":2108324328}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6801","nonce":2108324328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6803","nonce":2108324328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6802","nonce":2108324328}]},"public_addr":"172.21.15.188:6800/2108324328","cluster_addr":"172.21.15.188:6801/2108324328","heartbeat_back_addr":"172.21.15.188:6803/2108324328","heartbeat_front_addr":"172.21.15.188:6802/2108324328","state":["exists","up"]},{"osd":9,"uuid":"7d496ad5-46bf-485a-81d9-2b9da2a59882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6804","nonce":1755990887}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6805","nonce":1755990887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6807","nonce":1755990887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6806","nonce":1755990887}]},"public_addr":"172.21.15.188:6804/1755990887","cluster_addr":"172.21.15.188:6805/1755990887","heartbeat_back_addr":"172.21.15.188:6807/1755990887","heartbeat_front_addr":"172.21.15.188:6806/1755990887","state":["exists","up"]},{"osd":10,"uuid":"6cbb80ce-37f7-48df-9090-09a6068e4490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6808","nonce":3777340429}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6809","nonce":3777340429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6811","nonce":3777340429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6810","nonce":3777340429}]},"public_addr":"172.21.15.188:6808/3777340429","cluster_addr":"172.21.15.188:6809/3777340429","heartbeat_back_addr":"172.21.15.188:6811/3777340429","heartbeat_front_addr":"172.21.15.188:6810/3777340429","state":["exists","up"]},{"osd":11,"uuid":"c03517c4-fdb0-4587-96c1-b959041c4344","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6812","nonce":3987199514}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6813","nonce":3987199514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6815","nonce":3987199514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6814","nonce":3987199514}]},"public_addr":"172.21.15.188:6812/3987199514","cluster_addr":"172.21.15.188:6813/3987199514","heartbeat_back_addr":"172.21.15.188:6815/3987199514","heartbeat_front_addr":"172.21.15.188:6814/3987199514","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:27:04.530736+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:26:55.391648+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:25:54.609256+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:26:47.534725+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:26:23.649044+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:26:04.647716+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:26:39.775512+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:26:39.884033+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:26:08.046113+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:27:05.826970+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:26:46.198320+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:26:46.606778+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/3735983556":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/3575578250":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/2493529775":"2024-04-02T19:16:02.302343+0000","172.21.15.22:6800/2678666836":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/2389537847":"2024-04-02T19:16:02.302343+0000","172.21.15.22:0/798807675":"2024-04-02T19:16:02.302343+0000","172.21.15.22:6800/1090179981":"2024-04-02T19:16:02.302343+0000","172.21.15.22:0/51907384":"2024-04-02T19:16:30.513384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T19:27:12.089 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:27:12.141 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:12.300 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:27:12.305 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:12.305 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:27:12.406 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:27:12.435 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:12.459 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:27:12.464 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:12.465 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:27:12.566 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:27:12.595 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:12 smithi062 ceph-mon[44211]: pgmap v460: 17 pgs: 17 active+clean; 7.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:27:12.595 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:12 smithi062 ceph-mon[44211]: 2.f scrub starts 2024-04-01T19:27:12.595 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:12 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3594750828' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T19:27:12.596 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:12.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:12 smithi022 ceph-mon[39439]: pgmap v460: 17 pgs: 17 active+clean; 7.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:27:12.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:12 smithi022 ceph-mon[39439]: 2.f scrub starts 2024-04-01T19:27:12.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:12 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3594750828' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T19:27:12.617 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:27:12.620 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:12.620 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:27:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:12 smithi188 ceph-mon[43939]: pgmap v460: 17 pgs: 17 active+clean; 7.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:27:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:12 smithi188 ceph-mon[43939]: 2.f scrub starts 2024-04-01T19:27:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:12 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3594750828' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T19:27:12.721 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:27:12.773 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:12.883 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:27:12.889 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:12.890 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:27:12.991 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:27:13.037 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:13.124 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:27:13.199 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:27:13.209 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:13.209 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:27:13.310 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:27:13.340 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:13.363 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:27:13.367 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:13.367 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:27:13.468 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:27:13.498 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:13.518 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:27:13.521 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:13.521 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:27:13.622 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:27:13.652 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:13.673 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:27:13.676 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:13.676 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:27:13.777 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:27:13.800 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-01T19:27:13.820 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:13.984 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:27:13.993 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:13.994 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:27:14.094 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:27:14.140 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:14.272 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:27:14.275 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:14.276 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:27:14.314 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:27:14.314 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:27:14.363 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:27:14.377 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:27:14.406 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:14.427 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:27:14.429 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:14.430 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:27:14.531 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:27:14.560 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:14.584 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:27:14.586 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:14.587 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:27:14.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:14 smithi022 ceph-mon[39439]: pgmap v461: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:27:14.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:14 smithi022 ceph-mon[39439]: 2.f scrub ok 2024-04-01T19:27:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:14 smithi188 ceph-mon[43939]: pgmap v461: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:27:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:14 smithi188 ceph-mon[43939]: 2.f scrub ok 2024-04-01T19:27:14.687 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:27:14.715 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:14 smithi062 ceph-mon[44211]: pgmap v461: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:27:14.715 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:14 smithi062 ceph-mon[44211]: 2.f scrub ok 2024-04-01T19:27:14.717 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:14.740 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:27:14.743 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:14.743 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:27:14.844 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:27:14.874 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:14.897 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:27:14.900 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:14.900 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:27:15.001 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:27:15.031 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:15.056 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_historic_ops 2024-04-01T19:27:15.056 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:27:15.063 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:15.064 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:27:15.165 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:27:15.223 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:15.261 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:27:15.269 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:15.269 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:27:15.362 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:15 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2114968038' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:27:15.362 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:15 smithi062 ceph-mon[44211]: from='client.34916 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:27:15.370 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:27:15.371 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:27:15.418 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:15.452 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:27:15.460 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:15.460 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:27:15.495 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:27:15.561 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:27:15.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:15 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2114968038' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:27:15.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:15 smithi022 ceph-mon[39439]: from='client.34916 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:27:15.616 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:15.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:15 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2114968038' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:27:15.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:15 smithi188 ceph-mon[43939]: from='client.34916 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:27:15.652 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:27:15.655 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:15.656 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:27:15.756 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:27:15.784 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:15.805 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:27:15.808 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:15.808 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:27:15.909 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:27:15.941 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:15.967 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:27:15.971 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:15.972 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:27:16.073 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:27:16.126 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:16.394 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:27:16.396 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:16.396 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:27:16.498 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:27:16.543 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:16.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:16 smithi022 ceph-mon[39439]: pgmap v462: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:27:16.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:16 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:27:16.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:16 smithi022 ceph-mon[39439]: from='client.34916 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:27:16.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:16 smithi022 ceph-mon[39439]: osdmap e151: 12 total, 12 up, 12 in 2024-04-01T19:27:16.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:16 smithi188 ceph-mon[43939]: pgmap v462: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:27:16.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:16 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:27:16.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:16 smithi188 ceph-mon[43939]: from='client.34916 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:27:16.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:16 smithi188 ceph-mon[43939]: osdmap e151: 12 total, 12 up, 12 in 2024-04-01T19:27:16.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:16 smithi062 ceph-mon[44211]: pgmap v462: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:27:16.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:16 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:27:16.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:16 smithi062 ceph-mon[44211]: from='client.34916 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:27:16.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:16 smithi062 ceph-mon[44211]: osdmap e151: 12 total, 12 up, 12 in 2024-04-01T19:27:16.940 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:27:16.973 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:27:17.008 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:27:17.012 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:27:17.017 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:17.017 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:27:17.047 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:27:17.083 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:27:17.118 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:27:17.119 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:27:17.141 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:27:17.168 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:17.183 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:27:17.212 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:27:17.250 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:27:17.276 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:27:17.316 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:27:17.317 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:27:17.318 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:27:17.318 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:27:17.318 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:27:17.318 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:27:17.318 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:27:17.318 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:27:17.318 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:27:17.318 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:27:17.318 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:27:17.318 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:27:17.318 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:27:17.369 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:17 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/676996404' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:27:17.369 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:17.370 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:17.370 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:17.377 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:27:17.383 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:17.384 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:27:17.485 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:27:17.513 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:17.535 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:27:17.539 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:17.540 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:27:17.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:17 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/676996404' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:27:17.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:17.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:17.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:17.640 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:27:17.667 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:17 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/676996404' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:27:17.667 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:17.667 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:17.667 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:17.669 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:17.689 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:27:17.691 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:17.691 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:27:17.735 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:27:17.736 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:27:17.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:27:17.736 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:27:17.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.736 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:167455 2.f 2:f85107a3:::benchmark_data_smithi188_77607_object51:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:27:17.736 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:26:35.723780+0000", 2024-04-01T19:27:17.736 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 42.009553150000002, 2024-04-01T19:27:17.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.101809963, 2024-04-01T19:27:17.736 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:17.736 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:17.736 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:17.736 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:17.736 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:17.736 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:17.737 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 167455 2024-04-01T19:27:17.737 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.737 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:17.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.737 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:17.737 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:35.723780+0000", 2024-04-01T19:27:17.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.737 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.737 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:17.737 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:35.723780+0000", 2024-04-01T19:27:17.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.737 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.737 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:17.738 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:35.723781+0000", 2024-04-01T19:27:17.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3170000000000001e-06 2024-04-01T19:27:17.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.738 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:17.738 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:35.723786+0000", 2024-04-01T19:27:17.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5449999999999997e-06 2024-04-01T19:27:17.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.738 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:17.738 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:35.723795+0000", 2024-04-01T19:27:17.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0580000000000004e-06 2024-04-01T19:27:17.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:17.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:35.723803+0000", 2024-04-01T19:27:17.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9349999999999994e-06 2024-04-01T19:27:17.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:17.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:35.810234+0000", 2024-04-01T19:27:17.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.086431847000000006 2024-04-01T19:27:17.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:17.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:35.810362+0000", 2024-04-01T19:27:17.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000127875 2024-04-01T19:27:17.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:17.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:35.810487+0000", 2024-04-01T19:27:17.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012424100000000001 2024-04-01T19:27:17.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:17.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:35.818079+0000", 2024-04-01T19:27:17.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0075921080000000002 2024-04-01T19:27:17.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:17.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:35.825492+0000", 2024-04-01T19:27:17.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074134209999999999 2024-04-01T19:27:17.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.741 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:17.741 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:35.825548+0000", 2024-04-01T19:27:17.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6412000000000001e-05 2024-04-01T19:27:17.741 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.741 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:17.741 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:35.825590+0000", 2024-04-01T19:27:17.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1204000000000001e-05 2024-04-01T19:27:17.741 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.741 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:17.741 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.741 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.741 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:167773 2.f 2:f389f312:::benchmark_data_smithi188_77607_object369:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:27:17.742 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:26:36.098908+0000", 2024-04-01T19:27:17.742 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 41.634425094000001, 2024-04-01T19:27:17.742 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.111786091, 2024-04-01T19:27:17.742 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:17.742 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:17.742 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:17.742 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:17.742 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:17.742 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:17.742 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 167773 2024-04-01T19:27:17.742 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.742 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:17.742 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.743 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:17.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.098908+0000", 2024-04-01T19:27:17.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.743 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.743 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:17.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.098908+0000", 2024-04-01T19:27:17.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.743 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.743 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:17.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.098909+0000", 2024-04-01T19:27:17.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6959999999999999e-06 2024-04-01T19:27:17.743 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:17.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.098915+0000", 2024-04-01T19:27:17.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3149999999999999e-06 2024-04-01T19:27:17.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:17.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.098924+0000", 2024-04-01T19:27:17.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4930000000000004e-06 2024-04-01T19:27:17.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:17.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.098932+0000", 2024-04-01T19:27:17.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2910000000000002e-06 2024-04-01T19:27:17.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:17.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.107695+0000", 2024-04-01T19:27:17.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0087633599999999996 2024-04-01T19:27:17.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:17.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.107803+0000", 2024-04-01T19:27:17.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010838800000000001 2024-04-01T19:27:17.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:17.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.107878+0000", 2024-04-01T19:27:17.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5069999999999998e-05 2024-04-01T19:27:17.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:17.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.210520+0000", 2024-04-01T19:27:17.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.10264169300000001 2024-04-01T19:27:17.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:17.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.210578+0000", 2024-04-01T19:27:17.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8189999999999997e-05 2024-04-01T19:27:17.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:17.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.210634+0000", 2024-04-01T19:27:17.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5554999999999999e-05 2024-04-01T19:27:17.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:17.747 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.210694+0000", 2024-04-01T19:27:17.747 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0040000000000001e-05 2024-04-01T19:27:17.747 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.747 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:17.747 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.747 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.747 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.747 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:167780 2.f 2:ff2c89bf:::benchmark_data_smithi188_77607_object376:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:27:17.747 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:26:36.107066+0000", 2024-04-01T19:27:17.747 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 41.626266541, 2024-04-01T19:27:17.747 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.103797262, 2024-04-01T19:27:17.747 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:17.747 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:17.747 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:17.748 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:17.748 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:17.748 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:17.748 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 167780 2024-04-01T19:27:17.748 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.748 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:17.748 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:17.748 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.107066+0000", 2024-04-01T19:27:17.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.748 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.748 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:17.748 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.107066+0000", 2024-04-01T19:27:17.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.749 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.749 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.749 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:17.749 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.107068+0000", 2024-04-01T19:27:17.749 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4559999999999999e-06 2024-04-01T19:27:17.749 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.749 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.749 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:17.749 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.107073+0000", 2024-04-01T19:27:17.749 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7829999999999998e-06 2024-04-01T19:27:17.749 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.749 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.749 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:17.749 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.107081+0000", 2024-04-01T19:27:17.749 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8449999999999992e-06 2024-04-01T19:27:17.750 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.750 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:17.750 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.107088+0000", 2024-04-01T19:27:17.750 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0709999999999997e-06 2024-04-01T19:27:17.750 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.750 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:17.750 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.112027+0000", 2024-04-01T19:27:17.750 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0049388590000000003 2024-04-01T19:27:17.750 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.750 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:17.750 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.112172+0000", 2024-04-01T19:27:17.750 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014423699999999999 2024-04-01T19:27:17.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:17.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.112307+0000", 2024-04-01T19:27:17.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013508699999999999 2024-04-01T19:27:17.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:17.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.210755+0000", 2024-04-01T19:27:17.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.098448608000000007 2024-04-01T19:27:17.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:17.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.210770+0000", 2024-04-01T19:27:17.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4430000000000001e-05 2024-04-01T19:27:17.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:17.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.210813+0000", 2024-04-01T19:27:17.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2861000000000002e-05 2024-04-01T19:27:17.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:17.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.210864+0000", 2024-04-01T19:27:17.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1025e-05 2024-04-01T19:27:17.752 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.752 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:17.753 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.753 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.753 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.753 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:167792 2.f 2:f091f2dd:::benchmark_data_smithi188_77607_object388:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:27:17.753 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:26:36.115707+0000", 2024-04-01T19:27:17.753 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 41.617625957000001, 2024-04-01T19:27:17.753 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.10517082899999999, 2024-04-01T19:27:17.753 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:17.753 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:17.753 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:17.753 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:17.753 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:17.753 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:17.753 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 167792 2024-04-01T19:27:17.753 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.754 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:17.754 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.754 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:17.754 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.115707+0000", 2024-04-01T19:27:17.754 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.754 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.754 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.754 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:17.754 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.115707+0000", 2024-04-01T19:27:17.754 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.754 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.754 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.754 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:17.754 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.115709+0000", 2024-04-01T19:27:17.754 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4480000000000001e-06 2024-04-01T19:27:17.755 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.755 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.755 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:17.755 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.115717+0000", 2024-04-01T19:27:17.755 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8630000000000008e-06 2024-04-01T19:27:17.755 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.755 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.755 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:17.755 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.115734+0000", 2024-04-01T19:27:17.755 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6316000000000001e-05 2024-04-01T19:27:17.755 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.755 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.755 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:17.755 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.115742+0000", 2024-04-01T19:27:17.755 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.969e-06 2024-04-01T19:27:17.756 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.756 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.756 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:17.756 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.206717+0000", 2024-04-01T19:27:17.756 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.090974502999999998 2024-04-01T19:27:17.756 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.756 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.756 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:17.756 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.206809+0000", 2024-04-01T19:27:17.756 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2467999999999996e-05 2024-04-01T19:27:17.756 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.756 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.757 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:17.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.206898+0000", 2024-04-01T19:27:17.757 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8279e-05 2024-04-01T19:27:17.757 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.757 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.757 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:17.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.211043+0000", 2024-04-01T19:27:17.757 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0041452879999999996 2024-04-01T19:27:17.757 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.757 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.757 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:17.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.220802+0000", 2024-04-01T19:27:17.757 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0097590760000000002 2024-04-01T19:27:17.757 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.757 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.758 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:17.758 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.220838+0000", 2024-04-01T19:27:17.758 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6022999999999997e-05 2024-04-01T19:27:17.758 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.758 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.758 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:17.758 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.220878+0000", 2024-04-01T19:27:17.758 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9595999999999998e-05 2024-04-01T19:27:17.758 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.758 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:17.758 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.758 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.759 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.759 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:168228 2.f 2:f2680a3c:::benchmark_data_smithi188_77607_object824:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:27:17.759 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:26:36.643487+0000", 2024-04-01T19:27:17.759 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 41.089845791999998, 2024-04-01T19:27:17.759 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.10661440799999999, 2024-04-01T19:27:17.759 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:17.759 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:17.759 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:17.759 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:17.759 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:17.759 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:17.759 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 168228 2024-04-01T19:27:17.759 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.759 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:17.759 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.760 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:17.760 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.643487+0000", 2024-04-01T19:27:17.760 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.760 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.760 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.760 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:17.760 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.643487+0000", 2024-04-01T19:27:17.760 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.760 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.760 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.760 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:17.760 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.643488+0000", 2024-04-01T19:27:17.760 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1209999999999999e-06 2024-04-01T19:27:17.760 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.760 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.760 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:17.761 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.643492+0000", 2024-04-01T19:27:17.761 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7589999999999999e-06 2024-04-01T19:27:17.761 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.761 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.761 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:17.761 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.643498+0000", 2024-04-01T19:27:17.761 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2750000000000001e-06 2024-04-01T19:27:17.761 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.761 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.761 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:17.761 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.643504+0000", 2024-04-01T19:27:17.761 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5620000000000003e-06 2024-04-01T19:27:17.761 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.761 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.761 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:17.762 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.726473+0000", 2024-04-01T19:27:17.762 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.082969483999999996 2024-04-01T19:27:17.762 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.762 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.762 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:17.762 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.726591+0000", 2024-04-01T19:27:17.762 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011738 2024-04-01T19:27:17.762 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.762 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.762 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:17.762 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.726718+0000", 2024-04-01T19:27:17.762 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012741599999999999 2024-04-01T19:27:17.762 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.762 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.763 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:17.763 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.741258+0000", 2024-04-01T19:27:17.763 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014540226999999999 2024-04-01T19:27:17.763 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.763 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.763 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:17.763 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.749990+0000", 2024-04-01T19:27:17.763 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0087315090000000001 2024-04-01T19:27:17.763 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.763 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.763 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:17.763 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.750049+0000", 2024-04-01T19:27:17.763 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8965000000000002e-05 2024-04-01T19:27:17.763 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.763 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.764 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:17.764 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.750101+0000", 2024-04-01T19:27:17.764 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2710000000000002e-05 2024-04-01T19:27:17.764 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.764 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:17.764 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.764 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.764 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.764 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:168474 2.f 2:f697ef88:::benchmark_data_smithi188_77607_object1070:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:27:17.764 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:26:36.903351+0000", 2024-04-01T19:27:17.764 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 40.829981924999998, 2024-04-01T19:27:17.765 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.102486801, 2024-04-01T19:27:17.765 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:17.765 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:17.765 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:17.765 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:17.765 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:17.765 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:17.765 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 168474 2024-04-01T19:27:17.765 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.765 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:17.765 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.765 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:17.765 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.903351+0000", 2024-04-01T19:27:17.765 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.766 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.766 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.766 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:17.766 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.903351+0000", 2024-04-01T19:27:17.766 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.766 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.766 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.766 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:17.766 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.903353+0000", 2024-04-01T19:27:17.766 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7120000000000001e-06 2024-04-01T19:27:17.766 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.766 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.766 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:17.766 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.903358+0000", 2024-04-01T19:27:17.767 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.378e-06 2024-04-01T19:27:17.767 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.767 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.767 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:17.767 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.903370+0000", 2024-04-01T19:27:17.767 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2401999999999999e-05 2024-04-01T19:27:17.767 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.767 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.768 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:17.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.903379+0000", 2024-04-01T19:27:17.768 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3440000000000001e-06 2024-04-01T19:27:17.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.768 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.768 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:17.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.910853+0000", 2024-04-01T19:27:17.768 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074739580000000002 2024-04-01T19:27:17.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.768 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.768 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:17.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.910956+0000", 2024-04-01T19:27:17.768 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000103714 2024-04-01T19:27:17.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.769 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:17.769 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.911059+0000", 2024-04-01T19:27:17.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000102099 2024-04-01T19:27:17.769 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.769 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:17.769 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:36.996874+0000", 2024-04-01T19:27:17.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.085815180000000005 2024-04-01T19:27:17.769 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.769 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:17.769 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.005734+0000", 2024-04-01T19:27:17.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0088603829999999995 2024-04-01T19:27:17.769 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.770 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:17.770 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.005778+0000", 2024-04-01T19:27:17.770 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3959999999999999e-05 2024-04-01T19:27:17.770 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.770 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.770 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:17.770 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.005838+0000", 2024-04-01T19:27:17.770 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9670999999999998e-05 2024-04-01T19:27:17.770 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.770 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:17.770 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.770 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.770 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.770 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:168818 2.f 2:ffa6c671:::benchmark_data_smithi188_77607_object1414:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:27:17.771 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:26:37.290201+0000", 2024-04-01T19:27:17.771 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 40.443132239000001, 2024-04-01T19:27:17.771 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.107335266, 2024-04-01T19:27:17.771 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:17.771 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:17.771 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:17.771 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:17.771 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:17.771 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:17.771 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 168818 2024-04-01T19:27:17.771 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.771 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:17.771 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.772 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:17.772 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.290201+0000", 2024-04-01T19:27:17.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.772 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.772 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:17.772 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.290201+0000", 2024-04-01T19:27:17.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.772 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.772 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:17.772 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.290202+0000", 2024-04-01T19:27:17.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.271e-06 2024-04-01T19:27:17.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.773 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:17.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.290207+0000", 2024-04-01T19:27:17.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6530000000000002e-06 2024-04-01T19:27:17.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.773 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:17.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.290216+0000", 2024-04-01T19:27:17.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7860000000000008e-06 2024-04-01T19:27:17.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.773 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:17.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.290223+0000", 2024-04-01T19:27:17.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.007e-06 2024-04-01T19:27:17.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.774 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:17.774 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.305125+0000", 2024-04-01T19:27:17.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014901994 2024-04-01T19:27:17.774 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.774 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:17.774 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.305234+0000", 2024-04-01T19:27:17.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108964 2024-04-01T19:27:17.774 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.774 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:17.774 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.305353+0000", 2024-04-01T19:27:17.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119086 2024-04-01T19:27:17.775 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.776 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.776 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:17.776 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.397381+0000", 2024-04-01T19:27:17.776 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.092027428999999994 2024-04-01T19:27:17.776 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.776 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.776 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:17.776 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.397469+0000", 2024-04-01T19:27:17.776 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8306000000000005e-05 2024-04-01T19:27:17.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:17.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.397498+0000", 2024-04-01T19:27:17.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8629999999999999e-05 2024-04-01T19:27:17.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:17.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.397536+0000", 2024-04-01T19:27:17.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8139999999999997e-05 2024-04-01T19:27:17.777 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.777 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:17.777 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.778 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.778 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:169391 2.f 2:f1ae000b:::benchmark_data_smithi188_77607_object1987:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:27:17.778 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:26:37.979561+0000", 2024-04-01T19:27:17.778 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 39.753771653000001, 2024-04-01T19:27:17.778 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.117663015, 2024-04-01T19:27:17.778 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:17.778 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:17.778 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:17.778 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:17.778 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:17.778 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:17.778 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 169391 2024-04-01T19:27:17.779 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.779 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:17.779 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.779 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:17.779 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.979561+0000", 2024-04-01T19:27:17.779 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.779 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.779 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.779 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:17.779 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.979561+0000", 2024-04-01T19:27:17.779 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.779 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.779 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.780 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:17.780 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.979562+0000", 2024-04-01T19:27:17.780 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3200000000000005e-07 2024-04-01T19:27:17.780 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.780 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.780 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:17.780 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.979564+0000", 2024-04-01T19:27:17.780 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4590000000000001e-06 2024-04-01T19:27:17.780 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.780 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.780 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:17.780 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.979570+0000", 2024-04-01T19:27:17.780 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2440000000000001e-06 2024-04-01T19:27:17.780 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.780 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.781 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:17.781 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.979575+0000", 2024-04-01T19:27:17.781 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1880000000000001e-06 2024-04-01T19:27:17.781 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.781 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.781 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:17.781 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.983258+0000", 2024-04-01T19:27:17.781 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036827940000000001 2024-04-01T19:27:17.781 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.781 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.781 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:17.781 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.983371+0000", 2024-04-01T19:27:17.781 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000113539 2024-04-01T19:27:17.782 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.782 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.782 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:17.782 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.983518+0000", 2024-04-01T19:27:17.782 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000146947 2024-04-01T19:27:17.782 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.782 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.782 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:17.782 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:37.998198+0000", 2024-04-01T19:27:17.782 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014680043 2024-04-01T19:27:17.782 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:17.783 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.097107+0000", 2024-04-01T19:27:17.783 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.098908640000000006 2024-04-01T19:27:17.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:17.783 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.097164+0000", 2024-04-01T19:27:17.783 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7129999999999997e-05 2024-04-01T19:27:17.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:17.784 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.097224+0000", 2024-04-01T19:27:17.784 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0399000000000002e-05 2024-04-01T19:27:17.784 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.784 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:17.784 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.784 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.784 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.784 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:169533 2.f 2:f2e1415d:::benchmark_data_smithi188_77607_object2129:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:27:17.784 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:26:38.140484+0000", 2024-04-01T19:27:17.784 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 39.592848672999999, 2024-04-01T19:27:17.784 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.11195912399999999, 2024-04-01T19:27:17.784 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:17.784 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:17.785 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:17.785 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:17.785 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:17.785 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:17.785 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 169533 2024-04-01T19:27:17.785 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.785 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:17.785 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.785 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:17.785 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.140484+0000", 2024-04-01T19:27:17.785 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.785 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.785 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.785 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:17.786 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.140484+0000", 2024-04-01T19:27:17.786 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.786 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.786 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.786 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:17.786 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.140486+0000", 2024-04-01T19:27:17.786 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.905e-06 2024-04-01T19:27:17.786 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.786 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.786 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:17.786 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.140494+0000", 2024-04-01T19:27:17.786 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2139999999999996e-06 2024-04-01T19:27:17.786 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.786 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.787 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:17.787 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.140506+0000", 2024-04-01T19:27:17.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1866e-05 2024-04-01T19:27:17.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.787 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.787 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:17.787 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.140514+0000", 2024-04-01T19:27:17.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6090000000000003e-06 2024-04-01T19:27:17.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.787 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.787 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:17.787 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.142968+0000", 2024-04-01T19:27:17.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002453743 2024-04-01T19:27:17.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.788 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:17.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.143046+0000", 2024-04-01T19:27:17.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8374000000000006e-05 2024-04-01T19:27:17.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.788 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:17.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.143124+0000", 2024-04-01T19:27:17.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7927000000000001e-05 2024-04-01T19:27:17.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.788 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:17.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.151828+0000", 2024-04-01T19:27:17.789 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0087037030000000001 2024-04-01T19:27:17.789 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.789 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.789 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:17.789 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.252357+0000", 2024-04-01T19:27:17.789 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.100529418 2024-04-01T19:27:17.789 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.789 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.789 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:17.789 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.252397+0000", 2024-04-01T19:27:17.789 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0141000000000001e-05 2024-04-01T19:27:17.789 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.789 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.789 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:17.790 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.252443+0000", 2024-04-01T19:27:17.790 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6224000000000003e-05 2024-04-01T19:27:17.790 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.790 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:17.790 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.790 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.790 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.790 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:169536 2.f 2:f3183433:::benchmark_data_smithi188_77607_object2132:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:27:17.790 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:26:38.140616+0000", 2024-04-01T19:27:17.790 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 39.592717120000003, 2024-04-01T19:27:17.790 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.11194259099999999, 2024-04-01T19:27:17.790 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:17.790 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:17.791 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:17.791 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:17.791 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:17.791 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:17.791 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 169536 2024-04-01T19:27:17.791 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.791 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:17.791 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.791 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:17.791 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.140616+0000", 2024-04-01T19:27:17.791 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.791 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.791 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.791 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:17.791 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.140616+0000", 2024-04-01T19:27:17.792 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.792 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.792 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.792 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:17.792 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.140616+0000", 2024-04-01T19:27:17.792 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4499999999999996e-07 2024-04-01T19:27:17.792 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.792 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.792 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:17.792 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.140620+0000", 2024-04-01T19:27:17.792 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3850000000000002e-06 2024-04-01T19:27:17.792 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.792 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.792 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:17.793 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.140627+0000", 2024-04-01T19:27:17.793 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0639999999999996e-06 2024-04-01T19:27:17.793 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.793 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.793 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:17.793 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.140633+0000", 2024-04-01T19:27:17.793 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7169999999999996e-06 2024-04-01T19:27:17.793 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.793 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.793 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:17.793 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.147121+0000", 2024-04-01T19:27:17.793 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0064883720000000001 2024-04-01T19:27:17.793 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.794 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.794 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:17.794 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.147225+0000", 2024-04-01T19:27:17.794 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000104304 2024-04-01T19:27:17.794 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.794 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.794 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:17.794 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.147349+0000", 2024-04-01T19:27:17.794 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012354900000000001 2024-04-01T19:27:17.794 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.794 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.794 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:17.795 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.252297+0000", 2024-04-01T19:27:17.795 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.104948189 2024-04-01T19:27:17.795 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.795 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.795 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:17.795 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.252481+0000", 2024-04-01T19:27:17.795 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018359999999999999 2024-04-01T19:27:17.795 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.795 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.795 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:17.795 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.252518+0000", 2024-04-01T19:27:17.795 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7218000000000002e-05 2024-04-01T19:27:17.795 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.795 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.796 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:17.796 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.252558+0000", 2024-04-01T19:27:17.796 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0448000000000003e-05 2024-04-01T19:27:17.796 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.796 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:17.796 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.796 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.796 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.796 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:169538 2.f 2:f2f464c4:::benchmark_data_smithi188_77607_object2134:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:27:17.796 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:26:38.142519+0000", 2024-04-01T19:27:17.796 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 39.590813959999998, 2024-04-01T19:27:17.796 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.110254906, 2024-04-01T19:27:17.796 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:17.796 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:17.796 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:17.797 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:17.797 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:17.797 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:17.797 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 169538 2024-04-01T19:27:17.797 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.797 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:17.797 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.797 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:17.797 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.142519+0000", 2024-04-01T19:27:17.797 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.797 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.797 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.797 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:17.797 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.142519+0000", 2024-04-01T19:27:17.797 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.798 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.798 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.798 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:17.798 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.142521+0000", 2024-04-01T19:27:17.798 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2079999999999999e-06 2024-04-01T19:27:17.798 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.798 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.798 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:17.798 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.142527+0000", 2024-04-01T19:27:17.798 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1419999999999998e-06 2024-04-01T19:27:17.798 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.798 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.798 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:17.799 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.142544+0000", 2024-04-01T19:27:17.799 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6300999999999999e-05 2024-04-01T19:27:17.799 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.799 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.799 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:17.799 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.142552+0000", 2024-04-01T19:27:17.799 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4859999999999997e-06 2024-04-01T19:27:17.799 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.799 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.799 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:17.799 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.151916+0000", 2024-04-01T19:27:17.799 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0093639750000000001 2024-04-01T19:27:17.799 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.799 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.799 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:17.800 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.151997+0000", 2024-04-01T19:27:17.800 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1290000000000003e-05 2024-04-01T19:27:17.800 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.800 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.800 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:17.800 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.152077+0000", 2024-04-01T19:27:17.800 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0042000000000004e-05 2024-04-01T19:27:17.800 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.800 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.800 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:17.800 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.252302+0000", 2024-04-01T19:27:17.800 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.100224462 2024-04-01T19:27:17.800 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.800 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.800 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:17.800 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.252662+0000", 2024-04-01T19:27:17.801 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036062600000000001 2024-04-01T19:27:17.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.801 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.801 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:17.801 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.252717+0000", 2024-04-01T19:27:17.801 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4545e-05 2024-04-01T19:27:17.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.801 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.801 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:17.801 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.252774+0000", 2024-04-01T19:27:17.801 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6829000000000001e-05 2024-04-01T19:27:17.801 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.801 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:17.801 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.802 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.802 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:169728 2.f 2:f414daa1:::benchmark_data_smithi188_77607_object2324:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:27:17.802 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:26:38.389447+0000", 2024-04-01T19:27:17.802 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 39.343885641999996, 2024-04-01T19:27:17.802 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.101983131, 2024-04-01T19:27:17.802 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:17.802 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:17.802 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:17.802 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:17.802 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:17.802 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:17.802 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 169728 2024-04-01T19:27:17.802 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.802 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:17.803 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.803 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:17.803 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.389447+0000", 2024-04-01T19:27:17.803 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.803 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.803 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.803 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:17.803 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.389447+0000", 2024-04-01T19:27:17.803 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.803 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.803 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.803 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:17.803 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.389449+0000", 2024-04-01T19:27:17.804 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6780000000000001e-06 2024-04-01T19:27:17.804 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.804 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.804 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:17.804 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.389454+0000", 2024-04-01T19:27:17.804 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7890000000000002e-06 2024-04-01T19:27:17.804 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.804 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.804 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:17.804 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.389463+0000", 2024-04-01T19:27:17.804 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3309999999999993e-06 2024-04-01T19:27:17.804 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.804 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.804 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:17.805 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.389471+0000", 2024-04-01T19:27:17.805 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6739999999999997e-06 2024-04-01T19:27:17.805 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.805 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.805 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:17.805 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.485489+0000", 2024-04-01T19:27:17.805 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.096018671999999999 2024-04-01T19:27:17.805 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.805 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.805 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:17.805 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.485619+0000", 2024-04-01T19:27:17.805 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012997900000000001 2024-04-01T19:27:17.805 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.805 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.806 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:17.806 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.485745+0000", 2024-04-01T19:27:17.806 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000125506 2024-04-01T19:27:17.806 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.806 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.806 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:17.806 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.489813+0000", 2024-04-01T19:27:17.806 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040681220000000004 2024-04-01T19:27:17.806 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.806 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.806 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:17.806 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.491368+0000", 2024-04-01T19:27:17.806 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015554309999999999 2024-04-01T19:27:17.807 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.807 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.807 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:17.807 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.491400+0000", 2024-04-01T19:27:17.807 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1522000000000001e-05 2024-04-01T19:27:17.807 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.807 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.807 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:17.807 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.491430+0000", 2024-04-01T19:27:17.807 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0426999999999999e-05 2024-04-01T19:27:17.807 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.807 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:17.807 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.807 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.808 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.808 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:169937 2.f 2:fa56bd86:::benchmark_data_smithi188_77607_object2533:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:27:17.808 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:26:38.646663+0000", 2024-04-01T19:27:17.808 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 39.086669856999997, 2024-04-01T19:27:17.808 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.105579087, 2024-04-01T19:27:17.808 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:17.808 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:17.808 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:17.808 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:17.808 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:17.808 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:17.808 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 169937 2024-04-01T19:27:17.808 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.808 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:17.809 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.809 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:17.809 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.646663+0000", 2024-04-01T19:27:17.809 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.809 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.809 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.809 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:17.809 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.646663+0000", 2024-04-01T19:27:17.809 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.809 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.809 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.809 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:17.809 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.646665+0000", 2024-04-01T19:27:17.810 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.013e-06 2024-04-01T19:27:17.810 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.810 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.810 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:17.810 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.646672+0000", 2024-04-01T19:27:17.810 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6000000000000003e-06 2024-04-01T19:27:17.810 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.810 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.810 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:17.810 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.646684+0000", 2024-04-01T19:27:17.810 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2306e-05 2024-04-01T19:27:17.810 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.810 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.810 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:17.811 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.646692+0000", 2024-04-01T19:27:17.811 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4030000000000007e-06 2024-04-01T19:27:17.811 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.811 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.811 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:17.811 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.733345+0000", 2024-04-01T19:27:17.811 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.086652982000000003 2024-04-01T19:27:17.811 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.811 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.811 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:17.811 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.733502+0000", 2024-04-01T19:27:17.811 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000156575 2024-04-01T19:27:17.811 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.811 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.812 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:17.812 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.733652+0000", 2024-04-01T19:27:17.812 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014967800000000001 2024-04-01T19:27:17.812 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.812 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.812 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:17.812 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.737556+0000", 2024-04-01T19:27:17.812 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0039049200000000001 2024-04-01T19:27:17.812 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.812 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.812 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:17.812 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.752126+0000", 2024-04-01T19:27:17.812 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0145693 2024-04-01T19:27:17.812 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.812 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.813 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:17.813 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.752181+0000", 2024-04-01T19:27:17.813 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5449999999999999e-05 2024-04-01T19:27:17.813 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.813 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.813 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:17.813 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.752242+0000", 2024-04-01T19:27:17.813 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0859999999999997e-05 2024-04-01T19:27:17.813 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.813 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:17.813 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.813 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.813 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.813 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:169995 2.f 2:fff23744:::benchmark_data_smithi188_77607_object2591:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:27:17.814 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:26:38.711837+0000", 2024-04-01T19:27:17.814 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 39.021495950999999, 2024-04-01T19:27:17.814 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.130625934, 2024-04-01T19:27:17.814 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:17.814 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:17.814 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:17.814 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:17.814 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:17.814 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:17.814 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 169995 2024-04-01T19:27:17.814 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.814 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:17.814 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.814 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:17.815 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.711837+0000", 2024-04-01T19:27:17.815 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.815 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.815 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.815 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:17.815 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.711837+0000", 2024-04-01T19:27:17.815 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.815 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.815 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.815 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:17.815 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.711839+0000", 2024-04-01T19:27:17.815 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.418e-06 2024-04-01T19:27:17.815 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.815 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.815 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:17.816 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.711845+0000", 2024-04-01T19:27:17.816 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1120000000000001e-06 2024-04-01T19:27:17.816 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.816 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.816 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:17.816 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.711859+0000", 2024-04-01T19:27:17.816 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.34e-05 2024-04-01T19:27:17.816 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.816 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.816 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:17.816 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.711868+0000", 2024-04-01T19:27:17.816 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8640000000000002e-06 2024-04-01T19:27:17.816 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.816 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.817 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:17.817 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.743645+0000", 2024-04-01T19:27:17.817 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031776980000000003 2024-04-01T19:27:17.817 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.817 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.817 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:17.817 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.743757+0000", 2024-04-01T19:27:17.817 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000112315 2024-04-01T19:27:17.817 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.817 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.817 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:17.817 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.743836+0000", 2024-04-01T19:27:17.817 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9163000000000001e-05 2024-04-01T19:27:17.817 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.817 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.818 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:17.818 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.747605+0000", 2024-04-01T19:27:17.818 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0037689260000000001 2024-04-01T19:27:17.818 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.818 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.818 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:17.818 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.842382+0000", 2024-04-01T19:27:17.818 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.094776919000000001 2024-04-01T19:27:17.818 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.818 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.818 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:17.818 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.842419+0000", 2024-04-01T19:27:17.818 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6668999999999997e-05 2024-04-01T19:27:17.818 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.818 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.819 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:17.819 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.842463+0000", 2024-04-01T19:27:17.819 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4168000000000001e-05 2024-04-01T19:27:17.819 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.819 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:17.819 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.819 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.819 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.819 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:170150 2.f 2:fa318fca:::benchmark_data_smithi188_77607_object2746:head [delete] snapc 0=[] ondisk+write+known_if_redirected e140)", 2024-04-01T19:27:17.819 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:26:38.893108+0000", 2024-04-01T19:27:17.819 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 38.840225160999999, 2024-04-01T19:27:17.819 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.109814378, 2024-04-01T19:27:17.819 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:17.819 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:17.820 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:17.820 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:17.820 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:17.820 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:17.820 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 170150 2024-04-01T19:27:17.820 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.820 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:17.820 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.820 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:17.820 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.893108+0000", 2024-04-01T19:27:17.820 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.820 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.820 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.820 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:17.820 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.893108+0000", 2024-04-01T19:27:17.821 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.821 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.821 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.821 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:17.821 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.893109+0000", 2024-04-01T19:27:17.821 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7099999999999999e-06 2024-04-01T19:27:17.821 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.821 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.821 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:17.821 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.893114+0000", 2024-04-01T19:27:17.821 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2849999999999996e-06 2024-04-01T19:27:17.821 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.821 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.821 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:17.822 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.893123+0000", 2024-04-01T19:27:17.822 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4059999999999994e-06 2024-04-01T19:27:17.822 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.822 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.822 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:17.822 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.893129+0000", 2024-04-01T19:27:17.822 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5439999999999998e-06 2024-04-01T19:27:17.822 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.822 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.822 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:17.822 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.902555+0000", 2024-04-01T19:27:17.822 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0094261659999999997 2024-04-01T19:27:17.823 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.823 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.823 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:17.823 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.902664+0000", 2024-04-01T19:27:17.823 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000109094 2024-04-01T19:27:17.823 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.823 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.823 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:17.823 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.902782+0000", 2024-04-01T19:27:17.823 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011762 2024-04-01T19:27:17.823 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.823 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.823 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:17.823 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:38.907199+0000", 2024-04-01T19:27:17.823 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0044172739999999997 2024-04-01T19:27:17.824 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.824 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.824 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:17.824 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.002815+0000", 2024-04-01T19:27:17.824 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.095616346000000005 2024-04-01T19:27:17.824 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.824 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.824 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:17.824 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.002865+0000", 2024-04-01T19:27:17.824 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9784000000000003e-05 2024-04-01T19:27:17.824 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.824 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.824 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:17.824 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.002922+0000", 2024-04-01T19:27:17.825 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7148999999999998e-05 2024-04-01T19:27:17.825 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.825 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:17.825 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.825 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.825 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.825 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:170622 2.f 2:fa2a0045:::benchmark_data_smithi188_77607_object3218:head [delete] snapc 0=[] ondisk+write+known_if_redirected e140)", 2024-04-01T19:27:17.825 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:26:39.421556+0000", 2024-04-01T19:27:17.825 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 38.311777073999998, 2024-04-01T19:27:17.825 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.103615761, 2024-04-01T19:27:17.825 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:17.825 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:17.825 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:17.825 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:17.825 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:17.825 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:17.826 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 170622 2024-04-01T19:27:17.826 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.826 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:17.826 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.826 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:17.826 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.421556+0000", 2024-04-01T19:27:17.826 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.826 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.826 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.826 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:17.826 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.421556+0000", 2024-04-01T19:27:17.826 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.826 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.826 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.827 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:17.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.421557+0000", 2024-04-01T19:27:17.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.671e-06 2024-04-01T19:27:17.827 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.827 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.827 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:17.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.421562+0000", 2024-04-01T19:27:17.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.955e-06 2024-04-01T19:27:17.827 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.827 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.827 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:17.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.421573+0000", 2024-04-01T19:27:17.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0155e-05 2024-04-01T19:27:17.827 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.828 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.828 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:17.828 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.421580+0000", 2024-04-01T19:27:17.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9959999999999996e-06 2024-04-01T19:27:17.828 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.828 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.828 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:17.828 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.510550+0000", 2024-04-01T19:27:17.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.088970245000000003 2024-04-01T19:27:17.828 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.828 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.828 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:17.828 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.510689+0000", 2024-04-01T19:27:17.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000139357 2024-04-01T19:27:17.828 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.829 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.829 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:17.829 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.510824+0000", 2024-04-01T19:27:17.829 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000135174 2024-04-01T19:27:17.829 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.829 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.829 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:17.829 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.514785+0000", 2024-04-01T19:27:17.829 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0039606290000000002 2024-04-01T19:27:17.829 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.829 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.829 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:17.829 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.525063+0000", 2024-04-01T19:27:17.829 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010277738 2024-04-01T19:27:17.829 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.829 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.830 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:17.830 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.525115+0000", 2024-04-01T19:27:17.830 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2633000000000002e-05 2024-04-01T19:27:17.830 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.830 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.830 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:17.830 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.525172+0000", 2024-04-01T19:27:17.830 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6208000000000001e-05 2024-04-01T19:27:17.830 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.830 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:17.830 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.830 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.830 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.831 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:170625 2.f 2:fc8a8c13:::benchmark_data_smithi188_77607_object3221:head [delete] snapc 0=[] ondisk+write+known_if_redirected e140)", 2024-04-01T19:27:17.831 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:26:39.428364+0000", 2024-04-01T19:27:17.831 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 38.304968856000002, 2024-04-01T19:27:17.831 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.105189518, 2024-04-01T19:27:17.831 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:17.831 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:17.831 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:17.831 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:17.831 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:17.831 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:17.831 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 170625 2024-04-01T19:27:17.831 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.831 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:17.831 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.832 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:17.832 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.428364+0000", 2024-04-01T19:27:17.832 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.832 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.832 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.832 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:17.832 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.428364+0000", 2024-04-01T19:27:17.832 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.832 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.832 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.832 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:17.832 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.428366+0000", 2024-04-01T19:27:17.832 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8610000000000001e-06 2024-04-01T19:27:17.832 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.833 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.833 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:17.833 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.428371+0000", 2024-04-01T19:27:17.833 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0679999999999996e-06 2024-04-01T19:27:17.833 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.833 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.833 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:17.833 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.428386+0000", 2024-04-01T19:27:17.833 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5067e-05 2024-04-01T19:27:17.833 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.833 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.833 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:17.833 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.428394+0000", 2024-04-01T19:27:17.833 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.208e-06 2024-04-01T19:27:17.834 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.834 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:17.834 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.516488+0000", 2024-04-01T19:27:17.834 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.08809351 2024-04-01T19:27:17.834 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.834 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:17.834 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.516575+0000", 2024-04-01T19:27:17.834 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7111e-05 2024-04-01T19:27:17.834 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.835 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:17.835 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.516649+0000", 2024-04-01T19:27:17.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4647999999999994e-05 2024-04-01T19:27:17.835 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.835 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.835 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:17.835 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.529746+0000", 2024-04-01T19:27:17.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013096942 2024-04-01T19:27:17.835 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.835 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.835 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:17.835 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.533465+0000", 2024-04-01T19:27:17.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0037181060000000001 2024-04-01T19:27:17.836 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.836 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.836 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:17.836 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.533506+0000", 2024-04-01T19:27:17.836 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1848999999999999e-05 2024-04-01T19:27:17.836 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.836 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.836 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:17.836 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:39.533554+0000", 2024-04-01T19:27:17.836 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7148000000000003e-05 2024-04-01T19:27:17.836 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.836 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:17.836 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.836 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.836 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.837 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:171142 2.f 2:f88d8cb7:::benchmark_data_smithi188_77607_object3738:head [delete] snapc 0=[] ondisk+write+known_if_redirected e141)", 2024-04-01T19:27:17.837 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:26:40.061184+0000", 2024-04-01T19:27:17.837 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 37.672149157, 2024-04-01T19:27:17.837 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.124535589, 2024-04-01T19:27:17.837 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:17.837 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:17.837 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:17.837 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:17.837 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:17.837 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:17.837 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 171142 2024-04-01T19:27:17.837 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.837 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:17.837 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.838 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:17.838 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.061184+0000", 2024-04-01T19:27:17.838 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.838 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.838 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.838 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:17.838 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.061184+0000", 2024-04-01T19:27:17.838 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.838 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.838 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.838 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:17.838 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.061186+0000", 2024-04-01T19:27:17.838 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0870000000000001e-06 2024-04-01T19:27:17.839 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.839 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.839 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:17.839 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.061192+0000", 2024-04-01T19:27:17.839 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4829999999999996e-06 2024-04-01T19:27:17.839 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.839 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.839 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:17.839 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.061205+0000", 2024-04-01T19:27:17.839 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3169999999999999e-05 2024-04-01T19:27:17.839 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.839 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.839 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:17.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.061213+0000", 2024-04-01T19:27:17.840 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7009999999999996e-06 2024-04-01T19:27:17.840 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.840 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.840 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:17.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.151994+0000", 2024-04-01T19:27:17.840 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.090780499000000001 2024-04-01T19:27:17.840 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.840 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.840 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:17.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.152130+0000", 2024-04-01T19:27:17.840 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013637100000000001 2024-04-01T19:27:17.840 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.840 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.841 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:17.841 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.152264+0000", 2024-04-01T19:27:17.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013423299999999999 2024-04-01T19:27:17.841 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.841 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.841 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:17.841 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.160217+0000", 2024-04-01T19:27:17.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0079528489999999997 2024-04-01T19:27:17.841 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.841 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.841 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:17.841 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.185632+0000", 2024-04-01T19:27:17.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.025414941 2024-04-01T19:27:17.841 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.841 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.842 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:17.842 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.185667+0000", 2024-04-01T19:27:17.842 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4538e-05 2024-04-01T19:27:17.842 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.842 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.842 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:17.842 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.185719+0000", 2024-04-01T19:27:17.842 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2716999999999997e-05 2024-04-01T19:27:17.842 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.842 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:17.842 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.842 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.842 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.842 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:171162 2.f 2:faa02e8d:::benchmark_data_smithi188_77607_object3758:head [delete] snapc 0=[] ondisk+write+known_if_redirected e141)", 2024-04-01T19:27:17.842 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:26:40.077834+0000", 2024-04-01T19:27:17.843 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 37.655498889999997, 2024-04-01T19:27:17.843 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.107994954, 2024-04-01T19:27:17.843 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:17.843 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:17.843 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:17.843 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:17.843 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:17.843 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:17.843 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 171162 2024-04-01T19:27:17.843 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.843 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:17.843 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.843 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:17.843 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.077834+0000", 2024-04-01T19:27:17.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:17.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.077834+0000", 2024-04-01T19:27:17.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:17.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.077835+0000", 2024-04-01T19:27:17.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9300000000000006e-07 2024-04-01T19:27:17.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:17.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.077839+0000", 2024-04-01T19:27:17.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7459999999999998e-06 2024-04-01T19:27:17.845 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:17.845 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.077850+0000", 2024-04-01T19:27:17.845 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.151e-05 2024-04-01T19:27:17.845 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:17.845 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.077857+0000", 2024-04-01T19:27:17.845 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7009999999999999e-06 2024-04-01T19:27:17.845 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:17.845 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.156235+0000", 2024-04-01T19:27:17.845 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.078377889000000006 2024-04-01T19:27:17.846 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.846 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.846 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:17.846 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.156377+0000", 2024-04-01T19:27:17.846 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000142564 2024-04-01T19:27:17.846 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.846 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.846 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:17.846 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.156509+0000", 2024-04-01T19:27:17.846 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013166600000000001 2024-04-01T19:27:17.846 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.846 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.846 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:17.846 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.160224+0000", 2024-04-01T19:27:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0037153149999999999 2024-04-01T19:27:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.185765+0000", 2024-04-01T19:27:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.025540199999999999 2024-04-01T19:27:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.185794+0000", 2024-04-01T19:27:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9799e-05 2024-04-01T19:27:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.185829+0000", 2024-04-01T19:27:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4570999999999998e-05 2024-04-01T19:27:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:171274 2.f 2:fa42cd65:::benchmark_data_smithi188_77607_object3870:head [delete] snapc 0=[] ondisk+write+known_if_redirected e141)", 2024-04-01T19:27:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:26:40.209521+0000", 2024-04-01T19:27:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 37.523812215, 2024-04-01T19:27:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.105957499, 2024-04-01T19:27:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 171274 2024-04-01T19:27:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.209521+0000", 2024-04-01T19:27:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.209521+0000", 2024-04-01T19:27:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.209523+0000", 2024-04-01T19:27:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.385e-06 2024-04-01T19:27:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.209530+0000", 2024-04-01T19:27:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6479999999999997e-06 2024-04-01T19:27:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.209543+0000", 2024-04-01T19:27:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3508e-05 2024-04-01T19:27:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.209552+0000", 2024-04-01T19:27:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7280000000000001e-06 2024-04-01T19:27:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.212150+0000", 2024-04-01T19:27:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025981749999999999 2024-04-01T19:27:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.212286+0000", 2024-04-01T19:27:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013574999999999999 2024-04-01T19:27:17.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:27:17.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.212388+0000", 2024-04-01T19:27:17.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010252 2024-04-01T19:27:17.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:17.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.315295+0000", 2024-04-01T19:27:17.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.102906725 2024-04-01T19:27:17.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:17.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.315375+0000", 2024-04-01T19:27:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0255999999999999e-05 2024-04-01T19:27:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.315423+0000", 2024-04-01T19:27:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8052e-05 2024-04-01T19:27:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:26:40.315478+0000", 2024-04-01T19:27:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4752e-05 2024-04-01T19:27:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:17.854 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:17.854 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:27:17.854 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:27:17.917 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:18.052 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:27:18.055 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:18.055 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:27:18.156 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:27:18.185 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:18.209 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:27:18.213 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:18.213 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:27:18.314 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:27:18.369 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:18 smithi062 ceph-mon[44211]: pgmap v464: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 7.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:27:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.547 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:18 smithi022 ceph-mon[39439]: pgmap v464: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 7.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:27:18.547 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.547 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.547 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.547 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.547 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.547 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.547 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.547 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.547 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:18 smithi188 ceph-mon[43939]: pgmap v464: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 7.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:27:18.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.604 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.604 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.604 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.604 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.604 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.604 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.605 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.605 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:18.631 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:27:18.634 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:18.634 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:27:18.645 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_ops_in_flight 2024-04-01T19:27:18.657 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:27:18.736 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:27:18.811 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:18.860 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:27:18.866 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:18.867 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:27:18.968 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:27:18.998 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:19.020 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:27:19.023 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:19.023 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:27:19.047 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:27:19.093 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:27:19.124 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:27:19.166 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:19.318 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:27:19.326 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:19.326 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:27:19.427 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:27:19.462 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:19.483 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:27:19.488 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:19.489 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:27:19.590 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:27:19.620 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:19.644 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:27:19.649 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:19.650 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:27:19.751 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:27:19.802 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:19.899 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:27:19.904 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:19.905 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:27:20.006 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:27:20.046 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:20.151 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:27:20.155 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:20.156 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:27:20.257 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:27:20.290 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:20.310 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:27:20.313 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:20.313 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:27:20.414 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:27:20.443 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:20.466 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:27:20.469 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:20.469 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:27:20.570 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:27:20.584 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:27:20.623 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:20.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:20 smithi188 ceph-mon[43939]: pgmap v465: 17 pgs: 17 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:27:20.679 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:20 smithi022 ceph-mon[39439]: pgmap v465: 17 pgs: 17 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:27:20.712 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:27:20.723 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:20.724 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:27:20.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:20 smithi062 ceph-mon[44211]: pgmap v465: 17 pgs: 17 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:27:20.824 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:27:20.857 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:20.881 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:27:20.883 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:20.884 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:27:20.985 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:27:21.033 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:21.094 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:27:21.101 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:21.102 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:27:21.165 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:27:21.203 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:27:21.233 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:21.253 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:27:21.255 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:21.256 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:27:21.357 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:27:21.412 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:21.543 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:27:21.551 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:21.552 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:27:21.653 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:27:21.701 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:21.909 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:27:21.909 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:27:21.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:21.910 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:221578 2.d 2:b728f453:::benchmark_data_smithi188_77607_object54174:head [delete] snapc 0=[] ondisk+write+known_if_redirected e151)", 2024-04-01T19:27:21.910 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:21.907149+0000", 2024-04-01T19:27:21.910 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0013553949999999999, 2024-04-01T19:27:21.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013871319999999999, 2024-04-01T19:27:21.910 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:21.910 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:21.910 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:27:21.910 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:21.910 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:21.910 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:21.910 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 221578 2024-04-01T19:27:21.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:21.911 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:21.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:21.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:21.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:21.907149+0000", 2024-04-01T19:27:21.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:21.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:21.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:21.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:21.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:21.907149+0000", 2024-04-01T19:27:21.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:21.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:21.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:21.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:21.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:21.907151+0000", 2024-04-01T19:27:21.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7269999999999999e-06 2024-04-01T19:27:21.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:21.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:21.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:21.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:21.907156+0000", 2024-04-01T19:27:21.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6799999999999998e-06 2024-04-01T19:27:21.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:21.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:21.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:21.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:21.907170+0000", 2024-04-01T19:27:21.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3342e-05 2024-04-01T19:27:21.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:21.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:21.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:21.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:21.907178+0000", 2024-04-01T19:27:21.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8909999999999995e-06 2024-04-01T19:27:21.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:21.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:21.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:21.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:21.907232+0000", 2024-04-01T19:27:21.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3897000000000003e-05 2024-04-01T19:27:21.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:21.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:21.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:21.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:21.907379+0000", 2024-04-01T19:27:21.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0001473 2024-04-01T19:27:21.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:21.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:21.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:27:21.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:21.907507+0000", 2024-04-01T19:27:21.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012784299999999999 2024-04-01T19:27:21.914 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:21.914 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:21.914 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:21.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:21.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:21.914 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.24751.0:221572 2.f e151/106)", 2024-04-01T19:27:21.914 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:21.908517+0000", 2024-04-01T19:27:21.914 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4294967295.9999876, 2024-04-01T19:27:21.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010193599999999999, 2024-04-01T19:27:21.914 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:21.914 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:21.914 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:27:21.914 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:21.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:21.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:21.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:21.908517+0000", 2024-04-01T19:27:21.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:21.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:21.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:21.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:21.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:21.908517+0000", 2024-04-01T19:27:21.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:21.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:21.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:21.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:21.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:21.908518+0000", 2024-04-01T19:27:21.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.285e-06 2024-04-01T19:27:21.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:21.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:21.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:21.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:21.908524+0000", 2024-04-01T19:27:21.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3840000000000002e-06 2024-04-01T19:27:21.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:21.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:21.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:21.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:21.908537+0000", 2024-04-01T19:27:21.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2150000000000001e-05 2024-04-01T19:27:21.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:21.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:21.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:21.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:21.908543+0000", 2024-04-01T19:27:21.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9550000000000003e-06 2024-04-01T19:27:21.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:21.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:21.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:21.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:21.908607+0000", 2024-04-01T19:27:21.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3014000000000003e-05 2024-04-01T19:27:21.917 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:21.917 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:21.917 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:21.917 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:21.917 INFO:teuthology.orchestra.run.smithi188.stdout: ], 2024-04-01T19:27:21.917 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 2 2024-04-01T19:27:21.917 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:27:22.067 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:27:22.070 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:22.070 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:27:22.171 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:27:22.243 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:22.409 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:27:22.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:22 smithi188 ceph-mon[43939]: pgmap v466: 17 pgs: 17 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.18k op/s 2024-04-01T19:27:22.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:22 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3344115297' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:27:22.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:22 smithi062 ceph-mon[44211]: pgmap v466: 17 pgs: 17 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.18k op/s 2024-04-01T19:27:22.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:22 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3344115297' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:27:22.812 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:22.813 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:22 smithi022 ceph-mon[39439]: pgmap v466: 17 pgs: 17 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.18k op/s 2024-04-01T19:27:22.813 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:22 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3344115297' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:27:22.814 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:27:22.814 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:27:22.858 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_blocked_ops 2024-04-01T19:27:22.914 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:27:22.967 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:23.252 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:27:23.643 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:23 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:27:23.643 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:23 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:27:23.643 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:23 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:27:23.644 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:23 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3344115297' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:27:23.644 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:23 smithi022 ceph-mon[39439]: osdmap e152: 12 total, 12 up, 12 in 2024-04-01T19:27:23.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:23 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:27:23.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:23 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:27:23.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:23 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:27:23.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:23 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3344115297' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:27:23.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:23 smithi062 ceph-mon[44211]: osdmap e152: 12 total, 12 up, 12 in 2024-04-01T19:27:23.809 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:23 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:27:23.809 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:23 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:27:23.809 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:23 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:27:23.809 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:23 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3344115297' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:27:23.809 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:23 smithi188 ceph-mon[43939]: osdmap e152: 12 total, 12 up, 12 in 2024-04-01T19:27:23.937 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:27:23.975 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:27:23.999 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:27:24.035 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:27:24.072 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:27:24.114 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:27:24.143 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:27:24.184 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:27:24.225 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:27:24.234 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:27:24.243 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:24.243 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:27:24.263 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:27:24.287 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:27:24.318 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:27:24.336 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:27:24.336 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:27:24.336 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:27:24.336 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:27:24.336 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:27:24.336 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:27:24.336 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:27:24.336 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:27:24.336 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:27:24.336 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:27:24.336 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:27:24.336 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:27:24.344 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:27:24.375 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:24.397 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:27:24.399 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:24.400 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:27:24.501 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:27:24.543 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:24.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:24 smithi022 ceph-mon[39439]: pgmap v468: 17 pgs: 17 active+clean; 7.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:27:24.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:24 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3157002729' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:27:24.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:24.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:24.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:24.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:24 smithi188 ceph-mon[43939]: pgmap v468: 17 pgs: 17 active+clean; 7.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:27:24.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:24 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3157002729' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:27:24.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:24.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:24.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:24.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:24 smithi062 ceph-mon[44211]: pgmap v468: 17 pgs: 17 active+clean; 7.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:27:24.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:24 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3157002729' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:27:24.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:24.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:24.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:24.811 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:27:24.817 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:24.817 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:27:24.918 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:27:24.946 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:24.967 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:27:24.969 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:24.969 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:27:25.070 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:27:25.111 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:25.190 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:27:25.197 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:25.197 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:27:25.298 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:27:25.334 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:25.361 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:27:25.364 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:25.365 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:27:25.466 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:27:25.504 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:25.536 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:25.537 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:27:25.537 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:27:25.545 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:27:25.545 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:27:25.638 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:27:25.668 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.668 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.669 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.669 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.669 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.669 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.669 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.669 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.669 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.671 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:25.693 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:27:25.698 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:25.699 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:27:25.799 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:27:25.830 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.830 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.830 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.830 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.831 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.831 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.831 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.831 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.831 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.832 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:25.861 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:27:25.867 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:25.868 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:27:25.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:25.968 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:27:26.001 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:26.021 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:27:26.024 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:26.025 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:27:26.126 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:27:26.159 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:26.233 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:27:26.476 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_historic_ops 2024-04-01T19:27:26.514 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:27:26.518 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:26.518 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:27:26.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:26 smithi022 ceph-mon[39439]: pgmap v469: 17 pgs: 17 active+clean; 6.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:27:26.619 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:27:26.651 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:26.673 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:27:26.678 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:27:26.679 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:26 smithi062 ceph-mon[44211]: pgmap v469: 17 pgs: 17 active+clean; 6.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:27:26.680 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:26.681 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:27:26.782 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:27:26.823 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:26.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:26 smithi188 ceph-mon[43939]: pgmap v469: 17 pgs: 17 active+clean; 6.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:27:26.878 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:27:26.972 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:27:26.974 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:26.975 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:27:27.076 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:27:27.116 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:27.130 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:27:27.169 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:27:27.176 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:27.176 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:27:27.277 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:27:27.309 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:27.338 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:27:27.341 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:27.341 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:27:27.442 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:27:27.483 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:27.606 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:27:27.608 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:27.609 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:27:27.709 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:27:27.752 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:27 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:27:27.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:27 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:27:27.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:27 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:27:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:27 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:27:27.762 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:27.822 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:27:27.828 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:27.828 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:27:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:27 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:27:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:27 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:27:27.929 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:27:27.969 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:28.197 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:27:28.214 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:27:28.216 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:28.217 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:27:28.318 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:27:28.372 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:28.433 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:27:28.436 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:28.436 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:27:28.537 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:27:28.567 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:28.590 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:27:28.593 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:28.593 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:27:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:28 smithi188 ceph-mon[43939]: pgmap v470: 17 pgs: 17 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:27:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:28 smithi188 ceph-mon[43939]: osdmap e153: 12 total, 12 up, 12 in 2024-04-01T19:27:28.693 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:27:28.734 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:28 smithi022 ceph-mon[39439]: pgmap v470: 17 pgs: 17 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:27:28.734 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:28 smithi022 ceph-mon[39439]: osdmap e153: 12 total, 12 up, 12 in 2024-04-01T19:27:28.752 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:28 smithi062 ceph-mon[44211]: pgmap v470: 17 pgs: 17 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:27:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:28 smithi062 ceph-mon[44211]: osdmap e153: 12 total, 12 up, 12 in 2024-04-01T19:27:29.121 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:27:29.121 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:27:29.165 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:27:29.170 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:29.171 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:27:29.272 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:27:29.305 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:29.327 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:27:29.334 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:29.334 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:27:29.435 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:27:29.473 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:29.769 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:27:29.780 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:29.780 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:27:29.872 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_ops_in_flight 2024-04-01T19:27:29.881 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:27:29.931 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:30.150 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:27:30.160 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:30.161 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:27:30.259 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:27:30.261 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:27:30.303 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:30.440 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:27:30.452 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:30.452 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:27:30.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:30 smithi022 ceph-mon[39439]: pgmap v472: 17 pgs: 17 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:27:30.456 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:30 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/413569335' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:27:30.456 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:30 smithi022 ceph-mon[39439]: from='client.34928 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:27:30.530 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:27:30.553 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:27:30.567 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:27:30.589 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:27:30.608 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:30.627 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:27:30.642 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:27:30.646 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:30.647 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:27:30.655 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:27:30.679 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:27:30.716 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:27:30.738 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:27:30.748 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:27:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:30 smithi062 ceph-mon[44211]: pgmap v472: 17 pgs: 17 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:27:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:30 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/413569335' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:27:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:30 smithi062 ceph-mon[44211]: from='client.34928 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:27:30.768 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:27:30.792 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:27:30.803 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:27:30.806 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:30 smithi188 ceph-mon[43939]: pgmap v472: 17 pgs: 17 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:27:30.806 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:30 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/413569335' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:27:30.807 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:30 smithi188 ceph-mon[43939]: from='client.34928 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:27:30.810 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:30.842 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:27:30.853 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:27:30.855 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:30.855 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:27:30.871 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:27:30.885 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:27:30.886 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:27:30.886 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:27:30.886 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:27:30.886 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:27:30.886 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:27:30.886 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:27:30.886 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:27:30.886 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:27:30.886 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:27:30.886 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:27:30.886 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:27:30.956 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:27:30.987 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:31.009 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:27:31.011 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:31.012 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:27:31.113 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:27:31.159 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:31.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:31 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2977255491' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:27:31.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:31 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:27:31.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:31 smithi062 ceph-mon[44211]: from='client.34928 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:27:31.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:31 smithi062 ceph-mon[44211]: osdmap e154: 12 total, 12 up, 12 in 2024-04-01T19:27:31.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:31 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:27:31.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:31 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:27:31.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:31 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2977255491' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:27:31.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:31 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:27:31.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:31 smithi022 ceph-mon[39439]: from='client.34928 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:27:31.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:31 smithi022 ceph-mon[39439]: osdmap e154: 12 total, 12 up, 12 in 2024-04-01T19:27:31.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:31 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:27:31.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:31 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:27:31.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:31 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2977255491' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:27:31.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:31 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:27:31.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:31 smithi188 ceph-mon[43939]: from='client.34928 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:27:31.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:31 smithi188 ceph-mon[43939]: osdmap e154: 12 total, 12 up, 12 in 2024-04-01T19:27:31.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:31.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:31 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:27:31.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:31 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:27:31.919 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:27:31.926 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:31.926 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:27:32.027 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:27:32.079 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:32.451 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:27:32.456 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:32.456 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:27:32.557 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:27:32.611 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: pgmap v473: 17 pgs: 17 active+clean; 6.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.32k op/s 2024-04-01T19:27:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:27:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:27:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: osdmap e155: 12 total, 12 up, 12 in 2024-04-01T19:27:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {auth=28,config=2,health=12,kv=53,logm=5} crc {auth=3655091712,config=3313370793,health=3122926494,kv=2648069041,logm=511038637}) 2024-04-01T19:27:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3411214442}) 2024-04-01T19:27:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2297863081}) 2024-04-01T19:27:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2718597491}) 2024-04-01T19:27:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=794743645}) 2024-04-01T19:27:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2623089323}) 2024-04-01T19:27:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3701432068}) 2024-04-01T19:27:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=501842337}) 2024-04-01T19:27:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1427610345}) 2024-04-01T19:27:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2175353730}) 2024-04-01T19:27:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=904533792}) 2024-04-01T19:27:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1574506417}) 2024-04-01T19:27:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4170560483}) 2024-04-01T19:27:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1398843995}) 2024-04-01T19:27:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3967929430}) 2024-04-01T19:27:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1360973572}) 2024-04-01T19:27:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2008213584}) 2024-04-01T19:27:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1059302916}) 2024-04-01T19:27:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1466132610}) 2024-04-01T19:27:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4075246814}) 2024-04-01T19:27:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=784761154}) 2024-04-01T19:27:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4054152017}) 2024-04-01T19:27:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=382156802}) 2024-04-01T19:27:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=628043968}) 2024-04-01T19:27:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2085453682}) 2024-04-01T19:27:32.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=646928951}) 2024-04-01T19:27:32.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=85,mdsmap=3,mgr=12} crc {logm=4067097275,mdsmap=2840952586,mgr=48798733}) 2024-04-01T19:27:32.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mgr=6,mgr_command_descs=1,mgr_metadata=2,mgrstat=9,mon_config_key=82} crc {mgr=1880327694,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=1627343907,mon_config_key=4211860601}) 2024-04-01T19:27:32.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=3475949768}) 2024-04-01T19:27:32.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=2752990102}) 2024-04-01T19:27:32.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=4,monmap=5,osd_metadata=12,osd_pg_creating=1,osdmap=78} crc {mon_config_key=4136163978,monmap=3338646291,osd_metadata=2033258519,osd_pg_creating=2209559030,osdmap=2666954381}) 2024-04-01T19:27:32.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=49} crc {osdmap=750387637}) 2024-04-01T19:27:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: pgmap v473: 17 pgs: 17 active+clean; 6.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.32k op/s 2024-04-01T19:27:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:27:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:27:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: osdmap e155: 12 total, 12 up, 12 in 2024-04-01T19:27:32.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {auth=28,config=2,health=12,kv=53,logm=5} crc {auth=3655091712,config=3313370793,health=3122926494,kv=2648069041,logm=511038637}) 2024-04-01T19:27:32.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3411214442}) 2024-04-01T19:27:32.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2297863081}) 2024-04-01T19:27:32.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2718597491}) 2024-04-01T19:27:32.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=794743645}) 2024-04-01T19:27:32.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2623089323}) 2024-04-01T19:27:32.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3701432068}) 2024-04-01T19:27:32.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=501842337}) 2024-04-01T19:27:32.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1427610345}) 2024-04-01T19:27:32.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2175353730}) 2024-04-01T19:27:32.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=904533792}) 2024-04-01T19:27:32.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1574506417}) 2024-04-01T19:27:32.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4170560483}) 2024-04-01T19:27:32.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1398843995}) 2024-04-01T19:27:32.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3967929430}) 2024-04-01T19:27:32.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1360973572}) 2024-04-01T19:27:32.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2008213584}) 2024-04-01T19:27:32.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1059302916}) 2024-04-01T19:27:32.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1466132610}) 2024-04-01T19:27:32.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4075246814}) 2024-04-01T19:27:32.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=784761154}) 2024-04-01T19:27:32.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4054152017}) 2024-04-01T19:27:32.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=382156802}) 2024-04-01T19:27:32.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=628043968}) 2024-04-01T19:27:32.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2085453682}) 2024-04-01T19:27:32.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=646928951}) 2024-04-01T19:27:32.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=85,mdsmap=3,mgr=12} crc {logm=4067097275,mdsmap=2840952586,mgr=48798733}) 2024-04-01T19:27:32.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mgr=6,mgr_command_descs=1,mgr_metadata=2,mgrstat=9,mon_config_key=82} crc {mgr=1880327694,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=1627343907,mon_config_key=4211860601}) 2024-04-01T19:27:32.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=3475949768}) 2024-04-01T19:27:32.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=2752990102}) 2024-04-01T19:27:32.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=4,monmap=5,osd_metadata=12,osd_pg_creating=1,osdmap=78} crc {mon_config_key=4136163978,monmap=3338646291,osd_metadata=2033258519,osd_pg_creating=2209559030,osdmap=2666954381}) 2024-04-01T19:27:32.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=49} crc {osdmap=750387637}) 2024-04-01T19:27:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: pgmap v473: 17 pgs: 17 active+clean; 6.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.32k op/s 2024-04-01T19:27:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:27:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:27:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: osdmap e155: 12 total, 12 up, 12 in 2024-04-01T19:27:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {auth=28,config=2,health=12,kv=53,logm=5} crc {auth=3655091712,config=3313370793,health=3122926494,kv=2648069041,logm=511038637}) 2024-04-01T19:27:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3411214442}) 2024-04-01T19:27:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2297863081}) 2024-04-01T19:27:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2718597491}) 2024-04-01T19:27:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=794743645}) 2024-04-01T19:27:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2623089323}) 2024-04-01T19:27:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3701432068}) 2024-04-01T19:27:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=501842337}) 2024-04-01T19:27:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1427610345}) 2024-04-01T19:27:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2175353730}) 2024-04-01T19:27:32.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=904533792}) 2024-04-01T19:27:32.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1574506417}) 2024-04-01T19:27:32.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4170560483}) 2024-04-01T19:27:32.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1398843995}) 2024-04-01T19:27:32.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3967929430}) 2024-04-01T19:27:32.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1360973572}) 2024-04-01T19:27:32.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2008213584}) 2024-04-01T19:27:32.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1059302916}) 2024-04-01T19:27:32.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1466132610}) 2024-04-01T19:27:32.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4075246814}) 2024-04-01T19:27:32.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=784761154}) 2024-04-01T19:27:32.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4054152017}) 2024-04-01T19:27:32.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=382156802}) 2024-04-01T19:27:32.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=628043968}) 2024-04-01T19:27:32.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2085453682}) 2024-04-01T19:27:32.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=646928951}) 2024-04-01T19:27:32.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=85,mdsmap=3,mgr=12} crc {logm=4067097275,mdsmap=2840952586,mgr=48798733}) 2024-04-01T19:27:32.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mgr=6,mgr_command_descs=1,mgr_metadata=2,mgrstat=9,mon_config_key=82} crc {mgr=1880327694,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=1627343907,mon_config_key=4211860601}) 2024-04-01T19:27:32.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=3475949768}) 2024-04-01T19:27:32.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=2752990102}) 2024-04-01T19:27:32.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=4,monmap=5,osd_metadata=12,osd_pg_creating=1,osdmap=78} crc {mon_config_key=4136163978,monmap=3338646291,osd_metadata=2033258519,osd_pg_creating=2209559030,osdmap=2666954381}) 2024-04-01T19:27:32.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=49} crc {osdmap=750387637}) 2024-04-01T19:27:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:33 smithi062 ceph-mon[44211]: 2.c scrub starts 2024-04-01T19:27:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:33 smithi062 ceph-mon[44211]: 2.1 scrub starts 2024-04-01T19:27:33.801 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-01T19:27:33.801 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:27:33.836 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:33 smithi022 ceph-mon[39439]: 2.c scrub starts 2024-04-01T19:27:33.836 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:33 smithi022 ceph-mon[39439]: 2.1 scrub starts 2024-04-01T19:27:33.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:33 smithi188 ceph-mon[43939]: 2.c scrub starts 2024-04-01T19:27:33.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:33 smithi188 ceph-mon[43939]: 2.1 scrub starts 2024-04-01T19:27:33.899 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:27:34.229 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:27:34.443 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:27:34.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:34 smithi062 ceph-mon[44211]: pgmap v476: 17 pgs: 17 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:27:34.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:34 smithi062 ceph-mon[44211]: 2.a scrub starts 2024-04-01T19:27:34.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:34 smithi062 ceph-mon[44211]: 2.1 scrub ok 2024-04-01T19:27:34.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:34 smithi062 ceph-mon[44211]: 2.c scrub ok 2024-04-01T19:27:34.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:34 smithi062 ceph-mon[44211]: 2.8 scrub starts 2024-04-01T19:27:34.832 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:34 smithi022 ceph-mon[39439]: pgmap v476: 17 pgs: 17 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:27:34.832 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:34 smithi022 ceph-mon[39439]: 2.a scrub starts 2024-04-01T19:27:34.832 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:34 smithi022 ceph-mon[39439]: 2.1 scrub ok 2024-04-01T19:27:34.833 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:34 smithi022 ceph-mon[39439]: 2.c scrub ok 2024-04-01T19:27:34.833 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:34 smithi022 ceph-mon[39439]: 2.8 scrub starts 2024-04-01T19:27:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:34 smithi188 ceph-mon[43939]: pgmap v476: 17 pgs: 17 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:27:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:34 smithi188 ceph-mon[43939]: 2.a scrub starts 2024-04-01T19:27:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:34 smithi188 ceph-mon[43939]: 2.1 scrub ok 2024-04-01T19:27:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:34 smithi188 ceph-mon[43939]: 2.c scrub ok 2024-04-01T19:27:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:34 smithi188 ceph-mon[43939]: 2.8 scrub starts 2024-04-01T19:27:35.182 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:27:35.678 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:35 smithi022 ceph-mon[39439]: 2.e scrub starts 2024-04-01T19:27:35.678 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:35 smithi022 ceph-mon[39439]: 2.a scrub ok 2024-04-01T19:27:35.678 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:35 smithi022 ceph-mon[39439]: 2.8 scrub ok 2024-04-01T19:27:35.687 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:27:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:35 smithi062 ceph-mon[44211]: 2.e scrub starts 2024-04-01T19:27:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:35 smithi062 ceph-mon[44211]: 2.a scrub ok 2024-04-01T19:27:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:35 smithi062 ceph-mon[44211]: 2.8 scrub ok 2024-04-01T19:27:35.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:35 smithi188 ceph-mon[43939]: 2.e scrub starts 2024-04-01T19:27:35.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:35 smithi188 ceph-mon[43939]: 2.a scrub ok 2024-04-01T19:27:35.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:35 smithi188 ceph-mon[43939]: 2.8 scrub ok 2024-04-01T19:27:36.496 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:36 smithi022 ceph-mon[39439]: pgmap v477: 17 pgs: 17 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.28k op/s 2024-04-01T19:27:36.496 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:36 smithi022 ceph-mon[39439]: 2.7 scrub starts 2024-04-01T19:27:36.496 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:36 smithi022 ceph-mon[39439]: 2.2 scrub starts 2024-04-01T19:27:36.497 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:36 smithi022 ceph-mon[39439]: 2.e scrub ok 2024-04-01T19:27:36.497 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:36 smithi022 ceph-mon[39439]: 2.5 scrub starts 2024-04-01T19:27:36.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:36 smithi062 ceph-mon[44211]: pgmap v477: 17 pgs: 17 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.28k op/s 2024-04-01T19:27:36.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:36 smithi062 ceph-mon[44211]: 2.7 scrub starts 2024-04-01T19:27:36.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:36 smithi062 ceph-mon[44211]: 2.2 scrub starts 2024-04-01T19:27:36.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:36 smithi062 ceph-mon[44211]: 2.e scrub ok 2024-04-01T19:27:36.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:36 smithi062 ceph-mon[44211]: 2.5 scrub starts 2024-04-01T19:27:36.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:36 smithi188 ceph-mon[43939]: pgmap v477: 17 pgs: 17 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.28k op/s 2024-04-01T19:27:36.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:36 smithi188 ceph-mon[43939]: 2.7 scrub starts 2024-04-01T19:27:36.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:36 smithi188 ceph-mon[43939]: 2.2 scrub starts 2024-04-01T19:27:36.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:36 smithi188 ceph-mon[43939]: 2.e scrub ok 2024-04-01T19:27:36.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:36 smithi188 ceph-mon[43939]: 2.5 scrub starts 2024-04-01T19:27:37.384 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:27:37.387 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:37.387 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:27:37.488 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:27:37.519 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:37.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:37 smithi022 ceph-mon[39439]: 2.7 scrub ok 2024-04-01T19:27:37.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:37 smithi022 ceph-mon[39439]: 2.9 scrub starts 2024-04-01T19:27:37.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:37 smithi022 ceph-mon[39439]: 2.2 scrub ok 2024-04-01T19:27:37.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:37 smithi022 ceph-mon[39439]: 2.5 scrub ok 2024-04-01T19:27:37.543 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:27:37.546 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:37.546 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:27:37.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:37 smithi188 ceph-mon[43939]: 2.7 scrub ok 2024-04-01T19:27:37.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:37 smithi188 ceph-mon[43939]: 2.9 scrub starts 2024-04-01T19:27:37.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:37 smithi188 ceph-mon[43939]: 2.2 scrub ok 2024-04-01T19:27:37.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:37 smithi188 ceph-mon[43939]: 2.5 scrub ok 2024-04-01T19:27:37.647 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:27:37.675 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:37.698 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:27:37.701 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:37.701 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:27:37.802 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:27:37.841 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:27:37.844 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:37.851 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:27:37.928 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:27:37.932 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:37.933 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:27:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:37 smithi062 ceph-mon[44211]: 2.7 scrub ok 2024-04-01T19:27:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:37 smithi062 ceph-mon[44211]: 2.9 scrub starts 2024-04-01T19:27:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:37 smithi062 ceph-mon[44211]: 2.2 scrub ok 2024-04-01T19:27:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:37 smithi062 ceph-mon[44211]: 2.5 scrub ok 2024-04-01T19:27:38.033 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:27:38.061 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:38.083 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:27:38.086 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:38.086 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:27:38.100 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:27:38.100 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:27:38.100 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-01T19:27:38.100 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:27:38.188 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:27:38.230 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:38.341 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:27:38.343 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:38.343 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:27:38.444 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:27:38.474 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:38.497 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:27:38.499 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:38.500 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:27:38.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:38 smithi022 ceph-mon[39439]: pgmap v478: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:27:38.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:38 smithi022 ceph-mon[39439]: 2.9 scrub ok 2024-04-01T19:27:38.600 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:27:38.640 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:38.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:38 smithi062 ceph-mon[44211]: pgmap v478: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:27:38.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:38 smithi062 ceph-mon[44211]: 2.9 scrub ok 2024-04-01T19:27:38.839 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":478,"stamp":"2024-04-01T19:27:36.695602+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6466044472,"num_objects":98658,"num_object_clones":0,"num_object_copies":197316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98658,"num_whiteouts":0,"num_read":127,"num_read_kb":110,"num_write":236329,"num_write_kb":10716603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160837,"ondisk_log_size":160837,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":13536224,"kb_used_data":12719272,"kb_used_omap":18,"kb_used_meta":816813,"kb_avail":1111405600,"statfs":{"total":1151940427776,"available":1138079334400,"internally_reserved":0,"allocated":13024534528,"data_stored":13019892384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":836416825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,0,7,6,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-616562688,"num_objects":-9408,"num_object_clones":0,"num_object_copies":-18816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-9408,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9408,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.011931"},"pg_stats":[{"pgid":"2.f","version":"155'16925","reported_seq":17245,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:32.605865+0000","last_change":"2024-04-01T19:27:13.306713+0000","last_active":"2024-04-01T19:27:32.605865+0000","last_peered":"2024-04-01T19:27:32.605865+0000","last_clean":"2024-04-01T19:27:32.605865+0000","last_became_active":"2024-04-01T19:24:51.843914+0000","last_became_peered":"2024-04-01T19:24:51.843914+0000","last_unstale":"2024-04-01T19:27:32.605865+0000","last_undegraded":"2024-04-01T19:27:32.605865+0000","last_fullsized":"2024-04-01T19:27:32.605865+0000","mapping_epoch":106,"log_start":"128'6902","ondisk_log_start":"128'6902","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'15495","last_scrub_stamp":"2024-04-01T19:27:13.306569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:13.306569+0000","objects_scrubbed":7722,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:32.127625+0000","scrub_duration":1481,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":409010176,"num_objects":6241,"num_object_clones":0,"num_object_copies":12482,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6241,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14491,"num_write_kb":663424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"155'17960","reported_seq":18331,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:34.583620+0000","last_change":"2024-04-01T19:26:59.485622+0000","last_active":"2024-04-01T19:27:34.583620+0000","last_peered":"2024-04-01T19:27:34.583620+0000","last_clean":"2024-04-01T19:27:34.583620+0000","last_became_active":"2024-04-01T19:24:52.198710+0000","last_became_peered":"2024-04-01T19:24:52.198710+0000","last_unstale":"2024-04-01T19:27:34.583620+0000","last_undegraded":"2024-04-01T19:27:34.583620+0000","last_fullsized":"2024-04-01T19:27:34.583620+0000","mapping_epoch":106,"log_start":"130'7900","ondisk_log_start":"130'7900","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"147'15383","last_scrub_stamp":"2024-04-01T19:26:59.485355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:26:59.485355+0000","objects_scrubbed":8652,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:05.123929+0000","scrub_duration":2055,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394395648,"num_objects":6018,"num_object_clones":0,"num_object_copies":12036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6018,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14740,"num_write_kb":664256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"155'14579","reported_seq":14792,"reported_epoch":155,"state":"active+clean+scrubbing","last_fresh":"2024-04-01T19:27:35.586185+0000","last_change":"2024-04-01T19:27:35.514678+0000","last_active":"2024-04-01T19:27:35.586185+0000","last_peered":"2024-04-01T19:27:35.586185+0000","last_clean":"2024-04-01T19:27:35.586185+0000","last_became_active":"2024-04-01T19:24:51.845054+0000","last_became_peered":"2024-04-01T19:24:51.845054+0000","last_unstale":"2024-04-01T19:27:35.586185+0000","last_undegraded":"2024-04-01T19:27:35.586185+0000","last_fullsized":"2024-04-01T19:27:35.586185+0000","mapping_epoch":106,"log_start":"121'4500","ondisk_log_start":"121'4500","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"134'9072","last_scrub_stamp":"2024-04-01T19:26:13.293397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:26:13.293397+0000","objects_scrubbed":399,"log_size":10079,"log_dups_size":0,"ondisk_log_size":10079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"scrubbing for 0s","scrub_duration":1565,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401670144,"num_objects":6129,"num_object_clones":0,"num_object_copies":12258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14579,"num_write_kb":662656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"155'14883","reported_seq":15157,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:36.353721+0000","last_change":"2024-04-01T19:27:33.457495+0000","last_active":"2024-04-01T19:27:36.353721+0000","last_peered":"2024-04-01T19:27:36.353721+0000","last_clean":"2024-04-01T19:27:36.353721+0000","last_became_active":"2024-04-01T19:24:51.840851+0000","last_became_peered":"2024-04-01T19:24:51.840851+0000","last_unstale":"2024-04-01T19:27:36.353721+0000","last_undegraded":"2024-04-01T19:27:36.353721+0000","last_fullsized":"2024-04-01T19:27:36.353721+0000","mapping_epoch":106,"log_start":"122'4800","ondisk_log_start":"122'4800","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'14702","last_scrub_stamp":"2024-04-01T19:27:33.457312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:33.457312+0000","objects_scrubbed":6191,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:51.123854+0000","scrub_duration":1171,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390922240,"num_objects":5965,"num_object_clones":0,"num_object_copies":11930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5965,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14883,"num_write_kb":667136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"155'14744","reported_seq":14949,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:35.544296+0000","last_change":"2024-04-01T19:26:11.304712+0000","last_active":"2024-04-01T19:27:35.544296+0000","last_peered":"2024-04-01T19:27:35.544296+0000","last_clean":"2024-04-01T19:27:35.544296+0000","last_became_active":"2024-04-01T19:24:51.845477+0000","last_became_peered":"2024-04-01T19:24:51.845477+0000","last_unstale":"2024-04-01T19:27:35.544296+0000","last_undegraded":"2024-04-01T19:27:35.544296+0000","last_fullsized":"2024-04-01T19:27:35.544296+0000","mapping_epoch":106,"log_start":"122'4700","ondisk_log_start":"122'4700","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"134'9009","last_scrub_stamp":"2024-04-01T19:26:11.304493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:26:11.304493+0000","objects_scrubbed":8946,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1631,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400293888,"num_objects":6108,"num_object_clones":0,"num_object_copies":12216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14744,"num_write_kb":667264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'137","reported_seq":471,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:31.789998+0000","last_change":"2024-04-01T19:26:10.499816+0000","last_active":"2024-04-01T19:27:31.789998+0000","last_peered":"2024-04-01T19:27:31.789998+0000","last_clean":"2024-04-01T19:27:31.789998+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:27:31.789998+0000","last_undegraded":"2024-04-01T19:27:31.789998+0000","last_fullsized":"2024-04-01T19:27:31.789998+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'137","last_scrub_stamp":"2024-04-01T19:26:10.499680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:18:35.244165+0000","last_clean_scrub_stamp":"2024-04-01T19:26:10.499680+0000","objects_scrubbed":2,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:27:38.991106+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"155'14988","reported_seq":15292,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:32.901312+0000","last_change":"2024-04-01T19:27:00.239485+0000","last_active":"2024-04-01T19:27:32.901312+0000","last_peered":"2024-04-01T19:27:32.901312+0000","last_clean":"2024-04-01T19:27:32.901312+0000","last_became_active":"2024-04-01T19:24:51.846976+0000","last_became_peered":"2024-04-01T19:24:51.846976+0000","last_unstale":"2024-04-01T19:27:32.901312+0000","last_undegraded":"2024-04-01T19:27:32.901312+0000","last_fullsized":"2024-04-01T19:27:32.901312+0000","mapping_epoch":106,"log_start":"122'4900","ondisk_log_start":"122'4900","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'12500","last_scrub_stamp":"2024-04-01T19:27:00.239306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:00.239306+0000","objects_scrubbed":8865,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:27.390519+0000","scrub_duration":1530,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414973952,"num_objects":6332,"num_object_clones":0,"num_object_copies":12664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6332,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14988,"num_write_kb":682240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10],"acting":[7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"155'14529","reported_seq":14743,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:32.620170+0000","last_change":"2024-04-01T19:26:26.597668+0000","last_active":"2024-04-01T19:27:32.620170+0000","last_peered":"2024-04-01T19:27:32.620170+0000","last_clean":"2024-04-01T19:27:32.620170+0000","last_became_active":"2024-04-01T19:24:52.198744+0000","last_became_peered":"2024-04-01T19:24:52.198744+0000","last_unstale":"2024-04-01T19:27:32.620170+0000","last_undegraded":"2024-04-01T19:27:32.620170+0000","last_fullsized":"2024-04-01T19:27:32.620170+0000","mapping_epoch":106,"log_start":"120'4500","ondisk_log_start":"120'4500","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"138'9931","last_scrub_stamp":"2024-04-01T19:26:26.597466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:26:26.597466+0000","objects_scrubbed":9867,"log_size":10029,"log_dups_size":0,"ondisk_log_size":10029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405995520,"num_objects":6195,"num_object_clones":0,"num_object_copies":12390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6195,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14529,"num_write_kb":663168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.6","version":"155'14814","reported_seq":15020,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:34.601882+0000","last_change":"2024-04-01T19:26:11.371794+0000","last_active":"2024-04-01T19:27:34.601882+0000","last_peered":"2024-04-01T19:27:34.601882+0000","last_clean":"2024-04-01T19:27:34.601882+0000","last_became_active":"2024-04-01T19:24:51.841944+0000","last_became_peered":"2024-04-01T19:24:51.841944+0000","last_unstale":"2024-04-01T19:27:34.601882+0000","last_undegraded":"2024-04-01T19:27:34.601882+0000","last_fullsized":"2024-04-01T19:27:34.601882+0000","mapping_epoch":106,"log_start":"122'4800","ondisk_log_start":"122'4800","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"134'9006","last_scrub_stamp":"2024-04-01T19:26:11.371553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:26:11.371553+0000","objects_scrubbed":8922,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:27:40.078362+0000","scrub_duration":2074,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401997824,"num_objects":6134,"num_object_clones":0,"num_object_copies":12268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14814,"num_write_kb":670336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"155'14787","reported_seq":14994,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:32.318597+0000","last_change":"2024-04-01T19:26:11.898403+0000","last_active":"2024-04-01T19:27:32.318597+0000","last_peered":"2024-04-01T19:27:32.318597+0000","last_clean":"2024-04-01T19:27:32.318597+0000","last_became_active":"2024-04-01T19:24:51.841813+0000","last_became_peered":"2024-04-01T19:24:51.841813+0000","last_unstale":"2024-04-01T19:27:32.318597+0000","last_undegraded":"2024-04-01T19:27:32.318597+0000","last_fullsized":"2024-04-01T19:27:32.318597+0000","mapping_epoch":106,"log_start":"121'4700","ondisk_log_start":"121'4700","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"134'9165","last_scrub_stamp":"2024-04-01T19:26:11.898287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:26:11.898287+0000","objects_scrubbed":9112,"log_size":10087,"log_dups_size":0,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:27:33.474911+0000","scrub_duration":1388,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415956992,"num_objects":6347,"num_object_clones":0,"num_object_copies":12694,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6347,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14787,"num_write_kb":676288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.8","version":"155'14774","reported_seq":14983,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:32.910991+0000","last_change":"2024-04-01T19:26:14.239595+0000","last_active":"2024-04-01T19:27:32.910991+0000","last_peered":"2024-04-01T19:27:32.910991+0000","last_clean":"2024-04-01T19:27:32.910991+0000","last_became_active":"2024-04-01T19:24:51.846809+0000","last_became_peered":"2024-04-01T19:24:51.846809+0000","last_unstale":"2024-04-01T19:27:32.910991+0000","last_undegraded":"2024-04-01T19:27:32.910991+0000","last_fullsized":"2024-04-01T19:27:32.910991+0000","mapping_epoch":106,"log_start":"121'4700","ondisk_log_start":"121'4700","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"134'9311","last_scrub_stamp":"2024-04-01T19:26:14.239440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:26:14.239440+0000","objects_scrubbed":9238,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1737,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408158208,"num_objects":6228,"num_object_clones":0,"num_object_copies":12456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6228,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14774,"num_write_kb":672064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.9","version":"155'14839","reported_seq":15045,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:34.615625+0000","last_change":"2024-04-01T19:26:09.309034+0000","last_active":"2024-04-01T19:27:34.615625+0000","last_peered":"2024-04-01T19:27:34.615625+0000","last_clean":"2024-04-01T19:27:34.615625+0000","last_became_active":"2024-04-01T19:24:51.844271+0000","last_became_peered":"2024-04-01T19:24:51.844271+0000","last_unstale":"2024-04-01T19:27:34.615625+0000","last_undegraded":"2024-04-01T19:27:34.615625+0000","last_fullsized":"2024-04-01T19:27:34.615625+0000","mapping_epoch":106,"log_start":"122'4800","ondisk_log_start":"122'4800","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"134'8934","last_scrub_stamp":"2024-04-01T19:26:09.308935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:26:09.308935+0000","objects_scrubbed":8866,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"queued for scrub","scrub_duration":2005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400621568,"num_objects":6113,"num_object_clones":0,"num_object_copies":12226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14839,"num_write_kb":670464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"155'14816","reported_seq":15096,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:35.028558+0000","last_change":"2024-04-01T19:27:34.480317+0000","last_active":"2024-04-01T19:27:35.028558+0000","last_peered":"2024-04-01T19:27:35.028558+0000","last_clean":"2024-04-01T19:27:35.028558+0000","last_became_active":"2024-04-01T19:24:51.842274+0000","last_became_peered":"2024-04-01T19:24:51.842274+0000","last_unstale":"2024-04-01T19:27:35.028558+0000","last_undegraded":"2024-04-01T19:27:35.028558+0000","last_fullsized":"2024-04-01T19:27:35.028558+0000","mapping_epoch":106,"log_start":"122'4800","ondisk_log_start":"122'4800","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'14767","last_scrub_stamp":"2024-04-01T19:27:34.480145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:34.480145+0000","objects_scrubbed":6215,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:29:02.512702+0000","scrub_duration":1477,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400949248,"num_objects":6118,"num_object_clones":0,"num_object_copies":12236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6118,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14816,"num_write_kb":669888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.b","version":"155'14623","reported_seq":14835,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:32.598151+0000","last_change":"2024-04-01T19:26:18.652424+0000","last_active":"2024-04-01T19:27:32.598151+0000","last_peered":"2024-04-01T19:27:32.598151+0000","last_clean":"2024-04-01T19:27:32.598151+0000","last_became_active":"2024-04-01T19:24:51.842971+0000","last_became_peered":"2024-04-01T19:24:51.842971+0000","last_unstale":"2024-04-01T19:27:32.598151+0000","last_undegraded":"2024-04-01T19:27:32.598151+0000","last_fullsized":"2024-04-01T19:27:32.598151+0000","mapping_epoch":106,"log_start":"121'4600","ondisk_log_start":"121'4600","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"135'9592","last_scrub_stamp":"2024-04-01T19:26:18.652305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:26:18.652305+0000","objects_scrubbed":9528,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:27:40.870902+0000","scrub_duration":1886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414253056,"num_objects":6321,"num_object_clones":0,"num_object_copies":12642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6321,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14623,"num_write_kb":670208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.c","version":"155'14807","reported_seq":15084,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:35.041196+0000","last_change":"2024-04-01T19:27:33.489195+0000","last_active":"2024-04-01T19:27:35.041196+0000","last_peered":"2024-04-01T19:27:35.041196+0000","last_clean":"2024-04-01T19:27:35.041196+0000","last_became_active":"2024-04-01T19:24:52.198867+0000","last_became_peered":"2024-04-01T19:24:52.198867+0000","last_unstale":"2024-04-01T19:27:35.041196+0000","last_undegraded":"2024-04-01T19:27:35.041196+0000","last_fullsized":"2024-04-01T19:27:35.041196+0000","mapping_epoch":106,"log_start":"122'4800","ondisk_log_start":"122'4800","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'14706","last_scrub_stamp":"2024-04-01T19:27:33.489026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:33.489026+0000","objects_scrubbed":6402,"log_size":10007,"log_dups_size":0,"ondisk_log_size":10007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:53.922044+0000","scrub_duration":1478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":409665536,"num_objects":6251,"num_object_clones":0,"num_object_copies":12502,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6251,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14807,"num_write_kb":673856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.d","version":"155'14607","reported_seq":14816,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:34.435132+0000","last_change":"2024-04-01T19:26:16.548547+0000","last_active":"2024-04-01T19:27:34.435132+0000","last_peered":"2024-04-01T19:27:34.435132+0000","last_clean":"2024-04-01T19:27:34.435132+0000","last_became_active":"2024-04-01T19:24:51.843633+0000","last_became_peered":"2024-04-01T19:24:51.843633+0000","last_unstale":"2024-04-01T19:27:34.435132+0000","last_undegraded":"2024-04-01T19:27:34.435132+0000","last_fullsized":"2024-04-01T19:27:34.435132+0000","mapping_epoch":106,"log_start":"121'4600","ondisk_log_start":"121'4600","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"134'9310","last_scrub_stamp":"2024-04-01T19:26:16.548393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:26:16.548393+0000","objects_scrubbed":9253,"log_size":10007,"log_dups_size":0,"ondisk_log_size":10007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:27:38.351651+0000","scrub_duration":1538,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":397672472,"num_objects":6069,"num_object_clones":0,"num_object_copies":12138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6069,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14607,"num_write_kb":661569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4],"acting":[9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.e","version":"155'15127","reported_seq":15406,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:36.398790+0000","last_change":"2024-04-01T19:27:35.639198+0000","last_active":"2024-04-01T19:27:36.398790+0000","last_peered":"2024-04-01T19:27:36.398790+0000","last_clean":"2024-04-01T19:27:36.398790+0000","last_became_active":"2024-04-01T19:24:51.841004+0000","last_became_peered":"2024-04-01T19:24:51.841004+0000","last_unstale":"2024-04-01T19:27:36.398790+0000","last_undegraded":"2024-04-01T19:27:36.398790+0000","last_fullsized":"2024-04-01T19:27:36.398790+0000","mapping_epoch":106,"log_start":"122'5100","ondisk_log_start":"122'5100","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'15068","last_scrub_stamp":"2024-04-01T19:27:35.639028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:35.639028+0000","objects_scrubbed":6185,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:57.858982+0000","scrub_duration":1356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398917632,"num_objects":6087,"num_object_clones":0,"num_object_copies":12174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6087,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15127,"num_write_kb":678848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":6465454104,"num_objects":98656,"num_object_clones":0,"num_object_copies":197312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98656,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":236148,"num_write_kb":10713665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12955033600,"data_stored":12955025456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160700,"ondisk_log_size":160700,"up":32,"acting":32,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220220,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1254528,"kb_used_data":1187256,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":92490624,"statfs":{"total":95995035648,"available":94710398976,"internally_reserved":0,"allocated":1215750144,"data_stored":1215359000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":68876740},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":77,"seq":330712481855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":869552,"kb_used_data":824484,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":92875600,"statfs":{"total":95995035648,"available":95104614400,"internally_reserved":0,"allocated":844271616,"data_stored":843890026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":46135744},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678086,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1250812,"kb_used_data":1175220,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":92494340,"statfs":{"total":95995035648,"available":94714204160,"internally_reserved":0,"allocated":1203425280,"data_stored":1203033636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":77396416},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":63,"seq":270582939722,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1726000,"kb_used_data":1618468,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":92019152,"statfs":{"total":95995035648,"available":94227611648,"internally_reserved":0,"allocated":1657311232,"data_stored":1656929662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,2,3,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234064,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1282248,"kb_used_data":1206648,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":92462904,"statfs":{"total":95995035648,"available":94682013696,"internally_reserved":0,"allocated":1235607552,"data_stored":1235216428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":77396426},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528405,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":446896,"kb_used_data":411556,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93298256,"statfs":{"total":95995035648,"available":95537414144,"internally_reserved":0,"allocated":421433344,"data_stored":421051774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574958,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1681528,"kb_used_data":1569840,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":92063624,"statfs":{"total":95995035648,"available":94273150976,"internally_reserved":0,"allocated":1607516160,"data_stored":1607128588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738485,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1248568,"kb_used_data":1177136,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":92496584,"statfs":{"total":95995035648,"available":94716502016,"internally_reserved":0,"allocated":1205387264,"data_stored":1204999692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346027,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1237240,"kb_used_data":1161648,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":92507912,"statfs":{"total":95995035648,"available":94728101888,"internally_reserved":0,"allocated":1189527552,"data_stored":1189139980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149795,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1290928,"kb_used_data":1219492,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":92454224,"statfs":{"total":95995035648,"available":94673125376,"internally_reserved":0,"allocated":1248759808,"data_stored":1248378238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73136583},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953567,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":418108,"kb_used_data":382772,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93327044,"statfs":{"total":95995035648,"available":95566893056,"internally_reserved":0,"allocated":391958528,"data_stored":391566884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790043,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":829816,"kb_used_data":784752,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":92915336,"statfs":{"total":95995035648,"available":95145304064,"internally_reserved":0,"allocated":803586048,"data_stored":803198476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1198653440,"data_stored":1198653440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1603338240,"data_stored":1603338240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1187643392,"data_stored":1187643392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1235812352,"data_stored":1235812352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":390467584,"data_stored":390463512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":801964032,"data_stored":801964032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":415956992,"data_stored":415956992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1231355904,"data_stored":1231355904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":1639645184,"data_stored":1639645184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":1200492544,"data_stored":1200488472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":835387392,"data_stored":835387392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":1214316544,"data_stored":1214316544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:27:38.841 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:27:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:38 smithi188 ceph-mon[43939]: pgmap v478: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:27:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:38 smithi188 ceph-mon[43939]: 2.9 scrub ok 2024-04-01T19:27:38.973 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_blocked_ops 2024-04-01T19:27:39.348 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:27:39.411 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:27:39.414 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:39.415 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:27:39.516 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:27:39.531 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:27:39.531 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:27:39.531 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:27:39.531 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:27:39.531 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:27:39.531 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:27:39.531 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:27:39.535 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:27:39.555 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:39.579 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:27:39.619 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:27:39.642 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:27:39.650 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:39.650 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:27:39.655 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:27:39.687 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:27:39.689 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:27:39.689 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:27:39.689 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:27:39.689 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:27:39.689 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:27:39.689 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:27:39.689 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:27:39.689 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:27:39.689 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:27:39.689 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:27:39.689 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:27:39.689 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:27:39.715 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:39 smithi022 ceph-mon[39439]: from='client.34940 v1:172.21.15.22:0/147872224' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:27:39.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:39 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1404018064' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:27:39.751 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:27:39.799 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:39.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:39 smithi188 ceph-mon[43939]: from='client.34940 v1:172.21.15.22:0/147872224' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:27:39.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:39 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1404018064' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:27:39.937 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:27:39.939 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:39.940 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:27:40.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:39 smithi062 ceph-mon[44211]: from='client.34940 v1:172.21.15.22:0/147872224' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:27:40.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:39 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1404018064' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:27:40.040 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:27:40.086 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:40.304 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:27:40.313 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:40.313 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:27:40.414 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:27:40.477 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:40.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:40 smithi188 ceph-mon[43939]: pgmap v479: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:27:40.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:40 smithi022 ceph-mon[39439]: pgmap v479: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:27:40.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.761 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.761 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.761 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.841 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:27:40.847 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:27:40.850 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:40.851 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:27:40.952 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:27:40.984 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:40 smithi062 ceph-mon[44211]: pgmap v479: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:27:40.984 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.984 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.984 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.984 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.984 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.984 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.984 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.985 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.985 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.985 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.985 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:40.987 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:41.012 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:27:41.014 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:41.015 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:27:41.116 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:27:41.156 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:41.283 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:27:41.288 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:41.289 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:27:41.389 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:27:41.438 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:41.599 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:27:41.618 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:27:41.619 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:27:41.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:41 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:41.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:41 smithi022 ceph-mon[39439]: 2.3 scrub starts 2024-04-01T19:27:41.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:41 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3280026674' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:27:41.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:41 smithi022 ceph-mon[39439]: from='client.34952 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:27:41.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:41 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:41.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:41 smithi188 ceph-mon[43939]: 2.3 scrub starts 2024-04-01T19:27:41.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:41 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3280026674' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:27:41.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:41 smithi188 ceph-mon[43939]: from='client.34952 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:27:42.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:41 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:42.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:41 smithi062 ceph-mon[44211]: 2.3 scrub starts 2024-04-01T19:27:42.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:41 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3280026674' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:27:42.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:41 smithi062 ceph-mon[44211]: from='client.34952 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:27:42.430 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:27:42.438 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:42.438 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:27:42.486 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_historic_ops 2024-04-01T19:27:42.539 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:27:42.619 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:42.663 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:27:42.667 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:42.667 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:27:42.768 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:27:42.800 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:27:42.813 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:42 smithi188 ceph-mon[43939]: pgmap v480: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:27:42.813 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:42 smithi188 ceph-mon[43939]: 2.3 scrub ok 2024-04-01T19:27:42.813 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:42 smithi188 ceph-mon[43939]: 2.6 scrub starts 2024-04-01T19:27:42.813 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:42 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:27:42.813 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:42 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:27:42.813 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:42 smithi188 ceph-mon[43939]: from='client.34952 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:27:42.813 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:42 smithi188 ceph-mon[43939]: osdmap e156: 12 total, 12 up, 12 in 2024-04-01T19:27:42.813 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:42 smithi188 ceph-mon[43939]: 1.0 deep-scrub starts 2024-04-01T19:27:42.813 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:42 smithi188 ceph-mon[43939]: 1.0 deep-scrub ok 2024-04-01T19:27:42.814 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:42 smithi188 ceph-mon[43939]: 2.b deep-scrub starts 2024-04-01T19:27:42.816 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:42.840 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:42 smithi022 ceph-mon[39439]: pgmap v480: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:27:42.840 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:42 smithi022 ceph-mon[39439]: 2.3 scrub ok 2024-04-01T19:27:42.840 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:42 smithi022 ceph-mon[39439]: 2.6 scrub starts 2024-04-01T19:27:42.840 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:42 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:27:42.840 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:42 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:27:42.840 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:42 smithi022 ceph-mon[39439]: from='client.34952 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:27:42.840 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:42 smithi022 ceph-mon[39439]: osdmap e156: 12 total, 12 up, 12 in 2024-04-01T19:27:42.840 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:42 smithi022 ceph-mon[39439]: 1.0 deep-scrub starts 2024-04-01T19:27:42.841 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:42 smithi022 ceph-mon[39439]: 1.0 deep-scrub ok 2024-04-01T19:27:42.841 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:42 smithi022 ceph-mon[39439]: 2.b deep-scrub starts 2024-04-01T19:27:42.868 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:27:42.874 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:42.875 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:27:42.906 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:27:42.976 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:27:43.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:42 smithi062 ceph-mon[44211]: pgmap v480: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:27:43.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:42 smithi062 ceph-mon[44211]: 2.3 scrub ok 2024-04-01T19:27:43.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:42 smithi062 ceph-mon[44211]: 2.6 scrub starts 2024-04-01T19:27:43.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:42 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:27:43.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:42 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:27:43.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:42 smithi062 ceph-mon[44211]: from='client.34952 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:27:43.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:42 smithi062 ceph-mon[44211]: osdmap e156: 12 total, 12 up, 12 in 2024-04-01T19:27:43.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:42 smithi062 ceph-mon[44211]: 1.0 deep-scrub starts 2024-04-01T19:27:43.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:42 smithi062 ceph-mon[44211]: 1.0 deep-scrub ok 2024-04-01T19:27:43.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:42 smithi062 ceph-mon[44211]: 2.b deep-scrub starts 2024-04-01T19:27:43.028 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:43.081 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:27:43.086 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:43.086 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:27:43.187 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:27:43.217 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:43.242 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:27:43.245 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:43.246 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:27:43.349 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:27:43.406 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:43.444 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:27:43.450 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:43.451 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:27:43.504 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:27:43.552 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:27:43.581 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:43.604 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:27:43.608 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:43.608 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:27:43.709 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:27:43.738 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:43.763 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:27:43.766 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:43.767 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:27:43.771 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:27:43.775 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:27:43.803 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:43 smithi022 ceph-mon[39439]: 2.6 scrub ok 2024-04-01T19:27:43.867 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:27:43.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:43 smithi188 ceph-mon[43939]: 2.6 scrub ok 2024-04-01T19:27:43.905 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:43.934 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:27:43.944 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:43.944 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:27:44.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:43 smithi062 ceph-mon[44211]: 2.6 scrub ok 2024-04-01T19:27:44.045 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:27:44.077 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:44.102 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:27:44.107 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:44.108 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:27:44.209 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:27:44.247 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:44.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:44 smithi022 ceph-mon[39439]: pgmap v482: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 995 op/s 2024-04-01T19:27:44.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:44 smithi022 ceph-mon[39439]: 2.d deep-scrub starts 2024-04-01T19:27:44.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:44 smithi022 ceph-mon[39439]: from='client.15051 v1:172.21.15.22:0/2000554126' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:27:44.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:44 smithi188 ceph-mon[43939]: pgmap v482: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 995 op/s 2024-04-01T19:27:44.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:44 smithi188 ceph-mon[43939]: 2.d deep-scrub starts 2024-04-01T19:27:44.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:44 smithi188 ceph-mon[43939]: from='client.15051 v1:172.21.15.22:0/2000554126' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:27:44.936 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:27:45.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:44 smithi062 ceph-mon[44211]: pgmap v482: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 995 op/s 2024-04-01T19:27:45.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:44 smithi062 ceph-mon[44211]: 2.d deep-scrub starts 2024-04-01T19:27:45.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:44 smithi062 ceph-mon[44211]: from='client.15051 v1:172.21.15.22:0/2000554126' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:27:45.246 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:27:45.246 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:27:45.584 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:45 smithi022 ceph-mon[39439]: pgmap v483: 17 pgs: 2 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 14 active+clean; 5.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:27:45.747 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":482,"stamp":"2024-04-01T19:27:42.696869+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6085935672,"num_objects":92858,"num_object_clones":0,"num_object_copies":185716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92858,"num_whiteouts":0,"num_read":127,"num_read_kb":110,"num_write":242129,"num_write_kb":10716603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160937,"ondisk_log_size":160937,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":12717576,"kb_used_data":11889312,"kb_used_omap":18,"kb_used_meta":827949,"kb_avail":1112224248,"statfs":{"total":1151940427776,"available":1138917629952,"internally_reserved":0,"allocated":12174655488,"data_stored":12170054225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":847820089},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,3,3,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-653131776,"num_objects":-9966,"num_object_clones":0,"num_object_copies":-19932,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-9966,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9966,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.008731"},"pg_stats":[{"pgid":"2.f","version":"155'17237","reported_seq":17557,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:37.606760+0000","last_change":"2024-04-01T19:27:13.306713+0000","last_active":"2024-04-01T19:27:37.606760+0000","last_peered":"2024-04-01T19:27:37.606760+0000","last_clean":"2024-04-01T19:27:37.606760+0000","last_became_active":"2024-04-01T19:24:51.843914+0000","last_became_peered":"2024-04-01T19:24:51.843914+0000","last_unstale":"2024-04-01T19:27:37.606760+0000","last_undegraded":"2024-04-01T19:27:37.606760+0000","last_fullsized":"2024-04-01T19:27:37.606760+0000","mapping_epoch":106,"log_start":"128'7202","ondisk_log_start":"128'7202","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'15495","last_scrub_stamp":"2024-04-01T19:27:13.306569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:13.306569+0000","objects_scrubbed":7722,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:32.127625+0000","scrub_duration":1481,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388562944,"num_objects":5929,"num_object_clones":0,"num_object_copies":11858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5929,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14803,"num_write_kb":663424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"155'18336","reported_seq":18707,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:39.568179+0000","last_change":"2024-04-01T19:26:59.485622+0000","last_active":"2024-04-01T19:27:39.568179+0000","last_peered":"2024-04-01T19:27:39.568179+0000","last_clean":"2024-04-01T19:27:39.568179+0000","last_became_active":"2024-04-01T19:24:52.198710+0000","last_became_peered":"2024-04-01T19:24:52.198710+0000","last_unstale":"2024-04-01T19:27:39.568179+0000","last_undegraded":"2024-04-01T19:27:39.568179+0000","last_fullsized":"2024-04-01T19:27:39.568179+0000","mapping_epoch":106,"log_start":"130'8300","ondisk_log_start":"130'8300","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"147'15383","last_scrub_stamp":"2024-04-01T19:26:59.485355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:26:59.485355+0000","objects_scrubbed":8652,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:05.123929+0000","scrub_duration":2055,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369754112,"num_objects":5642,"num_object_clones":0,"num_object_copies":11284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5642,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15116,"num_write_kb":664256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"155'14916","reported_seq":15191,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:40.536870+0000","last_change":"2024-04-01T19:27:36.619478+0000","last_active":"2024-04-01T19:27:40.536870+0000","last_peered":"2024-04-01T19:27:40.536870+0000","last_clean":"2024-04-01T19:27:40.536870+0000","last_became_active":"2024-04-01T19:24:51.845054+0000","last_became_peered":"2024-04-01T19:24:51.845054+0000","last_unstale":"2024-04-01T19:27:40.536870+0000","last_undegraded":"2024-04-01T19:27:40.536870+0000","last_fullsized":"2024-04-01T19:27:40.536870+0000","mapping_epoch":106,"log_start":"122'4900","ondisk_log_start":"122'4900","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'14661","last_scrub_stamp":"2024-04-01T19:27:36.619317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:36.619317+0000","objects_scrubbed":6078,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:49.703119+0000","scrub_duration":1103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":379584512,"num_objects":5792,"num_object_clones":0,"num_object_copies":11584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5792,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14916,"num_write_kb":662656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"155'15253","reported_seq":15527,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:41.396733+0000","last_change":"2024-04-01T19:27:33.457495+0000","last_active":"2024-04-01T19:27:41.396733+0000","last_peered":"2024-04-01T19:27:41.396733+0000","last_clean":"2024-04-01T19:27:41.396733+0000","last_became_active":"2024-04-01T19:24:51.840851+0000","last_became_peered":"2024-04-01T19:24:51.840851+0000","last_unstale":"2024-04-01T19:27:41.396733+0000","last_undegraded":"2024-04-01T19:27:41.396733+0000","last_fullsized":"2024-04-01T19:27:41.396733+0000","mapping_epoch":106,"log_start":"122'5200","ondisk_log_start":"122'5200","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'14702","last_scrub_stamp":"2024-04-01T19:27:33.457312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:33.457312+0000","objects_scrubbed":6191,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:51.123854+0000","scrub_duration":1171,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":366673920,"num_objects":5595,"num_object_clones":0,"num_object_copies":11190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5595,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15253,"num_write_kb":667136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"155'15108","reported_seq":15315,"reported_epoch":155,"state":"active+clean+scrubbing","last_fresh":"2024-04-01T19:27:40.584103+0000","last_change":"2024-04-01T19:27:40.568266+0000","last_active":"2024-04-01T19:27:40.584103+0000","last_peered":"2024-04-01T19:27:40.584103+0000","last_clean":"2024-04-01T19:27:40.584103+0000","last_became_active":"2024-04-01T19:24:51.845477+0000","last_became_peered":"2024-04-01T19:24:51.845477+0000","last_unstale":"2024-04-01T19:27:40.584103+0000","last_undegraded":"2024-04-01T19:27:40.584103+0000","last_fullsized":"2024-04-01T19:27:40.584103+0000","mapping_epoch":106,"log_start":"122'5100","ondisk_log_start":"122'5100","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"134'9009","last_scrub_stamp":"2024-04-01T19:26:11.304493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:26:11.304493+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"scrubbing for 0s","scrub_duration":1631,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":376438784,"num_objects":5744,"num_object_clones":0,"num_object_copies":11488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5744,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15108,"num_write_kb":667264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'137","reported_seq":471,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:31.789998+0000","last_change":"2024-04-01T19:26:10.499816+0000","last_active":"2024-04-01T19:27:31.789998+0000","last_peered":"2024-04-01T19:27:31.789998+0000","last_clean":"2024-04-01T19:27:31.789998+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:27:31.789998+0000","last_undegraded":"2024-04-01T19:27:31.789998+0000","last_fullsized":"2024-04-01T19:27:31.789998+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'137","last_scrub_stamp":"2024-04-01T19:26:10.499680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:18:35.244165+0000","last_clean_scrub_stamp":"2024-04-01T19:26:10.499680+0000","objects_scrubbed":2,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:27:38.991106+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"155'15327","reported_seq":15631,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:37.915002+0000","last_change":"2024-04-01T19:27:00.239485+0000","last_active":"2024-04-01T19:27:37.915002+0000","last_peered":"2024-04-01T19:27:37.915002+0000","last_clean":"2024-04-01T19:27:37.915002+0000","last_became_active":"2024-04-01T19:24:51.846976+0000","last_became_peered":"2024-04-01T19:24:51.846976+0000","last_unstale":"2024-04-01T19:27:37.915002+0000","last_undegraded":"2024-04-01T19:27:37.915002+0000","last_fullsized":"2024-04-01T19:27:37.915002+0000","mapping_epoch":106,"log_start":"122'5300","ondisk_log_start":"122'5300","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'12500","last_scrub_stamp":"2024-04-01T19:27:00.239306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:00.239306+0000","objects_scrubbed":8865,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:27.390519+0000","scrub_duration":1530,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392757248,"num_objects":5993,"num_object_clones":0,"num_object_copies":11986,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5993,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15327,"num_write_kb":682240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10],"acting":[7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"155'14876","reported_seq":15158,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:37.625700+0000","last_change":"2024-04-01T19:27:37.103493+0000","last_active":"2024-04-01T19:27:37.625700+0000","last_peered":"2024-04-01T19:27:37.625700+0000","last_clean":"2024-04-01T19:27:37.625700+0000","last_became_active":"2024-04-01T19:24:52.198744+0000","last_became_peered":"2024-04-01T19:24:52.198744+0000","last_unstale":"2024-04-01T19:27:37.625700+0000","last_undegraded":"2024-04-01T19:27:37.625700+0000","last_fullsized":"2024-04-01T19:27:37.625700+0000","mapping_epoch":106,"log_start":"122'4800","ondisk_log_start":"122'4800","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'14839","last_scrub_stamp":"2024-04-01T19:27:37.103325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:37.103325+0000","objects_scrubbed":5930,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:48.378428+0000","scrub_duration":1351,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383254528,"num_objects":5848,"num_object_clones":0,"num_object_copies":11696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5848,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14876,"num_write_kb":663168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.6","version":"155'15155","reported_seq":15361,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:39.616804+0000","last_change":"2024-04-01T19:26:11.371794+0000","last_active":"2024-04-01T19:27:39.616804+0000","last_peered":"2024-04-01T19:27:39.616804+0000","last_clean":"2024-04-01T19:27:39.616804+0000","last_became_active":"2024-04-01T19:24:51.841944+0000","last_became_peered":"2024-04-01T19:24:51.841944+0000","last_unstale":"2024-04-01T19:27:39.616804+0000","last_undegraded":"2024-04-01T19:27:39.616804+0000","last_fullsized":"2024-04-01T19:27:39.616804+0000","mapping_epoch":106,"log_start":"122'5100","ondisk_log_start":"122'5100","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"134'9006","last_scrub_stamp":"2024-04-01T19:26:11.371553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:26:11.371553+0000","objects_scrubbed":8922,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:27:40.078362+0000","scrub_duration":2074,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":379650048,"num_objects":5793,"num_object_clones":0,"num_object_copies":11586,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5793,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15155,"num_write_kb":670336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"156'15433","reported_seq":15712,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-04-01T19:27:42.311576+0000","last_change":"2024-04-01T19:27:36.388074+0000","last_active":"2024-04-01T19:27:42.311576+0000","last_peered":"2024-04-01T19:27:42.311576+0000","last_clean":"2024-04-01T19:27:42.311576+0000","last_became_active":"2024-04-01T19:24:51.841813+0000","last_became_peered":"2024-04-01T19:24:51.841813+0000","last_unstale":"2024-04-01T19:27:42.311576+0000","last_undegraded":"2024-04-01T19:27:42.311576+0000","last_fullsized":"2024-04-01T19:27:42.311576+0000","mapping_epoch":106,"log_start":"123'5400","ondisk_log_start":"123'5400","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'15042","last_scrub_stamp":"2024-04-01T19:27:36.387914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:36.387914+0000","objects_scrubbed":6121,"log_size":10033,"log_dups_size":0,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:29:00.951689+0000","scrub_duration":957,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373620736,"num_objects":5701,"num_object_clones":0,"num_object_copies":11402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5701,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15433,"num_write_kb":676288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.8","version":"155'15084","reported_seq":15362,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:37.914898+0000","last_change":"2024-04-01T19:27:34.704805+0000","last_active":"2024-04-01T19:27:37.914898+0000","last_peered":"2024-04-01T19:27:37.914898+0000","last_clean":"2024-04-01T19:27:37.914898+0000","last_became_active":"2024-04-01T19:24:51.846809+0000","last_became_peered":"2024-04-01T19:24:51.846809+0000","last_unstale":"2024-04-01T19:27:37.914898+0000","last_undegraded":"2024-04-01T19:27:37.914898+0000","last_fullsized":"2024-04-01T19:27:37.914898+0000","mapping_epoch":106,"log_start":"122'5000","ondisk_log_start":"122'5000","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'14875","last_scrub_stamp":"2024-04-01T19:27:34.704678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:34.704678+0000","objects_scrubbed":6151,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:29:02.152153+0000","scrub_duration":917,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":387842048,"num_objects":5918,"num_object_clones":0,"num_object_copies":11836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5918,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15084,"num_write_kb":672064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.9","version":"155'15199","reported_seq":15472,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:39.616501+0000","last_change":"2024-04-01T19:27:37.638095+0000","last_active":"2024-04-01T19:27:39.616501+0000","last_peered":"2024-04-01T19:27:39.616501+0000","last_clean":"2024-04-01T19:27:39.616501+0000","last_became_active":"2024-04-01T19:24:51.844271+0000","last_became_peered":"2024-04-01T19:24:51.844271+0000","last_unstale":"2024-04-01T19:27:39.616501+0000","last_undegraded":"2024-04-01T19:27:39.616501+0000","last_fullsized":"2024-04-01T19:27:39.616501+0000","mapping_epoch":106,"log_start":"122'5100","ondisk_log_start":"122'5100","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'15055","last_scrub_stamp":"2024-04-01T19:27:37.637816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:37.637816+0000","objects_scrubbed":5942,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:46.219744+0000","scrub_duration":1230,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":377028608,"num_objects":5753,"num_object_clones":0,"num_object_copies":11506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5753,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15199,"num_write_kb":670464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"155'15151","reported_seq":15431,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:40.028716+0000","last_change":"2024-04-01T19:27:34.480317+0000","last_active":"2024-04-01T19:27:40.028716+0000","last_peered":"2024-04-01T19:27:40.028716+0000","last_clean":"2024-04-01T19:27:40.028716+0000","last_became_active":"2024-04-01T19:24:51.842274+0000","last_became_peered":"2024-04-01T19:24:51.842274+0000","last_unstale":"2024-04-01T19:27:40.028716+0000","last_undegraded":"2024-04-01T19:27:40.028716+0000","last_fullsized":"2024-04-01T19:27:40.028716+0000","mapping_epoch":106,"log_start":"122'5100","ondisk_log_start":"122'5100","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'14767","last_scrub_stamp":"2024-04-01T19:27:34.480145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:34.480145+0000","objects_scrubbed":6215,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:29:02.512702+0000","scrub_duration":1477,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":378994688,"num_objects":5783,"num_object_clones":0,"num_object_copies":11566,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5783,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15151,"num_write_kb":669888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.b","version":"155'14943","reported_seq":15155,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:37.626995+0000","last_change":"2024-04-01T19:26:18.652424+0000","last_active":"2024-04-01T19:27:37.626995+0000","last_peered":"2024-04-01T19:27:37.626995+0000","last_clean":"2024-04-01T19:27:37.626995+0000","last_became_active":"2024-04-01T19:24:51.842971+0000","last_became_peered":"2024-04-01T19:24:51.842971+0000","last_unstale":"2024-04-01T19:27:37.626995+0000","last_undegraded":"2024-04-01T19:27:37.626995+0000","last_fullsized":"2024-04-01T19:27:37.626995+0000","mapping_epoch":106,"log_start":"122'4900","ondisk_log_start":"122'4900","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"135'9592","last_scrub_stamp":"2024-04-01T19:26:18.652305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:26:18.652305+0000","objects_scrubbed":9528,"log_size":10043,"log_dups_size":0,"ondisk_log_size":10043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:27:40.870902+0000","scrub_duration":1886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393281536,"num_objects":6001,"num_object_clones":0,"num_object_copies":12002,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6001,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14943,"num_write_kb":670208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.c","version":"155'15155","reported_seq":15432,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:40.055313+0000","last_change":"2024-04-01T19:27:33.489195+0000","last_active":"2024-04-01T19:27:40.055313+0000","last_peered":"2024-04-01T19:27:40.055313+0000","last_clean":"2024-04-01T19:27:40.055313+0000","last_became_active":"2024-04-01T19:24:52.198867+0000","last_became_peered":"2024-04-01T19:24:52.198867+0000","last_unstale":"2024-04-01T19:27:40.055313+0000","last_undegraded":"2024-04-01T19:27:40.055313+0000","last_fullsized":"2024-04-01T19:27:40.055313+0000","mapping_epoch":106,"log_start":"122'5100","ondisk_log_start":"122'5100","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'14706","last_scrub_stamp":"2024-04-01T19:27:33.489026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:33.489026+0000","objects_scrubbed":6402,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:53.922044+0000","scrub_duration":1478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":386859008,"num_objects":5903,"num_object_clones":0,"num_object_copies":11806,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5903,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15155,"num_write_kb":673856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.d","version":"155'14938","reported_seq":15147,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:39.355334+0000","last_change":"2024-04-01T19:26:16.548547+0000","last_active":"2024-04-01T19:27:39.355334+0000","last_peered":"2024-04-01T19:27:39.355334+0000","last_clean":"2024-04-01T19:27:39.355334+0000","last_became_active":"2024-04-01T19:24:51.843633+0000","last_became_peered":"2024-04-01T19:24:51.843633+0000","last_unstale":"2024-04-01T19:27:39.355334+0000","last_undegraded":"2024-04-01T19:27:39.355334+0000","last_fullsized":"2024-04-01T19:27:39.355334+0000","mapping_epoch":106,"log_start":"122'4900","ondisk_log_start":"122'4900","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"134'9310","last_scrub_stamp":"2024-04-01T19:26:16.548393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:26:16.548393+0000","objects_scrubbed":9253,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1538,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375980056,"num_objects":5738,"num_object_clones":0,"num_object_copies":11476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5738,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14938,"num_write_kb":661569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4],"acting":[9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.e","version":"155'15491","reported_seq":15770,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-04-01T19:27:41.402968+0000","last_change":"2024-04-01T19:27:35.639198+0000","last_active":"2024-04-01T19:27:41.402968+0000","last_peered":"2024-04-01T19:27:41.402968+0000","last_clean":"2024-04-01T19:27:41.402968+0000","last_became_active":"2024-04-01T19:24:51.841004+0000","last_became_peered":"2024-04-01T19:24:51.841004+0000","last_unstale":"2024-04-01T19:27:41.402968+0000","last_undegraded":"2024-04-01T19:27:41.402968+0000","last_fullsized":"2024-04-01T19:27:41.402968+0000","mapping_epoch":106,"log_start":"123'5400","ondisk_log_start":"123'5400","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'15068","last_scrub_stamp":"2024-04-01T19:27:35.639028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:35.639028+0000","objects_scrubbed":6185,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:57.858982+0000","scrub_duration":1356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375062528,"num_objects":5723,"num_object_clones":0,"num_object_copies":11446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5723,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15491,"num_write_kb":678848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":6085345304,"num_objects":92856,"num_object_clones":0,"num_object_copies":185712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92856,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":241948,"num_write_kb":10713665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12099461120,"data_stored":12099452976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160800,"ondisk_log_size":160800,"up":32,"acting":32,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220221,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1204608,"kb_used_data":1133112,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":92540544,"statfs":{"total":95995035648,"available":94761517056,"internally_reserved":0,"allocated":1160306688,"data_stored":1159915544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":73136580},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":77,"seq":330712481857,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":809208,"kb_used_data":737776,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":92935944,"statfs":{"total":95995035648,"available":95166406656,"internally_reserved":0,"allocated":755482624,"data_stored":755095032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":73136576},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678087,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1175676,"kb_used_data":1112564,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":92569476,"statfs":{"total":95995035648,"available":94791143424,"internally_reserved":0,"allocated":1139265536,"data_stored":1138873892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":64616896},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":63,"seq":270582939723,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1645048,"kb_used_data":1533360,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":92100104,"statfs":{"total":95995035648,"available":94310506496,"internally_reserved":0,"allocated":1570160640,"data_stored":1569773068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234065,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1205184,"kb_used_data":1142072,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":92539968,"statfs":{"total":95995035648,"available":94760927232,"internally_reserved":0,"allocated":1169481728,"data_stored":1169090604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":64616906},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528407,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":408568,"kb_used_data":369072,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93336584,"statfs":{"total":95995035648,"available":95576662016,"internally_reserved":0,"allocated":377929728,"data_stored":377542156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574959,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1576952,"kb_used_data":1477744,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":92168200,"statfs":{"total":95995035648,"available":94380236800,"internally_reserved":0,"allocated":1513209856,"data_stored":1512822284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738486,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1182328,"kb_used_data":1106736,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":92562824,"statfs":{"total":95995035648,"available":94784331776,"internally_reserved":0,"allocated":1133297664,"data_stored":1132910092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346028,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1154616,"kb_used_data":1091504,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":92590536,"statfs":{"total":95995035648,"available":94812708864,"internally_reserved":0,"allocated":1117700096,"data_stored":1117312524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149797,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1148872,"kb_used_data":1085624,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":92596280,"statfs":{"total":95995035648,"available":94818590720,"internally_reserved":0,"allocated":1111678976,"data_stored":1111356293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":64616903},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953568,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":399996,"kb_used_data":360500,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93345156,"statfs":{"total":95995035648,"available":95585439744,"internally_reserved":0,"allocated":369152000,"data_stored":368760356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790044,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":806520,"kb_used_data":739248,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":92938632,"statfs":{"total":95995035648,"available":95169159168,"internally_reserved":0,"allocated":756989952,"data_stored":756602380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1127284736,"data_stored":1127284736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1509621760,"data_stored":1509621760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1115160576,"data_stored":1115160576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1100152832,"data_stored":1100152832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":367464448,"data_stored":367460376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":755826688,"data_stored":755826688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":373620736,"data_stored":373620736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1165230080,"data_stored":1165230080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":1553334272,"data_stored":1553334272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":1136922624,"data_stored":1136918552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":749076480,"data_stored":749076480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":1145765888,"data_stored":1145765888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:27:45.748 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-01T19:27:45.753 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:27:45.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:45 smithi188 ceph-mon[43939]: pgmap v483: 17 pgs: 2 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 14 active+clean; 5.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:27:46.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:45 smithi062 ceph-mon[44211]: pgmap v483: 17 pgs: 2 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 14 active+clean; 5.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:27:46.120 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_ops_in_flight 2024-04-01T19:27:46.309 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:27:46.317 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:46.318 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:27:46.419 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:27:46.464 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:27:46.487 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:27:46.495 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:46.508 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:27:46.525 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:27:46.530 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:46.531 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:27:46.535 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:27:46.557 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:27:46.576 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:27:46.585 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:46 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/298021892' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:27:46.586 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:27:46.616 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:27:46.631 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:27:46.636 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:27:46.666 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:46.670 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:27:46.688 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:27:46.691 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:46.692 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:27:46.695 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:27:46.722 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:27:46.749 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:27:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:27:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:27:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:27:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:27:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:27:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:27:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:27:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:27:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:27:46.752 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:27:46.752 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:27:46.752 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:27:46.792 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:27:46.822 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:46.845 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:27:46.848 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:46 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/298021892' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:27:46.849 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:46.850 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:27:46.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:46 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/298021892' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:27:46.951 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:27:46.999 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:47.032 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:27:47.038 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:47.039 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:27:47.140 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:27:47.179 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:47.223 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:27:47.228 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:47.228 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:27:47.329 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:27:47.382 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:47.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:47.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:47.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:47.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:47.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:47.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:47.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:47.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:47.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:47.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:47.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:47 smithi022 ceph-mon[39439]: pgmap v484: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:27:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:47.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:47.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:47.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:47.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:47 smithi188 ceph-mon[43939]: pgmap v484: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:27:48.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:48.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:48.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:48.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:48.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:48.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:48.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:48.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:48.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:48.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:48.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:47 smithi062 ceph-mon[44211]: pgmap v484: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:27:48.240 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:27:48.247 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:48.247 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:27:48.348 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:27:48.394 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:48.478 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:27:48.481 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:48.481 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:27:48.582 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:27:48.594 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:48 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:48.594 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:48 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:48.645 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:48.750 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:27:48.753 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:48.754 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:27:48.855 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:27:48.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:48 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:48.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:48 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:48.883 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:48 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:48.883 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:48 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:27:48.885 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:48.908 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:27:48.910 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:48.910 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:27:48.930 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:27:48.931 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:27:48.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.931 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(osd.8.0:49984 2.b e156/106 2:d302c845:::benchmark_data_smithi188_77607_object83064:head v 156'16616, mlcod=156'16604)", 2024-04-01T19:27:48.931 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:48.916454+0000", 2024-04-01T19:27:48.931 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.015954090000000001, 2024-04-01T19:27:48.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015994622, 2024-04-01T19:27:48.931 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:48.931 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:48.931 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-01T19:27:48.931 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:48.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:48.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.916454+0000", 2024-04-01T19:27:48.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:48.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:48.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.916454+0000", 2024-04-01T19:27:48.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:48.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:48.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.916455+0000", 2024-04-01T19:27:48.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.116e-06 2024-04-01T19:27:48.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:48.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.916463+0000", 2024-04-01T19:27:48.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6890000000000004e-06 2024-04-01T19:27:48.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:48.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.916475+0000", 2024-04-01T19:27:48.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2369e-05 2024-04-01T19:27:48.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:48.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.916482+0000", 2024-04-01T19:27:48.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8020000000000003e-06 2024-04-01T19:27:48.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:48.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.918857+0000", 2024-04-01T19:27:48.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0023748160000000001 2024-04-01T19:27:48.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:48.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.918879+0000", 2024-04-01T19:27:48.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2163000000000001e-05 2024-04-01T19:27:48.934 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:48.934 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:48.934 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:48.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.934 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(osd.8.0:49985 2.b e156/106 2:d303e594:::benchmark_data_smithi188_77607_object139087:head v 156'16617, mlcod=156'16604)", 2024-04-01T19:27:48.935 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:48.924360+0000", 2024-04-01T19:27:48.935 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0080476520000000006, 2024-04-01T19:27:48.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0081625929999999992, 2024-04-01T19:27:48.935 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:48.935 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:48.935 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-01T19:27:48.935 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:48.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:48.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.924360+0000", 2024-04-01T19:27:48.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:48.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:48.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.924360+0000", 2024-04-01T19:27:48.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:48.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:48.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.924362+0000", 2024-04-01T19:27:48.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.655e-06 2024-04-01T19:27:48.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:48.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.924371+0000", 2024-04-01T19:27:48.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6570000000000003e-06 2024-04-01T19:27:48.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:48.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.924382+0000", 2024-04-01T19:27:48.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1326e-05 2024-04-01T19:27:48.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:48.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.924389+0000", 2024-04-01T19:27:48.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5909999999999998e-06 2024-04-01T19:27:48.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:48.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.924450+0000", 2024-04-01T19:27:48.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0588999999999999e-05 2024-04-01T19:27:48.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:48.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.924469+0000", 2024-04-01T19:27:48.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8624999999999999e-05 2024-04-01T19:27:48.938 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:48.938 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:48.938 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:48.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.938 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(osd.8.0:49987 2.b e156/106 2:d3045164:::benchmark_data_smithi188_77607_object146251:head v 156'16618, mlcod=156'16604)", 2024-04-01T19:27:48.938 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:48.924410+0000", 2024-04-01T19:27:48.938 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0079980399999999997, 2024-04-01T19:27:48.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0081905650000000003, 2024-04-01T19:27:48.938 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:48.939 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:48.939 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-01T19:27:48.939 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:48.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:48.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.924410+0000", 2024-04-01T19:27:48.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:48.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:48.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.924410+0000", 2024-04-01T19:27:48.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:48.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:48.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.924410+0000", 2024-04-01T19:27:48.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3600000000000004e-07 2024-04-01T19:27:48.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:48.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.924415+0000", 2024-04-01T19:27:48.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.792e-06 2024-04-01T19:27:48.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:48.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.927363+0000", 2024-04-01T19:27:48.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0029479419999999998 2024-04-01T19:27:48.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:48.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.927375+0000", 2024-04-01T19:27:48.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1996e-05 2024-04-01T19:27:48.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:48.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.928499+0000", 2024-04-01T19:27:48.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001123633 2024-04-01T19:27:48.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:48.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.928519+0000", 2024-04-01T19:27:48.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0015999999999999e-05 2024-04-01T19:27:48.941 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:48.941 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:48.942 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:48.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.942 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(osd.8.0:49988 2.b e156/106)", 2024-04-01T19:27:48.942 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:48.929888+0000", 2024-04-01T19:27:48.942 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.002519645, 2024-04-01T19:27:48.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0027714599999999999, 2024-04-01T19:27:48.942 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:48.942 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:48.942 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "queued for pg", 2024-04-01T19:27:48.942 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:48.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:48.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.929888+0000", 2024-04-01T19:27:48.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:48.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:48.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.929888+0000", 2024-04-01T19:27:48.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:48.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:48.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.929890+0000", 2024-04-01T19:27:48.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.508e-06 2024-04-01T19:27:48.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:48.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.929899+0000", 2024-04-01T19:27:48.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0070000000000003e-06 2024-04-01T19:27:48.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:48.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.929912+0000", 2024-04-01T19:27:48.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3213999999999999e-05 2024-04-01T19:27:48.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:48.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:48.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:48.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.929920+0000", 2024-04-01T19:27:48.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5460000000000003e-06 2024-04-01T19:27:48.944 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:48.944 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:48.944 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:48.945 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:48.945 INFO:teuthology.orchestra.run.smithi188.stdout: ], 2024-04-01T19:27:48.945 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 4 2024-04-01T19:27:48.945 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:27:49.011 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:27:49.056 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:49.205 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:27:49.209 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:49.209 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:27:49.309 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:27:49.340 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:49.364 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:27:49.369 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:49.369 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:27:49.470 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:27:49.499 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:27:49.499 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:49.520 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:27:49.522 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:49.523 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:27:49.609 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:27:49.625 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:27:49.666 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:49.694 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:27:49.703 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:49.703 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:27:49.804 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:27:49.832 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:49.834 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_blocked_ops 2024-04-01T19:27:49.858 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:27:49.860 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:49 smithi062 ceph-mon[44211]: pgmap v485: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.00k op/s 2024-04-01T19:27:49.860 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:49 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4058385633' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:27:49.861 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:49.862 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:27:49.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:49 smithi022 ceph-mon[39439]: pgmap v485: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.00k op/s 2024-04-01T19:27:49.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:49 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4058385633' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:27:49.872 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:49 smithi188 ceph-mon[43939]: pgmap v485: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.00k op/s 2024-04-01T19:27:49.872 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:49 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4058385633' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:27:49.873 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:27:49.962 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:27:49.993 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:50.228 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:27:50.847 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:50 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:27:50.847 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:50 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4058385633' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:27:50.847 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:50 smithi188 ceph-mon[43939]: osdmap e157: 12 total, 12 up, 12 in 2024-04-01T19:27:50.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:50 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:27:50.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:50 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4058385633' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:27:50.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:50 smithi022 ceph-mon[39439]: osdmap e157: 12 total, 12 up, 12 in 2024-04-01T19:27:51.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:50 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:27:51.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:50 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4058385633' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:27:51.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:50 smithi062 ceph-mon[44211]: osdmap e157: 12 total, 12 up, 12 in 2024-04-01T19:27:51.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:51 smithi022 ceph-mon[39439]: pgmap v487: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 934 op/s 2024-04-01T19:27:51.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:51 smithi188 ceph-mon[43939]: pgmap v487: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 934 op/s 2024-04-01T19:27:52.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:51 smithi062 ceph-mon[44211]: pgmap v487: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 934 op/s 2024-04-01T19:27:52.527 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:27:52.527 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:27:52.527 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-01T19:27:52.527 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-01T19:27:52.527 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:27:52.857 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:27:52.860 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:52.861 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:27:52.962 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:27:53.012 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:53.229 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:27:53.236 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:53.237 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:27:53.338 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:27:53.370 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:53.884 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_historic_ops 2024-04-01T19:27:54.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:53 smithi062 ceph-mon[44211]: pgmap v488: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 893 op/s 2024-04-01T19:27:54.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:53 smithi022 ceph-mon[39439]: pgmap v488: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 893 op/s 2024-04-01T19:27:54.129 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:53 smithi188 ceph-mon[43939]: pgmap v488: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 893 op/s 2024-04-01T19:27:54.298 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:27:56.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:55 smithi062 ceph-mon[44211]: pgmap v489: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 824 op/s 2024-04-01T19:27:56.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:55 smithi022 ceph-mon[39439]: pgmap v489: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 824 op/s 2024-04-01T19:27:56.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:55 smithi188 ceph-mon[43939]: pgmap v489: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 824 op/s 2024-04-01T19:27:56.662 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:27:56.662 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:27:56.662 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:27:56.663 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:27:56.663 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.663 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:118423 2.c 2:36f0243f:::benchmark_data_smithi188_77607_object118422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e128)", 2024-04-01T19:27:56.663 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:25:52.408571+0000", 2024-04-01T19:27:56.663 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 124.253178507, 2024-04-01T19:27:56.663 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.21340094400000001, 2024-04-01T19:27:56.663 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:56.663 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:56.663 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:56.663 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:56.663 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:56.663 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:56.663 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 118423 2024-04-01T19:27:56.663 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.664 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:56.664 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.664 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:56.664 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.408571+0000", 2024-04-01T19:27:56.664 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.664 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.664 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.664 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:56.664 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.408571+0000", 2024-04-01T19:27:56.664 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.664 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.664 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.664 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:56.664 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.408573+0000", 2024-04-01T19:27:56.664 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3819999999999998e-06 2024-04-01T19:27:56.665 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.665 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:56.665 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.408597+0000", 2024-04-01T19:27:56.665 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3637000000000001e-05 2024-04-01T19:27:56.665 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.665 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:56.665 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.408609+0000", 2024-04-01T19:27:56.665 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2812e-05 2024-04-01T19:27:56.665 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.665 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:56.665 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.408617+0000", 2024-04-01T19:27:56.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0090000000000007e-06 2024-04-01T19:27:56.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:56.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.408680+0000", 2024-04-01T19:27:56.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2691e-05 2024-04-01T19:27:56.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:56.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.408812+0000", 2024-04-01T19:27:56.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013213799999999999 2024-04-01T19:27:56.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:27:56.667 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.408965+0000", 2024-04-01T19:27:56.667 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000152385 2024-04-01T19:27:56.667 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.667 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.667 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:56.667 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.412160+0000", 2024-04-01T19:27:56.667 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031956240000000002 2024-04-01T19:27:56.667 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.667 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.667 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:56.667 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.621896+0000", 2024-04-01T19:27:56.667 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.209735961 2024-04-01T19:27:56.667 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.667 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.668 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:56.668 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.621935+0000", 2024-04-01T19:27:56.668 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8411000000000002e-05 2024-04-01T19:27:56.668 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.668 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:56.668 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.621972+0000", 2024-04-01T19:27:56.668 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6894000000000003e-05 2024-04-01T19:27:56.668 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.668 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:56.668 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.668 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.668 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:118440 2.c 2:374e48f8:::benchmark_data_smithi188_77607_object118439:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e128)", 2024-04-01T19:27:56.669 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:25:52.420716+0000", 2024-04-01T19:27:56.669 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 124.241033438, 2024-04-01T19:27:56.669 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.20139631199999999, 2024-04-01T19:27:56.669 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:56.669 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:56.669 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:56.669 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:56.669 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:56.669 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:56.669 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 118440 2024-04-01T19:27:56.669 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.669 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:56.669 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.669 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:56.669 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.420716+0000", 2024-04-01T19:27:56.670 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.670 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.670 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.670 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:56.670 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.420716+0000", 2024-04-01T19:27:56.670 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.670 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.670 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.670 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:56.670 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.420717+0000", 2024-04-01T19:27:56.670 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.61e-06 2024-04-01T19:27:56.670 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.671 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.671 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:56.671 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.420738+0000", 2024-04-01T19:27:56.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0641000000000001e-05 2024-04-01T19:27:56.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.671 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.671 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:56.671 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.420753+0000", 2024-04-01T19:27:56.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4783999999999999e-05 2024-04-01T19:27:56.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.671 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.671 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:56.671 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.420762+0000", 2024-04-01T19:27:56.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8850000000000005e-06 2024-04-01T19:27:56.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.672 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:56.672 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.420817+0000", 2024-04-01T19:27:56.672 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5554999999999999e-05 2024-04-01T19:27:56.672 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.672 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:56.672 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.420926+0000", 2024-04-01T19:27:56.672 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108857 2024-04-01T19:27:56.672 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.672 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:27:56.672 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.421033+0000", 2024-04-01T19:27:56.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010676899999999999 2024-04-01T19:27:56.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:56.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.424232+0000", 2024-04-01T19:27:56.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031996759999999998 2024-04-01T19:27:56.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:56.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.622017+0000", 2024-04-01T19:27:56.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.19778406400000001 2024-04-01T19:27:56.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:56.674 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.622072+0000", 2024-04-01T19:27:56.674 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5800000000000001e-05 2024-04-01T19:27:56.674 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.674 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.674 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:56.674 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.622112+0000", 2024-04-01T19:27:56.674 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9671e-05 2024-04-01T19:27:56.674 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.674 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:56.674 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.674 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.674 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.674 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:118495 2.c 2:3e5de941:::benchmark_data_smithi188_77607_object118494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e128)", 2024-04-01T19:27:56.674 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:25:52.457238+0000", 2024-04-01T19:27:56.675 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 124.204511353, 2024-04-01T19:27:56.675 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16836590600000001, 2024-04-01T19:27:56.675 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:56.675 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:56.675 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:56.675 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:56.675 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:56.675 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:56.675 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 118495 2024-04-01T19:27:56.675 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.675 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:56.675 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.675 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:56.675 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457238+0000", 2024-04-01T19:27:56.675 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.676 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.676 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.676 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:56.676 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457238+0000", 2024-04-01T19:27:56.676 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.676 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.676 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.676 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:56.676 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457240+0000", 2024-04-01T19:27:56.676 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.57e-06 2024-04-01T19:27:56.676 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.676 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.676 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:56.677 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457270+0000", 2024-04-01T19:27:56.677 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9887e-05 2024-04-01T19:27:56.677 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.677 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.677 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:56.677 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457282+0000", 2024-04-01T19:27:56.677 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2163e-05 2024-04-01T19:27:56.677 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.677 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.677 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:56.677 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457301+0000", 2024-04-01T19:27:56.677 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8321999999999998e-05 2024-04-01T19:27:56.677 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.677 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:56.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457374+0000", 2024-04-01T19:27:56.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2941999999999994e-05 2024-04-01T19:27:56.678 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.678 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:56.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457491+0000", 2024-04-01T19:27:56.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117265 2024-04-01T19:27:56.678 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.678 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:27:56.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457623+0000", 2024-04-01T19:27:56.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000132275 2024-04-01T19:27:56.678 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.679 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:56.679 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.464786+0000", 2024-04-01T19:27:56.679 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071633069999999998 2024-04-01T19:27:56.679 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.679 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:56.679 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.625496+0000", 2024-04-01T19:27:56.679 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16070952299999999 2024-04-01T19:27:56.679 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.679 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:56.679 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.625553+0000", 2024-04-01T19:27:56.680 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7462e-05 2024-04-01T19:27:56.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.680 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:56.680 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.625604+0000", 2024-04-01T19:27:56.680 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0189999999999999e-05 2024-04-01T19:27:56.680 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.680 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:56.680 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.680 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:118497 2.c 2:345b15cf:::benchmark_data_smithi188_77607_object118496:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e128)", 2024-04-01T19:27:56.680 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:25:52.457323+0000", 2024-04-01T19:27:56.681 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 124.204425783, 2024-04-01T19:27:56.681 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.172470871, 2024-04-01T19:27:56.681 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:56.681 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:56.681 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:56.681 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:56.681 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:56.681 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:56.681 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 118497 2024-04-01T19:27:56.681 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.681 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:56.681 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.681 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:56.681 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457323+0000", 2024-04-01T19:27:56.682 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.682 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.682 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.682 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:56.682 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457323+0000", 2024-04-01T19:27:56.682 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.682 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.682 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.682 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:56.682 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457324+0000", 2024-04-01T19:27:56.682 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0249999999999999e-06 2024-04-01T19:27:56.682 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.682 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.682 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:56.683 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457359+0000", 2024-04-01T19:27:56.683 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4297e-05 2024-04-01T19:27:56.683 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.683 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.683 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:56.683 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457365+0000", 2024-04-01T19:27:56.683 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4570000000000002e-06 2024-04-01T19:27:56.683 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.683 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.683 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:56.683 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457369+0000", 2024-04-01T19:27:56.683 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3409999999999996e-06 2024-04-01T19:27:56.683 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.683 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.684 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:56.684 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.460944+0000", 2024-04-01T19:27:56.684 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0035744280000000002 2024-04-01T19:27:56.684 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.684 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.684 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:56.684 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.461061+0000", 2024-04-01T19:27:56.684 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117447 2024-04-01T19:27:56.684 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.684 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.684 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:27:56.684 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.461182+0000", 2024-04-01T19:27:56.684 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012052099999999999 2024-04-01T19:27:56.685 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.685 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.685 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:56.685 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.468119+0000", 2024-04-01T19:27:56.685 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0069371140000000003 2024-04-01T19:27:56.685 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.685 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.685 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:56.685 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.629709+0000", 2024-04-01T19:27:56.685 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16159025399999999 2024-04-01T19:27:56.685 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.685 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.685 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:56.685 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.629749+0000", 2024-04-01T19:27:56.685 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9360000000000003e-05 2024-04-01T19:27:56.686 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.686 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.686 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:56.686 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.629794+0000", 2024-04-01T19:27:56.686 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5627000000000002e-05 2024-04-01T19:27:56.686 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.686 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:56.686 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.686 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.686 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.686 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:118504 2.c 2:3a6d1685:::benchmark_data_smithi188_77607_object118503:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e128)", 2024-04-01T19:27:56.686 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:25:52.468475+0000", 2024-04-01T19:27:56.686 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 124.19327418899999, 2024-04-01T19:27:56.686 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.161449647, 2024-04-01T19:27:56.687 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:56.687 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:56.687 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:56.687 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:56.687 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:56.687 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:56.687 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 118504 2024-04-01T19:27:56.687 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.687 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:56.687 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.687 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:56.687 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.468475+0000", 2024-04-01T19:27:56.687 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.687 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:56.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.468475+0000", 2024-04-01T19:27:56.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:56.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.468476+0000", 2024-04-01T19:27:56.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.141e-06 2024-04-01T19:27:56.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:56.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.468498+0000", 2024-04-01T19:27:56.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1925000000000001e-05 2024-04-01T19:27:56.689 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.689 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.689 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:56.689 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.468520+0000", 2024-04-01T19:27:56.689 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2229e-05 2024-04-01T19:27:56.689 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.689 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.689 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:56.689 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.468528+0000", 2024-04-01T19:27:56.689 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2549999999999997e-06 2024-04-01T19:27:56.689 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.689 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.689 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:56.689 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.468581+0000", 2024-04-01T19:27:56.690 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2760999999999998e-05 2024-04-01T19:27:56.690 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.690 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.690 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:56.690 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.468699+0000", 2024-04-01T19:27:56.690 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117361 2024-04-01T19:27:56.690 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.690 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.690 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:27:56.690 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.468837+0000", 2024-04-01T19:27:56.690 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000138343 2024-04-01T19:27:56.690 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.690 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.691 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:56.691 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.472108+0000", 2024-04-01T19:27:56.691 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.003270804 2024-04-01T19:27:56.691 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.691 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.691 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:56.691 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.629839+0000", 2024-04-01T19:27:56.691 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.157731644 2024-04-01T19:27:56.691 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.691 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.691 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:56.691 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.629885+0000", 2024-04-01T19:27:56.691 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5964000000000002e-05 2024-04-01T19:27:56.691 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.692 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.692 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:56.692 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.629925+0000", 2024-04-01T19:27:56.692 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9220000000000001e-05 2024-04-01T19:27:56.692 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.692 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:56.692 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.692 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.692 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.692 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:118526 2.c 2:34ed6a6c:::benchmark_data_smithi188_77607_object118525:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e128)", 2024-04-01T19:27:56.692 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:25:52.482133+0000", 2024-04-01T19:27:56.692 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 124.179616002, 2024-04-01T19:27:56.692 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.15085310199999999, 2024-04-01T19:27:56.693 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:56.693 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:56.693 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:56.693 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:56.693 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:56.693 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:56.693 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 118526 2024-04-01T19:27:56.693 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.693 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:56.693 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.693 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:56.693 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.482133+0000", 2024-04-01T19:27:56.693 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.693 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.694 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.694 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:56.694 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.482133+0000", 2024-04-01T19:27:56.694 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.694 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.694 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.694 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:56.694 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.482135+0000", 2024-04-01T19:27:56.694 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.897e-06 2024-04-01T19:27:56.694 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.694 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.694 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:56.694 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.482158+0000", 2024-04-01T19:27:56.695 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2688999999999999e-05 2024-04-01T19:27:56.695 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.695 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.695 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:56.695 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.482168+0000", 2024-04-01T19:27:56.695 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0732e-05 2024-04-01T19:27:56.695 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.695 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.695 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:56.695 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.482177+0000", 2024-04-01T19:27:56.695 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2879999999999993e-06 2024-04-01T19:27:56.695 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.695 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.696 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:56.696 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.482228+0000", 2024-04-01T19:27:56.696 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1379999999999999e-05 2024-04-01T19:27:56.696 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.696 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.696 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:56.696 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.482328+0000", 2024-04-01T19:27:56.696 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9920000000000006e-05 2024-04-01T19:27:56.696 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.696 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.696 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:27:56.696 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.482437+0000", 2024-04-01T19:27:56.696 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000109153 2024-04-01T19:27:56.696 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.696 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.697 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:56.697 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.485425+0000", 2024-04-01T19:27:56.697 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002987361 2024-04-01T19:27:56.697 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.697 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.697 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:56.697 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.632871+0000", 2024-04-01T19:27:56.697 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14744655500000001 2024-04-01T19:27:56.697 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.697 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.697 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:56.697 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.632936+0000", 2024-04-01T19:27:56.697 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4671999999999993e-05 2024-04-01T19:27:56.697 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.698 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.698 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:56.698 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.632986+0000", 2024-04-01T19:27:56.698 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0454999999999997e-05 2024-04-01T19:27:56.698 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.698 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:56.698 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.698 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.698 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.698 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:118560 2.c 2:303eae68:::benchmark_data_smithi188_77607_object118559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e128)", 2024-04-01T19:27:56.698 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:25:52.506083+0000", 2024-04-01T19:27:56.698 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 124.155666607, 2024-04-01T19:27:56.698 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.127036019, 2024-04-01T19:27:56.699 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:56.699 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:56.699 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:56.699 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:56.699 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:56.699 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:56.699 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 118560 2024-04-01T19:27:56.699 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.699 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:56.699 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.699 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:56.699 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.506083+0000", 2024-04-01T19:27:56.699 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.700 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.700 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.700 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:56.700 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.506083+0000", 2024-04-01T19:27:56.700 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.700 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.700 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.700 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:56.700 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.506084+0000", 2024-04-01T19:27:56.700 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1650000000000001e-06 2024-04-01T19:27:56.700 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.700 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.700 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:56.700 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.506104+0000", 2024-04-01T19:27:56.701 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0783000000000001e-05 2024-04-01T19:27:56.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.701 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.701 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:56.701 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.506112+0000", 2024-04-01T19:27:56.701 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.892e-06 2024-04-01T19:27:56.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.701 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.701 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:56.701 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.506120+0000", 2024-04-01T19:27:56.701 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7300000000000005e-06 2024-04-01T19:27:56.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.701 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.701 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:56.702 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.506168+0000", 2024-04-01T19:27:56.702 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8337000000000002e-05 2024-04-01T19:27:56.702 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.702 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.702 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:56.702 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.506287+0000", 2024-04-01T19:27:56.702 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000118924 2024-04-01T19:27:56.702 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.702 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.702 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:27:56.702 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.506430+0000", 2024-04-01T19:27:56.702 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014257300000000001 2024-04-01T19:27:56.702 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.702 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.703 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:56.703 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.509879+0000", 2024-04-01T19:27:56.703 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0034487979999999999 2024-04-01T19:27:56.703 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.703 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.703 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:56.703 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.633035+0000", 2024-04-01T19:27:56.703 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.123155801 2024-04-01T19:27:56.703 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.703 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.703 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:56.703 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.633083+0000", 2024-04-01T19:27:56.703 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8733000000000002e-05 2024-04-01T19:27:56.704 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.704 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.704 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:56.704 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.633119+0000", 2024-04-01T19:27:56.704 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5283000000000001e-05 2024-04-01T19:27:56.704 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.704 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:56.704 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.704 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.704 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.704 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:118580 2.c 2:312fea36:::benchmark_data_smithi188_77607_object118579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e128)", 2024-04-01T19:27:56.704 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:25:52.521042+0000", 2024-04-01T19:27:56.704 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 124.140706908, 2024-04-01T19:27:56.704 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.117359536, 2024-04-01T19:27:56.705 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:56.705 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:56.705 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:56.705 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:56.705 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:56.705 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:56.705 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 118580 2024-04-01T19:27:56.705 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.705 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:56.705 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.705 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:56.705 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.521042+0000", 2024-04-01T19:27:56.705 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.705 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.706 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.706 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:56.706 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.521042+0000", 2024-04-01T19:27:56.706 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.706 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.706 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.706 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:56.706 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.521044+0000", 2024-04-01T19:27:56.706 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4589999999999999e-06 2024-04-01T19:27:56.706 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.706 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.706 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:56.706 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.521063+0000", 2024-04-01T19:27:56.706 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9440999999999999e-05 2024-04-01T19:27:56.707 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.707 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.707 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:56.707 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.521074+0000", 2024-04-01T19:27:56.707 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1109e-05 2024-04-01T19:27:56.707 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.707 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.707 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:56.707 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.521080+0000", 2024-04-01T19:27:56.707 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1109999999999996e-06 2024-04-01T19:27:56.707 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.707 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.707 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:56.707 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.521132+0000", 2024-04-01T19:27:56.707 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2021999999999998e-05 2024-04-01T19:27:56.708 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.708 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.708 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:56.708 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.521250+0000", 2024-04-01T19:27:56.708 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117761 2024-04-01T19:27:56.708 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.708 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.708 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:27:56.708 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.521393+0000", 2024-04-01T19:27:56.708 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014255999999999999 2024-04-01T19:27:56.708 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.708 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.708 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:56.708 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.527618+0000", 2024-04-01T19:27:56.708 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062248340000000003 2024-04-01T19:27:56.709 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.709 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.709 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:56.709 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.638276+0000", 2024-04-01T19:27:56.709 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.110658429 2024-04-01T19:27:56.709 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.709 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.709 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:56.709 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.638335+0000", 2024-04-01T19:27:56.709 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9299999999999998e-05 2024-04-01T19:27:56.709 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.709 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.709 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:56.710 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.638402+0000", 2024-04-01T19:27:56.710 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6509999999999998e-05 2024-04-01T19:27:56.710 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.710 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:56.710 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.710 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.710 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.710 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:118586 2.c 2:33e37a35:::benchmark_data_smithi188_77607_object118585:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e128)", 2024-04-01T19:27:56.710 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:25:52.524276+0000", 2024-04-01T19:27:56.710 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 124.137472941, 2024-04-01T19:27:56.710 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.11427359600000001, 2024-04-01T19:27:56.710 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:56.710 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:56.710 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:56.711 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:56.711 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:56.711 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:56.711 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 118586 2024-04-01T19:27:56.711 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.711 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:56.711 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.711 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:56.711 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.524276+0000", 2024-04-01T19:27:56.711 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.711 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.711 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.711 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:56.711 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.524276+0000", 2024-04-01T19:27:56.712 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.712 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.712 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.712 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:56.712 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.524278+0000", 2024-04-01T19:27:56.712 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6700000000000001e-06 2024-04-01T19:27:56.712 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.712 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.712 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:56.712 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.524298+0000", 2024-04-01T19:27:56.712 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0610000000000001e-05 2024-04-01T19:27:56.712 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.712 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.712 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:56.712 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.524311+0000", 2024-04-01T19:27:56.713 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2758000000000001e-05 2024-04-01T19:27:56.713 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.713 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.713 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:56.713 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.524319+0000", 2024-04-01T19:27:56.713 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6499999999999996e-06 2024-04-01T19:27:56.713 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.713 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.713 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:56.713 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.524692+0000", 2024-04-01T19:27:56.713 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00037340399999999998 2024-04-01T19:27:56.713 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.713 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.713 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:56.713 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.524814+0000", 2024-04-01T19:27:56.714 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012218799999999999 2024-04-01T19:27:56.714 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.714 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.714 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:27:56.714 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.524898+0000", 2024-04-01T19:27:56.714 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3769000000000004e-05 2024-04-01T19:27:56.714 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.714 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.714 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:56.714 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.527736+0000", 2024-04-01T19:27:56.714 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0028374049999999999 2024-04-01T19:27:56.714 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.714 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.714 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:56.715 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.638461+0000", 2024-04-01T19:27:56.715 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.11072537 2024-04-01T19:27:56.715 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.715 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.715 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:56.715 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.638512+0000", 2024-04-01T19:27:56.715 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0992999999999998e-05 2024-04-01T19:27:56.715 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.715 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.715 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:56.715 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.638550+0000", 2024-04-01T19:27:56.715 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7778999999999999e-05 2024-04-01T19:27:56.715 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.715 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:56.715 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.716 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.716 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.716 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:118595 2.c 2:35cfec40:::benchmark_data_smithi188_77607_object118594:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e128)", 2024-04-01T19:27:56.716 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:25:52.528709+0000", 2024-04-01T19:27:56.716 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 124.133039905, 2024-04-01T19:27:56.716 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.114154964, 2024-04-01T19:27:56.716 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:56.716 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:56.716 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:56.716 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:56.716 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:56.716 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:56.716 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 118595 2024-04-01T19:27:56.716 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.716 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:56.717 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.717 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:56.717 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.528709+0000", 2024-04-01T19:27:56.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.717 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.717 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.717 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:56.717 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.528709+0000", 2024-04-01T19:27:56.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.717 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.717 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.717 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:56.717 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.528711+0000", 2024-04-01T19:27:56.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.415e-06 2024-04-01T19:27:56.717 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.718 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.718 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:56.718 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.528755+0000", 2024-04-01T19:27:56.718 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4768000000000002e-05 2024-04-01T19:27:56.718 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.718 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.718 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:56.718 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.528764+0000", 2024-04-01T19:27:56.718 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7579999999999998e-06 2024-04-01T19:27:56.718 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.718 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.718 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:56.718 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.528771+0000", 2024-04-01T19:27:56.719 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1840000000000002e-06 2024-04-01T19:27:56.719 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.719 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.719 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:56.719 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.528820+0000", 2024-04-01T19:27:56.719 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8927000000000001e-05 2024-04-01T19:27:56.719 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.719 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.719 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:56.719 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.528903+0000", 2024-04-01T19:27:56.719 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2628999999999998e-05 2024-04-01T19:27:56.719 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.719 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.719 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:27:56.720 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.529027+0000", 2024-04-01T19:27:56.720 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000124148 2024-04-01T19:27:56.720 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.720 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.720 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:56.720 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.535282+0000", 2024-04-01T19:27:56.720 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062546659999999999 2024-04-01T19:27:56.720 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.720 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.720 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:56.720 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.642768+0000", 2024-04-01T19:27:56.720 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.107485938 2024-04-01T19:27:56.720 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.720 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.720 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:56.721 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.642823+0000", 2024-04-01T19:27:56.721 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5507000000000002e-05 2024-04-01T19:27:56.721 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.721 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.721 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:56.721 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.642864+0000", 2024-04-01T19:27:56.721 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1023999999999999e-05 2024-04-01T19:27:56.721 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.721 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:56.721 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.721 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.721 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.721 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:118596 2.c 2:33d740c8:::benchmark_data_smithi188_77607_object118595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e128)", 2024-04-01T19:27:56.721 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:25:52.532357+0000", 2024-04-01T19:27:56.721 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 124.129391817, 2024-04-01T19:27:56.722 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.110620493, 2024-04-01T19:27:56.722 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:56.722 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:56.722 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:56.722 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:56.722 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:56.722 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:56.722 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 118596 2024-04-01T19:27:56.722 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.722 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:56.722 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.722 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:56.722 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.532357+0000", 2024-04-01T19:27:56.722 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.723 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.723 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.723 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:56.723 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.532357+0000", 2024-04-01T19:27:56.723 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.723 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.723 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.723 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:56.723 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.532359+0000", 2024-04-01T19:27:56.723 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5200000000000001e-06 2024-04-01T19:27:56.723 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.723 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.723 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:56.723 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.532403+0000", 2024-04-01T19:27:56.723 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4029999999999997e-05 2024-04-01T19:27:56.724 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.724 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.724 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:56.724 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.532413+0000", 2024-04-01T19:27:56.724 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0458999999999999e-05 2024-04-01T19:27:56.724 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.724 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.724 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:56.724 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.532420+0000", 2024-04-01T19:27:56.724 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0990000000000001e-06 2024-04-01T19:27:56.724 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.724 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.724 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:56.724 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.532468+0000", 2024-04-01T19:27:56.724 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8010000000000003e-05 2024-04-01T19:27:56.725 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.725 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.725 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:56.725 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.532557+0000", 2024-04-01T19:27:56.725 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8261000000000001e-05 2024-04-01T19:27:56.725 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.725 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.725 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:27:56.725 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.532667+0000", 2024-04-01T19:27:56.725 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011040900000000001 2024-04-01T19:27:56.725 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.725 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.725 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:56.725 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.535499+0000", 2024-04-01T19:27:56.726 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0028316119999999998 2024-04-01T19:27:56.726 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.726 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.726 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:56.726 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.642899+0000", 2024-04-01T19:27:56.726 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.107400697 2024-04-01T19:27:56.726 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.726 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.726 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:56.726 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.642947+0000", 2024-04-01T19:27:56.726 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7414999999999999e-05 2024-04-01T19:27:56.726 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.726 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.726 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:56.727 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.642978+0000", 2024-04-01T19:27:56.727 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0981e-05 2024-04-01T19:27:56.727 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.727 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:56.727 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.727 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.727 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.727 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.24751.0:235102 2.b e155/106 2:da0bd45b:::benchmark_data_smithi188_77607_object67698:head v 155'14667, mlcod=155'14665)", 2024-04-01T19:27:56.727 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:33.278804+0000", 2024-04-01T19:27:56.727 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 23.382945419999999, 2024-04-01T19:27:56.727 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.093368679999999996, 2024-04-01T19:27:56.727 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:56.727 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:56.727 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:56.727 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:56.728 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.728 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:56.728 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:33.278804+0000", 2024-04-01T19:27:56.728 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.728 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.728 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.728 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:56.728 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:33.278804+0000", 2024-04-01T19:27:56.728 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.728 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.728 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.728 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:56.728 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:33.278805+0000", 2024-04-01T19:27:56.728 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4890000000000001e-06 2024-04-01T19:27:56.728 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.729 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.729 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:56.729 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:33.278814+0000", 2024-04-01T19:27:56.729 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6929999999999996e-06 2024-04-01T19:27:56.729 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.729 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.729 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:56.729 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:33.342185+0000", 2024-04-01T19:27:56.729 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.063370658999999996 2024-04-01T19:27:56.729 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.729 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.729 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:56.729 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:33.342199+0000", 2024-04-01T19:27:56.729 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4589e-05 2024-04-01T19:27:56.729 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.730 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.730 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:56.730 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:33.342403+0000", 2024-04-01T19:27:56.730 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000203838 2024-04-01T19:27:56.730 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.730 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.730 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:56.730 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:33.342421+0000", 2024-04-01T19:27:56.730 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8270999999999998e-05 2024-04-01T19:27:56.730 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.730 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.730 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:56.730 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:33.372145+0000", 2024-04-01T19:27:56.731 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029723375 2024-04-01T19:27:56.731 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.731 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.731 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:56.731 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:33.372172+0000", 2024-04-01T19:27:56.731 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7766000000000001e-05 2024-04-01T19:27:56.731 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.731 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:56.731 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.731 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.731 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.731 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:240019 2.c 2:3c88fbc4:::benchmark_data_smithi188_77607_object72615:head [delete] snapc 0=[] ondisk+write+known_if_redirected e155)", 2024-04-01T19:27:56.731 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:37.885566+0000", 2024-04-01T19:27:56.731 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 18.776182892000001, 2024-04-01T19:27:56.732 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.22244529199999999, 2024-04-01T19:27:56.732 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:56.732 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:56.732 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:56.732 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:56.732 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:56.732 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:56.732 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 240019 2024-04-01T19:27:56.732 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.732 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:56.732 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.732 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:56.732 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.885566+0000", 2024-04-01T19:27:56.732 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.732 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.733 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.733 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:56.733 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.885566+0000", 2024-04-01T19:27:56.733 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.733 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.733 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.733 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:56.733 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.885570+0000", 2024-04-01T19:27:56.733 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5889999999999999e-06 2024-04-01T19:27:56.733 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.733 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.733 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:56.733 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.885578+0000", 2024-04-01T19:27:56.733 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6149999999999997e-06 2024-04-01T19:27:56.734 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.734 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.734 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:56.734 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.885595+0000", 2024-04-01T19:27:56.734 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6218999999999998e-05 2024-04-01T19:27:56.734 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.734 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.734 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:56.734 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.885602+0000", 2024-04-01T19:27:56.734 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4989999999999997e-06 2024-04-01T19:27:56.734 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.734 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.734 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:56.734 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.885655+0000", 2024-04-01T19:27:56.735 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2853999999999999e-05 2024-04-01T19:27:56.735 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.735 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:56.735 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.885744+0000", 2024-04-01T19:27:56.735 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8879000000000001e-05 2024-04-01T19:27:56.735 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.735 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:27:56.735 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.886349+0000", 2024-04-01T19:27:56.735 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000605147 2024-04-01T19:27:56.735 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.736 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:56.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.890195+0000", 2024-04-01T19:27:56.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0038461060000000002 2024-04-01T19:27:56.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.736 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:56.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.107906+0000", 2024-04-01T19:27:56.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.21771119799999999 2024-04-01T19:27:56.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.736 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:56.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.107960+0000", 2024-04-01T19:27:56.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3671999999999997e-05 2024-04-01T19:27:56.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.737 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:56.737 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.108012+0000", 2024-04-01T19:27:56.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1514000000000002e-05 2024-04-01T19:27:56.737 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.737 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:56.737 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.737 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.737 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:240065 2.c 2:328ade74:::benchmark_data_smithi188_77607_object72661:head [delete] snapc 0=[] ondisk+write+known_if_redirected e155)", 2024-04-01T19:27:56.737 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:37.928693+0000", 2024-04-01T19:27:56.737 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 18.733056383000001, 2024-04-01T19:27:56.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.184336738, 2024-04-01T19:27:56.737 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:56.737 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:56.738 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:56.738 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:56.738 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:56.738 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:56.738 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 240065 2024-04-01T19:27:56.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.738 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:56.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.738 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:56.738 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.928693+0000", 2024-04-01T19:27:56.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.738 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:56.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.928693+0000", 2024-04-01T19:27:56.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:56.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.928695+0000", 2024-04-01T19:27:56.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9759999999999998e-06 2024-04-01T19:27:56.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:56.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.928702+0000", 2024-04-01T19:27:56.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4499999999999998e-06 2024-04-01T19:27:56.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:56.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.928717+0000", 2024-04-01T19:27:56.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4384e-05 2024-04-01T19:27:56.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:56.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.928726+0000", 2024-04-01T19:27:56.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4849999999999998e-06 2024-04-01T19:27:56.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:56.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.928795+0000", 2024-04-01T19:27:56.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9003000000000003e-05 2024-04-01T19:27:56.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:56.741 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.928939+0000", 2024-04-01T19:27:56.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000143869 2024-04-01T19:27:56.741 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.741 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:27:56.741 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.929065+0000", 2024-04-01T19:27:56.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012627299999999999 2024-04-01T19:27:56.741 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.741 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:56.741 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.937578+0000", 2024-04-01T19:27:56.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085127450000000004 2024-04-01T19:27:56.741 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.741 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:56.742 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.112913+0000", 2024-04-01T19:27:56.742 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.175334724 2024-04-01T19:27:56.742 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.742 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.742 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:56.742 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.112976+0000", 2024-04-01T19:27:56.742 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3262000000000005e-05 2024-04-01T19:27:56.742 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.742 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.742 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:56.742 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.113029+0000", 2024-04-01T19:27:56.742 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3566999999999997e-05 2024-04-01T19:27:56.742 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.742 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:56.742 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.743 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.743 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:240073 2.c 2:3b089fda:::benchmark_data_smithi188_77607_object72669:head [delete] snapc 0=[] ondisk+write+known_if_redirected e155)", 2024-04-01T19:27:56.743 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:37.932704+0000", 2024-04-01T19:27:56.743 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 18.729045091, 2024-04-01T19:27:56.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18046169200000001, 2024-04-01T19:27:56.743 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:56.743 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:56.743 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:56.743 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:56.743 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:56.743 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:56.743 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 240073 2024-04-01T19:27:56.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.744 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:56.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:56.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.932704+0000", 2024-04-01T19:27:56.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:56.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.932704+0000", 2024-04-01T19:27:56.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:56.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.932705+0000", 2024-04-01T19:27:56.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.217e-06 2024-04-01T19:27:56.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:56.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.932710+0000", 2024-04-01T19:27:56.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3109999999999999e-06 2024-04-01T19:27:56.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:56.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.932719+0000", 2024-04-01T19:27:56.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.6069999999999997e-06 2024-04-01T19:27:56.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:56.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.932727+0000", 2024-04-01T19:27:56.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0790000000000001e-06 2024-04-01T19:27:56.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:56.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.933489+0000", 2024-04-01T19:27:56.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00076132200000000004 2024-04-01T19:27:56.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:56.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.933584+0000", 2024-04-01T19:27:56.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5004e-05 2024-04-01T19:27:56.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.747 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.747 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:27:56.747 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.933660+0000", 2024-04-01T19:27:56.747 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6879999999999996e-05 2024-04-01T19:27:56.747 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.747 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.747 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:56.747 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.937711+0000", 2024-04-01T19:27:56.747 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040502969999999996 2024-04-01T19:27:56.747 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.747 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.747 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:56.747 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.113075+0000", 2024-04-01T19:27:56.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.17536437599999999 2024-04-01T19:27:56.748 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.748 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:56.748 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.113127+0000", 2024-04-01T19:27:56.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2210000000000003e-05 2024-04-01T19:27:56.748 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.748 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:56.748 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.113166+0000", 2024-04-01T19:27:56.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8389000000000001e-05 2024-04-01T19:27:56.748 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.748 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:56.748 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.749 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.749 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.749 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:240080 2.c 2:3d838c5d:::benchmark_data_smithi188_77607_object72676:head [delete] snapc 0=[] ondisk+write+known_if_redirected e155)", 2024-04-01T19:27:56.749 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:37.940147+0000", 2024-04-01T19:27:56.749 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 18.72160203, 2024-04-01T19:27:56.749 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.182677962, 2024-04-01T19:27:56.749 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:56.749 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:56.749 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:56.749 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:56.749 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:56.749 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:56.749 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 240080 2024-04-01T19:27:56.749 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.750 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:56.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.750 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:56.750 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.940147+0000", 2024-04-01T19:27:56.750 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.750 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.750 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:56.750 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.940147+0000", 2024-04-01T19:27:56.750 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.750 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.750 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:56.750 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.940150+0000", 2024-04-01T19:27:56.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4940000000000002e-06 2024-04-01T19:27:56.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:56.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.940157+0000", 2024-04-01T19:27:56.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2699999999999999e-06 2024-04-01T19:27:56.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:56.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.940171+0000", 2024-04-01T19:27:56.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4382000000000001e-05 2024-04-01T19:27:56.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:56.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.940179+0000", 2024-04-01T19:27:56.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1559999999999995e-06 2024-04-01T19:27:56.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:56.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.940241+0000", 2024-04-01T19:27:56.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1563000000000007e-05 2024-04-01T19:27:56.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:56.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.940371+0000", 2024-04-01T19:27:56.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000130538 2024-04-01T19:27:56.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.753 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:27:56.753 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.940499+0000", 2024-04-01T19:27:56.753 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012706499999999999 2024-04-01T19:27:56.753 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.753 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.753 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:56.753 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.944377+0000", 2024-04-01T19:27:56.753 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.003878785 2024-04-01T19:27:56.753 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.753 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.753 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:56.753 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.122752+0000", 2024-04-01T19:27:56.753 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.17837456400000001 2024-04-01T19:27:56.753 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.753 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.754 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:56.754 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.122796+0000", 2024-04-01T19:27:56.754 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4418000000000001e-05 2024-04-01T19:27:56.754 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.754 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.754 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:56.754 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.122825+0000", 2024-04-01T19:27:56.754 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8727000000000001e-05 2024-04-01T19:27:56.754 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.754 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:56.754 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.754 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.754 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.754 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:240090 2.c 2:36d309b5:::benchmark_data_smithi188_77607_object72686:head [delete] snapc 0=[] ondisk+write+known_if_redirected e155)", 2024-04-01T19:27:56.755 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:37.948424+0000", 2024-04-01T19:27:56.755 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 18.713324960000001, 2024-04-01T19:27:56.755 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.174503084, 2024-04-01T19:27:56.755 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:56.755 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:56.755 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:56.755 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:56.755 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:56.755 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:56.755 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 240090 2024-04-01T19:27:56.755 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.755 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:56.755 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.755 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:56.756 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.948424+0000", 2024-04-01T19:27:56.756 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.756 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.756 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.756 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:56.756 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.948424+0000", 2024-04-01T19:27:56.756 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.756 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.756 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.756 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:56.756 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.948426+0000", 2024-04-01T19:27:56.756 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1519999999999999e-06 2024-04-01T19:27:56.756 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.756 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.757 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:56.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.948433+0000", 2024-04-01T19:27:56.757 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8889999999999996e-06 2024-04-01T19:27:56.757 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.757 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.757 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:56.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.948448+0000", 2024-04-01T19:27:56.757 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4562000000000001e-05 2024-04-01T19:27:56.757 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.757 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.757 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:56.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.948456+0000", 2024-04-01T19:27:56.757 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1669999999999999e-06 2024-04-01T19:27:56.757 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.758 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.758 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:56.758 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.948514+0000", 2024-04-01T19:27:56.758 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8344000000000002e-05 2024-04-01T19:27:56.758 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.758 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.758 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:56.758 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.948644+0000", 2024-04-01T19:27:56.758 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013015800000000001 2024-04-01T19:27:56.758 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.758 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.758 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:27:56.758 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.948770+0000", 2024-04-01T19:27:56.758 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012528800000000001 2024-04-01T19:27:56.759 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.759 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.759 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:56.759 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.955395+0000", 2024-04-01T19:27:56.759 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0066254649999999997 2024-04-01T19:27:56.759 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.759 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.759 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:56.759 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.122867+0000", 2024-04-01T19:27:56.759 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.167472071 2024-04-01T19:27:56.759 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.760 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.760 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:56.760 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.122901+0000", 2024-04-01T19:27:56.760 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3435000000000001e-05 2024-04-01T19:27:56.760 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.760 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.760 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:56.760 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.122927+0000", 2024-04-01T19:27:56.760 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6553000000000001e-05 2024-04-01T19:27:56.760 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.760 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:56.760 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.760 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.760 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.761 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:240121 2.c 2:34dcaf01:::benchmark_data_smithi188_77607_object72717:head [delete] snapc 0=[] ondisk+write+known_if_redirected e155)", 2024-04-01T19:27:56.761 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:37.976465+0000", 2024-04-01T19:27:56.761 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 18.685283884, 2024-04-01T19:27:56.761 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14656604400000001, 2024-04-01T19:27:56.761 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:56.761 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:56.761 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:56.761 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:56.761 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:56.761 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:56.761 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 240121 2024-04-01T19:27:56.761 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.761 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:56.761 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.761 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:56.762 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.976465+0000", 2024-04-01T19:27:56.762 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.762 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.762 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.762 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:56.762 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.976465+0000", 2024-04-01T19:27:56.762 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.762 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.762 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.762 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:56.762 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.976468+0000", 2024-04-01T19:27:56.762 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4830000000000002e-06 2024-04-01T19:27:56.762 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.762 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.763 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:56.763 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.976475+0000", 2024-04-01T19:27:56.763 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7090000000000002e-06 2024-04-01T19:27:56.763 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.763 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.763 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:56.763 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.976492+0000", 2024-04-01T19:27:56.763 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6424000000000001e-05 2024-04-01T19:27:56.763 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.763 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.763 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:56.763 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.976502+0000", 2024-04-01T19:27:56.763 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0096e-05 2024-04-01T19:27:56.763 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.764 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.764 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:56.764 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.976566+0000", 2024-04-01T19:27:56.764 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4456999999999996e-05 2024-04-01T19:27:56.764 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.764 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.764 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:56.764 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.976666+0000", 2024-04-01T19:27:56.764 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9275000000000001e-05 2024-04-01T19:27:56.764 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.764 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.764 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:27:56.764 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.976747+0000", 2024-04-01T19:27:56.764 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1532000000000005e-05 2024-04-01T19:27:56.764 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.764 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.765 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:56.765 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.981354+0000", 2024-04-01T19:27:56.765 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046069459999999998 2024-04-01T19:27:56.765 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.765 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.765 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:56.765 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.122965+0000", 2024-04-01T19:27:56.765 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14161036399999999 2024-04-01T19:27:56.765 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.765 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.765 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:56.765 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.122996+0000", 2024-04-01T19:27:56.765 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1390999999999998e-05 2024-04-01T19:27:56.765 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.766 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.766 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:56.766 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.123031+0000", 2024-04-01T19:27:56.766 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5367000000000002e-05 2024-04-01T19:27:56.766 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.766 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:56.766 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.766 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.766 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.766 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:240160 2.c 2:3c4915e8:::benchmark_data_smithi188_77607_object72756:head [delete] snapc 0=[] ondisk+write+known_if_redirected e155)", 2024-04-01T19:27:56.766 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:38.013808+0000", 2024-04-01T19:27:56.766 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 18.647941199000002, 2024-04-01T19:27:56.766 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.117216369, 2024-04-01T19:27:56.766 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:56.767 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:56.767 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:56.767 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:56.767 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:56.767 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:56.767 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 240160 2024-04-01T19:27:56.767 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.767 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:56.767 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.767 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:56.767 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.013808+0000", 2024-04-01T19:27:56.767 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.767 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.767 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.767 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:56.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.013808+0000", 2024-04-01T19:27:56.768 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.768 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.768 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:56.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.013809+0000", 2024-04-01T19:27:56.768 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4399999999999999e-07 2024-04-01T19:27:56.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.768 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.768 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:56.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.013812+0000", 2024-04-01T19:27:56.768 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.546e-06 2024-04-01T19:27:56.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.768 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.769 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:56.769 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.013819+0000", 2024-04-01T19:27:56.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8229999999999997e-06 2024-04-01T19:27:56.769 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.769 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:56.769 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.013825+0000", 2024-04-01T19:27:56.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9309999999999996e-06 2024-04-01T19:27:56.769 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.769 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:56.769 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.013883+0000", 2024-04-01T19:27:56.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8377e-05 2024-04-01T19:27:56.769 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.770 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.770 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:56.770 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.014020+0000", 2024-04-01T19:27:56.770 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013684100000000001 2024-04-01T19:27:56.770 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.770 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.770 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:27:56.770 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.014152+0000", 2024-04-01T19:27:56.770 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013157699999999999 2024-04-01T19:27:56.770 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.770 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.770 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:56.770 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.022287+0000", 2024-04-01T19:27:56.770 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0081350680000000005 2024-04-01T19:27:56.770 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.771 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.771 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:56.771 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.130933+0000", 2024-04-01T19:27:56.771 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.108646373 2024-04-01T19:27:56.771 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.771 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.771 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:56.771 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.130977+0000", 2024-04-01T19:27:56.771 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3322999999999998e-05 2024-04-01T19:27:56.771 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.771 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.771 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:56.771 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.131024+0000", 2024-04-01T19:27:56.771 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7666000000000001e-05 2024-04-01T19:27:56.772 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.772 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:56.772 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.772 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.772 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:240168 2.c 2:3a7c047e:::benchmark_data_smithi188_77607_object72764:head [delete] snapc 0=[] ondisk+write+known_if_redirected e155)", 2024-04-01T19:27:56.772 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:38.016369+0000", 2024-04-01T19:27:56.772 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 18.645380396, 2024-04-01T19:27:56.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.114782652, 2024-04-01T19:27:56.772 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:27:56.772 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:27:56.772 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:27:56.772 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:27:56.772 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:27:56.772 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:27:56.773 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 240168 2024-04-01T19:27:56.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.773 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:27:56.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.773 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:27:56.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.016369+0000", 2024-04-01T19:27:56.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.773 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:27:56.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.016369+0000", 2024-04-01T19:27:56.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:27:56.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.774 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:27:56.774 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.016370+0000", 2024-04-01T19:27:56.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.711e-06 2024-04-01T19:27:56.774 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.774 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:27:56.774 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.016375+0000", 2024-04-01T19:27:56.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0180000000000001e-06 2024-04-01T19:27:56.774 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.774 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:27:56.774 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.016384+0000", 2024-04-01T19:27:56.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4679999999999992e-06 2024-04-01T19:27:56.774 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.775 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.775 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:27:56.775 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.016391+0000", 2024-04-01T19:27:56.775 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4420000000000001e-06 2024-04-01T19:27:56.775 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.775 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.775 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:27:56.775 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.018120+0000", 2024-04-01T19:27:56.775 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0017291419999999999 2024-04-01T19:27:56.775 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.775 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.775 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:27:56.775 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.018250+0000", 2024-04-01T19:27:56.775 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000129653 2024-04-01T19:27:56.776 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.776 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.776 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:27:56.776 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.018333+0000", 2024-04-01T19:27:56.776 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2900999999999998e-05 2024-04-01T19:27:56.776 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.776 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.776 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:27:56.776 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.022439+0000", 2024-04-01T19:27:56.776 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.004106111 2024-04-01T19:27:56.776 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.776 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.776 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:27:56.776 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.131080+0000", 2024-04-01T19:27:56.776 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.10864069799999999 2024-04-01T19:27:56.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:27:56.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.131111+0000", 2024-04-01T19:27:56.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0880000000000002e-05 2024-04-01T19:27:56.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:27:56.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:27:56.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:27:56.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.131151+0000", 2024-04-01T19:27:56.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0627999999999998e-05 2024-04-01T19:27:56.777 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.777 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:56.777 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.777 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:27:56.777 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:27:56.778 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:27:57.464 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_ops_in_flight 2024-04-01T19:27:57.761 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:57 smithi022 ceph-mon[39439]: pgmap v490: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 788 op/s 2024-04-01T19:27:58.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:57 smithi188 ceph-mon[43939]: pgmap v490: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 788 op/s 2024-04-01T19:27:58.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:57 smithi062 ceph-mon[44211]: pgmap v490: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 788 op/s 2024-04-01T19:27:58.405 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:27:58.424 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:27:58.429 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:58.429 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:27:58.530 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:27:58.571 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:58.624 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:27:58.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:58.628 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:27:58.729 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:27:58.762 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:58.782 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:27:58.784 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:58.785 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:27:58.886 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:27:58.922 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:27:59.368 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:27:59.477 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:27:59.480 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:27:59.481 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:27:59.582 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:27:59.625 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:00.054 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:59 smithi022 ceph-mon[39439]: pgmap v491: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 786 op/s 2024-04-01T19:28:00.054 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:59 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1728744257' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:28:00.055 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:59 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:28:00.055 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:59 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:28:00.055 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:00.055 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:00.055 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:00.055 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:27:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:00.078 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:28:00.084 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:00.084 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:28:00.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:59 smithi188 ceph-mon[43939]: pgmap v491: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 786 op/s 2024-04-01T19:28:00.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:59 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1728744257' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:28:00.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:59 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:28:00.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:59 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:28:00.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:00.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:00.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:00.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:27:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:00.186 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:28:00.209 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:28:00.210 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:28:00.210 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:28:00.210 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:28:00.210 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:28:00.210 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:28:00.210 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:28:00.210 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:28:00.210 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:28:00.210 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:28:00.210 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:28:00.210 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:28:00.211 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:28:00.211 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:28:00.211 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:28:00.211 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:28:00.211 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:28:00.211 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:28:00.211 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:28:00.211 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:28:00.211 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:28:00.211 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:28:00.211 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:28:00.211 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:28:00.223 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:00.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:59 smithi062 ceph-mon[44211]: pgmap v491: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 786 op/s 2024-04-01T19:28:00.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:59 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1728744257' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:28:00.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:59 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:28:00.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:59 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:28:00.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:00.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:00.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:00.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:27:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:00.443 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:28:00.446 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:00.446 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:28:00.547 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:28:00.577 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:00.600 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:28:00.603 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:00.603 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:28:00.704 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:28:00.762 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:00.810 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:28:00.814 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:00.814 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:28:00.915 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:28:00.942 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:00.942 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:00.942 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:00.942 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:00.942 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:00.942 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:00.942 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:00.942 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:00.942 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:00 smithi062 ceph-mon[44211]: osdmap e158: 12 total, 12 up, 12 in 2024-04-01T19:28:00.944 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:00.967 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:28:00.970 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:00.970 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:28:01.071 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:28:01.100 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:01.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:01.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:01.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:01.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:01.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:01.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:01.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:01.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:01.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:00 smithi022 ceph-mon[39439]: osdmap e158: 12 total, 12 up, 12 in 2024-04-01T19:28:01.122 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:28:01.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:01.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:01.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:01.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:01.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:01.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:01.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:01.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:01.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:00 smithi188 ceph-mon[43939]: osdmap e158: 12 total, 12 up, 12 in 2024-04-01T19:28:01.125 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:01.126 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:28:01.227 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:28:01.257 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:01.286 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:28:01.291 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:01.292 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:28:01.393 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:28:01.441 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:01.477 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:28:01.484 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:01.485 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:28:01.567 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:28:01.585 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:28:01.613 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:01.623 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:28:01.624 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:28:01.635 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:28:01.637 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:01.638 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:28:01.739 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:28:01.768 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:01.790 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:28:01.794 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:01.795 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:28:01.895 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:28:01.905 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:01 smithi022 ceph-mon[39439]: pgmap v493: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 4.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 782 op/s 2024-04-01T19:28:01.938 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:01.975 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:28:01.979 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:01.979 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:28:02.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:01 smithi062 ceph-mon[44211]: pgmap v493: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 4.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 782 op/s 2024-04-01T19:28:02.080 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:28:02.107 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:02.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:01 smithi188 ceph-mon[43939]: pgmap v493: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 4.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 782 op/s 2024-04-01T19:28:02.128 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:28:02.131 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:02.131 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:28:02.232 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:28:02.267 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:02.291 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:28:02.297 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:02.297 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:28:02.398 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:28:02.437 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:02.463 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:28:02.467 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:02.467 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:28:02.569 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:28:02.600 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:02.622 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:28:02.626 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:02.626 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:28:02.727 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:28:02.757 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:28:02.785 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:02.785 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:28:02.886 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:28:02.920 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:02.957 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:28:03.027 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:28:03.036 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:03.036 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:28:03.057 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_blocked_ops 2024-04-01T19:28:03.136 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:28:03.165 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:03.186 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:28:03.190 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:03.191 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:28:03.292 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:28:03.352 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:03.384 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:28:03.387 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:03.387 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:28:03.488 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:28:03.554 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:03.595 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:28:03.600 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:03.600 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:28:03.701 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:28:03.731 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:03.753 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:28:03.757 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:03.758 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:28:03.858 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:28:03.923 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:03.948 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:28:03.951 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:03.951 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:28:03.969 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:03 smithi022 ceph-mon[39439]: pgmap v494: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 4.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 783 op/s 2024-04-01T19:28:04.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:03 smithi062 ceph-mon[44211]: pgmap v494: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 4.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 783 op/s 2024-04-01T19:28:04.015 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:28:04.052 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:28:04.089 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:04.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:03 smithi188 ceph-mon[43939]: pgmap v494: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 4.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 783 op/s 2024-04-01T19:28:04.167 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:28:04.180 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:04.180 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:28:04.281 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:28:04.343 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:04.426 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:28:04.429 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:04.429 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:28:04.530 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:28:04.585 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:04.623 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:28:04.632 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:04.632 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:28:04.733 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:28:04.764 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:04.785 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:28:04.790 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:04.790 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:28:04.800 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:28:04.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:04 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:28:04.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:04 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:28:04.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:04 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3521314490' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:28:04.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:04 smithi188 ceph-mon[43939]: from='client.34979 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:28:04.891 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:28:04.935 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:05.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:04 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:28:05.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:04 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:28:05.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:04 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3521314490' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:28:05.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:04 smithi022 ceph-mon[39439]: from='client.34979 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:28:05.149 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:28:05.153 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:05.154 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:28:05.254 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:28:05.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:04 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:28:05.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:04 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:28:05.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:04 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3521314490' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:28:05.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:04 smithi062 ceph-mon[44211]: from='client.34979 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:28:05.290 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:05.327 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:28:05.332 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:05.333 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:28:05.399 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:28:05.433 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:28:05.471 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:05.506 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:28:05.509 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:05.510 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:28:05.610 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:28:05.641 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:05.664 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:28:05.668 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:05.669 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:28:05.749 INFO:tasks.thrashosds.thrasher:Recovered, killing an osd 2024-04-01T19:28:05.749 INFO:tasks.thrashosds.thrasher:Killing osd 8, live_osds are [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] 2024-04-01T19:28:05.749 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-04-01T19:28:05.749 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.8 2024-04-01T19:28:05.769 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:28:05.791 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:05 smithi022 ceph-mon[39439]: pgmap v495: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 4.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 782 op/s 2024-04-01T19:28:05.791 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:05 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:28:05.791 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:05 smithi022 ceph-mon[39439]: from='client.34979 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:28:05.791 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:05 smithi022 ceph-mon[39439]: osdmap e159: 12 total, 12 up, 12 in 2024-04-01T19:28:05.800 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:05.825 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:28:05.828 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:05.828 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:28:05.929 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:28:05.981 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:06.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:05 smithi062 ceph-mon[44211]: pgmap v495: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 4.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 782 op/s 2024-04-01T19:28:06.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:05 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:28:06.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:05 smithi062 ceph-mon[44211]: from='client.34979 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:28:06.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:05 smithi062 ceph-mon[44211]: osdmap e159: 12 total, 12 up, 12 in 2024-04-01T19:28:06.038 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:28:06.051 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:06.051 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:28:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:05 smithi188 ceph-mon[43939]: pgmap v495: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 4.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 782 op/s 2024-04-01T19:28:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:05 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:28:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:05 smithi188 ceph-mon[43939]: from='client.34979 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:28:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:05 smithi188 ceph-mon[43939]: osdmap e159: 12 total, 12 up, 12 in 2024-04-01T19:28:06.125 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 19:28:05 smithi188 systemd[1]: Stopping Ceph osd.8 for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T19:28:06.152 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:28:06.205 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:06.338 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:28:06.343 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:06.343 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:28:06.444 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:28:06.474 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:06.494 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:28:06.502 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:06.502 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:28:06.603 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:28:06.624 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 19:28:06 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[49836]: 2024-04-01T19:28:06.173+0000 7f3bce5b8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T19:28:06.624 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 19:28:06 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[49836]: 2024-04-01T19:28:06.173+0000 7f3bce5b8700 -1 osd.8 159 *** Got signal Terminated *** 2024-04-01T19:28:06.624 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 19:28:06 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[49836]: 2024-04-01T19:28:06.173+0000 7f3bce5b8700 -1 osd.8 159 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T19:28:06.635 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:06.659 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:28:06.661 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:06.661 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:28:06.763 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:28:06.793 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:06.817 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:28:06.824 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:06.824 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:28:06.925 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:28:06.952 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:06 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:28:06.952 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:06 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:28:06.952 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:06 smithi022 ceph-mon[39439]: osd.8 marked itself down and dead 2024-04-01T19:28:06.954 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:07.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:06 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:28:07.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:06 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:28:07.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:06 smithi188 ceph-mon[43939]: osd.8 marked itself down and dead 2024-04-01T19:28:07.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:06 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:28:07.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:06 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:28:07.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:06 smithi062 ceph-mon[44211]: osd.8 marked itself down and dead 2024-04-01T19:28:07.303 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:28:07.306 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:07.306 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:28:07.407 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:28:07.438 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:07.460 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:28:07.464 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:07.465 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:28:07.565 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:28:07.593 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:07.795 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:28:07.807 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 19:28:07 smithi188 bash[86153]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8 2024-04-01T19:28:07.818 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:28:07.857 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:28:07.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:07 smithi022 ceph-mon[39439]: pgmap v497: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 4.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 826 op/s 2024-04-01T19:28:07.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:07 smithi022 ceph-mon[39439]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-01T19:28:07.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:07 smithi022 ceph-mon[39439]: osdmap e160: 12 total, 11 up, 12 in 2024-04-01T19:28:07.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:07 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2303629631' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:28:07.878 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:28:07.899 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:28:07.919 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:28:07.940 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:28:07.960 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:28:07.980 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:28:07.990 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:28:08.001 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:28:08.023 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:28:08.023 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:28:08.023 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:28:08.023 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:28:08.023 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:28:08.023 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:28:08.023 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:28:08.024 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:28:08.024 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:28:08.024 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.8 2024-04-01T19:28:08.024 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:28:08.024 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:28:08.024 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:28:08.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:07 smithi188 ceph-mon[43939]: pgmap v497: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 4.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 826 op/s 2024-04-01T19:28:08.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:07 smithi188 ceph-mon[43939]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-01T19:28:08.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:07 smithi188 ceph-mon[43939]: osdmap e160: 12 total, 11 up, 12 in 2024-04-01T19:28:08.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:07 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2303629631' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:28:08.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:07 smithi062 ceph-mon[44211]: pgmap v497: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 4.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 826 op/s 2024-04-01T19:28:08.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:07 smithi062 ceph-mon[44211]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-01T19:28:08.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:07 smithi062 ceph-mon[44211]: osdmap e160: 12 total, 11 up, 12 in 2024-04-01T19:28:08.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:07 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2303629631' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:28:08.343 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:28:08.345 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:08.346 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:28:08.447 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:28:08.480 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:08.502 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:28:08.504 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:08.505 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:28:08.605 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:28:08.637 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:08.659 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:28:08.661 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:08.662 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:28:08.687 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:28:08.687 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:28:08.688 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:28:08.762 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:28:08.844 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:08.866 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:28:08.869 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:08.869 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:28:08.962 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:08 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:28:08.963 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:08 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:28:08.963 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:08.963 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:08 smithi022 ceph-mon[39439]: osdmap e161: 12 total, 11 up, 12 in 2024-04-01T19:28:08.963 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:08.963 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:08.963 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:08.963 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:08.963 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:08.963 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:08.963 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:08.963 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:08.963 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:08.964 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:08 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:28:08.964 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:08 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:28:08.970 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:28:09.001 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:09.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:08 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:28:09.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:08 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:28:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:08 smithi188 ceph-mon[43939]: osdmap e161: 12 total, 11 up, 12 in 2024-04-01T19:28:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:08 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:28:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:08 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:28:09.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:08 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:28:09.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:08 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:28:09.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:09.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:08 smithi062 ceph-mon[44211]: osdmap e161: 12 total, 11 up, 12 in 2024-04-01T19:28:09.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:09.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:09.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:09.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:09.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:09.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:09.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:09.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:09.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:09.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:08 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:28:09.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:08 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:28:09.451 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:28:09.455 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:09.455 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:28:09.556 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:28:09.585 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:09.605 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:28:09.608 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:09.608 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:28:09.709 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:28:09.738 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:10.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:10.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:09 smithi062 ceph-mon[44211]: pgmap v500: 17 pgs: 1 stale+active+clean+scrubbing+deep, 2 stale+active+clean, 1 active+clean+scrubbing+deep, 13 active+clean; 4.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 766 op/s 2024-04-01T19:28:10.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:09 smithi062 ceph-mon[44211]: osdmap e162: 12 total, 11 up, 12 in 2024-04-01T19:28:10.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:09 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:28:10.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:10.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:09 smithi022 ceph-mon[39439]: pgmap v500: 17 pgs: 1 stale+active+clean+scrubbing+deep, 2 stale+active+clean, 1 active+clean+scrubbing+deep, 13 active+clean; 4.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 766 op/s 2024-04-01T19:28:10.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:09 smithi022 ceph-mon[39439]: osdmap e162: 12 total, 11 up, 12 in 2024-04-01T19:28:10.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:09 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:28:10.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:10.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:09 smithi188 ceph-mon[43939]: pgmap v500: 17 pgs: 1 stale+active+clean+scrubbing+deep, 2 stale+active+clean, 1 active+clean+scrubbing+deep, 13 active+clean; 4.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 766 op/s 2024-04-01T19:28:10.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:09 smithi188 ceph-mon[43939]: osdmap e162: 12 total, 11 up, 12 in 2024-04-01T19:28:10.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:09 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:28:10.365 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:28:10.365 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:28:10.365 INFO:teuthology.orchestra.run.smithi022.stdout: "complaint_time": 30, 2024-04-01T19:28:10.365 INFO:teuthology.orchestra.run.smithi022.stdout: "num_blocked_ops": 0 2024-04-01T19:28:10.365 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:28:10.688 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:28:10.826 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:28:11.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:10 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/70407567' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:28:11.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:10 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/70407567' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:28:11.147 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_historic_ops 2024-04-01T19:28:11.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:10 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/70407567' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:28:11.857 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:28:12.088 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:11 smithi022 ceph-mon[39439]: pgmap v502: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 717 op/s; 17414/139256 objects degraded (12.505%) 2024-04-01T19:28:12.088 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:11 smithi022 ceph-mon[39439]: Health check failed: Degraded data redundancy: 17414/139256 objects degraded (12.505%), 4 pgs degraded (PG_DEGRADED) 2024-04-01T19:28:12.088 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:11 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:28:12.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:11 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/70407567' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:28:12.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:11 smithi022 ceph-mon[39439]: osdmap e163: 12 total, 11 up, 12 in 2024-04-01T19:28:12.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:11 smithi022 ceph-mon[39439]: 2.4 scrub starts 2024-04-01T19:28:12.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:11 smithi022 ceph-mon[39439]: 2.4 scrub ok 2024-04-01T19:28:12.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:11 smithi188 ceph-mon[43939]: pgmap v502: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 717 op/s; 17414/139256 objects degraded (12.505%) 2024-04-01T19:28:12.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:11 smithi188 ceph-mon[43939]: Health check failed: Degraded data redundancy: 17414/139256 objects degraded (12.505%), 4 pgs degraded (PG_DEGRADED) 2024-04-01T19:28:12.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:11 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:28:12.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:11 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/70407567' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:28:12.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:11 smithi188 ceph-mon[43939]: osdmap e163: 12 total, 11 up, 12 in 2024-04-01T19:28:12.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:11 smithi188 ceph-mon[43939]: 2.4 scrub starts 2024-04-01T19:28:12.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:11 smithi188 ceph-mon[43939]: 2.4 scrub ok 2024-04-01T19:28:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:11 smithi062 ceph-mon[44211]: pgmap v502: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 717 op/s; 17414/139256 objects degraded (12.505%) 2024-04-01T19:28:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:11 smithi062 ceph-mon[44211]: Health check failed: Degraded data redundancy: 17414/139256 objects degraded (12.505%), 4 pgs degraded (PG_DEGRADED) 2024-04-01T19:28:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:11 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:28:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:11 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/70407567' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:28:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:11 smithi062 ceph-mon[44211]: osdmap e163: 12 total, 11 up, 12 in 2024-04-01T19:28:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:11 smithi062 ceph-mon[44211]: 2.4 scrub starts 2024-04-01T19:28:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:11 smithi062 ceph-mon[44211]: 2.4 scrub ok 2024-04-01T19:28:12.590 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:28:13.120 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:28:13.124 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:13.124 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:28:13.225 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:28:13.254 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:13.805 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:28:13.810 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:13.811 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:28:13.894 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:28:13.912 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:28:13.944 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:13.965 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:28:13.967 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:13.968 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:28:14.064 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:28:14.068 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:28:14.084 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:28:14.096 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:13 smithi062 ceph-mon[44211]: pgmap v504: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 446 op/s; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:14.096 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:13 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:28:14.096 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:13 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:28:14.096 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:13 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:28:14.098 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:14.104 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:28:14.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:13 smithi022 ceph-mon[39439]: pgmap v504: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 446 op/s; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:14.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:13 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:28:14.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:13 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:28:14.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:13 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:28:14.119 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:28:14.122 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:14.123 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:28:14.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:13 smithi188 ceph-mon[43939]: pgmap v504: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 446 op/s; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:14.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:13 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:28:14.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:13 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:28:14.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:13 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:28:14.138 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:28:14.159 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:28:14.179 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:28:14.201 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:28:14.222 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:28:14.225 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:28:14.242 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:28:14.255 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:14.258 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.8.service' 2024-04-01T19:28:14.263 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:28:14.275 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:28:14.278 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:14.278 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:28:14.283 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:28:14.283 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:28:14.283 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:28:14.283 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:28:14.283 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:28:14.283 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:28:14.283 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:28:14.284 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:28:14.284 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:28:14.284 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.8 2024-04-01T19:28:14.284 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:28:14.284 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:28:14.284 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:28:14.303 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T19:28:14.303 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-04-01T19:28:14.304 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd down 8 2024-04-01T19:28:14.379 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:28:14.407 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:14.430 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:14.431 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:28:14.431 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:28:14.532 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:28:14.560 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:14.579 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:28:14.581 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:14.582 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:28:14.683 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:28:14.711 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:14.730 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:28:14.733 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:14.733 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:28:14.834 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:28:14.859 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:14 smithi022 ceph-mon[39439]: 2.d scrub starts 2024-04-01T19:28:14.859 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:14 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:28:14.859 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:14 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:28:14.860 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:14 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1251084588' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:28:14.860 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:14.860 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:14.860 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:14.860 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:14.860 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:14.860 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:14.860 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:14.860 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:14.860 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:14.860 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:14 smithi022 ceph-mon[39439]: osdmap e164: 12 total, 11 up, 12 in 2024-04-01T19:28:14.866 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:15.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:14 smithi062 ceph-mon[44211]: 2.d scrub starts 2024-04-01T19:28:15.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:14 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:28:15.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:14 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:28:15.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:14 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1251084588' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:28:15.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:15.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:15.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:15.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:15.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:15.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:15.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:15.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:15.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:15.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:14 smithi062 ceph-mon[44211]: osdmap e164: 12 total, 11 up, 12 in 2024-04-01T19:28:15.067 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:28:15.069 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:15.070 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:28:15.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:14 smithi188 ceph-mon[43939]: 2.d scrub starts 2024-04-01T19:28:15.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:14 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:28:15.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:14 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:28:15.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:14 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1251084588' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:28:15.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:15.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:15.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:15.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:15.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:15.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:15.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:15.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:15.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:15.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:14 smithi188 ceph-mon[43939]: osdmap e164: 12 total, 11 up, 12 in 2024-04-01T19:28:15.170 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:28:15.201 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:15.221 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:28:15.224 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:15.224 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:28:15.325 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:28:15.354 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:15.540 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:28:15.541 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:28:15.726 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:28:15.760 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:28:15.760 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:28:15.762 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:28:16.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:15 smithi022 ceph-mon[39439]: 2.d scrub ok 2024-04-01T19:28:16.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:16.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:16.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:15 smithi022 ceph-mon[39439]: pgmap v506: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 316 op/s; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:16.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:15 smithi188 ceph-mon[43939]: 2.d scrub ok 2024-04-01T19:28:16.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:16.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:16.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:15 smithi188 ceph-mon[43939]: pgmap v506: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 316 op/s; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:16.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:15 smithi062 ceph-mon[44211]: 2.d scrub ok 2024-04-01T19:28:16.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:16.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:16.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:15 smithi062 ceph-mon[44211]: pgmap v506: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 316 op/s; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:16.710 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_ops_in_flight 2024-04-01T19:28:17.105 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:28:17.111 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:17.112 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:28:17.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:16 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:28:17.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:16 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:28:17.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:16 smithi022 ceph-mon[39439]: osdmap e165: 12 total, 11 up, 12 in 2024-04-01T19:28:17.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:16 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:28:17.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:16 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:28:17.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:16 smithi188 ceph-mon[43939]: osdmap e165: 12 total, 11 up, 12 in 2024-04-01T19:28:17.213 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:28:17.244 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:16 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:28:17.244 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:16 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:28:17.245 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:16 smithi062 ceph-mon[44211]: osdmap e165: 12 total, 11 up, 12 in 2024-04-01T19:28:17.247 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:17.268 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:28:17.271 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:17.271 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:28:17.373 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:28:17.405 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:17.426 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:28:17.429 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:17.429 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:28:17.530 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:28:17.542 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:28:17.564 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:17.586 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:28:17.589 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:17.590 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:28:17.690 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:28:17.726 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:17.748 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:28:17.751 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:17.751 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:28:17.852 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:28:17.883 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:17.904 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:28:17.906 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:17.907 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:28:18.008 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:28:18.037 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:18.057 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:28:18.060 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:18.060 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:28:18.161 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:28:18.191 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:18.210 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:28:18.212 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:18.213 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:28:18.314 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:28:18.344 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:18.364 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:28:18.366 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:18.367 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:28:18.468 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:28:18.496 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:18.516 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:28:18.518 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:18.519 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:28:18.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:18 smithi022 ceph-mon[39439]: pgmap v508: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 8 op/s; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:18.619 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:28:18.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:18 smithi188 ceph-mon[43939]: pgmap v508: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 8 op/s; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:18.644 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:18 smithi062 ceph-mon[44211]: pgmap v508: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 8 op/s; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:18.646 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:18.665 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:28:18.668 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:18.668 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:28:18.769 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:28:18.803 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:18.824 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:28:18.827 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:18.827 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:28:18.885 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:28:18.928 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:28:18.958 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:19.082 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:28:19.086 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:19.086 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:28:19.187 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:28:19.219 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:19.241 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:28:19.244 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:19.245 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:28:19.346 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:28:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:19.946 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8 is already down. 2024-04-01T19:28:20.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:19 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[39416]: 2024-04-01T19:28:19.790+0000 7fd025a9f700 -1 mon.a@0(leader).osd e165 definitely_dead 0 2024-04-01T19:28:20.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:20 smithi022 ceph-mon[39439]: pgmap v509: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 6 op/s; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:20.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:20 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 17414/139154 objects degraded (12.514%), 4 pgs degraded (PG_DEGRADED) 2024-04-01T19:28:20.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:20 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3411871217' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["8"]}]: dispatch 2024-04-01T19:28:20.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:20 smithi022 ceph-mon[39439]: from='client.24973 ' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["8"]}]: dispatch 2024-04-01T19:28:20.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:20 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/644984346' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:28:20.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:20 smithi188 ceph-mon[43939]: pgmap v509: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 6 op/s; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:20.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:20 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 17414/139154 objects degraded (12.514%), 4 pgs degraded (PG_DEGRADED) 2024-04-01T19:28:20.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:20 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3411871217' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["8"]}]: dispatch 2024-04-01T19:28:20.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:20 smithi188 ceph-mon[43939]: from='client.24973 ' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["8"]}]: dispatch 2024-04-01T19:28:20.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:20 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/644984346' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:28:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:20 smithi062 ceph-mon[44211]: pgmap v509: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 6 op/s; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:20 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 17414/139154 objects degraded (12.514%), 4 pgs degraded (PG_DEGRADED) 2024-04-01T19:28:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:20 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3411871217' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["8"]}]: dispatch 2024-04-01T19:28:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:20 smithi062 ceph-mon[44211]: from='client.24973 ' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["8"]}]: dispatch 2024-04-01T19:28:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:20 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/644984346' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:28:20.782 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:28:20.807 INFO:tasks.thrashosds.thrasher:Removing osd 8, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] 2024-04-01T19:28:20.807 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd out 8 2024-04-01T19:28:21.526 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:28:21.527 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:28:21.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:21 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:28:21.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:21 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/644984346' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:28:21.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:21 smithi022 ceph-mon[39439]: osdmap e166: 12 total, 11 up, 12 in 2024-04-01T19:28:21.529 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:21.529 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:28:21.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:21 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:28:21.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:21 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/644984346' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:28:21.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:21 smithi188 ceph-mon[43939]: osdmap e166: 12 total, 11 up, 12 in 2024-04-01T19:28:21.630 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:28:21.661 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:21 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:28:21.661 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:21 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/644984346' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:28:21.661 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:21 smithi062 ceph-mon[44211]: osdmap e166: 12 total, 11 up, 12 in 2024-04-01T19:28:21.663 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:21.685 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:28:21.687 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:21.688 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:28:21.789 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:28:21.817 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:21.966 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:28:21.970 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:21.970 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:28:22.072 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:28:22.100 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:22.225 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:28:22.227 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:22.228 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:28:22.328 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:28:22.360 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:22.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:22 smithi022 ceph-mon[39439]: pgmap v510: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:22.381 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:28:22.384 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:22.384 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:28:22.485 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:28:22.515 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:22.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:22 smithi188 ceph-mon[43939]: pgmap v510: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:22.663 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:28:22.666 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:22.666 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:28:22.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:22 smithi062 ceph-mon[44211]: pgmap v510: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:22.767 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:28:22.801 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:22.822 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:28:22.824 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:22.825 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:28:22.926 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:28:22.956 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:23.905 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:28:23.908 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:23.908 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:28:24.009 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:28:24.025 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:28:24.025 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:28:24.043 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:24.065 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:28:24.067 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:24.068 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:28:24.169 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:28:24.199 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:24.220 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:28:24.223 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:24.223 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:28:24.324 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:28:24.357 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:24.378 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:28:24.381 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:24.381 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:28:24.482 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:28:24.513 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:24.535 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:28:24.538 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:24.538 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:28:24.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:24 smithi022 ceph-mon[39439]: pgmap v512: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:24.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:24 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:28:24.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:24 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:28:24.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:24 smithi188 ceph-mon[43939]: pgmap v512: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:24.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:24 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:28:24.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:24 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:28:24.639 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:28:24.670 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:24 smithi062 ceph-mon[44211]: pgmap v512: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:24.670 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:24 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:28:24.670 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:24 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:28:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:24.693 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:28:24.696 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:24.696 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:28:24.797 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:28:24.828 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:24.848 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:28:24.851 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:24.851 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:28:24.952 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:28:24.988 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:25.296 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_blocked_ops 2024-04-01T19:28:25.371 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:28:25.584 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:25 smithi022 ceph-mon[39439]: osdmap e167: 12 total, 11 up, 12 in 2024-04-01T19:28:25.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:25 smithi188 ceph-mon[43939]: osdmap e167: 12 total, 11 up, 12 in 2024-04-01T19:28:25.739 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:28:25.742 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:25.743 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:28:25.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:25 smithi062 ceph-mon[44211]: osdmap e167: 12 total, 11 up, 12 in 2024-04-01T19:28:25.844 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:28:25.876 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:25.905 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:28:25.929 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:28:25.929 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:28:25.931 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:28:25.952 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:28:25.973 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:28:25.993 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:28:26.014 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:28:26.035 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:28:26.056 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:28:26.077 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:28:26.098 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:28:26.098 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:28:26.098 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:28:26.099 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:28:26.099 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:28:26.099 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:28:26.099 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:28:26.099 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:28:26.099 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:28:26.099 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.8 2024-04-01T19:28:26.099 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:28:26.099 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:28:26.099 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:28:26.407 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:28:26.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:26 smithi022 ceph-mon[39439]: pgmap v514: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:26.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:26 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1773640669' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:28:26.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:26.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:26.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:26.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:26 smithi188 ceph-mon[43939]: pgmap v514: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:26.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:26 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1773640669' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:28:26.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:26.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:26.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:26.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:26 smithi062 ceph-mon[44211]: pgmap v514: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:26.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:26 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1773640669' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:28:26.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:26.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:26.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:26.896 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:28:26.897 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:28:27.427 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:28:27.430 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:27.431 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:28:27.531 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:28:27.565 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:27.586 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:28:27.589 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:27.589 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:28:27.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:27.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:27.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:27.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:27.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:27.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:27.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:27.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:27.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:27.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:27.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:27.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:27.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:27.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:27.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:27.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:27.690 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:28:27.726 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:27.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:28.077 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:28:28.079 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:28.080 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:28:28.181 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:28:28.213 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:28.234 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:28:28.236 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:28.236 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:28:28.337 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:28:28.368 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:28.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:28 smithi022 ceph-mon[39439]: pgmap v515: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:28.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:28 smithi022 ceph-mon[39439]: 2.0 scrub starts 2024-04-01T19:28:28.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:28 smithi022 ceph-mon[39439]: 2.0 scrub ok 2024-04-01T19:28:28.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:28 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[39416]: 2024-04-01T19:28:28.520+0000 7fd025a9f700 -1 mon.a@0(leader).osd e167 definitely_dead 0 2024-04-01T19:28:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:28 smithi188 ceph-mon[43939]: pgmap v515: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:28.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:28 smithi188 ceph-mon[43939]: 2.0 scrub starts 2024-04-01T19:28:28.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:28 smithi188 ceph-mon[43939]: 2.0 scrub ok 2024-04-01T19:28:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:28 smithi062 ceph-mon[44211]: pgmap v515: 17 pgs: 4 undersized+degraded+peered, 13 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:28 smithi062 ceph-mon[44211]: 2.0 scrub starts 2024-04-01T19:28:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:28 smithi062 ceph-mon[44211]: 2.0 scrub ok 2024-04-01T19:28:28.898 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:28:29.370 INFO:teuthology.orchestra.run.smithi022.stderr:marked out osd.8. 2024-04-01T19:28:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:29 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1701156195' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["8"]}]: dispatch 2024-04-01T19:28:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:29 smithi188 ceph-mon[43939]: Client client.admin marked osd.8 out, after it was down for 21 seconds 2024-04-01T19:28:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:29 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1701156195' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["8"]}]: dispatch 2024-04-01T19:28:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:29 smithi062 ceph-mon[44211]: Client client.admin marked osd.8 out, after it was down for 21 seconds 2024-04-01T19:28:29.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:29 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1701156195' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["8"]}]: dispatch 2024-04-01T19:28:29.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:29 smithi022 ceph-mon[39439]: Client client.admin marked osd.8 out, after it was down for 21 seconds 2024-04-01T19:28:30.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:30 smithi022 ceph-mon[39439]: pgmap v516: 17 pgs: 1 active+clean+scrubbing, 4 undersized+degraded+peered, 12 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:30.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:30 smithi022 ceph-mon[39439]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-01T19:28:30.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:30 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1701156195' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["8"]}]': finished 2024-04-01T19:28:30.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:30 smithi022 ceph-mon[39439]: osdmap e168: 12 total, 11 up, 11 in 2024-04-01T19:28:30.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:30 smithi022 ceph-mon[39439]: osdmap e169: 12 total, 11 up, 11 in 2024-04-01T19:28:30.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:30 smithi188 ceph-mon[43939]: pgmap v516: 17 pgs: 1 active+clean+scrubbing, 4 undersized+degraded+peered, 12 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:30.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:30 smithi188 ceph-mon[43939]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-01T19:28:30.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:30 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1701156195' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["8"]}]': finished 2024-04-01T19:28:30.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:30 smithi188 ceph-mon[43939]: osdmap e168: 12 total, 11 up, 11 in 2024-04-01T19:28:30.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:30 smithi188 ceph-mon[43939]: osdmap e169: 12 total, 11 up, 11 in 2024-04-01T19:28:30.654 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:28:30.655 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:28:30.699 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.8 2024-04-01T19:28:30.699 INFO:tasks.thrashosds.thrasher:remote for osd 8 is ubuntu@smithi188.front.sepia.ceph.com 2024-04-01T19:28:30.699 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -n osd.8 --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-8 --journal-path /var/lib/ceph/osd/ceph-8/journal --op list-pgs 2024-04-01T19:28:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:30 smithi062 ceph-mon[44211]: pgmap v516: 17 pgs: 1 active+clean+scrubbing, 4 undersized+degraded+peered, 12 active+clean; 4.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17414/139154 objects degraded (12.514%) 2024-04-01T19:28:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:30 smithi062 ceph-mon[44211]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-01T19:28:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:30 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1701156195' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["8"]}]': finished 2024-04-01T19:28:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:30 smithi062 ceph-mon[44211]: osdmap e168: 12 total, 11 up, 11 in 2024-04-01T19:28:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:30 smithi062 ceph-mon[44211]: osdmap e169: 12 total, 11 up, 11 in 2024-04-01T19:28:30.925 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/osd.8/config 2024-04-01T19:28:31.433 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:28:31.433 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:28:31.433 INFO:teuthology.orchestra.run.smithi022.stdout: "complaint_time": 30, 2024-04-01T19:28:31.433 INFO:teuthology.orchestra.run.smithi022.stdout: "num_blocked_ops": 0 2024-04-01T19:28:31.434 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:28:31.786 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:31 smithi022 ceph-mon[39439]: pgmap v519: 17 pgs: 2 remapped+peering, 1 active+clean+scrubbing, 2 peering, 12 active+clean; 4.2 GiB data, 8.1 GiB used, 975 GiB / 983 GiB avail 2024-04-01T19:28:32.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:31 smithi022 ceph-mon[39439]: 2.f starting backfill to osd.4 from (0'0,0'0] MAX to 159'18810 2024-04-01T19:28:32.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:31 smithi022 ceph-mon[39439]: osdmap e170: 12 total, 11 up, 11 in 2024-04-01T19:28:32.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:31 smithi022 ceph-mon[39439]: 2.5 starting backfill to osd.4 from (0'0,0'0] MAX to 159'16405 2024-04-01T19:28:32.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:31 smithi022 ceph-mon[39439]: 2.6 starting backfill to osd.3 from (0'0,0'0] MAX to 159'16593 2024-04-01T19:28:32.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:31 smithi022 ceph-mon[39439]: 2.b starting backfill to osd.7 from (0'0,0'0] MAX to 159'19840 2024-04-01T19:28:32.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:31 smithi022 ceph-mon[39439]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17414/139154 objects degraded (12.514%), 4 pgs degraded) 2024-04-01T19:28:32.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:31 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:28:32.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:31 smithi188 ceph-mon[43939]: pgmap v519: 17 pgs: 2 remapped+peering, 1 active+clean+scrubbing, 2 peering, 12 active+clean; 4.2 GiB data, 8.1 GiB used, 975 GiB / 983 GiB avail 2024-04-01T19:28:32.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:31 smithi188 ceph-mon[43939]: 2.f starting backfill to osd.4 from (0'0,0'0] MAX to 159'18810 2024-04-01T19:28:32.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:31 smithi188 ceph-mon[43939]: osdmap e170: 12 total, 11 up, 11 in 2024-04-01T19:28:32.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:31 smithi188 ceph-mon[43939]: 2.5 starting backfill to osd.4 from (0'0,0'0] MAX to 159'16405 2024-04-01T19:28:32.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:31 smithi188 ceph-mon[43939]: 2.6 starting backfill to osd.3 from (0'0,0'0] MAX to 159'16593 2024-04-01T19:28:32.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:31 smithi188 ceph-mon[43939]: 2.b starting backfill to osd.7 from (0'0,0'0] MAX to 159'19840 2024-04-01T19:28:32.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:31 smithi188 ceph-mon[43939]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17414/139154 objects degraded (12.514%), 4 pgs degraded) 2024-04-01T19:28:32.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:31 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:28:32.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:31 smithi062 ceph-mon[44211]: pgmap v519: 17 pgs: 2 remapped+peering, 1 active+clean+scrubbing, 2 peering, 12 active+clean; 4.2 GiB data, 8.1 GiB used, 975 GiB / 983 GiB avail 2024-04-01T19:28:32.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:31 smithi062 ceph-mon[44211]: 2.f starting backfill to osd.4 from (0'0,0'0] MAX to 159'18810 2024-04-01T19:28:32.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:31 smithi062 ceph-mon[44211]: osdmap e170: 12 total, 11 up, 11 in 2024-04-01T19:28:32.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:31 smithi062 ceph-mon[44211]: 2.5 starting backfill to osd.4 from (0'0,0'0] MAX to 159'16405 2024-04-01T19:28:32.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:31 smithi062 ceph-mon[44211]: 2.6 starting backfill to osd.3 from (0'0,0'0] MAX to 159'16593 2024-04-01T19:28:32.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:31 smithi062 ceph-mon[44211]: 2.b starting backfill to osd.7 from (0'0,0'0] MAX to 159'19840 2024-04-01T19:28:32.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:31 smithi062 ceph-mon[44211]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17414/139154 objects degraded (12.514%), 4 pgs degraded) 2024-04-01T19:28:32.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:31 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:28:32.276 INFO:teuthology.orchestra.run.smithi188.stderr:Creating an OSD daemon form without an OSD FSID value 2024-04-01T19:28:32.720 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:28:32.723 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:32.723 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:28:32.824 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:28:32.864 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:33.728 INFO:teuthology.orchestra.run.smithi188.stdout:2.f 2024-04-01T19:28:33.728 INFO:teuthology.orchestra.run.smithi188.stdout:2.b 2024-04-01T19:28:33.728 INFO:teuthology.orchestra.run.smithi188.stdout:2.5 2024-04-01T19:28:33.728 INFO:teuthology.orchestra.run.smithi188.stdout:2.6 2024-04-01T19:28:33.788 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:33 smithi022 ceph-mon[39439]: pgmap v521: 17 pgs: 2 remapped+peering, 1 active+clean+scrubbing, 2 peering, 12 active+clean; 4.2 GiB data, 8.2 GiB used, 975 GiB / 983 GiB avail 2024-04-01T19:28:33.817 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:28:33.821 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:33.821 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:28:33.922 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:28:33.955 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:33.978 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:28:33.981 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:33.982 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:28:34.075 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:28:34.082 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:28:34.104 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:28:34.123 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:34.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:33 smithi188 ceph-mon[43939]: pgmap v521: 17 pgs: 2 remapped+peering, 1 active+clean+scrubbing, 2 peering, 12 active+clean; 4.2 GiB data, 8.2 GiB used, 975 GiB / 983 GiB avail 2024-04-01T19:28:34.135 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:28:34.163 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:28:34.191 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:28:34.217 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:28:34.245 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:28:34.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:33 smithi062 ceph-mon[44211]: pgmap v521: 17 pgs: 2 remapped+peering, 1 active+clean+scrubbing, 2 peering, 12 active+clean; 4.2 GiB data, 8.2 GiB used, 975 GiB / 983 GiB avail 2024-04-01T19:28:34.279 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:28:34.279 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:28:34.282 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:34.282 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:28:34.308 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:28:34.338 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:28:34.364 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:28:34.364 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:28:34.364 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:28:34.364 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:28:34.364 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:28:34.364 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:28:34.365 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:28:34.365 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:28:34.365 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:28:34.365 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.8 2024-04-01T19:28:34.365 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:28:34.365 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:28:34.365 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:28:34.383 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:28:34.415 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:34.438 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:28:34.441 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:34.442 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:28:34.543 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:28:34.580 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:34.682 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:28:34.687 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:34.688 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:28:34.789 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:28:34.797 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:34 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1867954319' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:28:34.797 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:34.797 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:34.797 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:34.798 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:34.798 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:34.798 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:34.798 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:34.798 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:34.821 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:34.845 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:28:34.849 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:34.850 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:28:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:34 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1867954319' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:28:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:34.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:34.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:34.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:34.950 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:28:34.979 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:35.080 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:28:35.088 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:35.088 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:28:35.106 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_historic_ops 2024-04-01T19:28:35.116 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -n osd.8 --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-8 --journal-path /var/lib/ceph/osd/ceph-8/journal --op export --pgid 2.6 --file /var/log/ceph/exp.2.6.8 2024-04-01T19:28:35.189 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:28:35.229 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:35.254 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:28:35.257 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:35.258 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:28:35.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:34 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1867954319' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:28:35.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:35.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:35.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:35.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:35.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:35.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:35.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:35.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:35.358 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:28:35.389 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:35.404 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/osd.8/config 2024-04-01T19:28:35.414 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:28:35.417 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:35.417 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:28:35.518 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:28:35.556 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:35.813 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:28:35.879 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:28:35.879 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:28:36.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:36.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:36.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:36.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:35 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:28:36.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:35 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:28:36.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:35 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:28:36.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:35 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:28:36.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:35 smithi022 ceph-mon[39439]: pgmap v522: 17 pgs: 2 remapped+peering, 2 undersized+degraded+remapped+backfilling+peered, 13 active+clean; 4.2 GiB data, 8.2 GiB used, 975 GiB / 983 GiB avail; 4057/139154 objects degraded (2.915%); 48 MiB/s, 775 objects/s recovering 2024-04-01T19:28:36.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:35 smithi022 ceph-mon[39439]: Health check failed: Degraded data redundancy: 4057/139154 objects degraded (2.915%), 2 pgs degraded (PG_DEGRADED) 2024-04-01T19:28:36.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:35 smithi022 ceph-mon[39439]: osdmap e171: 12 total, 11 up, 11 in 2024-04-01T19:28:36.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:35 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1801002978' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:28:36.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:36.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:36.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:36.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:35 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:28:36.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:35 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:28:36.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:35 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:28:36.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:35 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:28:36.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:35 smithi188 ceph-mon[43939]: pgmap v522: 17 pgs: 2 remapped+peering, 2 undersized+degraded+remapped+backfilling+peered, 13 active+clean; 4.2 GiB data, 8.2 GiB used, 975 GiB / 983 GiB avail; 4057/139154 objects degraded (2.915%); 48 MiB/s, 775 objects/s recovering 2024-04-01T19:28:36.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:35 smithi188 ceph-mon[43939]: Health check failed: Degraded data redundancy: 4057/139154 objects degraded (2.915%), 2 pgs degraded (PG_DEGRADED) 2024-04-01T19:28:36.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:35 smithi188 ceph-mon[43939]: osdmap e171: 12 total, 11 up, 11 in 2024-04-01T19:28:36.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:35 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1801002978' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:28:36.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:36.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:36.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:36.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:35 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:28:36.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:35 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:28:36.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:35 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:28:36.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:35 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:28:36.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:35 smithi062 ceph-mon[44211]: pgmap v522: 17 pgs: 2 remapped+peering, 2 undersized+degraded+remapped+backfilling+peered, 13 active+clean; 4.2 GiB data, 8.2 GiB used, 975 GiB / 983 GiB avail; 4057/139154 objects degraded (2.915%); 48 MiB/s, 775 objects/s recovering 2024-04-01T19:28:36.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:35 smithi062 ceph-mon[44211]: Health check failed: Degraded data redundancy: 4057/139154 objects degraded (2.915%), 2 pgs degraded (PG_DEGRADED) 2024-04-01T19:28:36.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:35 smithi062 ceph-mon[44211]: osdmap e171: 12 total, 11 up, 11 in 2024-04-01T19:28:36.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:35 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1801002978' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:28:36.612 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:28:36.616 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:36.616 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:28:36.657 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:28:36.717 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:28:36.727 INFO:teuthology.orchestra.run.smithi188.stderr:Creating an OSD daemon form without an OSD FSID value 2024-04-01T19:28:36.751 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:36.926 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:36 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:28:36.926 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:36 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:28:36.926 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:36 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:28:36.926 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:36 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1801002978' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:28:36.926 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:36 smithi022 ceph-mon[39439]: osdmap e172: 12 total, 11 up, 11 in 2024-04-01T19:28:37.004 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:28:37.006 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:36 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:28:37.006 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:36 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:28:37.006 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:36 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:28:37.006 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:36 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1801002978' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:28:37.006 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:36 smithi188 ceph-mon[43939]: osdmap e172: 12 total, 11 up, 11 in 2024-04-01T19:28:37.007 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:37.008 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:28:37.109 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:28:37.140 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:37.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:36 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:28:37.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:36 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:28:37.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:36 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:28:37.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:36 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1801002978' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:28:37.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:36 smithi062 ceph-mon[44211]: osdmap e172: 12 total, 11 up, 11 in 2024-04-01T19:28:37.267 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:28:37.269 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:37.270 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:28:37.371 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:28:37.403 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:37.425 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:28:37.429 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:37.429 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:28:37.475 INFO:teuthology.orchestra.run.smithi188.stderr:Exporting 2.6 info 2.6( v 159'16591 (128'6500,159'16591] local-lis/les=106/107 n=4357 ec=106/106 lis/c=106/106 les/c/f=107/107/0 sis=106) 2024-04-01T19:28:37.530 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:28:37.545 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60001373:::benchmark_data_smithi188_77607_object145919:head# 2024-04-01T19:28:37.545 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:600088d3:::benchmark_data_smithi188_77607_object124377:head# 2024-04-01T19:28:37.545 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6000e136:::benchmark_data_smithi188_77607_object98409:head# 2024-04-01T19:28:37.546 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60011b48:::benchmark_data_smithi188_77607_object139526:head# 2024-04-01T19:28:37.546 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6001b3a3:::benchmark_data_smithi188_77607_object148402:head# 2024-04-01T19:28:37.547 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6001ff2f:::benchmark_data_smithi188_77607_object119051:head# 2024-04-01T19:28:37.547 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:600304a7:::benchmark_data_smithi188_77607_object152587:head# 2024-04-01T19:28:37.548 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6004546a:::benchmark_data_smithi188_77607_object166817:head# 2024-04-01T19:28:37.548 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6004bc28:::benchmark_data_smithi188_77607_object146763:head# 2024-04-01T19:28:37.549 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6004e626:::benchmark_data_smithi188_77607_object99926:head# 2024-04-01T19:28:37.549 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6004e925:::benchmark_data_smithi188_77607_object150924:head# 2024-04-01T19:28:37.550 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:600725bf:::benchmark_data_smithi188_77607_object147091:head# 2024-04-01T19:28:37.550 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6007553a:::benchmark_data_smithi188_77607_object136941:head# 2024-04-01T19:28:37.550 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60075ac8:::benchmark_data_smithi188_77607_object110784:head# 2024-04-01T19:28:37.551 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6007ac1b:::benchmark_data_smithi188_77607_object149626:head# 2024-04-01T19:28:37.551 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6007e2fb:::benchmark_data_smithi188_77607_object122576:head# 2024-04-01T19:28:37.552 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6007fdb4:::benchmark_data_smithi188_77607_object161169:head# 2024-04-01T19:28:37.552 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6009499f:::benchmark_data_smithi188_77607_object157457:head# 2024-04-01T19:28:37.553 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:600951e0:::benchmark_data_smithi188_77607_object128966:head# 2024-04-01T19:28:37.553 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60098538:::benchmark_data_smithi188_77607_object102002:head# 2024-04-01T19:28:37.553 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:600a10c6:::benchmark_data_smithi188_77607_object135316:head# 2024-04-01T19:28:37.554 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:600a4a83:::benchmark_data_smithi188_77607_object116415:head# 2024-04-01T19:28:37.554 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:600c4062:::benchmark_data_smithi188_77607_object123647:head# 2024-04-01T19:28:37.555 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60103143:::benchmark_data_smithi188_77607_object166743:head# 2024-04-01T19:28:37.555 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6010cce1:::benchmark_data_smithi188_77607_object108058:head# 2024-04-01T19:28:37.555 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60125b3b:::benchmark_data_smithi188_77607_object116175:head# 2024-04-01T19:28:37.556 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6013e857:::benchmark_data_smithi188_77607_object99607:head# 2024-04-01T19:28:37.556 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6014826a:::benchmark_data_smithi188_77607_object154405:head# 2024-04-01T19:28:37.557 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:601618be:::benchmark_data_smithi188_77607_object102813:head# 2024-04-01T19:28:37.557 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6016aca2:::benchmark_data_smithi188_77607_object115303:head# 2024-04-01T19:28:37.558 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60173e90:::benchmark_data_smithi188_77607_object154533:head# 2024-04-01T19:28:37.558 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6017a1c9:::benchmark_data_smithi188_77607_object125954:head# 2024-04-01T19:28:37.559 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6017a357:::benchmark_data_smithi188_77607_object134283:head# 2024-04-01T19:28:37.559 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6018c6ea:::benchmark_data_smithi188_77607_object155620:head# 2024-04-01T19:28:37.559 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6018d881:::benchmark_data_smithi188_77607_object130608:head# 2024-04-01T19:28:37.560 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6019c2be:::benchmark_data_smithi188_77607_object162674:head# 2024-04-01T19:28:37.560 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6019f7e4:::benchmark_data_smithi188_77607_object136900:head# 2024-04-01T19:28:37.561 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:601a5829:::benchmark_data_smithi188_77607_object113227:head# 2024-04-01T19:28:37.561 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:601a815d:::benchmark_data_smithi188_77607_object103008:head# 2024-04-01T19:28:37.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:601c7328:::benchmark_data_smithi188_77607_object102232:head# 2024-04-01T19:28:37.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:601d6a1b:::benchmark_data_smithi188_77607_object132109:head# 2024-04-01T19:28:37.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:601e2b07:::benchmark_data_smithi188_77607_object114407:head# 2024-04-01T19:28:37.563 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:601e78ca:::benchmark_data_smithi188_77607_object155613:head# 2024-04-01T19:28:37.563 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:601ef820:::benchmark_data_smithi188_77607_object132437:head# 2024-04-01T19:28:37.564 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:37.564 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:601f4529:::benchmark_data_smithi188_77607_object125923:head# 2024-04-01T19:28:37.565 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60200f47:::benchmark_data_smithi188_77607_object122689:head# 2024-04-01T19:28:37.565 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60202198:::benchmark_data_smithi188_77607_object152140:head# 2024-04-01T19:28:37.565 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6020cfa0:::benchmark_data_smithi188_77607_object142707:head# 2024-04-01T19:28:37.566 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60214ee0:::benchmark_data_smithi188_77607_object125578:head# 2024-04-01T19:28:37.566 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:602152a0:::benchmark_data_smithi188_77607_object133607:head# 2024-04-01T19:28:37.566 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6023436b:::benchmark_data_smithi188_77607_object131869:head# 2024-04-01T19:28:37.567 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60243b50:::benchmark_data_smithi188_77607_object153998:head# 2024-04-01T19:28:37.567 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60245e63:::benchmark_data_smithi188_77607_object165238:head# 2024-04-01T19:28:37.568 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:602684da:::benchmark_data_smithi188_77607_object147515:head# 2024-04-01T19:28:37.568 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60279552:::benchmark_data_smithi188_77607_object102643:head# 2024-04-01T19:28:37.569 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6027e0c7:::benchmark_data_smithi188_77607_object166674:head# 2024-04-01T19:28:37.569 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60288354:::benchmark_data_smithi188_77607_object121192:head# 2024-04-01T19:28:37.569 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:602a6e37:::benchmark_data_smithi188_77607_object121235:head# 2024-04-01T19:28:37.570 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:602b336d:::benchmark_data_smithi188_77607_object112319:head# 2024-04-01T19:28:37.570 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:602bcdb9:::benchmark_data_smithi188_77607_object129194:head# 2024-04-01T19:28:37.571 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:602c0894:::benchmark_data_smithi188_77607_object126477:head# 2024-04-01T19:28:37.571 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:602c23a8:::benchmark_data_smithi188_77607_object107742:head# 2024-04-01T19:28:37.572 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:602c989a:::benchmark_data_smithi188_77607_object140552:head# 2024-04-01T19:28:37.572 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:602dd0ff:::benchmark_data_smithi188_77607_object156851:head# 2024-04-01T19:28:37.572 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:602fb849:::benchmark_data_smithi188_77607_object151933:head# 2024-04-01T19:28:37.573 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60308e9a:::benchmark_data_smithi188_77607_object123501:head# 2024-04-01T19:28:37.573 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6030b099:::benchmark_data_smithi188_77607_object120731:head# 2024-04-01T19:28:37.574 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6032cb98:::benchmark_data_smithi188_77607_object112806:head# 2024-04-01T19:28:37.574 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6034a0a1:::benchmark_data_smithi188_77607_object163068:head# 2024-04-01T19:28:37.575 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6035db2f:::benchmark_data_smithi188_77607_object140092:head# 2024-04-01T19:28:37.575 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6036d344:::benchmark_data_smithi188_77607_object127720:head# 2024-04-01T19:28:37.576 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:603717e1:::benchmark_data_smithi188_77607_object100455:head# 2024-04-01T19:28:37.576 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6037ad21:::benchmark_data_smithi188_77607_object152347:head# 2024-04-01T19:28:37.577 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60388cb1:::benchmark_data_smithi188_77607_object141251:head# 2024-04-01T19:28:37.577 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60389165:::benchmark_data_smithi188_77607_object99830:head# 2024-04-01T19:28:37.577 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60396aa8:::benchmark_data_smithi188_77607_object104260:head# 2024-04-01T19:28:37.578 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60397ec0:::benchmark_data_smithi188_77607_object126674:head# 2024-04-01T19:28:37.578 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6039c447:::benchmark_data_smithi188_77607_object112554:head# 2024-04-01T19:28:37.579 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:603b725f:::benchmark_data_smithi188_77607_object163538:head# 2024-04-01T19:28:37.579 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:603bbb29:::benchmark_data_smithi188_77607_object157938:head# 2024-04-01T19:28:37.580 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:603c000b:::benchmark_data_smithi188_77607_object101549:head# 2024-04-01T19:28:37.580 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:603d89d8:::benchmark_data_smithi188_77607_object150051:head# 2024-04-01T19:28:37.581 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:603de932:::benchmark_data_smithi188_77607_object120597:head# 2024-04-01T19:28:37.581 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:603e488b:::benchmark_data_smithi188_77607_object100490:head# 2024-04-01T19:28:37.581 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:603e6eca:::benchmark_data_smithi188_77607_object145642:head# 2024-04-01T19:28:37.582 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:603ee3a6:::benchmark_data_smithi188_77607_object156908:head# 2024-04-01T19:28:37.582 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:603fcfbf:::benchmark_data_smithi188_77607_object118977:head# 2024-04-01T19:28:37.583 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:603ff0cd:::benchmark_data_smithi188_77607_object112111:head# 2024-04-01T19:28:37.583 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60405bea:::benchmark_data_smithi188_77607_object144911:head# 2024-04-01T19:28:37.584 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6040bbcf:::benchmark_data_smithi188_77607_object149107:head# 2024-04-01T19:28:37.584 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6040c1cb:::benchmark_data_smithi188_77607_object112357:head# 2024-04-01T19:28:37.584 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:604327fa:::benchmark_data_smithi188_77607_object107666:head# 2024-04-01T19:28:37.585 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60440120:::benchmark_data_smithi188_77607_object100311:head# 2024-04-01T19:28:37.585 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:28:37.586 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60444980:::benchmark_data_smithi188_77607_object124261:head# 2024-04-01T19:28:37.586 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6044d593:::benchmark_data_smithi188_77607_object157381:head# 2024-04-01T19:28:37.586 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6045591f:::benchmark_data_smithi188_77607_object156457:head# 2024-04-01T19:28:37.587 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6046324e:::benchmark_data_smithi188_77607_object138630:head# 2024-04-01T19:28:37.587 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6046ed91:::benchmark_data_smithi188_77607_object150948:head# 2024-04-01T19:28:37.588 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:37.588 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:28:37.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60479b1a:::benchmark_data_smithi188_77607_object126392:head# 2024-04-01T19:28:37.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60491bcd:::benchmark_data_smithi188_77607_object166510:head# 2024-04-01T19:28:37.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:604d3f8c:::benchmark_data_smithi188_77607_object130614:head# 2024-04-01T19:28:37.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:604da83f:::benchmark_data_smithi188_77607_object117702:head# 2024-04-01T19:28:37.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:604e13b8:::benchmark_data_smithi188_77607_object140841:head# 2024-04-01T19:28:37.590 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:604e39cc:::benchmark_data_smithi188_77607_object149412:head# 2024-04-01T19:28:37.590 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:604e521f:::benchmark_data_smithi188_77607_object99239:head# 2024-04-01T19:28:37.591 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:604e5fd8:::benchmark_data_smithi188_77607_object156420:head# 2024-04-01T19:28:37.591 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:604f2a2d:::benchmark_data_smithi188_77607_object155981:head# 2024-04-01T19:28:37.592 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6050ca8e:::benchmark_data_smithi188_77607_object161392:head# 2024-04-01T19:28:37.592 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60513471:::benchmark_data_smithi188_77607_object156876:head# 2024-04-01T19:28:37.592 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6052ce06:::benchmark_data_smithi188_77607_object114835:head# 2024-04-01T19:28:37.593 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60541ba7:::benchmark_data_smithi188_77607_object139646:head# 2024-04-01T19:28:37.593 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60542ef4:::benchmark_data_smithi188_77607_object121501:head# 2024-04-01T19:28:37.594 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6055d7e6:::benchmark_data_smithi188_77607_object118241:head# 2024-04-01T19:28:37.594 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60569ffd:::benchmark_data_smithi188_77607_object125036:head# 2024-04-01T19:28:37.595 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6056a6c3:::benchmark_data_smithi188_77607_object130367:head# 2024-04-01T19:28:37.595 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:605831c8:::benchmark_data_smithi188_77607_object151577:head# 2024-04-01T19:28:37.596 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60597bcf:::benchmark_data_smithi188_77607_object117069:head# 2024-04-01T19:28:37.596 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:605a7728:::benchmark_data_smithi188_77607_object140627:head# 2024-04-01T19:28:37.597 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:605a98c3:::benchmark_data_smithi188_77607_object124869:head# 2024-04-01T19:28:37.597 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:605b5bcd:::benchmark_data_smithi188_77607_object104316:head# 2024-04-01T19:28:37.597 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:605b9fd4:::benchmark_data_smithi188_77607_object113705:head# 2024-04-01T19:28:37.598 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:605f16e5:::benchmark_data_smithi188_77607_object123270:head# 2024-04-01T19:28:37.598 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:605f9814:::benchmark_data_smithi188_77607_object99225:head# 2024-04-01T19:28:37.599 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60609339:::benchmark_data_smithi188_77607_object158415:head# 2024-04-01T19:28:37.599 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60615060:::benchmark_data_smithi188_77607_object145887:head# 2024-04-01T19:28:37.600 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:606352e5:::benchmark_data_smithi188_77607_object120500:head# 2024-04-01T19:28:37.600 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6063ce1a:::benchmark_data_smithi188_77607_object124916:head# 2024-04-01T19:28:37.600 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60647137:::benchmark_data_smithi188_77607_object154375:head# 2024-04-01T19:28:37.601 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6064d2c8:::benchmark_data_smithi188_77607_object143419:head# 2024-04-01T19:28:37.601 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6065b864:::benchmark_data_smithi188_77607_object162476:head# 2024-04-01T19:28:37.602 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60683380:::benchmark_data_smithi188_77607_object134901:head# 2024-04-01T19:28:37.602 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6068aa7e:::benchmark_data_smithi188_77607_object158486:head# 2024-04-01T19:28:37.603 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:606dce35:::benchmark_data_smithi188_77607_object103625:head# 2024-04-01T19:28:37.603 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:606e16c6:::benchmark_data_smithi188_77607_object159886:head# 2024-04-01T19:28:37.604 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:606e92dc:::benchmark_data_smithi188_77607_object99261:head# 2024-04-01T19:28:37.604 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:606edb39:::benchmark_data_smithi188_77607_object124722:head# 2024-04-01T19:28:37.605 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6070d916:::benchmark_data_smithi188_77607_object103350:head# 2024-04-01T19:28:37.605 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6071588d:::benchmark_data_smithi188_77607_object125230:head# 2024-04-01T19:28:37.605 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6073b89d:::benchmark_data_smithi188_77607_object123800:head# 2024-04-01T19:28:37.606 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6073d82e:::benchmark_data_smithi188_77607_object141417:head# 2024-04-01T19:28:37.606 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60745658:::benchmark_data_smithi188_77607_object103284:head# 2024-04-01T19:28:37.607 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60748cec:::benchmark_data_smithi188_77607_object105275:head# 2024-04-01T19:28:37.607 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6076d1e4:::benchmark_data_smithi188_77607_object106248:head# 2024-04-01T19:28:37.608 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60770cbe:::benchmark_data_smithi188_77607_object110913:head# 2024-04-01T19:28:37.608 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:607717ac:::benchmark_data_smithi188_77607_object118620:head# 2024-04-01T19:28:37.609 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60779c78:::benchmark_data_smithi188_77607_object120790:head# 2024-04-01T19:28:37.609 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60780a28:::benchmark_data_smithi188_77607_object99132:head# 2024-04-01T19:28:37.610 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6078ad61:::benchmark_data_smithi188_77607_object139102:head# 2024-04-01T19:28:37.610 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6078bf1f:::benchmark_data_smithi188_77607_object113788:head# 2024-04-01T19:28:37.610 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:607ce7b6:::benchmark_data_smithi188_77607_object111346:head# 2024-04-01T19:28:37.611 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:607e5365:::benchmark_data_smithi188_77607_object138759:head# 2024-04-01T19:28:37.611 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:607e7511:::benchmark_data_smithi188_77607_object157981:head# 2024-04-01T19:28:37.612 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:607e9a6d:::benchmark_data_smithi188_77607_object148418:head# 2024-04-01T19:28:37.612 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:607ef7c6:::benchmark_data_smithi188_77607_object162364:head# 2024-04-01T19:28:37.613 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:607f8e37:::benchmark_data_smithi188_77607_object145165:head# 2024-04-01T19:28:37.613 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6082af85:::benchmark_data_smithi188_77607_object146351:head# 2024-04-01T19:28:37.614 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6085a5f6:::benchmark_data_smithi188_77607_object152890:head# 2024-04-01T19:28:37.614 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6085c98c:::benchmark_data_smithi188_77607_object136118:head# 2024-04-01T19:28:37.615 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60866264:::benchmark_data_smithi188_77607_object98286:head# 2024-04-01T19:28:37.615 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6087c1c0:::benchmark_data_smithi188_77607_object139301:head# 2024-04-01T19:28:37.616 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:608a62c2:::benchmark_data_smithi188_77607_object106587:head# 2024-04-01T19:28:37.616 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:608aeb61:::benchmark_data_smithi188_77607_object145053:head# 2024-04-01T19:28:37.616 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:608b8de0:::benchmark_data_smithi188_77607_object104326:head# 2024-04-01T19:28:37.617 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:608c5a45:::benchmark_data_smithi188_77607_object113376:head# 2024-04-01T19:28:37.617 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:608cf4a6:::benchmark_data_smithi188_77607_object140717:head# 2024-04-01T19:28:37.618 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:608daf61:::benchmark_data_smithi188_77607_object139256:head# 2024-04-01T19:28:37.618 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:608dd83f:::benchmark_data_smithi188_77607_object132377:head# 2024-04-01T19:28:37.619 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:608e1a03:::benchmark_data_smithi188_77607_object145969:head# 2024-04-01T19:28:37.620 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:608e2aa0:::benchmark_data_smithi188_77607_object156958:head# 2024-04-01T19:28:37.620 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:608eaf04:::benchmark_data_smithi188_77607_object159160:head# 2024-04-01T19:28:37.620 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:608f9ece:::benchmark_data_smithi188_77607_object107524:head# 2024-04-01T19:28:37.620 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60911f47:::benchmark_data_smithi188_77607_object136276:head# 2024-04-01T19:28:37.621 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6092c463:::benchmark_data_smithi188_77607_object134241:head# 2024-04-01T19:28:37.621 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60943319:::benchmark_data_smithi188_77607_object128298:head# 2024-04-01T19:28:37.622 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60954e2f:::benchmark_data_smithi188_77607_object126863:head# 2024-04-01T19:28:37.622 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6095d4cb:::benchmark_data_smithi188_77607_object161448:head# 2024-04-01T19:28:37.623 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60968ce9:::benchmark_data_smithi188_77607_object161372:head# 2024-04-01T19:28:37.623 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6096c463:::benchmark_data_smithi188_77607_object160404:head# 2024-04-01T19:28:37.623 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:609761c8:::benchmark_data_smithi188_77607_object167235:head# 2024-04-01T19:28:37.624 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:609816c3:::benchmark_data_smithi188_77607_object98219:head# 2024-04-01T19:28:37.624 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6098bf65:::benchmark_data_smithi188_77607_object143872:head# 2024-04-01T19:28:37.625 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6098fa40:::benchmark_data_smithi188_77607_object123470:head# 2024-04-01T19:28:37.625 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:609af99e:::benchmark_data_smithi188_77607_object137460:head# 2024-04-01T19:28:37.626 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:609b67a3:::benchmark_data_smithi188_77607_object109827:head# 2024-04-01T19:28:37.626 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:609bbef9:::benchmark_data_smithi188_77607_object132421:head# 2024-04-01T19:28:37.626 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:609c601e:::benchmark_data_smithi188_77607_object113621:head# 2024-04-01T19:28:37.627 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:609d3de2:::benchmark_data_smithi188_77607_object141628:head# 2024-04-01T19:28:37.627 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:609e1550:::benchmark_data_smithi188_77607_object130259:head# 2024-04-01T19:28:37.628 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:609f653e:::benchmark_data_smithi188_77607_object166589:head# 2024-04-01T19:28:37.628 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60a06c32:::benchmark_data_smithi188_77607_object104303:head# 2024-04-01T19:28:37.629 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60a113d1:::benchmark_data_smithi188_77607_object129129:head# 2024-04-01T19:28:37.629 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60a1ae5e:::benchmark_data_smithi188_77607_object108017:head# 2024-04-01T19:28:37.630 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60a2ff9d:::benchmark_data_smithi188_77607_object105381:head# 2024-04-01T19:28:37.630 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60a385f9:::benchmark_data_smithi188_77607_object164105:head# 2024-04-01T19:28:37.631 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60a3d950:::benchmark_data_smithi188_77607_object125995:head# 2024-04-01T19:28:37.631 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60a4609e:::benchmark_data_smithi188_77607_object164928:head# 2024-04-01T19:28:37.631 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60a48916:::benchmark_data_smithi188_77607_object140285:head# 2024-04-01T19:28:37.632 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60a4fe71:::benchmark_data_smithi188_77607_object134996:head# 2024-04-01T19:28:37.632 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60a5019c:::benchmark_data_smithi188_77607_object157936:head# 2024-04-01T19:28:37.633 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60a794c3:::benchmark_data_smithi188_77607_object119367:head# 2024-04-01T19:28:37.633 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60a8b624:::benchmark_data_smithi188_77607_object134145:head# 2024-04-01T19:28:37.634 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60aaa45a:::benchmark_data_smithi188_77607_object131176:head# 2024-04-01T19:28:37.634 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60ab2704:::benchmark_data_smithi188_77607_object159257:head# 2024-04-01T19:28:37.635 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60ab5e9f:::benchmark_data_smithi188_77607_object106399:head# 2024-04-01T19:28:37.635 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60add86f:::benchmark_data_smithi188_77607_object124003:head# 2024-04-01T19:28:37.635 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60ae6d83:::benchmark_data_smithi188_77607_object132362:head# 2024-04-01T19:28:37.636 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60af2324:::benchmark_data_smithi188_77607_object133703:head# 2024-04-01T19:28:37.636 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60afbae5:::benchmark_data_smithi188_77607_object164877:head# 2024-04-01T19:28:37.636 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60b05f3b:::benchmark_data_smithi188_77607_object119572:head# 2024-04-01T19:28:37.637 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60b25829:::benchmark_data_smithi188_77607_object136663:head# 2024-04-01T19:28:37.638 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60b60fe0:::benchmark_data_smithi188_77607_object145730:head# 2024-04-01T19:28:37.638 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60b9d189:::benchmark_data_smithi188_77607_object143480:head# 2024-04-01T19:28:37.638 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60ba5c51:::benchmark_data_smithi188_77607_object102518:head# 2024-04-01T19:28:37.639 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60bdc2da:::benchmark_data_smithi188_77607_object103924:head# 2024-04-01T19:28:37.639 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60be0671:::benchmark_data_smithi188_77607_object151786:head# 2024-04-01T19:28:37.640 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60bea1c7:::benchmark_data_smithi188_77607_object154060:head# 2024-04-01T19:28:37.640 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60bf54ab:::benchmark_data_smithi188_77607_object148891:head# 2024-04-01T19:28:37.641 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60c0b003:::benchmark_data_smithi188_77607_object164851:head# 2024-04-01T19:28:37.641 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60c17da4:::benchmark_data_smithi188_77607_object164788:head# 2024-04-01T19:28:37.641 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60c24cf7:::benchmark_data_smithi188_77607_object110334:head# 2024-04-01T19:28:37.642 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60c2c4a2:::benchmark_data_smithi188_77607_object147501:head# 2024-04-01T19:28:37.642 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60c3dcea:::benchmark_data_smithi188_77607_object108393:head# 2024-04-01T19:28:37.643 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60c3ff30:::benchmark_data_smithi188_77607_object162999:head# 2024-04-01T19:28:37.643 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60c42723:::benchmark_data_smithi188_77607_object145409:head# 2024-04-01T19:28:37.644 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60c55f72:::benchmark_data_smithi188_77607_object112608:head# 2024-04-01T19:28:37.644 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60c5e749:::benchmark_data_smithi188_77607_object135906:head# 2024-04-01T19:28:37.645 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60c7dc6e:::benchmark_data_smithi188_77607_object133377:head# 2024-04-01T19:28:37.645 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60c8a2c0:::benchmark_data_smithi188_77607_object148946:head# 2024-04-01T19:28:37.645 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60c9961c:::benchmark_data_smithi188_77607_object135228:head# 2024-04-01T19:28:37.646 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60caf19d:::benchmark_data_smithi188_77607_object118709:head# 2024-04-01T19:28:37.646 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60cb1fb3:::benchmark_data_smithi188_77607_object134738:head# 2024-04-01T19:28:37.647 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60cce44e:::benchmark_data_smithi188_77607_object148169:head# 2024-04-01T19:28:37.647 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60ccf172:::benchmark_data_smithi188_77607_object145013:head# 2024-04-01T19:28:37.648 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60cd42a6:::benchmark_data_smithi188_77607_object98433:head# 2024-04-01T19:28:37.648 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60cd8124:::benchmark_data_smithi188_77607_object124800:head# 2024-04-01T19:28:37.649 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60cee482:::benchmark_data_smithi188_77607_object161205:head# 2024-04-01T19:28:37.649 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60d0848f:::benchmark_data_smithi188_77607_object128915:head# 2024-04-01T19:28:37.650 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60d0a88f:::benchmark_data_smithi188_77607_object129758:head# 2024-04-01T19:28:37.650 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60d13dca:::benchmark_data_smithi188_77607_object147095:head# 2024-04-01T19:28:37.650 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60d22787:::benchmark_data_smithi188_77607_object157328:head# 2024-04-01T19:28:37.651 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60d3d5a6:::benchmark_data_smithi188_77607_object161924:head# 2024-04-01T19:28:37.652 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60d3dafd:::benchmark_data_smithi188_77607_object112303:head# 2024-04-01T19:28:37.652 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60d3e346:::benchmark_data_smithi188_77607_object111408:head# 2024-04-01T19:28:37.652 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60d43569:::benchmark_data_smithi188_77607_object132716:head# 2024-04-01T19:28:37.653 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60d531b9:::benchmark_data_smithi188_77607_object145236:head# 2024-04-01T19:28:37.653 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60d6a94b:::benchmark_data_smithi188_77607_object155096:head# 2024-04-01T19:28:37.654 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60d725ab:::benchmark_data_smithi188_77607_object123030:head# 2024-04-01T19:28:37.654 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60d819ab:::benchmark_data_smithi188_77607_object135559:head# 2024-04-01T19:28:37.654 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60d858bc:::benchmark_data_smithi188_77607_object133130:head# 2024-04-01T19:28:37.655 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60d8e5ef:::benchmark_data_smithi188_77607_object153249:head# 2024-04-01T19:28:37.655 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60d92922:::benchmark_data_smithi188_77607_object144415:head# 2024-04-01T19:28:37.656 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60d96a07:::benchmark_data_smithi188_77607_object119243:head# 2024-04-01T19:28:37.656 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60da351a:::benchmark_data_smithi188_77607_object111010:head# 2024-04-01T19:28:37.657 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60da56b8:::benchmark_data_smithi188_77607_object102537:head# 2024-04-01T19:28:37.657 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60db785b:::benchmark_data_smithi188_77607_object107021:head# 2024-04-01T19:28:37.658 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60dd408f:::benchmark_data_smithi188_77607_object126985:head# 2024-04-01T19:28:37.658 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60dd70c7:::benchmark_data_smithi188_77607_object160733:head# 2024-04-01T19:28:37.658 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60dd7609:::benchmark_data_smithi188_77607_object137779:head# 2024-04-01T19:28:37.659 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60de0b03:::benchmark_data_smithi188_77607_object160462:head# 2024-04-01T19:28:37.659 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60dec46f:::benchmark_data_smithi188_77607_object112148:head# 2024-04-01T19:28:37.660 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60df0b57:::benchmark_data_smithi188_77607_object108532:head# 2024-04-01T19:28:37.660 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60df180b:::benchmark_data_smithi188_77607_object164841:head# 2024-04-01T19:28:37.661 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60df2bab:::benchmark_data_smithi188_77607_object145480:head# 2024-04-01T19:28:37.661 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60dfb557:::benchmark_data_smithi188_77607_object156968:head# 2024-04-01T19:28:37.662 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60dfe6ad:::benchmark_data_smithi188_77607_object104746:head# 2024-04-01T19:28:37.662 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60e0eb67:::benchmark_data_smithi188_77607_object106136:head# 2024-04-01T19:28:37.663 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60e1ab95:::benchmark_data_smithi188_77607_object112510:head# 2024-04-01T19:28:37.663 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60e34acb:::benchmark_data_smithi188_77607_object157332:head# 2024-04-01T19:28:37.666 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60e399e4:::benchmark_data_smithi188_77607_object119582:head# 2024-04-01T19:28:37.666 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60e447bf:::benchmark_data_smithi188_77607_object164738:head# 2024-04-01T19:28:37.666 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60e64719:::benchmark_data_smithi188_77607_object149205:head# 2024-04-01T19:28:37.666 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60e669fe:::benchmark_data_smithi188_77607_object101218:head# 2024-04-01T19:28:37.667 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60e6a862:::benchmark_data_smithi188_77607_object120146:head# 2024-04-01T19:28:37.667 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60e7d21c:::benchmark_data_smithi188_77607_object153751:head# 2024-04-01T19:28:37.667 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60e7fb9d:::benchmark_data_smithi188_77607_object118213:head# 2024-04-01T19:28:37.667 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60e80c86:::benchmark_data_smithi188_77607_object123617:head# 2024-04-01T19:28:37.667 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60ea4ea6:::benchmark_data_smithi188_77607_object100668:head# 2024-04-01T19:28:37.668 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60ebd48e:::benchmark_data_smithi188_77607_object132973:head# 2024-04-01T19:28:37.668 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60ed03b3:::benchmark_data_smithi188_77607_object135506:head# 2024-04-01T19:28:37.668 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60f082bd:::benchmark_data_smithi188_77607_object116908:head# 2024-04-01T19:28:37.669 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60f0bf64:::benchmark_data_smithi188_77607_object128805:head# 2024-04-01T19:28:37.669 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60f104de:::benchmark_data_smithi188_77607_object158866:head# 2024-04-01T19:28:37.669 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60f1a257:::benchmark_data_smithi188_77607_object116002:head# 2024-04-01T19:28:37.670 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60f1ad9b:::benchmark_data_smithi188_77607_object102285:head# 2024-04-01T19:28:37.670 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60f24be0:::benchmark_data_smithi188_77607_object134648:head# 2024-04-01T19:28:37.671 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60f28326:::benchmark_data_smithi188_77607_object118041:head# 2024-04-01T19:28:37.671 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60f3d0e9:::benchmark_data_smithi188_77607_object157892:head# 2024-04-01T19:28:37.672 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60f4afc0:::benchmark_data_smithi188_77607_object133370:head# 2024-04-01T19:28:37.672 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60f5d410:::benchmark_data_smithi188_77607_object120674:head# 2024-04-01T19:28:37.673 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60f6f7a0:::benchmark_data_smithi188_77607_object147272:head# 2024-04-01T19:28:37.673 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60f6fbbe:::benchmark_data_smithi188_77607_object142270:head# 2024-04-01T19:28:37.674 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60f9d527:::benchmark_data_smithi188_77607_object98456:head# 2024-04-01T19:28:37.674 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60fa0be9:::benchmark_data_smithi188_77607_object116345:head# 2024-04-01T19:28:37.674 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60fa0dff:::benchmark_data_smithi188_77607_object156182:head# 2024-04-01T19:28:37.675 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60fa5fe0:::benchmark_data_smithi188_77607_object132335:head# 2024-04-01T19:28:37.675 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60fa6fb6:::benchmark_data_smithi188_77607_object153463:head# 2024-04-01T19:28:37.676 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60fb2847:::benchmark_data_smithi188_77607_object112186:head# 2024-04-01T19:28:37.676 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60fcaaa5:::benchmark_data_smithi188_77607_object109822:head# 2024-04-01T19:28:37.677 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60fcdad2:::benchmark_data_smithi188_77607_object146653:head# 2024-04-01T19:28:37.678 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60fdc518:::benchmark_data_smithi188_77607_object144467:head# 2024-04-01T19:28:37.679 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60fdfc79:::benchmark_data_smithi188_77607_object155992:head# 2024-04-01T19:28:37.679 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60fe6088:::benchmark_data_smithi188_77607_object152927:head# 2024-04-01T19:28:37.680 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60fe6202:::benchmark_data_smithi188_77607_object134275:head# 2024-04-01T19:28:37.680 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60fedca8:::benchmark_data_smithi188_77607_object111882:head# 2024-04-01T19:28:37.681 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60ff125a:::benchmark_data_smithi188_77607_object131741:head# 2024-04-01T19:28:37.681 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60ff774c:::benchmark_data_smithi188_77607_object137563:head# 2024-04-01T19:28:37.682 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:60ffc5b4:::benchmark_data_smithi188_77607_object112399:head# 2024-04-01T19:28:37.682 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6100679b:::benchmark_data_smithi188_77607_object128500:head# 2024-04-01T19:28:37.682 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6101ac5f:::benchmark_data_smithi188_77607_object128961:head# 2024-04-01T19:28:37.683 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61021838:::benchmark_data_smithi188_77607_object163659:head# 2024-04-01T19:28:37.683 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61023f81:::benchmark_data_smithi188_77607_object116009:head# 2024-04-01T19:28:37.684 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6102aa70:::benchmark_data_smithi188_77607_object127392:head# 2024-04-01T19:28:37.684 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6104c35c:::benchmark_data_smithi188_77607_object136747:head# 2024-04-01T19:28:37.685 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6105243d:::benchmark_data_smithi188_77607_object113505:head# 2024-04-01T19:28:37.685 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:610594fc:::benchmark_data_smithi188_77607_object157298:head# 2024-04-01T19:28:37.686 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61063ae0:::benchmark_data_smithi188_77607_object154610:head# 2024-04-01T19:28:37.686 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61071a63:::benchmark_data_smithi188_77607_object120226:head# 2024-04-01T19:28:37.687 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61072fef:::benchmark_data_smithi188_77607_object157301:head# 2024-04-01T19:28:37.687 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61086fc1:::benchmark_data_smithi188_77607_object163219:head# 2024-04-01T19:28:37.688 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6108f540:::benchmark_data_smithi188_77607_object113766:head# 2024-04-01T19:28:37.688 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:610a5b73:::benchmark_data_smithi188_77607_object129078:head# 2024-04-01T19:28:37.688 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:28:37.690 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:610a8969:::benchmark_data_smithi188_77607_object159195:head# 2024-04-01T19:28:37.690 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:610aeffc:::benchmark_data_smithi188_77607_object125540:head# 2024-04-01T19:28:37.690 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:610dd230:::benchmark_data_smithi188_77607_object118552:head# 2024-04-01T19:28:37.690 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:610dd6dd:::benchmark_data_smithi188_77607_object154901:head# 2024-04-01T19:28:37.691 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:610f4b9f:::benchmark_data_smithi188_77607_object134808:head# 2024-04-01T19:28:37.691 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:610fb582:::benchmark_data_smithi188_77607_object113061:head# 2024-04-01T19:28:37.692 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:610ff804:::benchmark_data_smithi188_77607_object138783:head# 2024-04-01T19:28:37.692 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61100f97:::benchmark_data_smithi188_77607_object101699:head# 2024-04-01T19:28:37.692 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6111e932:::benchmark_data_smithi188_77607_object136721:head# 2024-04-01T19:28:37.693 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6111fe52:::benchmark_data_smithi188_77607_object118221:head# 2024-04-01T19:28:37.693 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6112b4fb:::benchmark_data_smithi188_77607_object157058:head# 2024-04-01T19:28:37.694 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61132110:::benchmark_data_smithi188_77607_object133558:head# 2024-04-01T19:28:37.694 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61144dbf:::benchmark_data_smithi188_77607_object165436:head# 2024-04-01T19:28:37.695 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6115b6f9:::benchmark_data_smithi188_77607_object110348:head# 2024-04-01T19:28:37.695 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6116a93b:::benchmark_data_smithi188_77607_object146345:head# 2024-04-01T19:28:37.695 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61170e5c:::benchmark_data_smithi188_77607_object161005:head# 2024-04-01T19:28:37.696 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:611a7e70:::benchmark_data_smithi188_77607_object106025:head# 2024-04-01T19:28:37.697 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:611b4d26:::benchmark_data_smithi188_77607_object131783:head# 2024-04-01T19:28:37.697 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:611c29fd:::benchmark_data_smithi188_77607_object149588:head# 2024-04-01T19:28:37.697 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:611c3c00:::benchmark_data_smithi188_77607_object129009:head# 2024-04-01T19:28:37.698 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:611c952e:::benchmark_data_smithi188_77607_object133327:head# 2024-04-01T19:28:37.699 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:611e254a:::benchmark_data_smithi188_77607_object98143:head# 2024-04-01T19:28:37.699 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:611ec15b:::benchmark_data_smithi188_77607_object120502:head# 2024-04-01T19:28:37.699 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:611f80fd:::benchmark_data_smithi188_77607_object126614:head# 2024-04-01T19:28:37.700 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:611f9fbd:::benchmark_data_smithi188_77607_object99891:head# 2024-04-01T19:28:37.700 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:611fbde5:::benchmark_data_smithi188_77607_object145841:head# 2024-04-01T19:28:37.701 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6121ae50:::benchmark_data_smithi188_77607_object163606:head# 2024-04-01T19:28:37.701 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6122dd28:::benchmark_data_smithi188_77607_object164175:head# 2024-04-01T19:28:37.702 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61230456:::benchmark_data_smithi188_77607_object160518:head# 2024-04-01T19:28:37.702 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6123fd58:::benchmark_data_smithi188_77607_object158618:head# 2024-04-01T19:28:37.703 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61244ae6:::benchmark_data_smithi188_77607_object123150:head# 2024-04-01T19:28:37.703 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6126f2bc:::benchmark_data_smithi188_77607_object158909:head# 2024-04-01T19:28:37.704 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6127e025:::benchmark_data_smithi188_77607_object156415:head# 2024-04-01T19:28:37.704 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61281b41:::benchmark_data_smithi188_77607_object132071:head# 2024-04-01T19:28:37.705 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61296e39:::benchmark_data_smithi188_77607_object114567:head# 2024-04-01T19:28:37.705 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6129bd80:::benchmark_data_smithi188_77607_object138511:head# 2024-04-01T19:28:37.706 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6129de92:::benchmark_data_smithi188_77607_object126350:head# 2024-04-01T19:28:37.706 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6129e70c:::benchmark_data_smithi188_77607_object162345:head# 2024-04-01T19:28:37.706 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:612addd4:::benchmark_data_smithi188_77607_object161119:head# 2024-04-01T19:28:37.707 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:612ae990:::benchmark_data_smithi188_77607_object144826:head# 2024-04-01T19:28:37.708 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:612b5f7c:::benchmark_data_smithi188_77607_object150914:head# 2024-04-01T19:28:37.708 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:612bc7e7:::benchmark_data_smithi188_77607_object101319:head# 2024-04-01T19:28:37.708 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6131064e:::benchmark_data_smithi188_77607_object144582:head# 2024-04-01T19:28:37.709 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61311964:::benchmark_data_smithi188_77607_object144493:head# 2024-04-01T19:28:37.709 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61318db4:::benchmark_data_smithi188_77607_object112286:head# 2024-04-01T19:28:37.710 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:613413f0:::benchmark_data_smithi188_77607_object101085:head# 2024-04-01T19:28:37.710 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6134580a:::benchmark_data_smithi188_77607_object122290:head# 2024-04-01T19:28:37.711 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61348d69:::benchmark_data_smithi188_77607_object157966:head# 2024-04-01T19:28:37.711 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6135e007:::benchmark_data_smithi188_77607_object162426:head# 2024-04-01T19:28:37.711 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6136cc4b:::benchmark_data_smithi188_77607_object143754:head# 2024-04-01T19:28:37.712 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61374040:::benchmark_data_smithi188_77607_object122701:head# 2024-04-01T19:28:37.712 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61380192:::benchmark_data_smithi188_77607_object105329:head# 2024-04-01T19:28:37.713 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:613a3e31:::benchmark_data_smithi188_77607_object144508:head# 2024-04-01T19:28:37.713 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:613a8ceb:::benchmark_data_smithi188_77607_object162909:head# 2024-04-01T19:28:37.713 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:613b5227:::benchmark_data_smithi188_77607_object152918:head# 2024-04-01T19:28:37.714 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:613c9d1c:::benchmark_data_smithi188_77607_object105122:head# 2024-04-01T19:28:37.714 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:613cf45e:::benchmark_data_smithi188_77607_object155312:head# 2024-04-01T19:28:37.715 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:613d6b1a:::benchmark_data_smithi188_77607_object98754:head# 2024-04-01T19:28:37.715 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:613dfa92:::benchmark_data_smithi188_77607_object159755:head# 2024-04-01T19:28:37.716 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:613dfbee:::benchmark_data_smithi188_77607_object100590:head# 2024-04-01T19:28:37.716 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:613dff26:::benchmark_data_smithi188_77607_object143656:head# 2024-04-01T19:28:37.717 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:613eb8d6:::benchmark_data_smithi188_77607_object99273:head# 2024-04-01T19:28:37.717 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:613f768a:::benchmark_data_smithi188_77607_object138852:head# 2024-04-01T19:28:37.718 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:613f8700:::benchmark_data_smithi188_77607_object108110:head# 2024-04-01T19:28:37.718 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61400c52:::benchmark_data_smithi188_77607_object158137:head# 2024-04-01T19:28:37.719 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:614152b3:::benchmark_data_smithi188_77607_object125128:head# 2024-04-01T19:28:37.719 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6142aea8:::benchmark_data_smithi188_77607_object100744:head# 2024-04-01T19:28:37.720 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6144f106:::benchmark_data_smithi188_77607_object164683:head# 2024-04-01T19:28:37.720 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6145c2bc:::benchmark_data_smithi188_77607_object140255:head# 2024-04-01T19:28:37.721 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6145d21a:::benchmark_data_smithi188_77607_object101614:head# 2024-04-01T19:28:37.721 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6147dade:::benchmark_data_smithi188_77607_object109051:head# 2024-04-01T19:28:37.721 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:614810ce:::benchmark_data_smithi188_77607_object104853:head# 2024-04-01T19:28:37.722 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:37.722 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61492b49:::benchmark_data_smithi188_77607_object111202:head# 2024-04-01T19:28:37.722 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61499162:::benchmark_data_smithi188_77607_object161931:head# 2024-04-01T19:28:37.723 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:614999ab:::benchmark_data_smithi188_77607_object153326:head# 2024-04-01T19:28:37.723 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:614b02d0:::benchmark_data_smithi188_77607_object128149:head# 2024-04-01T19:28:37.724 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:614caaf7:::benchmark_data_smithi188_77607_object124260:head# 2024-04-01T19:28:37.724 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:614cd449:::benchmark_data_smithi188_77607_object147074:head# 2024-04-01T19:28:37.725 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:614d25ef:::benchmark_data_smithi188_77607_object98597:head# 2024-04-01T19:28:37.725 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:614d4680:::benchmark_data_smithi188_77607_object133636:head# 2024-04-01T19:28:37.726 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:614d4734:::benchmark_data_smithi188_77607_object157705:head# 2024-04-01T19:28:37.726 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:614e1015:::benchmark_data_smithi188_77607_object161244:head# 2024-04-01T19:28:37.727 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:614f6733:::benchmark_data_smithi188_77607_object99744:head# 2024-04-01T19:28:37.727 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:614faefa:::benchmark_data_smithi188_77607_object113269:head# 2024-04-01T19:28:37.728 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6150544d:::benchmark_data_smithi188_77607_object160819:head# 2024-04-01T19:28:37.728 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:615164a1:::benchmark_data_smithi188_77607_object103893:head# 2024-04-01T19:28:37.729 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:615262c8:::benchmark_data_smithi188_77607_object153269:head# 2024-04-01T19:28:37.729 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6152ee40:::benchmark_data_smithi188_77607_object122991:head# 2024-04-01T19:28:37.730 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6153814a:::benchmark_data_smithi188_77607_object106927:head# 2024-04-01T19:28:37.730 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61544064:::benchmark_data_smithi188_77607_object109789:head# 2024-04-01T19:28:37.731 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6154a105:::benchmark_data_smithi188_77607_object133258:head# 2024-04-01T19:28:37.731 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6154ce99:::benchmark_data_smithi188_77607_object141173:head# 2024-04-01T19:28:37.732 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6155357d:::benchmark_data_smithi188_77607_object105805:head# 2024-04-01T19:28:37.732 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61564b55:::benchmark_data_smithi188_77607_object161037:head# 2024-04-01T19:28:37.733 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61565444:::benchmark_data_smithi188_77607_object109982:head# 2024-04-01T19:28:37.733 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61566302:::benchmark_data_smithi188_77607_object132005:head# 2024-04-01T19:28:37.734 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61574ed6:::benchmark_data_smithi188_77607_object154905:head# 2024-04-01T19:28:37.734 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6157ce32:::benchmark_data_smithi188_77607_object148964:head# 2024-04-01T19:28:37.735 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61592c19:::benchmark_data_smithi188_77607_object148431:head# 2024-04-01T19:28:37.735 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6159e33e:::benchmark_data_smithi188_77607_object119751:head# 2024-04-01T19:28:37.736 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:615c69a8:::benchmark_data_smithi188_77607_object107687:head# 2024-04-01T19:28:37.736 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:615d3949:::benchmark_data_smithi188_77607_object153271:head# 2024-04-01T19:28:37.737 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:615f9a48:::benchmark_data_smithi188_77607_object155267:head# 2024-04-01T19:28:37.737 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:615fef73:::benchmark_data_smithi188_77607_object152742:head# 2024-04-01T19:28:37.738 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6160a373:::benchmark_data_smithi188_77607_object151482:head# 2024-04-01T19:28:37.738 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6160d32a:::benchmark_data_smithi188_77607_object160854:head# 2024-04-01T19:28:37.738 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6161a521:::benchmark_data_smithi188_77607_object158691:head# 2024-04-01T19:28:37.739 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:616254bb:::benchmark_data_smithi188_77607_object112964:head# 2024-04-01T19:28:37.739 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:616423ae:::benchmark_data_smithi188_77607_object107710:head# 2024-04-01T19:28:37.740 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6165a1ef:::benchmark_data_smithi188_77607_object134140:head# 2024-04-01T19:28:37.740 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6165ce48:::benchmark_data_smithi188_77607_object140618:head# 2024-04-01T19:28:37.741 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61667053:::benchmark_data_smithi188_77607_object153734:head# 2024-04-01T19:28:37.741 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61682bd3:::benchmark_data_smithi188_77607_object104249:head# 2024-04-01T19:28:37.742 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:616b1bd5:::benchmark_data_smithi188_77607_object109443:head# 2024-04-01T19:28:37.742 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:616c38ae:::benchmark_data_smithi188_77607_object112178:head# 2024-04-01T19:28:37.743 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:616c9b1d:::benchmark_data_smithi188_77607_object156647:head# 2024-04-01T19:28:37.743 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:616d7198:::benchmark_data_smithi188_77607_object129863:head# 2024-04-01T19:28:37.743 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:616dafae:::benchmark_data_smithi188_77607_object164956:head# 2024-04-01T19:28:37.744 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:616ff074:::benchmark_data_smithi188_77607_object161186:head# 2024-04-01T19:28:37.744 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:28:37.745 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61718561:::benchmark_data_smithi188_77607_object155083:head# 2024-04-01T19:28:37.745 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6173a412:::benchmark_data_smithi188_77607_object106715:head# 2024-04-01T19:28:37.746 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:617593a9:::benchmark_data_smithi188_77607_object130461:head# 2024-04-01T19:28:37.746 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6175a19d:::benchmark_data_smithi188_77607_object127184:head# 2024-04-01T19:28:37.746 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6175c854:::benchmark_data_smithi188_77607_object103305:head# 2024-04-01T19:28:37.747 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:37.748 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:28:37.748 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6176dc99:::benchmark_data_smithi188_77607_object130538:head# 2024-04-01T19:28:37.748 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6176f5e5:::benchmark_data_smithi188_77607_object117466:head# 2024-04-01T19:28:37.748 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:617a15e0:::benchmark_data_smithi188_77607_object99377:head# 2024-04-01T19:28:37.749 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:617b00e3:::benchmark_data_smithi188_77607_object146147:head# 2024-04-01T19:28:37.749 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:617b58d2:::benchmark_data_smithi188_77607_object163150:head# 2024-04-01T19:28:37.749 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:617d60db:::benchmark_data_smithi188_77607_object158738:head# 2024-04-01T19:28:37.750 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:617d8239:::benchmark_data_smithi188_77607_object105882:head# 2024-04-01T19:28:37.750 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:617da165:::benchmark_data_smithi188_77607_object140687:head# 2024-04-01T19:28:37.751 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6180773f:::benchmark_data_smithi188_77607_object152850:head# 2024-04-01T19:28:37.751 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6181c340:::benchmark_data_smithi188_77607_object127988:head# 2024-04-01T19:28:37.752 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6182e89d:::benchmark_data_smithi188_77607_object126700:head# 2024-04-01T19:28:37.752 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6183e702:::benchmark_data_smithi188_77607_object101157:head# 2024-04-01T19:28:37.752 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61849599:::benchmark_data_smithi188_77607_object138316:head# 2024-04-01T19:28:37.753 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61883247:::benchmark_data_smithi188_77607_object136228:head# 2024-04-01T19:28:37.753 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61884baa:::benchmark_data_smithi188_77607_object115961:head# 2024-04-01T19:28:37.754 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:618c0429:::benchmark_data_smithi188_77607_object127386:head# 2024-04-01T19:28:37.754 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:618c45da:::benchmark_data_smithi188_77607_object110410:head# 2024-04-01T19:28:37.755 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:618d73f5:::benchmark_data_smithi188_77607_object145733:head# 2024-04-01T19:28:37.755 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:618d8060:::benchmark_data_smithi188_77607_object123431:head# 2024-04-01T19:28:37.756 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:618ffbf6:::benchmark_data_smithi188_77607_object128845:head# 2024-04-01T19:28:37.756 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61909707:::benchmark_data_smithi188_77607_object161547:head# 2024-04-01T19:28:37.757 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6190a635:::benchmark_data_smithi188_77607_object150747:head# 2024-04-01T19:28:37.757 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61924d84:::benchmark_data_smithi188_77607_object153635:head# 2024-04-01T19:28:37.758 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6193cbd0:::benchmark_data_smithi188_77607_object125367:head# 2024-04-01T19:28:37.758 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6194f236:::benchmark_data_smithi188_77607_object98993:head# 2024-04-01T19:28:37.758 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61964d7f:::benchmark_data_smithi188_77607_object117343:head# 2024-04-01T19:28:37.759 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6197b0fe:::benchmark_data_smithi188_77607_object106873:head# 2024-04-01T19:28:37.759 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:619910d5:::benchmark_data_smithi188_77607_object149783:head# 2024-04-01T19:28:37.760 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61993a2e:::benchmark_data_smithi188_77607_object98928:head# 2024-04-01T19:28:37.760 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61999431:::benchmark_data_smithi188_77607_object131248:head# 2024-04-01T19:28:37.761 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:619d52d0:::benchmark_data_smithi188_77607_object154894:head# 2024-04-01T19:28:37.761 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:619dc99a:::benchmark_data_smithi188_77607_object150304:head# 2024-04-01T19:28:37.762 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:619dc9c3:::benchmark_data_smithi188_77607_object151489:head# 2024-04-01T19:28:37.762 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:619e91e0:::benchmark_data_smithi188_77607_object115627:head# 2024-04-01T19:28:37.763 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:619efba9:::benchmark_data_smithi188_77607_object162063:head# 2024-04-01T19:28:37.763 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61a07558:::benchmark_data_smithi188_77607_object150492:head# 2024-04-01T19:28:37.763 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61a0cee1:::benchmark_data_smithi188_77607_object163986:head# 2024-04-01T19:28:37.764 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61a1dfe0:::benchmark_data_smithi188_77607_object126940:head# 2024-04-01T19:28:37.764 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61a31b96:::benchmark_data_smithi188_77607_object102471:head# 2024-04-01T19:28:37.765 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61a3f21a:::benchmark_data_smithi188_77607_object165858:head# 2024-04-01T19:28:37.765 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61a3f663:::benchmark_data_smithi188_77607_object150833:head# 2024-04-01T19:28:37.766 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61a46103:::benchmark_data_smithi188_77607_object129846:head# 2024-04-01T19:28:37.766 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61a4c902:::benchmark_data_smithi188_77607_object122905:head# 2024-04-01T19:28:37.767 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61a4cfdb:::benchmark_data_smithi188_77607_object100046:head# 2024-04-01T19:28:37.767 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61a55f69:::benchmark_data_smithi188_77607_object122780:head# 2024-04-01T19:28:37.768 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61a5df38:::benchmark_data_smithi188_77607_object166790:head# 2024-04-01T19:28:37.768 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61a64cde:::benchmark_data_smithi188_77607_object120479:head# 2024-04-01T19:28:37.769 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61a68041:::benchmark_data_smithi188_77607_object98015:head# 2024-04-01T19:28:37.769 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61a6e20e:::benchmark_data_smithi188_77607_object164701:head# 2024-04-01T19:28:37.770 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61a6f6e5:::benchmark_data_smithi188_77607_object149317:head# 2024-04-01T19:28:37.770 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61a7a248:::benchmark_data_smithi188_77607_object144664:head# 2024-04-01T19:28:37.771 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61a7abcf:::benchmark_data_smithi188_77607_object139775:head# 2024-04-01T19:28:37.771 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61a8b6a2:::benchmark_data_smithi188_77607_object146074:head# 2024-04-01T19:28:37.772 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61a927f6:::benchmark_data_smithi188_77607_object139333:head# 2024-04-01T19:28:37.772 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61aa28e9:::benchmark_data_smithi188_77607_object104585:head# 2024-04-01T19:28:37.772 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61aa599f:::benchmark_data_smithi188_77607_object99851:head# 2024-04-01T19:28:37.773 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61aa77d5:::benchmark_data_smithi188_77607_object124744:head# 2024-04-01T19:28:37.773 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61ad9fc7:::benchmark_data_smithi188_77607_object147865:head# 2024-04-01T19:28:37.774 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61aea09a:::benchmark_data_smithi188_77607_object101717:head# 2024-04-01T19:28:37.774 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61aec61c:::benchmark_data_smithi188_77607_object129469:head# 2024-04-01T19:28:37.775 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61aff7e4:::benchmark_data_smithi188_77607_object135141:head# 2024-04-01T19:28:37.775 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61b05aa1:::benchmark_data_smithi188_77607_object104807:head# 2024-04-01T19:28:37.775 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61b06147:::benchmark_data_smithi188_77607_object146455:head# 2024-04-01T19:28:37.776 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61b100cd:::benchmark_data_smithi188_77607_object165938:head# 2024-04-01T19:28:37.776 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61b24fb1:::benchmark_data_smithi188_77607_object125545:head# 2024-04-01T19:28:37.777 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61b2e697:::benchmark_data_smithi188_77607_object160788:head# 2024-04-01T19:28:37.777 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61b48de3:::benchmark_data_smithi188_77607_object105824:head# 2024-04-01T19:28:37.778 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61b4d81c:::benchmark_data_smithi188_77607_object163702:head# 2024-04-01T19:28:37.778 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61b53eef:::benchmark_data_smithi188_77607_object142800:head# 2024-04-01T19:28:37.779 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61b712da:::benchmark_data_smithi188_77607_object152836:head# 2024-04-01T19:28:37.779 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61b8179d:::benchmark_data_smithi188_77607_object117879:head# 2024-04-01T19:28:37.780 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61b958a0:::benchmark_data_smithi188_77607_object137919:head# 2024-04-01T19:28:37.780 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61b9ae21:::benchmark_data_smithi188_77607_object114665:head# 2024-04-01T19:28:37.780 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61baef23:::benchmark_data_smithi188_77607_object154485:head# 2024-04-01T19:28:37.781 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61bd275e:::benchmark_data_smithi188_77607_object118421:head# 2024-04-01T19:28:37.781 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61bdd77c:::benchmark_data_smithi188_77607_object129819:head# 2024-04-01T19:28:37.782 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61be78ba:::benchmark_data_smithi188_77607_object99907:head# 2024-04-01T19:28:37.782 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61bf2941:::benchmark_data_smithi188_77607_object100385:head# 2024-04-01T19:28:37.783 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61bf6d35:::benchmark_data_smithi188_77607_object152945:head# 2024-04-01T19:28:37.783 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61bfc8e5:::benchmark_data_smithi188_77607_object154638:head# 2024-04-01T19:28:37.784 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61c05e8a:::benchmark_data_smithi188_77607_object151032:head# 2024-04-01T19:28:37.784 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61c14ea8:::benchmark_data_smithi188_77607_object132536:head# 2024-04-01T19:28:37.784 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61c1610f:::benchmark_data_smithi188_77607_object154845:head# 2024-04-01T19:28:37.785 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61c1c527:::benchmark_data_smithi188_77607_object103529:head# 2024-04-01T19:28:37.785 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61c20498:::benchmark_data_smithi188_77607_object119387:head# 2024-04-01T19:28:37.786 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61c36985:::benchmark_data_smithi188_77607_object154475:head# 2024-04-01T19:28:37.786 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61c3e918:::benchmark_data_smithi188_77607_object135539:head# 2024-04-01T19:28:37.787 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61c4fcb8:::benchmark_data_smithi188_77607_object109424:head# 2024-04-01T19:28:37.787 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61c6b2f2:::benchmark_data_smithi188_77607_object104908:head# 2024-04-01T19:28:37.788 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61c7a09c:::benchmark_data_smithi188_77607_object112757:head# 2024-04-01T19:28:37.788 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61c7e357:::benchmark_data_smithi188_77607_object154022:head# 2024-04-01T19:28:37.789 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61c9ba8a:::benchmark_data_smithi188_77607_object142896:head# 2024-04-01T19:28:37.789 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61ca531a:::benchmark_data_smithi188_77607_object106565:head# 2024-04-01T19:28:37.790 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61ca7d7d:::benchmark_data_smithi188_77607_object109163:head# 2024-04-01T19:28:37.790 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61cb769d:::benchmark_data_smithi188_77607_object141035:head# 2024-04-01T19:28:37.790 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61cc38db:::benchmark_data_smithi188_77607_object109578:head# 2024-04-01T19:28:37.791 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61cc55db:::benchmark_data_smithi188_77607_object159175:head# 2024-04-01T19:28:37.791 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61ccaec6:::benchmark_data_smithi188_77607_object132390:head# 2024-04-01T19:28:37.792 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61ccb849:::benchmark_data_smithi188_77607_object162175:head# 2024-04-01T19:28:37.792 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61cda688:::benchmark_data_smithi188_77607_object132744:head# 2024-04-01T19:28:37.793 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61cdee12:::benchmark_data_smithi188_77607_object145188:head# 2024-04-01T19:28:37.793 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61ce1687:::benchmark_data_smithi188_77607_object119205:head# 2024-04-01T19:28:37.793 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61cea8a2:::benchmark_data_smithi188_77607_object111591:head# 2024-04-01T19:28:37.794 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61cebafd:::benchmark_data_smithi188_77607_object144069:head# 2024-04-01T19:28:37.794 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61d0667d:::benchmark_data_smithi188_77607_object163334:head# 2024-04-01T19:28:37.795 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61d0dea4:::benchmark_data_smithi188_77607_object153004:head# 2024-04-01T19:28:37.795 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61d18d66:::benchmark_data_smithi188_77607_object143819:head# 2024-04-01T19:28:37.796 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61d1a3bd:::benchmark_data_smithi188_77607_object145302:head# 2024-04-01T19:28:37.796 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61d47f09:::benchmark_data_smithi188_77607_object111132:head# 2024-04-01T19:28:37.797 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61d66a23:::benchmark_data_smithi188_77607_object122212:head# 2024-04-01T19:28:37.797 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61d783cc:::benchmark_data_smithi188_77607_object150822:head# 2024-04-01T19:28:37.797 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61d93a98:::benchmark_data_smithi188_77607_object106732:head# 2024-04-01T19:28:37.798 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61dac5fa:::benchmark_data_smithi188_77607_object145652:head# 2024-04-01T19:28:37.798 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61deee14:::benchmark_data_smithi188_77607_object160627:head# 2024-04-01T19:28:37.799 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61e3f35b:::benchmark_data_smithi188_77607_object124356:head# 2024-04-01T19:28:37.799 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61e428d2:::benchmark_data_smithi188_77607_object164405:head# 2024-04-01T19:28:37.800 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61e43b9c:::benchmark_data_smithi188_77607_object120673:head# 2024-04-01T19:28:37.800 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61e666a8:::benchmark_data_smithi188_77607_object160494:head# 2024-04-01T19:28:37.801 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61e79b73:::benchmark_data_smithi188_77607_object116270:head# 2024-04-01T19:28:37.801 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61e86ff9:::benchmark_data_smithi188_77607_object106345:head# 2024-04-01T19:28:37.802 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61eb4899:::benchmark_data_smithi188_77607_object103815:head# 2024-04-01T19:28:37.802 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61ecb116:::benchmark_data_smithi188_77607_object163002:head# 2024-04-01T19:28:37.803 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61ed9705:::benchmark_data_smithi188_77607_object106586:head# 2024-04-01T19:28:37.803 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61ef1f77:::benchmark_data_smithi188_77607_object106227:head# 2024-04-01T19:28:37.804 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61f1897f:::benchmark_data_smithi188_77607_object103613:head# 2024-04-01T19:28:37.804 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61f20591:::benchmark_data_smithi188_77607_object132960:head# 2024-04-01T19:28:37.805 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61f24277:::benchmark_data_smithi188_77607_object107324:head# 2024-04-01T19:28:37.805 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61f2cb41:::benchmark_data_smithi188_77607_object146770:head# 2024-04-01T19:28:37.805 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61f37834:::benchmark_data_smithi188_77607_object142163:head# 2024-04-01T19:28:37.806 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61f4d6cf:::benchmark_data_smithi188_77607_object97902:head# 2024-04-01T19:28:37.806 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61f76edb:::benchmark_data_smithi188_77607_object137447:head# 2024-04-01T19:28:37.807 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61f76f2a:::benchmark_data_smithi188_77607_object106598:head# 2024-04-01T19:28:37.807 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61f773f7:::benchmark_data_smithi188_77607_object133580:head# 2024-04-01T19:28:37.808 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61f94d43:::benchmark_data_smithi188_77607_object106363:head# 2024-04-01T19:28:37.808 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61fad017:::benchmark_data_smithi188_77607_object127423:head# 2024-04-01T19:28:37.809 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61fc4b12:::benchmark_data_smithi188_77607_object128880:head# 2024-04-01T19:28:37.809 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61fd2e4f:::benchmark_data_smithi188_77607_object112755:head# 2024-04-01T19:28:37.809 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61fe3947:::benchmark_data_smithi188_77607_object130580:head# 2024-04-01T19:28:37.810 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61ff4a0c:::benchmark_data_smithi188_77607_object131679:head# 2024-04-01T19:28:37.810 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:61ff8f5a:::benchmark_data_smithi188_77607_object122482:head# 2024-04-01T19:28:37.811 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6200ab9c:::benchmark_data_smithi188_77607_object111416:head# 2024-04-01T19:28:37.812 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:620112a7:::benchmark_data_smithi188_77607_object97812:head# 2024-04-01T19:28:37.812 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:620249c1:::benchmark_data_smithi188_77607_object131693:head# 2024-04-01T19:28:37.812 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6202c382:::benchmark_data_smithi188_77607_object161550:head# 2024-04-01T19:28:37.813 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6203c4fb:::benchmark_data_smithi188_77607_object132821:head# 2024-04-01T19:28:37.813 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:620439d8:::benchmark_data_smithi188_77607_object149257:head# 2024-04-01T19:28:37.814 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6204b118:::benchmark_data_smithi188_77607_object128625:head# 2024-04-01T19:28:37.815 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6207bd45:::benchmark_data_smithi188_77607_object106802:head# 2024-04-01T19:28:37.815 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6207dbe7:::benchmark_data_smithi188_77607_object142197:head# 2024-04-01T19:28:37.815 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62092e74:::benchmark_data_smithi188_77607_object113611:head# 2024-04-01T19:28:37.816 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6209786d:::benchmark_data_smithi188_77607_object161036:head# 2024-04-01T19:28:37.816 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:620a3bed:::benchmark_data_smithi188_77607_object125939:head# 2024-04-01T19:28:37.817 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:620a43e8:::benchmark_data_smithi188_77607_object117720:head# 2024-04-01T19:28:37.817 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:620c10c1:::benchmark_data_smithi188_77607_object128947:head# 2024-04-01T19:28:37.823 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:620d309f:::benchmark_data_smithi188_77607_object107051:head# 2024-04-01T19:28:37.824 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:620ea0ae:::benchmark_data_smithi188_77607_object125026:head# 2024-04-01T19:28:37.824 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:620ee636:::benchmark_data_smithi188_77607_object138149:head# 2024-04-01T19:28:37.825 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:620fbf0b:::benchmark_data_smithi188_77607_object116743:head# 2024-04-01T19:28:37.825 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62123cc4:::benchmark_data_smithi188_77607_object98285:head# 2024-04-01T19:28:37.826 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6212459f:::benchmark_data_smithi188_77607_object153339:head# 2024-04-01T19:28:37.826 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62125688:::benchmark_data_smithi188_77607_object165385:head# 2024-04-01T19:28:37.827 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:621257d1:::benchmark_data_smithi188_77607_object142152:head# 2024-04-01T19:28:37.827 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:621274f2:::benchmark_data_smithi188_77607_object122584:head# 2024-04-01T19:28:37.827 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6212ba57:::benchmark_data_smithi188_77607_object101262:head# 2024-04-01T19:28:37.828 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6215f365:::benchmark_data_smithi188_77607_object119666:head# 2024-04-01T19:28:37.828 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6215f634:::benchmark_data_smithi188_77607_object126625:head# 2024-04-01T19:28:37.829 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:621688da:::benchmark_data_smithi188_77607_object108709:head# 2024-04-01T19:28:37.829 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6216b631:::benchmark_data_smithi188_77607_object129978:head# 2024-04-01T19:28:37.830 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6219f54c:::benchmark_data_smithi188_77607_object157217:head# 2024-04-01T19:28:37.830 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:621a3d6c:::benchmark_data_smithi188_77607_object148293:head# 2024-04-01T19:28:37.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:621a4def:::benchmark_data_smithi188_77607_object98678:head# 2024-04-01T19:28:37.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:621bf221:::benchmark_data_smithi188_77607_object123468:head# 2024-04-01T19:28:37.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:621c7998:::benchmark_data_smithi188_77607_object116498:head# 2024-04-01T19:28:37.832 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:621cf801:::benchmark_data_smithi188_77607_object156576:head# 2024-04-01T19:28:37.832 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:621ea119:::benchmark_data_smithi188_77607_object111577:head# 2024-04-01T19:28:37.833 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:622029a1:::benchmark_data_smithi188_77607_object108165:head# 2024-04-01T19:28:37.833 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6220f5c9:::benchmark_data_smithi188_77607_object106308:head# 2024-04-01T19:28:37.834 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6221d4d6:::benchmark_data_smithi188_77607_object130899:head# 2024-04-01T19:28:37.834 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6222048a:::benchmark_data_smithi188_77607_object97950:head# 2024-04-01T19:28:37.835 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:622302a5:::benchmark_data_smithi188_77607_object102782:head# 2024-04-01T19:28:37.835 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62232f61:::benchmark_data_smithi188_77607_object137635:head# 2024-04-01T19:28:37.836 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62256bd6:::benchmark_data_smithi188_77607_object99595:head# 2024-04-01T19:28:37.836 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62265e20:::benchmark_data_smithi188_77607_object161322:head# 2024-04-01T19:28:37.837 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62271595:::benchmark_data_smithi188_77607_object140821:head# 2024-04-01T19:28:37.837 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:622745cb:::benchmark_data_smithi188_77607_object149426:head# 2024-04-01T19:28:37.838 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62278d87:::benchmark_data_smithi188_77607_object159277:head# 2024-04-01T19:28:37.838 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62294b53:::benchmark_data_smithi188_77607_object108811:head# 2024-04-01T19:28:37.838 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6229af54:::benchmark_data_smithi188_77607_object150878:head# 2024-04-01T19:28:37.839 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:622a3a60:::benchmark_data_smithi188_77607_object99175:head# 2024-04-01T19:28:37.839 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:622c1be6:::benchmark_data_smithi188_77607_object110563:head# 2024-04-01T19:28:37.840 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:622c3765:::benchmark_data_smithi188_77607_object143097:head# 2024-04-01T19:28:37.840 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:622cc712:::benchmark_data_smithi188_77607_object146250:head# 2024-04-01T19:28:37.841 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62314a4c:::benchmark_data_smithi188_77607_object121607:head# 2024-04-01T19:28:37.841 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6231b9e9:::benchmark_data_smithi188_77607_object108367:head# 2024-04-01T19:28:37.842 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62326cb8:::benchmark_data_smithi188_77607_object133647:head# 2024-04-01T19:28:37.842 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62336013:::benchmark_data_smithi188_77607_object111382:head# 2024-04-01T19:28:37.843 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62361aea:::benchmark_data_smithi188_77607_object136258:head# 2024-04-01T19:28:37.843 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:623622a3:::benchmark_data_smithi188_77607_object132914:head# 2024-04-01T19:28:37.843 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6238a79e:::benchmark_data_smithi188_77607_object167387:head# 2024-04-01T19:28:37.844 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6238ada6:::benchmark_data_smithi188_77607_object102514:head# 2024-04-01T19:28:37.844 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:623a516c:::benchmark_data_smithi188_77607_object104514:head# 2024-04-01T19:28:37.845 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:623a58d7:::benchmark_data_smithi188_77607_object155423:head# 2024-04-01T19:28:37.845 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:623bb996:::benchmark_data_smithi188_77607_object145448:head# 2024-04-01T19:28:37.846 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:623ca125:::benchmark_data_smithi188_77607_object110222:head# 2024-04-01T19:28:37.846 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:623cf03e:::benchmark_data_smithi188_77607_object134929:head# 2024-04-01T19:28:37.847 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:623eead5:::benchmark_data_smithi188_77607_object164817:head# 2024-04-01T19:28:37.847 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:623f996d:::benchmark_data_smithi188_77607_object166542:head# 2024-04-01T19:28:37.848 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62410c1a:::benchmark_data_smithi188_77607_object154439:head# 2024-04-01T19:28:37.848 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6242edf1:::benchmark_data_smithi188_77607_object125454:head# 2024-04-01T19:28:37.848 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:28:37.849 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:624317fd:::benchmark_data_smithi188_77607_object138799:head# 2024-04-01T19:28:37.849 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62440a53:::benchmark_data_smithi188_77607_object115392:head# 2024-04-01T19:28:37.850 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62442e97:::benchmark_data_smithi188_77607_object151590:head# 2024-04-01T19:28:37.850 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62447a0d:::benchmark_data_smithi188_77607_object118147:head# 2024-04-01T19:28:37.850 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62473677:::benchmark_data_smithi188_77607_object143613:head# 2024-04-01T19:28:37.851 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:624759cf:::benchmark_data_smithi188_77607_object103083:head# 2024-04-01T19:28:37.852 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6247f0d6:::benchmark_data_smithi188_77607_object123626:head# 2024-04-01T19:28:37.852 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:624a9e27:::benchmark_data_smithi188_77607_object155245:head# 2024-04-01T19:28:37.852 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:624abf04:::benchmark_data_smithi188_77607_object145743:head# 2024-04-01T19:28:37.852 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:624acc33:::benchmark_data_smithi188_77607_object132584:head# 2024-04-01T19:28:37.853 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:624bbc02:::benchmark_data_smithi188_77607_object165037:head# 2024-04-01T19:28:37.853 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:624bc493:::benchmark_data_smithi188_77607_object138266:head# 2024-04-01T19:28:37.854 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:624c1ad8:::benchmark_data_smithi188_77607_object120191:head# 2024-04-01T19:28:37.854 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:624fc7f6:::benchmark_data_smithi188_77607_object145183:head# 2024-04-01T19:28:37.855 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:624fc9c8:::benchmark_data_smithi188_77607_object165968:head# 2024-04-01T19:28:37.855 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62503ea1:::benchmark_data_smithi188_77607_object145803:head# 2024-04-01T19:28:37.856 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62508ec7:::benchmark_data_smithi188_77607_object118748:head# 2024-04-01T19:28:37.856 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6250ee3a:::benchmark_data_smithi188_77607_object131272:head# 2024-04-01T19:28:37.857 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:625245d8:::benchmark_data_smithi188_77607_object117957:head# 2024-04-01T19:28:37.857 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62534b24:::benchmark_data_smithi188_77607_object108580:head# 2024-04-01T19:28:37.858 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6253dde8:::benchmark_data_smithi188_77607_object146662:head# 2024-04-01T19:28:37.858 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6254006f:::benchmark_data_smithi188_77607_object110331:head# 2024-04-01T19:28:37.859 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:625430d3:::benchmark_data_smithi188_77607_object129131:head# 2024-04-01T19:28:37.859 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62551978:::benchmark_data_smithi188_77607_object130036:head# 2024-04-01T19:28:37.860 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:625828bb:::benchmark_data_smithi188_77607_object149295:head# 2024-04-01T19:28:37.860 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62598f51:::benchmark_data_smithi188_77607_object163697:head# 2024-04-01T19:28:37.860 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6259aa9d:::benchmark_data_smithi188_77607_object141636:head# 2024-04-01T19:28:37.861 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:625a28dd:::benchmark_data_smithi188_77607_object106943:head# 2024-04-01T19:28:37.861 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:625c2fbe:::benchmark_data_smithi188_77607_object143994:head# 2024-04-01T19:28:37.862 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:625e903a:::benchmark_data_smithi188_77607_object154277:head# 2024-04-01T19:28:37.862 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:625ea061:::benchmark_data_smithi188_77607_object162433:head# 2024-04-01T19:28:37.863 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:625f614d:::benchmark_data_smithi188_77607_object146160:head# 2024-04-01T19:28:37.863 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62605473:::benchmark_data_smithi188_77607_object103495:head# 2024-04-01T19:28:37.864 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62609265:::benchmark_data_smithi188_77607_object133826:head# 2024-04-01T19:28:37.864 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6261c800:::benchmark_data_smithi188_77607_object119870:head# 2024-04-01T19:28:37.864 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62626a50:::benchmark_data_smithi188_77607_object167002:head# 2024-04-01T19:28:37.867 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62628a78:::benchmark_data_smithi188_77607_object161658:head# 2024-04-01T19:28:37.868 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6262abd4:::benchmark_data_smithi188_77607_object135139:head# 2024-04-01T19:28:37.868 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62637f60:::benchmark_data_smithi188_77607_object165755:head# 2024-04-01T19:28:37.869 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6264c2c4:::benchmark_data_smithi188_77607_object144934:head# 2024-04-01T19:28:37.869 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62653d12:::benchmark_data_smithi188_77607_object98187:head# 2024-04-01T19:28:37.870 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62658c6a:::benchmark_data_smithi188_77607_object99771:head# 2024-04-01T19:28:37.870 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62677ed0:::benchmark_data_smithi188_77607_object143334:head# 2024-04-01T19:28:37.870 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62681a78:::benchmark_data_smithi188_77607_object163652:head# 2024-04-01T19:28:37.871 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6268ce0e:::benchmark_data_smithi188_77607_object108448:head# 2024-04-01T19:28:37.871 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6268ef22:::benchmark_data_smithi188_77607_object99048:head# 2024-04-01T19:28:37.872 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:626a5f25:::benchmark_data_smithi188_77607_object140112:head# 2024-04-01T19:28:37.872 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:626a6cf7:::benchmark_data_smithi188_77607_object124698:head# 2024-04-01T19:28:37.872 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:626b6564:::benchmark_data_smithi188_77607_object100287:head# 2024-04-01T19:28:37.873 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:626bb462:::benchmark_data_smithi188_77607_object137240:head# 2024-04-01T19:28:37.873 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:626bd1d9:::benchmark_data_smithi188_77607_object115626:head# 2024-04-01T19:28:37.874 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:626c0355:::benchmark_data_smithi188_77607_object134495:head# 2024-04-01T19:28:37.874 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:626cae44:::benchmark_data_smithi188_77607_object100993:head# 2024-04-01T19:28:37.875 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:626ceb6f:::benchmark_data_smithi188_77607_object119507:head# 2024-04-01T19:28:37.875 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:626e6dba:::benchmark_data_smithi188_77607_object147570:head# 2024-04-01T19:28:37.876 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:626f29eb:::benchmark_data_smithi188_77607_object163448:head# 2024-04-01T19:28:37.876 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:626f2e36:::benchmark_data_smithi188_77607_object99109:head# 2024-04-01T19:28:37.877 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:627065e7:::benchmark_data_smithi188_77607_object126681:head# 2024-04-01T19:28:37.877 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62709747:::benchmark_data_smithi188_77607_object116306:head# 2024-04-01T19:28:37.877 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6270d34a:::benchmark_data_smithi188_77607_object132989:head# 2024-04-01T19:28:37.878 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:627166a1:::benchmark_data_smithi188_77607_object118833:head# 2024-04-01T19:28:37.878 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:627184ec:::benchmark_data_smithi188_77607_object111764:head# 2024-04-01T19:28:37.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6271de5a:::benchmark_data_smithi188_77607_object121833:head# 2024-04-01T19:28:37.879 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:37.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62724176:::benchmark_data_smithi188_77607_object136079:head# 2024-04-01T19:28:37.880 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:28:37.881 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6272ef50:::benchmark_data_smithi188_77607_object156328:head# 2024-04-01T19:28:37.881 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6273404f:::benchmark_data_smithi188_77607_object136712:head# 2024-04-01T19:28:37.881 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6273cf42:::benchmark_data_smithi188_77607_object135135:head# 2024-04-01T19:28:37.882 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6275622a:::benchmark_data_smithi188_77607_object141371:head# 2024-04-01T19:28:37.882 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62769da7:::benchmark_data_smithi188_77607_object164720:head# 2024-04-01T19:28:37.882 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6276ba66:::benchmark_data_smithi188_77607_object156081:head# 2024-04-01T19:28:37.883 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6277407f:::benchmark_data_smithi188_77607_object103332:head# 2024-04-01T19:28:37.884 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6277a43f:::benchmark_data_smithi188_77607_object163695:head# 2024-04-01T19:28:37.884 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6278eb4b:::benchmark_data_smithi188_77607_object121637:head# 2024-04-01T19:28:37.884 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:627937dc:::benchmark_data_smithi188_77607_object118649:head# 2024-04-01T19:28:37.884 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:627a4825:::benchmark_data_smithi188_77607_object106400:head# 2024-04-01T19:28:37.885 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:627c1123:::benchmark_data_smithi188_77607_object100331:head# 2024-04-01T19:28:37.885 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:627ef984:::benchmark_data_smithi188_77607_object130355:head# 2024-04-01T19:28:37.886 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6280377d:::benchmark_data_smithi188_77607_object160737:head# 2024-04-01T19:28:37.886 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62811f38:::benchmark_data_smithi188_77607_object102263:head# 2024-04-01T19:28:37.886 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62826863:::benchmark_data_smithi188_77607_object108350:head# 2024-04-01T19:28:37.887 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62847082:::benchmark_data_smithi188_77607_object124971:head# 2024-04-01T19:28:37.887 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:628750f6:::benchmark_data_smithi188_77607_object107597:head# 2024-04-01T19:28:37.889 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6287a519:::benchmark_data_smithi188_77607_object145770:head# 2024-04-01T19:28:37.890 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6288d764:::benchmark_data_smithi188_77607_object130233:head# 2024-04-01T19:28:37.890 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:628b55e4:::benchmark_data_smithi188_77607_object101263:head# 2024-04-01T19:28:37.891 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:628bbdf8:::benchmark_data_smithi188_77607_object129952:head# 2024-04-01T19:28:37.891 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:628c5e8d:::benchmark_data_smithi188_77607_object161328:head# 2024-04-01T19:28:37.892 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62918023:::benchmark_data_smithi188_77607_object152265:head# 2024-04-01T19:28:37.892 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6294694a:::benchmark_data_smithi188_77607_object102733:head# 2024-04-01T19:28:37.893 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:629499ba:::benchmark_data_smithi188_77607_object130752:head# 2024-04-01T19:28:37.893 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6294dd74:::benchmark_data_smithi188_77607_object138828:head# 2024-04-01T19:28:37.894 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:629518cd:::benchmark_data_smithi188_77607_object155860:head# 2024-04-01T19:28:37.894 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62964d99:::benchmark_data_smithi188_77607_object110066:head# 2024-04-01T19:28:37.895 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6297b5c3:::benchmark_data_smithi188_77607_object111479:head# 2024-04-01T19:28:37.895 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62986d98:::benchmark_data_smithi188_77607_object122322:head# 2024-04-01T19:28:37.895 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:629870f1:::benchmark_data_smithi188_77607_object154968:head# 2024-04-01T19:28:37.896 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6299ab89:::benchmark_data_smithi188_77607_object119479:head# 2024-04-01T19:28:37.896 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:629b5d0b:::benchmark_data_smithi188_77607_object133131:head# 2024-04-01T19:28:37.897 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:629c9f2b:::benchmark_data_smithi188_77607_object130613:head# 2024-04-01T19:28:37.897 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:629cdbf9:::benchmark_data_smithi188_77607_object103085:head# 2024-04-01T19:28:37.898 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:629e9099:::benchmark_data_smithi188_77607_object161180:head# 2024-04-01T19:28:37.898 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:629eec32:::benchmark_data_smithi188_77607_object135613:head# 2024-04-01T19:28:37.899 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:629f33e3:::benchmark_data_smithi188_77607_object99716:head# 2024-04-01T19:28:37.899 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62a1942b:::benchmark_data_smithi188_77607_object114403:head# 2024-04-01T19:28:37.899 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62a213e0:::benchmark_data_smithi188_77607_object154736:head# 2024-04-01T19:28:37.900 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62a44d29:::benchmark_data_smithi188_77607_object129257:head# 2024-04-01T19:28:37.900 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62a52f09:::benchmark_data_smithi188_77607_object147562:head# 2024-04-01T19:28:37.901 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62a5bd65:::benchmark_data_smithi188_77607_object130676:head# 2024-04-01T19:28:37.901 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62a660e8:::benchmark_data_smithi188_77607_object102953:head# 2024-04-01T19:28:37.902 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62a6df79:::benchmark_data_smithi188_77607_object147601:head# 2024-04-01T19:28:37.902 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62a70cdf:::benchmark_data_smithi188_77607_object111130:head# 2024-04-01T19:28:37.903 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62a89388:::benchmark_data_smithi188_77607_object100521:head# 2024-04-01T19:28:37.903 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62abc87a:::benchmark_data_smithi188_77607_object117592:head# 2024-04-01T19:28:37.904 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62ac3e75:::benchmark_data_smithi188_77607_object147240:head# 2024-04-01T19:28:37.904 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62ac818b:::benchmark_data_smithi188_77607_object111354:head# 2024-04-01T19:28:37.905 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62ae1ddf:::benchmark_data_smithi188_77607_object118908:head# 2024-04-01T19:28:37.905 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62af382e:::benchmark_data_smithi188_77607_object133440:head# 2024-04-01T19:28:37.905 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62afe033:::benchmark_data_smithi188_77607_object163603:head# 2024-04-01T19:28:37.906 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62b085cd:::benchmark_data_smithi188_77607_object154069:head# 2024-04-01T19:28:37.906 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62b2eee6:::benchmark_data_smithi188_77607_object167327:head# 2024-04-01T19:28:37.907 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62b33547:::benchmark_data_smithi188_77607_object107659:head# 2024-04-01T19:28:37.907 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62b448ca:::benchmark_data_smithi188_77607_object158688:head# 2024-04-01T19:28:37.909 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62b4ad7c:::benchmark_data_smithi188_77607_object144163:head# 2024-04-01T19:28:37.910 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62b5259c:::benchmark_data_smithi188_77607_object109973:head# 2024-04-01T19:28:37.910 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62b87ea2:::benchmark_data_smithi188_77607_object137538:head# 2024-04-01T19:28:37.911 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62b96d43:::benchmark_data_smithi188_77607_object126555:head# 2024-04-01T19:28:37.911 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62b9d838:::benchmark_data_smithi188_77607_object155248:head# 2024-04-01T19:28:37.912 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62ba20a0:::benchmark_data_smithi188_77607_object111713:head# 2024-04-01T19:28:37.912 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62bc8b53:::benchmark_data_smithi188_77607_object144220:head# 2024-04-01T19:28:37.913 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62bf1941:::benchmark_data_smithi188_77607_object138590:head# 2024-04-01T19:28:37.913 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62bf9312:::benchmark_data_smithi188_77607_object121974:head# 2024-04-01T19:28:37.914 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62c22c1d:::benchmark_data_smithi188_77607_object121425:head# 2024-04-01T19:28:37.914 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62c292dc:::benchmark_data_smithi188_77607_object145289:head# 2024-04-01T19:28:37.915 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62c3de0c:::benchmark_data_smithi188_77607_object145893:head# 2024-04-01T19:28:37.915 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62c4416d:::benchmark_data_smithi188_77607_object109580:head# 2024-04-01T19:28:37.916 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62c444e7:::benchmark_data_smithi188_77607_object161106:head# 2024-04-01T19:28:37.916 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62c486c3:::benchmark_data_smithi188_77607_object114147:head# 2024-04-01T19:28:37.916 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62c6200a:::benchmark_data_smithi188_77607_object132531:head# 2024-04-01T19:28:37.917 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62c712cb:::benchmark_data_smithi188_77607_object148532:head# 2024-04-01T19:28:37.918 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62c7b95a:::benchmark_data_smithi188_77607_object104966:head# 2024-04-01T19:28:37.918 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62c80c1d:::benchmark_data_smithi188_77607_object136422:head# 2024-04-01T19:28:37.918 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62c8b31f:::benchmark_data_smithi188_77607_object114724:head# 2024-04-01T19:28:37.919 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62c98957:::benchmark_data_smithi188_77607_object145367:head# 2024-04-01T19:28:37.919 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62c9a08b:::benchmark_data_smithi188_77607_object98933:head# 2024-04-01T19:28:37.920 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62c9fd3e:::benchmark_data_smithi188_77607_object145773:head# 2024-04-01T19:28:37.920 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62cb0631:::benchmark_data_smithi188_77607_object164521:head# 2024-04-01T19:28:37.921 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62cb1a97:::benchmark_data_smithi188_77607_object114504:head# 2024-04-01T19:28:37.921 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62ccb191:::benchmark_data_smithi188_77607_object141554:head# 2024-04-01T19:28:37.922 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62cd30d9:::benchmark_data_smithi188_77607_object151097:head# 2024-04-01T19:28:37.922 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62cd67e5:::benchmark_data_smithi188_77607_object121600:head# 2024-04-01T19:28:37.922 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62ce51af:::benchmark_data_smithi188_77607_object159470:head# 2024-04-01T19:28:37.923 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62d1df6a:::benchmark_data_smithi188_77607_object117721:head# 2024-04-01T19:28:37.923 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62d32e44:::benchmark_data_smithi188_77607_object104238:head# 2024-04-01T19:28:37.923 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62d3576b:::benchmark_data_smithi188_77607_object147263:head# 2024-04-01T19:28:37.924 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62d41965:::benchmark_data_smithi188_77607_object135058:head# 2024-04-01T19:28:37.924 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62d510ee:::benchmark_data_smithi188_77607_object157078:head# 2024-04-01T19:28:37.925 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62d65be0:::benchmark_data_smithi188_77607_object102783:head# 2024-04-01T19:28:37.925 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62d66689:::benchmark_data_smithi188_77607_object143626:head# 2024-04-01T19:28:37.926 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62d7253d:::benchmark_data_smithi188_77607_object114003:head# 2024-04-01T19:28:37.926 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62d7a39f:::benchmark_data_smithi188_77607_object103088:head# 2024-04-01T19:28:37.927 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62d7aaab:::benchmark_data_smithi188_77607_object158434:head# 2024-04-01T19:28:37.927 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62d855f1:::benchmark_data_smithi188_77607_object141644:head# 2024-04-01T19:28:37.928 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62d9d1a4:::benchmark_data_smithi188_77607_object115152:head# 2024-04-01T19:28:37.928 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62da1694:::benchmark_data_smithi188_77607_object130594:head# 2024-04-01T19:28:37.929 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62da9598:::benchmark_data_smithi188_77607_object128214:head# 2024-04-01T19:28:37.929 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62db7921:::benchmark_data_smithi188_77607_object152659:head# 2024-04-01T19:28:37.930 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62dbe75e:::benchmark_data_smithi188_77607_object143720:head# 2024-04-01T19:28:37.930 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62de068c:::benchmark_data_smithi188_77607_object113170:head# 2024-04-01T19:28:37.930 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62de57a7:::benchmark_data_smithi188_77607_object102241:head# 2024-04-01T19:28:37.931 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62e0094a:::benchmark_data_smithi188_77607_object109406:head# 2024-04-01T19:28:37.931 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62e00c52:::benchmark_data_smithi188_77607_object102051:head# 2024-04-01T19:28:37.932 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62e0b426:::benchmark_data_smithi188_77607_object147241:head# 2024-04-01T19:28:37.932 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62e0b6bd:::benchmark_data_smithi188_77607_object129054:head# 2024-04-01T19:28:37.933 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62e2d0c3:::benchmark_data_smithi188_77607_object148879:head# 2024-04-01T19:28:37.933 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62e35e65:::benchmark_data_smithi188_77607_object139861:head# 2024-04-01T19:28:37.934 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62e3a39b:::benchmark_data_smithi188_77607_object153829:head# 2024-04-01T19:28:37.934 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62e421a2:::benchmark_data_smithi188_77607_object119409:head# 2024-04-01T19:28:37.935 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62e4a1ac:::benchmark_data_smithi188_77607_object112244:head# 2024-04-01T19:28:37.935 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62e67539:::benchmark_data_smithi188_77607_object99487:head# 2024-04-01T19:28:37.936 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62e7781c:::benchmark_data_smithi188_77607_object109266:head# 2024-04-01T19:28:37.936 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62e95b00:::benchmark_data_smithi188_77607_object129729:head# 2024-04-01T19:28:37.937 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62e98834:::benchmark_data_smithi188_77607_object123062:head# 2024-04-01T19:28:37.937 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62e9bc3d:::benchmark_data_smithi188_77607_object133576:head# 2024-04-01T19:28:37.938 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62e9d41d:::benchmark_data_smithi188_77607_object144390:head# 2024-04-01T19:28:37.938 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62ebb02e:::benchmark_data_smithi188_77607_object106766:head# 2024-04-01T19:28:37.938 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62ec2f53:::benchmark_data_smithi188_77607_object150444:head# 2024-04-01T19:28:37.939 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62eda8ab:::benchmark_data_smithi188_77607_object137725:head# 2024-04-01T19:28:37.939 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62edbd97:::benchmark_data_smithi188_77607_object159948:head# 2024-04-01T19:28:37.940 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62edcd99:::benchmark_data_smithi188_77607_object143783:head# 2024-04-01T19:28:37.940 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62eec292:::benchmark_data_smithi188_77607_object156855:head# 2024-04-01T19:28:37.940 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62f145ee:::benchmark_data_smithi188_77607_object121088:head# 2024-04-01T19:28:37.941 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62f239f6:::benchmark_data_smithi188_77607_object141823:head# 2024-04-01T19:28:37.941 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62f26bb6:::benchmark_data_smithi188_77607_object138338:head# 2024-04-01T19:28:37.942 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62f38423:::benchmark_data_smithi188_77607_object165273:head# 2024-04-01T19:28:37.942 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62f6ef5f:::benchmark_data_smithi188_77607_object161524:head# 2024-04-01T19:28:37.943 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62f77712:::benchmark_data_smithi188_77607_object128824:head# 2024-04-01T19:28:37.943 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62f7cec0:::benchmark_data_smithi188_77607_object129339:head# 2024-04-01T19:28:37.944 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62f82396:::benchmark_data_smithi188_77607_object136053:head# 2024-04-01T19:28:37.944 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62f82665:::benchmark_data_smithi188_77607_object98271:head# 2024-04-01T19:28:37.945 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62f96d27:::benchmark_data_smithi188_77607_object130317:head# 2024-04-01T19:28:37.945 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62faccf5:::benchmark_data_smithi188_77607_object98460:head# 2024-04-01T19:28:37.946 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62fb770f:::benchmark_data_smithi188_77607_object104421:head# 2024-04-01T19:28:37.946 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62fd7e5f:::benchmark_data_smithi188_77607_object103552:head# 2024-04-01T19:28:37.947 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62fe6b95:::benchmark_data_smithi188_77607_object117700:head# 2024-04-01T19:28:37.947 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:62ff7e25:::benchmark_data_smithi188_77607_object113980:head# 2024-04-01T19:28:37.948 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6302756c:::benchmark_data_smithi188_77607_object130743:head# 2024-04-01T19:28:37.948 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6303412d:::benchmark_data_smithi188_77607_object165206:head# 2024-04-01T19:28:37.948 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63036614:::benchmark_data_smithi188_77607_object139647:head# 2024-04-01T19:28:37.949 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6303e6c0:::benchmark_data_smithi188_77607_object147301:head# 2024-04-01T19:28:37.949 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63043440:::benchmark_data_smithi188_77607_object163368:head# 2024-04-01T19:28:37.950 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6304f7ec:::benchmark_data_smithi188_77607_object128664:head# 2024-04-01T19:28:37.950 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6305d07b:::benchmark_data_smithi188_77607_object138984:head# 2024-04-01T19:28:37.951 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6306cc2e:::benchmark_data_smithi188_77607_object111444:head# 2024-04-01T19:28:37.951 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6308fa71:::benchmark_data_smithi188_77607_object162957:head# 2024-04-01T19:28:37.952 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6309a16a:::benchmark_data_smithi188_77607_object148189:head# 2024-04-01T19:28:37.952 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:630a3c3a:::benchmark_data_smithi188_77607_object105919:head# 2024-04-01T19:28:37.953 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:630c6baa:::benchmark_data_smithi188_77607_object125335:head# 2024-04-01T19:28:37.953 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:630d24e7:::benchmark_data_smithi188_77607_object163554:head# 2024-04-01T19:28:37.954 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:630eeb87:::benchmark_data_smithi188_77607_object112836:head# 2024-04-01T19:28:37.954 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6310483f:::benchmark_data_smithi188_77607_object128650:head# 2024-04-01T19:28:37.954 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:631130f0:::benchmark_data_smithi188_77607_object122527:head# 2024-04-01T19:28:37.955 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6311fcc0:::benchmark_data_smithi188_77607_object159105:head# 2024-04-01T19:28:37.955 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6312d693:::benchmark_data_smithi188_77607_object127238:head# 2024-04-01T19:28:37.956 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:631411d6:::benchmark_data_smithi188_77607_object110916:head# 2024-04-01T19:28:37.956 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6315cace:::benchmark_data_smithi188_77607_object116287:head# 2024-04-01T19:28:37.957 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63160c39:::benchmark_data_smithi188_77607_object129222:head# 2024-04-01T19:28:37.957 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6317aedb:::benchmark_data_smithi188_77607_object147018:head# 2024-04-01T19:28:37.958 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6318efad:::benchmark_data_smithi188_77607_object138589:head# 2024-04-01T19:28:37.958 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:631ae200:::benchmark_data_smithi188_77607_object155332:head# 2024-04-01T19:28:37.959 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:631b2b96:::benchmark_data_smithi188_77607_object106924:head# 2024-04-01T19:28:37.959 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:631d820d:::benchmark_data_smithi188_77607_object165002:head# 2024-04-01T19:28:37.960 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:631f6302:::benchmark_data_smithi188_77607_object162922:head# 2024-04-01T19:28:37.960 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6320153f:::benchmark_data_smithi188_77607_object107536:head# 2024-04-01T19:28:37.961 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63208374:::benchmark_data_smithi188_77607_object133994:head# 2024-04-01T19:28:37.961 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6322a3b4:::benchmark_data_smithi188_77607_object120406:head# 2024-04-01T19:28:37.961 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63249f0c:::benchmark_data_smithi188_77607_object120519:head# 2024-04-01T19:28:37.962 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6328702d:::benchmark_data_smithi188_77607_object157805:head# 2024-04-01T19:28:37.962 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6328edf5:::benchmark_data_smithi188_77607_object107207:head# 2024-04-01T19:28:37.963 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:632cb688:::benchmark_data_smithi188_77607_object157989:head# 2024-04-01T19:28:37.963 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:632cb9f0:::benchmark_data_smithi188_77607_object148680:head# 2024-04-01T19:28:37.964 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:632d02f8:::benchmark_data_smithi188_77607_object155553:head# 2024-04-01T19:28:37.964 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:632d933c:::benchmark_data_smithi188_77607_object100699:head# 2024-04-01T19:28:37.965 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6330336a:::benchmark_data_smithi188_77607_object159173:head# 2024-04-01T19:28:37.965 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6330579f:::benchmark_data_smithi188_77607_object138721:head# 2024-04-01T19:28:37.965 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6330c57a:::benchmark_data_smithi188_77607_object108977:head# 2024-04-01T19:28:37.968 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6331351f:::benchmark_data_smithi188_77607_object108581:head# 2024-04-01T19:28:37.968 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6331c273:::benchmark_data_smithi188_77607_object117811:head# 2024-04-01T19:28:37.969 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63331013:::benchmark_data_smithi188_77607_object117262:head# 2024-04-01T19:28:37.969 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6333af62:::benchmark_data_smithi188_77607_object106680:head# 2024-04-01T19:28:37.970 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6334e7e9:::benchmark_data_smithi188_77607_object112937:head# 2024-04-01T19:28:37.970 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6335e947:::benchmark_data_smithi188_77607_object144606:head# 2024-04-01T19:28:37.971 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63379fa2:::benchmark_data_smithi188_77607_object143172:head# 2024-04-01T19:28:37.971 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63386b1d:::benchmark_data_smithi188_77607_object126535:head# 2024-04-01T19:28:37.971 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6339fee1:::benchmark_data_smithi188_77607_object104865:head# 2024-04-01T19:28:37.972 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:633a1a1f:::benchmark_data_smithi188_77607_object160745:head# 2024-04-01T19:28:37.972 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:633a2419:::benchmark_data_smithi188_77607_object123151:head# 2024-04-01T19:28:37.973 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:633a987d:::benchmark_data_smithi188_77607_object145355:head# 2024-04-01T19:28:37.973 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:633aa00b:::benchmark_data_smithi188_77607_object149779:head# 2024-04-01T19:28:37.974 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:633ab459:::benchmark_data_smithi188_77607_object114059:head# 2024-04-01T19:28:37.974 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:633be31c:::benchmark_data_smithi188_77607_object144544:head# 2024-04-01T19:28:37.974 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:633d600d:::benchmark_data_smithi188_77607_object136637:head# 2024-04-01T19:28:37.975 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:633e67c6:::benchmark_data_smithi188_77607_object141824:head# 2024-04-01T19:28:37.975 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:633fb1e5:::benchmark_data_smithi188_77607_object124574:head# 2024-04-01T19:28:37.976 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6340c26c:::benchmark_data_smithi188_77607_object104484:head# 2024-04-01T19:28:37.976 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63424d4a:::benchmark_data_smithi188_77607_object129198:head# 2024-04-01T19:28:37.977 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6343a67f:::benchmark_data_smithi188_77607_object100349:head# 2024-04-01T19:28:37.977 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63448231:::benchmark_data_smithi188_77607_object166439:head# 2024-04-01T19:28:37.978 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63452907:::benchmark_data_smithi188_77607_object163205:head# 2024-04-01T19:28:37.978 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63462b62:::benchmark_data_smithi188_77607_object114498:head# 2024-04-01T19:28:37.979 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63463996:::benchmark_data_smithi188_77607_object166086:head# 2024-04-01T19:28:37.979 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6348383e:::benchmark_data_smithi188_77607_object131262:head# 2024-04-01T19:28:37.979 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63483932:::benchmark_data_smithi188_77607_object148075:head# 2024-04-01T19:28:37.980 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63491d34:::benchmark_data_smithi188_77607_object154559:head# 2024-04-01T19:28:37.980 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63493579:::benchmark_data_smithi188_77607_object98091:head# 2024-04-01T19:28:37.981 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:634b7c2c:::benchmark_data_smithi188_77607_object115195:head# 2024-04-01T19:28:37.982 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:634bb2db:::benchmark_data_smithi188_77607_object138571:head# 2024-04-01T19:28:37.982 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:634d1317:::benchmark_data_smithi188_77607_object146433:head# 2024-04-01T19:28:37.982 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:634d24f3:::benchmark_data_smithi188_77607_object100464:head# 2024-04-01T19:28:37.983 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:634ebeeb:::benchmark_data_smithi188_77607_object104760:head# 2024-04-01T19:28:37.983 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:634f8a81:::benchmark_data_smithi188_77607_object156765:head# 2024-04-01T19:28:37.984 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63505962:::benchmark_data_smithi188_77607_object165788:head# 2024-04-01T19:28:37.984 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63549817:::benchmark_data_smithi188_77607_object110422:head# 2024-04-01T19:28:37.985 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6355105b:::benchmark_data_smithi188_77607_object113355:head# 2024-04-01T19:28:37.985 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6356ba20:::benchmark_data_smithi188_77607_object157660:head# 2024-04-01T19:28:37.985 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63576e92:::benchmark_data_smithi188_77607_object97886:head# 2024-04-01T19:28:37.986 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:635800c4:::benchmark_data_smithi188_77607_object103551:head# 2024-04-01T19:28:37.986 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63582880:::benchmark_data_smithi188_77607_object148522:head# 2024-04-01T19:28:37.987 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6359595a:::benchmark_data_smithi188_77607_object101100:head# 2024-04-01T19:28:37.987 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63597f37:::benchmark_data_smithi188_77607_object154343:head# 2024-04-01T19:28:37.988 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6359a574:::benchmark_data_smithi188_77607_object125676:head# 2024-04-01T19:28:37.988 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:635acd2b:::benchmark_data_smithi188_77607_object135909:head# 2024-04-01T19:28:37.989 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:635b140e:::benchmark_data_smithi188_77607_object113324:head# 2024-04-01T19:28:37.989 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:635b4c98:::benchmark_data_smithi188_77607_object118362:head# 2024-04-01T19:28:37.990 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:635e207e:::benchmark_data_smithi188_77607_object99382:head# 2024-04-01T19:28:37.990 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:635f1fd6:::benchmark_data_smithi188_77607_object98809:head# 2024-04-01T19:28:37.991 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63621cd8:::benchmark_data_smithi188_77607_object110187:head# 2024-04-01T19:28:37.991 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63639976:::benchmark_data_smithi188_77607_object99061:head# 2024-04-01T19:28:37.991 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6363f018:::benchmark_data_smithi188_77607_object154138:head# 2024-04-01T19:28:37.992 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63660e60:::benchmark_data_smithi188_77607_object138489:head# 2024-04-01T19:28:37.992 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:636720a7:::benchmark_data_smithi188_77607_object121017:head# 2024-04-01T19:28:37.993 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6367b241:::benchmark_data_smithi188_77607_object125348:head# 2024-04-01T19:28:37.993 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6368b785:::benchmark_data_smithi188_77607_object113421:head# 2024-04-01T19:28:37.994 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:636a3134:::benchmark_data_smithi188_77607_object156726:head# 2024-04-01T19:28:37.994 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:636a3424:::benchmark_data_smithi188_77607_object108394:head# 2024-04-01T19:28:37.994 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:636a6405:::benchmark_data_smithi188_77607_object155323:head# 2024-04-01T19:28:37.995 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:636dc0bd:::benchmark_data_smithi188_77607_object111289:head# 2024-04-01T19:28:37.996 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:636e5da5:::benchmark_data_smithi188_77607_object159232:head# 2024-04-01T19:28:37.996 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:636eeb0c:::benchmark_data_smithi188_77607_object127972:head# 2024-04-01T19:28:37.996 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:636f0c90:::benchmark_data_smithi188_77607_object126587:head# 2024-04-01T19:28:37.997 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63702f24:::benchmark_data_smithi188_77607_object151578:head# 2024-04-01T19:28:37.997 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6370bc9c:::benchmark_data_smithi188_77607_object153772:head# 2024-04-01T19:28:37.998 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6371f90b:::benchmark_data_smithi188_77607_object115936:head# 2024-04-01T19:28:37.998 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63731823:::benchmark_data_smithi188_77607_object107593:head# 2024-04-01T19:28:37.999 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6373b30e:::benchmark_data_smithi188_77607_object165935:head# 2024-04-01T19:28:37.999 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6375a30e:::benchmark_data_smithi188_77607_object126198:head# 2024-04-01T19:28:37.999 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63777a9a:::benchmark_data_smithi188_77607_object148615:head# 2024-04-01T19:28:38.000 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6378e97d:::benchmark_data_smithi188_77607_object101306:head# 2024-04-01T19:28:38.000 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6379acdb:::benchmark_data_smithi188_77607_object128520:head# 2024-04-01T19:28:38.001 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:637b0601:::benchmark_data_smithi188_77607_object129995:head# 2024-04-01T19:28:38.001 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:637d811f:::benchmark_data_smithi188_77607_object103110:head# 2024-04-01T19:28:38.002 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:637e65b6:::benchmark_data_smithi188_77607_object128708:head# 2024-04-01T19:28:38.002 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:637e6dd0:::benchmark_data_smithi188_77607_object98780:head# 2024-04-01T19:28:38.003 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:637f0dac:::benchmark_data_smithi188_77607_object130412:head# 2024-04-01T19:28:38.003 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:637f6d02:::benchmark_data_smithi188_77607_object116341:head# 2024-04-01T19:28:38.004 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6381d0c1:::benchmark_data_smithi188_77607_object148186:head# 2024-04-01T19:28:38.004 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63821429:::benchmark_data_smithi188_77607_object115547:head# 2024-04-01T19:28:38.004 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63836df0:::benchmark_data_smithi188_77607_object99028:head# 2024-04-01T19:28:38.005 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:638386cb:::benchmark_data_smithi188_77607_object108590:head# 2024-04-01T19:28:38.005 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6383efed:::benchmark_data_smithi188_77607_object157113:head# 2024-04-01T19:28:38.006 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6384429a:::benchmark_data_smithi188_77607_object135974:head# 2024-04-01T19:28:38.006 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6385d9cf:::benchmark_data_smithi188_77607_object159497:head# 2024-04-01T19:28:38.007 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:638691b6:::benchmark_data_smithi188_77607_object116640:head# 2024-04-01T19:28:38.007 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6387e3d7:::benchmark_data_smithi188_77607_object106808:head# 2024-04-01T19:28:38.008 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63895c56:::benchmark_data_smithi188_77607_object116294:head# 2024-04-01T19:28:38.008 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6389b7fc:::benchmark_data_smithi188_77607_object163025:head# 2024-04-01T19:28:38.009 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:638b5b3c:::benchmark_data_smithi188_77607_object109439:head# 2024-04-01T19:28:38.009 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:638bf847:::benchmark_data_smithi188_77607_object140322:head# 2024-04-01T19:28:38.009 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:638d9820:::benchmark_data_smithi188_77607_object133015:head# 2024-04-01T19:28:38.010 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:638da134:::benchmark_data_smithi188_77607_object108030:head# 2024-04-01T19:28:38.010 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:638dd3eb:::benchmark_data_smithi188_77607_object150475:head# 2024-04-01T19:28:38.011 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:638e51e6:::benchmark_data_smithi188_77607_object147693:head# 2024-04-01T19:28:38.011 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:638e7fe1:::benchmark_data_smithi188_77607_object118531:head# 2024-04-01T19:28:38.011 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:638f031b:::benchmark_data_smithi188_77607_object114636:head# 2024-04-01T19:28:38.012 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63921440:::benchmark_data_smithi188_77607_object126759:head# 2024-04-01T19:28:38.012 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6392c67f:::benchmark_data_smithi188_77607_object105236:head# 2024-04-01T19:28:38.013 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63943ccd:::benchmark_data_smithi188_77607_object114457:head# 2024-04-01T19:28:38.013 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63976798:::benchmark_data_smithi188_77607_object136412:head# 2024-04-01T19:28:38.014 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6399de8b:::benchmark_data_smithi188_77607_object100131:head# 2024-04-01T19:28:38.014 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:639a6cb2:::benchmark_data_smithi188_77607_object110239:head# 2024-04-01T19:28:38.015 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:639bb4cd:::benchmark_data_smithi188_77607_object157163:head# 2024-04-01T19:28:38.015 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:639c56e5:::benchmark_data_smithi188_77607_object107834:head# 2024-04-01T19:28:38.016 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:639dd129:::benchmark_data_smithi188_77607_object149394:head# 2024-04-01T19:28:38.016 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:639f1ec3:::benchmark_data_smithi188_77607_object152773:head# 2024-04-01T19:28:38.016 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63a08815:::benchmark_data_smithi188_77607_object154847:head# 2024-04-01T19:28:38.017 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63a21c75:::benchmark_data_smithi188_77607_object143897:head# 2024-04-01T19:28:38.017 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63a2b9ca:::benchmark_data_smithi188_77607_object144526:head# 2024-04-01T19:28:38.018 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63a2ba3d:::benchmark_data_smithi188_77607_object164106:head# 2024-04-01T19:28:38.018 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63a2f418:::benchmark_data_smithi188_77607_object161907:head# 2024-04-01T19:28:38.019 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63a4b92e:::benchmark_data_smithi188_77607_object147675:head# 2024-04-01T19:28:38.019 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63a5096e:::benchmark_data_smithi188_77607_object155748:head# 2024-04-01T19:28:38.019 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63a553ee:::benchmark_data_smithi188_77607_object101194:head# 2024-04-01T19:28:38.020 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63a5da3f:::benchmark_data_smithi188_77607_object121310:head# 2024-04-01T19:28:38.020 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63a67af4:::benchmark_data_smithi188_77607_object141171:head# 2024-04-01T19:28:38.020 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63a68c36:::benchmark_data_smithi188_77607_object145248:head# 2024-04-01T19:28:38.021 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63a6e896:::benchmark_data_smithi188_77607_object138496:head# 2024-04-01T19:28:38.021 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63a74be4:::benchmark_data_smithi188_77607_object157492:head# 2024-04-01T19:28:38.022 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63a7982a:::benchmark_data_smithi188_77607_object121481:head# 2024-04-01T19:28:38.022 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63a7aeed:::benchmark_data_smithi188_77607_object107767:head# 2024-04-01T19:28:38.023 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63a8f39a:::benchmark_data_smithi188_77607_object104407:head# 2024-04-01T19:28:38.023 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63a98c84:::benchmark_data_smithi188_77607_object127225:head# 2024-04-01T19:28:38.024 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63ab6cb2:::benchmark_data_smithi188_77607_object148599:head# 2024-04-01T19:28:38.024 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63ad302f:::benchmark_data_smithi188_77607_object139412:head# 2024-04-01T19:28:38.025 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63adb8d7:::benchmark_data_smithi188_77607_object162472:head# 2024-04-01T19:28:38.025 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63aec7e7:::benchmark_data_smithi188_77607_object100022:head# 2024-04-01T19:28:38.025 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63af73bc:::benchmark_data_smithi188_77607_object147953:head# 2024-04-01T19:28:38.026 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63afe8a0:::benchmark_data_smithi188_77607_object104787:head# 2024-04-01T19:28:38.026 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63b14653:::benchmark_data_smithi188_77607_object166653:head# 2024-04-01T19:28:38.027 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63b25ac3:::benchmark_data_smithi188_77607_object111837:head# 2024-04-01T19:28:38.027 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63b2d148:::benchmark_data_smithi188_77607_object130749:head# 2024-04-01T19:28:38.028 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63b2d63d:::benchmark_data_smithi188_77607_object100098:head# 2024-04-01T19:28:38.028 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63b30add:::benchmark_data_smithi188_77607_object99121:head# 2024-04-01T19:28:38.029 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63b47e78:::benchmark_data_smithi188_77607_object145441:head# 2024-04-01T19:28:38.029 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63b4d721:::benchmark_data_smithi188_77607_object133539:head# 2024-04-01T19:28:38.029 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63b4e999:::benchmark_data_smithi188_77607_object100436:head# 2024-04-01T19:28:38.030 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63b53a2f:::benchmark_data_smithi188_77607_object127522:head# 2024-04-01T19:28:38.030 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63b58b80:::benchmark_data_smithi188_77607_object151349:head# 2024-04-01T19:28:38.031 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63b63529:::benchmark_data_smithi188_77607_object119276:head# 2024-04-01T19:28:38.031 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:28:38.031 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63b64c09:::benchmark_data_smithi188_77607_object135145:head# 2024-04-01T19:28:38.032 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63b6e3a3:::benchmark_data_smithi188_77607_object125345:head# 2024-04-01T19:28:38.032 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63b99db5:::benchmark_data_smithi188_77607_object135819:head# 2024-04-01T19:28:38.032 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63b99f24:::benchmark_data_smithi188_77607_object149938:head# 2024-04-01T19:28:38.033 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63bb2459:::benchmark_data_smithi188_77607_object151269:head# 2024-04-01T19:28:38.033 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63bca623:::benchmark_data_smithi188_77607_object115282:head# 2024-04-01T19:28:38.034 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63bd18ad:::benchmark_data_smithi188_77607_object135159:head# 2024-04-01T19:28:38.034 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:38.034 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:28:38.035 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63bd20ee:::benchmark_data_smithi188_77607_object98504:head# 2024-04-01T19:28:38.035 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63bd567f:::benchmark_data_smithi188_77607_object132441:head# 2024-04-01T19:28:38.035 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63bdb242:::benchmark_data_smithi188_77607_object98025:head# 2024-04-01T19:28:38.036 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63bdb6de:::benchmark_data_smithi188_77607_object99745:head# 2024-04-01T19:28:38.036 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63bee865:::benchmark_data_smithi188_77607_object126230:head# 2024-04-01T19:28:38.036 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63c0506d:::benchmark_data_smithi188_77607_object98312:head# 2024-04-01T19:28:38.037 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63c09811:::benchmark_data_smithi188_77607_object167264:head# 2024-04-01T19:28:38.037 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63c19cca:::benchmark_data_smithi188_77607_object151380:head# 2024-04-01T19:28:38.038 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63c2cdd6:::benchmark_data_smithi188_77607_object145904:head# 2024-04-01T19:28:38.038 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63c34905:::benchmark_data_smithi188_77607_object122175:head# 2024-04-01T19:28:38.039 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63c65753:::benchmark_data_smithi188_77607_object127628:head# 2024-04-01T19:28:38.039 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63c67d97:::benchmark_data_smithi188_77607_object148026:head# 2024-04-01T19:28:38.039 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63c75dc9:::benchmark_data_smithi188_77607_object111691:head# 2024-04-01T19:28:38.040 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63c7dc6a:::benchmark_data_smithi188_77607_object132195:head# 2024-04-01T19:28:38.040 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63c82a31:::benchmark_data_smithi188_77607_object128677:head# 2024-04-01T19:28:38.041 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63c89ea3:::benchmark_data_smithi188_77607_object99246:head# 2024-04-01T19:28:38.041 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63c95947:::benchmark_data_smithi188_77607_object107015:head# 2024-04-01T19:28:38.042 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63c96c19:::benchmark_data_smithi188_77607_object164360:head# 2024-04-01T19:28:38.042 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63c9ca9c:::benchmark_data_smithi188_77607_object156945:head# 2024-04-01T19:28:38.043 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63c9d6e4:::benchmark_data_smithi188_77607_object159167:head# 2024-04-01T19:28:38.043 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63ca1447:::benchmark_data_smithi188_77607_object142587:head# 2024-04-01T19:28:38.043 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63cbd9a6:::benchmark_data_smithi188_77607_object116375:head# 2024-04-01T19:28:38.044 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63cc621c:::benchmark_data_smithi188_77607_object111601:head# 2024-04-01T19:28:38.045 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63cd4dfc:::benchmark_data_smithi188_77607_object154844:head# 2024-04-01T19:28:38.045 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63cdf696:::benchmark_data_smithi188_77607_object140983:head# 2024-04-01T19:28:38.045 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63cfc69c:::benchmark_data_smithi188_77607_object150885:head# 2024-04-01T19:28:38.046 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63d08365:::benchmark_data_smithi188_77607_object141280:head# 2024-04-01T19:28:38.046 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63d0968b:::benchmark_data_smithi188_77607_object141387:head# 2024-04-01T19:28:38.047 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63d20553:::benchmark_data_smithi188_77607_object138991:head# 2024-04-01T19:28:38.047 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63d34e56:::benchmark_data_smithi188_77607_object153788:head# 2024-04-01T19:28:38.048 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63d3a21e:::benchmark_data_smithi188_77607_object134845:head# 2024-04-01T19:28:38.048 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63d56dc6:::benchmark_data_smithi188_77607_object150611:head# 2024-04-01T19:28:38.049 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63d58ffa:::benchmark_data_smithi188_77607_object165636:head# 2024-04-01T19:28:38.049 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63d5cf13:::benchmark_data_smithi188_77607_object123798:head# 2024-04-01T19:28:38.050 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63d6994e:::benchmark_data_smithi188_77607_object123774:head# 2024-04-01T19:28:38.050 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63d6aa72:::benchmark_data_smithi188_77607_object106486:head# 2024-04-01T19:28:38.050 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63d719c7:::benchmark_data_smithi188_77607_object152749:head# 2024-04-01T19:28:38.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63d75fe7:::benchmark_data_smithi188_77607_object162208:head# 2024-04-01T19:28:38.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63d81a05:::benchmark_data_smithi188_77607_object143404:head# 2024-04-01T19:28:38.052 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63d83a94:::benchmark_data_smithi188_77607_object158720:head# 2024-04-01T19:28:38.052 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63d8d408:::benchmark_data_smithi188_77607_object136425:head# 2024-04-01T19:28:38.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63da9c3b:::benchmark_data_smithi188_77607_object100376:head# 2024-04-01T19:28:38.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63db61db:::benchmark_data_smithi188_77607_object150405:head# 2024-04-01T19:28:38.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63dc592b:::benchmark_data_smithi188_77607_object110737:head# 2024-04-01T19:28:38.054 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63dd0786:::benchmark_data_smithi188_77607_object137239:head# 2024-04-01T19:28:38.054 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63dd33c0:::benchmark_data_smithi188_77607_object113386:head# 2024-04-01T19:28:38.055 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63dd6a81:::benchmark_data_smithi188_77607_object151085:head# 2024-04-01T19:28:38.055 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63de58ef:::benchmark_data_smithi188_77607_object149272:head# 2024-04-01T19:28:38.056 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63de7378:::benchmark_data_smithi188_77607_object115170:head# 2024-04-01T19:28:38.056 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63de8fdb:::benchmark_data_smithi188_77607_object99527:head# 2024-04-01T19:28:38.056 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63deecf2:::benchmark_data_smithi188_77607_object126817:head# 2024-04-01T19:28:38.057 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63df8e23:::benchmark_data_smithi188_77607_object120619:head# 2024-04-01T19:28:38.057 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63e05048:::benchmark_data_smithi188_77607_object123382:head# 2024-04-01T19:28:38.058 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63e1a128:::benchmark_data_smithi188_77607_object133150:head# 2024-04-01T19:28:38.058 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63e1aa05:::benchmark_data_smithi188_77607_object152320:head# 2024-04-01T19:28:38.059 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63e275e0:::benchmark_data_smithi188_77607_object145285:head# 2024-04-01T19:28:38.059 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63e3c3e3:::benchmark_data_smithi188_77607_object157654:head# 2024-04-01T19:28:38.060 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63e42940:::benchmark_data_smithi188_77607_object133421:head# 2024-04-01T19:28:38.060 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63e452f3:::benchmark_data_smithi188_77607_object158747:head# 2024-04-01T19:28:38.060 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63e50039:::benchmark_data_smithi188_77607_object148820:head# 2024-04-01T19:28:38.061 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63e5153c:::benchmark_data_smithi188_77607_object161242:head# 2024-04-01T19:28:38.061 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63e8b2a1:::benchmark_data_smithi188_77607_object106121:head# 2024-04-01T19:28:38.062 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63e95787:::benchmark_data_smithi188_77607_object164125:head# 2024-04-01T19:28:38.062 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63e9e8ca:::benchmark_data_smithi188_77607_object134822:head# 2024-04-01T19:28:38.063 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63eb6c0d:::benchmark_data_smithi188_77607_object154534:head# 2024-04-01T19:28:38.063 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63eb7ee9:::benchmark_data_smithi188_77607_object136175:head# 2024-04-01T19:28:38.063 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63eef1be:::benchmark_data_smithi188_77607_object150429:head# 2024-04-01T19:28:38.064 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63ef3643:::benchmark_data_smithi188_77607_object99416:head# 2024-04-01T19:28:38.064 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63ef6fd3:::benchmark_data_smithi188_77607_object152504:head# 2024-04-01T19:28:38.065 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63efefb7:::benchmark_data_smithi188_77607_object153312:head# 2024-04-01T19:28:38.065 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63f100a0:::benchmark_data_smithi188_77607_object117337:head# 2024-04-01T19:28:38.065 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63f14a47:::benchmark_data_smithi188_77607_object102483:head# 2024-04-01T19:28:38.066 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63f18b74:::benchmark_data_smithi188_77607_object161515:head# 2024-04-01T19:28:38.066 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63f32c51:::benchmark_data_smithi188_77607_object108439:head# 2024-04-01T19:28:38.067 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63f4ba21:::benchmark_data_smithi188_77607_object152142:head# 2024-04-01T19:28:38.067 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63f53077:::benchmark_data_smithi188_77607_object166255:head# 2024-04-01T19:28:38.068 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63f8e7e7:::benchmark_data_smithi188_77607_object130995:head# 2024-04-01T19:28:38.068 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63fa544d:::benchmark_data_smithi188_77607_object110299:head# 2024-04-01T19:28:38.069 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63fc2846:::benchmark_data_smithi188_77607_object113153:head# 2024-04-01T19:28:38.069 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63fc517d:::benchmark_data_smithi188_77607_object98392:head# 2024-04-01T19:28:38.070 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63fccf38:::benchmark_data_smithi188_77607_object134278:head# 2024-04-01T19:28:38.070 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63fe9116:::benchmark_data_smithi188_77607_object132700:head# 2024-04-01T19:28:38.071 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:63ff6f71:::benchmark_data_smithi188_77607_object151396:head# 2024-04-01T19:28:38.071 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64004b99:::benchmark_data_smithi188_77607_object119734:head# 2024-04-01T19:28:38.071 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6401fe7e:::benchmark_data_smithi188_77607_object114236:head# 2024-04-01T19:28:38.072 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64036a9e:::benchmark_data_smithi188_77607_object160972:head# 2024-04-01T19:28:38.072 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:640616ca:::benchmark_data_smithi188_77607_object130953:head# 2024-04-01T19:28:38.073 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64062fcd:::benchmark_data_smithi188_77607_object101983:head# 2024-04-01T19:28:38.073 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64063a15:::benchmark_data_smithi188_77607_object138578:head# 2024-04-01T19:28:38.074 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:640699e3:::benchmark_data_smithi188_77607_object116058:head# 2024-04-01T19:28:38.074 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6407bb54:::benchmark_data_smithi188_77607_object120848:head# 2024-04-01T19:28:38.074 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6407c36f:::benchmark_data_smithi188_77607_object158903:head# 2024-04-01T19:28:38.075 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64091032:::benchmark_data_smithi188_77607_object103905:head# 2024-04-01T19:28:38.075 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:640b7ccb:::benchmark_data_smithi188_77607_object101324:head# 2024-04-01T19:28:38.076 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:640bc6e8:::benchmark_data_smithi188_77607_object104113:head# 2024-04-01T19:28:38.076 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:640bc6f3:::benchmark_data_smithi188_77607_object153011:head# 2024-04-01T19:28:38.077 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:640d9e7a:::benchmark_data_smithi188_77607_object124156:head# 2024-04-01T19:28:38.077 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:640dac08:::benchmark_data_smithi188_77607_object147673:head# 2024-04-01T19:28:38.078 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:640e878b:::benchmark_data_smithi188_77607_object129737:head# 2024-04-01T19:28:38.078 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:640f21af:::benchmark_data_smithi188_77607_object133742:head# 2024-04-01T19:28:38.079 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:640f7289:::benchmark_data_smithi188_77607_object99788:head# 2024-04-01T19:28:38.079 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:640f7896:::benchmark_data_smithi188_77607_object159589:head# 2024-04-01T19:28:38.080 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:640faf07:::benchmark_data_smithi188_77607_object146833:head# 2024-04-01T19:28:38.080 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:640fde8d:::benchmark_data_smithi188_77607_object105686:head# 2024-04-01T19:28:38.080 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:641125b5:::benchmark_data_smithi188_77607_object117590:head# 2024-04-01T19:28:38.081 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64127e67:::benchmark_data_smithi188_77607_object103485:head# 2024-04-01T19:28:38.081 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:641358df:::benchmark_data_smithi188_77607_object119133:head# 2024-04-01T19:28:38.082 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:641439fb:::benchmark_data_smithi188_77607_object152150:head# 2024-04-01T19:28:38.082 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64152117:::benchmark_data_smithi188_77607_object117803:head# 2024-04-01T19:28:38.082 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:641620c2:::benchmark_data_smithi188_77607_object135573:head# 2024-04-01T19:28:38.083 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64164f61:::benchmark_data_smithi188_77607_object159018:head# 2024-04-01T19:28:38.083 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6416fc7a:::benchmark_data_smithi188_77607_object100087:head# 2024-04-01T19:28:38.084 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:641bbafd:::benchmark_data_smithi188_77607_object161696:head# 2024-04-01T19:28:38.084 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:641f646e:::benchmark_data_smithi188_77607_object111779:head# 2024-04-01T19:28:38.085 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64207122:::benchmark_data_smithi188_77607_object122984:head# 2024-04-01T19:28:38.085 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64218eea:::benchmark_data_smithi188_77607_object130113:head# 2024-04-01T19:28:38.086 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6421fa1f:::benchmark_data_smithi188_77607_object113314:head# 2024-04-01T19:28:38.086 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6422db73:::benchmark_data_smithi188_77607_object102777:head# 2024-04-01T19:28:38.087 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6424fa91:::benchmark_data_smithi188_77607_object98979:head# 2024-04-01T19:28:38.087 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6425fa5d:::benchmark_data_smithi188_77607_object137537:head# 2024-04-01T19:28:38.087 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64271bb2:::benchmark_data_smithi188_77607_object154015:head# 2024-04-01T19:28:38.088 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6427c192:::benchmark_data_smithi188_77607_object108250:head# 2024-04-01T19:28:38.088 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:642808d9:::benchmark_data_smithi188_77607_object162567:head# 2024-04-01T19:28:38.089 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6428aada:::benchmark_data_smithi188_77607_object115420:head# 2024-04-01T19:28:38.089 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6428ebfc:::benchmark_data_smithi188_77607_object134708:head# 2024-04-01T19:28:38.089 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:642bada2:::benchmark_data_smithi188_77607_object134832:head# 2024-04-01T19:28:38.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:642bba69:::benchmark_data_smithi188_77607_object155384:head# 2024-04-01T19:28:38.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:642bbd2b:::benchmark_data_smithi188_77607_object115432:head# 2024-04-01T19:28:38.091 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:642d14f4:::benchmark_data_smithi188_77607_object151954:head# 2024-04-01T19:28:38.091 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:642dece4:::benchmark_data_smithi188_77607_object157080:head# 2024-04-01T19:28:38.091 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:642f79cc:::benchmark_data_smithi188_77607_object128723:head# 2024-04-01T19:28:38.092 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64309896:::benchmark_data_smithi188_77607_object136882:head# 2024-04-01T19:28:38.093 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6431078f:::benchmark_data_smithi188_77607_object161390:head# 2024-04-01T19:28:38.093 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64317129:::benchmark_data_smithi188_77607_object147573:head# 2024-04-01T19:28:38.093 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6431777b:::benchmark_data_smithi188_77607_object131079:head# 2024-04-01T19:28:38.094 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64317c05:::benchmark_data_smithi188_77607_object125350:head# 2024-04-01T19:28:38.094 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64324760:::benchmark_data_smithi188_77607_object160221:head# 2024-04-01T19:28:38.095 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6433854e:::benchmark_data_smithi188_77607_object149030:head# 2024-04-01T19:28:38.095 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64338915:::benchmark_data_smithi188_77607_object157568:head# 2024-04-01T19:28:38.096 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6434c058:::benchmark_data_smithi188_77607_object135929:head# 2024-04-01T19:28:38.096 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:643572cd:::benchmark_data_smithi188_77607_object127358:head# 2024-04-01T19:28:38.097 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6436ebbe:::benchmark_data_smithi188_77607_object165247:head# 2024-04-01T19:28:38.097 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:643795d1:::benchmark_data_smithi188_77607_object130628:head# 2024-04-01T19:28:38.097 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64386425:::benchmark_data_smithi188_77607_object131379:head# 2024-04-01T19:28:38.098 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64386fec:::benchmark_data_smithi188_77607_object144861:head# 2024-04-01T19:28:38.099 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64388ea2:::benchmark_data_smithi188_77607_object133338:head# 2024-04-01T19:28:38.099 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:643a4bd7:::benchmark_data_smithi188_77607_object143786:head# 2024-04-01T19:28:38.099 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:643a5b41:::benchmark_data_smithi188_77607_object149404:head# 2024-04-01T19:28:38.100 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:643a6da2:::benchmark_data_smithi188_77607_object136797:head# 2024-04-01T19:28:38.100 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:643be989:::benchmark_data_smithi188_77607_object98925:head# 2024-04-01T19:28:38.100 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:643c469a:::benchmark_data_smithi188_77607_object123445:head# 2024-04-01T19:28:38.102 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:643e328e:::benchmark_data_smithi188_77607_object167072:head# 2024-04-01T19:28:38.103 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:643f4f58:::benchmark_data_smithi188_77607_object111182:head# 2024-04-01T19:28:38.103 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:643f731a:::benchmark_data_smithi188_77607_object147362:head# 2024-04-01T19:28:38.103 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64401e14:::benchmark_data_smithi188_77607_object148772:head# 2024-04-01T19:28:38.104 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:644133a2:::benchmark_data_smithi188_77607_object160026:head# 2024-04-01T19:28:38.104 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6442d206:::benchmark_data_smithi188_77607_object128385:head# 2024-04-01T19:28:38.105 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6443df34:::benchmark_data_smithi188_77607_object160064:head# 2024-04-01T19:28:38.105 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6444351e:::benchmark_data_smithi188_77607_object100903:head# 2024-04-01T19:28:38.106 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6445ea46:::benchmark_data_smithi188_77607_object119491:head# 2024-04-01T19:28:38.106 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6447a784:::benchmark_data_smithi188_77607_object114224:head# 2024-04-01T19:28:38.106 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64485672:::benchmark_data_smithi188_77607_object122037:head# 2024-04-01T19:28:38.107 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64498cab:::benchmark_data_smithi188_77607_object156149:head# 2024-04-01T19:28:38.107 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6449ab49:::benchmark_data_smithi188_77607_object143759:head# 2024-04-01T19:28:38.108 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6449ebcd:::benchmark_data_smithi188_77607_object122651:head# 2024-04-01T19:28:38.108 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:644acbe3:::benchmark_data_smithi188_77607_object164165:head# 2024-04-01T19:28:38.109 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:644b8c3f:::benchmark_data_smithi188_77607_object153435:head# 2024-04-01T19:28:38.110 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:644d15dd:::benchmark_data_smithi188_77607_object126421:head# 2024-04-01T19:28:38.110 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:644d7bf9:::benchmark_data_smithi188_77607_object156760:head# 2024-04-01T19:28:38.110 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:644d9b67:::benchmark_data_smithi188_77607_object146000:head# 2024-04-01T19:28:38.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:37 smithi022 ceph-mon[39439]: pgmap v525: 17 pgs: 4 undersized+degraded+remapped+backfilling+peered, 13 active+clean; 4.2 GiB data, 8.6 GiB used, 975 GiB / 983 GiB avail; 8274/139154 objects degraded (5.946%); 95 MiB/s, 1.52k objects/s recovering 2024-04-01T19:28:38.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:37 smithi022 ceph-mon[39439]: osdmap e173: 12 total, 11 up, 11 in 2024-04-01T19:28:38.115 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:644e01ef:::benchmark_data_smithi188_77607_object123132:head# 2024-04-01T19:28:38.115 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:644eb045:::benchmark_data_smithi188_77607_object114950:head# 2024-04-01T19:28:38.115 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:644ec4cb:::benchmark_data_smithi188_77607_object140563:head# 2024-04-01T19:28:38.115 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:644fddba:::benchmark_data_smithi188_77607_object124896:head# 2024-04-01T19:28:38.115 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:644ff5a8:::benchmark_data_smithi188_77607_object139888:head# 2024-04-01T19:28:38.115 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:645080cd:::benchmark_data_smithi188_77607_object117133:head# 2024-04-01T19:28:38.115 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6451fae5:::benchmark_data_smithi188_77607_object111165:head# 2024-04-01T19:28:38.115 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64532250:::benchmark_data_smithi188_77607_object148799:head# 2024-04-01T19:28:38.115 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6454830a:::benchmark_data_smithi188_77607_object135452:head# 2024-04-01T19:28:38.115 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:645484e5:::benchmark_data_smithi188_77607_object161942:head# 2024-04-01T19:28:38.116 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6456e16d:::benchmark_data_smithi188_77607_object165829:head# 2024-04-01T19:28:38.116 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:645a74bb:::benchmark_data_smithi188_77607_object153398:head# 2024-04-01T19:28:38.116 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:645b0b5a:::benchmark_data_smithi188_77607_object166940:head# 2024-04-01T19:28:38.117 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:645ce916:::benchmark_data_smithi188_77607_object142834:head# 2024-04-01T19:28:38.117 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:645d9f3a:::benchmark_data_smithi188_77607_object161906:head# 2024-04-01T19:28:38.117 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64643010:::benchmark_data_smithi188_77607_object145837:head# 2024-04-01T19:28:38.118 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6466ef6d:::benchmark_data_smithi188_77607_object159145:head# 2024-04-01T19:28:38.118 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:646922c7:::benchmark_data_smithi188_77607_object100355:head# 2024-04-01T19:28:38.119 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:646a7ff0:::benchmark_data_smithi188_77607_object104021:head# 2024-04-01T19:28:38.119 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:646a89c9:::benchmark_data_smithi188_77607_object165849:head# 2024-04-01T19:28:38.120 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:646b9c6e:::benchmark_data_smithi188_77607_object105642:head# 2024-04-01T19:28:38.120 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:646c9946:::benchmark_data_smithi188_77607_object134700:head# 2024-04-01T19:28:38.121 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:646efc16:::benchmark_data_smithi188_77607_object129795:head# 2024-04-01T19:28:38.121 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:646f102e:::benchmark_data_smithi188_77607_object105595:head# 2024-04-01T19:28:38.122 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64704aca:::benchmark_data_smithi188_77607_object130282:head# 2024-04-01T19:28:38.122 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64707441:::benchmark_data_smithi188_77607_object122698:head# 2024-04-01T19:28:38.123 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64707486:::benchmark_data_smithi188_77607_object106914:head# 2024-04-01T19:28:38.123 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6470a465:::benchmark_data_smithi188_77607_object143017:head# 2024-04-01T19:28:38.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:37 smithi188 ceph-mon[43939]: pgmap v525: 17 pgs: 4 undersized+degraded+remapped+backfilling+peered, 13 active+clean; 4.2 GiB data, 8.6 GiB used, 975 GiB / 983 GiB avail; 8274/139154 objects degraded (5.946%); 95 MiB/s, 1.52k objects/s recovering 2024-04-01T19:28:38.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:37 smithi188 ceph-mon[43939]: osdmap e173: 12 total, 11 up, 11 in 2024-04-01T19:28:38.124 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64714127:::benchmark_data_smithi188_77607_object145982:head# 2024-04-01T19:28:38.124 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6471785f:::benchmark_data_smithi188_77607_object131596:head# 2024-04-01T19:28:38.125 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:647385f9:::benchmark_data_smithi188_77607_object132918:head# 2024-04-01T19:28:38.125 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6474161e:::benchmark_data_smithi188_77607_object152639:head# 2024-04-01T19:28:38.126 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6477873b:::benchmark_data_smithi188_77607_object133073:head# 2024-04-01T19:28:38.126 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6478c6d4:::benchmark_data_smithi188_77607_object102546:head# 2024-04-01T19:28:38.127 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6478fcc4:::benchmark_data_smithi188_77607_object153725:head# 2024-04-01T19:28:38.127 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:647a989e:::benchmark_data_smithi188_77607_object111451:head# 2024-04-01T19:28:38.127 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:647d4870:::benchmark_data_smithi188_77607_object160598:head# 2024-04-01T19:28:38.128 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:647e647a:::benchmark_data_smithi188_77607_object103094:head# 2024-04-01T19:28:38.128 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:647f9044:::benchmark_data_smithi188_77607_object127212:head# 2024-04-01T19:28:38.129 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64813c44:::benchmark_data_smithi188_77607_object122638:head# 2024-04-01T19:28:38.129 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64818ab8:::benchmark_data_smithi188_77607_object166533:head# 2024-04-01T19:28:38.130 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6481e802:::benchmark_data_smithi188_77607_object125291:head# 2024-04-01T19:28:38.130 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:648294b6:::benchmark_data_smithi188_77607_object124860:head# 2024-04-01T19:28:38.131 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64837a1b:::benchmark_data_smithi188_77607_object166162:head# 2024-04-01T19:28:38.131 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64844560:::benchmark_data_smithi188_77607_object153067:head# 2024-04-01T19:28:38.132 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6484835b:::benchmark_data_smithi188_77607_object159178:head# 2024-04-01T19:28:38.132 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6485ffbd:::benchmark_data_smithi188_77607_object106009:head# 2024-04-01T19:28:38.133 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:648650e6:::benchmark_data_smithi188_77607_object136639:head# 2024-04-01T19:28:38.133 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64866601:::benchmark_data_smithi188_77607_object145515:head# 2024-04-01T19:28:38.133 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64868144:::benchmark_data_smithi188_77607_object138545:head# 2024-04-01T19:28:38.134 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64872ccc:::benchmark_data_smithi188_77607_object155743:head# 2024-04-01T19:28:38.134 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64877bff:::benchmark_data_smithi188_77607_object110580:head# 2024-04-01T19:28:38.135 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:28:38.135 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6487eb33:::benchmark_data_smithi188_77607_object141479:head# 2024-04-01T19:28:38.136 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:648864f7:::benchmark_data_smithi188_77607_object124124:head# 2024-04-01T19:28:38.136 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6488fdbf:::benchmark_data_smithi188_77607_object99679:head# 2024-04-01T19:28:38.137 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6489adf6:::benchmark_data_smithi188_77607_object101428:head# 2024-04-01T19:28:38.137 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6489d8e6:::benchmark_data_smithi188_77607_object131625:head# 2024-04-01T19:28:38.137 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:648c555e:::benchmark_data_smithi188_77607_object143230:head# 2024-04-01T19:28:38.138 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:648dcd05:::benchmark_data_smithi188_77607_object157072:head# 2024-04-01T19:28:38.139 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64901d74:::benchmark_data_smithi188_77607_object159769:head# 2024-04-01T19:28:38.139 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64906afe:::benchmark_data_smithi188_77607_object158576:head# 2024-04-01T19:28:38.139 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6492893d:::benchmark_data_smithi188_77607_object158054:head# 2024-04-01T19:28:38.140 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64929614:::benchmark_data_smithi188_77607_object104583:head# 2024-04-01T19:28:38.140 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6492da17:::benchmark_data_smithi188_77607_object124182:head# 2024-04-01T19:28:38.140 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64938367:::benchmark_data_smithi188_77607_object106759:head# 2024-04-01T19:28:38.141 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6494558d:::benchmark_data_smithi188_77607_object147862:head# 2024-04-01T19:28:38.142 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64970a25:::benchmark_data_smithi188_77607_object159044:head# 2024-04-01T19:28:38.142 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:649771ce:::benchmark_data_smithi188_77607_object166083:head# 2024-04-01T19:28:38.142 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64977515:::benchmark_data_smithi188_77607_object100224:head# 2024-04-01T19:28:38.143 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6497b516:::benchmark_data_smithi188_77607_object150937:head# 2024-04-01T19:28:38.143 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:649815f6:::benchmark_data_smithi188_77607_object161423:head# 2024-04-01T19:28:38.143 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64981b01:::benchmark_data_smithi188_77607_object156306:head# 2024-04-01T19:28:38.144 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64988372:::benchmark_data_smithi188_77607_object103825:head# 2024-04-01T19:28:38.144 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:649d4a36:::benchmark_data_smithi188_77607_object147903:head# 2024-04-01T19:28:38.145 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:649d6fe0:::benchmark_data_smithi188_77607_object140989:head# 2024-04-01T19:28:38.145 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:649f86c2:::benchmark_data_smithi188_77607_object114862:head# 2024-04-01T19:28:38.146 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64a0786e:::benchmark_data_smithi188_77607_object146969:head# 2024-04-01T19:28:38.146 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64a198d8:::benchmark_data_smithi188_77607_object130559:head# 2024-04-01T19:28:38.147 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64a1e5aa:::benchmark_data_smithi188_77607_object98582:head# 2024-04-01T19:28:38.147 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64a3c639:::benchmark_data_smithi188_77607_object109831:head# 2024-04-01T19:28:38.148 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64a4640e:::benchmark_data_smithi188_77607_object106367:head# 2024-04-01T19:28:38.148 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64a4b34e:::benchmark_data_smithi188_77607_object102239:head# 2024-04-01T19:28:38.149 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64a5f047:::benchmark_data_smithi188_77607_object115797:head# 2024-04-01T19:28:38.149 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64a893c3:::benchmark_data_smithi188_77607_object98413:head# 2024-04-01T19:28:38.150 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64a8d679:::benchmark_data_smithi188_77607_object112310:head# 2024-04-01T19:28:38.151 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64aa5de9:::benchmark_data_smithi188_77607_object152110:head# 2024-04-01T19:28:38.151 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64abca7e:::benchmark_data_smithi188_77607_object100325:head# 2024-04-01T19:28:38.152 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64aedb1c:::benchmark_data_smithi188_77607_object146059:head# 2024-04-01T19:28:38.152 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64af08c1:::benchmark_data_smithi188_77607_object165159:head# 2024-04-01T19:28:38.152 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64b01c8a:::benchmark_data_smithi188_77607_object124719:head# 2024-04-01T19:28:38.153 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64b0888c:::benchmark_data_smithi188_77607_object113387:head# 2024-04-01T19:28:38.153 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64b12978:::benchmark_data_smithi188_77607_object120313:head# 2024-04-01T19:28:38.154 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64b1e2b8:::benchmark_data_smithi188_77607_object159900:head# 2024-04-01T19:28:38.154 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64b22892:::benchmark_data_smithi188_77607_object128265:head# 2024-04-01T19:28:38.155 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64b25f15:::benchmark_data_smithi188_77607_object143292:head# 2024-04-01T19:28:38.155 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64b35094:::benchmark_data_smithi188_77607_object120964:head# 2024-04-01T19:28:38.155 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64b3fa0e:::benchmark_data_smithi188_77607_object112615:head# 2024-04-01T19:28:38.156 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64b4534a:::benchmark_data_smithi188_77607_object145086:head# 2024-04-01T19:28:38.156 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64b4933b:::benchmark_data_smithi188_77607_object103040:head# 2024-04-01T19:28:38.157 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64b49c0d:::benchmark_data_smithi188_77607_object159288:head# 2024-04-01T19:28:38.157 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64b5a1c4:::benchmark_data_smithi188_77607_object142337:head# 2024-04-01T19:28:38.158 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64b7c77a:::benchmark_data_smithi188_77607_object106398:head# 2024-04-01T19:28:38.158 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64b80344:::benchmark_data_smithi188_77607_object120767:head# 2024-04-01T19:28:38.159 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64b9b3e6:::benchmark_data_smithi188_77607_object156261:head# 2024-04-01T19:28:38.159 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64ba3028:::benchmark_data_smithi188_77607_object141047:head# 2024-04-01T19:28:38.160 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64bb601a:::benchmark_data_smithi188_77607_object126228:head# 2024-04-01T19:28:38.160 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64bb8c28:::benchmark_data_smithi188_77607_object113794:head# 2024-04-01T19:28:38.161 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64bc9488:::benchmark_data_smithi188_77607_object116092:head# 2024-04-01T19:28:38.161 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64bcac5d:::benchmark_data_smithi188_77607_object142750:head# 2024-04-01T19:28:38.162 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64bd6e0a:::benchmark_data_smithi188_77607_object153669:head# 2024-04-01T19:28:38.162 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64c0537b:::benchmark_data_smithi188_77607_object113309:head# 2024-04-01T19:28:38.162 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64c11e03:::benchmark_data_smithi188_77607_object116073:head# 2024-04-01T19:28:38.163 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:38.163 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64c149fa:::benchmark_data_smithi188_77607_object156848:head# 2024-04-01T19:28:38.164 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64c17e68:::benchmark_data_smithi188_77607_object140513:head# 2024-04-01T19:28:38.164 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64c2415d:::benchmark_data_smithi188_77607_object100949:head# 2024-04-01T19:28:38.164 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64c37eda:::benchmark_data_smithi188_77607_object126797:head# 2024-04-01T19:28:38.165 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64c3d3c9:::benchmark_data_smithi188_77607_object159941:head# 2024-04-01T19:28:38.165 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64c4c6c7:::benchmark_data_smithi188_77607_object127285:head# 2024-04-01T19:28:38.166 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64c4ffd8:::benchmark_data_smithi188_77607_object155762:head# 2024-04-01T19:28:38.166 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64c570a5:::benchmark_data_smithi188_77607_object129236:head# 2024-04-01T19:28:38.167 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64c5cec0:::benchmark_data_smithi188_77607_object155162:head# 2024-04-01T19:28:38.167 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64c5f098:::benchmark_data_smithi188_77607_object132693:head# 2024-04-01T19:28:38.168 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64c66708:::benchmark_data_smithi188_77607_object143033:head# 2024-04-01T19:28:38.168 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64c887c9:::benchmark_data_smithi188_77607_object134830:head# 2024-04-01T19:28:38.168 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64c95961:::benchmark_data_smithi188_77607_object143102:head# 2024-04-01T19:28:38.169 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64c9dc8e:::benchmark_data_smithi188_77607_object129597:head# 2024-04-01T19:28:38.169 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64ca2ab6:::benchmark_data_smithi188_77607_object139814:head# 2024-04-01T19:28:38.170 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64cb002a:::benchmark_data_smithi188_77607_object163165:head# 2024-04-01T19:28:38.170 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64cb7f88:::benchmark_data_smithi188_77607_object113181:head# 2024-04-01T19:28:38.171 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64cc3c90:::benchmark_data_smithi188_77607_object113677:head# 2024-04-01T19:28:38.171 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64cc823d:::benchmark_data_smithi188_77607_object103929:head# 2024-04-01T19:28:38.171 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64ccf786:::benchmark_data_smithi188_77607_object115499:head# 2024-04-01T19:28:38.172 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64cdc999:::benchmark_data_smithi188_77607_object139880:head# 2024-04-01T19:28:38.172 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64cf1c49:::benchmark_data_smithi188_77607_object130575:head# 2024-04-01T19:28:38.173 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64cf8dbf:::benchmark_data_smithi188_77607_object115809:head# 2024-04-01T19:28:38.173 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64cfb280:::benchmark_data_smithi188_77607_object114146:head# 2024-04-01T19:28:38.174 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64cfc324:::benchmark_data_smithi188_77607_object98099:head# 2024-04-01T19:28:38.174 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64d004a6:::benchmark_data_smithi188_77607_object105728:head# 2024-04-01T19:28:38.175 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64d031b0:::benchmark_data_smithi188_77607_object119655:head# 2024-04-01T19:28:38.175 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64d1f819:::benchmark_data_smithi188_77607_object99911:head# 2024-04-01T19:28:38.176 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64d30911:::benchmark_data_smithi188_77607_object163628:head# 2024-04-01T19:28:38.176 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64d39fd4:::benchmark_data_smithi188_77607_object111461:head# 2024-04-01T19:28:38.177 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64d455d4:::benchmark_data_smithi188_77607_object143924:head# 2024-04-01T19:28:38.177 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64d59f97:::benchmark_data_smithi188_77607_object125673:head# 2024-04-01T19:28:38.178 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64d62c0d:::benchmark_data_smithi188_77607_object146732:head# 2024-04-01T19:28:38.178 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64d86b47:::benchmark_data_smithi188_77607_object146063:head# 2024-04-01T19:28:38.179 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64d93e4c:::benchmark_data_smithi188_77607_object119532:head# 2024-04-01T19:28:38.179 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64da02b2:::benchmark_data_smithi188_77607_object119268:head# 2024-04-01T19:28:38.179 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64daa157:::benchmark_data_smithi188_77607_object119674:head# 2024-04-01T19:28:38.180 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64e18f2d:::benchmark_data_smithi188_77607_object114139:head# 2024-04-01T19:28:38.180 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64e1eec3:::benchmark_data_smithi188_77607_object133373:head# 2024-04-01T19:28:38.181 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64e287db:::benchmark_data_smithi188_77607_object138923:head# 2024-04-01T19:28:38.181 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64e40c8c:::benchmark_data_smithi188_77607_object142560:head# 2024-04-01T19:28:38.182 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64e412de:::benchmark_data_smithi188_77607_object126038:head# 2024-04-01T19:28:38.182 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64e4bdfc:::benchmark_data_smithi188_77607_object153567:head# 2024-04-01T19:28:38.182 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64e6f5ad:::benchmark_data_smithi188_77607_object122608:head# 2024-04-01T19:28:38.183 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64e77bf4:::benchmark_data_smithi188_77607_object100493:head# 2024-04-01T19:28:38.183 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64e7a1d8:::benchmark_data_smithi188_77607_object104930:head# 2024-04-01T19:28:38.184 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64e9cfc0:::benchmark_data_smithi188_77607_object115644:head# 2024-04-01T19:28:38.184 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64eb784b:::benchmark_data_smithi188_77607_object126999:head# 2024-04-01T19:28:38.185 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64eef570:::benchmark_data_smithi188_77607_object101126:head# 2024-04-01T19:28:38.185 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64f035f8:::benchmark_data_smithi188_77607_object117001:head# 2024-04-01T19:28:38.185 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64f04c29:::benchmark_data_smithi188_77607_object131824:head# 2024-04-01T19:28:38.186 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64f3513e:::benchmark_data_smithi188_77607_object153646:head# 2024-04-01T19:28:38.186 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64f3941c:::benchmark_data_smithi188_77607_object126621:head# 2024-04-01T19:28:38.187 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64f489d1:::benchmark_data_smithi188_77607_object103522:head# 2024-04-01T19:28:38.187 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64f4bea4:::benchmark_data_smithi188_77607_object140305:head# 2024-04-01T19:28:38.188 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64f5cacf:::benchmark_data_smithi188_77607_object110326:head# 2024-04-01T19:28:38.188 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64f77d0a:::benchmark_data_smithi188_77607_object135984:head# 2024-04-01T19:28:38.188 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64f823af:::benchmark_data_smithi188_77607_object157795:head# 2024-04-01T19:28:38.189 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64fd35b4:::benchmark_data_smithi188_77607_object147820:head# 2024-04-01T19:28:38.189 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64fd5c87:::benchmark_data_smithi188_77607_object145673:head# 2024-04-01T19:28:38.190 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64fddafe:::benchmark_data_smithi188_77607_object141923:head# 2024-04-01T19:28:38.190 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:64ff9a61:::benchmark_data_smithi188_77607_object127853:head# 2024-04-01T19:28:38.191 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65066fac:::benchmark_data_smithi188_77607_object98179:head# 2024-04-01T19:28:38.191 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6506d2ae:::benchmark_data_smithi188_77607_object108719:head# 2024-04-01T19:28:38.192 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6507aac9:::benchmark_data_smithi188_77607_object108768:head# 2024-04-01T19:28:38.192 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6507c6f0:::benchmark_data_smithi188_77607_object119867:head# 2024-04-01T19:28:38.192 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65081481:::benchmark_data_smithi188_77607_object165878:head# 2024-04-01T19:28:38.193 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65081f63:::benchmark_data_smithi188_77607_object108851:head# 2024-04-01T19:28:38.193 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65094d01:::benchmark_data_smithi188_77607_object158538:head# 2024-04-01T19:28:38.194 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6509a16f:::benchmark_data_smithi188_77607_object160882:head# 2024-04-01T19:28:38.194 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6509e6c6:::benchmark_data_smithi188_77607_object146114:head# 2024-04-01T19:28:38.194 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:650a7211:::benchmark_data_smithi188_77607_object161446:head# 2024-04-01T19:28:38.195 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:650c661a:::benchmark_data_smithi188_77607_object114162:head# 2024-04-01T19:28:38.195 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:650ec8ca:::benchmark_data_smithi188_77607_object148468:head# 2024-04-01T19:28:38.196 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65111dd3:::benchmark_data_smithi188_77607_object131720:head# 2024-04-01T19:28:38.196 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:651253d8:::benchmark_data_smithi188_77607_object108601:head# 2024-04-01T19:28:38.197 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:651254bb:::benchmark_data_smithi188_77607_object112282:head# 2024-04-01T19:28:38.197 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6512dab2:::benchmark_data_smithi188_77607_object106742:head# 2024-04-01T19:28:38.198 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6513053a:::benchmark_data_smithi188_77607_object110092:head# 2024-04-01T19:28:38.198 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6513e4aa:::benchmark_data_smithi188_77607_object145829:head# 2024-04-01T19:28:38.199 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65145d2c:::benchmark_data_smithi188_77607_object126903:head# 2024-04-01T19:28:38.199 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6514cb42:::benchmark_data_smithi188_77607_object99366:head# 2024-04-01T19:28:38.200 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:651541bb:::benchmark_data_smithi188_77607_object135256:head# 2024-04-01T19:28:38.200 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6515d8de:::benchmark_data_smithi188_77607_object157902:head# 2024-04-01T19:28:38.201 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:651b426c:::benchmark_data_smithi188_77607_object120863:head# 2024-04-01T19:28:38.201 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:651c3df8:::benchmark_data_smithi188_77607_object121378:head# 2024-04-01T19:28:38.202 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:651d9d00:::benchmark_data_smithi188_77607_object117233:head# 2024-04-01T19:28:38.202 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:651dce76:::benchmark_data_smithi188_77607_object112354:head# 2024-04-01T19:28:38.202 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:651e954e:::benchmark_data_smithi188_77607_object153206:head# 2024-04-01T19:28:38.203 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:651ea2d8:::benchmark_data_smithi188_77607_object118477:head# 2024-04-01T19:28:38.203 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65215512:::benchmark_data_smithi188_77607_object166780:head# 2024-04-01T19:28:38.204 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65216344:::benchmark_data_smithi188_77607_object106524:head# 2024-04-01T19:28:38.204 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6521872f:::benchmark_data_smithi188_77607_object120741:head# 2024-04-01T19:28:38.205 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:652254b0:::benchmark_data_smithi188_77607_object118217:head# 2024-04-01T19:28:38.205 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:652851b2:::benchmark_data_smithi188_77607_object149649:head# 2024-04-01T19:28:38.206 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6529cdba:::benchmark_data_smithi188_77607_object106126:head# 2024-04-01T19:28:38.206 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:652b66be:::benchmark_data_smithi188_77607_object108211:head# 2024-04-01T19:28:38.206 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:652c7792:::benchmark_data_smithi188_77607_object108373:head# 2024-04-01T19:28:38.207 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6530f3c8:::benchmark_data_smithi188_77607_object141018:head# 2024-04-01T19:28:38.208 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6533ffb7:::benchmark_data_smithi188_77607_object126918:head# 2024-04-01T19:28:38.208 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65346fd5:::benchmark_data_smithi188_77607_object162197:head# 2024-04-01T19:28:38.208 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6534ad58:::benchmark_data_smithi188_77607_object127692:head# 2024-04-01T19:28:38.209 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6535a537:::benchmark_data_smithi188_77607_object127106:head# 2024-04-01T19:28:38.209 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:653622d0:::benchmark_data_smithi188_77607_object123996:head# 2024-04-01T19:28:38.210 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6537c008:::benchmark_data_smithi188_77607_object115584:head# 2024-04-01T19:28:38.210 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6537c1b3:::benchmark_data_smithi188_77607_object101756:head# 2024-04-01T19:28:38.211 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6537c80d:::benchmark_data_smithi188_77607_object146937:head# 2024-04-01T19:28:38.211 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65386074:::benchmark_data_smithi188_77607_object149711:head# 2024-04-01T19:28:38.212 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6539769d:::benchmark_data_smithi188_77607_object149110:head# 2024-04-01T19:28:38.212 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:653a3159:::benchmark_data_smithi188_77607_object157826:head# 2024-04-01T19:28:38.213 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:653a964e:::benchmark_data_smithi188_77607_object106063:head# 2024-04-01T19:28:38.213 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:653aba08:::benchmark_data_smithi188_77607_object154576:head# 2024-04-01T19:28:38.213 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:653b90b8:::benchmark_data_smithi188_77607_object167179:head# 2024-04-01T19:28:38.214 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:653e955b:::benchmark_data_smithi188_77607_object126603:head# 2024-04-01T19:28:38.214 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:653e9b05:::benchmark_data_smithi188_77607_object152049:head# 2024-04-01T19:28:38.215 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6541649e:::benchmark_data_smithi188_77607_object113401:head# 2024-04-01T19:28:38.215 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:654221fd:::benchmark_data_smithi188_77607_object103502:head# 2024-04-01T19:28:38.216 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6542fa11:::benchmark_data_smithi188_77607_object100706:head# 2024-04-01T19:28:38.216 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:654400b0:::benchmark_data_smithi188_77607_object152771:head# 2024-04-01T19:28:38.217 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6546bd19:::benchmark_data_smithi188_77607_object101566:head# 2024-04-01T19:28:38.217 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6546d14d:::benchmark_data_smithi188_77607_object141421:head# 2024-04-01T19:28:38.217 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65471694:::benchmark_data_smithi188_77607_object100080:head# 2024-04-01T19:28:38.218 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6547a81a:::benchmark_data_smithi188_77607_object145979:head# 2024-04-01T19:28:38.218 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6548008a:::benchmark_data_smithi188_77607_object124604:head# 2024-04-01T19:28:38.219 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:654834ca:::benchmark_data_smithi188_77607_object159122:head# 2024-04-01T19:28:38.219 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6548b9f9:::benchmark_data_smithi188_77607_object129994:head# 2024-04-01T19:28:38.220 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6549490d:::benchmark_data_smithi188_77607_object162996:head# 2024-04-01T19:28:38.220 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:654ad348:::benchmark_data_smithi188_77607_object151529:head# 2024-04-01T19:28:38.220 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:654e8b86:::benchmark_data_smithi188_77607_object149935:head# 2024-04-01T19:28:38.221 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:654ee990:::benchmark_data_smithi188_77607_object134626:head# 2024-04-01T19:28:38.221 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:654fe985:::benchmark_data_smithi188_77607_object163081:head# 2024-04-01T19:28:38.222 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65536910:::benchmark_data_smithi188_77607_object118024:head# 2024-04-01T19:28:38.222 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6553fd64:::benchmark_data_smithi188_77607_object159155:head# 2024-04-01T19:28:38.223 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65544292:::benchmark_data_smithi188_77607_object100770:head# 2024-04-01T19:28:38.224 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6555742a:::benchmark_data_smithi188_77607_object155036:head# 2024-04-01T19:28:38.224 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65562109:::benchmark_data_smithi188_77607_object146709:head# 2024-04-01T19:28:38.224 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65564750:::benchmark_data_smithi188_77607_object129732:head# 2024-04-01T19:28:38.224 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:655696e0:::benchmark_data_smithi188_77607_object147174:head# 2024-04-01T19:28:38.225 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6558e38b:::benchmark_data_smithi188_77607_object150088:head# 2024-04-01T19:28:38.225 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6558f068:::benchmark_data_smithi188_77607_object116726:head# 2024-04-01T19:28:38.226 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:655c29b8:::benchmark_data_smithi188_77607_object101058:head# 2024-04-01T19:28:38.227 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:655c4cda:::benchmark_data_smithi188_77607_object112219:head# 2024-04-01T19:28:38.227 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:655c7a01:::benchmark_data_smithi188_77607_object137645:head# 2024-04-01T19:28:38.227 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:655d55b3:::benchmark_data_smithi188_77607_object107212:head# 2024-04-01T19:28:38.228 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:655dd0e6:::benchmark_data_smithi188_77607_object156883:head# 2024-04-01T19:28:38.228 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6560845a:::benchmark_data_smithi188_77607_object150157:head# 2024-04-01T19:28:38.229 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65626591:::benchmark_data_smithi188_77607_object163937:head# 2024-04-01T19:28:38.229 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6562bfef:::benchmark_data_smithi188_77607_object155881:head# 2024-04-01T19:28:38.230 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65644e03:::benchmark_data_smithi188_77607_object100934:head# 2024-04-01T19:28:38.230 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6564874c:::benchmark_data_smithi188_77607_object128751:head# 2024-04-01T19:28:38.231 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6564c010:::benchmark_data_smithi188_77607_object147032:head# 2024-04-01T19:28:38.231 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6565183f:::benchmark_data_smithi188_77607_object107611:head# 2024-04-01T19:28:38.232 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65654ed5:::benchmark_data_smithi188_77607_object166423:head# 2024-04-01T19:28:38.232 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6565f1d5:::benchmark_data_smithi188_77607_object165461:head# 2024-04-01T19:28:38.232 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65667c47:::benchmark_data_smithi188_77607_object105108:head# 2024-04-01T19:28:38.233 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6567abf6:::benchmark_data_smithi188_77607_object120324:head# 2024-04-01T19:28:38.233 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:656806d2:::benchmark_data_smithi188_77607_object109170:head# 2024-04-01T19:28:38.234 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6568f527:::benchmark_data_smithi188_77607_object164661:head# 2024-04-01T19:28:38.234 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:656c4dcb:::benchmark_data_smithi188_77607_object103560:head# 2024-04-01T19:28:38.235 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:656c6b5f:::benchmark_data_smithi188_77607_object136884:head# 2024-04-01T19:28:38.235 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:656d3df5:::benchmark_data_smithi188_77607_object129036:head# 2024-04-01T19:28:38.236 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:656e4df3:::benchmark_data_smithi188_77607_object150361:head# 2024-04-01T19:28:38.236 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65709e2a:::benchmark_data_smithi188_77607_object166165:head# 2024-04-01T19:28:38.237 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6570b5be:::benchmark_data_smithi188_77607_object103097:head# 2024-04-01T19:28:38.237 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6570ddb9:::benchmark_data_smithi188_77607_object117446:head# 2024-04-01T19:28:38.238 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65715256:::benchmark_data_smithi188_77607_object153548:head# 2024-04-01T19:28:38.238 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6571969b:::benchmark_data_smithi188_77607_object142132:head# 2024-04-01T19:28:38.239 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6571b873:::benchmark_data_smithi188_77607_object123392:head# 2024-04-01T19:28:38.239 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6572ce93:::benchmark_data_smithi188_77607_object146385:head# 2024-04-01T19:28:38.241 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6573663f:::benchmark_data_smithi188_77607_object112963:head# 2024-04-01T19:28:38.241 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:657472af:::benchmark_data_smithi188_77607_object162748:head# 2024-04-01T19:28:38.242 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6575706c:::benchmark_data_smithi188_77607_object123219:head# 2024-04-01T19:28:38.242 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6577dfcd:::benchmark_data_smithi188_77607_object108666:head# 2024-04-01T19:28:38.243 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6578c3cf:::benchmark_data_smithi188_77607_object152134:head# 2024-04-01T19:28:38.243 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:657a7939:::benchmark_data_smithi188_77607_object117943:head# 2024-04-01T19:28:38.244 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:657aafb0:::benchmark_data_smithi188_77607_object120969:head# 2024-04-01T19:28:38.244 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:657c7fa7:::benchmark_data_smithi188_77607_object160299:head# 2024-04-01T19:28:38.245 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:657e0069:::benchmark_data_smithi188_77607_object106582:head# 2024-04-01T19:28:38.245 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:657e078d:::benchmark_data_smithi188_77607_object134425:head# 2024-04-01T19:28:38.246 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65806d1c:::benchmark_data_smithi188_77607_object155625:head# 2024-04-01T19:28:38.246 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6580bfa8:::benchmark_data_smithi188_77607_object130779:head# 2024-04-01T19:28:38.246 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6580fd97:::benchmark_data_smithi188_77607_object165219:head# 2024-04-01T19:28:38.247 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65818a4f:::benchmark_data_smithi188_77607_object149174:head# 2024-04-01T19:28:38.247 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:658199fd:::benchmark_data_smithi188_77607_object154041:head# 2024-04-01T19:28:38.248 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6582020f:::benchmark_data_smithi188_77607_object108304:head# 2024-04-01T19:28:38.248 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65835390:::benchmark_data_smithi188_77607_object142416:head# 2024-04-01T19:28:38.249 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65836c5f:::benchmark_data_smithi188_77607_object114092:head# 2024-04-01T19:28:38.249 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6583fc8a:::benchmark_data_smithi188_77607_object107234:head# 2024-04-01T19:28:38.250 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6584071f:::benchmark_data_smithi188_77607_object120414:head# 2024-04-01T19:28:38.250 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65848837:::benchmark_data_smithi188_77607_object116802:head# 2024-04-01T19:28:38.251 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:658619de:::benchmark_data_smithi188_77607_object145048:head# 2024-04-01T19:28:38.251 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6586f33e:::benchmark_data_smithi188_77607_object141006:head# 2024-04-01T19:28:38.251 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65873c85:::benchmark_data_smithi188_77607_object135528:head# 2024-04-01T19:28:38.252 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:658987e5:::benchmark_data_smithi188_77607_object160499:head# 2024-04-01T19:28:38.252 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:658a2194:::benchmark_data_smithi188_77607_object105724:head# 2024-04-01T19:28:38.253 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:658a54da:::benchmark_data_smithi188_77607_object99593:head# 2024-04-01T19:28:38.253 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:658ab531:::benchmark_data_smithi188_77607_object103954:head# 2024-04-01T19:28:38.254 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:658c20b3:::benchmark_data_smithi188_77607_object99493:head# 2024-04-01T19:28:38.254 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:658d2bd2:::benchmark_data_smithi188_77607_object137102:head# 2024-04-01T19:28:38.255 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:658dbe07:::benchmark_data_smithi188_77607_object107411:head# 2024-04-01T19:28:38.255 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:658eb714:::benchmark_data_smithi188_77607_object124508:head# 2024-04-01T19:28:38.256 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:658f11f6:::benchmark_data_smithi188_77607_object143140:head# 2024-04-01T19:28:38.256 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:659067dd:::benchmark_data_smithi188_77607_object164150:head# 2024-04-01T19:28:38.257 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:659226ee:::benchmark_data_smithi188_77607_object142744:head# 2024-04-01T19:28:38.257 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65955c86:::benchmark_data_smithi188_77607_object162815:head# 2024-04-01T19:28:38.258 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6596e044:::benchmark_data_smithi188_77607_object110355:head# 2024-04-01T19:28:38.258 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65986aec:::benchmark_data_smithi188_77607_object147779:head# 2024-04-01T19:28:38.258 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6598c66c:::benchmark_data_smithi188_77607_object121184:head# 2024-04-01T19:28:38.259 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6598e88b:::benchmark_data_smithi188_77607_object106386:head# 2024-04-01T19:28:38.259 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65993bbe:::benchmark_data_smithi188_77607_object130002:head# 2024-04-01T19:28:38.260 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65993d82:::benchmark_data_smithi188_77607_object125093:head# 2024-04-01T19:28:38.260 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:659a02b4:::benchmark_data_smithi188_77607_object158708:head# 2024-04-01T19:28:38.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:37 smithi062 ceph-mon[44211]: pgmap v525: 17 pgs: 4 undersized+degraded+remapped+backfilling+peered, 13 active+clean; 4.2 GiB data, 8.6 GiB used, 975 GiB / 983 GiB avail; 8274/139154 objects degraded (5.946%); 95 MiB/s, 1.52k objects/s recovering 2024-04-01T19:28:38.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:37 smithi062 ceph-mon[44211]: osdmap e173: 12 total, 11 up, 11 in 2024-04-01T19:28:38.261 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:659a198e:::benchmark_data_smithi188_77607_object128706:head# 2024-04-01T19:28:38.261 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:659b4fd0:::benchmark_data_smithi188_77607_object166098:head# 2024-04-01T19:28:38.262 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:659baad1:::benchmark_data_smithi188_77607_object116158:head# 2024-04-01T19:28:38.262 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:659d17ce:::benchmark_data_smithi188_77607_object129035:head# 2024-04-01T19:28:38.263 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:659e1203:::benchmark_data_smithi188_77607_object111147:head# 2024-04-01T19:28:38.263 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:659e57c3:::benchmark_data_smithi188_77607_object130840:head# 2024-04-01T19:28:38.263 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:659f7e4b:::benchmark_data_smithi188_77607_object113616:head# 2024-04-01T19:28:38.264 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:659fd1c5:::benchmark_data_smithi188_77607_object110043:head# 2024-04-01T19:28:38.264 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65a0d312:::benchmark_data_smithi188_77607_object130208:head# 2024-04-01T19:28:38.265 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65a13ce8:::benchmark_data_smithi188_77607_object113393:head# 2024-04-01T19:28:38.265 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65a36671:::benchmark_data_smithi188_77607_object132008:head# 2024-04-01T19:28:38.265 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65a46b19:::benchmark_data_smithi188_77607_object133660:head# 2024-04-01T19:28:38.266 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65a4aff7:::benchmark_data_smithi188_77607_object155363:head# 2024-04-01T19:28:38.266 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65a50f00:::benchmark_data_smithi188_77607_object120757:head# 2024-04-01T19:28:38.267 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65a716b4:::benchmark_data_smithi188_77607_object137028:head# 2024-04-01T19:28:38.267 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65a77ebe:::benchmark_data_smithi188_77607_object129596:head# 2024-04-01T19:28:38.268 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65a7b8ec:::benchmark_data_smithi188_77607_object143620:head# 2024-04-01T19:28:38.268 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65a9e0c6:::benchmark_data_smithi188_77607_object133959:head# 2024-04-01T19:28:38.269 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65aa0e30:::benchmark_data_smithi188_77607_object160511:head# 2024-04-01T19:28:38.269 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65aa1002:::benchmark_data_smithi188_77607_object119122:head# 2024-04-01T19:28:38.270 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65aa93a6:::benchmark_data_smithi188_77607_object113659:head# 2024-04-01T19:28:38.270 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65abb030:::benchmark_data_smithi188_77607_object143361:head# 2024-04-01T19:28:38.271 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65ac4789:::benchmark_data_smithi188_77607_object157498:head# 2024-04-01T19:28:38.271 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65ad235f:::benchmark_data_smithi188_77607_object160322:head# 2024-04-01T19:28:38.271 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65ae905e:::benchmark_data_smithi188_77607_object155648:head# 2024-04-01T19:28:38.272 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65af9d8c:::benchmark_data_smithi188_77607_object143635:head# 2024-04-01T19:28:38.272 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65afb66b:::benchmark_data_smithi188_77607_object150689:head# 2024-04-01T19:28:38.273 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65b2adfd:::benchmark_data_smithi188_77607_object99325:head# 2024-04-01T19:28:38.273 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65b489d6:::benchmark_data_smithi188_77607_object133084:head# 2024-04-01T19:28:38.274 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65b5598f:::benchmark_data_smithi188_77607_object143012:head# 2024-04-01T19:28:38.274 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65b655a2:::benchmark_data_smithi188_77607_object106859:head# 2024-04-01T19:28:38.275 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65b9585c:::benchmark_data_smithi188_77607_object158776:head# 2024-04-01T19:28:38.275 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65bae348:::benchmark_data_smithi188_77607_object107658:head# 2024-04-01T19:28:38.276 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65bb6946:::benchmark_data_smithi188_77607_object158052:head# 2024-04-01T19:28:38.276 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65bba7c5:::benchmark_data_smithi188_77607_object107813:head# 2024-04-01T19:28:38.276 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65bc0afb:::benchmark_data_smithi188_77607_object123137:head# 2024-04-01T19:28:38.277 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65bdbefb:::benchmark_data_smithi188_77607_object130777:head# 2024-04-01T19:28:38.277 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65c018dd:::benchmark_data_smithi188_77607_object144802:head# 2024-04-01T19:28:38.278 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65c1dad9:::benchmark_data_smithi188_77607_object157592:head# 2024-04-01T19:28:38.278 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65c39196:::benchmark_data_smithi188_77607_object163520:head# 2024-04-01T19:28:38.279 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65c42488:::benchmark_data_smithi188_77607_object122149:head# 2024-04-01T19:28:38.279 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65c4d751:::benchmark_data_smithi188_77607_object157968:head# 2024-04-01T19:28:38.280 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65c543cc:::benchmark_data_smithi188_77607_object124908:head# 2024-04-01T19:28:38.280 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65c554ea:::benchmark_data_smithi188_77607_object161129:head# 2024-04-01T19:28:38.281 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65c66d38:::benchmark_data_smithi188_77607_object121962:head# 2024-04-01T19:28:38.281 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65c692b4:::benchmark_data_smithi188_77607_object107561:head# 2024-04-01T19:28:38.281 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65c6d693:::benchmark_data_smithi188_77607_object129075:head# 2024-04-01T19:28:38.282 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65c98a9d:::benchmark_data_smithi188_77607_object116928:head# 2024-04-01T19:28:38.283 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65ca333a:::benchmark_data_smithi188_77607_object155683:head# 2024-04-01T19:28:38.283 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65cbc960:::benchmark_data_smithi188_77607_object167070:head# 2024-04-01T19:28:38.283 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65cc7095:::benchmark_data_smithi188_77607_object126834:head# 2024-04-01T19:28:38.284 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65cd4b33:::benchmark_data_smithi188_77607_object139789:head# 2024-04-01T19:28:38.284 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65cd7270:::benchmark_data_smithi188_77607_object127383:head# 2024-04-01T19:28:38.285 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65cd8754:::benchmark_data_smithi188_77607_object162701:head# 2024-04-01T19:28:38.285 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65cfb40a:::benchmark_data_smithi188_77607_object143860:head# 2024-04-01T19:28:38.286 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65cfb828:::benchmark_data_smithi188_77607_object134038:head# 2024-04-01T19:28:38.286 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65d04d05:::benchmark_data_smithi188_77607_object116952:head# 2024-04-01T19:28:38.287 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65d1c6ee:::benchmark_data_smithi188_77607_object138020:head# 2024-04-01T19:28:38.287 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65d22521:::benchmark_data_smithi188_77607_object136143:head# 2024-04-01T19:28:38.288 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65d26447:::benchmark_data_smithi188_77607_object158425:head# 2024-04-01T19:28:38.288 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65d32952:::benchmark_data_smithi188_77607_object155874:head# 2024-04-01T19:28:38.288 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65d3460d:::benchmark_data_smithi188_77607_object120459:head# 2024-04-01T19:28:38.289 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65d40763:::benchmark_data_smithi188_77607_object111038:head# 2024-04-01T19:28:38.289 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65d55d25:::benchmark_data_smithi188_77607_object125136:head# 2024-04-01T19:28:38.290 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65d5fcdf:::benchmark_data_smithi188_77607_object132133:head# 2024-04-01T19:28:38.290 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65d6673a:::benchmark_data_smithi188_77607_object104008:head# 2024-04-01T19:28:38.291 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65d875a5:::benchmark_data_smithi188_77607_object118375:head# 2024-04-01T19:28:38.291 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65d8db04:::benchmark_data_smithi188_77607_object160554:head# 2024-04-01T19:28:38.292 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65d901d2:::benchmark_data_smithi188_77607_object162196:head# 2024-04-01T19:28:38.292 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65dcbf05:::benchmark_data_smithi188_77607_object99380:head# 2024-04-01T19:28:38.292 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65de68d6:::benchmark_data_smithi188_77607_object156979:head# 2024-04-01T19:28:38.293 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65dee262:::benchmark_data_smithi188_77607_object103616:head# 2024-04-01T19:28:38.293 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65df3d35:::benchmark_data_smithi188_77607_object116565:head# 2024-04-01T19:28:38.294 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65e05827:::benchmark_data_smithi188_77607_object140231:head# 2024-04-01T19:28:38.294 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65e099e5:::benchmark_data_smithi188_77607_object156336:head# 2024-04-01T19:28:38.295 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65e0c957:::benchmark_data_smithi188_77607_object143681:head# 2024-04-01T19:28:38.295 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65e157ff:::benchmark_data_smithi188_77607_object109790:head# 2024-04-01T19:28:38.296 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65e1f340:::benchmark_data_smithi188_77607_object137847:head# 2024-04-01T19:28:38.296 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65e45fa2:::benchmark_data_smithi188_77607_object122699:head# 2024-04-01T19:28:38.297 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65e46d62:::benchmark_data_smithi188_77607_object138189:head# 2024-04-01T19:28:38.297 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65e4df43:::benchmark_data_smithi188_77607_object103246:head# 2024-04-01T19:28:38.297 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65e625bf:::benchmark_data_smithi188_77607_object158730:head# 2024-04-01T19:28:38.298 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65e77515:::benchmark_data_smithi188_77607_object105435:head# 2024-04-01T19:28:38.298 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65ea2c50:::benchmark_data_smithi188_77607_object138125:head# 2024-04-01T19:28:38.299 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65eb0f59:::benchmark_data_smithi188_77607_object142991:head# 2024-04-01T19:28:38.299 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65ebc220:::benchmark_data_smithi188_77607_object145507:head# 2024-04-01T19:28:38.300 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65ebec52:::benchmark_data_smithi188_77607_object121075:head# 2024-04-01T19:28:38.300 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65ecf38e:::benchmark_data_smithi188_77607_object109930:head# 2024-04-01T19:28:38.301 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65ed636c:::benchmark_data_smithi188_77607_object144909:head# 2024-04-01T19:28:38.301 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65ef4abe:::benchmark_data_smithi188_77607_object145958:head# 2024-04-01T19:28:38.301 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65f0b03f:::benchmark_data_smithi188_77607_object152477:head# 2024-04-01T19:28:38.302 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65f22737:::benchmark_data_smithi188_77607_object113270:head# 2024-04-01T19:28:38.302 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65f4ffff:::benchmark_data_smithi188_77607_object109241:head# 2024-04-01T19:28:38.303 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65f57a98:::benchmark_data_smithi188_77607_object154355:head# 2024-04-01T19:28:38.303 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65f59903:::benchmark_data_smithi188_77607_object137957:head# 2024-04-01T19:28:38.304 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65f5ad50:::benchmark_data_smithi188_77607_object123719:head# 2024-04-01T19:28:38.304 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65f74bcf:::benchmark_data_smithi188_77607_object157816:head# 2024-04-01T19:28:38.305 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65f75461:::benchmark_data_smithi188_77607_object159418:head# 2024-04-01T19:28:38.305 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65f8f6fe:::benchmark_data_smithi188_77607_object161350:head# 2024-04-01T19:28:38.306 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65fab33f:::benchmark_data_smithi188_77607_object122206:head# 2024-04-01T19:28:38.306 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65fb1e6e:::benchmark_data_smithi188_77607_object114773:head# 2024-04-01T19:28:38.306 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65fbb33f:::benchmark_data_smithi188_77607_object102840:head# 2024-04-01T19:28:38.307 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65fc56b9:::benchmark_data_smithi188_77607_object98660:head# 2024-04-01T19:28:38.307 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65fe37f1:::benchmark_data_smithi188_77607_object138566:head# 2024-04-01T19:28:38.308 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:65fe4bee:::benchmark_data_smithi188_77607_object125474:head# 2024-04-01T19:28:38.308 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6600987b:::benchmark_data_smithi188_77607_object137251:head# 2024-04-01T19:28:38.309 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66015279:::benchmark_data_smithi188_77607_object115706:head# 2024-04-01T19:28:38.309 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:660328f1:::benchmark_data_smithi188_77607_object122789:head# 2024-04-01T19:28:38.310 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66032aa2:::benchmark_data_smithi188_77607_object115074:head# 2024-04-01T19:28:38.310 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6605434f:::benchmark_data_smithi188_77607_object166649:head# 2024-04-01T19:28:38.311 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6605a2b4:::benchmark_data_smithi188_77607_object146111:head# 2024-04-01T19:28:38.311 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:660812ad:::benchmark_data_smithi188_77607_object120540:head# 2024-04-01T19:28:38.312 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:660868bf:::benchmark_data_smithi188_77607_object107349:head# 2024-04-01T19:28:38.312 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6608d0b3:::benchmark_data_smithi188_77607_object124480:head# 2024-04-01T19:28:38.312 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:660ac038:::benchmark_data_smithi188_77607_object120272:head# 2024-04-01T19:28:38.313 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:660b1c75:::benchmark_data_smithi188_77607_object101676:head# 2024-04-01T19:28:38.313 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:660b950a:::benchmark_data_smithi188_77607_object110672:head# 2024-04-01T19:28:38.314 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:660c6429:::benchmark_data_smithi188_77607_object111698:head# 2024-04-01T19:28:38.314 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:660cfe51:::benchmark_data_smithi188_77607_object111056:head# 2024-04-01T19:28:38.315 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:660d3244:::benchmark_data_smithi188_77607_object162664:head# 2024-04-01T19:28:38.315 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:660ec209:::benchmark_data_smithi188_77607_object151907:head# 2024-04-01T19:28:38.316 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:660ef8a3:::benchmark_data_smithi188_77607_object142759:head# 2024-04-01T19:28:38.316 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:660f2ac7:::benchmark_data_smithi188_77607_object118607:head# 2024-04-01T19:28:38.317 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66104804:::benchmark_data_smithi188_77607_object154643:head# 2024-04-01T19:28:38.317 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6610b201:::benchmark_data_smithi188_77607_object163809:head# 2024-04-01T19:28:38.318 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6610b318:::benchmark_data_smithi188_77607_object119080:head# 2024-04-01T19:28:38.318 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66113e3e:::benchmark_data_smithi188_77607_object98376:head# 2024-04-01T19:28:38.319 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6612467f:::benchmark_data_smithi188_77607_object162414:head# 2024-04-01T19:28:38.319 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:661285fc:::benchmark_data_smithi188_77607_object134524:head# 2024-04-01T19:28:38.319 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:661316c4:::benchmark_data_smithi188_77607_object162954:head# 2024-04-01T19:28:38.320 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66139a3b:::benchmark_data_smithi188_77607_object110414:head# 2024-04-01T19:28:38.320 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66145c6e:::benchmark_data_smithi188_77607_object130835:head# 2024-04-01T19:28:38.321 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6614d4ef:::benchmark_data_smithi188_77607_object137539:head# 2024-04-01T19:28:38.321 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6614f772:::benchmark_data_smithi188_77607_object115891:head# 2024-04-01T19:28:38.322 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66154cec:::benchmark_data_smithi188_77607_object121684:head# 2024-04-01T19:28:38.322 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66159efd:::benchmark_data_smithi188_77607_object140107:head# 2024-04-01T19:28:38.322 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:661631d4:::benchmark_data_smithi188_77607_object127207:head# 2024-04-01T19:28:38.323 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6616b41c:::benchmark_data_smithi188_77607_object130792:head# 2024-04-01T19:28:38.323 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6616c5e9:::benchmark_data_smithi188_77607_object114087:head# 2024-04-01T19:28:38.324 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66176bf5:::benchmark_data_smithi188_77607_object125055:head# 2024-04-01T19:28:38.324 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6617c9bc:::benchmark_data_smithi188_77607_object102693:head# 2024-04-01T19:28:38.325 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66183b62:::benchmark_data_smithi188_77607_object114038:head# 2024-04-01T19:28:38.325 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66185767:::benchmark_data_smithi188_77607_object167038:head# 2024-04-01T19:28:38.326 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66199d87:::benchmark_data_smithi188_77607_object150374:head# 2024-04-01T19:28:38.326 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:661a2eda:::benchmark_data_smithi188_77607_object158484:head# 2024-04-01T19:28:38.327 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:661a4628:::benchmark_data_smithi188_77607_object134488:head# 2024-04-01T19:28:38.327 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:661ab4e3:::benchmark_data_smithi188_77607_object124926:head# 2024-04-01T19:28:38.327 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:661c62d8:::benchmark_data_smithi188_77607_object108004:head# 2024-04-01T19:28:38.328 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:661dae6a:::benchmark_data_smithi188_77607_object152800:head# 2024-04-01T19:28:38.328 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66203230:::benchmark_data_smithi188_77607_object112196:head# 2024-04-01T19:28:38.329 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66222b22:::benchmark_data_smithi188_77607_object146155:head# 2024-04-01T19:28:38.329 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66266e5d:::benchmark_data_smithi188_77607_object136616:head# 2024-04-01T19:28:38.330 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66269b83:::benchmark_data_smithi188_77607_object165997:head# 2024-04-01T19:28:38.330 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6627e29f:::benchmark_data_smithi188_77607_object141174:head# 2024-04-01T19:28:38.331 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6628c8fd:::benchmark_data_smithi188_77607_object123770:head# 2024-04-01T19:28:38.331 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66293d09:::benchmark_data_smithi188_77607_object117293:head# 2024-04-01T19:28:38.332 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:662af6f2:::benchmark_data_smithi188_77607_object124306:head# 2024-04-01T19:28:38.332 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:662b30d4:::benchmark_data_smithi188_77607_object104162:head# 2024-04-01T19:28:38.332 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:662b5247:::benchmark_data_smithi188_77607_object161781:head# 2024-04-01T19:28:38.333 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:662b9e3f:::benchmark_data_smithi188_77607_object142252:head# 2024-04-01T19:28:38.333 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:662c31c3:::benchmark_data_smithi188_77607_object143300:head# 2024-04-01T19:28:38.334 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:662c3c05:::benchmark_data_smithi188_77607_object112935:head# 2024-04-01T19:28:38.334 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:662c5b84:::benchmark_data_smithi188_77607_object149946:head# 2024-04-01T19:28:38.335 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:662d0718:::benchmark_data_smithi188_77607_object98674:head# 2024-04-01T19:28:38.335 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:662e4f3c:::benchmark_data_smithi188_77607_object158864:head# 2024-04-01T19:28:38.335 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:662edc5b:::benchmark_data_smithi188_77607_object124551:head# 2024-04-01T19:28:38.336 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66303bfa:::benchmark_data_smithi188_77607_object144066:head# 2024-04-01T19:28:38.337 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66351cd9:::benchmark_data_smithi188_77607_object129558:head# 2024-04-01T19:28:38.337 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:663560de:::benchmark_data_smithi188_77607_object125169:head# 2024-04-01T19:28:38.337 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6639dcc1:::benchmark_data_smithi188_77607_object159152:head# 2024-04-01T19:28:38.338 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:663a0761:::benchmark_data_smithi188_77607_object118283:head# 2024-04-01T19:28:38.338 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:663af5d7:::benchmark_data_smithi188_77607_object132817:head# 2024-04-01T19:28:38.339 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:663af81f:::benchmark_data_smithi188_77607_object116464:head# 2024-04-01T19:28:38.339 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:663b080b:::benchmark_data_smithi188_77607_object121160:head# 2024-04-01T19:28:38.340 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:663bf021:::benchmark_data_smithi188_77607_object140414:head# 2024-04-01T19:28:38.340 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:663cc75b:::benchmark_data_smithi188_77607_object143082:head# 2024-04-01T19:28:38.341 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:663ddfeb:::benchmark_data_smithi188_77607_object157607:head# 2024-04-01T19:28:38.341 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:663fac98:::benchmark_data_smithi188_77607_object165333:head# 2024-04-01T19:28:38.342 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6641c8d7:::benchmark_data_smithi188_77607_object116580:head# 2024-04-01T19:28:38.342 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6643cf3f:::benchmark_data_smithi188_77607_object148356:head# 2024-04-01T19:28:38.342 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66440e08:::benchmark_data_smithi188_77607_object138535:head# 2024-04-01T19:28:38.343 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:664546a3:::benchmark_data_smithi188_77607_object138152:head# 2024-04-01T19:28:38.343 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:664549aa:::benchmark_data_smithi188_77607_object107516:head# 2024-04-01T19:28:38.344 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6646d6a9:::benchmark_data_smithi188_77607_object101109:head# 2024-04-01T19:28:38.344 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6647e228:::benchmark_data_smithi188_77607_object120911:head# 2024-04-01T19:28:38.345 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66484db8:::benchmark_data_smithi188_77607_object144082:head# 2024-04-01T19:28:38.345 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6648c6df:::benchmark_data_smithi188_77607_object99474:head# 2024-04-01T19:28:38.346 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6649073a:::benchmark_data_smithi188_77607_object140909:head# 2024-04-01T19:28:38.346 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66496cef:::benchmark_data_smithi188_77607_object164716:head# 2024-04-01T19:28:38.347 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:664bf749:::benchmark_data_smithi188_77607_object110310:head# 2024-04-01T19:28:38.347 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:664c1a46:::benchmark_data_smithi188_77607_object157094:head# 2024-04-01T19:28:38.348 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:664cb55d:::benchmark_data_smithi188_77607_object153588:head# 2024-04-01T19:28:38.348 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:664cc234:::benchmark_data_smithi188_77607_object142655:head# 2024-04-01T19:28:38.349 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:664dc642:::benchmark_data_smithi188_77607_object165914:head# 2024-04-01T19:28:38.349 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:664f2555:::benchmark_data_smithi188_77607_object128578:head# 2024-04-01T19:28:38.350 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:664f5522:::benchmark_data_smithi188_77607_object156230:head# 2024-04-01T19:28:38.350 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:664fb77b:::benchmark_data_smithi188_77607_object108136:head# 2024-04-01T19:28:38.350 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:664fefc0:::benchmark_data_smithi188_77607_object143406:head# 2024-04-01T19:28:38.351 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6650af52:::benchmark_data_smithi188_77607_object100214:head# 2024-04-01T19:28:38.351 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66514551:::benchmark_data_smithi188_77607_object134512:head# 2024-04-01T19:28:38.352 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6651cbf7:::benchmark_data_smithi188_77607_object118983:head# 2024-04-01T19:28:38.352 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6651db3c:::benchmark_data_smithi188_77607_object126586:head# 2024-04-01T19:28:38.352 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6654f7bd:::benchmark_data_smithi188_77607_object118432:head# 2024-04-01T19:28:38.353 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:665569c6:::benchmark_data_smithi188_77607_object111727:head# 2024-04-01T19:28:38.353 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66594cec:::benchmark_data_smithi188_77607_object167113:head# 2024-04-01T19:28:38.354 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6659899f:::benchmark_data_smithi188_77607_object143123:head# 2024-04-01T19:28:38.354 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:665a31be:::benchmark_data_smithi188_77607_object149016:head# 2024-04-01T19:28:38.355 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:665b46fe:::benchmark_data_smithi188_77607_object162168:head# 2024-04-01T19:28:38.355 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:665b6305:::benchmark_data_smithi188_77607_object150039:head# 2024-04-01T19:28:38.356 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:665c3ad2:::benchmark_data_smithi188_77607_object119573:head# 2024-04-01T19:28:38.356 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:665c8b08:::benchmark_data_smithi188_77607_object140806:head# 2024-04-01T19:28:38.357 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:665ccca2:::benchmark_data_smithi188_77607_object154130:head# 2024-04-01T19:28:38.357 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:665cd465:::benchmark_data_smithi188_77607_object122979:head# 2024-04-01T19:28:38.357 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:665eb99c:::benchmark_data_smithi188_77607_object98141:head# 2024-04-01T19:28:38.358 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6661fc83:::benchmark_data_smithi188_77607_object128850:head# 2024-04-01T19:28:38.358 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6662b4ba:::benchmark_data_smithi188_77607_object156689:head# 2024-04-01T19:28:38.359 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6663f558:::benchmark_data_smithi188_77607_object124732:head# 2024-04-01T19:28:38.359 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6664eedb:::benchmark_data_smithi188_77607_object141020:head# 2024-04-01T19:28:38.360 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:666527b8:::benchmark_data_smithi188_77607_object124581:head# 2024-04-01T19:28:38.360 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:666571be:::benchmark_data_smithi188_77607_object115800:head# 2024-04-01T19:28:38.361 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66657970:::benchmark_data_smithi188_77607_object143015:head# 2024-04-01T19:28:38.361 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66657d90:::benchmark_data_smithi188_77607_object157035:head# 2024-04-01T19:28:38.362 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66660cb9:::benchmark_data_smithi188_77607_object155262:head# 2024-04-01T19:28:38.362 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:666838a2:::benchmark_data_smithi188_77607_object109430:head# 2024-04-01T19:28:38.362 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:28:38.363 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:666a7465:::benchmark_data_smithi188_77607_object165372:head# 2024-04-01T19:28:38.363 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:666db89b:::benchmark_data_smithi188_77607_object143461:head# 2024-04-01T19:28:38.363 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:666f0644:::benchmark_data_smithi188_77607_object118577:head# 2024-04-01T19:28:38.364 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:666f797b:::benchmark_data_smithi188_77607_object138031:head# 2024-04-01T19:28:38.364 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66709e3a:::benchmark_data_smithi188_77607_object110116:head# 2024-04-01T19:28:38.365 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:38.365 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:28:38.366 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6670f609:::benchmark_data_smithi188_77607_object116763:head# 2024-04-01T19:28:38.366 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6671243d:::benchmark_data_smithi188_77607_object157026:head# 2024-04-01T19:28:38.366 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6671583d:::benchmark_data_smithi188_77607_object135059:head# 2024-04-01T19:28:38.366 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6671d160:::benchmark_data_smithi188_77607_object115737:head# 2024-04-01T19:28:38.366 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66727458:::benchmark_data_smithi188_77607_object116854:head# 2024-04-01T19:28:38.367 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66729101:::benchmark_data_smithi188_77607_object144646:head# 2024-04-01T19:28:38.367 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6673c32b:::benchmark_data_smithi188_77607_object157169:head# 2024-04-01T19:28:38.368 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6674b766:::benchmark_data_smithi188_77607_object109571:head# 2024-04-01T19:28:38.368 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66751fc4:::benchmark_data_smithi188_77607_object154502:head# 2024-04-01T19:28:38.369 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6675bf5d:::benchmark_data_smithi188_77607_object133605:head# 2024-04-01T19:28:38.369 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6675db62:::benchmark_data_smithi188_77607_object112961:head# 2024-04-01T19:28:38.370 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6676774f:::benchmark_data_smithi188_77607_object130172:head# 2024-04-01T19:28:38.370 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6676ee8a:::benchmark_data_smithi188_77607_object136892:head# 2024-04-01T19:28:38.370 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:667783ff:::benchmark_data_smithi188_77607_object126058:head# 2024-04-01T19:28:38.371 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66780663:::benchmark_data_smithi188_77607_object121884:head# 2024-04-01T19:28:38.371 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66788749:::benchmark_data_smithi188_77607_object129888:head# 2024-04-01T19:28:38.372 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:667b4a9d:::benchmark_data_smithi188_77607_object126396:head# 2024-04-01T19:28:38.372 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:667cabf5:::benchmark_data_smithi188_77607_object130429:head# 2024-04-01T19:28:38.373 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6681a9ad:::benchmark_data_smithi188_77607_object142112:head# 2024-04-01T19:28:38.373 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6683a505:::benchmark_data_smithi188_77607_object107763:head# 2024-04-01T19:28:38.374 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:668558bc:::benchmark_data_smithi188_77607_object100074:head# 2024-04-01T19:28:38.374 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6688217b:::benchmark_data_smithi188_77607_object131234:head# 2024-04-01T19:28:38.375 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6688bc2d:::benchmark_data_smithi188_77607_object151258:head# 2024-04-01T19:28:38.375 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6689b82a:::benchmark_data_smithi188_77607_object133699:head# 2024-04-01T19:28:38.376 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:668ac6ba:::benchmark_data_smithi188_77607_object109640:head# 2024-04-01T19:28:38.376 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:668c73df:::benchmark_data_smithi188_77607_object113991:head# 2024-04-01T19:28:38.376 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:668cfb61:::benchmark_data_smithi188_77607_object103585:head# 2024-04-01T19:28:38.377 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:668d9b89:::benchmark_data_smithi188_77607_object107217:head# 2024-04-01T19:28:38.379 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:668e09f6:::benchmark_data_smithi188_77607_object131213:head# 2024-04-01T19:28:38.379 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:668e60e4:::benchmark_data_smithi188_77607_object106830:head# 2024-04-01T19:28:38.380 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:668f0336:::benchmark_data_smithi188_77607_object143136:head# 2024-04-01T19:28:38.380 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:668f9ab3:::benchmark_data_smithi188_77607_object159850:head# 2024-04-01T19:28:38.381 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6690b365:::benchmark_data_smithi188_77607_object121179:head# 2024-04-01T19:28:38.381 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66924b00:::benchmark_data_smithi188_77607_object120468:head# 2024-04-01T19:28:38.381 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:669601f7:::benchmark_data_smithi188_77607_object130228:head# 2024-04-01T19:28:38.382 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66975a77:::benchmark_data_smithi188_77607_object157915:head# 2024-04-01T19:28:38.382 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6697fd28:::benchmark_data_smithi188_77607_object153160:head# 2024-04-01T19:28:38.383 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66993d60:::benchmark_data_smithi188_77607_object107206:head# 2024-04-01T19:28:38.383 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6699a5a9:::benchmark_data_smithi188_77607_object146456:head# 2024-04-01T19:28:38.384 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:669a8074:::benchmark_data_smithi188_77607_object109035:head# 2024-04-01T19:28:38.384 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:669b591b:::benchmark_data_smithi188_77607_object150986:head# 2024-04-01T19:28:38.385 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:669b8dcb:::benchmark_data_smithi188_77607_object101210:head# 2024-04-01T19:28:38.385 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:669c07c2:::benchmark_data_smithi188_77607_object113547:head# 2024-04-01T19:28:38.385 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:669c495c:::benchmark_data_smithi188_77607_object147001:head# 2024-04-01T19:28:38.386 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:669d24c2:::benchmark_data_smithi188_77607_object110204:head# 2024-04-01T19:28:38.386 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:669d2f73:::benchmark_data_smithi188_77607_object147511:head# 2024-04-01T19:28:38.387 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:669d90f0:::benchmark_data_smithi188_77607_object159992:head# 2024-04-01T19:28:38.387 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:669e951b:::benchmark_data_smithi188_77607_object114151:head# 2024-04-01T19:28:38.388 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66a03039:::benchmark_data_smithi188_77607_object155505:head# 2024-04-01T19:28:38.388 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66a050f9:::benchmark_data_smithi188_77607_object159942:head# 2024-04-01T19:28:38.388 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66a0bcf9:::benchmark_data_smithi188_77607_object113593:head# 2024-04-01T19:28:38.389 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66a218d8:::benchmark_data_smithi188_77607_object166581:head# 2024-04-01T19:28:38.389 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66a26445:::benchmark_data_smithi188_77607_object128220:head# 2024-04-01T19:28:38.390 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66a2842b:::benchmark_data_smithi188_77607_object158762:head# 2024-04-01T19:28:38.391 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66a30436:::benchmark_data_smithi188_77607_object153111:head# 2024-04-01T19:28:38.391 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66a79ed2:::benchmark_data_smithi188_77607_object161383:head# 2024-04-01T19:28:38.391 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66a8ece0:::benchmark_data_smithi188_77607_object116688:head# 2024-04-01T19:28:38.392 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66a9f934:::benchmark_data_smithi188_77607_object148032:head# 2024-04-01T19:28:38.392 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66aad4ff:::benchmark_data_smithi188_77607_object114561:head# 2024-04-01T19:28:38.393 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66ab7766:::benchmark_data_smithi188_77607_object142632:head# 2024-04-01T19:28:38.393 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66ad233d:::benchmark_data_smithi188_77607_object124969:head# 2024-04-01T19:28:38.394 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66ad2f02:::benchmark_data_smithi188_77607_object135717:head# 2024-04-01T19:28:38.394 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66adea05:::benchmark_data_smithi188_77607_object166611:head# 2024-04-01T19:28:38.394 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66ae6090:::benchmark_data_smithi188_77607_object110059:head# 2024-04-01T19:28:38.395 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66b010d2:::benchmark_data_smithi188_77607_object120081:head# 2024-04-01T19:28:38.395 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66b13bd5:::benchmark_data_smithi188_77607_object120041:head# 2024-04-01T19:28:38.396 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66b19e25:::benchmark_data_smithi188_77607_object161616:head# 2024-04-01T19:28:38.396 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66b53b90:::benchmark_data_smithi188_77607_object163090:head# 2024-04-01T19:28:38.397 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66b5e4ea:::benchmark_data_smithi188_77607_object117275:head# 2024-04-01T19:28:38.397 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66b64445:::benchmark_data_smithi188_77607_object123474:head# 2024-04-01T19:28:38.398 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66b645ba:::benchmark_data_smithi188_77607_object104761:head# 2024-04-01T19:28:38.398 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66b68513:::benchmark_data_smithi188_77607_object118542:head# 2024-04-01T19:28:38.399 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66b68e5b:::benchmark_data_smithi188_77607_object141543:head# 2024-04-01T19:28:38.399 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66b95bd7:::benchmark_data_smithi188_77607_object123759:head# 2024-04-01T19:28:38.400 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66ba29dd:::benchmark_data_smithi188_77607_object118803:head# 2024-04-01T19:28:38.400 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66ba561d:::benchmark_data_smithi188_77607_object131972:head# 2024-04-01T19:28:38.400 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66ba899c:::benchmark_data_smithi188_77607_object132001:head# 2024-04-01T19:28:38.401 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66bc0b9d:::benchmark_data_smithi188_77607_object150890:head# 2024-04-01T19:28:38.401 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66bc68f1:::benchmark_data_smithi188_77607_object135779:head# 2024-04-01T19:28:38.402 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66bcdb04:::benchmark_data_smithi188_77607_object144060:head# 2024-04-01T19:28:38.403 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66be2194:::benchmark_data_smithi188_77607_object150577:head# 2024-04-01T19:28:38.403 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66beed5c:::benchmark_data_smithi188_77607_object114117:head# 2024-04-01T19:28:38.403 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66bf3244:::benchmark_data_smithi188_77607_object155220:head# 2024-04-01T19:28:38.404 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66c006e6:::benchmark_data_smithi188_77607_object107123:head# 2024-04-01T19:28:38.404 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66c007d0:::benchmark_data_smithi188_77607_object101763:head# 2024-04-01T19:28:38.405 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66c13fef:::benchmark_data_smithi188_77607_object162612:head# 2024-04-01T19:28:38.405 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66c3e4b8:::benchmark_data_smithi188_77607_object150825:head# 2024-04-01T19:28:38.406 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66c3eedf:::benchmark_data_smithi188_77607_object100569:head# 2024-04-01T19:28:38.406 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66c411d6:::benchmark_data_smithi188_77607_object141512:head# 2024-04-01T19:28:38.407 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66c464f7:::benchmark_data_smithi188_77607_object118661:head# 2024-04-01T19:28:38.407 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66c47de5:::benchmark_data_smithi188_77607_object145350:head# 2024-04-01T19:28:38.407 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66c498f2:::benchmark_data_smithi188_77607_object157496:head# 2024-04-01T19:28:38.408 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66c4acd0:::benchmark_data_smithi188_77607_object112362:head# 2024-04-01T19:28:38.408 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66c5f6c5:::benchmark_data_smithi188_77607_object125849:head# 2024-04-01T19:28:38.409 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66c62e24:::benchmark_data_smithi188_77607_object147284:head# 2024-04-01T19:28:38.409 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66c6e459:::benchmark_data_smithi188_77607_object101096:head# 2024-04-01T19:28:38.410 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66c84be9:::benchmark_data_smithi188_77607_object106187:head# 2024-04-01T19:28:38.410 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66cc0397:::benchmark_data_smithi188_77607_object156548:head# 2024-04-01T19:28:38.411 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66cd10ab:::benchmark_data_smithi188_77607_object165029:head# 2024-04-01T19:28:38.411 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66cd471c:::benchmark_data_smithi188_77607_object98297:head# 2024-04-01T19:28:38.412 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66cebef0:::benchmark_data_smithi188_77607_object137682:head# 2024-04-01T19:28:38.412 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66d1373e:::benchmark_data_smithi188_77607_object122531:head# 2024-04-01T19:28:38.413 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66d3a65e:::benchmark_data_smithi188_77607_object142669:head# 2024-04-01T19:28:38.413 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66d4412f:::benchmark_data_smithi188_77607_object119382:head# 2024-04-01T19:28:38.413 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66d48056:::benchmark_data_smithi188_77607_object155518:head# 2024-04-01T19:28:38.414 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66d5a068:::benchmark_data_smithi188_77607_object131785:head# 2024-04-01T19:28:38.414 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66d5e8dd:::benchmark_data_smithi188_77607_object129477:head# 2024-04-01T19:28:38.415 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66d625f9:::benchmark_data_smithi188_77607_object158483:head# 2024-04-01T19:28:38.415 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66d6f6a0:::benchmark_data_smithi188_77607_object103572:head# 2024-04-01T19:28:38.416 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66d8d493:::benchmark_data_smithi188_77607_object139409:head# 2024-04-01T19:28:38.416 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66d90de3:::benchmark_data_smithi188_77607_object127699:head# 2024-04-01T19:28:38.416 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66da49f9:::benchmark_data_smithi188_77607_object102630:head# 2024-04-01T19:28:38.417 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66dad271:::benchmark_data_smithi188_77607_object161058:head# 2024-04-01T19:28:38.417 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66dbd210:::benchmark_data_smithi188_77607_object166984:head# 2024-04-01T19:28:38.418 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66dc2332:::benchmark_data_smithi188_77607_object124761:head# 2024-04-01T19:28:38.418 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66dc3acf:::benchmark_data_smithi188_77607_object157304:head# 2024-04-01T19:28:38.419 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66dcccca:::benchmark_data_smithi188_77607_object132647:head# 2024-04-01T19:28:38.419 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66ddab79:::benchmark_data_smithi188_77607_object130733:head# 2024-04-01T19:28:38.420 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66df8ce7:::benchmark_data_smithi188_77607_object132206:head# 2024-04-01T19:28:38.420 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66dfa998:::benchmark_data_smithi188_77607_object120721:head# 2024-04-01T19:28:38.421 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66dfec73:::benchmark_data_smithi188_77607_object118566:head# 2024-04-01T19:28:38.421 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66dffef4:::benchmark_data_smithi188_77607_object158416:head# 2024-04-01T19:28:38.421 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66e009e3:::benchmark_data_smithi188_77607_object165585:head# 2024-04-01T19:28:38.422 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66e08cef:::benchmark_data_smithi188_77607_object110892:head# 2024-04-01T19:28:38.422 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66e251cc:::benchmark_data_smithi188_77607_object148339:head# 2024-04-01T19:28:38.423 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66e2c400:::benchmark_data_smithi188_77607_object136706:head# 2024-04-01T19:28:38.423 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66e2e74c:::benchmark_data_smithi188_77607_object103380:head# 2024-04-01T19:28:38.424 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66e34a64:::benchmark_data_smithi188_77607_object156541:head# 2024-04-01T19:28:38.424 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66e3c94e:::benchmark_data_smithi188_77607_object101467:head# 2024-04-01T19:28:38.425 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66e48de7:::benchmark_data_smithi188_77607_object145927:head# 2024-04-01T19:28:38.425 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66e4ab29:::benchmark_data_smithi188_77607_object133750:head# 2024-04-01T19:28:38.426 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66e519d3:::benchmark_data_smithi188_77607_object141749:head# 2024-04-01T19:28:38.426 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66e532a1:::benchmark_data_smithi188_77607_object120866:head# 2024-04-01T19:28:38.427 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66e5b652:::benchmark_data_smithi188_77607_object165320:head# 2024-04-01T19:28:38.428 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66e68852:::benchmark_data_smithi188_77607_object155158:head# 2024-04-01T19:28:38.428 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66e724cc:::benchmark_data_smithi188_77607_object119347:head# 2024-04-01T19:28:38.428 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66e85fc8:::benchmark_data_smithi188_77607_object108657:head# 2024-04-01T19:28:38.429 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66e89699:::benchmark_data_smithi188_77607_object161724:head# 2024-04-01T19:28:38.430 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66ea354a:::benchmark_data_smithi188_77607_object147276:head# 2024-04-01T19:28:38.430 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66eade61:::benchmark_data_smithi188_77607_object164134:head# 2024-04-01T19:28:38.431 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66ec95c8:::benchmark_data_smithi188_77607_object128184:head# 2024-04-01T19:28:38.431 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66ee4564:::benchmark_data_smithi188_77607_object132111:head# 2024-04-01T19:28:38.431 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66ee7297:::benchmark_data_smithi188_77607_object109131:head# 2024-04-01T19:28:38.432 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66f26f49:::benchmark_data_smithi188_77607_object132193:head# 2024-04-01T19:28:38.432 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66f5a59b:::benchmark_data_smithi188_77607_object146415:head# 2024-04-01T19:28:38.433 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66f839ab:::benchmark_data_smithi188_77607_object155242:head# 2024-04-01T19:28:38.434 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66f849b7:::benchmark_data_smithi188_77607_object129689:head# 2024-04-01T19:28:38.434 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66f8aca8:::benchmark_data_smithi188_77607_object127612:head# 2024-04-01T19:28:38.434 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66f8d661:::benchmark_data_smithi188_77607_object103093:head# 2024-04-01T19:28:38.435 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66f8e9eb:::benchmark_data_smithi188_77607_object125763:head# 2024-04-01T19:28:38.435 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66f9cb81:::benchmark_data_smithi188_77607_object121249:head# 2024-04-01T19:28:38.436 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66fa2636:::benchmark_data_smithi188_77607_object156483:head# 2024-04-01T19:28:38.436 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66fb7559:::benchmark_data_smithi188_77607_object127336:head# 2024-04-01T19:28:38.437 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66fb87ea:::benchmark_data_smithi188_77607_object117559:head# 2024-04-01T19:28:38.437 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66fc9dd1:::benchmark_data_smithi188_77607_object144100:head# 2024-04-01T19:28:38.438 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66fcc38d:::benchmark_data_smithi188_77607_object106655:head# 2024-04-01T19:28:38.438 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66fcce14:::benchmark_data_smithi188_77607_object114285:head# 2024-04-01T19:28:38.439 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66fd0b8b:::benchmark_data_smithi188_77607_object164880:head# 2024-04-01T19:28:38.439 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66fd0df8:::benchmark_data_smithi188_77607_object126436:head# 2024-04-01T19:28:38.440 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66fd8d28:::benchmark_data_smithi188_77607_object127284:head# 2024-04-01T19:28:38.440 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:66fdb2ba:::benchmark_data_smithi188_77607_object117769:head# 2024-04-01T19:28:38.440 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6704f3b1:::benchmark_data_smithi188_77607_object105562:head# 2024-04-01T19:28:38.441 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6705c033:::benchmark_data_smithi188_77607_object124990:head# 2024-04-01T19:28:38.441 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67064c71:::benchmark_data_smithi188_77607_object104457:head# 2024-04-01T19:28:38.442 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:670816ec:::benchmark_data_smithi188_77607_object120258:head# 2024-04-01T19:28:38.442 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6708c556:::benchmark_data_smithi188_77607_object161418:head# 2024-04-01T19:28:38.443 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6709bbf8:::benchmark_data_smithi188_77607_object125177:head# 2024-04-01T19:28:38.443 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:670a9ae6:::benchmark_data_smithi188_77607_object141830:head# 2024-04-01T19:28:38.443 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:670c087e:::benchmark_data_smithi188_77607_object112519:head# 2024-04-01T19:28:38.444 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:670c707e:::benchmark_data_smithi188_77607_object101447:head# 2024-04-01T19:28:38.444 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:670e5078:::benchmark_data_smithi188_77607_object156624:head# 2024-04-01T19:28:38.445 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:670ec63a:::benchmark_data_smithi188_77607_object129859:head# 2024-04-01T19:28:38.445 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:671060ae:::benchmark_data_smithi188_77607_object155593:head# 2024-04-01T19:28:38.446 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6710919c:::benchmark_data_smithi188_77607_object106417:head# 2024-04-01T19:28:38.446 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67116882:::benchmark_data_smithi188_77607_object153365:head# 2024-04-01T19:28:38.447 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67131e8b:::benchmark_data_smithi188_77607_object161118:head# 2024-04-01T19:28:38.447 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6714a71a:::benchmark_data_smithi188_77607_object109487:head# 2024-04-01T19:28:38.448 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6715be43:::benchmark_data_smithi188_77607_object141470:head# 2024-04-01T19:28:38.448 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6717666d:::benchmark_data_smithi188_77607_object124443:head# 2024-04-01T19:28:38.449 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6717c160:::benchmark_data_smithi188_77607_object102338:head# 2024-04-01T19:28:38.449 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:671850de:::benchmark_data_smithi188_77607_object153297:head# 2024-04-01T19:28:38.450 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:671a061d:::benchmark_data_smithi188_77607_object128342:head# 2024-04-01T19:28:38.450 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:671a6f68:::benchmark_data_smithi188_77607_object131295:head# 2024-04-01T19:28:38.450 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:671a7a2c:::benchmark_data_smithi188_77607_object161470:head# 2024-04-01T19:28:38.451 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:671d1d6b:::benchmark_data_smithi188_77607_object165071:head# 2024-04-01T19:28:38.451 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:671d3c41:::benchmark_data_smithi188_77607_object152062:head# 2024-04-01T19:28:38.452 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:671edb34:::benchmark_data_smithi188_77607_object114666:head# 2024-04-01T19:28:38.452 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:671f116f:::benchmark_data_smithi188_77607_object119020:head# 2024-04-01T19:28:38.453 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:671f1d6f:::benchmark_data_smithi188_77607_object111682:head# 2024-04-01T19:28:38.453 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:671f53c3:::benchmark_data_smithi188_77607_object107978:head# 2024-04-01T19:28:38.454 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:671f9c00:::benchmark_data_smithi188_77607_object121078:head# 2024-04-01T19:28:38.454 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67201727:::benchmark_data_smithi188_77607_object112327:head# 2024-04-01T19:28:38.455 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6721a77b:::benchmark_data_smithi188_77607_object136780:head# 2024-04-01T19:28:38.455 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67233949:::benchmark_data_smithi188_77607_object144001:head# 2024-04-01T19:28:38.456 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:672572da:::benchmark_data_smithi188_77607_object148617:head# 2024-04-01T19:28:38.456 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67273978:::benchmark_data_smithi188_77607_object128612:head# 2024-04-01T19:28:38.456 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67279308:::benchmark_data_smithi188_77607_object150905:head# 2024-04-01T19:28:38.457 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6728f342:::benchmark_data_smithi188_77607_object135345:head# 2024-04-01T19:28:38.457 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:672918d6:::benchmark_data_smithi188_77607_object136478:head# 2024-04-01T19:28:38.458 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6729cf03:::benchmark_data_smithi188_77607_object129424:head# 2024-04-01T19:28:38.458 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:672acd91:::benchmark_data_smithi188_77607_object112466:head# 2024-04-01T19:28:38.459 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:672b26e0:::benchmark_data_smithi188_77607_object154185:head# 2024-04-01T19:28:38.459 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:672bb649:::benchmark_data_smithi188_77607_object106720:head# 2024-04-01T19:28:38.459 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:672c07a6:::benchmark_data_smithi188_77607_object135691:head# 2024-04-01T19:28:38.460 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:672c2bec:::benchmark_data_smithi188_77607_object112925:head# 2024-04-01T19:28:38.460 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:672d290d:::benchmark_data_smithi188_77607_object97906:head# 2024-04-01T19:28:38.461 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:672f98b6:::benchmark_data_smithi188_77607_object137652:head# 2024-04-01T19:28:38.462 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:672fa5fc:::benchmark_data_smithi188_77607_object116192:head# 2024-04-01T19:28:38.462 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:673146e2:::benchmark_data_smithi188_77607_object108192:head# 2024-04-01T19:28:38.462 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6731e7c5:::benchmark_data_smithi188_77607_object150500:head# 2024-04-01T19:28:38.462 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6732a6ab:::benchmark_data_smithi188_77607_object129280:head# 2024-04-01T19:28:38.463 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:673384f7:::benchmark_data_smithi188_77607_object99077:head# 2024-04-01T19:28:38.463 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:673521fa:::benchmark_data_smithi188_77607_object164492:head# 2024-04-01T19:28:38.464 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67353f86:::benchmark_data_smithi188_77607_object99782:head# 2024-04-01T19:28:38.464 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6735d1b4:::benchmark_data_smithi188_77607_object124202:head# 2024-04-01T19:28:38.465 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6735d7f6:::benchmark_data_smithi188_77607_object154234:head# 2024-04-01T19:28:38.465 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:673712fc:::benchmark_data_smithi188_77607_object163152:head# 2024-04-01T19:28:38.466 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:28:38.466 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67373694:::benchmark_data_smithi188_77607_object98539:head# 2024-04-01T19:28:38.466 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6739a6fd:::benchmark_data_smithi188_77607_object102593:head# 2024-04-01T19:28:38.467 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:673b0a90:::benchmark_data_smithi188_77607_object123224:head# 2024-04-01T19:28:38.467 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:673beee3:::benchmark_data_smithi188_77607_object107355:head# 2024-04-01T19:28:38.468 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:673e354c:::benchmark_data_smithi188_77607_object137622:head# 2024-04-01T19:28:38.468 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:673fc452:::benchmark_data_smithi188_77607_object156323:head# 2024-04-01T19:28:38.469 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67418684:::benchmark_data_smithi188_77607_object147987:head# 2024-04-01T19:28:38.469 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6743f7f1:::benchmark_data_smithi188_77607_object101792:head# 2024-04-01T19:28:38.470 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6744e299:::benchmark_data_smithi188_77607_object117443:head# 2024-04-01T19:28:38.470 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6745216c:::benchmark_data_smithi188_77607_object150869:head# 2024-04-01T19:28:38.471 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67453aff:::benchmark_data_smithi188_77607_object156098:head# 2024-04-01T19:28:38.471 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:674751b5:::benchmark_data_smithi188_77607_object127289:head# 2024-04-01T19:28:38.472 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67489bcf:::benchmark_data_smithi188_77607_object119176:head# 2024-04-01T19:28:38.472 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6749ab93:::benchmark_data_smithi188_77607_object141736:head# 2024-04-01T19:28:38.472 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:674a783a:::benchmark_data_smithi188_77607_object105704:head# 2024-04-01T19:28:38.473 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:674b8c14:::benchmark_data_smithi188_77607_object144952:head# 2024-04-01T19:28:38.473 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:674b908e:::benchmark_data_smithi188_77607_object128924:head# 2024-04-01T19:28:38.474 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:674bab87:::benchmark_data_smithi188_77607_object111934:head# 2024-04-01T19:28:38.474 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:674d377e:::benchmark_data_smithi188_77607_object116923:head# 2024-04-01T19:28:38.475 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:674d6878:::benchmark_data_smithi188_77607_object109058:head# 2024-04-01T19:28:38.475 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:674d93e9:::benchmark_data_smithi188_77607_object151325:head# 2024-04-01T19:28:38.475 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:674dbbcc:::benchmark_data_smithi188_77607_object147726:head# 2024-04-01T19:28:38.476 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:674e0719:::benchmark_data_smithi188_77607_object101909:head# 2024-04-01T19:28:38.476 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6750bd0d:::benchmark_data_smithi188_77607_object112753:head# 2024-04-01T19:28:38.477 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67519f80:::benchmark_data_smithi188_77607_object161275:head# 2024-04-01T19:28:38.477 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67521e96:::benchmark_data_smithi188_77607_object152981:head# 2024-04-01T19:28:38.477 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67525c3a:::benchmark_data_smithi188_77607_object129157:head# 2024-04-01T19:28:38.478 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6752e326:::benchmark_data_smithi188_77607_object104898:head# 2024-04-01T19:28:38.478 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6754a87d:::benchmark_data_smithi188_77607_object166186:head# 2024-04-01T19:28:38.479 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6755960a:::benchmark_data_smithi188_77607_object135294:head# 2024-04-01T19:28:38.479 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67565768:::benchmark_data_smithi188_77607_object98075:head# 2024-04-01T19:28:38.479 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67577f76:::benchmark_data_smithi188_77607_object120888:head# 2024-04-01T19:28:38.480 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6757c1c2:::benchmark_data_smithi188_77607_object122754:head# 2024-04-01T19:28:38.480 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67584c60:::benchmark_data_smithi188_77607_object125211:head# 2024-04-01T19:28:38.481 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6758724d:::benchmark_data_smithi188_77607_object116144:head# 2024-04-01T19:28:38.481 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6759db63:::benchmark_data_smithi188_77607_object143751:head# 2024-04-01T19:28:38.482 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:675a1794:::benchmark_data_smithi188_77607_object153431:head# 2024-04-01T19:28:38.482 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:675c427e:::benchmark_data_smithi188_77607_object106733:head# 2024-04-01T19:28:38.483 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:675de55a:::benchmark_data_smithi188_77607_object142347:head# 2024-04-01T19:28:38.483 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:675ebc43:::benchmark_data_smithi188_77607_object152489:head# 2024-04-01T19:28:38.484 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:675f5afa:::benchmark_data_smithi188_77607_object158622:head# 2024-04-01T19:28:38.484 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6760474a:::benchmark_data_smithi188_77607_object163687:head# 2024-04-01T19:28:38.485 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67612d18:::benchmark_data_smithi188_77607_object132470:head# 2024-04-01T19:28:38.485 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6762d21e:::benchmark_data_smithi188_77607_object136271:head# 2024-04-01T19:28:38.485 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:676623bd:::benchmark_data_smithi188_77607_object122316:head# 2024-04-01T19:28:38.486 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:676641f9:::benchmark_data_smithi188_77607_object108867:head# 2024-04-01T19:28:38.486 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67672656:::benchmark_data_smithi188_77607_object121981:head# 2024-04-01T19:28:38.487 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6767edaf:::benchmark_data_smithi188_77607_object104862:head# 2024-04-01T19:28:38.487 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6768bf15:::benchmark_data_smithi188_77607_object164182:head# 2024-04-01T19:28:38.488 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6768f46d:::benchmark_data_smithi188_77607_object150831:head# 2024-04-01T19:28:38.488 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6769730b:::benchmark_data_smithi188_77607_object102413:head# 2024-04-01T19:28:38.489 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:676976ac:::benchmark_data_smithi188_77607_object116975:head# 2024-04-01T19:28:38.489 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6769f17b:::benchmark_data_smithi188_77607_object149791:head# 2024-04-01T19:28:38.490 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:676c5c4c:::benchmark_data_smithi188_77607_object133833:head# 2024-04-01T19:28:38.490 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:676d9b3e:::benchmark_data_smithi188_77607_object121168:head# 2024-04-01T19:28:38.490 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:676f4f66:::benchmark_data_smithi188_77607_object122228:head# 2024-04-01T19:28:38.491 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67714286:::benchmark_data_smithi188_77607_object104689:head# 2024-04-01T19:28:38.491 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6771df0e:::benchmark_data_smithi188_77607_object146742:head# 2024-04-01T19:28:38.492 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6771ebf8:::benchmark_data_smithi188_77607_object147918:head# 2024-04-01T19:28:38.492 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6772b5e3:::benchmark_data_smithi188_77607_object142482:head# 2024-04-01T19:28:38.493 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6773165b:::benchmark_data_smithi188_77607_object116893:head# 2024-04-01T19:28:38.493 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:677395f7:::benchmark_data_smithi188_77607_object165587:head# 2024-04-01T19:28:38.493 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6773df95:::benchmark_data_smithi188_77607_object127005:head# 2024-04-01T19:28:38.494 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6775b2cc:::benchmark_data_smithi188_77607_object144068:head# 2024-04-01T19:28:38.494 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6776434b:::benchmark_data_smithi188_77607_object160791:head# 2024-04-01T19:28:38.495 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67779f86:::benchmark_data_smithi188_77607_object134422:head# 2024-04-01T19:28:38.495 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6778014c:::benchmark_data_smithi188_77607_object161686:head# 2024-04-01T19:28:38.496 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:677881af:::benchmark_data_smithi188_77607_object151841:head# 2024-04-01T19:28:38.496 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6778b8a8:::benchmark_data_smithi188_77607_object117621:head# 2024-04-01T19:28:38.496 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:38.497 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:677ade9a:::benchmark_data_smithi188_77607_object132332:head# 2024-04-01T19:28:38.497 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:677b16cc:::benchmark_data_smithi188_77607_object118638:head# 2024-04-01T19:28:38.497 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:677bee46:::benchmark_data_smithi188_77607_object163171:head# 2024-04-01T19:28:38.498 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:677c2895:::benchmark_data_smithi188_77607_object107754:head# 2024-04-01T19:28:38.498 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:677cfedf:::benchmark_data_smithi188_77607_object112035:head# 2024-04-01T19:28:38.499 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:677d19f8:::benchmark_data_smithi188_77607_object116120:head# 2024-04-01T19:28:38.499 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:677de2d8:::benchmark_data_smithi188_77607_object144962:head# 2024-04-01T19:28:38.500 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:677df5de:::benchmark_data_smithi188_77607_object127999:head# 2024-04-01T19:28:38.500 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:677e3f44:::benchmark_data_smithi188_77607_object127313:head# 2024-04-01T19:28:38.501 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6780f35e:::benchmark_data_smithi188_77607_object111999:head# 2024-04-01T19:28:38.501 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6782c31a:::benchmark_data_smithi188_77607_object146556:head# 2024-04-01T19:28:38.502 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67849cb2:::benchmark_data_smithi188_77607_object156395:head# 2024-04-01T19:28:38.502 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6785416d:::benchmark_data_smithi188_77607_object145405:head# 2024-04-01T19:28:38.503 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6786b39c:::benchmark_data_smithi188_77607_object104300:head# 2024-04-01T19:28:38.503 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6787b1d7:::benchmark_data_smithi188_77607_object116229:head# 2024-04-01T19:28:38.503 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6788db0c:::benchmark_data_smithi188_77607_object120293:head# 2024-04-01T19:28:38.504 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67892afd:::benchmark_data_smithi188_77607_object118317:head# 2024-04-01T19:28:38.504 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6789d4f3:::benchmark_data_smithi188_77607_object134011:head# 2024-04-01T19:28:38.505 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:678a2531:::benchmark_data_smithi188_77607_object143345:head# 2024-04-01T19:28:38.505 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:678bf686:::benchmark_data_smithi188_77607_object125032:head# 2024-04-01T19:28:38.506 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:678c9b6e:::benchmark_data_smithi188_77607_object163099:head# 2024-04-01T19:28:38.506 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:678cc2d8:::benchmark_data_smithi188_77607_object114190:head# 2024-04-01T19:28:38.507 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:678d5a2f:::benchmark_data_smithi188_77607_object108322:head# 2024-04-01T19:28:38.507 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:678ddfcf:::benchmark_data_smithi188_77607_object115513:head# 2024-04-01T19:28:38.508 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67905e1f:::benchmark_data_smithi188_77607_object132306:head# 2024-04-01T19:28:38.508 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:679076a8:::benchmark_data_smithi188_77607_object154235:head# 2024-04-01T19:28:38.508 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6791512f:::benchmark_data_smithi188_77607_object144424:head# 2024-04-01T19:28:38.509 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:679168a7:::benchmark_data_smithi188_77607_object133252:head# 2024-04-01T19:28:38.509 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6792a544:::benchmark_data_smithi188_77607_object134499:head# 2024-04-01T19:28:38.510 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:679302e3:::benchmark_data_smithi188_77607_object110215:head# 2024-04-01T19:28:38.510 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6793a8be:::benchmark_data_smithi188_77607_object140052:head# 2024-04-01T19:28:38.511 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6795cca9:::benchmark_data_smithi188_77607_object123477:head# 2024-04-01T19:28:38.511 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6796d0fe:::benchmark_data_smithi188_77607_object110376:head# 2024-04-01T19:28:38.511 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6797899b:::benchmark_data_smithi188_77607_object111728:head# 2024-04-01T19:28:38.512 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:679a884c:::benchmark_data_smithi188_77607_object146748:head# 2024-04-01T19:28:38.512 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:679adb11:::benchmark_data_smithi188_77607_object134517:head# 2024-04-01T19:28:38.513 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:679b24f8:::benchmark_data_smithi188_77607_object108428:head# 2024-04-01T19:28:38.513 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:679be32e:::benchmark_data_smithi188_77607_object142963:head# 2024-04-01T19:28:38.514 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:679c1af3:::benchmark_data_smithi188_77607_object147196:head# 2024-04-01T19:28:38.514 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:679c78b9:::benchmark_data_smithi188_77607_object112561:head# 2024-04-01T19:28:38.515 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:679d292b:::benchmark_data_smithi188_77607_object123525:head# 2024-04-01T19:28:38.515 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:679eeb38:::benchmark_data_smithi188_77607_object142713:head# 2024-04-01T19:28:38.516 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67a10d3a:::benchmark_data_smithi188_77607_object127368:head# 2024-04-01T19:28:38.517 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67a242d6:::benchmark_data_smithi188_77607_object167061:head# 2024-04-01T19:28:38.517 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:28:38.518 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67a27e22:::benchmark_data_smithi188_77607_object119037:head# 2024-04-01T19:28:38.518 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67a31594:::benchmark_data_smithi188_77607_object160302:head# 2024-04-01T19:28:38.518 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67a5c3bf:::benchmark_data_smithi188_77607_object151451:head# 2024-04-01T19:28:38.519 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67a7a86e:::benchmark_data_smithi188_77607_object125473:head# 2024-04-01T19:28:38.519 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67a84b62:::benchmark_data_smithi188_77607_object107340:head# 2024-04-01T19:28:38.520 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:38.520 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:28:38.521 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67a8abad:::benchmark_data_smithi188_77607_object134751:head# 2024-04-01T19:28:38.521 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67a8bea9:::benchmark_data_smithi188_77607_object126297:head# 2024-04-01T19:28:38.521 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67ab5147:::benchmark_data_smithi188_77607_object129528:head# 2024-04-01T19:28:38.521 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67abfa64:::benchmark_data_smithi188_77607_object115652:head# 2024-04-01T19:28:38.522 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67ac5a53:::benchmark_data_smithi188_77607_object126408:head# 2024-04-01T19:28:38.522 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67ac98cd:::benchmark_data_smithi188_77607_object141976:head# 2024-04-01T19:28:38.526 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67acdf33:::benchmark_data_smithi188_77607_object150343:head# 2024-04-01T19:28:38.526 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67ad033f:::benchmark_data_smithi188_77607_object108274:head# 2024-04-01T19:28:38.526 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67ad0803:::benchmark_data_smithi188_77607_object135463:head# 2024-04-01T19:28:38.526 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67ad5f4b:::benchmark_data_smithi188_77607_object153896:head# 2024-04-01T19:28:38.526 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67ad97b7:::benchmark_data_smithi188_77607_object125665:head# 2024-04-01T19:28:38.526 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67adabe4:::benchmark_data_smithi188_77607_object146726:head# 2024-04-01T19:28:38.526 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67af2093:::benchmark_data_smithi188_77607_object166187:head# 2024-04-01T19:28:38.527 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67af6eeb:::benchmark_data_smithi188_77607_object120024:head# 2024-04-01T19:28:38.527 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67afcf9d:::benchmark_data_smithi188_77607_object153066:head# 2024-04-01T19:28:38.527 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67b17843:::benchmark_data_smithi188_77607_object144854:head# 2024-04-01T19:28:38.527 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67b1ef63:::benchmark_data_smithi188_77607_object101821:head# 2024-04-01T19:28:38.527 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67b24231:::benchmark_data_smithi188_77607_object99504:head# 2024-04-01T19:28:38.528 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67b3e99b:::benchmark_data_smithi188_77607_object135855:head# 2024-04-01T19:28:38.529 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67b3ffc7:::benchmark_data_smithi188_77607_object112611:head# 2024-04-01T19:28:38.529 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67b4b564:::benchmark_data_smithi188_77607_object100413:head# 2024-04-01T19:28:38.530 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67b5c194:::benchmark_data_smithi188_77607_object166819:head# 2024-04-01T19:28:38.530 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67b82f33:::benchmark_data_smithi188_77607_object126394:head# 2024-04-01T19:28:38.531 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67b86c63:::benchmark_data_smithi188_77607_object108509:head# 2024-04-01T19:28:38.531 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67bdba11:::benchmark_data_smithi188_77607_object108063:head# 2024-04-01T19:28:38.532 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67be10d7:::benchmark_data_smithi188_77607_object125831:head# 2024-04-01T19:28:38.532 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67be4bf8:::benchmark_data_smithi188_77607_object135983:head# 2024-04-01T19:28:38.532 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67bfc339:::benchmark_data_smithi188_77607_object139527:head# 2024-04-01T19:28:38.533 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67bfd7f5:::benchmark_data_smithi188_77607_object100671:head# 2024-04-01T19:28:38.533 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67c0b88c:::benchmark_data_smithi188_77607_object157509:head# 2024-04-01T19:28:38.534 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67c2d7ac:::benchmark_data_smithi188_77607_object140822:head# 2024-04-01T19:28:38.534 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67c8a706:::benchmark_data_smithi188_77607_object139491:head# 2024-04-01T19:28:38.535 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67c8f4b5:::benchmark_data_smithi188_77607_object125542:head# 2024-04-01T19:28:38.535 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67c95dd2:::benchmark_data_smithi188_77607_object164055:head# 2024-04-01T19:28:38.536 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67cabcfa:::benchmark_data_smithi188_77607_object133464:head# 2024-04-01T19:28:38.536 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67cbef93:::benchmark_data_smithi188_77607_object123685:head# 2024-04-01T19:28:38.537 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67cc2f49:::benchmark_data_smithi188_77607_object152501:head# 2024-04-01T19:28:38.537 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67cdb464:::benchmark_data_smithi188_77607_object100352:head# 2024-04-01T19:28:38.537 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67cdfab6:::benchmark_data_smithi188_77607_object107671:head# 2024-04-01T19:28:38.538 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67ce4d17:::benchmark_data_smithi188_77607_object127791:head# 2024-04-01T19:28:38.538 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67ceded1:::benchmark_data_smithi188_77607_object143615:head# 2024-04-01T19:28:38.539 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67cef7c1:::benchmark_data_smithi188_77607_object125570:head# 2024-04-01T19:28:38.539 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67cf33d5:::benchmark_data_smithi188_77607_object139909:head# 2024-04-01T19:28:38.540 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67cf3dd8:::benchmark_data_smithi188_77607_object137059:head# 2024-04-01T19:28:38.540 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67d28e3f:::benchmark_data_smithi188_77607_object110074:head# 2024-04-01T19:28:38.541 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67d44fe9:::benchmark_data_smithi188_77607_object123275:head# 2024-04-01T19:28:38.541 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67d5401e:::benchmark_data_smithi188_77607_object142809:head# 2024-04-01T19:28:38.541 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67d5ec2a:::benchmark_data_smithi188_77607_object156862:head# 2024-04-01T19:28:38.542 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67dca736:::benchmark_data_smithi188_77607_object120934:head# 2024-04-01T19:28:38.542 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67dd446b:::benchmark_data_smithi188_77607_object111067:head# 2024-04-01T19:28:38.543 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67de65e5:::benchmark_data_smithi188_77607_object156043:head# 2024-04-01T19:28:38.543 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67df84bd:::benchmark_data_smithi188_77607_object159121:head# 2024-04-01T19:28:38.544 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67df95d7:::benchmark_data_smithi188_77607_object126639:head# 2024-04-01T19:28:38.544 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67dffbbb:::benchmark_data_smithi188_77607_object149789:head# 2024-04-01T19:28:38.545 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67e10499:::benchmark_data_smithi188_77607_object133739:head# 2024-04-01T19:28:38.545 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67e15795:::benchmark_data_smithi188_77607_object154432:head# 2024-04-01T19:28:38.546 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67e322c6:::benchmark_data_smithi188_77607_object107256:head# 2024-04-01T19:28:38.546 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67e32d12:::benchmark_data_smithi188_77607_object129333:head# 2024-04-01T19:28:38.546 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67e39452:::benchmark_data_smithi188_77607_object135363:head# 2024-04-01T19:28:38.547 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67e3f5b1:::benchmark_data_smithi188_77607_object142908:head# 2024-04-01T19:28:38.547 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67e6d0da:::benchmark_data_smithi188_77607_object122281:head# 2024-04-01T19:28:38.548 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67e73685:::benchmark_data_smithi188_77607_object166208:head# 2024-04-01T19:28:38.548 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67e75f69:::benchmark_data_smithi188_77607_object99218:head# 2024-04-01T19:28:38.549 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67e7d9ad:::benchmark_data_smithi188_77607_object107972:head# 2024-04-01T19:28:38.549 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67e807b1:::benchmark_data_smithi188_77607_object108941:head# 2024-04-01T19:28:38.550 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67e8fced:::benchmark_data_smithi188_77607_object167094:head# 2024-04-01T19:28:38.550 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67e969dd:::benchmark_data_smithi188_77607_object109201:head# 2024-04-01T19:28:38.551 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67ea20e2:::benchmark_data_smithi188_77607_object120801:head# 2024-04-01T19:28:38.551 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67eac4d3:::benchmark_data_smithi188_77607_object100260:head# 2024-04-01T19:28:38.552 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67eb0ab8:::benchmark_data_smithi188_77607_object130044:head# 2024-04-01T19:28:38.552 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67ec1a9d:::benchmark_data_smithi188_77607_object104307:head# 2024-04-01T19:28:38.553 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67ec8371:::benchmark_data_smithi188_77607_object166623:head# 2024-04-01T19:28:38.553 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67ef7584:::benchmark_data_smithi188_77607_object114413:head# 2024-04-01T19:28:38.553 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67efe1e1:::benchmark_data_smithi188_77607_object104069:head# 2024-04-01T19:28:38.554 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67f3791c:::benchmark_data_smithi188_77607_object109226:head# 2024-04-01T19:28:38.554 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67f3d2e2:::benchmark_data_smithi188_77607_object108610:head# 2024-04-01T19:28:38.555 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67f80651:::benchmark_data_smithi188_77607_object133354:head# 2024-04-01T19:28:38.555 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67f88be8:::benchmark_data_smithi188_77607_object131140:head# 2024-04-01T19:28:38.555 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67f8f2f3:::benchmark_data_smithi188_77607_object164998:head# 2024-04-01T19:28:38.556 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67f8f937:::benchmark_data_smithi188_77607_object107266:head# 2024-04-01T19:28:38.557 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67f9a585:::benchmark_data_smithi188_77607_object115561:head# 2024-04-01T19:28:38.557 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67fa18eb:::benchmark_data_smithi188_77607_object123966:head# 2024-04-01T19:28:38.557 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67fab4ec:::benchmark_data_smithi188_77607_object138220:head# 2024-04-01T19:28:38.558 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67fb41ab:::benchmark_data_smithi188_77607_object101535:head# 2024-04-01T19:28:38.558 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67fc3fb8:::benchmark_data_smithi188_77607_object144143:head# 2024-04-01T19:28:38.559 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67fd2b7c:::benchmark_data_smithi188_77607_object136979:head# 2024-04-01T19:28:38.559 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67fdfbfd:::benchmark_data_smithi188_77607_object112825:head# 2024-04-01T19:28:38.560 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67fe829d:::benchmark_data_smithi188_77607_object100530:head# 2024-04-01T19:28:38.560 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67fea877:::benchmark_data_smithi188_77607_object139656:head# 2024-04-01T19:28:38.560 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67ff2cd2:::benchmark_data_smithi188_77607_object99226:head# 2024-04-01T19:28:38.561 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:67ff90eb:::benchmark_data_smithi188_77607_object123353:head# 2024-04-01T19:28:38.561 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6800135b:::benchmark_data_smithi188_77607_object154639:head# 2024-04-01T19:28:38.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:680140c2:::benchmark_data_smithi188_77607_object145696:head# 2024-04-01T19:28:38.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:680149d9:::benchmark_data_smithi188_77607_object160468:head# 2024-04-01T19:28:38.563 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68042de5:::benchmark_data_smithi188_77607_object137123:head# 2024-04-01T19:28:38.563 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6804668c:::benchmark_data_smithi188_77607_object144218:head# 2024-04-01T19:28:38.564 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:680505d6:::benchmark_data_smithi188_77607_object115711:head# 2024-04-01T19:28:38.564 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6805b319:::benchmark_data_smithi188_77607_object161901:head# 2024-04-01T19:28:38.564 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6805dc4b:::benchmark_data_smithi188_77607_object146028:head# 2024-04-01T19:28:38.565 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68060ab8:::benchmark_data_smithi188_77607_object157589:head# 2024-04-01T19:28:38.565 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68069605:::benchmark_data_smithi188_77607_object125027:head# 2024-04-01T19:28:38.566 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68077ef2:::benchmark_data_smithi188_77607_object110068:head# 2024-04-01T19:28:38.566 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:680793ad:::benchmark_data_smithi188_77607_object126958:head# 2024-04-01T19:28:38.567 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6807dcd3:::benchmark_data_smithi188_77607_object108865:head# 2024-04-01T19:28:38.567 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68087b6e:::benchmark_data_smithi188_77607_object104177:head# 2024-04-01T19:28:38.568 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6809c443:::benchmark_data_smithi188_77607_object161049:head# 2024-04-01T19:28:38.568 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:680b6492:::benchmark_data_smithi188_77607_object140154:head# 2024-04-01T19:28:38.569 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:680bfaf9:::benchmark_data_smithi188_77607_object148657:head# 2024-04-01T19:28:38.569 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:680c3dd9:::benchmark_data_smithi188_77607_object109125:head# 2024-04-01T19:28:38.570 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:680e66c9:::benchmark_data_smithi188_77607_object117669:head# 2024-04-01T19:28:38.570 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:680eeb7b:::benchmark_data_smithi188_77607_object114908:head# 2024-04-01T19:28:38.571 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:680f837c:::benchmark_data_smithi188_77607_object150569:head# 2024-04-01T19:28:38.571 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68103380:::benchmark_data_smithi188_77607_object137025:head# 2024-04-01T19:28:38.572 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68128b12:::benchmark_data_smithi188_77607_object146920:head# 2024-04-01T19:28:38.572 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:681305e0:::benchmark_data_smithi188_77607_object127504:head# 2024-04-01T19:28:38.573 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6814cf30:::benchmark_data_smithi188_77607_object109239:head# 2024-04-01T19:28:38.573 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68162e62:::benchmark_data_smithi188_77607_object116392:head# 2024-04-01T19:28:38.573 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68175a9d:::benchmark_data_smithi188_77607_object137482:head# 2024-04-01T19:28:38.574 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6818ebea:::benchmark_data_smithi188_77607_object148423:head# 2024-04-01T19:28:38.575 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:681aaf00:::benchmark_data_smithi188_77607_object151773:head# 2024-04-01T19:28:38.575 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:681b24dd:::benchmark_data_smithi188_77607_object165411:head# 2024-04-01T19:28:38.576 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:681ec2e3:::benchmark_data_smithi188_77607_object137227:head# 2024-04-01T19:28:38.576 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:681f44f8:::benchmark_data_smithi188_77607_object158702:head# 2024-04-01T19:28:38.577 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68200deb:::benchmark_data_smithi188_77607_object122279:head# 2024-04-01T19:28:38.577 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6823863f:::benchmark_data_smithi188_77607_object136554:head# 2024-04-01T19:28:38.578 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6823b974:::benchmark_data_smithi188_77607_object114023:head# 2024-04-01T19:28:38.578 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:682535ef:::benchmark_data_smithi188_77607_object107627:head# 2024-04-01T19:28:38.578 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68259c7b:::benchmark_data_smithi188_77607_object167284:head# 2024-04-01T19:28:38.579 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68264691:::benchmark_data_smithi188_77607_object109254:head# 2024-04-01T19:28:38.579 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6828e1fe:::benchmark_data_smithi188_77607_object146848:head# 2024-04-01T19:28:38.580 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6829e0a5:::benchmark_data_smithi188_77607_object145209:head# 2024-04-01T19:28:38.580 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:682ba803:::benchmark_data_smithi188_77607_object152397:head# 2024-04-01T19:28:38.581 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:682d206a:::benchmark_data_smithi188_77607_object157586:head# 2024-04-01T19:28:38.581 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:682d9d82:::benchmark_data_smithi188_77607_object162712:head# 2024-04-01T19:28:38.582 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:682daede:::benchmark_data_smithi188_77607_object152710:head# 2024-04-01T19:28:38.582 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68313b10:::benchmark_data_smithi188_77607_object153633:head# 2024-04-01T19:28:38.583 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68317a02:::benchmark_data_smithi188_77607_object153824:head# 2024-04-01T19:28:38.583 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68320172:::benchmark_data_smithi188_77607_object163748:head# 2024-04-01T19:28:38.584 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68329ccc:::benchmark_data_smithi188_77607_object149877:head# 2024-04-01T19:28:38.584 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68335aa4:::benchmark_data_smithi188_77607_object129538:head# 2024-04-01T19:28:38.585 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:683367c0:::benchmark_data_smithi188_77607_object106652:head# 2024-04-01T19:28:38.585 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6834881e:::benchmark_data_smithi188_77607_object106824:head# 2024-04-01T19:28:38.586 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6835a286:::benchmark_data_smithi188_77607_object121837:head# 2024-04-01T19:28:38.586 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6835b443:::benchmark_data_smithi188_77607_object117085:head# 2024-04-01T19:28:38.587 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6837b8f4:::benchmark_data_smithi188_77607_object164678:head# 2024-04-01T19:28:38.587 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6838512e:::benchmark_data_smithi188_77607_object98527:head# 2024-04-01T19:28:38.588 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:683bed56:::benchmark_data_smithi188_77607_object166180:head# 2024-04-01T19:28:38.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:683c0751:::benchmark_data_smithi188_77607_object140215:head# 2024-04-01T19:28:38.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:683ca8df:::benchmark_data_smithi188_77607_object144016:head# 2024-04-01T19:28:38.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:683d549f:::benchmark_data_smithi188_77607_object101925:head# 2024-04-01T19:28:38.590 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:683d6adb:::benchmark_data_smithi188_77607_object141953:head# 2024-04-01T19:28:38.590 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:683e3c80:::benchmark_data_smithi188_77607_object165256:head# 2024-04-01T19:28:38.591 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:683e546d:::benchmark_data_smithi188_77607_object136952:head# 2024-04-01T19:28:38.591 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:683ec96d:::benchmark_data_smithi188_77607_object127983:head# 2024-04-01T19:28:38.592 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:683eeaff:::benchmark_data_smithi188_77607_object113654:head# 2024-04-01T19:28:38.593 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:683f6e7a:::benchmark_data_smithi188_77607_object133969:head# 2024-04-01T19:28:38.593 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6840a2f8:::benchmark_data_smithi188_77607_object149501:head# 2024-04-01T19:28:38.593 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68429d88:::benchmark_data_smithi188_77607_object116273:head# 2024-04-01T19:28:38.594 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6844d0f0:::benchmark_data_smithi188_77607_object121377:head# 2024-04-01T19:28:38.595 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6844dbfc:::benchmark_data_smithi188_77607_object161559:head# 2024-04-01T19:28:38.595 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6845d075:::benchmark_data_smithi188_77607_object103512:head# 2024-04-01T19:28:38.596 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6846af8e:::benchmark_data_smithi188_77607_object162764:head# 2024-04-01T19:28:38.596 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68472a43:::benchmark_data_smithi188_77607_object100922:head# 2024-04-01T19:28:38.597 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:684b3989:::benchmark_data_smithi188_77607_object118939:head# 2024-04-01T19:28:38.598 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:684c668f:::benchmark_data_smithi188_77607_object110254:head# 2024-04-01T19:28:38.598 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6850490e:::benchmark_data_smithi188_77607_object98647:head# 2024-04-01T19:28:38.598 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68527469:::benchmark_data_smithi188_77607_object141784:head# 2024-04-01T19:28:38.599 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6852bed2:::benchmark_data_smithi188_77607_object128975:head# 2024-04-01T19:28:38.600 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68533558:::benchmark_data_smithi188_77607_object117602:head# 2024-04-01T19:28:38.600 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68534fed:::benchmark_data_smithi188_77607_object165011:head# 2024-04-01T19:28:38.601 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68536eeb:::benchmark_data_smithi188_77607_object138421:head# 2024-04-01T19:28:38.601 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:685650bd:::benchmark_data_smithi188_77607_object121646:head# 2024-04-01T19:28:38.602 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6856c373:::benchmark_data_smithi188_77607_object113540:head# 2024-04-01T19:28:38.602 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:685707e5:::benchmark_data_smithi188_77607_object145675:head# 2024-04-01T19:28:38.603 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68571448:::benchmark_data_smithi188_77607_object150335:head# 2024-04-01T19:28:38.603 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6857ef24:::benchmark_data_smithi188_77607_object99876:head# 2024-04-01T19:28:38.604 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:685a6ca8:::benchmark_data_smithi188_77607_object113754:head# 2024-04-01T19:28:38.604 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:685ac047:::benchmark_data_smithi188_77607_object151365:head# 2024-04-01T19:28:38.605 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:685c0514:::benchmark_data_smithi188_77607_object99182:head# 2024-04-01T19:28:38.605 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:685e8f1e:::benchmark_data_smithi188_77607_object110500:head# 2024-04-01T19:28:38.606 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:685eb30f:::benchmark_data_smithi188_77607_object112864:head# 2024-04-01T19:28:38.606 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:685f1d86:::benchmark_data_smithi188_77607_object112866:head# 2024-04-01T19:28:38.607 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6861eede:::benchmark_data_smithi188_77607_object110842:head# 2024-04-01T19:28:38.607 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:686222ea:::benchmark_data_smithi188_77607_object123198:head# 2024-04-01T19:28:38.608 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68645149:::benchmark_data_smithi188_77607_object99797:head# 2024-04-01T19:28:38.608 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6864aa61:::benchmark_data_smithi188_77607_object165780:head# 2024-04-01T19:28:38.609 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6865d20e:::benchmark_data_smithi188_77607_object158371:head# 2024-04-01T19:28:38.609 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6867a9bc:::benchmark_data_smithi188_77607_object156618:head# 2024-04-01T19:28:38.610 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6868371b:::benchmark_data_smithi188_77607_object164110:head# 2024-04-01T19:28:38.610 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6868b88a:::benchmark_data_smithi188_77607_object113796:head# 2024-04-01T19:28:38.611 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6868c824:::benchmark_data_smithi188_77607_object137936:head# 2024-04-01T19:28:38.611 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68698c9c:::benchmark_data_smithi188_77607_object98156:head# 2024-04-01T19:28:38.612 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:686ae9df:::benchmark_data_smithi188_77607_object124699:head# 2024-04-01T19:28:38.612 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:686afef0:::benchmark_data_smithi188_77607_object147069:head# 2024-04-01T19:28:38.613 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:686c51d8:::benchmark_data_smithi188_77607_object141637:head# 2024-04-01T19:28:38.614 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:686cb6b8:::benchmark_data_smithi188_77607_object150845:head# 2024-04-01T19:28:38.614 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:686fe8be:::benchmark_data_smithi188_77607_object123310:head# 2024-04-01T19:28:38.615 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68724f75:::benchmark_data_smithi188_77607_object143913:head# 2024-04-01T19:28:38.615 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6873277e:::benchmark_data_smithi188_77607_object165580:head# 2024-04-01T19:28:38.615 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6873db40:::benchmark_data_smithi188_77607_object127885:head# 2024-04-01T19:28:38.616 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6873ea0d:::benchmark_data_smithi188_77607_object115785:head# 2024-04-01T19:28:38.616 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6874aee3:::benchmark_data_smithi188_77607_object123828:head# 2024-04-01T19:28:38.617 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6874fc6b:::benchmark_data_smithi188_77607_object159381:head# 2024-04-01T19:28:38.617 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68752aa8:::benchmark_data_smithi188_77607_object114251:head# 2024-04-01T19:28:38.618 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6876a523:::benchmark_data_smithi188_77607_object157101:head# 2024-04-01T19:28:38.618 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:687780b0:::benchmark_data_smithi188_77607_object144730:head# 2024-04-01T19:28:38.619 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6877d6ab:::benchmark_data_smithi188_77607_object137087:head# 2024-04-01T19:28:38.619 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68783483:::benchmark_data_smithi188_77607_object145413:head# 2024-04-01T19:28:38.620 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6878735e:::benchmark_data_smithi188_77607_object125723:head# 2024-04-01T19:28:38.621 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:687b260c:::benchmark_data_smithi188_77607_object110750:head# 2024-04-01T19:28:38.621 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:28:38.622 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:687c0fcf:::benchmark_data_smithi188_77607_object103054:head# 2024-04-01T19:28:38.622 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:687f3de4:::benchmark_data_smithi188_77607_object109539:head# 2024-04-01T19:28:38.623 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6880317a:::benchmark_data_smithi188_77607_object152785:head# 2024-04-01T19:28:38.623 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6880a181:::benchmark_data_smithi188_77607_object125000:head# 2024-04-01T19:28:38.624 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68810828:::benchmark_data_smithi188_77607_object157727:head# 2024-04-01T19:28:38.624 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68814d1c:::benchmark_data_smithi188_77607_object133214:head# 2024-04-01T19:28:38.625 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6883a4a0:::benchmark_data_smithi188_77607_object116079:head# 2024-04-01T19:28:38.625 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6883bb2c:::benchmark_data_smithi188_77607_object100431:head# 2024-04-01T19:28:38.625 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68844f93:::benchmark_data_smithi188_77607_object134872:head# 2024-04-01T19:28:38.626 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:688588d9:::benchmark_data_smithi188_77607_object116053:head# 2024-04-01T19:28:38.626 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6887e9e3:::benchmark_data_smithi188_77607_object142399:head# 2024-04-01T19:28:38.627 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6888a718:::benchmark_data_smithi188_77607_object133990:head# 2024-04-01T19:28:38.628 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:688a5100:::benchmark_data_smithi188_77607_object141376:head# 2024-04-01T19:28:38.628 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:688a62f1:::benchmark_data_smithi188_77607_object136635:head# 2024-04-01T19:28:38.628 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:688aed26:::benchmark_data_smithi188_77607_object167212:head# 2024-04-01T19:28:38.629 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:688bbac5:::benchmark_data_smithi188_77607_object148289:head# 2024-04-01T19:28:38.629 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:28:38.630 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:28:38.630 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:688bed63:::benchmark_data_smithi188_77607_object153648:head# 2024-04-01T19:28:38.630 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:688fb9b8:::benchmark_data_smithi188_77607_object105519:head# 2024-04-01T19:28:38.631 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6890ad88:::benchmark_data_smithi188_77607_object110660:head# 2024-04-01T19:28:38.631 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6890dddf:::benchmark_data_smithi188_77607_object133710:head# 2024-04-01T19:28:38.632 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6891ab6d:::benchmark_data_smithi188_77607_object103403:head# 2024-04-01T19:28:38.632 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68921f3b:::benchmark_data_smithi188_77607_object141248:head# 2024-04-01T19:28:38.633 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:689269a7:::benchmark_data_smithi188_77607_object153997:head# 2024-04-01T19:28:38.633 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6893c084:::benchmark_data_smithi188_77607_object127830:head# 2024-04-01T19:28:38.634 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6897830e:::benchmark_data_smithi188_77607_object100460:head# 2024-04-01T19:28:38.634 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6897c995:::benchmark_data_smithi188_77607_object119850:head# 2024-04-01T19:28:38.635 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:689ab7c3:::benchmark_data_smithi188_77607_object144975:head# 2024-04-01T19:28:38.635 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:689b024b:::benchmark_data_smithi188_77607_object150133:head# 2024-04-01T19:28:38.636 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:689b4b54:::benchmark_data_smithi188_77607_object130820:head# 2024-04-01T19:28:38.637 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:689bec48:::benchmark_data_smithi188_77607_object122045:head# 2024-04-01T19:28:38.637 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:689e1ef1:::benchmark_data_smithi188_77607_object100892:head# 2024-04-01T19:28:38.638 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:689e91b6:::benchmark_data_smithi188_77607_object146613:head# 2024-04-01T19:28:38.638 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68a01a38:::benchmark_data_smithi188_77607_object119374:head# 2024-04-01T19:28:38.639 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68a18e08:::benchmark_data_smithi188_77607_object133804:head# 2024-04-01T19:28:38.639 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68a271d1:::benchmark_data_smithi188_77607_object116696:head# 2024-04-01T19:28:38.640 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68a6b0bd:::benchmark_data_smithi188_77607_object164111:head# 2024-04-01T19:28:38.640 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68a706ed:::benchmark_data_smithi188_77607_object138037:head# 2024-04-01T19:28:38.641 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68a7a9a7:::benchmark_data_smithi188_77607_object127716:head# 2024-04-01T19:28:38.641 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68a9785a:::benchmark_data_smithi188_77607_object141327:head# 2024-04-01T19:28:38.642 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68aa171e:::benchmark_data_smithi188_77607_object162421:head# 2024-04-01T19:28:38.642 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68aa393b:::benchmark_data_smithi188_77607_object152439:head# 2024-04-01T19:28:38.643 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68aa65a7:::benchmark_data_smithi188_77607_object98734:head# 2024-04-01T19:28:38.643 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68abd072:::benchmark_data_smithi188_77607_object131915:head# 2024-04-01T19:28:38.644 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68ac4ba9:::benchmark_data_smithi188_77607_object133229:head# 2024-04-01T19:28:38.645 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68aea02c:::benchmark_data_smithi188_77607_object127309:head# 2024-04-01T19:28:38.645 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68aea4d2:::benchmark_data_smithi188_77607_object115812:head# 2024-04-01T19:28:38.646 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68b061a1:::benchmark_data_smithi188_77607_object126992:head# 2024-04-01T19:28:38.646 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68b1bb28:::benchmark_data_smithi188_77607_object116608:head# 2024-04-01T19:28:38.647 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68b1ebf9:::benchmark_data_smithi188_77607_object124600:head# 2024-04-01T19:28:38.647 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68b25525:::benchmark_data_smithi188_77607_object116992:head# 2024-04-01T19:28:38.648 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:38.648 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68b25dd1:::benchmark_data_smithi188_77607_object124624:head# 2024-04-01T19:28:38.648 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68b30070:::benchmark_data_smithi188_77607_object116324:head# 2024-04-01T19:28:38.649 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68b3121a:::benchmark_data_smithi188_77607_object101055:head# 2024-04-01T19:28:38.649 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68b34dee:::benchmark_data_smithi188_77607_object146346:head# 2024-04-01T19:28:38.649 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68b44d54:::benchmark_data_smithi188_77607_object112454:head# 2024-04-01T19:28:38.650 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68b59ed6:::benchmark_data_smithi188_77607_object103561:head# 2024-04-01T19:28:38.650 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68b63ecf:::benchmark_data_smithi188_77607_object125328:head# 2024-04-01T19:28:38.651 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68b69f2b:::benchmark_data_smithi188_77607_object108133:head# 2024-04-01T19:28:38.651 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68b6fac3:::benchmark_data_smithi188_77607_object112782:head# 2024-04-01T19:28:38.652 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68b79840:::benchmark_data_smithi188_77607_object118688:head# 2024-04-01T19:28:38.652 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68ba534e:::benchmark_data_smithi188_77607_object118645:head# 2024-04-01T19:28:38.653 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68be330e:::benchmark_data_smithi188_77607_object116099:head# 2024-04-01T19:28:38.653 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68c2739a:::benchmark_data_smithi188_77607_object110481:head# 2024-04-01T19:28:38.654 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68c44d11:::benchmark_data_smithi188_77607_object162314:head# 2024-04-01T19:28:38.654 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68c4b02c:::benchmark_data_smithi188_77607_object125182:head# 2024-04-01T19:28:38.655 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68c73205:::benchmark_data_smithi188_77607_object121553:head# 2024-04-01T19:28:38.655 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:28:38.656 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68c7e8ed:::benchmark_data_smithi188_77607_object115219:head# 2024-04-01T19:28:38.656 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68c8c55d:::benchmark_data_smithi188_77607_object139230:head# 2024-04-01T19:28:38.657 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68ca9874:::benchmark_data_smithi188_77607_object166849:head# 2024-04-01T19:28:38.657 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68ca99be:::benchmark_data_smithi188_77607_object104434:head# 2024-04-01T19:28:38.657 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68cbbbe5:::benchmark_data_smithi188_77607_object142490:head# 2024-04-01T19:28:38.659 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68cbfaa8:::benchmark_data_smithi188_77607_object129673:head# 2024-04-01T19:28:38.659 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68cc9f12:::benchmark_data_smithi188_77607_object134148:head# 2024-04-01T19:28:38.659 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68ccc0dd:::benchmark_data_smithi188_77607_object159799:head# 2024-04-01T19:28:38.659 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68ccd573:::benchmark_data_smithi188_77607_object118874:head# 2024-04-01T19:28:38.660 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68cd06eb:::benchmark_data_smithi188_77607_object128389:head# 2024-04-01T19:28:38.660 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68cd94ec:::benchmark_data_smithi188_77607_object142823:head# 2024-04-01T19:28:38.661 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68cdcf5a:::benchmark_data_smithi188_77607_object124436:head# 2024-04-01T19:28:38.661 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68ce5bf5:::benchmark_data_smithi188_77607_object164158:head# 2024-04-01T19:28:38.662 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68cf2098:::benchmark_data_smithi188_77607_object160471:head# 2024-04-01T19:28:38.662 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68cf3e43:::benchmark_data_smithi188_77607_object98306:head# 2024-04-01T19:28:38.663 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68cf9ccc:::benchmark_data_smithi188_77607_object152609:head# 2024-04-01T19:28:38.663 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68d1cdb8:::benchmark_data_smithi188_77607_object159556:head# 2024-04-01T19:28:38.665 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68d33202:::benchmark_data_smithi188_77607_object164100:head# 2024-04-01T19:28:38.665 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68d3ac61:::benchmark_data_smithi188_77607_object163660:head# 2024-04-01T19:28:38.666 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68d91b4b:::benchmark_data_smithi188_77607_object120676:head# 2024-04-01T19:28:38.666 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:28:38.667 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68d99491:::benchmark_data_smithi188_77607_object167149:head# 2024-04-01T19:28:38.667 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68da8ee1:::benchmark_data_smithi188_77607_object98207:head# 2024-04-01T19:28:38.667 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68dc0ef0:::benchmark_data_smithi188_77607_object134897:head# 2024-04-01T19:28:38.668 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68dc67aa:::benchmark_data_smithi188_77607_object110197:head# 2024-04-01T19:28:38.668 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:38.669 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68de2484:::benchmark_data_smithi188_77607_object156551:head# 2024-04-01T19:28:38.669 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:28:38.670 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68de2e1c:::benchmark_data_smithi188_77607_object166386:head# 2024-04-01T19:28:38.670 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68de8a17:::benchmark_data_smithi188_77607_object132657:head# 2024-04-01T19:28:38.670 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68df04f6:::benchmark_data_smithi188_77607_object147723:head# 2024-04-01T19:28:38.671 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68e013af:::benchmark_data_smithi188_77607_object138872:head# 2024-04-01T19:28:38.671 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68e0184f:::benchmark_data_smithi188_77607_object120351:head# 2024-04-01T19:28:38.672 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68e149c7:::benchmark_data_smithi188_77607_object160314:head# 2024-04-01T19:28:38.672 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68e27ede:::benchmark_data_smithi188_77607_object162721:head# 2024-04-01T19:28:38.672 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68e393a2:::benchmark_data_smithi188_77607_object136878:head# 2024-04-01T19:28:38.673 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68e3cca7:::benchmark_data_smithi188_77607_object150644:head# 2024-04-01T19:28:38.673 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68ea9b78:::benchmark_data_smithi188_77607_object161676:head# 2024-04-01T19:28:38.674 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68ecca96:::benchmark_data_smithi188_77607_object116449:head# 2024-04-01T19:28:38.674 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68ecf374:::benchmark_data_smithi188_77607_object105163:head# 2024-04-01T19:28:38.675 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68eda323:::benchmark_data_smithi188_77607_object151989:head# 2024-04-01T19:28:38.675 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68edddc6:::benchmark_data_smithi188_77607_object150359:head# 2024-04-01T19:28:38.676 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68eea044:::benchmark_data_smithi188_77607_object154696:head# 2024-04-01T19:28:38.676 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68ef9f0e:::benchmark_data_smithi188_77607_object136548:head# 2024-04-01T19:28:38.677 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68f13b68:::benchmark_data_smithi188_77607_object120164:head# 2024-04-01T19:28:38.677 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68f18624:::benchmark_data_smithi188_77607_object133532:head# 2024-04-01T19:28:38.678 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68f27b72:::benchmark_data_smithi188_77607_object148372:head# 2024-04-01T19:28:38.678 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68f2fedd:::benchmark_data_smithi188_77607_object123807:head# 2024-04-01T19:28:38.678 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68f5d851:::benchmark_data_smithi188_77607_object151813:head# 2024-04-01T19:28:38.679 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68f63462:::benchmark_data_smithi188_77607_object115762:head# 2024-04-01T19:28:38.679 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68f64a04:::benchmark_data_smithi188_77607_object131100:head# 2024-04-01T19:28:38.680 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68f6c20d:::benchmark_data_smithi188_77607_object137570:head# 2024-04-01T19:28:38.680 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68f9f228:::benchmark_data_smithi188_77607_object132465:head# 2024-04-01T19:28:38.681 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68fb15ce:::benchmark_data_smithi188_77607_object116693:head# 2024-04-01T19:28:38.681 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68fb4d7d:::benchmark_data_smithi188_77607_object164828:head# 2024-04-01T19:28:38.682 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68fc222c:::benchmark_data_smithi188_77607_object100954:head# 2024-04-01T19:28:38.682 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68fd8569:::benchmark_data_smithi188_77607_object103492:head# 2024-04-01T19:28:38.683 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68fe4967:::benchmark_data_smithi188_77607_object133468:head# 2024-04-01T19:28:38.683 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68fe5841:::benchmark_data_smithi188_77607_object102746:head# 2024-04-01T19:28:38.684 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68fe8e93:::benchmark_data_smithi188_77607_object137495:head# 2024-04-01T19:28:38.684 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68fec9ac:::benchmark_data_smithi188_77607_object108856:head# 2024-04-01T19:28:38.685 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:68ff9894:::benchmark_data_smithi188_77607_object134876:head# 2024-04-01T19:28:38.685 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69009653:::benchmark_data_smithi188_77607_object143676:head# 2024-04-01T19:28:38.686 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6900dbb6:::benchmark_data_smithi188_77607_object113548:head# 2024-04-01T19:28:38.686 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6900edc9:::benchmark_data_smithi188_77607_object124444:head# 2024-04-01T19:28:38.687 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6900f131:::benchmark_data_smithi188_77607_object150585:head# 2024-04-01T19:28:38.687 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6901bfe0:::benchmark_data_smithi188_77607_object157619:head# 2024-04-01T19:28:38.688 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69038019:::benchmark_data_smithi188_77607_object117336:head# 2024-04-01T19:28:38.689 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6903ba0d:::benchmark_data_smithi188_77607_object130137:head# 2024-04-01T19:28:38.689 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:690426bb:::benchmark_data_smithi188_77607_object129767:head# 2024-04-01T19:28:38.689 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69044e87:::benchmark_data_smithi188_77607_object102797:head# 2024-04-01T19:28:38.690 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69048b70:::benchmark_data_smithi188_77607_object136858:head# 2024-04-01T19:28:38.690 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69049ffb:::benchmark_data_smithi188_77607_object118927:head# 2024-04-01T19:28:38.691 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69057bd2:::benchmark_data_smithi188_77607_object156499:head# 2024-04-01T19:28:38.691 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69057e9b:::benchmark_data_smithi188_77607_object136589:head# 2024-04-01T19:28:38.692 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69058ef7:::benchmark_data_smithi188_77607_object134931:head# 2024-04-01T19:28:38.692 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69089e2b:::benchmark_data_smithi188_77607_object134706:head# 2024-04-01T19:28:38.693 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:690990e8:::benchmark_data_smithi188_77607_object132396:head# 2024-04-01T19:28:38.693 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:690a16d2:::benchmark_data_smithi188_77607_object112659:head# 2024-04-01T19:28:38.694 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:690aea75:::benchmark_data_smithi188_77607_object147696:head# 2024-04-01T19:28:38.694 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:690b7192:::benchmark_data_smithi188_77607_object152322:head# 2024-04-01T19:28:38.695 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:690c9391:::benchmark_data_smithi188_77607_object165481:head# 2024-04-01T19:28:38.695 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:690e6c6e:::benchmark_data_smithi188_77607_object101609:head# 2024-04-01T19:28:38.696 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:690f4ec1:::benchmark_data_smithi188_77607_object162178:head# 2024-04-01T19:28:38.696 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:690f6ee3:::benchmark_data_smithi188_77607_object166608:head# 2024-04-01T19:28:38.697 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:690fbbfc:::benchmark_data_smithi188_77607_object137805:head# 2024-04-01T19:28:38.697 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:690fbd1e:::benchmark_data_smithi188_77607_object114817:head# 2024-04-01T19:28:38.698 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:691006ae:::benchmark_data_smithi188_77607_object98265:head# 2024-04-01T19:28:38.698 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6915bd24:::benchmark_data_smithi188_77607_object107093:head# 2024-04-01T19:28:38.699 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6916ebe3:::benchmark_data_smithi188_77607_object140098:head# 2024-04-01T19:28:38.699 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6917eb7e:::benchmark_data_smithi188_77607_object103405:head# 2024-04-01T19:28:38.700 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6918601a:::benchmark_data_smithi188_77607_object141908:head# 2024-04-01T19:28:38.700 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69186e1b:::benchmark_data_smithi188_77607_object165779:head# 2024-04-01T19:28:38.701 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6919c96d:::benchmark_data_smithi188_77607_object143884:head# 2024-04-01T19:28:38.701 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:691aed5b:::benchmark_data_smithi188_77607_object152102:head# 2024-04-01T19:28:38.702 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:691ca5e9:::benchmark_data_smithi188_77607_object108054:head# 2024-04-01T19:28:38.702 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:691cae42:::benchmark_data_smithi188_77607_object121511:head# 2024-04-01T19:28:38.703 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:691cc139:::benchmark_data_smithi188_77607_object155956:head# 2024-04-01T19:28:38.703 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:691d88a1:::benchmark_data_smithi188_77607_object159034:head# 2024-04-01T19:28:38.704 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:691dafdd:::benchmark_data_smithi188_77607_object159635:head# 2024-04-01T19:28:38.704 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:691e9474:::benchmark_data_smithi188_77607_object123736:head# 2024-04-01T19:28:38.705 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:691ffaaf:::benchmark_data_smithi188_77607_object144596:head# 2024-04-01T19:28:38.706 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6920cc51:::benchmark_data_smithi188_77607_object154548:head# 2024-04-01T19:28:38.706 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6923a628:::benchmark_data_smithi188_77607_object137321:head# 2024-04-01T19:28:38.707 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6924cc16:::benchmark_data_smithi188_77607_object113585:head# 2024-04-01T19:28:38.707 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6927db22:::benchmark_data_smithi188_77607_object99329:head# 2024-04-01T19:28:38.708 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69297795:::benchmark_data_smithi188_77607_object156900:head# 2024-04-01T19:28:38.708 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6929d5a8:::benchmark_data_smithi188_77607_object99700:head# 2024-04-01T19:28:38.709 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:692ae458:::benchmark_data_smithi188_77607_object157810:head# 2024-04-01T19:28:38.709 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:692b30de:::benchmark_data_smithi188_77607_object115235:head# 2024-04-01T19:28:38.710 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:692ba982:::benchmark_data_smithi188_77607_object153025:head# 2024-04-01T19:28:38.710 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:692bfe36:::benchmark_data_smithi188_77607_object129489:head# 2024-04-01T19:28:38.711 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:692e7814:::benchmark_data_smithi188_77607_object141759:head# 2024-04-01T19:28:38.711 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:692ef4de:::benchmark_data_smithi188_77607_object107769:head# 2024-04-01T19:28:38.711 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:692fa27e:::benchmark_data_smithi188_77607_object110151:head# 2024-04-01T19:28:38.712 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:692fc947:::benchmark_data_smithi188_77607_object104909:head# 2024-04-01T19:28:38.713 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69317f16:::benchmark_data_smithi188_77607_object134967:head# 2024-04-01T19:28:38.713 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6934ff6d:::benchmark_data_smithi188_77607_object165191:head# 2024-04-01T19:28:38.714 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6935e119:::benchmark_data_smithi188_77607_object101019:head# 2024-04-01T19:28:38.714 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69378697:::benchmark_data_smithi188_77607_object116641:head# 2024-04-01T19:28:38.715 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6937adc7:::benchmark_data_smithi188_77607_object150425:head# 2024-04-01T19:28:38.715 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:693a43c3:::benchmark_data_smithi188_77607_object141458:head# 2024-04-01T19:28:38.716 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:693cd257:::benchmark_data_smithi188_77607_object137505:head# 2024-04-01T19:28:38.716 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:693d70a9:::benchmark_data_smithi188_77607_object103967:head# 2024-04-01T19:28:38.717 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:693d8582:::benchmark_data_smithi188_77607_object120604:head# 2024-04-01T19:28:38.717 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:693f0c9a:::benchmark_data_smithi188_77607_object147796:head# 2024-04-01T19:28:38.717 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:693f1769:::benchmark_data_smithi188_77607_object160230:head# 2024-04-01T19:28:38.718 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69412497:::benchmark_data_smithi188_77607_object126908:head# 2024-04-01T19:28:38.718 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69418373:::benchmark_data_smithi188_77607_object160070:head# 2024-04-01T19:28:38.719 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69418dce:::benchmark_data_smithi188_77607_object157698:head# 2024-04-01T19:28:38.719 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6942fcb0:::benchmark_data_smithi188_77607_object100707:head# 2024-04-01T19:28:38.720 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6943b09c:::benchmark_data_smithi188_77607_object165922:head# 2024-04-01T19:28:38.720 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:694463a7:::benchmark_data_smithi188_77607_object141950:head# 2024-04-01T19:28:38.721 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69448081:::benchmark_data_smithi188_77607_object155405:head# 2024-04-01T19:28:38.721 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69453ba9:::benchmark_data_smithi188_77607_object151397:head# 2024-04-01T19:28:38.722 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6945fb2b:::benchmark_data_smithi188_77607_object127609:head# 2024-04-01T19:28:38.722 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6948963b:::benchmark_data_smithi188_77607_object140447:head# 2024-04-01T19:28:38.723 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6949319b:::benchmark_data_smithi188_77607_object166023:head# 2024-04-01T19:28:38.723 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:694dc7ad:::benchmark_data_smithi188_77607_object147999:head# 2024-04-01T19:28:38.724 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:694dfd95:::benchmark_data_smithi188_77607_object122866:head# 2024-04-01T19:28:38.724 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69500f7d:::benchmark_data_smithi188_77607_object156664:head# 2024-04-01T19:28:38.725 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6950965b:::benchmark_data_smithi188_77607_object154140:head# 2024-04-01T19:28:38.725 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6951a8f7:::benchmark_data_smithi188_77607_object146152:head# 2024-04-01T19:28:38.726 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69538a15:::benchmark_data_smithi188_77607_object127905:head# 2024-04-01T19:28:38.727 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69544404:::benchmark_data_smithi188_77607_object125912:head# 2024-04-01T19:28:38.727 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69551ca4:::benchmark_data_smithi188_77607_object119480:head# 2024-04-01T19:28:38.728 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69551fd0:::benchmark_data_smithi188_77607_object128842:head# 2024-04-01T19:28:38.728 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69553a0f:::benchmark_data_smithi188_77607_object160164:head# 2024-04-01T19:28:38.729 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6955977d:::benchmark_data_smithi188_77607_object145744:head# 2024-04-01T19:28:38.729 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69559ca1:::benchmark_data_smithi188_77607_object120606:head# 2024-04-01T19:28:38.730 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6955c174:::benchmark_data_smithi188_77607_object158588:head# 2024-04-01T19:28:38.730 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6955ef87:::benchmark_data_smithi188_77607_object151538:head# 2024-04-01T19:28:38.730 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69565fac:::benchmark_data_smithi188_77607_object129828:head# 2024-04-01T19:28:38.731 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6956ac73:::benchmark_data_smithi188_77607_object164169:head# 2024-04-01T19:28:38.731 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6957f3ae:::benchmark_data_smithi188_77607_object163720:head# 2024-04-01T19:28:38.732 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:695a45ff:::benchmark_data_smithi188_77607_object139271:head# 2024-04-01T19:28:38.732 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:695a8885:::benchmark_data_smithi188_77607_object134253:head# 2024-04-01T19:28:38.733 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:695bc4d7:::benchmark_data_smithi188_77607_object146469:head# 2024-04-01T19:28:38.733 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:695bf785:::benchmark_data_smithi188_77607_object99052:head# 2024-04-01T19:28:38.734 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:695c614c:::benchmark_data_smithi188_77607_object124603:head# 2024-04-01T19:28:38.734 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:695d060b:::benchmark_data_smithi188_77607_object124565:head# 2024-04-01T19:28:38.735 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:695d3653:::benchmark_data_smithi188_77607_object138061:head# 2024-04-01T19:28:38.735 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:695ebac5:::benchmark_data_smithi188_77607_object145537:head# 2024-04-01T19:28:38.736 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69612a3f:::benchmark_data_smithi188_77607_object124764:head# 2024-04-01T19:28:38.736 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6961ee41:::benchmark_data_smithi188_77607_object159266:head# 2024-04-01T19:28:38.736 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69625f73:::benchmark_data_smithi188_77607_object165462:head# 2024-04-01T19:28:38.737 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69638705:::benchmark_data_smithi188_77607_object131507:head# 2024-04-01T19:28:38.737 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6964c39a:::benchmark_data_smithi188_77607_object124950:head# 2024-04-01T19:28:38.738 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69669eef:::benchmark_data_smithi188_77607_object156734:head# 2024-04-01T19:28:38.738 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:696764f3:::benchmark_data_smithi188_77607_object105620:head# 2024-04-01T19:28:38.739 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6967c64f:::benchmark_data_smithi188_77607_object136011:head# 2024-04-01T19:28:38.739 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6969225c:::benchmark_data_smithi188_77607_object118504:head# 2024-04-01T19:28:38.740 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69692d86:::benchmark_data_smithi188_77607_object157121:head# 2024-04-01T19:28:38.740 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6969705e:::benchmark_data_smithi188_77607_object134817:head# 2024-04-01T19:28:38.740 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6969bd3d:::benchmark_data_smithi188_77607_object150824:head# 2024-04-01T19:28:38.741 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6969bde2:::benchmark_data_smithi188_77607_object143477:head# 2024-04-01T19:28:38.741 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6969e07d:::benchmark_data_smithi188_77607_object147337:head# 2024-04-01T19:28:38.742 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:696a55e0:::benchmark_data_smithi188_77607_object112992:head# 2024-04-01T19:28:38.742 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:696a91e1:::benchmark_data_smithi188_77607_object153656:head# 2024-04-01T19:28:38.743 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:696b1235:::benchmark_data_smithi188_77607_object156863:head# 2024-04-01T19:28:38.743 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:696c0148:::benchmark_data_smithi188_77607_object150796:head# 2024-04-01T19:28:38.744 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69706f2c:::benchmark_data_smithi188_77607_object154086:head# 2024-04-01T19:28:38.745 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69713f28:::benchmark_data_smithi188_77607_object129393:head# 2024-04-01T19:28:38.745 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69718e83:::benchmark_data_smithi188_77607_object153265:head# 2024-04-01T19:28:38.746 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6971d830:::benchmark_data_smithi188_77607_object145884:head# 2024-04-01T19:28:38.746 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69720a83:::benchmark_data_smithi188_77607_object110398:head# 2024-04-01T19:28:38.747 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6972204c:::benchmark_data_smithi188_77607_object104144:head# 2024-04-01T19:28:38.747 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6974b1fd:::benchmark_data_smithi188_77607_object148351:head# 2024-04-01T19:28:38.748 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:697644fa:::benchmark_data_smithi188_77607_object136435:head# 2024-04-01T19:28:38.748 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:697745ea:::benchmark_data_smithi188_77607_object104951:head# 2024-04-01T19:28:38.749 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69784dbe:::benchmark_data_smithi188_77607_object161775:head# 2024-04-01T19:28:38.750 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6978c6bc:::benchmark_data_smithi188_77607_object157684:head# 2024-04-01T19:28:38.750 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69790914:::benchmark_data_smithi188_77607_object101642:head# 2024-04-01T19:28:38.751 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:697a4dac:::benchmark_data_smithi188_77607_object165569:head# 2024-04-01T19:28:38.751 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:697a55eb:::benchmark_data_smithi188_77607_object139150:head# 2024-04-01T19:28:38.752 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:697aae76:::benchmark_data_smithi188_77607_object156456:head# 2024-04-01T19:28:38.752 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:697b990e:::benchmark_data_smithi188_77607_object113763:head# 2024-04-01T19:28:38.752 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:697c1842:::benchmark_data_smithi188_77607_object153859:head# 2024-04-01T19:28:38.753 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:697cd971:::benchmark_data_smithi188_77607_object110140:head# 2024-04-01T19:28:38.754 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6980c157:::benchmark_data_smithi188_77607_object143558:head# 2024-04-01T19:28:38.754 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:698216ae:::benchmark_data_smithi188_77607_object163827:head# 2024-04-01T19:28:38.755 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6983a203:::benchmark_data_smithi188_77607_object134271:head# 2024-04-01T19:28:38.755 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6984116c:::benchmark_data_smithi188_77607_object165599:head# 2024-04-01T19:28:38.755 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69849c97:::benchmark_data_smithi188_77607_object157128:head# 2024-04-01T19:28:38.756 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69850904:::benchmark_data_smithi188_77607_object148933:head# 2024-04-01T19:28:38.756 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69856c8b:::benchmark_data_smithi188_77607_object151344:head# 2024-04-01T19:28:38.757 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6985eb79:::benchmark_data_smithi188_77607_object156218:head# 2024-04-01T19:28:38.757 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:698600e4:::benchmark_data_smithi188_77607_object109307:head# 2024-04-01T19:28:38.758 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69861939:::benchmark_data_smithi188_77607_object154890:head# 2024-04-01T19:28:38.758 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69868056:::benchmark_data_smithi188_77607_object142435:head# 2024-04-01T19:28:38.759 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6986883b:::benchmark_data_smithi188_77607_object122162:head# 2024-04-01T19:28:38.760 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6986f43d:::benchmark_data_smithi188_77607_object145039:head# 2024-04-01T19:28:38.760 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:698801e8:::benchmark_data_smithi188_77607_object103314:head# 2024-04-01T19:28:38.760 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6988e885:::benchmark_data_smithi188_77607_object98521:head# 2024-04-01T19:28:38.761 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:698906f1:::benchmark_data_smithi188_77607_object133366:head# 2024-04-01T19:28:38.762 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:698a02a3:::benchmark_data_smithi188_77607_object140482:head# 2024-04-01T19:28:38.762 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:698c3b49:::benchmark_data_smithi188_77607_object126071:head# 2024-04-01T19:28:38.763 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:698cc1e5:::benchmark_data_smithi188_77607_object116351:head# 2024-04-01T19:28:38.764 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:698d1ff3:::benchmark_data_smithi188_77607_object159696:head# 2024-04-01T19:28:38.764 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:698d319a:::benchmark_data_smithi188_77607_object166170:head# 2024-04-01T19:28:38.764 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:698d51d9:::benchmark_data_smithi188_77607_object164518:head# 2024-04-01T19:28:38.765 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:698dfb67:::benchmark_data_smithi188_77607_object118023:head# 2024-04-01T19:28:38.765 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:698e25bb:::benchmark_data_smithi188_77607_object153273:head# 2024-04-01T19:28:38.766 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:698e8f32:::benchmark_data_smithi188_77607_object110951:head# 2024-04-01T19:28:38.766 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:698ef146:::benchmark_data_smithi188_77607_object155154:head# 2024-04-01T19:28:38.767 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:698fc2ac:::benchmark_data_smithi188_77607_object111689:head# 2024-04-01T19:28:38.767 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69927658:::benchmark_data_smithi188_77607_object124538:head# 2024-04-01T19:28:38.768 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6992d30a:::benchmark_data_smithi188_77607_object100140:head# 2024-04-01T19:28:38.768 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:699864fe:::benchmark_data_smithi188_77607_object121172:head# 2024-04-01T19:28:38.769 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6998c6c7:::benchmark_data_smithi188_77607_object113512:head# 2024-04-01T19:28:38.769 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6999552e:::benchmark_data_smithi188_77607_object140802:head# 2024-04-01T19:28:38.770 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:28:38.770 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69998066:::benchmark_data_smithi188_77607_object102796:head# 2024-04-01T19:28:38.771 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:699a1f1e:::benchmark_data_smithi188_77607_object106643:head# 2024-04-01T19:28:38.771 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:699a5eae:::benchmark_data_smithi188_77607_object133653:head# 2024-04-01T19:28:38.772 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:699b51ee:::benchmark_data_smithi188_77607_object135957:head# 2024-04-01T19:28:38.772 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:699bef31:::benchmark_data_smithi188_77607_object104201:head# 2024-04-01T19:28:38.772 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:699ddaa9:::benchmark_data_smithi188_77607_object104540:head# 2024-04-01T19:28:38.773 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:699e0d48:::benchmark_data_smithi188_77607_object131910:head# 2024-04-01T19:28:38.773 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:699e5cf5:::benchmark_data_smithi188_77607_object120373:head# 2024-04-01T19:28:38.774 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:699ec260:::benchmark_data_smithi188_77607_object112185:head# 2024-04-01T19:28:38.774 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:699f5974:::benchmark_data_smithi188_77607_object134753:head# 2024-04-01T19:28:38.774 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:699f86b4:::benchmark_data_smithi188_77607_object167323:head# 2024-04-01T19:28:38.775 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69a11f4f:::benchmark_data_smithi188_77607_object108662:head# 2024-04-01T19:28:38.775 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69a1f295:::benchmark_data_smithi188_77607_object98507:head# 2024-04-01T19:28:38.776 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69a24ab2:::benchmark_data_smithi188_77607_object149972:head# 2024-04-01T19:28:38.776 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69a42c22:::benchmark_data_smithi188_77607_object133169:head# 2024-04-01T19:28:38.777 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69a50f81:::benchmark_data_smithi188_77607_object109675:head# 2024-04-01T19:28:38.777 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69a79dd9:::benchmark_data_smithi188_77607_object135299:head# 2024-04-01T19:28:38.778 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69a8d9e0:::benchmark_data_smithi188_77607_object133621:head# 2024-04-01T19:28:38.778 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69a95322:::benchmark_data_smithi188_77607_object166032:head# 2024-04-01T19:28:38.779 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69a95b40:::benchmark_data_smithi188_77607_object124897:head# 2024-04-01T19:28:38.779 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69a9953f:::benchmark_data_smithi188_77607_object126585:head# 2024-04-01T19:28:38.779 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69aae79b:::benchmark_data_smithi188_77607_object142956:head# 2024-04-01T19:28:38.780 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69aaf92b:::benchmark_data_smithi188_77607_object103865:head# 2024-04-01T19:28:38.780 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69ab7bc0:::benchmark_data_smithi188_77607_object149120:head# 2024-04-01T19:28:38.781 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69ad2dcc:::benchmark_data_smithi188_77607_object133642:head# 2024-04-01T19:28:38.781 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69b2e196:::benchmark_data_smithi188_77607_object144454:head# 2024-04-01T19:28:38.782 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69b330f8:::benchmark_data_smithi188_77607_object155872:head# 2024-04-01T19:28:38.782 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69b36a41:::benchmark_data_smithi188_77607_object136209:head# 2024-04-01T19:28:38.783 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69b440ee:::benchmark_data_smithi188_77607_object163686:head# 2024-04-01T19:28:38.783 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69b69d83:::benchmark_data_smithi188_77607_object123212:head# 2024-04-01T19:28:38.783 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69b6c9ed:::benchmark_data_smithi188_77607_object132871:head# 2024-04-01T19:28:38.784 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69b6cb51:::benchmark_data_smithi188_77607_object121877:head# 2024-04-01T19:28:38.784 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69b79792:::benchmark_data_smithi188_77607_object149375:head# 2024-04-01T19:28:38.784 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69b8d748:::benchmark_data_smithi188_77607_object107418:head# 2024-04-01T19:28:38.785 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69ba7add:::benchmark_data_smithi188_77607_object143617:head# 2024-04-01T19:28:38.785 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69ba982c:::benchmark_data_smithi188_77607_object163766:head# 2024-04-01T19:28:38.786 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69bacc21:::benchmark_data_smithi188_77607_object124101:head# 2024-04-01T19:28:38.786 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69bc203f:::benchmark_data_smithi188_77607_object129419:head# 2024-04-01T19:28:38.787 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69bcbec0:::benchmark_data_smithi188_77607_object162833:head# 2024-04-01T19:28:38.787 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69bcfc3f:::benchmark_data_smithi188_77607_object122886:head# 2024-04-01T19:28:38.788 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69be0610:::benchmark_data_smithi188_77607_object107059:head# 2024-04-01T19:28:38.788 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69be2127:::benchmark_data_smithi188_77607_object105731:head# 2024-04-01T19:28:38.789 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69be31dd:::benchmark_data_smithi188_77607_object127577:head# 2024-04-01T19:28:38.789 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69be4812:::benchmark_data_smithi188_77607_object101053:head# 2024-04-01T19:28:38.789 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69be5494:::benchmark_data_smithi188_77607_object135993:head# 2024-04-01T19:28:38.790 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69beed86:::benchmark_data_smithi188_77607_object139899:head# 2024-04-01T19:28:38.790 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69bfe9fe:::benchmark_data_smithi188_77607_object119617:head# 2024-04-01T19:28:38.791 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69c20f41:::benchmark_data_smithi188_77607_object137019:head# 2024-04-01T19:28:38.791 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69c23f49:::benchmark_data_smithi188_77607_object111507:head# 2024-04-01T19:28:38.792 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69c3093d:::benchmark_data_smithi188_77607_object106491:head# 2024-04-01T19:28:38.792 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69c31229:::benchmark_data_smithi188_77607_object132836:head# 2024-04-01T19:28:38.793 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69c331f2:::benchmark_data_smithi188_77607_object102738:head# 2024-04-01T19:28:38.793 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69c4df11:::benchmark_data_smithi188_77607_object166976:head# 2024-04-01T19:28:38.793 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69c56021:::benchmark_data_smithi188_77607_object163512:head# 2024-04-01T19:28:38.794 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69c56b31:::benchmark_data_smithi188_77607_object104154:head# 2024-04-01T19:28:38.794 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69c57f8b:::benchmark_data_smithi188_77607_object144647:head# 2024-04-01T19:28:38.795 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69c5ccb1:::benchmark_data_smithi188_77607_object149843:head# 2024-04-01T19:28:38.795 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69c7d92e:::benchmark_data_smithi188_77607_object166129:head# 2024-04-01T19:28:38.796 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69c91c7e:::benchmark_data_smithi188_77607_object101845:head# 2024-04-01T19:28:38.796 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69ca625c:::benchmark_data_smithi188_77607_object139694:head# 2024-04-01T19:28:38.796 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:38.797 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69cad787:::benchmark_data_smithi188_77607_object166534:head# 2024-04-01T19:28:38.797 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69cc3c51:::benchmark_data_smithi188_77607_object153605:head# 2024-04-01T19:28:38.797 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69ccc2f7:::benchmark_data_smithi188_77607_object140654:head# 2024-04-01T19:28:38.798 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69cdd6f5:::benchmark_data_smithi188_77607_object131434:head# 2024-04-01T19:28:38.798 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69ce165e:::benchmark_data_smithi188_77607_object124857:head# 2024-04-01T19:28:38.799 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69ce2999:::benchmark_data_smithi188_77607_object125853:head# 2024-04-01T19:28:38.799 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69cf967e:::benchmark_data_smithi188_77607_object156317:head# 2024-04-01T19:28:38.800 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69d0d24d:::benchmark_data_smithi188_77607_object154133:head# 2024-04-01T19:28:38.800 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69d1e8c5:::benchmark_data_smithi188_77607_object141970:head# 2024-04-01T19:28:38.800 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69d23a31:::benchmark_data_smithi188_77607_object114264:head# 2024-04-01T19:28:38.801 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69d2f63a:::benchmark_data_smithi188_77607_object155434:head# 2024-04-01T19:28:38.801 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69d3f72f:::benchmark_data_smithi188_77607_object149027:head# 2024-04-01T19:28:38.802 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69d73b89:::benchmark_data_smithi188_77607_object166417:head# 2024-04-01T19:28:38.802 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69d7dfd4:::benchmark_data_smithi188_77607_object104237:head# 2024-04-01T19:28:38.803 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69d922c1:::benchmark_data_smithi188_77607_object144124:head# 2024-04-01T19:28:38.803 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69d96614:::benchmark_data_smithi188_77607_object109674:head# 2024-04-01T19:28:38.803 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69d97f3e:::benchmark_data_smithi188_77607_object124812:head# 2024-04-01T19:28:38.804 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69dac38f:::benchmark_data_smithi188_77607_object108715:head# 2024-04-01T19:28:38.804 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69db5e1b:::benchmark_data_smithi188_77607_object147697:head# 2024-04-01T19:28:38.805 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69dbb804:::benchmark_data_smithi188_77607_object143139:head# 2024-04-01T19:28:38.805 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69dd2da8:::benchmark_data_smithi188_77607_object127035:head# 2024-04-01T19:28:38.806 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69deee59:::benchmark_data_smithi188_77607_object145489:head# 2024-04-01T19:28:38.806 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69e0be33:::benchmark_data_smithi188_77607_object135995:head# 2024-04-01T19:28:38.807 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69e20894:::benchmark_data_smithi188_77607_object158472:head# 2024-04-01T19:28:38.807 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69e26025:::benchmark_data_smithi188_77607_object112712:head# 2024-04-01T19:28:38.808 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69e26d23:::benchmark_data_smithi188_77607_object144189:head# 2024-04-01T19:28:38.808 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69e2cd4f:::benchmark_data_smithi188_77607_object139244:head# 2024-04-01T19:28:38.809 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69e40e4c:::benchmark_data_smithi188_77607_object125597:head# 2024-04-01T19:28:38.809 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69e45d8b:::benchmark_data_smithi188_77607_object134684:head# 2024-04-01T19:28:38.811 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69e80eca:::benchmark_data_smithi188_77607_object121379:head# 2024-04-01T19:28:38.812 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69e8345f:::benchmark_data_smithi188_77607_object147993:head# 2024-04-01T19:28:38.812 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69e99f1f:::benchmark_data_smithi188_77607_object105023:head# 2024-04-01T19:28:38.812 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69ea035f:::benchmark_data_smithi188_77607_object165689:head# 2024-04-01T19:28:38.813 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69ea2ad6:::benchmark_data_smithi188_77607_object161256:head# 2024-04-01T19:28:38.813 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69ea6d50:::benchmark_data_smithi188_77607_object122001:head# 2024-04-01T19:28:38.814 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69eb8d6d:::benchmark_data_smithi188_77607_object123923:head# 2024-04-01T19:28:38.814 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69ebc2ad:::benchmark_data_smithi188_77607_object162162:head# 2024-04-01T19:28:38.815 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69ec1541:::benchmark_data_smithi188_77607_object142185:head# 2024-04-01T19:28:38.815 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69ec6024:::benchmark_data_smithi188_77607_object162763:head# 2024-04-01T19:28:38.815 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69ed71d5:::benchmark_data_smithi188_77607_object149676:head# 2024-04-01T19:28:38.816 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:28:38.816 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69ee2615:::benchmark_data_smithi188_77607_object145573:head# 2024-04-01T19:28:38.817 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69eebcbd:::benchmark_data_smithi188_77607_object126488:head# 2024-04-01T19:28:38.817 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69efa500:::benchmark_data_smithi188_77607_object108018:head# 2024-04-01T19:28:38.817 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69f0509c:::benchmark_data_smithi188_77607_object136093:head# 2024-04-01T19:28:38.818 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69f08de1:::benchmark_data_smithi188_77607_object114237:head# 2024-04-01T19:28:38.818 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:38.819 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:28:38.819 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69f0977d:::benchmark_data_smithi188_77607_object159922:head# 2024-04-01T19:28:38.819 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69f1ccda:::benchmark_data_smithi188_77607_object160522:head# 2024-04-01T19:28:38.819 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69f4d219:::benchmark_data_smithi188_77607_object110069:head# 2024-04-01T19:28:38.820 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69f57dc0:::benchmark_data_smithi188_77607_object132778:head# 2024-04-01T19:28:38.820 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69f75553:::benchmark_data_smithi188_77607_object141158:head# 2024-04-01T19:28:38.821 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69f90f9c:::benchmark_data_smithi188_77607_object109890:head# 2024-04-01T19:28:38.822 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69f9f890:::benchmark_data_smithi188_77607_object98145:head# 2024-04-01T19:28:38.822 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69fb6b07:::benchmark_data_smithi188_77607_object112966:head# 2024-04-01T19:28:38.823 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69fdaeb9:::benchmark_data_smithi188_77607_object124491:head# 2024-04-01T19:28:38.823 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69fe0c54:::benchmark_data_smithi188_77607_object109670:head# 2024-04-01T19:28:38.824 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69fee7b6:::benchmark_data_smithi188_77607_object119631:head# 2024-04-01T19:28:38.824 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:69ff754b:::benchmark_data_smithi188_77607_object100120:head# 2024-04-01T19:28:38.825 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a0070f8:::benchmark_data_smithi188_77607_object135333:head# 2024-04-01T19:28:38.825 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a011813:::benchmark_data_smithi188_77607_object124496:head# 2024-04-01T19:28:38.826 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a015eb6:::benchmark_data_smithi188_77607_object143798:head# 2024-04-01T19:28:38.827 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a0333b1:::benchmark_data_smithi188_77607_object102451:head# 2024-04-01T19:28:38.827 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a043775:::benchmark_data_smithi188_77607_object130834:head# 2024-04-01T19:28:38.827 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a053c1d:::benchmark_data_smithi188_77607_object134494:head# 2024-04-01T19:28:38.828 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a05ad41:::benchmark_data_smithi188_77607_object154111:head# 2024-04-01T19:28:38.828 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a06211d:::benchmark_data_smithi188_77607_object144894:head# 2024-04-01T19:28:38.828 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a0641da:::benchmark_data_smithi188_77607_object116579:head# 2024-04-01T19:28:38.829 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a066329:::benchmark_data_smithi188_77607_object126089:head# 2024-04-01T19:28:38.829 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a073674:::benchmark_data_smithi188_77607_object141347:head# 2024-04-01T19:28:38.830 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a095113:::benchmark_data_smithi188_77607_object162907:head# 2024-04-01T19:28:38.830 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a0c6a9b:::benchmark_data_smithi188_77607_object102474:head# 2024-04-01T19:28:38.830 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a0d820d:::benchmark_data_smithi188_77607_object162128:head# 2024-04-01T19:28:38.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a0fc667:::benchmark_data_smithi188_77607_object135597:head# 2024-04-01T19:28:38.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a1086a1:::benchmark_data_smithi188_77607_object140465:head# 2024-04-01T19:28:38.832 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a10a2ef:::benchmark_data_smithi188_77607_object151249:head# 2024-04-01T19:28:38.832 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a10ad6c:::benchmark_data_smithi188_77607_object130484:head# 2024-04-01T19:28:38.833 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a131f4f:::benchmark_data_smithi188_77607_object119601:head# 2024-04-01T19:28:38.833 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a13b2cb:::benchmark_data_smithi188_77607_object153479:head# 2024-04-01T19:28:38.834 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a13ee94:::benchmark_data_smithi188_77607_object109485:head# 2024-04-01T19:28:38.834 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a149323:::benchmark_data_smithi188_77607_object97782:head# 2024-04-01T19:28:38.834 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a14f5ec:::benchmark_data_smithi188_77607_object104670:head# 2024-04-01T19:28:38.835 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a150f20:::benchmark_data_smithi188_77607_object127348:head# 2024-04-01T19:28:38.835 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a163771:::benchmark_data_smithi188_77607_object116525:head# 2024-04-01T19:28:38.836 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a1d34f2:::benchmark_data_smithi188_77607_object113919:head# 2024-04-01T19:28:38.836 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a21475c:::benchmark_data_smithi188_77607_object162239:head# 2024-04-01T19:28:38.837 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a24816a:::benchmark_data_smithi188_77607_object134997:head# 2024-04-01T19:28:38.837 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a2698b3:::benchmark_data_smithi188_77607_object138577:head# 2024-04-01T19:28:38.837 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a270939:::benchmark_data_smithi188_77607_object146178:head# 2024-04-01T19:28:38.838 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a270ab1:::benchmark_data_smithi188_77607_object142529:head# 2024-04-01T19:28:38.838 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a28e558:::benchmark_data_smithi188_77607_object117764:head# 2024-04-01T19:28:38.839 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a2c9b2a:::benchmark_data_smithi188_77607_object109769:head# 2024-04-01T19:28:38.839 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a2dada3:::benchmark_data_smithi188_77607_object153162:head# 2024-04-01T19:28:38.840 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a2e97f4:::benchmark_data_smithi188_77607_object98082:head# 2024-04-01T19:28:38.840 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a2ea59c:::benchmark_data_smithi188_77607_object132492:head# 2024-04-01T19:28:38.841 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a3033a5:::benchmark_data_smithi188_77607_object103533:head# 2024-04-01T19:28:38.841 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a31cc2f:::benchmark_data_smithi188_77607_object131360:head# 2024-04-01T19:28:38.842 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a331081:::benchmark_data_smithi188_77607_object136869:head# 2024-04-01T19:28:38.842 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a3495c3:::benchmark_data_smithi188_77607_object137579:head# 2024-04-01T19:28:38.843 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a351f55:::benchmark_data_smithi188_77607_object101168:head# 2024-04-01T19:28:38.843 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a355ed9:::benchmark_data_smithi188_77607_object139477:head# 2024-04-01T19:28:38.843 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a35bf17:::benchmark_data_smithi188_77607_object99284:head# 2024-04-01T19:28:38.844 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a35cf48:::benchmark_data_smithi188_77607_object167115:head# 2024-04-01T19:28:38.844 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a35eebc:::benchmark_data_smithi188_77607_object137126:head# 2024-04-01T19:28:38.845 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a39d634:::benchmark_data_smithi188_77607_object123258:head# 2024-04-01T19:28:38.845 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a39dbf7:::benchmark_data_smithi188_77607_object106841:head# 2024-04-01T19:28:38.846 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a3ec75d:::benchmark_data_smithi188_77607_object137576:head# 2024-04-01T19:28:38.846 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a3ee735:::benchmark_data_smithi188_77607_object138922:head# 2024-04-01T19:28:38.847 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a3f820e:::benchmark_data_smithi188_77607_object126105:head# 2024-04-01T19:28:38.847 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a403ed7:::benchmark_data_smithi188_77607_object158372:head# 2024-04-01T19:28:38.848 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a406ed8:::benchmark_data_smithi188_77607_object124936:head# 2024-04-01T19:28:38.848 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a408af4:::benchmark_data_smithi188_77607_object150293:head# 2024-04-01T19:28:38.848 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a40a5e6:::benchmark_data_smithi188_77607_object110617:head# 2024-04-01T19:28:38.849 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a40a92e:::benchmark_data_smithi188_77607_object134046:head# 2024-04-01T19:28:38.849 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a417d06:::benchmark_data_smithi188_77607_object104417:head# 2024-04-01T19:28:38.849 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a421142:::benchmark_data_smithi188_77607_object129501:head# 2024-04-01T19:28:38.850 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a44db68:::benchmark_data_smithi188_77607_object125012:head# 2024-04-01T19:28:38.850 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a46791e:::benchmark_data_smithi188_77607_object166547:head# 2024-04-01T19:28:38.851 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a47220d:::benchmark_data_smithi188_77607_object150047:head# 2024-04-01T19:28:38.851 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a484ed1:::benchmark_data_smithi188_77607_object119957:head# 2024-04-01T19:28:38.852 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a49c782:::benchmark_data_smithi188_77607_object105790:head# 2024-04-01T19:28:38.852 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a4a9375:::benchmark_data_smithi188_77607_object160180:head# 2024-04-01T19:28:38.853 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a4b55a7:::benchmark_data_smithi188_77607_object164445:head# 2024-04-01T19:28:38.853 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a4ccb6f:::benchmark_data_smithi188_77607_object118751:head# 2024-04-01T19:28:38.854 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a4dc200:::benchmark_data_smithi188_77607_object150213:head# 2024-04-01T19:28:38.854 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a4e05bd:::benchmark_data_smithi188_77607_object119858:head# 2024-04-01T19:28:38.855 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a4f3ea6:::benchmark_data_smithi188_77607_object135327:head# 2024-04-01T19:28:38.855 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a4fdb81:::benchmark_data_smithi188_77607_object101267:head# 2024-04-01T19:28:38.856 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a4fdf1e:::benchmark_data_smithi188_77607_object167174:head# 2024-04-01T19:28:38.856 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a51c346:::benchmark_data_smithi188_77607_object106793:head# 2024-04-01T19:28:38.857 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a530668:::benchmark_data_smithi188_77607_object108529:head# 2024-04-01T19:28:38.857 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a5310c2:::benchmark_data_smithi188_77607_object131502:head# 2024-04-01T19:28:38.858 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a536794:::benchmark_data_smithi188_77607_object120792:head# 2024-04-01T19:28:38.858 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a54a582:::benchmark_data_smithi188_77607_object120105:head# 2024-04-01T19:28:38.859 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a550e85:::benchmark_data_smithi188_77607_object140108:head# 2024-04-01T19:28:38.859 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a58779f:::benchmark_data_smithi188_77607_object130657:head# 2024-04-01T19:28:38.860 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a597db9:::benchmark_data_smithi188_77607_object148393:head# 2024-04-01T19:28:38.860 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a59b9dd:::benchmark_data_smithi188_77607_object145509:head# 2024-04-01T19:28:38.861 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a5a03c5:::benchmark_data_smithi188_77607_object116919:head# 2024-04-01T19:28:38.861 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a5b4893:::benchmark_data_smithi188_77607_object108929:head# 2024-04-01T19:28:38.861 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a5b829e:::benchmark_data_smithi188_77607_object167175:head# 2024-04-01T19:28:38.862 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a5cdb49:::benchmark_data_smithi188_77607_object111729:head# 2024-04-01T19:28:38.862 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a5e2a8e:::benchmark_data_smithi188_77607_object118784:head# 2024-04-01T19:28:38.863 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a5f4e78:::benchmark_data_smithi188_77607_object136668:head# 2024-04-01T19:28:38.863 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a5fc0fe:::benchmark_data_smithi188_77607_object115653:head# 2024-04-01T19:28:38.864 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a5ff92b:::benchmark_data_smithi188_77607_object165925:head# 2024-04-01T19:28:38.864 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a61b7a8:::benchmark_data_smithi188_77607_object146713:head# 2024-04-01T19:28:38.865 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a6208c7:::benchmark_data_smithi188_77607_object137023:head# 2024-04-01T19:28:38.865 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a639c87:::benchmark_data_smithi188_77607_object124757:head# 2024-04-01T19:28:38.866 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a63e38a:::benchmark_data_smithi188_77607_object156341:head# 2024-04-01T19:28:38.866 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a64b797:::benchmark_data_smithi188_77607_object133293:head# 2024-04-01T19:28:38.867 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a650260:::benchmark_data_smithi188_77607_object105617:head# 2024-04-01T19:28:38.867 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a650731:::benchmark_data_smithi188_77607_object151998:head# 2024-04-01T19:28:38.868 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a671f3f:::benchmark_data_smithi188_77607_object164010:head# 2024-04-01T19:28:38.868 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a673094:::benchmark_data_smithi188_77607_object140449:head# 2024-04-01T19:28:38.869 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a674ae7:::benchmark_data_smithi188_77607_object124877:head# 2024-04-01T19:28:38.869 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a6817e8:::benchmark_data_smithi188_77607_object130977:head# 2024-04-01T19:28:38.870 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a68ca51:::benchmark_data_smithi188_77607_object164495:head# 2024-04-01T19:28:38.870 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a68ebbb:::benchmark_data_smithi188_77607_object101256:head# 2024-04-01T19:28:38.871 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a69941d:::benchmark_data_smithi188_77607_object137146:head# 2024-04-01T19:28:38.871 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a69ff7e:::benchmark_data_smithi188_77607_object118320:head# 2024-04-01T19:28:38.871 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a6b9131:::benchmark_data_smithi188_77607_object162232:head# 2024-04-01T19:28:38.872 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a6beec2:::benchmark_data_smithi188_77607_object156315:head# 2024-04-01T19:28:38.873 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a6bf96d:::benchmark_data_smithi188_77607_object122788:head# 2024-04-01T19:28:38.873 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a6c6312:::benchmark_data_smithi188_77607_object125077:head# 2024-04-01T19:28:38.874 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a6d02bd:::benchmark_data_smithi188_77607_object141116:head# 2024-04-01T19:28:38.874 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a6e9801:::benchmark_data_smithi188_77607_object161574:head# 2024-04-01T19:28:38.874 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:28:38.875 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a6f7404:::benchmark_data_smithi188_77607_object125509:head# 2024-04-01T19:28:38.875 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a707575:::benchmark_data_smithi188_77607_object147588:head# 2024-04-01T19:28:38.876 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a718202:::benchmark_data_smithi188_77607_object122133:head# 2024-04-01T19:28:38.876 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a72ae29:::benchmark_data_smithi188_77607_object157991:head# 2024-04-01T19:28:38.877 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a730af6:::benchmark_data_smithi188_77607_object101260:head# 2024-04-01T19:28:38.877 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a736a12:::benchmark_data_smithi188_77607_object155263:head# 2024-04-01T19:28:38.877 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a74c0a5:::benchmark_data_smithi188_77607_object101808:head# 2024-04-01T19:28:38.878 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a7558c7:::benchmark_data_smithi188_77607_object108876:head# 2024-04-01T19:28:38.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a757b59:::benchmark_data_smithi188_77607_object133701:head# 2024-04-01T19:28:38.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a76ebfe:::benchmark_data_smithi188_77607_object128311:head# 2024-04-01T19:28:38.880 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a77edd7:::benchmark_data_smithi188_77607_object111823:head# 2024-04-01T19:28:38.880 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a77f864:::benchmark_data_smithi188_77607_object129837:head# 2024-04-01T19:28:38.881 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a786a3b:::benchmark_data_smithi188_77607_object127613:head# 2024-04-01T19:28:38.881 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a78a846:::benchmark_data_smithi188_77607_object164418:head# 2024-04-01T19:28:38.881 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a7a206d:::benchmark_data_smithi188_77607_object164466:head# 2024-04-01T19:28:38.882 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a7cd6cf:::benchmark_data_smithi188_77607_object152576:head# 2024-04-01T19:28:38.882 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a7d56df:::benchmark_data_smithi188_77607_object165468:head# 2024-04-01T19:28:38.883 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a7e3f1e:::benchmark_data_smithi188_77607_object160637:head# 2024-04-01T19:28:38.883 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a80becd:::benchmark_data_smithi188_77607_object130761:head# 2024-04-01T19:28:38.884 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a811c3d:::benchmark_data_smithi188_77607_object136584:head# 2024-04-01T19:28:38.884 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a82c39e:::benchmark_data_smithi188_77607_object139992:head# 2024-04-01T19:28:38.885 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a83e4e3:::benchmark_data_smithi188_77607_object158221:head# 2024-04-01T19:28:38.885 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a854d30:::benchmark_data_smithi188_77607_object100632:head# 2024-04-01T19:28:38.886 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a864700:::benchmark_data_smithi188_77607_object142646:head# 2024-04-01T19:28:38.886 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a87f0c2:::benchmark_data_smithi188_77607_object146395:head# 2024-04-01T19:28:38.887 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a8a0232:::benchmark_data_smithi188_77607_object102168:head# 2024-04-01T19:28:38.887 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a8c0554:::benchmark_data_smithi188_77607_object141230:head# 2024-04-01T19:28:38.888 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a8c9432:::benchmark_data_smithi188_77607_object159482:head# 2024-04-01T19:28:38.888 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a8f08c8:::benchmark_data_smithi188_77607_object128096:head# 2024-04-01T19:28:38.889 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a8f0d2d:::benchmark_data_smithi188_77607_object122932:head# 2024-04-01T19:28:38.889 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a8f3503:::benchmark_data_smithi188_77607_object108758:head# 2024-04-01T19:28:38.889 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a902bd7:::benchmark_data_smithi188_77607_object144519:head# 2024-04-01T19:28:38.890 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a90d2bf:::benchmark_data_smithi188_77607_object110538:head# 2024-04-01T19:28:38.891 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a91804f:::benchmark_data_smithi188_77607_object103631:head# 2024-04-01T19:28:38.891 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a934a3c:::benchmark_data_smithi188_77607_object143993:head# 2024-04-01T19:28:38.892 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a95fe8d:::benchmark_data_smithi188_77607_object152455:head# 2024-04-01T19:28:38.892 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a9666ae:::benchmark_data_smithi188_77607_object138523:head# 2024-04-01T19:28:38.893 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a96f04d:::benchmark_data_smithi188_77607_object121363:head# 2024-04-01T19:28:38.893 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a98061f:::benchmark_data_smithi188_77607_object125020:head# 2024-04-01T19:28:38.893 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a981131:::benchmark_data_smithi188_77607_object107638:head# 2024-04-01T19:28:38.894 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a996b7c:::benchmark_data_smithi188_77607_object106065:head# 2024-04-01T19:28:38.894 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a99fcf5:::benchmark_data_smithi188_77607_object147504:head# 2024-04-01T19:28:38.895 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a9bca56:::benchmark_data_smithi188_77607_object111818:head# 2024-04-01T19:28:38.895 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a9bee44:::benchmark_data_smithi188_77607_object138982:head# 2024-04-01T19:28:38.896 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a9cd395:::benchmark_data_smithi188_77607_object153684:head# 2024-04-01T19:28:38.896 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a9d51c8:::benchmark_data_smithi188_77607_object106338:head# 2024-04-01T19:28:38.897 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a9f7c2f:::benchmark_data_smithi188_77607_object119227:head# 2024-04-01T19:28:38.897 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6a9fbaa3:::benchmark_data_smithi188_77607_object131224:head# 2024-04-01T19:28:38.898 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aa05edd:::benchmark_data_smithi188_77607_object148122:head# 2024-04-01T19:28:38.898 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aa5084a:::benchmark_data_smithi188_77607_object142065:head# 2024-04-01T19:28:38.899 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aa5c76b:::benchmark_data_smithi188_77607_object108348:head# 2024-04-01T19:28:38.899 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aa5db07:::benchmark_data_smithi188_77607_object116433:head# 2024-04-01T19:28:38.900 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aa5f88b:::benchmark_data_smithi188_77607_object156937:head# 2024-04-01T19:28:38.900 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aa6d0d3:::benchmark_data_smithi188_77607_object162926:head# 2024-04-01T19:28:38.900 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aa71fcb:::benchmark_data_smithi188_77607_object153623:head# 2024-04-01T19:28:38.901 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aa74f8a:::benchmark_data_smithi188_77607_object122805:head# 2024-04-01T19:28:38.901 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aa76bc4:::benchmark_data_smithi188_77607_object149492:head# 2024-04-01T19:28:38.902 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aa7b82e:::benchmark_data_smithi188_77607_object142312:head# 2024-04-01T19:28:38.902 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aaa074d:::benchmark_data_smithi188_77607_object166202:head# 2024-04-01T19:28:38.903 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aab84aa:::benchmark_data_smithi188_77607_object131168:head# 2024-04-01T19:28:38.903 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aab9078:::benchmark_data_smithi188_77607_object99177:head# 2024-04-01T19:28:38.903 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aabb161:::benchmark_data_smithi188_77607_object106144:head# 2024-04-01T19:28:38.904 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aace648:::benchmark_data_smithi188_77607_object156111:head# 2024-04-01T19:28:38.904 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aacf237:::benchmark_data_smithi188_77607_object166223:head# 2024-04-01T19:28:38.905 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aad4846:::benchmark_data_smithi188_77607_object104848:head# 2024-04-01T19:28:38.905 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aaeec91:::benchmark_data_smithi188_77607_object155587:head# 2024-04-01T19:28:38.906 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aaef23c:::benchmark_data_smithi188_77607_object163110:head# 2024-04-01T19:28:38.906 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aaf2f52:::benchmark_data_smithi188_77607_object155747:head# 2024-04-01T19:28:38.907 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aaf4e60:::benchmark_data_smithi188_77607_object135668:head# 2024-04-01T19:28:38.907 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aaf58cb:::benchmark_data_smithi188_77607_object107226:head# 2024-04-01T19:28:38.907 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aaf607b:::benchmark_data_smithi188_77607_object109683:head# 2024-04-01T19:28:38.908 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aafe6b7:::benchmark_data_smithi188_77607_object115348:head# 2024-04-01T19:28:38.908 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ab05ca7:::benchmark_data_smithi188_77607_object121536:head# 2024-04-01T19:28:38.909 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ab1096a:::benchmark_data_smithi188_77607_object138120:head# 2024-04-01T19:28:38.909 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ab1a703:::benchmark_data_smithi188_77607_object147347:head# 2024-04-01T19:28:38.910 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ab375c3:::benchmark_data_smithi188_77607_object133292:head# 2024-04-01T19:28:38.910 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ab47ecf:::benchmark_data_smithi188_77607_object131666:head# 2024-04-01T19:28:38.911 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ab59aa2:::benchmark_data_smithi188_77607_object157447:head# 2024-04-01T19:28:38.911 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ab684f6:::benchmark_data_smithi188_77607_object109893:head# 2024-04-01T19:28:38.912 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ab74243:::benchmark_data_smithi188_77607_object130636:head# 2024-04-01T19:28:38.912 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ab84cd4:::benchmark_data_smithi188_77607_object134942:head# 2024-04-01T19:28:38.912 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ab8f26b:::benchmark_data_smithi188_77607_object164399:head# 2024-04-01T19:28:38.913 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6abb0aac:::benchmark_data_smithi188_77607_object103773:head# 2024-04-01T19:28:38.914 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6abb8956:::benchmark_data_smithi188_77607_object99666:head# 2024-04-01T19:28:38.914 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6abbcc40:::benchmark_data_smithi188_77607_object123834:head# 2024-04-01T19:28:38.914 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6abc7482:::benchmark_data_smithi188_77607_object138542:head# 2024-04-01T19:28:38.915 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6abcd933:::benchmark_data_smithi188_77607_object141625:head# 2024-04-01T19:28:38.916 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6abd88fc:::benchmark_data_smithi188_77607_object129308:head# 2024-04-01T19:28:38.917 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6abde1c8:::benchmark_data_smithi188_77607_object127152:head# 2024-04-01T19:28:38.917 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6abe9694:::benchmark_data_smithi188_77607_object142272:head# 2024-04-01T19:28:38.918 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ac0fe57:::benchmark_data_smithi188_77607_object114073:head# 2024-04-01T19:28:38.920 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:28:38.920 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ac140dd:::benchmark_data_smithi188_77607_object99033:head# 2024-04-01T19:28:38.921 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ac16105:::benchmark_data_smithi188_77607_object115786:head# 2024-04-01T19:28:38.921 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ac35cef:::benchmark_data_smithi188_77607_object127090:head# 2024-04-01T19:28:38.921 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ac361d0:::benchmark_data_smithi188_77607_object120633:head# 2024-04-01T19:28:38.922 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ac498aa:::benchmark_data_smithi188_77607_object163514:head# 2024-04-01T19:28:38.923 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ac5fc62:::benchmark_data_smithi188_77607_object153847:head# 2024-04-01T19:28:38.923 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ac6c043:::benchmark_data_smithi188_77607_object137825:head# 2024-04-01T19:28:38.924 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ac878ff:::benchmark_data_smithi188_77607_object162539:head# 2024-04-01T19:28:38.924 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ac88fb3:::benchmark_data_smithi188_77607_object106517:head# 2024-04-01T19:28:38.924 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ac8dac0:::benchmark_data_smithi188_77607_object152301:head# 2024-04-01T19:28:38.925 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6acc1ae8:::benchmark_data_smithi188_77607_object147587:head# 2024-04-01T19:28:38.925 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6acd6ae8:::benchmark_data_smithi188_77607_object144736:head# 2024-04-01T19:28:38.926 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6acd9335:::benchmark_data_smithi188_77607_object154850:head# 2024-04-01T19:28:38.926 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ace39cf:::benchmark_data_smithi188_77607_object152468:head# 2024-04-01T19:28:38.927 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6acf9edf:::benchmark_data_smithi188_77607_object161685:head# 2024-04-01T19:28:38.927 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ad071df:::benchmark_data_smithi188_77607_object141270:head# 2024-04-01T19:28:38.928 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ad0b0ab:::benchmark_data_smithi188_77607_object105461:head# 2024-04-01T19:28:38.928 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ad0b41c:::benchmark_data_smithi188_77607_object164130:head# 2024-04-01T19:28:38.928 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ad22ae1:::benchmark_data_smithi188_77607_object155865:head# 2024-04-01T19:28:38.929 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ad30334:::benchmark_data_smithi188_77607_object102264:head# 2024-04-01T19:28:38.929 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ad35eac:::benchmark_data_smithi188_77607_object165132:head# 2024-04-01T19:28:38.930 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ad59611:::benchmark_data_smithi188_77607_object166199:head# 2024-04-01T19:28:38.930 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ad5bf13:::benchmark_data_smithi188_77607_object135965:head# 2024-04-01T19:28:38.931 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ad6df70:::benchmark_data_smithi188_77607_object132538:head# 2024-04-01T19:28:38.931 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ad74115:::benchmark_data_smithi188_77607_object163953:head# 2024-04-01T19:28:38.932 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ad8a958:::benchmark_data_smithi188_77607_object102042:head# 2024-04-01T19:28:38.932 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6adb4992:::benchmark_data_smithi188_77607_object98847:head# 2024-04-01T19:28:38.933 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6adc3a98:::benchmark_data_smithi188_77607_object166221:head# 2024-04-01T19:28:38.933 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6adc6b8e:::benchmark_data_smithi188_77607_object107109:head# 2024-04-01T19:28:38.934 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6adcdb9a:::benchmark_data_smithi188_77607_object136859:head# 2024-04-01T19:28:38.934 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ade4b6f:::benchmark_data_smithi188_77607_object144353:head# 2024-04-01T19:28:38.937 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6adefaf9:::benchmark_data_smithi188_77607_object115108:head# 2024-04-01T19:28:38.938 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ae07028:::benchmark_data_smithi188_77607_object145404:head# 2024-04-01T19:28:38.938 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ae19d29:::benchmark_data_smithi188_77607_object116296:head# 2024-04-01T19:28:38.938 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ae2a053:::benchmark_data_smithi188_77607_object118882:head# 2024-04-01T19:28:38.938 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ae3a8a2:::benchmark_data_smithi188_77607_object107788:head# 2024-04-01T19:28:38.938 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ae3ca09:::benchmark_data_smithi188_77607_object123748:head# 2024-04-01T19:28:38.939 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ae3d297:::benchmark_data_smithi188_77607_object134846:head# 2024-04-01T19:28:38.939 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ae4c9d0:::benchmark_data_smithi188_77607_object145152:head# 2024-04-01T19:28:38.939 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ae647b3:::benchmark_data_smithi188_77607_object129126:head# 2024-04-01T19:28:38.939 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ae698e9:::benchmark_data_smithi188_77607_object122168:head# 2024-04-01T19:28:38.940 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ae74430:::benchmark_data_smithi188_77607_object102331:head# 2024-04-01T19:28:38.940 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ae91690:::benchmark_data_smithi188_77607_object125546:head# 2024-04-01T19:28:38.940 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ae9cc59:::benchmark_data_smithi188_77607_object137137:head# 2024-04-01T19:28:38.941 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aea054e:::benchmark_data_smithi188_77607_object142154:head# 2024-04-01T19:28:38.941 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aea4da5:::benchmark_data_smithi188_77607_object125397:head# 2024-04-01T19:28:38.942 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aea8ea0:::benchmark_data_smithi188_77607_object161290:head# 2024-04-01T19:28:38.942 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aeb31b1:::benchmark_data_smithi188_77607_object138855:head# 2024-04-01T19:28:38.943 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aeb58e6:::benchmark_data_smithi188_77607_object102743:head# 2024-04-01T19:28:38.943 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aeb9c91:::benchmark_data_smithi188_77607_object125004:head# 2024-04-01T19:28:38.943 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aeef336:::benchmark_data_smithi188_77607_object158161:head# 2024-04-01T19:28:38.944 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aef9cf6:::benchmark_data_smithi188_77607_object112162:head# 2024-04-01T19:28:38.944 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6af08e39:::benchmark_data_smithi188_77607_object165982:head# 2024-04-01T19:28:38.945 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6af192c8:::benchmark_data_smithi188_77607_object159425:head# 2024-04-01T19:28:38.945 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6af2667d:::benchmark_data_smithi188_77607_object110815:head# 2024-04-01T19:28:38.945 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6af28c8d:::benchmark_data_smithi188_77607_object142820:head# 2024-04-01T19:28:38.946 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6af321f4:::benchmark_data_smithi188_77607_object124430:head# 2024-04-01T19:28:38.947 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6af5e0ab:::benchmark_data_smithi188_77607_object139490:head# 2024-04-01T19:28:38.947 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6af5f11b:::benchmark_data_smithi188_77607_object147015:head# 2024-04-01T19:28:38.947 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:38.948 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6af68d49:::benchmark_data_smithi188_77607_object129600:head# 2024-04-01T19:28:38.948 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6af6c466:::benchmark_data_smithi188_77607_object150991:head# 2024-04-01T19:28:38.948 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6af7458a:::benchmark_data_smithi188_77607_object134914:head# 2024-04-01T19:28:38.949 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6af85425:::benchmark_data_smithi188_77607_object108083:head# 2024-04-01T19:28:38.949 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6af8ecf6:::benchmark_data_smithi188_77607_object135105:head# 2024-04-01T19:28:38.950 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6af9c28b:::benchmark_data_smithi188_77607_object98225:head# 2024-04-01T19:28:38.950 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6afa1b3e:::benchmark_data_smithi188_77607_object160014:head# 2024-04-01T19:28:38.950 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6afc8691:::benchmark_data_smithi188_77607_object112058:head# 2024-04-01T19:28:38.951 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6afc9703:::benchmark_data_smithi188_77607_object158590:head# 2024-04-01T19:28:38.951 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6afd2cdb:::benchmark_data_smithi188_77607_object125560:head# 2024-04-01T19:28:38.952 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6afd50f3:::benchmark_data_smithi188_77607_object124036:head# 2024-04-01T19:28:38.952 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6afeed90:::benchmark_data_smithi188_77607_object104653:head# 2024-04-01T19:28:38.953 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6aff4d3f:::benchmark_data_smithi188_77607_object162631:head# 2024-04-01T19:28:38.953 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b00c0b6:::benchmark_data_smithi188_77607_object126842:head# 2024-04-01T19:28:38.955 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b00c82f:::benchmark_data_smithi188_77607_object142607:head# 2024-04-01T19:28:38.955 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b029e39:::benchmark_data_smithi188_77607_object113963:head# 2024-04-01T19:28:38.956 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b02fd36:::benchmark_data_smithi188_77607_object111669:head# 2024-04-01T19:28:38.956 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b03ae80:::benchmark_data_smithi188_77607_object128950:head# 2024-04-01T19:28:38.956 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b051ebe:::benchmark_data_smithi188_77607_object152636:head# 2024-04-01T19:28:38.957 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b07dcba:::benchmark_data_smithi188_77607_object161451:head# 2024-04-01T19:28:38.957 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b09f34f:::benchmark_data_smithi188_77607_object122073:head# 2024-04-01T19:28:38.958 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b0ae5a4:::benchmark_data_smithi188_77607_object149556:head# 2024-04-01T19:28:38.958 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b0cbf19:::benchmark_data_smithi188_77607_object144972:head# 2024-04-01T19:28:38.959 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b0de95c:::benchmark_data_smithi188_77607_object165038:head# 2024-04-01T19:28:38.959 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b0e4645:::benchmark_data_smithi188_77607_object152961:head# 2024-04-01T19:28:38.960 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b10772d:::benchmark_data_smithi188_77607_object131764:head# 2024-04-01T19:28:38.960 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b117b32:::benchmark_data_smithi188_77607_object124749:head# 2024-04-01T19:28:38.960 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b145695:::benchmark_data_smithi188_77607_object139039:head# 2024-04-01T19:28:38.961 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b173771:::benchmark_data_smithi188_77607_object97784:head# 2024-04-01T19:28:38.961 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b17f583:::benchmark_data_smithi188_77607_object160387:head# 2024-04-01T19:28:38.962 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b18515a:::benchmark_data_smithi188_77607_object137519:head# 2024-04-01T19:28:38.962 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b1872b4:::benchmark_data_smithi188_77607_object114536:head# 2024-04-01T19:28:38.963 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b1a6a88:::benchmark_data_smithi188_77607_object151329:head# 2024-04-01T19:28:38.963 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b1ac48e:::benchmark_data_smithi188_77607_object141292:head# 2024-04-01T19:28:38.963 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b1ca665:::benchmark_data_smithi188_77607_object127525:head# 2024-04-01T19:28:38.964 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b1d6f29:::benchmark_data_smithi188_77607_object109210:head# 2024-04-01T19:28:38.964 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b1db5bd:::benchmark_data_smithi188_77607_object145035:head# 2024-04-01T19:28:38.965 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b1e50e2:::benchmark_data_smithi188_77607_object161375:head# 2024-04-01T19:28:38.965 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b208aeb:::benchmark_data_smithi188_77607_object148062:head# 2024-04-01T19:28:38.966 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b20a211:::benchmark_data_smithi188_77607_object100547:head# 2024-04-01T19:28:38.966 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:28:38.967 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b20b398:::benchmark_data_smithi188_77607_object128909:head# 2024-04-01T19:28:38.967 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b2122bb:::benchmark_data_smithi188_77607_object134491:head# 2024-04-01T19:28:38.967 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b218478:::benchmark_data_smithi188_77607_object142475:head# 2024-04-01T19:28:38.968 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b222b00:::benchmark_data_smithi188_77607_object106314:head# 2024-04-01T19:28:38.968 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b231352:::benchmark_data_smithi188_77607_object156233:head# 2024-04-01T19:28:38.968 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b23171c:::benchmark_data_smithi188_77607_object167342:head# 2024-04-01T19:28:38.969 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:38.969 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:28:38.970 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b24c584:::benchmark_data_smithi188_77607_object114116:head# 2024-04-01T19:28:38.970 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b250b48:::benchmark_data_smithi188_77607_object148176:head# 2024-04-01T19:28:38.970 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b268433:::benchmark_data_smithi188_77607_object130913:head# 2024-04-01T19:28:38.970 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b26895e:::benchmark_data_smithi188_77607_object104883:head# 2024-04-01T19:28:38.971 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b2918a6:::benchmark_data_smithi188_77607_object108599:head# 2024-04-01T19:28:38.971 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b299bb1:::benchmark_data_smithi188_77607_object146185:head# 2024-04-01T19:28:38.972 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b29b7e5:::benchmark_data_smithi188_77607_object159011:head# 2024-04-01T19:28:38.972 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b2a026a:::benchmark_data_smithi188_77607_object126511:head# 2024-04-01T19:28:38.973 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b2c4797:::benchmark_data_smithi188_77607_object112121:head# 2024-04-01T19:28:38.973 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b2dbddf:::benchmark_data_smithi188_77607_object119159:head# 2024-04-01T19:28:38.974 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b2fc750:::benchmark_data_smithi188_77607_object118860:head# 2024-04-01T19:28:38.974 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b304ca5:::benchmark_data_smithi188_77607_object114159:head# 2024-04-01T19:28:38.975 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b30682f:::benchmark_data_smithi188_77607_object124381:head# 2024-04-01T19:28:38.975 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b307f9e:::benchmark_data_smithi188_77607_object107634:head# 2024-04-01T19:28:38.976 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b31dbcd:::benchmark_data_smithi188_77607_object137958:head# 2024-04-01T19:28:38.976 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b32fbeb:::benchmark_data_smithi188_77607_object158191:head# 2024-04-01T19:28:38.977 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b33df12:::benchmark_data_smithi188_77607_object147659:head# 2024-04-01T19:28:38.977 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b34e2e2:::benchmark_data_smithi188_77607_object148737:head# 2024-04-01T19:28:38.978 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b34f802:::benchmark_data_smithi188_77607_object135913:head# 2024-04-01T19:28:38.978 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b353b3c:::benchmark_data_smithi188_77607_object132897:head# 2024-04-01T19:28:38.979 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b357321:::benchmark_data_smithi188_77607_object157291:head# 2024-04-01T19:28:38.979 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b36e4f3:::benchmark_data_smithi188_77607_object123095:head# 2024-04-01T19:28:38.980 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b3791f5:::benchmark_data_smithi188_77607_object100317:head# 2024-04-01T19:28:38.980 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b38156b:::benchmark_data_smithi188_77607_object115002:head# 2024-04-01T19:28:38.981 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b39406a:::benchmark_data_smithi188_77607_object131301:head# 2024-04-01T19:28:38.981 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b3ac01e:::benchmark_data_smithi188_77607_object151926:head# 2024-04-01T19:28:38.982 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b3b45cb:::benchmark_data_smithi188_77607_object139415:head# 2024-04-01T19:28:38.982 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b3bcaa8:::benchmark_data_smithi188_77607_object158383:head# 2024-04-01T19:28:38.983 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b3c7ff8:::benchmark_data_smithi188_77607_object119937:head# 2024-04-01T19:28:38.983 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b3cb239:::benchmark_data_smithi188_77607_object167295:head# 2024-04-01T19:28:38.983 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b3e1881:::benchmark_data_smithi188_77607_object131241:head# 2024-04-01T19:28:38.984 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b3fa8fe:::benchmark_data_smithi188_77607_object140314:head# 2024-04-01T19:28:38.984 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b40e20e:::benchmark_data_smithi188_77607_object128797:head# 2024-04-01T19:28:38.985 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b427195:::benchmark_data_smithi188_77607_object134502:head# 2024-04-01T19:28:38.985 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b43d66c:::benchmark_data_smithi188_77607_object136988:head# 2024-04-01T19:28:38.986 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b4439bb:::benchmark_data_smithi188_77607_object123240:head# 2024-04-01T19:28:38.986 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b44842e:::benchmark_data_smithi188_77607_object111789:head# 2024-04-01T19:28:38.987 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b451ab6:::benchmark_data_smithi188_77607_object128778:head# 2024-04-01T19:28:38.987 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b46aef8:::benchmark_data_smithi188_77607_object166773:head# 2024-04-01T19:28:38.988 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b479790:::benchmark_data_smithi188_77607_object151990:head# 2024-04-01T19:28:38.988 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b47b8f7:::benchmark_data_smithi188_77607_object119907:head# 2024-04-01T19:28:38.989 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b47e0c6:::benchmark_data_smithi188_77607_object128503:head# 2024-04-01T19:28:38.989 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b4a148b:::benchmark_data_smithi188_77607_object101811:head# 2024-04-01T19:28:38.990 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b4bb5d5:::benchmark_data_smithi188_77607_object126501:head# 2024-04-01T19:28:38.991 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b4d05a8:::benchmark_data_smithi188_77607_object152451:head# 2024-04-01T19:28:38.991 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b4d05d8:::benchmark_data_smithi188_77607_object156501:head# 2024-04-01T19:28:38.992 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b4deb0b:::benchmark_data_smithi188_77607_object165465:head# 2024-04-01T19:28:38.992 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b4df64c:::benchmark_data_smithi188_77607_object152267:head# 2024-04-01T19:28:38.993 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b4e3613:::benchmark_data_smithi188_77607_object127095:head# 2024-04-01T19:28:38.993 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b4e5de5:::benchmark_data_smithi188_77607_object150121:head# 2024-04-01T19:28:38.993 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b4efacb:::benchmark_data_smithi188_77607_object101630:head# 2024-04-01T19:28:38.994 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b5035f9:::benchmark_data_smithi188_77607_object122580:head# 2024-04-01T19:28:38.995 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b51a0c4:::benchmark_data_smithi188_77607_object135174:head# 2024-04-01T19:28:38.995 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b5252fb:::benchmark_data_smithi188_77607_object157442:head# 2024-04-01T19:28:38.995 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b533a05:::benchmark_data_smithi188_77607_object162642:head# 2024-04-01T19:28:38.996 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b57e0fc:::benchmark_data_smithi188_77607_object117798:head# 2024-04-01T19:28:38.997 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b5819c7:::benchmark_data_smithi188_77607_object139616:head# 2024-04-01T19:28:38.997 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b5a282c:::benchmark_data_smithi188_77607_object150721:head# 2024-04-01T19:28:38.998 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b5c8992:::benchmark_data_smithi188_77607_object163693:head# 2024-04-01T19:28:38.998 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b5ca3d7:::benchmark_data_smithi188_77607_object157129:head# 2024-04-01T19:28:38.998 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b5e1f92:::benchmark_data_smithi188_77607_object101316:head# 2024-04-01T19:28:38.999 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b5ecac9:::benchmark_data_smithi188_77607_object135458:head# 2024-04-01T19:28:39.000 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b613d92:::benchmark_data_smithi188_77607_object129700:head# 2024-04-01T19:28:39.000 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b61c242:::benchmark_data_smithi188_77607_object147036:head# 2024-04-01T19:28:39.001 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b62a80b:::benchmark_data_smithi188_77607_object157241:head# 2024-04-01T19:28:39.001 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b63fb87:::benchmark_data_smithi188_77607_object142979:head# 2024-04-01T19:28:39.002 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b640a76:::benchmark_data_smithi188_77607_object109723:head# 2024-04-01T19:28:39.002 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b660e83:::benchmark_data_smithi188_77607_object143697:head# 2024-04-01T19:28:39.003 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b66a00a:::benchmark_data_smithi188_77607_object119239:head# 2024-04-01T19:28:39.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:38 smithi022 ceph-mon[39439]: osdmap e174: 12 total, 11 up, 11 in 2024-04-01T19:28:39.004 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b68c42a:::benchmark_data_smithi188_77607_object161614:head# 2024-04-01T19:28:39.004 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b6b8e93:::benchmark_data_smithi188_77607_object137315:head# 2024-04-01T19:28:39.005 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b6baecf:::benchmark_data_smithi188_77607_object152115:head# 2024-04-01T19:28:39.005 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b6bf7b7:::benchmark_data_smithi188_77607_object114803:head# 2024-04-01T19:28:39.005 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b6c8f98:::benchmark_data_smithi188_77607_object102811:head# 2024-04-01T19:28:39.006 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b6d2ac0:::benchmark_data_smithi188_77607_object164102:head# 2024-04-01T19:28:39.006 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b703fb0:::benchmark_data_smithi188_77607_object141871:head# 2024-04-01T19:28:39.007 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b704ccf:::benchmark_data_smithi188_77607_object121796:head# 2024-04-01T19:28:39.007 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b7099be:::benchmark_data_smithi188_77607_object144192:head# 2024-04-01T19:28:39.007 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b70afba:::benchmark_data_smithi188_77607_object128281:head# 2024-04-01T19:28:39.008 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b710f8c:::benchmark_data_smithi188_77607_object151485:head# 2024-04-01T19:28:39.008 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b724473:::benchmark_data_smithi188_77607_object130394:head# 2024-04-01T19:28:39.009 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b730dcd:::benchmark_data_smithi188_77607_object99115:head# 2024-04-01T19:28:39.011 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b73322f:::benchmark_data_smithi188_77607_object153701:head# 2024-04-01T19:28:39.012 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b747725:::benchmark_data_smithi188_77607_object145535:head# 2024-04-01T19:28:39.012 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b76cb23:::benchmark_data_smithi188_77607_object115528:head# 2024-04-01T19:28:39.013 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b79626f:::benchmark_data_smithi188_77607_object130215:head# 2024-04-01T19:28:39.013 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b7a2deb:::benchmark_data_smithi188_77607_object103375:head# 2024-04-01T19:28:39.013 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b7ad3b4:::benchmark_data_smithi188_77607_object100742:head# 2024-04-01T19:28:39.014 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b7b9921:::benchmark_data_smithi188_77607_object139277:head# 2024-04-01T19:28:39.014 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b7cf28b:::benchmark_data_smithi188_77607_object140028:head# 2024-04-01T19:28:39.015 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b7db31c:::benchmark_data_smithi188_77607_object130160:head# 2024-04-01T19:28:39.015 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b7dda8f:::benchmark_data_smithi188_77607_object153104:head# 2024-04-01T19:28:39.016 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b7fb4e6:::benchmark_data_smithi188_77607_object108392:head# 2024-04-01T19:28:39.016 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b80f579:::benchmark_data_smithi188_77607_object155039:head# 2024-04-01T19:28:39.017 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b8241a2:::benchmark_data_smithi188_77607_object145485:head# 2024-04-01T19:28:39.017 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b8259f5:::benchmark_data_smithi188_77607_object131102:head# 2024-04-01T19:28:39.018 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b8321eb:::benchmark_data_smithi188_77607_object158609:head# 2024-04-01T19:28:39.018 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b83d3f2:::benchmark_data_smithi188_77607_object115763:head# 2024-04-01T19:28:39.019 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b83d3f9:::benchmark_data_smithi188_77607_object126294:head# 2024-04-01T19:28:39.019 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b8449a7:::benchmark_data_smithi188_77607_object165859:head# 2024-04-01T19:28:39.019 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b85ce04:::benchmark_data_smithi188_77607_object162074:head# 2024-04-01T19:28:39.020 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b87924a:::benchmark_data_smithi188_77607_object109277:head# 2024-04-01T19:28:39.021 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b880389:::benchmark_data_smithi188_77607_object132245:head# 2024-04-01T19:28:39.021 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b89dadb:::benchmark_data_smithi188_77607_object143597:head# 2024-04-01T19:28:39.022 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b8a0d4d:::benchmark_data_smithi188_77607_object107605:head# 2024-04-01T19:28:39.022 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b8a75f1:::benchmark_data_smithi188_77607_object110320:head# 2024-04-01T19:28:39.023 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b8b197b:::benchmark_data_smithi188_77607_object131511:head# 2024-04-01T19:28:39.023 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b8c93dd:::benchmark_data_smithi188_77607_object111513:head# 2024-04-01T19:28:39.024 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b8d3fe3:::benchmark_data_smithi188_77607_object102939:head# 2024-04-01T19:28:39.024 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b8f4b4a:::benchmark_data_smithi188_77607_object145553:head# 2024-04-01T19:28:39.025 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b8fb5a1:::benchmark_data_smithi188_77607_object142576:head# 2024-04-01T19:28:39.025 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b8fba11:::benchmark_data_smithi188_77607_object119812:head# 2024-04-01T19:28:39.026 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b9058cc:::benchmark_data_smithi188_77607_object102034:head# 2024-04-01T19:28:39.026 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b90b913:::benchmark_data_smithi188_77607_object132548:head# 2024-04-01T19:28:39.027 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b91c538:::benchmark_data_smithi188_77607_object136355:head# 2024-04-01T19:28:39.027 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b92d51f:::benchmark_data_smithi188_77607_object112661:head# 2024-04-01T19:28:39.028 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b93cf88:::benchmark_data_smithi188_77607_object134135:head# 2024-04-01T19:28:39.028 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b94731b:::benchmark_data_smithi188_77607_object157646:head# 2024-04-01T19:28:39.028 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b950b1b:::benchmark_data_smithi188_77607_object112801:head# 2024-04-01T19:28:39.029 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b9560b1:::benchmark_data_smithi188_77607_object157978:head# 2024-04-01T19:28:39.030 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b95ac13:::benchmark_data_smithi188_77607_object133017:head# 2024-04-01T19:28:39.030 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b96a0ff:::benchmark_data_smithi188_77607_object141906:head# 2024-04-01T19:28:39.031 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b96c5d4:::benchmark_data_smithi188_77607_object131843:head# 2024-04-01T19:28:39.031 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b97e7b2:::benchmark_data_smithi188_77607_object158690:head# 2024-04-01T19:28:39.031 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b9816a4:::benchmark_data_smithi188_77607_object151764:head# 2024-04-01T19:28:39.032 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b9a5adc:::benchmark_data_smithi188_77607_object158164:head# 2024-04-01T19:28:39.033 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b9b7c96:::benchmark_data_smithi188_77607_object109514:head# 2024-04-01T19:28:39.033 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b9beea3:::benchmark_data_smithi188_77607_object153534:head# 2024-04-01T19:28:39.034 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b9cbcea:::benchmark_data_smithi188_77607_object107147:head# 2024-04-01T19:28:39.034 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b9cd899:::benchmark_data_smithi188_77607_object114630:head# 2024-04-01T19:28:39.035 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b9e61f8:::benchmark_data_smithi188_77607_object127230:head# 2024-04-01T19:28:39.035 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6b9f40a5:::benchmark_data_smithi188_77607_object163684:head# 2024-04-01T19:28:39.036 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ba038a2:::benchmark_data_smithi188_77607_object116116:head# 2024-04-01T19:28:39.037 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ba0e961:::benchmark_data_smithi188_77607_object134388:head# 2024-04-01T19:28:39.037 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ba1cac4:::benchmark_data_smithi188_77607_object143562:head# 2024-04-01T19:28:39.038 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ba45232:::benchmark_data_smithi188_77607_object125247:head# 2024-04-01T19:28:39.038 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ba48f4d:::benchmark_data_smithi188_77607_object166256:head# 2024-04-01T19:28:39.038 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ba4ded6:::benchmark_data_smithi188_77607_object112015:head# 2024-04-01T19:28:39.039 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ba502c2:::benchmark_data_smithi188_77607_object150641:head# 2024-04-01T19:28:39.039 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ba5691a:::benchmark_data_smithi188_77607_object119137:head# 2024-04-01T19:28:39.040 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ba73caf:::benchmark_data_smithi188_77607_object151964:head# 2024-04-01T19:28:39.040 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ba9b0d7:::benchmark_data_smithi188_77607_object145432:head# 2024-04-01T19:28:39.041 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ba9d006:::benchmark_data_smithi188_77607_object162185:head# 2024-04-01T19:28:39.041 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6baae328:::benchmark_data_smithi188_77607_object103117:head# 2024-04-01T19:28:39.042 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bab33a0:::benchmark_data_smithi188_77607_object150576:head# 2024-04-01T19:28:39.042 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bab3be1:::benchmark_data_smithi188_77607_object113914:head# 2024-04-01T19:28:39.043 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bab620f:::benchmark_data_smithi188_77607_object164278:head# 2024-04-01T19:28:39.043 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bab7a71:::benchmark_data_smithi188_77607_object139934:head# 2024-04-01T19:28:39.044 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6baba54e:::benchmark_data_smithi188_77607_object153483:head# 2024-04-01T19:28:39.044 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bae7bef:::benchmark_data_smithi188_77607_object163587:head# 2024-04-01T19:28:39.045 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bae9e39:::benchmark_data_smithi188_77607_object158016:head# 2024-04-01T19:28:39.045 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bafdc75:::benchmark_data_smithi188_77607_object108588:head# 2024-04-01T19:28:39.046 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bb0784e:::benchmark_data_smithi188_77607_object163379:head# 2024-04-01T19:28:39.046 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bb18e3c:::benchmark_data_smithi188_77607_object123318:head# 2024-04-01T19:28:39.047 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bb2197a:::benchmark_data_smithi188_77607_object154545:head# 2024-04-01T19:28:39.047 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bb2e4d3:::benchmark_data_smithi188_77607_object124328:head# 2024-04-01T19:28:39.048 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bb35af4:::benchmark_data_smithi188_77607_object142327:head# 2024-04-01T19:28:39.048 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bb36231:::benchmark_data_smithi188_77607_object112547:head# 2024-04-01T19:28:39.049 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bb51073:::benchmark_data_smithi188_77607_object124727:head# 2024-04-01T19:28:39.049 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bb55aa0:::benchmark_data_smithi188_77607_object137617:head# 2024-04-01T19:28:39.050 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bb6bb35:::benchmark_data_smithi188_77607_object122492:head# 2024-04-01T19:28:39.050 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bb7eb2f:::benchmark_data_smithi188_77607_object147067:head# 2024-04-01T19:28:39.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bba0e39:::benchmark_data_smithi188_77607_object157325:head# 2024-04-01T19:28:39.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bbd051a:::benchmark_data_smithi188_77607_object143719:head# 2024-04-01T19:28:39.052 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bbd6571:::benchmark_data_smithi188_77607_object144791:head# 2024-04-01T19:28:39.052 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bbe52fa:::benchmark_data_smithi188_77607_object116552:head# 2024-04-01T19:28:39.052 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bbf25b9:::benchmark_data_smithi188_77607_object154217:head# 2024-04-01T19:28:39.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bbf755b:::benchmark_data_smithi188_77607_object131048:head# 2024-04-01T19:28:39.054 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bc42f3d:::benchmark_data_smithi188_77607_object129406:head# 2024-04-01T19:28:39.054 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bc4436f:::benchmark_data_smithi188_77607_object124286:head# 2024-04-01T19:28:39.054 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bc4fca6:::benchmark_data_smithi188_77607_object130038:head# 2024-04-01T19:28:39.055 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bc504d7:::benchmark_data_smithi188_77607_object159278:head# 2024-04-01T19:28:39.055 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bc62827:::benchmark_data_smithi188_77607_object151039:head# 2024-04-01T19:28:39.056 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bc64656:::benchmark_data_smithi188_77607_object104400:head# 2024-04-01T19:28:39.056 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bc64a11:::benchmark_data_smithi188_77607_object127914:head# 2024-04-01T19:28:39.057 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bc6a762:::benchmark_data_smithi188_77607_object147963:head# 2024-04-01T19:28:39.058 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bc73d4a:::benchmark_data_smithi188_77607_object137556:head# 2024-04-01T19:28:39.058 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bc9e20d:::benchmark_data_smithi188_77607_object124339:head# 2024-04-01T19:28:39.058 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bca9d38:::benchmark_data_smithi188_77607_object143963:head# 2024-04-01T19:28:39.059 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bcc34a5:::benchmark_data_smithi188_77607_object109612:head# 2024-04-01T19:28:39.060 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bcc4149:::benchmark_data_smithi188_77607_object151005:head# 2024-04-01T19:28:39.060 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bcc80be:::benchmark_data_smithi188_77607_object106205:head# 2024-04-01T19:28:39.061 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bcd0e15:::benchmark_data_smithi188_77607_object124874:head# 2024-04-01T19:28:39.061 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bcd9fd3:::benchmark_data_smithi188_77607_object159355:head# 2024-04-01T19:28:39.062 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bd0af9f:::benchmark_data_smithi188_77607_object160349:head# 2024-04-01T19:28:39.062 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bd3bc1d:::benchmark_data_smithi188_77607_object121956:head# 2024-04-01T19:28:39.063 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bd54a95:::benchmark_data_smithi188_77607_object158584:head# 2024-04-01T19:28:39.063 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bd5a868:::benchmark_data_smithi188_77607_object159118:head# 2024-04-01T19:28:39.064 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bd5cc22:::benchmark_data_smithi188_77607_object105025:head# 2024-04-01T19:28:39.064 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bd5dcbb:::benchmark_data_smithi188_77607_object142255:head# 2024-04-01T19:28:39.065 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bd62a1e:::benchmark_data_smithi188_77607_object126955:head# 2024-04-01T19:28:39.065 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bd6dca5:::benchmark_data_smithi188_77607_object129390:head# 2024-04-01T19:28:39.066 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bd73e97:::benchmark_data_smithi188_77607_object108743:head# 2024-04-01T19:28:39.066 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bd7655c:::benchmark_data_smithi188_77607_object155517:head# 2024-04-01T19:28:39.067 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bd76e2f:::benchmark_data_smithi188_77607_object157643:head# 2024-04-01T19:28:39.067 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bd78f18:::benchmark_data_smithi188_77607_object136748:head# 2024-04-01T19:28:39.068 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bd7d433:::benchmark_data_smithi188_77607_object131118:head# 2024-04-01T19:28:39.068 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bd82a43:::benchmark_data_smithi188_77607_object163094:head# 2024-04-01T19:28:39.069 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bd89d36:::benchmark_data_smithi188_77607_object140750:head# 2024-04-01T19:28:39.070 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:28:39.071 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bdcfa6d:::benchmark_data_smithi188_77607_object98211:head# 2024-04-01T19:28:39.071 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bddcf2f:::benchmark_data_smithi188_77607_object157603:head# 2024-04-01T19:28:39.071 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bde0994:::benchmark_data_smithi188_77607_object122415:head# 2024-04-01T19:28:39.072 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bde61b9:::benchmark_data_smithi188_77607_object126331:head# 2024-04-01T19:28:39.073 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bde8d5d:::benchmark_data_smithi188_77607_object98912:head# 2024-04-01T19:28:39.073 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bded4ea:::benchmark_data_smithi188_77607_object142164:head# 2024-04-01T19:28:39.073 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bdf6a83:::benchmark_data_smithi188_77607_object150804:head# 2024-04-01T19:28:39.073 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6be070fd:::benchmark_data_smithi188_77607_object160803:head# 2024-04-01T19:28:39.074 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6be0ccf3:::benchmark_data_smithi188_77607_object98520:head# 2024-04-01T19:28:39.074 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6be1c546:::benchmark_data_smithi188_77607_object160623:head# 2024-04-01T19:28:39.075 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6be34ee5:::benchmark_data_smithi188_77607_object152213:head# 2024-04-01T19:28:39.075 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6be450b6:::benchmark_data_smithi188_77607_object163819:head# 2024-04-01T19:28:39.076 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6be4ce78:::benchmark_data_smithi188_77607_object101605:head# 2024-04-01T19:28:39.076 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6be695a4:::benchmark_data_smithi188_77607_object115685:head# 2024-04-01T19:28:39.077 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6be737e2:::benchmark_data_smithi188_77607_object97963:head# 2024-04-01T19:28:39.077 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6be86046:::benchmark_data_smithi188_77607_object144275:head# 2024-04-01T19:28:39.078 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6be90f76:::benchmark_data_smithi188_77607_object142304:head# 2024-04-01T19:28:39.078 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6be93198:::benchmark_data_smithi188_77607_object116864:head# 2024-04-01T19:28:39.079 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6beb3d47:::benchmark_data_smithi188_77607_object161292:head# 2024-04-01T19:28:39.079 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bee9dee:::benchmark_data_smithi188_77607_object137435:head# 2024-04-01T19:28:39.080 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6befa437:::benchmark_data_smithi188_77607_object107622:head# 2024-04-01T19:28:39.080 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bf0f180:::benchmark_data_smithi188_77607_object98054:head# 2024-04-01T19:28:39.081 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bf0f528:::benchmark_data_smithi188_77607_object163931:head# 2024-04-01T19:28:39.081 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bf163a5:::benchmark_data_smithi188_77607_object152735:head# 2024-04-01T19:28:39.081 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bf26990:::benchmark_data_smithi188_77607_object124130:head# 2024-04-01T19:28:39.082 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bf324d4:::benchmark_data_smithi188_77607_object154998:head# 2024-04-01T19:28:39.083 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bf33808:::benchmark_data_smithi188_77607_object143550:head# 2024-04-01T19:28:39.083 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bf45c72:::benchmark_data_smithi188_77607_object154392:head# 2024-04-01T19:28:39.083 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bf496f7:::benchmark_data_smithi188_77607_object136687:head# 2024-04-01T19:28:39.084 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bf49c05:::benchmark_data_smithi188_77607_object126078:head# 2024-04-01T19:28:39.084 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bf4d116:::benchmark_data_smithi188_77607_object99690:head# 2024-04-01T19:28:39.085 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bf53b76:::benchmark_data_smithi188_77607_object132782:head# 2024-04-01T19:28:39.085 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bf5e822:::benchmark_data_smithi188_77607_object118810:head# 2024-04-01T19:28:39.086 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bf67cac:::benchmark_data_smithi188_77607_object148673:head# 2024-04-01T19:28:39.086 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bf6c540:::benchmark_data_smithi188_77607_object140955:head# 2024-04-01T19:28:39.087 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bf961f5:::benchmark_data_smithi188_77607_object117852:head# 2024-04-01T19:28:39.087 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bfaaf76:::benchmark_data_smithi188_77607_object121421:head# 2024-04-01T19:28:39.088 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bfb62c4:::benchmark_data_smithi188_77607_object138416:head# 2024-04-01T19:28:39.088 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bff93d4:::benchmark_data_smithi188_77607_object162132:head# 2024-04-01T19:28:39.089 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6bffc12f:::benchmark_data_smithi188_77607_object156780:head# 2024-04-01T19:28:39.089 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c01c04b:::benchmark_data_smithi188_77607_object136998:head# 2024-04-01T19:28:39.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c023e35:::benchmark_data_smithi188_77607_object105145:head# 2024-04-01T19:28:39.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c0624de:::benchmark_data_smithi188_77607_object137052:head# 2024-04-01T19:28:39.091 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c07eade:::benchmark_data_smithi188_77607_object140260:head# 2024-04-01T19:28:39.091 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c082c06:::benchmark_data_smithi188_77607_object100358:head# 2024-04-01T19:28:39.091 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c088f93:::benchmark_data_smithi188_77607_object152176:head# 2024-04-01T19:28:39.092 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c089a34:::benchmark_data_smithi188_77607_object116007:head# 2024-04-01T19:28:39.092 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c0b2b10:::benchmark_data_smithi188_77607_object104401:head# 2024-04-01T19:28:39.093 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c0bef55:::benchmark_data_smithi188_77607_object152005:head# 2024-04-01T19:28:39.093 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c0cdadb:::benchmark_data_smithi188_77607_object149118:head# 2024-04-01T19:28:39.094 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c0e02f6:::benchmark_data_smithi188_77607_object118194:head# 2024-04-01T19:28:39.094 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c0e81ce:::benchmark_data_smithi188_77607_object99219:head# 2024-04-01T19:28:39.095 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:38 smithi062 ceph-mon[44211]: osdmap e174: 12 total, 11 up, 11 in 2024-04-01T19:28:39.095 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c10b28c:::benchmark_data_smithi188_77607_object119826:head# 2024-04-01T19:28:39.096 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c112b65:::benchmark_data_smithi188_77607_object157145:head# 2024-04-01T19:28:39.096 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c118b28:::benchmark_data_smithi188_77607_object127235:head# 2024-04-01T19:28:39.097 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:39.097 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c124ed2:::benchmark_data_smithi188_77607_object122099:head# 2024-04-01T19:28:39.098 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c14af98:::benchmark_data_smithi188_77607_object135146:head# 2024-04-01T19:28:39.098 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c17b4bb:::benchmark_data_smithi188_77607_object153116:head# 2024-04-01T19:28:39.099 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c18ab58:::benchmark_data_smithi188_77607_object142296:head# 2024-04-01T19:28:39.099 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c19d4e6:::benchmark_data_smithi188_77607_object117563:head# 2024-04-01T19:28:39.099 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c1a11a2:::benchmark_data_smithi188_77607_object117831:head# 2024-04-01T19:28:39.100 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c1a24a3:::benchmark_data_smithi188_77607_object127578:head# 2024-04-01T19:28:39.100 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c1ac11c:::benchmark_data_smithi188_77607_object122715:head# 2024-04-01T19:28:39.101 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c1b4f20:::benchmark_data_smithi188_77607_object117880:head# 2024-04-01T19:28:39.101 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c1bcc63:::benchmark_data_smithi188_77607_object107338:head# 2024-04-01T19:28:39.102 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c1bf309:::benchmark_data_smithi188_77607_object133713:head# 2024-04-01T19:28:39.102 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c1c2532:::benchmark_data_smithi188_77607_object136985:head# 2024-04-01T19:28:39.103 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c1c5089:::benchmark_data_smithi188_77607_object145422:head# 2024-04-01T19:28:39.103 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c1f9017:::benchmark_data_smithi188_77607_object162415:head# 2024-04-01T19:28:39.105 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c1ff6c0:::benchmark_data_smithi188_77607_object107874:head# 2024-04-01T19:28:39.105 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c20a66e:::benchmark_data_smithi188_77607_object102259:head# 2024-04-01T19:28:39.106 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c21a583:::benchmark_data_smithi188_77607_object122255:head# 2024-04-01T19:28:39.106 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c2227c6:::benchmark_data_smithi188_77607_object138655:head# 2024-04-01T19:28:39.107 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c238683:::benchmark_data_smithi188_77607_object115583:head# 2024-04-01T19:28:39.107 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c243d97:::benchmark_data_smithi188_77607_object118277:head# 2024-04-01T19:28:39.107 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c24640e:::benchmark_data_smithi188_77607_object114455:head# 2024-04-01T19:28:39.108 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c25bdf7:::benchmark_data_smithi188_77607_object144740:head# 2024-04-01T19:28:39.108 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c26782b:::benchmark_data_smithi188_77607_object120092:head# 2024-04-01T19:28:39.109 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c26ec9a:::benchmark_data_smithi188_77607_object111502:head# 2024-04-01T19:28:39.109 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c27d58e:::benchmark_data_smithi188_77607_object134133:head# 2024-04-01T19:28:39.110 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c29ccb3:::benchmark_data_smithi188_77607_object130213:head# 2024-04-01T19:28:39.111 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c29f2aa:::benchmark_data_smithi188_77607_object106161:head# 2024-04-01T19:28:39.111 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c2afb16:::benchmark_data_smithi188_77607_object154577:head# 2024-04-01T19:28:39.112 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c2b3ccf:::benchmark_data_smithi188_77607_object157346:head# 2024-04-01T19:28:39.112 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c2c5ded:::benchmark_data_smithi188_77607_object135503:head# 2024-04-01T19:28:39.112 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c2d1972:::benchmark_data_smithi188_77607_object154420:head# 2024-04-01T19:28:39.113 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c2d1a62:::benchmark_data_smithi188_77607_object116146:head# 2024-04-01T19:28:39.113 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c2de9cc:::benchmark_data_smithi188_77607_object130022:head# 2024-04-01T19:28:39.114 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c2e5f0c:::benchmark_data_smithi188_77607_object128306:head# 2024-04-01T19:28:39.114 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c2e706c:::benchmark_data_smithi188_77607_object136999:head# 2024-04-01T19:28:39.115 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c2eaa2a:::benchmark_data_smithi188_77607_object155486:head# 2024-04-01T19:28:39.115 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:28:39.115 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c2f766d:::benchmark_data_smithi188_77607_object134443:head# 2024-04-01T19:28:39.116 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c2fcacf:::benchmark_data_smithi188_77607_object122575:head# 2024-04-01T19:28:39.116 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c2fef54:::benchmark_data_smithi188_77607_object105817:head# 2024-04-01T19:28:39.117 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c307b0a:::benchmark_data_smithi188_77607_object104868:head# 2024-04-01T19:28:39.117 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c30c2f4:::benchmark_data_smithi188_77607_object121387:head# 2024-04-01T19:28:39.118 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:39.118 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:28:39.119 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c31f075:::benchmark_data_smithi188_77607_object161023:head# 2024-04-01T19:28:39.119 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c3272fa:::benchmark_data_smithi188_77607_object136195:head# 2024-04-01T19:28:39.119 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c32aff1:::benchmark_data_smithi188_77607_object131307:head# 2024-04-01T19:28:39.120 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c339cec:::benchmark_data_smithi188_77607_object119360:head# 2024-04-01T19:28:39.120 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c33c38d:::benchmark_data_smithi188_77607_object165972:head# 2024-04-01T19:28:39.120 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c363710:::benchmark_data_smithi188_77607_object107295:head# 2024-04-01T19:28:39.121 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c367fae:::benchmark_data_smithi188_77607_object145587:head# 2024-04-01T19:28:39.121 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c368523:::benchmark_data_smithi188_77607_object145087:head# 2024-04-01T19:28:39.122 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c374ec4:::benchmark_data_smithi188_77607_object148171:head# 2024-04-01T19:28:39.123 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c37dc29:::benchmark_data_smithi188_77607_object134966:head# 2024-04-01T19:28:39.123 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c389ea3:::benchmark_data_smithi188_77607_object135820:head# 2024-04-01T19:28:39.123 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c39990e:::benchmark_data_smithi188_77607_object144814:head# 2024-04-01T19:28:39.124 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c3aee62:::benchmark_data_smithi188_77607_object151254:head# 2024-04-01T19:28:39.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:38 smithi188 ceph-mon[43939]: osdmap e174: 12 total, 11 up, 11 in 2024-04-01T19:28:39.124 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c3c1345:::benchmark_data_smithi188_77607_object110972:head# 2024-04-01T19:28:39.124 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c3c1cc4:::benchmark_data_smithi188_77607_object160938:head# 2024-04-01T19:28:39.125 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c3c5b63:::benchmark_data_smithi188_77607_object148858:head# 2024-04-01T19:28:39.125 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c3cb3e6:::benchmark_data_smithi188_77607_object153988:head# 2024-04-01T19:28:39.126 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c3d4219:::benchmark_data_smithi188_77607_object114484:head# 2024-04-01T19:28:39.126 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c3dbf8e:::benchmark_data_smithi188_77607_object134602:head# 2024-04-01T19:28:39.127 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c3e92dd:::benchmark_data_smithi188_77607_object116044:head# 2024-04-01T19:28:39.127 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c3f2067:::benchmark_data_smithi188_77607_object143055:head# 2024-04-01T19:28:39.128 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c418323:::benchmark_data_smithi188_77607_object134178:head# 2024-04-01T19:28:39.128 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c423493:::benchmark_data_smithi188_77607_object107753:head# 2024-04-01T19:28:39.129 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c426052:::benchmark_data_smithi188_77607_object140383:head# 2024-04-01T19:28:39.129 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c43ddf1:::benchmark_data_smithi188_77607_object143020:head# 2024-04-01T19:28:39.130 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c43e345:::benchmark_data_smithi188_77607_object153174:head# 2024-04-01T19:28:39.130 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c4415aa:::benchmark_data_smithi188_77607_object101293:head# 2024-04-01T19:28:39.131 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c4467cc:::benchmark_data_smithi188_77607_object104841:head# 2024-04-01T19:28:39.131 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c44c403:::benchmark_data_smithi188_77607_object98497:head# 2024-04-01T19:28:39.132 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c4770bb:::benchmark_data_smithi188_77607_object164045:head# 2024-04-01T19:28:39.132 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c47b60d:::benchmark_data_smithi188_77607_object106502:head# 2024-04-01T19:28:39.132 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c487533:::benchmark_data_smithi188_77607_object126222:head# 2024-04-01T19:28:39.133 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c49219c:::benchmark_data_smithi188_77607_object130181:head# 2024-04-01T19:28:39.133 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c499167:::benchmark_data_smithi188_77607_object125398:head# 2024-04-01T19:28:39.134 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c49c9a5:::benchmark_data_smithi188_77607_object117377:head# 2024-04-01T19:28:39.134 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c4a5f99:::benchmark_data_smithi188_77607_object101294:head# 2024-04-01T19:28:39.135 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c4a61f3:::benchmark_data_smithi188_77607_object109164:head# 2024-04-01T19:28:39.136 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c4a7c75:::benchmark_data_smithi188_77607_object150720:head# 2024-04-01T19:28:39.136 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c4b3935:::benchmark_data_smithi188_77607_object126683:head# 2024-04-01T19:28:39.137 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c4c9e49:::benchmark_data_smithi188_77607_object125550:head# 2024-04-01T19:28:39.137 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c4e1b1b:::benchmark_data_smithi188_77607_object154144:head# 2024-04-01T19:28:39.138 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c4eea11:::benchmark_data_smithi188_77607_object151194:head# 2024-04-01T19:28:39.138 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c50d2db:::benchmark_data_smithi188_77607_object125616:head# 2024-04-01T19:28:39.138 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c514c6b:::benchmark_data_smithi188_77607_object145166:head# 2024-04-01T19:28:39.139 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c51ed0d:::benchmark_data_smithi188_77607_object148529:head# 2024-04-01T19:28:39.139 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c5250f5:::benchmark_data_smithi188_77607_object106706:head# 2024-04-01T19:28:39.139 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c530ef2:::benchmark_data_smithi188_77607_object104573:head# 2024-04-01T19:28:39.141 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c539f94:::benchmark_data_smithi188_77607_object114994:head# 2024-04-01T19:28:39.142 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c559834:::benchmark_data_smithi188_77607_object101470:head# 2024-04-01T19:28:39.142 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c575fb2:::benchmark_data_smithi188_77607_object113995:head# 2024-04-01T19:28:39.142 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c57e087:::benchmark_data_smithi188_77607_object99092:head# 2024-04-01T19:28:39.142 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c57f6ab:::benchmark_data_smithi188_77607_object104405:head# 2024-04-01T19:28:39.143 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c58dc81:::benchmark_data_smithi188_77607_object108951:head# 2024-04-01T19:28:39.143 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c593b1a:::benchmark_data_smithi188_77607_object99142:head# 2024-04-01T19:28:39.144 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c5a7251:::benchmark_data_smithi188_77607_object131312:head# 2024-04-01T19:28:39.144 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c5caaaa:::benchmark_data_smithi188_77607_object107935:head# 2024-04-01T19:28:39.145 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c5d6e1c:::benchmark_data_smithi188_77607_object131001:head# 2024-04-01T19:28:39.145 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c5ea360:::benchmark_data_smithi188_77607_object123190:head# 2024-04-01T19:28:39.145 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c5f0c2d:::benchmark_data_smithi188_77607_object117767:head# 2024-04-01T19:28:39.146 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c5fd3df:::benchmark_data_smithi188_77607_object107296:head# 2024-04-01T19:28:39.146 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c5fe1de:::benchmark_data_smithi188_77607_object163787:head# 2024-04-01T19:28:39.147 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c629682:::benchmark_data_smithi188_77607_object128225:head# 2024-04-01T19:28:39.147 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c62cac5:::benchmark_data_smithi188_77607_object112431:head# 2024-04-01T19:28:39.148 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c64011c:::benchmark_data_smithi188_77607_object123936:head# 2024-04-01T19:28:39.148 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c64078c:::benchmark_data_smithi188_77607_object153762:head# 2024-04-01T19:28:39.149 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c64eee0:::benchmark_data_smithi188_77607_object122356:head# 2024-04-01T19:28:39.150 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c64fa3b:::benchmark_data_smithi188_77607_object110911:head# 2024-04-01T19:28:39.150 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c66515b:::benchmark_data_smithi188_77607_object128604:head# 2024-04-01T19:28:39.151 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c67aa97:::benchmark_data_smithi188_77607_object159901:head# 2024-04-01T19:28:39.151 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c68472a:::benchmark_data_smithi188_77607_object138978:head# 2024-04-01T19:28:39.152 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c6a0980:::benchmark_data_smithi188_77607_object128808:head# 2024-04-01T19:28:39.152 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c6a7e75:::benchmark_data_smithi188_77607_object119929:head# 2024-04-01T19:28:39.153 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c6ab7fd:::benchmark_data_smithi188_77607_object124596:head# 2024-04-01T19:28:39.153 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c6db9e6:::benchmark_data_smithi188_77607_object103286:head# 2024-04-01T19:28:39.154 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c6dcc49:::benchmark_data_smithi188_77607_object130539:head# 2024-04-01T19:28:39.154 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c6e9f92:::benchmark_data_smithi188_77607_object119626:head# 2024-04-01T19:28:39.155 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c6f21df:::benchmark_data_smithi188_77607_object139054:head# 2024-04-01T19:28:39.155 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c6fb2e0:::benchmark_data_smithi188_77607_object108114:head# 2024-04-01T19:28:39.156 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c71e578:::benchmark_data_smithi188_77607_object124052:head# 2024-04-01T19:28:39.156 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c725a2a:::benchmark_data_smithi188_77607_object163053:head# 2024-04-01T19:28:39.157 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c73890c:::benchmark_data_smithi188_77607_object108718:head# 2024-04-01T19:28:39.157 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c73f836:::benchmark_data_smithi188_77607_object150200:head# 2024-04-01T19:28:39.158 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c7455ce:::benchmark_data_smithi188_77607_object101360:head# 2024-04-01T19:28:39.158 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c7603dc:::benchmark_data_smithi188_77607_object147654:head# 2024-04-01T19:28:39.159 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c76994b:::benchmark_data_smithi188_77607_object129555:head# 2024-04-01T19:28:39.159 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c76ca98:::benchmark_data_smithi188_77607_object148567:head# 2024-04-01T19:28:39.160 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c779a44:::benchmark_data_smithi188_77607_object151898:head# 2024-04-01T19:28:39.160 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c782aed:::benchmark_data_smithi188_77607_object153671:head# 2024-04-01T19:28:39.161 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c784d85:::benchmark_data_smithi188_77607_object118469:head# 2024-04-01T19:28:39.161 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c7918d0:::benchmark_data_smithi188_77607_object143898:head# 2024-04-01T19:28:39.162 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c792526:::benchmark_data_smithi188_77607_object120835:head# 2024-04-01T19:28:39.162 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c795bee:::benchmark_data_smithi188_77607_object119729:head# 2024-04-01T19:28:39.163 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c7a9ae7:::benchmark_data_smithi188_77607_object142668:head# 2024-04-01T19:28:39.163 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c7aaef0:::benchmark_data_smithi188_77607_object143912:head# 2024-04-01T19:28:39.164 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c7ac726:::benchmark_data_smithi188_77607_object114112:head# 2024-04-01T19:28:39.164 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c7cb790:::benchmark_data_smithi188_77607_object99592:head# 2024-04-01T19:28:39.165 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c7d05f8:::benchmark_data_smithi188_77607_object125520:head# 2024-04-01T19:28:39.165 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c7e71ae:::benchmark_data_smithi188_77607_object153198:head# 2024-04-01T19:28:39.166 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c7f329d:::benchmark_data_smithi188_77607_object112133:head# 2024-04-01T19:28:39.166 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c7feec9:::benchmark_data_smithi188_77607_object139995:head# 2024-04-01T19:28:39.167 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c816593:::benchmark_data_smithi188_77607_object126492:head# 2024-04-01T19:28:39.168 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c818cf7:::benchmark_data_smithi188_77607_object144760:head# 2024-04-01T19:28:39.168 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c81ec67:::benchmark_data_smithi188_77607_object127008:head# 2024-04-01T19:28:39.169 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c82cda9:::benchmark_data_smithi188_77607_object120954:head# 2024-04-01T19:28:39.169 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c830507:::benchmark_data_smithi188_77607_object151212:head# 2024-04-01T19:28:39.170 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c83340b:::benchmark_data_smithi188_77607_object142603:head# 2024-04-01T19:28:39.170 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c856134:::benchmark_data_smithi188_77607_object99985:head# 2024-04-01T19:28:39.170 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c85623b:::benchmark_data_smithi188_77607_object116895:head# 2024-04-01T19:28:39.171 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c860f30:::benchmark_data_smithi188_77607_object111306:head# 2024-04-01T19:28:39.171 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c878182:::benchmark_data_smithi188_77607_object136569:head# 2024-04-01T19:28:39.172 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c8857cc:::benchmark_data_smithi188_77607_object111948:head# 2024-04-01T19:28:39.172 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c89f8e7:::benchmark_data_smithi188_77607_object164258:head# 2024-04-01T19:28:39.173 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c8a74f9:::benchmark_data_smithi188_77607_object135864:head# 2024-04-01T19:28:39.173 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c8bede7:::benchmark_data_smithi188_77607_object158851:head# 2024-04-01T19:28:39.174 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c8d100c:::benchmark_data_smithi188_77607_object143249:head# 2024-04-01T19:28:39.174 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c8d174c:::benchmark_data_smithi188_77607_object98301:head# 2024-04-01T19:28:39.175 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c8dbc46:::benchmark_data_smithi188_77607_object145231:head# 2024-04-01T19:28:39.175 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c8df2e5:::benchmark_data_smithi188_77607_object135605:head# 2024-04-01T19:28:39.176 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c8f5fd5:::benchmark_data_smithi188_77607_object110372:head# 2024-04-01T19:28:39.176 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c8ff58c:::benchmark_data_smithi188_77607_object163504:head# 2024-04-01T19:28:39.177 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c91d189:::benchmark_data_smithi188_77607_object99793:head# 2024-04-01T19:28:39.177 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c939678:::benchmark_data_smithi188_77607_object157357:head# 2024-04-01T19:28:39.178 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c945469:::benchmark_data_smithi188_77607_object147854:head# 2024-04-01T19:28:39.178 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c947a6c:::benchmark_data_smithi188_77607_object143914:head# 2024-04-01T19:28:39.179 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c948e81:::benchmark_data_smithi188_77607_object111257:head# 2024-04-01T19:28:39.179 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c957dbd:::benchmark_data_smithi188_77607_object143943:head# 2024-04-01T19:28:39.179 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c95c017:::benchmark_data_smithi188_77607_object136265:head# 2024-04-01T19:28:39.180 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c95d47e:::benchmark_data_smithi188_77607_object157067:head# 2024-04-01T19:28:39.180 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c9845b9:::benchmark_data_smithi188_77607_object117407:head# 2024-04-01T19:28:39.181 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c992ae3:::benchmark_data_smithi188_77607_object121566:head# 2024-04-01T19:28:39.181 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c9b6ed2:::benchmark_data_smithi188_77607_object158840:head# 2024-04-01T19:28:39.182 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c9bef5a:::benchmark_data_smithi188_77607_object105197:head# 2024-04-01T19:28:39.182 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c9c8c54:::benchmark_data_smithi188_77607_object159064:head# 2024-04-01T19:28:39.183 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c9cae26:::benchmark_data_smithi188_77607_object154340:head# 2024-04-01T19:28:39.183 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6c9d2ba7:::benchmark_data_smithi188_77607_object124385:head# 2024-04-01T19:28:39.183 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ca1099c:::benchmark_data_smithi188_77607_object108272:head# 2024-04-01T19:28:39.184 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ca1d668:::benchmark_data_smithi188_77607_object114998:head# 2024-04-01T19:28:39.184 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ca3039a:::benchmark_data_smithi188_77607_object135469:head# 2024-04-01T19:28:39.185 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ca3663d:::benchmark_data_smithi188_77607_object118778:head# 2024-04-01T19:28:39.185 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ca3c6ff:::benchmark_data_smithi188_77607_object117869:head# 2024-04-01T19:28:39.186 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ca4d101:::benchmark_data_smithi188_77607_object155690:head# 2024-04-01T19:28:39.187 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ca58245:::benchmark_data_smithi188_77607_object117154:head# 2024-04-01T19:28:39.187 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ca63f8e:::benchmark_data_smithi188_77607_object151645:head# 2024-04-01T19:28:39.188 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ca6761e:::benchmark_data_smithi188_77607_object140128:head# 2024-04-01T19:28:39.188 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ca7592c:::benchmark_data_smithi188_77607_object113716:head# 2024-04-01T19:28:39.188 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ca78c61:::benchmark_data_smithi188_77607_object132288:head# 2024-04-01T19:28:39.189 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6caa021c:::benchmark_data_smithi188_77607_object159196:head# 2024-04-01T19:28:39.189 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6caa2468:::benchmark_data_smithi188_77607_object133443:head# 2024-04-01T19:28:39.190 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6caab2b3:::benchmark_data_smithi188_77607_object101540:head# 2024-04-01T19:28:39.190 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cab03ae:::benchmark_data_smithi188_77607_object152931:head# 2024-04-01T19:28:39.190 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cac288c:::benchmark_data_smithi188_77607_object163772:head# 2024-04-01T19:28:39.191 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cac9994:::benchmark_data_smithi188_77607_object159069:head# 2024-04-01T19:28:39.191 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6caea792:::benchmark_data_smithi188_77607_object167109:head# 2024-04-01T19:28:39.192 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cb05eb6:::benchmark_data_smithi188_77607_object114752:head# 2024-04-01T19:28:39.192 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cb2efd8:::benchmark_data_smithi188_77607_object123605:head# 2024-04-01T19:28:39.193 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cb41a18:::benchmark_data_smithi188_77607_object103026:head# 2024-04-01T19:28:39.193 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cb8f3e8:::benchmark_data_smithi188_77607_object156913:head# 2024-04-01T19:28:39.194 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cb9d6df:::benchmark_data_smithi188_77607_object159821:head# 2024-04-01T19:28:39.194 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cba16af:::benchmark_data_smithi188_77607_object154843:head# 2024-04-01T19:28:39.195 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cba5620:::benchmark_data_smithi188_77607_object155670:head# 2024-04-01T19:28:39.195 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cbd942b:::benchmark_data_smithi188_77607_object133614:head# 2024-04-01T19:28:39.195 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cbe3c57:::benchmark_data_smithi188_77607_object107453:head# 2024-04-01T19:28:39.196 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cbe98e4:::benchmark_data_smithi188_77607_object161643:head# 2024-04-01T19:28:39.196 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cbfa49a:::benchmark_data_smithi188_77607_object122870:head# 2024-04-01T19:28:39.197 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cbfe10f:::benchmark_data_smithi188_77607_object135253:head# 2024-04-01T19:28:39.197 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cbfe7a5:::benchmark_data_smithi188_77607_object153356:head# 2024-04-01T19:28:39.198 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cc0cd41:::benchmark_data_smithi188_77607_object147089:head# 2024-04-01T19:28:39.198 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cc11913:::benchmark_data_smithi188_77607_object164047:head# 2024-04-01T19:28:39.199 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cc20e66:::benchmark_data_smithi188_77607_object115759:head# 2024-04-01T19:28:39.199 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cc25b68:::benchmark_data_smithi188_77607_object127675:head# 2024-04-01T19:28:39.200 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cc33c39:::benchmark_data_smithi188_77607_object158848:head# 2024-04-01T19:28:39.201 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cc3e841:::benchmark_data_smithi188_77607_object138918:head# 2024-04-01T19:28:39.201 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cc3eb00:::benchmark_data_smithi188_77607_object121870:head# 2024-04-01T19:28:39.201 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cc403d4:::benchmark_data_smithi188_77607_object133090:head# 2024-04-01T19:28:39.202 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cc4290c:::benchmark_data_smithi188_77607_object159365:head# 2024-04-01T19:28:39.203 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cc492bb:::benchmark_data_smithi188_77607_object131682:head# 2024-04-01T19:28:39.203 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cc5e345:::benchmark_data_smithi188_77607_object137055:head# 2024-04-01T19:28:39.204 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cc984d8:::benchmark_data_smithi188_77607_object115362:head# 2024-04-01T19:28:39.204 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ccadb79:::benchmark_data_smithi188_77607_object141665:head# 2024-04-01T19:28:39.205 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ccba319:::benchmark_data_smithi188_77607_object138366:head# 2024-04-01T19:28:39.205 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ccc0563:::benchmark_data_smithi188_77607_object148572:head# 2024-04-01T19:28:39.205 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ccc0863:::benchmark_data_smithi188_77607_object121868:head# 2024-04-01T19:28:39.206 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ccce2ef:::benchmark_data_smithi188_77607_object132815:head# 2024-04-01T19:28:39.206 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ccdf8cd:::benchmark_data_smithi188_77607_object100072:head# 2024-04-01T19:28:39.207 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ccdfc1d:::benchmark_data_smithi188_77607_object112014:head# 2024-04-01T19:28:39.207 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cce29d2:::benchmark_data_smithi188_77607_object139515:head# 2024-04-01T19:28:39.208 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ccefb31:::benchmark_data_smithi188_77607_object161909:head# 2024-04-01T19:28:39.208 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ccf9c29:::benchmark_data_smithi188_77607_object147363:head# 2024-04-01T19:28:39.209 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ccfe3ab:::benchmark_data_smithi188_77607_object143352:head# 2024-04-01T19:28:39.209 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cd1da93:::benchmark_data_smithi188_77607_object139066:head# 2024-04-01T19:28:39.210 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cd39238:::benchmark_data_smithi188_77607_object139777:head# 2024-04-01T19:28:39.210 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cd3e346:::benchmark_data_smithi188_77607_object146265:head# 2024-04-01T19:28:39.211 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cd405b2:::benchmark_data_smithi188_77607_object103419:head# 2024-04-01T19:28:39.211 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cd458d8:::benchmark_data_smithi188_77607_object116848:head# 2024-04-01T19:28:39.212 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cd4cc8c:::benchmark_data_smithi188_77607_object143162:head# 2024-04-01T19:28:39.212 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cd63bbd:::benchmark_data_smithi188_77607_object156319:head# 2024-04-01T19:28:39.213 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cd6906e:::benchmark_data_smithi188_77607_object98724:head# 2024-04-01T19:28:39.213 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cd718bd:::benchmark_data_smithi188_77607_object136369:head# 2024-04-01T19:28:39.214 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cd85b78:::benchmark_data_smithi188_77607_object106649:head# 2024-04-01T19:28:39.214 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cd98f9f:::benchmark_data_smithi188_77607_object119925:head# 2024-04-01T19:28:39.215 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cda1b46:::benchmark_data_smithi188_77607_object134324:head# 2024-04-01T19:28:39.215 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cdd4301:::benchmark_data_smithi188_77607_object126116:head# 2024-04-01T19:28:39.216 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cdd4621:::benchmark_data_smithi188_77607_object131258:head# 2024-04-01T19:28:39.216 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cdf205c:::benchmark_data_smithi188_77607_object145931:head# 2024-04-01T19:28:39.217 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ce08015:::benchmark_data_smithi188_77607_object131529:head# 2024-04-01T19:28:39.217 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ce1d31b:::benchmark_data_smithi188_77607_object165536:head# 2024-04-01T19:28:39.218 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ce2dcb7:::benchmark_data_smithi188_77607_object132555:head# 2024-04-01T19:28:39.218 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ce502a0:::benchmark_data_smithi188_77607_object124285:head# 2024-04-01T19:28:39.219 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:28:39.219 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ce527f2:::benchmark_data_smithi188_77607_object107764:head# 2024-04-01T19:28:39.219 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ce611c4:::benchmark_data_smithi188_77607_object139375:head# 2024-04-01T19:28:39.220 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ce66658:::benchmark_data_smithi188_77607_object161368:head# 2024-04-01T19:28:39.220 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ce7333a:::benchmark_data_smithi188_77607_object99817:head# 2024-04-01T19:28:39.221 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ce930b4:::benchmark_data_smithi188_77607_object112472:head# 2024-04-01T19:28:39.221 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ce99fbf:::benchmark_data_smithi188_77607_object130380:head# 2024-04-01T19:28:39.221 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ceb0704:::benchmark_data_smithi188_77607_object99358:head# 2024-04-01T19:28:39.222 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ceb0b56:::benchmark_data_smithi188_77607_object151456:head# 2024-04-01T19:28:39.222 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cebd93c:::benchmark_data_smithi188_77607_object134726:head# 2024-04-01T19:28:39.223 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cecdbf3:::benchmark_data_smithi188_77607_object123261:head# 2024-04-01T19:28:39.223 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cee5264:::benchmark_data_smithi188_77607_object110011:head# 2024-04-01T19:28:39.224 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cef0bcb:::benchmark_data_smithi188_77607_object116792:head# 2024-04-01T19:28:39.224 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cef770e:::benchmark_data_smithi188_77607_object111166:head# 2024-04-01T19:28:39.225 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ceff88f:::benchmark_data_smithi188_77607_object162673:head# 2024-04-01T19:28:39.226 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cf0833c:::benchmark_data_smithi188_77607_object143415:head# 2024-04-01T19:28:39.226 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cf0bf30:::benchmark_data_smithi188_77607_object151688:head# 2024-04-01T19:28:39.226 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cf1d55b:::benchmark_data_smithi188_77607_object119830:head# 2024-04-01T19:28:39.227 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cf1de7e:::benchmark_data_smithi188_77607_object97935:head# 2024-04-01T19:28:39.228 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cf28f7a:::benchmark_data_smithi188_77607_object165471:head# 2024-04-01T19:28:39.228 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cf31f21:::benchmark_data_smithi188_77607_object122776:head# 2024-04-01T19:28:39.228 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cf3c9bb:::benchmark_data_smithi188_77607_object154818:head# 2024-04-01T19:28:39.229 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cf3e4d7:::benchmark_data_smithi188_77607_object106156:head# 2024-04-01T19:28:39.229 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cf3fc5e:::benchmark_data_smithi188_77607_object136846:head# 2024-04-01T19:28:39.230 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cf45738:::benchmark_data_smithi188_77607_object160818:head# 2024-04-01T19:28:39.230 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cf5390e:::benchmark_data_smithi188_77607_object137840:head# 2024-04-01T19:28:39.231 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cf63c22:::benchmark_data_smithi188_77607_object133853:head# 2024-04-01T19:28:39.231 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cf7d08b:::benchmark_data_smithi188_77607_object141893:head# 2024-04-01T19:28:39.232 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cf829dc:::benchmark_data_smithi188_77607_object105613:head# 2024-04-01T19:28:39.232 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cf8e852:::benchmark_data_smithi188_77607_object145259:head# 2024-04-01T19:28:39.233 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cf9b77f:::benchmark_data_smithi188_77607_object111274:head# 2024-04-01T19:28:39.233 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cf9dc41:::benchmark_data_smithi188_77607_object112233:head# 2024-04-01T19:28:39.234 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cfc204d:::benchmark_data_smithi188_77607_object133013:head# 2024-04-01T19:28:39.234 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cfc49e2:::benchmark_data_smithi188_77607_object138161:head# 2024-04-01T19:28:39.235 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cfc8b43:::benchmark_data_smithi188_77607_object140755:head# 2024-04-01T19:28:39.235 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cfd39bc:::benchmark_data_smithi188_77607_object145249:head# 2024-04-01T19:28:39.236 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cfe4d88:::benchmark_data_smithi188_77607_object117433:head# 2024-04-01T19:28:39.236 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cfebf53:::benchmark_data_smithi188_77607_object118139:head# 2024-04-01T19:28:39.237 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6cfef48e:::benchmark_data_smithi188_77607_object151027:head# 2024-04-01T19:28:39.237 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d00c089:::benchmark_data_smithi188_77607_object145703:head# 2024-04-01T19:28:39.238 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d00fa38:::benchmark_data_smithi188_77607_object103911:head# 2024-04-01T19:28:39.238 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d01c637:::benchmark_data_smithi188_77607_object167044:head# 2024-04-01T19:28:39.239 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d025e6a:::benchmark_data_smithi188_77607_object127661:head# 2024-04-01T19:28:39.239 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d02a725:::benchmark_data_smithi188_77607_object104922:head# 2024-04-01T19:28:39.240 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d02f28d:::benchmark_data_smithi188_77607_object146291:head# 2024-04-01T19:28:39.240 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d03ace7:::benchmark_data_smithi188_77607_object161191:head# 2024-04-01T19:28:39.241 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d045125:::benchmark_data_smithi188_77607_object100788:head# 2024-04-01T19:28:39.241 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d04668a:::benchmark_data_smithi188_77607_object141974:head# 2024-04-01T19:28:39.242 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d0729ce:::benchmark_data_smithi188_77607_object107280:head# 2024-04-01T19:28:39.242 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d073782:::benchmark_data_smithi188_77607_object134661:head# 2024-04-01T19:28:39.243 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d08a5eb:::benchmark_data_smithi188_77607_object112433:head# 2024-04-01T19:28:39.243 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d0acdad:::benchmark_data_smithi188_77607_object113853:head# 2024-04-01T19:28:39.244 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d0b400f:::benchmark_data_smithi188_77607_object118740:head# 2024-04-01T19:28:39.244 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d0c4164:::benchmark_data_smithi188_77607_object142122:head# 2024-04-01T19:28:39.244 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d0cd7ba:::benchmark_data_smithi188_77607_object160557:head# 2024-04-01T19:28:39.245 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d0f56ef:::benchmark_data_smithi188_77607_object99816:head# 2024-04-01T19:28:39.246 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d0f7029:::benchmark_data_smithi188_77607_object154955:head# 2024-04-01T19:28:39.246 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d0fb9e9:::benchmark_data_smithi188_77607_object136671:head# 2024-04-01T19:28:39.247 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d0ff2d3:::benchmark_data_smithi188_77607_object162490:head# 2024-04-01T19:28:39.247 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d109a16:::benchmark_data_smithi188_77607_object103563:head# 2024-04-01T19:28:39.248 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d113a50:::benchmark_data_smithi188_77607_object165711:head# 2024-04-01T19:28:39.248 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d126130:::benchmark_data_smithi188_77607_object148072:head# 2024-04-01T19:28:39.248 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:39.249 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d150feb:::benchmark_data_smithi188_77607_object136743:head# 2024-04-01T19:28:39.249 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d1536bc:::benchmark_data_smithi188_77607_object124490:head# 2024-04-01T19:28:39.250 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d15f82d:::benchmark_data_smithi188_77607_object147177:head# 2024-04-01T19:28:39.250 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d16dfc9:::benchmark_data_smithi188_77607_object121195:head# 2024-04-01T19:28:39.252 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d18c65f:::benchmark_data_smithi188_77607_object153486:head# 2024-04-01T19:28:39.252 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d19572d:::benchmark_data_smithi188_77607_object113302:head# 2024-04-01T19:28:39.252 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d1a5007:::benchmark_data_smithi188_77607_object137464:head# 2024-04-01T19:28:39.253 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d1ab660:::benchmark_data_smithi188_77607_object137820:head# 2024-04-01T19:28:39.253 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d1bf18d:::benchmark_data_smithi188_77607_object127232:head# 2024-04-01T19:28:39.254 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d1d8a70:::benchmark_data_smithi188_77607_object138576:head# 2024-04-01T19:28:39.254 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d1ed143:::benchmark_data_smithi188_77607_object149548:head# 2024-04-01T19:28:39.255 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d2044f0:::benchmark_data_smithi188_77607_object112972:head# 2024-04-01T19:28:39.255 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d242359:::benchmark_data_smithi188_77607_object140864:head# 2024-04-01T19:28:39.256 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d254f9e:::benchmark_data_smithi188_77607_object162803:head# 2024-04-01T19:28:39.256 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d2653c4:::benchmark_data_smithi188_77607_object119970:head# 2024-04-01T19:28:39.257 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d27861a:::benchmark_data_smithi188_77607_object137293:head# 2024-04-01T19:28:39.257 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d288634:::benchmark_data_smithi188_77607_object124557:head# 2024-04-01T19:28:39.258 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d28ba58:::benchmark_data_smithi188_77607_object126565:head# 2024-04-01T19:28:39.258 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d2abf69:::benchmark_data_smithi188_77607_object101418:head# 2024-04-01T19:28:39.259 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d2b08c6:::benchmark_data_smithi188_77607_object139207:head# 2024-04-01T19:28:39.259 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d2d41b0:::benchmark_data_smithi188_77607_object153530:head# 2024-04-01T19:28:39.260 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d2e3ed8:::benchmark_data_smithi188_77607_object156229:head# 2024-04-01T19:28:39.260 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d2ea7ed:::benchmark_data_smithi188_77607_object132410:head# 2024-04-01T19:28:39.261 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d2f09f9:::benchmark_data_smithi188_77607_object166287:head# 2024-04-01T19:28:39.261 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d2f19db:::benchmark_data_smithi188_77607_object151906:head# 2024-04-01T19:28:39.261 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d312c36:::benchmark_data_smithi188_77607_object143224:head# 2024-04-01T19:28:39.262 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d31a003:::benchmark_data_smithi188_77607_object164614:head# 2024-04-01T19:28:39.263 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d3213e3:::benchmark_data_smithi188_77607_object132565:head# 2024-04-01T19:28:39.263 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d32f14a:::benchmark_data_smithi188_77607_object134811:head# 2024-04-01T19:28:39.263 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d3329b8:::benchmark_data_smithi188_77607_object166875:head# 2024-04-01T19:28:39.264 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d33d946:::benchmark_data_smithi188_77607_object108733:head# 2024-04-01T19:28:39.264 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d355d74:::benchmark_data_smithi188_77607_object143905:head# 2024-04-01T19:28:39.264 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d366899:::benchmark_data_smithi188_77607_object140413:head# 2024-04-01T19:28:39.265 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d371d6e:::benchmark_data_smithi188_77607_object104902:head# 2024-04-01T19:28:39.265 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d388bc6:::benchmark_data_smithi188_77607_object162542:head# 2024-04-01T19:28:39.266 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d390dac:::benchmark_data_smithi188_77607_object160729:head# 2024-04-01T19:28:39.267 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d39604c:::benchmark_data_smithi188_77607_object124046:head# 2024-04-01T19:28:39.267 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d39dab1:::benchmark_data_smithi188_77607_object156860:head# 2024-04-01T19:28:39.267 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d39fb57:::benchmark_data_smithi188_77607_object151404:head# 2024-04-01T19:28:39.268 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d39fdf5:::benchmark_data_smithi188_77607_object166965:head# 2024-04-01T19:28:39.268 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d3a336d:::benchmark_data_smithi188_77607_object109142:head# 2024-04-01T19:28:39.269 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d3a7574:::benchmark_data_smithi188_77607_object141642:head# 2024-04-01T19:28:39.269 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d3a837c:::benchmark_data_smithi188_77607_object124460:head# 2024-04-01T19:28:39.270 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d3ab117:::benchmark_data_smithi188_77607_object104698:head# 2024-04-01T19:28:39.270 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d3ae895:::benchmark_data_smithi188_77607_object128423:head# 2024-04-01T19:28:39.271 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d3b2d55:::benchmark_data_smithi188_77607_object138529:head# 2024-04-01T19:28:39.271 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d3bdc39:::benchmark_data_smithi188_77607_object109598:head# 2024-04-01T19:28:39.272 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d3d53f3:::benchmark_data_smithi188_77607_object149575:head# 2024-04-01T19:28:39.272 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d3dc30c:::benchmark_data_smithi188_77607_object158736:head# 2024-04-01T19:28:39.272 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d3e588f:::benchmark_data_smithi188_77607_object150158:head# 2024-04-01T19:28:39.273 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d3e6395:::benchmark_data_smithi188_77607_object99437:head# 2024-04-01T19:28:39.273 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d3e66c6:::benchmark_data_smithi188_77607_object121283:head# 2024-04-01T19:28:39.274 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d3ff4c6:::benchmark_data_smithi188_77607_object127736:head# 2024-04-01T19:28:39.274 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d40be51:::benchmark_data_smithi188_77607_object122342:head# 2024-04-01T19:28:39.275 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d4322de:::benchmark_data_smithi188_77607_object118316:head# 2024-04-01T19:28:39.275 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d43ec98:::benchmark_data_smithi188_77607_object157153:head# 2024-04-01T19:28:39.275 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d45f187:::benchmark_data_smithi188_77607_object103078:head# 2024-04-01T19:28:39.276 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d46cb9a:::benchmark_data_smithi188_77607_object117820:head# 2024-04-01T19:28:39.277 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d46ff44:::benchmark_data_smithi188_77607_object162897:head# 2024-04-01T19:28:39.277 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d47395a:::benchmark_data_smithi188_77607_object137975:head# 2024-04-01T19:28:39.277 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d47511c:::benchmark_data_smithi188_77607_object123243:head# 2024-04-01T19:28:39.278 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d47dab6:::benchmark_data_smithi188_77607_object123863:head# 2024-04-01T19:28:39.278 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d494531:::benchmark_data_smithi188_77607_object141146:head# 2024-04-01T19:28:39.279 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d496b4f:::benchmark_data_smithi188_77607_object156563:head# 2024-04-01T19:28:39.279 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d49c1d5:::benchmark_data_smithi188_77607_object150535:head# 2024-04-01T19:28:39.280 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d49eb18:::benchmark_data_smithi188_77607_object151246:head# 2024-04-01T19:28:39.280 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d4a84c6:::benchmark_data_smithi188_77607_object108182:head# 2024-04-01T19:28:39.281 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d4ba30a:::benchmark_data_smithi188_77607_object121698:head# 2024-04-01T19:28:39.281 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d4c30a3:::benchmark_data_smithi188_77607_object158542:head# 2024-04-01T19:28:39.282 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d4dc931:::benchmark_data_smithi188_77607_object165593:head# 2024-04-01T19:28:39.282 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d4fb4db:::benchmark_data_smithi188_77607_object114493:head# 2024-04-01T19:28:39.283 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d503442:::benchmark_data_smithi188_77607_object133414:head# 2024-04-01T19:28:39.283 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d505c17:::benchmark_data_smithi188_77607_object102707:head# 2024-04-01T19:28:39.284 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d50b8cc:::benchmark_data_smithi188_77607_object133791:head# 2024-04-01T19:28:39.284 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d51617c:::benchmark_data_smithi188_77607_object146043:head# 2024-04-01T19:28:39.284 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d51dc65:::benchmark_data_smithi188_77607_object109473:head# 2024-04-01T19:28:39.285 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d5217e0:::benchmark_data_smithi188_77607_object166429:head# 2024-04-01T19:28:39.285 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d525351:::benchmark_data_smithi188_77607_object125593:head# 2024-04-01T19:28:39.286 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d53269f:::benchmark_data_smithi188_77607_object122428:head# 2024-04-01T19:28:39.286 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d5327a3:::benchmark_data_smithi188_77607_object160162:head# 2024-04-01T19:28:39.287 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d5547f4:::benchmark_data_smithi188_77607_object107107:head# 2024-04-01T19:28:39.287 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d560e40:::benchmark_data_smithi188_77607_object104477:head# 2024-04-01T19:28:39.287 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d57e427:::benchmark_data_smithi188_77607_object162550:head# 2024-04-01T19:28:39.288 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d583254:::benchmark_data_smithi188_77607_object155616:head# 2024-04-01T19:28:39.288 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d594db8:::benchmark_data_smithi188_77607_object157022:head# 2024-04-01T19:28:39.289 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d5bc542:::benchmark_data_smithi188_77607_object123108:head# 2024-04-01T19:28:39.290 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d5c3d9c:::benchmark_data_smithi188_77607_object128690:head# 2024-04-01T19:28:39.290 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d5d24e5:::benchmark_data_smithi188_77607_object158838:head# 2024-04-01T19:28:39.290 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d5eb929:::benchmark_data_smithi188_77607_object123420:head# 2024-04-01T19:28:39.291 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d61e078:::benchmark_data_smithi188_77607_object162607:head# 2024-04-01T19:28:39.291 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d630675:::benchmark_data_smithi188_77607_object159545:head# 2024-04-01T19:28:39.292 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d63315a:::benchmark_data_smithi188_77607_object126721:head# 2024-04-01T19:28:39.292 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d63faaa:::benchmark_data_smithi188_77607_object133274:head# 2024-04-01T19:28:39.293 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d64c8b6:::benchmark_data_smithi188_77607_object149641:head# 2024-04-01T19:28:39.293 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d64fe23:::benchmark_data_smithi188_77607_object115456:head# 2024-04-01T19:28:39.294 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d66d7df:::benchmark_data_smithi188_77607_object157678:head# 2024-04-01T19:28:39.294 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d693226:::benchmark_data_smithi188_77607_object123644:head# 2024-04-01T19:28:39.295 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d6a5ddc:::benchmark_data_smithi188_77607_object122252:head# 2024-04-01T19:28:39.295 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d6b8d94:::benchmark_data_smithi188_77607_object165979:head# 2024-04-01T19:28:39.295 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d6c0f25:::benchmark_data_smithi188_77607_object101118:head# 2024-04-01T19:28:39.296 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d6c2b17:::benchmark_data_smithi188_77607_object129175:head# 2024-04-01T19:28:39.296 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d6c441f:::benchmark_data_smithi188_77607_object137896:head# 2024-04-01T19:28:39.297 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d6d4a75:::benchmark_data_smithi188_77607_object106940:head# 2024-04-01T19:28:39.297 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d6e3ff8:::benchmark_data_smithi188_77607_object131329:head# 2024-04-01T19:28:39.298 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d6e9545:::benchmark_data_smithi188_77607_object112725:head# 2024-04-01T19:28:39.298 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d700ad1:::benchmark_data_smithi188_77607_object148013:head# 2024-04-01T19:28:39.299 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d701027:::benchmark_data_smithi188_77607_object118161:head# 2024-04-01T19:28:39.299 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d703d75:::benchmark_data_smithi188_77607_object127148:head# 2024-04-01T19:28:39.300 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d72126b:::benchmark_data_smithi188_77607_object149952:head# 2024-04-01T19:28:39.300 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d721a05:::benchmark_data_smithi188_77607_object156208:head# 2024-04-01T19:28:39.301 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d729d52:::benchmark_data_smithi188_77607_object117589:head# 2024-04-01T19:28:39.301 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d7314dd:::benchmark_data_smithi188_77607_object114648:head# 2024-04-01T19:28:39.302 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d733602:::benchmark_data_smithi188_77607_object142335:head# 2024-04-01T19:28:39.302 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d734fbc:::benchmark_data_smithi188_77607_object125720:head# 2024-04-01T19:28:39.303 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d73b5b8:::benchmark_data_smithi188_77607_object113529:head# 2024-04-01T19:28:39.303 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d74aff5:::benchmark_data_smithi188_77607_object115579:head# 2024-04-01T19:28:39.304 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d7519cd:::benchmark_data_smithi188_77607_object109761:head# 2024-04-01T19:28:39.304 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d76912d:::benchmark_data_smithi188_77607_object124452:head# 2024-04-01T19:28:39.305 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d76e482:::benchmark_data_smithi188_77607_object147760:head# 2024-04-01T19:28:39.305 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d7947de:::benchmark_data_smithi188_77607_object99615:head# 2024-04-01T19:28:39.306 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d7bb6e0:::benchmark_data_smithi188_77607_object111821:head# 2024-04-01T19:28:39.306 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d7bbfed:::benchmark_data_smithi188_77607_object123535:head# 2024-04-01T19:28:39.306 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d7c4d1c:::benchmark_data_smithi188_77607_object118718:head# 2024-04-01T19:28:39.307 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d7d4c91:::benchmark_data_smithi188_77607_object148017:head# 2024-04-01T19:28:39.307 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d7d6036:::benchmark_data_smithi188_77607_object138200:head# 2024-04-01T19:28:39.308 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d7e1db5:::benchmark_data_smithi188_77607_object151643:head# 2024-04-01T19:28:39.308 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d7e4ef3:::benchmark_data_smithi188_77607_object98160:head# 2024-04-01T19:28:39.309 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d7f2d53:::benchmark_data_smithi188_77607_object133189:head# 2024-04-01T19:28:39.309 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d7ff2e0:::benchmark_data_smithi188_77607_object122461:head# 2024-04-01T19:28:39.310 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d803264:::benchmark_data_smithi188_77607_object101730:head# 2024-04-01T19:28:39.310 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d807c26:::benchmark_data_smithi188_77607_object159555:head# 2024-04-01T19:28:39.311 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d821063:::benchmark_data_smithi188_77607_object131437:head# 2024-04-01T19:28:39.311 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d85658e:::benchmark_data_smithi188_77607_object119875:head# 2024-04-01T19:28:39.312 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d859ad5:::benchmark_data_smithi188_77607_object137547:head# 2024-04-01T19:28:39.312 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d85dcf9:::benchmark_data_smithi188_77607_object112637:head# 2024-04-01T19:28:39.313 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d85f3b4:::benchmark_data_smithi188_77607_object114848:head# 2024-04-01T19:28:39.313 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d86e510:::benchmark_data_smithi188_77607_object153184:head# 2024-04-01T19:28:39.314 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d87414a:::benchmark_data_smithi188_77607_object130023:head# 2024-04-01T19:28:39.314 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d88a153:::benchmark_data_smithi188_77607_object153642:head# 2024-04-01T19:28:39.315 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d890269:::benchmark_data_smithi188_77607_object131099:head# 2024-04-01T19:28:39.315 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d892451:::benchmark_data_smithi188_77607_object127978:head# 2024-04-01T19:28:39.315 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d8d8aa0:::benchmark_data_smithi188_77607_object162515:head# 2024-04-01T19:28:39.316 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d8da03a:::benchmark_data_smithi188_77607_object102562:head# 2024-04-01T19:28:39.316 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d8db9d4:::benchmark_data_smithi188_77607_object145050:head# 2024-04-01T19:28:39.317 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d8dd1db:::benchmark_data_smithi188_77607_object148213:head# 2024-04-01T19:28:39.318 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d913ff0:::benchmark_data_smithi188_77607_object147348:head# 2024-04-01T19:28:39.318 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d92178a:::benchmark_data_smithi188_77607_object129394:head# 2024-04-01T19:28:39.318 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d926c0d:::benchmark_data_smithi188_77607_object137035:head# 2024-04-01T19:28:39.319 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d930859:::benchmark_data_smithi188_77607_object153610:head# 2024-04-01T19:28:39.319 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d943bb7:::benchmark_data_smithi188_77607_object165730:head# 2024-04-01T19:28:39.320 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d94dc6e:::benchmark_data_smithi188_77607_object136165:head# 2024-04-01T19:28:39.320 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d95fe8b:::benchmark_data_smithi188_77607_object99949:head# 2024-04-01T19:28:39.320 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d9733da:::benchmark_data_smithi188_77607_object120653:head# 2024-04-01T19:28:39.321 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d97d305:::benchmark_data_smithi188_77607_object153925:head# 2024-04-01T19:28:39.321 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d97e44d:::benchmark_data_smithi188_77607_object102680:head# 2024-04-01T19:28:39.322 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d99c781:::benchmark_data_smithi188_77607_object142266:head# 2024-04-01T19:28:39.322 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d99cb35:::benchmark_data_smithi188_77607_object114465:head# 2024-04-01T19:28:39.323 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d9b5aa6:::benchmark_data_smithi188_77607_object165291:head# 2024-04-01T19:28:39.323 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d9bff03:::benchmark_data_smithi188_77607_object135107:head# 2024-04-01T19:28:39.324 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d9c1e23:::benchmark_data_smithi188_77607_object110362:head# 2024-04-01T19:28:39.324 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d9e3be8:::benchmark_data_smithi188_77607_object153054:head# 2024-04-01T19:28:39.324 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6d9e7561:::benchmark_data_smithi188_77607_object122902:head# 2024-04-01T19:28:39.325 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6da174cb:::benchmark_data_smithi188_77607_object151379:head# 2024-04-01T19:28:39.325 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6da1ee79:::benchmark_data_smithi188_77607_object127154:head# 2024-04-01T19:28:39.326 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6da256e8:::benchmark_data_smithi188_77607_object111940:head# 2024-04-01T19:28:39.326 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6da338b5:::benchmark_data_smithi188_77607_object138059:head# 2024-04-01T19:28:39.327 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6da3765e:::benchmark_data_smithi188_77607_object102077:head# 2024-04-01T19:28:39.327 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6da39044:::benchmark_data_smithi188_77607_object146759:head# 2024-04-01T19:28:39.328 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6da3999c:::benchmark_data_smithi188_77607_object163887:head# 2024-04-01T19:28:39.328 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6da5bb69:::benchmark_data_smithi188_77607_object107124:head# 2024-04-01T19:28:39.329 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6da681af:::benchmark_data_smithi188_77607_object148277:head# 2024-04-01T19:28:39.329 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6da7dd41:::benchmark_data_smithi188_77607_object158926:head# 2024-04-01T19:28:39.330 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6da7f918:::benchmark_data_smithi188_77607_object111446:head# 2024-04-01T19:28:39.330 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dabe438:::benchmark_data_smithi188_77607_object142818:head# 2024-04-01T19:28:39.331 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6daca839:::benchmark_data_smithi188_77607_object163328:head# 2024-04-01T19:28:39.331 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dadc0d4:::benchmark_data_smithi188_77607_object131418:head# 2024-04-01T19:28:39.332 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dae07ab:::benchmark_data_smithi188_77607_object163413:head# 2024-04-01T19:28:39.332 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dae9de6:::benchmark_data_smithi188_77607_object155383:head# 2024-04-01T19:28:39.333 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6db1462a:::benchmark_data_smithi188_77607_object165727:head# 2024-04-01T19:28:39.333 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6db17d8a:::benchmark_data_smithi188_77607_object164464:head# 2024-04-01T19:28:39.334 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6db1d373:::benchmark_data_smithi188_77607_object137225:head# 2024-04-01T19:28:39.334 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6db21010:::benchmark_data_smithi188_77607_object98064:head# 2024-04-01T19:28:39.335 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6db222ab:::benchmark_data_smithi188_77607_object145788:head# 2024-04-01T19:28:39.335 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6db22996:::benchmark_data_smithi188_77607_object130366:head# 2024-04-01T19:28:39.336 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6db2c336:::benchmark_data_smithi188_77607_object145824:head# 2024-04-01T19:28:39.336 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6db44cc9:::benchmark_data_smithi188_77607_object103944:head# 2024-04-01T19:28:39.337 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6db591bd:::benchmark_data_smithi188_77607_object119788:head# 2024-04-01T19:28:39.337 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6db65b3c:::benchmark_data_smithi188_77607_object99120:head# 2024-04-01T19:28:39.337 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6db72b9e:::benchmark_data_smithi188_77607_object155767:head# 2024-04-01T19:28:39.338 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6db75623:::benchmark_data_smithi188_77607_object120537:head# 2024-04-01T19:28:39.339 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6db849ed:::benchmark_data_smithi188_77607_object105710:head# 2024-04-01T19:28:39.339 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6db84e54:::benchmark_data_smithi188_77607_object107086:head# 2024-04-01T19:28:39.340 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6db89a43:::benchmark_data_smithi188_77607_object149333:head# 2024-04-01T19:28:39.340 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dba3ba4:::benchmark_data_smithi188_77607_object137489:head# 2024-04-01T19:28:39.341 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dbac2df:::benchmark_data_smithi188_77607_object98590:head# 2024-04-01T19:28:39.341 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dbbc860:::benchmark_data_smithi188_77607_object157522:head# 2024-04-01T19:28:39.342 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dbc48cd:::benchmark_data_smithi188_77607_object147287:head# 2024-04-01T19:28:39.342 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dbc5118:::benchmark_data_smithi188_77607_object101780:head# 2024-04-01T19:28:39.342 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dbd146d:::benchmark_data_smithi188_77607_object149406:head# 2024-04-01T19:28:39.343 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dbdabf4:::benchmark_data_smithi188_77607_object99296:head# 2024-04-01T19:28:39.345 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dbfa4a5:::benchmark_data_smithi188_77607_object155226:head# 2024-04-01T19:28:39.345 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dc0d04a:::benchmark_data_smithi188_77607_object129118:head# 2024-04-01T19:28:39.345 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dc0f5c1:::benchmark_data_smithi188_77607_object123264:head# 2024-04-01T19:28:39.346 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dc1ed03:::benchmark_data_smithi188_77607_object160466:head# 2024-04-01T19:28:39.346 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dc1f9ea:::benchmark_data_smithi188_77607_object133762:head# 2024-04-01T19:28:39.346 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dc1ff24:::benchmark_data_smithi188_77607_object146547:head# 2024-04-01T19:28:39.346 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dc388a3:::benchmark_data_smithi188_77607_object165981:head# 2024-04-01T19:28:39.347 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dc39b62:::benchmark_data_smithi188_77607_object155691:head# 2024-04-01T19:28:39.347 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dc42d77:::benchmark_data_smithi188_77607_object114378:head# 2024-04-01T19:28:39.348 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dc538af:::benchmark_data_smithi188_77607_object155350:head# 2024-04-01T19:28:39.348 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dc61448:::benchmark_data_smithi188_77607_object139032:head# 2024-04-01T19:28:39.349 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dcb7911:::benchmark_data_smithi188_77607_object122832:head# 2024-04-01T19:28:39.349 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dcbcc12:::benchmark_data_smithi188_77607_object100366:head# 2024-04-01T19:28:39.350 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dcf6544:::benchmark_data_smithi188_77607_object112708:head# 2024-04-01T19:28:39.351 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dd02fb4:::benchmark_data_smithi188_77607_object164144:head# 2024-04-01T19:28:39.351 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dd24173:::benchmark_data_smithi188_77607_object134698:head# 2024-04-01T19:28:39.352 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dd3772e:::benchmark_data_smithi188_77607_object102656:head# 2024-04-01T19:28:39.352 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dd3fed7:::benchmark_data_smithi188_77607_object126829:head# 2024-04-01T19:28:39.352 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dd5e542:::benchmark_data_smithi188_77607_object150170:head# 2024-04-01T19:28:39.353 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dd5fb10:::benchmark_data_smithi188_77607_object158543:head# 2024-04-01T19:28:39.354 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dd6e799:::benchmark_data_smithi188_77607_object98140:head# 2024-04-01T19:28:39.354 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dd8122e:::benchmark_data_smithi188_77607_object144408:head# 2024-04-01T19:28:39.355 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dd861b4:::benchmark_data_smithi188_77607_object151613:head# 2024-04-01T19:28:39.355 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dde6b91:::benchmark_data_smithi188_77607_object111697:head# 2024-04-01T19:28:39.355 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ddf63a8:::benchmark_data_smithi188_77607_object117931:head# 2024-04-01T19:28:39.356 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6de02e42:::benchmark_data_smithi188_77607_object106630:head# 2024-04-01T19:28:39.356 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6de03b47:::benchmark_data_smithi188_77607_object133680:head# 2024-04-01T19:28:39.357 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6de453c5:::benchmark_data_smithi188_77607_object151274:head# 2024-04-01T19:28:39.357 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6de4a4f9:::benchmark_data_smithi188_77607_object126767:head# 2024-04-01T19:28:39.358 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6de4ceaf:::benchmark_data_smithi188_77607_object105833:head# 2024-04-01T19:28:39.358 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6de4d712:::benchmark_data_smithi188_77607_object156811:head# 2024-04-01T19:28:39.359 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6de50658:::benchmark_data_smithi188_77607_object150224:head# 2024-04-01T19:28:39.359 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6de69ec7:::benchmark_data_smithi188_77607_object157662:head# 2024-04-01T19:28:39.360 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6de937ba:::benchmark_data_smithi188_77607_object106326:head# 2024-04-01T19:28:39.360 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6de93d0b:::benchmark_data_smithi188_77607_object166099:head# 2024-04-01T19:28:39.361 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6de954b6:::benchmark_data_smithi188_77607_object102219:head# 2024-04-01T19:28:39.361 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6deb5fe8:::benchmark_data_smithi188_77607_object147468:head# 2024-04-01T19:28:39.362 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6deca275:::benchmark_data_smithi188_77607_object142666:head# 2024-04-01T19:28:39.362 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6df1cebe:::benchmark_data_smithi188_77607_object120917:head# 2024-04-01T19:28:39.362 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6df21eac:::benchmark_data_smithi188_77607_object159077:head# 2024-04-01T19:28:39.363 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6df2d992:::benchmark_data_smithi188_77607_object156688:head# 2024-04-01T19:28:39.363 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6df38330:::benchmark_data_smithi188_77607_object143691:head# 2024-04-01T19:28:39.364 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6df3cf60:::benchmark_data_smithi188_77607_object135251:head# 2024-04-01T19:28:39.364 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6df58326:::benchmark_data_smithi188_77607_object103904:head# 2024-04-01T19:28:39.365 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6df657b9:::benchmark_data_smithi188_77607_object159913:head# 2024-04-01T19:28:39.365 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6df7a6da:::benchmark_data_smithi188_77607_object132784:head# 2024-04-01T19:28:39.366 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6df8375e:::benchmark_data_smithi188_77607_object156580:head# 2024-04-01T19:28:39.366 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6df99de9:::benchmark_data_smithi188_77607_object101370:head# 2024-04-01T19:28:39.367 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dfb210e:::benchmark_data_smithi188_77607_object113595:head# 2024-04-01T19:28:39.368 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6dfdcffc:::benchmark_data_smithi188_77607_object118253:head# 2024-04-01T19:28:39.368 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e019b0c:::benchmark_data_smithi188_77607_object142495:head# 2024-04-01T19:28:39.368 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e044799:::benchmark_data_smithi188_77607_object147756:head# 2024-04-01T19:28:39.369 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e05e0ec:::benchmark_data_smithi188_77607_object134378:head# 2024-04-01T19:28:39.369 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e06cd65:::benchmark_data_smithi188_77607_object141207:head# 2024-04-01T19:28:39.370 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e07f49a:::benchmark_data_smithi188_77607_object101155:head# 2024-04-01T19:28:39.371 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e0c1ab8:::benchmark_data_smithi188_77607_object122496:head# 2024-04-01T19:28:39.371 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e0c1eb0:::benchmark_data_smithi188_77607_object148605:head# 2024-04-01T19:28:39.372 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e0d055d:::benchmark_data_smithi188_77607_object104157:head# 2024-04-01T19:28:39.372 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e0d7a6d:::benchmark_data_smithi188_77607_object144433:head# 2024-04-01T19:28:39.372 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e0f2f42:::benchmark_data_smithi188_77607_object115608:head# 2024-04-01T19:28:39.373 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e0f33e9:::benchmark_data_smithi188_77607_object105891:head# 2024-04-01T19:28:39.374 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e0f85b2:::benchmark_data_smithi188_77607_object141693:head# 2024-04-01T19:28:39.374 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e105a6e:::benchmark_data_smithi188_77607_object98377:head# 2024-04-01T19:28:39.374 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e10bde3:::benchmark_data_smithi188_77607_object165762:head# 2024-04-01T19:28:39.375 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e115750:::benchmark_data_smithi188_77607_object122917:head# 2024-04-01T19:28:39.375 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e1265cb:::benchmark_data_smithi188_77607_object112390:head# 2024-04-01T19:28:39.376 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e12efdc:::benchmark_data_smithi188_77607_object152092:head# 2024-04-01T19:28:39.376 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e1579f8:::benchmark_data_smithi188_77607_object107401:head# 2024-04-01T19:28:39.377 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e162c23:::benchmark_data_smithi188_77607_object165407:head# 2024-04-01T19:28:39.377 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e16ece2:::benchmark_data_smithi188_77607_object134779:head# 2024-04-01T19:28:39.378 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e18fd36:::benchmark_data_smithi188_77607_object146042:head# 2024-04-01T19:28:39.378 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e19585b:::benchmark_data_smithi188_77607_object158879:head# 2024-04-01T19:28:39.379 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e1a6ac2:::benchmark_data_smithi188_77607_object116518:head# 2024-04-01T19:28:39.379 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e1a7d4e:::benchmark_data_smithi188_77607_object132267:head# 2024-04-01T19:28:39.380 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e1b50a3:::benchmark_data_smithi188_77607_object161571:head# 2024-04-01T19:28:39.380 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e1d3ac1:::benchmark_data_smithi188_77607_object128580:head# 2024-04-01T19:28:39.381 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e1de88a:::benchmark_data_smithi188_77607_object109320:head# 2024-04-01T19:28:39.382 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e20e658:::benchmark_data_smithi188_77607_object138259:head# 2024-04-01T19:28:39.382 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e20f154:::benchmark_data_smithi188_77607_object155512:head# 2024-04-01T19:28:39.382 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e231bb7:::benchmark_data_smithi188_77607_object128763:head# 2024-04-01T19:28:39.383 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e2532c7:::benchmark_data_smithi188_77607_object156147:head# 2024-04-01T19:28:39.384 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e2540e1:::benchmark_data_smithi188_77607_object158091:head# 2024-04-01T19:28:39.384 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e25a2f1:::benchmark_data_smithi188_77607_object157400:head# 2024-04-01T19:28:39.385 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e25bf60:::benchmark_data_smithi188_77607_object99634:head# 2024-04-01T19:28:39.385 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e261b32:::benchmark_data_smithi188_77607_object134172:head# 2024-04-01T19:28:39.385 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e267e58:::benchmark_data_smithi188_77607_object113101:head# 2024-04-01T19:28:39.386 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e26c0db:::benchmark_data_smithi188_77607_object121487:head# 2024-04-01T19:28:39.386 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e295d2f:::benchmark_data_smithi188_77607_object163259:head# 2024-04-01T19:28:39.387 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e29dc28:::benchmark_data_smithi188_77607_object104093:head# 2024-04-01T19:28:39.387 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e2b528a:::benchmark_data_smithi188_77607_object104084:head# 2024-04-01T19:28:39.388 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e2d76c7:::benchmark_data_smithi188_77607_object142153:head# 2024-04-01T19:28:39.388 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e2d8c9c:::benchmark_data_smithi188_77607_object110111:head# 2024-04-01T19:28:39.389 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e2db1e8:::benchmark_data_smithi188_77607_object149038:head# 2024-04-01T19:28:39.389 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e30576f:::benchmark_data_smithi188_77607_object99894:head# 2024-04-01T19:28:39.390 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e31a89c:::benchmark_data_smithi188_77607_object164995:head# 2024-04-01T19:28:39.390 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e33c683:::benchmark_data_smithi188_77607_object105202:head# 2024-04-01T19:28:39.391 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e34a7f0:::benchmark_data_smithi188_77607_object122215:head# 2024-04-01T19:28:39.391 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e350f96:::benchmark_data_smithi188_77607_object100286:head# 2024-04-01T19:28:39.392 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e365d29:::benchmark_data_smithi188_77607_object156268:head# 2024-04-01T19:28:39.392 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e381911:::benchmark_data_smithi188_77607_object127332:head# 2024-04-01T19:28:39.392 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e38a15f:::benchmark_data_smithi188_77607_object125815:head# 2024-04-01T19:28:39.393 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e39ce55:::benchmark_data_smithi188_77607_object128465:head# 2024-04-01T19:28:39.393 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e3a1501:::benchmark_data_smithi188_77607_object122041:head# 2024-04-01T19:28:39.394 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e3c26e9:::benchmark_data_smithi188_77607_object153008:head# 2024-04-01T19:28:39.396 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e3c64b7:::benchmark_data_smithi188_77607_object110595:head# 2024-04-01T19:28:39.396 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e405002:::benchmark_data_smithi188_77607_object114501:head# 2024-04-01T19:28:39.397 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e40e236:::benchmark_data_smithi188_77607_object145296:head# 2024-04-01T19:28:39.397 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:28:39.397 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e42c7e3:::benchmark_data_smithi188_77607_object149531:head# 2024-04-01T19:28:39.398 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e43b028:::benchmark_data_smithi188_77607_object167011:head# 2024-04-01T19:28:39.398 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e4444e0:::benchmark_data_smithi188_77607_object118305:head# 2024-04-01T19:28:39.399 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e451048:::benchmark_data_smithi188_77607_object167045:head# 2024-04-01T19:28:39.399 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e481d32:::benchmark_data_smithi188_77607_object162739:head# 2024-04-01T19:28:39.400 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e48281a:::benchmark_data_smithi188_77607_object164707:head# 2024-04-01T19:28:39.400 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:39.401 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e4aca93:::benchmark_data_smithi188_77607_object145797:head# 2024-04-01T19:28:39.401 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e4b46aa:::benchmark_data_smithi188_77607_object130506:head# 2024-04-01T19:28:39.401 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:28:39.402 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e4c6bda:::benchmark_data_smithi188_77607_object133105:head# 2024-04-01T19:28:39.402 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e4c96b0:::benchmark_data_smithi188_77607_object121187:head# 2024-04-01T19:28:39.402 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e4d7f7b:::benchmark_data_smithi188_77607_object133695:head# 2024-04-01T19:28:39.402 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e4e011e:::benchmark_data_smithi188_77607_object131588:head# 2024-04-01T19:28:39.403 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e4e3e44:::benchmark_data_smithi188_77607_object121917:head# 2024-04-01T19:28:39.403 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e4e5391:::benchmark_data_smithi188_77607_object129053:head# 2024-04-01T19:28:39.404 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e4e7624:::benchmark_data_smithi188_77607_object100989:head# 2024-04-01T19:28:39.405 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e4ed238:::benchmark_data_smithi188_77607_object134251:head# 2024-04-01T19:28:39.405 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e510730:::benchmark_data_smithi188_77607_object103048:head# 2024-04-01T19:28:39.406 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e513d23:::benchmark_data_smithi188_77607_object137529:head# 2024-04-01T19:28:39.406 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e52ce32:::benchmark_data_smithi188_77607_object166476:head# 2024-04-01T19:28:39.407 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e52ffa7:::benchmark_data_smithi188_77607_object104206:head# 2024-04-01T19:28:39.407 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e553c18:::benchmark_data_smithi188_77607_object127110:head# 2024-04-01T19:28:39.408 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e562ba4:::benchmark_data_smithi188_77607_object133796:head# 2024-04-01T19:28:39.408 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e5783d0:::benchmark_data_smithi188_77607_object151253:head# 2024-04-01T19:28:39.408 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e58a6bc:::benchmark_data_smithi188_77607_object106250:head# 2024-04-01T19:28:39.409 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e5918f4:::benchmark_data_smithi188_77607_object126409:head# 2024-04-01T19:28:39.410 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e5995e2:::benchmark_data_smithi188_77607_object122362:head# 2024-04-01T19:28:39.410 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e59b3b4:::benchmark_data_smithi188_77607_object166106:head# 2024-04-01T19:28:39.411 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_ops_in_flight 2024-04-01T19:28:39.412 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e5c1262:::benchmark_data_smithi188_77607_object132880:head# 2024-04-01T19:28:39.412 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e5c7243:::benchmark_data_smithi188_77607_object128434:head# 2024-04-01T19:28:39.412 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e5c964c:::benchmark_data_smithi188_77607_object128802:head# 2024-04-01T19:28:39.412 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e5cc4aa:::benchmark_data_smithi188_77607_object160884:head# 2024-04-01T19:28:39.413 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e5d0960:::benchmark_data_smithi188_77607_object123395:head# 2024-04-01T19:28:39.413 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e5f6b5d:::benchmark_data_smithi188_77607_object163774:head# 2024-04-01T19:28:39.413 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e5f77c9:::benchmark_data_smithi188_77607_object158445:head# 2024-04-01T19:28:39.414 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e602a88:::benchmark_data_smithi188_77607_object98594:head# 2024-04-01T19:28:39.414 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e60c1e8:::benchmark_data_smithi188_77607_object151811:head# 2024-04-01T19:28:39.415 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e617898:::benchmark_data_smithi188_77607_object143094:head# 2024-04-01T19:28:39.415 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e62ec10:::benchmark_data_smithi188_77607_object103212:head# 2024-04-01T19:28:39.416 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e632f96:::benchmark_data_smithi188_77607_object120000:head# 2024-04-01T19:28:39.416 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e636552:::benchmark_data_smithi188_77607_object151586:head# 2024-04-01T19:28:39.417 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e63d6c2:::benchmark_data_smithi188_77607_object115496:head# 2024-04-01T19:28:39.417 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e648520:::benchmark_data_smithi188_77607_object139713:head# 2024-04-01T19:28:39.418 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e64f8fe:::benchmark_data_smithi188_77607_object105823:head# 2024-04-01T19:28:39.418 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e653f98:::benchmark_data_smithi188_77607_object113536:head# 2024-04-01T19:28:39.419 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e662f7d:::benchmark_data_smithi188_77607_object159198:head# 2024-04-01T19:28:39.420 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e66c2e3:::benchmark_data_smithi188_77607_object105513:head# 2024-04-01T19:28:39.420 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e67ded4:::benchmark_data_smithi188_77607_object162017:head# 2024-04-01T19:28:39.420 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e68959c:::benchmark_data_smithi188_77607_object146020:head# 2024-04-01T19:28:39.421 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e6a1be3:::benchmark_data_smithi188_77607_object151535:head# 2024-04-01T19:28:39.421 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e6b088f:::benchmark_data_smithi188_77607_object120287:head# 2024-04-01T19:28:39.422 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e6b5466:::benchmark_data_smithi188_77607_object114974:head# 2024-04-01T19:28:39.422 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e6d18c6:::benchmark_data_smithi188_77607_object161993:head# 2024-04-01T19:28:39.422 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e6d9db3:::benchmark_data_smithi188_77607_object141366:head# 2024-04-01T19:28:39.423 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e6dfedd:::benchmark_data_smithi188_77607_object157435:head# 2024-04-01T19:28:39.423 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e6f5d8e:::benchmark_data_smithi188_77607_object141090:head# 2024-04-01T19:28:39.424 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e6f8c62:::benchmark_data_smithi188_77607_object127428:head# 2024-04-01T19:28:39.424 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e700e30:::benchmark_data_smithi188_77607_object154150:head# 2024-04-01T19:28:39.425 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e705862:::benchmark_data_smithi188_77607_object135755:head# 2024-04-01T19:28:39.425 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e718b5f:::benchmark_data_smithi188_77607_object143852:head# 2024-04-01T19:28:39.425 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e726808:::benchmark_data_smithi188_77607_object145374:head# 2024-04-01T19:28:39.426 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e737dc9:::benchmark_data_smithi188_77607_object110476:head# 2024-04-01T19:28:39.427 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e74ae13:::benchmark_data_smithi188_77607_object162334:head# 2024-04-01T19:28:39.427 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e7556b6:::benchmark_data_smithi188_77607_object108264:head# 2024-04-01T19:28:39.427 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e77a725:::benchmark_data_smithi188_77607_object106757:head# 2024-04-01T19:28:39.428 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e7cc0dc:::benchmark_data_smithi188_77607_object160080:head# 2024-04-01T19:28:39.429 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e7d3a42:::benchmark_data_smithi188_77607_object98466:head# 2024-04-01T19:28:39.429 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e8356e0:::benchmark_data_smithi188_77607_object105556:head# 2024-04-01T19:28:39.430 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e84b584:::benchmark_data_smithi188_77607_object151570:head# 2024-04-01T19:28:39.430 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e851ba0:::benchmark_data_smithi188_77607_object162223:head# 2024-04-01T19:28:39.430 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e8534b4:::benchmark_data_smithi188_77607_object128179:head# 2024-04-01T19:28:39.431 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e8654a0:::benchmark_data_smithi188_77607_object107966:head# 2024-04-01T19:28:39.431 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e885647:::benchmark_data_smithi188_77607_object108795:head# 2024-04-01T19:28:39.432 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e8874d2:::benchmark_data_smithi188_77607_object119142:head# 2024-04-01T19:28:39.432 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e888ba2:::benchmark_data_smithi188_77607_object156867:head# 2024-04-01T19:28:39.432 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e8b0fc8:::benchmark_data_smithi188_77607_object135867:head# 2024-04-01T19:28:39.433 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e8cfc8b:::benchmark_data_smithi188_77607_object148058:head# 2024-04-01T19:28:39.433 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e8d2880:::benchmark_data_smithi188_77607_object118681:head# 2024-04-01T19:28:39.434 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e8fc549:::benchmark_data_smithi188_77607_object157086:head# 2024-04-01T19:28:39.434 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e9073ea:::benchmark_data_smithi188_77607_object128832:head# 2024-04-01T19:28:39.435 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e90c3c3:::benchmark_data_smithi188_77607_object124141:head# 2024-04-01T19:28:39.435 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e9123a9:::benchmark_data_smithi188_77607_object144682:head# 2024-04-01T19:28:39.436 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e927c78:::benchmark_data_smithi188_77607_object120862:head# 2024-04-01T19:28:39.436 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e9431fd:::benchmark_data_smithi188_77607_object116284:head# 2024-04-01T19:28:39.436 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e94b9a8:::benchmark_data_smithi188_77607_object153792:head# 2024-04-01T19:28:39.437 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e94dfca:::benchmark_data_smithi188_77607_object124531:head# 2024-04-01T19:28:39.437 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e953a2d:::benchmark_data_smithi188_77607_object103134:head# 2024-04-01T19:28:39.438 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e962697:::benchmark_data_smithi188_77607_object107944:head# 2024-04-01T19:28:39.438 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e9755af:::benchmark_data_smithi188_77607_object103299:head# 2024-04-01T19:28:39.439 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e98cc23:::benchmark_data_smithi188_77607_object130320:head# 2024-04-01T19:28:39.439 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e9ac5b6:::benchmark_data_smithi188_77607_object103438:head# 2024-04-01T19:28:39.439 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e9bd2a0:::benchmark_data_smithi188_77607_object147643:head# 2024-04-01T19:28:39.440 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e9cc2ae:::benchmark_data_smithi188_77607_object160469:head# 2024-04-01T19:28:39.440 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6e9ec413:::benchmark_data_smithi188_77607_object162960:head# 2024-04-01T19:28:39.441 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ea01af8:::benchmark_data_smithi188_77607_object167214:head# 2024-04-01T19:28:39.441 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ea36838:::benchmark_data_smithi188_77607_object122295:head# 2024-04-01T19:28:39.442 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ea4a378:::benchmark_data_smithi188_77607_object138453:head# 2024-04-01T19:28:39.443 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ea4d829:::benchmark_data_smithi188_77607_object132709:head# 2024-04-01T19:28:39.443 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ea5c6f2:::benchmark_data_smithi188_77607_object158440:head# 2024-04-01T19:28:39.444 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ea5d40c:::benchmark_data_smithi188_77607_object105673:head# 2024-04-01T19:28:39.444 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ea65a58:::benchmark_data_smithi188_77607_object159876:head# 2024-04-01T19:28:39.445 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ea73b14:::benchmark_data_smithi188_77607_object131469:head# 2024-04-01T19:28:39.445 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ea80b11:::benchmark_data_smithi188_77607_object109665:head# 2024-04-01T19:28:39.446 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ea8c9f6:::benchmark_data_smithi188_77607_object104111:head# 2024-04-01T19:28:39.446 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ea926df:::benchmark_data_smithi188_77607_object120873:head# 2024-04-01T19:28:39.447 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6eab157a:::benchmark_data_smithi188_77607_object114464:head# 2024-04-01T19:28:39.447 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ead8109:::benchmark_data_smithi188_77607_object165545:head# 2024-04-01T19:28:39.448 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6eb02e4b:::benchmark_data_smithi188_77607_object151726:head# 2024-04-01T19:28:39.448 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6eb0f490:::benchmark_data_smithi188_77607_object116583:head# 2024-04-01T19:28:39.449 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6eb3da38:::benchmark_data_smithi188_77607_object124292:head# 2024-04-01T19:28:39.449 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6eb40848:::benchmark_data_smithi188_77607_object154416:head# 2024-04-01T19:28:39.450 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6eb4d7db:::benchmark_data_smithi188_77607_object128068:head# 2024-04-01T19:28:39.450 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6eb53fd7:::benchmark_data_smithi188_77607_object118385:head# 2024-04-01T19:28:39.450 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6eb55942:::benchmark_data_smithi188_77607_object153766:head# 2024-04-01T19:28:39.451 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6eb68743:::benchmark_data_smithi188_77607_object108452:head# 2024-04-01T19:28:39.452 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6eb7b6eb:::benchmark_data_smithi188_77607_object120316:head# 2024-04-01T19:28:39.452 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6eb83d2b:::benchmark_data_smithi188_77607_object99374:head# 2024-04-01T19:28:39.452 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6eb86015:::benchmark_data_smithi188_77607_object116134:head# 2024-04-01T19:28:39.454 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6eb9f21d:::benchmark_data_smithi188_77607_object117089:head# 2024-04-01T19:28:39.454 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6eba7a13:::benchmark_data_smithi188_77607_object123729:head# 2024-04-01T19:28:39.454 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ebd2b9e:::benchmark_data_smithi188_77607_object155101:head# 2024-04-01T19:28:39.454 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ebd65ac:::benchmark_data_smithi188_77607_object148511:head# 2024-04-01T19:28:39.455 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ebf3cb7:::benchmark_data_smithi188_77607_object137092:head# 2024-04-01T19:28:39.505 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:28:39.508 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ebfbfb0:::benchmark_data_smithi188_77607_object112374:head# 2024-04-01T19:28:39.508 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ec01814:::benchmark_data_smithi188_77607_object111174:head# 2024-04-01T19:28:39.508 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ec03203:::benchmark_data_smithi188_77607_object104749:head# 2024-04-01T19:28:39.508 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ec03d24:::benchmark_data_smithi188_77607_object98703:head# 2024-04-01T19:28:39.508 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ec176d1:::benchmark_data_smithi188_77607_object160285:head# 2024-04-01T19:28:39.508 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ec3e49d:::benchmark_data_smithi188_77607_object105422:head# 2024-04-01T19:28:39.508 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ec403d6:::benchmark_data_smithi188_77607_object143403:head# 2024-04-01T19:28:39.509 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ec54ae4:::benchmark_data_smithi188_77607_object133834:head# 2024-04-01T19:28:39.509 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ec5dd03:::benchmark_data_smithi188_77607_object98788:head# 2024-04-01T19:28:39.509 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ec6dac1:::benchmark_data_smithi188_77607_object160425:head# 2024-04-01T19:28:39.509 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ec70528:::benchmark_data_smithi188_77607_object146141:head# 2024-04-01T19:28:39.509 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ec753df:::benchmark_data_smithi188_77607_object111967:head# 2024-04-01T19:28:39.509 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ec854d4:::benchmark_data_smithi188_77607_object154207:head# 2024-04-01T19:28:39.509 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ec88635:::benchmark_data_smithi188_77607_object152111:head# 2024-04-01T19:28:39.509 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ec964d7:::benchmark_data_smithi188_77607_object135893:head# 2024-04-01T19:28:39.509 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ecaf786:::benchmark_data_smithi188_77607_object113891:head# 2024-04-01T19:28:39.509 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ecb8239:::benchmark_data_smithi188_77607_object139313:head# 2024-04-01T19:28:39.509 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ecb8d3b:::benchmark_data_smithi188_77607_object103252:head# 2024-04-01T19:28:39.509 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ecce4e9:::benchmark_data_smithi188_77607_object109404:head# 2024-04-01T19:28:39.509 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ecdbff8:::benchmark_data_smithi188_77607_object147024:head# 2024-04-01T19:28:39.510 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ece1524:::benchmark_data_smithi188_77607_object156622:head# 2024-04-01T19:28:39.510 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ececd06:::benchmark_data_smithi188_77607_object107854:head# 2024-04-01T19:28:39.510 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ecef26e:::benchmark_data_smithi188_77607_object108724:head# 2024-04-01T19:28:39.510 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ecf3b3f:::benchmark_data_smithi188_77607_object150591:head# 2024-04-01T19:28:39.510 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ecf839e:::benchmark_data_smithi188_77607_object122950:head# 2024-04-01T19:28:39.510 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ecff01a:::benchmark_data_smithi188_77607_object149512:head# 2024-04-01T19:28:39.510 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ed0c5a9:::benchmark_data_smithi188_77607_object163354:head# 2024-04-01T19:28:39.510 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ed161fd:::benchmark_data_smithi188_77607_object104015:head# 2024-04-01T19:28:39.510 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ed296c6:::benchmark_data_smithi188_77607_object160212:head# 2024-04-01T19:28:39.510 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ed3b2b5:::benchmark_data_smithi188_77607_object144941:head# 2024-04-01T19:28:39.510 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ed55bce:::benchmark_data_smithi188_77607_object138268:head# 2024-04-01T19:28:39.510 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ed56efd:::benchmark_data_smithi188_77607_object166013:head# 2024-04-01T19:28:39.510 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ed632d9:::benchmark_data_smithi188_77607_object110233:head# 2024-04-01T19:28:39.511 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ed756eb:::benchmark_data_smithi188_77607_object111896:head# 2024-04-01T19:28:39.511 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ed76f2c:::benchmark_data_smithi188_77607_object155013:head# 2024-04-01T19:28:39.511 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ed8276f:::benchmark_data_smithi188_77607_object160710:head# 2024-04-01T19:28:39.511 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ed86844:::benchmark_data_smithi188_77607_object139680:head# 2024-04-01T19:28:39.511 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6eda5932:::benchmark_data_smithi188_77607_object157166:head# 2024-04-01T19:28:39.511 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6edaab4c:::benchmark_data_smithi188_77607_object127870:head# 2024-04-01T19:28:39.511 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ede98c4:::benchmark_data_smithi188_77607_object119521:head# 2024-04-01T19:28:39.511 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6edf7c57:::benchmark_data_smithi188_77607_object107608:head# 2024-04-01T19:28:39.511 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6edffa9d:::benchmark_data_smithi188_77607_object160984:head# 2024-04-01T19:28:39.511 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ee0621e:::benchmark_data_smithi188_77607_object112027:head# 2024-04-01T19:28:39.511 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ee08f39:::benchmark_data_smithi188_77607_object138433:head# 2024-04-01T19:28:39.511 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ee1667a:::benchmark_data_smithi188_77607_object121572:head# 2024-04-01T19:28:39.511 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ee1b253:::benchmark_data_smithi188_77607_object141170:head# 2024-04-01T19:28:39.511 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ee1b929:::benchmark_data_smithi188_77607_object121889:head# 2024-04-01T19:28:39.511 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ee20184:::benchmark_data_smithi188_77607_object116513:head# 2024-04-01T19:28:39.512 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ee22775:::benchmark_data_smithi188_77607_object162893:head# 2024-04-01T19:28:39.512 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ee3bccc:::benchmark_data_smithi188_77607_object134694:head# 2024-04-01T19:28:39.512 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ee5406d:::benchmark_data_smithi188_77607_object113295:head# 2024-04-01T19:28:39.512 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ee681f7:::benchmark_data_smithi188_77607_object148825:head# 2024-04-01T19:28:39.512 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ee6ea28:::benchmark_data_smithi188_77607_object145560:head# 2024-04-01T19:28:39.512 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ee78bc1:::benchmark_data_smithi188_77607_object156609:head# 2024-04-01T19:28:39.512 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ee906b1:::benchmark_data_smithi188_77607_object150521:head# 2024-04-01T19:28:39.512 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ee973ce:::benchmark_data_smithi188_77607_object135373:head# 2024-04-01T19:28:39.512 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6eea139d:::benchmark_data_smithi188_77607_object165852:head# 2024-04-01T19:28:39.512 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6eeceb27:::benchmark_data_smithi188_77607_object149609:head# 2024-04-01T19:28:39.512 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6eed4ab7:::benchmark_data_smithi188_77607_object141150:head# 2024-04-01T19:28:39.512 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6eedbc69:::benchmark_data_smithi188_77607_object166209:head# 2024-04-01T19:28:39.512 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ef0ba36:::benchmark_data_smithi188_77607_object167067:head# 2024-04-01T19:28:39.512 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ef1b159:::benchmark_data_smithi188_77607_object148918:head# 2024-04-01T19:28:39.513 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ef1b992:::benchmark_data_smithi188_77607_object110825:head# 2024-04-01T19:28:39.513 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ef1ec00:::benchmark_data_smithi188_77607_object165272:head# 2024-04-01T19:28:39.513 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ef27946:::benchmark_data_smithi188_77607_object149052:head# 2024-04-01T19:28:39.513 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ef2a1b0:::benchmark_data_smithi188_77607_object119207:head# 2024-04-01T19:28:39.513 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ef55c30:::benchmark_data_smithi188_77607_object115051:head# 2024-04-01T19:28:39.513 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ef7ba36:::benchmark_data_smithi188_77607_object150728:head# 2024-04-01T19:28:39.513 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ef80298:::benchmark_data_smithi188_77607_object109356:head# 2024-04-01T19:28:39.513 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ef8b230:::benchmark_data_smithi188_77607_object116566:head# 2024-04-01T19:28:39.513 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ef9d25e:::benchmark_data_smithi188_77607_object111210:head# 2024-04-01T19:28:39.513 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6efbc71a:::benchmark_data_smithi188_77607_object129479:head# 2024-04-01T19:28:39.513 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6efd9c45:::benchmark_data_smithi188_77607_object162609:head# 2024-04-01T19:28:39.513 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6efda5f8:::benchmark_data_smithi188_77607_object103376:head# 2024-04-01T19:28:39.513 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6effb9a9:::benchmark_data_smithi188_77607_object120319:head# 2024-04-01T19:28:39.513 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f0141ec:::benchmark_data_smithi188_77607_object107069:head# 2024-04-01T19:28:39.513 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f0221e0:::benchmark_data_smithi188_77607_object145319:head# 2024-04-01T19:28:39.514 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f03fe8f:::benchmark_data_smithi188_77607_object149190:head# 2024-04-01T19:28:39.514 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f0535cb:::benchmark_data_smithi188_77607_object162964:head# 2024-04-01T19:28:39.514 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f0564d2:::benchmark_data_smithi188_77607_object150680:head# 2024-04-01T19:28:39.514 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f06450e:::benchmark_data_smithi188_77607_object158758:head# 2024-04-01T19:28:39.514 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f07d75c:::benchmark_data_smithi188_77607_object116401:head# 2024-04-01T19:28:39.514 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f08909a:::benchmark_data_smithi188_77607_object141112:head# 2024-04-01T19:28:39.514 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f0c4c03:::benchmark_data_smithi188_77607_object154428:head# 2024-04-01T19:28:39.514 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f0cf027:::benchmark_data_smithi188_77607_object160722:head# 2024-04-01T19:28:39.514 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f0d3065:::benchmark_data_smithi188_77607_object165556:head# 2024-04-01T19:28:39.514 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f0ee17c:::benchmark_data_smithi188_77607_object111472:head# 2024-04-01T19:28:39.514 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f0f32b3:::benchmark_data_smithi188_77607_object98995:head# 2024-04-01T19:28:39.514 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f11742f:::benchmark_data_smithi188_77607_object139759:head# 2024-04-01T19:28:39.514 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f13514e:::benchmark_data_smithi188_77607_object120147:head# 2024-04-01T19:28:39.514 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f16b701:::benchmark_data_smithi188_77607_object131173:head# 2024-04-01T19:28:39.515 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f1819c2:::benchmark_data_smithi188_77607_object161243:head# 2024-04-01T19:28:39.515 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f18dba8:::benchmark_data_smithi188_77607_object144151:head# 2024-04-01T19:28:39.515 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f195774:::benchmark_data_smithi188_77607_object118440:head# 2024-04-01T19:28:39.515 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f19a778:::benchmark_data_smithi188_77607_object159466:head# 2024-04-01T19:28:39.515 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f1ac452:::benchmark_data_smithi188_77607_object113660:head# 2024-04-01T19:28:39.515 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f1b8dc3:::benchmark_data_smithi188_77607_object163362:head# 2024-04-01T19:28:39.515 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f1bb697:::benchmark_data_smithi188_77607_object114129:head# 2024-04-01T19:28:39.515 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f1c1393:::benchmark_data_smithi188_77607_object144714:head# 2024-04-01T19:28:39.515 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f1d3620:::benchmark_data_smithi188_77607_object149836:head# 2024-04-01T19:28:39.515 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f1ed3bc:::benchmark_data_smithi188_77607_object143481:head# 2024-04-01T19:28:39.515 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f1ee1ba:::benchmark_data_smithi188_77607_object151530:head# 2024-04-01T19:28:39.515 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f204810:::benchmark_data_smithi188_77607_object102072:head# 2024-04-01T19:28:39.515 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f23a00f:::benchmark_data_smithi188_77607_object141702:head# 2024-04-01T19:28:39.515 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f257377:::benchmark_data_smithi188_77607_object115304:head# 2024-04-01T19:28:39.515 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f283502:::benchmark_data_smithi188_77607_object132483:head# 2024-04-01T19:28:39.516 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f29f27a:::benchmark_data_smithi188_77607_object122504:head# 2024-04-01T19:28:39.516 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f2b4d47:::benchmark_data_smithi188_77607_object158494:head# 2024-04-01T19:28:39.518 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f2b56b5:::benchmark_data_smithi188_77607_object121159:head# 2024-04-01T19:28:39.518 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f2bd187:::benchmark_data_smithi188_77607_object128953:head# 2024-04-01T19:28:39.518 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f2c2c12:::benchmark_data_smithi188_77607_object166148:head# 2024-04-01T19:28:39.518 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f2c708a:::benchmark_data_smithi188_77607_object139408:head# 2024-04-01T19:28:39.518 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f2d124c:::benchmark_data_smithi188_77607_object121432:head# 2024-04-01T19:28:39.518 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f2ded31:::benchmark_data_smithi188_77607_object125627:head# 2024-04-01T19:28:39.518 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f2f0e0f:::benchmark_data_smithi188_77607_object133210:head# 2024-04-01T19:28:39.519 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f2fa4d3:::benchmark_data_smithi188_77607_object144710:head# 2024-04-01T19:28:39.519 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f3166d7:::benchmark_data_smithi188_77607_object108321:head# 2024-04-01T19:28:39.519 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f31715e:::benchmark_data_smithi188_77607_object167189:head# 2024-04-01T19:28:39.519 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f3354be:::benchmark_data_smithi188_77607_object134509:head# 2024-04-01T19:28:39.519 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f33b37c:::benchmark_data_smithi188_77607_object105222:head# 2024-04-01T19:28:39.519 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f35e81d:::benchmark_data_smithi188_77607_object156122:head# 2024-04-01T19:28:39.519 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f367972:::benchmark_data_smithi188_77607_object159507:head# 2024-04-01T19:28:39.519 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f36b315:::benchmark_data_smithi188_77607_object157819:head# 2024-04-01T19:28:39.519 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f38783a:::benchmark_data_smithi188_77607_object136905:head# 2024-04-01T19:28:39.519 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f39945a:::benchmark_data_smithi188_77607_object108611:head# 2024-04-01T19:28:39.519 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f39dac5:::benchmark_data_smithi188_77607_object166899:head# 2024-04-01T19:28:39.519 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f3a3312:::benchmark_data_smithi188_77607_object108243:head# 2024-04-01T19:28:39.519 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f3b2ccc:::benchmark_data_smithi188_77607_object129338:head# 2024-04-01T19:28:39.519 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f3b712d:::benchmark_data_smithi188_77607_object107585:head# 2024-04-01T19:28:39.521 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f3c5af1:::benchmark_data_smithi188_77607_object116208:head# 2024-04-01T19:28:39.521 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f3c8911:::benchmark_data_smithi188_77607_object145907:head# 2024-04-01T19:28:39.521 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f40e35a:::benchmark_data_smithi188_77607_object163525:head# 2024-04-01T19:28:39.521 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f4253ec:::benchmark_data_smithi188_77607_object118976:head# 2024-04-01T19:28:39.521 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f42abb6:::benchmark_data_smithi188_77607_object97864:head# 2024-04-01T19:28:39.521 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f42f3c9:::benchmark_data_smithi188_77607_object160679:head# 2024-04-01T19:28:39.521 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f43960c:::benchmark_data_smithi188_77607_object132056:head# 2024-04-01T19:28:39.522 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f44be09:::benchmark_data_smithi188_77607_object161102:head# 2024-04-01T19:28:39.522 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f454037:::benchmark_data_smithi188_77607_object105487:head# 2024-04-01T19:28:39.523 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f48b578:::benchmark_data_smithi188_77607_object130306:head# 2024-04-01T19:28:39.523 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f48fdce:::benchmark_data_smithi188_77607_object123002:head# 2024-04-01T19:28:39.524 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f4aaf30:::benchmark_data_smithi188_77607_object123585:head# 2024-04-01T19:28:39.524 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f4b3e4f:::benchmark_data_smithi188_77607_object105415:head# 2024-04-01T19:28:39.525 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f4ce006:::benchmark_data_smithi188_77607_object104408:head# 2024-04-01T19:28:39.525 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f4e2fb4:::benchmark_data_smithi188_77607_object111076:head# 2024-04-01T19:28:39.526 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f4e4084:::benchmark_data_smithi188_77607_object121009:head# 2024-04-01T19:28:39.526 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f4e8b5e:::benchmark_data_smithi188_77607_object141652:head# 2024-04-01T19:28:39.527 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f4eccef:::benchmark_data_smithi188_77607_object147418:head# 2024-04-01T19:28:39.527 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f4fa4ae:::benchmark_data_smithi188_77607_object136205:head# 2024-04-01T19:28:39.528 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f500bb1:::benchmark_data_smithi188_77607_object125034:head# 2024-04-01T19:28:39.528 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f52b2ed:::benchmark_data_smithi188_77607_object113405:head# 2024-04-01T19:28:39.529 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f5469a2:::benchmark_data_smithi188_77607_object149571:head# 2024-04-01T19:28:39.529 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f553817:::benchmark_data_smithi188_77607_object107960:head# 2024-04-01T19:28:39.530 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f5580d1:::benchmark_data_smithi188_77607_object157606:head# 2024-04-01T19:28:39.530 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f558f44:::benchmark_data_smithi188_77607_object125049:head# 2024-04-01T19:28:39.531 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f567955:::benchmark_data_smithi188_77607_object147427:head# 2024-04-01T19:28:39.531 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f568a30:::benchmark_data_smithi188_77607_object151793:head# 2024-04-01T19:28:39.531 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f57d466:::benchmark_data_smithi188_77607_object124298:head# 2024-04-01T19:28:39.532 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f59a1f8:::benchmark_data_smithi188_77607_object166621:head# 2024-04-01T19:28:39.532 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f59ba3a:::benchmark_data_smithi188_77607_object150603:head# 2024-04-01T19:28:39.533 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f59f817:::benchmark_data_smithi188_77607_object155967:head# 2024-04-01T19:28:39.533 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f59fd9f:::benchmark_data_smithi188_77607_object121391:head# 2024-04-01T19:28:39.534 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f5ae4b5:::benchmark_data_smithi188_77607_object100306:head# 2024-04-01T19:28:39.534 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f5eb1aa:::benchmark_data_smithi188_77607_object121610:head# 2024-04-01T19:28:39.535 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f6091e2:::benchmark_data_smithi188_77607_object144394:head# 2024-04-01T19:28:39.535 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f6233a6:::benchmark_data_smithi188_77607_object159853:head# 2024-04-01T19:28:39.536 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f629610:::benchmark_data_smithi188_77607_object134229:head# 2024-04-01T19:28:39.536 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f631a82:::benchmark_data_smithi188_77607_object156717:head# 2024-04-01T19:28:39.537 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f633d78:::benchmark_data_smithi188_77607_object160391:head# 2024-04-01T19:28:39.537 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f63868f:::benchmark_data_smithi188_77607_object151828:head# 2024-04-01T19:28:39.538 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f665f33:::benchmark_data_smithi188_77607_object106752:head# 2024-04-01T19:28:39.538 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f671ab2:::benchmark_data_smithi188_77607_object117175:head# 2024-04-01T19:28:39.539 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f69460d:::benchmark_data_smithi188_77607_object113129:head# 2024-04-01T19:28:39.539 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f698ee1:::benchmark_data_smithi188_77607_object147282:head# 2024-04-01T19:28:39.540 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f69c866:::benchmark_data_smithi188_77607_object116180:head# 2024-04-01T19:28:39.540 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f6a93cd:::benchmark_data_smithi188_77607_object127121:head# 2024-04-01T19:28:39.541 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f6aaa39:::benchmark_data_smithi188_77607_object120691:head# 2024-04-01T19:28:39.542 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f6ac249:::benchmark_data_smithi188_77607_object165933:head# 2024-04-01T19:28:39.542 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f6ba32c:::benchmark_data_smithi188_77607_object130166:head# 2024-04-01T19:28:39.543 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f6e22d2:::benchmark_data_smithi188_77607_object135006:head# 2024-04-01T19:28:39.543 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f6f85f2:::benchmark_data_smithi188_77607_object102621:head# 2024-04-01T19:28:39.544 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f710efa:::benchmark_data_smithi188_77607_object104369:head# 2024-04-01T19:28:39.544 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f71a8cd:::benchmark_data_smithi188_77607_object142013:head# 2024-04-01T19:28:39.545 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:39.545 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f71b3f2:::benchmark_data_smithi188_77607_object106138:head# 2024-04-01T19:28:39.545 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f71d9aa:::benchmark_data_smithi188_77607_object147952:head# 2024-04-01T19:28:39.546 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f71e504:::benchmark_data_smithi188_77607_object126960:head# 2024-04-01T19:28:39.546 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f7232b5:::benchmark_data_smithi188_77607_object149770:head# 2024-04-01T19:28:39.549 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f724423:::benchmark_data_smithi188_77607_object163958:head# 2024-04-01T19:28:39.549 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f727b70:::benchmark_data_smithi188_77607_object101090:head# 2024-04-01T19:28:39.550 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f73999d:::benchmark_data_smithi188_77607_object166812:head# 2024-04-01T19:28:39.550 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f76ccd3:::benchmark_data_smithi188_77607_object136657:head# 2024-04-01T19:28:39.550 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f770522:::benchmark_data_smithi188_77607_object134390:head# 2024-04-01T19:28:39.550 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f78e869:::benchmark_data_smithi188_77607_object149327:head# 2024-04-01T19:28:39.550 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f793f92:::benchmark_data_smithi188_77607_object160137:head# 2024-04-01T19:28:39.550 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f79582e:::benchmark_data_smithi188_77607_object142102:head# 2024-04-01T19:28:39.551 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f79aabb:::benchmark_data_smithi188_77607_object108152:head# 2024-04-01T19:28:39.551 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f7b5232:::benchmark_data_smithi188_77607_object128817:head# 2024-04-01T19:28:39.551 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f7bd51e:::benchmark_data_smithi188_77607_object105240:head# 2024-04-01T19:28:39.552 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f7d1ee5:::benchmark_data_smithi188_77607_object134589:head# 2024-04-01T19:28:39.552 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f7f278f:::benchmark_data_smithi188_77607_object119574:head# 2024-04-01T19:28:39.553 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f7f9ef8:::benchmark_data_smithi188_77607_object123700:head# 2024-04-01T19:28:39.553 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f83a2da:::benchmark_data_smithi188_77607_object157144:head# 2024-04-01T19:28:39.553 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f83a723:::benchmark_data_smithi188_77607_object164814:head# 2024-04-01T19:28:39.554 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f849401:::benchmark_data_smithi188_77607_object113662:head# 2024-04-01T19:28:39.554 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f852efb:::benchmark_data_smithi188_77607_object161681:head# 2024-04-01T19:28:39.555 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f85f1b8:::benchmark_data_smithi188_77607_object102744:head# 2024-04-01T19:28:39.555 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f881f47:::benchmark_data_smithi188_77607_object115268:head# 2024-04-01T19:28:39.556 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f8911af:::benchmark_data_smithi188_77607_object146546:head# 2024-04-01T19:28:39.556 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f897c14:::benchmark_data_smithi188_77607_object153230:head# 2024-04-01T19:28:39.556 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f899e43:::benchmark_data_smithi188_77607_object156864:head# 2024-04-01T19:28:39.557 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f8a5136:::benchmark_data_smithi188_77607_object136114:head# 2024-04-01T19:28:39.557 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f8aa779:::benchmark_data_smithi188_77607_object160830:head# 2024-04-01T19:28:39.558 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f8b9ed5:::benchmark_data_smithi188_77607_object143911:head# 2024-04-01T19:28:39.558 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f8c7a63:::benchmark_data_smithi188_77607_object157500:head# 2024-04-01T19:28:39.559 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f8cfe59:::benchmark_data_smithi188_77607_object163501:head# 2024-04-01T19:28:39.560 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f8e2701:::benchmark_data_smithi188_77607_object99610:head# 2024-04-01T19:28:39.560 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f8f0dfc:::benchmark_data_smithi188_77607_object150272:head# 2024-04-01T19:28:39.560 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f8f6872:::benchmark_data_smithi188_77607_object166673:head# 2024-04-01T19:28:39.561 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f8fa2a6:::benchmark_data_smithi188_77607_object145364:head# 2024-04-01T19:28:39.561 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f905df0:::benchmark_data_smithi188_77607_object152584:head# 2024-04-01T19:28:39.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f914267:::benchmark_data_smithi188_77607_object113138:head# 2024-04-01T19:28:39.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f940089:::benchmark_data_smithi188_77607_object166925:head# 2024-04-01T19:28:39.563 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f9484c6:::benchmark_data_smithi188_77607_object148146:head# 2024-04-01T19:28:39.563 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f94abee:::benchmark_data_smithi188_77607_object142452:head# 2024-04-01T19:28:39.563 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f94b30c:::benchmark_data_smithi188_77607_object165114:head# 2024-04-01T19:28:39.564 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f954eb7:::benchmark_data_smithi188_77607_object162451:head# 2024-04-01T19:28:39.564 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:28:39.565 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f95938d:::benchmark_data_smithi188_77607_object130921:head# 2024-04-01T19:28:39.565 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f95a8dc:::benchmark_data_smithi188_77607_object165448:head# 2024-04-01T19:28:39.565 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f9648a3:::benchmark_data_smithi188_77607_object108369:head# 2024-04-01T19:28:39.566 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f96f9e6:::benchmark_data_smithi188_77607_object98241:head# 2024-04-01T19:28:39.567 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f97c36d:::benchmark_data_smithi188_77607_object137468:head# 2024-04-01T19:28:39.567 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:39.567 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:28:39.568 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f98393f:::benchmark_data_smithi188_77607_object147757:head# 2024-04-01T19:28:39.568 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f9978c2:::benchmark_data_smithi188_77607_object128258:head# 2024-04-01T19:28:39.568 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f99895b:::benchmark_data_smithi188_77607_object125031:head# 2024-04-01T19:28:39.569 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f9c6a4b:::benchmark_data_smithi188_77607_object158292:head# 2024-04-01T19:28:39.569 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f9ca345:::benchmark_data_smithi188_77607_object103834:head# 2024-04-01T19:28:39.570 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f9caf5e:::benchmark_data_smithi188_77607_object114021:head# 2024-04-01T19:28:39.570 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6f9d41ea:::benchmark_data_smithi188_77607_object143239:head# 2024-04-01T19:28:39.571 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fa2d4ef:::benchmark_data_smithi188_77607_object129013:head# 2024-04-01T19:28:39.571 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fa3367e:::benchmark_data_smithi188_77607_object129911:head# 2024-04-01T19:28:39.572 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fa3b584:::benchmark_data_smithi188_77607_object161101:head# 2024-04-01T19:28:39.572 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fa41442:::benchmark_data_smithi188_77607_object149237:head# 2024-04-01T19:28:39.573 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fa4b94d:::benchmark_data_smithi188_77607_object120346:head# 2024-04-01T19:28:39.573 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fa5f4ab:::benchmark_data_smithi188_77607_object117500:head# 2024-04-01T19:28:39.573 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fa684b6:::benchmark_data_smithi188_77607_object131293:head# 2024-04-01T19:28:39.574 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fa6ba43:::benchmark_data_smithi188_77607_object102205:head# 2024-04-01T19:28:39.574 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fa7481b:::benchmark_data_smithi188_77607_object117321:head# 2024-04-01T19:28:39.575 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fa78499:::benchmark_data_smithi188_77607_object102065:head# 2024-04-01T19:28:39.575 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fa7de20:::benchmark_data_smithi188_77607_object166933:head# 2024-04-01T19:28:39.575 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fa80c25:::benchmark_data_smithi188_77607_object136433:head# 2024-04-01T19:28:39.576 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fa9e95b:::benchmark_data_smithi188_77607_object99409:head# 2024-04-01T19:28:39.576 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6faa758a:::benchmark_data_smithi188_77607_object149431:head# 2024-04-01T19:28:39.577 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6faab6b8:::benchmark_data_smithi188_77607_object141312:head# 2024-04-01T19:28:39.577 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6faad38d:::benchmark_data_smithi188_77607_object118796:head# 2024-04-01T19:28:39.578 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fab5314:::benchmark_data_smithi188_77607_object122014:head# 2024-04-01T19:28:39.578 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fac8570:::benchmark_data_smithi188_77607_object151312:head# 2024-04-01T19:28:39.579 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fac9372:::benchmark_data_smithi188_77607_object148053:head# 2024-04-01T19:28:39.579 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fad73d3:::benchmark_data_smithi188_77607_object146230:head# 2024-04-01T19:28:39.580 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fadef12:::benchmark_data_smithi188_77607_object99094:head# 2024-04-01T19:28:39.580 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fae0728:::benchmark_data_smithi188_77607_object119288:head# 2024-04-01T19:28:39.581 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fae34b4:::benchmark_data_smithi188_77607_object133276:head# 2024-04-01T19:28:39.581 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6faf2814:::benchmark_data_smithi188_77607_object146550:head# 2024-04-01T19:28:39.582 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fb02e58:::benchmark_data_smithi188_77607_object111213:head# 2024-04-01T19:28:39.582 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fb02f27:::benchmark_data_smithi188_77607_object109520:head# 2024-04-01T19:28:39.583 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fb0f47a:::benchmark_data_smithi188_77607_object98060:head# 2024-04-01T19:28:39.583 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fb2188c:::benchmark_data_smithi188_77607_object137534:head# 2024-04-01T19:28:39.584 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fb2b2b2:::benchmark_data_smithi188_77607_object111399:head# 2024-04-01T19:28:39.584 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fb41900:::benchmark_data_smithi188_77607_object132832:head# 2024-04-01T19:28:39.585 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fb55587:::benchmark_data_smithi188_77607_object111960:head# 2024-04-01T19:28:39.585 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fb57645:::benchmark_data_smithi188_77607_object117155:head# 2024-04-01T19:28:39.585 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fb63825:::benchmark_data_smithi188_77607_object160905:head# 2024-04-01T19:28:39.586 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fb71cb2:::benchmark_data_smithi188_77607_object113021:head# 2024-04-01T19:28:39.587 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fb729ef:::benchmark_data_smithi188_77607_object141884:head# 2024-04-01T19:28:39.587 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fb83a4a:::benchmark_data_smithi188_77607_object102197:head# 2024-04-01T19:28:39.587 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fb95698:::benchmark_data_smithi188_77607_object107800:head# 2024-04-01T19:28:39.588 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fb9d4d5:::benchmark_data_smithi188_77607_object100750:head# 2024-04-01T19:28:39.588 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fbb6b4e:::benchmark_data_smithi188_77607_object121052:head# 2024-04-01T19:28:39.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fbc3bf4:::benchmark_data_smithi188_77607_object109330:head# 2024-04-01T19:28:39.590 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fbe7811:::benchmark_data_smithi188_77607_object155908:head# 2024-04-01T19:28:39.590 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fbf5f3d:::benchmark_data_smithi188_77607_object144036:head# 2024-04-01T19:28:39.590 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fbf9239:::benchmark_data_smithi188_77607_object166156:head# 2024-04-01T19:28:39.591 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fbfe457:::benchmark_data_smithi188_77607_object127825:head# 2024-04-01T19:28:39.591 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fc06366:::benchmark_data_smithi188_77607_object159719:head# 2024-04-01T19:28:39.592 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fc07c4d:::benchmark_data_smithi188_77607_object104534:head# 2024-04-01T19:28:39.592 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fc2a7ea:::benchmark_data_smithi188_77607_object106952:head# 2024-04-01T19:28:39.593 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fc32532:::benchmark_data_smithi188_77607_object142385:head# 2024-04-01T19:28:39.593 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fc7623e:::benchmark_data_smithi188_77607_object153061:head# 2024-04-01T19:28:39.594 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fc8364c:::benchmark_data_smithi188_77607_object144385:head# 2024-04-01T19:28:39.594 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fc8d7c2:::benchmark_data_smithi188_77607_object165908:head# 2024-04-01T19:28:39.595 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fcaab6c:::benchmark_data_smithi188_77607_object107644:head# 2024-04-01T19:28:39.595 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fce16f8:::benchmark_data_smithi188_77607_object135571:head# 2024-04-01T19:28:39.595 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fd2d31a:::benchmark_data_smithi188_77607_object158579:head# 2024-04-01T19:28:39.596 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fd3ac9e:::benchmark_data_smithi188_77607_object133704:head# 2024-04-01T19:28:39.596 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fd3e3b0:::benchmark_data_smithi188_77607_object141954:head# 2024-04-01T19:28:39.597 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fd4474e:::benchmark_data_smithi188_77607_object143203:head# 2024-04-01T19:28:39.597 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fd4b9be:::benchmark_data_smithi188_77607_object136194:head# 2024-04-01T19:28:39.598 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fd4d7b1:::benchmark_data_smithi188_77607_object100917:head# 2024-04-01T19:28:39.598 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fd71f65:::benchmark_data_smithi188_77607_object109942:head# 2024-04-01T19:28:39.599 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fd74fea:::benchmark_data_smithi188_77607_object144915:head# 2024-04-01T19:28:39.599 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fd7bab1:::benchmark_data_smithi188_77607_object148894:head# 2024-04-01T19:28:39.600 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fd8464e:::benchmark_data_smithi188_77607_object103980:head# 2024-04-01T19:28:39.600 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fd9aeb3:::benchmark_data_smithi188_77607_object146671:head# 2024-04-01T19:28:39.600 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fdb22c7:::benchmark_data_smithi188_77607_object130328:head# 2024-04-01T19:28:39.601 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fdbacab:::benchmark_data_smithi188_77607_object151956:head# 2024-04-01T19:28:39.601 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fdc56bc:::benchmark_data_smithi188_77607_object144662:head# 2024-04-01T19:28:39.602 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fe0118f:::benchmark_data_smithi188_77607_object114720:head# 2024-04-01T19:28:39.602 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fe0799d:::benchmark_data_smithi188_77607_object156215:head# 2024-04-01T19:28:39.603 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fe23dfa:::benchmark_data_smithi188_77607_object148243:head# 2024-04-01T19:28:39.603 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fe28547:::benchmark_data_smithi188_77607_object122511:head# 2024-04-01T19:28:39.604 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fe2f370:::benchmark_data_smithi188_77607_object129653:head# 2024-04-01T19:28:39.604 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fe4bce4:::benchmark_data_smithi188_77607_object166404:head# 2024-04-01T19:28:39.605 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fe4f355:::benchmark_data_smithi188_77607_object143438:head# 2024-04-01T19:28:39.605 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fe5d7e9:::benchmark_data_smithi188_77607_object104987:head# 2024-04-01T19:28:39.606 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fe80580:::benchmark_data_smithi188_77607_object122614:head# 2024-04-01T19:28:39.606 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fe8df3d:::benchmark_data_smithi188_77607_object156347:head# 2024-04-01T19:28:39.607 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fe98428:::benchmark_data_smithi188_77607_object146437:head# 2024-04-01T19:28:39.607 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fead80e:::benchmark_data_smithi188_77607_object98290:head# 2024-04-01T19:28:39.607 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6febb0ad:::benchmark_data_smithi188_77607_object131860:head# 2024-04-01T19:28:39.608 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fec5eca:::benchmark_data_smithi188_77607_object117922:head# 2024-04-01T19:28:39.608 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6fecbf28:::benchmark_data_smithi188_77607_object116370:head# 2024-04-01T19:28:39.609 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ff049d2:::benchmark_data_smithi188_77607_object135977:head# 2024-04-01T19:28:39.609 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ff15db7:::benchmark_data_smithi188_77607_object163337:head# 2024-04-01T19:28:39.609 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ff30e48:::benchmark_data_smithi188_77607_object100360:head# 2024-04-01T19:28:39.610 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ff6abf4:::benchmark_data_smithi188_77607_object102592:head# 2024-04-01T19:28:39.610 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ff7a484:::benchmark_data_smithi188_77607_object135297:head# 2024-04-01T19:28:39.611 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ff88981:::benchmark_data_smithi188_77607_object137385:head# 2024-04-01T19:28:39.611 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ff8df5b:::benchmark_data_smithi188_77607_object133367:head# 2024-04-01T19:28:39.612 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ffa21bb:::benchmark_data_smithi188_77607_object163488:head# 2024-04-01T19:28:39.612 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ffaa492:::benchmark_data_smithi188_77607_object152387:head# 2024-04-01T19:28:39.613 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ffaff2b:::benchmark_data_smithi188_77607_object133395:head# 2024-04-01T19:28:39.613 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ffc7441:::benchmark_data_smithi188_77607_object155978:head# 2024-04-01T19:28:39.613 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ffd8e2a:::benchmark_data_smithi188_77607_object151388:head# 2024-04-01T19:28:39.614 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ffdb421:::benchmark_data_smithi188_77607_object132357:head# 2024-04-01T19:28:39.614 INFO:teuthology.orchestra.run.smithi188.stderr:Read #2:6ffe0cf6:::benchmark_data_smithi188_77607_object125439:head# 2024-04-01T19:28:39.618 INFO:teuthology.orchestra.run.smithi188.stderr:Export successful 2024-04-01T19:28:39.668 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:28:39.696 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:39.715 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:28:39.718 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:39.718 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:28:39.819 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:28:39.846 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:39.869 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:28:39.872 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:39.873 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:28:39.974 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:28:39.979 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:39 smithi022 ceph-mon[39439]: pgmap v528: 17 pgs: 4 undersized+degraded+remapped+backfilling+peered, 13 active+clean; 4.2 GiB data, 9.0 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 0 op/s; 8274/139152 objects degraded (5.946%); 70 MiB/s, 1.12k objects/s recovering 2024-04-01T19:28:39.980 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:39 smithi022 ceph-mon[39439]: osdmap e175: 12 total, 11 up, 11 in 2024-04-01T19:28:40.004 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:40.027 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:28:40.031 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:40.031 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:28:40.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:39 smithi188 ceph-mon[43939]: pgmap v528: 17 pgs: 4 undersized+degraded+remapped+backfilling+peered, 13 active+clean; 4.2 GiB data, 9.0 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 0 op/s; 8274/139152 objects degraded (5.946%); 70 MiB/s, 1.12k objects/s recovering 2024-04-01T19:28:40.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:39 smithi188 ceph-mon[43939]: osdmap e175: 12 total, 11 up, 11 in 2024-04-01T19:28:40.132 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:28:40.200 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:40.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:39 smithi062 ceph-mon[44211]: pgmap v528: 17 pgs: 4 undersized+degraded+remapped+backfilling+peered, 13 active+clean; 4.2 GiB data, 9.0 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 0 op/s; 8274/139152 objects degraded (5.946%); 70 MiB/s, 1.12k objects/s recovering 2024-04-01T19:28:40.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:39 smithi062 ceph-mon[44211]: osdmap e175: 12 total, 11 up, 11 in 2024-04-01T19:28:40.280 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:28:40.296 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:28:40.309 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:40.310 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:28:40.411 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:28:40.447 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:40.817 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:28:40.957 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -n osd.8 --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-8 --journal-path /var/lib/ceph/osd/ceph-8/journal --force --op remove --pgid 2.6 2024-04-01T19:28:40.999 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:28:41.004 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:41.005 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:28:41.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:40 smithi022 ceph-mon[39439]: osdmap e176: 12 total, 11 up, 11 in 2024-04-01T19:28:41.105 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:28:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:40 smithi188 ceph-mon[43939]: osdmap e176: 12 total, 11 up, 11 in 2024-04-01T19:28:41.170 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:41.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:40 smithi062 ceph-mon[44211]: osdmap e176: 12 total, 11 up, 11 in 2024-04-01T19:28:41.262 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/osd.8/config 2024-04-01T19:28:41.440 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:28:41.444 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:41.445 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:28:41.546 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:28:41.578 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:41.606 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:28:41.612 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:41.613 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:28:41.714 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:28:41.745 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:41.768 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:28:41.770 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:41.771 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:28:41.854 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:41 smithi022 ceph-mon[39439]: pgmap v531: 17 pgs: 1 peering, 16 active+clean; 4.2 GiB data, 9.0 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 54 op/s; 129 MiB/s, 2.06k objects/s recovering 2024-04-01T19:28:41.855 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:41 smithi022 ceph-mon[39439]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8274/139152 objects degraded (5.946%), 4 pgs degraded) 2024-04-01T19:28:41.855 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:41 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1324859459' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:28:41.863 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:28:41.871 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:28:41.902 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:28:41.904 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:41.955 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:28:41.993 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:28:42.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:41 smithi062 ceph-mon[44211]: pgmap v531: 17 pgs: 1 peering, 16 active+clean; 4.2 GiB data, 9.0 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 54 op/s; 129 MiB/s, 2.06k objects/s recovering 2024-04-01T19:28:42.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:41 smithi062 ceph-mon[44211]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8274/139152 objects degraded (5.946%), 4 pgs degraded) 2024-04-01T19:28:42.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:41 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1324859459' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:28:42.026 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:28:42.058 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:28:42.090 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:28:42.105 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:28:42.107 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:41 smithi188 ceph-mon[43939]: pgmap v531: 17 pgs: 1 peering, 16 active+clean; 4.2 GiB data, 9.0 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 54 op/s; 129 MiB/s, 2.06k objects/s recovering 2024-04-01T19:28:42.108 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:41 smithi188 ceph-mon[43939]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8274/139152 objects degraded (5.946%), 4 pgs degraded) 2024-04-01T19:28:42.108 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:41 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1324859459' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:28:42.108 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:42.109 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:28:42.119 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:28:42.161 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:28:42.190 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:28:42.209 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:28:42.221 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:28:42.221 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:28:42.221 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:28:42.221 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:28:42.221 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:28:42.222 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:28:42.222 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:28:42.222 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:28:42.222 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:28:42.222 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.8 2024-04-01T19:28:42.222 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:28:42.222 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:28:42.222 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:28:42.270 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:42.367 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:28:42.375 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:42.376 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:28:42.477 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:28:42.513 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:42.542 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:28:42.548 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:42.548 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:28:42.649 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:28:42.683 INFO:teuthology.orchestra.run.smithi188.stderr:Creating an OSD daemon form without an OSD FSID value 2024-04-01T19:28:42.724 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:42.946 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:42.946 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:42.946 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:42.946 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:42.947 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:42.947 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:42.947 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:42.947 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:42.947 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:42.947 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:42.947 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:43.029 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:43.029 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:43.029 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:43.029 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:43.030 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:43.030 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:43.030 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:43.030 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:43.030 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:43.030 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:43.030 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:43.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:43.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:43.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:43.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:43.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:43.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:43.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:43.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:43.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:43.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:43.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:43.414 INFO:teuthology.orchestra.run.smithi188.stdout: marking collection for removal 2024-04-01T19:28:43.415 INFO:teuthology.orchestra.run.smithi188.stdout:setting '_remove' omap key 2024-04-01T19:28:43.415 INFO:teuthology.orchestra.run.smithi188.stdout:finish_remove_pgs 2.6_head removing 2.6 2024-04-01T19:28:43.490 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:28:43.493 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:43.493 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:28:43.540 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:28:43.540 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:28:43.549 INFO:teuthology.orchestra.run.smithi188.stdout:Remove successful 2024-04-01T19:28:43.594 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:28:43.635 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:44.039 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:28:44.047 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:44.048 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:28:44.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:43 smithi188 ceph-mon[43939]: pgmap v532: 17 pgs: 1 peering, 16 active+clean; 4.2 GiB data, 9.2 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 115 op/s; 88 MiB/s, 1.40k objects/s recovering 2024-04-01T19:28:44.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:43 smithi022 ceph-mon[39439]: pgmap v532: 17 pgs: 1 peering, 16 active+clean; 4.2 GiB data, 9.2 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 115 op/s; 88 MiB/s, 1.40k objects/s recovering 2024-04-01T19:28:44.148 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:28:44.178 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:43 smithi062 ceph-mon[44211]: pgmap v532: 17 pgs: 1 peering, 16 active+clean; 4.2 GiB data, 9.2 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 115 op/s; 88 MiB/s, 1.40k objects/s recovering 2024-04-01T19:28:44.180 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:44.210 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:28:44.215 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:44.215 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:28:44.316 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:28:44.384 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:44.717 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:28:44.735 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:44.736 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:28:44.743 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -n osd.8 --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-8 --journal-path /var/lib/ceph/osd/ceph-8/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.2.6.8 2024-04-01T19:28:44.837 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:28:44.869 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:44.901 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:28:44.905 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:44.905 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:28:45.006 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:28:45.022 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/osd.8/config 2024-04-01T19:28:45.040 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:45.073 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:28:45.078 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:45.078 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:28:45.179 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:28:45.214 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:45.242 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:28:45.245 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:45.246 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:28:45.347 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:28:45.458 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:45.541 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:28:45.550 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:28:45.550 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:28:45.550 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.550 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:272336 2.e 2:7cdf44c4:::benchmark_data_smithi188_77607_object104932:head [delete] snapc 0=[] ondisk+write+known_if_redirected e176)", 2024-04-01T19:28:45.550 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:45.513541+0000", 2024-04-01T19:28:45.551 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.025848422999999999, 2024-04-01T19:28:45.551 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.025878234999999999, 2024-04-01T19:28:45.551 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:28:45.551 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:28:45.551 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:28:45.551 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:28:45.551 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:28:45.551 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:28:45.551 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 272336 2024-04-01T19:28:45.551 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.551 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:28:45.551 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.551 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:28:45.552 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.513541+0000", 2024-04-01T19:28:45.552 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.552 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.552 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.552 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:28:45.552 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.513541+0000", 2024-04-01T19:28:45.552 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.552 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.552 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.552 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:28:45.552 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.513544+0000", 2024-04-01T19:28:45.552 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.1389999999999999e-06 2024-04-01T19:28:45.552 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.552 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.553 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:28:45.553 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.513553+0000", 2024-04-01T19:28:45.553 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8519999999999993e-06 2024-04-01T19:28:45.553 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.553 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.553 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:28:45.553 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.513575+0000", 2024-04-01T19:28:45.553 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1563999999999999e-05 2024-04-01T19:28:45.553 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.553 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.553 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:28:45.553 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.513585+0000", 2024-04-01T19:28:45.553 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0108999999999999e-05 2024-04-01T19:28:45.554 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.554 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.554 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:28:45.554 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.513678+0000", 2024-04-01T19:28:45.554 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.2622999999999997e-05 2024-04-01T19:28:45.554 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.554 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.554 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:28:45.554 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.513791+0000", 2024-04-01T19:28:45.554 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000113242 2024-04-01T19:28:45.555 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.555 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.555 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:28:45.555 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.513898+0000", 2024-04-01T19:28:45.555 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000106919 2024-04-01T19:28:45.555 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.555 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.555 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:28:45.555 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.525113+0000", 2024-04-01T19:28:45.555 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.011214732999999999 2024-04-01T19:28:45.555 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.555 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:28:45.555 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.555 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.555 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.556 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:272341 2.1 2:84550b7d:::benchmark_data_smithi188_77607_object104937:head [delete] snapc 0=[] ondisk+write+known_if_redirected e176)", 2024-04-01T19:28:45.556 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:45.518628+0000", 2024-04-01T19:28:45.556 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.020761371000000001, 2024-04-01T19:28:45.556 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.020892918999999999, 2024-04-01T19:28:45.556 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:28:45.556 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:28:45.556 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:28:45.556 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:28:45.556 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:28:45.556 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:28:45.556 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 272341 2024-04-01T19:28:45.556 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.556 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:28:45.556 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.556 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:28:45.557 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.518628+0000", 2024-04-01T19:28:45.557 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.557 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.557 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.557 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:28:45.557 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.518628+0000", 2024-04-01T19:28:45.557 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.557 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.557 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.557 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:28:45.557 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.518630+0000", 2024-04-01T19:28:45.557 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8029999999999999e-06 2024-04-01T19:28:45.557 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.557 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.558 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:28:45.558 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.518635+0000", 2024-04-01T19:28:45.558 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6369999999999998e-06 2024-04-01T19:28:45.558 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.558 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.558 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:28:45.558 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.518644+0000", 2024-04-01T19:28:45.558 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.3530000000000001e-06 2024-04-01T19:28:45.558 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.558 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.558 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:28:45.558 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.518652+0000", 2024-04-01T19:28:45.558 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.8299999999999996e-06 2024-04-01T19:28:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:28:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.519130+0000", 2024-04-01T19:28:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00047772100000000002 2024-04-01T19:28:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:28:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.519238+0000", 2024-04-01T19:28:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000108218 2024-04-01T19:28:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:28:45.559 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.519342+0000", 2024-04-01T19:28:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000103637 2024-04-01T19:28:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:28:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.529930+0000", 2024-04-01T19:28:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010588261999999999 2024-04-01T19:28:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:28:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:272345 2.e 2:7341402e:::benchmark_data_smithi188_77607_object104941:head [delete] snapc 0=[] ondisk+write+known_if_redirected e176)", 2024-04-01T19:28:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:45.520127+0000", 2024-04-01T19:28:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.019263182, 2024-04-01T19:28:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.019481297000000002, 2024-04-01T19:28:45.560 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:28:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:28:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:28:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:28:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:28:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:28:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 272345 2024-04-01T19:28:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:28:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:28:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.520127+0000", 2024-04-01T19:28:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.561 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:28:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.520127+0000", 2024-04-01T19:28:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:28:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.520128+0000", 2024-04-01T19:28:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6729999999999999e-06 2024-04-01T19:28:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:28:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.520133+0000", 2024-04-01T19:28:45.562 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0880000000000002e-06 2024-04-01T19:28:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:28:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.520143+0000", 2024-04-01T19:28:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.764e-06 2024-04-01T19:28:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:28:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.520151+0000", 2024-04-01T19:28:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2879999999999993e-06 2024-04-01T19:28:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:28:45.563 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.520201+0000", 2024-04-01T19:28:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0099000000000003e-05 2024-04-01T19:28:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:28:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.520308+0000", 2024-04-01T19:28:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00010600899999999999 2024-04-01T19:28:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:28:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.520412+0000", 2024-04-01T19:28:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000104028 2024-04-01T19:28:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.564 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:28:45.565 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.529690+0000", 2024-04-01T19:28:45.565 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0092779779999999992 2024-04-01T19:28:45.565 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.565 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:28:45.565 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.565 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.565 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.565 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:272342 2.3 e176/106 2:ce486257:::benchmark_data_smithi188_77607_object104938:head v 176'16902, mlcod=176'16899)", 2024-04-01T19:28:45.565 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:45.524944+0000", 2024-04-01T19:28:45.566 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.01444605, 2024-04-01T19:28:45.566 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014750704999999999, 2024-04-01T19:28:45.566 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:28:45.566 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:28:45.566 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:28:45.566 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:28:45.566 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.566 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:28:45.566 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.524944+0000", 2024-04-01T19:28:45.566 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.566 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.566 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:28:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.524944+0000", 2024-04-01T19:28:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:28:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.524945+0000", 2024-04-01T19:28:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.666e-06 2024-04-01T19:28:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:28:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.524959+0000", 2024-04-01T19:28:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3325e-05 2024-04-01T19:28:45.567 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.568 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.568 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:28:45.568 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.524969+0000", 2024-04-01T19:28:45.568 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0723000000000001e-05 2024-04-01T19:28:45.568 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.568 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.568 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:28:45.568 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.524978+0000", 2024-04-01T19:28:45.568 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.1009999999999992e-06 2024-04-01T19:28:45.568 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.568 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.568 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:28:45.568 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.525353+0000", 2024-04-01T19:28:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00037511199999999998 2024-04-01T19:28:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:28:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.525373+0000", 2024-04-01T19:28:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0806999999999999e-05 2024-04-01T19:28:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:28:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:272351 2.1 2:8927fd3d:::benchmark_data_smithi188_77607_object104947:head [delete] snapc 0=[] ondisk+write+known_if_redirected e176)", 2024-04-01T19:28:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:45.525098+0000", 2024-04-01T19:28:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.014291411, 2024-04-01T19:28:45.569 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014660685, 2024-04-01T19:28:45.570 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:28:45.570 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:28:45.570 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:28:45.570 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:28:45.570 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:28:45.570 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:28:45.570 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 272351 2024-04-01T19:28:45.570 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.570 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:28:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:28:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.525098+0000", 2024-04-01T19:28:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:28:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.525098+0000", 2024-04-01T19:28:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:28:45.571 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.525100+0000", 2024-04-01T19:28:45.572 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0449999999999999e-06 2024-04-01T19:28:45.572 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.572 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.572 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:28:45.572 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.525107+0000", 2024-04-01T19:28:45.572 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3840000000000002e-06 2024-04-01T19:28:45.572 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.572 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.572 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:28:45.572 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.525118+0000", 2024-04-01T19:28:45.572 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1005000000000001e-05 2024-04-01T19:28:45.572 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.572 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.573 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:28:45.573 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.525125+0000", 2024-04-01T19:28:45.573 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5050000000000001e-06 2024-04-01T19:28:45.573 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.573 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.573 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:28:45.573 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.525183+0000", 2024-04-01T19:28:45.573 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7389999999999998e-05 2024-04-01T19:28:45.573 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.573 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.573 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:28:45.573 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.525290+0000", 2024-04-01T19:28:45.573 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00010713 2024-04-01T19:28:45.573 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.574 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.574 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:28:45.574 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.525402+0000", 2024-04-01T19:28:45.574 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000112039 2024-04-01T19:28:45.574 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.574 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:28:45.574 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.574 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.574 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.574 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:272353 2.1 2:8527d0fc:::benchmark_data_smithi188_77607_object104949:head [delete] snapc 0=[] ondisk+write+known_if_redirected e176)", 2024-04-01T19:28:45.574 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:45.530061+0000", 2024-04-01T19:28:45.574 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0093284270000000002, 2024-04-01T19:28:45.574 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0097752510000000004, 2024-04-01T19:28:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:28:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:28:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:28:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:28:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:28:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:28:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 272353 2024-04-01T19:28:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:28:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:28:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.530061+0000", 2024-04-01T19:28:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.575 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.576 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:28:45.576 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.530061+0000", 2024-04-01T19:28:45.576 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.576 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.576 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.576 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:28:45.576 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.530064+0000", 2024-04-01T19:28:45.576 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.261e-06 2024-04-01T19:28:45.576 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.576 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.576 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:28:45.576 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.530071+0000", 2024-04-01T19:28:45.576 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0679999999999999e-06 2024-04-01T19:28:45.577 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.577 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.577 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:28:45.577 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.530084+0000", 2024-04-01T19:28:45.577 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3199e-05 2024-04-01T19:28:45.577 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.577 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.577 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:28:45.577 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.530093+0000", 2024-04-01T19:28:45.577 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.1479999999999995e-06 2024-04-01T19:28:45.577 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.577 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.577 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:28:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.530172+0000", 2024-04-01T19:28:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.8611999999999999e-05 2024-04-01T19:28:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:28:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.530301+0000", 2024-04-01T19:28:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012948500000000001 2024-04-01T19:28:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:28:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.530436+0000", 2024-04-01T19:28:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013453900000000001 2024-04-01T19:28:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.578 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:28:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:272357 2.1 2:8f8962d0:::benchmark_data_smithi188_77607_object104953:head [delete] snapc 0=[] ondisk+write+known_if_redirected e176)", 2024-04-01T19:28:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:45.533539+0000", 2024-04-01T19:28:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0058509900000000004, 2024-04-01T19:28:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.006375136, 2024-04-01T19:28:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:28:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:28:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:28:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:28:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:28:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:28:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 272357 2024-04-01T19:28:45.579 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:28:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:28:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.533539+0000", 2024-04-01T19:28:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:28:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.533539+0000", 2024-04-01T19:28:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:28:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.533541+0000", 2024-04-01T19:28:45.580 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.289e-06 2024-04-01T19:28:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:28:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.533548+0000", 2024-04-01T19:28:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9519999999999997e-06 2024-04-01T19:28:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:28:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.533561+0000", 2024-04-01T19:28:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2490999999999999e-05 2024-04-01T19:28:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:28:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.533569+0000", 2024-04-01T19:28:45.581 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8699999999999998e-06 2024-04-01T19:28:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:28:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.534295+0000", 2024-04-01T19:28:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00072555999999999999 2024-04-01T19:28:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:28:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.534431+0000", 2024-04-01T19:28:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013587000000000001 2024-04-01T19:28:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.582 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:28:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.534578+0000", 2024-04-01T19:28:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014677700000000001 2024-04-01T19:28:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:28:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:272359 2.1 2:886fd738:::benchmark_data_smithi188_77607_object104955:head [delete] snapc 0=[] ondisk+write+known_if_redirected e176)", 2024-04-01T19:28:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:45.533589+0000", 2024-04-01T19:28:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0058004040000000003, 2024-04-01T19:28:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0064056180000000001, 2024-04-01T19:28:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:28:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:28:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:28:45.583 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:28:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:28:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:28:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 272359 2024-04-01T19:28:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:28:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:28:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.533589+0000", 2024-04-01T19:28:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:28:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.533589+0000", 2024-04-01T19:28:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.584 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:28:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.533590+0000", 2024-04-01T19:28:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.44e-07 2024-04-01T19:28:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:28:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.533593+0000", 2024-04-01T19:28:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.0869999999999998e-06 2024-04-01T19:28:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:28:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.533599+0000", 2024-04-01T19:28:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6230000000000002e-06 2024-04-01T19:28:45.585 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:28:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.533604+0000", 2024-04-01T19:28:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3689999999999998e-06 2024-04-01T19:28:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:28:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.538864+0000", 2024-04-01T19:28:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0052596090000000002 2024-04-01T19:28:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:28:45.586 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.538991+0000", 2024-04-01T19:28:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012718500000000001 2024-04-01T19:28:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:28:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.539116+0000", 2024-04-01T19:28:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012485999999999999 2024-04-01T19:28:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:28:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:272362 2.e 2:73860ae5:::benchmark_data_smithi188_77607_object104958:head [delete] snapc 0=[] ondisk+write+known_if_redirected e176)", 2024-04-01T19:28:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:45.533610+0000", 2024-04-01T19:28:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0057795809999999998, 2024-04-01T19:28:45.587 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0064635150000000004, 2024-04-01T19:28:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:28:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:28:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:28:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:28:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:28:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:28:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 272362 2024-04-01T19:28:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:28:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:28:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.533610+0000", 2024-04-01T19:28:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.588 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:28:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.533610+0000", 2024-04-01T19:28:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:28:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.533611+0000", 2024-04-01T19:28:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2099999999999997e-07 2024-04-01T19:28:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:28:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.533613+0000", 2024-04-01T19:28:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4169999999999999e-06 2024-04-01T19:28:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:28:45.589 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.533618+0000", 2024-04-01T19:28:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7690000000000004e-06 2024-04-01T19:28:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:28:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.533623+0000", 2024-04-01T19:28:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7870000000000001e-06 2024-04-01T19:28:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:28:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.535599+0000", 2024-04-01T19:28:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0019766330000000002 2024-04-01T19:28:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:28:45.590 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.535706+0000", 2024-04-01T19:28:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000106536 2024-04-01T19:28:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:28:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.535812+0000", 2024-04-01T19:28:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000106482 2024-04-01T19:28:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:28:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:272358 2.3 e176/106 2:c95ec5b5:::benchmark_data_smithi188_77607_object104954:head v 176'16903, mlcod=176'16900)", 2024-04-01T19:28:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:45.535550+0000", 2024-04-01T19:28:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.003839524, 2024-04-01T19:28:45.591 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0046036970000000003, 2024-04-01T19:28:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:28:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:28:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:28:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:28:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:28:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.535550+0000", 2024-04-01T19:28:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:28:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.535550+0000", 2024-04-01T19:28:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.592 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:28:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.535551+0000", 2024-04-01T19:28:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.153e-06 2024-04-01T19:28:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:28:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.535559+0000", 2024-04-01T19:28:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6960000000000005e-06 2024-04-01T19:28:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:28:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.535577+0000", 2024-04-01T19:28:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8019000000000001e-05 2024-04-01T19:28:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.593 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:28:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.535585+0000", 2024-04-01T19:28:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4619999999999999e-06 2024-04-01T19:28:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:28:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.535774+0000", 2024-04-01T19:28:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00018990700000000001 2024-04-01T19:28:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:28:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.535794+0000", 2024-04-01T19:28:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9568e-05 2024-04-01T19:28:45.594 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:28:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop_reply(client.24751.0:272341 2.1 e176/106)", 2024-04-01T19:28:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:45.535661+0000", 2024-04-01T19:28:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0037285489999999998, 2024-04-01T19:28:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0045593200000000004, 2024-04-01T19:28:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:28:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:28:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "queued for pg", 2024-04-01T19:28:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:28:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:28:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.535661+0000", 2024-04-01T19:28:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:28:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.535661+0000", 2024-04-01T19:28:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:28:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.535662+0000", 2024-04-01T19:28:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9499999999999998e-07 2024-04-01T19:28:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.596 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:28:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.535664+0000", 2024-04-01T19:28:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.181e-06 2024-04-01T19:28:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:28:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.535668+0000", 2024-04-01T19:28:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.2359999999999998e-06 2024-04-01T19:28:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:28:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.535673+0000", 2024-04-01T19:28:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6240000000000001e-06 2024-04-01T19:28:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:28:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop_reply(client.24751.0:272351 2.1 e176/106)", 2024-04-01T19:28:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:45.535678+0000", 2024-04-01T19:28:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0037122370000000002, 2024-04-01T19:28:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.004662523, 2024-04-01T19:28:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:28:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:28:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "queued for pg", 2024-04-01T19:28:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:28:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:28:45.598 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.535678+0000", 2024-04-01T19:28:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:28:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.535678+0000", 2024-04-01T19:28:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:28:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.535678+0000", 2024-04-01T19:28:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5199999999999998e-07 2024-04-01T19:28:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:28:45.599 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.535680+0000", 2024-04-01T19:28:45.600 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1129999999999999e-06 2024-04-01T19:28:45.600 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.600 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.600 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:28:45.600 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.535684+0000", 2024-04-01T19:28:45.600 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.89e-06 2024-04-01T19:28:45.600 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.600 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.600 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:28:45.600 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.535688+0000", 2024-04-01T19:28:45.600 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9859999999999996e-06 2024-04-01T19:28:45.600 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.600 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:28:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:272363 2.e 2:72c1e653:::benchmark_data_smithi188_77607_object104959:head [delete] snapc 0=[] ondisk+write+known_if_redirected e176)", 2024-04-01T19:28:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:45.537591+0000", 2024-04-01T19:28:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0017989379999999999, 2024-04-01T19:28:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.002794057, 2024-04-01T19:28:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:28:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:28:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:28:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:28:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:28:45.601 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:28:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 272363 2024-04-01T19:28:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:28:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:28:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.537591+0000", 2024-04-01T19:28:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:28:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.537591+0000", 2024-04-01T19:28:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.602 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:28:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.537593+0000", 2024-04-01T19:28:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1500000000000002e-06 2024-04-01T19:28:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:28:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.537600+0000", 2024-04-01T19:28:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5470000000000002e-06 2024-04-01T19:28:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:28:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.537612+0000", 2024-04-01T19:28:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2561999999999999e-05 2024-04-01T19:28:45.603 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:28:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.537621+0000", 2024-04-01T19:28:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.1810000000000007e-06 2024-04-01T19:28:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:28:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.540258+0000", 2024-04-01T19:28:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.002637028 2024-04-01T19:28:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:28:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.540370+0000", 2024-04-01T19:28:45.604 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000111858 2024-04-01T19:28:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:28:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop_reply(client.24751.0:272345 2.e e176/106)", 2024-04-01T19:28:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:45.540137+0000", 2024-04-01T19:28:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 4294967295.9992533, 2024-04-01T19:28:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00029908099999999998, 2024-04-01T19:28:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:28:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:28:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "queued for pg", 2024-04-01T19:28:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:28:45.605 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:28:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.540137+0000", 2024-04-01T19:28:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:28:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.540137+0000", 2024-04-01T19:28:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:28:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:28:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.540138+0000", 2024-04-01T19:28:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3060000000000001e-06 2024-04-01T19:28:45.606 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:28:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.540143+0000", 2024-04-01T19:28:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.685e-06 2024-04-01T19:28:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:28:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.540150+0000", 2024-04-01T19:28:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9709999999999998e-06 2024-04-01T19:28:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:28:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:28:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:28:45.607 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.540156+0000", 2024-04-01T19:28:45.608 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.691e-06 2024-04-01T19:28:45.608 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.608 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:28:45.608 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.608 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:28:45.608 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T19:28:45.608 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 14 2024-04-01T19:28:45.608 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:28:46.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:45 smithi188 ceph-mon[43939]: pgmap v533: 17 pgs: 17 active+clean; 4.1 GiB data, 9.0 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 438 op/s; 75 MiB/s, 1.20k objects/s recovering 2024-04-01T19:28:46.148 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:28:46.151 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:46.151 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:28:46.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:45 smithi022 ceph-mon[39439]: pgmap v533: 17 pgs: 17 active+clean; 4.1 GiB data, 9.0 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 438 op/s; 75 MiB/s, 1.20k objects/s recovering 2024-04-01T19:28:46.252 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:28:46.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:45 smithi062 ceph-mon[44211]: pgmap v533: 17 pgs: 17 active+clean; 4.1 GiB data, 9.0 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 438 op/s; 75 MiB/s, 1.20k objects/s recovering 2024-04-01T19:28:46.281 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:46.814 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_blocked_ops 2024-04-01T19:28:46.833 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:28:46.912 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:28:47.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:46 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2789572968' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:28:47.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:46 smithi022 ceph-mon[39439]: from='client.35042 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:28:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:46 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2789572968' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:28:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:46 smithi062 ceph-mon[44211]: from='client.35042 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:28:47.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:46 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2789572968' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:28:47.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:46 smithi188 ceph-mon[43939]: from='client.35042 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:28:47.735 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:28:47.740 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:47.741 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:28:47.842 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:28:47.873 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:47.900 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:28:47.905 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:47.906 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:28:48.007 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:28:48.064 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:48.064 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:47 smithi022 ceph-mon[39439]: pgmap v534: 17 pgs: 17 active+clean; 3.9 GiB data, 8.7 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 763 op/s; 65 MiB/s, 1.03k objects/s recovering 2024-04-01T19:28:48.065 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:47 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:28:48.065 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:47 smithi022 ceph-mon[39439]: from='client.35042 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:28:48.065 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:47 smithi022 ceph-mon[39439]: osdmap e177: 12 total, 11 up, 11 in 2024-04-01T19:28:48.100 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:28:48.105 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:48.106 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:28:48.206 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:28:48.241 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:47 smithi062 ceph-mon[44211]: pgmap v534: 17 pgs: 17 active+clean; 3.9 GiB data, 8.7 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 763 op/s; 65 MiB/s, 1.03k objects/s recovering 2024-04-01T19:28:48.241 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:47 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:28:48.242 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:47 smithi062 ceph-mon[44211]: from='client.35042 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:28:48.242 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:47 smithi062 ceph-mon[44211]: osdmap e177: 12 total, 11 up, 11 in 2024-04-01T19:28:48.244 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:48.267 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:28:48.274 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:48.274 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:28:48.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:47 smithi188 ceph-mon[43939]: pgmap v534: 17 pgs: 17 active+clean; 3.9 GiB data, 8.7 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 763 op/s; 65 MiB/s, 1.03k objects/s recovering 2024-04-01T19:28:48.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:47 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:28:48.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:47 smithi188 ceph-mon[43939]: from='client.35042 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:28:48.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:47 smithi188 ceph-mon[43939]: osdmap e177: 12 total, 11 up, 11 in 2024-04-01T19:28:48.375 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:28:48.408 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:48.761 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:28:48.765 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:48.766 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:28:48.811 INFO:teuthology.orchestra.run.smithi188.stderr:Creating an OSD daemon form without an OSD FSID value 2024-04-01T19:28:48.867 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:28:48.901 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:48.926 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:28:48.932 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:48.932 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:28:49.013 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:28:49.033 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:28:49.065 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:49.094 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:28:49.099 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:49.099 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:28:49.200 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:28:49.234 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:49.317 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:28:49.319 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:49.320 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:28:49.421 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:28:49.457 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:49.480 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:28:49.485 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:49.486 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:28:49.551 INFO:teuthology.orchestra.run.smithi188.stdout:get_pg_num_history pg_num_history pg_num_history(e159 pg_nums {1={14=1},2={106=16}} deleted_pools ) 2024-04-01T19:28:49.552 INFO:teuthology.orchestra.run.smithi188.stdout:Importing pgid 2.6 2024-04-01T19:28:49.565 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60001373:::benchmark_data_smithi188_77607_object145919:head# 2024-04-01T19:28:49.566 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.566 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:600088d3:::benchmark_data_smithi188_77607_object124377:head# 2024-04-01T19:28:49.566 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.566 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6000e136:::benchmark_data_smithi188_77607_object98409:head# 2024-04-01T19:28:49.566 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.566 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60011b48:::benchmark_data_smithi188_77607_object139526:head# 2024-04-01T19:28:49.567 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.569 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6001b3a3:::benchmark_data_smithi188_77607_object148402:head# 2024-04-01T19:28:49.570 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.570 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6001ff2f:::benchmark_data_smithi188_77607_object119051:head# 2024-04-01T19:28:49.570 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.570 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:600304a7:::benchmark_data_smithi188_77607_object152587:head# 2024-04-01T19:28:49.570 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.570 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6004546a:::benchmark_data_smithi188_77607_object166817:head# 2024-04-01T19:28:49.570 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.571 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6004bc28:::benchmark_data_smithi188_77607_object146763:head# 2024-04-01T19:28:49.571 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.571 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6004e626:::benchmark_data_smithi188_77607_object99926:head# 2024-04-01T19:28:49.571 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.571 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6004e925:::benchmark_data_smithi188_77607_object150924:head# 2024-04-01T19:28:49.571 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.571 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:600725bf:::benchmark_data_smithi188_77607_object147091:head# 2024-04-01T19:28:49.571 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.572 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6007553a:::benchmark_data_smithi188_77607_object136941:head# 2024-04-01T19:28:49.572 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.572 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60075ac8:::benchmark_data_smithi188_77607_object110784:head# 2024-04-01T19:28:49.572 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.572 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6007ac1b:::benchmark_data_smithi188_77607_object149626:head# 2024-04-01T19:28:49.572 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.572 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6007e2fb:::benchmark_data_smithi188_77607_object122576:head# 2024-04-01T19:28:49.572 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.575 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6007fdb4:::benchmark_data_smithi188_77607_object161169:head# 2024-04-01T19:28:49.575 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.575 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6009499f:::benchmark_data_smithi188_77607_object157457:head# 2024-04-01T19:28:49.575 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.575 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:600951e0:::benchmark_data_smithi188_77607_object128966:head# 2024-04-01T19:28:49.575 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.576 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60098538:::benchmark_data_smithi188_77607_object102002:head# 2024-04-01T19:28:49.576 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.576 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:600a10c6:::benchmark_data_smithi188_77607_object135316:head# 2024-04-01T19:28:49.576 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.576 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:600a4a83:::benchmark_data_smithi188_77607_object116415:head# 2024-04-01T19:28:49.576 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.576 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:600c4062:::benchmark_data_smithi188_77607_object123647:head# 2024-04-01T19:28:49.576 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.577 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60103143:::benchmark_data_smithi188_77607_object166743:head# 2024-04-01T19:28:49.577 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.577 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6010cce1:::benchmark_data_smithi188_77607_object108058:head# 2024-04-01T19:28:49.577 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.577 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60125b3b:::benchmark_data_smithi188_77607_object116175:head# 2024-04-01T19:28:49.577 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.577 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6013e857:::benchmark_data_smithi188_77607_object99607:head# 2024-04-01T19:28:49.578 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.578 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6014826a:::benchmark_data_smithi188_77607_object154405:head# 2024-04-01T19:28:49.578 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.592 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:601618be:::benchmark_data_smithi188_77607_object102813:head# 2024-04-01T19:28:49.593 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.593 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6016aca2:::benchmark_data_smithi188_77607_object115303:head# 2024-04-01T19:28:49.593 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.593 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60173e90:::benchmark_data_smithi188_77607_object154533:head# 2024-04-01T19:28:49.593 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.593 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6017a1c9:::benchmark_data_smithi188_77607_object125954:head# 2024-04-01T19:28:49.593 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.593 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6017a357:::benchmark_data_smithi188_77607_object134283:head# 2024-04-01T19:28:49.594 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.594 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6018c6ea:::benchmark_data_smithi188_77607_object155620:head# 2024-04-01T19:28:49.594 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.594 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6018d881:::benchmark_data_smithi188_77607_object130608:head# 2024-04-01T19:28:49.594 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.594 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6019c2be:::benchmark_data_smithi188_77607_object162674:head# 2024-04-01T19:28:49.594 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.594 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6019f7e4:::benchmark_data_smithi188_77607_object136900:head# 2024-04-01T19:28:49.594 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:601a5829:::benchmark_data_smithi188_77607_object113227:head# 2024-04-01T19:28:49.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:601a815d:::benchmark_data_smithi188_77607_object103008:head# 2024-04-01T19:28:49.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:601c7328:::benchmark_data_smithi188_77607_object102232:head# 2024-04-01T19:28:49.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:601d6a1b:::benchmark_data_smithi188_77607_object132109:head# 2024-04-01T19:28:49.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:601e2b07:::benchmark_data_smithi188_77607_object114407:head# 2024-04-01T19:28:49.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:601e78ca:::benchmark_data_smithi188_77607_object155613:head# 2024-04-01T19:28:49.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:601ef820:::benchmark_data_smithi188_77607_object132437:head# 2024-04-01T19:28:49.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:601f4529:::benchmark_data_smithi188_77607_object125923:head# 2024-04-01T19:28:49.596 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.596 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60200f47:::benchmark_data_smithi188_77607_object122689:head# 2024-04-01T19:28:49.596 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.596 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60202198:::benchmark_data_smithi188_77607_object152140:head# 2024-04-01T19:28:49.596 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.596 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6020cfa0:::benchmark_data_smithi188_77607_object142707:head# 2024-04-01T19:28:49.596 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.596 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60214ee0:::benchmark_data_smithi188_77607_object125578:head# 2024-04-01T19:28:49.596 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.596 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:602152a0:::benchmark_data_smithi188_77607_object133607:head# 2024-04-01T19:28:49.596 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.597 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6023436b:::benchmark_data_smithi188_77607_object131869:head# 2024-04-01T19:28:49.597 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.597 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60243b50:::benchmark_data_smithi188_77607_object153998:head# 2024-04-01T19:28:49.597 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.597 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60245e63:::benchmark_data_smithi188_77607_object165238:head# 2024-04-01T19:28:49.597 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.597 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:602684da:::benchmark_data_smithi188_77607_object147515:head# 2024-04-01T19:28:49.597 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.597 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60279552:::benchmark_data_smithi188_77607_object102643:head# 2024-04-01T19:28:49.597 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.597 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6027e0c7:::benchmark_data_smithi188_77607_object166674:head# 2024-04-01T19:28:49.597 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.597 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60288354:::benchmark_data_smithi188_77607_object121192:head# 2024-04-01T19:28:49.598 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.598 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:602a6e37:::benchmark_data_smithi188_77607_object121235:head# 2024-04-01T19:28:49.598 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.598 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:602b336d:::benchmark_data_smithi188_77607_object112319:head# 2024-04-01T19:28:49.598 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.598 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:602bcdb9:::benchmark_data_smithi188_77607_object129194:head# 2024-04-01T19:28:49.598 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.598 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:602c0894:::benchmark_data_smithi188_77607_object126477:head# 2024-04-01T19:28:49.598 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.598 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:602c23a8:::benchmark_data_smithi188_77607_object107742:head# 2024-04-01T19:28:49.598 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.598 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:602c989a:::benchmark_data_smithi188_77607_object140552:head# 2024-04-01T19:28:49.598 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.598 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:602dd0ff:::benchmark_data_smithi188_77607_object156851:head# 2024-04-01T19:28:49.599 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.599 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:602fb849:::benchmark_data_smithi188_77607_object151933:head# 2024-04-01T19:28:49.599 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.599 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60308e9a:::benchmark_data_smithi188_77607_object123501:head# 2024-04-01T19:28:49.599 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.599 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6030b099:::benchmark_data_smithi188_77607_object120731:head# 2024-04-01T19:28:49.599 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.599 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6032cb98:::benchmark_data_smithi188_77607_object112806:head# 2024-04-01T19:28:49.599 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.599 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6034a0a1:::benchmark_data_smithi188_77607_object163068:head# 2024-04-01T19:28:49.599 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.599 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6035db2f:::benchmark_data_smithi188_77607_object140092:head# 2024-04-01T19:28:49.599 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.599 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6036d344:::benchmark_data_smithi188_77607_object127720:head# 2024-04-01T19:28:49.599 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.600 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:603717e1:::benchmark_data_smithi188_77607_object100455:head# 2024-04-01T19:28:49.600 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.600 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6037ad21:::benchmark_data_smithi188_77607_object152347:head# 2024-04-01T19:28:49.600 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.600 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60388cb1:::benchmark_data_smithi188_77607_object141251:head# 2024-04-01T19:28:49.600 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.600 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60389165:::benchmark_data_smithi188_77607_object99830:head# 2024-04-01T19:28:49.600 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.600 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60396aa8:::benchmark_data_smithi188_77607_object104260:head# 2024-04-01T19:28:49.600 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.600 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60397ec0:::benchmark_data_smithi188_77607_object126674:head# 2024-04-01T19:28:49.600 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.600 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6039c447:::benchmark_data_smithi188_77607_object112554:head# 2024-04-01T19:28:49.600 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.600 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:603b725f:::benchmark_data_smithi188_77607_object163538:head# 2024-04-01T19:28:49.601 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.601 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:603bbb29:::benchmark_data_smithi188_77607_object157938:head# 2024-04-01T19:28:49.601 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.601 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:603c000b:::benchmark_data_smithi188_77607_object101549:head# 2024-04-01T19:28:49.601 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.601 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:603d89d8:::benchmark_data_smithi188_77607_object150051:head# 2024-04-01T19:28:49.601 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.601 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:603de932:::benchmark_data_smithi188_77607_object120597:head# 2024-04-01T19:28:49.601 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.601 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:603e488b:::benchmark_data_smithi188_77607_object100490:head# 2024-04-01T19:28:49.601 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.601 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:603e6eca:::benchmark_data_smithi188_77607_object145642:head# 2024-04-01T19:28:49.601 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.601 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:603ee3a6:::benchmark_data_smithi188_77607_object156908:head# 2024-04-01T19:28:49.601 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.602 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:603fcfbf:::benchmark_data_smithi188_77607_object118977:head# 2024-04-01T19:28:49.602 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.602 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:603ff0cd:::benchmark_data_smithi188_77607_object112111:head# 2024-04-01T19:28:49.602 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.602 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60405bea:::benchmark_data_smithi188_77607_object144911:head# 2024-04-01T19:28:49.602 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.602 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6040bbcf:::benchmark_data_smithi188_77607_object149107:head# 2024-04-01T19:28:49.602 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.602 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6040c1cb:::benchmark_data_smithi188_77607_object112357:head# 2024-04-01T19:28:49.602 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.602 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:604327fa:::benchmark_data_smithi188_77607_object107666:head# 2024-04-01T19:28:49.602 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.602 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60440120:::benchmark_data_smithi188_77607_object100311:head# 2024-04-01T19:28:49.603 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.603 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60444980:::benchmark_data_smithi188_77607_object124261:head# 2024-04-01T19:28:49.603 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.603 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6044d593:::benchmark_data_smithi188_77607_object157381:head# 2024-04-01T19:28:49.603 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.603 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:28:49.604 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6045591f:::benchmark_data_smithi188_77607_object156457:head# 2024-04-01T19:28:49.604 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.604 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6046324e:::benchmark_data_smithi188_77607_object138630:head# 2024-04-01T19:28:49.605 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.605 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6046ed91:::benchmark_data_smithi188_77607_object150948:head# 2024-04-01T19:28:49.605 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.605 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60479b1a:::benchmark_data_smithi188_77607_object126392:head# 2024-04-01T19:28:49.605 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.605 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60491bcd:::benchmark_data_smithi188_77607_object166510:head# 2024-04-01T19:28:49.606 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.606 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:604d3f8c:::benchmark_data_smithi188_77607_object130614:head# 2024-04-01T19:28:49.606 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.607 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:604da83f:::benchmark_data_smithi188_77607_object117702:head# 2024-04-01T19:28:49.607 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.607 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:604e13b8:::benchmark_data_smithi188_77607_object140841:head# 2024-04-01T19:28:49.608 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.608 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:604e39cc:::benchmark_data_smithi188_77607_object149412:head# 2024-04-01T19:28:49.608 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.608 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:604e521f:::benchmark_data_smithi188_77607_object99239:head# 2024-04-01T19:28:49.608 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.608 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:604e5fd8:::benchmark_data_smithi188_77607_object156420:head# 2024-04-01T19:28:49.609 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.609 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:604f2a2d:::benchmark_data_smithi188_77607_object155981:head# 2024-04-01T19:28:49.609 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.609 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6050ca8e:::benchmark_data_smithi188_77607_object161392:head# 2024-04-01T19:28:49.609 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.609 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60513471:::benchmark_data_smithi188_77607_object156876:head# 2024-04-01T19:28:49.610 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.610 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6052ce06:::benchmark_data_smithi188_77607_object114835:head# 2024-04-01T19:28:49.610 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.610 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60541ba7:::benchmark_data_smithi188_77607_object139646:head# 2024-04-01T19:28:49.610 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.611 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60542ef4:::benchmark_data_smithi188_77607_object121501:head# 2024-04-01T19:28:49.611 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.616 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6055d7e6:::benchmark_data_smithi188_77607_object118241:head# 2024-04-01T19:28:49.616 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.616 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60569ffd:::benchmark_data_smithi188_77607_object125036:head# 2024-04-01T19:28:49.617 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.617 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6056a6c3:::benchmark_data_smithi188_77607_object130367:head# 2024-04-01T19:28:49.617 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.617 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:605831c8:::benchmark_data_smithi188_77607_object151577:head# 2024-04-01T19:28:49.617 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.617 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60597bcf:::benchmark_data_smithi188_77607_object117069:head# 2024-04-01T19:28:49.618 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.618 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:605a7728:::benchmark_data_smithi188_77607_object140627:head# 2024-04-01T19:28:49.618 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.618 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:605a98c3:::benchmark_data_smithi188_77607_object124869:head# 2024-04-01T19:28:49.618 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.618 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:605b5bcd:::benchmark_data_smithi188_77607_object104316:head# 2024-04-01T19:28:49.618 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.619 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:605b9fd4:::benchmark_data_smithi188_77607_object113705:head# 2024-04-01T19:28:49.619 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.619 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:605f16e5:::benchmark_data_smithi188_77607_object123270:head# 2024-04-01T19:28:49.619 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.619 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:605f9814:::benchmark_data_smithi188_77607_object99225:head# 2024-04-01T19:28:49.619 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.619 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60609339:::benchmark_data_smithi188_77607_object158415:head# 2024-04-01T19:28:49.619 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.620 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60615060:::benchmark_data_smithi188_77607_object145887:head# 2024-04-01T19:28:49.620 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.620 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:606352e5:::benchmark_data_smithi188_77607_object120500:head# 2024-04-01T19:28:49.620 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.620 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6063ce1a:::benchmark_data_smithi188_77607_object124916:head# 2024-04-01T19:28:49.620 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.620 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60647137:::benchmark_data_smithi188_77607_object154375:head# 2024-04-01T19:28:49.620 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.621 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6064d2c8:::benchmark_data_smithi188_77607_object143419:head# 2024-04-01T19:28:49.621 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.621 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6065b864:::benchmark_data_smithi188_77607_object162476:head# 2024-04-01T19:28:49.621 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.621 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60683380:::benchmark_data_smithi188_77607_object134901:head# 2024-04-01T19:28:49.621 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.622 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6068aa7e:::benchmark_data_smithi188_77607_object158486:head# 2024-04-01T19:28:49.622 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.622 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:606dce35:::benchmark_data_smithi188_77607_object103625:head# 2024-04-01T19:28:49.622 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.622 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:606e16c6:::benchmark_data_smithi188_77607_object159886:head# 2024-04-01T19:28:49.622 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.622 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:606e92dc:::benchmark_data_smithi188_77607_object99261:head# 2024-04-01T19:28:49.623 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.623 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:606edb39:::benchmark_data_smithi188_77607_object124722:head# 2024-04-01T19:28:49.623 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.631 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6070d916:::benchmark_data_smithi188_77607_object103350:head# 2024-04-01T19:28:49.631 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.632 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6071588d:::benchmark_data_smithi188_77607_object125230:head# 2024-04-01T19:28:49.632 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.632 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6073b89d:::benchmark_data_smithi188_77607_object123800:head# 2024-04-01T19:28:49.632 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.632 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6073d82e:::benchmark_data_smithi188_77607_object141417:head# 2024-04-01T19:28:49.632 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.632 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60745658:::benchmark_data_smithi188_77607_object103284:head# 2024-04-01T19:28:49.632 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.632 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60748cec:::benchmark_data_smithi188_77607_object105275:head# 2024-04-01T19:28:49.632 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.632 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6076d1e4:::benchmark_data_smithi188_77607_object106248:head# 2024-04-01T19:28:49.632 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.632 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60770cbe:::benchmark_data_smithi188_77607_object110913:head# 2024-04-01T19:28:49.632 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.633 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:607717ac:::benchmark_data_smithi188_77607_object118620:head# 2024-04-01T19:28:49.633 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.633 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60779c78:::benchmark_data_smithi188_77607_object120790:head# 2024-04-01T19:28:49.633 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.633 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60780a28:::benchmark_data_smithi188_77607_object99132:head# 2024-04-01T19:28:49.633 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.633 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6078ad61:::benchmark_data_smithi188_77607_object139102:head# 2024-04-01T19:28:49.633 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.633 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6078bf1f:::benchmark_data_smithi188_77607_object113788:head# 2024-04-01T19:28:49.633 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.633 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:607ce7b6:::benchmark_data_smithi188_77607_object111346:head# 2024-04-01T19:28:49.633 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.633 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:607e5365:::benchmark_data_smithi188_77607_object138759:head# 2024-04-01T19:28:49.633 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.633 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:607e7511:::benchmark_data_smithi188_77607_object157981:head# 2024-04-01T19:28:49.634 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.634 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:607e9a6d:::benchmark_data_smithi188_77607_object148418:head# 2024-04-01T19:28:49.634 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.634 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:607ef7c6:::benchmark_data_smithi188_77607_object162364:head# 2024-04-01T19:28:49.634 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.634 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:607f8e37:::benchmark_data_smithi188_77607_object145165:head# 2024-04-01T19:28:49.634 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.634 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6082af85:::benchmark_data_smithi188_77607_object146351:head# 2024-04-01T19:28:49.634 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.634 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6085a5f6:::benchmark_data_smithi188_77607_object152890:head# 2024-04-01T19:28:49.635 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.635 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6085c98c:::benchmark_data_smithi188_77607_object136118:head# 2024-04-01T19:28:49.635 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.635 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60866264:::benchmark_data_smithi188_77607_object98286:head# 2024-04-01T19:28:49.635 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.635 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6087c1c0:::benchmark_data_smithi188_77607_object139301:head# 2024-04-01T19:28:49.635 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.635 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:608a62c2:::benchmark_data_smithi188_77607_object106587:head# 2024-04-01T19:28:49.635 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.636 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:608aeb61:::benchmark_data_smithi188_77607_object145053:head# 2024-04-01T19:28:49.636 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.636 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:608b8de0:::benchmark_data_smithi188_77607_object104326:head# 2024-04-01T19:28:49.636 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.636 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:608c5a45:::benchmark_data_smithi188_77607_object113376:head# 2024-04-01T19:28:49.636 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.636 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:608cf4a6:::benchmark_data_smithi188_77607_object140717:head# 2024-04-01T19:28:49.636 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.636 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:608daf61:::benchmark_data_smithi188_77607_object139256:head# 2024-04-01T19:28:49.636 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.636 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:608dd83f:::benchmark_data_smithi188_77607_object132377:head# 2024-04-01T19:28:49.636 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.636 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:608e1a03:::benchmark_data_smithi188_77607_object145969:head# 2024-04-01T19:28:49.636 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.636 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:608e2aa0:::benchmark_data_smithi188_77607_object156958:head# 2024-04-01T19:28:49.637 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.637 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:608eaf04:::benchmark_data_smithi188_77607_object159160:head# 2024-04-01T19:28:49.637 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.637 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:608f9ece:::benchmark_data_smithi188_77607_object107524:head# 2024-04-01T19:28:49.637 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.637 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60911f47:::benchmark_data_smithi188_77607_object136276:head# 2024-04-01T19:28:49.637 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.637 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6092c463:::benchmark_data_smithi188_77607_object134241:head# 2024-04-01T19:28:49.637 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.637 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60943319:::benchmark_data_smithi188_77607_object128298:head# 2024-04-01T19:28:49.637 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.637 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60954e2f:::benchmark_data_smithi188_77607_object126863:head# 2024-04-01T19:28:49.637 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.637 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6095d4cb:::benchmark_data_smithi188_77607_object161448:head# 2024-04-01T19:28:49.637 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.638 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60968ce9:::benchmark_data_smithi188_77607_object161372:head# 2024-04-01T19:28:49.638 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.638 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6096c463:::benchmark_data_smithi188_77607_object160404:head# 2024-04-01T19:28:49.638 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.638 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:609761c8:::benchmark_data_smithi188_77607_object167235:head# 2024-04-01T19:28:49.638 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.638 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:609816c3:::benchmark_data_smithi188_77607_object98219:head# 2024-04-01T19:28:49.638 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.638 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6098bf65:::benchmark_data_smithi188_77607_object143872:head# 2024-04-01T19:28:49.638 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.638 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6098fa40:::benchmark_data_smithi188_77607_object123470:head# 2024-04-01T19:28:49.638 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.638 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:609af99e:::benchmark_data_smithi188_77607_object137460:head# 2024-04-01T19:28:49.638 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.639 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:609b67a3:::benchmark_data_smithi188_77607_object109827:head# 2024-04-01T19:28:49.639 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.639 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:609bbef9:::benchmark_data_smithi188_77607_object132421:head# 2024-04-01T19:28:49.639 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.639 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:609c601e:::benchmark_data_smithi188_77607_object113621:head# 2024-04-01T19:28:49.639 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.639 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:609d3de2:::benchmark_data_smithi188_77607_object141628:head# 2024-04-01T19:28:49.639 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.639 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:609e1550:::benchmark_data_smithi188_77607_object130259:head# 2024-04-01T19:28:49.639 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.639 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:609f653e:::benchmark_data_smithi188_77607_object166589:head# 2024-04-01T19:28:49.639 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.639 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60a06c32:::benchmark_data_smithi188_77607_object104303:head# 2024-04-01T19:28:49.639 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.640 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60a113d1:::benchmark_data_smithi188_77607_object129129:head# 2024-04-01T19:28:49.640 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.640 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60a1ae5e:::benchmark_data_smithi188_77607_object108017:head# 2024-04-01T19:28:49.640 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.640 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60a2ff9d:::benchmark_data_smithi188_77607_object105381:head# 2024-04-01T19:28:49.640 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.640 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60a385f9:::benchmark_data_smithi188_77607_object164105:head# 2024-04-01T19:28:49.640 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.640 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60a3d950:::benchmark_data_smithi188_77607_object125995:head# 2024-04-01T19:28:49.640 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.640 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60a4609e:::benchmark_data_smithi188_77607_object164928:head# 2024-04-01T19:28:49.640 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.641 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:49.643 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60a48916:::benchmark_data_smithi188_77607_object140285:head# 2024-04-01T19:28:49.643 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.643 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60a4fe71:::benchmark_data_smithi188_77607_object134996:head# 2024-04-01T19:28:49.643 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.643 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60a5019c:::benchmark_data_smithi188_77607_object157936:head# 2024-04-01T19:28:49.644 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.644 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60a794c3:::benchmark_data_smithi188_77607_object119367:head# 2024-04-01T19:28:49.644 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.644 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60a8b624:::benchmark_data_smithi188_77607_object134145:head# 2024-04-01T19:28:49.644 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.644 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60aaa45a:::benchmark_data_smithi188_77607_object131176:head# 2024-04-01T19:28:49.644 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.644 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60ab2704:::benchmark_data_smithi188_77607_object159257:head# 2024-04-01T19:28:49.644 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.644 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60ab5e9f:::benchmark_data_smithi188_77607_object106399:head# 2024-04-01T19:28:49.644 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.644 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60add86f:::benchmark_data_smithi188_77607_object124003:head# 2024-04-01T19:28:49.644 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.644 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60ae6d83:::benchmark_data_smithi188_77607_object132362:head# 2024-04-01T19:28:49.645 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.645 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60af2324:::benchmark_data_smithi188_77607_object133703:head# 2024-04-01T19:28:49.645 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.645 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60afbae5:::benchmark_data_smithi188_77607_object164877:head# 2024-04-01T19:28:49.645 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.645 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60b05f3b:::benchmark_data_smithi188_77607_object119572:head# 2024-04-01T19:28:49.645 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.645 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60b25829:::benchmark_data_smithi188_77607_object136663:head# 2024-04-01T19:28:49.645 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.645 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60b60fe0:::benchmark_data_smithi188_77607_object145730:head# 2024-04-01T19:28:49.645 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.645 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60b9d189:::benchmark_data_smithi188_77607_object143480:head# 2024-04-01T19:28:49.646 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.646 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60ba5c51:::benchmark_data_smithi188_77607_object102518:head# 2024-04-01T19:28:49.646 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.646 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60bdc2da:::benchmark_data_smithi188_77607_object103924:head# 2024-04-01T19:28:49.646 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.646 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60be0671:::benchmark_data_smithi188_77607_object151786:head# 2024-04-01T19:28:49.646 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.646 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60bea1c7:::benchmark_data_smithi188_77607_object154060:head# 2024-04-01T19:28:49.646 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.646 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60bf54ab:::benchmark_data_smithi188_77607_object148891:head# 2024-04-01T19:28:49.646 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.646 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60c0b003:::benchmark_data_smithi188_77607_object164851:head# 2024-04-01T19:28:49.647 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.647 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60c17da4:::benchmark_data_smithi188_77607_object164788:head# 2024-04-01T19:28:49.647 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.647 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60c24cf7:::benchmark_data_smithi188_77607_object110334:head# 2024-04-01T19:28:49.647 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.647 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60c2c4a2:::benchmark_data_smithi188_77607_object147501:head# 2024-04-01T19:28:49.647 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.647 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60c3dcea:::benchmark_data_smithi188_77607_object108393:head# 2024-04-01T19:28:49.647 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.647 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60c3ff30:::benchmark_data_smithi188_77607_object162999:head# 2024-04-01T19:28:49.647 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.647 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60c42723:::benchmark_data_smithi188_77607_object145409:head# 2024-04-01T19:28:49.647 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.647 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60c55f72:::benchmark_data_smithi188_77607_object112608:head# 2024-04-01T19:28:49.647 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.647 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60c5e749:::benchmark_data_smithi188_77607_object135906:head# 2024-04-01T19:28:49.648 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.648 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60c7dc6e:::benchmark_data_smithi188_77607_object133377:head# 2024-04-01T19:28:49.648 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.648 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60c8a2c0:::benchmark_data_smithi188_77607_object148946:head# 2024-04-01T19:28:49.648 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.648 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60c9961c:::benchmark_data_smithi188_77607_object135228:head# 2024-04-01T19:28:49.648 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.648 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60caf19d:::benchmark_data_smithi188_77607_object118709:head# 2024-04-01T19:28:49.648 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.648 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60cb1fb3:::benchmark_data_smithi188_77607_object134738:head# 2024-04-01T19:28:49.648 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.652 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60cce44e:::benchmark_data_smithi188_77607_object148169:head# 2024-04-01T19:28:49.652 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.652 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60ccf172:::benchmark_data_smithi188_77607_object145013:head# 2024-04-01T19:28:49.652 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.652 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60cd42a6:::benchmark_data_smithi188_77607_object98433:head# 2024-04-01T19:28:49.652 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.652 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60cd8124:::benchmark_data_smithi188_77607_object124800:head# 2024-04-01T19:28:49.652 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.652 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60cee482:::benchmark_data_smithi188_77607_object161205:head# 2024-04-01T19:28:49.652 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.652 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60d0848f:::benchmark_data_smithi188_77607_object128915:head# 2024-04-01T19:28:49.652 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.652 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60d0a88f:::benchmark_data_smithi188_77607_object129758:head# 2024-04-01T19:28:49.653 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.653 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60d13dca:::benchmark_data_smithi188_77607_object147095:head# 2024-04-01T19:28:49.653 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.653 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60d22787:::benchmark_data_smithi188_77607_object157328:head# 2024-04-01T19:28:49.653 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.653 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60d3d5a6:::benchmark_data_smithi188_77607_object161924:head# 2024-04-01T19:28:49.653 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.653 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60d3dafd:::benchmark_data_smithi188_77607_object112303:head# 2024-04-01T19:28:49.653 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.653 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60d3e346:::benchmark_data_smithi188_77607_object111408:head# 2024-04-01T19:28:49.653 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.653 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60d43569:::benchmark_data_smithi188_77607_object132716:head# 2024-04-01T19:28:49.653 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.653 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60d531b9:::benchmark_data_smithi188_77607_object145236:head# 2024-04-01T19:28:49.653 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.654 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60d6a94b:::benchmark_data_smithi188_77607_object155096:head# 2024-04-01T19:28:49.654 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.654 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60d725ab:::benchmark_data_smithi188_77607_object123030:head# 2024-04-01T19:28:49.654 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.654 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60d819ab:::benchmark_data_smithi188_77607_object135559:head# 2024-04-01T19:28:49.654 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.654 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60d858bc:::benchmark_data_smithi188_77607_object133130:head# 2024-04-01T19:28:49.654 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.654 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60d8e5ef:::benchmark_data_smithi188_77607_object153249:head# 2024-04-01T19:28:49.654 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.654 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60d92922:::benchmark_data_smithi188_77607_object144415:head# 2024-04-01T19:28:49.654 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.654 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60d96a07:::benchmark_data_smithi188_77607_object119243:head# 2024-04-01T19:28:49.654 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.655 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60da351a:::benchmark_data_smithi188_77607_object111010:head# 2024-04-01T19:28:49.655 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.655 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60da56b8:::benchmark_data_smithi188_77607_object102537:head# 2024-04-01T19:28:49.655 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.655 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60db785b:::benchmark_data_smithi188_77607_object107021:head# 2024-04-01T19:28:49.655 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.655 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60dd408f:::benchmark_data_smithi188_77607_object126985:head# 2024-04-01T19:28:49.655 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.655 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60dd70c7:::benchmark_data_smithi188_77607_object160733:head# 2024-04-01T19:28:49.655 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.655 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60dd7609:::benchmark_data_smithi188_77607_object137779:head# 2024-04-01T19:28:49.655 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.655 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60de0b03:::benchmark_data_smithi188_77607_object160462:head# 2024-04-01T19:28:49.655 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.655 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60dec46f:::benchmark_data_smithi188_77607_object112148:head# 2024-04-01T19:28:49.656 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.656 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60df0b57:::benchmark_data_smithi188_77607_object108532:head# 2024-04-01T19:28:49.656 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.656 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60df180b:::benchmark_data_smithi188_77607_object164841:head# 2024-04-01T19:28:49.656 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.656 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60df2bab:::benchmark_data_smithi188_77607_object145480:head# 2024-04-01T19:28:49.656 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.656 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60dfb557:::benchmark_data_smithi188_77607_object156968:head# 2024-04-01T19:28:49.656 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.656 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60dfe6ad:::benchmark_data_smithi188_77607_object104746:head# 2024-04-01T19:28:49.656 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.656 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60e0eb67:::benchmark_data_smithi188_77607_object106136:head# 2024-04-01T19:28:49.657 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.657 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60e1ab95:::benchmark_data_smithi188_77607_object112510:head# 2024-04-01T19:28:49.657 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.662 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60e34acb:::benchmark_data_smithi188_77607_object157332:head# 2024-04-01T19:28:49.662 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.662 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60e399e4:::benchmark_data_smithi188_77607_object119582:head# 2024-04-01T19:28:49.662 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.662 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60e447bf:::benchmark_data_smithi188_77607_object164738:head# 2024-04-01T19:28:49.663 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.663 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60e64719:::benchmark_data_smithi188_77607_object149205:head# 2024-04-01T19:28:49.663 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.663 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60e669fe:::benchmark_data_smithi188_77607_object101218:head# 2024-04-01T19:28:49.663 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.663 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60e6a862:::benchmark_data_smithi188_77607_object120146:head# 2024-04-01T19:28:49.663 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.663 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60e7d21c:::benchmark_data_smithi188_77607_object153751:head# 2024-04-01T19:28:49.663 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.663 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60e7fb9d:::benchmark_data_smithi188_77607_object118213:head# 2024-04-01T19:28:49.663 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.663 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60e80c86:::benchmark_data_smithi188_77607_object123617:head# 2024-04-01T19:28:49.663 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.663 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60ea4ea6:::benchmark_data_smithi188_77607_object100668:head# 2024-04-01T19:28:49.664 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.664 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60ebd48e:::benchmark_data_smithi188_77607_object132973:head# 2024-04-01T19:28:49.664 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.664 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60ed03b3:::benchmark_data_smithi188_77607_object135506:head# 2024-04-01T19:28:49.664 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.664 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60f082bd:::benchmark_data_smithi188_77607_object116908:head# 2024-04-01T19:28:49.664 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.664 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60f0bf64:::benchmark_data_smithi188_77607_object128805:head# 2024-04-01T19:28:49.664 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.664 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60f104de:::benchmark_data_smithi188_77607_object158866:head# 2024-04-01T19:28:49.664 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.664 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60f1a257:::benchmark_data_smithi188_77607_object116002:head# 2024-04-01T19:28:49.664 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.664 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60f1ad9b:::benchmark_data_smithi188_77607_object102285:head# 2024-04-01T19:28:49.664 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.665 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60f24be0:::benchmark_data_smithi188_77607_object134648:head# 2024-04-01T19:28:49.665 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.665 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60f28326:::benchmark_data_smithi188_77607_object118041:head# 2024-04-01T19:28:49.665 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.665 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60f3d0e9:::benchmark_data_smithi188_77607_object157892:head# 2024-04-01T19:28:49.665 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.665 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60f4afc0:::benchmark_data_smithi188_77607_object133370:head# 2024-04-01T19:28:49.665 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.665 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60f5d410:::benchmark_data_smithi188_77607_object120674:head# 2024-04-01T19:28:49.665 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.665 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60f6f7a0:::benchmark_data_smithi188_77607_object147272:head# 2024-04-01T19:28:49.665 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.665 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60f6fbbe:::benchmark_data_smithi188_77607_object142270:head# 2024-04-01T19:28:49.665 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.666 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60f9d527:::benchmark_data_smithi188_77607_object98456:head# 2024-04-01T19:28:49.666 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.666 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60fa0be9:::benchmark_data_smithi188_77607_object116345:head# 2024-04-01T19:28:49.666 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.666 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60fa0dff:::benchmark_data_smithi188_77607_object156182:head# 2024-04-01T19:28:49.666 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.666 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60fa5fe0:::benchmark_data_smithi188_77607_object132335:head# 2024-04-01T19:28:49.666 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.666 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60fa6fb6:::benchmark_data_smithi188_77607_object153463:head# 2024-04-01T19:28:49.666 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.666 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60fb2847:::benchmark_data_smithi188_77607_object112186:head# 2024-04-01T19:28:49.667 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.667 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60fcaaa5:::benchmark_data_smithi188_77607_object109822:head# 2024-04-01T19:28:49.667 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.667 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60fcdad2:::benchmark_data_smithi188_77607_object146653:head# 2024-04-01T19:28:49.667 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.667 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60fdc518:::benchmark_data_smithi188_77607_object144467:head# 2024-04-01T19:28:49.667 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.667 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60fdfc79:::benchmark_data_smithi188_77607_object155992:head# 2024-04-01T19:28:49.667 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.667 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60fe6088:::benchmark_data_smithi188_77607_object152927:head# 2024-04-01T19:28:49.667 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.667 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60fe6202:::benchmark_data_smithi188_77607_object134275:head# 2024-04-01T19:28:49.667 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.667 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60fedca8:::benchmark_data_smithi188_77607_object111882:head# 2024-04-01T19:28:49.667 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.667 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60ff125a:::benchmark_data_smithi188_77607_object131741:head# 2024-04-01T19:28:49.668 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.668 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60ff774c:::benchmark_data_smithi188_77607_object137563:head# 2024-04-01T19:28:49.668 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.668 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:60ffc5b4:::benchmark_data_smithi188_77607_object112399:head# 2024-04-01T19:28:49.668 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.668 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6100679b:::benchmark_data_smithi188_77607_object128500:head# 2024-04-01T19:28:49.669 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.669 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6101ac5f:::benchmark_data_smithi188_77607_object128961:head# 2024-04-01T19:28:49.669 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.669 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61021838:::benchmark_data_smithi188_77607_object163659:head# 2024-04-01T19:28:49.669 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.669 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61023f81:::benchmark_data_smithi188_77607_object116009:head# 2024-04-01T19:28:49.669 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.669 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6102aa70:::benchmark_data_smithi188_77607_object127392:head# 2024-04-01T19:28:49.669 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.669 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6104c35c:::benchmark_data_smithi188_77607_object136747:head# 2024-04-01T19:28:49.669 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.669 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6105243d:::benchmark_data_smithi188_77607_object113505:head# 2024-04-01T19:28:49.669 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.670 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:49.670 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:28:49.670 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:28:49.672 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:610594fc:::benchmark_data_smithi188_77607_object157298:head# 2024-04-01T19:28:49.672 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.673 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61063ae0:::benchmark_data_smithi188_77607_object154610:head# 2024-04-01T19:28:49.673 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.673 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61071a63:::benchmark_data_smithi188_77607_object120226:head# 2024-04-01T19:28:49.673 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.673 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61072fef:::benchmark_data_smithi188_77607_object157301:head# 2024-04-01T19:28:49.673 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.673 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61086fc1:::benchmark_data_smithi188_77607_object163219:head# 2024-04-01T19:28:49.673 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.673 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6108f540:::benchmark_data_smithi188_77607_object113766:head# 2024-04-01T19:28:49.673 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.673 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:610a5b73:::benchmark_data_smithi188_77607_object129078:head# 2024-04-01T19:28:49.673 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.673 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:610a8969:::benchmark_data_smithi188_77607_object159195:head# 2024-04-01T19:28:49.673 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.673 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:610aeffc:::benchmark_data_smithi188_77607_object125540:head# 2024-04-01T19:28:49.674 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.674 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:610dd230:::benchmark_data_smithi188_77607_object118552:head# 2024-04-01T19:28:49.674 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.674 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:610dd6dd:::benchmark_data_smithi188_77607_object154901:head# 2024-04-01T19:28:49.674 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.674 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:610f4b9f:::benchmark_data_smithi188_77607_object134808:head# 2024-04-01T19:28:49.674 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.674 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:610fb582:::benchmark_data_smithi188_77607_object113061:head# 2024-04-01T19:28:49.674 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.674 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:610ff804:::benchmark_data_smithi188_77607_object138783:head# 2024-04-01T19:28:49.674 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.674 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61100f97:::benchmark_data_smithi188_77607_object101699:head# 2024-04-01T19:28:49.674 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.674 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6111e932:::benchmark_data_smithi188_77607_object136721:head# 2024-04-01T19:28:49.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.675 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6111fe52:::benchmark_data_smithi188_77607_object118221:head# 2024-04-01T19:28:49.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.675 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6112b4fb:::benchmark_data_smithi188_77607_object157058:head# 2024-04-01T19:28:49.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.675 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61132110:::benchmark_data_smithi188_77607_object133558:head# 2024-04-01T19:28:49.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.675 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61144dbf:::benchmark_data_smithi188_77607_object165436:head# 2024-04-01T19:28:49.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.675 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6115b6f9:::benchmark_data_smithi188_77607_object110348:head# 2024-04-01T19:28:49.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.675 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6116a93b:::benchmark_data_smithi188_77607_object146345:head# 2024-04-01T19:28:49.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.675 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61170e5c:::benchmark_data_smithi188_77607_object161005:head# 2024-04-01T19:28:49.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.676 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:611a7e70:::benchmark_data_smithi188_77607_object106025:head# 2024-04-01T19:28:49.676 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.676 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:611b4d26:::benchmark_data_smithi188_77607_object131783:head# 2024-04-01T19:28:49.676 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.676 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:611c29fd:::benchmark_data_smithi188_77607_object149588:head# 2024-04-01T19:28:49.676 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.676 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:611c3c00:::benchmark_data_smithi188_77607_object129009:head# 2024-04-01T19:28:49.676 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.676 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:611c952e:::benchmark_data_smithi188_77607_object133327:head# 2024-04-01T19:28:49.676 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.678 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:611e254a:::benchmark_data_smithi188_77607_object98143:head# 2024-04-01T19:28:49.678 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.678 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:611ec15b:::benchmark_data_smithi188_77607_object120502:head# 2024-04-01T19:28:49.678 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.678 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:611f80fd:::benchmark_data_smithi188_77607_object126614:head# 2024-04-01T19:28:49.678 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.678 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:611f9fbd:::benchmark_data_smithi188_77607_object99891:head# 2024-04-01T19:28:49.678 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.678 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:611fbde5:::benchmark_data_smithi188_77607_object145841:head# 2024-04-01T19:28:49.678 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.678 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6121ae50:::benchmark_data_smithi188_77607_object163606:head# 2024-04-01T19:28:49.679 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.679 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6122dd28:::benchmark_data_smithi188_77607_object164175:head# 2024-04-01T19:28:49.679 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.679 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61230456:::benchmark_data_smithi188_77607_object160518:head# 2024-04-01T19:28:49.679 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.679 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6123fd58:::benchmark_data_smithi188_77607_object158618:head# 2024-04-01T19:28:49.679 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.680 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61244ae6:::benchmark_data_smithi188_77607_object123150:head# 2024-04-01T19:28:49.680 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.680 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6126f2bc:::benchmark_data_smithi188_77607_object158909:head# 2024-04-01T19:28:49.680 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.680 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6127e025:::benchmark_data_smithi188_77607_object156415:head# 2024-04-01T19:28:49.680 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.681 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61281b41:::benchmark_data_smithi188_77607_object132071:head# 2024-04-01T19:28:49.681 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.681 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61296e39:::benchmark_data_smithi188_77607_object114567:head# 2024-04-01T19:28:49.681 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.681 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6129bd80:::benchmark_data_smithi188_77607_object138511:head# 2024-04-01T19:28:49.681 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.681 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6129de92:::benchmark_data_smithi188_77607_object126350:head# 2024-04-01T19:28:49.681 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.681 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6129e70c:::benchmark_data_smithi188_77607_object162345:head# 2024-04-01T19:28:49.681 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.681 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:612addd4:::benchmark_data_smithi188_77607_object161119:head# 2024-04-01T19:28:49.681 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.681 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:612ae990:::benchmark_data_smithi188_77607_object144826:head# 2024-04-01T19:28:49.681 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.682 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:612b5f7c:::benchmark_data_smithi188_77607_object150914:head# 2024-04-01T19:28:49.682 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.682 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:612bc7e7:::benchmark_data_smithi188_77607_object101319:head# 2024-04-01T19:28:49.682 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.682 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6131064e:::benchmark_data_smithi188_77607_object144582:head# 2024-04-01T19:28:49.682 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.682 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61311964:::benchmark_data_smithi188_77607_object144493:head# 2024-04-01T19:28:49.682 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.683 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61318db4:::benchmark_data_smithi188_77607_object112286:head# 2024-04-01T19:28:49.683 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.683 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:613413f0:::benchmark_data_smithi188_77607_object101085:head# 2024-04-01T19:28:49.683 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.683 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6134580a:::benchmark_data_smithi188_77607_object122290:head# 2024-04-01T19:28:49.684 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.684 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61348d69:::benchmark_data_smithi188_77607_object157966:head# 2024-04-01T19:28:49.684 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.684 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6135e007:::benchmark_data_smithi188_77607_object162426:head# 2024-04-01T19:28:49.684 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.685 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6136cc4b:::benchmark_data_smithi188_77607_object143754:head# 2024-04-01T19:28:49.685 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.685 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61374040:::benchmark_data_smithi188_77607_object122701:head# 2024-04-01T19:28:49.685 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.685 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61380192:::benchmark_data_smithi188_77607_object105329:head# 2024-04-01T19:28:49.685 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.685 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:613a3e31:::benchmark_data_smithi188_77607_object144508:head# 2024-04-01T19:28:49.685 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.688 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:613a8ceb:::benchmark_data_smithi188_77607_object162909:head# 2024-04-01T19:28:49.688 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.688 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:613b5227:::benchmark_data_smithi188_77607_object152918:head# 2024-04-01T19:28:49.688 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.688 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:613c9d1c:::benchmark_data_smithi188_77607_object105122:head# 2024-04-01T19:28:49.688 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.688 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:613cf45e:::benchmark_data_smithi188_77607_object155312:head# 2024-04-01T19:28:49.688 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.688 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:613d6b1a:::benchmark_data_smithi188_77607_object98754:head# 2024-04-01T19:28:49.688 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.688 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:613dfa92:::benchmark_data_smithi188_77607_object159755:head# 2024-04-01T19:28:49.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:613dfbee:::benchmark_data_smithi188_77607_object100590:head# 2024-04-01T19:28:49.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:613dff26:::benchmark_data_smithi188_77607_object143656:head# 2024-04-01T19:28:49.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:613eb8d6:::benchmark_data_smithi188_77607_object99273:head# 2024-04-01T19:28:49.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:613f768a:::benchmark_data_smithi188_77607_object138852:head# 2024-04-01T19:28:49.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:613f8700:::benchmark_data_smithi188_77607_object108110:head# 2024-04-01T19:28:49.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61400c52:::benchmark_data_smithi188_77607_object158137:head# 2024-04-01T19:28:49.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:614152b3:::benchmark_data_smithi188_77607_object125128:head# 2024-04-01T19:28:49.690 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.691 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6142aea8:::benchmark_data_smithi188_77607_object100744:head# 2024-04-01T19:28:49.691 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.691 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6144f106:::benchmark_data_smithi188_77607_object164683:head# 2024-04-01T19:28:49.691 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.691 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6145c2bc:::benchmark_data_smithi188_77607_object140255:head# 2024-04-01T19:28:49.691 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.691 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6145d21a:::benchmark_data_smithi188_77607_object101614:head# 2024-04-01T19:28:49.691 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.691 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6147dade:::benchmark_data_smithi188_77607_object109051:head# 2024-04-01T19:28:49.691 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.691 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:614810ce:::benchmark_data_smithi188_77607_object104853:head# 2024-04-01T19:28:49.691 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.694 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61492b49:::benchmark_data_smithi188_77607_object111202:head# 2024-04-01T19:28:49.694 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.695 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61499162:::benchmark_data_smithi188_77607_object161931:head# 2024-04-01T19:28:49.695 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.695 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:614999ab:::benchmark_data_smithi188_77607_object153326:head# 2024-04-01T19:28:49.695 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.695 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:614b02d0:::benchmark_data_smithi188_77607_object128149:head# 2024-04-01T19:28:49.695 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.696 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:614caaf7:::benchmark_data_smithi188_77607_object124260:head# 2024-04-01T19:28:49.696 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.696 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:614cd449:::benchmark_data_smithi188_77607_object147074:head# 2024-04-01T19:28:49.696 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.696 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:614d25ef:::benchmark_data_smithi188_77607_object98597:head# 2024-04-01T19:28:49.696 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.696 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:614d4680:::benchmark_data_smithi188_77607_object133636:head# 2024-04-01T19:28:49.696 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.698 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:614d4734:::benchmark_data_smithi188_77607_object157705:head# 2024-04-01T19:28:49.699 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.699 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:614e1015:::benchmark_data_smithi188_77607_object161244:head# 2024-04-01T19:28:49.699 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.699 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:614f6733:::benchmark_data_smithi188_77607_object99744:head# 2024-04-01T19:28:49.699 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.699 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:614faefa:::benchmark_data_smithi188_77607_object113269:head# 2024-04-01T19:28:49.699 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.699 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6150544d:::benchmark_data_smithi188_77607_object160819:head# 2024-04-01T19:28:49.699 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.699 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:615164a1:::benchmark_data_smithi188_77607_object103893:head# 2024-04-01T19:28:49.699 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.699 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:615262c8:::benchmark_data_smithi188_77607_object153269:head# 2024-04-01T19:28:49.699 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.699 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6152ee40:::benchmark_data_smithi188_77607_object122991:head# 2024-04-01T19:28:49.700 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.700 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6153814a:::benchmark_data_smithi188_77607_object106927:head# 2024-04-01T19:28:49.700 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.700 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61544064:::benchmark_data_smithi188_77607_object109789:head# 2024-04-01T19:28:49.700 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.701 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6154a105:::benchmark_data_smithi188_77607_object133258:head# 2024-04-01T19:28:49.701 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.701 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6154ce99:::benchmark_data_smithi188_77607_object141173:head# 2024-04-01T19:28:49.702 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.702 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6155357d:::benchmark_data_smithi188_77607_object105805:head# 2024-04-01T19:28:49.702 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.702 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61564b55:::benchmark_data_smithi188_77607_object161037:head# 2024-04-01T19:28:49.702 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.702 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61565444:::benchmark_data_smithi188_77607_object109982:head# 2024-04-01T19:28:49.702 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.702 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61566302:::benchmark_data_smithi188_77607_object132005:head# 2024-04-01T19:28:49.702 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.702 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61574ed6:::benchmark_data_smithi188_77607_object154905:head# 2024-04-01T19:28:49.702 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.702 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6157ce32:::benchmark_data_smithi188_77607_object148964:head# 2024-04-01T19:28:49.702 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.702 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61592c19:::benchmark_data_smithi188_77607_object148431:head# 2024-04-01T19:28:49.703 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.703 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6159e33e:::benchmark_data_smithi188_77607_object119751:head# 2024-04-01T19:28:49.703 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.705 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:615c69a8:::benchmark_data_smithi188_77607_object107687:head# 2024-04-01T19:28:49.705 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.705 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:615d3949:::benchmark_data_smithi188_77607_object153271:head# 2024-04-01T19:28:49.705 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.705 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:615f9a48:::benchmark_data_smithi188_77607_object155267:head# 2024-04-01T19:28:49.705 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.705 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:615fef73:::benchmark_data_smithi188_77607_object152742:head# 2024-04-01T19:28:49.705 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.705 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6160a373:::benchmark_data_smithi188_77607_object151482:head# 2024-04-01T19:28:49.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6160d32a:::benchmark_data_smithi188_77607_object160854:head# 2024-04-01T19:28:49.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6161a521:::benchmark_data_smithi188_77607_object158691:head# 2024-04-01T19:28:49.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:616254bb:::benchmark_data_smithi188_77607_object112964:head# 2024-04-01T19:28:49.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:616423ae:::benchmark_data_smithi188_77607_object107710:head# 2024-04-01T19:28:49.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6165a1ef:::benchmark_data_smithi188_77607_object134140:head# 2024-04-01T19:28:49.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6165ce48:::benchmark_data_smithi188_77607_object140618:head# 2024-04-01T19:28:49.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.707 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61667053:::benchmark_data_smithi188_77607_object153734:head# 2024-04-01T19:28:49.707 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.707 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61682bd3:::benchmark_data_smithi188_77607_object104249:head# 2024-04-01T19:28:49.707 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.709 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:616b1bd5:::benchmark_data_smithi188_77607_object109443:head# 2024-04-01T19:28:49.709 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.709 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:616c38ae:::benchmark_data_smithi188_77607_object112178:head# 2024-04-01T19:28:49.709 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.709 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:616c9b1d:::benchmark_data_smithi188_77607_object156647:head# 2024-04-01T19:28:49.709 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.709 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:616d7198:::benchmark_data_smithi188_77607_object129863:head# 2024-04-01T19:28:49.709 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.709 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:616dafae:::benchmark_data_smithi188_77607_object164956:head# 2024-04-01T19:28:49.710 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.710 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:616ff074:::benchmark_data_smithi188_77607_object161186:head# 2024-04-01T19:28:49.710 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.710 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61718561:::benchmark_data_smithi188_77607_object155083:head# 2024-04-01T19:28:49.710 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.710 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6173a412:::benchmark_data_smithi188_77607_object106715:head# 2024-04-01T19:28:49.710 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.710 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:617593a9:::benchmark_data_smithi188_77607_object130461:head# 2024-04-01T19:28:49.710 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.710 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6175a19d:::benchmark_data_smithi188_77607_object127184:head# 2024-04-01T19:28:49.710 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.710 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6175c854:::benchmark_data_smithi188_77607_object103305:head# 2024-04-01T19:28:49.710 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.714 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6176dc99:::benchmark_data_smithi188_77607_object130538:head# 2024-04-01T19:28:49.714 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.714 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6176f5e5:::benchmark_data_smithi188_77607_object117466:head# 2024-04-01T19:28:49.714 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.714 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:617a15e0:::benchmark_data_smithi188_77607_object99377:head# 2024-04-01T19:28:49.714 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.714 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:617b00e3:::benchmark_data_smithi188_77607_object146147:head# 2024-04-01T19:28:49.714 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.714 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:617b58d2:::benchmark_data_smithi188_77607_object163150:head# 2024-04-01T19:28:49.714 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.714 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:617d60db:::benchmark_data_smithi188_77607_object158738:head# 2024-04-01T19:28:49.714 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.715 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:617d8239:::benchmark_data_smithi188_77607_object105882:head# 2024-04-01T19:28:49.715 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.715 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:617da165:::benchmark_data_smithi188_77607_object140687:head# 2024-04-01T19:28:49.715 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.715 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6180773f:::benchmark_data_smithi188_77607_object152850:head# 2024-04-01T19:28:49.715 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.715 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6181c340:::benchmark_data_smithi188_77607_object127988:head# 2024-04-01T19:28:49.715 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.715 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6182e89d:::benchmark_data_smithi188_77607_object126700:head# 2024-04-01T19:28:49.715 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.715 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6183e702:::benchmark_data_smithi188_77607_object101157:head# 2024-04-01T19:28:49.715 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.715 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61849599:::benchmark_data_smithi188_77607_object138316:head# 2024-04-01T19:28:49.715 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.716 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61883247:::benchmark_data_smithi188_77607_object136228:head# 2024-04-01T19:28:49.716 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.716 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61884baa:::benchmark_data_smithi188_77607_object115961:head# 2024-04-01T19:28:49.716 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.716 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:618c0429:::benchmark_data_smithi188_77607_object127386:head# 2024-04-01T19:28:49.716 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.716 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:618c45da:::benchmark_data_smithi188_77607_object110410:head# 2024-04-01T19:28:49.716 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.716 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:618d73f5:::benchmark_data_smithi188_77607_object145733:head# 2024-04-01T19:28:49.716 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.716 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:618d8060:::benchmark_data_smithi188_77607_object123431:head# 2024-04-01T19:28:49.716 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.716 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:618ffbf6:::benchmark_data_smithi188_77607_object128845:head# 2024-04-01T19:28:49.716 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.716 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61909707:::benchmark_data_smithi188_77607_object161547:head# 2024-04-01T19:28:49.717 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.717 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6190a635:::benchmark_data_smithi188_77607_object150747:head# 2024-04-01T19:28:49.717 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.721 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61924d84:::benchmark_data_smithi188_77607_object153635:head# 2024-04-01T19:28:49.721 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.721 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6193cbd0:::benchmark_data_smithi188_77607_object125367:head# 2024-04-01T19:28:49.721 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.721 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6194f236:::benchmark_data_smithi188_77607_object98993:head# 2024-04-01T19:28:49.721 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.721 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61964d7f:::benchmark_data_smithi188_77607_object117343:head# 2024-04-01T19:28:49.721 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.721 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6197b0fe:::benchmark_data_smithi188_77607_object106873:head# 2024-04-01T19:28:49.721 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.721 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:619910d5:::benchmark_data_smithi188_77607_object149783:head# 2024-04-01T19:28:49.721 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.722 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61993a2e:::benchmark_data_smithi188_77607_object98928:head# 2024-04-01T19:28:49.722 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.722 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61999431:::benchmark_data_smithi188_77607_object131248:head# 2024-04-01T19:28:49.722 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.722 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:619d52d0:::benchmark_data_smithi188_77607_object154894:head# 2024-04-01T19:28:49.722 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.722 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:619dc99a:::benchmark_data_smithi188_77607_object150304:head# 2024-04-01T19:28:49.722 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.722 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:619dc9c3:::benchmark_data_smithi188_77607_object151489:head# 2024-04-01T19:28:49.722 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.722 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:619e91e0:::benchmark_data_smithi188_77607_object115627:head# 2024-04-01T19:28:49.722 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.722 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:619efba9:::benchmark_data_smithi188_77607_object162063:head# 2024-04-01T19:28:49.723 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.723 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61a07558:::benchmark_data_smithi188_77607_object150492:head# 2024-04-01T19:28:49.723 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.723 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61a0cee1:::benchmark_data_smithi188_77607_object163986:head# 2024-04-01T19:28:49.723 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.723 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61a1dfe0:::benchmark_data_smithi188_77607_object126940:head# 2024-04-01T19:28:49.723 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.723 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61a31b96:::benchmark_data_smithi188_77607_object102471:head# 2024-04-01T19:28:49.723 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.723 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61a3f21a:::benchmark_data_smithi188_77607_object165858:head# 2024-04-01T19:28:49.723 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.723 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61a3f663:::benchmark_data_smithi188_77607_object150833:head# 2024-04-01T19:28:49.723 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.723 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61a46103:::benchmark_data_smithi188_77607_object129846:head# 2024-04-01T19:28:49.723 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.724 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61a4c902:::benchmark_data_smithi188_77607_object122905:head# 2024-04-01T19:28:49.724 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.724 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61a4cfdb:::benchmark_data_smithi188_77607_object100046:head# 2024-04-01T19:28:49.724 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.724 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61a55f69:::benchmark_data_smithi188_77607_object122780:head# 2024-04-01T19:28:49.724 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.724 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61a5df38:::benchmark_data_smithi188_77607_object166790:head# 2024-04-01T19:28:49.724 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.724 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61a64cde:::benchmark_data_smithi188_77607_object120479:head# 2024-04-01T19:28:49.724 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.724 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61a68041:::benchmark_data_smithi188_77607_object98015:head# 2024-04-01T19:28:49.724 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.724 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61a6e20e:::benchmark_data_smithi188_77607_object164701:head# 2024-04-01T19:28:49.724 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.724 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61a6f6e5:::benchmark_data_smithi188_77607_object149317:head# 2024-04-01T19:28:49.725 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.734 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61a7a248:::benchmark_data_smithi188_77607_object144664:head# 2024-04-01T19:28:49.734 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.734 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61a7abcf:::benchmark_data_smithi188_77607_object139775:head# 2024-04-01T19:28:49.734 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.734 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61a8b6a2:::benchmark_data_smithi188_77607_object146074:head# 2024-04-01T19:28:49.734 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.734 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61a927f6:::benchmark_data_smithi188_77607_object139333:head# 2024-04-01T19:28:49.734 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.734 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61aa28e9:::benchmark_data_smithi188_77607_object104585:head# 2024-04-01T19:28:49.734 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.734 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61aa599f:::benchmark_data_smithi188_77607_object99851:head# 2024-04-01T19:28:49.735 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.735 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61aa77d5:::benchmark_data_smithi188_77607_object124744:head# 2024-04-01T19:28:49.735 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.735 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61ad9fc7:::benchmark_data_smithi188_77607_object147865:head# 2024-04-01T19:28:49.735 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.735 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61aea09a:::benchmark_data_smithi188_77607_object101717:head# 2024-04-01T19:28:49.735 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.735 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61aec61c:::benchmark_data_smithi188_77607_object129469:head# 2024-04-01T19:28:49.735 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.735 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61aff7e4:::benchmark_data_smithi188_77607_object135141:head# 2024-04-01T19:28:49.735 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.735 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61b05aa1:::benchmark_data_smithi188_77607_object104807:head# 2024-04-01T19:28:49.735 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.735 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61b06147:::benchmark_data_smithi188_77607_object146455:head# 2024-04-01T19:28:49.735 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.736 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61b100cd:::benchmark_data_smithi188_77607_object165938:head# 2024-04-01T19:28:49.736 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.736 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61b24fb1:::benchmark_data_smithi188_77607_object125545:head# 2024-04-01T19:28:49.736 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.736 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61b2e697:::benchmark_data_smithi188_77607_object160788:head# 2024-04-01T19:28:49.736 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.736 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61b48de3:::benchmark_data_smithi188_77607_object105824:head# 2024-04-01T19:28:49.736 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.736 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61b4d81c:::benchmark_data_smithi188_77607_object163702:head# 2024-04-01T19:28:49.736 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.736 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61b53eef:::benchmark_data_smithi188_77607_object142800:head# 2024-04-01T19:28:49.736 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.736 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61b712da:::benchmark_data_smithi188_77607_object152836:head# 2024-04-01T19:28:49.736 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.736 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61b8179d:::benchmark_data_smithi188_77607_object117879:head# 2024-04-01T19:28:49.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61b958a0:::benchmark_data_smithi188_77607_object137919:head# 2024-04-01T19:28:49.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61b9ae21:::benchmark_data_smithi188_77607_object114665:head# 2024-04-01T19:28:49.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61baef23:::benchmark_data_smithi188_77607_object154485:head# 2024-04-01T19:28:49.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61bd275e:::benchmark_data_smithi188_77607_object118421:head# 2024-04-01T19:28:49.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61bdd77c:::benchmark_data_smithi188_77607_object129819:head# 2024-04-01T19:28:49.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61be78ba:::benchmark_data_smithi188_77607_object99907:head# 2024-04-01T19:28:49.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.738 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61bf2941:::benchmark_data_smithi188_77607_object100385:head# 2024-04-01T19:28:49.738 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.738 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61bf6d35:::benchmark_data_smithi188_77607_object152945:head# 2024-04-01T19:28:49.738 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.738 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61bfc8e5:::benchmark_data_smithi188_77607_object154638:head# 2024-04-01T19:28:49.738 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.738 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61c05e8a:::benchmark_data_smithi188_77607_object151032:head# 2024-04-01T19:28:49.738 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.738 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61c14ea8:::benchmark_data_smithi188_77607_object132536:head# 2024-04-01T19:28:49.738 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.738 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61c1610f:::benchmark_data_smithi188_77607_object154845:head# 2024-04-01T19:28:49.738 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.738 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61c1c527:::benchmark_data_smithi188_77607_object103529:head# 2024-04-01T19:28:49.738 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.739 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61c20498:::benchmark_data_smithi188_77607_object119387:head# 2024-04-01T19:28:49.739 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.739 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61c36985:::benchmark_data_smithi188_77607_object154475:head# 2024-04-01T19:28:49.739 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.739 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61c3e918:::benchmark_data_smithi188_77607_object135539:head# 2024-04-01T19:28:49.739 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.739 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61c4fcb8:::benchmark_data_smithi188_77607_object109424:head# 2024-04-01T19:28:49.739 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.739 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61c6b2f2:::benchmark_data_smithi188_77607_object104908:head# 2024-04-01T19:28:49.739 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.739 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61c7a09c:::benchmark_data_smithi188_77607_object112757:head# 2024-04-01T19:28:49.739 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.739 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61c7e357:::benchmark_data_smithi188_77607_object154022:head# 2024-04-01T19:28:49.739 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.739 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61c9ba8a:::benchmark_data_smithi188_77607_object142896:head# 2024-04-01T19:28:49.740 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.740 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61ca531a:::benchmark_data_smithi188_77607_object106565:head# 2024-04-01T19:28:49.740 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.740 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61ca7d7d:::benchmark_data_smithi188_77607_object109163:head# 2024-04-01T19:28:49.740 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.740 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61cb769d:::benchmark_data_smithi188_77607_object141035:head# 2024-04-01T19:28:49.740 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.740 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61cc38db:::benchmark_data_smithi188_77607_object109578:head# 2024-04-01T19:28:49.740 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.740 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61cc55db:::benchmark_data_smithi188_77607_object159175:head# 2024-04-01T19:28:49.740 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.740 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61ccaec6:::benchmark_data_smithi188_77607_object132390:head# 2024-04-01T19:28:49.740 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.740 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61ccb849:::benchmark_data_smithi188_77607_object162175:head# 2024-04-01T19:28:49.740 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.741 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61cda688:::benchmark_data_smithi188_77607_object132744:head# 2024-04-01T19:28:49.741 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.741 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61cdee12:::benchmark_data_smithi188_77607_object145188:head# 2024-04-01T19:28:49.741 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.741 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61ce1687:::benchmark_data_smithi188_77607_object119205:head# 2024-04-01T19:28:49.741 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.741 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61cea8a2:::benchmark_data_smithi188_77607_object111591:head# 2024-04-01T19:28:49.741 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.741 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61cebafd:::benchmark_data_smithi188_77607_object144069:head# 2024-04-01T19:28:49.741 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.741 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61d0667d:::benchmark_data_smithi188_77607_object163334:head# 2024-04-01T19:28:49.741 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.741 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61d0dea4:::benchmark_data_smithi188_77607_object153004:head# 2024-04-01T19:28:49.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61d18d66:::benchmark_data_smithi188_77607_object143819:head# 2024-04-01T19:28:49.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61d1a3bd:::benchmark_data_smithi188_77607_object145302:head# 2024-04-01T19:28:49.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.749 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61d47f09:::benchmark_data_smithi188_77607_object111132:head# 2024-04-01T19:28:49.749 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.749 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61d66a23:::benchmark_data_smithi188_77607_object122212:head# 2024-04-01T19:28:49.749 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.749 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61d783cc:::benchmark_data_smithi188_77607_object150822:head# 2024-04-01T19:28:49.749 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.749 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61d93a98:::benchmark_data_smithi188_77607_object106732:head# 2024-04-01T19:28:49.750 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.750 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61dac5fa:::benchmark_data_smithi188_77607_object145652:head# 2024-04-01T19:28:49.750 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.750 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61deee14:::benchmark_data_smithi188_77607_object160627:head# 2024-04-01T19:28:49.750 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.750 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61e3f35b:::benchmark_data_smithi188_77607_object124356:head# 2024-04-01T19:28:49.750 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.750 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61e428d2:::benchmark_data_smithi188_77607_object164405:head# 2024-04-01T19:28:49.751 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.751 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61e43b9c:::benchmark_data_smithi188_77607_object120673:head# 2024-04-01T19:28:49.751 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.751 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61e666a8:::benchmark_data_smithi188_77607_object160494:head# 2024-04-01T19:28:49.751 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.751 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61e79b73:::benchmark_data_smithi188_77607_object116270:head# 2024-04-01T19:28:49.751 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.751 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61e86ff9:::benchmark_data_smithi188_77607_object106345:head# 2024-04-01T19:28:49.752 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.752 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61eb4899:::benchmark_data_smithi188_77607_object103815:head# 2024-04-01T19:28:49.752 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.752 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61ecb116:::benchmark_data_smithi188_77607_object163002:head# 2024-04-01T19:28:49.752 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.752 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61ed9705:::benchmark_data_smithi188_77607_object106586:head# 2024-04-01T19:28:49.753 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.753 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61ef1f77:::benchmark_data_smithi188_77607_object106227:head# 2024-04-01T19:28:49.753 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.753 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61f1897f:::benchmark_data_smithi188_77607_object103613:head# 2024-04-01T19:28:49.753 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.753 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61f20591:::benchmark_data_smithi188_77607_object132960:head# 2024-04-01T19:28:49.754 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.754 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61f24277:::benchmark_data_smithi188_77607_object107324:head# 2024-04-01T19:28:49.754 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.754 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61f2cb41:::benchmark_data_smithi188_77607_object146770:head# 2024-04-01T19:28:49.754 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.754 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61f37834:::benchmark_data_smithi188_77607_object142163:head# 2024-04-01T19:28:49.755 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.755 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61f4d6cf:::benchmark_data_smithi188_77607_object97902:head# 2024-04-01T19:28:49.755 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.755 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61f76edb:::benchmark_data_smithi188_77607_object137447:head# 2024-04-01T19:28:49.755 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.755 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61f76f2a:::benchmark_data_smithi188_77607_object106598:head# 2024-04-01T19:28:49.755 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.756 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61f773f7:::benchmark_data_smithi188_77607_object133580:head# 2024-04-01T19:28:49.756 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.756 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61f94d43:::benchmark_data_smithi188_77607_object106363:head# 2024-04-01T19:28:49.756 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.756 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61fad017:::benchmark_data_smithi188_77607_object127423:head# 2024-04-01T19:28:49.756 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.756 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61fc4b12:::benchmark_data_smithi188_77607_object128880:head# 2024-04-01T19:28:49.756 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.757 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61fd2e4f:::benchmark_data_smithi188_77607_object112755:head# 2024-04-01T19:28:49.757 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.757 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61fe3947:::benchmark_data_smithi188_77607_object130580:head# 2024-04-01T19:28:49.757 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.757 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61ff4a0c:::benchmark_data_smithi188_77607_object131679:head# 2024-04-01T19:28:49.757 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.757 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:61ff8f5a:::benchmark_data_smithi188_77607_object122482:head# 2024-04-01T19:28:49.757 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.758 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6200ab9c:::benchmark_data_smithi188_77607_object111416:head# 2024-04-01T19:28:49.758 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.758 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:620112a7:::benchmark_data_smithi188_77607_object97812:head# 2024-04-01T19:28:49.758 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.758 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:620249c1:::benchmark_data_smithi188_77607_object131693:head# 2024-04-01T19:28:49.761 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.761 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6202c382:::benchmark_data_smithi188_77607_object161550:head# 2024-04-01T19:28:49.761 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.762 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6203c4fb:::benchmark_data_smithi188_77607_object132821:head# 2024-04-01T19:28:49.762 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.762 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:620439d8:::benchmark_data_smithi188_77607_object149257:head# 2024-04-01T19:28:49.762 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.762 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6204b118:::benchmark_data_smithi188_77607_object128625:head# 2024-04-01T19:28:49.762 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.763 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6207bd45:::benchmark_data_smithi188_77607_object106802:head# 2024-04-01T19:28:49.763 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.763 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6207dbe7:::benchmark_data_smithi188_77607_object142197:head# 2024-04-01T19:28:49.763 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.763 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62092e74:::benchmark_data_smithi188_77607_object113611:head# 2024-04-01T19:28:49.763 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.763 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6209786d:::benchmark_data_smithi188_77607_object161036:head# 2024-04-01T19:28:49.763 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.763 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:620a3bed:::benchmark_data_smithi188_77607_object125939:head# 2024-04-01T19:28:49.763 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.763 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:620a43e8:::benchmark_data_smithi188_77607_object117720:head# 2024-04-01T19:28:49.763 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.764 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:620c10c1:::benchmark_data_smithi188_77607_object128947:head# 2024-04-01T19:28:49.764 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.764 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:620d309f:::benchmark_data_smithi188_77607_object107051:head# 2024-04-01T19:28:49.764 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.764 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:620ea0ae:::benchmark_data_smithi188_77607_object125026:head# 2024-04-01T19:28:49.764 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.771 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:28:49.782 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:620ee636:::benchmark_data_smithi188_77607_object138149:head# 2024-04-01T19:28:49.782 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.782 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:620fbf0b:::benchmark_data_smithi188_77607_object116743:head# 2024-04-01T19:28:49.782 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.782 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62123cc4:::benchmark_data_smithi188_77607_object98285:head# 2024-04-01T19:28:49.782 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.783 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6212459f:::benchmark_data_smithi188_77607_object153339:head# 2024-04-01T19:28:49.783 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.783 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62125688:::benchmark_data_smithi188_77607_object165385:head# 2024-04-01T19:28:49.783 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.783 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:621257d1:::benchmark_data_smithi188_77607_object142152:head# 2024-04-01T19:28:49.783 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.783 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:621274f2:::benchmark_data_smithi188_77607_object122584:head# 2024-04-01T19:28:49.783 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.783 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6212ba57:::benchmark_data_smithi188_77607_object101262:head# 2024-04-01T19:28:49.783 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.783 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6215f365:::benchmark_data_smithi188_77607_object119666:head# 2024-04-01T19:28:49.783 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.783 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6215f634:::benchmark_data_smithi188_77607_object126625:head# 2024-04-01T19:28:49.783 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.784 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:621688da:::benchmark_data_smithi188_77607_object108709:head# 2024-04-01T19:28:49.784 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.784 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6216b631:::benchmark_data_smithi188_77607_object129978:head# 2024-04-01T19:28:49.784 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.784 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6219f54c:::benchmark_data_smithi188_77607_object157217:head# 2024-04-01T19:28:49.784 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.784 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:621a3d6c:::benchmark_data_smithi188_77607_object148293:head# 2024-04-01T19:28:49.784 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.784 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:621a4def:::benchmark_data_smithi188_77607_object98678:head# 2024-04-01T19:28:49.784 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.784 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:621bf221:::benchmark_data_smithi188_77607_object123468:head# 2024-04-01T19:28:49.784 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.784 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:621c7998:::benchmark_data_smithi188_77607_object116498:head# 2024-04-01T19:28:49.784 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.785 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:621cf801:::benchmark_data_smithi188_77607_object156576:head# 2024-04-01T19:28:49.785 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.785 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:621ea119:::benchmark_data_smithi188_77607_object111577:head# 2024-04-01T19:28:49.785 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.785 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:622029a1:::benchmark_data_smithi188_77607_object108165:head# 2024-04-01T19:28:49.785 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.785 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6220f5c9:::benchmark_data_smithi188_77607_object106308:head# 2024-04-01T19:28:49.785 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.785 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6221d4d6:::benchmark_data_smithi188_77607_object130899:head# 2024-04-01T19:28:49.785 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.785 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6222048a:::benchmark_data_smithi188_77607_object97950:head# 2024-04-01T19:28:49.785 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.785 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:622302a5:::benchmark_data_smithi188_77607_object102782:head# 2024-04-01T19:28:49.786 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.786 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62232f61:::benchmark_data_smithi188_77607_object137635:head# 2024-04-01T19:28:49.786 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.786 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62256bd6:::benchmark_data_smithi188_77607_object99595:head# 2024-04-01T19:28:49.786 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.786 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62265e20:::benchmark_data_smithi188_77607_object161322:head# 2024-04-01T19:28:49.786 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.786 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62271595:::benchmark_data_smithi188_77607_object140821:head# 2024-04-01T19:28:49.786 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.786 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:622745cb:::benchmark_data_smithi188_77607_object149426:head# 2024-04-01T19:28:49.786 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.786 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62278d87:::benchmark_data_smithi188_77607_object159277:head# 2024-04-01T19:28:49.787 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.787 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62294b53:::benchmark_data_smithi188_77607_object108811:head# 2024-04-01T19:28:49.787 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.787 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6229af54:::benchmark_data_smithi188_77607_object150878:head# 2024-04-01T19:28:49.787 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.787 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:622a3a60:::benchmark_data_smithi188_77607_object99175:head# 2024-04-01T19:28:49.787 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.787 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:622c1be6:::benchmark_data_smithi188_77607_object110563:head# 2024-04-01T19:28:49.787 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.787 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:622c3765:::benchmark_data_smithi188_77607_object143097:head# 2024-04-01T19:28:49.787 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.787 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:622cc712:::benchmark_data_smithi188_77607_object146250:head# 2024-04-01T19:28:49.787 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.788 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62314a4c:::benchmark_data_smithi188_77607_object121607:head# 2024-04-01T19:28:49.788 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.788 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6231b9e9:::benchmark_data_smithi188_77607_object108367:head# 2024-04-01T19:28:49.788 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.788 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62326cb8:::benchmark_data_smithi188_77607_object133647:head# 2024-04-01T19:28:49.788 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.788 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62336013:::benchmark_data_smithi188_77607_object111382:head# 2024-04-01T19:28:49.788 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.788 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62361aea:::benchmark_data_smithi188_77607_object136258:head# 2024-04-01T19:28:49.788 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.788 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:623622a3:::benchmark_data_smithi188_77607_object132914:head# 2024-04-01T19:28:49.788 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.788 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6238a79e:::benchmark_data_smithi188_77607_object167387:head# 2024-04-01T19:28:49.789 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.789 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6238ada6:::benchmark_data_smithi188_77607_object102514:head# 2024-04-01T19:28:49.789 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.789 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:623a516c:::benchmark_data_smithi188_77607_object104514:head# 2024-04-01T19:28:49.789 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.789 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:623a58d7:::benchmark_data_smithi188_77607_object155423:head# 2024-04-01T19:28:49.789 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.789 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:623bb996:::benchmark_data_smithi188_77607_object145448:head# 2024-04-01T19:28:49.789 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.789 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:623ca125:::benchmark_data_smithi188_77607_object110222:head# 2024-04-01T19:28:49.789 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.789 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:623cf03e:::benchmark_data_smithi188_77607_object134929:head# 2024-04-01T19:28:49.789 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.789 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:623eead5:::benchmark_data_smithi188_77607_object164817:head# 2024-04-01T19:28:49.790 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.790 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:623f996d:::benchmark_data_smithi188_77607_object166542:head# 2024-04-01T19:28:49.790 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.790 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62410c1a:::benchmark_data_smithi188_77607_object154439:head# 2024-04-01T19:28:49.790 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.790 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6242edf1:::benchmark_data_smithi188_77607_object125454:head# 2024-04-01T19:28:49.790 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.790 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:624317fd:::benchmark_data_smithi188_77607_object138799:head# 2024-04-01T19:28:49.790 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.790 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62440a53:::benchmark_data_smithi188_77607_object115392:head# 2024-04-01T19:28:49.790 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.790 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62442e97:::benchmark_data_smithi188_77607_object151590:head# 2024-04-01T19:28:49.790 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.791 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62447a0d:::benchmark_data_smithi188_77607_object118147:head# 2024-04-01T19:28:49.791 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.791 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62473677:::benchmark_data_smithi188_77607_object143613:head# 2024-04-01T19:28:49.791 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.791 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:624759cf:::benchmark_data_smithi188_77607_object103083:head# 2024-04-01T19:28:49.791 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.791 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6247f0d6:::benchmark_data_smithi188_77607_object123626:head# 2024-04-01T19:28:49.791 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.791 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:624a9e27:::benchmark_data_smithi188_77607_object155245:head# 2024-04-01T19:28:49.791 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.791 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:624abf04:::benchmark_data_smithi188_77607_object145743:head# 2024-04-01T19:28:49.791 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.792 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:624acc33:::benchmark_data_smithi188_77607_object132584:head# 2024-04-01T19:28:49.792 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.792 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:624bbc02:::benchmark_data_smithi188_77607_object165037:head# 2024-04-01T19:28:49.792 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.792 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:624bc493:::benchmark_data_smithi188_77607_object138266:head# 2024-04-01T19:28:49.792 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.792 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:624c1ad8:::benchmark_data_smithi188_77607_object120191:head# 2024-04-01T19:28:49.792 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.793 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:624fc7f6:::benchmark_data_smithi188_77607_object145183:head# 2024-04-01T19:28:49.793 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.793 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:624fc9c8:::benchmark_data_smithi188_77607_object165968:head# 2024-04-01T19:28:49.793 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.793 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62503ea1:::benchmark_data_smithi188_77607_object145803:head# 2024-04-01T19:28:49.793 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.793 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62508ec7:::benchmark_data_smithi188_77607_object118748:head# 2024-04-01T19:28:49.793 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.793 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6250ee3a:::benchmark_data_smithi188_77607_object131272:head# 2024-04-01T19:28:49.794 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.794 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:625245d8:::benchmark_data_smithi188_77607_object117957:head# 2024-04-01T19:28:49.794 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.794 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62534b24:::benchmark_data_smithi188_77607_object108580:head# 2024-04-01T19:28:49.794 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.794 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6253dde8:::benchmark_data_smithi188_77607_object146662:head# 2024-04-01T19:28:49.794 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.794 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6254006f:::benchmark_data_smithi188_77607_object110331:head# 2024-04-01T19:28:49.795 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.795 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:625430d3:::benchmark_data_smithi188_77607_object129131:head# 2024-04-01T19:28:49.795 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.795 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62551978:::benchmark_data_smithi188_77607_object130036:head# 2024-04-01T19:28:49.795 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.795 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:625828bb:::benchmark_data_smithi188_77607_object149295:head# 2024-04-01T19:28:49.795 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.795 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62598f51:::benchmark_data_smithi188_77607_object163697:head# 2024-04-01T19:28:49.796 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.796 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6259aa9d:::benchmark_data_smithi188_77607_object141636:head# 2024-04-01T19:28:49.796 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.796 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:625a28dd:::benchmark_data_smithi188_77607_object106943:head# 2024-04-01T19:28:49.796 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.796 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:625c2fbe:::benchmark_data_smithi188_77607_object143994:head# 2024-04-01T19:28:49.796 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.796 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:625e903a:::benchmark_data_smithi188_77607_object154277:head# 2024-04-01T19:28:49.797 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.797 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:625ea061:::benchmark_data_smithi188_77607_object162433:head# 2024-04-01T19:28:49.797 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.797 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:625f614d:::benchmark_data_smithi188_77607_object146160:head# 2024-04-01T19:28:49.797 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.797 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62605473:::benchmark_data_smithi188_77607_object103495:head# 2024-04-01T19:28:49.797 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.797 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62609265:::benchmark_data_smithi188_77607_object133826:head# 2024-04-01T19:28:49.797 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.798 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6261c800:::benchmark_data_smithi188_77607_object119870:head# 2024-04-01T19:28:49.798 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.798 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62626a50:::benchmark_data_smithi188_77607_object167002:head# 2024-04-01T19:28:49.798 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.798 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62628a78:::benchmark_data_smithi188_77607_object161658:head# 2024-04-01T19:28:49.798 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.798 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6262abd4:::benchmark_data_smithi188_77607_object135139:head# 2024-04-01T19:28:49.798 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.799 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62637f60:::benchmark_data_smithi188_77607_object165755:head# 2024-04-01T19:28:49.799 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.799 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6264c2c4:::benchmark_data_smithi188_77607_object144934:head# 2024-04-01T19:28:49.799 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.799 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62653d12:::benchmark_data_smithi188_77607_object98187:head# 2024-04-01T19:28:49.799 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.799 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62658c6a:::benchmark_data_smithi188_77607_object99771:head# 2024-04-01T19:28:49.799 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.799 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62677ed0:::benchmark_data_smithi188_77607_object143334:head# 2024-04-01T19:28:49.800 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.800 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62681a78:::benchmark_data_smithi188_77607_object163652:head# 2024-04-01T19:28:49.800 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.800 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6268ce0e:::benchmark_data_smithi188_77607_object108448:head# 2024-04-01T19:28:49.800 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.800 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6268ef22:::benchmark_data_smithi188_77607_object99048:head# 2024-04-01T19:28:49.800 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.800 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:626a5f25:::benchmark_data_smithi188_77607_object140112:head# 2024-04-01T19:28:49.801 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.801 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:626a6cf7:::benchmark_data_smithi188_77607_object124698:head# 2024-04-01T19:28:49.801 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.801 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:626b6564:::benchmark_data_smithi188_77607_object100287:head# 2024-04-01T19:28:49.801 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.801 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:626bb462:::benchmark_data_smithi188_77607_object137240:head# 2024-04-01T19:28:49.801 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.801 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:626bd1d9:::benchmark_data_smithi188_77607_object115626:head# 2024-04-01T19:28:49.801 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.802 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:626c0355:::benchmark_data_smithi188_77607_object134495:head# 2024-04-01T19:28:49.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.802 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:626cae44:::benchmark_data_smithi188_77607_object100993:head# 2024-04-01T19:28:49.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.802 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:626ceb6f:::benchmark_data_smithi188_77607_object119507:head# 2024-04-01T19:28:49.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.802 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:626e6dba:::benchmark_data_smithi188_77607_object147570:head# 2024-04-01T19:28:49.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.803 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:626f29eb:::benchmark_data_smithi188_77607_object163448:head# 2024-04-01T19:28:49.803 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.803 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:626f2e36:::benchmark_data_smithi188_77607_object99109:head# 2024-04-01T19:28:49.803 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.803 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:627065e7:::benchmark_data_smithi188_77607_object126681:head# 2024-04-01T19:28:49.803 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.803 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62709747:::benchmark_data_smithi188_77607_object116306:head# 2024-04-01T19:28:49.803 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.803 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6270d34a:::benchmark_data_smithi188_77607_object132989:head# 2024-04-01T19:28:49.804 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.804 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:627166a1:::benchmark_data_smithi188_77607_object118833:head# 2024-04-01T19:28:49.804 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.804 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:627184ec:::benchmark_data_smithi188_77607_object111764:head# 2024-04-01T19:28:49.804 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.807 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:28:49.810 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6271de5a:::benchmark_data_smithi188_77607_object121833:head# 2024-04-01T19:28:49.810 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.810 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62724176:::benchmark_data_smithi188_77607_object136079:head# 2024-04-01T19:28:49.810 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.810 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6272ef50:::benchmark_data_smithi188_77607_object156328:head# 2024-04-01T19:28:49.810 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.810 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6273404f:::benchmark_data_smithi188_77607_object136712:head# 2024-04-01T19:28:49.810 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.811 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6273cf42:::benchmark_data_smithi188_77607_object135135:head# 2024-04-01T19:28:49.811 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.811 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6275622a:::benchmark_data_smithi188_77607_object141371:head# 2024-04-01T19:28:49.811 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.811 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62769da7:::benchmark_data_smithi188_77607_object164720:head# 2024-04-01T19:28:49.811 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.811 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6276ba66:::benchmark_data_smithi188_77607_object156081:head# 2024-04-01T19:28:49.811 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.811 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6277407f:::benchmark_data_smithi188_77607_object103332:head# 2024-04-01T19:28:49.811 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.811 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6277a43f:::benchmark_data_smithi188_77607_object163695:head# 2024-04-01T19:28:49.811 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.811 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6278eb4b:::benchmark_data_smithi188_77607_object121637:head# 2024-04-01T19:28:49.811 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.812 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:627937dc:::benchmark_data_smithi188_77607_object118649:head# 2024-04-01T19:28:49.812 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.812 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:627a4825:::benchmark_data_smithi188_77607_object106400:head# 2024-04-01T19:28:49.812 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.812 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:627c1123:::benchmark_data_smithi188_77607_object100331:head# 2024-04-01T19:28:49.812 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.812 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:627ef984:::benchmark_data_smithi188_77607_object130355:head# 2024-04-01T19:28:49.812 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.812 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6280377d:::benchmark_data_smithi188_77607_object160737:head# 2024-04-01T19:28:49.812 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.812 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62811f38:::benchmark_data_smithi188_77607_object102263:head# 2024-04-01T19:28:49.812 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.812 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62826863:::benchmark_data_smithi188_77607_object108350:head# 2024-04-01T19:28:49.812 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.812 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62847082:::benchmark_data_smithi188_77607_object124971:head# 2024-04-01T19:28:49.813 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.813 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:628750f6:::benchmark_data_smithi188_77607_object107597:head# 2024-04-01T19:28:49.813 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.813 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6287a519:::benchmark_data_smithi188_77607_object145770:head# 2024-04-01T19:28:49.813 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.813 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6288d764:::benchmark_data_smithi188_77607_object130233:head# 2024-04-01T19:28:49.813 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.813 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:628b55e4:::benchmark_data_smithi188_77607_object101263:head# 2024-04-01T19:28:49.813 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.813 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:628bbdf8:::benchmark_data_smithi188_77607_object129952:head# 2024-04-01T19:28:49.813 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.813 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:628c5e8d:::benchmark_data_smithi188_77607_object161328:head# 2024-04-01T19:28:49.813 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.813 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62918023:::benchmark_data_smithi188_77607_object152265:head# 2024-04-01T19:28:49.814 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.814 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6294694a:::benchmark_data_smithi188_77607_object102733:head# 2024-04-01T19:28:49.814 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.814 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:629499ba:::benchmark_data_smithi188_77607_object130752:head# 2024-04-01T19:28:49.814 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.814 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6294dd74:::benchmark_data_smithi188_77607_object138828:head# 2024-04-01T19:28:49.814 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.814 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:629518cd:::benchmark_data_smithi188_77607_object155860:head# 2024-04-01T19:28:49.814 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.814 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62964d99:::benchmark_data_smithi188_77607_object110066:head# 2024-04-01T19:28:49.814 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.814 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6297b5c3:::benchmark_data_smithi188_77607_object111479:head# 2024-04-01T19:28:49.814 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.814 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62986d98:::benchmark_data_smithi188_77607_object122322:head# 2024-04-01T19:28:49.814 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.815 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:629870f1:::benchmark_data_smithi188_77607_object154968:head# 2024-04-01T19:28:49.815 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.815 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6299ab89:::benchmark_data_smithi188_77607_object119479:head# 2024-04-01T19:28:49.815 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.815 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:629b5d0b:::benchmark_data_smithi188_77607_object133131:head# 2024-04-01T19:28:49.815 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.815 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:629c9f2b:::benchmark_data_smithi188_77607_object130613:head# 2024-04-01T19:28:49.815 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.815 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:629cdbf9:::benchmark_data_smithi188_77607_object103085:head# 2024-04-01T19:28:49.815 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.815 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:629e9099:::benchmark_data_smithi188_77607_object161180:head# 2024-04-01T19:28:49.815 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.815 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:629eec32:::benchmark_data_smithi188_77607_object135613:head# 2024-04-01T19:28:49.815 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.816 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:629f33e3:::benchmark_data_smithi188_77607_object99716:head# 2024-04-01T19:28:49.816 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.816 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62a1942b:::benchmark_data_smithi188_77607_object114403:head# 2024-04-01T19:28:49.816 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.816 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62a213e0:::benchmark_data_smithi188_77607_object154736:head# 2024-04-01T19:28:49.816 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.816 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62a44d29:::benchmark_data_smithi188_77607_object129257:head# 2024-04-01T19:28:49.816 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.816 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62a52f09:::benchmark_data_smithi188_77607_object147562:head# 2024-04-01T19:28:49.816 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.816 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62a5bd65:::benchmark_data_smithi188_77607_object130676:head# 2024-04-01T19:28:49.816 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.816 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62a660e8:::benchmark_data_smithi188_77607_object102953:head# 2024-04-01T19:28:49.816 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.817 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62a6df79:::benchmark_data_smithi188_77607_object147601:head# 2024-04-01T19:28:49.817 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.817 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62a70cdf:::benchmark_data_smithi188_77607_object111130:head# 2024-04-01T19:28:49.817 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.817 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62a89388:::benchmark_data_smithi188_77607_object100521:head# 2024-04-01T19:28:49.817 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.817 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62abc87a:::benchmark_data_smithi188_77607_object117592:head# 2024-04-01T19:28:49.817 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.817 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62ac3e75:::benchmark_data_smithi188_77607_object147240:head# 2024-04-01T19:28:49.817 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.817 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62ac818b:::benchmark_data_smithi188_77607_object111354:head# 2024-04-01T19:28:49.817 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.818 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62ae1ddf:::benchmark_data_smithi188_77607_object118908:head# 2024-04-01T19:28:49.818 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.818 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62af382e:::benchmark_data_smithi188_77607_object133440:head# 2024-04-01T19:28:49.818 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.818 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62afe033:::benchmark_data_smithi188_77607_object163603:head# 2024-04-01T19:28:49.819 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.819 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62b085cd:::benchmark_data_smithi188_77607_object154069:head# 2024-04-01T19:28:49.819 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.819 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62b2eee6:::benchmark_data_smithi188_77607_object167327:head# 2024-04-01T19:28:49.819 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.819 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:49.821 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62b33547:::benchmark_data_smithi188_77607_object107659:head# 2024-04-01T19:28:49.821 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.821 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62b448ca:::benchmark_data_smithi188_77607_object158688:head# 2024-04-01T19:28:49.821 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.821 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62b4ad7c:::benchmark_data_smithi188_77607_object144163:head# 2024-04-01T19:28:49.821 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.821 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62b5259c:::benchmark_data_smithi188_77607_object109973:head# 2024-04-01T19:28:49.821 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.821 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62b87ea2:::benchmark_data_smithi188_77607_object137538:head# 2024-04-01T19:28:49.821 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.821 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62b96d43:::benchmark_data_smithi188_77607_object126555:head# 2024-04-01T19:28:49.821 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.821 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62b9d838:::benchmark_data_smithi188_77607_object155248:head# 2024-04-01T19:28:49.821 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.822 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62ba20a0:::benchmark_data_smithi188_77607_object111713:head# 2024-04-01T19:28:49.822 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.822 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62bc8b53:::benchmark_data_smithi188_77607_object144220:head# 2024-04-01T19:28:49.822 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.822 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62bf1941:::benchmark_data_smithi188_77607_object138590:head# 2024-04-01T19:28:49.822 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.822 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62bf9312:::benchmark_data_smithi188_77607_object121974:head# 2024-04-01T19:28:49.822 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.822 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62c22c1d:::benchmark_data_smithi188_77607_object121425:head# 2024-04-01T19:28:49.822 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.822 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62c292dc:::benchmark_data_smithi188_77607_object145289:head# 2024-04-01T19:28:49.822 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.822 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62c3de0c:::benchmark_data_smithi188_77607_object145893:head# 2024-04-01T19:28:49.822 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.825 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62c4416d:::benchmark_data_smithi188_77607_object109580:head# 2024-04-01T19:28:49.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62c444e7:::benchmark_data_smithi188_77607_object161106:head# 2024-04-01T19:28:49.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62c486c3:::benchmark_data_smithi188_77607_object114147:head# 2024-04-01T19:28:49.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62c6200a:::benchmark_data_smithi188_77607_object132531:head# 2024-04-01T19:28:49.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62c712cb:::benchmark_data_smithi188_77607_object148532:head# 2024-04-01T19:28:49.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62c7b95a:::benchmark_data_smithi188_77607_object104966:head# 2024-04-01T19:28:49.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62c80c1d:::benchmark_data_smithi188_77607_object136422:head# 2024-04-01T19:28:49.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62c8b31f:::benchmark_data_smithi188_77607_object114724:head# 2024-04-01T19:28:49.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.827 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62c98957:::benchmark_data_smithi188_77607_object145367:head# 2024-04-01T19:28:49.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.827 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62c9a08b:::benchmark_data_smithi188_77607_object98933:head# 2024-04-01T19:28:49.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.827 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62c9fd3e:::benchmark_data_smithi188_77607_object145773:head# 2024-04-01T19:28:49.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.827 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62cb0631:::benchmark_data_smithi188_77607_object164521:head# 2024-04-01T19:28:49.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.827 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62cb1a97:::benchmark_data_smithi188_77607_object114504:head# 2024-04-01T19:28:49.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.827 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62ccb191:::benchmark_data_smithi188_77607_object141554:head# 2024-04-01T19:28:49.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.827 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62cd30d9:::benchmark_data_smithi188_77607_object151097:head# 2024-04-01T19:28:49.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.828 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62cd67e5:::benchmark_data_smithi188_77607_object121600:head# 2024-04-01T19:28:49.828 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.828 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62ce51af:::benchmark_data_smithi188_77607_object159470:head# 2024-04-01T19:28:49.828 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.828 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62d1df6a:::benchmark_data_smithi188_77607_object117721:head# 2024-04-01T19:28:49.828 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.828 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62d32e44:::benchmark_data_smithi188_77607_object104238:head# 2024-04-01T19:28:49.828 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62d3576b:::benchmark_data_smithi188_77607_object147263:head# 2024-04-01T19:28:49.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62d41965:::benchmark_data_smithi188_77607_object135058:head# 2024-04-01T19:28:49.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62d510ee:::benchmark_data_smithi188_77607_object157078:head# 2024-04-01T19:28:49.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62d65be0:::benchmark_data_smithi188_77607_object102783:head# 2024-04-01T19:28:49.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62d66689:::benchmark_data_smithi188_77607_object143626:head# 2024-04-01T19:28:49.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62d7253d:::benchmark_data_smithi188_77607_object114003:head# 2024-04-01T19:28:49.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62d7a39f:::benchmark_data_smithi188_77607_object103088:head# 2024-04-01T19:28:49.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62d7aaab:::benchmark_data_smithi188_77607_object158434:head# 2024-04-01T19:28:49.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62d855f1:::benchmark_data_smithi188_77607_object141644:head# 2024-04-01T19:28:49.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62d9d1a4:::benchmark_data_smithi188_77607_object115152:head# 2024-04-01T19:28:49.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62da1694:::benchmark_data_smithi188_77607_object130594:head# 2024-04-01T19:28:49.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62da9598:::benchmark_data_smithi188_77607_object128214:head# 2024-04-01T19:28:49.832 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.832 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62db7921:::benchmark_data_smithi188_77607_object152659:head# 2024-04-01T19:28:49.832 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.832 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62dbe75e:::benchmark_data_smithi188_77607_object143720:head# 2024-04-01T19:28:49.832 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.832 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62de068c:::benchmark_data_smithi188_77607_object113170:head# 2024-04-01T19:28:49.832 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.833 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62de57a7:::benchmark_data_smithi188_77607_object102241:head# 2024-04-01T19:28:49.833 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.833 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62e0094a:::benchmark_data_smithi188_77607_object109406:head# 2024-04-01T19:28:49.833 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.833 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62e00c52:::benchmark_data_smithi188_77607_object102051:head# 2024-04-01T19:28:49.833 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.833 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62e0b426:::benchmark_data_smithi188_77607_object147241:head# 2024-04-01T19:28:49.833 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.834 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:28:49.838 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62e0b6bd:::benchmark_data_smithi188_77607_object129054:head# 2024-04-01T19:28:49.838 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.838 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62e2d0c3:::benchmark_data_smithi188_77607_object148879:head# 2024-04-01T19:28:49.838 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.839 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62e35e65:::benchmark_data_smithi188_77607_object139861:head# 2024-04-01T19:28:49.839 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.839 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62e3a39b:::benchmark_data_smithi188_77607_object153829:head# 2024-04-01T19:28:49.839 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.839 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62e421a2:::benchmark_data_smithi188_77607_object119409:head# 2024-04-01T19:28:49.839 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.839 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62e4a1ac:::benchmark_data_smithi188_77607_object112244:head# 2024-04-01T19:28:49.839 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.843 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62e67539:::benchmark_data_smithi188_77607_object99487:head# 2024-04-01T19:28:49.843 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.843 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62e7781c:::benchmark_data_smithi188_77607_object109266:head# 2024-04-01T19:28:49.843 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.843 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62e95b00:::benchmark_data_smithi188_77607_object129729:head# 2024-04-01T19:28:49.844 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.844 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62e98834:::benchmark_data_smithi188_77607_object123062:head# 2024-04-01T19:28:49.844 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.844 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62e9bc3d:::benchmark_data_smithi188_77607_object133576:head# 2024-04-01T19:28:49.844 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.844 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62e9d41d:::benchmark_data_smithi188_77607_object144390:head# 2024-04-01T19:28:49.844 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:28:49.844 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.845 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62ebb02e:::benchmark_data_smithi188_77607_object106766:head# 2024-04-01T19:28:49.845 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.845 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62ec2f53:::benchmark_data_smithi188_77607_object150444:head# 2024-04-01T19:28:49.845 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.845 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62eda8ab:::benchmark_data_smithi188_77607_object137725:head# 2024-04-01T19:28:49.845 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.845 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62edbd97:::benchmark_data_smithi188_77607_object159948:head# 2024-04-01T19:28:49.845 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.845 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62edcd99:::benchmark_data_smithi188_77607_object143783:head# 2024-04-01T19:28:49.845 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.845 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62eec292:::benchmark_data_smithi188_77607_object156855:head# 2024-04-01T19:28:49.845 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.846 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62f145ee:::benchmark_data_smithi188_77607_object121088:head# 2024-04-01T19:28:49.846 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.846 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62f239f6:::benchmark_data_smithi188_77607_object141823:head# 2024-04-01T19:28:49.846 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.846 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62f26bb6:::benchmark_data_smithi188_77607_object138338:head# 2024-04-01T19:28:49.846 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.846 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62f38423:::benchmark_data_smithi188_77607_object165273:head# 2024-04-01T19:28:49.846 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.847 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62f6ef5f:::benchmark_data_smithi188_77607_object161524:head# 2024-04-01T19:28:49.847 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.847 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62f77712:::benchmark_data_smithi188_77607_object128824:head# 2024-04-01T19:28:49.847 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.847 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62f7cec0:::benchmark_data_smithi188_77607_object129339:head# 2024-04-01T19:28:49.847 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.847 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62f82396:::benchmark_data_smithi188_77607_object136053:head# 2024-04-01T19:28:49.847 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.847 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62f82665:::benchmark_data_smithi188_77607_object98271:head# 2024-04-01T19:28:49.847 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.847 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62f96d27:::benchmark_data_smithi188_77607_object130317:head# 2024-04-01T19:28:49.847 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.847 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62faccf5:::benchmark_data_smithi188_77607_object98460:head# 2024-04-01T19:28:49.847 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.848 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:49.848 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:28:49.849 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62fb770f:::benchmark_data_smithi188_77607_object104421:head# 2024-04-01T19:28:49.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62fd7e5f:::benchmark_data_smithi188_77607_object103552:head# 2024-04-01T19:28:49.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62fe6b95:::benchmark_data_smithi188_77607_object117700:head# 2024-04-01T19:28:49.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:62ff7e25:::benchmark_data_smithi188_77607_object113980:head# 2024-04-01T19:28:49.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6302756c:::benchmark_data_smithi188_77607_object130743:head# 2024-04-01T19:28:49.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6303412d:::benchmark_data_smithi188_77607_object165206:head# 2024-04-01T19:28:49.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63036614:::benchmark_data_smithi188_77607_object139647:head# 2024-04-01T19:28:49.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6303e6c0:::benchmark_data_smithi188_77607_object147301:head# 2024-04-01T19:28:49.851 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.851 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63043440:::benchmark_data_smithi188_77607_object163368:head# 2024-04-01T19:28:49.851 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.851 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6304f7ec:::benchmark_data_smithi188_77607_object128664:head# 2024-04-01T19:28:49.851 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.854 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6305d07b:::benchmark_data_smithi188_77607_object138984:head# 2024-04-01T19:28:49.854 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.854 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6306cc2e:::benchmark_data_smithi188_77607_object111444:head# 2024-04-01T19:28:49.854 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.854 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6308fa71:::benchmark_data_smithi188_77607_object162957:head# 2024-04-01T19:28:49.854 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.854 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6309a16a:::benchmark_data_smithi188_77607_object148189:head# 2024-04-01T19:28:49.854 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.854 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:630a3c3a:::benchmark_data_smithi188_77607_object105919:head# 2024-04-01T19:28:49.854 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.854 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:630c6baa:::benchmark_data_smithi188_77607_object125335:head# 2024-04-01T19:28:49.854 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.854 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:630d24e7:::benchmark_data_smithi188_77607_object163554:head# 2024-04-01T19:28:49.855 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:630eeb87:::benchmark_data_smithi188_77607_object112836:head# 2024-04-01T19:28:49.855 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6310483f:::benchmark_data_smithi188_77607_object128650:head# 2024-04-01T19:28:49.855 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:631130f0:::benchmark_data_smithi188_77607_object122527:head# 2024-04-01T19:28:49.855 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6311fcc0:::benchmark_data_smithi188_77607_object159105:head# 2024-04-01T19:28:49.855 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6312d693:::benchmark_data_smithi188_77607_object127238:head# 2024-04-01T19:28:49.855 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:631411d6:::benchmark_data_smithi188_77607_object110916:head# 2024-04-01T19:28:49.855 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6315cace:::benchmark_data_smithi188_77607_object116287:head# 2024-04-01T19:28:49.855 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63160c39:::benchmark_data_smithi188_77607_object129222:head# 2024-04-01T19:28:49.856 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.856 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6317aedb:::benchmark_data_smithi188_77607_object147018:head# 2024-04-01T19:28:49.856 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.856 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6318efad:::benchmark_data_smithi188_77607_object138589:head# 2024-04-01T19:28:49.856 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.858 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:631ae200:::benchmark_data_smithi188_77607_object155332:head# 2024-04-01T19:28:49.858 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.858 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:631b2b96:::benchmark_data_smithi188_77607_object106924:head# 2024-04-01T19:28:49.858 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.858 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:631d820d:::benchmark_data_smithi188_77607_object165002:head# 2024-04-01T19:28:49.858 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.858 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:631f6302:::benchmark_data_smithi188_77607_object162922:head# 2024-04-01T19:28:49.859 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.859 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6320153f:::benchmark_data_smithi188_77607_object107536:head# 2024-04-01T19:28:49.859 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.859 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63208374:::benchmark_data_smithi188_77607_object133994:head# 2024-04-01T19:28:49.859 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.859 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6322a3b4:::benchmark_data_smithi188_77607_object120406:head# 2024-04-01T19:28:49.859 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.859 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63249f0c:::benchmark_data_smithi188_77607_object120519:head# 2024-04-01T19:28:49.859 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.859 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6328702d:::benchmark_data_smithi188_77607_object157805:head# 2024-04-01T19:28:49.859 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.859 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6328edf5:::benchmark_data_smithi188_77607_object107207:head# 2024-04-01T19:28:49.859 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.859 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:632cb688:::benchmark_data_smithi188_77607_object157989:head# 2024-04-01T19:28:49.859 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.860 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:632cb9f0:::benchmark_data_smithi188_77607_object148680:head# 2024-04-01T19:28:49.860 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.860 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:632d02f8:::benchmark_data_smithi188_77607_object155553:head# 2024-04-01T19:28:49.860 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.860 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:632d933c:::benchmark_data_smithi188_77607_object100699:head# 2024-04-01T19:28:49.860 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.860 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6330336a:::benchmark_data_smithi188_77607_object159173:head# 2024-04-01T19:28:49.860 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.860 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6330579f:::benchmark_data_smithi188_77607_object138721:head# 2024-04-01T19:28:49.860 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.860 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6330c57a:::benchmark_data_smithi188_77607_object108977:head# 2024-04-01T19:28:49.860 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.860 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6331351f:::benchmark_data_smithi188_77607_object108581:head# 2024-04-01T19:28:49.860 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.862 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6331c273:::benchmark_data_smithi188_77607_object117811:head# 2024-04-01T19:28:49.862 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.862 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63331013:::benchmark_data_smithi188_77607_object117262:head# 2024-04-01T19:28:49.862 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.863 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6333af62:::benchmark_data_smithi188_77607_object106680:head# 2024-04-01T19:28:49.863 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.863 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6334e7e9:::benchmark_data_smithi188_77607_object112937:head# 2024-04-01T19:28:49.863 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.863 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6335e947:::benchmark_data_smithi188_77607_object144606:head# 2024-04-01T19:28:49.863 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63379fa2:::benchmark_data_smithi188_77607_object143172:head# 2024-04-01T19:28:49.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63386b1d:::benchmark_data_smithi188_77607_object126535:head# 2024-04-01T19:28:49.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6339fee1:::benchmark_data_smithi188_77607_object104865:head# 2024-04-01T19:28:49.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:633a1a1f:::benchmark_data_smithi188_77607_object160745:head# 2024-04-01T19:28:49.865 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.865 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:633a2419:::benchmark_data_smithi188_77607_object123151:head# 2024-04-01T19:28:49.865 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.866 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:633a987d:::benchmark_data_smithi188_77607_object145355:head# 2024-04-01T19:28:49.866 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.866 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:633aa00b:::benchmark_data_smithi188_77607_object149779:head# 2024-04-01T19:28:49.866 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.866 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:633ab459:::benchmark_data_smithi188_77607_object114059:head# 2024-04-01T19:28:49.866 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.867 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:633be31c:::benchmark_data_smithi188_77607_object144544:head# 2024-04-01T19:28:49.867 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.867 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:633d600d:::benchmark_data_smithi188_77607_object136637:head# 2024-04-01T19:28:49.867 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.867 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:633e67c6:::benchmark_data_smithi188_77607_object141824:head# 2024-04-01T19:28:49.867 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.867 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:633fb1e5:::benchmark_data_smithi188_77607_object124574:head# 2024-04-01T19:28:49.867 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.867 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6340c26c:::benchmark_data_smithi188_77607_object104484:head# 2024-04-01T19:28:49.867 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63424d4a:::benchmark_data_smithi188_77607_object129198:head# 2024-04-01T19:28:49.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6343a67f:::benchmark_data_smithi188_77607_object100349:head# 2024-04-01T19:28:49.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63448231:::benchmark_data_smithi188_77607_object166439:head# 2024-04-01T19:28:49.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.870 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63452907:::benchmark_data_smithi188_77607_object163205:head# 2024-04-01T19:28:49.870 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.870 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63462b62:::benchmark_data_smithi188_77607_object114498:head# 2024-04-01T19:28:49.870 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.870 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63463996:::benchmark_data_smithi188_77607_object166086:head# 2024-04-01T19:28:49.870 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.870 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6348383e:::benchmark_data_smithi188_77607_object131262:head# 2024-04-01T19:28:49.870 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.870 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63483932:::benchmark_data_smithi188_77607_object148075:head# 2024-04-01T19:28:49.870 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.870 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63491d34:::benchmark_data_smithi188_77607_object154559:head# 2024-04-01T19:28:49.870 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.870 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63493579:::benchmark_data_smithi188_77607_object98091:head# 2024-04-01T19:28:49.870 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.870 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:634b7c2c:::benchmark_data_smithi188_77607_object115195:head# 2024-04-01T19:28:49.871 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.871 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:634bb2db:::benchmark_data_smithi188_77607_object138571:head# 2024-04-01T19:28:49.871 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.871 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:28:49.873 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:634d1317:::benchmark_data_smithi188_77607_object146433:head# 2024-04-01T19:28:49.873 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.873 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:634d24f3:::benchmark_data_smithi188_77607_object100464:head# 2024-04-01T19:28:49.873 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.873 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:634ebeeb:::benchmark_data_smithi188_77607_object104760:head# 2024-04-01T19:28:49.873 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.874 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:634f8a81:::benchmark_data_smithi188_77607_object156765:head# 2024-04-01T19:28:49.874 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.874 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63505962:::benchmark_data_smithi188_77607_object165788:head# 2024-04-01T19:28:49.874 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.874 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63549817:::benchmark_data_smithi188_77607_object110422:head# 2024-04-01T19:28:49.874 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.874 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6355105b:::benchmark_data_smithi188_77607_object113355:head# 2024-04-01T19:28:49.874 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.874 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6356ba20:::benchmark_data_smithi188_77607_object157660:head# 2024-04-01T19:28:49.874 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.874 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63576e92:::benchmark_data_smithi188_77607_object97886:head# 2024-04-01T19:28:49.874 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.874 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:635800c4:::benchmark_data_smithi188_77607_object103551:head# 2024-04-01T19:28:49.874 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.874 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63582880:::benchmark_data_smithi188_77607_object148522:head# 2024-04-01T19:28:49.874 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.875 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6359595a:::benchmark_data_smithi188_77607_object101100:head# 2024-04-01T19:28:49.875 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.875 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63597f37:::benchmark_data_smithi188_77607_object154343:head# 2024-04-01T19:28:49.875 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.875 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6359a574:::benchmark_data_smithi188_77607_object125676:head# 2024-04-01T19:28:49.875 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.875 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:635acd2b:::benchmark_data_smithi188_77607_object135909:head# 2024-04-01T19:28:49.875 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.875 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:635b140e:::benchmark_data_smithi188_77607_object113324:head# 2024-04-01T19:28:49.875 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.880 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:635b4c98:::benchmark_data_smithi188_77607_object118362:head# 2024-04-01T19:28:49.880 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.880 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:635e207e:::benchmark_data_smithi188_77607_object99382:head# 2024-04-01T19:28:49.880 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.880 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:635f1fd6:::benchmark_data_smithi188_77607_object98809:head# 2024-04-01T19:28:49.880 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63621cd8:::benchmark_data_smithi188_77607_object110187:head# 2024-04-01T19:28:49.881 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63639976:::benchmark_data_smithi188_77607_object99061:head# 2024-04-01T19:28:49.881 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6363f018:::benchmark_data_smithi188_77607_object154138:head# 2024-04-01T19:28:49.881 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63660e60:::benchmark_data_smithi188_77607_object138489:head# 2024-04-01T19:28:49.881 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:636720a7:::benchmark_data_smithi188_77607_object121017:head# 2024-04-01T19:28:49.881 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6367b241:::benchmark_data_smithi188_77607_object125348:head# 2024-04-01T19:28:49.881 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6368b785:::benchmark_data_smithi188_77607_object113421:head# 2024-04-01T19:28:49.881 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:636a3134:::benchmark_data_smithi188_77607_object156726:head# 2024-04-01T19:28:49.882 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.882 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:636a3424:::benchmark_data_smithi188_77607_object108394:head# 2024-04-01T19:28:49.882 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.882 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:636a6405:::benchmark_data_smithi188_77607_object155323:head# 2024-04-01T19:28:49.882 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.882 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:636dc0bd:::benchmark_data_smithi188_77607_object111289:head# 2024-04-01T19:28:49.882 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.882 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:636e5da5:::benchmark_data_smithi188_77607_object159232:head# 2024-04-01T19:28:49.882 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.882 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:636eeb0c:::benchmark_data_smithi188_77607_object127972:head# 2024-04-01T19:28:49.882 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.882 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:636f0c90:::benchmark_data_smithi188_77607_object126587:head# 2024-04-01T19:28:49.882 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.882 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63702f24:::benchmark_data_smithi188_77607_object151578:head# 2024-04-01T19:28:49.883 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.883 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6370bc9c:::benchmark_data_smithi188_77607_object153772:head# 2024-04-01T19:28:49.883 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.883 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6371f90b:::benchmark_data_smithi188_77607_object115936:head# 2024-04-01T19:28:49.883 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.883 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63731823:::benchmark_data_smithi188_77607_object107593:head# 2024-04-01T19:28:49.883 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.883 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6373b30e:::benchmark_data_smithi188_77607_object165935:head# 2024-04-01T19:28:49.883 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.883 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6375a30e:::benchmark_data_smithi188_77607_object126198:head# 2024-04-01T19:28:49.883 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.883 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63777a9a:::benchmark_data_smithi188_77607_object148615:head# 2024-04-01T19:28:49.883 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.884 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6378e97d:::benchmark_data_smithi188_77607_object101306:head# 2024-04-01T19:28:49.884 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.884 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6379acdb:::benchmark_data_smithi188_77607_object128520:head# 2024-04-01T19:28:49.884 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.884 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:637b0601:::benchmark_data_smithi188_77607_object129995:head# 2024-04-01T19:28:49.884 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.884 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:637d811f:::benchmark_data_smithi188_77607_object103110:head# 2024-04-01T19:28:49.885 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.885 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:637e65b6:::benchmark_data_smithi188_77607_object128708:head# 2024-04-01T19:28:49.885 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.885 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:637e6dd0:::benchmark_data_smithi188_77607_object98780:head# 2024-04-01T19:28:49.885 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.895 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:637f0dac:::benchmark_data_smithi188_77607_object130412:head# 2024-04-01T19:28:49.895 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.895 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:637f6d02:::benchmark_data_smithi188_77607_object116341:head# 2024-04-01T19:28:49.895 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.895 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6381d0c1:::benchmark_data_smithi188_77607_object148186:head# 2024-04-01T19:28:49.895 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.895 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63821429:::benchmark_data_smithi188_77607_object115547:head# 2024-04-01T19:28:49.895 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.895 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63836df0:::benchmark_data_smithi188_77607_object99028:head# 2024-04-01T19:28:49.895 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.895 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:638386cb:::benchmark_data_smithi188_77607_object108590:head# 2024-04-01T19:28:49.895 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.896 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6383efed:::benchmark_data_smithi188_77607_object157113:head# 2024-04-01T19:28:49.896 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.896 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6384429a:::benchmark_data_smithi188_77607_object135974:head# 2024-04-01T19:28:49.896 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.896 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6385d9cf:::benchmark_data_smithi188_77607_object159497:head# 2024-04-01T19:28:49.896 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.896 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:638691b6:::benchmark_data_smithi188_77607_object116640:head# 2024-04-01T19:28:49.896 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.896 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6387e3d7:::benchmark_data_smithi188_77607_object106808:head# 2024-04-01T19:28:49.896 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.896 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63895c56:::benchmark_data_smithi188_77607_object116294:head# 2024-04-01T19:28:49.896 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.896 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6389b7fc:::benchmark_data_smithi188_77607_object163025:head# 2024-04-01T19:28:49.896 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.897 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:638b5b3c:::benchmark_data_smithi188_77607_object109439:head# 2024-04-01T19:28:49.897 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.897 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:638bf847:::benchmark_data_smithi188_77607_object140322:head# 2024-04-01T19:28:49.897 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.897 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:638d9820:::benchmark_data_smithi188_77607_object133015:head# 2024-04-01T19:28:49.897 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.897 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:638da134:::benchmark_data_smithi188_77607_object108030:head# 2024-04-01T19:28:49.897 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.897 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:638dd3eb:::benchmark_data_smithi188_77607_object150475:head# 2024-04-01T19:28:49.897 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.897 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:638e51e6:::benchmark_data_smithi188_77607_object147693:head# 2024-04-01T19:28:49.897 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.897 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:638e7fe1:::benchmark_data_smithi188_77607_object118531:head# 2024-04-01T19:28:49.897 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.898 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:638f031b:::benchmark_data_smithi188_77607_object114636:head# 2024-04-01T19:28:49.898 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.898 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63921440:::benchmark_data_smithi188_77607_object126759:head# 2024-04-01T19:28:49.898 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.898 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6392c67f:::benchmark_data_smithi188_77607_object105236:head# 2024-04-01T19:28:49.898 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.898 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63943ccd:::benchmark_data_smithi188_77607_object114457:head# 2024-04-01T19:28:49.898 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.898 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63976798:::benchmark_data_smithi188_77607_object136412:head# 2024-04-01T19:28:49.898 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.898 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6399de8b:::benchmark_data_smithi188_77607_object100131:head# 2024-04-01T19:28:49.898 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.898 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:639a6cb2:::benchmark_data_smithi188_77607_object110239:head# 2024-04-01T19:28:49.899 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.899 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:639bb4cd:::benchmark_data_smithi188_77607_object157163:head# 2024-04-01T19:28:49.899 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.899 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:639c56e5:::benchmark_data_smithi188_77607_object107834:head# 2024-04-01T19:28:49.899 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.899 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:639dd129:::benchmark_data_smithi188_77607_object149394:head# 2024-04-01T19:28:49.899 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.899 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:639f1ec3:::benchmark_data_smithi188_77607_object152773:head# 2024-04-01T19:28:49.899 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.899 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63a08815:::benchmark_data_smithi188_77607_object154847:head# 2024-04-01T19:28:49.899 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.899 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63a21c75:::benchmark_data_smithi188_77607_object143897:head# 2024-04-01T19:28:49.899 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.899 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63a2b9ca:::benchmark_data_smithi188_77607_object144526:head# 2024-04-01T19:28:49.900 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.900 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63a2ba3d:::benchmark_data_smithi188_77607_object164106:head# 2024-04-01T19:28:49.900 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.900 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63a2f418:::benchmark_data_smithi188_77607_object161907:head# 2024-04-01T19:28:49.900 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.900 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63a4b92e:::benchmark_data_smithi188_77607_object147675:head# 2024-04-01T19:28:49.900 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.900 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63a5096e:::benchmark_data_smithi188_77607_object155748:head# 2024-04-01T19:28:49.900 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.900 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63a553ee:::benchmark_data_smithi188_77607_object101194:head# 2024-04-01T19:28:49.900 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.900 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63a5da3f:::benchmark_data_smithi188_77607_object121310:head# 2024-04-01T19:28:49.900 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.900 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63a67af4:::benchmark_data_smithi188_77607_object141171:head# 2024-04-01T19:28:49.900 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63a68c36:::benchmark_data_smithi188_77607_object145248:head# 2024-04-01T19:28:49.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63a6e896:::benchmark_data_smithi188_77607_object138496:head# 2024-04-01T19:28:49.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63a74be4:::benchmark_data_smithi188_77607_object157492:head# 2024-04-01T19:28:49.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63a7982a:::benchmark_data_smithi188_77607_object121481:head# 2024-04-01T19:28:49.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63a7aeed:::benchmark_data_smithi188_77607_object107767:head# 2024-04-01T19:28:49.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63a8f39a:::benchmark_data_smithi188_77607_object104407:head# 2024-04-01T19:28:49.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63a98c84:::benchmark_data_smithi188_77607_object127225:head# 2024-04-01T19:28:49.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63ab6cb2:::benchmark_data_smithi188_77607_object148599:head# 2024-04-01T19:28:49.902 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.902 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63ad302f:::benchmark_data_smithi188_77607_object139412:head# 2024-04-01T19:28:49.902 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.902 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63adb8d7:::benchmark_data_smithi188_77607_object162472:head# 2024-04-01T19:28:49.902 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.902 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63aec7e7:::benchmark_data_smithi188_77607_object100022:head# 2024-04-01T19:28:49.902 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.902 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63af73bc:::benchmark_data_smithi188_77607_object147953:head# 2024-04-01T19:28:49.902 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.902 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63afe8a0:::benchmark_data_smithi188_77607_object104787:head# 2024-04-01T19:28:49.902 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.902 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63b14653:::benchmark_data_smithi188_77607_object166653:head# 2024-04-01T19:28:49.902 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.902 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63b25ac3:::benchmark_data_smithi188_77607_object111837:head# 2024-04-01T19:28:49.903 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.903 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63b2d148:::benchmark_data_smithi188_77607_object130749:head# 2024-04-01T19:28:49.903 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.903 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63b2d63d:::benchmark_data_smithi188_77607_object100098:head# 2024-04-01T19:28:49.903 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.903 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63b30add:::benchmark_data_smithi188_77607_object99121:head# 2024-04-01T19:28:49.903 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.903 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63b47e78:::benchmark_data_smithi188_77607_object145441:head# 2024-04-01T19:28:49.903 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.903 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63b4d721:::benchmark_data_smithi188_77607_object133539:head# 2024-04-01T19:28:49.903 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.912 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63b4e999:::benchmark_data_smithi188_77607_object100436:head# 2024-04-01T19:28:49.912 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.913 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63b53a2f:::benchmark_data_smithi188_77607_object127522:head# 2024-04-01T19:28:49.913 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.913 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63b58b80:::benchmark_data_smithi188_77607_object151349:head# 2024-04-01T19:28:49.913 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.913 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63b63529:::benchmark_data_smithi188_77607_object119276:head# 2024-04-01T19:28:49.913 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.913 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63b64c09:::benchmark_data_smithi188_77607_object135145:head# 2024-04-01T19:28:49.913 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.913 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63b6e3a3:::benchmark_data_smithi188_77607_object125345:head# 2024-04-01T19:28:49.913 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.913 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63b99db5:::benchmark_data_smithi188_77607_object135819:head# 2024-04-01T19:28:49.913 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.913 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63b99f24:::benchmark_data_smithi188_77607_object149938:head# 2024-04-01T19:28:49.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.914 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63bb2459:::benchmark_data_smithi188_77607_object151269:head# 2024-04-01T19:28:49.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.914 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63bca623:::benchmark_data_smithi188_77607_object115282:head# 2024-04-01T19:28:49.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.914 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63bd18ad:::benchmark_data_smithi188_77607_object135159:head# 2024-04-01T19:28:49.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.914 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63bd20ee:::benchmark_data_smithi188_77607_object98504:head# 2024-04-01T19:28:49.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.914 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63bd567f:::benchmark_data_smithi188_77607_object132441:head# 2024-04-01T19:28:49.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.914 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63bdb242:::benchmark_data_smithi188_77607_object98025:head# 2024-04-01T19:28:49.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.915 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63bdb6de:::benchmark_data_smithi188_77607_object99745:head# 2024-04-01T19:28:49.915 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.915 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63bee865:::benchmark_data_smithi188_77607_object126230:head# 2024-04-01T19:28:49.915 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.915 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63c0506d:::benchmark_data_smithi188_77607_object98312:head# 2024-04-01T19:28:49.915 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.915 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63c09811:::benchmark_data_smithi188_77607_object167264:head# 2024-04-01T19:28:49.915 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.915 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63c19cca:::benchmark_data_smithi188_77607_object151380:head# 2024-04-01T19:28:49.915 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.915 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63c2cdd6:::benchmark_data_smithi188_77607_object145904:head# 2024-04-01T19:28:49.915 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.915 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63c34905:::benchmark_data_smithi188_77607_object122175:head# 2024-04-01T19:28:49.915 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.916 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63c65753:::benchmark_data_smithi188_77607_object127628:head# 2024-04-01T19:28:49.916 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.916 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63c67d97:::benchmark_data_smithi188_77607_object148026:head# 2024-04-01T19:28:49.916 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.916 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63c75dc9:::benchmark_data_smithi188_77607_object111691:head# 2024-04-01T19:28:49.916 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.916 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63c7dc6a:::benchmark_data_smithi188_77607_object132195:head# 2024-04-01T19:28:49.916 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.916 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63c82a31:::benchmark_data_smithi188_77607_object128677:head# 2024-04-01T19:28:49.916 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.916 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63c89ea3:::benchmark_data_smithi188_77607_object99246:head# 2024-04-01T19:28:49.916 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.916 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63c95947:::benchmark_data_smithi188_77607_object107015:head# 2024-04-01T19:28:49.916 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.917 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63c96c19:::benchmark_data_smithi188_77607_object164360:head# 2024-04-01T19:28:49.917 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.917 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63c9ca9c:::benchmark_data_smithi188_77607_object156945:head# 2024-04-01T19:28:49.917 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.917 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63c9d6e4:::benchmark_data_smithi188_77607_object159167:head# 2024-04-01T19:28:49.917 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.917 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63ca1447:::benchmark_data_smithi188_77607_object142587:head# 2024-04-01T19:28:49.917 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.917 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63cbd9a6:::benchmark_data_smithi188_77607_object116375:head# 2024-04-01T19:28:49.917 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.917 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63cc621c:::benchmark_data_smithi188_77607_object111601:head# 2024-04-01T19:28:49.917 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.917 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63cd4dfc:::benchmark_data_smithi188_77607_object154844:head# 2024-04-01T19:28:49.917 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.917 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63cdf696:::benchmark_data_smithi188_77607_object140983:head# 2024-04-01T19:28:49.918 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.918 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63cfc69c:::benchmark_data_smithi188_77607_object150885:head# 2024-04-01T19:28:49.918 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.918 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63d08365:::benchmark_data_smithi188_77607_object141280:head# 2024-04-01T19:28:49.918 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.918 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63d0968b:::benchmark_data_smithi188_77607_object141387:head# 2024-04-01T19:28:49.918 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.918 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63d20553:::benchmark_data_smithi188_77607_object138991:head# 2024-04-01T19:28:49.918 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.918 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63d34e56:::benchmark_data_smithi188_77607_object153788:head# 2024-04-01T19:28:49.918 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.918 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63d3a21e:::benchmark_data_smithi188_77607_object134845:head# 2024-04-01T19:28:49.918 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.918 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63d56dc6:::benchmark_data_smithi188_77607_object150611:head# 2024-04-01T19:28:49.919 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.919 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63d58ffa:::benchmark_data_smithi188_77607_object165636:head# 2024-04-01T19:28:49.919 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.919 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63d5cf13:::benchmark_data_smithi188_77607_object123798:head# 2024-04-01T19:28:49.919 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.919 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63d6994e:::benchmark_data_smithi188_77607_object123774:head# 2024-04-01T19:28:49.919 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.919 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63d6aa72:::benchmark_data_smithi188_77607_object106486:head# 2024-04-01T19:28:49.919 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.919 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63d719c7:::benchmark_data_smithi188_77607_object152749:head# 2024-04-01T19:28:49.919 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.919 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63d75fe7:::benchmark_data_smithi188_77607_object162208:head# 2024-04-01T19:28:49.919 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.919 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63d81a05:::benchmark_data_smithi188_77607_object143404:head# 2024-04-01T19:28:49.919 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.920 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63d83a94:::benchmark_data_smithi188_77607_object158720:head# 2024-04-01T19:28:49.920 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.920 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63d8d408:::benchmark_data_smithi188_77607_object136425:head# 2024-04-01T19:28:49.920 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.920 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63da9c3b:::benchmark_data_smithi188_77607_object100376:head# 2024-04-01T19:28:49.920 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.920 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63db61db:::benchmark_data_smithi188_77607_object150405:head# 2024-04-01T19:28:49.920 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.920 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63dc592b:::benchmark_data_smithi188_77607_object110737:head# 2024-04-01T19:28:49.920 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.920 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63dd0786:::benchmark_data_smithi188_77607_object137239:head# 2024-04-01T19:28:49.920 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.920 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63dd33c0:::benchmark_data_smithi188_77607_object113386:head# 2024-04-01T19:28:49.920 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.920 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63dd6a81:::benchmark_data_smithi188_77607_object151085:head# 2024-04-01T19:28:49.921 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.921 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63de58ef:::benchmark_data_smithi188_77607_object149272:head# 2024-04-01T19:28:49.921 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.921 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63de7378:::benchmark_data_smithi188_77607_object115170:head# 2024-04-01T19:28:49.921 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.921 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63de8fdb:::benchmark_data_smithi188_77607_object99527:head# 2024-04-01T19:28:49.921 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.921 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63deecf2:::benchmark_data_smithi188_77607_object126817:head# 2024-04-01T19:28:49.921 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.921 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63df8e23:::benchmark_data_smithi188_77607_object120619:head# 2024-04-01T19:28:49.921 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.921 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63e05048:::benchmark_data_smithi188_77607_object123382:head# 2024-04-01T19:28:49.921 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.931 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63e1a128:::benchmark_data_smithi188_77607_object133150:head# 2024-04-01T19:28:49.931 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.931 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63e1aa05:::benchmark_data_smithi188_77607_object152320:head# 2024-04-01T19:28:49.931 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.931 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63e275e0:::benchmark_data_smithi188_77607_object145285:head# 2024-04-01T19:28:49.931 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.931 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63e3c3e3:::benchmark_data_smithi188_77607_object157654:head# 2024-04-01T19:28:49.931 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.932 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63e42940:::benchmark_data_smithi188_77607_object133421:head# 2024-04-01T19:28:49.932 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.932 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63e452f3:::benchmark_data_smithi188_77607_object158747:head# 2024-04-01T19:28:49.932 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.932 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63e50039:::benchmark_data_smithi188_77607_object148820:head# 2024-04-01T19:28:49.932 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.932 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63e5153c:::benchmark_data_smithi188_77607_object161242:head# 2024-04-01T19:28:49.932 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.932 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63e8b2a1:::benchmark_data_smithi188_77607_object106121:head# 2024-04-01T19:28:49.932 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.932 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63e95787:::benchmark_data_smithi188_77607_object164125:head# 2024-04-01T19:28:49.932 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.932 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63e9e8ca:::benchmark_data_smithi188_77607_object134822:head# 2024-04-01T19:28:49.933 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.933 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63eb6c0d:::benchmark_data_smithi188_77607_object154534:head# 2024-04-01T19:28:49.933 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.933 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63eb7ee9:::benchmark_data_smithi188_77607_object136175:head# 2024-04-01T19:28:49.933 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.933 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63eef1be:::benchmark_data_smithi188_77607_object150429:head# 2024-04-01T19:28:49.933 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.933 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63ef3643:::benchmark_data_smithi188_77607_object99416:head# 2024-04-01T19:28:49.933 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.933 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63ef6fd3:::benchmark_data_smithi188_77607_object152504:head# 2024-04-01T19:28:49.933 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.933 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63efefb7:::benchmark_data_smithi188_77607_object153312:head# 2024-04-01T19:28:49.933 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.933 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63f100a0:::benchmark_data_smithi188_77607_object117337:head# 2024-04-01T19:28:49.934 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.934 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63f14a47:::benchmark_data_smithi188_77607_object102483:head# 2024-04-01T19:28:49.934 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.934 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63f18b74:::benchmark_data_smithi188_77607_object161515:head# 2024-04-01T19:28:49.934 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.934 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63f32c51:::benchmark_data_smithi188_77607_object108439:head# 2024-04-01T19:28:49.934 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.934 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63f4ba21:::benchmark_data_smithi188_77607_object152142:head# 2024-04-01T19:28:49.934 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.934 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63f53077:::benchmark_data_smithi188_77607_object166255:head# 2024-04-01T19:28:49.934 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.934 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63f8e7e7:::benchmark_data_smithi188_77607_object130995:head# 2024-04-01T19:28:49.934 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.935 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63fa544d:::benchmark_data_smithi188_77607_object110299:head# 2024-04-01T19:28:49.935 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.935 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63fc2846:::benchmark_data_smithi188_77607_object113153:head# 2024-04-01T19:28:49.935 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.935 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63fc517d:::benchmark_data_smithi188_77607_object98392:head# 2024-04-01T19:28:49.935 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.935 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63fccf38:::benchmark_data_smithi188_77607_object134278:head# 2024-04-01T19:28:49.935 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.935 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63fe9116:::benchmark_data_smithi188_77607_object132700:head# 2024-04-01T19:28:49.935 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.935 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:63ff6f71:::benchmark_data_smithi188_77607_object151396:head# 2024-04-01T19:28:49.935 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.935 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64004b99:::benchmark_data_smithi188_77607_object119734:head# 2024-04-01T19:28:49.935 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.936 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6401fe7e:::benchmark_data_smithi188_77607_object114236:head# 2024-04-01T19:28:49.936 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.936 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64036a9e:::benchmark_data_smithi188_77607_object160972:head# 2024-04-01T19:28:49.936 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.936 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:640616ca:::benchmark_data_smithi188_77607_object130953:head# 2024-04-01T19:28:49.936 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.936 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64062fcd:::benchmark_data_smithi188_77607_object101983:head# 2024-04-01T19:28:49.936 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.936 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64063a15:::benchmark_data_smithi188_77607_object138578:head# 2024-04-01T19:28:49.936 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.936 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:640699e3:::benchmark_data_smithi188_77607_object116058:head# 2024-04-01T19:28:49.936 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.936 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6407bb54:::benchmark_data_smithi188_77607_object120848:head# 2024-04-01T19:28:49.936 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.937 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6407c36f:::benchmark_data_smithi188_77607_object158903:head# 2024-04-01T19:28:49.937 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.937 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64091032:::benchmark_data_smithi188_77607_object103905:head# 2024-04-01T19:28:49.937 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.937 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:640b7ccb:::benchmark_data_smithi188_77607_object101324:head# 2024-04-01T19:28:49.937 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.937 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:640bc6e8:::benchmark_data_smithi188_77607_object104113:head# 2024-04-01T19:28:49.937 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.937 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:640bc6f3:::benchmark_data_smithi188_77607_object153011:head# 2024-04-01T19:28:49.937 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.937 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:640d9e7a:::benchmark_data_smithi188_77607_object124156:head# 2024-04-01T19:28:49.937 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.937 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:640dac08:::benchmark_data_smithi188_77607_object147673:head# 2024-04-01T19:28:49.937 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.937 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:640e878b:::benchmark_data_smithi188_77607_object129737:head# 2024-04-01T19:28:49.938 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.938 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:640f21af:::benchmark_data_smithi188_77607_object133742:head# 2024-04-01T19:28:49.938 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.938 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:640f7289:::benchmark_data_smithi188_77607_object99788:head# 2024-04-01T19:28:49.938 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.938 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:640f7896:::benchmark_data_smithi188_77607_object159589:head# 2024-04-01T19:28:49.938 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.938 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:640faf07:::benchmark_data_smithi188_77607_object146833:head# 2024-04-01T19:28:49.938 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.938 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:640fde8d:::benchmark_data_smithi188_77607_object105686:head# 2024-04-01T19:28:49.938 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.938 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:641125b5:::benchmark_data_smithi188_77607_object117590:head# 2024-04-01T19:28:49.938 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.939 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64127e67:::benchmark_data_smithi188_77607_object103485:head# 2024-04-01T19:28:49.939 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.939 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:641358df:::benchmark_data_smithi188_77607_object119133:head# 2024-04-01T19:28:49.939 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.939 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:641439fb:::benchmark_data_smithi188_77607_object152150:head# 2024-04-01T19:28:49.939 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.939 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64152117:::benchmark_data_smithi188_77607_object117803:head# 2024-04-01T19:28:49.939 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.939 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:641620c2:::benchmark_data_smithi188_77607_object135573:head# 2024-04-01T19:28:49.939 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.939 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64164f61:::benchmark_data_smithi188_77607_object159018:head# 2024-04-01T19:28:49.939 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.939 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6416fc7a:::benchmark_data_smithi188_77607_object100087:head# 2024-04-01T19:28:49.939 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.939 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:641bbafd:::benchmark_data_smithi188_77607_object161696:head# 2024-04-01T19:28:49.940 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.940 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:641f646e:::benchmark_data_smithi188_77607_object111779:head# 2024-04-01T19:28:49.940 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.940 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64207122:::benchmark_data_smithi188_77607_object122984:head# 2024-04-01T19:28:49.940 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.940 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64218eea:::benchmark_data_smithi188_77607_object130113:head# 2024-04-01T19:28:49.940 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.940 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6421fa1f:::benchmark_data_smithi188_77607_object113314:head# 2024-04-01T19:28:49.940 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.940 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6422db73:::benchmark_data_smithi188_77607_object102777:head# 2024-04-01T19:28:49.940 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.940 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6424fa91:::benchmark_data_smithi188_77607_object98979:head# 2024-04-01T19:28:49.940 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.941 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:28:49.945 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6425fa5d:::benchmark_data_smithi188_77607_object137537:head# 2024-04-01T19:28:49.945 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.945 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64271bb2:::benchmark_data_smithi188_77607_object154015:head# 2024-04-01T19:28:49.945 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.945 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6427c192:::benchmark_data_smithi188_77607_object108250:head# 2024-04-01T19:28:49.946 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.946 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:642808d9:::benchmark_data_smithi188_77607_object162567:head# 2024-04-01T19:28:49.946 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.946 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6428aada:::benchmark_data_smithi188_77607_object115420:head# 2024-04-01T19:28:49.946 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.946 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6428ebfc:::benchmark_data_smithi188_77607_object134708:head# 2024-04-01T19:28:49.946 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.946 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:642bada2:::benchmark_data_smithi188_77607_object134832:head# 2024-04-01T19:28:49.946 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.946 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:642bba69:::benchmark_data_smithi188_77607_object155384:head# 2024-04-01T19:28:49.946 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.946 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:642bbd2b:::benchmark_data_smithi188_77607_object115432:head# 2024-04-01T19:28:49.946 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.946 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:642d14f4:::benchmark_data_smithi188_77607_object151954:head# 2024-04-01T19:28:49.947 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.947 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:642dece4:::benchmark_data_smithi188_77607_object157080:head# 2024-04-01T19:28:49.947 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.947 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:642f79cc:::benchmark_data_smithi188_77607_object128723:head# 2024-04-01T19:28:49.947 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.947 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64309896:::benchmark_data_smithi188_77607_object136882:head# 2024-04-01T19:28:49.947 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.947 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6431078f:::benchmark_data_smithi188_77607_object161390:head# 2024-04-01T19:28:49.947 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.947 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64317129:::benchmark_data_smithi188_77607_object147573:head# 2024-04-01T19:28:49.947 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.947 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6431777b:::benchmark_data_smithi188_77607_object131079:head# 2024-04-01T19:28:49.947 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.947 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64317c05:::benchmark_data_smithi188_77607_object125350:head# 2024-04-01T19:28:49.947 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.948 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64324760:::benchmark_data_smithi188_77607_object160221:head# 2024-04-01T19:28:49.948 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.948 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6433854e:::benchmark_data_smithi188_77607_object149030:head# 2024-04-01T19:28:49.948 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.948 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64338915:::benchmark_data_smithi188_77607_object157568:head# 2024-04-01T19:28:49.948 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.948 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6434c058:::benchmark_data_smithi188_77607_object135929:head# 2024-04-01T19:28:49.948 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.948 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:643572cd:::benchmark_data_smithi188_77607_object127358:head# 2024-04-01T19:28:49.948 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.948 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6436ebbe:::benchmark_data_smithi188_77607_object165247:head# 2024-04-01T19:28:49.948 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.948 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:643795d1:::benchmark_data_smithi188_77607_object130628:head# 2024-04-01T19:28:49.948 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.949 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64386425:::benchmark_data_smithi188_77607_object131379:head# 2024-04-01T19:28:49.949 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.949 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64386fec:::benchmark_data_smithi188_77607_object144861:head# 2024-04-01T19:28:49.949 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.949 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64388ea2:::benchmark_data_smithi188_77607_object133338:head# 2024-04-01T19:28:49.949 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.949 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:643a4bd7:::benchmark_data_smithi188_77607_object143786:head# 2024-04-01T19:28:49.949 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.949 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:643a5b41:::benchmark_data_smithi188_77607_object149404:head# 2024-04-01T19:28:49.949 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.949 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:28:49.954 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:643a6da2:::benchmark_data_smithi188_77607_object136797:head# 2024-04-01T19:28:49.954 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.954 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:643be989:::benchmark_data_smithi188_77607_object98925:head# 2024-04-01T19:28:49.954 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.954 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:643c469a:::benchmark_data_smithi188_77607_object123445:head# 2024-04-01T19:28:49.954 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.954 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:643e328e:::benchmark_data_smithi188_77607_object167072:head# 2024-04-01T19:28:49.954 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.954 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:643f4f58:::benchmark_data_smithi188_77607_object111182:head# 2024-04-01T19:28:49.954 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.954 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:643f731a:::benchmark_data_smithi188_77607_object147362:head# 2024-04-01T19:28:49.954 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.955 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64401e14:::benchmark_data_smithi188_77607_object148772:head# 2024-04-01T19:28:49.955 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.955 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:644133a2:::benchmark_data_smithi188_77607_object160026:head# 2024-04-01T19:28:49.955 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.955 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6442d206:::benchmark_data_smithi188_77607_object128385:head# 2024-04-01T19:28:49.955 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.955 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6443df34:::benchmark_data_smithi188_77607_object160064:head# 2024-04-01T19:28:49.955 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.955 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6444351e:::benchmark_data_smithi188_77607_object100903:head# 2024-04-01T19:28:49.955 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.955 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6445ea46:::benchmark_data_smithi188_77607_object119491:head# 2024-04-01T19:28:49.955 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.955 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6447a784:::benchmark_data_smithi188_77607_object114224:head# 2024-04-01T19:28:49.955 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.955 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64485672:::benchmark_data_smithi188_77607_object122037:head# 2024-04-01T19:28:49.956 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.956 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64498cab:::benchmark_data_smithi188_77607_object156149:head# 2024-04-01T19:28:49.956 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.956 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6449ab49:::benchmark_data_smithi188_77607_object143759:head# 2024-04-01T19:28:49.956 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.956 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6449ebcd:::benchmark_data_smithi188_77607_object122651:head# 2024-04-01T19:28:49.956 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.956 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:644acbe3:::benchmark_data_smithi188_77607_object164165:head# 2024-04-01T19:28:49.956 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.956 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:644b8c3f:::benchmark_data_smithi188_77607_object153435:head# 2024-04-01T19:28:49.956 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.956 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:644d15dd:::benchmark_data_smithi188_77607_object126421:head# 2024-04-01T19:28:49.956 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.956 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:644d7bf9:::benchmark_data_smithi188_77607_object156760:head# 2024-04-01T19:28:49.956 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.957 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:644d9b67:::benchmark_data_smithi188_77607_object146000:head# 2024-04-01T19:28:49.957 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.957 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:644e01ef:::benchmark_data_smithi188_77607_object123132:head# 2024-04-01T19:28:49.957 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.957 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:644eb045:::benchmark_data_smithi188_77607_object114950:head# 2024-04-01T19:28:49.957 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.957 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:644ec4cb:::benchmark_data_smithi188_77607_object140563:head# 2024-04-01T19:28:49.957 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.957 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:644fddba:::benchmark_data_smithi188_77607_object124896:head# 2024-04-01T19:28:49.957 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.957 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:644ff5a8:::benchmark_data_smithi188_77607_object139888:head# 2024-04-01T19:28:49.957 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.957 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:645080cd:::benchmark_data_smithi188_77607_object117133:head# 2024-04-01T19:28:49.957 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.957 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6451fae5:::benchmark_data_smithi188_77607_object111165:head# 2024-04-01T19:28:49.958 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.958 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64532250:::benchmark_data_smithi188_77607_object148799:head# 2024-04-01T19:28:49.958 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.958 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6454830a:::benchmark_data_smithi188_77607_object135452:head# 2024-04-01T19:28:49.958 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.958 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:645484e5:::benchmark_data_smithi188_77607_object161942:head# 2024-04-01T19:28:49.958 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.958 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6456e16d:::benchmark_data_smithi188_77607_object165829:head# 2024-04-01T19:28:49.958 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.958 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:645a74bb:::benchmark_data_smithi188_77607_object153398:head# 2024-04-01T19:28:49.958 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.958 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:645b0b5a:::benchmark_data_smithi188_77607_object166940:head# 2024-04-01T19:28:49.958 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.965 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:645ce916:::benchmark_data_smithi188_77607_object142834:head# 2024-04-01T19:28:49.965 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.965 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:645d9f3a:::benchmark_data_smithi188_77607_object161906:head# 2024-04-01T19:28:49.965 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.965 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64643010:::benchmark_data_smithi188_77607_object145837:head# 2024-04-01T19:28:49.965 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.965 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6466ef6d:::benchmark_data_smithi188_77607_object159145:head# 2024-04-01T19:28:49.965 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.965 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:646922c7:::benchmark_data_smithi188_77607_object100355:head# 2024-04-01T19:28:49.965 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.965 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:646a7ff0:::benchmark_data_smithi188_77607_object104021:head# 2024-04-01T19:28:49.965 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.965 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:646a89c9:::benchmark_data_smithi188_77607_object165849:head# 2024-04-01T19:28:49.966 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.966 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:646b9c6e:::benchmark_data_smithi188_77607_object105642:head# 2024-04-01T19:28:49.966 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.966 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:646c9946:::benchmark_data_smithi188_77607_object134700:head# 2024-04-01T19:28:49.966 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.966 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:646efc16:::benchmark_data_smithi188_77607_object129795:head# 2024-04-01T19:28:49.966 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.966 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:646f102e:::benchmark_data_smithi188_77607_object105595:head# 2024-04-01T19:28:49.966 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.966 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64704aca:::benchmark_data_smithi188_77607_object130282:head# 2024-04-01T19:28:49.966 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.966 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64707441:::benchmark_data_smithi188_77607_object122698:head# 2024-04-01T19:28:49.966 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.966 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64707486:::benchmark_data_smithi188_77607_object106914:head# 2024-04-01T19:28:49.966 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.967 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6470a465:::benchmark_data_smithi188_77607_object143017:head# 2024-04-01T19:28:49.967 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.967 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64714127:::benchmark_data_smithi188_77607_object145982:head# 2024-04-01T19:28:49.967 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.967 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6471785f:::benchmark_data_smithi188_77607_object131596:head# 2024-04-01T19:28:49.967 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.967 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:647385f9:::benchmark_data_smithi188_77607_object132918:head# 2024-04-01T19:28:49.967 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.967 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6474161e:::benchmark_data_smithi188_77607_object152639:head# 2024-04-01T19:28:49.967 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.967 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6477873b:::benchmark_data_smithi188_77607_object133073:head# 2024-04-01T19:28:49.967 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.967 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6478c6d4:::benchmark_data_smithi188_77607_object102546:head# 2024-04-01T19:28:49.967 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.967 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6478fcc4:::benchmark_data_smithi188_77607_object153725:head# 2024-04-01T19:28:49.968 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.968 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:647a989e:::benchmark_data_smithi188_77607_object111451:head# 2024-04-01T19:28:49.968 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.968 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:647d4870:::benchmark_data_smithi188_77607_object160598:head# 2024-04-01T19:28:49.968 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.968 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:647e647a:::benchmark_data_smithi188_77607_object103094:head# 2024-04-01T19:28:49.968 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.968 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:647f9044:::benchmark_data_smithi188_77607_object127212:head# 2024-04-01T19:28:49.968 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.968 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64813c44:::benchmark_data_smithi188_77607_object122638:head# 2024-04-01T19:28:49.968 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.968 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64818ab8:::benchmark_data_smithi188_77607_object166533:head# 2024-04-01T19:28:49.968 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.969 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6481e802:::benchmark_data_smithi188_77607_object125291:head# 2024-04-01T19:28:49.969 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.969 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:648294b6:::benchmark_data_smithi188_77607_object124860:head# 2024-04-01T19:28:49.969 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.969 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64837a1b:::benchmark_data_smithi188_77607_object166162:head# 2024-04-01T19:28:49.969 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.969 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64844560:::benchmark_data_smithi188_77607_object153067:head# 2024-04-01T19:28:49.969 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.969 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6484835b:::benchmark_data_smithi188_77607_object159178:head# 2024-04-01T19:28:49.969 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.969 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6485ffbd:::benchmark_data_smithi188_77607_object106009:head# 2024-04-01T19:28:49.969 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.969 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:648650e6:::benchmark_data_smithi188_77607_object136639:head# 2024-04-01T19:28:49.969 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.970 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64866601:::benchmark_data_smithi188_77607_object145515:head# 2024-04-01T19:28:49.970 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.970 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64868144:::benchmark_data_smithi188_77607_object138545:head# 2024-04-01T19:28:49.970 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.970 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64872ccc:::benchmark_data_smithi188_77607_object155743:head# 2024-04-01T19:28:49.970 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.970 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64877bff:::benchmark_data_smithi188_77607_object110580:head# 2024-04-01T19:28:49.970 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.970 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6487eb33:::benchmark_data_smithi188_77607_object141479:head# 2024-04-01T19:28:49.970 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.970 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:648864f7:::benchmark_data_smithi188_77607_object124124:head# 2024-04-01T19:28:49.970 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.970 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6488fdbf:::benchmark_data_smithi188_77607_object99679:head# 2024-04-01T19:28:49.970 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.971 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6489adf6:::benchmark_data_smithi188_77607_object101428:head# 2024-04-01T19:28:49.971 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.971 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6489d8e6:::benchmark_data_smithi188_77607_object131625:head# 2024-04-01T19:28:49.971 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.975 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:648c555e:::benchmark_data_smithi188_77607_object143230:head# 2024-04-01T19:28:49.977 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.977 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:648dcd05:::benchmark_data_smithi188_77607_object157072:head# 2024-04-01T19:28:49.977 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.978 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64901d74:::benchmark_data_smithi188_77607_object159769:head# 2024-04-01T19:28:49.978 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.978 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64906afe:::benchmark_data_smithi188_77607_object158576:head# 2024-04-01T19:28:49.978 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.978 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6492893d:::benchmark_data_smithi188_77607_object158054:head# 2024-04-01T19:28:49.978 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.978 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64929614:::benchmark_data_smithi188_77607_object104583:head# 2024-04-01T19:28:49.979 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.979 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6492da17:::benchmark_data_smithi188_77607_object124182:head# 2024-04-01T19:28:49.979 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.979 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64938367:::benchmark_data_smithi188_77607_object106759:head# 2024-04-01T19:28:49.979 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.979 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6494558d:::benchmark_data_smithi188_77607_object147862:head# 2024-04-01T19:28:49.979 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.979 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64970a25:::benchmark_data_smithi188_77607_object159044:head# 2024-04-01T19:28:49.979 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.979 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:649771ce:::benchmark_data_smithi188_77607_object166083:head# 2024-04-01T19:28:49.979 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.979 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64977515:::benchmark_data_smithi188_77607_object100224:head# 2024-04-01T19:28:49.979 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.980 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6497b516:::benchmark_data_smithi188_77607_object150937:head# 2024-04-01T19:28:49.980 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.980 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:649815f6:::benchmark_data_smithi188_77607_object161423:head# 2024-04-01T19:28:49.980 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.980 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64981b01:::benchmark_data_smithi188_77607_object156306:head# 2024-04-01T19:28:49.980 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.980 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64988372:::benchmark_data_smithi188_77607_object103825:head# 2024-04-01T19:28:49.980 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.980 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:649d4a36:::benchmark_data_smithi188_77607_object147903:head# 2024-04-01T19:28:49.980 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.980 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:649d6fe0:::benchmark_data_smithi188_77607_object140989:head# 2024-04-01T19:28:49.980 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.980 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:649f86c2:::benchmark_data_smithi188_77607_object114862:head# 2024-04-01T19:28:49.980 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.980 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64a0786e:::benchmark_data_smithi188_77607_object146969:head# 2024-04-01T19:28:49.981 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.981 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64a198d8:::benchmark_data_smithi188_77607_object130559:head# 2024-04-01T19:28:49.981 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.981 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64a1e5aa:::benchmark_data_smithi188_77607_object98582:head# 2024-04-01T19:28:49.981 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.981 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64a3c639:::benchmark_data_smithi188_77607_object109831:head# 2024-04-01T19:28:49.981 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.981 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64a4640e:::benchmark_data_smithi188_77607_object106367:head# 2024-04-01T19:28:49.981 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.981 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64a4b34e:::benchmark_data_smithi188_77607_object102239:head# 2024-04-01T19:28:49.981 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.981 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64a5f047:::benchmark_data_smithi188_77607_object115797:head# 2024-04-01T19:28:49.981 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.981 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64a893c3:::benchmark_data_smithi188_77607_object98413:head# 2024-04-01T19:28:49.982 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.982 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64a8d679:::benchmark_data_smithi188_77607_object112310:head# 2024-04-01T19:28:49.982 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.982 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64aa5de9:::benchmark_data_smithi188_77607_object152110:head# 2024-04-01T19:28:49.982 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.982 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64abca7e:::benchmark_data_smithi188_77607_object100325:head# 2024-04-01T19:28:49.982 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.983 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:28:49.986 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64aedb1c:::benchmark_data_smithi188_77607_object146059:head# 2024-04-01T19:28:49.986 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.986 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64af08c1:::benchmark_data_smithi188_77607_object165159:head# 2024-04-01T19:28:49.986 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.986 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64b01c8a:::benchmark_data_smithi188_77607_object124719:head# 2024-04-01T19:28:49.986 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.986 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64b0888c:::benchmark_data_smithi188_77607_object113387:head# 2024-04-01T19:28:49.986 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.987 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64b12978:::benchmark_data_smithi188_77607_object120313:head# 2024-04-01T19:28:49.987 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.987 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64b1e2b8:::benchmark_data_smithi188_77607_object159900:head# 2024-04-01T19:28:49.987 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.987 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64b22892:::benchmark_data_smithi188_77607_object128265:head# 2024-04-01T19:28:49.987 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.987 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64b25f15:::benchmark_data_smithi188_77607_object143292:head# 2024-04-01T19:28:49.987 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.987 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64b35094:::benchmark_data_smithi188_77607_object120964:head# 2024-04-01T19:28:49.987 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.987 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64b3fa0e:::benchmark_data_smithi188_77607_object112615:head# 2024-04-01T19:28:49.987 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.987 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64b4534a:::benchmark_data_smithi188_77607_object145086:head# 2024-04-01T19:28:49.987 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.988 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64b4933b:::benchmark_data_smithi188_77607_object103040:head# 2024-04-01T19:28:49.988 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.988 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64b49c0d:::benchmark_data_smithi188_77607_object159288:head# 2024-04-01T19:28:49.988 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.988 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64b5a1c4:::benchmark_data_smithi188_77607_object142337:head# 2024-04-01T19:28:49.988 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.988 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64b7c77a:::benchmark_data_smithi188_77607_object106398:head# 2024-04-01T19:28:49.988 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.988 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64b80344:::benchmark_data_smithi188_77607_object120767:head# 2024-04-01T19:28:49.988 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.988 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64b9b3e6:::benchmark_data_smithi188_77607_object156261:head# 2024-04-01T19:28:49.988 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.988 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64ba3028:::benchmark_data_smithi188_77607_object141047:head# 2024-04-01T19:28:49.988 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.989 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64bb601a:::benchmark_data_smithi188_77607_object126228:head# 2024-04-01T19:28:49.989 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.989 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64bb8c28:::benchmark_data_smithi188_77607_object113794:head# 2024-04-01T19:28:49.989 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.989 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64bc9488:::benchmark_data_smithi188_77607_object116092:head# 2024-04-01T19:28:49.989 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.989 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64bcac5d:::benchmark_data_smithi188_77607_object142750:head# 2024-04-01T19:28:49.989 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.989 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64bd6e0a:::benchmark_data_smithi188_77607_object153669:head# 2024-04-01T19:28:49.989 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.989 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64c0537b:::benchmark_data_smithi188_77607_object113309:head# 2024-04-01T19:28:49.989 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.989 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64c11e03:::benchmark_data_smithi188_77607_object116073:head# 2024-04-01T19:28:49.990 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.990 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64c149fa:::benchmark_data_smithi188_77607_object156848:head# 2024-04-01T19:28:49.990 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.990 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64c17e68:::benchmark_data_smithi188_77607_object140513:head# 2024-04-01T19:28:49.990 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.994 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64c2415d:::benchmark_data_smithi188_77607_object100949:head# 2024-04-01T19:28:49.994 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.994 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64c37eda:::benchmark_data_smithi188_77607_object126797:head# 2024-04-01T19:28:49.994 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.994 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64c3d3c9:::benchmark_data_smithi188_77607_object159941:head# 2024-04-01T19:28:49.994 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.994 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64c4c6c7:::benchmark_data_smithi188_77607_object127285:head# 2024-04-01T19:28:49.994 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.994 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64c4ffd8:::benchmark_data_smithi188_77607_object155762:head# 2024-04-01T19:28:49.995 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.995 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64c570a5:::benchmark_data_smithi188_77607_object129236:head# 2024-04-01T19:28:49.995 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.995 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64c5cec0:::benchmark_data_smithi188_77607_object155162:head# 2024-04-01T19:28:49.995 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.995 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64c5f098:::benchmark_data_smithi188_77607_object132693:head# 2024-04-01T19:28:49.995 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.995 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64c66708:::benchmark_data_smithi188_77607_object143033:head# 2024-04-01T19:28:49.995 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.995 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64c887c9:::benchmark_data_smithi188_77607_object134830:head# 2024-04-01T19:28:49.995 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.995 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64c95961:::benchmark_data_smithi188_77607_object143102:head# 2024-04-01T19:28:49.995 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.995 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64c9dc8e:::benchmark_data_smithi188_77607_object129597:head# 2024-04-01T19:28:49.996 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.996 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64ca2ab6:::benchmark_data_smithi188_77607_object139814:head# 2024-04-01T19:28:49.996 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.996 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64cb002a:::benchmark_data_smithi188_77607_object163165:head# 2024-04-01T19:28:49.996 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.996 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64cb7f88:::benchmark_data_smithi188_77607_object113181:head# 2024-04-01T19:28:49.996 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.996 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64cc3c90:::benchmark_data_smithi188_77607_object113677:head# 2024-04-01T19:28:49.996 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.996 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64cc823d:::benchmark_data_smithi188_77607_object103929:head# 2024-04-01T19:28:49.996 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.996 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64ccf786:::benchmark_data_smithi188_77607_object115499:head# 2024-04-01T19:28:49.996 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.996 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64cdc999:::benchmark_data_smithi188_77607_object139880:head# 2024-04-01T19:28:49.997 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.997 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64cf1c49:::benchmark_data_smithi188_77607_object130575:head# 2024-04-01T19:28:49.997 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.997 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64cf8dbf:::benchmark_data_smithi188_77607_object115809:head# 2024-04-01T19:28:49.997 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.997 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64cfb280:::benchmark_data_smithi188_77607_object114146:head# 2024-04-01T19:28:49.997 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.997 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64cfc324:::benchmark_data_smithi188_77607_object98099:head# 2024-04-01T19:28:49.997 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.997 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64d004a6:::benchmark_data_smithi188_77607_object105728:head# 2024-04-01T19:28:49.997 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.997 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64d031b0:::benchmark_data_smithi188_77607_object119655:head# 2024-04-01T19:28:49.997 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.997 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64d1f819:::benchmark_data_smithi188_77607_object99911:head# 2024-04-01T19:28:49.997 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.998 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64d30911:::benchmark_data_smithi188_77607_object163628:head# 2024-04-01T19:28:49.998 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.998 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64d39fd4:::benchmark_data_smithi188_77607_object111461:head# 2024-04-01T19:28:49.998 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.998 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64d455d4:::benchmark_data_smithi188_77607_object143924:head# 2024-04-01T19:28:49.998 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:49.998 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64d59f97:::benchmark_data_smithi188_77607_object125673:head# 2024-04-01T19:28:49.998 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.001 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64d62c0d:::benchmark_data_smithi188_77607_object146732:head# 2024-04-01T19:28:50.002 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.002 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64d86b47:::benchmark_data_smithi188_77607_object146063:head# 2024-04-01T19:28:50.002 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.002 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64d93e4c:::benchmark_data_smithi188_77607_object119532:head# 2024-04-01T19:28:50.002 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.002 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64da02b2:::benchmark_data_smithi188_77607_object119268:head# 2024-04-01T19:28:50.002 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.002 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64daa157:::benchmark_data_smithi188_77607_object119674:head# 2024-04-01T19:28:50.002 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.002 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64e18f2d:::benchmark_data_smithi188_77607_object114139:head# 2024-04-01T19:28:50.002 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.002 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64e1eec3:::benchmark_data_smithi188_77607_object133373:head# 2024-04-01T19:28:50.002 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.002 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64e287db:::benchmark_data_smithi188_77607_object138923:head# 2024-04-01T19:28:50.003 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.003 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64e40c8c:::benchmark_data_smithi188_77607_object142560:head# 2024-04-01T19:28:50.003 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.003 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64e412de:::benchmark_data_smithi188_77607_object126038:head# 2024-04-01T19:28:50.003 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.003 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64e4bdfc:::benchmark_data_smithi188_77607_object153567:head# 2024-04-01T19:28:50.003 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.003 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64e6f5ad:::benchmark_data_smithi188_77607_object122608:head# 2024-04-01T19:28:50.003 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.003 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64e77bf4:::benchmark_data_smithi188_77607_object100493:head# 2024-04-01T19:28:50.003 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.003 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64e7a1d8:::benchmark_data_smithi188_77607_object104930:head# 2024-04-01T19:28:50.003 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.003 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64e9cfc0:::benchmark_data_smithi188_77607_object115644:head# 2024-04-01T19:28:50.004 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.004 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64eb784b:::benchmark_data_smithi188_77607_object126999:head# 2024-04-01T19:28:50.004 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.004 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64eef570:::benchmark_data_smithi188_77607_object101126:head# 2024-04-01T19:28:50.004 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.004 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64f035f8:::benchmark_data_smithi188_77607_object117001:head# 2024-04-01T19:28:50.004 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.004 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64f04c29:::benchmark_data_smithi188_77607_object131824:head# 2024-04-01T19:28:50.004 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.004 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64f3513e:::benchmark_data_smithi188_77607_object153646:head# 2024-04-01T19:28:50.004 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.004 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64f3941c:::benchmark_data_smithi188_77607_object126621:head# 2024-04-01T19:28:50.004 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.004 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64f489d1:::benchmark_data_smithi188_77607_object103522:head# 2024-04-01T19:28:50.004 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.005 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64f4bea4:::benchmark_data_smithi188_77607_object140305:head# 2024-04-01T19:28:50.005 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.005 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64f5cacf:::benchmark_data_smithi188_77607_object110326:head# 2024-04-01T19:28:50.005 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.005 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64f77d0a:::benchmark_data_smithi188_77607_object135984:head# 2024-04-01T19:28:50.005 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.005 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64f823af:::benchmark_data_smithi188_77607_object157795:head# 2024-04-01T19:28:50.005 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.005 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64fd35b4:::benchmark_data_smithi188_77607_object147820:head# 2024-04-01T19:28:50.005 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.005 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64fd5c87:::benchmark_data_smithi188_77607_object145673:head# 2024-04-01T19:28:50.005 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.007 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64fddafe:::benchmark_data_smithi188_77607_object141923:head# 2024-04-01T19:28:50.007 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.008 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:64ff9a61:::benchmark_data_smithi188_77607_object127853:head# 2024-04-01T19:28:50.008 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.008 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65066fac:::benchmark_data_smithi188_77607_object98179:head# 2024-04-01T19:28:50.008 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.008 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6506d2ae:::benchmark_data_smithi188_77607_object108719:head# 2024-04-01T19:28:50.008 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.008 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6507aac9:::benchmark_data_smithi188_77607_object108768:head# 2024-04-01T19:28:50.008 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.008 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6507c6f0:::benchmark_data_smithi188_77607_object119867:head# 2024-04-01T19:28:50.008 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.008 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65081481:::benchmark_data_smithi188_77607_object165878:head# 2024-04-01T19:28:50.008 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.008 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65081f63:::benchmark_data_smithi188_77607_object108851:head# 2024-04-01T19:28:50.008 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.009 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65094d01:::benchmark_data_smithi188_77607_object158538:head# 2024-04-01T19:28:50.009 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.009 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6509a16f:::benchmark_data_smithi188_77607_object160882:head# 2024-04-01T19:28:50.009 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.009 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6509e6c6:::benchmark_data_smithi188_77607_object146114:head# 2024-04-01T19:28:50.009 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.009 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:650a7211:::benchmark_data_smithi188_77607_object161446:head# 2024-04-01T19:28:50.009 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.009 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:650c661a:::benchmark_data_smithi188_77607_object114162:head# 2024-04-01T19:28:50.009 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.009 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:650ec8ca:::benchmark_data_smithi188_77607_object148468:head# 2024-04-01T19:28:50.009 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.009 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65111dd3:::benchmark_data_smithi188_77607_object131720:head# 2024-04-01T19:28:50.009 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.010 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:651253d8:::benchmark_data_smithi188_77607_object108601:head# 2024-04-01T19:28:50.010 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.010 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:651254bb:::benchmark_data_smithi188_77607_object112282:head# 2024-04-01T19:28:50.010 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.010 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6512dab2:::benchmark_data_smithi188_77607_object106742:head# 2024-04-01T19:28:50.010 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.010 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6513053a:::benchmark_data_smithi188_77607_object110092:head# 2024-04-01T19:28:50.010 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.010 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6513e4aa:::benchmark_data_smithi188_77607_object145829:head# 2024-04-01T19:28:50.010 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.010 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65145d2c:::benchmark_data_smithi188_77607_object126903:head# 2024-04-01T19:28:50.010 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.010 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6514cb42:::benchmark_data_smithi188_77607_object99366:head# 2024-04-01T19:28:50.010 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.011 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:28:50.012 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:651541bb:::benchmark_data_smithi188_77607_object135256:head# 2024-04-01T19:28:50.012 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.012 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6515d8de:::benchmark_data_smithi188_77607_object157902:head# 2024-04-01T19:28:50.012 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.012 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:651b426c:::benchmark_data_smithi188_77607_object120863:head# 2024-04-01T19:28:50.012 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.012 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:651c3df8:::benchmark_data_smithi188_77607_object121378:head# 2024-04-01T19:28:50.012 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.012 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:651d9d00:::benchmark_data_smithi188_77607_object117233:head# 2024-04-01T19:28:50.012 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.013 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:651dce76:::benchmark_data_smithi188_77607_object112354:head# 2024-04-01T19:28:50.013 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.015 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:651e954e:::benchmark_data_smithi188_77607_object153206:head# 2024-04-01T19:28:50.015 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.015 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:651ea2d8:::benchmark_data_smithi188_77607_object118477:head# 2024-04-01T19:28:50.015 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.015 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65215512:::benchmark_data_smithi188_77607_object166780:head# 2024-04-01T19:28:50.015 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.015 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65216344:::benchmark_data_smithi188_77607_object106524:head# 2024-04-01T19:28:50.015 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.015 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6521872f:::benchmark_data_smithi188_77607_object120741:head# 2024-04-01T19:28:50.015 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.016 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:652254b0:::benchmark_data_smithi188_77607_object118217:head# 2024-04-01T19:28:50.016 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.016 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:652851b2:::benchmark_data_smithi188_77607_object149649:head# 2024-04-01T19:28:50.016 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.016 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6529cdba:::benchmark_data_smithi188_77607_object106126:head# 2024-04-01T19:28:50.016 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.016 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:652b66be:::benchmark_data_smithi188_77607_object108211:head# 2024-04-01T19:28:50.016 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.016 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:652c7792:::benchmark_data_smithi188_77607_object108373:head# 2024-04-01T19:28:50.016 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.016 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6530f3c8:::benchmark_data_smithi188_77607_object141018:head# 2024-04-01T19:28:50.016 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.016 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6533ffb7:::benchmark_data_smithi188_77607_object126918:head# 2024-04-01T19:28:50.017 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.017 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65346fd5:::benchmark_data_smithi188_77607_object162197:head# 2024-04-01T19:28:50.017 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.017 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6534ad58:::benchmark_data_smithi188_77607_object127692:head# 2024-04-01T19:28:50.017 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.017 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6535a537:::benchmark_data_smithi188_77607_object127106:head# 2024-04-01T19:28:50.017 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.017 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:653622d0:::benchmark_data_smithi188_77607_object123996:head# 2024-04-01T19:28:50.017 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.017 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6537c008:::benchmark_data_smithi188_77607_object115584:head# 2024-04-01T19:28:50.017 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.017 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6537c1b3:::benchmark_data_smithi188_77607_object101756:head# 2024-04-01T19:28:50.017 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.017 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6537c80d:::benchmark_data_smithi188_77607_object146937:head# 2024-04-01T19:28:50.018 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.018 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65386074:::benchmark_data_smithi188_77607_object149711:head# 2024-04-01T19:28:50.018 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.018 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6539769d:::benchmark_data_smithi188_77607_object149110:head# 2024-04-01T19:28:50.018 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.018 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:653a3159:::benchmark_data_smithi188_77607_object157826:head# 2024-04-01T19:28:50.018 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.023 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:653a964e:::benchmark_data_smithi188_77607_object106063:head# 2024-04-01T19:28:50.024 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.024 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:653aba08:::benchmark_data_smithi188_77607_object154576:head# 2024-04-01T19:28:50.024 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.024 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:653b90b8:::benchmark_data_smithi188_77607_object167179:head# 2024-04-01T19:28:50.024 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.024 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:653e955b:::benchmark_data_smithi188_77607_object126603:head# 2024-04-01T19:28:50.024 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.024 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:653e9b05:::benchmark_data_smithi188_77607_object152049:head# 2024-04-01T19:28:50.024 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.024 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6541649e:::benchmark_data_smithi188_77607_object113401:head# 2024-04-01T19:28:50.024 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.024 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:654221fd:::benchmark_data_smithi188_77607_object103502:head# 2024-04-01T19:28:50.024 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.024 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6542fa11:::benchmark_data_smithi188_77607_object100706:head# 2024-04-01T19:28:50.025 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.025 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:654400b0:::benchmark_data_smithi188_77607_object152771:head# 2024-04-01T19:28:50.025 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.025 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6546bd19:::benchmark_data_smithi188_77607_object101566:head# 2024-04-01T19:28:50.025 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.025 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6546d14d:::benchmark_data_smithi188_77607_object141421:head# 2024-04-01T19:28:50.025 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.025 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65471694:::benchmark_data_smithi188_77607_object100080:head# 2024-04-01T19:28:50.025 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.025 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6547a81a:::benchmark_data_smithi188_77607_object145979:head# 2024-04-01T19:28:50.025 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.025 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6548008a:::benchmark_data_smithi188_77607_object124604:head# 2024-04-01T19:28:50.025 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.025 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:654834ca:::benchmark_data_smithi188_77607_object159122:head# 2024-04-01T19:28:50.025 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.026 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6548b9f9:::benchmark_data_smithi188_77607_object129994:head# 2024-04-01T19:28:50.026 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.026 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6549490d:::benchmark_data_smithi188_77607_object162996:head# 2024-04-01T19:28:50.026 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.026 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:654ad348:::benchmark_data_smithi188_77607_object151529:head# 2024-04-01T19:28:50.026 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.026 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:654e8b86:::benchmark_data_smithi188_77607_object149935:head# 2024-04-01T19:28:50.026 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.026 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:654ee990:::benchmark_data_smithi188_77607_object134626:head# 2024-04-01T19:28:50.026 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.026 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:654fe985:::benchmark_data_smithi188_77607_object163081:head# 2024-04-01T19:28:50.026 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.026 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65536910:::benchmark_data_smithi188_77607_object118024:head# 2024-04-01T19:28:50.027 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.027 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6553fd64:::benchmark_data_smithi188_77607_object159155:head# 2024-04-01T19:28:50.027 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.027 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65544292:::benchmark_data_smithi188_77607_object100770:head# 2024-04-01T19:28:50.027 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.027 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6555742a:::benchmark_data_smithi188_77607_object155036:head# 2024-04-01T19:28:50.027 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.027 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65562109:::benchmark_data_smithi188_77607_object146709:head# 2024-04-01T19:28:50.027 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.027 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65564750:::benchmark_data_smithi188_77607_object129732:head# 2024-04-01T19:28:50.027 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.027 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:655696e0:::benchmark_data_smithi188_77607_object147174:head# 2024-04-01T19:28:50.027 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.027 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6558e38b:::benchmark_data_smithi188_77607_object150088:head# 2024-04-01T19:28:50.028 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.028 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6558f068:::benchmark_data_smithi188_77607_object116726:head# 2024-04-01T19:28:50.028 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.028 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:655c29b8:::benchmark_data_smithi188_77607_object101058:head# 2024-04-01T19:28:50.028 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.028 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:655c4cda:::benchmark_data_smithi188_77607_object112219:head# 2024-04-01T19:28:50.028 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.028 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:655c7a01:::benchmark_data_smithi188_77607_object137645:head# 2024-04-01T19:28:50.028 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.028 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:655d55b3:::benchmark_data_smithi188_77607_object107212:head# 2024-04-01T19:28:50.028 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.028 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:655dd0e6:::benchmark_data_smithi188_77607_object156883:head# 2024-04-01T19:28:50.028 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.028 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6560845a:::benchmark_data_smithi188_77607_object150157:head# 2024-04-01T19:28:50.028 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.029 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:50.043 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65626591:::benchmark_data_smithi188_77607_object163937:head# 2024-04-01T19:28:50.043 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.043 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6562bfef:::benchmark_data_smithi188_77607_object155881:head# 2024-04-01T19:28:50.043 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.043 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65644e03:::benchmark_data_smithi188_77607_object100934:head# 2024-04-01T19:28:50.043 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.043 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6564874c:::benchmark_data_smithi188_77607_object128751:head# 2024-04-01T19:28:50.043 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.043 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6564c010:::benchmark_data_smithi188_77607_object147032:head# 2024-04-01T19:28:50.044 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.044 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6565183f:::benchmark_data_smithi188_77607_object107611:head# 2024-04-01T19:28:50.044 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.044 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65654ed5:::benchmark_data_smithi188_77607_object166423:head# 2024-04-01T19:28:50.044 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.044 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6565f1d5:::benchmark_data_smithi188_77607_object165461:head# 2024-04-01T19:28:50.044 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.044 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65667c47:::benchmark_data_smithi188_77607_object105108:head# 2024-04-01T19:28:50.044 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.044 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6567abf6:::benchmark_data_smithi188_77607_object120324:head# 2024-04-01T19:28:50.044 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.044 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:656806d2:::benchmark_data_smithi188_77607_object109170:head# 2024-04-01T19:28:50.044 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.045 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6568f527:::benchmark_data_smithi188_77607_object164661:head# 2024-04-01T19:28:50.045 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.045 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:656c4dcb:::benchmark_data_smithi188_77607_object103560:head# 2024-04-01T19:28:50.045 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.045 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:656c6b5f:::benchmark_data_smithi188_77607_object136884:head# 2024-04-01T19:28:50.045 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.045 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:656d3df5:::benchmark_data_smithi188_77607_object129036:head# 2024-04-01T19:28:50.045 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.045 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:656e4df3:::benchmark_data_smithi188_77607_object150361:head# 2024-04-01T19:28:50.045 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.045 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65709e2a:::benchmark_data_smithi188_77607_object166165:head# 2024-04-01T19:28:50.045 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.045 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6570b5be:::benchmark_data_smithi188_77607_object103097:head# 2024-04-01T19:28:50.045 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.046 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6570ddb9:::benchmark_data_smithi188_77607_object117446:head# 2024-04-01T19:28:50.046 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.046 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65715256:::benchmark_data_smithi188_77607_object153548:head# 2024-04-01T19:28:50.046 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.046 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6571969b:::benchmark_data_smithi188_77607_object142132:head# 2024-04-01T19:28:50.046 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.046 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6571b873:::benchmark_data_smithi188_77607_object123392:head# 2024-04-01T19:28:50.046 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.046 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6572ce93:::benchmark_data_smithi188_77607_object146385:head# 2024-04-01T19:28:50.046 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.046 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6573663f:::benchmark_data_smithi188_77607_object112963:head# 2024-04-01T19:28:50.046 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.047 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:657472af:::benchmark_data_smithi188_77607_object162748:head# 2024-04-01T19:28:50.047 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.047 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6575706c:::benchmark_data_smithi188_77607_object123219:head# 2024-04-01T19:28:50.047 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.047 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6577dfcd:::benchmark_data_smithi188_77607_object108666:head# 2024-04-01T19:28:50.047 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.047 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6578c3cf:::benchmark_data_smithi188_77607_object152134:head# 2024-04-01T19:28:50.047 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.047 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:657a7939:::benchmark_data_smithi188_77607_object117943:head# 2024-04-01T19:28:50.047 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.047 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:657aafb0:::benchmark_data_smithi188_77607_object120969:head# 2024-04-01T19:28:50.047 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.047 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:657c7fa7:::benchmark_data_smithi188_77607_object160299:head# 2024-04-01T19:28:50.047 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.048 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:657e0069:::benchmark_data_smithi188_77607_object106582:head# 2024-04-01T19:28:50.048 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.048 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:657e078d:::benchmark_data_smithi188_77607_object134425:head# 2024-04-01T19:28:50.048 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.048 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65806d1c:::benchmark_data_smithi188_77607_object155625:head# 2024-04-01T19:28:50.048 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.048 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6580bfa8:::benchmark_data_smithi188_77607_object130779:head# 2024-04-01T19:28:50.048 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.048 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6580fd97:::benchmark_data_smithi188_77607_object165219:head# 2024-04-01T19:28:50.048 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.048 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65818a4f:::benchmark_data_smithi188_77607_object149174:head# 2024-04-01T19:28:50.048 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.048 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:658199fd:::benchmark_data_smithi188_77607_object154041:head# 2024-04-01T19:28:50.048 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.049 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6582020f:::benchmark_data_smithi188_77607_object108304:head# 2024-04-01T19:28:50.049 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.049 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65835390:::benchmark_data_smithi188_77607_object142416:head# 2024-04-01T19:28:50.049 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.049 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65836c5f:::benchmark_data_smithi188_77607_object114092:head# 2024-04-01T19:28:50.049 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.049 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6583fc8a:::benchmark_data_smithi188_77607_object107234:head# 2024-04-01T19:28:50.049 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.049 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6584071f:::benchmark_data_smithi188_77607_object120414:head# 2024-04-01T19:28:50.049 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.049 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65848837:::benchmark_data_smithi188_77607_object116802:head# 2024-04-01T19:28:50.049 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.049 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:658619de:::benchmark_data_smithi188_77607_object145048:head# 2024-04-01T19:28:50.049 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.049 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6586f33e:::benchmark_data_smithi188_77607_object141006:head# 2024-04-01T19:28:50.050 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.050 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65873c85:::benchmark_data_smithi188_77607_object135528:head# 2024-04-01T19:28:50.050 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.050 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:658987e5:::benchmark_data_smithi188_77607_object160499:head# 2024-04-01T19:28:50.050 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.050 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:658a2194:::benchmark_data_smithi188_77607_object105724:head# 2024-04-01T19:28:50.050 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.050 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:658a54da:::benchmark_data_smithi188_77607_object99593:head# 2024-04-01T19:28:50.050 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.050 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:658ab531:::benchmark_data_smithi188_77607_object103954:head# 2024-04-01T19:28:50.050 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.050 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:658c20b3:::benchmark_data_smithi188_77607_object99493:head# 2024-04-01T19:28:50.050 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.050 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:658d2bd2:::benchmark_data_smithi188_77607_object137102:head# 2024-04-01T19:28:50.051 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.051 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:658dbe07:::benchmark_data_smithi188_77607_object107411:head# 2024-04-01T19:28:50.051 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.051 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:658eb714:::benchmark_data_smithi188_77607_object124508:head# 2024-04-01T19:28:50.051 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.051 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:658f11f6:::benchmark_data_smithi188_77607_object143140:head# 2024-04-01T19:28:50.051 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.051 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:659067dd:::benchmark_data_smithi188_77607_object164150:head# 2024-04-01T19:28:50.051 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.051 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:659226ee:::benchmark_data_smithi188_77607_object142744:head# 2024-04-01T19:28:50.051 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.051 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65955c86:::benchmark_data_smithi188_77607_object162815:head# 2024-04-01T19:28:50.051 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.051 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6596e044:::benchmark_data_smithi188_77607_object110355:head# 2024-04-01T19:28:50.051 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.052 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65986aec:::benchmark_data_smithi188_77607_object147779:head# 2024-04-01T19:28:50.052 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.052 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6598c66c:::benchmark_data_smithi188_77607_object121184:head# 2024-04-01T19:28:50.052 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.052 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6598e88b:::benchmark_data_smithi188_77607_object106386:head# 2024-04-01T19:28:50.052 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.052 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65993bbe:::benchmark_data_smithi188_77607_object130002:head# 2024-04-01T19:28:50.052 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.052 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65993d82:::benchmark_data_smithi188_77607_object125093:head# 2024-04-01T19:28:50.052 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.052 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:659a02b4:::benchmark_data_smithi188_77607_object158708:head# 2024-04-01T19:28:50.052 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.052 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:659a198e:::benchmark_data_smithi188_77607_object128706:head# 2024-04-01T19:28:50.052 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.053 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:659b4fd0:::benchmark_data_smithi188_77607_object166098:head# 2024-04-01T19:28:50.053 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.053 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:659baad1:::benchmark_data_smithi188_77607_object116158:head# 2024-04-01T19:28:50.053 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.053 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:659d17ce:::benchmark_data_smithi188_77607_object129035:head# 2024-04-01T19:28:50.053 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.053 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:659e1203:::benchmark_data_smithi188_77607_object111147:head# 2024-04-01T19:28:50.053 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.053 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:659e57c3:::benchmark_data_smithi188_77607_object130840:head# 2024-04-01T19:28:50.053 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.053 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:659f7e4b:::benchmark_data_smithi188_77607_object113616:head# 2024-04-01T19:28:50.053 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.053 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:659fd1c5:::benchmark_data_smithi188_77607_object110043:head# 2024-04-01T19:28:50.053 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.053 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65a0d312:::benchmark_data_smithi188_77607_object130208:head# 2024-04-01T19:28:50.053 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.054 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65a13ce8:::benchmark_data_smithi188_77607_object113393:head# 2024-04-01T19:28:50.054 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.054 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65a36671:::benchmark_data_smithi188_77607_object132008:head# 2024-04-01T19:28:50.054 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.054 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65a46b19:::benchmark_data_smithi188_77607_object133660:head# 2024-04-01T19:28:50.054 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.054 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65a4aff7:::benchmark_data_smithi188_77607_object155363:head# 2024-04-01T19:28:50.054 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.054 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65a50f00:::benchmark_data_smithi188_77607_object120757:head# 2024-04-01T19:28:50.054 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.054 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65a716b4:::benchmark_data_smithi188_77607_object137028:head# 2024-04-01T19:28:50.054 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.054 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65a77ebe:::benchmark_data_smithi188_77607_object129596:head# 2024-04-01T19:28:50.054 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.055 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65a7b8ec:::benchmark_data_smithi188_77607_object143620:head# 2024-04-01T19:28:50.055 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.055 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65a9e0c6:::benchmark_data_smithi188_77607_object133959:head# 2024-04-01T19:28:50.055 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.055 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:28:50.060 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65aa0e30:::benchmark_data_smithi188_77607_object160511:head# 2024-04-01T19:28:50.060 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.061 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65aa1002:::benchmark_data_smithi188_77607_object119122:head# 2024-04-01T19:28:50.061 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.061 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65aa93a6:::benchmark_data_smithi188_77607_object113659:head# 2024-04-01T19:28:50.061 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.061 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65abb030:::benchmark_data_smithi188_77607_object143361:head# 2024-04-01T19:28:50.061 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.061 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65ac4789:::benchmark_data_smithi188_77607_object157498:head# 2024-04-01T19:28:50.061 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.061 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65ad235f:::benchmark_data_smithi188_77607_object160322:head# 2024-04-01T19:28:50.061 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.061 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65ae905e:::benchmark_data_smithi188_77607_object155648:head# 2024-04-01T19:28:50.061 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.061 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65af9d8c:::benchmark_data_smithi188_77607_object143635:head# 2024-04-01T19:28:50.062 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.062 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65afb66b:::benchmark_data_smithi188_77607_object150689:head# 2024-04-01T19:28:50.062 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.062 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65b2adfd:::benchmark_data_smithi188_77607_object99325:head# 2024-04-01T19:28:50.062 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.062 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65b489d6:::benchmark_data_smithi188_77607_object133084:head# 2024-04-01T19:28:50.062 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.062 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65b5598f:::benchmark_data_smithi188_77607_object143012:head# 2024-04-01T19:28:50.062 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.062 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65b655a2:::benchmark_data_smithi188_77607_object106859:head# 2024-04-01T19:28:50.062 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.062 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65b9585c:::benchmark_data_smithi188_77607_object158776:head# 2024-04-01T19:28:50.062 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.062 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65bae348:::benchmark_data_smithi188_77607_object107658:head# 2024-04-01T19:28:50.062 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.063 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65bb6946:::benchmark_data_smithi188_77607_object158052:head# 2024-04-01T19:28:50.063 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.063 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65bba7c5:::benchmark_data_smithi188_77607_object107813:head# 2024-04-01T19:28:50.063 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.063 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65bc0afb:::benchmark_data_smithi188_77607_object123137:head# 2024-04-01T19:28:50.063 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.063 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65bdbefb:::benchmark_data_smithi188_77607_object130777:head# 2024-04-01T19:28:50.063 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.063 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65c018dd:::benchmark_data_smithi188_77607_object144802:head# 2024-04-01T19:28:50.063 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.063 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65c1dad9:::benchmark_data_smithi188_77607_object157592:head# 2024-04-01T19:28:50.063 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.063 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65c39196:::benchmark_data_smithi188_77607_object163520:head# 2024-04-01T19:28:50.063 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.064 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65c42488:::benchmark_data_smithi188_77607_object122149:head# 2024-04-01T19:28:50.064 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.064 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65c4d751:::benchmark_data_smithi188_77607_object157968:head# 2024-04-01T19:28:50.064 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.064 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65c543cc:::benchmark_data_smithi188_77607_object124908:head# 2024-04-01T19:28:50.064 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.064 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65c554ea:::benchmark_data_smithi188_77607_object161129:head# 2024-04-01T19:28:50.064 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.064 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65c66d38:::benchmark_data_smithi188_77607_object121962:head# 2024-04-01T19:28:50.064 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.064 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65c692b4:::benchmark_data_smithi188_77607_object107561:head# 2024-04-01T19:28:50.064 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.064 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65c6d693:::benchmark_data_smithi188_77607_object129075:head# 2024-04-01T19:28:50.064 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.064 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65c98a9d:::benchmark_data_smithi188_77607_object116928:head# 2024-04-01T19:28:50.065 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.065 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65ca333a:::benchmark_data_smithi188_77607_object155683:head# 2024-04-01T19:28:50.065 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.065 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65cbc960:::benchmark_data_smithi188_77607_object167070:head# 2024-04-01T19:28:50.065 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.065 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65cc7095:::benchmark_data_smithi188_77607_object126834:head# 2024-04-01T19:28:50.065 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.065 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65cd4b33:::benchmark_data_smithi188_77607_object139789:head# 2024-04-01T19:28:50.065 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.065 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65cd7270:::benchmark_data_smithi188_77607_object127383:head# 2024-04-01T19:28:50.065 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.065 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65cd8754:::benchmark_data_smithi188_77607_object162701:head# 2024-04-01T19:28:50.065 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.065 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65cfb40a:::benchmark_data_smithi188_77607_object143860:head# 2024-04-01T19:28:50.065 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.065 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65cfb828:::benchmark_data_smithi188_77607_object134038:head# 2024-04-01T19:28:50.066 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.066 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65d04d05:::benchmark_data_smithi188_77607_object116952:head# 2024-04-01T19:28:50.066 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.066 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65d1c6ee:::benchmark_data_smithi188_77607_object138020:head# 2024-04-01T19:28:50.066 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.066 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65d22521:::benchmark_data_smithi188_77607_object136143:head# 2024-04-01T19:28:50.066 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.066 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65d26447:::benchmark_data_smithi188_77607_object158425:head# 2024-04-01T19:28:50.066 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.066 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65d32952:::benchmark_data_smithi188_77607_object155874:head# 2024-04-01T19:28:50.066 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.066 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65d3460d:::benchmark_data_smithi188_77607_object120459:head# 2024-04-01T19:28:50.066 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.066 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65d40763:::benchmark_data_smithi188_77607_object111038:head# 2024-04-01T19:28:50.067 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.067 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65d55d25:::benchmark_data_smithi188_77607_object125136:head# 2024-04-01T19:28:50.067 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.067 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65d5fcdf:::benchmark_data_smithi188_77607_object132133:head# 2024-04-01T19:28:50.067 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.067 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65d6673a:::benchmark_data_smithi188_77607_object104008:head# 2024-04-01T19:28:50.067 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.067 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65d875a5:::benchmark_data_smithi188_77607_object118375:head# 2024-04-01T19:28:50.067 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.067 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65d8db04:::benchmark_data_smithi188_77607_object160554:head# 2024-04-01T19:28:50.067 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.067 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65d901d2:::benchmark_data_smithi188_77607_object162196:head# 2024-04-01T19:28:50.067 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.067 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65dcbf05:::benchmark_data_smithi188_77607_object99380:head# 2024-04-01T19:28:50.067 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.068 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65de68d6:::benchmark_data_smithi188_77607_object156979:head# 2024-04-01T19:28:50.068 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.068 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65dee262:::benchmark_data_smithi188_77607_object103616:head# 2024-04-01T19:28:50.068 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.068 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65df3d35:::benchmark_data_smithi188_77607_object116565:head# 2024-04-01T19:28:50.068 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.068 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65e05827:::benchmark_data_smithi188_77607_object140231:head# 2024-04-01T19:28:50.068 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.068 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65e099e5:::benchmark_data_smithi188_77607_object156336:head# 2024-04-01T19:28:50.068 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.068 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65e0c957:::benchmark_data_smithi188_77607_object143681:head# 2024-04-01T19:28:50.068 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.068 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65e157ff:::benchmark_data_smithi188_77607_object109790:head# 2024-04-01T19:28:50.068 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.070 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65e1f340:::benchmark_data_smithi188_77607_object137847:head# 2024-04-01T19:28:50.070 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.070 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65e45fa2:::benchmark_data_smithi188_77607_object122699:head# 2024-04-01T19:28:50.070 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.070 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65e46d62:::benchmark_data_smithi188_77607_object138189:head# 2024-04-01T19:28:50.070 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.070 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65e4df43:::benchmark_data_smithi188_77607_object103246:head# 2024-04-01T19:28:50.071 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.071 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65e625bf:::benchmark_data_smithi188_77607_object158730:head# 2024-04-01T19:28:50.071 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.071 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65e77515:::benchmark_data_smithi188_77607_object105435:head# 2024-04-01T19:28:50.071 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.071 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65ea2c50:::benchmark_data_smithi188_77607_object138125:head# 2024-04-01T19:28:50.071 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.071 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65eb0f59:::benchmark_data_smithi188_77607_object142991:head# 2024-04-01T19:28:50.071 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.071 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65ebc220:::benchmark_data_smithi188_77607_object145507:head# 2024-04-01T19:28:50.071 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.071 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65ebec52:::benchmark_data_smithi188_77607_object121075:head# 2024-04-01T19:28:50.071 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.071 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65ecf38e:::benchmark_data_smithi188_77607_object109930:head# 2024-04-01T19:28:50.071 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.072 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65ed636c:::benchmark_data_smithi188_77607_object144909:head# 2024-04-01T19:28:50.072 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.072 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65ef4abe:::benchmark_data_smithi188_77607_object145958:head# 2024-04-01T19:28:50.072 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.072 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65f0b03f:::benchmark_data_smithi188_77607_object152477:head# 2024-04-01T19:28:50.072 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.072 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65f22737:::benchmark_data_smithi188_77607_object113270:head# 2024-04-01T19:28:50.072 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.072 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65f4ffff:::benchmark_data_smithi188_77607_object109241:head# 2024-04-01T19:28:50.073 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.073 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65f57a98:::benchmark_data_smithi188_77607_object154355:head# 2024-04-01T19:28:50.073 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.074 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65f59903:::benchmark_data_smithi188_77607_object137957:head# 2024-04-01T19:28:50.074 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.074 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65f5ad50:::benchmark_data_smithi188_77607_object123719:head# 2024-04-01T19:28:50.074 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.074 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65f74bcf:::benchmark_data_smithi188_77607_object157816:head# 2024-04-01T19:28:50.074 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.074 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65f75461:::benchmark_data_smithi188_77607_object159418:head# 2024-04-01T19:28:50.075 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.075 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65f8f6fe:::benchmark_data_smithi188_77607_object161350:head# 2024-04-01T19:28:50.075 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.075 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65fab33f:::benchmark_data_smithi188_77607_object122206:head# 2024-04-01T19:28:50.075 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.075 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65fb1e6e:::benchmark_data_smithi188_77607_object114773:head# 2024-04-01T19:28:50.075 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.076 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65fbb33f:::benchmark_data_smithi188_77607_object102840:head# 2024-04-01T19:28:50.076 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.076 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65fc56b9:::benchmark_data_smithi188_77607_object98660:head# 2024-04-01T19:28:50.076 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.076 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65fe37f1:::benchmark_data_smithi188_77607_object138566:head# 2024-04-01T19:28:50.076 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.076 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:65fe4bee:::benchmark_data_smithi188_77607_object125474:head# 2024-04-01T19:28:50.077 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.077 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6600987b:::benchmark_data_smithi188_77607_object137251:head# 2024-04-01T19:28:50.077 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.077 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66015279:::benchmark_data_smithi188_77607_object115706:head# 2024-04-01T19:28:50.077 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.077 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:660328f1:::benchmark_data_smithi188_77607_object122789:head# 2024-04-01T19:28:50.077 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.082 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66032aa2:::benchmark_data_smithi188_77607_object115074:head# 2024-04-01T19:28:50.083 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.083 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6605434f:::benchmark_data_smithi188_77607_object166649:head# 2024-04-01T19:28:50.083 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.083 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6605a2b4:::benchmark_data_smithi188_77607_object146111:head# 2024-04-01T19:28:50.083 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.083 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:660812ad:::benchmark_data_smithi188_77607_object120540:head# 2024-04-01T19:28:50.083 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.083 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:660868bf:::benchmark_data_smithi188_77607_object107349:head# 2024-04-01T19:28:50.083 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.083 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6608d0b3:::benchmark_data_smithi188_77607_object124480:head# 2024-04-01T19:28:50.083 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.083 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:660ac038:::benchmark_data_smithi188_77607_object120272:head# 2024-04-01T19:28:50.083 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.083 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:660b1c75:::benchmark_data_smithi188_77607_object101676:head# 2024-04-01T19:28:50.083 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.084 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:660b950a:::benchmark_data_smithi188_77607_object110672:head# 2024-04-01T19:28:50.084 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.085 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:660c6429:::benchmark_data_smithi188_77607_object111698:head# 2024-04-01T19:28:50.085 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.085 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:660cfe51:::benchmark_data_smithi188_77607_object111056:head# 2024-04-01T19:28:50.085 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.085 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:660d3244:::benchmark_data_smithi188_77607_object162664:head# 2024-04-01T19:28:50.085 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.085 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:660ec209:::benchmark_data_smithi188_77607_object151907:head# 2024-04-01T19:28:50.085 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.085 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:660ef8a3:::benchmark_data_smithi188_77607_object142759:head# 2024-04-01T19:28:50.086 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.086 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:660f2ac7:::benchmark_data_smithi188_77607_object118607:head# 2024-04-01T19:28:50.086 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.086 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66104804:::benchmark_data_smithi188_77607_object154643:head# 2024-04-01T19:28:50.086 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.086 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:28:50.089 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6610b201:::benchmark_data_smithi188_77607_object163809:head# 2024-04-01T19:28:50.089 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.089 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6610b318:::benchmark_data_smithi188_77607_object119080:head# 2024-04-01T19:28:50.089 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.089 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66113e3e:::benchmark_data_smithi188_77607_object98376:head# 2024-04-01T19:28:50.089 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.089 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6612467f:::benchmark_data_smithi188_77607_object162414:head# 2024-04-01T19:28:50.089 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.089 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:661285fc:::benchmark_data_smithi188_77607_object134524:head# 2024-04-01T19:28:50.089 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.089 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:661316c4:::benchmark_data_smithi188_77607_object162954:head# 2024-04-01T19:28:50.090 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.090 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66139a3b:::benchmark_data_smithi188_77607_object110414:head# 2024-04-01T19:28:50.090 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.090 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66145c6e:::benchmark_data_smithi188_77607_object130835:head# 2024-04-01T19:28:50.090 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.090 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6614d4ef:::benchmark_data_smithi188_77607_object137539:head# 2024-04-01T19:28:50.090 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.090 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6614f772:::benchmark_data_smithi188_77607_object115891:head# 2024-04-01T19:28:50.090 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.090 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66154cec:::benchmark_data_smithi188_77607_object121684:head# 2024-04-01T19:28:50.090 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.090 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66159efd:::benchmark_data_smithi188_77607_object140107:head# 2024-04-01T19:28:50.090 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.090 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:661631d4:::benchmark_data_smithi188_77607_object127207:head# 2024-04-01T19:28:50.091 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.091 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6616b41c:::benchmark_data_smithi188_77607_object130792:head# 2024-04-01T19:28:50.091 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.091 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6616c5e9:::benchmark_data_smithi188_77607_object114087:head# 2024-04-01T19:28:50.091 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.094 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66176bf5:::benchmark_data_smithi188_77607_object125055:head# 2024-04-01T19:28:50.094 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.094 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6617c9bc:::benchmark_data_smithi188_77607_object102693:head# 2024-04-01T19:28:50.094 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.094 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66183b62:::benchmark_data_smithi188_77607_object114038:head# 2024-04-01T19:28:50.094 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.094 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66185767:::benchmark_data_smithi188_77607_object167038:head# 2024-04-01T19:28:50.094 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.094 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66199d87:::benchmark_data_smithi188_77607_object150374:head# 2024-04-01T19:28:50.094 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.094 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:661a2eda:::benchmark_data_smithi188_77607_object158484:head# 2024-04-01T19:28:50.094 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.095 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:661a4628:::benchmark_data_smithi188_77607_object134488:head# 2024-04-01T19:28:50.095 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.095 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:661ab4e3:::benchmark_data_smithi188_77607_object124926:head# 2024-04-01T19:28:50.095 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.095 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:661c62d8:::benchmark_data_smithi188_77607_object108004:head# 2024-04-01T19:28:50.095 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.095 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:661dae6a:::benchmark_data_smithi188_77607_object152800:head# 2024-04-01T19:28:50.095 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.095 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66203230:::benchmark_data_smithi188_77607_object112196:head# 2024-04-01T19:28:50.095 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.095 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66222b22:::benchmark_data_smithi188_77607_object146155:head# 2024-04-01T19:28:50.095 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.095 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66266e5d:::benchmark_data_smithi188_77607_object136616:head# 2024-04-01T19:28:50.095 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.095 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66269b83:::benchmark_data_smithi188_77607_object165997:head# 2024-04-01T19:28:50.095 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.096 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6627e29f:::benchmark_data_smithi188_77607_object141174:head# 2024-04-01T19:28:50.096 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.096 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6628c8fd:::benchmark_data_smithi188_77607_object123770:head# 2024-04-01T19:28:50.096 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.096 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66293d09:::benchmark_data_smithi188_77607_object117293:head# 2024-04-01T19:28:50.096 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.096 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:662af6f2:::benchmark_data_smithi188_77607_object124306:head# 2024-04-01T19:28:50.096 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.097 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:662b30d4:::benchmark_data_smithi188_77607_object104162:head# 2024-04-01T19:28:50.097 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.097 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:662b5247:::benchmark_data_smithi188_77607_object161781:head# 2024-04-01T19:28:50.097 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.097 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:662b9e3f:::benchmark_data_smithi188_77607_object142252:head# 2024-04-01T19:28:50.097 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.097 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:662c31c3:::benchmark_data_smithi188_77607_object143300:head# 2024-04-01T19:28:50.097 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.099 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:662c3c05:::benchmark_data_smithi188_77607_object112935:head# 2024-04-01T19:28:50.099 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.100 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:662c5b84:::benchmark_data_smithi188_77607_object149946:head# 2024-04-01T19:28:50.100 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.100 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:662d0718:::benchmark_data_smithi188_77607_object98674:head# 2024-04-01T19:28:50.100 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.100 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:662e4f3c:::benchmark_data_smithi188_77607_object158864:head# 2024-04-01T19:28:50.100 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.100 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:662edc5b:::benchmark_data_smithi188_77607_object124551:head# 2024-04-01T19:28:50.100 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.100 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66303bfa:::benchmark_data_smithi188_77607_object144066:head# 2024-04-01T19:28:50.100 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.100 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66351cd9:::benchmark_data_smithi188_77607_object129558:head# 2024-04-01T19:28:50.100 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.100 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:663560de:::benchmark_data_smithi188_77607_object125169:head# 2024-04-01T19:28:50.100 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.100 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6639dcc1:::benchmark_data_smithi188_77607_object159152:head# 2024-04-01T19:28:50.101 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.101 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:663a0761:::benchmark_data_smithi188_77607_object118283:head# 2024-04-01T19:28:50.101 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.101 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:663af5d7:::benchmark_data_smithi188_77607_object132817:head# 2024-04-01T19:28:50.101 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.101 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:663af81f:::benchmark_data_smithi188_77607_object116464:head# 2024-04-01T19:28:50.101 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.101 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:663b080b:::benchmark_data_smithi188_77607_object121160:head# 2024-04-01T19:28:50.101 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.101 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:663bf021:::benchmark_data_smithi188_77607_object140414:head# 2024-04-01T19:28:50.101 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.101 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:663cc75b:::benchmark_data_smithi188_77607_object143082:head# 2024-04-01T19:28:50.101 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.101 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:663ddfeb:::benchmark_data_smithi188_77607_object157607:head# 2024-04-01T19:28:50.101 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.102 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:663fac98:::benchmark_data_smithi188_77607_object165333:head# 2024-04-01T19:28:50.102 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.102 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6641c8d7:::benchmark_data_smithi188_77607_object116580:head# 2024-04-01T19:28:50.102 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.102 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6643cf3f:::benchmark_data_smithi188_77607_object148356:head# 2024-04-01T19:28:50.102 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.104 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66440e08:::benchmark_data_smithi188_77607_object138535:head# 2024-04-01T19:28:50.104 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.105 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:664546a3:::benchmark_data_smithi188_77607_object138152:head# 2024-04-01T19:28:50.105 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.105 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:664549aa:::benchmark_data_smithi188_77607_object107516:head# 2024-04-01T19:28:50.105 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.105 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6646d6a9:::benchmark_data_smithi188_77607_object101109:head# 2024-04-01T19:28:50.105 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.105 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6647e228:::benchmark_data_smithi188_77607_object120911:head# 2024-04-01T19:28:50.105 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.105 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66484db8:::benchmark_data_smithi188_77607_object144082:head# 2024-04-01T19:28:50.105 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.105 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6648c6df:::benchmark_data_smithi188_77607_object99474:head# 2024-04-01T19:28:50.105 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.105 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6649073a:::benchmark_data_smithi188_77607_object140909:head# 2024-04-01T19:28:50.105 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.105 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66496cef:::benchmark_data_smithi188_77607_object164716:head# 2024-04-01T19:28:50.106 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.106 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:664bf749:::benchmark_data_smithi188_77607_object110310:head# 2024-04-01T19:28:50.106 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.106 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:664c1a46:::benchmark_data_smithi188_77607_object157094:head# 2024-04-01T19:28:50.106 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.106 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:664cb55d:::benchmark_data_smithi188_77607_object153588:head# 2024-04-01T19:28:50.106 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.106 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:664cc234:::benchmark_data_smithi188_77607_object142655:head# 2024-04-01T19:28:50.106 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.106 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:664dc642:::benchmark_data_smithi188_77607_object165914:head# 2024-04-01T19:28:50.106 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.106 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:664f2555:::benchmark_data_smithi188_77607_object128578:head# 2024-04-01T19:28:50.106 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.106 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:664f5522:::benchmark_data_smithi188_77607_object156230:head# 2024-04-01T19:28:50.106 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.107 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:664fb77b:::benchmark_data_smithi188_77607_object108136:head# 2024-04-01T19:28:50.107 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.107 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:664fefc0:::benchmark_data_smithi188_77607_object143406:head# 2024-04-01T19:28:50.107 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.109 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6650af52:::benchmark_data_smithi188_77607_object100214:head# 2024-04-01T19:28:50.110 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.110 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66514551:::benchmark_data_smithi188_77607_object134512:head# 2024-04-01T19:28:50.110 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.110 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6651cbf7:::benchmark_data_smithi188_77607_object118983:head# 2024-04-01T19:28:50.110 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.110 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6651db3c:::benchmark_data_smithi188_77607_object126586:head# 2024-04-01T19:28:50.110 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.110 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6654f7bd:::benchmark_data_smithi188_77607_object118432:head# 2024-04-01T19:28:50.110 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.110 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:665569c6:::benchmark_data_smithi188_77607_object111727:head# 2024-04-01T19:28:50.110 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.110 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66594cec:::benchmark_data_smithi188_77607_object167113:head# 2024-04-01T19:28:50.111 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.111 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6659899f:::benchmark_data_smithi188_77607_object143123:head# 2024-04-01T19:28:50.111 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.111 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:665a31be:::benchmark_data_smithi188_77607_object149016:head# 2024-04-01T19:28:50.111 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.111 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:665b46fe:::benchmark_data_smithi188_77607_object162168:head# 2024-04-01T19:28:50.111 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.111 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:665b6305:::benchmark_data_smithi188_77607_object150039:head# 2024-04-01T19:28:50.111 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.111 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:665c3ad2:::benchmark_data_smithi188_77607_object119573:head# 2024-04-01T19:28:50.111 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.111 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:665c8b08:::benchmark_data_smithi188_77607_object140806:head# 2024-04-01T19:28:50.111 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.111 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:665ccca2:::benchmark_data_smithi188_77607_object154130:head# 2024-04-01T19:28:50.111 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.112 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:665cd465:::benchmark_data_smithi188_77607_object122979:head# 2024-04-01T19:28:50.112 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.112 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:665eb99c:::benchmark_data_smithi188_77607_object98141:head# 2024-04-01T19:28:50.112 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.112 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6661fc83:::benchmark_data_smithi188_77607_object128850:head# 2024-04-01T19:28:50.112 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.112 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6662b4ba:::benchmark_data_smithi188_77607_object156689:head# 2024-04-01T19:28:50.112 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.112 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6663f558:::benchmark_data_smithi188_77607_object124732:head# 2024-04-01T19:28:50.112 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.112 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6664eedb:::benchmark_data_smithi188_77607_object141020:head# 2024-04-01T19:28:50.112 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.112 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:666527b8:::benchmark_data_smithi188_77607_object124581:head# 2024-04-01T19:28:50.112 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.115 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:666571be:::benchmark_data_smithi188_77607_object115800:head# 2024-04-01T19:28:50.115 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.115 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66657970:::benchmark_data_smithi188_77607_object143015:head# 2024-04-01T19:28:50.115 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.116 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66657d90:::benchmark_data_smithi188_77607_object157035:head# 2024-04-01T19:28:50.116 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.116 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66660cb9:::benchmark_data_smithi188_77607_object155262:head# 2024-04-01T19:28:50.116 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.116 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:666838a2:::benchmark_data_smithi188_77607_object109430:head# 2024-04-01T19:28:50.116 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.116 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:666a7465:::benchmark_data_smithi188_77607_object165372:head# 2024-04-01T19:28:50.116 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.116 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:666db89b:::benchmark_data_smithi188_77607_object143461:head# 2024-04-01T19:28:50.116 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.116 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:666f0644:::benchmark_data_smithi188_77607_object118577:head# 2024-04-01T19:28:50.116 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.116 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:666f797b:::benchmark_data_smithi188_77607_object138031:head# 2024-04-01T19:28:50.116 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.117 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66709e3a:::benchmark_data_smithi188_77607_object110116:head# 2024-04-01T19:28:50.117 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.117 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6670f609:::benchmark_data_smithi188_77607_object116763:head# 2024-04-01T19:28:50.117 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.117 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6671243d:::benchmark_data_smithi188_77607_object157026:head# 2024-04-01T19:28:50.117 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.117 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6671583d:::benchmark_data_smithi188_77607_object135059:head# 2024-04-01T19:28:50.117 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.117 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6671d160:::benchmark_data_smithi188_77607_object115737:head# 2024-04-01T19:28:50.117 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.117 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66727458:::benchmark_data_smithi188_77607_object116854:head# 2024-04-01T19:28:50.117 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.117 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66729101:::benchmark_data_smithi188_77607_object144646:head# 2024-04-01T19:28:50.117 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.117 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6673c32b:::benchmark_data_smithi188_77607_object157169:head# 2024-04-01T19:28:50.118 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.118 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6674b766:::benchmark_data_smithi188_77607_object109571:head# 2024-04-01T19:28:50.118 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.118 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66751fc4:::benchmark_data_smithi188_77607_object154502:head# 2024-04-01T19:28:50.118 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.118 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6675bf5d:::benchmark_data_smithi188_77607_object133605:head# 2024-04-01T19:28:50.118 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.118 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6675db62:::benchmark_data_smithi188_77607_object112961:head# 2024-04-01T19:28:50.118 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.118 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6676774f:::benchmark_data_smithi188_77607_object130172:head# 2024-04-01T19:28:50.118 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.120 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6676ee8a:::benchmark_data_smithi188_77607_object136892:head# 2024-04-01T19:28:50.120 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.120 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:667783ff:::benchmark_data_smithi188_77607_object126058:head# 2024-04-01T19:28:50.120 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.121 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66780663:::benchmark_data_smithi188_77607_object121884:head# 2024-04-01T19:28:50.121 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.121 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66788749:::benchmark_data_smithi188_77607_object129888:head# 2024-04-01T19:28:50.121 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.121 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:667b4a9d:::benchmark_data_smithi188_77607_object126396:head# 2024-04-01T19:28:50.121 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.121 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:667cabf5:::benchmark_data_smithi188_77607_object130429:head# 2024-04-01T19:28:50.121 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.121 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6681a9ad:::benchmark_data_smithi188_77607_object142112:head# 2024-04-01T19:28:50.121 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.121 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6683a505:::benchmark_data_smithi188_77607_object107763:head# 2024-04-01T19:28:50.121 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.121 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:668558bc:::benchmark_data_smithi188_77607_object100074:head# 2024-04-01T19:28:50.121 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.121 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6688217b:::benchmark_data_smithi188_77607_object131234:head# 2024-04-01T19:28:50.122 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.122 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6688bc2d:::benchmark_data_smithi188_77607_object151258:head# 2024-04-01T19:28:50.122 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.122 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6689b82a:::benchmark_data_smithi188_77607_object133699:head# 2024-04-01T19:28:50.122 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.122 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:668ac6ba:::benchmark_data_smithi188_77607_object109640:head# 2024-04-01T19:28:50.122 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.122 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:668c73df:::benchmark_data_smithi188_77607_object113991:head# 2024-04-01T19:28:50.122 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.122 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:668cfb61:::benchmark_data_smithi188_77607_object103585:head# 2024-04-01T19:28:50.122 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.122 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:668d9b89:::benchmark_data_smithi188_77607_object107217:head# 2024-04-01T19:28:50.122 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.122 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:668e09f6:::benchmark_data_smithi188_77607_object131213:head# 2024-04-01T19:28:50.123 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.123 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:668e60e4:::benchmark_data_smithi188_77607_object106830:head# 2024-04-01T19:28:50.123 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.123 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:668f0336:::benchmark_data_smithi188_77607_object143136:head# 2024-04-01T19:28:50.123 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.123 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:28:50.125 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:668f9ab3:::benchmark_data_smithi188_77607_object159850:head# 2024-04-01T19:28:50.125 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.125 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6690b365:::benchmark_data_smithi188_77607_object121179:head# 2024-04-01T19:28:50.125 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.126 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66924b00:::benchmark_data_smithi188_77607_object120468:head# 2024-04-01T19:28:50.126 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.126 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:669601f7:::benchmark_data_smithi188_77607_object130228:head# 2024-04-01T19:28:50.126 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.126 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66975a77:::benchmark_data_smithi188_77607_object157915:head# 2024-04-01T19:28:50.126 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.126 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6697fd28:::benchmark_data_smithi188_77607_object153160:head# 2024-04-01T19:28:50.126 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.126 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66993d60:::benchmark_data_smithi188_77607_object107206:head# 2024-04-01T19:28:50.126 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.126 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6699a5a9:::benchmark_data_smithi188_77607_object146456:head# 2024-04-01T19:28:50.126 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.126 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:669a8074:::benchmark_data_smithi188_77607_object109035:head# 2024-04-01T19:28:50.126 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.127 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:669b591b:::benchmark_data_smithi188_77607_object150986:head# 2024-04-01T19:28:50.127 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.127 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:669b8dcb:::benchmark_data_smithi188_77607_object101210:head# 2024-04-01T19:28:50.127 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.127 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:669c07c2:::benchmark_data_smithi188_77607_object113547:head# 2024-04-01T19:28:50.127 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.127 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:669c495c:::benchmark_data_smithi188_77607_object147001:head# 2024-04-01T19:28:50.127 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.127 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:669d24c2:::benchmark_data_smithi188_77607_object110204:head# 2024-04-01T19:28:50.127 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.127 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:669d2f73:::benchmark_data_smithi188_77607_object147511:head# 2024-04-01T19:28:50.127 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.127 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:669d90f0:::benchmark_data_smithi188_77607_object159992:head# 2024-04-01T19:28:50.128 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.128 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:669e951b:::benchmark_data_smithi188_77607_object114151:head# 2024-04-01T19:28:50.128 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.128 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66a03039:::benchmark_data_smithi188_77607_object155505:head# 2024-04-01T19:28:50.128 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.129 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66a050f9:::benchmark_data_smithi188_77607_object159942:head# 2024-04-01T19:28:50.129 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.129 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66a0bcf9:::benchmark_data_smithi188_77607_object113593:head# 2024-04-01T19:28:50.129 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.129 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66a218d8:::benchmark_data_smithi188_77607_object166581:head# 2024-04-01T19:28:50.129 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.129 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66a26445:::benchmark_data_smithi188_77607_object128220:head# 2024-04-01T19:28:50.130 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.130 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66a2842b:::benchmark_data_smithi188_77607_object158762:head# 2024-04-01T19:28:50.130 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.130 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66a30436:::benchmark_data_smithi188_77607_object153111:head# 2024-04-01T19:28:50.130 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.130 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66a79ed2:::benchmark_data_smithi188_77607_object161383:head# 2024-04-01T19:28:50.130 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.130 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66a8ece0:::benchmark_data_smithi188_77607_object116688:head# 2024-04-01T19:28:50.130 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.130 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:49 smithi188 ceph-mon[43939]: pgmap v536: 17 pgs: 17 active+clean; 3.8 GiB data, 8.4 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 816 op/s; 30 MiB/s, 474 objects/s recovering 2024-04-01T19:28:50.130 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:49 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3732884545' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:28:50.132 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66a9f934:::benchmark_data_smithi188_77607_object148032:head# 2024-04-01T19:28:50.132 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.132 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66aad4ff:::benchmark_data_smithi188_77607_object114561:head# 2024-04-01T19:28:50.132 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.132 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66ab7766:::benchmark_data_smithi188_77607_object142632:head# 2024-04-01T19:28:50.132 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.133 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66ad233d:::benchmark_data_smithi188_77607_object124969:head# 2024-04-01T19:28:50.133 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.133 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66ad2f02:::benchmark_data_smithi188_77607_object135717:head# 2024-04-01T19:28:50.133 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.133 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66adea05:::benchmark_data_smithi188_77607_object166611:head# 2024-04-01T19:28:50.133 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.133 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66ae6090:::benchmark_data_smithi188_77607_object110059:head# 2024-04-01T19:28:50.133 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.133 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66b010d2:::benchmark_data_smithi188_77607_object120081:head# 2024-04-01T19:28:50.133 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.133 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66b13bd5:::benchmark_data_smithi188_77607_object120041:head# 2024-04-01T19:28:50.133 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.133 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66b19e25:::benchmark_data_smithi188_77607_object161616:head# 2024-04-01T19:28:50.133 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.133 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66b53b90:::benchmark_data_smithi188_77607_object163090:head# 2024-04-01T19:28:50.134 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.136 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66b5e4ea:::benchmark_data_smithi188_77607_object117275:head# 2024-04-01T19:28:50.137 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.137 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66b64445:::benchmark_data_smithi188_77607_object123474:head# 2024-04-01T19:28:50.137 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.137 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66b645ba:::benchmark_data_smithi188_77607_object104761:head# 2024-04-01T19:28:50.137 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.137 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66b68513:::benchmark_data_smithi188_77607_object118542:head# 2024-04-01T19:28:50.137 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.137 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66b68e5b:::benchmark_data_smithi188_77607_object141543:head# 2024-04-01T19:28:50.137 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.137 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66b95bd7:::benchmark_data_smithi188_77607_object123759:head# 2024-04-01T19:28:50.137 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.137 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66ba29dd:::benchmark_data_smithi188_77607_object118803:head# 2024-04-01T19:28:50.137 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.137 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66ba561d:::benchmark_data_smithi188_77607_object131972:head# 2024-04-01T19:28:50.137 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.138 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66ba899c:::benchmark_data_smithi188_77607_object132001:head# 2024-04-01T19:28:50.138 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.138 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66bc0b9d:::benchmark_data_smithi188_77607_object150890:head# 2024-04-01T19:28:50.138 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.138 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66bc68f1:::benchmark_data_smithi188_77607_object135779:head# 2024-04-01T19:28:50.138 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.138 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66bcdb04:::benchmark_data_smithi188_77607_object144060:head# 2024-04-01T19:28:50.138 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.138 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66be2194:::benchmark_data_smithi188_77607_object150577:head# 2024-04-01T19:28:50.138 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.138 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66beed5c:::benchmark_data_smithi188_77607_object114117:head# 2024-04-01T19:28:50.138 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.138 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66bf3244:::benchmark_data_smithi188_77607_object155220:head# 2024-04-01T19:28:50.138 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.139 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66c006e6:::benchmark_data_smithi188_77607_object107123:head# 2024-04-01T19:28:50.139 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.139 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66c007d0:::benchmark_data_smithi188_77607_object101763:head# 2024-04-01T19:28:50.139 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.139 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66c13fef:::benchmark_data_smithi188_77607_object162612:head# 2024-04-01T19:28:50.139 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.139 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66c3e4b8:::benchmark_data_smithi188_77607_object150825:head# 2024-04-01T19:28:50.139 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.139 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66c3eedf:::benchmark_data_smithi188_77607_object100569:head# 2024-04-01T19:28:50.139 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.143 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66c411d6:::benchmark_data_smithi188_77607_object141512:head# 2024-04-01T19:28:50.143 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.143 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66c464f7:::benchmark_data_smithi188_77607_object118661:head# 2024-04-01T19:28:50.143 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.143 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66c47de5:::benchmark_data_smithi188_77607_object145350:head# 2024-04-01T19:28:50.143 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.143 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66c498f2:::benchmark_data_smithi188_77607_object157496:head# 2024-04-01T19:28:50.144 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.144 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66c4acd0:::benchmark_data_smithi188_77607_object112362:head# 2024-04-01T19:28:50.144 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.144 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66c5f6c5:::benchmark_data_smithi188_77607_object125849:head# 2024-04-01T19:28:50.144 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.144 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66c62e24:::benchmark_data_smithi188_77607_object147284:head# 2024-04-01T19:28:50.144 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.144 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66c6e459:::benchmark_data_smithi188_77607_object101096:head# 2024-04-01T19:28:50.144 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.144 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66c84be9:::benchmark_data_smithi188_77607_object106187:head# 2024-04-01T19:28:50.144 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.144 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66cc0397:::benchmark_data_smithi188_77607_object156548:head# 2024-04-01T19:28:50.144 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.144 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66cd10ab:::benchmark_data_smithi188_77607_object165029:head# 2024-04-01T19:28:50.144 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.145 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66cd471c:::benchmark_data_smithi188_77607_object98297:head# 2024-04-01T19:28:50.145 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.145 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66cebef0:::benchmark_data_smithi188_77607_object137682:head# 2024-04-01T19:28:50.145 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.145 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66d1373e:::benchmark_data_smithi188_77607_object122531:head# 2024-04-01T19:28:50.145 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.145 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66d3a65e:::benchmark_data_smithi188_77607_object142669:head# 2024-04-01T19:28:50.145 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.145 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66d4412f:::benchmark_data_smithi188_77607_object119382:head# 2024-04-01T19:28:50.145 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.145 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66d48056:::benchmark_data_smithi188_77607_object155518:head# 2024-04-01T19:28:50.145 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.145 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66d5a068:::benchmark_data_smithi188_77607_object131785:head# 2024-04-01T19:28:50.145 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.145 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66d5e8dd:::benchmark_data_smithi188_77607_object129477:head# 2024-04-01T19:28:50.146 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.146 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66d625f9:::benchmark_data_smithi188_77607_object158483:head# 2024-04-01T19:28:50.146 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.146 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66d6f6a0:::benchmark_data_smithi188_77607_object103572:head# 2024-04-01T19:28:50.146 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.146 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66d8d493:::benchmark_data_smithi188_77607_object139409:head# 2024-04-01T19:28:50.146 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.146 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66d90de3:::benchmark_data_smithi188_77607_object127699:head# 2024-04-01T19:28:50.146 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.146 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66da49f9:::benchmark_data_smithi188_77607_object102630:head# 2024-04-01T19:28:50.146 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.146 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66dad271:::benchmark_data_smithi188_77607_object161058:head# 2024-04-01T19:28:50.146 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.146 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66dbd210:::benchmark_data_smithi188_77607_object166984:head# 2024-04-01T19:28:50.147 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.147 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:28:50.147 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:28:50.152 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66dc2332:::benchmark_data_smithi188_77607_object124761:head# 2024-04-01T19:28:50.153 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.153 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66dc3acf:::benchmark_data_smithi188_77607_object157304:head# 2024-04-01T19:28:50.153 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.153 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66dcccca:::benchmark_data_smithi188_77607_object132647:head# 2024-04-01T19:28:50.153 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.153 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66ddab79:::benchmark_data_smithi188_77607_object130733:head# 2024-04-01T19:28:50.153 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.153 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66df8ce7:::benchmark_data_smithi188_77607_object132206:head# 2024-04-01T19:28:50.153 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.153 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66dfa998:::benchmark_data_smithi188_77607_object120721:head# 2024-04-01T19:28:50.153 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.153 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66dfec73:::benchmark_data_smithi188_77607_object118566:head# 2024-04-01T19:28:50.153 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.153 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66dffef4:::benchmark_data_smithi188_77607_object158416:head# 2024-04-01T19:28:50.153 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.154 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66e009e3:::benchmark_data_smithi188_77607_object165585:head# 2024-04-01T19:28:50.154 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.154 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66e08cef:::benchmark_data_smithi188_77607_object110892:head# 2024-04-01T19:28:50.154 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.154 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66e251cc:::benchmark_data_smithi188_77607_object148339:head# 2024-04-01T19:28:50.154 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.154 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66e2c400:::benchmark_data_smithi188_77607_object136706:head# 2024-04-01T19:28:50.154 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.154 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66e2e74c:::benchmark_data_smithi188_77607_object103380:head# 2024-04-01T19:28:50.154 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.154 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66e34a64:::benchmark_data_smithi188_77607_object156541:head# 2024-04-01T19:28:50.154 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.154 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66e3c94e:::benchmark_data_smithi188_77607_object101467:head# 2024-04-01T19:28:50.154 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.155 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66e48de7:::benchmark_data_smithi188_77607_object145927:head# 2024-04-01T19:28:50.155 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.155 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66e4ab29:::benchmark_data_smithi188_77607_object133750:head# 2024-04-01T19:28:50.155 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.155 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66e519d3:::benchmark_data_smithi188_77607_object141749:head# 2024-04-01T19:28:50.155 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.155 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66e532a1:::benchmark_data_smithi188_77607_object120866:head# 2024-04-01T19:28:50.155 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.155 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66e5b652:::benchmark_data_smithi188_77607_object165320:head# 2024-04-01T19:28:50.155 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.155 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66e68852:::benchmark_data_smithi188_77607_object155158:head# 2024-04-01T19:28:50.155 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.155 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66e724cc:::benchmark_data_smithi188_77607_object119347:head# 2024-04-01T19:28:50.155 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.155 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66e85fc8:::benchmark_data_smithi188_77607_object108657:head# 2024-04-01T19:28:50.156 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.156 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66e89699:::benchmark_data_smithi188_77607_object161724:head# 2024-04-01T19:28:50.156 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.156 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66ea354a:::benchmark_data_smithi188_77607_object147276:head# 2024-04-01T19:28:50.156 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.156 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66eade61:::benchmark_data_smithi188_77607_object164134:head# 2024-04-01T19:28:50.156 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.156 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66ec95c8:::benchmark_data_smithi188_77607_object128184:head# 2024-04-01T19:28:50.156 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.156 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66ee4564:::benchmark_data_smithi188_77607_object132111:head# 2024-04-01T19:28:50.156 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.156 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66ee7297:::benchmark_data_smithi188_77607_object109131:head# 2024-04-01T19:28:50.156 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.156 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66f26f49:::benchmark_data_smithi188_77607_object132193:head# 2024-04-01T19:28:50.156 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.157 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66f5a59b:::benchmark_data_smithi188_77607_object146415:head# 2024-04-01T19:28:50.157 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.157 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66f839ab:::benchmark_data_smithi188_77607_object155242:head# 2024-04-01T19:28:50.157 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.157 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66f849b7:::benchmark_data_smithi188_77607_object129689:head# 2024-04-01T19:28:50.157 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.157 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66f8aca8:::benchmark_data_smithi188_77607_object127612:head# 2024-04-01T19:28:50.157 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.157 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66f8d661:::benchmark_data_smithi188_77607_object103093:head# 2024-04-01T19:28:50.157 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.157 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66f8e9eb:::benchmark_data_smithi188_77607_object125763:head# 2024-04-01T19:28:50.157 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.157 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66f9cb81:::benchmark_data_smithi188_77607_object121249:head# 2024-04-01T19:28:50.157 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.157 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66fa2636:::benchmark_data_smithi188_77607_object156483:head# 2024-04-01T19:28:50.157 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.158 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:50.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:49 smithi022 ceph-mon[39439]: pgmap v536: 17 pgs: 17 active+clean; 3.8 GiB data, 8.4 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 816 op/s; 30 MiB/s, 474 objects/s recovering 2024-04-01T19:28:50.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:49 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3732884545' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:28:50.160 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:28:50.162 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66fb7559:::benchmark_data_smithi188_77607_object127336:head# 2024-04-01T19:28:50.162 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.162 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66fb87ea:::benchmark_data_smithi188_77607_object117559:head# 2024-04-01T19:28:50.162 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.162 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66fc9dd1:::benchmark_data_smithi188_77607_object144100:head# 2024-04-01T19:28:50.162 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.162 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66fcc38d:::benchmark_data_smithi188_77607_object106655:head# 2024-04-01T19:28:50.162 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.162 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66fcce14:::benchmark_data_smithi188_77607_object114285:head# 2024-04-01T19:28:50.162 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.162 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66fd0b8b:::benchmark_data_smithi188_77607_object164880:head# 2024-04-01T19:28:50.163 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.163 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66fd0df8:::benchmark_data_smithi188_77607_object126436:head# 2024-04-01T19:28:50.163 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.163 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66fd8d28:::benchmark_data_smithi188_77607_object127284:head# 2024-04-01T19:28:50.163 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.163 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:66fdb2ba:::benchmark_data_smithi188_77607_object117769:head# 2024-04-01T19:28:50.163 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.163 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6704f3b1:::benchmark_data_smithi188_77607_object105562:head# 2024-04-01T19:28:50.163 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.163 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6705c033:::benchmark_data_smithi188_77607_object124990:head# 2024-04-01T19:28:50.163 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.163 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67064c71:::benchmark_data_smithi188_77607_object104457:head# 2024-04-01T19:28:50.163 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.163 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:670816ec:::benchmark_data_smithi188_77607_object120258:head# 2024-04-01T19:28:50.163 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.163 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6708c556:::benchmark_data_smithi188_77607_object161418:head# 2024-04-01T19:28:50.164 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.164 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6709bbf8:::benchmark_data_smithi188_77607_object125177:head# 2024-04-01T19:28:50.164 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.164 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:670a9ae6:::benchmark_data_smithi188_77607_object141830:head# 2024-04-01T19:28:50.164 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.164 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:670c087e:::benchmark_data_smithi188_77607_object112519:head# 2024-04-01T19:28:50.164 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.164 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:670c707e:::benchmark_data_smithi188_77607_object101447:head# 2024-04-01T19:28:50.164 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.164 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:670e5078:::benchmark_data_smithi188_77607_object156624:head# 2024-04-01T19:28:50.164 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.165 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:28:50.166 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:670ec63a:::benchmark_data_smithi188_77607_object129859:head# 2024-04-01T19:28:50.167 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.167 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:671060ae:::benchmark_data_smithi188_77607_object155593:head# 2024-04-01T19:28:50.167 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.167 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6710919c:::benchmark_data_smithi188_77607_object106417:head# 2024-04-01T19:28:50.167 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.167 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67116882:::benchmark_data_smithi188_77607_object153365:head# 2024-04-01T19:28:50.167 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.167 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67131e8b:::benchmark_data_smithi188_77607_object161118:head# 2024-04-01T19:28:50.167 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.167 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6714a71a:::benchmark_data_smithi188_77607_object109487:head# 2024-04-01T19:28:50.167 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.167 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6715be43:::benchmark_data_smithi188_77607_object141470:head# 2024-04-01T19:28:50.167 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.167 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6717666d:::benchmark_data_smithi188_77607_object124443:head# 2024-04-01T19:28:50.168 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.168 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6717c160:::benchmark_data_smithi188_77607_object102338:head# 2024-04-01T19:28:50.168 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.168 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:671850de:::benchmark_data_smithi188_77607_object153297:head# 2024-04-01T19:28:50.168 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.168 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:671a061d:::benchmark_data_smithi188_77607_object128342:head# 2024-04-01T19:28:50.168 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.168 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:671a6f68:::benchmark_data_smithi188_77607_object131295:head# 2024-04-01T19:28:50.168 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.170 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:671a7a2c:::benchmark_data_smithi188_77607_object161470:head# 2024-04-01T19:28:50.170 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.170 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:671d1d6b:::benchmark_data_smithi188_77607_object165071:head# 2024-04-01T19:28:50.170 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.170 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:671d3c41:::benchmark_data_smithi188_77607_object152062:head# 2024-04-01T19:28:50.170 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.170 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:671edb34:::benchmark_data_smithi188_77607_object114666:head# 2024-04-01T19:28:50.170 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.170 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:671f116f:::benchmark_data_smithi188_77607_object119020:head# 2024-04-01T19:28:50.171 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.171 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:671f1d6f:::benchmark_data_smithi188_77607_object111682:head# 2024-04-01T19:28:50.171 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.171 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:671f53c3:::benchmark_data_smithi188_77607_object107978:head# 2024-04-01T19:28:50.171 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.171 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:671f9c00:::benchmark_data_smithi188_77607_object121078:head# 2024-04-01T19:28:50.171 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.171 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67201727:::benchmark_data_smithi188_77607_object112327:head# 2024-04-01T19:28:50.171 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.171 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6721a77b:::benchmark_data_smithi188_77607_object136780:head# 2024-04-01T19:28:50.171 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.171 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67233949:::benchmark_data_smithi188_77607_object144001:head# 2024-04-01T19:28:50.171 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.172 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:672572da:::benchmark_data_smithi188_77607_object148617:head# 2024-04-01T19:28:50.172 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.172 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67273978:::benchmark_data_smithi188_77607_object128612:head# 2024-04-01T19:28:50.172 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.174 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67279308:::benchmark_data_smithi188_77607_object150905:head# 2024-04-01T19:28:50.174 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.174 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6728f342:::benchmark_data_smithi188_77607_object135345:head# 2024-04-01T19:28:50.174 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.174 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:672918d6:::benchmark_data_smithi188_77607_object136478:head# 2024-04-01T19:28:50.174 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.174 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6729cf03:::benchmark_data_smithi188_77607_object129424:head# 2024-04-01T19:28:50.175 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.175 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:672acd91:::benchmark_data_smithi188_77607_object112466:head# 2024-04-01T19:28:50.175 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.175 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:672b26e0:::benchmark_data_smithi188_77607_object154185:head# 2024-04-01T19:28:50.175 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.175 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:672bb649:::benchmark_data_smithi188_77607_object106720:head# 2024-04-01T19:28:50.175 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.175 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:672c07a6:::benchmark_data_smithi188_77607_object135691:head# 2024-04-01T19:28:50.175 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.175 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:672c2bec:::benchmark_data_smithi188_77607_object112925:head# 2024-04-01T19:28:50.175 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.175 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:672d290d:::benchmark_data_smithi188_77607_object97906:head# 2024-04-01T19:28:50.175 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.175 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:672f98b6:::benchmark_data_smithi188_77607_object137652:head# 2024-04-01T19:28:50.175 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.175 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:672fa5fc:::benchmark_data_smithi188_77607_object116192:head# 2024-04-01T19:28:50.176 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.176 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:673146e2:::benchmark_data_smithi188_77607_object108192:head# 2024-04-01T19:28:50.176 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.176 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6731e7c5:::benchmark_data_smithi188_77607_object150500:head# 2024-04-01T19:28:50.176 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.176 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6732a6ab:::benchmark_data_smithi188_77607_object129280:head# 2024-04-01T19:28:50.176 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.176 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:673384f7:::benchmark_data_smithi188_77607_object99077:head# 2024-04-01T19:28:50.176 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.177 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:673521fa:::benchmark_data_smithi188_77607_object164492:head# 2024-04-01T19:28:50.178 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.178 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67353f86:::benchmark_data_smithi188_77607_object99782:head# 2024-04-01T19:28:50.178 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.178 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6735d1b4:::benchmark_data_smithi188_77607_object124202:head# 2024-04-01T19:28:50.178 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.178 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6735d7f6:::benchmark_data_smithi188_77607_object154234:head# 2024-04-01T19:28:50.178 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.178 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:673712fc:::benchmark_data_smithi188_77607_object163152:head# 2024-04-01T19:28:50.178 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.178 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67373694:::benchmark_data_smithi188_77607_object98539:head# 2024-04-01T19:28:50.178 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.178 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6739a6fd:::benchmark_data_smithi188_77607_object102593:head# 2024-04-01T19:28:50.179 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.179 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:673b0a90:::benchmark_data_smithi188_77607_object123224:head# 2024-04-01T19:28:50.179 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.179 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:673beee3:::benchmark_data_smithi188_77607_object107355:head# 2024-04-01T19:28:50.179 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.179 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:673e354c:::benchmark_data_smithi188_77607_object137622:head# 2024-04-01T19:28:50.179 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.180 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:673fc452:::benchmark_data_smithi188_77607_object156323:head# 2024-04-01T19:28:50.180 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.180 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67418684:::benchmark_data_smithi188_77607_object147987:head# 2024-04-01T19:28:50.181 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.181 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6743f7f1:::benchmark_data_smithi188_77607_object101792:head# 2024-04-01T19:28:50.181 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.181 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6744e299:::benchmark_data_smithi188_77607_object117443:head# 2024-04-01T19:28:50.181 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.181 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6745216c:::benchmark_data_smithi188_77607_object150869:head# 2024-04-01T19:28:50.181 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.181 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67453aff:::benchmark_data_smithi188_77607_object156098:head# 2024-04-01T19:28:50.181 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.181 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:674751b5:::benchmark_data_smithi188_77607_object127289:head# 2024-04-01T19:28:50.181 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.181 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67489bcf:::benchmark_data_smithi188_77607_object119176:head# 2024-04-01T19:28:50.181 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.181 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6749ab93:::benchmark_data_smithi188_77607_object141736:head# 2024-04-01T19:28:50.182 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.182 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:674a783a:::benchmark_data_smithi188_77607_object105704:head# 2024-04-01T19:28:50.182 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.182 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:674b8c14:::benchmark_data_smithi188_77607_object144952:head# 2024-04-01T19:28:50.182 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.182 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:674b908e:::benchmark_data_smithi188_77607_object128924:head# 2024-04-01T19:28:50.182 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.182 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:674bab87:::benchmark_data_smithi188_77607_object111934:head# 2024-04-01T19:28:50.182 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.184 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:674d377e:::benchmark_data_smithi188_77607_object116923:head# 2024-04-01T19:28:50.184 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.184 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:674d6878:::benchmark_data_smithi188_77607_object109058:head# 2024-04-01T19:28:50.184 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.184 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:674d93e9:::benchmark_data_smithi188_77607_object151325:head# 2024-04-01T19:28:50.185 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.185 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:674dbbcc:::benchmark_data_smithi188_77607_object147726:head# 2024-04-01T19:28:50.185 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.185 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:674e0719:::benchmark_data_smithi188_77607_object101909:head# 2024-04-01T19:28:50.185 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.185 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6750bd0d:::benchmark_data_smithi188_77607_object112753:head# 2024-04-01T19:28:50.185 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.185 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67519f80:::benchmark_data_smithi188_77607_object161275:head# 2024-04-01T19:28:50.185 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.185 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67521e96:::benchmark_data_smithi188_77607_object152981:head# 2024-04-01T19:28:50.185 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.185 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67525c3a:::benchmark_data_smithi188_77607_object129157:head# 2024-04-01T19:28:50.185 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.185 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6752e326:::benchmark_data_smithi188_77607_object104898:head# 2024-04-01T19:28:50.185 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.185 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6754a87d:::benchmark_data_smithi188_77607_object166186:head# 2024-04-01T19:28:50.186 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.186 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6755960a:::benchmark_data_smithi188_77607_object135294:head# 2024-04-01T19:28:50.186 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.186 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67565768:::benchmark_data_smithi188_77607_object98075:head# 2024-04-01T19:28:50.186 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.186 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67577f76:::benchmark_data_smithi188_77607_object120888:head# 2024-04-01T19:28:50.186 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.186 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6757c1c2:::benchmark_data_smithi188_77607_object122754:head# 2024-04-01T19:28:50.186 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.188 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67584c60:::benchmark_data_smithi188_77607_object125211:head# 2024-04-01T19:28:50.188 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.188 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6758724d:::benchmark_data_smithi188_77607_object116144:head# 2024-04-01T19:28:50.189 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.189 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6759db63:::benchmark_data_smithi188_77607_object143751:head# 2024-04-01T19:28:50.189 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.189 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:675a1794:::benchmark_data_smithi188_77607_object153431:head# 2024-04-01T19:28:50.189 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.189 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:675c427e:::benchmark_data_smithi188_77607_object106733:head# 2024-04-01T19:28:50.189 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.189 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:675de55a:::benchmark_data_smithi188_77607_object142347:head# 2024-04-01T19:28:50.189 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.189 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:675ebc43:::benchmark_data_smithi188_77607_object152489:head# 2024-04-01T19:28:50.189 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.189 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:675f5afa:::benchmark_data_smithi188_77607_object158622:head# 2024-04-01T19:28:50.189 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.189 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6760474a:::benchmark_data_smithi188_77607_object163687:head# 2024-04-01T19:28:50.189 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.190 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67612d18:::benchmark_data_smithi188_77607_object132470:head# 2024-04-01T19:28:50.190 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.190 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6762d21e:::benchmark_data_smithi188_77607_object136271:head# 2024-04-01T19:28:50.190 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.190 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:676623bd:::benchmark_data_smithi188_77607_object122316:head# 2024-04-01T19:28:50.190 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.190 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:676641f9:::benchmark_data_smithi188_77607_object108867:head# 2024-04-01T19:28:50.190 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.190 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67672656:::benchmark_data_smithi188_77607_object121981:head# 2024-04-01T19:28:50.190 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.190 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6767edaf:::benchmark_data_smithi188_77607_object104862:head# 2024-04-01T19:28:50.190 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.193 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6768bf15:::benchmark_data_smithi188_77607_object164182:head# 2024-04-01T19:28:50.193 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.193 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6768f46d:::benchmark_data_smithi188_77607_object150831:head# 2024-04-01T19:28:50.193 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.193 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6769730b:::benchmark_data_smithi188_77607_object102413:head# 2024-04-01T19:28:50.193 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.193 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:676976ac:::benchmark_data_smithi188_77607_object116975:head# 2024-04-01T19:28:50.193 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.194 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6769f17b:::benchmark_data_smithi188_77607_object149791:head# 2024-04-01T19:28:50.194 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.194 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:676c5c4c:::benchmark_data_smithi188_77607_object133833:head# 2024-04-01T19:28:50.194 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.194 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:676d9b3e:::benchmark_data_smithi188_77607_object121168:head# 2024-04-01T19:28:50.194 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.194 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:676f4f66:::benchmark_data_smithi188_77607_object122228:head# 2024-04-01T19:28:50.194 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.194 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67714286:::benchmark_data_smithi188_77607_object104689:head# 2024-04-01T19:28:50.194 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.194 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6771df0e:::benchmark_data_smithi188_77607_object146742:head# 2024-04-01T19:28:50.194 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.194 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6771ebf8:::benchmark_data_smithi188_77607_object147918:head# 2024-04-01T19:28:50.194 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.194 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6772b5e3:::benchmark_data_smithi188_77607_object142482:head# 2024-04-01T19:28:50.195 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.195 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6773165b:::benchmark_data_smithi188_77607_object116893:head# 2024-04-01T19:28:50.195 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.195 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:677395f7:::benchmark_data_smithi188_77607_object165587:head# 2024-04-01T19:28:50.195 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.195 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6773df95:::benchmark_data_smithi188_77607_object127005:head# 2024-04-01T19:28:50.195 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.195 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6775b2cc:::benchmark_data_smithi188_77607_object144068:head# 2024-04-01T19:28:50.195 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.195 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6776434b:::benchmark_data_smithi188_77607_object160791:head# 2024-04-01T19:28:50.195 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.198 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67779f86:::benchmark_data_smithi188_77607_object134422:head# 2024-04-01T19:28:50.198 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.198 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6778014c:::benchmark_data_smithi188_77607_object161686:head# 2024-04-01T19:28:50.198 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.198 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:677881af:::benchmark_data_smithi188_77607_object151841:head# 2024-04-01T19:28:50.198 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.198 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6778b8a8:::benchmark_data_smithi188_77607_object117621:head# 2024-04-01T19:28:50.198 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.198 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:677ade9a:::benchmark_data_smithi188_77607_object132332:head# 2024-04-01T19:28:50.198 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.198 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:677b16cc:::benchmark_data_smithi188_77607_object118638:head# 2024-04-01T19:28:50.199 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.199 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:677bee46:::benchmark_data_smithi188_77607_object163171:head# 2024-04-01T19:28:50.199 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.199 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:677c2895:::benchmark_data_smithi188_77607_object107754:head# 2024-04-01T19:28:50.199 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.199 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:677cfedf:::benchmark_data_smithi188_77607_object112035:head# 2024-04-01T19:28:50.199 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.199 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:677d19f8:::benchmark_data_smithi188_77607_object116120:head# 2024-04-01T19:28:50.199 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.199 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:677de2d8:::benchmark_data_smithi188_77607_object144962:head# 2024-04-01T19:28:50.199 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.199 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:677df5de:::benchmark_data_smithi188_77607_object127999:head# 2024-04-01T19:28:50.199 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.199 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:677e3f44:::benchmark_data_smithi188_77607_object127313:head# 2024-04-01T19:28:50.200 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.200 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6780f35e:::benchmark_data_smithi188_77607_object111999:head# 2024-04-01T19:28:50.200 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.200 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6782c31a:::benchmark_data_smithi188_77607_object146556:head# 2024-04-01T19:28:50.200 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.200 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67849cb2:::benchmark_data_smithi188_77607_object156395:head# 2024-04-01T19:28:50.200 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.200 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6785416d:::benchmark_data_smithi188_77607_object145405:head# 2024-04-01T19:28:50.200 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.200 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6786b39c:::benchmark_data_smithi188_77607_object104300:head# 2024-04-01T19:28:50.200 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.203 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6787b1d7:::benchmark_data_smithi188_77607_object116229:head# 2024-04-01T19:28:50.203 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.203 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6788db0c:::benchmark_data_smithi188_77607_object120293:head# 2024-04-01T19:28:50.203 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.203 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67892afd:::benchmark_data_smithi188_77607_object118317:head# 2024-04-01T19:28:50.203 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.203 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6789d4f3:::benchmark_data_smithi188_77607_object134011:head# 2024-04-01T19:28:50.203 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.203 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:678a2531:::benchmark_data_smithi188_77607_object143345:head# 2024-04-01T19:28:50.203 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:678bf686:::benchmark_data_smithi188_77607_object125032:head# 2024-04-01T19:28:50.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:678c9b6e:::benchmark_data_smithi188_77607_object163099:head# 2024-04-01T19:28:50.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:678cc2d8:::benchmark_data_smithi188_77607_object114190:head# 2024-04-01T19:28:50.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:678d5a2f:::benchmark_data_smithi188_77607_object108322:head# 2024-04-01T19:28:50.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:678ddfcf:::benchmark_data_smithi188_77607_object115513:head# 2024-04-01T19:28:50.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67905e1f:::benchmark_data_smithi188_77607_object132306:head# 2024-04-01T19:28:50.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:679076a8:::benchmark_data_smithi188_77607_object154235:head# 2024-04-01T19:28:50.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6791512f:::benchmark_data_smithi188_77607_object144424:head# 2024-04-01T19:28:50.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.205 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:679168a7:::benchmark_data_smithi188_77607_object133252:head# 2024-04-01T19:28:50.205 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.205 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6792a544:::benchmark_data_smithi188_77607_object134499:head# 2024-04-01T19:28:50.205 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.205 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:679302e3:::benchmark_data_smithi188_77607_object110215:head# 2024-04-01T19:28:50.205 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.205 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6793a8be:::benchmark_data_smithi188_77607_object140052:head# 2024-04-01T19:28:50.205 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.205 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6795cca9:::benchmark_data_smithi188_77607_object123477:head# 2024-04-01T19:28:50.205 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.205 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6796d0fe:::benchmark_data_smithi188_77607_object110376:head# 2024-04-01T19:28:50.205 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.205 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6797899b:::benchmark_data_smithi188_77607_object111728:head# 2024-04-01T19:28:50.205 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.206 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:679a884c:::benchmark_data_smithi188_77607_object146748:head# 2024-04-01T19:28:50.206 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.206 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:679adb11:::benchmark_data_smithi188_77607_object134517:head# 2024-04-01T19:28:50.206 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.206 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:679b24f8:::benchmark_data_smithi188_77607_object108428:head# 2024-04-01T19:28:50.206 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.207 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:679be32e:::benchmark_data_smithi188_77607_object142963:head# 2024-04-01T19:28:50.207 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.209 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:679c1af3:::benchmark_data_smithi188_77607_object147196:head# 2024-04-01T19:28:50.210 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.210 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:679c78b9:::benchmark_data_smithi188_77607_object112561:head# 2024-04-01T19:28:50.210 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.210 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:679d292b:::benchmark_data_smithi188_77607_object123525:head# 2024-04-01T19:28:50.210 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.210 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:679eeb38:::benchmark_data_smithi188_77607_object142713:head# 2024-04-01T19:28:50.210 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.210 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67a10d3a:::benchmark_data_smithi188_77607_object127368:head# 2024-04-01T19:28:50.210 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.210 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67a242d6:::benchmark_data_smithi188_77607_object167061:head# 2024-04-01T19:28:50.210 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.210 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67a27e22:::benchmark_data_smithi188_77607_object119037:head# 2024-04-01T19:28:50.210 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.210 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67a31594:::benchmark_data_smithi188_77607_object160302:head# 2024-04-01T19:28:50.211 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.211 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67a5c3bf:::benchmark_data_smithi188_77607_object151451:head# 2024-04-01T19:28:50.211 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.211 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67a7a86e:::benchmark_data_smithi188_77607_object125473:head# 2024-04-01T19:28:50.211 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.211 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67a84b62:::benchmark_data_smithi188_77607_object107340:head# 2024-04-01T19:28:50.211 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.211 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67a8abad:::benchmark_data_smithi188_77607_object134751:head# 2024-04-01T19:28:50.211 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.211 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67a8bea9:::benchmark_data_smithi188_77607_object126297:head# 2024-04-01T19:28:50.211 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.211 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67ab5147:::benchmark_data_smithi188_77607_object129528:head# 2024-04-01T19:28:50.211 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.211 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67abfa64:::benchmark_data_smithi188_77607_object115652:head# 2024-04-01T19:28:50.211 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.212 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67ac5a53:::benchmark_data_smithi188_77607_object126408:head# 2024-04-01T19:28:50.212 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.212 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67ac98cd:::benchmark_data_smithi188_77607_object141976:head# 2024-04-01T19:28:50.212 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.212 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:28:50.212 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67acdf33:::benchmark_data_smithi188_77607_object150343:head# 2024-04-01T19:28:50.213 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.213 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:28:50.213 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:28:50.213 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:28:50.213 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:28:50.213 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:28:50.213 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:28:50.213 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:28:50.213 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:28:50.213 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.8 2024-04-01T19:28:50.213 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:28:50.213 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:28:50.213 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:28:50.216 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67ad033f:::benchmark_data_smithi188_77607_object108274:head# 2024-04-01T19:28:50.216 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.219 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67ad0803:::benchmark_data_smithi188_77607_object135463:head# 2024-04-01T19:28:50.219 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.220 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67ad5f4b:::benchmark_data_smithi188_77607_object153896:head# 2024-04-01T19:28:50.220 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.220 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67ad97b7:::benchmark_data_smithi188_77607_object125665:head# 2024-04-01T19:28:50.220 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.220 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67adabe4:::benchmark_data_smithi188_77607_object146726:head# 2024-04-01T19:28:50.220 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.225 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67af2093:::benchmark_data_smithi188_77607_object166187:head# 2024-04-01T19:28:50.225 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.226 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67af6eeb:::benchmark_data_smithi188_77607_object120024:head# 2024-04-01T19:28:50.226 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.226 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67afcf9d:::benchmark_data_smithi188_77607_object153066:head# 2024-04-01T19:28:50.226 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.226 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67b17843:::benchmark_data_smithi188_77607_object144854:head# 2024-04-01T19:28:50.226 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.227 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67b1ef63:::benchmark_data_smithi188_77607_object101821:head# 2024-04-01T19:28:50.227 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.227 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67b24231:::benchmark_data_smithi188_77607_object99504:head# 2024-04-01T19:28:50.227 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.229 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67b3e99b:::benchmark_data_smithi188_77607_object135855:head# 2024-04-01T19:28:50.229 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.229 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67b3ffc7:::benchmark_data_smithi188_77607_object112611:head# 2024-04-01T19:28:50.229 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.229 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67b4b564:::benchmark_data_smithi188_77607_object100413:head# 2024-04-01T19:28:50.229 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.229 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67b5c194:::benchmark_data_smithi188_77607_object166819:head# 2024-04-01T19:28:50.230 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.230 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67b82f33:::benchmark_data_smithi188_77607_object126394:head# 2024-04-01T19:28:50.230 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.230 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67b86c63:::benchmark_data_smithi188_77607_object108509:head# 2024-04-01T19:28:50.230 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.230 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67bdba11:::benchmark_data_smithi188_77607_object108063:head# 2024-04-01T19:28:50.230 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.232 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67be10d7:::benchmark_data_smithi188_77607_object125831:head# 2024-04-01T19:28:50.232 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.232 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67be4bf8:::benchmark_data_smithi188_77607_object135983:head# 2024-04-01T19:28:50.232 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.232 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67bfc339:::benchmark_data_smithi188_77607_object139527:head# 2024-04-01T19:28:50.232 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.232 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67bfd7f5:::benchmark_data_smithi188_77607_object100671:head# 2024-04-01T19:28:50.232 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.232 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67c0b88c:::benchmark_data_smithi188_77607_object157509:head# 2024-04-01T19:28:50.233 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.233 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67c2d7ac:::benchmark_data_smithi188_77607_object140822:head# 2024-04-01T19:28:50.233 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.233 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67c8a706:::benchmark_data_smithi188_77607_object139491:head# 2024-04-01T19:28:50.233 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.233 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67c8f4b5:::benchmark_data_smithi188_77607_object125542:head# 2024-04-01T19:28:50.233 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.233 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67c95dd2:::benchmark_data_smithi188_77607_object164055:head# 2024-04-01T19:28:50.233 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.233 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67cabcfa:::benchmark_data_smithi188_77607_object133464:head# 2024-04-01T19:28:50.233 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.233 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67cbef93:::benchmark_data_smithi188_77607_object123685:head# 2024-04-01T19:28:50.233 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.233 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67cc2f49:::benchmark_data_smithi188_77607_object152501:head# 2024-04-01T19:28:50.233 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.236 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67cdb464:::benchmark_data_smithi188_77607_object100352:head# 2024-04-01T19:28:50.237 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.237 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67cdfab6:::benchmark_data_smithi188_77607_object107671:head# 2024-04-01T19:28:50.237 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.237 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67ce4d17:::benchmark_data_smithi188_77607_object127791:head# 2024-04-01T19:28:50.237 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.237 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67ceded1:::benchmark_data_smithi188_77607_object143615:head# 2024-04-01T19:28:50.237 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.237 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67cef7c1:::benchmark_data_smithi188_77607_object125570:head# 2024-04-01T19:28:50.237 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.237 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67cf33d5:::benchmark_data_smithi188_77607_object139909:head# 2024-04-01T19:28:50.237 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.237 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67cf3dd8:::benchmark_data_smithi188_77607_object137059:head# 2024-04-01T19:28:50.237 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.237 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67d28e3f:::benchmark_data_smithi188_77607_object110074:head# 2024-04-01T19:28:50.238 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.238 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67d44fe9:::benchmark_data_smithi188_77607_object123275:head# 2024-04-01T19:28:50.238 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.238 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67d5401e:::benchmark_data_smithi188_77607_object142809:head# 2024-04-01T19:28:50.238 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.238 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67d5ec2a:::benchmark_data_smithi188_77607_object156862:head# 2024-04-01T19:28:50.238 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.238 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67dca736:::benchmark_data_smithi188_77607_object120934:head# 2024-04-01T19:28:50.238 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.238 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67dd446b:::benchmark_data_smithi188_77607_object111067:head# 2024-04-01T19:28:50.238 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.238 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67de65e5:::benchmark_data_smithi188_77607_object156043:head# 2024-04-01T19:28:50.238 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.238 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67df84bd:::benchmark_data_smithi188_77607_object159121:head# 2024-04-01T19:28:50.239 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.239 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67df95d7:::benchmark_data_smithi188_77607_object126639:head# 2024-04-01T19:28:50.239 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.239 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67dffbbb:::benchmark_data_smithi188_77607_object149789:head# 2024-04-01T19:28:50.239 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.239 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67e10499:::benchmark_data_smithi188_77607_object133739:head# 2024-04-01T19:28:50.239 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.239 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67e15795:::benchmark_data_smithi188_77607_object154432:head# 2024-04-01T19:28:50.239 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.241 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67e322c6:::benchmark_data_smithi188_77607_object107256:head# 2024-04-01T19:28:50.241 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.241 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67e32d12:::benchmark_data_smithi188_77607_object129333:head# 2024-04-01T19:28:50.241 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.241 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67e39452:::benchmark_data_smithi188_77607_object135363:head# 2024-04-01T19:28:50.242 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.242 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67e3f5b1:::benchmark_data_smithi188_77607_object142908:head# 2024-04-01T19:28:50.242 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.242 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67e6d0da:::benchmark_data_smithi188_77607_object122281:head# 2024-04-01T19:28:50.242 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.242 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67e73685:::benchmark_data_smithi188_77607_object166208:head# 2024-04-01T19:28:50.242 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.242 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67e75f69:::benchmark_data_smithi188_77607_object99218:head# 2024-04-01T19:28:50.242 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.242 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67e7d9ad:::benchmark_data_smithi188_77607_object107972:head# 2024-04-01T19:28:50.242 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.242 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67e807b1:::benchmark_data_smithi188_77607_object108941:head# 2024-04-01T19:28:50.242 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.243 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67e8fced:::benchmark_data_smithi188_77607_object167094:head# 2024-04-01T19:28:50.243 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.243 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67e969dd:::benchmark_data_smithi188_77607_object109201:head# 2024-04-01T19:28:50.243 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.243 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67ea20e2:::benchmark_data_smithi188_77607_object120801:head# 2024-04-01T19:28:50.243 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.243 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67eac4d3:::benchmark_data_smithi188_77607_object100260:head# 2024-04-01T19:28:50.243 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.243 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67eb0ab8:::benchmark_data_smithi188_77607_object130044:head# 2024-04-01T19:28:50.243 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.243 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67ec1a9d:::benchmark_data_smithi188_77607_object104307:head# 2024-04-01T19:28:50.243 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.245 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67ec8371:::benchmark_data_smithi188_77607_object166623:head# 2024-04-01T19:28:50.246 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.246 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67ef7584:::benchmark_data_smithi188_77607_object114413:head# 2024-04-01T19:28:50.246 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.246 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67efe1e1:::benchmark_data_smithi188_77607_object104069:head# 2024-04-01T19:28:50.246 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.246 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67f3791c:::benchmark_data_smithi188_77607_object109226:head# 2024-04-01T19:28:50.246 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.246 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67f3d2e2:::benchmark_data_smithi188_77607_object108610:head# 2024-04-01T19:28:50.246 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.246 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67f80651:::benchmark_data_smithi188_77607_object133354:head# 2024-04-01T19:28:50.246 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.246 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67f88be8:::benchmark_data_smithi188_77607_object131140:head# 2024-04-01T19:28:50.247 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.247 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67f8f2f3:::benchmark_data_smithi188_77607_object164998:head# 2024-04-01T19:28:50.247 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.247 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67f8f937:::benchmark_data_smithi188_77607_object107266:head# 2024-04-01T19:28:50.247 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.247 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67f9a585:::benchmark_data_smithi188_77607_object115561:head# 2024-04-01T19:28:50.247 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.247 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67fa18eb:::benchmark_data_smithi188_77607_object123966:head# 2024-04-01T19:28:50.247 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.247 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67fab4ec:::benchmark_data_smithi188_77607_object138220:head# 2024-04-01T19:28:50.247 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.247 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67fb41ab:::benchmark_data_smithi188_77607_object101535:head# 2024-04-01T19:28:50.247 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.247 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67fc3fb8:::benchmark_data_smithi188_77607_object144143:head# 2024-04-01T19:28:50.247 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.248 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67fd2b7c:::benchmark_data_smithi188_77607_object136979:head# 2024-04-01T19:28:50.248 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.248 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67fdfbfd:::benchmark_data_smithi188_77607_object112825:head# 2024-04-01T19:28:50.248 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.248 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67fe829d:::benchmark_data_smithi188_77607_object100530:head# 2024-04-01T19:28:50.248 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.250 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67fea877:::benchmark_data_smithi188_77607_object139656:head# 2024-04-01T19:28:50.250 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.250 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67ff2cd2:::benchmark_data_smithi188_77607_object99226:head# 2024-04-01T19:28:50.250 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.250 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:67ff90eb:::benchmark_data_smithi188_77607_object123353:head# 2024-04-01T19:28:50.250 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.250 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6800135b:::benchmark_data_smithi188_77607_object154639:head# 2024-04-01T19:28:50.250 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.251 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:680140c2:::benchmark_data_smithi188_77607_object145696:head# 2024-04-01T19:28:50.251 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.251 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:680149d9:::benchmark_data_smithi188_77607_object160468:head# 2024-04-01T19:28:50.251 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.251 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68042de5:::benchmark_data_smithi188_77607_object137123:head# 2024-04-01T19:28:50.251 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.251 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6804668c:::benchmark_data_smithi188_77607_object144218:head# 2024-04-01T19:28:50.251 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.251 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:680505d6:::benchmark_data_smithi188_77607_object115711:head# 2024-04-01T19:28:50.251 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.251 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6805b319:::benchmark_data_smithi188_77607_object161901:head# 2024-04-01T19:28:50.251 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.251 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6805dc4b:::benchmark_data_smithi188_77607_object146028:head# 2024-04-01T19:28:50.251 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.251 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68060ab8:::benchmark_data_smithi188_77607_object157589:head# 2024-04-01T19:28:50.252 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.252 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68069605:::benchmark_data_smithi188_77607_object125027:head# 2024-04-01T19:28:50.252 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.252 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68077ef2:::benchmark_data_smithi188_77607_object110068:head# 2024-04-01T19:28:50.252 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.252 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:680793ad:::benchmark_data_smithi188_77607_object126958:head# 2024-04-01T19:28:50.252 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.252 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6807dcd3:::benchmark_data_smithi188_77607_object108865:head# 2024-04-01T19:28:50.252 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.256 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68087b6e:::benchmark_data_smithi188_77607_object104177:head# 2024-04-01T19:28:50.256 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.256 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6809c443:::benchmark_data_smithi188_77607_object161049:head# 2024-04-01T19:28:50.256 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.256 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:680b6492:::benchmark_data_smithi188_77607_object140154:head# 2024-04-01T19:28:50.256 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.256 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:680bfaf9:::benchmark_data_smithi188_77607_object148657:head# 2024-04-01T19:28:50.256 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.256 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:680c3dd9:::benchmark_data_smithi188_77607_object109125:head# 2024-04-01T19:28:50.256 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.256 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:680e66c9:::benchmark_data_smithi188_77607_object117669:head# 2024-04-01T19:28:50.256 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.256 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:680eeb7b:::benchmark_data_smithi188_77607_object114908:head# 2024-04-01T19:28:50.257 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.257 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:680f837c:::benchmark_data_smithi188_77607_object150569:head# 2024-04-01T19:28:50.257 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.257 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68103380:::benchmark_data_smithi188_77607_object137025:head# 2024-04-01T19:28:50.257 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.257 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68128b12:::benchmark_data_smithi188_77607_object146920:head# 2024-04-01T19:28:50.257 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.257 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:681305e0:::benchmark_data_smithi188_77607_object127504:head# 2024-04-01T19:28:50.257 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.257 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6814cf30:::benchmark_data_smithi188_77607_object109239:head# 2024-04-01T19:28:50.257 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.257 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68162e62:::benchmark_data_smithi188_77607_object116392:head# 2024-04-01T19:28:50.257 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.257 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68175a9d:::benchmark_data_smithi188_77607_object137482:head# 2024-04-01T19:28:50.257 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.258 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6818ebea:::benchmark_data_smithi188_77607_object148423:head# 2024-04-01T19:28:50.258 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.258 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:681aaf00:::benchmark_data_smithi188_77607_object151773:head# 2024-04-01T19:28:50.258 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.258 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:681b24dd:::benchmark_data_smithi188_77607_object165411:head# 2024-04-01T19:28:50.258 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.258 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:681ec2e3:::benchmark_data_smithi188_77607_object137227:head# 2024-04-01T19:28:50.258 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.258 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:681f44f8:::benchmark_data_smithi188_77607_object158702:head# 2024-04-01T19:28:50.258 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.258 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68200deb:::benchmark_data_smithi188_77607_object122279:head# 2024-04-01T19:28:50.258 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.258 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6823863f:::benchmark_data_smithi188_77607_object136554:head# 2024-04-01T19:28:50.259 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.259 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6823b974:::benchmark_data_smithi188_77607_object114023:head# 2024-04-01T19:28:50.259 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.259 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:682535ef:::benchmark_data_smithi188_77607_object107627:head# 2024-04-01T19:28:50.259 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.259 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68259c7b:::benchmark_data_smithi188_77607_object167284:head# 2024-04-01T19:28:50.259 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.259 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68264691:::benchmark_data_smithi188_77607_object109254:head# 2024-04-01T19:28:50.259 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.260 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6828e1fe:::benchmark_data_smithi188_77607_object146848:head# 2024-04-01T19:28:50.260 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.260 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6829e0a5:::benchmark_data_smithi188_77607_object145209:head# 2024-04-01T19:28:50.260 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.260 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:682ba803:::benchmark_data_smithi188_77607_object152397:head# 2024-04-01T19:28:50.260 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.260 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:682d206a:::benchmark_data_smithi188_77607_object157586:head# 2024-04-01T19:28:50.260 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.260 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:682d9d82:::benchmark_data_smithi188_77607_object162712:head# 2024-04-01T19:28:50.260 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.260 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:682daede:::benchmark_data_smithi188_77607_object152710:head# 2024-04-01T19:28:50.260 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.261 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68313b10:::benchmark_data_smithi188_77607_object153633:head# 2024-04-01T19:28:50.261 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.261 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:28:50.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:49 smithi062 ceph-mon[44211]: pgmap v536: 17 pgs: 17 active+clean; 3.8 GiB data, 8.4 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 816 op/s; 30 MiB/s, 474 objects/s recovering 2024-04-01T19:28:50.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:49 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3732884545' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:28:50.263 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68317a02:::benchmark_data_smithi188_77607_object153824:head# 2024-04-01T19:28:50.263 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.263 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68320172:::benchmark_data_smithi188_77607_object163748:head# 2024-04-01T19:28:50.263 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.263 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68329ccc:::benchmark_data_smithi188_77607_object149877:head# 2024-04-01T19:28:50.264 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.264 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68335aa4:::benchmark_data_smithi188_77607_object129538:head# 2024-04-01T19:28:50.264 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.264 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:683367c0:::benchmark_data_smithi188_77607_object106652:head# 2024-04-01T19:28:50.264 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.264 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6834881e:::benchmark_data_smithi188_77607_object106824:head# 2024-04-01T19:28:50.264 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.264 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6835a286:::benchmark_data_smithi188_77607_object121837:head# 2024-04-01T19:28:50.264 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.264 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6835b443:::benchmark_data_smithi188_77607_object117085:head# 2024-04-01T19:28:50.264 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.264 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6837b8f4:::benchmark_data_smithi188_77607_object164678:head# 2024-04-01T19:28:50.264 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.264 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6838512e:::benchmark_data_smithi188_77607_object98527:head# 2024-04-01T19:28:50.265 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.265 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:683bed56:::benchmark_data_smithi188_77607_object166180:head# 2024-04-01T19:28:50.265 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.265 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:683c0751:::benchmark_data_smithi188_77607_object140215:head# 2024-04-01T19:28:50.265 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.265 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:683ca8df:::benchmark_data_smithi188_77607_object144016:head# 2024-04-01T19:28:50.265 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.265 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:683d549f:::benchmark_data_smithi188_77607_object101925:head# 2024-04-01T19:28:50.265 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.265 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:683d6adb:::benchmark_data_smithi188_77607_object141953:head# 2024-04-01T19:28:50.265 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.265 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:683e3c80:::benchmark_data_smithi188_77607_object165256:head# 2024-04-01T19:28:50.265 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.265 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:683e546d:::benchmark_data_smithi188_77607_object136952:head# 2024-04-01T19:28:50.265 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.266 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:683ec96d:::benchmark_data_smithi188_77607_object127983:head# 2024-04-01T19:28:50.266 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.266 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:683eeaff:::benchmark_data_smithi188_77607_object113654:head# 2024-04-01T19:28:50.266 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.268 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:683f6e7a:::benchmark_data_smithi188_77607_object133969:head# 2024-04-01T19:28:50.268 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.269 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6840a2f8:::benchmark_data_smithi188_77607_object149501:head# 2024-04-01T19:28:50.269 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.269 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68429d88:::benchmark_data_smithi188_77607_object116273:head# 2024-04-01T19:28:50.269 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.269 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6844d0f0:::benchmark_data_smithi188_77607_object121377:head# 2024-04-01T19:28:50.269 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.270 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6844dbfc:::benchmark_data_smithi188_77607_object161559:head# 2024-04-01T19:28:50.270 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.270 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6845d075:::benchmark_data_smithi188_77607_object103512:head# 2024-04-01T19:28:50.270 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.270 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6846af8e:::benchmark_data_smithi188_77607_object162764:head# 2024-04-01T19:28:50.270 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.270 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68472a43:::benchmark_data_smithi188_77607_object100922:head# 2024-04-01T19:28:50.271 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.271 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:684b3989:::benchmark_data_smithi188_77607_object118939:head# 2024-04-01T19:28:50.271 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.272 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:684c668f:::benchmark_data_smithi188_77607_object110254:head# 2024-04-01T19:28:50.272 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.272 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6850490e:::benchmark_data_smithi188_77607_object98647:head# 2024-04-01T19:28:50.272 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.272 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68527469:::benchmark_data_smithi188_77607_object141784:head# 2024-04-01T19:28:50.272 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.272 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6852bed2:::benchmark_data_smithi188_77607_object128975:head# 2024-04-01T19:28:50.272 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.273 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68533558:::benchmark_data_smithi188_77607_object117602:head# 2024-04-01T19:28:50.273 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.273 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68534fed:::benchmark_data_smithi188_77607_object165011:head# 2024-04-01T19:28:50.273 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.273 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68536eeb:::benchmark_data_smithi188_77607_object138421:head# 2024-04-01T19:28:50.273 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.273 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:685650bd:::benchmark_data_smithi188_77607_object121646:head# 2024-04-01T19:28:50.274 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.274 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6856c373:::benchmark_data_smithi188_77607_object113540:head# 2024-04-01T19:28:50.274 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.274 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:685707e5:::benchmark_data_smithi188_77607_object145675:head# 2024-04-01T19:28:50.274 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.274 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68571448:::benchmark_data_smithi188_77607_object150335:head# 2024-04-01T19:28:50.274 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.275 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6857ef24:::benchmark_data_smithi188_77607_object99876:head# 2024-04-01T19:28:50.275 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.275 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:685a6ca8:::benchmark_data_smithi188_77607_object113754:head# 2024-04-01T19:28:50.275 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.275 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:685ac047:::benchmark_data_smithi188_77607_object151365:head# 2024-04-01T19:28:50.276 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.276 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:685c0514:::benchmark_data_smithi188_77607_object99182:head# 2024-04-01T19:28:50.276 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.276 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:685e8f1e:::benchmark_data_smithi188_77607_object110500:head# 2024-04-01T19:28:50.276 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.276 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:685eb30f:::benchmark_data_smithi188_77607_object112864:head# 2024-04-01T19:28:50.276 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.277 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:685f1d86:::benchmark_data_smithi188_77607_object112866:head# 2024-04-01T19:28:50.277 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.278 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6861eede:::benchmark_data_smithi188_77607_object110842:head# 2024-04-01T19:28:50.278 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.279 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:686222ea:::benchmark_data_smithi188_77607_object123198:head# 2024-04-01T19:28:50.279 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.279 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68645149:::benchmark_data_smithi188_77607_object99797:head# 2024-04-01T19:28:50.279 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.279 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6864aa61:::benchmark_data_smithi188_77607_object165780:head# 2024-04-01T19:28:50.279 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.280 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6865d20e:::benchmark_data_smithi188_77607_object158371:head# 2024-04-01T19:28:50.280 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.280 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6867a9bc:::benchmark_data_smithi188_77607_object156618:head# 2024-04-01T19:28:50.280 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.280 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6868371b:::benchmark_data_smithi188_77607_object164110:head# 2024-04-01T19:28:50.280 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.280 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6868b88a:::benchmark_data_smithi188_77607_object113796:head# 2024-04-01T19:28:50.280 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.281 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6868c824:::benchmark_data_smithi188_77607_object137936:head# 2024-04-01T19:28:50.281 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.281 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68698c9c:::benchmark_data_smithi188_77607_object98156:head# 2024-04-01T19:28:50.281 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.281 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:686ae9df:::benchmark_data_smithi188_77607_object124699:head# 2024-04-01T19:28:50.281 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.281 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:686afef0:::benchmark_data_smithi188_77607_object147069:head# 2024-04-01T19:28:50.281 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.282 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:686c51d8:::benchmark_data_smithi188_77607_object141637:head# 2024-04-01T19:28:50.282 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.283 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:686cb6b8:::benchmark_data_smithi188_77607_object150845:head# 2024-04-01T19:28:50.283 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.283 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:686fe8be:::benchmark_data_smithi188_77607_object123310:head# 2024-04-01T19:28:50.283 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.283 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68724f75:::benchmark_data_smithi188_77607_object143913:head# 2024-04-01T19:28:50.283 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.283 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6873277e:::benchmark_data_smithi188_77607_object165580:head# 2024-04-01T19:28:50.283 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.284 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6873db40:::benchmark_data_smithi188_77607_object127885:head# 2024-04-01T19:28:50.284 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.284 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6873ea0d:::benchmark_data_smithi188_77607_object115785:head# 2024-04-01T19:28:50.284 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.284 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6874aee3:::benchmark_data_smithi188_77607_object123828:head# 2024-04-01T19:28:50.284 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.284 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6874fc6b:::benchmark_data_smithi188_77607_object159381:head# 2024-04-01T19:28:50.285 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.285 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68752aa8:::benchmark_data_smithi188_77607_object114251:head# 2024-04-01T19:28:50.285 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.285 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6876a523:::benchmark_data_smithi188_77607_object157101:head# 2024-04-01T19:28:50.285 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.286 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:687780b0:::benchmark_data_smithi188_77607_object144730:head# 2024-04-01T19:28:50.286 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.286 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6877d6ab:::benchmark_data_smithi188_77607_object137087:head# 2024-04-01T19:28:50.286 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.286 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68783483:::benchmark_data_smithi188_77607_object145413:head# 2024-04-01T19:28:50.286 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.286 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6878735e:::benchmark_data_smithi188_77607_object125723:head# 2024-04-01T19:28:50.286 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.286 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:687b260c:::benchmark_data_smithi188_77607_object110750:head# 2024-04-01T19:28:50.286 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.286 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:687c0fcf:::benchmark_data_smithi188_77607_object103054:head# 2024-04-01T19:28:50.286 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.287 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:687f3de4:::benchmark_data_smithi188_77607_object109539:head# 2024-04-01T19:28:50.288 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.288 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6880317a:::benchmark_data_smithi188_77607_object152785:head# 2024-04-01T19:28:50.288 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.288 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6880a181:::benchmark_data_smithi188_77607_object125000:head# 2024-04-01T19:28:50.288 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.288 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68810828:::benchmark_data_smithi188_77607_object157727:head# 2024-04-01T19:28:50.288 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.288 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68814d1c:::benchmark_data_smithi188_77607_object133214:head# 2024-04-01T19:28:50.288 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.288 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6883a4a0:::benchmark_data_smithi188_77607_object116079:head# 2024-04-01T19:28:50.288 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.290 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6883bb2c:::benchmark_data_smithi188_77607_object100431:head# 2024-04-01T19:28:50.290 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.290 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68844f93:::benchmark_data_smithi188_77607_object134872:head# 2024-04-01T19:28:50.290 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.290 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:688588d9:::benchmark_data_smithi188_77607_object116053:head# 2024-04-01T19:28:50.290 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.290 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6887e9e3:::benchmark_data_smithi188_77607_object142399:head# 2024-04-01T19:28:50.290 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.290 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6888a718:::benchmark_data_smithi188_77607_object133990:head# 2024-04-01T19:28:50.290 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.290 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:688a5100:::benchmark_data_smithi188_77607_object141376:head# 2024-04-01T19:28:50.290 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.290 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:688a62f1:::benchmark_data_smithi188_77607_object136635:head# 2024-04-01T19:28:50.291 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.291 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:688aed26:::benchmark_data_smithi188_77607_object167212:head# 2024-04-01T19:28:50.291 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.291 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:688bbac5:::benchmark_data_smithi188_77607_object148289:head# 2024-04-01T19:28:50.291 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.292 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:688bed63:::benchmark_data_smithi188_77607_object153648:head# 2024-04-01T19:28:50.292 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.292 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:688fb9b8:::benchmark_data_smithi188_77607_object105519:head# 2024-04-01T19:28:50.292 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.292 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6890ad88:::benchmark_data_smithi188_77607_object110660:head# 2024-04-01T19:28:50.293 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.293 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6890dddf:::benchmark_data_smithi188_77607_object133710:head# 2024-04-01T19:28:50.293 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.293 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6891ab6d:::benchmark_data_smithi188_77607_object103403:head# 2024-04-01T19:28:50.293 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.293 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68921f3b:::benchmark_data_smithi188_77607_object141248:head# 2024-04-01T19:28:50.293 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.293 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:689269a7:::benchmark_data_smithi188_77607_object153997:head# 2024-04-01T19:28:50.293 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.293 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6893c084:::benchmark_data_smithi188_77607_object127830:head# 2024-04-01T19:28:50.293 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.293 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6897830e:::benchmark_data_smithi188_77607_object100460:head# 2024-04-01T19:28:50.293 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.294 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6897c995:::benchmark_data_smithi188_77607_object119850:head# 2024-04-01T19:28:50.294 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.295 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:689ab7c3:::benchmark_data_smithi188_77607_object144975:head# 2024-04-01T19:28:50.295 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.295 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:689b024b:::benchmark_data_smithi188_77607_object150133:head# 2024-04-01T19:28:50.295 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.295 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:689b4b54:::benchmark_data_smithi188_77607_object130820:head# 2024-04-01T19:28:50.295 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.295 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:689bec48:::benchmark_data_smithi188_77607_object122045:head# 2024-04-01T19:28:50.295 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.295 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:689e1ef1:::benchmark_data_smithi188_77607_object100892:head# 2024-04-01T19:28:50.295 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.295 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:689e91b6:::benchmark_data_smithi188_77607_object146613:head# 2024-04-01T19:28:50.295 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.295 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68a01a38:::benchmark_data_smithi188_77607_object119374:head# 2024-04-01T19:28:50.296 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.297 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68a18e08:::benchmark_data_smithi188_77607_object133804:head# 2024-04-01T19:28:50.297 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.297 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68a271d1:::benchmark_data_smithi188_77607_object116696:head# 2024-04-01T19:28:50.297 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.297 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68a6b0bd:::benchmark_data_smithi188_77607_object164111:head# 2024-04-01T19:28:50.297 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.297 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68a706ed:::benchmark_data_smithi188_77607_object138037:head# 2024-04-01T19:28:50.297 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.297 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68a7a9a7:::benchmark_data_smithi188_77607_object127716:head# 2024-04-01T19:28:50.297 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.298 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68a9785a:::benchmark_data_smithi188_77607_object141327:head# 2024-04-01T19:28:50.298 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.298 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68aa171e:::benchmark_data_smithi188_77607_object162421:head# 2024-04-01T19:28:50.298 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.298 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68aa393b:::benchmark_data_smithi188_77607_object152439:head# 2024-04-01T19:28:50.298 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.298 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:50.299 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68aa65a7:::benchmark_data_smithi188_77607_object98734:head# 2024-04-01T19:28:50.300 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.300 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68abd072:::benchmark_data_smithi188_77607_object131915:head# 2024-04-01T19:28:50.300 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.300 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68ac4ba9:::benchmark_data_smithi188_77607_object133229:head# 2024-04-01T19:28:50.300 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.300 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68aea02c:::benchmark_data_smithi188_77607_object127309:head# 2024-04-01T19:28:50.300 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.300 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68aea4d2:::benchmark_data_smithi188_77607_object115812:head# 2024-04-01T19:28:50.300 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.300 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68b061a1:::benchmark_data_smithi188_77607_object126992:head# 2024-04-01T19:28:50.300 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.300 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68b1bb28:::benchmark_data_smithi188_77607_object116608:head# 2024-04-01T19:28:50.300 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.301 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68b1ebf9:::benchmark_data_smithi188_77607_object124600:head# 2024-04-01T19:28:50.301 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.301 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68b25525:::benchmark_data_smithi188_77607_object116992:head# 2024-04-01T19:28:50.301 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.301 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68b25dd1:::benchmark_data_smithi188_77607_object124624:head# 2024-04-01T19:28:50.301 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.301 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68b30070:::benchmark_data_smithi188_77607_object116324:head# 2024-04-01T19:28:50.301 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.303 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68b3121a:::benchmark_data_smithi188_77607_object101055:head# 2024-04-01T19:28:50.303 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.303 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68b34dee:::benchmark_data_smithi188_77607_object146346:head# 2024-04-01T19:28:50.303 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.303 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68b44d54:::benchmark_data_smithi188_77607_object112454:head# 2024-04-01T19:28:50.303 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.303 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68b59ed6:::benchmark_data_smithi188_77607_object103561:head# 2024-04-01T19:28:50.303 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.303 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68b63ecf:::benchmark_data_smithi188_77607_object125328:head# 2024-04-01T19:28:50.303 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.303 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68b69f2b:::benchmark_data_smithi188_77607_object108133:head# 2024-04-01T19:28:50.304 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.304 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68b6fac3:::benchmark_data_smithi188_77607_object112782:head# 2024-04-01T19:28:50.304 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.304 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68b79840:::benchmark_data_smithi188_77607_object118688:head# 2024-04-01T19:28:50.304 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.304 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68ba534e:::benchmark_data_smithi188_77607_object118645:head# 2024-04-01T19:28:50.304 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.304 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68be330e:::benchmark_data_smithi188_77607_object116099:head# 2024-04-01T19:28:50.304 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.304 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68c2739a:::benchmark_data_smithi188_77607_object110481:head# 2024-04-01T19:28:50.304 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.304 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68c44d11:::benchmark_data_smithi188_77607_object162314:head# 2024-04-01T19:28:50.304 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.306 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68c4b02c:::benchmark_data_smithi188_77607_object125182:head# 2024-04-01T19:28:50.306 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.306 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68c73205:::benchmark_data_smithi188_77607_object121553:head# 2024-04-01T19:28:50.306 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.307 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68c7e8ed:::benchmark_data_smithi188_77607_object115219:head# 2024-04-01T19:28:50.307 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.307 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68c8c55d:::benchmark_data_smithi188_77607_object139230:head# 2024-04-01T19:28:50.307 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.307 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68ca9874:::benchmark_data_smithi188_77607_object166849:head# 2024-04-01T19:28:50.307 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.307 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68ca99be:::benchmark_data_smithi188_77607_object104434:head# 2024-04-01T19:28:50.307 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.307 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68cbbbe5:::benchmark_data_smithi188_77607_object142490:head# 2024-04-01T19:28:50.307 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.307 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68cbfaa8:::benchmark_data_smithi188_77607_object129673:head# 2024-04-01T19:28:50.307 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.307 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68cc9f12:::benchmark_data_smithi188_77607_object134148:head# 2024-04-01T19:28:50.307 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.308 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68ccc0dd:::benchmark_data_smithi188_77607_object159799:head# 2024-04-01T19:28:50.308 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.308 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68ccd573:::benchmark_data_smithi188_77607_object118874:head# 2024-04-01T19:28:50.308 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.308 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68cd06eb:::benchmark_data_smithi188_77607_object128389:head# 2024-04-01T19:28:50.308 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.308 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68cd94ec:::benchmark_data_smithi188_77607_object142823:head# 2024-04-01T19:28:50.308 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.308 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68cdcf5a:::benchmark_data_smithi188_77607_object124436:head# 2024-04-01T19:28:50.308 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.313 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68ce5bf5:::benchmark_data_smithi188_77607_object164158:head# 2024-04-01T19:28:50.313 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.313 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68cf2098:::benchmark_data_smithi188_77607_object160471:head# 2024-04-01T19:28:50.313 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.313 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68cf3e43:::benchmark_data_smithi188_77607_object98306:head# 2024-04-01T19:28:50.313 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.313 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68cf9ccc:::benchmark_data_smithi188_77607_object152609:head# 2024-04-01T19:28:50.313 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.313 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68d1cdb8:::benchmark_data_smithi188_77607_object159556:head# 2024-04-01T19:28:50.313 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.314 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68d33202:::benchmark_data_smithi188_77607_object164100:head# 2024-04-01T19:28:50.314 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.314 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68d3ac61:::benchmark_data_smithi188_77607_object163660:head# 2024-04-01T19:28:50.314 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.314 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68d91b4b:::benchmark_data_smithi188_77607_object120676:head# 2024-04-01T19:28:50.314 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.314 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68d99491:::benchmark_data_smithi188_77607_object167149:head# 2024-04-01T19:28:50.314 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.314 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68da8ee1:::benchmark_data_smithi188_77607_object98207:head# 2024-04-01T19:28:50.314 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.314 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68dc0ef0:::benchmark_data_smithi188_77607_object134897:head# 2024-04-01T19:28:50.314 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.314 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68dc67aa:::benchmark_data_smithi188_77607_object110197:head# 2024-04-01T19:28:50.315 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.315 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68de2484:::benchmark_data_smithi188_77607_object156551:head# 2024-04-01T19:28:50.315 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.315 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68de2e1c:::benchmark_data_smithi188_77607_object166386:head# 2024-04-01T19:28:50.315 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.315 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68de8a17:::benchmark_data_smithi188_77607_object132657:head# 2024-04-01T19:28:50.315 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.315 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68df04f6:::benchmark_data_smithi188_77607_object147723:head# 2024-04-01T19:28:50.315 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.315 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68e013af:::benchmark_data_smithi188_77607_object138872:head# 2024-04-01T19:28:50.315 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.315 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68e0184f:::benchmark_data_smithi188_77607_object120351:head# 2024-04-01T19:28:50.315 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.315 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68e149c7:::benchmark_data_smithi188_77607_object160314:head# 2024-04-01T19:28:50.316 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.316 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68e27ede:::benchmark_data_smithi188_77607_object162721:head# 2024-04-01T19:28:50.316 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.316 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68e393a2:::benchmark_data_smithi188_77607_object136878:head# 2024-04-01T19:28:50.316 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.316 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68e3cca7:::benchmark_data_smithi188_77607_object150644:head# 2024-04-01T19:28:50.316 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.316 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68ea9b78:::benchmark_data_smithi188_77607_object161676:head# 2024-04-01T19:28:50.316 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.316 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68ecca96:::benchmark_data_smithi188_77607_object116449:head# 2024-04-01T19:28:50.316 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.316 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68ecf374:::benchmark_data_smithi188_77607_object105163:head# 2024-04-01T19:28:50.316 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.316 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68eda323:::benchmark_data_smithi188_77607_object151989:head# 2024-04-01T19:28:50.316 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.317 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68edddc6:::benchmark_data_smithi188_77607_object150359:head# 2024-04-01T19:28:50.317 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.319 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68eea044:::benchmark_data_smithi188_77607_object154696:head# 2024-04-01T19:28:50.319 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.320 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68ef9f0e:::benchmark_data_smithi188_77607_object136548:head# 2024-04-01T19:28:50.320 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.320 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68f13b68:::benchmark_data_smithi188_77607_object120164:head# 2024-04-01T19:28:50.320 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.320 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68f18624:::benchmark_data_smithi188_77607_object133532:head# 2024-04-01T19:28:50.320 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.320 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68f27b72:::benchmark_data_smithi188_77607_object148372:head# 2024-04-01T19:28:50.320 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.320 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68f2fedd:::benchmark_data_smithi188_77607_object123807:head# 2024-04-01T19:28:50.320 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.320 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68f5d851:::benchmark_data_smithi188_77607_object151813:head# 2024-04-01T19:28:50.320 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.320 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68f63462:::benchmark_data_smithi188_77607_object115762:head# 2024-04-01T19:28:50.320 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.320 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68f64a04:::benchmark_data_smithi188_77607_object131100:head# 2024-04-01T19:28:50.320 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.321 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68f6c20d:::benchmark_data_smithi188_77607_object137570:head# 2024-04-01T19:28:50.321 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.321 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68f9f228:::benchmark_data_smithi188_77607_object132465:head# 2024-04-01T19:28:50.321 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.321 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68fb15ce:::benchmark_data_smithi188_77607_object116693:head# 2024-04-01T19:28:50.321 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.321 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68fb4d7d:::benchmark_data_smithi188_77607_object164828:head# 2024-04-01T19:28:50.321 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.321 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68fc222c:::benchmark_data_smithi188_77607_object100954:head# 2024-04-01T19:28:50.321 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.321 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68fd8569:::benchmark_data_smithi188_77607_object103492:head# 2024-04-01T19:28:50.321 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.321 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68fe4967:::benchmark_data_smithi188_77607_object133468:head# 2024-04-01T19:28:50.321 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.321 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68fe5841:::benchmark_data_smithi188_77607_object102746:head# 2024-04-01T19:28:50.322 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.322 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68fe8e93:::benchmark_data_smithi188_77607_object137495:head# 2024-04-01T19:28:50.322 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.322 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:28:50.324 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68fec9ac:::benchmark_data_smithi188_77607_object108856:head# 2024-04-01T19:28:50.324 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.324 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:68ff9894:::benchmark_data_smithi188_77607_object134876:head# 2024-04-01T19:28:50.324 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.324 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69009653:::benchmark_data_smithi188_77607_object143676:head# 2024-04-01T19:28:50.324 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.324 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6900dbb6:::benchmark_data_smithi188_77607_object113548:head# 2024-04-01T19:28:50.324 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.324 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6900edc9:::benchmark_data_smithi188_77607_object124444:head# 2024-04-01T19:28:50.324 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.324 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6900f131:::benchmark_data_smithi188_77607_object150585:head# 2024-04-01T19:28:50.324 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.324 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6901bfe0:::benchmark_data_smithi188_77607_object157619:head# 2024-04-01T19:28:50.324 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.325 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69038019:::benchmark_data_smithi188_77607_object117336:head# 2024-04-01T19:28:50.325 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.325 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6903ba0d:::benchmark_data_smithi188_77607_object130137:head# 2024-04-01T19:28:50.325 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.325 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:690426bb:::benchmark_data_smithi188_77607_object129767:head# 2024-04-01T19:28:50.325 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.325 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69044e87:::benchmark_data_smithi188_77607_object102797:head# 2024-04-01T19:28:50.325 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.326 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:50.326 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:28:50.337 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69048b70:::benchmark_data_smithi188_77607_object136858:head# 2024-04-01T19:28:50.337 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.337 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69049ffb:::benchmark_data_smithi188_77607_object118927:head# 2024-04-01T19:28:50.337 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.337 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69057bd2:::benchmark_data_smithi188_77607_object156499:head# 2024-04-01T19:28:50.337 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.337 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69057e9b:::benchmark_data_smithi188_77607_object136589:head# 2024-04-01T19:28:50.337 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.338 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69058ef7:::benchmark_data_smithi188_77607_object134931:head# 2024-04-01T19:28:50.338 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.338 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69089e2b:::benchmark_data_smithi188_77607_object134706:head# 2024-04-01T19:28:50.338 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.338 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:690990e8:::benchmark_data_smithi188_77607_object132396:head# 2024-04-01T19:28:50.338 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.338 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:690a16d2:::benchmark_data_smithi188_77607_object112659:head# 2024-04-01T19:28:50.338 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.338 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:690aea75:::benchmark_data_smithi188_77607_object147696:head# 2024-04-01T19:28:50.338 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.338 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:690b7192:::benchmark_data_smithi188_77607_object152322:head# 2024-04-01T19:28:50.338 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.338 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:690c9391:::benchmark_data_smithi188_77607_object165481:head# 2024-04-01T19:28:50.338 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.338 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:690e6c6e:::benchmark_data_smithi188_77607_object101609:head# 2024-04-01T19:28:50.339 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.339 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:690f4ec1:::benchmark_data_smithi188_77607_object162178:head# 2024-04-01T19:28:50.339 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.339 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:690f6ee3:::benchmark_data_smithi188_77607_object166608:head# 2024-04-01T19:28:50.339 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.339 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:690fbbfc:::benchmark_data_smithi188_77607_object137805:head# 2024-04-01T19:28:50.339 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.339 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:690fbd1e:::benchmark_data_smithi188_77607_object114817:head# 2024-04-01T19:28:50.339 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.339 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:691006ae:::benchmark_data_smithi188_77607_object98265:head# 2024-04-01T19:28:50.339 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.339 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6915bd24:::benchmark_data_smithi188_77607_object107093:head# 2024-04-01T19:28:50.339 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.339 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6916ebe3:::benchmark_data_smithi188_77607_object140098:head# 2024-04-01T19:28:50.340 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.340 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6917eb7e:::benchmark_data_smithi188_77607_object103405:head# 2024-04-01T19:28:50.340 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.340 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6918601a:::benchmark_data_smithi188_77607_object141908:head# 2024-04-01T19:28:50.340 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.340 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69186e1b:::benchmark_data_smithi188_77607_object165779:head# 2024-04-01T19:28:50.340 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.340 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6919c96d:::benchmark_data_smithi188_77607_object143884:head# 2024-04-01T19:28:50.340 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.340 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:691aed5b:::benchmark_data_smithi188_77607_object152102:head# 2024-04-01T19:28:50.340 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.340 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:691ca5e9:::benchmark_data_smithi188_77607_object108054:head# 2024-04-01T19:28:50.340 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.340 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:691cae42:::benchmark_data_smithi188_77607_object121511:head# 2024-04-01T19:28:50.340 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.341 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:691cc139:::benchmark_data_smithi188_77607_object155956:head# 2024-04-01T19:28:50.341 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.341 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:691d88a1:::benchmark_data_smithi188_77607_object159034:head# 2024-04-01T19:28:50.341 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.341 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:691dafdd:::benchmark_data_smithi188_77607_object159635:head# 2024-04-01T19:28:50.341 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.341 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:691e9474:::benchmark_data_smithi188_77607_object123736:head# 2024-04-01T19:28:50.341 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.341 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:691ffaaf:::benchmark_data_smithi188_77607_object144596:head# 2024-04-01T19:28:50.341 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.341 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6920cc51:::benchmark_data_smithi188_77607_object154548:head# 2024-04-01T19:28:50.341 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.341 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6923a628:::benchmark_data_smithi188_77607_object137321:head# 2024-04-01T19:28:50.341 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.341 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6924cc16:::benchmark_data_smithi188_77607_object113585:head# 2024-04-01T19:28:50.342 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.342 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6927db22:::benchmark_data_smithi188_77607_object99329:head# 2024-04-01T19:28:50.342 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.342 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69297795:::benchmark_data_smithi188_77607_object156900:head# 2024-04-01T19:28:50.342 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.342 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6929d5a8:::benchmark_data_smithi188_77607_object99700:head# 2024-04-01T19:28:50.342 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.342 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:692ae458:::benchmark_data_smithi188_77607_object157810:head# 2024-04-01T19:28:50.342 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.342 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:692b30de:::benchmark_data_smithi188_77607_object115235:head# 2024-04-01T19:28:50.342 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.342 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:692ba982:::benchmark_data_smithi188_77607_object153025:head# 2024-04-01T19:28:50.342 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.343 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:692bfe36:::benchmark_data_smithi188_77607_object129489:head# 2024-04-01T19:28:50.343 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.343 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:692e7814:::benchmark_data_smithi188_77607_object141759:head# 2024-04-01T19:28:50.343 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.343 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:692ef4de:::benchmark_data_smithi188_77607_object107769:head# 2024-04-01T19:28:50.343 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.343 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:692fa27e:::benchmark_data_smithi188_77607_object110151:head# 2024-04-01T19:28:50.343 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.343 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:692fc947:::benchmark_data_smithi188_77607_object104909:head# 2024-04-01T19:28:50.343 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.343 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69317f16:::benchmark_data_smithi188_77607_object134967:head# 2024-04-01T19:28:50.343 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.343 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6934ff6d:::benchmark_data_smithi188_77607_object165191:head# 2024-04-01T19:28:50.343 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.343 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6935e119:::benchmark_data_smithi188_77607_object101019:head# 2024-04-01T19:28:50.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69378697:::benchmark_data_smithi188_77607_object116641:head# 2024-04-01T19:28:50.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6937adc7:::benchmark_data_smithi188_77607_object150425:head# 2024-04-01T19:28:50.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:693a43c3:::benchmark_data_smithi188_77607_object141458:head# 2024-04-01T19:28:50.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:693cd257:::benchmark_data_smithi188_77607_object137505:head# 2024-04-01T19:28:50.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:693d70a9:::benchmark_data_smithi188_77607_object103967:head# 2024-04-01T19:28:50.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:693d8582:::benchmark_data_smithi188_77607_object120604:head# 2024-04-01T19:28:50.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:693f0c9a:::benchmark_data_smithi188_77607_object147796:head# 2024-04-01T19:28:50.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:693f1769:::benchmark_data_smithi188_77607_object160230:head# 2024-04-01T19:28:50.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69412497:::benchmark_data_smithi188_77607_object126908:head# 2024-04-01T19:28:50.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69418373:::benchmark_data_smithi188_77607_object160070:head# 2024-04-01T19:28:50.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69418dce:::benchmark_data_smithi188_77607_object157698:head# 2024-04-01T19:28:50.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6942fcb0:::benchmark_data_smithi188_77607_object100707:head# 2024-04-01T19:28:50.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6943b09c:::benchmark_data_smithi188_77607_object165922:head# 2024-04-01T19:28:50.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:694463a7:::benchmark_data_smithi188_77607_object141950:head# 2024-04-01T19:28:50.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69448081:::benchmark_data_smithi188_77607_object155405:head# 2024-04-01T19:28:50.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.346 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69453ba9:::benchmark_data_smithi188_77607_object151397:head# 2024-04-01T19:28:50.346 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.346 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6945fb2b:::benchmark_data_smithi188_77607_object127609:head# 2024-04-01T19:28:50.346 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.346 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6948963b:::benchmark_data_smithi188_77607_object140447:head# 2024-04-01T19:28:50.346 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.346 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6949319b:::benchmark_data_smithi188_77607_object166023:head# 2024-04-01T19:28:50.346 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.346 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:694dc7ad:::benchmark_data_smithi188_77607_object147999:head# 2024-04-01T19:28:50.346 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.346 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:694dfd95:::benchmark_data_smithi188_77607_object122866:head# 2024-04-01T19:28:50.346 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.346 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69500f7d:::benchmark_data_smithi188_77607_object156664:head# 2024-04-01T19:28:50.346 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.346 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6950965b:::benchmark_data_smithi188_77607_object154140:head# 2024-04-01T19:28:50.347 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.347 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6951a8f7:::benchmark_data_smithi188_77607_object146152:head# 2024-04-01T19:28:50.347 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.347 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69538a15:::benchmark_data_smithi188_77607_object127905:head# 2024-04-01T19:28:50.347 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.347 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69544404:::benchmark_data_smithi188_77607_object125912:head# 2024-04-01T19:28:50.347 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.354 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69551ca4:::benchmark_data_smithi188_77607_object119480:head# 2024-04-01T19:28:50.354 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.354 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69551fd0:::benchmark_data_smithi188_77607_object128842:head# 2024-04-01T19:28:50.354 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.354 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69553a0f:::benchmark_data_smithi188_77607_object160164:head# 2024-04-01T19:28:50.354 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.354 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6955977d:::benchmark_data_smithi188_77607_object145744:head# 2024-04-01T19:28:50.354 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.354 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69559ca1:::benchmark_data_smithi188_77607_object120606:head# 2024-04-01T19:28:50.354 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.355 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6955c174:::benchmark_data_smithi188_77607_object158588:head# 2024-04-01T19:28:50.355 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.355 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6955ef87:::benchmark_data_smithi188_77607_object151538:head# 2024-04-01T19:28:50.355 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.355 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69565fac:::benchmark_data_smithi188_77607_object129828:head# 2024-04-01T19:28:50.355 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.355 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6956ac73:::benchmark_data_smithi188_77607_object164169:head# 2024-04-01T19:28:50.355 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.355 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6957f3ae:::benchmark_data_smithi188_77607_object163720:head# 2024-04-01T19:28:50.355 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.355 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:695a45ff:::benchmark_data_smithi188_77607_object139271:head# 2024-04-01T19:28:50.355 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.355 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:695a8885:::benchmark_data_smithi188_77607_object134253:head# 2024-04-01T19:28:50.355 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.355 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:695bc4d7:::benchmark_data_smithi188_77607_object146469:head# 2024-04-01T19:28:50.356 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.356 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:695bf785:::benchmark_data_smithi188_77607_object99052:head# 2024-04-01T19:28:50.356 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.356 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:695c614c:::benchmark_data_smithi188_77607_object124603:head# 2024-04-01T19:28:50.356 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.356 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:695d060b:::benchmark_data_smithi188_77607_object124565:head# 2024-04-01T19:28:50.356 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.356 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:695d3653:::benchmark_data_smithi188_77607_object138061:head# 2024-04-01T19:28:50.356 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.356 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:695ebac5:::benchmark_data_smithi188_77607_object145537:head# 2024-04-01T19:28:50.356 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.356 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69612a3f:::benchmark_data_smithi188_77607_object124764:head# 2024-04-01T19:28:50.356 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.356 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6961ee41:::benchmark_data_smithi188_77607_object159266:head# 2024-04-01T19:28:50.356 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.357 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69625f73:::benchmark_data_smithi188_77607_object165462:head# 2024-04-01T19:28:50.357 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.357 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69638705:::benchmark_data_smithi188_77607_object131507:head# 2024-04-01T19:28:50.357 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.357 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6964c39a:::benchmark_data_smithi188_77607_object124950:head# 2024-04-01T19:28:50.357 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.357 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69669eef:::benchmark_data_smithi188_77607_object156734:head# 2024-04-01T19:28:50.357 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.357 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:696764f3:::benchmark_data_smithi188_77607_object105620:head# 2024-04-01T19:28:50.357 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.357 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6967c64f:::benchmark_data_smithi188_77607_object136011:head# 2024-04-01T19:28:50.357 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.357 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6969225c:::benchmark_data_smithi188_77607_object118504:head# 2024-04-01T19:28:50.357 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.357 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69692d86:::benchmark_data_smithi188_77607_object157121:head# 2024-04-01T19:28:50.357 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.358 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6969705e:::benchmark_data_smithi188_77607_object134817:head# 2024-04-01T19:28:50.358 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.358 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6969bd3d:::benchmark_data_smithi188_77607_object150824:head# 2024-04-01T19:28:50.358 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.358 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6969bde2:::benchmark_data_smithi188_77607_object143477:head# 2024-04-01T19:28:50.358 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.358 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6969e07d:::benchmark_data_smithi188_77607_object147337:head# 2024-04-01T19:28:50.358 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.358 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:696a55e0:::benchmark_data_smithi188_77607_object112992:head# 2024-04-01T19:28:50.358 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.358 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:696a91e1:::benchmark_data_smithi188_77607_object153656:head# 2024-04-01T19:28:50.358 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.358 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:696b1235:::benchmark_data_smithi188_77607_object156863:head# 2024-04-01T19:28:50.358 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.359 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:696c0148:::benchmark_data_smithi188_77607_object150796:head# 2024-04-01T19:28:50.359 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.359 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69706f2c:::benchmark_data_smithi188_77607_object154086:head# 2024-04-01T19:28:50.359 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.359 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69713f28:::benchmark_data_smithi188_77607_object129393:head# 2024-04-01T19:28:50.359 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.359 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69718e83:::benchmark_data_smithi188_77607_object153265:head# 2024-04-01T19:28:50.359 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.359 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6971d830:::benchmark_data_smithi188_77607_object145884:head# 2024-04-01T19:28:50.359 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.359 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69720a83:::benchmark_data_smithi188_77607_object110398:head# 2024-04-01T19:28:50.359 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.359 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6972204c:::benchmark_data_smithi188_77607_object104144:head# 2024-04-01T19:28:50.359 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.359 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6974b1fd:::benchmark_data_smithi188_77607_object148351:head# 2024-04-01T19:28:50.359 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.360 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:697644fa:::benchmark_data_smithi188_77607_object136435:head# 2024-04-01T19:28:50.360 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.360 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:697745ea:::benchmark_data_smithi188_77607_object104951:head# 2024-04-01T19:28:50.360 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.360 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69784dbe:::benchmark_data_smithi188_77607_object161775:head# 2024-04-01T19:28:50.360 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.360 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6978c6bc:::benchmark_data_smithi188_77607_object157684:head# 2024-04-01T19:28:50.360 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.360 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69790914:::benchmark_data_smithi188_77607_object101642:head# 2024-04-01T19:28:50.360 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.360 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:697a4dac:::benchmark_data_smithi188_77607_object165569:head# 2024-04-01T19:28:50.360 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.360 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:697a55eb:::benchmark_data_smithi188_77607_object139150:head# 2024-04-01T19:28:50.360 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.360 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:697aae76:::benchmark_data_smithi188_77607_object156456:head# 2024-04-01T19:28:50.361 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.361 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:697b990e:::benchmark_data_smithi188_77607_object113763:head# 2024-04-01T19:28:50.361 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.361 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:697c1842:::benchmark_data_smithi188_77607_object153859:head# 2024-04-01T19:28:50.361 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.361 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:697cd971:::benchmark_data_smithi188_77607_object110140:head# 2024-04-01T19:28:50.361 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.361 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6980c157:::benchmark_data_smithi188_77607_object143558:head# 2024-04-01T19:28:50.361 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.361 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:698216ae:::benchmark_data_smithi188_77607_object163827:head# 2024-04-01T19:28:50.361 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.361 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6983a203:::benchmark_data_smithi188_77607_object134271:head# 2024-04-01T19:28:50.361 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.361 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6984116c:::benchmark_data_smithi188_77607_object165599:head# 2024-04-01T19:28:50.361 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.361 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69849c97:::benchmark_data_smithi188_77607_object157128:head# 2024-04-01T19:28:50.362 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.362 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69850904:::benchmark_data_smithi188_77607_object148933:head# 2024-04-01T19:28:50.362 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.362 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69856c8b:::benchmark_data_smithi188_77607_object151344:head# 2024-04-01T19:28:50.362 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.362 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6985eb79:::benchmark_data_smithi188_77607_object156218:head# 2024-04-01T19:28:50.362 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.362 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:698600e4:::benchmark_data_smithi188_77607_object109307:head# 2024-04-01T19:28:50.362 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.362 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69861939:::benchmark_data_smithi188_77607_object154890:head# 2024-04-01T19:28:50.362 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.362 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69868056:::benchmark_data_smithi188_77607_object142435:head# 2024-04-01T19:28:50.362 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.366 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6986883b:::benchmark_data_smithi188_77607_object122162:head# 2024-04-01T19:28:50.366 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.366 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6986f43d:::benchmark_data_smithi188_77607_object145039:head# 2024-04-01T19:28:50.366 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.366 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:698801e8:::benchmark_data_smithi188_77607_object103314:head# 2024-04-01T19:28:50.366 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.366 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6988e885:::benchmark_data_smithi188_77607_object98521:head# 2024-04-01T19:28:50.366 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.366 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:698906f1:::benchmark_data_smithi188_77607_object133366:head# 2024-04-01T19:28:50.367 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.367 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:698a02a3:::benchmark_data_smithi188_77607_object140482:head# 2024-04-01T19:28:50.367 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.367 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:698c3b49:::benchmark_data_smithi188_77607_object126071:head# 2024-04-01T19:28:50.367 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.367 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:698cc1e5:::benchmark_data_smithi188_77607_object116351:head# 2024-04-01T19:28:50.367 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.367 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:698d1ff3:::benchmark_data_smithi188_77607_object159696:head# 2024-04-01T19:28:50.367 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.367 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:698d319a:::benchmark_data_smithi188_77607_object166170:head# 2024-04-01T19:28:50.367 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.367 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:698d51d9:::benchmark_data_smithi188_77607_object164518:head# 2024-04-01T19:28:50.367 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.367 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:698dfb67:::benchmark_data_smithi188_77607_object118023:head# 2024-04-01T19:28:50.367 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.368 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:698e25bb:::benchmark_data_smithi188_77607_object153273:head# 2024-04-01T19:28:50.368 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.368 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:698e8f32:::benchmark_data_smithi188_77607_object110951:head# 2024-04-01T19:28:50.368 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.368 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:698ef146:::benchmark_data_smithi188_77607_object155154:head# 2024-04-01T19:28:50.368 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.368 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:698fc2ac:::benchmark_data_smithi188_77607_object111689:head# 2024-04-01T19:28:50.368 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.368 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69927658:::benchmark_data_smithi188_77607_object124538:head# 2024-04-01T19:28:50.368 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.368 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6992d30a:::benchmark_data_smithi188_77607_object100140:head# 2024-04-01T19:28:50.368 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.368 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:699864fe:::benchmark_data_smithi188_77607_object121172:head# 2024-04-01T19:28:50.368 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.369 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6998c6c7:::benchmark_data_smithi188_77607_object113512:head# 2024-04-01T19:28:50.369 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.369 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6999552e:::benchmark_data_smithi188_77607_object140802:head# 2024-04-01T19:28:50.369 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.369 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69998066:::benchmark_data_smithi188_77607_object102796:head# 2024-04-01T19:28:50.369 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.369 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:699a1f1e:::benchmark_data_smithi188_77607_object106643:head# 2024-04-01T19:28:50.369 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.369 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:699a5eae:::benchmark_data_smithi188_77607_object133653:head# 2024-04-01T19:28:50.369 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.369 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:699b51ee:::benchmark_data_smithi188_77607_object135957:head# 2024-04-01T19:28:50.369 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.372 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:699bef31:::benchmark_data_smithi188_77607_object104201:head# 2024-04-01T19:28:50.372 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.373 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:699ddaa9:::benchmark_data_smithi188_77607_object104540:head# 2024-04-01T19:28:50.373 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.373 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:699e0d48:::benchmark_data_smithi188_77607_object131910:head# 2024-04-01T19:28:50.373 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.373 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:699e5cf5:::benchmark_data_smithi188_77607_object120373:head# 2024-04-01T19:28:50.373 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.373 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:699ec260:::benchmark_data_smithi188_77607_object112185:head# 2024-04-01T19:28:50.373 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.373 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:699f5974:::benchmark_data_smithi188_77607_object134753:head# 2024-04-01T19:28:50.373 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.373 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:699f86b4:::benchmark_data_smithi188_77607_object167323:head# 2024-04-01T19:28:50.373 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.373 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69a11f4f:::benchmark_data_smithi188_77607_object108662:head# 2024-04-01T19:28:50.374 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.374 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69a1f295:::benchmark_data_smithi188_77607_object98507:head# 2024-04-01T19:28:50.374 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.374 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69a24ab2:::benchmark_data_smithi188_77607_object149972:head# 2024-04-01T19:28:50.374 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.374 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69a42c22:::benchmark_data_smithi188_77607_object133169:head# 2024-04-01T19:28:50.374 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.374 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69a50f81:::benchmark_data_smithi188_77607_object109675:head# 2024-04-01T19:28:50.374 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.374 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69a79dd9:::benchmark_data_smithi188_77607_object135299:head# 2024-04-01T19:28:50.374 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.374 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69a8d9e0:::benchmark_data_smithi188_77607_object133621:head# 2024-04-01T19:28:50.374 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.375 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69a95322:::benchmark_data_smithi188_77607_object166032:head# 2024-04-01T19:28:50.375 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.375 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69a95b40:::benchmark_data_smithi188_77607_object124897:head# 2024-04-01T19:28:50.375 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.375 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69a9953f:::benchmark_data_smithi188_77607_object126585:head# 2024-04-01T19:28:50.375 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.375 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69aae79b:::benchmark_data_smithi188_77607_object142956:head# 2024-04-01T19:28:50.375 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.375 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69aaf92b:::benchmark_data_smithi188_77607_object103865:head# 2024-04-01T19:28:50.375 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.375 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69ab7bc0:::benchmark_data_smithi188_77607_object149120:head# 2024-04-01T19:28:50.375 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.380 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69ad2dcc:::benchmark_data_smithi188_77607_object133642:head# 2024-04-01T19:28:50.380 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.380 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69b2e196:::benchmark_data_smithi188_77607_object144454:head# 2024-04-01T19:28:50.380 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.380 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69b330f8:::benchmark_data_smithi188_77607_object155872:head# 2024-04-01T19:28:50.380 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.380 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69b36a41:::benchmark_data_smithi188_77607_object136209:head# 2024-04-01T19:28:50.381 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.381 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69b440ee:::benchmark_data_smithi188_77607_object163686:head# 2024-04-01T19:28:50.381 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.381 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69b69d83:::benchmark_data_smithi188_77607_object123212:head# 2024-04-01T19:28:50.381 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.381 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69b6c9ed:::benchmark_data_smithi188_77607_object132871:head# 2024-04-01T19:28:50.381 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.381 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69b6cb51:::benchmark_data_smithi188_77607_object121877:head# 2024-04-01T19:28:50.381 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.381 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69b79792:::benchmark_data_smithi188_77607_object149375:head# 2024-04-01T19:28:50.381 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.381 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69b8d748:::benchmark_data_smithi188_77607_object107418:head# 2024-04-01T19:28:50.381 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.382 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69ba7add:::benchmark_data_smithi188_77607_object143617:head# 2024-04-01T19:28:50.382 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.382 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69ba982c:::benchmark_data_smithi188_77607_object163766:head# 2024-04-01T19:28:50.382 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.382 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69bacc21:::benchmark_data_smithi188_77607_object124101:head# 2024-04-01T19:28:50.382 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.382 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69bc203f:::benchmark_data_smithi188_77607_object129419:head# 2024-04-01T19:28:50.382 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.382 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69bcbec0:::benchmark_data_smithi188_77607_object162833:head# 2024-04-01T19:28:50.382 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.382 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69bcfc3f:::benchmark_data_smithi188_77607_object122886:head# 2024-04-01T19:28:50.382 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.382 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69be0610:::benchmark_data_smithi188_77607_object107059:head# 2024-04-01T19:28:50.383 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.383 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69be2127:::benchmark_data_smithi188_77607_object105731:head# 2024-04-01T19:28:50.383 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.383 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69be31dd:::benchmark_data_smithi188_77607_object127577:head# 2024-04-01T19:28:50.383 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.383 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69be4812:::benchmark_data_smithi188_77607_object101053:head# 2024-04-01T19:28:50.383 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.383 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69be5494:::benchmark_data_smithi188_77607_object135993:head# 2024-04-01T19:28:50.383 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.383 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69beed86:::benchmark_data_smithi188_77607_object139899:head# 2024-04-01T19:28:50.383 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.383 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69bfe9fe:::benchmark_data_smithi188_77607_object119617:head# 2024-04-01T19:28:50.383 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.383 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69c20f41:::benchmark_data_smithi188_77607_object137019:head# 2024-04-01T19:28:50.383 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.384 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69c23f49:::benchmark_data_smithi188_77607_object111507:head# 2024-04-01T19:28:50.384 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.384 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69c3093d:::benchmark_data_smithi188_77607_object106491:head# 2024-04-01T19:28:50.384 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.384 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69c31229:::benchmark_data_smithi188_77607_object132836:head# 2024-04-01T19:28:50.384 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.384 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69c331f2:::benchmark_data_smithi188_77607_object102738:head# 2024-04-01T19:28:50.384 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.384 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69c4df11:::benchmark_data_smithi188_77607_object166976:head# 2024-04-01T19:28:50.384 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.384 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69c56021:::benchmark_data_smithi188_77607_object163512:head# 2024-04-01T19:28:50.384 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.388 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69c56b31:::benchmark_data_smithi188_77607_object104154:head# 2024-04-01T19:28:50.388 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.388 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69c57f8b:::benchmark_data_smithi188_77607_object144647:head# 2024-04-01T19:28:50.388 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.388 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69c5ccb1:::benchmark_data_smithi188_77607_object149843:head# 2024-04-01T19:28:50.389 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.389 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69c7d92e:::benchmark_data_smithi188_77607_object166129:head# 2024-04-01T19:28:50.389 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.389 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69c91c7e:::benchmark_data_smithi188_77607_object101845:head# 2024-04-01T19:28:50.389 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.389 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69ca625c:::benchmark_data_smithi188_77607_object139694:head# 2024-04-01T19:28:50.389 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.389 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69cad787:::benchmark_data_smithi188_77607_object166534:head# 2024-04-01T19:28:50.389 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.389 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69cc3c51:::benchmark_data_smithi188_77607_object153605:head# 2024-04-01T19:28:50.389 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.389 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69ccc2f7:::benchmark_data_smithi188_77607_object140654:head# 2024-04-01T19:28:50.389 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.389 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69cdd6f5:::benchmark_data_smithi188_77607_object131434:head# 2024-04-01T19:28:50.389 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.390 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69ce165e:::benchmark_data_smithi188_77607_object124857:head# 2024-04-01T19:28:50.390 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.390 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69ce2999:::benchmark_data_smithi188_77607_object125853:head# 2024-04-01T19:28:50.390 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.390 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69cf967e:::benchmark_data_smithi188_77607_object156317:head# 2024-04-01T19:28:50.390 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.390 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69d0d24d:::benchmark_data_smithi188_77607_object154133:head# 2024-04-01T19:28:50.390 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.390 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69d1e8c5:::benchmark_data_smithi188_77607_object141970:head# 2024-04-01T19:28:50.390 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.390 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69d23a31:::benchmark_data_smithi188_77607_object114264:head# 2024-04-01T19:28:50.390 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.390 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69d2f63a:::benchmark_data_smithi188_77607_object155434:head# 2024-04-01T19:28:50.390 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.391 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69d3f72f:::benchmark_data_smithi188_77607_object149027:head# 2024-04-01T19:28:50.391 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.391 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69d73b89:::benchmark_data_smithi188_77607_object166417:head# 2024-04-01T19:28:50.391 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.391 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69d7dfd4:::benchmark_data_smithi188_77607_object104237:head# 2024-04-01T19:28:50.391 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.391 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69d922c1:::benchmark_data_smithi188_77607_object144124:head# 2024-04-01T19:28:50.391 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.391 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69d96614:::benchmark_data_smithi188_77607_object109674:head# 2024-04-01T19:28:50.391 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.391 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69d97f3e:::benchmark_data_smithi188_77607_object124812:head# 2024-04-01T19:28:50.391 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.391 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69dac38f:::benchmark_data_smithi188_77607_object108715:head# 2024-04-01T19:28:50.391 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.392 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69db5e1b:::benchmark_data_smithi188_77607_object147697:head# 2024-04-01T19:28:50.392 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.392 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69dbb804:::benchmark_data_smithi188_77607_object143139:head# 2024-04-01T19:28:50.392 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.392 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69dd2da8:::benchmark_data_smithi188_77607_object127035:head# 2024-04-01T19:28:50.392 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.392 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69deee59:::benchmark_data_smithi188_77607_object145489:head# 2024-04-01T19:28:50.392 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.392 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69e0be33:::benchmark_data_smithi188_77607_object135995:head# 2024-04-01T19:28:50.392 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.394 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69e20894:::benchmark_data_smithi188_77607_object158472:head# 2024-04-01T19:28:50.394 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.394 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69e26025:::benchmark_data_smithi188_77607_object112712:head# 2024-04-01T19:28:50.394 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.394 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69e26d23:::benchmark_data_smithi188_77607_object144189:head# 2024-04-01T19:28:50.394 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.394 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69e2cd4f:::benchmark_data_smithi188_77607_object139244:head# 2024-04-01T19:28:50.394 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.394 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69e40e4c:::benchmark_data_smithi188_77607_object125597:head# 2024-04-01T19:28:50.394 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.394 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69e45d8b:::benchmark_data_smithi188_77607_object134684:head# 2024-04-01T19:28:50.394 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.395 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69e80eca:::benchmark_data_smithi188_77607_object121379:head# 2024-04-01T19:28:50.395 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.395 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69e8345f:::benchmark_data_smithi188_77607_object147993:head# 2024-04-01T19:28:50.395 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.395 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69e99f1f:::benchmark_data_smithi188_77607_object105023:head# 2024-04-01T19:28:50.395 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.395 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69ea035f:::benchmark_data_smithi188_77607_object165689:head# 2024-04-01T19:28:50.395 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.398 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69ea2ad6:::benchmark_data_smithi188_77607_object161256:head# 2024-04-01T19:28:50.399 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.399 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69ea6d50:::benchmark_data_smithi188_77607_object122001:head# 2024-04-01T19:28:50.399 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.399 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69eb8d6d:::benchmark_data_smithi188_77607_object123923:head# 2024-04-01T19:28:50.399 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.399 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69ebc2ad:::benchmark_data_smithi188_77607_object162162:head# 2024-04-01T19:28:50.399 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.399 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69ec1541:::benchmark_data_smithi188_77607_object142185:head# 2024-04-01T19:28:50.399 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.399 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69ec6024:::benchmark_data_smithi188_77607_object162763:head# 2024-04-01T19:28:50.399 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.399 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69ed71d5:::benchmark_data_smithi188_77607_object149676:head# 2024-04-01T19:28:50.400 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.400 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69ee2615:::benchmark_data_smithi188_77607_object145573:head# 2024-04-01T19:28:50.400 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.400 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69eebcbd:::benchmark_data_smithi188_77607_object126488:head# 2024-04-01T19:28:50.400 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.400 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69efa500:::benchmark_data_smithi188_77607_object108018:head# 2024-04-01T19:28:50.400 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.400 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69f0509c:::benchmark_data_smithi188_77607_object136093:head# 2024-04-01T19:28:50.400 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.400 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69f08de1:::benchmark_data_smithi188_77607_object114237:head# 2024-04-01T19:28:50.400 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.400 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69f0977d:::benchmark_data_smithi188_77607_object159922:head# 2024-04-01T19:28:50.400 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.400 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69f1ccda:::benchmark_data_smithi188_77607_object160522:head# 2024-04-01T19:28:50.401 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.401 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69f4d219:::benchmark_data_smithi188_77607_object110069:head# 2024-04-01T19:28:50.401 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.401 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69f57dc0:::benchmark_data_smithi188_77607_object132778:head# 2024-04-01T19:28:50.401 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.401 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69f75553:::benchmark_data_smithi188_77607_object141158:head# 2024-04-01T19:28:50.401 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.401 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69f90f9c:::benchmark_data_smithi188_77607_object109890:head# 2024-04-01T19:28:50.401 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.401 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69f9f890:::benchmark_data_smithi188_77607_object98145:head# 2024-04-01T19:28:50.401 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.401 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69fb6b07:::benchmark_data_smithi188_77607_object112966:head# 2024-04-01T19:28:50.401 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.401 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69fdaeb9:::benchmark_data_smithi188_77607_object124491:head# 2024-04-01T19:28:50.402 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.402 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69fe0c54:::benchmark_data_smithi188_77607_object109670:head# 2024-04-01T19:28:50.402 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.402 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69fee7b6:::benchmark_data_smithi188_77607_object119631:head# 2024-04-01T19:28:50.402 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.402 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:69ff754b:::benchmark_data_smithi188_77607_object100120:head# 2024-04-01T19:28:50.402 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.402 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a0070f8:::benchmark_data_smithi188_77607_object135333:head# 2024-04-01T19:28:50.402 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.402 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a011813:::benchmark_data_smithi188_77607_object124496:head# 2024-04-01T19:28:50.402 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.402 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a015eb6:::benchmark_data_smithi188_77607_object143798:head# 2024-04-01T19:28:50.402 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.403 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a0333b1:::benchmark_data_smithi188_77607_object102451:head# 2024-04-01T19:28:50.403 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.403 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a043775:::benchmark_data_smithi188_77607_object130834:head# 2024-04-01T19:28:50.403 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.403 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a053c1d:::benchmark_data_smithi188_77607_object134494:head# 2024-04-01T19:28:50.403 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.403 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a05ad41:::benchmark_data_smithi188_77607_object154111:head# 2024-04-01T19:28:50.403 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.403 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a06211d:::benchmark_data_smithi188_77607_object144894:head# 2024-04-01T19:28:50.403 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.403 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a0641da:::benchmark_data_smithi188_77607_object116579:head# 2024-04-01T19:28:50.403 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.410 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a066329:::benchmark_data_smithi188_77607_object126089:head# 2024-04-01T19:28:50.410 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.410 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a073674:::benchmark_data_smithi188_77607_object141347:head# 2024-04-01T19:28:50.411 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.411 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a095113:::benchmark_data_smithi188_77607_object162907:head# 2024-04-01T19:28:50.411 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.411 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a0c6a9b:::benchmark_data_smithi188_77607_object102474:head# 2024-04-01T19:28:50.411 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.411 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a0d820d:::benchmark_data_smithi188_77607_object162128:head# 2024-04-01T19:28:50.411 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.411 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a0fc667:::benchmark_data_smithi188_77607_object135597:head# 2024-04-01T19:28:50.411 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.411 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a1086a1:::benchmark_data_smithi188_77607_object140465:head# 2024-04-01T19:28:50.411 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.411 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a10a2ef:::benchmark_data_smithi188_77607_object151249:head# 2024-04-01T19:28:50.411 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.412 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a10ad6c:::benchmark_data_smithi188_77607_object130484:head# 2024-04-01T19:28:50.412 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.412 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a131f4f:::benchmark_data_smithi188_77607_object119601:head# 2024-04-01T19:28:50.412 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.412 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a13b2cb:::benchmark_data_smithi188_77607_object153479:head# 2024-04-01T19:28:50.412 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.412 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a13ee94:::benchmark_data_smithi188_77607_object109485:head# 2024-04-01T19:28:50.412 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.412 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a149323:::benchmark_data_smithi188_77607_object97782:head# 2024-04-01T19:28:50.412 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.412 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a14f5ec:::benchmark_data_smithi188_77607_object104670:head# 2024-04-01T19:28:50.412 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.412 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a150f20:::benchmark_data_smithi188_77607_object127348:head# 2024-04-01T19:28:50.412 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.413 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a163771:::benchmark_data_smithi188_77607_object116525:head# 2024-04-01T19:28:50.413 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.413 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a1d34f2:::benchmark_data_smithi188_77607_object113919:head# 2024-04-01T19:28:50.413 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.413 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a21475c:::benchmark_data_smithi188_77607_object162239:head# 2024-04-01T19:28:50.413 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.413 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a24816a:::benchmark_data_smithi188_77607_object134997:head# 2024-04-01T19:28:50.413 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.413 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a2698b3:::benchmark_data_smithi188_77607_object138577:head# 2024-04-01T19:28:50.413 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.413 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a270939:::benchmark_data_smithi188_77607_object146178:head# 2024-04-01T19:28:50.413 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.413 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a270ab1:::benchmark_data_smithi188_77607_object142529:head# 2024-04-01T19:28:50.413 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.414 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a28e558:::benchmark_data_smithi188_77607_object117764:head# 2024-04-01T19:28:50.414 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.414 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a2c9b2a:::benchmark_data_smithi188_77607_object109769:head# 2024-04-01T19:28:50.414 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.414 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a2dada3:::benchmark_data_smithi188_77607_object153162:head# 2024-04-01T19:28:50.414 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.414 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a2e97f4:::benchmark_data_smithi188_77607_object98082:head# 2024-04-01T19:28:50.414 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.414 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a2ea59c:::benchmark_data_smithi188_77607_object132492:head# 2024-04-01T19:28:50.414 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.414 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a3033a5:::benchmark_data_smithi188_77607_object103533:head# 2024-04-01T19:28:50.414 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.414 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a31cc2f:::benchmark_data_smithi188_77607_object131360:head# 2024-04-01T19:28:50.414 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.415 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a331081:::benchmark_data_smithi188_77607_object136869:head# 2024-04-01T19:28:50.415 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.415 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a3495c3:::benchmark_data_smithi188_77607_object137579:head# 2024-04-01T19:28:50.415 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.415 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a351f55:::benchmark_data_smithi188_77607_object101168:head# 2024-04-01T19:28:50.415 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.415 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a355ed9:::benchmark_data_smithi188_77607_object139477:head# 2024-04-01T19:28:50.415 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.415 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a35bf17:::benchmark_data_smithi188_77607_object99284:head# 2024-04-01T19:28:50.415 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.415 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a35cf48:::benchmark_data_smithi188_77607_object167115:head# 2024-04-01T19:28:50.415 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.415 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a35eebc:::benchmark_data_smithi188_77607_object137126:head# 2024-04-01T19:28:50.415 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.416 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a39d634:::benchmark_data_smithi188_77607_object123258:head# 2024-04-01T19:28:50.416 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.416 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a39dbf7:::benchmark_data_smithi188_77607_object106841:head# 2024-04-01T19:28:50.416 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.416 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a3ec75d:::benchmark_data_smithi188_77607_object137576:head# 2024-04-01T19:28:50.416 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.416 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a3ee735:::benchmark_data_smithi188_77607_object138922:head# 2024-04-01T19:28:50.416 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.416 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a3f820e:::benchmark_data_smithi188_77607_object126105:head# 2024-04-01T19:28:50.416 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.416 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a403ed7:::benchmark_data_smithi188_77607_object158372:head# 2024-04-01T19:28:50.416 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.416 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a406ed8:::benchmark_data_smithi188_77607_object124936:head# 2024-04-01T19:28:50.417 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.417 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a408af4:::benchmark_data_smithi188_77607_object150293:head# 2024-04-01T19:28:50.417 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.417 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a40a5e6:::benchmark_data_smithi188_77607_object110617:head# 2024-04-01T19:28:50.417 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.417 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a40a92e:::benchmark_data_smithi188_77607_object134046:head# 2024-04-01T19:28:50.417 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.417 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a417d06:::benchmark_data_smithi188_77607_object104417:head# 2024-04-01T19:28:50.417 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.425 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a421142:::benchmark_data_smithi188_77607_object129501:head# 2024-04-01T19:28:50.425 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.425 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a44db68:::benchmark_data_smithi188_77607_object125012:head# 2024-04-01T19:28:50.425 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.425 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a46791e:::benchmark_data_smithi188_77607_object166547:head# 2024-04-01T19:28:50.425 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.425 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a47220d:::benchmark_data_smithi188_77607_object150047:head# 2024-04-01T19:28:50.425 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.425 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a484ed1:::benchmark_data_smithi188_77607_object119957:head# 2024-04-01T19:28:50.425 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.425 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a49c782:::benchmark_data_smithi188_77607_object105790:head# 2024-04-01T19:28:50.426 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.426 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a4a9375:::benchmark_data_smithi188_77607_object160180:head# 2024-04-01T19:28:50.426 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.426 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a4b55a7:::benchmark_data_smithi188_77607_object164445:head# 2024-04-01T19:28:50.426 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.426 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a4ccb6f:::benchmark_data_smithi188_77607_object118751:head# 2024-04-01T19:28:50.426 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.426 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a4dc200:::benchmark_data_smithi188_77607_object150213:head# 2024-04-01T19:28:50.426 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.426 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a4e05bd:::benchmark_data_smithi188_77607_object119858:head# 2024-04-01T19:28:50.426 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.426 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a4f3ea6:::benchmark_data_smithi188_77607_object135327:head# 2024-04-01T19:28:50.426 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.427 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a4fdb81:::benchmark_data_smithi188_77607_object101267:head# 2024-04-01T19:28:50.427 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.427 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a4fdf1e:::benchmark_data_smithi188_77607_object167174:head# 2024-04-01T19:28:50.427 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.427 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a51c346:::benchmark_data_smithi188_77607_object106793:head# 2024-04-01T19:28:50.427 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.427 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a530668:::benchmark_data_smithi188_77607_object108529:head# 2024-04-01T19:28:50.427 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.427 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a5310c2:::benchmark_data_smithi188_77607_object131502:head# 2024-04-01T19:28:50.427 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.427 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a536794:::benchmark_data_smithi188_77607_object120792:head# 2024-04-01T19:28:50.427 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.427 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a54a582:::benchmark_data_smithi188_77607_object120105:head# 2024-04-01T19:28:50.427 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.428 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a550e85:::benchmark_data_smithi188_77607_object140108:head# 2024-04-01T19:28:50.428 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.428 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a58779f:::benchmark_data_smithi188_77607_object130657:head# 2024-04-01T19:28:50.428 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.428 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a597db9:::benchmark_data_smithi188_77607_object148393:head# 2024-04-01T19:28:50.428 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.428 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a59b9dd:::benchmark_data_smithi188_77607_object145509:head# 2024-04-01T19:28:50.428 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.428 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a5a03c5:::benchmark_data_smithi188_77607_object116919:head# 2024-04-01T19:28:50.428 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.428 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a5b4893:::benchmark_data_smithi188_77607_object108929:head# 2024-04-01T19:28:50.428 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.429 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a5b829e:::benchmark_data_smithi188_77607_object167175:head# 2024-04-01T19:28:50.429 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.429 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a5cdb49:::benchmark_data_smithi188_77607_object111729:head# 2024-04-01T19:28:50.429 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.429 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a5e2a8e:::benchmark_data_smithi188_77607_object118784:head# 2024-04-01T19:28:50.429 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.429 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a5f4e78:::benchmark_data_smithi188_77607_object136668:head# 2024-04-01T19:28:50.429 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.429 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a5fc0fe:::benchmark_data_smithi188_77607_object115653:head# 2024-04-01T19:28:50.429 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.429 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a5ff92b:::benchmark_data_smithi188_77607_object165925:head# 2024-04-01T19:28:50.429 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.429 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a61b7a8:::benchmark_data_smithi188_77607_object146713:head# 2024-04-01T19:28:50.429 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.430 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a6208c7:::benchmark_data_smithi188_77607_object137023:head# 2024-04-01T19:28:50.430 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.430 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a639c87:::benchmark_data_smithi188_77607_object124757:head# 2024-04-01T19:28:50.430 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.430 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a63e38a:::benchmark_data_smithi188_77607_object156341:head# 2024-04-01T19:28:50.430 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.430 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a64b797:::benchmark_data_smithi188_77607_object133293:head# 2024-04-01T19:28:50.430 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.430 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a650260:::benchmark_data_smithi188_77607_object105617:head# 2024-04-01T19:28:50.430 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.430 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a650731:::benchmark_data_smithi188_77607_object151998:head# 2024-04-01T19:28:50.430 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.430 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a671f3f:::benchmark_data_smithi188_77607_object164010:head# 2024-04-01T19:28:50.431 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.431 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a673094:::benchmark_data_smithi188_77607_object140449:head# 2024-04-01T19:28:50.431 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.431 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a674ae7:::benchmark_data_smithi188_77607_object124877:head# 2024-04-01T19:28:50.431 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.431 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a6817e8:::benchmark_data_smithi188_77607_object130977:head# 2024-04-01T19:28:50.431 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.431 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a68ca51:::benchmark_data_smithi188_77607_object164495:head# 2024-04-01T19:28:50.431 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.431 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a68ebbb:::benchmark_data_smithi188_77607_object101256:head# 2024-04-01T19:28:50.431 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.431 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a69941d:::benchmark_data_smithi188_77607_object137146:head# 2024-04-01T19:28:50.431 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.431 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a69ff7e:::benchmark_data_smithi188_77607_object118320:head# 2024-04-01T19:28:50.432 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.432 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a6b9131:::benchmark_data_smithi188_77607_object162232:head# 2024-04-01T19:28:50.432 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.432 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a6beec2:::benchmark_data_smithi188_77607_object156315:head# 2024-04-01T19:28:50.432 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.432 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a6bf96d:::benchmark_data_smithi188_77607_object122788:head# 2024-04-01T19:28:50.432 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.432 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a6c6312:::benchmark_data_smithi188_77607_object125077:head# 2024-04-01T19:28:50.432 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.432 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a6d02bd:::benchmark_data_smithi188_77607_object141116:head# 2024-04-01T19:28:50.432 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.432 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a6e9801:::benchmark_data_smithi188_77607_object161574:head# 2024-04-01T19:28:50.432 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.432 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a6f7404:::benchmark_data_smithi188_77607_object125509:head# 2024-04-01T19:28:50.433 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.433 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a707575:::benchmark_data_smithi188_77607_object147588:head# 2024-04-01T19:28:50.433 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.433 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a718202:::benchmark_data_smithi188_77607_object122133:head# 2024-04-01T19:28:50.433 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.433 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:28:50.436 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a72ae29:::benchmark_data_smithi188_77607_object157991:head# 2024-04-01T19:28:50.437 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.437 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a730af6:::benchmark_data_smithi188_77607_object101260:head# 2024-04-01T19:28:50.437 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.437 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a736a12:::benchmark_data_smithi188_77607_object155263:head# 2024-04-01T19:28:50.437 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.437 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a74c0a5:::benchmark_data_smithi188_77607_object101808:head# 2024-04-01T19:28:50.437 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.437 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a7558c7:::benchmark_data_smithi188_77607_object108876:head# 2024-04-01T19:28:50.437 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.437 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a757b59:::benchmark_data_smithi188_77607_object133701:head# 2024-04-01T19:28:50.437 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.437 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a76ebfe:::benchmark_data_smithi188_77607_object128311:head# 2024-04-01T19:28:50.438 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.438 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a77edd7:::benchmark_data_smithi188_77607_object111823:head# 2024-04-01T19:28:50.438 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.438 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a77f864:::benchmark_data_smithi188_77607_object129837:head# 2024-04-01T19:28:50.438 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.438 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a786a3b:::benchmark_data_smithi188_77607_object127613:head# 2024-04-01T19:28:50.438 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.438 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a78a846:::benchmark_data_smithi188_77607_object164418:head# 2024-04-01T19:28:50.438 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.438 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a7a206d:::benchmark_data_smithi188_77607_object164466:head# 2024-04-01T19:28:50.438 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.438 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a7cd6cf:::benchmark_data_smithi188_77607_object152576:head# 2024-04-01T19:28:50.439 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.439 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a7d56df:::benchmark_data_smithi188_77607_object165468:head# 2024-04-01T19:28:50.439 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.439 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a7e3f1e:::benchmark_data_smithi188_77607_object160637:head# 2024-04-01T19:28:50.439 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.439 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a80becd:::benchmark_data_smithi188_77607_object130761:head# 2024-04-01T19:28:50.439 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.439 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a811c3d:::benchmark_data_smithi188_77607_object136584:head# 2024-04-01T19:28:50.439 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.439 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a82c39e:::benchmark_data_smithi188_77607_object139992:head# 2024-04-01T19:28:50.439 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.439 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a83e4e3:::benchmark_data_smithi188_77607_object158221:head# 2024-04-01T19:28:50.439 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.440 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a854d30:::benchmark_data_smithi188_77607_object100632:head# 2024-04-01T19:28:50.440 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.440 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a864700:::benchmark_data_smithi188_77607_object142646:head# 2024-04-01T19:28:50.440 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.440 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a87f0c2:::benchmark_data_smithi188_77607_object146395:head# 2024-04-01T19:28:50.440 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.440 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a8a0232:::benchmark_data_smithi188_77607_object102168:head# 2024-04-01T19:28:50.440 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.440 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a8c0554:::benchmark_data_smithi188_77607_object141230:head# 2024-04-01T19:28:50.440 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.440 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a8c9432:::benchmark_data_smithi188_77607_object159482:head# 2024-04-01T19:28:50.440 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.443 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a8f08c8:::benchmark_data_smithi188_77607_object128096:head# 2024-04-01T19:28:50.443 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.443 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a8f0d2d:::benchmark_data_smithi188_77607_object122932:head# 2024-04-01T19:28:50.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a8f3503:::benchmark_data_smithi188_77607_object108758:head# 2024-04-01T19:28:50.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a902bd7:::benchmark_data_smithi188_77607_object144519:head# 2024-04-01T19:28:50.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a90d2bf:::benchmark_data_smithi188_77607_object110538:head# 2024-04-01T19:28:50.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a91804f:::benchmark_data_smithi188_77607_object103631:head# 2024-04-01T19:28:50.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a934a3c:::benchmark_data_smithi188_77607_object143993:head# 2024-04-01T19:28:50.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a95fe8d:::benchmark_data_smithi188_77607_object152455:head# 2024-04-01T19:28:50.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.445 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a9666ae:::benchmark_data_smithi188_77607_object138523:head# 2024-04-01T19:28:50.445 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.445 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a96f04d:::benchmark_data_smithi188_77607_object121363:head# 2024-04-01T19:28:50.445 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.445 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a98061f:::benchmark_data_smithi188_77607_object125020:head# 2024-04-01T19:28:50.445 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.445 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a981131:::benchmark_data_smithi188_77607_object107638:head# 2024-04-01T19:28:50.445 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.445 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a996b7c:::benchmark_data_smithi188_77607_object106065:head# 2024-04-01T19:28:50.445 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.445 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a99fcf5:::benchmark_data_smithi188_77607_object147504:head# 2024-04-01T19:28:50.445 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.445 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a9bca56:::benchmark_data_smithi188_77607_object111818:head# 2024-04-01T19:28:50.445 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.446 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a9bee44:::benchmark_data_smithi188_77607_object138982:head# 2024-04-01T19:28:50.446 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.446 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a9cd395:::benchmark_data_smithi188_77607_object153684:head# 2024-04-01T19:28:50.446 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.446 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a9d51c8:::benchmark_data_smithi188_77607_object106338:head# 2024-04-01T19:28:50.446 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.446 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a9f7c2f:::benchmark_data_smithi188_77607_object119227:head# 2024-04-01T19:28:50.446 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.451 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6a9fbaa3:::benchmark_data_smithi188_77607_object131224:head# 2024-04-01T19:28:50.451 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.451 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aa05edd:::benchmark_data_smithi188_77607_object148122:head# 2024-04-01T19:28:50.451 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.451 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aa5084a:::benchmark_data_smithi188_77607_object142065:head# 2024-04-01T19:28:50.451 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.451 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aa5c76b:::benchmark_data_smithi188_77607_object108348:head# 2024-04-01T19:28:50.451 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.451 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aa5db07:::benchmark_data_smithi188_77607_object116433:head# 2024-04-01T19:28:50.452 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.452 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aa5f88b:::benchmark_data_smithi188_77607_object156937:head# 2024-04-01T19:28:50.452 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.452 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aa6d0d3:::benchmark_data_smithi188_77607_object162926:head# 2024-04-01T19:28:50.452 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.452 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aa71fcb:::benchmark_data_smithi188_77607_object153623:head# 2024-04-01T19:28:50.452 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.452 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aa74f8a:::benchmark_data_smithi188_77607_object122805:head# 2024-04-01T19:28:50.452 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.452 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aa76bc4:::benchmark_data_smithi188_77607_object149492:head# 2024-04-01T19:28:50.452 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.452 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aa7b82e:::benchmark_data_smithi188_77607_object142312:head# 2024-04-01T19:28:50.452 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.452 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aaa074d:::benchmark_data_smithi188_77607_object166202:head# 2024-04-01T19:28:50.453 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.453 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aab84aa:::benchmark_data_smithi188_77607_object131168:head# 2024-04-01T19:28:50.453 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.453 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aab9078:::benchmark_data_smithi188_77607_object99177:head# 2024-04-01T19:28:50.453 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.453 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aabb161:::benchmark_data_smithi188_77607_object106144:head# 2024-04-01T19:28:50.453 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.453 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aace648:::benchmark_data_smithi188_77607_object156111:head# 2024-04-01T19:28:50.453 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.453 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aacf237:::benchmark_data_smithi188_77607_object166223:head# 2024-04-01T19:28:50.453 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.453 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aad4846:::benchmark_data_smithi188_77607_object104848:head# 2024-04-01T19:28:50.453 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.454 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aaeec91:::benchmark_data_smithi188_77607_object155587:head# 2024-04-01T19:28:50.454 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.454 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aaef23c:::benchmark_data_smithi188_77607_object163110:head# 2024-04-01T19:28:50.454 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.454 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aaf2f52:::benchmark_data_smithi188_77607_object155747:head# 2024-04-01T19:28:50.454 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.454 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aaf4e60:::benchmark_data_smithi188_77607_object135668:head# 2024-04-01T19:28:50.454 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.454 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aaf58cb:::benchmark_data_smithi188_77607_object107226:head# 2024-04-01T19:28:50.454 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.454 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aaf607b:::benchmark_data_smithi188_77607_object109683:head# 2024-04-01T19:28:50.454 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.454 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aafe6b7:::benchmark_data_smithi188_77607_object115348:head# 2024-04-01T19:28:50.454 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.454 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ab05ca7:::benchmark_data_smithi188_77607_object121536:head# 2024-04-01T19:28:50.455 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.455 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ab1096a:::benchmark_data_smithi188_77607_object138120:head# 2024-04-01T19:28:50.455 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.455 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ab1a703:::benchmark_data_smithi188_77607_object147347:head# 2024-04-01T19:28:50.455 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.455 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ab375c3:::benchmark_data_smithi188_77607_object133292:head# 2024-04-01T19:28:50.455 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.455 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ab47ecf:::benchmark_data_smithi188_77607_object131666:head# 2024-04-01T19:28:50.455 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.460 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ab59aa2:::benchmark_data_smithi188_77607_object157447:head# 2024-04-01T19:28:50.461 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.461 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ab684f6:::benchmark_data_smithi188_77607_object109893:head# 2024-04-01T19:28:50.461 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.461 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ab74243:::benchmark_data_smithi188_77607_object130636:head# 2024-04-01T19:28:50.461 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.461 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ab84cd4:::benchmark_data_smithi188_77607_object134942:head# 2024-04-01T19:28:50.461 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.461 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ab8f26b:::benchmark_data_smithi188_77607_object164399:head# 2024-04-01T19:28:50.461 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.461 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6abb0aac:::benchmark_data_smithi188_77607_object103773:head# 2024-04-01T19:28:50.461 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.461 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6abb8956:::benchmark_data_smithi188_77607_object99666:head# 2024-04-01T19:28:50.461 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.462 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6abbcc40:::benchmark_data_smithi188_77607_object123834:head# 2024-04-01T19:28:50.462 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.462 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6abc7482:::benchmark_data_smithi188_77607_object138542:head# 2024-04-01T19:28:50.462 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.462 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6abcd933:::benchmark_data_smithi188_77607_object141625:head# 2024-04-01T19:28:50.462 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.462 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6abd88fc:::benchmark_data_smithi188_77607_object129308:head# 2024-04-01T19:28:50.462 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.462 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6abde1c8:::benchmark_data_smithi188_77607_object127152:head# 2024-04-01T19:28:50.462 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.462 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6abe9694:::benchmark_data_smithi188_77607_object142272:head# 2024-04-01T19:28:50.462 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.462 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ac0fe57:::benchmark_data_smithi188_77607_object114073:head# 2024-04-01T19:28:50.462 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.463 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ac140dd:::benchmark_data_smithi188_77607_object99033:head# 2024-04-01T19:28:50.463 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.463 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ac16105:::benchmark_data_smithi188_77607_object115786:head# 2024-04-01T19:28:50.463 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.463 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ac35cef:::benchmark_data_smithi188_77607_object127090:head# 2024-04-01T19:28:50.463 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.463 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ac361d0:::benchmark_data_smithi188_77607_object120633:head# 2024-04-01T19:28:50.463 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.463 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ac498aa:::benchmark_data_smithi188_77607_object163514:head# 2024-04-01T19:28:50.463 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.463 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ac5fc62:::benchmark_data_smithi188_77607_object153847:head# 2024-04-01T19:28:50.463 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.463 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ac6c043:::benchmark_data_smithi188_77607_object137825:head# 2024-04-01T19:28:50.464 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.464 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ac878ff:::benchmark_data_smithi188_77607_object162539:head# 2024-04-01T19:28:50.464 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.464 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ac88fb3:::benchmark_data_smithi188_77607_object106517:head# 2024-04-01T19:28:50.464 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.464 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ac8dac0:::benchmark_data_smithi188_77607_object152301:head# 2024-04-01T19:28:50.464 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.464 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6acc1ae8:::benchmark_data_smithi188_77607_object147587:head# 2024-04-01T19:28:50.464 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.464 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6acd6ae8:::benchmark_data_smithi188_77607_object144736:head# 2024-04-01T19:28:50.464 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.464 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6acd9335:::benchmark_data_smithi188_77607_object154850:head# 2024-04-01T19:28:50.464 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.465 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ace39cf:::benchmark_data_smithi188_77607_object152468:head# 2024-04-01T19:28:50.465 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.465 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6acf9edf:::benchmark_data_smithi188_77607_object161685:head# 2024-04-01T19:28:50.465 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.465 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ad071df:::benchmark_data_smithi188_77607_object141270:head# 2024-04-01T19:28:50.465 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.465 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ad0b0ab:::benchmark_data_smithi188_77607_object105461:head# 2024-04-01T19:28:50.465 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.465 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ad0b41c:::benchmark_data_smithi188_77607_object164130:head# 2024-04-01T19:28:50.465 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.465 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ad22ae1:::benchmark_data_smithi188_77607_object155865:head# 2024-04-01T19:28:50.465 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.465 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ad30334:::benchmark_data_smithi188_77607_object102264:head# 2024-04-01T19:28:50.465 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.465 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ad35eac:::benchmark_data_smithi188_77607_object165132:head# 2024-04-01T19:28:50.466 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.466 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ad59611:::benchmark_data_smithi188_77607_object166199:head# 2024-04-01T19:28:50.466 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.466 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ad5bf13:::benchmark_data_smithi188_77607_object135965:head# 2024-04-01T19:28:50.466 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.466 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ad6df70:::benchmark_data_smithi188_77607_object132538:head# 2024-04-01T19:28:50.466 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.466 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ad74115:::benchmark_data_smithi188_77607_object163953:head# 2024-04-01T19:28:50.466 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.466 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ad8a958:::benchmark_data_smithi188_77607_object102042:head# 2024-04-01T19:28:50.466 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.466 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6adb4992:::benchmark_data_smithi188_77607_object98847:head# 2024-04-01T19:28:50.466 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.473 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6adc3a98:::benchmark_data_smithi188_77607_object166221:head# 2024-04-01T19:28:50.473 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.474 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6adc6b8e:::benchmark_data_smithi188_77607_object107109:head# 2024-04-01T19:28:50.474 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.474 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6adcdb9a:::benchmark_data_smithi188_77607_object136859:head# 2024-04-01T19:28:50.474 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.474 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ade4b6f:::benchmark_data_smithi188_77607_object144353:head# 2024-04-01T19:28:50.474 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.474 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6adefaf9:::benchmark_data_smithi188_77607_object115108:head# 2024-04-01T19:28:50.474 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.474 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ae07028:::benchmark_data_smithi188_77607_object145404:head# 2024-04-01T19:28:50.474 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.474 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ae19d29:::benchmark_data_smithi188_77607_object116296:head# 2024-04-01T19:28:50.474 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.475 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ae2a053:::benchmark_data_smithi188_77607_object118882:head# 2024-04-01T19:28:50.475 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.475 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ae3a8a2:::benchmark_data_smithi188_77607_object107788:head# 2024-04-01T19:28:50.475 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.475 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ae3ca09:::benchmark_data_smithi188_77607_object123748:head# 2024-04-01T19:28:50.475 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.475 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ae3d297:::benchmark_data_smithi188_77607_object134846:head# 2024-04-01T19:28:50.475 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.475 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ae4c9d0:::benchmark_data_smithi188_77607_object145152:head# 2024-04-01T19:28:50.475 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.475 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ae647b3:::benchmark_data_smithi188_77607_object129126:head# 2024-04-01T19:28:50.475 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.475 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ae698e9:::benchmark_data_smithi188_77607_object122168:head# 2024-04-01T19:28:50.476 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.476 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ae74430:::benchmark_data_smithi188_77607_object102331:head# 2024-04-01T19:28:50.476 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.476 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ae91690:::benchmark_data_smithi188_77607_object125546:head# 2024-04-01T19:28:50.476 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.476 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ae9cc59:::benchmark_data_smithi188_77607_object137137:head# 2024-04-01T19:28:50.476 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.476 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aea054e:::benchmark_data_smithi188_77607_object142154:head# 2024-04-01T19:28:50.476 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.476 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aea4da5:::benchmark_data_smithi188_77607_object125397:head# 2024-04-01T19:28:50.476 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.476 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aea8ea0:::benchmark_data_smithi188_77607_object161290:head# 2024-04-01T19:28:50.476 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.476 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aeb31b1:::benchmark_data_smithi188_77607_object138855:head# 2024-04-01T19:28:50.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aeb58e6:::benchmark_data_smithi188_77607_object102743:head# 2024-04-01T19:28:50.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aeb9c91:::benchmark_data_smithi188_77607_object125004:head# 2024-04-01T19:28:50.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aeef336:::benchmark_data_smithi188_77607_object158161:head# 2024-04-01T19:28:50.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aef9cf6:::benchmark_data_smithi188_77607_object112162:head# 2024-04-01T19:28:50.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6af08e39:::benchmark_data_smithi188_77607_object165982:head# 2024-04-01T19:28:50.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6af192c8:::benchmark_data_smithi188_77607_object159425:head# 2024-04-01T19:28:50.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6af2667d:::benchmark_data_smithi188_77607_object110815:head# 2024-04-01T19:28:50.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.478 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6af28c8d:::benchmark_data_smithi188_77607_object142820:head# 2024-04-01T19:28:50.478 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.478 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6af321f4:::benchmark_data_smithi188_77607_object124430:head# 2024-04-01T19:28:50.478 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.478 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6af5e0ab:::benchmark_data_smithi188_77607_object139490:head# 2024-04-01T19:28:50.478 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.478 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6af5f11b:::benchmark_data_smithi188_77607_object147015:head# 2024-04-01T19:28:50.478 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.478 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6af68d49:::benchmark_data_smithi188_77607_object129600:head# 2024-04-01T19:28:50.478 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.478 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6af6c466:::benchmark_data_smithi188_77607_object150991:head# 2024-04-01T19:28:50.478 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.478 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6af7458a:::benchmark_data_smithi188_77607_object134914:head# 2024-04-01T19:28:50.479 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.479 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6af85425:::benchmark_data_smithi188_77607_object108083:head# 2024-04-01T19:28:50.479 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.479 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6af8ecf6:::benchmark_data_smithi188_77607_object135105:head# 2024-04-01T19:28:50.479 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.479 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6af9c28b:::benchmark_data_smithi188_77607_object98225:head# 2024-04-01T19:28:50.479 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.479 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6afa1b3e:::benchmark_data_smithi188_77607_object160014:head# 2024-04-01T19:28:50.479 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.479 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6afc8691:::benchmark_data_smithi188_77607_object112058:head# 2024-04-01T19:28:50.479 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.479 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6afc9703:::benchmark_data_smithi188_77607_object158590:head# 2024-04-01T19:28:50.479 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.479 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6afd2cdb:::benchmark_data_smithi188_77607_object125560:head# 2024-04-01T19:28:50.480 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.480 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6afd50f3:::benchmark_data_smithi188_77607_object124036:head# 2024-04-01T19:28:50.480 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.480 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6afeed90:::benchmark_data_smithi188_77607_object104653:head# 2024-04-01T19:28:50.480 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.480 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6aff4d3f:::benchmark_data_smithi188_77607_object162631:head# 2024-04-01T19:28:50.480 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.480 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b00c0b6:::benchmark_data_smithi188_77607_object126842:head# 2024-04-01T19:28:50.480 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.480 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b00c82f:::benchmark_data_smithi188_77607_object142607:head# 2024-04-01T19:28:50.480 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.480 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b029e39:::benchmark_data_smithi188_77607_object113963:head# 2024-04-01T19:28:50.480 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.480 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b02fd36:::benchmark_data_smithi188_77607_object111669:head# 2024-04-01T19:28:50.481 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.481 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b03ae80:::benchmark_data_smithi188_77607_object128950:head# 2024-04-01T19:28:50.481 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.481 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b051ebe:::benchmark_data_smithi188_77607_object152636:head# 2024-04-01T19:28:50.481 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.481 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b07dcba:::benchmark_data_smithi188_77607_object161451:head# 2024-04-01T19:28:50.481 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.487 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b09f34f:::benchmark_data_smithi188_77607_object122073:head# 2024-04-01T19:28:50.487 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.487 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b0ae5a4:::benchmark_data_smithi188_77607_object149556:head# 2024-04-01T19:28:50.487 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.488 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b0cbf19:::benchmark_data_smithi188_77607_object144972:head# 2024-04-01T19:28:50.488 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.488 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b0de95c:::benchmark_data_smithi188_77607_object165038:head# 2024-04-01T19:28:50.488 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.488 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b0e4645:::benchmark_data_smithi188_77607_object152961:head# 2024-04-01T19:28:50.488 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.488 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b10772d:::benchmark_data_smithi188_77607_object131764:head# 2024-04-01T19:28:50.488 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.488 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b117b32:::benchmark_data_smithi188_77607_object124749:head# 2024-04-01T19:28:50.488 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.488 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b145695:::benchmark_data_smithi188_77607_object139039:head# 2024-04-01T19:28:50.488 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.488 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b173771:::benchmark_data_smithi188_77607_object97784:head# 2024-04-01T19:28:50.489 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.489 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b17f583:::benchmark_data_smithi188_77607_object160387:head# 2024-04-01T19:28:50.489 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.489 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b18515a:::benchmark_data_smithi188_77607_object137519:head# 2024-04-01T19:28:50.489 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.489 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b1872b4:::benchmark_data_smithi188_77607_object114536:head# 2024-04-01T19:28:50.489 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.489 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b1a6a88:::benchmark_data_smithi188_77607_object151329:head# 2024-04-01T19:28:50.489 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.489 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b1ac48e:::benchmark_data_smithi188_77607_object141292:head# 2024-04-01T19:28:50.489 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.489 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b1ca665:::benchmark_data_smithi188_77607_object127525:head# 2024-04-01T19:28:50.489 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.489 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b1d6f29:::benchmark_data_smithi188_77607_object109210:head# 2024-04-01T19:28:50.489 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.490 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b1db5bd:::benchmark_data_smithi188_77607_object145035:head# 2024-04-01T19:28:50.490 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.490 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b1e50e2:::benchmark_data_smithi188_77607_object161375:head# 2024-04-01T19:28:50.490 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.490 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b208aeb:::benchmark_data_smithi188_77607_object148062:head# 2024-04-01T19:28:50.490 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.490 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b20a211:::benchmark_data_smithi188_77607_object100547:head# 2024-04-01T19:28:50.490 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.490 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b20b398:::benchmark_data_smithi188_77607_object128909:head# 2024-04-01T19:28:50.490 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.490 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b2122bb:::benchmark_data_smithi188_77607_object134491:head# 2024-04-01T19:28:50.490 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b218478:::benchmark_data_smithi188_77607_object142475:head# 2024-04-01T19:28:50.491 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b222b00:::benchmark_data_smithi188_77607_object106314:head# 2024-04-01T19:28:50.491 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b231352:::benchmark_data_smithi188_77607_object156233:head# 2024-04-01T19:28:50.491 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b23171c:::benchmark_data_smithi188_77607_object167342:head# 2024-04-01T19:28:50.491 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b24c584:::benchmark_data_smithi188_77607_object114116:head# 2024-04-01T19:28:50.491 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b250b48:::benchmark_data_smithi188_77607_object148176:head# 2024-04-01T19:28:50.491 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b268433:::benchmark_data_smithi188_77607_object130913:head# 2024-04-01T19:28:50.491 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.492 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b26895e:::benchmark_data_smithi188_77607_object104883:head# 2024-04-01T19:28:50.492 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.492 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b2918a6:::benchmark_data_smithi188_77607_object108599:head# 2024-04-01T19:28:50.492 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.492 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b299bb1:::benchmark_data_smithi188_77607_object146185:head# 2024-04-01T19:28:50.492 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.492 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b29b7e5:::benchmark_data_smithi188_77607_object159011:head# 2024-04-01T19:28:50.492 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.492 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b2a026a:::benchmark_data_smithi188_77607_object126511:head# 2024-04-01T19:28:50.492 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.492 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b2c4797:::benchmark_data_smithi188_77607_object112121:head# 2024-04-01T19:28:50.492 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.492 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b2dbddf:::benchmark_data_smithi188_77607_object119159:head# 2024-04-01T19:28:50.493 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.493 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b2fc750:::benchmark_data_smithi188_77607_object118860:head# 2024-04-01T19:28:50.493 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.493 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b304ca5:::benchmark_data_smithi188_77607_object114159:head# 2024-04-01T19:28:50.493 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.493 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b30682f:::benchmark_data_smithi188_77607_object124381:head# 2024-04-01T19:28:50.493 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.493 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b307f9e:::benchmark_data_smithi188_77607_object107634:head# 2024-04-01T19:28:50.493 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.493 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b31dbcd:::benchmark_data_smithi188_77607_object137958:head# 2024-04-01T19:28:50.493 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.493 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b32fbeb:::benchmark_data_smithi188_77607_object158191:head# 2024-04-01T19:28:50.493 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.493 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b33df12:::benchmark_data_smithi188_77607_object147659:head# 2024-04-01T19:28:50.494 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.494 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b34e2e2:::benchmark_data_smithi188_77607_object148737:head# 2024-04-01T19:28:50.494 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.494 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b34f802:::benchmark_data_smithi188_77607_object135913:head# 2024-04-01T19:28:50.494 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.494 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b353b3c:::benchmark_data_smithi188_77607_object132897:head# 2024-04-01T19:28:50.494 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.494 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b357321:::benchmark_data_smithi188_77607_object157291:head# 2024-04-01T19:28:50.494 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.494 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b36e4f3:::benchmark_data_smithi188_77607_object123095:head# 2024-04-01T19:28:50.494 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.494 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b3791f5:::benchmark_data_smithi188_77607_object100317:head# 2024-04-01T19:28:50.494 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.494 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b38156b:::benchmark_data_smithi188_77607_object115002:head# 2024-04-01T19:28:50.495 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.501 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b39406a:::benchmark_data_smithi188_77607_object131301:head# 2024-04-01T19:28:50.501 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.501 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b3ac01e:::benchmark_data_smithi188_77607_object151926:head# 2024-04-01T19:28:50.501 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.501 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b3b45cb:::benchmark_data_smithi188_77607_object139415:head# 2024-04-01T19:28:50.501 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.501 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b3bcaa8:::benchmark_data_smithi188_77607_object158383:head# 2024-04-01T19:28:50.502 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.502 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b3c7ff8:::benchmark_data_smithi188_77607_object119937:head# 2024-04-01T19:28:50.502 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.502 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b3cb239:::benchmark_data_smithi188_77607_object167295:head# 2024-04-01T19:28:50.502 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.502 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b3e1881:::benchmark_data_smithi188_77607_object131241:head# 2024-04-01T19:28:50.502 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.502 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b3fa8fe:::benchmark_data_smithi188_77607_object140314:head# 2024-04-01T19:28:50.502 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.502 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b40e20e:::benchmark_data_smithi188_77607_object128797:head# 2024-04-01T19:28:50.502 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.502 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b427195:::benchmark_data_smithi188_77607_object134502:head# 2024-04-01T19:28:50.502 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.502 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b43d66c:::benchmark_data_smithi188_77607_object136988:head# 2024-04-01T19:28:50.503 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.503 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b4439bb:::benchmark_data_smithi188_77607_object123240:head# 2024-04-01T19:28:50.503 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.503 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b44842e:::benchmark_data_smithi188_77607_object111789:head# 2024-04-01T19:28:50.503 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.503 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b451ab6:::benchmark_data_smithi188_77607_object128778:head# 2024-04-01T19:28:50.503 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.503 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b46aef8:::benchmark_data_smithi188_77607_object166773:head# 2024-04-01T19:28:50.503 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.503 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b479790:::benchmark_data_smithi188_77607_object151990:head# 2024-04-01T19:28:50.503 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.503 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b47b8f7:::benchmark_data_smithi188_77607_object119907:head# 2024-04-01T19:28:50.503 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.503 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b47e0c6:::benchmark_data_smithi188_77607_object128503:head# 2024-04-01T19:28:50.503 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.504 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b4a148b:::benchmark_data_smithi188_77607_object101811:head# 2024-04-01T19:28:50.504 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.504 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b4bb5d5:::benchmark_data_smithi188_77607_object126501:head# 2024-04-01T19:28:50.504 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.504 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b4d05a8:::benchmark_data_smithi188_77607_object152451:head# 2024-04-01T19:28:50.504 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.504 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b4d05d8:::benchmark_data_smithi188_77607_object156501:head# 2024-04-01T19:28:50.504 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.504 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b4deb0b:::benchmark_data_smithi188_77607_object165465:head# 2024-04-01T19:28:50.504 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.504 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b4df64c:::benchmark_data_smithi188_77607_object152267:head# 2024-04-01T19:28:50.504 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.504 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b4e3613:::benchmark_data_smithi188_77607_object127095:head# 2024-04-01T19:28:50.504 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.505 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b4e5de5:::benchmark_data_smithi188_77607_object150121:head# 2024-04-01T19:28:50.505 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.505 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b4efacb:::benchmark_data_smithi188_77607_object101630:head# 2024-04-01T19:28:50.505 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.505 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b5035f9:::benchmark_data_smithi188_77607_object122580:head# 2024-04-01T19:28:50.505 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.505 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b51a0c4:::benchmark_data_smithi188_77607_object135174:head# 2024-04-01T19:28:50.505 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.505 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b5252fb:::benchmark_data_smithi188_77607_object157442:head# 2024-04-01T19:28:50.505 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.505 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b533a05:::benchmark_data_smithi188_77607_object162642:head# 2024-04-01T19:28:50.505 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.505 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b57e0fc:::benchmark_data_smithi188_77607_object117798:head# 2024-04-01T19:28:50.505 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.506 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b5819c7:::benchmark_data_smithi188_77607_object139616:head# 2024-04-01T19:28:50.506 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.506 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b5a282c:::benchmark_data_smithi188_77607_object150721:head# 2024-04-01T19:28:50.506 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.506 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b5c8992:::benchmark_data_smithi188_77607_object163693:head# 2024-04-01T19:28:50.506 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.506 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b5ca3d7:::benchmark_data_smithi188_77607_object157129:head# 2024-04-01T19:28:50.506 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.506 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b5e1f92:::benchmark_data_smithi188_77607_object101316:head# 2024-04-01T19:28:50.506 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.506 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b5ecac9:::benchmark_data_smithi188_77607_object135458:head# 2024-04-01T19:28:50.506 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.506 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b613d92:::benchmark_data_smithi188_77607_object129700:head# 2024-04-01T19:28:50.506 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.507 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b61c242:::benchmark_data_smithi188_77607_object147036:head# 2024-04-01T19:28:50.507 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.507 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b62a80b:::benchmark_data_smithi188_77607_object157241:head# 2024-04-01T19:28:50.507 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.507 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b63fb87:::benchmark_data_smithi188_77607_object142979:head# 2024-04-01T19:28:50.507 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.507 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b640a76:::benchmark_data_smithi188_77607_object109723:head# 2024-04-01T19:28:50.507 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.507 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b660e83:::benchmark_data_smithi188_77607_object143697:head# 2024-04-01T19:28:50.507 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.507 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b66a00a:::benchmark_data_smithi188_77607_object119239:head# 2024-04-01T19:28:50.507 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.507 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b68c42a:::benchmark_data_smithi188_77607_object161614:head# 2024-04-01T19:28:50.507 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.508 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b6b8e93:::benchmark_data_smithi188_77607_object137315:head# 2024-04-01T19:28:50.508 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.508 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b6baecf:::benchmark_data_smithi188_77607_object152115:head# 2024-04-01T19:28:50.508 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.508 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b6bf7b7:::benchmark_data_smithi188_77607_object114803:head# 2024-04-01T19:28:50.508 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.508 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b6c8f98:::benchmark_data_smithi188_77607_object102811:head# 2024-04-01T19:28:50.508 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.508 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b6d2ac0:::benchmark_data_smithi188_77607_object164102:head# 2024-04-01T19:28:50.508 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.508 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b703fb0:::benchmark_data_smithi188_77607_object141871:head# 2024-04-01T19:28:50.508 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.508 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b704ccf:::benchmark_data_smithi188_77607_object121796:head# 2024-04-01T19:28:50.509 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.509 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b7099be:::benchmark_data_smithi188_77607_object144192:head# 2024-04-01T19:28:50.509 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.509 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b70afba:::benchmark_data_smithi188_77607_object128281:head# 2024-04-01T19:28:50.509 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.516 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:50.518 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b710f8c:::benchmark_data_smithi188_77607_object151485:head# 2024-04-01T19:28:50.519 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.519 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b724473:::benchmark_data_smithi188_77607_object130394:head# 2024-04-01T19:28:50.519 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.519 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b730dcd:::benchmark_data_smithi188_77607_object99115:head# 2024-04-01T19:28:50.519 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.519 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b73322f:::benchmark_data_smithi188_77607_object153701:head# 2024-04-01T19:28:50.519 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.519 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b747725:::benchmark_data_smithi188_77607_object145535:head# 2024-04-01T19:28:50.519 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.519 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b76cb23:::benchmark_data_smithi188_77607_object115528:head# 2024-04-01T19:28:50.520 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.520 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b79626f:::benchmark_data_smithi188_77607_object130215:head# 2024-04-01T19:28:50.520 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.520 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b7a2deb:::benchmark_data_smithi188_77607_object103375:head# 2024-04-01T19:28:50.520 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.520 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b7ad3b4:::benchmark_data_smithi188_77607_object100742:head# 2024-04-01T19:28:50.520 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.520 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b7b9921:::benchmark_data_smithi188_77607_object139277:head# 2024-04-01T19:28:50.520 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.520 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b7cf28b:::benchmark_data_smithi188_77607_object140028:head# 2024-04-01T19:28:50.521 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.521 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b7db31c:::benchmark_data_smithi188_77607_object130160:head# 2024-04-01T19:28:50.521 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.521 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b7dda8f:::benchmark_data_smithi188_77607_object153104:head# 2024-04-01T19:28:50.521 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.521 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b7fb4e6:::benchmark_data_smithi188_77607_object108392:head# 2024-04-01T19:28:50.521 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.521 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b80f579:::benchmark_data_smithi188_77607_object155039:head# 2024-04-01T19:28:50.521 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.521 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b8241a2:::benchmark_data_smithi188_77607_object145485:head# 2024-04-01T19:28:50.521 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.521 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b8259f5:::benchmark_data_smithi188_77607_object131102:head# 2024-04-01T19:28:50.522 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.522 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b8321eb:::benchmark_data_smithi188_77607_object158609:head# 2024-04-01T19:28:50.522 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.522 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b83d3f2:::benchmark_data_smithi188_77607_object115763:head# 2024-04-01T19:28:50.522 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.522 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b83d3f9:::benchmark_data_smithi188_77607_object126294:head# 2024-04-01T19:28:50.522 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.522 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b8449a7:::benchmark_data_smithi188_77607_object165859:head# 2024-04-01T19:28:50.522 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.522 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b85ce04:::benchmark_data_smithi188_77607_object162074:head# 2024-04-01T19:28:50.523 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.523 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b87924a:::benchmark_data_smithi188_77607_object109277:head# 2024-04-01T19:28:50.523 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.523 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b880389:::benchmark_data_smithi188_77607_object132245:head# 2024-04-01T19:28:50.523 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.523 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b89dadb:::benchmark_data_smithi188_77607_object143597:head# 2024-04-01T19:28:50.523 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.523 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b8a0d4d:::benchmark_data_smithi188_77607_object107605:head# 2024-04-01T19:28:50.523 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.523 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b8a75f1:::benchmark_data_smithi188_77607_object110320:head# 2024-04-01T19:28:50.523 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.524 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b8b197b:::benchmark_data_smithi188_77607_object131511:head# 2024-04-01T19:28:50.524 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.524 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b8c93dd:::benchmark_data_smithi188_77607_object111513:head# 2024-04-01T19:28:50.524 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.524 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b8d3fe3:::benchmark_data_smithi188_77607_object102939:head# 2024-04-01T19:28:50.524 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.524 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b8f4b4a:::benchmark_data_smithi188_77607_object145553:head# 2024-04-01T19:28:50.524 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.524 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b8fb5a1:::benchmark_data_smithi188_77607_object142576:head# 2024-04-01T19:28:50.524 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.524 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b8fba11:::benchmark_data_smithi188_77607_object119812:head# 2024-04-01T19:28:50.524 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.524 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b9058cc:::benchmark_data_smithi188_77607_object102034:head# 2024-04-01T19:28:50.524 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.525 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b90b913:::benchmark_data_smithi188_77607_object132548:head# 2024-04-01T19:28:50.525 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.525 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b91c538:::benchmark_data_smithi188_77607_object136355:head# 2024-04-01T19:28:50.525 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.525 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b92d51f:::benchmark_data_smithi188_77607_object112661:head# 2024-04-01T19:28:50.525 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.525 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b93cf88:::benchmark_data_smithi188_77607_object134135:head# 2024-04-01T19:28:50.525 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.525 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b94731b:::benchmark_data_smithi188_77607_object157646:head# 2024-04-01T19:28:50.525 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.525 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b950b1b:::benchmark_data_smithi188_77607_object112801:head# 2024-04-01T19:28:50.525 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.525 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b9560b1:::benchmark_data_smithi188_77607_object157978:head# 2024-04-01T19:28:50.525 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.525 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b95ac13:::benchmark_data_smithi188_77607_object133017:head# 2024-04-01T19:28:50.526 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.526 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b96a0ff:::benchmark_data_smithi188_77607_object141906:head# 2024-04-01T19:28:50.526 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.526 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b96c5d4:::benchmark_data_smithi188_77607_object131843:head# 2024-04-01T19:28:50.526 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.526 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b97e7b2:::benchmark_data_smithi188_77607_object158690:head# 2024-04-01T19:28:50.526 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.526 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b9816a4:::benchmark_data_smithi188_77607_object151764:head# 2024-04-01T19:28:50.526 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.526 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b9a5adc:::benchmark_data_smithi188_77607_object158164:head# 2024-04-01T19:28:50.526 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.526 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b9b7c96:::benchmark_data_smithi188_77607_object109514:head# 2024-04-01T19:28:50.526 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.526 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b9beea3:::benchmark_data_smithi188_77607_object153534:head# 2024-04-01T19:28:50.527 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.527 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b9cbcea:::benchmark_data_smithi188_77607_object107147:head# 2024-04-01T19:28:50.527 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.527 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b9cd899:::benchmark_data_smithi188_77607_object114630:head# 2024-04-01T19:28:50.527 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.527 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b9e61f8:::benchmark_data_smithi188_77607_object127230:head# 2024-04-01T19:28:50.527 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.527 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6b9f40a5:::benchmark_data_smithi188_77607_object163684:head# 2024-04-01T19:28:50.527 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.527 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ba038a2:::benchmark_data_smithi188_77607_object116116:head# 2024-04-01T19:28:50.527 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.527 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ba0e961:::benchmark_data_smithi188_77607_object134388:head# 2024-04-01T19:28:50.527 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.527 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ba1cac4:::benchmark_data_smithi188_77607_object143562:head# 2024-04-01T19:28:50.527 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.528 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ba45232:::benchmark_data_smithi188_77607_object125247:head# 2024-04-01T19:28:50.528 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.528 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ba48f4d:::benchmark_data_smithi188_77607_object166256:head# 2024-04-01T19:28:50.528 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.528 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ba4ded6:::benchmark_data_smithi188_77607_object112015:head# 2024-04-01T19:28:50.528 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.528 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ba502c2:::benchmark_data_smithi188_77607_object150641:head# 2024-04-01T19:28:50.528 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.528 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ba5691a:::benchmark_data_smithi188_77607_object119137:head# 2024-04-01T19:28:50.528 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.528 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ba73caf:::benchmark_data_smithi188_77607_object151964:head# 2024-04-01T19:28:50.528 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.528 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ba9b0d7:::benchmark_data_smithi188_77607_object145432:head# 2024-04-01T19:28:50.529 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.529 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ba9d006:::benchmark_data_smithi188_77607_object162185:head# 2024-04-01T19:28:50.529 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.529 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6baae328:::benchmark_data_smithi188_77607_object103117:head# 2024-04-01T19:28:50.529 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.529 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bab33a0:::benchmark_data_smithi188_77607_object150576:head# 2024-04-01T19:28:50.529 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.529 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bab3be1:::benchmark_data_smithi188_77607_object113914:head# 2024-04-01T19:28:50.529 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.529 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bab620f:::benchmark_data_smithi188_77607_object164278:head# 2024-04-01T19:28:50.529 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.529 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bab7a71:::benchmark_data_smithi188_77607_object139934:head# 2024-04-01T19:28:50.529 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.529 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6baba54e:::benchmark_data_smithi188_77607_object153483:head# 2024-04-01T19:28:50.530 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.541 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bae7bef:::benchmark_data_smithi188_77607_object163587:head# 2024-04-01T19:28:50.541 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.541 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bae9e39:::benchmark_data_smithi188_77607_object158016:head# 2024-04-01T19:28:50.541 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.541 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bafdc75:::benchmark_data_smithi188_77607_object108588:head# 2024-04-01T19:28:50.541 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.541 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bb0784e:::benchmark_data_smithi188_77607_object163379:head# 2024-04-01T19:28:50.542 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.542 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bb18e3c:::benchmark_data_smithi188_77607_object123318:head# 2024-04-01T19:28:50.542 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.542 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bb2197a:::benchmark_data_smithi188_77607_object154545:head# 2024-04-01T19:28:50.542 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.542 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bb2e4d3:::benchmark_data_smithi188_77607_object124328:head# 2024-04-01T19:28:50.542 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.542 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bb35af4:::benchmark_data_smithi188_77607_object142327:head# 2024-04-01T19:28:50.542 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.542 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bb36231:::benchmark_data_smithi188_77607_object112547:head# 2024-04-01T19:28:50.542 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.542 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bb51073:::benchmark_data_smithi188_77607_object124727:head# 2024-04-01T19:28:50.542 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.543 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bb55aa0:::benchmark_data_smithi188_77607_object137617:head# 2024-04-01T19:28:50.543 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.543 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bb6bb35:::benchmark_data_smithi188_77607_object122492:head# 2024-04-01T19:28:50.543 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.543 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bb7eb2f:::benchmark_data_smithi188_77607_object147067:head# 2024-04-01T19:28:50.543 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.543 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bba0e39:::benchmark_data_smithi188_77607_object157325:head# 2024-04-01T19:28:50.543 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.543 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bbd051a:::benchmark_data_smithi188_77607_object143719:head# 2024-04-01T19:28:50.543 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.543 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bbd6571:::benchmark_data_smithi188_77607_object144791:head# 2024-04-01T19:28:50.543 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.543 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bbe52fa:::benchmark_data_smithi188_77607_object116552:head# 2024-04-01T19:28:50.543 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.544 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bbf25b9:::benchmark_data_smithi188_77607_object154217:head# 2024-04-01T19:28:50.544 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.544 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bbf755b:::benchmark_data_smithi188_77607_object131048:head# 2024-04-01T19:28:50.544 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.544 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bc42f3d:::benchmark_data_smithi188_77607_object129406:head# 2024-04-01T19:28:50.544 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.544 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bc4436f:::benchmark_data_smithi188_77607_object124286:head# 2024-04-01T19:28:50.544 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.544 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bc4fca6:::benchmark_data_smithi188_77607_object130038:head# 2024-04-01T19:28:50.544 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.544 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bc504d7:::benchmark_data_smithi188_77607_object159278:head# 2024-04-01T19:28:50.544 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.544 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bc62827:::benchmark_data_smithi188_77607_object151039:head# 2024-04-01T19:28:50.545 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.545 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bc64656:::benchmark_data_smithi188_77607_object104400:head# 2024-04-01T19:28:50.545 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.545 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bc64a11:::benchmark_data_smithi188_77607_object127914:head# 2024-04-01T19:28:50.545 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.545 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bc6a762:::benchmark_data_smithi188_77607_object147963:head# 2024-04-01T19:28:50.545 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.545 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bc73d4a:::benchmark_data_smithi188_77607_object137556:head# 2024-04-01T19:28:50.545 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.545 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bc9e20d:::benchmark_data_smithi188_77607_object124339:head# 2024-04-01T19:28:50.545 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.545 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bca9d38:::benchmark_data_smithi188_77607_object143963:head# 2024-04-01T19:28:50.545 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.545 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bcc34a5:::benchmark_data_smithi188_77607_object109612:head# 2024-04-01T19:28:50.546 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.546 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bcc4149:::benchmark_data_smithi188_77607_object151005:head# 2024-04-01T19:28:50.546 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.546 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bcc80be:::benchmark_data_smithi188_77607_object106205:head# 2024-04-01T19:28:50.546 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.546 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bcd0e15:::benchmark_data_smithi188_77607_object124874:head# 2024-04-01T19:28:50.546 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.546 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bcd9fd3:::benchmark_data_smithi188_77607_object159355:head# 2024-04-01T19:28:50.546 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.546 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bd0af9f:::benchmark_data_smithi188_77607_object160349:head# 2024-04-01T19:28:50.546 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.546 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bd3bc1d:::benchmark_data_smithi188_77607_object121956:head# 2024-04-01T19:28:50.546 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.547 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bd54a95:::benchmark_data_smithi188_77607_object158584:head# 2024-04-01T19:28:50.547 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.547 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bd5a868:::benchmark_data_smithi188_77607_object159118:head# 2024-04-01T19:28:50.547 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.547 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bd5cc22:::benchmark_data_smithi188_77607_object105025:head# 2024-04-01T19:28:50.547 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.547 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bd5dcbb:::benchmark_data_smithi188_77607_object142255:head# 2024-04-01T19:28:50.547 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.547 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bd62a1e:::benchmark_data_smithi188_77607_object126955:head# 2024-04-01T19:28:50.547 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.547 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bd6dca5:::benchmark_data_smithi188_77607_object129390:head# 2024-04-01T19:28:50.547 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.547 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bd73e97:::benchmark_data_smithi188_77607_object108743:head# 2024-04-01T19:28:50.547 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.547 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bd7655c:::benchmark_data_smithi188_77607_object155517:head# 2024-04-01T19:28:50.548 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.548 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bd76e2f:::benchmark_data_smithi188_77607_object157643:head# 2024-04-01T19:28:50.548 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.548 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bd78f18:::benchmark_data_smithi188_77607_object136748:head# 2024-04-01T19:28:50.548 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.548 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bd7d433:::benchmark_data_smithi188_77607_object131118:head# 2024-04-01T19:28:50.548 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.548 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bd82a43:::benchmark_data_smithi188_77607_object163094:head# 2024-04-01T19:28:50.548 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.548 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bd89d36:::benchmark_data_smithi188_77607_object140750:head# 2024-04-01T19:28:50.548 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.548 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bdcfa6d:::benchmark_data_smithi188_77607_object98211:head# 2024-04-01T19:28:50.548 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.548 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bddcf2f:::benchmark_data_smithi188_77607_object157603:head# 2024-04-01T19:28:50.549 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.549 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bde0994:::benchmark_data_smithi188_77607_object122415:head# 2024-04-01T19:28:50.549 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.549 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bde61b9:::benchmark_data_smithi188_77607_object126331:head# 2024-04-01T19:28:50.549 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.549 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bde8d5d:::benchmark_data_smithi188_77607_object98912:head# 2024-04-01T19:28:50.549 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.549 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bded4ea:::benchmark_data_smithi188_77607_object142164:head# 2024-04-01T19:28:50.549 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.549 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bdf6a83:::benchmark_data_smithi188_77607_object150804:head# 2024-04-01T19:28:50.549 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.549 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6be070fd:::benchmark_data_smithi188_77607_object160803:head# 2024-04-01T19:28:50.549 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.549 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6be0ccf3:::benchmark_data_smithi188_77607_object98520:head# 2024-04-01T19:28:50.550 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.550 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6be1c546:::benchmark_data_smithi188_77607_object160623:head# 2024-04-01T19:28:50.550 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.550 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6be34ee5:::benchmark_data_smithi188_77607_object152213:head# 2024-04-01T19:28:50.550 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.550 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6be450b6:::benchmark_data_smithi188_77607_object163819:head# 2024-04-01T19:28:50.550 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.550 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6be4ce78:::benchmark_data_smithi188_77607_object101605:head# 2024-04-01T19:28:50.550 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.550 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6be695a4:::benchmark_data_smithi188_77607_object115685:head# 2024-04-01T19:28:50.550 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.550 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6be737e2:::benchmark_data_smithi188_77607_object97963:head# 2024-04-01T19:28:50.550 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.551 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6be86046:::benchmark_data_smithi188_77607_object144275:head# 2024-04-01T19:28:50.551 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.551 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6be90f76:::benchmark_data_smithi188_77607_object142304:head# 2024-04-01T19:28:50.551 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.551 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6be93198:::benchmark_data_smithi188_77607_object116864:head# 2024-04-01T19:28:50.551 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.551 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6beb3d47:::benchmark_data_smithi188_77607_object161292:head# 2024-04-01T19:28:50.551 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.551 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bee9dee:::benchmark_data_smithi188_77607_object137435:head# 2024-04-01T19:28:50.551 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.551 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6befa437:::benchmark_data_smithi188_77607_object107622:head# 2024-04-01T19:28:50.551 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.551 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bf0f180:::benchmark_data_smithi188_77607_object98054:head# 2024-04-01T19:28:50.551 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.551 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bf0f528:::benchmark_data_smithi188_77607_object163931:head# 2024-04-01T19:28:50.552 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.552 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bf163a5:::benchmark_data_smithi188_77607_object152735:head# 2024-04-01T19:28:50.552 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.552 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bf26990:::benchmark_data_smithi188_77607_object124130:head# 2024-04-01T19:28:50.552 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.552 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bf324d4:::benchmark_data_smithi188_77607_object154998:head# 2024-04-01T19:28:50.552 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.552 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bf33808:::benchmark_data_smithi188_77607_object143550:head# 2024-04-01T19:28:50.552 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.552 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bf45c72:::benchmark_data_smithi188_77607_object154392:head# 2024-04-01T19:28:50.552 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.552 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bf496f7:::benchmark_data_smithi188_77607_object136687:head# 2024-04-01T19:28:50.552 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.552 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bf49c05:::benchmark_data_smithi188_77607_object126078:head# 2024-04-01T19:28:50.553 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.553 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bf4d116:::benchmark_data_smithi188_77607_object99690:head# 2024-04-01T19:28:50.553 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.553 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bf53b76:::benchmark_data_smithi188_77607_object132782:head# 2024-04-01T19:28:50.553 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.553 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bf5e822:::benchmark_data_smithi188_77607_object118810:head# 2024-04-01T19:28:50.553 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.553 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bf67cac:::benchmark_data_smithi188_77607_object148673:head# 2024-04-01T19:28:50.553 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.553 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bf6c540:::benchmark_data_smithi188_77607_object140955:head# 2024-04-01T19:28:50.553 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.553 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bf961f5:::benchmark_data_smithi188_77607_object117852:head# 2024-04-01T19:28:50.553 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.554 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bfaaf76:::benchmark_data_smithi188_77607_object121421:head# 2024-04-01T19:28:50.554 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.554 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bfb62c4:::benchmark_data_smithi188_77607_object138416:head# 2024-04-01T19:28:50.554 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.554 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bff93d4:::benchmark_data_smithi188_77607_object162132:head# 2024-04-01T19:28:50.554 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.554 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6bffc12f:::benchmark_data_smithi188_77607_object156780:head# 2024-04-01T19:28:50.554 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.554 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c01c04b:::benchmark_data_smithi188_77607_object136998:head# 2024-04-01T19:28:50.554 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.567 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c023e35:::benchmark_data_smithi188_77607_object105145:head# 2024-04-01T19:28:50.567 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.567 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c0624de:::benchmark_data_smithi188_77607_object137052:head# 2024-04-01T19:28:50.567 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.567 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c07eade:::benchmark_data_smithi188_77607_object140260:head# 2024-04-01T19:28:50.567 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.568 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c082c06:::benchmark_data_smithi188_77607_object100358:head# 2024-04-01T19:28:50.568 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.568 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c088f93:::benchmark_data_smithi188_77607_object152176:head# 2024-04-01T19:28:50.568 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.568 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c089a34:::benchmark_data_smithi188_77607_object116007:head# 2024-04-01T19:28:50.568 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.568 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c0b2b10:::benchmark_data_smithi188_77607_object104401:head# 2024-04-01T19:28:50.568 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.568 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c0bef55:::benchmark_data_smithi188_77607_object152005:head# 2024-04-01T19:28:50.568 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.568 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c0cdadb:::benchmark_data_smithi188_77607_object149118:head# 2024-04-01T19:28:50.568 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.568 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c0e02f6:::benchmark_data_smithi188_77607_object118194:head# 2024-04-01T19:28:50.569 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.569 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c0e81ce:::benchmark_data_smithi188_77607_object99219:head# 2024-04-01T19:28:50.569 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.569 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c10b28c:::benchmark_data_smithi188_77607_object119826:head# 2024-04-01T19:28:50.569 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.569 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c112b65:::benchmark_data_smithi188_77607_object157145:head# 2024-04-01T19:28:50.569 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.569 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c118b28:::benchmark_data_smithi188_77607_object127235:head# 2024-04-01T19:28:50.569 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.569 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c124ed2:::benchmark_data_smithi188_77607_object122099:head# 2024-04-01T19:28:50.569 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.569 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c14af98:::benchmark_data_smithi188_77607_object135146:head# 2024-04-01T19:28:50.569 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.569 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c17b4bb:::benchmark_data_smithi188_77607_object153116:head# 2024-04-01T19:28:50.570 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.570 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c18ab58:::benchmark_data_smithi188_77607_object142296:head# 2024-04-01T19:28:50.570 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.570 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c19d4e6:::benchmark_data_smithi188_77607_object117563:head# 2024-04-01T19:28:50.570 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.570 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c1a11a2:::benchmark_data_smithi188_77607_object117831:head# 2024-04-01T19:28:50.570 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.570 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c1a24a3:::benchmark_data_smithi188_77607_object127578:head# 2024-04-01T19:28:50.570 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.570 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c1ac11c:::benchmark_data_smithi188_77607_object122715:head# 2024-04-01T19:28:50.570 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.570 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c1b4f20:::benchmark_data_smithi188_77607_object117880:head# 2024-04-01T19:28:50.570 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.571 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c1bcc63:::benchmark_data_smithi188_77607_object107338:head# 2024-04-01T19:28:50.571 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.571 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c1bf309:::benchmark_data_smithi188_77607_object133713:head# 2024-04-01T19:28:50.571 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.571 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c1c2532:::benchmark_data_smithi188_77607_object136985:head# 2024-04-01T19:28:50.571 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.571 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c1c5089:::benchmark_data_smithi188_77607_object145422:head# 2024-04-01T19:28:50.571 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.571 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c1f9017:::benchmark_data_smithi188_77607_object162415:head# 2024-04-01T19:28:50.571 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.571 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c1ff6c0:::benchmark_data_smithi188_77607_object107874:head# 2024-04-01T19:28:50.571 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.572 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c20a66e:::benchmark_data_smithi188_77607_object102259:head# 2024-04-01T19:28:50.572 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.572 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c21a583:::benchmark_data_smithi188_77607_object122255:head# 2024-04-01T19:28:50.572 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.572 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c2227c6:::benchmark_data_smithi188_77607_object138655:head# 2024-04-01T19:28:50.572 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.572 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c238683:::benchmark_data_smithi188_77607_object115583:head# 2024-04-01T19:28:50.572 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.572 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c243d97:::benchmark_data_smithi188_77607_object118277:head# 2024-04-01T19:28:50.572 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.572 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c24640e:::benchmark_data_smithi188_77607_object114455:head# 2024-04-01T19:28:50.572 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.572 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c25bdf7:::benchmark_data_smithi188_77607_object144740:head# 2024-04-01T19:28:50.572 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.573 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c26782b:::benchmark_data_smithi188_77607_object120092:head# 2024-04-01T19:28:50.573 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.573 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c26ec9a:::benchmark_data_smithi188_77607_object111502:head# 2024-04-01T19:28:50.573 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.573 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c27d58e:::benchmark_data_smithi188_77607_object134133:head# 2024-04-01T19:28:50.573 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.573 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c29ccb3:::benchmark_data_smithi188_77607_object130213:head# 2024-04-01T19:28:50.573 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.573 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c29f2aa:::benchmark_data_smithi188_77607_object106161:head# 2024-04-01T19:28:50.573 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.573 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c2afb16:::benchmark_data_smithi188_77607_object154577:head# 2024-04-01T19:28:50.573 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.573 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c2b3ccf:::benchmark_data_smithi188_77607_object157346:head# 2024-04-01T19:28:50.574 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.574 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c2c5ded:::benchmark_data_smithi188_77607_object135503:head# 2024-04-01T19:28:50.574 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.574 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c2d1972:::benchmark_data_smithi188_77607_object154420:head# 2024-04-01T19:28:50.574 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.574 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c2d1a62:::benchmark_data_smithi188_77607_object116146:head# 2024-04-01T19:28:50.574 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.574 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c2de9cc:::benchmark_data_smithi188_77607_object130022:head# 2024-04-01T19:28:50.574 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.574 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c2e5f0c:::benchmark_data_smithi188_77607_object128306:head# 2024-04-01T19:28:50.574 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.574 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c2e706c:::benchmark_data_smithi188_77607_object136999:head# 2024-04-01T19:28:50.574 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.575 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c2eaa2a:::benchmark_data_smithi188_77607_object155486:head# 2024-04-01T19:28:50.575 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.575 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c2f766d:::benchmark_data_smithi188_77607_object134443:head# 2024-04-01T19:28:50.575 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.575 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c2fcacf:::benchmark_data_smithi188_77607_object122575:head# 2024-04-01T19:28:50.575 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.575 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c2fef54:::benchmark_data_smithi188_77607_object105817:head# 2024-04-01T19:28:50.575 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.575 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c307b0a:::benchmark_data_smithi188_77607_object104868:head# 2024-04-01T19:28:50.575 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.575 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c30c2f4:::benchmark_data_smithi188_77607_object121387:head# 2024-04-01T19:28:50.575 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.575 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c31f075:::benchmark_data_smithi188_77607_object161023:head# 2024-04-01T19:28:50.576 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.576 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c3272fa:::benchmark_data_smithi188_77607_object136195:head# 2024-04-01T19:28:50.576 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.576 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c32aff1:::benchmark_data_smithi188_77607_object131307:head# 2024-04-01T19:28:50.576 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.576 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c339cec:::benchmark_data_smithi188_77607_object119360:head# 2024-04-01T19:28:50.576 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.576 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c33c38d:::benchmark_data_smithi188_77607_object165972:head# 2024-04-01T19:28:50.576 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.576 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c363710:::benchmark_data_smithi188_77607_object107295:head# 2024-04-01T19:28:50.576 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.576 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c367fae:::benchmark_data_smithi188_77607_object145587:head# 2024-04-01T19:28:50.576 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.577 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c368523:::benchmark_data_smithi188_77607_object145087:head# 2024-04-01T19:28:50.577 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.577 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c374ec4:::benchmark_data_smithi188_77607_object148171:head# 2024-04-01T19:28:50.577 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.577 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c37dc29:::benchmark_data_smithi188_77607_object134966:head# 2024-04-01T19:28:50.577 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.577 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c389ea3:::benchmark_data_smithi188_77607_object135820:head# 2024-04-01T19:28:50.577 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.577 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c39990e:::benchmark_data_smithi188_77607_object144814:head# 2024-04-01T19:28:50.577 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.577 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c3aee62:::benchmark_data_smithi188_77607_object151254:head# 2024-04-01T19:28:50.577 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.577 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c3c1345:::benchmark_data_smithi188_77607_object110972:head# 2024-04-01T19:28:50.578 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.578 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c3c1cc4:::benchmark_data_smithi188_77607_object160938:head# 2024-04-01T19:28:50.578 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.578 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c3c5b63:::benchmark_data_smithi188_77607_object148858:head# 2024-04-01T19:28:50.578 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.578 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c3cb3e6:::benchmark_data_smithi188_77607_object153988:head# 2024-04-01T19:28:50.578 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.578 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c3d4219:::benchmark_data_smithi188_77607_object114484:head# 2024-04-01T19:28:50.578 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.578 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c3dbf8e:::benchmark_data_smithi188_77607_object134602:head# 2024-04-01T19:28:50.578 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.578 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c3e92dd:::benchmark_data_smithi188_77607_object116044:head# 2024-04-01T19:28:50.578 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.579 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c3f2067:::benchmark_data_smithi188_77607_object143055:head# 2024-04-01T19:28:50.579 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.579 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c418323:::benchmark_data_smithi188_77607_object134178:head# 2024-04-01T19:28:50.579 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.579 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c423493:::benchmark_data_smithi188_77607_object107753:head# 2024-04-01T19:28:50.579 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.579 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c426052:::benchmark_data_smithi188_77607_object140383:head# 2024-04-01T19:28:50.579 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.579 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c43ddf1:::benchmark_data_smithi188_77607_object143020:head# 2024-04-01T19:28:50.579 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.579 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c43e345:::benchmark_data_smithi188_77607_object153174:head# 2024-04-01T19:28:50.579 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.579 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c4415aa:::benchmark_data_smithi188_77607_object101293:head# 2024-04-01T19:28:50.579 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.580 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c4467cc:::benchmark_data_smithi188_77607_object104841:head# 2024-04-01T19:28:50.580 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.580 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c44c403:::benchmark_data_smithi188_77607_object98497:head# 2024-04-01T19:28:50.580 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.580 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c4770bb:::benchmark_data_smithi188_77607_object164045:head# 2024-04-01T19:28:50.580 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.580 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c47b60d:::benchmark_data_smithi188_77607_object106502:head# 2024-04-01T19:28:50.580 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.580 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c487533:::benchmark_data_smithi188_77607_object126222:head# 2024-04-01T19:28:50.580 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.580 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c49219c:::benchmark_data_smithi188_77607_object130181:head# 2024-04-01T19:28:50.580 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.580 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c499167:::benchmark_data_smithi188_77607_object125398:head# 2024-04-01T19:28:50.580 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.580 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c49c9a5:::benchmark_data_smithi188_77607_object117377:head# 2024-04-01T19:28:50.581 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.581 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c4a5f99:::benchmark_data_smithi188_77607_object101294:head# 2024-04-01T19:28:50.581 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.581 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c4a61f3:::benchmark_data_smithi188_77607_object109164:head# 2024-04-01T19:28:50.581 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.581 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c4a7c75:::benchmark_data_smithi188_77607_object150720:head# 2024-04-01T19:28:50.581 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.581 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c4b3935:::benchmark_data_smithi188_77607_object126683:head# 2024-04-01T19:28:50.581 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.581 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c4c9e49:::benchmark_data_smithi188_77607_object125550:head# 2024-04-01T19:28:50.581 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.581 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c4e1b1b:::benchmark_data_smithi188_77607_object154144:head# 2024-04-01T19:28:50.581 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.581 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c4eea11:::benchmark_data_smithi188_77607_object151194:head# 2024-04-01T19:28:50.582 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.582 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c50d2db:::benchmark_data_smithi188_77607_object125616:head# 2024-04-01T19:28:50.582 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.582 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c514c6b:::benchmark_data_smithi188_77607_object145166:head# 2024-04-01T19:28:50.582 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.582 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c51ed0d:::benchmark_data_smithi188_77607_object148529:head# 2024-04-01T19:28:50.582 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.582 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c5250f5:::benchmark_data_smithi188_77607_object106706:head# 2024-04-01T19:28:50.582 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.582 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c530ef2:::benchmark_data_smithi188_77607_object104573:head# 2024-04-01T19:28:50.582 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.582 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c539f94:::benchmark_data_smithi188_77607_object114994:head# 2024-04-01T19:28:50.582 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.583 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c559834:::benchmark_data_smithi188_77607_object101470:head# 2024-04-01T19:28:50.583 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.583 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c575fb2:::benchmark_data_smithi188_77607_object113995:head# 2024-04-01T19:28:50.583 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.583 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c57e087:::benchmark_data_smithi188_77607_object99092:head# 2024-04-01T19:28:50.583 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.589 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c57f6ab:::benchmark_data_smithi188_77607_object104405:head# 2024-04-01T19:28:50.589 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.590 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c58dc81:::benchmark_data_smithi188_77607_object108951:head# 2024-04-01T19:28:50.590 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.590 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c593b1a:::benchmark_data_smithi188_77607_object99142:head# 2024-04-01T19:28:50.590 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.590 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c5a7251:::benchmark_data_smithi188_77607_object131312:head# 2024-04-01T19:28:50.590 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.590 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c5caaaa:::benchmark_data_smithi188_77607_object107935:head# 2024-04-01T19:28:50.590 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.590 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c5d6e1c:::benchmark_data_smithi188_77607_object131001:head# 2024-04-01T19:28:50.590 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.590 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c5ea360:::benchmark_data_smithi188_77607_object123190:head# 2024-04-01T19:28:50.590 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.590 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c5f0c2d:::benchmark_data_smithi188_77607_object117767:head# 2024-04-01T19:28:50.591 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.591 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c5fd3df:::benchmark_data_smithi188_77607_object107296:head# 2024-04-01T19:28:50.591 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.591 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c5fe1de:::benchmark_data_smithi188_77607_object163787:head# 2024-04-01T19:28:50.591 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.591 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c629682:::benchmark_data_smithi188_77607_object128225:head# 2024-04-01T19:28:50.591 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.591 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c62cac5:::benchmark_data_smithi188_77607_object112431:head# 2024-04-01T19:28:50.591 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.591 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c64011c:::benchmark_data_smithi188_77607_object123936:head# 2024-04-01T19:28:50.591 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.591 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c64078c:::benchmark_data_smithi188_77607_object153762:head# 2024-04-01T19:28:50.591 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.591 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c64eee0:::benchmark_data_smithi188_77607_object122356:head# 2024-04-01T19:28:50.592 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.592 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c64fa3b:::benchmark_data_smithi188_77607_object110911:head# 2024-04-01T19:28:50.593 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.593 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c66515b:::benchmark_data_smithi188_77607_object128604:head# 2024-04-01T19:28:50.593 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.593 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c67aa97:::benchmark_data_smithi188_77607_object159901:head# 2024-04-01T19:28:50.593 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.593 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c68472a:::benchmark_data_smithi188_77607_object138978:head# 2024-04-01T19:28:50.593 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.594 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c6a0980:::benchmark_data_smithi188_77607_object128808:head# 2024-04-01T19:28:50.594 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.594 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c6a7e75:::benchmark_data_smithi188_77607_object119929:head# 2024-04-01T19:28:50.594 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.594 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c6ab7fd:::benchmark_data_smithi188_77607_object124596:head# 2024-04-01T19:28:50.594 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.594 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c6db9e6:::benchmark_data_smithi188_77607_object103286:head# 2024-04-01T19:28:50.594 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.594 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c6dcc49:::benchmark_data_smithi188_77607_object130539:head# 2024-04-01T19:28:50.594 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.594 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c6e9f92:::benchmark_data_smithi188_77607_object119626:head# 2024-04-01T19:28:50.594 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.594 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c6f21df:::benchmark_data_smithi188_77607_object139054:head# 2024-04-01T19:28:50.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c6fb2e0:::benchmark_data_smithi188_77607_object108114:head# 2024-04-01T19:28:50.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c71e578:::benchmark_data_smithi188_77607_object124052:head# 2024-04-01T19:28:50.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c725a2a:::benchmark_data_smithi188_77607_object163053:head# 2024-04-01T19:28:50.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c73890c:::benchmark_data_smithi188_77607_object108718:head# 2024-04-01T19:28:50.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c73f836:::benchmark_data_smithi188_77607_object150200:head# 2024-04-01T19:28:50.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c7455ce:::benchmark_data_smithi188_77607_object101360:head# 2024-04-01T19:28:50.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c7603dc:::benchmark_data_smithi188_77607_object147654:head# 2024-04-01T19:28:50.596 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.596 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c76994b:::benchmark_data_smithi188_77607_object129555:head# 2024-04-01T19:28:50.596 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.596 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c76ca98:::benchmark_data_smithi188_77607_object148567:head# 2024-04-01T19:28:50.596 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.596 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c779a44:::benchmark_data_smithi188_77607_object151898:head# 2024-04-01T19:28:50.596 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.596 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c782aed:::benchmark_data_smithi188_77607_object153671:head# 2024-04-01T19:28:50.596 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.596 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c784d85:::benchmark_data_smithi188_77607_object118469:head# 2024-04-01T19:28:50.596 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.596 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c7918d0:::benchmark_data_smithi188_77607_object143898:head# 2024-04-01T19:28:50.596 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.596 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c792526:::benchmark_data_smithi188_77607_object120835:head# 2024-04-01T19:28:50.596 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.597 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c795bee:::benchmark_data_smithi188_77607_object119729:head# 2024-04-01T19:28:50.597 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.597 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c7a9ae7:::benchmark_data_smithi188_77607_object142668:head# 2024-04-01T19:28:50.597 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.597 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c7aaef0:::benchmark_data_smithi188_77607_object143912:head# 2024-04-01T19:28:50.597 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.597 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c7ac726:::benchmark_data_smithi188_77607_object114112:head# 2024-04-01T19:28:50.597 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.597 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c7cb790:::benchmark_data_smithi188_77607_object99592:head# 2024-04-01T19:28:50.597 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.597 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c7d05f8:::benchmark_data_smithi188_77607_object125520:head# 2024-04-01T19:28:50.597 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.597 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c7e71ae:::benchmark_data_smithi188_77607_object153198:head# 2024-04-01T19:28:50.597 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.598 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c7f329d:::benchmark_data_smithi188_77607_object112133:head# 2024-04-01T19:28:50.598 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.598 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c7feec9:::benchmark_data_smithi188_77607_object139995:head# 2024-04-01T19:28:50.598 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.606 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c816593:::benchmark_data_smithi188_77607_object126492:head# 2024-04-01T19:28:50.606 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.606 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c818cf7:::benchmark_data_smithi188_77607_object144760:head# 2024-04-01T19:28:50.607 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.607 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c81ec67:::benchmark_data_smithi188_77607_object127008:head# 2024-04-01T19:28:50.607 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.607 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c82cda9:::benchmark_data_smithi188_77607_object120954:head# 2024-04-01T19:28:50.607 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.607 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c830507:::benchmark_data_smithi188_77607_object151212:head# 2024-04-01T19:28:50.607 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.607 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c83340b:::benchmark_data_smithi188_77607_object142603:head# 2024-04-01T19:28:50.607 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.607 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c856134:::benchmark_data_smithi188_77607_object99985:head# 2024-04-01T19:28:50.607 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.607 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c85623b:::benchmark_data_smithi188_77607_object116895:head# 2024-04-01T19:28:50.608 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.608 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c860f30:::benchmark_data_smithi188_77607_object111306:head# 2024-04-01T19:28:50.608 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.608 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c878182:::benchmark_data_smithi188_77607_object136569:head# 2024-04-01T19:28:50.608 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.608 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c8857cc:::benchmark_data_smithi188_77607_object111948:head# 2024-04-01T19:28:50.608 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.608 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c89f8e7:::benchmark_data_smithi188_77607_object164258:head# 2024-04-01T19:28:50.608 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.608 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c8a74f9:::benchmark_data_smithi188_77607_object135864:head# 2024-04-01T19:28:50.608 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.608 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c8bede7:::benchmark_data_smithi188_77607_object158851:head# 2024-04-01T19:28:50.608 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.609 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c8d100c:::benchmark_data_smithi188_77607_object143249:head# 2024-04-01T19:28:50.609 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.609 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c8d174c:::benchmark_data_smithi188_77607_object98301:head# 2024-04-01T19:28:50.609 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.609 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c8dbc46:::benchmark_data_smithi188_77607_object145231:head# 2024-04-01T19:28:50.609 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.609 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c8df2e5:::benchmark_data_smithi188_77607_object135605:head# 2024-04-01T19:28:50.609 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.609 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c8f5fd5:::benchmark_data_smithi188_77607_object110372:head# 2024-04-01T19:28:50.609 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.609 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c8ff58c:::benchmark_data_smithi188_77607_object163504:head# 2024-04-01T19:28:50.609 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.609 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c91d189:::benchmark_data_smithi188_77607_object99793:head# 2024-04-01T19:28:50.610 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.610 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c939678:::benchmark_data_smithi188_77607_object157357:head# 2024-04-01T19:28:50.610 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.610 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c945469:::benchmark_data_smithi188_77607_object147854:head# 2024-04-01T19:28:50.610 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.610 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c947a6c:::benchmark_data_smithi188_77607_object143914:head# 2024-04-01T19:28:50.610 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.610 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c948e81:::benchmark_data_smithi188_77607_object111257:head# 2024-04-01T19:28:50.610 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.610 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c957dbd:::benchmark_data_smithi188_77607_object143943:head# 2024-04-01T19:28:50.610 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.610 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c95c017:::benchmark_data_smithi188_77607_object136265:head# 2024-04-01T19:28:50.610 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.611 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c95d47e:::benchmark_data_smithi188_77607_object157067:head# 2024-04-01T19:28:50.611 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.611 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c9845b9:::benchmark_data_smithi188_77607_object117407:head# 2024-04-01T19:28:50.611 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.611 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c992ae3:::benchmark_data_smithi188_77607_object121566:head# 2024-04-01T19:28:50.611 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.611 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c9b6ed2:::benchmark_data_smithi188_77607_object158840:head# 2024-04-01T19:28:50.611 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.611 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c9bef5a:::benchmark_data_smithi188_77607_object105197:head# 2024-04-01T19:28:50.611 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.611 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c9c8c54:::benchmark_data_smithi188_77607_object159064:head# 2024-04-01T19:28:50.611 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.611 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c9cae26:::benchmark_data_smithi188_77607_object154340:head# 2024-04-01T19:28:50.612 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.612 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6c9d2ba7:::benchmark_data_smithi188_77607_object124385:head# 2024-04-01T19:28:50.612 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.612 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ca1099c:::benchmark_data_smithi188_77607_object108272:head# 2024-04-01T19:28:50.612 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.612 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ca1d668:::benchmark_data_smithi188_77607_object114998:head# 2024-04-01T19:28:50.612 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.612 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ca3039a:::benchmark_data_smithi188_77607_object135469:head# 2024-04-01T19:28:50.612 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.612 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ca3663d:::benchmark_data_smithi188_77607_object118778:head# 2024-04-01T19:28:50.612 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.612 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ca3c6ff:::benchmark_data_smithi188_77607_object117869:head# 2024-04-01T19:28:50.612 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.612 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ca4d101:::benchmark_data_smithi188_77607_object155690:head# 2024-04-01T19:28:50.613 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.613 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ca58245:::benchmark_data_smithi188_77607_object117154:head# 2024-04-01T19:28:50.613 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.613 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ca63f8e:::benchmark_data_smithi188_77607_object151645:head# 2024-04-01T19:28:50.613 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.613 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ca6761e:::benchmark_data_smithi188_77607_object140128:head# 2024-04-01T19:28:50.613 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.613 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ca7592c:::benchmark_data_smithi188_77607_object113716:head# 2024-04-01T19:28:50.613 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.613 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ca78c61:::benchmark_data_smithi188_77607_object132288:head# 2024-04-01T19:28:50.613 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.613 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6caa021c:::benchmark_data_smithi188_77607_object159196:head# 2024-04-01T19:28:50.613 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.613 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6caa2468:::benchmark_data_smithi188_77607_object133443:head# 2024-04-01T19:28:50.614 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.614 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6caab2b3:::benchmark_data_smithi188_77607_object101540:head# 2024-04-01T19:28:50.614 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.614 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cab03ae:::benchmark_data_smithi188_77607_object152931:head# 2024-04-01T19:28:50.614 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.614 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cac288c:::benchmark_data_smithi188_77607_object163772:head# 2024-04-01T19:28:50.614 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.614 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cac9994:::benchmark_data_smithi188_77607_object159069:head# 2024-04-01T19:28:50.614 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.614 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6caea792:::benchmark_data_smithi188_77607_object167109:head# 2024-04-01T19:28:50.614 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.614 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cb05eb6:::benchmark_data_smithi188_77607_object114752:head# 2024-04-01T19:28:50.614 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.615 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cb2efd8:::benchmark_data_smithi188_77607_object123605:head# 2024-04-01T19:28:50.615 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.615 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cb41a18:::benchmark_data_smithi188_77607_object103026:head# 2024-04-01T19:28:50.615 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.615 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cb8f3e8:::benchmark_data_smithi188_77607_object156913:head# 2024-04-01T19:28:50.615 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.615 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cb9d6df:::benchmark_data_smithi188_77607_object159821:head# 2024-04-01T19:28:50.615 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.615 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cba16af:::benchmark_data_smithi188_77607_object154843:head# 2024-04-01T19:28:50.615 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.615 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cba5620:::benchmark_data_smithi188_77607_object155670:head# 2024-04-01T19:28:50.615 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.615 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cbd942b:::benchmark_data_smithi188_77607_object133614:head# 2024-04-01T19:28:50.615 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.616 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cbe3c57:::benchmark_data_smithi188_77607_object107453:head# 2024-04-01T19:28:50.616 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.616 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cbe98e4:::benchmark_data_smithi188_77607_object161643:head# 2024-04-01T19:28:50.616 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.616 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cbfa49a:::benchmark_data_smithi188_77607_object122870:head# 2024-04-01T19:28:50.616 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.616 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cbfe10f:::benchmark_data_smithi188_77607_object135253:head# 2024-04-01T19:28:50.616 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.616 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cbfe7a5:::benchmark_data_smithi188_77607_object153356:head# 2024-04-01T19:28:50.616 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.616 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cc0cd41:::benchmark_data_smithi188_77607_object147089:head# 2024-04-01T19:28:50.616 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.616 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cc11913:::benchmark_data_smithi188_77607_object164047:head# 2024-04-01T19:28:50.616 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.617 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cc20e66:::benchmark_data_smithi188_77607_object115759:head# 2024-04-01T19:28:50.617 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.617 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cc25b68:::benchmark_data_smithi188_77607_object127675:head# 2024-04-01T19:28:50.617 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.617 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cc33c39:::benchmark_data_smithi188_77607_object158848:head# 2024-04-01T19:28:50.617 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.617 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cc3e841:::benchmark_data_smithi188_77607_object138918:head# 2024-04-01T19:28:50.617 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.626 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cc3eb00:::benchmark_data_smithi188_77607_object121870:head# 2024-04-01T19:28:50.626 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.626 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cc403d4:::benchmark_data_smithi188_77607_object133090:head# 2024-04-01T19:28:50.626 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.626 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cc4290c:::benchmark_data_smithi188_77607_object159365:head# 2024-04-01T19:28:50.626 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.626 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cc492bb:::benchmark_data_smithi188_77607_object131682:head# 2024-04-01T19:28:50.626 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.626 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cc5e345:::benchmark_data_smithi188_77607_object137055:head# 2024-04-01T19:28:50.626 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.626 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cc984d8:::benchmark_data_smithi188_77607_object115362:head# 2024-04-01T19:28:50.626 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.626 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ccadb79:::benchmark_data_smithi188_77607_object141665:head# 2024-04-01T19:28:50.627 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.627 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ccba319:::benchmark_data_smithi188_77607_object138366:head# 2024-04-01T19:28:50.627 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.627 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ccc0563:::benchmark_data_smithi188_77607_object148572:head# 2024-04-01T19:28:50.627 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.627 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ccc0863:::benchmark_data_smithi188_77607_object121868:head# 2024-04-01T19:28:50.627 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.627 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ccce2ef:::benchmark_data_smithi188_77607_object132815:head# 2024-04-01T19:28:50.627 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.627 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ccdf8cd:::benchmark_data_smithi188_77607_object100072:head# 2024-04-01T19:28:50.627 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.627 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ccdfc1d:::benchmark_data_smithi188_77607_object112014:head# 2024-04-01T19:28:50.627 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.627 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cce29d2:::benchmark_data_smithi188_77607_object139515:head# 2024-04-01T19:28:50.627 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.628 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ccefb31:::benchmark_data_smithi188_77607_object161909:head# 2024-04-01T19:28:50.628 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.628 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ccf9c29:::benchmark_data_smithi188_77607_object147363:head# 2024-04-01T19:28:50.628 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.628 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ccfe3ab:::benchmark_data_smithi188_77607_object143352:head# 2024-04-01T19:28:50.628 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.628 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cd1da93:::benchmark_data_smithi188_77607_object139066:head# 2024-04-01T19:28:50.628 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.628 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cd39238:::benchmark_data_smithi188_77607_object139777:head# 2024-04-01T19:28:50.628 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.628 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cd3e346:::benchmark_data_smithi188_77607_object146265:head# 2024-04-01T19:28:50.628 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.628 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cd405b2:::benchmark_data_smithi188_77607_object103419:head# 2024-04-01T19:28:50.628 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.629 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cd458d8:::benchmark_data_smithi188_77607_object116848:head# 2024-04-01T19:28:50.629 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.629 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cd4cc8c:::benchmark_data_smithi188_77607_object143162:head# 2024-04-01T19:28:50.629 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.629 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cd63bbd:::benchmark_data_smithi188_77607_object156319:head# 2024-04-01T19:28:50.629 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.629 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cd6906e:::benchmark_data_smithi188_77607_object98724:head# 2024-04-01T19:28:50.629 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.629 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cd718bd:::benchmark_data_smithi188_77607_object136369:head# 2024-04-01T19:28:50.629 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.629 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cd85b78:::benchmark_data_smithi188_77607_object106649:head# 2024-04-01T19:28:50.629 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.629 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cd98f9f:::benchmark_data_smithi188_77607_object119925:head# 2024-04-01T19:28:50.630 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.630 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cda1b46:::benchmark_data_smithi188_77607_object134324:head# 2024-04-01T19:28:50.630 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.630 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cdd4301:::benchmark_data_smithi188_77607_object126116:head# 2024-04-01T19:28:50.630 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.630 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cdd4621:::benchmark_data_smithi188_77607_object131258:head# 2024-04-01T19:28:50.630 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.630 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cdf205c:::benchmark_data_smithi188_77607_object145931:head# 2024-04-01T19:28:50.630 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.630 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ce08015:::benchmark_data_smithi188_77607_object131529:head# 2024-04-01T19:28:50.630 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.630 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ce1d31b:::benchmark_data_smithi188_77607_object165536:head# 2024-04-01T19:28:50.630 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.630 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ce2dcb7:::benchmark_data_smithi188_77607_object132555:head# 2024-04-01T19:28:50.631 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.631 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ce502a0:::benchmark_data_smithi188_77607_object124285:head# 2024-04-01T19:28:50.631 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.631 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ce527f2:::benchmark_data_smithi188_77607_object107764:head# 2024-04-01T19:28:50.631 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.631 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ce611c4:::benchmark_data_smithi188_77607_object139375:head# 2024-04-01T19:28:50.631 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.631 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ce66658:::benchmark_data_smithi188_77607_object161368:head# 2024-04-01T19:28:50.631 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.631 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ce7333a:::benchmark_data_smithi188_77607_object99817:head# 2024-04-01T19:28:50.631 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.631 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ce930b4:::benchmark_data_smithi188_77607_object112472:head# 2024-04-01T19:28:50.631 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.631 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ce99fbf:::benchmark_data_smithi188_77607_object130380:head# 2024-04-01T19:28:50.631 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.632 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ceb0704:::benchmark_data_smithi188_77607_object99358:head# 2024-04-01T19:28:50.632 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.632 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ceb0b56:::benchmark_data_smithi188_77607_object151456:head# 2024-04-01T19:28:50.632 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.632 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cebd93c:::benchmark_data_smithi188_77607_object134726:head# 2024-04-01T19:28:50.632 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.632 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cecdbf3:::benchmark_data_smithi188_77607_object123261:head# 2024-04-01T19:28:50.632 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.632 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cee5264:::benchmark_data_smithi188_77607_object110011:head# 2024-04-01T19:28:50.632 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.632 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cef0bcb:::benchmark_data_smithi188_77607_object116792:head# 2024-04-01T19:28:50.632 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.632 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cef770e:::benchmark_data_smithi188_77607_object111166:head# 2024-04-01T19:28:50.632 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.632 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ceff88f:::benchmark_data_smithi188_77607_object162673:head# 2024-04-01T19:28:50.633 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.633 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cf0833c:::benchmark_data_smithi188_77607_object143415:head# 2024-04-01T19:28:50.633 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.633 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cf0bf30:::benchmark_data_smithi188_77607_object151688:head# 2024-04-01T19:28:50.633 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.633 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cf1d55b:::benchmark_data_smithi188_77607_object119830:head# 2024-04-01T19:28:50.633 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.633 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cf1de7e:::benchmark_data_smithi188_77607_object97935:head# 2024-04-01T19:28:50.633 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.633 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cf28f7a:::benchmark_data_smithi188_77607_object165471:head# 2024-04-01T19:28:50.633 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.633 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cf31f21:::benchmark_data_smithi188_77607_object122776:head# 2024-04-01T19:28:50.633 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.633 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cf3c9bb:::benchmark_data_smithi188_77607_object154818:head# 2024-04-01T19:28:50.633 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.634 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cf3e4d7:::benchmark_data_smithi188_77607_object106156:head# 2024-04-01T19:28:50.634 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.634 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cf3fc5e:::benchmark_data_smithi188_77607_object136846:head# 2024-04-01T19:28:50.634 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.634 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cf45738:::benchmark_data_smithi188_77607_object160818:head# 2024-04-01T19:28:50.634 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.634 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cf5390e:::benchmark_data_smithi188_77607_object137840:head# 2024-04-01T19:28:50.634 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.634 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cf63c22:::benchmark_data_smithi188_77607_object133853:head# 2024-04-01T19:28:50.634 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.634 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cf7d08b:::benchmark_data_smithi188_77607_object141893:head# 2024-04-01T19:28:50.634 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.634 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cf829dc:::benchmark_data_smithi188_77607_object105613:head# 2024-04-01T19:28:50.634 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.635 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cf8e852:::benchmark_data_smithi188_77607_object145259:head# 2024-04-01T19:28:50.635 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.635 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cf9b77f:::benchmark_data_smithi188_77607_object111274:head# 2024-04-01T19:28:50.635 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.635 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cf9dc41:::benchmark_data_smithi188_77607_object112233:head# 2024-04-01T19:28:50.635 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.635 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cfc204d:::benchmark_data_smithi188_77607_object133013:head# 2024-04-01T19:28:50.635 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.635 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cfc49e2:::benchmark_data_smithi188_77607_object138161:head# 2024-04-01T19:28:50.635 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.635 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cfc8b43:::benchmark_data_smithi188_77607_object140755:head# 2024-04-01T19:28:50.635 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.635 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cfd39bc:::benchmark_data_smithi188_77607_object145249:head# 2024-04-01T19:28:50.635 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.636 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cfe4d88:::benchmark_data_smithi188_77607_object117433:head# 2024-04-01T19:28:50.636 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.636 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cfebf53:::benchmark_data_smithi188_77607_object118139:head# 2024-04-01T19:28:50.636 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.636 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6cfef48e:::benchmark_data_smithi188_77607_object151027:head# 2024-04-01T19:28:50.636 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.637 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d00c089:::benchmark_data_smithi188_77607_object145703:head# 2024-04-01T19:28:50.637 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.637 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d00fa38:::benchmark_data_smithi188_77607_object103911:head# 2024-04-01T19:28:50.637 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.637 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d01c637:::benchmark_data_smithi188_77607_object167044:head# 2024-04-01T19:28:50.637 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.638 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d025e6a:::benchmark_data_smithi188_77607_object127661:head# 2024-04-01T19:28:50.638 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.638 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d02a725:::benchmark_data_smithi188_77607_object104922:head# 2024-04-01T19:28:50.639 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.639 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d02f28d:::benchmark_data_smithi188_77607_object146291:head# 2024-04-01T19:28:50.639 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.643 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d03ace7:::benchmark_data_smithi188_77607_object161191:head# 2024-04-01T19:28:50.643 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.643 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d045125:::benchmark_data_smithi188_77607_object100788:head# 2024-04-01T19:28:50.643 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.643 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d04668a:::benchmark_data_smithi188_77607_object141974:head# 2024-04-01T19:28:50.643 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.643 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d0729ce:::benchmark_data_smithi188_77607_object107280:head# 2024-04-01T19:28:50.643 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.644 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d073782:::benchmark_data_smithi188_77607_object134661:head# 2024-04-01T19:28:50.644 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.644 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d08a5eb:::benchmark_data_smithi188_77607_object112433:head# 2024-04-01T19:28:50.644 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.644 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d0acdad:::benchmark_data_smithi188_77607_object113853:head# 2024-04-01T19:28:50.644 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.644 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d0b400f:::benchmark_data_smithi188_77607_object118740:head# 2024-04-01T19:28:50.644 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.644 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d0c4164:::benchmark_data_smithi188_77607_object142122:head# 2024-04-01T19:28:50.644 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.644 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d0cd7ba:::benchmark_data_smithi188_77607_object160557:head# 2024-04-01T19:28:50.644 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.644 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d0f56ef:::benchmark_data_smithi188_77607_object99816:head# 2024-04-01T19:28:50.644 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.645 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d0f7029:::benchmark_data_smithi188_77607_object154955:head# 2024-04-01T19:28:50.645 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.645 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d0fb9e9:::benchmark_data_smithi188_77607_object136671:head# 2024-04-01T19:28:50.645 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.645 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d0ff2d3:::benchmark_data_smithi188_77607_object162490:head# 2024-04-01T19:28:50.645 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.645 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d109a16:::benchmark_data_smithi188_77607_object103563:head# 2024-04-01T19:28:50.645 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.645 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d113a50:::benchmark_data_smithi188_77607_object165711:head# 2024-04-01T19:28:50.645 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.645 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d126130:::benchmark_data_smithi188_77607_object148072:head# 2024-04-01T19:28:50.645 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.645 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d150feb:::benchmark_data_smithi188_77607_object136743:head# 2024-04-01T19:28:50.645 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.647 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d1536bc:::benchmark_data_smithi188_77607_object124490:head# 2024-04-01T19:28:50.647 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.647 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d15f82d:::benchmark_data_smithi188_77607_object147177:head# 2024-04-01T19:28:50.647 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.647 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d16dfc9:::benchmark_data_smithi188_77607_object121195:head# 2024-04-01T19:28:50.647 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.647 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d18c65f:::benchmark_data_smithi188_77607_object153486:head# 2024-04-01T19:28:50.647 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.647 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d19572d:::benchmark_data_smithi188_77607_object113302:head# 2024-04-01T19:28:50.647 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.647 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d1a5007:::benchmark_data_smithi188_77607_object137464:head# 2024-04-01T19:28:50.647 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.647 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d1ab660:::benchmark_data_smithi188_77607_object137820:head# 2024-04-01T19:28:50.648 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.648 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d1bf18d:::benchmark_data_smithi188_77607_object127232:head# 2024-04-01T19:28:50.648 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.648 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d1d8a70:::benchmark_data_smithi188_77607_object138576:head# 2024-04-01T19:28:50.648 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.649 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d1ed143:::benchmark_data_smithi188_77607_object149548:head# 2024-04-01T19:28:50.649 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.649 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d2044f0:::benchmark_data_smithi188_77607_object112972:head# 2024-04-01T19:28:50.650 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.650 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d242359:::benchmark_data_smithi188_77607_object140864:head# 2024-04-01T19:28:50.650 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.650 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d254f9e:::benchmark_data_smithi188_77607_object162803:head# 2024-04-01T19:28:50.650 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.650 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d2653c4:::benchmark_data_smithi188_77607_object119970:head# 2024-04-01T19:28:50.650 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.650 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d27861a:::benchmark_data_smithi188_77607_object137293:head# 2024-04-01T19:28:50.650 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.650 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d288634:::benchmark_data_smithi188_77607_object124557:head# 2024-04-01T19:28:50.650 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.650 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d28ba58:::benchmark_data_smithi188_77607_object126565:head# 2024-04-01T19:28:50.650 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.650 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d2abf69:::benchmark_data_smithi188_77607_object101418:head# 2024-04-01T19:28:50.651 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.652 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d2b08c6:::benchmark_data_smithi188_77607_object139207:head# 2024-04-01T19:28:50.652 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.652 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d2d41b0:::benchmark_data_smithi188_77607_object153530:head# 2024-04-01T19:28:50.652 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.652 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d2e3ed8:::benchmark_data_smithi188_77607_object156229:head# 2024-04-01T19:28:50.652 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.652 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d2ea7ed:::benchmark_data_smithi188_77607_object132410:head# 2024-04-01T19:28:50.652 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.652 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d2f09f9:::benchmark_data_smithi188_77607_object166287:head# 2024-04-01T19:28:50.652 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.652 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d2f19db:::benchmark_data_smithi188_77607_object151906:head# 2024-04-01T19:28:50.652 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.652 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d312c36:::benchmark_data_smithi188_77607_object143224:head# 2024-04-01T19:28:50.653 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.653 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d31a003:::benchmark_data_smithi188_77607_object164614:head# 2024-04-01T19:28:50.653 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.653 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d3213e3:::benchmark_data_smithi188_77607_object132565:head# 2024-04-01T19:28:50.653 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.654 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d32f14a:::benchmark_data_smithi188_77607_object134811:head# 2024-04-01T19:28:50.654 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.654 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d3329b8:::benchmark_data_smithi188_77607_object166875:head# 2024-04-01T19:28:50.655 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.655 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d33d946:::benchmark_data_smithi188_77607_object108733:head# 2024-04-01T19:28:50.655 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.655 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d355d74:::benchmark_data_smithi188_77607_object143905:head# 2024-04-01T19:28:50.655 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.655 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d366899:::benchmark_data_smithi188_77607_object140413:head# 2024-04-01T19:28:50.655 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.655 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d371d6e:::benchmark_data_smithi188_77607_object104902:head# 2024-04-01T19:28:50.655 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.655 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d388bc6:::benchmark_data_smithi188_77607_object162542:head# 2024-04-01T19:28:50.655 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.655 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d390dac:::benchmark_data_smithi188_77607_object160729:head# 2024-04-01T19:28:50.655 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.656 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d39604c:::benchmark_data_smithi188_77607_object124046:head# 2024-04-01T19:28:50.656 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.656 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d39dab1:::benchmark_data_smithi188_77607_object156860:head# 2024-04-01T19:28:50.656 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.658 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d39fb57:::benchmark_data_smithi188_77607_object151404:head# 2024-04-01T19:28:50.658 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.658 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d39fdf5:::benchmark_data_smithi188_77607_object166965:head# 2024-04-01T19:28:50.658 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.658 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d3a336d:::benchmark_data_smithi188_77607_object109142:head# 2024-04-01T19:28:50.659 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.659 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d3a7574:::benchmark_data_smithi188_77607_object141642:head# 2024-04-01T19:28:50.659 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.659 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d3a837c:::benchmark_data_smithi188_77607_object124460:head# 2024-04-01T19:28:50.659 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.659 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d3ab117:::benchmark_data_smithi188_77607_object104698:head# 2024-04-01T19:28:50.659 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.659 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d3ae895:::benchmark_data_smithi188_77607_object128423:head# 2024-04-01T19:28:50.659 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.659 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d3b2d55:::benchmark_data_smithi188_77607_object138529:head# 2024-04-01T19:28:50.659 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.659 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d3bdc39:::benchmark_data_smithi188_77607_object109598:head# 2024-04-01T19:28:50.659 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.659 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d3d53f3:::benchmark_data_smithi188_77607_object149575:head# 2024-04-01T19:28:50.660 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.660 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d3dc30c:::benchmark_data_smithi188_77607_object158736:head# 2024-04-01T19:28:50.660 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.660 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d3e588f:::benchmark_data_smithi188_77607_object150158:head# 2024-04-01T19:28:50.660 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.660 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d3e6395:::benchmark_data_smithi188_77607_object99437:head# 2024-04-01T19:28:50.660 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.661 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d3e66c6:::benchmark_data_smithi188_77607_object121283:head# 2024-04-01T19:28:50.661 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.661 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d3ff4c6:::benchmark_data_smithi188_77607_object127736:head# 2024-04-01T19:28:50.661 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.661 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d40be51:::benchmark_data_smithi188_77607_object122342:head# 2024-04-01T19:28:50.661 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.661 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d4322de:::benchmark_data_smithi188_77607_object118316:head# 2024-04-01T19:28:50.661 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.661 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d43ec98:::benchmark_data_smithi188_77607_object157153:head# 2024-04-01T19:28:50.661 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.661 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d45f187:::benchmark_data_smithi188_77607_object103078:head# 2024-04-01T19:28:50.662 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.662 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d46cb9a:::benchmark_data_smithi188_77607_object117820:head# 2024-04-01T19:28:50.662 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.662 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d46ff44:::benchmark_data_smithi188_77607_object162897:head# 2024-04-01T19:28:50.662 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.665 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d47395a:::benchmark_data_smithi188_77607_object137975:head# 2024-04-01T19:28:50.665 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.665 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d47511c:::benchmark_data_smithi188_77607_object123243:head# 2024-04-01T19:28:50.665 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.665 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d47dab6:::benchmark_data_smithi188_77607_object123863:head# 2024-04-01T19:28:50.665 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.665 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d494531:::benchmark_data_smithi188_77607_object141146:head# 2024-04-01T19:28:50.665 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.665 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d496b4f:::benchmark_data_smithi188_77607_object156563:head# 2024-04-01T19:28:50.665 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.666 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d49c1d5:::benchmark_data_smithi188_77607_object150535:head# 2024-04-01T19:28:50.666 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.666 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d49eb18:::benchmark_data_smithi188_77607_object151246:head# 2024-04-01T19:28:50.666 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.666 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d4a84c6:::benchmark_data_smithi188_77607_object108182:head# 2024-04-01T19:28:50.666 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.666 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d4ba30a:::benchmark_data_smithi188_77607_object121698:head# 2024-04-01T19:28:50.666 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.666 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d4c30a3:::benchmark_data_smithi188_77607_object158542:head# 2024-04-01T19:28:50.666 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.666 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d4dc931:::benchmark_data_smithi188_77607_object165593:head# 2024-04-01T19:28:50.666 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.666 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d4fb4db:::benchmark_data_smithi188_77607_object114493:head# 2024-04-01T19:28:50.666 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.667 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d503442:::benchmark_data_smithi188_77607_object133414:head# 2024-04-01T19:28:50.667 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.667 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d505c17:::benchmark_data_smithi188_77607_object102707:head# 2024-04-01T19:28:50.667 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.667 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d50b8cc:::benchmark_data_smithi188_77607_object133791:head# 2024-04-01T19:28:50.667 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.670 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d51617c:::benchmark_data_smithi188_77607_object146043:head# 2024-04-01T19:28:50.670 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.670 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d51dc65:::benchmark_data_smithi188_77607_object109473:head# 2024-04-01T19:28:50.670 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.670 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d5217e0:::benchmark_data_smithi188_77607_object166429:head# 2024-04-01T19:28:50.670 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.670 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d525351:::benchmark_data_smithi188_77607_object125593:head# 2024-04-01T19:28:50.670 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.671 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d53269f:::benchmark_data_smithi188_77607_object122428:head# 2024-04-01T19:28:50.671 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.671 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d5327a3:::benchmark_data_smithi188_77607_object160162:head# 2024-04-01T19:28:50.671 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.671 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d5547f4:::benchmark_data_smithi188_77607_object107107:head# 2024-04-01T19:28:50.671 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.671 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d560e40:::benchmark_data_smithi188_77607_object104477:head# 2024-04-01T19:28:50.671 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.671 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d57e427:::benchmark_data_smithi188_77607_object162550:head# 2024-04-01T19:28:50.671 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.671 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d583254:::benchmark_data_smithi188_77607_object155616:head# 2024-04-01T19:28:50.671 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.671 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d594db8:::benchmark_data_smithi188_77607_object157022:head# 2024-04-01T19:28:50.671 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.671 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d5bc542:::benchmark_data_smithi188_77607_object123108:head# 2024-04-01T19:28:50.672 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.672 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d5c3d9c:::benchmark_data_smithi188_77607_object128690:head# 2024-04-01T19:28:50.672 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.672 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d5d24e5:::benchmark_data_smithi188_77607_object158838:head# 2024-04-01T19:28:50.672 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.672 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d5eb929:::benchmark_data_smithi188_77607_object123420:head# 2024-04-01T19:28:50.672 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.672 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d61e078:::benchmark_data_smithi188_77607_object162607:head# 2024-04-01T19:28:50.672 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.672 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d630675:::benchmark_data_smithi188_77607_object159545:head# 2024-04-01T19:28:50.672 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.672 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d63315a:::benchmark_data_smithi188_77607_object126721:head# 2024-04-01T19:28:50.672 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.672 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d63faaa:::benchmark_data_smithi188_77607_object133274:head# 2024-04-01T19:28:50.672 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.673 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d64c8b6:::benchmark_data_smithi188_77607_object149641:head# 2024-04-01T19:28:50.673 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.673 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d64fe23:::benchmark_data_smithi188_77607_object115456:head# 2024-04-01T19:28:50.673 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.673 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d66d7df:::benchmark_data_smithi188_77607_object157678:head# 2024-04-01T19:28:50.674 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.674 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d693226:::benchmark_data_smithi188_77607_object123644:head# 2024-04-01T19:28:50.674 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.674 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d6a5ddc:::benchmark_data_smithi188_77607_object122252:head# 2024-04-01T19:28:50.674 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.674 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d6b8d94:::benchmark_data_smithi188_77607_object165979:head# 2024-04-01T19:28:50.674 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.674 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d6c0f25:::benchmark_data_smithi188_77607_object101118:head# 2024-04-01T19:28:50.674 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.674 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d6c2b17:::benchmark_data_smithi188_77607_object129175:head# 2024-04-01T19:28:50.674 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.674 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d6c441f:::benchmark_data_smithi188_77607_object137896:head# 2024-04-01T19:28:50.674 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.674 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d6d4a75:::benchmark_data_smithi188_77607_object106940:head# 2024-04-01T19:28:50.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.675 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d6e3ff8:::benchmark_data_smithi188_77607_object131329:head# 2024-04-01T19:28:50.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.675 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d6e9545:::benchmark_data_smithi188_77607_object112725:head# 2024-04-01T19:28:50.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.675 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d700ad1:::benchmark_data_smithi188_77607_object148013:head# 2024-04-01T19:28:50.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.675 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d701027:::benchmark_data_smithi188_77607_object118161:head# 2024-04-01T19:28:50.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.675 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d703d75:::benchmark_data_smithi188_77607_object127148:head# 2024-04-01T19:28:50.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.675 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d72126b:::benchmark_data_smithi188_77607_object149952:head# 2024-04-01T19:28:50.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.678 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d721a05:::benchmark_data_smithi188_77607_object156208:head# 2024-04-01T19:28:50.678 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.678 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d729d52:::benchmark_data_smithi188_77607_object117589:head# 2024-04-01T19:28:50.678 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.678 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d7314dd:::benchmark_data_smithi188_77607_object114648:head# 2024-04-01T19:28:50.678 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.678 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d733602:::benchmark_data_smithi188_77607_object142335:head# 2024-04-01T19:28:50.678 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.678 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d734fbc:::benchmark_data_smithi188_77607_object125720:head# 2024-04-01T19:28:50.678 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.679 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d73b5b8:::benchmark_data_smithi188_77607_object113529:head# 2024-04-01T19:28:50.679 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.679 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d74aff5:::benchmark_data_smithi188_77607_object115579:head# 2024-04-01T19:28:50.679 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.679 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d7519cd:::benchmark_data_smithi188_77607_object109761:head# 2024-04-01T19:28:50.679 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.679 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d76912d:::benchmark_data_smithi188_77607_object124452:head# 2024-04-01T19:28:50.679 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.679 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d76e482:::benchmark_data_smithi188_77607_object147760:head# 2024-04-01T19:28:50.679 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.679 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d7947de:::benchmark_data_smithi188_77607_object99615:head# 2024-04-01T19:28:50.679 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.679 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d7bb6e0:::benchmark_data_smithi188_77607_object111821:head# 2024-04-01T19:28:50.679 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.679 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d7bbfed:::benchmark_data_smithi188_77607_object123535:head# 2024-04-01T19:28:50.680 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.680 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d7c4d1c:::benchmark_data_smithi188_77607_object118718:head# 2024-04-01T19:28:50.680 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.680 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d7d4c91:::benchmark_data_smithi188_77607_object148017:head# 2024-04-01T19:28:50.680 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.680 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d7d6036:::benchmark_data_smithi188_77607_object138200:head# 2024-04-01T19:28:50.680 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.681 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d7e1db5:::benchmark_data_smithi188_77607_object151643:head# 2024-04-01T19:28:50.681 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.681 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d7e4ef3:::benchmark_data_smithi188_77607_object98160:head# 2024-04-01T19:28:50.681 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.681 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d7f2d53:::benchmark_data_smithi188_77607_object133189:head# 2024-04-01T19:28:50.681 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.685 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d7ff2e0:::benchmark_data_smithi188_77607_object122461:head# 2024-04-01T19:28:50.685 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.685 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d803264:::benchmark_data_smithi188_77607_object101730:head# 2024-04-01T19:28:50.685 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.686 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d807c26:::benchmark_data_smithi188_77607_object159555:head# 2024-04-01T19:28:50.686 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.686 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d821063:::benchmark_data_smithi188_77607_object131437:head# 2024-04-01T19:28:50.686 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.686 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d85658e:::benchmark_data_smithi188_77607_object119875:head# 2024-04-01T19:28:50.686 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.686 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d859ad5:::benchmark_data_smithi188_77607_object137547:head# 2024-04-01T19:28:50.686 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d85dcf9:::benchmark_data_smithi188_77607_object112637:head# 2024-04-01T19:28:50.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d85f3b4:::benchmark_data_smithi188_77607_object114848:head# 2024-04-01T19:28:50.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d86e510:::benchmark_data_smithi188_77607_object153184:head# 2024-04-01T19:28:50.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d87414a:::benchmark_data_smithi188_77607_object130023:head# 2024-04-01T19:28:50.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.690 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d88a153:::benchmark_data_smithi188_77607_object153642:head# 2024-04-01T19:28:50.690 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.690 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d890269:::benchmark_data_smithi188_77607_object131099:head# 2024-04-01T19:28:50.690 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.690 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d892451:::benchmark_data_smithi188_77607_object127978:head# 2024-04-01T19:28:50.690 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.690 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d8d8aa0:::benchmark_data_smithi188_77607_object162515:head# 2024-04-01T19:28:50.690 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.690 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d8da03a:::benchmark_data_smithi188_77607_object102562:head# 2024-04-01T19:28:50.690 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.690 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d8db9d4:::benchmark_data_smithi188_77607_object145050:head# 2024-04-01T19:28:50.690 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.690 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d8dd1db:::benchmark_data_smithi188_77607_object148213:head# 2024-04-01T19:28:50.690 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.691 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d913ff0:::benchmark_data_smithi188_77607_object147348:head# 2024-04-01T19:28:50.691 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.691 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d92178a:::benchmark_data_smithi188_77607_object129394:head# 2024-04-01T19:28:50.691 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.691 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d926c0d:::benchmark_data_smithi188_77607_object137035:head# 2024-04-01T19:28:50.691 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.691 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d930859:::benchmark_data_smithi188_77607_object153610:head# 2024-04-01T19:28:50.691 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.694 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d943bb7:::benchmark_data_smithi188_77607_object165730:head# 2024-04-01T19:28:50.694 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.694 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d94dc6e:::benchmark_data_smithi188_77607_object136165:head# 2024-04-01T19:28:50.694 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.694 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d95fe8b:::benchmark_data_smithi188_77607_object99949:head# 2024-04-01T19:28:50.694 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.694 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d9733da:::benchmark_data_smithi188_77607_object120653:head# 2024-04-01T19:28:50.694 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.694 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d97d305:::benchmark_data_smithi188_77607_object153925:head# 2024-04-01T19:28:50.694 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.694 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d97e44d:::benchmark_data_smithi188_77607_object102680:head# 2024-04-01T19:28:50.694 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.695 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d99c781:::benchmark_data_smithi188_77607_object142266:head# 2024-04-01T19:28:50.695 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.695 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d99cb35:::benchmark_data_smithi188_77607_object114465:head# 2024-04-01T19:28:50.695 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.695 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d9b5aa6:::benchmark_data_smithi188_77607_object165291:head# 2024-04-01T19:28:50.695 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.695 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d9bff03:::benchmark_data_smithi188_77607_object135107:head# 2024-04-01T19:28:50.695 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.695 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d9c1e23:::benchmark_data_smithi188_77607_object110362:head# 2024-04-01T19:28:50.695 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.695 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d9e3be8:::benchmark_data_smithi188_77607_object153054:head# 2024-04-01T19:28:50.695 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.695 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6d9e7561:::benchmark_data_smithi188_77607_object122902:head# 2024-04-01T19:28:50.695 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.695 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6da174cb:::benchmark_data_smithi188_77607_object151379:head# 2024-04-01T19:28:50.696 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.696 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6da1ee79:::benchmark_data_smithi188_77607_object127154:head# 2024-04-01T19:28:50.696 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.696 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6da256e8:::benchmark_data_smithi188_77607_object111940:head# 2024-04-01T19:28:50.696 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.696 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6da338b5:::benchmark_data_smithi188_77607_object138059:head# 2024-04-01T19:28:50.696 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.696 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6da3765e:::benchmark_data_smithi188_77607_object102077:head# 2024-04-01T19:28:50.696 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.696 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6da39044:::benchmark_data_smithi188_77607_object146759:head# 2024-04-01T19:28:50.696 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.699 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6da3999c:::benchmark_data_smithi188_77607_object163887:head# 2024-04-01T19:28:50.700 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.700 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6da5bb69:::benchmark_data_smithi188_77607_object107124:head# 2024-04-01T19:28:50.700 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.700 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6da681af:::benchmark_data_smithi188_77607_object148277:head# 2024-04-01T19:28:50.700 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.700 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6da7dd41:::benchmark_data_smithi188_77607_object158926:head# 2024-04-01T19:28:50.700 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.700 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6da7f918:::benchmark_data_smithi188_77607_object111446:head# 2024-04-01T19:28:50.700 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.700 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dabe438:::benchmark_data_smithi188_77607_object142818:head# 2024-04-01T19:28:50.700 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.700 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6daca839:::benchmark_data_smithi188_77607_object163328:head# 2024-04-01T19:28:50.700 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.700 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dadc0d4:::benchmark_data_smithi188_77607_object131418:head# 2024-04-01T19:28:50.701 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.701 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dae07ab:::benchmark_data_smithi188_77607_object163413:head# 2024-04-01T19:28:50.701 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.701 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dae9de6:::benchmark_data_smithi188_77607_object155383:head# 2024-04-01T19:28:50.701 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.701 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6db1462a:::benchmark_data_smithi188_77607_object165727:head# 2024-04-01T19:28:50.701 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.701 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6db17d8a:::benchmark_data_smithi188_77607_object164464:head# 2024-04-01T19:28:50.701 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.701 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6db1d373:::benchmark_data_smithi188_77607_object137225:head# 2024-04-01T19:28:50.701 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.701 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6db21010:::benchmark_data_smithi188_77607_object98064:head# 2024-04-01T19:28:50.701 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.701 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6db222ab:::benchmark_data_smithi188_77607_object145788:head# 2024-04-01T19:28:50.701 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.702 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6db22996:::benchmark_data_smithi188_77607_object130366:head# 2024-04-01T19:28:50.702 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.702 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6db2c336:::benchmark_data_smithi188_77607_object145824:head# 2024-04-01T19:28:50.702 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.702 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6db44cc9:::benchmark_data_smithi188_77607_object103944:head# 2024-04-01T19:28:50.702 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.702 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6db591bd:::benchmark_data_smithi188_77607_object119788:head# 2024-04-01T19:28:50.702 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.702 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6db65b3c:::benchmark_data_smithi188_77607_object99120:head# 2024-04-01T19:28:50.702 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.702 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6db72b9e:::benchmark_data_smithi188_77607_object155767:head# 2024-04-01T19:28:50.702 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.702 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6db75623:::benchmark_data_smithi188_77607_object120537:head# 2024-04-01T19:28:50.702 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.703 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6db849ed:::benchmark_data_smithi188_77607_object105710:head# 2024-04-01T19:28:50.703 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.705 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6db84e54:::benchmark_data_smithi188_77607_object107086:head# 2024-04-01T19:28:50.705 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.705 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6db89a43:::benchmark_data_smithi188_77607_object149333:head# 2024-04-01T19:28:50.705 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.705 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dba3ba4:::benchmark_data_smithi188_77607_object137489:head# 2024-04-01T19:28:50.705 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.705 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dbac2df:::benchmark_data_smithi188_77607_object98590:head# 2024-04-01T19:28:50.705 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.705 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dbbc860:::benchmark_data_smithi188_77607_object157522:head# 2024-04-01T19:28:50.705 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dbc48cd:::benchmark_data_smithi188_77607_object147287:head# 2024-04-01T19:28:50.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dbc5118:::benchmark_data_smithi188_77607_object101780:head# 2024-04-01T19:28:50.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dbd146d:::benchmark_data_smithi188_77607_object149406:head# 2024-04-01T19:28:50.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dbdabf4:::benchmark_data_smithi188_77607_object99296:head# 2024-04-01T19:28:50.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dbfa4a5:::benchmark_data_smithi188_77607_object155226:head# 2024-04-01T19:28:50.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dc0d04a:::benchmark_data_smithi188_77607_object129118:head# 2024-04-01T19:28:50.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dc0f5c1:::benchmark_data_smithi188_77607_object123264:head# 2024-04-01T19:28:50.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.707 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dc1ed03:::benchmark_data_smithi188_77607_object160466:head# 2024-04-01T19:28:50.707 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.707 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dc1f9ea:::benchmark_data_smithi188_77607_object133762:head# 2024-04-01T19:28:50.707 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.707 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dc1ff24:::benchmark_data_smithi188_77607_object146547:head# 2024-04-01T19:28:50.707 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.707 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dc388a3:::benchmark_data_smithi188_77607_object165981:head# 2024-04-01T19:28:50.707 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.707 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dc39b62:::benchmark_data_smithi188_77607_object155691:head# 2024-04-01T19:28:50.707 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.707 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dc42d77:::benchmark_data_smithi188_77607_object114378:head# 2024-04-01T19:28:50.707 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.707 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dc538af:::benchmark_data_smithi188_77607_object155350:head# 2024-04-01T19:28:50.707 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.708 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dc61448:::benchmark_data_smithi188_77607_object139032:head# 2024-04-01T19:28:50.708 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.708 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dcb7911:::benchmark_data_smithi188_77607_object122832:head# 2024-04-01T19:28:50.709 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.709 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dcbcc12:::benchmark_data_smithi188_77607_object100366:head# 2024-04-01T19:28:50.709 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.709 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dcf6544:::benchmark_data_smithi188_77607_object112708:head# 2024-04-01T19:28:50.709 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.709 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dd02fb4:::benchmark_data_smithi188_77607_object164144:head# 2024-04-01T19:28:50.709 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.709 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dd24173:::benchmark_data_smithi188_77607_object134698:head# 2024-04-01T19:28:50.709 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.709 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dd3772e:::benchmark_data_smithi188_77607_object102656:head# 2024-04-01T19:28:50.709 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.712 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dd3fed7:::benchmark_data_smithi188_77607_object126829:head# 2024-04-01T19:28:50.712 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.712 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dd5e542:::benchmark_data_smithi188_77607_object150170:head# 2024-04-01T19:28:50.713 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.713 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dd5fb10:::benchmark_data_smithi188_77607_object158543:head# 2024-04-01T19:28:50.713 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.713 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dd6e799:::benchmark_data_smithi188_77607_object98140:head# 2024-04-01T19:28:50.713 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.714 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dd8122e:::benchmark_data_smithi188_77607_object144408:head# 2024-04-01T19:28:50.714 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.715 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dd861b4:::benchmark_data_smithi188_77607_object151613:head# 2024-04-01T19:28:50.715 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.715 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dde6b91:::benchmark_data_smithi188_77607_object111697:head# 2024-04-01T19:28:50.715 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.715 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ddf63a8:::benchmark_data_smithi188_77607_object117931:head# 2024-04-01T19:28:50.715 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.715 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6de02e42:::benchmark_data_smithi188_77607_object106630:head# 2024-04-01T19:28:50.715 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.715 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6de03b47:::benchmark_data_smithi188_77607_object133680:head# 2024-04-01T19:28:50.715 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.715 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6de453c5:::benchmark_data_smithi188_77607_object151274:head# 2024-04-01T19:28:50.715 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.717 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6de4a4f9:::benchmark_data_smithi188_77607_object126767:head# 2024-04-01T19:28:50.717 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.717 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6de4ceaf:::benchmark_data_smithi188_77607_object105833:head# 2024-04-01T19:28:50.717 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.717 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6de4d712:::benchmark_data_smithi188_77607_object156811:head# 2024-04-01T19:28:50.717 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.717 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6de50658:::benchmark_data_smithi188_77607_object150224:head# 2024-04-01T19:28:50.718 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.718 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6de69ec7:::benchmark_data_smithi188_77607_object157662:head# 2024-04-01T19:28:50.718 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.718 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6de937ba:::benchmark_data_smithi188_77607_object106326:head# 2024-04-01T19:28:50.718 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.718 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6de93d0b:::benchmark_data_smithi188_77607_object166099:head# 2024-04-01T19:28:50.718 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.718 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6de954b6:::benchmark_data_smithi188_77607_object102219:head# 2024-04-01T19:28:50.718 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.718 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6deb5fe8:::benchmark_data_smithi188_77607_object147468:head# 2024-04-01T19:28:50.718 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.718 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6deca275:::benchmark_data_smithi188_77607_object142666:head# 2024-04-01T19:28:50.719 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.720 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6df1cebe:::benchmark_data_smithi188_77607_object120917:head# 2024-04-01T19:28:50.721 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.721 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6df21eac:::benchmark_data_smithi188_77607_object159077:head# 2024-04-01T19:28:50.721 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.721 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6df2d992:::benchmark_data_smithi188_77607_object156688:head# 2024-04-01T19:28:50.721 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.721 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6df38330:::benchmark_data_smithi188_77607_object143691:head# 2024-04-01T19:28:50.721 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.721 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6df3cf60:::benchmark_data_smithi188_77607_object135251:head# 2024-04-01T19:28:50.721 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.721 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6df58326:::benchmark_data_smithi188_77607_object103904:head# 2024-04-01T19:28:50.721 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.721 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6df657b9:::benchmark_data_smithi188_77607_object159913:head# 2024-04-01T19:28:50.721 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.721 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6df7a6da:::benchmark_data_smithi188_77607_object132784:head# 2024-04-01T19:28:50.721 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.722 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6df8375e:::benchmark_data_smithi188_77607_object156580:head# 2024-04-01T19:28:50.722 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.722 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6df99de9:::benchmark_data_smithi188_77607_object101370:head# 2024-04-01T19:28:50.722 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.722 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dfb210e:::benchmark_data_smithi188_77607_object113595:head# 2024-04-01T19:28:50.722 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.722 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6dfdcffc:::benchmark_data_smithi188_77607_object118253:head# 2024-04-01T19:28:50.722 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.724 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e019b0c:::benchmark_data_smithi188_77607_object142495:head# 2024-04-01T19:28:50.724 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.724 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e044799:::benchmark_data_smithi188_77607_object147756:head# 2024-04-01T19:28:50.724 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.724 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e05e0ec:::benchmark_data_smithi188_77607_object134378:head# 2024-04-01T19:28:50.724 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.724 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e06cd65:::benchmark_data_smithi188_77607_object141207:head# 2024-04-01T19:28:50.724 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.724 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e07f49a:::benchmark_data_smithi188_77607_object101155:head# 2024-04-01T19:28:50.724 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.724 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e0c1ab8:::benchmark_data_smithi188_77607_object122496:head# 2024-04-01T19:28:50.724 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.724 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e0c1eb0:::benchmark_data_smithi188_77607_object148605:head# 2024-04-01T19:28:50.724 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.725 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e0d055d:::benchmark_data_smithi188_77607_object104157:head# 2024-04-01T19:28:50.725 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.725 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e0d7a6d:::benchmark_data_smithi188_77607_object144433:head# 2024-04-01T19:28:50.725 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.725 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e0f2f42:::benchmark_data_smithi188_77607_object115608:head# 2024-04-01T19:28:50.725 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.725 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e0f33e9:::benchmark_data_smithi188_77607_object105891:head# 2024-04-01T19:28:50.725 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.725 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e0f85b2:::benchmark_data_smithi188_77607_object141693:head# 2024-04-01T19:28:50.725 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.728 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e105a6e:::benchmark_data_smithi188_77607_object98377:head# 2024-04-01T19:28:50.728 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.728 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e10bde3:::benchmark_data_smithi188_77607_object165762:head# 2024-04-01T19:28:50.729 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.729 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e115750:::benchmark_data_smithi188_77607_object122917:head# 2024-04-01T19:28:50.729 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.729 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e1265cb:::benchmark_data_smithi188_77607_object112390:head# 2024-04-01T19:28:50.729 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.729 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e12efdc:::benchmark_data_smithi188_77607_object152092:head# 2024-04-01T19:28:50.729 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.730 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e1579f8:::benchmark_data_smithi188_77607_object107401:head# 2024-04-01T19:28:50.730 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.730 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e162c23:::benchmark_data_smithi188_77607_object165407:head# 2024-04-01T19:28:50.730 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.730 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e16ece2:::benchmark_data_smithi188_77607_object134779:head# 2024-04-01T19:28:50.730 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.730 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e18fd36:::benchmark_data_smithi188_77607_object146042:head# 2024-04-01T19:28:50.730 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.730 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e19585b:::benchmark_data_smithi188_77607_object158879:head# 2024-04-01T19:28:50.730 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.730 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e1a6ac2:::benchmark_data_smithi188_77607_object116518:head# 2024-04-01T19:28:50.730 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.731 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e1a7d4e:::benchmark_data_smithi188_77607_object132267:head# 2024-04-01T19:28:50.731 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.731 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e1b50a3:::benchmark_data_smithi188_77607_object161571:head# 2024-04-01T19:28:50.731 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.731 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e1d3ac1:::benchmark_data_smithi188_77607_object128580:head# 2024-04-01T19:28:50.731 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.731 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e1de88a:::benchmark_data_smithi188_77607_object109320:head# 2024-04-01T19:28:50.731 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.732 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e20e658:::benchmark_data_smithi188_77607_object138259:head# 2024-04-01T19:28:50.733 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.733 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e20f154:::benchmark_data_smithi188_77607_object155512:head# 2024-04-01T19:28:50.733 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.733 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e231bb7:::benchmark_data_smithi188_77607_object128763:head# 2024-04-01T19:28:50.733 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.733 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e2532c7:::benchmark_data_smithi188_77607_object156147:head# 2024-04-01T19:28:50.733 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.733 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e2540e1:::benchmark_data_smithi188_77607_object158091:head# 2024-04-01T19:28:50.733 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.733 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e25a2f1:::benchmark_data_smithi188_77607_object157400:head# 2024-04-01T19:28:50.733 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.733 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e25bf60:::benchmark_data_smithi188_77607_object99634:head# 2024-04-01T19:28:50.733 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.733 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e261b32:::benchmark_data_smithi188_77607_object134172:head# 2024-04-01T19:28:50.733 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.734 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e267e58:::benchmark_data_smithi188_77607_object113101:head# 2024-04-01T19:28:50.734 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.734 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e26c0db:::benchmark_data_smithi188_77607_object121487:head# 2024-04-01T19:28:50.734 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.734 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e295d2f:::benchmark_data_smithi188_77607_object163259:head# 2024-04-01T19:28:50.734 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.735 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e29dc28:::benchmark_data_smithi188_77607_object104093:head# 2024-04-01T19:28:50.735 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.735 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e2b528a:::benchmark_data_smithi188_77607_object104084:head# 2024-04-01T19:28:50.735 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.735 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e2d76c7:::benchmark_data_smithi188_77607_object142153:head# 2024-04-01T19:28:50.735 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.736 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e2d8c9c:::benchmark_data_smithi188_77607_object110111:head# 2024-04-01T19:28:50.736 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.736 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e2db1e8:::benchmark_data_smithi188_77607_object149038:head# 2024-04-01T19:28:50.736 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.736 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e30576f:::benchmark_data_smithi188_77607_object99894:head# 2024-04-01T19:28:50.736 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.736 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e31a89c:::benchmark_data_smithi188_77607_object164995:head# 2024-04-01T19:28:50.736 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.736 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e33c683:::benchmark_data_smithi188_77607_object105202:head# 2024-04-01T19:28:50.736 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.736 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e34a7f0:::benchmark_data_smithi188_77607_object122215:head# 2024-04-01T19:28:50.736 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.736 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e350f96:::benchmark_data_smithi188_77607_object100286:head# 2024-04-01T19:28:50.736 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e365d29:::benchmark_data_smithi188_77607_object156268:head# 2024-04-01T19:28:50.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e381911:::benchmark_data_smithi188_77607_object127332:head# 2024-04-01T19:28:50.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.740 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e38a15f:::benchmark_data_smithi188_77607_object125815:head# 2024-04-01T19:28:50.740 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.740 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e39ce55:::benchmark_data_smithi188_77607_object128465:head# 2024-04-01T19:28:50.740 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.740 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e3a1501:::benchmark_data_smithi188_77607_object122041:head# 2024-04-01T19:28:50.740 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.741 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e3c26e9:::benchmark_data_smithi188_77607_object153008:head# 2024-04-01T19:28:50.741 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.741 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e3c64b7:::benchmark_data_smithi188_77607_object110595:head# 2024-04-01T19:28:50.741 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.741 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e405002:::benchmark_data_smithi188_77607_object114501:head# 2024-04-01T19:28:50.741 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.741 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e40e236:::benchmark_data_smithi188_77607_object145296:head# 2024-04-01T19:28:50.741 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.741 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e42c7e3:::benchmark_data_smithi188_77607_object149531:head# 2024-04-01T19:28:50.741 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.741 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e43b028:::benchmark_data_smithi188_77607_object167011:head# 2024-04-01T19:28:50.741 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.741 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e4444e0:::benchmark_data_smithi188_77607_object118305:head# 2024-04-01T19:28:50.741 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.741 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e451048:::benchmark_data_smithi188_77607_object167045:head# 2024-04-01T19:28:50.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e481d32:::benchmark_data_smithi188_77607_object162739:head# 2024-04-01T19:28:50.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e48281a:::benchmark_data_smithi188_77607_object164707:head# 2024-04-01T19:28:50.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e4aca93:::benchmark_data_smithi188_77607_object145797:head# 2024-04-01T19:28:50.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e4b46aa:::benchmark_data_smithi188_77607_object130506:head# 2024-04-01T19:28:50.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e4c6bda:::benchmark_data_smithi188_77607_object133105:head# 2024-04-01T19:28:50.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e4c96b0:::benchmark_data_smithi188_77607_object121187:head# 2024-04-01T19:28:50.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e4d7f7b:::benchmark_data_smithi188_77607_object133695:head# 2024-04-01T19:28:50.743 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.743 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e4e011e:::benchmark_data_smithi188_77607_object131588:head# 2024-04-01T19:28:50.743 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.743 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e4e3e44:::benchmark_data_smithi188_77607_object121917:head# 2024-04-01T19:28:50.743 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.746 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e4e5391:::benchmark_data_smithi188_77607_object129053:head# 2024-04-01T19:28:50.746 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.747 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e4e7624:::benchmark_data_smithi188_77607_object100989:head# 2024-04-01T19:28:50.747 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.747 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e4ed238:::benchmark_data_smithi188_77607_object134251:head# 2024-04-01T19:28:50.747 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.747 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e510730:::benchmark_data_smithi188_77607_object103048:head# 2024-04-01T19:28:50.747 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.747 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e513d23:::benchmark_data_smithi188_77607_object137529:head# 2024-04-01T19:28:50.747 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.747 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e52ce32:::benchmark_data_smithi188_77607_object166476:head# 2024-04-01T19:28:50.747 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.747 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e52ffa7:::benchmark_data_smithi188_77607_object104206:head# 2024-04-01T19:28:50.747 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.747 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e553c18:::benchmark_data_smithi188_77607_object127110:head# 2024-04-01T19:28:50.747 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.748 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e562ba4:::benchmark_data_smithi188_77607_object133796:head# 2024-04-01T19:28:50.748 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.748 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e5783d0:::benchmark_data_smithi188_77607_object151253:head# 2024-04-01T19:28:50.748 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.748 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e58a6bc:::benchmark_data_smithi188_77607_object106250:head# 2024-04-01T19:28:50.748 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.748 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e5918f4:::benchmark_data_smithi188_77607_object126409:head# 2024-04-01T19:28:50.748 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.748 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e5995e2:::benchmark_data_smithi188_77607_object122362:head# 2024-04-01T19:28:50.748 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.748 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e59b3b4:::benchmark_data_smithi188_77607_object166106:head# 2024-04-01T19:28:50.748 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.748 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e5c1262:::benchmark_data_smithi188_77607_object132880:head# 2024-04-01T19:28:50.748 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.749 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e5c7243:::benchmark_data_smithi188_77607_object128434:head# 2024-04-01T19:28:50.749 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.749 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e5c964c:::benchmark_data_smithi188_77607_object128802:head# 2024-04-01T19:28:50.749 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.749 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e5cc4aa:::benchmark_data_smithi188_77607_object160884:head# 2024-04-01T19:28:50.749 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.749 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e5d0960:::benchmark_data_smithi188_77607_object123395:head# 2024-04-01T19:28:50.749 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.749 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e5f6b5d:::benchmark_data_smithi188_77607_object163774:head# 2024-04-01T19:28:50.749 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.749 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e5f77c9:::benchmark_data_smithi188_77607_object158445:head# 2024-04-01T19:28:50.749 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.749 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e602a88:::benchmark_data_smithi188_77607_object98594:head# 2024-04-01T19:28:50.749 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.750 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e60c1e8:::benchmark_data_smithi188_77607_object151811:head# 2024-04-01T19:28:50.750 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.750 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e617898:::benchmark_data_smithi188_77607_object143094:head# 2024-04-01T19:28:50.750 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.750 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e62ec10:::benchmark_data_smithi188_77607_object103212:head# 2024-04-01T19:28:50.750 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.755 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e632f96:::benchmark_data_smithi188_77607_object120000:head# 2024-04-01T19:28:50.755 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.755 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e636552:::benchmark_data_smithi188_77607_object151586:head# 2024-04-01T19:28:50.755 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.755 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e63d6c2:::benchmark_data_smithi188_77607_object115496:head# 2024-04-01T19:28:50.755 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.756 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e648520:::benchmark_data_smithi188_77607_object139713:head# 2024-04-01T19:28:50.756 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.756 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e64f8fe:::benchmark_data_smithi188_77607_object105823:head# 2024-04-01T19:28:50.756 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.756 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e653f98:::benchmark_data_smithi188_77607_object113536:head# 2024-04-01T19:28:50.756 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.756 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e662f7d:::benchmark_data_smithi188_77607_object159198:head# 2024-04-01T19:28:50.756 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.756 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e66c2e3:::benchmark_data_smithi188_77607_object105513:head# 2024-04-01T19:28:50.756 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.756 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e67ded4:::benchmark_data_smithi188_77607_object162017:head# 2024-04-01T19:28:50.756 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.756 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e68959c:::benchmark_data_smithi188_77607_object146020:head# 2024-04-01T19:28:50.756 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.756 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e6a1be3:::benchmark_data_smithi188_77607_object151535:head# 2024-04-01T19:28:50.757 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.757 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e6b088f:::benchmark_data_smithi188_77607_object120287:head# 2024-04-01T19:28:50.757 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.757 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e6b5466:::benchmark_data_smithi188_77607_object114974:head# 2024-04-01T19:28:50.757 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.757 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e6d18c6:::benchmark_data_smithi188_77607_object161993:head# 2024-04-01T19:28:50.757 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.757 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e6d9db3:::benchmark_data_smithi188_77607_object141366:head# 2024-04-01T19:28:50.757 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.757 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e6dfedd:::benchmark_data_smithi188_77607_object157435:head# 2024-04-01T19:28:50.757 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.757 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e6f5d8e:::benchmark_data_smithi188_77607_object141090:head# 2024-04-01T19:28:50.757 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.757 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e6f8c62:::benchmark_data_smithi188_77607_object127428:head# 2024-04-01T19:28:50.757 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.758 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e700e30:::benchmark_data_smithi188_77607_object154150:head# 2024-04-01T19:28:50.758 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.758 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e705862:::benchmark_data_smithi188_77607_object135755:head# 2024-04-01T19:28:50.758 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.758 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e718b5f:::benchmark_data_smithi188_77607_object143852:head# 2024-04-01T19:28:50.758 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.758 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e726808:::benchmark_data_smithi188_77607_object145374:head# 2024-04-01T19:28:50.758 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.758 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e737dc9:::benchmark_data_smithi188_77607_object110476:head# 2024-04-01T19:28:50.758 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.758 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e74ae13:::benchmark_data_smithi188_77607_object162334:head# 2024-04-01T19:28:50.758 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.758 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e7556b6:::benchmark_data_smithi188_77607_object108264:head# 2024-04-01T19:28:50.759 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.759 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e77a725:::benchmark_data_smithi188_77607_object106757:head# 2024-04-01T19:28:50.759 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.759 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e7cc0dc:::benchmark_data_smithi188_77607_object160080:head# 2024-04-01T19:28:50.759 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.759 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e7d3a42:::benchmark_data_smithi188_77607_object98466:head# 2024-04-01T19:28:50.759 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.759 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e8356e0:::benchmark_data_smithi188_77607_object105556:head# 2024-04-01T19:28:50.759 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.759 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e84b584:::benchmark_data_smithi188_77607_object151570:head# 2024-04-01T19:28:50.759 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.759 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e851ba0:::benchmark_data_smithi188_77607_object162223:head# 2024-04-01T19:28:50.759 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.759 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e8534b4:::benchmark_data_smithi188_77607_object128179:head# 2024-04-01T19:28:50.759 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.760 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e8654a0:::benchmark_data_smithi188_77607_object107966:head# 2024-04-01T19:28:50.760 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.760 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e885647:::benchmark_data_smithi188_77607_object108795:head# 2024-04-01T19:28:50.760 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.760 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e8874d2:::benchmark_data_smithi188_77607_object119142:head# 2024-04-01T19:28:50.760 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.760 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e888ba2:::benchmark_data_smithi188_77607_object156867:head# 2024-04-01T19:28:50.760 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.760 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e8b0fc8:::benchmark_data_smithi188_77607_object135867:head# 2024-04-01T19:28:50.760 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.760 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e8cfc8b:::benchmark_data_smithi188_77607_object148058:head# 2024-04-01T19:28:50.760 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.773 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e8d2880:::benchmark_data_smithi188_77607_object118681:head# 2024-04-01T19:28:50.773 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.773 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e8fc549:::benchmark_data_smithi188_77607_object157086:head# 2024-04-01T19:28:50.773 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.773 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e9073ea:::benchmark_data_smithi188_77607_object128832:head# 2024-04-01T19:28:50.773 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.773 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e90c3c3:::benchmark_data_smithi188_77607_object124141:head# 2024-04-01T19:28:50.773 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.773 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e9123a9:::benchmark_data_smithi188_77607_object144682:head# 2024-04-01T19:28:50.773 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.773 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e927c78:::benchmark_data_smithi188_77607_object120862:head# 2024-04-01T19:28:50.773 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.773 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e9431fd:::benchmark_data_smithi188_77607_object116284:head# 2024-04-01T19:28:50.774 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.774 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e94b9a8:::benchmark_data_smithi188_77607_object153792:head# 2024-04-01T19:28:50.774 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.774 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e94dfca:::benchmark_data_smithi188_77607_object124531:head# 2024-04-01T19:28:50.774 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.774 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e953a2d:::benchmark_data_smithi188_77607_object103134:head# 2024-04-01T19:28:50.774 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.774 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e962697:::benchmark_data_smithi188_77607_object107944:head# 2024-04-01T19:28:50.774 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.774 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e9755af:::benchmark_data_smithi188_77607_object103299:head# 2024-04-01T19:28:50.774 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.774 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e98cc23:::benchmark_data_smithi188_77607_object130320:head# 2024-04-01T19:28:50.774 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.775 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e9ac5b6:::benchmark_data_smithi188_77607_object103438:head# 2024-04-01T19:28:50.775 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.775 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e9bd2a0:::benchmark_data_smithi188_77607_object147643:head# 2024-04-01T19:28:50.775 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.775 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e9cc2ae:::benchmark_data_smithi188_77607_object160469:head# 2024-04-01T19:28:50.775 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.775 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6e9ec413:::benchmark_data_smithi188_77607_object162960:head# 2024-04-01T19:28:50.775 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.775 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ea01af8:::benchmark_data_smithi188_77607_object167214:head# 2024-04-01T19:28:50.775 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.775 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ea36838:::benchmark_data_smithi188_77607_object122295:head# 2024-04-01T19:28:50.775 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.775 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ea4a378:::benchmark_data_smithi188_77607_object138453:head# 2024-04-01T19:28:50.775 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.776 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ea4d829:::benchmark_data_smithi188_77607_object132709:head# 2024-04-01T19:28:50.776 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.776 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ea5c6f2:::benchmark_data_smithi188_77607_object158440:head# 2024-04-01T19:28:50.776 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.776 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ea5d40c:::benchmark_data_smithi188_77607_object105673:head# 2024-04-01T19:28:50.776 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.776 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ea65a58:::benchmark_data_smithi188_77607_object159876:head# 2024-04-01T19:28:50.776 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.776 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ea73b14:::benchmark_data_smithi188_77607_object131469:head# 2024-04-01T19:28:50.776 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.776 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ea80b11:::benchmark_data_smithi188_77607_object109665:head# 2024-04-01T19:28:50.776 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.776 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ea8c9f6:::benchmark_data_smithi188_77607_object104111:head# 2024-04-01T19:28:50.777 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.777 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ea926df:::benchmark_data_smithi188_77607_object120873:head# 2024-04-01T19:28:50.777 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.777 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6eab157a:::benchmark_data_smithi188_77607_object114464:head# 2024-04-01T19:28:50.777 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.777 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ead8109:::benchmark_data_smithi188_77607_object165545:head# 2024-04-01T19:28:50.777 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.777 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6eb02e4b:::benchmark_data_smithi188_77607_object151726:head# 2024-04-01T19:28:50.777 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.777 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6eb0f490:::benchmark_data_smithi188_77607_object116583:head# 2024-04-01T19:28:50.777 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.777 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6eb3da38:::benchmark_data_smithi188_77607_object124292:head# 2024-04-01T19:28:50.777 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.777 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6eb40848:::benchmark_data_smithi188_77607_object154416:head# 2024-04-01T19:28:50.778 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.778 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6eb4d7db:::benchmark_data_smithi188_77607_object128068:head# 2024-04-01T19:28:50.778 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.778 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6eb53fd7:::benchmark_data_smithi188_77607_object118385:head# 2024-04-01T19:28:50.778 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.778 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6eb55942:::benchmark_data_smithi188_77607_object153766:head# 2024-04-01T19:28:50.778 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.778 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6eb68743:::benchmark_data_smithi188_77607_object108452:head# 2024-04-01T19:28:50.778 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.778 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6eb7b6eb:::benchmark_data_smithi188_77607_object120316:head# 2024-04-01T19:28:50.778 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.778 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6eb83d2b:::benchmark_data_smithi188_77607_object99374:head# 2024-04-01T19:28:50.778 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.779 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6eb86015:::benchmark_data_smithi188_77607_object116134:head# 2024-04-01T19:28:50.779 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.779 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6eb9f21d:::benchmark_data_smithi188_77607_object117089:head# 2024-04-01T19:28:50.779 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.779 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6eba7a13:::benchmark_data_smithi188_77607_object123729:head# 2024-04-01T19:28:50.779 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.779 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ebd2b9e:::benchmark_data_smithi188_77607_object155101:head# 2024-04-01T19:28:50.779 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.779 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ebd65ac:::benchmark_data_smithi188_77607_object148511:head# 2024-04-01T19:28:50.779 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.779 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ebf3cb7:::benchmark_data_smithi188_77607_object137092:head# 2024-04-01T19:28:50.779 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.779 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ebfbfb0:::benchmark_data_smithi188_77607_object112374:head# 2024-04-01T19:28:50.779 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.779 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ec01814:::benchmark_data_smithi188_77607_object111174:head# 2024-04-01T19:28:50.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ec03203:::benchmark_data_smithi188_77607_object104749:head# 2024-04-01T19:28:50.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ec03d24:::benchmark_data_smithi188_77607_object98703:head# 2024-04-01T19:28:50.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ec176d1:::benchmark_data_smithi188_77607_object160285:head# 2024-04-01T19:28:50.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ec3e49d:::benchmark_data_smithi188_77607_object105422:head# 2024-04-01T19:28:50.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ec403d6:::benchmark_data_smithi188_77607_object143403:head# 2024-04-01T19:28:50.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ec54ae4:::benchmark_data_smithi188_77607_object133834:head# 2024-04-01T19:28:50.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ec5dd03:::benchmark_data_smithi188_77607_object98788:head# 2024-04-01T19:28:50.781 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.781 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ec6dac1:::benchmark_data_smithi188_77607_object160425:head# 2024-04-01T19:28:50.781 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.781 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ec70528:::benchmark_data_smithi188_77607_object146141:head# 2024-04-01T19:28:50.781 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.781 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ec753df:::benchmark_data_smithi188_77607_object111967:head# 2024-04-01T19:28:50.781 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.781 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ec854d4:::benchmark_data_smithi188_77607_object154207:head# 2024-04-01T19:28:50.781 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.781 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ec88635:::benchmark_data_smithi188_77607_object152111:head# 2024-04-01T19:28:50.781 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.781 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ec964d7:::benchmark_data_smithi188_77607_object135893:head# 2024-04-01T19:28:50.781 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.782 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ecaf786:::benchmark_data_smithi188_77607_object113891:head# 2024-04-01T19:28:50.782 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.782 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ecb8239:::benchmark_data_smithi188_77607_object139313:head# 2024-04-01T19:28:50.782 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.782 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ecb8d3b:::benchmark_data_smithi188_77607_object103252:head# 2024-04-01T19:28:50.782 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.782 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ecce4e9:::benchmark_data_smithi188_77607_object109404:head# 2024-04-01T19:28:50.782 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.782 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ecdbff8:::benchmark_data_smithi188_77607_object147024:head# 2024-04-01T19:28:50.782 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.782 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ece1524:::benchmark_data_smithi188_77607_object156622:head# 2024-04-01T19:28:50.782 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.782 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ececd06:::benchmark_data_smithi188_77607_object107854:head# 2024-04-01T19:28:50.782 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.782 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ecef26e:::benchmark_data_smithi188_77607_object108724:head# 2024-04-01T19:28:50.783 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.783 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ecf3b3f:::benchmark_data_smithi188_77607_object150591:head# 2024-04-01T19:28:50.783 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.783 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ecf839e:::benchmark_data_smithi188_77607_object122950:head# 2024-04-01T19:28:50.783 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.783 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ecff01a:::benchmark_data_smithi188_77607_object149512:head# 2024-04-01T19:28:50.783 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.783 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ed0c5a9:::benchmark_data_smithi188_77607_object163354:head# 2024-04-01T19:28:50.783 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.783 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ed161fd:::benchmark_data_smithi188_77607_object104015:head# 2024-04-01T19:28:50.783 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.789 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ed296c6:::benchmark_data_smithi188_77607_object160212:head# 2024-04-01T19:28:50.789 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.789 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ed3b2b5:::benchmark_data_smithi188_77607_object144941:head# 2024-04-01T19:28:50.789 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.789 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ed55bce:::benchmark_data_smithi188_77607_object138268:head# 2024-04-01T19:28:50.789 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.789 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ed56efd:::benchmark_data_smithi188_77607_object166013:head# 2024-04-01T19:28:50.789 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.789 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ed632d9:::benchmark_data_smithi188_77607_object110233:head# 2024-04-01T19:28:50.789 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.789 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ed756eb:::benchmark_data_smithi188_77607_object111896:head# 2024-04-01T19:28:50.789 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.790 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ed76f2c:::benchmark_data_smithi188_77607_object155013:head# 2024-04-01T19:28:50.790 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.790 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ed8276f:::benchmark_data_smithi188_77607_object160710:head# 2024-04-01T19:28:50.790 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.790 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ed86844:::benchmark_data_smithi188_77607_object139680:head# 2024-04-01T19:28:50.790 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.790 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6eda5932:::benchmark_data_smithi188_77607_object157166:head# 2024-04-01T19:28:50.790 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.790 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6edaab4c:::benchmark_data_smithi188_77607_object127870:head# 2024-04-01T19:28:50.790 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.790 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ede98c4:::benchmark_data_smithi188_77607_object119521:head# 2024-04-01T19:28:50.790 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.790 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6edf7c57:::benchmark_data_smithi188_77607_object107608:head# 2024-04-01T19:28:50.790 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.791 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6edffa9d:::benchmark_data_smithi188_77607_object160984:head# 2024-04-01T19:28:50.791 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.791 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ee0621e:::benchmark_data_smithi188_77607_object112027:head# 2024-04-01T19:28:50.791 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.791 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ee08f39:::benchmark_data_smithi188_77607_object138433:head# 2024-04-01T19:28:50.791 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.791 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ee1667a:::benchmark_data_smithi188_77607_object121572:head# 2024-04-01T19:28:50.791 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.791 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ee1b253:::benchmark_data_smithi188_77607_object141170:head# 2024-04-01T19:28:50.791 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.791 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ee1b929:::benchmark_data_smithi188_77607_object121889:head# 2024-04-01T19:28:50.791 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.791 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ee20184:::benchmark_data_smithi188_77607_object116513:head# 2024-04-01T19:28:50.791 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.791 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ee22775:::benchmark_data_smithi188_77607_object162893:head# 2024-04-01T19:28:50.792 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.792 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ee3bccc:::benchmark_data_smithi188_77607_object134694:head# 2024-04-01T19:28:50.792 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.792 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ee5406d:::benchmark_data_smithi188_77607_object113295:head# 2024-04-01T19:28:50.792 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.792 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ee681f7:::benchmark_data_smithi188_77607_object148825:head# 2024-04-01T19:28:50.792 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.792 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ee6ea28:::benchmark_data_smithi188_77607_object145560:head# 2024-04-01T19:28:50.792 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.792 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ee78bc1:::benchmark_data_smithi188_77607_object156609:head# 2024-04-01T19:28:50.792 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.792 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ee906b1:::benchmark_data_smithi188_77607_object150521:head# 2024-04-01T19:28:50.792 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.792 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ee973ce:::benchmark_data_smithi188_77607_object135373:head# 2024-04-01T19:28:50.793 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.793 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6eea139d:::benchmark_data_smithi188_77607_object165852:head# 2024-04-01T19:28:50.793 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.793 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6eeceb27:::benchmark_data_smithi188_77607_object149609:head# 2024-04-01T19:28:50.793 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.793 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6eed4ab7:::benchmark_data_smithi188_77607_object141150:head# 2024-04-01T19:28:50.793 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.793 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6eedbc69:::benchmark_data_smithi188_77607_object166209:head# 2024-04-01T19:28:50.793 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.793 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ef0ba36:::benchmark_data_smithi188_77607_object167067:head# 2024-04-01T19:28:50.793 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.793 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ef1b159:::benchmark_data_smithi188_77607_object148918:head# 2024-04-01T19:28:50.793 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.793 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ef1b992:::benchmark_data_smithi188_77607_object110825:head# 2024-04-01T19:28:50.794 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.794 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ef1ec00:::benchmark_data_smithi188_77607_object165272:head# 2024-04-01T19:28:50.794 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.794 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ef27946:::benchmark_data_smithi188_77607_object149052:head# 2024-04-01T19:28:50.794 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.794 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ef2a1b0:::benchmark_data_smithi188_77607_object119207:head# 2024-04-01T19:28:50.794 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.794 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ef55c30:::benchmark_data_smithi188_77607_object115051:head# 2024-04-01T19:28:50.794 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.794 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ef7ba36:::benchmark_data_smithi188_77607_object150728:head# 2024-04-01T19:28:50.794 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.794 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ef80298:::benchmark_data_smithi188_77607_object109356:head# 2024-04-01T19:28:50.794 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.794 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ef8b230:::benchmark_data_smithi188_77607_object116566:head# 2024-04-01T19:28:50.795 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.795 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ef9d25e:::benchmark_data_smithi188_77607_object111210:head# 2024-04-01T19:28:50.795 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.795 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6efbc71a:::benchmark_data_smithi188_77607_object129479:head# 2024-04-01T19:28:50.795 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.795 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6efd9c45:::benchmark_data_smithi188_77607_object162609:head# 2024-04-01T19:28:50.795 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.795 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6efda5f8:::benchmark_data_smithi188_77607_object103376:head# 2024-04-01T19:28:50.795 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.795 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6effb9a9:::benchmark_data_smithi188_77607_object120319:head# 2024-04-01T19:28:50.795 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.795 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f0141ec:::benchmark_data_smithi188_77607_object107069:head# 2024-04-01T19:28:50.795 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.795 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f0221e0:::benchmark_data_smithi188_77607_object145319:head# 2024-04-01T19:28:50.796 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.796 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f03fe8f:::benchmark_data_smithi188_77607_object149190:head# 2024-04-01T19:28:50.796 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.796 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f0535cb:::benchmark_data_smithi188_77607_object162964:head# 2024-04-01T19:28:50.796 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.796 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f0564d2:::benchmark_data_smithi188_77607_object150680:head# 2024-04-01T19:28:50.796 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.796 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f06450e:::benchmark_data_smithi188_77607_object158758:head# 2024-04-01T19:28:50.796 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.796 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f07d75c:::benchmark_data_smithi188_77607_object116401:head# 2024-04-01T19:28:50.796 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.798 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f08909a:::benchmark_data_smithi188_77607_object141112:head# 2024-04-01T19:28:50.798 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.798 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f0c4c03:::benchmark_data_smithi188_77607_object154428:head# 2024-04-01T19:28:50.798 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.798 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f0cf027:::benchmark_data_smithi188_77607_object160722:head# 2024-04-01T19:28:50.798 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.798 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f0d3065:::benchmark_data_smithi188_77607_object165556:head# 2024-04-01T19:28:50.799 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.799 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f0ee17c:::benchmark_data_smithi188_77607_object111472:head# 2024-04-01T19:28:50.799 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.799 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f0f32b3:::benchmark_data_smithi188_77607_object98995:head# 2024-04-01T19:28:50.799 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.799 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f11742f:::benchmark_data_smithi188_77607_object139759:head# 2024-04-01T19:28:50.799 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.799 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f13514e:::benchmark_data_smithi188_77607_object120147:head# 2024-04-01T19:28:50.799 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.799 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f16b701:::benchmark_data_smithi188_77607_object131173:head# 2024-04-01T19:28:50.799 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.799 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f1819c2:::benchmark_data_smithi188_77607_object161243:head# 2024-04-01T19:28:50.799 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.799 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f18dba8:::benchmark_data_smithi188_77607_object144151:head# 2024-04-01T19:28:50.800 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.800 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f195774:::benchmark_data_smithi188_77607_object118440:head# 2024-04-01T19:28:50.800 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.800 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f19a778:::benchmark_data_smithi188_77607_object159466:head# 2024-04-01T19:28:50.800 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.801 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f1ac452:::benchmark_data_smithi188_77607_object113660:head# 2024-04-01T19:28:50.801 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.801 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f1b8dc3:::benchmark_data_smithi188_77607_object163362:head# 2024-04-01T19:28:50.801 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.801 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f1bb697:::benchmark_data_smithi188_77607_object114129:head# 2024-04-01T19:28:50.801 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.801 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f1c1393:::benchmark_data_smithi188_77607_object144714:head# 2024-04-01T19:28:50.801 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.802 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f1d3620:::benchmark_data_smithi188_77607_object149836:head# 2024-04-01T19:28:50.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.802 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f1ed3bc:::benchmark_data_smithi188_77607_object143481:head# 2024-04-01T19:28:50.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.802 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f1ee1ba:::benchmark_data_smithi188_77607_object151530:head# 2024-04-01T19:28:50.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.802 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f204810:::benchmark_data_smithi188_77607_object102072:head# 2024-04-01T19:28:50.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.802 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f23a00f:::benchmark_data_smithi188_77607_object141702:head# 2024-04-01T19:28:50.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.802 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f257377:::benchmark_data_smithi188_77607_object115304:head# 2024-04-01T19:28:50.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.802 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f283502:::benchmark_data_smithi188_77607_object132483:head# 2024-04-01T19:28:50.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.803 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f29f27a:::benchmark_data_smithi188_77607_object122504:head# 2024-04-01T19:28:50.803 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.803 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f2b4d47:::benchmark_data_smithi188_77607_object158494:head# 2024-04-01T19:28:50.804 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.804 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f2b56b5:::benchmark_data_smithi188_77607_object121159:head# 2024-04-01T19:28:50.804 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.804 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f2bd187:::benchmark_data_smithi188_77607_object128953:head# 2024-04-01T19:28:50.804 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.804 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f2c2c12:::benchmark_data_smithi188_77607_object166148:head# 2024-04-01T19:28:50.804 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.806 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f2c708a:::benchmark_data_smithi188_77607_object139408:head# 2024-04-01T19:28:50.806 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.807 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f2d124c:::benchmark_data_smithi188_77607_object121432:head# 2024-04-01T19:28:50.807 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.807 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f2ded31:::benchmark_data_smithi188_77607_object125627:head# 2024-04-01T19:28:50.807 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.807 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f2f0e0f:::benchmark_data_smithi188_77607_object133210:head# 2024-04-01T19:28:50.807 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.807 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f2fa4d3:::benchmark_data_smithi188_77607_object144710:head# 2024-04-01T19:28:50.807 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.807 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f3166d7:::benchmark_data_smithi188_77607_object108321:head# 2024-04-01T19:28:50.807 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.807 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f31715e:::benchmark_data_smithi188_77607_object167189:head# 2024-04-01T19:28:50.807 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.807 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f3354be:::benchmark_data_smithi188_77607_object134509:head# 2024-04-01T19:28:50.807 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.808 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f33b37c:::benchmark_data_smithi188_77607_object105222:head# 2024-04-01T19:28:50.808 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.808 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f35e81d:::benchmark_data_smithi188_77607_object156122:head# 2024-04-01T19:28:50.808 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.808 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f367972:::benchmark_data_smithi188_77607_object159507:head# 2024-04-01T19:28:50.808 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.808 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f36b315:::benchmark_data_smithi188_77607_object157819:head# 2024-04-01T19:28:50.808 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.808 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f38783a:::benchmark_data_smithi188_77607_object136905:head# 2024-04-01T19:28:50.808 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.808 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f39945a:::benchmark_data_smithi188_77607_object108611:head# 2024-04-01T19:28:50.808 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.808 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f39dac5:::benchmark_data_smithi188_77607_object166899:head# 2024-04-01T19:28:50.808 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.809 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f3a3312:::benchmark_data_smithi188_77607_object108243:head# 2024-04-01T19:28:50.809 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.809 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f3b2ccc:::benchmark_data_smithi188_77607_object129338:head# 2024-04-01T19:28:50.809 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.811 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f3b712d:::benchmark_data_smithi188_77607_object107585:head# 2024-04-01T19:28:50.811 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.811 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f3c5af1:::benchmark_data_smithi188_77607_object116208:head# 2024-04-01T19:28:50.811 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.811 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f3c8911:::benchmark_data_smithi188_77607_object145907:head# 2024-04-01T19:28:50.811 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.811 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f40e35a:::benchmark_data_smithi188_77607_object163525:head# 2024-04-01T19:28:50.812 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.812 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f4253ec:::benchmark_data_smithi188_77607_object118976:head# 2024-04-01T19:28:50.812 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.812 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f42abb6:::benchmark_data_smithi188_77607_object97864:head# 2024-04-01T19:28:50.812 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.812 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f42f3c9:::benchmark_data_smithi188_77607_object160679:head# 2024-04-01T19:28:50.812 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.813 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f43960c:::benchmark_data_smithi188_77607_object132056:head# 2024-04-01T19:28:50.813 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.813 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f44be09:::benchmark_data_smithi188_77607_object161102:head# 2024-04-01T19:28:50.813 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.813 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f454037:::benchmark_data_smithi188_77607_object105487:head# 2024-04-01T19:28:50.813 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.815 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f48b578:::benchmark_data_smithi188_77607_object130306:head# 2024-04-01T19:28:50.815 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.815 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f48fdce:::benchmark_data_smithi188_77607_object123002:head# 2024-04-01T19:28:50.815 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.815 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f4aaf30:::benchmark_data_smithi188_77607_object123585:head# 2024-04-01T19:28:50.815 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.815 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f4b3e4f:::benchmark_data_smithi188_77607_object105415:head# 2024-04-01T19:28:50.815 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.815 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f4ce006:::benchmark_data_smithi188_77607_object104408:head# 2024-04-01T19:28:50.816 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.816 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f4e2fb4:::benchmark_data_smithi188_77607_object111076:head# 2024-04-01T19:28:50.816 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.816 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f4e4084:::benchmark_data_smithi188_77607_object121009:head# 2024-04-01T19:28:50.816 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.817 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f4e8b5e:::benchmark_data_smithi188_77607_object141652:head# 2024-04-01T19:28:50.817 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.817 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f4eccef:::benchmark_data_smithi188_77607_object147418:head# 2024-04-01T19:28:50.817 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.817 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f4fa4ae:::benchmark_data_smithi188_77607_object136205:head# 2024-04-01T19:28:50.817 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.817 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f500bb1:::benchmark_data_smithi188_77607_object125034:head# 2024-04-01T19:28:50.818 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.818 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f52b2ed:::benchmark_data_smithi188_77607_object113405:head# 2024-04-01T19:28:50.818 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.818 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f5469a2:::benchmark_data_smithi188_77607_object149571:head# 2024-04-01T19:28:50.818 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.818 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f553817:::benchmark_data_smithi188_77607_object107960:head# 2024-04-01T19:28:50.818 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.818 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f5580d1:::benchmark_data_smithi188_77607_object157606:head# 2024-04-01T19:28:50.818 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.820 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f558f44:::benchmark_data_smithi188_77607_object125049:head# 2024-04-01T19:28:50.820 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.820 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f567955:::benchmark_data_smithi188_77607_object147427:head# 2024-04-01T19:28:50.820 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.820 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f568a30:::benchmark_data_smithi188_77607_object151793:head# 2024-04-01T19:28:50.820 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.820 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f57d466:::benchmark_data_smithi188_77607_object124298:head# 2024-04-01T19:28:50.820 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.820 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f59a1f8:::benchmark_data_smithi188_77607_object166621:head# 2024-04-01T19:28:50.820 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.821 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f59ba3a:::benchmark_data_smithi188_77607_object150603:head# 2024-04-01T19:28:50.821 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.821 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f59f817:::benchmark_data_smithi188_77607_object155967:head# 2024-04-01T19:28:50.821 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.821 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f59fd9f:::benchmark_data_smithi188_77607_object121391:head# 2024-04-01T19:28:50.821 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.821 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f5ae4b5:::benchmark_data_smithi188_77607_object100306:head# 2024-04-01T19:28:50.822 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.822 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f5eb1aa:::benchmark_data_smithi188_77607_object121610:head# 2024-04-01T19:28:50.822 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.825 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f6091e2:::benchmark_data_smithi188_77607_object144394:head# 2024-04-01T19:28:50.825 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.825 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f6233a6:::benchmark_data_smithi188_77607_object159853:head# 2024-04-01T19:28:50.825 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.825 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f629610:::benchmark_data_smithi188_77607_object134229:head# 2024-04-01T19:28:50.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f631a82:::benchmark_data_smithi188_77607_object156717:head# 2024-04-01T19:28:50.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f633d78:::benchmark_data_smithi188_77607_object160391:head# 2024-04-01T19:28:50.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f63868f:::benchmark_data_smithi188_77607_object151828:head# 2024-04-01T19:28:50.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f665f33:::benchmark_data_smithi188_77607_object106752:head# 2024-04-01T19:28:50.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f671ab2:::benchmark_data_smithi188_77607_object117175:head# 2024-04-01T19:28:50.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f69460d:::benchmark_data_smithi188_77607_object113129:head# 2024-04-01T19:28:50.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f698ee1:::benchmark_data_smithi188_77607_object147282:head# 2024-04-01T19:28:50.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.827 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f69c866:::benchmark_data_smithi188_77607_object116180:head# 2024-04-01T19:28:50.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.827 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f6a93cd:::benchmark_data_smithi188_77607_object127121:head# 2024-04-01T19:28:50.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.829 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f6aaa39:::benchmark_data_smithi188_77607_object120691:head# 2024-04-01T19:28:50.829 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.829 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f6ac249:::benchmark_data_smithi188_77607_object165933:head# 2024-04-01T19:28:50.829 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f6ba32c:::benchmark_data_smithi188_77607_object130166:head# 2024-04-01T19:28:50.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f6e22d2:::benchmark_data_smithi188_77607_object135006:head# 2024-04-01T19:28:50.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f6f85f2:::benchmark_data_smithi188_77607_object102621:head# 2024-04-01T19:28:50.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f710efa:::benchmark_data_smithi188_77607_object104369:head# 2024-04-01T19:28:50.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f71a8cd:::benchmark_data_smithi188_77607_object142013:head# 2024-04-01T19:28:50.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f71b3f2:::benchmark_data_smithi188_77607_object106138:head# 2024-04-01T19:28:50.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f71d9aa:::benchmark_data_smithi188_77607_object147952:head# 2024-04-01T19:28:50.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f71e504:::benchmark_data_smithi188_77607_object126960:head# 2024-04-01T19:28:50.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f7232b5:::benchmark_data_smithi188_77607_object149770:head# 2024-04-01T19:28:50.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f724423:::benchmark_data_smithi188_77607_object163958:head# 2024-04-01T19:28:50.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f727b70:::benchmark_data_smithi188_77607_object101090:head# 2024-04-01T19:28:50.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f73999d:::benchmark_data_smithi188_77607_object166812:head# 2024-04-01T19:28:50.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f76ccd3:::benchmark_data_smithi188_77607_object136657:head# 2024-04-01T19:28:50.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.834 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f770522:::benchmark_data_smithi188_77607_object134390:head# 2024-04-01T19:28:50.834 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.834 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f78e869:::benchmark_data_smithi188_77607_object149327:head# 2024-04-01T19:28:50.834 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.834 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f793f92:::benchmark_data_smithi188_77607_object160137:head# 2024-04-01T19:28:50.834 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.834 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f79582e:::benchmark_data_smithi188_77607_object142102:head# 2024-04-01T19:28:50.834 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.834 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f79aabb:::benchmark_data_smithi188_77607_object108152:head# 2024-04-01T19:28:50.834 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.834 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f7b5232:::benchmark_data_smithi188_77607_object128817:head# 2024-04-01T19:28:50.834 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.835 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f7bd51e:::benchmark_data_smithi188_77607_object105240:head# 2024-04-01T19:28:50.835 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.835 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f7d1ee5:::benchmark_data_smithi188_77607_object134589:head# 2024-04-01T19:28:50.835 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.835 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f7f278f:::benchmark_data_smithi188_77607_object119574:head# 2024-04-01T19:28:50.835 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.835 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f7f9ef8:::benchmark_data_smithi188_77607_object123700:head# 2024-04-01T19:28:50.835 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.835 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f83a2da:::benchmark_data_smithi188_77607_object157144:head# 2024-04-01T19:28:50.835 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.835 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f83a723:::benchmark_data_smithi188_77607_object164814:head# 2024-04-01T19:28:50.835 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.835 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f849401:::benchmark_data_smithi188_77607_object113662:head# 2024-04-01T19:28:50.835 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.835 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f852efb:::benchmark_data_smithi188_77607_object161681:head# 2024-04-01T19:28:50.835 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.836 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f85f1b8:::benchmark_data_smithi188_77607_object102744:head# 2024-04-01T19:28:50.836 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.836 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f881f47:::benchmark_data_smithi188_77607_object115268:head# 2024-04-01T19:28:50.836 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.837 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f8911af:::benchmark_data_smithi188_77607_object146546:head# 2024-04-01T19:28:50.837 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.837 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f897c14:::benchmark_data_smithi188_77607_object153230:head# 2024-04-01T19:28:50.838 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.838 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f899e43:::benchmark_data_smithi188_77607_object156864:head# 2024-04-01T19:28:50.838 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.838 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f8a5136:::benchmark_data_smithi188_77607_object136114:head# 2024-04-01T19:28:50.838 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.838 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f8aa779:::benchmark_data_smithi188_77607_object160830:head# 2024-04-01T19:28:50.838 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.838 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f8b9ed5:::benchmark_data_smithi188_77607_object143911:head# 2024-04-01T19:28:50.838 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.838 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f8c7a63:::benchmark_data_smithi188_77607_object157500:head# 2024-04-01T19:28:50.838 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.838 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f8cfe59:::benchmark_data_smithi188_77607_object163501:head# 2024-04-01T19:28:50.838 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.839 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f8e2701:::benchmark_data_smithi188_77607_object99610:head# 2024-04-01T19:28:50.839 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.839 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f8f0dfc:::benchmark_data_smithi188_77607_object150272:head# 2024-04-01T19:28:50.839 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.839 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f8f6872:::benchmark_data_smithi188_77607_object166673:head# 2024-04-01T19:28:50.839 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.841 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f8fa2a6:::benchmark_data_smithi188_77607_object145364:head# 2024-04-01T19:28:50.841 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.841 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f905df0:::benchmark_data_smithi188_77607_object152584:head# 2024-04-01T19:28:50.841 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.841 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f914267:::benchmark_data_smithi188_77607_object113138:head# 2024-04-01T19:28:50.841 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.841 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f940089:::benchmark_data_smithi188_77607_object166925:head# 2024-04-01T19:28:50.841 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.841 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f9484c6:::benchmark_data_smithi188_77607_object148146:head# 2024-04-01T19:28:50.842 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.842 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f94abee:::benchmark_data_smithi188_77607_object142452:head# 2024-04-01T19:28:50.842 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.842 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f94b30c:::benchmark_data_smithi188_77607_object165114:head# 2024-04-01T19:28:50.842 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.842 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f954eb7:::benchmark_data_smithi188_77607_object162451:head# 2024-04-01T19:28:50.842 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.842 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f95938d:::benchmark_data_smithi188_77607_object130921:head# 2024-04-01T19:28:50.842 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.842 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f95a8dc:::benchmark_data_smithi188_77607_object165448:head# 2024-04-01T19:28:50.842 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.842 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f9648a3:::benchmark_data_smithi188_77607_object108369:head# 2024-04-01T19:28:50.842 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.843 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f96f9e6:::benchmark_data_smithi188_77607_object98241:head# 2024-04-01T19:28:50.843 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.843 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f97c36d:::benchmark_data_smithi188_77607_object137468:head# 2024-04-01T19:28:50.843 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.843 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f98393f:::benchmark_data_smithi188_77607_object147757:head# 2024-04-01T19:28:50.843 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.843 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f9978c2:::benchmark_data_smithi188_77607_object128258:head# 2024-04-01T19:28:50.843 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.845 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f99895b:::benchmark_data_smithi188_77607_object125031:head# 2024-04-01T19:28:50.845 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.845 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f9c6a4b:::benchmark_data_smithi188_77607_object158292:head# 2024-04-01T19:28:50.845 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.846 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f9ca345:::benchmark_data_smithi188_77607_object103834:head# 2024-04-01T19:28:50.846 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.846 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f9caf5e:::benchmark_data_smithi188_77607_object114021:head# 2024-04-01T19:28:50.846 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.846 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6f9d41ea:::benchmark_data_smithi188_77607_object143239:head# 2024-04-01T19:28:50.846 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.846 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fa2d4ef:::benchmark_data_smithi188_77607_object129013:head# 2024-04-01T19:28:50.846 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.846 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fa3367e:::benchmark_data_smithi188_77607_object129911:head# 2024-04-01T19:28:50.846 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.846 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fa3b584:::benchmark_data_smithi188_77607_object161101:head# 2024-04-01T19:28:50.846 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.846 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fa41442:::benchmark_data_smithi188_77607_object149237:head# 2024-04-01T19:28:50.847 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.847 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fa4b94d:::benchmark_data_smithi188_77607_object120346:head# 2024-04-01T19:28:50.847 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.847 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fa5f4ab:::benchmark_data_smithi188_77607_object117500:head# 2024-04-01T19:28:50.847 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.847 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fa684b6:::benchmark_data_smithi188_77607_object131293:head# 2024-04-01T19:28:50.847 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.847 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fa6ba43:::benchmark_data_smithi188_77607_object102205:head# 2024-04-01T19:28:50.847 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.847 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fa7481b:::benchmark_data_smithi188_77607_object117321:head# 2024-04-01T19:28:50.847 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.847 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fa78499:::benchmark_data_smithi188_77607_object102065:head# 2024-04-01T19:28:50.847 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.847 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fa7de20:::benchmark_data_smithi188_77607_object166933:head# 2024-04-01T19:28:50.847 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.849 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fa80c25:::benchmark_data_smithi188_77607_object136433:head# 2024-04-01T19:28:50.849 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fa9e95b:::benchmark_data_smithi188_77607_object99409:head# 2024-04-01T19:28:50.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6faa758a:::benchmark_data_smithi188_77607_object149431:head# 2024-04-01T19:28:50.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6faab6b8:::benchmark_data_smithi188_77607_object141312:head# 2024-04-01T19:28:50.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6faad38d:::benchmark_data_smithi188_77607_object118796:head# 2024-04-01T19:28:50.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fab5314:::benchmark_data_smithi188_77607_object122014:head# 2024-04-01T19:28:50.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fac8570:::benchmark_data_smithi188_77607_object151312:head# 2024-04-01T19:28:50.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fac9372:::benchmark_data_smithi188_77607_object148053:head# 2024-04-01T19:28:50.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fad73d3:::benchmark_data_smithi188_77607_object146230:head# 2024-04-01T19:28:50.851 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.851 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fadef12:::benchmark_data_smithi188_77607_object99094:head# 2024-04-01T19:28:50.851 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.851 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fae0728:::benchmark_data_smithi188_77607_object119288:head# 2024-04-01T19:28:50.851 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.851 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fae34b4:::benchmark_data_smithi188_77607_object133276:head# 2024-04-01T19:28:50.851 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.851 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6faf2814:::benchmark_data_smithi188_77607_object146550:head# 2024-04-01T19:28:50.851 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.851 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fb02e58:::benchmark_data_smithi188_77607_object111213:head# 2024-04-01T19:28:50.851 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.851 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fb02f27:::benchmark_data_smithi188_77607_object109520:head# 2024-04-01T19:28:50.851 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.851 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fb0f47a:::benchmark_data_smithi188_77607_object98060:head# 2024-04-01T19:28:50.851 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.853 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fb2188c:::benchmark_data_smithi188_77607_object137534:head# 2024-04-01T19:28:50.854 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.854 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fb2b2b2:::benchmark_data_smithi188_77607_object111399:head# 2024-04-01T19:28:50.854 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.854 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fb41900:::benchmark_data_smithi188_77607_object132832:head# 2024-04-01T19:28:50.854 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.854 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fb55587:::benchmark_data_smithi188_77607_object111960:head# 2024-04-01T19:28:50.854 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.854 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fb57645:::benchmark_data_smithi188_77607_object117155:head# 2024-04-01T19:28:50.854 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.854 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fb63825:::benchmark_data_smithi188_77607_object160905:head# 2024-04-01T19:28:50.854 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.854 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fb71cb2:::benchmark_data_smithi188_77607_object113021:head# 2024-04-01T19:28:50.854 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fb729ef:::benchmark_data_smithi188_77607_object141884:head# 2024-04-01T19:28:50.855 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fb83a4a:::benchmark_data_smithi188_77607_object102197:head# 2024-04-01T19:28:50.855 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fb95698:::benchmark_data_smithi188_77607_object107800:head# 2024-04-01T19:28:50.855 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fb9d4d5:::benchmark_data_smithi188_77607_object100750:head# 2024-04-01T19:28:50.855 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fbb6b4e:::benchmark_data_smithi188_77607_object121052:head# 2024-04-01T19:28:50.855 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fbc3bf4:::benchmark_data_smithi188_77607_object109330:head# 2024-04-01T19:28:50.855 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fbe7811:::benchmark_data_smithi188_77607_object155908:head# 2024-04-01T19:28:50.855 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fbf5f3d:::benchmark_data_smithi188_77607_object144036:head# 2024-04-01T19:28:50.856 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.859 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fbf9239:::benchmark_data_smithi188_77607_object166156:head# 2024-04-01T19:28:50.859 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.859 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fbfe457:::benchmark_data_smithi188_77607_object127825:head# 2024-04-01T19:28:50.859 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.859 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fc06366:::benchmark_data_smithi188_77607_object159719:head# 2024-04-01T19:28:50.859 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.859 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fc07c4d:::benchmark_data_smithi188_77607_object104534:head# 2024-04-01T19:28:50.859 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.859 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fc2a7ea:::benchmark_data_smithi188_77607_object106952:head# 2024-04-01T19:28:50.859 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.859 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fc32532:::benchmark_data_smithi188_77607_object142385:head# 2024-04-01T19:28:50.859 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.859 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fc7623e:::benchmark_data_smithi188_77607_object153061:head# 2024-04-01T19:28:50.860 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.860 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fc8364c:::benchmark_data_smithi188_77607_object144385:head# 2024-04-01T19:28:50.860 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.860 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fc8d7c2:::benchmark_data_smithi188_77607_object165908:head# 2024-04-01T19:28:50.860 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.861 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fcaab6c:::benchmark_data_smithi188_77607_object107644:head# 2024-04-01T19:28:50.861 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.861 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fce16f8:::benchmark_data_smithi188_77607_object135571:head# 2024-04-01T19:28:50.861 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.861 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fd2d31a:::benchmark_data_smithi188_77607_object158579:head# 2024-04-01T19:28:50.861 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.861 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fd3ac9e:::benchmark_data_smithi188_77607_object133704:head# 2024-04-01T19:28:50.862 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.862 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fd3e3b0:::benchmark_data_smithi188_77607_object141954:head# 2024-04-01T19:28:50.862 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.862 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fd4474e:::benchmark_data_smithi188_77607_object143203:head# 2024-04-01T19:28:50.862 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.862 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fd4b9be:::benchmark_data_smithi188_77607_object136194:head# 2024-04-01T19:28:50.862 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.862 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fd4d7b1:::benchmark_data_smithi188_77607_object100917:head# 2024-04-01T19:28:50.862 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.863 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fd71f65:::benchmark_data_smithi188_77607_object109942:head# 2024-04-01T19:28:50.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fd74fea:::benchmark_data_smithi188_77607_object144915:head# 2024-04-01T19:28:50.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fd7bab1:::benchmark_data_smithi188_77607_object148894:head# 2024-04-01T19:28:50.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fd8464e:::benchmark_data_smithi188_77607_object103980:head# 2024-04-01T19:28:50.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fd9aeb3:::benchmark_data_smithi188_77607_object146671:head# 2024-04-01T19:28:50.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fdb22c7:::benchmark_data_smithi188_77607_object130328:head# 2024-04-01T19:28:50.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fdbacab:::benchmark_data_smithi188_77607_object151956:head# 2024-04-01T19:28:50.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.865 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fdc56bc:::benchmark_data_smithi188_77607_object144662:head# 2024-04-01T19:28:50.865 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.867 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fe0118f:::benchmark_data_smithi188_77607_object114720:head# 2024-04-01T19:28:50.867 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.867 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fe0799d:::benchmark_data_smithi188_77607_object156215:head# 2024-04-01T19:28:50.867 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.868 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fe23dfa:::benchmark_data_smithi188_77607_object148243:head# 2024-04-01T19:28:50.868 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.868 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fe28547:::benchmark_data_smithi188_77607_object122511:head# 2024-04-01T19:28:50.868 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.868 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fe2f370:::benchmark_data_smithi188_77607_object129653:head# 2024-04-01T19:28:50.868 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.868 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fe4bce4:::benchmark_data_smithi188_77607_object166404:head# 2024-04-01T19:28:50.868 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.868 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fe4f355:::benchmark_data_smithi188_77607_object143438:head# 2024-04-01T19:28:50.868 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.868 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fe5d7e9:::benchmark_data_smithi188_77607_object104987:head# 2024-04-01T19:28:50.868 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fe80580:::benchmark_data_smithi188_77607_object122614:head# 2024-04-01T19:28:50.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fe8df3d:::benchmark_data_smithi188_77607_object156347:head# 2024-04-01T19:28:50.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fe98428:::benchmark_data_smithi188_77607_object146437:head# 2024-04-01T19:28:50.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fead80e:::benchmark_data_smithi188_77607_object98290:head# 2024-04-01T19:28:50.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6febb0ad:::benchmark_data_smithi188_77607_object131860:head# 2024-04-01T19:28:50.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fec5eca:::benchmark_data_smithi188_77607_object117922:head# 2024-04-01T19:28:50.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.870 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6fecbf28:::benchmark_data_smithi188_77607_object116370:head# 2024-04-01T19:28:50.870 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.870 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ff049d2:::benchmark_data_smithi188_77607_object135977:head# 2024-04-01T19:28:50.870 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.871 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ff15db7:::benchmark_data_smithi188_77607_object163337:head# 2024-04-01T19:28:50.872 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.872 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ff30e48:::benchmark_data_smithi188_77607_object100360:head# 2024-04-01T19:28:50.872 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.872 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ff6abf4:::benchmark_data_smithi188_77607_object102592:head# 2024-04-01T19:28:50.872 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.872 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ff7a484:::benchmark_data_smithi188_77607_object135297:head# 2024-04-01T19:28:50.872 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.872 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ff88981:::benchmark_data_smithi188_77607_object137385:head# 2024-04-01T19:28:50.872 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.872 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ff8df5b:::benchmark_data_smithi188_77607_object133367:head# 2024-04-01T19:28:50.873 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.873 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ffa21bb:::benchmark_data_smithi188_77607_object163488:head# 2024-04-01T19:28:50.873 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.873 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ffaa492:::benchmark_data_smithi188_77607_object152387:head# 2024-04-01T19:28:50.873 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.873 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ffaff2b:::benchmark_data_smithi188_77607_object133395:head# 2024-04-01T19:28:50.873 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.873 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ffc7441:::benchmark_data_smithi188_77607_object155978:head# 2024-04-01T19:28:50.873 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.873 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ffd8e2a:::benchmark_data_smithi188_77607_object151388:head# 2024-04-01T19:28:50.873 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.873 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ffdb421:::benchmark_data_smithi188_77607_object132357:head# 2024-04-01T19:28:50.874 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.874 INFO:teuthology.orchestra.run.smithi188.stdout:Write #2:6ffe0cf6:::benchmark_data_smithi188_77607_object125439:head# 2024-04-01T19:28:50.874 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:28:50.879 INFO:teuthology.orchestra.run.smithi188.stdout:write_pg epoch 159 info 2.6( v 159'16591 (128'6500,159'16591] local-lis/les=106/107 n=4357 ec=106/106 lis/c=106/106 les/c/f=107/107/0 sis=106) 2024-04-01T19:28:50.950 INFO:teuthology.orchestra.run.smithi188.stdout:Import successful 2024-04-01T19:28:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:51.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:28:52.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:51 smithi188 ceph-mon[43939]: pgmap v537: 17 pgs: 17 active+clean; 3.6 GiB data, 8.1 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:28:52.215 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/exp.2.6.8 2024-04-01T19:28:52.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:51 smithi062 ceph-mon[44211]: pgmap v537: 17 pgs: 17 active+clean; 3.6 GiB data, 8.1 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:28:52.335 INFO:tasks.thrashosds.thrasher:Waiting for clean again 2024-04-01T19:28:52.336 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-01T19:28:52.336 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:28:52.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:51 smithi022 ceph-mon[39439]: pgmap v537: 17 pgs: 17 active+clean; 3.6 GiB data, 8.1 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:28:54.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:53 smithi062 ceph-mon[44211]: pgmap v538: 17 pgs: 17 active+clean; 3.5 GiB data, 7.8 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:28:54.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:53 smithi022 ceph-mon[39439]: pgmap v538: 17 pgs: 17 active+clean; 3.5 GiB data, 7.8 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:28:54.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:53 smithi188 ceph-mon[43939]: pgmap v538: 17 pgs: 17 active+clean; 3.5 GiB data, 7.8 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:28:55.089 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:28:55.101 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:55.101 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:28:55.202 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:28:55.235 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:55.260 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:28:55.262 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:55.263 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:28:55.364 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:28:55.403 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:55.429 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:28:55.432 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:55.433 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:28:55.534 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:28:55.592 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:56.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:55 smithi062 ceph-mon[44211]: pgmap v539: 17 pgs: 17 active+clean; 3.3 GiB data, 7.5 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:28:56.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:55 smithi022 ceph-mon[39439]: pgmap v539: 17 pgs: 17 active+clean; 3.3 GiB data, 7.5 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:28:56.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:55 smithi188 ceph-mon[43939]: pgmap v539: 17 pgs: 17 active+clean; 3.3 GiB data, 7.5 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:28:57.837 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:28:57.838 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:28:57.851 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:28:58.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:57 smithi022 ceph-mon[39439]: pgmap v540: 17 pgs: 17 active+clean; 3.1 GiB data, 7.2 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.24k op/s 2024-04-01T19:28:58.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:57 smithi062 ceph-mon[44211]: pgmap v540: 17 pgs: 17 active+clean; 3.1 GiB data, 7.2 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.24k op/s 2024-04-01T19:28:58.368 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:28:58.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:57 smithi188 ceph-mon[43939]: pgmap v540: 17 pgs: 17 active+clean; 3.1 GiB data, 7.2 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.24k op/s 2024-04-01T19:28:58.378 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:58.379 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:28:58.480 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:28:58.549 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:58.692 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:28:58.692 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:28:59.225 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:28:59.233 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:59.233 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:28:59.233 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:28:59.335 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:28:59.385 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:59.469 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:28:59.480 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:59.481 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:28:59.582 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:28:59.613 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:59.640 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:28:59.643 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:28:59.643 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:28:59.744 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:28:59.796 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:28:59.839 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:28:59.974 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_historic_ops 2024-04-01T19:29:00.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:28:59 smithi022 ceph-mon[39439]: pgmap v541: 17 pgs: 17 active+clean; 3.0 GiB data, 7.0 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:29:00.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:28:59 smithi062 ceph-mon[44211]: pgmap v541: 17 pgs: 17 active+clean; 3.0 GiB data, 7.0 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:29:00.281 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:29:00.290 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:00.291 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:29:00.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:28:59 smithi188 ceph-mon[43939]: pgmap v541: 17 pgs: 17 active+clean; 3.0 GiB data, 7.0 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:29:00.392 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:29:00.426 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:00.454 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:29:00.460 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:00.460 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:29:00.561 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:29:00.591 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:00.616 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:29:00.620 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:00.620 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:29:00.721 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:29:00.749 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:00.772 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:29:00.774 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:00.775 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:29:00.876 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:29:00.907 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:00.939 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:29:00.942 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:00.942 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:29:01.043 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:29:01.101 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:01.157 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:29:01.165 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:01.166 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:29:01.267 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:29:01.299 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:01.323 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:29:01.327 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:01.327 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:29:01.428 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:29:01.495 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:01.610 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:29:01.638 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:01.639 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:29:01.740 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:29:01.805 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:02.031 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:29:02.034 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:29:02.037 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:02.038 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:29:02.070 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:29:02.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:02 smithi022 ceph-mon[39439]: pgmap v542: 17 pgs: 17 active+clean; 2.8 GiB data, 6.6 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.39k op/s 2024-04-01T19:29:02.090 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:02 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1814380050' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:29:02.090 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:02 smithi022 ceph-mon[39439]: from='client.25024 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:29:02.096 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:29:02.139 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:29:02.168 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:02.200 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:29:02.203 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:02.203 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:29:02.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:02 smithi062 ceph-mon[44211]: pgmap v542: 17 pgs: 17 active+clean; 2.8 GiB data, 6.6 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.39k op/s 2024-04-01T19:29:02.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:02 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1814380050' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:29:02.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:02 smithi062 ceph-mon[44211]: from='client.25024 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:29:02.304 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:29:02.335 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:02.358 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:29:02.360 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:02.361 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:29:02.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:02 smithi188 ceph-mon[43939]: pgmap v542: 17 pgs: 17 active+clean; 2.8 GiB data, 6.6 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.39k op/s 2024-04-01T19:29:02.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:02 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1814380050' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:29:02.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:02 smithi188 ceph-mon[43939]: from='client.25024 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:29:02.462 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:29:02.526 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:03.120 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:03 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:29:03.120 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:03 smithi022 ceph-mon[39439]: from='client.25024 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:29:03.120 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:03 smithi022 ceph-mon[39439]: osdmap e178: 12 total, 11 up, 11 in 2024-04-01T19:29:03.120 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:03 smithi022 ceph-mon[39439]: 2.c scrub starts 2024-04-01T19:29:03.120 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:03 smithi022 ceph-mon[39439]: 2.5 scrub starts 2024-04-01T19:29:03.120 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:03 smithi022 ceph-mon[39439]: 2.c scrub ok 2024-04-01T19:29:03.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:03 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:29:03.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:03 smithi062 ceph-mon[44211]: from='client.25024 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:29:03.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:03 smithi062 ceph-mon[44211]: osdmap e178: 12 total, 11 up, 11 in 2024-04-01T19:29:03.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:03 smithi062 ceph-mon[44211]: 2.c scrub starts 2024-04-01T19:29:03.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:03 smithi062 ceph-mon[44211]: 2.5 scrub starts 2024-04-01T19:29:03.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:03 smithi062 ceph-mon[44211]: 2.c scrub ok 2024-04-01T19:29:03.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:03 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:29:03.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:03 smithi188 ceph-mon[43939]: from='client.25024 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:29:03.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:03 smithi188 ceph-mon[43939]: osdmap e178: 12 total, 11 up, 11 in 2024-04-01T19:29:03.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:03 smithi188 ceph-mon[43939]: 2.c scrub starts 2024-04-01T19:29:03.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:03 smithi188 ceph-mon[43939]: 2.5 scrub starts 2024-04-01T19:29:03.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:03 smithi188 ceph-mon[43939]: 2.c scrub ok 2024-04-01T19:29:04.312 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:04 smithi022 ceph-mon[39439]: pgmap v544: 17 pgs: 17 active+clean; 2.7 GiB data, 6.3 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.26k op/s 2024-04-01T19:29:04.312 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:04 smithi022 ceph-mon[39439]: 2.5 scrub ok 2024-04-01T19:29:04.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:04 smithi188 ceph-mon[43939]: pgmap v544: 17 pgs: 17 active+clean; 2.7 GiB data, 6.3 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.26k op/s 2024-04-01T19:29:04.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:04 smithi188 ceph-mon[43939]: 2.5 scrub ok 2024-04-01T19:29:04.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:04 smithi062 ceph-mon[44211]: pgmap v544: 17 pgs: 17 active+clean; 2.7 GiB data, 6.3 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.26k op/s 2024-04-01T19:29:04.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:04 smithi062 ceph-mon[44211]: 2.5 scrub ok 2024-04-01T19:29:05.683 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:29:05.687 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:05.687 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:29:05.788 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:29:05.850 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:05.852 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:29:05.887 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:29:06.026 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:29:06.040 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:06.040 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:29:06.052 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:29:06.141 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:29:06.174 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:06.198 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:29:06.201 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:06.201 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:29:06.302 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:29:06.334 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:06 smithi062 ceph-mon[44211]: pgmap v545: 17 pgs: 17 active+clean; 2.5 GiB data, 6.0 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:29:06.334 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:06 smithi062 ceph-mon[44211]: 2.8 scrub starts 2024-04-01T19:29:06.335 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:06 smithi062 ceph-mon[44211]: 2.b scrub starts 2024-04-01T19:29:06.335 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:06 smithi062 ceph-mon[44211]: 2.1 scrub starts 2024-04-01T19:29:06.335 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:06 smithi062 ceph-mon[44211]: 2.b scrub ok 2024-04-01T19:29:06.337 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:06.359 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:29:06.363 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:06.363 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:29:06.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:06 smithi022 ceph-mon[39439]: pgmap v545: 17 pgs: 17 active+clean; 2.5 GiB data, 6.0 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:29:06.370 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:06 smithi022 ceph-mon[39439]: 2.8 scrub starts 2024-04-01T19:29:06.370 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:06 smithi022 ceph-mon[39439]: 2.b scrub starts 2024-04-01T19:29:06.370 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:06 smithi022 ceph-mon[39439]: 2.1 scrub starts 2024-04-01T19:29:06.370 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:06 smithi022 ceph-mon[39439]: 2.b scrub ok 2024-04-01T19:29:06.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:06 smithi188 ceph-mon[43939]: pgmap v545: 17 pgs: 17 active+clean; 2.5 GiB data, 6.0 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:29:06.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:06 smithi188 ceph-mon[43939]: 2.8 scrub starts 2024-04-01T19:29:06.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:06 smithi188 ceph-mon[43939]: 2.b scrub starts 2024-04-01T19:29:06.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:06 smithi188 ceph-mon[43939]: 2.1 scrub starts 2024-04-01T19:29:06.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:06 smithi188 ceph-mon[43939]: 2.b scrub ok 2024-04-01T19:29:06.464 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:29:06.497 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:06.525 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:29:06.529 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:06.530 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:29:06.631 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:29:06.685 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:29:06.685 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:29:06.695 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:06.869 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:29:06.872 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:06.872 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:29:06.973 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:29:07.020 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:07.072 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:29:07.087 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:07.088 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:29:07.124 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:07 smithi022 ceph-mon[39439]: 2.8 scrub ok 2024-04-01T19:29:07.124 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:07 smithi022 ceph-mon[39439]: from='client.15141 v1:172.21.15.22:0/4176018087' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:29:07.124 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:07 smithi022 ceph-mon[39439]: 2.1 scrub ok 2024-04-01T19:29:07.124 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:07 smithi022 ceph-mon[39439]: 2.a scrub starts 2024-04-01T19:29:07.124 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:07 smithi022 ceph-mon[39439]: 2.e scrub starts 2024-04-01T19:29:07.124 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:07 smithi022 ceph-mon[39439]: 2.a scrub ok 2024-04-01T19:29:07.189 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:29:07.252 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:07.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:07 smithi188 ceph-mon[43939]: 2.8 scrub ok 2024-04-01T19:29:07.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:07 smithi188 ceph-mon[43939]: from='client.15141 v1:172.21.15.22:0/4176018087' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:29:07.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:07 smithi188 ceph-mon[43939]: 2.1 scrub ok 2024-04-01T19:29:07.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:07 smithi188 ceph-mon[43939]: 2.a scrub starts 2024-04-01T19:29:07.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:07 smithi188 ceph-mon[43939]: 2.e scrub starts 2024-04-01T19:29:07.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:07 smithi188 ceph-mon[43939]: 2.a scrub ok 2024-04-01T19:29:07.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:07 smithi062 ceph-mon[44211]: 2.8 scrub ok 2024-04-01T19:29:07.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:07 smithi062 ceph-mon[44211]: from='client.15141 v1:172.21.15.22:0/4176018087' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:29:07.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:07 smithi062 ceph-mon[44211]: 2.1 scrub ok 2024-04-01T19:29:07.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:07 smithi062 ceph-mon[44211]: 2.a scrub starts 2024-04-01T19:29:07.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:07 smithi062 ceph-mon[44211]: 2.e scrub starts 2024-04-01T19:29:07.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:07 smithi062 ceph-mon[44211]: 2.a scrub ok 2024-04-01T19:29:07.633 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":545,"stamp":"2024-04-01T19:29:04.731783+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2737504824,"num_objects":41765,"num_object_clones":0,"num_object_copies":83530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41765,"num_whiteouts":0,"num_read":127,"num_read_kb":110,"num_write":293222,"num_write_kb":10716603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17422,"num_bytes_recovered":1143359616,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160884,"ondisk_log_size":160884,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":11,"num_per_pool_osds":11,"num_per_pool_omap_osds":11,"kb":1031196672,"kb_used":6326168,"kb_used_data":5420788,"kb_used_omap":17,"kb_used_meta":905070,"kb_avail":1024870504,"statfs":{"total":1055945392128,"available":1049467396096,"internally_reserved":0,"allocated":5550886912,"data_stored":5547236631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17548,"internal_metadata":926792564},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-817758208,"num_objects":-12478,"num_object_clones":0,"num_object_copies":-24956,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-12478,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12478,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.005337"},"pg_stats":[{"pgid":"2.f","version":"178'20744","reported_seq":29832,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:04.661337+0000","last_change":"2024-04-01T19:28:39.875202+0000","last_active":"2024-04-01T19:29:04.661337+0000","last_peered":"2024-04-01T19:29:04.661337+0000","last_clean":"2024-04-01T19:29:04.661337+0000","last_became_active":"2024-04-01T19:28:39.833695+0000","last_became_peered":"2024-04-01T19:28:39.833695+0000","last_unstale":"2024-04-01T19:29:04.661337+0000","last_undegraded":"2024-04-01T19:29:04.661337+0000","last_fullsized":"2024-04-01T19:29:04.661337+0000","mapping_epoch":175,"log_start":"138'10702","ondisk_log_start":"138'10702","created":106,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'15495","last_scrub_stamp":"2024-04-01T19:27:13.306569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:13.306569+0000","objects_scrubbed":7722,"log_size":10042,"log_dups_size":0,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1481,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158728192,"num_objects":2422,"num_object_clones":0,"num_object_copies":4844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2422,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18310,"num_write_kb":663424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4356,"num_bytes_recovered":285474816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4],"acting":[9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"178'21613","reported_seq":22080,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:04.669368+0000","last_change":"2024-04-01T19:28:11.557704+0000","last_active":"2024-04-01T19:29:04.669368+0000","last_peered":"2024-04-01T19:29:04.669368+0000","last_clean":"2024-04-01T19:29:04.669368+0000","last_became_active":"2024-04-01T19:24:52.198710+0000","last_became_peered":"2024-04-01T19:24:52.198710+0000","last_unstale":"2024-04-01T19:29:04.669368+0000","last_undegraded":"2024-04-01T19:29:04.669368+0000","last_fullsized":"2024-04-01T19:29:04.669368+0000","mapping_epoch":106,"log_start":"138'11600","ondisk_log_start":"138'11600","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'19786","last_scrub_stamp":"2024-04-01T19:28:11.557573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:28:11.557573+0000","objects_scrubbed":4192,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:29:34.932180+0000","scrub_duration":350,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154992640,"num_objects":2365,"num_object_clones":0,"num_object_copies":4730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2365,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18393,"num_write_kb":664256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"177'17943","reported_seq":18262,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-04-01T19:29:00.574277+0000","last_change":"2024-04-01T19:27:36.619478+0000","last_active":"2024-04-01T19:29:00.574277+0000","last_peered":"2024-04-01T19:29:00.574277+0000","last_clean":"2024-04-01T19:29:00.574277+0000","last_became_active":"2024-04-01T19:24:51.845054+0000","last_became_peered":"2024-04-01T19:24:51.845054+0000","last_unstale":"2024-04-01T19:29:00.574277+0000","last_undegraded":"2024-04-01T19:29:00.574277+0000","last_fullsized":"2024-04-01T19:29:00.574277+0000","mapping_epoch":106,"log_start":"130'7900","ondisk_log_start":"130'7900","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'14661","last_scrub_stamp":"2024-04-01T19:27:36.619317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:36.619317+0000","objects_scrubbed":6078,"log_size":10043,"log_dups_size":0,"ondisk_log_size":10043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181207040,"num_objects":2765,"num_object_clones":0,"num_object_copies":5530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2765,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17943,"num_write_kb":662656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"177'18183","reported_seq":18499,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-04-01T19:29:01.456715+0000","last_change":"2024-04-01T19:27:33.457495+0000","last_active":"2024-04-01T19:29:01.456715+0000","last_peered":"2024-04-01T19:29:01.456715+0000","last_clean":"2024-04-01T19:29:01.456715+0000","last_became_active":"2024-04-01T19:24:51.840851+0000","last_became_peered":"2024-04-01T19:24:51.840851+0000","last_unstale":"2024-04-01T19:29:01.456715+0000","last_undegraded":"2024-04-01T19:29:01.456715+0000","last_fullsized":"2024-04-01T19:29:01.456715+0000","mapping_epoch":106,"log_start":"130'8100","ondisk_log_start":"130'8100","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'14702","last_scrub_stamp":"2024-04-01T19:27:33.457312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:33.457312+0000","objects_scrubbed":6191,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:29:03.172393+0000","scrub_duration":1171,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174653440,"num_objects":2665,"num_object_clones":0,"num_object_copies":5330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2665,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18183,"num_write_kb":667136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"177'18130","reported_seq":18443,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-04-01T19:29:00.591851+0000","last_change":"2024-04-01T19:27:41.363036+0000","last_active":"2024-04-01T19:29:00.591851+0000","last_peered":"2024-04-01T19:29:00.591851+0000","last_clean":"2024-04-01T19:29:00.591851+0000","last_became_active":"2024-04-01T19:24:51.845477+0000","last_became_peered":"2024-04-01T19:24:51.845477+0000","last_unstale":"2024-04-01T19:29:00.591851+0000","last_undegraded":"2024-04-01T19:29:00.591851+0000","last_fullsized":"2024-04-01T19:29:00.591851+0000","mapping_epoch":106,"log_start":"130'8100","ondisk_log_start":"130'8100","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'15150","last_scrub_stamp":"2024-04-01T19:27:41.362851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:41.362851+0000","objects_scrubbed":5722,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":794,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178388992,"num_objects":2722,"num_object_clones":0,"num_object_copies":5444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2722,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18130,"num_write_kb":667264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":527,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:01.999892+0000","last_change":"2024-04-01T19:27:41.709212+0000","last_active":"2024-04-01T19:29:01.999892+0000","last_peered":"2024-04-01T19:29:01.999892+0000","last_clean":"2024-04-01T19:29:01.999892+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:29:01.999892+0000","last_undegraded":"2024-04-01T19:29:01.999892+0000","last_fullsized":"2024-04-01T19:29:01.999892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:27:41.709127+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:29:06.728713+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"178'18736","reported_seq":19138,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:02.946390+0000","last_change":"2024-04-01T19:28:28.136349+0000","last_active":"2024-04-01T19:29:02.946390+0000","last_peered":"2024-04-01T19:29:02.946390+0000","last_clean":"2024-04-01T19:29:02.946390+0000","last_became_active":"2024-04-01T19:24:51.846976+0000","last_became_peered":"2024-04-01T19:24:51.846976+0000","last_unstale":"2024-04-01T19:29:02.946390+0000","last_undegraded":"2024-04-01T19:29:02.946390+0000","last_fullsized":"2024-04-01T19:29:02.946390+0000","mapping_epoch":106,"log_start":"132'8700","ondisk_log_start":"132'8700","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'16933","last_scrub_stamp":"2024-04-01T19:28:28.136219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:28:28.136219+0000","objects_scrubbed":4387,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:29:52.961256+0000","scrub_duration":398,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169345024,"num_objects":2584,"num_object_clones":0,"num_object_copies":5168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2584,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18736,"num_write_kb":682240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10],"acting":[7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"177'17960","reported_seq":26936,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-04-01T19:28:59.995580+0000","last_change":"2024-04-01T19:28:38.862025+0000","last_active":"2024-04-01T19:28:59.995580+0000","last_peered":"2024-04-01T19:28:59.995580+0000","last_clean":"2024-04-01T19:28:59.995580+0000","last_became_active":"2024-04-01T19:28:38.830702+0000","last_became_peered":"2024-04-01T19:28:38.830702+0000","last_unstale":"2024-04-01T19:28:59.995580+0000","last_undegraded":"2024-04-01T19:28:59.995580+0000","last_fullsized":"2024-04-01T19:28:59.995580+0000","mapping_epoch":174,"log_start":"130'7900","ondisk_log_start":"130'7900","created":106,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'14839","last_scrub_stamp":"2024-04-01T19:27:37.103325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:37.103325+0000","objects_scrubbed":5930,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1351,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181141504,"num_objects":2764,"num_object_clones":0,"num_object_copies":5528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2764,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17960,"num_write_kb":663168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4319,"num_bytes_recovered":283049984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"178'18501","reported_seq":27538,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:04.636871+0000","last_change":"2024-04-01T19:28:37.861105+0000","last_active":"2024-04-01T19:29:04.636871+0000","last_peered":"2024-04-01T19:29:04.636871+0000","last_clean":"2024-04-01T19:29:04.636871+0000","last_became_active":"2024-04-01T19:28:37.823569+0000","last_became_peered":"2024-04-01T19:28:37.823569+0000","last_unstale":"2024-04-01T19:29:04.636871+0000","last_undegraded":"2024-04-01T19:29:04.636871+0000","last_fullsized":"2024-04-01T19:29:04.636871+0000","mapping_epoch":173,"log_start":"131'8500","ondisk_log_start":"131'8500","created":106,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'15341","last_scrub_stamp":"2024-04-01T19:27:42.412194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:42.412194+0000","objects_scrubbed":5632,"log_size":10001,"log_dups_size":0,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:29:08.749500+0000","scrub_duration":963,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160366592,"num_objects":2447,"num_object_clones":0,"num_object_copies":4894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18501,"num_write_kb":670336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4355,"num_bytes_recovered":285409280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"178'18522","reported_seq":18845,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:02.353215+0000","last_change":"2024-04-01T19:27:36.388074+0000","last_active":"2024-04-01T19:29:02.353215+0000","last_peered":"2024-04-01T19:29:02.353215+0000","last_clean":"2024-04-01T19:29:02.353215+0000","last_became_active":"2024-04-01T19:24:51.841813+0000","last_became_peered":"2024-04-01T19:24:51.841813+0000","last_unstale":"2024-04-01T19:29:02.353215+0000","last_undegraded":"2024-04-01T19:29:02.353215+0000","last_fullsized":"2024-04-01T19:29:02.353215+0000","mapping_epoch":106,"log_start":"130'8500","ondisk_log_start":"130'8500","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'15042","last_scrub_stamp":"2024-04-01T19:27:36.387914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:36.387914+0000","objects_scrubbed":6121,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:29:06.238612+0000","scrub_duration":957,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171180032,"num_objects":2612,"num_object_clones":0,"num_object_copies":5224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2612,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18522,"num_write_kb":676288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.8","version":"178'18372","reported_seq":18697,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:02.944542+0000","last_change":"2024-04-01T19:27:34.704805+0000","last_active":"2024-04-01T19:29:02.944542+0000","last_peered":"2024-04-01T19:29:02.944542+0000","last_clean":"2024-04-01T19:29:02.944542+0000","last_became_active":"2024-04-01T19:24:51.846809+0000","last_became_peered":"2024-04-01T19:24:51.846809+0000","last_unstale":"2024-04-01T19:29:02.944542+0000","last_undegraded":"2024-04-01T19:29:02.944542+0000","last_fullsized":"2024-04-01T19:29:02.944542+0000","mapping_epoch":106,"log_start":"130'8300","ondisk_log_start":"130'8300","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'14875","last_scrub_stamp":"2024-04-01T19:27:34.704678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:34.704678+0000","objects_scrubbed":6151,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":917,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172359680,"num_objects":2630,"num_object_clones":0,"num_object_copies":5260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2630,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18372,"num_write_kb":672064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.9","version":"178'18568","reported_seq":18887,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:04.651707+0000","last_change":"2024-04-01T19:27:37.638095+0000","last_active":"2024-04-01T19:29:04.651707+0000","last_peered":"2024-04-01T19:29:04.651707+0000","last_clean":"2024-04-01T19:29:04.651707+0000","last_became_active":"2024-04-01T19:24:51.844271+0000","last_became_peered":"2024-04-01T19:24:51.844271+0000","last_unstale":"2024-04-01T19:29:04.651707+0000","last_undegraded":"2024-04-01T19:29:04.651707+0000","last_fullsized":"2024-04-01T19:29:04.651707+0000","mapping_epoch":106,"log_start":"130'8500","ondisk_log_start":"130'8500","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'15055","last_scrub_stamp":"2024-04-01T19:27:37.637816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:37.637816+0000","objects_scrubbed":5942,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1230,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156237824,"num_objects":2384,"num_object_clones":0,"num_object_copies":4768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2384,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18568,"num_write_kb":670464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"177'18186","reported_seq":18510,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-04-01T19:29:00.127881+0000","last_change":"2024-04-01T19:27:34.480317+0000","last_active":"2024-04-01T19:29:00.127881+0000","last_peered":"2024-04-01T19:29:00.127881+0000","last_clean":"2024-04-01T19:29:00.127881+0000","last_became_active":"2024-04-01T19:24:51.842274+0000","last_became_peered":"2024-04-01T19:24:51.842274+0000","last_unstale":"2024-04-01T19:29:00.127881+0000","last_undegraded":"2024-04-01T19:29:00.127881+0000","last_fullsized":"2024-04-01T19:29:00.127881+0000","mapping_epoch":106,"log_start":"130'8100","ondisk_log_start":"130'8100","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'14767","last_scrub_stamp":"2024-04-01T19:27:34.480145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:34.480145+0000","objects_scrubbed":6215,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:29:02.512702+0000","scrub_duration":1477,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180092928,"num_objects":2748,"num_object_clones":0,"num_object_copies":5496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2748,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18186,"num_write_kb":669888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.b","version":"177'21456","reported_seq":30630,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-04-01T19:29:00.109254+0000","last_change":"2024-04-01T19:28:39.876784+0000","last_active":"2024-04-01T19:29:00.109254+0000","last_peered":"2024-04-01T19:29:00.109254+0000","last_clean":"2024-04-01T19:29:00.109254+0000","last_became_active":"2024-04-01T19:28:39.835560+0000","last_became_peered":"2024-04-01T19:28:39.835560+0000","last_unstale":"2024-04-01T19:29:00.109254+0000","last_undegraded":"2024-04-01T19:29:00.109254+0000","last_fullsized":"2024-04-01T19:29:00.109254+0000","mapping_epoch":175,"log_start":"144'11400","ondisk_log_start":"144'11400","created":106,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"135'9592","last_scrub_stamp":"2024-04-01T19:26:18.652305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:26:18.652305+0000","objects_scrubbed":3280,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:29:03.046406+0000","scrub_duration":1886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181403648,"num_objects":2768,"num_object_clones":0,"num_object_copies":5536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2768,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18176,"num_write_kb":670208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4384,"num_bytes_recovered":287309824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.c","version":"177'18249","reported_seq":18570,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-04-01T19:29:00.057956+0000","last_change":"2024-04-01T19:27:33.489195+0000","last_active":"2024-04-01T19:29:00.057956+0000","last_peered":"2024-04-01T19:29:00.057956+0000","last_clean":"2024-04-01T19:29:00.057956+0000","last_became_active":"2024-04-01T19:24:52.198867+0000","last_became_peered":"2024-04-01T19:24:52.198867+0000","last_unstale":"2024-04-01T19:29:00.057956+0000","last_undegraded":"2024-04-01T19:29:00.057956+0000","last_fullsized":"2024-04-01T19:29:00.057956+0000","mapping_epoch":106,"log_start":"130'8200","ondisk_log_start":"130'8200","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'14706","last_scrub_stamp":"2024-04-01T19:27:33.489026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:33.489026+0000","objects_scrubbed":6402,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184090624,"num_objects":2809,"num_object_clones":0,"num_object_copies":5618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2809,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18249,"num_write_kb":673856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.d","version":"178'21462","reported_seq":21900,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:04.673157+0000","last_change":"2024-04-01T19:28:13.878569+0000","last_active":"2024-04-01T19:29:04.673157+0000","last_peered":"2024-04-01T19:29:04.673157+0000","last_clean":"2024-04-01T19:29:04.673157+0000","last_became_active":"2024-04-01T19:24:51.843633+0000","last_became_peered":"2024-04-01T19:24:51.843633+0000","last_unstale":"2024-04-01T19:29:04.673157+0000","last_undegraded":"2024-04-01T19:29:04.673157+0000","last_fullsized":"2024-04-01T19:29:04.673157+0000","mapping_epoch":106,"log_start":"144'11401","ondisk_log_start":"144'11401","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'19571","last_scrub_stamp":"2024-04-01T19:28:13.878445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:28:13.878445+0000","objects_scrubbed":4278,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:29:17.064425+0000","scrub_duration":460,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156368920,"num_objects":2387,"num_object_clones":0,"num_object_copies":4774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2387,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":18289,"num_write_kb":661569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4],"acting":[9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.e","version":"177'18523","reported_seq":18846,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-04-01T19:29:01.426500+0000","last_change":"2024-04-01T19:27:35.639198+0000","last_active":"2024-04-01T19:29:01.426500+0000","last_peered":"2024-04-01T19:29:01.426500+0000","last_clean":"2024-04-01T19:29:01.426500+0000","last_became_active":"2024-04-01T19:24:51.841004+0000","last_became_peered":"2024-04-01T19:24:51.841004+0000","last_unstale":"2024-04-01T19:29:01.426500+0000","last_undegraded":"2024-04-01T19:29:01.426500+0000","last_fullsized":"2024-04-01T19:29:01.426500+0000","mapping_epoch":106,"log_start":"130'8500","ondisk_log_start":"130'8500","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'15068","last_scrub_stamp":"2024-04-01T19:27:35.639028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:35.639028+0000","objects_scrubbed":6185,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:29:03.172418+0000","scrub_duration":1356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176357376,"num_objects":2691,"num_object_clones":0,"num_object_copies":5382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2691,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18523,"num_write_kb":678848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":2736914456,"num_objects":41763,"num_object_clones":0,"num_object_copies":83526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41763,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":293041,"num_write_kb":10713665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17414,"num_bytes_recovered":1141243904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6684680192,"data_stored":6684672048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160745,"ondisk_log_size":160745,"up":32,"acting":32,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220237,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":624276,"kb_used_data":534796,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":93120876,"statfs":{"total":95995035648,"available":95355777024,"internally_reserved":0,"allocated":547631104,"data_stored":547299297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":91617732},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":77,"seq":330712481873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":405580,"kb_used_data":342468,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":93339572,"statfs":{"total":95995035648,"available":95579721728,"internally_reserved":0,"allocated":350687232,"data_stored":350358977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":64616896},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678104,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":571804,"kb_used_data":468436,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":93173348,"statfs":{"total":95995035648,"available":95409508352,"internally_reserved":0,"allocated":479678464,"data_stored":479340055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":105839040},"hb_peers":[0,1,2,3,4,5,6,7,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234082,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":746788,"kb_used_data":665624,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":92998364,"statfs":{"total":95995035648,"available":95230324736,"internally_reserved":0,"allocated":681598976,"data_stored":681261087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":83098058},"hb_peers":[0,1,2,3,4,5,6,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528423,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":203932,"kb_used_data":168592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93541220,"statfs":{"total":95995035648,"available":95786209280,"internally_reserved":0,"allocated":172638208,"data_stored":172303871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574976,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":724188,"kb_used_data":624912,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":93020964,"statfs":{"total":95995035648,"available":95253467136,"internally_reserved":0,"allocated":639909888,"data_stored":639575551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738502,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":634124,"kb_used_data":540420,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":93111028,"statfs":{"total":95995035648,"available":95345692672,"internally_reserved":0,"allocated":553390080,"data_stored":553061845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346044,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":580300,"kb_used_data":517124,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":93164852,"statfs":{"total":95995035648,"available":95400808448,"internally_reserved":0,"allocated":529534976,"data_stored":529206741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149813,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":768588,"kb_used_data":679108,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":92976564,"statfs":{"total":95995035648,"available":95208001536,"internally_reserved":0,"allocated":695406592,"data_stored":695078357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":91617735},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953584,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":629584,"kb_used_data":517896,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":93115568,"statfs":{"total":95995035648,"available":95350341632,"internally_reserved":0,"allocated":530325504,"data_stored":529993197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790060,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":437004,"kb_used_data":361412,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":93308148,"statfs":{"total":95995035648,"available":95547543552,"internally_reserved":0,"allocated":370085888,"data_stored":369757653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,4,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":542441472,"data_stored":542441472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":632946688,"data_stored":632946688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":524681216,"data_stored":524681216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":679346176,"data_stored":679346176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":526127104,"data_stored":526123032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":359464960,"data_stored":359464960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":171180032,"data_stored":171180032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":674627584,"data_stored":674627584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":1204682752,"data_stored":1204682752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":478154752,"data_stored":478150680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":345505792,"data_stored":345505792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":545521664,"data_stored":545521664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:29:07.634 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:29:07.827 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:29:07.832 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:07.832 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:29:07.933 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:29:07.941 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:29:08.000 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:29:08.023 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:08.050 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:29:08.082 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:29:08.126 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:29:08.163 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:29:08.195 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:29:08.232 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:29:08.279 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:29:08.305 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:29:08.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:08 smithi022 ceph-mon[39439]: 2.2 scrub starts 2024-04-01T19:29:08.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:08 smithi022 ceph-mon[39439]: pgmap v546: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 2.4 GiB data, 5.7 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:29:08.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:08 smithi022 ceph-mon[39439]: 2.e scrub ok 2024-04-01T19:29:08.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:08 smithi022 ceph-mon[39439]: 2.2 scrub ok 2024-04-01T19:29:08.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:08 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3809270955' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:29:08.310 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:08.310 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:29:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:29:08.347 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_ops_in_flight 2024-04-01T19:29:08.372 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:29:08.372 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:29:08.372 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:29:08.372 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:29:08.372 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:29:08.372 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:29:08.372 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:29:08.372 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:29:08.373 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:29:08.373 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.8 2024-04-01T19:29:08.373 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:29:08.373 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:29:08.373 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:29:08.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:08 smithi188 ceph-mon[43939]: 2.2 scrub starts 2024-04-01T19:29:08.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:08 smithi188 ceph-mon[43939]: pgmap v546: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 2.4 GiB data, 5.7 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:29:08.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:08 smithi188 ceph-mon[43939]: 2.e scrub ok 2024-04-01T19:29:08.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:08 smithi188 ceph-mon[43939]: 2.2 scrub ok 2024-04-01T19:29:08.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:08 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3809270955' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:29:08.412 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:29:08.501 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:08 smithi062 ceph-mon[44211]: 2.2 scrub starts 2024-04-01T19:29:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:08 smithi062 ceph-mon[44211]: pgmap v546: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 2.4 GiB data, 5.7 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:29:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:08 smithi062 ceph-mon[44211]: 2.e scrub ok 2024-04-01T19:29:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:08 smithi062 ceph-mon[44211]: 2.2 scrub ok 2024-04-01T19:29:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:08 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3809270955' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:29:08.649 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:29:08.656 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:08.656 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:29:08.757 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:29:08.784 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:08.806 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:29:08.808 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:08.809 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:29:08.910 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:29:08.985 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:09.166 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:29:09.178 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:09.178 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:29:09.183 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:29:09.183 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:29:09.252 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:29:09.253 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:29:09.279 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:29:09.308 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:09.315 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:29:09.337 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:29:09.341 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:09.341 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:29:09.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.442 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:29:09.476 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.477 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.477 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.477 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.477 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.477 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.477 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.477 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.477 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.477 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.477 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:09.479 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:09.514 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:29:09.519 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:09.519 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:29:09.620 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:29:09.649 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:09.672 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:29:09.679 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:09.679 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:29:09.780 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:29:09.810 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:09.835 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:29:09.840 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:09.840 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:29:09.941 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:29:09.977 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:10.005 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:29:10.007 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:10.008 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:29:10.109 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:29:10.142 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:10.170 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:29:10.174 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:10.175 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:29:10.276 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:29:10.310 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:10.331 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:29:10.334 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:10.334 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:29:10.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:10 smithi022 ceph-mon[39439]: 2.3 scrub starts 2024-04-01T19:29:10.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:10 smithi022 ceph-mon[39439]: pgmap v547: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 2.3 GiB data, 5.5 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:29:10.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:10 smithi022 ceph-mon[39439]: 2.3 scrub ok 2024-04-01T19:29:10.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:10 smithi022 ceph-mon[39439]: 2.f scrub starts 2024-04-01T19:29:10.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:10 smithi188 ceph-mon[43939]: 2.3 scrub starts 2024-04-01T19:29:10.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:10 smithi188 ceph-mon[43939]: pgmap v547: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 2.3 GiB data, 5.5 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:29:10.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:10 smithi188 ceph-mon[43939]: 2.3 scrub ok 2024-04-01T19:29:10.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:10 smithi188 ceph-mon[43939]: 2.f scrub starts 2024-04-01T19:29:10.436 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:29:10.476 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:10.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:10 smithi062 ceph-mon[44211]: 2.3 scrub starts 2024-04-01T19:29:10.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:10 smithi062 ceph-mon[44211]: pgmap v547: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 2.3 GiB data, 5.5 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:29:10.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:10 smithi062 ceph-mon[44211]: 2.3 scrub ok 2024-04-01T19:29:10.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:10 smithi062 ceph-mon[44211]: 2.f scrub starts 2024-04-01T19:29:10.518 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:29:10.525 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:10.526 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:29:10.627 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:29:10.657 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:10.678 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:29:10.683 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:10.684 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:29:10.784 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:29:10.825 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:10.961 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:29:10.964 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:10.964 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:29:11.065 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:29:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:11.184 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:29:11.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:11 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T19:29:11.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:11 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T19:29:11.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:11 smithi022 ceph-mon[39439]: 2.f scrub ok 2024-04-01T19:29:11.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:11 smithi022 ceph-mon[39439]: 2.7 scrub starts 2024-04-01T19:29:11.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:11 smithi022 ceph-mon[39439]: 2.7 scrub ok 2024-04-01T19:29:11.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:11 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T19:29:11.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:11 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T19:29:11.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:11 smithi188 ceph-mon[43939]: 2.f scrub ok 2024-04-01T19:29:11.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:11 smithi188 ceph-mon[43939]: 2.7 scrub starts 2024-04-01T19:29:11.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:11 smithi188 ceph-mon[43939]: 2.7 scrub ok 2024-04-01T19:29:11.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:11 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T19:29:11.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:11 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T19:29:11.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:11 smithi062 ceph-mon[44211]: 2.f scrub ok 2024-04-01T19:29:11.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:11 smithi062 ceph-mon[44211]: 2.7 scrub starts 2024-04-01T19:29:11.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:11 smithi062 ceph-mon[44211]: 2.7 scrub ok 2024-04-01T19:29:12.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:12 smithi022 ceph-mon[39439]: pgmap v548: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.1 GiB data, 5.2 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:29:12.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:12 smithi188 ceph-mon[43939]: pgmap v548: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.1 GiB data, 5.2 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:29:12.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:12 smithi062 ceph-mon[44211]: pgmap v548: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.1 GiB data, 5.2 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:29:12.771 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:29:12.775 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:12.775 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:29:12.876 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:29:12.905 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:12.936 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:29:12.939 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:29:12.942 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:12.943 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:29:12.954 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:29:13.043 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:29:13.074 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:13.098 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:29:13.103 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:13.103 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:29:13.204 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:29:13.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:13 smithi062 ceph-mon[44211]: 2.9 scrub starts 2024-04-01T19:29:13.279 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:13.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:13 smithi188 ceph-mon[43939]: 2.9 scrub starts 2024-04-01T19:29:13.463 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:29:13.465 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:13.466 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:29:13.472 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:13 smithi022 ceph-mon[39439]: 2.9 scrub starts 2024-04-01T19:29:13.567 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:29:13.654 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:13.921 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:29:13.921 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:29:13.921 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:13.921 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:306470 2.6 e178/173 2:6cd1da93:::benchmark_data_smithi188_77607_object139066:head v 178'19170, mlcod=178'19167)", 2024-04-01T19:29:13.921 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:29:13.667675+0000", 2024-04-01T19:29:13.921 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0072581959999999997, 2024-04-01T19:29:13.921 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0072902150000000001, 2024-04-01T19:29:13.921 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:29:13.921 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:29:13.921 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:29:13.921 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:29:13.922 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:13.922 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:29:13.922 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.667675+0000", 2024-04-01T19:29:13.922 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:13.922 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:13.922 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:13.922 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:29:13.922 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.667675+0000", 2024-04-01T19:29:13.922 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:13.922 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:13.922 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:13.922 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:29:13.922 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.667677+0000", 2024-04-01T19:29:13.923 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1179999999999999e-06 2024-04-01T19:29:13.923 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:13.923 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:13.923 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:29:13.923 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.667688+0000", 2024-04-01T19:29:13.923 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0611999999999999e-05 2024-04-01T19:29:13.923 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:13.923 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:13.923 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:29:13.923 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.667702+0000", 2024-04-01T19:29:13.923 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4100000000000001e-05 2024-04-01T19:29:13.923 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:13.923 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:13.923 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:29:13.924 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.667712+0000", 2024-04-01T19:29:13.924 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0101e-05 2024-04-01T19:29:13.924 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:13.924 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:13.924 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:29:13.924 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.669846+0000", 2024-04-01T19:29:13.924 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0021339900000000001 2024-04-01T19:29:13.924 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:13.924 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:13.924 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:29:13.924 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.669869+0000", 2024-04-01T19:29:13.924 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2478999999999999e-05 2024-04-01T19:29:13.924 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:13.924 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:29:13.925 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:13.925 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:13.925 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T19:29:13.925 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 1 2024-04-01T19:29:13.925 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:29:14.162 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:29:14.164 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:14.165 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:29:14.266 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:29:14.364 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:14.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:14 smithi062 ceph-mon[44211]: pgmap v549: 17 pgs: 17 active+clean; 2.0 GiB data, 4.9 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:29:14.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:14 smithi062 ceph-mon[44211]: from='client.35072 v1:172.21.15.22:0/3549860382' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:29:14.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:14 smithi062 ceph-mon[44211]: 2.9 scrub ok 2024-04-01T19:29:14.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:14 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:29:14.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:14 smithi062 ceph-mon[44211]: 2.6 scrub starts 2024-04-01T19:29:14.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:14 smithi022 ceph-mon[39439]: pgmap v549: 17 pgs: 17 active+clean; 2.0 GiB data, 4.9 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:29:14.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:14 smithi022 ceph-mon[39439]: from='client.35072 v1:172.21.15.22:0/3549860382' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:29:14.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:14 smithi022 ceph-mon[39439]: 2.9 scrub ok 2024-04-01T19:29:14.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:14 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:29:14.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:14 smithi022 ceph-mon[39439]: 2.6 scrub starts 2024-04-01T19:29:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:14 smithi188 ceph-mon[43939]: pgmap v549: 17 pgs: 17 active+clean; 2.0 GiB data, 4.9 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:29:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:14 smithi188 ceph-mon[43939]: from='client.35072 v1:172.21.15.22:0/3549860382' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:29:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:14 smithi188 ceph-mon[43939]: 2.9 scrub ok 2024-04-01T19:29:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:14 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:29:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:14 smithi188 ceph-mon[43939]: 2.6 scrub starts 2024-04-01T19:29:14.749 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_blocked_ops 2024-04-01T19:29:15.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:15 smithi022 ceph-mon[39439]: 2.6 scrub ok 2024-04-01T19:29:15.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:15 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:29:15.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:15 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:29:15.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:15 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:29:15.497 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:29:15.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:15 smithi062 ceph-mon[44211]: 2.6 scrub ok 2024-04-01T19:29:15.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:15 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:29:15.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:15 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:29:15.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:15 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:29:15.536 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:29:15.545 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:15.545 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:29:15.549 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":549,"stamp":"2024-04-01T19:29:12.734351+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2133721656,"num_objects":32552,"num_object_clones":0,"num_object_copies":65104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32552,"num_whiteouts":0,"num_read":127,"num_read_kb":110,"num_write":302435,"num_write_kb":10716603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17422,"num_bytes_recovered":1143359616,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160897,"ondisk_log_size":160897,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":11,"num_per_pool_osds":11,"num_per_pool_omap_osds":11,"kb":1031196672,"kb_used":5117216,"kb_used_data":4184200,"kb_used_omap":17,"kb_used_meta":932846,"kb_avail":1026079456,"statfs":{"total":1055945392128,"available":1050705362944,"internally_reserved":0,"allocated":4284620800,"data_stored":4280927805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17548,"internal_metadata":955235188},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1,6,5,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-800849920,"num_objects":-12220,"num_object_clones":0,"num_object_copies":-24440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-12220,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12220,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.737794"},"pg_stats":[{"pgid":"2.f","version":"178'21113","reported_seq":30202,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:09.637956+0000","last_change":"2024-04-01T19:28:39.875202+0000","last_active":"2024-04-01T19:29:09.637956+0000","last_peered":"2024-04-01T19:29:09.637956+0000","last_clean":"2024-04-01T19:29:09.637956+0000","last_became_active":"2024-04-01T19:28:39.833695+0000","last_became_peered":"2024-04-01T19:28:39.833695+0000","last_unstale":"2024-04-01T19:29:09.637956+0000","last_undegraded":"2024-04-01T19:29:09.637956+0000","last_fullsized":"2024-04-01T19:29:09.637956+0000","mapping_epoch":175,"log_start":"138'11102","ondisk_log_start":"138'11102","created":106,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'15495","last_scrub_stamp":"2024-04-01T19:27:13.306569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:13.306569+0000","objects_scrubbed":7722,"log_size":10011,"log_dups_size":0,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1481,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134545408,"num_objects":2053,"num_object_clones":0,"num_object_copies":4106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2053,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18679,"num_write_kb":663424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4356,"num_bytes_recovered":285474816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4],"acting":[9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"178'21953","reported_seq":22419,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:09.698205+0000","last_change":"2024-04-01T19:28:11.557704+0000","last_active":"2024-04-01T19:29:09.698205+0000","last_peered":"2024-04-01T19:29:09.698205+0000","last_clean":"2024-04-01T19:29:09.698205+0000","last_became_active":"2024-04-01T19:24:52.198710+0000","last_became_peered":"2024-04-01T19:24:52.198710+0000","last_unstale":"2024-04-01T19:29:09.698205+0000","last_undegraded":"2024-04-01T19:29:09.698205+0000","last_fullsized":"2024-04-01T19:29:09.698205+0000","mapping_epoch":106,"log_start":"138'11900","ondisk_log_start":"138'11900","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'19786","last_scrub_stamp":"2024-04-01T19:28:11.557573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:28:11.557573+0000","objects_scrubbed":4192,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:29:34.932180+0000","scrub_duration":350,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132710400,"num_objects":2025,"num_object_clones":0,"num_object_copies":4050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2025,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18733,"num_write_kb":664256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"178'18690","reported_seq":19042,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:10.576844+0000","last_change":"2024-04-01T19:29:07.187481+0000","last_active":"2024-04-01T19:29:10.576844+0000","last_peered":"2024-04-01T19:29:10.576844+0000","last_clean":"2024-04-01T19:29:10.576844+0000","last_became_active":"2024-04-01T19:24:51.845054+0000","last_became_peered":"2024-04-01T19:24:51.845054+0000","last_unstale":"2024-04-01T19:29:10.576844+0000","last_undegraded":"2024-04-01T19:29:10.576844+0000","last_fullsized":"2024-04-01T19:29:10.576844+0000","mapping_epoch":106,"log_start":"133'8600","ondisk_log_start":"133'8600","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'18420","last_scrub_stamp":"2024-04-01T19:29:07.187332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:29:07.187332+0000","objects_scrubbed":2303,"log_size":10090,"log_dups_size":0,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:30:25.089686+0000","scrub_duration":475,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132251648,"num_objects":2018,"num_object_clones":0,"num_object_copies":4036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2018,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18690,"num_write_kb":662656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"178'18969","reported_seq":19321,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:11.524676+0000","last_change":"2024-04-01T19:29:05.924672+0000","last_active":"2024-04-01T19:29:11.524676+0000","last_peered":"2024-04-01T19:29:11.524676+0000","last_clean":"2024-04-01T19:29:11.524676+0000","last_became_active":"2024-04-01T19:24:51.840851+0000","last_became_peered":"2024-04-01T19:24:51.840851+0000","last_unstale":"2024-04-01T19:29:11.524676+0000","last_undegraded":"2024-04-01T19:29:11.524676+0000","last_fullsized":"2024-04-01T19:29:11.524676+0000","mapping_epoch":106,"log_start":"134'8900","ondisk_log_start":"134'8900","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'18554","last_scrub_stamp":"2024-04-01T19:29:05.924410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:29:05.924410+0000","objects_scrubbed":2322,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:30:11.222584+0000","scrub_duration":676,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123142144,"num_objects":1879,"num_object_clones":0,"num_object_copies":3758,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1879,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18969,"num_write_kb":667136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"178'18838","reported_seq":19184,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:10.580823+0000","last_change":"2024-04-01T19:29:09.103864+0000","last_active":"2024-04-01T19:29:10.580823+0000","last_peered":"2024-04-01T19:29:10.580823+0000","last_clean":"2024-04-01T19:29:10.580823+0000","last_became_active":"2024-04-01T19:24:51.845477+0000","last_became_peered":"2024-04-01T19:24:51.845477+0000","last_unstale":"2024-04-01T19:29:10.580823+0000","last_undegraded":"2024-04-01T19:29:10.580823+0000","last_fullsized":"2024-04-01T19:29:10.580823+0000","mapping_epoch":106,"log_start":"134'8800","ondisk_log_start":"134'8800","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'18730","last_scrub_stamp":"2024-04-01T19:29:09.103650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:29:09.103650+0000","objects_scrubbed":2133,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:30:19.694142+0000","scrub_duration":394,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131989504,"num_objects":2014,"num_object_clones":0,"num_object_copies":4028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2014,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18838,"num_write_kb":667264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":528,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:01.999947+0000","last_change":"2024-04-01T19:27:41.709212+0000","last_active":"2024-04-01T19:29:01.999947+0000","last_peered":"2024-04-01T19:29:01.999947+0000","last_clean":"2024-04-01T19:29:01.999947+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:29:01.999947+0000","last_undegraded":"2024-04-01T19:29:01.999947+0000","last_fullsized":"2024-04-01T19:29:01.999947+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:27:41.709127+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"178'19110","reported_seq":19512,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:07.919907+0000","last_change":"2024-04-01T19:28:28.136349+0000","last_active":"2024-04-01T19:29:07.919907+0000","last_peered":"2024-04-01T19:29:07.919907+0000","last_clean":"2024-04-01T19:29:07.919907+0000","last_became_active":"2024-04-01T19:24:51.846976+0000","last_became_peered":"2024-04-01T19:24:51.846976+0000","last_unstale":"2024-04-01T19:29:07.919907+0000","last_undegraded":"2024-04-01T19:29:07.919907+0000","last_fullsized":"2024-04-01T19:29:07.919907+0000","mapping_epoch":106,"log_start":"134'9100","ondisk_log_start":"134'9100","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'16933","last_scrub_stamp":"2024-04-01T19:28:28.136219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:28:28.136219+0000","objects_scrubbed":4387,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:29:52.961256+0000","scrub_duration":398,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144834560,"num_objects":2210,"num_object_clones":0,"num_object_copies":4420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2210,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19110,"num_write_kb":682240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10],"acting":[7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"178'18710","reported_seq":27723,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:09.969723+0000","last_change":"2024-04-01T19:29:02.941797+0000","last_active":"2024-04-01T19:29:09.969723+0000","last_peered":"2024-04-01T19:29:09.969723+0000","last_clean":"2024-04-01T19:29:09.969723+0000","last_became_active":"2024-04-01T19:28:38.830702+0000","last_became_peered":"2024-04-01T19:28:38.830702+0000","last_unstale":"2024-04-01T19:29:09.969723+0000","last_undegraded":"2024-04-01T19:29:09.969723+0000","last_fullsized":"2024-04-01T19:29:09.969723+0000","mapping_epoch":174,"log_start":"134'8700","ondisk_log_start":"134'8700","created":106,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'18153","last_scrub_stamp":"2024-04-01T19:29:02.941617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:29:02.941617+0000","objects_scrubbed":2595,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:30:28.996779+0000","scrub_duration":659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131989504,"num_objects":2014,"num_object_clones":0,"num_object_copies":4028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2014,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18710,"num_write_kb":663168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4319,"num_bytes_recovered":283049984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"178'18867","reported_seq":27905,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:09.679754+0000","last_change":"2024-04-01T19:28:37.861105+0000","last_active":"2024-04-01T19:29:09.679754+0000","last_peered":"2024-04-01T19:29:09.679754+0000","last_clean":"2024-04-01T19:29:09.679754+0000","last_became_active":"2024-04-01T19:28:37.823569+0000","last_became_peered":"2024-04-01T19:28:37.823569+0000","last_unstale":"2024-04-01T19:29:09.679754+0000","last_undegraded":"2024-04-01T19:29:09.679754+0000","last_fullsized":"2024-04-01T19:29:09.679754+0000","mapping_epoch":173,"log_start":"134'8800","ondisk_log_start":"134'8800","created":106,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'15341","last_scrub_stamp":"2024-04-01T19:27:42.412194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:42.412194+0000","objects_scrubbed":5632,"log_size":10067,"log_dups_size":0,"ondisk_log_size":10067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":963,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136380416,"num_objects":2081,"num_object_clones":0,"num_object_copies":4162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2081,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18867,"num_write_kb":670336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4355,"num_bytes_recovered":285409280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"178'19276","reported_seq":19628,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:12.349872+0000","last_change":"2024-04-01T19:29:10.522205+0000","last_active":"2024-04-01T19:29:12.349872+0000","last_peered":"2024-04-01T19:29:12.349872+0000","last_clean":"2024-04-01T19:29:12.349872+0000","last_became_active":"2024-04-01T19:24:51.841813+0000","last_became_peered":"2024-04-01T19:24:51.841813+0000","last_unstale":"2024-04-01T19:29:12.349872+0000","last_undegraded":"2024-04-01T19:29:12.349872+0000","last_fullsized":"2024-04-01T19:29:12.349872+0000","mapping_epoch":106,"log_start":"134'9200","ondisk_log_start":"134'9200","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'19134","last_scrub_stamp":"2024-04-01T19:29:10.522035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:29:10.522035+0000","objects_scrubbed":2013,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:30:39.216835+0000","scrub_duration":376,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121765888,"num_objects":1858,"num_object_clones":0,"num_object_copies":3716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1858,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19276,"num_write_kb":676288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.8","version":"178'18765","reported_seq":19125,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:07.919759+0000","last_change":"2024-04-01T19:29:05.405011+0000","last_active":"2024-04-01T19:29:07.919759+0000","last_peered":"2024-04-01T19:29:07.919759+0000","last_clean":"2024-04-01T19:29:07.919759+0000","last_became_active":"2024-04-01T19:24:51.846809+0000","last_became_peered":"2024-04-01T19:24:51.846809+0000","last_unstale":"2024-04-01T19:29:07.919759+0000","last_undegraded":"2024-04-01T19:29:07.919759+0000","last_fullsized":"2024-04-01T19:29:07.919759+0000","mapping_epoch":106,"log_start":"133'8700","ondisk_log_start":"133'8700","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'18584","last_scrub_stamp":"2024-04-01T19:29:05.404872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:29:05.404872+0000","objects_scrubbed":2441,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:30:05.745291+0000","scrub_duration":617,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146604032,"num_objects":2237,"num_object_clones":0,"num_object_copies":4474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2237,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18765,"num_write_kb":672064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.9","version":"178'18952","reported_seq":19271,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:09.695578+0000","last_change":"2024-04-01T19:27:37.638095+0000","last_active":"2024-04-01T19:29:09.695578+0000","last_peered":"2024-04-01T19:29:09.695578+0000","last_clean":"2024-04-01T19:29:09.695578+0000","last_became_active":"2024-04-01T19:24:51.844271+0000","last_became_peered":"2024-04-01T19:24:51.844271+0000","last_unstale":"2024-04-01T19:29:09.695578+0000","last_undegraded":"2024-04-01T19:29:09.695578+0000","last_fullsized":"2024-04-01T19:29:09.695578+0000","mapping_epoch":106,"log_start":"134'8900","ondisk_log_start":"134'8900","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'15055","last_scrub_stamp":"2024-04-01T19:27:37.637816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:27:37.637816+0000","objects_scrubbed":5942,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1230,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072000,"num_objects":2000,"num_object_clones":0,"num_object_copies":4000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2000,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18952,"num_write_kb":670464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"178'18889","reported_seq":19246,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:10.107171+0000","last_change":"2024-04-01T19:29:06.542939+0000","last_active":"2024-04-01T19:29:10.107171+0000","last_peered":"2024-04-01T19:29:10.107171+0000","last_clean":"2024-04-01T19:29:10.107171+0000","last_became_active":"2024-04-01T19:24:51.842274+0000","last_became_peered":"2024-04-01T19:24:51.842274+0000","last_unstale":"2024-04-01T19:29:10.107171+0000","last_undegraded":"2024-04-01T19:29:10.107171+0000","last_fullsized":"2024-04-01T19:29:10.107171+0000","mapping_epoch":106,"log_start":"134'8800","ondisk_log_start":"134'8800","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'18624","last_scrub_stamp":"2024-04-01T19:29:06.542800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:29:06.542800+0000","objects_scrubbed":2324,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:30:18.808613+0000","scrub_duration":463,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134021120,"num_objects":2045,"num_object_clones":0,"num_object_copies":4090,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2045,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18889,"num_write_kb":669888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.b","version":"178'22213","reported_seq":31421,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:10.138067+0000","last_change":"2024-04-01T19:29:05.428639+0000","last_active":"2024-04-01T19:29:10.138067+0000","last_peered":"2024-04-01T19:29:10.138067+0000","last_clean":"2024-04-01T19:29:10.138067+0000","last_became_active":"2024-04-01T19:28:39.835560+0000","last_became_peered":"2024-04-01T19:28:39.835560+0000","last_unstale":"2024-04-01T19:29:10.138067+0000","last_undegraded":"2024-04-01T19:29:10.138067+0000","last_fullsized":"2024-04-01T19:29:10.138067+0000","mapping_epoch":175,"log_start":"147'12200","ondisk_log_start":"147'12200","created":106,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'21875","last_scrub_stamp":"2024-04-01T19:29:05.428479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:29:05.428479+0000","objects_scrubbed":2362,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:30:14.762650+0000","scrub_duration":381,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131792896,"num_objects":2011,"num_object_clones":0,"num_object_copies":4022,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2011,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18933,"num_write_kb":670208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4384,"num_bytes_recovered":287309824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.c","version":"178'18945","reported_seq":19303,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:10.127298+0000","last_change":"2024-04-01T19:29:02.595086+0000","last_active":"2024-04-01T19:29:10.127298+0000","last_peered":"2024-04-01T19:29:10.127298+0000","last_clean":"2024-04-01T19:29:10.127298+0000","last_became_active":"2024-04-01T19:24:52.198867+0000","last_became_peered":"2024-04-01T19:24:52.198867+0000","last_unstale":"2024-04-01T19:29:10.127298+0000","last_undegraded":"2024-04-01T19:29:10.127298+0000","last_fullsized":"2024-04-01T19:29:10.127298+0000","mapping_epoch":106,"log_start":"134'8900","ondisk_log_start":"134'8900","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'18420","last_scrub_stamp":"2024-04-01T19:29:02.594976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:29:02.594976+0000","objects_scrubbed":2660,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:30:07.866264+0000","scrub_duration":562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138477568,"num_objects":2113,"num_object_clones":0,"num_object_copies":4226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18945,"num_write_kb":673856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.d","version":"178'21819","reported_seq":22257,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:09.632967+0000","last_change":"2024-04-01T19:28:13.878569+0000","last_active":"2024-04-01T19:29:09.632967+0000","last_peered":"2024-04-01T19:29:09.632967+0000","last_clean":"2024-04-01T19:29:09.632967+0000","last_became_active":"2024-04-01T19:24:51.843633+0000","last_became_peered":"2024-04-01T19:24:51.843633+0000","last_unstale":"2024-04-01T19:29:09.632967+0000","last_undegraded":"2024-04-01T19:29:09.632967+0000","last_fullsized":"2024-04-01T19:29:09.632967+0000","mapping_epoch":106,"log_start":"146'11801","ondisk_log_start":"146'11801","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'19571","last_scrub_stamp":"2024-04-01T19:28:13.878445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:28:13.878445+0000","objects_scrubbed":4278,"log_size":10018,"log_dups_size":0,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:29:17.064425+0000","scrub_duration":460,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132972568,"num_objects":2030,"num_object_clones":0,"num_object_copies":4060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2030,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":18646,"num_write_kb":661569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4],"acting":[9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.e","version":"178'19252","reported_seq":19609,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-04-01T19:29:11.519073+0000","last_change":"2024-04-01T19:29:06.950535+0000","last_active":"2024-04-01T19:29:11.519073+0000","last_peered":"2024-04-01T19:29:11.519073+0000","last_clean":"2024-04-01T19:29:11.519073+0000","last_became_active":"2024-04-01T19:24:51.841004+0000","last_became_peered":"2024-04-01T19:24:51.841004+0000","last_unstale":"2024-04-01T19:29:11.519073+0000","last_undegraded":"2024-04-01T19:29:11.519073+0000","last_fullsized":"2024-04-01T19:29:11.519073+0000","mapping_epoch":106,"log_start":"134'9200","ondisk_log_start":"134'9200","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"178'18913","last_scrub_stamp":"2024-04-01T19:29:06.950375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:24:50.829919+0000","last_clean_scrub_stamp":"2024-04-01T19:29:06.950375+0000","objects_scrubbed":2334,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:30:18.668829+0000","scrub_duration":727,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128581632,"num_objects":1962,"num_object_clones":0,"num_object_copies":3924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1962,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19252,"num_write_kb":678848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":2133131288,"num_objects":32550,"num_object_clones":0,"num_object_copies":65100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32550,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":302254,"num_write_kb":10713665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17414,"num_bytes_recovered":1141243904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5409087488,"data_stored":5409079344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160758,"ondisk_log_size":160758,"up":32,"acting":32,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220239,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":495584,"kb_used_data":396376,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":93249568,"statfs":{"total":95995035648,"available":95487557632,"internally_reserved":0,"allocated":405889024,"data_stored":405551115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":101579204},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":77,"seq":330712481875,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":314904,"kb_used_data":247632,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":93430248,"statfs":{"total":95995035648,"available":95672573952,"internally_reserved":0,"allocated":253575168,"data_stored":253240811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":68876736},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678105,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":516828,"kb_used_data":409300,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":93228324,"statfs":{"total":95995035648,"available":95465803776,"internally_reserved":0,"allocated":419123200,"data_stored":418784791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":110098880},"hb_peers":[0,1,2,3,4,5,6,7,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234083,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":654944,"kb_used_data":565464,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":93090208,"statfs":{"total":95995035648,"available":95324372992,"internally_reserved":0,"allocated":579035136,"data_stored":578697247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":91617738},"hb_peers":[0,1,2,3,4,5,6,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528425,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":160088,"kb_used_data":120592,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93585064,"statfs":{"total":95995035648,"available":95831105536,"internally_reserved":0,"allocated":123486208,"data_stored":123151871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574977,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":633816,"kb_used_data":530448,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":93111336,"statfs":{"total":95995035648,"available":95346008064,"internally_reserved":0,"allocated":543178752,"data_stored":542844415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738504,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":505944,"kb_used_data":402576,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":93239208,"statfs":{"total":95995035648,"available":95476948992,"internally_reserved":0,"allocated":412237824,"data_stored":411903487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346046,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":446104,"kb_used_data":374608,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":93299048,"statfs":{"total":95995035648,"available":95538225152,"internally_reserved":0,"allocated":383598592,"data_stored":383264255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149815,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":573528,"kb_used_data":492368,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":93171624,"statfs":{"total":95995035648,"available":95407742976,"internally_reserved":0,"allocated":504184832,"data_stored":503850495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":83098055},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953586,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":484060,"kb_used_data":376532,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":93261092,"statfs":{"total":95995035648,"available":95499358208,"internally_reserved":0,"allocated":385568768,"data_stored":385230359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790062,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":331416,"kb_used_data":268304,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":93413736,"statfs":{"total":95995035648,"available":95655665664,"internally_reserved":0,"allocated":274743296,"data_stored":274408959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,4,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":403177472,"data_stored":403177472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":537657344,"data_stored":537657344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":378339328,"data_stored":378339328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":486342656,"data_stored":486342656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":380964864,"data_stored":380960792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":263979008,"data_stored":263979008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":121765888,"data_stored":121765888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":573833216,"data_stored":573833216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":1204682752,"data_stored":1204682752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":406196224,"data_stored":406192152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":247857152,"data_stored":247857152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":404291584,"data_stored":404291584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:29:15.550 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-01T19:29:15.550 INFO:tasks.thrashosds.thrasher:Waiting for trim 2024-04-01T19:29:15.592 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:29:15.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:15 smithi188 ceph-mon[43939]: 2.6 scrub ok 2024-04-01T19:29:15.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:15 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:29:15.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:15 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:29:15.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:15 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:29:15.646 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:29:15.677 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:15.707 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:29:15.711 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:15.712 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:29:15.813 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:29:15.845 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:15.873 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:29:15.875 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:15.876 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:29:15.977 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:29:16.006 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:16.031 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:29:16.035 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:16.036 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:29:16.137 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:29:16.167 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:16.188 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:29:16.191 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:16.191 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:29:16.292 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:29:16.359 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:16.520 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:29:16.525 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:16.526 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:16 smithi022 ceph-mon[39439]: pgmap v550: 17 pgs: 17 active+clean; 1.8 GiB data, 4.6 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:29:16.526 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:29:16.627 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:29:16.726 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:16.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:16 smithi062 ceph-mon[44211]: pgmap v550: 17 pgs: 17 active+clean; 1.8 GiB data, 4.6 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:29:16.784 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:29:16.794 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:16.795 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:29:16.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:16 smithi188 ceph-mon[43939]: pgmap v550: 17 pgs: 17 active+clean; 1.8 GiB data, 4.6 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:29:16.895 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:29:16.921 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:16.947 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:29:16.949 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:16.950 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:29:17.051 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:29:17.088 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:29:17.120 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:17.121 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:29:17.222 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:29:17.252 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:17.275 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:29:17.279 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:17.280 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:29:17.381 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:29:17.415 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:17.442 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:29:17.449 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:17.449 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:29:17.456 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:17 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/870728028' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:29:17.463 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:29:17.551 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:29:17.602 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:17.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:17 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/870728028' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:29:17.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:17 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/870728028' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:29:18.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:18 smithi062 ceph-mon[44211]: pgmap v551: 17 pgs: 17 active+clean; 1.7 GiB data, 4.4 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:29:18.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:18 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:29:18.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:18 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:29:18.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:18 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/870728028' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:29:18.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:18 smithi062 ceph-mon[44211]: osdmap e179: 12 total, 11 up, 11 in 2024-04-01T19:29:18.869 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:18 smithi022 ceph-mon[39439]: pgmap v551: 17 pgs: 17 active+clean; 1.7 GiB data, 4.4 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:29:18.869 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:18 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:29:18.869 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:18 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:29:18.869 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:18 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/870728028' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:29:18.869 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:18 smithi022 ceph-mon[39439]: osdmap e179: 12 total, 11 up, 11 in 2024-04-01T19:29:18.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:18 smithi188 ceph-mon[43939]: pgmap v551: 17 pgs: 17 active+clean; 1.7 GiB data, 4.4 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:29:18.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:18 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:29:18.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:18 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:29:18.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:18 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/870728028' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:29:18.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:18 smithi188 ceph-mon[43939]: osdmap e179: 12 total, 11 up, 11 in 2024-04-01T19:29:18.885 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:29:18.908 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:29:18.945 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:29:18.992 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:29:19.018 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:29:19.053 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:29:19.090 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:29:19.118 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:29:19.145 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:29:19.182 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:29:19.214 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:29:19.219 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:29:19.219 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:29:19.219 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:29:19.219 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:29:19.219 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:29:19.219 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:29:19.219 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:29:19.219 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:29:19.219 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.8 2024-04-01T19:29:19.219 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:29:19.220 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:29:19.220 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:29:19.485 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:19 smithi022 ceph-mon[39439]: 2.d scrub starts 2024-04-01T19:29:19.485 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:19 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/616768524' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:29:19.485 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:19.659 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:29:19.667 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:19.668 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:29:19.752 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:19.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:19.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:19 smithi062 ceph-mon[44211]: 2.d scrub starts 2024-04-01T19:29:19.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:19 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/616768524' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:29:19.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:19.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:19.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:19.769 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:29:19.801 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:19.826 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:29:19.831 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:19.831 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:29:19.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:19 smithi188 ceph-mon[43939]: 2.d scrub starts 2024-04-01T19:29:19.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:19 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/616768524' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:29:19.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:19.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:19.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:19.932 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:29:19.993 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:20.095 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:29:20.104 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:20.105 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:29:20.125 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:29:20.125 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:29:20.206 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:29:20.255 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:20.726 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:29:20.736 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:20.737 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:29:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:20 smithi062 ceph-mon[44211]: pgmap v553: 17 pgs: 17 active+clean; 1.6 GiB data, 4.1 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:29:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:20 smithi062 ceph-mon[44211]: 2.d scrub ok 2024-04-01T19:29:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:20.838 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:29:20.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:20 smithi022 ceph-mon[39439]: pgmap v553: 17 pgs: 17 active+clean; 1.6 GiB data, 4.1 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:29:20.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:20.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:20.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:20.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:20.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:20 smithi022 ceph-mon[39439]: 2.d scrub ok 2024-04-01T19:29:20.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:20.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:20.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:20.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:20.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:20 smithi188 ceph-mon[43939]: pgmap v553: 17 pgs: 17 active+clean; 1.6 GiB data, 4.1 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:29:20.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:20.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:20.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:20.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:20.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:20 smithi188 ceph-mon[43939]: 2.d scrub ok 2024-04-01T19:29:20.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:20.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:20.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:20.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:20.886 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:20.957 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:29:20.963 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:20.964 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:29:21.065 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:29:21.102 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:21.127 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:29:21.133 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:21.134 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:29:21.235 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:29:21.265 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:21.286 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:29:21.293 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:21.294 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:29:21.395 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:29:21.429 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:21.431 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:29:21.455 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:29:21.460 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:21.460 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:29:21.494 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:29:21.495 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:29:21.561 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:29:21.654 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:21.788 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:29:21.792 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:21.793 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:29:21.894 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:29:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:22.126 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:29:22.418 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_historic_ops 2024-04-01T19:29:22.423 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:29:22.437 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:22.437 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:29:22.481 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:29:22.539 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:29:22.567 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:22.605 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:29:22.607 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:22.608 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:29:22.709 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:29:22.738 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:22.763 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:29:22.768 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:22.768 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:29:22.808 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:29:22.812 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:22 smithi022 ceph-mon[39439]: pgmap v554: 17 pgs: 17 active+clean; 1.3 GiB data, 3.8 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:29:22.812 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:22 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:29:22.812 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:22 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:29:22.812 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:22 smithi022 ceph-mon[39439]: osdmap e180: 12 total, 11 up, 11 in 2024-04-01T19:29:22.869 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:29:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:22 smithi188 ceph-mon[43939]: pgmap v554: 17 pgs: 17 active+clean; 1.3 GiB data, 3.8 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:29:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:22 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:29:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:22 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:29:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:22 smithi188 ceph-mon[43939]: osdmap e180: 12 total, 11 up, 11 in 2024-04-01T19:29:22.900 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:22 smithi062 ceph-mon[44211]: pgmap v554: 17 pgs: 17 active+clean; 1.3 GiB data, 3.8 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:29:22.900 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:22 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:29:22.900 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:22 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:29:22.900 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:22 smithi062 ceph-mon[44211]: osdmap e180: 12 total, 11 up, 11 in 2024-04-01T19:29:22.902 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:22.924 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:29:22.929 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:22.930 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:29:23.031 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:29:23.062 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:23.089 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:29:23.091 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:23.091 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:29:23.192 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:29:23.256 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:24.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:24 smithi022 ceph-mon[39439]: pgmap v556: 17 pgs: 17 active+clean; 1.3 GiB data, 3.5 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:29:24.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:24 smithi188 ceph-mon[43939]: pgmap v556: 17 pgs: 17 active+clean; 1.3 GiB data, 3.5 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:29:25.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:24 smithi062 ceph-mon[44211]: pgmap v556: 17 pgs: 17 active+clean; 1.3 GiB data, 3.5 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:29:26.156 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:29:26.160 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:26.160 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:29:26.261 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:29:26.334 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:26.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:26 smithi022 ceph-mon[39439]: pgmap v557: 17 pgs: 17 active+clean; 1.1 GiB data, 3.2 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:29:26.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:26 smithi188 ceph-mon[43939]: pgmap v557: 17 pgs: 17 active+clean; 1.1 GiB data, 3.2 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:29:27.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:26 smithi062 ceph-mon[44211]: pgmap v557: 17 pgs: 17 active+clean; 1.1 GiB data, 3.2 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:29:27.235 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:29:27.276 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:29:27.287 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:27.288 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:29:27.389 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:29:27.458 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:27.511 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:29:27.518 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:27.518 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:29:27.619 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:29:27.652 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:27.681 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:29:27.683 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:27.683 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:29:27.784 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:29:27.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:27 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:29:27.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:27 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:29:27.786 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:27 smithi022 ceph-mon[39439]: osdmap e181: 12 total, 11 up, 11 in 2024-04-01T19:29:27.843 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:27 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:29:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:27 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:29:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:27 smithi188 ceph-mon[43939]: osdmap e181: 12 total, 11 up, 11 in 2024-04-01T19:29:27.982 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:29:27.995 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:27.996 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:29:28.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:27 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:29:28.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:27 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:29:28.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:27 smithi062 ceph-mon[44211]: osdmap e181: 12 total, 11 up, 11 in 2024-04-01T19:29:28.096 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:29:28.136 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:28.161 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:29:28.166 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:28.167 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:29:28.267 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:29:28.303 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:28.324 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:29:28.327 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:28.327 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:29:28.428 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:29:28.458 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:28.487 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:29:28.491 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:28.492 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:29:28.592 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:29:28.624 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:28.652 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:29:28.657 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:28.657 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:29:28.758 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:29:28.788 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:28 smithi188 ceph-mon[43939]: pgmap v559: 17 pgs: 17 active+clean; 931 MiB data, 2.9 GiB used, 981 GiB / 983 GiB avail; 0 B/s wr, 1.38k op/s 2024-04-01T19:29:28.791 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:28.814 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:28.815 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:29:28.815 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:29:28.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:28 smithi022 ceph-mon[39439]: pgmap v559: 17 pgs: 17 active+clean; 931 MiB data, 2.9 GiB used, 981 GiB / 983 GiB avail; 0 B/s wr, 1.38k op/s 2024-04-01T19:29:28.915 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:29:28.941 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:28.961 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:29:28.965 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:28.965 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:29:29.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:28 smithi062 ceph-mon[44211]: pgmap v559: 17 pgs: 17 active+clean; 931 MiB data, 2.9 GiB used, 981 GiB / 983 GiB avail; 0 B/s wr, 1.38k op/s 2024-04-01T19:29:29.066 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:29:29.145 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:29.200 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:29:29.206 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:29.207 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:29:29.285 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:29:29.308 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:29:29.333 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:29:29.371 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:29:29.398 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:29.440 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:29:29.451 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:29.452 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:29:29.465 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:29:29.506 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:29:29.547 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:29:29.553 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:29:29.587 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:29:29.588 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:29.610 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:29:29.616 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:29.617 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:29:29.621 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:29:29.657 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:29:29.705 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:29:29.717 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:29:29.732 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:29 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2301644902' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:29:29.747 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:29.775 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:29:29.775 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:29:29.775 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:29:29.775 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:29:29.776 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:29:29.776 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:29:29.776 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:29:29.776 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:29:29.777 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:29:29.777 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:29:29.777 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.8 2024-04-01T19:29:29.777 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:29:29.777 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:29:29.777 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:29:29.781 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:29.782 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:29:29.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:29 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2301644902' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:29:29.883 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:29:29.910 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:29 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2301644902' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:29:29.912 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:29.938 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:29:29.942 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:29.943 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:29:30.043 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:29:30.091 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:30.219 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:29:30.222 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:30.223 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:29:30.309 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:29:30.309 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 20, 2024-04-01T19:29:30.309 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 600, 2024-04-01T19:29:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:29:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:155466 2.1 e136/106 2:8833247c:::benchmark_data_smithi188_77607_object155465:head v 136'9708, mlcod=136'9706)", 2024-04-01T19:29:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:21.000103+0000", 2024-04-01T19:29:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 189.301842443, 2024-04-01T19:29:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.035418577999999999, 2024-04-01T19:29:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:29:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:29:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:29:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:29:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:21.000103+0000", 2024-04-01T19:29:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:29:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:21.000103+0000", 2024-04-01T19:29:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:29:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:21.000104+0000", 2024-04-01T19:29:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.263e-06 2024-04-01T19:29:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:29:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:21.000127+0000", 2024-04-01T19:29:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2702e-05 2024-04-01T19:29:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:29:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:21.000138+0000", 2024-04-01T19:29:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1627000000000001e-05 2024-04-01T19:29:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:29:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:21.000146+0000", 2024-04-01T19:29:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9440000000000005e-06 2024-04-01T19:29:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:29:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:21.000214+0000", 2024-04-01T19:29:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.7718000000000005e-05 2024-04-01T19:29:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:29:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:21.000234+0000", 2024-04-01T19:29:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0469e-05 2024-04-01T19:29:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:29:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:21.035464+0000", 2024-04-01T19:29:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.035229309 2024-04-01T19:29:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:29:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:21.035521+0000", 2024-04-01T19:29:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7546000000000001e-05 2024-04-01T19:29:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:29:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:185542 2.a e144/106 2:52e1818e:::benchmark_data_smithi188_77607_object18138:head v 144'11583, mlcod=144'11581)", 2024-04-01T19:29:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:51.531472+0000", 2024-04-01T19:29:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 158.77047301299999, 2024-04-01T19:29:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.034680774999999997, 2024-04-01T19:29:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:29:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:29:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:29:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:29:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:51.531472+0000", 2024-04-01T19:29:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:29:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:51.531472+0000", 2024-04-01T19:29:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:29:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:51.531474+0000", 2024-04-01T19:29:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.53e-06 2024-04-01T19:29:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:29:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:51.531481+0000", 2024-04-01T19:29:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.8660000000000006e-06 2024-04-01T19:29:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:29:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:51.531495+0000", 2024-04-01T19:29:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3247999999999999e-05 2024-04-01T19:29:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:29:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:51.531503+0000", 2024-04-01T19:29:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0369999999999995e-06 2024-04-01T19:29:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:29:30.318 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:51.531583+0000", 2024-04-01T19:29:30.318 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0747999999999993e-05 2024-04-01T19:29:30.318 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.318 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.318 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:29:30.318 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:51.531604+0000", 2024-04-01T19:29:30.318 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0200999999999999e-05 2024-04-01T19:29:30.318 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.318 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.318 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:29:30.318 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:51.566110+0000", 2024-04-01T19:29:30.318 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.034506848 2024-04-01T19:29:30.318 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:29:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:51.566153+0000", 2024-04-01T19:29:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.2296999999999998e-05 2024-04-01T19:29:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:29:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:197004 2.a e148/106 2:5ff56a6b:::benchmark_data_smithi188_77607_object29600:head v 148'12298, mlcod=148'12295)", 2024-04-01T19:29:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:27:01.117541+0000", 2024-04-01T19:29:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 149.184403527, 2024-04-01T19:29:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.033475741000000003, 2024-04-01T19:29:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:29:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:29:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:29:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:29:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.117541+0000", 2024-04-01T19:29:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:29:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.117541+0000", 2024-04-01T19:29:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:29:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.117543+0000", 2024-04-01T19:29:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.705e-06 2024-04-01T19:29:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:29:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.117551+0000", 2024-04-01T19:29:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.1650000000000006e-06 2024-04-01T19:29:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:29:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.117564+0000", 2024-04-01T19:29:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2870999999999999e-05 2024-04-01T19:29:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:29:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.117573+0000", 2024-04-01T19:29:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.388e-06 2024-04-01T19:29:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:29:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.117638+0000", 2024-04-01T19:29:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5693999999999998e-05 2024-04-01T19:29:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:29:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.117664+0000", 2024-04-01T19:29:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5395e-05 2024-04-01T19:29:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:29:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.150965+0000", 2024-04-01T19:29:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.033300814999999998 2024-04-01T19:29:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:29:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.151017+0000", 2024-04-01T19:29:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2707999999999997e-05 2024-04-01T19:29:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:29:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:197067 2.1 e148/106 2:8ce526a3:::benchmark_data_smithi188_77607_object29663:head v 148'12331, mlcod=148'12327)", 2024-04-01T19:29:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:27:01.191649+0000", 2024-04-01T19:29:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 149.11029633499999, 2024-04-01T19:29:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.036576380999999998, 2024-04-01T19:29:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:29:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:29:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:29:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:29:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.191649+0000", 2024-04-01T19:29:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:29:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.191649+0000", 2024-04-01T19:29:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:29:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.191649+0000", 2024-04-01T19:29:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7e-07 2024-04-01T19:29:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:29:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.191656+0000", 2024-04-01T19:29:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8090000000000004e-06 2024-04-01T19:29:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:29:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.191660+0000", 2024-04-01T19:29:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6269999999999999e-06 2024-04-01T19:29:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:29:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.191664+0000", 2024-04-01T19:29:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9609999999999999e-06 2024-04-01T19:29:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:29:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.210559+0000", 2024-04-01T19:29:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.018894060000000001 2024-04-01T19:29:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:29:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.210582+0000", 2024-04-01T19:29:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3791e-05 2024-04-01T19:29:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:29:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.228184+0000", 2024-04-01T19:29:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.017601947999999999 2024-04-01T19:29:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:29:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.228225+0000", 2024-04-01T19:29:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.0815000000000001e-05 2024-04-01T19:29:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:29:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:203025 2.1 e150/106 2:872a2d5f:::benchmark_data_smithi188_77607_object35621:head v 150'12701, mlcod=149'12699)", 2024-04-01T19:29:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:27:06.093735+0000", 2024-04-01T19:29:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 144.208209893, 2024-04-01T19:29:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.032680307999999998, 2024-04-01T19:29:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:29:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:29:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:29:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:29:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:06.093735+0000", 2024-04-01T19:29:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:29:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:06.093735+0000", 2024-04-01T19:29:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:29:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:06.093736+0000", 2024-04-01T19:29:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7000000000000004e-07 2024-04-01T19:29:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:29:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:06.093741+0000", 2024-04-01T19:29:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.237e-06 2024-04-01T19:29:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:29:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:06.093747+0000", 2024-04-01T19:29:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3450000000000002e-06 2024-04-01T19:29:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:29:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:06.093753+0000", 2024-04-01T19:29:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8100000000000003e-06 2024-04-01T19:29:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.332 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:29:30.332 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:06.094969+0000", 2024-04-01T19:29:30.332 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0012160389999999999 2024-04-01T19:29:30.332 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.332 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.332 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:29:30.332 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:06.094990+0000", 2024-04-01T19:29:30.332 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0174999999999999e-05 2024-04-01T19:29:30.332 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.332 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.332 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:29:30.332 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:06.126365+0000", 2024-04-01T19:29:30.332 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.031375574000000003 2024-04-01T19:29:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:29:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:06.126415+0000", 2024-04-01T19:29:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0358000000000001e-05 2024-04-01T19:29:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:29:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:236357 2.a e155/106 2:59c87872:::benchmark_data_smithi188_77607_object68953:head v 155'14769, mlcod=155'14766)", 2024-04-01T19:29:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:27:34.504782+0000", 2024-04-01T19:29:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 115.797163447, 2024-04-01T19:29:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.040947130999999998, 2024-04-01T19:29:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:29:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:29:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:29:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:29:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.504782+0000", 2024-04-01T19:29:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:29:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.504782+0000", 2024-04-01T19:29:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:29:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.504783+0000", 2024-04-01T19:29:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.457e-06 2024-04-01T19:29:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:29:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.504792+0000", 2024-04-01T19:29:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5660000000000007e-06 2024-04-01T19:29:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:29:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.504806+0000", 2024-04-01T19:29:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.488e-05 2024-04-01T19:29:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:29:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.504814+0000", 2024-04-01T19:29:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7400000000000004e-06 2024-04-01T19:29:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:29:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.506723+0000", 2024-04-01T19:29:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0019087710000000001 2024-04-01T19:29:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:29:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.506749+0000", 2024-04-01T19:29:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5673999999999998e-05 2024-04-01T19:29:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:29:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.545673+0000", 2024-04-01T19:29:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.038923864000000002 2024-04-01T19:29:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:29:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.545729+0000", 2024-04-01T19:29:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6178999999999999e-05 2024-04-01T19:29:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:29:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:236365 2.a e155/106 2:5ad792a3:::benchmark_data_smithi188_77607_object68961:head v 155'14770, mlcod=155'14767)", 2024-04-01T19:29:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:27:34.508924+0000", 2024-04-01T19:29:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 115.793021239, 2024-04-01T19:29:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.036832798, 2024-04-01T19:29:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:29:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:29:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:29:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:29:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.508924+0000", 2024-04-01T19:29:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:29:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.508924+0000", 2024-04-01T19:29:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:29:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.508926+0000", 2024-04-01T19:29:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1019999999999999e-06 2024-04-01T19:29:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:29:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.508934+0000", 2024-04-01T19:29:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7389999999999999e-06 2024-04-01T19:29:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:29:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.508946+0000", 2024-04-01T19:29:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2292e-05 2024-04-01T19:29:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:29:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.508954+0000", 2024-04-01T19:29:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4570000000000005e-06 2024-04-01T19:29:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:29:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.511201+0000", 2024-04-01T19:29:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.002246802 2024-04-01T19:29:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:29:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.511220+0000", 2024-04-01T19:29:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9205e-05 2024-04-01T19:29:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:29:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.545732+0000", 2024-04-01T19:29:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.034512045999999998 2024-04-01T19:29:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:29:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.545757+0000", 2024-04-01T19:29:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4155000000000002e-05 2024-04-01T19:29:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:29:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:236813 2.e e155/106 2:7a3c735d:::benchmark_data_smithi188_77607_object69409:head v 155'15025, mlcod=155'15020)", 2024-04-01T19:29:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:27:34.955410+0000", 2024-04-01T19:29:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 115.346534981, 2024-04-01T19:29:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.032172483000000002, 2024-04-01T19:29:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:29:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:29:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:29:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:29:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.955410+0000", 2024-04-01T19:29:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:29:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.955410+0000", 2024-04-01T19:29:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:29:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.955411+0000", 2024-04-01T19:29:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.269e-06 2024-04-01T19:29:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:29:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.955418+0000", 2024-04-01T19:29:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9439999999999999e-06 2024-04-01T19:29:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:29:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.955429+0000", 2024-04-01T19:29:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0705e-05 2024-04-01T19:29:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:29:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.955436+0000", 2024-04-01T19:29:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3810000000000001e-06 2024-04-01T19:29:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:29:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.957757+0000", 2024-04-01T19:29:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0023208730000000002 2024-04-01T19:29:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:29:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.957780+0000", 2024-04-01T19:29:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2918999999999999e-05 2024-04-01T19:29:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:29:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.987534+0000", 2024-04-01T19:29:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.029754108000000001 2024-04-01T19:29:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:29:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.987583+0000", 2024-04-01T19:29:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8284000000000001e-05 2024-04-01T19:29:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:29:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:236818 2.e e155/106 2:710caca5:::benchmark_data_smithi188_77607_object69414:head v 155'15026, mlcod=155'15022)", 2024-04-01T19:29:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:27:34.955509+0000", 2024-04-01T19:29:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 115.34643626099999, 2024-04-01T19:29:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.032106096000000001, 2024-04-01T19:29:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:29:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:29:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:29:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:29:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.955509+0000", 2024-04-01T19:29:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:29:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.955509+0000", 2024-04-01T19:29:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:29:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.955515+0000", 2024-04-01T19:29:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8669999999999999e-06 2024-04-01T19:29:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:29:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.955520+0000", 2024-04-01T19:29:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7230000000000001e-06 2024-04-01T19:29:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:29:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.955529+0000", 2024-04-01T19:29:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.9500000000000007e-06 2024-04-01T19:29:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:29:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.955535+0000", 2024-04-01T19:29:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6960000000000002e-06 2024-04-01T19:29:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:29:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.963483+0000", 2024-04-01T19:29:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0079481989999999995 2024-04-01T19:29:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:29:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.963505+0000", 2024-04-01T19:29:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1648999999999999e-05 2024-04-01T19:29:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:29:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.987588+0000", 2024-04-01T19:29:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.024082705999999999 2024-04-01T19:29:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:29:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.987615+0000", 2024-04-01T19:29:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.7305999999999999e-05 2024-04-01T19:29:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:29:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:241422 2.e e155/106 2:72654786:::benchmark_data_smithi188_77607_object74018:head v 155'15322, mlcod=155'15318)", 2024-04-01T19:29:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:27:39.079748+0000", 2024-04-01T19:29:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 111.22219683500001, 2024-04-01T19:29:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.036956733999999998, 2024-04-01T19:29:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:29:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:29:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:29:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:29:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:39.079748+0000", 2024-04-01T19:29:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:29:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:39.079748+0000", 2024-04-01T19:29:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:29:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:39.079749+0000", 2024-04-01T19:29:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1739999999999999e-06 2024-04-01T19:29:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:29:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:39.079757+0000", 2024-04-01T19:29:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3119999999999996e-06 2024-04-01T19:29:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:29:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:39.079768+0000", 2024-04-01T19:29:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0876999999999999e-05 2024-04-01T19:29:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:29:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:39.079775+0000", 2024-04-01T19:29:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2309999999999999e-06 2024-04-01T19:29:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:29:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:39.082493+0000", 2024-04-01T19:29:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0027180260000000001 2024-04-01T19:29:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:29:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:39.082533+0000", 2024-04-01T19:29:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9748e-05 2024-04-01T19:29:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:29:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:39.116674+0000", 2024-04-01T19:29:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.034141219 2024-04-01T19:29:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:29:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:39.116705+0000", 2024-04-01T19:29:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.1146999999999998e-05 2024-04-01T19:29:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:29:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:241432 2.e e155/106 2:793fe45a:::benchmark_data_smithi188_77607_object74028:head v 155'15323, mlcod=155'15318)", 2024-04-01T19:29:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:27:39.083594+0000", 2024-04-01T19:29:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 111.218351113, 2024-04-01T19:29:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.033134375000000001, 2024-04-01T19:29:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:29:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:29:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:29:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:29:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:39.083594+0000", 2024-04-01T19:29:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:29:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:39.083594+0000", 2024-04-01T19:29:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:29:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:39.083596+0000", 2024-04-01T19:29:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.782e-06 2024-04-01T19:29:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:29:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:39.083604+0000", 2024-04-01T19:29:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2579999999999995e-06 2024-04-01T19:29:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:29:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:39.083618+0000", 2024-04-01T19:29:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4241e-05 2024-04-01T19:29:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:29:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:39.083627+0000", 2024-04-01T19:29:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8850000000000005e-06 2024-04-01T19:29:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:29:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:39.100925+0000", 2024-04-01T19:29:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.017297709000000001 2024-04-01T19:29:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:29:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:39.100949+0000", 2024-04-01T19:29:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3969999999999999e-05 2024-04-01T19:29:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:29:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:39.116707+0000", 2024-04-01T19:29:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.015758340999999999 2024-04-01T19:29:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:29:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:39.116728+0000", 2024-04-01T19:29:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1189e-05 2024-04-01T19:29:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:29:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:272308 2.e e176/106 2:7577c2d3:::benchmark_data_smithi188_77607_object104904:head v 176'17279, mlcod=176'17275)", 2024-04-01T19:29:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:45.484162+0000", 2024-04-01T19:29:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 44.817782700000002, 2024-04-01T19:29:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.033189868999999997, 2024-04-01T19:29:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:29:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:29:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:29:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:29:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.484162+0000", 2024-04-01T19:29:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:29:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.484162+0000", 2024-04-01T19:29:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:29:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.484163+0000", 2024-04-01T19:29:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8699999999999995e-07 2024-04-01T19:29:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:29:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.484171+0000", 2024-04-01T19:29:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4950000000000008e-06 2024-04-01T19:29:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:29:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.484178+0000", 2024-04-01T19:29:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.7050000000000002e-06 2024-04-01T19:29:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:29:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.484183+0000", 2024-04-01T19:29:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.135e-06 2024-04-01T19:29:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:29:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.490320+0000", 2024-04-01T19:29:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0061369199999999997 2024-04-01T19:29:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:29:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.490342+0000", 2024-04-01T19:29:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2243e-05 2024-04-01T19:29:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:29:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.517309+0000", 2024-04-01T19:29:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.026966758 2024-04-01T19:29:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:29:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.517352+0000", 2024-04-01T19:29:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.3126e-05 2024-04-01T19:29:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:29:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:274503 2.e e177/106 2:73b9eb6e:::benchmark_data_smithi188_77607_object107099:head v 177'17408, mlcod=177'17404)", 2024-04-01T19:29:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:47.374276+0000", 2024-04-01T19:29:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 42.927668801999999, 2024-04-01T19:29:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.032644351000000002, 2024-04-01T19:29:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:29:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:29:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:29:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:29:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:47.374276+0000", 2024-04-01T19:29:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:29:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:47.374276+0000", 2024-04-01T19:29:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:29:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:47.374277+0000", 2024-04-01T19:29:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1400000000000001e-06 2024-04-01T19:29:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:29:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:47.374284+0000", 2024-04-01T19:29:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2870000000000001e-06 2024-04-01T19:29:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:29:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:47.374296+0000", 2024-04-01T19:29:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2381999999999999e-05 2024-04-01T19:29:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:29:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:47.374303+0000", 2024-04-01T19:29:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.7229999999999998e-06 2024-04-01T19:29:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:29:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:47.379680+0000", 2024-04-01T19:29:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0053767720000000001 2024-04-01T19:29:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:29:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:47.379696+0000", 2024-04-01T19:29:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6084000000000001e-05 2024-04-01T19:29:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:29:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:47.406870+0000", 2024-04-01T19:29:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.027174001 2024-04-01T19:29:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:29:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:47.406921+0000", 2024-04-01T19:29:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0961999999999998e-05 2024-04-01T19:29:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:29:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:308091 2.6 e178/173 2:617da165:::benchmark_data_smithi188_77607_object140687:head v 178'19243, mlcod=178'19241)", 2024-04-01T19:29:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:29:15.110889+0000", 2024-04-01T19:29:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 15.191056254999999, 2024-04-01T19:29:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.035059963, 2024-04-01T19:29:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:29:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:29:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:29:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:29:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:15.110889+0000", 2024-04-01T19:29:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:29:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:15.110889+0000", 2024-04-01T19:29:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:29:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:15.110890+0000", 2024-04-01T19:29:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4219999999999999e-06 2024-04-01T19:29:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:29:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:15.110898+0000", 2024-04-01T19:29:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2430000000000005e-06 2024-04-01T19:29:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:29:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:15.110909+0000", 2024-04-01T19:29:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0847e-05 2024-04-01T19:29:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:29:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:15.110916+0000", 2024-04-01T19:29:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.1609999999999997e-06 2024-04-01T19:29:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:29:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:15.112714+0000", 2024-04-01T19:29:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.001797545 2024-04-01T19:29:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:29:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:15.112735+0000", 2024-04-01T19:29:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0965999999999999e-05 2024-04-01T19:29:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:29:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:15.141440+0000", 2024-04-01T19:29:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.028704665000000001 2024-04-01T19:29:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:29:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:15.145949+0000", 2024-04-01T19:29:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0045091139999999998 2024-04-01T19:29:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:29:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:308093 2.e e178/106 2:707ed3de:::benchmark_data_smithi188_77607_object140689:head v 178'19520, mlcod=178'19517)", 2024-04-01T19:29:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:29:15.112719+0000", 2024-04-01T19:29:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 15.189226395, 2024-04-01T19:29:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.033270749000000002, 2024-04-01T19:29:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:29:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:29:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:29:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:29:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:15.112719+0000", 2024-04-01T19:29:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:29:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:15.112719+0000", 2024-04-01T19:29:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:29:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:15.112720+0000", 2024-04-01T19:29:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3680000000000001e-06 2024-04-01T19:29:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:29:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:15.112728+0000", 2024-04-01T19:29:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9009999999999994e-06 2024-04-01T19:29:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:29:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:15.112738+0000", 2024-04-01T19:29:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0098999999999999e-05 2024-04-01T19:29:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:29:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:15.112745+0000", 2024-04-01T19:29:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3640000000000001e-06 2024-04-01T19:29:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:29:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:15.114484+0000", 2024-04-01T19:29:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.001738346 2024-04-01T19:29:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:29:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:15.114508+0000", 2024-04-01T19:29:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4464000000000002e-05 2024-04-01T19:29:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:29:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:15.145953+0000", 2024-04-01T19:29:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.031444569999999998 2024-04-01T19:29:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:29:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:15.145989+0000", 2024-04-01T19:29:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.6637000000000002e-05 2024-04-01T19:29:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:29:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:309234 2.6 e178/173 2:670a9ae6:::benchmark_data_smithi188_77607_object141830:head v 178'19310, mlcod=178'19306)", 2024-04-01T19:29:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:29:16.050318+0000", 2024-04-01T19:29:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 14.251626947, 2024-04-01T19:29:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.036186409000000003, 2024-04-01T19:29:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:29:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:29:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:29:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:29:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.050318+0000", 2024-04-01T19:29:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:29:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.050318+0000", 2024-04-01T19:29:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:29:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.050320+0000", 2024-04-01T19:29:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9999999999999999e-06 2024-04-01T19:29:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:29:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.050331+0000", 2024-04-01T19:29:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.094e-05 2024-04-01T19:29:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:29:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.050344+0000", 2024-04-01T19:29:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2791e-05 2024-04-01T19:29:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:29:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.050352+0000", 2024-04-01T19:29:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4570000000000005e-06 2024-04-01T19:29:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:29:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.065559+0000", 2024-04-01T19:29:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.015206447999999999 2024-04-01T19:29:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:29:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.065579+0000", 2024-04-01T19:29:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0701999999999999e-05 2024-04-01T19:29:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:29:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.086474+0000", 2024-04-01T19:29:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.020894807000000001 2024-04-01T19:29:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:29:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.086504+0000", 2024-04-01T19:29:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.0264e-05 2024-04-01T19:29:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:29:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:310180 2.e e178/106 2:7d2c8628:::benchmark_data_smithi188_77607_object142776:head v 178'19658, mlcod=178'19653)", 2024-04-01T19:29:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:29:16.883642+0000", 2024-04-01T19:29:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 13.418302730000001, 2024-04-01T19:29:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.033592037999999998, 2024-04-01T19:29:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:29:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:29:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:29:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:29:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.883642+0000", 2024-04-01T19:29:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:29:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.883642+0000", 2024-04-01T19:29:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:29:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.883644+0000", 2024-04-01T19:29:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8029999999999999e-06 2024-04-01T19:29:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:29:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.883652+0000", 2024-04-01T19:29:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4800000000000004e-06 2024-04-01T19:29:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:29:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.883664+0000", 2024-04-01T19:29:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2670000000000001e-05 2024-04-01T19:29:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:29:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.883673+0000", 2024-04-01T19:29:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3350000000000007e-06 2024-04-01T19:29:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:29:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.890376+0000", 2024-04-01T19:29:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0067037290000000003 2024-04-01T19:29:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:29:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.890397+0000", 2024-04-01T19:29:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1158999999999999e-05 2024-04-01T19:29:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:29:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.917189+0000", 2024-04-01T19:29:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.026791845000000002 2024-04-01T19:29:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:29:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.917234+0000", 2024-04-01T19:29:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5016999999999999e-05 2024-04-01T19:29:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:29:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:310182 2.1 e178/106 2:812cdd6c:::benchmark_data_smithi188_77607_object142778:head v 178'19343, mlcod=178'19341)", 2024-04-01T19:29:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:29:16.883690+0000", 2024-04-01T19:29:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 13.418254864, 2024-04-01T19:29:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.033996427000000003, 2024-04-01T19:29:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:29:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:29:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:29:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:29:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.883690+0000", 2024-04-01T19:29:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:29:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.883690+0000", 2024-04-01T19:29:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:29:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.883691+0000", 2024-04-01T19:29:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.06e-07 2024-04-01T19:29:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:29:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.883695+0000", 2024-04-01T19:29:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4179999999999999e-06 2024-04-01T19:29:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:29:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.883703+0000", 2024-04-01T19:29:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.8329999999999994e-06 2024-04-01T19:29:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:29:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.883708+0000", 2024-04-01T19:29:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6739999999999996e-06 2024-04-01T19:29:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:29:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.885724+0000", 2024-04-01T19:29:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0020161670000000001 2024-04-01T19:29:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:29:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.885745+0000", 2024-04-01T19:29:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1373999999999999e-05 2024-04-01T19:29:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:29:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.917651+0000", 2024-04-01T19:29:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.031906263999999997 2024-04-01T19:29:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:29:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.917687+0000", 2024-04-01T19:29:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5191000000000002e-05 2024-04-01T19:29:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:29:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:325819 2.6 e181/173 2:60609339:::benchmark_data_smithi188_77607_object158415:head v 181'20376, mlcod=181'20374)", 2024-04-01T19:29:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:29:29.679856+0000", 2024-04-01T19:29:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.62208881699999996, 2024-04-01T19:29:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.034537531000000003, 2024-04-01T19:29:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:29:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:29:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:29:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:29:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:29.679856+0000", 2024-04-01T19:29:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:29:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:29.679856+0000", 2024-04-01T19:29:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:29:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:29.679858+0000", 2024-04-01T19:29:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5060000000000001e-06 2024-04-01T19:29:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:29:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:29.679867+0000", 2024-04-01T19:29:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8899999999999996e-06 2024-04-01T19:29:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:29:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:29.679878+0000", 2024-04-01T19:29:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1664e-05 2024-04-01T19:29:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:29:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:29.679886+0000", 2024-04-01T19:29:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.1429999999999998e-06 2024-04-01T19:29:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:29:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:29.679970+0000", 2024-04-01T19:29:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4021000000000001e-05 2024-04-01T19:29:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:29:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:29.679992+0000", 2024-04-01T19:29:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1746000000000002e-05 2024-04-01T19:29:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:29:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:29.714343+0000", 2024-04-01T19:29:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.034350789 2024-04-01T19:29:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:29:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:29.714394+0000", 2024-04-01T19:29:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0772000000000001e-05 2024-04-01T19:29:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:29:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:325820 2.6 e181/173 2:66dffef4:::benchmark_data_smithi188_77607_object158416:head v 181'20377, mlcod=181'20374)", 2024-04-01T19:29:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:29:29.682706+0000", 2024-04-01T19:29:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.61923879599999998, 2024-04-01T19:29:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.035993599000000001, 2024-04-01T19:29:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:29:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:29:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:29:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:29:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:29.682706+0000", 2024-04-01T19:29:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:29:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:29.682706+0000", 2024-04-01T19:29:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:29:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:29:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:29.682707+0000", 2024-04-01T19:29:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4000000000000002e-07 2024-04-01T19:29:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:29:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:29.682711+0000", 2024-04-01T19:29:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.3549999999999998e-06 2024-04-01T19:29:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:29:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:29.682716+0000", 2024-04-01T19:29:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.164e-06 2024-04-01T19:29:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:29:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:29.682720+0000", 2024-04-01T19:29:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1880000000000004e-06 2024-04-01T19:29:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:29:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:29.690304+0000", 2024-04-01T19:29:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0075839219999999999 2024-04-01T19:29:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:29:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:29.690324+0000", 2024-04-01T19:29:30.400 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0024999999999999e-05 2024-04-01T19:29:30.400 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.400 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.400 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:29:30.400 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:29.718627+0000", 2024-04-01T19:29:30.400 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.028303045999999998 2024-04-01T19:29:30.400 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:29:30.400 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:29:30.400 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:29:30.400 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:29.718700+0000", 2024-04-01T19:29:30.400 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2359000000000003e-05 2024-04-01T19:29:30.400 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.400 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:29:30.400 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.400 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:29:30.401 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:29:30.401 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:29:30.401 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:29:30.437 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:30.461 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:29:30.465 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:30.466 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:29:30.567 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:29:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:30.624 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:29:30.633 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:30.634 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:29:30.735 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:29:30.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:30 smithi022 ceph-mon[39439]: pgmap v560: 17 pgs: 17 active+clean; 860 MiB data, 2.7 GiB used, 981 GiB / 983 GiB avail; 0 B/s wr, 999 op/s 2024-04-01T19:29:30.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:30.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:30.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:30.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:30.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:30.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:30.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:30.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:30.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:30.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:30 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/858868932' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:29:30.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:30 smithi022 ceph-mon[39439]: from='client.25051 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:29:30.769 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:30 smithi188 ceph-mon[43939]: pgmap v560: 17 pgs: 17 active+clean; 860 MiB data, 2.7 GiB used, 981 GiB / 983 GiB avail; 0 B/s wr, 999 op/s 2024-04-01T19:29:30.769 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:30.769 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:30.769 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:30.769 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:30.769 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:30.769 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:30.769 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:30.769 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:30.769 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:30.769 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:30 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/858868932' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:29:30.770 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:30 smithi188 ceph-mon[43939]: from='client.25051 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:29:30.770 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:30.798 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:29:30.800 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:30.801 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:29:30.839 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:29:30.901 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:29:30.933 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:30.959 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:29:30.964 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:30.965 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:29:31.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:30 smithi062 ceph-mon[44211]: pgmap v560: 17 pgs: 17 active+clean; 860 MiB data, 2.7 GiB used, 981 GiB / 983 GiB avail; 0 B/s wr, 999 op/s 2024-04-01T19:29:31.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:31.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:31.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:31.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:31.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:31.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:31.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:31.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:31.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:31.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:30 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/858868932' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:29:31.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:30 smithi062 ceph-mon[44211]: from='client.25051 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:29:31.065 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:29:31.101 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:31.123 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:29:31.130 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:31.131 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:29:31.232 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:29:31.262 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:31.297 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:29:31.304 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:31.304 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:29:31.405 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:29:31.465 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:31.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:31.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:31.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:31 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:29:31.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:31 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:29:31.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:31 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:29:31.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:31 smithi022 ceph-mon[39439]: from='client.25051 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:29:31.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:31 smithi022 ceph-mon[39439]: osdmap e182: 12 total, 11 up, 11 in 2024-04-01T19:29:31.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:31.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:31.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:31 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:29:31.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:31 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:29:31.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:31 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:29:31.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:31 smithi188 ceph-mon[43939]: from='client.25051 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:29:31.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:31 smithi188 ceph-mon[43939]: osdmap e182: 12 total, 11 up, 11 in 2024-04-01T19:29:32.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:32.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:32.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:31 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:29:32.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:31 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:29:32.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:31 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:29:32.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:31 smithi062 ceph-mon[44211]: from='client.25051 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:29:32.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:31 smithi062 ceph-mon[44211]: osdmap e182: 12 total, 11 up, 11 in 2024-04-01T19:29:32.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:32 smithi022 ceph-mon[39439]: pgmap v561: 17 pgs: 17 active+clean; 599 MiB data, 2.3 GiB used, 981 GiB / 983 GiB avail; 0 B/s wr, 1.32k op/s 2024-04-01T19:29:32.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:32 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:29:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:32 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:29:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:32 smithi022 ceph-mon[39439]: osdmap e183: 12 total, 11 up, 11 in 2024-04-01T19:29:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:32 smithi188 ceph-mon[43939]: pgmap v561: 17 pgs: 17 active+clean; 599 MiB data, 2.3 GiB used, 981 GiB / 983 GiB avail; 0 B/s wr, 1.32k op/s 2024-04-01T19:29:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:32 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:29:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:32 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:29:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:32 smithi188 ceph-mon[43939]: osdmap e183: 12 total, 11 up, 11 in 2024-04-01T19:29:33.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:32 smithi062 ceph-mon[44211]: pgmap v561: 17 pgs: 17 active+clean; 599 MiB data, 2.3 GiB used, 981 GiB / 983 GiB avail; 0 B/s wr, 1.32k op/s 2024-04-01T19:29:33.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:32 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:29:33.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:32 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:29:33.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:32 smithi062 ceph-mon[44211]: osdmap e183: 12 total, 11 up, 11 in 2024-04-01T19:29:34.407 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:29:34.408 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:29:34.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:34 smithi022 ceph-mon[39439]: pgmap v564: 17 pgs: 17 active+clean; 530 MiB data, 2.0 GiB used, 981 GiB / 983 GiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:29:34.849 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:29:34.853 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:34.854 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:29:34.871 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_ops_in_flight 2024-04-01T19:29:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:34 smithi188 ceph-mon[43939]: pgmap v564: 17 pgs: 17 active+clean; 530 MiB data, 2.0 GiB used, 981 GiB / 983 GiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:29:34.903 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:34 smithi062 ceph-mon[44211]: pgmap v564: 17 pgs: 17 active+clean; 530 MiB data, 2.0 GiB used, 981 GiB / 983 GiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:29:34.955 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:29:34.982 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:35.007 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:29:35.010 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:35.011 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:29:35.112 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:29:35.172 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:35.256 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:29:35.394 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:29:35.398 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:35.398 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:29:35.499 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:29:35.528 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:35.555 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:29:35.559 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:35.559 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:29:35.660 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:29:35.690 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:35.714 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:29:35.716 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:35.717 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:29:35.817 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:29:35.851 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:35.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:35 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:29:35.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:35 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:29:35.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:35 smithi022 ceph-mon[39439]: osdmap e184: 12 total, 11 up, 11 in 2024-04-01T19:29:35.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:35 smithi022 ceph-mon[39439]: pgmap v566: 17 pgs: 17 active+clean; 364 MiB data, 1.8 GiB used, 982 GiB / 983 GiB avail; 0 B/s wr, 1.32k op/s 2024-04-01T19:29:35.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:35 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:29:35.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:35 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:29:35.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:35 smithi188 ceph-mon[43939]: osdmap e184: 12 total, 11 up, 11 in 2024-04-01T19:29:35.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:35 smithi188 ceph-mon[43939]: pgmap v566: 17 pgs: 17 active+clean; 364 MiB data, 1.8 GiB used, 982 GiB / 983 GiB avail; 0 B/s wr, 1.32k op/s 2024-04-01T19:29:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:35 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:29:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:35 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:29:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:35 smithi062 ceph-mon[44211]: osdmap e184: 12 total, 11 up, 11 in 2024-04-01T19:29:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:35 smithi062 ceph-mon[44211]: pgmap v566: 17 pgs: 17 active+clean; 364 MiB data, 1.8 GiB used, 982 GiB / 983 GiB avail; 0 B/s wr, 1.32k op/s 2024-04-01T19:29:36.408 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:29:36.854 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:29:36.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:36 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:29:36.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:36 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:29:36.889 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Removed 167401 objects 2024-04-01T19:29:36.889 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Clean up completed and total clean up time :181.202 2024-04-01T19:29:37.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:36 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:29:37.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:36 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:29:37.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:36 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:29:37.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:36 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:29:37.438 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:29:37.508 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:29:37.511 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:37.511 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:29:37.612 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:29:37.640 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:37.658 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:29:37.661 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:37.661 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:29:37.755 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:37 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:29:37.755 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:37 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:29:37.755 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:37 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:29:37.755 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:37 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:29:37.755 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:37 smithi062 ceph-mon[44211]: osdmap e185: 12 total, 11 up, 11 in 2024-04-01T19:29:37.755 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:37 smithi062 ceph-mon[44211]: pgmap v568: 17 pgs: 17 active+clean; 159 MiB data, 1.4 GiB used, 982 GiB / 983 GiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:29:37.762 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:29:37.789 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:38.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:37 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:29:38.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:37 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:29:38.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:37 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:29:38.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:37 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:29:38.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:37 smithi022 ceph-mon[39439]: osdmap e185: 12 total, 11 up, 11 in 2024-04-01T19:29:38.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:37 smithi022 ceph-mon[39439]: pgmap v568: 17 pgs: 17 active+clean; 159 MiB data, 1.4 GiB used, 982 GiB / 983 GiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:29:38.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:37 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:29:38.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:37 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:29:38.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:37 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:29:38.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:37 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:29:38.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:37 smithi188 ceph-mon[43939]: osdmap e185: 12 total, 11 up, 11 in 2024-04-01T19:29:38.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:37 smithi188 ceph-mon[43939]: pgmap v568: 17 pgs: 17 active+clean; 159 MiB data, 1.4 GiB used, 982 GiB / 983 GiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:29:38.183 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:29:38.438 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:29:38.440 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:38.441 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:29:38.542 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:29:38.579 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:38.781 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:29:38.784 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:38.784 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:29:38.885 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:29:38.916 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:38.939 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_0 2024-04-01T19:29:38.940 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-04-01T19:29:39.065 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:29:39.067 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:39.068 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:29:39.169 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:29:39.199 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:39.220 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:29:39.223 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:39.223 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:29:39.306 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:29:39.308 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:29:39.324 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:29:39.329 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:29:39.348 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:29:39.349 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:29:39.349 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 0 2024-04-01T19:29:39.349 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:29:39.349 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:29:39.352 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:39.369 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:29:39.373 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:29:39.375 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:39.376 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:29:39.389 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:29:39.408 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:29:39.428 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:29:39.448 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:29:39.468 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:29:39.477 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:29:39.489 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:29:39.508 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:39.509 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:29:39.509 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:29:39.509 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:29:39.509 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:29:39.509 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:29:39.510 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:29:39.510 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:29:39.510 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:29:39.510 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:29:39.510 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.8 2024-04-01T19:29:39.510 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:29:39.510 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:29:39.510 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:29:39.530 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:29:39.532 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:39.533 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:29:39.634 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:29:39.663 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:39 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:29:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:39 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:29:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:39 smithi022 ceph-mon[39439]: osdmap e186: 12 total, 11 up, 11 in 2024-04-01T19:29:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:39 smithi022 ceph-mon[39439]: pgmap v570: 17 pgs: 17 active+clean; 98 MiB data, 1.2 GiB used, 982 GiB / 983 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:29:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:39 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3775631084' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:29:39.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:39 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:29:39.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:39 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:29:39.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:39 smithi188 ceph-mon[43939]: osdmap e186: 12 total, 11 up, 11 in 2024-04-01T19:29:39.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:39 smithi188 ceph-mon[43939]: pgmap v570: 17 pgs: 17 active+clean; 98 MiB data, 1.2 GiB used, 982 GiB / 983 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:29:39.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:39 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3775631084' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:29:40.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:39 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:29:40.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:39 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:29:40.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:39 smithi062 ceph-mon[44211]: osdmap e186: 12 total, 11 up, 11 in 2024-04-01T19:29:40.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:39 smithi062 ceph-mon[44211]: pgmap v570: 17 pgs: 17 active+clean; 98 MiB data, 1.2 GiB used, 982 GiB / 983 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:29:40.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:39 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3775631084' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:29:40.112 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:29:40.115 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:40.116 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:29:40.129 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_blocked_ops 2024-04-01T19:29:40.217 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:29:40.244 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:40.263 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:29:40.265 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:40.265 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:29:40.366 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:29:40.396 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:40.444 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:29:40.544 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:29:40.548 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:40.548 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:29:40.649 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:29:40.682 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:40.703 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:29:40.705 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:40.706 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:29:40.807 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:29:40.836 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:40.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:40.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:40.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:40.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:40.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:40.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:40.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:40.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:40.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:40.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:40.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:40.934 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:29:40.936 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:40.936 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:40.936 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:40.936 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:40.937 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:40.937 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:40.937 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:40.937 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:40.937 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:40.937 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:40.937 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:40.937 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:40.938 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:29:41.039 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:29:41.069 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:41.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:41.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:41.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:41.462 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:29:41.462 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:29:41.618 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:29:41.640 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:41.641 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:29:41.742 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:29:41.773 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:41.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:41 smithi022 ceph-mon[39439]: pgmap v571: 17 pgs: 17 active+clean; 3.4 MiB data, 1.1 GiB used, 982 GiB / 983 GiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:29:41.949 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:41 smithi062 ceph-mon[44211]: pgmap v571: 17 pgs: 17 active+clean; 3.4 MiB data, 1.1 GiB used, 982 GiB / 983 GiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:29:41.972 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:29:41.975 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:41.975 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:29:42.076 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:29:42.105 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:42.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:41 smithi188 ceph-mon[43939]: pgmap v571: 17 pgs: 17 active+clean; 3.4 MiB data, 1.1 GiB used, 982 GiB / 983 GiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:29:42.204 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:29:42.206 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:42.207 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:29:42.240 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:29:42.240 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:29:42.307 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:29:42.336 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:42.462 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:29:42.464 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:42.464 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:29:42.565 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:29:42.596 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:42.616 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:29:42.619 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:42.620 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:29:42.685 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:29:42.721 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:29:42.747 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:42 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2910027241' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:29:42.750 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:42.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:42 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2910027241' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:29:43.059 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_historic_ops 2024-04-01T19:29:43.099 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:29:43.101 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:43.102 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:29:43.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:42 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2910027241' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:29:43.202 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:29:43.234 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:43.256 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:29:43.258 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:43.259 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:29:43.359 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:29:43.369 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:29:43.389 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:43.409 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:29:43.411 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:43.412 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:29:43.463 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:29:43.512 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:29:43.540 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:43.560 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:29:43.563 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:43.563 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:29:43.664 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:29:43.700 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:43.716 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'unique_pool_0' removed 2024-04-01T19:29:43.728 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:29:43.734 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:43.734 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:29:43.761 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:29:43.834 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:29:43.862 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:43.864 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:43 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:29:43.865 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:43 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2910027241' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:29:43.865 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:43 smithi062 ceph-mon[44211]: osdmap e187: 12 total, 11 up, 11 in 2024-04-01T19:29:43.865 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:43 smithi062 ceph-mon[44211]: pgmap v573: 17 pgs: 17 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail; 0 B/s wr, 415 op/s 2024-04-01T19:29:43.865 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:43 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1088312939' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:29:43.865 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:43 smithi062 ceph-mon[44211]: from='client.35108 ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:29:43.881 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:29:43.884 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:43.884 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:29:43.985 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:29:44.010 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:43 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:29:44.010 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:43 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2910027241' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:29:44.011 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:43 smithi188 ceph-mon[43939]: osdmap e187: 12 total, 11 up, 11 in 2024-04-01T19:29:44.011 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:43 smithi188 ceph-mon[43939]: pgmap v573: 17 pgs: 17 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail; 0 B/s wr, 415 op/s 2024-04-01T19:29:44.011 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:43 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1088312939' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:29:44.011 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:43 smithi188 ceph-mon[43939]: from='client.35108 ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:29:44.012 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:44.030 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:29:44.032 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:44.033 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:29:44.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:43 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:29:44.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:43 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2910027241' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:29:44.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:43 smithi022 ceph-mon[39439]: osdmap e187: 12 total, 11 up, 11 in 2024-04-01T19:29:44.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:43 smithi022 ceph-mon[39439]: pgmap v573: 17 pgs: 17 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail; 0 B/s wr, 415 op/s 2024-04-01T19:29:44.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:43 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1088312939' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:29:44.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:43 smithi022 ceph-mon[39439]: from='client.35108 ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:29:44.133 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:29:44.159 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:44.177 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:29:44.179 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:44.180 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:29:44.281 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:29:44.307 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:44.325 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:29:44.327 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:44.327 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:29:44.428 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:29:44.461 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:44.610 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:29:44.614 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:44.615 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:29:44.716 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:29:44.743 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:44.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:44 smithi022 ceph-mon[39439]: from='client.35108 ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T19:29:44.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:44 smithi022 ceph-mon[39439]: osdmap e188: 12 total, 11 up, 11 in 2024-04-01T19:29:44.888 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:44 smithi062 ceph-mon[44211]: from='client.35108 ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T19:29:44.888 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:44 smithi062 ceph-mon[44211]: osdmap e188: 12 total, 11 up, 11 in 2024-04-01T19:29:44.893 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:29:44.896 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:44.896 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:29:44.943 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-04-01T19:29:44.944 INFO:tasks.radosbench:Beginning radosbench... 2024-04-01T19:29:44.944 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_1 2024-04-01T19:29:44.944 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pool create unique_pool_1 16 2024-04-01T19:29:44.996 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:29:45.025 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:45.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:44 smithi188 ceph-mon[43939]: from='client.35108 ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T19:29:45.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:44 smithi188 ceph-mon[43939]: osdmap e188: 12 total, 11 up, 11 in 2024-04-01T19:29:45.181 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:29:45.184 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:45.185 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:29:45.205 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:29:45.205 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:29:45.286 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:29:45.314 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:45.383 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:29:45.974 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:45 smithi022 ceph-mon[39439]: pgmap v575: 1 pgs: 1 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail 2024-04-01T19:29:46.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:45 smithi062 ceph-mon[44211]: pgmap v575: 1 pgs: 1 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail 2024-04-01T19:29:46.049 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_ops_in_flight 2024-04-01T19:29:46.063 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:29:46.066 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:46.066 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:29:46.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:45 smithi188 ceph-mon[43939]: pgmap v575: 1 pgs: 1 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail 2024-04-01T19:29:46.167 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:29:46.181 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:29:46.181 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:29:46.202 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:46.238 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:29:46.257 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:29:46.276 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:29:46.296 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:29:46.316 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:29:46.337 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:29:46.338 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:29:46.359 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:29:46.379 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:29:46.400 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:29:46.424 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:29:46.446 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:29:46.447 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:29:46.447 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:29:46.447 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:29:46.447 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:29:46.447 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:29:46.447 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:29:46.447 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:29:46.447 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:29:46.447 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.8 2024-04-01T19:29:46.447 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:29:46.447 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:29:46.447 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:29:46.457 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:29:46.460 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:46.460 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:29:46.561 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:29:46.593 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:46.614 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:29:46.617 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:46.617 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:29:46.718 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:29:46.746 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:46.848 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:46 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:29:46.848 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:46 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:29:46.848 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:46 smithi062 ceph-mon[44211]: osdmap e189: 12 total, 11 up, 11 in 2024-04-01T19:29:46.848 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:46 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/671724968' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:29:46.848 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:46.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:46 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:29:46.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:46 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:29:46.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:46 smithi188 ceph-mon[43939]: osdmap e189: 12 total, 11 up, 11 in 2024-04-01T19:29:46.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:46 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/671724968' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:29:46.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:47.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:46 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:29:47.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:46 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:29:47.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:46 smithi022 ceph-mon[39439]: osdmap e189: 12 total, 11 up, 11 in 2024-04-01T19:29:47.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:46 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/671724968' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:29:47.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:47.918 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:47.918 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:47.918 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:47.918 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:47.918 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:47.918 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:47.918 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:47.918 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:47.918 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:47.919 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:47.919 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:47 smithi062 ceph-mon[44211]: pgmap v577: 1 pgs: 1 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail 2024-04-01T19:29:48.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:48.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:48.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:48.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:48.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:48.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:48.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:48.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:48.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:48.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:48.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:47 smithi022 ceph-mon[39439]: pgmap v577: 1 pgs: 1 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail 2024-04-01T19:29:48.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:48.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:48.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:48.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:48.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:48.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:48.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:48.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:48.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:48.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:48.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:47 smithi188 ceph-mon[43939]: pgmap v577: 1 pgs: 1 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail 2024-04-01T19:29:48.198 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:29:48.198 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:29:48.198 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 0 2024-04-01T19:29:48.198 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:29:48.237 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:29:48.238 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:29:48.852 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:48 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:29:48.853 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:48 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:29:48.853 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:48 smithi062 ceph-mon[44211]: osdmap e190: 12 total, 11 up, 11 in 2024-04-01T19:29:48.854 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_blocked_ops 2024-04-01T19:29:48.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:48 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:29:48.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:48 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:29:48.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:48 smithi022 ceph-mon[39439]: osdmap e190: 12 total, 11 up, 11 in 2024-04-01T19:29:49.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:48 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:29:49.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:48 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:29:49.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:48 smithi188 ceph-mon[43939]: osdmap e190: 12 total, 11 up, 11 in 2024-04-01T19:29:49.129 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:29:49.197 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:29:49.200 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:49.201 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:29:49.301 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:29:49.337 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:49.358 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:29:49.360 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:49.361 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:29:49.462 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:29:49.491 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:49.511 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:29:49.513 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:49.514 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:29:49.614 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:29:49.642 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:49.661 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:29:49.663 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:49.664 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:29:49.706 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:49 smithi022 ceph-mon[39439]: pgmap v579: 1 pgs: 1 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail 2024-04-01T19:29:49.765 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:29:49.791 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:49.810 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:29:49.813 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:49.813 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:29:49.914 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:29:49.946 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:29:49.969 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:49.969 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:29:50.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:49 smithi062 ceph-mon[44211]: pgmap v579: 1 pgs: 1 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail 2024-04-01T19:29:50.069 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:29:50.094 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:49 smithi188 ceph-mon[43939]: pgmap v579: 1 pgs: 1 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail 2024-04-01T19:29:50.096 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:50.115 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:29:50.118 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:50.118 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:29:50.219 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:29:50.239 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:29:50.248 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:50.269 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:29:50.271 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:50.272 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:29:50.373 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:29:50.399 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:50.418 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:29:50.420 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:50.421 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:29:50.522 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:29:50.526 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:29:50.554 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:50.654 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:29:50.656 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:50.657 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:29:50.758 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:29:50.790 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:50.816 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:29:50.818 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:50.819 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:29:50.823 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'unique_pool_1' created 2024-04-01T19:29:50.828 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:29:50.912 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:29:50.913 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:29:50.913 INFO:teuthology.orchestra.run.smithi062.stdout: "complaint_time": 30, 2024-04-01T19:29:50.913 INFO:teuthology.orchestra.run.smithi062.stdout: "num_blocked_ops": 0 2024-04-01T19:29:50.913 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:29:50.919 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:29:50.935 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:50 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1640988166' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]: dispatch 2024-04-01T19:29:50.935 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:50 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2203155201' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:29:50.935 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:50 smithi062 ceph-mon[44211]: from='client.35126 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:29:50.947 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:51.096 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:29:51.098 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:50 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1640988166' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]: dispatch 2024-04-01T19:29:51.098 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:50 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2203155201' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:29:51.098 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:50 smithi022 ceph-mon[39439]: from='client.35126 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:29:51.099 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:51.099 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:29:51.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:50 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1640988166' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]: dispatch 2024-04-01T19:29:51.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:50 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2203155201' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:29:51.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:50 smithi188 ceph-mon[43939]: from='client.35126 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:29:51.200 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:29:51.265 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:51.286 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:29:51.289 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:51.289 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:29:51.390 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:29:51.420 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:51.620 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:29:51.623 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:51.623 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:29:51.648 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_historic_ops 2024-04-01T19:29:51.725 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:29:51.756 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:51.777 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:29:51.780 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:51.780 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:29:51.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:51 smithi022 ceph-mon[39439]: pgmap v580: 1 pgs: 1 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail 2024-04-01T19:29:51.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:51 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:29:51.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:51 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1640988166' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]': finished 2024-04-01T19:29:51.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:51 smithi022 ceph-mon[39439]: from='client.35126 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:29:51.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:51 smithi022 ceph-mon[39439]: osdmap e191: 12 total, 11 up, 11 in 2024-04-01T19:29:51.881 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:29:51.910 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:51.929 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:29:51.931 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:51.932 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:29:51.966 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:29:52.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:51 smithi062 ceph-mon[44211]: pgmap v580: 1 pgs: 1 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail 2024-04-01T19:29:52.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:51 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:29:52.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:51 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1640988166' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]': finished 2024-04-01T19:29:52.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:51 smithi062 ceph-mon[44211]: from='client.35126 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:29:52.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:51 smithi062 ceph-mon[44211]: osdmap e191: 12 total, 11 up, 11 in 2024-04-01T19:29:52.033 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:29:52.058 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:51 smithi188 ceph-mon[43939]: pgmap v580: 1 pgs: 1 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail 2024-04-01T19:29:52.058 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:51 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:29:52.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:51 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1640988166' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]': finished 2024-04-01T19:29:52.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:51 smithi188 ceph-mon[43939]: from='client.35126 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:29:52.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:51 smithi188 ceph-mon[43939]: osdmap e191: 12 total, 11 up, 11 in 2024-04-01T19:29:52.060 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:52.080 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:29:52.082 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:52.083 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:29:52.184 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:29:52.214 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:52.765 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:29:52.768 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:52.769 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:29:52.869 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:29:52.900 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:53.019 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:52 smithi022 ceph-mon[39439]: osdmap e192: 12 total, 11 up, 11 in 2024-04-01T19:29:53.020 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:52 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:29:53.020 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:52 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:29:53.020 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:52 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:29:53.020 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:52 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:29:53.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:52 smithi188 ceph-mon[43939]: osdmap e192: 12 total, 11 up, 11 in 2024-04-01T19:29:53.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:52 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:29:53.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:52 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:29:53.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:52 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:29:53.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:52 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:29:53.148 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:52 smithi062 ceph-mon[44211]: osdmap e192: 12 total, 11 up, 11 in 2024-04-01T19:29:53.148 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:52 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:29:53.148 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:52 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:29:53.148 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:52 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:29:53.148 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:52 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:29:53.149 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:29:53.153 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:53.153 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:29:53.254 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:29:53.286 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:53.307 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:29:53.310 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:53.310 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:29:53.411 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:29:53.445 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:53.575 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pool application enable unique_pool_1 rados --yes-i-really-mean-it || true 2024-04-01T19:29:53.646 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:29:53.648 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:53.649 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:29:53.679 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:29:53.680 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 20, 2024-04-01T19:29:53.680 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 600, 2024-04-01T19:29:53.680 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:29:53.680 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.680 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:141482 2.3 2:cd47f646:::benchmark_data_smithi188_77607_object141481:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:29:53.680 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:09.000819+0000", 2024-04-01T19:29:53.680 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 224.678184547, 2024-04-01T19:29:53.680 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.044661365000000001, 2024-04-01T19:29:53.680 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:29:53.680 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:29:53.680 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:53.680 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:29:53.680 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:29:53.681 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:29:53.681 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 141482 2024-04-01T19:29:53.681 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.681 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:29:53.681 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.681 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:29:53.681 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.000819+0000", 2024-04-01T19:29:53.681 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.681 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.681 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.681 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:29:53.681 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.000819+0000", 2024-04-01T19:29:53.681 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.681 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.682 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.682 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:29:53.682 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.000821+0000", 2024-04-01T19:29:53.682 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.866e-06 2024-04-01T19:29:53.682 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.682 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.682 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:29:53.682 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.000938+0000", 2024-04-01T19:29:53.682 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000117837 2024-04-01T19:29:53.682 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.682 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.682 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:29:53.682 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.000950+0000", 2024-04-01T19:29:53.682 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1965e-05 2024-04-01T19:29:53.683 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.683 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.683 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:29:53.683 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.000958+0000", 2024-04-01T19:29:53.683 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.6090000000000003e-06 2024-04-01T19:29:53.683 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.683 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.683 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:29:53.683 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.001007+0000", 2024-04-01T19:29:53.683 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9070000000000003e-05 2024-04-01T19:29:53.683 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.683 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.683 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:29:53.684 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.001107+0000", 2024-04-01T19:29:53.684 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00010006200000000001 2024-04-01T19:29:53.684 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.684 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.684 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 2", 2024-04-01T19:29:53.684 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.001224+0000", 2024-04-01T19:29:53.684 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000117286 2024-04-01T19:29:53.684 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.684 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.684 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:29:53.684 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.004326+0000", 2024-04-01T19:29:53.684 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.003101206 2024-04-01T19:29:53.684 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.685 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.685 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:29:53.685 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.045412+0000", 2024-04-01T19:29:53.685 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.041086217000000001 2024-04-01T19:29:53.685 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.685 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.685 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:29:53.685 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.045444+0000", 2024-04-01T19:29:53.685 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.2121e-05 2024-04-01T19:29:53.685 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.685 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.685 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:29:53.685 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.045480+0000", 2024-04-01T19:29:53.686 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.6125999999999999e-05 2024-04-01T19:29:53.686 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.686 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:29:53.686 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.686 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.686 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.686 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:141487 2.2 2:4e04f9d1:::benchmark_data_smithi188_77607_object141486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:29:53.686 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:09.005598+0000", 2024-04-01T19:29:53.686 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 224.67340511099999, 2024-04-01T19:29:53.686 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.044332270999999999, 2024-04-01T19:29:53.686 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:29:53.686 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:29:53.687 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:53.687 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:29:53.687 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:29:53.687 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:29:53.687 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 141487 2024-04-01T19:29:53.687 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.687 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:29:53.687 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.687 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:29:53.687 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005598+0000", 2024-04-01T19:29:53.687 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.687 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.687 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.687 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:29:53.688 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005598+0000", 2024-04-01T19:29:53.688 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.688 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.688 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.688 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:29:53.688 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005599+0000", 2024-04-01T19:29:53.688 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.172e-06 2024-04-01T19:29:53.688 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.688 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.688 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:29:53.688 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005662+0000", 2024-04-01T19:29:53.688 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2823999999999993e-05 2024-04-01T19:29:53.688 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.689 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.689 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:29:53.689 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005671+0000", 2024-04-01T19:29:53.689 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.0759999999999992e-06 2024-04-01T19:29:53.689 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.689 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.689 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:29:53.689 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005676+0000", 2024-04-01T19:29:53.689 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.831e-06 2024-04-01T19:29:53.689 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.689 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.689 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:29:53.689 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.009972+0000", 2024-04-01T19:29:53.690 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.004295465 2024-04-01T19:29:53.690 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.690 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.690 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:29:53.690 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.010055+0000", 2024-04-01T19:29:53.690 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.3053000000000006e-05 2024-04-01T19:29:53.690 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.690 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.690 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:29:53.690 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.010159+0000", 2024-04-01T19:29:53.690 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000104505 2024-04-01T19:29:53.690 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.690 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.691 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:29:53.691 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.014280+0000", 2024-04-01T19:29:53.691 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0041208319999999996 2024-04-01T19:29:53.691 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.691 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.691 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:29:53.691 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.049825+0000", 2024-04-01T19:29:53.691 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.035545531999999998 2024-04-01T19:29:53.691 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.691 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.691 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:29:53.691 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.049884+0000", 2024-04-01T19:29:53.691 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8406999999999998e-05 2024-04-01T19:29:53.692 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.692 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.692 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:29:53.692 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.049930+0000", 2024-04-01T19:29:53.692 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6573999999999998e-05 2024-04-01T19:29:53.692 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.692 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:29:53.692 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.692 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.693 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.693 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:141489 2.2 2:420ebb95:::benchmark_data_smithi188_77607_object141488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:29:53.693 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:09.005826+0000", 2024-04-01T19:29:53.693 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 224.67317708900001, 2024-04-01T19:29:53.693 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.044204885999999999, 2024-04-01T19:29:53.693 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:29:53.693 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:29:53.693 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:53.693 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:29:53.694 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:29:53.694 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:29:53.694 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 141489 2024-04-01T19:29:53.694 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.694 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:29:53.694 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.694 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:29:53.694 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005826+0000", 2024-04-01T19:29:53.694 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.694 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.694 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.695 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:29:53.695 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005826+0000", 2024-04-01T19:29:53.695 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.695 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.695 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.695 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:29:53.695 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005827+0000", 2024-04-01T19:29:53.695 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1060000000000001e-06 2024-04-01T19:29:53.695 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.695 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.695 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:29:53.695 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005942+0000", 2024-04-01T19:29:53.695 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000114608 2024-04-01T19:29:53.696 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.696 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.696 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:29:53.696 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005950+0000", 2024-04-01T19:29:53.696 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9650000000000008e-06 2024-04-01T19:29:53.696 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.696 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.696 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:29:53.696 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.005954+0000", 2024-04-01T19:29:53.696 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3329999999999998e-06 2024-04-01T19:29:53.696 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.697 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.697 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:29:53.697 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.012460+0000", 2024-04-01T19:29:53.697 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.006505856 2024-04-01T19:29:53.697 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.697 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.697 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:29:53.697 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.012536+0000", 2024-04-01T19:29:53.697 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.5524000000000004e-05 2024-04-01T19:29:53.697 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.697 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.697 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:29:53.697 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.012629+0000", 2024-04-01T19:29:53.697 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.3004000000000006e-05 2024-04-01T19:29:53.698 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.698 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.698 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:29:53.698 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.014425+0000", 2024-04-01T19:29:53.698 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.001796139 2024-04-01T19:29:53.698 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.698 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.698 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:29:53.698 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.049966+0000", 2024-04-01T19:29:53.698 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.035541352999999998 2024-04-01T19:29:53.698 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.698 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.698 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:29:53.699 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.050003+0000", 2024-04-01T19:29:53.699 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.6551000000000003e-05 2024-04-01T19:29:53.699 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.699 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.699 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:29:53.699 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:09.050031+0000", 2024-04-01T19:29:53.699 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8447000000000001e-05 2024-04-01T19:29:53.699 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.699 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:29:53.699 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.699 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.699 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.699 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:148142 2.3 2:c77187ad:::benchmark_data_smithi188_77607_object148141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:29:53.700 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:14.462669+0000", 2024-04-01T19:29:53.700 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 219.216334512, 2024-04-01T19:29:53.700 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.052882452000000003, 2024-04-01T19:29:53.700 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:29:53.700 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:29:53.700 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:53.700 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:29:53.700 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:29:53.700 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:29:53.700 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 148142 2024-04-01T19:29:53.700 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.700 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:29:53.700 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.700 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:29:53.700 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.462669+0000", 2024-04-01T19:29:53.701 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.701 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.701 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.701 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:29:53.701 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.462669+0000", 2024-04-01T19:29:53.701 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.701 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.701 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.701 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:29:53.701 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.462679+0000", 2024-04-01T19:29:53.701 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.9480000000000003e-06 2024-04-01T19:29:53.701 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.701 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.701 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:29:53.701 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.462722+0000", 2024-04-01T19:29:53.702 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3210999999999997e-05 2024-04-01T19:29:53.702 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.702 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.702 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:29:53.702 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.462733+0000", 2024-04-01T19:29:53.702 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1158999999999999e-05 2024-04-01T19:29:53.702 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.702 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.702 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:29:53.702 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.462739+0000", 2024-04-01T19:29:53.702 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3069999999999999e-06 2024-04-01T19:29:53.702 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.703 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.703 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:29:53.703 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.462797+0000", 2024-04-01T19:29:53.703 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7893999999999998e-05 2024-04-01T19:29:53.703 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.703 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.703 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:29:53.703 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.462878+0000", 2024-04-01T19:29:53.703 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0728000000000004e-05 2024-04-01T19:29:53.703 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.703 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.703 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 2", 2024-04-01T19:29:53.703 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.462975+0000", 2024-04-01T19:29:53.704 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.7013000000000001e-05 2024-04-01T19:29:53.704 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.704 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.704 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:29:53.704 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.466973+0000", 2024-04-01T19:29:53.704 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0039982189999999999 2024-04-01T19:29:53.704 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.704 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.704 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:29:53.704 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.515449+0000", 2024-04-01T19:29:53.704 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.048476205000000001 2024-04-01T19:29:53.704 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.705 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.705 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:29:53.705 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.515508+0000", 2024-04-01T19:29:53.705 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8967e-05 2024-04-01T19:29:53.705 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.705 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.705 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:29:53.705 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.515551+0000", 2024-04-01T19:29:53.705 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.2800999999999999e-05 2024-04-01T19:29:53.705 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.705 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:29:53.705 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.705 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.705 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.706 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:148155 2.3 2:ccff6a2f:::benchmark_data_smithi188_77607_object148154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:29:53.706 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:14.470808+0000", 2024-04-01T19:29:53.706 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 219.208195467, 2024-04-01T19:29:53.706 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.044919413999999998, 2024-04-01T19:29:53.706 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:29:53.706 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:29:53.706 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:53.706 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:29:53.706 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:29:53.706 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:29:53.706 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 148155 2024-04-01T19:29:53.706 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.706 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:29:53.707 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.707 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:29:53.707 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.470808+0000", 2024-04-01T19:29:53.707 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.707 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.707 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.707 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:29:53.707 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.470808+0000", 2024-04-01T19:29:53.707 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.707 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.707 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.707 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:29:53.707 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.470810+0000", 2024-04-01T19:29:53.707 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1399999999999998e-06 2024-04-01T19:29:53.708 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.708 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.708 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:29:53.708 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.470857+0000", 2024-04-01T19:29:53.708 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7367999999999998e-05 2024-04-01T19:29:53.708 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.708 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.708 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:29:53.708 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.470870+0000", 2024-04-01T19:29:53.708 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2672e-05 2024-04-01T19:29:53.708 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.708 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.708 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:29:53.709 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.470878+0000", 2024-04-01T19:29:53.709 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.5449999999999998e-06 2024-04-01T19:29:53.709 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.709 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.709 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:29:53.709 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.470933+0000", 2024-04-01T19:29:53.709 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5037999999999997e-05 2024-04-01T19:29:53.709 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.709 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.709 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:29:53.709 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.471026+0000", 2024-04-01T19:29:53.709 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.3801999999999994e-05 2024-04-01T19:29:53.709 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.710 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.710 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 2", 2024-04-01T19:29:53.710 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.471124+0000", 2024-04-01T19:29:53.710 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.7418999999999997e-05 2024-04-01T19:29:53.710 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.710 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.710 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:29:53.710 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.474254+0000", 2024-04-01T19:29:53.710 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0031303030000000001 2024-04-01T19:29:53.710 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.710 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.711 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:29:53.711 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.515616+0000", 2024-04-01T19:29:53.711 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.041361653999999998 2024-04-01T19:29:53.711 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.711 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.711 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:29:53.711 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.515681+0000", 2024-04-01T19:29:53.711 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5426999999999995e-05 2024-04-01T19:29:53.711 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.711 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.711 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:29:53.711 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:14.515727+0000", 2024-04-01T19:29:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6045999999999999e-05 2024-04-01T19:29:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:29:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:175101 2.2 2:4e4e748c:::benchmark_data_smithi188_77607_object7697:head [delete] snapc 0=[] ondisk+write+known_if_redirected e142)", 2024-04-01T19:29:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:43.409250+0000", 2024-04-01T19:29:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 190.26975304000001, 2024-04-01T19:29:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.05683469, 2024-04-01T19:29:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:29:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:29:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:53.712 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:29:53.713 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:29:53.713 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:29:53.713 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 175101 2024-04-01T19:29:53.713 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.713 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:29:53.713 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.713 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:29:53.713 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.409250+0000", 2024-04-01T19:29:53.713 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.713 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.713 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.714 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:29:53.714 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.409250+0000", 2024-04-01T19:29:53.714 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.714 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.714 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.714 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:29:53.714 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.409251+0000", 2024-04-01T19:29:53.714 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3099999999999997e-07 2024-04-01T19:29:53.714 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.714 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:29:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.409253+0000", 2024-04-01T19:29:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3949999999999999e-06 2024-04-01T19:29:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:29:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.409260+0000", 2024-04-01T19:29:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9140000000000002e-06 2024-04-01T19:29:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:29:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.409264+0000", 2024-04-01T19:29:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8639999999999998e-06 2024-04-01T19:29:53.715 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:29:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.413507+0000", 2024-04-01T19:29:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0042429659999999999 2024-04-01T19:29:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:29:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.413614+0000", 2024-04-01T19:29:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00010660800000000001 2024-04-01T19:29:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:29:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.413729+0000", 2024-04-01T19:29:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000114924 2024-04-01T19:29:53.716 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:29:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.418717+0000", 2024-04-01T19:29:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0049883330000000002 2024-04-01T19:29:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:29:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.466007+0000", 2024-04-01T19:29:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.047289987999999998 2024-04-01T19:29:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:29:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.466046+0000", 2024-04-01T19:29:53.717 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8940000000000003e-05 2024-04-01T19:29:53.718 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.718 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.718 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:29:53.718 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.466085+0000", 2024-04-01T19:29:53.718 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9127e-05 2024-04-01T19:29:53.718 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.718 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:29:53.718 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.718 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.718 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.718 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:179823 2.2 2:4dfdb89f:::benchmark_data_smithi188_77607_object12419:head [delete] snapc 0=[] ondisk+write+known_if_redirected e143)", 2024-04-01T19:29:53.719 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:47.058531+0000", 2024-04-01T19:29:53.719 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 186.620472216, 2024-04-01T19:29:53.719 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.061764912999999998, 2024-04-01T19:29:53.719 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:29:53.719 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:29:53.719 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:53.719 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:29:53.719 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:29:53.719 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:29:53.719 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 179823 2024-04-01T19:29:53.719 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.719 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:29:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:29:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.058531+0000", 2024-04-01T19:29:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:29:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.058531+0000", 2024-04-01T19:29:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:29:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.058533+0000", 2024-04-01T19:29:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.2589999999999999e-06 2024-04-01T19:29:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.720 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:29:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.058540+0000", 2024-04-01T19:29:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5899999999999996e-06 2024-04-01T19:29:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:29:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.058556+0000", 2024-04-01T19:29:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.579e-05 2024-04-01T19:29:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:29:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.058564+0000", 2024-04-01T19:29:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.6789999999999994e-06 2024-04-01T19:29:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.721 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.722 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:29:53.722 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.058638+0000", 2024-04-01T19:29:53.722 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.3343999999999994e-05 2024-04-01T19:29:53.722 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.722 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.722 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:29:53.722 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.058746+0000", 2024-04-01T19:29:53.723 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000108733 2024-04-01T19:29:53.723 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.723 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.723 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:29:53.723 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.058864+0000", 2024-04-01T19:29:53.723 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00011739399999999999 2024-04-01T19:29:53.724 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.724 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.724 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:29:53.724 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.062139+0000", 2024-04-01T19:29:53.724 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.003275488 2024-04-01T19:29:53.724 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.724 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.724 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:29:53.724 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.120220+0000", 2024-04-01T19:29:53.724 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.058080522000000002 2024-04-01T19:29:53.724 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.724 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.724 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:29:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.120259+0000", 2024-04-01T19:29:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8680999999999998e-05 2024-04-01T19:29:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:29:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.120296+0000", 2024-04-01T19:29:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.7432999999999999e-05 2024-04-01T19:29:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:29:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:179830 2.2 2:4bbcc0e1:::benchmark_data_smithi188_77607_object12426:head [delete] snapc 0=[] ondisk+write+known_if_redirected e143)", 2024-04-01T19:29:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:47.068383+0000", 2024-04-01T19:29:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 186.61062019900001, 2024-04-01T19:29:53.726 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.052005702000000001, 2024-04-01T19:29:53.726 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:29:53.726 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:29:53.726 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:53.726 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:29:53.726 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:29:53.726 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:29:53.726 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 179830 2024-04-01T19:29:53.726 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.726 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:29:53.727 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.727 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:29:53.727 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.068383+0000", 2024-04-01T19:29:53.727 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.727 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.727 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.727 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:29:53.727 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.068383+0000", 2024-04-01T19:29:53.727 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.727 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.727 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.727 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:29:53.727 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.068386+0000", 2024-04-01T19:29:53.729 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.7379999999999999e-06 2024-04-01T19:29:53.729 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.729 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.729 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:29:53.729 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.068397+0000", 2024-04-01T19:29:53.729 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1542999999999999e-05 2024-04-01T19:29:53.729 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.729 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.730 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:29:53.730 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.068416+0000", 2024-04-01T19:29:53.730 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8703999999999999e-05 2024-04-01T19:29:53.730 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.730 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.730 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:29:53.730 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.068426+0000", 2024-04-01T19:29:53.730 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0195e-05 2024-04-01T19:29:53.730 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.730 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.730 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:29:53.730 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.068492+0000", 2024-04-01T19:29:53.730 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5662999999999998e-05 2024-04-01T19:29:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:29:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.068628+0000", 2024-04-01T19:29:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013650399999999999 2024-04-01T19:29:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:29:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.068776+0000", 2024-04-01T19:29:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014753800000000001 2024-04-01T19:29:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:29:53.731 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.072518+0000", 2024-04-01T19:29:53.732 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.003742141 2024-04-01T19:29:53.732 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.732 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.732 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:29:53.732 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.120329+0000", 2024-04-01T19:29:53.732 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.047810521000000002 2024-04-01T19:29:53.732 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.732 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.732 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:29:53.732 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.120360+0000", 2024-04-01T19:29:53.732 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.1798999999999998e-05 2024-04-01T19:29:53.732 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.732 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:29:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.120389+0000", 2024-04-01T19:29:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8356000000000001e-05 2024-04-01T19:29:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:29:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:179836 2.2 2:4f3b356f:::benchmark_data_smithi188_77607_object12432:head [delete] snapc 0=[] ondisk+write+known_if_redirected e143)", 2024-04-01T19:29:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:47.073406+0000", 2024-04-01T19:29:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 186.605597528, 2024-04-01T19:29:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.047072142999999997, 2024-04-01T19:29:53.733 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:29:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:29:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:29:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:29:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:29:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 179836 2024-04-01T19:29:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:29:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:29:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.073406+0000", 2024-04-01T19:29:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:29:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.073406+0000", 2024-04-01T19:29:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:29:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.073408+0000", 2024-04-01T19:29:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.2630000000000002e-06 2024-04-01T19:29:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:29:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.073415+0000", 2024-04-01T19:29:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.4800000000000004e-06 2024-04-01T19:29:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:29:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.073428+0000", 2024-04-01T19:29:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2846e-05 2024-04-01T19:29:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:29:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.073437+0000", 2024-04-01T19:29:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1870000000000003e-06 2024-04-01T19:29:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:29:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.073481+0000", 2024-04-01T19:29:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3145000000000001e-05 2024-04-01T19:29:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:29:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.073585+0000", 2024-04-01T19:29:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000104706 2024-04-01T19:29:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:29:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.073665+0000", 2024-04-01T19:29:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9178000000000007e-05 2024-04-01T19:29:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:29:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.077164+0000", 2024-04-01T19:29:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0034993170000000001 2024-04-01T19:29:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:29:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.120424+0000", 2024-04-01T19:29:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.043259787000000001 2024-04-01T19:29:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:29:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.120452+0000", 2024-04-01T19:29:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8424000000000001e-05 2024-04-01T19:29:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:29:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.120478+0000", 2024-04-01T19:29:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.5809999999999999e-05 2024-04-01T19:29:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:29:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:182853 2.3 2:c667e7db:::benchmark_data_smithi188_77607_object15449:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-04-01T19:29:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:49.448950+0000", 2024-04-01T19:29:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 184.23005277600001, 2024-04-01T19:29:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.046764092, 2024-04-01T19:29:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:29:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:29:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:29:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:29:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:29:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 182853 2024-04-01T19:29:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:29:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:29:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.448950+0000", 2024-04-01T19:29:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:29:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.448950+0000", 2024-04-01T19:29:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:29:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.448952+0000", 2024-04-01T19:29:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.158e-06 2024-04-01T19:29:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:29:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.448956+0000", 2024-04-01T19:29:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9920000000000001e-06 2024-04-01T19:29:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:29:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.448964+0000", 2024-04-01T19:29:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.6079999999999996e-06 2024-04-01T19:29:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:29:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.448972+0000", 2024-04-01T19:29:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.7489999999999998e-06 2024-04-01T19:29:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:29:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.449016+0000", 2024-04-01T19:29:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3600000000000003e-05 2024-04-01T19:29:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:29:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.449103+0000", 2024-04-01T19:29:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.7168000000000003e-05 2024-04-01T19:29:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 2", 2024-04-01T19:29:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.449195+0000", 2024-04-01T19:29:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1891999999999994e-05 2024-04-01T19:29:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:29:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.457523+0000", 2024-04-01T19:29:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0083279470000000005 2024-04-01T19:29:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:29:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.495651+0000", 2024-04-01T19:29:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.038128711000000003 2024-04-01T19:29:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:29:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.495685+0000", 2024-04-01T19:29:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.4029000000000002e-05 2024-04-01T19:29:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:29:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.495715+0000", 2024-04-01T19:29:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.9238e-05 2024-04-01T19:29:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:29:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:182859 2.3 2:ccc1387f:::benchmark_data_smithi188_77607_object15455:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-04-01T19:29:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:49.449895+0000", 2024-04-01T19:29:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 184.229108344, 2024-04-01T19:29:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.045990709999999997, 2024-04-01T19:29:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:29:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:29:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:29:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:29:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:29:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 182859 2024-04-01T19:29:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:29:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.747 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:29:53.747 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.449895+0000", 2024-04-01T19:29:53.747 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.747 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.747 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.747 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:29:53.747 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.449895+0000", 2024-04-01T19:29:53.747 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.747 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.747 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.747 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:29:53.747 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.449896+0000", 2024-04-01T19:29:53.747 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.540000000000001e-07 2024-04-01T19:29:53.747 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.748 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.748 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:29:53.748 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.449899+0000", 2024-04-01T19:29:53.748 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.507e-06 2024-04-01T19:29:53.748 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.748 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.748 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:29:53.748 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.449907+0000", 2024-04-01T19:29:53.748 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0399999999999993e-06 2024-04-01T19:29:53.748 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.748 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.748 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:29:53.748 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.449915+0000", 2024-04-01T19:29:53.749 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9219999999999997e-06 2024-04-01T19:29:53.749 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.749 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.749 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:29:53.749 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.453065+0000", 2024-04-01T19:29:53.749 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0031498390000000002 2024-04-01T19:29:53.749 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.749 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.749 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:29:53.749 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.453181+0000", 2024-04-01T19:29:53.749 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00011618 2024-04-01T19:29:53.749 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.749 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.749 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 2", 2024-04-01T19:29:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.453279+0000", 2024-04-01T19:29:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.7479000000000006e-05 2024-04-01T19:29:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:29:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.460719+0000", 2024-04-01T19:29:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0074405870000000002 2024-04-01T19:29:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:29:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.495765+0000", 2024-04-01T19:29:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.035045369 2024-04-01T19:29:53.750 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:29:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.495831+0000", 2024-04-01T19:29:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6316999999999995e-05 2024-04-01T19:29:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:29:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.495886+0000", 2024-04-01T19:29:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.4515999999999998e-05 2024-04-01T19:29:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:29:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.751 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:182862 2.3 2:c68dd1c4:::benchmark_data_smithi188_77607_object15458:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-04-01T19:29:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:49.454074+0000", 2024-04-01T19:29:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 184.224928979, 2024-04-01T19:29:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.047465201999999998, 2024-04-01T19:29:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:29:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:29:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:29:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:29:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:29:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 182862 2024-04-01T19:29:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:29:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.752 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:29:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.454074+0000", 2024-04-01T19:29:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:29:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.454074+0000", 2024-04-01T19:29:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:29:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.454075+0000", 2024-04-01T19:29:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1370000000000001e-06 2024-04-01T19:29:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.753 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:29:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.454079+0000", 2024-04-01T19:29:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9879999999999998e-06 2024-04-01T19:29:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:29:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.454089+0000", 2024-04-01T19:29:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.4809999999999995e-06 2024-04-01T19:29:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:29:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.454097+0000", 2024-04-01T19:29:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.7270000000000007e-06 2024-04-01T19:29:53.754 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:29:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.457551+0000", 2024-04-01T19:29:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0034543310000000002 2024-04-01T19:29:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:29:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.457642+0000", 2024-04-01T19:29:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1302000000000001e-05 2024-04-01T19:29:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 2", 2024-04-01T19:29:53.755 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.457732+0000", 2024-04-01T19:29:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.9870999999999994e-05 2024-04-01T19:29:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:29:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.460838+0000", 2024-04-01T19:29:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0031055100000000001 2024-04-01T19:29:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:29:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.501438+0000", 2024-04-01T19:29:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.040599936000000003 2024-04-01T19:29:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.756 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:29:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.501491+0000", 2024-04-01T19:29:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3871e-05 2024-04-01T19:29:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:29:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:49.501539+0000", 2024-04-01T19:29:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8047999999999998e-05 2024-04-01T19:29:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:29:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.757 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:272420 2.2 2:41feb0af:::benchmark_data_smithi188_77607_object105016:head [delete] snapc 0=[] ondisk+write+known_if_redirected e176)", 2024-04-01T19:29:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:28:45.594996+0000", 2024-04-01T19:29:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 68.084007522999997, 2024-04-01T19:29:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.052955657000000003, 2024-04-01T19:29:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:29:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:29:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:29:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:29:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:29:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 272420 2024-04-01T19:29:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.758 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:29:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:29:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:28:45.594996+0000", 2024-04-01T19:29:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:29:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:28:45.594996+0000", 2024-04-01T19:29:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.759 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:29:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:28:45.594997+0000", 2024-04-01T19:29:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.615e-06 2024-04-01T19:29:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:29:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:28:45.595001+0000", 2024-04-01T19:29:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0890000000000002e-06 2024-04-01T19:29:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:29:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:28:45.595012+0000", 2024-04-01T19:29:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0896e-05 2024-04-01T19:29:53.760 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:29:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:28:45.595018+0000", 2024-04-01T19:29:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.4949999999999999e-06 2024-04-01T19:29:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:29:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:28:45.595065+0000", 2024-04-01T19:29:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7008000000000001e-05 2024-04-01T19:29:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:29:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:28:45.595190+0000", 2024-04-01T19:29:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012519399999999999 2024-04-01T19:29:53.761 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.762 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.762 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:29:53.762 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:28:45.595296+0000", 2024-04-01T19:29:53.762 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000105899 2024-04-01T19:29:53.762 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.762 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.762 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:29:53.762 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:28:45.599622+0000", 2024-04-01T19:29:53.762 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0043258150000000002 2024-04-01T19:29:53.762 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.762 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.762 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:29:53.762 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:28:45.647846+0000", 2024-04-01T19:29:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.048224005 2024-04-01T19:29:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:29:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:28:45.647915+0000", 2024-04-01T19:29:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9220000000000005e-05 2024-04-01T19:29:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:29:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:28:45.647951+0000", 2024-04-01T19:29:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.6421000000000002e-05 2024-04-01T19:29:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:29:53.763 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.764 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.764 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.764 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:301198 2.2 2:48775ec5:::benchmark_data_smithi188_77607_object133794:head [delete] snapc 0=[] ondisk+write+known_if_redirected e178)", 2024-04-01T19:29:53.764 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:29:09.242481+0000", 2024-04-01T19:29:53.764 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 44.436522027000002, 2024-04-01T19:29:53.764 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.057124468999999997, 2024-04-01T19:29:53.764 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:29:53.764 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:29:53.764 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:53.764 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:29:53.764 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:29:53.764 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:29:53.764 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 301198 2024-04-01T19:29:53.764 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.764 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:29:53.765 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.765 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:29:53.765 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.242481+0000", 2024-04-01T19:29:53.765 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.765 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.765 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.765 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:29:53.765 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.242481+0000", 2024-04-01T19:29:53.765 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.765 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.765 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.765 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:29:53.765 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.242484+0000", 2024-04-01T19:29:53.765 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3709999999999998e-06 2024-04-01T19:29:53.766 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.766 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.766 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:29:53.766 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.242490+0000", 2024-04-01T19:29:53.766 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6989999999999997e-06 2024-04-01T19:29:53.766 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.766 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.766 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:29:53.766 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.242503+0000", 2024-04-01T19:29:53.766 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2822e-05 2024-04-01T19:29:53.766 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.766 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.766 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:29:53.766 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.242511+0000", 2024-04-01T19:29:53.767 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.525e-06 2024-04-01T19:29:53.767 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.767 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.767 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:29:53.767 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.242559+0000", 2024-04-01T19:29:53.767 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8560999999999998e-05 2024-04-01T19:29:53.767 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.767 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.767 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:29:53.767 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.242644+0000", 2024-04-01T19:29:53.767 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.4512999999999995e-05 2024-04-01T19:29:53.767 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.767 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.767 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:29:53.768 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.242712+0000", 2024-04-01T19:29:53.768 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8366000000000002e-05 2024-04-01T19:29:53.768 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.768 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.768 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:29:53.768 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.246238+0000", 2024-04-01T19:29:53.768 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0035263149999999999 2024-04-01T19:29:53.768 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.768 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.768 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:29:53.768 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.299531+0000", 2024-04-01T19:29:53.768 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.053292610999999997 2024-04-01T19:29:53.768 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.768 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.769 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:29:53.769 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.299568+0000", 2024-04-01T19:29:53.769 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.6538999999999997e-05 2024-04-01T19:29:53.769 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.769 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.769 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:29:53.769 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.299606+0000", 2024-04-01T19:29:53.769 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8146999999999999e-05 2024-04-01T19:29:53.769 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.769 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:29:53.769 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.769 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.770 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.770 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:301206 2.2 2:4f117f4a:::benchmark_data_smithi188_77607_object133802:head [delete] snapc 0=[] ondisk+write+known_if_redirected e178)", 2024-04-01T19:29:53.770 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:29:09.252992+0000", 2024-04-01T19:29:53.770 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 44.426011637999999, 2024-04-01T19:29:53.770 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.046782706, 2024-04-01T19:29:53.770 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:29:53.770 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:29:53.770 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:53.770 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:29:53.770 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:29:53.770 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:29:53.770 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 301206 2024-04-01T19:29:53.771 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.771 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:29:53.771 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.771 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:29:53.771 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.252992+0000", 2024-04-01T19:29:53.771 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.771 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.771 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.771 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:29:53.771 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.252992+0000", 2024-04-01T19:29:53.771 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.771 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.771 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.771 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:29:53.772 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.252993+0000", 2024-04-01T19:29:53.772 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.6899999999999999e-06 2024-04-01T19:29:53.772 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.772 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.772 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:29:53.772 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.253000+0000", 2024-04-01T19:29:53.772 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.4849999999999997e-06 2024-04-01T19:29:53.772 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.772 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.772 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:29:53.772 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.253011+0000", 2024-04-01T19:29:53.772 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1049e-05 2024-04-01T19:29:53.772 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.772 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.773 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:29:53.773 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.253018+0000", 2024-04-01T19:29:53.773 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.0269999999999998e-06 2024-04-01T19:29:53.773 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.773 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.773 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:29:53.773 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.253073+0000", 2024-04-01T19:29:53.773 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5062000000000002e-05 2024-04-01T19:29:53.773 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.773 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.773 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:29:53.773 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.253211+0000", 2024-04-01T19:29:53.773 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013761599999999999 2024-04-01T19:29:53.773 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.773 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.774 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:29:53.774 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.253353+0000", 2024-04-01T19:29:53.774 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014265999999999999 2024-04-01T19:29:53.774 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.774 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.774 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:29:53.774 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.258010+0000", 2024-04-01T19:29:53.774 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0046568809999999999 2024-04-01T19:29:53.774 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.774 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.774 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:29:53.774 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.299666+0000", 2024-04-01T19:29:53.775 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.041655651000000002 2024-04-01T19:29:53.775 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.775 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.775 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:29:53.775 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.299724+0000", 2024-04-01T19:29:53.775 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7961000000000003e-05 2024-04-01T19:29:53.775 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.775 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.775 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:29:53.775 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.299774+0000", 2024-04-01T19:29:53.775 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0624000000000002e-05 2024-04-01T19:29:53.775 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.775 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:29:53.775 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.776 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.776 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.776 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:305475 2.3 2:c6f24b04:::benchmark_data_smithi188_77607_object138071:head [delete] snapc 0=[] ondisk+write+known_if_redirected e178)", 2024-04-01T19:29:53.776 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:29:12.785371+0000", 2024-04-01T19:29:53.776 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.893632330999999, 2024-04-01T19:29:53.776 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.045276898000000003, 2024-04-01T19:29:53.776 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:29:53.776 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:29:53.776 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:53.776 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:29:53.776 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:29:53.776 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:29:53.776 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 305475 2024-04-01T19:29:53.776 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.777 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:29:53.777 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.777 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:29:53.777 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.785371+0000", 2024-04-01T19:29:53.777 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.777 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.777 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.777 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:29:53.777 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.785371+0000", 2024-04-01T19:29:53.777 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.777 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.778 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.778 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:29:53.778 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.785372+0000", 2024-04-01T19:29:53.778 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.35e-06 2024-04-01T19:29:53.778 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.778 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.778 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:29:53.778 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.785377+0000", 2024-04-01T19:29:53.778 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.5800000000000002e-06 2024-04-01T19:29:53.778 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.778 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.778 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:29:53.778 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.785388+0000", 2024-04-01T19:29:53.779 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1501000000000001e-05 2024-04-01T19:29:53.779 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.779 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.779 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:29:53.779 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.785396+0000", 2024-04-01T19:29:53.779 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.2099999999999996e-06 2024-04-01T19:29:53.779 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.779 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.779 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:29:53.779 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.786805+0000", 2024-04-01T19:29:53.779 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.001409078 2024-04-01T19:29:53.779 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.779 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.779 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:29:53.780 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.786880+0000", 2024-04-01T19:29:53.780 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.5636999999999994e-05 2024-04-01T19:29:53.780 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.780 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.780 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 2", 2024-04-01T19:29:53.780 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.786975+0000", 2024-04-01T19:29:53.780 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.4895000000000005e-05 2024-04-01T19:29:53.780 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.780 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.780 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:29:53.780 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.790758+0000", 2024-04-01T19:29:53.780 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0037824930000000001 2024-04-01T19:29:53.780 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.781 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.781 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:29:53.781 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.830518+0000", 2024-04-01T19:29:53.781 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.039759933999999997 2024-04-01T19:29:53.781 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.781 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.781 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:29:53.781 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.830601+0000", 2024-04-01T19:29:53.781 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.3702000000000006e-05 2024-04-01T19:29:53.781 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.781 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.781 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:29:53.781 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.830648+0000", 2024-04-01T19:29:53.781 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6517999999999997e-05 2024-04-01T19:29:53.782 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.782 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:29:53.782 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.782 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.782 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.782 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:305492 2.2 2:491b5b0f:::benchmark_data_smithi188_77607_object138088:head [delete] snapc 0=[] ondisk+write+known_if_redirected e178)", 2024-04-01T19:29:53.782 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:29:12.801777+0000", 2024-04-01T19:29:53.782 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.877226393000001, 2024-04-01T19:29:53.782 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.055344009999999999, 2024-04-01T19:29:53.782 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:29:53.782 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:29:53.782 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:53.783 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:29:53.783 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:29:53.783 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:29:53.783 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 305492 2024-04-01T19:29:53.783 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.783 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:29:53.783 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.783 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:29:53.783 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.801777+0000", 2024-04-01T19:29:53.783 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.783 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.783 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.783 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:29:53.784 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.801777+0000", 2024-04-01T19:29:53.784 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.784 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.784 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.784 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:29:53.784 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.801778+0000", 2024-04-01T19:29:53.784 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.59e-06 2024-04-01T19:29:53.784 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.784 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.784 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:29:53.784 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.801784+0000", 2024-04-01T19:29:53.784 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7300000000000002e-06 2024-04-01T19:29:53.784 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.784 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.785 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:29:53.785 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.801794+0000", 2024-04-01T19:29:53.785 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0076e-05 2024-04-01T19:29:53.785 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.785 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.785 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:29:53.785 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.801801+0000", 2024-04-01T19:29:53.785 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.331e-06 2024-04-01T19:29:53.785 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.785 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.785 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:29:53.785 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.801849+0000", 2024-04-01T19:29:53.785 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8588000000000003e-05 2024-04-01T19:29:53.785 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.785 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.786 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:29:53.786 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.801975+0000", 2024-04-01T19:29:53.786 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000125456 2024-04-01T19:29:53.786 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.786 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.786 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:29:53.786 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.802100+0000", 2024-04-01T19:29:53.786 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000124993 2024-04-01T19:29:53.786 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.786 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.786 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:29:53.786 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.805409+0000", 2024-04-01T19:29:53.787 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0033097589999999998 2024-04-01T19:29:53.787 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.787 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.787 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:29:53.787 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.856997+0000", 2024-04-01T19:29:53.787 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.051587252 2024-04-01T19:29:53.787 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.787 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.787 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:29:53.787 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.857062+0000", 2024-04-01T19:29:53.787 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5575999999999997e-05 2024-04-01T19:29:53.787 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.787 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.787 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:29:53.788 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.857121+0000", 2024-04-01T19:29:53.788 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8659000000000002e-05 2024-04-01T19:29:53.788 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.788 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:29:53.788 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.788 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.788 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.788 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:307192 2.3 2:c7dbf00b:::benchmark_data_smithi188_77607_object139788:head [delete] snapc 0=[] ondisk+write+known_if_redirected e178)", 2024-04-01T19:29:53.788 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:29:14.330398+0000", 2024-04-01T19:29:53.788 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 39.348604960999999, 2024-04-01T19:29:53.788 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.043338098999999998, 2024-04-01T19:29:53.788 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:29:53.789 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:29:53.789 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:53.789 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:29:53.789 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:29:53.789 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:29:53.789 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 307192 2024-04-01T19:29:53.789 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.789 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:29:53.789 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.789 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:29:53.789 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:14.330398+0000", 2024-04-01T19:29:53.789 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.789 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.789 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.789 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:29:53.790 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:14.330398+0000", 2024-04-01T19:29:53.790 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.790 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.790 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.790 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:29:53.790 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:14.330400+0000", 2024-04-01T19:29:53.790 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.5910000000000001e-06 2024-04-01T19:29:53.790 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.790 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.790 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:29:53.790 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:14.330406+0000", 2024-04-01T19:29:53.790 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.879e-06 2024-04-01T19:29:53.790 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.791 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.791 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:29:53.791 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:14.330417+0000", 2024-04-01T19:29:53.791 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0752e-05 2024-04-01T19:29:53.791 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.791 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.791 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:29:53.791 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:14.330423+0000", 2024-04-01T19:29:53.791 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8449999999999997e-06 2024-04-01T19:29:53.791 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.791 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.791 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:29:53.791 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:14.330462+0000", 2024-04-01T19:29:53.791 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8850000000000002e-05 2024-04-01T19:29:53.791 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.792 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.792 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:29:53.792 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:14.330538+0000", 2024-04-01T19:29:53.792 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.6064999999999998e-05 2024-04-01T19:29:53.792 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.792 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.792 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 2", 2024-04-01T19:29:53.792 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:14.330604+0000", 2024-04-01T19:29:53.792 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5277000000000005e-05 2024-04-01T19:29:53.792 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.792 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.792 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:29:53.792 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:14.334263+0000", 2024-04-01T19:29:53.793 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0036593860000000001 2024-04-01T19:29:53.793 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.793 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.793 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:29:53.793 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:14.373653+0000", 2024-04-01T19:29:53.793 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.039389885999999999 2024-04-01T19:29:53.793 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.793 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.793 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:29:53.793 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:14.373705+0000", 2024-04-01T19:29:53.793 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1904999999999999e-05 2024-04-01T19:29:53.793 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.793 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.794 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:29:53.794 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:14.373736+0000", 2024-04-01T19:29:53.794 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.1662999999999998e-05 2024-04-01T19:29:53.794 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.794 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:29:53.794 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.794 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.794 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.794 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:330803 2.2 2:476873c2:::benchmark_data_smithi188_77607_object163399:head [delete] snapc 0=[] ondisk+write+known_if_redirected e183)", 2024-04-01T19:29:53.794 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:29:33.639173+0000", 2024-04-01T19:29:53.794 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 20.039830588000001, 2024-04-01T19:29:53.794 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.047216005999999998, 2024-04-01T19:29:53.794 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:29:53.795 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:29:53.795 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:53.795 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:29:53.795 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:29:53.795 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:29:53.795 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 330803 2024-04-01T19:29:53.795 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.795 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:29:53.795 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.795 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:29:53.795 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:33.639173+0000", 2024-04-01T19:29:53.795 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.795 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.795 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.795 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:29:53.796 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:33.639173+0000", 2024-04-01T19:29:53.796 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.796 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.796 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.796 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:29:53.796 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:33.639175+0000", 2024-04-01T19:29:53.796 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3539999999999998e-06 2024-04-01T19:29:53.796 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.796 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.796 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:29:53.796 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:33.639181+0000", 2024-04-01T19:29:53.796 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8919999999999997e-06 2024-04-01T19:29:53.796 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.796 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.796 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:29:53.797 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:33.639200+0000", 2024-04-01T19:29:53.797 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.9403999999999999e-05 2024-04-01T19:29:53.797 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.797 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.797 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:29:53.797 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:33.639207+0000", 2024-04-01T19:29:53.797 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9090000000000003e-06 2024-04-01T19:29:53.797 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.797 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.797 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:29:53.797 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:33.639261+0000", 2024-04-01T19:29:53.797 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3427999999999997e-05 2024-04-01T19:29:53.797 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.797 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.798 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:29:53.798 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:33.639387+0000", 2024-04-01T19:29:53.798 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012629300000000001 2024-04-01T19:29:53.798 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.798 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.798 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:29:53.798 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:33.639514+0000", 2024-04-01T19:29:53.798 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012655899999999999 2024-04-01T19:29:53.798 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.798 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.798 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:29:53.798 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:33.644359+0000", 2024-04-01T19:29:53.798 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.004845701 2024-04-01T19:29:53.799 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.799 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.799 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:29:53.799 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:33.686280+0000", 2024-04-01T19:29:53.799 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.041920628000000001 2024-04-01T19:29:53.799 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.799 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.799 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:29:53.799 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:33.686342+0000", 2024-04-01T19:29:53.799 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.1864000000000003e-05 2024-04-01T19:29:53.799 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.799 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.799 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:29:53.799 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:33.686389+0000", 2024-04-01T19:29:53.800 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6974000000000001e-05 2024-04-01T19:29:53.800 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.800 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:29:53.800 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.800 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.800 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.800 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:333505 2.3 2:c64a8d89:::benchmark_data_smithi188_77607_object166101:head [delete] snapc 0=[] ondisk+write+known_if_redirected e184)", 2024-04-01T19:29:53.800 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:29:35.782259+0000", 2024-04-01T19:29:53.800 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 17.896744625, 2024-04-01T19:29:53.800 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.042466790999999997, 2024-04-01T19:29:53.800 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:29:53.800 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:29:53.800 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:29:53.800 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:29:53.801 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:29:53.801 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:29:53.801 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 333505 2024-04-01T19:29:53.801 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.801 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:29:53.801 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.801 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:29:53.801 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.782259+0000", 2024-04-01T19:29:53.801 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.801 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.801 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.801 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:29:53.801 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.782259+0000", 2024-04-01T19:29:53.801 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:29:53.802 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.802 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.802 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:29:53.802 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.782260+0000", 2024-04-01T19:29:53.802 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.7300000000000004e-07 2024-04-01T19:29:53.802 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.802 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.802 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:29:53.802 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.782263+0000", 2024-04-01T19:29:53.802 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.292e-06 2024-04-01T19:29:53.802 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.802 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.802 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:29:53.803 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.782269+0000", 2024-04-01T19:29:53.803 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.1589999999999998e-06 2024-04-01T19:29:53.803 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.803 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.803 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:29:53.803 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.782274+0000", 2024-04-01T19:29:53.803 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.5770000000000004e-06 2024-04-01T19:29:53.803 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.803 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.803 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:29:53.803 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.786772+0000", 2024-04-01T19:29:53.803 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0044987509999999996 2024-04-01T19:29:53.803 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.803 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.804 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:29:53.804 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.786877+0000", 2024-04-01T19:29:53.804 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000104304 2024-04-01T19:29:53.804 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.804 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.804 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 2", 2024-04-01T19:29:53.804 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.786979+0000", 2024-04-01T19:29:53.804 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000102119 2024-04-01T19:29:53.804 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.804 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.804 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:29:53.804 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.824441+0000", 2024-04-01T19:29:53.804 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.037461902999999998 2024-04-01T19:29:53.805 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.805 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.805 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:29:53.805 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.824632+0000", 2024-04-01T19:29:53.805 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00019177699999999999 2024-04-01T19:29:53.805 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.805 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.805 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:29:53.805 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.824684+0000", 2024-04-01T19:29:53.805 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1514000000000002e-05 2024-04-01T19:29:53.805 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:29:53.805 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:29:53.805 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:29:53.805 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.824725+0000", 2024-04-01T19:29:53.806 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.1421999999999997e-05 2024-04-01T19:29:53.806 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.806 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:29:53.806 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.806 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:29:53.806 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:29:53.806 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:29:53.806 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:29:53.807 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:29:53.817 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:29:53.833 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:53 smithi022 ceph-mon[39439]: pgmap v583: 17 pgs: 1 creating+peering, 11 unknown, 5 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail 2024-04-01T19:29:53.833 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:53 smithi022 ceph-mon[39439]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T19:29:53.833 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:53 smithi022 ceph-mon[39439]: osdmap e193: 12 total, 11 up, 11 in 2024-04-01T19:29:53.834 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:53 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1833048887' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:29:53.842 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:53.844 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:29:53.869 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:29:53.889 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:29:53.910 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:29:53.930 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:29:53.941 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:29:53.950 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:29:53.972 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:29:53.992 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:29:54.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:53 smithi062 ceph-mon[44211]: pgmap v583: 17 pgs: 1 creating+peering, 11 unknown, 5 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail 2024-04-01T19:29:54.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:53 smithi062 ceph-mon[44211]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T19:29:54.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:53 smithi062 ceph-mon[44211]: osdmap e193: 12 total, 11 up, 11 in 2024-04-01T19:29:54.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:53 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1833048887' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:29:54.013 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:29:54.013 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:29:54.013 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:29:54.013 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:29:54.014 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:29:54.014 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:29:54.014 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:29:54.014 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:29:54.014 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:29:54.014 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.8 2024-04-01T19:29:54.014 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:29:54.014 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:29:54.014 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:29:54.098 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:29:54.102 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:54.102 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:29:54.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:53 smithi188 ceph-mon[43939]: pgmap v583: 17 pgs: 1 creating+peering, 11 unknown, 5 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail 2024-04-01T19:29:54.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:53 smithi188 ceph-mon[43939]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T19:29:54.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:53 smithi188 ceph-mon[43939]: osdmap e193: 12 total, 11 up, 11 in 2024-04-01T19:29:54.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:53 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1833048887' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:29:54.203 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:29:54.231 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:54.304 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:29:54.307 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:54.308 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:29:54.409 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:29:54.436 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:54.456 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_ops_in_flight 2024-04-01T19:29:54.770 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:29:54.884 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:29:54.886 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:29:54.887 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:54.887 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:29:54.887 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:29:54.988 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:29:55.016 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:55.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.387 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:29:55.551 INFO:tasks.thrashosds.thrasher:Reviving osd 8 2024-04-01T19:29:55.552 INFO:tasks.cephadm.osd.8:Restarting osd.8 (starting--it wasn't running)... 2024-04-01T19:29:55.552 DEBUG:teuthology.orchestra.run.smithi188:osd.8> sudo journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.8.service 2024-04-01T19:29:55.555 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl start ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.8 2024-04-01T19:29:55.587 INFO:journalctl@ceph.osd.8.smithi188.stdout:-- Logs begin at Mon 2024-04-01 19:04:09 UTC. -- 2024-04-01T19:29:55.665 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:29:55.670 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:55.670 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:29:55.771 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:29:55.799 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:55.838 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 19:29:55 smithi188 systemd[1]: Starting Ceph osd.8 for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T19:29:55.904 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:55 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.904 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:55 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.905 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:55 smithi022 ceph-mon[39439]: pgmap v585: 17 pgs: 1 creating+peering, 8 unknown, 8 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail 2024-04-01T19:29:55.988 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:55 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.988 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:55 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:55.988 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:55 smithi062 ceph-mon[44211]: pgmap v585: 17 pgs: 1 creating+peering, 8 unknown, 8 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail 2024-04-01T19:29:56.097 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:55 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:56.097 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:55 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:29:56.097 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:55 smithi188 ceph-mon[43939]: pgmap v585: 17 pgs: 1 creating+peering, 8 unknown, 8 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail 2024-04-01T19:29:56.149 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:29:56.152 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:56.152 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:29:56.165 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:29:56.253 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:29:56.282 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:56.592 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:29:56.592 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:29:56.862 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:29:56.865 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:56.866 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:29:56.887 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:29:56.967 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:29:56.998 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:57.105 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 19:29:56 smithi188 bash[91329]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2024-04-01T19:29:57.105 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 19:29:56 smithi188 bash[91329]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-8 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-01T19:29:57.106 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 19:29:56 smithi188 bash[91329]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-01T19:29:57.106 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 19:29:56 smithi188 bash[91329]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-01T19:29:57.106 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 19:29:56 smithi188 bash[91329]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-8/block 2024-04-01T19:29:57.106 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 19:29:56 smithi188 bash[91329]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2024-04-01T19:29:57.106 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 19:29:56 smithi188 bash[91329]: --> ceph-volume raw activate successful for osd ID: 8 2024-04-01T19:29:57.198 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:29:57.200 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:57.201 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:29:57.214 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_blocked_ops 2024-04-01T19:29:57.302 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:29:57.332 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:57.431 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:29:57.434 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:57.434 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:29:57.525 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:29:57.535 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:29:57.565 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:57.814 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:29:57.817 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:57.817 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:29:57.844 INFO:teuthology.orchestra.run.smithi022.stderr:enabled application 'rados' on pool 'unique_pool_1' 2024-04-01T19:29:57.918 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:29:57.946 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:57.965 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:29:57.967 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:57.968 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:29:58.036 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:57 smithi062 ceph-mon[44211]: pgmap v586: 17 pgs: 17 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail 2024-04-01T19:29:58.036 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:57 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2686141647' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:29:58.064 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_ops_in_flight 2024-04-01T19:29:58.069 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:29:58.088 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:57 smithi188 ceph-mon[43939]: pgmap v586: 17 pgs: 17 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail 2024-04-01T19:29:58.089 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:57 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2686141647' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:29:58.089 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 19:29:58 smithi188 bash[91634]: a5828937131f829182af3e99344b38f3fc2192b300428ff174f855ba732044bd 2024-04-01T19:29:58.089 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 19:29:58 smithi188 systemd[1]: Started Ceph osd.8 for 09f6b846-f05c-11ee-b647-cb9ed24678a4. 2024-04-01T19:29:58.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:57 smithi022 ceph-mon[39439]: pgmap v586: 17 pgs: 17 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail 2024-04-01T19:29:58.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:57 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2686141647' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:29:58.115 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:58.134 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:29:58.137 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:58.138 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:29:58.239 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:29:58.265 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:58.287 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:29:58.291 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:58.292 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:29:58.338 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:29:58.393 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:29:58.423 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:58.544 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:29:58.547 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:58.548 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:29:58.649 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:29:58.682 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:58.737 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:29:58.740 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:58.740 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:29:58.841 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:29:58.848 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 19:29:58 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T19:29:58.508+0000 7f784fcca7c0 -1 Falling back to public interface 2024-04-01T19:29:58.871 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:59.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:58 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2686141647' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:29:59.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:58 smithi062 ceph-mon[44211]: osdmap e194: 12 total, 11 up, 11 in 2024-04-01T19:29:59.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:58 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:29:59.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:58 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:29:59.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:58 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:29:59.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:58 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:29:59.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:58 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:29:59.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:58 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:29:59.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:58 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:29:59.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:58 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:29:59.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:58 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:29:59.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:58 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:29:59.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:58 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:29:59.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:58 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:29:59.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:58 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:29:59.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:58 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2686141647' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:29:59.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:58 smithi022 ceph-mon[39439]: osdmap e194: 12 total, 11 up, 11 in 2024-04-01T19:29:59.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:58 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:29:59.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:58 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:29:59.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:58 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:29:59.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:58 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:29:59.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:58 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:29:59.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:58 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:29:59.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:58 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:29:59.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:58 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:29:59.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:58 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:29:59.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:58 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:29:59.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:58 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:29:59.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:58 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:29:59.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:58 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:29:59.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:58 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2686141647' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:29:59.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:58 smithi188 ceph-mon[43939]: osdmap e194: 12 total, 11 up, 11 in 2024-04-01T19:29:59.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:58 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:29:59.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:58 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:29:59.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:58 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:29:59.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:58 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:29:59.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:58 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:29:59.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:58 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:29:59.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:58 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:29:59.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:58 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:29:59.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:58 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:29:59.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:58 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:29:59.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:58 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:29:59.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:58 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:29:59.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:58 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:29:59.300 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:29:59.300 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:29:59.489 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:29:59.520 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:29:59.522 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:59.523 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:29:59.624 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:29:59.652 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:59.751 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:29:59.753 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:59.754 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:29:59.855 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:29:59.883 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:59 smithi062 ceph-mon[44211]: pgmap v588: 17 pgs: 17 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail 2024-04-01T19:29:59.884 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:59 smithi062 ceph-mon[44211]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T19:29:59.884 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:29:59 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4229320759' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:29:59.887 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:29:59.961 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:29:59.964 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:29:59.964 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:29:59.985 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_historic_ops 2024-04-01T19:30:00.005 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:59 smithi188 ceph-mon[43939]: pgmap v588: 17 pgs: 17 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail 2024-04-01T19:30:00.005 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:59 smithi188 ceph-mon[43939]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T19:30:00.005 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:29:59 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4229320759' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:30:00.065 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:30:00.077 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:30:00.090 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:59 smithi022 ceph-mon[39439]: pgmap v588: 17 pgs: 17 active+clean; 577 KiB data, 1.0 GiB used, 982 GiB / 983 GiB avail 2024-04-01T19:30:00.090 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:59 smithi022 ceph-mon[39439]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T19:30:00.090 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:29:59 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4229320759' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:30:00.096 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:00.295 INFO:teuthology.orchestra.run.smithi188.stderr:no valid command found; 10 closest matches: 2024-04-01T19:30:00.295 INFO:teuthology.orchestra.run.smithi188.stderr:0 2024-04-01T19:30:00.295 INFO:teuthology.orchestra.run.smithi188.stderr:1 2024-04-01T19:30:00.295 INFO:teuthology.orchestra.run.smithi188.stderr:2 2024-04-01T19:30:00.295 INFO:teuthology.orchestra.run.smithi188.stderr:abort 2024-04-01T19:30:00.295 INFO:teuthology.orchestra.run.smithi188.stderr:assert 2024-04-01T19:30:00.295 INFO:teuthology.orchestra.run.smithi188.stderr:config diff 2024-04-01T19:30:00.296 INFO:teuthology.orchestra.run.smithi188.stderr:config diff get 2024-04-01T19:30:00.296 INFO:teuthology.orchestra.run.smithi188.stderr:config get 2024-04-01T19:30:00.296 INFO:teuthology.orchestra.run.smithi188.stderr:config help [] 2024-04-01T19:30:00.296 INFO:teuthology.orchestra.run.smithi188.stderr:config set ... 2024-04-01T19:30:00.296 INFO:teuthology.orchestra.run.smithi188.stderr:admin_socket: invalid command 2024-04-01T19:30:00.299 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:30:00.489 DEBUG:teuthology.orchestra.run.smithi188:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.2 -b 65536 --object-size 65536 -p unique_pool_1 bench 90 write' 2024-04-01T19:30:00.492 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-04-01T19:30:00.492 INFO:teuthology.orchestra.run:waiting for 3000 2024-04-01T19:30:00.585 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:hints = 1 2024-04-01T19:30:00.585 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-04-01T19:30:00.585 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Object prefix: benchmark_data_smithi188_92122 2024-04-01T19:30:00.585 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:30:00.585 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 0 0 0 0 0 0 - 0 2024-04-01T19:30:01.037 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:00 smithi188 ceph-mon[43939]: Health detail: HEALTH_WARN nodeep-scrub flag(s) set 2024-04-01T19:30:01.038 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:00 smithi188 ceph-mon[43939]: [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set 2024-04-01T19:30:01.038 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:00 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:30:01.038 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:00 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:30:01.038 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:00 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4229320759' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:30:01.038 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:00 smithi188 ceph-mon[43939]: osdmap e195: 12 total, 11 up, 11 in 2024-04-01T19:30:01.088 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-01T19:30:01.089 INFO:tasks.cephadm.ceph_manager.ceph:waiting on admin_socket for osd-8, ['dump_ops_in_flight'] 2024-04-01T19:30:01.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:00 smithi022 ceph-mon[39439]: Health detail: HEALTH_WARN nodeep-scrub flag(s) set 2024-04-01T19:30:01.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:00 smithi022 ceph-mon[39439]: [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set 2024-04-01T19:30:01.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:00 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:30:01.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:00 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:30:01.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:00 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4229320759' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:30:01.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:00 smithi022 ceph-mon[39439]: osdmap e195: 12 total, 11 up, 11 in 2024-04-01T19:30:01.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:00 smithi062 ceph-mon[44211]: Health detail: HEALTH_WARN nodeep-scrub flag(s) set 2024-04-01T19:30:01.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:00 smithi062 ceph-mon[44211]: [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set 2024-04-01T19:30:01.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:00 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:30:01.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:00 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:30:01.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:00 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4229320759' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:30:01.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:00 smithi062 ceph-mon[44211]: osdmap e195: 12 total, 11 up, 11 in 2024-04-01T19:30:01.585 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 1 15 6157 6142 383.882 383.875 0.00252694 0.00260023 2024-04-01T19:30:01.779 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:30:01.783 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:01.784 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:30:01.885 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:30:01.928 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:01.989 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:30:01.995 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:01.996 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:30:02.097 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:30:02.140 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:02.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:02 smithi062 ceph-mon[44211]: pgmap v590: 17 pgs: 17 active+clean; 3.0 MiB data, 1.0 GiB used, 982 GiB / 983 GiB avail; 315 KiB/s wr, 4 op/s 2024-04-01T19:30:02.295 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:30:02.299 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:02.299 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:30:02.347 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:30:02.347 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:30:02.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:02 smithi022 ceph-mon[39439]: pgmap v590: 17 pgs: 17 active+clean; 3.0 MiB data, 1.0 GiB used, 982 GiB / 983 GiB avail; 315 KiB/s wr, 4 op/s 2024-04-01T19:30:02.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:02 smithi188 ceph-mon[43939]: pgmap v590: 17 pgs: 17 active+clean; 3.0 MiB data, 1.0 GiB used, 982 GiB / 983 GiB avail; 315 KiB/s wr, 4 op/s 2024-04-01T19:30:02.400 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:30:02.451 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:02.585 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 2 16 11336 11320 353.739 323.625 0.00312057 0.00282457 2024-04-01T19:30:02.608 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:30:02.611 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:02.612 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:30:02.713 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:30:02.753 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 19:30:02 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T19:30:02.489+0000 7f784fcca7c0 -1 osd.8 159 log_to_monitors true 2024-04-01T19:30:02.756 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:02.783 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:30:02.787 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:02.787 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:30:02.888 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:30:02.932 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:02.960 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:30:02.997 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:30:03.034 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:30:03.070 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:30:03.107 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:30:03.139 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:30:03.142 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:03.143 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:30:03.145 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:30:03.167 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_ops_in_flight 2024-04-01T19:30:03.180 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:30:03.215 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:30:03.244 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:30:03.249 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:30:03.250 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:03 smithi062 ceph-mon[44211]: from='osd.8 v1:172.21.15.188:6800/1873408265' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-01T19:30:03.250 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:03 smithi062 ceph-mon[44211]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-01T19:30:03.250 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:03 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2045544915' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:30:03.281 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:03.283 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:30:03.307 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:30:03.309 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:03.310 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:30:03.315 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:30:03.315 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:30:03.315 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:30:03.315 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:30:03.315 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:30:03.315 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:30:03.315 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:30:03.315 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:30:03.315 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:30:03.316 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.8 2024-04-01T19:30:03.316 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:30:03.316 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:30:03.316 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:30:03.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:03 smithi022 ceph-mon[39439]: from='osd.8 v1:172.21.15.188:6800/1873408265' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-01T19:30:03.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:03 smithi022 ceph-mon[39439]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-01T19:30:03.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:03 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2045544915' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:30:03.374 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 19:30:03 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T19:30:03.102+0000 7f783d11a700 -1 osd.8 159 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T19:30:03.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:03 smithi188 ceph-mon[43939]: from='osd.8 v1:172.21.15.188:6800/1873408265' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-01T19:30:03.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:03 smithi188 ceph-mon[43939]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-01T19:30:03.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:03 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2045544915' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:30:03.410 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:30:03.459 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:03.561 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:30:03.564 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:03.564 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:30:03.585 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 3 16 16116 16100 335.4 298.75 0.00328706 0.00297733 2024-04-01T19:30:03.606 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:30:03.664 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:30:03.705 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:03.827 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:30:03.862 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:30:03.865 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:03.865 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:30:03.966 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:30:04.013 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:04.142 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:30:04.145 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:04.145 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:30:04.147 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:30:04.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:04 smithi022 ceph-mon[39439]: pgmap v591: 17 pgs: 17 active+clean; 196 MiB data, 1.2 GiB used, 982 GiB / 983 GiB avail; 24 MiB/s wr, 390 op/s 2024-04-01T19:30:04.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:04 smithi022 ceph-mon[39439]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-01T19:30:04.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:04 smithi022 ceph-mon[39439]: from='osd.8 v1:172.21.15.188:6800/1873408265' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:30:04.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:04 smithi022 ceph-mon[39439]: osdmap e196: 12 total, 11 up, 11 in 2024-04-01T19:30:04.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:04 smithi022 ceph-mon[39439]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:30:04.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:04 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:30:04.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.150 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:30:04.245 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:30:04.247 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:30:04.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:04 smithi062 ceph-mon[44211]: pgmap v591: 17 pgs: 17 active+clean; 196 MiB data, 1.2 GiB used, 982 GiB / 983 GiB avail; 24 MiB/s wr, 390 op/s 2024-04-01T19:30:04.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:04 smithi062 ceph-mon[44211]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-01T19:30:04.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:04 smithi062 ceph-mon[44211]: from='osd.8 v1:172.21.15.188:6800/1873408265' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:30:04.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:04 smithi062 ceph-mon[44211]: osdmap e196: 12 total, 11 up, 11 in 2024-04-01T19:30:04.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:04 smithi062 ceph-mon[44211]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:30:04.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:04 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:30:04.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.282 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:04.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:04 smithi188 ceph-mon[43939]: pgmap v591: 17 pgs: 17 active+clean; 196 MiB data, 1.2 GiB used, 982 GiB / 983 GiB avail; 24 MiB/s wr, 390 op/s 2024-04-01T19:30:04.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:04 smithi188 ceph-mon[43939]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-01T19:30:04.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:04 smithi188 ceph-mon[43939]: from='osd.8 v1:172.21.15.188:6800/1873408265' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:30:04.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:04 smithi188 ceph-mon[43939]: osdmap e196: 12 total, 11 up, 11 in 2024-04-01T19:30:04.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:04 smithi188 ceph-mon[43939]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T19:30:04.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:04 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:30:04.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:04.486 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:30:04.490 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:04.490 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:30:04.585 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 4 16 20386 20370 318.264 266.875 0.00276447 0.00313965 2024-04-01T19:30:04.591 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:30:04.625 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:04.655 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:30:04.658 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:04.659 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:30:04.760 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:30:04.809 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:05.090 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:30:05.093 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:05.093 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:30:05.194 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:30:05.233 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:05.239 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:05 smithi062 ceph-mon[44211]: osd.8 v1:172.21.15.188:6800/1873408265 boot 2024-04-01T19:30:05.239 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:05 smithi062 ceph-mon[44211]: osdmap e197: 12 total, 12 up, 11 in 2024-04-01T19:30:05.239 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:05 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:30:05.259 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:30:05.262 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:05.263 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:30:05.363 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:30:05.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:05 smithi022 ceph-mon[39439]: osd.8 v1:172.21.15.188:6800/1873408265 boot 2024-04-01T19:30:05.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:05 smithi022 ceph-mon[39439]: osdmap e197: 12 total, 12 up, 11 in 2024-04-01T19:30:05.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:05 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:30:05.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:05 smithi188 ceph-mon[43939]: osd.8 v1:172.21.15.188:6800/1873408265 boot 2024-04-01T19:30:05.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:05 smithi188 ceph-mon[43939]: osdmap e197: 12 total, 12 up, 11 in 2024-04-01T19:30:05.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:05 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T19:30:05.403 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:05.428 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:30:05.431 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:05.432 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:30:05.533 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:30:05.574 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:05.585 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 5 16 24696 24680 308.482 269.375 0.00315104 0.00323928 2024-04-01T19:30:05.605 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:30:05.605 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:30:05.605 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.605 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:24758 3.d 3:bec6bb20:::benchmark_data_smithi188_92122_object24757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e198)", 2024-04-01T19:30:05.605 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:30:05.604548+0000", 2024-04-01T19:30:05.605 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.001894272, 2024-04-01T19:30:05.606 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.001930034, 2024-04-01T19:30:05.606 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:30:05.606 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:30:05.606 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:30:05.606 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:30:05.606 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:30:05.606 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:30:05.606 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 24758 2024-04-01T19:30:05.606 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.606 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:30:05.606 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.606 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:30:05.606 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.604548+0000", 2024-04-01T19:30:05.607 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:30:05.607 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.607 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.607 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:30:05.607 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.604548+0000", 2024-04-01T19:30:05.607 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:30:05.607 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.607 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.607 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:30:05.607 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.604550+0000", 2024-04-01T19:30:05.607 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.6279999999999999e-06 2024-04-01T19:30:05.607 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.607 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.607 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:30:05.608 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.604580+0000", 2024-04-01T19:30:05.608 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.0420999999999999e-05 2024-04-01T19:30:05.608 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.608 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.608 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:30:05.608 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.604593+0000", 2024-04-01T19:30:05.608 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2833000000000001e-05 2024-04-01T19:30:05.608 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.608 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.608 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:30:05.608 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.604602+0000", 2024-04-01T19:30:05.608 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.7110000000000001e-06 2024-04-01T19:30:05.608 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.609 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.609 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:30:05.609 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.604797+0000", 2024-04-01T19:30:05.609 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00019473099999999999 2024-04-01T19:30:05.609 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.609 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.609 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:30:05.609 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.604910+0000", 2024-04-01T19:30:05.609 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00011369100000000001 2024-04-01T19:30:05.609 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.609 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.609 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 5", 2024-04-01T19:30:05.609 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.605042+0000", 2024-04-01T19:30:05.610 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013160799999999999 2024-04-01T19:30:05.610 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.610 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.610 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:30:05.610 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.605983+0000", 2024-04-01T19:30:05.610 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00094128400000000002 2024-04-01T19:30:05.610 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:30:05.610 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:30:05.610 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:30:05.610 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.610 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.610 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.25117.0:24764 3.9 e198/191 3:9a683356:::benchmark_data_smithi188_92122_object24763:head v 198'1502, mlcod=198'1500)", 2024-04-01T19:30:05.610 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:30:05.606073+0000", 2024-04-01T19:30:05.611 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.000369281, 2024-04-01T19:30:05.611 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00047115999999999998, 2024-04-01T19:30:05.611 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:30:05.611 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:30:05.611 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "started", 2024-04-01T19:30:05.611 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:30:05.611 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.611 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:30:05.611 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.606073+0000", 2024-04-01T19:30:05.611 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:30:05.611 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.611 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.611 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:30:05.612 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.606073+0000", 2024-04-01T19:30:05.612 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:30:05.612 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.612 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.612 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:30:05.612 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.606075+0000", 2024-04-01T19:30:05.612 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1540000000000001e-06 2024-04-01T19:30:05.612 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.612 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.612 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:30:05.612 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.606131+0000", 2024-04-01T19:30:05.612 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6733e-05 2024-04-01T19:30:05.613 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.613 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.613 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:30:05.613 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.606140+0000", 2024-04-01T19:30:05.613 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.4800000000000001e-06 2024-04-01T19:30:05.613 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.613 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.613 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:30:05.613 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.606145+0000", 2024-04-01T19:30:05.613 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8890000000000001e-06 2024-04-01T19:30:05.613 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.613 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.613 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:30:05.614 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.606498+0000", 2024-04-01T19:30:05.614 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00035368200000000002 2024-04-01T19:30:05.614 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.614 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.614 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:30:05.614 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.606518+0000", 2024-04-01T19:30:05.614 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.9836000000000001e-05 2024-04-01T19:30:05.614 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:30:05.614 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:30:05.614 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:30:05.614 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.614 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.614 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:24769 3.f 3:f8699dd2:::benchmark_data_smithi188_92122_object24768:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e198)", 2024-04-01T19:30:05.615 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:30:05.606258+0000", 2024-04-01T19:30:05.615 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.00018440000000000001, 2024-04-01T19:30:05.615 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00033826599999999999, 2024-04-01T19:30:05.615 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:30:05.615 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:30:05.615 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "started", 2024-04-01T19:30:05.615 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:30:05.615 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:30:05.615 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:30:05.615 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 24769 2024-04-01T19:30:05.615 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.615 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:30:05.616 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.616 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:30:05.616 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.606258+0000", 2024-04-01T19:30:05.616 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:30:05.616 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.616 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.616 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:30:05.616 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.606258+0000", 2024-04-01T19:30:05.616 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:30:05.616 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.616 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.616 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:30:05.616 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.606260+0000", 2024-04-01T19:30:05.616 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.584e-06 2024-04-01T19:30:05.617 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.617 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.617 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:30:05.617 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.606341+0000", 2024-04-01T19:30:05.617 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0765000000000003e-05 2024-04-01T19:30:05.617 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.617 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.617 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:30:05.617 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.606355+0000", 2024-04-01T19:30:05.617 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4705000000000001e-05 2024-04-01T19:30:05.617 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.617 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.617 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:30:05.618 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.606364+0000", 2024-04-01T19:30:05.618 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.2789999999999998e-06 2024-04-01T19:30:05.618 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.618 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.618 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:30:05.618 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.606417+0000", 2024-04-01T19:30:05.618 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3504999999999997e-05 2024-04-01T19:30:05.618 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:30:05.618 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:30:05.618 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:30:05.618 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:05.606536+0000", 2024-04-01T19:30:05.618 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000118748 2024-04-01T19:30:05.618 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:30:05.618 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:30:05.619 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:30:05.619 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:30:05.619 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-04-01T19:30:05.619 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 3 2024-04-01T19:30:05.619 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:30:05.637 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:30:05.642 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:05.643 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:30:05.744 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:30:05.793 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:05.858 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:30:05.861 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:05.861 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:30:05.962 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:30:06.005 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:06.090 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_ops_in_flight 2024-04-01T19:30:06.150 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:30:06.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:06.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:06 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:30:06.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:06 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:30:06.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:06 smithi062 ceph-mon[44211]: pgmap v594: 17 pgs: 17 active+clean; 382 MiB data, 1.8 GiB used, 982 GiB / 983 GiB avail; 64 MiB/s wr, 1.02k op/s 2024-04-01T19:30:06.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:06 smithi062 ceph-mon[44211]: osdmap e198: 12 total, 12 up, 11 in 2024-04-01T19:30:06.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:06.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:06 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:30:06.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:06 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:30:06.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:06 smithi022 ceph-mon[39439]: pgmap v594: 17 pgs: 17 active+clean; 382 MiB data, 1.8 GiB used, 982 GiB / 983 GiB avail; 64 MiB/s wr, 1.02k op/s 2024-04-01T19:30:06.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:06 smithi022 ceph-mon[39439]: osdmap e198: 12 total, 12 up, 11 in 2024-04-01T19:30:06.366 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:30:06.373 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:06.374 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:30:06.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:06.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:06 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:30:06.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:06 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:30:06.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:06 smithi188 ceph-mon[43939]: pgmap v594: 17 pgs: 17 active+clean; 382 MiB data, 1.8 GiB used, 982 GiB / 983 GiB avail; 64 MiB/s wr, 1.02k op/s 2024-04-01T19:30:06.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:06 smithi188 ceph-mon[43939]: osdmap e198: 12 total, 12 up, 11 in 2024-04-01T19:30:06.382 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_blocked_ops 2024-04-01T19:30:06.463 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:30:06.475 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:30:06.515 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:06.586 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 6 15 28555 28540 297.273 241.25 0.00313048 0.00336178 2024-04-01T19:30:06.722 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:30:06.725 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:06.725 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:30:06.817 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:30:06.826 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:30:06.867 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:06.896 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:30:06.901 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:06.902 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:30:07.003 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:30:07.047 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:07.078 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:30:07.081 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:07.081 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:30:07.182 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:30:07.217 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:07.243 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:30:07.246 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:07.247 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:30:07.348 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:30:07.385 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:07.586 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 7 15 32063 32048 286.12 219.25 0.00537739 0.00349333 2024-04-01T19:30:07.593 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:30:07.595 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:07.596 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:30:07.697 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:30:07.716 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:30:07.758 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:08.024 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:30:08.026 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:08.026 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:30:08.127 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:30:08.128 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:30:08.169 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:08.256 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:08 smithi022 ceph-mon[39439]: pgmap v596: 17 pgs: 17 active+clean; 1.2 GiB data, 3.3 GiB used, 980 GiB / 983 GiB avail; 198 MiB/s wr, 3.17k op/s 2024-04-01T19:30:08.256 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:08 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1437180577' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:30:08.256 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:08 smithi022 ceph-mon[39439]: from='client.25129 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:30:08.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:08 smithi188 ceph-mon[43939]: pgmap v596: 17 pgs: 17 active+clean; 1.2 GiB data, 3.3 GiB used, 980 GiB / 983 GiB avail; 198 MiB/s wr, 3.17k op/s 2024-04-01T19:30:08.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:08 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1437180577' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:30:08.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:08 smithi188 ceph-mon[43939]: from='client.25129 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:30:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:08 smithi062 ceph-mon[44211]: pgmap v596: 17 pgs: 17 active+clean; 1.2 GiB data, 3.3 GiB used, 980 GiB / 983 GiB avail; 198 MiB/s wr, 3.17k op/s 2024-04-01T19:30:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:08 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1437180577' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:30:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:08 smithi062 ceph-mon[44211]: from='client.25129 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:30:08.586 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 8 16 35296 35280 275.603 202 0.00259418 0.00362654 2024-04-01T19:30:08.865 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:30:08.865 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:30:08.865 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-01T19:30:08.865 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:30:09.278 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:09 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:30:09.278 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:09 smithi022 ceph-mon[39439]: from='client.25129 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:30:09.279 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:09 smithi022 ceph-mon[39439]: osdmap e199: 12 total, 12 up, 11 in 2024-04-01T19:30:09.280 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:09 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:30:09.280 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:09 smithi188 ceph-mon[43939]: from='client.25129 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:30:09.280 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:09 smithi188 ceph-mon[43939]: osdmap e199: 12 total, 12 up, 11 in 2024-04-01T19:30:09.329 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:30:09.331 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:09.332 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:30:09.433 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:30:09.475 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:09.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:09 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:30:09.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:09 smithi062 ceph-mon[44211]: from='client.25129 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:30:09.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:09 smithi062 ceph-mon[44211]: osdmap e199: 12 total, 12 up, 11 in 2024-04-01T19:30:09.586 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 9 15 38818 38803 269.444 220.188 0.0106881 0.0037097 2024-04-01T19:30:09.667 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-01T19:30:09.667 INFO:tasks.thrashosds.thrasher:Adding osd 8 2024-04-01T19:30:09.667 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd in 8 2024-04-01T19:30:10.040 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:30:10.043 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:10.044 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:30:10.103 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:30:10.103 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:30:10.103 INFO:teuthology.orchestra.run.smithi062.stdout: "complaint_time": 30, 2024-04-01T19:30:10.103 INFO:teuthology.orchestra.run.smithi062.stdout: "num_blocked_ops": 0 2024-04-01T19:30:10.103 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:30:10.145 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:30:10.197 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:10.284 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:30:10.287 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:10.287 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:10 smithi022 ceph-mon[39439]: pgmap v598: 17 pgs: 17 active+clean; 1.6 GiB data, 4.1 GiB used, 979 GiB / 983 GiB avail; 242 MiB/s wr, 3.88k op/s 2024-04-01T19:30:10.288 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:30:10.346 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:30:10.364 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:30:10.389 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:30:10.414 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:30:10.444 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:10.457 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:30:10.495 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:30:10.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:10 smithi062 ceph-mon[44211]: pgmap v598: 17 pgs: 17 active+clean; 1.6 GiB data, 4.1 GiB used, 979 GiB / 983 GiB avail; 242 MiB/s wr, 3.88k op/s 2024-04-01T19:30:10.535 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:30:10.571 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:30:10.586 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 10 15 41765 41750 260.916 184.188 0.00486244 0.00383092 2024-04-01T19:30:10.608 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:30:10.613 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:30:10.617 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:10.618 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:30:10.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:10 smithi188 ceph-mon[43939]: pgmap v598: 17 pgs: 17 active+clean; 1.6 GiB data, 4.1 GiB used, 979 GiB / 983 GiB avail; 242 MiB/s wr, 3.88k op/s 2024-04-01T19:30:10.649 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:30:10.692 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:30:10.719 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:30:10.728 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:30:10.758 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:10.765 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:30:10.788 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:30:10.792 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:10.792 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:30:10.797 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:30:10.802 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:30:10.802 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:30:10.802 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:30:10.802 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:30:10.802 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:30:10.802 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:30:10.802 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:30:10.802 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:30:10.802 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-04-01T19:30:10.802 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:30:10.802 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:30:10.802 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:30:10.893 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:30:10.914 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_historic_ops 2024-04-01T19:30:10.949 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:10.980 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:30:10.984 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:10.985 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:30:11.086 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:30:11.127 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:11.175 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:30:11.180 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:11.180 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:30:11.281 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:30:11.315 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:11.339 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:30:11.342 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:11.343 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:30:11.368 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:30:11.443 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:30:11.477 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:11 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2250910882' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:30:11.477 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:11.477 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:11.477 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:11.477 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:11.477 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:11.477 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:11.477 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:11.480 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:11.506 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:30:11.509 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:11.510 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:30:11.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:11 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2250910882' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:30:11.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:11.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:11.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:11.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:11.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:11.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:11.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:11.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:11 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2250910882' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:30:11.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:11.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:11.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:11.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:11.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:11.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:11.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:11.586 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 11 16 44777 44761 254.303 188.188 0.00351051 0.00393044 2024-04-01T19:30:11.611 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:30:11.657 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:11.692 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:30:11.696 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:11.697 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:30:11.798 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:30:11.807 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:30:11.831 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:11.856 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:30:11.859 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:11.859 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:30:11.960 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:30:12.029 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:12.093 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:30:12.097 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:12.098 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:30:12.199 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:30:12.239 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:12 smithi062 ceph-mon[44211]: pgmap v599: 17 pgs: 17 active+clean; 2.2 GiB data, 5.3 GiB used, 978 GiB / 983 GiB avail; 299 MiB/s wr, 4.78k op/s 2024-04-01T19:30:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:12.266 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:30:12.270 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:12.271 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:30:12.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:12.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:12.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:12.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:12 smithi022 ceph-mon[39439]: pgmap v599: 17 pgs: 17 active+clean; 2.2 GiB data, 5.3 GiB used, 978 GiB / 983 GiB avail; 299 MiB/s wr, 4.78k op/s 2024-04-01T19:30:12.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:12.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:12.372 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:30:12.414 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:12.445 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:30:12.449 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:12.450 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:30:12.551 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:30:12.586 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 12 16 47693 47677 248.298 182.25 0.00275712 0.00402492 2024-04-01T19:30:12.606 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:12 smithi188 ceph-mon[43939]: pgmap v599: 17 pgs: 17 active+clean; 2.2 GiB data, 5.3 GiB used, 978 GiB / 983 GiB avail; 299 MiB/s wr, 4.78k op/s 2024-04-01T19:30:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:12.862 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:30:12.869 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:12.869 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:30:12.920 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:30:12.970 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:30:13.011 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:13.037 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:30:13.041 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:13.041 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:30:13.142 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:30:13.175 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:13.199 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:30:13.203 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:13.204 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:30:13.305 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:30:13.365 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:13.408 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:30:13.413 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:13.414 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:30:13.503 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:30:13.503 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:30:13.514 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:30:13.568 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:13.586 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 13 16 50434 50418 242.376 171.312 0.00795795 0.00412417 2024-04-01T19:30:13.779 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:30:13.784 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:13.784 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:30:13.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:13 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[39416]: 2024-04-01T19:30:13.545+0000 7fd025a9f700 -1 mon.a@0(leader).osd e199 definitely_dead 0 2024-04-01T19:30:13.885 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:30:13.921 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:13.944 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:30:13.947 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:13.948 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:30:14.049 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:30:14.085 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:14.114 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:30:14.118 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:14.118 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:30:14.150 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:30:14.178 INFO:teuthology.orchestra.run.smithi022.stderr:marked in osd.8. 2024-04-01T19:30:14.194 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:14 smithi022 ceph-mon[39439]: pgmap v600: 17 pgs: 17 active+clean; 2.5 GiB data, 6.0 GiB used, 977 GiB / 983 GiB avail; 277 MiB/s wr, 4.43k op/s 2024-04-01T19:30:14.194 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:14 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3933868765' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["8"]}]: dispatch 2024-04-01T19:30:14.219 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:30:14.251 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:14 smithi062 ceph-mon[44211]: pgmap v600: 17 pgs: 17 active+clean; 2.5 GiB data, 6.0 GiB used, 977 GiB / 983 GiB avail; 277 MiB/s wr, 4.43k op/s 2024-04-01T19:30:14.252 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:14 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3933868765' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["8"]}]: dispatch 2024-04-01T19:30:14.259 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:14.284 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_ops_in_flight 2024-04-01T19:30:14.308 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:14 smithi188 ceph-mon[43939]: pgmap v600: 17 pgs: 17 active+clean; 2.5 GiB data, 6.0 GiB used, 977 GiB / 983 GiB avail; 277 MiB/s wr, 4.43k op/s 2024-04-01T19:30:14.309 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:14 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3933868765' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["8"]}]: dispatch 2024-04-01T19:30:14.339 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:30:14.344 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:14.345 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:30:14.446 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:30:14.472 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:14.491 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:30:14.493 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:14.493 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:30:14.549 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:30:14.587 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 14 16 52410 52394 233.883 123.5 0.00287827 0.0041695 2024-04-01T19:30:14.594 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:30:14.623 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:14.971 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:30:14.974 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:14.974 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:30:14.991 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:30:14.993 INFO:tasks.thrashosds.thrasher:Added osd 8 2024-04-01T19:30:15.076 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:30:15.108 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:15.224 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:15 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3933868765' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["8"]}]': finished 2024-04-01T19:30:15.224 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:15 smithi022 ceph-mon[39439]: osdmap e200: 12 total, 12 up, 12 in 2024-04-01T19:30:15.224 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:15 smithi022 ceph-mon[39439]: osdmap e201: 12 total, 12 up, 12 in 2024-04-01T19:30:15.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:15 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3933868765' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["8"]}]': finished 2024-04-01T19:30:15.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:15 smithi188 ceph-mon[43939]: osdmap e200: 12 total, 12 up, 12 in 2024-04-01T19:30:15.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:15 smithi188 ceph-mon[43939]: osdmap e201: 12 total, 12 up, 12 in 2024-04-01T19:30:15.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:15 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3933868765' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["8"]}]': finished 2024-04-01T19:30:15.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:15 smithi062 ceph-mon[44211]: osdmap e200: 12 total, 12 up, 12 in 2024-04-01T19:30:15.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:15 smithi062 ceph-mon[44211]: osdmap e201: 12 total, 12 up, 12 in 2024-04-01T19:30:15.587 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 15 16 52410 52394 218.29 0 - 0.0041695 2024-04-01T19:30:16.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:16 smithi062 ceph-mon[44211]: pgmap v602: 17 pgs: 17 active+clean; 2.7 GiB data, 6.4 GiB used, 977 GiB / 983 GiB avail; 199 MiB/s wr, 3.18k op/s 2024-04-01T19:30:16.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:16 smithi062 ceph-mon[44211]: osdmap e202: 12 total, 12 up, 12 in 2024-04-01T19:30:16.512 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:16 smithi188 ceph-mon[43939]: pgmap v602: 17 pgs: 17 active+clean; 2.7 GiB data, 6.4 GiB used, 977 GiB / 983 GiB avail; 199 MiB/s wr, 3.18k op/s 2024-04-01T19:30:16.512 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:16 smithi188 ceph-mon[43939]: osdmap e202: 12 total, 12 up, 12 in 2024-04-01T19:30:16.562 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:30:16.569 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:16.569 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:30:16.587 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 16 16 52546 52530 205.178 4.25 0.00281086 0.00487159 2024-04-01T19:30:16.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:16 smithi022 ceph-mon[39439]: pgmap v602: 17 pgs: 17 active+clean; 2.7 GiB data, 6.4 GiB used, 977 GiB / 983 GiB avail; 199 MiB/s wr, 3.18k op/s 2024-04-01T19:30:16.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:16 smithi022 ceph-mon[39439]: osdmap e202: 12 total, 12 up, 12 in 2024-04-01T19:30:16.671 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:30:16.723 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:16.752 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:30:16.757 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:16.757 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:30:16.858 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:30:16.897 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:17.105 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:30:17.107 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:17.107 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:30:17.184 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:30:17.208 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:30:17.256 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:17.284 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:30:17.288 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:17.289 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:30:17.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:17 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1132275153' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:30:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:17 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1132275153' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:30:17.390 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:30:17.408 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:30:17.434 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:17.434 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:30:17.470 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:30:17.501 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:30:17.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:17 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1132275153' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:30:17.531 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:30:17.565 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:30:17.578 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:30:17.583 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:17.583 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:30:17.587 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 17 16 54911 54895 201.803 147.812 0.00491492 0.00495304 2024-04-01T19:30:17.598 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:30:17.631 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:30:17.661 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:30:17.684 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:30:17.691 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:30:17.721 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:30:17.726 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:17.755 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:30:17.757 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:30:17.757 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:30:17.757 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:30:17.758 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:30:17.758 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:30:17.758 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:30:17.758 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:30:17.758 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:30:17.758 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:30:17.758 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:30:17.758 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:30:17.758 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:30:17.759 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:30:17.762 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:17.762 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:30:17.863 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:30:17.905 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:17.935 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:30:17.938 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:17.939 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:30:18.040 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:30:18.090 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:18.114 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:30:18.117 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:18.118 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:30:18.219 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:30:18.263 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:18 smithi188 ceph-mon[43939]: pgmap v605: 17 pgs: 17 active+clean; 3.1 GiB data, 7.3 GiB used, 976 GiB / 983 GiB avail; 139 MiB/s wr, 2.23k op/s 2024-04-01T19:30:18.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:18 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:30:18.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:18 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1132275153' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:30:18.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:18 smithi188 ceph-mon[43939]: osdmap e203: 12 total, 12 up, 12 in 2024-04-01T19:30:18.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:18 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2425261398' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:30:18.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:18.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:18.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:18.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:18.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:18.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:18.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:18.383 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:30:18.383 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:30:18.383 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:18.383 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.25117.0:56753 3.2 e203/191 3:48d1fc2e:::benchmark_data_smithi188_92122_object56752:head v 203'3481, mlcod=203'3476)", 2024-04-01T19:30:18.383 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:30:18.382777+0000", 2024-04-01T19:30:18.383 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.002356632, 2024-04-01T19:30:18.383 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0023784689999999998, 2024-04-01T19:30:18.383 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:18.383 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:18.384 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-01T19:30:18.384 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:18.384 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:18.384 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:18.384 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:30:18.382777+0000", 2024-04-01T19:30:18.384 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:18.384 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:18.384 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:18.384 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:18.384 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:30:18.382777+0000", 2024-04-01T19:30:18.384 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:18.385 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:18.385 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:18.385 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:18.385 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:30:18.382778+0000", 2024-04-01T19:30:18.385 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3769999999999999e-06 2024-04-01T19:30:18.385 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:18.385 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:18.385 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:18.385 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:30:18.382919+0000", 2024-04-01T19:30:18.385 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014113999999999999 2024-04-01T19:30:18.385 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:18.385 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:18.385 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:18.385 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:30:18.382929+0000", 2024-04-01T19:30:18.386 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7489999999999993e-06 2024-04-01T19:30:18.386 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:18.386 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:18.386 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:18.386 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:30:18.382937+0000", 2024-04-01T19:30:18.386 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0190000000000006e-06 2024-04-01T19:30:18.386 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:18.386 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:18.386 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:18.386 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:30:18.382993+0000", 2024-04-01T19:30:18.386 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5863999999999999e-05 2024-04-01T19:30:18.387 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:18.387 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:18.387 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:18.387 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:30:18.383005+0000", 2024-04-01T19:30:18.387 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1959e-05 2024-04-01T19:30:18.387 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:18.387 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:18.387 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:18.387 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:18.387 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:18.387 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.25117.0:56759 3.0 e203/191 3:06caec50:::benchmark_data_smithi188_92122_object56758:head v 203'3521, mlcod=203'3518)", 2024-04-01T19:30:18.387 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:30:18.383307+0000", 2024-04-01T19:30:18.387 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0018262039999999999, 2024-04-01T19:30:18.387 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018950499999999999, 2024-04-01T19:30:18.387 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:18.388 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:18.388 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-01T19:30:18.388 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:18.388 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:18.388 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:18.388 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:30:18.383307+0000", 2024-04-01T19:30:18.388 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:18.388 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:18.388 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:18.388 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:18.388 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:30:18.383307+0000", 2024-04-01T19:30:18.388 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:18.388 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:18.388 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:18.388 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:18.389 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:30:18.383308+0000", 2024-04-01T19:30:18.389 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1650000000000001e-06 2024-04-01T19:30:18.389 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:18.389 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:18.389 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:18.389 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:30:18.383331+0000", 2024-04-01T19:30:18.389 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2586e-05 2024-04-01T19:30:18.389 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:18.389 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:18.389 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:18.389 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:30:18.383350+0000", 2024-04-01T19:30:18.389 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9340000000000001e-05 2024-04-01T19:30:18.389 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:18.389 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:18.389 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:18.390 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:30:18.383358+0000", 2024-04-01T19:30:18.390 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2509999999999994e-06 2024-04-01T19:30:18.390 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:18.390 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:18.390 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:18.390 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:30:18.383419+0000", 2024-04-01T19:30:18.390 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0971000000000003e-05 2024-04-01T19:30:18.390 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:18.390 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:18.390 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:18.391 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:30:18.383438+0000", 2024-04-01T19:30:18.391 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8712999999999999e-05 2024-04-01T19:30:18.391 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:18.391 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:18.391 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:18.391 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:18.391 INFO:teuthology.orchestra.run.smithi188.stdout: ], 2024-04-01T19:30:18.391 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 2 2024-04-01T19:30:18.392 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:30:18.436 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:30:18.439 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:18.440 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:30:18.440 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:18 smithi022 ceph-mon[39439]: pgmap v605: 17 pgs: 17 active+clean; 3.1 GiB data, 7.3 GiB used, 976 GiB / 983 GiB avail; 139 MiB/s wr, 2.23k op/s 2024-04-01T19:30:18.440 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:18 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:30:18.440 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:18 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1132275153' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:30:18.440 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:18 smithi022 ceph-mon[39439]: osdmap e203: 12 total, 12 up, 12 in 2024-04-01T19:30:18.440 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:18 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2425261398' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:30:18.440 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:18.441 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:18.441 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:18.441 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:18.441 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:18.441 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:18.441 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:18 smithi062 ceph-mon[44211]: pgmap v605: 17 pgs: 17 active+clean; 3.1 GiB data, 7.3 GiB used, 976 GiB / 983 GiB avail; 139 MiB/s wr, 2.23k op/s 2024-04-01T19:30:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:18 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:30:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:18 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1132275153' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:30:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:18 smithi062 ceph-mon[44211]: osdmap e203: 12 total, 12 up, 12 in 2024-04-01T19:30:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:18 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2425261398' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:30:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:18.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:18.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:18.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:18.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:18.540 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:30:18.583 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:18.587 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 18 16 57252 57236 198.719 146.312 0.00452741 0.00503082 2024-04-01T19:30:18.945 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:30:18.949 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:18.949 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:30:19.050 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:30:19.094 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:19.123 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:30:19.128 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:19.129 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:30:19.199 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_blocked_ops 2024-04-01T19:30:19.229 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:30:19.300 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:19.333 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:30:19.338 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:19.338 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:30:19.439 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:30:19.480 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:19.480 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:19.481 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:19.481 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:19.481 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:19.483 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:19.514 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:30:19.519 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:19.520 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:30:19.567 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:30:19.587 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 19 16 59576 59560 195.904 145.25 0.00308051 0.0051024 2024-04-01T19:30:19.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:19.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:19.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:19.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:19.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:19.621 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:30:19.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:19.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:19.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:19.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:19.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:19.664 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:19.699 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:30:19.704 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:19.705 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:30:19.806 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:30:19.845 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:19.877 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:30:19.882 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:19.883 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:30:19.984 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:30:19.994 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 9, 10, 11, 8] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7, 9, 10, 11, 8] 2024-04-01T19:30:19.994 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-01T19:30:19.995 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-04-01T19:30:19.995 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.0 reset_purged_snaps_last 2024-04-01T19:30:20.027 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:20.058 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:30:20.066 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:20.067 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:30:20.167 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:30:20.213 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:20.250 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:30:20.256 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:20.256 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:30:20.270 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:30:20.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:20 smithi022 ceph-mon[39439]: pgmap v607: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 3.3 GiB data, 7.6 GiB used, 976 GiB / 983 GiB avail; 136 MiB/s wr, 2.18k op/s; 3157/107314 objects misplaced (2.942%); 1.2 MiB/s, 19 objects/s recovering 2024-04-01T19:30:20.311 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:20 smithi022 ceph-mon[39439]: osdmap e204: 12 total, 12 up, 12 in 2024-04-01T19:30:20.357 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:30:20.389 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:20 smithi188 ceph-mon[43939]: pgmap v607: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 3.3 GiB data, 7.6 GiB used, 976 GiB / 983 GiB avail; 136 MiB/s wr, 2.18k op/s; 3157/107314 objects misplaced (2.942%); 1.2 MiB/s, 19 objects/s recovering 2024-04-01T19:30:20.389 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:20 smithi188 ceph-mon[43939]: osdmap e204: 12 total, 12 up, 12 in 2024-04-01T19:30:20.392 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:20.421 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:30:20.424 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:20.424 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:30:20.455 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:30:20.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:20 smithi062 ceph-mon[44211]: pgmap v607: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 3.3 GiB data, 7.6 GiB used, 976 GiB / 983 GiB avail; 136 MiB/s wr, 2.18k op/s; 3157/107314 objects misplaced (2.942%); 1.2 MiB/s, 19 objects/s recovering 2024-04-01T19:30:20.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:20 smithi062 ceph-mon[44211]: osdmap e204: 12 total, 12 up, 12 in 2024-04-01T19:30:20.524 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:30:20.575 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:20.587 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:30:20.590059 min lat: 0.00100536 max lat: 2.32602 avg lat: 0.00518072 2024-04-01T19:30:20.587 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:30:20.587 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 20 16 61769 61753 192.962 137.062 0.00500314 0.00518072 2024-04-01T19:30:20.720 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:30:20.726 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:20.727 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:30:20.828 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:30:20.881 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:20.956 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:30:21.339 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:30:21.350 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:21.351 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:30:21.374 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:30:21.451 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:30:21.496 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:21.531 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:30:21.544 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:21.545 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:30:21.565 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:30:21.565 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:30:21.565 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-01T19:30:21.565 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-01T19:30:21.565 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:30:21.587 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 21 16 63876 63860 190.043 131.688 0.00343784 0.00525991 2024-04-01T19:30:21.646 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:30:21.695 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:21.726 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:30:21.727 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:21.727 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:30:21.828 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:30:21.868 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:22.054 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:30:22.060 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:22.061 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:30:22.064 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:30:22.162 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:30:22.208 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:22.232 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:30:22.235 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:22.235 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:30:22.336 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:30:22.366 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_historic_ops 2024-04-01T19:30:22.385 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:22.433 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:30:22.438 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:22.438 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:30:22.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:22 smithi062 ceph-mon[44211]: pgmap v609: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 141 MiB/s wr, 2.26k op/s; 3157/115868 objects misplaced (2.725%); 949 KiB/s, 14 objects/s recovering 2024-04-01T19:30:22.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:22 smithi022 ceph-mon[39439]: pgmap v609: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 141 MiB/s wr, 2.26k op/s; 3157/115868 objects misplaced (2.725%); 949 KiB/s, 14 objects/s recovering 2024-04-01T19:30:22.540 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:30:22.579 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:22 smithi188 ceph-mon[43939]: pgmap v609: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 141 MiB/s wr, 2.26k op/s; 3157/115868 objects misplaced (2.725%); 949 KiB/s, 14 objects/s recovering 2024-04-01T19:30:22.583 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:22.587 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 22 16 66045 66029 187.566 135.562 0.00392232 0.0053299 2024-04-01T19:30:22.614 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:30:22.617 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:22.618 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:30:22.719 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:30:22.745 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:30:22.764 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:23.587 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 23 16 68207 68191 185.286 135.125 0.00554351 0.00539571 2024-04-01T19:30:24.495 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:24 smithi188 ceph-mon[43939]: pgmap v610: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 3.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 108 MiB/s wr, 1.73k op/s; 3157/122970 objects misplaced (2.567%); 812 KiB/s, 12 objects/s recovering 2024-04-01T19:30:24.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:24 smithi062 ceph-mon[44211]: pgmap v610: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 3.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 108 MiB/s wr, 1.73k op/s; 3157/122970 objects misplaced (2.567%); 812 KiB/s, 12 objects/s recovering 2024-04-01T19:30:24.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:24 smithi022 ceph-mon[39439]: pgmap v610: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 3.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 108 MiB/s wr, 1.73k op/s; 3157/122970 objects misplaced (2.567%); 812 KiB/s, 12 objects/s recovering 2024-04-01T19:30:24.587 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 24 16 70356 70340 183.162 134.312 0.00710737 0.00545826 2024-04-01T19:30:24.834 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:30:24.835 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:30:24.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:30:24.835 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:30:24.835 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.835 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:248721 2.d 2:b1003e65:::benchmark_data_smithi188_77607_object81317:head [delete] snapc 0=[] ondisk+write+known_if_redirected e156)", 2024-04-01T19:30:24.835 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:46.897485+0000", 2024-04-01T19:30:24.835 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 157.93608035700001, 2024-04-01T19:30:24.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16256036500000001, 2024-04-01T19:30:24.835 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:24.835 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:24.835 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:24.836 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:24.836 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:24.836 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:24.836 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 248721 2024-04-01T19:30:24.836 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.836 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:24.836 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.836 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:24.836 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.897485+0000", 2024-04-01T19:30:24.836 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.836 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.836 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.836 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:24.837 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.897485+0000", 2024-04-01T19:30:24.837 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.837 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.837 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.837 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:24.837 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.897487+0000", 2024-04-01T19:30:24.837 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9860000000000001e-06 2024-04-01T19:30:24.837 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.837 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.837 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:24.837 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.897493+0000", 2024-04-01T19:30:24.837 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7239999999999997e-06 2024-04-01T19:30:24.837 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.837 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.838 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:24.838 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.897506+0000", 2024-04-01T19:30:24.838 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2774e-05 2024-04-01T19:30:24.838 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.838 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.838 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:24.838 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.897514+0000", 2024-04-01T19:30:24.838 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1850000000000004e-06 2024-04-01T19:30:24.838 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.838 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.838 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.838 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.923769+0000", 2024-04-01T19:30:24.838 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026255392999999998 2024-04-01T19:30:24.839 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.839 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.839 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:24.839 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.923894+0000", 2024-04-01T19:30:24.839 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012517 2024-04-01T19:30:24.839 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.839 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.839 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:30:24.839 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.924022+0000", 2024-04-01T19:30:24.839 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012779100000000001 2024-04-01T19:30:24.839 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.839 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.839 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:24.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.928773+0000", 2024-04-01T19:30:24.840 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0047510039999999996 2024-04-01T19:30:24.840 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.840 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.840 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:24.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.059965+0000", 2024-04-01T19:30:24.840 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13119133199999999 2024-04-01T19:30:24.840 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.840 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.840 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:24.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.060002+0000", 2024-04-01T19:30:24.840 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7548e-05 2024-04-01T19:30:24.840 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.841 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.841 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:24.841 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.060046+0000", 2024-04-01T19:30:24.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3458000000000003e-05 2024-04-01T19:30:24.841 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.841 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:24.841 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.841 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.841 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.841 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:249236 2.d 2:b6ce699d:::benchmark_data_smithi188_77607_object81832:head [delete] snapc 0=[] ondisk+write+known_if_redirected e156)", 2024-04-01T19:30:24.841 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:47.591312+0000", 2024-04-01T19:30:24.841 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 157.24225360099999, 2024-04-01T19:30:24.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.181560891, 2024-04-01T19:30:24.842 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:24.842 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:24.842 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:24.842 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:24.842 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:24.842 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:24.842 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 249236 2024-04-01T19:30:24.842 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.842 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:24.842 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.842 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:24.842 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.591312+0000", 2024-04-01T19:30:24.842 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.843 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.843 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.843 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:24.843 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.591312+0000", 2024-04-01T19:30:24.843 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.843 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.843 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.843 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:24.843 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.591314+0000", 2024-04-01T19:30:24.843 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.385e-06 2024-04-01T19:30:24.843 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.843 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.843 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:24.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.591321+0000", 2024-04-01T19:30:24.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0840000000000003e-06 2024-04-01T19:30:24.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:24.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.591336+0000", 2024-04-01T19:30:24.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4575e-05 2024-04-01T19:30:24.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:24.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.591356+0000", 2024-04-01T19:30:24.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9755e-05 2024-04-01T19:30:24.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.626225+0000", 2024-04-01T19:30:24.845 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034869270000000001 2024-04-01T19:30:24.845 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:24.845 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.626348+0000", 2024-04-01T19:30:24.845 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012279399999999999 2024-04-01T19:30:24.845 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:30:24.845 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.626469+0000", 2024-04-01T19:30:24.845 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012113 2024-04-01T19:30:24.845 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:24.845 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.655862+0000", 2024-04-01T19:30:24.846 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029392686000000001 2024-04-01T19:30:24.846 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.846 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.846 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:24.846 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.772758+0000", 2024-04-01T19:30:24.846 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.11689601199999999 2024-04-01T19:30:24.846 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.846 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.846 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:24.846 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.772812+0000", 2024-04-01T19:30:24.846 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4122999999999997e-05 2024-04-01T19:30:24.846 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.846 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.846 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:24.847 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.772873+0000", 2024-04-01T19:30:24.847 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1076999999999998e-05 2024-04-01T19:30:24.847 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.847 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:24.847 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.847 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.847 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.847 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:250183 2.d 2:b6dffcc1:::benchmark_data_smithi188_77607_object82779:head [delete] snapc 0=[] ondisk+write+known_if_redirected e156)", 2024-04-01T19:30:24.847 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:48.757562+0000", 2024-04-01T19:30:24.847 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 156.076003638, 2024-04-01T19:30:24.847 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16188115, 2024-04-01T19:30:24.847 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:24.847 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:24.847 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:24.847 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:24.848 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:24.848 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:24.848 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 250183 2024-04-01T19:30:24.848 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.848 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:24.848 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.848 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:24.848 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.757562+0000", 2024-04-01T19:30:24.848 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.848 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.848 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.848 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:24.848 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.757562+0000", 2024-04-01T19:30:24.848 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.848 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.848 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.849 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:24.849 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.757564+0000", 2024-04-01T19:30:24.849 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2089999999999999e-06 2024-04-01T19:30:24.849 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.849 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.849 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:24.849 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.757571+0000", 2024-04-01T19:30:24.849 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8700000000000003e-06 2024-04-01T19:30:24.849 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.849 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.849 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:24.849 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.757586+0000", 2024-04-01T19:30:24.849 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5325999999999999e-05 2024-04-01T19:30:24.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.850 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:24.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.757596+0000", 2024-04-01T19:30:24.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0013000000000001e-05 2024-04-01T19:30:24.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.850 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.787384+0000", 2024-04-01T19:30:24.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029787991 2024-04-01T19:30:24.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.850 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:24.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.787515+0000", 2024-04-01T19:30:24.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013011199999999999 2024-04-01T19:30:24.851 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.851 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:30:24.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.787644+0000", 2024-04-01T19:30:24.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000129164 2024-04-01T19:30:24.851 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.851 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:24.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.803111+0000", 2024-04-01T19:30:24.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015466881 2024-04-01T19:30:24.851 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.851 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:24.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.919319+0000", 2024-04-01T19:30:24.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.116208031 2024-04-01T19:30:24.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:24.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.919379+0000", 2024-04-01T19:30:24.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0327e-05 2024-04-01T19:30:24.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:24.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.919443+0000", 2024-04-01T19:30:24.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4226000000000005e-05 2024-04-01T19:30:24.852 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.853 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:24.853 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.853 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.853 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:250195 2.d 2:b3613023:::benchmark_data_smithi188_77607_object82791:head [delete] snapc 0=[] ondisk+write+known_if_redirected e156)", 2024-04-01T19:30:24.853 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:48.769498+0000", 2024-04-01T19:30:24.853 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 156.06406759399999, 2024-04-01T19:30:24.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.150167941, 2024-04-01T19:30:24.853 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:24.853 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:24.854 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:24.854 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:24.854 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:24.854 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:24.854 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 250195 2024-04-01T19:30:24.854 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.854 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:24.854 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.854 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:24.854 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.769498+0000", 2024-04-01T19:30:24.854 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.854 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.854 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:24.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.769498+0000", 2024-04-01T19:30:24.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:24.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.769500+0000", 2024-04-01T19:30:24.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3870000000000002e-06 2024-04-01T19:30:24.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:24.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.769508+0000", 2024-04-01T19:30:24.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1430000000000001e-06 2024-04-01T19:30:24.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.856 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:24.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.769523+0000", 2024-04-01T19:30:24.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5625e-05 2024-04-01T19:30:24.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.856 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:24.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.769531+0000", 2024-04-01T19:30:24.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3110000000000006e-06 2024-04-01T19:30:24.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.856 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.792882+0000", 2024-04-01T19:30:24.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023350724999999999 2024-04-01T19:30:24.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:24.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.793022+0000", 2024-04-01T19:30:24.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014011000000000001 2024-04-01T19:30:24.857 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:30:24.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.793168+0000", 2024-04-01T19:30:24.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014591699999999999 2024-04-01T19:30:24.857 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:24.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.803160+0000", 2024-04-01T19:30:24.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0099919559999999998 2024-04-01T19:30:24.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.858 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:24.858 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.919577+0000", 2024-04-01T19:30:24.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.116416319 2024-04-01T19:30:24.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.858 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:24.858 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.919620+0000", 2024-04-01T19:30:24.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3188000000000001e-05 2024-04-01T19:30:24.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.858 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:24.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.919666+0000", 2024-04-01T19:30:24.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6260000000000001e-05 2024-04-01T19:30:24.859 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.859 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:24.859 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.859 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:250350 2.d 2:b8eceb9e:::benchmark_data_smithi188_77607_object82946:head [delete] snapc 0=[] ondisk+write+known_if_redirected e156)", 2024-04-01T19:30:24.859 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:48.978621+0000", 2024-04-01T19:30:24.859 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 155.85494444599999, 2024-04-01T19:30:24.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.146024284, 2024-04-01T19:30:24.859 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:24.859 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:24.859 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:24.860 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:24.860 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:24.860 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:24.860 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 250350 2024-04-01T19:30:24.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.860 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:24.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.860 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:24.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.978621+0000", 2024-04-01T19:30:24.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.860 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:24.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.978621+0000", 2024-04-01T19:30:24.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:24.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.978622+0000", 2024-04-01T19:30:24.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8999999999999996e-07 2024-04-01T19:30:24.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:24.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.978625+0000", 2024-04-01T19:30:24.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7350000000000001e-06 2024-04-01T19:30:24.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:24.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.978631+0000", 2024-04-01T19:30:24.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2450000000000003e-06 2024-04-01T19:30:24.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:24.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.978636+0000", 2024-04-01T19:30:24.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8590000000000004e-06 2024-04-01T19:30:24.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.989548+0000", 2024-04-01T19:30:24.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010912478999999999 2024-04-01T19:30:24.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:24.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.989667+0000", 2024-04-01T19:30:24.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000118585 2024-04-01T19:30:24.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:30:24.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.989790+0000", 2024-04-01T19:30:24.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012361800000000001 2024-04-01T19:30:24.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:24.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.994628+0000", 2024-04-01T19:30:24.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0048380970000000004 2024-04-01T19:30:24.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:24.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.124528+0000", 2024-04-01T19:30:24.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.12989994599999999 2024-04-01T19:30:24.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:24.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.124577+0000", 2024-04-01T19:30:24.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8554999999999998e-05 2024-04-01T19:30:24.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:24.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.124645+0000", 2024-04-01T19:30:24.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8474999999999997e-05 2024-04-01T19:30:24.865 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.865 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:24.865 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.865 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:250603 2.d 2:b946184c:::benchmark_data_smithi188_77607_object83199:head [delete] snapc 0=[] ondisk+write+known_if_redirected e156)", 2024-04-01T19:30:24.865 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:49.293661+0000", 2024-04-01T19:30:24.865 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 155.53990487300001, 2024-04-01T19:30:24.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14584196399999999, 2024-04-01T19:30:24.865 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:24.865 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:24.865 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:24.865 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:24.865 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:24.866 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:24.866 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 250603 2024-04-01T19:30:24.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.866 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:24.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:24.866 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.293661+0000", 2024-04-01T19:30:24.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:24.866 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.293661+0000", 2024-04-01T19:30:24.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:24.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.293663+0000", 2024-04-01T19:30:24.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0150000000000002e-06 2024-04-01T19:30:24.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:24.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.293668+0000", 2024-04-01T19:30:24.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6869999999999999e-06 2024-04-01T19:30:24.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:24.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.293680+0000", 2024-04-01T19:30:24.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1810999999999999e-05 2024-04-01T19:30:24.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:24.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.293686+0000", 2024-04-01T19:30:24.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6679999999999998e-06 2024-04-01T19:30:24.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.314363+0000", 2024-04-01T19:30:24.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020676792999999999 2024-04-01T19:30:24.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:24.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.314466+0000", 2024-04-01T19:30:24.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000103162 2024-04-01T19:30:24.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:30:24.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.314533+0000", 2024-04-01T19:30:24.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6952000000000005e-05 2024-04-01T19:30:24.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:24.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.326788+0000", 2024-04-01T19:30:24.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012254699000000001 2024-04-01T19:30:24.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:24.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.439418+0000", 2024-04-01T19:30:24.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.112630336 2024-04-01T19:30:24.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:24.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.439452+0000", 2024-04-01T19:30:24.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4051000000000003e-05 2024-04-01T19:30:24.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:24.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.439503+0000", 2024-04-01T19:30:24.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.079e-05 2024-04-01T19:30:24.870 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.871 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:24.871 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.871 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:251569 2.d 2:bc483287:::benchmark_data_smithi188_77607_object84165:head [delete] snapc 0=[] ondisk+write+known_if_redirected e157)", 2024-04-01T19:30:24.871 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:50.522652+0000", 2024-04-01T19:30:24.871 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 154.31091397500001, 2024-04-01T19:30:24.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16137095300000001, 2024-04-01T19:30:24.871 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:24.871 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:24.871 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:24.871 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:24.871 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:24.871 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:24.872 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 251569 2024-04-01T19:30:24.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.872 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:24.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:24.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.522652+0000", 2024-04-01T19:30:24.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:24.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.522652+0000", 2024-04-01T19:30:24.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:24.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.522654+0000", 2024-04-01T19:30:24.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2369999999999999e-06 2024-04-01T19:30:24.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:24.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.522670+0000", 2024-04-01T19:30:24.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5888000000000001e-05 2024-04-01T19:30:24.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:24.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.522686+0000", 2024-04-01T19:30:24.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5928999999999999e-05 2024-04-01T19:30:24.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:24.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.522693+0000", 2024-04-01T19:30:24.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7680000000000008e-06 2024-04-01T19:30:24.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.548310+0000", 2024-04-01T19:30:24.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.025616173999999999 2024-04-01T19:30:24.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:24.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.548442+0000", 2024-04-01T19:30:24.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000132772 2024-04-01T19:30:24.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:30:24.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.548556+0000", 2024-04-01T19:30:24.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000113393 2024-04-01T19:30:24.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:24.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.683906+0000", 2024-04-01T19:30:24.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.135349792 2024-04-01T19:30:24.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:24.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.683921+0000", 2024-04-01T19:30:24.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5631e-05 2024-04-01T19:30:24.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:24.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.683968+0000", 2024-04-01T19:30:24.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6279000000000002e-05 2024-04-01T19:30:24.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:24.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.684023+0000", 2024-04-01T19:30:24.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5090000000000003e-05 2024-04-01T19:30:24.876 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.876 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:24.876 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.877 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:251601 2.d 2:bd354f70:::benchmark_data_smithi188_77607_object84197:head [delete] snapc 0=[] ondisk+write+known_if_redirected e157)", 2024-04-01T19:30:24.877 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:50.549151+0000", 2024-04-01T19:30:24.877 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 154.28441472099999, 2024-04-01T19:30:24.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.146277241, 2024-04-01T19:30:24.877 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:24.877 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:24.877 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:24.877 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:24.877 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:24.877 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:24.877 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 251601 2024-04-01T19:30:24.877 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.877 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:24.877 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.877 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:24.878 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.549151+0000", 2024-04-01T19:30:24.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.878 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.878 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.878 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:24.878 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.549151+0000", 2024-04-01T19:30:24.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.878 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.878 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.878 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:24.878 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.549153+0000", 2024-04-01T19:30:24.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7090000000000001e-06 2024-04-01T19:30:24.878 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:24.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.549159+0000", 2024-04-01T19:30:24.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3520000000000003e-06 2024-04-01T19:30:24.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:24.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.549169+0000", 2024-04-01T19:30:24.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.798e-06 2024-04-01T19:30:24.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:24.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.549188+0000", 2024-04-01T19:30:24.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9017000000000001e-05 2024-04-01T19:30:24.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.679851+0000", 2024-04-01T19:30:24.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13066309100000001 2024-04-01T19:30:24.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:24.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.679937+0000", 2024-04-01T19:30:24.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5829999999999996e-05 2024-04-01T19:30:24.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:30:24.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.680015+0000", 2024-04-01T19:30:24.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8287000000000004e-05 2024-04-01T19:30:24.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:24.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.684239+0000", 2024-04-01T19:30:24.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0042242579999999998 2024-04-01T19:30:24.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:24.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.695316+0000", 2024-04-01T19:30:24.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011076618999999999 2024-04-01T19:30:24.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.882 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:24.882 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.695377+0000", 2024-04-01T19:30:24.882 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0841000000000002e-05 2024-04-01T19:30:24.882 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.882 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.882 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:24.882 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.695428+0000", 2024-04-01T19:30:24.882 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1439e-05 2024-04-01T19:30:24.882 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.882 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:24.882 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.882 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.882 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.883 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:253518 2.d 2:b2dfd025:::benchmark_data_smithi188_77607_object86114:head [delete] snapc 0=[] ondisk+write+known_if_redirected e157)", 2024-04-01T19:30:24.883 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:52.998586+0000", 2024-04-01T19:30:24.883 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 151.83497922999999, 2024-04-01T19:30:24.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.17168951199999999, 2024-04-01T19:30:24.883 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:24.883 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:24.883 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:24.883 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:24.883 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:24.883 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:24.883 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 253518 2024-04-01T19:30:24.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.883 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:24.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:24.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:52.998586+0000", 2024-04-01T19:30:24.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:24.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:52.998586+0000", 2024-04-01T19:30:24.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:24.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:52.998589+0000", 2024-04-01T19:30:24.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1320000000000001e-06 2024-04-01T19:30:24.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.885 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:24.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:52.998595+0000", 2024-04-01T19:30:24.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7129999999999999e-06 2024-04-01T19:30:24.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.885 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:24.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:52.998607+0000", 2024-04-01T19:30:24.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1582e-05 2024-04-01T19:30:24.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.885 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:24.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:52.998615+0000", 2024-04-01T19:30:24.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0029999999999994e-06 2024-04-01T19:30:24.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.886 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.039964+0000", 2024-04-01T19:30:24.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041349412000000002 2024-04-01T19:30:24.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:24.886 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.040085+0000", 2024-04-01T19:30:24.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012086099999999999 2024-04-01T19:30:24.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:30:24.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.040214+0000", 2024-04-01T19:30:24.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012912000000000001 2024-04-01T19:30:24.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:24.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.061849+0000", 2024-04-01T19:30:24.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.021635031999999998 2024-04-01T19:30:24.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:24.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.170163+0000", 2024-04-01T19:30:24.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.10831364 2024-04-01T19:30:24.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:24.888 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.170214+0000", 2024-04-01T19:30:24.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0695999999999997e-05 2024-04-01T19:30:24.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:24.888 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.170276+0000", 2024-04-01T19:30:24.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2321000000000002e-05 2024-04-01T19:30:24.888 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.888 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:24.888 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.888 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:254281 2.d 2:b91f57e9:::benchmark_data_smithi188_77607_object86877:head [delete] snapc 0=[] ondisk+write+known_if_redirected e157)", 2024-04-01T19:30:24.889 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:53.999010+0000", 2024-04-01T19:30:24.889 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 150.834555147, 2024-04-01T19:30:24.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.199172619, 2024-04-01T19:30:24.889 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:24.889 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:24.889 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:24.889 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:24.889 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:24.889 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:24.889 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 254281 2024-04-01T19:30:24.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.889 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:24.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:24.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.999010+0000", 2024-04-01T19:30:24.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:24.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.999010+0000", 2024-04-01T19:30:24.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:24.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.999012+0000", 2024-04-01T19:30:24.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5889999999999999e-06 2024-04-01T19:30:24.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:24.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.999017+0000", 2024-04-01T19:30:24.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7419999999999997e-06 2024-04-01T19:30:24.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:24.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.999026+0000", 2024-04-01T19:30:24.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5740000000000002e-06 2024-04-01T19:30:24.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:24.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.999034+0000", 2024-04-01T19:30:24.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.396e-06 2024-04-01T19:30:24.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.056758+0000", 2024-04-01T19:30:24.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057724567999999997 2024-04-01T19:30:24.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:24.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.056871+0000", 2024-04-01T19:30:24.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000112892 2024-04-01T19:30:24.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:30:24.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.056984+0000", 2024-04-01T19:30:24.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011265900000000001 2024-04-01T19:30:24.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:24.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.061837+0000", 2024-04-01T19:30:24.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0048528169999999997 2024-04-01T19:30:24.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:24.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.198068+0000", 2024-04-01T19:30:24.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13623084599999999 2024-04-01T19:30:24.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:24.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.198113+0000", 2024-04-01T19:30:24.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5890999999999998e-05 2024-04-01T19:30:24.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.894 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:24.894 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.198183+0000", 2024-04-01T19:30:24.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9645000000000002e-05 2024-04-01T19:30:24.894 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.894 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:24.894 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.894 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:254452 2.d 2:b233dfb5:::benchmark_data_smithi188_77607_object87048:head [delete] snapc 0=[] ondisk+write+known_if_redirected e157)", 2024-04-01T19:30:24.894 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:54.264275+0000", 2024-04-01T19:30:24.894 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 150.56929082299999, 2024-04-01T19:30:24.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14739497600000001, 2024-04-01T19:30:24.894 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:24.895 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:24.895 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:24.895 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:24.895 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:24.895 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:24.895 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 254452 2024-04-01T19:30:24.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.895 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:24.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:24.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.264275+0000", 2024-04-01T19:30:24.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:24.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.264275+0000", 2024-04-01T19:30:24.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:24.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.264277+0000", 2024-04-01T19:30:24.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0470000000000001e-06 2024-04-01T19:30:24.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:24.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.264283+0000", 2024-04-01T19:30:24.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0689999999999998e-06 2024-04-01T19:30:24.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.897 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:24.897 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.264291+0000", 2024-04-01T19:30:24.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8299999999999996e-06 2024-04-01T19:30:24.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.897 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:24.897 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.264298+0000", 2024-04-01T19:30:24.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3420000000000002e-06 2024-04-01T19:30:24.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.897 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.897 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.385001+0000", 2024-04-01T19:30:24.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.120703242 2024-04-01T19:30:24.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:24.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.385108+0000", 2024-04-01T19:30:24.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000106902 2024-04-01T19:30:24.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:30:24.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.385222+0000", 2024-04-01T19:30:24.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000113738 2024-04-01T19:30:24.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:24.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.410153+0000", 2024-04-01T19:30:24.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.024931471 2024-04-01T19:30:24.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:24.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.411612+0000", 2024-04-01T19:30:24.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014584369999999999 2024-04-01T19:30:24.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:24.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.411642+0000", 2024-04-01T19:30:24.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0540999999999998e-05 2024-04-01T19:30:24.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:24.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.411670+0000", 2024-04-01T19:30:24.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7356999999999999e-05 2024-04-01T19:30:24.900 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.900 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:24.900 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.900 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:254701 2.d 2:b4905e4c:::benchmark_data_smithi188_77607_object87297:head [delete] snapc 0=[] ondisk+write+known_if_redirected e157)", 2024-04-01T19:30:24.900 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:54.596002+0000", 2024-04-01T19:30:24.900 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 150.23756404599999, 2024-04-01T19:30:24.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14451546300000001, 2024-04-01T19:30:24.900 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:24.900 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:24.901 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:24.901 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:24.901 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:24.901 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:24.901 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 254701 2024-04-01T19:30:24.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.901 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:24.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:24.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.596002+0000", 2024-04-01T19:30:24.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:24.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.596002+0000", 2024-04-01T19:30:24.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:24.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.596004+0000", 2024-04-01T19:30:24.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.967e-06 2024-04-01T19:30:24.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:24.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.596010+0000", 2024-04-01T19:30:24.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0800000000000002e-06 2024-04-01T19:30:24.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:24.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.596023+0000", 2024-04-01T19:30:24.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3396e-05 2024-04-01T19:30:24.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:24.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.596032+0000", 2024-04-01T19:30:24.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7479999999999999e-06 2024-04-01T19:30:24.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.619993+0000", 2024-04-01T19:30:24.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.02396125 2024-04-01T19:30:24.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:24.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.620121+0000", 2024-04-01T19:30:24.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000127541 2024-04-01T19:30:24.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:30:24.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.620245+0000", 2024-04-01T19:30:24.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012476100000000001 2024-04-01T19:30:24.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:24.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.739593+0000", 2024-04-01T19:30:24.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.119347251 2024-04-01T19:30:24.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:24.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.740400+0000", 2024-04-01T19:30:24.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00080735900000000001 2024-04-01T19:30:24.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:24.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.740455+0000", 2024-04-01T19:30:24.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5365999999999998e-05 2024-04-01T19:30:24.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:24.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.740517+0000", 2024-04-01T19:30:24.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1743999999999997e-05 2024-04-01T19:30:24.906 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.906 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:24.906 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.906 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:254706 2.d 2:be5aeffc:::benchmark_data_smithi188_77607_object87302:head [delete] snapc 0=[] ondisk+write+known_if_redirected e157)", 2024-04-01T19:30:24.906 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:54.596154+0000", 2024-04-01T19:30:24.906 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 150.237411485, 2024-04-01T19:30:24.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14451310000000001, 2024-04-01T19:30:24.906 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:24.906 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:24.906 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:24.906 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:24.907 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:24.907 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:24.907 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 254706 2024-04-01T19:30:24.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.907 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:24.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:24.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.596154+0000", 2024-04-01T19:30:24.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:24.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.596154+0000", 2024-04-01T19:30:24.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:24.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.596155+0000", 2024-04-01T19:30:24.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.263e-06 2024-04-01T19:30:24.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:24.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.596160+0000", 2024-04-01T19:30:24.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.301e-06 2024-04-01T19:30:24.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:24.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.596170+0000", 2024-04-01T19:30:24.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0344e-05 2024-04-01T19:30:24.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:24.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.596178+0000", 2024-04-01T19:30:24.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-01T19:30:24.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.624761+0000", 2024-04-01T19:30:24.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028583055 2024-04-01T19:30:24.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:24.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.624888+0000", 2024-04-01T19:30:24.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012715599999999999 2024-04-01T19:30:24.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:30:24.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.625003+0000", 2024-04-01T19:30:24.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000115543 2024-04-01T19:30:24.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:24.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.739635+0000", 2024-04-01T19:30:24.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.114631654 2024-04-01T19:30:24.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:24.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.740570+0000", 2024-04-01T19:30:24.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00093521700000000001 2024-04-01T19:30:24.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:24.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.740622+0000", 2024-04-01T19:30:24.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1876000000000003e-05 2024-04-01T19:30:24.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:24.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.740667+0000", 2024-04-01T19:30:24.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5003999999999998e-05 2024-04-01T19:30:24.912 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.912 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:24.912 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.912 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:255080 2.d 2:b280a3fb:::benchmark_data_smithi188_77607_object87676:head [delete] snapc 0=[] ondisk+write+known_if_redirected e157)", 2024-04-01T19:30:24.912 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:55.090210+0000", 2024-04-01T19:30:24.912 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 149.74335524700001, 2024-04-01T19:30:24.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.15887069700000001, 2024-04-01T19:30:24.912 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:24.912 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:24.912 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:24.912 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:24.913 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:24.913 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:24.913 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 255080 2024-04-01T19:30:24.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.913 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:24.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:24.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.090210+0000", 2024-04-01T19:30:24.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:24.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.090210+0000", 2024-04-01T19:30:24.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:24.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.090212+0000", 2024-04-01T19:30:24.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7400000000000001e-06 2024-04-01T19:30:24.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:24.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.090216+0000", 2024-04-01T19:30:24.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2379999999999999e-06 2024-04-01T19:30:24.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:24.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.090226+0000", 2024-04-01T19:30:24.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1740000000000006e-06 2024-04-01T19:30:24.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:24.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.090231+0000", 2024-04-01T19:30:24.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8830000000000003e-06 2024-04-01T19:30:24.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.110454+0000", 2024-04-01T19:30:24.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020223042 2024-04-01T19:30:24.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:24.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.110549+0000", 2024-04-01T19:30:24.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4320000000000005e-05 2024-04-01T19:30:24.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:30:24.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.110629+0000", 2024-04-01T19:30:24.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9950000000000005e-05 2024-04-01T19:30:24.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:24.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.114631+0000", 2024-04-01T19:30:24.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040024049999999997 2024-04-01T19:30:24.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:24.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.248950+0000", 2024-04-01T19:30:24.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13431896800000001 2024-04-01T19:30:24.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:24.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.249010+0000", 2024-04-01T19:30:24.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0134999999999999e-05 2024-04-01T19:30:24.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:24.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.249081+0000", 2024-04-01T19:30:24.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0841999999999997e-05 2024-04-01T19:30:24.917 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.918 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:24.918 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.918 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:265187 2.f 2.575ca2f (undecoded) ondisk+retry+write+known_if_redirected e169)", 2024-04-01T19:30:24.918 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:28:30.804284+0000", 2024-04-01T19:30:24.918 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 114.02928131, 2024-04-01T19:30:24.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85333816100000004, 2024-04-01T19:30:24.918 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:24.918 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:24.918 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:30:24.918 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:24.918 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:24.919 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:24.919 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 265187 2024-04-01T19:30:24.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.919 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:24.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:24.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804284+0000", 2024-04-01T19:30:24.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:24.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804284+0000", 2024-04-01T19:30:24.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:24.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804287+0000", 2024-04-01T19:30:24.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8600000000000001e-06 2024-04-01T19:30:24.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:24.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804297+0000", 2024-04-01T19:30:24.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8300000000000008e-06 2024-04-01T19:30:24.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:24.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804309+0000", 2024-04-01T19:30:24.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1943000000000001e-05 2024-04-01T19:30:24.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:24.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804326+0000", 2024-04-01T19:30:24.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7348000000000001e-05 2024-04-01T19:30:24.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804481+0000", 2024-04-01T19:30:24.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015451500000000001 2024-04-01T19:30:24.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:30:24.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804496+0000", 2024-04-01T19:30:24.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5682999999999999e-05 2024-04-01T19:30:24.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.657594+0000", 2024-04-01T19:30:24.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85309795300000002 2024-04-01T19:30:24.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:24.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.657622+0000", 2024-04-01T19:30:24.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8028999999999999e-05 2024-04-01T19:30:24.922 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.923 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:24.923 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.923 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:265204 2.f 2.e8d255ff (undecoded) ondisk+retry+write+known_if_redirected e169)", 2024-04-01T19:30:24.923 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:28:30.804397+0000", 2024-04-01T19:30:24.923 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 114.02916894099999, 2024-04-01T19:30:24.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85341209200000001, 2024-04-01T19:30:24.923 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:24.923 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:24.923 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:30:24.923 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:24.923 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:24.923 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:24.924 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 265204 2024-04-01T19:30:24.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.924 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:24.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:24.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804397+0000", 2024-04-01T19:30:24.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:24.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804397+0000", 2024-04-01T19:30:24.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:24.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804398+0000", 2024-04-01T19:30:24.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4300000000000001e-07 2024-04-01T19:30:24.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:24.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804403+0000", 2024-04-01T19:30:24.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9069999999999998e-06 2024-04-01T19:30:24.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:24.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804468+0000", 2024-04-01T19:30:24.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5566000000000002e-05 2024-04-01T19:30:24.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:24.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804512+0000", 2024-04-01T19:30:24.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3782000000000002e-05 2024-04-01T19:30:24.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804571+0000", 2024-04-01T19:30:24.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8758000000000002e-05 2024-04-01T19:30:24.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:30:24.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804581+0000", 2024-04-01T19:30:24.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.995e-06 2024-04-01T19:30:24.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.657801+0000", 2024-04-01T19:30:24.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85322052199999998 2024-04-01T19:30:24.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:24.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.657809+0000", 2024-04-01T19:30:24.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6190000000000002e-06 2024-04-01T19:30:24.927 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.927 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:24.928 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.928 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:265211 2.f 2.997101df (undecoded) ondisk+retry+write+known_if_redirected e169)", 2024-04-01T19:30:24.928 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:28:30.804530+0000", 2024-04-01T19:30:24.928 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 114.029035212, 2024-04-01T19:30:24.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85332372400000001, 2024-04-01T19:30:24.928 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:24.928 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:24.928 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:30:24.928 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:24.928 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:24.928 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:24.928 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 265211 2024-04-01T19:30:24.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.929 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:24.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:24.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804530+0000", 2024-04-01T19:30:24.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:24.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804530+0000", 2024-04-01T19:30:24.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:24.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804531+0000", 2024-04-01T19:30:24.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7000000000000003e-07 2024-04-01T19:30:24.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:24.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804536+0000", 2024-04-01T19:30:24.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7679999999999999e-06 2024-04-01T19:30:24.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:24.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804551+0000", 2024-04-01T19:30:24.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4962e-05 2024-04-01T19:30:24.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:24.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804565+0000", 2024-04-01T19:30:24.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3964999999999999e-05 2024-04-01T19:30:24.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804606+0000", 2024-04-01T19:30:24.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1044999999999998e-05 2024-04-01T19:30:24.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:30:24.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804614+0000", 2024-04-01T19:30:24.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0460000000000006e-06 2024-04-01T19:30:24.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.657845+0000", 2024-04-01T19:30:24.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85323087399999997 2024-04-01T19:30:24.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:24.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.657854+0000", 2024-04-01T19:30:24.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0939999999999997e-06 2024-04-01T19:30:24.932 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.932 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:24.932 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.933 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:265236 2.f 2.41e78bff (undecoded) ondisk+retry+write+known_if_redirected e169)", 2024-04-01T19:30:24.933 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:28:30.804573+0000", 2024-04-01T19:30:24.933 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 114.02899280299999, 2024-04-01T19:30:24.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85330377800000001, 2024-04-01T19:30:24.933 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:24.933 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:24.933 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:30:24.933 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:24.933 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:24.933 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:24.933 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 265236 2024-04-01T19:30:24.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.933 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:24.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:24.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804573+0000", 2024-04-01T19:30:24.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:24.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804573+0000", 2024-04-01T19:30:24.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:24.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804574+0000", 2024-04-01T19:30:24.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8599999999999998e-07 2024-04-01T19:30:24.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:24.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804597+0000", 2024-04-01T19:30:24.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3825e-05 2024-04-01T19:30:24.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:24.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804606+0000", 2024-04-01T19:30:24.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3100000000000001e-06 2024-04-01T19:30:24.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:24.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804613+0000", 2024-04-01T19:30:24.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5700000000000004e-06 2024-04-01T19:30:24.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804654+0000", 2024-04-01T19:30:24.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0377000000000003e-05 2024-04-01T19:30:24.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:30:24.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804662+0000", 2024-04-01T19:30:24.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8089999999999999e-06 2024-04-01T19:30:24.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.657871+0000", 2024-04-01T19:30:24.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85320828800000004 2024-04-01T19:30:24.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:24.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.657877+0000", 2024-04-01T19:30:24.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.913e-06 2024-04-01T19:30:24.937 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.937 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:24.937 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.937 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:265242 2.f 2.74f080ef (undecoded) ondisk+retry+write+known_if_redirected e169)", 2024-04-01T19:30:24.938 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:28:30.804623+0000", 2024-04-01T19:30:24.938 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 114.02894287300001, 2024-04-01T19:30:24.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85341866099999997, 2024-04-01T19:30:24.938 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:24.938 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:24.938 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:30:24.938 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:24.938 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:24.938 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:24.938 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 265242 2024-04-01T19:30:24.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.938 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:24.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:24.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804623+0000", 2024-04-01T19:30:24.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:24.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804623+0000", 2024-04-01T19:30:24.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:24.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804624+0000", 2024-04-01T19:30:24.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9800000000000003e-07 2024-04-01T19:30:24.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:24.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804638+0000", 2024-04-01T19:30:24.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4379000000000001e-05 2024-04-01T19:30:24.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:24.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804644+0000", 2024-04-01T19:30:24.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9220000000000002e-06 2024-04-01T19:30:24.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:24.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804650+0000", 2024-04-01T19:30:24.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0059999999999998e-06 2024-04-01T19:30:24.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804690+0000", 2024-04-01T19:30:24.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0031999999999999e-05 2024-04-01T19:30:24.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:30:24.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804697+0000", 2024-04-01T19:30:24.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8870000000000003e-06 2024-04-01T19:30:24.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.658037+0000", 2024-04-01T19:30:24.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85334062099999997 2024-04-01T19:30:24.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:24.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.658041+0000", 2024-04-01T19:30:24.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0160000000000002e-06 2024-04-01T19:30:24.942 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.942 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:24.942 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.942 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:265243 2.f 2.5c78d94f (undecoded) ondisk+retry+write+known_if_redirected e169)", 2024-04-01T19:30:24.943 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:28:30.804666+0000", 2024-04-01T19:30:24.943 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 114.028899903, 2024-04-01T19:30:24.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85341545600000002, 2024-04-01T19:30:24.943 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:24.943 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:24.943 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:30:24.943 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:24.943 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:24.943 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:24.943 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 265243 2024-04-01T19:30:24.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.943 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:24.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:24.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804666+0000", 2024-04-01T19:30:24.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:24.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804666+0000", 2024-04-01T19:30:24.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:24.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:24.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804666+0000", 2024-04-01T19:30:24.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4099999999999998e-07 2024-04-01T19:30:24.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.945 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:24.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804670+0000", 2024-04-01T19:30:24.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5140000000000002e-06 2024-04-01T19:30:24.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.945 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:24.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804676+0000", 2024-04-01T19:30:24.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3559999999999998e-06 2024-04-01T19:30:24.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.945 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:24.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804692+0000", 2024-04-01T19:30:24.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5933000000000001e-05 2024-04-01T19:30:24.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804724+0000", 2024-04-01T19:30:24.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1254999999999998e-05 2024-04-01T19:30:24.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:30:24.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804731+0000", 2024-04-01T19:30:24.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.605e-06 2024-04-01T19:30:24.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:24.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.658074+0000", 2024-04-01T19:30:24.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.853342657 2024-04-01T19:30:24.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:24.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:24.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:24.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.658081+0000", 2024-04-01T19:30:24.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3950000000000003e-06 2024-04-01T19:30:24.947 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.947 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:24.947 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.947 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:24.947 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:24.947 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:30:25.586 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_ops_in_flight 2024-04-01T19:30:25.588 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 25 16 72357 72341 180.837 125.062 0.00461655 0.00552815 2024-04-01T19:30:25.838 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:25 smithi188 ceph-mon[43939]: pgmap v611: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 3.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 111 MiB/s wr, 1.77k op/s; 2825/128376 objects misplaced (2.201%); 3.3 MiB/s, 52 objects/s recovering 2024-04-01T19:30:25.838 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:25 smithi188 ceph-mon[43939]: osdmap e205: 12 total, 12 up, 12 in 2024-04-01T19:30:25.838 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:25 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4065300455' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:30:25.838 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:25.838 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:25.838 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:25.839 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:25 smithi022 ceph-mon[39439]: pgmap v611: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 3.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 111 MiB/s wr, 1.77k op/s; 2825/128376 objects misplaced (2.201%); 3.3 MiB/s, 52 objects/s recovering 2024-04-01T19:30:25.839 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:25 smithi022 ceph-mon[39439]: osdmap e205: 12 total, 12 up, 12 in 2024-04-01T19:30:25.839 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:25 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4065300455' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:30:25.839 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:25.839 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:25.839 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:25.903 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.1 reset_purged_snaps_last 2024-04-01T19:30:25.965 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:30:26.227 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:30:26.232 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:26.232 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:30:26.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:25 smithi062 ceph-mon[44211]: pgmap v611: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 3.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 111 MiB/s wr, 1.77k op/s; 2825/128376 objects misplaced (2.201%); 3.3 MiB/s, 52 objects/s recovering 2024-04-01T19:30:26.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:25 smithi062 ceph-mon[44211]: osdmap e205: 12 total, 12 up, 12 in 2024-04-01T19:30:26.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:25 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4065300455' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:30:26.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:26.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:26.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:26.333 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:30:26.336 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:30:26.336 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:30:26.336 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:30:26.336 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:30:26.336 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:30:26.336 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:30:26.336 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:30:26.337 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:30:26.337 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:30:26.337 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:30:26.337 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:30:26.337 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:30:26.337 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:30:26.337 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:30:26.337 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:30:26.337 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:30:26.337 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:30:26.338 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:30:26.338 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:30:26.338 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:30:26.338 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:30:26.338 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:30:26.338 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:30:26.338 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:30:26.374 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:26.406 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:30:26.412 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:26.412 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:30:26.513 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:30:26.558 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:26.584 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:30:26.587 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 26 16 74286 74270 178.519 120.562 0.0156113 0.00559993 2024-04-01T19:30:26.588 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:26.588 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:30:26.690 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:30:26.735 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:26.900 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:30:26.902 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:26.902 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:30:27.003 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:30:27.045 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.045 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.045 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.045 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.045 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.045 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.045 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.045 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.045 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.047 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:27.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:27.284 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:30:27.587 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 27 16 76203 76187 176.344 119.812 0.0033529 0.00566913 2024-04-01T19:30:27.720 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:30:27.727 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:27.728 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:30:27.828 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:30:27.869 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:30:27.869 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:27.997 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:30:28.000 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:28.001 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:30:28.001 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:27 smithi188 ceph-mon[43939]: pgmap v613: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 4.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 123 MiB/s wr, 1.97k op/s; 2825/138830 objects misplaced (2.035%); 2.6 MiB/s, 41 objects/s recovering 2024-04-01T19:30:28.001 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:27 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3926585710' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:30:28.001 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:27 smithi188 ceph-mon[43939]: from='client.25159 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:30:28.012 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:27 smithi022 ceph-mon[39439]: pgmap v613: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 4.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 123 MiB/s wr, 1.97k op/s; 2825/138830 objects misplaced (2.035%); 2.6 MiB/s, 41 objects/s recovering 2024-04-01T19:30:28.012 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:27 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3926585710' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:30:28.013 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:27 smithi022 ceph-mon[39439]: from='client.25159 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:30:28.046 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:30:28.047 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:30:28.102 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:30:28.137 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:28.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:27 smithi062 ceph-mon[44211]: pgmap v613: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 4.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 123 MiB/s wr, 1.97k op/s; 2825/138830 objects misplaced (2.035%); 2.6 MiB/s, 41 objects/s recovering 2024-04-01T19:30:28.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:27 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3926585710' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:30:28.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:27 smithi062 ceph-mon[44211]: from='client.25159 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:30:28.346 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:30:28.349 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:28.350 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:30:28.451 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:30:28.492 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:28.588 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 28 16 78143 78127 174.376 121.25 0.00624435 0.0057332 2024-04-01T19:30:28.850 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_blocked_ops 2024-04-01T19:30:29.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:28 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:30:29.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:28 smithi022 ceph-mon[39439]: from='client.25159 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:30:29.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:28 smithi022 ceph-mon[39439]: osdmap e206: 12 total, 12 up, 12 in 2024-04-01T19:30:29.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:28 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:30:29.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:28 smithi188 ceph-mon[43939]: from='client.25159 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:30:29.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:28 smithi188 ceph-mon[43939]: osdmap e206: 12 total, 12 up, 12 in 2024-04-01T19:30:29.215 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:30:29.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:28 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:30:29.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:28 smithi062 ceph-mon[44211]: from='client.25159 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:30:29.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:28 smithi062 ceph-mon[44211]: osdmap e206: 12 total, 12 up, 12 in 2024-04-01T19:30:29.588 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 29 16 79966 79950 172.292 113.938 0.00964012 0.00580214 2024-04-01T19:30:29.745 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:30:30.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:29 smithi022 ceph-mon[39439]: pgmap v615: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 4.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 124 MiB/s wr, 1.99k op/s; 2481/147730 objects misplaced (1.679%); 5.3 MiB/s, 84 objects/s recovering 2024-04-01T19:30:30.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:29 smithi022 ceph-mon[39439]: osdmap e207: 12 total, 12 up, 12 in 2024-04-01T19:30:30.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:29 smithi188 ceph-mon[43939]: pgmap v615: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 4.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 124 MiB/s wr, 1.99k op/s; 2481/147730 objects misplaced (1.679%); 5.3 MiB/s, 84 objects/s recovering 2024-04-01T19:30:30.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:29 smithi188 ceph-mon[43939]: osdmap e207: 12 total, 12 up, 12 in 2024-04-01T19:30:30.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:29 smithi062 ceph-mon[44211]: pgmap v615: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 4.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 124 MiB/s wr, 1.99k op/s; 2481/147730 objects misplaced (1.679%); 5.3 MiB/s, 84 objects/s recovering 2024-04-01T19:30:30.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:29 smithi062 ceph-mon[44211]: osdmap e207: 12 total, 12 up, 12 in 2024-04-01T19:30:30.588 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 30 15 81808 81793 170.388 115.188 0.01234 0.00586703 2024-04-01T19:30:31.249 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:30:31.249 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:30:31.553 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:30:31.557 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:31.558 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:30:31.588 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 31 16 83652 83636 168.607 115.188 0.00330966 0.00592927 2024-04-01T19:30:31.658 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:30:31.704 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:31.726 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:30:31.730 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:31.731 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:30:31.832 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:30:31.868 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:32.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:31 smithi062 ceph-mon[44211]: pgmap v617: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 4.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 150 MiB/s wr, 2.40k op/s; 2481/157250 objects misplaced (1.578%); 3.6 MiB/s, 57 objects/s recovering 2024-04-01T19:30:32.015 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_historic_ops 2024-04-01T19:30:32.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:31 smithi022 ceph-mon[39439]: pgmap v617: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 4.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 150 MiB/s wr, 2.40k op/s; 2481/157250 objects misplaced (1.578%); 3.6 MiB/s, 57 objects/s recovering 2024-04-01T19:30:32.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:31 smithi188 ceph-mon[43939]: pgmap v617: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 4.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 150 MiB/s wr, 2.40k op/s; 2481/157250 objects misplaced (1.578%); 3.6 MiB/s, 57 objects/s recovering 2024-04-01T19:30:32.389 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:30:32.588 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 32 16 85468 85452 166.885 113.5 0.00475188 0.00599093 2024-04-01T19:30:33.588 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 33 16 87197 87181 165.102 108.062 0.0104221 0.00605564 2024-04-01T19:30:34.114 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:33 smithi188 ceph-mon[43939]: pgmap v618: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 5.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 136 MiB/s wr, 2.18k op/s; 2481/162962 objects misplaced (1.522%); 2.7 MiB/s, 43 objects/s recovering 2024-04-01T19:30:34.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:33 smithi062 ceph-mon[44211]: pgmap v618: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 5.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 136 MiB/s wr, 2.18k op/s; 2481/162962 objects misplaced (1.522%); 2.7 MiB/s, 43 objects/s recovering 2024-04-01T19:30:34.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:33 smithi022 ceph-mon[39439]: pgmap v618: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 5.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 136 MiB/s wr, 2.18k op/s; 2481/162962 objects misplaced (1.522%); 2.7 MiB/s, 43 objects/s recovering 2024-04-01T19:30:34.479 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:30:34.480 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:30:34.588 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 34 15 88919 88904 163.413 107.688 0.00394978 0.00611828 2024-04-01T19:30:35.271 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_ops_in_flight 2024-04-01T19:30:35.588 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 35 16 90706 90690 161.933 111.625 0.00967578 0.00617357 2024-04-01T19:30:35.637 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:30:36.215 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:35 smithi188 ceph-mon[43939]: pgmap v619: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 5.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 112 MiB/s wr, 1.80k op/s; 2093/167620 objects misplaced (1.249%); 5.7 MiB/s, 91 objects/s recovering 2024-04-01T19:30:36.216 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:35 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:30:36.216 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:35 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:30:36.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:35 smithi062 ceph-mon[44211]: pgmap v619: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 5.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 112 MiB/s wr, 1.80k op/s; 2093/167620 objects misplaced (1.249%); 5.7 MiB/s, 91 objects/s recovering 2024-04-01T19:30:36.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:35 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:30:36.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:35 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:30:36.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:35 smithi022 ceph-mon[39439]: pgmap v619: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 5.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 112 MiB/s wr, 1.80k op/s; 2093/167620 objects misplaced (1.249%); 5.7 MiB/s, 91 objects/s recovering 2024-04-01T19:30:36.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:35 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:30:36.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:35 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:30:36.588 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 36 16 92425 92409 160.419 107.438 0.00814341 0.00623207 2024-04-01T19:30:37.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:36 smithi022 ceph-mon[39439]: osdmap e208: 12 total, 12 up, 12 in 2024-04-01T19:30:37.114 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:36 smithi188 ceph-mon[43939]: osdmap e208: 12 total, 12 up, 12 in 2024-04-01T19:30:37.228 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:30:37.231 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:37.231 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:30:37.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:36 smithi062 ceph-mon[44211]: osdmap e208: 12 total, 12 up, 12 in 2024-04-01T19:30:37.333 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:30:37.371 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:37.400 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:30:37.404 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:37.405 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:30:37.506 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:30:37.569 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:37.588 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 37 16 94155 94139 159.006 108.125 0.00692733 0.00628786 2024-04-01T19:30:37.608 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:30:37.637 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:30:37.644 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:37.645 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:30:37.746 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:30:37.786 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:37.810 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:30:37.815 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:30:37.815 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:30:37.816 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:37.816 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:30:37.917 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:30:37.968 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:38.098 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:30:38.101 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:38.101 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:30:38.101 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:37 smithi188 ceph-mon[43939]: pgmap v621: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 5.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 112 MiB/s wr, 1.80k op/s; 2093/176478 objects misplaced (1.186%); 3.0 MiB/s, 48 objects/s recovering 2024-04-01T19:30:38.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:37 smithi022 ceph-mon[39439]: pgmap v621: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 5.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 112 MiB/s wr, 1.80k op/s; 2093/176478 objects misplaced (1.186%); 3.0 MiB/s, 48 objects/s recovering 2024-04-01T19:30:38.202 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:30:38.237 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:37 smithi062 ceph-mon[44211]: pgmap v621: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 5.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 112 MiB/s wr, 1.80k op/s; 2093/176478 objects misplaced (1.186%); 3.0 MiB/s, 48 objects/s recovering 2024-04-01T19:30:38.240 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:38.275 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:30:38.278 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:38.278 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:30:38.379 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:30:38.427 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:38.588 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 38 16 95875 95859 157.65 107.5 0.00690582 0.00634199 2024-04-01T19:30:38.665 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_blocked_ops 2024-04-01T19:30:38.793 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:30:38.795 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:38.796 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:30:38.811 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.2 reset_purged_snaps_last 2024-04-01T19:30:38.897 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:30:38.932 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:38.960 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:30:38.963 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:38.964 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:30:38.995 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:30:39.041 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:30:39.064 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:30:39.111 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:39.141 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:30:39.144 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:39.145 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:30:39.246 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:30:39.306 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:39.391 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:30:39.398 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:39.399 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:30:39.500 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:30:39.540 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:39.569 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:30:39.572 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:39.572 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:30:39.590 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 39 16 97455 97439 156.133 98.75 0.0058136 0.00640275 2024-04-01T19:30:39.673 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:30:39.706 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:39.735 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:30:39.738 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:39.738 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:30:39.839 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:30:39.869 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:39.870 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:30:39.890 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:30:39.892 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:39.893 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:30:39.917 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:30:39.994 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:30:40.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:39 smithi062 ceph-mon[44211]: pgmap v622: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 5.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 123 MiB/s wr, 1.97k op/s; 1680/184128 objects misplaced (0.912%); 5.6 MiB/s, 89 objects/s recovering 2024-04-01T19:30:40.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:39 smithi062 ceph-mon[44211]: osdmap e209: 12 total, 12 up, 12 in 2024-04-01T19:30:40.037 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:40.072 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:30:40.076 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:40.077 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:30:40.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:39 smithi022 ceph-mon[39439]: pgmap v622: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 5.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 123 MiB/s wr, 1.97k op/s; 1680/184128 objects misplaced (0.912%); 5.6 MiB/s, 89 objects/s recovering 2024-04-01T19:30:40.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:39 smithi022 ceph-mon[39439]: osdmap e209: 12 total, 12 up, 12 in 2024-04-01T19:30:40.177 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:30:40.209 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:39 smithi188 ceph-mon[43939]: pgmap v622: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 5.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 123 MiB/s wr, 1.97k op/s; 1680/184128 objects misplaced (0.912%); 5.6 MiB/s, 89 objects/s recovering 2024-04-01T19:30:40.209 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:39 smithi188 ceph-mon[43939]: osdmap e209: 12 total, 12 up, 12 in 2024-04-01T19:30:40.212 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:40.473 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:30:40.478 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:40.478 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:30:40.579 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:30:40.590 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:30:40.593152 min lat: 0.00100536 max lat: 2.32602 avg lat: 0.00647165 2024-04-01T19:30:40.590 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:30:40.590 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 40 16 98898 98882 154.485 90.1875 0.00925473 0.00647165 2024-04-01T19:30:40.617 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:40.699 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:30:40.703 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:40.704 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:30:40.805 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:30:40.858 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:40.886 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:30:40.890 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:40.890 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:30:40.991 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:30:41.036 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:41.118 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:30:41.123 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:41.124 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:30:41.203 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:30:41.203 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:30:41.225 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:30:41.274 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:41.530 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:30:41.534 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:41.535 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:30:41.590 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 41 16 100563 100547 153.255 104.062 0.00471028 0.00652375 2024-04-01T19:30:41.636 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:30:41.686 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:42.012 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_historic_ops 2024-04-01T19:30:42.162 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:30:42.167 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:42.168 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:30:42.249 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:41 smithi022 ceph-mon[39439]: pgmap v624: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 5.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 115 MiB/s wr, 1.84k op/s; 1680/192482 objects misplaced (0.873%); 6.3 MiB/s, 100 objects/s recovering 2024-04-01T19:30:42.250 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:41 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4042141952' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:30:42.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:41 smithi062 ceph-mon[44211]: pgmap v624: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 5.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 115 MiB/s wr, 1.84k op/s; 1680/192482 objects misplaced (0.873%); 6.3 MiB/s, 100 objects/s recovering 2024-04-01T19:30:42.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:41 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4042141952' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:30:42.269 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:30:42.296 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:30:42.296 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:30:42.296 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:30:42.296 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:30:42.297 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:30:42.297 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:30:42.297 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:30:42.297 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:30:42.297 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:30:42.297 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:30:42.297 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:30:42.297 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:30:42.297 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:30:42.297 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:30:42.298 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:30:42.298 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:30:42.298 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:30:42.298 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:30:42.298 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:30:42.298 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:30:42.298 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:30:42.298 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:30:42.298 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:30:42.298 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:30:42.318 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:42.346 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:30:42.352 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:42.352 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:30:42.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:41 smithi188 ceph-mon[43939]: pgmap v624: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 5.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 115 MiB/s wr, 1.84k op/s; 1680/192482 objects misplaced (0.873%); 6.3 MiB/s, 100 objects/s recovering 2024-04-01T19:30:42.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:41 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4042141952' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:30:42.380 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:30:42.454 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:30:42.502 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:42.590 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 42 16 102141 102125 151.954 98.625 0.0063872 0.00658 2024-04-01T19:30:43.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:43.590 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 43 16 103814 103798 150.851 104.562 0.00742069 0.00662718 2024-04-01T19:30:44.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:43 smithi022 ceph-mon[39439]: pgmap v625: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 6.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 116 MiB/s wr, 1.86k op/s; 1680/197380 objects misplaced (0.851%); 3.2 MiB/s, 51 objects/s recovering 2024-04-01T19:30:44.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:43 smithi188 ceph-mon[43939]: pgmap v625: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 6.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 116 MiB/s wr, 1.86k op/s; 1680/197380 objects misplaced (0.851%); 3.2 MiB/s, 51 objects/s recovering 2024-04-01T19:30:44.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:43 smithi062 ceph-mon[44211]: pgmap v625: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 6.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 116 MiB/s wr, 1.86k op/s; 1680/197380 objects misplaced (0.851%); 3.2 MiB/s, 51 objects/s recovering 2024-04-01T19:30:44.506 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:30:44.506 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:30:44.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:30:44.506 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:30:44.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.506 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:118423 2.c 2:36f0243f:::benchmark_data_smithi188_77607_object118422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e128)", 2024-04-01T19:30:44.506 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:25:52.408571+0000", 2024-04-01T19:30:44.506 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 292.09591954299998, 2024-04-01T19:30:44.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.21340094400000001, 2024-04-01T19:30:44.506 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:44.507 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:44.507 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:44.507 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:44.507 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:44.507 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:44.507 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 118423 2024-04-01T19:30:44.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.507 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:44.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:44.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.408571+0000", 2024-04-01T19:30:44.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:44.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.408571+0000", 2024-04-01T19:30:44.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:44.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.408573+0000", 2024-04-01T19:30:44.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3819999999999998e-06 2024-04-01T19:30:44.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:44.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.408597+0000", 2024-04-01T19:30:44.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3637000000000001e-05 2024-04-01T19:30:44.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:44.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.408609+0000", 2024-04-01T19:30:44.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2812e-05 2024-04-01T19:30:44.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:44.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.408617+0000", 2024-04-01T19:30:44.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0090000000000007e-06 2024-04-01T19:30:44.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:44.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.408680+0000", 2024-04-01T19:30:44.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2691e-05 2024-04-01T19:30:44.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.510 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:44.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.408812+0000", 2024-04-01T19:30:44.510 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013213799999999999 2024-04-01T19:30:44.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.510 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:30:44.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.408965+0000", 2024-04-01T19:30:44.510 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000152385 2024-04-01T19:30:44.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.510 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:44.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.412160+0000", 2024-04-01T19:30:44.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031956240000000002 2024-04-01T19:30:44.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:44.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.621896+0000", 2024-04-01T19:30:44.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.209735961 2024-04-01T19:30:44.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:44.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.621935+0000", 2024-04-01T19:30:44.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8411000000000002e-05 2024-04-01T19:30:44.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:44.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.621972+0000", 2024-04-01T19:30:44.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6894000000000003e-05 2024-04-01T19:30:44.512 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.512 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:44.512 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.512 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:118440 2.c 2:374e48f8:::benchmark_data_smithi188_77607_object118439:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e128)", 2024-04-01T19:30:44.512 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:25:52.420716+0000", 2024-04-01T19:30:44.512 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 292.08377447399999, 2024-04-01T19:30:44.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.20139631199999999, 2024-04-01T19:30:44.513 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:44.513 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:44.513 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:44.513 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:44.513 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:44.513 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:44.513 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 118440 2024-04-01T19:30:44.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.513 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:44.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:44.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.420716+0000", 2024-04-01T19:30:44.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:44.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.420716+0000", 2024-04-01T19:30:44.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.514 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:44.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.420717+0000", 2024-04-01T19:30:44.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.61e-06 2024-04-01T19:30:44.514 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:44.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.420738+0000", 2024-04-01T19:30:44.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0641000000000001e-05 2024-04-01T19:30:44.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:44.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.420753+0000", 2024-04-01T19:30:44.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4783999999999999e-05 2024-04-01T19:30:44.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:44.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.420762+0000", 2024-04-01T19:30:44.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8850000000000005e-06 2024-04-01T19:30:44.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:44.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.420817+0000", 2024-04-01T19:30:44.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5554999999999999e-05 2024-04-01T19:30:44.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:44.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.420926+0000", 2024-04-01T19:30:44.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108857 2024-04-01T19:30:44.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:30:44.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.421033+0000", 2024-04-01T19:30:44.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010676899999999999 2024-04-01T19:30:44.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:44.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.424232+0000", 2024-04-01T19:30:44.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031996759999999998 2024-04-01T19:30:44.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:44.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.622017+0000", 2024-04-01T19:30:44.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.19778406400000001 2024-04-01T19:30:44.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:44.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.622072+0000", 2024-04-01T19:30:44.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5800000000000001e-05 2024-04-01T19:30:44.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:44.518 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.622112+0000", 2024-04-01T19:30:44.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9671e-05 2024-04-01T19:30:44.518 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.518 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:44.518 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.518 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.518 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:118495 2.c 2:3e5de941:::benchmark_data_smithi188_77607_object118494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e128)", 2024-04-01T19:30:44.518 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:25:52.457238+0000", 2024-04-01T19:30:44.518 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 292.04725238899999, 2024-04-01T19:30:44.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16836590600000001, 2024-04-01T19:30:44.518 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:44.518 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:44.518 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:44.519 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:44.519 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:44.519 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:44.519 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 118495 2024-04-01T19:30:44.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.519 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:44.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:44.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457238+0000", 2024-04-01T19:30:44.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:44.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457238+0000", 2024-04-01T19:30:44.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:44.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457240+0000", 2024-04-01T19:30:44.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.57e-06 2024-04-01T19:30:44.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:44.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457270+0000", 2024-04-01T19:30:44.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9887e-05 2024-04-01T19:30:44.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:44.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457282+0000", 2024-04-01T19:30:44.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2163e-05 2024-04-01T19:30:44.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:44.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457301+0000", 2024-04-01T19:30:44.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8321999999999998e-05 2024-04-01T19:30:44.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:44.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457374+0000", 2024-04-01T19:30:44.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2941999999999994e-05 2024-04-01T19:30:44.522 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.522 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:44.522 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457491+0000", 2024-04-01T19:30:44.522 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117265 2024-04-01T19:30:44.522 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.522 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:30:44.522 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457623+0000", 2024-04-01T19:30:44.522 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000132275 2024-04-01T19:30:44.522 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.522 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:44.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.464786+0000", 2024-04-01T19:30:44.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071633069999999998 2024-04-01T19:30:44.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:44.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.625496+0000", 2024-04-01T19:30:44.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16070952299999999 2024-04-01T19:30:44.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:44.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.625553+0000", 2024-04-01T19:30:44.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7462e-05 2024-04-01T19:30:44.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:44.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.625604+0000", 2024-04-01T19:30:44.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0189999999999999e-05 2024-04-01T19:30:44.524 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.524 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:44.524 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.524 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:118497 2.c 2:345b15cf:::benchmark_data_smithi188_77607_object118496:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e128)", 2024-04-01T19:30:44.524 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:25:52.457323+0000", 2024-04-01T19:30:44.524 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 292.04716681899998, 2024-04-01T19:30:44.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.172470871, 2024-04-01T19:30:44.524 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:44.524 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:44.525 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:44.525 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:44.525 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:44.525 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:44.525 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 118497 2024-04-01T19:30:44.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.525 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:44.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.525 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:44.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457323+0000", 2024-04-01T19:30:44.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.526 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:44.526 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457323+0000", 2024-04-01T19:30:44.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.526 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:44.526 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457324+0000", 2024-04-01T19:30:44.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0249999999999999e-06 2024-04-01T19:30:44.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.526 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:44.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457359+0000", 2024-04-01T19:30:44.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4297e-05 2024-04-01T19:30:44.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:44.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457365+0000", 2024-04-01T19:30:44.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4570000000000002e-06 2024-04-01T19:30:44.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:44.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.457369+0000", 2024-04-01T19:30:44.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3409999999999996e-06 2024-04-01T19:30:44.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:44.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.460944+0000", 2024-04-01T19:30:44.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0035744280000000002 2024-04-01T19:30:44.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:44.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.461061+0000", 2024-04-01T19:30:44.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117447 2024-04-01T19:30:44.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:30:44.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.461182+0000", 2024-04-01T19:30:44.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012052099999999999 2024-04-01T19:30:44.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.529 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:44.529 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.468119+0000", 2024-04-01T19:30:44.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0069371140000000003 2024-04-01T19:30:44.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.529 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:44.529 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.629709+0000", 2024-04-01T19:30:44.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16159025399999999 2024-04-01T19:30:44.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.530 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:44.530 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.629749+0000", 2024-04-01T19:30:44.530 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9360000000000003e-05 2024-04-01T19:30:44.530 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.530 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:44.530 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.629794+0000", 2024-04-01T19:30:44.530 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5627000000000002e-05 2024-04-01T19:30:44.530 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.530 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:44.530 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.530 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.531 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:118504 2.c 2:3a6d1685:::benchmark_data_smithi188_77607_object118503:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e128)", 2024-04-01T19:30:44.531 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:25:52.468475+0000", 2024-04-01T19:30:44.531 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 292.03601522500003, 2024-04-01T19:30:44.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.161449647, 2024-04-01T19:30:44.531 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:44.531 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:44.531 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:44.531 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:44.531 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:44.531 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:44.531 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 118504 2024-04-01T19:30:44.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.531 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:44.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:44.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.468475+0000", 2024-04-01T19:30:44.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:44.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.468475+0000", 2024-04-01T19:30:44.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:44.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.468476+0000", 2024-04-01T19:30:44.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.141e-06 2024-04-01T19:30:44.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:44.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.468498+0000", 2024-04-01T19:30:44.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1925000000000001e-05 2024-04-01T19:30:44.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:44.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.468520+0000", 2024-04-01T19:30:44.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2229e-05 2024-04-01T19:30:44.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:44.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.468528+0000", 2024-04-01T19:30:44.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2549999999999997e-06 2024-04-01T19:30:44.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.534 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:44.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.468581+0000", 2024-04-01T19:30:44.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2760999999999998e-05 2024-04-01T19:30:44.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.534 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:44.535 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.468699+0000", 2024-04-01T19:30:44.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117361 2024-04-01T19:30:44.535 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.535 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:30:44.535 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.468837+0000", 2024-04-01T19:30:44.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000138343 2024-04-01T19:30:44.535 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.535 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:44.535 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.472108+0000", 2024-04-01T19:30:44.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.003270804 2024-04-01T19:30:44.535 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:44.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.629839+0000", 2024-04-01T19:30:44.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.157731644 2024-04-01T19:30:44.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:44.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.629885+0000", 2024-04-01T19:30:44.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5964000000000002e-05 2024-04-01T19:30:44.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:44.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.629925+0000", 2024-04-01T19:30:44.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9220000000000001e-05 2024-04-01T19:30:44.537 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.537 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:44.537 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.537 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:118526 2.c 2:34ed6a6c:::benchmark_data_smithi188_77607_object118525:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e128)", 2024-04-01T19:30:44.537 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:25:52.482133+0000", 2024-04-01T19:30:44.537 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 292.022357038, 2024-04-01T19:30:44.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.15085310199999999, 2024-04-01T19:30:44.537 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:44.537 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:44.537 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:44.537 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:44.538 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:44.538 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:44.538 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 118526 2024-04-01T19:30:44.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.538 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:44.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:44.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.482133+0000", 2024-04-01T19:30:44.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:44.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.482133+0000", 2024-04-01T19:30:44.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:44.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.482135+0000", 2024-04-01T19:30:44.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.897e-06 2024-04-01T19:30:44.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:44.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.482158+0000", 2024-04-01T19:30:44.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2688999999999999e-05 2024-04-01T19:30:44.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:44.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.482168+0000", 2024-04-01T19:30:44.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0732e-05 2024-04-01T19:30:44.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:44.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.482177+0000", 2024-04-01T19:30:44.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2879999999999993e-06 2024-04-01T19:30:44.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:44.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.482228+0000", 2024-04-01T19:30:44.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1379999999999999e-05 2024-04-01T19:30:44.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:44.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.482328+0000", 2024-04-01T19:30:44.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9920000000000006e-05 2024-04-01T19:30:44.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:30:44.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.482437+0000", 2024-04-01T19:30:44.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000109153 2024-04-01T19:30:44.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:44.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.485425+0000", 2024-04-01T19:30:44.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002987361 2024-04-01T19:30:44.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:44.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.632871+0000", 2024-04-01T19:30:44.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14744655500000001 2024-04-01T19:30:44.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:44.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.632936+0000", 2024-04-01T19:30:44.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4671999999999993e-05 2024-04-01T19:30:44.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:44.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.632986+0000", 2024-04-01T19:30:44.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0454999999999997e-05 2024-04-01T19:30:44.543 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.543 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:44.543 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.543 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:118560 2.c 2:303eae68:::benchmark_data_smithi188_77607_object118559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e128)", 2024-04-01T19:30:44.543 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:25:52.506083+0000", 2024-04-01T19:30:44.543 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 291.99840764300001, 2024-04-01T19:30:44.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.127036019, 2024-04-01T19:30:44.543 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:44.543 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:44.544 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:44.544 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:44.544 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:44.544 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:44.544 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 118560 2024-04-01T19:30:44.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.544 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:44.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:44.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.506083+0000", 2024-04-01T19:30:44.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.545 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.545 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:44.545 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.506083+0000", 2024-04-01T19:30:44.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.545 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.545 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:44.545 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.506084+0000", 2024-04-01T19:30:44.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1650000000000001e-06 2024-04-01T19:30:44.545 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.545 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:44.545 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.506104+0000", 2024-04-01T19:30:44.546 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0783000000000001e-05 2024-04-01T19:30:44.546 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.546 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.546 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:44.546 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.506112+0000", 2024-04-01T19:30:44.546 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.892e-06 2024-04-01T19:30:44.546 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.546 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.546 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:44.546 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.506120+0000", 2024-04-01T19:30:44.546 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7300000000000005e-06 2024-04-01T19:30:44.546 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.546 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.546 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:44.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.506168+0000", 2024-04-01T19:30:44.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8337000000000002e-05 2024-04-01T19:30:44.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.547 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:44.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.506287+0000", 2024-04-01T19:30:44.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000118924 2024-04-01T19:30:44.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.547 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:30:44.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.506430+0000", 2024-04-01T19:30:44.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014257300000000001 2024-04-01T19:30:44.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:44.548 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.509879+0000", 2024-04-01T19:30:44.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0034487979999999999 2024-04-01T19:30:44.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:44.548 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.633035+0000", 2024-04-01T19:30:44.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.123155801 2024-04-01T19:30:44.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:44.548 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.633083+0000", 2024-04-01T19:30:44.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8733000000000002e-05 2024-04-01T19:30:44.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.549 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:44.549 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.633119+0000", 2024-04-01T19:30:44.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5283000000000001e-05 2024-04-01T19:30:44.549 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.549 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:44.549 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.549 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:118580 2.c 2:312fea36:::benchmark_data_smithi188_77607_object118579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e128)", 2024-04-01T19:30:44.549 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:25:52.521042+0000", 2024-04-01T19:30:44.549 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 291.98344794399998, 2024-04-01T19:30:44.550 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.117359536, 2024-04-01T19:30:44.550 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:44.550 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:44.550 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:44.550 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:44.550 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:44.550 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:44.550 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 118580 2024-04-01T19:30:44.550 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.550 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:44.550 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.550 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:44.550 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.521042+0000", 2024-04-01T19:30:44.550 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.551 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:44.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.521042+0000", 2024-04-01T19:30:44.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.551 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:44.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.521044+0000", 2024-04-01T19:30:44.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4589999999999999e-06 2024-04-01T19:30:44.551 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:44.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.521063+0000", 2024-04-01T19:30:44.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9440999999999999e-05 2024-04-01T19:30:44.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:44.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.521074+0000", 2024-04-01T19:30:44.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1109e-05 2024-04-01T19:30:44.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:44.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.521080+0000", 2024-04-01T19:30:44.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1109999999999996e-06 2024-04-01T19:30:44.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:44.553 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.521132+0000", 2024-04-01T19:30:44.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2021999999999998e-05 2024-04-01T19:30:44.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:44.553 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.521250+0000", 2024-04-01T19:30:44.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117761 2024-04-01T19:30:44.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:30:44.553 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.521393+0000", 2024-04-01T19:30:44.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014255999999999999 2024-04-01T19:30:44.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:44.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.527618+0000", 2024-04-01T19:30:44.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062248340000000003 2024-04-01T19:30:44.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:44.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.638276+0000", 2024-04-01T19:30:44.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.110658429 2024-04-01T19:30:44.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:44.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.638335+0000", 2024-04-01T19:30:44.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9299999999999998e-05 2024-04-01T19:30:44.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.555 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:44.555 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.638402+0000", 2024-04-01T19:30:44.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6509999999999998e-05 2024-04-01T19:30:44.555 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.555 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:44.555 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.555 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:118586 2.c 2:33e37a35:::benchmark_data_smithi188_77607_object118585:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e128)", 2024-04-01T19:30:44.555 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:25:52.524276+0000", 2024-04-01T19:30:44.556 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 291.98021397700001, 2024-04-01T19:30:44.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.11427359600000001, 2024-04-01T19:30:44.556 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:44.556 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:44.556 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:44.556 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:44.556 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:44.556 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:44.556 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 118586 2024-04-01T19:30:44.556 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.556 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:44.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:44.557 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.524276+0000", 2024-04-01T19:30:44.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.557 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.557 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:44.557 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.524276+0000", 2024-04-01T19:30:44.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.557 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.557 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:44.557 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.524278+0000", 2024-04-01T19:30:44.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6700000000000001e-06 2024-04-01T19:30:44.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.558 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:44.558 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.524298+0000", 2024-04-01T19:30:44.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0610000000000001e-05 2024-04-01T19:30:44.558 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.558 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:44.558 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.524311+0000", 2024-04-01T19:30:44.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2758000000000001e-05 2024-04-01T19:30:44.558 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.558 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:44.558 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.524319+0000", 2024-04-01T19:30:44.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6499999999999996e-06 2024-04-01T19:30:44.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:44.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.524692+0000", 2024-04-01T19:30:44.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00037340399999999998 2024-04-01T19:30:44.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:44.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.524814+0000", 2024-04-01T19:30:44.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012218799999999999 2024-04-01T19:30:44.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:30:44.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.524898+0000", 2024-04-01T19:30:44.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3769000000000004e-05 2024-04-01T19:30:44.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:44.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.527736+0000", 2024-04-01T19:30:44.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0028374049999999999 2024-04-01T19:30:44.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:44.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.638461+0000", 2024-04-01T19:30:44.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.11072537 2024-04-01T19:30:44.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:44.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.638512+0000", 2024-04-01T19:30:44.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0992999999999998e-05 2024-04-01T19:30:44.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:44.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.638550+0000", 2024-04-01T19:30:44.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7778999999999999e-05 2024-04-01T19:30:44.561 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.561 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:44.561 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.561 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:118595 2.c 2:35cfec40:::benchmark_data_smithi188_77607_object118594:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e128)", 2024-04-01T19:30:44.562 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:25:52.528709+0000", 2024-04-01T19:30:44.562 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 291.97578094099998, 2024-04-01T19:30:44.562 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.114154964, 2024-04-01T19:30:44.562 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:44.562 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:44.562 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:44.562 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:44.562 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:44.562 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:44.562 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 118595 2024-04-01T19:30:44.562 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.562 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:44.562 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:44.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.528709+0000", 2024-04-01T19:30:44.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:44.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.528709+0000", 2024-04-01T19:30:44.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:44.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.528711+0000", 2024-04-01T19:30:44.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.415e-06 2024-04-01T19:30:44.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:44.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.528755+0000", 2024-04-01T19:30:44.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4768000000000002e-05 2024-04-01T19:30:44.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:44.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.528764+0000", 2024-04-01T19:30:44.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7579999999999998e-06 2024-04-01T19:30:44.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:44.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.528771+0000", 2024-04-01T19:30:44.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1840000000000002e-06 2024-04-01T19:30:44.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:44.565 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.528820+0000", 2024-04-01T19:30:44.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8927000000000001e-05 2024-04-01T19:30:44.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:44.565 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.528903+0000", 2024-04-01T19:30:44.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2628999999999998e-05 2024-04-01T19:30:44.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.566 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:30:44.566 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.529027+0000", 2024-04-01T19:30:44.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000124148 2024-04-01T19:30:44.566 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.566 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.566 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:44.566 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.535282+0000", 2024-04-01T19:30:44.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062546659999999999 2024-04-01T19:30:44.566 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.566 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.566 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:44.566 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.642768+0000", 2024-04-01T19:30:44.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.107485938 2024-04-01T19:30:44.566 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:44.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.642823+0000", 2024-04-01T19:30:44.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5507000000000002e-05 2024-04-01T19:30:44.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:44.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:25:52.642864+0000", 2024-04-01T19:30:44.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1023999999999999e-05 2024-04-01T19:30:44.567 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.567 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:44.567 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.568 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:240019 2.c 2:3c88fbc4:::benchmark_data_smithi188_77607_object72615:head [delete] snapc 0=[] ondisk+write+known_if_redirected e155)", 2024-04-01T19:30:44.568 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:37.885566+0000", 2024-04-01T19:30:44.568 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 186.61892392799999, 2024-04-01T19:30:44.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.22244529199999999, 2024-04-01T19:30:44.568 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:44.568 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:44.568 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:44.568 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:44.568 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:44.568 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:44.568 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 240019 2024-04-01T19:30:44.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.568 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:44.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.569 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:44.569 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.885566+0000", 2024-04-01T19:30:44.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.569 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:44.569 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.885566+0000", 2024-04-01T19:30:44.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.569 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:44.569 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.885570+0000", 2024-04-01T19:30:44.570 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5889999999999999e-06 2024-04-01T19:30:44.570 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.570 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.570 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:44.570 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.885578+0000", 2024-04-01T19:30:44.570 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6149999999999997e-06 2024-04-01T19:30:44.570 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.570 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.570 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:44.570 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.885595+0000", 2024-04-01T19:30:44.570 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6218999999999998e-05 2024-04-01T19:30:44.570 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.570 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.570 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:44.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.885602+0000", 2024-04-01T19:30:44.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4989999999999997e-06 2024-04-01T19:30:44.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:44.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.885655+0000", 2024-04-01T19:30:44.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2853999999999999e-05 2024-04-01T19:30:44.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:44.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.885744+0000", 2024-04-01T19:30:44.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8879000000000001e-05 2024-04-01T19:30:44.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:30:44.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.886349+0000", 2024-04-01T19:30:44.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000605147 2024-04-01T19:30:44.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:44.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.890195+0000", 2024-04-01T19:30:44.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0038461060000000002 2024-04-01T19:30:44.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:44.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.107906+0000", 2024-04-01T19:30:44.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.21771119799999999 2024-04-01T19:30:44.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:44.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.107960+0000", 2024-04-01T19:30:44.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3671999999999997e-05 2024-04-01T19:30:44.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:44.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.108012+0000", 2024-04-01T19:30:44.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1514000000000002e-05 2024-04-01T19:30:44.573 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.573 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:44.573 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.574 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.574 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.574 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:240065 2.c 2:328ade74:::benchmark_data_smithi188_77607_object72661:head [delete] snapc 0=[] ondisk+write+known_if_redirected e155)", 2024-04-01T19:30:44.574 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:37.928693+0000", 2024-04-01T19:30:44.574 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 186.575797419, 2024-04-01T19:30:44.574 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.184336738, 2024-04-01T19:30:44.574 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:44.574 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:44.574 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:44.574 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:44.574 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:44.574 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:44.574 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 240065 2024-04-01T19:30:44.574 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.575 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:44.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:44.575 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.928693+0000", 2024-04-01T19:30:44.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:44.575 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.928693+0000", 2024-04-01T19:30:44.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:44.575 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.928695+0000", 2024-04-01T19:30:44.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9759999999999998e-06 2024-04-01T19:30:44.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:44.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.928702+0000", 2024-04-01T19:30:44.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4499999999999998e-06 2024-04-01T19:30:44.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:44.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.928717+0000", 2024-04-01T19:30:44.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4384e-05 2024-04-01T19:30:44.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:44.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.928726+0000", 2024-04-01T19:30:44.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4849999999999998e-06 2024-04-01T19:30:44.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:44.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.928795+0000", 2024-04-01T19:30:44.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9003000000000003e-05 2024-04-01T19:30:44.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:44.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.928939+0000", 2024-04-01T19:30:44.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000143869 2024-04-01T19:30:44.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:30:44.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.929065+0000", 2024-04-01T19:30:44.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012627299999999999 2024-04-01T19:30:44.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:44.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.937578+0000", 2024-04-01T19:30:44.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085127450000000004 2024-04-01T19:30:44.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.579 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:44.579 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.112913+0000", 2024-04-01T19:30:44.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.175334724 2024-04-01T19:30:44.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.579 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:44.579 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.112976+0000", 2024-04-01T19:30:44.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3262000000000005e-05 2024-04-01T19:30:44.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.579 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:44.579 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.113029+0000", 2024-04-01T19:30:44.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3566999999999997e-05 2024-04-01T19:30:44.579 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.579 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:44.580 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.580 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:240073 2.c 2:3b089fda:::benchmark_data_smithi188_77607_object72669:head [delete] snapc 0=[] ondisk+write+known_if_redirected e155)", 2024-04-01T19:30:44.580 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:37.932704+0000", 2024-04-01T19:30:44.580 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 186.571786127, 2024-04-01T19:30:44.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18046169200000001, 2024-04-01T19:30:44.580 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:44.580 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:44.580 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:44.580 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:44.580 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:44.580 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:44.581 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 240073 2024-04-01T19:30:44.581 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.581 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:44.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.581 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:44.581 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.932704+0000", 2024-04-01T19:30:44.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.581 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.581 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:44.581 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.932704+0000", 2024-04-01T19:30:44.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.581 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.582 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:44.582 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.932705+0000", 2024-04-01T19:30:44.582 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.217e-06 2024-04-01T19:30:44.582 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.582 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:44.582 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.932710+0000", 2024-04-01T19:30:44.582 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3109999999999999e-06 2024-04-01T19:30:44.582 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.582 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:44.582 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.932719+0000", 2024-04-01T19:30:44.582 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.6069999999999997e-06 2024-04-01T19:30:44.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:44.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.932727+0000", 2024-04-01T19:30:44.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0790000000000001e-06 2024-04-01T19:30:44.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:44.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.933489+0000", 2024-04-01T19:30:44.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00076132200000000004 2024-04-01T19:30:44.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:44.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.933584+0000", 2024-04-01T19:30:44.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5004e-05 2024-04-01T19:30:44.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:30:44.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.933660+0000", 2024-04-01T19:30:44.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6879999999999996e-05 2024-04-01T19:30:44.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:44.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.937711+0000", 2024-04-01T19:30:44.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040502969999999996 2024-04-01T19:30:44.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:44.585 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.113075+0000", 2024-04-01T19:30:44.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.17536437599999999 2024-04-01T19:30:44.585 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.585 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.585 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:44.585 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.113127+0000", 2024-04-01T19:30:44.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2210000000000003e-05 2024-04-01T19:30:44.585 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.585 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.585 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:44.585 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.113166+0000", 2024-04-01T19:30:44.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8389000000000001e-05 2024-04-01T19:30:44.585 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.586 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:44.586 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.586 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.586 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.586 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:240080 2.c 2:3d838c5d:::benchmark_data_smithi188_77607_object72676:head [delete] snapc 0=[] ondisk+write+known_if_redirected e155)", 2024-04-01T19:30:44.586 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:37.940147+0000", 2024-04-01T19:30:44.586 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 186.56434306599999, 2024-04-01T19:30:44.586 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.182677962, 2024-04-01T19:30:44.586 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:44.586 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:44.586 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:44.586 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:44.586 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:44.587 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:44.587 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 240080 2024-04-01T19:30:44.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.587 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:44.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:44.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.940147+0000", 2024-04-01T19:30:44.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:44.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.940147+0000", 2024-04-01T19:30:44.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:44.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.940150+0000", 2024-04-01T19:30:44.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4940000000000002e-06 2024-04-01T19:30:44.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:44.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.940157+0000", 2024-04-01T19:30:44.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2699999999999999e-06 2024-04-01T19:30:44.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:44.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.940171+0000", 2024-04-01T19:30:44.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4382000000000001e-05 2024-04-01T19:30:44.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:44.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.940179+0000", 2024-04-01T19:30:44.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1559999999999995e-06 2024-04-01T19:30:44.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:44.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.940241+0000", 2024-04-01T19:30:44.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1563000000000007e-05 2024-04-01T19:30:44.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:44.590 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.940371+0000", 2024-04-01T19:30:44.590 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000130538 2024-04-01T19:30:44.590 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.590 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.590 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:30:44.590 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.940499+0000", 2024-04-01T19:30:44.590 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012706499999999999 2024-04-01T19:30:44.590 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.590 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.590 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:44.590 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.944377+0000", 2024-04-01T19:30:44.590 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.003878785 2024-04-01T19:30:44.590 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.590 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.591 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:44.591 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.122752+0000", 2024-04-01T19:30:44.591 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.17837456400000001 2024-04-01T19:30:44.591 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.591 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.591 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:44.591 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.122796+0000", 2024-04-01T19:30:44.591 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4418000000000001e-05 2024-04-01T19:30:44.591 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.591 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.591 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:44.591 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.122825+0000", 2024-04-01T19:30:44.591 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8727000000000001e-05 2024-04-01T19:30:44.591 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.591 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:44.592 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.592 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.592 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.592 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:240090 2.c 2:36d309b5:::benchmark_data_smithi188_77607_object72686:head [delete] snapc 0=[] ondisk+write+known_if_redirected e155)", 2024-04-01T19:30:44.592 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:37.948424+0000", 2024-04-01T19:30:44.592 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 186.556065996, 2024-04-01T19:30:44.592 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.174503084, 2024-04-01T19:30:44.592 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:44.592 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:44.592 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:44.592 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:44.592 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:44.592 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:44.592 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 240090 2024-04-01T19:30:44.592 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.593 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:44.593 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.593 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:44.593 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.948424+0000", 2024-04-01T19:30:44.593 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.593 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.593 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.593 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:44.593 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.948424+0000", 2024-04-01T19:30:44.593 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.593 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.593 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.593 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:44.593 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.948426+0000", 2024-04-01T19:30:44.594 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1519999999999999e-06 2024-04-01T19:30:44.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.594 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:44.594 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.948433+0000", 2024-04-01T19:30:44.594 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8889999999999996e-06 2024-04-01T19:30:44.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.594 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:44.594 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.948448+0000", 2024-04-01T19:30:44.594 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4562000000000001e-05 2024-04-01T19:30:44.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.594 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:44.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.948456+0000", 2024-04-01T19:30:44.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1669999999999999e-06 2024-04-01T19:30:44.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:44.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.948514+0000", 2024-04-01T19:30:44.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8344000000000002e-05 2024-04-01T19:30:44.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:44.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.948644+0000", 2024-04-01T19:30:44.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013015800000000001 2024-04-01T19:30:44.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.596 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:30:44.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.948770+0000", 2024-04-01T19:30:44.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012528800000000001 2024-04-01T19:30:44.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.596 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:44.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.955395+0000", 2024-04-01T19:30:44.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0066254649999999997 2024-04-01T19:30:44.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.596 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:44.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.122867+0000", 2024-04-01T19:30:44.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.167472071 2024-04-01T19:30:44.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.596 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:44.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.122901+0000", 2024-04-01T19:30:44.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3435000000000001e-05 2024-04-01T19:30:44.597 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:44.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.122927+0000", 2024-04-01T19:30:44.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6553000000000001e-05 2024-04-01T19:30:44.597 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.597 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:44.597 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.597 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.597 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:240121 2.c 2:34dcaf01:::benchmark_data_smithi188_77607_object72717:head [delete] snapc 0=[] ondisk+write+known_if_redirected e155)", 2024-04-01T19:30:44.597 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:37.976465+0000", 2024-04-01T19:30:44.597 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 186.52802492000001, 2024-04-01T19:30:44.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14656604400000001, 2024-04-01T19:30:44.598 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:44.598 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:44.598 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:44.598 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:44.598 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:44.598 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:44.598 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 240121 2024-04-01T19:30:44.598 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.598 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:44.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.598 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:44.598 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.976465+0000", 2024-04-01T19:30:44.598 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:44.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.976465+0000", 2024-04-01T19:30:44.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:44.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.976468+0000", 2024-04-01T19:30:44.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4830000000000002e-06 2024-04-01T19:30:44.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:44.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.976475+0000", 2024-04-01T19:30:44.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7090000000000002e-06 2024-04-01T19:30:44.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.600 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:44.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.976492+0000", 2024-04-01T19:30:44.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6424000000000001e-05 2024-04-01T19:30:44.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.600 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:44.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.976502+0000", 2024-04-01T19:30:44.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0096e-05 2024-04-01T19:30:44.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:44.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.976566+0000", 2024-04-01T19:30:44.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4456999999999996e-05 2024-04-01T19:30:44.601 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.601 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:44.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.976666+0000", 2024-04-01T19:30:44.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9275000000000001e-05 2024-04-01T19:30:44.601 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.601 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:30:44.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.976747+0000", 2024-04-01T19:30:44.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1532000000000005e-05 2024-04-01T19:30:44.601 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.602 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.602 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:44.602 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:37.981354+0000", 2024-04-01T19:30:44.602 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046069459999999998 2024-04-01T19:30:44.602 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.602 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.602 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:44.602 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.122965+0000", 2024-04-01T19:30:44.602 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14161036399999999 2024-04-01T19:30:44.602 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.602 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.602 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:44.602 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.122996+0000", 2024-04-01T19:30:44.603 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1390999999999998e-05 2024-04-01T19:30:44.603 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.603 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.603 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:44.603 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.123031+0000", 2024-04-01T19:30:44.603 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5367000000000002e-05 2024-04-01T19:30:44.603 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.603 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:44.603 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.603 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.603 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.603 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:240160 2.c 2:3c4915e8:::benchmark_data_smithi188_77607_object72756:head [delete] snapc 0=[] ondisk+write+known_if_redirected e155)", 2024-04-01T19:30:44.603 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:38.013808+0000", 2024-04-01T19:30:44.604 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 186.49068223500001, 2024-04-01T19:30:44.604 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.117216369, 2024-04-01T19:30:44.604 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:44.604 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:44.604 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:44.604 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:44.604 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:44.604 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:44.604 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 240160 2024-04-01T19:30:44.604 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.604 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:44.604 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.604 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:44.604 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.013808+0000", 2024-04-01T19:30:44.605 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.605 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.605 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.605 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:44.605 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.013808+0000", 2024-04-01T19:30:44.605 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.605 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.605 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.605 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:44.605 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.013809+0000", 2024-04-01T19:30:44.605 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4399999999999999e-07 2024-04-01T19:30:44.605 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.605 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.606 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:44.606 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.013812+0000", 2024-04-01T19:30:44.606 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.546e-06 2024-04-01T19:30:44.606 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.606 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.606 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:44.606 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.013819+0000", 2024-04-01T19:30:44.606 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8229999999999997e-06 2024-04-01T19:30:44.606 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.606 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.606 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:44.606 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.013825+0000", 2024-04-01T19:30:44.606 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9309999999999996e-06 2024-04-01T19:30:44.607 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.607 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.607 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:44.607 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.013883+0000", 2024-04-01T19:30:44.607 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8377e-05 2024-04-01T19:30:44.607 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.607 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.607 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:44.607 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.014020+0000", 2024-04-01T19:30:44.607 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013684100000000001 2024-04-01T19:30:44.607 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.607 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.607 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:30:44.607 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.014152+0000", 2024-04-01T19:30:44.608 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013157699999999999 2024-04-01T19:30:44.608 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.608 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:44.608 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.022287+0000", 2024-04-01T19:30:44.608 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0081350680000000005 2024-04-01T19:30:44.608 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.608 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:44.608 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.130933+0000", 2024-04-01T19:30:44.608 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.108646373 2024-04-01T19:30:44.608 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.609 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:44.609 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.130977+0000", 2024-04-01T19:30:44.609 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3322999999999998e-05 2024-04-01T19:30:44.609 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.609 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.609 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:44.609 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.131024+0000", 2024-04-01T19:30:44.609 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7666000000000001e-05 2024-04-01T19:30:44.609 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.609 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:44.609 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.609 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.609 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.609 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:240168 2.c 2:3a7c047e:::benchmark_data_smithi188_77607_object72764:head [delete] snapc 0=[] ondisk+write+known_if_redirected e155)", 2024-04-01T19:30:44.610 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:38.016369+0000", 2024-04-01T19:30:44.610 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 186.48812143200001, 2024-04-01T19:30:44.610 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.114782652, 2024-04-01T19:30:44.610 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:44.610 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:44.610 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:30:44.610 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:44.610 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:44.610 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:44.610 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 240168 2024-04-01T19:30:44.610 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.610 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:44.610 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.611 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:44.611 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.016369+0000", 2024-04-01T19:30:44.611 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.611 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.611 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.611 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:44.611 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.016369+0000", 2024-04-01T19:30:44.611 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.611 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.611 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.611 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:44.611 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.016370+0000", 2024-04-01T19:30:44.611 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.711e-06 2024-04-01T19:30:44.612 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.612 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.612 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:44.612 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.016375+0000", 2024-04-01T19:30:44.612 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0180000000000001e-06 2024-04-01T19:30:44.612 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.612 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.612 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:44.612 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.016384+0000", 2024-04-01T19:30:44.612 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4679999999999992e-06 2024-04-01T19:30:44.612 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.612 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.612 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:44.612 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.016391+0000", 2024-04-01T19:30:44.613 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4420000000000001e-06 2024-04-01T19:30:44.613 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.613 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.613 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:44.613 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.018120+0000", 2024-04-01T19:30:44.613 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0017291419999999999 2024-04-01T19:30:44.613 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.613 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.613 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:30:44.613 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.018250+0000", 2024-04-01T19:30:44.613 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000129653 2024-04-01T19:30:44.613 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.613 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.614 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:30:44.614 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.018333+0000", 2024-04-01T19:30:44.614 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2900999999999998e-05 2024-04-01T19:30:44.614 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.614 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.614 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:30:44.614 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.022439+0000", 2024-04-01T19:30:44.614 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.004106111 2024-04-01T19:30:44.614 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.614 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.614 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:30:44.614 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.131080+0000", 2024-04-01T19:30:44.614 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.10864069799999999 2024-04-01T19:30:44.614 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.615 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.615 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:30:44.615 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.131111+0000", 2024-04-01T19:30:44.615 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0880000000000002e-05 2024-04-01T19:30:44.615 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.615 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.615 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:44.615 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:38.131151+0000", 2024-04-01T19:30:44.615 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0627999999999998e-05 2024-04-01T19:30:44.615 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.615 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:44.615 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.615 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.615 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.615 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:265224 2.b 2.54b4455b (undecoded) ondisk+retry+write+known_if_redirected e170)", 2024-04-01T19:30:44.616 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:28:30.815480+0000", 2024-04-01T19:30:44.616 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 133.68900997700001, 2024-04-01T19:30:44.616 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.83027662000000002, 2024-04-01T19:30:44.616 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:44.616 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:44.616 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:30:44.616 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:44.616 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:44.616 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:44.616 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 265224 2024-04-01T19:30:44.616 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.616 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:44.616 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.617 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:44.617 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.815480+0000", 2024-04-01T19:30:44.617 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.617 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.617 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.617 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:44.617 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.815480+0000", 2024-04-01T19:30:44.617 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.617 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.617 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.617 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:44.617 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.815483+0000", 2024-04-01T19:30:44.617 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6400000000000001e-06 2024-04-01T19:30:44.617 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.618 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.618 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:44.618 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.815491+0000", 2024-04-01T19:30:44.618 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8339999999999999e-06 2024-04-01T19:30:44.618 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.618 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.618 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:44.618 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.815504+0000", 2024-04-01T19:30:44.618 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3276e-05 2024-04-01T19:30:44.618 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.618 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.618 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:44.618 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.815514+0000", 2024-04-01T19:30:44.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7350000000000008e-06 2024-04-01T19:30:44.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.619 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:44.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.815580+0000", 2024-04-01T19:30:44.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5944000000000004e-05 2024-04-01T19:30:44.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.619 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:30:44.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.815589+0000", 2024-04-01T19:30:44.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0769999999999997e-06 2024-04-01T19:30:44.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.619 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:44.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.645714+0000", 2024-04-01T19:30:44.620 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.83012580800000002 2024-04-01T19:30:44.620 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.620 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.620 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:44.620 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.645757+0000", 2024-04-01T19:30:44.620 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2305999999999998e-05 2024-04-01T19:30:44.620 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.620 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:44.620 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.620 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.620 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.620 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:265231 2.b 2.7ca58efb (undecoded) ondisk+retry+write+known_if_redirected e170)", 2024-04-01T19:30:44.620 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:28:30.815540+0000", 2024-04-01T19:30:44.620 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 133.688950124, 2024-04-01T19:30:44.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.83034085800000001, 2024-04-01T19:30:44.621 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:30:44.621 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:30:44.621 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:30:44.621 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:30:44.621 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:30:44.621 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:30:44.621 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 265231 2024-04-01T19:30:44.621 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.621 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:30:44.621 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.621 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:30:44.621 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.815540+0000", 2024-04-01T19:30:44.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.622 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.622 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.622 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:30:44.622 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.815540+0000", 2024-04-01T19:30:44.622 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:30:44.622 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.622 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.622 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:30:44.622 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.815541+0000", 2024-04-01T19:30:44.622 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4199999999999995e-07 2024-04-01T19:30:44.622 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.622 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.622 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:30:44.622 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.815544+0000", 2024-04-01T19:30:44.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.038e-06 2024-04-01T19:30:44.623 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.623 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.623 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:30:44.623 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.815550+0000", 2024-04-01T19:30:44.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8850000000000004e-06 2024-04-01T19:30:44.623 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.623 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.623 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:30:44.623 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.815555+0000", 2024-04-01T19:30:44.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5260000000000001e-06 2024-04-01T19:30:44.623 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.623 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.624 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:44.624 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.815618+0000", 2024-04-01T19:30:44.624 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3201999999999996e-05 2024-04-01T19:30:44.624 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.624 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.624 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:30:44.624 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.815628+0000", 2024-04-01T19:30:44.624 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.6660000000000003e-06 2024-04-01T19:30:44.624 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.624 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.624 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:30:44.624 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.645872+0000", 2024-04-01T19:30:44.624 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.83024435900000004 2024-04-01T19:30:44.624 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:30:44.625 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:30:44.625 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:30:44.625 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.645881+0000", 2024-04-01T19:30:44.625 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4400000000000005e-06 2024-04-01T19:30:44.625 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.625 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:44.625 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.625 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:30:44.625 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:30:44.625 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:30:44.626 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 44 16 105415 105399 149.697 100.062 0.00959973 0.00667881 2024-04-01T19:30:44.717 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:30:44.737 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:44.737 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:30:44.838 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:30:44.842 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:30:44.874 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:44.905 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:30:44.911 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:44.912 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:30:44.984 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:44 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:30:44.985 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:44 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:30:44.985 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:44 smithi022 ceph-mon[39439]: osdmap e210: 12 total, 12 up, 12 in 2024-04-01T19:30:44.985 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:44 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:30:44.985 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:44 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:30:44.985 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:44 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:30:44.985 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:44 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:30:44.985 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:44 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3033432858' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:30:45.013 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:30:45.063 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:45.117 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.3 reset_purged_snaps_last 2024-04-01T19:30:45.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:44 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:30:45.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:44 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:30:45.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:44 smithi062 ceph-mon[44211]: osdmap e210: 12 total, 12 up, 12 in 2024-04-01T19:30:45.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:44 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:30:45.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:44 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:30:45.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:44 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:30:45.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:44 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:30:45.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:44 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3033432858' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:30:45.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:44 smithi062 ceph-mon[44211]: from='client.25183 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:30:45.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:44 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:30:45.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:44 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:30:45.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:44 smithi062 ceph-mon[44211]: from='client.25183 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:30:45.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:44 smithi062 ceph-mon[44211]: osdmap e211: 12 total, 12 up, 12 in 2024-04-01T19:30:45.268 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:44 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:30:45.268 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:44 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:30:45.268 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:44 smithi188 ceph-mon[43939]: osdmap e210: 12 total, 12 up, 12 in 2024-04-01T19:30:45.268 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:44 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:30:45.268 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:44 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:30:45.268 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:44 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:30:45.268 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:44 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:30:45.268 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:44 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3033432858' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:30:45.268 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:44 smithi188 ceph-mon[43939]: from='client.25183 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:30:45.269 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:44 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:30:45.269 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:44 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:30:45.269 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:44 smithi188 ceph-mon[43939]: from='client.25183 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:30:45.269 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:44 smithi188 ceph-mon[43939]: osdmap e211: 12 total, 12 up, 12 in 2024-04-01T19:30:45.300 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:30:45.307 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:45.308 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:30:45.309 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_ops_in_flight 2024-04-01T19:30:45.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:44 smithi022 ceph-mon[39439]: from='client.25183 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:30:45.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:44 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:30:45.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:44 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:30:45.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:44 smithi022 ceph-mon[39439]: from='client.25183 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:30:45.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:44 smithi022 ceph-mon[39439]: osdmap e211: 12 total, 12 up, 12 in 2024-04-01T19:30:45.409 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:30:45.453 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:45.509 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:30:45.513 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:45.514 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:30:45.530 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:30:45.591 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 45 16 106960 106944 148.516 96.5625 0.0112529 0.00673236 2024-04-01T19:30:45.615 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:30:45.660 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:45.692 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:30:45.695 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:45.695 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:30:45.701 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:30:45.796 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:30:45.869 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:45.892 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:30:45.897 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:30:45.914 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:45.915 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:30:45.965 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:30:46.016 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:30:46.069 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:46.097 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:46.098 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:30:46.098 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:30:46.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:45 smithi022 ceph-mon[39439]: pgmap v627: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 6.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 98 MiB/s wr, 1.56k op/s; 1229/201492 objects misplaced (0.610%); 6.7 MiB/s, 107 objects/s recovering 2024-04-01T19:30:46.199 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:30:46.244 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:46.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:45 smithi062 ceph-mon[44211]: pgmap v627: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 6.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 98 MiB/s wr, 1.56k op/s; 1229/201492 objects misplaced (0.610%); 6.7 MiB/s, 107 objects/s recovering 2024-04-01T19:30:46.266 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:45 smithi188 ceph-mon[43939]: pgmap v627: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 6.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 98 MiB/s wr, 1.56k op/s; 1229/201492 objects misplaced (0.610%); 6.7 MiB/s, 107 objects/s recovering 2024-04-01T19:30:46.458 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:30:46.462 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:46.463 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:30:46.564 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:30:46.591 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 46 16 108395 108379 147.237 89.6875 0.00493087 0.00678993 2024-04-01T19:30:46.600 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:46.626 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:30:46.632 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:46.632 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:30:46.733 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:30:46.765 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:46.792 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:30:46.804 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:46.804 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:30:46.905 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:30:46.947 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:46.997 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:30:47.003 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:47.004 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:30:47.105 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:30:47.141 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:47.174 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:30:47.179 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:47.180 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:30:47.281 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:30:47.321 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:47.463 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:30:47.469 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:47.469 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:30:47.570 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:30:47.591 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 47 16 109971 109955 146.2 98.5 0.00741666 0.00683851 2024-04-01T19:30:47.613 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:47.840 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:30:48.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:48 smithi062 ceph-mon[44211]: pgmap v629: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 6.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 110 MiB/s wr, 1.76k op/s; 1229/209586 objects misplaced (0.586%); 4.1 MiB/s, 65 objects/s recovering 2024-04-01T19:30:48.302 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:48 smithi022 ceph-mon[39439]: pgmap v629: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 6.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 110 MiB/s wr, 1.76k op/s; 1229/209586 objects misplaced (0.586%); 4.1 MiB/s, 65 objects/s recovering 2024-04-01T19:30:48.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:48 smithi188 ceph-mon[43939]: pgmap v629: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 6.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 110 MiB/s wr, 1.76k op/s; 1229/209586 objects misplaced (0.586%); 4.1 MiB/s, 65 objects/s recovering 2024-04-01T19:30:48.586 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:30:48.590 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:48.591 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:30:48.591 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 48 16 111557 111541 145.219 99.125 0.00710986 0.00688457 2024-04-01T19:30:48.692 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:30:48.725 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:49.586 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:30:49.586 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:30:49.587 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:30:49.587 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:30:49.587 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:30:49.591 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 49 16 112976 112960 144.065 88.6875 0.0117782 0.00694021 2024-04-01T19:30:49.609 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:30:49.651 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:30:49.679 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:30:49.680 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:30:49.684 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:49.684 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:30:49.701 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:30:49.734 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:30:49.768 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:30:49.785 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:30:49.803 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:30:49.806 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:30:49.806 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:30:49.807 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:30:49.807 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:30:49.807 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:30:49.807 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:30:49.807 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:30:49.807 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:30:49.807 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:30:49.807 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:30:49.807 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:30:49.807 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:30:49.825 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:49.936 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:30:49.941 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:49.941 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:30:50.043 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:30:50.097 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:50.129 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:30:50.133 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:50.133 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:30:50.135 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:30:50.135 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:30:50.234 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:30:50.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:50 smithi062 ceph-mon[44211]: pgmap v630: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 6.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 93 MiB/s wr, 1.49k op/s; 698/216340 objects misplaced (0.323%); 7.7 MiB/s, 122 objects/s recovering 2024-04-01T19:30:50.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:50 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2217492724' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:30:50.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:50.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:50.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:50.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:50.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:50.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:50.278 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:50.315 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:30:50.318 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:50.318 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:30:50.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:50 smithi022 ceph-mon[39439]: pgmap v630: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 6.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 93 MiB/s wr, 1.49k op/s; 698/216340 objects misplaced (0.323%); 7.7 MiB/s, 122 objects/s recovering 2024-04-01T19:30:50.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:50 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2217492724' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:30:50.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:50.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:50.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:50.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:50.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:50.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:50.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:50 smithi188 ceph-mon[43939]: pgmap v630: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 6.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 93 MiB/s wr, 1.49k op/s; 698/216340 objects misplaced (0.323%); 7.7 MiB/s, 122 objects/s recovering 2024-04-01T19:30:50.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:50 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2217492724' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:30:50.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:50.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:50.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:50.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:50.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:50.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:50.419 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:30:50.484 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:50.509 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:30:50.512 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:50.512 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:30:50.591 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 50 16 114478 114462 143.061 93.875 0.0101985 0.00698866 2024-04-01T19:30:50.612 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:30:50.653 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:50.682 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:30:50.689 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:50.690 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:30:50.791 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:30:50.861 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:50.978 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_blocked_ops 2024-04-01T19:30:50.992 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:30:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:30:51.011 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:51.012 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:30:51.040 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.4 reset_purged_snaps_last 2024-04-01T19:30:51.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:51.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:51.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:51.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:51.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:51.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:51.113 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:30:51.173 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:51.211 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:30:51.217 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:51.218 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:30:51.319 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:30:51.353 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:51.353 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:51.354 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:51.354 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:51.354 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:51.354 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:51.356 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:51.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:51.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:51.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:51.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:51.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:51.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:51.379 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:30:51.382 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:30:51.386 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:51.386 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:30:51.487 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:30:51.529 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:51.560 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:30:51.564 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:51.565 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:30:51.591 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 51 16 115944 115928 142.053 91.625 0.0110863 0.00703812 2024-04-01T19:30:51.666 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:30:51.709 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:51.739 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:30:51.742 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:51.742 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:30:51.843 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:30:51.894 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:51.961 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:30:51.967 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:51.967 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:30:51.992 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:30:52.068 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:30:52.109 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:52.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:52 smithi022 ceph-mon[39439]: pgmap v631: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 6.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 103 MiB/s wr, 1.66k op/s; 698/223866 objects misplaced (0.312%); 7.7 MiB/s, 122 objects/s recovering 2024-04-01T19:30:52.313 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:30:52.315 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:52 smithi188 ceph-mon[43939]: pgmap v631: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 6.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 103 MiB/s wr, 1.66k op/s; 698/223866 objects misplaced (0.312%); 7.7 MiB/s, 122 objects/s recovering 2024-04-01T19:30:52.316 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:52.316 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:30:52.417 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:30:52.464 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:52.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:52 smithi062 ceph-mon[44211]: pgmap v631: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 6.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 103 MiB/s wr, 1.66k op/s; 698/223866 objects misplaced (0.312%); 7.7 MiB/s, 122 objects/s recovering 2024-04-01T19:30:52.591 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 52 16 117483 117467 141.171 96.1875 0.00720374 0.00708241 2024-04-01T19:30:52.678 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:30:52.682 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:52.682 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:30:52.783 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:30:52.819 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:52.842 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:30:52.852 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:30:52.864 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:52.865 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:30:52.966 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:30:53.003 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:53.137 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:30:53.145 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:53.145 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:30:53.246 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:30:53.290 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:53.320 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:30:53.326 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:53.326 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:30:53.427 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:30:53.461 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:53.486 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:30:53.490 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:30:53.490 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:30:53.492 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:53.493 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:30:53.592 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 53 16 118871 118855 140.141 86.75 0.00710147 0.00713434 2024-04-01T19:30:53.594 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:30:53.662 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:53.731 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:30:53.759 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:53.760 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:30:53.861 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:30:53.895 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:53.922 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:30:53.926 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:53.927 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:30:54.028 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:30:54.064 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:54 smithi022 ceph-mon[39439]: pgmap v632: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 7.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 100 MiB/s wr, 1.60k op/s; 698/228596 objects misplaced (0.305%); 3.8 MiB/s, 60 objects/s recovering 2024-04-01T19:30:54.064 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:54 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:30:54.064 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:54 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:30:54.064 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:54 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2715686410' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:30:54.064 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:54 smithi022 ceph-mon[39439]: from='client.25201 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:30:54.078 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:54.103 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:30:54.106 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:54.106 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:30:54.207 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:30:54.236 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:54.256 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:30:54.261 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:54.261 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:30:54.310 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:54 smithi188 ceph-mon[43939]: pgmap v632: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 7.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 100 MiB/s wr, 1.60k op/s; 698/228596 objects misplaced (0.305%); 3.8 MiB/s, 60 objects/s recovering 2024-04-01T19:30:54.310 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:54 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:30:54.310 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:54 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:30:54.311 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:54 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2715686410' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:30:54.313 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:54 smithi188 ceph-mon[43939]: from='client.25201 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:30:54.334 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_historic_ops 2024-04-01T19:30:54.362 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:30:54.384 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:30:54.403 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:54.423 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:30:54.426 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:54.426 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:30:54.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:54 smithi062 ceph-mon[44211]: pgmap v632: 17 pgs: 1 active+recovering+remapped, 16 active+clean; 7.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 100 MiB/s wr, 1.60k op/s; 698/228596 objects misplaced (0.305%); 3.8 MiB/s, 60 objects/s recovering 2024-04-01T19:30:54.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:54 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:30:54.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:54 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:30:54.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:54 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2715686410' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:30:54.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:54 smithi062 ceph-mon[44211]: from='client.25201 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:30:54.527 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:30:54.555 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:54.583 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:30:54.589 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:54.590 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:30:54.592 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 54 16 119740 119724 138.551 54.3125 0.0039793 0.00715475 2024-04-01T19:30:54.597 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:30:54.691 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:30:54.717 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:54.865 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:30:54.869 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:54.869 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:30:54.970 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:30:54.990 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:30:55.041 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:55.337 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:55 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:30:55.337 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:55 smithi022 ceph-mon[39439]: from='client.25201 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:30:55.337 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:55 smithi022 ceph-mon[39439]: osdmap e212: 12 total, 12 up, 12 in 2024-04-01T19:30:55.337 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:55 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:30:55.337 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:55 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:30:55.337 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:55 smithi022 ceph-mon[39439]: osdmap e213: 12 total, 12 up, 12 in 2024-04-01T19:30:55.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:55 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:30:55.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:55 smithi188 ceph-mon[43939]: from='client.25201 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:30:55.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:55 smithi188 ceph-mon[43939]: osdmap e212: 12 total, 12 up, 12 in 2024-04-01T19:30:55.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:55 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:30:55.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:55 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:30:55.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:55 smithi188 ceph-mon[43939]: osdmap e213: 12 total, 12 up, 12 in 2024-04-01T19:30:55.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:55 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:30:55.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:55 smithi062 ceph-mon[44211]: from='client.25201 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:30:55.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:55 smithi062 ceph-mon[44211]: osdmap e212: 12 total, 12 up, 12 in 2024-04-01T19:30:55.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:55 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:30:55.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:55 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:30:55.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:55 smithi062 ceph-mon[44211]: osdmap e213: 12 total, 12 up, 12 in 2024-04-01T19:30:55.592 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 55 16 120809 120793 137.247 66.8125 0.0101423 0.00728442 2024-04-01T19:30:56.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:56 smithi022 ceph-mon[39439]: pgmap v634: 17 pgs: 1 creating+peering, 16 active+clean; 7.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 97 MiB/s wr, 1.55k op/s; 7.7 MiB/s, 123 objects/s recovering 2024-04-01T19:30:56.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:56 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:30:56.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:56 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:30:56.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:56 smithi022 ceph-mon[39439]: osdmap e214: 12 total, 12 up, 12 in 2024-04-01T19:30:56.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:56 smithi188 ceph-mon[43939]: pgmap v634: 17 pgs: 1 creating+peering, 16 active+clean; 7.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 97 MiB/s wr, 1.55k op/s; 7.7 MiB/s, 123 objects/s recovering 2024-04-01T19:30:56.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:56 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:30:56.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:56 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:30:56.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:56 smithi188 ceph-mon[43939]: osdmap e214: 12 total, 12 up, 12 in 2024-04-01T19:30:56.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:56 smithi062 ceph-mon[44211]: pgmap v634: 17 pgs: 1 creating+peering, 16 active+clean; 7.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 97 MiB/s wr, 1.55k op/s; 7.7 MiB/s, 123 objects/s recovering 2024-04-01T19:30:56.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:56 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:30:56.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:56 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:30:56.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:56 smithi062 ceph-mon[44211]: osdmap e214: 12 total, 12 up, 12 in 2024-04-01T19:30:56.593 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 56 16 122340 122324 136.505 95.6875 0.0109602 0.00732427 2024-04-01T19:30:56.617 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:30:56.620 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:56.620 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:30:56.721 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:30:56.739 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:30:56.740 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:30:56.780 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:56.814 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:30:56.817 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:56.818 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:30:56.919 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:30:56.968 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:57.040 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:30:57.558 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_ops_in_flight 2024-04-01T19:30:57.569 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.5 reset_purged_snaps_last 2024-04-01T19:30:57.594 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 57 16 123838 123822 135.752 93.625 0.0167517 0.00736459 2024-04-01T19:30:57.795 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:30:57.810 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:57.811 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:30:57.912 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:30:57.947 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:57.976 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:30:57.979 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:57.980 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:30:58.081 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:30:58.084 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:58 smithi022 ceph-mon[39439]: pgmap v637: 17 pgs: 1 creating+peering, 16 active+clean; 7.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 77 MiB/s wr, 1.24k op/s; 7.3 MiB/s, 116 objects/s recovering 2024-04-01T19:30:58.114 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:58.135 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:30:58.140 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:58.141 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:30:58.242 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:30:58.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:58 smithi062 ceph-mon[44211]: pgmap v637: 17 pgs: 1 creating+peering, 16 active+clean; 7.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 77 MiB/s wr, 1.24k op/s; 7.3 MiB/s, 116 objects/s recovering 2024-04-01T19:30:58.265 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:30:58.284 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:30:58.290 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:30:58.342 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:30:58.354 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:58.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:58 smithi188 ceph-mon[43939]: pgmap v637: 17 pgs: 1 creating+peering, 16 active+clean; 7.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 77 MiB/s wr, 1.24k op/s; 7.3 MiB/s, 116 objects/s recovering 2024-04-01T19:30:58.398 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:30:58.440 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:30:58.462 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:30:58.470 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:58.471 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:30:58.483 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:30:58.524 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:30:58.555 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:30:58.572 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:30:58.592 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 58 16 125082 125066 134.752 77.75 0.00801454 0.00741912 2024-04-01T19:30:58.594 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:30:58.648 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:58.653 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:30:58.695 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:30:58.745 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:30:58.787 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:30:58.825 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:30:58.839 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:30:58.839 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:30:58.839 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:30:58.839 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:30:58.839 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:30:58.839 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:30:58.839 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:30:58.839 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:30:58.839 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:30:58.839 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:30:58.839 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:30:58.839 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:30:58.944 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:30:58.951 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:58.951 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:30:59.052 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:30:59.082 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:59.112 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:30:59.119 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:59.120 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:30:59.221 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:30:59.256 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:59.291 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:30:59.294 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:59.295 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:30:59.300 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:59 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:30:59.300 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:59 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:30:59.300 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:59 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:30:59.300 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:59 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:30:59.300 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:59 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2606604929' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:30:59.300 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:59.301 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:59.301 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:59.301 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:59.301 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:59.301 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:59.301 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:59 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:30:59.301 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:59 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:30:59.301 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:59.301 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:59 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:30:59.301 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:59 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:30:59.301 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:30:59 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:30:59.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:59 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:30:59.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:59 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:30:59.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:59 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:30:59.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:59 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:30:59.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:59 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2606604929' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:30:59.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:59.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:59.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:59.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:59.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:59.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:59.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:59 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:30:59.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:59 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:30:59.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:59.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:59 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:30:59.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:59 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:30:59.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:30:59 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:30:59.396 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:30:59.448 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:59.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:59 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:30:59.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:59 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:30:59.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:59 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:30:59.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:59 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:30:59.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:59 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2606604929' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:30:59.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:59.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:59.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:59.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:59.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:59.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:59.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:59 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:30:59.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:59 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:30:59.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:30:59.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:59 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:30:59.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:59 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:30:59.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:30:59 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:30:59.585 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:30:59.593 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 59 16 126400 126384 133.865 82.375 0.0123973 0.00746835 2024-04-01T19:30:59.593 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:59.594 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:30:59.695 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:30:59.751 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:30:59.908 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:30:59.911 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:30:59.912 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:31:00.013 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:31:00.044 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:00.069 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:31:00.078 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:00.079 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:31:00.180 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:31:00.219 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:00.241 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:00.241 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:00.241 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:00.241 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:00 smithi022 ceph-mon[39439]: pgmap v638: 17 pgs: 1 creating+peering, 16 active+clean; 7.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 77 MiB/s wr, 1.24k op/s; 7.3 MiB/s, 116 objects/s recovering 2024-04-01T19:31:00.242 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:00.242 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:00.242 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:00 smithi022 ceph-mon[39439]: osdmap e215: 12 total, 12 up, 12 in 2024-04-01T19:31:00.247 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:31:00.250 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:00.251 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:31:00.352 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:31:00.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:00.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:00.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:00.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:00 smithi188 ceph-mon[43939]: pgmap v638: 17 pgs: 1 creating+peering, 16 active+clean; 7.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 77 MiB/s wr, 1.24k op/s; 7.3 MiB/s, 116 objects/s recovering 2024-04-01T19:31:00.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:00.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:00.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:00 smithi188 ceph-mon[43939]: osdmap e215: 12 total, 12 up, 12 in 2024-04-01T19:31:00.382 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:00.382 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:00.382 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:00.383 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:00 smithi062 ceph-mon[44211]: pgmap v638: 17 pgs: 1 creating+peering, 16 active+clean; 7.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 77 MiB/s wr, 1.24k op/s; 7.3 MiB/s, 116 objects/s recovering 2024-04-01T19:31:00.383 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:00.383 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:00.383 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:00 smithi062 ceph-mon[44211]: osdmap e215: 12 total, 12 up, 12 in 2024-04-01T19:31:00.385 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:00.408 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:31:00.411 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:00.411 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:31:00.512 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:31:00.545 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:00.575 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:31:00.578 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:00.578 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:31:00.593 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:31:00.595863 min lat: 0.00100536 max lat: 2.32602 avg lat: 0.00750494 2024-04-01T19:31:00.593 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:31:00.593 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 60 16 127917 127901 133.214 94.8125 0.0098262 0.00750494 2024-04-01T19:31:00.679 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:31:00.716 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:00.750 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:31:00.755 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:00.755 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:31:00.856 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:31:00.914 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:01.593 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 61 16 129445 129429 132.595 95.5 0.00439767 0.00754041 2024-04-01T19:31:01.908 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:31:01.912 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:01.912 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:31:02.013 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:31:02.051 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:02.081 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:31:02.085 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:02.085 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:31:02.186 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:31:02.221 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:02.245 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:31:02.248 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:02.248 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:31:02.349 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:31:02.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:02 smithi022 ceph-mon[39439]: pgmap v640: 17 pgs: 17 active+clean; 7.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 98 MiB/s wr, 1.57k op/s 2024-04-01T19:31:02.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:02 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:31:02.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:02 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:31:02.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:02 smithi188 ceph-mon[43939]: pgmap v640: 17 pgs: 17 active+clean; 7.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 98 MiB/s wr, 1.57k op/s 2024-04-01T19:31:02.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:02 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:31:02.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:02 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:31:02.409 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:02.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:02 smithi062 ceph-mon[44211]: pgmap v640: 17 pgs: 17 active+clean; 7.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 98 MiB/s wr, 1.57k op/s 2024-04-01T19:31:02.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:02 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:31:02.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:02 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:31:02.593 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 62 16 130930 130914 131.953 92.8125 0.0051343 0.00757673 2024-04-01T19:31:03.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:03 smithi188 ceph-mon[43939]: osdmap e216: 12 total, 12 up, 12 in 2024-04-01T19:31:03.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:03 smithi062 ceph-mon[44211]: osdmap e216: 12 total, 12 up, 12 in 2024-04-01T19:31:03.593 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 63 16 132449 132433 131.366 94.9375 0.00885401 0.00761108 2024-04-01T19:31:03.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:03 smithi022 ceph-mon[39439]: osdmap e216: 12 total, 12 up, 12 in 2024-04-01T19:31:03.792 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:31:03.797 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:03.798 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:31:03.899 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:31:03.942 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:03.950 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:31:04.131 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:31:04.137 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:04.138 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:31:04.239 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:31:04.246 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:31:04.246 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:31:04.246 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.246 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25117.0:133273 3.3 e217/191 3:cdf79645:::benchmark_data_smithi188_92122_object133272:head v 217'8301, mlcod=217'8298)", 2024-04-01T19:31:04.246 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:04.233541+0000", 2024-04-01T19:31:04.246 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0093341459999999998, 2024-04-01T19:31:04.246 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0093682809999999991, 2024-04-01T19:31:04.246 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:31:04.246 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:31:04.246 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:31:04.247 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:31:04.247 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.247 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:31:04.247 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.233541+0000", 2024-04-01T19:31:04.247 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:31:04.247 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.247 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.247 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:31:04.247 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.233541+0000", 2024-04-01T19:31:04.247 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:31:04.247 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.247 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.247 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:31:04.248 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.233543+0000", 2024-04-01T19:31:04.248 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3230000000000001e-06 2024-04-01T19:31:04.248 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.248 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.248 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:31:04.248 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.233576+0000", 2024-04-01T19:31:04.248 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3120999999999997e-05 2024-04-01T19:31:04.248 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.248 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.248 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:31:04.248 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.233589+0000", 2024-04-01T19:31:04.248 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3083e-05 2024-04-01T19:31:04.248 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.249 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.249 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:31:04.249 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.233596+0000", 2024-04-01T19:31:04.249 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.7619999999999998e-06 2024-04-01T19:31:04.249 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.249 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.249 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:31:04.249 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.233646+0000", 2024-04-01T19:31:04.249 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0491999999999997e-05 2024-04-01T19:31:04.249 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.249 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.249 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:31:04.249 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.233665+0000", 2024-04-01T19:31:04.250 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9096000000000001e-05 2024-04-01T19:31:04.250 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:31:04.250 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:31:04.250 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:31:04.250 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.250 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.250 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:133279 3.6 3:602a1a4b:::benchmark_data_smithi188_92122_object133278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e217)", 2024-04-01T19:31:04.250 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:04.233620+0000", 2024-04-01T19:31:04.250 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0092559070000000007, 2024-04-01T19:31:04.250 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0093687360000000008, 2024-04-01T19:31:04.250 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:31:04.250 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:31:04.251 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:31:04.251 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:31:04.251 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:31:04.251 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:31:04.251 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 133279 2024-04-01T19:31:04.251 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.251 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:31:04.251 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.251 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:31:04.251 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.233620+0000", 2024-04-01T19:31:04.251 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:31:04.251 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.251 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.251 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:31:04.252 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.233620+0000", 2024-04-01T19:31:04.252 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:31:04.252 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.252 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.252 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:31:04.252 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.233622+0000", 2024-04-01T19:31:04.252 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9640000000000002e-06 2024-04-01T19:31:04.252 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.252 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.252 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:31:04.252 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.233650+0000", 2024-04-01T19:31:04.252 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.8787999999999999e-05 2024-04-01T19:31:04.252 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.252 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.253 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:31:04.253 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.233658+0000", 2024-04-01T19:31:04.253 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.8150000000000006e-06 2024-04-01T19:31:04.253 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.253 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.253 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:31:04.253 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.233664+0000", 2024-04-01T19:31:04.253 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0240000000000003e-06 2024-04-01T19:31:04.253 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.253 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.253 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:31:04.253 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.233730+0000", 2024-04-01T19:31:04.253 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5471999999999999e-05 2024-04-01T19:31:04.253 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.254 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.254 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:31:04.254 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.233852+0000", 2024-04-01T19:31:04.254 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012248399999999999 2024-04-01T19:31:04.254 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.254 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.254 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 1", 2024-04-01T19:31:04.254 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.233977+0000", 2024-04-01T19:31:04.254 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000124969 2024-04-01T19:31:04.254 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.254 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.254 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:31:04.254 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.241766+0000", 2024-04-01T19:31:04.255 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0077885790000000003 2024-04-01T19:31:04.255 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:31:04.255 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:31:04.255 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:31:04.255 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.255 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.255 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:133281 3.1 3:878d5944:::benchmark_data_smithi188_92122_object133280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e217)", 2024-04-01T19:31:04.255 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:04.237551+0000", 2024-04-01T19:31:04.255 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.005324189, 2024-04-01T19:31:04.255 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0055318590000000001, 2024-04-01T19:31:04.255 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:31:04.255 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:31:04.255 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:31:04.256 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:31:04.256 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:31:04.256 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:31:04.256 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 133281 2024-04-01T19:31:04.256 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.256 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:31:04.256 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.256 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:31:04.256 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.237551+0000", 2024-04-01T19:31:04.256 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:31:04.256 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.256 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.256 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:31:04.256 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.237551+0000", 2024-04-01T19:31:04.256 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:31:04.257 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.257 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.257 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:31:04.257 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.237554+0000", 2024-04-01T19:31:04.257 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3190000000000002e-06 2024-04-01T19:31:04.257 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.257 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.257 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:31:04.257 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.237595+0000", 2024-04-01T19:31:04.257 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1356999999999997e-05 2024-04-01T19:31:04.257 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.257 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.257 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:31:04.257 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.237608+0000", 2024-04-01T19:31:04.258 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2653999999999999e-05 2024-04-01T19:31:04.258 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.258 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.258 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:31:04.258 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.237616+0000", 2024-04-01T19:31:04.258 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4810000000000006e-06 2024-04-01T19:31:04.258 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.258 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.258 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:31:04.258 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.237697+0000", 2024-04-01T19:31:04.258 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0448e-05 2024-04-01T19:31:04.258 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.258 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.259 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:31:04.259 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.237832+0000", 2024-04-01T19:31:04.259 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000135659 2024-04-01T19:31:04.259 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.259 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.259 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 4", 2024-04-01T19:31:04.259 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.237964+0000", 2024-04-01T19:31:04.259 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013215899999999999 2024-04-01T19:31:04.259 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.259 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.259 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:31:04.259 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.242279+0000", 2024-04-01T19:31:04.259 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0043145859999999996 2024-04-01T19:31:04.259 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:31:04.260 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:31:04.260 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:31:04.260 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.260 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.260 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:133284 3.6 3:63d3228f:::benchmark_data_smithi188_92122_object133283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e217)", 2024-04-01T19:31:04.260 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:04.237637+0000", 2024-04-01T19:31:04.260 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0052380350000000003, 2024-04-01T19:31:04.260 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0055438140000000002, 2024-04-01T19:31:04.260 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:31:04.260 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:31:04.260 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:31:04.260 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:31:04.260 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:31:04.261 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:31:04.261 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 133284 2024-04-01T19:31:04.261 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.261 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:31:04.261 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.261 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:31:04.261 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.237637+0000", 2024-04-01T19:31:04.261 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:31:04.261 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.261 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.261 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:31:04.261 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.237637+0000", 2024-04-01T19:31:04.261 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:31:04.261 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.262 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.262 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:31:04.262 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.237638+0000", 2024-04-01T19:31:04.262 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.4399999999999998e-07 2024-04-01T19:31:04.262 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.262 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.262 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:31:04.262 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.237674+0000", 2024-04-01T19:31:04.262 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5160000000000002e-05 2024-04-01T19:31:04.262 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.262 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.262 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:31:04.263 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.237681+0000", 2024-04-01T19:31:04.263 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7360000000000001e-06 2024-04-01T19:31:04.263 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.263 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.263 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:31:04.263 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.237688+0000", 2024-04-01T19:31:04.263 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4790000000000001e-06 2024-04-01T19:31:04.263 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.263 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.263 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:31:04.263 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.237820+0000", 2024-04-01T19:31:04.263 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013223299999999999 2024-04-01T19:31:04.263 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.263 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.263 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:31:04.264 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.237945+0000", 2024-04-01T19:31:04.264 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000124559 2024-04-01T19:31:04.264 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.264 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.264 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 1", 2024-04-01T19:31:04.264 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.238082+0000", 2024-04-01T19:31:04.264 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013793900000000001 2024-04-01T19:31:04.264 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.264 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.264 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:31:04.264 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.242141+0000", 2024-04-01T19:31:04.264 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0040583720000000002 2024-04-01T19:31:04.264 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:31:04.265 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:31:04.265 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:31:04.265 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.265 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.265 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25117.0:133276 3.3 e217/191 3:ca2c778c:::benchmark_data_smithi188_92122_object133275:head v 217'8302, mlcod=217'8299)", 2024-04-01T19:31:04.265 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:04.237721+0000", 2024-04-01T19:31:04.265 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0051544119999999997, 2024-04-01T19:31:04.265 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0055520140000000001, 2024-04-01T19:31:04.265 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:31:04.265 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:31:04.265 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:31:04.265 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:31:04.265 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.266 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:31:04.266 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.237721+0000", 2024-04-01T19:31:04.266 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:31:04.266 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.266 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.266 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:31:04.266 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.237721+0000", 2024-04-01T19:31:04.266 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:31:04.266 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.266 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.266 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:31:04.266 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.237722+0000", 2024-04-01T19:31:04.266 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.153e-06 2024-04-01T19:31:04.266 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.267 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.267 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:31:04.267 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.237756+0000", 2024-04-01T19:31:04.267 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3793e-05 2024-04-01T19:31:04.267 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.267 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.267 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:31:04.267 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.237765+0000", 2024-04-01T19:31:04.267 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.7730000000000005e-06 2024-04-01T19:31:04.267 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.267 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.267 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:31:04.267 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.237771+0000", 2024-04-01T19:31:04.268 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0530000000000003e-06 2024-04-01T19:31:04.268 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.268 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.268 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:31:04.268 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.242133+0000", 2024-04-01T19:31:04.268 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0043618750000000003 2024-04-01T19:31:04.268 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.268 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.268 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:31:04.268 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.242153+0000", 2024-04-01T19:31:04.268 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.982e-05 2024-04-01T19:31:04.268 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:31:04.268 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:31:04.268 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:31:04.269 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.269 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.269 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25117.0:133282 3.b e217/191 3:de1127d2:::benchmark_data_smithi188_92122_object133281:head v 217'8448, mlcod=217'8446)", 2024-04-01T19:31:04.269 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:04.241574+0000", 2024-04-01T19:31:04.269 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.001301466, 2024-04-01T19:31:04.269 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.001768721, 2024-04-01T19:31:04.269 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:31:04.269 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:31:04.269 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:31:04.269 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:31:04.269 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.269 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:31:04.269 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.241574+0000", 2024-04-01T19:31:04.269 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:31:04.269 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.270 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.270 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:31:04.270 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.241574+0000", 2024-04-01T19:31:04.270 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:31:04.270 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.270 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.270 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:31:04.270 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.241576+0000", 2024-04-01T19:31:04.270 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8789999999999999e-06 2024-04-01T19:31:04.270 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.270 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.270 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:31:04.270 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.241606+0000", 2024-04-01T19:31:04.271 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.0233e-05 2024-04-01T19:31:04.271 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.271 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.271 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:31:04.271 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.241618+0000", 2024-04-01T19:31:04.271 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.202e-05 2024-04-01T19:31:04.271 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.271 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.271 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:31:04.271 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.241626+0000", 2024-04-01T19:31:04.271 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5490000000000001e-06 2024-04-01T19:31:04.271 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.271 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.271 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:31:04.272 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.242162+0000", 2024-04-01T19:31:04.272 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00053630300000000002 2024-04-01T19:31:04.272 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.272 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.272 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:31:04.272 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.242182+0000", 2024-04-01T19:31:04.272 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9596e-05 2024-04-01T19:31:04.272 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:31:04.272 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:31:04.272 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:31:04.272 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.272 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.272 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:133286 3.6 3.c26ca46 (undecoded) ondisk+write+known_if_redirected e217)", 2024-04-01T19:31:04.272 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:04.242199+0000", 2024-04-01T19:31:04.273 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.00067690600000000001, 2024-04-01T19:31:04.273 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.001208839, 2024-04-01T19:31:04.273 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:31:04.273 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:31:04.273 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "queued for pg", 2024-04-01T19:31:04.273 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:31:04.273 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:31:04.273 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:31:04.273 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 133286 2024-04-01T19:31:04.273 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.273 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:31:04.273 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.273 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:31:04.273 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.242199+0000", 2024-04-01T19:31:04.274 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:31:04.274 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.274 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.274 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:31:04.274 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.242199+0000", 2024-04-01T19:31:04.274 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:31:04.274 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.274 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.274 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:31:04.274 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.242200+0000", 2024-04-01T19:31:04.274 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.792e-06 2024-04-01T19:31:04.274 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.274 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.275 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:31:04.275 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.242231+0000", 2024-04-01T19:31:04.275 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.0849999999999998e-05 2024-04-01T19:31:04.275 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.275 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.275 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:31:04.275 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.242247+0000", 2024-04-01T19:31:04.275 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5917e-05 2024-04-01T19:31:04.275 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:04.275 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:04.275 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:31:04.275 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:04.242255+0000", 2024-04-01T19:31:04.275 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.1540000000000002e-06 2024-04-01T19:31:04.275 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:31:04.276 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:31:04.276 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:31:04.276 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:31:04.276 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T19:31:04.276 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 7 2024-04-01T19:31:04.276 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:31:04.300 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:04.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:04 smithi062 ceph-mon[44211]: pgmap v642: 17 pgs: 17 active+clean; 7.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 80 MiB/s wr, 1.28k op/s 2024-04-01T19:31:04.593 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 64 16 133772 133756 130.605 82.6875 0.0115426 0.00765549 2024-04-01T19:31:04.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:04 smithi022 ceph-mon[39439]: pgmap v642: 17 pgs: 17 active+clean; 7.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 80 MiB/s wr, 1.28k op/s 2024-04-01T19:31:04.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:04 smithi188 ceph-mon[43939]: pgmap v642: 17 pgs: 17 active+clean; 7.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 80 MiB/s wr, 1.28k op/s 2024-04-01T19:31:04.688 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:31:04.691 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:04.691 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:31:04.793 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:31:04.837 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:04.871 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:31:04.875 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:04.875 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:31:04.976 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:31:05.015 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:05.040 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:31:05.043 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:05.044 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:31:05.145 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:31:05.156 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:05 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:31:05.156 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:05 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:31:05.156 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:05 smithi062 ceph-mon[44211]: osdmap e217: 12 total, 12 up, 12 in 2024-04-01T19:31:05.208 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:05.259 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_blocked_ops 2024-04-01T19:31:05.334 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:31:05.339 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:05.340 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:31:05.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:05 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:31:05.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:05 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:31:05.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:05 smithi188 ceph-mon[43939]: osdmap e217: 12 total, 12 up, 12 in 2024-04-01T19:31:05.441 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:31:05.498 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:05.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:05 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:31:05.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:05 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:31:05.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:05 smithi022 ceph-mon[39439]: osdmap e217: 12 total, 12 up, 12 in 2024-04-01T19:31:05.594 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 65 16 135087 135071 129.858 82.1875 0.0130704 0.00769943 2024-04-01T19:31:05.631 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:05.631 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:31:05.632 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:31:05.733 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:31:05.764 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:05.791 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:31:05.797 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:05.797 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:31:05.898 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:31:05.932 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:05.956 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:31:05.960 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:05.960 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:31:05.965 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:31:06.053 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:31:06.060 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:31:06.090 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:06.111 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:31:06.114 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:06.114 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:31:06.180 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:06 smithi188 ceph-mon[43939]: pgmap v644: 17 pgs: 17 active+clean; 7.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 MiB/s wr, 1.32k op/s 2024-04-01T19:31:06.180 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:06 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1279181658' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:31:06.180 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:06 smithi188 ceph-mon[43939]: from='client.35246 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:31:06.181 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:06 smithi062 ceph-mon[44211]: pgmap v644: 17 pgs: 17 active+clean; 7.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 MiB/s wr, 1.32k op/s 2024-04-01T19:31:06.181 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:06 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1279181658' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:31:06.181 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:06 smithi062 ceph-mon[44211]: from='client.35246 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:31:06.201 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:31:06.215 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:31:06.246 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:06.271 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:31:06.274 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:06.275 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:31:06.375 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:31:06.413 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:06.443 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:31:06.447 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:06.447 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:31:06.548 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:31:06.594 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 66 16 136443 136427 129.175 84.75 0.0050748 0.00774001 2024-04-01T19:31:06.597 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:06 smithi022 ceph-mon[39439]: pgmap v644: 17 pgs: 17 active+clean; 7.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 MiB/s wr, 1.32k op/s 2024-04-01T19:31:06.597 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:06 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1279181658' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:31:06.598 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:06 smithi022 ceph-mon[39439]: from='client.35246 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:31:06.602 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:06.656 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:31:06.663 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:06.663 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:31:06.764 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:31:06.799 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:06.837 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:31:06.843 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:06.843 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:31:06.944 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:31:06.973 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:07.008 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:31:07.010 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:07.011 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:31:07.112 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:31:07.165 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:07.198 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:07 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:31:07.199 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:07 smithi062 ceph-mon[44211]: from='client.35246 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:31:07.199 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:07 smithi062 ceph-mon[44211]: osdmap e218: 12 total, 12 up, 12 in 2024-04-01T19:31:07.327 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:31:07.340 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:07.341 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:31:07.341 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:07 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:31:07.341 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:07 smithi022 ceph-mon[39439]: from='client.35246 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:31:07.341 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:07 smithi022 ceph-mon[39439]: osdmap e218: 12 total, 12 up, 12 in 2024-04-01T19:31:07.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:07 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:31:07.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:07 smithi188 ceph-mon[43939]: from='client.35246 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:31:07.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:07 smithi188 ceph-mon[43939]: osdmap e218: 12 total, 12 up, 12 in 2024-04-01T19:31:07.442 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:31:07.490 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:07.594 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 67 16 137831 137815 128.542 86.75 0.00459415 0.0077782 2024-04-01T19:31:07.733 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.6 reset_purged_snaps_last 2024-04-01T19:31:07.962 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:31:07.969 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:07.970 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:31:08.071 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:31:08.109 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:08.262 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:08 smithi022 ceph-mon[39439]: pgmap v646: 17 pgs: 17 active+clean; 8.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 MiB/s wr, 1.28k op/s 2024-04-01T19:31:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:08 smithi062 ceph-mon[44211]: pgmap v646: 17 pgs: 17 active+clean; 8.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 MiB/s wr, 1.28k op/s 2024-04-01T19:31:08.594 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 68 16 139141 139125 127.855 81.875 0.00840256 0.00781992 2024-04-01T19:31:08.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:08 smithi188 ceph-mon[43939]: pgmap v646: 17 pgs: 17 active+clean; 8.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 MiB/s wr, 1.28k op/s 2024-04-01T19:31:09.123 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:31:09.594 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 69 16 140462 140446 127.199 82.5625 0.0042843 0.00785954 2024-04-01T19:31:10.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:10 smithi062 ceph-mon[44211]: pgmap v647: 17 pgs: 17 active+clean; 8.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 92 MiB/s wr, 1.48k op/s 2024-04-01T19:31:10.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:10 smithi062 ceph-mon[44211]: osdmap e219: 12 total, 12 up, 12 in 2024-04-01T19:31:10.594 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 70 16 141881 141865 126.649 88.6875 0.00459175 0.0078945 2024-04-01T19:31:10.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:10 smithi022 ceph-mon[39439]: pgmap v647: 17 pgs: 17 active+clean; 8.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 92 MiB/s wr, 1.48k op/s 2024-04-01T19:31:10.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:10 smithi022 ceph-mon[39439]: osdmap e219: 12 total, 12 up, 12 in 2024-04-01T19:31:10.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:10 smithi188 ceph-mon[43939]: pgmap v647: 17 pgs: 17 active+clean; 8.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 92 MiB/s wr, 1.48k op/s 2024-04-01T19:31:10.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:10 smithi188 ceph-mon[43939]: osdmap e219: 12 total, 12 up, 12 in 2024-04-01T19:31:11.599 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 71 16 143256 143240 126.067 85.9375 0.0141932 0.00793106 2024-04-01T19:31:12.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:12 smithi062 ceph-mon[44211]: pgmap v649: 17 pgs: 17 active+clean; 8.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 99 MiB/s wr, 1.58k op/s 2024-04-01T19:31:12.599 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 72 16 144653 144637 125.529 87.3125 0.0200462 0.00796474 2024-04-01T19:31:12.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:12 smithi022 ceph-mon[39439]: pgmap v649: 17 pgs: 17 active+clean; 8.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 99 MiB/s wr, 1.58k op/s 2024-04-01T19:31:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:12 smithi188 ceph-mon[43939]: pgmap v649: 17 pgs: 17 active+clean; 8.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 99 MiB/s wr, 1.58k op/s 2024-04-01T19:31:13.287 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:31:13.294 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:13.295 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:31:13.396 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:31:13.430 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:13.453 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:31:13.458 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:13.458 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:31:13.559 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:31:13.599 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 73 16 146074 146058 125.026 88.8125 0.00571916 0.0079969 2024-04-01T19:31:13.617 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:13.823 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:31:13.827 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:13.828 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:31:13.929 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:31:13.967 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:13.990 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:31:13.995 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:13.995 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:31:14.096 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:31:14.134 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:14.162 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:31:14.164 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:14.165 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:31:14.266 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:31:14.293 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:14 smithi022 ceph-mon[39439]: pgmap v650: 17 pgs: 17 active+clean; 8.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 MiB/s wr, 1.52k op/s 2024-04-01T19:31:14.299 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:14.321 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:31:14.330 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:14.331 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:31:14.432 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:31:14.458 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:14 smithi188 ceph-mon[43939]: pgmap v650: 17 pgs: 17 active+clean; 8.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 MiB/s wr, 1.52k op/s 2024-04-01T19:31:14.460 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:14.485 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:31:14.488 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:14.488 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:31:14.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:14 smithi062 ceph-mon[44211]: pgmap v650: 17 pgs: 17 active+clean; 8.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 MiB/s wr, 1.52k op/s 2024-04-01T19:31:14.589 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:31:14.599 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 74 16 147381 147365 124.44 81.6875 0.0110503 0.00803439 2024-04-01T19:31:14.634 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:31:14.634 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:31:14.634 INFO:teuthology.orchestra.run.smithi022.stdout: "complaint_time": 30, 2024-04-01T19:31:14.634 INFO:teuthology.orchestra.run.smithi022.stdout: "num_blocked_ops": 0 2024-04-01T19:31:14.634 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:31:14.636 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:14.860 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:31:14.866 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:14.867 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:31:14.968 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:31:15.003 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:15.038 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:31:15.040 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:15.041 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:31:15.142 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:31:15.171 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:15.208 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:31:15.211 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:15.212 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:31:15.313 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:31:15.359 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:15.391 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:31:15.395 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:15.395 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:31:15.496 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:31:15.541 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:15.572 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:31:15.575 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:15.575 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:31:15.599 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 75 16 148725 148709 123.901 84 0.00522051 0.00806949 2024-04-01T19:31:15.670 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_historic_ops 2024-04-01T19:31:15.676 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:31:15.710 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:15.738 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:31:15.743 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:15.743 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:31:15.845 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:31:15.871 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:15.895 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:31:15.898 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:15.899 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:31:15.902 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:31:15.903 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:31:15.979 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:31:15.999 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:31:16.023 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:31:16.037 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:16.056 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:31:16.067 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:31:16.073 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:16.073 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:31:16.098 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:31:16.137 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:31:16.164 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:31:16.174 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:31:16.198 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:31:16.206 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:16.227 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:31:16.229 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:16.229 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:31:16.230 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:31:16.279 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:31:16.322 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:31:16.330 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:31:16.354 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:31:16.393 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:16.407 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:31:16.424 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:31:16.424 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:31:16.424 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:31:16.424 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:31:16.424 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:31:16.424 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:31:16.424 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:31:16.424 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:31:16.425 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:31:16.425 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:31:16.425 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:31:16.425 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:31:16.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:16 smithi022 ceph-mon[39439]: pgmap v651: 17 pgs: 17 active+clean; 8.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 78 MiB/s wr, 1.24k op/s 2024-04-01T19:31:16.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:16 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:31:16.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:16 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:31:16.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:16 smithi022 ceph-mon[39439]: osdmap e220: 12 total, 12 up, 12 in 2024-04-01T19:31:16.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:16 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3744998427' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:31:16.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:16 smithi062 ceph-mon[44211]: pgmap v651: 17 pgs: 17 active+clean; 8.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 78 MiB/s wr, 1.24k op/s 2024-04-01T19:31:16.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:16 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:31:16.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:16 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:31:16.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:16 smithi062 ceph-mon[44211]: osdmap e220: 12 total, 12 up, 12 in 2024-04-01T19:31:16.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:16 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3744998427' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:31:16.599 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 76 16 149833 149817 123.182 69.25 0.0102744 0.00811616 2024-04-01T19:31:16.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:16 smithi188 ceph-mon[43939]: pgmap v651: 17 pgs: 17 active+clean; 8.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 78 MiB/s wr, 1.24k op/s 2024-04-01T19:31:16.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:16 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:31:16.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:16 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:31:16.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:16 smithi188 ceph-mon[43939]: osdmap e220: 12 total, 12 up, 12 in 2024-04-01T19:31:16.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:16 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3744998427' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:31:17.251 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.251 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.251 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.251 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.251 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.251 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.251 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.252 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.252 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.252 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.252 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.252 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.599 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 77 16 151196 151180 122.689 85.1875 0.00947133 0.00814937 2024-04-01T19:31:17.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:17.655 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:31:17.658 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:17.658 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:31:17.759 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:31:17.809 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:18 smithi062 ceph-mon[44211]: pgmap v653: 17 pgs: 17 active+clean; 9.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 86 MiB/s wr, 1.38k op/s 2024-04-01T19:31:18.599 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 78 16 152506 152490 122.165 81.875 0.0210623 0.0081844 2024-04-01T19:31:18.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:18 smithi022 ceph-mon[39439]: pgmap v653: 17 pgs: 17 active+clean; 9.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 86 MiB/s wr, 1.38k op/s 2024-04-01T19:31:18.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:18 smithi188 ceph-mon[43939]: pgmap v653: 17 pgs: 17 active+clean; 9.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 86 MiB/s wr, 1.38k op/s 2024-04-01T19:31:19.212 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:31:19.222 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:19.223 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:31:19.324 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:31:19.358 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:19.384 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:31:19.386 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:19.387 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:31:19.488 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:31:19.538 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:19.599 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 79 16 153782 153766 121.628 79.75 0.00386721 0.00822018 2024-04-01T19:31:20.003 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:31:20.034 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:31:20.045 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:20.045 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:31:20.146 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:31:20.188 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:20.258 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:31:20.262 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:20 smithi022 ceph-mon[39439]: pgmap v654: 17 pgs: 17 active+clean; 9.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 MiB/s wr, 1.43k op/s 2024-04-01T19:31:20.262 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:20 smithi022 ceph-mon[39439]: osdmap e221: 12 total, 12 up, 12 in 2024-04-01T19:31:20.262 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:20 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2166127710' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:31:20.262 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:20 smithi022 ceph-mon[39439]: from='client.25231 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:31:20.266 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:20.266 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:31:20.367 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:31:20.410 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:20.538 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:31:20.540 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:20.541 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:31:20.600 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:31:20.602720 min lat: 0.00100536 max lat: 2.32602 avg lat: 0.00825741 2024-04-01T19:31:20.600 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:31:20.600 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 80 16 155020 155004 121.075 77.375 0.00452512 0.00825741 2024-04-01T19:31:20.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:20 smithi188 ceph-mon[43939]: pgmap v654: 17 pgs: 17 active+clean; 9.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 MiB/s wr, 1.43k op/s 2024-04-01T19:31:20.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:20 smithi188 ceph-mon[43939]: osdmap e221: 12 total, 12 up, 12 in 2024-04-01T19:31:20.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:20 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2166127710' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:31:20.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:20 smithi188 ceph-mon[43939]: from='client.25231 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:31:20.642 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:31:20.680 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:20.706 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:31:20.716 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:20.716 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:31:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:20 smithi062 ceph-mon[44211]: pgmap v654: 17 pgs: 17 active+clean; 9.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 MiB/s wr, 1.43k op/s 2024-04-01T19:31:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:20 smithi062 ceph-mon[44211]: osdmap e221: 12 total, 12 up, 12 in 2024-04-01T19:31:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:20 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2166127710' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:31:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:20 smithi062 ceph-mon[44211]: from='client.25231 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:31:20.817 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:31:20.854 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:20.874 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:31:20.881 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:31:20.883 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:31:20.886 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:20.886 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:31:20.987 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:31:21.019 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:21.048 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:31:21.054 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:21.054 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:31:21.156 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:31:21.215 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:21.267 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:21 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:31:21.268 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:21 smithi188 ceph-mon[43939]: from='client.25231 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:31:21.268 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:21 smithi188 ceph-mon[43939]: osdmap e222: 12 total, 12 up, 12 in 2024-04-01T19:31:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:31:21.324 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:21.324 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:31:21.425 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:31:21.458 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:21.482 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:31:21.485 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:21.485 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:31:21.586 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:31:21.600 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 81 15 156280 156265 120.553 78.8125 0.00622081 0.00829425 2024-04-01T19:31:21.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:21 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:31:21.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:21 smithi022 ceph-mon[39439]: from='client.25231 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:31:21.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:21 smithi022 ceph-mon[39439]: osdmap e222: 12 total, 12 up, 12 in 2024-04-01T19:31:21.642 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:21.684 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:31:21.691 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:21.692 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:31:21.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:21 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:31:21.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:21 smithi062 ceph-mon[44211]: from='client.25231 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:31:21.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:21 smithi062 ceph-mon[44211]: osdmap e222: 12 total, 12 up, 12 in 2024-04-01T19:31:21.793 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:31:21.840 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:21.974 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:31:21.979 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:21.979 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:31:22.080 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:31:22.130 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:22.156 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:31:22.160 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:22.160 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:31:22.261 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:31:22.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:22 smithi022 ceph-mon[39439]: pgmap v656: 17 pgs: 17 active+clean; 9.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 MiB/s wr, 1.40k op/s 2024-04-01T19:31:22.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:22 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T19:31:22.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:22 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T19:31:22.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:22 smithi022 ceph-mon[39439]: 3.3 scrub starts 2024-04-01T19:31:22.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:22 smithi022 ceph-mon[39439]: 3.5 scrub starts 2024-04-01T19:31:22.304 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:22.424 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:31:22.444 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:22.445 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:31:22.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:22 smithi062 ceph-mon[44211]: pgmap v656: 17 pgs: 17 active+clean; 9.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 MiB/s wr, 1.40k op/s 2024-04-01T19:31:22.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:22 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T19:31:22.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:22 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T19:31:22.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:22 smithi062 ceph-mon[44211]: 3.3 scrub starts 2024-04-01T19:31:22.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:22 smithi062 ceph-mon[44211]: 3.5 scrub starts 2024-04-01T19:31:22.546 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:31:22.600 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 82 16 157333 157317 119.885 65.75 0.00713687 0.00833979 2024-04-01T19:31:22.611 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:22.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:22 smithi188 ceph-mon[43939]: pgmap v656: 17 pgs: 17 active+clean; 9.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 MiB/s wr, 1.40k op/s 2024-04-01T19:31:22.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:22 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T19:31:22.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:22 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T19:31:22.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:22 smithi188 ceph-mon[43939]: 3.3 scrub starts 2024-04-01T19:31:22.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:22 smithi188 ceph-mon[43939]: 3.5 scrub starts 2024-04-01T19:31:22.834 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:31:22.852 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:22.853 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:31:22.868 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:31:22.954 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:31:23.010 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:23.040 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:31:23.043 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:23.043 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:31:23.145 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:31:23.177 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:23.198 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:31:23.200 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:23.200 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:31:23.301 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:31:23.348 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:23.466 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:31:23.482 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:23.483 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:31:23.517 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.7 reset_purged_snaps_last 2024-04-01T19:31:23.583 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:31:23.600 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 83 16 158268 158252 119.145 58.4375 0.00895449 0.0083912 2024-04-01T19:31:23.606 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:23 smithi022 ceph-mon[39439]: 3.f scrub starts 2024-04-01T19:31:23.607 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:23 smithi022 ceph-mon[39439]: 3.4 scrub starts 2024-04-01T19:31:23.607 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:23 smithi022 ceph-mon[39439]: 3.6 scrub starts 2024-04-01T19:31:23.609 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:23 smithi188 ceph-mon[43939]: 3.f scrub starts 2024-04-01T19:31:23.609 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:23 smithi188 ceph-mon[43939]: 3.4 scrub starts 2024-04-01T19:31:23.609 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:23 smithi188 ceph-mon[43939]: 3.6 scrub starts 2024-04-01T19:31:23.611 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:23.633 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:31:23.637 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:23.637 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:31:23.712 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:31:23.738 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:31:23.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:23 smithi062 ceph-mon[44211]: 3.f scrub starts 2024-04-01T19:31:23.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:23 smithi062 ceph-mon[44211]: 3.4 scrub starts 2024-04-01T19:31:23.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:23 smithi062 ceph-mon[44211]: 3.6 scrub starts 2024-04-01T19:31:23.768 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:23.791 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:31:23.797 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:23.798 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:31:23.899 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:31:23.926 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:23.950 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:31:23.954 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:23.955 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:31:24.055 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:31:24.084 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:24.107 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:31:24.110 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:24.110 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:31:24.211 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:31:24.263 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:24.396 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:31:24.403 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:24.403 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:31:24.504 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:31:24.538 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:24.557 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:31:24.559 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:24 smithi188 ceph-mon[43939]: pgmap v658: 17 pgs: 17 active+clean; 9.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s wr, 1.21k op/s 2024-04-01T19:31:24.559 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:24 smithi188 ceph-mon[43939]: 3.d scrub starts 2024-04-01T19:31:24.559 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:24 smithi188 ceph-mon[43939]: 3.f scrub ok 2024-04-01T19:31:24.559 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:24 smithi188 ceph-mon[43939]: 3.3 scrub ok 2024-04-01T19:31:24.559 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:24 smithi188 ceph-mon[43939]: 3.5 scrub ok 2024-04-01T19:31:24.560 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:24.560 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:31:24.600 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 84 16 159191 159175 118.413 57.6875 0.0154374 0.00844345 2024-04-01T19:31:24.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:24 smithi022 ceph-mon[39439]: pgmap v658: 17 pgs: 17 active+clean; 9.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s wr, 1.21k op/s 2024-04-01T19:31:24.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:24 smithi022 ceph-mon[39439]: 3.d scrub starts 2024-04-01T19:31:24.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:24 smithi022 ceph-mon[39439]: 3.f scrub ok 2024-04-01T19:31:24.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:24 smithi022 ceph-mon[39439]: 3.3 scrub ok 2024-04-01T19:31:24.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:24 smithi022 ceph-mon[39439]: 3.5 scrub ok 2024-04-01T19:31:24.661 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:31:24.691 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:24.720 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:31:24.725 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:24.725 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:31:24.750 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:31:24.750 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:31:24.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:24 smithi062 ceph-mon[44211]: pgmap v658: 17 pgs: 17 active+clean; 9.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s wr, 1.21k op/s 2024-04-01T19:31:24.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:24 smithi062 ceph-mon[44211]: 3.d scrub starts 2024-04-01T19:31:24.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:24 smithi062 ceph-mon[44211]: 3.f scrub ok 2024-04-01T19:31:24.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:24 smithi062 ceph-mon[44211]: 3.3 scrub ok 2024-04-01T19:31:24.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:24 smithi062 ceph-mon[44211]: 3.5 scrub ok 2024-04-01T19:31:24.826 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:31:24.869 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:24.896 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:31:24.899 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:24.899 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:31:25.000 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:31:25.037 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:25.070 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:31:25.075 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:25.075 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:31:25.176 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:31:25.209 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:25.231 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:31:25.234 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:25.234 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:31:25.335 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:31:25.371 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:25.401 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:31:25.404 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:25.405 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:31:25.506 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:31:25.548 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:25.574 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:31:25.576 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:25 smithi062 ceph-mon[44211]: 3.4 scrub ok 2024-04-01T19:31:25.576 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:25 smithi062 ceph-mon[44211]: 3.1 scrub starts 2024-04-01T19:31:25.576 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:25 smithi062 ceph-mon[44211]: 3.6 scrub ok 2024-04-01T19:31:25.576 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:25 smithi062 ceph-mon[44211]: osdmap e223: 12 total, 12 up, 12 in 2024-04-01T19:31:25.576 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:25 smithi062 ceph-mon[44211]: 3.d scrub ok 2024-04-01T19:31:25.577 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:25.577 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:31:25.600 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 85 16 160332 160316 117.859 71.3125 0.00985126 0.00848338 2024-04-01T19:31:25.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:25 smithi022 ceph-mon[39439]: 3.4 scrub ok 2024-04-01T19:31:25.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:25 smithi022 ceph-mon[39439]: 3.1 scrub starts 2024-04-01T19:31:25.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:25 smithi022 ceph-mon[39439]: 3.6 scrub ok 2024-04-01T19:31:25.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:25 smithi022 ceph-mon[39439]: osdmap e223: 12 total, 12 up, 12 in 2024-04-01T19:31:25.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:25 smithi022 ceph-mon[39439]: 3.d scrub ok 2024-04-01T19:31:25.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:25 smithi188 ceph-mon[43939]: 3.4 scrub ok 2024-04-01T19:31:25.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:25 smithi188 ceph-mon[43939]: 3.1 scrub starts 2024-04-01T19:31:25.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:25 smithi188 ceph-mon[43939]: 3.6 scrub ok 2024-04-01T19:31:25.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:25 smithi188 ceph-mon[43939]: osdmap e223: 12 total, 12 up, 12 in 2024-04-01T19:31:25.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:25 smithi188 ceph-mon[43939]: 3.d scrub ok 2024-04-01T19:31:25.678 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:31:25.732 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:26.415 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_ops_in_flight 2024-04-01T19:31:26.464 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:31:26.464 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:31:26.464 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:31:26.464 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:31:26.465 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:31:26.465 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:31:26.465 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:31:26.465 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:31:26.469 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:31:26.505 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:31:26.514 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:26.514 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:31:26.518 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:31:26.529 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:31:26.539 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:31:26.582 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:31:26.600 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 86 16 161336 161320 117.218 62.75 0.014769 0.00852971 2024-04-01T19:31:26.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:26 smithi022 ceph-mon[39439]: pgmap v659: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 MiB/s wr, 1.12k op/s 2024-04-01T19:31:26.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:26 smithi022 ceph-mon[39439]: 3.9 scrub starts 2024-04-01T19:31:26.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:26 smithi022 ceph-mon[39439]: 3.c scrub starts 2024-04-01T19:31:26.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:26 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2040013601' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:31:26.615 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:31:26.617 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:31:26.623 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:31:26.623 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:31:26.623 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:31:26.624 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:31:26.624 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:31:26.624 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:31:26.624 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:31:26.624 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:31:26.624 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:31:26.624 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:31:26.624 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:31:26.624 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:31:26.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:26 smithi188 ceph-mon[43939]: pgmap v659: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 MiB/s wr, 1.12k op/s 2024-04-01T19:31:26.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:26 smithi188 ceph-mon[43939]: 3.9 scrub starts 2024-04-01T19:31:26.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:26 smithi188 ceph-mon[43939]: 3.c scrub starts 2024-04-01T19:31:26.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:26 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2040013601' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:31:26.658 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:26.684 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:31:26.690 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:26.690 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:31:26.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:26 smithi062 ceph-mon[44211]: pgmap v659: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 MiB/s wr, 1.12k op/s 2024-04-01T19:31:26.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:26 smithi062 ceph-mon[44211]: 3.9 scrub starts 2024-04-01T19:31:26.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:26 smithi062 ceph-mon[44211]: 3.c scrub starts 2024-04-01T19:31:26.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:26 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2040013601' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:31:26.791 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:31:26.833 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:26.961 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:31:26.967 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:26.967 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:31:27.068 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:31:27.124 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:27.189 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:31:27.196 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:27.196 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:31:27.297 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:31:27.335 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:27.374 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:31:27.384 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:27.384 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:31:27.485 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:31:27.548 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:27 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:31:27.549 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:27 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:31:27.549 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.549 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.549 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.549 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.549 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.549 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.549 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:27 smithi022 ceph-mon[39439]: osdmap e224: 12 total, 12 up, 12 in 2024-04-01T19:31:27.549 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.549 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.549 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.549 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.549 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:27 smithi022 ceph-mon[39439]: 3.1 scrub ok 2024-04-01T19:31:27.549 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.549 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.559 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:27.598 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:31:27.600 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 87 16 162402 162386 116.637 66.625 0.0107852 0.00857154 2024-04-01T19:31:27.601 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:27.602 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:31:27.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:27 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:31:27.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:27 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:31:27.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:27 smithi188 ceph-mon[43939]: osdmap e224: 12 total, 12 up, 12 in 2024-04-01T19:31:27.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:27 smithi188 ceph-mon[43939]: 3.1 scrub ok 2024-04-01T19:31:27.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.703 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:31:27.739 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:27 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:31:27.739 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:27 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:31:27.739 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.739 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.739 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.739 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.739 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.739 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.739 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:27 smithi062 ceph-mon[44211]: osdmap e224: 12 total, 12 up, 12 in 2024-04-01T19:31:27.739 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.740 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.740 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.740 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.740 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:27 smithi062 ceph-mon[44211]: 3.1 scrub ok 2024-04-01T19:31:27.740 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.740 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:27.742 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:27.765 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:31:27.771 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:27.771 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:31:27.872 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:31:27.907 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:27.927 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:31:27.931 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:27.932 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:31:28.033 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:31:28.063 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:28.090 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:31:28.098 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:28.098 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:31:28.199 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:31:28.242 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:28.267 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:31:28.274 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:28.275 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:31:28.376 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:31:28.414 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:28.454 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:31:28.457 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:28.458 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:31:28.559 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:31:28.600 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 88 16 163487 163471 116.082 67.8125 0.0112848 0.00861347 2024-04-01T19:31:28.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:28 smithi022 ceph-mon[39439]: pgmap v662: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s wr, 1.00k op/s 2024-04-01T19:31:28.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:28 smithi022 ceph-mon[39439]: 3.9 scrub ok 2024-04-01T19:31:28.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:28 smithi022 ceph-mon[39439]: 3.0 scrub starts 2024-04-01T19:31:28.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:28 smithi022 ceph-mon[39439]: 3.b scrub starts 2024-04-01T19:31:28.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:28 smithi022 ceph-mon[39439]: 3.a scrub starts 2024-04-01T19:31:28.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:28 smithi022 ceph-mon[39439]: 3.c scrub ok 2024-04-01T19:31:28.605 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:28 smithi188 ceph-mon[43939]: pgmap v662: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s wr, 1.00k op/s 2024-04-01T19:31:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:28 smithi188 ceph-mon[43939]: 3.9 scrub ok 2024-04-01T19:31:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:28 smithi188 ceph-mon[43939]: 3.0 scrub starts 2024-04-01T19:31:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:28 smithi188 ceph-mon[43939]: 3.b scrub starts 2024-04-01T19:31:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:28 smithi188 ceph-mon[43939]: 3.a scrub starts 2024-04-01T19:31:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:28 smithi188 ceph-mon[43939]: 3.c scrub ok 2024-04-01T19:31:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:28 smithi062 ceph-mon[44211]: pgmap v662: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s wr, 1.00k op/s 2024-04-01T19:31:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:28 smithi062 ceph-mon[44211]: 3.9 scrub ok 2024-04-01T19:31:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:28 smithi062 ceph-mon[44211]: 3.0 scrub starts 2024-04-01T19:31:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:28 smithi062 ceph-mon[44211]: 3.b scrub starts 2024-04-01T19:31:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:28 smithi062 ceph-mon[44211]: 3.a scrub starts 2024-04-01T19:31:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:28 smithi062 ceph-mon[44211]: 3.c scrub ok 2024-04-01T19:31:28.859 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:31:28.862 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:28.863 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:31:28.964 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:31:28.994 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:29.016 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:31:29.021 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:29.021 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:31:29.122 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:31:29.164 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:29.199 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:31:29.203 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:29.203 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:31:29.304 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:31:29.335 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:29.357 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:31:29.360 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:29.360 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:31:29.453 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:29 smithi022 ceph-mon[39439]: 3.0 scrub ok 2024-04-01T19:31:29.461 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:31:29.514 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:29.561 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:31:29.570 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:29.570 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:31:29.600 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 89 16 164553 164537 115.526 66.625 0.0134142 0.00865442 2024-04-01T19:31:29.656 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:31:29.671 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:31:29.704 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:29 smithi188 ceph-mon[43939]: 3.0 scrub ok 2024-04-01T19:31:29.706 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:29.739 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:31:29.743 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:29.743 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:31:29.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:29 smithi062 ceph-mon[44211]: 3.0 scrub ok 2024-04-01T19:31:29.844 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:31:29.890 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:29.915 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:31:29.919 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:29.920 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:31:30.021 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:31:30.056 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:30.079 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:31:30.089 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:30.089 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:31:30.190 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:31:30.235 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:30.302 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:31:30.309 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:31:30.312 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:30.313 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:31:30.414 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:31:30.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:30 smithi022 ceph-mon[39439]: pgmap v663: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s wr, 1k op/s 2024-04-01T19:31:30.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:30 smithi022 ceph-mon[39439]: 3.a scrub ok 2024-04-01T19:31:30.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:30 smithi022 ceph-mon[39439]: 3.8 scrub starts 2024-04-01T19:31:30.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:30 smithi022 ceph-mon[39439]: 3.2 scrub starts 2024-04-01T19:31:30.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:30 smithi022 ceph-mon[39439]: 3.b scrub ok 2024-04-01T19:31:30.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:30 smithi022 ceph-mon[39439]: osdmap e225: 12 total, 12 up, 12 in 2024-04-01T19:31:30.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:30 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3494367892' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:31:30.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:30 smithi022 ceph-mon[39439]: from='client.25240 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:31:30.464 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:30.600 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Total time run: 90.0135 2024-04-01T19:31:30.601 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Total writes made: 165588 2024-04-01T19:31:30.601 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Write size: 65536 2024-04-01T19:31:30.601 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Object size: 65536 2024-04-01T19:31:30.601 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Bandwidth (MB/sec): 114.974 2024-04-01T19:31:30.601 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Stddev Bandwidth: 62.8096 2024-04-01T19:31:30.601 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Max bandwidth (MB/sec): 383.875 2024-04-01T19:31:30.601 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Min bandwidth (MB/sec): 0 2024-04-01T19:31:30.601 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Average IOPS: 1839 2024-04-01T19:31:30.601 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Stddev IOPS: 1004.95 2024-04-01T19:31:30.601 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Max IOPS: 6142 2024-04-01T19:31:30.601 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Min IOPS: 0 2024-04-01T19:31:30.601 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Average Latency(s): 0.00869699 2024-04-01T19:31:30.602 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Stddev Latency(s): 0.0244775 2024-04-01T19:31:30.602 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Max latency(s): 2.32602 2024-04-01T19:31:30.602 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Min latency(s): 0.00100536 2024-04-01T19:31:30.608 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Cleaning up (deleting benchmark objects) 2024-04-01T19:31:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:30 smithi062 ceph-mon[44211]: pgmap v663: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s wr, 1k op/s 2024-04-01T19:31:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:30 smithi062 ceph-mon[44211]: 3.a scrub ok 2024-04-01T19:31:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:30 smithi062 ceph-mon[44211]: 3.8 scrub starts 2024-04-01T19:31:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:30 smithi062 ceph-mon[44211]: 3.2 scrub starts 2024-04-01T19:31:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:30 smithi062 ceph-mon[44211]: 3.b scrub ok 2024-04-01T19:31:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:30 smithi062 ceph-mon[44211]: osdmap e225: 12 total, 12 up, 12 in 2024-04-01T19:31:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:30 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3494367892' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:31:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:30 smithi062 ceph-mon[44211]: from='client.25240 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:31:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:30 smithi188 ceph-mon[43939]: pgmap v663: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s wr, 1k op/s 2024-04-01T19:31:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:30 smithi188 ceph-mon[43939]: 3.a scrub ok 2024-04-01T19:31:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:30 smithi188 ceph-mon[43939]: 3.8 scrub starts 2024-04-01T19:31:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:30 smithi188 ceph-mon[43939]: 3.2 scrub starts 2024-04-01T19:31:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:30 smithi188 ceph-mon[43939]: 3.b scrub ok 2024-04-01T19:31:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:30 smithi188 ceph-mon[43939]: osdmap e225: 12 total, 12 up, 12 in 2024-04-01T19:31:30.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:30 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3494367892' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:31:30.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:30 smithi188 ceph-mon[43939]: from='client.25240 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:31:30.906 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:31:31.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:31 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:31:31.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:31 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:31:31.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:31 smithi062 ceph-mon[44211]: from='client.25240 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:31:31.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:31 smithi062 ceph-mon[44211]: osdmap e226: 12 total, 12 up, 12 in 2024-04-01T19:31:31.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:31 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:31:31.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:31 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:31:31.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:31 smithi022 ceph-mon[39439]: from='client.25240 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:31:31.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:31 smithi022 ceph-mon[39439]: osdmap e226: 12 total, 12 up, 12 in 2024-04-01T19:31:31.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:31 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:31:31.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:31 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:31:31.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:31 smithi188 ceph-mon[43939]: from='client.25240 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:31:31.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:31 smithi188 ceph-mon[43939]: osdmap e226: 12 total, 12 up, 12 in 2024-04-01T19:31:32.731 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:32 smithi022 ceph-mon[39439]: pgmap v665: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 82 MiB/s wr, 1.32k op/s 2024-04-01T19:31:32.731 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:32 smithi022 ceph-mon[39439]: 3.8 scrub ok 2024-04-01T19:31:32.731 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:32 smithi022 ceph-mon[39439]: 3.2 scrub ok 2024-04-01T19:31:32.732 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:31:32.741 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:32.741 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:31:32.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:32 smithi062 ceph-mon[44211]: pgmap v665: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 82 MiB/s wr, 1.32k op/s 2024-04-01T19:31:32.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:32 smithi062 ceph-mon[44211]: 3.8 scrub ok 2024-04-01T19:31:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:32 smithi062 ceph-mon[44211]: 3.2 scrub ok 2024-04-01T19:31:32.842 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:31:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:32 smithi188 ceph-mon[43939]: pgmap v665: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 82 MiB/s wr, 1.32k op/s 2024-04-01T19:31:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:32 smithi188 ceph-mon[43939]: 3.8 scrub ok 2024-04-01T19:31:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:32 smithi188 ceph-mon[43939]: 3.2 scrub ok 2024-04-01T19:31:32.881 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:32.906 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:31:32.909 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:32.910 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:31:33.011 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:31:33.043 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:33.073 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:31:33.078 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:33.078 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:31:33.179 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:31:33.211 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:33.243 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:31:33.246 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:33.246 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:31:33.347 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:31:33.386 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:33.414 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:31:33.416 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:33.417 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:31:33.517 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:31:33.544 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:33 smithi188 ceph-mon[43939]: 3.7 scrub starts 2024-04-01T19:31:33.546 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:33.568 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:31:33.575 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:33.575 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:31:33.677 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:31:33.735 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:33 smithi022 ceph-mon[39439]: 3.7 scrub starts 2024-04-01T19:31:33.741 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:33.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:33 smithi062 ceph-mon[44211]: 3.7 scrub starts 2024-04-01T19:31:34.758 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:31:34.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:34 smithi062 ceph-mon[44211]: pgmap v667: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 58 MiB/s wr, 1.03k op/s 2024-04-01T19:31:34.793 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:34 smithi022 ceph-mon[39439]: pgmap v667: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 58 MiB/s wr, 1.03k op/s 2024-04-01T19:31:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:34 smithi188 ceph-mon[43939]: pgmap v667: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 58 MiB/s wr, 1.03k op/s 2024-04-01T19:31:35.306 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:31:35.310 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:35.310 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:31:35.311 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:31:35.360 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.9 reset_purged_snaps_last 2024-04-01T19:31:35.412 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:31:35.457 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:35.491 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:31:35.494 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:35.495 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:31:35.595 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:31:35.649 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:35.691 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:31:35.695 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:35.695 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:31:35.796 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:31:35.827 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:35.858 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:31:35.864 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:35.865 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:31:35.964 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:31:35.965 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:31:35.995 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:31:35.995 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:31:35.995 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:35.995 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25117.0:172233 3.6 e227/191 3:6cd696db:::benchmark_data_smithi188_92122_object6642:head v 227'10761, mlcod=227'10759)", 2024-04-01T19:31:35.996 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:35.993572+0000", 2024-04-01T19:31:35.996 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0027460750000000002, 2024-04-01T19:31:35.996 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.002776195, 2024-04-01T19:31:35.996 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:31:35.996 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:31:35.996 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:31:35.996 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:31:35.996 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:35.996 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:31:35.996 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.993572+0000", 2024-04-01T19:31:35.996 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:31:35.996 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:35.996 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:35.996 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:31:35.997 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.993572+0000", 2024-04-01T19:31:35.997 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:31:35.997 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:35.997 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:35.997 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:31:35.997 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.993575+0000", 2024-04-01T19:31:35.997 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2589999999999999e-06 2024-04-01T19:31:35.997 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:35.997 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:35.997 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:31:35.997 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.993586+0000", 2024-04-01T19:31:35.997 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1531e-05 2024-04-01T19:31:35.998 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:35.998 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:35.998 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:31:35.998 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.993606+0000", 2024-04-01T19:31:35.998 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9287999999999999e-05 2024-04-01T19:31:35.998 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:35.998 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:35.998 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:31:35.998 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.993618+0000", 2024-04-01T19:31:35.998 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2627e-05 2024-04-01T19:31:35.998 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:35.998 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:35.998 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:31:35.999 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.993684+0000", 2024-04-01T19:31:35.999 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5821999999999994e-05 2024-04-01T19:31:35.999 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:35.999 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:35.999 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:31:35.999 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.993714+0000", 2024-04-01T19:31:35.999 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.0108e-05 2024-04-01T19:31:35.999 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:31:35.999 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:31:35.999 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:31:35.999 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:35.999 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:35.999 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25117.0:172239 3.6 e227/191)", 2024-04-01T19:31:36.000 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:35.993639+0000", 2024-04-01T19:31:36.000 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0026800090000000001, 2024-04-01T19:31:36.000 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00275326, 2024-04-01T19:31:36.000 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:31:36.000 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:31:36.000 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "queued for pg", 2024-04-01T19:31:36.000 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:31:36.000 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:36.000 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:31:36.000 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.993639+0000", 2024-04-01T19:31:36.000 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:31:36.000 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:36.000 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:36.001 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:31:36.001 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.993639+0000", 2024-04-01T19:31:36.001 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:31:36.001 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:36.001 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:36.001 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:31:36.001 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.993639+0000", 2024-04-01T19:31:36.001 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5899999999999996e-07 2024-04-01T19:31:36.001 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:36.001 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:36.001 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:31:36.001 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.993644+0000", 2024-04-01T19:31:36.001 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0520000000000001e-06 2024-04-01T19:31:36.002 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:36.002 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:36.002 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:31:36.002 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.993649+0000", 2024-04-01T19:31:36.002 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9729999999999997e-06 2024-04-01T19:31:36.002 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:36.002 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:36.005 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:31:36.005 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.993654+0000", 2024-04-01T19:31:36.005 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6970000000000001e-06 2024-04-01T19:31:36.005 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:31:36.005 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:31:36.005 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:31:36.005 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:36.005 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:36.006 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:172243 3.4 3:2e117699:::benchmark_data_smithi188_92122_object6652:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-04-01T19:31:36.006 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:35.994622+0000", 2024-04-01T19:31:36.006 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.001696457, 2024-04-01T19:31:36.006 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.001803848, 2024-04-01T19:31:36.006 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:31:36.006 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:31:36.006 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:31:36.006 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:31:36.006 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:31:36.006 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:31:36.006 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 172243 2024-04-01T19:31:36.006 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:36.006 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:31:36.006 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:36.007 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:31:36.007 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.994622+0000", 2024-04-01T19:31:36.007 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:31:36.007 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:36.007 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:36.007 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:31:36.007 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.994622+0000", 2024-04-01T19:31:36.007 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:31:36.007 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:36.007 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:36.007 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:31:36.007 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.994624+0000", 2024-04-01T19:31:36.007 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.531e-06 2024-04-01T19:31:36.007 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:36.008 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:36.008 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:31:36.008 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.994628+0000", 2024-04-01T19:31:36.008 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9940000000000002e-06 2024-04-01T19:31:36.008 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:36.008 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:36.008 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:31:36.008 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.994635+0000", 2024-04-01T19:31:36.008 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0090000000000001e-06 2024-04-01T19:31:36.008 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:36.008 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:36.008 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:31:36.008 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.994640+0000", 2024-04-01T19:31:36.008 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2560000000000002e-06 2024-04-01T19:31:36.009 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:36.009 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:36.009 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:31:36.009 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.994944+0000", 2024-04-01T19:31:36.009 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00030453300000000001 2024-04-01T19:31:36.009 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:36.009 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:36.009 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:31:36.009 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.995050+0000", 2024-04-01T19:31:36.009 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00010521199999999999 2024-04-01T19:31:36.009 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:36.009 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:36.009 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 11", 2024-04-01T19:31:36.009 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.995149+0000", 2024-04-01T19:31:36.009 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.9674999999999997e-05 2024-04-01T19:31:36.010 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:31:36.010 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:31:36.010 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:31:36.010 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:36.010 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:36.010 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:172247 3.4 3.13b35f44 (undecoded) ondisk+write+known_if_redirected e227)", 2024-04-01T19:31:36.010 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:35.994646+0000", 2024-04-01T19:31:36.010 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.001672109, 2024-04-01T19:31:36.010 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0018235479999999999, 2024-04-01T19:31:36.010 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:31:36.010 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:31:36.010 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "queued for pg", 2024-04-01T19:31:36.010 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:31:36.011 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:31:36.011 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:31:36.011 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 172247 2024-04-01T19:31:36.011 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:36.011 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:31:36.011 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:36.011 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:31:36.011 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.994646+0000", 2024-04-01T19:31:36.011 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:31:36.011 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:36.011 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:36.011 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:31:36.011 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.994646+0000", 2024-04-01T19:31:36.011 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:31:36.012 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:36.012 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:36.012 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:31:36.012 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.994647+0000", 2024-04-01T19:31:36.012 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.3000000000000001e-07 2024-04-01T19:31:36.012 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:36.012 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:36.012 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:31:36.012 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.994649+0000", 2024-04-01T19:31:36.012 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9800000000000001e-06 2024-04-01T19:31:36.012 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:36.012 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:36.012 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:31:36.012 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.994653+0000", 2024-04-01T19:31:36.013 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4449999999999998e-06 2024-04-01T19:31:36.013 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:31:36.013 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:31:36.013 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:31:36.013 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:35.994658+0000", 2024-04-01T19:31:36.013 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4560000000000002e-06 2024-04-01T19:31:36.013 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:31:36.013 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:31:36.013 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:31:36.013 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:31:36.013 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T19:31:36.013 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 4 2024-04-01T19:31:36.013 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:31:36.014 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:36.021 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:35 smithi022 ceph-mon[39439]: 3.7 scrub ok 2024-04-01T19:31:36.021 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:35 smithi022 ceph-mon[39439]: pgmap v668: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s rd, 50 MiB/s wr, 1.01k op/s 2024-04-01T19:31:36.021 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:35 smithi022 ceph-mon[39439]: osdmap e227: 12 total, 12 up, 12 in 2024-04-01T19:31:36.021 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:35 smithi022 ceph-mon[39439]: 3.e scrub starts 2024-04-01T19:31:36.022 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:31:36.025 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:36.025 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:31:36.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:35 smithi188 ceph-mon[43939]: 3.7 scrub ok 2024-04-01T19:31:36.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:35 smithi188 ceph-mon[43939]: pgmap v668: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s rd, 50 MiB/s wr, 1.01k op/s 2024-04-01T19:31:36.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:35 smithi188 ceph-mon[43939]: osdmap e227: 12 total, 12 up, 12 in 2024-04-01T19:31:36.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:35 smithi188 ceph-mon[43939]: 3.e scrub starts 2024-04-01T19:31:36.126 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:31:36.165 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:35 smithi062 ceph-mon[44211]: 3.7 scrub ok 2024-04-01T19:31:36.165 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:35 smithi062 ceph-mon[44211]: pgmap v668: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s rd, 50 MiB/s wr, 1.01k op/s 2024-04-01T19:31:36.166 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:35 smithi062 ceph-mon[44211]: osdmap e227: 12 total, 12 up, 12 in 2024-04-01T19:31:36.166 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:35 smithi062 ceph-mon[44211]: 3.e scrub starts 2024-04-01T19:31:36.171 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:36.194 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:31:36.200 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:36.200 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:31:36.301 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:31:36.354 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:36.493 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:31:36.499 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:36.499 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:31:36.600 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:31:36.638 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:36.663 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:31:36.666 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:36.666 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:31:36.767 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:31:36.816 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:37.209 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:36 smithi022 ceph-mon[39439]: 3.e scrub ok 2024-04-01T19:31:37.242 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_blocked_ops 2024-04-01T19:31:37.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:36 smithi062 ceph-mon[44211]: 3.e scrub ok 2024-04-01T19:31:37.277 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:31:37.281 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:37.281 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:31:37.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:36 smithi188 ceph-mon[43939]: 3.e scrub ok 2024-04-01T19:31:37.382 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:31:37.423 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:37.452 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:31:37.455 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:37.455 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:31:37.556 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:31:37.591 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:37.615 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:31:37.620 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:37.620 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:31:37.721 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:31:37.763 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:37.790 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:31:37.798 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:37.799 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:31:37.900 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:31:37.934 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:37.956 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:31:37.958 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:37.959 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:31:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:37 smithi062 ceph-mon[44211]: pgmap v670: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 147 B/s rd, 36 MiB/s wr, 1.24k op/s 2024-04-01T19:31:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:37 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:31:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:37 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:31:38.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:37 smithi022 ceph-mon[39439]: pgmap v670: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 147 B/s rd, 36 MiB/s wr, 1.24k op/s 2024-04-01T19:31:38.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:37 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:31:38.032 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:37 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:31:38.059 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:31:38.096 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:38.120 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:31:38.123 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:38.123 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:31:38.225 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:31:38.253 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:37 smithi188 ceph-mon[43939]: pgmap v670: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 147 B/s rd, 36 MiB/s wr, 1.24k op/s 2024-04-01T19:31:38.254 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:37 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:31:38.254 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:37 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:31:38.255 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:38.281 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:31:38.286 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:38.286 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:31:38.387 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:31:38.433 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:38.464 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:31:38.467 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:38.467 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:31:38.568 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:31:38.630 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:38.660 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:31:38.664 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:38.665 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:31:38.766 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:31:38.810 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:38.903 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:31:38.908 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:38.909 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:31:39.010 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:31:39.043 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:39.069 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:31:39.076 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:39.076 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:31:39.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:38 smithi022 ceph-mon[39439]: osdmap e228: 12 total, 12 up, 12 in 2024-04-01T19:31:39.153 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:31:39.156 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:31:39.177 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:31:39.204 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:38 smithi188 ceph-mon[43939]: osdmap e228: 12 total, 12 up, 12 in 2024-04-01T19:31:39.206 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:39.231 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:31:39.239 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:39.240 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:31:39.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:38 smithi062 ceph-mon[44211]: osdmap e228: 12 total, 12 up, 12 in 2024-04-01T19:31:39.341 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:31:39.383 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:39.406 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:31:39.417 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:39.417 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:31:39.518 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:31:39.556 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:39.593 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:31:39.596 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:39.596 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:31:39.697 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:31:39.730 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:39.752 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:31:39.758 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:39.759 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:31:39.859 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:31:39.883 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:31:39.893 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:39.925 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:31:39.930 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:39.931 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:31:40.032 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:31:40.049 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:39 smithi022 ceph-mon[39439]: pgmap v672: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 B/s rd, 13 MiB/s wr, 1.10k op/s 2024-04-01T19:31:40.049 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:39 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/467280418' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:31:40.050 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:39 smithi022 ceph-mon[39439]: from='client.35279 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:31:40.050 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:39 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:31:40.050 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:39 smithi022 ceph-mon[39439]: from='client.35279 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:31:40.050 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:39 smithi022 ceph-mon[39439]: osdmap e229: 12 total, 12 up, 12 in 2024-04-01T19:31:40.104 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:40.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:39 smithi062 ceph-mon[44211]: pgmap v672: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 B/s rd, 13 MiB/s wr, 1.10k op/s 2024-04-01T19:31:40.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:39 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/467280418' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:31:40.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:39 smithi062 ceph-mon[44211]: from='client.35279 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:31:40.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:39 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:31:40.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:39 smithi062 ceph-mon[44211]: from='client.35279 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:31:40.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:39 smithi062 ceph-mon[44211]: osdmap e229: 12 total, 12 up, 12 in 2024-04-01T19:31:40.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:39 smithi188 ceph-mon[43939]: pgmap v672: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 B/s rd, 13 MiB/s wr, 1.10k op/s 2024-04-01T19:31:40.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:39 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/467280418' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:31:40.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:39 smithi188 ceph-mon[43939]: from='client.35279 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:31:40.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:39 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:31:40.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:39 smithi188 ceph-mon[43939]: from='client.35279 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:31:40.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:39 smithi188 ceph-mon[43939]: osdmap e229: 12 total, 12 up, 12 in 2024-04-01T19:31:41.008 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:31:41.025 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:31:41.057 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:31:41.086 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:31:41.117 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:31:41.153 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:31:41.182 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:31:41.211 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:31:41.260 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:31:41.285 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:31:41.317 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:31:41.354 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:31:41.359 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:31:41.359 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:31:41.359 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:31:41.359 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:31:41.359 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:31:41.359 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:31:41.359 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:31:41.359 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:31:41.360 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:31:41.360 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:31:41.360 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:31:41.360 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:31:42.074 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:41 smithi022 ceph-mon[39439]: pgmap v674: 17 pgs: 17 active+clean; 9.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s wr, 1.48k op/s 2024-04-01T19:31:42.074 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:41 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2166861985' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:31:42.074 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:41 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.074 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:41 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.074 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:41 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.074 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:41 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.074 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:41 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.074 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:41 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.075 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:41 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.075 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:41 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.075 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:41 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.075 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:41 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.075 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:41 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.078 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:31:42.084 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:42.084 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:31:42.185 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:31:42.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:41 smithi188 ceph-mon[43939]: pgmap v674: 17 pgs: 17 active+clean; 9.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s wr, 1.48k op/s 2024-04-01T19:31:42.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:41 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2166861985' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:31:42.218 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:41 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:41 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:41 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:41 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:41 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:41 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:41 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:41 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:41 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:41 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.219 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:41 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.220 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:42.242 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:31:42.245 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:42.246 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:31:42.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:41 smithi062 ceph-mon[44211]: pgmap v674: 17 pgs: 17 active+clean; 9.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s wr, 1.48k op/s 2024-04-01T19:31:42.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:41 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2166861985' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:31:42.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:41 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:41 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:41 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:41 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:41 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:41 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:41 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:41 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:41 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:41 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:41 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:42.346 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:31:42.376 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:42.399 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:31:42.401 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:42.401 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:31:42.502 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:31:42.545 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:43.088 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:43.104 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:31:43.107 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:43.108 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:31:43.208 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:31:43.235 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:43.237 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:43.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:43.261 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:31:43.267 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:43.268 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:31:43.369 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:31:43.400 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:43.426 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:31:43.431 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:43.431 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:31:43.492 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:31:43.532 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:31:43.565 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:43.587 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:31:43.589 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:43.590 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:31:43.691 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:31:43.718 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:43.739 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:31:43.741 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:43.742 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:31:43.843 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:31:43.905 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:44.119 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:31:44.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:43 smithi022 ceph-mon[39439]: pgmap v675: 17 pgs: 17 active+clean; 9.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s wr, 1.38k op/s 2024-04-01T19:31:44.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:43 smithi062 ceph-mon[44211]: pgmap v675: 17 pgs: 17 active+clean; 9.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s wr, 1.38k op/s 2024-04-01T19:31:44.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:43 smithi188 ceph-mon[43939]: pgmap v675: 17 pgs: 17 active+clean; 9.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s wr, 1.38k op/s 2024-04-01T19:31:44.391 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:31:44.399 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:44.400 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:31:44.501 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:31:44.562 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:44.947 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:31:44.951 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:44.952 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:31:45.052 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:31:45.084 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:45.108 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:31:45.111 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:45.111 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:31:45.212 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:31:45.244 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:45.269 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:31:45.276 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:45.276 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:31:45.377 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:31:45.409 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:45.444 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:31:45.449 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:45.450 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:31:45.550 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:31:45.579 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:45.609 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:31:45.615 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:45.616 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:31:45.716 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:31:45.755 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:45.774 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:31:45.777 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:45.777 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:31:45.878 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:31:45.914 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:45.935 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:31:45.942 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:45.943 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:31:46.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:45 smithi062 ceph-mon[44211]: pgmap v676: 17 pgs: 17 active+clean; 9.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:31:46.043 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:31:46.085 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:46.368 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:45 smithi022 ceph-mon[39439]: pgmap v676: 17 pgs: 17 active+clean; 9.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:31:46.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:45 smithi188 ceph-mon[43939]: pgmap v676: 17 pgs: 17 active+clean; 9.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:31:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:46 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:31:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:46 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:31:47.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:46 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:31:47.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:46 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:31:47.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:46 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:31:47.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:46 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:31:47.650 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.10 reset_purged_snaps_last 2024-04-01T19:31:48.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:47 smithi062 ceph-mon[44211]: pgmap v677: 17 pgs: 17 active+clean; 9.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:31:48.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:47 smithi062 ceph-mon[44211]: osdmap e230: 12 total, 12 up, 12 in 2024-04-01T19:31:48.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:47 smithi022 ceph-mon[39439]: pgmap v677: 17 pgs: 17 active+clean; 9.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:31:48.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:47 smithi022 ceph-mon[39439]: osdmap e230: 12 total, 12 up, 12 in 2024-04-01T19:31:48.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:47 smithi188 ceph-mon[43939]: pgmap v677: 17 pgs: 17 active+clean; 9.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:31:48.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:47 smithi188 ceph-mon[43939]: osdmap e230: 12 total, 12 up, 12 in 2024-04-01T19:31:48.911 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:31:48.967 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:48.967 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:31:49.068 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:31:49.103 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:49.128 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:31:49.131 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:49.131 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:31:49.209 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:31:49.232 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:31:49.241 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:31:49.241 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:31:49.263 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:49.276 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:31:49.285 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:31:49.290 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:49.291 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:31:49.391 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:31:49.425 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:49.455 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:31:49.461 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:49.462 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:31:49.563 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:31:49.612 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:49.646 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:31:49.651 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:49.651 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:31:49.751 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:31:49.795 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:49.827 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:31:49.834 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:49.834 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:31:49.935 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:31:49.964 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:49.988 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:31:49.993 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:49.993 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:31:50.094 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:31:50.125 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:50.147 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:31:50.150 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:50.151 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:31:50.220 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:49 smithi022 ceph-mon[39439]: pgmap v679: 17 pgs: 17 active+clean; 8.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.34k op/s 2024-04-01T19:31:50.252 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:31:50.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:49 smithi062 ceph-mon[44211]: pgmap v679: 17 pgs: 17 active+clean; 8.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.34k op/s 2024-04-01T19:31:50.301 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:50.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:49 smithi188 ceph-mon[43939]: pgmap v679: 17 pgs: 17 active+clean; 8.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.34k op/s 2024-04-01T19:31:50.565 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:31:50.568 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:50.569 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:31:50.670 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:31:50.713 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:50.746 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:31:50.753 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:50.753 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:31:50.854 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:31:50.887 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:51.654 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_historic_ops 2024-04-01T19:31:51.922 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:31:51.951 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:31:51.962 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:51.963 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:31:52.064 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:31:52.094 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:52.122 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:31:52.129 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:52.129 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:31:52.230 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:31:52.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:51 smithi062 ceph-mon[44211]: pgmap v680: 17 pgs: 17 active+clean; 8.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.29k op/s 2024-04-01T19:31:52.273 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:51 smithi022 ceph-mon[39439]: pgmap v680: 17 pgs: 17 active+clean; 8.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.29k op/s 2024-04-01T19:31:52.287 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:52.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:51 smithi188 ceph-mon[43939]: pgmap v680: 17 pgs: 17 active+clean; 8.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.29k op/s 2024-04-01T19:31:52.588 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:31:52.592 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:52.592 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:31:52.693 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:31:52.695 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:31:52.729 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:31:52.747 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:52.758 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:31:52.775 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:31:52.778 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:52.778 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:31:52.795 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:31:52.831 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:31:52.872 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:31:52.879 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:31:52.912 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:31:52.936 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:52.948 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:31:52.979 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:31:52.997 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:52 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:31:52.997 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:52 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:31:52.997 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:52 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:31:52.997 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:52 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:31:52.997 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:52 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1229633252' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:31:52.997 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:52.997 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:52.998 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:52.998 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:53.011 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:31:53.023 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:31:53.032 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:53.033 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:31:53.038 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:31:53.069 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:31:53.077 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:31:53.077 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:31:53.077 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:31:53.077 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:31:53.077 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:31:53.077 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:31:53.077 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:31:53.078 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:31:53.078 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:31:53.078 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:31:53.078 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:31:53.078 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:31:53.134 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:31:53.171 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:53.204 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:31:53.210 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:53.210 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:31:53.311 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:31:53.351 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:52 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:31:53.351 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:52 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:31:53.351 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:52 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:31:53.351 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:52 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:31:53.351 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:52 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1229633252' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:31:53.351 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:53.351 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:53.352 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:53.352 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:53.353 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:53.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:53 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:31:53.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:53 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:31:53.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:53 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:31:53.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:53 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:31:53.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:53 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1229633252' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:31:53.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:53.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:53.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:53.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:54.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:54 smithi022 ceph-mon[39439]: pgmap v681: 17 pgs: 17 active+clean; 8.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:31:54.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:54.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:54.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:54.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:54.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:54.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:54.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:54.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:54.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:54 smithi188 ceph-mon[43939]: pgmap v681: 17 pgs: 17 active+clean; 8.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:31:54.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:54.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:54.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:54.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:54.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:54.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:54.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:54.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:54.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:54 smithi062 ceph-mon[44211]: pgmap v681: 17 pgs: 17 active+clean; 8.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:31:54.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:54.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:54.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:54.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:54.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:54.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:54.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:54.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:31:54.516 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:31:54.523 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:54.524 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:31:54.625 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:31:54.658 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:54.685 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:31:54.690 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:54.690 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:31:54.791 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:31:54.835 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:55.086 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:55 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:31:55.086 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:55 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:31:55.086 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:55 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:31:55.086 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:55 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:31:55.086 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:55 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:31:55.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:55 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:31:55.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:55 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:31:55.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:55 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:31:55.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:55 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:31:55.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:55 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:31:55.409 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:31:55.413 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:55.413 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:31:55.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:55 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:31:55.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:55 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:31:55.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:55 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:31:55.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:55 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:31:55.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:55 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:31:55.514 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:31:55.547 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:55.578 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:31:55.581 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:55.582 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:31:55.683 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:31:55.718 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:55.744 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:31:55.749 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:55.749 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:31:55.850 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:31:55.885 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:55.913 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:31:55.916 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:55.916 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:31:56.003 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.11 reset_purged_snaps_last 2024-04-01T19:31:56.017 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:31:56.049 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:56.080 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:31:56.088 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:56.089 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:31:56.138 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:56 smithi062 ceph-mon[44211]: pgmap v682: 17 pgs: 17 active+clean; 8.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.29k op/s 2024-04-01T19:31:56.138 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:56 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1272134803' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:31:56.139 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:56 smithi062 ceph-mon[44211]: from='client.35306 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:31:56.145 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:31:56.190 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:31:56.219 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:56.241 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:31:56.242 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:56.243 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:31:56.344 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:31:56.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:56 smithi022 ceph-mon[39439]: pgmap v682: 17 pgs: 17 active+clean; 8.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.29k op/s 2024-04-01T19:31:56.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:56 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1272134803' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:31:56.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:56 smithi022 ceph-mon[39439]: from='client.35306 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:31:56.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:56 smithi188 ceph-mon[43939]: pgmap v682: 17 pgs: 17 active+clean; 8.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.29k op/s 2024-04-01T19:31:56.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:56 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1272134803' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:31:56.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:56 smithi188 ceph-mon[43939]: from='client.35306 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:31:56.378 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:56.398 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:31:56.401 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:56.402 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:31:56.503 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:31:56.565 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:57.337 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:57 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:31:57.337 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:57 smithi022 ceph-mon[39439]: from='client.35306 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:31:57.337 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:57 smithi022 ceph-mon[39439]: osdmap e231: 12 total, 12 up, 12 in 2024-04-01T19:31:57.337 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:31:57.345 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:31:57.350 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:57.351 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:31:57.451 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:31:57.481 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:57 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:31:57.481 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:57 smithi062 ceph-mon[44211]: from='client.35306 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:31:57.481 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:57 smithi062 ceph-mon[44211]: osdmap e231: 12 total, 12 up, 12 in 2024-04-01T19:31:57.483 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:57.509 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:31:57.513 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:57.514 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:31:57.615 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:31:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:57 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:31:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:57 smithi188 ceph-mon[43939]: from='client.35306 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:31:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:57 smithi188 ceph-mon[43939]: osdmap e231: 12 total, 12 up, 12 in 2024-04-01T19:31:57.647 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:57.675 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:31:57.681 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:57.682 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:31:57.783 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:31:57.810 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:57.834 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:31:57.836 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:57.837 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:31:57.937 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:31:57.967 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:57.990 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:31:57.996 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:57.996 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:31:58.098 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:31:58.140 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:58.205 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:31:58.213 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:58.213 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:31:58.259 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:31:58.313 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:31:58.352 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:58.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:31:58 smithi188 ceph-mon[43939]: pgmap v684: 17 pgs: 17 active+clean; 8.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.29k op/s 2024-04-01T19:31:58.377 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:31:58.385 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:58.385 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:31:58.392 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:31:58 smithi022 ceph-mon[39439]: pgmap v684: 17 pgs: 17 active+clean; 8.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.29k op/s 2024-04-01T19:31:58.486 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:31:58.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:31:58 smithi062 ceph-mon[44211]: pgmap v684: 17 pgs: 17 active+clean; 8.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.29k op/s 2024-04-01T19:31:58.518 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:58.543 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:31:58.548 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:58.548 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:31:58.589 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:31:58.649 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:31:58.679 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:58.701 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:31:58.707 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:58.708 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:31:58.809 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:31:58.838 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:58.860 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:31:58.862 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:58.863 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:31:58.964 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:31:59.003 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:59.028 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:31:59.035 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:59.036 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:31:59.137 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:31:59.171 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:59.206 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:31:59.212 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:59.213 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:31:59.314 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:31:59.346 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:59.376 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:31:59.380 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:59.381 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:31:59.382 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:31:59.482 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:31:59.523 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:59.549 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:31:59.554 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:59.554 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:31:59.655 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:31:59.718 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:31:59.880 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:31:59.887 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:31:59.887 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:31:59.988 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:32:00.029 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:00.167 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:32:00.172 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:00.172 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:32:00.229 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:32:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 20, 2024-04-01T19:32:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 600, 2024-04-01T19:32:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:32:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:154129 2.4 2:216ccd68:::benchmark_data_smithi188_77607_object154128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e136)", 2024-04-01T19:32:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:19.693545+0000", 2024-04-01T19:32:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 340.53337887599997, 2024-04-01T19:32:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.168805124, 2024-04-01T19:32:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 154129 2024-04-01T19:32:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.693545+0000", 2024-04-01T19:32:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.693545+0000", 2024-04-01T19:32:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.693547+0000", 2024-04-01T19:32:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.33e-06 2024-04-01T19:32:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.693600+0000", 2024-04-01T19:32:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2855999999999997e-05 2024-04-01T19:32:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.693610+0000", 2024-04-01T19:32:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0545e-05 2024-04-01T19:32:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.693618+0000", 2024-04-01T19:32:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.678e-06 2024-04-01T19:32:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.737278+0000", 2024-04-01T19:32:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.043659870000000003 2024-04-01T19:32:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.737438+0000", 2024-04-01T19:32:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00016024600000000001 2024-04-01T19:32:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:32:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.737634+0000", 2024-04-01T19:32:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000196209 2024-04-01T19:32:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.745561+0000", 2024-04-01T19:32:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0079263479999999997 2024-04-01T19:32:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.862221+0000", 2024-04-01T19:32:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.116660497 2024-04-01T19:32:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.862282+0000", 2024-04-01T19:32:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1400000000000002e-05 2024-04-01T19:32:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.862351+0000", 2024-04-01T19:32:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8145000000000006e-05 2024-04-01T19:32:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:154144 2.4 2:29b9ba8b:::benchmark_data_smithi188_77607_object154143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e136)", 2024-04-01T19:32:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:19.713543+0000", 2024-04-01T19:32:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 340.51338109800002, 2024-04-01T19:32:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.14900134100000001, 2024-04-01T19:32:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 154144 2024-04-01T19:32:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.713543+0000", 2024-04-01T19:32:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.713543+0000", 2024-04-01T19:32:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.713545+0000", 2024-04-01T19:32:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.587e-06 2024-04-01T19:32:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.713602+0000", 2024-04-01T19:32:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7683999999999999e-05 2024-04-01T19:32:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.713624+0000", 2024-04-01T19:32:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1994999999999999e-05 2024-04-01T19:32:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.713632+0000", 2024-04-01T19:32:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9959999999999993e-06 2024-04-01T19:32:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.741488+0000", 2024-04-01T19:32:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.027855442000000001 2024-04-01T19:32:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.741581+0000", 2024-04-01T19:32:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.3389999999999999e-05 2024-04-01T19:32:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:32:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.741672+0000", 2024-04-01T19:32:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.0257e-05 2024-04-01T19:32:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.745567+0000", 2024-04-01T19:32:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.003895211 2024-04-01T19:32:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.862416+0000", 2024-04-01T19:32:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.116849614 2024-04-01T19:32:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.862481+0000", 2024-04-01T19:32:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4373000000000002e-05 2024-04-01T19:32:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.862545+0000", 2024-04-01T19:32:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3792000000000002e-05 2024-04-01T19:32:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:168013 2.4 2:2042f4f9:::benchmark_data_smithi188_77607_object609:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e139)", 2024-04-01T19:32:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:36.398936+0000", 2024-04-01T19:32:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 323.82798821699998, 2024-04-01T19:32:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13387802100000001, 2024-04-01T19:32:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 168013 2024-04-01T19:32:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.398936+0000", 2024-04-01T19:32:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.398936+0000", 2024-04-01T19:32:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.398937+0000", 2024-04-01T19:32:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8400000000000005e-07 2024-04-01T19:32:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.398938+0000", 2024-04-01T19:32:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9099999999999999e-06 2024-04-01T19:32:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.398943+0000", 2024-04-01T19:32:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7310000000000001e-06 2024-04-01T19:32:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.398948+0000", 2024-04-01T19:32:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7620000000000003e-06 2024-04-01T19:32:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.493902+0000", 2024-04-01T19:32:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.09495373 2024-04-01T19:32:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.494033+0000", 2024-04-01T19:32:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000131292 2024-04-01T19:32:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:32:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.494167+0000", 2024-04-01T19:32:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000133504 2024-04-01T19:32:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.508268+0000", 2024-04-01T19:32:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014101310000000001 2024-04-01T19:32:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.532696+0000", 2024-04-01T19:32:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.024428347999999999 2024-04-01T19:32:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.532757+0000", 2024-04-01T19:32:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0850999999999997e-05 2024-04-01T19:32:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.532814+0000", 2024-04-01T19:32:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7099000000000003e-05 2024-04-01T19:32:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:168503 2.4 2:216d22bf:::benchmark_data_smithi188_77607_object1099:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:32:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:36.933598+0000", 2024-04-01T19:32:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 323.29332638599999, 2024-04-01T19:32:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.15898862999999999, 2024-04-01T19:32:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 168503 2024-04-01T19:32:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.933598+0000", 2024-04-01T19:32:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.933598+0000", 2024-04-01T19:32:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.933599+0000", 2024-04-01T19:32:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7300000000000005e-07 2024-04-01T19:32:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.933602+0000", 2024-04-01T19:32:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.0769999999999999e-06 2024-04-01T19:32:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.933608+0000", 2024-04-01T19:32:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2450000000000003e-06 2024-04-01T19:32:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.933640+0000", 2024-04-01T19:32:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.1804000000000002e-05 2024-04-01T19:32:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.957575+0000", 2024-04-01T19:32:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.023935656 2024-04-01T19:32:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.957705+0000", 2024-04-01T19:32:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012981700000000001 2024-04-01T19:32:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:32:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.957840+0000", 2024-04-01T19:32:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000134232 2024-04-01T19:32:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.962046+0000", 2024-04-01T19:32:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0042064889999999999 2024-04-01T19:32:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.092439+0000", 2024-04-01T19:32:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13039316400000001 2024-04-01T19:32:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.092500+0000", 2024-04-01T19:32:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0992999999999997e-05 2024-04-01T19:32:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.092587+0000", 2024-04-01T19:32:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6379999999999996e-05 2024-04-01T19:32:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:168561 2.4 2:216284a5:::benchmark_data_smithi188_77607_object1157:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:32:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:37.001846+0000", 2024-04-01T19:32:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 323.22507785400001, 2024-04-01T19:32:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13320378099999999, 2024-04-01T19:32:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 168561 2024-04-01T19:32:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.001846+0000", 2024-04-01T19:32:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.001846+0000", 2024-04-01T19:32:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.001849+0000", 2024-04-01T19:32:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3520000000000001e-06 2024-04-01T19:32:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.001869+0000", 2024-04-01T19:32:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0455999999999999e-05 2024-04-01T19:32:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.001890+0000", 2024-04-01T19:32:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0948999999999999e-05 2024-04-01T19:32:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.001900+0000", 2024-04-01T19:32:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.3319999999999998e-06 2024-04-01T19:32:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.097339+0000", 2024-04-01T19:32:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.095439674000000002 2024-04-01T19:32:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.097455+0000", 2024-04-01T19:32:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000115958 2024-04-01T19:32:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:32:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.097561+0000", 2024-04-01T19:32:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000105813 2024-04-01T19:32:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.111447+0000", 2024-04-01T19:32:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.013885666 2024-04-01T19:32:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.134970+0000", 2024-04-01T19:32:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.023523394999999999 2024-04-01T19:32:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.135006+0000", 2024-04-01T19:32:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.6239999999999999e-05 2024-04-01T19:32:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.135050+0000", 2024-04-01T19:32:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.3946000000000002e-05 2024-04-01T19:32:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:168878 2.4 2:2fe8ad4f:::benchmark_data_smithi188_77607_object1474:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:32:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:37.361741+0000", 2024-04-01T19:32:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 322.86518303100002, 2024-04-01T19:32:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13598875199999999, 2024-04-01T19:32:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 168878 2024-04-01T19:32:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.361741+0000", 2024-04-01T19:32:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.361741+0000", 2024-04-01T19:32:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.361742+0000", 2024-04-01T19:32:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0610000000000001e-06 2024-04-01T19:32:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.361746+0000", 2024-04-01T19:32:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.4999999999999999e-06 2024-04-01T19:32:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.361753+0000", 2024-04-01T19:32:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0380000000000002e-06 2024-04-01T19:32:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.361764+0000", 2024-04-01T19:32:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1372000000000001e-05 2024-04-01T19:32:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.386612+0000", 2024-04-01T19:32:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.024848186000000001 2024-04-01T19:32:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.386693+0000", 2024-04-01T19:32:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0269e-05 2024-04-01T19:32:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:32:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.386765+0000", 2024-04-01T19:32:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2755000000000004e-05 2024-04-01T19:32:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.396249+0000", 2024-04-01T19:32:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.009483544 2024-04-01T19:32:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.497621+0000", 2024-04-01T19:32:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.101372484 2024-04-01T19:32:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.497673+0000", 2024-04-01T19:32:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.1409000000000002e-05 2024-04-01T19:32:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.497730+0000", 2024-04-01T19:32:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7133999999999999e-05 2024-04-01T19:32:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:168882 2.4 2:253bea4e:::benchmark_data_smithi188_77607_object1478:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:32:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:37.362576+0000", 2024-04-01T19:32:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 322.864348667, 2024-04-01T19:32:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13527134399999999, 2024-04-01T19:32:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 168882 2024-04-01T19:32:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.362576+0000", 2024-04-01T19:32:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.362576+0000", 2024-04-01T19:32:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.362577+0000", 2024-04-01T19:32:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2300000000000001e-06 2024-04-01T19:32:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.362582+0000", 2024-04-01T19:32:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9389999999999996e-06 2024-04-01T19:32:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.362590+0000", 2024-04-01T19:32:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0809999999999994e-06 2024-04-01T19:32:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.362597+0000", 2024-04-01T19:32:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9739999999999996e-06 2024-04-01T19:32:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.389726+0000", 2024-04-01T19:32:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.027129442 2024-04-01T19:32:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.389812+0000", 2024-04-01T19:32:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5704000000000005e-05 2024-04-01T19:32:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:32:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.389902+0000", 2024-04-01T19:32:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.0214000000000001e-05 2024-04-01T19:32:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.396533+0000", 2024-04-01T19:32:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0066305979999999997 2024-04-01T19:32:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.497771+0000", 2024-04-01T19:32:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.101237884 2024-04-01T19:32:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.497802+0000", 2024-04-01T19:32:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.1560999999999998e-05 2024-04-01T19:32:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.497847+0000", 2024-04-01T19:32:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4716999999999999e-05 2024-04-01T19:32:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:169376 2.4 2:22116be6:::benchmark_data_smithi188_77607_object1972:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:32:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:37.964004+0000", 2024-04-01T19:32:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 322.26292001600001, 2024-04-01T19:32:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13362046899999999, 2024-04-01T19:32:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 169376 2024-04-01T19:32:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.964004+0000", 2024-04-01T19:32:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.964004+0000", 2024-04-01T19:32:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.964006+0000", 2024-04-01T19:32:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1179999999999999e-06 2024-04-01T19:32:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.964013+0000", 2024-04-01T19:32:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2809999999999997e-06 2024-04-01T19:32:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.964029+0000", 2024-04-01T19:32:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5945000000000001e-05 2024-04-01T19:32:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.964037+0000", 2024-04-01T19:32:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5199999999999997e-06 2024-04-01T19:32:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.968671+0000", 2024-04-01T19:32:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0046341430000000003 2024-04-01T19:32:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.968786+0000", 2024-04-01T19:32:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000115056 2024-04-01T19:32:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:32:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.968911+0000", 2024-04-01T19:32:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012422600000000001 2024-04-01T19:32:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.983926+0000", 2024-04-01T19:32:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.015015185 2024-04-01T19:32:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.097475+0000", 2024-04-01T19:32:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.113549708 2024-04-01T19:32:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.097548+0000", 2024-04-01T19:32:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2825999999999997e-05 2024-04-01T19:32:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.097625+0000", 2024-04-01T19:32:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6460999999999999e-05 2024-04-01T19:32:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:169563 2.4 2:22236e1e:::benchmark_data_smithi188_77607_object2159:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:32:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:38.170573+0000", 2024-04-01T19:32:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 322.05635126700003, 2024-04-01T19:32:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.158113117, 2024-04-01T19:32:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 169563 2024-04-01T19:32:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.170573+0000", 2024-04-01T19:32:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.170573+0000", 2024-04-01T19:32:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.170575+0000", 2024-04-01T19:32:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2630000000000002e-06 2024-04-01T19:32:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.170582+0000", 2024-04-01T19:32:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.348e-06 2024-04-01T19:32:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.170595+0000", 2024-04-01T19:32:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3621999999999999e-05 2024-04-01T19:32:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.170604+0000", 2024-04-01T19:32:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8400000000000001e-06 2024-04-01T19:32:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.211420+0000", 2024-04-01T19:32:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.040816216000000002 2024-04-01T19:32:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.211530+0000", 2024-04-01T19:32:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00011005000000000001 2024-04-01T19:32:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:32:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.211650+0000", 2024-04-01T19:32:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000119741 2024-04-01T19:32:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.217218+0000", 2024-04-01T19:32:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0055679010000000001 2024-04-01T19:32:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.328560+0000", 2024-04-01T19:32:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.111341592 2024-04-01T19:32:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.328621+0000", 2024-04-01T19:32:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1166000000000004e-05 2024-04-01T19:32:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.328686+0000", 2024-04-01T19:32:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5377999999999996e-05 2024-04-01T19:32:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:170768 2.4 2:2ff39c60:::benchmark_data_smithi188_77607_object3364:head [delete] snapc 0=[] ondisk+write+known_if_redirected e140)", 2024-04-01T19:32:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:39.585423+0000", 2024-04-01T19:32:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 320.64150138100001, 2024-04-01T19:32:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.135395086, 2024-04-01T19:32:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 170768 2024-04-01T19:32:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.585423+0000", 2024-04-01T19:32:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.585423+0000", 2024-04-01T19:32:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.585425+0000", 2024-04-01T19:32:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.852e-06 2024-04-01T19:32:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.585431+0000", 2024-04-01T19:32:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1580000000000002e-06 2024-04-01T19:32:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.585440+0000", 2024-04-01T19:32:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.3300000000000005e-06 2024-04-01T19:32:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.585448+0000", 2024-04-01T19:32:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0099999999999995e-06 2024-04-01T19:32:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.684963+0000", 2024-04-01T19:32:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.099514376000000002 2024-04-01T19:32:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.685119+0000", 2024-04-01T19:32:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015643800000000001 2024-04-01T19:32:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:32:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.685270+0000", 2024-04-01T19:32:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000150576 2024-04-01T19:32:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.709200+0000", 2024-04-01T19:32:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.023929934999999999 2024-04-01T19:32:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.720712+0000", 2024-04-01T19:32:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.011512191999999999 2024-04-01T19:32:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.720769+0000", 2024-04-01T19:32:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6849999999999999e-05 2024-04-01T19:32:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.720818+0000", 2024-04-01T19:32:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9369000000000001e-05 2024-04-01T19:32:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:170773 2.4 2:28c89dc6:::benchmark_data_smithi188_77607_object3369:head [delete] snapc 0=[] ondisk+write+known_if_redirected e140)", 2024-04-01T19:32:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:39.587102+0000", 2024-04-01T19:32:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 320.63982276399997, 2024-04-01T19:32:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13739808100000001, 2024-04-01T19:32:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 170773 2024-04-01T19:32:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.587102+0000", 2024-04-01T19:32:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.587102+0000", 2024-04-01T19:32:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.587103+0000", 2024-04-01T19:32:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6130000000000001e-06 2024-04-01T19:32:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.587109+0000", 2024-04-01T19:32:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4550000000000003e-06 2024-04-01T19:32:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.587121+0000", 2024-04-01T19:32:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1914e-05 2024-04-01T19:32:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.587129+0000", 2024-04-01T19:32:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5820000000000002e-06 2024-04-01T19:32:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.688934+0000", 2024-04-01T19:32:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.10180497199999999 2024-04-01T19:32:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.689017+0000", 2024-04-01T19:32:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2602999999999995e-05 2024-04-01T19:32:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:32:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.689093+0000", 2024-04-01T19:32:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6738999999999998e-05 2024-04-01T19:32:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.709205+0000", 2024-04-01T19:32:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.020111831 2024-04-01T19:32:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.724394+0000", 2024-04-01T19:32:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.015189162000000001 2024-04-01T19:32:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.724441+0000", 2024-04-01T19:32:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6403000000000003e-05 2024-04-01T19:32:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.724500+0000", 2024-04-01T19:32:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8807000000000001e-05 2024-04-01T19:32:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:170780 2.4 2:2c43b94c:::benchmark_data_smithi188_77607_object3376:head [delete] snapc 0=[] ondisk+write+known_if_redirected e140)", 2024-04-01T19:32:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:39.596139+0000", 2024-04-01T19:32:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 320.63078572500001, 2024-04-01T19:32:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13253120400000001, 2024-04-01T19:32:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 170780 2024-04-01T19:32:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.596139+0000", 2024-04-01T19:32:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.596139+0000", 2024-04-01T19:32:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.596141+0000", 2024-04-01T19:32:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.401e-06 2024-04-01T19:32:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.596147+0000", 2024-04-01T19:32:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2770000000000002e-06 2024-04-01T19:32:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.596158+0000", 2024-04-01T19:32:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1043000000000001e-05 2024-04-01T19:32:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.596166+0000", 2024-04-01T19:32:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0190000000000006e-06 2024-04-01T19:32:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.692475+0000", 2024-04-01T19:32:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.096309078000000006 2024-04-01T19:32:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.692612+0000", 2024-04-01T19:32:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000136315 2024-04-01T19:32:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:32:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.692842+0000", 2024-04-01T19:32:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00023002 2024-04-01T19:32:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.709328+0000", 2024-04-01T19:32:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.016485975999999999 2024-04-01T19:32:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.728560+0000", 2024-04-01T19:32:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.019231997000000001 2024-04-01T19:32:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.728595+0000", 2024-04-01T19:32:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5374999999999999e-05 2024-04-01T19:32:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.728670+0000", 2024-04-01T19:32:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4703000000000006e-05 2024-04-01T19:32:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:170987 2.4 2:2b017fd7:::benchmark_data_smithi188_77607_object3583:head [delete] snapc 0=[] ondisk+write+known_if_redirected e141)", 2024-04-01T19:32:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:39.855785+0000", 2024-04-01T19:32:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 320.37113949399998, 2024-04-01T19:32:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.17668636300000001, 2024-04-01T19:32:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 170987 2024-04-01T19:32:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.855785+0000", 2024-04-01T19:32:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.855785+0000", 2024-04-01T19:32:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.855787+0000", 2024-04-01T19:32:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.413e-06 2024-04-01T19:32:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.855794+0000", 2024-04-01T19:32:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3369999999999996e-06 2024-04-01T19:32:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.855805+0000", 2024-04-01T19:32:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.119e-05 2024-04-01T19:32:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.855813+0000", 2024-04-01T19:32:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.704e-06 2024-04-01T19:32:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.897481+0000", 2024-04-01T19:32:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.041667997999999998 2024-04-01T19:32:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.897627+0000", 2024-04-01T19:32:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000145551 2024-04-01T19:32:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:32:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.897754+0000", 2024-04-01T19:32:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000127448 2024-04-01T19:32:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.904812+0000", 2024-04-01T19:32:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.007057547 2024-04-01T19:32:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.032341+0000", 2024-04-01T19:32:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.12752882600000001 2024-04-01T19:32:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.032402+0000", 2024-04-01T19:32:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1237999999999999e-05 2024-04-01T19:32:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.032471+0000", 2024-04-01T19:32:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9110999999999996e-05 2024-04-01T19:32:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:171249 2.4 2:2ed16714:::benchmark_data_smithi188_77607_object3845:head [delete] snapc 0=[] ondisk+write+known_if_redirected e141)", 2024-04-01T19:32:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:40.187602+0000", 2024-04-01T19:32:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 320.03932271100001, 2024-04-01T19:32:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.139158531, 2024-04-01T19:32:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 171249 2024-04-01T19:32:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.187602+0000", 2024-04-01T19:32:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.187602+0000", 2024-04-01T19:32:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.187604+0000", 2024-04-01T19:32:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2010000000000002e-06 2024-04-01T19:32:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.187610+0000", 2024-04-01T19:32:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5289999999999997e-06 2024-04-01T19:32:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.187623+0000", 2024-04-01T19:32:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2531000000000001e-05 2024-04-01T19:32:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.187633+0000", 2024-04-01T19:32:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0101999999999999e-05 2024-04-01T19:32:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.287600+0000", 2024-04-01T19:32:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.099966652000000003 2024-04-01T19:32:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.287733+0000", 2024-04-01T19:32:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013353400000000001 2024-04-01T19:32:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:32:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.287887+0000", 2024-04-01T19:32:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000153404 2024-04-01T19:32:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.291575+0000", 2024-04-01T19:32:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0036889259999999999 2024-04-01T19:32:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.326673+0000", 2024-04-01T19:32:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.035097916 2024-04-01T19:32:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.326707+0000", 2024-04-01T19:32:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.4090000000000001e-05 2024-04-01T19:32:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.326760+0000", 2024-04-01T19:32:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2645999999999997e-05 2024-04-01T19:32:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:171254 2.4 2:271db100:::benchmark_data_smithi188_77607_object3850:head [delete] snapc 0=[] ondisk+write+known_if_redirected e141)", 2024-04-01T19:32:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:40.188075+0000", 2024-04-01T19:32:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 320.03884971999997, 2024-04-01T19:32:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.155416745, 2024-04-01T19:32:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 171254 2024-04-01T19:32:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.188075+0000", 2024-04-01T19:32:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.188075+0000", 2024-04-01T19:32:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.188076+0000", 2024-04-01T19:32:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4640000000000001e-06 2024-04-01T19:32:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.188081+0000", 2024-04-01T19:32:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8040000000000001e-06 2024-04-01T19:32:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.188104+0000", 2024-04-01T19:32:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3577000000000001e-05 2024-04-01T19:32:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.188112+0000", 2024-04-01T19:32:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5120000000000002e-06 2024-04-01T19:32:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.293169+0000", 2024-04-01T19:32:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.105056749 2024-04-01T19:32:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.293261+0000", 2024-04-01T19:32:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.2708999999999996e-05 2024-04-01T19:32:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:32:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.293347+0000", 2024-04-01T19:32:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5418000000000001e-05 2024-04-01T19:32:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.301658+0000", 2024-04-01T19:32:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0083108169999999999 2024-04-01T19:32:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.343390+0000", 2024-04-01T19:32:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.041732305999999997 2024-04-01T19:32:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.343430+0000", 2024-04-01T19:32:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.0021999999999997e-05 2024-04-01T19:32:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.343491+0000", 2024-04-01T19:32:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1366999999999997e-05 2024-04-01T19:32:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:171408 2.4 2:2138250a:::benchmark_data_smithi188_77607_object4004:head [delete] snapc 0=[] ondisk+write+known_if_redirected e141)", 2024-04-01T19:32:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:40.399136+0000", 2024-04-01T19:32:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 319.82778788600001, 2024-04-01T19:32:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.14753075600000001, 2024-04-01T19:32:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 171408 2024-04-01T19:32:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.399136+0000", 2024-04-01T19:32:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.399136+0000", 2024-04-01T19:32:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.399138+0000", 2024-04-01T19:32:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.096e-06 2024-04-01T19:32:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.399142+0000", 2024-04-01T19:32:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.2930000000000002e-06 2024-04-01T19:32:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.399149+0000", 2024-04-01T19:32:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4819999999999997e-06 2024-04-01T19:32:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.399156+0000", 2024-04-01T19:32:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.6390000000000003e-06 2024-04-01T19:32:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.458840+0000", 2024-04-01T19:32:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.059683936 2024-04-01T19:32:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.458919+0000", 2024-04-01T19:32:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9036999999999996e-05 2024-04-01T19:32:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:32:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.459034+0000", 2024-04-01T19:32:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000115406 2024-04-01T19:32:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.468175+0000", 2024-04-01T19:32:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0091410810000000006 2024-04-01T19:32:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.546519+0000", 2024-04-01T19:32:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.078343975999999996 2024-04-01T19:32:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.546603+0000", 2024-04-01T19:32:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3591999999999995e-05 2024-04-01T19:32:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.546667+0000", 2024-04-01T19:32:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4218000000000001e-05 2024-04-01T19:32:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:171556 2.4 2:2e8e4f02:::benchmark_data_smithi188_77607_object4152:head [delete] snapc 0=[] ondisk+write+known_if_redirected e141)", 2024-04-01T19:32:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:40.575646+0000", 2024-04-01T19:32:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 319.65127782000002, 2024-04-01T19:32:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.140900262, 2024-04-01T19:32:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 171556 2024-04-01T19:32:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.575646+0000", 2024-04-01T19:32:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.575646+0000", 2024-04-01T19:32:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.575649+0000", 2024-04-01T19:32:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4739999999999999e-06 2024-04-01T19:32:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.575657+0000", 2024-04-01T19:32:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0059999999999992e-06 2024-04-01T19:32:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.575669+0000", 2024-04-01T19:32:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1619e-05 2024-04-01T19:32:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.575677+0000", 2024-04-01T19:32:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5420000000000005e-06 2024-04-01T19:32:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.680865+0000", 2024-04-01T19:32:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.10518825800000001 2024-04-01T19:32:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.680984+0000", 2024-04-01T19:32:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000118579 2024-04-01T19:32:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:32:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.681109+0000", 2024-04-01T19:32:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012469 2024-04-01T19:32:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.694331+0000", 2024-04-01T19:32:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.013222650000000001 2024-04-01T19:32:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.716424+0000", 2024-04-01T19:32:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.022092309000000001 2024-04-01T19:32:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.716479+0000", 2024-04-01T19:32:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4951999999999998e-05 2024-04-01T19:32:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.716547+0000", 2024-04-01T19:32:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8182999999999994e-05 2024-04-01T19:32:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:265186 2.6 2.c4c92856 (undecoded) ondisk+retry+write+known_if_redirected e170)", 2024-04-01T19:32:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:30.810128+0000", 2024-04-01T19:32:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 209.41679653, 2024-04-01T19:32:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.136600637, 2024-04-01T19:32:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "reached pg", 2024-04-01T19:32:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 265186 2024-04-01T19:32:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810128+0000", 2024-04-01T19:32:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810128+0000", 2024-04-01T19:32:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810130+0000", 2024-04-01T19:32:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.593e-06 2024-04-01T19:32:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810138+0000", 2024-04-01T19:32:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2880000000000004e-06 2024-04-01T19:32:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810151+0000", 2024-04-01T19:32:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2892e-05 2024-04-01T19:32:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810161+0000", 2024-04-01T19:32:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0040999999999999e-05 2024-04-01T19:32:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810208+0000", 2024-04-01T19:32:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7243999999999997e-05 2024-04-01T19:32:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for peered", 2024-04-01T19:32:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810216+0000", 2024-04-01T19:32:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3019999999999995e-06 2024-04-01T19:32:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.946682+0000", 2024-04-01T19:32:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13646552200000001 2024-04-01T19:32:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.946728+0000", 2024-04-01T19:32:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6755000000000002e-05 2024-04-01T19:32:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:265188 2.6 2.8eece8d6 (undecoded) ondisk+retry+write+known_if_redirected e170)", 2024-04-01T19:32:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:30.810177+0000", 2024-04-01T19:32:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 209.416746846, 2024-04-01T19:32:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.136708157, 2024-04-01T19:32:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "reached pg", 2024-04-01T19:32:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 265188 2024-04-01T19:32:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810177+0000", 2024-04-01T19:32:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810177+0000", 2024-04-01T19:32:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810178+0000", 2024-04-01T19:32:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2699999999999999e-07 2024-04-01T19:32:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810182+0000", 2024-04-01T19:32:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7809999999999999e-06 2024-04-01T19:32:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810188+0000", 2024-04-01T19:32:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3300000000000004e-06 2024-04-01T19:32:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810195+0000", 2024-04-01T19:32:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2960000000000004e-06 2024-04-01T19:32:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810254+0000", 2024-04-01T19:32:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8928000000000002e-05 2024-04-01T19:32:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for peered", 2024-04-01T19:32:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810262+0000", 2024-04-01T19:32:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3019999999999995e-06 2024-04-01T19:32:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.946879+0000", 2024-04-01T19:32:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13661667199999999 2024-04-01T19:32:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.946886+0000", 2024-04-01T19:32:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.1210000000000001e-06 2024-04-01T19:32:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:265216 2.6 2.e5488046 (undecoded) ondisk+retry+write+known_if_redirected e170)", 2024-04-01T19:32:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:30.810203+0000", 2024-04-01T19:32:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 209.416720849, 2024-04-01T19:32:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13673660200000001, 2024-04-01T19:32:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:00.340 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:32:00.341 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:32:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "reached pg", 2024-04-01T19:32:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 265216 2024-04-01T19:32:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810203+0000", 2024-04-01T19:32:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810203+0000", 2024-04-01T19:32:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810204+0000", 2024-04-01T19:32:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3600000000000003e-07 2024-04-01T19:32:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810208+0000", 2024-04-01T19:32:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7220000000000001e-06 2024-04-01T19:32:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810214+0000", 2024-04-01T19:32:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9379999999999997e-06 2024-04-01T19:32:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810219+0000", 2024-04-01T19:32:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0969999999999996e-06 2024-04-01T19:32:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810277+0000", 2024-04-01T19:32:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7966e-05 2024-04-01T19:32:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for peered", 2024-04-01T19:32:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810282+0000", 2024-04-01T19:32:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6380000000000001e-06 2024-04-01T19:32:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.946932+0000", 2024-04-01T19:32:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13664933700000001 2024-04-01T19:32:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.946940+0000", 2024-04-01T19:32:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2679999999999994e-06 2024-04-01T19:32:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:00.346 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:32:00.346 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:32:00.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:00 smithi022 ceph-mon[39439]: pgmap v685: 17 pgs: 17 active+clean; 8.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.27k op/s 2024-04-01T19:32:00.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:00 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:32:00.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:00 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:32:00.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:00 smithi022 ceph-mon[39439]: osdmap e232: 12 total, 12 up, 12 in 2024-04-01T19:32:00.380 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:00.405 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:32:00.413 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:00.413 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:00 smithi062 ceph-mon[44211]: pgmap v685: 17 pgs: 17 active+clean; 8.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.27k op/s 2024-04-01T19:32:00.413 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:00 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:32:00.413 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:00 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:32:00.413 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:00 smithi062 ceph-mon[44211]: osdmap e232: 12 total, 12 up, 12 in 2024-04-01T19:32:00.414 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:32:00.514 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:32:00.543 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:00 smithi188 ceph-mon[43939]: pgmap v685: 17 pgs: 17 active+clean; 8.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.27k op/s 2024-04-01T19:32:00.543 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:00 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:32:00.543 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:00 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:32:00.543 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:00 smithi188 ceph-mon[43939]: osdmap e232: 12 total, 12 up, 12 in 2024-04-01T19:32:00.545 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:00.574 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:32:00.579 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:00.580 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:32:00.680 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:32:00.712 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:00.741 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:32:00.747 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:00.747 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:32:00.848 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:32:00.881 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:00.903 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:32:00.906 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:00.906 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:32:01.007 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:32:01.048 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:01.075 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:32:01.078 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:01.078 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:32:01.150 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_ops_in_flight 2024-04-01T19:32:01.179 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:32:01.210 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:01.235 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:32:01.239 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:01.239 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:32:01.340 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:32:01.373 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:01.405 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:32:01.414 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:01.414 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:32:01.515 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:32:01.548 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:01.575 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:32:01.580 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:01.580 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:32:01.681 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:32:01.714 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:01.735 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:32:01.740 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:01.740 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:32:01.841 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:32:01.873 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:01.902 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:32:01.908 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:01.909 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:32:02.010 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:32:02.077 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:02.149 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:32:02.156 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:02.157 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:32:02.258 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:32:02.287 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:02.317 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:32:02.320 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:02.320 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:32:02.368 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:02 smithi022 ceph-mon[39439]: pgmap v687: 17 pgs: 17 active+clean; 7.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.48k op/s 2024-04-01T19:32:02.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:02 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:32:02.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:02 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:32:02.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:02 smithi022 ceph-mon[39439]: osdmap e233: 12 total, 12 up, 12 in 2024-04-01T19:32:02.421 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:32:02.448 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:02 smithi188 ceph-mon[43939]: pgmap v687: 17 pgs: 17 active+clean; 7.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.48k op/s 2024-04-01T19:32:02.449 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:02 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:32:02.449 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:02 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:32:02.449 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:02 smithi188 ceph-mon[43939]: osdmap e233: 12 total, 12 up, 12 in 2024-04-01T19:32:02.458 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:02.488 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:32:02.492 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:02.492 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:32:02.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:02 smithi062 ceph-mon[44211]: pgmap v687: 17 pgs: 17 active+clean; 7.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.48k op/s 2024-04-01T19:32:02.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:02 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:32:02.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:02 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:32:02.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:02 smithi062 ceph-mon[44211]: osdmap e233: 12 total, 12 up, 12 in 2024-04-01T19:32:02.593 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:32:02.649 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:02.833 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:32:02.839 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:02.839 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:32:02.940 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:32:03.007 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:03.031 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:32:03.037 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:03.037 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:32:03.138 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:32:03.179 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:03.206 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:32:03.210 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:03.211 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:32:03.311 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:32:03.364 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:03.626 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:32:03.635 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:03.636 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:32:03.737 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:32:03.802 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:03.937 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:32:03.943 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:03.944 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:32:04.045 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:32:04.076 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:04.110 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:32:04.114 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:04.114 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:32:04.215 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:32:04.255 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:04 smithi022 ceph-mon[39439]: pgmap v689: 17 pgs: 17 active+clean; 7.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:32:04.258 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:04.289 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:32:04.306 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:04.307 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:32:04.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:04 smithi188 ceph-mon[43939]: pgmap v689: 17 pgs: 17 active+clean; 7.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:32:04.407 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:32:04.462 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:04.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:04 smithi062 ceph-mon[44211]: pgmap v689: 17 pgs: 17 active+clean; 7.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:32:04.652 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.8 reset_purged_snaps_last 2024-04-01T19:32:05.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:05 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:32:05.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:05 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:32:05.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:05 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:32:05.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:05 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:32:05.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:05 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:32:05.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:05 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:32:05.936 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:32:05.941 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:05.942 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:32:06.020 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:32:06.043 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:32:06.071 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:06.071 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:32:06.093 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:32:06.095 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:06.096 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:32:06.197 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:32:06.241 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:06.270 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:32:06.276 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:06.277 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:32:06.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:06 smithi188 ceph-mon[43939]: pgmap v690: 17 pgs: 17 active+clean; 7.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:32:06.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:06 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:32:06.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:06 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:32:06.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:06 smithi188 ceph-mon[43939]: osdmap e234: 12 total, 12 up, 12 in 2024-04-01T19:32:06.378 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:32:06.412 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:06.441 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:32:06.447 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:06 smithi062 ceph-mon[44211]: pgmap v690: 17 pgs: 17 active+clean; 7.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:32:06.447 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:06 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:32:06.447 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:06 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:32:06.447 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:06 smithi062 ceph-mon[44211]: osdmap e234: 12 total, 12 up, 12 in 2024-04-01T19:32:06.448 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:06.449 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:32:06.550 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:32:06.597 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:06.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:06 smithi022 ceph-mon[39439]: pgmap v690: 17 pgs: 17 active+clean; 7.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:32:06.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:06 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:32:06.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:06 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:32:06.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:06 smithi022 ceph-mon[39439]: osdmap e234: 12 total, 12 up, 12 in 2024-04-01T19:32:06.629 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:32:06.634 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:06.635 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:32:06.681 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:32:06.717 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:32:06.736 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:32:06.753 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:32:06.776 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:06.784 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:32:06.804 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:32:06.814 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:06.814 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:32:06.815 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:32:06.845 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:32:06.882 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:32:06.915 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:32:06.921 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:32:06.952 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:06.957 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:32:06.979 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:32:06.983 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:06.983 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:32:06.984 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:32:07.016 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:32:07.061 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:32:07.079 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:32:07.080 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:32:07.080 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:32:07.080 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:32:07.080 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:32:07.080 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:32:07.080 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:32:07.080 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:32:07.080 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:32:07.080 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:32:07.080 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:32:07.080 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:32:07.084 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:32:07.116 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:07.146 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:32:07.153 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:07.153 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:32:07.254 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:32:07.300 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:07.324 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:32:07.327 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:07.327 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:32:07.428 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:32:07.489 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:07 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/294352398' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:32:07.489 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:07.489 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:07.489 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:07.489 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:07.489 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:07.495 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:07.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:07 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/294352398' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:32:07.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:07.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:07.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:07.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:07.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:07.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:07 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/294352398' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:32:07.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:07.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:07.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:07.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:07.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:08 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:32:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:08 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:32:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:08 smithi062 ceph-mon[44211]: pgmap v692: 17 pgs: 17 active+clean; 7.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.28k op/s 2024-04-01T19:32:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:08.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:08.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:08 smithi062 ceph-mon[44211]: osdmap e235: 12 total, 12 up, 12 in 2024-04-01T19:32:08.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:08 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1608418525' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:32:08.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:08 smithi062 ceph-mon[44211]: from='client.25291 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:32:08.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:08 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:32:08.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:08 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:32:08.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:08 smithi022 ceph-mon[39439]: pgmap v692: 17 pgs: 17 active+clean; 7.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.28k op/s 2024-04-01T19:32:08.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:08.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:08.535 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:08.535 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:08.535 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:08.535 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:08.535 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:08.535 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:08 smithi022 ceph-mon[39439]: osdmap e235: 12 total, 12 up, 12 in 2024-04-01T19:32:08.535 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:08 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1608418525' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:32:08.535 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:08 smithi022 ceph-mon[39439]: from='client.25291 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:32:08.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:08 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:32:08.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:08 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:32:08.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:08 smithi188 ceph-mon[43939]: pgmap v692: 17 pgs: 17 active+clean; 7.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.28k op/s 2024-04-01T19:32:08.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:08.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:08.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:08.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:08.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:08.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:08.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:08.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:08 smithi188 ceph-mon[43939]: osdmap e235: 12 total, 12 up, 12 in 2024-04-01T19:32:08.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:08 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1608418525' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:32:08.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:08 smithi188 ceph-mon[43939]: from='client.25291 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:32:09.151 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:32:09.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:09 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:32:09.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:09 smithi022 ceph-mon[39439]: from='client.25291 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:32:09.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:09 smithi022 ceph-mon[39439]: osdmap e236: 12 total, 12 up, 12 in 2024-04-01T19:32:09.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:09 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:32:09.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:09 smithi062 ceph-mon[44211]: from='client.25291 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:32:09.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:09 smithi062 ceph-mon[44211]: osdmap e236: 12 total, 12 up, 12 in 2024-04-01T19:32:09.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:09 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:32:09.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:09 smithi188 ceph-mon[43939]: from='client.25291 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:32:09.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:09 smithi188 ceph-mon[43939]: osdmap e236: 12 total, 12 up, 12 in 2024-04-01T19:32:09.883 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:32:09.885 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:09.886 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:32:09.987 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:32:10.020 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:10.047 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:32:10.050 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:10.051 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:32:10.152 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:32:10.212 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:10.441 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:32:10.446 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:10.447 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:32:10.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:10 smithi062 ceph-mon[44211]: pgmap v695: 17 pgs: 17 active+clean; 7.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.38k op/s 2024-04-01T19:32:10.547 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:32:10.570 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:10 smithi022 ceph-mon[39439]: pgmap v695: 17 pgs: 17 active+clean; 7.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.38k op/s 2024-04-01T19:32:10.580 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:10 smithi188 ceph-mon[43939]: pgmap v695: 17 pgs: 17 active+clean; 7.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.38k op/s 2024-04-01T19:32:10.584 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:10.609 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:32:10.612 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:10.612 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:32:10.713 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:32:10.753 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:10.889 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:32:10.893 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:10.894 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:32:10.995 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:32:11.035 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:11.047 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:32:11.171 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:32:11.176 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:11.176 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:32:11.277 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:32:11.305 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:11.326 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:32:11.330 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:11.331 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:32:11.432 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:32:11.462 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:11.487 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:32:11.491 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:11.491 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:32:11.592 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:32:11.630 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:11.662 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:32:11.667 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:11.668 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:32:11.769 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:32:11.797 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:11.821 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:32:11.826 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:11.826 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:32:11.926 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:32:11.927 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:32:11.935 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:32:11.936 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:32:11.962 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:11.989 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:32:11.991 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:11.992 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:32:12.093 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:32:12.139 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:12.176 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:32:12.181 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:12.182 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:32:12.283 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:32:12.320 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:12.353 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:32:12.355 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:12.356 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:32:12.457 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:32:12.496 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:12.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:12 smithi062 ceph-mon[44211]: pgmap v696: 17 pgs: 17 active+clean; 7.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.58k op/s 2024-04-01T19:32:12.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:12 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:32:12.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:12 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:32:12.520 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:32:12.523 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:12.523 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:32:12.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:12 smithi022 ceph-mon[39439]: pgmap v696: 17 pgs: 17 active+clean; 7.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.58k op/s 2024-04-01T19:32:12.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:12 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:32:12.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:12 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:32:12.623 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:32:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:12 smithi188 ceph-mon[43939]: pgmap v696: 17 pgs: 17 active+clean; 7.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.58k op/s 2024-04-01T19:32:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:12 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:32:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:12 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:32:12.670 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:13.128 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:32:13.142 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:13.142 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:32:13.243 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:32:13.277 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:13.300 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:32:13.306 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:13.306 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:32:13.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:13 smithi022 ceph-mon[39439]: osdmap e237: 12 total, 12 up, 12 in 2024-04-01T19:32:13.407 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:32:13.438 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:13.460 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:32:13.463 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:13.464 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:32:13.535 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:32:13.565 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:32:13.576 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_blocked_ops 2024-04-01T19:32:13.587 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:32:13.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:13 smithi188 ceph-mon[43939]: osdmap e237: 12 total, 12 up, 12 in 2024-04-01T19:32:13.650 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:13.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:13 smithi062 ceph-mon[44211]: osdmap e237: 12 total, 12 up, 12 in 2024-04-01T19:32:14.525 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:32:14.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:14 smithi022 ceph-mon[39439]: pgmap v698: 17 pgs: 17 active+clean; 7.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:32:14.529 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:14.529 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:32:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:14 smithi188 ceph-mon[43939]: pgmap v698: 17 pgs: 17 active+clean; 7.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:32:14.630 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:32:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:14.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:14 smithi062 ceph-mon[44211]: pgmap v698: 17 pgs: 17 active+clean; 7.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:32:14.943 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:32:14.951 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:14.952 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:32:15.053 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:32:15.093 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:15.126 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:32:15.137 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:15.138 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:32:15.239 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:32:15.290 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:16.068 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:32:16.074 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:16.077 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:32:16.179 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:32:16.211 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:16.251 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:32:16.254 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:16.255 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:32:16.291 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:16 smithi022 ceph-mon[39439]: pgmap v699: 17 pgs: 17 active+clean; 6.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:32:16.355 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:32:16.406 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:16.435 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:32:16.440 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:16.441 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:32:16.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:16 smithi062 ceph-mon[44211]: pgmap v699: 17 pgs: 17 active+clean; 6.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:32:16.542 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:32:16.578 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:16 smithi188 ceph-mon[43939]: pgmap v699: 17 pgs: 17 active+clean; 6.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:32:16.586 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:16.608 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:32:16.611 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:16.612 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:32:16.713 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:32:16.751 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:16.773 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:32:16.775 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:16.776 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:32:16.790 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:32:16.877 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:32:16.946 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:17.092 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:32:17.096 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:17.096 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:32:17.198 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:32:17.273 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:17.303 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:32:17.304 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:32:17.307 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:17.308 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:32:17.339 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:32:17.342 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:32:17.351 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:17 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3074565147' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:32:17.351 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:17 smithi022 ceph-mon[39439]: from='client.25300 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:32:17.352 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:17 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2612148550' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:32:17.393 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:32:17.409 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:32:17.429 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:32:17.440 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:17.466 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:32:17.476 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:32:17.478 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:17.478 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:32:17.497 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:32:17.538 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:32:17.567 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:32:17.579 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:32:17.604 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:32:17.606 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:17 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3074565147' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:32:17.607 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:17 smithi062 ceph-mon[44211]: from='client.25300 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:32:17.607 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:17 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2612148550' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:32:17.609 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:17.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:17 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3074565147' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:32:17.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:17 smithi188 ceph-mon[43939]: from='client.25300 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:32:17.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:17 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2612148550' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:32:17.630 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:32:17.634 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:32:17.635 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:17.636 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:32:17.669 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:32:17.713 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:32:17.723 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:32:17.723 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:32:17.723 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:32:17.724 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:32:17.724 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:32:17.724 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:32:17.724 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:32:17.724 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:32:17.724 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:32:17.724 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:32:17.724 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:32:17.724 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:32:17.737 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:32:17.769 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:17.795 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:32:17.803 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:17.803 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:32:17.904 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:32:17.954 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:32:18.029 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:18.029 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:32:18.130 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:32:18.158 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:18.160 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 9, 10, 11, 8] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7, 9, 10, 11, 8] 2024-04-01T19:32:18.160 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-01T19:32:18.161 INFO:tasks.thrashosds.thrasher:inject_pause on osd.7 2024-04-01T19:32:18.161 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-01T19:32:18.161 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-01T19:32:18.161 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 config set filestore_inject_stall 3 2024-04-01T19:32:18.186 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:32:18.192 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:18.192 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:32:18.293 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:32:18.316 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:18 smithi022 ceph-mon[39439]: pgmap v700: 17 pgs: 17 active+clean; 6.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:32:18.317 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:18 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:32:18.317 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:18 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:32:18.317 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.317 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:18 smithi022 ceph-mon[39439]: from='client.25300 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:32:18.317 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:18 smithi022 ceph-mon[39439]: osdmap e238: 12 total, 12 up, 12 in 2024-04-01T19:32:18.317 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.317 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.317 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.317 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.317 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.317 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.317 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.318 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.318 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.318 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.336 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:18.441 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:32:18.444 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:18.444 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:32:18.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:18 smithi062 ceph-mon[44211]: pgmap v700: 17 pgs: 17 active+clean; 6.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:32:18.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:18 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:32:18.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:18 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:32:18.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:18 smithi062 ceph-mon[44211]: from='client.25300 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:32:18.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:18 smithi062 ceph-mon[44211]: osdmap e238: 12 total, 12 up, 12 in 2024-04-01T19:32:18.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.545 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:32:18.554 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:32:18.610 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:18.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:18 smithi188 ceph-mon[43939]: pgmap v700: 17 pgs: 17 active+clean; 6.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:32:18.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:18 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:32:18.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:18 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:32:18.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:18 smithi188 ceph-mon[43939]: from='client.25300 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:32:18.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:18 smithi188 ceph-mon[43939]: osdmap e238: 12 total, 12 up, 12 in 2024-04-01T19:32:18.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:32:18.869 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:18.870 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:32:18.971 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:32:19.003 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:19.030 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:32:19.036 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:19.037 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:32:19.138 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:32:19.171 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:19.201 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:32:19.207 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:19.207 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:32:19.308 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:32:19.329 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:19.330 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:19 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:32:19.330 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:19 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:32:19.349 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:19.375 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:32:19.377 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:19.378 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:32:19.479 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:32:19.510 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:19.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:19.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:19 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:32:19.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:19 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:32:19.537 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:32:19.543 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:19.543 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:32:19.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:19.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:19 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:32:19.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:19 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:32:19.644 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:32:19.702 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:20.060 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:32:20.071 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:20.071 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:32:20.172 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:32:20.203 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:20.225 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:32:20.227 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:20.228 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:32:20.329 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:32:20.389 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:20.428 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:32:20.431 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:20.431 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:32:20.532 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:32:20.537 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:32:20.538 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:32:20.538 INFO:teuthology.orchestra.run.smithi022.stdout: "complaint_time": 30, 2024-04-01T19:32:20.538 INFO:teuthology.orchestra.run.smithi022.stdout: "num_blocked_ops": 0 2024-04-01T19:32:20.538 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:32:20.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:20 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:32:20.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:20 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:32:20.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:20 smithi022 ceph-mon[39439]: pgmap v702: 17 pgs: 17 active+clean; 6.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:32:20.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:20 smithi022 ceph-mon[39439]: osdmap e239: 12 total, 12 up, 12 in 2024-04-01T19:32:20.583 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:20.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:20 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:32:20.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:20 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:32:20.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:20 smithi188 ceph-mon[43939]: pgmap v702: 17 pgs: 17 active+clean; 6.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:32:20.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:20 smithi188 ceph-mon[43939]: osdmap e239: 12 total, 12 up, 12 in 2024-04-01T19:32:20.718 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:32:20.719 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-01T19:32:20.719 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:32:20.735 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:20 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:32:20.735 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:20 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:32:20.735 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:20 smithi062 ceph-mon[44211]: pgmap v702: 17 pgs: 17 active+clean; 6.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:32:20.735 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:20 smithi062 ceph-mon[44211]: osdmap e239: 12 total, 12 up, 12 in 2024-04-01T19:32:20.751 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:32:20.758 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:20.758 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:32:20.859 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:32:20.908 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:21.365 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:32:21.374 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:21.374 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:32:21.411 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_historic_ops 2024-04-01T19:32:21.430 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:21 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:32:21.430 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:21 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:32:21.430 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:21 smithi062 ceph-mon[44211]: osdmap e240: 12 total, 12 up, 12 in 2024-04-01T19:32:21.452 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:32:21.475 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:32:21.521 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:21.543 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:32:21.546 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:21.546 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:32:21.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:21 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:32:21.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:21 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:32:21.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:21 smithi022 ceph-mon[39439]: osdmap e240: 12 total, 12 up, 12 in 2024-04-01T19:32:21.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:21 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:32:21.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:21 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:32:21.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:21 smithi188 ceph-mon[43939]: osdmap e240: 12 total, 12 up, 12 in 2024-04-01T19:32:21.647 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:32:21.744 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:21.766 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:32:21.770 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:21.771 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:32:21.872 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:32:21.900 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:21.926 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:32:21.926 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:32:21.929 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:21.930 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:32:21.949 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:32:21.952 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:32:22.030 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:32:22.089 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:22.339 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:22 smithi022 ceph-mon[39439]: pgmap v704: 17 pgs: 17 active+clean; 6.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.47k op/s 2024-04-01T19:32:22.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:22 smithi188 ceph-mon[43939]: pgmap v704: 17 pgs: 17 active+clean; 6.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.47k op/s 2024-04-01T19:32:22.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:22 smithi062 ceph-mon[44211]: pgmap v704: 17 pgs: 17 active+clean; 6.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.47k op/s 2024-04-01T19:32:24.561 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:32:24.565 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:24.565 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:32:24.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:24 smithi022 ceph-mon[39439]: pgmap v706: 17 pgs: 17 active+clean; 6.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:32:24.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:24 smithi188 ceph-mon[43939]: pgmap v706: 17 pgs: 17 active+clean; 6.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:32:24.666 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:32:24.699 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:24 smithi062 ceph-mon[44211]: pgmap v706: 17 pgs: 17 active+clean; 6.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:32:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:24.739 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:32:24.744 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:24.744 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:32:24.845 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:32:24.876 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:24.902 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:32:24.905 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:24.906 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:32:25.006 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:32:25.041 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:25.066 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:32:25.069 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:25.070 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:32:25.170 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:32:25.200 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:25.225 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:32:25.232 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:25.233 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:32:25.334 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:32:25.366 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:25.399 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:32:25.402 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:25.403 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:32:25.504 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:32:25.534 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:25.564 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:32:25.567 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:25.568 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:32:25.669 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:32:25.725 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:25.878 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:32:25.886 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:25.887 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:32:25.988 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:32:26.035 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:26.069 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:32:26.076 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:26.076 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:32:26.177 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:32:26.216 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:26.248 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:32:26.254 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:26.254 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:32:26.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:26 smithi022 ceph-mon[39439]: pgmap v707: 17 pgs: 17 active+clean; 6.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:32:26.348 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:26 smithi062 ceph-mon[44211]: pgmap v707: 17 pgs: 17 active+clean; 6.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:32:26.355 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:32:26.386 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:26.409 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:32:26.411 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:26.412 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:32:26.462 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 9, 10, 11, 8] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7, 9, 10, 11, 8] 2024-04-01T19:32:26.462 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 0 1 2024-04-01T19:32:26.513 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:32:26.542 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:26 smithi188 ceph-mon[43939]: pgmap v707: 17 pgs: 17 active+clean; 6.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:32:26.545 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:26.567 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:32:26.573 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:26.573 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:32:26.674 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:32:26.704 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:26.727 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:32:26.732 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:26.732 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:32:26.833 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:32:26.868 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:26.897 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:32:26.903 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:26.903 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:32:27.004 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:32:27.037 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:27.064 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:32:27.068 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:27.068 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:32:27.169 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:32:27.202 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:27.223 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:32:27.226 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:27.226 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:32:27.327 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:32:27.364 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:27.398 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:32:27.404 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:27.404 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:32:27.455 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:32:27.505 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:32:27.558 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:27.989 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:32:27.998 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:27.998 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:32:28.087 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:32:28.087 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:32:28.087 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:32:28.088 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:32:28.088 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:32:28.099 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:32:28.129 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:32:28.167 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:32:28.180 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:28.199 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:32:28.226 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:32:28.226 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 20, 2024-04-01T19:32:28.226 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 600, 2024-04-01T19:32:28.226 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:32:28.226 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.226 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:148125 2.e 2:727aed70:::benchmark_data_smithi188_77607_object148124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:32:28.226 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:14.449786+0000", 2024-04-01T19:32:28.226 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 373.30769862800003, 2024-04-01T19:32:28.226 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.049945237000000003, 2024-04-01T19:32:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 148125 2024-04-01T19:32:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.449786+0000", 2024-04-01T19:32:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.227 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.449786+0000", 2024-04-01T19:32:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.449788+0000", 2024-04-01T19:32:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.875e-06 2024-04-01T19:32:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.228 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.449809+0000", 2024-04-01T19:32:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1126999999999999e-05 2024-04-01T19:32:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.452528+0000", 2024-04-01T19:32:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0027194849999999998 2024-04-01T19:32:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:28.229 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.452540+0000", 2024-04-01T19:32:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1207e-05 2024-04-01T19:32:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.454578+0000", 2024-04-01T19:32:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0020383519999999998 2024-04-01T19:32:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.454669+0000", 2024-04-01T19:32:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.1056000000000004e-05 2024-04-01T19:32:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.230 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:32:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.454770+0000", 2024-04-01T19:32:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000100462 2024-04-01T19:32:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.461671+0000", 2024-04-01T19:32:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.006901903 2024-04-01T19:32:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.499605+0000", 2024-04-01T19:32:28.231 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.037933407000000002 2024-04-01T19:32:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.499664+0000", 2024-04-01T19:32:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9101999999999998e-05 2024-04-01T19:32:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.499731+0000", 2024-04-01T19:32:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.7261000000000005e-05 2024-04-01T19:32:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.232 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:148144 2.1 2:840a2df5:::benchmark_data_smithi188_77607_object148143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:32:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:14.462873+0000", 2024-04-01T19:32:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 373.29461118900002, 2024-04-01T19:32:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.052465008, 2024-04-01T19:32:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 148144 2024-04-01T19:32:28.233 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.462873+0000", 2024-04-01T19:32:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.462873+0000", 2024-04-01T19:32:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:28.234 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.462876+0000", 2024-04-01T19:32:28.235 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.525e-06 2024-04-01T19:32:28.235 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.235 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.235 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:28.235 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.463032+0000", 2024-04-01T19:32:28.235 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015644699999999999 2024-04-01T19:32:28.235 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.235 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.235 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:28.235 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.463043+0000", 2024-04-01T19:32:28.235 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0665999999999999e-05 2024-04-01T19:32:28.235 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.235 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.235 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:28.236 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.463052+0000", 2024-04-01T19:32:28.236 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.507e-06 2024-04-01T19:32:28.236 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.236 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.236 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:28.236 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.463109+0000", 2024-04-01T19:32:28.236 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7843999999999997e-05 2024-04-01T19:32:28.236 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.236 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.236 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:28.236 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.499448+0000", 2024-04-01T19:32:28.236 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.036338095000000001 2024-04-01T19:32:28.236 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.236 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.237 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:32:28.237 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.499686+0000", 2024-04-01T19:32:28.237 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00023816000000000001 2024-04-01T19:32:28.237 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.237 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.237 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:28.237 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.512811+0000", 2024-04-01T19:32:28.237 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.013125746000000001 2024-04-01T19:32:28.237 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.237 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.237 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:28.237 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.515229+0000", 2024-04-01T19:32:28.237 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0024171689999999998 2024-04-01T19:32:28.237 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.237 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.238 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:28.238 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.515287+0000", 2024-04-01T19:32:28.238 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8199999999999998e-05 2024-04-01T19:32:28.238 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.238 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.238 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:28.238 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.515338+0000", 2024-04-01T19:32:28.238 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.1649e-05 2024-04-01T19:32:28.238 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.238 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:28.238 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.238 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.238 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.238 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:148142 2.3 e134/106 2:c77187ad:::benchmark_data_smithi188_77607_object148141:head v 134'9255, mlcod=134'9253)", 2024-04-01T19:32:28.239 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:14.463631+0000", 2024-04-01T19:32:28.239 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 373.293854017, 2024-04-01T19:32:28.239 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.051623170000000003, 2024-04-01T19:32:28.239 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:28.239 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:28.239 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:28.239 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:28.239 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.239 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:28.239 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.463631+0000", 2024-04-01T19:32:28.239 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.239 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.240 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.240 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:28.240 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.463631+0000", 2024-04-01T19:32:28.240 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.240 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.240 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.240 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:28.240 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.463632+0000", 2024-04-01T19:32:28.240 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6530000000000001e-06 2024-04-01T19:32:28.240 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.240 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.240 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:28.240 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.463668+0000", 2024-04-01T19:32:28.241 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5592000000000001e-05 2024-04-01T19:32:28.241 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.241 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.241 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:28.241 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.499423+0000", 2024-04-01T19:32:28.241 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.035755376999999998 2024-04-01T19:32:28.241 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.241 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.241 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:28.241 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.499441+0000", 2024-04-01T19:32:28.241 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8185999999999998e-05 2024-04-01T19:32:28.241 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.242 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.242 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:28.242 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.499814+0000", 2024-04-01T19:32:28.242 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00037296399999999999 2024-04-01T19:32:28.242 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.242 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.242 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:28.242 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.499834+0000", 2024-04-01T19:32:28.242 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9579e-05 2024-04-01T19:32:28.242 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.242 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.242 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:28.242 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.515199+0000", 2024-04-01T19:32:28.243 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.015364568 2024-04-01T19:32:28.243 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.243 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.243 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:28.243 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.515254+0000", 2024-04-01T19:32:28.243 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5250999999999997e-05 2024-04-01T19:32:28.243 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.243 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:28.243 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.243 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.243 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.243 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:182858 2.1 2:836cb02a:::benchmark_data_smithi188_77607_object15454:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-04-01T19:32:28.244 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:49.449669+0000", 2024-04-01T19:32:28.244 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 338.307815484, 2024-04-01T19:32:28.244 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.046786688999999999, 2024-04-01T19:32:28.244 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:28.244 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:28.244 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:28.244 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:28.244 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:28.244 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:28.244 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 182858 2024-04-01T19:32:28.244 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.244 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:28.244 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.244 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:28.245 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.449669+0000", 2024-04-01T19:32:28.245 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.245 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.245 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.245 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:28.245 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.449669+0000", 2024-04-01T19:32:28.245 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.245 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.245 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.245 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:28.245 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.449671+0000", 2024-04-01T19:32:28.245 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2359999999999999e-06 2024-04-01T19:32:28.245 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.245 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.246 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:28.246 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.449677+0000", 2024-04-01T19:32:28.246 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6380000000000001e-06 2024-04-01T19:32:28.246 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.246 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.246 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:28.246 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.481599+0000", 2024-04-01T19:32:28.246 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.031921917000000001 2024-04-01T19:32:28.246 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.246 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.246 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:28.246 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.481613+0000", 2024-04-01T19:32:28.246 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4205999999999999e-05 2024-04-01T19:32:28.247 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.247 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.247 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:28.247 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.481790+0000", 2024-04-01T19:32:28.247 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000177057 2024-04-01T19:32:28.247 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.247 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.247 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:28.247 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.481914+0000", 2024-04-01T19:32:28.247 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012362000000000001 2024-04-01T19:32:28.247 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.247 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.247 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:32:28.247 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.482034+0000", 2024-04-01T19:32:28.248 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000119741 2024-04-01T19:32:28.248 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.248 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.248 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:28.248 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.496334+0000", 2024-04-01T19:32:28.248 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.01430058 2024-04-01T19:32:28.248 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.248 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.248 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:28.248 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.496352+0000", 2024-04-01T19:32:28.248 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7464000000000001e-05 2024-04-01T19:32:28.248 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.249 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.249 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:28.249 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.496405+0000", 2024-04-01T19:32:28.249 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3576999999999999e-05 2024-04-01T19:32:28.249 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.249 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.249 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:28.249 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.496456+0000", 2024-04-01T19:32:28.249 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0652999999999998e-05 2024-04-01T19:32:28.249 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.249 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:28.249 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.250 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.250 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.250 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:197050 2.e 2:7780661b:::benchmark_data_smithi188_77607_object29646:head [delete] snapc 0=[] ondisk+write+known_if_redirected e148)", 2024-04-01T19:32:28.250 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:27:01.163720+0000", 2024-04-01T19:32:28.250 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 326.593764894, 2024-04-01T19:32:28.250 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.046820833999999999, 2024-04-01T19:32:28.250 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:28.250 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:28.250 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:28.250 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:28.250 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:28.250 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:28.250 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 197050 2024-04-01T19:32:28.251 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.251 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:28.251 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.251 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:28.251 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.163720+0000", 2024-04-01T19:32:28.251 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.251 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.251 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.251 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:28.251 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.163720+0000", 2024-04-01T19:32:28.251 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.251 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.251 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.251 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:28.251 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.163722+0000", 2024-04-01T19:32:28.252 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6089999999999999e-06 2024-04-01T19:32:28.252 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.252 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.252 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:28.252 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.163732+0000", 2024-04-01T19:32:28.252 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.3260000000000002e-06 2024-04-01T19:32:28.252 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.252 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.252 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:28.252 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.163746+0000", 2024-04-01T19:32:28.252 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4139e-05 2024-04-01T19:32:28.252 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.252 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.252 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:28.253 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.163757+0000", 2024-04-01T19:32:28.253 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0974e-05 2024-04-01T19:32:28.253 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.253 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.253 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:28.253 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.175349+0000", 2024-04-01T19:32:28.253 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.011592259000000001 2024-04-01T19:32:28.253 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.253 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.253 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:28.253 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.175488+0000", 2024-04-01T19:32:28.253 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013927300000000001 2024-04-01T19:32:28.253 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.253 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.254 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:32:28.254 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.175619+0000", 2024-04-01T19:32:28.254 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013097900000000001 2024-04-01T19:32:28.254 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.254 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.254 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:28.254 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.202362+0000", 2024-04-01T19:32:28.254 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.026742955999999998 2024-04-01T19:32:28.254 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.254 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.254 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:28.255 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.210409+0000", 2024-04-01T19:32:28.255 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0080466349999999999 2024-04-01T19:32:28.255 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.255 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.255 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:28.255 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:32:28.256 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.210481+0000", 2024-04-01T19:32:28.256 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2395000000000001e-05 2024-04-01T19:32:28.256 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.256 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.256 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:28.256 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.210541+0000", 2024-04-01T19:32:28.256 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9289000000000001e-05 2024-04-01T19:32:28.257 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.257 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:28.257 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.257 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.257 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.257 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:201818 2.e 2:7ff9e1f3:::benchmark_data_smithi188_77607_object34414:head [delete] snapc 0=[] ondisk+write+known_if_redirected e148)", 2024-04-01T19:32:28.257 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:27:05.064418+0000", 2024-04-01T19:32:28.257 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 322.69306666699998, 2024-04-01T19:32:28.257 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.048457660999999999, 2024-04-01T19:32:28.257 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:28.257 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:28.257 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:28.257 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:28.258 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:28.258 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:28.258 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 201818 2024-04-01T19:32:28.258 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.258 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:28.258 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.258 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:28.258 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.064418+0000", 2024-04-01T19:32:28.258 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.258 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.258 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.258 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:28.258 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.064418+0000", 2024-04-01T19:32:28.259 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.259 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.259 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.259 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:28.259 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.064419+0000", 2024-04-01T19:32:28.259 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.1800000000000005e-07 2024-04-01T19:32:28.259 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.259 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.259 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:28.259 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.064423+0000", 2024-04-01T19:32:28.259 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.8700000000000002e-06 2024-04-01T19:32:28.259 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.259 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.259 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:28.260 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.064430+0000", 2024-04-01T19:32:28.260 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6310000000000003e-06 2024-04-01T19:32:28.260 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.260 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.260 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:28.260 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.064437+0000", 2024-04-01T19:32:28.260 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8190000000000003e-06 2024-04-01T19:32:28.260 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.260 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.260 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:28.260 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.069554+0000", 2024-04-01T19:32:28.260 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0051165179999999996 2024-04-01T19:32:28.260 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.260 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.261 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:28.261 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.069682+0000", 2024-04-01T19:32:28.261 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012807000000000001 2024-04-01T19:32:28.261 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.261 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.261 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:32:28.261 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.069803+0000", 2024-04-01T19:32:28.261 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012164599999999999 2024-04-01T19:32:28.261 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.261 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.261 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:28.262 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.083836+0000", 2024-04-01T19:32:28.262 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.01403278 2024-04-01T19:32:28.262 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.262 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.262 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:28.262 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.112759+0000", 2024-04-01T19:32:28.262 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.028923154999999999 2024-04-01T19:32:28.263 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.263 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.263 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:28.263 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.112824+0000", 2024-04-01T19:32:28.263 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4259999999999998e-05 2024-04-01T19:32:28.263 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.263 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.263 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:28.263 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.112876+0000", 2024-04-01T19:32:28.264 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2094e-05 2024-04-01T19:32:28.264 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.264 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:28.264 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.264 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.264 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.264 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:201822 2.e 2:7cf02010:::benchmark_data_smithi188_77607_object34418:head [delete] snapc 0=[] ondisk+write+known_if_redirected e148)", 2024-04-01T19:32:28.264 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:27:05.064446+0000", 2024-04-01T19:32:28.264 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 322.69303882700001, 2024-04-01T19:32:28.264 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.048558083000000002, 2024-04-01T19:32:28.264 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:28.264 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:28.264 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:28.264 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:28.265 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:28.265 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:28.265 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 201822 2024-04-01T19:32:28.265 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.265 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:28.265 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.265 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:28.265 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.064446+0000", 2024-04-01T19:32:28.265 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.265 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.265 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.265 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:28.265 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.064446+0000", 2024-04-01T19:32:28.266 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.266 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.266 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.266 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:28.266 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.064446+0000", 2024-04-01T19:32:28.266 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4899999999999995e-07 2024-04-01T19:32:28.266 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.266 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.266 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:28.266 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.064449+0000", 2024-04-01T19:32:28.266 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.988e-06 2024-04-01T19:32:28.267 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.267 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.267 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:28.267 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.064455+0000", 2024-04-01T19:32:28.267 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7100000000000004e-06 2024-04-01T19:32:28.267 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.267 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.267 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:28.267 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.064460+0000", 2024-04-01T19:32:28.267 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.775e-06 2024-04-01T19:32:28.267 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.267 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.267 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:28.268 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.074362+0000", 2024-04-01T19:32:28.268 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0099025829999999995 2024-04-01T19:32:28.268 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.268 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.268 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:28.268 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.074480+0000", 2024-04-01T19:32:28.268 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000117683 2024-04-01T19:32:28.268 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.268 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.268 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:32:28.268 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.074589+0000", 2024-04-01T19:32:28.268 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000108965 2024-04-01T19:32:28.268 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.268 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.269 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:28.269 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.083844+0000", 2024-04-01T19:32:28.269 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0092551260000000007 2024-04-01T19:32:28.269 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.269 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.269 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:28.269 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.112918+0000", 2024-04-01T19:32:28.269 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.029074164999999999 2024-04-01T19:32:28.269 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.269 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.269 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:28.270 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.112965+0000", 2024-04-01T19:32:28.270 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6723e-05 2024-04-01T19:32:28.270 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.270 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.270 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:28.270 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.113004+0000", 2024-04-01T19:32:28.270 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.8716e-05 2024-04-01T19:32:28.270 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.270 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:28.270 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.271 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.271 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.271 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:232287 2.1 2:8d72669b:::benchmark_data_smithi188_77607_object64883:head [delete] snapc 0=[] ondisk+write+known_if_redirected e154)", 2024-04-01T19:32:28.271 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:27:30.800564+0000", 2024-04-01T19:32:28.271 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 296.95692044499998, 2024-04-01T19:32:28.271 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.046309595000000002, 2024-04-01T19:32:28.271 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:28.271 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:28.271 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:28.271 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:28.271 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:28.272 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:28.272 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 232287 2024-04-01T19:32:28.272 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.272 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:28.272 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.272 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:28.272 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800564+0000", 2024-04-01T19:32:28.272 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.272 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.272 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.272 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:28.272 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800564+0000", 2024-04-01T19:32:28.272 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.273 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.273 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.273 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:28.273 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800568+0000", 2024-04-01T19:32:28.273 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.6059999999999999e-06 2024-04-01T19:32:28.273 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.273 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.273 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:28.273 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800577+0000", 2024-04-01T19:32:28.273 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.3719999999999994e-06 2024-04-01T19:32:28.273 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.273 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.273 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:28.274 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800595+0000", 2024-04-01T19:32:28.274 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8258999999999999e-05 2024-04-01T19:32:28.274 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.274 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.274 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:28.274 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800606+0000", 2024-04-01T19:32:28.274 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0438999999999999e-05 2024-04-01T19:32:28.274 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.274 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.274 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:28.274 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800678+0000", 2024-04-01T19:32:28.274 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2311000000000006e-05 2024-04-01T19:32:28.274 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.275 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.275 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:28.275 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800800+0000", 2024-04-01T19:32:28.275 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012170799999999999 2024-04-01T19:32:28.275 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.275 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.275 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:32:28.275 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800914+0000", 2024-04-01T19:32:28.276 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00011417900000000001 2024-04-01T19:32:28.276 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.276 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.276 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:28.276 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.811239+0000", 2024-04-01T19:32:28.276 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.01032488 2024-04-01T19:32:28.276 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.277 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.277 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:28.277 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.846752+0000", 2024-04-01T19:32:28.277 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.035513220999999998 2024-04-01T19:32:28.277 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.277 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.278 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:28.278 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.846818+0000", 2024-04-01T19:32:28.278 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.622e-05 2024-04-01T19:32:28.278 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.278 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.278 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:28.279 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.846874+0000", 2024-04-01T19:32:28.279 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5399999999999998e-05 2024-04-01T19:32:28.279 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.279 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:28.279 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.279 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.280 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.280 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:232296 2.1 2:8be978a8:::benchmark_data_smithi188_77607_object64892:head [delete] snapc 0=[] ondisk+write+known_if_redirected e154)", 2024-04-01T19:32:28.280 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:27:30.800663+0000", 2024-04-01T19:32:28.280 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 296.956821811, 2024-04-01T19:32:28.280 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.046350598999999999, 2024-04-01T19:32:28.280 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:28.281 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:28.281 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:28.281 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:28.281 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:28.281 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:28.281 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 232296 2024-04-01T19:32:28.282 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.282 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:28.282 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.282 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:28.282 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800663+0000", 2024-04-01T19:32:28.282 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.282 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.283 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.283 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:28.283 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800663+0000", 2024-04-01T19:32:28.283 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.283 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.283 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.283 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:28.284 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800663+0000", 2024-04-01T19:32:28.284 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.13e-07 2024-04-01T19:32:28.284 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.284 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.284 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:28.284 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800666+0000", 2024-04-01T19:32:28.284 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6869999999999999e-06 2024-04-01T19:32:28.284 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.284 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.285 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:28.285 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800671+0000", 2024-04-01T19:32:28.285 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0420000000000002e-06 2024-04-01T19:32:28.285 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.285 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.285 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:28.285 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800677+0000", 2024-04-01T19:32:28.285 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3430000000000001e-06 2024-04-01T19:32:28.285 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.285 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.286 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:28.286 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.806559+0000", 2024-04-01T19:32:28.286 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0058811560000000002 2024-04-01T19:32:28.286 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.286 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.286 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:28.286 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.806666+0000", 2024-04-01T19:32:28.286 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000107227 2024-04-01T19:32:28.286 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.286 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.286 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:32:28.286 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.806773+0000", 2024-04-01T19:32:28.287 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000107161 2024-04-01T19:32:28.287 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.287 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.287 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:28.287 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.811575+0000", 2024-04-01T19:32:28.287 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0048016730000000002 2024-04-01T19:32:28.287 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.287 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.287 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:28.287 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.846923+0000", 2024-04-01T19:32:28.287 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.035348836000000002 2024-04-01T19:32:28.287 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.287 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.287 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:28.288 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.846972+0000", 2024-04-01T19:32:28.288 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8501999999999997e-05 2024-04-01T19:32:28.288 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.288 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.288 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:28.288 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.847013+0000", 2024-04-01T19:32:28.288 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1458999999999997e-05 2024-04-01T19:32:28.288 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.288 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:28.288 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.288 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.288 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.288 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:236448 2.e 2:7dd5818f:::benchmark_data_smithi188_77607_object69044:head [delete] snapc 0=[] ondisk+write+known_if_redirected e155)", 2024-04-01T19:32:28.288 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:27:34.595552+0000", 2024-04-01T19:32:28.289 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 293.16193281300002, 2024-04-01T19:32:28.289 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.046592974000000002, 2024-04-01T19:32:28.289 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:28.289 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:28.289 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:28.289 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:28.289 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:28.289 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:28.289 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 236448 2024-04-01T19:32:28.289 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.289 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:28.289 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.289 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:28.289 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.595552+0000", 2024-04-01T19:32:28.290 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.290 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.290 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.290 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:28.290 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.595552+0000", 2024-04-01T19:32:28.290 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.290 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.290 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.290 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:28.290 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.595554+0000", 2024-04-01T19:32:28.290 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.605e-06 2024-04-01T19:32:28.290 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.290 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.291 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:28.291 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.595562+0000", 2024-04-01T19:32:28.291 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4390000000000003e-06 2024-04-01T19:32:28.291 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.291 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.291 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:28.291 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.596286+0000", 2024-04-01T19:32:28.291 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00072368599999999997 2024-04-01T19:32:28.291 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.291 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.291 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:28.291 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.596299+0000", 2024-04-01T19:32:28.291 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3777999999999999e-05 2024-04-01T19:32:28.292 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.292 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.292 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:28.292 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.600993+0000", 2024-04-01T19:32:28.292 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.004693305 2024-04-01T19:32:28.292 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.292 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.292 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:28.292 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.601134+0000", 2024-04-01T19:32:28.292 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014172800000000001 2024-04-01T19:32:28.292 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.292 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.293 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:32:28.293 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.601283+0000", 2024-04-01T19:32:28.293 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000148608 2024-04-01T19:32:28.293 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.293 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.293 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:28.293 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.620150+0000", 2024-04-01T19:32:28.293 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.018867053000000002 2024-04-01T19:32:28.293 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.293 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.293 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:28.293 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.642029+0000", 2024-04-01T19:32:28.293 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.021879292000000002 2024-04-01T19:32:28.293 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.294 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.294 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:28.294 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.642085+0000", 2024-04-01T19:32:28.294 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5547999999999997e-05 2024-04-01T19:32:28.294 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.294 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.294 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:28.294 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.642145+0000", 2024-04-01T19:32:28.294 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9932000000000001e-05 2024-04-01T19:32:28.294 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.294 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:28.294 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.294 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.295 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.295 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:236636 2.1 2:85594b38:::benchmark_data_smithi188_77607_object69232:head [delete] snapc 0=[] ondisk+write+known_if_redirected e155)", 2024-04-01T19:32:28.295 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:27:34.773335+0000", 2024-04-01T19:32:28.295 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 292.98415007099999, 2024-04-01T19:32:28.295 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.050238772000000001, 2024-04-01T19:32:28.295 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:28.295 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:28.295 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:28.295 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:28.295 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:28.295 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:28.295 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 236636 2024-04-01T19:32:28.295 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.295 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:28.296 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.296 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:28.296 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.773335+0000", 2024-04-01T19:32:28.296 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.296 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.296 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.296 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:28.297 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.773335+0000", 2024-04-01T19:32:28.297 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.297 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.297 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.297 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:28.297 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.773337+0000", 2024-04-01T19:32:28.297 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.599e-06 2024-04-01T19:32:28.297 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.297 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.297 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:28.297 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.773346+0000", 2024-04-01T19:32:28.297 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6060000000000003e-06 2024-04-01T19:32:28.298 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.298 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.298 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:28.298 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.773355+0000", 2024-04-01T19:32:28.298 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.1409999999999994e-06 2024-04-01T19:32:28.298 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.298 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.298 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:28.298 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.773364+0000", 2024-04-01T19:32:28.298 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6309999999999992e-06 2024-04-01T19:32:28.298 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.298 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.298 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:28.299 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.783612+0000", 2024-04-01T19:32:28.299 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010248889000000001 2024-04-01T19:32:28.299 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.299 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.299 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:28.299 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.783757+0000", 2024-04-01T19:32:28.299 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000144909 2024-04-01T19:32:28.299 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.299 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.299 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:32:28.299 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.783894+0000", 2024-04-01T19:32:28.299 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000136847 2024-04-01T19:32:28.299 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.299 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.300 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:28.300 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.798381+0000", 2024-04-01T19:32:28.300 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014486643 2024-04-01T19:32:28.300 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.300 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.300 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:28.300 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.823411+0000", 2024-04-01T19:32:28.300 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.025030196000000001 2024-04-01T19:32:28.300 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.300 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.300 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:28.300 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.823467+0000", 2024-04-01T19:32:28.300 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5779000000000002e-05 2024-04-01T19:32:28.300 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.300 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.301 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:28.301 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.823573+0000", 2024-04-01T19:32:28.301 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000106532 2024-04-01T19:32:28.301 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.301 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:28.301 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.301 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.301 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.301 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:236813 2.e 2:7a3c735d:::benchmark_data_smithi188_77607_object69409:head [delete] snapc 0=[] ondisk+write+known_if_redirected e155)", 2024-04-01T19:32:28.301 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:27:34.946539+0000", 2024-04-01T19:32:28.301 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 292.81094517399998, 2024-04-01T19:32:28.301 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.051207083, 2024-04-01T19:32:28.301 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:28.302 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:28.302 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:28.302 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:28.302 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:28.302 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:28.302 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 236813 2024-04-01T19:32:28.302 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.302 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:28.302 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.302 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:28.302 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.946539+0000", 2024-04-01T19:32:28.302 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.302 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.302 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.303 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:28.303 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.946539+0000", 2024-04-01T19:32:28.303 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.303 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.303 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.303 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:28.303 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.946541+0000", 2024-04-01T19:32:28.303 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4729999999999999e-06 2024-04-01T19:32:28.303 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.303 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.303 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:28.303 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.946546+0000", 2024-04-01T19:32:28.303 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.1309999999999997e-06 2024-04-01T19:32:28.304 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.304 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.304 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:28.304 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.946555+0000", 2024-04-01T19:32:28.304 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8580000000000006e-06 2024-04-01T19:32:28.304 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.304 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.304 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:28.304 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.946561+0000", 2024-04-01T19:32:28.304 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.896e-06 2024-04-01T19:32:28.304 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.304 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.305 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:28.305 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.951112+0000", 2024-04-01T19:32:28.305 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0045516059999999997 2024-04-01T19:32:28.305 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.305 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.305 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:28.306 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.951246+0000", 2024-04-01T19:32:28.306 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000133879 2024-04-01T19:32:28.306 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.306 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.306 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:32:28.306 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.951380+0000", 2024-04-01T19:32:28.307 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000134141 2024-04-01T19:32:28.307 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.307 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.307 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:28.307 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.967665+0000", 2024-04-01T19:32:28.307 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.016284653 2024-04-01T19:32:28.307 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.308 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.308 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:28.308 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.997615+0000", 2024-04-01T19:32:28.308 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.029949435999999999 2024-04-01T19:32:28.308 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.308 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.308 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:28.308 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.997673+0000", 2024-04-01T19:32:28.308 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8406999999999998e-05 2024-04-01T19:32:28.309 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.309 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.309 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:28.309 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.997747+0000", 2024-04-01T19:32:28.309 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3603000000000007e-05 2024-04-01T19:32:28.309 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.310 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:28.310 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.310 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.310 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.310 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:272244 2.e 2:79b429a3:::benchmark_data_smithi188_77607_object104840:head [delete] snapc 0=[] ondisk+write+known_if_redirected e176)", 2024-04-01T19:32:28.310 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:45.415475+0000", 2024-04-01T19:32:28.310 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 222.34200918900001, 2024-04-01T19:32:28.311 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.050565594999999998, 2024-04-01T19:32:28.311 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:28.311 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:28.311 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:28.311 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:28.311 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:28.311 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:28.312 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 272244 2024-04-01T19:32:28.312 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.312 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:28.312 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.312 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:28.312 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.415475+0000", 2024-04-01T19:32:28.313 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.313 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.313 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.313 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:28.313 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.415475+0000", 2024-04-01T19:32:28.313 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.313 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.314 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.314 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:28.314 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.415478+0000", 2024-04-01T19:32:28.314 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1299999999999999e-06 2024-04-01T19:32:28.314 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.314 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.315 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:28.315 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.415483+0000", 2024-04-01T19:32:28.315 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8000000000000004e-06 2024-04-01T19:32:28.315 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.315 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.315 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:28.315 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.415496+0000", 2024-04-01T19:32:28.315 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2471e-05 2024-04-01T19:32:28.316 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.316 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.316 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:28.316 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.415504+0000", 2024-04-01T19:32:28.316 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2870000000000004e-06 2024-04-01T19:32:28.316 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.316 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.317 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:28.317 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.424192+0000", 2024-04-01T19:32:28.317 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0086876260000000004 2024-04-01T19:32:28.317 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.317 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.317 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:28.318 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.424334+0000", 2024-04-01T19:32:28.318 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014255 2024-04-01T19:32:28.318 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.318 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.318 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:32:28.318 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.424457+0000", 2024-04-01T19:32:28.319 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000122392 2024-04-01T19:32:28.319 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.319 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.319 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:28.319 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.429468+0000", 2024-04-01T19:32:28.319 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0050116570000000001 2024-04-01T19:32:28.319 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.320 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.320 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:28.320 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.465945+0000", 2024-04-01T19:32:28.320 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.036476462000000001 2024-04-01T19:32:28.320 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.320 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.320 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:28.320 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.465997+0000", 2024-04-01T19:32:28.320 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2332e-05 2024-04-01T19:32:28.320 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.320 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.320 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:28.321 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.466041+0000", 2024-04-01T19:32:28.321 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.3887999999999997e-05 2024-04-01T19:32:28.321 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.321 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:28.321 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.321 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.321 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.321 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:272290 2.e 2:761d9cf9:::benchmark_data_smithi188_77607_object104886:head [delete] snapc 0=[] ondisk+write+known_if_redirected e176)", 2024-04-01T19:32:28.321 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:45.468074+0000", 2024-04-01T19:32:28.321 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 222.28941047500001, 2024-04-01T19:32:28.321 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.050318532999999999, 2024-04-01T19:32:28.321 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:28.321 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:28.321 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:28.322 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:28.322 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:28.322 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:28.322 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 272290 2024-04-01T19:32:28.322 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.322 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:28.322 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.322 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:28.322 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.468074+0000", 2024-04-01T19:32:28.322 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.322 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.322 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.323 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:28.323 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.468074+0000", 2024-04-01T19:32:28.323 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.323 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.323 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.323 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:28.323 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.468076+0000", 2024-04-01T19:32:28.323 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.466e-06 2024-04-01T19:32:28.323 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.323 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.323 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:28.323 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.468082+0000", 2024-04-01T19:32:28.323 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8129999999999998e-06 2024-04-01T19:32:28.323 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.324 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.324 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:28.324 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.468097+0000", 2024-04-01T19:32:28.324 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4507e-05 2024-04-01T19:32:28.324 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.324 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.324 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:28.324 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.468106+0000", 2024-04-01T19:32:28.324 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.4579999999999999e-06 2024-04-01T19:32:28.324 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.324 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.324 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:28.324 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.477321+0000", 2024-04-01T19:32:28.324 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0092145739999999997 2024-04-01T19:32:28.324 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.325 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.325 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:28.325 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.477450+0000", 2024-04-01T19:32:28.325 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012936800000000001 2024-04-01T19:32:28.325 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.325 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.325 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:32:28.325 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.477582+0000", 2024-04-01T19:32:28.325 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000131478 2024-04-01T19:32:28.325 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.325 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.325 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:28.325 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.493554+0000", 2024-04-01T19:32:28.325 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.015972058000000001 2024-04-01T19:32:28.326 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.326 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.326 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:28.326 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.518304+0000", 2024-04-01T19:32:28.326 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.024750488000000001 2024-04-01T19:32:28.326 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.326 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.326 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:28.326 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.518354+0000", 2024-04-01T19:32:28.326 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9367999999999999e-05 2024-04-01T19:32:28.326 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.326 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.326 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:28.327 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.518393+0000", 2024-04-01T19:32:28.329 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.8955000000000002e-05 2024-04-01T19:32:28.329 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.329 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:28.330 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.330 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.330 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.330 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:300312 2.e 2:716ae978:::benchmark_data_smithi188_77607_object132908:head [delete] snapc 0=[] ondisk+write+known_if_redirected e178)", 2024-04-01T19:32:28.330 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:29:08.401178+0000", 2024-04-01T19:32:28.330 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 199.35630675300001, 2024-04-01T19:32:28.330 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.049220369, 2024-04-01T19:32:28.330 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:28.330 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:28.330 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:28.330 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:28.331 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:28.331 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:28.331 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 300312 2024-04-01T19:32:28.331 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.331 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:28.331 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.331 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:28.331 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.401178+0000", 2024-04-01T19:32:28.331 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.332 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.332 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.332 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:28.332 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.401178+0000", 2024-04-01T19:32:28.332 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.332 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.332 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.332 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:28.332 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.401179+0000", 2024-04-01T19:32:28.332 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.8000000000000005e-07 2024-04-01T19:32:28.332 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.333 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.333 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:28.333 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.401182+0000", 2024-04-01T19:32:28.333 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.4300000000000002e-06 2024-04-01T19:32:28.333 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.333 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.333 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:28.333 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.401188+0000", 2024-04-01T19:32:28.333 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1099999999999999e-06 2024-04-01T19:32:28.333 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.333 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.333 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:28.334 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.401194+0000", 2024-04-01T19:32:28.334 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.524e-06 2024-04-01T19:32:28.334 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.334 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.334 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:28.334 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.406380+0000", 2024-04-01T19:32:28.334 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0051861520000000003 2024-04-01T19:32:28.334 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.334 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.334 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:28.334 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.406471+0000", 2024-04-01T19:32:28.334 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.0725999999999998e-05 2024-04-01T19:32:28.334 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.335 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.335 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:32:28.335 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.406636+0000", 2024-04-01T19:32:28.335 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000165661 2024-04-01T19:32:28.335 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.335 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.335 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:28.335 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.419064+0000", 2024-04-01T19:32:28.335 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.012427334 2024-04-01T19:32:28.335 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.335 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.335 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:28.335 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.450309+0000", 2024-04-01T19:32:28.335 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.031245430000000001 2024-04-01T19:32:28.336 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.336 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.336 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:28.336 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.450360+0000", 2024-04-01T19:32:28.336 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.1180999999999997e-05 2024-04-01T19:32:28.336 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.336 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.336 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:28.336 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.450398+0000", 2024-04-01T19:32:28.336 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.8040999999999997e-05 2024-04-01T19:32:28.336 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.336 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:28.336 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.336 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.337 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.337 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:301225 2.e 2:7b326bf1:::benchmark_data_smithi188_77607_object133821:head [delete] snapc 0=[] ondisk+write+known_if_redirected e178)", 2024-04-01T19:32:28.337 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:29:09.267563+0000", 2024-04-01T19:32:28.337 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 198.48992146500001, 2024-04-01T19:32:28.337 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.048005921999999999, 2024-04-01T19:32:28.337 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:28.337 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:28.337 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:28.337 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:28.337 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:28.337 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:28.337 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 301225 2024-04-01T19:32:28.337 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.337 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:28.338 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.338 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:28.338 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.267563+0000", 2024-04-01T19:32:28.338 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.338 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.338 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.338 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:28.338 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.267563+0000", 2024-04-01T19:32:28.338 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.338 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.338 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.338 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:28.338 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.267565+0000", 2024-04-01T19:32:28.338 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.852e-06 2024-04-01T19:32:28.339 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.339 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.339 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:28.339 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.267571+0000", 2024-04-01T19:32:28.339 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9900000000000002e-06 2024-04-01T19:32:28.339 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.339 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.339 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:28.339 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.267579+0000", 2024-04-01T19:32:28.339 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9810000000000003e-06 2024-04-01T19:32:28.339 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.340 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.340 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:28.340 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.267585+0000", 2024-04-01T19:32:28.340 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8769999999999998e-06 2024-04-01T19:32:28.340 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.340 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.340 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:28.340 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.277378+0000", 2024-04-01T19:32:28.340 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0097929509999999994 2024-04-01T19:32:28.340 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.340 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.340 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:28.340 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.277529+0000", 2024-04-01T19:32:28.340 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015084399999999999 2024-04-01T19:32:28.341 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.341 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.341 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:32:28.341 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.277659+0000", 2024-04-01T19:32:28.341 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000130104 2024-04-01T19:32:28.341 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.341 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.341 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:28.341 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.292550+0000", 2024-04-01T19:32:28.341 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014891570999999999 2024-04-01T19:32:28.341 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.341 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.341 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:28.342 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.315456+0000", 2024-04-01T19:32:28.342 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.022905966 2024-04-01T19:32:28.342 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.342 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.342 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:28.342 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.315518+0000", 2024-04-01T19:32:28.342 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1946999999999995e-05 2024-04-01T19:32:28.342 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.342 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.342 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:28.342 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.315569+0000", 2024-04-01T19:32:28.342 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0838999999999999e-05 2024-04-01T19:32:28.343 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.343 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:28.343 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.343 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.343 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.343 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:301805 2.e 2:72d0a49b:::benchmark_data_smithi188_77607_object134401:head [delete] snapc 0=[] ondisk+write+known_if_redirected e178)", 2024-04-01T19:32:28.343 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:29:09.764063+0000", 2024-04-01T19:32:28.343 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 197.993421539, 2024-04-01T19:32:28.343 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.048788630999999999, 2024-04-01T19:32:28.343 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:28.343 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:28.343 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:28.343 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:28.343 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:28.344 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:28.344 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 301805 2024-04-01T19:32:28.344 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.344 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:28.344 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.344 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:28.344 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.764063+0000", 2024-04-01T19:32:28.344 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.344 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.344 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.344 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:28.344 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.764063+0000", 2024-04-01T19:32:28.344 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.345 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.345 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.345 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:28.345 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.764064+0000", 2024-04-01T19:32:28.345 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.7900000000000007e-07 2024-04-01T19:32:28.345 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.345 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.345 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:28.345 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.764068+0000", 2024-04-01T19:32:28.345 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7799999999999998e-06 2024-04-01T19:32:28.345 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.345 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.345 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:28.345 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.764075+0000", 2024-04-01T19:32:28.346 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4449999999999999e-06 2024-04-01T19:32:28.346 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.346 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.346 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:28.346 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.764082+0000", 2024-04-01T19:32:28.346 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2960000000000004e-06 2024-04-01T19:32:28.346 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.346 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.346 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:28.346 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.773422+0000", 2024-04-01T19:32:28.346 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0093401969999999997 2024-04-01T19:32:28.346 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.346 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.347 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:28.347 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.773573+0000", 2024-04-01T19:32:28.347 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015120199999999999 2024-04-01T19:32:28.347 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.347 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.347 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:32:28.347 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.773713+0000", 2024-04-01T19:32:28.347 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000139865 2024-04-01T19:32:28.347 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.347 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.347 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:28.347 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.786903+0000", 2024-04-01T19:32:28.347 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.013190584 2024-04-01T19:32:28.348 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.348 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.348 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:28.348 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.812750+0000", 2024-04-01T19:32:28.348 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.025846583999999999 2024-04-01T19:32:28.348 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.348 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.348 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:28.348 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.812802+0000", 2024-04-01T19:32:28.348 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2459e-05 2024-04-01T19:32:28.348 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.348 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.348 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:28.348 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.812852+0000", 2024-04-01T19:32:28.348 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9240000000000003e-05 2024-04-01T19:32:28.349 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.349 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:28.349 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.349 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.349 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.349 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:306726 2.e 2:79113c24:::benchmark_data_smithi188_77607_object139322:head [delete] snapc 0=[] ondisk+write+known_if_redirected e178)", 2024-04-01T19:32:28.349 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:29:13.913545+0000", 2024-04-01T19:32:28.349 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 193.843939734, 2024-04-01T19:32:28.349 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.050671905000000003, 2024-04-01T19:32:28.349 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:28.349 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:28.350 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:28.350 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:28.350 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:28.350 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:28.350 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 306726 2024-04-01T19:32:28.350 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.350 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:28.350 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.350 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:28.350 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.913545+0000", 2024-04-01T19:32:28.350 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.350 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.351 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.351 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:28.351 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.913545+0000", 2024-04-01T19:32:28.351 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.351 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.351 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.351 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:28.351 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.913547+0000", 2024-04-01T19:32:28.351 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0499999999999999e-06 2024-04-01T19:32:28.351 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.351 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.351 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:28.351 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.913553+0000", 2024-04-01T19:32:28.352 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3430000000000001e-06 2024-04-01T19:32:28.352 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.352 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.352 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:28.352 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.913568+0000", 2024-04-01T19:32:28.352 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5203e-05 2024-04-01T19:32:28.352 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.352 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.352 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:28.352 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.913577+0000", 2024-04-01T19:32:28.352 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5469999999999997e-06 2024-04-01T19:32:28.352 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.352 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.353 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:28.353 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.919575+0000", 2024-04-01T19:32:28.353 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0059976980000000001 2024-04-01T19:32:28.353 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.353 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.353 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:28.353 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.919903+0000", 2024-04-01T19:32:28.353 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00032790500000000003 2024-04-01T19:32:28.353 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.353 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.353 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:32:28.353 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.920023+0000", 2024-04-01T19:32:28.353 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000120109 2024-04-01T19:32:28.353 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.354 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.354 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:28.354 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.951401+0000", 2024-04-01T19:32:28.354 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.031378389 2024-04-01T19:32:28.354 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.354 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.354 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:28.354 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.964118+0000", 2024-04-01T19:32:28.354 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.012716732 2024-04-01T19:32:28.354 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.354 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.354 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:28.354 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.964167+0000", 2024-04-01T19:32:28.354 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9450999999999998e-05 2024-04-01T19:32:28.355 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.355 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.355 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:28.355 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.964217+0000", 2024-04-01T19:32:28.355 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9478000000000003e-05 2024-04-01T19:32:28.355 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.355 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:28.355 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.355 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.355 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.355 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:309229 2.e 2:7489af3c:::benchmark_data_smithi188_77607_object141825:head [delete] snapc 0=[] ondisk+write+known_if_redirected e178)", 2024-04-01T19:32:28.355 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:29:16.042337+0000", 2024-04-01T19:32:28.355 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 191.715147839, 2024-04-01T19:32:28.355 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.046542255999999997, 2024-04-01T19:32:28.356 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:28.356 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:28.356 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:28.356 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:28.356 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:28.356 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:28.356 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 309229 2024-04-01T19:32:28.356 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.356 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:28.356 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.356 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:28.356 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.042337+0000", 2024-04-01T19:32:28.356 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.356 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.357 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.357 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:28.357 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.042337+0000", 2024-04-01T19:32:28.357 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.357 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.357 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.357 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:28.357 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.042338+0000", 2024-04-01T19:32:28.357 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2669999999999999e-06 2024-04-01T19:32:28.357 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.357 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.357 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:28.357 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.042342+0000", 2024-04-01T19:32:28.357 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1540000000000004e-06 2024-04-01T19:32:28.358 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.358 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.358 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:28.358 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.042350+0000", 2024-04-01T19:32:28.358 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.1559999999999995e-06 2024-04-01T19:32:28.358 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.358 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.358 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:28.358 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.042356+0000", 2024-04-01T19:32:28.358 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2920000000000003e-06 2024-04-01T19:32:28.358 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.358 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.358 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:28.359 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.045688+0000", 2024-04-01T19:32:28.359 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0033320670000000002 2024-04-01T19:32:28.359 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.359 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.359 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:28.359 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.045795+0000", 2024-04-01T19:32:28.359 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000107699 2024-04-01T19:32:28.359 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.359 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.359 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:32:28.359 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.045880+0000", 2024-04-01T19:32:28.359 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4809999999999996e-05 2024-04-01T19:32:28.359 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.359 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.359 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:28.360 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.056662+0000", 2024-04-01T19:32:28.360 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010782112 2024-04-01T19:32:28.360 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.360 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.360 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:28.360 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.088778+0000", 2024-04-01T19:32:28.360 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.032115519000000002 2024-04-01T19:32:28.360 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.360 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.360 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:28.360 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.088835+0000", 2024-04-01T19:32:28.360 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6718999999999997e-05 2024-04-01T19:32:28.360 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.361 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.361 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:28.361 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.088879+0000", 2024-04-01T19:32:28.361 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4461e-05 2024-04-01T19:32:28.361 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.361 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:28.361 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.361 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.361 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.361 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:334314 2.e 2:7a4c3578:::benchmark_data_smithi188_77607_object166910:head [delete] snapc 0=[] ondisk+write+known_if_redirected e184)", 2024-04-01T19:32:28.361 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:29:36.442582+0000", 2024-04-01T19:32:28.361 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 171.314902356, 2024-04-01T19:32:28.361 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.051087360999999998, 2024-04-01T19:32:28.362 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:32:28.362 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:32:28.362 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:32:28.362 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:32:28.362 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:32:28.362 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:32:28.362 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 334314 2024-04-01T19:32:28.362 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.362 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:32:28.363 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.363 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:32:28.363 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.442582+0000", 2024-04-01T19:32:28.363 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.363 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.363 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.363 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:32:28.364 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.442582+0000", 2024-04-01T19:32:28.364 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:32:28.364 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.364 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.364 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:32:28.364 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.442583+0000", 2024-04-01T19:32:28.365 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4700000000000001e-07 2024-04-01T19:32:28.365 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.365 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.365 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:32:28.365 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.442586+0000", 2024-04-01T19:32:28.365 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.8839999999999998e-06 2024-04-01T19:32:28.365 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.365 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.365 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:32:28.366 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.442591+0000", 2024-04-01T19:32:28.366 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2789999999999998e-06 2024-04-01T19:32:28.366 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.366 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.366 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:32:28.366 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.442596+0000", 2024-04-01T19:32:28.366 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0320000000000003e-06 2024-04-01T19:32:28.366 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.366 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.366 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:32:28.366 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.453743+0000", 2024-04-01T19:32:28.366 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.011147186999999999 2024-04-01T19:32:28.367 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.367 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.367 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:32:28.367 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.453814+0000", 2024-04-01T19:32:28.367 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0879999999999999e-05 2024-04-01T19:32:28.367 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.367 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.367 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:32:28.367 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.453942+0000", 2024-04-01T19:32:28.367 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012826800000000001 2024-04-01T19:32:28.367 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.367 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.367 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:32:28.368 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.467551+0000", 2024-04-01T19:32:28.368 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.013608128000000001 2024-04-01T19:32:28.368 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.368 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.368 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:32:28.368 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.493550+0000", 2024-04-01T19:32:28.368 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.025998996999999999 2024-04-01T19:32:28.368 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.368 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.368 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:32:28.368 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.493609+0000", 2024-04-01T19:32:28.368 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9737000000000001e-05 2024-04-01T19:32:28.368 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:32:28.368 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:32:28.368 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:32:28.369 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.493670+0000", 2024-04-01T19:32:28.369 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0322000000000003e-05 2024-04-01T19:32:28.369 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.369 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:28.369 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.369 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:32:28.369 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:32:28.369 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:32:28.370 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:32:28.370 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:32:28.370 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:32:28.370 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:32:28.371 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:32:28.371 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:32:28.371 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:32:28.371 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:32:28.371 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:32:28.371 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:32:28.371 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:32:28.371 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:32:28.371 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:32:28.371 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:32:28.371 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:32:28.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:28 smithi022 ceph-mon[39439]: pgmap v708: 17 pgs: 17 active+clean; 6.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.28k op/s 2024-04-01T19:32:28.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:28 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/300764172' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:32:28.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:28 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:28.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:28 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:28 smithi188 ceph-mon[43939]: pgmap v708: 17 pgs: 17 active+clean; 6.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.28k op/s 2024-04-01T19:32:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:28 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/300764172' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:32:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:28 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:28 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:28 smithi062 ceph-mon[44211]: pgmap v708: 17 pgs: 17 active+clean; 6.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.28k op/s 2024-04-01T19:32:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:28 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/300764172' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:32:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:28 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:28 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.379 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_ops_in_flight 2024-04-01T19:32:29.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:29 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:32:29.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:29 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:32:29.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:29 smithi022 ceph-mon[39439]: osdmap e241: 12 total, 12 up, 12 in 2024-04-01T19:32:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:29 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:32:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:29 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:32:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:29 smithi188 ceph-mon[43939]: osdmap e241: 12 total, 12 up, 12 in 2024-04-01T19:32:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:29 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:32:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:29 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:32:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:29.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:29 smithi062 ceph-mon[44211]: osdmap e241: 12 total, 12 up, 12 in 2024-04-01T19:32:30.387 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:32:30.392 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:30.392 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:32:30.393 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:32:30.494 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:32:30.547 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:30 smithi062 ceph-mon[44211]: pgmap v710: 17 pgs: 17 active+clean; 5.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:32:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:30 smithi062 ceph-mon[44211]: 3.4 scrub starts 2024-04-01T19:32:30.822 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:30 smithi022 ceph-mon[39439]: pgmap v710: 17 pgs: 17 active+clean; 5.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:32:30.822 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:30 smithi022 ceph-mon[39439]: 3.4 scrub starts 2024-04-01T19:32:30.823 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:32:30.833 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:30.833 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:32:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:30 smithi188 ceph-mon[43939]: pgmap v710: 17 pgs: 17 active+clean; 5.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:32:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:30 smithi188 ceph-mon[43939]: 3.4 scrub starts 2024-04-01T19:32:30.935 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:32:31.001 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:31.466 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:32:31.475 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:31.476 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:32:31.577 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:32:31.644 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:31.727 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:32:31.735 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:31.735 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:32:31.836 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:32:31.869 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:31.892 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:32:31.896 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:31.896 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:32:31.997 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:32:32.054 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:32.401 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: pgmap v711: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.27k op/s 2024-04-01T19:32:32.401 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: 3.4 scrub ok 2024-04-01T19:32:32.401 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2603378515' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:32:32.401 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: from='client.25309 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:32:32.402 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {auth=30,config=2,health=12,kv=53,logm=3} crc {auth=4014662136,config=3313370793,health=861809967,kv=2412141721,logm=1138223061}) 2024-04-01T19:32:32.402 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=332103200}) 2024-04-01T19:32:32.402 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1205781036}) 2024-04-01T19:32:32.402 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=5971898}) 2024-04-01T19:32:32.402 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2806730361}) 2024-04-01T19:32:32.402 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2978858200}) 2024-04-01T19:32:32.402 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2647882599}) 2024-04-01T19:32:32.402 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=970661265}) 2024-04-01T19:32:32.402 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3692052178}) 2024-04-01T19:32:32.402 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4258404689}) 2024-04-01T19:32:32.402 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2600761267}) 2024-04-01T19:32:32.403 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3496120447}) 2024-04-01T19:32:32.403 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1075560331}) 2024-04-01T19:32:32.403 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2450953941}) 2024-04-01T19:32:32.403 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1185574248}) 2024-04-01T19:32:32.403 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=280606763}) 2024-04-01T19:32:32.403 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=246648625}) 2024-04-01T19:32:32.403 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2945326615}) 2024-04-01T19:32:32.403 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2797585607}) 2024-04-01T19:32:32.403 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=695276527}) 2024-04-01T19:32:32.403 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=790657602}) 2024-04-01T19:32:32.403 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2759284727}) 2024-04-01T19:32:32.403 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1017074114}) 2024-04-01T19:32:32.403 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1055995577}) 2024-04-01T19:32:32.403 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1841741634}) 2024-04-01T19:32:32.404 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4060748382}) 2024-04-01T19:32:32.404 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3640458045}) 2024-04-01T19:32:32.404 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2765855047}) 2024-04-01T19:32:32.404 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3067366513}) 2024-04-01T19:32:32.404 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3864698684}) 2024-04-01T19:32:32.404 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=6788625}) 2024-04-01T19:32:32.404 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3665700489}) 2024-04-01T19:32:32.404 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3662991117}) 2024-04-01T19:32:32.404 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2865051796}) 2024-04-01T19:32:32.404 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1226498177}) 2024-04-01T19:32:32.404 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2504892582}) 2024-04-01T19:32:32.404 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=98,mdsmap=2} crc {logm=4049158168,mdsmap=1401145748}) 2024-04-01T19:32:32.405 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mdsmap=1,mgr=18,mgr_command_descs=1,mgr_metadata=2,mgrstat=9,mon_config_key=69} crc {mdsmap=1228700967,mgr=1734247563,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=2119189355,mon_config_key=2999758455}) 2024-04-01T19:32:32.405 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=969979395}) 2024-04-01T19:32:32.405 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=3212360292}) 2024-04-01T19:32:32.405 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=17,monmap=5,osd_metadata=12,osd_pg_creating=1,osdmap=65} crc {mon_config_key=2571585895,monmap=3338646291,osd_metadata=1571792687,osd_pg_creating=3545770193,osdmap=909431414}) 2024-04-01T19:32:32.405 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=44} crc {osdmap=1421494362}) 2024-04-01T19:32:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:32:32.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: pgmap v711: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.27k op/s 2024-04-01T19:32:32.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: 3.4 scrub ok 2024-04-01T19:32:32.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2603378515' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:32:32.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: from='client.25309 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:32:32.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {auth=30,config=2,health=12,kv=53,logm=3} crc {auth=4014662136,config=3313370793,health=861809967,kv=2412141721,logm=1138223061}) 2024-04-01T19:32:32.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=332103200}) 2024-04-01T19:32:32.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1205781036}) 2024-04-01T19:32:32.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=5971898}) 2024-04-01T19:32:32.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2806730361}) 2024-04-01T19:32:32.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2978858200}) 2024-04-01T19:32:32.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2647882599}) 2024-04-01T19:32:32.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=970661265}) 2024-04-01T19:32:32.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3692052178}) 2024-04-01T19:32:32.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4258404689}) 2024-04-01T19:32:32.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2600761267}) 2024-04-01T19:32:32.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3496120447}) 2024-04-01T19:32:32.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1075560331}) 2024-04-01T19:32:32.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2450953941}) 2024-04-01T19:32:32.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1185574248}) 2024-04-01T19:32:32.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=280606763}) 2024-04-01T19:32:32.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=246648625}) 2024-04-01T19:32:32.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2945326615}) 2024-04-01T19:32:32.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2797585607}) 2024-04-01T19:32:32.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=695276527}) 2024-04-01T19:32:32.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=790657602}) 2024-04-01T19:32:32.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2759284727}) 2024-04-01T19:32:32.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1017074114}) 2024-04-01T19:32:32.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1055995577}) 2024-04-01T19:32:32.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1841741634}) 2024-04-01T19:32:32.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4060748382}) 2024-04-01T19:32:32.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3640458045}) 2024-04-01T19:32:32.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2765855047}) 2024-04-01T19:32:32.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3067366513}) 2024-04-01T19:32:32.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3864698684}) 2024-04-01T19:32:32.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=6788625}) 2024-04-01T19:32:32.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3665700489}) 2024-04-01T19:32:32.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3662991117}) 2024-04-01T19:32:32.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2865051796}) 2024-04-01T19:32:32.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1226498177}) 2024-04-01T19:32:32.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2504892582}) 2024-04-01T19:32:32.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=98,mdsmap=2} crc {logm=4049158168,mdsmap=1401145748}) 2024-04-01T19:32:32.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mdsmap=1,mgr=18,mgr_command_descs=1,mgr_metadata=2,mgrstat=9,mon_config_key=69} crc {mdsmap=1228700967,mgr=1734247563,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=2119189355,mon_config_key=2999758455}) 2024-04-01T19:32:32.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=969979395}) 2024-04-01T19:32:32.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=3212360292}) 2024-04-01T19:32:32.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=17,monmap=5,osd_metadata=12,osd_pg_creating=1,osdmap=65} crc {mon_config_key=2571585895,monmap=3338646291,osd_metadata=1571792687,osd_pg_creating=3545770193,osdmap=909431414}) 2024-04-01T19:32:32.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=44} crc {osdmap=1421494362}) 2024-04-01T19:32:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: pgmap v711: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.27k op/s 2024-04-01T19:32:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: 3.4 scrub ok 2024-04-01T19:32:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2603378515' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:32:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: from='client.25309 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:32:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {auth=30,config=2,health=12,kv=53,logm=3} crc {auth=4014662136,config=3313370793,health=861809967,kv=2412141721,logm=1138223061}) 2024-04-01T19:32:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=332103200}) 2024-04-01T19:32:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1205781036}) 2024-04-01T19:32:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=5971898}) 2024-04-01T19:32:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2806730361}) 2024-04-01T19:32:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2978858200}) 2024-04-01T19:32:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2647882599}) 2024-04-01T19:32:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=970661265}) 2024-04-01T19:32:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3692052178}) 2024-04-01T19:32:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4258404689}) 2024-04-01T19:32:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2600761267}) 2024-04-01T19:32:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3496120447}) 2024-04-01T19:32:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1075560331}) 2024-04-01T19:32:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2450953941}) 2024-04-01T19:32:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1185574248}) 2024-04-01T19:32:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=280606763}) 2024-04-01T19:32:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=246648625}) 2024-04-01T19:32:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2945326615}) 2024-04-01T19:32:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2797585607}) 2024-04-01T19:32:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=695276527}) 2024-04-01T19:32:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=790657602}) 2024-04-01T19:32:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2759284727}) 2024-04-01T19:32:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1017074114}) 2024-04-01T19:32:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1055995577}) 2024-04-01T19:32:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1841741634}) 2024-04-01T19:32:32.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4060748382}) 2024-04-01T19:32:32.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3640458045}) 2024-04-01T19:32:32.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2765855047}) 2024-04-01T19:32:32.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3067366513}) 2024-04-01T19:32:32.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3864698684}) 2024-04-01T19:32:32.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=6788625}) 2024-04-01T19:32:32.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3665700489}) 2024-04-01T19:32:32.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3662991117}) 2024-04-01T19:32:32.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2865051796}) 2024-04-01T19:32:32.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1226498177}) 2024-04-01T19:32:32.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2504892582}) 2024-04-01T19:32:32.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=98,mdsmap=2} crc {logm=4049158168,mdsmap=1401145748}) 2024-04-01T19:32:32.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mdsmap=1,mgr=18,mgr_command_descs=1,mgr_metadata=2,mgrstat=9,mon_config_key=69} crc {mdsmap=1228700967,mgr=1734247563,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=2119189355,mon_config_key=2999758455}) 2024-04-01T19:32:32.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=969979395}) 2024-04-01T19:32:32.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=3212360292}) 2024-04-01T19:32:32.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=17,monmap=5,osd_metadata=12,osd_pg_creating=1,osdmap=65} crc {mon_config_key=2571585895,monmap=3338646291,osd_metadata=1571792687,osd_pg_creating=3545770193,osdmap=909431414}) 2024-04-01T19:32:32.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=44} crc {osdmap=1421494362}) 2024-04-01T19:32:32.862 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:32:33.608 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:32:33.645 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:33 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:32:33.645 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:33 smithi022 ceph-mon[39439]: from='client.25309 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:32:33.645 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:33 smithi022 ceph-mon[39439]: osdmap e242: 12 total, 12 up, 12 in 2024-04-01T19:32:33.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:33 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:32:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:33 smithi062 ceph-mon[44211]: from='client.25309 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:32:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:33 smithi062 ceph-mon[44211]: osdmap e242: 12 total, 12 up, 12 in 2024-04-01T19:32:33.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:33 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:32:33.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:33 smithi188 ceph-mon[43939]: from='client.25309 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:32:33.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:33 smithi188 ceph-mon[43939]: osdmap e242: 12 total, 12 up, 12 in 2024-04-01T19:32:34.134 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:32:34.145 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:34.146 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:32:34.247 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:32:34.301 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:34.438 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.0 to 1 (10000) 2024-04-01T19:32:34.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:34 smithi062 ceph-mon[44211]: pgmap v713: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.27k op/s 2024-04-01T19:32:34.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:34 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3986251625' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T19:32:34.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:34 smithi062 ceph-mon[44211]: from='client.25312 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T19:32:34.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:34 smithi022 ceph-mon[39439]: pgmap v713: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.27k op/s 2024-04-01T19:32:34.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:34 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3986251625' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T19:32:34.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:34 smithi022 ceph-mon[39439]: from='client.25312 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T19:32:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:34 smithi188 ceph-mon[43939]: pgmap v713: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.27k op/s 2024-04-01T19:32:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:34 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3986251625' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T19:32:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:34 smithi188 ceph-mon[43939]: from='client.25312 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T19:32:34.928 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:32:35.598 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:32:35.601 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 1 1 2024-04-01T19:32:35.605 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:35.606 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:32:35.647 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:32:35.693 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:35 smithi022 ceph-mon[39439]: from='client.25312 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-04-01T19:32:35.693 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:35 smithi022 ceph-mon[39439]: osdmap e243: 12 total, 12 up, 12 in 2024-04-01T19:32:35.706 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:32:35.739 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:35 smithi188 ceph-mon[43939]: from='client.25312 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-04-01T19:32:35.739 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:35 smithi188 ceph-mon[43939]: osdmap e243: 12 total, 12 up, 12 in 2024-04-01T19:32:35.742 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:35.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:35 smithi062 ceph-mon[44211]: from='client.25312 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-04-01T19:32:35.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:35 smithi062 ceph-mon[44211]: osdmap e243: 12 total, 12 up, 12 in 2024-04-01T19:32:35.761 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:32:35.767 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:35.767 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:32:35.868 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:32:35.901 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:35.923 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:32:35.925 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:35.926 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:32:36.027 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:32:36.057 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:36.086 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:32:36.089 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:36.090 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:32:36.190 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:32:36.258 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:36.309 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:32:36.315 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:36.316 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:32:36.417 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:32:36.448 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:36 smithi022 ceph-mon[39439]: pgmap v715: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.02k op/s 2024-04-01T19:32:36.469 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:36.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:36 smithi062 ceph-mon[44211]: pgmap v715: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.02k op/s 2024-04-01T19:32:36.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:36 smithi188 ceph-mon[43939]: pgmap v715: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.02k op/s 2024-04-01T19:32:37.715 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:32:37.716 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:32:38.243 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:32:38.262 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:38.263 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:32:38.363 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:32:38.394 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:38.427 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:32:38.431 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:38.431 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:32:38.532 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:32:38.573 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:38.713 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_blocked_ops 2024-04-01T19:32:38.717 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:38 smithi022 ceph-mon[39439]: pgmap v716: 17 pgs: 17 active+clean; 5.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:32:38.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:38 smithi062 ceph-mon[44211]: pgmap v716: 17 pgs: 17 active+clean; 5.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:32:38.792 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:32:38.793 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:32:38.793 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:32:38.793 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:32:38.793 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:32:38.793 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:32:38.793 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:32:38.793 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:32:38.810 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:32:38.815 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:32:38.837 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:32:38.841 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:32:38.847 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:38.848 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:32:38.868 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:32:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:38 smithi188 ceph-mon[43939]: pgmap v716: 17 pgs: 17 active+clean; 5.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:32:38.910 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:32:38.942 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:32:38.949 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:32:38.949 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:32:38.949 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:32:38.950 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:32:38.950 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:32:38.950 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:32:38.950 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:32:38.950 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:32:38.950 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:32:38.950 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:32:38.950 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:32:38.950 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:32:38.950 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:32:38.982 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:39.013 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:32:39.018 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:39.018 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:32:39.119 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:32:39.160 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:39.187 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:32:39.197 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:39.198 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:32:39.299 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:32:39.328 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:39.350 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:32:39.356 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:39.356 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:32:39.457 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:32:39.504 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:39.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:39 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1716636828' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:32:39.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:39 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1716636828' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:32:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:39 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1716636828' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:32:39.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:39.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:40.166 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:32:40.172 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:40.172 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:32:40.273 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:32:40.334 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:40 smithi062 ceph-mon[44211]: pgmap v717: 17 pgs: 17 active+clean; 5.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.11k op/s 2024-04-01T19:32:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:40.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:40.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:40 smithi022 ceph-mon[39439]: pgmap v717: 17 pgs: 17 active+clean; 5.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.11k op/s 2024-04-01T19:32:40.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:40.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:40.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:40.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:40 smithi188 ceph-mon[43939]: pgmap v717: 17 pgs: 17 active+clean; 5.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.11k op/s 2024-04-01T19:32:40.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:40.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:41.844 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:32:41.847 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:41.847 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:32:41.947 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:32:41.948 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:32:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:42.164 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:32:42.178 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:42.179 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:32:42.280 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:32:42.316 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:42.344 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:32:42.350 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:42.350 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:32:42.451 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:32:42.475 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:42 smithi022 ceph-mon[39439]: pgmap v718: 17 pgs: 17 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.38k op/s 2024-04-01T19:32:42.514 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:42 smithi188 ceph-mon[43939]: pgmap v718: 17 pgs: 17 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.38k op/s 2024-04-01T19:32:42.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:42 smithi062 ceph-mon[44211]: pgmap v718: 17 pgs: 17 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.38k op/s 2024-04-01T19:32:43.508 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:32:44.596 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:32:44.607 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:44 smithi022 ceph-mon[39439]: pgmap v719: 17 pgs: 17 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.24k op/s 2024-04-01T19:32:44.608 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:44.608 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:32:44.709 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:32:44.741 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:44 smithi062 ceph-mon[44211]: pgmap v719: 17 pgs: 17 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.24k op/s 2024-04-01T19:32:44.744 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:44.778 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:32:44.780 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:44.780 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:32:44.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:44 smithi188 ceph-mon[43939]: pgmap v719: 17 pgs: 17 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.24k op/s 2024-04-01T19:32:44.881 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:32:44.945 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:44.981 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:32:44.988 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:44.988 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:32:45.089 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:32:45.122 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:45.159 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:32:45.162 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:45.162 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:32:45.235 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:32:45.262 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:32:45.296 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:45.329 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:32:45.336 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:45.336 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:32:45.438 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:32:45.473 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:45.486 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:45 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2259740134' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:32:45.486 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:45 smithi022 ceph-mon[39439]: from='client.25324 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:32:45.501 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:32:45.507 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:45.507 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:32:45.519 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:32:45.608 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:32:45.642 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:45.674 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:32:45.678 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:45.679 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:32:45.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:45 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2259740134' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:32:45.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:45 smithi062 ceph-mon[44211]: from='client.25324 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:32:45.779 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:32:45.825 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:45.854 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:32:45.857 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:45.857 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:32:45.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:45 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2259740134' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:32:45.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:45 smithi188 ceph-mon[43939]: from='client.25324 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:32:45.958 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:32:45.999 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:46.027 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:32:46.030 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:46.030 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:32:46.131 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:32:46.200 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:46.246 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:32:46.249 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:46.250 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:32:46.351 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:32:46.384 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:46.403 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:32:46.406 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:46.406 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:32:46.507 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:32:46.539 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:46.566 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:32:46.569 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:46.569 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:32:46.670 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:32:46.702 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:46.737 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:46.737 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:32:46.738 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:32:46.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:46 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:32:46.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:46 smithi062 ceph-mon[44211]: from='client.25324 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:32:46.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:46 smithi062 ceph-mon[44211]: osdmap e244: 12 total, 12 up, 12 in 2024-04-01T19:32:46.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:46 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:32:46.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:46 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:32:46.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:46 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:32:46.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:46 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:32:46.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:46 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:32:46.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:46 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:32:46.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:46 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:32:46.839 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:32:46.845 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:46 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:32:46.845 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:46 smithi022 ceph-mon[39439]: from='client.25324 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:32:46.845 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:46 smithi022 ceph-mon[39439]: osdmap e244: 12 total, 12 up, 12 in 2024-04-01T19:32:46.845 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:32:46.845 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:32:46.845 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:32:46.845 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:32:46.845 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:32:46.846 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:32:46.846 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:46 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:32:46.867 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:46 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:32:46.868 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:46 smithi188 ceph-mon[43939]: from='client.25324 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:32:46.868 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:46 smithi188 ceph-mon[43939]: osdmap e244: 12 total, 12 up, 12 in 2024-04-01T19:32:46.868 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:46 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:32:46.868 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:46 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:32:46.868 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:46 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:32:46.868 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:46 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:32:46.868 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:46 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:32:46.868 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:46 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:32:46.868 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:46 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:32:46.875 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:46.898 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:32:46.904 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:46.905 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:32:47.005 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:32:47.037 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:47.064 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:32:47.068 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:47.069 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:32:47.170 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:32:47.199 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:47.227 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:32:47.229 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:47.230 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:32:47.331 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:32:47.376 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:47.409 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:32:47.412 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:47.413 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:32:47.508 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:47 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3855459499' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T19:32:47.508 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:47 smithi188 ceph-mon[43939]: from='client.35348 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T19:32:47.514 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:32:47.514 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.1 to 1 (10000) 2024-04-01T19:32:47.547 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:47.580 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:32:47.583 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:47.584 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:32:47.685 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:32:47.729 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:47.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:47 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3855459499' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T19:32:47.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:47 smithi062 ceph-mon[44211]: from='client.35348 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T19:32:47.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:47 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3855459499' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T19:32:47.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:47 smithi022 ceph-mon[39439]: from='client.35348 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T19:32:47.988 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:32:47.992 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:47.992 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:32:48.093 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:32:48.126 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:48.152 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:32:48.155 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:48.155 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:32:48.256 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:32:48.292 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:48.321 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:32:48.323 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:48.324 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:32:48.413 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:32:48.413 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:32:48.413 INFO:teuthology.orchestra.run.smithi022.stdout: "complaint_time": 30, 2024-04-01T19:32:48.413 INFO:teuthology.orchestra.run.smithi022.stdout: "num_blocked_ops": 0 2024-04-01T19:32:48.413 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:32:48.424 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:32:48.478 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:48.506 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:32:48.509 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:48.510 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:32:48.611 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:32:48.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:48 smithi022 ceph-mon[39439]: pgmap v722: 17 pgs: 17 active+clean; 4.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.26k op/s 2024-04-01T19:32:48.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:48 smithi022 ceph-mon[39439]: from='client.35348 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-04-01T19:32:48.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:48 smithi022 ceph-mon[39439]: osdmap e245: 12 total, 12 up, 12 in 2024-04-01T19:32:48.665 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:48.740 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:32:48.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:48 smithi062 ceph-mon[44211]: pgmap v722: 17 pgs: 17 active+clean; 4.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.26k op/s 2024-04-01T19:32:48.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:48 smithi062 ceph-mon[44211]: from='client.35348 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-04-01T19:32:48.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:48 smithi062 ceph-mon[44211]: osdmap e245: 12 total, 12 up, 12 in 2024-04-01T19:32:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:48 smithi188 ceph-mon[43939]: pgmap v722: 17 pgs: 17 active+clean; 4.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.26k op/s 2024-04-01T19:32:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:48 smithi188 ceph-mon[43939]: from='client.35348 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-04-01T19:32:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:48 smithi188 ceph-mon[43939]: osdmap e245: 12 total, 12 up, 12 in 2024-04-01T19:32:49.219 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:32:49.227 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:49.228 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:32:49.329 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:32:49.329 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:32:49.358 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:32:49.369 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:49.395 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:32:49.396 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:32:49.401 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:49.401 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:32:49.425 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:32:49.464 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:32:49.502 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:32:49.504 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:32:49.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:49 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1418729' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:32:49.537 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:32:49.542 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:49.572 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:32:49.583 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:32:49.591 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:49.592 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:32:49.606 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:32:49.641 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 2 1 2024-04-01T19:32:49.641 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:32:49.665 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:32:49.692 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:32:49.702 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:32:49.717 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:32:49.717 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:32:49.717 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:32:49.717 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:32:49.718 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:32:49.718 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:32:49.718 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:32:49.718 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:32:49.718 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:32:49.718 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:32:49.718 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:32:49.718 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:32:49.751 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:49.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:49 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1418729' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:32:49.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:49 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1418729' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:32:50.115 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_historic_ops 2024-04-01T19:32:50.363 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:32:50.526 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:50 smithi062 ceph-mon[44211]: pgmap v724: 17 pgs: 17 active+clean; 4.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:32:50.526 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.527 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.527 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.527 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.527 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.527 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.527 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.527 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.527 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.527 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.527 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.527 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.630 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:32:50.641 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:50.641 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:32:50.742 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:32:50.774 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:50.797 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:32:50.801 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:50.802 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:32:50.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:50 smithi022 ceph-mon[39439]: pgmap v724: 17 pgs: 17 active+clean; 4.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:32:50.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:50 smithi188 ceph-mon[43939]: pgmap v724: 17 pgs: 17 active+clean; 4.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:32:50.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:32:50.902 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:32:50.941 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:50.969 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:32:50.972 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:50.972 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:32:51.074 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:32:51.114 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:51.188 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:32:51.198 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:51.199 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:32:51.300 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:32:51.334 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:51.359 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:32:51.363 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:51.363 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:32:51.465 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:32:51.529 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:51.644 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:32:51.650 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:51.651 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:32:51.751 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:32:51.781 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:51.807 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:32:51.810 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:51.810 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:32:51.911 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:32:51.954 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:52.073 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:32:52.080 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:32:52.081 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:52.081 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:32:52.182 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:32:52.237 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:52.352 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:32:52.362 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:52.362 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:32:52.395 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:32:52.464 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:32:52.506 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:52.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:52 smithi022 ceph-mon[39439]: pgmap v725: 17 pgs: 17 active+clean; 4.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.44k op/s 2024-04-01T19:32:52.656 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:32:52.662 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:52.662 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:32:52.763 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:32:52.833 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:52.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:52 smithi188 ceph-mon[43939]: pgmap v725: 17 pgs: 17 active+clean; 4.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.44k op/s 2024-04-01T19:32:52.986 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:32:52.996 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:52.997 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:32:53.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:52 smithi062 ceph-mon[44211]: pgmap v725: 17 pgs: 17 active+clean; 4.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.44k op/s 2024-04-01T19:32:53.097 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:32:53.128 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:53.159 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:32:53.162 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:53.163 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:32:53.220 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:32:53.263 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:32:53.302 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:53.331 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:32:53.334 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:53.334 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:32:53.435 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:32:53.471 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:53.495 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:32:53.497 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:53.497 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:32:53.548 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:53 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/698748338' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:32:53.548 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:53 smithi022 ceph-mon[39439]: from='client.35357 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:32:53.579 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:32:53.599 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:32:53.629 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:53.658 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:32:53.661 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:53.661 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:32:53.762 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:32:53.790 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:53 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/698748338' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:32:53.790 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:53 smithi188 ceph-mon[43939]: from='client.35357 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:32:53.791 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:53.813 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:32:53.817 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:53.817 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:32:53.918 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:32:53.968 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:53 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/698748338' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:32:53.969 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:53 smithi062 ceph-mon[44211]: from='client.35357 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:32:53.977 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:54.013 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:32:54.016 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:54.016 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:32:54.117 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:32:54.156 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:54.190 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:32:54.193 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:54.193 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:32:54.294 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:32:54.325 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:54.347 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:32:54.354 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:54.354 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:32:54.455 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:32:54.533 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:54.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:54 smithi188 ceph-mon[43939]: pgmap v726: 17 pgs: 17 active+clean; 4.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.24k op/s 2024-04-01T19:32:54.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:54 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:32:54.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:54 smithi188 ceph-mon[43939]: from='client.35357 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:32:54.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:54 smithi188 ceph-mon[43939]: osdmap e246: 12 total, 12 up, 12 in 2024-04-01T19:32:54.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:54 smithi188 ceph-mon[43939]: 3.d scrub starts 2024-04-01T19:32:54.807 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:54 smithi022 ceph-mon[39439]: pgmap v726: 17 pgs: 17 active+clean; 4.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.24k op/s 2024-04-01T19:32:54.807 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:54 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:32:54.808 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:54 smithi022 ceph-mon[39439]: from='client.35357 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:32:54.808 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:54 smithi022 ceph-mon[39439]: osdmap e246: 12 total, 12 up, 12 in 2024-04-01T19:32:54.808 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:54 smithi022 ceph-mon[39439]: 3.d scrub starts 2024-04-01T19:32:54.816 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:32:54.825 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:54.826 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:32:54.927 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:32:54.956 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:54 smithi062 ceph-mon[44211]: pgmap v726: 17 pgs: 17 active+clean; 4.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.24k op/s 2024-04-01T19:32:54.957 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:54 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:32:54.957 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:54 smithi062 ceph-mon[44211]: from='client.35357 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:32:54.957 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:54 smithi062 ceph-mon[44211]: osdmap e246: 12 total, 12 up, 12 in 2024-04-01T19:32:54.957 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:54 smithi062 ceph-mon[44211]: 3.d scrub starts 2024-04-01T19:32:54.961 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:54.991 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:32:54.994 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:54.994 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:32:55.095 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:32:55.161 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:55.647 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.2 to 1 (10000) 2024-04-01T19:32:55.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:55 smithi022 ceph-mon[39439]: 3.d scrub ok 2024-04-01T19:32:55.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:55 smithi022 ceph-mon[39439]: 3.6 scrub starts 2024-04-01T19:32:55.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:55 smithi188 ceph-mon[43939]: 3.d scrub ok 2024-04-01T19:32:55.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:55 smithi188 ceph-mon[43939]: 3.6 scrub starts 2024-04-01T19:32:56.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:55 smithi062 ceph-mon[44211]: 3.d scrub ok 2024-04-01T19:32:56.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:55 smithi062 ceph-mon[44211]: 3.6 scrub starts 2024-04-01T19:32:56.156 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:32:56.164 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:56.164 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:32:56.265 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:32:56.306 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:56.335 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:32:56.338 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:56.338 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:32:56.439 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:32:56.502 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:56.632 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:32:56.646 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:32:56.647 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:32:56.671 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:32:56.749 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:32:56.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:56 smithi022 ceph-mon[39439]: pgmap v728: 17 pgs: 17 active+clean; 3.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:32:56.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:56 smithi022 ceph-mon[39439]: 3.6 scrub ok 2024-04-01T19:32:56.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:56 smithi022 ceph-mon[39439]: 3.1 scrub starts 2024-04-01T19:32:56.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:56 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/468324097' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:32:56.761 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:56 smithi022 ceph-mon[39439]: from='client.25339 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:32:56.761 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:56 smithi022 ceph-mon[39439]: from='client.25339 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-04-01T19:32:56.761 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:56 smithi022 ceph-mon[39439]: osdmap e247: 12 total, 12 up, 12 in 2024-04-01T19:32:56.819 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:32:56.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:56 smithi188 ceph-mon[43939]: pgmap v728: 17 pgs: 17 active+clean; 3.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:32:56.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:56 smithi188 ceph-mon[43939]: 3.6 scrub ok 2024-04-01T19:32:56.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:56 smithi188 ceph-mon[43939]: 3.1 scrub starts 2024-04-01T19:32:56.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:56 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/468324097' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:32:56.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:56 smithi188 ceph-mon[43939]: from='client.25339 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:32:56.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:56 smithi188 ceph-mon[43939]: from='client.25339 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-04-01T19:32:56.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:56 smithi188 ceph-mon[43939]: osdmap e247: 12 total, 12 up, 12 in 2024-04-01T19:32:57.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:56 smithi062 ceph-mon[44211]: pgmap v728: 17 pgs: 17 active+clean; 3.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:32:57.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:56 smithi062 ceph-mon[44211]: 3.6 scrub ok 2024-04-01T19:32:57.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:56 smithi062 ceph-mon[44211]: 3.1 scrub starts 2024-04-01T19:32:57.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:56 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/468324097' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:32:57.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:56 smithi062 ceph-mon[44211]: from='client.25339 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:32:57.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:56 smithi062 ceph-mon[44211]: from='client.25339 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-04-01T19:32:57.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:56 smithi062 ceph-mon[44211]: osdmap e247: 12 total, 12 up, 12 in 2024-04-01T19:32:57.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:57 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:32:57.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:57 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:32:57.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:57 smithi188 ceph-mon[43939]: 3.1 scrub ok 2024-04-01T19:32:57.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:57 smithi188 ceph-mon[43939]: 3.2 scrub starts 2024-04-01T19:32:57.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:57 smithi188 ceph-mon[43939]: osdmap e248: 12 total, 12 up, 12 in 2024-04-01T19:32:57.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:57 smithi188 ceph-mon[43939]: 3.9 scrub starts 2024-04-01T19:32:58.015 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:57 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:32:58.015 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:57 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:32:58.015 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:57 smithi062 ceph-mon[44211]: 3.1 scrub ok 2024-04-01T19:32:58.015 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:57 smithi062 ceph-mon[44211]: 3.2 scrub starts 2024-04-01T19:32:58.015 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:57 smithi062 ceph-mon[44211]: osdmap e248: 12 total, 12 up, 12 in 2024-04-01T19:32:58.015 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:57 smithi062 ceph-mon[44211]: 3.9 scrub starts 2024-04-01T19:32:58.016 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:57 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:32:58.016 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:57 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:32:58.016 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:57 smithi022 ceph-mon[39439]: 3.1 scrub ok 2024-04-01T19:32:58.016 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:57 smithi022 ceph-mon[39439]: 3.2 scrub starts 2024-04-01T19:32:58.016 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:57 smithi022 ceph-mon[39439]: osdmap e248: 12 total, 12 up, 12 in 2024-04-01T19:32:58.016 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:57 smithi022 ceph-mon[39439]: 3.9 scrub starts 2024-04-01T19:32:58.051 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 3 1 2024-04-01T19:32:58.202 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:32:58.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:58 smithi188 ceph-mon[43939]: pgmap v731: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 3.7 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:32:58.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:58 smithi188 ceph-mon[43939]: 3.a scrub starts 2024-04-01T19:32:58.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:58 smithi188 ceph-mon[43939]: 3.2 scrub ok 2024-04-01T19:32:58.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:58 smithi188 ceph-mon[43939]: 3.a scrub ok 2024-04-01T19:32:58.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:58 smithi188 ceph-mon[43939]: 3.9 scrub ok 2024-04-01T19:32:59.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:58 smithi062 ceph-mon[44211]: pgmap v731: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 3.7 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:32:59.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:58 smithi062 ceph-mon[44211]: 3.a scrub starts 2024-04-01T19:32:59.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:58 smithi062 ceph-mon[44211]: 3.2 scrub ok 2024-04-01T19:32:59.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:58 smithi062 ceph-mon[44211]: 3.a scrub ok 2024-04-01T19:32:59.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:58 smithi062 ceph-mon[44211]: 3.9 scrub ok 2024-04-01T19:32:59.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:58 smithi022 ceph-mon[39439]: pgmap v731: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 3.7 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:32:59.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:58 smithi022 ceph-mon[39439]: 3.a scrub starts 2024-04-01T19:32:59.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:58 smithi022 ceph-mon[39439]: 3.2 scrub ok 2024-04-01T19:32:59.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:58 smithi022 ceph-mon[39439]: 3.a scrub ok 2024-04-01T19:32:59.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:58 smithi022 ceph-mon[39439]: 3.9 scrub ok 2024-04-01T19:32:59.415 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:32:59.415 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:33:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:59 smithi062 ceph-mon[44211]: 3.7 scrub starts 2024-04-01T19:33:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:59 smithi062 ceph-mon[44211]: 3.5 scrub starts 2024-04-01T19:33:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:32:59 smithi062 ceph-mon[44211]: 3.3 scrub starts 2024-04-01T19:33:00.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:59 smithi022 ceph-mon[39439]: 3.7 scrub starts 2024-04-01T19:33:00.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:59 smithi022 ceph-mon[39439]: 3.5 scrub starts 2024-04-01T19:33:00.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:32:59 smithi022 ceph-mon[39439]: 3.3 scrub starts 2024-04-01T19:33:00.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:59 smithi188 ceph-mon[43939]: 3.7 scrub starts 2024-04-01T19:33:00.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:59 smithi188 ceph-mon[43939]: 3.5 scrub starts 2024-04-01T19:33:00.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:32:59 smithi188 ceph-mon[43939]: 3.3 scrub starts 2024-04-01T19:33:01.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:00 smithi062 ceph-mon[44211]: pgmap v732: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 3.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.32k op/s 2024-04-01T19:33:01.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:00 smithi062 ceph-mon[44211]: 3.7 scrub ok 2024-04-01T19:33:01.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:00 smithi062 ceph-mon[44211]: 3.8 scrub starts 2024-04-01T19:33:01.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:00 smithi062 ceph-mon[44211]: 3.b scrub starts 2024-04-01T19:33:01.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:00 smithi062 ceph-mon[44211]: 3.5 scrub ok 2024-04-01T19:33:01.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:00 smithi062 ceph-mon[44211]: 3.3 scrub ok 2024-04-01T19:33:01.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:00 smithi022 ceph-mon[39439]: pgmap v732: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 3.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.32k op/s 2024-04-01T19:33:01.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:00 smithi022 ceph-mon[39439]: 3.7 scrub ok 2024-04-01T19:33:01.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:00 smithi022 ceph-mon[39439]: 3.8 scrub starts 2024-04-01T19:33:01.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:00 smithi022 ceph-mon[39439]: 3.b scrub starts 2024-04-01T19:33:01.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:00 smithi022 ceph-mon[39439]: 3.5 scrub ok 2024-04-01T19:33:01.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:00 smithi022 ceph-mon[39439]: 3.3 scrub ok 2024-04-01T19:33:01.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:00 smithi188 ceph-mon[43939]: pgmap v732: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 3.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.32k op/s 2024-04-01T19:33:01.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:00 smithi188 ceph-mon[43939]: 3.7 scrub ok 2024-04-01T19:33:01.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:00 smithi188 ceph-mon[43939]: 3.8 scrub starts 2024-04-01T19:33:01.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:00 smithi188 ceph-mon[43939]: 3.b scrub starts 2024-04-01T19:33:01.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:00 smithi188 ceph-mon[43939]: 3.5 scrub ok 2024-04-01T19:33:01.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:00 smithi188 ceph-mon[43939]: 3.3 scrub ok 2024-04-01T19:33:02.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:01 smithi062 ceph-mon[44211]: 3.8 scrub ok 2024-04-01T19:33:02.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:01 smithi062 ceph-mon[44211]: 3.b scrub ok 2024-04-01T19:33:02.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:01 smithi062 ceph-mon[44211]: 3.e scrub starts 2024-04-01T19:33:02.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:01 smithi022 ceph-mon[39439]: 3.8 scrub ok 2024-04-01T19:33:02.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:01 smithi022 ceph-mon[39439]: 3.b scrub ok 2024-04-01T19:33:02.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:01 smithi022 ceph-mon[39439]: 3.e scrub starts 2024-04-01T19:33:02.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:01 smithi188 ceph-mon[43939]: 3.8 scrub ok 2024-04-01T19:33:02.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:01 smithi188 ceph-mon[43939]: 3.b scrub ok 2024-04-01T19:33:02.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:01 smithi188 ceph-mon[43939]: 3.e scrub starts 2024-04-01T19:33:03.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:02 smithi062 ceph-mon[44211]: pgmap v733: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 3.4 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.27k op/s 2024-04-01T19:33:03.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:02 smithi062 ceph-mon[44211]: 3.e scrub ok 2024-04-01T19:33:03.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:02 smithi022 ceph-mon[39439]: pgmap v733: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 3.4 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.27k op/s 2024-04-01T19:33:03.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:02 smithi022 ceph-mon[39439]: 3.e scrub ok 2024-04-01T19:33:03.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:02 smithi188 ceph-mon[43939]: pgmap v733: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 3.4 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.27k op/s 2024-04-01T19:33:03.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:02 smithi188 ceph-mon[43939]: 3.e scrub ok 2024-04-01T19:33:04.379 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:33:04.397 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:04.397 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:33:04.423 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_ops_in_flight 2024-04-01T19:33:04.498 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:33:04.545 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:04.611 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:33:04.613 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:04.614 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:33:04.648 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:04 smithi022 ceph-mon[39439]: pgmap v734: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 3.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:33:04.648 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:04 smithi022 ceph-mon[39439]: 3.0 scrub starts 2024-04-01T19:33:04.648 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:04 smithi022 ceph-mon[39439]: 3.c scrub starts 2024-04-01T19:33:04.648 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:04 smithi022 ceph-mon[39439]: 3.c scrub ok 2024-04-01T19:33:04.715 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:33:04.755 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:04.757 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:04 smithi062 ceph-mon[44211]: pgmap v734: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 3.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:33:04.757 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:04 smithi062 ceph-mon[44211]: 3.0 scrub starts 2024-04-01T19:33:04.757 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:04 smithi062 ceph-mon[44211]: 3.c scrub starts 2024-04-01T19:33:04.757 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:04 smithi062 ceph-mon[44211]: 3.c scrub ok 2024-04-01T19:33:04.802 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:33:04.811 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:04.811 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:33:04.840 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:33:04.912 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:33:04.953 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:05.003 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:33:05.012 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:33:05.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:04 smithi188 ceph-mon[43939]: pgmap v734: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 3.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:33:05.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:04 smithi188 ceph-mon[43939]: 3.0 scrub starts 2024-04-01T19:33:05.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:04 smithi188 ceph-mon[43939]: 3.c scrub starts 2024-04-01T19:33:05.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:04 smithi188 ceph-mon[43939]: 3.c scrub ok 2024-04-01T19:33:05.157 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:33:05.160 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:05.161 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:33:05.262 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:33:05.291 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:05.318 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:33:05.324 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:05.324 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:33:05.425 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:33:05.454 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:05.478 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:33:05.481 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:05.481 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:33:05.582 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:33:05.633 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:05.660 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:05 smithi062 ceph-mon[44211]: 3.0 scrub ok 2024-04-01T19:33:05.661 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:05 smithi062 ceph-mon[44211]: 3.f scrub starts 2024-04-01T19:33:05.661 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:05 smithi062 ceph-mon[44211]: 3.f scrub ok 2024-04-01T19:33:05.835 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:33:05.843 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:05.843 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:33:05.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:05 smithi022 ceph-mon[39439]: 3.0 scrub ok 2024-04-01T19:33:05.854 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:05 smithi022 ceph-mon[39439]: 3.f scrub starts 2024-04-01T19:33:05.854 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:05 smithi022 ceph-mon[39439]: 3.f scrub ok 2024-04-01T19:33:05.944 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:33:06.013 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:05 smithi188 ceph-mon[43939]: 3.0 scrub ok 2024-04-01T19:33:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:05 smithi188 ceph-mon[43939]: 3.f scrub starts 2024-04-01T19:33:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:05 smithi188 ceph-mon[43939]: 3.f scrub ok 2024-04-01T19:33:06.127 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:33:06.137 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:06.138 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:33:06.239 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:33:06.271 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:06.297 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:33:06.302 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:06.302 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:33:06.403 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:33:06.455 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:06.481 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:33:06.484 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:06.485 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:33:06.586 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:33:06.623 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:06.734 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:33:06.757 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:33:06.761 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:06.762 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:33:06.767 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:33:06.794 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:33:06.821 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:33:06.860 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:33:06.862 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:33:06.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:06 smithi022 ceph-mon[39439]: pgmap v735: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 3.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T19:33:06.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:06 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T19:33:06.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:06 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:33:06.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:06 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:33:06.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:06 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T19:33:06.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:06 smithi022 ceph-mon[39439]: osdmap e249: 12 total, 12 up, 12 in 2024-04-01T19:33:06.894 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:33:06.898 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:06 smithi062 ceph-mon[44211]: pgmap v735: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 3.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T19:33:06.898 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:06 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T19:33:06.898 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:06 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:33:06.898 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:06 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:33:06.898 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:06 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T19:33:06.898 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:06 smithi062 ceph-mon[44211]: osdmap e249: 12 total, 12 up, 12 in 2024-04-01T19:33:06.901 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:06.926 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:33:06.937 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:33:06.941 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:06.941 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:33:06.961 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:33:06.996 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:33:07.022 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:33:07.042 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:33:07.054 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:33:07.087 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:33:07.090 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:33:07.090 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:33:07.090 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:33:07.090 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:33:07.090 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:33:07.090 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:33:07.090 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:33:07.090 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:33:07.091 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:33:07.091 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:33:07.091 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:33:07.091 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:33:07.092 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:07.104 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:33:07.104 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:33:07.105 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:07.105 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.25117.0:285712 3.e e249/191 3:73a83b3c:::benchmark_data_smithi188_92122_object120121:head v 249'17894, mlcod=249'17890)", 2024-04-01T19:33:07.105 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:33:07.103373+0000", 2024-04-01T19:33:07.105 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0035137290000000002, 2024-04-01T19:33:07.105 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0035380099999999999, 2024-04-01T19:33:07.105 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:07.105 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:07.105 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "started", 2024-04-01T19:33:07.105 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:07.105 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:07.105 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:07.105 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:07.103373+0000", 2024-04-01T19:33:07.105 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:07.105 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:07.106 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:07.106 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:07.106 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:07.103373+0000", 2024-04-01T19:33:07.106 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:07.106 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:07.106 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:07.106 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:07.106 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:07.103374+0000", 2024-04-01T19:33:07.106 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.9800000000000002e-07 2024-04-01T19:33:07.106 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:07.106 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:07.106 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:07.106 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:07.103380+0000", 2024-04-01T19:33:07.107 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5079999999999996e-06 2024-04-01T19:33:07.107 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:07.107 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:07.107 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:07.107 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:07.103387+0000", 2024-04-01T19:33:07.107 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9160000000000004e-06 2024-04-01T19:33:07.107 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:07.107 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:07.107 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:07.107 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:07.103392+0000", 2024-04-01T19:33:07.107 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6459999999999998e-06 2024-04-01T19:33:07.107 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:07.107 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:07.107 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:07.107 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:07.103431+0000", 2024-04-01T19:33:07.108 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8609000000000003e-05 2024-04-01T19:33:07.108 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:07.108 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:07.108 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:07.108 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:07.103444+0000", 2024-04-01T19:33:07.108 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2911999999999999e-05 2024-04-01T19:33:07.108 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:07.108 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:07.108 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:07.108 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:07.108 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-04-01T19:33:07.108 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 1 2024-04-01T19:33:07.108 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:33:07.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:06 smithi188 ceph-mon[43939]: pgmap v735: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 3.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T19:33:07.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:06 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T19:33:07.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:06 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:33:07.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:06 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:33:07.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:06 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T19:33:07.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:06 smithi188 ceph-mon[43939]: osdmap e249: 12 total, 12 up, 12 in 2024-04-01T19:33:07.128 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:33:07.134 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:07.135 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:33:07.236 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:33:07.264 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:07.291 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:33:07.294 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:07.295 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:33:07.395 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:33:07.455 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:07.765 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:07 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2564509079' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:33:07.765 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:07.765 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:07.765 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:07.765 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:07.765 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:07.766 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:07.766 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:07.766 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:07 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2564509079' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:33:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:08.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:08.064 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_blocked_ops 2024-04-01T19:33:08.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:07 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2564509079' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:33:08.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:08.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:08.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:08.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:08.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:08.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:08.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:08.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:08.225 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:33:08.231 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:08.232 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:33:08.333 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:33:08.368 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:08.396 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:33:08.402 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:08.402 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:33:08.419 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:33:08.503 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:33:08.549 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:33:08.645 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:08.645 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:33:08.746 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:33:08.779 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:08.804 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:33:08.807 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:08.807 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:33:08.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:08 smithi022 ceph-mon[39439]: pgmap v737: 17 pgs: 17 active+clean; 3.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:33:08.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:08.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:08.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:08.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:08.908 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:33:08.949 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:08 smithi188 ceph-mon[43939]: pgmap v737: 17 pgs: 17 active+clean; 3.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:33:08.949 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:08.949 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:08.949 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:08.950 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:08.952 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:09.001 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:08 smithi062 ceph-mon[44211]: pgmap v737: 17 pgs: 17 active+clean; 3.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:33:09.001 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:09.001 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:09.001 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:09.001 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:09.002 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:33:09.007 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:09.007 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:33:09.108 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:33:09.162 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:09.234 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:33:09.237 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:09.238 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:33:09.339 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:33:09.370 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:09.394 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:33:09.411 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:09.411 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:33:09.512 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:33:09.566 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:09.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:09 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:33:09.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:09 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:33:09.939 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:33:09.947 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:09.948 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:33:10.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:09 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:33:10.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:09 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:33:10.049 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:33:10.096 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:10.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:09 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:33:10.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:09 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:33:10.304 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:33:10.316 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:10.317 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:33:10.418 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:33:10.462 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:10.526 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:33:10.532 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:10.532 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:33:10.553 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:33:10.554 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:33:10.554 INFO:teuthology.orchestra.run.smithi062.stdout: "complaint_time": 30, 2024-04-01T19:33:10.554 INFO:teuthology.orchestra.run.smithi062.stdout: "num_blocked_ops": 0 2024-04-01T19:33:10.554 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:33:10.633 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:33:10.686 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:10.719 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:33:10.727 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:10.728 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:33:10.742 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.3 to 1 (10000) 2024-04-01T19:33:10.801 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:33:10.829 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:33:10.927 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:10.937 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:10 smithi062 ceph-mon[44211]: pgmap v738: 17 pgs: 17 active+clean; 2.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:33:10.937 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:10 smithi062 ceph-mon[44211]: osdmap e250: 12 total, 12 up, 12 in 2024-04-01T19:33:10.937 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:10 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2737809230' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:33:10.937 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:10 smithi062 ceph-mon[44211]: from='client.35372 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:33:11.011 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:33:11.021 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:10 smithi022 ceph-mon[39439]: pgmap v738: 17 pgs: 17 active+clean; 2.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:33:11.021 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:10 smithi022 ceph-mon[39439]: osdmap e250: 12 total, 12 up, 12 in 2024-04-01T19:33:11.021 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:10 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2737809230' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:33:11.021 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:10 smithi022 ceph-mon[39439]: from='client.35372 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:33:11.021 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:11.022 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:33:11.123 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:33:11.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:10 smithi188 ceph-mon[43939]: pgmap v738: 17 pgs: 17 active+clean; 2.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:33:11.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:10 smithi188 ceph-mon[43939]: osdmap e250: 12 total, 12 up, 12 in 2024-04-01T19:33:11.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:10 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2737809230' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:33:11.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:10 smithi188 ceph-mon[43939]: from='client.35372 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:33:11.151 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:11.178 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:33:11.182 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:11.182 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:33:11.283 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:33:11.315 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:11.317 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_historic_ops 2024-04-01T19:33:11.336 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:33:11.342 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:11.342 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:33:11.443 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:33:11.479 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:11.515 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:33:11.520 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:11.521 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:33:11.622 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:33:11.641 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 4 1 2024-04-01T19:33:11.667 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:11.701 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:33:11.701 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:33:11.707 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:11.707 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:33:11.713 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:33:11.738 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:33:11.808 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:33:11.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:11 smithi022 ceph-mon[39439]: from='client.35372 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-04-01T19:33:11.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:11 smithi022 ceph-mon[39439]: osdmap e251: 12 total, 12 up, 12 in 2024-04-01T19:33:11.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:11 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1244535045' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:33:11.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:11 smithi022 ceph-mon[39439]: from='client.25354 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:33:11.868 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:11.970 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:11 smithi062 ceph-mon[44211]: from='client.35372 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-04-01T19:33:11.970 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:11 smithi062 ceph-mon[44211]: osdmap e251: 12 total, 12 up, 12 in 2024-04-01T19:33:11.970 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:11 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1244535045' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:33:11.970 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:11 smithi062 ceph-mon[44211]: from='client.25354 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:33:12.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:11 smithi188 ceph-mon[43939]: from='client.35372 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-04-01T19:33:12.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:11 smithi188 ceph-mon[43939]: osdmap e251: 12 total, 12 up, 12 in 2024-04-01T19:33:12.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:11 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1244535045' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:33:12.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:11 smithi188 ceph-mon[43939]: from='client.25354 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:33:12.250 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:33:12.253 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:12.254 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:33:12.355 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:33:12.387 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:12.412 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:33:12.416 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:12.416 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:33:12.517 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:33:12.557 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:12.581 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:33:12.589 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:12.589 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:33:12.690 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:33:12.746 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:13.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:12 smithi062 ceph-mon[44211]: pgmap v741: 17 pgs: 17 active+clean; 2.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.53k op/s 2024-04-01T19:33:13.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:12 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:33:13.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:12 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:33:13.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:12 smithi062 ceph-mon[44211]: from='client.25354 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:33:13.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:12 smithi062 ceph-mon[44211]: osdmap e252: 12 total, 12 up, 12 in 2024-04-01T19:33:13.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:12 smithi022 ceph-mon[39439]: pgmap v741: 17 pgs: 17 active+clean; 2.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.53k op/s 2024-04-01T19:33:13.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:12 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:33:13.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:12 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:33:13.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:12 smithi022 ceph-mon[39439]: from='client.25354 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:33:13.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:12 smithi022 ceph-mon[39439]: osdmap e252: 12 total, 12 up, 12 in 2024-04-01T19:33:13.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:12 smithi188 ceph-mon[43939]: pgmap v741: 17 pgs: 17 active+clean; 2.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.53k op/s 2024-04-01T19:33:13.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:12 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:33:13.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:12 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:33:13.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:12 smithi188 ceph-mon[43939]: from='client.25354 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:33:13.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:12 smithi188 ceph-mon[43939]: osdmap e252: 12 total, 12 up, 12 in 2024-04-01T19:33:13.206 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:33:13.210 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:13.210 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:33:13.311 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:33:13.352 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:13.827 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:33:13.827 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 20, 2024-04-01T19:33:13.827 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 600, 2024-04-01T19:33:13.827 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:33:13.827 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.827 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:28938 3.3 3:c8595752:::benchmark_data_smithi188_92122_object28937:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e198)", 2024-04-01T19:33:13.827 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:30:06.684213+0000", 2024-04-01T19:33:13.827 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 187.13600489999999, 2024-04-01T19:33:13.827 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.064326243000000005, 2024-04-01T19:33:13.828 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:13.828 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:13.828 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:13.828 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:13.828 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:13.828 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:13.828 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 28938 2024-04-01T19:33:13.828 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.828 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:13.828 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.828 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:13.828 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.684213+0000", 2024-04-01T19:33:13.829 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.829 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.829 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.829 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:13.829 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.684213+0000", 2024-04-01T19:33:13.829 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.829 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.829 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.829 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:13.829 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.684215+0000", 2024-04-01T19:33:13.829 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.2910000000000002e-06 2024-04-01T19:33:13.829 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.830 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.830 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:13.830 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.684259+0000", 2024-04-01T19:33:13.830 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3912000000000002e-05 2024-04-01T19:33:13.830 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.830 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.830 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:13.830 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.684274+0000", 2024-04-01T19:33:13.830 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4708e-05 2024-04-01T19:33:13.830 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.830 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.830 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:13.831 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.684294+0000", 2024-04-01T19:33:13.831 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.0284000000000001e-05 2024-04-01T19:33:13.831 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.831 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.831 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:13.831 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.684357+0000", 2024-04-01T19:33:13.831 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2818999999999996e-05 2024-04-01T19:33:13.831 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.831 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.831 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:13.831 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.684474+0000", 2024-04-01T19:33:13.832 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000116932 2024-04-01T19:33:13.832 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.832 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.832 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 0", 2024-04-01T19:33:13.832 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.684623+0000", 2024-04-01T19:33:13.832 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000149591 2024-04-01T19:33:13.832 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.832 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.832 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:13.832 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.686079+0000", 2024-04-01T19:33:13.832 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0014551259999999999 2024-04-01T19:33:13.832 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.833 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.833 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:13.833 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.748440+0000", 2024-04-01T19:33:13.833 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.062361406000000001 2024-04-01T19:33:13.833 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.833 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.833 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:13.833 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.748497+0000", 2024-04-01T19:33:13.833 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7102999999999999e-05 2024-04-01T19:33:13.833 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.833 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.833 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:13.834 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.748539+0000", 2024-04-01T19:33:13.834 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.2070999999999998e-05 2024-04-01T19:33:13.834 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.834 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:13.834 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.834 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.834 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.834 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:28951 3.3 3:cc425ce6:::benchmark_data_smithi188_92122_object28950:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e198)", 2024-04-01T19:33:13.834 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:30:06.687212+0000", 2024-04-01T19:33:13.834 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 187.13300529599999, 2024-04-01T19:33:13.834 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.061440289000000002, 2024-04-01T19:33:13.834 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:13.835 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:13.835 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:13.835 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:13.835 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:13.835 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:13.835 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 28951 2024-04-01T19:33:13.835 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.835 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:13.835 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.835 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:13.835 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.687212+0000", 2024-04-01T19:33:13.835 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.835 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.836 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.836 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:13.836 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.687212+0000", 2024-04-01T19:33:13.836 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.836 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.836 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.836 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:13.836 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.687214+0000", 2024-04-01T19:33:13.836 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.894e-06 2024-04-01T19:33:13.836 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.836 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.836 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:13.836 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.687277+0000", 2024-04-01T19:33:13.836 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2217000000000004e-05 2024-04-01T19:33:13.837 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.837 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.837 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:13.837 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.687289+0000", 2024-04-01T19:33:13.837 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2608e-05 2024-04-01T19:33:13.837 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.837 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.837 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:13.837 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.687297+0000", 2024-04-01T19:33:13.837 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.8480000000000001e-06 2024-04-01T19:33:13.837 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.837 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.837 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:13.837 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.687351+0000", 2024-04-01T19:33:13.838 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.4194999999999999e-05 2024-04-01T19:33:13.838 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.838 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.838 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:13.838 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.687476+0000", 2024-04-01T19:33:13.838 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012450300000000001 2024-04-01T19:33:13.838 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.838 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.838 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 0", 2024-04-01T19:33:13.838 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.687618+0000", 2024-04-01T19:33:13.838 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000142084 2024-04-01T19:33:13.838 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.838 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.839 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:13.839 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.689202+0000", 2024-04-01T19:33:13.839 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0015838899999999999 2024-04-01T19:33:13.839 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.839 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.839 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:13.839 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.748575+0000", 2024-04-01T19:33:13.839 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.059373012000000003 2024-04-01T19:33:13.839 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.839 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.839 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:13.839 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.748620+0000", 2024-04-01T19:33:13.839 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.4914999999999999e-05 2024-04-01T19:33:13.839 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.839 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.840 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:13.840 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.748653+0000", 2024-04-01T19:33:13.840 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.3123000000000001e-05 2024-04-01T19:33:13.840 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.840 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:13.840 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.840 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.840 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.840 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:28952 3.3 3:cbf4c7ce:::benchmark_data_smithi188_92122_object28951:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e198)", 2024-04-01T19:33:13.840 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:30:06.687512+0000", 2024-04-01T19:33:13.840 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 187.13270555299999, 2024-04-01T19:33:13.840 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.061254465000000001, 2024-04-01T19:33:13.840 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:13.840 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:13.841 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:13.841 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:13.841 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:13.841 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:13.841 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 28952 2024-04-01T19:33:13.841 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.841 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:13.841 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.841 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:13.841 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.687512+0000", 2024-04-01T19:33:13.841 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.841 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.841 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.842 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:13.842 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.687512+0000", 2024-04-01T19:33:13.842 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.842 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.842 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.842 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:13.842 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.687513+0000", 2024-04-01T19:33:13.842 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2240000000000001e-06 2024-04-01T19:33:13.842 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.842 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.842 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:13.842 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.687568+0000", 2024-04-01T19:33:13.843 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.4707000000000003e-05 2024-04-01T19:33:13.843 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.843 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.843 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:13.843 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.687576+0000", 2024-04-01T19:33:13.843 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.1319999999999994e-06 2024-04-01T19:33:13.843 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.843 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.843 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:13.843 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.687583+0000", 2024-04-01T19:33:13.843 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2979999999999997e-06 2024-04-01T19:33:13.843 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.844 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.844 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:13.844 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.688482+0000", 2024-04-01T19:33:13.844 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000899148 2024-04-01T19:33:13.844 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.844 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.844 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:13.844 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.688555+0000", 2024-04-01T19:33:13.844 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.3412999999999997e-05 2024-04-01T19:33:13.844 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.844 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.844 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 0", 2024-04-01T19:33:13.845 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.688652+0000", 2024-04-01T19:33:13.845 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.6407e-05 2024-04-01T19:33:13.845 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.845 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.845 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:13.845 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.689365+0000", 2024-04-01T19:33:13.845 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00071329399999999995 2024-04-01T19:33:13.845 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.845 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.845 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:13.845 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.748686+0000", 2024-04-01T19:33:13.845 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.059320865 2024-04-01T19:33:13.845 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.845 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.846 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:13.846 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.748729+0000", 2024-04-01T19:33:13.846 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3136000000000002e-05 2024-04-01T19:33:13.846 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.846 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.846 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:13.846 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.748767+0000", 2024-04-01T19:33:13.846 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.7840999999999999e-05 2024-04-01T19:33:13.846 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.846 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:13.846 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.846 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.846 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.847 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:28964 3.3 3:ca1d32ba:::benchmark_data_smithi188_92122_object28963:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e198)", 2024-04-01T19:33:13.847 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:30:06.691940+0000", 2024-04-01T19:33:13.847 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 187.12827755199999, 2024-04-01T19:33:13.847 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.056937492999999999, 2024-04-01T19:33:13.847 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:13.847 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:13.847 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:13.847 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:13.847 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:13.847 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:13.847 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 28964 2024-04-01T19:33:13.847 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.847 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:13.847 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.848 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:13.848 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.691940+0000", 2024-04-01T19:33:13.848 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.848 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.848 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.848 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:13.848 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.691940+0000", 2024-04-01T19:33:13.848 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.848 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.848 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.848 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:13.848 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.691943+0000", 2024-04-01T19:33:13.849 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3740000000000001e-06 2024-04-01T19:33:13.849 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.849 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.849 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:13.849 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.691987+0000", 2024-04-01T19:33:13.849 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.4836000000000002e-05 2024-04-01T19:33:13.849 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.849 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.849 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:13.849 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.691999+0000", 2024-04-01T19:33:13.849 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1718e-05 2024-04-01T19:33:13.849 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.849 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.849 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:13.849 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.692005+0000", 2024-04-01T19:33:13.850 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.4269999999999999e-06 2024-04-01T19:33:13.850 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.850 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.850 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:13.850 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.692044+0000", 2024-04-01T19:33:13.850 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9147000000000003e-05 2024-04-01T19:33:13.850 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.850 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.850 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:13.850 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.692127+0000", 2024-04-01T19:33:13.850 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.3682000000000003e-05 2024-04-01T19:33:13.850 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.850 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.850 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 0", 2024-04-01T19:33:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.692216+0000", 2024-04-01T19:33:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.8776000000000005e-05 2024-04-01T19:33:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.692966+0000", 2024-04-01T19:33:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00074970400000000002 2024-04-01T19:33:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.748800+0000", 2024-04-01T19:33:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0558337 2024-04-01T19:33:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:13.852 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.748845+0000", 2024-04-01T19:33:13.852 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.587e-05 2024-04-01T19:33:13.852 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.852 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.852 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:13.852 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.748878+0000", 2024-04-01T19:33:13.852 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.2258999999999997e-05 2024-04-01T19:33:13.852 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.852 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:13.852 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.852 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.852 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.852 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:28966 3.3 3:ca6daa75:::benchmark_data_smithi188_92122_object28965:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e198)", 2024-04-01T19:33:13.853 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:30:06.693605+0000", 2024-04-01T19:33:13.853 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 187.12661235600001, 2024-04-01T19:33:13.853 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.055393976999999997, 2024-04-01T19:33:13.853 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:13.853 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:13.853 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:13.853 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:13.853 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:13.853 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:13.853 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 28966 2024-04-01T19:33:13.853 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.853 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:13.853 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.853 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:13.853 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.693605+0000", 2024-04-01T19:33:13.854 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.854 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.854 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.854 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:13.854 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.693605+0000", 2024-04-01T19:33:13.854 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.854 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.854 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.854 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:13.854 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.693606+0000", 2024-04-01T19:33:13.854 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.077e-06 2024-04-01T19:33:13.854 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.854 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.855 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:13.857 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.693660+0000", 2024-04-01T19:33:13.857 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3455999999999998e-05 2024-04-01T19:33:13.857 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.857 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.857 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:13.857 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.693669+0000", 2024-04-01T19:33:13.857 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.8049999999999996e-06 2024-04-01T19:33:13.858 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.858 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.858 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:13.858 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.693676+0000", 2024-04-01T19:33:13.858 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.6240000000000002e-06 2024-04-01T19:33:13.858 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.858 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.858 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:13.858 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.693717+0000", 2024-04-01T19:33:13.858 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0751000000000003e-05 2024-04-01T19:33:13.858 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.858 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.858 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:13.859 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.693806+0000", 2024-04-01T19:33:13.859 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.8751000000000005e-05 2024-04-01T19:33:13.859 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.859 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.859 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 0", 2024-04-01T19:33:13.859 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.693893+0000", 2024-04-01T19:33:13.859 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.6949999999999999e-05 2024-04-01T19:33:13.859 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.859 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.859 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:13.859 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.694477+0000", 2024-04-01T19:33:13.859 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00058458200000000005 2024-04-01T19:33:13.859 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.859 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.860 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:13.860 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.748913+0000", 2024-04-01T19:33:13.860 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.054435764999999997 2024-04-01T19:33:13.860 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.860 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.860 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:13.860 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.748964+0000", 2024-04-01T19:33:13.860 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0439999999999998e-05 2024-04-01T19:33:13.860 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.860 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.860 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:13.860 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.748999+0000", 2024-04-01T19:33:13.860 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.5775999999999998e-05 2024-04-01T19:33:13.861 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.861 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:13.861 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.861 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.861 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.861 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:125156 3.3 3:c2f3b78c:::benchmark_data_smithi188_92122_object125155:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e214)", 2024-04-01T19:33:13.861 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:30:58.660752+0000", 2024-04-01T19:33:13.861 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 135.15946604199999, 2024-04-01T19:33:13.861 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.047313171000000001, 2024-04-01T19:33:13.861 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:13.861 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:13.861 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:13.861 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:13.861 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:13.862 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:13.862 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 125156 2024-04-01T19:33:13.862 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.862 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:13.862 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.862 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:13.862 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:58.660752+0000", 2024-04-01T19:33:13.862 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.862 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.862 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.862 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:13.863 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:58.660752+0000", 2024-04-01T19:33:13.863 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.863 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.863 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.863 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:13.863 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:58.660754+0000", 2024-04-01T19:33:13.863 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1770000000000001e-06 2024-04-01T19:33:13.863 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.863 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.863 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:13.863 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:58.660822+0000", 2024-04-01T19:33:13.863 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8288999999999996e-05 2024-04-01T19:33:13.863 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.864 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.864 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:13.864 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:58.660836+0000", 2024-04-01T19:33:13.864 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4079e-05 2024-04-01T19:33:13.864 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.864 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.864 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:13.864 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:58.660846+0000", 2024-04-01T19:33:13.864 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0049e-05 2024-04-01T19:33:13.864 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.864 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.864 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:13.864 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:58.660902+0000", 2024-04-01T19:33:13.864 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6124e-05 2024-04-01T19:33:13.865 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.865 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.865 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:13.865 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:58.661007+0000", 2024-04-01T19:33:13.865 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00010406 2024-04-01T19:33:13.865 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.865 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.865 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 0", 2024-04-01T19:33:13.865 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:58.661136+0000", 2024-04-01T19:33:13.865 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000129815 2024-04-01T19:33:13.865 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.865 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.865 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:13.865 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:58.663989+0000", 2024-04-01T19:33:13.866 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0028529200000000001 2024-04-01T19:33:13.866 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.866 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.866 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:13.866 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:58.707998+0000", 2024-04-01T19:33:13.866 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.044008799000000001 2024-04-01T19:33:13.866 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.866 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.866 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:13.866 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:58.708033+0000", 2024-04-01T19:33:13.866 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.4737999999999998e-05 2024-04-01T19:33:13.866 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.866 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.867 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:13.867 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:58.708065+0000", 2024-04-01T19:33:13.867 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.2121e-05 2024-04-01T19:33:13.867 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.867 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:13.867 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.867 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.867 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.867 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:142942 3.3 3:cca90cf9:::benchmark_data_smithi188_92122_object142941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e219)", 2024-04-01T19:33:13.867 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:31:11.339991+0000", 2024-04-01T19:33:13.867 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 122.480226485, 2024-04-01T19:33:13.867 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.066030793000000004, 2024-04-01T19:33:13.867 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:13.868 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:13.868 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:13.868 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:13.868 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:13.868 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:13.868 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 142942 2024-04-01T19:33:13.868 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.868 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:13.868 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.868 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:13.868 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.339991+0000", 2024-04-01T19:33:13.868 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.868 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.869 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.869 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:13.869 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.339991+0000", 2024-04-01T19:33:13.869 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.869 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.869 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.869 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:13.869 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.339993+0000", 2024-04-01T19:33:13.869 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.7889999999999999e-06 2024-04-01T19:33:13.869 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.869 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.869 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:13.869 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.340038+0000", 2024-04-01T19:33:13.869 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.4657999999999998e-05 2024-04-01T19:33:13.870 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.870 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.870 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:13.870 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.340049+0000", 2024-04-01T19:33:13.870 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1102e-05 2024-04-01T19:33:13.870 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.870 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.870 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:13.870 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.340055+0000", 2024-04-01T19:33:13.870 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.1569999999999997e-06 2024-04-01T19:33:13.870 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.870 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.870 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:13.870 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.340115+0000", 2024-04-01T19:33:13.871 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.9947000000000001e-05 2024-04-01T19:33:13.871 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.871 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.871 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:13.871 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.340253+0000", 2024-04-01T19:33:13.871 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013844199999999999 2024-04-01T19:33:13.871 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.871 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.871 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 0", 2024-04-01T19:33:13.871 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.340387+0000", 2024-04-01T19:33:13.871 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013405599999999999 2024-04-01T19:33:13.871 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.871 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.871 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:13.872 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.343568+0000", 2024-04-01T19:33:13.872 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0031801849999999999 2024-04-01T19:33:13.872 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.872 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.872 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:13.872 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.405938+0000", 2024-04-01T19:33:13.872 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.062370398000000001 2024-04-01T19:33:13.872 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.872 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.872 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:13.872 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.405974+0000", 2024-04-01T19:33:13.872 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.5918999999999999e-05 2024-04-01T19:33:13.872 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.872 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.873 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:13.873 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.406022+0000", 2024-04-01T19:33:13.873 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8140000000000003e-05 2024-04-01T19:33:13.873 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.873 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:13.873 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.873 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.873 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.873 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:142950 3.3 3:c565f0d7:::benchmark_data_smithi188_92122_object142949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e219)", 2024-04-01T19:33:13.873 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:31:11.348673+0000", 2024-04-01T19:33:13.873 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 122.471544823, 2024-04-01T19:33:13.873 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.060812892, 2024-04-01T19:33:13.873 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:13.874 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:13.874 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:13.874 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:13.874 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:13.874 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:13.874 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 142950 2024-04-01T19:33:13.874 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.874 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:13.874 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.874 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:13.874 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.348673+0000", 2024-04-01T19:33:13.874 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.874 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.874 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.875 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:13.875 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.348673+0000", 2024-04-01T19:33:13.875 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.875 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.875 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.875 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:13.875 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.348676+0000", 2024-04-01T19:33:13.875 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.6000000000000001e-06 2024-04-01T19:33:13.875 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.876 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.876 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:13.876 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.348737+0000", 2024-04-01T19:33:13.876 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.1402999999999995e-05 2024-04-01T19:33:13.876 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.876 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.876 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:13.876 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.348751+0000", 2024-04-01T19:33:13.876 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4188999999999999e-05 2024-04-01T19:33:13.876 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.876 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.876 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:13.876 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.348770+0000", 2024-04-01T19:33:13.876 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8442999999999999e-05 2024-04-01T19:33:13.877 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.877 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.877 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:13.877 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.348821+0000", 2024-04-01T19:33:13.877 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1876999999999998e-05 2024-04-01T19:33:13.877 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.877 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.877 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:13.877 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.348926+0000", 2024-04-01T19:33:13.877 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000104626 2024-04-01T19:33:13.877 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.877 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.877 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 0", 2024-04-01T19:33:13.877 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.349038+0000", 2024-04-01T19:33:13.878 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000112298 2024-04-01T19:33:13.878 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.878 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.878 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:13.878 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.352935+0000", 2024-04-01T19:33:13.878 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0038965689999999999 2024-04-01T19:33:13.878 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.878 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.878 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:13.878 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.409423+0000", 2024-04-01T19:33:13.878 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.056487709999999997 2024-04-01T19:33:13.878 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.878 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.878 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:13.879 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.409456+0000", 2024-04-01T19:33:13.879 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.2833999999999998e-05 2024-04-01T19:33:13.879 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.879 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.879 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:13.879 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:11.409486+0000", 2024-04-01T19:33:13.879 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.0343000000000001e-05 2024-04-01T19:33:13.879 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.879 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:13.879 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.879 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.879 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.879 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:166916 3.3 3:c7bb5a55:::benchmark_data_smithi188_92122_object1325:head [delete] snapc 0=[] ondisk+write+known_if_redirected e226)", 2024-04-01T19:33:13.879 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:31:31.665391+0000", 2024-04-01T19:33:13.880 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 102.154826391, 2024-04-01T19:33:13.880 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.039887376000000002, 2024-04-01T19:33:13.880 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:13.880 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:13.880 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:13.880 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:13.880 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:13.880 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:13.880 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 166916 2024-04-01T19:33:13.880 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.880 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:13.880 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.880 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:13.881 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:31.665391+0000", 2024-04-01T19:33:13.881 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.881 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.881 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.881 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:13.881 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:31.665391+0000", 2024-04-01T19:33:13.881 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.881 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.881 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.881 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:13.881 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:31.665392+0000", 2024-04-01T19:33:13.881 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.47e-07 2024-04-01T19:33:13.881 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.881 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.882 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:13.882 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:31.665396+0000", 2024-04-01T19:33:13.882 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.3239999999999999e-06 2024-04-01T19:33:13.882 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.882 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.882 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:13.882 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:31.665401+0000", 2024-04-01T19:33:13.882 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.857e-06 2024-04-01T19:33:13.882 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.882 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.882 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:13.882 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:31.665406+0000", 2024-04-01T19:33:13.882 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3229999999999999e-06 2024-04-01T19:33:13.882 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.883 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.883 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:13.883 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:31.670513+0000", 2024-04-01T19:33:13.883 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0051074909999999996 2024-04-01T19:33:13.883 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.883 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.883 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:13.883 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:31.670617+0000", 2024-04-01T19:33:13.883 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000103842 2024-04-01T19:33:13.883 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.883 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.883 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 0", 2024-04-01T19:33:13.883 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:31.670728+0000", 2024-04-01T19:33:13.883 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000110815 2024-04-01T19:33:13.884 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.884 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.884 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:13.884 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:31.674695+0000", 2024-04-01T19:33:13.884 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0039674380000000002 2024-04-01T19:33:13.884 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.884 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.884 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:13.884 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:31.705179+0000", 2024-04-01T19:33:13.884 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.030484015999999999 2024-04-01T19:33:13.884 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.884 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.884 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:13.884 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:31.705235+0000", 2024-04-01T19:33:13.884 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5198000000000002e-05 2024-04-01T19:33:13.885 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.885 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.885 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:13.885 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:31.705279+0000", 2024-04-01T19:33:13.885 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.4224999999999998e-05 2024-04-01T19:33:13.885 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.885 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:13.885 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.885 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.885 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.885 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:169263 3.3 3:c2e29226:::benchmark_data_smithi188_92122_object3672:head [delete] snapc 0=[] ondisk+write+known_if_redirected e226)", 2024-04-01T19:33:13.885 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:31:33.525022+0000", 2024-04-01T19:33:13.885 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 100.29519599699999, 2024-04-01T19:33:13.885 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.041776157000000001, 2024-04-01T19:33:13.886 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:13.886 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:13.886 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:13.886 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:13.886 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:13.886 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:13.886 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 169263 2024-04-01T19:33:13.886 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.886 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:13.886 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.886 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:13.886 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.525022+0000", 2024-04-01T19:33:13.886 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.887 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.887 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.887 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:13.887 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.525022+0000", 2024-04-01T19:33:13.887 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.887 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.887 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.887 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:13.887 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.525023+0000", 2024-04-01T19:33:13.887 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.3799999999999996e-07 2024-04-01T19:33:13.887 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.887 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.887 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:13.888 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.525026+0000", 2024-04-01T19:33:13.888 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.2100000000000002e-06 2024-04-01T19:33:13.888 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.888 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.888 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:13.888 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.525032+0000", 2024-04-01T19:33:13.888 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5320000000000003e-06 2024-04-01T19:33:13.888 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.888 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.888 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:13.888 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.525039+0000", 2024-04-01T19:33:13.888 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6370000000000002e-06 2024-04-01T19:33:13.888 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.889 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.889 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:13.889 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.532869+0000", 2024-04-01T19:33:13.889 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0078300469999999997 2024-04-01T19:33:13.889 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.889 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.889 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:13.889 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.532981+0000", 2024-04-01T19:33:13.889 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00011189 2024-04-01T19:33:13.889 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.889 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.889 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 0", 2024-04-01T19:33:13.889 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.533048+0000", 2024-04-01T19:33:13.889 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6951000000000003e-05 2024-04-01T19:33:13.890 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.890 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.890 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:13.890 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.539815+0000", 2024-04-01T19:33:13.890 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0067676710000000003 2024-04-01T19:33:13.890 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.890 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.890 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:13.890 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.566674+0000", 2024-04-01T19:33:13.890 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.026858245999999999 2024-04-01T19:33:13.890 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.890 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.890 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:13.891 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.566731+0000", 2024-04-01T19:33:13.891 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7719000000000001e-05 2024-04-01T19:33:13.891 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.891 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.891 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:13.891 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.566798+0000", 2024-04-01T19:33:13.891 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6515999999999998e-05 2024-04-01T19:33:13.891 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.891 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:13.891 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.891 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.891 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.891 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:171482 3.3 3:cb3082f9:::benchmark_data_smithi188_92122_object5891:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-04-01T19:33:13.891 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:31:35.309243+0000", 2024-04-01T19:33:13.892 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 98.510974816000001, 2024-04-01T19:33:13.892 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.040826912999999999, 2024-04-01T19:33:13.892 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:13.892 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:13.892 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:13.892 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:13.892 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:13.892 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:13.892 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 171482 2024-04-01T19:33:13.892 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.892 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:13.892 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.892 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:13.893 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.309243+0000", 2024-04-01T19:33:13.893 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.893 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.893 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.893 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:13.893 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.309243+0000", 2024-04-01T19:33:13.893 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.893 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.893 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.893 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:13.893 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.309245+0000", 2024-04-01T19:33:13.893 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3479999999999998e-06 2024-04-01T19:33:13.893 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.893 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.894 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:13.894 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.309251+0000", 2024-04-01T19:33:13.894 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.032e-06 2024-04-01T19:33:13.894 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.894 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.894 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:13.894 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.309263+0000", 2024-04-01T19:33:13.894 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1922e-05 2024-04-01T19:33:13.894 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.894 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.894 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:13.894 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.309271+0000", 2024-04-01T19:33:13.894 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.174e-06 2024-04-01T19:33:13.895 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.895 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.895 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:13.895 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.309332+0000", 2024-04-01T19:33:13.895 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.0080000000000001e-05 2024-04-01T19:33:13.895 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.895 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.895 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:13.895 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.309458+0000", 2024-04-01T19:33:13.895 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012670300000000001 2024-04-01T19:33:13.895 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.895 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.895 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 0", 2024-04-01T19:33:13.895 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.309577+0000", 2024-04-01T19:33:13.896 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000118915 2024-04-01T19:33:13.896 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.896 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.896 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:13.896 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.318093+0000", 2024-04-01T19:33:13.896 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0085156309999999992 2024-04-01T19:33:13.896 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.896 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.896 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:13.896 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.349969+0000", 2024-04-01T19:33:13.896 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.031876663999999999 2024-04-01T19:33:13.896 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.896 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.897 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:13.897 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.350025+0000", 2024-04-01T19:33:13.897 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5742000000000003e-05 2024-04-01T19:33:13.897 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.897 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.897 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:13.897 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.350070+0000", 2024-04-01T19:33:13.897 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.4702e-05 2024-04-01T19:33:13.897 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.897 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:13.897 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.897 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.897 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.897 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:171489 3.3 3:c6f4edec:::benchmark_data_smithi188_92122_object5898:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-04-01T19:33:13.898 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:31:35.309754+0000", 2024-04-01T19:33:13.898 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 98.510464173000003, 2024-04-01T19:33:13.898 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.040481654999999998, 2024-04-01T19:33:13.898 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:13.898 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:13.898 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:13.898 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:13.898 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:13.898 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:13.898 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 171489 2024-04-01T19:33:13.898 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.898 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:13.898 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.898 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:13.899 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.309754+0000", 2024-04-01T19:33:13.899 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.899 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.899 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.899 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:13.899 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.309754+0000", 2024-04-01T19:33:13.899 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.899 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.899 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.899 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:13.899 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.309755+0000", 2024-04-01T19:33:13.899 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.212e-06 2024-04-01T19:33:13.899 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.899 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.899 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:13.900 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.309769+0000", 2024-04-01T19:33:13.900 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3797e-05 2024-04-01T19:33:13.900 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.900 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.900 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:13.900 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.309778+0000", 2024-04-01T19:33:13.900 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.4760000000000004e-06 2024-04-01T19:33:13.900 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.900 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.900 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:13.900 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.309785+0000", 2024-04-01T19:33:13.900 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.0949999999999998e-06 2024-04-01T19:33:13.900 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.900 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.901 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:13.901 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.314112+0000", 2024-04-01T19:33:13.901 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0043264669999999996 2024-04-01T19:33:13.901 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.901 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.901 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:13.901 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.314232+0000", 2024-04-01T19:33:13.901 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012055799999999999 2024-04-01T19:33:13.901 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.901 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.901 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 0", 2024-04-01T19:33:13.901 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.314359+0000", 2024-04-01T19:33:13.901 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000126966 2024-04-01T19:33:13.901 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.902 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.902 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:13.902 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.318267+0000", 2024-04-01T19:33:13.902 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0039080360000000001 2024-04-01T19:33:13.902 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.902 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.902 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:13.902 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.350133+0000", 2024-04-01T19:33:13.902 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.031865734 2024-04-01T19:33:13.902 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.902 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.902 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:13.902 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.350193+0000", 2024-04-01T19:33:13.902 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.9574000000000003e-05 2024-04-01T19:33:13.903 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.903 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.903 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:13.903 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.350235+0000", 2024-04-01T19:33:13.903 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.2740000000000001e-05 2024-04-01T19:33:13.903 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.903 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:13.903 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.903 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.903 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.903 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:172199 3.3 3:c679769a:::benchmark_data_smithi188_92122_object6608:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-04-01T19:33:13.903 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:31:35.941344+0000", 2024-04-01T19:33:13.903 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 97.878874267, 2024-04-01T19:33:13.904 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.056728631000000002, 2024-04-01T19:33:13.904 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:13.904 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:13.904 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:13.904 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:13.904 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:13.904 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:13.904 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 172199 2024-04-01T19:33:13.904 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.904 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:13.904 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.904 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:13.904 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.941344+0000", 2024-04-01T19:33:13.904 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.904 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.905 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.905 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:13.905 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.941344+0000", 2024-04-01T19:33:13.905 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.905 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.905 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.905 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:13.905 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.941345+0000", 2024-04-01T19:33:13.905 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.855e-06 2024-04-01T19:33:13.905 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.905 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.905 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:13.905 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.941350+0000", 2024-04-01T19:33:13.906 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.899e-06 2024-04-01T19:33:13.906 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.906 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.906 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:13.906 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.941362+0000", 2024-04-01T19:33:13.906 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1878999999999999e-05 2024-04-01T19:33:13.906 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.906 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.906 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:13.906 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.941370+0000", 2024-04-01T19:33:13.906 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.6190000000000002e-06 2024-04-01T19:33:13.906 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.906 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.906 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:13.907 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.941422+0000", 2024-04-01T19:33:13.907 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2101000000000001e-05 2024-04-01T19:33:13.907 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.907 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.907 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:13.907 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.941543+0000", 2024-04-01T19:33:13.907 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000121154 2024-04-01T19:33:13.907 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.907 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.907 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 0", 2024-04-01T19:33:13.907 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.941677+0000", 2024-04-01T19:33:13.907 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013382800000000001 2024-04-01T19:33:13.907 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.907 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.908 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:13.908 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.946027+0000", 2024-04-01T19:33:13.908 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0043505870000000004 2024-04-01T19:33:13.908 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.908 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.908 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:13.908 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.997979+0000", 2024-04-01T19:33:13.908 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.051951947999999998 2024-04-01T19:33:13.908 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.908 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.908 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:13.908 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.998022+0000", 2024-04-01T19:33:13.908 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3066999999999999e-05 2024-04-01T19:33:13.908 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.909 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.909 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:13.909 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.998072+0000", 2024-04-01T19:33:13.909 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9694000000000002e-05 2024-04-01T19:33:13.909 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.909 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:13.909 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.909 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.909 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.909 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:172209 3.3 3:c4ef6b76:::benchmark_data_smithi188_92122_object6618:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-04-01T19:33:13.909 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:31:35.953784+0000", 2024-04-01T19:33:13.909 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 97.866433552999993, 2024-04-01T19:33:13.909 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.044389185999999997, 2024-04-01T19:33:13.909 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:13.910 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:13.910 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:13.910 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:13.910 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:13.910 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:13.910 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 172209 2024-04-01T19:33:13.910 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.910 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:13.910 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.910 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:13.910 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.953784+0000", 2024-04-01T19:33:13.910 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.910 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.910 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.911 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:13.911 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.953784+0000", 2024-04-01T19:33:13.911 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.911 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.911 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.911 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:13.911 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.953786+0000", 2024-04-01T19:33:13.911 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.041e-06 2024-04-01T19:33:13.911 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.911 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.911 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:13.911 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.953792+0000", 2024-04-01T19:33:13.911 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.4330000000000003e-06 2024-04-01T19:33:13.911 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.912 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.912 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:13.912 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.953802+0000", 2024-04-01T19:33:13.912 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0084999999999999e-05 2024-04-01T19:33:13.912 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.912 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.912 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:13.912 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.953809+0000", 2024-04-01T19:33:13.912 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.131e-06 2024-04-01T19:33:13.912 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.912 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.912 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:13.912 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.953865+0000", 2024-04-01T19:33:13.912 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5742000000000003e-05 2024-04-01T19:33:13.913 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.913 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.913 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:13.913 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.953998+0000", 2024-04-01T19:33:13.913 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013290900000000001 2024-04-01T19:33:13.913 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.913 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.913 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 0", 2024-04-01T19:33:13.913 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.954123+0000", 2024-04-01T19:33:13.913 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012531900000000001 2024-04-01T19:33:13.913 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.913 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.913 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:13.913 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.957767+0000", 2024-04-01T19:33:13.914 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0036441450000000001 2024-04-01T19:33:13.914 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.914 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.914 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:13.914 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.998112+0000", 2024-04-01T19:33:13.914 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.040345381999999999 2024-04-01T19:33:13.914 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.914 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.914 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:13.914 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.998141+0000", 2024-04-01T19:33:13.914 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8537000000000001e-05 2024-04-01T19:33:13.914 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.915 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.915 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:13.915 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:35.998173+0000", 2024-04-01T19:33:13.915 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.2462000000000002e-05 2024-04-01T19:33:13.915 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.915 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:13.915 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.915 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.915 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.915 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:174947 3.3 3:c112e867:::benchmark_data_smithi188_92122_object9356:head [delete] snapc 0=[] ondisk+write+known_if_redirected e228)", 2024-04-01T19:33:13.915 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:31:38.097800+0000", 2024-04-01T19:33:13.915 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 95.722417934000006, 2024-04-01T19:33:13.915 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.041326464, 2024-04-01T19:33:13.915 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:13.915 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:13.916 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:13.916 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:13.916 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:13.916 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:13.916 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 174947 2024-04-01T19:33:13.916 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.916 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:13.916 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.916 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:13.916 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:38.097800+0000", 2024-04-01T19:33:13.916 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.916 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.916 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.916 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:13.917 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:38.097800+0000", 2024-04-01T19:33:13.917 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.917 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.917 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.917 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:13.917 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:38.097801+0000", 2024-04-01T19:33:13.917 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3909999999999999e-06 2024-04-01T19:33:13.917 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.917 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.917 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:13.917 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:38.097806+0000", 2024-04-01T19:33:13.917 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7829999999999998e-06 2024-04-01T19:33:13.917 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.918 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.918 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:13.918 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:38.097816+0000", 2024-04-01T19:33:13.918 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0203999999999999e-05 2024-04-01T19:33:13.918 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.918 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.918 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:13.918 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:38.097824+0000", 2024-04-01T19:33:13.918 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0649999999999999e-06 2024-04-01T19:33:13.918 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.918 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.918 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:13.918 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:38.101779+0000", 2024-04-01T19:33:13.918 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0039543299999999998 2024-04-01T19:33:13.919 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.919 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.919 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:13.919 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:38.101875+0000", 2024-04-01T19:33:13.919 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.6854000000000005e-05 2024-04-01T19:33:13.919 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.919 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.919 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 0", 2024-04-01T19:33:13.919 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:38.101968+0000", 2024-04-01T19:33:13.919 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.2542999999999998e-05 2024-04-01T19:33:13.919 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.919 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.919 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:13.920 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:38.105504+0000", 2024-04-01T19:33:13.920 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0035358799999999999 2024-04-01T19:33:13.920 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.920 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.920 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:13.920 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:38.139059+0000", 2024-04-01T19:33:13.920 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.033554694000000003 2024-04-01T19:33:13.920 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.920 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.920 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:13.920 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:38.139094+0000", 2024-04-01T19:33:13.920 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.5512000000000002e-05 2024-04-01T19:33:13.920 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.920 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.921 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:13.921 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:38.139126+0000", 2024-04-01T19:33:13.921 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.2208000000000001e-05 2024-04-01T19:33:13.921 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.921 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:13.921 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.921 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.921 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.921 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:207505 3.3 3:c06d8884:::benchmark_data_smithi188_92122_object41914:head [delete] snapc 0=[] ondisk+write+known_if_redirected e233)", 2024-04-01T19:33:13.921 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:32:03.817589+0000", 2024-04-01T19:33:13.921 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 70.002628647999998, 2024-04-01T19:33:13.921 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.040887352000000002, 2024-04-01T19:33:13.921 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:13.922 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:13.922 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:13.922 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:13.922 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:13.922 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:13.922 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 207505 2024-04-01T19:33:13.922 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.922 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:13.922 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.922 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:13.922 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.817589+0000", 2024-04-01T19:33:13.922 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.922 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.922 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.923 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:13.923 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.817589+0000", 2024-04-01T19:33:13.923 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.923 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.923 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.923 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:13.923 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.817591+0000", 2024-04-01T19:33:13.923 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1880000000000001e-06 2024-04-01T19:33:13.923 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.923 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.923 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:13.923 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.817597+0000", 2024-04-01T19:33:13.923 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6230000000000002e-06 2024-04-01T19:33:13.923 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.924 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.924 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:13.924 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.817610+0000", 2024-04-01T19:33:13.924 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2789000000000001e-05 2024-04-01T19:33:13.924 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.924 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.924 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:13.924 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.817618+0000", 2024-04-01T19:33:13.924 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.1019999999999997e-06 2024-04-01T19:33:13.924 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.924 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.924 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:13.924 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.817677+0000", 2024-04-01T19:33:13.924 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8822e-05 2024-04-01T19:33:13.925 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.925 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.925 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:13.925 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.817816+0000", 2024-04-01T19:33:13.925 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013963699999999999 2024-04-01T19:33:13.925 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.925 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.925 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 0", 2024-04-01T19:33:13.925 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.817935+0000", 2024-04-01T19:33:13.925 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00011859899999999999 2024-04-01T19:33:13.925 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.925 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.925 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:13.925 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.825948+0000", 2024-04-01T19:33:13.926 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.008013292 2024-04-01T19:33:13.926 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.926 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.926 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:13.926 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.858357+0000", 2024-04-01T19:33:13.926 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.032409276000000001 2024-04-01T19:33:13.926 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.926 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.926 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:13.926 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.858426+0000", 2024-04-01T19:33:13.926 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8918000000000007e-05 2024-04-01T19:33:13.926 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.926 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.926 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:13.927 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.858476+0000", 2024-04-01T19:33:13.927 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0105999999999998e-05 2024-04-01T19:33:13.927 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.927 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:13.927 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.927 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.927 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.927 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:207507 3.3 3:c042397c:::benchmark_data_smithi188_92122_object41916:head [delete] snapc 0=[] ondisk+write+known_if_redirected e233)", 2024-04-01T19:33:13.927 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:32:03.817895+0000", 2024-04-01T19:33:13.927 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 70.002323191000002, 2024-04-01T19:33:13.927 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.043032662999999999, 2024-04-01T19:33:13.927 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:13.927 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:13.927 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:13.927 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:13.928 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:13.928 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:13.928 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 207507 2024-04-01T19:33:13.928 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.928 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:13.928 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.928 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:13.928 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.817895+0000", 2024-04-01T19:33:13.928 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.928 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.928 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.928 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:13.928 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.817895+0000", 2024-04-01T19:33:13.929 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.929 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.929 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.929 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:13.929 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.817896+0000", 2024-04-01T19:33:13.929 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.5209999999999999e-06 2024-04-01T19:33:13.929 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.929 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.929 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:13.929 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.817901+0000", 2024-04-01T19:33:13.929 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1479999999999997e-06 2024-04-01T19:33:13.929 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.929 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.929 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:13.930 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.817911+0000", 2024-04-01T19:33:13.930 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.008e-05 2024-04-01T19:33:13.930 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.930 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.930 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:13.930 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.817919+0000", 2024-04-01T19:33:13.930 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.3470000000000001e-06 2024-04-01T19:33:13.930 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.930 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.930 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:13.930 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.822235+0000", 2024-04-01T19:33:13.930 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.004316294 2024-04-01T19:33:13.930 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.930 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.931 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:13.931 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.822342+0000", 2024-04-01T19:33:13.931 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000106822 2024-04-01T19:33:13.931 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.931 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.931 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 0", 2024-04-01T19:33:13.931 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.822463+0000", 2024-04-01T19:33:13.931 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000120908 2024-04-01T19:33:13.931 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.931 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.931 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:13.931 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.829465+0000", 2024-04-01T19:33:13.931 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0070020639999999997 2024-04-01T19:33:13.932 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.932 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.932 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:13.932 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.860868+0000", 2024-04-01T19:33:13.932 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.031402758000000003 2024-04-01T19:33:13.932 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.932 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.932 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:13.932 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.860902+0000", 2024-04-01T19:33:13.932 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.4421000000000001e-05 2024-04-01T19:33:13.932 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.932 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.932 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:13.932 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:03.860927+0000", 2024-04-01T19:33:13.933 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.5299999999999998e-05 2024-04-01T19:33:13.933 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.933 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:13.933 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.933 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.933 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.933 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:252164 3.3 3:c301ada3:::benchmark_data_smithi188_92122_object86573:head [delete] snapc 0=[] ondisk+write+known_if_redirected e243)", 2024-04-01T19:33:13.933 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:32:39.422927+0000", 2024-04-01T19:33:13.933 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 34.397290587999997, 2024-04-01T19:33:13.933 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.039866398999999997, 2024-04-01T19:33:13.933 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:13.933 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:13.933 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:13.933 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:13.934 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:13.934 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:13.934 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 252164 2024-04-01T19:33:13.934 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.934 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:13.934 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.934 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:13.934 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:39.422927+0000", 2024-04-01T19:33:13.934 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.934 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.934 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.934 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:13.934 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:39.422927+0000", 2024-04-01T19:33:13.934 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.934 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.935 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.935 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:13.935 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:39.422928+0000", 2024-04-01T19:33:13.935 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.074e-06 2024-04-01T19:33:13.935 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.935 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.935 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:13.935 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:39.422933+0000", 2024-04-01T19:33:13.935 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7219999999999999e-06 2024-04-01T19:33:13.935 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.935 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.935 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:13.935 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:39.422943+0000", 2024-04-01T19:33:13.935 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.6639999999999993e-06 2024-04-01T19:33:13.936 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.936 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.936 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:13.936 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:39.422948+0000", 2024-04-01T19:33:13.936 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.614e-06 2024-04-01T19:33:13.936 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.936 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.936 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:13.936 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:39.425508+0000", 2024-04-01T19:33:13.936 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0025593830000000001 2024-04-01T19:33:13.936 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.936 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.936 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:13.936 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:39.425609+0000", 2024-04-01T19:33:13.936 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00010137999999999999 2024-04-01T19:33:13.937 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.937 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.937 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 0", 2024-04-01T19:33:13.937 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:39.425699+0000", 2024-04-01T19:33:13.937 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.0048000000000002e-05 2024-04-01T19:33:13.937 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.937 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.937 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:13.937 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:39.429010+0000", 2024-04-01T19:33:13.937 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0033106469999999999 2024-04-01T19:33:13.937 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.937 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.937 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:13.937 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:39.462715+0000", 2024-04-01T19:33:13.938 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.033704897999999997 2024-04-01T19:33:13.938 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.938 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.938 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:13.938 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:39.462749+0000", 2024-04-01T19:33:13.938 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.4659000000000001e-05 2024-04-01T19:33:13.938 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.938 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.938 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:13.938 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:39.462794+0000", 2024-04-01T19:33:13.938 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.4310000000000001e-05 2024-04-01T19:33:13.938 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.938 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:13.938 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.939 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.939 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.939 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:263821 3.3 3:c92d025e:::benchmark_data_smithi188_92122_object98230:head [delete] snapc 0=[] ondisk+write+known_if_redirected e245)", 2024-04-01T19:33:13.939 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:32:48.817698+0000", 2024-04-01T19:33:13.939 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 25.002520198999999, 2024-04-01T19:33:13.939 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.045072922000000001, 2024-04-01T19:33:13.939 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:13.939 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:13.939 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:13.939 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:13.939 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:13.939 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:13.939 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 263821 2024-04-01T19:33:13.939 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.940 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:13.940 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.940 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:13.940 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:48.817698+0000", 2024-04-01T19:33:13.940 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.940 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.940 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.940 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:13.940 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:48.817698+0000", 2024-04-01T19:33:13.940 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.940 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.940 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.940 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:13.940 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:48.817698+0000", 2024-04-01T19:33:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.5600000000000004e-07 2024-04-01T19:33:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:48.817703+0000", 2024-04-01T19:33:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.1670000000000001e-06 2024-04-01T19:33:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:48.817708+0000", 2024-04-01T19:33:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.096e-06 2024-04-01T19:33:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:48.817711+0000", 2024-04-01T19:33:13.942 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.799e-06 2024-04-01T19:33:13.942 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.942 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.942 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:13.942 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:48.821270+0000", 2024-04-01T19:33:13.942 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0035582299999999999 2024-04-01T19:33:13.942 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.942 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.942 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:13.942 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:48.821405+0000", 2024-04-01T19:33:13.942 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013483500000000001 2024-04-01T19:33:13.942 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.942 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.943 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 0", 2024-04-01T19:33:13.943 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:48.821484+0000", 2024-04-01T19:33:13.943 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.8963999999999998e-05 2024-04-01T19:33:13.943 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.943 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.943 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:13.943 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:48.829120+0000", 2024-04-01T19:33:13.943 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0076363280000000004 2024-04-01T19:33:13.943 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.943 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.943 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:13.943 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:48.862692+0000", 2024-04-01T19:33:13.943 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.033571960999999997 2024-04-01T19:33:13.943 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.943 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.944 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:13.944 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:48.862725+0000", 2024-04-01T19:33:13.944 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.3379e-05 2024-04-01T19:33:13.944 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.944 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.944 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:13.944 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:48.862771+0000", 2024-04-01T19:33:13.944 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.5306999999999998e-05 2024-04-01T19:33:13.944 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.944 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:13.944 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.944 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.944 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.944 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:288709 3.3 3:cae83447:::benchmark_data_smithi188_92122_object123118:head [delete] snapc 0=[] ondisk+write+known_if_redirected e249)", 2024-04-01T19:33:13.945 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:33:09.484078+0000", 2024-04-01T19:33:13.945 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 4.3361401769999999, 2024-04-01T19:33:13.945 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.040299899, 2024-04-01T19:33:13.945 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:13.945 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:13.945 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:13.945 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:13.945 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:13.945 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:13.945 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 288709 2024-04-01T19:33:13.945 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.945 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:13.945 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.945 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:13.945 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:09.484078+0000", 2024-04-01T19:33:13.946 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.946 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.946 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.946 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:13.946 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:09.484078+0000", 2024-04-01T19:33:13.946 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:13.946 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.946 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.946 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:13.946 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:09.484079+0000", 2024-04-01T19:33:13.946 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.221e-06 2024-04-01T19:33:13.946 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.946 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.946 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:13.947 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:09.484083+0000", 2024-04-01T19:33:13.947 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3839999999999999e-06 2024-04-01T19:33:13.947 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.947 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.947 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:13.947 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:09.484094+0000", 2024-04-01T19:33:13.947 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0597999999999999e-05 2024-04-01T19:33:13.947 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.947 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.947 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:13.947 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:09.484101+0000", 2024-04-01T19:33:13.947 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8959999999999997e-06 2024-04-01T19:33:13.947 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.947 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.948 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:13.948 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:09.490375+0000", 2024-04-01T19:33:13.948 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.006274005 2024-04-01T19:33:13.948 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.948 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.948 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:13.948 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:09.490454+0000", 2024-04-01T19:33:13.948 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.8809999999999999e-05 2024-04-01T19:33:13.948 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.948 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.948 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 0", 2024-04-01T19:33:13.948 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:09.490535+0000", 2024-04-01T19:33:13.948 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.1347999999999994e-05 2024-04-01T19:33:13.948 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.949 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.949 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:13.949 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:09.493366+0000", 2024-04-01T19:33:13.949 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0028314099999999999 2024-04-01T19:33:13.949 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.949 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.949 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:13.949 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:09.524275+0000", 2024-04-01T19:33:13.949 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.030908739000000001 2024-04-01T19:33:13.949 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.949 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.949 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:13.949 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:09.524325+0000", 2024-04-01T19:33:13.949 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0124999999999999e-05 2024-04-01T19:33:13.949 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:13.950 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:13.950 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:13.950 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:09.524377+0000", 2024-04-01T19:33:13.950 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2363e-05 2024-04-01T19:33:13.950 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.950 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:13.950 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.950 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:13.950 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:13.950 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:33:13.951 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:13.952 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:33:13.952 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:33:13.952 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:33:14.053 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:33:14.097 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:14.121 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:33:14.124 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:14.125 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:33:14.225 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:33:14.260 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:14.284 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:33:14.290 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:14.291 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:33:14.392 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:33:14.423 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:14.448 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:33:14.451 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:14.452 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:33:14.552 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:33:14.617 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:14.625 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_ops_in_flight 2024-04-01T19:33:14.737 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:14 smithi022 ceph-mon[39439]: pgmap v743: 17 pgs: 17 active+clean; 2.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:33:14.867 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:33:14.990 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:33:15.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:14 smithi062 ceph-mon[44211]: pgmap v743: 17 pgs: 17 active+clean; 2.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:33:15.067 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:33:15.102 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:33:15.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:14 smithi188 ceph-mon[43939]: pgmap v743: 17 pgs: 17 active+clean; 2.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:33:15.140 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:33:15.180 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:33:15.220 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:33:15.267 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:33:15.297 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:33:15.328 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:33:15.357 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:33:15.392 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:33:15.400 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:33:15.412 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:15.412 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:33:15.423 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:33:15.458 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:33:15.480 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:33:15.480 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:33:15.480 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:33:15.480 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:33:15.480 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:33:15.480 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:33:15.480 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:33:15.480 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:33:15.480 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:33:15.480 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:33:15.480 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:33:15.481 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:33:15.513 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:33:15.545 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:15.568 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:33:15.572 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:15.573 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:33:15.674 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:33:15.717 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:15.750 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:15 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:33:15.873 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:33:15.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:15 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:33:15.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:15 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:33:15.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:15 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3975449534' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:33:15.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:15.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:15.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:15.876 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:15.877 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:33:15.978 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:33:16.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:15 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:33:16.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:15 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:33:16.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:15 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3975449534' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:33:16.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:16.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:16.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:16.039 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:15 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:33:16.040 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:15 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3975449534' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:33:16.040 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:16.040 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:16.040 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:16.042 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:16.088 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:33:16.092 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:16.092 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:33:16.193 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:33:16.223 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:16.251 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:33:16.254 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:16.254 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:33:16.355 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:33:16.386 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:16.652 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:33:16.655 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:16.655 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:33:16.756 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:33:16.797 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:16.926 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:33:16.930 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:16 smithi062 ceph-mon[44211]: pgmap v744: 17 pgs: 17 active+clean; 2.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:33:16.930 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:16 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:16.930 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:16 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:16.930 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:16 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:16.930 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:16 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:16.931 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:16 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:16.931 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:16 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:16.931 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:16 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:16.931 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:16 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:16.931 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:16 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:16.931 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:16 smithi062 ceph-mon[44211]: osdmap e253: 12 total, 12 up, 12 in 2024-04-01T19:33:16.931 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:16.932 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:33:17.020 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:16 smithi022 ceph-mon[39439]: pgmap v744: 17 pgs: 17 active+clean; 2.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:33:17.020 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:16 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:17.020 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:16 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:17.020 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:16 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:17.020 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:16 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:17.020 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:16 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:17.020 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:16 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:17.020 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:16 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:17.020 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:16 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:17.020 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:16 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:17.021 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:16 smithi022 ceph-mon[39439]: osdmap e253: 12 total, 12 up, 12 in 2024-04-01T19:33:17.033 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:33:17.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:16 smithi188 ceph-mon[43939]: pgmap v744: 17 pgs: 17 active+clean; 2.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:33:17.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:16 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:17.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:16 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:17.060 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:16 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:17.060 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:16 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:17.060 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:16 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:17.060 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:16 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:17.060 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:16 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:17.060 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:16 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:17.060 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:16 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:17.060 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:16 smithi188 ceph-mon[43939]: osdmap e253: 12 total, 12 up, 12 in 2024-04-01T19:33:17.061 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:17.083 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:33:17.088 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:17.089 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:33:17.190 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:33:17.223 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:17.248 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:33:17.251 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:17.252 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:33:17.272 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:33:17.272 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:33:17.295 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:33:17.352 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:33:17.403 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:17.572 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:33:17.576 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:17.576 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:33:17.677 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:33:17.706 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:17.738 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:33:17.741 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:17.741 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:33:17.793 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.4 to 1 (10000) 2024-04-01T19:33:17.842 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:33:17.890 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:17.995 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:17 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:33:17.995 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:17 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:33:17.995 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:17 smithi062 ceph-mon[44211]: osdmap e254: 12 total, 12 up, 12 in 2024-04-01T19:33:17.995 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:17 smithi062 ceph-mon[44211]: pgmap v747: 17 pgs: 17 active+clean; 2.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:33:17.995 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:17 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2266664557' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T19:33:17.995 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:17 smithi062 ceph-mon[44211]: from='client.25366 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T19:33:17.995 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:17 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:33:17.995 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:17 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:33:18.029 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_blocked_ops 2024-04-01T19:33:18.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:17 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:33:18.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:17 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:33:18.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:17 smithi022 ceph-mon[39439]: osdmap e254: 12 total, 12 up, 12 in 2024-04-01T19:33:18.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:17 smithi022 ceph-mon[39439]: pgmap v747: 17 pgs: 17 active+clean; 2.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:33:18.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:17 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2266664557' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T19:33:18.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:17 smithi022 ceph-mon[39439]: from='client.25366 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T19:33:18.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:17 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:33:18.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:17 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:33:18.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:17 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:33:18.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:17 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:33:18.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:17 smithi188 ceph-mon[43939]: osdmap e254: 12 total, 12 up, 12 in 2024-04-01T19:33:18.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:17 smithi188 ceph-mon[43939]: pgmap v747: 17 pgs: 17 active+clean; 2.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:33:18.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:17 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2266664557' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T19:33:18.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:17 smithi188 ceph-mon[43939]: from='client.25366 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T19:33:18.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:17 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:33:18.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:17 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:33:18.419 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:33:18.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:18 smithi022 ceph-mon[39439]: from='client.25366 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-04-01T19:33:18.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:18 smithi022 ceph-mon[39439]: osdmap e255: 12 total, 12 up, 12 in 2024-04-01T19:33:19.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:18 smithi062 ceph-mon[44211]: from='client.25366 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-04-01T19:33:19.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:18 smithi062 ceph-mon[44211]: osdmap e255: 12 total, 12 up, 12 in 2024-04-01T19:33:19.019 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:33:19.057 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 5 1 2024-04-01T19:33:19.078 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:33:19.088 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:19.089 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:33:19.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:18 smithi188 ceph-mon[43939]: from='client.25366 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-04-01T19:33:19.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:18 smithi188 ceph-mon[43939]: osdmap e255: 12 total, 12 up, 12 in 2024-04-01T19:33:19.189 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:33:19.222 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:19.251 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:33:19.254 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:19.254 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:33:19.355 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:33:19.420 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:19.646 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:33:19.651 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:19.652 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:33:19.752 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:33:19.766 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:33:19.793 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:19 smithi022 ceph-mon[39439]: pgmap v749: 17 pgs: 17 active+clean; 2.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.33k op/s 2024-04-01T19:33:19.818 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:19.994 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:33:20.003 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:20.004 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:33:20.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:19 smithi062 ceph-mon[44211]: pgmap v749: 17 pgs: 17 active+clean; 2.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.33k op/s 2024-04-01T19:33:20.104 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:33:20.127 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:19 smithi188 ceph-mon[43939]: pgmap v749: 17 pgs: 17 active+clean; 2.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.33k op/s 2024-04-01T19:33:20.141 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:20.162 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:33:20.164 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:20.165 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:33:20.266 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:33:20.298 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:20.324 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:33:20.327 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:20.328 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:33:20.379 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:33:20.379 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:33:20.429 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:33:20.456 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:20.479 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:33:20.483 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:20.483 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:33:20.498 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:33:20.584 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:33:20.648 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:20.681 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:33:20.686 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:20.687 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:33:20.788 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:33:20.825 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:20.893 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:33:20.954 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:20 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1367162933' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:33:20.954 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:20 smithi022 ceph-mon[39439]: from='client.35393 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:33:21.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:20 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1367162933' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:33:21.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:20 smithi062 ceph-mon[44211]: from='client.35393 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:33:21.089 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:33:21.095 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:21.096 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:33:21.123 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_historic_ops 2024-04-01T19:33:21.388 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:33:21.389 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:20 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1367162933' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:33:21.389 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:20 smithi188 ceph-mon[43939]: from='client.35393 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:33:21.417 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:21.447 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:33:21.450 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:21.451 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:33:21.551 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:33:21.603 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:21.686 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:33:21.693 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:21.693 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:33:21.779 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:33:21.794 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:33:21.825 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:21.854 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:33:21.863 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:21.864 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:33:21.964 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:33:22.009 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:22.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:21 smithi022 ceph-mon[39439]: pgmap v750: 17 pgs: 17 active+clean; 1.9 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.51k op/s 2024-04-01T19:33:22.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:21 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:33:22.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:21 smithi022 ceph-mon[39439]: from='client.35393 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:33:22.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:21 smithi022 ceph-mon[39439]: osdmap e256: 12 total, 12 up, 12 in 2024-04-01T19:33:22.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:21 smithi188 ceph-mon[43939]: pgmap v750: 17 pgs: 17 active+clean; 1.9 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.51k op/s 2024-04-01T19:33:22.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:21 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:33:22.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:21 smithi188 ceph-mon[43939]: from='client.35393 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:33:22.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:21 smithi188 ceph-mon[43939]: osdmap e256: 12 total, 12 up, 12 in 2024-04-01T19:33:22.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:21 smithi062 ceph-mon[44211]: pgmap v750: 17 pgs: 17 active+clean; 1.9 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.51k op/s 2024-04-01T19:33:22.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:21 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:33:22.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:21 smithi062 ceph-mon[44211]: from='client.35393 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:33:22.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:21 smithi062 ceph-mon[44211]: osdmap e256: 12 total, 12 up, 12 in 2024-04-01T19:33:24.020 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:23 smithi022 ceph-mon[39439]: pgmap v752: 17 pgs: 17 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T19:33:24.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:23 smithi062 ceph-mon[44211]: pgmap v752: 17 pgs: 17 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T19:33:24.276 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:33:24.281 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:24.281 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:33:24.339 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:33:24.371 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:33:24.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:23 smithi188 ceph-mon[43939]: pgmap v752: 17 pgs: 17 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T19:33:24.382 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:33:24.406 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:33:24.421 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:24.445 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:33:24.449 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:33:24.456 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:24.456 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:33:24.484 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:33:24.522 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:33:24.557 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:33:24.558 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:33:24.588 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:33:24.592 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:24.617 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:33:24.619 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:33:24.622 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:24.622 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:33:24.648 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:33:24.677 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:33:24.714 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:33:24.718 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:33:24.718 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:33:24.718 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:33:24.719 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:33:24.719 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:33:24.719 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:33:24.719 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:33:24.719 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:33:24.719 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:33:24.719 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:33:24.719 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:33:24.719 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:33:24.723 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:33:24.756 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:24.882 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:24 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1287279550' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T19:33:24.882 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:24 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1450814266' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:33:24.882 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:24.882 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:24.882 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:24.884 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.5 to 1 (10000) 2024-04-01T19:33:24.965 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:33:24.967 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:24.967 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:33:25.068 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:33:25.106 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:25.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:24 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1287279550' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T19:33:25.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:24 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1450814266' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:33:25.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:25.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:25.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:25.135 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:33:25.139 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:25.139 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:33:25.140 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:24 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1287279550' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T19:33:25.140 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:24 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1450814266' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:33:25.140 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:25.141 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:25.141 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:25.240 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:33:25.307 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:25.369 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:33:25.384 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:25.385 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:33:25.485 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:33:25.541 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:25.803 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 6 1 2024-04-01T19:33:25.822 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:33:25.825 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:25.825 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:33:25.926 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:33:25.971 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:25.994 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:33:25.997 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:25.997 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:33:26.061 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:33:26.098 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:33:26.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:25 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:33:26.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:25 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:33:26.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:25 smithi022 ceph-mon[39439]: pgmap v753: 17 pgs: 17 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:33:26.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:25 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1287279550' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-04-01T19:33:26.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:25 smithi022 ceph-mon[39439]: osdmap e257: 12 total, 12 up, 12 in 2024-04-01T19:33:26.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:25 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:33:26.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:25 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:33:26.131 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:33:26.132 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 20, 2024-04-01T19:33:26.132 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 600, 2024-04-01T19:33:26.132 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:33:26.132 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.132 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:175101 2.2 2:4e4e748c:::benchmark_data_smithi188_77607_object7697:head [delete] snapc 0=[] ondisk+write+known_if_redirected e142)", 2024-04-01T19:33:26.132 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:43.409250+0000", 2024-04-01T19:33:26.132 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 402.72094658999998, 2024-04-01T19:33:26.132 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.05683469, 2024-04-01T19:33:26.132 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:26.132 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:26.132 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:26.132 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:26.132 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:33:26.133 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:26.133 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 175101 2024-04-01T19:33:26.133 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.133 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:26.133 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.133 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:26.133 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.409250+0000", 2024-04-01T19:33:26.133 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.133 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.133 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.133 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:26.133 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.409250+0000", 2024-04-01T19:33:26.133 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.134 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.134 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.134 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:26.134 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.409251+0000", 2024-04-01T19:33:26.134 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3099999999999997e-07 2024-04-01T19:33:26.134 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.134 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.134 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:26.134 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.409253+0000", 2024-04-01T19:33:26.134 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3949999999999999e-06 2024-04-01T19:33:26.134 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.134 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.135 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:26.135 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.409260+0000", 2024-04-01T19:33:26.135 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9140000000000002e-06 2024-04-01T19:33:26.135 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.135 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.135 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:26.135 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.409264+0000", 2024-04-01T19:33:26.135 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8639999999999998e-06 2024-04-01T19:33:26.135 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.135 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.135 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:26.135 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.413507+0000", 2024-04-01T19:33:26.135 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0042429659999999999 2024-04-01T19:33:26.136 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.136 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.136 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:26.136 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.413614+0000", 2024-04-01T19:33:26.136 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00010660800000000001 2024-04-01T19:33:26.136 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.136 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.136 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:33:26.136 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.413729+0000", 2024-04-01T19:33:26.136 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000114924 2024-04-01T19:33:26.136 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.136 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.136 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:26.137 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.418717+0000", 2024-04-01T19:33:26.137 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0049883330000000002 2024-04-01T19:33:26.137 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.137 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.137 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:26.137 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.466007+0000", 2024-04-01T19:33:26.137 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.047289987999999998 2024-04-01T19:33:26.137 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.137 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.137 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:26.137 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.466046+0000", 2024-04-01T19:33:26.137 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8940000000000003e-05 2024-04-01T19:33:26.138 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.138 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.138 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:26.138 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:43.466085+0000", 2024-04-01T19:33:26.138 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9127e-05 2024-04-01T19:33:26.138 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.138 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:26.138 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.138 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.138 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.138 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:179823 2.2 2:4dfdb89f:::benchmark_data_smithi188_77607_object12419:head [delete] snapc 0=[] ondisk+write+known_if_redirected e143)", 2024-04-01T19:33:26.138 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:47.058531+0000", 2024-04-01T19:33:26.138 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 399.07166576600002, 2024-04-01T19:33:26.139 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.061764912999999998, 2024-04-01T19:33:26.139 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:26.139 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:26.139 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:26.139 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:26.139 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:33:26.139 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:26.139 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 179823 2024-04-01T19:33:26.139 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.139 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:26.139 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.139 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:26.139 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.058531+0000", 2024-04-01T19:33:26.140 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.140 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.140 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.140 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:26.140 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.058531+0000", 2024-04-01T19:33:26.140 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.140 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.140 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.140 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:26.140 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.058533+0000", 2024-04-01T19:33:26.140 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.2589999999999999e-06 2024-04-01T19:33:26.140 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.141 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.141 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:26.141 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.058540+0000", 2024-04-01T19:33:26.141 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5899999999999996e-06 2024-04-01T19:33:26.141 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.141 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.141 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:26.141 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.058556+0000", 2024-04-01T19:33:26.141 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.579e-05 2024-04-01T19:33:26.141 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.141 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.141 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:26.141 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.058564+0000", 2024-04-01T19:33:26.142 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.6789999999999994e-06 2024-04-01T19:33:26.142 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.142 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.142 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:26.142 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.058638+0000", 2024-04-01T19:33:26.142 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.3343999999999994e-05 2024-04-01T19:33:26.142 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.142 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.142 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:26.142 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.058746+0000", 2024-04-01T19:33:26.142 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000108733 2024-04-01T19:33:26.142 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.142 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.142 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:33:26.143 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.058864+0000", 2024-04-01T19:33:26.143 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00011739399999999999 2024-04-01T19:33:26.143 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.143 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.143 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:26.143 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.062139+0000", 2024-04-01T19:33:26.143 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.003275488 2024-04-01T19:33:26.143 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.143 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.143 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:26.143 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.120220+0000", 2024-04-01T19:33:26.143 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.058080522000000002 2024-04-01T19:33:26.143 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.143 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.144 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:26.144 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.120259+0000", 2024-04-01T19:33:26.144 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8680999999999998e-05 2024-04-01T19:33:26.144 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.144 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.144 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:26.144 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:47.120296+0000", 2024-04-01T19:33:26.144 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.7432999999999999e-05 2024-04-01T19:33:26.144 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.144 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:26.144 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.144 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.145 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.145 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:301198 2.2 2:48775ec5:::benchmark_data_smithi188_77607_object133794:head [delete] snapc 0=[] ondisk+write+known_if_redirected e178)", 2024-04-01T19:33:26.145 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:29:09.242481+0000", 2024-04-01T19:33:26.145 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 256.88771557699999, 2024-04-01T19:33:26.145 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.057124468999999997, 2024-04-01T19:33:26.145 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:26.145 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:26.145 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:26.145 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:26.145 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:33:26.145 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:26.145 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 301198 2024-04-01T19:33:26.145 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.145 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:26.146 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.146 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:26.146 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.242481+0000", 2024-04-01T19:33:26.146 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.146 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.146 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.146 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:26.146 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.242481+0000", 2024-04-01T19:33:26.146 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.146 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.146 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.146 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:26.147 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.242484+0000", 2024-04-01T19:33:26.147 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3709999999999998e-06 2024-04-01T19:33:26.147 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.147 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.147 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:26.147 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.242490+0000", 2024-04-01T19:33:26.147 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6989999999999997e-06 2024-04-01T19:33:26.147 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.147 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.147 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:26.147 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.242503+0000", 2024-04-01T19:33:26.147 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2822e-05 2024-04-01T19:33:26.148 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.148 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.148 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:26.148 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.242511+0000", 2024-04-01T19:33:26.148 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.525e-06 2024-04-01T19:33:26.148 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.148 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.148 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:26.148 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.242559+0000", 2024-04-01T19:33:26.148 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8560999999999998e-05 2024-04-01T19:33:26.148 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.148 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.148 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:26.149 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.242644+0000", 2024-04-01T19:33:26.149 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.4512999999999995e-05 2024-04-01T19:33:26.149 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.149 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.149 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:33:26.149 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.242712+0000", 2024-04-01T19:33:26.149 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8366000000000002e-05 2024-04-01T19:33:26.149 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.149 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.149 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:26.149 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.246238+0000", 2024-04-01T19:33:26.149 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0035263149999999999 2024-04-01T19:33:26.149 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.150 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.150 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:26.150 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.299531+0000", 2024-04-01T19:33:26.150 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.053292610999999997 2024-04-01T19:33:26.150 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.150 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.150 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:26.150 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.299568+0000", 2024-04-01T19:33:26.150 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.6538999999999997e-05 2024-04-01T19:33:26.150 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.150 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.150 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:26.150 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:09.299606+0000", 2024-04-01T19:33:26.151 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8146999999999999e-05 2024-04-01T19:33:26.151 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.151 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:26.151 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.151 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.151 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.151 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:305492 2.2 2:491b5b0f:::benchmark_data_smithi188_77607_object138088:head [delete] snapc 0=[] ondisk+write+known_if_redirected e178)", 2024-04-01T19:33:26.151 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:29:12.801777+0000", 2024-04-01T19:33:26.151 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 253.328419943, 2024-04-01T19:33:26.151 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.055344009999999999, 2024-04-01T19:33:26.151 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:26.151 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:26.152 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:26.152 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:26.152 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:33:26.152 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:26.152 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 305492 2024-04-01T19:33:26.152 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.153 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:26.153 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.153 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:26.153 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.801777+0000", 2024-04-01T19:33:26.153 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.153 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.153 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.153 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:26.153 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.801777+0000", 2024-04-01T19:33:26.153 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.153 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.153 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.154 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:26.154 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.801778+0000", 2024-04-01T19:33:26.154 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.59e-06 2024-04-01T19:33:26.154 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.154 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.154 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:26.154 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.801784+0000", 2024-04-01T19:33:26.154 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7300000000000002e-06 2024-04-01T19:33:26.154 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.154 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.154 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:26.154 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.801794+0000", 2024-04-01T19:33:26.155 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0076e-05 2024-04-01T19:33:26.155 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.155 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.155 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:26.155 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.801801+0000", 2024-04-01T19:33:26.155 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.331e-06 2024-04-01T19:33:26.155 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.155 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.155 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:26.155 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.801849+0000", 2024-04-01T19:33:26.155 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8588000000000003e-05 2024-04-01T19:33:26.155 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.155 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.156 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:26.156 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.801975+0000", 2024-04-01T19:33:26.156 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000125456 2024-04-01T19:33:26.156 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.156 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.156 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:33:26.156 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.802100+0000", 2024-04-01T19:33:26.156 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000124993 2024-04-01T19:33:26.156 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.156 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.156 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:26.156 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.805409+0000", 2024-04-01T19:33:26.156 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0033097589999999998 2024-04-01T19:33:26.156 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.156 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.157 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:26.157 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.856997+0000", 2024-04-01T19:33:26.157 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.051587252 2024-04-01T19:33:26.157 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.157 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.157 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:26.157 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.857062+0000", 2024-04-01T19:33:26.157 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5575999999999997e-05 2024-04-01T19:33:26.157 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.157 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.157 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:26.157 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:12.857121+0000", 2024-04-01T19:33:26.157 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8659000000000002e-05 2024-04-01T19:33:26.158 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.158 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:26.158 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.158 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.158 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.158 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:28940 3.5 3:a79292cd:::benchmark_data_smithi188_92122_object28939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e198)", 2024-04-01T19:33:26.158 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:30:06.685335+0000", 2024-04-01T19:33:26.158 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 199.444862091, 2024-04-01T19:33:26.158 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.061931159999999999, 2024-04-01T19:33:26.158 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:26.158 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:26.158 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:26.158 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:26.159 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:26.159 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:26.159 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 28940 2024-04-01T19:33:26.159 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.159 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:26.159 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.159 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:26.159 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.685335+0000", 2024-04-01T19:33:26.159 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.159 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.159 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.159 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:26.159 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.685335+0000", 2024-04-01T19:33:26.159 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.159 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.160 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.160 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:26.160 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.685337+0000", 2024-04-01T19:33:26.160 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.266e-06 2024-04-01T19:33:26.160 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.160 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.160 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:26.160 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.685376+0000", 2024-04-01T19:33:26.160 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8934999999999999e-05 2024-04-01T19:33:26.160 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.160 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.160 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:26.160 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.685387+0000", 2024-04-01T19:33:26.160 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1257000000000001e-05 2024-04-01T19:33:26.160 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.161 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.161 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:26.161 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.685395+0000", 2024-04-01T19:33:26.161 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.6299999999999998e-06 2024-04-01T19:33:26.161 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.161 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.161 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:26.161 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.685446+0000", 2024-04-01T19:33:26.161 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1570000000000003e-05 2024-04-01T19:33:26.161 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.161 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.161 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:26.161 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.685563+0000", 2024-04-01T19:33:26.161 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000116222 2024-04-01T19:33:26.162 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.162 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.162 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:33:26.162 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.685901+0000", 2024-04-01T19:33:26.162 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00033886700000000002 2024-04-01T19:33:26.162 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.162 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.162 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:26.162 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.687799+0000", 2024-04-01T19:33:26.162 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00189755 2024-04-01T19:33:26.162 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.162 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.162 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:26.163 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.747203+0000", 2024-04-01T19:33:26.163 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.059404063999999999 2024-04-01T19:33:26.163 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.163 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.163 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:26.163 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.747239+0000", 2024-04-01T19:33:26.163 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.5439999999999999e-05 2024-04-01T19:33:26.163 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.163 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.163 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:26.163 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.747266+0000", 2024-04-01T19:33:26.163 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.7359e-05 2024-04-01T19:33:26.163 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.164 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:26.164 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.164 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.164 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.164 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:28943 3.c 3:3262d9f5:::benchmark_data_smithi188_92122_object28942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e198)", 2024-04-01T19:33:26.164 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:30:06.685413+0000", 2024-04-01T19:33:26.164 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 199.44478375899999, 2024-04-01T19:33:26.164 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.061838168999999998, 2024-04-01T19:33:26.164 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:26.164 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:26.164 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:26.164 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:26.164 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:26.165 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:26.165 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 28943 2024-04-01T19:33:26.165 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.165 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:26.165 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.165 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:26.165 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.685413+0000", 2024-04-01T19:33:26.165 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.165 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.165 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.165 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:26.165 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.685413+0000", 2024-04-01T19:33:26.165 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.165 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.166 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.166 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:26.166 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.685414+0000", 2024-04-01T19:33:26.166 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.3900000000000003e-07 2024-04-01T19:33:26.166 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.166 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.166 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:26.166 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.685447+0000", 2024-04-01T19:33:26.166 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.2568999999999999e-05 2024-04-01T19:33:26.166 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.166 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.166 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:26.166 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.685453+0000", 2024-04-01T19:33:26.167 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.7700000000000004e-06 2024-04-01T19:33:26.167 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.167 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.167 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:26.167 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.685459+0000", 2024-04-01T19:33:26.167 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6409999999999999e-06 2024-04-01T19:33:26.167 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.167 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.167 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:26.167 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.685529+0000", 2024-04-01T19:33:26.167 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9979000000000002e-05 2024-04-01T19:33:26.167 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.167 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.168 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:26.168 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.685645+0000", 2024-04-01T19:33:26.168 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000116168 2024-04-01T19:33:26.168 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.168 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.168 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:33:26.168 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.685815+0000", 2024-04-01T19:33:26.168 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00016953899999999999 2024-04-01T19:33:26.168 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.168 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.168 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:26.168 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.688034+0000", 2024-04-01T19:33:26.168 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0022197570000000002 2024-04-01T19:33:26.169 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.169 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.169 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:26.169 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.747149+0000", 2024-04-01T19:33:26.169 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.059114113000000003 2024-04-01T19:33:26.169 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.169 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.169 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:26.169 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.747200+0000", 2024-04-01T19:33:26.169 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1955e-05 2024-04-01T19:33:26.169 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.169 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.169 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:26.170 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:06.747251+0000", 2024-04-01T19:33:26.170 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0739000000000003e-05 2024-04-01T19:33:26.170 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.170 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:26.170 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.170 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.170 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.170 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:139751 3.5 3:a2388e67:::benchmark_data_smithi188_92122_object139750:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e218)", 2024-04-01T19:33:26.170 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:31:09.007724+0000", 2024-04-01T19:33:26.170 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 137.122472483, 2024-04-01T19:33:26.170 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.064348449000000002, 2024-04-01T19:33:26.170 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:26.170 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:26.171 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:26.171 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:26.171 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:26.171 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:26.171 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 139751 2024-04-01T19:33:26.171 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.171 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:26.171 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.171 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:26.171 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.007724+0000", 2024-04-01T19:33:26.171 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.171 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.171 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.172 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:26.172 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.007724+0000", 2024-04-01T19:33:26.172 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.172 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.172 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.172 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:26.172 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.007725+0000", 2024-04-01T19:33:26.172 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2399999999999998e-07 2024-04-01T19:33:26.172 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.172 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.172 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:26.172 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.007793+0000", 2024-04-01T19:33:26.172 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8439e-05 2024-04-01T19:33:26.173 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.173 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.173 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:26.173 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.007802+0000", 2024-04-01T19:33:26.173 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.2139999999999996e-06 2024-04-01T19:33:26.173 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.173 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.173 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:26.173 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.007809+0000", 2024-04-01T19:33:26.173 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.3849999999999996e-06 2024-04-01T19:33:26.173 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.173 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.173 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:26.173 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.016098+0000", 2024-04-01T19:33:26.174 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0082887389999999998 2024-04-01T19:33:26.174 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.174 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.174 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:26.174 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.016240+0000", 2024-04-01T19:33:26.174 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000141946 2024-04-01T19:33:26.174 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.174 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.174 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:33:26.174 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.016389+0000", 2024-04-01T19:33:26.174 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000149543 2024-04-01T19:33:26.174 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.174 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.175 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:26.175 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.028211+0000", 2024-04-01T19:33:26.175 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.011821744 2024-04-01T19:33:26.175 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.175 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.175 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:26.175 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.071997+0000", 2024-04-01T19:33:26.175 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.043786026999999998 2024-04-01T19:33:26.175 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.175 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.175 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:26.175 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.072033+0000", 2024-04-01T19:33:26.175 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.6232000000000001e-05 2024-04-01T19:33:26.175 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.176 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.176 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:26.176 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.072073+0000", 2024-04-01T19:33:26.176 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9555999999999999e-05 2024-04-01T19:33:26.176 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.176 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:26.176 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.176 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.176 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.176 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:139758 3.5 3:a1b48f8a:::benchmark_data_smithi188_92122_object139757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e218)", 2024-04-01T19:33:26.176 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:31:09.011990+0000", 2024-04-01T19:33:26.176 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 137.11820631099999, 2024-04-01T19:33:26.176 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.060186133000000003, 2024-04-01T19:33:26.177 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:26.177 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:26.177 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:26.177 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:26.177 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:26.177 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:26.177 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 139758 2024-04-01T19:33:26.177 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.177 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:26.177 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.177 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:26.177 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.011990+0000", 2024-04-01T19:33:26.177 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.177 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.177 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.177 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:26.178 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.011990+0000", 2024-04-01T19:33:26.178 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.178 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.178 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.178 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:26.178 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.011993+0000", 2024-04-01T19:33:26.178 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.4200000000000001e-06 2024-04-01T19:33:26.178 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.178 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.178 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:26.178 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.012049+0000", 2024-04-01T19:33:26.178 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6400000000000002e-05 2024-04-01T19:33:26.178 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.179 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.179 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:26.179 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.012060+0000", 2024-04-01T19:33:26.179 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0638999999999999e-05 2024-04-01T19:33:26.179 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.179 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.179 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:26.179 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.012068+0000", 2024-04-01T19:33:26.179 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0879999999999995e-06 2024-04-01T19:33:26.179 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.179 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.179 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:26.179 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.020279+0000", 2024-04-01T19:33:26.179 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0082113729999999992 2024-04-01T19:33:26.179 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.179 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.180 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:26.180 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.020397+0000", 2024-04-01T19:33:26.180 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00011733799999999999 2024-04-01T19:33:26.180 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.180 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.180 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:33:26.180 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.020541+0000", 2024-04-01T19:33:26.180 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000144017 2024-04-01T19:33:26.180 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.180 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.180 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:26.180 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.028244+0000", 2024-04-01T19:33:26.180 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0077030359999999999 2024-04-01T19:33:26.180 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.180 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.181 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:26.181 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.072114+0000", 2024-04-01T19:33:26.181 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.043870076000000001 2024-04-01T19:33:26.181 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.181 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.181 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:26.181 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.072148+0000", 2024-04-01T19:33:26.181 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.3772000000000001e-05 2024-04-01T19:33:26.181 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.181 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.181 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:26.181 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.072177+0000", 2024-04-01T19:33:26.181 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8974000000000001e-05 2024-04-01T19:33:26.181 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.181 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:26.182 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.182 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.182 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.182 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:140390 3.c 3:349a9b59:::benchmark_data_smithi188_92122_object140389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e218)", 2024-04-01T19:33:26.182 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:31:09.503788+0000", 2024-04-01T19:33:26.182 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 136.626408556, 2024-04-01T19:33:26.182 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.055873359999999997, 2024-04-01T19:33:26.182 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:26.182 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:26.182 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:26.182 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:26.182 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:26.182 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:26.182 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 140390 2024-04-01T19:33:26.183 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.183 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:26.183 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.183 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:26.183 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.503788+0000", 2024-04-01T19:33:26.183 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.183 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.183 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.183 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:26.183 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.503788+0000", 2024-04-01T19:33:26.183 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.183 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.183 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.183 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:26.184 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.503790+0000", 2024-04-01T19:33:26.184 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.7409999999999999e-06 2024-04-01T19:33:26.184 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.184 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.184 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:26.184 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.503850+0000", 2024-04-01T19:33:26.184 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.0469e-05 2024-04-01T19:33:26.184 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.184 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.184 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:26.184 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.503861+0000", 2024-04-01T19:33:26.184 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0438000000000001e-05 2024-04-01T19:33:26.184 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.184 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.184 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:26.185 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.503869+0000", 2024-04-01T19:33:26.185 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.1329999999999999e-06 2024-04-01T19:33:26.185 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.185 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.185 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:26.185 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.503934+0000", 2024-04-01T19:33:26.185 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5327000000000007e-05 2024-04-01T19:33:26.185 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.185 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.185 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:26.185 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.504075+0000", 2024-04-01T19:33:26.185 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014053899999999999 2024-04-01T19:33:26.185 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.185 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.185 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:33:26.186 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.504229+0000", 2024-04-01T19:33:26.186 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00015418699999999999 2024-04-01T19:33:26.186 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.186 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.186 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:26.186 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.508242+0000", 2024-04-01T19:33:26.186 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0040132259999999999 2024-04-01T19:33:26.186 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.186 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.186 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:26.186 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.559594+0000", 2024-04-01T19:33:26.186 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.051351711000000001 2024-04-01T19:33:26.186 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.187 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.187 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:26.187 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.559629+0000", 2024-04-01T19:33:26.187 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.5247999999999999e-05 2024-04-01T19:33:26.187 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.187 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.187 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:26.187 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.559662+0000", 2024-04-01T19:33:26.187 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.2341000000000001e-05 2024-04-01T19:33:26.187 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.187 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:26.187 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.187 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.187 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.187 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:140403 3.5 3:ab94ea7a:::benchmark_data_smithi188_92122_object140402:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e218)", 2024-04-01T19:33:26.188 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:31:09.513654+0000", 2024-04-01T19:33:26.188 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 136.61654237799999, 2024-04-01T19:33:26.188 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.062082091999999998, 2024-04-01T19:33:26.188 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:26.188 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:26.188 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:26.188 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:26.188 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:26.188 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:26.188 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 140403 2024-04-01T19:33:26.188 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.188 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:26.188 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.188 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:26.189 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.513654+0000", 2024-04-01T19:33:26.189 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.189 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.189 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.189 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:26.189 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.513654+0000", 2024-04-01T19:33:26.189 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.189 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.189 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.189 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:26.189 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.513655+0000", 2024-04-01T19:33:26.189 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.032e-06 2024-04-01T19:33:26.189 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.189 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.190 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:26.190 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.513732+0000", 2024-04-01T19:33:26.190 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.6307e-05 2024-04-01T19:33:26.190 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.190 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.190 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:26.190 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.513745+0000", 2024-04-01T19:33:26.190 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2972e-05 2024-04-01T19:33:26.190 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.190 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.190 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:26.190 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.513759+0000", 2024-04-01T19:33:26.190 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3978999999999999e-05 2024-04-01T19:33:26.191 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.191 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.191 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:26.191 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.513825+0000", 2024-04-01T19:33:26.191 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5860999999999998e-05 2024-04-01T19:33:26.191 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.191 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.191 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:26.191 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.513941+0000", 2024-04-01T19:33:26.191 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00011668899999999999 2024-04-01T19:33:26.191 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.191 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.191 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:33:26.191 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.514076+0000", 2024-04-01T19:33:26.192 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013455499999999999 2024-04-01T19:33:26.192 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.192 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.192 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:26.192 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.518220+0000", 2024-04-01T19:33:26.192 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0041439470000000003 2024-04-01T19:33:26.192 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.192 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.192 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:26.192 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.575617+0000", 2024-04-01T19:33:26.192 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.057397675000000002 2024-04-01T19:33:26.192 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.192 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.192 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:26.193 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.575683+0000", 2024-04-01T19:33:26.193 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5386e-05 2024-04-01T19:33:26.193 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.193 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.193 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:26.193 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:09.575737+0000", 2024-04-01T19:33:26.193 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3689e-05 2024-04-01T19:33:26.193 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.193 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:26.193 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.193 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.193 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.193 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:169692 3.c 3:371e9a23:::benchmark_data_smithi188_92122_object4101:head [delete] snapc 0=[] ondisk+write+known_if_redirected e226)", 2024-04-01T19:33:26.194 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:31:33.871482+0000", 2024-04-01T19:33:26.194 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 112.258715193, 2024-04-01T19:33:26.194 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.059729655999999999, 2024-04-01T19:33:26.194 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:26.194 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:26.194 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:26.194 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:26.194 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:26.194 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:26.194 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 169692 2024-04-01T19:33:26.194 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.194 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:26.194 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.195 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:26.195 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.871482+0000", 2024-04-01T19:33:26.195 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.195 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.195 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.195 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:26.195 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.871482+0000", 2024-04-01T19:33:26.195 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.195 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.195 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.195 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:26.195 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.871484+0000", 2024-04-01T19:33:26.195 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1670000000000002e-06 2024-04-01T19:33:26.195 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.196 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.196 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:26.196 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.871491+0000", 2024-04-01T19:33:26.196 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.7780000000000002e-06 2024-04-01T19:33:26.196 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.196 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.196 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:26.196 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.871503+0000", 2024-04-01T19:33:26.196 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2899e-05 2024-04-01T19:33:26.196 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.196 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.196 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:26.197 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.871512+0000", 2024-04-01T19:33:26.197 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.1329999999999999e-06 2024-04-01T19:33:26.197 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.197 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.197 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:26.197 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.871569+0000", 2024-04-01T19:33:26.197 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6996000000000001e-05 2024-04-01T19:33:26.197 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.197 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.197 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:26.197 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.871696+0000", 2024-04-01T19:33:26.197 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012775800000000001 2024-04-01T19:33:26.197 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.197 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.198 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:33:26.198 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.871827+0000", 2024-04-01T19:33:26.198 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013104100000000001 2024-04-01T19:33:26.198 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.198 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.198 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:26.198 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.876300+0000", 2024-04-01T19:33:26.198 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0044727070000000002 2024-04-01T19:33:26.198 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.198 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.198 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:26.198 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.931149+0000", 2024-04-01T19:33:26.198 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.054848696000000002 2024-04-01T19:33:26.198 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.199 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.199 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:26.199 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.931183+0000", 2024-04-01T19:33:26.199 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.3735000000000001e-05 2024-04-01T19:33:26.199 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.199 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.199 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:26.199 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:33.931211+0000", 2024-04-01T19:33:26.199 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8745999999999999e-05 2024-04-01T19:33:26.199 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.199 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:26.199 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.199 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.199 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.200 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:230112 3.5 3:a6c6ad31:::benchmark_data_smithi188_92122_object64521:head [delete] snapc 0=[] ondisk+write+known_if_redirected e240)", 2024-04-01T19:33:26.200 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:32:21.732392+0000", 2024-04-01T19:33:26.200 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 64.397805172999995, 2024-04-01T19:33:26.200 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.076769050000000005, 2024-04-01T19:33:26.200 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:26.200 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:26.200 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:26.200 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:26.200 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:26.200 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:26.200 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 230112 2024-04-01T19:33:26.200 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.200 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:26.200 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.201 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:26.201 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.732392+0000", 2024-04-01T19:33:26.201 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.201 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.201 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.201 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:26.201 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.732392+0000", 2024-04-01T19:33:26.201 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.201 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.201 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.201 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:26.201 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.732393+0000", 2024-04-01T19:33:26.201 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.5099999999999999e-06 2024-04-01T19:33:26.201 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.202 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.202 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:26.202 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.732398+0000", 2024-04-01T19:33:26.202 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3600000000000004e-06 2024-04-01T19:33:26.202 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.202 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.202 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:26.202 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.732408+0000", 2024-04-01T19:33:26.202 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.4639999999999995e-06 2024-04-01T19:33:26.202 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.202 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.202 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:26.202 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.732413+0000", 2024-04-01T19:33:26.203 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.536e-06 2024-04-01T19:33:26.203 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.203 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.203 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:26.203 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.732461+0000", 2024-04-01T19:33:26.203 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7348000000000001e-05 2024-04-01T19:33:26.203 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.203 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.203 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:26.203 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.732577+0000", 2024-04-01T19:33:26.203 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000116564 2024-04-01T19:33:26.203 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.204 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.204 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:33:26.204 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.732690+0000", 2024-04-01T19:33:26.204 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000113056 2024-04-01T19:33:26.204 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.204 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.204 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:26.204 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.738492+0000", 2024-04-01T19:33:26.204 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0058015009999999997 2024-04-01T19:33:26.204 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.204 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.205 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:26.205 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.809099+0000", 2024-04-01T19:33:26.205 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.070606564999999996 2024-04-01T19:33:26.205 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.205 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.205 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:26.205 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.809133+0000", 2024-04-01T19:33:26.205 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.4622000000000002e-05 2024-04-01T19:33:26.205 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.205 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.205 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:26.205 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.809161+0000", 2024-04-01T19:33:26.205 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.7523999999999999e-05 2024-04-01T19:33:26.206 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.206 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:26.206 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.206 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.206 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.206 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:230113 3.5 3:a16cc8aa:::benchmark_data_smithi188_92122_object64522:head [delete] snapc 0=[] ondisk+write+known_if_redirected e240)", 2024-04-01T19:33:26.206 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:32:21.732748+0000", 2024-04-01T19:33:26.206 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 64.397448709000003, 2024-04-01T19:33:26.206 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.076579954000000006, 2024-04-01T19:33:26.206 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:26.206 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:26.206 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:26.207 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:26.207 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:26.207 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:26.207 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 230113 2024-04-01T19:33:26.207 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.207 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:26.207 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.207 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:26.207 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.732748+0000", 2024-04-01T19:33:26.207 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.207 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.207 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.208 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:26.208 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.732748+0000", 2024-04-01T19:33:26.208 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.208 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.208 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.208 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:26.208 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.732750+0000", 2024-04-01T19:33:26.208 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1749999999999999e-06 2024-04-01T19:33:26.208 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.208 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.208 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:26.208 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.732755+0000", 2024-04-01T19:33:26.208 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.2710000000000003e-06 2024-04-01T19:33:26.208 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.209 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.209 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:26.209 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.732769+0000", 2024-04-01T19:33:26.209 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4836e-05 2024-04-01T19:33:26.209 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.209 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.209 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:26.209 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.732776+0000", 2024-04-01T19:33:26.209 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5030000000000002e-06 2024-04-01T19:33:26.209 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.209 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.209 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:26.210 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.736234+0000", 2024-04-01T19:33:26.210 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.003457913 2024-04-01T19:33:26.210 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.210 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.210 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:26.210 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.736343+0000", 2024-04-01T19:33:26.210 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00010917900000000001 2024-04-01T19:33:26.210 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.210 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.210 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:33:26.210 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.736419+0000", 2024-04-01T19:33:26.210 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.6474e-05 2024-04-01T19:33:26.210 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.211 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.211 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:26.211 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.738666+0000", 2024-04-01T19:33:26.211 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0022468800000000001 2024-04-01T19:33:26.211 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.211 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.211 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:26.211 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.809218+0000", 2024-04-01T19:33:26.211 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.070551498000000004 2024-04-01T19:33:26.211 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.211 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.211 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:26.211 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.809276+0000", 2024-04-01T19:33:26.212 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8007000000000002e-05 2024-04-01T19:33:26.212 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.212 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.212 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:26.212 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.809328+0000", 2024-04-01T19:33:26.212 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2218e-05 2024-04-01T19:33:26.212 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.212 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:26.212 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.212 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.212 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.212 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:230119 3.5 3:a1e8222b:::benchmark_data_smithi188_92122_object64528:head [delete] snapc 0=[] ondisk+write+known_if_redirected e240)", 2024-04-01T19:33:26.212 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:32:21.738825+0000", 2024-04-01T19:33:26.212 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 64.391371964000001, 2024-04-01T19:33:26.213 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.070616727000000004, 2024-04-01T19:33:26.213 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:26.213 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:26.213 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:26.213 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:26.213 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:26.213 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:26.213 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 230119 2024-04-01T19:33:26.213 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.213 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:26.213 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.213 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:26.213 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.738825+0000", 2024-04-01T19:33:26.213 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.214 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.214 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.214 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:26.214 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.738825+0000", 2024-04-01T19:33:26.214 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.214 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.214 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.214 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:26.214 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.738826+0000", 2024-04-01T19:33:26.214 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.35e-06 2024-04-01T19:33:26.214 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.214 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.214 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:26.215 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.738831+0000", 2024-04-01T19:33:26.215 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.4800000000000003e-06 2024-04-01T19:33:26.215 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.215 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.215 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:26.215 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.738842+0000", 2024-04-01T19:33:26.215 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1034e-05 2024-04-01T19:33:26.215 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.215 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.215 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:26.215 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.738848+0000", 2024-04-01T19:33:26.215 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.0809999999999999e-06 2024-04-01T19:33:26.215 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.215 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.215 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:26.216 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.738891+0000", 2024-04-01T19:33:26.216 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3464000000000003e-05 2024-04-01T19:33:26.216 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.216 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.216 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:26.216 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.738981+0000", 2024-04-01T19:33:26.216 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.0047e-05 2024-04-01T19:33:26.216 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.216 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.216 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:33:26.216 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.739102+0000", 2024-04-01T19:33:26.216 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012045 2024-04-01T19:33:26.216 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.216 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.217 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:26.217 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.742958+0000", 2024-04-01T19:33:26.217 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0038558249999999998 2024-04-01T19:33:26.217 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.217 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.217 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:26.217 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.809371+0000", 2024-04-01T19:33:26.217 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.066413002999999998 2024-04-01T19:33:26.217 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.217 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.217 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:26.217 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.809402+0000", 2024-04-01T19:33:26.217 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.1704e-05 2024-04-01T19:33:26.217 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.218 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.218 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:26.218 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.809442+0000", 2024-04-01T19:33:26.218 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9289000000000003e-05 2024-04-01T19:33:26.218 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.218 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:26.218 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.218 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.218 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.218 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:230128 3.5 3:a5e9604f:::benchmark_data_smithi188_92122_object64537:head [delete] snapc 0=[] ondisk+write+known_if_redirected e240)", 2024-04-01T19:33:26.218 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:32:21.744517+0000", 2024-04-01T19:33:26.218 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 64.385680163000004, 2024-04-01T19:33:26.218 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.065078525999999998, 2024-04-01T19:33:26.219 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:26.219 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:26.219 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:26.219 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:26.219 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:26.219 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:26.219 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 230128 2024-04-01T19:33:26.219 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.219 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:26.219 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.219 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:26.219 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.744517+0000", 2024-04-01T19:33:26.219 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.219 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.220 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.220 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:26.220 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.744517+0000", 2024-04-01T19:33:26.220 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.220 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.220 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.220 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:26.220 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.744519+0000", 2024-04-01T19:33:26.220 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.0760000000000001e-06 2024-04-01T19:33:26.220 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.220 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.220 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:26.220 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.744525+0000", 2024-04-01T19:33:26.220 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.0859999999999998e-06 2024-04-01T19:33:26.221 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.221 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.221 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:26.221 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.744535+0000", 2024-04-01T19:33:26.221 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0444e-05 2024-04-01T19:33:26.221 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.221 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.221 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:26.221 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.744542+0000", 2024-04-01T19:33:26.221 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6429999999999998e-06 2024-04-01T19:33:26.221 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.221 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.221 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:26.221 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.744604+0000", 2024-04-01T19:33:26.222 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2012000000000002e-05 2024-04-01T19:33:26.222 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.222 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.222 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:26.222 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.744745+0000", 2024-04-01T19:33:26.222 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000140858 2024-04-01T19:33:26.222 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.222 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.222 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:33:26.222 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.744880+0000", 2024-04-01T19:33:26.222 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013541599999999999 2024-04-01T19:33:26.222 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.222 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.223 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:26.223 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.749711+0000", 2024-04-01T19:33:26.223 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0048310940000000002 2024-04-01T19:33:26.223 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.223 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.223 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:26.223 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.809492+0000", 2024-04-01T19:33:26.223 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.059780456000000003 2024-04-01T19:33:26.223 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.223 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.223 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:26.223 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.809546+0000", 2024-04-01T19:33:26.223 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.4376000000000003e-05 2024-04-01T19:33:26.223 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.224 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.224 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:26.224 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.809595+0000", 2024-04-01T19:33:26.224 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9064999999999999e-05 2024-04-01T19:33:26.224 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.224 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:26.224 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.224 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.224 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.224 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:230135 3.5 3:a32c7565:::benchmark_data_smithi188_92122_object64544:head [delete] snapc 0=[] ondisk+write+known_if_redirected e240)", 2024-04-01T19:33:26.224 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:32:21.750225+0000", 2024-04-01T19:33:26.224 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 64.379971909000005, 2024-04-01T19:33:26.224 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.059485492000000001, 2024-04-01T19:33:26.224 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:26.225 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:26.225 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:26.225 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:26.225 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:26.225 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:26.225 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 230135 2024-04-01T19:33:26.225 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.225 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:26.225 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.225 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:26.225 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.750225+0000", 2024-04-01T19:33:26.225 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.225 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.225 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.226 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:26.226 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.750225+0000", 2024-04-01T19:33:26.226 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.226 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.226 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.226 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:26.226 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.750227+0000", 2024-04-01T19:33:26.226 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.4109999999999999e-06 2024-04-01T19:33:26.226 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.226 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.226 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:26.226 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.750234+0000", 2024-04-01T19:33:26.226 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9210000000000003e-06 2024-04-01T19:33:26.227 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.227 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.227 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:26.227 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.750249+0000", 2024-04-01T19:33:26.227 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.5143000000000001e-05 2024-04-01T19:33:26.227 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.227 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.227 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:26.227 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.750258+0000", 2024-04-01T19:33:26.227 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.3739999999999998e-06 2024-04-01T19:33:26.227 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.227 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.227 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:26.227 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.751010+0000", 2024-04-01T19:33:26.228 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00075248199999999996 2024-04-01T19:33:26.228 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.228 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.228 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:26.228 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.751149+0000", 2024-04-01T19:33:26.228 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000138684 2024-04-01T19:33:26.228 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.228 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.228 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:33:26.228 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.751279+0000", 2024-04-01T19:33:26.228 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013053199999999999 2024-04-01T19:33:26.228 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.228 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.228 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:26.229 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.759514+0000", 2024-04-01T19:33:26.229 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0082350050000000001 2024-04-01T19:33:26.229 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.229 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.229 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:26.229 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.809645+0000", 2024-04-01T19:33:26.229 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.050130842000000002 2024-04-01T19:33:26.229 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.229 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.229 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:26.229 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.809675+0000", 2024-04-01T19:33:26.229 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.9515000000000001e-05 2024-04-01T19:33:26.229 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.230 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.230 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:26.230 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.809710+0000", 2024-04-01T19:33:26.230 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.5583000000000001e-05 2024-04-01T19:33:26.230 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.230 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:26.230 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.230 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.230 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.230 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:230136 3.5 3:ac530f57:::benchmark_data_smithi188_92122_object64545:head [delete] snapc 0=[] ondisk+write+known_if_redirected e240)", 2024-04-01T19:33:26.230 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:32:21.750277+0000", 2024-04-01T19:33:26.230 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 64.379919990999994, 2024-04-01T19:33:26.230 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.059602679999999998, 2024-04-01T19:33:26.231 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:26.231 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:26.231 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:26.231 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:26.231 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:26.231 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:26.231 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 230136 2024-04-01T19:33:26.231 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.231 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:26.231 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.231 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:26.231 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.750277+0000", 2024-04-01T19:33:26.231 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.232 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.232 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.232 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:26.232 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.750277+0000", 2024-04-01T19:33:26.232 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.232 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.232 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.232 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:26.232 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.750278+0000", 2024-04-01T19:33:26.232 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.0699999999999996e-07 2024-04-01T19:33:26.232 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.232 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.233 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:26.233 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.750281+0000", 2024-04-01T19:33:26.233 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.1030000000000002e-06 2024-04-01T19:33:26.233 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.233 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.233 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:26.233 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.750286+0000", 2024-04-01T19:33:26.233 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.4489999999999998e-06 2024-04-01T19:33:26.233 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.233 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.233 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:26.234 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.750292+0000", 2024-04-01T19:33:26.234 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.4609999999999999e-06 2024-04-01T19:33:26.234 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.234 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.234 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:26.234 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.755174+0000", 2024-04-01T19:33:26.234 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0048821059999999998 2024-04-01T19:33:26.234 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.234 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.234 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:26.234 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.755293+0000", 2024-04-01T19:33:26.234 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000119616 2024-04-01T19:33:26.235 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.235 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.235 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:33:26.235 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.755412+0000", 2024-04-01T19:33:26.235 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000118411 2024-04-01T19:33:26.235 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.235 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.235 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:26.235 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.759590+0000", 2024-04-01T19:33:26.235 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0041785930000000004 2024-04-01T19:33:26.235 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.235 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.235 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:26.236 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.809771+0000", 2024-04-01T19:33:26.236 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.050180972999999997 2024-04-01T19:33:26.236 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.236 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.236 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:26.236 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.809835+0000", 2024-04-01T19:33:26.236 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3751999999999995e-05 2024-04-01T19:33:26.236 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.236 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.236 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:26.236 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.809879+0000", 2024-04-01T19:33:26.237 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.4508999999999997e-05 2024-04-01T19:33:26.237 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.237 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:26.237 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.237 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.237 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.237 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:230139 3.c 3:3022a283:::benchmark_data_smithi188_92122_object64548:head [delete] snapc 0=[] ondisk+write+known_if_redirected e240)", 2024-04-01T19:33:26.237 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:32:21.753521+0000", 2024-04-01T19:33:26.237 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 64.376676235999994, 2024-04-01T19:33:26.237 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.055604909000000001, 2024-04-01T19:33:26.238 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:26.238 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:26.238 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:26.238 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:26.238 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:26.238 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:26.238 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 230139 2024-04-01T19:33:26.238 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.238 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:26.238 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.238 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:26.238 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.753521+0000", 2024-04-01T19:33:26.239 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.239 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.239 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.239 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:26.239 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.753521+0000", 2024-04-01T19:33:26.239 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.239 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.239 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.239 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:26.239 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.753523+0000", 2024-04-01T19:33:26.239 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1600000000000001e-06 2024-04-01T19:33:26.239 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.240 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.240 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:26.240 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.753529+0000", 2024-04-01T19:33:26.240 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.139e-06 2024-04-01T19:33:26.240 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.240 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.240 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:26.240 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.753542+0000", 2024-04-01T19:33:26.240 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3135e-05 2024-04-01T19:33:26.240 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.240 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.240 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:26.241 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.753550+0000", 2024-04-01T19:33:26.241 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.3790000000000006e-06 2024-04-01T19:33:26.241 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.241 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.241 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:26.241 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.753607+0000", 2024-04-01T19:33:26.241 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6784999999999999e-05 2024-04-01T19:33:26.241 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.241 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.242 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:26.242 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.753732+0000", 2024-04-01T19:33:26.242 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012458 2024-04-01T19:33:26.242 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.242 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.242 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:33:26.242 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.753858+0000", 2024-04-01T19:33:26.242 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000126589 2024-04-01T19:33:26.242 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.242 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.242 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:26.242 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.758298+0000", 2024-04-01T19:33:26.242 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0044399330000000001 2024-04-01T19:33:26.243 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.243 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.243 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:26.243 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.809005+0000", 2024-04-01T19:33:26.243 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.050707172000000002 2024-04-01T19:33:26.243 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.243 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.243 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:26.243 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.809100+0000", 2024-04-01T19:33:26.243 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.4918000000000002e-05 2024-04-01T19:33:26.243 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.243 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.244 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:26.244 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:21.809125+0000", 2024-04-01T19:33:26.244 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.5119000000000001e-05 2024-04-01T19:33:26.244 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.244 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:26.244 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.244 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.244 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.244 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:295231 3.5 3:a02b83ba:::benchmark_data_smithi188_92122_object129640:head [delete] snapc 0=[] ondisk+write+known_if_redirected e252)", 2024-04-01T19:33:26.244 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:33:14.889089+0000", 2024-04-01T19:33:26.244 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 11.241107936000001, 2024-04-01T19:33:26.244 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.063428310000000002, 2024-04-01T19:33:26.244 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:26.245 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:26.245 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:26.245 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:26.245 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:26.245 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:26.245 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 295231 2024-04-01T19:33:26.245 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.245 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:26.245 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.245 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:26.245 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.889089+0000", 2024-04-01T19:33:26.245 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.245 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.246 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.246 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:26.246 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.889089+0000", 2024-04-01T19:33:26.246 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.246 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.246 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.246 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:26.246 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.889091+0000", 2024-04-01T19:33:26.246 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.5270000000000001e-06 2024-04-01T19:33:26.246 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.247 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.247 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:26.247 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.889100+0000", 2024-04-01T19:33:26.247 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.5830000000000007e-06 2024-04-01T19:33:26.247 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.247 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.247 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:26.247 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.889113+0000", 2024-04-01T19:33:26.247 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.349e-05 2024-04-01T19:33:26.248 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.248 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.248 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:26.248 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.889122+0000", 2024-04-01T19:33:26.248 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.2490000000000001e-06 2024-04-01T19:33:26.248 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.248 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.248 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:26.248 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.904634+0000", 2024-04-01T19:33:26.248 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.015512191 2024-04-01T19:33:26.248 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.248 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.248 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:26.248 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.904774+0000", 2024-04-01T19:33:26.249 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013989300000000001 2024-04-01T19:33:26.249 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.249 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.249 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:33:26.249 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.904897+0000", 2024-04-01T19:33:26.249 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012275400000000001 2024-04-01T19:33:26.249 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.249 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.249 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:26.249 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.914201+0000", 2024-04-01T19:33:26.249 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0093047560000000008 2024-04-01T19:33:26.249 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.250 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.250 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:26.250 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.952406+0000", 2024-04-01T19:33:26.250 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.038204821999999999 2024-04-01T19:33:26.250 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.250 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.250 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:26.250 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.952465+0000", 2024-04-01T19:33:26.250 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8468000000000003e-05 2024-04-01T19:33:26.250 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.250 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.251 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:26.251 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.952517+0000", 2024-04-01T19:33:26.251 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2577000000000002e-05 2024-04-01T19:33:26.251 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.251 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:26.251 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.251 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.251 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.251 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:295238 3.5 3:a4f40aea:::benchmark_data_smithi188_92122_object129647:head [delete] snapc 0=[] ondisk+write+known_if_redirected e252)", 2024-04-01T19:33:26.251 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:33:14.895052+0000", 2024-04-01T19:33:26.252 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 11.235145293, 2024-04-01T19:33:26.252 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.057578981000000001, 2024-04-01T19:33:26.252 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:26.252 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:26.252 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:26.252 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:26.252 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:26.252 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:26.252 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 295238 2024-04-01T19:33:26.252 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.252 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:26.252 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.252 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:26.253 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.895052+0000", 2024-04-01T19:33:26.253 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.253 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.253 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.253 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:26.253 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.895052+0000", 2024-04-01T19:33:26.253 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:26.253 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.253 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.253 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:26.253 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.895053+0000", 2024-04-01T19:33:26.253 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4410000000000001e-06 2024-04-01T19:33:26.253 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.254 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.254 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:26.254 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.895057+0000", 2024-04-01T19:33:26.254 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9210000000000002e-06 2024-04-01T19:33:26.254 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.254 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.254 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:26.254 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.895065+0000", 2024-04-01T19:33:26.254 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9270000000000005e-06 2024-04-01T19:33:26.254 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.254 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.255 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:26.255 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.895070+0000", 2024-04-01T19:33:26.255 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2549999999999997e-06 2024-04-01T19:33:26.255 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.255 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.255 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:26.255 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.909360+0000", 2024-04-01T19:33:26.255 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.014289606999999999 2024-04-01T19:33:26.256 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.256 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.256 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:26.256 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.909459+0000", 2024-04-01T19:33:26.256 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.9802000000000004e-05 2024-04-01T19:33:26.256 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.256 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.256 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:33:26.256 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.909547+0000", 2024-04-01T19:33:26.256 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.7729e-05 2024-04-01T19:33:26.256 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.256 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.256 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:26.256 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.914317+0000", 2024-04-01T19:33:26.257 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0047700759999999998 2024-04-01T19:33:26.257 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.257 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.257 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:26.257 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.952555+0000", 2024-04-01T19:33:26.257 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.038237927999999997 2024-04-01T19:33:26.257 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.257 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.257 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:26.257 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.952596+0000", 2024-04-01T19:33:26.257 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0611999999999997e-05 2024-04-01T19:33:26.257 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:26.257 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:26.257 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:26.258 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:33:14.952630+0000", 2024-04-01T19:33:26.258 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.4683e-05 2024-04-01T19:33:26.258 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.258 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:26.258 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.258 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:26.258 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:26.258 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:33:26.259 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.259 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:25 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:33:26.259 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:25 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:33:26.259 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.259 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.259 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.259 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.259 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.259 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:25 smithi062 ceph-mon[44211]: pgmap v753: 17 pgs: 17 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:33:26.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:25 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1287279550' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-04-01T19:33:26.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:25 smithi062 ceph-mon[44211]: osdmap e257: 12 total, 12 up, 12 in 2024-04-01T19:33:26.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:25 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:33:26.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:25 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:33:26.261 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:26.261 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:26.261 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:33:26.262 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:33:26.362 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:33:26.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:25 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:33:26.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:25 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:33:26.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:26.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:25 smithi188 ceph-mon[43939]: pgmap v753: 17 pgs: 17 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:33:26.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:25 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1287279550' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-04-01T19:33:26.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:25 smithi188 ceph-mon[43939]: osdmap e257: 12 total, 12 up, 12 in 2024-04-01T19:33:26.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:25 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:33:26.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:25 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:33:26.437 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:26.453 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:33:26.859 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:33:26.863 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:33:26.867 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:26.868 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:33:26.899 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_ops_in_flight 2024-04-01T19:33:26.969 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:33:27.019 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:27.047 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:33:27.050 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:27.051 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:33:27.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:26 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:33:27.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:26 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:33:27.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:26 smithi022 ceph-mon[39439]: osdmap e258: 12 total, 12 up, 12 in 2024-04-01T19:33:27.152 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:33:27.180 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:26 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:33:27.180 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:26 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:33:27.180 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:26 smithi188 ceph-mon[43939]: osdmap e258: 12 total, 12 up, 12 in 2024-04-01T19:33:27.182 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:27.209 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:33:27.214 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:27.217 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:33:27.258 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:33:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:26 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:33:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:26 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:33:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:26 smithi062 ceph-mon[44211]: osdmap e258: 12 total, 12 up, 12 in 2024-04-01T19:33:27.318 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:33:27.349 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:27.372 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:33:27.375 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:27.376 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:33:27.477 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:33:27.507 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:27.537 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:33:27.540 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:27.540 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:33:27.641 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:33:27.685 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:28.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:27 smithi022 ceph-mon[39439]: pgmap v756: 17 pgs: 17 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:33:28.202 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:27 smithi062 ceph-mon[44211]: pgmap v756: 17 pgs: 17 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:33:28.346 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:33:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:27 smithi188 ceph-mon[43939]: pgmap v756: 17 pgs: 17 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:33:28.559 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:33:28.566 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:28.566 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:33:28.667 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:33:28.711 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:29.242 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:33:29.242 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:33:29.243 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 0 2024-04-01T19:33:29.243 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:33:29.777 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:33:29.779 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:29.780 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:33:29.881 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:33:29.910 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:29.934 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:33:29.943 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:29.943 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:33:29.978 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:33:30.018 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_blocked_ops 2024-04-01T19:33:30.043 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:33:30.091 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:30.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:29 smithi022 ceph-mon[39439]: pgmap v757: 17 pgs: 17 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:33:30.117 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:33:30.120 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:30.121 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:33:30.222 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:33:30.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:29 smithi062 ceph-mon[44211]: pgmap v757: 17 pgs: 17 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:33:30.266 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:30.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:29 smithi188 ceph-mon[43939]: pgmap v757: 17 pgs: 17 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:33:30.396 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:33:30.627 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:33:30.636 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:30.637 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:33:30.738 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:33:30.768 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:30.787 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:33:30.792 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:30.793 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:33:30.894 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:33:30.962 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:30.984 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:33:30.988 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.6 to 1 (10000) 2024-04-01T19:33:31.016 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:30 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3959096816' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T19:33:31.016 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:30 smithi062 ceph-mon[44211]: from='client.35408 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T19:33:31.016 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:30 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1736943593' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:33:31.016 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:30 smithi062 ceph-mon[44211]: from='client.35411 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:33:31.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:30 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3959096816' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T19:33:31.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:30 smithi188 ceph-mon[43939]: from='client.35408 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T19:33:31.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:30 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1736943593' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:33:31.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:30 smithi188 ceph-mon[43939]: from='client.35411 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:33:31.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:30 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3959096816' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T19:33:31.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:30 smithi022 ceph-mon[39439]: from='client.35408 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T19:33:31.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:30 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1736943593' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:33:31.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:30 smithi022 ceph-mon[39439]: from='client.35411 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:33:31.964 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:31 smithi022 ceph-mon[39439]: pgmap v758: 17 pgs: 17 active+clean; 1.1 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.42k op/s 2024-04-01T19:33:31.964 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:31 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:33:31.964 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:31 smithi022 ceph-mon[39439]: from='client.35408 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-04-01T19:33:31.964 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:31 smithi022 ceph-mon[39439]: from='client.35411 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:33:31.964 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:31 smithi022 ceph-mon[39439]: osdmap e259: 12 total, 12 up, 12 in 2024-04-01T19:33:32.237 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:31 smithi062 ceph-mon[44211]: pgmap v758: 17 pgs: 17 active+clean; 1.1 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.42k op/s 2024-04-01T19:33:32.237 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:31 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:33:32.237 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:31 smithi062 ceph-mon[44211]: from='client.35408 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-04-01T19:33:32.238 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:31 smithi062 ceph-mon[44211]: from='client.35411 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:33:32.238 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:31 smithi062 ceph-mon[44211]: osdmap e259: 12 total, 12 up, 12 in 2024-04-01T19:33:32.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:31 smithi188 ceph-mon[43939]: pgmap v758: 17 pgs: 17 active+clean; 1.1 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.42k op/s 2024-04-01T19:33:32.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:31 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:33:32.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:31 smithi188 ceph-mon[43939]: from='client.35408 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-04-01T19:33:32.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:31 smithi188 ceph-mon[43939]: from='client.35411 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:33:32.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:31 smithi188 ceph-mon[43939]: osdmap e259: 12 total, 12 up, 12 in 2024-04-01T19:33:32.608 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:33:32.608 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:33:32.608 INFO:teuthology.orchestra.run.smithi062.stdout: "complaint_time": 30, 2024-04-01T19:33:32.608 INFO:teuthology.orchestra.run.smithi062.stdout: "num_blocked_ops": 0 2024-04-01T19:33:32.609 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:33:33.171 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 7 1 2024-04-01T19:33:33.333 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:33:33.339 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:33.340 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:33:33.358 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_historic_ops 2024-04-01T19:33:33.441 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:33:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:33.517 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:33:33.520 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:33.520 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:33:33.621 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:33:33.667 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:33.695 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:33:33.698 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:33.699 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:33:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:33:33.753 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:33:33.763 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:33:33.789 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:33:33.799 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:33:33.823 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:33:33.826 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:33.848 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:33:33.852 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:33.853 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:33:33.853 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:33:33.887 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:33:33.927 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:33:33.954 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:33:33.962 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:33:33.988 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:33.992 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:33:34.023 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:33:34.026 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:34.026 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:33:34.035 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:33:34.062 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:33:34.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:33 smithi188 ceph-mon[43939]: pgmap v760: 17 pgs: 17 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.24k op/s 2024-04-01T19:33:34.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:33 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/16841292' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:33:34.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:34.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:34.127 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:33:34.130 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:33:34.137 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:33:34.157 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:33:34.170 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:33:34.170 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:33:34.170 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:33:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:33:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:33:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:33:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:33:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:33:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:33:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:33:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:33:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:33:34.194 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:34.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:33 smithi062 ceph-mon[44211]: pgmap v760: 17 pgs: 17 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.24k op/s 2024-04-01T19:33:34.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:33 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/16841292' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:33:34.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:34.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:34.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:33 smithi022 ceph-mon[39439]: pgmap v760: 17 pgs: 17 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.24k op/s 2024-04-01T19:33:34.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:33 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/16841292' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:33:34.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:34.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:34.874 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:33:34.881 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:34.881 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:33:34.982 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:33:35.031 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:35.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:35.506 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:33:35.511 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:35.512 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:33:35.613 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:33:35.644 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:35.671 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:33:35.674 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:35.675 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:33:35.776 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:33:35.813 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:35.832 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:33:35.832 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:33:35.993 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:35 smithi188 ceph-mon[43939]: pgmap v761: 17 pgs: 17 active+clean; 965 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:33:35.993 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:35 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:33:35.994 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:35 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:33:35.994 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:35 smithi188 ceph-mon[43939]: osdmap e260: 12 total, 12 up, 12 in 2024-04-01T19:33:36.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:35 smithi022 ceph-mon[39439]: pgmap v761: 17 pgs: 17 active+clean; 965 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:33:36.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:35 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:33:36.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:35 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:33:36.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:35 smithi022 ceph-mon[39439]: osdmap e260: 12 total, 12 up, 12 in 2024-04-01T19:33:36.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:35 smithi062 ceph-mon[44211]: pgmap v761: 17 pgs: 17 active+clean; 965 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:33:36.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:35 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:33:36.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:35 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:33:36.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:35 smithi062 ceph-mon[44211]: osdmap e260: 12 total, 12 up, 12 in 2024-04-01T19:33:36.629 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_ops_in_flight 2024-04-01T19:33:37.012 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:33:37.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:37 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:33:37.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:37 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:33:37.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:37 smithi062 ceph-mon[44211]: osdmap e261: 12 total, 12 up, 12 in 2024-04-01T19:33:37.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:37 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:33:37.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:37 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:33:37.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:37 smithi022 ceph-mon[39439]: osdmap e261: 12 total, 12 up, 12 in 2024-04-01T19:33:37.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:37 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:33:37.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:37 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:33:37.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:37 smithi188 ceph-mon[43939]: osdmap e261: 12 total, 12 up, 12 in 2024-04-01T19:33:38.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:38 smithi062 ceph-mon[44211]: pgmap v764: 17 pgs: 17 active+clean; 772 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T19:33:38.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:38 smithi022 ceph-mon[39439]: pgmap v764: 17 pgs: 17 active+clean; 772 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T19:33:38.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:38 smithi188 ceph-mon[43939]: pgmap v764: 17 pgs: 17 active+clean; 772 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T19:33:38.568 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:33:38.619 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:38.620 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:33:38.620 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:33:38.721 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:33:38.754 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:38.780 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:33:38.783 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:38.783 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:33:38.884 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:33:38.938 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:39.016 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:33:39.016 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:33:39.821 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_blocked_ops 2024-04-01T19:33:40.205 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:33:40.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:40 smithi062 ceph-mon[44211]: pgmap v765: 17 pgs: 17 active+clean; 634 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:33:40.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:40 smithi022 ceph-mon[39439]: pgmap v765: 17 pgs: 17 active+clean; 634 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:33:40.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:40 smithi188 ceph-mon[43939]: pgmap v765: 17 pgs: 17 active+clean; 634 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:33:40.520 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:33:40.911 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:33:40.919 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:40.919 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:33:41.020 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:33:41.083 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:41.169 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:33:41.182 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:41.182 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:33:41.283 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:33:41.326 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:41.377 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:33:41.383 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:41.384 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:33:41.485 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:33:41.515 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:41.554 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:33:41.559 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:41.559 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:33:41.660 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:33:41.732 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:41.783 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:33:41.788 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:41.788 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:33:41.889 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:33:41.934 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:42.019 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:42 smithi022 ceph-mon[39439]: pgmap v766: 17 pgs: 17 active+clean; 413 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.42k op/s 2024-04-01T19:33:42.034 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:33:42.038 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:42.039 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:33:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:33:42.140 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:33:42.171 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:42 smithi062 ceph-mon[44211]: pgmap v766: 17 pgs: 17 active+clean; 413 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.42k op/s 2024-04-01T19:33:42.177 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:42.208 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:33:42.211 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:42.212 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:33:42.213 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:33:42.213 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:33:42.313 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:33:42.343 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:42 smithi188 ceph-mon[43939]: pgmap v766: 17 pgs: 17 active+clean; 413 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.42k op/s 2024-04-01T19:33:42.349 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:42.374 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:33:42.380 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:42.380 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:33:42.481 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:33:42.515 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:42.545 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:33:42.547 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:42.547 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:33:42.648 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:33:42.688 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:42.948 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:33:42.952 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:42.952 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:33:42.982 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_historic_ops 2024-04-01T19:33:43.052 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.7 to 1 (10000) 2024-04-01T19:33:43.054 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:33:43.085 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:43.109 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:33:43.111 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:43.112 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:33:43.173 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:43 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2141517221' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T19:33:43.173 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:43 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:33:43.174 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:43 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:33:43.212 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:33:43.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:43 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2141517221' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T19:33:43.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:43 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:33:43.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:43 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:33:43.270 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:43.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:43 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2141517221' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T19:33:43.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:43 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:33:43.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:43 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:33:43.405 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:33:43.408 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:43.408 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:33:43.408 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:33:43.509 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:33:43.546 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:43.686 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:33:43.688 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:43.689 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:33:43.790 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:33:43.851 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:43.900 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:33:43.905 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:43.906 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:33:44.007 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:33:44.053 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:44.180 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:33:44.185 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:44.186 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:33:44.186 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:44 smithi062 ceph-mon[44211]: pgmap v767: 17 pgs: 17 active+clean; 364 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:33:44.186 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:44 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2141517221' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-04-01T19:33:44.186 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:44 smithi062 ceph-mon[44211]: osdmap e262: 12 total, 12 up, 12 in 2024-04-01T19:33:44.287 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:33:44.348 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:44 smithi022 ceph-mon[39439]: pgmap v767: 17 pgs: 17 active+clean; 364 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:33:44.348 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:44 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2141517221' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-04-01T19:33:44.348 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:44 smithi022 ceph-mon[39439]: osdmap e262: 12 total, 12 up, 12 in 2024-04-01T19:33:44.367 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:44.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:44 smithi188 ceph-mon[43939]: pgmap v767: 17 pgs: 17 active+clean; 364 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:33:44.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:44 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2141517221' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-04-01T19:33:44.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:44 smithi188 ceph-mon[43939]: osdmap e262: 12 total, 12 up, 12 in 2024-04-01T19:33:44.399 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:33:44.407 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:44.407 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:33:44.508 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:33:44.534 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Removed 165588 objects 2024-04-01T19:33:44.534 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Clean up completed and total clean up time :133.926 2024-04-01T19:33:44.535 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:44.554 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:33:44.557 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:44.557 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:33:44.658 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:33:44.687 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:44.725 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:33:44.728 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:44.728 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:33:44.829 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:33:44.857 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:45.048 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:33:45.186 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:33:45.206 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:33:45.225 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:33:45.245 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:33:45.266 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:33:45.287 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:33:45.295 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:45 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1296550534' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:33:45.307 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:33:45.327 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:33:45.347 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:33:45.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:45 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1296550534' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:33:45.367 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:33:45.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:45 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1296550534' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:33:45.387 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:33:45.407 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:33:45.409 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:33:45.409 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:33:45.409 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:33:45.409 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:33:45.409 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:33:45.410 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:33:45.410 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:33:45.410 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:33:45.410 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:33:45.410 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:33:45.410 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:33:45.410 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:33:45.506 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:33:45.509 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:45.510 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:33:45.522 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:33:45.523 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 20, 2024-04-01T19:33:45.523 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 600, 2024-04-01T19:33:45.523 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:33:45.523 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.523 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:186608 2.0 2:0b57091c:::benchmark_data_smithi188_77607_object19204:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-04-01T19:33:45.523 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:52.407461+0000", 2024-04-01T19:33:45.523 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 413.11538825100001, 2024-04-01T19:33:45.523 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.050725640000000002, 2024-04-01T19:33:45.523 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:45.523 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:45.523 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:45.523 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:45.523 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:33:45.524 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:45.524 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 186608 2024-04-01T19:33:45.524 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.524 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:45.524 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.524 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:45.524 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407461+0000", 2024-04-01T19:33:45.524 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.524 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.524 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.524 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:45.524 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407461+0000", 2024-04-01T19:33:45.524 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.524 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.525 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.525 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:45.525 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407463+0000", 2024-04-01T19:33:45.525 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.207e-06 2024-04-01T19:33:45.525 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.525 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.525 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:45.525 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407467+0000", 2024-04-01T19:33:45.525 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.2030000000000002e-06 2024-04-01T19:33:45.525 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.525 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.525 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:45.525 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407474+0000", 2024-04-01T19:33:45.525 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.3159999999999999e-06 2024-04-01T19:33:45.526 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.526 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.526 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:45.526 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407479+0000", 2024-04-01T19:33:45.526 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2220000000000001e-06 2024-04-01T19:33:45.526 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.526 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.526 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:45.526 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.410428+0000", 2024-04-01T19:33:45.526 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0029484860000000002 2024-04-01T19:33:45.526 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.526 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.526 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:45.526 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.410493+0000", 2024-04-01T19:33:45.527 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.4925999999999995e-05 2024-04-01T19:33:45.527 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.527 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.527 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 10", 2024-04-01T19:33:45.527 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.410553+0000", 2024-04-01T19:33:45.527 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.0599e-05 2024-04-01T19:33:45.527 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.527 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.527 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:45.527 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.419683+0000", 2024-04-01T19:33:45.527 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0091298879999999992 2024-04-01T19:33:45.527 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.527 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.527 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:45.528 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.422096+0000", 2024-04-01T19:33:45.528 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0024130449999999999 2024-04-01T19:33:45.528 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.528 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.528 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:45.528 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.422135+0000", 2024-04-01T19:33:45.528 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8466000000000001e-05 2024-04-01T19:33:45.528 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.528 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.528 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:45.528 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458187+0000", 2024-04-01T19:33:45.528 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.036052281999999998 2024-04-01T19:33:45.528 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.529 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:45.529 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.529 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.529 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.529 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:186611 2.0 2:078ce2d5:::benchmark_data_smithi188_77607_object19207:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-04-01T19:33:45.529 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:52.407570+0000", 2024-04-01T19:33:45.529 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 413.11527977600002, 2024-04-01T19:33:45.529 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.050783633000000002, 2024-04-01T19:33:45.529 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:45.529 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:45.529 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:45.529 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:45.529 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:33:45.529 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:45.530 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 186611 2024-04-01T19:33:45.530 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.530 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:45.530 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.530 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:45.530 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407570+0000", 2024-04-01T19:33:45.530 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.530 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.530 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.530 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:45.530 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407570+0000", 2024-04-01T19:33:45.530 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.530 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.530 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.531 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:45.531 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407571+0000", 2024-04-01T19:33:45.531 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.8100000000000001e-07 2024-04-01T19:33:45.531 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.531 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.531 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:45.531 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407574+0000", 2024-04-01T19:33:45.531 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.6270000000000002e-06 2024-04-01T19:33:45.531 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.531 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.531 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:45.531 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407581+0000", 2024-04-01T19:33:45.531 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.319e-06 2024-04-01T19:33:45.531 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.532 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.532 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:45.532 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407585+0000", 2024-04-01T19:33:45.532 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.1069999999999998e-06 2024-04-01T19:33:45.532 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.532 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.532 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:45.532 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.413627+0000", 2024-04-01T19:33:45.532 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0060416410000000004 2024-04-01T19:33:45.532 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.532 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.532 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:45.532 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.413716+0000", 2024-04-01T19:33:45.533 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.9766999999999996e-05 2024-04-01T19:33:45.533 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.533 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.533 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 10", 2024-04-01T19:33:45.533 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.413824+0000", 2024-04-01T19:33:45.533 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000108083 2024-04-01T19:33:45.533 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.533 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.533 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:45.533 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.419696+0000", 2024-04-01T19:33:45.533 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0058718659999999999 2024-04-01T19:33:45.533 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.533 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.534 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:45.534 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458253+0000", 2024-04-01T19:33:45.534 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.038557033999999997 2024-04-01T19:33:45.534 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.534 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.534 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:45.534 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458311+0000", 2024-04-01T19:33:45.534 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7343000000000003e-05 2024-04-01T19:33:45.534 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.534 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.534 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:45.534 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458354+0000", 2024-04-01T19:33:45.534 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.2964999999999999e-05 2024-04-01T19:33:45.534 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.535 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:45.535 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.535 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.535 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.535 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:186612 2.8 2:1889545c:::benchmark_data_smithi188_77607_object19208:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-04-01T19:33:45.535 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:52.407666+0000", 2024-04-01T19:33:45.535 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 413.11518381899998, 2024-04-01T19:33:45.535 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.050818611, 2024-04-01T19:33:45.535 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:45.535 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:45.535 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:45.535 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:45.535 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:33:45.535 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:45.535 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 186612 2024-04-01T19:33:45.536 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.536 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:45.536 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.536 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:45.536 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407666+0000", 2024-04-01T19:33:45.536 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.536 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.536 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.536 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:45.536 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407666+0000", 2024-04-01T19:33:45.536 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.536 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.536 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.536 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:45.537 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407666+0000", 2024-04-01T19:33:45.537 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6100000000000001e-07 2024-04-01T19:33:45.537 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.537 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.537 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:45.537 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407669+0000", 2024-04-01T19:33:45.537 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.4609999999999998e-06 2024-04-01T19:33:45.537 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.537 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.537 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:45.537 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407673+0000", 2024-04-01T19:33:45.537 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.6200000000000001e-06 2024-04-01T19:33:45.537 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.538 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.538 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:45.538 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.407676+0000", 2024-04-01T19:33:45.538 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.1829999999999998e-06 2024-04-01T19:33:45.538 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.538 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.538 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:45.538 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.413621+0000", 2024-04-01T19:33:45.538 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.005945405 2024-04-01T19:33:45.538 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.538 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.538 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:45.538 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.413710+0000", 2024-04-01T19:33:45.539 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.9265000000000007e-05 2024-04-01T19:33:45.539 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.539 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.539 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 9", 2024-04-01T19:33:45.539 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.413824+0000", 2024-04-01T19:33:45.539 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00011393 2024-04-01T19:33:45.539 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.539 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.539 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:45.539 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.419692+0000", 2024-04-01T19:33:45.539 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0058677219999999997 2024-04-01T19:33:45.539 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.539 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.539 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:45.539 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458399+0000", 2024-04-01T19:33:45.540 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.038707273 2024-04-01T19:33:45.540 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.540 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.540 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:45.540 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458448+0000", 2024-04-01T19:33:45.540 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8229000000000002e-05 2024-04-01T19:33:45.540 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.540 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.540 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:45.540 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458485+0000", 2024-04-01T19:33:45.540 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.6962000000000003e-05 2024-04-01T19:33:45.540 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.540 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:45.540 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.540 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.541 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.541 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:186613 2.0 2:04a34076:::benchmark_data_smithi188_77607_object19209:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-04-01T19:33:45.541 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:26:52.410598+0000", 2024-04-01T19:33:45.541 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 413.11225132999999, 2024-04-01T19:33:45.541 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.047997257000000002, 2024-04-01T19:33:45.541 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:45.541 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:45.541 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:45.541 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:45.541 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:33:45.541 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:45.541 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 186613 2024-04-01T19:33:45.541 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.541 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:45.541 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.542 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:45.542 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.410598+0000", 2024-04-01T19:33:45.542 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.542 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.542 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.542 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:45.542 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.410598+0000", 2024-04-01T19:33:45.542 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.542 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.542 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.542 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:45.542 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.410600+0000", 2024-04-01T19:33:45.542 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4160000000000001e-06 2024-04-01T19:33:45.542 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.543 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.543 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:45.543 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.410605+0000", 2024-04-01T19:33:45.543 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2249999999999999e-06 2024-04-01T19:33:45.543 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.543 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.543 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:45.543 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.410614+0000", 2024-04-01T19:33:45.543 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1800000000000002e-06 2024-04-01T19:33:45.543 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.543 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.543 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:45.543 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.410624+0000", 2024-04-01T19:33:45.543 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.7270000000000002e-06 2024-04-01T19:33:45.544 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.544 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.544 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:45.544 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.416723+0000", 2024-04-01T19:33:45.544 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0060989759999999999 2024-04-01T19:33:45.544 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.544 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.544 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:45.544 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.416844+0000", 2024-04-01T19:33:45.544 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000121107 2024-04-01T19:33:45.544 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.544 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.544 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 10", 2024-04-01T19:33:45.544 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.416919+0000", 2024-04-01T19:33:45.545 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.5060000000000003e-05 2024-04-01T19:33:45.545 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.545 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.545 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:45.545 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.419832+0000", 2024-04-01T19:33:45.545 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0029129640000000001 2024-04-01T19:33:45.545 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.545 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.545 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:45.545 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458508+0000", 2024-04-01T19:33:45.545 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.038675543999999999 2024-04-01T19:33:45.545 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.545 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.545 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:45.545 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458557+0000", 2024-04-01T19:33:45.546 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9132999999999999e-05 2024-04-01T19:33:45.546 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.546 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.546 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:45.546 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:26:52.458596+0000", 2024-04-01T19:33:45.546 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8924999999999997e-05 2024-04-01T19:33:45.546 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.546 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:45.546 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.546 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.546 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.546 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:333479 2.8 2:15a5a0dd:::benchmark_data_smithi188_77607_object166075:head [delete] snapc 0=[] ondisk+write+known_if_redirected e184)", 2024-04-01T19:33:45.546 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:29:35.759042+0000", 2024-04-01T19:33:45.546 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 249.763807262, 2024-04-01T19:33:45.547 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.065341420999999997, 2024-04-01T19:33:45.547 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:45.547 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:45.547 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:45.547 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:45.547 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:33:45.547 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:45.547 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 333479 2024-04-01T19:33:45.547 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.547 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:45.547 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.547 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:45.547 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.759042+0000", 2024-04-01T19:33:45.547 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.547 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.548 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.548 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:45.548 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.759042+0000", 2024-04-01T19:33:45.548 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.548 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.548 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.548 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:45.548 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.759044+0000", 2024-04-01T19:33:45.548 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4759999999999999e-06 2024-04-01T19:33:45.548 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.548 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.548 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:45.548 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.759049+0000", 2024-04-01T19:33:45.548 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8239999999999999e-06 2024-04-01T19:33:45.549 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.549 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.549 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:45.549 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.759057+0000", 2024-04-01T19:33:45.549 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.7080000000000003e-06 2024-04-01T19:33:45.549 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.549 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.549 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:45.549 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.759063+0000", 2024-04-01T19:33:45.549 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5589999999999996e-06 2024-04-01T19:33:45.549 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.549 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.549 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:45.549 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.761994+0000", 2024-04-01T19:33:45.550 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0029307999999999999 2024-04-01T19:33:45.550 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.550 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.550 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:45.550 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.762075+0000", 2024-04-01T19:33:45.550 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0734000000000003e-05 2024-04-01T19:33:45.550 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.550 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.550 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 9", 2024-04-01T19:33:45.550 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.762145+0000", 2024-04-01T19:33:45.550 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.0789000000000003e-05 2024-04-01T19:33:45.550 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.550 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.551 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:45.551 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.769377+0000", 2024-04-01T19:33:45.551 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0072314959999999996 2024-04-01T19:33:45.551 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.551 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.551 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:45.551 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.773035+0000", 2024-04-01T19:33:45.551 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0036582239999999999 2024-04-01T19:33:45.551 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.551 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.551 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:45.551 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.824334+0000", 2024-04-01T19:33:45.551 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.051299205 2024-04-01T19:33:45.551 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.551 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.552 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:45.552 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.824384+0000", 2024-04-01T19:33:45.552 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9605999999999999e-05 2024-04-01T19:33:45.552 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.552 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:45.552 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.552 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.552 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.552 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:333483 2.8 2:1e62d551:::benchmark_data_smithi188_77607_object166079:head [delete] snapc 0=[] ondisk+write+known_if_redirected e184)", 2024-04-01T19:33:45.552 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:29:35.765451+0000", 2024-04-01T19:33:45.552 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 249.757399212, 2024-04-01T19:33:45.552 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.069086539000000002, 2024-04-01T19:33:45.552 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:45.552 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:45.553 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:45.553 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:45.553 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:33:45.553 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:45.553 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 333483 2024-04-01T19:33:45.553 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.553 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:45.553 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.553 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:45.553 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.765451+0000", 2024-04-01T19:33:45.553 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.553 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.553 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.553 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:45.553 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.765451+0000", 2024-04-01T19:33:45.553 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.554 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.554 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.554 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:45.554 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.765453+0000", 2024-04-01T19:33:45.554 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.255e-06 2024-04-01T19:33:45.554 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.554 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.554 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:45.554 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.765459+0000", 2024-04-01T19:33:45.554 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8279999999999999e-06 2024-04-01T19:33:45.554 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.554 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.555 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:45.555 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.765470+0000", 2024-04-01T19:33:45.555 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1881e-05 2024-04-01T19:33:45.555 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.555 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.555 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:45.555 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.765479+0000", 2024-04-01T19:33:45.555 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0099999999999995e-06 2024-04-01T19:33:45.555 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.555 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.555 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:45.555 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.765666+0000", 2024-04-01T19:33:45.555 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000187448 2024-04-01T19:33:45.555 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.556 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.556 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:45.556 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.765739+0000", 2024-04-01T19:33:45.556 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.3510000000000006e-05 2024-04-01T19:33:45.556 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.556 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.556 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 9", 2024-04-01T19:33:45.556 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.765837+0000", 2024-04-01T19:33:45.556 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.7372000000000002e-05 2024-04-01T19:33:45.556 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.556 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.556 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:45.556 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.769513+0000", 2024-04-01T19:33:45.556 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0036764290000000002 2024-04-01T19:33:45.556 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.557 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.557 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:45.557 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.834429+0000", 2024-04-01T19:33:45.557 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.064915553000000001 2024-04-01T19:33:45.557 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.557 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.557 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:45.557 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.834484+0000", 2024-04-01T19:33:45.557 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.4907000000000001e-05 2024-04-01T19:33:45.557 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.557 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.557 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:45.557 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.834537+0000", 2024-04-01T19:33:45.557 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3346000000000001e-05 2024-04-01T19:33:45.557 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.558 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:45.558 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.558 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.558 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.558 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:333489 2.8 2:1b7e3e88:::benchmark_data_smithi188_77607_object166085:head [delete] snapc 0=[] ondisk+write+known_if_redirected e184)", 2024-04-01T19:33:45.558 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:29:35.767182+0000", 2024-04-01T19:33:45.558 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 249.75566800199999, 2024-04-01T19:33:45.558 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.067435637000000007, 2024-04-01T19:33:45.558 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:45.558 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:45.558 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:45.558 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:45.558 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:33:45.559 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:45.559 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 333489 2024-04-01T19:33:45.559 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.559 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:45.559 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.559 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:45.559 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.767182+0000", 2024-04-01T19:33:45.559 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.559 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.559 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.559 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:45.559 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.767182+0000", 2024-04-01T19:33:45.559 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.560 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.560 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.560 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:45.560 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.767183+0000", 2024-04-01T19:33:45.560 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4649999999999999e-06 2024-04-01T19:33:45.560 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.560 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.560 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:45.560 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.767188+0000", 2024-04-01T19:33:45.560 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0849999999999996e-06 2024-04-01T19:33:45.560 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.560 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.560 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:45.560 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.767198+0000", 2024-04-01T19:33:45.560 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0003000000000001e-05 2024-04-01T19:33:45.561 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.561 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.561 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:45.561 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.767206+0000", 2024-04-01T19:33:45.561 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.3939999999999998e-06 2024-04-01T19:33:45.561 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.561 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.561 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:45.561 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.769539+0000", 2024-04-01T19:33:45.561 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0023334860000000001 2024-04-01T19:33:45.561 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.561 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.561 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:45.561 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.769616+0000", 2024-04-01T19:33:45.561 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.6759000000000001e-05 2024-04-01T19:33:45.562 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.562 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.562 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 9", 2024-04-01T19:33:45.562 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.769684+0000", 2024-04-01T19:33:45.562 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8044000000000001e-05 2024-04-01T19:33:45.562 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.562 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.562 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:45.562 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.829528+0000", 2024-04-01T19:33:45.562 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.059844321999999998 2024-04-01T19:33:45.562 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.562 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.562 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:45.562 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.834549+0000", 2024-04-01T19:33:45.563 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0050203510000000002 2024-04-01T19:33:45.563 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.563 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.563 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:45.563 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.834591+0000", 2024-04-01T19:33:45.563 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.2441000000000002e-05 2024-04-01T19:33:45.563 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.563 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.563 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:45.563 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.834617+0000", 2024-04-01T19:33:45.563 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.6287000000000001e-05 2024-04-01T19:33:45.563 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.563 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:45.563 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.564 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.564 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.564 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.24751.0:333492 2.8 2:1ea5b6de:::benchmark_data_smithi188_77607_object166088:head [delete] snapc 0=[] ondisk+write+known_if_redirected e184)", 2024-04-01T19:33:45.564 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:29:35.771773+0000", 2024-04-01T19:33:45.564 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 249.751076845, 2024-04-01T19:33:45.564 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.063138702000000005, 2024-04-01T19:33:45.564 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:45.564 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:45.564 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:45.564 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:45.564 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.24751", 2024-04-01T19:33:45.564 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:45.564 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 333492 2024-04-01T19:33:45.564 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.565 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:45.565 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.565 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:45.565 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.771773+0000", 2024-04-01T19:33:45.565 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.565 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.565 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.565 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:45.565 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.771773+0000", 2024-04-01T19:33:45.565 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.565 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.565 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.565 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:45.565 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.771774+0000", 2024-04-01T19:33:45.566 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.407e-06 2024-04-01T19:33:45.566 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.566 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.566 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:45.566 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.771779+0000", 2024-04-01T19:33:45.566 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6530000000000002e-06 2024-04-01T19:33:45.566 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.566 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.566 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:45.566 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.771788+0000", 2024-04-01T19:33:45.566 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.9220000000000003e-06 2024-04-01T19:33:45.566 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.566 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.567 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:45.567 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.771793+0000", 2024-04-01T19:33:45.567 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5280000000000003e-06 2024-04-01T19:33:45.567 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.567 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.567 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:45.567 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.824435+0000", 2024-04-01T19:33:45.567 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.052641424999999999 2024-04-01T19:33:45.567 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.567 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.567 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:45.567 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.824569+0000", 2024-04-01T19:33:45.567 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000133893 2024-04-01T19:33:45.568 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.568 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.568 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 9", 2024-04-01T19:33:45.568 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.824695+0000", 2024-04-01T19:33:45.568 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000125807 2024-04-01T19:33:45.568 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.568 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.568 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:45.568 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.834678+0000", 2024-04-01T19:33:45.568 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0099832159999999996 2024-04-01T19:33:45.568 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.568 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.568 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:45.568 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.834827+0000", 2024-04-01T19:33:45.569 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000149328 2024-04-01T19:33:45.569 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.569 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.569 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:45.569 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.834873+0000", 2024-04-01T19:33:45.569 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.5512000000000001e-05 2024-04-01T19:33:45.569 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.569 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.569 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:45.569 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.834912+0000", 2024-04-01T19:33:45.569 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9011000000000003e-05 2024-04-01T19:33:45.569 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.569 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:45.569 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.569 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.570 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.570 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop_reply(client.24751.0:333489 2.8 e184/106 ondisk, result = 0)", 2024-04-01T19:33:45.570 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:29:35.772752+0000", 2024-04-01T19:33:45.570 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 249.75009821699999, 2024-04-01T19:33:45.570 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.056784284999999997, 2024-04-01T19:33:45.570 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:45.570 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:45.570 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "started", 2024-04-01T19:33:45.570 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:45.570 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.570 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:45.570 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.772752+0000", 2024-04-01T19:33:45.570 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.571 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.571 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.571 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:45.571 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.772752+0000", 2024-04-01T19:33:45.571 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.571 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.571 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.571 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:45.571 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.772753+0000", 2024-04-01T19:33:45.571 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.401e-06 2024-04-01T19:33:45.571 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.571 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.571 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:45.571 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.772758+0000", 2024-04-01T19:33:45.572 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7180000000000004e-06 2024-04-01T19:33:45.572 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.572 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.572 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:45.572 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.772776+0000", 2024-04-01T19:33:45.572 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8689e-05 2024-04-01T19:33:45.572 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.572 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.572 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:45.572 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.772783+0000", 2024-04-01T19:33:45.572 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8190000000000003e-06 2024-04-01T19:33:45.572 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.572 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.572 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:45.573 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.829514+0000", 2024-04-01T19:33:45.573 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.056730968 2024-04-01T19:33:45.573 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.573 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.573 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:45.573 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.829522+0000", 2024-04-01T19:33:45.573 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9370000000000004e-06 2024-04-01T19:33:45.573 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.573 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.573 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:45.573 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.829536+0000", 2024-04-01T19:33:45.573 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3753e-05 2024-04-01T19:33:45.573 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.573 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:45.573 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.574 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.574 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.574 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.24751.0:333496 2.b e184/175 2:d9ab93ea:::benchmark_data_smithi188_77607_object166092:head v 184'24155, mlcod=184'24153)", 2024-04-01T19:33:45.574 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:29:35.777100+0000", 2024-04-01T19:33:45.574 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 249.74574961600001, 2024-04-01T19:33:45.574 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.053095607000000003, 2024-04-01T19:33:45.574 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:45.574 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:45.574 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:45.574 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:45.574 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.574 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:45.574 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.777100+0000", 2024-04-01T19:33:45.575 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.575 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.575 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.575 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:45.575 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.777100+0000", 2024-04-01T19:33:45.575 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.575 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.575 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.575 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:45.575 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.777102+0000", 2024-04-01T19:33:45.575 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.5230000000000001e-06 2024-04-01T19:33:45.575 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.575 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.576 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:45.576 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.777109+0000", 2024-04-01T19:33:45.576 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.8310000000000001e-06 2024-04-01T19:33:45.576 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.576 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.576 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:45.576 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.822976+0000", 2024-04-01T19:33:45.576 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.045866723999999998 2024-04-01T19:33:45.576 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.576 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.576 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:45.576 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.822983+0000", 2024-04-01T19:33:45.576 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1149999999999996e-06 2024-04-01T19:33:45.576 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.577 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.577 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:45.577 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.823102+0000", 2024-04-01T19:33:45.577 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000118773 2024-04-01T19:33:45.577 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.577 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.577 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:45.577 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.823121+0000", 2024-04-01T19:33:45.577 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.9102000000000001e-05 2024-04-01T19:33:45.577 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.577 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.577 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:45.577 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.830147+0000", 2024-04-01T19:33:45.577 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0070254030000000004 2024-04-01T19:33:45.578 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.578 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.578 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:45.578 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.830196+0000", 2024-04-01T19:33:45.578 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9135999999999998e-05 2024-04-01T19:33:45.578 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.578 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:45.578 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.578 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.578 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.578 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.24751.0:333500 2.9 e184/106 2:9ad80d57:::benchmark_data_smithi188_77607_object166096:head v 184'20883, mlcod=184'20881)", 2024-04-01T19:33:45.578 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:29:35.783928+0000", 2024-04-01T19:33:45.578 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 249.73892146399999, 2024-04-01T19:33:45.579 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.048618281999999999, 2024-04-01T19:33:45.579 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:45.579 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:45.579 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:45.579 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:45.579 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.579 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:45.579 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.783928+0000", 2024-04-01T19:33:45.579 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.579 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.579 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.579 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:45.579 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.783928+0000", 2024-04-01T19:33:45.579 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.580 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.580 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.580 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:45.580 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.783930+0000", 2024-04-01T19:33:45.580 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.7039999999999999e-06 2024-04-01T19:33:45.580 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.580 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.580 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:45.580 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.783940+0000", 2024-04-01T19:33:45.580 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.6250000000000002e-06 2024-04-01T19:33:45.580 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.580 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.580 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:45.580 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.822728+0000", 2024-04-01T19:33:45.581 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.038788530000000002 2024-04-01T19:33:45.581 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.581 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.581 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:45.581 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.822743+0000", 2024-04-01T19:33:45.581 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.5165e-05 2024-04-01T19:33:45.581 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.581 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.581 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:45.581 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.823089+0000", 2024-04-01T19:33:45.581 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00034611400000000001 2024-04-01T19:33:45.581 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.581 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.581 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:45.582 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.823113+0000", 2024-04-01T19:33:45.582 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3855000000000001e-05 2024-04-01T19:33:45.582 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.582 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.582 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:45.582 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.832487+0000", 2024-04-01T19:33:45.582 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0093733389999999996 2024-04-01T19:33:45.582 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.582 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.582 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:45.582 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:29:35.832547+0000", 2024-04-01T19:33:45.582 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.995e-05 2024-04-01T19:33:45.582 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.583 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:45.583 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.583 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.583 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.583 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:111576 3.9 3:90e22c59:::benchmark_data_smithi188_92122_object111575:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e211)", 2024-04-01T19:33:45.583 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:30:48.610162+0000", 2024-04-01T19:33:45.583 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 176.912688011, 2024-04-01T19:33:45.583 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.058928480999999998, 2024-04-01T19:33:45.583 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:45.583 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:45.583 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:45.583 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:45.583 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:45.584 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:45.584 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 111576 2024-04-01T19:33:45.584 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.584 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:45.584 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.584 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:45.584 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.610162+0000", 2024-04-01T19:33:45.584 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.584 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.584 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.584 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:45.584 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.610162+0000", 2024-04-01T19:33:45.584 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.584 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.584 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.585 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:45.585 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.610163+0000", 2024-04-01T19:33:45.585 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.6000000000000002e-07 2024-04-01T19:33:45.585 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.585 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.585 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:45.585 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.610281+0000", 2024-04-01T19:33:45.585 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000118713 2024-04-01T19:33:45.585 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.585 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.585 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:45.585 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.610289+0000", 2024-04-01T19:33:45.585 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.7840000000000004e-06 2024-04-01T19:33:45.585 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.586 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.586 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:45.586 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.610296+0000", 2024-04-01T19:33:45.586 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.4999999999999996e-06 2024-04-01T19:33:45.586 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.586 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.586 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:45.586 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.614386+0000", 2024-04-01T19:33:45.586 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0040905630000000002 2024-04-01T19:33:45.586 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.586 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.586 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:45.586 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.614511+0000", 2024-04-01T19:33:45.586 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012448599999999999 2024-04-01T19:33:45.587 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.587 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.587 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8,11", 2024-04-01T19:33:45.587 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.614616+0000", 2024-04-01T19:33:45.587 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00010497600000000001 2024-04-01T19:33:45.587 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.587 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.587 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:45.587 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.618897+0000", 2024-04-01T19:33:45.587 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0042812479999999997 2024-04-01T19:33:45.587 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.587 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.588 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:45.588 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.618924+0000", 2024-04-01T19:33:45.588 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.7124e-05 2024-04-01T19:33:45.588 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.588 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.588 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:45.588 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.668854+0000", 2024-04-01T19:33:45.588 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.049930337999999998 2024-04-01T19:33:45.588 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.588 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.588 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:45.588 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.668895+0000", 2024-04-01T19:33:45.588 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0813999999999999e-05 2024-04-01T19:33:45.588 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.589 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.589 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:45.589 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.669090+0000", 2024-04-01T19:33:45.589 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00019507500000000001 2024-04-01T19:33:45.589 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.589 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:45.589 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.589 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.589 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.589 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:111589 3.9 3:9269ca68:::benchmark_data_smithi188_92122_object111588:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e211)", 2024-04-01T19:33:45.589 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:30:48.619133+0000", 2024-04-01T19:33:45.589 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 176.90371656299999, 2024-04-01T19:33:45.589 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.050211113000000002, 2024-04-01T19:33:45.589 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:45.590 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:45.590 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:45.590 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:45.590 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:45.590 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:45.590 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 111589 2024-04-01T19:33:45.590 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.590 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:45.590 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.590 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:45.590 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.619133+0000", 2024-04-01T19:33:45.590 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.590 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.590 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.590 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:45.591 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.619133+0000", 2024-04-01T19:33:45.591 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.591 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.591 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.591 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:45.591 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.619135+0000", 2024-04-01T19:33:45.591 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1629999999999999e-06 2024-04-01T19:33:45.591 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.591 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.591 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:45.591 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.619189+0000", 2024-04-01T19:33:45.591 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3499999999999999e-05 2024-04-01T19:33:45.591 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.592 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.592 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:45.592 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.619201+0000", 2024-04-01T19:33:45.592 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2568999999999999e-05 2024-04-01T19:33:45.592 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.592 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.592 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:45.592 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.619209+0000", 2024-04-01T19:33:45.592 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0709999999999995e-06 2024-04-01T19:33:45.592 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.592 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.592 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:45.592 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.619246+0000", 2024-04-01T19:33:45.592 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.6758000000000003e-05 2024-04-01T19:33:45.593 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.593 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.593 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:45.593 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.619338+0000", 2024-04-01T19:33:45.593 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1648000000000001e-05 2024-04-01T19:33:45.593 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.593 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.593 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8,11", 2024-04-01T19:33:45.593 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.619443+0000", 2024-04-01T19:33:45.593 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000104986 2024-04-01T19:33:45.593 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.593 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.593 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:45.593 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.622686+0000", 2024-04-01T19:33:45.594 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0032434540000000002 2024-04-01T19:33:45.594 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.594 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.594 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:45.594 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.623900+0000", 2024-04-01T19:33:45.594 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.001213607 2024-04-01T19:33:45.594 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.594 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.594 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:45.594 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.669130+0000", 2024-04-01T19:33:45.594 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.045230489999999998 2024-04-01T19:33:45.594 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.594 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.594 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:45.595 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.669166+0000", 2024-04-01T19:33:45.595 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.5599000000000003e-05 2024-04-01T19:33:45.595 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.595 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.595 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:45.595 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.669344+0000", 2024-04-01T19:33:45.595 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00017826800000000001 2024-04-01T19:33:45.595 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.595 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:45.595 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.595 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.595 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.595 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:111598 3.f 3:f732535b:::benchmark_data_smithi188_92122_object111597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e211)", 2024-04-01T19:33:45.595 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:30:48.623615+0000", 2024-04-01T19:33:45.596 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 176.899234331, 2024-04-01T19:33:45.596 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.053557410999999999, 2024-04-01T19:33:45.596 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:45.596 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:45.596 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:45.596 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:45.596 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:45.596 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:45.596 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 111598 2024-04-01T19:33:45.596 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.596 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:45.596 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.596 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:45.596 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.623615+0000", 2024-04-01T19:33:45.597 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.597 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.597 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.597 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:45.597 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.623615+0000", 2024-04-01T19:33:45.597 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.597 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.597 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.597 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:45.597 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.623618+0000", 2024-04-01T19:33:45.597 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.5749999999999999e-06 2024-04-01T19:33:45.597 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.597 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.597 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:45.598 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.623658+0000", 2024-04-01T19:33:45.598 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9703000000000003e-05 2024-04-01T19:33:45.598 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.598 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.598 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:45.598 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.623670+0000", 2024-04-01T19:33:45.598 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2408999999999999e-05 2024-04-01T19:33:45.598 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.598 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.598 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:45.599 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.623680+0000", 2024-04-01T19:33:45.599 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.4089999999999992e-06 2024-04-01T19:33:45.599 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.599 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.599 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:45.599 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.623736+0000", 2024-04-01T19:33:45.599 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6824999999999999e-05 2024-04-01T19:33:45.599 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.599 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.599 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:45.599 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.623870+0000", 2024-04-01T19:33:45.599 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000133604 2024-04-01T19:33:45.599 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.600 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.600 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T19:33:45.600 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.623959+0000", 2024-04-01T19:33:45.600 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.8737000000000001e-05 2024-04-01T19:33:45.600 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.600 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.600 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:45.600 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.626693+0000", 2024-04-01T19:33:45.600 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0027341610000000001 2024-04-01T19:33:45.600 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.600 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.600 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:45.600 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.677059+0000", 2024-04-01T19:33:45.600 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.050366485000000003 2024-04-01T19:33:45.601 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.601 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.601 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:45.601 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.677125+0000", 2024-04-01T19:33:45.601 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6057999999999997e-05 2024-04-01T19:33:45.601 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.601 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.601 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:45.601 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.677173+0000", 2024-04-01T19:33:45.601 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7444999999999997e-05 2024-04-01T19:33:45.601 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.601 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:45.601 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.601 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.601 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.602 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:112041 3.9 3:98a28997:::benchmark_data_smithi188_92122_object112040:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e211)", 2024-04-01T19:33:45.602 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:30:48.940118+0000", 2024-04-01T19:33:45.602 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 176.582731344, 2024-04-01T19:33:45.602 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.050635123999999997, 2024-04-01T19:33:45.602 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:45.602 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:45.602 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:45.602 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:45.602 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:45.602 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:45.602 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 112041 2024-04-01T19:33:45.602 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.602 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:45.602 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.603 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:45.603 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.940118+0000", 2024-04-01T19:33:45.603 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.603 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.603 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.603 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:45.603 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.940118+0000", 2024-04-01T19:33:45.603 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.603 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.603 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.603 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:45.603 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.940120+0000", 2024-04-01T19:33:45.603 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.841e-06 2024-04-01T19:33:45.603 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.604 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.604 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:45.604 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.940206+0000", 2024-04-01T19:33:45.604 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.5953999999999997e-05 2024-04-01T19:33:45.604 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.604 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.604 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:45.604 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.940221+0000", 2024-04-01T19:33:45.604 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4579000000000001e-05 2024-04-01T19:33:45.604 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.604 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.604 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:45.604 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.940230+0000", 2024-04-01T19:33:45.604 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.9400000000000008e-06 2024-04-01T19:33:45.604 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.605 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.605 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:45.605 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.940289+0000", 2024-04-01T19:33:45.605 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.9043999999999999e-05 2024-04-01T19:33:45.605 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.605 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.605 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:45.605 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.940444+0000", 2024-04-01T19:33:45.605 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00015518800000000001 2024-04-01T19:33:45.605 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.605 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.605 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8,11", 2024-04-01T19:33:45.605 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.940620+0000", 2024-04-01T19:33:45.605 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00017629899999999999 2024-04-01T19:33:45.606 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.606 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.606 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:45.606 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.946349+0000", 2024-04-01T19:33:45.606 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0057284939999999998 2024-04-01T19:33:45.606 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.606 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.606 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:45.606 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.946369+0000", 2024-04-01T19:33:45.606 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.9870000000000001e-05 2024-04-01T19:33:45.606 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.606 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.606 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:45.606 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.990496+0000", 2024-04-01T19:33:45.607 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.044127878000000002 2024-04-01T19:33:45.607 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.607 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.607 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:45.607 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.990540+0000", 2024-04-01T19:33:45.607 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3228e-05 2024-04-01T19:33:45.607 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.607 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.607 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:45.607 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.990754+0000", 2024-04-01T19:33:45.607 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000213809 2024-04-01T19:33:45.607 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.607 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:45.608 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.608 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.608 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.608 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:112043 3.f 3:f3fea994:::benchmark_data_smithi188_92122_object112042:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e211)", 2024-04-01T19:33:45.608 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:30:48.942376+0000", 2024-04-01T19:33:45.608 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 176.580473337, 2024-04-01T19:33:45.608 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.048110685, 2024-04-01T19:33:45.608 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:45.608 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:45.608 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:45.608 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:45.608 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:45.608 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:45.609 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 112043 2024-04-01T19:33:45.609 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.609 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:45.609 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.609 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:45.609 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.942376+0000", 2024-04-01T19:33:45.609 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.609 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.609 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.609 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:45.609 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.942376+0000", 2024-04-01T19:33:45.609 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.609 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.610 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.610 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:45.610 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.942378+0000", 2024-04-01T19:33:45.610 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.9309999999999998e-06 2024-04-01T19:33:45.610 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.610 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.610 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:45.610 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.942427+0000", 2024-04-01T19:33:45.610 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9081e-05 2024-04-01T19:33:45.610 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.613 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.613 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:45.614 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.942439+0000", 2024-04-01T19:33:45.614 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1826e-05 2024-04-01T19:33:45.614 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.614 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.614 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:45.614 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.942447+0000", 2024-04-01T19:33:45.614 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.5170000000000002e-06 2024-04-01T19:33:45.614 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.614 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.614 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:45.614 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.942495+0000", 2024-04-01T19:33:45.614 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7941000000000001e-05 2024-04-01T19:33:45.614 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.615 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.615 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:45.615 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.942631+0000", 2024-04-01T19:33:45.615 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000136317 2024-04-01T19:33:45.615 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.615 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.615 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T19:33:45.615 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.942789+0000", 2024-04-01T19:33:45.615 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000158374 2024-04-01T19:33:45.615 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.615 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.615 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:45.615 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.946059+0000", 2024-04-01T19:33:45.615 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0032700709999999998 2024-04-01T19:33:45.616 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.616 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.616 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:45.616 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.990372+0000", 2024-04-01T19:33:45.616 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.044312374000000002 2024-04-01T19:33:45.616 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.616 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.616 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:45.616 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.990435+0000", 2024-04-01T19:33:45.616 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3397000000000003e-05 2024-04-01T19:33:45.616 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.616 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.616 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:45.617 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.990487+0000", 2024-04-01T19:33:45.617 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1856e-05 2024-04-01T19:33:45.617 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.617 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:45.617 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.617 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.617 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.617 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:112051 3.f 3:f41e5a84:::benchmark_data_smithi188_92122_object112050:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e211)", 2024-04-01T19:33:45.617 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:30:48.948909+0000", 2024-04-01T19:33:45.617 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 176.57394101200001, 2024-04-01T19:33:45.617 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.048102574000000002, 2024-04-01T19:33:45.617 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:45.617 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:45.617 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:45.618 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:45.618 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:45.618 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:45.618 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 112051 2024-04-01T19:33:45.618 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.618 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:45.618 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.618 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:45.618 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.948909+0000", 2024-04-01T19:33:45.618 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.618 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.618 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.618 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:45.619 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.948909+0000", 2024-04-01T19:33:45.619 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.619 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.619 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.619 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:45.619 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.948911+0000", 2024-04-01T19:33:45.619 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3910000000000001e-06 2024-04-01T19:33:45.619 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.619 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.619 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:45.619 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.948954+0000", 2024-04-01T19:33:45.619 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3201000000000002e-05 2024-04-01T19:33:45.619 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.619 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.620 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:45.620 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.948965+0000", 2024-04-01T19:33:45.620 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0412e-05 2024-04-01T19:33:45.620 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.620 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.620 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:45.620 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.948973+0000", 2024-04-01T19:33:45.620 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.456e-06 2024-04-01T19:33:45.620 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.620 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.620 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:45.620 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.949024+0000", 2024-04-01T19:33:45.620 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1279000000000002e-05 2024-04-01T19:33:45.620 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.620 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.621 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:45.621 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.949152+0000", 2024-04-01T19:33:45.621 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012785199999999999 2024-04-01T19:33:45.621 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.621 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.621 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T19:33:45.621 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.949295+0000", 2024-04-01T19:33:45.621 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014224800000000001 2024-04-01T19:33:45.621 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.621 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.621 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:45.621 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.952480+0000", 2024-04-01T19:33:45.621 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0031854510000000002 2024-04-01T19:33:45.621 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.622 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.622 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:45.622 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.996903+0000", 2024-04-01T19:33:45.622 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.044423074999999999 2024-04-01T19:33:45.622 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.622 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.622 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:45.622 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.996967+0000", 2024-04-01T19:33:45.622 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3827999999999999e-05 2024-04-01T19:33:45.622 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.622 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.622 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:45.622 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.997011+0000", 2024-04-01T19:33:45.622 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.4381000000000001e-05 2024-04-01T19:33:45.623 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.623 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:45.623 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.623 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.623 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.623 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:176971 3.f 3:f912767f:::benchmark_data_smithi188_92122_object11380:head [delete] snapc 0=[] ondisk+write+known_if_redirected e228)", 2024-04-01T19:33:45.623 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:31:39.705365+0000", 2024-04-01T19:33:45.623 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 125.817485105, 2024-04-01T19:33:45.623 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.044689417000000002, 2024-04-01T19:33:45.623 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:45.623 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:45.623 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:45.623 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:45.623 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:45.624 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:45.624 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 176971 2024-04-01T19:33:45.624 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.624 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:45.624 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.624 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:45.624 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.705365+0000", 2024-04-01T19:33:45.624 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.624 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.624 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.624 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:45.624 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.705365+0000", 2024-04-01T19:33:45.624 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.624 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.625 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.625 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:45.625 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.705366+0000", 2024-04-01T19:33:45.625 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.722e-06 2024-04-01T19:33:45.625 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.625 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.625 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:45.625 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.705371+0000", 2024-04-01T19:33:45.625 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8130000000000003e-06 2024-04-01T19:33:45.625 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.625 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.625 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:45.625 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.705381+0000", 2024-04-01T19:33:45.625 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.8889999999999997e-06 2024-04-01T19:33:45.626 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.626 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.626 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:45.626 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.705388+0000", 2024-04-01T19:33:45.626 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1359999999999999e-06 2024-04-01T19:33:45.626 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.626 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.626 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:45.626 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.706880+0000", 2024-04-01T19:33:45.626 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.001491528 2024-04-01T19:33:45.626 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.626 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.626 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:45.626 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.707014+0000", 2024-04-01T19:33:45.627 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013426399999999999 2024-04-01T19:33:45.627 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.627 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.627 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T19:33:45.627 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.707141+0000", 2024-04-01T19:33:45.627 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000127119 2024-04-01T19:33:45.627 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.627 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.627 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:45.627 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.710970+0000", 2024-04-01T19:33:45.627 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0038289790000000001 2024-04-01T19:33:45.627 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.627 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.627 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:45.628 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.749956+0000", 2024-04-01T19:33:45.628 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.038986189999999997 2024-04-01T19:33:45.628 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.628 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.628 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:45.628 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.749996+0000", 2024-04-01T19:33:45.628 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9694000000000003e-05 2024-04-01T19:33:45.628 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.628 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.628 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:45.628 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.750054+0000", 2024-04-01T19:33:45.628 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8082999999999999e-05 2024-04-01T19:33:45.628 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.628 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:45.629 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.629 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.629 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.629 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:261219 3.d 3:b2923ebb:::benchmark_data_smithi188_92122_object95628:head [delete] snapc 0=[] ondisk+write+known_if_redirected e244)", 2024-04-01T19:33:45.629 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:32:46.731927+0000", 2024-04-01T19:33:45.629 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 58.790922315000003, 2024-04-01T19:33:45.629 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.045473831999999999, 2024-04-01T19:33:45.629 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:45.629 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:45.629 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:45.629 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:45.629 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:45.629 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:45.629 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 261219 2024-04-01T19:33:45.629 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.630 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:45.630 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.630 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:45.630 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.731927+0000", 2024-04-01T19:33:45.630 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.630 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.630 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.630 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:45.630 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.731927+0000", 2024-04-01T19:33:45.630 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.630 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.630 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.630 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:45.631 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.731929+0000", 2024-04-01T19:33:45.631 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.378e-06 2024-04-01T19:33:45.631 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.631 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.631 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:45.631 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.731934+0000", 2024-04-01T19:33:45.631 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9649999999999999e-06 2024-04-01T19:33:45.631 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.631 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.631 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:45.633 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.731947+0000", 2024-04-01T19:33:45.633 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2825e-05 2024-04-01T19:33:45.633 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.633 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.633 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:45.633 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.731954+0000", 2024-04-01T19:33:45.633 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1489999999999997e-06 2024-04-01T19:33:45.633 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.633 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.633 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:45.633 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.745696+0000", 2024-04-01T19:33:45.633 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.01374218 2024-04-01T19:33:45.634 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.634 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.634 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:45.634 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.745831+0000", 2024-04-01T19:33:45.634 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013500400000000001 2024-04-01T19:33:45.634 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.634 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.634 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 5", 2024-04-01T19:33:45.634 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.745956+0000", 2024-04-01T19:33:45.634 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000124898 2024-04-01T19:33:45.634 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.634 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.634 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.758885+0000", 2024-04-01T19:33:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.012928966 2024-04-01T19:33:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.777288+0000", 2024-04-01T19:33:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.018403116000000001 2024-04-01T19:33:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.777350+0000", 2024-04-01T19:33:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2419e-05 2024-04-01T19:33:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.777401+0000", 2024-04-01T19:33:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0932e-05 2024-04-01T19:33:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:261220 3.d 3:b6bbee84:::benchmark_data_smithi188_92122_object95629:head [delete] snapc 0=[] ondisk+write+known_if_redirected e244)", 2024-04-01T19:33:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:32:46.731997+0000", 2024-04-01T19:33:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 58.790853153, 2024-04-01T19:33:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.054216997000000003, 2024-04-01T19:33:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:33:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:33:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:33:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:33:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:33:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 261220 2024-04-01T19:33:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:33:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:33:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.731997+0000", 2024-04-01T19:33:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:33:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.731997+0000", 2024-04-01T19:33:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:33:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:33:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.731998+0000", 2024-04-01T19:33:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0240000000000001e-06 2024-04-01T19:33:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:33:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.732001+0000", 2024-04-01T19:33:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.7960000000000002e-06 2024-04-01T19:33:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:33:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.732010+0000", 2024-04-01T19:33:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.4370000000000007e-06 2024-04-01T19:33:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:33:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.732016+0000", 2024-04-01T19:33:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7169999999999996e-06 2024-04-01T19:33:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:33:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.749671+0000", 2024-04-01T19:33:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.017655502999999999 2024-04-01T19:33:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:33:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.749796+0000", 2024-04-01T19:33:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012520899999999999 2024-04-01T19:33:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 5", 2024-04-01T19:33:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.749915+0000", 2024-04-01T19:33:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000118233 2024-04-01T19:33:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:33:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.762635+0000", 2024-04-01T19:33:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.012720247 2024-04-01T19:33:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.786099+0000", 2024-04-01T19:33:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.023464631999999999 2024-04-01T19:33:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:33:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.786162+0000", 2024-04-01T19:33:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3002000000000004e-05 2024-04-01T19:33:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:33:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:33:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:33:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.786214+0000", 2024-04-01T19:33:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1196999999999998e-05 2024-04-01T19:33:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:45.642 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.642 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:33:45.642 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:33:45.642 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:33:45.642 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:33:45.671 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:45.871 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:33:45.873 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:45.874 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:33:45.875 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 9 1 2024-04-01T19:33:45.975 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:33:46.006 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:46.028 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:33:46.031 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:46.032 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:33:46.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:46 smithi022 ceph-mon[39439]: pgmap v769: 17 pgs: 17 active+clean; 196 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:33:46.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:46 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:33:46.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:46 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1296550534' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:33:46.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:46 smithi022 ceph-mon[39439]: osdmap e263: 12 total, 12 up, 12 in 2024-04-01T19:33:46.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:46 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2247422352' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:33:46.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.133 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:33:46.161 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:46 smithi062 ceph-mon[44211]: pgmap v769: 17 pgs: 17 active+clean; 196 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:33:46.162 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:46 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:33:46.162 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:46 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1296550534' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:33:46.162 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:46 smithi062 ceph-mon[44211]: osdmap e263: 12 total, 12 up, 12 in 2024-04-01T19:33:46.162 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:46 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2247422352' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:33:46.162 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.162 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.162 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.162 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.162 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.162 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.162 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.162 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.162 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.165 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:46.219 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:33:46.224 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:46.224 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:33:46.243 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_ops_in_flight 2024-04-01T19:33:46.271 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:46 smithi188 ceph-mon[43939]: pgmap v769: 17 pgs: 17 active+clean; 196 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:33:46.272 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:46 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:33:46.272 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:46 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1296550534' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:33:46.272 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:46 smithi188 ceph-mon[43939]: osdmap e263: 12 total, 12 up, 12 in 2024-04-01T19:33:46.272 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:46 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2247422352' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:33:46.272 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.272 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.272 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.272 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.272 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.272 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.272 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.272 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.273 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:46.291 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_1 2024-04-01T19:33:46.291 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pool rm unique_pool_1 unique_pool_1 --yes-i-really-really-mean-it 2024-04-01T19:33:46.325 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:33:46.361 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:46.508 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:33:46.560 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:33:46.563 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:46.563 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:33:46.665 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:33:46.694 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:46.714 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:33:46.717 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:46.717 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:33:46.818 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:33:46.845 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:46.865 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:33:46.868 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:46.868 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:33:46.970 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:33:47.000 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:47.030 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:33:47.035 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:47.035 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:33:47.037 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:33:47.069 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:33:47.136 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:33:47.168 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:47.187 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:33:47.191 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:47.192 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:33:47.293 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:33:47.296 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:47.296 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:47.296 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:47.296 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:33:47.296 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:47 smithi022 ceph-mon[39439]: 3.4 scrub starts 2024-04-01T19:33:47.296 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:47 smithi022 ceph-mon[39439]: 3.4 scrub ok 2024-04-01T19:33:47.324 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:47.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:47.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:47.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:47.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:33:47.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:47 smithi188 ceph-mon[43939]: 3.4 scrub starts 2024-04-01T19:33:47.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:47 smithi188 ceph-mon[43939]: 3.4 scrub ok 2024-04-01T19:33:47.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:47.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:47.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:47.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:33:47.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:47 smithi062 ceph-mon[44211]: 3.4 scrub starts 2024-04-01T19:33:47.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:47 smithi062 ceph-mon[44211]: 3.4 scrub ok 2024-04-01T19:33:47.573 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:33:47.576 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:47.576 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:33:47.677 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:33:47.707 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:47.728 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:33:47.730 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:47.731 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:33:47.832 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:33:47.860 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:47.880 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:33:47.882 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:47.883 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:33:47.984 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:33:48.013 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:48.086 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:33:48.088 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:48.089 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:33:48.190 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:33:48.219 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:48.231 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:48 smithi188 ceph-mon[43939]: pgmap v771: 17 pgs: 17 active+clean; 49 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:33:48.239 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:33:48.242 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:48.243 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:33:48.305 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:48 smithi022 ceph-mon[39439]: pgmap v771: 17 pgs: 17 active+clean; 49 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:33:48.343 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:33:48.369 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:48 smithi062 ceph-mon[44211]: pgmap v771: 17 pgs: 17 active+clean; 49 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:33:48.371 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:48.391 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:33:48.394 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:48.394 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:33:48.495 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:33:48.529 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:48.592 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:33:48.774 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:33:48.774 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:33:48.774 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-01T19:33:48.774 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:33:48.953 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:33:49.010 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:33:49.844 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_blocked_ops 2024-04-01T19:33:49.979 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:33:49.982 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:49.982 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:33:50.063 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.9 to 1 (10000) 2024-04-01T19:33:50.083 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:33:50.109 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:50 smithi188 ceph-mon[43939]: pgmap v772: 17 pgs: 17 active+clean; 2.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 820 op/s 2024-04-01T19:33:50.110 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:50 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3485828349' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T19:33:50.110 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:50 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:33:50.110 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:50 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:33:50.111 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:50.140 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:33:50.145 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:50.146 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:33:50.173 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:33:50.247 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:33:50.273 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:50.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:50 smithi022 ceph-mon[39439]: pgmap v772: 17 pgs: 17 active+clean; 2.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 820 op/s 2024-04-01T19:33:50.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:50 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3485828349' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T19:33:50.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:50 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:33:50.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:50 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:33:50.395 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:33:50.401 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:50.401 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:33:50.502 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:33:50.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:50 smithi062 ceph-mon[44211]: pgmap v772: 17 pgs: 17 active+clean; 2.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 820 op/s 2024-04-01T19:33:50.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:50 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3485828349' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T19:33:50.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:50 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:33:50.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:50 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:33:50.536 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:50.557 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:33:50.561 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:50.561 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:33:50.662 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:33:50.693 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:51.244 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:33:51.247 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:51.248 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:33:51.259 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 10 1 2024-04-01T19:33:51.325 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:51 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3485828349' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]': finished 2024-04-01T19:33:51.326 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:51 smithi022 ceph-mon[39439]: osdmap e264: 12 total, 12 up, 12 in 2024-04-01T19:33:51.326 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:51 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:33:51.326 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:51 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:33:51.326 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:51 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:33:51.348 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:33:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:51 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3485828349' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]': finished 2024-04-01T19:33:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:51 smithi188 ceph-mon[43939]: osdmap e264: 12 total, 12 up, 12 in 2024-04-01T19:33:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:51 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:33:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:51 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:33:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:51 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:33:51.377 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:51 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3485828349' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]': finished 2024-04-01T19:33:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:51 smithi062 ceph-mon[44211]: osdmap e264: 12 total, 12 up, 12 in 2024-04-01T19:33:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:51 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:33:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:51 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:33:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:51 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:33:51.725 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:33:51.728 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:51.728 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:33:51.786 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:33:51.945 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:33:51.975 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:51.995 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:33:51.997 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:51.998 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:33:52.074 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'unique_pool_1' removed 2024-04-01T19:33:52.099 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:33:52.132 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:52.172 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:52 smithi022 ceph-mon[39439]: pgmap v774: 17 pgs: 17 active+clean; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 595 op/s 2024-04-01T19:33:52.172 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:52 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/596217623' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:33:52.177 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:33:52.180 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:52.181 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:33:52.241 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:33:52.241 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:33:52.241 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-01T19:33:52.241 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-01T19:33:52.241 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:33:52.257 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:52 smithi188 ceph-mon[43939]: pgmap v774: 17 pgs: 17 active+clean; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 595 op/s 2024-04-01T19:33:52.257 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:52 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/596217623' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:33:52.281 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:33:52.310 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:52.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:52 smithi062 ceph-mon[44211]: pgmap v774: 17 pgs: 17 active+clean; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 595 op/s 2024-04-01T19:33:52.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:52 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/596217623' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:33:52.944 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_historic_ops 2024-04-01T19:33:52.989 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:33:53.020 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-04-01T19:33:53.021 INFO:tasks.radosbench:Beginning radosbench... 2024-04-01T19:33:53.021 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_2 2024-04-01T19:33:53.022 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pool create unique_pool_2 16 2024-04-01T19:33:53.203 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:33:53.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:53 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/596217623' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T19:33:53.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:53 smithi022 ceph-mon[39439]: osdmap e265: 12 total, 12 up, 12 in 2024-04-01T19:33:53.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:53 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/596217623' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T19:33:53.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:53 smithi188 ceph-mon[43939]: osdmap e265: 12 total, 12 up, 12 in 2024-04-01T19:33:53.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:53 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/596217623' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T19:33:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:53 smithi062 ceph-mon[44211]: osdmap e265: 12 total, 12 up, 12 in 2024-04-01T19:33:53.899 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:33:54.173 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:54 smithi022 ceph-mon[39439]: pgmap v776: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:33:54.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:54 smithi188 ceph-mon[43939]: pgmap v776: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:33:54.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:54 smithi062 ceph-mon[44211]: pgmap v776: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:33:55.086 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:33:55.086 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:33:55.086 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:33:55.086 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:33:55.086 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.086 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:248721 2.d 2:b1003e65:::benchmark_data_smithi188_77607_object81317:head [delete] snapc 0=[] ondisk+write+known_if_redirected e156)", 2024-04-01T19:33:55.087 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:46.897485+0000", 2024-04-01T19:33:55.087 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 368.18871511999998, 2024-04-01T19:33:55.087 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16256036500000001, 2024-04-01T19:33:55.087 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:33:55.087 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:33:55.087 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:55.087 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:33:55.087 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:33:55.087 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:55.087 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 248721 2024-04-01T19:33:55.087 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.087 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:33:55.087 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.087 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:33:55.088 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.897485+0000", 2024-04-01T19:33:55.088 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.088 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.088 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.088 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:33:55.088 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.897485+0000", 2024-04-01T19:33:55.088 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.088 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.088 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.088 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:33:55.088 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.897487+0000", 2024-04-01T19:33:55.088 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9860000000000001e-06 2024-04-01T19:33:55.088 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.088 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.089 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:33:55.089 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.897493+0000", 2024-04-01T19:33:55.089 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7239999999999997e-06 2024-04-01T19:33:55.089 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.089 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.089 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:33:55.089 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.897506+0000", 2024-04-01T19:33:55.089 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2774e-05 2024-04-01T19:33:55.089 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.089 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.089 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:33:55.089 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.897514+0000", 2024-04-01T19:33:55.089 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1850000000000004e-06 2024-04-01T19:33:55.089 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.090 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.090 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.090 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.923769+0000", 2024-04-01T19:33:55.090 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026255392999999998 2024-04-01T19:33:55.090 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.090 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.090 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:33:55.090 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.923894+0000", 2024-04-01T19:33:55.090 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012517 2024-04-01T19:33:55.090 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.090 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.090 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:33:55.090 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.924022+0000", 2024-04-01T19:33:55.090 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012779100000000001 2024-04-01T19:33:55.091 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.091 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.091 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:55.091 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.928773+0000", 2024-04-01T19:33:55.091 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0047510039999999996 2024-04-01T19:33:55.091 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.091 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.091 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:33:55.091 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.059965+0000", 2024-04-01T19:33:55.091 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13119133199999999 2024-04-01T19:33:55.091 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.091 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.091 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:33:55.092 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.060002+0000", 2024-04-01T19:33:55.092 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7548e-05 2024-04-01T19:33:55.092 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.092 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.092 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:33:55.092 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.060046+0000", 2024-04-01T19:33:55.092 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3458000000000003e-05 2024-04-01T19:33:55.092 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.092 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:33:55.092 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.092 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.092 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.092 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:249236 2.d 2:b6ce699d:::benchmark_data_smithi188_77607_object81832:head [delete] snapc 0=[] ondisk+write+known_if_redirected e156)", 2024-04-01T19:33:55.092 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:47.591312+0000", 2024-04-01T19:33:55.092 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 367.49488836400002, 2024-04-01T19:33:55.093 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.181560891, 2024-04-01T19:33:55.093 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:33:55.093 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:33:55.093 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:55.093 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:33:55.093 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:33:55.093 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:55.093 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 249236 2024-04-01T19:33:55.093 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.093 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:33:55.093 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.093 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:33:55.093 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.591312+0000", 2024-04-01T19:33:55.094 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.094 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.094 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.094 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:33:55.094 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.591312+0000", 2024-04-01T19:33:55.094 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.094 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.094 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.094 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:33:55.094 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.591314+0000", 2024-04-01T19:33:55.094 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.385e-06 2024-04-01T19:33:55.094 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.094 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.094 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:33:55.095 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.591321+0000", 2024-04-01T19:33:55.095 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0840000000000003e-06 2024-04-01T19:33:55.095 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.095 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.095 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:33:55.095 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.591336+0000", 2024-04-01T19:33:55.095 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4575e-05 2024-04-01T19:33:55.095 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.095 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.095 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:33:55.095 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.591356+0000", 2024-04-01T19:33:55.095 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9755e-05 2024-04-01T19:33:55.096 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.096 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.096 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.096 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.626225+0000", 2024-04-01T19:33:55.096 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034869270000000001 2024-04-01T19:33:55.096 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.096 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.096 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:33:55.096 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.626348+0000", 2024-04-01T19:33:55.096 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012279399999999999 2024-04-01T19:33:55.096 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.096 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.096 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:33:55.097 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.626469+0000", 2024-04-01T19:33:55.097 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012113 2024-04-01T19:33:55.097 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.097 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.097 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:55.097 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.655862+0000", 2024-04-01T19:33:55.097 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029392686000000001 2024-04-01T19:33:55.097 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.097 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.097 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:33:55.097 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.772758+0000", 2024-04-01T19:33:55.097 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.11689601199999999 2024-04-01T19:33:55.097 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.098 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.098 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:33:55.098 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.772812+0000", 2024-04-01T19:33:55.098 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4122999999999997e-05 2024-04-01T19:33:55.098 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.098 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.098 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:33:55.098 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.772873+0000", 2024-04-01T19:33:55.098 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1076999999999998e-05 2024-04-01T19:33:55.098 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.098 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:33:55.098 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.098 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.099 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.099 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:250183 2.d 2:b6dffcc1:::benchmark_data_smithi188_77607_object82779:head [delete] snapc 0=[] ondisk+write+known_if_redirected e156)", 2024-04-01T19:33:55.099 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:48.757562+0000", 2024-04-01T19:33:55.099 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 366.32863840099998, 2024-04-01T19:33:55.099 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16188115, 2024-04-01T19:33:55.099 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:33:55.099 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:33:55.099 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:55.099 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:33:55.099 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:33:55.099 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:55.099 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 250183 2024-04-01T19:33:55.099 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.099 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:33:55.100 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.100 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:33:55.100 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.757562+0000", 2024-04-01T19:33:55.100 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.100 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.100 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.100 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:33:55.100 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.757562+0000", 2024-04-01T19:33:55.100 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.100 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.100 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.100 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:33:55.100 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.757564+0000", 2024-04-01T19:33:55.100 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2089999999999999e-06 2024-04-01T19:33:55.101 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.101 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.101 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:33:55.101 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.757571+0000", 2024-04-01T19:33:55.101 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8700000000000003e-06 2024-04-01T19:33:55.101 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.101 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.101 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:33:55.101 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.757586+0000", 2024-04-01T19:33:55.101 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5325999999999999e-05 2024-04-01T19:33:55.101 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.101 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.101 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:33:55.101 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.757596+0000", 2024-04-01T19:33:55.102 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0013000000000001e-05 2024-04-01T19:33:55.102 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.102 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.102 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.102 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.787384+0000", 2024-04-01T19:33:55.102 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029787991 2024-04-01T19:33:55.102 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.102 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.102 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:33:55.102 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.787515+0000", 2024-04-01T19:33:55.102 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013011199999999999 2024-04-01T19:33:55.102 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.103 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.103 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:33:55.103 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.787644+0000", 2024-04-01T19:33:55.103 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000129164 2024-04-01T19:33:55.103 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.103 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.103 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:55.103 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.803111+0000", 2024-04-01T19:33:55.103 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015466881 2024-04-01T19:33:55.103 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.103 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.103 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:33:55.103 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.919319+0000", 2024-04-01T19:33:55.103 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.116208031 2024-04-01T19:33:55.103 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.104 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.104 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:33:55.104 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.919379+0000", 2024-04-01T19:33:55.104 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0327e-05 2024-04-01T19:33:55.104 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.104 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.104 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:33:55.104 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.919443+0000", 2024-04-01T19:33:55.104 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4226000000000005e-05 2024-04-01T19:33:55.104 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.104 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:33:55.104 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.104 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.105 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.105 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:250195 2.d 2:b3613023:::benchmark_data_smithi188_77607_object82791:head [delete] snapc 0=[] ondisk+write+known_if_redirected e156)", 2024-04-01T19:33:55.105 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:48.769498+0000", 2024-04-01T19:33:55.105 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 366.316702357, 2024-04-01T19:33:55.105 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.150167941, 2024-04-01T19:33:55.105 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:33:55.105 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:33:55.105 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:55.105 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:33:55.105 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:33:55.105 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:55.105 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 250195 2024-04-01T19:33:55.105 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.105 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:33:55.105 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.106 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:33:55.106 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.769498+0000", 2024-04-01T19:33:55.106 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.106 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.106 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.106 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:33:55.106 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.769498+0000", 2024-04-01T19:33:55.106 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.106 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.106 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.106 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:33:55.106 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.769500+0000", 2024-04-01T19:33:55.106 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3870000000000002e-06 2024-04-01T19:33:55.107 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.107 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.107 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:33:55.107 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.769508+0000", 2024-04-01T19:33:55.107 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1430000000000001e-06 2024-04-01T19:33:55.107 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.107 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.107 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:33:55.107 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.769523+0000", 2024-04-01T19:33:55.107 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5625e-05 2024-04-01T19:33:55.107 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.107 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.107 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:33:55.107 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.769531+0000", 2024-04-01T19:33:55.108 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3110000000000006e-06 2024-04-01T19:33:55.108 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.108 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.108 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.108 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.792882+0000", 2024-04-01T19:33:55.108 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023350724999999999 2024-04-01T19:33:55.108 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.108 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.108 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:33:55.108 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.793022+0000", 2024-04-01T19:33:55.108 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014011000000000001 2024-04-01T19:33:55.108 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.108 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.108 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:33:55.109 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.793168+0000", 2024-04-01T19:33:55.109 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014591699999999999 2024-04-01T19:33:55.109 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.109 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.109 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:55.109 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.803160+0000", 2024-04-01T19:33:55.109 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0099919559999999998 2024-04-01T19:33:55.109 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.109 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.109 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:33:55.109 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.919577+0000", 2024-04-01T19:33:55.109 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.116416319 2024-04-01T19:33:55.109 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.109 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.110 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:33:55.110 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.919620+0000", 2024-04-01T19:33:55.110 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3188000000000001e-05 2024-04-01T19:33:55.110 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.110 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.110 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:33:55.110 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.919666+0000", 2024-04-01T19:33:55.110 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6260000000000001e-05 2024-04-01T19:33:55.110 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.110 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:33:55.110 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.110 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.110 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.111 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:250350 2.d 2:b8eceb9e:::benchmark_data_smithi188_77607_object82946:head [delete] snapc 0=[] ondisk+write+known_if_redirected e156)", 2024-04-01T19:33:55.111 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:48.978621+0000", 2024-04-01T19:33:55.111 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 366.10757920899999, 2024-04-01T19:33:55.111 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.146024284, 2024-04-01T19:33:55.111 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:33:55.111 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:33:55.111 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:55.111 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:33:55.111 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:33:55.111 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:55.111 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 250350 2024-04-01T19:33:55.111 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.111 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:33:55.111 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.112 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:33:55.112 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.978621+0000", 2024-04-01T19:33:55.112 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.112 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.112 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.112 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:33:55.112 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.978621+0000", 2024-04-01T19:33:55.112 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.112 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.112 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.112 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:33:55.112 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.978622+0000", 2024-04-01T19:33:55.112 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8999999999999996e-07 2024-04-01T19:33:55.113 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.113 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.113 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:33:55.113 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.978625+0000", 2024-04-01T19:33:55.113 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7350000000000001e-06 2024-04-01T19:33:55.113 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.113 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.113 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:33:55.113 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.978631+0000", 2024-04-01T19:33:55.113 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2450000000000003e-06 2024-04-01T19:33:55.113 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.113 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.113 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:33:55.113 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.978636+0000", 2024-04-01T19:33:55.114 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8590000000000004e-06 2024-04-01T19:33:55.114 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.114 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.114 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.114 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.989548+0000", 2024-04-01T19:33:55.114 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010912478999999999 2024-04-01T19:33:55.114 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.114 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.114 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:33:55.114 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.989667+0000", 2024-04-01T19:33:55.114 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000118585 2024-04-01T19:33:55.114 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.114 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.114 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:33:55.115 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.989790+0000", 2024-04-01T19:33:55.115 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012361800000000001 2024-04-01T19:33:55.115 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.115 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.115 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:55.115 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.994628+0000", 2024-04-01T19:33:55.115 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0048380970000000004 2024-04-01T19:33:55.115 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.115 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.115 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:33:55.115 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.124528+0000", 2024-04-01T19:33:55.115 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.12989994599999999 2024-04-01T19:33:55.115 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.115 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.116 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:33:55.116 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.124577+0000", 2024-04-01T19:33:55.116 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8554999999999998e-05 2024-04-01T19:33:55.116 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.116 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.116 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:33:55.116 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.124645+0000", 2024-04-01T19:33:55.116 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8474999999999997e-05 2024-04-01T19:33:55.116 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.116 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:33:55.116 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.116 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.116 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.117 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:250603 2.d 2:b946184c:::benchmark_data_smithi188_77607_object83199:head [delete] snapc 0=[] ondisk+write+known_if_redirected e156)", 2024-04-01T19:33:55.117 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:49.293661+0000", 2024-04-01T19:33:55.117 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 365.79253963600001, 2024-04-01T19:33:55.117 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14584196399999999, 2024-04-01T19:33:55.117 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:33:55.117 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:33:55.117 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:55.117 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:33:55.117 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:33:55.117 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:55.117 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 250603 2024-04-01T19:33:55.117 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.117 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:33:55.117 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.118 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:33:55.118 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.293661+0000", 2024-04-01T19:33:55.118 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.118 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.118 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.118 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:33:55.118 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.293661+0000", 2024-04-01T19:33:55.118 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.118 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.118 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.118 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:33:55.118 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.293663+0000", 2024-04-01T19:33:55.118 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0150000000000002e-06 2024-04-01T19:33:55.119 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.119 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.119 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:33:55.119 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.293668+0000", 2024-04-01T19:33:55.119 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6869999999999999e-06 2024-04-01T19:33:55.119 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.119 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.119 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:33:55.119 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.293680+0000", 2024-04-01T19:33:55.119 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1810999999999999e-05 2024-04-01T19:33:55.119 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.119 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.119 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:33:55.119 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.293686+0000", 2024-04-01T19:33:55.120 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6679999999999998e-06 2024-04-01T19:33:55.120 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.120 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.120 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.120 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.314363+0000", 2024-04-01T19:33:55.120 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020676792999999999 2024-04-01T19:33:55.120 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.120 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.120 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:33:55.120 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.314466+0000", 2024-04-01T19:33:55.120 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000103162 2024-04-01T19:33:55.120 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.120 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.120 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:33:55.121 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.314533+0000", 2024-04-01T19:33:55.121 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6952000000000005e-05 2024-04-01T19:33:55.121 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.121 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.121 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:33:55.121 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.326788+0000", 2024-04-01T19:33:55.121 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012254699000000001 2024-04-01T19:33:55.121 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.121 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.121 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:55.121 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.439418+0000", 2024-04-01T19:33:55.121 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.112630336 2024-04-01T19:33:55.121 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.121 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.122 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:33:55.122 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.439452+0000", 2024-04-01T19:33:55.122 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4051000000000003e-05 2024-04-01T19:33:55.122 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.122 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.122 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:33:55.122 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.439503+0000", 2024-04-01T19:33:55.122 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.079e-05 2024-04-01T19:33:55.122 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.122 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:33:55.122 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.122 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.122 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.122 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:251569 2.d 2:bc483287:::benchmark_data_smithi188_77607_object84165:head [delete] snapc 0=[] ondisk+write+known_if_redirected e157)", 2024-04-01T19:33:55.123 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:50.522652+0000", 2024-04-01T19:33:55.123 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 364.56354873800001, 2024-04-01T19:33:55.123 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16137095300000001, 2024-04-01T19:33:55.123 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:33:55.123 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:33:55.123 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:55.123 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:33:55.123 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:33:55.123 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:55.123 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 251569 2024-04-01T19:33:55.123 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.123 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:33:55.123 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.123 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:33:55.124 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.522652+0000", 2024-04-01T19:33:55.124 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.124 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.124 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.124 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:33:55.124 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.522652+0000", 2024-04-01T19:33:55.124 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.124 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.124 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.124 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:33:55.124 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.522654+0000", 2024-04-01T19:33:55.124 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2369999999999999e-06 2024-04-01T19:33:55.124 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.124 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.124 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:33:55.125 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.522670+0000", 2024-04-01T19:33:55.125 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5888000000000001e-05 2024-04-01T19:33:55.125 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.125 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.125 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:33:55.125 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.522686+0000", 2024-04-01T19:33:55.125 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5928999999999999e-05 2024-04-01T19:33:55.125 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.125 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.125 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:33:55.125 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.522693+0000", 2024-04-01T19:33:55.125 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7680000000000008e-06 2024-04-01T19:33:55.125 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.125 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.125 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.126 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.548310+0000", 2024-04-01T19:33:55.126 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.025616173999999999 2024-04-01T19:33:55.126 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.126 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.126 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:33:55.126 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.548442+0000", 2024-04-01T19:33:55.126 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000132772 2024-04-01T19:33:55.126 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.126 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.126 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:33:55.126 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.548556+0000", 2024-04-01T19:33:55.126 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000113393 2024-04-01T19:33:55.126 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.126 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.127 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:55.127 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.683906+0000", 2024-04-01T19:33:55.127 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.135349792 2024-04-01T19:33:55.127 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.127 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.127 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:33:55.127 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.683921+0000", 2024-04-01T19:33:55.127 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5631e-05 2024-04-01T19:33:55.127 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.127 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.127 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:33:55.127 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.683968+0000", 2024-04-01T19:33:55.127 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6279000000000002e-05 2024-04-01T19:33:55.127 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.127 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.128 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:33:55.128 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.684023+0000", 2024-04-01T19:33:55.128 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5090000000000003e-05 2024-04-01T19:33:55.128 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.128 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:33:55.128 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.128 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.128 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.128 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:251601 2.d 2:bd354f70:::benchmark_data_smithi188_77607_object84197:head [delete] snapc 0=[] ondisk+write+known_if_redirected e157)", 2024-04-01T19:33:55.128 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:50.549151+0000", 2024-04-01T19:33:55.128 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 364.53704948400002, 2024-04-01T19:33:55.128 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.146277241, 2024-04-01T19:33:55.128 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:33:55.129 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:33:55.129 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:55.129 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:33:55.129 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:33:55.129 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:55.129 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 251601 2024-04-01T19:33:55.129 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.129 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:33:55.129 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.129 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:33:55.129 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.549151+0000", 2024-04-01T19:33:55.129 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.129 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.130 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.130 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:33:55.130 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.549151+0000", 2024-04-01T19:33:55.130 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.130 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.130 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.130 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:33:55.130 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.549153+0000", 2024-04-01T19:33:55.130 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7090000000000001e-06 2024-04-01T19:33:55.130 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.130 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.130 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:33:55.130 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.549159+0000", 2024-04-01T19:33:55.130 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3520000000000003e-06 2024-04-01T19:33:55.131 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.131 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.131 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:33:55.131 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.549169+0000", 2024-04-01T19:33:55.131 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.798e-06 2024-04-01T19:33:55.131 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.131 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.131 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:33:55.131 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.549188+0000", 2024-04-01T19:33:55.131 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9017000000000001e-05 2024-04-01T19:33:55.131 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.131 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.131 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.132 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.679851+0000", 2024-04-01T19:33:55.132 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13066309100000001 2024-04-01T19:33:55.132 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.132 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.132 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:33:55.132 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.679937+0000", 2024-04-01T19:33:55.132 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5829999999999996e-05 2024-04-01T19:33:55.132 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.132 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.132 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:33:55.132 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.680015+0000", 2024-04-01T19:33:55.132 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8287000000000004e-05 2024-04-01T19:33:55.132 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.133 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.133 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:33:55.133 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.684239+0000", 2024-04-01T19:33:55.133 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0042242579999999998 2024-04-01T19:33:55.133 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.133 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.133 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:55.133 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.695316+0000", 2024-04-01T19:33:55.133 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011076618999999999 2024-04-01T19:33:55.133 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.133 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.133 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:33:55.133 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.695377+0000", 2024-04-01T19:33:55.133 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0841000000000002e-05 2024-04-01T19:33:55.134 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.134 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.134 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:33:55.134 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.695428+0000", 2024-04-01T19:33:55.134 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1439e-05 2024-04-01T19:33:55.134 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.134 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:33:55.134 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.134 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.134 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.134 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:253518 2.d 2:b2dfd025:::benchmark_data_smithi188_77607_object86114:head [delete] snapc 0=[] ondisk+write+known_if_redirected e157)", 2024-04-01T19:33:55.134 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:52.998586+0000", 2024-04-01T19:33:55.134 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 362.08761399299999, 2024-04-01T19:33:55.135 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.17168951199999999, 2024-04-01T19:33:55.135 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:33:55.135 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:33:55.135 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:55.135 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:33:55.135 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:33:55.135 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:55.135 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 253518 2024-04-01T19:33:55.135 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.135 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:33:55.135 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.135 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:33:55.135 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:52.998586+0000", 2024-04-01T19:33:55.135 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.136 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.136 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.136 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:33:55.136 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:52.998586+0000", 2024-04-01T19:33:55.136 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.136 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.136 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.136 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:33:55.136 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:52.998589+0000", 2024-04-01T19:33:55.136 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1320000000000001e-06 2024-04-01T19:33:55.136 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.136 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.136 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:33:55.136 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:52.998595+0000", 2024-04-01T19:33:55.136 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7129999999999999e-06 2024-04-01T19:33:55.137 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.137 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.137 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:33:55.137 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:52.998607+0000", 2024-04-01T19:33:55.137 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1582e-05 2024-04-01T19:33:55.137 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.137 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.137 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:33:55.137 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:52.998615+0000", 2024-04-01T19:33:55.137 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0029999999999994e-06 2024-04-01T19:33:55.137 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.137 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.137 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.138 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.039964+0000", 2024-04-01T19:33:55.138 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041349412000000002 2024-04-01T19:33:55.138 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.138 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.138 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:33:55.138 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.040085+0000", 2024-04-01T19:33:55.138 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012086099999999999 2024-04-01T19:33:55.138 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.138 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.138 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:33:55.138 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.040214+0000", 2024-04-01T19:33:55.138 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012912000000000001 2024-04-01T19:33:55.138 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.138 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.139 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:55.139 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.061849+0000", 2024-04-01T19:33:55.139 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.021635031999999998 2024-04-01T19:33:55.139 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.139 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.139 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:33:55.139 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.170163+0000", 2024-04-01T19:33:55.139 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.10831364 2024-04-01T19:33:55.139 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.139 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.139 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:33:55.139 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.170214+0000", 2024-04-01T19:33:55.139 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0695999999999997e-05 2024-04-01T19:33:55.140 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.140 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.140 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:33:55.140 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.170276+0000", 2024-04-01T19:33:55.140 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2321000000000002e-05 2024-04-01T19:33:55.140 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.140 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:33:55.140 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.140 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.140 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.140 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:254281 2.d 2:b91f57e9:::benchmark_data_smithi188_77607_object86877:head [delete] snapc 0=[] ondisk+write+known_if_redirected e157)", 2024-04-01T19:33:55.140 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:53.999010+0000", 2024-04-01T19:33:55.140 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 361.08718991000001, 2024-04-01T19:33:55.140 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.199172619, 2024-04-01T19:33:55.140 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:33:55.141 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:33:55.141 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:55.141 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:33:55.141 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:33:55.141 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:55.141 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 254281 2024-04-01T19:33:55.141 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.141 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:33:55.141 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.141 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:33:55.141 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.999010+0000", 2024-04-01T19:33:55.141 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.141 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.142 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.142 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:33:55.142 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.999010+0000", 2024-04-01T19:33:55.142 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.142 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.142 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.142 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:33:55.142 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.999012+0000", 2024-04-01T19:33:55.142 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5889999999999999e-06 2024-04-01T19:33:55.142 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.142 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.142 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:33:55.142 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.999017+0000", 2024-04-01T19:33:55.143 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7419999999999997e-06 2024-04-01T19:33:55.143 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.143 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.143 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:33:55.143 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.999026+0000", 2024-04-01T19:33:55.143 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5740000000000002e-06 2024-04-01T19:33:55.143 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.143 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.143 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:33:55.143 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.999034+0000", 2024-04-01T19:33:55.143 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.396e-06 2024-04-01T19:33:55.143 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.143 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.143 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.144 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.056758+0000", 2024-04-01T19:33:55.144 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057724567999999997 2024-04-01T19:33:55.144 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.144 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.144 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:33:55.144 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.056871+0000", 2024-04-01T19:33:55.144 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000112892 2024-04-01T19:33:55.144 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.144 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.144 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:33:55.144 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.056984+0000", 2024-04-01T19:33:55.144 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011265900000000001 2024-04-01T19:33:55.144 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.144 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.144 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:55.145 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.061837+0000", 2024-04-01T19:33:55.145 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0048528169999999997 2024-04-01T19:33:55.145 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.145 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.145 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:33:55.145 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.198068+0000", 2024-04-01T19:33:55.145 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13623084599999999 2024-04-01T19:33:55.145 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.145 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.145 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:33:55.145 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.198113+0000", 2024-04-01T19:33:55.145 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5890999999999998e-05 2024-04-01T19:33:55.145 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.145 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.145 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:33:55.146 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.198183+0000", 2024-04-01T19:33:55.146 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9645000000000002e-05 2024-04-01T19:33:55.146 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.146 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:33:55.146 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.146 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.146 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.146 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:254452 2.d 2:b233dfb5:::benchmark_data_smithi188_77607_object87048:head [delete] snapc 0=[] ondisk+write+known_if_redirected e157)", 2024-04-01T19:33:55.146 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:54.264275+0000", 2024-04-01T19:33:55.146 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 360.82192558600002, 2024-04-01T19:33:55.146 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14739497600000001, 2024-04-01T19:33:55.146 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:33:55.146 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:33:55.147 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:55.147 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:33:55.147 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:33:55.147 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:55.147 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 254452 2024-04-01T19:33:55.147 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.147 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:33:55.147 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.147 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:33:55.147 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.264275+0000", 2024-04-01T19:33:55.147 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.147 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.147 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.147 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:33:55.148 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.264275+0000", 2024-04-01T19:33:55.148 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.148 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.148 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.148 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:33:55.148 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.264277+0000", 2024-04-01T19:33:55.148 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0470000000000001e-06 2024-04-01T19:33:55.148 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.148 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.148 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:33:55.148 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.264283+0000", 2024-04-01T19:33:55.148 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0689999999999998e-06 2024-04-01T19:33:55.148 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.148 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.149 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:33:55.149 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.264291+0000", 2024-04-01T19:33:55.149 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8299999999999996e-06 2024-04-01T19:33:55.149 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.149 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.149 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:33:55.149 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.264298+0000", 2024-04-01T19:33:55.149 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3420000000000002e-06 2024-04-01T19:33:55.149 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.149 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.149 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.149 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.385001+0000", 2024-04-01T19:33:55.149 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.120703242 2024-04-01T19:33:55.149 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.149 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.150 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:33:55.150 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.385108+0000", 2024-04-01T19:33:55.150 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000106902 2024-04-01T19:33:55.150 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.150 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.150 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:33:55.150 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.385222+0000", 2024-04-01T19:33:55.150 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000113738 2024-04-01T19:33:55.150 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.150 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.150 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:55.150 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.410153+0000", 2024-04-01T19:33:55.150 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.024931471 2024-04-01T19:33:55.150 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.151 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.151 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:33:55.151 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.411612+0000", 2024-04-01T19:33:55.151 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014584369999999999 2024-04-01T19:33:55.151 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.151 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.151 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:33:55.151 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.411642+0000", 2024-04-01T19:33:55.151 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0540999999999998e-05 2024-04-01T19:33:55.151 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.151 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.151 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:33:55.151 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.411670+0000", 2024-04-01T19:33:55.151 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7356999999999999e-05 2024-04-01T19:33:55.151 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.152 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:33:55.152 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.152 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.152 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.152 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:254701 2.d 2:b4905e4c:::benchmark_data_smithi188_77607_object87297:head [delete] snapc 0=[] ondisk+write+known_if_redirected e157)", 2024-04-01T19:33:55.152 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:54.596002+0000", 2024-04-01T19:33:55.152 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 360.49019880899999, 2024-04-01T19:33:55.152 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14451546300000001, 2024-04-01T19:33:55.152 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:33:55.152 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:33:55.152 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:55.152 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:33:55.152 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:33:55.152 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:55.152 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 254701 2024-04-01T19:33:55.153 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.153 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:33:55.153 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.153 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:33:55.153 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.596002+0000", 2024-04-01T19:33:55.153 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.153 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.153 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.153 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:33:55.153 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.596002+0000", 2024-04-01T19:33:55.153 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.153 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.153 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.153 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:33:55.153 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.596004+0000", 2024-04-01T19:33:55.154 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.967e-06 2024-04-01T19:33:55.154 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.154 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.154 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:33:55.154 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.596010+0000", 2024-04-01T19:33:55.154 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0800000000000002e-06 2024-04-01T19:33:55.154 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.154 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.154 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:33:55.154 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.596023+0000", 2024-04-01T19:33:55.154 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3396e-05 2024-04-01T19:33:55.154 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.154 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.154 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:33:55.155 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.596032+0000", 2024-04-01T19:33:55.155 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7479999999999999e-06 2024-04-01T19:33:55.155 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.155 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.155 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.155 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.619993+0000", 2024-04-01T19:33:55.155 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.02396125 2024-04-01T19:33:55.155 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.155 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.155 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:33:55.155 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.620121+0000", 2024-04-01T19:33:55.155 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000127541 2024-04-01T19:33:55.155 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.155 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.156 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:33:55.156 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.620245+0000", 2024-04-01T19:33:55.156 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012476100000000001 2024-04-01T19:33:55.156 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.156 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.156 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:55.156 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.739593+0000", 2024-04-01T19:33:55.156 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.119347251 2024-04-01T19:33:55.156 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.156 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.156 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:33:55.156 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.740400+0000", 2024-04-01T19:33:55.156 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00080735900000000001 2024-04-01T19:33:55.156 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.157 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.157 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:33:55.157 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.740455+0000", 2024-04-01T19:33:55.157 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5365999999999998e-05 2024-04-01T19:33:55.157 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.157 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.157 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:33:55.157 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.740517+0000", 2024-04-01T19:33:55.157 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1743999999999997e-05 2024-04-01T19:33:55.157 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.157 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:33:55.157 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.157 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.157 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.158 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:254706 2.d 2:be5aeffc:::benchmark_data_smithi188_77607_object87302:head [delete] snapc 0=[] ondisk+write+known_if_redirected e157)", 2024-04-01T19:33:55.158 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:54.596154+0000", 2024-04-01T19:33:55.158 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 360.490046248, 2024-04-01T19:33:55.158 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14451310000000001, 2024-04-01T19:33:55.158 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:33:55.158 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:33:55.158 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:55.158 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:33:55.158 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:33:55.158 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:55.158 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 254706 2024-04-01T19:33:55.158 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.158 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:33:55.158 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.159 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:33:55.159 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.596154+0000", 2024-04-01T19:33:55.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.159 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.159 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.159 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:33:55.159 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.596154+0000", 2024-04-01T19:33:55.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.159 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.159 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.159 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:33:55.159 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.596155+0000", 2024-04-01T19:33:55.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.263e-06 2024-04-01T19:33:55.160 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.160 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.160 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:33:55.160 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.596160+0000", 2024-04-01T19:33:55.160 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.301e-06 2024-04-01T19:33:55.160 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.160 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.160 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:33:55.160 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.596170+0000", 2024-04-01T19:33:55.160 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0344e-05 2024-04-01T19:33:55.160 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.160 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.160 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:33:55.160 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.596178+0000", 2024-04-01T19:33:55.160 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-01T19:33:55.160 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.624761+0000", 2024-04-01T19:33:55.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028583055 2024-04-01T19:33:55.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:33:55.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.624888+0000", 2024-04-01T19:33:55.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012715599999999999 2024-04-01T19:33:55.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:33:55.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.625003+0000", 2024-04-01T19:33:55.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000115543 2024-04-01T19:33:55.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.162 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:55.162 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.739635+0000", 2024-04-01T19:33:55.162 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.114631654 2024-04-01T19:33:55.162 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.162 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.162 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:33:55.162 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.740570+0000", 2024-04-01T19:33:55.162 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00093521700000000001 2024-04-01T19:33:55.162 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.162 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.162 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:33:55.162 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.740622+0000", 2024-04-01T19:33:55.162 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1876000000000003e-05 2024-04-01T19:33:55.163 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.163 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.163 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:33:55.163 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.740667+0000", 2024-04-01T19:33:55.163 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5003999999999998e-05 2024-04-01T19:33:55.163 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.163 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:33:55.163 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.163 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.163 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.163 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:255080 2.d 2:b280a3fb:::benchmark_data_smithi188_77607_object87676:head [delete] snapc 0=[] ondisk+write+known_if_redirected e157)", 2024-04-01T19:33:55.163 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:55.090210+0000", 2024-04-01T19:33:55.163 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 359.99599001000001, 2024-04-01T19:33:55.163 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.15887069700000001, 2024-04-01T19:33:55.164 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:33:55.164 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:33:55.164 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:33:55.164 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:33:55.164 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:33:55.164 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:55.164 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 255080 2024-04-01T19:33:55.164 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.164 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:33:55.164 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.164 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:33:55.164 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.090210+0000", 2024-04-01T19:33:55.164 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.164 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.164 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.165 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:33:55.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.090210+0000", 2024-04-01T19:33:55.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.165 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.165 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.165 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:33:55.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.090212+0000", 2024-04-01T19:33:55.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7400000000000001e-06 2024-04-01T19:33:55.165 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.165 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.165 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:33:55.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.090216+0000", 2024-04-01T19:33:55.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2379999999999999e-06 2024-04-01T19:33:55.165 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.165 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.166 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:33:55.166 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.090226+0000", 2024-04-01T19:33:55.166 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1740000000000006e-06 2024-04-01T19:33:55.166 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.166 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.166 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:33:55.166 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.090231+0000", 2024-04-01T19:33:55.166 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8830000000000003e-06 2024-04-01T19:33:55.166 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.166 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.166 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.166 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.110454+0000", 2024-04-01T19:33:55.166 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020223042 2024-04-01T19:33:55.166 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.167 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.167 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:33:55.167 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.110549+0000", 2024-04-01T19:33:55.167 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4320000000000005e-05 2024-04-01T19:33:55.167 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.167 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.167 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:33:55.167 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.110629+0000", 2024-04-01T19:33:55.167 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9950000000000005e-05 2024-04-01T19:33:55.167 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.167 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.167 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:33:55.167 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.114631+0000", 2024-04-01T19:33:55.167 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040024049999999997 2024-04-01T19:33:55.168 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.168 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.168 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:33:55.168 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.248950+0000", 2024-04-01T19:33:55.168 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13431896800000001 2024-04-01T19:33:55.168 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.168 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.168 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:33:55.168 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.249010+0000", 2024-04-01T19:33:55.168 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0134999999999999e-05 2024-04-01T19:33:55.168 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.168 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.168 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:33:55.168 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.249081+0000", 2024-04-01T19:33:55.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0841999999999997e-05 2024-04-01T19:33:55.169 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.169 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:33:55.169 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.169 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.169 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:265187 2.f 2.575ca2f (undecoded) ondisk+retry+write+known_if_redirected e169)", 2024-04-01T19:33:55.169 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:28:30.804284+0000", 2024-04-01T19:33:55.169 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 324.28191607299999, 2024-04-01T19:33:55.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85333816100000004, 2024-04-01T19:33:55.169 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:33:55.169 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:33:55.169 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:33:55.169 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:33:55.170 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:33:55.170 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:55.170 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 265187 2024-04-01T19:33:55.170 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.170 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:33:55.170 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.170 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:33:55.170 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804284+0000", 2024-04-01T19:33:55.170 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.170 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.170 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.170 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:33:55.170 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804284+0000", 2024-04-01T19:33:55.170 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.171 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:33:55.171 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804287+0000", 2024-04-01T19:33:55.171 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8600000000000001e-06 2024-04-01T19:33:55.171 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:33:55.171 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804297+0000", 2024-04-01T19:33:55.171 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8300000000000008e-06 2024-04-01T19:33:55.171 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:33:55.171 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804309+0000", 2024-04-01T19:33:55.172 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1943000000000001e-05 2024-04-01T19:33:55.172 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.172 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.172 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:33:55.172 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804326+0000", 2024-04-01T19:33:55.172 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7348000000000001e-05 2024-04-01T19:33:55.172 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.172 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.172 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.172 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804481+0000", 2024-04-01T19:33:55.172 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015451500000000001 2024-04-01T19:33:55.172 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.172 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:33:55.173 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804496+0000", 2024-04-01T19:33:55.173 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5682999999999999e-05 2024-04-01T19:33:55.173 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.173 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.657594+0000", 2024-04-01T19:33:55.173 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85309795300000002 2024-04-01T19:33:55.173 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:33:55.173 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.657622+0000", 2024-04-01T19:33:55.173 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8028999999999999e-05 2024-04-01T19:33:55.173 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.174 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:33:55.174 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.174 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:265204 2.f 2.e8d255ff (undecoded) ondisk+retry+write+known_if_redirected e169)", 2024-04-01T19:33:55.174 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:28:30.804397+0000", 2024-04-01T19:33:55.174 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 324.28180370400003, 2024-04-01T19:33:55.174 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85341209200000001, 2024-04-01T19:33:55.174 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:33:55.174 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:33:55.174 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:33:55.174 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:33:55.174 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:33:55.175 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:55.175 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 265204 2024-04-01T19:33:55.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.175 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:33:55.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.175 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:33:55.175 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804397+0000", 2024-04-01T19:33:55.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.175 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:33:55.175 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804397+0000", 2024-04-01T19:33:55.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.176 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:33:55.176 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804398+0000", 2024-04-01T19:33:55.176 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4300000000000001e-07 2024-04-01T19:33:55.176 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.176 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:33:55.176 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804403+0000", 2024-04-01T19:33:55.176 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9069999999999998e-06 2024-04-01T19:33:55.176 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.176 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:33:55.176 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804468+0000", 2024-04-01T19:33:55.176 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5566000000000002e-05 2024-04-01T19:33:55.177 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.177 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.177 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:33:55.177 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804512+0000", 2024-04-01T19:33:55.177 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3782000000000002e-05 2024-04-01T19:33:55.177 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.177 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.177 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.177 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804571+0000", 2024-04-01T19:33:55.177 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8758000000000002e-05 2024-04-01T19:33:55.177 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.177 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.177 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:33:55.177 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804581+0000", 2024-04-01T19:33:55.178 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.995e-06 2024-04-01T19:33:55.178 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.178 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.178 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.178 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.657801+0000", 2024-04-01T19:33:55.178 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85322052199999998 2024-04-01T19:33:55.178 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.178 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.178 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:33:55.178 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.657809+0000", 2024-04-01T19:33:55.178 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6190000000000002e-06 2024-04-01T19:33:55.178 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.178 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:33:55.179 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.179 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.179 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.179 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:265211 2.f 2.997101df (undecoded) ondisk+retry+write+known_if_redirected e169)", 2024-04-01T19:33:55.179 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:28:30.804530+0000", 2024-04-01T19:33:55.179 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 324.281669975, 2024-04-01T19:33:55.179 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85332372400000001, 2024-04-01T19:33:55.179 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:33:55.179 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:33:55.179 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:33:55.179 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:33:55.179 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:33:55.179 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:55.179 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 265211 2024-04-01T19:33:55.179 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.180 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:33:55.180 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.180 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:33:55.180 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804530+0000", 2024-04-01T19:33:55.180 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.180 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.180 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.180 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:33:55.180 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804530+0000", 2024-04-01T19:33:55.180 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.180 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.180 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.180 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:33:55.180 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804531+0000", 2024-04-01T19:33:55.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7000000000000003e-07 2024-04-01T19:33:55.181 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.181 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.181 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:33:55.181 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804536+0000", 2024-04-01T19:33:55.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7679999999999999e-06 2024-04-01T19:33:55.181 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.181 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.181 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:33:55.181 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804551+0000", 2024-04-01T19:33:55.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4962e-05 2024-04-01T19:33:55.181 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.181 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.181 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:33:55.181 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804565+0000", 2024-04-01T19:33:55.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3964999999999999e-05 2024-04-01T19:33:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804606+0000", 2024-04-01T19:33:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1044999999999998e-05 2024-04-01T19:33:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:33:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804614+0000", 2024-04-01T19:33:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0460000000000006e-06 2024-04-01T19:33:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.657845+0000", 2024-04-01T19:33:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85323087399999997 2024-04-01T19:33:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:33:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.657854+0000", 2024-04-01T19:33:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0939999999999997e-06 2024-04-01T19:33:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:33:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:265236 2.f 2.41e78bff (undecoded) ondisk+retry+write+known_if_redirected e169)", 2024-04-01T19:33:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:28:30.804573+0000", 2024-04-01T19:33:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 324.281627566, 2024-04-01T19:33:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85330377800000001, 2024-04-01T19:33:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:33:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:33:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:33:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:33:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:33:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 265236 2024-04-01T19:33:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:33:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:33:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804573+0000", 2024-04-01T19:33:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:33:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804573+0000", 2024-04-01T19:33:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:33:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804574+0000", 2024-04-01T19:33:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8599999999999998e-07 2024-04-01T19:33:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:33:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804597+0000", 2024-04-01T19:33:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3825e-05 2024-04-01T19:33:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:33:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804606+0000", 2024-04-01T19:33:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3100000000000001e-06 2024-04-01T19:33:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:33:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804613+0000", 2024-04-01T19:33:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5700000000000004e-06 2024-04-01T19:33:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804654+0000", 2024-04-01T19:33:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0377000000000003e-05 2024-04-01T19:33:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:33:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804662+0000", 2024-04-01T19:33:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8089999999999999e-06 2024-04-01T19:33:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.657871+0000", 2024-04-01T19:33:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85320828800000004 2024-04-01T19:33:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:33:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.657877+0000", 2024-04-01T19:33:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.913e-06 2024-04-01T19:33:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:33:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:265242 2.f 2.74f080ef (undecoded) ondisk+retry+write+known_if_redirected e169)", 2024-04-01T19:33:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:28:30.804623+0000", 2024-04-01T19:33:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 324.28157763600001, 2024-04-01T19:33:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85341866099999997, 2024-04-01T19:33:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:33:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:33:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:33:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:33:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:33:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 265242 2024-04-01T19:33:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:33:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:33:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804623+0000", 2024-04-01T19:33:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:33:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804623+0000", 2024-04-01T19:33:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:33:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804624+0000", 2024-04-01T19:33:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9800000000000003e-07 2024-04-01T19:33:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:33:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804638+0000", 2024-04-01T19:33:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4379000000000001e-05 2024-04-01T19:33:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:33:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804644+0000", 2024-04-01T19:33:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9220000000000002e-06 2024-04-01T19:33:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:33:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804650+0000", 2024-04-01T19:33:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0059999999999998e-06 2024-04-01T19:33:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804690+0000", 2024-04-01T19:33:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0031999999999999e-05 2024-04-01T19:33:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:33:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804697+0000", 2024-04-01T19:33:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8870000000000003e-06 2024-04-01T19:33:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.658037+0000", 2024-04-01T19:33:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85334062099999997 2024-04-01T19:33:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:33:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.658041+0000", 2024-04-01T19:33:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0160000000000002e-06 2024-04-01T19:33:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:33:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:265243 2.f 2.5c78d94f (undecoded) ondisk+retry+write+known_if_redirected e169)", 2024-04-01T19:33:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:28:30.804666+0000", 2024-04-01T19:33:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 324.28153466600003, 2024-04-01T19:33:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85341545600000002, 2024-04-01T19:33:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:33:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:33:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:33:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:33:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:33:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:33:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 265243 2024-04-01T19:33:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:33:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:33:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804666+0000", 2024-04-01T19:33:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:33:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804666+0000", 2024-04-01T19:33:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:33:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:33:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804666+0000", 2024-04-01T19:33:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4099999999999998e-07 2024-04-01T19:33:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:33:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804670+0000", 2024-04-01T19:33:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5140000000000002e-06 2024-04-01T19:33:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:33:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804676+0000", 2024-04-01T19:33:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3559999999999998e-06 2024-04-01T19:33:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:33:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804692+0000", 2024-04-01T19:33:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5933000000000001e-05 2024-04-01T19:33:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804724+0000", 2024-04-01T19:33:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1254999999999998e-05 2024-04-01T19:33:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:33:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804731+0000", 2024-04-01T19:33:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.605e-06 2024-04-01T19:33:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:33:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.658074+0000", 2024-04-01T19:33:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.853342657 2024-04-01T19:33:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:33:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:33:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:33:55.197 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.658081+0000", 2024-04-01T19:33:55.197 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3950000000000003e-06 2024-04-01T19:33:55.197 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.197 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:33:55.197 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.197 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:33:55.197 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:33:55.197 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:33:55.312 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:33:55.313 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:33:55.313 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:33:55.313 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:33:55.313 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:33:55.319 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:33:55.340 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:33:55.361 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:33:55.380 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:33:55.400 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:33:55.421 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:33:55.441 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:33:55.442 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:33:55.442 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:33:55.442 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:33:55.442 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:33:55.442 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:33:55.442 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:33:55.442 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:33:55.443 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:33:55.443 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:33:55.443 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:33:55.443 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:33:55.443 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:33:55.779 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_ops_in_flight 2024-04-01T19:33:56.041 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:33:56.088 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:33:56.356 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:56 smithi188 ceph-mon[43939]: pgmap v777: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:33:56.356 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:56 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2297707722' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:33:56.356 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:56 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.356 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:56 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.356 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:56 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.356 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:56 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.356 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:56 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.356 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:56 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.356 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:56 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.356 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:56 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.356 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:56 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.356 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:56 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2488627659' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:33:56.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:56 smithi022 ceph-mon[39439]: pgmap v777: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:33:56.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:56 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2297707722' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:33:56.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:56 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:56 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:56 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:56 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:56 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:56 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:56 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:56 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:56 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:56 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2488627659' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:33:56.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:56 smithi062 ceph-mon[44211]: pgmap v777: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:33:56.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:56 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2297707722' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:33:56.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:56 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:56 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:56 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:56 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:56 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:56 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:56 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:56 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:56 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:56.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:56 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2488627659' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:33:57.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:57.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:57.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:57.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:57 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:33:57.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:57 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:33:57.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:57 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2488627659' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:33:57.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:57 smithi022 ceph-mon[39439]: osdmap e266: 12 total, 12 up, 12 in 2024-04-01T19:33:57.372 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:57.372 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:57.372 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:57.372 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:57 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:33:57.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:57 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:33:57.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:57 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2488627659' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:33:57.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:57 smithi188 ceph-mon[43939]: osdmap e266: 12 total, 12 up, 12 in 2024-04-01T19:33:57.465 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:33:57.467 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:57.467 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:33:57.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:57.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:57.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:33:57.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:57 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:33:57.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:57 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:33:57.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:57 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2488627659' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:33:57.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:57 smithi062 ceph-mon[44211]: osdmap e266: 12 total, 12 up, 12 in 2024-04-01T19:33:57.568 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:33:57.602 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:58.004 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:33:58.004 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:33:58.096 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'unique_pool_2' created 2024-04-01T19:33:58.352 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:33:58.355 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:58 smithi022 ceph-mon[39439]: pgmap v779: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:33:58.355 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:58 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4058440556' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]: dispatch 2024-04-01T19:33:58.355 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:58.356 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:33:58.371 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:58 smithi188 ceph-mon[43939]: pgmap v779: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:33:58.371 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:58 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4058440556' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]: dispatch 2024-04-01T19:33:58.457 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:33:58.489 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:58 smithi062 ceph-mon[44211]: pgmap v779: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:33:58.489 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:58 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4058440556' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]: dispatch 2024-04-01T19:33:58.493 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:58.516 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:33:58.519 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:58.519 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:33:58.620 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:33:58.653 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:58.672 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:33:58.676 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:58.676 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:33:58.686 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_blocked_ops 2024-04-01T19:33:58.777 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:33:58.810 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:58.832 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:33:58.835 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:58.835 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:33:58.904 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pool application enable unique_pool_2 rados --yes-i-really-mean-it || true 2024-04-01T19:33:58.936 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:33:58.967 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:58.984 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:33:58.989 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:33:58.992 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:58.992 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:33:59.093 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:33:59.121 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:59.203 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:33:59.229 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:59 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4058440556' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]': finished 2024-04-01T19:33:59.229 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:33:59 smithi022 ceph-mon[39439]: osdmap e267: 12 total, 12 up, 12 in 2024-04-01T19:33:59.269 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:33:59.271 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:59.271 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:33:59.372 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:33:59.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:59 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4058440556' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]': finished 2024-04-01T19:33:59.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:33:59 smithi188 ceph-mon[43939]: osdmap e267: 12 total, 12 up, 12 in 2024-04-01T19:33:59.399 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:59.496 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:33:59.499 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:33:59.499 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:33:59.504 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:33:59.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:59 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4058440556' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]': finished 2024-04-01T19:33:59.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:33:59 smithi062 ceph-mon[44211]: osdmap e267: 12 total, 12 up, 12 in 2024-04-01T19:33:59.533 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:33:59.600 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:33:59.627 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:33:59.790 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:34:00.271 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:00 smithi188 ceph-mon[43939]: pgmap v781: 17 pgs: 1 active+clean, 16 unknown; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:34:00.271 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:00 smithi188 ceph-mon[43939]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T19:34:00.271 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:00 smithi188 ceph-mon[43939]: osdmap e268: 12 total, 12 up, 12 in 2024-04-01T19:34:00.276 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:34:00.278 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:00.279 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:34:00.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:00 smithi022 ceph-mon[39439]: pgmap v781: 17 pgs: 1 active+clean, 16 unknown; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:34:00.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:00 smithi022 ceph-mon[39439]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T19:34:00.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:00 smithi022 ceph-mon[39439]: osdmap e268: 12 total, 12 up, 12 in 2024-04-01T19:34:00.380 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:34:00.411 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:00 smithi062 ceph-mon[44211]: pgmap v781: 17 pgs: 1 active+clean, 16 unknown; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:34:00.411 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:00 smithi062 ceph-mon[44211]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T19:34:00.411 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:00 smithi062 ceph-mon[44211]: osdmap e268: 12 total, 12 up, 12 in 2024-04-01T19:34:00.413 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:00.436 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:34:00.438 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:00.439 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:34:00.540 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:34:00.571 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:00.592 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:34:00.594 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:00.595 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:34:00.696 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:34:00.726 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:00.746 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:34:00.748 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:00.749 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:34:00.850 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:34:00.879 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:00.889 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:34:00.889 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:34:00.898 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:34:00.901 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:00.902 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:34:01.003 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:34:01.032 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:01.109 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.10 to 1 (10000) 2024-04-01T19:34:01.129 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:34:01.132 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:01.132 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:34:01.233 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:34:01.239 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:01 smithi188 ceph-mon[43939]: osdmap e269: 12 total, 12 up, 12 in 2024-04-01T19:34:01.239 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:01 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3488148971' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T19:34:01.262 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:01.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:01 smithi022 ceph-mon[39439]: osdmap e269: 12 total, 12 up, 12 in 2024-04-01T19:34:01.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:01 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3488148971' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T19:34:01.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:01 smithi062 ceph-mon[44211]: osdmap e269: 12 total, 12 up, 12 in 2024-04-01T19:34:01.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:01 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3488148971' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T19:34:01.610 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:34:01.614 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:01.614 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:34:01.623 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_historic_ops 2024-04-01T19:34:01.715 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:34:01.741 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:01.763 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:34:01.766 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:01.769 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:34:01.871 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:34:01.904 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:01.927 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:34:01.929 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:01.930 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:34:01.931 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:34:02.031 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:34:02.066 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:02.192 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:34:02.195 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:02.195 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:34:02.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:02 smithi062 ceph-mon[44211]: pgmap v784: 17 pgs: 11 active+clean, 6 unknown; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:34:02.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:02 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3488148971' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]': finished 2024-04-01T19:34:02.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:02 smithi062 ceph-mon[44211]: osdmap e270: 12 total, 12 up, 12 in 2024-04-01T19:34:02.297 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:34:02.329 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:02.334 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:02 smithi022 ceph-mon[39439]: pgmap v784: 17 pgs: 11 active+clean, 6 unknown; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:34:02.334 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:02 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3488148971' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]': finished 2024-04-01T19:34:02.334 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:02 smithi022 ceph-mon[39439]: osdmap e270: 12 total, 12 up, 12 in 2024-04-01T19:34:02.352 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:34:02.354 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:02.355 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:34:02.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:02 smithi188 ceph-mon[43939]: pgmap v784: 17 pgs: 11 active+clean, 6 unknown; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:34:02.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:02 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3488148971' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]': finished 2024-04-01T19:34:02.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:02 smithi188 ceph-mon[43939]: osdmap e270: 12 total, 12 up, 12 in 2024-04-01T19:34:02.456 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:34:02.485 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:02.733 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:34:02.735 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:02.736 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:34:02.837 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:34:02.866 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:02.887 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:34:02.890 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:02.890 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:34:02.991 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:34:03.025 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:03.047 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:34:03.050 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:03.050 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:34:03.142 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:03 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1376776891' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:34:03.151 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:34:03.183 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:03.205 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:34:03.206 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:03.207 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:34:03.308 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:34:03.335 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:03 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1376776891' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:34:03.338 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:03.358 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:34:03.360 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:03.361 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:34:03.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:03 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1376776891' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:34:03.461 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:34:03.493 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:03.613 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:34:03.615 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:03.616 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:34:03.637 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 11 1 2024-04-01T19:34:03.714 INFO:teuthology.orchestra.run.smithi022.stderr:enabled application 'rados' on pool 'unique_pool_2' 2024-04-01T19:34:03.717 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:34:03.744 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:03.958 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:34:03.958 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:34:04.321 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:04 smithi188 ceph-mon[43939]: pgmap v786: 17 pgs: 16 active+clean, 1 unknown; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:34:04.321 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:04 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1376776891' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:34:04.321 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:04 smithi188 ceph-mon[43939]: osdmap e271: 12 total, 12 up, 12 in 2024-04-01T19:34:04.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:04 smithi022 ceph-mon[39439]: pgmap v786: 17 pgs: 16 active+clean, 1 unknown; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:34:04.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:04 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1376776891' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:34:04.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:04 smithi022 ceph-mon[39439]: osdmap e271: 12 total, 12 up, 12 in 2024-04-01T19:34:04.434 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:34:04.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:04 smithi062 ceph-mon[44211]: pgmap v786: 17 pgs: 16 active+clean, 1 unknown; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:34:04.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:04 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1376776891' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:34:04.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:04 smithi062 ceph-mon[44211]: osdmap e271: 12 total, 12 up, 12 in 2024-04-01T19:34:04.663 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_ops_in_flight 2024-04-01T19:34:04.894 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:34:04.897 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:04.898 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:34:04.924 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:34:04.999 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:34:05.029 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:05.148 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:34:05.167 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:34:05.187 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:34:05.206 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:34:05.227 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:34:05.228 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:34:05.231 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:05.231 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:34:05.250 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:34:05.269 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:34:05.290 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:34:05.311 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:34:05.331 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:34:05.332 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:34:05.351 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:34:05.361 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:05.372 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:34:05.373 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:34:05.373 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:34:05.374 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:34:05.374 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:34:05.374 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:34:05.374 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:34:05.374 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:34:05.374 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:34:05.374 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:34:05.374 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:34:05.374 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:34:05.374 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:34:05.469 DEBUG:teuthology.orchestra.run.smithi188:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.2 -b 65536 --object-size 65536 -p unique_pool_2 bench 90 write' 2024-04-01T19:34:05.472 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-04-01T19:34:05.472 INFO:teuthology.orchestra.run:waiting for 3000 2024-04-01T19:34:05.484 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:34:05.486 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:05 smithi188 ceph-mon[43939]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T19:34:05.486 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:05 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:34:05.486 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:05 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2530680433' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:34:05.487 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:05.487 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:34:05.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:05 smithi062 ceph-mon[44211]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T19:34:05.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:05 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:34:05.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:05 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2530680433' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:34:05.564 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:hints = 1 2024-04-01T19:34:05.564 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-04-01T19:34:05.564 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Object prefix: benchmark_data_smithi188_104537 2024-04-01T19:34:05.564 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:34:05.564 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 0 0 0 0 0 0 - 0 2024-04-01T19:34:05.588 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:34:05.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:05 smithi022 ceph-mon[39439]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T19:34:05.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:05 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:34:05.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:05 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2530680433' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:34:05.629 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:05.835 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:34:05.838 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:05.839 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:34:05.940 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:34:05.982 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:06.247 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:34:06.441 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:34:06.444 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:06.445 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:34:06.446 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:06 smithi188 ceph-mon[43939]: pgmap v788: 17 pgs: 17 active+clean; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:34:06.446 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.446 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.446 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.446 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.446 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.446 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.446 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.446 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.447 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.447 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.447 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.447 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:06 smithi062 ceph-mon[44211]: pgmap v788: 17 pgs: 17 active+clean; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:34:06.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.545 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:34:06.564 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 1 15 5943 5928 370.472 370.5 0.0027186 0.00269282 2024-04-01T19:34:06.587 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:06.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:06 smithi022 ceph-mon[39439]: pgmap v788: 17 pgs: 17 active+clean; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:34:06.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:06.742 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:34:06.746 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:06.746 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:34:06.847 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:34:06.906 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:06.937 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:34:06.940 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:06.940 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:34:07.041 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:34:07.089 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:07.119 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:34:07.122 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:07.123 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:34:07.126 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:34:07.127 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:34:07.127 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.127 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:8787 4.9 4:9ddd8d3c:::benchmark_data_smithi188_104537_object8786:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e271)", 2024-04-01T19:34:07.127 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:34:07.126357+0000", 2024-04-01T19:34:07.127 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.001564003, 2024-04-01T19:34:07.127 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015975130000000001, 2024-04-01T19:34:07.127 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:34:07.127 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:34:07.127 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:34:07.127 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:34:07.128 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:34:07.128 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:34:07.128 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 8787 2024-04-01T19:34:07.128 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.128 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:34:07.128 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.128 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:34:07.128 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.126357+0000", 2024-04-01T19:34:07.128 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:07.129 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.129 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.129 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:34:07.129 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.126357+0000", 2024-04-01T19:34:07.129 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:07.129 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.129 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.129 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:34:07.129 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.126361+0000", 2024-04-01T19:34:07.129 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2370000000000001e-06 2024-04-01T19:34:07.129 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.129 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.130 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:34:07.130 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.126396+0000", 2024-04-01T19:34:07.130 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4981999999999998e-05 2024-04-01T19:34:07.130 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.130 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.130 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:34:07.130 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.126409+0000", 2024-04-01T19:34:07.130 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3648999999999999e-05 2024-04-01T19:34:07.130 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.130 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.130 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:34:07.131 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.126425+0000", 2024-04-01T19:34:07.131 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6001000000000001e-05 2024-04-01T19:34:07.131 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.131 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.131 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:34:07.131 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.126477+0000", 2024-04-01T19:34:07.131 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2006999999999999e-05 2024-04-01T19:34:07.131 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.131 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.131 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:34:07.131 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.126561+0000", 2024-04-01T19:34:07.131 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3490000000000002e-05 2024-04-01T19:34:07.131 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.132 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.132 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-01T19:34:07.132 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.126696+0000", 2024-04-01T19:34:07.132 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557700000000001 2024-04-01T19:34:07.132 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:07.132 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:34:07.132 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:07.132 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.132 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.132 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:8796 4.1 4:8595758e:::benchmark_data_smithi188_104537_object8795:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e271)", 2024-04-01T19:34:07.132 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:34:07.127205+0000", 2024-04-01T19:34:07.132 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.00071586700000000002, 2024-04-01T19:34:07.133 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085507400000000005, 2024-04-01T19:34:07.133 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:34:07.133 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:34:07.133 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:34:07.133 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:34:07.133 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:34:07.133 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:34:07.133 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 8796 2024-04-01T19:34:07.133 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.133 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:34:07.133 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.133 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:34:07.133 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.127205+0000", 2024-04-01T19:34:07.134 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:07.134 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.134 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.134 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:34:07.134 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.127205+0000", 2024-04-01T19:34:07.134 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:07.134 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.134 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.134 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:34:07.134 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.127207+0000", 2024-04-01T19:34:07.134 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.167e-06 2024-04-01T19:34:07.134 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.134 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.135 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:34:07.135 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.127229+0000", 2024-04-01T19:34:07.135 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2469000000000001e-05 2024-04-01T19:34:07.135 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.135 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.135 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:34:07.135 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.127239+0000", 2024-04-01T19:34:07.135 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8090000000000004e-06 2024-04-01T19:34:07.135 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.135 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.135 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:34:07.136 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.127245+0000", 2024-04-01T19:34:07.136 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9739999999999999e-06 2024-04-01T19:34:07.136 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.136 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.136 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:34:07.136 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.127296+0000", 2024-04-01T19:34:07.136 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0745999999999998e-05 2024-04-01T19:34:07.136 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.136 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.136 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:34:07.136 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.127439+0000", 2024-04-01T19:34:07.136 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000143098 2024-04-01T19:34:07.136 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.136 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.137 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 5", 2024-04-01T19:34:07.137 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.127570+0000", 2024-04-01T19:34:07.137 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013157800000000001 2024-04-01T19:34:07.137 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:07.137 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:34:07.137 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:07.137 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.137 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.137 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:8797 4.9 4:9cc8a7d9:::benchmark_data_smithi188_104537_object8796:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e271)", 2024-04-01T19:34:07.137 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:34:07.127259+0000", 2024-04-01T19:34:07.137 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.00066218199999999998, 2024-04-01T19:34:07.137 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00089425699999999997, 2024-04-01T19:34:07.137 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:34:07.138 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:34:07.138 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:34:07.138 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:34:07.138 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:34:07.138 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:34:07.138 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 8797 2024-04-01T19:34:07.138 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.138 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:34:07.138 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.138 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:34:07.138 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.127259+0000", 2024-04-01T19:34:07.139 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:07.139 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.139 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.139 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:34:07.139 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.127259+0000", 2024-04-01T19:34:07.139 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:07.139 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.139 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.139 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:34:07.139 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.127260+0000", 2024-04-01T19:34:07.140 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7000000000000004e-07 2024-04-01T19:34:07.140 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.140 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.140 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:34:07.140 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.127276+0000", 2024-04-01T19:34:07.140 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5756e-05 2024-04-01T19:34:07.140 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.140 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.140 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:34:07.140 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.127280+0000", 2024-04-01T19:34:07.140 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3139999999999997e-06 2024-04-01T19:34:07.140 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.140 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.140 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:34:07.141 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.127290+0000", 2024-04-01T19:34:07.141 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0243e-05 2024-04-01T19:34:07.141 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.141 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.141 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:34:07.141 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.127329+0000", 2024-04-01T19:34:07.141 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9019e-05 2024-04-01T19:34:07.141 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.141 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.141 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:34:07.141 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.127471+0000", 2024-04-01T19:34:07.141 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014156699999999999 2024-04-01T19:34:07.141 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:07.141 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:07.141 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-01T19:34:07.142 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:34:07.127602+0000", 2024-04-01T19:34:07.142 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000131058 2024-04-01T19:34:07.142 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:07.142 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:34:07.142 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:07.142 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:07.142 INFO:teuthology.orchestra.run.smithi188.stdout: ], 2024-04-01T19:34:07.142 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 3 2024-04-01T19:34:07.142 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:34:07.224 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:34:07.263 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:07.370 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:34:07.374 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:07.374 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:34:07.475 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:34:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:07.546 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:34:07.549 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:07.549 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:34:07.564 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 2 16 11010 10994 343.537 316.625 0.00219711 0.00290579 2024-04-01T19:34:07.650 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:34:07.691 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:07.854 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:34:07.859 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:07.860 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:34:07.906 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_blocked_ops 2024-04-01T19:34:07.961 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:34:08.008 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:08.038 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:34:08.042 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:08.042 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:34:08.143 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:34:08.192 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:08.215 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:34:08.223 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:34:08.228 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:08.229 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:34:08.229 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:08 smithi188 ceph-mon[43939]: pgmap v789: 17 pgs: 17 active+clean; 60 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s wr, 139 op/s 2024-04-01T19:34:08.322 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:34:08.329 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:34:08.365 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:08.392 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:34:08.396 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:08.397 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:34:08.498 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:34:08.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:08 smithi062 ceph-mon[44211]: pgmap v789: 17 pgs: 17 active+clean; 60 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s wr, 139 op/s 2024-04-01T19:34:08.537 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:08.564 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 3 16 15536 15520 323.309 282.875 0.00847419 0.0030905 2024-04-01T19:34:08.564 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:34:08.567 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:08.568 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:34:08.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:08 smithi022 ceph-mon[39439]: pgmap v789: 17 pgs: 17 active+clean; 60 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s wr, 139 op/s 2024-04-01T19:34:08.668 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:34:08.708 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:08.736 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:34:08.740 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:08.740 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:34:08.841 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:34:08.877 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:08.901 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:34:08.904 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:08.904 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:34:08.918 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:34:09.005 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:34:09.036 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:09.064 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:34:09.069 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:09.070 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:34:09.171 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:34:09.190 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:09 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1401209100' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:34:09.205 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:34:09.225 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:09.437 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:34:09.444 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:09.445 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:34:09.445 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:09 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1401209100' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:34:09.546 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:34:09.564 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 4 15 19585 19570 305.745 253.125 0.00281477 0.00326764 2024-04-01T19:34:09.584 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:09.609 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:34:09.612 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:09.612 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:34:09.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:09 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1401209100' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:34:09.713 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:34:09.767 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:10.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:10 smithi062 ceph-mon[44211]: pgmap v790: 17 pgs: 17 active+clean; 195 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s wr, 388 op/s 2024-04-01T19:34:10.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:10 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:34:10.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:10 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1401209100' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:34:10.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:10 smithi062 ceph-mon[44211]: osdmap e272: 12 total, 12 up, 12 in 2024-04-01T19:34:10.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:10 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1685835433' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T19:34:10.566 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 5 16 23854 23838 297.942 266.75 0.00191892 0.00335418 2024-04-01T19:34:10.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:10 smithi022 ceph-mon[39439]: pgmap v790: 17 pgs: 17 active+clean; 195 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s wr, 388 op/s 2024-04-01T19:34:10.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:10 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:34:10.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:10 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1401209100' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:34:10.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:10 smithi022 ceph-mon[39439]: osdmap e272: 12 total, 12 up, 12 in 2024-04-01T19:34:10.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:10 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1685835433' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T19:34:10.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:10 smithi188 ceph-mon[43939]: pgmap v790: 17 pgs: 17 active+clean; 195 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s wr, 388 op/s 2024-04-01T19:34:10.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:10 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:34:10.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:10 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1401209100' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:34:10.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:10 smithi188 ceph-mon[43939]: osdmap e272: 12 total, 12 up, 12 in 2024-04-01T19:34:10.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:10 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1685835433' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T19:34:10.630 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:34:10.637 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:10.637 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:34:10.738 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:34:10.787 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:10.946 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.11 to 1 (10000) 2024-04-01T19:34:11.564 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 6 16 27662 27646 287.948 238 0.00152502 0.00346185 2024-04-01T19:34:12.200 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:11 smithi022 ceph-mon[39439]: pgmap v792: 17 pgs: 17 active+clean; 1015 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 127 MiB/s wr, 2.03k op/s 2024-04-01T19:34:12.200 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:11 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1685835433' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]': finished 2024-04-01T19:34:12.200 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:11 smithi022 ceph-mon[39439]: osdmap e273: 12 total, 12 up, 12 in 2024-04-01T19:34:12.200 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:11 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1786265989' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:34:12.200 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:12.200 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:12.200 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:12.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:11 smithi062 ceph-mon[44211]: pgmap v792: 17 pgs: 17 active+clean; 1015 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 127 MiB/s wr, 2.03k op/s 2024-04-01T19:34:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:11 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1685835433' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]': finished 2024-04-01T19:34:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:11 smithi062 ceph-mon[44211]: osdmap e273: 12 total, 12 up, 12 in 2024-04-01T19:34:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:11 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1786265989' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:34:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:12.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:12.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:11 smithi188 ceph-mon[43939]: pgmap v792: 17 pgs: 17 active+clean; 1015 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 127 MiB/s wr, 2.03k op/s 2024-04-01T19:34:12.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:11 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1685835433' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]': finished 2024-04-01T19:34:12.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:11 smithi188 ceph-mon[43939]: osdmap e273: 12 total, 12 up, 12 in 2024-04-01T19:34:12.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:11 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1786265989' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:34:12.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:12.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:12.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:12.564 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 7 16 30960 30944 276.257 206.125 0.0046081 0.00361821 2024-04-01T19:34:13.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:12 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:34:13.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:12 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:34:13.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:12 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:34:13.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:12 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:34:13.364 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.364 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.364 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.364 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.364 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.364 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.364 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.364 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.364 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:13.364 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:12 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:34:13.364 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:12 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:34:13.458 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:34:13.458 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:34:13.459 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:34:13.459 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:34:13.459 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:34:13.459 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:34:13.459 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:34:13.459 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:34:13.459 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:34:13.459 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:34:13.459 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:34:13.460 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:34:13.460 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:34:13.460 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:34:13.460 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:34:13.460 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:34:13.460 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:34:13.461 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:34:13.461 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:34:13.461 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:34:13.461 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:34:13.461 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:34:13.461 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:34:13.461 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:34:13.566 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 8 16 34541 34525 269.643 223.812 0.00277217 0.00370608 2024-04-01T19:34:13.740 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:34:13.741 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:34:14.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:13 smithi188 ceph-mon[43939]: pgmap v794: 17 pgs: 17 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 178 MiB/s wr, 2.85k op/s 2024-04-01T19:34:14.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:13 smithi188 ceph-mon[43939]: osdmap e274: 12 total, 12 up, 12 in 2024-04-01T19:34:14.246 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:34:14.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:13 smithi062 ceph-mon[44211]: pgmap v794: 17 pgs: 17 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 178 MiB/s wr, 2.85k op/s 2024-04-01T19:34:14.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:13 smithi062 ceph-mon[44211]: osdmap e274: 12 total, 12 up, 12 in 2024-04-01T19:34:14.289 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:13 smithi022 ceph-mon[39439]: pgmap v794: 17 pgs: 17 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 178 MiB/s wr, 2.85k op/s 2024-04-01T19:34:14.290 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:13 smithi022 ceph-mon[39439]: osdmap e274: 12 total, 12 up, 12 in 2024-04-01T19:34:14.567 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 9 16 37519 37503 260.363 186.125 0.00407667 0.00383868 2024-04-01T19:34:14.567 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_historic_ops 2024-04-01T19:34:14.935 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:34:15.567 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 10 15 40375 40360 252.183 178.562 0.00585716 0.00396318 2024-04-01T19:34:16.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:15 smithi062 ceph-mon[44211]: pgmap v796: 17 pgs: 17 active+clean; 1.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 277 MiB/s wr, 4.43k op/s 2024-04-01T19:34:16.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:15 smithi022 ceph-mon[39439]: pgmap v796: 17 pgs: 17 active+clean; 1.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 277 MiB/s wr, 4.43k op/s 2024-04-01T19:34:16.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:15 smithi188 ceph-mon[43939]: pgmap v796: 17 pgs: 17 active+clean; 1.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 277 MiB/s wr, 4.43k op/s 2024-04-01T19:34:16.488 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:34:16.498 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:16.498 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:34:16.569 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 11 16 43315 43299 245.955 183.688 0.00297322 0.00406458 2024-04-01T19:34:16.599 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:34:16.638 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:16.667 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:34:16.670 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:16.671 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:34:16.772 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:34:16.817 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:17.133 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:34:17.133 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:34:17.566 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 12 16 45873 45857 238.782 159.875 0.0048106 0.00418609 2024-04-01T19:34:17.978 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_ops_in_flight 2024-04-01T19:34:18.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:17 smithi062 ceph-mon[44211]: pgmap v797: 17 pgs: 17 active+clean; 2.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 284 MiB/s wr, 4.54k op/s 2024-04-01T19:34:18.352 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:34:18.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:17 smithi022 ceph-mon[39439]: pgmap v797: 17 pgs: 17 active+clean; 2.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 284 MiB/s wr, 4.54k op/s 2024-04-01T19:34:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:17 smithi188 ceph-mon[43939]: pgmap v797: 17 pgs: 17 active+clean; 2.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 284 MiB/s wr, 4.54k op/s 2024-04-01T19:34:18.567 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 13 16 48690 48674 233.957 176.062 0.00480245 0.00427268 2024-04-01T19:34:19.567 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 14 16 51425 51409 229.455 170.938 0.00392236 0.00435587 2024-04-01T19:34:19.682 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:34:19.686 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:19.686 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:34:19.787 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:34:19.828 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:19.855 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:34:19.858 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:19.858 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:34:19.960 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:34:19.966 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:19 smithi022 ceph-mon[39439]: pgmap v798: 17 pgs: 17 active+clean; 2.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 191 MiB/s wr, 3.06k op/s 2024-04-01T19:34:20.000 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:20.109 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:34:20.112 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:19 smithi188 ceph-mon[43939]: pgmap v798: 17 pgs: 17 active+clean; 2.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 191 MiB/s wr, 3.06k op/s 2024-04-01T19:34:20.112 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:20.113 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:34:20.214 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:34:20.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:19 smithi062 ceph-mon[44211]: pgmap v798: 17 pgs: 17 active+clean; 2.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 191 MiB/s wr, 3.06k op/s 2024-04-01T19:34:20.265 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:20.299 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 8 1 2024-04-01T19:34:20.310 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:34:20.315 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:20.315 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:34:20.347 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:34:20.415 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:34:20.451 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:20.477 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:34:20.480 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:20.481 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:34:20.487 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:34:20.487 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:34:20.567 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 15 16 54064 54048 225.148 164.938 0.0118974 0.00444009 2024-04-01T19:34:20.582 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:34:20.626 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:20.731 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:34:20.734 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:20.735 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:34:20.836 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:34:20.879 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:21.231 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_blocked_ops 2024-04-01T19:34:21.234 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:34:21.236 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:21.236 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:34:21.337 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:34:21.375 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:21.403 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:34:21.406 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:21.407 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:34:21.508 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:34:21.550 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:21.567 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 16 16 56630 56614 221.095 160.375 0.00602607 0.00452089 2024-04-01T19:34:21.635 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:34:21.721 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:34:21.727 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:34:21.729 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:21.730 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:34:21.818 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:34:21.830 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:34:21.894 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:22.106 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:34:22.110 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:22.111 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:34:22.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:21 smithi022 ceph-mon[39439]: pgmap v799: 17 pgs: 17 active+clean; 3.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 209 MiB/s wr, 3.34k op/s 2024-04-01T19:34:22.203 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:21 smithi188 ceph-mon[43939]: pgmap v799: 17 pgs: 17 active+clean; 3.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 209 MiB/s wr, 3.34k op/s 2024-04-01T19:34:22.211 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:34:22.251 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:22.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:21 smithi062 ceph-mon[44211]: pgmap v799: 17 pgs: 17 active+clean; 3.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 209 MiB/s wr, 3.34k op/s 2024-04-01T19:34:22.311 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:34:22.316 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:22.316 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:34:22.418 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:34:22.477 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:22.568 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 17 16 58979 58963 216.725 146.812 0.0132911 0.00461184 2024-04-01T19:34:22.648 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:34:22.651 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:22.652 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:34:22.753 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:34:22.789 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:22.998 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:34:23.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:22 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:34:23.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:22 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:34:23.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:22 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/764461857' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:34:23.146 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:34:23.151 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:23.152 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:34:23.253 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:34:23.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:22 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:34:23.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:22 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:34:23.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:22 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/764461857' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:34:23.300 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:23.333 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:34:23.337 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:23.337 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:34:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:34:23.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:22 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:34:23.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:22 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:34:23.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:22 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/764461857' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:34:23.439 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:34:23.482 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:23.513 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:34:23.517 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:23.518 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:34:23.568 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 18 15 61334 61319 212.866 147.25 0.00753154 0.0046964 2024-04-01T19:34:23.619 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:34:23.676 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:23.820 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:34:23.820 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:34:23.885 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:34:23.891 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:23.892 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:34:23.993 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:34:24.033 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:24.112 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:34:24.114 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:23 smithi188 ceph-mon[43939]: pgmap v800: 17 pgs: 17 active+clean; 3.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 192 MiB/s wr, 3.07k op/s 2024-04-01T19:34:24.114 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:23 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:34:24.114 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:23 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/764461857' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:34:24.114 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:23 smithi188 ceph-mon[43939]: osdmap e275: 12 total, 12 up, 12 in 2024-04-01T19:34:24.115 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:24.115 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:34:24.216 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:34:24.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:23 smithi062 ceph-mon[44211]: pgmap v800: 17 pgs: 17 active+clean; 3.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 192 MiB/s wr, 3.07k op/s 2024-04-01T19:34:24.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:23 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:34:24.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:23 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/764461857' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:34:24.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:23 smithi062 ceph-mon[44211]: osdmap e275: 12 total, 12 up, 12 in 2024-04-01T19:34:24.272 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:24.319 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:23 smithi022 ceph-mon[39439]: pgmap v800: 17 pgs: 17 active+clean; 3.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 192 MiB/s wr, 3.07k op/s 2024-04-01T19:34:24.319 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:23 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:34:24.319 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:23 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/764461857' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:34:24.320 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:23 smithi022 ceph-mon[39439]: osdmap e275: 12 total, 12 up, 12 in 2024-04-01T19:34:24.568 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 19 16 63799 63783 209.767 154 0.0082079 0.00476556 2024-04-01T19:34:24.621 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:34:24.626 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:24.627 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:34:24.636 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_historic_ops 2024-04-01T19:34:24.728 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:34:24.769 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:24.800 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:34:24.803 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:24.803 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:34:24.904 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:34:24.948 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:24.976 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:34:24.981 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:24.981 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:34:25.058 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:34:25.058 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:34:25.058 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:34:25.058 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:34:25.058 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:34:25.058 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:24 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:34:25.058 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:24 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:34:25.073 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:34:25.082 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:34:25.128 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:25.256 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:34:25.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:34:25.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:34:25.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:34:25.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:34:25.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:34:25.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:24 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:34:25.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:24 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:34:25.261 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:34:25.261 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:34:25.262 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:34:25.262 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:34:25.262 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:34:25.262 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:24 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:34:25.262 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:24 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:34:25.262 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:25.263 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:34:25.364 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:34:25.406 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:25.437 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:34:25.444 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:25.444 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:34:25.545 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:34:25.568 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:34:25.571085 min lat: 0.00107168 max lat: 0.0942952 avg lat: 0.00484714 2024-04-01T19:34:25.568 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:34:25.568 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 20 16 66013 65997 206.197 138.375 0.00805564 0.00484714 2024-04-01T19:34:25.594 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:26.523 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:34:26.537 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:26 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1999379195' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:34:26.556 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:34:26.566 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:34:26.568 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 21 15 68223 68208 202.959 138.188 0.00290261 0.00492485 2024-04-01T19:34:26.571 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:26.572 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:34:26.588 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:34:26.622 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:34:26.664 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:34:26.672 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:34:26.694 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:34:26.709 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:26.729 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:34:26.738 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:34:26.744 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:26.745 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:34:26.760 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:34:26.789 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:34:26.828 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:34:26.845 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:34:26.862 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:26 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1999379195' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:34:26.865 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:34:26.893 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:34:26.895 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:34:26.895 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:34:26.895 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:34:26.895 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:34:26.895 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:34:26.895 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:34:26.895 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:34:26.895 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:34:26.896 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:34:26.896 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:34:26.896 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:34:26.896 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:34:26.896 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:26.926 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:34:26.929 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:26.930 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:34:27.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:26 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1999379195' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:34:27.031 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:34:27.080 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:27.134 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:34:27.140 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:27.140 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:34:27.241 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:34:27.289 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:27.354 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:34:27.355 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:34:27.355 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:34:27.355 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:34:27.355 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.355 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:148071 3.9 3:99144c84:::benchmark_data_smithi188_92122_object148070:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e219)", 2024-04-01T19:34:27.355 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:15.124459+0000", 2024-04-01T19:34:27.355 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 192.228078474, 2024-04-01T19:34:27.355 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027354364999999999, 2024-04-01T19:34:27.355 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:34:27.355 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:34:27.355 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:27.356 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:34:27.356 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:34:27.356 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:34:27.356 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 148071 2024-04-01T19:34:27.356 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.356 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:34:27.356 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.356 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:34:27.356 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124459+0000", 2024-04-01T19:34:27.356 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.356 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.356 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.356 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:34:27.357 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124459+0000", 2024-04-01T19:34:27.357 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.357 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.357 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.357 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:34:27.357 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124461+0000", 2024-04-01T19:34:27.357 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1069999999999999e-06 2024-04-01T19:34:27.357 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.357 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.357 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:34:27.357 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124482+0000", 2024-04-01T19:34:27.357 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1294e-05 2024-04-01T19:34:27.357 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.358 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.358 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:34:27.358 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124493+0000", 2024-04-01T19:34:27.358 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1246e-05 2024-04-01T19:34:27.358 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.359 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.359 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:34:27.359 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124503+0000", 2024-04-01T19:34:27.359 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0720000000000006e-06 2024-04-01T19:34:27.359 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.359 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.359 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:34:27.359 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.126589+0000", 2024-04-01T19:34:27.359 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0020860169999999999 2024-04-01T19:34:27.359 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.359 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.359 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:34:27.360 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.126723+0000", 2024-04-01T19:34:27.360 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000134136 2024-04-01T19:34:27.360 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.360 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.360 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:34:27.360 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.126876+0000", 2024-04-01T19:34:27.360 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015317099999999999 2024-04-01T19:34:27.360 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.360 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.360 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:34:27.360 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.143003+0000", 2024-04-01T19:34:27.360 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016126939999999999 2024-04-01T19:34:27.360 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.361 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.361 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:34:27.361 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.151716+0000", 2024-04-01T19:34:27.361 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0087129459999999992 2024-04-01T19:34:27.361 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.361 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.361 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:34:27.361 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.151771+0000", 2024-04-01T19:34:27.361 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5503e-05 2024-04-01T19:34:27.361 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.361 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.361 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:34:27.361 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.151813+0000", 2024-04-01T19:34:27.362 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1933e-05 2024-04-01T19:34:27.362 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.362 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:34:27.362 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.362 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.362 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.362 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:148075 3.9 3:9c08ae7a:::benchmark_data_smithi188_92122_object148074:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e219)", 2024-04-01T19:34:27.362 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:15.124595+0000", 2024-04-01T19:34:27.362 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 192.22794206399999, 2024-04-01T19:34:27.362 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027365482, 2024-04-01T19:34:27.362 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:34:27.362 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:34:27.363 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:27.363 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:34:27.363 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:34:27.363 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:34:27.363 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 148075 2024-04-01T19:34:27.363 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.363 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:34:27.363 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.363 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:34:27.363 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124595+0000", 2024-04-01T19:34:27.363 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.363 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.363 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.363 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:34:27.364 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124595+0000", 2024-04-01T19:34:27.364 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.364 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.364 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.364 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:34:27.364 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124602+0000", 2024-04-01T19:34:27.364 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4370000000000004e-06 2024-04-01T19:34:27.364 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.364 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.364 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:34:27.364 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124630+0000", 2024-04-01T19:34:27.364 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8262000000000001e-05 2024-04-01T19:34:27.364 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.365 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.365 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:34:27.365 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124638+0000", 2024-04-01T19:34:27.365 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0099999999999995e-06 2024-04-01T19:34:27.365 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.365 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.365 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:34:27.365 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124644+0000", 2024-04-01T19:34:27.365 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0859999999999998e-06 2024-04-01T19:34:27.365 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.365 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.365 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:34:27.365 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.130698+0000", 2024-04-01T19:34:27.366 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060540189999999999 2024-04-01T19:34:27.366 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.366 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.366 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:34:27.366 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.130853+0000", 2024-04-01T19:34:27.366 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015509399999999999 2024-04-01T19:34:27.366 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.366 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.366 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:34:27.366 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.131009+0000", 2024-04-01T19:34:27.366 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015546099999999999 2024-04-01T19:34:27.366 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.366 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.366 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:34:27.367 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.143011+0000", 2024-04-01T19:34:27.367 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.01200273 2024-04-01T19:34:27.367 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.367 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.367 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:34:27.367 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.151869+0000", 2024-04-01T19:34:27.367 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0088579069999999999 2024-04-01T19:34:27.367 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.367 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.367 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:34:27.367 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.151919+0000", 2024-04-01T19:34:27.367 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9654000000000003e-05 2024-04-01T19:34:27.367 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.368 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.368 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:34:27.368 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.151961+0000", 2024-04-01T19:34:27.368 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1822e-05 2024-04-01T19:34:27.368 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.368 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:34:27.368 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.368 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.368 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.368 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:148078 3.9 3:9a843ce1:::benchmark_data_smithi188_92122_object148077:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e219)", 2024-04-01T19:34:27.368 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:15.124826+0000", 2024-04-01T19:34:27.369 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 192.227711408, 2024-04-01T19:34:27.369 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027264575999999999, 2024-04-01T19:34:27.369 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:34:27.369 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:34:27.369 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:27.369 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:34:27.369 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:34:27.369 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:34:27.369 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 148078 2024-04-01T19:34:27.369 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.369 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:34:27.369 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.369 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:34:27.370 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124826+0000", 2024-04-01T19:34:27.370 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.370 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.370 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.370 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:34:27.370 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124826+0000", 2024-04-01T19:34:27.370 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.370 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.370 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.370 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:34:27.370 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124827+0000", 2024-04-01T19:34:27.370 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2920000000000001e-06 2024-04-01T19:34:27.370 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.371 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.371 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:34:27.371 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124846+0000", 2024-04-01T19:34:27.371 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8423e-05 2024-04-01T19:34:27.371 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.371 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.371 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:34:27.371 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124853+0000", 2024-04-01T19:34:27.371 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0729999999999999e-06 2024-04-01T19:34:27.371 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.371 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.371 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:34:27.372 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124865+0000", 2024-04-01T19:34:27.372 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2262000000000001e-05 2024-04-01T19:34:27.372 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.372 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.372 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:34:27.372 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.134963+0000", 2024-04-01T19:34:27.372 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.01009839 2024-04-01T19:34:27.372 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.372 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.372 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:34:27.372 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.135108+0000", 2024-04-01T19:34:27.372 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000144606 2024-04-01T19:34:27.373 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.373 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.373 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:34:27.373 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.135266+0000", 2024-04-01T19:34:27.373 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000158412 2024-04-01T19:34:27.373 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.373 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.373 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:34:27.373 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.143110+0000", 2024-04-01T19:34:27.373 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0078440550000000008 2024-04-01T19:34:27.373 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.373 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.373 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:34:27.373 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.152013+0000", 2024-04-01T19:34:27.374 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0089021299999999994 2024-04-01T19:34:27.374 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.374 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.374 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:34:27.374 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.152054+0000", 2024-04-01T19:34:27.374 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1436000000000001e-05 2024-04-01T19:34:27.374 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.374 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.374 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:34:27.374 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.152090+0000", 2024-04-01T19:34:27.374 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6497e-05 2024-04-01T19:34:27.374 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.374 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:34:27.375 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.375 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.375 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.375 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:163103 3.9 3:9d8f00c2:::benchmark_data_smithi188_92122_object163102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e224)", 2024-04-01T19:34:27.375 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:28.265835+0000", 2024-04-01T19:34:27.375 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 179.08670276399999, 2024-04-01T19:34:27.375 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029696488, 2024-04-01T19:34:27.375 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:34:27.375 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:34:27.375 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:27.375 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:34:27.375 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:34:27.375 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:34:27.375 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 163103 2024-04-01T19:34:27.376 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.376 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:34:27.376 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.376 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:34:27.376 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.265835+0000", 2024-04-01T19:34:27.376 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.376 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.376 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.376 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:34:27.376 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.265835+0000", 2024-04-01T19:34:27.376 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.376 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.376 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.376 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:34:27.377 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.265835+0000", 2024-04-01T19:34:27.377 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5000000000000002e-07 2024-04-01T19:34:27.377 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.377 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.377 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:34:27.377 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.265854+0000", 2024-04-01T19:34:27.377 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8678e-05 2024-04-01T19:34:27.377 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.377 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.377 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:34:27.377 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.265860+0000", 2024-04-01T19:34:27.377 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3439999999999997e-06 2024-04-01T19:34:27.377 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.377 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.378 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:34:27.378 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.265866+0000", 2024-04-01T19:34:27.378 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6760000000000004e-06 2024-04-01T19:34:27.378 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.378 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.378 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:34:27.378 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.270474+0000", 2024-04-01T19:34:27.378 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.004608043 2024-04-01T19:34:27.378 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.378 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.378 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:34:27.378 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.270623+0000", 2024-04-01T19:34:27.378 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014932199999999999 2024-04-01T19:34:27.378 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.379 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.379 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:34:27.379 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.270786+0000", 2024-04-01T19:34:27.379 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016298500000000001 2024-04-01T19:34:27.379 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.379 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.379 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:34:27.379 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.283776+0000", 2024-04-01T19:34:27.379 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012989877 2024-04-01T19:34:27.379 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.379 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.379 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:34:27.379 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.295416+0000", 2024-04-01T19:34:27.379 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011639943 2024-04-01T19:34:27.380 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.380 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.380 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:34:27.380 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.295477+0000", 2024-04-01T19:34:27.380 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1156999999999997e-05 2024-04-01T19:34:27.380 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.380 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.380 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:34:27.380 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.295531+0000", 2024-04-01T19:34:27.380 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3813000000000001e-05 2024-04-01T19:34:27.380 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.380 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:34:27.380 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.380 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.380 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.380 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:163105 3.9 3:9ddc7cf3:::benchmark_data_smithi188_92122_object163104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e224)", 2024-04-01T19:34:27.381 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:28.266122+0000", 2024-04-01T19:34:27.381 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 179.08641503800001, 2024-04-01T19:34:27.381 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029525068000000002, 2024-04-01T19:34:27.381 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:34:27.381 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:34:27.381 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:27.381 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:34:27.381 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:34:27.381 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:34:27.381 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 163105 2024-04-01T19:34:27.381 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.381 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:34:27.381 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.381 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:34:27.382 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.266122+0000", 2024-04-01T19:34:27.382 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.382 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.382 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.382 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:34:27.382 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.266122+0000", 2024-04-01T19:34:27.382 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.382 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.382 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.382 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:34:27.382 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.266123+0000", 2024-04-01T19:34:27.382 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.257e-06 2024-04-01T19:34:27.382 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.383 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.383 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:34:27.383 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.266146+0000", 2024-04-01T19:34:27.383 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.26e-05 2024-04-01T19:34:27.383 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.383 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.383 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:34:27.383 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.266155+0000", 2024-04-01T19:34:27.383 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8910000000000001e-06 2024-04-01T19:34:27.383 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.383 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.383 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:34:27.383 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.266162+0000", 2024-04-01T19:34:27.383 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6789999999999999e-06 2024-04-01T19:34:27.383 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.383 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.384 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:34:27.384 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.274857+0000", 2024-04-01T19:34:27.384 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0086949509999999994 2024-04-01T19:34:27.384 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.384 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.384 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:34:27.384 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.275007+0000", 2024-04-01T19:34:27.384 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015065599999999999 2024-04-01T19:34:27.384 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.384 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.384 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:34:27.384 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.275172+0000", 2024-04-01T19:34:27.384 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016463 2024-04-01T19:34:27.384 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.385 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.385 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:34:27.385 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.283784+0000", 2024-04-01T19:34:27.385 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0086125860000000002 2024-04-01T19:34:27.385 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.385 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.385 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:34:27.385 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.295569+0000", 2024-04-01T19:34:27.385 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011784559999999999 2024-04-01T19:34:27.385 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.385 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.385 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:34:27.385 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.295616+0000", 2024-04-01T19:34:27.385 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6582000000000002e-05 2024-04-01T19:34:27.385 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.385 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.386 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:34:27.386 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.295647+0000", 2024-04-01T19:34:27.386 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1676e-05 2024-04-01T19:34:27.386 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.386 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:34:27.386 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.386 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.386 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.386 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:168901 3.9 3:9a790eaf:::benchmark_data_smithi188_92122_object3310:head [delete] snapc 0=[] ondisk+write+known_if_redirected e226)", 2024-04-01T19:34:27.386 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:33.240638+0000", 2024-04-01T19:34:27.386 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 174.11189953900001, 2024-04-01T19:34:27.386 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034426845999999997, 2024-04-01T19:34:27.387 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:34:27.387 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:34:27.387 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:27.387 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:34:27.387 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:34:27.387 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:34:27.387 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 168901 2024-04-01T19:34:27.387 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.387 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:34:27.387 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.387 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:34:27.387 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240638+0000", 2024-04-01T19:34:27.387 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.387 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.388 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.388 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:34:27.388 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240638+0000", 2024-04-01T19:34:27.388 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.388 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.388 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.388 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:34:27.388 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240640+0000", 2024-04-01T19:34:27.388 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.429e-06 2024-04-01T19:34:27.388 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.388 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.388 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:34:27.388 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240646+0000", 2024-04-01T19:34:27.389 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5219999999999998e-06 2024-04-01T19:34:27.389 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.389 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.389 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:34:27.389 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240656+0000", 2024-04-01T19:34:27.389 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0791000000000001e-05 2024-04-01T19:34:27.389 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.389 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.389 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:34:27.389 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240665+0000", 2024-04-01T19:34:27.389 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6260000000000001e-06 2024-04-01T19:34:27.389 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.389 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.390 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:34:27.390 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240747+0000", 2024-04-01T19:34:27.390 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1833000000000001e-05 2024-04-01T19:34:27.390 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.390 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.390 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:34:27.390 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240873+0000", 2024-04-01T19:34:27.390 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000126203 2024-04-01T19:34:27.390 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.390 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.390 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:34:27.390 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240997+0000", 2024-04-01T19:34:27.391 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000124108 2024-04-01T19:34:27.391 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.391 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.391 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:34:27.391 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.247758+0000", 2024-04-01T19:34:27.391 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067612319999999998 2024-04-01T19:34:27.391 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.391 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.391 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:34:27.391 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.274954+0000", 2024-04-01T19:34:27.391 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027195286999999999 2024-04-01T19:34:27.391 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.391 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.391 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:34:27.392 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.275014+0000", 2024-04-01T19:34:27.392 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0677000000000002e-05 2024-04-01T19:34:27.392 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.392 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.392 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:34:27.392 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.275065+0000", 2024-04-01T19:34:27.392 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0138e-05 2024-04-01T19:34:27.392 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.392 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:34:27.392 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.392 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.392 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.392 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:168902 3.9 3:9c3bc715:::benchmark_data_smithi188_92122_object3311:head [delete] snapc 0=[] ondisk+write+known_if_redirected e226)", 2024-04-01T19:34:27.393 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:33.240687+0000", 2024-04-01T19:34:27.393 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 174.111849831, 2024-04-01T19:34:27.393 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034487716000000002, 2024-04-01T19:34:27.393 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:34:27.393 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:34:27.393 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:27.393 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:34:27.393 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:34:27.393 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:34:27.393 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 168902 2024-04-01T19:34:27.393 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.393 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:34:27.393 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.393 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:34:27.393 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240687+0000", 2024-04-01T19:34:27.394 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.394 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.394 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.394 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:34:27.394 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240687+0000", 2024-04-01T19:34:27.394 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.394 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.394 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.394 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:34:27.394 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240688+0000", 2024-04-01T19:34:27.394 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1399999999999996e-07 2024-04-01T19:34:27.394 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.394 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.394 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:34:27.395 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240691+0000", 2024-04-01T19:34:27.395 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.824e-06 2024-04-01T19:34:27.395 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.395 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.395 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:34:27.395 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240697+0000", 2024-04-01T19:34:27.395 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4210000000000003e-06 2024-04-01T19:34:27.395 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.395 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.395 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:34:27.395 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240702+0000", 2024-04-01T19:34:27.395 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9889999999999997e-06 2024-04-01T19:34:27.395 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.395 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.396 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:34:27.396 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.244160+0000", 2024-04-01T19:34:27.396 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0034571820000000001 2024-04-01T19:34:27.396 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.396 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.396 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:34:27.396 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.244289+0000", 2024-04-01T19:34:27.396 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012960099999999999 2024-04-01T19:34:27.396 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.396 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.396 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:34:27.396 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.244434+0000", 2024-04-01T19:34:27.396 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014468 2024-04-01T19:34:27.396 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.396 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.397 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:34:27.397 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.256089+0000", 2024-04-01T19:34:27.397 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011655522999999999 2024-04-01T19:34:27.397 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.397 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.397 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:34:27.397 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.275101+0000", 2024-04-01T19:34:27.397 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019011954000000001 2024-04-01T19:34:27.397 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.397 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.397 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:34:27.397 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.275142+0000", 2024-04-01T19:34:27.397 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0465e-05 2024-04-01T19:34:27.397 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.397 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.398 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:34:27.398 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.275175+0000", 2024-04-01T19:34:27.398 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3263000000000003e-05 2024-04-01T19:34:27.398 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.398 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:34:27.398 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.398 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.398 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.398 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:168903 3.9 3:9ad3f095:::benchmark_data_smithi188_92122_object3312:head [delete] snapc 0=[] ondisk+write+known_if_redirected e226)", 2024-04-01T19:34:27.398 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:33.245855+0000", 2024-04-01T19:34:27.398 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 174.10668228, 2024-04-01T19:34:27.398 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029426130000000002, 2024-04-01T19:34:27.398 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:34:27.399 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:34:27.399 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:27.399 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:34:27.399 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:34:27.399 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:34:27.399 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 168903 2024-04-01T19:34:27.399 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.399 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:34:27.399 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.399 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:34:27.399 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.245855+0000", 2024-04-01T19:34:27.399 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.399 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.400 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.400 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:34:27.400 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.245855+0000", 2024-04-01T19:34:27.400 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.400 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.400 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.400 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:34:27.400 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.245858+0000", 2024-04-01T19:34:27.400 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7010000000000001e-06 2024-04-01T19:34:27.400 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.400 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.400 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:34:27.401 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.245865+0000", 2024-04-01T19:34:27.401 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9e-06 2024-04-01T19:34:27.401 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.401 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.401 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:34:27.401 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.245880+0000", 2024-04-01T19:34:27.401 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5534000000000001e-05 2024-04-01T19:34:27.401 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.401 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.401 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:34:27.401 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.245890+0000", 2024-04-01T19:34:27.401 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7240000000000004e-06 2024-04-01T19:34:27.401 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.401 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.402 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:34:27.402 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.247793+0000", 2024-04-01T19:34:27.402 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0019034849999999999 2024-04-01T19:34:27.402 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.402 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.402 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:34:27.402 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.247909+0000", 2024-04-01T19:34:27.402 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000115463 2024-04-01T19:34:27.402 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.402 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.402 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:34:27.402 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.248024+0000", 2024-04-01T19:34:27.403 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000115439 2024-04-01T19:34:27.403 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.403 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.403 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:34:27.403 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.260247+0000", 2024-04-01T19:34:27.403 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012222749999999999 2024-04-01T19:34:27.403 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.403 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.403 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:34:27.403 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.275208+0000", 2024-04-01T19:34:27.403 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014960588 2024-04-01T19:34:27.403 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.403 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.403 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:34:27.404 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.275247+0000", 2024-04-01T19:34:27.404 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9628000000000001e-05 2024-04-01T19:34:27.404 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.404 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.404 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:34:27.404 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.275281+0000", 2024-04-01T19:34:27.404 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3918000000000003e-05 2024-04-01T19:34:27.404 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.404 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:34:27.404 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.404 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.404 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.404 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:168904 3.9 3:90476aec:::benchmark_data_smithi188_92122_object3313:head [delete] snapc 0=[] ondisk+write+known_if_redirected e226)", 2024-04-01T19:34:27.404 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:33.247843+0000", 2024-04-01T19:34:27.404 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 174.104693948, 2024-04-01T19:34:27.404 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027547312000000001, 2024-04-01T19:34:27.405 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:34:27.405 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:34:27.405 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:27.405 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:34:27.405 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:34:27.405 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:34:27.405 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 168904 2024-04-01T19:34:27.405 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.405 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:34:27.405 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.405 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:34:27.405 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.247843+0000", 2024-04-01T19:34:27.405 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.405 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.406 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.406 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:34:27.406 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.247843+0000", 2024-04-01T19:34:27.406 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.406 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.406 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.406 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:34:27.406 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.247845+0000", 2024-04-01T19:34:27.406 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4279999999999999e-06 2024-04-01T19:34:27.406 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.406 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.406 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:34:27.406 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.247851+0000", 2024-04-01T19:34:27.407 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8680000000000004e-06 2024-04-01T19:34:27.407 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.407 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.407 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:34:27.407 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.247859+0000", 2024-04-01T19:34:27.407 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2649999999999996e-06 2024-04-01T19:34:27.407 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.407 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.407 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:34:27.407 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.247867+0000", 2024-04-01T19:34:27.407 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1289999999999996e-06 2024-04-01T19:34:27.407 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.408 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.408 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:34:27.408 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.252198+0000", 2024-04-01T19:34:27.408 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0043308679999999999 2024-04-01T19:34:27.408 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.408 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.408 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:34:27.408 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.252300+0000", 2024-04-01T19:34:27.408 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000102105 2024-04-01T19:34:27.408 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.408 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.408 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:34:27.408 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.252389+0000", 2024-04-01T19:34:27.409 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8980999999999994e-05 2024-04-01T19:34:27.409 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.409 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.409 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:34:27.409 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.260252+0000", 2024-04-01T19:34:27.409 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0078629990000000007 2024-04-01T19:34:27.409 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.409 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.409 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:34:27.409 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.275314+0000", 2024-04-01T19:34:27.409 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015061779000000001 2024-04-01T19:34:27.409 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.409 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.409 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:34:27.410 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.275359+0000", 2024-04-01T19:34:27.410 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5666e-05 2024-04-01T19:34:27.410 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.410 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.410 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:34:27.410 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.275391+0000", 2024-04-01T19:34:27.410 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1223999999999998e-05 2024-04-01T19:34:27.410 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.410 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:34:27.410 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.410 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.410 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.411 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:172598 3.9 3:9cf4f1c3:::benchmark_data_smithi188_92122_object7007:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-04-01T19:34:27.411 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:36.272444+0000", 2024-04-01T19:34:27.411 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 171.08009359799999, 2024-04-01T19:34:27.411 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.032034100000000003, 2024-04-01T19:34:27.411 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:34:27.411 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:34:27.411 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:27.411 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:34:27.411 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:34:27.411 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:34:27.411 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 172598 2024-04-01T19:34:27.411 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.411 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:34:27.411 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.412 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:34:27.412 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.272444+0000", 2024-04-01T19:34:27.412 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.412 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.412 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.412 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:34:27.412 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.272444+0000", 2024-04-01T19:34:27.412 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.412 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.412 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.412 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:34:27.412 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.272445+0000", 2024-04-01T19:34:27.412 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.578e-06 2024-04-01T19:34:27.412 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.412 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.413 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:34:27.413 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.272450+0000", 2024-04-01T19:34:27.413 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0019999999999997e-06 2024-04-01T19:34:27.413 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.413 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.413 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:34:27.413 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.272462+0000", 2024-04-01T19:34:27.413 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1357e-05 2024-04-01T19:34:27.413 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.413 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.413 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:34:27.413 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.272469+0000", 2024-04-01T19:34:27.413 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.357e-06 2024-04-01T19:34:27.414 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.414 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.414 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:34:27.414 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.274667+0000", 2024-04-01T19:34:27.414 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0021985070000000002 2024-04-01T19:34:27.414 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.414 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.414 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:34:27.414 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.274791+0000", 2024-04-01T19:34:27.414 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012366800000000001 2024-04-01T19:34:27.414 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.414 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.414 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:34:27.415 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.274917+0000", 2024-04-01T19:34:27.415 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012541700000000001 2024-04-01T19:34:27.415 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.415 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.415 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:34:27.415 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.289080+0000", 2024-04-01T19:34:27.415 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014163904999999999 2024-04-01T19:34:27.415 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.415 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.415 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:34:27.415 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.304382+0000", 2024-04-01T19:34:27.415 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015301248 2024-04-01T19:34:27.415 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.415 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.416 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:34:27.416 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.304440+0000", 2024-04-01T19:34:27.416 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8087000000000001e-05 2024-04-01T19:34:27.416 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.416 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.416 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:34:27.416 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.304478+0000", 2024-04-01T19:34:27.416 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7973999999999999e-05 2024-04-01T19:34:27.416 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.416 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:34:27.416 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.416 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.417 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.417 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:172599 3.9 3:97be2d43:::benchmark_data_smithi188_92122_object7008:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-04-01T19:34:27.417 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:36.272484+0000", 2024-04-01T19:34:27.417 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 171.080052962, 2024-04-01T19:34:27.417 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.032104537000000002, 2024-04-01T19:34:27.417 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:34:27.417 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:34:27.417 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:27.417 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:34:27.417 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:34:27.417 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:34:27.417 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 172599 2024-04-01T19:34:27.417 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.418 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:34:27.418 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.418 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:34:27.418 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.272484+0000", 2024-04-01T19:34:27.418 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.418 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.418 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.418 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:34:27.418 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.272484+0000", 2024-04-01T19:34:27.418 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.418 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.418 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.419 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:34:27.419 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.272485+0000", 2024-04-01T19:34:27.419 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.44e-07 2024-04-01T19:34:27.419 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.419 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.419 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:34:27.419 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.272488+0000", 2024-04-01T19:34:27.419 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6170000000000001e-06 2024-04-01T19:34:27.419 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.419 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.419 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:34:27.419 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.272493+0000", 2024-04-01T19:34:27.419 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4020000000000001e-06 2024-04-01T19:34:27.420 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.420 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.420 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:34:27.420 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.272498+0000", 2024-04-01T19:34:27.420 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0039999999999999e-06 2024-04-01T19:34:27.420 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.420 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.420 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:34:27.420 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.278534+0000", 2024-04-01T19:34:27.420 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006036451 2024-04-01T19:34:27.420 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.420 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.420 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:34:27.420 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.278642+0000", 2024-04-01T19:34:27.421 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000107632 2024-04-01T19:34:27.421 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.421 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.421 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:34:27.421 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.278753+0000", 2024-04-01T19:34:27.421 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011083500000000001 2024-04-01T19:34:27.421 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.421 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.421 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:34:27.421 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.289088+0000", 2024-04-01T19:34:27.421 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010334826 2024-04-01T19:34:27.421 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.421 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.421 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:34:27.422 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.304525+0000", 2024-04-01T19:34:27.422 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015437288 2024-04-01T19:34:27.422 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.422 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.422 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:34:27.422 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.304554+0000", 2024-04-01T19:34:27.422 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8683999999999998e-05 2024-04-01T19:34:27.422 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.422 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.422 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:34:27.422 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.304589+0000", 2024-04-01T19:34:27.422 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5154000000000003e-05 2024-04-01T19:34:27.422 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.423 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:34:27.423 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.423 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.423 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.423 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:172604 3.9 3:927c03aa:::benchmark_data_smithi188_92122_object7013:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-04-01T19:34:27.423 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:36.277529+0000", 2024-04-01T19:34:27.423 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 171.07500870699999, 2024-04-01T19:34:27.423 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029372993999999999, 2024-04-01T19:34:27.423 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:34:27.423 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:34:27.423 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:27.423 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:34:27.423 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:34:27.423 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:34:27.424 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 172604 2024-04-01T19:34:27.424 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.424 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:34:27.424 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.424 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:34:27.424 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.277529+0000", 2024-04-01T19:34:27.424 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.424 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.424 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.424 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:34:27.424 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.277529+0000", 2024-04-01T19:34:27.424 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.424 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.424 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.425 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:34:27.425 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.277531+0000", 2024-04-01T19:34:27.425 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.429e-06 2024-04-01T19:34:27.425 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.425 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.425 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:34:27.425 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.277538+0000", 2024-04-01T19:34:27.425 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1829999999999997e-06 2024-04-01T19:34:27.425 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.425 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.425 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:34:27.425 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.277551+0000", 2024-04-01T19:34:27.425 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2541000000000001e-05 2024-04-01T19:34:27.425 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.426 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.426 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:34:27.426 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.277558+0000", 2024-04-01T19:34:27.426 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5159999999999997e-06 2024-04-01T19:34:27.426 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.426 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.426 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:34:27.426 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.282682+0000", 2024-04-01T19:34:27.426 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0051240039999999997 2024-04-01T19:34:27.426 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.426 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.426 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:34:27.426 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.282765+0000", 2024-04-01T19:34:27.426 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2850999999999997e-05 2024-04-01T19:34:27.427 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.427 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.427 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:34:27.427 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.282883+0000", 2024-04-01T19:34:27.427 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011825 2024-04-01T19:34:27.427 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.427 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.427 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:34:27.427 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.292783+0000", 2024-04-01T19:34:27.427 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0098992799999999999 2024-04-01T19:34:27.427 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.427 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.427 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:34:27.427 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.306811+0000", 2024-04-01T19:34:27.428 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014028250000000001 2024-04-01T19:34:27.428 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.428 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.428 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:34:27.428 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.306861+0000", 2024-04-01T19:34:27.428 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0501999999999999e-05 2024-04-01T19:34:27.428 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.428 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.428 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:34:27.428 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.306902+0000", 2024-04-01T19:34:27.428 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0188000000000002e-05 2024-04-01T19:34:27.428 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.428 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:34:27.429 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.429 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.429 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.429 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:172616 3.9 3:933f80de:::benchmark_data_smithi188_92122_object7025:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-04-01T19:34:27.429 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:36.288390+0000", 2024-04-01T19:34:27.429 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 171.06414708, 2024-04-01T19:34:27.429 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029023908000000001, 2024-04-01T19:34:27.429 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:34:27.429 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:34:27.429 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:27.429 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:34:27.429 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:34:27.430 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:34:27.430 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 172616 2024-04-01T19:34:27.430 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.430 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:34:27.430 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.430 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:34:27.430 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.288390+0000", 2024-04-01T19:34:27.430 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.430 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.430 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.430 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:34:27.430 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.288390+0000", 2024-04-01T19:34:27.430 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.431 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.431 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.431 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:34:27.431 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.288392+0000", 2024-04-01T19:34:27.431 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1969999999999999e-06 2024-04-01T19:34:27.431 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.431 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.431 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:34:27.431 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.288399+0000", 2024-04-01T19:34:27.431 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1469999999999998e-06 2024-04-01T19:34:27.431 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.431 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.431 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:34:27.431 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.288412+0000", 2024-04-01T19:34:27.432 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3237999999999999e-05 2024-04-01T19:34:27.432 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.432 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.432 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:34:27.432 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.288419+0000", 2024-04-01T19:34:27.432 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6990000000000003e-06 2024-04-01T19:34:27.432 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.432 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.432 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:34:27.432 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.289118+0000", 2024-04-01T19:34:27.432 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00069862799999999997 2024-04-01T19:34:27.432 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.433 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.433 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:34:27.433 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.289245+0000", 2024-04-01T19:34:27.433 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012723899999999999 2024-04-01T19:34:27.433 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.433 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.433 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:34:27.433 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.289380+0000", 2024-04-01T19:34:27.433 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013506100000000001 2024-04-01T19:34:27.433 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.433 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.433 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:34:27.434 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.300775+0000", 2024-04-01T19:34:27.434 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011394757 2024-04-01T19:34:27.434 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.434 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.434 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:34:27.434 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.317302+0000", 2024-04-01T19:34:27.434 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016526948999999999 2024-04-01T19:34:27.434 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.434 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.434 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:34:27.434 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.317367+0000", 2024-04-01T19:34:27.434 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4976999999999998e-05 2024-04-01T19:34:27.434 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.434 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.435 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:34:27.435 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.317414+0000", 2024-04-01T19:34:27.435 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7015999999999998e-05 2024-04-01T19:34:27.435 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.435 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:34:27.435 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.435 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.435 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.435 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:172618 3.9 3:97819161:::benchmark_data_smithi188_92122_object7027:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-04-01T19:34:27.435 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:36.288595+0000", 2024-04-01T19:34:27.435 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 171.06394259300001, 2024-04-01T19:34:27.435 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031716123999999998, 2024-04-01T19:34:27.435 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:34:27.435 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:34:27.436 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:27.436 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:34:27.436 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:34:27.436 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:34:27.436 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 172618 2024-04-01T19:34:27.436 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.436 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:34:27.436 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.436 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:34:27.436 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.288595+0000", 2024-04-01T19:34:27.436 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.436 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.436 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.436 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:34:27.437 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.288595+0000", 2024-04-01T19:34:27.437 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.437 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.437 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.437 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:34:27.437 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.288596+0000", 2024-04-01T19:34:27.437 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1299999999999998e-07 2024-04-01T19:34:27.437 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.437 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.437 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:34:27.437 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.288599+0000", 2024-04-01T19:34:27.437 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5889999999999999e-06 2024-04-01T19:34:27.437 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.437 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.437 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:34:27.438 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.288607+0000", 2024-04-01T19:34:27.438 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1110000000000008e-06 2024-04-01T19:34:27.438 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.438 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.438 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:34:27.438 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.288613+0000", 2024-04-01T19:34:27.438 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8579999999999996e-06 2024-04-01T19:34:27.438 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.438 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.438 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:34:27.438 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.292831+0000", 2024-04-01T19:34:27.438 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0042178090000000003 2024-04-01T19:34:27.438 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.438 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.439 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:34:27.439 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.292946+0000", 2024-04-01T19:34:27.439 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000114683 2024-04-01T19:34:27.439 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.439 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.439 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:34:27.439 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.293015+0000", 2024-04-01T19:34:27.439 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8924999999999995e-05 2024-04-01T19:34:27.439 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.439 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.439 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:34:27.439 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.300780+0000", 2024-04-01T19:34:27.439 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077651810000000003 2024-04-01T19:34:27.439 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.439 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.440 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:34:27.440 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.320231+0000", 2024-04-01T19:34:27.440 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019451428 2024-04-01T19:34:27.440 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.440 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.440 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:34:27.440 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.320278+0000", 2024-04-01T19:34:27.440 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6477000000000002e-05 2024-04-01T19:34:27.440 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.440 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.440 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:34:27.440 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.320311+0000", 2024-04-01T19:34:27.440 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3149999999999999e-05 2024-04-01T19:34:27.440 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.441 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:34:27.441 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.441 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.441 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.441 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:172621 3.9 3:944d919c:::benchmark_data_smithi188_92122_object7030:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-04-01T19:34:27.441 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:36.292038+0000", 2024-04-01T19:34:27.441 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 171.060499311, 2024-04-01T19:34:27.441 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028436669000000001, 2024-04-01T19:34:27.441 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:34:27.441 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:34:27.441 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:27.441 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:34:27.441 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:34:27.441 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:34:27.442 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 172621 2024-04-01T19:34:27.442 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.442 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:34:27.442 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.442 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:34:27.442 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.292038+0000", 2024-04-01T19:34:27.442 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.442 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.442 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.442 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:34:27.442 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.292038+0000", 2024-04-01T19:34:27.442 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.442 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.443 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.443 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:34:27.443 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.292040+0000", 2024-04-01T19:34:27.443 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.731e-06 2024-04-01T19:34:27.443 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.443 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.443 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:34:27.443 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.292045+0000", 2024-04-01T19:34:27.443 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4349999999999996e-06 2024-04-01T19:34:27.443 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.443 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.443 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:34:27.443 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.292056+0000", 2024-04-01T19:34:27.443 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1325000000000001e-05 2024-04-01T19:34:27.444 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.444 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.444 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:34:27.444 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.292063+0000", 2024-04-01T19:34:27.444 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2790000000000004e-06 2024-04-01T19:34:27.444 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.444 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.444 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:34:27.444 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.296540+0000", 2024-04-01T19:34:27.444 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0044769759999999997 2024-04-01T19:34:27.444 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.444 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.444 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:34:27.444 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.296663+0000", 2024-04-01T19:34:27.445 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012368200000000001 2024-04-01T19:34:27.445 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.445 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:34:27.445 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.296800+0000", 2024-04-01T19:34:27.445 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000136327 2024-04-01T19:34:27.445 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.445 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:34:27.445 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.304491+0000", 2024-04-01T19:34:27.445 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076913110000000002 2024-04-01T19:34:27.445 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.445 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:34:27.445 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.320378+0000", 2024-04-01T19:34:27.446 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015886498999999998 2024-04-01T19:34:27.446 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.446 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.446 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:34:27.446 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.320429+0000", 2024-04-01T19:34:27.446 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1873999999999998e-05 2024-04-01T19:34:27.446 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.446 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.446 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:34:27.446 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.320475+0000", 2024-04-01T19:34:27.446 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5229999999999999e-05 2024-04-01T19:34:27.446 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.446 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:34:27.446 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.447 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.447 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.447 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:206792 3.9 3:9697cd20:::benchmark_data_smithi188_92122_object41201:head [delete] snapc 0=[] ondisk+write+known_if_redirected e233)", 2024-04-01T19:34:27.447 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:32:03.257189+0000", 2024-04-01T19:34:27.447 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 144.09534818500001, 2024-04-01T19:34:27.447 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029571714999999998, 2024-04-01T19:34:27.447 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:34:27.447 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:34:27.447 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:27.447 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:34:27.447 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:34:27.447 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:34:27.447 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 206792 2024-04-01T19:34:27.447 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.447 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:34:27.448 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.448 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:34:27.448 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257189+0000", 2024-04-01T19:34:27.448 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.448 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.448 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.448 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:34:27.448 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257189+0000", 2024-04-01T19:34:27.448 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.448 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.448 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.448 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:34:27.448 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257191+0000", 2024-04-01T19:34:27.449 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9460000000000001e-06 2024-04-01T19:34:27.449 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.449 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.449 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:34:27.449 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257196+0000", 2024-04-01T19:34:27.449 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3319999999999999e-06 2024-04-01T19:34:27.449 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.449 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.449 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:34:27.449 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257209+0000", 2024-04-01T19:34:27.449 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2907e-05 2024-04-01T19:34:27.449 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.449 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.449 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:34:27.450 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257228+0000", 2024-04-01T19:34:27.450 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8904999999999999e-05 2024-04-01T19:34:27.450 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.450 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.450 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:34:27.450 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257327+0000", 2024-04-01T19:34:27.450 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8431999999999995e-05 2024-04-01T19:34:27.450 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.450 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.450 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:34:27.450 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257440+0000", 2024-04-01T19:34:27.450 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000113812 2024-04-01T19:34:27.450 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.450 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.451 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:34:27.451 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257544+0000", 2024-04-01T19:34:27.451 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010329 2024-04-01T19:34:27.451 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.451 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.451 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:34:27.451 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.265602+0000", 2024-04-01T19:34:27.451 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080578430000000003 2024-04-01T19:34:27.451 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.451 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.451 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:34:27.451 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.286665+0000", 2024-04-01T19:34:27.451 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.021063620000000002 2024-04-01T19:34:27.451 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.451 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.452 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:34:27.452 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.286714+0000", 2024-04-01T19:34:27.452 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9288e-05 2024-04-01T19:34:27.452 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.452 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.452 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:34:27.452 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.286761+0000", 2024-04-01T19:34:27.452 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.634e-05 2024-04-01T19:34:27.452 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.452 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:34:27.452 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.452 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.452 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.452 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:206795 3.9 3:992bcee8:::benchmark_data_smithi188_92122_object41204:head [delete] snapc 0=[] ondisk+write+known_if_redirected e233)", 2024-04-01T19:34:27.453 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:32:03.257247+0000", 2024-04-01T19:34:27.453 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 144.09528997000001, 2024-04-01T19:34:27.453 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029662869000000001, 2024-04-01T19:34:27.453 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:34:27.453 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:34:27.453 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:27.453 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:34:27.453 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:34:27.453 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:34:27.453 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 206795 2024-04-01T19:34:27.453 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.453 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:34:27.453 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.453 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:34:27.453 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257247+0000", 2024-04-01T19:34:27.453 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.454 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.454 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.454 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:34:27.454 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257247+0000", 2024-04-01T19:34:27.454 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.454 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.454 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.454 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:34:27.454 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257248+0000", 2024-04-01T19:34:27.454 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1800000000000005e-07 2024-04-01T19:34:27.454 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.454 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.454 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:34:27.454 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257251+0000", 2024-04-01T19:34:27.455 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9790000000000002e-06 2024-04-01T19:34:27.455 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.455 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.455 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:34:27.455 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257258+0000", 2024-04-01T19:34:27.455 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7939999999999997e-06 2024-04-01T19:34:27.455 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.455 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.455 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:34:27.455 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257263+0000", 2024-04-01T19:34:27.455 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1789999999999999e-06 2024-04-01T19:34:27.455 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.455 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.455 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:34:27.455 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.261883+0000", 2024-04-01T19:34:27.456 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.004619672 2024-04-01T19:34:27.456 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.456 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.456 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:34:27.456 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.262001+0000", 2024-04-01T19:34:27.456 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117818 2024-04-01T19:34:27.456 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.456 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.456 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:34:27.456 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.262127+0000", 2024-04-01T19:34:27.456 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012600799999999999 2024-04-01T19:34:27.456 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.456 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.456 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:34:27.457 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.265794+0000", 2024-04-01T19:34:27.457 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036671009999999999 2024-04-01T19:34:27.457 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.457 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.457 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:34:27.457 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.286823+0000", 2024-04-01T19:34:27.457 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.021029711999999999 2024-04-01T19:34:27.457 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.457 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.457 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:34:27.457 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.286870+0000", 2024-04-01T19:34:27.457 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6776000000000001e-05 2024-04-01T19:34:27.458 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.458 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.458 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:34:27.458 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.286910+0000", 2024-04-01T19:34:27.458 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0012000000000002e-05 2024-04-01T19:34:27.458 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.458 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:34:27.458 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.458 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.458 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.458 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:233380 3.9 3:9f878984:::benchmark_data_smithi188_92122_object67789:head [delete] snapc 0=[] ondisk+write+known_if_redirected e240)", 2024-04-01T19:34:27.458 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:32:24.276074+0000", 2024-04-01T19:34:27.458 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 123.076463038, 2024-04-01T19:34:27.459 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029768269999999999, 2024-04-01T19:34:27.459 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:34:27.459 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:34:27.459 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:27.459 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:34:27.459 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:34:27.459 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:34:27.459 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 233380 2024-04-01T19:34:27.459 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.459 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:34:27.459 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.459 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:34:27.459 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.276074+0000", 2024-04-01T19:34:27.459 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.460 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.460 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.460 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:34:27.460 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.276074+0000", 2024-04-01T19:34:27.460 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.460 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.460 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.460 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:34:27.460 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.276076+0000", 2024-04-01T19:34:27.460 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0549999999999998e-06 2024-04-01T19:34:27.460 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.460 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.460 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:34:27.460 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.276083+0000", 2024-04-01T19:34:27.460 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.601e-06 2024-04-01T19:34:27.461 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.461 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.461 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:34:27.461 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.276097+0000", 2024-04-01T19:34:27.461 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.447e-05 2024-04-01T19:34:27.461 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.461 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.461 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:34:27.461 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.276104+0000", 2024-04-01T19:34:27.461 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2190000000000001e-06 2024-04-01T19:34:27.461 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.461 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.461 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:34:27.461 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.280914+0000", 2024-04-01T19:34:27.461 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0048100959999999998 2024-04-01T19:34:27.462 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.462 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.462 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:34:27.462 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.281039+0000", 2024-04-01T19:34:27.462 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012482899999999999 2024-04-01T19:34:27.462 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.462 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.462 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:34:27.462 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.281153+0000", 2024-04-01T19:34:27.462 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000114386 2024-04-01T19:34:27.462 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.462 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.462 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:34:27.462 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.294101+0000", 2024-04-01T19:34:27.463 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012947718 2024-04-01T19:34:27.463 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.463 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.463 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:34:27.463 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.305758+0000", 2024-04-01T19:34:27.463 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011657410999999999 2024-04-01T19:34:27.463 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.463 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.463 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:34:27.463 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.305792+0000", 2024-04-01T19:34:27.463 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4387000000000001e-05 2024-04-01T19:34:27.463 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.463 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.463 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:34:27.463 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.305843+0000", 2024-04-01T19:34:27.463 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0098e-05 2024-04-01T19:34:27.464 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.464 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:34:27.464 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.464 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.464 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.464 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:288104 3.9 3:99586915:::benchmark_data_smithi188_92122_object122513:head [delete] snapc 0=[] ondisk+write+known_if_redirected e249)", 2024-04-01T19:34:27.464 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:33:08.991272+0000", 2024-04-01T19:34:27.464 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 78.361265277000001, 2024-04-01T19:34:27.464 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033197938000000003, 2024-04-01T19:34:27.464 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:34:27.464 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:34:27.464 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:27.464 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:34:27.464 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:34:27.464 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:34:27.464 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 288104 2024-04-01T19:34:27.465 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.465 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:34:27.465 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.465 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:34:27.465 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:08.991272+0000", 2024-04-01T19:34:27.465 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.465 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.465 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.465 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:34:27.465 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:08.991272+0000", 2024-04-01T19:34:27.465 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.465 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.465 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.465 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:34:27.465 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:08.991274+0000", 2024-04-01T19:34:27.466 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.12e-06 2024-04-01T19:34:27.466 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.466 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.466 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:34:27.466 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:08.991281+0000", 2024-04-01T19:34:27.466 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5309999999999998e-06 2024-04-01T19:34:27.466 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.466 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.466 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:34:27.466 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:08.991289+0000", 2024-04-01T19:34:27.466 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5310000000000001e-06 2024-04-01T19:34:27.466 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.466 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.467 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:34:27.467 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:08.991298+0000", 2024-04-01T19:34:27.467 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4309999999999994e-06 2024-04-01T19:34:27.467 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.467 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.467 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:34:27.467 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:08.991373+0000", 2024-04-01T19:34:27.467 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5236999999999998e-05 2024-04-01T19:34:27.467 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.467 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.467 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:34:27.467 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:08.991493+0000", 2024-04-01T19:34:27.467 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119716 2024-04-01T19:34:27.467 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.467 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.468 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:34:27.468 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:08.991594+0000", 2024-04-01T19:34:27.468 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010182499999999999 2024-04-01T19:34:27.468 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.468 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.468 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:34:27.468 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:08.996257+0000", 2024-04-01T19:34:27.468 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046627750000000001 2024-04-01T19:34:27.468 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.468 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.468 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:34:27.468 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:09.024370+0000", 2024-04-01T19:34:27.469 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028113082000000001 2024-04-01T19:34:27.469 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.469 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.469 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:34:27.469 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:09.024426+0000", 2024-04-01T19:34:27.469 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5368000000000003e-05 2024-04-01T19:34:27.469 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.469 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.469 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:34:27.469 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:09.024470+0000", 2024-04-01T19:34:27.469 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4322e-05 2024-04-01T19:34:27.469 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.469 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:34:27.469 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.469 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.470 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.470 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:294144 3.9 3:98ed1b01:::benchmark_data_smithi188_92122_object128553:head [delete] snapc 0=[] ondisk+write+known_if_redirected e252)", 2024-04-01T19:34:27.470 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:33:14.001589+0000", 2024-04-01T19:34:27.470 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 73.350947894000001, 2024-04-01T19:34:27.470 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034811092000000002, 2024-04-01T19:34:27.470 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:34:27.470 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:34:27.470 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:27.470 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:34:27.470 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:34:27.470 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:34:27.470 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 294144 2024-04-01T19:34:27.470 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.471 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:34:27.471 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.471 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:34:27.471 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.001589+0000", 2024-04-01T19:34:27.471 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.471 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.471 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.471 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:34:27.471 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.001589+0000", 2024-04-01T19:34:27.471 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:34:27.471 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.471 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.471 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:34:27.471 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.001591+0000", 2024-04-01T19:34:27.471 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.48e-06 2024-04-01T19:34:27.472 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.472 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.472 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:34:27.472 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.001596+0000", 2024-04-01T19:34:27.472 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6999999999999999e-06 2024-04-01T19:34:27.472 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.472 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.472 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:34:27.472 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.001609+0000", 2024-04-01T19:34:27.472 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3335e-05 2024-04-01T19:34:27.472 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.472 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.472 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:34:27.473 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.001616+0000", 2024-04-01T19:34:27.473 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4850000000000003e-06 2024-04-01T19:34:27.473 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.473 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.473 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:34:27.473 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.009625+0000", 2024-04-01T19:34:27.473 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080084990000000005 2024-04-01T19:34:27.473 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.473 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.473 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:34:27.473 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.009741+0000", 2024-04-01T19:34:27.473 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000116118 2024-04-01T19:34:27.473 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.474 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.474 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:34:27.474 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.009855+0000", 2024-04-01T19:34:27.474 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011373400000000001 2024-04-01T19:34:27.474 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.474 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.474 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:34:27.474 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.022482+0000", 2024-04-01T19:34:27.474 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012627189 2024-04-01T19:34:27.474 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.474 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.474 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:34:27.474 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.036302+0000", 2024-04-01T19:34:27.474 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013820569 2024-04-01T19:34:27.475 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.475 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.475 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:34:27.475 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.036359+0000", 2024-04-01T19:34:27.475 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6107999999999999e-05 2024-04-01T19:34:27.475 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:34:27.475 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:34:27.475 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:34:27.475 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.036400+0000", 2024-04-01T19:34:27.475 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1875000000000001e-05 2024-04-01T19:34:27.475 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.475 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:34:27.475 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.475 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:34:27.476 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:34:27.476 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:34:27.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:27 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/426798822' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T19:34:27.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:27 smithi022 ceph-mon[39439]: from='client.35519 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T19:34:27.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.564 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.8 to 1 (10000) 2024-04-01T19:34:27.568 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 22 16 70418 70402 199.966 137.125 0.0063559 0.00499933 2024-04-01T19:34:27.652 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:34:27.654 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:34:27.659 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:27.660 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:34:27.760 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:34:27.791 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.791 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.791 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.792 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.792 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.792 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.792 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.792 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.792 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:27 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/426798822' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T19:34:27.792 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:27 smithi188 ceph-mon[43939]: from='client.35519 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T19:34:27.792 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.792 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.798 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:27.829 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:34:27.836 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:27.837 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:34:27.838 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.838 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.838 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.838 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.838 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.838 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.838 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.838 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.838 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:27 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/426798822' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T19:34:27.839 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:27 smithi062 ceph-mon[44211]: from='client.35519 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T19:34:27.839 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.839 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:27.938 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:34:27.973 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:28.002 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:34:28.007 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:28.007 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:34:28.108 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:34:28.150 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:28.202 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_ops_in_flight 2024-04-01T19:34:28.493 INFO:tasks.thrashosds.thrasher:test_map_discontinuity 2024-04-01T19:34:28.493 INFO:tasks.thrashosds.thrasher:Waiting for recovery 2024-04-01T19:34:28.493 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-01T19:34:28.494 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-04-01T19:34:28.512 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:34:28.522 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:28.522 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:34:28.568 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 23 16 72621 72605 197.258 137.688 0.00336578 0.00506724 2024-04-01T19:34:28.623 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:34:28.658 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:28.667 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:34:28.677 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:34:28.684 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:34:28.688 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:28.688 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:34:28.789 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:34:28.822 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:28 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:28.822 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:28 smithi188 ceph-mon[43939]: pgmap v803: 17 pgs: 17 active+clean; 3.9 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 164 MiB/s wr, 2.63k op/s 2024-04-01T19:34:28.822 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:28 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:28.822 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:28 smithi188 ceph-mon[43939]: from='client.35519 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]': finished 2024-04-01T19:34:28.822 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:28 smithi188 ceph-mon[43939]: osdmap e276: 12 total, 12 up, 12 in 2024-04-01T19:34:28.824 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:28.852 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:34:28.855 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:28.856 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:34:28.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:28 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:28.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:28 smithi022 ceph-mon[39439]: pgmap v803: 17 pgs: 17 active+clean; 3.9 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 164 MiB/s wr, 2.63k op/s 2024-04-01T19:34:28.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:28 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:28.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:28 smithi022 ceph-mon[39439]: from='client.35519 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]': finished 2024-04-01T19:34:28.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:28 smithi022 ceph-mon[39439]: osdmap e276: 12 total, 12 up, 12 in 2024-04-01T19:34:28.956 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:34:28.994 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:29.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:28 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:29.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:28 smithi062 ceph-mon[44211]: pgmap v803: 17 pgs: 17 active+clean; 3.9 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 164 MiB/s wr, 2.63k op/s 2024-04-01T19:34:29.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:28 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:29.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:28 smithi062 ceph-mon[44211]: from='client.35519 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]': finished 2024-04-01T19:34:29.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:28 smithi062 ceph-mon[44211]: osdmap e276: 12 total, 12 up, 12 in 2024-04-01T19:34:29.022 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:34:29.026 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:29.026 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:34:29.127 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:34:29.170 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:29.213 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:34:29.216 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:29.217 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:34:29.318 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:34:29.357 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:29.389 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:34:29.393 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:29.393 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:34:29.494 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:34:29.541 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:29.568 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 24 16 74737 74721 194.549 132.25 0.00671231 0.00513834 2024-04-01T19:34:29.707 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:34:29.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:29 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:34:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:29 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:34:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:29 smithi062 ceph-mon[44211]: osdmap e277: 12 total, 12 up, 12 in 2024-04-01T19:34:29.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:29 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:34:29.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:29 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:34:29.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:29 smithi022 ceph-mon[39439]: osdmap e277: 12 total, 12 up, 12 in 2024-04-01T19:34:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:29 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:34:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:29 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:34:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:29 smithi188 ceph-mon[43939]: osdmap e277: 12 total, 12 up, 12 in 2024-04-01T19:34:30.568 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 25 16 76909 76893 192.197 135.75 0.0105025 0.0052015 2024-04-01T19:34:30.620 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:34:30.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:30.629 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:34:30.730 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:34:30.767 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:30.792 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:34:30.799 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:30.800 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:34:30.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:30 smithi022 ceph-mon[39439]: pgmap v806: 17 pgs: 17 active+clean; 4.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 132 MiB/s wr, 2.11k op/s 2024-04-01T19:34:30.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:30 smithi022 ceph-mon[39439]: osdmap e278: 12 total, 12 up, 12 in 2024-04-01T19:34:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:30 smithi188 ceph-mon[43939]: pgmap v806: 17 pgs: 17 active+clean; 4.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 132 MiB/s wr, 2.11k op/s 2024-04-01T19:34:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:30 smithi188 ceph-mon[43939]: osdmap e278: 12 total, 12 up, 12 in 2024-04-01T19:34:30.900 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:34:30.946 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:31.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:30 smithi062 ceph-mon[44211]: pgmap v806: 17 pgs: 17 active+clean; 4.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 132 MiB/s wr, 2.11k op/s 2024-04-01T19:34:31.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:30 smithi062 ceph-mon[44211]: osdmap e278: 12 total, 12 up, 12 in 2024-04-01T19:34:31.568 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 26 16 79068 79052 189.995 134.938 0.00319608 0.00526179 2024-04-01T19:34:31.614 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:34:31.618 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:31.618 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:34:31.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:31 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:34:31.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:31 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:34:31.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:31 smithi022 ceph-mon[39439]: osdmap e279: 12 total, 12 up, 12 in 2024-04-01T19:34:31.719 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:34:31.778 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:31.829 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:34:31.835 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:31.835 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:34:31.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:31 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:34:31.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:31 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:34:31.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:31 smithi188 ceph-mon[43939]: osdmap e279: 12 total, 12 up, 12 in 2024-04-01T19:34:31.920 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:34:31.920 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:34:31.921 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:31.921 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:79737 4.b 4:d5e39f3b:::benchmark_data_smithi188_104537_object79736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e279)", 2024-04-01T19:34:31.921 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:34:31.908556+0000", 2024-04-01T19:34:31.921 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0085934440000000004, 2024-04-01T19:34:31.921 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0086198190000000008, 2024-04-01T19:34:31.921 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:31.921 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:31.921 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:34:31.921 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:34:31.921 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:34:31.921 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:34:31.921 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 79737 2024-04-01T19:34:31.922 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:31.922 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:31.922 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:31.922 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:31.922 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:31.908556+0000", 2024-04-01T19:34:31.922 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:31.922 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:31.922 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:31.922 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:31.922 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:31.908556+0000", 2024-04-01T19:34:31.922 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:31.922 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:31.922 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:31.923 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:31.923 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:31.908559+0000", 2024-04-01T19:34:31.923 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.2619999999999999e-06 2024-04-01T19:34:31.923 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:31.923 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:31.923 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:31.923 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:31.908600+0000", 2024-04-01T19:34:31.923 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1112999999999998e-05 2024-04-01T19:34:31.923 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:31.923 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:31.923 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:31.923 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:31.908622+0000", 2024-04-01T19:34:31.923 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1583999999999999e-05 2024-04-01T19:34:31.923 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:31.924 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:31.924 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:31.924 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:31.908632+0000", 2024-04-01T19:34:31.924 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0512e-05 2024-04-01T19:34:31.924 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:31.924 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:31.924 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:31.924 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:31.908700+0000", 2024-04-01T19:34:31.924 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.7879999999999994e-05 2024-04-01T19:34:31.924 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:31.925 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:31.925 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:34:31.925 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:31.908821+0000", 2024-04-01T19:34:31.925 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000121017 2024-04-01T19:34:31.925 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:31.925 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:31.925 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 1", 2024-04-01T19:34:31.925 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:31.908952+0000", 2024-04-01T19:34:31.925 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013061600000000001 2024-04-01T19:34:31.925 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:31.925 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:31.925 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:34:31.925 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:31.913079+0000", 2024-04-01T19:34:31.925 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.004127225 2024-04-01T19:34:31.926 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:31.926 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:31.926 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:31.926 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:31.926 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:31.926 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:79754 4.b 4:d451523f:::benchmark_data_smithi188_104537_object79753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e279)", 2024-04-01T19:34:31.926 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:34:31.914862+0000", 2024-04-01T19:34:31.926 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0022871969999999999, 2024-04-01T19:34:31.926 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0023902870000000001, 2024-04-01T19:34:31.926 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:31.926 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:31.926 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:34:31.926 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:34:31.927 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:34:31.927 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:34:31.927 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 79754 2024-04-01T19:34:31.927 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:31.927 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:31.927 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:31.927 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:31.927 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:31.914862+0000", 2024-04-01T19:34:31.927 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:31.927 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:31.927 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:31.927 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:31.927 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:31.914862+0000", 2024-04-01T19:34:31.927 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:31.928 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:31.928 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:31.928 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:31.928 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:31.914865+0000", 2024-04-01T19:34:31.928 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6139999999999999e-06 2024-04-01T19:34:31.928 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:31.928 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:31.928 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:31.928 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:31.914930+0000", 2024-04-01T19:34:31.928 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5858999999999994e-05 2024-04-01T19:34:31.928 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:31.928 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:31.928 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:31.928 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:31.914946+0000", 2024-04-01T19:34:31.928 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5444e-05 2024-04-01T19:34:31.929 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:31.929 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:31.929 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:31.929 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:31.914955+0000", 2024-04-01T19:34:31.929 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8619999999999992e-06 2024-04-01T19:34:31.929 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:31.929 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:31.929 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:31.929 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:31.915044+0000", 2024-04-01T19:34:31.929 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.9349000000000001e-05 2024-04-01T19:34:31.929 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:31.929 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:31.929 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:34:31.929 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:31.915176+0000", 2024-04-01T19:34:31.930 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013176999999999999 2024-04-01T19:34:31.930 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:31.930 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:31.930 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 1", 2024-04-01T19:34:31.930 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:31.915304+0000", 2024-04-01T19:34:31.930 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000127711 2024-04-01T19:34:31.930 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:31.930 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:31.930 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:31.930 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:31.930 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T19:34:31.930 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 2 2024-04-01T19:34:31.931 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:34:31.936 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:34:32.007 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:32.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:31 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:34:32.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:31 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:34:32.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:31 smithi062 ceph-mon[44211]: osdmap e279: 12 total, 12 up, 12 in 2024-04-01T19:34:32.234 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:34:32.236 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:32.237 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:34:32.338 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:34:32.366 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:32.388 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:34:32.406 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:32.406 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:34:32.507 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:34:32.548 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:32.568 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 27 16 80826 80810 187.027 109.875 0.00858449 0.0053455 2024-04-01T19:34:32.573 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:34:32.577 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:32.578 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:34:32.682 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:34:32.714 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:32.740 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:34:32.744 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:32.745 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:34:32.846 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:34:32.871 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:32 smithi022 ceph-mon[39439]: pgmap v808: 17 pgs: 17 active+clean; 4.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 154 MiB/s wr, 2.47k op/s 2024-04-01T19:34:32.871 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:32 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:34:32.871 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:32 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:34:32.871 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:32 smithi022 ceph-mon[39439]: osdmap e280: 12 total, 12 up, 12 in 2024-04-01T19:34:32.871 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:32 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4062550535' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:34:32.871 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:32 smithi022 ceph-mon[39439]: from='client.35531 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:34:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:32 smithi188 ceph-mon[43939]: pgmap v808: 17 pgs: 17 active+clean; 4.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 154 MiB/s wr, 2.47k op/s 2024-04-01T19:34:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:32 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:34:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:32 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:34:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:32 smithi188 ceph-mon[43939]: osdmap e280: 12 total, 12 up, 12 in 2024-04-01T19:34:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:32 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4062550535' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:34:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:32 smithi188 ceph-mon[43939]: from='client.35531 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:34:32.880 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:32 smithi062 ceph-mon[44211]: pgmap v808: 17 pgs: 17 active+clean; 4.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 154 MiB/s wr, 2.47k op/s 2024-04-01T19:34:32.880 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:32 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:34:32.880 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:32 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:34:32.880 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:32 smithi062 ceph-mon[44211]: osdmap e280: 12 total, 12 up, 12 in 2024-04-01T19:34:32.880 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:32 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4062550535' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:34:32.880 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:32 smithi062 ceph-mon[44211]: from='client.35531 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:34:32.882 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:32.907 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_blocked_ops 2024-04-01T19:34:32.910 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:34:32.913 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:32.913 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:34:33.013 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:34:33.014 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:34:33.034 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:34:33.104 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:33.243 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:34:33.246 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:34:33.249 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:33.250 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:34:33.351 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:34:33.387 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:33.416 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:34:33.420 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:33.420 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:34:33.521 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:34:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:33.568 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 28 16 82769 82753 184.685 121.438 0.00314037 0.00541308 2024-04-01T19:34:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:34:33.584 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:33.584 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:34:33.685 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:34:33.726 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:33.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:33 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:34:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:33 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:34:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:33 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:34:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:33 smithi062 ceph-mon[44211]: from='client.35531 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:34:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:33 smithi062 ceph-mon[44211]: osdmap e281: 12 total, 12 up, 12 in 2024-04-01T19:34:33.803 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:33 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:34:33.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:33 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:34:33.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:33 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:34:33.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:33 smithi022 ceph-mon[39439]: from='client.35531 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:34:33.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:33 smithi022 ceph-mon[39439]: osdmap e281: 12 total, 12 up, 12 in 2024-04-01T19:34:34.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:33 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:34:34.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:33 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:34:34.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:33 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:34:34.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:33 smithi188 ceph-mon[43939]: from='client.35531 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:34:34.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:33 smithi188 ceph-mon[43939]: osdmap e281: 12 total, 12 up, 12 in 2024-04-01T19:34:34.400 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:34:34.406 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:34.406 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:34:34.507 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:34:34.542 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:34.569 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 29 16 84875 84859 182.855 131.625 0.00566604 0.00546736 2024-04-01T19:34:34.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:34 smithi022 ceph-mon[39439]: pgmap v811: 17 pgs: 17 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 158 MiB/s wr, 2.53k op/s 2024-04-01T19:34:34.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:34 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:34:34.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:34 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:34:34.910 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:34:34.921 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:34.922 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:34:34.938 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:34:35.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:34 smithi062 ceph-mon[44211]: pgmap v811: 17 pgs: 17 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 158 MiB/s wr, 2.53k op/s 2024-04-01T19:34:35.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:34 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:34:35.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:34 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:34:35.023 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:34:35.072 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:35.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:34 smithi188 ceph-mon[43939]: pgmap v811: 17 pgs: 17 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 158 MiB/s wr, 2.53k op/s 2024-04-01T19:34:35.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:34 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:34:35.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:34 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:34:35.569 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 30 16 86876 86860 180.928 125.062 0.00960212 0.00552583 2024-04-01T19:34:35.940 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:35 smithi022 ceph-mon[39439]: osdmap e282: 12 total, 12 up, 12 in 2024-04-01T19:34:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:35 smithi062 ceph-mon[44211]: osdmap e282: 12 total, 12 up, 12 in 2024-04-01T19:34:36.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:35 smithi188 ceph-mon[43939]: osdmap e282: 12 total, 12 up, 12 in 2024-04-01T19:34:36.162 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:34:36.569 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 31 16 88684 88668 178.737 113 0.00857865 0.00559239 2024-04-01T19:34:36.591 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:34:36.591 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:34:36.591 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:34:36.591 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:34:36.591 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:34:36.591 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:34:36.591 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:34:36.591 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:34:36.591 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:34:36.597 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:34:36.615 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:34:36.618 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:36.618 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:34:36.631 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:34:36.675 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:34:36.680 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:34:36.680 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:34:36.680 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:34:36.680 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:34:36.680 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:34:36.680 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:34:36.680 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:34:36.680 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:34:36.680 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:34:36.680 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:34:36.680 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:34:36.680 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:34:36.719 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:34:36.762 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:36.793 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:34:36.797 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:36.797 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:34:36.898 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:34:36.932 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:36 smithi188 ceph-mon[43939]: pgmap v814: 17 pgs: 17 active+clean; 4.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 112 MiB/s wr, 1.79k op/s 2024-04-01T19:34:36.932 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:36 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:34:36.933 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:36 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:34:36.933 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:36 smithi188 ceph-mon[43939]: osdmap e283: 12 total, 12 up, 12 in 2024-04-01T19:34:36.933 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:36 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/759479387' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:34:36.935 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:36.962 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:34:36.967 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:36.968 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:34:37.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:36 smithi062 ceph-mon[44211]: pgmap v814: 17 pgs: 17 active+clean; 4.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 112 MiB/s wr, 1.79k op/s 2024-04-01T19:34:37.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:36 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:34:37.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:36 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:34:37.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:36 smithi062 ceph-mon[44211]: osdmap e283: 12 total, 12 up, 12 in 2024-04-01T19:34:37.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:36 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/759479387' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:34:37.069 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:34:37.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:36 smithi022 ceph-mon[39439]: pgmap v814: 17 pgs: 17 active+clean; 4.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 112 MiB/s wr, 1.79k op/s 2024-04-01T19:34:37.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:36 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:34:37.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:36 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:34:37.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:36 smithi022 ceph-mon[39439]: osdmap e283: 12 total, 12 up, 12 in 2024-04-01T19:34:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:36 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/759479387' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:34:37.116 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:37.569 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 32 16 90620 90604 176.932 121 0.00655996 0.00565071 2024-04-01T19:34:37.933 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:37 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:37.933 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:37 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:37.933 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:37 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:37.933 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:37 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:37.933 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:37 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:37.934 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:37 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:37.934 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:37 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:37.934 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:37 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:37.934 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:37 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:37.934 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:37 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:37.934 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:37 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:37.934 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:37 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:37.986 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:34:37.990 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:37.990 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:34:38.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:37 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:38.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:37 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:37 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:37 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:37 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:37 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:37 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:37 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:37 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:37 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:37 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:37 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:38.091 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:34:38.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:37 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:38.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:37 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:38.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:37 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:38.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:37 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:38.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:37 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:38.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:37 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:38.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:37 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:38.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:37 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:38.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:37 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:38.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:37 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:38.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:37 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:38.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:37 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:38.128 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:38.162 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:34:38.166 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:38.167 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:34:38.268 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:34:38.326 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:38.569 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 33 16 92565 92549 175.254 121.562 0.0036431 0.00570441 2024-04-01T19:34:38.598 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:34:38.601 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:38.602 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:34:38.702 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:34:38.748 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:38.850 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:34:38.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:38 smithi022 ceph-mon[39439]: pgmap v816: 17 pgs: 17 active+clean; 5.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 128 MiB/s wr, 2.04k op/s 2024-04-01T19:34:38.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:38 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:34:38.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:38 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:34:38.877 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:38.878 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:34:38.957 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:34:38.957 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:34:38.979 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:34:39.010 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:38 smithi188 ceph-mon[43939]: pgmap v816: 17 pgs: 17 active+clean; 5.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 128 MiB/s wr, 2.04k op/s 2024-04-01T19:34:39.010 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:38 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:34:39.010 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:38 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:34:39.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:38 smithi062 ceph-mon[44211]: pgmap v816: 17 pgs: 17 active+clean; 5.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 128 MiB/s wr, 2.04k op/s 2024-04-01T19:34:39.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:38 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:34:39.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:38 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:34:39.013 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:39.041 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:34:39.044 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:39.045 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:34:39.145 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:34:39.182 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:39.209 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:34:39.212 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:39.213 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:34:39.314 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:34:39.358 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:39.388 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:34:39.395 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:39.396 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:34:39.497 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:34:39.531 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:39.556 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:34:39.562 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:39.562 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:34:39.569 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 34 16 94415 94399 173.5 115.625 0.0078148 0.00576277 2024-04-01T19:34:39.614 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:34:39.663 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:34:39.694 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:39.725 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:34:39.731 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:39.732 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:34:39.833 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:34:39.874 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:39.935 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:34:39.964 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:39 smithi022 ceph-mon[39439]: osdmap e284: 12 total, 12 up, 12 in 2024-04-01T19:34:40.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:39 smithi062 ceph-mon[44211]: osdmap e284: 12 total, 12 up, 12 in 2024-04-01T19:34:40.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:39 smithi188 ceph-mon[43939]: osdmap e284: 12 total, 12 up, 12 in 2024-04-01T19:34:40.263 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:34:40.276 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:40.276 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:34:40.377 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:34:40.415 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:40.441 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:34:40.447 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:40.448 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:34:40.549 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:34:40.569 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 35 15 96169 96154 171.677 109.688 0.0201167 0.0058223 2024-04-01T19:34:40.612 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:40.707 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:40 smithi188 ceph-mon[43939]: pgmap v818: 17 pgs: 17 active+clean; 5.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 105 MiB/s wr, 1.67k op/s 2024-04-01T19:34:40.774 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:34:40.775 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":284,"fsid":"09f6b846-f05c-11ee-b647-cb9ed24678a4","created":"2024-04-01T19:15:34.344221+0000","modified":"2024-04-01T19:34:38.681151+0000","last_up_change":"2024-04-01T19:30:04.088708+0000","last_in_change":"2024-04-01T19:30:14.157330+0000","flags":"nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5804032,"flags_set":["nodeep-scrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":28,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T19:18:34.605751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"unique_pool_2","create_time":"2024-04-01T19:33:57.141554+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"271","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.92000001668930054,"raw_score_acting":2.75,"raw_score_stable":2.75,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfd4aa7e-a933-42e2-aac8-f93a3d9fcc3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":267,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":1419201649}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":1419201649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":1419201649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":1419201649}]},"public_addr":"172.21.15.22:6801/1419201649","cluster_addr":"172.21.15.22:6802/1419201649","heartbeat_back_addr":"172.21.15.22:6804/1419201649","heartbeat_front_addr":"172.21.15.22:6803/1419201649","state":["exists","up"]},{"osd":1,"uuid":"6ddadf19-2b4e-4c01-8918-9d51c323925b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":267,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":2579227110}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":2579227110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6808","nonce":2579227110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":2579227110}]},"public_addr":"172.21.15.22:6805/2579227110","cluster_addr":"172.21.15.22:6806/2579227110","heartbeat_back_addr":"172.21.15.22:6808/2579227110","heartbeat_front_addr":"172.21.15.22:6807/2579227110","state":["exists","up"]},{"osd":2,"uuid":"4af1f44c-f47c-4ce6-87ba-1aeec3960969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":835455757}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":835455757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":835455757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":835455757}]},"public_addr":"172.21.15.22:6809/835455757","cluster_addr":"172.21.15.22:6810/835455757","heartbeat_back_addr":"172.21.15.22:6812/835455757","heartbeat_front_addr":"172.21.15.22:6811/835455757","state":["exists","up"]},{"osd":3,"uuid":"c399f336-23c7-414a-822e-63793daf85c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":267,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":90988887}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":90988887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":90988887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":90988887}]},"public_addr":"172.21.15.22:6813/90988887","cluster_addr":"172.21.15.22:6814/90988887","heartbeat_back_addr":"172.21.15.22:6816/90988887","heartbeat_front_addr":"172.21.15.22:6815/90988887","state":["exists","up"]},{"osd":4,"uuid":"0a2690dc-e5b6-4d29-b517-980018519d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":267,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6800","nonce":2408168690}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6801","nonce":2408168690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6803","nonce":2408168690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6802","nonce":2408168690}]},"public_addr":"172.21.15.62:6800/2408168690","cluster_addr":"172.21.15.62:6801/2408168690","heartbeat_back_addr":"172.21.15.62:6803/2408168690","heartbeat_front_addr":"172.21.15.62:6802/2408168690","state":["exists","up"]},{"osd":5,"uuid":"c6830412-959a-4f1e-8c3d-f4b2d88673e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":191,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6804","nonce":386874616}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6805","nonce":386874616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6807","nonce":386874616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6806","nonce":386874616}]},"public_addr":"172.21.15.62:6804/386874616","cluster_addr":"172.21.15.62:6805/386874616","heartbeat_back_addr":"172.21.15.62:6807/386874616","heartbeat_front_addr":"172.21.15.62:6806/386874616","state":["exists","up"]},{"osd":6,"uuid":"f646310b-91a4-4259-a51f-6a0e92b7cba8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":267,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6808","nonce":90097362}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6809","nonce":90097362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6811","nonce":90097362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6810","nonce":90097362}]},"public_addr":"172.21.15.62:6808/90097362","cluster_addr":"172.21.15.62:6809/90097362","heartbeat_back_addr":"172.21.15.62:6811/90097362","heartbeat_front_addr":"172.21.15.62:6810/90097362","state":["exists","up"]},{"osd":7,"uuid":"afe5f371-c892-43e9-b82e-c2d911354e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6812","nonce":2055487337}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6813","nonce":2055487337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6815","nonce":2055487337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6814","nonce":2055487337}]},"public_addr":"172.21.15.62:6812/2055487337","cluster_addr":"172.21.15.62:6813/2055487337","heartbeat_back_addr":"172.21.15.62:6815/2055487337","heartbeat_front_addr":"172.21.15.62:6814/2055487337","state":["exists","up"]},{"osd":8,"uuid":"b7eb6461-f6fa-4a12-864c-6e6748e6337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":63,"last_clean_end":159,"up_from":197,"up_thru":212,"down_at":160,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6800","nonce":1873408265}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6801","nonce":1873408265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6803","nonce":1873408265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6802","nonce":1873408265}]},"public_addr":"172.21.15.188:6800/1873408265","cluster_addr":"172.21.15.188:6801/1873408265","heartbeat_back_addr":"172.21.15.188:6803/1873408265","heartbeat_front_addr":"172.21.15.188:6802/1873408265","state":["exists","up"]},{"osd":9,"uuid":"7d496ad5-46bf-485a-81d9-2b9da2a59882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":267,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6804","nonce":1755990887}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6805","nonce":1755990887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6807","nonce":1755990887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6806","nonce":1755990887}]},"public_addr":"172.21.15.188:6804/1755990887","cluster_addr":"172.21.15.188:6805/1755990887","heartbeat_back_addr":"172.21.15.188:6807/1755990887","heartbeat_front_addr":"172.21.15.188:6806/1755990887","state":["exists","up"]},{"osd":10,"uuid":"6cbb80ce-37f7-48df-9090-09a6068e4490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6808","nonce":3777340429}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6809","nonce":3777340429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6811","nonce":3777340429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6810","nonce":3777340429}]},"public_addr":"172.21.15.188:6808/3777340429","cluster_addr":"172.21.15.188:6809/3777340429","heartbeat_back_addr":"172.21.15.188:6811/3777340429","heartbeat_front_addr":"172.21.15.188:6810/3777340429","state":["exists","up"]},{"osd":11,"uuid":"c03517c4-fdb0-4587-96c1-b959041c4344","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":267,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6812","nonce":3987199514}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6813","nonce":3987199514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6815","nonce":3987199514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6814","nonce":3987199514}]},"public_addr":"172.21.15.188:6812/3987199514","cluster_addr":"172.21.15.188:6813/3987199514","heartbeat_back_addr":"172.21.15.188:6815/3987199514","heartbeat_front_addr":"172.21.15.188:6814/3987199514","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:34:35.512806+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:34:31.598504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:33:42.074609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:33:25.869679+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:34:37.917534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:34:12.187038+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:34:30.281246+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:34:28.368035+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:33:34.928017+0000","dead_epoch":159},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:34:33.707047+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:34:21.985464+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:34:31.928356+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/3735983556":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/3575578250":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/2493529775":"2024-04-02T19:16:02.302343+0000","172.21.15.22:6800/2678666836":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/2389537847":"2024-04-02T19:16:02.302343+0000","172.21.15.22:0/798807675":"2024-04-02T19:16:02.302343+0000","172.21.15.22:6800/1090179981":"2024-04-02T19:16:02.302343+0000","172.21.15.22:0/51907384":"2024-04-02T19:16:30.513384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T19:34:40.806 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:40 smithi022 ceph-mon[39439]: pgmap v818: 17 pgs: 17 active+clean; 5.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 105 MiB/s wr, 1.67k op/s 2024-04-01T19:34:41.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:40 smithi062 ceph-mon[44211]: pgmap v818: 17 pgs: 17 active+clean; 5.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 105 MiB/s wr, 1.67k op/s 2024-04-01T19:34:41.036 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_historic_ops 2024-04-01T19:34:41.569 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 36 16 97955 97939 170.007 111.562 0.00393253 0.00588074 2024-04-01T19:34:41.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:41 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3328176809' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T19:34:41.843 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-01T19:34:42.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:41 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3328176809' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T19:34:42.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:41 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3328176809' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T19:34:42.569 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 37 16 99807 99791 168.541 115.75 0.00529009 0.00593159 2024-04-01T19:34:42.685 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:34:42.687 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:42.688 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:34:42.769 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:34:42.789 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:34:42.827 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:43.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:42 smithi062 ceph-mon[44211]: pgmap v819: 17 pgs: 17 active+clean; 5.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 140 MiB/s wr, 2.24k op/s 2024-04-01T19:34:43.018 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:42 smithi022 ceph-mon[39439]: pgmap v819: 17 pgs: 17 active+clean; 5.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 140 MiB/s wr, 2.24k op/s 2024-04-01T19:34:43.030 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:34:43.039 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:43.040 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:34:43.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:42 smithi188 ceph-mon[43939]: pgmap v819: 17 pgs: 17 active+clean; 5.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 140 MiB/s wr, 2.24k op/s 2024-04-01T19:34:43.141 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:34:43.175 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:43.200 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:34:43.204 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:43.205 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:34:43.306 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:34:43.343 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:43.368 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:34:43.372 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:43.372 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:34:43.473 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:34:43.508 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:43.538 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:34:43.544 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:43.544 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:34:43.569 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 38 16 101454 101438 166.814 102.938 0.00355928 0.00599323 2024-04-01T19:34:43.645 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:34:43.682 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:43.708 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:34:43.712 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:43.712 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:34:43.813 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:34:43.850 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:43.880 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:34:43.884 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:43.884 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:34:43.985 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:34:44.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:43 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T19:34:44.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:43 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T19:34:44.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:43 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:34:44.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:43 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:34:44.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:43 smithi062 ceph-mon[44211]: osdmap e285: 12 total, 12 up, 12 in 2024-04-01T19:34:44.040 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:43 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T19:34:44.040 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:43 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T19:34:44.040 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:43 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:34:44.040 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:43 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:34:44.040 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:43 smithi022 ceph-mon[39439]: osdmap e285: 12 total, 12 up, 12 in 2024-04-01T19:34:44.043 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:44.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:43 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T19:34:44.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:43 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T19:34:44.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:43 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:34:44.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:43 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:34:44.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:43 smithi188 ceph-mon[43939]: osdmap e285: 12 total, 12 up, 12 in 2024-04-01T19:34:44.483 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:34:44.569 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 39 16 103194 103178 165.325 108.75 0.00969951 0.00604699 2024-04-01T19:34:44.747 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:44 smithi022 ceph-mon[39439]: pgmap v821: 17 pgs: 17 active+clean; 5.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 118 MiB/s wr, 1.89k op/s 2024-04-01T19:34:44.747 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:44 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1918241231' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:34:44.747 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:44 smithi022 ceph-mon[39439]: from='client.25513 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:34:44.756 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:34:45.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:44 smithi062 ceph-mon[44211]: pgmap v821: 17 pgs: 17 active+clean; 5.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 118 MiB/s wr, 1.89k op/s 2024-04-01T19:34:45.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:44 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1918241231' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:34:45.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:44 smithi062 ceph-mon[44211]: from='client.25513 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:34:45.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:44 smithi188 ceph-mon[43939]: pgmap v821: 17 pgs: 17 active+clean; 5.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 118 MiB/s wr, 1.89k op/s 2024-04-01T19:34:45.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:44 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1918241231' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:34:45.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:44 smithi188 ceph-mon[43939]: from='client.25513 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:34:45.296 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:34:45.331 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:34:45.358 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:34:45.392 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:34:45.420 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:34:45.457 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:34:45.490 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:34:45.524 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:34:45.559 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:34:45.569 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:34:45.572671 min lat: 0.00107168 max lat: 0.217443 avg lat: 0.00609914 2024-04-01T19:34:45.569 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:34:45.569 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 40 16 104932 104916 163.908 108.625 0.0111186 0.00609914 2024-04-01T19:34:45.593 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:34:45.627 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:34:45.661 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:34:45.664 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:34:45.664 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:34:45.664 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:34:45.664 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:34:45.664 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:34:45.664 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:34:45.664 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:34:45.664 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:34:45.664 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:34:45.664 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:34:45.664 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:34:45.664 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:34:46.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:45 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:34:46.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:45 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:34:46.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:45 smithi062 ceph-mon[44211]: from='client.25513 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:34:46.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:45 smithi062 ceph-mon[44211]: osdmap e286: 12 total, 12 up, 12 in 2024-04-01T19:34:46.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:45 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/970162362' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:34:46.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:45 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:46.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:45 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:34:46.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:45 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:34:46.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:45 smithi022 ceph-mon[39439]: from='client.25513 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:34:46.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:45 smithi022 ceph-mon[39439]: osdmap e286: 12 total, 12 up, 12 in 2024-04-01T19:34:46.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:45 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/970162362' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:34:46.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:45 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:46.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:45 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:34:46.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:45 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:34:46.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:45 smithi188 ceph-mon[43939]: from='client.25513 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:34:46.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:45 smithi188 ceph-mon[43939]: osdmap e286: 12 total, 12 up, 12 in 2024-04-01T19:34:46.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:45 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/970162362' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:34:46.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:45 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:46.570 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 41 16 106687 106671 162.585 109.688 0.00867319 0.00614906 2024-04-01T19:34:47.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:46 smithi022 ceph-mon[39439]: pgmap v823: 17 pgs: 17 active+clean; 6.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 123 MiB/s wr, 1.96k op/s 2024-04-01T19:34:47.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:46 smithi188 ceph-mon[43939]: pgmap v823: 17 pgs: 17 active+clean; 6.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 123 MiB/s wr, 1.96k op/s 2024-04-01T19:34:47.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:46 smithi062 ceph-mon[44211]: pgmap v823: 17 pgs: 17 active+clean; 6.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 123 MiB/s wr, 1.96k op/s 2024-04-01T19:34:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:47.570 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 42 16 108466 108450 161.361 111.188 0.00476052 0.00619593 2024-04-01T19:34:48.037 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:34:48.042 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:48.042 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:34:48.143 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:34:48.218 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:48.241 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:34:48.243 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:48.243 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:34:48.344 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:34:48.379 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:48.406 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:34:48.412 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:48.412 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:34:48.513 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:34:48.551 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:48.570 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 43 16 110197 110181 160.124 108.188 0.0202976 0.0062436 2024-04-01T19:34:48.582 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:34:48.585 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:48.585 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:34:48.686 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:34:48.738 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:48.763 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:34:48.766 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:48.766 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:34:48.867 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:34:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:48 smithi188 ceph-mon[43939]: pgmap v824: 17 pgs: 17 active+clean; 6.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 129 MiB/s wr, 2.07k op/s 2024-04-01T19:34:48.901 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:48.925 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:34:48.929 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:48.930 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:34:49.031 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:34:49.095 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:48 smithi022 ceph-mon[39439]: pgmap v824: 17 pgs: 17 active+clean; 6.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 129 MiB/s wr, 2.07k op/s 2024-04-01T19:34:49.099 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:49.129 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:34:49.136 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:49.137 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:34:49.221 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:34:49.221 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 20, 2024-04-01T19:34:49.221 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 600, 2024-04-01T19:34:49.221 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:34:49.221 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.222 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:171389 2.c e141/106 2:30e61d70:::benchmark_data_smithi188_77607_object3985:head v 141'10760, mlcod=141'10757)", 2024-04-01T19:34:49.222 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:40.367747+0000", 2024-04-01T19:34:49.222 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 488.853959519, 2024-04-01T19:34:49.222 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.075827662000000004, 2024-04-01T19:34:49.222 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:49.222 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:49.222 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:49.222 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:49.222 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.222 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:49.222 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.367747+0000", 2024-04-01T19:34:49.222 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.222 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.223 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.223 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:49.223 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.367747+0000", 2024-04-01T19:34:49.223 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.223 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.223 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.223 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:49.223 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.367749+0000", 2024-04-01T19:34:49.223 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7099999999999999e-06 2024-04-01T19:34:49.223 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.223 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.223 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:49.223 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.367760+0000", 2024-04-01T19:34:49.223 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.132e-05 2024-04-01T19:34:49.223 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.224 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.224 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:49.224 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.367782+0000", 2024-04-01T19:34:49.224 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1880999999999999e-05 2024-04-01T19:34:49.224 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.224 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.224 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:49.224 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.367792+0000", 2024-04-01T19:34:49.224 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.8269999999999993e-06 2024-04-01T19:34:49.224 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.224 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.224 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.224 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.370508+0000", 2024-04-01T19:34:49.224 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.002716118 2024-04-01T19:34:49.225 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.225 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.225 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:34:49.225 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.370542+0000", 2024-04-01T19:34:49.225 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3887999999999998e-05 2024-04-01T19:34:49.225 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.225 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.225 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:34:49.225 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.443529+0000", 2024-04-01T19:34:49.225 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.072986933000000004 2024-04-01T19:34:49.225 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.225 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.225 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:34:49.225 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.443575+0000", 2024-04-01T19:34:49.226 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5985000000000001e-05 2024-04-01T19:34:49.226 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.226 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:49.226 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.226 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.226 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.226 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.1.0:35383 2.4 e141/106 2:263f2ea9:::benchmark_data_smithi188_77607_object44958:head v 141'13799, mlcod=141'13790)", 2024-04-01T19:34:49.226 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:40.401656+0000", 2024-04-01T19:34:49.226 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 488.820050364, 2024-04-01T19:34:49.226 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.074950158000000003, 2024-04-01T19:34:49.226 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:49.226 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:49.226 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:49.226 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:49.227 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.227 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:49.227 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.401656+0000", 2024-04-01T19:34:49.227 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.227 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.227 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.227 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:49.227 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.401656+0000", 2024-04-01T19:34:49.227 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.227 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.227 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.227 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:49.227 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.401661+0000", 2024-04-01T19:34:49.227 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9690000000000002e-06 2024-04-01T19:34:49.228 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.228 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.228 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:49.228 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.401670+0000", 2024-04-01T19:34:49.228 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.9619999999999999e-06 2024-04-01T19:34:49.228 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.228 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.228 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:49.228 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.401681+0000", 2024-04-01T19:34:49.228 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1100999999999999e-05 2024-04-01T19:34:49.228 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.228 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.228 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:49.228 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.401690+0000", 2024-04-01T19:34:49.229 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3909999999999998e-06 2024-04-01T19:34:49.229 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.229 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.229 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.229 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.418821+0000", 2024-04-01T19:34:49.229 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.017131368000000001 2024-04-01T19:34:49.229 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.229 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.229 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:34:49.229 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.418845+0000", 2024-04-01T19:34:49.229 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3821000000000001e-05 2024-04-01T19:34:49.229 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.229 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.229 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:34:49.229 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.476556+0000", 2024-04-01T19:34:49.230 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.057711195999999999 2024-04-01T19:34:49.230 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.230 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.230 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:34:49.230 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.476607+0000", 2024-04-01T19:34:49.230 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0349999999999997e-05 2024-04-01T19:34:49.230 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.230 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:49.230 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.230 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.230 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.230 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.1.0:35384 2.4 e141/106 2:263f5065:::benchmark_data_smithi188_77607_object69253:head v 141'13800, mlcod=141'13790)", 2024-04-01T19:34:49.230 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:40.401703+0000", 2024-04-01T19:34:49.230 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 488.82000388300003, 2024-04-01T19:34:49.230 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.078446964999999994, 2024-04-01T19:34:49.231 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:49.231 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:49.231 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:49.231 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:49.231 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.231 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:49.231 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.401703+0000", 2024-04-01T19:34:49.231 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.231 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.231 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.231 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:49.231 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.401703+0000", 2024-04-01T19:34:49.231 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.231 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.231 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.231 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:49.232 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.401703+0000", 2024-04-01T19:34:49.232 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9200000000000001e-07 2024-04-01T19:34:49.232 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.232 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.232 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:49.232 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.401708+0000", 2024-04-01T19:34:49.232 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1330000000000001e-06 2024-04-01T19:34:49.232 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.232 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.232 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:49.232 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.401712+0000", 2024-04-01T19:34:49.232 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5959999999999997e-06 2024-04-01T19:34:49.232 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.232 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.232 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:49.233 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.401717+0000", 2024-04-01T19:34:49.233 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.3680000000000004e-06 2024-04-01T19:34:49.233 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.233 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.233 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.233 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.428475+0000", 2024-04-01T19:34:49.233 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.026758612000000001 2024-04-01T19:34:49.233 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.233 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.233 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:34:49.233 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.428501+0000", 2024-04-01T19:34:49.233 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5448000000000001e-05 2024-04-01T19:34:49.233 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.233 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.233 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:34:49.233 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.480103+0000", 2024-04-01T19:34:49.234 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.051602093000000002 2024-04-01T19:34:49.234 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.234 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.234 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:34:49.234 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.480150+0000", 2024-04-01T19:34:49.234 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7222999999999998e-05 2024-04-01T19:34:49.234 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.234 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:49.234 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.234 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.234 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.234 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:171414 2.c e141/106 2:3e1acc7a:::benchmark_data_smithi188_77607_object4010:head v 141'10763, mlcod=141'10758)", 2024-04-01T19:34:49.234 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:40.402164+0000", 2024-04-01T19:34:49.234 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 488.81954277300002, 2024-04-01T19:34:49.235 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.074490039999999993, 2024-04-01T19:34:49.235 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:49.235 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:49.235 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:49.235 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:49.235 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.235 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:49.235 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.402164+0000", 2024-04-01T19:34:49.235 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.235 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.235 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.235 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:49.235 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.402164+0000", 2024-04-01T19:34:49.235 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.235 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.235 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.236 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:49.236 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.402165+0000", 2024-04-01T19:34:49.236 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.172e-06 2024-04-01T19:34:49.236 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.236 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.236 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:49.236 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.402173+0000", 2024-04-01T19:34:49.236 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3980000000000002e-06 2024-04-01T19:34:49.236 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.236 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.236 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:49.236 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.402181+0000", 2024-04-01T19:34:49.236 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0839999999999992e-06 2024-04-01T19:34:49.236 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.236 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.237 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:49.237 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.402189+0000", 2024-04-01T19:34:49.237 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2500000000000006e-06 2024-04-01T19:34:49.237 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.237 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.237 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.237 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.423628+0000", 2024-04-01T19:34:49.237 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.021438784999999998 2024-04-01T19:34:49.237 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.237 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.237 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:34:49.237 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.423652+0000", 2024-04-01T19:34:49.237 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4019000000000002e-05 2024-04-01T19:34:49.237 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.237 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.237 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:34:49.238 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.476614+0000", 2024-04-01T19:34:49.238 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.052961966999999999 2024-04-01T19:34:49.238 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.238 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.238 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:34:49.238 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.476654+0000", 2024-04-01T19:34:49.238 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.0364999999999997e-05 2024-04-01T19:34:49.238 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.238 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:49.238 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.238 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.238 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.238 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.1.0:35387 2.4 e141/106 2:263f9941:::benchmark_data_smithi188_77607_object136523:head v 141'13801, mlcod=141'13790)", 2024-04-01T19:34:49.239 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:40.403478+0000", 2024-04-01T19:34:49.239 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 488.81822836399999, 2024-04-01T19:34:49.239 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.076709094000000005, 2024-04-01T19:34:49.239 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:49.239 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:49.239 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:49.239 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:49.239 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.239 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:49.239 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.403478+0000", 2024-04-01T19:34:49.239 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.239 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.239 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.239 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:49.239 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.403478+0000", 2024-04-01T19:34:49.240 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.240 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.240 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.240 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:49.240 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.403480+0000", 2024-04-01T19:34:49.240 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3650000000000001e-06 2024-04-01T19:34:49.240 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.240 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.240 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:49.240 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.403487+0000", 2024-04-01T19:34:49.240 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2099999999999996e-06 2024-04-01T19:34:49.240 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.240 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.240 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:49.240 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.403496+0000", 2024-04-01T19:34:49.240 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.4420000000000004e-06 2024-04-01T19:34:49.241 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.241 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.241 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:49.241 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.403504+0000", 2024-04-01T19:34:49.241 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.8329999999999994e-06 2024-04-01T19:34:49.241 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.241 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.241 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.241 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.433160+0000", 2024-04-01T19:34:49.241 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.029655461000000001 2024-04-01T19:34:49.241 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.241 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.241 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:34:49.241 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.433186+0000", 2024-04-01T19:34:49.242 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.618e-05 2024-04-01T19:34:49.242 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.242 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.242 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:34:49.242 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.480156+0000", 2024-04-01T19:34:49.242 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.046970235999999999 2024-04-01T19:34:49.242 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.242 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.242 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:34:49.242 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.480188+0000", 2024-04-01T19:34:49.242 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.1367e-05 2024-04-01T19:34:49.242 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.242 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:49.242 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.242 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.243 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.243 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.1.0:35388 2.4 e141/106 2:263fd74d:::benchmark_data_smithi188_77607_object104294:head v 141'13802, mlcod=141'13790)", 2024-04-01T19:34:49.243 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:40.407255+0000", 2024-04-01T19:34:49.243 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 488.814451921, 2024-04-01T19:34:49.243 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.087972185999999994, 2024-04-01T19:34:49.243 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:49.243 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:49.243 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:49.243 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:49.243 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.243 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:49.243 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.407255+0000", 2024-04-01T19:34:49.243 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.243 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.243 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.244 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:49.244 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.407255+0000", 2024-04-01T19:34:49.244 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.244 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.244 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.244 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:49.244 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.407257+0000", 2024-04-01T19:34:49.244 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.888e-06 2024-04-01T19:34:49.244 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.244 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.244 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:49.244 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.407267+0000", 2024-04-01T19:34:49.244 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.8630000000000003e-06 2024-04-01T19:34:49.244 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.244 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.245 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:49.245 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.407283+0000", 2024-04-01T19:34:49.245 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6180000000000001e-05 2024-04-01T19:34:49.245 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.245 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.245 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:49.245 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.407291+0000", 2024-04-01T19:34:49.245 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2740000000000007e-06 2024-04-01T19:34:49.245 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.245 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.245 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.245 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.443237+0000", 2024-04-01T19:34:49.245 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.035946120999999998 2024-04-01T19:34:49.245 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.245 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.245 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:34:49.246 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.443262+0000", 2024-04-01T19:34:49.246 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4351000000000001e-05 2024-04-01T19:34:49.246 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.246 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.246 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:34:49.246 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.495183+0000", 2024-04-01T19:34:49.246 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.051921448000000002 2024-04-01T19:34:49.246 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.246 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.246 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:34:49.246 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.495227+0000", 2024-04-01T19:34:49.246 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4060999999999997e-05 2024-04-01T19:34:49.246 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.246 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:49.247 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.247 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.247 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.247 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.1.0:35391 2.4 e141/106 2:263fd8c7:::benchmark_data_smithi188_77607_object24889:head v 141'13803, mlcod=141'13790)", 2024-04-01T19:34:49.247 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:40.412568+0000", 2024-04-01T19:34:49.247 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 488.80913869199998, 2024-04-01T19:34:49.247 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.082698137000000005, 2024-04-01T19:34:49.247 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:49.247 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:49.247 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:49.247 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:49.247 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.247 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:49.247 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.412568+0000", 2024-04-01T19:34:49.247 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.248 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.248 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.248 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:49.248 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.412568+0000", 2024-04-01T19:34:49.248 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.248 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.248 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.248 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:49.248 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.412570+0000", 2024-04-01T19:34:49.248 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0530000000000001e-06 2024-04-01T19:34:49.248 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.248 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.248 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:49.248 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.412580+0000", 2024-04-01T19:34:49.248 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.9070000000000002e-06 2024-04-01T19:34:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.412601+0000", 2024-04-01T19:34:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1081e-05 2024-04-01T19:34:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.412610+0000", 2024-04-01T19:34:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6910000000000003e-06 2024-04-01T19:34:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.449019+0000", 2024-04-01T19:34:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.03640935 2024-04-01T19:34:49.249 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.250 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.250 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:34:49.250 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.449040+0000", 2024-04-01T19:34:49.250 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.107e-05 2024-04-01T19:34:49.250 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.250 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.250 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:34:49.250 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.495235+0000", 2024-04-01T19:34:49.250 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.046194812000000002 2024-04-01T19:34:49.250 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.250 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.250 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:34:49.250 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.495266+0000", 2024-04-01T19:34:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.1173000000000001e-05 2024-04-01T19:34:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.1.0:35392 2.4 e141/106 2:263fedef:::benchmark_data_smithi188_77607_object66424:head v 141'13804, mlcod=141'13790)", 2024-04-01T19:34:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:40.417596+0000", 2024-04-01T19:34:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 488.80411072999999, 2024-04-01T19:34:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.077735936000000005, 2024-04-01T19:34:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.251 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.417596+0000", 2024-04-01T19:34:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.417596+0000", 2024-04-01T19:34:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.417598+0000", 2024-04-01T19:34:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9800000000000001e-06 2024-04-01T19:34:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.252 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.417607+0000", 2024-04-01T19:34:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.4210000000000001e-06 2024-04-01T19:34:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.417627+0000", 2024-04-01T19:34:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9130000000000001e-05 2024-04-01T19:34:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.417635+0000", 2024-04-01T19:34:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8289999999999997e-06 2024-04-01T19:34:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.253 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.453347+0000", 2024-04-01T19:34:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.035711439999999997 2024-04-01T19:34:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:34:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.453372+0000", 2024-04-01T19:34:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4632000000000001e-05 2024-04-01T19:34:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:34:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.495303+0000", 2024-04-01T19:34:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.041931163 2024-04-01T19:34:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.254 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:34:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.495332+0000", 2024-04-01T19:34:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.9340999999999999e-05 2024-04-01T19:34:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.1.0:35404 2.4 e141/106 2:264578d7:::benchmark_data_smithi188_77607_object74429:head v 141'13815, mlcod=141'13790)", 2024-04-01T19:34:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:40.455071+0000", 2024-04-01T19:34:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 488.76663619200002, 2024-04-01T19:34:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.075956894999999996, 2024-04-01T19:34:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:49.255 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.455071+0000", 2024-04-01T19:34:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.455071+0000", 2024-04-01T19:34:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.256 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.455072+0000", 2024-04-01T19:34:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0729999999999999e-06 2024-04-01T19:34:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.455078+0000", 2024-04-01T19:34:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4300000000000003e-06 2024-04-01T19:34:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.455087+0000", 2024-04-01T19:34:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.7409999999999998e-06 2024-04-01T19:34:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.257 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.455094+0000", 2024-04-01T19:34:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9360000000000002e-06 2024-04-01T19:34:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.514312+0000", 2024-04-01T19:34:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.059218162999999997 2024-04-01T19:34:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:34:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.514326+0000", 2024-04-01T19:34:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4029000000000001e-05 2024-04-01T19:34:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.258 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:34:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.530979+0000", 2024-04-01T19:34:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.016653257000000001 2024-04-01T19:34:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:34:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.531028+0000", 2024-04-01T19:34:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8266000000000002e-05 2024-04-01T19:34:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:171408 2.4 e141/106 2:2138250a:::benchmark_data_smithi188_77607_object4004:head v 141'13816, mlcod=141'13795)", 2024-04-01T19:34:49.259 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:40.459100+0000", 2024-04-01T19:34:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 488.76260671300003, 2024-04-01T19:34:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.078224157000000002, 2024-04-01T19:34:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:34:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.459100+0000", 2024-04-01T19:34:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:49.260 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.459100+0000", 2024-04-01T19:34:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.459101+0000", 2024-04-01T19:34:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2020000000000001e-06 2024-04-01T19:34:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.459108+0000", 2024-04-01T19:34:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3210000000000001e-06 2024-04-01T19:34:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.261 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:49.262 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.459116+0000", 2024-04-01T19:34:49.262 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5730000000000008e-06 2024-04-01T19:34:49.262 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.262 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.262 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:49.262 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.459123+0000", 2024-04-01T19:34:49.262 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.6630000000000004e-06 2024-04-01T19:34:49.262 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.262 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.262 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.262 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.518614+0000", 2024-04-01T19:34:49.262 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.059491113999999998 2024-04-01T19:34:49.262 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.262 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.263 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:34:49.263 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.518633+0000", 2024-04-01T19:34:49.265 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8885999999999998e-05 2024-04-01T19:34:49.265 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.265 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.266 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:34:49.266 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.537291+0000", 2024-04-01T19:34:49.266 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.018658623999999999 2024-04-01T19:34:49.266 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.266 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.266 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:34:49.266 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.537324+0000", 2024-04-01T19:34:49.266 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.2774000000000002e-05 2024-04-01T19:34:49.266 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.266 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:49.266 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.266 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.266 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.267 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:265195 2.5 2.a09f2ad5 (undecoded) ondisk+retry+write+known_if_redirected e168)", 2024-04-01T19:34:49.267 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:29.546482+0000", 2024-04-01T19:34:49.267 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 379.67522482099997, 2024-04-01T19:34:49.267 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.23907231900000001, 2024-04-01T19:34:49.267 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:49.267 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:49.267 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "reached pg", 2024-04-01T19:34:49.267 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:34:49.267 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:34:49.267 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:34:49.267 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 265195 2024-04-01T19:34:49.267 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.267 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:49.267 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.267 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:49.268 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546482+0000", 2024-04-01T19:34:49.268 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.268 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.268 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.268 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:49.268 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546482+0000", 2024-04-01T19:34:49.268 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.268 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.268 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.268 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:49.268 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546484+0000", 2024-04-01T19:34:49.268 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.793e-06 2024-04-01T19:34:49.268 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.268 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.268 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:49.269 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546489+0000", 2024-04-01T19:34:49.269 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9370000000000003e-06 2024-04-01T19:34:49.269 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.269 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.269 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:49.269 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546501+0000", 2024-04-01T19:34:49.269 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1970000000000001e-05 2024-04-01T19:34:49.269 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.269 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.269 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:49.269 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546508+0000", 2024-04-01T19:34:49.269 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5900000000000002e-06 2024-04-01T19:34:49.269 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.269 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.269 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.270 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546572+0000", 2024-04-01T19:34:49.270 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4181000000000001e-05 2024-04-01T19:34:49.270 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.270 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.270 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for peered", 2024-04-01T19:34:49.270 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546579+0000", 2024-04-01T19:34:49.270 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4150000000000004e-06 2024-04-01T19:34:49.270 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.270 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.270 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.270 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.785502+0000", 2024-04-01T19:34:49.270 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.238922987 2024-04-01T19:34:49.270 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.271 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.271 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:34:49.271 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.785554+0000", 2024-04-01T19:34:49.271 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2445999999999999e-05 2024-04-01T19:34:49.271 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.271 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:49.271 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.271 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.271 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.271 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:265196 2.5 2.4213aaf5 (undecoded) ondisk+retry+write+known_if_redirected e168)", 2024-04-01T19:34:49.271 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:29.546538+0000", 2024-04-01T19:34:49.271 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 379.675169181, 2024-04-01T19:34:49.271 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.239062528, 2024-04-01T19:34:49.271 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:49.271 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:49.272 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "reached pg", 2024-04-01T19:34:49.272 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:34:49.272 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:34:49.272 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:34:49.272 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 265196 2024-04-01T19:34:49.272 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.272 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:49.272 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.272 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:49.272 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546538+0000", 2024-04-01T19:34:49.272 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.272 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.272 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.272 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:49.272 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546538+0000", 2024-04-01T19:34:49.272 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.273 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.273 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.273 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:49.273 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546539+0000", 2024-04-01T19:34:49.273 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.9100000000000002e-07 2024-04-01T19:34:49.273 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.273 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.273 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:49.273 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546543+0000", 2024-04-01T19:34:49.273 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.2289999999999997e-06 2024-04-01T19:34:49.273 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.273 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.273 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:49.273 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546549+0000", 2024-04-01T19:34:49.274 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1569999999999997e-06 2024-04-01T19:34:49.274 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.274 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.274 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:49.274 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546553+0000", 2024-04-01T19:34:49.274 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.3089999999999997e-06 2024-04-01T19:34:49.274 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.274 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.274 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.274 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546617+0000", 2024-04-01T19:34:49.274 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3868000000000006e-05 2024-04-01T19:34:49.274 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.274 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.274 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for peered", 2024-04-01T19:34:49.275 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546626+0000", 2024-04-01T19:34:49.275 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.7700000000000007e-06 2024-04-01T19:34:49.275 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.275 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.275 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.275 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.785591+0000", 2024-04-01T19:34:49.275 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.23896531900000001 2024-04-01T19:34:49.275 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.275 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.275 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:34:49.275 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.785600+0000", 2024-04-01T19:34:49.275 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.9849999999999995e-06 2024-04-01T19:34:49.275 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.275 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:49.275 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.275 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.276 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.276 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:265200 2.5 2.79d60dd5 (undecoded) ondisk+retry+write+known_if_redirected e168)", 2024-04-01T19:34:49.276 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:29.546561+0000", 2024-04-01T19:34:49.276 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 379.67514564999999, 2024-04-01T19:34:49.276 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.23913856999999999, 2024-04-01T19:34:49.276 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:49.276 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:49.276 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "reached pg", 2024-04-01T19:34:49.276 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:34:49.276 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:34:49.276 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:34:49.276 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 265200 2024-04-01T19:34:49.276 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.276 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:49.276 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.277 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:49.277 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546561+0000", 2024-04-01T19:34:49.277 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.277 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.277 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.277 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:49.277 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546561+0000", 2024-04-01T19:34:49.277 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.277 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.277 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.277 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:49.277 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546562+0000", 2024-04-01T19:34:49.277 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4700000000000001e-07 2024-04-01T19:34:49.277 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.278 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.278 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:49.278 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546565+0000", 2024-04-01T19:34:49.278 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.7889999999999999e-06 2024-04-01T19:34:49.278 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.278 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.278 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:49.278 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546570+0000", 2024-04-01T19:34:49.278 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3449999999999996e-06 2024-04-01T19:34:49.278 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.278 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.278 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:49.278 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546576+0000", 2024-04-01T19:34:49.279 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0399999999999998e-06 2024-04-01T19:34:49.279 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.279 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.279 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.279 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546669+0000", 2024-04-01T19:34:49.279 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.2901999999999999e-05 2024-04-01T19:34:49.279 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.279 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.279 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for peered", 2024-04-01T19:34:49.279 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546676+0000", 2024-04-01T19:34:49.279 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9800000000000001e-06 2024-04-01T19:34:49.279 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.279 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.279 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.279 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.785682+0000", 2024-04-01T19:34:49.279 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.239005993 2024-04-01T19:34:49.280 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.280 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.280 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:34:49.280 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.785700+0000", 2024-04-01T19:34:49.280 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7774e-05 2024-04-01T19:34:49.280 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.280 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:49.280 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.280 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.280 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.280 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:265228 2.5 2.bcae0335 (undecoded) ondisk+retry+write+known_if_redirected e168)", 2024-04-01T19:34:49.280 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:29.546582+0000", 2024-04-01T19:34:49.280 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 379.67512452900002, 2024-04-01T19:34:49.280 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.239201578, 2024-04-01T19:34:49.281 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:49.281 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:49.281 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "reached pg", 2024-04-01T19:34:49.281 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:34:49.281 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:34:49.281 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:34:49.281 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 265228 2024-04-01T19:34:49.281 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.281 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:49.281 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.281 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:49.281 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546582+0000", 2024-04-01T19:34:49.281 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.281 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.281 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.282 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:49.282 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546582+0000", 2024-04-01T19:34:49.282 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.282 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.282 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.282 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:49.282 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546583+0000", 2024-04-01T19:34:49.282 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9699999999999995e-07 2024-04-01T19:34:49.282 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.282 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.282 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:49.282 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546586+0000", 2024-04-01T19:34:49.282 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.7360000000000001e-06 2024-04-01T19:34:49.282 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.283 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.283 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:49.283 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546591+0000", 2024-04-01T19:34:49.283 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7049999999999996e-06 2024-04-01T19:34:49.283 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.283 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.283 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:49.283 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546597+0000", 2024-04-01T19:34:49.283 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5389999999999998e-06 2024-04-01T19:34:49.283 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.283 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.283 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.283 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546706+0000", 2024-04-01T19:34:49.283 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000108615 2024-04-01T19:34:49.283 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.284 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.284 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for peered", 2024-04-01T19:34:49.284 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546710+0000", 2024-04-01T19:34:49.284 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4950000000000002e-06 2024-04-01T19:34:49.284 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.284 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.284 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.284 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.785766+0000", 2024-04-01T19:34:49.284 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.23905596000000001 2024-04-01T19:34:49.284 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.284 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.284 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:34:49.284 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.785784+0000", 2024-04-01T19:34:49.284 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7830999999999999e-05 2024-04-01T19:34:49.284 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.285 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:49.285 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.285 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.285 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.285 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:265232 2.5 2.e8b4b2d5 (undecoded) ondisk+retry+write+known_if_redirected e168)", 2024-04-01T19:34:49.285 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:29.546603+0000", 2024-04-01T19:34:49.285 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 379.67510341399998, 2024-04-01T19:34:49.285 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.239291751, 2024-04-01T19:34:49.285 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:49.285 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:49.285 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "reached pg", 2024-04-01T19:34:49.285 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:34:49.285 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:34:49.285 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:34:49.286 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 265232 2024-04-01T19:34:49.286 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.286 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:49.286 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.286 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:49.286 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546603+0000", 2024-04-01T19:34:49.286 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.286 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.286 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.286 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:49.286 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546603+0000", 2024-04-01T19:34:49.286 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.286 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.287 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.287 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:49.287 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546604+0000", 2024-04-01T19:34:49.287 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2900000000000003e-07 2024-04-01T19:34:49.287 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.287 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.287 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:49.287 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546606+0000", 2024-04-01T19:34:49.287 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3740000000000001e-06 2024-04-01T19:34:49.287 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.287 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.287 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:49.287 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546616+0000", 2024-04-01T19:34:49.287 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.3170000000000008e-06 2024-04-01T19:34:49.287 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.288 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.288 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:49.288 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546622+0000", 2024-04-01T19:34:49.288 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8719999999999999e-06 2024-04-01T19:34:49.288 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.288 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.288 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.288 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546731+0000", 2024-04-01T19:34:49.288 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000109491 2024-04-01T19:34:49.288 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.288 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.288 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for peered", 2024-04-01T19:34:49.288 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.546737+0000", 2024-04-01T19:34:49.288 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9359999999999996e-06 2024-04-01T19:34:49.289 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.289 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.289 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.289 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.785883+0000", 2024-04-01T19:34:49.289 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.23914633800000001 2024-04-01T19:34:49.289 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.289 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.289 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:34:49.289 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:29.785895+0000", 2024-04-01T19:34:49.289 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1793999999999999e-05 2024-04-01T19:34:49.289 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.289 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:49.289 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.289 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.290 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.290 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:265195 2.5 2.a09f2ad5 (undecoded) ondisk+retry+write+known_if_redirected e170)", 2024-04-01T19:34:49.290 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:30.811035+0000", 2024-04-01T19:34:49.290 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 378.410672256, 2024-04-01T19:34:49.290 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.85375858199999999, 2024-04-01T19:34:49.290 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:49.290 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:49.290 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "reached pg", 2024-04-01T19:34:49.290 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:34:49.290 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:34:49.290 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:34:49.290 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 265195 2024-04-01T19:34:49.290 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.291 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:49.291 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.291 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:49.291 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811035+0000", 2024-04-01T19:34:49.291 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.291 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.291 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.291 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:49.291 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811035+0000", 2024-04-01T19:34:49.291 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.291 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.291 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.291 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:49.291 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811037+0000", 2024-04-01T19:34:49.292 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5809999999999999e-06 2024-04-01T19:34:49.292 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.292 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.292 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:49.292 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811042+0000", 2024-04-01T19:34:49.292 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0719999999999999e-06 2024-04-01T19:34:49.292 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.292 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.292 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:49.292 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811053+0000", 2024-04-01T19:34:49.292 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0346000000000001e-05 2024-04-01T19:34:49.292 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.292 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.292 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:49.292 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811060+0000", 2024-04-01T19:34:49.293 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5950000000000001e-06 2024-04-01T19:34:49.293 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.293 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.293 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.293 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811107+0000", 2024-04-01T19:34:49.293 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7246999999999997e-05 2024-04-01T19:34:49.293 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.293 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.293 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for peered", 2024-04-01T19:34:49.293 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811116+0000", 2024-04-01T19:34:49.293 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.7260000000000008e-06 2024-04-01T19:34:49.293 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.293 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.293 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.293 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:31.664766+0000", 2024-04-01T19:34:49.294 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.85364939900000003 2024-04-01T19:34:49.294 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.294 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.294 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:34:49.294 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:31.664793+0000", 2024-04-01T19:34:49.294 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.7616000000000001e-05 2024-04-01T19:34:49.294 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.294 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:49.294 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.294 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.294 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.294 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:265196 2.5 2.4213aaf5 (undecoded) ondisk+retry+write+known_if_redirected e170)", 2024-04-01T19:34:49.294 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:30.811078+0000", 2024-04-01T19:34:49.294 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 378.41062836399999, 2024-04-01T19:34:49.295 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.85387833400000002, 2024-04-01T19:34:49.295 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:49.295 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:49.295 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "reached pg", 2024-04-01T19:34:49.295 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:34:49.295 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:34:49.295 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:34:49.295 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 265196 2024-04-01T19:34:49.295 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.295 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:49.295 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.295 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:49.295 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811078+0000", 2024-04-01T19:34:49.295 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.296 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.296 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.296 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:49.296 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811078+0000", 2024-04-01T19:34:49.296 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.296 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.296 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.296 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:49.296 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811079+0000", 2024-04-01T19:34:49.296 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3099999999999997e-07 2024-04-01T19:34:49.296 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.296 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.296 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:49.296 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811082+0000", 2024-04-01T19:34:49.296 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.689e-06 2024-04-01T19:34:49.297 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.297 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.297 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:49.297 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811086+0000", 2024-04-01T19:34:49.297 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.2300000000000002e-06 2024-04-01T19:34:49.297 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.297 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.297 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:49.297 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811090+0000", 2024-04-01T19:34:49.297 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.6179999999999999e-06 2024-04-01T19:34:49.297 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.297 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.297 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.297 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811160+0000", 2024-04-01T19:34:49.297 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9930000000000003e-05 2024-04-01T19:34:49.298 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.298 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.298 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for peered", 2024-04-01T19:34:49.298 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811169+0000", 2024-04-01T19:34:49.298 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.4380000000000001e-06 2024-04-01T19:34:49.298 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.298 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.298 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.298 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:31.664949+0000", 2024-04-01T19:34:49.298 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.85377973699999998 2024-04-01T19:34:49.298 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.298 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.298 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:34:49.298 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:31.664957+0000", 2024-04-01T19:34:49.299 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0609999999999996e-06 2024-04-01T19:34:49.299 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.299 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:49.299 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.299 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.299 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.299 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:265200 2.5 2.79d60dd5 (undecoded) ondisk+retry+write+known_if_redirected e170)", 2024-04-01T19:34:49.299 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:30.811094+0000", 2024-04-01T19:34:49.299 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 378.410612609, 2024-04-01T19:34:49.299 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.85394860699999997, 2024-04-01T19:34:49.299 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:49.299 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:49.299 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "reached pg", 2024-04-01T19:34:49.299 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:34:49.299 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:34:49.300 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:34:49.300 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 265200 2024-04-01T19:34:49.300 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.300 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:49.300 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.300 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:49.300 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811094+0000", 2024-04-01T19:34:49.300 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.300 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.300 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.300 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:49.300 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811094+0000", 2024-04-01T19:34:49.300 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.300 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.300 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.300 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:49.301 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811095+0000", 2024-04-01T19:34:49.301 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3200000000000001e-07 2024-04-01T19:34:49.301 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.301 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.301 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:49.301 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811104+0000", 2024-04-01T19:34:49.301 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.8940000000000005e-06 2024-04-01T19:34:49.301 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.301 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.301 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:49.301 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811108+0000", 2024-04-01T19:34:49.301 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5779999999999999e-06 2024-04-01T19:34:49.301 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.301 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.301 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:49.301 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811111+0000", 2024-04-01T19:34:49.302 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.0879999999999999e-06 2024-04-01T19:34:49.302 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.302 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.302 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.302 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811203+0000", 2024-04-01T19:34:49.302 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.1568000000000001e-05 2024-04-01T19:34:49.302 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.302 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.302 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for peered", 2024-04-01T19:34:49.302 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811210+0000", 2024-04-01T19:34:49.302 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.08e-06 2024-04-01T19:34:49.302 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.302 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.302 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.303 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:31.665033+0000", 2024-04-01T19:34:49.303 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.85382338999999996 2024-04-01T19:34:49.303 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.303 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.303 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:34:49.303 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:31.665043+0000", 2024-04-01T19:34:49.303 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.6770000000000007e-06 2024-04-01T19:34:49.303 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.303 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:49.303 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.303 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.303 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.303 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:265228 2.5 2.bcae0335 (undecoded) ondisk+retry+write+known_if_redirected e170)", 2024-04-01T19:34:49.303 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:30.811116+0000", 2024-04-01T19:34:49.303 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 378.41059065299999, 2024-04-01T19:34:49.303 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.85394903099999997, 2024-04-01T19:34:49.304 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:49.304 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:49.304 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "reached pg", 2024-04-01T19:34:49.304 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:34:49.304 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:34:49.304 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:34:49.304 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 265228 2024-04-01T19:34:49.304 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.304 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:49.304 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.304 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:49.304 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811116+0000", 2024-04-01T19:34:49.304 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.304 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.304 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.304 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:49.305 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811116+0000", 2024-04-01T19:34:49.305 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.305 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.305 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.305 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:49.305 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811117+0000", 2024-04-01T19:34:49.305 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.8599999999999999e-07 2024-04-01T19:34:49.305 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.305 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.305 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:49.305 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811119+0000", 2024-04-01T19:34:49.305 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4389999999999999e-06 2024-04-01T19:34:49.305 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.305 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.306 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:49.306 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811122+0000", 2024-04-01T19:34:49.306 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3919999999999999e-06 2024-04-01T19:34:49.306 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.306 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.306 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:49.306 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811125+0000", 2024-04-01T19:34:49.306 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.9969999999999999e-06 2024-04-01T19:34:49.306 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.306 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.306 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.306 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811262+0000", 2024-04-01T19:34:49.306 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000136792 2024-04-01T19:34:49.306 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.307 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.307 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for peered", 2024-04-01T19:34:49.307 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811275+0000", 2024-04-01T19:34:49.307 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3266e-05 2024-04-01T19:34:49.307 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.307 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.307 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.307 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:31.665059+0000", 2024-04-01T19:34:49.307 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.85378384200000002 2024-04-01T19:34:49.307 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.307 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.307 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:34:49.307 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:31.665065+0000", 2024-04-01T19:34:49.307 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9170000000000003e-06 2024-04-01T19:34:49.307 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.308 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:49.308 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.308 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.308 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.308 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:265232 2.5 2.e8b4b2d5 (undecoded) ondisk+retry+write+known_if_redirected e170)", 2024-04-01T19:34:49.308 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:30.811151+0000", 2024-04-01T19:34:49.308 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 378.41055588, 2024-04-01T19:34:49.308 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.85409733899999996, 2024-04-01T19:34:49.308 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:49.308 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:49.308 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "reached pg", 2024-04-01T19:34:49.308 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:34:49.308 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:34:49.308 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:34:49.308 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 265232 2024-04-01T19:34:49.309 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.309 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:49.309 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.309 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:49.309 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811151+0000", 2024-04-01T19:34:49.309 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.309 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.309 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.309 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:49.309 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811151+0000", 2024-04-01T19:34:49.309 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:49.309 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.309 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.309 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:49.309 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811152+0000", 2024-04-01T19:34:49.310 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2410000000000001e-06 2024-04-01T19:34:49.310 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.310 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.310 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:49.310 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811157+0000", 2024-04-01T19:34:49.310 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7559999999999999e-06 2024-04-01T19:34:49.310 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.310 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.310 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:49.310 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811163+0000", 2024-04-01T19:34:49.310 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8980000000000001e-06 2024-04-01T19:34:49.310 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.310 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.310 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:49.311 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811168+0000", 2024-04-01T19:34:49.311 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8899999999999998e-06 2024-04-01T19:34:49.311 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.311 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.311 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.311 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811311+0000", 2024-04-01T19:34:49.311 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014343900000000001 2024-04-01T19:34:49.311 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.311 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.311 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for peered", 2024-04-01T19:34:49.311 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.811320+0000", 2024-04-01T19:34:49.311 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.456e-06 2024-04-01T19:34:49.311 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.311 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.311 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:49.311 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:31.665241+0000", 2024-04-01T19:34:49.312 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.85392143700000001 2024-04-01T19:34:49.312 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:49.312 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:49.312 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:34:49.312 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:31.665248+0000", 2024-04-01T19:34:49.312 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2219999999999996e-06 2024-04-01T19:34:49.312 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.312 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:49.312 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.312 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:49.312 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:49.312 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:34:49.312 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:34:49.313 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:34:49.314 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:48 smithi062 ceph-mon[44211]: pgmap v824: 17 pgs: 17 active+clean; 6.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 129 MiB/s wr, 2.07k op/s 2024-04-01T19:34:49.347 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:49.374 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:34:49.377 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:49.377 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:34:49.478 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:34:49.516 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:49.539 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:34:49.543 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:49.543 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:34:49.570 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 44 16 111834 111818 158.81 102.312 0.00414594 0.00629518 2024-04-01T19:34:49.644 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:34:49.713 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:50.034 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:34:50.051 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_ops_in_flight 2024-04-01T19:34:50.091 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:34:50.097 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:50.098 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:34:50.171 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:34:50.199 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:34:50.231 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:50.255 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:34:50.259 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:50.260 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:34:50.361 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:34:50.389 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:50.416 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:34:50.422 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:50.422 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:34:50.523 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:34:50.558 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:50.573 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 45 16 113360 113344 157.387 95.375 0.0112363 0.00635182 2024-04-01T19:34:50.582 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:34:50.586 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:50.586 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:34:50.687 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:34:50.722 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:50.756 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:34:50.762 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:50.763 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:34:50.772 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:50 smithi022 ceph-mon[39439]: pgmap v825: 17 pgs: 17 active+clean; 6.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 96 MiB/s wr, 1.53k op/s 2024-04-01T19:34:50.863 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:34:50.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:50 smithi188 ceph-mon[43939]: pgmap v825: 17 pgs: 17 active+clean; 6.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 96 MiB/s wr, 1.53k op/s 2024-04-01T19:34:50.896 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:50.923 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:34:50.928 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:50.929 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:34:51.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:50 smithi062 ceph-mon[44211]: pgmap v825: 17 pgs: 17 active+clean; 6.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 96 MiB/s wr, 1.53k op/s 2024-04-01T19:34:51.030 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:34:51.067 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:51.090 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:34:51.093 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:51.093 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:34:51.169 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:34:51.174 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:34:51.194 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:34:51.248 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:51.574 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 46 16 114947 114931 156.122 99.1875 0.00460056 0.00640386 2024-04-01T19:34:51.735 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:34:51.741 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:51.741 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:34:51.842 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:34:51.876 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:51.906 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:34:51.911 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:51.912 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:34:52.013 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:34:52.064 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:52.574 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 47 16 116551 116535 154.933 100.25 0.0072916 0.006453 2024-04-01T19:34:52.728 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:34:52.734 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:52.735 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:34:52.836 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:34:52.870 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:52.898 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:34:52.902 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:52.902 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:34:52.926 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:52 smithi022 ceph-mon[39439]: pgmap v826: 17 pgs: 17 active+clean; 6.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 108 MiB/s wr, 1.73k op/s 2024-04-01T19:34:53.003 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:34:53.041 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:52 smithi062 ceph-mon[44211]: pgmap v826: 17 pgs: 17 active+clean; 6.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 108 MiB/s wr, 1.73k op/s 2024-04-01T19:34:53.044 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:53.071 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:34:53.074 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:53.075 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:34:53.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:52 smithi188 ceph-mon[43939]: pgmap v826: 17 pgs: 17 active+clean; 6.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 108 MiB/s wr, 1.73k op/s 2024-04-01T19:34:53.175 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:34:53.214 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:53.240 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:34:53.242 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:53.243 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:34:53.344 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:34:53.386 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:53.574 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 48 16 118101 118085 153.724 96.875 0.00433576 0.00650364 2024-04-01T19:34:53.750 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:34:53.753 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:53.753 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:34:53.801 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:34:53.854 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:34:53.913 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:54.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:53 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1342270224' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:34:54.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:53 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1342270224' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:34:54.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:53 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1342270224' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:34:54.574 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 49 16 119735 119719 152.671 102.125 0.0068622 0.0065482 2024-04-01T19:34:54.585 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:34:54.587 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:54.588 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:34:54.689 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:34:54.721 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:54.747 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:34:54.752 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:54.753 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:34:54.854 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:34:54.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:54 smithi022 ceph-mon[39439]: pgmap v827: 17 pgs: 17 active+clean; 6.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 107 MiB/s wr, 1.72k op/s 2024-04-01T19:34:54.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:54 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:34:54.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:54 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1342270224' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:34:54.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:54 smithi022 ceph-mon[39439]: osdmap e287: 12 total, 12 up, 12 in 2024-04-01T19:34:54.889 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:54.916 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:34:54.918 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:54.919 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:34:55.020 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:34:55.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:54 smithi188 ceph-mon[43939]: pgmap v827: 17 pgs: 17 active+clean; 6.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 107 MiB/s wr, 1.72k op/s 2024-04-01T19:34:55.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:54 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:34:55.059 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:54 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1342270224' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:34:55.060 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:54 smithi188 ceph-mon[43939]: osdmap e287: 12 total, 12 up, 12 in 2024-04-01T19:34:55.064 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:55.087 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:34:55.091 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:55.091 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:34:55.192 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:34:55.232 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:55.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:54 smithi062 ceph-mon[44211]: pgmap v827: 17 pgs: 17 active+clean; 6.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 107 MiB/s wr, 1.72k op/s 2024-04-01T19:34:55.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:54 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:34:55.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:54 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1342270224' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:34:55.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:54 smithi062 ceph-mon[44211]: osdmap e287: 12 total, 12 up, 12 in 2024-04-01T19:34:55.316 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:34:55.320 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:55.321 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:34:55.422 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:34:55.460 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:55.487 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:34:55.490 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:55.491 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:34:55.577 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 50 16 121256 121240 151.508 95.0625 0.00715377 0.00659864 2024-04-01T19:34:55.592 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:34:55.639 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:55.954 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:55 smithi022 ceph-mon[39439]: pgmap v829: 17 pgs: 17 active+clean; 7.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 106 MiB/s wr, 1.69k op/s 2024-04-01T19:34:55.954 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:55 smithi022 ceph-mon[39439]: osdmap e288: 12 total, 12 up, 12 in 2024-04-01T19:34:55.988 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:34:55.993 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:55.994 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:34:56.095 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:34:56.138 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:56.166 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:34:56.170 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:56.170 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:34:56.196 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:34:56.196 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:34:56.196 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.196 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25465.0:121509 4.a e288/267 4:563b5796:::benchmark_data_smithi188_104537_object121508:head v 288'7634, mlcod=288'7632)", 2024-04-01T19:34:56.196 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:34:55.746454+0000", 2024-04-01T19:34:56.196 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0096664790000000004, 2024-04-01T19:34:56.196 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0096888129999999992, 2024-04-01T19:34:56.196 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:56.197 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:56.197 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:34:56.197 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:56.197 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.197 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:56.197 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.746454+0000", 2024-04-01T19:34:56.197 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:56.197 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.197 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.197 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:56.197 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.746454+0000", 2024-04-01T19:34:56.197 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:56.197 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.197 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.198 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:56.198 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.746455+0000", 2024-04-01T19:34:56.198 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5099999999999999e-06 2024-04-01T19:34:56.198 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.198 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.198 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:56.198 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.746485+0000", 2024-04-01T19:34:56.198 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.9255999999999999e-05 2024-04-01T19:34:56.198 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.198 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.198 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:56.198 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.746505+0000", 2024-04-01T19:34:56.198 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0752000000000001e-05 2024-04-01T19:34:56.199 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.199 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.199 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:56.199 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.746535+0000", 2024-04-01T19:34:56.199 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.9377e-05 2024-04-01T19:34:56.199 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.199 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.199 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:56.199 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.746591+0000", 2024-04-01T19:34:56.199 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6190000000000002e-05 2024-04-01T19:34:56.199 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.199 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.199 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:34:56.200 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.746610+0000", 2024-04-01T19:34:56.200 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.91e-05 2024-04-01T19:34:56.200 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:56.200 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:56.200 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:56.200 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.200 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.200 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25465.0:121510 4.a e288/267 4:53d11d05:::benchmark_data_smithi188_104537_object121509:head v 288'7635, mlcod=288'7632)", 2024-04-01T19:34:56.200 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:34:55.746557+0000", 2024-04-01T19:34:56.200 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0095636249999999992, 2024-04-01T19:34:56.200 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0096278460000000007, 2024-04-01T19:34:56.200 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:56.200 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:56.200 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:34:56.201 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:56.201 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.201 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:56.201 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.746557+0000", 2024-04-01T19:34:56.201 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:56.201 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.201 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.201 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:56.201 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.746557+0000", 2024-04-01T19:34:56.201 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:56.201 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.201 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.201 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:56.201 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.746557+0000", 2024-04-01T19:34:56.202 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.1399999999999996e-07 2024-04-01T19:34:56.202 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.202 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.202 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:56.202 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.746593+0000", 2024-04-01T19:34:56.202 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5975e-05 2024-04-01T19:34:56.202 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.202 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.202 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:56.202 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.746601+0000", 2024-04-01T19:34:56.202 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5469999999999999e-06 2024-04-01T19:34:56.202 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.202 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.203 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:56.203 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.746609+0000", 2024-04-01T19:34:56.203 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.473e-06 2024-04-01T19:34:56.203 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.203 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.203 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:56.203 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.749790+0000", 2024-04-01T19:34:56.203 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0031804979999999999 2024-04-01T19:34:56.203 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.203 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.203 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:34:56.203 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.749809+0000", 2024-04-01T19:34:56.203 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9358e-05 2024-04-01T19:34:56.203 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:56.204 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:56.204 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:56.204 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.204 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.204 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:121511 4.7 4:e475b035:::benchmark_data_smithi188_104537_object121510:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e288)", 2024-04-01T19:34:56.204 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:34:55.746628+0000", 2024-04-01T19:34:56.204 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0094920239999999999, 2024-04-01T19:34:56.204 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0096032349999999999, 2024-04-01T19:34:56.204 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:56.204 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:56.204 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:34:56.204 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:34:56.204 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:34:56.204 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:34:56.205 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 121511 2024-04-01T19:34:56.205 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.205 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:56.205 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.205 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:56.205 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.746628+0000", 2024-04-01T19:34:56.205 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:56.205 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.205 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.205 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:56.205 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.746628+0000", 2024-04-01T19:34:56.205 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:56.205 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.205 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.206 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:56.206 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.746630+0000", 2024-04-01T19:34:56.206 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5340000000000001e-06 2024-04-01T19:34:56.206 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.206 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.206 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:56.206 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.746659+0000", 2024-04-01T19:34:56.206 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.8994000000000001e-05 2024-04-01T19:34:56.206 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.206 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.206 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:56.206 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.746668+0000", 2024-04-01T19:34:56.206 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8349999999999993e-06 2024-04-01T19:34:56.207 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.207 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.207 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:56.207 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.746675+0000", 2024-04-01T19:34:56.207 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6899999999999992e-06 2024-04-01T19:34:56.207 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.207 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.207 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:56.207 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.749846+0000", 2024-04-01T19:34:56.207 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0031709210000000002 2024-04-01T19:34:56.207 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.207 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.207 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:34:56.207 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.749978+0000", 2024-04-01T19:34:56.208 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000131982 2024-04-01T19:34:56.208 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.208 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.208 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 10", 2024-04-01T19:34:56.208 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.750109+0000", 2024-04-01T19:34:56.208 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013060400000000001 2024-04-01T19:34:56.208 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:56.208 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:56.208 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:56.208 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.208 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.208 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25465.0:121512 4.a e288/267 4:57be3bab:::benchmark_data_smithi188_104537_object121511:head v 288'7636, mlcod=288'7632)", 2024-04-01T19:34:56.208 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:34:55.748053+0000", 2024-04-01T19:34:56.208 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0080672810000000008, 2024-04-01T19:34:56.209 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0082235209999999993, 2024-04-01T19:34:56.209 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:56.209 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:56.209 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:34:56.209 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:56.209 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.209 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:56.209 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.748053+0000", 2024-04-01T19:34:56.209 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:56.209 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.209 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.209 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:56.209 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.748053+0000", 2024-04-01T19:34:56.209 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:56.210 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.210 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.210 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:56.210 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.748054+0000", 2024-04-01T19:34:56.210 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0589999999999999e-06 2024-04-01T19:34:56.210 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.210 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.210 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:56.210 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.748129+0000", 2024-04-01T19:34:56.210 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5350000000000002e-05 2024-04-01T19:34:56.210 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.210 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.210 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:56.211 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.748138+0000", 2024-04-01T19:34:56.211 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4319999999999999e-06 2024-04-01T19:34:56.211 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.211 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.211 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:56.211 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.748144+0000", 2024-04-01T19:34:56.211 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2770000000000002e-06 2024-04-01T19:34:56.211 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.211 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.211 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:56.211 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.753227+0000", 2024-04-01T19:34:56.211 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0050825139999999998 2024-04-01T19:34:56.211 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.211 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.212 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:34:56.212 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.753241+0000", 2024-04-01T19:34:56.212 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4022000000000001e-05 2024-04-01T19:34:56.212 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:56.212 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:56.212 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:56.212 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.212 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.212 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:121523 4.7 4:e3ebc36e:::benchmark_data_smithi188_104537_object121522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e288)", 2024-04-01T19:34:56.212 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:34:55.752670+0000", 2024-04-01T19:34:56.212 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0034500389999999998, 2024-04-01T19:34:56.212 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0036595360000000001, 2024-04-01T19:34:56.212 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:56.212 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:56.213 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:34:56.213 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:34:56.213 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:34:56.213 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:34:56.213 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 121523 2024-04-01T19:34:56.213 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.213 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:56.213 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.213 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:56.213 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.752670+0000", 2024-04-01T19:34:56.213 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:56.213 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.213 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.213 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:56.214 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.752670+0000", 2024-04-01T19:34:56.214 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:56.214 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.214 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.214 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:56.214 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.752672+0000", 2024-04-01T19:34:56.214 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7400000000000001e-06 2024-04-01T19:34:56.214 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.214 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.214 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:56.214 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.752731+0000", 2024-04-01T19:34:56.214 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9208e-05 2024-04-01T19:34:56.215 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.215 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.215 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:56.215 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.752741+0000", 2024-04-01T19:34:56.215 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0148e-05 2024-04-01T19:34:56.215 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.215 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.215 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:56.215 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.752747+0000", 2024-04-01T19:34:56.215 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9529999999999996e-06 2024-04-01T19:34:56.215 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.215 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.215 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:56.215 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.753627+0000", 2024-04-01T19:34:56.216 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00087933100000000001 2024-04-01T19:34:56.216 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.216 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.216 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:34:56.216 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.753720+0000", 2024-04-01T19:34:56.216 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.2967999999999995e-05 2024-04-01T19:34:56.216 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.216 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.216 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 10", 2024-04-01T19:34:56.216 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.753817+0000", 2024-04-01T19:34:56.216 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.7350999999999997e-05 2024-04-01T19:34:56.216 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:56.216 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:56.216 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:56.217 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.217 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.217 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25465.0:121518 4.a e288/267 4:567d6a43:::benchmark_data_smithi188_104537_object121517:head v 288'7637, mlcod=288'7632)", 2024-04-01T19:34:56.217 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:34:55.752925+0000", 2024-04-01T19:34:56.217 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0031955540000000002, 2024-04-01T19:34:56.217 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0034476540000000001, 2024-04-01T19:34:56.217 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:56.217 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:56.217 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:34:56.217 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:56.217 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.217 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:56.217 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.752925+0000", 2024-04-01T19:34:56.217 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:56.218 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.218 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.218 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:56.218 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.752925+0000", 2024-04-01T19:34:56.218 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:56.218 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.218 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.218 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:56.218 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.752926+0000", 2024-04-01T19:34:56.218 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.22e-06 2024-04-01T19:34:56.218 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.218 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.219 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:56.219 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.753021+0000", 2024-04-01T19:34:56.219 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.4629000000000005e-05 2024-04-01T19:34:56.219 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.219 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.219 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:56.219 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.753029+0000", 2024-04-01T19:34:56.219 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3140000000000004e-06 2024-04-01T19:34:56.219 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.219 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.219 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:56.219 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.753034+0000", 2024-04-01T19:34:56.219 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8980000000000004e-06 2024-04-01T19:34:56.220 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.220 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.220 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:34:56.220 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.755656+0000", 2024-04-01T19:34:56.220 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0026218690000000002 2024-04-01T19:34:56.220 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.220 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.220 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:34:56.220 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.755675+0000", 2024-04-01T19:34:56.220 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9678e-05 2024-04-01T19:34:56.220 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:56.220 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:56.220 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:56.220 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.221 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.221 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop_reply(client.25465.0:121511 4.7 e288/267)", 2024-04-01T19:34:56.221 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:34:55.754035+0000", 2024-04-01T19:34:56.221 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0020854630000000001, 2024-04-01T19:34:56.221 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0023697039999999998, 2024-04-01T19:34:56.221 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:34:56.221 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:34:56.221 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "queued for pg", 2024-04-01T19:34:56.221 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:34:56.221 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.221 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:34:56.221 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.754035+0000", 2024-04-01T19:34:56.221 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:56.222 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.222 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.222 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:34:56.222 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.754035+0000", 2024-04-01T19:34:56.222 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:34:56.222 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.222 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.222 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:34:56.222 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.754036+0000", 2024-04-01T19:34:56.222 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.006e-06 2024-04-01T19:34:56.222 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.222 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.222 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:34:56.223 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.754042+0000", 2024-04-01T19:34:56.223 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2450000000000003e-06 2024-04-01T19:34:56.223 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.223 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.223 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:34:56.223 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.754049+0000", 2024-04-01T19:34:56.223 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8979999999999999e-06 2024-04-01T19:34:56.223 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:34:56.223 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:34:56.223 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:34:56.223 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:34:55.754054+0000", 2024-04-01T19:34:56.223 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0270000000000003e-06 2024-04-01T19:34:56.223 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:56.223 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:34:56.223 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:56.224 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:34:56.224 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T19:34:56.224 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 7 2024-04-01T19:34:56.224 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:34:56.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:55 smithi062 ceph-mon[44211]: pgmap v829: 17 pgs: 17 active+clean; 7.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 106 MiB/s wr, 1.69k op/s 2024-04-01T19:34:56.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:55 smithi062 ceph-mon[44211]: osdmap e288: 12 total, 12 up, 12 in 2024-04-01T19:34:56.271 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:34:56.313 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:56.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:55 smithi188 ceph-mon[43939]: pgmap v829: 17 pgs: 17 active+clean; 7.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 106 MiB/s wr, 1.69k op/s 2024-04-01T19:34:56.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:55 smithi188 ceph-mon[43939]: osdmap e288: 12 total, 12 up, 12 in 2024-04-01T19:34:56.407 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:34:56.412 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:56.412 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:34:56.513 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:34:56.547 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:56.573 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:34:56.577 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 51 16 122834 122818 150.471 98.625 0.00503109 0.00664457 2024-04-01T19:34:56.579 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:56.579 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:34:56.681 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:34:56.719 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:56.749 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:34:56.753 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:56.753 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:34:56.854 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:34:56.887 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:56.898 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_blocked_ops 2024-04-01T19:34:56.913 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:34:56.922 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:56.923 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:34:57.024 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:34:57.058 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:57.088 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:34:57.092 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:57.093 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:34:57.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:56 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:34:57.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:56 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:34:57.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:56 smithi022 ceph-mon[39439]: osdmap e289: 12 total, 12 up, 12 in 2024-04-01T19:34:57.193 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:34:57.222 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:56 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:34:57.222 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:56 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:34:57.222 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:56 smithi062 ceph-mon[44211]: osdmap e289: 12 total, 12 up, 12 in 2024-04-01T19:34:57.224 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:57.247 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:34:57.253 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:57.253 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:34:57.354 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:34:57.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:56 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:34:57.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:56 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:34:57.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:56 smithi188 ceph-mon[43939]: osdmap e289: 12 total, 12 up, 12 in 2024-04-01T19:34:57.402 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:57.459 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:34:57.465 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:57.466 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:34:57.532 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:34:57.567 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:34:57.571 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:34:57.572 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:34:57.577 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 52 16 124306 124290 149.347 92 0.00509915 0.00669423 2024-04-01T19:34:57.600 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:34:57.602 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:57.625 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:34:57.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:57.628 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:34:57.640 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:34:57.673 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:34:57.703 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:34:57.727 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:34:57.728 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:34:57.756 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:34:57.773 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:57.792 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:34:57.801 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:34:57.810 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:57.811 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:34:57.824 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:34:57.852 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:34:57.883 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:34:57.912 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:34:57.917 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:34:57.917 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:34:57.917 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:34:57.917 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:34:57.917 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:34:57.917 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:34:57.918 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:34:57.918 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:34:57.918 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:34:57.918 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:34:57.918 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:34:57.918 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:34:57.953 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:58.031 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:34:58.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:57 smithi062 ceph-mon[44211]: pgmap v832: 17 pgs: 17 active+clean; 7.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 99 MiB/s wr, 1.59k op/s 2024-04-01T19:34:58.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:57 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1881771582' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:34:58.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:58.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:58.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:58.341 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:57 smithi022 ceph-mon[39439]: pgmap v832: 17 pgs: 17 active+clean; 7.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 99 MiB/s wr, 1.59k op/s 2024-04-01T19:34:58.341 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:57 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1881771582' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:34:58.342 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:58.342 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:58.342 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:58.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:57 smithi188 ceph-mon[43939]: pgmap v832: 17 pgs: 17 active+clean; 7.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 99 MiB/s wr, 1.59k op/s 2024-04-01T19:34:58.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:57 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1881771582' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:34:58.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:58.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:58.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:58.578 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 53 16 125763 125747 148.247 91.0625 0.0103393 0.00674388 2024-04-01T19:34:58.657 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:34:58.660 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:58.661 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:34:58.762 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:34:58.799 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:58.825 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:34:58.827 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:58.828 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:34:58.929 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:34:58.961 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:58.993 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:34:58.996 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:58.997 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:34:59.098 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:34:59.137 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.137 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.138 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.138 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.138 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.138 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.138 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.138 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.138 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.139 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:59.167 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:34:59.172 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:59.173 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:34:59.274 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:34:59.345 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.345 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.346 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:59.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:34:59.580 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 54 16 127286 127270 147.257 95.1875 0.0109421 0.00678937 2024-04-01T19:34:59.760 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:34:59.764 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:59.765 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:34:59.866 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:34:59.909 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:34:59.944 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:34:59.947 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:34:59.948 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:35:00.025 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:35:00.038 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:59 smithi022 ceph-mon[39439]: pgmap v833: 17 pgs: 17 active+clean; 7.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 82 MiB/s wr, 1.31k op/s 2024-04-01T19:35:00.038 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:34:59 smithi022 ceph-mon[39439]: osdmap e290: 12 total, 12 up, 12 in 2024-04-01T19:35:00.049 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:35:00.082 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:00.111 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:00.111 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:35:00.112 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:35:00.213 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:35:00.243 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:59 smithi188 ceph-mon[43939]: pgmap v833: 17 pgs: 17 active+clean; 7.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 82 MiB/s wr, 1.31k op/s 2024-04-01T19:35:00.243 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:34:59 smithi188 ceph-mon[43939]: osdmap e290: 12 total, 12 up, 12 in 2024-04-01T19:35:00.246 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:00.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:59 smithi062 ceph-mon[44211]: pgmap v833: 17 pgs: 17 active+clean; 7.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 82 MiB/s wr, 1.31k op/s 2024-04-01T19:35:00.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:34:59 smithi062 ceph-mon[44211]: osdmap e290: 12 total, 12 up, 12 in 2024-04-01T19:35:00.271 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:35:00.277 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:00.278 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:35:00.379 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:35:00.415 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:00.438 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:35:00.440 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:00.441 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:35:00.542 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:35:00.581 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 55 16 128740 128724 146.232 90.875 0.00490296 0.00683682 2024-04-01T19:35:00.606 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:35:00.606 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:35:00.607 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:00.675 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:35:00.682 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:00.683 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:35:00.784 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:35:00.822 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:00.853 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:35:00.859 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:00.860 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:35:00.960 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:35:01.008 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:01.041 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:35:01.046 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:01.047 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:35:01.148 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:35:01.180 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:01.206 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:35:01.208 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:01.209 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:35:01.310 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:35:01.350 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:01.376 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:35:01.381 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:01.381 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:35:01.482 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:35:01.517 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:01.545 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:35:01.548 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:01.549 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:35:01.581 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 56 16 130239 130223 145.294 93.6875 0.0112577 0.00688106 2024-04-01T19:35:01.650 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:35:01.686 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:01.719 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:35:01.728 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:01.729 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:35:01.787 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:35:01.804 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_historic_ops 2024-04-01T19:35:01.830 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:35:01.844 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-01T19:35:01.845 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:35:01.866 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:01.889 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:35:01.892 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:01.893 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:35:01.994 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:35:02.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:01 smithi022 ceph-mon[39439]: pgmap v835: 17 pgs: 17 active+clean; 7.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 105 MiB/s wr, 1.68k op/s 2024-04-01T19:35:02.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:01 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:35:02.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:01 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:35:02.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:01 smithi022 ceph-mon[39439]: osdmap e291: 12 total, 12 up, 12 in 2024-04-01T19:35:02.138 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:02.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:01 smithi062 ceph-mon[44211]: pgmap v835: 17 pgs: 17 active+clean; 7.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 105 MiB/s wr, 1.68k op/s 2024-04-01T19:35:02.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:01 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:35:02.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:01 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:35:02.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:01 smithi062 ceph-mon[44211]: osdmap e291: 12 total, 12 up, 12 in 2024-04-01T19:35:02.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:01 smithi188 ceph-mon[43939]: pgmap v835: 17 pgs: 17 active+clean; 7.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 105 MiB/s wr, 1.68k op/s 2024-04-01T19:35:02.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:01 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:35:02.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:01 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:35:02.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:01 smithi188 ceph-mon[43939]: osdmap e291: 12 total, 12 up, 12 in 2024-04-01T19:35:02.375 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:35:02.380 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:02.380 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:35:02.466 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:35:02.481 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:35:02.513 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:02.535 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:35:02.536 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:35:02.541 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:02.542 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:35:02.581 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 57 16 131519 131503 144.149 80 0.0201052 0.00693596 2024-04-01T19:35:02.642 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:35:02.688 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:02.918 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:35:02.927 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:02.928 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:35:03.029 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:35:03.061 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:03.087 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:35:03.089 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:03.090 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:35:03.193 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:35:03.225 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:03.382 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:35:03.391 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:03.392 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:35:03.392 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:35:03.493 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:35:03.532 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:03.569 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:35:03.572 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:03.573 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:35:03.581 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 58 16 132812 132796 143.057 80.8125 0.00430186 0.00698878 2024-04-01T19:35:03.673 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:35:03.703 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:03.736 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:35:03.739 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:03.739 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:35:03.841 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:35:03.876 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:03.906 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:35:03.912 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:03.912 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:35:03.996 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:03 smithi188 ceph-mon[43939]: pgmap v837: 17 pgs: 17 active+clean; 7.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 92 MiB/s wr, 1.47k op/s 2024-04-01T19:35:03.996 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:03 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1593546898' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:35:03.996 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:03 smithi188 ceph-mon[43939]: from='client.25534 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:35:04.013 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:35:04.017 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:35:04.050 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:04.081 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:35:04.084 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:04.084 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:35:04.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:03 smithi022 ceph-mon[39439]: pgmap v837: 17 pgs: 17 active+clean; 7.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 92 MiB/s wr, 1.47k op/s 2024-04-01T19:35:04.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:03 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1593546898' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:35:04.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:03 smithi022 ceph-mon[39439]: from='client.25534 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:35:04.185 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:35:04.224 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:04.255 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:35:04.258 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:03 smithi062 ceph-mon[44211]: pgmap v837: 17 pgs: 17 active+clean; 7.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 92 MiB/s wr, 1.47k op/s 2024-04-01T19:35:04.258 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:03 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1593546898' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:35:04.258 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:03 smithi062 ceph-mon[44211]: from='client.25534 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:35:04.262 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:04.262 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:35:04.363 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:35:04.432 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:04.500 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:35:04.502 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:04.503 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:35:04.581 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 59 15 134236 134221 142.142 89.0625 0.0159598 0.00703388 2024-04-01T19:35:04.603 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:35:04.639 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:04.667 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:35:04.673 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:04.673 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:35:04.774 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:35:04.807 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:04.840 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:35:04.844 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:04.845 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:35:04.946 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:35:04.977 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:05.007 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:35:05.010 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:05.011 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:35:05.112 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:35:05.151 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:05.178 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:35:05.183 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:05.183 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:35:05.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:05 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:35:05.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:05 smithi062 ceph-mon[44211]: from='client.25534 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:35:05.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:05 smithi062 ceph-mon[44211]: osdmap e292: 12 total, 12 up, 12 in 2024-04-01T19:35:05.284 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:35:05.325 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:05.345 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:05 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:35:05.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:05 smithi022 ceph-mon[39439]: from='client.25534 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:35:05.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:05 smithi022 ceph-mon[39439]: osdmap e292: 12 total, 12 up, 12 in 2024-04-01T19:35:05.352 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:35:05.354 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:05.355 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:35:05.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:05 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:35:05.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:05 smithi188 ceph-mon[43939]: from='client.25534 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:35:05.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:05 smithi188 ceph-mon[43939]: osdmap e292: 12 total, 12 up, 12 in 2024-04-01T19:35:05.456 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:35:05.488 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:05.516 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:35:05.522 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:05.522 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:35:05.581 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:35:05.584206 min lat: 0.00107168 max lat: 0.222141 avg lat: 0.00707476 2024-04-01T19:35:05.581 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:35:05.581 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 60 16 135709 135693 141.306 92 0.00504196 0.00707476 2024-04-01T19:35:05.623 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:35:05.652 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:05.676 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:35:05.678 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:05.679 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:35:05.780 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:35:05.810 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:05.841 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:35:05.844 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:05.844 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:35:05.945 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:35:05.984 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:06.007 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:35:06.012 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:06.012 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:35:06.113 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:35:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:06 smithi188 ceph-mon[43939]: pgmap v839: 17 pgs: 17 active+clean; 8.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 MiB/s wr, 1.60k op/s 2024-04-01T19:35:06.177 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:06.266 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:06 smithi022 ceph-mon[39439]: pgmap v839: 17 pgs: 17 active+clean; 8.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 MiB/s wr, 1.60k op/s 2024-04-01T19:35:06.485 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:35:06.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:06 smithi062 ceph-mon[44211]: pgmap v839: 17 pgs: 17 active+clean; 8.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 MiB/s wr, 1.60k op/s 2024-04-01T19:35:06.516 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:35:06.564 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:35:06.581 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 61 16 136966 136950 140.278 78.5625 0.00539305 0.0071274 2024-04-01T19:35:06.598 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:35:06.633 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:35:06.660 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:35:06.691 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:35:06.726 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:35:06.760 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:35:06.791 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:35:06.831 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:35:06.862 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:35:06.868 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:35:06.868 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:35:06.868 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:35:06.868 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:35:06.868 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:35:06.868 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:35:06.869 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:35:06.869 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:35:06.869 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:35:06.869 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:35:06.869 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:35:06.869 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:35:07.294 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:07 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3007453485' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:35:07.294 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:07.294 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:07.294 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:07.294 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:07.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:07 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3007453485' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:35:07.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:07.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:07.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:07.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:07.412 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:35:07.419 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:07.419 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:35:07.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:07 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3007453485' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:35:07.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:07.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:07.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:07.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:07.520 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:35:07.573 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:07.581 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 62 16 138336 138320 139.396 85.625 0.012274 0.00717261 2024-04-01T19:35:07.740 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:35:07.743 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:07.743 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:35:07.844 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:35:07.874 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:07.902 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:35:07.906 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:07.907 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:35:08.008 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:35:08.055 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:08.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:08.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:08.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:08.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:08.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:08.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:08.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:08.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:08.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:08 smithi062 ceph-mon[44211]: pgmap v840: 17 pgs: 17 active+clean; 8.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 97 MiB/s wr, 1.54k op/s 2024-04-01T19:35:08.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:08.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:08.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:08.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:08.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:08.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:08.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:08.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:08.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:08 smithi022 ceph-mon[39439]: pgmap v840: 17 pgs: 17 active+clean; 8.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 97 MiB/s wr, 1.54k op/s 2024-04-01T19:35:08.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:08.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:08.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:08.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:08.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:08.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:08.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:08.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:08.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:08 smithi188 ceph-mon[43939]: pgmap v840: 17 pgs: 17 active+clean; 8.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 97 MiB/s wr, 1.54k op/s 2024-04-01T19:35:08.560 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:35:08.564 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:08.564 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:35:08.581 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 63 16 139785 139769 138.621 90.5625 0.00787087 0.00721253 2024-04-01T19:35:08.703 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:35:08.749 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:09.581 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 64 16 141224 141208 137.86 89.9375 0.00973462 0.00725234 2024-04-01T19:35:09.787 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:35:10.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:10 smithi022 ceph-mon[39439]: pgmap v841: 17 pgs: 17 active+clean; 8.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 75 MiB/s wr, 1.21k op/s 2024-04-01T19:35:10.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:10 smithi188 ceph-mon[43939]: pgmap v841: 17 pgs: 17 active+clean; 8.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 75 MiB/s wr, 1.21k op/s 2024-04-01T19:35:10.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:10 smithi062 ceph-mon[44211]: pgmap v841: 17 pgs: 17 active+clean; 8.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 75 MiB/s wr, 1.21k op/s 2024-04-01T19:35:10.581 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 65 16 142559 142543 137.023 83.4375 0.00943536 0.00729654 2024-04-01T19:35:11.581 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 66 16 143861 143845 136.18 81.375 0.00437997 0.00734173 2024-04-01T19:35:11.715 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:35:11.719 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:11.720 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:35:11.820 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:35:11.895 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:11.973 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:35:11.976 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:11.976 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:35:12.077 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:35:12.098 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:35:12.099 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:35:12.122 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:12.155 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:35:12.161 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:12.162 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:35:12.263 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:35:12.314 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:12 smithi022 ceph-mon[39439]: pgmap v842: 17 pgs: 17 active+clean; 8.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s wr, 1.41k op/s 2024-04-01T19:35:12.320 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:12.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:12 smithi188 ceph-mon[43939]: pgmap v842: 17 pgs: 17 active+clean; 8.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s wr, 1.41k op/s 2024-04-01T19:35:12.410 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:35:12.417 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:12.418 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:35:12.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:12 smithi062 ceph-mon[44211]: pgmap v842: 17 pgs: 17 active+clean; 8.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s wr, 1.41k op/s 2024-04-01T19:35:12.519 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:35:12.553 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:12.579 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:35:12.581 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 67 16 145199 145183 135.396 83.625 0.0065472 0.00738415 2024-04-01T19:35:12.582 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:12.583 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:35:12.610 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:35:12.610 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 20, 2024-04-01T19:35:12.610 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 600, 2024-04-01T19:35:12.610 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:35:12.610 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.610 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:154129 2.4 2:216ccd68:::benchmark_data_smithi188_77607_object154128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e136)", 2024-04-01T19:35:12.610 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:19.693545+0000", 2024-04-01T19:35:12.611 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 532.91231587599998, 2024-04-01T19:35:12.611 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.168805124, 2024-04-01T19:35:12.611 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:12.611 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:12.611 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:12.611 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:12.611 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:12.611 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:12.611 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 154129 2024-04-01T19:35:12.611 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.611 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:12.611 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.611 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:12.611 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.693545+0000", 2024-04-01T19:35:12.611 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.612 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.612 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.612 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:12.612 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.693545+0000", 2024-04-01T19:35:12.612 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.612 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.612 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.612 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:12.612 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.693547+0000", 2024-04-01T19:35:12.612 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.33e-06 2024-04-01T19:35:12.612 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.612 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.613 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:12.613 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.693600+0000", 2024-04-01T19:35:12.613 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2855999999999997e-05 2024-04-01T19:35:12.613 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.613 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.613 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:12.613 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.693610+0000", 2024-04-01T19:35:12.613 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0545e-05 2024-04-01T19:35:12.613 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.613 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.613 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:12.613 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.693618+0000", 2024-04-01T19:35:12.613 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.678e-06 2024-04-01T19:35:12.613 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.614 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.614 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:12.614 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.737278+0000", 2024-04-01T19:35:12.614 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.043659870000000003 2024-04-01T19:35:12.614 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.614 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.614 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:12.614 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.737438+0000", 2024-04-01T19:35:12.614 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00016024600000000001 2024-04-01T19:35:12.614 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.614 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.615 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:35:12.615 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.737634+0000", 2024-04-01T19:35:12.615 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000196209 2024-04-01T19:35:12.615 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.615 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.615 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:12.615 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.745561+0000", 2024-04-01T19:35:12.615 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0079263479999999997 2024-04-01T19:35:12.615 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.615 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.615 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:12.615 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.862221+0000", 2024-04-01T19:35:12.615 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.116660497 2024-04-01T19:35:12.616 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.616 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.616 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:12.616 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.862282+0000", 2024-04-01T19:35:12.616 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1400000000000002e-05 2024-04-01T19:35:12.616 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.616 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.616 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:12.616 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.862351+0000", 2024-04-01T19:35:12.616 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8145000000000006e-05 2024-04-01T19:35:12.616 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.616 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:12.616 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.616 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.617 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.617 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:154144 2.4 2:29b9ba8b:::benchmark_data_smithi188_77607_object154143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e136)", 2024-04-01T19:35:12.617 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:19.713543+0000", 2024-04-01T19:35:12.617 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 532.89231809800003, 2024-04-01T19:35:12.617 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.14900134100000001, 2024-04-01T19:35:12.617 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:12.617 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:12.617 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:12.617 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:12.617 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:12.617 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:12.617 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 154144 2024-04-01T19:35:12.617 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.617 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:12.617 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.617 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:12.618 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.713543+0000", 2024-04-01T19:35:12.618 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.618 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.618 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.618 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:12.618 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.713543+0000", 2024-04-01T19:35:12.618 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.618 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.618 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.618 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:12.618 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.713545+0000", 2024-04-01T19:35:12.618 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.587e-06 2024-04-01T19:35:12.618 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.619 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.619 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:12.619 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.713602+0000", 2024-04-01T19:35:12.619 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7683999999999999e-05 2024-04-01T19:35:12.619 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.619 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.619 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:12.619 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.713624+0000", 2024-04-01T19:35:12.619 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1994999999999999e-05 2024-04-01T19:35:12.619 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.619 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.619 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:12.619 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.713632+0000", 2024-04-01T19:35:12.619 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9959999999999993e-06 2024-04-01T19:35:12.620 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.620 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.620 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:12.620 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.741488+0000", 2024-04-01T19:35:12.620 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.027855442000000001 2024-04-01T19:35:12.620 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.620 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.620 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:12.620 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.741581+0000", 2024-04-01T19:35:12.620 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.3389999999999999e-05 2024-04-01T19:35:12.620 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.620 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.620 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:35:12.620 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.741672+0000", 2024-04-01T19:35:12.621 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.0257e-05 2024-04-01T19:35:12.621 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.621 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.621 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:12.621 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.745567+0000", 2024-04-01T19:35:12.621 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.003895211 2024-04-01T19:35:12.621 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.621 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.621 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:12.621 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.862416+0000", 2024-04-01T19:35:12.621 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.116849614 2024-04-01T19:35:12.621 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.621 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.622 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:12.622 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.862481+0000", 2024-04-01T19:35:12.622 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4373000000000002e-05 2024-04-01T19:35:12.622 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.622 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.622 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:12.622 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:19.862545+0000", 2024-04-01T19:35:12.622 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3792000000000002e-05 2024-04-01T19:35:12.622 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.622 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:12.622 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.622 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.622 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.623 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:168013 2.4 2:2042f4f9:::benchmark_data_smithi188_77607_object609:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e139)", 2024-04-01T19:35:12.623 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:36.398936+0000", 2024-04-01T19:35:12.623 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 516.20692521700005, 2024-04-01T19:35:12.623 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13387802100000001, 2024-04-01T19:35:12.623 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:12.623 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:12.623 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:12.623 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:12.623 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:12.623 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:12.623 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 168013 2024-04-01T19:35:12.623 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.623 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:12.623 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.623 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:12.624 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.398936+0000", 2024-04-01T19:35:12.624 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.624 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.624 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.624 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:12.624 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.398936+0000", 2024-04-01T19:35:12.624 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.624 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.624 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.624 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:12.624 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.398937+0000", 2024-04-01T19:35:12.624 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8400000000000005e-07 2024-04-01T19:35:12.624 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.625 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.625 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:12.625 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.398938+0000", 2024-04-01T19:35:12.625 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9099999999999999e-06 2024-04-01T19:35:12.625 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.625 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.625 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:12.625 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.398943+0000", 2024-04-01T19:35:12.625 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7310000000000001e-06 2024-04-01T19:35:12.625 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.625 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.625 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:12.625 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.398948+0000", 2024-04-01T19:35:12.626 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7620000000000003e-06 2024-04-01T19:35:12.626 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.626 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.626 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:12.626 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.493902+0000", 2024-04-01T19:35:12.626 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.09495373 2024-04-01T19:35:12.626 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.626 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.626 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:12.626 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.494033+0000", 2024-04-01T19:35:12.626 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000131292 2024-04-01T19:35:12.626 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.626 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.626 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:35:12.627 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.494167+0000", 2024-04-01T19:35:12.627 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000133504 2024-04-01T19:35:12.627 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.627 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.630 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:12.630 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.508268+0000", 2024-04-01T19:35:12.630 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014101310000000001 2024-04-01T19:35:12.630 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.630 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.630 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:12.630 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.532696+0000", 2024-04-01T19:35:12.630 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.024428347999999999 2024-04-01T19:35:12.630 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.631 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.631 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:12.631 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.532757+0000", 2024-04-01T19:35:12.631 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0850999999999997e-05 2024-04-01T19:35:12.631 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.631 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.631 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:12.631 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.532814+0000", 2024-04-01T19:35:12.631 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7099000000000003e-05 2024-04-01T19:35:12.631 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.631 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:12.631 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.631 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.632 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.632 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:168503 2.4 2:216d22bf:::benchmark_data_smithi188_77607_object1099:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:35:12.632 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:36.933598+0000", 2024-04-01T19:35:12.632 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 515.67226338600005, 2024-04-01T19:35:12.632 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.15898862999999999, 2024-04-01T19:35:12.632 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:12.632 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:12.632 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:12.632 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:12.632 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:12.632 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:12.632 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 168503 2024-04-01T19:35:12.632 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.632 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:12.632 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.633 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:12.633 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.933598+0000", 2024-04-01T19:35:12.633 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.633 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.633 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.633 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:12.633 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.933598+0000", 2024-04-01T19:35:12.633 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.633 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.633 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.633 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:12.633 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.933599+0000", 2024-04-01T19:35:12.633 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7300000000000005e-07 2024-04-01T19:35:12.633 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.633 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.633 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:12.634 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.933602+0000", 2024-04-01T19:35:12.634 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.0769999999999999e-06 2024-04-01T19:35:12.634 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.634 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.634 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:12.634 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.933608+0000", 2024-04-01T19:35:12.634 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2450000000000003e-06 2024-04-01T19:35:12.634 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.634 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.634 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:12.634 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.933640+0000", 2024-04-01T19:35:12.634 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.1804000000000002e-05 2024-04-01T19:35:12.634 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.634 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.635 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:12.635 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.957575+0000", 2024-04-01T19:35:12.635 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.023935656 2024-04-01T19:35:12.635 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.635 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.635 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:12.635 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.957705+0000", 2024-04-01T19:35:12.635 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012981700000000001 2024-04-01T19:35:12.635 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.635 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.635 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:35:12.635 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.957840+0000", 2024-04-01T19:35:12.635 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000134232 2024-04-01T19:35:12.635 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.636 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.636 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:12.636 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:36.962046+0000", 2024-04-01T19:35:12.636 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0042064889999999999 2024-04-01T19:35:12.636 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.636 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.636 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:12.636 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.092439+0000", 2024-04-01T19:35:12.636 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13039316400000001 2024-04-01T19:35:12.636 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.636 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.636 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:12.636 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.092500+0000", 2024-04-01T19:35:12.636 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0992999999999997e-05 2024-04-01T19:35:12.637 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.637 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.637 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:12.637 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.092587+0000", 2024-04-01T19:35:12.637 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6379999999999996e-05 2024-04-01T19:35:12.637 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.637 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:12.637 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.637 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.637 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.637 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:168561 2.4 2:216284a5:::benchmark_data_smithi188_77607_object1157:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:35:12.637 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:37.001846+0000", 2024-04-01T19:35:12.637 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 515.60401485399996, 2024-04-01T19:35:12.637 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13320378099999999, 2024-04-01T19:35:12.637 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:12.638 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:12.638 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:12.638 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:12.638 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:12.638 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:12.638 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 168561 2024-04-01T19:35:12.638 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.638 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:12.638 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.638 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:12.638 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.001846+0000", 2024-04-01T19:35:12.638 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.638 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.639 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.639 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:12.639 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.001846+0000", 2024-04-01T19:35:12.639 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.639 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.639 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.639 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:12.639 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.001849+0000", 2024-04-01T19:35:12.639 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3520000000000001e-06 2024-04-01T19:35:12.639 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.639 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.639 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:12.639 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.001869+0000", 2024-04-01T19:35:12.640 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0455999999999999e-05 2024-04-01T19:35:12.640 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.640 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.640 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:12.640 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.001890+0000", 2024-04-01T19:35:12.640 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0948999999999999e-05 2024-04-01T19:35:12.640 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.640 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.640 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:12.640 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.001900+0000", 2024-04-01T19:35:12.640 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.3319999999999998e-06 2024-04-01T19:35:12.640 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.640 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.640 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:12.641 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.097339+0000", 2024-04-01T19:35:12.641 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.095439674000000002 2024-04-01T19:35:12.641 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.641 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.641 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:12.641 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.097455+0000", 2024-04-01T19:35:12.641 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000115958 2024-04-01T19:35:12.641 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.641 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.641 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:35:12.642 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.097561+0000", 2024-04-01T19:35:12.642 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000105813 2024-04-01T19:35:12.642 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.642 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.642 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:12.642 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.111447+0000", 2024-04-01T19:35:12.642 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.013885666 2024-04-01T19:35:12.642 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.642 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.642 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:12.642 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.134970+0000", 2024-04-01T19:35:12.642 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.023523394999999999 2024-04-01T19:35:12.642 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.643 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.643 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:12.643 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.135006+0000", 2024-04-01T19:35:12.643 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.6239999999999999e-05 2024-04-01T19:35:12.643 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.643 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.643 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:12.643 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.135050+0000", 2024-04-01T19:35:12.643 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.3946000000000002e-05 2024-04-01T19:35:12.643 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.643 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:12.643 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.643 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.644 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.644 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:168878 2.4 2:2fe8ad4f:::benchmark_data_smithi188_77607_object1474:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:35:12.644 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:37.361741+0000", 2024-04-01T19:35:12.644 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 515.24412003099997, 2024-04-01T19:35:12.644 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13598875199999999, 2024-04-01T19:35:12.644 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:12.644 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:12.644 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:12.644 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:12.644 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:12.644 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:12.644 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 168878 2024-04-01T19:35:12.644 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.644 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:12.645 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.645 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:12.645 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.361741+0000", 2024-04-01T19:35:12.645 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.645 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.645 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.645 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:12.645 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.361741+0000", 2024-04-01T19:35:12.645 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.645 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.645 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.645 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:12.646 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.361742+0000", 2024-04-01T19:35:12.646 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0610000000000001e-06 2024-04-01T19:35:12.646 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.646 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.646 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:12.646 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.361746+0000", 2024-04-01T19:35:12.646 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.4999999999999999e-06 2024-04-01T19:35:12.646 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.646 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.646 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:12.646 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.361753+0000", 2024-04-01T19:35:12.646 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0380000000000002e-06 2024-04-01T19:35:12.646 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.647 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.647 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:12.647 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.361764+0000", 2024-04-01T19:35:12.647 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1372000000000001e-05 2024-04-01T19:35:12.647 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.647 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.647 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:12.647 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.386612+0000", 2024-04-01T19:35:12.647 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.024848186000000001 2024-04-01T19:35:12.647 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.647 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.647 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:12.647 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.386693+0000", 2024-04-01T19:35:12.647 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0269e-05 2024-04-01T19:35:12.648 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.648 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.648 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:35:12.648 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.386765+0000", 2024-04-01T19:35:12.648 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2755000000000004e-05 2024-04-01T19:35:12.648 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.648 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.648 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:12.648 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.396249+0000", 2024-04-01T19:35:12.648 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.009483544 2024-04-01T19:35:12.648 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.648 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.648 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:12.648 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.497621+0000", 2024-04-01T19:35:12.649 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.101372484 2024-04-01T19:35:12.649 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.649 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.649 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:12.649 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.497673+0000", 2024-04-01T19:35:12.649 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.1409000000000002e-05 2024-04-01T19:35:12.649 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.649 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.649 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:12.649 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.497730+0000", 2024-04-01T19:35:12.649 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7133999999999999e-05 2024-04-01T19:35:12.649 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.649 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:12.649 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.649 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.650 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.650 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:168882 2.4 2:253bea4e:::benchmark_data_smithi188_77607_object1478:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:35:12.650 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:37.362576+0000", 2024-04-01T19:35:12.650 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 515.24328566700001, 2024-04-01T19:35:12.650 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13527134399999999, 2024-04-01T19:35:12.650 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:12.650 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:12.650 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:12.650 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:12.650 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:12.650 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:12.650 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 168882 2024-04-01T19:35:12.651 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.651 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:12.651 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.651 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:12.651 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.362576+0000", 2024-04-01T19:35:12.651 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.651 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.651 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.651 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:12.651 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.362576+0000", 2024-04-01T19:35:12.651 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.652 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.652 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.652 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:12.652 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.362577+0000", 2024-04-01T19:35:12.652 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2300000000000001e-06 2024-04-01T19:35:12.652 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.652 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.652 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:12.652 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.362582+0000", 2024-04-01T19:35:12.652 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9389999999999996e-06 2024-04-01T19:35:12.652 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.652 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.652 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:12.652 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.362590+0000", 2024-04-01T19:35:12.653 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0809999999999994e-06 2024-04-01T19:35:12.653 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.653 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.653 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:12.653 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.362597+0000", 2024-04-01T19:35:12.653 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9739999999999996e-06 2024-04-01T19:35:12.653 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.653 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.653 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:12.653 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.389726+0000", 2024-04-01T19:35:12.653 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.027129442 2024-04-01T19:35:12.653 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.653 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.654 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:12.654 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.389812+0000", 2024-04-01T19:35:12.654 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5704000000000005e-05 2024-04-01T19:35:12.654 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.654 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.654 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:35:12.654 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.389902+0000", 2024-04-01T19:35:12.654 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.0214000000000001e-05 2024-04-01T19:35:12.654 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.654 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.654 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:12.654 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.396533+0000", 2024-04-01T19:35:12.654 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0066305979999999997 2024-04-01T19:35:12.654 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.655 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.655 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:12.655 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.497771+0000", 2024-04-01T19:35:12.655 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.101237884 2024-04-01T19:35:12.655 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.655 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.655 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:12.655 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.497802+0000", 2024-04-01T19:35:12.655 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.1560999999999998e-05 2024-04-01T19:35:12.655 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.655 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.655 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:12.655 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.497847+0000", 2024-04-01T19:35:12.655 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4716999999999999e-05 2024-04-01T19:35:12.655 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.656 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:12.656 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.656 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.656 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.656 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:169376 2.4 2:22116be6:::benchmark_data_smithi188_77607_object1972:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:35:12.656 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:37.964004+0000", 2024-04-01T19:35:12.656 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 514.64185701600002, 2024-04-01T19:35:12.656 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13362046899999999, 2024-04-01T19:35:12.656 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:12.656 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:12.656 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:12.656 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:12.656 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:12.656 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:12.657 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 169376 2024-04-01T19:35:12.657 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.657 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:12.657 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.657 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:12.657 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.964004+0000", 2024-04-01T19:35:12.657 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.657 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.657 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.657 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:12.657 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.964004+0000", 2024-04-01T19:35:12.657 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.657 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.657 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.658 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:12.658 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.964006+0000", 2024-04-01T19:35:12.658 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1179999999999999e-06 2024-04-01T19:35:12.658 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.658 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.658 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:12.658 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.964013+0000", 2024-04-01T19:35:12.658 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2809999999999997e-06 2024-04-01T19:35:12.658 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.658 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.658 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:12.658 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.964029+0000", 2024-04-01T19:35:12.658 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5945000000000001e-05 2024-04-01T19:35:12.659 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.659 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.659 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:12.659 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.964037+0000", 2024-04-01T19:35:12.659 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5199999999999997e-06 2024-04-01T19:35:12.659 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.659 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.659 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:12.659 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.968671+0000", 2024-04-01T19:35:12.659 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0046341430000000003 2024-04-01T19:35:12.659 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.659 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.659 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:12.659 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.968786+0000", 2024-04-01T19:35:12.660 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000115056 2024-04-01T19:35:12.660 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.660 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.660 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:35:12.660 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.968911+0000", 2024-04-01T19:35:12.660 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012422600000000001 2024-04-01T19:35:12.660 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.660 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.660 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:12.660 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:37.983926+0000", 2024-04-01T19:35:12.660 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.015015185 2024-04-01T19:35:12.660 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.660 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.660 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:12.661 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.097475+0000", 2024-04-01T19:35:12.661 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.113549708 2024-04-01T19:35:12.661 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.661 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.661 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:12.661 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.097548+0000", 2024-04-01T19:35:12.661 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2825999999999997e-05 2024-04-01T19:35:12.661 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.661 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.661 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:12.661 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.097625+0000", 2024-04-01T19:35:12.661 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6460999999999999e-05 2024-04-01T19:35:12.661 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.661 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:12.662 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.662 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.662 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.662 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:169563 2.4 2:22236e1e:::benchmark_data_smithi188_77607_object2159:head [delete] snapc 0=[] ondisk+write+known_if_redirected e139)", 2024-04-01T19:35:12.662 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:38.170573+0000", 2024-04-01T19:35:12.662 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 514.43528826700003, 2024-04-01T19:35:12.662 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.158113117, 2024-04-01T19:35:12.662 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:12.662 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:12.662 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:12.662 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:12.662 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:12.662 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:12.662 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 169563 2024-04-01T19:35:12.663 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.663 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:12.663 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.663 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:12.663 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.170573+0000", 2024-04-01T19:35:12.663 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.663 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.663 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.663 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:12.663 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.170573+0000", 2024-04-01T19:35:12.663 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.663 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.663 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.664 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:12.664 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.170575+0000", 2024-04-01T19:35:12.664 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2630000000000002e-06 2024-04-01T19:35:12.664 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.664 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.664 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:12.664 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.170582+0000", 2024-04-01T19:35:12.664 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.348e-06 2024-04-01T19:35:12.664 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.664 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.664 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:12.664 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.170595+0000", 2024-04-01T19:35:12.664 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3621999999999999e-05 2024-04-01T19:35:12.664 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.665 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.665 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:12.665 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.170604+0000", 2024-04-01T19:35:12.665 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8400000000000001e-06 2024-04-01T19:35:12.665 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.665 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.665 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:12.665 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.211420+0000", 2024-04-01T19:35:12.665 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.040816216000000002 2024-04-01T19:35:12.665 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.665 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.665 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:12.665 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.211530+0000", 2024-04-01T19:35:12.665 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00011005000000000001 2024-04-01T19:35:12.666 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.666 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.666 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:35:12.666 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.211650+0000", 2024-04-01T19:35:12.666 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000119741 2024-04-01T19:35:12.666 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.666 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.666 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:12.666 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.217218+0000", 2024-04-01T19:35:12.666 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0055679010000000001 2024-04-01T19:35:12.666 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.666 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.666 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:12.667 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.328560+0000", 2024-04-01T19:35:12.667 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.111341592 2024-04-01T19:35:12.667 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.667 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.667 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:12.667 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.328621+0000", 2024-04-01T19:35:12.667 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1166000000000004e-05 2024-04-01T19:35:12.667 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.667 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.667 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:12.667 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:38.328686+0000", 2024-04-01T19:35:12.667 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5377999999999996e-05 2024-04-01T19:35:12.667 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.667 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:12.668 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.668 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.668 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.668 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:170768 2.4 2:2ff39c60:::benchmark_data_smithi188_77607_object3364:head [delete] snapc 0=[] ondisk+write+known_if_redirected e140)", 2024-04-01T19:35:12.668 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:39.585423+0000", 2024-04-01T19:35:12.668 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 513.02043838099996, 2024-04-01T19:35:12.668 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.135395086, 2024-04-01T19:35:12.668 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:12.668 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:12.668 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:12.668 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:12.668 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:12.668 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:12.668 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 170768 2024-04-01T19:35:12.668 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.669 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:12.669 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.669 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:12.669 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.585423+0000", 2024-04-01T19:35:12.669 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.669 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.669 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.669 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:12.669 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.585423+0000", 2024-04-01T19:35:12.669 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.669 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.669 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.669 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:12.670 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.585425+0000", 2024-04-01T19:35:12.670 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.852e-06 2024-04-01T19:35:12.670 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.670 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.670 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:12.670 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.585431+0000", 2024-04-01T19:35:12.670 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1580000000000002e-06 2024-04-01T19:35:12.670 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.670 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.670 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:12.670 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.585440+0000", 2024-04-01T19:35:12.670 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.3300000000000005e-06 2024-04-01T19:35:12.670 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.671 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.671 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:12.671 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.585448+0000", 2024-04-01T19:35:12.671 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0099999999999995e-06 2024-04-01T19:35:12.671 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.671 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.671 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:12.671 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.684963+0000", 2024-04-01T19:35:12.671 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.099514376000000002 2024-04-01T19:35:12.671 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.671 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.671 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:12.671 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.685119+0000", 2024-04-01T19:35:12.672 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015643800000000001 2024-04-01T19:35:12.672 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.672 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.672 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:35:12.672 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.685270+0000", 2024-04-01T19:35:12.672 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000150576 2024-04-01T19:35:12.672 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.672 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.672 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:12.672 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.709200+0000", 2024-04-01T19:35:12.672 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.023929934999999999 2024-04-01T19:35:12.672 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.672 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.672 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:12.673 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.720712+0000", 2024-04-01T19:35:12.673 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.011512191999999999 2024-04-01T19:35:12.673 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.673 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.673 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:12.673 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.720769+0000", 2024-04-01T19:35:12.673 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6849999999999999e-05 2024-04-01T19:35:12.673 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.673 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.673 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:12.673 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.720818+0000", 2024-04-01T19:35:12.673 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9369000000000001e-05 2024-04-01T19:35:12.673 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.673 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:12.674 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.674 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.674 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.674 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:170773 2.4 2:28c89dc6:::benchmark_data_smithi188_77607_object3369:head [delete] snapc 0=[] ondisk+write+known_if_redirected e140)", 2024-04-01T19:35:12.674 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:39.587102+0000", 2024-04-01T19:35:12.674 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 513.01875976400004, 2024-04-01T19:35:12.674 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13739808100000001, 2024-04-01T19:35:12.674 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:12.674 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:12.674 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:12.674 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:12.674 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:12.675 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:12.675 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 170773 2024-04-01T19:35:12.675 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.675 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:12.675 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.675 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:12.675 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.587102+0000", 2024-04-01T19:35:12.675 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.675 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.675 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.675 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:12.675 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.587102+0000", 2024-04-01T19:35:12.675 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.675 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.676 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.676 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:12.676 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.587103+0000", 2024-04-01T19:35:12.676 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6130000000000001e-06 2024-04-01T19:35:12.676 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.676 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.676 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:12.676 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.587109+0000", 2024-04-01T19:35:12.676 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4550000000000003e-06 2024-04-01T19:35:12.676 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.676 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.676 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:12.676 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.587121+0000", 2024-04-01T19:35:12.676 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1914e-05 2024-04-01T19:35:12.677 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.677 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.677 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:12.677 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.587129+0000", 2024-04-01T19:35:12.677 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5820000000000002e-06 2024-04-01T19:35:12.677 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.677 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.677 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:12.677 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.688934+0000", 2024-04-01T19:35:12.677 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.10180497199999999 2024-04-01T19:35:12.677 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.677 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.677 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:12.678 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.689017+0000", 2024-04-01T19:35:12.678 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2602999999999995e-05 2024-04-01T19:35:12.678 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.678 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.678 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:35:12.678 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.689093+0000", 2024-04-01T19:35:12.678 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6738999999999998e-05 2024-04-01T19:35:12.678 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.678 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.678 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:12.678 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.709205+0000", 2024-04-01T19:35:12.678 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.020111831 2024-04-01T19:35:12.678 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.678 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.679 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:12.679 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.724394+0000", 2024-04-01T19:35:12.679 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.015189162000000001 2024-04-01T19:35:12.679 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.679 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.679 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:12.679 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.724441+0000", 2024-04-01T19:35:12.679 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6403000000000003e-05 2024-04-01T19:35:12.679 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.679 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.679 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:12.679 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.724500+0000", 2024-04-01T19:35:12.679 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8807000000000001e-05 2024-04-01T19:35:12.680 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.680 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:12.680 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.680 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.680 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.680 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:170780 2.4 2:2c43b94c:::benchmark_data_smithi188_77607_object3376:head [delete] snapc 0=[] ondisk+write+known_if_redirected e140)", 2024-04-01T19:35:12.680 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:39.596139+0000", 2024-04-01T19:35:12.680 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 513.00972272499996, 2024-04-01T19:35:12.680 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13253120400000001, 2024-04-01T19:35:12.680 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:12.680 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:12.680 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:12.680 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:12.680 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:12.680 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:12.681 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 170780 2024-04-01T19:35:12.681 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.681 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:12.681 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.681 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:12.681 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.596139+0000", 2024-04-01T19:35:12.681 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.681 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.681 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.681 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:12.681 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.596139+0000", 2024-04-01T19:35:12.681 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.681 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.682 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.682 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:12.682 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.596141+0000", 2024-04-01T19:35:12.682 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.401e-06 2024-04-01T19:35:12.682 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.682 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.682 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:12.682 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.596147+0000", 2024-04-01T19:35:12.682 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2770000000000002e-06 2024-04-01T19:35:12.682 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.682 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.682 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:12.682 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.596158+0000", 2024-04-01T19:35:12.682 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1043000000000001e-05 2024-04-01T19:35:12.683 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.683 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.683 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:12.683 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.596166+0000", 2024-04-01T19:35:12.683 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0190000000000006e-06 2024-04-01T19:35:12.683 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.683 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.683 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:12.683 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.692475+0000", 2024-04-01T19:35:12.683 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.096309078000000006 2024-04-01T19:35:12.683 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.683 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.683 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:12.683 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.692612+0000", 2024-04-01T19:35:12.684 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000136315 2024-04-01T19:35:12.684 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.684 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.684 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:35:12.684 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.692842+0000", 2024-04-01T19:35:12.684 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00023002 2024-04-01T19:35:12.684 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.684 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.684 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:12.684 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.709328+0000", 2024-04-01T19:35:12.684 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.016485975999999999 2024-04-01T19:35:12.684 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.684 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.684 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:12.685 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.728560+0000", 2024-04-01T19:35:12.685 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.019231997000000001 2024-04-01T19:35:12.685 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.685 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.685 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:12.685 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.728595+0000", 2024-04-01T19:35:12.685 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5374999999999999e-05 2024-04-01T19:35:12.685 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.685 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.685 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:12.685 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.728670+0000", 2024-04-01T19:35:12.685 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4703000000000006e-05 2024-04-01T19:35:12.685 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.685 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:12.686 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.686 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.686 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.686 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:170987 2.4 2:2b017fd7:::benchmark_data_smithi188_77607_object3583:head [delete] snapc 0=[] ondisk+write+known_if_redirected e141)", 2024-04-01T19:35:12.686 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:39.855785+0000", 2024-04-01T19:35:12.686 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 512.75007649400004, 2024-04-01T19:35:12.686 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.17668636300000001, 2024-04-01T19:35:12.686 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:12.686 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:12.686 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:12.686 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:12.686 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:12.686 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:12.687 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 170987 2024-04-01T19:35:12.687 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.687 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:12.687 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.687 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:12.687 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.855785+0000", 2024-04-01T19:35:12.687 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.687 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.687 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.687 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:12.687 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.855785+0000", 2024-04-01T19:35:12.687 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.687 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.687 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.688 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:12.688 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.855787+0000", 2024-04-01T19:35:12.688 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.413e-06 2024-04-01T19:35:12.688 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.688 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.688 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:12.688 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.855794+0000", 2024-04-01T19:35:12.688 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3369999999999996e-06 2024-04-01T19:35:12.688 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.688 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.688 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:12.688 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.855805+0000", 2024-04-01T19:35:12.688 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.119e-05 2024-04-01T19:35:12.688 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.689 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.689 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:12.689 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.855813+0000", 2024-04-01T19:35:12.689 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.704e-06 2024-04-01T19:35:12.689 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.689 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.689 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:12.689 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.897481+0000", 2024-04-01T19:35:12.689 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.041667997999999998 2024-04-01T19:35:12.689 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.689 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.689 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:12.689 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.897627+0000", 2024-04-01T19:35:12.689 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000145551 2024-04-01T19:35:12.690 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.690 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.690 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:35:12.690 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.897754+0000", 2024-04-01T19:35:12.690 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000127448 2024-04-01T19:35:12.690 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.690 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.690 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:12.690 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:39.904812+0000", 2024-04-01T19:35:12.690 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.007057547 2024-04-01T19:35:12.690 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.690 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.690 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:12.691 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.032341+0000", 2024-04-01T19:35:12.691 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.12752882600000001 2024-04-01T19:35:12.691 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.691 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.691 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:12.691 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.032402+0000", 2024-04-01T19:35:12.691 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1237999999999999e-05 2024-04-01T19:35:12.691 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.691 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.691 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:12.691 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.032471+0000", 2024-04-01T19:35:12.691 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9110999999999996e-05 2024-04-01T19:35:12.691 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.691 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:12.691 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.692 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.692 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.692 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:171249 2.4 2:2ed16714:::benchmark_data_smithi188_77607_object3845:head [delete] snapc 0=[] ondisk+write+known_if_redirected e141)", 2024-04-01T19:35:12.692 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:40.187602+0000", 2024-04-01T19:35:12.692 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 512.41825971100002, 2024-04-01T19:35:12.692 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.139158531, 2024-04-01T19:35:12.692 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:12.692 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:12.692 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:12.692 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:12.692 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:12.692 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:12.692 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 171249 2024-04-01T19:35:12.692 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.693 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:12.693 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.693 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:12.693 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.187602+0000", 2024-04-01T19:35:12.693 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.693 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.693 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.693 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:12.693 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.187602+0000", 2024-04-01T19:35:12.693 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.693 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.693 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.693 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:12.693 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.187604+0000", 2024-04-01T19:35:12.694 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2010000000000002e-06 2024-04-01T19:35:12.694 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.694 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.694 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:12.694 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.187610+0000", 2024-04-01T19:35:12.694 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5289999999999997e-06 2024-04-01T19:35:12.694 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.694 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.694 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:12.694 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.187623+0000", 2024-04-01T19:35:12.694 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2531000000000001e-05 2024-04-01T19:35:12.694 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.694 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.695 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:12.695 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.187633+0000", 2024-04-01T19:35:12.695 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0101999999999999e-05 2024-04-01T19:35:12.695 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.695 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.695 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:12.695 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.287600+0000", 2024-04-01T19:35:12.695 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.099966652000000003 2024-04-01T19:35:12.695 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.695 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.695 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:12.695 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.287733+0000", 2024-04-01T19:35:12.695 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013353400000000001 2024-04-01T19:35:12.695 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.696 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.696 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:35:12.696 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.287887+0000", 2024-04-01T19:35:12.696 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000153404 2024-04-01T19:35:12.696 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.696 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.696 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:12.696 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.291575+0000", 2024-04-01T19:35:12.696 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0036889259999999999 2024-04-01T19:35:12.696 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.696 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.696 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:12.696 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.326673+0000", 2024-04-01T19:35:12.696 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.035097916 2024-04-01T19:35:12.697 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.697 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.697 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:12.697 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.326707+0000", 2024-04-01T19:35:12.697 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.4090000000000001e-05 2024-04-01T19:35:12.697 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.697 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.697 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:12.697 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.326760+0000", 2024-04-01T19:35:12.697 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2645999999999997e-05 2024-04-01T19:35:12.697 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.697 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:12.697 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.697 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.698 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.698 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:171254 2.4 2:271db100:::benchmark_data_smithi188_77607_object3850:head [delete] snapc 0=[] ondisk+write+known_if_redirected e141)", 2024-04-01T19:35:12.698 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:40.188075+0000", 2024-04-01T19:35:12.698 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 512.41778671999998, 2024-04-01T19:35:12.698 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.155416745, 2024-04-01T19:35:12.698 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:12.698 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:12.698 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:12.698 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:12.698 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:12.698 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:12.698 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 171254 2024-04-01T19:35:12.698 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.699 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:12.699 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.699 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:12.699 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.188075+0000", 2024-04-01T19:35:12.699 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.699 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.699 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.699 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:12.699 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.188075+0000", 2024-04-01T19:35:12.699 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.699 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.699 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.699 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:12.699 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.188076+0000", 2024-04-01T19:35:12.700 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4640000000000001e-06 2024-04-01T19:35:12.700 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.700 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.700 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:12.700 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.188081+0000", 2024-04-01T19:35:12.700 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8040000000000001e-06 2024-04-01T19:35:12.700 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.700 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.700 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:12.700 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.188104+0000", 2024-04-01T19:35:12.700 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3577000000000001e-05 2024-04-01T19:35:12.700 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.700 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.700 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:12.701 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.188112+0000", 2024-04-01T19:35:12.701 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5120000000000002e-06 2024-04-01T19:35:12.701 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.701 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.701 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:12.701 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.293169+0000", 2024-04-01T19:35:12.701 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.105056749 2024-04-01T19:35:12.701 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.701 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.701 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:12.701 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.293261+0000", 2024-04-01T19:35:12.701 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.2708999999999996e-05 2024-04-01T19:35:12.701 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.702 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.702 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:35:12.702 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.293347+0000", 2024-04-01T19:35:12.702 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5418000000000001e-05 2024-04-01T19:35:12.702 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.702 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.702 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:12.702 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.301658+0000", 2024-04-01T19:35:12.702 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0083108169999999999 2024-04-01T19:35:12.702 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.702 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.702 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:12.702 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.343390+0000", 2024-04-01T19:35:12.703 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.041732305999999997 2024-04-01T19:35:12.703 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.703 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.703 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:12.703 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.343430+0000", 2024-04-01T19:35:12.703 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.0021999999999997e-05 2024-04-01T19:35:12.703 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.703 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.703 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:12.703 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.343491+0000", 2024-04-01T19:35:12.703 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1366999999999997e-05 2024-04-01T19:35:12.703 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.703 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:12.703 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.704 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.704 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.704 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:171408 2.4 2:2138250a:::benchmark_data_smithi188_77607_object4004:head [delete] snapc 0=[] ondisk+write+known_if_redirected e141)", 2024-04-01T19:35:12.704 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:40.399136+0000", 2024-04-01T19:35:12.704 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 512.20672488599996, 2024-04-01T19:35:12.704 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.14753075600000001, 2024-04-01T19:35:12.704 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:12.704 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:12.704 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:12.704 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:12.704 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:12.704 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:12.704 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 171408 2024-04-01T19:35:12.704 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.705 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:12.705 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.705 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:12.705 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.399136+0000", 2024-04-01T19:35:12.705 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.705 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.705 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.705 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:12.705 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.399136+0000", 2024-04-01T19:35:12.705 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.705 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.705 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.705 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:12.705 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.399138+0000", 2024-04-01T19:35:12.706 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.096e-06 2024-04-01T19:35:12.706 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.706 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.706 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:12.706 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.399142+0000", 2024-04-01T19:35:12.706 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.2930000000000002e-06 2024-04-01T19:35:12.706 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.706 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.706 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:12.706 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.399149+0000", 2024-04-01T19:35:12.706 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4819999999999997e-06 2024-04-01T19:35:12.706 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.706 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.707 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:12.707 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.399156+0000", 2024-04-01T19:35:12.707 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.6390000000000003e-06 2024-04-01T19:35:12.707 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.707 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.707 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:12.707 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.458840+0000", 2024-04-01T19:35:12.707 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.059683936 2024-04-01T19:35:12.707 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.707 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.707 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:12.707 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.458919+0000", 2024-04-01T19:35:12.707 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9036999999999996e-05 2024-04-01T19:35:12.707 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.707 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.708 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:35:12.708 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.459034+0000", 2024-04-01T19:35:12.708 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000115406 2024-04-01T19:35:12.708 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.708 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.708 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:12.708 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.468175+0000", 2024-04-01T19:35:12.708 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0091410810000000006 2024-04-01T19:35:12.708 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.708 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.708 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:12.708 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.546519+0000", 2024-04-01T19:35:12.708 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.078343975999999996 2024-04-01T19:35:12.708 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.709 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.709 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:12.709 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.546603+0000", 2024-04-01T19:35:12.709 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3591999999999995e-05 2024-04-01T19:35:12.709 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.709 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.709 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:12.709 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.546667+0000", 2024-04-01T19:35:12.709 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4218000000000001e-05 2024-04-01T19:35:12.709 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.709 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:12.709 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.709 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.710 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.710 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:171556 2.4 2:2e8e4f02:::benchmark_data_smithi188_77607_object4152:head [delete] snapc 0=[] ondisk+write+known_if_redirected e141)", 2024-04-01T19:35:12.710 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:40.575646+0000", 2024-04-01T19:35:12.710 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 512.03021481999997, 2024-04-01T19:35:12.710 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.140900262, 2024-04-01T19:35:12.710 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:12.710 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:12.710 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:12.710 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:12.710 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:12.710 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:12.710 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 171556 2024-04-01T19:35:12.710 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.710 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:12.711 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.711 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:12.711 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.575646+0000", 2024-04-01T19:35:12.711 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.711 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.711 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.711 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:12.711 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.575646+0000", 2024-04-01T19:35:12.711 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.711 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.711 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.711 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:12.711 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.575649+0000", 2024-04-01T19:35:12.711 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4739999999999999e-06 2024-04-01T19:35:12.711 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.712 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.712 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:12.712 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.575657+0000", 2024-04-01T19:35:12.712 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0059999999999992e-06 2024-04-01T19:35:12.712 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.712 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.712 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:12.712 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.575669+0000", 2024-04-01T19:35:12.712 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1619e-05 2024-04-01T19:35:12.712 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.712 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.712 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:12.712 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.575677+0000", 2024-04-01T19:35:12.712 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5420000000000005e-06 2024-04-01T19:35:12.712 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.713 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.713 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:12.713 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.680865+0000", 2024-04-01T19:35:12.713 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.10518825800000001 2024-04-01T19:35:12.713 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.713 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.713 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:12.713 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.680984+0000", 2024-04-01T19:35:12.713 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000118579 2024-04-01T19:35:12.713 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.713 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.713 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:35:12.713 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.681109+0000", 2024-04-01T19:35:12.713 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012469 2024-04-01T19:35:12.713 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.714 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.714 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:12.714 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.694331+0000", 2024-04-01T19:35:12.714 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.013222650000000001 2024-04-01T19:35:12.714 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.714 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.714 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:12.714 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.716424+0000", 2024-04-01T19:35:12.714 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.022092309000000001 2024-04-01T19:35:12.714 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.714 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.714 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:12.714 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.716479+0000", 2024-04-01T19:35:12.715 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4951999999999998e-05 2024-04-01T19:35:12.715 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.715 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.715 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:12.715 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:40.716547+0000", 2024-04-01T19:35:12.715 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8182999999999994e-05 2024-04-01T19:35:12.715 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.715 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:12.715 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.715 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.715 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.715 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:265186 2.6 2.c4c92856 (undecoded) ondisk+retry+write+known_if_redirected e170)", 2024-04-01T19:35:12.715 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:30.810128+0000", 2024-04-01T19:35:12.715 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 401.79573353000001, 2024-04-01T19:35:12.715 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.136600637, 2024-04-01T19:35:12.715 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:12.716 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:12.716 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "reached pg", 2024-04-01T19:35:12.716 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:12.716 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:12.716 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:12.716 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 265186 2024-04-01T19:35:12.716 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.716 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:12.716 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.716 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:12.716 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810128+0000", 2024-04-01T19:35:12.716 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.716 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.716 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.716 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:12.716 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810128+0000", 2024-04-01T19:35:12.717 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.717 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.717 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.717 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:12.717 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810130+0000", 2024-04-01T19:35:12.717 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.593e-06 2024-04-01T19:35:12.717 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.717 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.717 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:12.717 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810138+0000", 2024-04-01T19:35:12.717 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2880000000000004e-06 2024-04-01T19:35:12.717 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.717 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.717 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:12.718 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810151+0000", 2024-04-01T19:35:12.718 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2892e-05 2024-04-01T19:35:12.718 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.718 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.718 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:12.718 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810161+0000", 2024-04-01T19:35:12.718 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0040999999999999e-05 2024-04-01T19:35:12.718 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.718 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.718 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:12.718 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810208+0000", 2024-04-01T19:35:12.718 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7243999999999997e-05 2024-04-01T19:35:12.718 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.719 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.719 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for peered", 2024-04-01T19:35:12.719 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810216+0000", 2024-04-01T19:35:12.719 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3019999999999995e-06 2024-04-01T19:35:12.719 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.719 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.719 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:12.719 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.946682+0000", 2024-04-01T19:35:12.719 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13646552200000001 2024-04-01T19:35:12.719 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.719 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.719 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:12.719 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.946728+0000", 2024-04-01T19:35:12.719 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6755000000000002e-05 2024-04-01T19:35:12.720 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.720 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:12.720 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.720 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.720 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.720 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:265188 2.6 2.8eece8d6 (undecoded) ondisk+retry+write+known_if_redirected e170)", 2024-04-01T19:35:12.720 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:30.810177+0000", 2024-04-01T19:35:12.720 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 401.79568384599997, 2024-04-01T19:35:12.720 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.136708157, 2024-04-01T19:35:12.720 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:12.720 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:12.720 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "reached pg", 2024-04-01T19:35:12.720 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:12.720 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:12.721 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:12.721 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 265188 2024-04-01T19:35:12.721 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.721 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:12.721 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.721 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:12.721 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810177+0000", 2024-04-01T19:35:12.721 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.721 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.721 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.721 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:12.721 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810177+0000", 2024-04-01T19:35:12.721 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.721 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.722 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.722 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:12.722 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810178+0000", 2024-04-01T19:35:12.722 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2699999999999999e-07 2024-04-01T19:35:12.722 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.722 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.722 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:12.722 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810182+0000", 2024-04-01T19:35:12.722 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7809999999999999e-06 2024-04-01T19:35:12.722 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.722 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.722 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:12.722 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810188+0000", 2024-04-01T19:35:12.723 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3300000000000004e-06 2024-04-01T19:35:12.723 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.723 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.723 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:12.723 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810195+0000", 2024-04-01T19:35:12.723 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2960000000000004e-06 2024-04-01T19:35:12.723 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.723 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.723 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:12.723 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810254+0000", 2024-04-01T19:35:12.723 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8928000000000002e-05 2024-04-01T19:35:12.723 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.723 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.724 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for peered", 2024-04-01T19:35:12.724 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810262+0000", 2024-04-01T19:35:12.724 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3019999999999995e-06 2024-04-01T19:35:12.724 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.724 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.724 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:12.724 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.946879+0000", 2024-04-01T19:35:12.724 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13661667199999999 2024-04-01T19:35:12.724 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.724 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.724 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:12.724 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.946886+0000", 2024-04-01T19:35:12.724 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.1210000000000001e-06 2024-04-01T19:35:12.724 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.724 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:12.725 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.725 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.725 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.725 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:265216 2.6 2.e5488046 (undecoded) ondisk+retry+write+known_if_redirected e170)", 2024-04-01T19:35:12.725 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:30.810203+0000", 2024-04-01T19:35:12.725 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 401.79565784900001, 2024-04-01T19:35:12.725 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13673660200000001, 2024-04-01T19:35:12.725 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:12.725 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:12.725 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "reached pg", 2024-04-01T19:35:12.725 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:12.725 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:12.725 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:12.726 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 265216 2024-04-01T19:35:12.726 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.726 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:12.726 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.726 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:12.726 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810203+0000", 2024-04-01T19:35:12.726 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.726 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.726 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.726 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:12.726 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810203+0000", 2024-04-01T19:35:12.726 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:12.726 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.726 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.727 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:12.727 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810204+0000", 2024-04-01T19:35:12.727 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3600000000000003e-07 2024-04-01T19:35:12.727 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.727 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.727 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:12.727 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810208+0000", 2024-04-01T19:35:12.727 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7220000000000001e-06 2024-04-01T19:35:12.727 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.727 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.727 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:12.727 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810214+0000", 2024-04-01T19:35:12.727 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9379999999999997e-06 2024-04-01T19:35:12.728 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.728 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.728 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:12.728 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810219+0000", 2024-04-01T19:35:12.728 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0969999999999996e-06 2024-04-01T19:35:12.728 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.728 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.728 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:12.728 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810277+0000", 2024-04-01T19:35:12.728 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7966e-05 2024-04-01T19:35:12.728 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.728 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.728 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for peered", 2024-04-01T19:35:12.728 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.810282+0000", 2024-04-01T19:35:12.729 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6380000000000001e-06 2024-04-01T19:35:12.729 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.729 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.729 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:12.729 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.946932+0000", 2024-04-01T19:35:12.729 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13664933700000001 2024-04-01T19:35:12.729 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:12.729 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:12.729 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:12.729 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:30.946940+0000", 2024-04-01T19:35:12.729 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2679999999999994e-06 2024-04-01T19:35:12.729 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.729 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:12.729 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.730 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:12.730 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:12.730 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:35:12.730 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:35:12.771 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:12.984 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:35:12.987 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:12.988 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:35:13.003 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":842,"stamp":"2024-04-01T19:35:10.884469+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":9183625760,"num_objects":140124,"num_object_clones":0,"num_object_copies":280248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":140124,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":140303,"num_write_kb":8970746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140261,"ondisk_log_size":140261,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":11,"kb":1124941824,"kb_used":20449236,"kb_used_data":17839088,"kb_used_omap":149,"kb_used_meta":2609898,"kb_avail":1104492588,"statfs":{"total":1151940427776,"available":1131000410112,"internally_reserved":0,"allocated":18267226112,"data_stored":18261067972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":152997,"internal_metadata":2672536155},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,5,6,4],"upper_bound":32},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":916783104,"num_objects":13989,"num_object_clones":0,"num_object_copies":27978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13989,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13989,"num_write_kb":895296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.901619"},"pg_stats":[{"pgid":"4.f","version":"292'8884","reported_seq":8943,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-04-01T19:35:09.313821+0000","last_change":"2024-04-01T19:33:59.106417+0000","last_active":"2024-04-01T19:35:09.313821+0000","last_peered":"2024-04-01T19:35:09.313821+0000","last_clean":"2024-04-01T19:35:09.313821+0000","last_became_active":"2024-04-01T19:33:59.106174+0000","last_became_peered":"2024-04-01T19:33:59.106174+0000","last_unstale":"2024-04-01T19:35:09.313821+0000","last_undegraded":"2024-04-01T19:35:09.313821+0000","last_fullsized":"2024-04-01T19:35:09.313821+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":8884,"log_dups_size":0,"ondisk_log_size":8884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:35:15.203656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582221824,"num_objects":8884,"num_object_clones":0,"num_object_copies":17768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8884,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8884,"num_write_kb":568576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"292'8518","reported_seq":8576,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-04-01T19:35:06.377102+0000","last_change":"2024-04-01T19:33:59.258882+0000","last_active":"2024-04-01T19:35:06.377102+0000","last_peered":"2024-04-01T19:35:06.377102+0000","last_clean":"2024-04-01T19:35:06.377102+0000","last_became_active":"2024-04-01T19:33:59.258540+0000","last_became_peered":"2024-04-01T19:33:59.258540+0000","last_unstale":"2024-04-01T19:35:06.377102+0000","last_undegraded":"2024-04-01T19:35:06.377102+0000","last_fullsized":"2024-04-01T19:35:06.377102+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":8518,"log_dups_size":0,"ondisk_log_size":8518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:35:09.909018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":558235648,"num_objects":8518,"num_object_clones":0,"num_object_copies":17036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8518,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8518,"num_write_kb":545152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.d","version":"292'8461","reported_seq":8518,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-04-01T19:35:06.369925+0000","last_change":"2024-04-01T19:33:59.105554+0000","last_active":"2024-04-01T19:35:06.369925+0000","last_peered":"2024-04-01T19:35:06.369925+0000","last_clean":"2024-04-01T19:35:06.369925+0000","last_became_active":"2024-04-01T19:33:59.105279+0000","last_became_peered":"2024-04-01T19:33:59.105279+0000","last_unstale":"2024-04-01T19:35:06.369925+0000","last_undegraded":"2024-04-01T19:35:06.369925+0000","last_fullsized":"2024-04-01T19:35:06.369925+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":8461,"log_dups_size":0,"ondisk_log_size":8461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:35:24.554461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554500096,"num_objects":8461,"num_object_clones":0,"num_object_copies":16922,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8461,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8461,"num_write_kb":541504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.c","version":"292'8547","reported_seq":8603,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-04-01T19:35:06.356330+0000","last_change":"2024-04-01T19:33:59.105349+0000","last_active":"2024-04-01T19:35:06.356330+0000","last_peered":"2024-04-01T19:35:06.356330+0000","last_clean":"2024-04-01T19:35:06.356330+0000","last_became_active":"2024-04-01T19:33:59.105051+0000","last_became_peered":"2024-04-01T19:33:59.105051+0000","last_unstale":"2024-04-01T19:35:06.356330+0000","last_undegraded":"2024-04-01T19:35:06.356330+0000","last_fullsized":"2024-04-01T19:35:06.356330+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":8547,"log_dups_size":0,"ondisk_log_size":8547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:35:15.693384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":560136192,"num_objects":8547,"num_object_clones":0,"num_object_copies":17094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8547,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8547,"num_write_kb":547008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.b","version":"292'8827","reported_seq":8886,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-04-01T19:35:10.272204+0000","last_change":"2024-04-01T19:33:59.106009+0000","last_active":"2024-04-01T19:35:10.272204+0000","last_peered":"2024-04-01T19:35:10.272204+0000","last_clean":"2024-04-01T19:35:10.272204+0000","last_became_active":"2024-04-01T19:33:59.105705+0000","last_became_peered":"2024-04-01T19:33:59.105705+0000","last_unstale":"2024-04-01T19:35:10.272204+0000","last_undegraded":"2024-04-01T19:35:10.272204+0000","last_fullsized":"2024-04-01T19:35:10.272204+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":8827,"log_dups_size":0,"ondisk_log_size":8827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:35:25.201752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":578486272,"num_objects":8827,"num_object_clones":0,"num_object_copies":17654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8827,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8827,"num_write_kb":564928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"292'8692","reported_seq":8751,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-04-01T19:35:07.439427+0000","last_change":"2024-04-01T19:33:59.106217+0000","last_active":"2024-04-01T19:35:07.439427+0000","last_peered":"2024-04-01T19:35:07.439427+0000","last_clean":"2024-04-01T19:35:07.439427+0000","last_became_active":"2024-04-01T19:33:59.105994+0000","last_became_peered":"2024-04-01T19:33:59.105994+0000","last_unstale":"2024-04-01T19:35:07.439427+0000","last_undegraded":"2024-04-01T19:35:07.439427+0000","last_fullsized":"2024-04-01T19:35:07.439427+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":8692,"log_dups_size":0,"ondisk_log_size":8692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569638912,"num_objects":8692,"num_object_clones":0,"num_object_copies":17384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8692,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8692,"num_write_kb":556288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"292'9113","reported_seq":9170,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-04-01T19:35:10.515799+0000","last_change":"2024-04-01T19:33:59.106743+0000","last_active":"2024-04-01T19:35:10.515799+0000","last_peered":"2024-04-01T19:35:10.515799+0000","last_clean":"2024-04-01T19:35:10.515799+0000","last_became_active":"2024-04-01T19:33:59.106492+0000","last_became_peered":"2024-04-01T19:33:59.106492+0000","last_unstale":"2024-04-01T19:35:10.515799+0000","last_undegraded":"2024-04-01T19:35:10.515799+0000","last_fullsized":"2024-04-01T19:35:10.515799+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":9113,"log_dups_size":0,"ondisk_log_size":9113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:35:15.549955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":597229568,"num_objects":9113,"num_object_clones":0,"num_object_copies":18226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9113,"num_write_kb":583232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.8","version":"292'8856","reported_seq":8915,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-04-01T19:35:10.487461+0000","last_change":"2024-04-01T19:33:59.258895+0000","last_active":"2024-04-01T19:35:10.487461+0000","last_peered":"2024-04-01T19:35:10.487461+0000","last_clean":"2024-04-01T19:35:10.487461+0000","last_became_active":"2024-04-01T19:33:59.258615+0000","last_became_peered":"2024-04-01T19:33:59.258615+0000","last_unstale":"2024-04-01T19:35:10.487461+0000","last_undegraded":"2024-04-01T19:35:10.487461+0000","last_fullsized":"2024-04-01T19:35:10.487461+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":8856,"log_dups_size":0,"ondisk_log_size":8856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580386816,"num_objects":8856,"num_object_clones":0,"num_object_copies":17712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8856,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8856,"num_write_kb":566784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.7","version":"292'8800","reported_seq":8859,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-04-01T19:35:09.310758+0000","last_change":"2024-04-01T19:33:59.258981+0000","last_active":"2024-04-01T19:35:09.310758+0000","last_peered":"2024-04-01T19:35:09.310758+0000","last_clean":"2024-04-01T19:35:09.310758+0000","last_became_active":"2024-04-01T19:33:59.258696+0000","last_became_peered":"2024-04-01T19:33:59.258696+0000","last_unstale":"2024-04-01T19:35:09.310758+0000","last_undegraded":"2024-04-01T19:35:09.310758+0000","last_fullsized":"2024-04-01T19:35:09.310758+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":8800,"log_dups_size":0,"ondisk_log_size":8800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:35:12.177516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576716800,"num_objects":8800,"num_object_clones":0,"num_object_copies":17600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8800,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8800,"num_write_kb":563200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"292'8780","reported_seq":8839,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-04-01T19:35:09.764534+0000","last_change":"2024-04-01T19:33:59.105934+0000","last_active":"2024-04-01T19:35:09.764534+0000","last_peered":"2024-04-01T19:35:09.764534+0000","last_clean":"2024-04-01T19:35:09.764534+0000","last_became_active":"2024-04-01T19:33:59.105657+0000","last_became_peered":"2024-04-01T19:33:59.105657+0000","last_unstale":"2024-04-01T19:35:09.764534+0000","last_undegraded":"2024-04-01T19:35:09.764534+0000","last_fullsized":"2024-04-01T19:35:09.764534+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":8780,"log_dups_size":0,"ondisk_log_size":8780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:35:23.034515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575406080,"num_objects":8780,"num_object_clones":0,"num_object_copies":17560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8780,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8780,"num_write_kb":561920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.4","version":"292'8800","reported_seq":8859,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-04-01T19:35:09.281467+0000","last_change":"2024-04-01T19:33:59.257923+0000","last_active":"2024-04-01T19:35:09.281467+0000","last_peered":"2024-04-01T19:35:09.281467+0000","last_clean":"2024-04-01T19:35:09.281467+0000","last_became_active":"2024-04-01T19:33:59.257653+0000","last_became_peered":"2024-04-01T19:33:59.257653+0000","last_unstale":"2024-04-01T19:35:09.281467+0000","last_undegraded":"2024-04-01T19:35:09.281467+0000","last_fullsized":"2024-04-01T19:35:09.281467+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":8800,"log_dups_size":0,"ondisk_log_size":8800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:35:12.177557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576716800,"num_objects":8800,"num_object_clones":0,"num_object_copies":17600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8800,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8800,"num_write_kb":563200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"292'8781","reported_seq":8840,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-04-01T19:35:10.495492+0000","last_change":"2024-04-01T19:33:59.258465+0000","last_active":"2024-04-01T19:35:10.495492+0000","last_peered":"2024-04-01T19:35:10.495492+0000","last_clean":"2024-04-01T19:35:10.495492+0000","last_became_active":"2024-04-01T19:33:59.258172+0000","last_became_peered":"2024-04-01T19:33:59.258172+0000","last_unstale":"2024-04-01T19:35:10.495492+0000","last_undegraded":"2024-04-01T19:35:10.495492+0000","last_fullsized":"2024-04-01T19:35:10.495492+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":8781,"log_dups_size":0,"ondisk_log_size":8781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:35:12.293940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575471616,"num_objects":8781,"num_object_clones":0,"num_object_copies":17562,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8781,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8781,"num_write_kb":561984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"292'8857","reported_seq":8916,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-04-01T19:35:09.763098+0000","last_change":"2024-04-01T19:33:59.102383+0000","last_active":"2024-04-01T19:35:09.763098+0000","last_peered":"2024-04-01T19:35:09.763098+0000","last_clean":"2024-04-01T19:35:09.763098+0000","last_became_active":"2024-04-01T19:33:59.102135+0000","last_became_peered":"2024-04-01T19:33:59.102135+0000","last_unstale":"2024-04-01T19:35:09.763098+0000","last_undegraded":"2024-04-01T19:35:09.763098+0000","last_fullsized":"2024-04-01T19:35:09.763098+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":8857,"log_dups_size":0,"ondisk_log_size":8857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:35:10.426764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580452352,"num_objects":8857,"num_object_clones":0,"num_object_copies":17714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8857,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8857,"num_write_kb":566848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5],"acting":[9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1","version":"292'8935","reported_seq":8994,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-04-01T19:35:10.511109+0000","last_change":"2024-04-01T19:33:59.106086+0000","last_active":"2024-04-01T19:35:10.511109+0000","last_peered":"2024-04-01T19:35:10.511109+0000","last_clean":"2024-04-01T19:35:10.511109+0000","last_became_active":"2024-04-01T19:33:59.105816+0000","last_became_peered":"2024-04-01T19:33:59.105816+0000","last_unstale":"2024-04-01T19:35:10.511109+0000","last_undegraded":"2024-04-01T19:35:10.511109+0000","last_fullsized":"2024-04-01T19:35:10.511109+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":8935,"log_dups_size":0,"ondisk_log_size":8935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":585564160,"num_objects":8935,"num_object_clones":0,"num_object_copies":17870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8935,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8935,"num_write_kb":571840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.0","version":"292'8640","reported_seq":8699,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-04-01T19:35:07.434053+0000","last_change":"2024-04-01T19:33:59.258783+0000","last_active":"2024-04-01T19:35:07.434053+0000","last_peered":"2024-04-01T19:35:07.434053+0000","last_clean":"2024-04-01T19:35:07.434053+0000","last_became_active":"2024-04-01T19:33:59.258519+0000","last_became_peered":"2024-04-01T19:33:59.258519+0000","last_unstale":"2024-04-01T19:35:07.434053+0000","last_undegraded":"2024-04-01T19:35:07.434053+0000","last_fullsized":"2024-04-01T19:35:07.434053+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":8640,"log_dups_size":0,"ondisk_log_size":8640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:35:10.662556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566231040,"num_objects":8640,"num_object_clones":0,"num_object_copies":17280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8640,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8640,"num_write_kb":552960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"292'8631","reported_seq":8690,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-04-01T19:35:07.429339+0000","last_change":"2024-04-01T19:33:59.258963+0000","last_active":"2024-04-01T19:35:07.429339+0000","last_peered":"2024-04-01T19:35:07.429339+0000","last_clean":"2024-04-01T19:35:07.429339+0000","last_became_active":"2024-04-01T19:33:59.258666+0000","last_became_peered":"2024-04-01T19:33:59.258666+0000","last_unstale":"2024-04-01T19:35:07.429339+0000","last_undegraded":"2024-04-01T19:35:07.429339+0000","last_fullsized":"2024-04-01T19:35:07.429339+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":8631,"log_dups_size":0,"ondisk_log_size":8631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:35:26.861748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565641216,"num_objects":8631,"num_object_clones":0,"num_object_copies":17262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8631,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8631,"num_write_kb":552384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":791,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-04-01T19:35:04.013627+0000","last_change":"2024-04-01T19:34:42.619046+0000","last_active":"2024-04-01T19:35:04.013627+0000","last_peered":"2024-04-01T19:35:04.013627+0000","last_clean":"2024-04-01T19:35:04.013627+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:35:04.013627+0000","last_undegraded":"2024-04-01T19:35:04.013627+0000","last_fullsized":"2024-04-01T19:35:04.013627+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:34:42.618917+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:34:42.618917+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:36:01.762149+0000","scrub_duration":73,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":9183035392,"num_objects":140122,"num_object_clones":0,"num_object_copies":280244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":140122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140122,"num_write_kb":8967808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18336841728,"data_stored":18336841728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140122,"ondisk_log_size":140122,"up":32,"acting":32,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220311,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2620024,"kb_used_data":2282032,"kb_used_omap":1,"kb_used_meta":337982,"kb_avail":91125128,"statfs":{"total":95995035648,"available":93312131072,"internally_reserved":0,"allocated":2336800768,"data_stored":2336284613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":346094020},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":77,"seq":330712481946,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1740848,"kb_used_data":1637480,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":92004304,"statfs":{"total":95995035648,"available":94212407296,"internally_reserved":0,"allocated":1676779520,"data_stored":1676266917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":105839040},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678177,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1930160,"kb_used_data":1686568,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":91814992,"statfs":{"total":95995035648,"available":94018551808,"internally_reserved":0,"allocated":1727045632,"data_stored":1726533049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":249428416},"hb_peers":[1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":74740,"kb_used_data":1000,"kb_used_omap":132,"kb_used_meta":73595,"kb_avail":93670412,"statfs":{"total":95995035648,"available":95918501888,"internally_reserved":0,"allocated":1024000,"data_stored":511417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":75362023},"hb_peers":[0,1,2,3,4,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234155,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1935992,"kb_used_data":1652144,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":91809160,"statfs":{"total":95995035648,"available":94012579840,"internally_reserved":0,"allocated":1691795456,"data_stored":1691279321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":290650570},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528496,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1208944,"kb_used_data":1101416,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":92536208,"statfs":{"total":95995035648,"available":94757076992,"internally_reserved":0,"allocated":1127849984,"data_stored":1127337401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110098886},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575049,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":4264304,"kb_used_data":3954088,"kb_used_omap":1,"kb_used_meta":310206,"kb_avail":89480848,"statfs":{"total":95995035648,"available":91628388352,"internally_reserved":0,"allocated":4048986112,"data_stored":4048473529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":317651397},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,2,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738576,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":817584,"kb_used_data":565672,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":92927568,"statfs":{"total":95995035648,"available":95157829632,"internally_reserved":0,"allocated":579248128,"data_stored":578735545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346117,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":637232,"kb_used_data":543592,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":93107920,"statfs":{"total":95995035648,"available":95342510080,"internally_reserved":0,"allocated":556638208,"data_stored":556125625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,1,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149886,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1960624,"kb_used_data":1650408,"kb_used_omap":1,"kb_used_meta":310206,"kb_avail":91784528,"statfs":{"total":95995035648,"available":93987356672,"internally_reserved":0,"allocated":1690017792,"data_stored":1689505209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":317651399},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953657,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1938032,"kb_used_data":1627816,"kb_used_omap":1,"kb_used_meta":310206,"kb_avail":91807120,"statfs":{"total":95995035648,"available":94010490880,"internally_reserved":0,"allocated":1666883584,"data_stored":1666371001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":317651397},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790134,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1320752,"kb_used_data":1136872,"kb_used_omap":1,"kb_used_meta":183870,"kb_avail":92424400,"statfs":{"total":95995035648,"available":94642585600,"internally_reserved":0,"allocated":1164156928,"data_stored":1163644345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188283333},"hb_peers":[0,1,2,3,4,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":578551808,"data_stored":578551808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4053401600,"data_stored":4053401600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":559153152,"data_stored":559153152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1704329216,"data_stored":1704329216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1673003008,"data_stored":1673003008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1172897792,"data_stored":1172897792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1135280128,"data_stored":1135280128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1699020800,"data_stored":1699020800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":1732182016,"data_stored":1732182016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":1690042368,"data_stored":1690042368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":2338979840,"data_stored":2338979840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:35:13.005 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:35:13.089 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:35:13.122 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:13.151 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:35:13.157 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:13.158 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:35:13.220 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:35:13.258 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:35:13.292 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:13.320 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:35:13.323 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:13 smithi062 ceph-mon[44211]: from='client.25537 v1:172.21.15.22:0/2833383916' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:35:13.324 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:13.325 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:35:13.328 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:13 smithi022 ceph-mon[39439]: from='client.25537 v1:172.21.15.22:0/2833383916' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:35:13.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:13 smithi188 ceph-mon[43939]: from='client.25537 v1:172.21.15.22:0/2833383916' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:35:13.425 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:35:13.465 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:13.492 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:35:13.497 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:13.497 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:35:13.582 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 68 16 146538 146522 134.634 83.6875 0.018031 0.00742621 2024-04-01T19:35:13.599 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:35:13.629 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:13.656 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:35:13.659 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:13.659 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:35:13.760 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:35:13.763 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:35:13.805 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_ops_in_flight 2024-04-01T19:35:13.865 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:13.960 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:35:13.970 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:13.970 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:35:14.049 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:14 smithi022 ceph-mon[39439]: pgmap v843: 17 pgs: 17 active+clean; 8.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 86 MiB/s wr, 1.38k op/s 2024-04-01T19:35:14.071 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:35:14.191 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:14.225 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:35:14.228 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:14.228 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:35:14.329 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:35:14.360 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:14 smithi062 ceph-mon[44211]: pgmap v843: 17 pgs: 17 active+clean; 8.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 86 MiB/s wr, 1.38k op/s 2024-04-01T19:35:14.365 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:14.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:14 smithi188 ceph-mon[43939]: pgmap v843: 17 pgs: 17 active+clean; 8.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 86 MiB/s wr, 1.38k op/s 2024-04-01T19:35:14.395 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:35:14.398 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:14.398 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:35:14.500 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:35:14.540 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:14.570 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:35:14.576 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:14.576 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:35:14.582 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 69 16 147743 147727 133.775 75.3125 0.00511462 0.00747382 2024-04-01T19:35:14.677 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:35:14.705 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:14.728 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:35:14.733 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:14.733 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:35:14.752 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:35:14.834 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:35:14.865 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:14.902 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:35:14.908 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:14.908 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:35:15.009 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:35:15.063 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:15.306 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:35:15.307 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:35:15.322 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:35:15.332 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:15.333 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:35:15.434 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:35:15.467 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:15.498 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:35:15.501 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:15.502 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:35:15.582 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 70 16 149016 149000 133 79.5625 0.00824634 0.00751619 2024-04-01T19:35:15.603 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:35:15.640 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:15.666 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:35:15.671 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:15.672 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:35:15.773 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:35:15.804 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:15.826 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:35:15.829 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:15.829 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:35:15.930 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:35:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:16.007 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:35:16.014 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:16.015 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:35:16.115 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:35:16.157 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:16.184 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:35:16.190 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:16.190 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:35:16.291 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:35:16.318 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:16 smithi188 ceph-mon[43939]: pgmap v844: 17 pgs: 17 active+clean; 8.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 MiB/s wr, 1.45k op/s 2024-04-01T19:35:16.320 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:16.352 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:35:16.356 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:16.356 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:35:16.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:16 smithi022 ceph-mon[39439]: pgmap v844: 17 pgs: 17 active+clean; 8.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 MiB/s wr, 1.45k op/s 2024-04-01T19:35:16.457 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:35:16.492 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:16.492 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:16 smithi062 ceph-mon[44211]: pgmap v844: 17 pgs: 17 active+clean; 8.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 MiB/s wr, 1.45k op/s 2024-04-01T19:35:16.525 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:35:16.532 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:16.532 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:35:16.582 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 71 16 150299 150283 132.257 80.1875 0.0143031 0.00755979 2024-04-01T19:35:16.633 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:35:16.666 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:16.691 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:35:16.694 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:16.694 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:35:16.795 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:35:16.830 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:16.854 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:35:16.856 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:16.856 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:35:16.957 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:35:16.998 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:17.022 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:35:17.024 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:17.024 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:35:17.066 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:17 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1263037406' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:35:17.083 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:35:17.125 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:35:17.157 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:17.178 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:35:17.182 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:17.182 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:35:17.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:17 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1263037406' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:35:17.283 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:35:17.319 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:17.350 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:35:17.352 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:17.353 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:35:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:17 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1263037406' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:35:17.453 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:35:17.493 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:17.521 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:35:17.526 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:17.527 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:35:17.582 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 72 16 151583 151567 131.534 80.25 0.00552802 0.00760125 2024-04-01T19:35:17.628 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:35:17.674 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:18.066 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:18 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:35:18.066 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:18 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:35:18.067 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:18 smithi022 ceph-mon[39439]: pgmap v845: 17 pgs: 17 active+clean; 9.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s wr, 1.41k op/s 2024-04-01T19:35:18.067 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:18 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:35:18.067 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:18 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1263037406' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:35:18.067 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:18 smithi022 ceph-mon[39439]: osdmap e293: 12 total, 12 up, 12 in 2024-04-01T19:35:18.067 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:18 smithi022 ceph-mon[39439]: 4.1 scrub starts 2024-04-01T19:35:18.154 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:35:18.159 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:18.160 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:35:18.260 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:35:18.298 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:18.327 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:35:18.331 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:18 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:35:18.331 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:18 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:35:18.331 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:18 smithi062 ceph-mon[44211]: pgmap v845: 17 pgs: 17 active+clean; 9.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s wr, 1.41k op/s 2024-04-01T19:35:18.331 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:18 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:35:18.332 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:18 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1263037406' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:35:18.332 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:18 smithi062 ceph-mon[44211]: osdmap e293: 12 total, 12 up, 12 in 2024-04-01T19:35:18.332 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:18 smithi062 ceph-mon[44211]: 4.1 scrub starts 2024-04-01T19:35:18.332 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:18.333 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:35:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:18 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:35:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:18 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:35:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:18 smithi188 ceph-mon[43939]: pgmap v845: 17 pgs: 17 active+clean; 9.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s wr, 1.41k op/s 2024-04-01T19:35:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:18 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:35:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:18 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1263037406' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:35:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:18 smithi188 ceph-mon[43939]: osdmap e293: 12 total, 12 up, 12 in 2024-04-01T19:35:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:18 smithi188 ceph-mon[43939]: 4.1 scrub starts 2024-04-01T19:35:18.434 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:35:18.484 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:18.511 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:35:18.514 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:18.514 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:35:18.582 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 73 16 152864 152848 130.829 80.0625 0.0166806 0.00764216 2024-04-01T19:35:18.615 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:35:18.649 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:18.675 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:35:18.683 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:18.683 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:35:18.785 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:35:18.833 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:19.083 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:19 smithi022 ceph-mon[39439]: 4.0 scrub starts 2024-04-01T19:35:19.122 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:35:19.126 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:19.126 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:35:19.227 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:35:19.275 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:19.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:19 smithi188 ceph-mon[43939]: 4.0 scrub starts 2024-04-01T19:35:19.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:19 smithi062 ceph-mon[44211]: 4.0 scrub starts 2024-04-01T19:35:19.533 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:35:19.542 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:19.543 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:35:19.583 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 74 16 153992 153976 130.014 70.5 0.00552053 0.00768998 2024-04-01T19:35:19.643 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:35:19.687 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:19.723 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:35:19.732 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:19.733 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:35:19.834 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:35:19.868 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:19.897 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:35:19.900 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:19.901 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:35:20.002 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:35:20.047 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:20.079 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:35:20.084 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:20.084 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:35:20.185 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:35:20.206 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:20 smithi022 ceph-mon[39439]: 4.e scrub starts 2024-04-01T19:35:20.206 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:20 smithi022 ceph-mon[39439]: pgmap v847: 17 pgs: 17 active+clean; 9.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 83 MiB/s wr, 1.33k op/s 2024-04-01T19:35:20.206 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:20 smithi022 ceph-mon[39439]: 4.2 scrub starts 2024-04-01T19:35:20.206 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:20 smithi022 ceph-mon[39439]: 4.8 scrub starts 2024-04-01T19:35:20.206 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:20 smithi022 ceph-mon[39439]: 4.1 scrub ok 2024-04-01T19:35:20.227 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:20.251 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:35:20.255 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:20.256 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:35:20.357 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:35:20.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:20 smithi188 ceph-mon[43939]: 4.e scrub starts 2024-04-01T19:35:20.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:20 smithi188 ceph-mon[43939]: pgmap v847: 17 pgs: 17 active+clean; 9.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 83 MiB/s wr, 1.33k op/s 2024-04-01T19:35:20.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:20 smithi188 ceph-mon[43939]: 4.2 scrub starts 2024-04-01T19:35:20.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:20 smithi188 ceph-mon[43939]: 4.8 scrub starts 2024-04-01T19:35:20.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:20 smithi188 ceph-mon[43939]: 4.1 scrub ok 2024-04-01T19:35:20.412 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:20.440 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:35:20.445 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:20.446 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:35:20.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:20 smithi062 ceph-mon[44211]: 4.e scrub starts 2024-04-01T19:35:20.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:20 smithi062 ceph-mon[44211]: pgmap v847: 17 pgs: 17 active+clean; 9.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 83 MiB/s wr, 1.33k op/s 2024-04-01T19:35:20.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:20 smithi062 ceph-mon[44211]: 4.2 scrub starts 2024-04-01T19:35:20.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:20 smithi062 ceph-mon[44211]: 4.8 scrub starts 2024-04-01T19:35:20.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:20 smithi062 ceph-mon[44211]: 4.1 scrub ok 2024-04-01T19:35:20.546 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:35:20.583 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 75 16 155014 154998 129.132 63.875 0.0133682 0.00774245 2024-04-01T19:35:20.588 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:20.613 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:35:20.619 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:20.620 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:35:20.703 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:35:20.720 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:35:20.759 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:20.789 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:35:20.794 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:20.794 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:35:20.818 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:35:20.864 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:35:20.895 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:35:20.903 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:35:20.929 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:20.936 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:35:20.952 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:35:20.955 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:20.956 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:35:20.975 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:35:21.004 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:35:21.042 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:35:21.056 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:35:21.072 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:35:21.086 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:21.108 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:21 smithi188 ceph-mon[43939]: 4.0 scrub ok 2024-04-01T19:35:21.108 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:21 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/243828814' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:35:21.108 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:21.108 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:21.109 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:21.109 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:35:21.114 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:21.114 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:35:21.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:21 smithi022 ceph-mon[39439]: 4.0 scrub ok 2024-04-01T19:35:21.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:21 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/243828814' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:35:21.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:21.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:21.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:21.117 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:35:21.143 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:35:21.198 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:35:21.215 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:35:21.244 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:21 smithi062 ceph-mon[44211]: 4.0 scrub ok 2024-04-01T19:35:21.244 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:21 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/243828814' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:35:21.244 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:21.244 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:21.245 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:21.246 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:21.247 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:35:21.256 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:35:21.257 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:35:21.268 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:35:21.269 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:35:21.269 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:35:21.269 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:35:21.269 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:35:21.269 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:35:21.270 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:35:21.270 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:35:21.270 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:35:21.270 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:35:21.270 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:35:21.270 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:35:21.270 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:35:21.273 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:21.273 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:35:21.374 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:35:21.410 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:21.434 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:35:21.437 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:21.438 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:35:21.539 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:35:21.570 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:21.583 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 76 16 156035 156019 128.273 63.8125 0.0203798 0.00779411 2024-04-01T19:35:21.594 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:35:21.597 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:21.598 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:35:21.699 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:35:21.710 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:35:21.711 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:35:21.746 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:21.879 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:35:21.882 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:21.883 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:35:21.984 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:35:22.020 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:22.059 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:35:22.064 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:22.065 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:35:22.166 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:35:22.202 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:22.232 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:35:22.239 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:22.239 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:35:22.340 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:35:22.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:22 smithi022 ceph-mon[39439]: 4.e scrub ok 2024-04-01T19:35:22.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:22 smithi022 ceph-mon[39439]: pgmap v848: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 80 MiB/s wr, 1.29k op/s 2024-04-01T19:35:22.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:22 smithi022 ceph-mon[39439]: 4.2 scrub ok 2024-04-01T19:35:22.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:22 smithi022 ceph-mon[39439]: 4.8 scrub ok 2024-04-01T19:35:22.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:22 smithi022 ceph-mon[39439]: from='client.35591 v1:172.21.15.22:0/783245123' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:35:22.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:22 smithi022 ceph-mon[39439]: 4.3 scrub starts 2024-04-01T19:35:22.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:22 smithi188 ceph-mon[43939]: 4.e scrub ok 2024-04-01T19:35:22.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:22 smithi188 ceph-mon[43939]: pgmap v848: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 80 MiB/s wr, 1.29k op/s 2024-04-01T19:35:22.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:22 smithi188 ceph-mon[43939]: 4.2 scrub ok 2024-04-01T19:35:22.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:22 smithi188 ceph-mon[43939]: 4.8 scrub ok 2024-04-01T19:35:22.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:22 smithi188 ceph-mon[43939]: from='client.35591 v1:172.21.15.22:0/783245123' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:35:22.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:22 smithi188 ceph-mon[43939]: 4.3 scrub starts 2024-04-01T19:35:22.380 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:22.405 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:35:22.408 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:22.408 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:35:22.509 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:35:22.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:22 smithi062 ceph-mon[44211]: 4.e scrub ok 2024-04-01T19:35:22.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:22 smithi062 ceph-mon[44211]: pgmap v848: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 80 MiB/s wr, 1.29k op/s 2024-04-01T19:35:22.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:22 smithi062 ceph-mon[44211]: 4.2 scrub ok 2024-04-01T19:35:22.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:22 smithi062 ceph-mon[44211]: 4.8 scrub ok 2024-04-01T19:35:22.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:22 smithi062 ceph-mon[44211]: from='client.35591 v1:172.21.15.22:0/783245123' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:35:22.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:22.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:22 smithi062 ceph-mon[44211]: 4.3 scrub starts 2024-04-01T19:35:22.542 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_blocked_ops 2024-04-01T19:35:22.568 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:22.583 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 77 16 157158 157142 127.519 70.1875 0.00930555 0.00784059 2024-04-01T19:35:23.031 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:35:23.047 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:23.047 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:35:23.148 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:35:23.181 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:23.205 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:35:23.209 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:23.209 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:35:23.310 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:35:23.347 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:23.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:23 smithi022 ceph-mon[39439]: 4.7 scrub starts 2024-04-01T19:35:23.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:23 smithi022 ceph-mon[39439]: 4.c scrub starts 2024-04-01T19:35:23.381 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:35:23.387 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:23 smithi062 ceph-mon[44211]: 4.7 scrub starts 2024-04-01T19:35:23.387 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:23 smithi062 ceph-mon[44211]: 4.c scrub starts 2024-04-01T19:35:23.388 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:23.388 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:35:23.489 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:35:23.533 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:23.583 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 78 16 158271 158255 126.776 69.5625 0.0173158 0.00788669 2024-04-01T19:35:23.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:23 smithi188 ceph-mon[43939]: 4.7 scrub starts 2024-04-01T19:35:23.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:23 smithi188 ceph-mon[43939]: 4.c scrub starts 2024-04-01T19:35:23.798 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:35:23.810 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:23.811 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:35:23.849 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":848,"stamp":"2024-04-01T19:35:20.891671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":10027926048,"num_objects":153007,"num_object_clones":0,"num_object_copies":306014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":153007,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":153186,"num_write_kb":9795258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153144,"ondisk_log_size":153144,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":11,"kb":1124941824,"kb_used":22143976,"kb_used_data":19509848,"kb_used_omap":149,"kb_used_meta":2633514,"kb_avail":1102797848,"statfs":{"total":1151940427776,"available":1129264996352,"internally_reserved":0,"allocated":19978084352,"data_stored":19972520596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":152997,"internal_metadata":2696718939},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,1,9,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":844300288,"num_objects":12883,"num_object_clones":0,"num_object_copies":25766,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12883,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12883,"num_write_kb":824512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.007201"},"pg_stats":[{"pgid":"4.f","version":"293'9631","reported_seq":9689,"reported_epoch":293,"state":"active+clean","last_fresh":"2024-04-01T19:35:19.350636+0000","last_change":"2024-04-01T19:33:59.106417+0000","last_active":"2024-04-01T19:35:19.350636+0000","last_peered":"2024-04-01T19:35:19.350636+0000","last_clean":"2024-04-01T19:35:19.350636+0000","last_became_active":"2024-04-01T19:33:59.106174+0000","last_became_peered":"2024-04-01T19:33:59.106174+0000","last_unstale":"2024-04-01T19:35:19.350636+0000","last_undegraded":"2024-04-01T19:35:19.350636+0000","last_fullsized":"2024-04-01T19:35:19.350636+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":9631,"log_dups_size":0,"ondisk_log_size":9631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:35:21.271263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631177216,"num_objects":9631,"num_object_clones":0,"num_object_copies":19262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9631,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9631,"num_write_kb":616384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"292'9370","reported_seq":9428,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-04-01T19:35:16.356996+0000","last_change":"2024-04-01T19:33:59.258882+0000","last_active":"2024-04-01T19:35:16.356996+0000","last_peered":"2024-04-01T19:35:16.356996+0000","last_clean":"2024-04-01T19:35:16.356996+0000","last_became_active":"2024-04-01T19:33:59.258540+0000","last_became_peered":"2024-04-01T19:33:59.258540+0000","last_unstale":"2024-04-01T19:35:16.356996+0000","last_undegraded":"2024-04-01T19:35:16.356996+0000","last_fullsized":"2024-04-01T19:35:16.356996+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":9370,"log_dups_size":0,"ondisk_log_size":9370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:35:16.867719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":614072320,"num_objects":9370,"num_object_clones":0,"num_object_copies":18740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9370,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9370,"num_write_kb":599680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.d","version":"292'9345","reported_seq":9401,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-04-01T19:35:16.357890+0000","last_change":"2024-04-01T19:33:59.105554+0000","last_active":"2024-04-01T19:35:16.357890+0000","last_peered":"2024-04-01T19:35:16.357890+0000","last_clean":"2024-04-01T19:35:16.357890+0000","last_became_active":"2024-04-01T19:33:59.105279+0000","last_became_peered":"2024-04-01T19:33:59.105279+0000","last_unstale":"2024-04-01T19:35:16.357890+0000","last_undegraded":"2024-04-01T19:35:16.357890+0000","last_fullsized":"2024-04-01T19:35:16.357890+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":9345,"log_dups_size":0,"ondisk_log_size":9345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:35:24.554461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":612433920,"num_objects":9345,"num_object_clones":0,"num_object_copies":18690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9345,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9345,"num_write_kb":598080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.c","version":"292'9385","reported_seq":9443,"reported_epoch":292,"state":"active+clean","last_fresh":"2024-04-01T19:35:16.350178+0000","last_change":"2024-04-01T19:33:59.105349+0000","last_active":"2024-04-01T19:35:16.350178+0000","last_peered":"2024-04-01T19:35:16.350178+0000","last_clean":"2024-04-01T19:35:16.350178+0000","last_became_active":"2024-04-01T19:33:59.105051+0000","last_became_peered":"2024-04-01T19:33:59.105051+0000","last_unstale":"2024-04-01T19:35:16.350178+0000","last_undegraded":"2024-04-01T19:35:16.350178+0000","last_fullsized":"2024-04-01T19:35:16.350178+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":9385,"log_dups_size":0,"ondisk_log_size":9385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:35:20.896750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":615055360,"num_objects":9385,"num_object_clones":0,"num_object_copies":18770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9385,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9385,"num_write_kb":600640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.b","version":"293'9650","reported_seq":9711,"reported_epoch":293,"state":"active+clean","last_fresh":"2024-04-01T19:35:20.202474+0000","last_change":"2024-04-01T19:33:59.106009+0000","last_active":"2024-04-01T19:35:20.202474+0000","last_peered":"2024-04-01T19:35:20.202474+0000","last_clean":"2024-04-01T19:35:20.202474+0000","last_became_active":"2024-04-01T19:33:59.105705+0000","last_became_peered":"2024-04-01T19:33:59.105705+0000","last_unstale":"2024-04-01T19:35:20.202474+0000","last_undegraded":"2024-04-01T19:35:20.202474+0000","last_fullsized":"2024-04-01T19:35:20.202474+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":9650,"log_dups_size":0,"ondisk_log_size":9650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:35:25.201752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":632422400,"num_objects":9650,"num_object_clones":0,"num_object_copies":19300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9650,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9650,"num_write_kb":617600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"293'9516","reported_seq":9577,"reported_epoch":293,"state":"active+clean","last_fresh":"2024-04-01T19:35:17.442859+0000","last_change":"2024-04-01T19:33:59.106217+0000","last_active":"2024-04-01T19:35:17.442859+0000","last_peered":"2024-04-01T19:35:17.442859+0000","last_clean":"2024-04-01T19:35:17.442859+0000","last_became_active":"2024-04-01T19:33:59.105994+0000","last_became_peered":"2024-04-01T19:33:59.105994+0000","last_unstale":"2024-04-01T19:35:17.442859+0000","last_undegraded":"2024-04-01T19:35:17.442859+0000","last_fullsized":"2024-04-01T19:35:17.442859+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":9516,"log_dups_size":0,"ondisk_log_size":9516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:35:18.729735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":623640576,"num_objects":9516,"num_object_clones":0,"num_object_copies":19032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9516,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9516,"num_write_kb":609024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"293'9878","reported_seq":9939,"reported_epoch":293,"state":"active+clean","last_fresh":"2024-04-01T19:35:20.412446+0000","last_change":"2024-04-01T19:33:59.106743+0000","last_active":"2024-04-01T19:35:20.412446+0000","last_peered":"2024-04-01T19:35:20.412446+0000","last_clean":"2024-04-01T19:35:20.412446+0000","last_became_active":"2024-04-01T19:33:59.106492+0000","last_became_peered":"2024-04-01T19:33:59.106492+0000","last_unstale":"2024-04-01T19:35:20.412446+0000","last_undegraded":"2024-04-01T19:35:20.412446+0000","last_fullsized":"2024-04-01T19:35:20.412446+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":9878,"log_dups_size":0,"ondisk_log_size":9878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:35:21.415013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":647364608,"num_objects":9878,"num_object_clones":0,"num_object_copies":19756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9878,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9878,"num_write_kb":632192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.8","version":"293'9679","reported_seq":9798,"reported_epoch":293,"state":"active+clean+scrubbing","last_fresh":"2024-04-01T19:35:20.543855+0000","last_change":"2024-04-01T19:35:19.427104+0000","last_active":"2024-04-01T19:35:20.543855+0000","last_peered":"2024-04-01T19:35:20.543855+0000","last_clean":"2024-04-01T19:35:20.543855+0000","last_became_active":"2024-04-01T19:33:59.258615+0000","last_became_peered":"2024-04-01T19:33:59.258615+0000","last_unstale":"2024-04-01T19:35:20.543855+0000","last_undegraded":"2024-04-01T19:35:20.543855+0000","last_fullsized":"2024-04-01T19:35:20.543855+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":5449,"log_size":9679,"log_dups_size":0,"ondisk_log_size":9679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":634322944,"num_objects":9679,"num_object_clones":0,"num_object_copies":19358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9679,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9679,"num_write_kb":619456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.7","version":"293'9614","reported_seq":9675,"reported_epoch":293,"state":"active+clean","last_fresh":"2024-04-01T19:35:19.307273+0000","last_change":"2024-04-01T19:33:59.258981+0000","last_active":"2024-04-01T19:35:19.307273+0000","last_peered":"2024-04-01T19:35:19.307273+0000","last_clean":"2024-04-01T19:35:19.307273+0000","last_became_active":"2024-04-01T19:33:59.258696+0000","last_became_peered":"2024-04-01T19:33:59.258696+0000","last_unstale":"2024-04-01T19:35:19.307273+0000","last_undegraded":"2024-04-01T19:35:19.307273+0000","last_fullsized":"2024-04-01T19:35:19.307273+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":9614,"log_dups_size":0,"ondisk_log_size":9614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:35:21.271118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630063104,"num_objects":9614,"num_object_clones":0,"num_object_copies":19228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9614,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9614,"num_write_kb":615296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"293'9556","reported_seq":9617,"reported_epoch":293,"state":"active+clean","last_fresh":"2024-04-01T19:35:19.791442+0000","last_change":"2024-04-01T19:33:59.105934+0000","last_active":"2024-04-01T19:35:19.791442+0000","last_peered":"2024-04-01T19:35:19.791442+0000","last_clean":"2024-04-01T19:35:19.791442+0000","last_became_active":"2024-04-01T19:33:59.105657+0000","last_became_peered":"2024-04-01T19:33:59.105657+0000","last_unstale":"2024-04-01T19:35:19.791442+0000","last_undegraded":"2024-04-01T19:35:19.791442+0000","last_fullsized":"2024-04-01T19:35:19.791442+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":9556,"log_dups_size":0,"ondisk_log_size":9556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:35:23.034515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":626262016,"num_objects":9556,"num_object_clones":0,"num_object_copies":19112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9556,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9556,"num_write_kb":611584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.4","version":"293'9617","reported_seq":9678,"reported_epoch":293,"state":"active+clean","last_fresh":"2024-04-01T19:35:19.186895+0000","last_change":"2024-04-01T19:33:59.257923+0000","last_active":"2024-04-01T19:35:19.186895+0000","last_peered":"2024-04-01T19:35:19.186895+0000","last_clean":"2024-04-01T19:35:19.186895+0000","last_became_active":"2024-04-01T19:33:59.257653+0000","last_became_peered":"2024-04-01T19:33:59.257653+0000","last_unstale":"2024-04-01T19:35:19.186895+0000","last_undegraded":"2024-04-01T19:35:19.186895+0000","last_fullsized":"2024-04-01T19:35:19.186895+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":9617,"log_dups_size":0,"ondisk_log_size":9617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:35:21.271159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630259712,"num_objects":9617,"num_object_clones":0,"num_object_copies":19234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9617,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9617,"num_write_kb":615488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"293'9602","reported_seq":9663,"reported_epoch":293,"state":"active+clean","last_fresh":"2024-04-01T19:35:20.549027+0000","last_change":"2024-04-01T19:33:59.258465+0000","last_active":"2024-04-01T19:35:20.549027+0000","last_peered":"2024-04-01T19:35:20.549027+0000","last_clean":"2024-04-01T19:35:20.549027+0000","last_became_active":"2024-04-01T19:33:59.258172+0000","last_became_peered":"2024-04-01T19:33:59.258172+0000","last_unstale":"2024-04-01T19:35:20.549027+0000","last_undegraded":"2024-04-01T19:35:20.549027+0000","last_fullsized":"2024-04-01T19:35:20.549027+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":9602,"log_dups_size":0,"ondisk_log_size":9602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629276672,"num_objects":9602,"num_object_clones":0,"num_object_copies":19204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9602,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9602,"num_write_kb":614528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"293'9633","reported_seq":9728,"reported_epoch":293,"state":"active+clean+scrubbing","last_fresh":"2024-04-01T19:35:19.812456+0000","last_change":"2024-04-01T19:35:19.233056+0000","last_active":"2024-04-01T19:35:19.812456+0000","last_peered":"2024-04-01T19:35:19.812456+0000","last_clean":"2024-04-01T19:35:19.812456+0000","last_became_active":"2024-04-01T19:33:59.102135+0000","last_became_peered":"2024-04-01T19:33:59.102135+0000","last_unstale":"2024-04-01T19:35:19.812456+0000","last_undegraded":"2024-04-01T19:35:19.812456+0000","last_fullsized":"2024-04-01T19:35:19.812456+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":3299,"log_size":9633,"log_dups_size":0,"ondisk_log_size":9633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631308288,"num_objects":9633,"num_object_clones":0,"num_object_copies":19266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9633,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9633,"num_write_kb":616512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5],"acting":[9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1","version":"293'9721","reported_seq":9886,"reported_epoch":293,"state":"active+clean","last_fresh":"2024-04-01T19:35:20.520862+0000","last_change":"2024-04-01T19:35:19.560634+0000","last_active":"2024-04-01T19:35:20.520862+0000","last_peered":"2024-04-01T19:35:20.520862+0000","last_clean":"2024-04-01T19:35:20.520862+0000","last_became_active":"2024-04-01T19:33:59.105816+0000","last_became_peered":"2024-04-01T19:33:59.105816+0000","last_unstale":"2024-04-01T19:35:20.520862+0000","last_undegraded":"2024-04-01T19:35:20.520862+0000","last_fullsized":"2024-04-01T19:35:20.520862+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"293'9655","last_scrub_stamp":"2024-04-01T19:35:19.560476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:35:19.560476+0000","objects_scrubbed":9563,"log_size":9721,"log_dups_size":0,"ondisk_log_size":9721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:36:34.450988+0000","scrub_duration":2161,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":637075456,"num_objects":9721,"num_object_clones":0,"num_object_copies":19442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9721,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9721,"num_write_kb":622144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.0","version":"293'9412","reported_seq":9473,"reported_epoch":293,"state":"active+clean","last_fresh":"2024-04-01T19:35:17.461392+0000","last_change":"2024-04-01T19:33:59.258783+0000","last_active":"2024-04-01T19:35:17.461392+0000","last_peered":"2024-04-01T19:35:17.461392+0000","last_clean":"2024-04-01T19:35:17.461392+0000","last_became_active":"2024-04-01T19:33:59.258519+0000","last_became_peered":"2024-04-01T19:33:59.258519+0000","last_unstale":"2024-04-01T19:35:17.461392+0000","last_undegraded":"2024-04-01T19:35:17.461392+0000","last_fullsized":"2024-04-01T19:35:17.461392+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":9412,"log_dups_size":0,"ondisk_log_size":9412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":616824832,"num_objects":9412,"num_object_clones":0,"num_object_copies":18824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9412,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9412,"num_write_kb":602368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"293'9396","reported_seq":9457,"reported_epoch":293,"state":"active+clean","last_fresh":"2024-04-01T19:35:17.427605+0000","last_change":"2024-04-01T19:33:59.258963+0000","last_active":"2024-04-01T19:35:17.427605+0000","last_peered":"2024-04-01T19:35:17.427605+0000","last_clean":"2024-04-01T19:35:17.427605+0000","last_became_active":"2024-04-01T19:33:59.258666+0000","last_became_peered":"2024-04-01T19:33:59.258666+0000","last_unstale":"2024-04-01T19:35:17.427605+0000","last_undegraded":"2024-04-01T19:35:17.427605+0000","last_fullsized":"2024-04-01T19:35:17.427605+0000","mapping_epoch":267,"log_start":"0'0","ondisk_log_start":"0'0","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:33:58.088058+0000","objects_scrubbed":0,"log_size":9396,"log_dups_size":0,"ondisk_log_size":9396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:35:26.861748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":615776256,"num_objects":9396,"num_object_clones":0,"num_object_copies":18792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9396,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9396,"num_write_kb":601344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":793,"reported_epoch":293,"state":"active+clean","last_fresh":"2024-04-01T19:35:17.085178+0000","last_change":"2024-04-01T19:34:42.619046+0000","last_active":"2024-04-01T19:35:17.085178+0000","last_peered":"2024-04-01T19:35:17.085178+0000","last_clean":"2024-04-01T19:35:17.085178+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:35:17.085178+0000","last_undegraded":"2024-04-01T19:35:17.085178+0000","last_fullsized":"2024-04-01T19:35:17.085178+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:34:42.618917+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:34:42.618917+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:36:01.762149+0000","scrub_duration":73,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":10027335680,"num_objects":153005,"num_object_clones":0,"num_object_copies":306010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":153005,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153005,"num_write_kb":9792320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20032651264,"data_stored":20032651264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153005,"ondisk_log_size":153005,"up":32,"acting":32,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220313,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2840400,"kb_used_data":2488520,"kb_used_omap":1,"kb_used_meta":351870,"kb_avail":90904752,"statfs":{"total":95995035648,"available":93086466048,"internally_reserved":0,"allocated":2548244480,"data_stored":2547813237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":360315332},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":77,"seq":330712481948,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1908336,"kb_used_data":1796648,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":91836816,"statfs":{"total":95995035648,"available":94040899584,"internally_reserved":0,"allocated":1839767552,"data_stored":1839254949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":114358720},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678179,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2088776,"kb_used_data":1836864,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":91656376,"statfs":{"total":95995035648,"available":93856129024,"internally_reserved":0,"allocated":1880948736,"data_stored":1880521065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":257948096},"hb_peers":[1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557376,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":74752,"kb_used_data":832,"kb_used_omap":132,"kb_used_meta":73595,"kb_avail":93670400,"statfs":{"total":95995035648,"available":95918489600,"internally_reserved":0,"allocated":851968,"data_stored":424297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":75362023},"hb_peers":[0,1,2,3,4,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234157,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2104648,"kb_used_data":1812296,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":91640504,"statfs":{"total":95995035648,"available":93839876096,"internally_reserved":0,"allocated":1855791104,"data_stored":1855359881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":299170250},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528498,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1317360,"kb_used_data":1205672,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":92427792,"statfs":{"total":95995035648,"available":94646059008,"internally_reserved":0,"allocated":1234608128,"data_stored":1234095545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114358726},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575051,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":4645064,"kb_used_data":4316800,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":89100088,"statfs":{"total":95995035648,"available":91238490112,"internally_reserved":0,"allocated":4420403200,"data_stored":4419975529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738578,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":870088,"kb_used_data":618176,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":92875064,"statfs":{"total":95995035648,"available":95104065536,"internally_reserved":0,"allocated":633012224,"data_stored":632584553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346119,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":678704,"kb_used_data":597544,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":93066448,"statfs":{"total":95995035648,"available":95300042752,"internally_reserved":0,"allocated":611885056,"data_stored":611372473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149888,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2110256,"kb_used_data":1808360,"kb_used_omap":1,"kb_used_meta":301886,"kb_avail":91634896,"statfs":{"total":95995035648,"available":93834133504,"internally_reserved":0,"allocated":1851760640,"data_stored":1851248057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":309131719},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953659,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2093488,"kb_used_data":1791592,"kb_used_omap":1,"kb_used_meta":301886,"kb_avail":91651664,"statfs":{"total":95995035648,"available":93851303936,"internally_reserved":0,"allocated":1834590208,"data_stored":1834077625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":309131717},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790136,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1412104,"kb_used_data":1236544,"kb_used_omap":1,"kb_used_meta":175550,"kb_avail":92333048,"statfs":{"total":95995035648,"available":94549041152,"internally_reserved":0,"allocated":1266221056,"data_stored":1265793385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179763653},"hb_peers":[0,1,2,3,4,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":632422400,"data_stored":632422400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4422172672,"data_stored":4422172672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":614400000,"data_stored":614400000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1861025792,"data_stored":1861025792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1841627136,"data_stored":1841627136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1271660544,"data_stored":1271660544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1239547904,"data_stored":1239547904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1861812224,"data_stored":1861812224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":1887502336,"data_stored":1887502336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":1852178432,"data_stored":1852178432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":2548301824,"data_stored":2548301824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:35:23.850 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-01T19:35:23.895 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:35:23.899 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:35:23.912 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:35:23.944 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:23.972 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:35:23.976 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:23.976 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:35:24.076 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:35:24.111 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:24.141 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:35:24.144 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:24.145 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:35:24.246 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:35:24.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:24 smithi062 ceph-mon[44211]: pgmap v849: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 78 MiB/s wr, 1.25k op/s 2024-04-01T19:35:24.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:24 smithi062 ceph-mon[44211]: 4.3 scrub ok 2024-04-01T19:35:24.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:24 smithi062 ceph-mon[44211]: 4.9 scrub starts 2024-04-01T19:35:24.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:24 smithi062 ceph-mon[44211]: 4.c scrub ok 2024-04-01T19:35:24.278 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:24.301 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:35:24.304 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:24.304 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:35:24.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:24 smithi188 ceph-mon[43939]: pgmap v849: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 78 MiB/s wr, 1.25k op/s 2024-04-01T19:35:24.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:24 smithi188 ceph-mon[43939]: 4.3 scrub ok 2024-04-01T19:35:24.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:24 smithi188 ceph-mon[43939]: 4.9 scrub starts 2024-04-01T19:35:24.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:24 smithi188 ceph-mon[43939]: 4.c scrub ok 2024-04-01T19:35:24.405 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:35:24.453 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:24 smithi022 ceph-mon[39439]: pgmap v849: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 78 MiB/s wr, 1.25k op/s 2024-04-01T19:35:24.453 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:24 smithi022 ceph-mon[39439]: 4.3 scrub ok 2024-04-01T19:35:24.453 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:24 smithi022 ceph-mon[39439]: 4.9 scrub starts 2024-04-01T19:35:24.454 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:24 smithi022 ceph-mon[39439]: 4.c scrub ok 2024-04-01T19:35:24.459 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:24.583 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 79 16 159426 159410 126.085 72.1875 0.0216413 0.00792992 2024-04-01T19:35:25.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:25 smithi022 ceph-mon[39439]: 4.7 scrub ok 2024-04-01T19:35:25.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:25 smithi022 ceph-mon[39439]: 4.a scrub starts 2024-04-01T19:35:25.459 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:35:25.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:25 smithi062 ceph-mon[44211]: 4.7 scrub ok 2024-04-01T19:35:25.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:25 smithi062 ceph-mon[44211]: 4.a scrub starts 2024-04-01T19:35:25.583 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:35:25.586330 min lat: 0.00107168 max lat: 0.222141 avg lat: 0.00797417 2024-04-01T19:35:25.583 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:35:25.583 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 80 16 160543 160527 125.381 69.8125 0.0228515 0.00797417 2024-04-01T19:35:25.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:25 smithi188 ceph-mon[43939]: 4.7 scrub ok 2024-04-01T19:35:25.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:25 smithi188 ceph-mon[43939]: 4.a scrub starts 2024-04-01T19:35:26.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:26 smithi022 ceph-mon[39439]: 4.4 scrub starts 2024-04-01T19:35:26.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:26 smithi022 ceph-mon[39439]: pgmap v850: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s wr, 1.22k op/s 2024-04-01T19:35:26.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:26 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:35:26.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:26 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:35:26.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:26 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:35:26.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:26 smithi062 ceph-mon[44211]: 4.4 scrub starts 2024-04-01T19:35:26.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:26 smithi062 ceph-mon[44211]: pgmap v850: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s wr, 1.22k op/s 2024-04-01T19:35:26.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:26 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:35:26.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:26 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:35:26.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:26 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:35:26.583 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 81 16 161569 161553 124.625 64.125 0.00727632 0.00802226 2024-04-01T19:35:26.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:26 smithi188 ceph-mon[43939]: 4.4 scrub starts 2024-04-01T19:35:26.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:26 smithi188 ceph-mon[43939]: pgmap v850: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s wr, 1.22k op/s 2024-04-01T19:35:26.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:26 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:35:26.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:26 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:35:26.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:26 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:35:26.650 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:35:26.658 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:26.659 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:35:26.760 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:35:26.799 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:26.826 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:35:26.830 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:26.830 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:35:26.931 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:35:27.015 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:27.189 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:35:27.198 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:27.199 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:35:27.210 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:27 smithi022 ceph-mon[39439]: 4.9 scrub ok 2024-04-01T19:35:27.210 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:27 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:35:27.210 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:27 smithi022 ceph-mon[39439]: 4.f scrub starts 2024-04-01T19:35:27.210 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:27 smithi022 ceph-mon[39439]: 4.a scrub ok 2024-04-01T19:35:27.210 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:27 smithi022 ceph-mon[39439]: 4.4 scrub ok 2024-04-01T19:35:27.210 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:27 smithi022 ceph-mon[39439]: 4.d scrub starts 2024-04-01T19:35:27.300 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:35:27.351 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:27.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:27 smithi062 ceph-mon[44211]: 4.9 scrub ok 2024-04-01T19:35:27.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:27 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:35:27.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:27 smithi062 ceph-mon[44211]: 4.f scrub starts 2024-04-01T19:35:27.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:27 smithi062 ceph-mon[44211]: 4.a scrub ok 2024-04-01T19:35:27.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:27 smithi062 ceph-mon[44211]: 4.4 scrub ok 2024-04-01T19:35:27.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:27 smithi062 ceph-mon[44211]: 4.d scrub starts 2024-04-01T19:35:27.516 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:35:27.516 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:35:27.583 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 82 16 162702 162686 123.969 70.8125 0.0105846 0.00806527 2024-04-01T19:35:27.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:27 smithi188 ceph-mon[43939]: 4.9 scrub ok 2024-04-01T19:35:27.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:27 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:35:27.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:27 smithi188 ceph-mon[43939]: 4.f scrub starts 2024-04-01T19:35:27.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:27 smithi188 ceph-mon[43939]: 4.a scrub ok 2024-04-01T19:35:27.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:27 smithi188 ceph-mon[43939]: 4.4 scrub ok 2024-04-01T19:35:27.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:27 smithi188 ceph-mon[43939]: 4.d scrub starts 2024-04-01T19:35:27.835 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:35:27.870 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:35:27.874 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:27.874 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:35:27.976 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:35:28.008 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:28.034 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:35:28.036 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:28.037 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:35:28.138 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:35:28.185 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:35:28.196 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:28.266 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:35:28.272 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:28.273 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:35:28.373 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:35:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:28 smithi188 ceph-mon[43939]: pgmap v851: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 73 MiB/s wr, 1.16k op/s 2024-04-01T19:35:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:28 smithi188 ceph-mon[43939]: 4.5 scrub starts 2024-04-01T19:35:28.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:28 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1779012508' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:35:28.421 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:28.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:28 smithi062 ceph-mon[44211]: pgmap v851: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 73 MiB/s wr, 1.16k op/s 2024-04-01T19:35:28.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:28 smithi062 ceph-mon[44211]: 4.5 scrub starts 2024-04-01T19:35:28.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:28 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1779012508' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:35:28.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:28 smithi022 ceph-mon[39439]: pgmap v851: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 73 MiB/s wr, 1.16k op/s 2024-04-01T19:35:28.572 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:28 smithi022 ceph-mon[39439]: 4.5 scrub starts 2024-04-01T19:35:28.572 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:28 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1779012508' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:35:28.583 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 83 16 163744 163728 123.26 65.125 0.012421 0.00811156 2024-04-01T19:35:28.981 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:35:28.989 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:28.989 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:35:29.090 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:35:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:29.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:29 smithi022 ceph-mon[39439]: 4.6 scrub starts 2024-04-01T19:35:29.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:29 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:35:29.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:29 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:35:29.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:29 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1779012508' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:35:29.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:29 smithi022 ceph-mon[39439]: osdmap e294: 12 total, 12 up, 12 in 2024-04-01T19:35:29.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:29 smithi022 ceph-mon[39439]: 4.d scrub ok 2024-04-01T19:35:29.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:29 smithi022 ceph-mon[39439]: 4.f scrub ok 2024-04-01T19:35:29.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:29 smithi062 ceph-mon[44211]: 4.6 scrub starts 2024-04-01T19:35:29.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:29 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:35:29.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:29 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:35:29.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:29 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1779012508' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:35:29.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:29 smithi062 ceph-mon[44211]: osdmap e294: 12 total, 12 up, 12 in 2024-04-01T19:35:29.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:29 smithi062 ceph-mon[44211]: 4.d scrub ok 2024-04-01T19:35:29.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:29 smithi062 ceph-mon[44211]: 4.f scrub ok 2024-04-01T19:35:29.515 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:35:29.519 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:29.519 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:35:29.583 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 84 16 164877 164861 122.636 70.8125 0.00996821 0.0081531 2024-04-01T19:35:29.620 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:35:29.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:29 smithi188 ceph-mon[43939]: 4.6 scrub starts 2024-04-01T19:35:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:29 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:35:29.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:29 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:35:29.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:29 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1779012508' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:35:29.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:29 smithi188 ceph-mon[43939]: osdmap e294: 12 total, 12 up, 12 in 2024-04-01T19:35:29.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:29 smithi188 ceph-mon[43939]: 4.d scrub ok 2024-04-01T19:35:29.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:29 smithi188 ceph-mon[43939]: 4.f scrub ok 2024-04-01T19:35:29.653 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:29.678 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:35:29.684 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:29.684 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:35:29.785 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:35:29.836 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:29.980 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:35:29.983 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:29.984 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:35:30.085 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:35:30.126 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:30.149 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:35:30.153 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:30.154 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:35:30.255 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:35:30.292 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:30.315 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:35:30.317 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:30.318 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:35:30.360 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_historic_ops 2024-04-01T19:35:30.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:30 smithi188 ceph-mon[43939]: pgmap v853: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 72 MiB/s wr, 1.15k op/s 2024-04-01T19:35:30.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:30 smithi188 ceph-mon[43939]: 4.5 scrub ok 2024-04-01T19:35:30.418 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:35:30.446 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:30.471 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:35:30.474 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:30.475 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:35:30.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:30 smithi062 ceph-mon[44211]: pgmap v853: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 72 MiB/s wr, 1.15k op/s 2024-04-01T19:35:30.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:30 smithi062 ceph-mon[44211]: 4.5 scrub ok 2024-04-01T19:35:30.575 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:35:30.583 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 85 16 166037 166021 122.046 72.5 0.0397083 0.00819216 2024-04-01T19:35:30.608 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:30.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:30 smithi022 ceph-mon[39439]: pgmap v853: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 72 MiB/s wr, 1.15k op/s 2024-04-01T19:35:30.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:30 smithi022 ceph-mon[39439]: 4.5 scrub ok 2024-04-01T19:35:30.633 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:35:30.637 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:30.637 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:35:30.738 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:35:30.808 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:31.034 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:35:31.044 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:31.045 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:35:31.081 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:35:31.144 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:35:31.145 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:35:31.176 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:31.189 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:35:31.203 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:35:31.206 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:31.206 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:35:31.227 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:35:31.261 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:35:31.294 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:35:31.307 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:35:31.328 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:35:31.337 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:31.362 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:35:31.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:31 smithi022 ceph-mon[39439]: 4.6 scrub ok 2024-04-01T19:35:31.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:31 smithi022 ceph-mon[39439]: 4.b scrub starts 2024-04-01T19:35:31.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:31 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/302984264' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:35:31.363 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:35:31.366 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:31.366 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:35:31.409 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:35:31.431 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:35:31.467 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:35:31.468 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:35:31.510 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:35:31.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:31 smithi062 ceph-mon[44211]: 4.6 scrub ok 2024-04-01T19:35:31.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:31 smithi062 ceph-mon[44211]: 4.b scrub starts 2024-04-01T19:35:31.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:31 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/302984264' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:35:31.528 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:31.547 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:35:31.566 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:35:31.566 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:35:31.566 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:35:31.566 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:35:31.566 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:35:31.567 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:35:31.567 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:35:31.567 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:35:31.567 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:35:31.567 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:35:31.567 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:35:31.567 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:35:31.583 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 86 16 167110 167094 121.406 67.0625 0.014477 0.00823502 2024-04-01T19:35:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:31 smithi188 ceph-mon[43939]: 4.6 scrub ok 2024-04-01T19:35:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:31 smithi188 ceph-mon[43939]: 4.b scrub starts 2024-04-01T19:35:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:31 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/302984264' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:35:32.023 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:35:32.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:32 smithi022 ceph-mon[39439]: pgmap v854: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 69 MiB/s wr, 1.10k op/s 2024-04-01T19:35:32.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.413 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:35:32.415 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:32.416 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:35:32.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:32 smithi062 ceph-mon[44211]: pgmap v854: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 69 MiB/s wr, 1.10k op/s 2024-04-01T19:35:32.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.517 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:35:32.541 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:32 smithi188 ceph-mon[43939]: pgmap v854: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 69 MiB/s wr, 1.10k op/s 2024-04-01T19:35:32.541 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.541 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.541 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.541 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.541 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.542 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.542 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.542 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.542 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.542 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:32.543 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:32.566 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:35:32.568 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:32.569 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:35:32.584 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 87 16 168271 168255 120.845 72.5625 0.0101333 0.00827378 2024-04-01T19:35:32.669 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:35:32.726 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:33.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:33.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:33.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:33 smithi062 ceph-mon[44211]: 4.b scrub ok 2024-04-01T19:35:33.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:33 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:35:33.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:33 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:35:33.584 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 88 16 169523 169507 120.361 78.25 0.0050124 0.00830725 2024-04-01T19:35:33.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:33.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:33.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:33 smithi022 ceph-mon[39439]: 4.b scrub ok 2024-04-01T19:35:33.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:33 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:35:33.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:33 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:35:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:33 smithi188 ceph-mon[43939]: 4.b scrub ok 2024-04-01T19:35:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:33 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:35:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:33 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:35:34.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:34 smithi062 ceph-mon[44211]: pgmap v855: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 69 MiB/s wr, 1.10k op/s 2024-04-01T19:35:34.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:34 smithi062 ceph-mon[44211]: osdmap e295: 12 total, 12 up, 12 in 2024-04-01T19:35:34.584 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 89 16 170730 170714 119.856 75.4375 0.011927 0.00834167 2024-04-01T19:35:34.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:34 smithi022 ceph-mon[39439]: pgmap v855: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 69 MiB/s wr, 1.10k op/s 2024-04-01T19:35:34.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:34 smithi022 ceph-mon[39439]: osdmap e295: 12 total, 12 up, 12 in 2024-04-01T19:35:34.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:34 smithi188 ceph-mon[43939]: pgmap v855: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 69 MiB/s wr, 1.10k op/s 2024-04-01T19:35:34.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:34 smithi188 ceph-mon[43939]: osdmap e295: 12 total, 12 up, 12 in 2024-04-01T19:35:35.584 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Total time run: 90.0053 2024-04-01T19:35:35.585 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Total writes made: 171991 2024-04-01T19:35:35.585 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Write size: 65536 2024-04-01T19:35:35.585 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Object size: 65536 2024-04-01T19:35:35.585 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Bandwidth (MB/sec): 119.431 2024-04-01T19:35:35.585 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Stddev Bandwidth: 58.3413 2024-04-01T19:35:35.585 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Max bandwidth (MB/sec): 370.5 2024-04-01T19:35:35.585 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Min bandwidth (MB/sec): 63.8125 2024-04-01T19:35:35.585 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Average IOPS: 1910 2024-04-01T19:35:35.585 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Stddev IOPS: 933.46 2024-04-01T19:35:35.586 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Max IOPS: 5928 2024-04-01T19:35:35.586 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Min IOPS: 1021 2024-04-01T19:35:35.586 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Average Latency(s): 0.00837233 2024-04-01T19:35:35.586 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Stddev Latency(s): 0.00689531 2024-04-01T19:35:35.586 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Max latency(s): 0.222141 2024-04-01T19:35:35.586 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Min latency(s): 0.00107168 2024-04-01T19:35:35.592 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Cleaning up (deleting benchmark objects) 2024-04-01T19:35:36.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:36 smithi062 ceph-mon[44211]: pgmap v857: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 65 MiB/s wr, 1.05k op/s 2024-04-01T19:35:36.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:36 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:35:36.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:36 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:35:36.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:36 smithi022 ceph-mon[39439]: pgmap v857: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 65 MiB/s wr, 1.05k op/s 2024-04-01T19:35:36.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:36 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:35:36.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:36 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:35:36.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:36 smithi188 ceph-mon[43939]: pgmap v857: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 65 MiB/s wr, 1.05k op/s 2024-04-01T19:35:36.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:36 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:35:36.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:36 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:35:37.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:37 smithi022 ceph-mon[39439]: osdmap e296: 12 total, 12 up, 12 in 2024-04-01T19:35:37.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:37 smithi188 ceph-mon[43939]: osdmap e296: 12 total, 12 up, 12 in 2024-04-01T19:35:37.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:37 smithi062 ceph-mon[44211]: osdmap e296: 12 total, 12 up, 12 in 2024-04-01T19:35:38.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:38 smithi022 ceph-mon[39439]: pgmap v859: 17 pgs: 17 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s rd, 79 MiB/s wr, 1.29k op/s 2024-04-01T19:35:38.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:38 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:35:38.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:38 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:35:38.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:38 smithi188 ceph-mon[43939]: pgmap v859: 17 pgs: 17 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s rd, 79 MiB/s wr, 1.29k op/s 2024-04-01T19:35:38.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:38 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:35:38.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:38 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:35:38.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:38 smithi062 ceph-mon[44211]: pgmap v859: 17 pgs: 17 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s rd, 79 MiB/s wr, 1.29k op/s 2024-04-01T19:35:38.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:38 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:35:38.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:38 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:35:39.290 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:39 smithi022 ceph-mon[39439]: osdmap e297: 12 total, 12 up, 12 in 2024-04-01T19:35:39.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:39 smithi188 ceph-mon[43939]: osdmap e297: 12 total, 12 up, 12 in 2024-04-01T19:35:39.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:39 smithi062 ceph-mon[44211]: osdmap e297: 12 total, 12 up, 12 in 2024-04-01T19:35:40.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:40 smithi022 ceph-mon[39439]: pgmap v861: 17 pgs: 17 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 56 MiB/s wr, 1.01k op/s 2024-04-01T19:35:40.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:40 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:35:40.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:40 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:35:40.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:40 smithi188 ceph-mon[43939]: pgmap v861: 17 pgs: 17 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 56 MiB/s wr, 1.01k op/s 2024-04-01T19:35:40.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:40 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:35:40.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:40 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:35:40.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:40 smithi062 ceph-mon[44211]: pgmap v861: 17 pgs: 17 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 56 MiB/s wr, 1.01k op/s 2024-04-01T19:35:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:40 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:35:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:40 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:35:41.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:41 smithi022 ceph-mon[39439]: osdmap e298: 12 total, 12 up, 12 in 2024-04-01T19:35:41.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:41 smithi188 ceph-mon[43939]: osdmap e298: 12 total, 12 up, 12 in 2024-04-01T19:35:41.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:41 smithi062 ceph-mon[44211]: osdmap e298: 12 total, 12 up, 12 in 2024-04-01T19:35:42.146 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:35:42.255 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:42.255 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:35:42.356 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:35:42.390 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:42.418 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:35:42.421 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:42.422 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:35:42.522 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:35:42.561 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:42.562 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:42 smithi062 ceph-mon[44211]: pgmap v863: 17 pgs: 17 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 41 MiB/s wr, 1.35k op/s 2024-04-01T19:35:42.589 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:35:42.594 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:42.595 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:35:42.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:42 smithi022 ceph-mon[39439]: pgmap v863: 17 pgs: 17 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 41 MiB/s wr, 1.35k op/s 2024-04-01T19:35:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:42 smithi188 ceph-mon[43939]: pgmap v863: 17 pgs: 17 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 41 MiB/s wr, 1.35k op/s 2024-04-01T19:35:42.695 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:35:42.747 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:43.407 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:35:43.417 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:43.418 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:35:43.449 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:35:43.519 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:35:43.550 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:43.576 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:35:43.583 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:43.584 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:35:43.685 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:35:43.733 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:43.775 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:35:43.783 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:43.783 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:35:43.851 INFO:tasks.thrashosds.thrasher:Recovered, killing an osd 2024-04-01T19:35:43.851 INFO:tasks.thrashosds.thrasher:Killing osd 6, live_osds are [0, 1, 2, 3, 4, 5, 6, 7, 9, 10, 11, 8] 2024-04-01T19:35:43.851 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-04-01T19:35:43.852 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.6 2024-04-01T19:35:43.884 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:35:43.920 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:43.948 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:35:43.954 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:43.955 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:35:44.055 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:35:44.120 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:44.224 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:35:43 smithi062 systemd[1]: Stopping Ceph osd.6 for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T19:35:44.230 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:35:44.232 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:44.232 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:35:44.333 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:35:44.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:44 smithi022 ceph-mon[39439]: pgmap v864: 17 pgs: 17 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 154 B/s rd, 20 MiB/s wr, 1.31k op/s 2024-04-01T19:35:44.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:44 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:35:44.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:44 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:35:44.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:44 smithi022 ceph-mon[39439]: osdmap e299: 12 total, 12 up, 12 in 2024-04-01T19:35:44.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:44 smithi022 ceph-mon[39439]: osd.6 marked itself down and dead 2024-04-01T19:35:44.379 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:44.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:44 smithi062 ceph-mon[44211]: pgmap v864: 17 pgs: 17 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 154 B/s rd, 20 MiB/s wr, 1.31k op/s 2024-04-01T19:35:44.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:44 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:35:44.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:44 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:35:44.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:44 smithi062 ceph-mon[44211]: osdmap e299: 12 total, 12 up, 12 in 2024-04-01T19:35:44.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:44 smithi062 ceph-mon[44211]: osd.6 marked itself down and dead 2024-04-01T19:35:44.511 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:35:44 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[65334]: 2024-04-01T19:35:44.224+0000 7f4521bf1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T19:35:44.511 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:35:44 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[65334]: 2024-04-01T19:35:44.224+0000 7f4521bf1700 -1 osd.6 299 *** Got signal Terminated *** 2024-04-01T19:35:44.511 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:35:44 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[65334]: 2024-04-01T19:35:44.224+0000 7f4521bf1700 -1 osd.6 299 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T19:35:44.590 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:35:44.592 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:44.593 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:35:44.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:44 smithi188 ceph-mon[43939]: pgmap v864: 17 pgs: 17 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 154 B/s rd, 20 MiB/s wr, 1.31k op/s 2024-04-01T19:35:44.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:44 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:35:44.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:44 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:35:44.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:44 smithi188 ceph-mon[43939]: osdmap e299: 12 total, 12 up, 12 in 2024-04-01T19:35:44.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:44 smithi188 ceph-mon[43939]: osd.6 marked itself down and dead 2024-04-01T19:35:44.694 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:35:44.723 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:44.742 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:35:44.744 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:44.745 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:35:44.811 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:35:44.812 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 20, 2024-04-01T19:35:44.812 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 600, 2024-04-01T19:35:44.812 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:35:44.812 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.812 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:148125 2.e 2:727aed70:::benchmark_data_smithi188_77607_object148124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:35:44.812 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:14.449786+0000", 2024-04-01T19:35:44.812 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 570.36200599400001, 2024-04-01T19:35:44.812 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.049945237000000003, 2024-04-01T19:35:44.812 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:44.812 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:44.812 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:44.812 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:44.813 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:44.813 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:44.813 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 148125 2024-04-01T19:35:44.813 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.813 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:44.813 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.813 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:44.813 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.449786+0000", 2024-04-01T19:35:44.813 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.813 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.813 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.813 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:44.813 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.449786+0000", 2024-04-01T19:35:44.813 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.814 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.814 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.814 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:44.814 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.449788+0000", 2024-04-01T19:35:44.814 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.875e-06 2024-04-01T19:35:44.814 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.814 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.814 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:44.814 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.449809+0000", 2024-04-01T19:35:44.814 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1126999999999999e-05 2024-04-01T19:35:44.814 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.814 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.814 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:44.815 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.452528+0000", 2024-04-01T19:35:44.815 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0027194849999999998 2024-04-01T19:35:44.815 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.815 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.815 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:44.815 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.452540+0000", 2024-04-01T19:35:44.815 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1207e-05 2024-04-01T19:35:44.815 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.815 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.815 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:44.815 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.454578+0000", 2024-04-01T19:35:44.815 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0020383519999999998 2024-04-01T19:35:44.815 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.816 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.816 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:44.816 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.454669+0000", 2024-04-01T19:35:44.816 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.1056000000000004e-05 2024-04-01T19:35:44.816 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.816 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.816 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:35:44.816 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.454770+0000", 2024-04-01T19:35:44.816 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000100462 2024-04-01T19:35:44.816 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.816 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.816 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:44.816 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.461671+0000", 2024-04-01T19:35:44.817 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.006901903 2024-04-01T19:35:44.817 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.817 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.817 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:44.817 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.499605+0000", 2024-04-01T19:35:44.817 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.037933407000000002 2024-04-01T19:35:44.817 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.817 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.817 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:44.817 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.499664+0000", 2024-04-01T19:35:44.817 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9101999999999998e-05 2024-04-01T19:35:44.817 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.817 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.818 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:44.818 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.499731+0000", 2024-04-01T19:35:44.818 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.7261000000000005e-05 2024-04-01T19:35:44.818 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.818 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:44.818 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.818 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.818 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.818 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:148144 2.1 2:840a2df5:::benchmark_data_smithi188_77607_object148143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e134)", 2024-04-01T19:35:44.818 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:14.462873+0000", 2024-04-01T19:35:44.818 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 570.34891855499995, 2024-04-01T19:35:44.818 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.052465008, 2024-04-01T19:35:44.818 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:44.819 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:44.819 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:44.819 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:44.819 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:44.819 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:44.819 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 148144 2024-04-01T19:35:44.819 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.819 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:44.819 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.819 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:44.819 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.462873+0000", 2024-04-01T19:35:44.819 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.819 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.819 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.820 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:44.820 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.462873+0000", 2024-04-01T19:35:44.820 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.820 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.820 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.820 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:44.820 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.462876+0000", 2024-04-01T19:35:44.820 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.525e-06 2024-04-01T19:35:44.820 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.820 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.820 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:44.820 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.463032+0000", 2024-04-01T19:35:44.820 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015644699999999999 2024-04-01T19:35:44.821 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.821 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.821 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:44.821 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.463043+0000", 2024-04-01T19:35:44.821 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0665999999999999e-05 2024-04-01T19:35:44.821 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.821 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.821 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:44.821 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.463052+0000", 2024-04-01T19:35:44.821 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.507e-06 2024-04-01T19:35:44.821 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.821 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.821 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:44.822 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.463109+0000", 2024-04-01T19:35:44.822 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7843999999999997e-05 2024-04-01T19:35:44.822 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.822 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.822 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:44.822 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.499448+0000", 2024-04-01T19:35:44.822 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.036338095000000001 2024-04-01T19:35:44.822 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.822 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.822 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:35:44.822 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.499686+0000", 2024-04-01T19:35:44.822 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00023816000000000001 2024-04-01T19:35:44.822 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.823 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.823 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:44.823 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.512811+0000", 2024-04-01T19:35:44.823 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.013125746000000001 2024-04-01T19:35:44.823 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.823 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.823 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:44.823 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.515229+0000", 2024-04-01T19:35:44.823 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0024171689999999998 2024-04-01T19:35:44.823 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.823 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.823 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:44.823 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.515287+0000", 2024-04-01T19:35:44.823 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8199999999999998e-05 2024-04-01T19:35:44.824 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.824 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.824 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:44.824 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.515338+0000", 2024-04-01T19:35:44.824 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.1649e-05 2024-04-01T19:35:44.824 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.824 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:44.824 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.824 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.824 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.824 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.24751.0:148142 2.3 e134/106 2:c77187ad:::benchmark_data_smithi188_77607_object148141:head v 134'9255, mlcod=134'9253)", 2024-04-01T19:35:44.824 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:14.463631+0000", 2024-04-01T19:35:44.824 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 570.34816138300005, 2024-04-01T19:35:44.824 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.051623170000000003, 2024-04-01T19:35:44.824 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:44.825 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:44.825 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:44.825 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:44.825 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.825 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:44.825 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.463631+0000", 2024-04-01T19:35:44.825 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.825 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.825 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.825 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:44.825 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.463631+0000", 2024-04-01T19:35:44.825 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.825 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.825 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.826 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:44.826 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.463632+0000", 2024-04-01T19:35:44.826 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6530000000000001e-06 2024-04-01T19:35:44.826 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.826 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.826 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:44.826 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.463668+0000", 2024-04-01T19:35:44.826 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5592000000000001e-05 2024-04-01T19:35:44.826 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.826 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.826 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:44.826 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.499423+0000", 2024-04-01T19:35:44.826 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.035755376999999998 2024-04-01T19:35:44.827 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.827 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.827 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:44.827 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.499441+0000", 2024-04-01T19:35:44.827 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8185999999999998e-05 2024-04-01T19:35:44.827 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.827 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.827 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:44.827 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.499814+0000", 2024-04-01T19:35:44.827 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00037296399999999999 2024-04-01T19:35:44.827 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.827 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.827 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:44.827 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.499834+0000", 2024-04-01T19:35:44.828 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9579e-05 2024-04-01T19:35:44.828 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.828 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.828 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:44.828 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.515199+0000", 2024-04-01T19:35:44.828 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.015364568 2024-04-01T19:35:44.828 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.828 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.828 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:44.828 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:14.515254+0000", 2024-04-01T19:35:44.828 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5250999999999997e-05 2024-04-01T19:35:44.828 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.828 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:44.829 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.829 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.829 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.829 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:182858 2.1 2:836cb02a:::benchmark_data_smithi188_77607_object15454:head [delete] snapc 0=[] ondisk+write+known_if_redirected e144)", 2024-04-01T19:35:44.829 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:26:49.449669+0000", 2024-04-01T19:35:44.829 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 535.36212284999999, 2024-04-01T19:35:44.829 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.046786688999999999, 2024-04-01T19:35:44.829 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:44.829 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:44.829 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:44.829 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:44.829 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:44.829 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:44.829 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 182858 2024-04-01T19:35:44.830 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.830 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:44.830 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.830 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:44.830 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.449669+0000", 2024-04-01T19:35:44.830 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.830 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.830 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.830 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:44.830 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.449669+0000", 2024-04-01T19:35:44.830 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.830 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.830 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.831 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:44.831 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.449671+0000", 2024-04-01T19:35:44.831 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2359999999999999e-06 2024-04-01T19:35:44.831 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.831 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.831 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:44.831 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.449677+0000", 2024-04-01T19:35:44.831 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6380000000000001e-06 2024-04-01T19:35:44.831 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.831 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.831 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:44.831 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.481599+0000", 2024-04-01T19:35:44.831 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.031921917000000001 2024-04-01T19:35:44.831 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.832 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.832 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:44.832 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.481613+0000", 2024-04-01T19:35:44.832 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4205999999999999e-05 2024-04-01T19:35:44.832 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.832 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.832 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:44.832 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.481790+0000", 2024-04-01T19:35:44.832 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000177057 2024-04-01T19:35:44.832 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.832 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.832 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:44.832 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.481914+0000", 2024-04-01T19:35:44.833 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012362000000000001 2024-04-01T19:35:44.833 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.833 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.833 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:35:44.833 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.482034+0000", 2024-04-01T19:35:44.833 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000119741 2024-04-01T19:35:44.833 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.833 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.833 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:44.833 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.496334+0000", 2024-04-01T19:35:44.833 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.01430058 2024-04-01T19:35:44.833 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.833 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.833 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:44.834 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.496352+0000", 2024-04-01T19:35:44.834 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7464000000000001e-05 2024-04-01T19:35:44.834 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.834 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.834 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:44.834 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.496405+0000", 2024-04-01T19:35:44.834 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3576999999999999e-05 2024-04-01T19:35:44.834 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.834 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.834 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:44.834 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:26:49.496456+0000", 2024-04-01T19:35:44.834 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0652999999999998e-05 2024-04-01T19:35:44.834 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.834 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:44.835 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.835 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.835 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.835 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:197050 2.e 2:7780661b:::benchmark_data_smithi188_77607_object29646:head [delete] snapc 0=[] ondisk+write+known_if_redirected e148)", 2024-04-01T19:35:44.835 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:27:01.163720+0000", 2024-04-01T19:35:44.835 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 523.64807226000005, 2024-04-01T19:35:44.835 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.046820833999999999, 2024-04-01T19:35:44.835 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:44.835 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:44.835 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:44.835 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:44.835 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:44.835 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:44.835 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 197050 2024-04-01T19:35:44.836 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.836 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:44.836 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.836 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:44.836 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.163720+0000", 2024-04-01T19:35:44.836 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.836 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.836 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.836 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:44.836 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.163720+0000", 2024-04-01T19:35:44.836 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.836 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.836 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.836 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:44.837 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.163722+0000", 2024-04-01T19:35:44.837 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6089999999999999e-06 2024-04-01T19:35:44.837 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.837 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.837 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:44.837 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.163732+0000", 2024-04-01T19:35:44.837 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.3260000000000002e-06 2024-04-01T19:35:44.837 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.837 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.837 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:44.837 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.163746+0000", 2024-04-01T19:35:44.837 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4139e-05 2024-04-01T19:35:44.837 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.837 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.838 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:44.838 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.163757+0000", 2024-04-01T19:35:44.838 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0974e-05 2024-04-01T19:35:44.838 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.838 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.838 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:44.838 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.175349+0000", 2024-04-01T19:35:44.838 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.011592259000000001 2024-04-01T19:35:44.838 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.838 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.838 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:44.838 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.175488+0000", 2024-04-01T19:35:44.838 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013927300000000001 2024-04-01T19:35:44.838 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.839 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.839 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:35:44.839 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.175619+0000", 2024-04-01T19:35:44.839 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013097900000000001 2024-04-01T19:35:44.839 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.839 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.839 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:44.839 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.202362+0000", 2024-04-01T19:35:44.839 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.026742955999999998 2024-04-01T19:35:44.839 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.839 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.839 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:44.839 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.210409+0000", 2024-04-01T19:35:44.839 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0080466349999999999 2024-04-01T19:35:44.840 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.840 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.840 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:44.840 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.210481+0000", 2024-04-01T19:35:44.840 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2395000000000001e-05 2024-04-01T19:35:44.840 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.840 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.840 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:44.840 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:01.210541+0000", 2024-04-01T19:35:44.840 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9289000000000001e-05 2024-04-01T19:35:44.840 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.840 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:44.840 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.840 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.841 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.841 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:201818 2.e 2:7ff9e1f3:::benchmark_data_smithi188_77607_object34414:head [delete] snapc 0=[] ondisk+write+known_if_redirected e148)", 2024-04-01T19:35:44.841 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:27:05.064418+0000", 2024-04-01T19:35:44.841 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 519.74737403300003, 2024-04-01T19:35:44.841 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.048457660999999999, 2024-04-01T19:35:44.841 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:44.841 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:44.841 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:44.841 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:44.841 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:44.841 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:44.841 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 201818 2024-04-01T19:35:44.841 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.841 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:44.842 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.842 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:44.842 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.064418+0000", 2024-04-01T19:35:44.842 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.842 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.842 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.842 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:44.842 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.064418+0000", 2024-04-01T19:35:44.842 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.842 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.842 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.842 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:44.842 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.064419+0000", 2024-04-01T19:35:44.843 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.1800000000000005e-07 2024-04-01T19:35:44.843 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.843 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.843 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:44.843 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.064423+0000", 2024-04-01T19:35:44.843 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.8700000000000002e-06 2024-04-01T19:35:44.843 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.843 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.843 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:44.843 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.064430+0000", 2024-04-01T19:35:44.843 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6310000000000003e-06 2024-04-01T19:35:44.843 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.843 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.844 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:44.844 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.064437+0000", 2024-04-01T19:35:44.844 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8190000000000003e-06 2024-04-01T19:35:44.844 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.844 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.844 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:44.844 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.069554+0000", 2024-04-01T19:35:44.844 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0051165179999999996 2024-04-01T19:35:44.844 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.844 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.844 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:44.844 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.069682+0000", 2024-04-01T19:35:44.844 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012807000000000001 2024-04-01T19:35:44.844 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.845 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.845 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:35:44.845 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.069803+0000", 2024-04-01T19:35:44.845 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012164599999999999 2024-04-01T19:35:44.845 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.845 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.845 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:44.845 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.083836+0000", 2024-04-01T19:35:44.845 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.01403278 2024-04-01T19:35:44.845 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.846 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.846 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:44.846 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.112759+0000", 2024-04-01T19:35:44.846 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.028923154999999999 2024-04-01T19:35:44.846 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.846 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.846 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:44.846 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.112824+0000", 2024-04-01T19:35:44.846 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4259999999999998e-05 2024-04-01T19:35:44.846 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.846 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.846 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:44.846 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.112876+0000", 2024-04-01T19:35:44.847 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2094e-05 2024-04-01T19:35:44.847 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.847 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:44.847 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.847 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.847 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.847 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:201822 2.e 2:7cf02010:::benchmark_data_smithi188_77607_object34418:head [delete] snapc 0=[] ondisk+write+known_if_redirected e148)", 2024-04-01T19:35:44.847 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:27:05.064446+0000", 2024-04-01T19:35:44.847 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 519.747346193, 2024-04-01T19:35:44.847 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.048558083000000002, 2024-04-01T19:35:44.847 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:44.847 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:44.847 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:44.847 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:44.848 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:44.848 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:44.848 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 201822 2024-04-01T19:35:44.848 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.848 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:44.848 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.848 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:44.848 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.064446+0000", 2024-04-01T19:35:44.848 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.848 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.848 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.848 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:44.848 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.064446+0000", 2024-04-01T19:35:44.848 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.849 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.849 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.849 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:44.849 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.064446+0000", 2024-04-01T19:35:44.849 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4899999999999995e-07 2024-04-01T19:35:44.849 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.849 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.849 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:44.849 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.064449+0000", 2024-04-01T19:35:44.849 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.988e-06 2024-04-01T19:35:44.849 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.849 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.849 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:44.849 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.064455+0000", 2024-04-01T19:35:44.850 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7100000000000004e-06 2024-04-01T19:35:44.850 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.850 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.850 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:44.850 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.064460+0000", 2024-04-01T19:35:44.850 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.775e-06 2024-04-01T19:35:44.850 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.850 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.850 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:44.850 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.074362+0000", 2024-04-01T19:35:44.850 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0099025829999999995 2024-04-01T19:35:44.850 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.850 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.851 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:44.851 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.074480+0000", 2024-04-01T19:35:44.851 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000117683 2024-04-01T19:35:44.851 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.851 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.851 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:35:44.851 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.074589+0000", 2024-04-01T19:35:44.851 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000108965 2024-04-01T19:35:44.851 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.851 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.851 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:44.851 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.083844+0000", 2024-04-01T19:35:44.851 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0092551260000000007 2024-04-01T19:35:44.851 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.852 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.852 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:44.852 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.112918+0000", 2024-04-01T19:35:44.852 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.029074164999999999 2024-04-01T19:35:44.852 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.852 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.852 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:44.852 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.112965+0000", 2024-04-01T19:35:44.852 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6723e-05 2024-04-01T19:35:44.852 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.852 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.852 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:44.852 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:05.113004+0000", 2024-04-01T19:35:44.852 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.8716e-05 2024-04-01T19:35:44.853 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.853 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:44.853 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.853 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.853 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.853 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:232287 2.1 2:8d72669b:::benchmark_data_smithi188_77607_object64883:head [delete] snapc 0=[] ondisk+write+known_if_redirected e154)", 2024-04-01T19:35:44.853 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:27:30.800564+0000", 2024-04-01T19:35:44.853 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 494.01122781100003, 2024-04-01T19:35:44.853 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.046309595000000002, 2024-04-01T19:35:44.853 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:44.853 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:44.853 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:44.853 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:44.853 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:44.854 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:44.854 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 232287 2024-04-01T19:35:44.854 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.854 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:44.854 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.854 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:44.854 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800564+0000", 2024-04-01T19:35:44.854 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.854 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.854 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.854 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:44.854 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800564+0000", 2024-04-01T19:35:44.854 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.855 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.855 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.855 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:44.855 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800568+0000", 2024-04-01T19:35:44.855 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.6059999999999999e-06 2024-04-01T19:35:44.855 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.855 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.855 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:44.855 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800577+0000", 2024-04-01T19:35:44.855 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.3719999999999994e-06 2024-04-01T19:35:44.855 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.855 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.855 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:44.855 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800595+0000", 2024-04-01T19:35:44.855 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8258999999999999e-05 2024-04-01T19:35:44.856 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.856 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.856 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:44.856 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800606+0000", 2024-04-01T19:35:44.856 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0438999999999999e-05 2024-04-01T19:35:44.856 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.856 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.856 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:44.856 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800678+0000", 2024-04-01T19:35:44.856 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2311000000000006e-05 2024-04-01T19:35:44.856 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.856 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.856 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:44.856 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800800+0000", 2024-04-01T19:35:44.857 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012170799999999999 2024-04-01T19:35:44.857 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.857 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.857 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:35:44.857 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800914+0000", 2024-04-01T19:35:44.857 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00011417900000000001 2024-04-01T19:35:44.857 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.857 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.857 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:44.857 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.811239+0000", 2024-04-01T19:35:44.857 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.01032488 2024-04-01T19:35:44.857 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.857 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.858 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:44.858 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.846752+0000", 2024-04-01T19:35:44.858 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.035513220999999998 2024-04-01T19:35:44.858 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.858 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.858 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:44.858 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.846818+0000", 2024-04-01T19:35:44.858 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.622e-05 2024-04-01T19:35:44.858 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.858 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.858 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:44.858 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.846874+0000", 2024-04-01T19:35:44.858 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5399999999999998e-05 2024-04-01T19:35:44.858 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.859 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:44.859 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.859 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.859 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.859 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:232296 2.1 2:8be978a8:::benchmark_data_smithi188_77607_object64892:head [delete] snapc 0=[] ondisk+write+known_if_redirected e154)", 2024-04-01T19:35:44.859 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:27:30.800663+0000", 2024-04-01T19:35:44.859 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 494.01112917699999, 2024-04-01T19:35:44.859 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.046350598999999999, 2024-04-01T19:35:44.859 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:44.859 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:44.859 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:44.859 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:44.859 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:44.860 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:44.860 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 232296 2024-04-01T19:35:44.860 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.860 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:44.860 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.860 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:44.860 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800663+0000", 2024-04-01T19:35:44.860 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.860 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.860 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.860 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:44.860 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800663+0000", 2024-04-01T19:35:44.860 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.860 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.861 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.861 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:44.861 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800663+0000", 2024-04-01T19:35:44.861 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.13e-07 2024-04-01T19:35:44.861 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.861 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.861 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:44.861 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800666+0000", 2024-04-01T19:35:44.861 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6869999999999999e-06 2024-04-01T19:35:44.861 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.861 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.861 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:44.861 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800671+0000", 2024-04-01T19:35:44.862 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0420000000000002e-06 2024-04-01T19:35:44.862 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.862 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.862 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:44.862 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.800677+0000", 2024-04-01T19:35:44.862 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3430000000000001e-06 2024-04-01T19:35:44.862 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.862 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.862 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:44.862 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.806559+0000", 2024-04-01T19:35:44.862 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0058811560000000002 2024-04-01T19:35:44.862 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.862 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.862 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:44.863 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.806666+0000", 2024-04-01T19:35:44.863 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000107227 2024-04-01T19:35:44.863 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.863 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.863 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:35:44.863 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.806773+0000", 2024-04-01T19:35:44.863 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000107161 2024-04-01T19:35:44.863 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.863 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.863 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:44.863 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.811575+0000", 2024-04-01T19:35:44.863 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0048016730000000002 2024-04-01T19:35:44.863 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.863 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.863 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:44.864 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.846923+0000", 2024-04-01T19:35:44.864 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.035348836000000002 2024-04-01T19:35:44.864 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.864 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.864 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:44.864 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.846972+0000", 2024-04-01T19:35:44.864 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8501999999999997e-05 2024-04-01T19:35:44.864 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.864 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.864 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:44.864 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:30.847013+0000", 2024-04-01T19:35:44.864 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1458999999999997e-05 2024-04-01T19:35:44.864 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.865 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:44.865 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.865 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.865 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.865 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:236448 2.e 2:7dd5818f:::benchmark_data_smithi188_77607_object69044:head [delete] snapc 0=[] ondisk+write+known_if_redirected e155)", 2024-04-01T19:35:44.865 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:27:34.595552+0000", 2024-04-01T19:35:44.865 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 490.21624017900001, 2024-04-01T19:35:44.865 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.046592974000000002, 2024-04-01T19:35:44.865 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:44.865 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:44.865 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:44.865 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:44.865 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:44.865 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:44.865 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 236448 2024-04-01T19:35:44.866 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.866 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:44.866 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.866 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:44.866 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.595552+0000", 2024-04-01T19:35:44.866 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.866 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.866 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.866 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:44.866 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.595552+0000", 2024-04-01T19:35:44.866 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.866 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.866 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.866 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:44.867 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.595554+0000", 2024-04-01T19:35:44.867 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.605e-06 2024-04-01T19:35:44.867 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.867 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.867 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:44.867 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.595562+0000", 2024-04-01T19:35:44.867 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4390000000000003e-06 2024-04-01T19:35:44.867 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.867 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.867 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:44.867 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.596286+0000", 2024-04-01T19:35:44.867 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00072368599999999997 2024-04-01T19:35:44.867 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.867 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.868 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:44.868 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.596299+0000", 2024-04-01T19:35:44.868 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3777999999999999e-05 2024-04-01T19:35:44.868 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.868 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.868 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:44.868 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.600993+0000", 2024-04-01T19:35:44.868 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.004693305 2024-04-01T19:35:44.868 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.868 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.868 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:44.868 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.601134+0000", 2024-04-01T19:35:44.869 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014172800000000001 2024-04-01T19:35:44.869 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.869 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.869 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:35:44.869 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.601283+0000", 2024-04-01T19:35:44.869 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000148608 2024-04-01T19:35:44.869 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.869 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.869 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:44.869 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.620150+0000", 2024-04-01T19:35:44.869 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.018867053000000002 2024-04-01T19:35:44.869 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.869 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.869 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:44.869 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.642029+0000", 2024-04-01T19:35:44.870 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.021879292000000002 2024-04-01T19:35:44.870 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.870 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.870 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:44.870 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.642085+0000", 2024-04-01T19:35:44.870 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5547999999999997e-05 2024-04-01T19:35:44.870 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.870 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.870 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:44.870 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.642145+0000", 2024-04-01T19:35:44.870 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9932000000000001e-05 2024-04-01T19:35:44.870 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.870 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:44.871 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.871 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.871 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.871 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:236636 2.1 2:85594b38:::benchmark_data_smithi188_77607_object69232:head [delete] snapc 0=[] ondisk+write+known_if_redirected e155)", 2024-04-01T19:35:44.871 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:27:34.773335+0000", 2024-04-01T19:35:44.871 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 490.03845743699998, 2024-04-01T19:35:44.871 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.050238772000000001, 2024-04-01T19:35:44.871 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:44.871 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:44.871 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:44.871 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:44.871 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:44.871 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:44.871 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 236636 2024-04-01T19:35:44.872 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.872 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:44.872 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.872 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:44.872 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.773335+0000", 2024-04-01T19:35:44.872 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.872 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.872 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.872 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:44.872 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.773335+0000", 2024-04-01T19:35:44.872 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.872 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.872 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.872 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:44.873 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.773337+0000", 2024-04-01T19:35:44.873 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.599e-06 2024-04-01T19:35:44.873 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.873 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.873 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:44.873 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.773346+0000", 2024-04-01T19:35:44.873 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6060000000000003e-06 2024-04-01T19:35:44.873 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.873 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.873 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:44.873 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.773355+0000", 2024-04-01T19:35:44.873 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.1409999999999994e-06 2024-04-01T19:35:44.873 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.873 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.874 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:44.874 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.773364+0000", 2024-04-01T19:35:44.874 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6309999999999992e-06 2024-04-01T19:35:44.874 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.874 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.874 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:44.874 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.783612+0000", 2024-04-01T19:35:44.874 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010248889000000001 2024-04-01T19:35:44.874 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.874 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.874 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:44.874 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.783757+0000", 2024-04-01T19:35:44.874 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000144909 2024-04-01T19:35:44.875 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.875 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.875 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:35:44.875 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.783894+0000", 2024-04-01T19:35:44.875 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000136847 2024-04-01T19:35:44.875 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.875 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.875 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:44.875 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.798381+0000", 2024-04-01T19:35:44.875 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014486643 2024-04-01T19:35:44.875 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.875 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.875 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:44.876 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.823411+0000", 2024-04-01T19:35:44.876 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.025030196000000001 2024-04-01T19:35:44.876 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.876 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.876 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:44.876 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.823467+0000", 2024-04-01T19:35:44.876 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5779000000000002e-05 2024-04-01T19:35:44.876 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.876 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.876 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:44.876 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.823573+0000", 2024-04-01T19:35:44.876 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000106532 2024-04-01T19:35:44.876 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.876 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:44.877 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.877 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.877 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.877 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:236813 2.e 2:7a3c735d:::benchmark_data_smithi188_77607_object69409:head [delete] snapc 0=[] ondisk+write+known_if_redirected e155)", 2024-04-01T19:35:44.877 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:27:34.946539+0000", 2024-04-01T19:35:44.877 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 489.86525253999997, 2024-04-01T19:35:44.877 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.051207083, 2024-04-01T19:35:44.877 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:44.877 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:44.877 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:44.877 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:44.877 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:44.877 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:44.878 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 236813 2024-04-01T19:35:44.878 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.878 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:44.878 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.878 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:44.878 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.946539+0000", 2024-04-01T19:35:44.878 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.878 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.878 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.878 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:44.878 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.946539+0000", 2024-04-01T19:35:44.878 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.878 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.878 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.879 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:44.879 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.946541+0000", 2024-04-01T19:35:44.879 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4729999999999999e-06 2024-04-01T19:35:44.879 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.879 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.879 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:44.879 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.946546+0000", 2024-04-01T19:35:44.879 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.1309999999999997e-06 2024-04-01T19:35:44.879 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.879 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.879 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:44.879 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.946555+0000", 2024-04-01T19:35:44.879 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8580000000000006e-06 2024-04-01T19:35:44.879 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.880 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.880 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:44.880 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.946561+0000", 2024-04-01T19:35:44.880 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.896e-06 2024-04-01T19:35:44.880 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.880 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.880 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:44.880 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.951112+0000", 2024-04-01T19:35:44.880 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0045516059999999997 2024-04-01T19:35:44.880 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.880 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.880 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:44.880 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.951246+0000", 2024-04-01T19:35:44.880 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000133879 2024-04-01T19:35:44.881 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.881 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.881 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:35:44.881 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.951380+0000", 2024-04-01T19:35:44.881 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000134141 2024-04-01T19:35:44.881 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.881 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.881 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:44.881 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.967665+0000", 2024-04-01T19:35:44.881 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.016284653 2024-04-01T19:35:44.881 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.881 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.881 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:44.881 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.997615+0000", 2024-04-01T19:35:44.882 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.029949435999999999 2024-04-01T19:35:44.882 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.882 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.882 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:44.882 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.997673+0000", 2024-04-01T19:35:44.882 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8406999999999998e-05 2024-04-01T19:35:44.882 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.882 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.882 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:44.882 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:27:34.997747+0000", 2024-04-01T19:35:44.882 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3603000000000007e-05 2024-04-01T19:35:44.882 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.882 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:44.883 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.883 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.883 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.883 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:272244 2.e 2:79b429a3:::benchmark_data_smithi188_77607_object104840:head [delete] snapc 0=[] ondisk+write+known_if_redirected e176)", 2024-04-01T19:35:44.883 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:45.415475+0000", 2024-04-01T19:35:44.883 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 419.396316555, 2024-04-01T19:35:44.883 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.050565594999999998, 2024-04-01T19:35:44.883 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:44.883 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:44.883 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:44.883 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:44.883 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:44.883 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:44.883 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 272244 2024-04-01T19:35:44.884 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.884 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:44.884 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.884 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:44.884 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.415475+0000", 2024-04-01T19:35:44.884 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.884 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.884 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.884 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:44.884 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.415475+0000", 2024-04-01T19:35:44.884 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.884 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.884 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.885 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:44.885 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.415478+0000", 2024-04-01T19:35:44.885 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1299999999999999e-06 2024-04-01T19:35:44.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.885 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.885 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:44.885 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.415483+0000", 2024-04-01T19:35:44.885 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8000000000000004e-06 2024-04-01T19:35:44.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.885 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.885 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:44.885 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.415496+0000", 2024-04-01T19:35:44.885 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2471e-05 2024-04-01T19:35:44.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.886 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.886 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:44.886 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.415504+0000", 2024-04-01T19:35:44.886 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2870000000000004e-06 2024-04-01T19:35:44.886 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.886 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.886 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:44.886 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.424192+0000", 2024-04-01T19:35:44.886 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0086876260000000004 2024-04-01T19:35:44.886 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.886 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.886 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:44.886 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.424334+0000", 2024-04-01T19:35:44.887 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014255 2024-04-01T19:35:44.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.887 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.887 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:35:44.887 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.424457+0000", 2024-04-01T19:35:44.887 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000122392 2024-04-01T19:35:44.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.887 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.887 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:44.887 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.429468+0000", 2024-04-01T19:35:44.887 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0050116570000000001 2024-04-01T19:35:44.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.887 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.888 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:44.888 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.465945+0000", 2024-04-01T19:35:44.888 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.036476462000000001 2024-04-01T19:35:44.888 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.888 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.888 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:44.888 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.465997+0000", 2024-04-01T19:35:44.888 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2332e-05 2024-04-01T19:35:44.888 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.888 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.888 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:44.888 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.466041+0000", 2024-04-01T19:35:44.888 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.3887999999999997e-05 2024-04-01T19:35:44.889 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.889 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:44.889 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.889 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.889 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.889 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:272290 2.e 2:761d9cf9:::benchmark_data_smithi188_77607_object104886:head [delete] snapc 0=[] ondisk+write+known_if_redirected e176)", 2024-04-01T19:35:44.889 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:28:45.468074+0000", 2024-04-01T19:35:44.889 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 419.343717841, 2024-04-01T19:35:44.889 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.050318532999999999, 2024-04-01T19:35:44.889 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:44.889 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:44.889 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:44.889 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:44.889 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:44.889 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:44.890 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 272290 2024-04-01T19:35:44.890 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.890 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:44.890 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.890 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:44.890 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.468074+0000", 2024-04-01T19:35:44.890 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.890 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.890 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.890 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:44.890 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.468074+0000", 2024-04-01T19:35:44.890 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.890 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.890 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.891 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:44.891 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.468076+0000", 2024-04-01T19:35:44.891 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.466e-06 2024-04-01T19:35:44.891 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.891 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.891 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:44.891 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.468082+0000", 2024-04-01T19:35:44.891 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8129999999999998e-06 2024-04-01T19:35:44.891 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.891 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.891 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:44.891 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.468097+0000", 2024-04-01T19:35:44.891 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4507e-05 2024-04-01T19:35:44.891 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.892 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.892 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:44.892 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.468106+0000", 2024-04-01T19:35:44.892 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.4579999999999999e-06 2024-04-01T19:35:44.892 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.892 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.892 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:44.892 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.477321+0000", 2024-04-01T19:35:44.892 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0092145739999999997 2024-04-01T19:35:44.892 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.892 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.892 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:44.892 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.477450+0000", 2024-04-01T19:35:44.892 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012936800000000001 2024-04-01T19:35:44.893 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.893 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.893 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:35:44.893 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.477582+0000", 2024-04-01T19:35:44.893 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000131478 2024-04-01T19:35:44.893 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.893 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.893 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:44.893 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.493554+0000", 2024-04-01T19:35:44.893 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.015972058000000001 2024-04-01T19:35:44.893 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.893 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.893 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:44.894 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.518304+0000", 2024-04-01T19:35:44.894 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.024750488000000001 2024-04-01T19:35:44.894 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.894 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.894 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:44.894 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.518354+0000", 2024-04-01T19:35:44.894 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9367999999999999e-05 2024-04-01T19:35:44.894 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.894 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.894 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:44.894 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:28:45.518393+0000", 2024-04-01T19:35:44.894 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.8955000000000002e-05 2024-04-01T19:35:44.894 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.894 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:44.895 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.895 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.895 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.895 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:300312 2.e 2:716ae978:::benchmark_data_smithi188_77607_object132908:head [delete] snapc 0=[] ondisk+write+known_if_redirected e178)", 2024-04-01T19:35:44.895 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:29:08.401178+0000", 2024-04-01T19:35:44.895 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 396.410614119, 2024-04-01T19:35:44.895 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.049220369, 2024-04-01T19:35:44.895 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:44.895 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:44.895 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:44.895 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:44.895 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:44.895 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:44.895 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 300312 2024-04-01T19:35:44.896 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.896 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:44.896 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.896 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:44.896 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.401178+0000", 2024-04-01T19:35:44.896 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.896 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.896 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.896 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:44.896 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.401178+0000", 2024-04-01T19:35:44.896 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.896 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.896 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.896 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:44.897 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.401179+0000", 2024-04-01T19:35:44.897 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.8000000000000005e-07 2024-04-01T19:35:44.897 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.897 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.897 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:44.897 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.401182+0000", 2024-04-01T19:35:44.897 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.4300000000000002e-06 2024-04-01T19:35:44.897 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.897 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.897 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:44.897 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.401188+0000", 2024-04-01T19:35:44.897 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1099999999999999e-06 2024-04-01T19:35:44.897 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.897 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.898 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:44.898 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.401194+0000", 2024-04-01T19:35:44.898 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.524e-06 2024-04-01T19:35:44.898 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.898 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.898 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:44.898 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.406380+0000", 2024-04-01T19:35:44.898 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0051861520000000003 2024-04-01T19:35:44.898 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.898 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.898 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:44.898 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.406471+0000", 2024-04-01T19:35:44.898 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.0725999999999998e-05 2024-04-01T19:35:44.898 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.899 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.899 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:35:44.899 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.406636+0000", 2024-04-01T19:35:44.899 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000165661 2024-04-01T19:35:44.899 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.899 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.899 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:44.899 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.419064+0000", 2024-04-01T19:35:44.899 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.012427334 2024-04-01T19:35:44.899 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.899 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.899 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:44.899 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.450309+0000", 2024-04-01T19:35:44.900 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.031245430000000001 2024-04-01T19:35:44.900 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.900 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.900 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:44.900 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.450360+0000", 2024-04-01T19:35:44.900 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.1180999999999997e-05 2024-04-01T19:35:44.900 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.900 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.900 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:44.900 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:08.450398+0000", 2024-04-01T19:35:44.900 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.8040999999999997e-05 2024-04-01T19:35:44.900 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.900 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:44.900 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.901 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.901 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.901 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:301225 2.e 2:7b326bf1:::benchmark_data_smithi188_77607_object133821:head [delete] snapc 0=[] ondisk+write+known_if_redirected e178)", 2024-04-01T19:35:44.901 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:29:09.267563+0000", 2024-04-01T19:35:44.901 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 395.544228831, 2024-04-01T19:35:44.901 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.048005921999999999, 2024-04-01T19:35:44.901 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:44.901 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:44.901 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:44.901 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:44.901 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:44.901 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:44.901 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 301225 2024-04-01T19:35:44.901 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.902 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:44.902 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.902 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:44.902 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.267563+0000", 2024-04-01T19:35:44.902 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.902 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.902 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.902 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:44.902 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.267563+0000", 2024-04-01T19:35:44.902 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.902 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.902 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.902 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:44.902 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.267565+0000", 2024-04-01T19:35:44.903 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.852e-06 2024-04-01T19:35:44.903 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.903 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.903 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:44.903 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.267571+0000", 2024-04-01T19:35:44.903 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9900000000000002e-06 2024-04-01T19:35:44.903 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.903 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.903 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:44.903 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.267579+0000", 2024-04-01T19:35:44.903 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9810000000000003e-06 2024-04-01T19:35:44.903 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.903 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.903 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:44.904 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.267585+0000", 2024-04-01T19:35:44.904 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8769999999999998e-06 2024-04-01T19:35:44.904 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.904 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.904 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:44.904 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.277378+0000", 2024-04-01T19:35:44.904 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0097929509999999994 2024-04-01T19:35:44.904 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.904 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.904 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:44.904 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.277529+0000", 2024-04-01T19:35:44.904 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015084399999999999 2024-04-01T19:35:44.904 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.905 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.905 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:35:44.905 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.277659+0000", 2024-04-01T19:35:44.905 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000130104 2024-04-01T19:35:44.905 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.905 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.905 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:44.905 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.292550+0000", 2024-04-01T19:35:44.905 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014891570999999999 2024-04-01T19:35:44.905 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.905 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.905 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:44.905 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.315456+0000", 2024-04-01T19:35:44.905 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.022905966 2024-04-01T19:35:44.906 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.906 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.906 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:44.906 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.315518+0000", 2024-04-01T19:35:44.906 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1946999999999995e-05 2024-04-01T19:35:44.906 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.906 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.906 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:44.906 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.315569+0000", 2024-04-01T19:35:44.906 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0838999999999999e-05 2024-04-01T19:35:44.906 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.906 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:44.906 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.907 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.907 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.907 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:301805 2.e 2:72d0a49b:::benchmark_data_smithi188_77607_object134401:head [delete] snapc 0=[] ondisk+write+known_if_redirected e178)", 2024-04-01T19:35:44.907 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:29:09.764063+0000", 2024-04-01T19:35:44.907 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 395.04772890499999, 2024-04-01T19:35:44.907 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.048788630999999999, 2024-04-01T19:35:44.907 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:44.907 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:44.907 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:44.907 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:44.907 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:44.907 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:44.907 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 301805 2024-04-01T19:35:44.907 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.907 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:44.908 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.908 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:44.908 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.764063+0000", 2024-04-01T19:35:44.908 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.908 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.908 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.908 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:44.908 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.764063+0000", 2024-04-01T19:35:44.908 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.908 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.908 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.908 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:44.908 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.764064+0000", 2024-04-01T19:35:44.908 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.7900000000000007e-07 2024-04-01T19:35:44.909 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.909 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.909 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:44.909 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.764068+0000", 2024-04-01T19:35:44.909 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7799999999999998e-06 2024-04-01T19:35:44.909 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.909 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.909 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:44.909 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.764075+0000", 2024-04-01T19:35:44.909 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4449999999999999e-06 2024-04-01T19:35:44.909 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.909 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.909 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:44.910 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.764082+0000", 2024-04-01T19:35:44.910 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2960000000000004e-06 2024-04-01T19:35:44.910 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.910 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.910 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:44.910 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.773422+0000", 2024-04-01T19:35:44.910 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0093401969999999997 2024-04-01T19:35:44.910 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.910 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.910 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:44.910 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.773573+0000", 2024-04-01T19:35:44.910 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015120199999999999 2024-04-01T19:35:44.910 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.911 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.911 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:35:44.911 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.773713+0000", 2024-04-01T19:35:44.911 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000139865 2024-04-01T19:35:44.911 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.911 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.911 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:44.911 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.786903+0000", 2024-04-01T19:35:44.911 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.013190584 2024-04-01T19:35:44.911 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.911 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.911 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:44.911 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.812750+0000", 2024-04-01T19:35:44.911 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.025846583999999999 2024-04-01T19:35:44.912 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.912 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.912 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:44.912 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.812802+0000", 2024-04-01T19:35:44.912 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2459e-05 2024-04-01T19:35:44.912 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.912 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.912 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:44.912 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:09.812852+0000", 2024-04-01T19:35:44.912 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9240000000000003e-05 2024-04-01T19:35:44.912 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.912 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:44.912 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.912 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.913 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.913 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:306726 2.e 2:79113c24:::benchmark_data_smithi188_77607_object139322:head [delete] snapc 0=[] ondisk+write+known_if_redirected e178)", 2024-04-01T19:35:44.913 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:29:13.913545+0000", 2024-04-01T19:35:44.913 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 390.89824709999999, 2024-04-01T19:35:44.913 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.050671905000000003, 2024-04-01T19:35:44.913 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:44.913 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:44.913 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:44.913 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:44.913 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:44.913 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:44.913 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 306726 2024-04-01T19:35:44.913 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.914 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:44.914 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.914 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:44.914 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.913545+0000", 2024-04-01T19:35:44.914 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.914 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.914 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.914 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:44.914 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.913545+0000", 2024-04-01T19:35:44.914 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.914 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.914 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.914 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:44.915 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.913547+0000", 2024-04-01T19:35:44.915 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0499999999999999e-06 2024-04-01T19:35:44.915 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.915 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.915 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:44.915 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.913553+0000", 2024-04-01T19:35:44.915 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3430000000000001e-06 2024-04-01T19:35:44.915 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.915 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.915 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:44.915 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.913568+0000", 2024-04-01T19:35:44.915 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5203e-05 2024-04-01T19:35:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.913577+0000", 2024-04-01T19:35:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5469999999999997e-06 2024-04-01T19:35:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.919575+0000", 2024-04-01T19:35:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0059976980000000001 2024-04-01T19:35:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:44.916 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.919903+0000", 2024-04-01T19:35:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00032790500000000003 2024-04-01T19:35:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:35:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.920023+0000", 2024-04-01T19:35:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000120109 2024-04-01T19:35:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.951401+0000", 2024-04-01T19:35:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.031378389 2024-04-01T19:35:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.917 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.918 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:44.918 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.964118+0000", 2024-04-01T19:35:44.918 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.012716732 2024-04-01T19:35:44.918 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.918 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.918 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:44.918 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.964167+0000", 2024-04-01T19:35:44.918 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9450999999999998e-05 2024-04-01T19:35:44.918 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.918 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.918 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:44.918 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:13.964217+0000", 2024-04-01T19:35:44.918 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9478000000000003e-05 2024-04-01T19:35:44.918 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:309229 2.e 2:7489af3c:::benchmark_data_smithi188_77607_object141825:head [delete] snapc 0=[] ondisk+write+known_if_redirected e178)", 2024-04-01T19:35:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:29:16.042337+0000", 2024-04-01T19:35:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 388.76945520499999, 2024-04-01T19:35:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.046542255999999997, 2024-04-01T19:35:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:44.919 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 309229 2024-04-01T19:35:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.042337+0000", 2024-04-01T19:35:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.042337+0000", 2024-04-01T19:35:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.042338+0000", 2024-04-01T19:35:44.920 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2669999999999999e-06 2024-04-01T19:35:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.042342+0000", 2024-04-01T19:35:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1540000000000004e-06 2024-04-01T19:35:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.042350+0000", 2024-04-01T19:35:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.1559999999999995e-06 2024-04-01T19:35:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:44.921 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.042356+0000", 2024-04-01T19:35:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2920000000000003e-06 2024-04-01T19:35:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.045688+0000", 2024-04-01T19:35:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0033320670000000002 2024-04-01T19:35:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.045795+0000", 2024-04-01T19:35:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000107699 2024-04-01T19:35:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.922 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:35:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.045880+0000", 2024-04-01T19:35:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4809999999999996e-05 2024-04-01T19:35:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.056662+0000", 2024-04-01T19:35:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010782112 2024-04-01T19:35:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.088778+0000", 2024-04-01T19:35:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.032115519000000002 2024-04-01T19:35:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.923 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.924 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:44.924 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.088835+0000", 2024-04-01T19:35:44.924 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6718999999999997e-05 2024-04-01T19:35:44.924 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.924 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.924 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:44.924 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:16.088879+0000", 2024-04-01T19:35:44.924 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4461e-05 2024-04-01T19:35:44.924 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.924 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:44.924 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.924 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.924 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.924 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.24751.0:334314 2.e 2:7a4c3578:::benchmark_data_smithi188_77607_object166910:head [delete] snapc 0=[] ondisk+write+known_if_redirected e184)", 2024-04-01T19:35:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:29:36.442582+0000", 2024-04-01T19:35:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 368.36920972199999, 2024-04-01T19:35:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.051087360999999998, 2024-04-01T19:35:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:35:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:35:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:35:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:35:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.24751", 2024-04-01T19:35:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:35:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 334314 2024-04-01T19:35:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:35:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.925 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:35:44.926 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.442582+0000", 2024-04-01T19:35:44.926 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.926 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.926 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.926 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:35:44.926 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.442582+0000", 2024-04-01T19:35:44.926 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:35:44.926 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.926 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.926 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:35:44.926 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.442583+0000", 2024-04-01T19:35:44.926 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4700000000000001e-07 2024-04-01T19:35:44.926 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.927 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.927 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:35:44.927 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.442586+0000", 2024-04-01T19:35:44.927 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.8839999999999998e-06 2024-04-01T19:35:44.927 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.927 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.927 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:35:44.927 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.442591+0000", 2024-04-01T19:35:44.927 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2789999999999998e-06 2024-04-01T19:35:44.927 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.927 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.927 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:35:44.927 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.442596+0000", 2024-04-01T19:35:44.928 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0320000000000003e-06 2024-04-01T19:35:44.928 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.928 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.928 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:35:44.928 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.453743+0000", 2024-04-01T19:35:44.928 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.011147186999999999 2024-04-01T19:35:44.928 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.928 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.928 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:35:44.928 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.453814+0000", 2024-04-01T19:35:44.928 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0879999999999999e-05 2024-04-01T19:35:44.928 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.928 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.928 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 3", 2024-04-01T19:35:44.929 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.453942+0000", 2024-04-01T19:35:44.929 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012826800000000001 2024-04-01T19:35:44.929 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.929 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.929 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:35:44.929 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.467551+0000", 2024-04-01T19:35:44.929 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.013608128000000001 2024-04-01T19:35:44.929 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.929 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.929 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:35:44.929 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.493550+0000", 2024-04-01T19:35:44.929 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.025998996999999999 2024-04-01T19:35:44.929 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.929 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.929 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:35:44.930 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.493609+0000", 2024-04-01T19:35:44.930 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9737000000000001e-05 2024-04-01T19:35:44.930 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:35:44.930 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:35:44.930 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:35:44.930 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:29:36.493670+0000", 2024-04-01T19:35:44.930 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0322000000000003e-05 2024-04-01T19:35:44.930 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.930 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:44.930 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.930 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:35:44.930 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:35:44.930 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:35:44.931 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:35:44.959 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:45.157 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:35:45.164 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:45.164 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:35:45.265 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:35:45.273 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:35:45.295 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:45.315 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:35:45.317 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:45.317 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:35:45.418 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:35:45.446 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:45.465 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:35:45.467 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:45.467 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:35:45.511 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:35:45 smithi062 bash[107830]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6 2024-04-01T19:35:45.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:45 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:35:45.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:45 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:35:45.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:45 smithi062 ceph-mon[44211]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-01T19:35:45.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:45 smithi062 ceph-mon[44211]: osdmap e300: 12 total, 11 up, 12 in 2024-04-01T19:35:45.568 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:35:45.592 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:45 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:35:45.592 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:45 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:35:45.592 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:45 smithi188 ceph-mon[43939]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-01T19:35:45.592 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:45 smithi188 ceph-mon[43939]: osdmap e300: 12 total, 11 up, 12 in 2024-04-01T19:35:45.594 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:45 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:35:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:45 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:35:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:45 smithi022 ceph-mon[39439]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-01T19:35:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:45 smithi022 ceph-mon[39439]: osdmap e300: 12 total, 11 up, 12 in 2024-04-01T19:35:45.612 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:35:45.614 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:45.615 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:35:45.715 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:35:45.747 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:45.772 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:35:45.774 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:45.774 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:35:45.875 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:35:45.904 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:46.003 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:35:46.006 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:46.007 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:35:46.108 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:35:46.139 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:46.159 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:35:46.161 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:46.162 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:35:46.263 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:35:46.290 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:46.580 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:46 smithi022 ceph-mon[39439]: pgmap v867: 17 pgs: 1 peering, 1 stale+active+clean, 15 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s wr, 1.40k op/s 2024-04-01T19:35:46.580 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:46 smithi022 ceph-mon[39439]: osdmap e301: 12 total, 11 up, 12 in 2024-04-01T19:35:46.613 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_ops_in_flight 2024-04-01T19:35:46.613 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:35:46.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:46 smithi188 ceph-mon[43939]: pgmap v867: 17 pgs: 1 peering, 1 stale+active+clean, 15 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s wr, 1.40k op/s 2024-04-01T19:35:46.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:46 smithi188 ceph-mon[43939]: osdmap e301: 12 total, 11 up, 12 in 2024-04-01T19:35:46.638 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:35:46.641 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:46.642 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:35:46.702 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:46 smithi062 ceph-mon[44211]: pgmap v867: 17 pgs: 1 peering, 1 stale+active+clean, 15 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s wr, 1.40k op/s 2024-04-01T19:35:46.703 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:46 smithi062 ceph-mon[44211]: osdmap e301: 12 total, 11 up, 12 in 2024-04-01T19:35:46.742 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:35:46.770 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:46.919 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:35:46.922 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:46.923 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:35:47.024 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:35:47.055 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.6.service' 2024-04-01T19:35:47.056 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:47.077 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:35:47.079 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:47.080 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:35:47.107 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T19:35:47.107 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-04-01T19:35:47.108 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd down 6 2024-04-01T19:35:47.181 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:35:47.209 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:47.346 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:35:47.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:47 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/367526930' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:35:47.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:47 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:35:47.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:47 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:35:47.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:47 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/367526930' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:35:47.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:47 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:35:47.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:47 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:35:47.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:47 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/367526930' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:35:47.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:47 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:35:47.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:47 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:35:48.187 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:35:48.189 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:48.189 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:35:48.196 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:35:48.290 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:35:48.322 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:48.345 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:35:48.347 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:48.348 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:35:48.449 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:35:48.468 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:48 smithi022 ceph-mon[39439]: pgmap v869: 17 pgs: 1 peering, 1 stale+active+clean, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:35:48.469 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:48 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:35:48.469 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:48 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/367526930' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:35:48.469 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:48 smithi022 ceph-mon[39439]: osdmap e302: 12 total, 11 up, 12 in 2024-04-01T19:35:48.485 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:48.509 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:35:48.512 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:48.512 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:35:48.613 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:35:48.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:48 smithi188 ceph-mon[43939]: pgmap v869: 17 pgs: 1 peering, 1 stale+active+clean, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:35:48.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:48 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:35:48.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:48 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/367526930' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:35:48.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:48 smithi188 ceph-mon[43939]: osdmap e302: 12 total, 11 up, 12 in 2024-04-01T19:35:48.644 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:48.665 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:35:48.667 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:48.667 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:35:48.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:48 smithi062 ceph-mon[44211]: pgmap v869: 17 pgs: 1 peering, 1 stale+active+clean, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:35:48.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:48 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:35:48.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:48 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/367526930' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:35:48.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:48 smithi062 ceph-mon[44211]: osdmap e302: 12 total, 11 up, 12 in 2024-04-01T19:35:48.768 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:35:48.798 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:48.818 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:35:48.821 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:48.822 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:35:48.923 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:35:48.955 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:49.329 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:35:49.748 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:49 smithi022 ceph-mon[39439]: Health check failed: Degraded data redundancy: 9937/321970 objects degraded (3.086%), 1 pg degraded (PG_DEGRADED) 2024-04-01T19:35:49.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:49 smithi062 ceph-mon[44211]: Health check failed: Degraded data redundancy: 9937/321970 objects degraded (3.086%), 1 pg degraded (PG_DEGRADED) 2024-04-01T19:35:49.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:49 smithi188 ceph-mon[43939]: Health check failed: Degraded data redundancy: 9937/321970 objects degraded (3.086%), 1 pg degraded (PG_DEGRADED) 2024-04-01T19:35:50.176 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:35:50.561 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:35:50.563 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:50.564 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:35:50.571 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:35:50.571 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:35:50.665 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:35:50.695 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:50 smithi188 ceph-mon[43939]: pgmap v871: 17 pgs: 1 undersized+degraded+peered, 1 peering, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 792 op/s; 9937/321970 objects degraded (3.086%) 2024-04-01T19:35:50.697 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:50.699 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:50 smithi022 ceph-mon[39439]: pgmap v871: 17 pgs: 1 undersized+degraded+peered, 1 peering, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 792 op/s; 9937/321970 objects degraded (3.086%) 2024-04-01T19:35:50.717 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:35:50.717 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:35:50.717 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:35:50.717 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:35:50.717 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:35:50.717 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:35:50.717 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:35:50.717 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:35:50.717 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:35:50.717 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:35:50.718 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:35:50.718 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:35:50.718 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:35:50.718 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:35:50.718 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:35:50.718 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:35:50.718 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:35:50.718 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:35:50.718 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:35:50.718 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:35:50.718 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:35:50.719 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:35:50.719 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:35:50.719 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:35:50.721 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:50.722 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:35:50.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:50 smithi062 ceph-mon[44211]: pgmap v871: 17 pgs: 1 undersized+degraded+peered, 1 peering, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 792 op/s; 9937/321970 objects degraded (3.086%) 2024-04-01T19:35:50.823 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:35:50.852 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:50.872 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:35:50.874 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:50.875 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:35:50.976 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:35:51.005 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:51.025 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:35:51.028 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:51.028 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:35:51.129 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:35:51.164 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:51.186 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:35:51.189 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:51.189 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:35:51.290 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:35:51.321 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:51.445 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:35:51.448 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:51.448 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:35:51.469 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_blocked_ops 2024-04-01T19:35:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:51 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3844083767' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:35:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.549 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:35:51.583 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:51.604 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:35:51.607 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:51.607 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:35:51.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:51 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3844083767' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:35:51.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.708 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:35:51.737 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:51.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:51 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3844083767' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:35:51.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:51.935 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:35:51.937 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:51.938 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:35:52.039 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:35:52.072 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:52.093 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:35:52.097 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:52.097 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:35:52.198 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:35:52.227 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:52.744 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:52.745 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:52 smithi022 ceph-mon[39439]: pgmap v872: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 674 op/s; 20044/321960 objects degraded (6.226%) 2024-04-01T19:35:52.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:52.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:52 smithi062 ceph-mon[44211]: pgmap v872: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 674 op/s; 20044/321960 objects degraded (6.226%) 2024-04-01T19:35:52.779 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:35:52.780 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:35:52.780 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:35:52.781 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:35:52.782 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:52.783 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:35:52.802 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:35:52.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:35:52.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:52 smithi188 ceph-mon[43939]: pgmap v872: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 674 op/s; 20044/321960 objects degraded (6.226%) 2024-04-01T19:35:52.883 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:35:52.917 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:52.939 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:35:52.942 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:52.943 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:35:53.043 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:35:53.074 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:53.094 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:35:53.097 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:53.098 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:35:53.199 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:35:53.227 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:53.576 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:35:53.578 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:53.579 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:35:53.680 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:35:53.713 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:53.735 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:35:53.738 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:53.739 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:35:53.840 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:35:53.873 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:53.894 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:35:53.897 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:53.898 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:35:53.999 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:35:54.033 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:54.262 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:35:54.265 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:54.265 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:35:54.366 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:35:54.396 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:54.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:54 smithi022 ceph-mon[39439]: pgmap v873: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 297 op/s; 20044/321960 objects degraded (6.226%) 2024-04-01T19:35:54.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:54 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:35:54.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:54 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:35:54.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:54 smithi062 ceph-mon[44211]: pgmap v873: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 297 op/s; 20044/321960 objects degraded (6.226%) 2024-04-01T19:35:54.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:54 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:35:54.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:54 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:35:54.781 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:35:54.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:54 smithi188 ceph-mon[43939]: pgmap v873: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 297 op/s; 20044/321960 objects degraded (6.226%) 2024-04-01T19:35:54.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:54 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:35:54.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:54 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:35:55.649 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:35:55.652 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:55.652 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:35:55.741 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:55 smithi022 ceph-mon[39439]: osdmap e303: 12 total, 11 up, 12 in 2024-04-01T19:35:55.742 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:55 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 20044/321960 objects degraded (6.226%), 2 pgs degraded (PG_DEGRADED) 2024-04-01T19:35:55.753 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:35:55.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:55 smithi062 ceph-mon[44211]: osdmap e303: 12 total, 11 up, 12 in 2024-04-01T19:35:55.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:55 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 20044/321960 objects degraded (6.226%), 2 pgs degraded (PG_DEGRADED) 2024-04-01T19:35:55.786 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:55.808 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:35:55.811 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:55.811 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:35:55.839 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6 is already down. 2024-04-01T19:35:55.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:55 smithi188 ceph-mon[43939]: osdmap e303: 12 total, 11 up, 12 in 2024-04-01T19:35:55.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:55 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 20044/321960 objects degraded (6.226%), 2 pgs degraded (PG_DEGRADED) 2024-04-01T19:35:55.913 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:35:55.942 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:56.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:55 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[39416]: 2024-04-01T19:35:55.837+0000 7fd025a9f700 -1 mon.a@0(leader).osd e303 definitely_dead 0 2024-04-01T19:35:56.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:56 smithi022 ceph-mon[39439]: pgmap v875: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 36 op/s; 20044/321960 objects degraded (6.226%) 2024-04-01T19:35:56.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:56 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4017537871' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["6"]}]: dispatch 2024-04-01T19:35:56.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:56 smithi062 ceph-mon[44211]: pgmap v875: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 36 op/s; 20044/321960 objects degraded (6.226%) 2024-04-01T19:35:56.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:56 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4017537871' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["6"]}]: dispatch 2024-04-01T19:35:56.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:56 smithi188 ceph-mon[43939]: pgmap v875: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 36 op/s; 20044/321960 objects degraded (6.226%) 2024-04-01T19:35:56.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:56 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4017537871' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["6"]}]: dispatch 2024-04-01T19:35:56.992 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:35:56.995 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:56.995 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:35:57.038 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:35:57.038 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:35:57.097 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:35:57.129 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:57.277 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:35:57.279 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:57.280 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:35:57.381 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:35:57.413 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:57.434 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:35:57.436 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:57.436 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:35:57.537 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:35:57.568 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:57.588 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:35:57.591 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:57.591 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:35:57.653 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:35:57.692 INFO:tasks.thrashosds.thrasher:Removing osd 6, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7, 9, 10, 11, 8] 2024-04-01T19:35:57.692 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd out 6 2024-04-01T19:35:57.693 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:35:57.726 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:57.749 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:35:57.752 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:57.752 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:35:57.853 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:35:57.887 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:57.908 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:35:57.910 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:57.911 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:35:58.012 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:35:58.039 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:58.187 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:35:58.191 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:35:58.191 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:35:58.292 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:35:58.322 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:35:58.425 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:35:58.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:58 smithi022 ceph-mon[39439]: pgmap v876: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 13 op/s; 20044/321960 objects degraded (6.226%) 2024-04-01T19:35:58.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:58 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2734242106' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:35:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:58 smithi062 ceph-mon[44211]: pgmap v876: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 13 op/s; 20044/321960 objects degraded (6.226%) 2024-04-01T19:35:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:58 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2734242106' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:35:58.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:58 smithi188 ceph-mon[43939]: pgmap v876: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 13 op/s; 20044/321960 objects degraded (6.226%) 2024-04-01T19:35:58.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:58 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2734242106' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:35:58.911 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_historic_ops 2024-04-01T19:35:59.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:59 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:35:59.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:59 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2734242106' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:35:59.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:35:59 smithi022 ceph-mon[39439]: osdmap e304: 12 total, 11 up, 12 in 2024-04-01T19:35:59.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:59 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:35:59.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:59 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2734242106' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:35:59.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:35:59 smithi062 ceph-mon[44211]: osdmap e304: 12 total, 11 up, 12 in 2024-04-01T19:35:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:59 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:35:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:59 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2734242106' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:35:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:35:59 smithi188 ceph-mon[43939]: osdmap e304: 12 total, 11 up, 12 in 2024-04-01T19:36:00.073 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:36:00.076 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:00.077 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:36:00.178 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:36:00.212 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:00.234 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:36:00.237 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:00.237 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:36:00.338 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:36:00.369 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:00.390 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:36:00.393 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:00.393 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:36:00.494 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:36:00.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:00 smithi062 ceph-mon[44211]: pgmap v878: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20044/321960 objects degraded (6.226%) 2024-04-01T19:36:00.524 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:00.544 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:36:00.547 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:00.547 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:36:00.648 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:36:00.678 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:00 smithi022 ceph-mon[39439]: pgmap v878: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20044/321960 objects degraded (6.226%) 2024-04-01T19:36:00.681 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:00.721 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:36:00.733 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:00.733 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:36:00.834 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:36:00.864 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:00.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:00 smithi188 ceph-mon[43939]: pgmap v878: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20044/321960 objects degraded (6.226%) 2024-04-01T19:36:00.892 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:36:00.895 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:00.895 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:36:00.996 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:36:01.004 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:36:01.004 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:36:01.035 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:01.040 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:36:01.062 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:36:01.081 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:36:01.100 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:36:01.120 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:36:01.140 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:36:01.163 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:36:01.186 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:36:01.204 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:36:01.225 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:36:01.245 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:36:01.245 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:36:01.246 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:36:01.246 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:36:01.246 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:36:01.246 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:36:01.246 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:36:01.246 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:36:01.246 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:36:01.246 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:36:01.246 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:36:01.246 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:36:01.246 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:36:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:01 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2991354085' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:36:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:01.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:01 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2991354085' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:36:01.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:01.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:01.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:01.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:01.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:01 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2991354085' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:36:01.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:01.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:01.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:01.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:02.497 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:36:02.587 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:36:02.590 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:02.590 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:36:02.691 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:36:02.721 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:02 smithi188 ceph-mon[43939]: pgmap v879: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20044/321960 objects degraded (6.226%) 2024-04-01T19:36:02.721 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:02.721 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:02.722 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:02.722 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:02.722 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:02.722 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:02.722 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:02.723 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:02.744 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:36:02.746 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:02.747 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:36:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:02 smithi062 ceph-mon[44211]: pgmap v879: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20044/321960 objects degraded (6.226%) 2024-04-01T19:36:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:02.848 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:36:02.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:02 smithi022 ceph-mon[39439]: pgmap v879: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20044/321960 objects degraded (6.226%) 2024-04-01T19:36:02.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:02.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:02.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:02.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:02.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:02.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:02.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:02.881 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:02.903 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:36:02.906 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:02.907 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:36:03.008 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:36:03.041 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:03.062 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:36:03.065 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:03.066 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:36:03.166 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:36:03.197 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:03.218 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:36:03.220 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:03.221 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:36:03.322 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:36:03.353 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:03.375 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:36:03.377 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:03.378 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:36:03.479 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:36:03.510 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:03.869 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:36:03.871 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:03.871 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:36:03.972 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:36:03.999 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:36:03.999 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 20, 2024-04-01T19:36:04.000 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 600, 2024-04-01T19:36:04.000 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:36:04.000 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.000 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:148823 3.7 3:ee362c40:::benchmark_data_smithi188_92122_object148822:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e220)", 2024-04-01T19:36:04.000 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:15.680681+0000", 2024-04-01T19:36:04.000 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 288.318503561, 2024-04-01T19:36:04.000 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.23053715599999999, 2024-04-01T19:36:04.000 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:36:04.000 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:36:04.000 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:04.000 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:36:04.000 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:36:04.000 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:36:04.000 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 148823 2024-04-01T19:36:04.001 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.001 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:36:04.001 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.001 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:36:04.001 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680681+0000", 2024-04-01T19:36:04.001 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.001 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.001 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.001 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:36:04.001 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680681+0000", 2024-04-01T19:36:04.001 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.001 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.001 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.002 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:36:04.002 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680682+0000", 2024-04-01T19:36:04.002 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.015e-06 2024-04-01T19:36:04.002 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.002 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.002 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:36:04.002 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680720+0000", 2024-04-01T19:36:04.002 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7586999999999998e-05 2024-04-01T19:36:04.002 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.002 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.002 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:36:04.002 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680728+0000", 2024-04-01T19:36:04.003 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6660000000000008e-06 2024-04-01T19:36:04.003 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.003 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.003 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:36:04.003 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680734+0000", 2024-04-01T19:36:04.003 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2380000000000002e-06 2024-04-01T19:36:04.003 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.003 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.003 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:36:04.003 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680831+0000", 2024-04-01T19:36:04.003 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.6881999999999998e-05 2024-04-01T19:36:04.003 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.003 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.003 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:36:04.004 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680949+0000", 2024-04-01T19:36:04.004 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00011820999999999999 2024-04-01T19:36:04.004 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.004 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.004 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 11", 2024-04-01T19:36:04.004 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.681080+0000", 2024-04-01T19:36:04.004 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013095399999999999 2024-04-01T19:36:04.004 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.004 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.005 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:36:04.005 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.689897+0000", 2024-04-01T19:36:04.005 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0088173039999999998 2024-04-01T19:36:04.005 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.005 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.005 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:04.005 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.911098+0000", 2024-04-01T19:36:04.005 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.221200906 2024-04-01T19:36:04.005 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.005 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.005 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:36:04.006 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.911162+0000", 2024-04-01T19:36:04.006 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4022000000000005e-05 2024-04-01T19:36:04.006 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.006 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.006 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:36:04.006 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.911219+0000", 2024-04-01T19:36:04.006 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6372000000000002e-05 2024-04-01T19:36:04.006 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.006 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:36:04.006 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.006 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.006 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:148825 3.7 3:e8f36808:::benchmark_data_smithi188_92122_object148824:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e220)", 2024-04-01T19:36:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:15.680743+0000", 2024-04-01T19:36:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 288.31844177099998, 2024-04-01T19:36:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.23060560799999999, 2024-04-01T19:36:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:36:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:36:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:36:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:36:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:36:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 148825 2024-04-01T19:36:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:36:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:36:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680743+0000", 2024-04-01T19:36:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:36:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680743+0000", 2024-04-01T19:36:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:36:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680745+0000", 2024-04-01T19:36:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1550000000000001e-06 2024-04-01T19:36:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:36:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680766+0000", 2024-04-01T19:36:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0455999999999999e-05 2024-04-01T19:36:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:36:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680772+0000", 2024-04-01T19:36:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2530000000000001e-06 2024-04-01T19:36:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:36:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680778+0000", 2024-04-01T19:36:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8810000000000001e-06 2024-04-01T19:36:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:36:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.685722+0000", 2024-04-01T19:36:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.004943996 2024-04-01T19:36:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:36:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.685918+0000", 2024-04-01T19:36:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00019609799999999999 2024-04-01T19:36:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.011 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.011 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 11", 2024-04-01T19:36:04.011 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.686042+0000", 2024-04-01T19:36:04.011 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012375600000000001 2024-04-01T19:36:04.011 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.011 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.011 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:36:04.011 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.694464+0000", 2024-04-01T19:36:04.011 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0084217579999999997 2024-04-01T19:36:04.011 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.911265+0000", 2024-04-01T19:36:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21680168399999999 2024-04-01T19:36:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:36:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.911314+0000", 2024-04-01T19:36:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8352000000000001e-05 2024-04-01T19:36:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:36:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.911349+0000", 2024-04-01T19:36:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5219000000000003e-05 2024-04-01T19:36:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:36:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:148870 3.7 3:e44d9249:::benchmark_data_smithi188_92122_object148869:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e220)", 2024-04-01T19:36:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:15.723501+0000", 2024-04-01T19:36:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 288.27568443500002, 2024-04-01T19:36:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.192572565, 2024-04-01T19:36:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:36:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:36:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:36:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:36:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:36:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 148870 2024-04-01T19:36:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:36:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:36:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.723501+0000", 2024-04-01T19:36:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:36:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.723501+0000", 2024-04-01T19:36:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:36:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.723503+0000", 2024-04-01T19:36:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9489999999999999e-06 2024-04-01T19:36:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:36:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.723547+0000", 2024-04-01T19:36:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4650000000000001e-05 2024-04-01T19:36:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:36:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.723563+0000", 2024-04-01T19:36:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5648e-05 2024-04-01T19:36:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:36:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.723572+0000", 2024-04-01T19:36:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.7099999999999996e-06 2024-04-01T19:36:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:36:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.723639+0000", 2024-04-01T19:36:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.7899999999999997e-05 2024-04-01T19:36:04.017 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.017 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.017 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:36:04.017 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.723766+0000", 2024-04-01T19:36:04.017 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000126866 2024-04-01T19:36:04.017 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.017 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.017 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 11", 2024-04-01T19:36:04.017 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.723914+0000", 2024-04-01T19:36:04.017 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014736 2024-04-01T19:36:04.017 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.017 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.017 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:36:04.017 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.728167+0000", 2024-04-01T19:36:04.018 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0042528790000000002 2024-04-01T19:36:04.018 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.018 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.018 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:04.018 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.915937+0000", 2024-04-01T19:36:04.018 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.187770837 2024-04-01T19:36:04.018 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.018 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.018 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:36:04.018 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.916012+0000", 2024-04-01T19:36:04.018 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4481999999999996e-05 2024-04-01T19:36:04.019 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.019 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.019 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:36:04.019 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.916073+0000", 2024-04-01T19:36:04.019 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1284000000000005e-05 2024-04-01T19:36:04.019 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.019 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:36:04.019 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.019 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.019 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.019 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:148878 3.7 3:e6c4fcb6:::benchmark_data_smithi188_92122_object148877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e220)", 2024-04-01T19:36:04.019 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:15.734454+0000", 2024-04-01T19:36:04.019 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 288.26473088300003, 2024-04-01T19:36:04.019 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.18392858200000001, 2024-04-01T19:36:04.019 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:36:04.020 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:36:04.020 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:04.020 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:36:04.020 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:36:04.020 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:36:04.020 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 148878 2024-04-01T19:36:04.020 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.020 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:36:04.020 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.020 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:36:04.020 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.734454+0000", 2024-04-01T19:36:04.020 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.020 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.020 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.021 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:36:04.021 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.734454+0000", 2024-04-01T19:36:04.021 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.021 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.021 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.021 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:36:04.021 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.734457+0000", 2024-04-01T19:36:04.021 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3740000000000001e-06 2024-04-01T19:36:04.021 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.021 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.021 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:36:04.021 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.734514+0000", 2024-04-01T19:36:04.021 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7914000000000002e-05 2024-04-01T19:36:04.021 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.021 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.022 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:36:04.022 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.734527+0000", 2024-04-01T19:36:04.022 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2435999999999999e-05 2024-04-01T19:36:04.022 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.022 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.022 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:36:04.022 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.734534+0000", 2024-04-01T19:36:04.022 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2439999999999996e-06 2024-04-01T19:36:04.022 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.022 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.022 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:36:04.022 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.734585+0000", 2024-04-01T19:36:04.023 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0739000000000003e-05 2024-04-01T19:36:04.023 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.023 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.023 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:36:04.023 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.734696+0000", 2024-04-01T19:36:04.023 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000111444 2024-04-01T19:36:04.023 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.023 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.023 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 11", 2024-04-01T19:36:04.023 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.734850+0000", 2024-04-01T19:36:04.023 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015382300000000001 2024-04-01T19:36:04.023 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.023 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.023 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:36:04.024 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.738171+0000", 2024-04-01T19:36:04.024 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0033207029999999999 2024-04-01T19:36:04.024 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.024 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.024 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:04.024 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.918297+0000", 2024-04-01T19:36:04.024 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.180126434 2024-04-01T19:36:04.024 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.024 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.024 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:36:04.024 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.918337+0000", 2024-04-01T19:36:04.024 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9990000000000002e-05 2024-04-01T19:36:04.024 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.025 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.025 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:36:04.025 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.918383+0000", 2024-04-01T19:36:04.025 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5481e-05 2024-04-01T19:36:04.025 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.025 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:36:04.025 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.025 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.025 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.025 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:148906 3.7 3:e033df60:::benchmark_data_smithi188_92122_object148905:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e220)", 2024-04-01T19:36:04.025 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:15.756560+0000", 2024-04-01T19:36:04.025 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 288.24262498299998, 2024-04-01T19:36:04.025 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.16191088200000001, 2024-04-01T19:36:04.025 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:36:04.026 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:36:04.026 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:04.026 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:36:04.026 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:36:04.026 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:36:04.026 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 148906 2024-04-01T19:36:04.026 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.026 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:36:04.026 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.026 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:36:04.026 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.756560+0000", 2024-04-01T19:36:04.026 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.027 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.027 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.027 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:36:04.027 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.756560+0000", 2024-04-01T19:36:04.027 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.027 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.027 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.027 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:36:04.027 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.756561+0000", 2024-04-01T19:36:04.027 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.325e-06 2024-04-01T19:36:04.027 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.027 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.027 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:36:04.027 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.756590+0000", 2024-04-01T19:36:04.027 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.8243e-05 2024-04-01T19:36:04.028 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.028 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.028 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:36:04.028 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.756601+0000", 2024-04-01T19:36:04.028 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1525000000000001e-05 2024-04-01T19:36:04.028 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.028 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.028 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:36:04.028 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.756611+0000", 2024-04-01T19:36:04.028 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0325e-05 2024-04-01T19:36:04.028 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.028 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.028 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:36:04.028 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.756664+0000", 2024-04-01T19:36:04.029 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2843999999999998e-05 2024-04-01T19:36:04.029 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.029 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.029 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:36:04.029 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.756770+0000", 2024-04-01T19:36:04.029 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000105821 2024-04-01T19:36:04.029 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.029 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.029 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 11", 2024-04-01T19:36:04.029 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.756910+0000", 2024-04-01T19:36:04.029 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013955200000000001 2024-04-01T19:36:04.029 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.029 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.029 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:36:04.030 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.763044+0000", 2024-04-01T19:36:04.030 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0061343259999999998 2024-04-01T19:36:04.030 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.030 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.030 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:04.030 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.918409+0000", 2024-04-01T19:36:04.030 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.155365118 2024-04-01T19:36:04.030 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.030 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.030 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:36:04.030 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.918438+0000", 2024-04-01T19:36:04.030 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.8611000000000001e-05 2024-04-01T19:36:04.030 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.031 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.031 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:36:04.031 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.918471+0000", 2024-04-01T19:36:04.031 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3191999999999997e-05 2024-04-01T19:36:04.031 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.031 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:36:04.031 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.031 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.031 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.031 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:148920 3.7 3:e8ee5001:::benchmark_data_smithi188_92122_object148919:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e220)", 2024-04-01T19:36:04.031 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:15.773529+0000", 2024-04-01T19:36:04.031 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 288.22565616000003, 2024-04-01T19:36:04.031 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.14847933999999999, 2024-04-01T19:36:04.032 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:36:04.032 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:36:04.032 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:04.032 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:36:04.032 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:36:04.032 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:36:04.032 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 148920 2024-04-01T19:36:04.032 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.032 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:36:04.032 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.032 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:36:04.032 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.773529+0000", 2024-04-01T19:36:04.032 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.033 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.033 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.033 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:36:04.033 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.773529+0000", 2024-04-01T19:36:04.033 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.033 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.033 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.033 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:36:04.033 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.773532+0000", 2024-04-01T19:36:04.033 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.134e-06 2024-04-01T19:36:04.033 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.033 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.033 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:36:04.033 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.773576+0000", 2024-04-01T19:36:04.034 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4014000000000002e-05 2024-04-01T19:36:04.034 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.034 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.034 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:36:04.034 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.773593+0000", 2024-04-01T19:36:04.034 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6796e-05 2024-04-01T19:36:04.034 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.034 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.034 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:36:04.034 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.773604+0000", 2024-04-01T19:36:04.034 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1083e-05 2024-04-01T19:36:04.034 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.035 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.035 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:36:04.035 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.773673+0000", 2024-04-01T19:36:04.035 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8860000000000001e-05 2024-04-01T19:36:04.035 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.035 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.035 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:36:04.035 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.773758+0000", 2024-04-01T19:36:04.035 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5511000000000002e-05 2024-04-01T19:36:04.035 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.035 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.035 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 11", 2024-04-01T19:36:04.035 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.773844+0000", 2024-04-01T19:36:04.035 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6197000000000002e-05 2024-04-01T19:36:04.035 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.036 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.036 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:36:04.036 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.777441+0000", 2024-04-01T19:36:04.036 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0035961970000000002 2024-04-01T19:36:04.036 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.036 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.036 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:04.036 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.921896+0000", 2024-04-01T19:36:04.036 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.14445524400000001 2024-04-01T19:36:04.036 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.036 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.036 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:36:04.036 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.921956+0000", 2024-04-01T19:36:04.036 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0443999999999999e-05 2024-04-01T19:36:04.037 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.037 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.037 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:36:04.037 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.922008+0000", 2024-04-01T19:36:04.037 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.1860000000000002e-05 2024-04-01T19:36:04.037 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.037 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:36:04.037 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.037 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.037 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.037 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:148927 3.7 3:e98e16cd:::benchmark_data_smithi188_92122_object148926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e220)", 2024-04-01T19:36:04.037 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:15.777641+0000", 2024-04-01T19:36:04.037 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 288.22154427700002, 2024-04-01T19:36:04.037 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.144497763, 2024-04-01T19:36:04.038 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:36:04.038 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:36:04.038 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:04.038 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:36:04.038 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:36:04.038 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:36:04.038 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 148927 2024-04-01T19:36:04.038 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.038 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:36:04.038 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.038 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:36:04.038 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.777641+0000", 2024-04-01T19:36:04.038 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.039 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.039 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.039 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:36:04.039 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.777641+0000", 2024-04-01T19:36:04.039 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.039 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.039 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.039 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:36:04.039 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.777643+0000", 2024-04-01T19:36:04.039 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4540000000000001e-06 2024-04-01T19:36:04.039 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.039 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.039 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:36:04.040 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.777684+0000", 2024-04-01T19:36:04.040 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1035000000000003e-05 2024-04-01T19:36:04.040 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.040 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.040 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:36:04.040 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.777702+0000", 2024-04-01T19:36:04.040 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7819e-05 2024-04-01T19:36:04.040 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.040 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.040 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:36:04.040 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.777710+0000", 2024-04-01T19:36:04.040 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2609999999999993e-06 2024-04-01T19:36:04.040 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.040 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.041 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:36:04.041 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.778676+0000", 2024-04-01T19:36:04.041 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00096519800000000001 2024-04-01T19:36:04.041 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.041 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.041 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:36:04.041 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.778769+0000", 2024-04-01T19:36:04.041 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.3930000000000004e-05 2024-04-01T19:36:04.041 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.041 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.041 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 11", 2024-04-01T19:36:04.041 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.778857+0000", 2024-04-01T19:36:04.041 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.7577000000000005e-05 2024-04-01T19:36:04.042 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.042 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.042 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:36:04.042 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.793914+0000", 2024-04-01T19:36:04.042 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.015057143 2024-04-01T19:36:04.042 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.042 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.042 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:04.042 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.922048+0000", 2024-04-01T19:36:04.042 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.12813411799999999 2024-04-01T19:36:04.042 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.042 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.043 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:36:04.043 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.922101+0000", 2024-04-01T19:36:04.043 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2374999999999999e-05 2024-04-01T19:36:04.043 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.043 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.043 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:36:04.043 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.922139+0000", 2024-04-01T19:36:04.043 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7852999999999998e-05 2024-04-01T19:36:04.043 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.043 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:36:04.043 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.043 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.044 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.044 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:194273 3.b 3:de601cd8:::benchmark_data_smithi188_92122_object28682:head [delete] snapc 0=[] ondisk+write+known_if_redirected e230)", 2024-04-01T19:36:04.044 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:53.260941+0000", 2024-04-01T19:36:04.044 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 250.738244106, 2024-04-01T19:36:04.044 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21903962399999999, 2024-04-01T19:36:04.044 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:36:04.044 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:36:04.044 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:04.044 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:36:04.044 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:36:04.044 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:36:04.044 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 194273 2024-04-01T19:36:04.044 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.044 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:36:04.045 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.045 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:36:04.045 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.260941+0000", 2024-04-01T19:36:04.045 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.045 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.045 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.045 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:36:04.045 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.260941+0000", 2024-04-01T19:36:04.045 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.045 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.045 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.045 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:36:04.045 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.260942+0000", 2024-04-01T19:36:04.046 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.418e-06 2024-04-01T19:36:04.046 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.046 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.046 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:36:04.046 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.260947+0000", 2024-04-01T19:36:04.046 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0019999999999997e-06 2024-04-01T19:36:04.046 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.046 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.046 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:36:04.046 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.260958+0000", 2024-04-01T19:36:04.046 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0166999999999999e-05 2024-04-01T19:36:04.046 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.046 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.047 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:36:04.047 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.260963+0000", 2024-04-01T19:36:04.047 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7930000000000003e-06 2024-04-01T19:36:04.047 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.047 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.047 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:36:04.047 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.261018+0000", 2024-04-01T19:36:04.047 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4691000000000002e-05 2024-04-01T19:36:04.047 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.047 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.047 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:36:04.047 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.261090+0000", 2024-04-01T19:36:04.047 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2131000000000004e-05 2024-04-01T19:36:04.047 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.047 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.048 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:36:04.048 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.261156+0000", 2024-04-01T19:36:04.048 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5462000000000004e-05 2024-04-01T19:36:04.048 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.048 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.048 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:36:04.048 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.264691+0000", 2024-04-01T19:36:04.048 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.003535201 2024-04-01T19:36:04.048 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.048 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.048 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:04.048 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.479894+0000", 2024-04-01T19:36:04.048 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21520278500000001 2024-04-01T19:36:04.049 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.049 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.049 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:36:04.049 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.479945+0000", 2024-04-01T19:36:04.049 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0949999999999998e-05 2024-04-01T19:36:04.049 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.049 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.049 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:36:04.049 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.479981+0000", 2024-04-01T19:36:04.049 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.6023999999999999e-05 2024-04-01T19:36:04.050 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.050 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:36:04.050 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.050 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.050 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.050 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:194319 3.b 3:dd2a0756:::benchmark_data_smithi188_92122_object28728:head [delete] snapc 0=[] ondisk+write+known_if_redirected e230)", 2024-04-01T19:36:04.050 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:53.296858+0000", 2024-04-01T19:36:04.050 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 250.702326752, 2024-04-01T19:36:04.050 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.183193935, 2024-04-01T19:36:04.050 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:36:04.050 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:36:04.050 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:04.050 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:36:04.051 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:36:04.051 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:36:04.051 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 194319 2024-04-01T19:36:04.051 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.051 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:36:04.051 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.051 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:36:04.051 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.296858+0000", 2024-04-01T19:36:04.051 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.051 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.051 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.051 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:36:04.051 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.296858+0000", 2024-04-01T19:36:04.051 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.052 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.052 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.052 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:36:04.052 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.296859+0000", 2024-04-01T19:36:04.052 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.2999999999999999e-07 2024-04-01T19:36:04.052 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.052 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.052 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:36:04.052 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.296866+0000", 2024-04-01T19:36:04.052 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3110000000000002e-06 2024-04-01T19:36:04.052 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.052 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.052 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:36:04.052 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.296873+0000", 2024-04-01T19:36:04.052 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7789999999999996e-06 2024-04-01T19:36:04.053 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.053 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.053 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:36:04.053 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.296879+0000", 2024-04-01T19:36:04.053 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0839999999999997e-06 2024-04-01T19:36:04.053 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.053 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.053 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:36:04.053 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.296951+0000", 2024-04-01T19:36:04.053 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.1916999999999996e-05 2024-04-01T19:36:04.053 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.053 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.053 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:36:04.053 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.297075+0000", 2024-04-01T19:36:04.053 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000123399 2024-04-01T19:36:04.054 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.054 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.054 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:36:04.054 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.297706+0000", 2024-04-01T19:36:04.054 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00063164299999999998 2024-04-01T19:36:04.054 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.054 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.054 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:36:04.054 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.302007+0000", 2024-04-01T19:36:04.054 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0043007710000000001 2024-04-01T19:36:04.054 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.054 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.054 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:04.055 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.480005+0000", 2024-04-01T19:36:04.055 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.17799791500000001 2024-04-01T19:36:04.055 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.055 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.055 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:36:04.055 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.480032+0000", 2024-04-01T19:36:04.055 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6539000000000001e-05 2024-04-01T19:36:04.055 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.055 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.055 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:36:04.055 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.480052+0000", 2024-04-01T19:36:04.055 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0647000000000001e-05 2024-04-01T19:36:04.055 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.055 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:36:04.055 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.056 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.056 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.056 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:194338 3.b 3:d74388c7:::benchmark_data_smithi188_92122_object28747:head [delete] snapc 0=[] ondisk+write+known_if_redirected e230)", 2024-04-01T19:36:04.056 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:53.312611+0000", 2024-04-01T19:36:04.056 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 250.686573815, 2024-04-01T19:36:04.056 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.167506657, 2024-04-01T19:36:04.056 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:36:04.056 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:36:04.056 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:04.056 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:36:04.056 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:36:04.056 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:36:04.056 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 194338 2024-04-01T19:36:04.056 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.056 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:36:04.057 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.057 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:36:04.057 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.312611+0000", 2024-04-01T19:36:04.057 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.057 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.057 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.057 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:36:04.057 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.312611+0000", 2024-04-01T19:36:04.057 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.057 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.057 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.057 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:36:04.057 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.312612+0000", 2024-04-01T19:36:04.058 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2079999999999999e-06 2024-04-01T19:36:04.058 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.058 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.058 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:36:04.058 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.312617+0000", 2024-04-01T19:36:04.058 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4789999999999998e-06 2024-04-01T19:36:04.058 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.058 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.058 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:36:04.058 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.312626+0000", 2024-04-01T19:36:04.058 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8359999999999998e-06 2024-04-01T19:36:04.058 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.058 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.059 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:36:04.059 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.312632+0000", 2024-04-01T19:36:04.059 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.6490000000000002e-06 2024-04-01T19:36:04.059 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.059 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.059 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:36:04.059 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.312683+0000", 2024-04-01T19:36:04.059 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0850000000000003e-05 2024-04-01T19:36:04.059 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.059 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.059 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:36:04.059 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.312793+0000", 2024-04-01T19:36:04.059 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00010964299999999999 2024-04-01T19:36:04.060 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.060 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.060 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:36:04.060 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.312901+0000", 2024-04-01T19:36:04.060 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00010823900000000001 2024-04-01T19:36:04.060 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.060 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.060 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:36:04.060 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.317232+0000", 2024-04-01T19:36:04.060 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0043310370000000003 2024-04-01T19:36:04.060 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.060 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.060 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:04.060 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.480073+0000", 2024-04-01T19:36:04.060 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.162841238 2024-04-01T19:36:04.061 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.061 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.061 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:36:04.061 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.480099+0000", 2024-04-01T19:36:04.061 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5179999999999999e-05 2024-04-01T19:36:04.061 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.061 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.061 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:36:04.061 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.480118+0000", 2024-04-01T19:36:04.061 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9298000000000001e-05 2024-04-01T19:36:04.061 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.061 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:36:04.061 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.061 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.061 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.062 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:194367 3.b 3:d1b8978a:::benchmark_data_smithi188_92122_object28776:head [delete] snapc 0=[] ondisk+write+known_if_redirected e230)", 2024-04-01T19:36:04.062 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:53.337487+0000", 2024-04-01T19:36:04.062 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 250.66169826199999, 2024-04-01T19:36:04.062 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.14908616699999999, 2024-04-01T19:36:04.062 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:36:04.062 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:36:04.062 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:04.062 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:36:04.062 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:36:04.062 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:36:04.062 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 194367 2024-04-01T19:36:04.062 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.062 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:36:04.063 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.063 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:36:04.063 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.337487+0000", 2024-04-01T19:36:04.063 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.063 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.063 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.063 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:36:04.063 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.337487+0000", 2024-04-01T19:36:04.063 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.063 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.063 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.063 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:36:04.063 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.337490+0000", 2024-04-01T19:36:04.063 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.7779999999999999e-06 2024-04-01T19:36:04.064 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.064 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.064 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:36:04.064 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.337497+0000", 2024-04-01T19:36:04.064 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.447e-06 2024-04-01T19:36:04.064 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.064 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.064 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:36:04.064 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.337526+0000", 2024-04-01T19:36:04.064 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.9195000000000001e-05 2024-04-01T19:36:04.064 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.064 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.064 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:36:04.064 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.337535+0000", 2024-04-01T19:36:04.065 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6470000000000004e-06 2024-04-01T19:36:04.065 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.065 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.065 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:36:04.065 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.337579+0000", 2024-04-01T19:36:04.065 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4508999999999997e-05 2024-04-01T19:36:04.065 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.065 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.065 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:36:04.065 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.337668+0000", 2024-04-01T19:36:04.065 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8261000000000001e-05 2024-04-01T19:36:04.065 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.065 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.065 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:36:04.066 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.337759+0000", 2024-04-01T19:36:04.066 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.1328000000000004e-05 2024-04-01T19:36:04.066 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.066 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.066 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:36:04.066 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.341905+0000", 2024-04-01T19:36:04.066 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0041456829999999998 2024-04-01T19:36:04.066 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.066 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.066 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:04.066 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.486462+0000", 2024-04-01T19:36:04.066 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.144557871 2024-04-01T19:36:04.066 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.066 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.067 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:36:04.067 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.486524+0000", 2024-04-01T19:36:04.067 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1369000000000001e-05 2024-04-01T19:36:04.067 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.067 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.067 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:36:04.067 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.486573+0000", 2024-04-01T19:36:04.067 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9079000000000002e-05 2024-04-01T19:36:04.067 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.067 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:36:04.067 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.067 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.067 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.067 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:194382 3.b 3:d8d4e65f:::benchmark_data_smithi188_92122_object28791:head [delete] snapc 0=[] ondisk+write+known_if_redirected e230)", 2024-04-01T19:36:04.068 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:53.350327+0000", 2024-04-01T19:36:04.068 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 250.64885813199999, 2024-04-01T19:36:04.068 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.14341351199999999, 2024-04-01T19:36:04.068 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:36:04.068 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:36:04.068 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:04.068 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:36:04.068 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:36:04.068 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:36:04.068 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 194382 2024-04-01T19:36:04.068 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.068 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:36:04.068 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.068 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:36:04.069 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.350327+0000", 2024-04-01T19:36:04.069 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.069 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.069 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.069 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:36:04.069 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.350327+0000", 2024-04-01T19:36:04.069 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.069 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.069 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.069 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:36:04.069 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.350329+0000", 2024-04-01T19:36:04.069 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5749999999999999e-06 2024-04-01T19:36:04.069 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.069 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.070 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:36:04.070 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.350337+0000", 2024-04-01T19:36:04.070 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.1489999999999997e-06 2024-04-01T19:36:04.070 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.070 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.070 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:36:04.070 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.350356+0000", 2024-04-01T19:36:04.070 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9275000000000001e-05 2024-04-01T19:36:04.070 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.070 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.070 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:36:04.070 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.350366+0000", 2024-04-01T19:36:04.070 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0373999999999999e-05 2024-04-01T19:36:04.071 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.071 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.071 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:36:04.071 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.350446+0000", 2024-04-01T19:36:04.071 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0037000000000006e-05 2024-04-01T19:36:04.071 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.071 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.071 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:36:04.071 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.350588+0000", 2024-04-01T19:36:04.071 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014181799999999999 2024-04-01T19:36:04.071 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.071 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.071 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:36:04.072 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.350680+0000", 2024-04-01T19:36:04.072 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.1850999999999999e-05 2024-04-01T19:36:04.072 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.072 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.072 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:36:04.072 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.354625+0000", 2024-04-01T19:36:04.072 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0039449469999999999 2024-04-01T19:36:04.072 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.072 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.072 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:04.072 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.493671+0000", 2024-04-01T19:36:04.072 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13904586799999999 2024-04-01T19:36:04.072 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.072 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.073 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:36:04.073 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.493708+0000", 2024-04-01T19:36:04.073 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7401000000000003e-05 2024-04-01T19:36:04.073 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.073 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.073 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:36:04.073 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.493740+0000", 2024-04-01T19:36:04.073 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.2217e-05 2024-04-01T19:36:04.073 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.073 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:36:04.073 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.073 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.073 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.073 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:203450 3.b 3:dcc0e3f0:::benchmark_data_smithi188_92122_object37859:head [delete] snapc 0=[] ondisk+write+known_if_redirected e232)", 2024-04-01T19:36:04.073 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:32:00.596659+0000", 2024-04-01T19:36:04.074 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 243.40252574199999, 2024-04-01T19:36:04.074 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21783223199999999, 2024-04-01T19:36:04.074 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:36:04.074 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:36:04.074 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:04.074 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:36:04.074 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:36:04.074 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:36:04.074 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 203450 2024-04-01T19:36:04.074 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.074 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:36:04.074 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.075 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:36:04.075 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.596659+0000", 2024-04-01T19:36:04.075 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.075 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.075 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.075 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:36:04.075 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.596659+0000", 2024-04-01T19:36:04.075 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.075 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.075 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.075 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:36:04.075 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.596661+0000", 2024-04-01T19:36:04.075 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.798e-06 2024-04-01T19:36:04.075 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.075 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.076 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:36:04.076 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.596666+0000", 2024-04-01T19:36:04.076 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2000000000000002e-06 2024-04-01T19:36:04.076 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.076 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.076 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:36:04.076 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.596679+0000", 2024-04-01T19:36:04.076 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2345e-05 2024-04-01T19:36:04.076 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.076 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.076 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:36:04.076 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.596686+0000", 2024-04-01T19:36:04.076 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4370000000000001e-06 2024-04-01T19:36:04.077 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.077 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.077 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:36:04.077 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.596743+0000", 2024-04-01T19:36:04.077 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7003000000000003e-05 2024-04-01T19:36:04.077 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.077 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.077 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:36:04.077 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.596854+0000", 2024-04-01T19:36:04.077 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000110893 2024-04-01T19:36:04.077 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.077 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.077 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:36:04.078 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.596958+0000", 2024-04-01T19:36:04.078 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000104225 2024-04-01T19:36:04.078 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.078 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.078 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:36:04.078 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.605240+0000", 2024-04-01T19:36:04.078 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0082815370000000003 2024-04-01T19:36:04.078 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.078 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.078 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:04.078 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.814430+0000", 2024-04-01T19:36:04.078 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.20919001100000001 2024-04-01T19:36:04.078 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.079 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.079 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:36:04.079 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.814463+0000", 2024-04-01T19:36:04.079 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3083000000000002e-05 2024-04-01T19:36:04.079 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.079 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.079 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:36:04.079 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.814492+0000", 2024-04-01T19:36:04.079 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.87e-05 2024-04-01T19:36:04.079 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.079 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:36:04.079 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.079 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.080 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.080 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:203452 3.b 3:d88decb6:::benchmark_data_smithi188_92122_object37861:head [delete] snapc 0=[] ondisk+write+known_if_redirected e232)", 2024-04-01T19:36:04.080 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:32:00.597081+0000", 2024-04-01T19:36:04.080 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 243.40210439399999, 2024-04-01T19:36:04.080 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.22275341300000001, 2024-04-01T19:36:04.080 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:36:04.080 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:36:04.080 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:04.080 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:36:04.080 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:36:04.080 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:36:04.080 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 203452 2024-04-01T19:36:04.080 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.080 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:36:04.080 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.081 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:36:04.081 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.597081+0000", 2024-04-01T19:36:04.081 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.081 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.081 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.081 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:36:04.081 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.597081+0000", 2024-04-01T19:36:04.081 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.081 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.081 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.081 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:36:04.081 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.597082+0000", 2024-04-01T19:36:04.081 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7519999999999999e-06 2024-04-01T19:36:04.081 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.082 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.082 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:36:04.082 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.597088+0000", 2024-04-01T19:36:04.082 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3430000000000003e-06 2024-04-01T19:36:04.082 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.082 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.082 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:36:04.082 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.597099+0000", 2024-04-01T19:36:04.082 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.136e-05 2024-04-01T19:36:04.082 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.082 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.082 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:36:04.082 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.597107+0000", 2024-04-01T19:36:04.082 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5920000000000003e-06 2024-04-01T19:36:04.083 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.083 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.083 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:36:04.083 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.601775+0000", 2024-04-01T19:36:04.083 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0046678930000000002 2024-04-01T19:36:04.083 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.083 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.083 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:36:04.083 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.601854+0000", 2024-04-01T19:36:04.083 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9621000000000002e-05 2024-04-01T19:36:04.083 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.083 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.083 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:36:04.083 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.601928+0000", 2024-04-01T19:36:04.083 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3775000000000004e-05 2024-04-01T19:36:04.084 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.084 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.084 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:36:04.084 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.609107+0000", 2024-04-01T19:36:04.084 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0071786749999999998 2024-04-01T19:36:04.084 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.084 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.084 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:04.084 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.819715+0000", 2024-04-01T19:36:04.084 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21060874700000001 2024-04-01T19:36:04.084 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.084 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.084 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:36:04.084 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.819776+0000", 2024-04-01T19:36:04.085 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0554999999999999e-05 2024-04-01T19:36:04.085 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.085 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.085 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:36:04.085 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.819834+0000", 2024-04-01T19:36:04.085 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8100000000000003e-05 2024-04-01T19:36:04.085 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.085 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:36:04.085 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.085 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.085 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.085 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:203468 3.b 3:df17487f:::benchmark_data_smithi188_92122_object37877:head [delete] snapc 0=[] ondisk+write+known_if_redirected e232)", 2024-04-01T19:36:04.085 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:32:00.605518+0000", 2024-04-01T19:36:04.085 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 243.393667222, 2024-04-01T19:36:04.086 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21447159700000001, 2024-04-01T19:36:04.086 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:36:04.086 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:36:04.086 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:04.086 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:36:04.086 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:36:04.086 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:36:04.086 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 203468 2024-04-01T19:36:04.086 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.086 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:36:04.086 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.086 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:36:04.086 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.605518+0000", 2024-04-01T19:36:04.086 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.087 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.087 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.087 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:36:04.087 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.605518+0000", 2024-04-01T19:36:04.087 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.087 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.089 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.089 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:36:04.089 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.605519+0000", 2024-04-01T19:36:04.089 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3200000000000001e-06 2024-04-01T19:36:04.089 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.089 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.090 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:36:04.090 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.605524+0000", 2024-04-01T19:36:04.090 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7049999999999998e-06 2024-04-01T19:36:04.090 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.090 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.090 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:36:04.090 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.605533+0000", 2024-04-01T19:36:04.090 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.2e-06 2024-04-01T19:36:04.090 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.090 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.090 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:36:04.090 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.605539+0000", 2024-04-01T19:36:04.090 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.392e-06 2024-04-01T19:36:04.090 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.091 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.091 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:36:04.091 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.605589+0000", 2024-04-01T19:36:04.091 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9257e-05 2024-04-01T19:36:04.091 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.091 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.091 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:36:04.091 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.605720+0000", 2024-04-01T19:36:04.091 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013134400000000001 2024-04-01T19:36:04.091 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.091 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.091 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:36:04.091 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.605843+0000", 2024-04-01T19:36:04.092 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000122705 2024-04-01T19:36:04.092 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.092 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.092 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:36:04.092 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.609179+0000", 2024-04-01T19:36:04.092 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0033365629999999999 2024-04-01T19:36:04.092 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.092 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.092 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:04.092 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.819883+0000", 2024-04-01T19:36:04.092 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21070414600000001 2024-04-01T19:36:04.092 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.092 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.093 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:36:04.093 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.819944+0000", 2024-04-01T19:36:04.093 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0517999999999999e-05 2024-04-01T19:36:04.093 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.093 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.093 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:36:04.093 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.819989+0000", 2024-04-01T19:36:04.093 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5447e-05 2024-04-01T19:36:04.093 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.093 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:36:04.093 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.093 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.093 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.093 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:203518 3.b 3:dd1c4ef6:::benchmark_data_smithi188_92122_object37927:head [delete] snapc 0=[] ondisk+write+known_if_redirected e232)", 2024-04-01T19:36:04.094 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:32:00.644942+0000", 2024-04-01T19:36:04.094 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 243.35424350400001, 2024-04-01T19:36:04.094 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.18017075599999999, 2024-04-01T19:36:04.094 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:36:04.094 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:36:04.094 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:04.094 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:36:04.094 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:36:04.094 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:36:04.094 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 203518 2024-04-01T19:36:04.094 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.094 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:36:04.094 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.095 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:36:04.095 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.644942+0000", 2024-04-01T19:36:04.095 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.095 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.095 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.095 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:36:04.095 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.644942+0000", 2024-04-01T19:36:04.095 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.095 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.095 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.095 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:36:04.095 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.644944+0000", 2024-04-01T19:36:04.095 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.8770000000000002e-06 2024-04-01T19:36:04.095 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.096 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.096 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:36:04.096 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.644952+0000", 2024-04-01T19:36:04.096 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9869999999999999e-06 2024-04-01T19:36:04.096 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.096 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.096 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:36:04.096 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.644968+0000", 2024-04-01T19:36:04.096 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5715000000000001e-05 2024-04-01T19:36:04.096 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.096 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.096 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:36:04.096 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.644977+0000", 2024-04-01T19:36:04.096 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.1849999999999993e-06 2024-04-01T19:36:04.097 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.097 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.097 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:36:04.097 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.645057+0000", 2024-04-01T19:36:04.097 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9501999999999999e-05 2024-04-01T19:36:04.097 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.097 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.097 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:36:04.097 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.645144+0000", 2024-04-01T19:36:04.097 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.7257999999999997e-05 2024-04-01T19:36:04.097 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.097 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.098 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:36:04.098 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.645216+0000", 2024-04-01T19:36:04.098 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2078999999999999e-05 2024-04-01T19:36:04.098 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.098 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.098 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:36:04.098 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.648796+0000", 2024-04-01T19:36:04.098 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0035800789999999999 2024-04-01T19:36:04.098 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.098 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.098 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:04.098 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.825032+0000", 2024-04-01T19:36:04.098 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.17623623699999999 2024-04-01T19:36:04.098 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.099 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.099 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:36:04.099 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.825069+0000", 2024-04-01T19:36:04.099 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.6798999999999998e-05 2024-04-01T19:36:04.099 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.099 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.099 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:36:04.099 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.825112+0000", 2024-04-01T19:36:04.099 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.3037999999999997e-05 2024-04-01T19:36:04.099 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.099 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:36:04.099 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.099 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.099 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.099 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:203525 3.b 3:d0e726e4:::benchmark_data_smithi188_92122_object37934:head [delete] snapc 0=[] ondisk+write+known_if_redirected e232)", 2024-04-01T19:36:04.100 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:32:00.651620+0000", 2024-04-01T19:36:04.100 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 243.347564621, 2024-04-01T19:36:04.100 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.17363524, 2024-04-01T19:36:04.100 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:36:04.100 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:36:04.100 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:04.100 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:36:04.100 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:36:04.100 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:36:04.100 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 203525 2024-04-01T19:36:04.100 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.100 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:36:04.100 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.100 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:36:04.101 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.651620+0000", 2024-04-01T19:36:04.101 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.101 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.101 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.101 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:36:04.101 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.651620+0000", 2024-04-01T19:36:04.101 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.101 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.101 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.101 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:36:04.101 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.651622+0000", 2024-04-01T19:36:04.101 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.069e-06 2024-04-01T19:36:04.102 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.102 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.102 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:36:04.102 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.651629+0000", 2024-04-01T19:36:04.102 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.596e-06 2024-04-01T19:36:04.102 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.102 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.102 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:36:04.102 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.651641+0000", 2024-04-01T19:36:04.102 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2356e-05 2024-04-01T19:36:04.102 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.102 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.102 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:36:04.103 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.651648+0000", 2024-04-01T19:36:04.103 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9349999999999997e-06 2024-04-01T19:36:04.103 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.103 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.103 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:36:04.103 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.651694+0000", 2024-04-01T19:36:04.103 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5324000000000002e-05 2024-04-01T19:36:04.103 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.103 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.103 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:36:04.103 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.651778+0000", 2024-04-01T19:36:04.103 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4318000000000001e-05 2024-04-01T19:36:04.103 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.103 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.104 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:36:04.104 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.651852+0000", 2024-04-01T19:36:04.104 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3536999999999997e-05 2024-04-01T19:36:04.104 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.104 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.104 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:36:04.104 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.655216+0000", 2024-04-01T19:36:04.104 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.003364704 2024-04-01T19:36:04.104 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.104 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.104 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:04.104 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.825157+0000", 2024-04-01T19:36:04.104 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.169941011 2024-04-01T19:36:04.105 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.105 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.105 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:36:04.105 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.825211+0000", 2024-04-01T19:36:04.105 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4020000000000001e-05 2024-04-01T19:36:04.105 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.105 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.105 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:36:04.105 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.825256+0000", 2024-04-01T19:36:04.105 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4369999999999997e-05 2024-04-01T19:36:04.105 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.105 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:36:04.105 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.105 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.106 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.106 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:203539 3.b 3:d8c57bdc:::benchmark_data_smithi188_92122_object37948:head [delete] snapc 0=[] ondisk+write+known_if_redirected e232)", 2024-04-01T19:36:04.106 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:32:00.660792+0000", 2024-04-01T19:36:04.106 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 243.33839338799999, 2024-04-01T19:36:04.106 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.172239949, 2024-04-01T19:36:04.106 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:36:04.106 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:36:04.106 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:04.106 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:36:04.106 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:36:04.106 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:36:04.106 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 203539 2024-04-01T19:36:04.106 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.107 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:36:04.107 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.107 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:36:04.107 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660792+0000", 2024-04-01T19:36:04.107 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.107 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.107 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.107 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:36:04.107 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660792+0000", 2024-04-01T19:36:04.107 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.107 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.107 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.107 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:36:04.107 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660793+0000", 2024-04-01T19:36:04.108 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0640000000000001e-06 2024-04-01T19:36:04.108 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.108 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.108 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:36:04.108 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660796+0000", 2024-04-01T19:36:04.108 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3349999999999998e-06 2024-04-01T19:36:04.108 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.108 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.108 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:36:04.108 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660804+0000", 2024-04-01T19:36:04.108 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.8569999999999995e-06 2024-04-01T19:36:04.108 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.109 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.109 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:36:04.109 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660809+0000", 2024-04-01T19:36:04.109 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6149999999999999e-06 2024-04-01T19:36:04.109 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.109 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.109 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:36:04.109 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660853+0000", 2024-04-01T19:36:04.109 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4873999999999998e-05 2024-04-01T19:36:04.109 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.109 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.109 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:36:04.109 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660930+0000", 2024-04-01T19:36:04.109 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6279999999999995e-05 2024-04-01T19:36:04.109 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.110 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.110 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:36:04.110 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660999+0000", 2024-04-01T19:36:04.110 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8875999999999996e-05 2024-04-01T19:36:04.110 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.110 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.110 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:36:04.110 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.668640+0000", 2024-04-01T19:36:04.110 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0076412509999999999 2024-04-01T19:36:04.110 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.110 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.110 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:04.110 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.832956+0000", 2024-04-01T19:36:04.111 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.16431617800000001 2024-04-01T19:36:04.111 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.111 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.111 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:36:04.111 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.832988+0000", 2024-04-01T19:36:04.111 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.2069000000000001e-05 2024-04-01T19:36:04.111 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.111 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.111 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:36:04.111 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.833032+0000", 2024-04-01T19:36:04.111 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.3550000000000001e-05 2024-04-01T19:36:04.111 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.111 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:36:04.112 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.112 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.112 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.112 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:203540 3.b 3:d41f05ce:::benchmark_data_smithi188_92122_object37949:head [delete] snapc 0=[] ondisk+write+known_if_redirected e232)", 2024-04-01T19:36:04.112 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:32:00.660818+0000", 2024-04-01T19:36:04.112 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 243.33836720799999, 2024-04-01T19:36:04.112 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.17715509300000001, 2024-04-01T19:36:04.112 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:36:04.112 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:36:04.112 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:04.112 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:36:04.112 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:36:04.112 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:36:04.113 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 203540 2024-04-01T19:36:04.113 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.113 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:36:04.113 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.113 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:36:04.113 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660818+0000", 2024-04-01T19:36:04.113 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.113 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.113 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.113 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:36:04.113 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660818+0000", 2024-04-01T19:36:04.113 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.113 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.113 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.114 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:36:04.114 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660818+0000", 2024-04-01T19:36:04.114 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5600000000000001e-07 2024-04-01T19:36:04.114 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.114 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.114 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:36:04.114 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660820+0000", 2024-04-01T19:36:04.114 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8199999999999999e-06 2024-04-01T19:36:04.114 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.114 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.114 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:36:04.114 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660823+0000", 2024-04-01T19:36:04.114 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3189999999999999e-06 2024-04-01T19:36:04.115 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.115 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.115 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:36:04.115 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660828+0000", 2024-04-01T19:36:04.115 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.69e-06 2024-04-01T19:36:04.115 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.115 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.115 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:36:04.115 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.664362+0000", 2024-04-01T19:36:04.115 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0035334709999999998 2024-04-01T19:36:04.115 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.115 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.115 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:36:04.116 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.664452+0000", 2024-04-01T19:36:04.116 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.0044999999999996e-05 2024-04-01T19:36:04.116 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.116 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.116 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:36:04.116 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.665003+0000", 2024-04-01T19:36:04.116 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00055186500000000002 2024-04-01T19:36:04.116 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.116 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.116 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:36:04.116 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.668751+0000", 2024-04-01T19:36:04.116 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.003747139 2024-04-01T19:36:04.116 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.117 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.117 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:04.117 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.837876+0000", 2024-04-01T19:36:04.117 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.16912496699999999 2024-04-01T19:36:04.117 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.117 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.117 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:36:04.117 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.837928+0000", 2024-04-01T19:36:04.117 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2420000000000003e-05 2024-04-01T19:36:04.117 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.117 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.117 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:36:04.117 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.837973+0000", 2024-04-01T19:36:04.117 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4901000000000003e-05 2024-04-01T19:36:04.117 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.118 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:36:04.118 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.118 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.118 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.118 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:203561 3.b 3:d09e1d7a:::benchmark_data_smithi188_92122_object37970:head [delete] snapc 0=[] ondisk+write+known_if_redirected e232)", 2024-04-01T19:36:04.118 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:32:00.682776+0000", 2024-04-01T19:36:04.118 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 243.316409333, 2024-04-01T19:36:04.118 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.16111267200000001, 2024-04-01T19:36:04.118 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:36:04.118 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:36:04.118 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:04.118 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:36:04.119 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:36:04.119 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:36:04.119 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 203561 2024-04-01T19:36:04.119 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.119 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:36:04.119 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.119 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:36:04.119 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.682776+0000", 2024-04-01T19:36:04.119 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.119 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.119 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.119 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:36:04.119 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.682776+0000", 2024-04-01T19:36:04.120 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:36:04.120 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.120 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.120 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:36:04.120 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.682778+0000", 2024-04-01T19:36:04.120 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5969999999999999e-06 2024-04-01T19:36:04.120 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.120 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.120 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:36:04.120 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.682786+0000", 2024-04-01T19:36:04.120 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6939999999999995e-06 2024-04-01T19:36:04.120 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.120 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.120 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:36:04.121 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.682802+0000", 2024-04-01T19:36:04.121 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6206999999999999e-05 2024-04-01T19:36:04.121 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.121 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.121 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:36:04.121 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.682811+0000", 2024-04-01T19:36:04.121 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6430000000000001e-06 2024-04-01T19:36:04.121 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.121 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.121 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:36:04.121 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.682867+0000", 2024-04-01T19:36:04.121 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6388000000000003e-05 2024-04-01T19:36:04.121 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.121 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.122 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:36:04.122 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.682952+0000", 2024-04-01T19:36:04.122 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4846999999999996e-05 2024-04-01T19:36:04.122 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.122 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.122 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:36:04.122 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.683023+0000", 2024-04-01T19:36:04.122 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.1422999999999997e-05 2024-04-01T19:36:04.122 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.122 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.122 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:36:04.122 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.686537+0000", 2024-04-01T19:36:04.123 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0035138809999999999 2024-04-01T19:36:04.123 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.123 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.123 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:04.123 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.843783+0000", 2024-04-01T19:36:04.123 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.157245251 2024-04-01T19:36:04.123 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.123 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.123 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:36:04.123 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.843839+0000", 2024-04-01T19:36:04.123 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5890000000000002e-05 2024-04-01T19:36:04.123 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:36:04.123 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:36:04.123 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:36:04.124 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.843888+0000", 2024-04-01T19:36:04.124 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9851000000000001e-05 2024-04-01T19:36:04.124 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.124 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:36:04.124 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.124 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:36:04.124 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:36:04.124 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:36:04.125 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:04.125 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:04.125 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:36:04.126 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:36:04.226 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:36:04.258 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:04.523 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:36:04.523 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:36:04.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:04 smithi062 ceph-mon[44211]: pgmap v880: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20044/321960 objects degraded (6.226%) 2024-04-01T19:36:04.858 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:04 smithi022 ceph-mon[39439]: pgmap v880: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20044/321960 objects degraded (6.226%) 2024-04-01T19:36:04.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:04 smithi188 ceph-mon[43939]: pgmap v880: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20044/321960 objects degraded (6.226%) 2024-04-01T19:36:04.907 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:36:04.910 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:04.910 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:36:05.011 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:36:05.044 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:05.065 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:36:05.068 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:05.068 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:36:05.169 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:36:05.339 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:05.361 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:36:05.363 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:05.364 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:36:05.465 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:36:05.497 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:05.518 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:36:05.520 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:05.521 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:36:05.554 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_ops_in_flight 2024-04-01T19:36:05.567 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:36:05.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:05 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[39416]: 2024-04-01T19:36:05.362+0000 7fd025a9f700 -1 mon.a@0(leader).osd e304 definitely_dead 0 2024-04-01T19:36:05.621 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:36:05.651 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:05.671 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:36:05.674 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:05.674 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:36:05.775 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:36:05.805 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:05.829 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:36:05.831 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:05.832 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:36:05.841 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:36:05.933 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:36:05.962 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:05.990 INFO:teuthology.orchestra.run.smithi022.stderr:marked out osd.6. 2024-04-01T19:36:06.085 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:36:06.086 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:05 smithi022 ceph-mon[39439]: pgmap v881: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20044/321960 objects degraded (6.226%) 2024-04-01T19:36:06.087 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:05 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2144289374' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["6"]}]: dispatch 2024-04-01T19:36:06.087 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:05 smithi022 ceph-mon[39439]: Client client.admin marked osd.6 out, after it was down for 21 seconds 2024-04-01T19:36:06.087 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:06.088 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:36:06.189 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:36:06.220 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:06.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:05 smithi062 ceph-mon[44211]: pgmap v881: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20044/321960 objects degraded (6.226%) 2024-04-01T19:36:06.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:05 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2144289374' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["6"]}]: dispatch 2024-04-01T19:36:06.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:05 smithi062 ceph-mon[44211]: Client client.admin marked osd.6 out, after it was down for 21 seconds 2024-04-01T19:36:06.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:05 smithi188 ceph-mon[43939]: pgmap v881: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20044/321960 objects degraded (6.226%) 2024-04-01T19:36:06.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:05 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2144289374' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["6"]}]: dispatch 2024-04-01T19:36:06.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:05 smithi188 ceph-mon[43939]: Client client.admin marked osd.6 out, after it was down for 21 seconds 2024-04-01T19:36:06.524 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:36:07.163 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.6 2024-04-01T19:36:07.163 INFO:tasks.thrashosds.thrasher:remote for osd 6 is ubuntu@smithi062.front.sepia.ceph.com 2024-04-01T19:36:07.164 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -n osd.6 --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-6 --journal-path /var/lib/ceph/osd/ceph-6/journal --op list-pgs 2024-04-01T19:36:07.171 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:36:07.176 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:07.176 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:36:07.188 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:36:07.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:06 smithi062 ceph-mon[44211]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-01T19:36:07.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:06 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2144289374' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["6"]}]': finished 2024-04-01T19:36:07.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:06 smithi062 ceph-mon[44211]: osdmap e305: 12 total, 11 up, 11 in 2024-04-01T19:36:07.277 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:36:07.303 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:06 smithi022 ceph-mon[39439]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-01T19:36:07.303 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:06 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2144289374' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["6"]}]': finished 2024-04-01T19:36:07.303 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:06 smithi022 ceph-mon[39439]: osdmap e305: 12 total, 11 up, 11 in 2024-04-01T19:36:07.305 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:07.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:06 smithi188 ceph-mon[43939]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-01T19:36:07.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:06 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2144289374' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["6"]}]': finished 2024-04-01T19:36:07.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:06 smithi188 ceph-mon[43939]: osdmap e305: 12 total, 11 up, 11 in 2024-04-01T19:36:07.470 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/osd.6/config 2024-04-01T19:36:07.855 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:36:07.857 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:07.858 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:36:07.923 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:36:07.923 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:36:07.923 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 0 2024-04-01T19:36:07.923 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:36:07.959 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:36:07.991 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:08.016 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:36:08.019 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:08.019 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:36:08.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:08 smithi022 ceph-mon[39439]: pgmap v883: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 20044/321960 objects degraded (6.226%) 2024-04-01T19:36:08.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:08 smithi022 ceph-mon[39439]: osdmap e306: 12 total, 11 up, 11 in 2024-04-01T19:36:08.120 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:36:08.150 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:08.170 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:36:08.172 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:08.173 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:36:08.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:08 smithi062 ceph-mon[44211]: pgmap v883: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 20044/321960 objects degraded (6.226%) 2024-04-01T19:36:08.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:08 smithi062 ceph-mon[44211]: osdmap e306: 12 total, 11 up, 11 in 2024-04-01T19:36:08.273 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:36:08.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:08 smithi188 ceph-mon[43939]: pgmap v883: 17 pgs: 2 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 20044/321960 objects degraded (6.226%) 2024-04-01T19:36:08.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:08 smithi188 ceph-mon[43939]: osdmap e306: 12 total, 11 up, 11 in 2024-04-01T19:36:08.300 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:08.321 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:36:08.324 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:08.324 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:36:08.425 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:36:08.454 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:08.578 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:36:08.580 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:08.580 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:36:08.619 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_blocked_ops 2024-04-01T19:36:08.681 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:36:08.708 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:08.961 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:36:08.964 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:08.964 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:36:09.065 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:36:09.095 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:09.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:09 smithi062 ceph-mon[44211]: osdmap e307: 12 total, 11 up, 11 in 2024-04-01T19:36:09.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:09 smithi062 ceph-mon[44211]: 4.5 starting backfill to osd.11 from (0'0,0'0] MAX to 299'11383 2024-04-01T19:36:09.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:09 smithi062 ceph-mon[44211]: osdmap e308: 12 total, 11 up, 11 in 2024-04-01T19:36:09.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:09 smithi022 ceph-mon[39439]: osdmap e307: 12 total, 11 up, 11 in 2024-04-01T19:36:09.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:09 smithi022 ceph-mon[39439]: 4.5 starting backfill to osd.11 from (0'0,0'0] MAX to 299'11383 2024-04-01T19:36:09.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:09 smithi022 ceph-mon[39439]: osdmap e308: 12 total, 11 up, 11 in 2024-04-01T19:36:09.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:09 smithi188 ceph-mon[43939]: osdmap e307: 12 total, 11 up, 11 in 2024-04-01T19:36:09.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:09 smithi188 ceph-mon[43939]: 4.5 starting backfill to osd.11 from (0'0,0'0] MAX to 299'11383 2024-04-01T19:36:09.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:09 smithi188 ceph-mon[43939]: osdmap e308: 12 total, 11 up, 11 in 2024-04-01T19:36:09.418 INFO:teuthology.orchestra.run.smithi062.stderr:Creating an OSD daemon form without an OSD FSID value 2024-04-01T19:36:09.644 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:36:09.647 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:09.648 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:36:09.749 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:36:09.779 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:09.875 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:36:10.014 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:36:10.031 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:36:10.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:10 smithi022 ceph-mon[39439]: pgmap v886: 17 pgs: 1 remapped+peering, 1 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 10107/321960 objects degraded (3.139%) 2024-04-01T19:36:10.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:10 smithi022 ceph-mon[39439]: 4.a starting backfill to osd.10 from (0'0,0'0] MAX to 299'11547 2024-04-01T19:36:10.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:10 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 10107/321960 objects degraded (3.139%), 1 pg degraded (PG_DEGRADED) 2024-04-01T19:36:10.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:10 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2653429736' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:36:10.033 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:10.034 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:36:10.135 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:36:10.168 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:10.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:10 smithi062 ceph-mon[44211]: pgmap v886: 17 pgs: 1 remapped+peering, 1 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 10107/321960 objects degraded (3.139%) 2024-04-01T19:36:10.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:10 smithi062 ceph-mon[44211]: 4.a starting backfill to osd.10 from (0'0,0'0] MAX to 299'11547 2024-04-01T19:36:10.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:10 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 10107/321960 objects degraded (3.139%), 1 pg degraded (PG_DEGRADED) 2024-04-01T19:36:10.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:10 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2653429736' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:36:10.267 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:36:10.270 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:10.271 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:36:10.297 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:36:10.318 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:36:10.338 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:36:10.360 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:36:10.372 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:36:10.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:10 smithi188 ceph-mon[43939]: pgmap v886: 17 pgs: 1 remapped+peering, 1 undersized+degraded+peered, 15 active+clean; 9.8 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 10107/321960 objects degraded (3.139%) 2024-04-01T19:36:10.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:10 smithi188 ceph-mon[43939]: 4.a starting backfill to osd.10 from (0'0,0'0] MAX to 299'11547 2024-04-01T19:36:10.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:10 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 10107/321960 objects degraded (3.139%), 1 pg degraded (PG_DEGRADED) 2024-04-01T19:36:10.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:10 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2653429736' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:36:10.381 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:36:10.405 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:36:10.408 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:10.434 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:36:10.457 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:36:10.480 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:36:10.504 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:36:10.508 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:36:10.511 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:10.511 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:36:10.531 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:36:10.531 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:36:10.531 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:36:10.531 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:36:10.531 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:36:10.531 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:36:10.532 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:36:10.532 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:36:10.532 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:36:10.532 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:36:10.532 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:36:10.532 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:36:10.532 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:36:10.613 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:36:10.644 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:10.656 INFO:teuthology.orchestra.run.smithi062.stdout:4.5 2024-04-01T19:36:10.656 INFO:teuthology.orchestra.run.smithi062.stdout:4.a 2024-04-01T19:36:10.665 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:36:10.673 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:10.674 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:36:10.775 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:36:10.809 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:11.192 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:11 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:36:11.192 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:11 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2653429736' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:36:11.192 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:11 smithi062 ceph-mon[44211]: osdmap e309: 12 total, 11 up, 11 in 2024-04-01T19:36:11.192 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:11 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1603342842' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:36:11.192 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:11.192 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:11.192 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:11.192 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:11.192 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:11.193 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:11.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:11 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:36:11.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:11 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2653429736' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:36:11.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:11 smithi022 ceph-mon[39439]: osdmap e309: 12 total, 11 up, 11 in 2024-04-01T19:36:11.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:11 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1603342842' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:36:11.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:11.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:11.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:11.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:11.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:11.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:11.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:11 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:36:11.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:11 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2653429736' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:36:11.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:11 smithi188 ceph-mon[43939]: osdmap e309: 12 total, 11 up, 11 in 2024-04-01T19:36:11.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:11 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1603342842' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:36:11.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:11.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:11.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:11.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:11.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:11.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:11.662 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:11.663 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:36:11.663 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:36:11.694 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:36:11.694 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:36:11.763 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:36:11.792 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:11.813 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:36:11.816 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:11.816 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:36:11.918 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:36:11.948 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:11.969 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:36:11.972 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:11.972 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:36:12.073 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:36:12.102 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:12.123 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:36:12.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:12.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:12.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:12.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:12.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:12.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:12 smithi188 ceph-mon[43939]: pgmap v889: 17 pgs: 1 remapped+peering, 1 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 9900/321960 objects degraded (3.075%); 3.2 MiB/s, 51 objects/s recovering 2024-04-01T19:36:12.126 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:12.126 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:36:12.162 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -n osd.6 --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-6 --journal-path /var/lib/ceph/osd/ceph-6/journal --op export --pgid 4.a --file /var/log/ceph/exp.4.a.6 2024-04-01T19:36:12.227 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:36:12.257 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:12.279 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:36:12.281 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:12.282 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:36:12.291 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:36:12.291 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:36:12.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:12.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:12.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:12.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:12.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:12.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:12 smithi022 ceph-mon[39439]: pgmap v889: 17 pgs: 1 remapped+peering, 1 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 9900/321960 objects degraded (3.075%); 3.2 MiB/s, 51 objects/s recovering 2024-04-01T19:36:12.383 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:36:12.412 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:12.434 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:36:12.437 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:12.438 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:36:12.508 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/osd.6/config 2024-04-01T19:36:12.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:12.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:12.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:12.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:12.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:12.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:12 smithi062 ceph-mon[44211]: pgmap v889: 17 pgs: 1 remapped+peering, 1 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 9900/321960 objects degraded (3.075%); 3.2 MiB/s, 51 objects/s recovering 2024-04-01T19:36:12.538 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:36:12.567 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:12.589 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:36:12.592 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:12.592 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:36:12.692 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:36:12.721 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:12.741 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:36:12.743 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:12.744 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:36:12.844 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:36:12.874 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:12.896 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:36:12.898 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:12.899 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:36:12.926 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_historic_ops 2024-04-01T19:36:13.000 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:36:13.025 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:36:13.028 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:13.227 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:36:13.230 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:13.230 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:36:13.312 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:36:13.331 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:36:13.361 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:13.611 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:36:13.613 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:13.614 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:36:13.696 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:36:13.715 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:36:13.744 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:13.764 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:36:13.767 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:13.767 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:36:13.791 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:36:13.869 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:36:13.898 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:13.919 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:36:13.922 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:13.922 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:36:14.014 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:14 smithi022 ceph-mon[39439]: pgmap v890: 17 pgs: 2 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 17531/321960 objects degraded (5.445%); 27 MiB/s, 425 objects/s recovering 2024-04-01T19:36:14.023 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:36:14.054 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:14.157 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:36:14.163 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:14.163 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:36:14.264 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:36:14.293 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:14.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:14 smithi188 ceph-mon[43939]: pgmap v890: 17 pgs: 2 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 17531/321960 objects degraded (5.445%); 27 MiB/s, 425 objects/s recovering 2024-04-01T19:36:14.442 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:14 smithi062 ceph-mon[44211]: pgmap v890: 17 pgs: 2 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 17531/321960 objects degraded (5.445%); 27 MiB/s, 425 objects/s recovering 2024-04-01T19:36:14.496 INFO:teuthology.orchestra.run.smithi062.stderr:Creating an OSD daemon form without an OSD FSID value 2024-04-01T19:36:14.644 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:36:14.649 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:14.649 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:36:14.750 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:36:14.780 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:14.929 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:36:14.932 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:14.932 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:36:15.033 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:36:15.063 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:15.084 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:36:15.086 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:15.087 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:36:15.188 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:36:15.217 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:15.238 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:36:15.240 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:15.241 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:36:15.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:15 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T19:36:15.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:15 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T19:36:15.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:15 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 17531/321960 objects degraded (5.445%), 2 pgs degraded (PG_DEGRADED) 2024-04-01T19:36:15.341 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:36:15.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:15 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T19:36:15.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:15 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T19:36:15.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:15 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 17531/321960 objects degraded (5.445%), 2 pgs degraded (PG_DEGRADED) 2024-04-01T19:36:15.371 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:15.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:15 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T19:36:15.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:15 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T19:36:15.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:15 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 17531/321960 objects degraded (5.445%), 2 pgs degraded (PG_DEGRADED) 2024-04-01T19:36:15.494 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:36:15.498 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:15.499 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:36:15.600 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:36:15.631 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:Exporting 4.a info 4.a( v 299'11547 (272'1500,299'11547] local-lis/les=267/268 n=10107 ec=267/267 lis/c=267/267 les/c/f=268/268/0 sis=267) 2024-04-01T19:36:16.123 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:36:16.124 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:36:16.150 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:500004d2:::benchmark_data_smithi188_104537_object159378:head# 2024-04-01T19:36:16.150 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5000091a:::benchmark_data_smithi188_104537_object97091:head# 2024-04-01T19:36:16.151 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:500052a7:::benchmark_data_smithi188_104537_object98176:head# 2024-04-01T19:36:16.151 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50017012:::benchmark_data_smithi188_104537_object119265:head# 2024-04-01T19:36:16.151 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5001d9df:::benchmark_data_smithi188_104537_object14696:head# 2024-04-01T19:36:16.152 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50021bd0:::benchmark_data_smithi188_104537_object22967:head# 2024-04-01T19:36:16.152 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50023270:::benchmark_data_smithi188_104537_object58010:head# 2024-04-01T19:36:16.153 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50028eae:::benchmark_data_smithi188_104537_object141649:head# 2024-04-01T19:36:16.153 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50036539:::benchmark_data_smithi188_104537_object132548:head# 2024-04-01T19:36:16.154 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50046cd6:::benchmark_data_smithi188_104537_object147121:head# 2024-04-01T19:36:16.154 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:500494ee:::benchmark_data_smithi188_104537_object169328:head# 2024-04-01T19:36:16.155 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5004a5f4:::benchmark_data_smithi188_104537_object59711:head# 2024-04-01T19:36:16.155 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50057449:::benchmark_data_smithi188_104537_object163921:head# 2024-04-01T19:36:16.156 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5005761f:::benchmark_data_smithi188_104537_object171645:head# 2024-04-01T19:36:16.156 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5005f15a:::benchmark_data_smithi188_104537_object99452:head# 2024-04-01T19:36:16.156 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50061cc2:::benchmark_data_smithi188_104537_object165562:head# 2024-04-01T19:36:16.157 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:500694fc:::benchmark_data_smithi188_104537_object64830:head# 2024-04-01T19:36:16.157 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5006c86c:::benchmark_data_smithi188_104537_object45686:head# 2024-04-01T19:36:16.158 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5006f573:::benchmark_data_smithi188_104537_object156074:head# 2024-04-01T19:36:16.158 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50078cf4:::benchmark_data_smithi188_104537_object42680:head# 2024-04-01T19:36:16.159 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50078d3e:::benchmark_data_smithi188_104537_object11671:head# 2024-04-01T19:36:16.159 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50079754:::benchmark_data_smithi188_104537_object102249:head# 2024-04-01T19:36:16.160 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5007fd4a:::benchmark_data_smithi188_104537_object104123:head# 2024-04-01T19:36:16.160 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50089291:::benchmark_data_smithi188_104537_object58247:head# 2024-04-01T19:36:16.161 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5008e730:::benchmark_data_smithi188_104537_object46110:head# 2024-04-01T19:36:16.161 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:500931e8:::benchmark_data_smithi188_104537_object108003:head# 2024-04-01T19:36:16.161 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:500a44c1:::benchmark_data_smithi188_104537_object148702:head# 2024-04-01T19:36:16.162 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:500a9416:::benchmark_data_smithi188_104537_object58918:head# 2024-04-01T19:36:16.162 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:500aa44d:::benchmark_data_smithi188_104537_object62852:head# 2024-04-01T19:36:16.163 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:500acdf2:::benchmark_data_smithi188_104537_object74034:head# 2024-04-01T19:36:16.163 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:500ad77a:::benchmark_data_smithi188_104537_object140852:head# 2024-04-01T19:36:16.163 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:500b433c:::benchmark_data_smithi188_104537_object130936:head# 2024-04-01T19:36:16.164 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:500b7899:::benchmark_data_smithi188_104537_object37819:head# 2024-04-01T19:36:16.165 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:500ba508:::benchmark_data_smithi188_104537_object66711:head# 2024-04-01T19:36:16.165 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:500bcd32:::benchmark_data_smithi188_104537_object39312:head# 2024-04-01T19:36:16.165 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:500c1784:::benchmark_data_smithi188_104537_object71378:head# 2024-04-01T19:36:16.166 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:500c5eab:::benchmark_data_smithi188_104537_object132315:head# 2024-04-01T19:36:16.166 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:500c7a33:::benchmark_data_smithi188_104537_object113132:head# 2024-04-01T19:36:16.166 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:500cb228:::benchmark_data_smithi188_104537_object13601:head# 2024-04-01T19:36:16.167 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:500cf026:::benchmark_data_smithi188_104537_object120152:head# 2024-04-01T19:36:16.168 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:500e9402:::benchmark_data_smithi188_104537_object129181:head# 2024-04-01T19:36:16.168 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:500f2475:::benchmark_data_smithi188_104537_object130227:head# 2024-04-01T19:36:16.168 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:500fae60:::benchmark_data_smithi188_104537_object128200:head# 2024-04-01T19:36:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:500fd519:::benchmark_data_smithi188_104537_object161907:head# 2024-04-01T19:36:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5010e436:::benchmark_data_smithi188_104537_object161101:head# 2024-04-01T19:36:16.170 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5010e7b9:::benchmark_data_smithi188_104537_object140147:head# 2024-04-01T19:36:16.170 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:501178bb:::benchmark_data_smithi188_104537_object127467:head# 2024-04-01T19:36:16.171 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50119c57:::benchmark_data_smithi188_104537_object69877:head# 2024-04-01T19:36:16.171 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5011d923:::benchmark_data_smithi188_104537_object56113:head# 2024-04-01T19:36:16.171 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5011dfd4:::benchmark_data_smithi188_104537_object146400:head# 2024-04-01T19:36:16.172 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50124cd0:::benchmark_data_smithi188_104537_object65758:head# 2024-04-01T19:36:16.172 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5012638f:::benchmark_data_smithi188_104537_object53418:head# 2024-04-01T19:36:16.173 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50129e28:::benchmark_data_smithi188_104537_object72586:head# 2024-04-01T19:36:16.173 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5012c2e3:::benchmark_data_smithi188_104537_object25719:head# 2024-04-01T19:36:16.174 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5012d935:::benchmark_data_smithi188_104537_object110675:head# 2024-04-01T19:36:16.174 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:501327d1:::benchmark_data_smithi188_104537_object11573:head# 2024-04-01T19:36:16.174 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5013c226:::benchmark_data_smithi188_104537_object89576:head# 2024-04-01T19:36:16.175 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50140002:::benchmark_data_smithi188_104537_object145905:head# 2024-04-01T19:36:16.175 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5014aae8:::benchmark_data_smithi188_104537_object12240:head# 2024-04-01T19:36:16.176 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5014b506:::benchmark_data_smithi188_104537_object157448:head# 2024-04-01T19:36:16.176 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50155c52:::benchmark_data_smithi188_104537_object121221:head# 2024-04-01T19:36:16.176 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50159760:::benchmark_data_smithi188_104537_object113288:head# 2024-04-01T19:36:16.177 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50160254:::benchmark_data_smithi188_104537_object163820:head# 2024-04-01T19:36:16.177 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:501634a6:::benchmark_data_smithi188_104537_object80456:head# 2024-04-01T19:36:16.177 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50168ddc:::benchmark_data_smithi188_104537_object124097:head# 2024-04-01T19:36:16.178 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5016b55b:::benchmark_data_smithi188_104537_object165971:head# 2024-04-01T19:36:16.178 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50177322:::benchmark_data_smithi188_104537_object47534:head# 2024-04-01T19:36:16.179 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50178295:::benchmark_data_smithi188_104537_object153263:head# 2024-04-01T19:36:16.179 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50179c3b:::benchmark_data_smithi188_104537_object43934:head# 2024-04-01T19:36:16.180 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5017c475:::benchmark_data_smithi188_104537_object113335:head# 2024-04-01T19:36:16.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5017c812:::benchmark_data_smithi188_104537_object92559:head# 2024-04-01T19:36:16.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:501839c5:::benchmark_data_smithi188_104537_object81246:head# 2024-04-01T19:36:16.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5018424b:::benchmark_data_smithi188_104537_object101583:head# 2024-04-01T19:36:16.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50184931:::benchmark_data_smithi188_104537_object56884:head# 2024-04-01T19:36:16.182 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5018abd4:::benchmark_data_smithi188_104537_object151347:head# 2024-04-01T19:36:16.182 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5019297f:::benchmark_data_smithi188_104537_object123763:head# 2024-04-01T19:36:16.183 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5019afc6:::benchmark_data_smithi188_104537_object143828:head# 2024-04-01T19:36:16.183 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:501a0f1e:::benchmark_data_smithi188_104537_object163369:head# 2024-04-01T19:36:16.184 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:501a3d88:::benchmark_data_smithi188_104537_object154513:head# 2024-04-01T19:36:16.184 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:501ab65f:::benchmark_data_smithi188_104537_object37295:head# 2024-04-01T19:36:16.185 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:501bc23f:::benchmark_data_smithi188_104537_object128563:head# 2024-04-01T19:36:16.185 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:501be0c5:::benchmark_data_smithi188_104537_object138421:head# 2024-04-01T19:36:16.185 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:501c08ca:::benchmark_data_smithi188_104537_object141604:head# 2024-04-01T19:36:16.186 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:501d986f:::benchmark_data_smithi188_104537_object167240:head# 2024-04-01T19:36:16.187 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:501ec02b:::benchmark_data_smithi188_104537_object12699:head# 2024-04-01T19:36:16.187 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:501ec7c4:::benchmark_data_smithi188_104537_object145027:head# 2024-04-01T19:36:16.188 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50201399:::benchmark_data_smithi188_104537_object170600:head# 2024-04-01T19:36:16.188 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50207a73:::benchmark_data_smithi188_104537_object116815:head# 2024-04-01T19:36:16.189 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5020d596:::benchmark_data_smithi188_104537_object16060:head# 2024-04-01T19:36:16.189 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50210752:::benchmark_data_smithi188_104537_object155547:head# 2024-04-01T19:36:16.189 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50212ea3:::benchmark_data_smithi188_104537_object60878:head# 2024-04-01T19:36:16.190 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50214214:::benchmark_data_smithi188_104537_object90989:head# 2024-04-01T19:36:16.190 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50217ce9:::benchmark_data_smithi188_104537_object97741:head# 2024-04-01T19:36:16.192 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5021ae84:::benchmark_data_smithi188_104537_object97948:head# 2024-04-01T19:36:16.192 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5021ee2e:::benchmark_data_smithi188_104537_object120301:head# 2024-04-01T19:36:16.192 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:502240dc:::benchmark_data_smithi188_104537_object97968:head# 2024-04-01T19:36:16.192 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50225ba1:::benchmark_data_smithi188_104537_object33397:head# 2024-04-01T19:36:16.193 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50229505:::benchmark_data_smithi188_104537_object41252:head# 2024-04-01T19:36:16.193 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5022d40b:::benchmark_data_smithi188_104537_object19036:head# 2024-04-01T19:36:16.194 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50238058:::benchmark_data_smithi188_104537_object48850:head# 2024-04-01T19:36:16.194 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5023db48:::benchmark_data_smithi188_104537_object113441:head# 2024-04-01T19:36:16.194 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5023f543:::benchmark_data_smithi188_104537_object171819:head# 2024-04-01T19:36:16.195 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:502426bb:::benchmark_data_smithi188_104537_object72404:head# 2024-04-01T19:36:16.195 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5024f327:::benchmark_data_smithi188_104537_object44027:head# 2024-04-01T19:36:16.196 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50255583:::benchmark_data_smithi188_104537_object59545:head# 2024-04-01T19:36:16.196 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50257020:::benchmark_data_smithi188_104537_object43101:head# 2024-04-01T19:36:16.197 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5025951b:::benchmark_data_smithi188_104537_object164159:head# 2024-04-01T19:36:16.197 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5025aed9:::benchmark_data_smithi188_104537_object84524:head# 2024-04-01T19:36:16.198 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5026415e:::benchmark_data_smithi188_104537_object30595:head# 2024-04-01T19:36:16.198 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50266820:::benchmark_data_smithi188_104537_object141992:head# 2024-04-01T19:36:16.199 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50270315:::benchmark_data_smithi188_104537_object147273:head# 2024-04-01T19:36:16.199 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50288c62:::benchmark_data_smithi188_104537_object56441:head# 2024-04-01T19:36:16.199 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5028a4be:::benchmark_data_smithi188_104537_object170228:head# 2024-04-01T19:36:16.200 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5028c311:::benchmark_data_smithi188_104537_object96332:head# 2024-04-01T19:36:16.200 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5028d37c:::benchmark_data_smithi188_104537_object101935:head# 2024-04-01T19:36:16.201 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:502903b0:::benchmark_data_smithi188_104537_object19151:head# 2024-04-01T19:36:16.201 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:502a2e85:::benchmark_data_smithi188_104537_object160440:head# 2024-04-01T19:36:16.201 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:502a5f1b:::benchmark_data_smithi188_104537_object68167:head# 2024-04-01T19:36:16.202 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:502ae596:::benchmark_data_smithi188_104537_object91513:head# 2024-04-01T19:36:16.202 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:502aee81:::benchmark_data_smithi188_104537_object30738:head# 2024-04-01T19:36:16.203 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:502c0da7:::benchmark_data_smithi188_104537_object29298:head# 2024-04-01T19:36:16.203 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:502c38fe:::benchmark_data_smithi188_104537_object32395:head# 2024-04-01T19:36:16.204 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:502c4a50:::benchmark_data_smithi188_104537_object169940:head# 2024-04-01T19:36:16.204 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:502d32a4:::benchmark_data_smithi188_104537_object103679:head# 2024-04-01T19:36:16.205 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:502d46bf:::benchmark_data_smithi188_104537_object83201:head# 2024-04-01T19:36:16.205 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:502d4833:::benchmark_data_smithi188_104537_object52644:head# 2024-04-01T19:36:16.206 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:502e0351:::benchmark_data_smithi188_104537_object90114:head# 2024-04-01T19:36:16.206 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:502e735b:::benchmark_data_smithi188_104537_object123347:head# 2024-04-01T19:36:16.207 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:502e81c2:::benchmark_data_smithi188_104537_object15366:head# 2024-04-01T19:36:16.207 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:502fd635:::benchmark_data_smithi188_104537_object87682:head# 2024-04-01T19:36:16.208 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50309369:::benchmark_data_smithi188_104537_object123877:head# 2024-04-01T19:36:16.208 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5030aaa1:::benchmark_data_smithi188_104537_object79645:head# 2024-04-01T19:36:16.209 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5030ddb5:::benchmark_data_smithi188_104537_object58696:head# 2024-04-01T19:36:16.209 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50319b0d:::benchmark_data_smithi188_104537_object159423:head# 2024-04-01T19:36:16.210 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5031ce31:::benchmark_data_smithi188_104537_object126192:head# 2024-04-01T19:36:16.210 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5032b999:::benchmark_data_smithi188_104537_object41474:head# 2024-04-01T19:36:16.211 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5032c81d:::benchmark_data_smithi188_104537_object112556:head# 2024-04-01T19:36:16.211 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5032d14c:::benchmark_data_smithi188_104537_object150958:head# 2024-04-01T19:36:16.211 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5033e294:::benchmark_data_smithi188_104537_object128188:head# 2024-04-01T19:36:16.212 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5034db85:::benchmark_data_smithi188_104537_object145472:head# 2024-04-01T19:36:16.212 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50354cae:::benchmark_data_smithi188_104537_object19157:head# 2024-04-01T19:36:16.213 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5035a531:::benchmark_data_smithi188_104537_object20851:head# 2024-04-01T19:36:16.213 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50360f5c:::benchmark_data_smithi188_104537_object109361:head# 2024-04-01T19:36:16.213 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50364ab3:::benchmark_data_smithi188_104537_object36887:head# 2024-04-01T19:36:16.214 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50364b7d:::benchmark_data_smithi188_104537_object148233:head# 2024-04-01T19:36:16.214 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50369053:::benchmark_data_smithi188_104537_object139198:head# 2024-04-01T19:36:16.215 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:503759cf:::benchmark_data_smithi188_104537_object136213:head# 2024-04-01T19:36:16.215 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5037929d:::benchmark_data_smithi188_104537_object62101:head# 2024-04-01T19:36:16.216 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5037baa2:::benchmark_data_smithi188_104537_object132246:head# 2024-04-01T19:36:16.216 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5037d520:::benchmark_data_smithi188_104537_object136613:head# 2024-04-01T19:36:16.217 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50385825:::benchmark_data_smithi188_104537_object73698:head# 2024-04-01T19:36:16.217 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5038e728:::benchmark_data_smithi188_104537_object44969:head# 2024-04-01T19:36:16.218 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:503913c8:::benchmark_data_smithi188_104537_object88545:head# 2024-04-01T19:36:16.218 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50396410:::benchmark_data_smithi188_104537_object29156:head# 2024-04-01T19:36:16.219 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5039acb3:::benchmark_data_smithi188_104537_object133880:head# 2024-04-01T19:36:16.219 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:503a4a72:::benchmark_data_smithi188_104537_object144661:head# 2024-04-01T19:36:16.219 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:503a72e5:::benchmark_data_smithi188_104537_object145002:head# 2024-04-01T19:36:16.220 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:503a9424:::benchmark_data_smithi188_104537_object11044:head# 2024-04-01T19:36:16.220 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:503af97f:::benchmark_data_smithi188_104537_object12018:head# 2024-04-01T19:36:16.221 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:503b5773:::benchmark_data_smithi188_104537_object20355:head# 2024-04-01T19:36:16.222 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:503b6848:::benchmark_data_smithi188_104537_object127520:head# 2024-04-01T19:36:16.222 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:503c1618:::benchmark_data_smithi188_104537_object99765:head# 2024-04-01T19:36:16.222 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:503c4393:::benchmark_data_smithi188_104537_object115338:head# 2024-04-01T19:36:16.223 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:503ca635:::benchmark_data_smithi188_104537_object135395:head# 2024-04-01T19:36:16.223 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:503cb583:::benchmark_data_smithi188_104537_object169931:head# 2024-04-01T19:36:16.224 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:503daa2e:::benchmark_data_smithi188_104537_object169545:head# 2024-04-01T19:36:16.224 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:503ddf99:::benchmark_data_smithi188_104537_object53857:head# 2024-04-01T19:36:16.225 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:503e3271:::benchmark_data_smithi188_104537_object81707:head# 2024-04-01T19:36:16.225 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:503fbf9d:::benchmark_data_smithi188_104537_object60747:head# 2024-04-01T19:36:16.226 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5041040c:::benchmark_data_smithi188_104537_object53521:head# 2024-04-01T19:36:16.226 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50414587:::benchmark_data_smithi188_104537_object165931:head# 2024-04-01T19:36:16.227 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:504148f1:::benchmark_data_smithi188_104537_object114587:head# 2024-04-01T19:36:16.227 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5041b181:::benchmark_data_smithi188_104537_object107165:head# 2024-04-01T19:36:16.228 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5042563b:::benchmark_data_smithi188_104537_object71143:head# 2024-04-01T19:36:16.228 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50429d88:::benchmark_data_smithi188_104537_object106541:head# 2024-04-01T19:36:16.228 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5043118b:::benchmark_data_smithi188_104537_object78340:head# 2024-04-01T19:36:16.229 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50436008:::benchmark_data_smithi188_104537_object154694:head# 2024-04-01T19:36:16.229 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:504375ff:::benchmark_data_smithi188_104537_object141047:head# 2024-04-01T19:36:16.230 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5043b91b:::benchmark_data_smithi188_104537_object54942:head# 2024-04-01T19:36:16.230 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5043e467:::benchmark_data_smithi188_104537_object12452:head# 2024-04-01T19:36:16.231 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50445e8c:::benchmark_data_smithi188_104537_object13504:head# 2024-04-01T19:36:16.231 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5044862f:::benchmark_data_smithi188_104537_object102390:head# 2024-04-01T19:36:16.232 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5045494c:::benchmark_data_smithi188_104537_object56170:head# 2024-04-01T19:36:16.232 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50461868:::benchmark_data_smithi188_104537_object161761:head# 2024-04-01T19:36:16.233 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50465a06:::benchmark_data_smithi188_104537_object132626:head# 2024-04-01T19:36:16.233 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5046a16f:::benchmark_data_smithi188_104537_object121654:head# 2024-04-01T19:36:16.234 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5046b2e2:::benchmark_data_smithi188_104537_object36478:head# 2024-04-01T19:36:16.234 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5046c78d:::benchmark_data_smithi188_104537_object19543:head# 2024-04-01T19:36:16.235 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50475344:::benchmark_data_smithi188_104537_object118073:head# 2024-04-01T19:36:16.236 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50477097:::benchmark_data_smithi188_104537_object115116:head# 2024-04-01T19:36:16.236 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5047d56e:::benchmark_data_smithi188_104537_object83207:head# 2024-04-01T19:36:16.236 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50480c80:::benchmark_data_smithi188_104537_object130997:head# 2024-04-01T19:36:16.237 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5048145c:::benchmark_data_smithi188_104537_object85242:head# 2024-04-01T19:36:16.237 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50483bac:::benchmark_data_smithi188_104537_object143586:head# 2024-04-01T19:36:16.237 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5048a6a5:::benchmark_data_smithi188_104537_object122540:head# 2024-04-01T19:36:16.238 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50491a26:::benchmark_data_smithi188_104537_object92579:head# 2024-04-01T19:36:16.238 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50492b70:::benchmark_data_smithi188_104537_object160039:head# 2024-04-01T19:36:16.239 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50497808:::benchmark_data_smithi188_104537_object115678:head# 2024-04-01T19:36:16.239 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50499e35:::benchmark_data_smithi188_104537_object103618:head# 2024-04-01T19:36:16.240 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:504ae1d5:::benchmark_data_smithi188_104537_object89851:head# 2024-04-01T19:36:16.240 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:504af14d:::benchmark_data_smithi188_104537_object78092:head# 2024-04-01T19:36:16.240 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:504b4952:::benchmark_data_smithi188_104537_object159261:head# 2024-04-01T19:36:16.241 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:504b6efd:::benchmark_data_smithi188_104537_object109194:head# 2024-04-01T19:36:16.241 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:504b7d4c:::benchmark_data_smithi188_104537_object15022:head# 2024-04-01T19:36:16.242 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:504b92f9:::benchmark_data_smithi188_104537_object130426:head# 2024-04-01T19:36:16.242 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:504bb755:::benchmark_data_smithi188_104537_object137321:head# 2024-04-01T19:36:16.243 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:504bed9d:::benchmark_data_smithi188_104537_object21320:head# 2024-04-01T19:36:16.243 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:504cb955:::benchmark_data_smithi188_104537_object92838:head# 2024-04-01T19:36:16.244 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:504d24d7:::benchmark_data_smithi188_104537_object50330:head# 2024-04-01T19:36:16.244 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:504db363:::benchmark_data_smithi188_104537_object118702:head# 2024-04-01T19:36:16.245 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:504e47f1:::benchmark_data_smithi188_104537_object58383:head# 2024-04-01T19:36:16.246 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:504eb2c9:::benchmark_data_smithi188_104537_object146227:head# 2024-04-01T19:36:16.246 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:504eef61:::benchmark_data_smithi188_104537_object152184:head# 2024-04-01T19:36:16.246 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:504fb450:::benchmark_data_smithi188_104537_object72367:head# 2024-04-01T19:36:16.247 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:504fe69e:::benchmark_data_smithi188_104537_object78851:head# 2024-04-01T19:36:16.247 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:505146d0:::benchmark_data_smithi188_104537_object102830:head# 2024-04-01T19:36:16.248 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50517d05:::benchmark_data_smithi188_104537_object87677:head# 2024-04-01T19:36:16.248 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:505295f8:::benchmark_data_smithi188_104537_object170742:head# 2024-04-01T19:36:16.249 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5052998c:::benchmark_data_smithi188_104537_object83470:head# 2024-04-01T19:36:16.249 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:505334e2:::benchmark_data_smithi188_104537_object15643:head# 2024-04-01T19:36:16.250 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:505386f0:::benchmark_data_smithi188_104537_object34695:head# 2024-04-01T19:36:16.250 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5053963b:::benchmark_data_smithi188_104537_object123739:head# 2024-04-01T19:36:16.251 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50539b66:::benchmark_data_smithi188_104537_object144468:head# 2024-04-01T19:36:16.251 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:505443d8:::benchmark_data_smithi188_104537_object14497:head# 2024-04-01T19:36:16.252 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50548766:::benchmark_data_smithi188_104537_object17334:head# 2024-04-01T19:36:16.252 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5054fd59:::benchmark_data_smithi188_104537_object144831:head# 2024-04-01T19:36:16.253 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50558dad:::benchmark_data_smithi188_104537_object125283:head# 2024-04-01T19:36:16.253 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5055df7e:::benchmark_data_smithi188_104537_object106544:head# 2024-04-01T19:36:16.254 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50560e32:::benchmark_data_smithi188_104537_object16467:head# 2024-04-01T19:36:16.254 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50568c97:::benchmark_data_smithi188_104537_object170252:head# 2024-04-01T19:36:16.255 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50572928:::benchmark_data_smithi188_104537_object79718:head# 2024-04-01T19:36:16.255 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5057a772:::benchmark_data_smithi188_104537_object121439:head# 2024-04-01T19:36:16.255 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5057fd15:::benchmark_data_smithi188_104537_object78812:head# 2024-04-01T19:36:16.256 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50580315:::benchmark_data_smithi188_104537_object85806:head# 2024-04-01T19:36:16.256 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50584e41:::benchmark_data_smithi188_104537_object20248:head# 2024-04-01T19:36:16.257 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50589870:::benchmark_data_smithi188_104537_object18327:head# 2024-04-01T19:36:16.257 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5059101e:::benchmark_data_smithi188_104537_object71649:head# 2024-04-01T19:36:16.258 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:505a59b5:::benchmark_data_smithi188_104537_object150134:head# 2024-04-01T19:36:16.258 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:505b0854:::benchmark_data_smithi188_104537_object120476:head# 2024-04-01T19:36:16.259 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:505b3234:::benchmark_data_smithi188_104537_object139856:head# 2024-04-01T19:36:16.259 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:505bb13a:::benchmark_data_smithi188_104537_object109726:head# 2024-04-01T19:36:16.260 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:505c1eab:::benchmark_data_smithi188_104537_object74712:head# 2024-04-01T19:36:16.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:16 smithi062 ceph-mon[44211]: pgmap v891: 17 pgs: 2 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 13580/321960 objects degraded (4.218%); 58 MiB/s, 935 objects/s recovering 2024-04-01T19:36:16.261 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:505c8baa:::benchmark_data_smithi188_104537_object132079:head# 2024-04-01T19:36:16.261 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:505ca9d4:::benchmark_data_smithi188_104537_object52473:head# 2024-04-01T19:36:16.261 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:505cd72d:::benchmark_data_smithi188_104537_object162628:head# 2024-04-01T19:36:16.262 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:505d3974:::benchmark_data_smithi188_104537_object19730:head# 2024-04-01T19:36:16.262 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:505d9179:::benchmark_data_smithi188_104537_object41864:head# 2024-04-01T19:36:16.263 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:505dcd79:::benchmark_data_smithi188_104537_object12955:head# 2024-04-01T19:36:16.263 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:505de5be:::benchmark_data_smithi188_104537_object95478:head# 2024-04-01T19:36:16.264 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:505e21d7:::benchmark_data_smithi188_104537_object110599:head# 2024-04-01T19:36:16.264 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:505e8005:::benchmark_data_smithi188_104537_object131789:head# 2024-04-01T19:36:16.264 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:505ec45a:::benchmark_data_smithi188_104537_object69484:head# 2024-04-01T19:36:16.265 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:505ed4ee:::benchmark_data_smithi188_104537_object63222:head# 2024-04-01T19:36:16.265 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:505f2501:::benchmark_data_smithi188_104537_object16161:head# 2024-04-01T19:36:16.267 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:505fa586:::benchmark_data_smithi188_104537_object52169:head# 2024-04-01T19:36:16.267 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:505fadfc:::benchmark_data_smithi188_104537_object13767:head# 2024-04-01T19:36:16.268 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:505fd272:::benchmark_data_smithi188_104537_object44108:head# 2024-04-01T19:36:16.268 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50601f9b:::benchmark_data_smithi188_104537_object107109:head# 2024-04-01T19:36:16.269 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50608865:::benchmark_data_smithi188_104537_object128588:head# 2024-04-01T19:36:16.269 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5060b7c1:::benchmark_data_smithi188_104537_object52780:head# 2024-04-01T19:36:16.270 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5060ea35:::benchmark_data_smithi188_104537_object98758:head# 2024-04-01T19:36:16.270 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5060fbb1:::benchmark_data_smithi188_104537_object46588:head# 2024-04-01T19:36:16.271 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50617dfa:::benchmark_data_smithi188_104537_object83008:head# 2024-04-01T19:36:16.271 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50617f09:::benchmark_data_smithi188_104537_object100970:head# 2024-04-01T19:36:16.272 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5061829b:::benchmark_data_smithi188_104537_object95776:head# 2024-04-01T19:36:16.272 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5061c81b:::benchmark_data_smithi188_104537_object100909:head# 2024-04-01T19:36:16.272 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506245c5:::benchmark_data_smithi188_104537_object92459:head# 2024-04-01T19:36:16.273 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5062e999:::benchmark_data_smithi188_104537_object130520:head# 2024-04-01T19:36:16.273 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506324a5:::benchmark_data_smithi188_104537_object153464:head# 2024-04-01T19:36:16.274 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506362b3:::benchmark_data_smithi188_104537_object140210:head# 2024-04-01T19:36:16.274 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5063e7e8:::benchmark_data_smithi188_104537_object65896:head# 2024-04-01T19:36:16.275 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506400d7:::benchmark_data_smithi188_104537_object61407:head# 2024-04-01T19:36:16.275 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50655a3b:::benchmark_data_smithi188_104537_object74864:head# 2024-04-01T19:36:16.276 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5065a737:::benchmark_data_smithi188_104537_object110810:head# 2024-04-01T19:36:16.276 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5065ed5d:::benchmark_data_smithi188_104537_object47016:head# 2024-04-01T19:36:16.277 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506693dc:::benchmark_data_smithi188_104537_object110476:head# 2024-04-01T19:36:16.277 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5066b3e5:::benchmark_data_smithi188_104537_object57345:head# 2024-04-01T19:36:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5066b5b2:::benchmark_data_smithi188_104537_object153841:head# 2024-04-01T19:36:16.279 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5066bb84:::benchmark_data_smithi188_104537_object47025:head# 2024-04-01T19:36:16.279 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50670745:::benchmark_data_smithi188_104537_object165921:head# 2024-04-01T19:36:16.279 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506714c6:::benchmark_data_smithi188_104537_object64354:head# 2024-04-01T19:36:16.279 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50672b44:::benchmark_data_smithi188_104537_object13319:head# 2024-04-01T19:36:16.280 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50674aa0:::benchmark_data_smithi188_104537_object162451:head# 2024-04-01T19:36:16.281 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50677210:::benchmark_data_smithi188_104537_object28565:head# 2024-04-01T19:36:16.281 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5067ce6f:::benchmark_data_smithi188_104537_object120043:head# 2024-04-01T19:36:16.281 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5068debb:::benchmark_data_smithi188_104537_object32795:head# 2024-04-01T19:36:16.282 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5068e058:::benchmark_data_smithi188_104537_object157120:head# 2024-04-01T19:36:16.282 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5068fb67:::benchmark_data_smithi188_104537_object108694:head# 2024-04-01T19:36:16.283 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5069118d:::benchmark_data_smithi188_104537_object108085:head# 2024-04-01T19:36:16.283 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50692763:::benchmark_data_smithi188_104537_object22089:head# 2024-04-01T19:36:16.283 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50692a0e:::benchmark_data_smithi188_104537_object67526:head# 2024-04-01T19:36:16.284 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506a1cb1:::benchmark_data_smithi188_104537_object48582:head# 2024-04-01T19:36:16.284 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506ab620:::benchmark_data_smithi188_104537_object125748:head# 2024-04-01T19:36:16.285 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506ac9cd:::benchmark_data_smithi188_104537_object44355:head# 2024-04-01T19:36:16.285 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506af340:::benchmark_data_smithi188_104537_object135818:head# 2024-04-01T19:36:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506b24d1:::benchmark_data_smithi188_104537_object24452:head# 2024-04-01T19:36:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506b2560:::benchmark_data_smithi188_104537_object120580:head# 2024-04-01T19:36:16.287 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506b2cbf:::benchmark_data_smithi188_104537_object48908:head# 2024-04-01T19:36:16.287 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506b4c59:::benchmark_data_smithi188_104537_object24453:head# 2024-04-01T19:36:16.288 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506bf277:::benchmark_data_smithi188_104537_object25705:head# 2024-04-01T19:36:16.288 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506c81cd:::benchmark_data_smithi188_104537_object74757:head# 2024-04-01T19:36:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506cc19f:::benchmark_data_smithi188_104537_object152786:head# 2024-04-01T19:36:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506ccfed:::benchmark_data_smithi188_104537_object150232:head# 2024-04-01T19:36:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506ce9bc:::benchmark_data_smithi188_104537_object144142:head# 2024-04-01T19:36:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506da614:::benchmark_data_smithi188_104537_object128068:head# 2024-04-01T19:36:16.291 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506dea20:::benchmark_data_smithi188_104537_object37635:head# 2024-04-01T19:36:16.292 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506e30dc:::benchmark_data_smithi188_104537_object17781:head# 2024-04-01T19:36:16.292 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506e77c3:::benchmark_data_smithi188_104537_object15334:head# 2024-04-01T19:36:16.293 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506f2cb5:::benchmark_data_smithi188_104537_object55968:head# 2024-04-01T19:36:16.293 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506f7b94:::benchmark_data_smithi188_104537_object86995:head# 2024-04-01T19:36:16.294 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:506fd0e3:::benchmark_data_smithi188_104537_object157744:head# 2024-04-01T19:36:16.294 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50707199:::benchmark_data_smithi188_104537_object147276:head# 2024-04-01T19:36:16.295 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5070aa4b:::benchmark_data_smithi188_104537_object165063:head# 2024-04-01T19:36:16.295 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5070ab81:::benchmark_data_smithi188_104537_object150835:head# 2024-04-01T19:36:16.295 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5070cfe7:::benchmark_data_smithi188_104537_object53242:head# 2024-04-01T19:36:16.296 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50712c08:::benchmark_data_smithi188_104537_object152265:head# 2024-04-01T19:36:16.296 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5072a6b6:::benchmark_data_smithi188_104537_object80239:head# 2024-04-01T19:36:16.297 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5072c770:::benchmark_data_smithi188_104537_object114575:head# 2024-04-01T19:36:16.297 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5072df1f:::benchmark_data_smithi188_104537_object125002:head# 2024-04-01T19:36:16.298 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50734923:::benchmark_data_smithi188_104537_object49806:head# 2024-04-01T19:36:16.298 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5073db53:::benchmark_data_smithi188_104537_object60363:head# 2024-04-01T19:36:16.299 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5073f57c:::benchmark_data_smithi188_104537_object140165:head# 2024-04-01T19:36:16.299 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:507463c8:::benchmark_data_smithi188_104537_object73971:head# 2024-04-01T19:36:16.300 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50754b96:::benchmark_data_smithi188_104537_object129018:head# 2024-04-01T19:36:16.300 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:507551e2:::benchmark_data_smithi188_104537_object13328:head# 2024-04-01T19:36:16.300 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5075ab6c:::benchmark_data_smithi188_104537_object59254:head# 2024-04-01T19:36:16.301 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5076a55d:::benchmark_data_smithi188_104537_object146541:head# 2024-04-01T19:36:16.301 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50772978:::benchmark_data_smithi188_104537_object165275:head# 2024-04-01T19:36:16.302 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5077e591:::benchmark_data_smithi188_104537_object97062:head# 2024-04-01T19:36:16.302 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50781e03:::benchmark_data_smithi188_104537_object54765:head# 2024-04-01T19:36:16.303 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50789b17:::benchmark_data_smithi188_104537_object103521:head# 2024-04-01T19:36:16.303 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5078aa4f:::benchmark_data_smithi188_104537_object45507:head# 2024-04-01T19:36:16.304 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5078b8d8:::benchmark_data_smithi188_104537_object74878:head# 2024-04-01T19:36:16.304 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5078ff1a:::benchmark_data_smithi188_104537_object141149:head# 2024-04-01T19:36:16.304 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50790850:::benchmark_data_smithi188_104537_object120073:head# 2024-04-01T19:36:16.305 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50798df1:::benchmark_data_smithi188_104537_object111383:head# 2024-04-01T19:36:16.305 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:507ad12a:::benchmark_data_smithi188_104537_object45640:head# 2024-04-01T19:36:16.306 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:507adfee:::benchmark_data_smithi188_104537_object59468:head# 2024-04-01T19:36:16.306 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:507aff4b:::benchmark_data_smithi188_104537_object152553:head# 2024-04-01T19:36:16.307 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:507b84db:::benchmark_data_smithi188_104537_object108295:head# 2024-04-01T19:36:16.307 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:507b9442:::benchmark_data_smithi188_104537_object131659:head# 2024-04-01T19:36:16.307 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:507bbb8d:::benchmark_data_smithi188_104537_object52376:head# 2024-04-01T19:36:16.308 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:507c12a7:::benchmark_data_smithi188_104537_object50114:head# 2024-04-01T19:36:16.308 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:507c2ad0:::benchmark_data_smithi188_104537_object20348:head# 2024-04-01T19:36:16.309 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:507c45a4:::benchmark_data_smithi188_104537_object23944:head# 2024-04-01T19:36:16.309 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:507d1916:::benchmark_data_smithi188_104537_object162796:head# 2024-04-01T19:36:16.310 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:507d6293:::benchmark_data_smithi188_104537_object17938:head# 2024-04-01T19:36:16.310 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:507d7867:::benchmark_data_smithi188_104537_object41626:head# 2024-04-01T19:36:16.311 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:507db58d:::benchmark_data_smithi188_104537_object163071:head# 2024-04-01T19:36:16.311 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:507db63a:::benchmark_data_smithi188_104537_object26793:head# 2024-04-01T19:36:16.312 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:507dd9aa:::benchmark_data_smithi188_104537_object30388:head# 2024-04-01T19:36:16.312 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:507e0d61:::benchmark_data_smithi188_104537_object84640:head# 2024-04-01T19:36:16.313 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:507e669c:::benchmark_data_smithi188_104537_object161381:head# 2024-04-01T19:36:16.313 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:507e6904:::benchmark_data_smithi188_104537_object50317:head# 2024-04-01T19:36:16.313 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:507e7932:::benchmark_data_smithi188_104537_object161341:head# 2024-04-01T19:36:16.314 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:508002fb:::benchmark_data_smithi188_104537_object142345:head# 2024-04-01T19:36:16.314 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5080474e:::benchmark_data_smithi188_104537_object17021:head# 2024-04-01T19:36:16.315 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5080d5f7:::benchmark_data_smithi188_104537_object153907:head# 2024-04-01T19:36:16.315 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5080e0ce:::benchmark_data_smithi188_104537_object13029:head# 2024-04-01T19:36:16.316 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50818965:::benchmark_data_smithi188_104537_object29959:head# 2024-04-01T19:36:16.316 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50820308:::benchmark_data_smithi188_104537_object145275:head# 2024-04-01T19:36:16.317 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5082608e:::benchmark_data_smithi188_104537_object140714:head# 2024-04-01T19:36:16.317 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:508282f2:::benchmark_data_smithi188_104537_object41554:head# 2024-04-01T19:36:16.317 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5082a864:::benchmark_data_smithi188_104537_object108965:head# 2024-04-01T19:36:16.318 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5082b954:::benchmark_data_smithi188_104537_object163707:head# 2024-04-01T19:36:16.319 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5082d9a6:::benchmark_data_smithi188_104537_object60777:head# 2024-04-01T19:36:16.319 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50831865:::benchmark_data_smithi188_104537_object125393:head# 2024-04-01T19:36:16.319 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50836447:::benchmark_data_smithi188_104537_object94335:head# 2024-04-01T19:36:16.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50838f60:::benchmark_data_smithi188_104537_object115323:head# 2024-04-01T19:36:16.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50839c62:::benchmark_data_smithi188_104537_object139312:head# 2024-04-01T19:36:16.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5083b0a4:::benchmark_data_smithi188_104537_object102879:head# 2024-04-01T19:36:16.321 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:508401e7:::benchmark_data_smithi188_104537_object22928:head# 2024-04-01T19:36:16.321 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50842542:::benchmark_data_smithi188_104537_object72974:head# 2024-04-01T19:36:16.322 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50844e1b:::benchmark_data_smithi188_104537_object152244:head# 2024-04-01T19:36:16.322 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50848cc6:::benchmark_data_smithi188_104537_object76901:head# 2024-04-01T19:36:16.322 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5084d47e:::benchmark_data_smithi188_104537_object109445:head# 2024-04-01T19:36:16.323 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5084d7ef:::benchmark_data_smithi188_104537_object134162:head# 2024-04-01T19:36:16.323 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5084eb40:::benchmark_data_smithi188_104537_object25903:head# 2024-04-01T19:36:16.324 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5085165f:::benchmark_data_smithi188_104537_object51805:head# 2024-04-01T19:36:16.324 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50852f61:::benchmark_data_smithi188_104537_object64570:head# 2024-04-01T19:36:16.325 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50854823:::benchmark_data_smithi188_104537_object85932:head# 2024-04-01T19:36:16.325 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50856c5a:::benchmark_data_smithi188_104537_object100176:head# 2024-04-01T19:36:16.326 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50857c77:::benchmark_data_smithi188_104537_object34586:head# 2024-04-01T19:36:16.326 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50864bf9:::benchmark_data_smithi188_104537_object142196:head# 2024-04-01T19:36:16.326 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5086a3a9:::benchmark_data_smithi188_104537_object55461:head# 2024-04-01T19:36:16.327 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5086b101:::benchmark_data_smithi188_104537_object135437:head# 2024-04-01T19:36:16.327 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5086fd76:::benchmark_data_smithi188_104537_object11785:head# 2024-04-01T19:36:16.328 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50871183:::benchmark_data_smithi188_104537_object139994:head# 2024-04-01T19:36:16.328 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:508885e8:::benchmark_data_smithi188_104537_object80784:head# 2024-04-01T19:36:16.328 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5088b856:::benchmark_data_smithi188_104537_object70626:head# 2024-04-01T19:36:16.329 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5088d94e:::benchmark_data_smithi188_104537_object18179:head# 2024-04-01T19:36:16.329 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5088e04a:::benchmark_data_smithi188_104537_object137133:head# 2024-04-01T19:36:16.330 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50892084:::benchmark_data_smithi188_104537_object169702:head# 2024-04-01T19:36:16.330 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:508acaf6:::benchmark_data_smithi188_104537_object166837:head# 2024-04-01T19:36:16.331 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:508b02c7:::benchmark_data_smithi188_104537_object80040:head# 2024-04-01T19:36:16.332 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:508b7698:::benchmark_data_smithi188_104537_object62620:head# 2024-04-01T19:36:16.332 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:508b99f0:::benchmark_data_smithi188_104537_object20618:head# 2024-04-01T19:36:16.333 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:508bd685:::benchmark_data_smithi188_104537_object36933:head# 2024-04-01T19:36:16.333 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:508c7d27:::benchmark_data_smithi188_104537_object11451:head# 2024-04-01T19:36:16.334 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:508ceb72:::benchmark_data_smithi188_104537_object110173:head# 2024-04-01T19:36:16.334 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:508d8561:::benchmark_data_smithi188_104537_object115434:head# 2024-04-01T19:36:16.335 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:508e5518:::benchmark_data_smithi188_104537_object21679:head# 2024-04-01T19:36:16.335 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:508e6332:::benchmark_data_smithi188_104537_object36794:head# 2024-04-01T19:36:16.335 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:508ec6af:::benchmark_data_smithi188_104537_object170825:head# 2024-04-01T19:36:16.336 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:508ecdb5:::benchmark_data_smithi188_104537_object104913:head# 2024-04-01T19:36:16.336 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:508f77be:::benchmark_data_smithi188_104537_object41595:head# 2024-04-01T19:36:16.337 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:508ff2ca:::benchmark_data_smithi188_104537_object129636:head# 2024-04-01T19:36:16.337 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50907e3f:::benchmark_data_smithi188_104537_object25702:head# 2024-04-01T19:36:16.338 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5090aaa9:::benchmark_data_smithi188_104537_object144584:head# 2024-04-01T19:36:16.338 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5090cff0:::benchmark_data_smithi188_104537_object19837:head# 2024-04-01T19:36:16.339 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50911af8:::benchmark_data_smithi188_104537_object159002:head# 2024-04-01T19:36:16.339 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50917335:::benchmark_data_smithi188_104537_object58570:head# 2024-04-01T19:36:16.340 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5091a1eb:::benchmark_data_smithi188_104537_object88468:head# 2024-04-01T19:36:16.340 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5091a26f:::benchmark_data_smithi188_104537_object37375:head# 2024-04-01T19:36:16.341 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50934f8d:::benchmark_data_smithi188_104537_object129589:head# 2024-04-01T19:36:16.341 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5093953e:::benchmark_data_smithi188_104537_object21682:head# 2024-04-01T19:36:16.341 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5093df91:::benchmark_data_smithi188_104537_object76657:head# 2024-04-01T19:36:16.342 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5093f9af:::benchmark_data_smithi188_104537_object25256:head# 2024-04-01T19:36:16.342 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:509413bc:::benchmark_data_smithi188_104537_object100363:head# 2024-04-01T19:36:16.343 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5094d87b:::benchmark_data_smithi188_104537_object35790:head# 2024-04-01T19:36:16.343 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5094e306:::benchmark_data_smithi188_104537_object68070:head# 2024-04-01T19:36:16.344 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50951aed:::benchmark_data_smithi188_104537_object40423:head# 2024-04-01T19:36:16.344 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5095af3a:::benchmark_data_smithi188_104537_object135871:head# 2024-04-01T19:36:16.345 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50962da7:::benchmark_data_smithi188_104537_object165587:head# 2024-04-01T19:36:16.345 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50964f2c:::benchmark_data_smithi188_104537_object39619:head# 2024-04-01T19:36:16.346 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5097604b:::benchmark_data_smithi188_104537_object27992:head# 2024-04-01T19:36:16.346 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50982752:::benchmark_data_smithi188_104537_object25383:head# 2024-04-01T19:36:16.347 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5098286d:::benchmark_data_smithi188_104537_object103556:head# 2024-04-01T19:36:16.347 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50989fb1:::benchmark_data_smithi188_104537_object49009:head# 2024-04-01T19:36:16.348 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5098ec32:::benchmark_data_smithi188_104537_object139064:head# 2024-04-01T19:36:16.348 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50990e37:::benchmark_data_smithi188_104537_object45839:head# 2024-04-01T19:36:16.348 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5099ac03:::benchmark_data_smithi188_104537_object139078:head# 2024-04-01T19:36:16.349 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5099bb97:::benchmark_data_smithi188_104537_object33807:head# 2024-04-01T19:36:16.349 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:509a1df3:::benchmark_data_smithi188_104537_object148569:head# 2024-04-01T19:36:16.349 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:509a367d:::benchmark_data_smithi188_104537_object125093:head# 2024-04-01T19:36:16.350 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:509a52c4:::benchmark_data_smithi188_104537_object55393:head# 2024-04-01T19:36:16.355 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:509a58d3:::benchmark_data_smithi188_104537_object117076:head# 2024-04-01T19:36:16.355 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:509b3bd6:::benchmark_data_smithi188_104537_object163291:head# 2024-04-01T19:36:16.355 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:509b4567:::benchmark_data_smithi188_104537_object20712:head# 2024-04-01T19:36:16.355 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:509bddc5:::benchmark_data_smithi188_104537_object99469:head# 2024-04-01T19:36:16.355 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:509be4c6:::benchmark_data_smithi188_104537_object91419:head# 2024-04-01T19:36:16.355 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:509c64d4:::benchmark_data_smithi188_104537_object165651:head# 2024-04-01T19:36:16.355 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:509d38fa:::benchmark_data_smithi188_104537_object93821:head# 2024-04-01T19:36:16.355 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:509e2b65:::benchmark_data_smithi188_104537_object44572:head# 2024-04-01T19:36:16.356 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:509e4d21:::benchmark_data_smithi188_104537_object48549:head# 2024-04-01T19:36:16.356 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:509edfca:::benchmark_data_smithi188_104537_object120651:head# 2024-04-01T19:36:16.356 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:509f0a8d:::benchmark_data_smithi188_104537_object68053:head# 2024-04-01T19:36:16.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:509f7fb6:::benchmark_data_smithi188_104537_object60866:head# 2024-04-01T19:36:16.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:509fa7ab:::benchmark_data_smithi188_104537_object132871:head# 2024-04-01T19:36:16.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:509fbba3:::benchmark_data_smithi188_104537_object91496:head# 2024-04-01T19:36:16.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:509ffee9:::benchmark_data_smithi188_104537_object160826:head# 2024-04-01T19:36:16.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50a0b0fe:::benchmark_data_smithi188_104537_object43725:head# 2024-04-01T19:36:16.358 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50a1fc7b:::benchmark_data_smithi188_104537_object41104:head# 2024-04-01T19:36:16.358 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50a223f2:::benchmark_data_smithi188_104537_object22159:head# 2024-04-01T19:36:16.359 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50a246f0:::benchmark_data_smithi188_104537_object111436:head# 2024-04-01T19:36:16.359 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50a2d023:::benchmark_data_smithi188_104537_object85400:head# 2024-04-01T19:36:16.360 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50a315ea:::benchmark_data_smithi188_104537_object116868:head# 2024-04-01T19:36:16.360 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50a516d2:::benchmark_data_smithi188_104537_object165769:head# 2024-04-01T19:36:16.361 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50a52321:::benchmark_data_smithi188_104537_object149856:head# 2024-04-01T19:36:16.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:16 smithi022 ceph-mon[39439]: pgmap v891: 17 pgs: 2 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 13580/321960 objects degraded (4.218%); 58 MiB/s, 935 objects/s recovering 2024-04-01T19:36:16.361 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50a59ccd:::benchmark_data_smithi188_104537_object133869:head# 2024-04-01T19:36:16.362 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50a64c73:::benchmark_data_smithi188_104537_object91663:head# 2024-04-01T19:36:16.362 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50a683e3:::benchmark_data_smithi188_104537_object167193:head# 2024-04-01T19:36:16.362 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50a6b652:::benchmark_data_smithi188_104537_object47678:head# 2024-04-01T19:36:16.363 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50a6ef61:::benchmark_data_smithi188_104537_object130353:head# 2024-04-01T19:36:16.363 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50a7fbb7:::benchmark_data_smithi188_104537_object62512:head# 2024-04-01T19:36:16.363 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50a847c3:::benchmark_data_smithi188_104537_object136195:head# 2024-04-01T19:36:16.364 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50a895c3:::benchmark_data_smithi188_104537_object117326:head# 2024-04-01T19:36:16.364 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50a90930:::benchmark_data_smithi188_104537_object121958:head# 2024-04-01T19:36:16.365 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50a937e2:::benchmark_data_smithi188_104537_object78008:head# 2024-04-01T19:36:16.366 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50a9a193:::benchmark_data_smithi188_104537_object34697:head# 2024-04-01T19:36:16.366 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50aa9589:::benchmark_data_smithi188_104537_object143847:head# 2024-04-01T19:36:16.366 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50aa9f6f:::benchmark_data_smithi188_104537_object86808:head# 2024-04-01T19:36:16.367 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50aab509:::benchmark_data_smithi188_104537_object109000:head# 2024-04-01T19:36:16.367 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50ab2e85:::benchmark_data_smithi188_104537_object115324:head# 2024-04-01T19:36:16.368 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50abcf38:::benchmark_data_smithi188_104537_object111796:head# 2024-04-01T19:36:16.368 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50ac723e:::benchmark_data_smithi188_104537_object86170:head# 2024-04-01T19:36:16.368 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50ad19d7:::benchmark_data_smithi188_104537_object14329:head# 2024-04-01T19:36:16.369 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50ad2278:::benchmark_data_smithi188_104537_object43772:head# 2024-04-01T19:36:16.370 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50ada471:::benchmark_data_smithi188_104537_object122779:head# 2024-04-01T19:36:16.370 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50adc8b7:::benchmark_data_smithi188_104537_object99563:head# 2024-04-01T19:36:16.370 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50adf386:::benchmark_data_smithi188_104537_object129171:head# 2024-04-01T19:36:16.371 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50ae5fa4:::benchmark_data_smithi188_104537_object133254:head# 2024-04-01T19:36:16.371 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50ae8a47:::benchmark_data_smithi188_104537_object114446:head# 2024-04-01T19:36:16.372 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50af9eb1:::benchmark_data_smithi188_104537_object154754:head# 2024-04-01T19:36:16.372 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b060b9:::benchmark_data_smithi188_104537_object123502:head# 2024-04-01T19:36:16.373 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b0be9c:::benchmark_data_smithi188_104537_object20523:head# 2024-04-01T19:36:16.373 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b0e746:::benchmark_data_smithi188_104537_object87042:head# 2024-04-01T19:36:16.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:16 smithi188 ceph-mon[43939]: pgmap v891: 17 pgs: 2 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 13580/321960 objects degraded (4.218%); 58 MiB/s, 935 objects/s recovering 2024-04-01T19:36:16.374 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b0f5c1:::benchmark_data_smithi188_104537_object152282:head# 2024-04-01T19:36:16.374 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b18574:::benchmark_data_smithi188_104537_object155089:head# 2024-04-01T19:36:16.374 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b2b09a:::benchmark_data_smithi188_104537_object156016:head# 2024-04-01T19:36:16.375 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b2da14:::benchmark_data_smithi188_104537_object55826:head# 2024-04-01T19:36:16.375 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b329e1:::benchmark_data_smithi188_104537_object12943:head# 2024-04-01T19:36:16.376 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b33737:::benchmark_data_smithi188_104537_object69028:head# 2024-04-01T19:36:16.376 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b35d78:::benchmark_data_smithi188_104537_object145763:head# 2024-04-01T19:36:16.377 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b36c35:::benchmark_data_smithi188_104537_object82076:head# 2024-04-01T19:36:16.377 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b37467:::benchmark_data_smithi188_104537_object17294:head# 2024-04-01T19:36:16.378 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b3bb69:::benchmark_data_smithi188_104537_object134246:head# 2024-04-01T19:36:16.378 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b447cb:::benchmark_data_smithi188_104537_object126040:head# 2024-04-01T19:36:16.379 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b4b265:::benchmark_data_smithi188_104537_object50014:head# 2024-04-01T19:36:16.379 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b4da33:::benchmark_data_smithi188_104537_object45311:head# 2024-04-01T19:36:16.380 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b61db9:::benchmark_data_smithi188_104537_object95311:head# 2024-04-01T19:36:16.380 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b61e7a:::benchmark_data_smithi188_104537_object32649:head# 2024-04-01T19:36:16.381 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b64d25:::benchmark_data_smithi188_104537_object72759:head# 2024-04-01T19:36:16.381 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b6b19e:::benchmark_data_smithi188_104537_object41081:head# 2024-04-01T19:36:16.381 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b71f74:::benchmark_data_smithi188_104537_object101156:head# 2024-04-01T19:36:16.382 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b81df8:::benchmark_data_smithi188_104537_object120723:head# 2024-04-01T19:36:16.382 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b8abbb:::benchmark_data_smithi188_104537_object113425:head# 2024-04-01T19:36:16.383 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b8e9da:::benchmark_data_smithi188_104537_object128143:head# 2024-04-01T19:36:16.383 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b9d525:::benchmark_data_smithi188_104537_object84961:head# 2024-04-01T19:36:16.384 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50b9fa9e:::benchmark_data_smithi188_104537_object35751:head# 2024-04-01T19:36:16.384 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50bb52d7:::benchmark_data_smithi188_104537_object113285:head# 2024-04-01T19:36:16.384 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50bb653a:::benchmark_data_smithi188_104537_object28436:head# 2024-04-01T19:36:16.385 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50bbe5de:::benchmark_data_smithi188_104537_object169146:head# 2024-04-01T19:36:16.385 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50bbfff0:::benchmark_data_smithi188_104537_object169517:head# 2024-04-01T19:36:16.386 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50bc1c16:::benchmark_data_smithi188_104537_object103154:head# 2024-04-01T19:36:16.386 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50bcd826:::benchmark_data_smithi188_104537_object101035:head# 2024-04-01T19:36:16.387 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50bcef57:::benchmark_data_smithi188_104537_object138066:head# 2024-04-01T19:36:16.387 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50bdfc83:::benchmark_data_smithi188_104537_object147518:head# 2024-04-01T19:36:16.387 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50be46c7:::benchmark_data_smithi188_104537_object42530:head# 2024-04-01T19:36:16.388 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50bee573:::benchmark_data_smithi188_104537_object43942:head# 2024-04-01T19:36:16.389 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50bf7c37:::benchmark_data_smithi188_104537_object164103:head# 2024-04-01T19:36:16.389 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50bfefa3:::benchmark_data_smithi188_104537_object53372:head# 2024-04-01T19:36:16.389 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c02e75:::benchmark_data_smithi188_104537_object161689:head# 2024-04-01T19:36:16.390 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c03426:::benchmark_data_smithi188_104537_object57517:head# 2024-04-01T19:36:16.390 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c03e97:::benchmark_data_smithi188_104537_object53577:head# 2024-04-01T19:36:16.391 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c05515:::benchmark_data_smithi188_104537_object107799:head# 2024-04-01T19:36:16.391 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c09438:::benchmark_data_smithi188_104537_object13581:head# 2024-04-01T19:36:16.391 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c0eeac:::benchmark_data_smithi188_104537_object40647:head# 2024-04-01T19:36:16.392 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c1b0cb:::benchmark_data_smithi188_104537_object88130:head# 2024-04-01T19:36:16.392 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c2a906:::benchmark_data_smithi188_104537_object61928:head# 2024-04-01T19:36:16.393 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c2bbc7:::benchmark_data_smithi188_104537_object160365:head# 2024-04-01T19:36:16.394 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c4248e:::benchmark_data_smithi188_104537_object18759:head# 2024-04-01T19:36:16.394 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c4c40c:::benchmark_data_smithi188_104537_object162768:head# 2024-04-01T19:36:16.395 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c5a533:::benchmark_data_smithi188_104537_object21982:head# 2024-04-01T19:36:16.395 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c5a9e3:::benchmark_data_smithi188_104537_object112155:head# 2024-04-01T19:36:16.395 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c5c20d:::benchmark_data_smithi188_104537_object26420:head# 2024-04-01T19:36:16.396 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c5d6d1:::benchmark_data_smithi188_104537_object27065:head# 2024-04-01T19:36:16.396 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c6398f:::benchmark_data_smithi188_104537_object16143:head# 2024-04-01T19:36:16.397 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c66054:::benchmark_data_smithi188_104537_object49596:head# 2024-04-01T19:36:16.397 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c6b615:::benchmark_data_smithi188_104537_object44272:head# 2024-04-01T19:36:16.398 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c6f46e:::benchmark_data_smithi188_104537_object148861:head# 2024-04-01T19:36:16.398 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c73f27:::benchmark_data_smithi188_104537_object52403:head# 2024-04-01T19:36:16.399 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c76ec0:::benchmark_data_smithi188_104537_object51833:head# 2024-04-01T19:36:16.399 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c7d528:::benchmark_data_smithi188_104537_object24165:head# 2024-04-01T19:36:16.400 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c83e64:::benchmark_data_smithi188_104537_object84444:head# 2024-04-01T19:36:16.400 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c8993d:::benchmark_data_smithi188_104537_object107775:head# 2024-04-01T19:36:16.400 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c95470:::benchmark_data_smithi188_104537_object110433:head# 2024-04-01T19:36:16.401 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c97749:::benchmark_data_smithi188_104537_object150042:head# 2024-04-01T19:36:16.401 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50c984da:::benchmark_data_smithi188_104537_object88569:head# 2024-04-01T19:36:16.402 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50ca7fc9:::benchmark_data_smithi188_104537_object12238:head# 2024-04-01T19:36:16.402 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50ca9759:::benchmark_data_smithi188_104537_object143206:head# 2024-04-01T19:36:16.403 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50cb3254:::benchmark_data_smithi188_104537_object91433:head# 2024-04-01T19:36:16.404 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50cb62b3:::benchmark_data_smithi188_104537_object106583:head# 2024-04-01T19:36:16.404 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50ccc3bb:::benchmark_data_smithi188_104537_object39879:head# 2024-04-01T19:36:16.404 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50cd2e5c:::benchmark_data_smithi188_104537_object110999:head# 2024-04-01T19:36:16.405 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50cdf635:::benchmark_data_smithi188_104537_object66247:head# 2024-04-01T19:36:16.405 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50cdf87c:::benchmark_data_smithi188_104537_object133184:head# 2024-04-01T19:36:16.406 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50ce5723:::benchmark_data_smithi188_104537_object43945:head# 2024-04-01T19:36:16.406 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50cef6c1:::benchmark_data_smithi188_104537_object87580:head# 2024-04-01T19:36:16.406 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50cf0afc:::benchmark_data_smithi188_104537_object11557:head# 2024-04-01T19:36:16.407 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50d05389:::benchmark_data_smithi188_104537_object103489:head# 2024-04-01T19:36:16.408 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50d0d218:::benchmark_data_smithi188_104537_object138937:head# 2024-04-01T19:36:16.408 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50d105e3:::benchmark_data_smithi188_104537_object44752:head# 2024-04-01T19:36:16.408 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50d1487b:::benchmark_data_smithi188_104537_object49372:head# 2024-04-01T19:36:16.409 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50d1520c:::benchmark_data_smithi188_104537_object154288:head# 2024-04-01T19:36:16.409 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50d1cd80:::benchmark_data_smithi188_104537_object111386:head# 2024-04-01T19:36:16.410 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50d2849f:::benchmark_data_smithi188_104537_object69879:head# 2024-04-01T19:36:16.410 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50d28d64:::benchmark_data_smithi188_104537_object46503:head# 2024-04-01T19:36:16.411 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50d35369:::benchmark_data_smithi188_104537_object39386:head# 2024-04-01T19:36:16.411 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50d368eb:::benchmark_data_smithi188_104537_object99858:head# 2024-04-01T19:36:16.412 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50d3dc7a:::benchmark_data_smithi188_104537_object111183:head# 2024-04-01T19:36:16.412 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50d48083:::benchmark_data_smithi188_104537_object47150:head# 2024-04-01T19:36:16.413 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50d5058a:::benchmark_data_smithi188_104537_object34943:head# 2024-04-01T19:36:16.413 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50d54b75:::benchmark_data_smithi188_104537_object51338:head# 2024-04-01T19:36:16.414 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50d550c0:::benchmark_data_smithi188_104537_object63685:head# 2024-04-01T19:36:16.415 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50d5dc6e:::benchmark_data_smithi188_104537_object59204:head# 2024-04-01T19:36:16.415 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50d6a17f:::benchmark_data_smithi188_104537_object74529:head# 2024-04-01T19:36:16.415 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50d78664:::benchmark_data_smithi188_104537_object109482:head# 2024-04-01T19:36:16.416 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50d7ee1d:::benchmark_data_smithi188_104537_object40987:head# 2024-04-01T19:36:16.416 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50d8c333:::benchmark_data_smithi188_104537_object99109:head# 2024-04-01T19:36:16.417 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50d9d573:::benchmark_data_smithi188_104537_object113592:head# 2024-04-01T19:36:16.417 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50d9d688:::benchmark_data_smithi188_104537_object120677:head# 2024-04-01T19:36:16.418 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50da31b8:::benchmark_data_smithi188_104537_object72808:head# 2024-04-01T19:36:16.418 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50da6a4f:::benchmark_data_smithi188_104537_object84570:head# 2024-04-01T19:36:16.419 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50daaff8:::benchmark_data_smithi188_104537_object73143:head# 2024-04-01T19:36:16.419 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50dad233:::benchmark_data_smithi188_104537_object54318:head# 2024-04-01T19:36:16.419 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50dae341:::benchmark_data_smithi188_104537_object54003:head# 2024-04-01T19:36:16.420 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50db8298:::benchmark_data_smithi188_104537_object59621:head# 2024-04-01T19:36:16.421 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50dc02d1:::benchmark_data_smithi188_104537_object26996:head# 2024-04-01T19:36:16.421 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50dc6ec0:::benchmark_data_smithi188_104537_object109462:head# 2024-04-01T19:36:16.421 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50dd3e06:::benchmark_data_smithi188_104537_object58735:head# 2024-04-01T19:36:16.422 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50dd8e06:::benchmark_data_smithi188_104537_object37596:head# 2024-04-01T19:36:16.422 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50ddd817:::benchmark_data_smithi188_104537_object101808:head# 2024-04-01T19:36:16.423 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50ddf517:::benchmark_data_smithi188_104537_object40355:head# 2024-04-01T19:36:16.423 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50ddfdce:::benchmark_data_smithi188_104537_object17454:head# 2024-04-01T19:36:16.424 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50de31bd:::benchmark_data_smithi188_104537_object25284:head# 2024-04-01T19:36:16.424 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50de75e4:::benchmark_data_smithi188_104537_object167489:head# 2024-04-01T19:36:16.425 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50df714d:::benchmark_data_smithi188_104537_object93053:head# 2024-04-01T19:36:16.426 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50dff94a:::benchmark_data_smithi188_104537_object155412:head# 2024-04-01T19:36:16.426 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e048e4:::benchmark_data_smithi188_104537_object159448:head# 2024-04-01T19:36:16.426 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e0e3c0:::benchmark_data_smithi188_104537_object151823:head# 2024-04-01T19:36:16.427 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e0f62f:::benchmark_data_smithi188_104537_object19233:head# 2024-04-01T19:36:16.427 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e10454:::benchmark_data_smithi188_104537_object87897:head# 2024-04-01T19:36:16.427 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e14393:::benchmark_data_smithi188_104537_object70759:head# 2024-04-01T19:36:16.428 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e22cef:::benchmark_data_smithi188_104537_object14621:head# 2024-04-01T19:36:16.428 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e279a7:::benchmark_data_smithi188_104537_object18134:head# 2024-04-01T19:36:16.429 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e2a52b:::benchmark_data_smithi188_104537_object77501:head# 2024-04-01T19:36:16.429 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e2b67b:::benchmark_data_smithi188_104537_object106754:head# 2024-04-01T19:36:16.430 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e2e747:::benchmark_data_smithi188_104537_object171150:head# 2024-04-01T19:36:16.430 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e31764:::benchmark_data_smithi188_104537_object44171:head# 2024-04-01T19:36:16.431 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e31ece:::benchmark_data_smithi188_104537_object97452:head# 2024-04-01T19:36:16.431 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e35783:::benchmark_data_smithi188_104537_object75460:head# 2024-04-01T19:36:16.431 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e3886d:::benchmark_data_smithi188_104537_object116438:head# 2024-04-01T19:36:16.432 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e3b2d8:::benchmark_data_smithi188_104537_object156095:head# 2024-04-01T19:36:16.432 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e43cfd:::benchmark_data_smithi188_104537_object53258:head# 2024-04-01T19:36:16.433 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e473f0:::benchmark_data_smithi188_104537_object115528:head# 2024-04-01T19:36:16.433 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e4d780:::benchmark_data_smithi188_104537_object78059:head# 2024-04-01T19:36:16.434 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e52a2a:::benchmark_data_smithi188_104537_object139547:head# 2024-04-01T19:36:16.434 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e628df:::benchmark_data_smithi188_104537_object153418:head# 2024-04-01T19:36:16.435 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e72714:::benchmark_data_smithi188_104537_object19235:head# 2024-04-01T19:36:16.435 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e73a95:::benchmark_data_smithi188_104537_object94719:head# 2024-04-01T19:36:16.436 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e7a0d5:::benchmark_data_smithi188_104537_object107708:head# 2024-04-01T19:36:16.436 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e7bf3b:::benchmark_data_smithi188_104537_object68558:head# 2024-04-01T19:36:16.437 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e88129:::benchmark_data_smithi188_104537_object162298:head# 2024-04-01T19:36:16.437 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e8ec66:::benchmark_data_smithi188_104537_object64096:head# 2024-04-01T19:36:16.438 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e955b4:::benchmark_data_smithi188_104537_object125103:head# 2024-04-01T19:36:16.438 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e97d23:::benchmark_data_smithi188_104537_object130375:head# 2024-04-01T19:36:16.439 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50e9c570:::benchmark_data_smithi188_104537_object33658:head# 2024-04-01T19:36:16.439 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50eb53d8:::benchmark_data_smithi188_104537_object156250:head# 2024-04-01T19:36:16.440 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50ec845f:::benchmark_data_smithi188_104537_object102209:head# 2024-04-01T19:36:16.440 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50ec87db:::benchmark_data_smithi188_104537_object81105:head# 2024-04-01T19:36:16.441 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50ed4431:::benchmark_data_smithi188_104537_object45519:head# 2024-04-01T19:36:16.441 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50ed8684:::benchmark_data_smithi188_104537_object170219:head# 2024-04-01T19:36:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50ee8878:::benchmark_data_smithi188_104537_object126804:head# 2024-04-01T19:36:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50eeb665:::benchmark_data_smithi188_104537_object155383:head# 2024-04-01T19:36:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50ef2bbf:::benchmark_data_smithi188_104537_object146094:head# 2024-04-01T19:36:16.443 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50f026da:::benchmark_data_smithi188_104537_object90318:head# 2024-04-01T19:36:16.444 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50f040ce:::benchmark_data_smithi188_104537_object68657:head# 2024-04-01T19:36:16.444 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50f0bf17:::benchmark_data_smithi188_104537_object170658:head# 2024-04-01T19:36:16.444 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50f138d9:::benchmark_data_smithi188_104537_object115077:head# 2024-04-01T19:36:16.445 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50f1b09e:::benchmark_data_smithi188_104537_object94499:head# 2024-04-01T19:36:16.445 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50f21c69:::benchmark_data_smithi188_104537_object89402:head# 2024-04-01T19:36:16.445 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50f262a6:::benchmark_data_smithi188_104537_object27555:head# 2024-04-01T19:36:16.446 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50f28757:::benchmark_data_smithi188_104537_object25170:head# 2024-04-01T19:36:16.446 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50f2efec:::benchmark_data_smithi188_104537_object165399:head# 2024-04-01T19:36:16.447 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50f2fc65:::benchmark_data_smithi188_104537_object152032:head# 2024-04-01T19:36:16.447 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50f5f4c3:::benchmark_data_smithi188_104537_object144972:head# 2024-04-01T19:36:16.448 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50f60aa0:::benchmark_data_smithi188_104537_object71877:head# 2024-04-01T19:36:16.448 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50f6a75a:::benchmark_data_smithi188_104537_object48315:head# 2024-04-01T19:36:16.448 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50f72f1b:::benchmark_data_smithi188_104537_object78158:head# 2024-04-01T19:36:16.449 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50f77969:::benchmark_data_smithi188_104537_object94113:head# 2024-04-01T19:36:16.449 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50f82192:::benchmark_data_smithi188_104537_object30820:head# 2024-04-01T19:36:16.450 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50f86c2b:::benchmark_data_smithi188_104537_object56306:head# 2024-04-01T19:36:16.450 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50f8e9f3:::benchmark_data_smithi188_104537_object91955:head# 2024-04-01T19:36:16.451 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50fa4fdb:::benchmark_data_smithi188_104537_object51765:head# 2024-04-01T19:36:16.451 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50fa8b7a:::benchmark_data_smithi188_104537_object86499:head# 2024-04-01T19:36:16.451 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50fb0286:::benchmark_data_smithi188_104537_object120558:head# 2024-04-01T19:36:16.452 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50fb4a2c:::benchmark_data_smithi188_104537_object131496:head# 2024-04-01T19:36:16.452 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50fbd201:::benchmark_data_smithi188_104537_object128172:head# 2024-04-01T19:36:16.453 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50fc126d:::benchmark_data_smithi188_104537_object126169:head# 2024-04-01T19:36:16.453 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50fc4842:::benchmark_data_smithi188_104537_object87987:head# 2024-04-01T19:36:16.454 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50fcbe37:::benchmark_data_smithi188_104537_object51525:head# 2024-04-01T19:36:16.454 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50fd3f12:::benchmark_data_smithi188_104537_object132889:head# 2024-04-01T19:36:16.455 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50fdae35:::benchmark_data_smithi188_104537_object43911:head# 2024-04-01T19:36:16.455 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50fe213b:::benchmark_data_smithi188_104537_object164291:head# 2024-04-01T19:36:16.456 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50feba1b:::benchmark_data_smithi188_104537_object37846:head# 2024-04-01T19:36:16.456 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50fedd6e:::benchmark_data_smithi188_104537_object145775:head# 2024-04-01T19:36:16.457 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:50ff489c:::benchmark_data_smithi188_104537_object83779:head# 2024-04-01T19:36:16.457 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51000e6b:::benchmark_data_smithi188_104537_object149711:head# 2024-04-01T19:36:16.458 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51008acd:::benchmark_data_smithi188_104537_object93476:head# 2024-04-01T19:36:16.458 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51012eab:::benchmark_data_smithi188_104537_object34860:head# 2024-04-01T19:36:16.459 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5101cd65:::benchmark_data_smithi188_104537_object71824:head# 2024-04-01T19:36:16.459 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5101da52:::benchmark_data_smithi188_104537_object47013:head# 2024-04-01T19:36:16.460 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51021144:::benchmark_data_smithi188_104537_object95413:head# 2024-04-01T19:36:16.460 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:510290b0:::benchmark_data_smithi188_104537_object17932:head# 2024-04-01T19:36:16.461 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5102dfcf:::benchmark_data_smithi188_104537_object21856:head# 2024-04-01T19:36:16.461 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5103a678:::benchmark_data_smithi188_104537_object66559:head# 2024-04-01T19:36:16.462 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5103b644:::benchmark_data_smithi188_104537_object168864:head# 2024-04-01T19:36:16.462 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51044fa2:::benchmark_data_smithi188_104537_object170236:head# 2024-04-01T19:36:16.462 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5104c304:::benchmark_data_smithi188_104537_object97748:head# 2024-04-01T19:36:16.463 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5104f09a:::benchmark_data_smithi188_104537_object147469:head# 2024-04-01T19:36:16.463 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:510596a3:::benchmark_data_smithi188_104537_object147646:head# 2024-04-01T19:36:16.463 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5105f8bb:::benchmark_data_smithi188_104537_object76302:head# 2024-04-01T19:36:16.464 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5105fafa:::benchmark_data_smithi188_104537_object80818:head# 2024-04-01T19:36:16.464 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:510610e1:::benchmark_data_smithi188_104537_object95335:head# 2024-04-01T19:36:16.465 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51063f8b:::benchmark_data_smithi188_104537_object79113:head# 2024-04-01T19:36:16.465 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5106e2d0:::benchmark_data_smithi188_104537_object48165:head# 2024-04-01T19:36:16.466 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5107c032:::benchmark_data_smithi188_104537_object86625:head# 2024-04-01T19:36:16.466 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5107fcd1:::benchmark_data_smithi188_104537_object124779:head# 2024-04-01T19:36:16.467 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51085ff2:::benchmark_data_smithi188_104537_object145522:head# 2024-04-01T19:36:16.467 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51098b95:::benchmark_data_smithi188_104537_object63115:head# 2024-04-01T19:36:16.467 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:510990e0:::benchmark_data_smithi188_104537_object138489:head# 2024-04-01T19:36:16.468 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5109949e:::benchmark_data_smithi188_104537_object161042:head# 2024-04-01T19:36:16.468 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51099837:::benchmark_data_smithi188_104537_object144528:head# 2024-04-01T19:36:16.469 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5109a9b3:::benchmark_data_smithi188_104537_object60959:head# 2024-04-01T19:36:16.469 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5109cc5f:::benchmark_data_smithi188_104537_object171919:head# 2024-04-01T19:36:16.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5109d699:::benchmark_data_smithi188_104537_object98373:head# 2024-04-01T19:36:16.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:510a6dbb:::benchmark_data_smithi188_104537_object55471:head# 2024-04-01T19:36:16.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:510a6ee7:::benchmark_data_smithi188_104537_object168317:head# 2024-04-01T19:36:16.471 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:510b5b80:::benchmark_data_smithi188_104537_object115544:head# 2024-04-01T19:36:16.472 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:510bfd27:::benchmark_data_smithi188_104537_object160270:head# 2024-04-01T19:36:16.472 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:510c85ae:::benchmark_data_smithi188_104537_object93022:head# 2024-04-01T19:36:16.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:510cf7f9:::benchmark_data_smithi188_104537_object139204:head# 2024-04-01T19:36:16.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:510dc563:::benchmark_data_smithi188_104537_object22889:head# 2024-04-01T19:36:16.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:510eee54:::benchmark_data_smithi188_104537_object165385:head# 2024-04-01T19:36:16.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:510ff344:::benchmark_data_smithi188_104537_object77777:head# 2024-04-01T19:36:16.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:511017d4:::benchmark_data_smithi188_104537_object154950:head# 2024-04-01T19:36:16.475 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51102451:::benchmark_data_smithi188_104537_object39671:head# 2024-04-01T19:36:16.475 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:511030d8:::benchmark_data_smithi188_104537_object157891:head# 2024-04-01T19:36:16.476 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5110803c:::benchmark_data_smithi188_104537_object112649:head# 2024-04-01T19:36:16.477 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5111823e:::benchmark_data_smithi188_104537_object100122:head# 2024-04-01T19:36:16.477 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5111abeb:::benchmark_data_smithi188_104537_object117909:head# 2024-04-01T19:36:16.478 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5111cb4c:::benchmark_data_smithi188_104537_object16577:head# 2024-04-01T19:36:16.478 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51142485:::benchmark_data_smithi188_104537_object46554:head# 2024-04-01T19:36:16.479 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51145fbf:::benchmark_data_smithi188_104537_object127224:head# 2024-04-01T19:36:16.479 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:511474b4:::benchmark_data_smithi188_104537_object95516:head# 2024-04-01T19:36:16.480 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:511548f2:::benchmark_data_smithi188_104537_object165505:head# 2024-04-01T19:36:16.480 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51155c1c:::benchmark_data_smithi188_104537_object31826:head# 2024-04-01T19:36:16.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5115bdb4:::benchmark_data_smithi188_104537_object26275:head# 2024-04-01T19:36:16.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5115ce27:::benchmark_data_smithi188_104537_object41811:head# 2024-04-01T19:36:16.482 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51178223:::benchmark_data_smithi188_104537_object85111:head# 2024-04-01T19:36:16.482 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5117b0ff:::benchmark_data_smithi188_104537_object137492:head# 2024-04-01T19:36:16.483 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51185914:::benchmark_data_smithi188_104537_object90577:head# 2024-04-01T19:36:16.483 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5118e21c:::benchmark_data_smithi188_104537_object38264:head# 2024-04-01T19:36:16.484 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5119c8ee:::benchmark_data_smithi188_104537_object101642:head# 2024-04-01T19:36:16.484 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:511a31b5:::benchmark_data_smithi188_104537_object159703:head# 2024-04-01T19:36:16.485 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:511a6aaf:::benchmark_data_smithi188_104537_object22697:head# 2024-04-01T19:36:16.485 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:511aa87e:::benchmark_data_smithi188_104537_object30234:head# 2024-04-01T19:36:16.486 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:511b1442:::benchmark_data_smithi188_104537_object41437:head# 2024-04-01T19:36:16.486 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:511b2aad:::benchmark_data_smithi188_104537_object14587:head# 2024-04-01T19:36:16.486 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:511be06b:::benchmark_data_smithi188_104537_object70789:head# 2024-04-01T19:36:16.487 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:511c6acd:::benchmark_data_smithi188_104537_object158011:head# 2024-04-01T19:36:16.487 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:511c6ff2:::benchmark_data_smithi188_104537_object144815:head# 2024-04-01T19:36:16.488 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:511c84c0:::benchmark_data_smithi188_104537_object16908:head# 2024-04-01T19:36:16.488 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:511d2810:::benchmark_data_smithi188_104537_object21272:head# 2024-04-01T19:36:16.489 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:511d66e8:::benchmark_data_smithi188_104537_object87753:head# 2024-04-01T19:36:16.489 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:511ec531:::benchmark_data_smithi188_104537_object18089:head# 2024-04-01T19:36:16.490 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:511ec533:::benchmark_data_smithi188_104537_object79450:head# 2024-04-01T19:36:16.490 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:511f2f62:::benchmark_data_smithi188_104537_object114508:head# 2024-04-01T19:36:16.491 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:511fcb1c:::benchmark_data_smithi188_104537_object74333:head# 2024-04-01T19:36:16.491 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:511fe22b:::benchmark_data_smithi188_104537_object68686:head# 2024-04-01T19:36:16.492 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51202f13:::benchmark_data_smithi188_104537_object11969:head# 2024-04-01T19:36:16.492 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51217530:::benchmark_data_smithi188_104537_object70006:head# 2024-04-01T19:36:16.493 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:512184a2:::benchmark_data_smithi188_104537_object30642:head# 2024-04-01T19:36:16.493 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:512211e1:::benchmark_data_smithi188_104537_object155902:head# 2024-04-01T19:36:16.494 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51237b94:::benchmark_data_smithi188_104537_object128470:head# 2024-04-01T19:36:16.494 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5123a737:::benchmark_data_smithi188_104537_object53974:head# 2024-04-01T19:36:16.495 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5124f1a5:::benchmark_data_smithi188_104537_object11270:head# 2024-04-01T19:36:16.495 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51255f35:::benchmark_data_smithi188_104537_object160549:head# 2024-04-01T19:36:16.495 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5126748e:::benchmark_data_smithi188_104537_object164317:head# 2024-04-01T19:36:16.496 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51268983:::benchmark_data_smithi188_104537_object142064:head# 2024-04-01T19:36:16.497 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:512689e4:::benchmark_data_smithi188_104537_object143736:head# 2024-04-01T19:36:16.497 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51268c59:::benchmark_data_smithi188_104537_object133432:head# 2024-04-01T19:36:16.497 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5126b8f6:::benchmark_data_smithi188_104537_object161847:head# 2024-04-01T19:36:16.498 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51276efd:::benchmark_data_smithi188_104537_object165811:head# 2024-04-01T19:36:16.498 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51279927:::benchmark_data_smithi188_104537_object133887:head# 2024-04-01T19:36:16.499 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:512837b5:::benchmark_data_smithi188_104537_object18437:head# 2024-04-01T19:36:16.499 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51284d82:::benchmark_data_smithi188_104537_object79475:head# 2024-04-01T19:36:16.500 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5128d2c6:::benchmark_data_smithi188_104537_object133449:head# 2024-04-01T19:36:16.500 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:512a499a:::benchmark_data_smithi188_104537_object82959:head# 2024-04-01T19:36:16.501 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:512acb20:::benchmark_data_smithi188_104537_object139700:head# 2024-04-01T19:36:16.501 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:512b5d3a:::benchmark_data_smithi188_104537_object112365:head# 2024-04-01T19:36:16.501 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:512bb503:::benchmark_data_smithi188_104537_object95641:head# 2024-04-01T19:36:16.502 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:512c70f0:::benchmark_data_smithi188_104537_object33298:head# 2024-04-01T19:36:16.502 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:512ccc37:::benchmark_data_smithi188_104537_object54165:head# 2024-04-01T19:36:16.503 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:512d18de:::benchmark_data_smithi188_104537_object107054:head# 2024-04-01T19:36:16.503 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:512d28df:::benchmark_data_smithi188_104537_object18972:head# 2024-04-01T19:36:16.504 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:512dccdd:::benchmark_data_smithi188_104537_object93914:head# 2024-04-01T19:36:16.505 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:512e1e18:::benchmark_data_smithi188_104537_object25612:head# 2024-04-01T19:36:16.505 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:512e25ac:::benchmark_data_smithi188_104537_object156202:head# 2024-04-01T19:36:16.505 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:512ed593:::benchmark_data_smithi188_104537_object37901:head# 2024-04-01T19:36:16.506 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:512f6fbd:::benchmark_data_smithi188_104537_object133907:head# 2024-04-01T19:36:16.506 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:512f80f4:::benchmark_data_smithi188_104537_object94368:head# 2024-04-01T19:36:16.507 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:512fd3aa:::benchmark_data_smithi188_104537_object59668:head# 2024-04-01T19:36:16.507 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:512fea65:::benchmark_data_smithi188_104537_object110945:head# 2024-04-01T19:36:16.507 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:512feda0:::benchmark_data_smithi188_104537_object153379:head# 2024-04-01T19:36:16.508 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:512ffd0d:::benchmark_data_smithi188_104537_object103167:head# 2024-04-01T19:36:16.508 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51303a29:::benchmark_data_smithi188_104537_object126979:head# 2024-04-01T19:36:16.509 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51305c9d:::benchmark_data_smithi188_104537_object119491:head# 2024-04-01T19:36:16.509 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:513069e2:::benchmark_data_smithi188_104537_object47233:head# 2024-04-01T19:36:16.509 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5131263b:::benchmark_data_smithi188_104537_object131010:head# 2024-04-01T19:36:16.510 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51319b75:::benchmark_data_smithi188_104537_object165633:head# 2024-04-01T19:36:16.510 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5131cb06:::benchmark_data_smithi188_104537_object103967:head# 2024-04-01T19:36:16.511 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5131e45b:::benchmark_data_smithi188_104537_object58182:head# 2024-04-01T19:36:16.511 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5132cd55:::benchmark_data_smithi188_104537_object86143:head# 2024-04-01T19:36:16.511 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5132fb6d:::benchmark_data_smithi188_104537_object152671:head# 2024-04-01T19:36:16.512 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:513358c0:::benchmark_data_smithi188_104537_object11724:head# 2024-04-01T19:36:16.512 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5134236f:::benchmark_data_smithi188_104537_object109426:head# 2024-04-01T19:36:16.513 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51347437:::benchmark_data_smithi188_104537_object93450:head# 2024-04-01T19:36:16.513 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51349989:::benchmark_data_smithi188_104537_object12964:head# 2024-04-01T19:36:16.514 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51349a38:::benchmark_data_smithi188_104537_object168001:head# 2024-04-01T19:36:16.515 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5134ff8d:::benchmark_data_smithi188_104537_object59568:head# 2024-04-01T19:36:16.515 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51353ea5:::benchmark_data_smithi188_104537_object21357:head# 2024-04-01T19:36:16.516 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51364476:::benchmark_data_smithi188_104537_object44964:head# 2024-04-01T19:36:16.516 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:513698b7:::benchmark_data_smithi188_104537_object166909:head# 2024-04-01T19:36:16.516 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51378634:::benchmark_data_smithi188_104537_object161902:head# 2024-04-01T19:36:16.517 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5137ac3e:::benchmark_data_smithi188_104537_object124951:head# 2024-04-01T19:36:16.517 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5137df97:::benchmark_data_smithi188_104537_object36712:head# 2024-04-01T19:36:16.518 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51390b57:::benchmark_data_smithi188_104537_object126195:head# 2024-04-01T19:36:16.518 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:513915e8:::benchmark_data_smithi188_104537_object154585:head# 2024-04-01T19:36:16.519 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:513a84d1:::benchmark_data_smithi188_104537_object170726:head# 2024-04-01T19:36:16.519 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:513aa3e3:::benchmark_data_smithi188_104537_object149221:head# 2024-04-01T19:36:16.519 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:513ac12f:::benchmark_data_smithi188_104537_object29285:head# 2024-04-01T19:36:16.520 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:513bad91:::benchmark_data_smithi188_104537_object82835:head# 2024-04-01T19:36:16.520 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:513bb182:::benchmark_data_smithi188_104537_object165561:head# 2024-04-01T19:36:16.521 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:513c0f6a:::benchmark_data_smithi188_104537_object100933:head# 2024-04-01T19:36:16.521 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:513cb1a0:::benchmark_data_smithi188_104537_object32263:head# 2024-04-01T19:36:16.521 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:513db722:::benchmark_data_smithi188_104537_object128154:head# 2024-04-01T19:36:16.522 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:513e1399:::benchmark_data_smithi188_104537_object106603:head# 2024-04-01T19:36:16.522 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:513e62bd:::benchmark_data_smithi188_104537_object122089:head# 2024-04-01T19:36:16.523 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:513f4c9e:::benchmark_data_smithi188_104537_object124039:head# 2024-04-01T19:36:16.523 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:513f631e:::benchmark_data_smithi188_104537_object95538:head# 2024-04-01T19:36:16.524 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:513f7566:::benchmark_data_smithi188_104537_object100690:head# 2024-04-01T19:36:16.524 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5140670c:::benchmark_data_smithi188_104537_object122340:head# 2024-04-01T19:36:16.525 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:514112dc:::benchmark_data_smithi188_104537_object117885:head# 2024-04-01T19:36:16.525 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5141210c:::benchmark_data_smithi188_104537_object168453:head# 2024-04-01T19:36:16.526 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51414c26:::benchmark_data_smithi188_104537_object159734:head# 2024-04-01T19:36:16.526 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5141b04a:::benchmark_data_smithi188_104537_object56964:head# 2024-04-01T19:36:16.527 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5141e774:::benchmark_data_smithi188_104537_object109248:head# 2024-04-01T19:36:16.527 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:514248db:::benchmark_data_smithi188_104537_object76843:head# 2024-04-01T19:36:16.528 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:514270a8:::benchmark_data_smithi188_104537_object68492:head# 2024-04-01T19:36:16.528 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:514271b7:::benchmark_data_smithi188_104537_object48809:head# 2024-04-01T19:36:16.529 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5142afa7:::benchmark_data_smithi188_104537_object132407:head# 2024-04-01T19:36:16.529 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:514334cd:::benchmark_data_smithi188_104537_object76851:head# 2024-04-01T19:36:16.530 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5143a18a:::benchmark_data_smithi188_104537_object146522:head# 2024-04-01T19:36:16.530 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5143e350:::benchmark_data_smithi188_104537_object144259:head# 2024-04-01T19:36:16.531 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:514478d4:::benchmark_data_smithi188_104537_object85205:head# 2024-04-01T19:36:16.531 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:514516a0:::benchmark_data_smithi188_104537_object67082:head# 2024-04-01T19:36:16.531 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51454086:::benchmark_data_smithi188_104537_object80717:head# 2024-04-01T19:36:16.532 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51454414:::benchmark_data_smithi188_104537_object84773:head# 2024-04-01T19:36:16.532 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5145c0e6:::benchmark_data_smithi188_104537_object151989:head# 2024-04-01T19:36:16.533 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5145e109:::benchmark_data_smithi188_104537_object157510:head# 2024-04-01T19:36:16.533 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5145e1a8:::benchmark_data_smithi188_104537_object156247:head# 2024-04-01T19:36:16.533 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51462323:::benchmark_data_smithi188_104537_object105855:head# 2024-04-01T19:36:16.534 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5148815d:::benchmark_data_smithi188_104537_object74327:head# 2024-04-01T19:36:16.535 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51488490:::benchmark_data_smithi188_104537_object58270:head# 2024-04-01T19:36:16.535 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5148f919:::benchmark_data_smithi188_104537_object45800:head# 2024-04-01T19:36:16.535 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:514911ea:::benchmark_data_smithi188_104537_object106147:head# 2024-04-01T19:36:16.536 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51498706:::benchmark_data_smithi188_104537_object33841:head# 2024-04-01T19:36:16.536 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:514a88a2:::benchmark_data_smithi188_104537_object75584:head# 2024-04-01T19:36:16.537 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:514af02f:::benchmark_data_smithi188_104537_object160108:head# 2024-04-01T19:36:16.537 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:514b2537:::benchmark_data_smithi188_104537_object161079:head# 2024-04-01T19:36:16.538 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:514b7347:::benchmark_data_smithi188_104537_object72889:head# 2024-04-01T19:36:16.538 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:514c615e:::benchmark_data_smithi188_104537_object154263:head# 2024-04-01T19:36:16.539 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:514cb800:::benchmark_data_smithi188_104537_object154144:head# 2024-04-01T19:36:16.539 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:514d3329:::benchmark_data_smithi188_104537_object67759:head# 2024-04-01T19:36:16.540 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:514d431e:::benchmark_data_smithi188_104537_object43759:head# 2024-04-01T19:36:16.540 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:514de22e:::benchmark_data_smithi188_104537_object83278:head# 2024-04-01T19:36:16.541 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:514e13ee:::benchmark_data_smithi188_104537_object97215:head# 2024-04-01T19:36:16.541 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:514fafa1:::benchmark_data_smithi188_104537_object92419:head# 2024-04-01T19:36:16.541 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:514fd385:::benchmark_data_smithi188_104537_object94888:head# 2024-04-01T19:36:16.542 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:514fe7e4:::benchmark_data_smithi188_104537_object122922:head# 2024-04-01T19:36:16.542 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:515018aa:::benchmark_data_smithi188_104537_object42716:head# 2024-04-01T19:36:16.543 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5150419e:::benchmark_data_smithi188_104537_object35718:head# 2024-04-01T19:36:16.543 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5150a457:::benchmark_data_smithi188_104537_object162812:head# 2024-04-01T19:36:16.544 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:515103e7:::benchmark_data_smithi188_104537_object20423:head# 2024-04-01T19:36:16.544 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5151e535:::benchmark_data_smithi188_104537_object58770:head# 2024-04-01T19:36:16.545 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51520260:::benchmark_data_smithi188_104537_object138065:head# 2024-04-01T19:36:16.545 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5153e55d:::benchmark_data_smithi188_104537_object78653:head# 2024-04-01T19:36:16.546 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51541980:::benchmark_data_smithi188_104537_object164943:head# 2024-04-01T19:36:16.546 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51542179:::benchmark_data_smithi188_104537_object61967:head# 2024-04-01T19:36:16.547 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:515439ff:::benchmark_data_smithi188_104537_object61051:head# 2024-04-01T19:36:16.547 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51543e04:::benchmark_data_smithi188_104537_object122812:head# 2024-04-01T19:36:16.548 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:515444d4:::benchmark_data_smithi188_104537_object125097:head# 2024-04-01T19:36:16.548 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5154e86d:::benchmark_data_smithi188_104537_object13478:head# 2024-04-01T19:36:16.549 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:515589e6:::benchmark_data_smithi188_104537_object13696:head# 2024-04-01T19:36:16.549 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51562b8e:::benchmark_data_smithi188_104537_object114897:head# 2024-04-01T19:36:16.550 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5156e5d5:::benchmark_data_smithi188_104537_object66829:head# 2024-04-01T19:36:16.550 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51581530:::benchmark_data_smithi188_104537_object104524:head# 2024-04-01T19:36:16.551 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5158656d:::benchmark_data_smithi188_104537_object119902:head# 2024-04-01T19:36:16.551 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51587b2b:::benchmark_data_smithi188_104537_object161043:head# 2024-04-01T19:36:16.552 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5158bac4:::benchmark_data_smithi188_104537_object47526:head# 2024-04-01T19:36:16.552 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5159f4e6:::benchmark_data_smithi188_104537_object59948:head# 2024-04-01T19:36:16.553 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:515a1746:::benchmark_data_smithi188_104537_object106002:head# 2024-04-01T19:36:16.553 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:515b3fdd:::benchmark_data_smithi188_104537_object34163:head# 2024-04-01T19:36:16.553 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:515b9100:::benchmark_data_smithi188_104537_object149784:head# 2024-04-01T19:36:16.554 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:515c780c:::benchmark_data_smithi188_104537_object19706:head# 2024-04-01T19:36:16.555 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:515ce2cf:::benchmark_data_smithi188_104537_object31005:head# 2024-04-01T19:36:16.560 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:515d6ed2:::benchmark_data_smithi188_104537_object88236:head# 2024-04-01T19:36:16.560 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:515e4cd5:::benchmark_data_smithi188_104537_object130293:head# 2024-04-01T19:36:16.560 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:515e8032:::benchmark_data_smithi188_104537_object16864:head# 2024-04-01T19:36:16.560 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:515f1bd7:::benchmark_data_smithi188_104537_object152117:head# 2024-04-01T19:36:16.560 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:515f5292:::benchmark_data_smithi188_104537_object84382:head# 2024-04-01T19:36:16.560 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51608213:::benchmark_data_smithi188_104537_object40393:head# 2024-04-01T19:36:16.560 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5160974e:::benchmark_data_smithi188_104537_object44561:head# 2024-04-01T19:36:16.560 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5160d7a2:::benchmark_data_smithi188_104537_object40510:head# 2024-04-01T19:36:16.560 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:516266cf:::benchmark_data_smithi188_104537_object50665:head# 2024-04-01T19:36:16.560 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51629501:::benchmark_data_smithi188_104537_object142793:head# 2024-04-01T19:36:16.561 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51635464:::benchmark_data_smithi188_104537_object17613:head# 2024-04-01T19:36:16.561 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51635b51:::benchmark_data_smithi188_104537_object75284:head# 2024-04-01T19:36:16.561 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5163ace2:::benchmark_data_smithi188_104537_object135569:head# 2024-04-01T19:36:16.562 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5164240e:::benchmark_data_smithi188_104537_object134190:head# 2024-04-01T19:36:16.562 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51647b00:::benchmark_data_smithi188_104537_object61174:head# 2024-04-01T19:36:16.562 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5164b058:::benchmark_data_smithi188_104537_object133631:head# 2024-04-01T19:36:16.563 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5164ece3:::benchmark_data_smithi188_104537_object84295:head# 2024-04-01T19:36:16.563 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51658913:::benchmark_data_smithi188_104537_object95836:head# 2024-04-01T19:36:16.564 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51658df8:::benchmark_data_smithi188_104537_object50786:head# 2024-04-01T19:36:16.564 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51663db6:::benchmark_data_smithi188_104537_object20319:head# 2024-04-01T19:36:16.566 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51665b02:::benchmark_data_smithi188_104537_object131469:head# 2024-04-01T19:36:16.566 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51670070:::benchmark_data_smithi188_104537_object51047:head# 2024-04-01T19:36:16.566 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5167c4fa:::benchmark_data_smithi188_104537_object164193:head# 2024-04-01T19:36:16.567 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51680a5c:::benchmark_data_smithi188_104537_object75348:head# 2024-04-01T19:36:16.567 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51685d15:::benchmark_data_smithi188_104537_object156536:head# 2024-04-01T19:36:16.568 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5168d3e8:::benchmark_data_smithi188_104537_object167527:head# 2024-04-01T19:36:16.568 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51698993:::benchmark_data_smithi188_104537_object138255:head# 2024-04-01T19:36:16.569 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5169af0e:::benchmark_data_smithi188_104537_object147567:head# 2024-04-01T19:36:16.569 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5169b051:::benchmark_data_smithi188_104537_object34645:head# 2024-04-01T19:36:16.569 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5169ec7d:::benchmark_data_smithi188_104537_object49151:head# 2024-04-01T19:36:16.570 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:516ab5fa:::benchmark_data_smithi188_104537_object60552:head# 2024-04-01T19:36:16.570 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:516abf89:::benchmark_data_smithi188_104537_object89093:head# 2024-04-01T19:36:16.571 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:516bb528:::benchmark_data_smithi188_104537_object141883:head# 2024-04-01T19:36:16.571 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:516bdaed:::benchmark_data_smithi188_104537_object58062:head# 2024-04-01T19:36:16.573 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:516c1039:::benchmark_data_smithi188_104537_object19494:head# 2024-04-01T19:36:16.573 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:516d04b3:::benchmark_data_smithi188_104537_object156557:head# 2024-04-01T19:36:16.574 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:516d339e:::benchmark_data_smithi188_104537_object23771:head# 2024-04-01T19:36:16.574 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:516d3743:::benchmark_data_smithi188_104537_object114498:head# 2024-04-01T19:36:16.575 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:516d6fc8:::benchmark_data_smithi188_104537_object158397:head# 2024-04-01T19:36:16.575 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:516d8c0c:::benchmark_data_smithi188_104537_object54578:head# 2024-04-01T19:36:16.576 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:516db42e:::benchmark_data_smithi188_104537_object18367:head# 2024-04-01T19:36:16.576 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:516dbb0f:::benchmark_data_smithi188_104537_object117594:head# 2024-04-01T19:36:16.577 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:516dc660:::benchmark_data_smithi188_104537_object12427:head# 2024-04-01T19:36:16.577 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:516e33e2:::benchmark_data_smithi188_104537_object114160:head# 2024-04-01T19:36:16.578 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:516f0118:::benchmark_data_smithi188_104537_object85107:head# 2024-04-01T19:36:16.578 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:516f3563:::benchmark_data_smithi188_104537_object70116:head# 2024-04-01T19:36:16.579 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51700db8:::benchmark_data_smithi188_104537_object32418:head# 2024-04-01T19:36:16.579 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5170ebcc:::benchmark_data_smithi188_104537_object130946:head# 2024-04-01T19:36:16.580 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5171276e:::benchmark_data_smithi188_104537_object87260:head# 2024-04-01T19:36:16.580 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51717633:::benchmark_data_smithi188_104537_object108203:head# 2024-04-01T19:36:16.581 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5171b289:::benchmark_data_smithi188_104537_object53256:head# 2024-04-01T19:36:16.581 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5171b8e0:::benchmark_data_smithi188_104537_object171553:head# 2024-04-01T19:36:16.582 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5173390c:::benchmark_data_smithi188_104537_object120819:head# 2024-04-01T19:36:16.582 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5173774a:::benchmark_data_smithi188_104537_object135613:head# 2024-04-01T19:36:16.583 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5174ed82:::benchmark_data_smithi188_104537_object96340:head# 2024-04-01T19:36:16.583 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51754dea:::benchmark_data_smithi188_104537_object149032:head# 2024-04-01T19:36:16.583 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:517643b4:::benchmark_data_smithi188_104537_object48012:head# 2024-04-01T19:36:16.584 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51765bea:::benchmark_data_smithi188_104537_object57935:head# 2024-04-01T19:36:16.584 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5176f011:::benchmark_data_smithi188_104537_object59294:head# 2024-04-01T19:36:16.585 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5177484a:::benchmark_data_smithi188_104537_object11412:head# 2024-04-01T19:36:16.585 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5177ea80:::benchmark_data_smithi188_104537_object21452:head# 2024-04-01T19:36:16.585 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51785940:::benchmark_data_smithi188_104537_object130519:head# 2024-04-01T19:36:16.586 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5179511d:::benchmark_data_smithi188_104537_object112338:head# 2024-04-01T19:36:16.586 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51795f28:::benchmark_data_smithi188_104537_object39984:head# 2024-04-01T19:36:16.587 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:517a350a:::benchmark_data_smithi188_104537_object15346:head# 2024-04-01T19:36:16.587 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:517b641c:::benchmark_data_smithi188_104537_object93669:head# 2024-04-01T19:36:16.588 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:517c7480:::benchmark_data_smithi188_104537_object60381:head# 2024-04-01T19:36:16.589 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:517cce44:::benchmark_data_smithi188_104537_object170588:head# 2024-04-01T19:36:16.589 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:517d39b3:::benchmark_data_smithi188_104537_object43026:head# 2024-04-01T19:36:16.589 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:517d6bbf:::benchmark_data_smithi188_104537_object78822:head# 2024-04-01T19:36:16.590 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:517e03a5:::benchmark_data_smithi188_104537_object74799:head# 2024-04-01T19:36:16.590 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:517e6a30:::benchmark_data_smithi188_104537_object139773:head# 2024-04-01T19:36:16.590 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:517ec416:::benchmark_data_smithi188_104537_object121272:head# 2024-04-01T19:36:16.591 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:517edfd8:::benchmark_data_smithi188_104537_object29695:head# 2024-04-01T19:36:16.591 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:517f726d:::benchmark_data_smithi188_104537_object45100:head# 2024-04-01T19:36:16.591 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:517f7909:::benchmark_data_smithi188_104537_object64631:head# 2024-04-01T19:36:16.592 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:517f9767:::benchmark_data_smithi188_104537_object109380:head# 2024-04-01T19:36:16.592 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51800e19:::benchmark_data_smithi188_104537_object152856:head# 2024-04-01T19:36:16.593 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51801748:::benchmark_data_smithi188_104537_object64333:head# 2024-04-01T19:36:16.593 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:518068aa:::benchmark_data_smithi188_104537_object144027:head# 2024-04-01T19:36:16.593 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5180bc61:::benchmark_data_smithi188_104537_object162060:head# 2024-04-01T19:36:16.594 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51811d8d:::benchmark_data_smithi188_104537_object91235:head# 2024-04-01T19:36:16.594 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5181a90a:::benchmark_data_smithi188_104537_object130245:head# 2024-04-01T19:36:16.595 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:518311fd:::benchmark_data_smithi188_104537_object162390:head# 2024-04-01T19:36:16.595 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51831763:::benchmark_data_smithi188_104537_object51618:head# 2024-04-01T19:36:16.595 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:518370dc:::benchmark_data_smithi188_104537_object126362:head# 2024-04-01T19:36:16.596 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5184dbd4:::benchmark_data_smithi188_104537_object55148:head# 2024-04-01T19:36:16.596 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51862918:::benchmark_data_smithi188_104537_object59361:head# 2024-04-01T19:36:16.597 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51865424:::benchmark_data_smithi188_104537_object131295:head# 2024-04-01T19:36:16.597 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51868546:::benchmark_data_smithi188_104537_object159708:head# 2024-04-01T19:36:16.597 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51871c72:::benchmark_data_smithi188_104537_object79177:head# 2024-04-01T19:36:16.598 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5187ad6b:::benchmark_data_smithi188_104537_object73916:head# 2024-04-01T19:36:16.599 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5187bba6:::benchmark_data_smithi188_104537_object98217:head# 2024-04-01T19:36:16.599 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5187d3fb:::benchmark_data_smithi188_104537_object163274:head# 2024-04-01T19:36:16.600 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5187f0e3:::benchmark_data_smithi188_104537_object160123:head# 2024-04-01T19:36:16.600 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51880e62:::benchmark_data_smithi188_104537_object95053:head# 2024-04-01T19:36:16.600 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:518914c1:::benchmark_data_smithi188_104537_object150329:head# 2024-04-01T19:36:16.601 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51891566:::benchmark_data_smithi188_104537_object83411:head# 2024-04-01T19:36:16.601 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5189200a:::benchmark_data_smithi188_104537_object31864:head# 2024-04-01T19:36:16.601 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5189415b:::benchmark_data_smithi188_104537_object98141:head# 2024-04-01T19:36:16.602 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51899e01:::benchmark_data_smithi188_104537_object168355:head# 2024-04-01T19:36:16.602 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5189c9a5:::benchmark_data_smithi188_104537_object61260:head# 2024-04-01T19:36:16.603 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5189f762:::benchmark_data_smithi188_104537_object134275:head# 2024-04-01T19:36:16.603 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:518a1344:::benchmark_data_smithi188_104537_object38858:head# 2024-04-01T19:36:16.603 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:518a35ec:::benchmark_data_smithi188_104537_object98598:head# 2024-04-01T19:36:16.604 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:518a8d12:::benchmark_data_smithi188_104537_object150064:head# 2024-04-01T19:36:16.604 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:518b2f07:::benchmark_data_smithi188_104537_object69187:head# 2024-04-01T19:36:16.605 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:518b5a8e:::benchmark_data_smithi188_104537_object25137:head# 2024-04-01T19:36:16.605 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:518df2db:::benchmark_data_smithi188_104537_object39479:head# 2024-04-01T19:36:16.606 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:518e43af:::benchmark_data_smithi188_104537_object69456:head# 2024-04-01T19:36:16.606 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:518e6843:::benchmark_data_smithi188_104537_object153748:head# 2024-04-01T19:36:16.607 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:518e6b61:::benchmark_data_smithi188_104537_object27377:head# 2024-04-01T19:36:16.607 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:518e7a59:::benchmark_data_smithi188_104537_object120018:head# 2024-04-01T19:36:16.608 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:518ead88:::benchmark_data_smithi188_104537_object91911:head# 2024-04-01T19:36:16.608 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:518f8523:::benchmark_data_smithi188_104537_object78167:head# 2024-04-01T19:36:16.608 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:518fc511:::benchmark_data_smithi188_104537_object130583:head# 2024-04-01T19:36:16.609 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51904fe8:::benchmark_data_smithi188_104537_object23724:head# 2024-04-01T19:36:16.609 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:519052c0:::benchmark_data_smithi188_104537_object29406:head# 2024-04-01T19:36:16.610 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51905326:::benchmark_data_smithi188_104537_object77174:head# 2024-04-01T19:36:16.610 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5190ec3d:::benchmark_data_smithi188_104537_object80187:head# 2024-04-01T19:36:16.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5191701d:::benchmark_data_smithi188_104537_object127745:head# 2024-04-01T19:36:16.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51919966:::benchmark_data_smithi188_104537_object151528:head# 2024-04-01T19:36:16.612 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5192145f:::benchmark_data_smithi188_104537_object133547:head# 2024-04-01T19:36:16.612 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:519381bc:::benchmark_data_smithi188_104537_object87522:head# 2024-04-01T19:36:16.612 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5193868a:::benchmark_data_smithi188_104537_object135035:head# 2024-04-01T19:36:16.613 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51940596:::benchmark_data_smithi188_104537_object153657:head# 2024-04-01T19:36:16.613 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:519416f0:::benchmark_data_smithi188_104537_object148873:head# 2024-04-01T19:36:16.614 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51944647:::benchmark_data_smithi188_104537_object155215:head# 2024-04-01T19:36:16.614 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5194f3a9:::benchmark_data_smithi188_104537_object155526:head# 2024-04-01T19:36:16.614 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5194f933:::benchmark_data_smithi188_104537_object77805:head# 2024-04-01T19:36:16.615 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51950aea:::benchmark_data_smithi188_104537_object129613:head# 2024-04-01T19:36:16.615 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51958d44:::benchmark_data_smithi188_104537_object30249:head# 2024-04-01T19:36:16.615 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51959cb1:::benchmark_data_smithi188_104537_object114671:head# 2024-04-01T19:36:16.616 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51960879:::benchmark_data_smithi188_104537_object145941:head# 2024-04-01T19:36:16.616 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:519617c9:::benchmark_data_smithi188_104537_object171060:head# 2024-04-01T19:36:16.617 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5196cd84:::benchmark_data_smithi188_104537_object23883:head# 2024-04-01T19:36:16.617 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51978b7d:::benchmark_data_smithi188_104537_object62983:head# 2024-04-01T19:36:16.618 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51980740:::benchmark_data_smithi188_104537_object158010:head# 2024-04-01T19:36:16.618 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51983e71:::benchmark_data_smithi188_104537_object163834:head# 2024-04-01T19:36:16.619 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51985056:::benchmark_data_smithi188_104537_object102239:head# 2024-04-01T19:36:16.619 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51987465:::benchmark_data_smithi188_104537_object69323:head# 2024-04-01T19:36:16.619 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:519949ba:::benchmark_data_smithi188_104537_object60230:head# 2024-04-01T19:36:16.620 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5199b336:::benchmark_data_smithi188_104537_object52849:head# 2024-04-01T19:36:16.620 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:519aac70:::benchmark_data_smithi188_104537_object44740:head# 2024-04-01T19:36:16.621 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:519ab0d5:::benchmark_data_smithi188_104537_object145201:head# 2024-04-01T19:36:16.622 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:519b2b79:::benchmark_data_smithi188_104537_object140769:head# 2024-04-01T19:36:16.622 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:519b6ce8:::benchmark_data_smithi188_104537_object21216:head# 2024-04-01T19:36:16.623 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:519c33d5:::benchmark_data_smithi188_104537_object68327:head# 2024-04-01T19:36:16.623 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:519ca2ee:::benchmark_data_smithi188_104537_object44937:head# 2024-04-01T19:36:16.623 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:519cb535:::benchmark_data_smithi188_104537_object156643:head# 2024-04-01T19:36:16.624 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:519cbf10:::benchmark_data_smithi188_104537_object36134:head# 2024-04-01T19:36:16.625 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:519d6d18:::benchmark_data_smithi188_104537_object95238:head# 2024-04-01T19:36:16.625 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:519daf3d:::benchmark_data_smithi188_104537_object44786:head# 2024-04-01T19:36:16.625 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:519db98d:::benchmark_data_smithi188_104537_object167762:head# 2024-04-01T19:36:16.626 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:519dc18b:::benchmark_data_smithi188_104537_object133422:head# 2024-04-01T19:36:16.627 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:519dd6f3:::benchmark_data_smithi188_104537_object29131:head# 2024-04-01T19:36:16.627 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:519e7ac0:::benchmark_data_smithi188_104537_object55653:head# 2024-04-01T19:36:16.628 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:519f315a:::benchmark_data_smithi188_104537_object136441:head# 2024-04-01T19:36:16.628 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:519f800d:::benchmark_data_smithi188_104537_object48115:head# 2024-04-01T19:36:16.628 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51a08a4f:::benchmark_data_smithi188_104537_object47798:head# 2024-04-01T19:36:16.629 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51a08f52:::benchmark_data_smithi188_104537_object88440:head# 2024-04-01T19:36:16.629 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51a184ec:::benchmark_data_smithi188_104537_object86235:head# 2024-04-01T19:36:16.630 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51a21ca4:::benchmark_data_smithi188_104537_object160983:head# 2024-04-01T19:36:16.630 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51a24920:::benchmark_data_smithi188_104537_object65510:head# 2024-04-01T19:36:16.631 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51a307e0:::benchmark_data_smithi188_104537_object126793:head# 2024-04-01T19:36:16.631 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51a31439:::benchmark_data_smithi188_104537_object68770:head# 2024-04-01T19:36:16.631 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51a34db9:::benchmark_data_smithi188_104537_object92071:head# 2024-04-01T19:36:16.632 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51a39f7f:::benchmark_data_smithi188_104537_object96898:head# 2024-04-01T19:36:16.632 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51a4f42a:::benchmark_data_smithi188_104537_object14014:head# 2024-04-01T19:36:16.633 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51a50598:::benchmark_data_smithi188_104537_object148408:head# 2024-04-01T19:36:16.633 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51a58ed5:::benchmark_data_smithi188_104537_object125869:head# 2024-04-01T19:36:16.633 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51a59067:::benchmark_data_smithi188_104537_object116355:head# 2024-04-01T19:36:16.634 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51a5e9bf:::benchmark_data_smithi188_104537_object25036:head# 2024-04-01T19:36:16.634 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51a66314:::benchmark_data_smithi188_104537_object146279:head# 2024-04-01T19:36:16.635 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51a80c56:::benchmark_data_smithi188_104537_object68153:head# 2024-04-01T19:36:16.635 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51a897bc:::benchmark_data_smithi188_104537_object124974:head# 2024-04-01T19:36:16.636 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51a8a723:::benchmark_data_smithi188_104537_object18718:head# 2024-04-01T19:36:16.636 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51a8ed62:::benchmark_data_smithi188_104537_object139520:head# 2024-04-01T19:36:16.636 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51a962d5:::benchmark_data_smithi188_104537_object171325:head# 2024-04-01T19:36:16.637 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51ab9149:::benchmark_data_smithi188_104537_object125704:head# 2024-04-01T19:36:16.637 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51ac4d1a:::benchmark_data_smithi188_104537_object11263:head# 2024-04-01T19:36:16.638 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51ac9e89:::benchmark_data_smithi188_104537_object51655:head# 2024-04-01T19:36:16.638 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51aded62:::benchmark_data_smithi188_104537_object71871:head# 2024-04-01T19:36:16.639 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51ae0452:::benchmark_data_smithi188_104537_object18275:head# 2024-04-01T19:36:16.639 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51ae0dab:::benchmark_data_smithi188_104537_object81093:head# 2024-04-01T19:36:16.640 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51ae1cdb:::benchmark_data_smithi188_104537_object53738:head# 2024-04-01T19:36:16.640 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51ae5ac9:::benchmark_data_smithi188_104537_object44222:head# 2024-04-01T19:36:16.640 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51aef234:::benchmark_data_smithi188_104537_object77832:head# 2024-04-01T19:36:16.641 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51af2304:::benchmark_data_smithi188_104537_object26990:head# 2024-04-01T19:36:16.642 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51af4c06:::benchmark_data_smithi188_104537_object77424:head# 2024-04-01T19:36:16.642 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51af7b32:::benchmark_data_smithi188_104537_object91756:head# 2024-04-01T19:36:16.642 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51aff20b:::benchmark_data_smithi188_104537_object89733:head# 2024-04-01T19:36:16.643 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b002cd:::benchmark_data_smithi188_104537_object154648:head# 2024-04-01T19:36:16.643 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b081be:::benchmark_data_smithi188_104537_object54703:head# 2024-04-01T19:36:16.644 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b08c6c:::benchmark_data_smithi188_104537_object146762:head# 2024-04-01T19:36:16.644 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b0b08e:::benchmark_data_smithi188_104537_object120156:head# 2024-04-01T19:36:16.644 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b10bd9:::benchmark_data_smithi188_104537_object108593:head# 2024-04-01T19:36:16.645 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b10e35:::benchmark_data_smithi188_104537_object46291:head# 2024-04-01T19:36:16.645 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b11af1:::benchmark_data_smithi188_104537_object155579:head# 2024-04-01T19:36:16.646 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b2f13c:::benchmark_data_smithi188_104537_object158444:head# 2024-04-01T19:36:16.646 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b3894f:::benchmark_data_smithi188_104537_object132279:head# 2024-04-01T19:36:16.646 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b40538:::benchmark_data_smithi188_104537_object19197:head# 2024-04-01T19:36:16.647 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b40ab8:::benchmark_data_smithi188_104537_object135365:head# 2024-04-01T19:36:16.647 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b43a15:::benchmark_data_smithi188_104537_object25203:head# 2024-04-01T19:36:16.648 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b4dcff:::benchmark_data_smithi188_104537_object150864:head# 2024-04-01T19:36:16.648 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b55f49:::benchmark_data_smithi188_104537_object148563:head# 2024-04-01T19:36:16.649 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b57be8:::benchmark_data_smithi188_104537_object122003:head# 2024-04-01T19:36:16.649 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b5af4b:::benchmark_data_smithi188_104537_object98299:head# 2024-04-01T19:36:16.650 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b615e3:::benchmark_data_smithi188_104537_object154315:head# 2024-04-01T19:36:16.650 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b6c107:::benchmark_data_smithi188_104537_object83241:head# 2024-04-01T19:36:16.650 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b724cb:::benchmark_data_smithi188_104537_object171304:head# 2024-04-01T19:36:16.651 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b74685:::benchmark_data_smithi188_104537_object110049:head# 2024-04-01T19:36:16.651 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b77013:::benchmark_data_smithi188_104537_object170535:head# 2024-04-01T19:36:16.652 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b787ca:::benchmark_data_smithi188_104537_object90069:head# 2024-04-01T19:36:16.652 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b7b965:::benchmark_data_smithi188_104537_object119450:head# 2024-04-01T19:36:16.653 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b7c790:::benchmark_data_smithi188_104537_object108239:head# 2024-04-01T19:36:16.653 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b8cb96:::benchmark_data_smithi188_104537_object92479:head# 2024-04-01T19:36:16.653 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b8f50f:::benchmark_data_smithi188_104537_object118477:head# 2024-04-01T19:36:16.654 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b93291:::benchmark_data_smithi188_104537_object105311:head# 2024-04-01T19:36:16.654 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51b9c4f8:::benchmark_data_smithi188_104537_object20149:head# 2024-04-01T19:36:16.655 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51babd9b:::benchmark_data_smithi188_104537_object162982:head# 2024-04-01T19:36:16.655 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51bafa19:::benchmark_data_smithi188_104537_object169104:head# 2024-04-01T19:36:16.656 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51bbea0e:::benchmark_data_smithi188_104537_object122480:head# 2024-04-01T19:36:16.656 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51bc3ea1:::benchmark_data_smithi188_104537_object61383:head# 2024-04-01T19:36:16.656 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51bc4ef5:::benchmark_data_smithi188_104537_object81620:head# 2024-04-01T19:36:16.657 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51bcf719:::benchmark_data_smithi188_104537_object75113:head# 2024-04-01T19:36:16.657 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51bd3462:::benchmark_data_smithi188_104537_object112934:head# 2024-04-01T19:36:16.657 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51be2ac7:::benchmark_data_smithi188_104537_object70394:head# 2024-04-01T19:36:16.658 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51be7b86:::benchmark_data_smithi188_104537_object87993:head# 2024-04-01T19:36:16.658 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51bf76e9:::benchmark_data_smithi188_104537_object137574:head# 2024-04-01T19:36:16.659 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51bfa4e0:::benchmark_data_smithi188_104537_object119420:head# 2024-04-01T19:36:16.659 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51bfa88b:::benchmark_data_smithi188_104537_object53820:head# 2024-04-01T19:36:16.660 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51c00904:::benchmark_data_smithi188_104537_object97456:head# 2024-04-01T19:36:16.660 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51c021d4:::benchmark_data_smithi188_104537_object96560:head# 2024-04-01T19:36:16.661 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51c09442:::benchmark_data_smithi188_104537_object69191:head# 2024-04-01T19:36:16.662 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51c0fb2d:::benchmark_data_smithi188_104537_object165491:head# 2024-04-01T19:36:16.662 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51c146a3:::benchmark_data_smithi188_104537_object105218:head# 2024-04-01T19:36:16.662 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51c17f9c:::benchmark_data_smithi188_104537_object138556:head# 2024-04-01T19:36:16.663 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51c1a377:::benchmark_data_smithi188_104537_object119827:head# 2024-04-01T19:36:16.663 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51c1ccc7:::benchmark_data_smithi188_104537_object47253:head# 2024-04-01T19:36:16.664 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51c261bd:::benchmark_data_smithi188_104537_object60823:head# 2024-04-01T19:36:16.664 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51c2d4df:::benchmark_data_smithi188_104537_object51916:head# 2024-04-01T19:36:16.665 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51c2dcba:::benchmark_data_smithi188_104537_object131537:head# 2024-04-01T19:36:16.665 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51c30393:::benchmark_data_smithi188_104537_object170932:head# 2024-04-01T19:36:16.666 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51c34125:::benchmark_data_smithi188_104537_object62764:head# 2024-04-01T19:36:16.666 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51c3ccb0:::benchmark_data_smithi188_104537_object93789:head# 2024-04-01T19:36:16.667 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51c447b9:::benchmark_data_smithi188_104537_object28788:head# 2024-04-01T19:36:16.667 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51c4a983:::benchmark_data_smithi188_104537_object151956:head# 2024-04-01T19:36:16.667 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51c5d6ee:::benchmark_data_smithi188_104537_object103547:head# 2024-04-01T19:36:16.667 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51c691d9:::benchmark_data_smithi188_104537_object95266:head# 2024-04-01T19:36:16.668 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51c8148e:::benchmark_data_smithi188_104537_object38518:head# 2024-04-01T19:36:16.668 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51c88ee0:::benchmark_data_smithi188_104537_object19010:head# 2024-04-01T19:36:16.669 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51c8aea8:::benchmark_data_smithi188_104537_object167231:head# 2024-04-01T19:36:16.669 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51c9233d:::benchmark_data_smithi188_104537_object165972:head# 2024-04-01T19:36:16.669 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51c987b1:::benchmark_data_smithi188_104537_object127112:head# 2024-04-01T19:36:16.670 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51cb919d:::benchmark_data_smithi188_104537_object74453:head# 2024-04-01T19:36:16.670 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51cb91a6:::benchmark_data_smithi188_104537_object105769:head# 2024-04-01T19:36:16.671 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51cc2c69:::benchmark_data_smithi188_104537_object125709:head# 2024-04-01T19:36:16.671 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51cc9101:::benchmark_data_smithi188_104537_object70749:head# 2024-04-01T19:36:16.671 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51ccf1f4:::benchmark_data_smithi188_104537_object66155:head# 2024-04-01T19:36:16.672 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51cfdc18:::benchmark_data_smithi188_104537_object38654:head# 2024-04-01T19:36:16.672 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d01338:::benchmark_data_smithi188_104537_object47770:head# 2024-04-01T19:36:16.673 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d053ae:::benchmark_data_smithi188_104537_object88549:head# 2024-04-01T19:36:16.673 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d085e2:::benchmark_data_smithi188_104537_object140443:head# 2024-04-01T19:36:16.674 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d08801:::benchmark_data_smithi188_104537_object121173:head# 2024-04-01T19:36:16.674 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d0b5c3:::benchmark_data_smithi188_104537_object17985:head# 2024-04-01T19:36:16.674 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d0c747:::benchmark_data_smithi188_104537_object14917:head# 2024-04-01T19:36:16.675 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d10b6a:::benchmark_data_smithi188_104537_object46931:head# 2024-04-01T19:36:16.675 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d1687b:::benchmark_data_smithi188_104537_object14702:head# 2024-04-01T19:36:16.676 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d23564:::benchmark_data_smithi188_104537_object93793:head# 2024-04-01T19:36:16.676 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d2396f:::benchmark_data_smithi188_104537_object66180:head# 2024-04-01T19:36:16.677 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d2605b:::benchmark_data_smithi188_104537_object146351:head# 2024-04-01T19:36:16.677 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d2f576:::benchmark_data_smithi188_104537_object122045:head# 2024-04-01T19:36:16.677 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d34ffc:::benchmark_data_smithi188_104537_object55924:head# 2024-04-01T19:36:16.678 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d419f0:::benchmark_data_smithi188_104537_object139535:head# 2024-04-01T19:36:16.678 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d4a7cf:::benchmark_data_smithi188_104537_object127816:head# 2024-04-01T19:36:16.679 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d5dc9a:::benchmark_data_smithi188_104537_object108575:head# 2024-04-01T19:36:16.679 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d60ef5:::benchmark_data_smithi188_104537_object46377:head# 2024-04-01T19:36:16.680 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d62849:::benchmark_data_smithi188_104537_object51157:head# 2024-04-01T19:36:16.680 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d64a79:::benchmark_data_smithi188_104537_object121228:head# 2024-04-01T19:36:16.681 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d69726:::benchmark_data_smithi188_104537_object49586:head# 2024-04-01T19:36:16.681 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d69bcc:::benchmark_data_smithi188_104537_object56102:head# 2024-04-01T19:36:16.682 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d6cdc5:::benchmark_data_smithi188_104537_object16885:head# 2024-04-01T19:36:16.682 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d7355c:::benchmark_data_smithi188_104537_object51519:head# 2024-04-01T19:36:16.683 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d8e81e:::benchmark_data_smithi188_104537_object161777:head# 2024-04-01T19:36:16.683 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d8f6fe:::benchmark_data_smithi188_104537_object49587:head# 2024-04-01T19:36:16.684 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51d9408f:::benchmark_data_smithi188_104537_object46542:head# 2024-04-01T19:36:16.684 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51da01d2:::benchmark_data_smithi188_104537_object32215:head# 2024-04-01T19:36:16.685 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51da5683:::benchmark_data_smithi188_104537_object85509:head# 2024-04-01T19:36:16.685 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51daae3e:::benchmark_data_smithi188_104537_object127156:head# 2024-04-01T19:36:16.686 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51daf7be:::benchmark_data_smithi188_104537_object162435:head# 2024-04-01T19:36:16.686 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51db2a3e:::benchmark_data_smithi188_104537_object14166:head# 2024-04-01T19:36:16.686 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51dbb12c:::benchmark_data_smithi188_104537_object65288:head# 2024-04-01T19:36:16.686 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51dbff34:::benchmark_data_smithi188_104537_object71761:head# 2024-04-01T19:36:16.687 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51dc0a17:::benchmark_data_smithi188_104537_object26093:head# 2024-04-01T19:36:16.687 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51dca719:::benchmark_data_smithi188_104537_object153276:head# 2024-04-01T19:36:16.688 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51de1f15:::benchmark_data_smithi188_104537_object152262:head# 2024-04-01T19:36:16.688 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51dfa340:::benchmark_data_smithi188_104537_object69345:head# 2024-04-01T19:36:16.688 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e0594e:::benchmark_data_smithi188_104537_object149821:head# 2024-04-01T19:36:16.689 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e05d5a:::benchmark_data_smithi188_104537_object53707:head# 2024-04-01T19:36:16.689 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e0844b:::benchmark_data_smithi188_104537_object160605:head# 2024-04-01T19:36:16.690 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e0b661:::benchmark_data_smithi188_104537_object51117:head# 2024-04-01T19:36:16.690 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e0d212:::benchmark_data_smithi188_104537_object40927:head# 2024-04-01T19:36:16.691 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e1b0be:::benchmark_data_smithi188_104537_object59347:head# 2024-04-01T19:36:16.691 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e1f688:::benchmark_data_smithi188_104537_object36566:head# 2024-04-01T19:36:16.691 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e23b89:::benchmark_data_smithi188_104537_object135390:head# 2024-04-01T19:36:16.692 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e29546:::benchmark_data_smithi188_104537_object59605:head# 2024-04-01T19:36:16.692 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e33920:::benchmark_data_smithi188_104537_object50639:head# 2024-04-01T19:36:16.694 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e38a72:::benchmark_data_smithi188_104537_object103533:head# 2024-04-01T19:36:16.694 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e3eac2:::benchmark_data_smithi188_104537_object49339:head# 2024-04-01T19:36:16.694 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e436c1:::benchmark_data_smithi188_104537_object100508:head# 2024-04-01T19:36:16.695 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e45d67:::benchmark_data_smithi188_104537_object47944:head# 2024-04-01T19:36:16.695 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e4b41b:::benchmark_data_smithi188_104537_object97923:head# 2024-04-01T19:36:16.696 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e4e401:::benchmark_data_smithi188_104537_object138499:head# 2024-04-01T19:36:16.696 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e4ed1a:::benchmark_data_smithi188_104537_object142343:head# 2024-04-01T19:36:16.697 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e5866e:::benchmark_data_smithi188_104537_object31843:head# 2024-04-01T19:36:16.697 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e58aff:::benchmark_data_smithi188_104537_object48814:head# 2024-04-01T19:36:16.697 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e60623:::benchmark_data_smithi188_104537_object59335:head# 2024-04-01T19:36:16.698 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e69625:::benchmark_data_smithi188_104537_object48441:head# 2024-04-01T19:36:16.699 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e73030:::benchmark_data_smithi188_104537_object167488:head# 2024-04-01T19:36:16.700 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e73d17:::benchmark_data_smithi188_104537_object85521:head# 2024-04-01T19:36:16.700 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e7795e:::benchmark_data_smithi188_104537_object45892:head# 2024-04-01T19:36:16.701 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e7c0c7:::benchmark_data_smithi188_104537_object48661:head# 2024-04-01T19:36:16.701 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e835f3:::benchmark_data_smithi188_104537_object134679:head# 2024-04-01T19:36:16.702 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e88e4d:::benchmark_data_smithi188_104537_object111551:head# 2024-04-01T19:36:16.702 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e8feef:::benchmark_data_smithi188_104537_object32503:head# 2024-04-01T19:36:16.703 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e9080b:::benchmark_data_smithi188_104537_object59949:head# 2024-04-01T19:36:16.703 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e941dd:::benchmark_data_smithi188_104537_object101784:head# 2024-04-01T19:36:16.704 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51e971d3:::benchmark_data_smithi188_104537_object128408:head# 2024-04-01T19:36:16.704 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51ea016b:::benchmark_data_smithi188_104537_object21143:head# 2024-04-01T19:36:16.705 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51eb824c:::benchmark_data_smithi188_104537_object92975:head# 2024-04-01T19:36:16.705 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51eb87f1:::benchmark_data_smithi188_104537_object65107:head# 2024-04-01T19:36:16.705 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51eb997d:::benchmark_data_smithi188_104537_object137691:head# 2024-04-01T19:36:16.706 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51ebcd9c:::benchmark_data_smithi188_104537_object22396:head# 2024-04-01T19:36:16.706 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51ecf633:::benchmark_data_smithi188_104537_object164279:head# 2024-04-01T19:36:16.707 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51ed196e:::benchmark_data_smithi188_104537_object129153:head# 2024-04-01T19:36:16.707 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51ed493a:::benchmark_data_smithi188_104537_object43432:head# 2024-04-01T19:36:16.708 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51edb2c9:::benchmark_data_smithi188_104537_object157639:head# 2024-04-01T19:36:16.708 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51edba84:::benchmark_data_smithi188_104537_object119768:head# 2024-04-01T19:36:16.708 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51ee7485:::benchmark_data_smithi188_104537_object134341:head# 2024-04-01T19:36:16.709 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51eec1ae:::benchmark_data_smithi188_104537_object109616:head# 2024-04-01T19:36:16.709 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51ef2604:::benchmark_data_smithi188_104537_object17484:head# 2024-04-01T19:36:16.710 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51efd11c:::benchmark_data_smithi188_104537_object28123:head# 2024-04-01T19:36:16.710 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f02a52:::benchmark_data_smithi188_104537_object79189:head# 2024-04-01T19:36:16.710 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f099db:::benchmark_data_smithi188_104537_object51565:head# 2024-04-01T19:36:16.711 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f0b3e6:::benchmark_data_smithi188_104537_object56917:head# 2024-04-01T19:36:16.711 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f0b3eb:::benchmark_data_smithi188_104537_object167803:head# 2024-04-01T19:36:16.712 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f1506e:::benchmark_data_smithi188_104537_object51144:head# 2024-04-01T19:36:16.712 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f1ed5b:::benchmark_data_smithi188_104537_object96852:head# 2024-04-01T19:36:16.713 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f28dc2:::benchmark_data_smithi188_104537_object143044:head# 2024-04-01T19:36:16.713 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f295a5:::benchmark_data_smithi188_104537_object54684:head# 2024-04-01T19:36:16.714 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f2e89e:::benchmark_data_smithi188_104537_object42825:head# 2024-04-01T19:36:16.714 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f3bd63:::benchmark_data_smithi188_104537_object108062:head# 2024-04-01T19:36:16.714 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f42063:::benchmark_data_smithi188_104537_object20540:head# 2024-04-01T19:36:16.715 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f4725d:::benchmark_data_smithi188_104537_object152500:head# 2024-04-01T19:36:16.715 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f4dfc2:::benchmark_data_smithi188_104537_object168671:head# 2024-04-01T19:36:16.716 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f5a04e:::benchmark_data_smithi188_104537_object113104:head# 2024-04-01T19:36:16.716 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f5d5a2:::benchmark_data_smithi188_104537_object56345:head# 2024-04-01T19:36:16.717 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f6a9d7:::benchmark_data_smithi188_104537_object77878:head# 2024-04-01T19:36:16.717 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f6be92:::benchmark_data_smithi188_104537_object98417:head# 2024-04-01T19:36:16.717 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f883ae:::benchmark_data_smithi188_104537_object69872:head# 2024-04-01T19:36:16.719 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f88a88:::benchmark_data_smithi188_104537_object63408:head# 2024-04-01T19:36:16.719 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f89693:::benchmark_data_smithi188_104537_object21322:head# 2024-04-01T19:36:16.719 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f91018:::benchmark_data_smithi188_104537_object116645:head# 2024-04-01T19:36:16.720 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f9929c:::benchmark_data_smithi188_104537_object115078:head# 2024-04-01T19:36:16.720 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f9b4ac:::benchmark_data_smithi188_104537_object138452:head# 2024-04-01T19:36:16.720 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f9b61b:::benchmark_data_smithi188_104537_object80491:head# 2024-04-01T19:36:16.721 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f9cf87:::benchmark_data_smithi188_104537_object54389:head# 2024-04-01T19:36:16.721 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51f9f538:::benchmark_data_smithi188_104537_object13842:head# 2024-04-01T19:36:16.722 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51fa4eae:::benchmark_data_smithi188_104537_object88864:head# 2024-04-01T19:36:16.722 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51fa8c85:::benchmark_data_smithi188_104537_object86698:head# 2024-04-01T19:36:16.722 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51fab183:::benchmark_data_smithi188_104537_object157881:head# 2024-04-01T19:36:16.724 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51fb7b45:::benchmark_data_smithi188_104537_object134207:head# 2024-04-01T19:36:16.724 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51fbbaa3:::benchmark_data_smithi188_104537_object132590:head# 2024-04-01T19:36:16.724 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51fc1437:::benchmark_data_smithi188_104537_object108644:head# 2024-04-01T19:36:16.724 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51fc71b8:::benchmark_data_smithi188_104537_object10977:head# 2024-04-01T19:36:16.725 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51fcd91f:::benchmark_data_smithi188_104537_object106449:head# 2024-04-01T19:36:16.725 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51fd1508:::benchmark_data_smithi188_104537_object142661:head# 2024-04-01T19:36:16.726 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51fd5e62:::benchmark_data_smithi188_104537_object48976:head# 2024-04-01T19:36:16.726 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51fd8f98:::benchmark_data_smithi188_104537_object120587:head# 2024-04-01T19:36:16.726 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51fd95ba:::benchmark_data_smithi188_104537_object113955:head# 2024-04-01T19:36:16.727 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51fde6a7:::benchmark_data_smithi188_104537_object144724:head# 2024-04-01T19:36:16.727 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51fe00a4:::benchmark_data_smithi188_104537_object12202:head# 2024-04-01T19:36:16.728 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51fe059d:::benchmark_data_smithi188_104537_object31094:head# 2024-04-01T19:36:16.728 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51fe3486:::benchmark_data_smithi188_104537_object149622:head# 2024-04-01T19:36:16.729 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51fe6527:::benchmark_data_smithi188_104537_object136794:head# 2024-04-01T19:36:16.729 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:51fe6549:::benchmark_data_smithi188_104537_object98601:head# 2024-04-01T19:36:16.730 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52006898:::benchmark_data_smithi188_104537_object119664:head# 2024-04-01T19:36:16.730 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52009539:::benchmark_data_smithi188_104537_object89519:head# 2024-04-01T19:36:16.730 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5200a8e3:::benchmark_data_smithi188_104537_object158489:head# 2024-04-01T19:36:16.731 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5202b693:::benchmark_data_smithi188_104537_object15829:head# 2024-04-01T19:36:16.731 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5202edc5:::benchmark_data_smithi188_104537_object23369:head# 2024-04-01T19:36:16.732 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5203adf1:::benchmark_data_smithi188_104537_object142628:head# 2024-04-01T19:36:16.732 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5203fffa:::benchmark_data_smithi188_104537_object82419:head# 2024-04-01T19:36:16.733 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:520435bb:::benchmark_data_smithi188_104537_object137732:head# 2024-04-01T19:36:16.733 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5205815b:::benchmark_data_smithi188_104537_object144865:head# 2024-04-01T19:36:16.733 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5205aa66:::benchmark_data_smithi188_104537_object53584:head# 2024-04-01T19:36:16.734 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52065f65:::benchmark_data_smithi188_104537_object31657:head# 2024-04-01T19:36:16.734 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5207ad25:::benchmark_data_smithi188_104537_object84744:head# 2024-04-01T19:36:16.735 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5208397c:::benchmark_data_smithi188_104537_object123200:head# 2024-04-01T19:36:16.735 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5208417d:::benchmark_data_smithi188_104537_object150311:head# 2024-04-01T19:36:16.736 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52084fd7:::benchmark_data_smithi188_104537_object25458:head# 2024-04-01T19:36:16.736 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5208c289:::benchmark_data_smithi188_104537_object70122:head# 2024-04-01T19:36:16.737 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5208c693:::benchmark_data_smithi188_104537_object48051:head# 2024-04-01T19:36:16.737 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5208f30f:::benchmark_data_smithi188_104537_object45563:head# 2024-04-01T19:36:16.737 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:520a12de:::benchmark_data_smithi188_104537_object35551:head# 2024-04-01T19:36:16.738 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:520a48a9:::benchmark_data_smithi188_104537_object50104:head# 2024-04-01T19:36:16.738 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:520a6d64:::benchmark_data_smithi188_104537_object142016:head# 2024-04-01T19:36:16.739 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:520ae7e9:::benchmark_data_smithi188_104537_object23805:head# 2024-04-01T19:36:16.739 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:520b1811:::benchmark_data_smithi188_104537_object26668:head# 2024-04-01T19:36:16.740 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:520b4276:::benchmark_data_smithi188_104537_object61591:head# 2024-04-01T19:36:16.740 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:520b7b70:::benchmark_data_smithi188_104537_object96990:head# 2024-04-01T19:36:16.741 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:520b9a13:::benchmark_data_smithi188_104537_object25105:head# 2024-04-01T19:36:16.741 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:520baa90:::benchmark_data_smithi188_104537_object23395:head# 2024-04-01T19:36:16.742 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:520bc13f:::benchmark_data_smithi188_104537_object116829:head# 2024-04-01T19:36:16.742 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:520bd27b:::benchmark_data_smithi188_104537_object42601:head# 2024-04-01T19:36:16.742 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:520c396a:::benchmark_data_smithi188_104537_object64897:head# 2024-04-01T19:36:16.743 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:520cd9b3:::benchmark_data_smithi188_104537_object140524:head# 2024-04-01T19:36:16.743 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:520d3ca3:::benchmark_data_smithi188_104537_object157077:head# 2024-04-01T19:36:16.744 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:520d4ca0:::benchmark_data_smithi188_104537_object168706:head# 2024-04-01T19:36:16.744 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:520e8d23:::benchmark_data_smithi188_104537_object46211:head# 2024-04-01T19:36:16.745 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:520ea805:::benchmark_data_smithi188_104537_object132952:head# 2024-04-01T19:36:16.745 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:520ed993:::benchmark_data_smithi188_104537_object102959:head# 2024-04-01T19:36:16.746 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:520edcf6:::benchmark_data_smithi188_104537_object82246:head# 2024-04-01T19:36:16.746 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:520ee67e:::benchmark_data_smithi188_104537_object19554:head# 2024-04-01T19:36:16.746 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5210377e:::benchmark_data_smithi188_104537_object154385:head# 2024-04-01T19:36:16.747 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52106c1d:::benchmark_data_smithi188_104537_object170851:head# 2024-04-01T19:36:16.747 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5210ff91:::benchmark_data_smithi188_104537_object99443:head# 2024-04-01T19:36:16.747 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52113d77:::benchmark_data_smithi188_104537_object170598:head# 2024-04-01T19:36:16.748 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5211667e:::benchmark_data_smithi188_104537_object64905:head# 2024-04-01T19:36:16.748 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5211db3e:::benchmark_data_smithi188_104537_object31919:head# 2024-04-01T19:36:16.749 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52122314:::benchmark_data_smithi188_104537_object171342:head# 2024-04-01T19:36:16.749 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52126192:::benchmark_data_smithi188_104537_object138128:head# 2024-04-01T19:36:16.750 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52126d2f:::benchmark_data_smithi188_104537_object28493:head# 2024-04-01T19:36:16.750 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52127fc6:::benchmark_data_smithi188_104537_object114602:head# 2024-04-01T19:36:16.751 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52135d10:::benchmark_data_smithi188_104537_object124943:head# 2024-04-01T19:36:16.751 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5213ae4d:::benchmark_data_smithi188_104537_object39421:head# 2024-04-01T19:36:16.752 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52151047:::benchmark_data_smithi188_104537_object92789:head# 2024-04-01T19:36:16.752 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52156f43:::benchmark_data_smithi188_104537_object125531:head# 2024-04-01T19:36:16.753 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:521570f4:::benchmark_data_smithi188_104537_object147236:head# 2024-04-01T19:36:16.753 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5215aa0b:::benchmark_data_smithi188_104537_object154183:head# 2024-04-01T19:36:16.754 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5215f203:::benchmark_data_smithi188_104537_object167814:head# 2024-04-01T19:36:16.754 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52176fb0:::benchmark_data_smithi188_104537_object19467:head# 2024-04-01T19:36:16.755 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5217f1d1:::benchmark_data_smithi188_104537_object83705:head# 2024-04-01T19:36:16.755 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5217f76a:::benchmark_data_smithi188_104537_object92823:head# 2024-04-01T19:36:16.756 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:521a86eb:::benchmark_data_smithi188_104537_object115197:head# 2024-04-01T19:36:16.756 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:521ab0c4:::benchmark_data_smithi188_104537_object39285:head# 2024-04-01T19:36:16.757 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:521ac697:::benchmark_data_smithi188_104537_object94272:head# 2024-04-01T19:36:16.757 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:521b7f51:::benchmark_data_smithi188_104537_object51642:head# 2024-04-01T19:36:16.758 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:521bf9b8:::benchmark_data_smithi188_104537_object160316:head# 2024-04-01T19:36:16.758 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:521c122a:::benchmark_data_smithi188_104537_object93269:head# 2024-04-01T19:36:16.759 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:521c5ee4:::benchmark_data_smithi188_104537_object165847:head# 2024-04-01T19:36:16.759 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:521d1417:::benchmark_data_smithi188_104537_object160981:head# 2024-04-01T19:36:16.759 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:521d39fd:::benchmark_data_smithi188_104537_object44018:head# 2024-04-01T19:36:16.760 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:521ddb0c:::benchmark_data_smithi188_104537_object20589:head# 2024-04-01T19:36:16.760 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:521e1935:::benchmark_data_smithi188_104537_object41173:head# 2024-04-01T19:36:16.761 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:521e8d95:::benchmark_data_smithi188_104537_object68963:head# 2024-04-01T19:36:16.762 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:521ea1bc:::benchmark_data_smithi188_104537_object133901:head# 2024-04-01T19:36:16.762 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:521ebb12:::benchmark_data_smithi188_104537_object35410:head# 2024-04-01T19:36:16.763 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:521f7a38:::benchmark_data_smithi188_104537_object125711:head# 2024-04-01T19:36:16.764 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:521f7c97:::benchmark_data_smithi188_104537_object137131:head# 2024-04-01T19:36:16.764 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52205a0f:::benchmark_data_smithi188_104537_object94518:head# 2024-04-01T19:36:16.765 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52206349:::benchmark_data_smithi188_104537_object18147:head# 2024-04-01T19:36:16.765 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52206982:::benchmark_data_smithi188_104537_object92273:head# 2024-04-01T19:36:16.766 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5221457e:::benchmark_data_smithi188_104537_object133939:head# 2024-04-01T19:36:16.766 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52215d37:::benchmark_data_smithi188_104537_object171357:head# 2024-04-01T19:36:16.767 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52222747:::benchmark_data_smithi188_104537_object151159:head# 2024-04-01T19:36:16.768 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5222e140:::benchmark_data_smithi188_104537_object157726:head# 2024-04-01T19:36:16.768 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52230f65:::benchmark_data_smithi188_104537_object106739:head# 2024-04-01T19:36:16.768 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5223614b:::benchmark_data_smithi188_104537_object92376:head# 2024-04-01T19:36:16.769 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5224e8c9:::benchmark_data_smithi188_104537_object55059:head# 2024-04-01T19:36:16.769 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5224fec0:::benchmark_data_smithi188_104537_object67578:head# 2024-04-01T19:36:16.770 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5225a941:::benchmark_data_smithi188_104537_object73623:head# 2024-04-01T19:36:16.770 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5225b43b:::benchmark_data_smithi188_104537_object132681:head# 2024-04-01T19:36:16.770 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:522608f8:::benchmark_data_smithi188_104537_object160639:head# 2024-04-01T19:36:16.771 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5226f944:::benchmark_data_smithi188_104537_object92830:head# 2024-04-01T19:36:16.771 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52282690:::benchmark_data_smithi188_104537_object103660:head# 2024-04-01T19:36:16.772 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52284daa:::benchmark_data_smithi188_104537_object49456:head# 2024-04-01T19:36:16.772 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5228a822:::benchmark_data_smithi188_104537_object137271:head# 2024-04-01T19:36:16.772 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5229b708:::benchmark_data_smithi188_104537_object153969:head# 2024-04-01T19:36:16.773 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5229dc94:::benchmark_data_smithi188_104537_object160603:head# 2024-04-01T19:36:16.774 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:522a32ae:::benchmark_data_smithi188_104537_object40587:head# 2024-04-01T19:36:16.774 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:522a4465:::benchmark_data_smithi188_104537_object55940:head# 2024-04-01T19:36:16.775 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:522aab36:::benchmark_data_smithi188_104537_object86402:head# 2024-04-01T19:36:16.776 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:522b3b34:::benchmark_data_smithi188_104537_object152224:head# 2024-04-01T19:36:16.776 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:522c496b:::benchmark_data_smithi188_104537_object67006:head# 2024-04-01T19:36:16.777 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:522d0da8:::benchmark_data_smithi188_104537_object144564:head# 2024-04-01T19:36:16.777 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:522d1567:::benchmark_data_smithi188_104537_object75840:head# 2024-04-01T19:36:16.778 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:522eaddb:::benchmark_data_smithi188_104537_object71172:head# 2024-04-01T19:36:16.778 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:522f4952:::benchmark_data_smithi188_104537_object95751:head# 2024-04-01T19:36:16.779 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:522f9bac:::benchmark_data_smithi188_104537_object58549:head# 2024-04-01T19:36:16.779 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:522faf8e:::benchmark_data_smithi188_104537_object163214:head# 2024-04-01T19:36:16.780 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52311f37:::benchmark_data_smithi188_104537_object42672:head# 2024-04-01T19:36:16.781 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:523129e3:::benchmark_data_smithi188_104537_object65185:head# 2024-04-01T19:36:16.781 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5231e8d9:::benchmark_data_smithi188_104537_object146492:head# 2024-04-01T19:36:16.782 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52323f1d:::benchmark_data_smithi188_104537_object146281:head# 2024-04-01T19:36:16.782 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5232638b:::benchmark_data_smithi188_104537_object118975:head# 2024-04-01T19:36:16.782 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5232f3f2:::benchmark_data_smithi188_104537_object157290:head# 2024-04-01T19:36:16.783 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52335620:::benchmark_data_smithi188_104537_object131562:head# 2024-04-01T19:36:16.783 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5233969e:::benchmark_data_smithi188_104537_object141330:head# 2024-04-01T19:36:16.784 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5233d57e:::benchmark_data_smithi188_104537_object136280:head# 2024-04-01T19:36:16.784 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5233f45c:::benchmark_data_smithi188_104537_object81843:head# 2024-04-01T19:36:16.785 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5234fcbc:::benchmark_data_smithi188_104537_object31466:head# 2024-04-01T19:36:16.785 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52353530:::benchmark_data_smithi188_104537_object112583:head# 2024-04-01T19:36:16.785 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5235b7dd:::benchmark_data_smithi188_104537_object171450:head# 2024-04-01T19:36:16.786 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5236707e:::benchmark_data_smithi188_104537_object166649:head# 2024-04-01T19:36:16.786 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5236e938:::benchmark_data_smithi188_104537_object103100:head# 2024-04-01T19:36:16.787 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5236f2ee:::benchmark_data_smithi188_104537_object50257:head# 2024-04-01T19:36:16.787 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5237e64c:::benchmark_data_smithi188_104537_object100243:head# 2024-04-01T19:36:16.788 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5238c2ca:::benchmark_data_smithi188_104537_object163415:head# 2024-04-01T19:36:16.788 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5238d3bd:::benchmark_data_smithi188_104537_object87990:head# 2024-04-01T19:36:16.789 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5239545d:::benchmark_data_smithi188_104537_object142660:head# 2024-04-01T19:36:16.789 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5239c57e:::benchmark_data_smithi188_104537_object44194:head# 2024-04-01T19:36:16.790 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:523a0407:::benchmark_data_smithi188_104537_object28181:head# 2024-04-01T19:36:16.790 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:523a524c:::benchmark_data_smithi188_104537_object136795:head# 2024-04-01T19:36:16.791 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:523a88bb:::benchmark_data_smithi188_104537_object11296:head# 2024-04-01T19:36:16.791 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:523bcdc7:::benchmark_data_smithi188_104537_object44399:head# 2024-04-01T19:36:16.792 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:523c8e2b:::benchmark_data_smithi188_104537_object81437:head# 2024-04-01T19:36:16.792 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:523db9da:::benchmark_data_smithi188_104537_object13093:head# 2024-04-01T19:36:16.792 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:523e1f2e:::benchmark_data_smithi188_104537_object21595:head# 2024-04-01T19:36:16.793 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:523e3d86:::benchmark_data_smithi188_104537_object135315:head# 2024-04-01T19:36:16.793 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:523e40f9:::benchmark_data_smithi188_104537_object114868:head# 2024-04-01T19:36:16.794 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:523eae33:::benchmark_data_smithi188_104537_object54256:head# 2024-04-01T19:36:16.794 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:523ff693:::benchmark_data_smithi188_104537_object48333:head# 2024-04-01T19:36:16.795 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:524056fc:::benchmark_data_smithi188_104537_object95763:head# 2024-04-01T19:36:16.795 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:524063d1:::benchmark_data_smithi188_104537_object41717:head# 2024-04-01T19:36:16.796 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52412fa3:::benchmark_data_smithi188_104537_object45377:head# 2024-04-01T19:36:16.796 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:524182f2:::benchmark_data_smithi188_104537_object71433:head# 2024-04-01T19:36:16.797 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52420e9c:::benchmark_data_smithi188_104537_object112825:head# 2024-04-01T19:36:16.797 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52426293:::benchmark_data_smithi188_104537_object72831:head# 2024-04-01T19:36:16.798 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5242705b:::benchmark_data_smithi188_104537_object104650:head# 2024-04-01T19:36:16.798 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5242bac8:::benchmark_data_smithi188_104537_object139927:head# 2024-04-01T19:36:16.798 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5243ff52:::benchmark_data_smithi188_104537_object99289:head# 2024-04-01T19:36:16.799 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:524487d2:::benchmark_data_smithi188_104537_object62746:head# 2024-04-01T19:36:16.799 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5244b2db:::benchmark_data_smithi188_104537_object17036:head# 2024-04-01T19:36:16.800 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52451ae7:::benchmark_data_smithi188_104537_object13722:head# 2024-04-01T19:36:16.800 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52457e35:::benchmark_data_smithi188_104537_object127906:head# 2024-04-01T19:36:16.801 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52457eb3:::benchmark_data_smithi188_104537_object22402:head# 2024-04-01T19:36:16.801 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5245da23:::benchmark_data_smithi188_104537_object152723:head# 2024-04-01T19:36:16.802 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52460f27:::benchmark_data_smithi188_104537_object62762:head# 2024-04-01T19:36:16.803 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52463894:::benchmark_data_smithi188_104537_object25312:head# 2024-04-01T19:36:16.803 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:524695a4:::benchmark_data_smithi188_104537_object23066:head# 2024-04-01T19:36:16.803 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52476feb:::benchmark_data_smithi188_104537_object57189:head# 2024-04-01T19:36:16.804 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5247a231:::benchmark_data_smithi188_104537_object82981:head# 2024-04-01T19:36:16.804 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5247af72:::benchmark_data_smithi188_104537_object143155:head# 2024-04-01T19:36:16.804 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52482024:::benchmark_data_smithi188_104537_object68172:head# 2024-04-01T19:36:16.805 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5248e862:::benchmark_data_smithi188_104537_object79245:head# 2024-04-01T19:36:16.805 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5249529f:::benchmark_data_smithi188_104537_object65321:head# 2024-04-01T19:36:16.806 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:524ab582:::benchmark_data_smithi188_104537_object130990:head# 2024-04-01T19:36:16.806 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:524af767:::benchmark_data_smithi188_104537_object118701:head# 2024-04-01T19:36:16.807 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:524afaf8:::benchmark_data_smithi188_104537_object114082:head# 2024-04-01T19:36:16.807 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:524b3301:::benchmark_data_smithi188_104537_object164533:head# 2024-04-01T19:36:16.808 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:524be726:::benchmark_data_smithi188_104537_object49530:head# 2024-04-01T19:36:16.808 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:524c2a37:::benchmark_data_smithi188_104537_object138658:head# 2024-04-01T19:36:16.809 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:524c3bcf:::benchmark_data_smithi188_104537_object36100:head# 2024-04-01T19:36:16.809 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:524c512e:::benchmark_data_smithi188_104537_object29331:head# 2024-04-01T19:36:16.810 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:524d63b5:::benchmark_data_smithi188_104537_object147618:head# 2024-04-01T19:36:16.810 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:524de911:::benchmark_data_smithi188_104537_object34637:head# 2024-04-01T19:36:16.810 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:524e82ef:::benchmark_data_smithi188_104537_object70386:head# 2024-04-01T19:36:16.811 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:524eac49:::benchmark_data_smithi188_104537_object56715:head# 2024-04-01T19:36:16.811 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:524ec268:::benchmark_data_smithi188_104537_object164523:head# 2024-04-01T19:36:16.812 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:524eed69:::benchmark_data_smithi188_104537_object88094:head# 2024-04-01T19:36:16.812 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:524fad79:::benchmark_data_smithi188_104537_object88191:head# 2024-04-01T19:36:16.813 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:524fed3a:::benchmark_data_smithi188_104537_object33354:head# 2024-04-01T19:36:16.813 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5250fc81:::benchmark_data_smithi188_104537_object94067:head# 2024-04-01T19:36:16.814 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52513ba3:::benchmark_data_smithi188_104537_object117049:head# 2024-04-01T19:36:16.814 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52515efb:::benchmark_data_smithi188_104537_object166298:head# 2024-04-01T19:36:16.814 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52523abe:::benchmark_data_smithi188_104537_object126108:head# 2024-04-01T19:36:16.815 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52527e88:::benchmark_data_smithi188_104537_object88699:head# 2024-04-01T19:36:16.815 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5252adfb:::benchmark_data_smithi188_104537_object122597:head# 2024-04-01T19:36:16.816 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5252c6a8:::benchmark_data_smithi188_104537_object99065:head# 2024-04-01T19:36:16.816 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5252d1ec:::benchmark_data_smithi188_104537_object52728:head# 2024-04-01T19:36:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5253030a:::benchmark_data_smithi188_104537_object170759:head# 2024-04-01T19:36:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52530ce5:::benchmark_data_smithi188_104537_object12725:head# 2024-04-01T19:36:16.818 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52531a7b:::benchmark_data_smithi188_104537_object47385:head# 2024-04-01T19:36:16.818 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:525351ab:::benchmark_data_smithi188_104537_object116089:head# 2024-04-01T19:36:16.819 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5253540a:::benchmark_data_smithi188_104537_object81375:head# 2024-04-01T19:36:16.819 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:525374a5:::benchmark_data_smithi188_104537_object162836:head# 2024-04-01T19:36:16.819 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5253e523:::benchmark_data_smithi188_104537_object28689:head# 2024-04-01T19:36:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52549b7d:::benchmark_data_smithi188_104537_object106579:head# 2024-04-01T19:36:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52552495:::benchmark_data_smithi188_104537_object22972:head# 2024-04-01T19:36:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:525604be:::benchmark_data_smithi188_104537_object154755:head# 2024-04-01T19:36:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52568323:::benchmark_data_smithi188_104537_object119576:head# 2024-04-01T19:36:16.822 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52572953:::benchmark_data_smithi188_104537_object144167:head# 2024-04-01T19:36:16.822 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52578d78:::benchmark_data_smithi188_104537_object26907:head# 2024-04-01T19:36:16.823 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:525798b7:::benchmark_data_smithi188_104537_object171464:head# 2024-04-01T19:36:16.823 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5257b305:::benchmark_data_smithi188_104537_object32059:head# 2024-04-01T19:36:16.824 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5258b9e7:::benchmark_data_smithi188_104537_object160065:head# 2024-04-01T19:36:16.824 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5258ecc0:::benchmark_data_smithi188_104537_object19062:head# 2024-04-01T19:36:16.824 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52591a38:::benchmark_data_smithi188_104537_object67591:head# 2024-04-01T19:36:16.825 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52597fa8:::benchmark_data_smithi188_104537_object55898:head# 2024-04-01T19:36:16.825 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:525a35f1:::benchmark_data_smithi188_104537_object73159:head# 2024-04-01T19:36:16.826 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:525a706a:::benchmark_data_smithi188_104537_object124293:head# 2024-04-01T19:36:16.826 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:525b7b3f:::benchmark_data_smithi188_104537_object118418:head# 2024-04-01T19:36:16.827 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:525c2da0:::benchmark_data_smithi188_104537_object119177:head# 2024-04-01T19:36:16.827 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:525c900c:::benchmark_data_smithi188_104537_object19506:head# 2024-04-01T19:36:16.828 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:525ca761:::benchmark_data_smithi188_104537_object20176:head# 2024-04-01T19:36:16.828 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:525cbded:::benchmark_data_smithi188_104537_object150594:head# 2024-04-01T19:36:16.828 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:525d86d9:::benchmark_data_smithi188_104537_object128497:head# 2024-04-01T19:36:16.829 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:525d89dc:::benchmark_data_smithi188_104537_object26407:head# 2024-04-01T19:36:16.829 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:525e755e:::benchmark_data_smithi188_104537_object46961:head# 2024-04-01T19:36:16.830 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:525eaf92:::benchmark_data_smithi188_104537_object64247:head# 2024-04-01T19:36:16.830 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:525f0ee5:::benchmark_data_smithi188_104537_object43426:head# 2024-04-01T19:36:16.831 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:525f5eeb:::benchmark_data_smithi188_104537_object140681:head# 2024-04-01T19:36:16.831 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:526010da:::benchmark_data_smithi188_104537_object138911:head# 2024-04-01T19:36:16.832 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52604fb8:::benchmark_data_smithi188_104537_object25257:head# 2024-04-01T19:36:16.832 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5261805e:::benchmark_data_smithi188_104537_object134279:head# 2024-04-01T19:36:16.832 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52619e51:::benchmark_data_smithi188_104537_object121440:head# 2024-04-01T19:36:16.833 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5261aaaf:::benchmark_data_smithi188_104537_object131145:head# 2024-04-01T19:36:16.833 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52629db0:::benchmark_data_smithi188_104537_object40748:head# 2024-04-01T19:36:16.834 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5262a859:::benchmark_data_smithi188_104537_object34973:head# 2024-04-01T19:36:16.834 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52630794:::benchmark_data_smithi188_104537_object31099:head# 2024-04-01T19:36:16.835 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52635270:::benchmark_data_smithi188_104537_object138268:head# 2024-04-01T19:36:16.835 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52636a4e:::benchmark_data_smithi188_104537_object49807:head# 2024-04-01T19:36:16.835 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52644d86:::benchmark_data_smithi188_104537_object50538:head# 2024-04-01T19:36:16.836 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52665a06:::benchmark_data_smithi188_104537_object59242:head# 2024-04-01T19:36:16.837 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5266e332:::benchmark_data_smithi188_104537_object169995:head# 2024-04-01T19:36:16.837 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5268318e:::benchmark_data_smithi188_104537_object100168:head# 2024-04-01T19:36:16.838 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5268a57c:::benchmark_data_smithi188_104537_object129789:head# 2024-04-01T19:36:16.838 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5269aede:::benchmark_data_smithi188_104537_object88780:head# 2024-04-01T19:36:16.840 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5269c2b3:::benchmark_data_smithi188_104537_object96324:head# 2024-04-01T19:36:16.840 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:526a2ffd:::benchmark_data_smithi188_104537_object19023:head# 2024-04-01T19:36:16.841 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:526a8782:::benchmark_data_smithi188_104537_object121807:head# 2024-04-01T19:36:16.841 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:526a9e67:::benchmark_data_smithi188_104537_object28625:head# 2024-04-01T19:36:16.842 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:526adf16:::benchmark_data_smithi188_104537_object99120:head# 2024-04-01T19:36:16.842 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:526b7484:::benchmark_data_smithi188_104537_object138961:head# 2024-04-01T19:36:16.843 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:526bde72:::benchmark_data_smithi188_104537_object128038:head# 2024-04-01T19:36:16.843 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:526bf30e:::benchmark_data_smithi188_104537_object131417:head# 2024-04-01T19:36:16.843 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:526c9d2d:::benchmark_data_smithi188_104537_object168323:head# 2024-04-01T19:36:16.844 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:526ca0bd:::benchmark_data_smithi188_104537_object168030:head# 2024-04-01T19:36:16.844 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:526cd5eb:::benchmark_data_smithi188_104537_object154113:head# 2024-04-01T19:36:16.845 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:526d4578:::benchmark_data_smithi188_104537_object18710:head# 2024-04-01T19:36:16.845 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:526dc56b:::benchmark_data_smithi188_104537_object65480:head# 2024-04-01T19:36:16.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:526e8d92:::benchmark_data_smithi188_104537_object11172:head# 2024-04-01T19:36:16.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:526f250d:::benchmark_data_smithi188_104537_object115653:head# 2024-04-01T19:36:16.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:526f4b00:::benchmark_data_smithi188_104537_object73117:head# 2024-04-01T19:36:16.847 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:526f71c2:::benchmark_data_smithi188_104537_object94324:head# 2024-04-01T19:36:16.847 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:526fc9eb:::benchmark_data_smithi188_104537_object116827:head# 2024-04-01T19:36:16.848 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52711cc3:::benchmark_data_smithi188_104537_object97963:head# 2024-04-01T19:36:16.848 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52718e80:::benchmark_data_smithi188_104537_object164843:head# 2024-04-01T19:36:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5272770a:::benchmark_data_smithi188_104537_object77811:head# 2024-04-01T19:36:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5272840f:::benchmark_data_smithi188_104537_object75744:head# 2024-04-01T19:36:16.850 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:527381e2:::benchmark_data_smithi188_104537_object44305:head# 2024-04-01T19:36:16.850 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5273995b:::benchmark_data_smithi188_104537_object135789:head# 2024-04-01T19:36:16.851 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5273ad75:::benchmark_data_smithi188_104537_object75568:head# 2024-04-01T19:36:16.851 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5273da6a:::benchmark_data_smithi188_104537_object149771:head# 2024-04-01T19:36:16.852 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52743f88:::benchmark_data_smithi188_104537_object73837:head# 2024-04-01T19:36:16.852 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52751ddd:::benchmark_data_smithi188_104537_object104428:head# 2024-04-01T19:36:16.853 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52754c28:::benchmark_data_smithi188_104537_object165929:head# 2024-04-01T19:36:16.853 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52762a05:::benchmark_data_smithi188_104537_object115004:head# 2024-04-01T19:36:16.854 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52766524:::benchmark_data_smithi188_104537_object78152:head# 2024-04-01T19:36:16.855 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:527669a6:::benchmark_data_smithi188_104537_object146817:head# 2024-04-01T19:36:16.855 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52767a87:::benchmark_data_smithi188_104537_object161270:head# 2024-04-01T19:36:16.856 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:527695de:::benchmark_data_smithi188_104537_object58556:head# 2024-04-01T19:36:16.856 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5276c0e9:::benchmark_data_smithi188_104537_object109434:head# 2024-04-01T19:36:16.856 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5276d713:::benchmark_data_smithi188_104537_object129872:head# 2024-04-01T19:36:16.857 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52773d5f:::benchmark_data_smithi188_104537_object44539:head# 2024-04-01T19:36:16.857 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52779c33:::benchmark_data_smithi188_104537_object37748:head# 2024-04-01T19:36:16.858 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52779d06:::benchmark_data_smithi188_104537_object12434:head# 2024-04-01T19:36:16.859 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52781858:::benchmark_data_smithi188_104537_object139172:head# 2024-04-01T19:36:16.859 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5278e1cb:::benchmark_data_smithi188_104537_object93456:head# 2024-04-01T19:36:16.860 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5279004e:::benchmark_data_smithi188_104537_object91880:head# 2024-04-01T19:36:16.860 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5279127d:::benchmark_data_smithi188_104537_object171537:head# 2024-04-01T19:36:16.860 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52791dff:::benchmark_data_smithi188_104537_object96873:head# 2024-04-01T19:36:16.861 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52794b73:::benchmark_data_smithi188_104537_object34042:head# 2024-04-01T19:36:16.861 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52796104:::benchmark_data_smithi188_104537_object19384:head# 2024-04-01T19:36:16.861 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5279aeb7:::benchmark_data_smithi188_104537_object62236:head# 2024-04-01T19:36:16.862 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:527a16e5:::benchmark_data_smithi188_104537_object62112:head# 2024-04-01T19:36:16.863 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:527bb51a:::benchmark_data_smithi188_104537_object32792:head# 2024-04-01T19:36:16.863 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:527ce1f9:::benchmark_data_smithi188_104537_object89094:head# 2024-04-01T19:36:16.863 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:527d4515:::benchmark_data_smithi188_104537_object121611:head# 2024-04-01T19:36:16.864 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:527d4843:::benchmark_data_smithi188_104537_object77942:head# 2024-04-01T19:36:16.864 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:527d5b3d:::benchmark_data_smithi188_104537_object45405:head# 2024-04-01T19:36:16.864 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:527e0b44:::benchmark_data_smithi188_104537_object70377:head# 2024-04-01T19:36:16.865 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:527e0c70:::benchmark_data_smithi188_104537_object54511:head# 2024-04-01T19:36:16.865 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:527e43d9:::benchmark_data_smithi188_104537_object169406:head# 2024-04-01T19:36:16.866 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:527ea103:::benchmark_data_smithi188_104537_object134696:head# 2024-04-01T19:36:16.866 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:527ef244:::benchmark_data_smithi188_104537_object155235:head# 2024-04-01T19:36:16.867 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:527f765c:::benchmark_data_smithi188_104537_object142808:head# 2024-04-01T19:36:16.867 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52817815:::benchmark_data_smithi188_104537_object35382:head# 2024-04-01T19:36:16.867 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:528180c7:::benchmark_data_smithi188_104537_object52809:head# 2024-04-01T19:36:16.868 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52831466:::benchmark_data_smithi188_104537_object16763:head# 2024-04-01T19:36:16.868 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5283d56d:::benchmark_data_smithi188_104537_object118796:head# 2024-04-01T19:36:16.869 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5283f636:::benchmark_data_smithi188_104537_object23142:head# 2024-04-01T19:36:16.869 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52854239:::benchmark_data_smithi188_104537_object31551:head# 2024-04-01T19:36:16.870 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52854e85:::benchmark_data_smithi188_104537_object66147:head# 2024-04-01T19:36:16.870 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52859e8e:::benchmark_data_smithi188_104537_object143267:head# 2024-04-01T19:36:16.871 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5285c675:::benchmark_data_smithi188_104537_object112089:head# 2024-04-01T19:36:16.871 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52862b32:::benchmark_data_smithi188_104537_object110092:head# 2024-04-01T19:36:16.872 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5286766d:::benchmark_data_smithi188_104537_object168709:head# 2024-04-01T19:36:16.872 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5286c7f4:::benchmark_data_smithi188_104537_object25048:head# 2024-04-01T19:36:16.872 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5286f708:::benchmark_data_smithi188_104537_object97342:head# 2024-04-01T19:36:16.873 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52873a56:::benchmark_data_smithi188_104537_object133217:head# 2024-04-01T19:36:16.873 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52876ed6:::benchmark_data_smithi188_104537_object42671:head# 2024-04-01T19:36:16.874 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5288189b:::benchmark_data_smithi188_104537_object130001:head# 2024-04-01T19:36:16.874 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52886818:::benchmark_data_smithi188_104537_object76225:head# 2024-04-01T19:36:16.874 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5288c834:::benchmark_data_smithi188_104537_object168039:head# 2024-04-01T19:36:16.875 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5289249a:::benchmark_data_smithi188_104537_object53753:head# 2024-04-01T19:36:16.875 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52892738:::benchmark_data_smithi188_104537_object96475:head# 2024-04-01T19:36:16.876 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52893ff4:::benchmark_data_smithi188_104537_object117851:head# 2024-04-01T19:36:16.876 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52899a08:::benchmark_data_smithi188_104537_object167760:head# 2024-04-01T19:36:16.877 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5289b6ef:::benchmark_data_smithi188_104537_object47131:head# 2024-04-01T19:36:16.877 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5289f11c:::benchmark_data_smithi188_104537_object43825:head# 2024-04-01T19:36:16.877 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:528a0def:::benchmark_data_smithi188_104537_object106225:head# 2024-04-01T19:36:16.878 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:528a1092:::benchmark_data_smithi188_104537_object11022:head# 2024-04-01T19:36:16.878 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:528abaa7:::benchmark_data_smithi188_104537_object151507:head# 2024-04-01T19:36:16.879 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:528c215b:::benchmark_data_smithi188_104537_object59638:head# 2024-04-01T19:36:16.879 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:528c636b:::benchmark_data_smithi188_104537_object152209:head# 2024-04-01T19:36:16.879 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:528d00b0:::benchmark_data_smithi188_104537_object73666:head# 2024-04-01T19:36:16.880 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:528e5e82:::benchmark_data_smithi188_104537_object50848:head# 2024-04-01T19:36:16.880 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:528ec257:::benchmark_data_smithi188_104537_object64664:head# 2024-04-01T19:36:16.881 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52900839:::benchmark_data_smithi188_104537_object130277:head# 2024-04-01T19:36:16.881 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5290967f:::benchmark_data_smithi188_104537_object112012:head# 2024-04-01T19:36:16.881 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5290c2d6:::benchmark_data_smithi188_104537_object142392:head# 2024-04-01T19:36:16.882 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5290de07:::benchmark_data_smithi188_104537_object33007:head# 2024-04-01T19:36:16.882 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52928df7:::benchmark_data_smithi188_104537_object171959:head# 2024-04-01T19:36:16.883 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:529398f8:::benchmark_data_smithi188_104537_object97989:head# 2024-04-01T19:36:16.883 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5293dc10:::benchmark_data_smithi188_104537_object133867:head# 2024-04-01T19:36:16.884 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52941115:::benchmark_data_smithi188_104537_object56666:head# 2024-04-01T19:36:16.884 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52946102:::benchmark_data_smithi188_104537_object60433:head# 2024-04-01T19:36:16.884 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52959f63:::benchmark_data_smithi188_104537_object171666:head# 2024-04-01T19:36:16.885 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5295ca35:::benchmark_data_smithi188_104537_object45908:head# 2024-04-01T19:36:16.885 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5295d116:::benchmark_data_smithi188_104537_object136680:head# 2024-04-01T19:36:16.886 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52962482:::benchmark_data_smithi188_104537_object78796:head# 2024-04-01T19:36:16.886 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5296319b:::benchmark_data_smithi188_104537_object146553:head# 2024-04-01T19:36:16.887 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:529665ef:::benchmark_data_smithi188_104537_object33499:head# 2024-04-01T19:36:16.887 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5296e32b:::benchmark_data_smithi188_104537_object165270:head# 2024-04-01T19:36:16.887 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5296e4d3:::benchmark_data_smithi188_104537_object145687:head# 2024-04-01T19:36:16.888 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:529880ee:::benchmark_data_smithi188_104537_object64608:head# 2024-04-01T19:36:16.888 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5298ac13:::benchmark_data_smithi188_104537_object161271:head# 2024-04-01T19:36:16.889 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5298d785:::benchmark_data_smithi188_104537_object119535:head# 2024-04-01T19:36:16.889 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5299c266:::benchmark_data_smithi188_104537_object61690:head# 2024-04-01T19:36:16.890 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:529a1f7e:::benchmark_data_smithi188_104537_object167783:head# 2024-04-01T19:36:16.890 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:529a241a:::benchmark_data_smithi188_104537_object86664:head# 2024-04-01T19:36:16.891 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:529ac1e8:::benchmark_data_smithi188_104537_object162625:head# 2024-04-01T19:36:16.891 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:529b24ea:::benchmark_data_smithi188_104537_object72100:head# 2024-04-01T19:36:16.891 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:529b4522:::benchmark_data_smithi188_104537_object102076:head# 2024-04-01T19:36:16.892 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:529bf82e:::benchmark_data_smithi188_104537_object49695:head# 2024-04-01T19:36:16.892 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:529c2599:::benchmark_data_smithi188_104537_object109338:head# 2024-04-01T19:36:16.893 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:529c3952:::benchmark_data_smithi188_104537_object114843:head# 2024-04-01T19:36:16.893 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:529c3dcc:::benchmark_data_smithi188_104537_object33961:head# 2024-04-01T19:36:16.894 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:529c8171:::benchmark_data_smithi188_104537_object160498:head# 2024-04-01T19:36:16.895 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_ops_in_flight 2024-04-01T19:36:16.896 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:529cc1d5:::benchmark_data_smithi188_104537_object55560:head# 2024-04-01T19:36:16.896 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:529d756b:::benchmark_data_smithi188_104537_object74606:head# 2024-04-01T19:36:16.896 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:529e561f:::benchmark_data_smithi188_104537_object53490:head# 2024-04-01T19:36:16.896 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:529e7591:::benchmark_data_smithi188_104537_object29051:head# 2024-04-01T19:36:16.896 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:529eb0ee:::benchmark_data_smithi188_104537_object66213:head# 2024-04-01T19:36:16.898 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:529ebd77:::benchmark_data_smithi188_104537_object45506:head# 2024-04-01T19:36:16.898 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:529edcc8:::benchmark_data_smithi188_104537_object168345:head# 2024-04-01T19:36:16.898 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:529eebc8:::benchmark_data_smithi188_104537_object51752:head# 2024-04-01T19:36:16.898 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:529f08c0:::benchmark_data_smithi188_104537_object137818:head# 2024-04-01T19:36:16.898 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:529f599a:::benchmark_data_smithi188_104537_object16148:head# 2024-04-01T19:36:16.899 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:529fe0f9:::benchmark_data_smithi188_104537_object139006:head# 2024-04-01T19:36:16.899 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52a00597:::benchmark_data_smithi188_104537_object168015:head# 2024-04-01T19:36:16.899 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52a04056:::benchmark_data_smithi188_104537_object117144:head# 2024-04-01T19:36:16.900 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52a0a33f:::benchmark_data_smithi188_104537_object49120:head# 2024-04-01T19:36:16.900 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52a0a58d:::benchmark_data_smithi188_104537_object47276:head# 2024-04-01T19:36:16.901 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52a14548:::benchmark_data_smithi188_104537_object40921:head# 2024-04-01T19:36:16.901 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52a36fdc:::benchmark_data_smithi188_104537_object120200:head# 2024-04-01T19:36:16.901 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52a3f804:::benchmark_data_smithi188_104537_object165767:head# 2024-04-01T19:36:16.902 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52a427d6:::benchmark_data_smithi188_104537_object18999:head# 2024-04-01T19:36:16.902 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52a5a079:::benchmark_data_smithi188_104537_object74185:head# 2024-04-01T19:36:16.903 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52a6acdd:::benchmark_data_smithi188_104537_object88985:head# 2024-04-01T19:36:16.903 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52a727d9:::benchmark_data_smithi188_104537_object116113:head# 2024-04-01T19:36:16.904 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52a7e105:::benchmark_data_smithi188_104537_object67214:head# 2024-04-01T19:36:16.904 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52a80e25:::benchmark_data_smithi188_104537_object14348:head# 2024-04-01T19:36:16.904 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52a8387f:::benchmark_data_smithi188_104537_object152311:head# 2024-04-01T19:36:16.905 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52a8ad85:::benchmark_data_smithi188_104537_object154983:head# 2024-04-01T19:36:16.905 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52a8d4e7:::benchmark_data_smithi188_104537_object88923:head# 2024-04-01T19:36:16.906 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52a9d868:::benchmark_data_smithi188_104537_object26678:head# 2024-04-01T19:36:16.906 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52aa6779:::benchmark_data_smithi188_104537_object106460:head# 2024-04-01T19:36:16.906 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52aa6d2a:::benchmark_data_smithi188_104537_object113459:head# 2024-04-01T19:36:16.907 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52aa83fd:::benchmark_data_smithi188_104537_object169975:head# 2024-04-01T19:36:16.907 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52aafbf8:::benchmark_data_smithi188_104537_object122350:head# 2024-04-01T19:36:16.908 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52ac1d71:::benchmark_data_smithi188_104537_object58443:head# 2024-04-01T19:36:16.908 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52ac6723:::benchmark_data_smithi188_104537_object87044:head# 2024-04-01T19:36:16.908 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52ad7592:::benchmark_data_smithi188_104537_object74275:head# 2024-04-01T19:36:16.909 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52ad7fe5:::benchmark_data_smithi188_104537_object72164:head# 2024-04-01T19:36:16.909 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52ae2a05:::benchmark_data_smithi188_104537_object81467:head# 2024-04-01T19:36:16.910 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52ae4158:::benchmark_data_smithi188_104537_object64167:head# 2024-04-01T19:36:16.910 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52ae514e:::benchmark_data_smithi188_104537_object151979:head# 2024-04-01T19:36:16.911 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52ae680d:::benchmark_data_smithi188_104537_object101975:head# 2024-04-01T19:36:16.911 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52aeb012:::benchmark_data_smithi188_104537_object106180:head# 2024-04-01T19:36:16.911 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52af0877:::benchmark_data_smithi188_104537_object115663:head# 2024-04-01T19:36:16.912 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52afcdd3:::benchmark_data_smithi188_104537_object125674:head# 2024-04-01T19:36:16.912 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52b007fd:::benchmark_data_smithi188_104537_object83100:head# 2024-04-01T19:36:16.913 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52b1bb2c:::benchmark_data_smithi188_104537_object91471:head# 2024-04-01T19:36:16.913 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52b1f9ff:::benchmark_data_smithi188_104537_object129998:head# 2024-04-01T19:36:16.914 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52b21a98:::benchmark_data_smithi188_104537_object78819:head# 2024-04-01T19:36:16.914 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52b223a6:::benchmark_data_smithi188_104537_object95204:head# 2024-04-01T19:36:16.915 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52b25009:::benchmark_data_smithi188_104537_object151567:head# 2024-04-01T19:36:16.915 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52b25e36:::benchmark_data_smithi188_104537_object53433:head# 2024-04-01T19:36:16.915 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52b27ad1:::benchmark_data_smithi188_104537_object46027:head# 2024-04-01T19:36:16.916 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52b2d89f:::benchmark_data_smithi188_104537_object78456:head# 2024-04-01T19:36:16.916 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52b32947:::benchmark_data_smithi188_104537_object18366:head# 2024-04-01T19:36:16.916 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52b34015:::benchmark_data_smithi188_104537_object26432:head# 2024-04-01T19:36:16.917 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52b3eb5d:::benchmark_data_smithi188_104537_object22710:head# 2024-04-01T19:36:16.917 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52b48f6a:::benchmark_data_smithi188_104537_object32592:head# 2024-04-01T19:36:16.918 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52b51ba9:::benchmark_data_smithi188_104537_object34775:head# 2024-04-01T19:36:16.918 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52b58ca8:::benchmark_data_smithi188_104537_object117580:head# 2024-04-01T19:36:16.919 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52b59ef6:::benchmark_data_smithi188_104537_object62219:head# 2024-04-01T19:36:16.919 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52b6fabd:::benchmark_data_smithi188_104537_object35476:head# 2024-04-01T19:36:16.920 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52b7b267:::benchmark_data_smithi188_104537_object18711:head# 2024-04-01T19:36:16.920 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52b7e8e1:::benchmark_data_smithi188_104537_object73545:head# 2024-04-01T19:36:16.921 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52b98fa8:::benchmark_data_smithi188_104537_object155565:head# 2024-04-01T19:36:16.921 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52b9a9a0:::benchmark_data_smithi188_104537_object135120:head# 2024-04-01T19:36:16.922 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52baed34:::benchmark_data_smithi188_104537_object60503:head# 2024-04-01T19:36:16.922 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52bb1a07:::benchmark_data_smithi188_104537_object120427:head# 2024-04-01T19:36:16.923 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52bb330c:::benchmark_data_smithi188_104537_object123233:head# 2024-04-01T19:36:16.923 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52bb7734:::benchmark_data_smithi188_104537_object105736:head# 2024-04-01T19:36:16.924 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52bba9f8:::benchmark_data_smithi188_104537_object26220:head# 2024-04-01T19:36:16.924 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52bc8b82:::benchmark_data_smithi188_104537_object117110:head# 2024-04-01T19:36:16.924 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52bcb250:::benchmark_data_smithi188_104537_object14706:head# 2024-04-01T19:36:16.925 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52bcf6b3:::benchmark_data_smithi188_104537_object135715:head# 2024-04-01T19:36:16.925 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52bd0fed:::benchmark_data_smithi188_104537_object171872:head# 2024-04-01T19:36:16.926 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52bd37de:::benchmark_data_smithi188_104537_object131077:head# 2024-04-01T19:36:16.926 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52bd3836:::benchmark_data_smithi188_104537_object96234:head# 2024-04-01T19:36:16.927 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52bd5ed0:::benchmark_data_smithi188_104537_object33533:head# 2024-04-01T19:36:16.927 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52bd6d67:::benchmark_data_smithi188_104537_object109056:head# 2024-04-01T19:36:16.927 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52bd74a1:::benchmark_data_smithi188_104537_object129489:head# 2024-04-01T19:36:16.928 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52bdabd7:::benchmark_data_smithi188_104537_object86128:head# 2024-04-01T19:36:16.928 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52bdcf8a:::benchmark_data_smithi188_104537_object50742:head# 2024-04-01T19:36:16.929 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52be2ffe:::benchmark_data_smithi188_104537_object134179:head# 2024-04-01T19:36:16.929 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52be48d7:::benchmark_data_smithi188_104537_object125568:head# 2024-04-01T19:36:16.929 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52be5446:::benchmark_data_smithi188_104537_object54934:head# 2024-04-01T19:36:16.930 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52beea4d:::benchmark_data_smithi188_104537_object30581:head# 2024-04-01T19:36:16.930 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52beec9e:::benchmark_data_smithi188_104537_object143635:head# 2024-04-01T19:36:16.931 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52bef0d4:::benchmark_data_smithi188_104537_object137506:head# 2024-04-01T19:36:16.931 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52bef997:::benchmark_data_smithi188_104537_object39349:head# 2024-04-01T19:36:16.931 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52bf063b:::benchmark_data_smithi188_104537_object138536:head# 2024-04-01T19:36:16.932 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52bfb5bf:::benchmark_data_smithi188_104537_object161629:head# 2024-04-01T19:36:16.932 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52bff079:::benchmark_data_smithi188_104537_object122558:head# 2024-04-01T19:36:16.932 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c0783a:::benchmark_data_smithi188_104537_object66319:head# 2024-04-01T19:36:16.933 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c07fa1:::benchmark_data_smithi188_104537_object108686:head# 2024-04-01T19:36:16.933 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c0c0f5:::benchmark_data_smithi188_104537_object100841:head# 2024-04-01T19:36:16.934 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c14f6a:::benchmark_data_smithi188_104537_object163490:head# 2024-04-01T19:36:16.934 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c1f144:::benchmark_data_smithi188_104537_object112162:head# 2024-04-01T19:36:16.935 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c208a4:::benchmark_data_smithi188_104537_object157098:head# 2024-04-01T19:36:16.935 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c2bc4a:::benchmark_data_smithi188_104537_object12893:head# 2024-04-01T19:36:16.936 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c2c9bc:::benchmark_data_smithi188_104537_object103208:head# 2024-04-01T19:36:16.936 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c314f8:::benchmark_data_smithi188_104537_object59795:head# 2024-04-01T19:36:16.937 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c32853:::benchmark_data_smithi188_104537_object43398:head# 2024-04-01T19:36:16.937 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c45926:::benchmark_data_smithi188_104537_object94153:head# 2024-04-01T19:36:16.937 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c476ca:::benchmark_data_smithi188_104537_object28379:head# 2024-04-01T19:36:16.938 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c4946b:::benchmark_data_smithi188_104537_object129278:head# 2024-04-01T19:36:16.938 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c4c4a2:::benchmark_data_smithi188_104537_object102543:head# 2024-04-01T19:36:16.939 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c4c844:::benchmark_data_smithi188_104537_object105013:head# 2024-04-01T19:36:16.939 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c4cc5e:::benchmark_data_smithi188_104537_object76394:head# 2024-04-01T19:36:16.939 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c5bd71:::benchmark_data_smithi188_104537_object69962:head# 2024-04-01T19:36:16.940 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c658df:::benchmark_data_smithi188_104537_object165637:head# 2024-04-01T19:36:16.940 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c6b7aa:::benchmark_data_smithi188_104537_object80141:head# 2024-04-01T19:36:16.941 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c821ea:::benchmark_data_smithi188_104537_object63460:head# 2024-04-01T19:36:16.941 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c84271:::benchmark_data_smithi188_104537_object70470:head# 2024-04-01T19:36:16.942 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c84a2f:::benchmark_data_smithi188_104537_object47281:head# 2024-04-01T19:36:16.942 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c892cc:::benchmark_data_smithi188_104537_object84320:head# 2024-04-01T19:36:16.943 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c89333:::benchmark_data_smithi188_104537_object170523:head# 2024-04-01T19:36:16.943 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c90c52:::benchmark_data_smithi188_104537_object165259:head# 2024-04-01T19:36:16.944 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c9156f:::benchmark_data_smithi188_104537_object81577:head# 2024-04-01T19:36:16.944 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c95371:::benchmark_data_smithi188_104537_object43436:head# 2024-04-01T19:36:16.944 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c98b81:::benchmark_data_smithi188_104537_object139848:head# 2024-04-01T19:36:16.945 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c9bc3e:::benchmark_data_smithi188_104537_object101492:head# 2024-04-01T19:36:16.945 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c9f745:::benchmark_data_smithi188_104537_object25047:head# 2024-04-01T19:36:16.946 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52c9fb5f:::benchmark_data_smithi188_104537_object112981:head# 2024-04-01T19:36:16.946 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52ca1584:::benchmark_data_smithi188_104537_object42973:head# 2024-04-01T19:36:16.946 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52ca6578:::benchmark_data_smithi188_104537_object21751:head# 2024-04-01T19:36:16.947 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52cb4d2b:::benchmark_data_smithi188_104537_object131421:head# 2024-04-01T19:36:16.947 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52cc2045:::benchmark_data_smithi188_104537_object109953:head# 2024-04-01T19:36:16.948 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52cc4013:::benchmark_data_smithi188_104537_object156640:head# 2024-04-01T19:36:16.948 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52cd1644:::benchmark_data_smithi188_104537_object94685:head# 2024-04-01T19:36:16.949 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52cdaf45:::benchmark_data_smithi188_104537_object57252:head# 2024-04-01T19:36:16.949 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52cdc816:::benchmark_data_smithi188_104537_object95817:head# 2024-04-01T19:36:16.949 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52cf0da9:::benchmark_data_smithi188_104537_object157443:head# 2024-04-01T19:36:16.950 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52cf1d36:::benchmark_data_smithi188_104537_object78149:head# 2024-04-01T19:36:16.950 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52cf2fe1:::benchmark_data_smithi188_104537_object60628:head# 2024-04-01T19:36:16.951 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52cf8060:::benchmark_data_smithi188_104537_object82399:head# 2024-04-01T19:36:16.951 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52d04765:::benchmark_data_smithi188_104537_object48811:head# 2024-04-01T19:36:16.951 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52d05d95:::benchmark_data_smithi188_104537_object131898:head# 2024-04-01T19:36:16.952 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52d1120d:::benchmark_data_smithi188_104537_object102363:head# 2024-04-01T19:36:16.952 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52d1140f:::benchmark_data_smithi188_104537_object94201:head# 2024-04-01T19:36:16.953 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52d1e1df:::benchmark_data_smithi188_104537_object69383:head# 2024-04-01T19:36:16.953 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52d23210:::benchmark_data_smithi188_104537_object16500:head# 2024-04-01T19:36:16.954 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52d2ed22:::benchmark_data_smithi188_104537_object146242:head# 2024-04-01T19:36:16.954 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52d3055b:::benchmark_data_smithi188_104537_object52461:head# 2024-04-01T19:36:16.954 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52d36b5d:::benchmark_data_smithi188_104537_object98118:head# 2024-04-01T19:36:16.955 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52d36fb6:::benchmark_data_smithi188_104537_object61145:head# 2024-04-01T19:36:16.955 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52d38848:::benchmark_data_smithi188_104537_object126808:head# 2024-04-01T19:36:16.956 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52d3dcb3:::benchmark_data_smithi188_104537_object97685:head# 2024-04-01T19:36:16.956 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52d3ef94:::benchmark_data_smithi188_104537_object46730:head# 2024-04-01T19:36:16.957 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52d41c8f:::benchmark_data_smithi188_104537_object127814:head# 2024-04-01T19:36:16.957 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52d4585d:::benchmark_data_smithi188_104537_object134102:head# 2024-04-01T19:36:16.957 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52d49a9d:::benchmark_data_smithi188_104537_object95406:head# 2024-04-01T19:36:16.958 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52d4f580:::benchmark_data_smithi188_104537_object130154:head# 2024-04-01T19:36:16.958 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52d54c2a:::benchmark_data_smithi188_104537_object128752:head# 2024-04-01T19:36:16.959 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52d79ba8:::benchmark_data_smithi188_104537_object140596:head# 2024-04-01T19:36:16.959 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52d7e395:::benchmark_data_smithi188_104537_object96854:head# 2024-04-01T19:36:16.960 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52d80205:::benchmark_data_smithi188_104537_object34221:head# 2024-04-01T19:36:16.960 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52d8da14:::benchmark_data_smithi188_104537_object27197:head# 2024-04-01T19:36:16.960 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52d973e0:::benchmark_data_smithi188_104537_object124154:head# 2024-04-01T19:36:16.961 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52d9db1b:::benchmark_data_smithi188_104537_object38470:head# 2024-04-01T19:36:16.961 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52da71d8:::benchmark_data_smithi188_104537_object130720:head# 2024-04-01T19:36:16.962 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52daf63d:::benchmark_data_smithi188_104537_object135249:head# 2024-04-01T19:36:16.962 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52db7900:::benchmark_data_smithi188_104537_object121200:head# 2024-04-01T19:36:16.967 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52db7975:::benchmark_data_smithi188_104537_object75039:head# 2024-04-01T19:36:16.968 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52dc23c6:::benchmark_data_smithi188_104537_object144905:head# 2024-04-01T19:36:16.968 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52dc3bba:::benchmark_data_smithi188_104537_object150516:head# 2024-04-01T19:36:16.968 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52dc8b75:::benchmark_data_smithi188_104537_object94590:head# 2024-04-01T19:36:16.968 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52dd3b3a:::benchmark_data_smithi188_104537_object138506:head# 2024-04-01T19:36:16.968 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52dd3d68:::benchmark_data_smithi188_104537_object28265:head# 2024-04-01T19:36:16.968 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52de03e5:::benchmark_data_smithi188_104537_object105034:head# 2024-04-01T19:36:16.968 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52de6298:::benchmark_data_smithi188_104537_object132792:head# 2024-04-01T19:36:16.968 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52de6d59:::benchmark_data_smithi188_104537_object57672:head# 2024-04-01T19:36:16.968 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52dee373:::benchmark_data_smithi188_104537_object25956:head# 2024-04-01T19:36:16.968 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52df509d:::benchmark_data_smithi188_104537_object90182:head# 2024-04-01T19:36:16.968 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52dfa37a:::benchmark_data_smithi188_104537_object47516:head# 2024-04-01T19:36:16.969 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52dfcab7:::benchmark_data_smithi188_104537_object24124:head# 2024-04-01T19:36:16.969 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52e0b406:::benchmark_data_smithi188_104537_object142568:head# 2024-04-01T19:36:16.969 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52e0dbd5:::benchmark_data_smithi188_104537_object149281:head# 2024-04-01T19:36:16.969 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52e11474:::benchmark_data_smithi188_104537_object122919:head# 2024-04-01T19:36:16.970 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52e1181b:::benchmark_data_smithi188_104537_object158511:head# 2024-04-01T19:36:16.970 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52e29bf3:::benchmark_data_smithi188_104537_object127808:head# 2024-04-01T19:36:16.971 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52e2dc4b:::benchmark_data_smithi188_104537_object170661:head# 2024-04-01T19:36:16.971 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52e38807:::benchmark_data_smithi188_104537_object153408:head# 2024-04-01T19:36:16.972 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52e39720:::benchmark_data_smithi188_104537_object54366:head# 2024-04-01T19:36:16.972 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52e40ca5:::benchmark_data_smithi188_104537_object67252:head# 2024-04-01T19:36:16.973 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52e4fabf:::benchmark_data_smithi188_104537_object79021:head# 2024-04-01T19:36:16.973 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52e51194:::benchmark_data_smithi188_104537_object71826:head# 2024-04-01T19:36:16.974 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52e5e91e:::benchmark_data_smithi188_104537_object99042:head# 2024-04-01T19:36:16.974 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52e6addf:::benchmark_data_smithi188_104537_object14709:head# 2024-04-01T19:36:16.975 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52e70172:::benchmark_data_smithi188_104537_object126038:head# 2024-04-01T19:36:16.975 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52e70f02:::benchmark_data_smithi188_104537_object67028:head# 2024-04-01T19:36:16.975 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52e7dda6:::benchmark_data_smithi188_104537_object14863:head# 2024-04-01T19:36:16.976 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52e81c39:::benchmark_data_smithi188_104537_object101983:head# 2024-04-01T19:36:16.977 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52e97bd0:::benchmark_data_smithi188_104537_object114913:head# 2024-04-01T19:36:16.977 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52ea5ae4:::benchmark_data_smithi188_104537_object171176:head# 2024-04-01T19:36:16.977 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52ea8f31:::benchmark_data_smithi188_104537_object136644:head# 2024-04-01T19:36:16.978 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52eb4784:::benchmark_data_smithi188_104537_object117944:head# 2024-04-01T19:36:16.978 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52eb4e62:::benchmark_data_smithi188_104537_object79097:head# 2024-04-01T19:36:16.978 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52ec17cf:::benchmark_data_smithi188_104537_object90701:head# 2024-04-01T19:36:16.979 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52ec6b93:::benchmark_data_smithi188_104537_object64229:head# 2024-04-01T19:36:16.979 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52eca39a:::benchmark_data_smithi188_104537_object55631:head# 2024-04-01T19:36:16.979 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52ed336a:::benchmark_data_smithi188_104537_object109103:head# 2024-04-01T19:36:16.980 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52eeb379:::benchmark_data_smithi188_104537_object66397:head# 2024-04-01T19:36:16.980 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52ef42cb:::benchmark_data_smithi188_104537_object106970:head# 2024-04-01T19:36:16.981 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f035ad:::benchmark_data_smithi188_104537_object142814:head# 2024-04-01T19:36:16.981 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f07e53:::benchmark_data_smithi188_104537_object118678:head# 2024-04-01T19:36:16.982 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f188f5:::benchmark_data_smithi188_104537_object115566:head# 2024-04-01T19:36:16.982 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f18da8:::benchmark_data_smithi188_104537_object74487:head# 2024-04-01T19:36:16.983 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f19295:::benchmark_data_smithi188_104537_object171772:head# 2024-04-01T19:36:16.983 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f1c178:::benchmark_data_smithi188_104537_object48557:head# 2024-04-01T19:36:16.983 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f28c89:::benchmark_data_smithi188_104537_object131711:head# 2024-04-01T19:36:16.984 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f33626:::benchmark_data_smithi188_104537_object31905:head# 2024-04-01T19:36:16.984 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f3896e:::benchmark_data_smithi188_104537_object66726:head# 2024-04-01T19:36:16.984 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f42fab:::benchmark_data_smithi188_104537_object55746:head# 2024-04-01T19:36:16.985 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f445fa:::benchmark_data_smithi188_104537_object111451:head# 2024-04-01T19:36:16.985 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f47ed0:::benchmark_data_smithi188_104537_object167521:head# 2024-04-01T19:36:16.986 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f4c557:::benchmark_data_smithi188_104537_object44219:head# 2024-04-01T19:36:16.986 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f64572:::benchmark_data_smithi188_104537_object123083:head# 2024-04-01T19:36:16.987 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f66db8:::benchmark_data_smithi188_104537_object141924:head# 2024-04-01T19:36:16.987 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f6b786:::benchmark_data_smithi188_104537_object29747:head# 2024-04-01T19:36:16.987 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f6c129:::benchmark_data_smithi188_104537_object126002:head# 2024-04-01T19:36:16.988 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f6dbe1:::benchmark_data_smithi188_104537_object27575:head# 2024-04-01T19:36:16.988 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f6f7a4:::benchmark_data_smithi188_104537_object61560:head# 2024-04-01T19:36:16.989 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f70593:::benchmark_data_smithi188_104537_object165011:head# 2024-04-01T19:36:16.989 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f70897:::benchmark_data_smithi188_104537_object34021:head# 2024-04-01T19:36:16.990 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f761f1:::benchmark_data_smithi188_104537_object79241:head# 2024-04-01T19:36:16.990 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f7c809:::benchmark_data_smithi188_104537_object91198:head# 2024-04-01T19:36:16.991 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f7cf69:::benchmark_data_smithi188_104537_object66228:head# 2024-04-01T19:36:16.991 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f82655:::benchmark_data_smithi188_104537_object61799:head# 2024-04-01T19:36:16.992 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f96670:::benchmark_data_smithi188_104537_object86613:head# 2024-04-01T19:36:16.992 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f98145:::benchmark_data_smithi188_104537_object92009:head# 2024-04-01T19:36:16.993 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52f9ff06:::benchmark_data_smithi188_104537_object59732:head# 2024-04-01T19:36:16.993 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52fa5c1c:::benchmark_data_smithi188_104537_object114061:head# 2024-04-01T19:36:16.994 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52fae166:::benchmark_data_smithi188_104537_object45590:head# 2024-04-01T19:36:16.994 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52fb77c8:::benchmark_data_smithi188_104537_object62255:head# 2024-04-01T19:36:16.995 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52fbbaeb:::benchmark_data_smithi188_104537_object122218:head# 2024-04-01T19:36:16.995 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52fc24ab:::benchmark_data_smithi188_104537_object111867:head# 2024-04-01T19:36:16.996 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52fc3de5:::benchmark_data_smithi188_104537_object103285:head# 2024-04-01T19:36:16.996 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52fc60dc:::benchmark_data_smithi188_104537_object105574:head# 2024-04-01T19:36:16.997 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52fd15d9:::benchmark_data_smithi188_104537_object117684:head# 2024-04-01T19:36:16.997 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52fdc94e:::benchmark_data_smithi188_104537_object51218:head# 2024-04-01T19:36:16.998 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52fe182f:::benchmark_data_smithi188_104537_object168316:head# 2024-04-01T19:36:16.998 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52fe70a3:::benchmark_data_smithi188_104537_object28789:head# 2024-04-01T19:36:16.999 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:52fe7795:::benchmark_data_smithi188_104537_object142128:head# 2024-04-01T19:36:16.999 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:530081fb:::benchmark_data_smithi188_104537_object25573:head# 2024-04-01T19:36:17.000 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5300985e:::benchmark_data_smithi188_104537_object132429:head# 2024-04-01T19:36:17.000 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5300d6a3:::benchmark_data_smithi188_104537_object34880:head# 2024-04-01T19:36:17.001 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5300f276:::benchmark_data_smithi188_104537_object138941:head# 2024-04-01T19:36:17.001 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:530105be:::benchmark_data_smithi188_104537_object151792:head# 2024-04-01T19:36:17.001 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53016926:::benchmark_data_smithi188_104537_object102434:head# 2024-04-01T19:36:17.002 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5301f400:::benchmark_data_smithi188_104537_object118373:head# 2024-04-01T19:36:17.002 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5302b7db:::benchmark_data_smithi188_104537_object76967:head# 2024-04-01T19:36:17.003 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53034047:::benchmark_data_smithi188_104537_object171909:head# 2024-04-01T19:36:17.003 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53034050:::benchmark_data_smithi188_104537_object40708:head# 2024-04-01T19:36:17.004 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:36:17.004 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53046018:::benchmark_data_smithi188_104537_object162993:head# 2024-04-01T19:36:17.005 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53060a5f:::benchmark_data_smithi188_104537_object59357:head# 2024-04-01T19:36:17.005 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5306810d:::benchmark_data_smithi188_104537_object24360:head# 2024-04-01T19:36:17.005 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5306aba1:::benchmark_data_smithi188_104537_object44882:head# 2024-04-01T19:36:17.006 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5306be86:::benchmark_data_smithi188_104537_object23124:head# 2024-04-01T19:36:17.006 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5306f574:::benchmark_data_smithi188_104537_object43280:head# 2024-04-01T19:36:17.007 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:530720ca:::benchmark_data_smithi188_104537_object71757:head# 2024-04-01T19:36:17.007 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53073d73:::benchmark_data_smithi188_104537_object85258:head# 2024-04-01T19:36:17.008 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53080561:::benchmark_data_smithi188_104537_object43286:head# 2024-04-01T19:36:17.008 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53087d76:::benchmark_data_smithi188_104537_object150401:head# 2024-04-01T19:36:17.008 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5308dca4:::benchmark_data_smithi188_104537_object62265:head# 2024-04-01T19:36:17.009 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53091493:::benchmark_data_smithi188_104537_object167397:head# 2024-04-01T19:36:17.010 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53091925:::benchmark_data_smithi188_104537_object162170:head# 2024-04-01T19:36:17.010 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53094e31:::benchmark_data_smithi188_104537_object21209:head# 2024-04-01T19:36:17.010 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53095e96:::benchmark_data_smithi188_104537_object82411:head# 2024-04-01T19:36:17.011 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:530a113d:::benchmark_data_smithi188_104537_object44586:head# 2024-04-01T19:36:17.011 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:530a2309:::benchmark_data_smithi188_104537_object53048:head# 2024-04-01T19:36:17.012 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:530a8fde:::benchmark_data_smithi188_104537_object140156:head# 2024-04-01T19:36:17.012 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:530aad6f:::benchmark_data_smithi188_104537_object121196:head# 2024-04-01T19:36:17.013 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:530b1b30:::benchmark_data_smithi188_104537_object137551:head# 2024-04-01T19:36:17.013 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:530b9eca:::benchmark_data_smithi188_104537_object149941:head# 2024-04-01T19:36:17.014 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:530bd7a3:::benchmark_data_smithi188_104537_object141214:head# 2024-04-01T19:36:17.014 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:530ca7f7:::benchmark_data_smithi188_104537_object134205:head# 2024-04-01T19:36:17.015 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:530ce7aa:::benchmark_data_smithi188_104537_object130337:head# 2024-04-01T19:36:17.015 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:530d5323:::benchmark_data_smithi188_104537_object142801:head# 2024-04-01T19:36:17.016 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:530e4d31:::benchmark_data_smithi188_104537_object167529:head# 2024-04-01T19:36:17.016 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:530f192a:::benchmark_data_smithi188_104537_object36099:head# 2024-04-01T19:36:17.017 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:530f2441:::benchmark_data_smithi188_104537_object11414:head# 2024-04-01T19:36:17.017 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:530f97dd:::benchmark_data_smithi188_104537_object149823:head# 2024-04-01T19:36:17.018 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:530fd370:::benchmark_data_smithi188_104537_object39994:head# 2024-04-01T19:36:17.018 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:530ff694:::benchmark_data_smithi188_104537_object107335:head# 2024-04-01T19:36:17.019 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53101e96:::benchmark_data_smithi188_104537_object68961:head# 2024-04-01T19:36:17.019 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53102862:::benchmark_data_smithi188_104537_object88331:head# 2024-04-01T19:36:17.020 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53109988:::benchmark_data_smithi188_104537_object128348:head# 2024-04-01T19:36:17.020 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53110dae:::benchmark_data_smithi188_104537_object132636:head# 2024-04-01T19:36:17.021 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5312095c:::benchmark_data_smithi188_104537_object53456:head# 2024-04-01T19:36:17.021 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53129618:::benchmark_data_smithi188_104537_object23524:head# 2024-04-01T19:36:17.022 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5312e0e6:::benchmark_data_smithi188_104537_object91193:head# 2024-04-01T19:36:17.022 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5313124c:::benchmark_data_smithi188_104537_object15979:head# 2024-04-01T19:36:17.022 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53131300:::benchmark_data_smithi188_104537_object163419:head# 2024-04-01T19:36:17.023 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5314587c:::benchmark_data_smithi188_104537_object163612:head# 2024-04-01T19:36:17.023 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53146bc7:::benchmark_data_smithi188_104537_object161579:head# 2024-04-01T19:36:17.024 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5314caad:::benchmark_data_smithi188_104537_object45046:head# 2024-04-01T19:36:17.024 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53156886:::benchmark_data_smithi188_104537_object155612:head# 2024-04-01T19:36:17.025 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53160d9c:::benchmark_data_smithi188_104537_object27348:head# 2024-04-01T19:36:17.025 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53161fc9:::benchmark_data_smithi188_104537_object65765:head# 2024-04-01T19:36:17.026 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53164071:::benchmark_data_smithi188_104537_object126451:head# 2024-04-01T19:36:17.026 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53165415:::benchmark_data_smithi188_104537_object96745:head# 2024-04-01T19:36:17.027 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5316568d:::benchmark_data_smithi188_104537_object20744:head# 2024-04-01T19:36:17.027 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53171418:::benchmark_data_smithi188_104537_object48428:head# 2024-04-01T19:36:17.028 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53173d17:::benchmark_data_smithi188_104537_object106313:head# 2024-04-01T19:36:17.028 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53174797:::benchmark_data_smithi188_104537_object58114:head# 2024-04-01T19:36:17.029 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5317688f:::benchmark_data_smithi188_104537_object101696:head# 2024-04-01T19:36:17.029 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5317babf:::benchmark_data_smithi188_104537_object18642:head# 2024-04-01T19:36:17.029 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53180081:::benchmark_data_smithi188_104537_object13667:head# 2024-04-01T19:36:17.030 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53181047:::benchmark_data_smithi188_104537_object143477:head# 2024-04-01T19:36:17.030 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:531830ab:::benchmark_data_smithi188_104537_object95675:head# 2024-04-01T19:36:17.031 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53189fb2:::benchmark_data_smithi188_104537_object169027:head# 2024-04-01T19:36:17.031 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:36:17.031 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:531a3a6f:::benchmark_data_smithi188_104537_object68101:head# 2024-04-01T19:36:17.031 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:531ae285:::benchmark_data_smithi188_104537_object54169:head# 2024-04-01T19:36:17.032 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:531b0b54:::benchmark_data_smithi188_104537_object169924:head# 2024-04-01T19:36:17.032 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:531b715c:::benchmark_data_smithi188_104537_object76389:head# 2024-04-01T19:36:17.033 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:531b7b6c:::benchmark_data_smithi188_104537_object54549:head# 2024-04-01T19:36:17.033 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:531bb7d9:::benchmark_data_smithi188_104537_object126054:head# 2024-04-01T19:36:17.033 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:531c45a6:::benchmark_data_smithi188_104537_object47975:head# 2024-04-01T19:36:17.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:531c6a1c:::benchmark_data_smithi188_104537_object137566:head# 2024-04-01T19:36:17.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:531cad8e:::benchmark_data_smithi188_104537_object14969:head# 2024-04-01T19:36:17.035 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:531cd9d2:::benchmark_data_smithi188_104537_object69995:head# 2024-04-01T19:36:17.035 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:531ce6f3:::benchmark_data_smithi188_104537_object133492:head# 2024-04-01T19:36:17.036 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:531d5518:::benchmark_data_smithi188_104537_object166682:head# 2024-04-01T19:36:17.036 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:531e401e:::benchmark_data_smithi188_104537_object114973:head# 2024-04-01T19:36:17.037 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:531e6935:::benchmark_data_smithi188_104537_object59655:head# 2024-04-01T19:36:17.037 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:531ea0ee:::benchmark_data_smithi188_104537_object74281:head# 2024-04-01T19:36:17.037 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:531edbe4:::benchmark_data_smithi188_104537_object133215:head# 2024-04-01T19:36:17.038 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:531f2250:::benchmark_data_smithi188_104537_object165167:head# 2024-04-01T19:36:17.038 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:531fc800:::benchmark_data_smithi188_104537_object113400:head# 2024-04-01T19:36:17.039 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:531fdc40:::benchmark_data_smithi188_104537_object91567:head# 2024-04-01T19:36:17.039 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5320a743:::benchmark_data_smithi188_104537_object93412:head# 2024-04-01T19:36:17.039 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5320feda:::benchmark_data_smithi188_104537_object20706:head# 2024-04-01T19:36:17.040 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5321235a:::benchmark_data_smithi188_104537_object95404:head# 2024-04-01T19:36:17.040 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53216e4c:::benchmark_data_smithi188_104537_object63614:head# 2024-04-01T19:36:17.041 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5321ee3a:::benchmark_data_smithi188_104537_object124076:head# 2024-04-01T19:36:17.041 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5322485d:::benchmark_data_smithi188_104537_object166282:head# 2024-04-01T19:36:17.042 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53228c6c:::benchmark_data_smithi188_104537_object156844:head# 2024-04-01T19:36:17.042 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53239388:::benchmark_data_smithi188_104537_object47754:head# 2024-04-01T19:36:17.042 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5323c3ea:::benchmark_data_smithi188_104537_object22347:head# 2024-04-01T19:36:17.043 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:532428dc:::benchmark_data_smithi188_104537_object169329:head# 2024-04-01T19:36:17.043 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53245ab5:::benchmark_data_smithi188_104537_object64492:head# 2024-04-01T19:36:17.044 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5324c57c:::benchmark_data_smithi188_104537_object101933:head# 2024-04-01T19:36:17.044 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5324e098:::benchmark_data_smithi188_104537_object117651:head# 2024-04-01T19:36:17.045 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53255eee:::benchmark_data_smithi188_104537_object151395:head# 2024-04-01T19:36:17.045 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:532572ca:::benchmark_data_smithi188_104537_object85121:head# 2024-04-01T19:36:17.045 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5325b6b5:::benchmark_data_smithi188_104537_object161314:head# 2024-04-01T19:36:17.046 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5325be26:::benchmark_data_smithi188_104537_object166371:head# 2024-04-01T19:36:17.046 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53260363:::benchmark_data_smithi188_104537_object102184:head# 2024-04-01T19:36:17.047 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:532641cf:::benchmark_data_smithi188_104537_object104342:head# 2024-04-01T19:36:17.047 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53272b11:::benchmark_data_smithi188_104537_object71582:head# 2024-04-01T19:36:17.047 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:532752d4:::benchmark_data_smithi188_104537_object147511:head# 2024-04-01T19:36:17.048 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53275d80:::benchmark_data_smithi188_104537_object166986:head# 2024-04-01T19:36:17.048 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5328ef3f:::benchmark_data_smithi188_104537_object14386:head# 2024-04-01T19:36:17.049 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5329015c:::benchmark_data_smithi188_104537_object29509:head# 2024-04-01T19:36:17.049 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:532933ba:::benchmark_data_smithi188_104537_object17829:head# 2024-04-01T19:36:17.049 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5329576f:::benchmark_data_smithi188_104537_object78241:head# 2024-04-01T19:36:17.050 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53298fc4:::benchmark_data_smithi188_104537_object38008:head# 2024-04-01T19:36:17.050 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5329be94:::benchmark_data_smithi188_104537_object148865:head# 2024-04-01T19:36:17.050 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:532aac0e:::benchmark_data_smithi188_104537_object111394:head# 2024-04-01T19:36:17.051 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:532b016c:::benchmark_data_smithi188_104537_object52637:head# 2024-04-01T19:36:17.051 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:532b1f97:::benchmark_data_smithi188_104537_object124016:head# 2024-04-01T19:36:17.052 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:532b4293:::benchmark_data_smithi188_104537_object53260:head# 2024-04-01T19:36:17.052 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:532c1f67:::benchmark_data_smithi188_104537_object56494:head# 2024-04-01T19:36:17.053 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:532c8da0:::benchmark_data_smithi188_104537_object96040:head# 2024-04-01T19:36:17.053 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:532d4f11:::benchmark_data_smithi188_104537_object148594:head# 2024-04-01T19:36:17.053 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:532d6c7c:::benchmark_data_smithi188_104537_object136916:head# 2024-04-01T19:36:17.054 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:532db872:::benchmark_data_smithi188_104537_object27066:head# 2024-04-01T19:36:17.054 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:532df8ad:::benchmark_data_smithi188_104537_object24433:head# 2024-04-01T19:36:17.055 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:532e0bab:::benchmark_data_smithi188_104537_object13995:head# 2024-04-01T19:36:17.055 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:532e9ac4:::benchmark_data_smithi188_104537_object92801:head# 2024-04-01T19:36:17.055 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:532ef0c3:::benchmark_data_smithi188_104537_object31936:head# 2024-04-01T19:36:17.056 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:532f15d4:::benchmark_data_smithi188_104537_object23932:head# 2024-04-01T19:36:17.056 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:532f4b47:::benchmark_data_smithi188_104537_object20041:head# 2024-04-01T19:36:17.057 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53300f8f:::benchmark_data_smithi188_104537_object46760:head# 2024-04-01T19:36:17.057 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:533046c1:::benchmark_data_smithi188_104537_object130254:head# 2024-04-01T19:36:17.058 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:533054c3:::benchmark_data_smithi188_104537_object85972:head# 2024-04-01T19:36:17.058 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53307db2:::benchmark_data_smithi188_104537_object170322:head# 2024-04-01T19:36:17.058 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53308937:::benchmark_data_smithi188_104537_object84626:head# 2024-04-01T19:36:17.059 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:533104f3:::benchmark_data_smithi188_104537_object81305:head# 2024-04-01T19:36:17.059 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53314dd5:::benchmark_data_smithi188_104537_object33536:head# 2024-04-01T19:36:17.059 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53315b83:::benchmark_data_smithi188_104537_object105239:head# 2024-04-01T19:36:17.060 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:533188fa:::benchmark_data_smithi188_104537_object153052:head# 2024-04-01T19:36:17.060 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5331c700:::benchmark_data_smithi188_104537_object150953:head# 2024-04-01T19:36:17.061 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5332a9c0:::benchmark_data_smithi188_104537_object103108:head# 2024-04-01T19:36:17.061 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5332b68d:::benchmark_data_smithi188_104537_object105303:head# 2024-04-01T19:36:17.062 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5333ae66:::benchmark_data_smithi188_104537_object96206:head# 2024-04-01T19:36:17.062 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5333bafc:::benchmark_data_smithi188_104537_object77897:head# 2024-04-01T19:36:17.062 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5334bdf4:::benchmark_data_smithi188_104537_object110236:head# 2024-04-01T19:36:17.063 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5334d188:::benchmark_data_smithi188_104537_object129302:head# 2024-04-01T19:36:17.063 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53350de8:::benchmark_data_smithi188_104537_object30617:head# 2024-04-01T19:36:17.064 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5336222f:::benchmark_data_smithi188_104537_object14838:head# 2024-04-01T19:36:17.064 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53367cf6:::benchmark_data_smithi188_104537_object108089:head# 2024-04-01T19:36:17.064 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53368081:::benchmark_data_smithi188_104537_object104052:head# 2024-04-01T19:36:17.065 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53370305:::benchmark_data_smithi188_104537_object114725:head# 2024-04-01T19:36:17.065 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53373539:::benchmark_data_smithi188_104537_object81825:head# 2024-04-01T19:36:17.065 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:533797c0:::benchmark_data_smithi188_104537_object123865:head# 2024-04-01T19:36:17.066 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:533874f8:::benchmark_data_smithi188_104537_object118019:head# 2024-04-01T19:36:17.066 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5338c65e:::benchmark_data_smithi188_104537_object72752:head# 2024-04-01T19:36:17.067 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:533925b9:::benchmark_data_smithi188_104537_object131409:head# 2024-04-01T19:36:17.067 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53393224:::benchmark_data_smithi188_104537_object106347:head# 2024-04-01T19:36:17.068 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5339d5ec:::benchmark_data_smithi188_104537_object63700:head# 2024-04-01T19:36:17.068 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:533a42cc:::benchmark_data_smithi188_104537_object39920:head# 2024-04-01T19:36:17.068 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:533a435b:::benchmark_data_smithi188_104537_object111787:head# 2024-04-01T19:36:17.069 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:533aaa13:::benchmark_data_smithi188_104537_object83913:head# 2024-04-01T19:36:17.069 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:533af6d9:::benchmark_data_smithi188_104537_object41600:head# 2024-04-01T19:36:17.070 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:533b9aa8:::benchmark_data_smithi188_104537_object66291:head# 2024-04-01T19:36:17.070 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:533c083f:::benchmark_data_smithi188_104537_object132027:head# 2024-04-01T19:36:17.071 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:533c6f2b:::benchmark_data_smithi188_104537_object138622:head# 2024-04-01T19:36:17.071 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:533cc7f3:::benchmark_data_smithi188_104537_object11221:head# 2024-04-01T19:36:17.071 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:533e044a:::benchmark_data_smithi188_104537_object35516:head# 2024-04-01T19:36:17.072 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:533e949a:::benchmark_data_smithi188_104537_object44534:head# 2024-04-01T19:36:17.072 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:533f2e46:::benchmark_data_smithi188_104537_object21258:head# 2024-04-01T19:36:17.073 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:533f7e13:::benchmark_data_smithi188_104537_object103105:head# 2024-04-01T19:36:17.073 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53402c11:::benchmark_data_smithi188_104537_object120757:head# 2024-04-01T19:36:17.073 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5340cbeb:::benchmark_data_smithi188_104537_object81634:head# 2024-04-01T19:36:17.074 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:534132ae:::benchmark_data_smithi188_104537_object90625:head# 2024-04-01T19:36:17.074 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53415153:::benchmark_data_smithi188_104537_object140303:head# 2024-04-01T19:36:17.075 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5341e11a:::benchmark_data_smithi188_104537_object162261:head# 2024-04-01T19:36:17.075 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5343344d:::benchmark_data_smithi188_104537_object134113:head# 2024-04-01T19:36:17.075 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53434e6b:::benchmark_data_smithi188_104537_object64715:head# 2024-04-01T19:36:17.076 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5343939b:::benchmark_data_smithi188_104537_object123142:head# 2024-04-01T19:36:17.076 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5343b559:::benchmark_data_smithi188_104537_object132755:head# 2024-04-01T19:36:17.077 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5343cf54:::benchmark_data_smithi188_104537_object146619:head# 2024-04-01T19:36:17.077 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5344bbb5:::benchmark_data_smithi188_104537_object22379:head# 2024-04-01T19:36:17.078 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5345149f:::benchmark_data_smithi188_104537_object129177:head# 2024-04-01T19:36:17.078 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53454ea4:::benchmark_data_smithi188_104537_object32966:head# 2024-04-01T19:36:17.078 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5345767b:::benchmark_data_smithi188_104537_object170330:head# 2024-04-01T19:36:17.079 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53458876:::benchmark_data_smithi188_104537_object162080:head# 2024-04-01T19:36:17.079 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53459539:::benchmark_data_smithi188_104537_object67664:head# 2024-04-01T19:36:17.080 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53459b4b:::benchmark_data_smithi188_104537_object169180:head# 2024-04-01T19:36:17.080 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5345d00f:::benchmark_data_smithi188_104537_object58715:head# 2024-04-01T19:36:17.081 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5345e117:::benchmark_data_smithi188_104537_object20207:head# 2024-04-01T19:36:17.081 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:534765b0:::benchmark_data_smithi188_104537_object52997:head# 2024-04-01T19:36:17.081 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5347d8f0:::benchmark_data_smithi188_104537_object92263:head# 2024-04-01T19:36:17.082 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5347ddc5:::benchmark_data_smithi188_104537_object150111:head# 2024-04-01T19:36:17.082 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5348cb86:::benchmark_data_smithi188_104537_object45422:head# 2024-04-01T19:36:17.082 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5349f5ec:::benchmark_data_smithi188_104537_object46186:head# 2024-04-01T19:36:17.083 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:534a7c86:::benchmark_data_smithi188_104537_object22665:head# 2024-04-01T19:36:17.083 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:534a9d89:::benchmark_data_smithi188_104537_object74920:head# 2024-04-01T19:36:17.084 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:534ab3c3:::benchmark_data_smithi188_104537_object38851:head# 2024-04-01T19:36:17.084 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:534b9815:::benchmark_data_smithi188_104537_object111446:head# 2024-04-01T19:36:17.085 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:534bddbd:::benchmark_data_smithi188_104537_object45701:head# 2024-04-01T19:36:17.085 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:534c95e8:::benchmark_data_smithi188_104537_object141262:head# 2024-04-01T19:36:17.085 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:534ccfd3:::benchmark_data_smithi188_104537_object40805:head# 2024-04-01T19:36:17.086 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:534de9ab:::benchmark_data_smithi188_104537_object128327:head# 2024-04-01T19:36:17.086 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:534e3928:::benchmark_data_smithi188_104537_object116807:head# 2024-04-01T19:36:17.087 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:534e7142:::benchmark_data_smithi188_104537_object132039:head# 2024-04-01T19:36:17.087 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:534e9d30:::benchmark_data_smithi188_104537_object135284:head# 2024-04-01T19:36:17.088 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:534ea576:::benchmark_data_smithi188_104537_object118320:head# 2024-04-01T19:36:17.088 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:534f4b47:::benchmark_data_smithi188_104537_object131771:head# 2024-04-01T19:36:17.088 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:534f617e:::benchmark_data_smithi188_104537_object103708:head# 2024-04-01T19:36:17.089 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:534f6ada:::benchmark_data_smithi188_104537_object127959:head# 2024-04-01T19:36:17.089 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53512430:::benchmark_data_smithi188_104537_object171661:head# 2024-04-01T19:36:17.090 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535216fc:::benchmark_data_smithi188_104537_object51198:head# 2024-04-01T19:36:17.090 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53525ff2:::benchmark_data_smithi188_104537_object141459:head# 2024-04-01T19:36:17.091 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5353374e:::benchmark_data_smithi188_104537_object83245:head# 2024-04-01T19:36:17.091 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535359e8:::benchmark_data_smithi188_104537_object113604:head# 2024-04-01T19:36:17.091 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5354c228:::benchmark_data_smithi188_104537_object148921:head# 2024-04-01T19:36:17.092 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535541ef:::benchmark_data_smithi188_104537_object31060:head# 2024-04-01T19:36:17.092 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535561e0:::benchmark_data_smithi188_104537_object103587:head# 2024-04-01T19:36:17.093 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53563856:::benchmark_data_smithi188_104537_object93557:head# 2024-04-01T19:36:17.093 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5356471c:::benchmark_data_smithi188_104537_object143494:head# 2024-04-01T19:36:17.094 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53575bcb:::benchmark_data_smithi188_104537_object56809:head# 2024-04-01T19:36:17.094 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53578422:::benchmark_data_smithi188_104537_object129324:head# 2024-04-01T19:36:17.094 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5357b190:::benchmark_data_smithi188_104537_object138189:head# 2024-04-01T19:36:17.095 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53582f83:::benchmark_data_smithi188_104537_object129005:head# 2024-04-01T19:36:17.095 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5358b4b1:::benchmark_data_smithi188_104537_object37524:head# 2024-04-01T19:36:17.096 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5358cb8a:::benchmark_data_smithi188_104537_object149889:head# 2024-04-01T19:36:17.096 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5359192d:::benchmark_data_smithi188_104537_object77127:head# 2024-04-01T19:36:17.096 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535943dd:::benchmark_data_smithi188_104537_object153137:head# 2024-04-01T19:36:17.097 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535987bc:::benchmark_data_smithi188_104537_object65899:head# 2024-04-01T19:36:17.097 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5359bfb8:::benchmark_data_smithi188_104537_object97005:head# 2024-04-01T19:36:17.098 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535a3be8:::benchmark_data_smithi188_104537_object47613:head# 2024-04-01T19:36:17.098 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535a739f:::benchmark_data_smithi188_104537_object17509:head# 2024-04-01T19:36:17.099 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535a95c1:::benchmark_data_smithi188_104537_object52397:head# 2024-04-01T19:36:17.099 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535a9790:::benchmark_data_smithi188_104537_object14814:head# 2024-04-01T19:36:17.099 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535ac229:::benchmark_data_smithi188_104537_object141821:head# 2024-04-01T19:36:17.100 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535ad477:::benchmark_data_smithi188_104537_object107181:head# 2024-04-01T19:36:17.100 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535b0420:::benchmark_data_smithi188_104537_object152784:head# 2024-04-01T19:36:17.101 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535b1afd:::benchmark_data_smithi188_104537_object78598:head# 2024-04-01T19:36:17.102 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535bf5b2:::benchmark_data_smithi188_104537_object95379:head# 2024-04-01T19:36:17.102 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535cf714:::benchmark_data_smithi188_104537_object28909:head# 2024-04-01T19:36:17.103 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535d9934:::benchmark_data_smithi188_104537_object98188:head# 2024-04-01T19:36:17.103 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535d9e41:::benchmark_data_smithi188_104537_object87780:head# 2024-04-01T19:36:17.104 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535e35e7:::benchmark_data_smithi188_104537_object101242:head# 2024-04-01T19:36:17.104 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535e7c25:::benchmark_data_smithi188_104537_object53274:head# 2024-04-01T19:36:17.104 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535e9e36:::benchmark_data_smithi188_104537_object31806:head# 2024-04-01T19:36:17.105 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535ee526:::benchmark_data_smithi188_104537_object43270:head# 2024-04-01T19:36:17.106 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535f1006:::benchmark_data_smithi188_104537_object109200:head# 2024-04-01T19:36:17.106 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535f44e3:::benchmark_data_smithi188_104537_object156240:head# 2024-04-01T19:36:17.107 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535f490c:::benchmark_data_smithi188_104537_object12217:head# 2024-04-01T19:36:17.107 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:535fdcf4:::benchmark_data_smithi188_104537_object29614:head# 2024-04-01T19:36:17.108 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53606c1f:::benchmark_data_smithi188_104537_object96118:head# 2024-04-01T19:36:17.108 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53609727:::benchmark_data_smithi188_104537_object43781:head# 2024-04-01T19:36:17.109 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5360f64e:::benchmark_data_smithi188_104537_object120549:head# 2024-04-01T19:36:17.109 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53610c27:::benchmark_data_smithi188_104537_object163744:head# 2024-04-01T19:36:17.110 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53611cb5:::benchmark_data_smithi188_104537_object100204:head# 2024-04-01T19:36:17.110 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53612da4:::benchmark_data_smithi188_104537_object63156:head# 2024-04-01T19:36:17.111 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:536152de:::benchmark_data_smithi188_104537_object88580:head# 2024-04-01T19:36:17.111 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53615572:::benchmark_data_smithi188_104537_object129930:head# 2024-04-01T19:36:17.111 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5361c5cd:::benchmark_data_smithi188_104537_object62474:head# 2024-04-01T19:36:17.112 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53624147:::benchmark_data_smithi188_104537_object73008:head# 2024-04-01T19:36:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53629e05:::benchmark_data_smithi188_104537_object40819:head# 2024-04-01T19:36:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5362cbfc:::benchmark_data_smithi188_104537_object48924:head# 2024-04-01T19:36:17.114 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5362f64d:::benchmark_data_smithi188_104537_object60554:head# 2024-04-01T19:36:17.114 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5363880e:::benchmark_data_smithi188_104537_object79719:head# 2024-04-01T19:36:17.114 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5363c79d:::benchmark_data_smithi188_104537_object99872:head# 2024-04-01T19:36:17.115 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:536456ea:::benchmark_data_smithi188_104537_object103506:head# 2024-04-01T19:36:17.115 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53654576:::benchmark_data_smithi188_104537_object88040:head# 2024-04-01T19:36:17.116 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53654ebe:::benchmark_data_smithi188_104537_object92655:head# 2024-04-01T19:36:17.116 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53667bb9:::benchmark_data_smithi188_104537_object26540:head# 2024-04-01T19:36:17.117 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5367ccea:::benchmark_data_smithi188_104537_object80619:head# 2024-04-01T19:36:17.117 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:536808d8:::benchmark_data_smithi188_104537_object167597:head# 2024-04-01T19:36:17.118 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:536935f0:::benchmark_data_smithi188_104537_object35038:head# 2024-04-01T19:36:17.118 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53696a56:::benchmark_data_smithi188_104537_object122695:head# 2024-04-01T19:36:17.119 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53699d27:::benchmark_data_smithi188_104537_object33321:head# 2024-04-01T19:36:17.119 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:536a8435:::benchmark_data_smithi188_104537_object24508:head# 2024-04-01T19:36:17.120 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:536ab10d:::benchmark_data_smithi188_104537_object169892:head# 2024-04-01T19:36:17.120 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:536aec2e:::benchmark_data_smithi188_104537_object143049:head# 2024-04-01T19:36:17.121 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:536b1189:::benchmark_data_smithi188_104537_object118959:head# 2024-04-01T19:36:17.121 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:536bdf6a:::benchmark_data_smithi188_104537_object16646:head# 2024-04-01T19:36:17.122 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:536ca248:::benchmark_data_smithi188_104537_object30274:head# 2024-04-01T19:36:17.122 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:536d320d:::benchmark_data_smithi188_104537_object116360:head# 2024-04-01T19:36:17.123 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:536d3a30:::benchmark_data_smithi188_104537_object38542:head# 2024-04-01T19:36:17.123 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:536d6aea:::benchmark_data_smithi188_104537_object19388:head# 2024-04-01T19:36:17.124 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:536ddb84:::benchmark_data_smithi188_104537_object138708:head# 2024-04-01T19:36:17.124 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:536f20e2:::benchmark_data_smithi188_104537_object122305:head# 2024-04-01T19:36:17.125 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:536f492e:::benchmark_data_smithi188_104537_object151516:head# 2024-04-01T19:36:17.125 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:536f98e6:::benchmark_data_smithi188_104537_object147006:head# 2024-04-01T19:36:17.125 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:536faf49:::benchmark_data_smithi188_104537_object126583:head# 2024-04-01T19:36:17.126 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5370a070:::benchmark_data_smithi188_104537_object33474:head# 2024-04-01T19:36:17.126 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5370bceb:::benchmark_data_smithi188_104537_object72986:head# 2024-04-01T19:36:17.127 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53712d8a:::benchmark_data_smithi188_104537_object17245:head# 2024-04-01T19:36:17.127 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5371cde9:::benchmark_data_smithi188_104537_object170123:head# 2024-04-01T19:36:17.128 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53720712:::benchmark_data_smithi188_104537_object29518:head# 2024-04-01T19:36:17.128 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53721d6d:::benchmark_data_smithi188_104537_object69097:head# 2024-04-01T19:36:17.128 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:537407db:::benchmark_data_smithi188_104537_object82764:head# 2024-04-01T19:36:17.129 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53742b6e:::benchmark_data_smithi188_104537_object27052:head# 2024-04-01T19:36:17.129 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5374ecbc:::benchmark_data_smithi188_104537_object66780:head# 2024-04-01T19:36:17.130 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:537519eb:::benchmark_data_smithi188_104537_object51967:head# 2024-04-01T19:36:17.130 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:537587ed:::benchmark_data_smithi188_104537_object130015:head# 2024-04-01T19:36:17.131 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5376033c:::benchmark_data_smithi188_104537_object17423:head# 2024-04-01T19:36:17.131 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53761984:::benchmark_data_smithi188_104537_object37291:head# 2024-04-01T19:36:17.131 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53761e21:::benchmark_data_smithi188_104537_object116010:head# 2024-04-01T19:36:17.132 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5376b1fc:::benchmark_data_smithi188_104537_object43992:head# 2024-04-01T19:36:17.132 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5376d1dd:::benchmark_data_smithi188_104537_object119408:head# 2024-04-01T19:36:17.133 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5376ed80:::benchmark_data_smithi188_104537_object86466:head# 2024-04-01T19:36:17.133 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5377382c:::benchmark_data_smithi188_104537_object41395:head# 2024-04-01T19:36:17.133 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5377c1f2:::benchmark_data_smithi188_104537_object26172:head# 2024-04-01T19:36:17.134 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53781319:::benchmark_data_smithi188_104537_object96516:head# 2024-04-01T19:36:17.134 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53782849:::benchmark_data_smithi188_104537_object65242:head# 2024-04-01T19:36:17.135 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:537885ea:::benchmark_data_smithi188_104537_object70730:head# 2024-04-01T19:36:17.135 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53789649:::benchmark_data_smithi188_104537_object162794:head# 2024-04-01T19:36:17.136 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5378e53b:::benchmark_data_smithi188_104537_object160381:head# 2024-04-01T19:36:17.136 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5378fc78:::benchmark_data_smithi188_104537_object44189:head# 2024-04-01T19:36:17.136 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53794bc1:::benchmark_data_smithi188_104537_object73704:head# 2024-04-01T19:36:17.137 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5379cb4c:::benchmark_data_smithi188_104537_object126230:head# 2024-04-01T19:36:17.137 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:537a34c8:::benchmark_data_smithi188_104537_object149429:head# 2024-04-01T19:36:17.138 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:537ae9cf:::benchmark_data_smithi188_104537_object57761:head# 2024-04-01T19:36:17.138 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:537b05d9:::benchmark_data_smithi188_104537_object134697:head# 2024-04-01T19:36:17.138 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:537bc076:::benchmark_data_smithi188_104537_object169357:head# 2024-04-01T19:36:17.139 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:537bc4ba:::benchmark_data_smithi188_104537_object156122:head# 2024-04-01T19:36:17.139 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:537bcace:::benchmark_data_smithi188_104537_object121351:head# 2024-04-01T19:36:17.140 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:537c41c8:::benchmark_data_smithi188_104537_object125021:head# 2024-04-01T19:36:17.140 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:537c64b9:::benchmark_data_smithi188_104537_object142177:head# 2024-04-01T19:36:17.141 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:537e3b5f:::benchmark_data_smithi188_104537_object34952:head# 2024-04-01T19:36:17.141 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:537ec720:::benchmark_data_smithi188_104537_object113356:head# 2024-04-01T19:36:17.142 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:537eca0a:::benchmark_data_smithi188_104537_object157036:head# 2024-04-01T19:36:17.142 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:537ed502:::benchmark_data_smithi188_104537_object101559:head# 2024-04-01T19:36:17.143 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53804928:::benchmark_data_smithi188_104537_object131794:head# 2024-04-01T19:36:17.143 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53818a80:::benchmark_data_smithi188_104537_object53828:head# 2024-04-01T19:36:17.143 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5381fa54:::benchmark_data_smithi188_104537_object46666:head# 2024-04-01T19:36:17.144 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53824710:::benchmark_data_smithi188_104537_object157776:head# 2024-04-01T19:36:17.144 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53838b30:::benchmark_data_smithi188_104537_object44734:head# 2024-04-01T19:36:17.144 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:538417ef:::benchmark_data_smithi188_104537_object152524:head# 2024-04-01T19:36:17.145 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5384208e:::benchmark_data_smithi188_104537_object33251:head# 2024-04-01T19:36:17.145 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53848559:::benchmark_data_smithi188_104537_object89756:head# 2024-04-01T19:36:17.145 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5384de9b:::benchmark_data_smithi188_104537_object96846:head# 2024-04-01T19:36:17.146 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53874f95:::benchmark_data_smithi188_104537_object111606:head# 2024-04-01T19:36:17.147 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:538783f2:::benchmark_data_smithi188_104537_object153717:head# 2024-04-01T19:36:17.147 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5387bbe9:::benchmark_data_smithi188_104537_object160005:head# 2024-04-01T19:36:17.148 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5387e0b3:::benchmark_data_smithi188_104537_object103194:head# 2024-04-01T19:36:17.148 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:538800cb:::benchmark_data_smithi188_104537_object104778:head# 2024-04-01T19:36:17.148 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:538892cf:::benchmark_data_smithi188_104537_object170909:head# 2024-04-01T19:36:17.149 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:538b25cc:::benchmark_data_smithi188_104537_object156410:head# 2024-04-01T19:36:17.149 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:538b28e8:::benchmark_data_smithi188_104537_object21397:head# 2024-04-01T19:36:17.150 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:538c91c8:::benchmark_data_smithi188_104537_object56376:head# 2024-04-01T19:36:17.150 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:538cb46e:::benchmark_data_smithi188_104537_object68757:head# 2024-04-01T19:36:17.150 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:538d6f1b:::benchmark_data_smithi188_104537_object124750:head# 2024-04-01T19:36:17.151 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:538da68a:::benchmark_data_smithi188_104537_object62224:head# 2024-04-01T19:36:17.151 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:538e5c56:::benchmark_data_smithi188_104537_object171738:head# 2024-04-01T19:36:17.152 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:538ed744:::benchmark_data_smithi188_104537_object19131:head# 2024-04-01T19:36:17.152 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:538feeb3:::benchmark_data_smithi188_104537_object119392:head# 2024-04-01T19:36:17.153 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53904e97:::benchmark_data_smithi188_104537_object11484:head# 2024-04-01T19:36:17.154 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5390fb81:::benchmark_data_smithi188_104537_object80359:head# 2024-04-01T19:36:17.154 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5391557e:::benchmark_data_smithi188_104537_object115176:head# 2024-04-01T19:36:17.154 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53918e64:::benchmark_data_smithi188_104537_object141194:head# 2024-04-01T19:36:17.154 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5391cba9:::benchmark_data_smithi188_104537_object66475:head# 2024-04-01T19:36:17.155 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5391fb13:::benchmark_data_smithi188_104537_object128082:head# 2024-04-01T19:36:17.155 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53921921:::benchmark_data_smithi188_104537_object96133:head# 2024-04-01T19:36:17.155 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5392210f:::benchmark_data_smithi188_104537_object146542:head# 2024-04-01T19:36:17.156 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53926926:::benchmark_data_smithi188_104537_object163549:head# 2024-04-01T19:36:17.156 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53927850:::benchmark_data_smithi188_104537_object127263:head# 2024-04-01T19:36:17.157 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5392a069:::benchmark_data_smithi188_104537_object114413:head# 2024-04-01T19:36:17.157 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5393f8e6:::benchmark_data_smithi188_104537_object96940:head# 2024-04-01T19:36:17.158 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5394781e:::benchmark_data_smithi188_104537_object54433:head# 2024-04-01T19:36:17.158 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5394da97:::benchmark_data_smithi188_104537_object78031:head# 2024-04-01T19:36:17.158 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53959e06:::benchmark_data_smithi188_104537_object31046:head# 2024-04-01T19:36:17.159 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5395da32:::benchmark_data_smithi188_104537_object89943:head# 2024-04-01T19:36:17.159 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:539700f3:::benchmark_data_smithi188_104537_object155824:head# 2024-04-01T19:36:17.160 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53971758:::benchmark_data_smithi188_104537_object150245:head# 2024-04-01T19:36:17.160 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5397661f:::benchmark_data_smithi188_104537_object133358:head# 2024-04-01T19:36:17.160 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:36:17.161 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53977832:::benchmark_data_smithi188_104537_object107168:head# 2024-04-01T19:36:17.161 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5397dae6:::benchmark_data_smithi188_104537_object67672:head# 2024-04-01T19:36:17.161 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:539866be:::benchmark_data_smithi188_104537_object150668:head# 2024-04-01T19:36:17.162 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5398946f:::benchmark_data_smithi188_104537_object25152:head# 2024-04-01T19:36:17.162 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53994085:::benchmark_data_smithi188_104537_object150306:head# 2024-04-01T19:36:17.163 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53994711:::benchmark_data_smithi188_104537_object87251:head# 2024-04-01T19:36:17.163 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:539a76a8:::benchmark_data_smithi188_104537_object13539:head# 2024-04-01T19:36:17.164 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:539a7cfd:::benchmark_data_smithi188_104537_object97564:head# 2024-04-01T19:36:17.164 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:17.164 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:36:17.165 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:539b253c:::benchmark_data_smithi188_104537_object110965:head# 2024-04-01T19:36:17.165 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:539ba94a:::benchmark_data_smithi188_104537_object12056:head# 2024-04-01T19:36:17.165 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:539bf831:::benchmark_data_smithi188_104537_object126667:head# 2024-04-01T19:36:17.166 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:539bfd51:::benchmark_data_smithi188_104537_object138048:head# 2024-04-01T19:36:17.166 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:539c015f:::benchmark_data_smithi188_104537_object86872:head# 2024-04-01T19:36:17.166 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:539c72a6:::benchmark_data_smithi188_104537_object148628:head# 2024-04-01T19:36:17.167 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:539c8199:::benchmark_data_smithi188_104537_object131797:head# 2024-04-01T19:36:17.167 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:539cbb6a:::benchmark_data_smithi188_104537_object171462:head# 2024-04-01T19:36:17.167 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:539d4193:::benchmark_data_smithi188_104537_object37990:head# 2024-04-01T19:36:17.168 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:539d58db:::benchmark_data_smithi188_104537_object86834:head# 2024-04-01T19:36:17.168 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:539dcea0:::benchmark_data_smithi188_104537_object50195:head# 2024-04-01T19:36:17.168 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:539e3344:::benchmark_data_smithi188_104537_object70211:head# 2024-04-01T19:36:17.169 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:539e4a5d:::benchmark_data_smithi188_104537_object126025:head# 2024-04-01T19:36:17.169 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:539e8331:::benchmark_data_smithi188_104537_object45284:head# 2024-04-01T19:36:17.170 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:539ee745:::benchmark_data_smithi188_104537_object92217:head# 2024-04-01T19:36:17.170 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:539f9f23:::benchmark_data_smithi188_104537_object103272:head# 2024-04-01T19:36:17.170 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:539fc9a6:::benchmark_data_smithi188_104537_object114471:head# 2024-04-01T19:36:17.171 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a02eb3:::benchmark_data_smithi188_104537_object16919:head# 2024-04-01T19:36:17.171 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a06cdd:::benchmark_data_smithi188_104537_object166435:head# 2024-04-01T19:36:17.172 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a08801:::benchmark_data_smithi188_104537_object101069:head# 2024-04-01T19:36:17.172 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a0f27b:::benchmark_data_smithi188_104537_object63109:head# 2024-04-01T19:36:17.172 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a187c0:::benchmark_data_smithi188_104537_object108413:head# 2024-04-01T19:36:17.173 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a1ddd9:::benchmark_data_smithi188_104537_object39725:head# 2024-04-01T19:36:17.173 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a1e26b:::benchmark_data_smithi188_104537_object96011:head# 2024-04-01T19:36:17.174 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a2291b:::benchmark_data_smithi188_104537_object135494:head# 2024-04-01T19:36:17.174 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a26045:::benchmark_data_smithi188_104537_object22080:head# 2024-04-01T19:36:17.175 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a28289:::benchmark_data_smithi188_104537_object51989:head# 2024-04-01T19:36:17.175 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a28d76:::benchmark_data_smithi188_104537_object107046:head# 2024-04-01T19:36:17.175 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a2b399:::benchmark_data_smithi188_104537_object52333:head# 2024-04-01T19:36:17.176 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a2cd33:::benchmark_data_smithi188_104537_object162210:head# 2024-04-01T19:36:17.176 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a30ee2:::benchmark_data_smithi188_104537_object123841:head# 2024-04-01T19:36:17.177 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a33104:::benchmark_data_smithi188_104537_object38782:head# 2024-04-01T19:36:17.177 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a33404:::benchmark_data_smithi188_104537_object83590:head# 2024-04-01T19:36:17.178 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a352ad:::benchmark_data_smithi188_104537_object162473:head# 2024-04-01T19:36:17.178 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a376a8:::benchmark_data_smithi188_104537_object100255:head# 2024-04-01T19:36:17.178 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a3833b:::benchmark_data_smithi188_104537_object20710:head# 2024-04-01T19:36:17.179 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a3f322:::benchmark_data_smithi188_104537_object67427:head# 2024-04-01T19:36:17.179 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a41538:::benchmark_data_smithi188_104537_object93656:head# 2024-04-01T19:36:17.180 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a44178:::benchmark_data_smithi188_104537_object49329:head# 2024-04-01T19:36:17.180 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a526fa:::benchmark_data_smithi188_104537_object160789:head# 2024-04-01T19:36:17.180 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a56739:::benchmark_data_smithi188_104537_object29706:head# 2024-04-01T19:36:17.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a5a012:::benchmark_data_smithi188_104537_object147519:head# 2024-04-01T19:36:17.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a5ab75:::benchmark_data_smithi188_104537_object55681:head# 2024-04-01T19:36:17.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a6077a:::benchmark_data_smithi188_104537_object23748:head# 2024-04-01T19:36:17.183 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a64d61:::benchmark_data_smithi188_104537_object131141:head# 2024-04-01T19:36:17.183 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a72f5e:::benchmark_data_smithi188_104537_object109074:head# 2024-04-01T19:36:17.183 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a7797a:::benchmark_data_smithi188_104537_object152260:head# 2024-04-01T19:36:17.183 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a7f066:::benchmark_data_smithi188_104537_object98678:head# 2024-04-01T19:36:17.184 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a8362e:::benchmark_data_smithi188_104537_object117390:head# 2024-04-01T19:36:17.184 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a85ff7:::benchmark_data_smithi188_104537_object76094:head# 2024-04-01T19:36:17.185 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a8669c:::benchmark_data_smithi188_104537_object113094:head# 2024-04-01T19:36:17.185 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a89f6b:::benchmark_data_smithi188_104537_object156842:head# 2024-04-01T19:36:17.186 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a8ef35:::benchmark_data_smithi188_104537_object123746:head# 2024-04-01T19:36:17.186 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a91235:::benchmark_data_smithi188_104537_object78440:head# 2024-04-01T19:36:17.187 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53a913ed:::benchmark_data_smithi188_104537_object128729:head# 2024-04-01T19:36:17.187 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53aa129b:::benchmark_data_smithi188_104537_object114773:head# 2024-04-01T19:36:17.187 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53aadd06:::benchmark_data_smithi188_104537_object145064:head# 2024-04-01T19:36:17.188 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53aafef2:::benchmark_data_smithi188_104537_object136799:head# 2024-04-01T19:36:17.188 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53abe602:::benchmark_data_smithi188_104537_object57226:head# 2024-04-01T19:36:17.189 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53abe993:::benchmark_data_smithi188_104537_object58540:head# 2024-04-01T19:36:17.189 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53abf997:::benchmark_data_smithi188_104537_object165492:head# 2024-04-01T19:36:17.190 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53ac21cb:::benchmark_data_smithi188_104537_object139027:head# 2024-04-01T19:36:17.190 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53ac22e0:::benchmark_data_smithi188_104537_object96934:head# 2024-04-01T19:36:17.190 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:36:17.191 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53ac570e:::benchmark_data_smithi188_104537_object17963:head# 2024-04-01T19:36:17.191 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53acb899:::benchmark_data_smithi188_104537_object46481:head# 2024-04-01T19:36:17.191 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53ad31b4:::benchmark_data_smithi188_104537_object139863:head# 2024-04-01T19:36:17.192 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53ad60ac:::benchmark_data_smithi188_104537_object41042:head# 2024-04-01T19:36:17.192 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53adcf1c:::benchmark_data_smithi188_104537_object99928:head# 2024-04-01T19:36:17.193 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53aef779:::benchmark_data_smithi188_104537_object51901:head# 2024-04-01T19:36:17.193 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53b009fa:::benchmark_data_smithi188_104537_object58701:head# 2024-04-01T19:36:17.193 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53b0a8be:::benchmark_data_smithi188_104537_object152613:head# 2024-04-01T19:36:17.194 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53b0c8c5:::benchmark_data_smithi188_104537_object52160:head# 2024-04-01T19:36:17.194 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53b19918:::benchmark_data_smithi188_104537_object64782:head# 2024-04-01T19:36:17.195 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53b1aa40:::benchmark_data_smithi188_104537_object100544:head# 2024-04-01T19:36:17.195 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53b27b50:::benchmark_data_smithi188_104537_object136505:head# 2024-04-01T19:36:17.195 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53b2d4d8:::benchmark_data_smithi188_104537_object84807:head# 2024-04-01T19:36:17.196 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53b2e07e:::benchmark_data_smithi188_104537_object83361:head# 2024-04-01T19:36:17.196 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53b31e43:::benchmark_data_smithi188_104537_object80023:head# 2024-04-01T19:36:17.197 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53b33620:::benchmark_data_smithi188_104537_object114576:head# 2024-04-01T19:36:17.197 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53b41ca5:::benchmark_data_smithi188_104537_object41945:head# 2024-04-01T19:36:17.197 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53b48750:::benchmark_data_smithi188_104537_object31438:head# 2024-04-01T19:36:17.198 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53b584ef:::benchmark_data_smithi188_104537_object75573:head# 2024-04-01T19:36:17.198 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53b6a217:::benchmark_data_smithi188_104537_object79711:head# 2024-04-01T19:36:17.199 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53b6c48b:::benchmark_data_smithi188_104537_object12211:head# 2024-04-01T19:36:17.199 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53b6da80:::benchmark_data_smithi188_104537_object27068:head# 2024-04-01T19:36:17.200 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53b6e9c7:::benchmark_data_smithi188_104537_object22069:head# 2024-04-01T19:36:17.200 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53b6f920:::benchmark_data_smithi188_104537_object53520:head# 2024-04-01T19:36:17.200 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53b71e12:::benchmark_data_smithi188_104537_object140146:head# 2024-04-01T19:36:17.201 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53b72b29:::benchmark_data_smithi188_104537_object163222:head# 2024-04-01T19:36:17.201 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53b8644f:::benchmark_data_smithi188_104537_object32634:head# 2024-04-01T19:36:17.202 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53b8f10f:::benchmark_data_smithi188_104537_object134610:head# 2024-04-01T19:36:17.202 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53b9537d:::benchmark_data_smithi188_104537_object109346:head# 2024-04-01T19:36:17.203 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53b9ecb2:::benchmark_data_smithi188_104537_object92877:head# 2024-04-01T19:36:17.203 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53ba63d8:::benchmark_data_smithi188_104537_object29013:head# 2024-04-01T19:36:17.203 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53bab0f4:::benchmark_data_smithi188_104537_object157472:head# 2024-04-01T19:36:17.204 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53bb1389:::benchmark_data_smithi188_104537_object150364:head# 2024-04-01T19:36:17.204 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53bb5a6c:::benchmark_data_smithi188_104537_object77887:head# 2024-04-01T19:36:17.204 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53bbb0db:::benchmark_data_smithi188_104537_object126343:head# 2024-04-01T19:36:17.205 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53bbb406:::benchmark_data_smithi188_104537_object139608:head# 2024-04-01T19:36:17.205 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53bbb785:::benchmark_data_smithi188_104537_object33096:head# 2024-04-01T19:36:17.206 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53bbd480:::benchmark_data_smithi188_104537_object12941:head# 2024-04-01T19:36:17.206 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53bc97d9:::benchmark_data_smithi188_104537_object48215:head# 2024-04-01T19:36:17.207 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53bcc72f:::benchmark_data_smithi188_104537_object63770:head# 2024-04-01T19:36:17.207 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53bd5a7b:::benchmark_data_smithi188_104537_object62053:head# 2024-04-01T19:36:17.208 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53bd99f9:::benchmark_data_smithi188_104537_object115217:head# 2024-04-01T19:36:17.208 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53bdbe5f:::benchmark_data_smithi188_104537_object101511:head# 2024-04-01T19:36:17.209 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53be3de9:::benchmark_data_smithi188_104537_object97614:head# 2024-04-01T19:36:17.209 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53be8f49:::benchmark_data_smithi188_104537_object73851:head# 2024-04-01T19:36:17.209 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53bec0e8:::benchmark_data_smithi188_104537_object31604:head# 2024-04-01T19:36:17.210 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53bf01ac:::benchmark_data_smithi188_104537_object68595:head# 2024-04-01T19:36:17.210 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53bf8129:::benchmark_data_smithi188_104537_object48997:head# 2024-04-01T19:36:17.211 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53bf973a:::benchmark_data_smithi188_104537_object142957:head# 2024-04-01T19:36:17.211 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53bfc2f3:::benchmark_data_smithi188_104537_object148550:head# 2024-04-01T19:36:17.212 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c02069:::benchmark_data_smithi188_104537_object162200:head# 2024-04-01T19:36:17.212 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c03365:::benchmark_data_smithi188_104537_object20615:head# 2024-04-01T19:36:17.213 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c04906:::benchmark_data_smithi188_104537_object30327:head# 2024-04-01T19:36:17.213 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c0576e:::benchmark_data_smithi188_104537_object46430:head# 2024-04-01T19:36:17.213 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c05e43:::benchmark_data_smithi188_104537_object76587:head# 2024-04-01T19:36:17.214 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c0c340:::benchmark_data_smithi188_104537_object138660:head# 2024-04-01T19:36:17.214 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c0e15e:::benchmark_data_smithi188_104537_object43812:head# 2024-04-01T19:36:17.215 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c2b895:::benchmark_data_smithi188_104537_object22951:head# 2024-04-01T19:36:17.215 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c2c228:::benchmark_data_smithi188_104537_object42735:head# 2024-04-01T19:36:17.216 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c2c53e:::benchmark_data_smithi188_104537_object83238:head# 2024-04-01T19:36:17.216 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c3d59c:::benchmark_data_smithi188_104537_object41587:head# 2024-04-01T19:36:17.216 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c404d1:::benchmark_data_smithi188_104537_object15864:head# 2024-04-01T19:36:17.217 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c428c0:::benchmark_data_smithi188_104537_object92987:head# 2024-04-01T19:36:17.218 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c4bcab:::benchmark_data_smithi188_104537_object166608:head# 2024-04-01T19:36:17.218 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c4d122:::benchmark_data_smithi188_104537_object139354:head# 2024-04-01T19:36:17.218 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c52e0b:::benchmark_data_smithi188_104537_object150244:head# 2024-04-01T19:36:17.218 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c5f1b8:::benchmark_data_smithi188_104537_object23999:head# 2024-04-01T19:36:17.219 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c69ce0:::benchmark_data_smithi188_104537_object131178:head# 2024-04-01T19:36:17.219 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c6ae1e:::benchmark_data_smithi188_104537_object95390:head# 2024-04-01T19:36:17.220 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c6eaec:::benchmark_data_smithi188_104537_object168059:head# 2024-04-01T19:36:17.220 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c6fde1:::benchmark_data_smithi188_104537_object90058:head# 2024-04-01T19:36:17.221 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c70a74:::benchmark_data_smithi188_104537_object74919:head# 2024-04-01T19:36:17.221 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c7996e:::benchmark_data_smithi188_104537_object74682:head# 2024-04-01T19:36:17.221 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c79fc2:::benchmark_data_smithi188_104537_object78446:head# 2024-04-01T19:36:17.222 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c7da09:::benchmark_data_smithi188_104537_object71956:head# 2024-04-01T19:36:17.222 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c7ee74:::benchmark_data_smithi188_104537_object141526:head# 2024-04-01T19:36:17.223 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c82034:::benchmark_data_smithi188_104537_object70243:head# 2024-04-01T19:36:17.223 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c88373:::benchmark_data_smithi188_104537_object167063:head# 2024-04-01T19:36:17.224 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c932a3:::benchmark_data_smithi188_104537_object17658:head# 2024-04-01T19:36:17.224 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c9f868:::benchmark_data_smithi188_104537_object24602:head# 2024-04-01T19:36:17.225 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53c9ffcf:::benchmark_data_smithi188_104537_object171175:head# 2024-04-01T19:36:17.225 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53ca7423:::benchmark_data_smithi188_104537_object58610:head# 2024-04-01T19:36:17.226 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53cb4222:::benchmark_data_smithi188_104537_object100599:head# 2024-04-01T19:36:17.226 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53cb5428:::benchmark_data_smithi188_104537_object154922:head# 2024-04-01T19:36:17.227 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53cb8d1e:::benchmark_data_smithi188_104537_object67280:head# 2024-04-01T19:36:17.227 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53cbd414:::benchmark_data_smithi188_104537_object47574:head# 2024-04-01T19:36:17.228 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53cc7b39:::benchmark_data_smithi188_104537_object137579:head# 2024-04-01T19:36:17.228 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53ccaf82:::benchmark_data_smithi188_104537_object83221:head# 2024-04-01T19:36:17.229 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53ccee40:::benchmark_data_smithi188_104537_object154657:head# 2024-04-01T19:36:17.229 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53cdec19:::benchmark_data_smithi188_104537_object63124:head# 2024-04-01T19:36:17.229 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53ce4418:::benchmark_data_smithi188_104537_object139140:head# 2024-04-01T19:36:17.229 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53cf6293:::benchmark_data_smithi188_104537_object136390:head# 2024-04-01T19:36:17.230 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53cf8be3:::benchmark_data_smithi188_104537_object116082:head# 2024-04-01T19:36:17.231 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53cfa59c:::benchmark_data_smithi188_104537_object71332:head# 2024-04-01T19:36:17.231 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53cfda95:::benchmark_data_smithi188_104537_object69862:head# 2024-04-01T19:36:17.231 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53cfdb3a:::benchmark_data_smithi188_104537_object75901:head# 2024-04-01T19:36:17.232 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53d1195c:::benchmark_data_smithi188_104537_object136667:head# 2024-04-01T19:36:17.233 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53d11d05:::benchmark_data_smithi188_104537_object121509:head# 2024-04-01T19:36:17.234 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53d1cf61:::benchmark_data_smithi188_104537_object108804:head# 2024-04-01T19:36:17.235 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53d1e873:::benchmark_data_smithi188_104537_object21019:head# 2024-04-01T19:36:17.235 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53d204db:::benchmark_data_smithi188_104537_object144796:head# 2024-04-01T19:36:17.235 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53d2ac99:::benchmark_data_smithi188_104537_object27506:head# 2024-04-01T19:36:17.236 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53d2be4d:::benchmark_data_smithi188_104537_object100682:head# 2024-04-01T19:36:17.236 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53d2d42b:::benchmark_data_smithi188_104537_object132081:head# 2024-04-01T19:36:17.237 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53d49668:::benchmark_data_smithi188_104537_object149310:head# 2024-04-01T19:36:17.237 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53d6d8a1:::benchmark_data_smithi188_104537_object160046:head# 2024-04-01T19:36:17.238 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53d6f5a0:::benchmark_data_smithi188_104537_object117067:head# 2024-04-01T19:36:17.238 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53d76d14:::benchmark_data_smithi188_104537_object74249:head# 2024-04-01T19:36:17.239 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53d7aecc:::benchmark_data_smithi188_104537_object64551:head# 2024-04-01T19:36:17.239 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53d9cacf:::benchmark_data_smithi188_104537_object72804:head# 2024-04-01T19:36:17.239 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53d9e55a:::benchmark_data_smithi188_104537_object99931:head# 2024-04-01T19:36:17.240 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53da531c:::benchmark_data_smithi188_104537_object52188:head# 2024-04-01T19:36:17.240 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53daadf2:::benchmark_data_smithi188_104537_object56648:head# 2024-04-01T19:36:17.241 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53db2cf4:::benchmark_data_smithi188_104537_object65264:head# 2024-04-01T19:36:17.241 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53db772e:::benchmark_data_smithi188_104537_object45889:head# 2024-04-01T19:36:17.242 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53dbb043:::benchmark_data_smithi188_104537_object73590:head# 2024-04-01T19:36:17.242 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53dbbcbe:::benchmark_data_smithi188_104537_object45674:head# 2024-04-01T19:36:17.243 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53dc0dc7:::benchmark_data_smithi188_104537_object98698:head# 2024-04-01T19:36:17.243 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53dc390f:::benchmark_data_smithi188_104537_object153635:head# 2024-04-01T19:36:17.244 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53dc6c1a:::benchmark_data_smithi188_104537_object48547:head# 2024-04-01T19:36:17.244 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53dc92c5:::benchmark_data_smithi188_104537_object129108:head# 2024-04-01T19:36:17.244 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53dcd6c6:::benchmark_data_smithi188_104537_object103684:head# 2024-04-01T19:36:17.245 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53dd09cb:::benchmark_data_smithi188_104537_object124643:head# 2024-04-01T19:36:17.245 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53dd5ddd:::benchmark_data_smithi188_104537_object144321:head# 2024-04-01T19:36:17.246 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53de806d:::benchmark_data_smithi188_104537_object133078:head# 2024-04-01T19:36:17.246 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53df454e:::benchmark_data_smithi188_104537_object76403:head# 2024-04-01T19:36:17.247 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53df5f38:::benchmark_data_smithi188_104537_object95642:head# 2024-04-01T19:36:17.248 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e068e3:::benchmark_data_smithi188_104537_object65052:head# 2024-04-01T19:36:17.248 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e0c1c8:::benchmark_data_smithi188_104537_object16162:head# 2024-04-01T19:36:17.248 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e0db90:::benchmark_data_smithi188_104537_object152901:head# 2024-04-01T19:36:17.249 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e12efc:::benchmark_data_smithi188_104537_object24565:head# 2024-04-01T19:36:17.249 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e1e35c:::benchmark_data_smithi188_104537_object47663:head# 2024-04-01T19:36:17.250 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e26493:::benchmark_data_smithi188_104537_object62864:head# 2024-04-01T19:36:17.250 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e275b9:::benchmark_data_smithi188_104537_object163773:head# 2024-04-01T19:36:17.251 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e2d245:::benchmark_data_smithi188_104537_object41514:head# 2024-04-01T19:36:17.251 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e2d3f2:::benchmark_data_smithi188_104537_object84045:head# 2024-04-01T19:36:17.252 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e38ab0:::benchmark_data_smithi188_104537_object37987:head# 2024-04-01T19:36:17.252 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e3be8c:::benchmark_data_smithi188_104537_object129760:head# 2024-04-01T19:36:17.253 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e44ae6:::benchmark_data_smithi188_104537_object160223:head# 2024-04-01T19:36:17.253 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e4e534:::benchmark_data_smithi188_104537_object75558:head# 2024-04-01T19:36:17.254 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e4e8d5:::benchmark_data_smithi188_104537_object154017:head# 2024-04-01T19:36:17.254 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e569f5:::benchmark_data_smithi188_104537_object155398:head# 2024-04-01T19:36:17.255 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e56ad9:::benchmark_data_smithi188_104537_object12306:head# 2024-04-01T19:36:17.255 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e66156:::benchmark_data_smithi188_104537_object45624:head# 2024-04-01T19:36:17.256 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e6b77f:::benchmark_data_smithi188_104537_object40820:head# 2024-04-01T19:36:17.256 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e7c9ea:::benchmark_data_smithi188_104537_object163842:head# 2024-04-01T19:36:17.257 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e82915:::benchmark_data_smithi188_104537_object116542:head# 2024-04-01T19:36:17.257 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e84dda:::benchmark_data_smithi188_104537_object20689:head# 2024-04-01T19:36:17.258 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e8666a:::benchmark_data_smithi188_104537_object92582:head# 2024-04-01T19:36:17.258 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e8acc4:::benchmark_data_smithi188_104537_object168088:head# 2024-04-01T19:36:17.259 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e98178:::benchmark_data_smithi188_104537_object87406:head# 2024-04-01T19:36:17.260 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e99903:::benchmark_data_smithi188_104537_object109367:head# 2024-04-01T19:36:17.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:17 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4242346137' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:36:17.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:17 smithi062 ceph-mon[44211]: from='client.35648 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:36:17.261 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53e9b252:::benchmark_data_smithi188_104537_object122888:head# 2024-04-01T19:36:17.261 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53ea3104:::benchmark_data_smithi188_104537_object114985:head# 2024-04-01T19:36:17.261 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53ea4873:::benchmark_data_smithi188_104537_object60871:head# 2024-04-01T19:36:17.262 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53eae52c:::benchmark_data_smithi188_104537_object61600:head# 2024-04-01T19:36:17.262 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53eb3dbd:::benchmark_data_smithi188_104537_object28988:head# 2024-04-01T19:36:17.263 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53eb7c90:::benchmark_data_smithi188_104537_object160113:head# 2024-04-01T19:36:17.263 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53ec254c:::benchmark_data_smithi188_104537_object146283:head# 2024-04-01T19:36:17.263 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53ec3335:::benchmark_data_smithi188_104537_object29070:head# 2024-04-01T19:36:17.264 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53ec441d:::benchmark_data_smithi188_104537_object18793:head# 2024-04-01T19:36:17.264 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53ecbb67:::benchmark_data_smithi188_104537_object139267:head# 2024-04-01T19:36:17.265 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:36:17.266 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53ece765:::benchmark_data_smithi188_104537_object57808:head# 2024-04-01T19:36:17.266 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53ed89b5:::benchmark_data_smithi188_104537_object80596:head# 2024-04-01T19:36:17.266 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53edf78a:::benchmark_data_smithi188_104537_object132700:head# 2024-04-01T19:36:17.267 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53edfefe:::benchmark_data_smithi188_104537_object99411:head# 2024-04-01T19:36:17.267 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53eff8d7:::benchmark_data_smithi188_104537_object24164:head# 2024-04-01T19:36:17.267 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53f05833:::benchmark_data_smithi188_104537_object66604:head# 2024-04-01T19:36:17.267 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53f1bcdc:::benchmark_data_smithi188_104537_object68880:head# 2024-04-01T19:36:17.268 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53f22317:::benchmark_data_smithi188_104537_object150365:head# 2024-04-01T19:36:17.269 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53f223e2:::benchmark_data_smithi188_104537_object121918:head# 2024-04-01T19:36:17.269 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53f2cd7b:::benchmark_data_smithi188_104537_object119935:head# 2024-04-01T19:36:17.269 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53f2ede1:::benchmark_data_smithi188_104537_object137371:head# 2024-04-01T19:36:17.270 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53f2f51a:::benchmark_data_smithi188_104537_object140107:head# 2024-04-01T19:36:17.270 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53f35a11:::benchmark_data_smithi188_104537_object32459:head# 2024-04-01T19:36:17.271 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53f42970:::benchmark_data_smithi188_104537_object89854:head# 2024-04-01T19:36:17.272 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53f436f3:::benchmark_data_smithi188_104537_object48538:head# 2024-04-01T19:36:17.272 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53f465f8:::benchmark_data_smithi188_104537_object27912:head# 2024-04-01T19:36:17.272 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53f48b2f:::benchmark_data_smithi188_104537_object18583:head# 2024-04-01T19:36:17.273 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53f5f8c1:::benchmark_data_smithi188_104537_object116368:head# 2024-04-01T19:36:17.273 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53f65d7f:::benchmark_data_smithi188_104537_object92651:head# 2024-04-01T19:36:17.274 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53f69c57:::benchmark_data_smithi188_104537_object150784:head# 2024-04-01T19:36:17.274 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53f6e4e4:::benchmark_data_smithi188_104537_object162774:head# 2024-04-01T19:36:17.274 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53f7371b:::benchmark_data_smithi188_104537_object42229:head# 2024-04-01T19:36:17.275 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53f79543:::benchmark_data_smithi188_104537_object53630:head# 2024-04-01T19:36:17.276 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53f7b8c3:::benchmark_data_smithi188_104537_object123413:head# 2024-04-01T19:36:17.276 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53f829d1:::benchmark_data_smithi188_104537_object170522:head# 2024-04-01T19:36:17.277 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53f947a3:::benchmark_data_smithi188_104537_object157958:head# 2024-04-01T19:36:17.277 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53f97f6a:::benchmark_data_smithi188_104537_object41323:head# 2024-04-01T19:36:17.278 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53f9a891:::benchmark_data_smithi188_104537_object138530:head# 2024-04-01T19:36:17.278 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53fa2556:::benchmark_data_smithi188_104537_object42179:head# 2024-04-01T19:36:17.279 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53fa700d:::benchmark_data_smithi188_104537_object53095:head# 2024-04-01T19:36:17.279 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53faa640:::benchmark_data_smithi188_104537_object155604:head# 2024-04-01T19:36:17.279 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53fb5340:::benchmark_data_smithi188_104537_object117414:head# 2024-04-01T19:36:17.280 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53fbce5a:::benchmark_data_smithi188_104537_object145812:head# 2024-04-01T19:36:17.281 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53fbecda:::benchmark_data_smithi188_104537_object87345:head# 2024-04-01T19:36:17.281 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53fc8b7c:::benchmark_data_smithi188_104537_object110557:head# 2024-04-01T19:36:17.281 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53fca9c9:::benchmark_data_smithi188_104537_object60383:head# 2024-04-01T19:36:17.282 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53fccb8c:::benchmark_data_smithi188_104537_object34882:head# 2024-04-01T19:36:17.283 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53ff1819:::benchmark_data_smithi188_104537_object102150:head# 2024-04-01T19:36:17.283 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53ff3046:::benchmark_data_smithi188_104537_object14717:head# 2024-04-01T19:36:17.283 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53ff85ca:::benchmark_data_smithi188_104537_object53723:head# 2024-04-01T19:36:17.284 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:53ffa60f:::benchmark_data_smithi188_104537_object38277:head# 2024-04-01T19:36:17.285 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54008845:::benchmark_data_smithi188_104537_object80447:head# 2024-04-01T19:36:17.285 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5401eb21:::benchmark_data_smithi188_104537_object69856:head# 2024-04-01T19:36:17.286 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54020976:::benchmark_data_smithi188_104537_object107185:head# 2024-04-01T19:36:17.286 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54021f55:::benchmark_data_smithi188_104537_object162122:head# 2024-04-01T19:36:17.286 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:540258a4:::benchmark_data_smithi188_104537_object73220:head# 2024-04-01T19:36:17.287 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5402bcfe:::benchmark_data_smithi188_104537_object147483:head# 2024-04-01T19:36:17.287 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5402e0fb:::benchmark_data_smithi188_104537_object37062:head# 2024-04-01T19:36:17.288 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:540354a8:::benchmark_data_smithi188_104537_object170263:head# 2024-04-01T19:36:17.288 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54035b89:::benchmark_data_smithi188_104537_object165551:head# 2024-04-01T19:36:17.289 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:540386d0:::benchmark_data_smithi188_104537_object12082:head# 2024-04-01T19:36:17.289 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5404621e:::benchmark_data_smithi188_104537_object117850:head# 2024-04-01T19:36:17.290 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54047e18:::benchmark_data_smithi188_104537_object137784:head# 2024-04-01T19:36:17.290 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:540571f9:::benchmark_data_smithi188_104537_object67740:head# 2024-04-01T19:36:17.291 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5406bf67:::benchmark_data_smithi188_104537_object73788:head# 2024-04-01T19:36:17.291 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:540776b8:::benchmark_data_smithi188_104537_object144603:head# 2024-04-01T19:36:17.292 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:540815bb:::benchmark_data_smithi188_104537_object15314:head# 2024-04-01T19:36:17.292 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:17 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4242346137' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:36:17.292 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:17 smithi022 ceph-mon[39439]: from='client.35648 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:36:17.293 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54090f80:::benchmark_data_smithi188_104537_object30049:head# 2024-04-01T19:36:17.293 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5409b846:::benchmark_data_smithi188_104537_object38393:head# 2024-04-01T19:36:17.293 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:540a2a0e:::benchmark_data_smithi188_104537_object55079:head# 2024-04-01T19:36:17.294 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:540af463:::benchmark_data_smithi188_104537_object170013:head# 2024-04-01T19:36:17.294 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:17.295 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:540bcf2f:::benchmark_data_smithi188_104537_object99706:head# 2024-04-01T19:36:17.295 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:540c7008:::benchmark_data_smithi188_104537_object129404:head# 2024-04-01T19:36:17.295 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:540c872d:::benchmark_data_smithi188_104537_object72538:head# 2024-04-01T19:36:17.296 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:540cf9b2:::benchmark_data_smithi188_104537_object128332:head# 2024-04-01T19:36:17.296 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:540d0bb3:::benchmark_data_smithi188_104537_object88670:head# 2024-04-01T19:36:17.297 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:540d4191:::benchmark_data_smithi188_104537_object116994:head# 2024-04-01T19:36:17.297 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:540db1b5:::benchmark_data_smithi188_104537_object13562:head# 2024-04-01T19:36:17.298 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:540e1165:::benchmark_data_smithi188_104537_object21371:head# 2024-04-01T19:36:17.298 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:540e2255:::benchmark_data_smithi188_104537_object169037:head# 2024-04-01T19:36:17.299 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:540e5778:::benchmark_data_smithi188_104537_object148648:head# 2024-04-01T19:36:17.300 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:540e7151:::benchmark_data_smithi188_104537_object21490:head# 2024-04-01T19:36:17.300 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:540e9394:::benchmark_data_smithi188_104537_object121886:head# 2024-04-01T19:36:17.301 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:540eb0a4:::benchmark_data_smithi188_104537_object163883:head# 2024-04-01T19:36:17.301 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:540eb22d:::benchmark_data_smithi188_104537_object92952:head# 2024-04-01T19:36:17.302 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:541018e9:::benchmark_data_smithi188_104537_object165145:head# 2024-04-01T19:36:17.302 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54102440:::benchmark_data_smithi188_104537_object91767:head# 2024-04-01T19:36:17.303 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5410934c:::benchmark_data_smithi188_104537_object147217:head# 2024-04-01T19:36:17.303 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54109fc4:::benchmark_data_smithi188_104537_object136814:head# 2024-04-01T19:36:17.304 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5410c5eb:::benchmark_data_smithi188_104537_object82967:head# 2024-04-01T19:36:17.304 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5410fdf8:::benchmark_data_smithi188_104537_object165184:head# 2024-04-01T19:36:17.305 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54112131:::benchmark_data_smithi188_104537_object57464:head# 2024-04-01T19:36:17.305 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5411a85f:::benchmark_data_smithi188_104537_object43880:head# 2024-04-01T19:36:17.306 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5411a889:::benchmark_data_smithi188_104537_object136369:head# 2024-04-01T19:36:17.306 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54127383:::benchmark_data_smithi188_104537_object119216:head# 2024-04-01T19:36:17.306 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:541353e3:::benchmark_data_smithi188_104537_object101992:head# 2024-04-01T19:36:17.307 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:541467c2:::benchmark_data_smithi188_104537_object118335:head# 2024-04-01T19:36:17.307 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54149755:::benchmark_data_smithi188_104537_object90988:head# 2024-04-01T19:36:17.308 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:541504f0:::benchmark_data_smithi188_104537_object64521:head# 2024-04-01T19:36:17.308 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54150b1a:::benchmark_data_smithi188_104537_object132227:head# 2024-04-01T19:36:17.308 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54154175:::benchmark_data_smithi188_104537_object55032:head# 2024-04-01T19:36:17.309 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5415d2c0:::benchmark_data_smithi188_104537_object68781:head# 2024-04-01T19:36:17.309 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5416067a:::benchmark_data_smithi188_104537_object166815:head# 2024-04-01T19:36:17.310 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54161d2a:::benchmark_data_smithi188_104537_object148321:head# 2024-04-01T19:36:17.310 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54167290:::benchmark_data_smithi188_104537_object165021:head# 2024-04-01T19:36:17.311 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5416a731:::benchmark_data_smithi188_104537_object49162:head# 2024-04-01T19:36:17.311 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54170612:::benchmark_data_smithi188_104537_object168195:head# 2024-04-01T19:36:17.312 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54182c2e:::benchmark_data_smithi188_104537_object71322:head# 2024-04-01T19:36:17.312 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54185748:::benchmark_data_smithi188_104537_object43277:head# 2024-04-01T19:36:17.313 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5418e909:::benchmark_data_smithi188_104537_object90737:head# 2024-04-01T19:36:17.313 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5419d2a3:::benchmark_data_smithi188_104537_object72627:head# 2024-04-01T19:36:17.314 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:541a5c7f:::benchmark_data_smithi188_104537_object32628:head# 2024-04-01T19:36:17.318 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:541a9e8f:::benchmark_data_smithi188_104537_object38561:head# 2024-04-01T19:36:17.319 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:541b42c9:::benchmark_data_smithi188_104537_object75165:head# 2024-04-01T19:36:17.319 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:541d18a6:::benchmark_data_smithi188_104537_object69509:head# 2024-04-01T19:36:17.319 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:541d4078:::benchmark_data_smithi188_104537_object159949:head# 2024-04-01T19:36:17.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:541d5f04:::benchmark_data_smithi188_104537_object147775:head# 2024-04-01T19:36:17.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:541d9e56:::benchmark_data_smithi188_104537_object113056:head# 2024-04-01T19:36:17.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:541dc688:::benchmark_data_smithi188_104537_object93373:head# 2024-04-01T19:36:17.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:541e1cb8:::benchmark_data_smithi188_104537_object171099:head# 2024-04-01T19:36:17.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:541e6c61:::benchmark_data_smithi188_104537_object56649:head# 2024-04-01T19:36:17.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:541e9a74:::benchmark_data_smithi188_104537_object152438:head# 2024-04-01T19:36:17.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:541ebe05:::benchmark_data_smithi188_104537_object23054:head# 2024-04-01T19:36:17.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:541f0507:::benchmark_data_smithi188_104537_object47082:head# 2024-04-01T19:36:17.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:541f0bf2:::benchmark_data_smithi188_104537_object166708:head# 2024-04-01T19:36:17.321 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:541f3de5:::benchmark_data_smithi188_104537_object63070:head# 2024-04-01T19:36:17.321 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:541fb9a5:::benchmark_data_smithi188_104537_object91459:head# 2024-04-01T19:36:17.321 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:541fedc3:::benchmark_data_smithi188_104537_object38016:head# 2024-04-01T19:36:17.321 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54206d4b:::benchmark_data_smithi188_104537_object70070:head# 2024-04-01T19:36:17.322 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5421075d:::benchmark_data_smithi188_104537_object111689:head# 2024-04-01T19:36:17.322 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:542199c7:::benchmark_data_smithi188_104537_object66241:head# 2024-04-01T19:36:17.323 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5421dd36:::benchmark_data_smithi188_104537_object128925:head# 2024-04-01T19:36:17.323 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5421f9af:::benchmark_data_smithi188_104537_object71640:head# 2024-04-01T19:36:17.323 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54220070:::benchmark_data_smithi188_104537_object80576:head# 2024-04-01T19:36:17.324 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54228153:::benchmark_data_smithi188_104537_object36152:head# 2024-04-01T19:36:17.324 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5422857e:::benchmark_data_smithi188_104537_object112860:head# 2024-04-01T19:36:17.325 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54229678:::benchmark_data_smithi188_104537_object96810:head# 2024-04-01T19:36:17.325 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5423461e:::benchmark_data_smithi188_104537_object23177:head# 2024-04-01T19:36:17.326 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5423dc8e:::benchmark_data_smithi188_104537_object18311:head# 2024-04-01T19:36:17.326 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5423e0e3:::benchmark_data_smithi188_104537_object170640:head# 2024-04-01T19:36:17.326 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:542412f3:::benchmark_data_smithi188_104537_object139246:head# 2024-04-01T19:36:17.327 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5424f948:::benchmark_data_smithi188_104537_object47797:head# 2024-04-01T19:36:17.327 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54267b2f:::benchmark_data_smithi188_104537_object64866:head# 2024-04-01T19:36:17.327 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54272c3a:::benchmark_data_smithi188_104537_object102452:head# 2024-04-01T19:36:17.328 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5427b7a7:::benchmark_data_smithi188_104537_object128233:head# 2024-04-01T19:36:17.328 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5427ba2f:::benchmark_data_smithi188_104537_object72604:head# 2024-04-01T19:36:17.329 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5427c32d:::benchmark_data_smithi188_104537_object92434:head# 2024-04-01T19:36:17.330 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5427ccea:::benchmark_data_smithi188_104537_object158725:head# 2024-04-01T19:36:17.330 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54283524:::benchmark_data_smithi188_104537_object79445:head# 2024-04-01T19:36:17.331 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:542926c7:::benchmark_data_smithi188_104537_object112415:head# 2024-04-01T19:36:17.331 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:542a29d1:::benchmark_data_smithi188_104537_object33078:head# 2024-04-01T19:36:17.331 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:542b1f4b:::benchmark_data_smithi188_104537_object43427:head# 2024-04-01T19:36:17.332 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:542b7230:::benchmark_data_smithi188_104537_object166625:head# 2024-04-01T19:36:17.332 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:542b8dfa:::benchmark_data_smithi188_104537_object94129:head# 2024-04-01T19:36:17.333 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:542b9b6e:::benchmark_data_smithi188_104537_object135761:head# 2024-04-01T19:36:17.333 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:542bee22:::benchmark_data_smithi188_104537_object43895:head# 2024-04-01T19:36:17.333 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:542bf1f2:::benchmark_data_smithi188_104537_object141667:head# 2024-04-01T19:36:17.334 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:542c3f4b:::benchmark_data_smithi188_104537_object39366:head# 2024-04-01T19:36:17.334 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:542ce068:::benchmark_data_smithi188_104537_object108099:head# 2024-04-01T19:36:17.335 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:542d1992:::benchmark_data_smithi188_104537_object96933:head# 2024-04-01T19:36:17.335 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:542e3a91:::benchmark_data_smithi188_104537_object165951:head# 2024-04-01T19:36:17.336 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:542eea0d:::benchmark_data_smithi188_104537_object80689:head# 2024-04-01T19:36:17.336 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:542ef183:::benchmark_data_smithi188_104537_object126384:head# 2024-04-01T19:36:17.337 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:542ef3d9:::benchmark_data_smithi188_104537_object70281:head# 2024-04-01T19:36:17.337 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:542f7133:::benchmark_data_smithi188_104537_object166936:head# 2024-04-01T19:36:17.338 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:542f9c8c:::benchmark_data_smithi188_104537_object93576:head# 2024-04-01T19:36:17.338 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:543018cf:::benchmark_data_smithi188_104537_object142266:head# 2024-04-01T19:36:17.339 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54302993:::benchmark_data_smithi188_104537_object161593:head# 2024-04-01T19:36:17.340 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54304203:::benchmark_data_smithi188_104537_object84943:head# 2024-04-01T19:36:17.340 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5430e119:::benchmark_data_smithi188_104537_object79049:head# 2024-04-01T19:36:17.340 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5431f28e:::benchmark_data_smithi188_104537_object139665:head# 2024-04-01T19:36:17.341 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5432afdd:::benchmark_data_smithi188_104537_object154413:head# 2024-04-01T19:36:17.341 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5433be0c:::benchmark_data_smithi188_104537_object66764:head# 2024-04-01T19:36:17.342 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:543559a4:::benchmark_data_smithi188_104537_object32064:head# 2024-04-01T19:36:17.342 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5435727e:::benchmark_data_smithi188_104537_object152024:head# 2024-04-01T19:36:17.343 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:543678b4:::benchmark_data_smithi188_104537_object25792:head# 2024-04-01T19:36:17.343 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54374b69:::benchmark_data_smithi188_104537_object137821:head# 2024-04-01T19:36:17.344 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54376729:::benchmark_data_smithi188_104537_object17214:head# 2024-04-01T19:36:17.344 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:543828b7:::benchmark_data_smithi188_104537_object146882:head# 2024-04-01T19:36:17.345 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5438c35a:::benchmark_data_smithi188_104537_object125939:head# 2024-04-01T19:36:17.345 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54390c1d:::benchmark_data_smithi188_104537_object68822:head# 2024-04-01T19:36:17.346 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54398515:::benchmark_data_smithi188_104537_object89346:head# 2024-04-01T19:36:17.346 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5439d38e:::benchmark_data_smithi188_104537_object165904:head# 2024-04-01T19:36:17.346 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:543a1173:::benchmark_data_smithi188_104537_object71785:head# 2024-04-01T19:36:17.347 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:543a4383:::benchmark_data_smithi188_104537_object67761:head# 2024-04-01T19:36:17.347 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:543b22a3:::benchmark_data_smithi188_104537_object22678:head# 2024-04-01T19:36:17.348 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:543b2a68:::benchmark_data_smithi188_104537_object95252:head# 2024-04-01T19:36:17.348 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:543b5685:::benchmark_data_smithi188_104537_object11947:head# 2024-04-01T19:36:17.349 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:543cd25d:::benchmark_data_smithi188_104537_object37666:head# 2024-04-01T19:36:17.349 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:543cebe1:::benchmark_data_smithi188_104537_object73333:head# 2024-04-01T19:36:17.350 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:543d231b:::benchmark_data_smithi188_104537_object159136:head# 2024-04-01T19:36:17.350 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:543d354a:::benchmark_data_smithi188_104537_object116893:head# 2024-04-01T19:36:17.351 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:543d4f52:::benchmark_data_smithi188_104537_object29602:head# 2024-04-01T19:36:17.351 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:543d685c:::benchmark_data_smithi188_104537_object104916:head# 2024-04-01T19:36:17.352 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:543d8095:::benchmark_data_smithi188_104537_object157390:head# 2024-04-01T19:36:17.352 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:543e6eb1:::benchmark_data_smithi188_104537_object92465:head# 2024-04-01T19:36:17.353 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:543eb58a:::benchmark_data_smithi188_104537_object133961:head# 2024-04-01T19:36:17.353 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:543f086d:::benchmark_data_smithi188_104537_object82623:head# 2024-04-01T19:36:17.354 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:543f0bb0:::benchmark_data_smithi188_104537_object31056:head# 2024-04-01T19:36:17.354 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:543f24eb:::benchmark_data_smithi188_104537_object104838:head# 2024-04-01T19:36:17.355 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:544008f5:::benchmark_data_smithi188_104537_object145645:head# 2024-04-01T19:36:17.355 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5440651b:::benchmark_data_smithi188_104537_object149442:head# 2024-04-01T19:36:17.356 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5440940b:::benchmark_data_smithi188_104537_object156127:head# 2024-04-01T19:36:17.356 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5440eb53:::benchmark_data_smithi188_104537_object54290:head# 2024-04-01T19:36:17.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54410422:::benchmark_data_smithi188_104537_object158466:head# 2024-04-01T19:36:17.358 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54411636:::benchmark_data_smithi188_104537_object163858:head# 2024-04-01T19:36:17.358 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54411c0b:::benchmark_data_smithi188_104537_object154095:head# 2024-04-01T19:36:17.358 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54414055:::benchmark_data_smithi188_104537_object155309:head# 2024-04-01T19:36:17.359 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54423187:::benchmark_data_smithi188_104537_object67482:head# 2024-04-01T19:36:17.359 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5442e651:::benchmark_data_smithi188_104537_object66276:head# 2024-04-01T19:36:17.360 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5443e941:::benchmark_data_smithi188_104537_object152190:head# 2024-04-01T19:36:17.360 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54444b7b:::benchmark_data_smithi188_104537_object61003:head# 2024-04-01T19:36:17.361 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5444928e:::benchmark_data_smithi188_104537_object16377:head# 2024-04-01T19:36:17.361 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54451f32:::benchmark_data_smithi188_104537_object158971:head# 2024-04-01T19:36:17.361 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54458775:::benchmark_data_smithi188_104537_object73396:head# 2024-04-01T19:36:17.362 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5445aa22:::benchmark_data_smithi188_104537_object110019:head# 2024-04-01T19:36:17.362 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5447625b:::benchmark_data_smithi188_104537_object57599:head# 2024-04-01T19:36:17.363 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5447a0c4:::benchmark_data_smithi188_104537_object140860:head# 2024-04-01T19:36:17.363 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54498f9b:::benchmark_data_smithi188_104537_object153869:head# 2024-04-01T19:36:17.363 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5449a4d3:::benchmark_data_smithi188_104537_object56975:head# 2024-04-01T19:36:17.364 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5449b3a4:::benchmark_data_smithi188_104537_object72956:head# 2024-04-01T19:36:17.365 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:544a3eea:::benchmark_data_smithi188_104537_object21922:head# 2024-04-01T19:36:17.365 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:544ae70c:::benchmark_data_smithi188_104537_object131702:head# 2024-04-01T19:36:17.366 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:544b5ede:::benchmark_data_smithi188_104537_object138986:head# 2024-04-01T19:36:17.366 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:544bc287:::benchmark_data_smithi188_104537_object53581:head# 2024-04-01T19:36:17.366 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:544beb37:::benchmark_data_smithi188_104537_object52569:head# 2024-04-01T19:36:17.367 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:544c324a:::benchmark_data_smithi188_104537_object76388:head# 2024-04-01T19:36:17.367 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:544c70da:::benchmark_data_smithi188_104537_object22674:head# 2024-04-01T19:36:17.368 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:544c7c40:::benchmark_data_smithi188_104537_object30152:head# 2024-04-01T19:36:17.369 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:544ce47d:::benchmark_data_smithi188_104537_object169430:head# 2024-04-01T19:36:17.369 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:544d5359:::benchmark_data_smithi188_104537_object98784:head# 2024-04-01T19:36:17.370 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:544e461c:::benchmark_data_smithi188_104537_object30164:head# 2024-04-01T19:36:17.370 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:544f61ef:::benchmark_data_smithi188_104537_object89844:head# 2024-04-01T19:36:17.371 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:544ffc8a:::benchmark_data_smithi188_104537_object115900:head# 2024-04-01T19:36:17.371 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5450f800:::benchmark_data_smithi188_104537_object136032:head# 2024-04-01T19:36:17.371 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5450ffb0:::benchmark_data_smithi188_104537_object150078:head# 2024-04-01T19:36:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54515e33:::benchmark_data_smithi188_104537_object82111:head# 2024-04-01T19:36:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:545161a9:::benchmark_data_smithi188_104537_object169168:head# 2024-04-01T19:36:17.373 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54521668:::benchmark_data_smithi188_104537_object90595:head# 2024-04-01T19:36:17.373 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54525df1:::benchmark_data_smithi188_104537_object43937:head# 2024-04-01T19:36:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:17 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4242346137' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:36:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:17 smithi188 ceph-mon[43939]: from='client.35648 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:36:17.374 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:545328d6:::benchmark_data_smithi188_104537_object111042:head# 2024-04-01T19:36:17.374 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54539d32:::benchmark_data_smithi188_104537_object57068:head# 2024-04-01T19:36:17.374 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5453a4da:::benchmark_data_smithi188_104537_object45471:head# 2024-04-01T19:36:17.375 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5453d6c8:::benchmark_data_smithi188_104537_object164406:head# 2024-04-01T19:36:17.375 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5454327f:::benchmark_data_smithi188_104537_object32287:head# 2024-04-01T19:36:17.376 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5455c2f2:::benchmark_data_smithi188_104537_object154327:head# 2024-04-01T19:36:17.377 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:545645c1:::benchmark_data_smithi188_104537_object15161:head# 2024-04-01T19:36:17.377 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5456d66b:::benchmark_data_smithi188_104537_object93348:head# 2024-04-01T19:36:17.378 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54575f5b:::benchmark_data_smithi188_104537_object167703:head# 2024-04-01T19:36:17.378 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54585f54:::benchmark_data_smithi188_104537_object112668:head# 2024-04-01T19:36:17.378 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5458a14d:::benchmark_data_smithi188_104537_object113930:head# 2024-04-01T19:36:17.379 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5458c2bf:::benchmark_data_smithi188_104537_object20480:head# 2024-04-01T19:36:17.380 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54597cbf:::benchmark_data_smithi188_104537_object159711:head# 2024-04-01T19:36:17.380 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5459b5f6:::benchmark_data_smithi188_104537_object115239:head# 2024-04-01T19:36:17.381 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5459f283:::benchmark_data_smithi188_104537_object151633:head# 2024-04-01T19:36:17.381 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:545a9a2c:::benchmark_data_smithi188_104537_object122262:head# 2024-04-01T19:36:17.381 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:545ab40e:::benchmark_data_smithi188_104537_object121592:head# 2024-04-01T19:36:17.382 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:545b927d:::benchmark_data_smithi188_104537_object15134:head# 2024-04-01T19:36:17.382 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:545be60f:::benchmark_data_smithi188_104537_object54660:head# 2024-04-01T19:36:17.383 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:545bf7e1:::benchmark_data_smithi188_104537_object164558:head# 2024-04-01T19:36:17.383 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:545c14a7:::benchmark_data_smithi188_104537_object123254:head# 2024-04-01T19:36:17.384 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:545c43c4:::benchmark_data_smithi188_104537_object73713:head# 2024-04-01T19:36:17.384 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:545ccfdc:::benchmark_data_smithi188_104537_object127207:head# 2024-04-01T19:36:17.385 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:545d71d6:::benchmark_data_smithi188_104537_object79120:head# 2024-04-01T19:36:17.385 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:545ded5e:::benchmark_data_smithi188_104537_object69482:head# 2024-04-01T19:36:17.386 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:545f40bd:::benchmark_data_smithi188_104537_object82920:head# 2024-04-01T19:36:17.386 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:545f9661:::benchmark_data_smithi188_104537_object19937:head# 2024-04-01T19:36:17.387 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:545f98b1:::benchmark_data_smithi188_104537_object87938:head# 2024-04-01T19:36:17.387 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:546044ab:::benchmark_data_smithi188_104537_object37294:head# 2024-04-01T19:36:17.387 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:546068e0:::benchmark_data_smithi188_104537_object158211:head# 2024-04-01T19:36:17.388 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54606ad9:::benchmark_data_smithi188_104537_object69626:head# 2024-04-01T19:36:17.388 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5461e0e2:::benchmark_data_smithi188_104537_object162725:head# 2024-04-01T19:36:17.388 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5461e6d0:::benchmark_data_smithi188_104537_object81245:head# 2024-04-01T19:36:17.389 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54622fd3:::benchmark_data_smithi188_104537_object52340:head# 2024-04-01T19:36:17.389 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5462528a:::benchmark_data_smithi188_104537_object28344:head# 2024-04-01T19:36:17.390 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54625823:::benchmark_data_smithi188_104537_object59677:head# 2024-04-01T19:36:17.390 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54628123:::benchmark_data_smithi188_104537_object149288:head# 2024-04-01T19:36:17.391 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5462a681:::benchmark_data_smithi188_104537_object109297:head# 2024-04-01T19:36:17.391 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54632c2e:::benchmark_data_smithi188_104537_object100201:head# 2024-04-01T19:36:17.392 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54633954:::benchmark_data_smithi188_104537_object116901:head# 2024-04-01T19:36:17.392 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5463b422:::benchmark_data_smithi188_104537_object137489:head# 2024-04-01T19:36:17.392 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5463ddfe:::benchmark_data_smithi188_104537_object151339:head# 2024-04-01T19:36:17.393 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54643d57:::benchmark_data_smithi188_104537_object140609:head# 2024-04-01T19:36:17.393 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54646394:::benchmark_data_smithi188_104537_object125853:head# 2024-04-01T19:36:17.394 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5464e006:::benchmark_data_smithi188_104537_object92612:head# 2024-04-01T19:36:17.394 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5464f30a:::benchmark_data_smithi188_104537_object14661:head# 2024-04-01T19:36:17.395 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5464f6a3:::benchmark_data_smithi188_104537_object103448:head# 2024-04-01T19:36:17.395 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5465539c:::benchmark_data_smithi188_104537_object112955:head# 2024-04-01T19:36:17.395 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5465571c:::benchmark_data_smithi188_104537_object21794:head# 2024-04-01T19:36:17.396 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54655a91:::benchmark_data_smithi188_104537_object49603:head# 2024-04-01T19:36:17.396 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54657971:::benchmark_data_smithi188_104537_object134529:head# 2024-04-01T19:36:17.397 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5465e1d6:::benchmark_data_smithi188_104537_object19207:head# 2024-04-01T19:36:17.398 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5465fb00:::benchmark_data_smithi188_104537_object157969:head# 2024-04-01T19:36:17.398 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54668da7:::benchmark_data_smithi188_104537_object134212:head# 2024-04-01T19:36:17.399 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5466ab79:::benchmark_data_smithi188_104537_object27919:head# 2024-04-01T19:36:17.399 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5467fb13:::benchmark_data_smithi188_104537_object11753:head# 2024-04-01T19:36:17.400 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54687b66:::benchmark_data_smithi188_104537_object24767:head# 2024-04-01T19:36:17.400 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:546880f0:::benchmark_data_smithi188_104537_object28211:head# 2024-04-01T19:36:17.401 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54691f94:::benchmark_data_smithi188_104537_object161801:head# 2024-04-01T19:36:17.401 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54697a84:::benchmark_data_smithi188_104537_object108784:head# 2024-04-01T19:36:17.401 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5469a305:::benchmark_data_smithi188_104537_object15538:head# 2024-04-01T19:36:17.402 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:546a2f1e:::benchmark_data_smithi188_104537_object129652:head# 2024-04-01T19:36:17.402 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:546a2f7e:::benchmark_data_smithi188_104537_object125624:head# 2024-04-01T19:36:17.403 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:546a6d87:::benchmark_data_smithi188_104537_object57350:head# 2024-04-01T19:36:17.403 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:546ab1bc:::benchmark_data_smithi188_104537_object94827:head# 2024-04-01T19:36:17.404 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:546ab6ff:::benchmark_data_smithi188_104537_object116260:head# 2024-04-01T19:36:17.404 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:546ad340:::benchmark_data_smithi188_104537_object161334:head# 2024-04-01T19:36:17.405 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:546b8536:::benchmark_data_smithi188_104537_object35211:head# 2024-04-01T19:36:17.405 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:546b9ee4:::benchmark_data_smithi188_104537_object156605:head# 2024-04-01T19:36:17.405 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:546ba447:::benchmark_data_smithi188_104537_object101213:head# 2024-04-01T19:36:17.406 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:546bf91a:::benchmark_data_smithi188_104537_object35926:head# 2024-04-01T19:36:17.406 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:546c339e:::benchmark_data_smithi188_104537_object142656:head# 2024-04-01T19:36:17.407 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:546c534b:::benchmark_data_smithi188_104537_object127428:head# 2024-04-01T19:36:17.407 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:546c6d1f:::benchmark_data_smithi188_104537_object33815:head# 2024-04-01T19:36:17.407 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:546c7bb5:::benchmark_data_smithi188_104537_object101416:head# 2024-04-01T19:36:17.408 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:546d2865:::benchmark_data_smithi188_104537_object34972:head# 2024-04-01T19:36:17.409 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:546d88fb:::benchmark_data_smithi188_104537_object108629:head# 2024-04-01T19:36:17.409 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:546e4ade:::benchmark_data_smithi188_104537_object158533:head# 2024-04-01T19:36:17.410 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:546e824a:::benchmark_data_smithi188_104537_object119604:head# 2024-04-01T19:36:17.410 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:546ea93d:::benchmark_data_smithi188_104537_object47076:head# 2024-04-01T19:36:17.411 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:546eb33d:::benchmark_data_smithi188_104537_object59681:head# 2024-04-01T19:36:17.411 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:546fe1b8:::benchmark_data_smithi188_104537_object19353:head# 2024-04-01T19:36:17.412 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:547002de:::benchmark_data_smithi188_104537_object63308:head# 2024-04-01T19:36:17.412 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54700890:::benchmark_data_smithi188_104537_object141765:head# 2024-04-01T19:36:17.412 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54703cfc:::benchmark_data_smithi188_104537_object123582:head# 2024-04-01T19:36:17.413 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5470f37f:::benchmark_data_smithi188_104537_object38997:head# 2024-04-01T19:36:17.413 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5471137e:::benchmark_data_smithi188_104537_object137360:head# 2024-04-01T19:36:17.414 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54716540:::benchmark_data_smithi188_104537_object123240:head# 2024-04-01T19:36:17.414 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54722238:::benchmark_data_smithi188_104537_object83723:head# 2024-04-01T19:36:17.415 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54727c0b:::benchmark_data_smithi188_104537_object72380:head# 2024-04-01T19:36:17.415 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5472aa8e:::benchmark_data_smithi188_104537_object142039:head# 2024-04-01T19:36:17.416 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5472df3e:::benchmark_data_smithi188_104537_object78054:head# 2024-04-01T19:36:17.416 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54730f56:::benchmark_data_smithi188_104537_object131176:head# 2024-04-01T19:36:17.416 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5473c918:::benchmark_data_smithi188_104537_object27668:head# 2024-04-01T19:36:17.417 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54745836:::benchmark_data_smithi188_104537_object118180:head# 2024-04-01T19:36:17.417 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54748c65:::benchmark_data_smithi188_104537_object61036:head# 2024-04-01T19:36:17.418 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54748ea9:::benchmark_data_smithi188_104537_object38453:head# 2024-04-01T19:36:17.418 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5474afe5:::benchmark_data_smithi188_104537_object108285:head# 2024-04-01T19:36:17.419 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5475667d:::benchmark_data_smithi188_104537_object21108:head# 2024-04-01T19:36:17.419 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5476297e:::benchmark_data_smithi188_104537_object13604:head# 2024-04-01T19:36:17.420 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:547639bd:::benchmark_data_smithi188_104537_object150325:head# 2024-04-01T19:36:17.420 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5476a7c7:::benchmark_data_smithi188_104537_object74760:head# 2024-04-01T19:36:17.420 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5476a885:::benchmark_data_smithi188_104537_object38900:head# 2024-04-01T19:36:17.421 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5476af27:::benchmark_data_smithi188_104537_object28629:head# 2024-04-01T19:36:17.421 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5476bcef:::benchmark_data_smithi188_104537_object122613:head# 2024-04-01T19:36:17.423 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54776638:::benchmark_data_smithi188_104537_object50136:head# 2024-04-01T19:36:17.423 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5478020a:::benchmark_data_smithi188_104537_object138777:head# 2024-04-01T19:36:17.424 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54783cd1:::benchmark_data_smithi188_104537_object75497:head# 2024-04-01T19:36:17.424 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54792c00:::benchmark_data_smithi188_104537_object150893:head# 2024-04-01T19:36:17.425 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54793177:::benchmark_data_smithi188_104537_object16109:head# 2024-04-01T19:36:17.425 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54795b3f:::benchmark_data_smithi188_104537_object73383:head# 2024-04-01T19:36:17.426 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5479d439:::benchmark_data_smithi188_104537_object71487:head# 2024-04-01T19:36:17.426 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5479fd62:::benchmark_data_smithi188_104537_object57043:head# 2024-04-01T19:36:17.427 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:547b35ee:::benchmark_data_smithi188_104537_object54329:head# 2024-04-01T19:36:17.427 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:547c36c5:::benchmark_data_smithi188_104537_object155032:head# 2024-04-01T19:36:17.428 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:547cb9e0:::benchmark_data_smithi188_104537_object94850:head# 2024-04-01T19:36:17.428 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:547cf6fc:::benchmark_data_smithi188_104537_object15328:head# 2024-04-01T19:36:17.429 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:547d3fa2:::benchmark_data_smithi188_104537_object149284:head# 2024-04-01T19:36:17.429 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:547d5596:::benchmark_data_smithi188_104537_object101431:head# 2024-04-01T19:36:17.430 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:547d813f:::benchmark_data_smithi188_104537_object151349:head# 2024-04-01T19:36:17.430 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:547dfd97:::benchmark_data_smithi188_104537_object94665:head# 2024-04-01T19:36:17.431 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:547e364e:::benchmark_data_smithi188_104537_object97385:head# 2024-04-01T19:36:17.431 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:547e42e0:::benchmark_data_smithi188_104537_object123394:head# 2024-04-01T19:36:17.432 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:548027cf:::benchmark_data_smithi188_104537_object83121:head# 2024-04-01T19:36:17.432 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:548074c6:::benchmark_data_smithi188_104537_object127598:head# 2024-04-01T19:36:17.432 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5480ae74:::benchmark_data_smithi188_104537_object59594:head# 2024-04-01T19:36:17.433 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5480f6e2:::benchmark_data_smithi188_104537_object139389:head# 2024-04-01T19:36:17.433 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5481047b:::benchmark_data_smithi188_104537_object80404:head# 2024-04-01T19:36:17.434 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54812981:::benchmark_data_smithi188_104537_object87212:head# 2024-04-01T19:36:17.435 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54819f71:::benchmark_data_smithi188_104537_object143278:head# 2024-04-01T19:36:17.435 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54823afa:::benchmark_data_smithi188_104537_object130571:head# 2024-04-01T19:36:17.435 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54826240:::benchmark_data_smithi188_104537_object139635:head# 2024-04-01T19:36:17.436 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54838b85:::benchmark_data_smithi188_104537_object94591:head# 2024-04-01T19:36:17.437 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5483c985:::benchmark_data_smithi188_104537_object146918:head# 2024-04-01T19:36:17.437 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5484fdaa:::benchmark_data_smithi188_104537_object99462:head# 2024-04-01T19:36:17.437 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54856912:::benchmark_data_smithi188_104537_object124663:head# 2024-04-01T19:36:17.438 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:548581a6:::benchmark_data_smithi188_104537_object69070:head# 2024-04-01T19:36:17.438 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54859cbf:::benchmark_data_smithi188_104537_object49019:head# 2024-04-01T19:36:17.439 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5486c2ae:::benchmark_data_smithi188_104537_object73885:head# 2024-04-01T19:36:17.439 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:548769ed:::benchmark_data_smithi188_104537_object148925:head# 2024-04-01T19:36:17.440 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54877a94:::benchmark_data_smithi188_104537_object36571:head# 2024-04-01T19:36:17.440 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54881471:::benchmark_data_smithi188_104537_object20143:head# 2024-04-01T19:36:17.441 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54883b2e:::benchmark_data_smithi188_104537_object15937:head# 2024-04-01T19:36:17.441 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54884061:::benchmark_data_smithi188_104537_object32639:head# 2024-04-01T19:36:17.441 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5489942b:::benchmark_data_smithi188_104537_object85957:head# 2024-04-01T19:36:17.442 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5489a7f3:::benchmark_data_smithi188_104537_object166076:head# 2024-04-01T19:36:17.442 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:548a1e51:::benchmark_data_smithi188_104537_object29676:head# 2024-04-01T19:36:17.443 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:548aedbc:::benchmark_data_smithi188_104537_object127287:head# 2024-04-01T19:36:17.444 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:548bae24:::benchmark_data_smithi188_104537_object112681:head# 2024-04-01T19:36:17.444 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:548c405e:::benchmark_data_smithi188_104537_object143622:head# 2024-04-01T19:36:17.445 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:548c41af:::benchmark_data_smithi188_104537_object61571:head# 2024-04-01T19:36:17.445 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:548c4d5c:::benchmark_data_smithi188_104537_object64300:head# 2024-04-01T19:36:17.445 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:548c6f1d:::benchmark_data_smithi188_104537_object44802:head# 2024-04-01T19:36:17.446 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:548cad41:::benchmark_data_smithi188_104537_object97135:head# 2024-04-01T19:36:17.446 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:548eedef:::benchmark_data_smithi188_104537_object135270:head# 2024-04-01T19:36:17.447 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:548fbeb1:::benchmark_data_smithi188_104537_object28942:head# 2024-04-01T19:36:17.447 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:548fca9c:::benchmark_data_smithi188_104537_object129299:head# 2024-04-01T19:36:17.448 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:548fd410:::benchmark_data_smithi188_104537_object126239:head# 2024-04-01T19:36:17.448 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5490a4c9:::benchmark_data_smithi188_104537_object38219:head# 2024-04-01T19:36:17.449 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54912cd8:::benchmark_data_smithi188_104537_object48990:head# 2024-04-01T19:36:17.449 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5491bbd4:::benchmark_data_smithi188_104537_object13921:head# 2024-04-01T19:36:17.449 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5491cf46:::benchmark_data_smithi188_104537_object110491:head# 2024-04-01T19:36:17.450 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5491d6d0:::benchmark_data_smithi188_104537_object95944:head# 2024-04-01T19:36:17.450 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5491eab5:::benchmark_data_smithi188_104537_object147457:head# 2024-04-01T19:36:17.451 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:549232a5:::benchmark_data_smithi188_104537_object151356:head# 2024-04-01T19:36:17.451 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:549393b6:::benchmark_data_smithi188_104537_object59876:head# 2024-04-01T19:36:17.451 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5493fa42:::benchmark_data_smithi188_104537_object15296:head# 2024-04-01T19:36:17.452 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54946d9a:::benchmark_data_smithi188_104537_object122036:head# 2024-04-01T19:36:17.452 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:549486f8:::benchmark_data_smithi188_104537_object71657:head# 2024-04-01T19:36:17.453 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5495984a:::benchmark_data_smithi188_104537_object30764:head# 2024-04-01T19:36:17.453 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54959da3:::benchmark_data_smithi188_104537_object67911:head# 2024-04-01T19:36:17.453 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5495e860:::benchmark_data_smithi188_104537_object89293:head# 2024-04-01T19:36:17.454 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54962c38:::benchmark_data_smithi188_104537_object55103:head# 2024-04-01T19:36:17.455 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5497498b:::benchmark_data_smithi188_104537_object84616:head# 2024-04-01T19:36:17.455 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5497eef6:::benchmark_data_smithi188_104537_object128756:head# 2024-04-01T19:36:17.456 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54989c5c:::benchmark_data_smithi188_104537_object14539:head# 2024-04-01T19:36:17.456 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5498ef02:::benchmark_data_smithi188_104537_object72781:head# 2024-04-01T19:36:17.456 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5498f826:::benchmark_data_smithi188_104537_object19833:head# 2024-04-01T19:36:17.457 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:549909cb:::benchmark_data_smithi188_104537_object24678:head# 2024-04-01T19:36:17.458 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5499925c:::benchmark_data_smithi188_104537_object88405:head# 2024-04-01T19:36:17.458 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:549b312d:::benchmark_data_smithi188_104537_object102000:head# 2024-04-01T19:36:17.458 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:549bb147:::benchmark_data_smithi188_104537_object99914:head# 2024-04-01T19:36:17.459 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:549bf23f:::benchmark_data_smithi188_104537_object111707:head# 2024-04-01T19:36:17.459 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:549cf4b6:::benchmark_data_smithi188_104537_object63513:head# 2024-04-01T19:36:17.460 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:549d5afb:::benchmark_data_smithi188_104537_object158596:head# 2024-04-01T19:36:17.460 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:549df488:::benchmark_data_smithi188_104537_object55421:head# 2024-04-01T19:36:17.461 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:549e0647:::benchmark_data_smithi188_104537_object21723:head# 2024-04-01T19:36:17.461 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:549e6efd:::benchmark_data_smithi188_104537_object137225:head# 2024-04-01T19:36:17.461 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:549e79af:::benchmark_data_smithi188_104537_object161561:head# 2024-04-01T19:36:17.462 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:549efe6b:::benchmark_data_smithi188_104537_object135810:head# 2024-04-01T19:36:17.462 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:549f4ed5:::benchmark_data_smithi188_104537_object77005:head# 2024-04-01T19:36:17.463 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:549f6666:::benchmark_data_smithi188_104537_object54371:head# 2024-04-01T19:36:17.463 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:549f7eea:::benchmark_data_smithi188_104537_object35925:head# 2024-04-01T19:36:17.463 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:549facfb:::benchmark_data_smithi188_104537_object170920:head# 2024-04-01T19:36:17.464 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54a13e60:::benchmark_data_smithi188_104537_object163521:head# 2024-04-01T19:36:17.464 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54a1f711:::benchmark_data_smithi188_104537_object96064:head# 2024-04-01T19:36:17.465 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54a217f0:::benchmark_data_smithi188_104537_object50192:head# 2024-04-01T19:36:17.465 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54a223e2:::benchmark_data_smithi188_104537_object69244:head# 2024-04-01T19:36:17.466 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54a242da:::benchmark_data_smithi188_104537_object170106:head# 2024-04-01T19:36:17.466 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54a2eafe:::benchmark_data_smithi188_104537_object155515:head# 2024-04-01T19:36:17.467 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54a2fce1:::benchmark_data_smithi188_104537_object98166:head# 2024-04-01T19:36:17.467 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54a307a9:::benchmark_data_smithi188_104537_object169380:head# 2024-04-01T19:36:17.468 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54a35b6a:::benchmark_data_smithi188_104537_object12122:head# 2024-04-01T19:36:17.468 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54a3b30a:::benchmark_data_smithi188_104537_object80462:head# 2024-04-01T19:36:17.469 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54a46c05:::benchmark_data_smithi188_104537_object12795:head# 2024-04-01T19:36:17.469 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54a50163:::benchmark_data_smithi188_104537_object137377:head# 2024-04-01T19:36:17.469 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54a55e32:::benchmark_data_smithi188_104537_object83333:head# 2024-04-01T19:36:17.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54a60d42:::benchmark_data_smithi188_104537_object90641:head# 2024-04-01T19:36:17.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54a61722:::benchmark_data_smithi188_104537_object42037:head# 2024-04-01T19:36:17.471 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54a6ee38:::benchmark_data_smithi188_104537_object154062:head# 2024-04-01T19:36:17.471 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54a74098:::benchmark_data_smithi188_104537_object15867:head# 2024-04-01T19:36:17.471 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54a752d0:::benchmark_data_smithi188_104537_object61662:head# 2024-04-01T19:36:17.472 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54a82410:::benchmark_data_smithi188_104537_object103835:head# 2024-04-01T19:36:17.472 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54a87155:::benchmark_data_smithi188_104537_object134726:head# 2024-04-01T19:36:17.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54a8b97e:::benchmark_data_smithi188_104537_object124760:head# 2024-04-01T19:36:17.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54a8fda7:::benchmark_data_smithi188_104537_object27843:head# 2024-04-01T19:36:17.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54aa0822:::benchmark_data_smithi188_104537_object85128:head# 2024-04-01T19:36:17.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54aa09d6:::benchmark_data_smithi188_104537_object161566:head# 2024-04-01T19:36:17.475 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54aa4474:::benchmark_data_smithi188_104537_object31533:head# 2024-04-01T19:36:17.475 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54aa5c5a:::benchmark_data_smithi188_104537_object86724:head# 2024-04-01T19:36:17.475 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54aade45:::benchmark_data_smithi188_104537_object109387:head# 2024-04-01T19:36:17.476 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54abeb71:::benchmark_data_smithi188_104537_object71471:head# 2024-04-01T19:36:17.477 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54ac5c63:::benchmark_data_smithi188_104537_object79079:head# 2024-04-01T19:36:17.477 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54acf270:::benchmark_data_smithi188_104537_object140348:head# 2024-04-01T19:36:17.477 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54acf689:::benchmark_data_smithi188_104537_object80851:head# 2024-04-01T19:36:17.478 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54ad2ef7:::benchmark_data_smithi188_104537_object127471:head# 2024-04-01T19:36:17.478 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54adf101:::benchmark_data_smithi188_104537_object75565:head# 2024-04-01T19:36:17.479 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54ae7fe3:::benchmark_data_smithi188_104537_object122001:head# 2024-04-01T19:36:17.479 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54aec2ca:::benchmark_data_smithi188_104537_object46347:head# 2024-04-01T19:36:17.480 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54af24b7:::benchmark_data_smithi188_104537_object88792:head# 2024-04-01T19:36:17.480 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b04e6a:::benchmark_data_smithi188_104537_object98855:head# 2024-04-01T19:36:17.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b0a894:::benchmark_data_smithi188_104537_object133701:head# 2024-04-01T19:36:17.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b10ef7:::benchmark_data_smithi188_104537_object77044:head# 2024-04-01T19:36:17.482 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b1c2b7:::benchmark_data_smithi188_104537_object148683:head# 2024-04-01T19:36:17.482 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b21a90:::benchmark_data_smithi188_104537_object171717:head# 2024-04-01T19:36:17.483 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b23f2f:::benchmark_data_smithi188_104537_object63570:head# 2024-04-01T19:36:17.483 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b26648:::benchmark_data_smithi188_104537_object170473:head# 2024-04-01T19:36:17.484 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b26e10:::benchmark_data_smithi188_104537_object48929:head# 2024-04-01T19:36:17.484 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b2bf4e:::benchmark_data_smithi188_104537_object104513:head# 2024-04-01T19:36:17.484 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b3f5a2:::benchmark_data_smithi188_104537_object152050:head# 2024-04-01T19:36:17.485 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b431b7:::benchmark_data_smithi188_104537_object17979:head# 2024-04-01T19:36:17.485 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b47db6:::benchmark_data_smithi188_104537_object142923:head# 2024-04-01T19:36:17.486 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b68aa6:::benchmark_data_smithi188_104537_object141219:head# 2024-04-01T19:36:17.486 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b699f1:::benchmark_data_smithi188_104537_object37056:head# 2024-04-01T19:36:17.487 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b70d51:::benchmark_data_smithi188_104537_object138734:head# 2024-04-01T19:36:17.487 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b71307:::benchmark_data_smithi188_104537_object167942:head# 2024-04-01T19:36:17.487 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b730d6:::benchmark_data_smithi188_104537_object39240:head# 2024-04-01T19:36:17.488 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b741e4:::benchmark_data_smithi188_104537_object157560:head# 2024-04-01T19:36:17.488 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b74f87:::benchmark_data_smithi188_104537_object56980:head# 2024-04-01T19:36:17.489 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b755fc:::benchmark_data_smithi188_104537_object22407:head# 2024-04-01T19:36:17.489 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b76921:::benchmark_data_smithi188_104537_object115271:head# 2024-04-01T19:36:17.489 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b79d0c:::benchmark_data_smithi188_104537_object130319:head# 2024-04-01T19:36:17.490 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b86fd6:::benchmark_data_smithi188_104537_object147879:head# 2024-04-01T19:36:17.490 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b88e8d:::benchmark_data_smithi188_104537_object23043:head# 2024-04-01T19:36:17.490 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b8abd6:::benchmark_data_smithi188_104537_object41372:head# 2024-04-01T19:36:17.491 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b8f7a6:::benchmark_data_smithi188_104537_object30290:head# 2024-04-01T19:36:17.492 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b8f84a:::benchmark_data_smithi188_104537_object84229:head# 2024-04-01T19:36:17.492 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54b98b39:::benchmark_data_smithi188_104537_object77508:head# 2024-04-01T19:36:17.493 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54ba0b52:::benchmark_data_smithi188_104537_object20926:head# 2024-04-01T19:36:17.493 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54ba19f1:::benchmark_data_smithi188_104537_object132642:head# 2024-04-01T19:36:17.494 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54ba5444:::benchmark_data_smithi188_104537_object100303:head# 2024-04-01T19:36:17.494 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54bab1ea:::benchmark_data_smithi188_104537_object43271:head# 2024-04-01T19:36:17.494 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54babb9f:::benchmark_data_smithi188_104537_object93321:head# 2024-04-01T19:36:17.495 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54baddea:::benchmark_data_smithi188_104537_object27921:head# 2024-04-01T19:36:17.495 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54bbb9ba:::benchmark_data_smithi188_104537_object17793:head# 2024-04-01T19:36:17.496 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54bc446d:::benchmark_data_smithi188_104537_object79531:head# 2024-04-01T19:36:17.496 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54bce594:::benchmark_data_smithi188_104537_object116129:head# 2024-04-01T19:36:17.497 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54bd83b2:::benchmark_data_smithi188_104537_object95223:head# 2024-04-01T19:36:17.497 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54bda53e:::benchmark_data_smithi188_104537_object46631:head# 2024-04-01T19:36:17.498 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54bdd0d5:::benchmark_data_smithi188_104537_object17006:head# 2024-04-01T19:36:17.499 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54be0e3c:::benchmark_data_smithi188_104537_object143178:head# 2024-04-01T19:36:17.499 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54be393a:::benchmark_data_smithi188_104537_object146770:head# 2024-04-01T19:36:17.499 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54be6928:::benchmark_data_smithi188_104537_object93334:head# 2024-04-01T19:36:17.500 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54beafa5:::benchmark_data_smithi188_104537_object21142:head# 2024-04-01T19:36:17.500 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54bfce1b:::benchmark_data_smithi188_104537_object118900:head# 2024-04-01T19:36:17.501 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54bfce4f:::benchmark_data_smithi188_104537_object75140:head# 2024-04-01T19:36:17.501 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54c0142b:::benchmark_data_smithi188_104537_object101988:head# 2024-04-01T19:36:17.502 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54c0cd22:::benchmark_data_smithi188_104537_object139746:head# 2024-04-01T19:36:17.502 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54c11c31:::benchmark_data_smithi188_104537_object153199:head# 2024-04-01T19:36:17.503 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54c1747b:::benchmark_data_smithi188_104537_object121478:head# 2024-04-01T19:36:17.503 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54c2a1c5:::benchmark_data_smithi188_104537_object75832:head# 2024-04-01T19:36:17.504 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54c34015:::benchmark_data_smithi188_104537_object166037:head# 2024-04-01T19:36:17.504 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54c365ef:::benchmark_data_smithi188_104537_object14169:head# 2024-04-01T19:36:17.505 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54c39606:::benchmark_data_smithi188_104537_object19592:head# 2024-04-01T19:36:17.505 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54c3e2cd:::benchmark_data_smithi188_104537_object80592:head# 2024-04-01T19:36:17.505 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54c40db8:::benchmark_data_smithi188_104537_object24249:head# 2024-04-01T19:36:17.506 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54c4c843:::benchmark_data_smithi188_104537_object59208:head# 2024-04-01T19:36:17.506 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54c4c8a0:::benchmark_data_smithi188_104537_object152505:head# 2024-04-01T19:36:17.507 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54c55611:::benchmark_data_smithi188_104537_object109211:head# 2024-04-01T19:36:17.507 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54c5caa3:::benchmark_data_smithi188_104537_object158278:head# 2024-04-01T19:36:17.508 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54c5e851:::benchmark_data_smithi188_104537_object134303:head# 2024-04-01T19:36:17.508 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54c684f8:::benchmark_data_smithi188_104537_object125242:head# 2024-04-01T19:36:17.509 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54c6d0b9:::benchmark_data_smithi188_104537_object96112:head# 2024-04-01T19:36:17.509 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54c71e6f:::benchmark_data_smithi188_104537_object107305:head# 2024-04-01T19:36:17.509 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54c722ea:::benchmark_data_smithi188_104537_object53197:head# 2024-04-01T19:36:17.510 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54c746e3:::benchmark_data_smithi188_104537_object14951:head# 2024-04-01T19:36:17.510 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54c7ec0e:::benchmark_data_smithi188_104537_object157995:head# 2024-04-01T19:36:17.510 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54c83f04:::benchmark_data_smithi188_104537_object161175:head# 2024-04-01T19:36:17.511 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54c86d1e:::benchmark_data_smithi188_104537_object153533:head# 2024-04-01T19:36:17.511 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54c9d303:::benchmark_data_smithi188_104537_object106564:head# 2024-04-01T19:36:17.512 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54c9deaf:::benchmark_data_smithi188_104537_object54990:head# 2024-04-01T19:36:17.512 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54ca853b:::benchmark_data_smithi188_104537_object74079:head# 2024-04-01T19:36:17.512 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54cab651:::benchmark_data_smithi188_104537_object93734:head# 2024-04-01T19:36:17.513 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54cb03c5:::benchmark_data_smithi188_104537_object85234:head# 2024-04-01T19:36:17.513 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54cbd313:::benchmark_data_smithi188_104537_object11835:head# 2024-04-01T19:36:17.514 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54cbf321:::benchmark_data_smithi188_104537_object46436:head# 2024-04-01T19:36:17.515 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54cbf85e:::benchmark_data_smithi188_104537_object18932:head# 2024-04-01T19:36:17.515 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54cbf97d:::benchmark_data_smithi188_104537_object91592:head# 2024-04-01T19:36:17.516 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54cc3394:::benchmark_data_smithi188_104537_object74522:head# 2024-04-01T19:36:17.516 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54cc4411:::benchmark_data_smithi188_104537_object43590:head# 2024-04-01T19:36:17.517 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54cc892c:::benchmark_data_smithi188_104537_object34332:head# 2024-04-01T19:36:17.517 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54cd21a7:::benchmark_data_smithi188_104537_object38030:head# 2024-04-01T19:36:17.518 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54cd84b0:::benchmark_data_smithi188_104537_object57806:head# 2024-04-01T19:36:17.518 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54cdb1d6:::benchmark_data_smithi188_104537_object68295:head# 2024-04-01T19:36:17.519 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54cea81b:::benchmark_data_smithi188_104537_object74721:head# 2024-04-01T19:36:17.519 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54ced2f4:::benchmark_data_smithi188_104537_object82531:head# 2024-04-01T19:36:17.519 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54cfe01b:::benchmark_data_smithi188_104537_object23431:head# 2024-04-01T19:36:17.520 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54d02c3f:::benchmark_data_smithi188_104537_object22774:head# 2024-04-01T19:36:17.521 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54d0eddc:::benchmark_data_smithi188_104537_object45863:head# 2024-04-01T19:36:17.521 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54d18df9:::benchmark_data_smithi188_104537_object44753:head# 2024-04-01T19:36:17.522 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54d38cbf:::benchmark_data_smithi188_104537_object16478:head# 2024-04-01T19:36:17.522 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54d48ed0:::benchmark_data_smithi188_104537_object12676:head# 2024-04-01T19:36:17.523 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54d4ea1a:::benchmark_data_smithi188_104537_object77877:head# 2024-04-01T19:36:17.523 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54d5dd98:::benchmark_data_smithi188_104537_object86998:head# 2024-04-01T19:36:17.524 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54d637ed:::benchmark_data_smithi188_104537_object122992:head# 2024-04-01T19:36:17.524 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54d6a544:::benchmark_data_smithi188_104537_object128688:head# 2024-04-01T19:36:17.524 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54d80e4d:::benchmark_data_smithi188_104537_object143104:head# 2024-04-01T19:36:17.525 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54d83d78:::benchmark_data_smithi188_104537_object160224:head# 2024-04-01T19:36:17.525 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54d89ab6:::benchmark_data_smithi188_104537_object61103:head# 2024-04-01T19:36:17.526 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54d8aa0c:::benchmark_data_smithi188_104537_object140468:head# 2024-04-01T19:36:17.526 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54d8bdf1:::benchmark_data_smithi188_104537_object111406:head# 2024-04-01T19:36:17.526 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54d90c98:::benchmark_data_smithi188_104537_object112766:head# 2024-04-01T19:36:17.527 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54d99734:::benchmark_data_smithi188_104537_object61485:head# 2024-04-01T19:36:17.527 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54d9cfa8:::benchmark_data_smithi188_104537_object21669:head# 2024-04-01T19:36:17.528 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54dab818:::benchmark_data_smithi188_104537_object110621:head# 2024-04-01T19:36:17.528 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54db3bd3:::benchmark_data_smithi188_104537_object121901:head# 2024-04-01T19:36:17.528 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54db9431:::benchmark_data_smithi188_104537_object158099:head# 2024-04-01T19:36:17.529 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54dd0cce:::benchmark_data_smithi188_104537_object92599:head# 2024-04-01T19:36:17.530 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54dd91a6:::benchmark_data_smithi188_104537_object56464:head# 2024-04-01T19:36:17.530 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54ddcb9c:::benchmark_data_smithi188_104537_object139345:head# 2024-04-01T19:36:17.530 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54de0045:::benchmark_data_smithi188_104537_object32799:head# 2024-04-01T19:36:17.531 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54de9494:::benchmark_data_smithi188_104537_object111311:head# 2024-04-01T19:36:17.532 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54df21c7:::benchmark_data_smithi188_104537_object133293:head# 2024-04-01T19:36:17.532 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54df94db:::benchmark_data_smithi188_104537_object92924:head# 2024-04-01T19:36:17.532 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54dfbdcf:::benchmark_data_smithi188_104537_object37229:head# 2024-04-01T19:36:17.533 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54dff67e:::benchmark_data_smithi188_104537_object117145:head# 2024-04-01T19:36:17.533 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54e0ae19:::benchmark_data_smithi188_104537_object24152:head# 2024-04-01T19:36:17.534 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54e0efb5:::benchmark_data_smithi188_104537_object91698:head# 2024-04-01T19:36:17.534 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54e1596d:::benchmark_data_smithi188_104537_object75530:head# 2024-04-01T19:36:17.535 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54e1776b:::benchmark_data_smithi188_104537_object85819:head# 2024-04-01T19:36:17.535 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54e2910b:::benchmark_data_smithi188_104537_object81732:head# 2024-04-01T19:36:17.536 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54e2d086:::benchmark_data_smithi188_104537_object84420:head# 2024-04-01T19:36:17.536 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54e2e4b3:::benchmark_data_smithi188_104537_object132450:head# 2024-04-01T19:36:17.536 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54e3bef0:::benchmark_data_smithi188_104537_object106287:head# 2024-04-01T19:36:17.537 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54e593f8:::benchmark_data_smithi188_104537_object62771:head# 2024-04-01T19:36:17.537 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54e5c55d:::benchmark_data_smithi188_104537_object70855:head# 2024-04-01T19:36:17.538 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54e6e19f:::benchmark_data_smithi188_104537_object156277:head# 2024-04-01T19:36:17.538 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54e76de3:::benchmark_data_smithi188_104537_object13813:head# 2024-04-01T19:36:17.539 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54e7d1bc:::benchmark_data_smithi188_104537_object76331:head# 2024-04-01T19:36:17.539 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54e7dacd:::benchmark_data_smithi188_104537_object151218:head# 2024-04-01T19:36:17.539 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54e89b64:::benchmark_data_smithi188_104537_object114154:head# 2024-04-01T19:36:17.540 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54e92913:::benchmark_data_smithi188_104537_object91093:head# 2024-04-01T19:36:17.541 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54e9d511:::benchmark_data_smithi188_104537_object73178:head# 2024-04-01T19:36:17.541 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54eac2fb:::benchmark_data_smithi188_104537_object145230:head# 2024-04-01T19:36:17.542 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54eacc12:::benchmark_data_smithi188_104537_object29829:head# 2024-04-01T19:36:17.542 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54ec082e:::benchmark_data_smithi188_104537_object19320:head# 2024-04-01T19:36:17.542 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54ecc0da:::benchmark_data_smithi188_104537_object136804:head# 2024-04-01T19:36:17.543 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54ecea92:::benchmark_data_smithi188_104537_object85503:head# 2024-04-01T19:36:17.543 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54ed4241:::benchmark_data_smithi188_104537_object148304:head# 2024-04-01T19:36:17.544 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54ee2453:::benchmark_data_smithi188_104537_object57007:head# 2024-04-01T19:36:17.544 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54ee2669:::benchmark_data_smithi188_104537_object160275:head# 2024-04-01T19:36:17.545 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54eee996:::benchmark_data_smithi188_104537_object169919:head# 2024-04-01T19:36:17.545 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54f029a7:::benchmark_data_smithi188_104537_object130674:head# 2024-04-01T19:36:17.545 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54f05034:::benchmark_data_smithi188_104537_object58830:head# 2024-04-01T19:36:17.546 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54f09fb6:::benchmark_data_smithi188_104537_object67633:head# 2024-04-01T19:36:17.546 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54f19518:::benchmark_data_smithi188_104537_object20731:head# 2024-04-01T19:36:17.547 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54f1b583:::benchmark_data_smithi188_104537_object64170:head# 2024-04-01T19:36:17.547 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54f1ca7d:::benchmark_data_smithi188_104537_object19123:head# 2024-04-01T19:36:17.548 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54f1cc76:::benchmark_data_smithi188_104537_object53991:head# 2024-04-01T19:36:17.548 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54f27bf9:::benchmark_data_smithi188_104537_object157550:head# 2024-04-01T19:36:17.549 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54f29d5b:::benchmark_data_smithi188_104537_object114102:head# 2024-04-01T19:36:17.549 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54f34963:::benchmark_data_smithi188_104537_object126310:head# 2024-04-01T19:36:17.549 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54f3a337:::benchmark_data_smithi188_104537_object114992:head# 2024-04-01T19:36:17.550 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54f3d370:::benchmark_data_smithi188_104537_object65039:head# 2024-04-01T19:36:17.550 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54f42cb6:::benchmark_data_smithi188_104537_object149041:head# 2024-04-01T19:36:17.551 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54f46e3a:::benchmark_data_smithi188_104537_object114084:head# 2024-04-01T19:36:17.551 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54f48360:::benchmark_data_smithi188_104537_object42856:head# 2024-04-01T19:36:17.551 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54f4d9a8:::benchmark_data_smithi188_104537_object68341:head# 2024-04-01T19:36:17.552 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54f4ea47:::benchmark_data_smithi188_104537_object143033:head# 2024-04-01T19:36:17.552 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54f56012:::benchmark_data_smithi188_104537_object148294:head# 2024-04-01T19:36:17.553 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54f5aa9f:::benchmark_data_smithi188_104537_object99680:head# 2024-04-01T19:36:17.553 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54f7b475:::benchmark_data_smithi188_104537_object121345:head# 2024-04-01T19:36:17.554 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54f7d744:::benchmark_data_smithi188_104537_object18667:head# 2024-04-01T19:36:17.554 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54f943e4:::benchmark_data_smithi188_104537_object103956:head# 2024-04-01T19:36:17.554 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54f9769a:::benchmark_data_smithi188_104537_object128760:head# 2024-04-01T19:36:17.555 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54f9b007:::benchmark_data_smithi188_104537_object94770:head# 2024-04-01T19:36:17.555 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54fa86a3:::benchmark_data_smithi188_104537_object93513:head# 2024-04-01T19:36:17.556 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54faa078:::benchmark_data_smithi188_104537_object154081:head# 2024-04-01T19:36:17.556 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54fb1ec4:::benchmark_data_smithi188_104537_object111560:head# 2024-04-01T19:36:17.557 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54fbf014:::benchmark_data_smithi188_104537_object15822:head# 2024-04-01T19:36:17.557 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54fc3aa3:::benchmark_data_smithi188_104537_object15487:head# 2024-04-01T19:36:17.558 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54fc7625:::benchmark_data_smithi188_104537_object54413:head# 2024-04-01T19:36:17.558 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54fdafa2:::benchmark_data_smithi188_104537_object60617:head# 2024-04-01T19:36:17.559 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54fdcd4f:::benchmark_data_smithi188_104537_object13046:head# 2024-04-01T19:36:17.559 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54fe05f5:::benchmark_data_smithi188_104537_object23414:head# 2024-04-01T19:36:17.560 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54fe2eba:::benchmark_data_smithi188_104537_object143932:head# 2024-04-01T19:36:17.560 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54fe6e4f:::benchmark_data_smithi188_104537_object113395:head# 2024-04-01T19:36:17.561 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54fe726d:::benchmark_data_smithi188_104537_object63791:head# 2024-04-01T19:36:17.561 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54fe7ab7:::benchmark_data_smithi188_104537_object17014:head# 2024-04-01T19:36:17.561 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54fea476:::benchmark_data_smithi188_104537_object127697:head# 2024-04-01T19:36:17.562 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54feab60:::benchmark_data_smithi188_104537_object153758:head# 2024-04-01T19:36:17.562 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54feccf5:::benchmark_data_smithi188_104537_object130930:head# 2024-04-01T19:36:17.563 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54fee088:::benchmark_data_smithi188_104537_object115440:head# 2024-04-01T19:36:17.563 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54ff3539:::benchmark_data_smithi188_104537_object31645:head# 2024-04-01T19:36:17.564 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54ffbb76:::benchmark_data_smithi188_104537_object168934:head# 2024-04-01T19:36:17.564 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:54fff857:::benchmark_data_smithi188_104537_object70024:head# 2024-04-01T19:36:17.564 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55005d4f:::benchmark_data_smithi188_104537_object120383:head# 2024-04-01T19:36:17.565 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55008d58:::benchmark_data_smithi188_104537_object89563:head# 2024-04-01T19:36:17.565 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55009fac:::benchmark_data_smithi188_104537_object135758:head# 2024-04-01T19:36:17.566 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5500a15f:::benchmark_data_smithi188_104537_object16348:head# 2024-04-01T19:36:17.566 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5500e905:::benchmark_data_smithi188_104537_object85695:head# 2024-04-01T19:36:17.566 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55010251:::benchmark_data_smithi188_104537_object120106:head# 2024-04-01T19:36:17.567 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55013179:::benchmark_data_smithi188_104537_object96416:head# 2024-04-01T19:36:17.567 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5501823c:::benchmark_data_smithi188_104537_object134007:head# 2024-04-01T19:36:17.568 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5501f02a:::benchmark_data_smithi188_104537_object12952:head# 2024-04-01T19:36:17.568 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5502356d:::benchmark_data_smithi188_104537_object115641:head# 2024-04-01T19:36:17.568 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55024f6c:::benchmark_data_smithi188_104537_object106234:head# 2024-04-01T19:36:17.569 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55026bdb:::benchmark_data_smithi188_104537_object123067:head# 2024-04-01T19:36:17.569 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55028819:::benchmark_data_smithi188_104537_object43503:head# 2024-04-01T19:36:17.569 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55031215:::benchmark_data_smithi188_104537_object107173:head# 2024-04-01T19:36:17.570 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55031fa4:::benchmark_data_smithi188_104537_object17148:head# 2024-04-01T19:36:17.570 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5503249c:::benchmark_data_smithi188_104537_object71157:head# 2024-04-01T19:36:17.571 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55036a67:::benchmark_data_smithi188_104537_object98039:head# 2024-04-01T19:36:17.571 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55045537:::benchmark_data_smithi188_104537_object109154:head# 2024-04-01T19:36:17.572 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55048dc5:::benchmark_data_smithi188_104537_object164708:head# 2024-04-01T19:36:17.572 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55054cff:::benchmark_data_smithi188_104537_object76845:head# 2024-04-01T19:36:17.573 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5506093b:::benchmark_data_smithi188_104537_object64510:head# 2024-04-01T19:36:17.573 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55068819:::benchmark_data_smithi188_104537_object146393:head# 2024-04-01T19:36:17.573 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5506b3fc:::benchmark_data_smithi188_104537_object25307:head# 2024-04-01T19:36:17.574 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:550701f9:::benchmark_data_smithi188_104537_object171104:head# 2024-04-01T19:36:17.574 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55076585:::benchmark_data_smithi188_104537_object111029:head# 2024-04-01T19:36:17.579 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5507775b:::benchmark_data_smithi188_104537_object157352:head# 2024-04-01T19:36:17.579 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:550783d1:::benchmark_data_smithi188_104537_object103005:head# 2024-04-01T19:36:17.579 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5507decb:::benchmark_data_smithi188_104537_object52063:head# 2024-04-01T19:36:17.579 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5508b032:::benchmark_data_smithi188_104537_object27628:head# 2024-04-01T19:36:17.579 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:550962ec:::benchmark_data_smithi188_104537_object89130:head# 2024-04-01T19:36:17.579 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55096785:::benchmark_data_smithi188_104537_object15695:head# 2024-04-01T19:36:17.579 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55099d20:::benchmark_data_smithi188_104537_object122366:head# 2024-04-01T19:36:17.579 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:550aa432:::benchmark_data_smithi188_104537_object149305:head# 2024-04-01T19:36:17.580 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:550acf94:::benchmark_data_smithi188_104537_object49796:head# 2024-04-01T19:36:17.580 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:550b3258:::benchmark_data_smithi188_104537_object143818:head# 2024-04-01T19:36:17.580 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:550b4fdd:::benchmark_data_smithi188_104537_object15084:head# 2024-04-01T19:36:17.580 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:550b7b2c:::benchmark_data_smithi188_104537_object25676:head# 2024-04-01T19:36:17.580 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:550d254b:::benchmark_data_smithi188_104537_object58826:head# 2024-04-01T19:36:17.580 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:550d84e8:::benchmark_data_smithi188_104537_object54215:head# 2024-04-01T19:36:17.581 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:550d8693:::benchmark_data_smithi188_104537_object124393:head# 2024-04-01T19:36:17.581 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:550dd3c2:::benchmark_data_smithi188_104537_object92852:head# 2024-04-01T19:36:17.581 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:550ddff4:::benchmark_data_smithi188_104537_object64281:head# 2024-04-01T19:36:17.582 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:550de451:::benchmark_data_smithi188_104537_object109121:head# 2024-04-01T19:36:17.582 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:550de5e7:::benchmark_data_smithi188_104537_object79451:head# 2024-04-01T19:36:17.582 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:550f1910:::benchmark_data_smithi188_104537_object140614:head# 2024-04-01T19:36:17.583 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:550fd5e0:::benchmark_data_smithi188_104537_object101366:head# 2024-04-01T19:36:17.583 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:550fda69:::benchmark_data_smithi188_104537_object123408:head# 2024-04-01T19:36:17.584 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:550feb11:::benchmark_data_smithi188_104537_object17175:head# 2024-04-01T19:36:17.584 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55100b41:::benchmark_data_smithi188_104537_object98997:head# 2024-04-01T19:36:17.585 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55107b7f:::benchmark_data_smithi188_104537_object81179:head# 2024-04-01T19:36:17.585 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:551089d1:::benchmark_data_smithi188_104537_object84108:head# 2024-04-01T19:36:17.585 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55109c3d:::benchmark_data_smithi188_104537_object147439:head# 2024-04-01T19:36:17.586 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5510ca67:::benchmark_data_smithi188_104537_object30368:head# 2024-04-01T19:36:17.586 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5510dafd:::benchmark_data_smithi188_104537_object105276:head# 2024-04-01T19:36:17.587 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5510fabe:::benchmark_data_smithi188_104537_object153321:head# 2024-04-01T19:36:17.587 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55111235:::benchmark_data_smithi188_104537_object111266:head# 2024-04-01T19:36:17.588 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55125481:::benchmark_data_smithi188_104537_object99278:head# 2024-04-01T19:36:17.588 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5512b0af:::benchmark_data_smithi188_104537_object77199:head# 2024-04-01T19:36:17.589 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5512f4c1:::benchmark_data_smithi188_104537_object129625:head# 2024-04-01T19:36:17.589 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55131735:::benchmark_data_smithi188_104537_object141293:head# 2024-04-01T19:36:17.590 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55133694:::benchmark_data_smithi188_104537_object68031:head# 2024-04-01T19:36:17.590 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5513f393:::benchmark_data_smithi188_104537_object25377:head# 2024-04-01T19:36:17.591 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:551438b8:::benchmark_data_smithi188_104537_object36133:head# 2024-04-01T19:36:17.592 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5514bba1:::benchmark_data_smithi188_104537_object54330:head# 2024-04-01T19:36:17.592 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5514f19e:::benchmark_data_smithi188_104537_object44931:head# 2024-04-01T19:36:17.592 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5515a704:::benchmark_data_smithi188_104537_object142506:head# 2024-04-01T19:36:17.593 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5516be64:::benchmark_data_smithi188_104537_object40836:head# 2024-04-01T19:36:17.593 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55172c76:::benchmark_data_smithi188_104537_object102221:head# 2024-04-01T19:36:17.594 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55198c3c:::benchmark_data_smithi188_104537_object142720:head# 2024-04-01T19:36:17.594 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5519aff9:::benchmark_data_smithi188_104537_object123365:head# 2024-04-01T19:36:17.595 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:551a0ffd:::benchmark_data_smithi188_104537_object15919:head# 2024-04-01T19:36:17.595 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:551a3980:::benchmark_data_smithi188_104537_object121046:head# 2024-04-01T19:36:17.596 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:551a40e4:::benchmark_data_smithi188_104537_object106902:head# 2024-04-01T19:36:17.596 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:551a49a1:::benchmark_data_smithi188_104537_object63008:head# 2024-04-01T19:36:17.597 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:551ab405:::benchmark_data_smithi188_104537_object167459:head# 2024-04-01T19:36:17.597 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:551ab6c8:::benchmark_data_smithi188_104537_object89931:head# 2024-04-01T19:36:17.598 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:551ab9b5:::benchmark_data_smithi188_104537_object123035:head# 2024-04-01T19:36:17.598 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:551afd36:::benchmark_data_smithi188_104537_object32563:head# 2024-04-01T19:36:17.598 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:551c3086:::benchmark_data_smithi188_104537_object165215:head# 2024-04-01T19:36:17.599 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:551cffd1:::benchmark_data_smithi188_104537_object142247:head# 2024-04-01T19:36:17.600 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:551d09fd:::benchmark_data_smithi188_104537_object64052:head# 2024-04-01T19:36:17.600 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:551d47a5:::benchmark_data_smithi188_104537_object169699:head# 2024-04-01T19:36:17.600 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:551e30f6:::benchmark_data_smithi188_104537_object99060:head# 2024-04-01T19:36:17.601 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:551e31be:::benchmark_data_smithi188_104537_object111062:head# 2024-04-01T19:36:17.601 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:551ea001:::benchmark_data_smithi188_104537_object169010:head# 2024-04-01T19:36:17.602 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:551eb14f:::benchmark_data_smithi188_104537_object155672:head# 2024-04-01T19:36:17.602 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:551f1242:::benchmark_data_smithi188_104537_object94357:head# 2024-04-01T19:36:17.603 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:551f5a7f:::benchmark_data_smithi188_104537_object24730:head# 2024-04-01T19:36:17.603 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:551f7267:::benchmark_data_smithi188_104537_object15687:head# 2024-04-01T19:36:17.604 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:551ff1d1:::benchmark_data_smithi188_104537_object21027:head# 2024-04-01T19:36:17.604 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55206786:::benchmark_data_smithi188_104537_object164458:head# 2024-04-01T19:36:17.604 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55208561:::benchmark_data_smithi188_104537_object37546:head# 2024-04-01T19:36:17.605 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5520a5f4:::benchmark_data_smithi188_104537_object20368:head# 2024-04-01T19:36:17.606 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55218911:::benchmark_data_smithi188_104537_object17843:head# 2024-04-01T19:36:17.606 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5521cf18:::benchmark_data_smithi188_104537_object100327:head# 2024-04-01T19:36:17.606 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5521d5e0:::benchmark_data_smithi188_104537_object12586:head# 2024-04-01T19:36:17.607 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55228c30:::benchmark_data_smithi188_104537_object71847:head# 2024-04-01T19:36:17.607 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55230f04:::benchmark_data_smithi188_104537_object67945:head# 2024-04-01T19:36:17.608 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:552320c0:::benchmark_data_smithi188_104537_object53292:head# 2024-04-01T19:36:17.608 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55238a21:::benchmark_data_smithi188_104537_object33981:head# 2024-04-01T19:36:17.609 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5524b43e:::benchmark_data_smithi188_104537_object120349:head# 2024-04-01T19:36:17.609 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5524c1ce:::benchmark_data_smithi188_104537_object45203:head# 2024-04-01T19:36:17.610 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55259fd4:::benchmark_data_smithi188_104537_object48424:head# 2024-04-01T19:36:17.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5525d883:::benchmark_data_smithi188_104537_object151861:head# 2024-04-01T19:36:17.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5525fa4e:::benchmark_data_smithi188_104537_object70511:head# 2024-04-01T19:36:17.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5526268a:::benchmark_data_smithi188_104537_object49893:head# 2024-04-01T19:36:17.612 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55264611:::benchmark_data_smithi188_104537_object76896:head# 2024-04-01T19:36:17.613 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5527b26a:::benchmark_data_smithi188_104537_object77010:head# 2024-04-01T19:36:17.613 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5527c937:::benchmark_data_smithi188_104537_object71760:head# 2024-04-01T19:36:17.614 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5527f0e9:::benchmark_data_smithi188_104537_object97541:head# 2024-04-01T19:36:17.614 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:552885f4:::benchmark_data_smithi188_104537_object166858:head# 2024-04-01T19:36:17.615 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5528d621:::benchmark_data_smithi188_104537_object12261:head# 2024-04-01T19:36:17.615 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55293ec3:::benchmark_data_smithi188_104537_object132849:head# 2024-04-01T19:36:17.615 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:552963e8:::benchmark_data_smithi188_104537_object121751:head# 2024-04-01T19:36:17.616 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:552a213b:::benchmark_data_smithi188_104537_object98755:head# 2024-04-01T19:36:17.616 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:552b2b66:::benchmark_data_smithi188_104537_object160238:head# 2024-04-01T19:36:17.617 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:552bd759:::benchmark_data_smithi188_104537_object115943:head# 2024-04-01T19:36:17.617 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:552c0259:::benchmark_data_smithi188_104537_object69899:head# 2024-04-01T19:36:17.618 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:552c6b47:::benchmark_data_smithi188_104537_object104714:head# 2024-04-01T19:36:17.618 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:552c88c4:::benchmark_data_smithi188_104537_object66347:head# 2024-04-01T19:36:17.618 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:552cfd3c:::benchmark_data_smithi188_104537_object60623:head# 2024-04-01T19:36:17.619 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:552db2dd:::benchmark_data_smithi188_104537_object60941:head# 2024-04-01T19:36:17.619 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:552f2892:::benchmark_data_smithi188_104537_object28980:head# 2024-04-01T19:36:17.620 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:552ffd6f:::benchmark_data_smithi188_104537_object169208:head# 2024-04-01T19:36:17.621 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55300d7f:::benchmark_data_smithi188_104537_object44886:head# 2024-04-01T19:36:17.621 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:553031f8:::benchmark_data_smithi188_104537_object67629:head# 2024-04-01T19:36:17.622 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5530b10c:::benchmark_data_smithi188_104537_object161304:head# 2024-04-01T19:36:17.622 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5531593e:::benchmark_data_smithi188_104537_object83733:head# 2024-04-01T19:36:17.623 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55318202:::benchmark_data_smithi188_104537_object123184:head# 2024-04-01T19:36:17.623 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5531aa23:::benchmark_data_smithi188_104537_object155649:head# 2024-04-01T19:36:17.624 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:553203aa:::benchmark_data_smithi188_104537_object62052:head# 2024-04-01T19:36:17.624 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55320ce9:::benchmark_data_smithi188_104537_object132091:head# 2024-04-01T19:36:17.625 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55327d51:::benchmark_data_smithi188_104537_object20788:head# 2024-04-01T19:36:17.625 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5532fd6a:::benchmark_data_smithi188_104537_object60482:head# 2024-04-01T19:36:17.626 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5533775b:::benchmark_data_smithi188_104537_object37093:head# 2024-04-01T19:36:17.626 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5533c4e9:::benchmark_data_smithi188_104537_object31970:head# 2024-04-01T19:36:17.626 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:553406b8:::benchmark_data_smithi188_104537_object166471:head# 2024-04-01T19:36:17.627 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55345dd1:::benchmark_data_smithi188_104537_object95775:head# 2024-04-01T19:36:17.627 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55357ee8:::benchmark_data_smithi188_104537_object163288:head# 2024-04-01T19:36:17.628 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5536cab2:::benchmark_data_smithi188_104537_object163062:head# 2024-04-01T19:36:17.628 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:553719a7:::benchmark_data_smithi188_104537_object144867:head# 2024-04-01T19:36:17.629 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55373303:::benchmark_data_smithi188_104537_object110301:head# 2024-04-01T19:36:17.629 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55379c15:::benchmark_data_smithi188_104537_object132721:head# 2024-04-01T19:36:17.630 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5538ab9b:::benchmark_data_smithi188_104537_object102549:head# 2024-04-01T19:36:17.630 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55394530:::benchmark_data_smithi188_104537_object72595:head# 2024-04-01T19:36:17.631 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:553a0c26:::benchmark_data_smithi188_104537_object112426:head# 2024-04-01T19:36:17.631 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:553a7722:::benchmark_data_smithi188_104537_object166377:head# 2024-04-01T19:36:17.631 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:553ae226:::benchmark_data_smithi188_104537_object88492:head# 2024-04-01T19:36:17.632 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:553b381d:::benchmark_data_smithi188_104537_object157845:head# 2024-04-01T19:36:17.632 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:553b4447:::benchmark_data_smithi188_104537_object86735:head# 2024-04-01T19:36:17.633 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:553b4ef0:::benchmark_data_smithi188_104537_object63960:head# 2024-04-01T19:36:17.633 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:553b8dad:::benchmark_data_smithi188_104537_object138664:head# 2024-04-01T19:36:17.634 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:553ba4c1:::benchmark_data_smithi188_104537_object70911:head# 2024-04-01T19:36:17.634 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:553bc55b:::benchmark_data_smithi188_104537_object111835:head# 2024-04-01T19:36:17.635 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:553cfdd3:::benchmark_data_smithi188_104537_object45261:head# 2024-04-01T19:36:17.635 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:553d2b21:::benchmark_data_smithi188_104537_object42633:head# 2024-04-01T19:36:17.636 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:553d4537:::benchmark_data_smithi188_104537_object23509:head# 2024-04-01T19:36:17.637 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:553d497d:::benchmark_data_smithi188_104537_object94292:head# 2024-04-01T19:36:17.637 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:553d7ccd:::benchmark_data_smithi188_104537_object93127:head# 2024-04-01T19:36:17.638 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:553d98ad:::benchmark_data_smithi188_104537_object12093:head# 2024-04-01T19:36:17.638 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:553ef4b1:::benchmark_data_smithi188_104537_object150334:head# 2024-04-01T19:36:17.639 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:553f72c7:::benchmark_data_smithi188_104537_object103051:head# 2024-04-01T19:36:17.639 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:553fbe81:::benchmark_data_smithi188_104537_object117073:head# 2024-04-01T19:36:17.640 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55407d23:::benchmark_data_smithi188_104537_object152165:head# 2024-04-01T19:36:17.640 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55436811:::benchmark_data_smithi188_104537_object146685:head# 2024-04-01T19:36:17.641 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5543b32a:::benchmark_data_smithi188_104537_object56880:head# 2024-04-01T19:36:17.641 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5544747b:::benchmark_data_smithi188_104537_object29409:head# 2024-04-01T19:36:17.642 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5544779f:::benchmark_data_smithi188_104537_object113449:head# 2024-04-01T19:36:17.642 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5544aad1:::benchmark_data_smithi188_104537_object127984:head# 2024-04-01T19:36:17.642 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5544c8d0:::benchmark_data_smithi188_104537_object102277:head# 2024-04-01T19:36:17.643 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:554510a5:::benchmark_data_smithi188_104537_object18882:head# 2024-04-01T19:36:17.644 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5545c99d:::benchmark_data_smithi188_104537_object35702:head# 2024-04-01T19:36:17.644 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55460014:::benchmark_data_smithi188_104537_object97335:head# 2024-04-01T19:36:17.645 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55461b07:::benchmark_data_smithi188_104537_object38460:head# 2024-04-01T19:36:17.645 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:554641a9:::benchmark_data_smithi188_104537_object109152:head# 2024-04-01T19:36:17.646 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5546a91a:::benchmark_data_smithi188_104537_object163635:head# 2024-04-01T19:36:17.646 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5546b41e:::benchmark_data_smithi188_104537_object113698:head# 2024-04-01T19:36:17.646 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5546dce1:::benchmark_data_smithi188_104537_object96982:head# 2024-04-01T19:36:17.647 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:554764fe:::benchmark_data_smithi188_104537_object168254:head# 2024-04-01T19:36:17.647 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5548053f:::benchmark_data_smithi188_104537_object115928:head# 2024-04-01T19:36:17.648 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55489af6:::benchmark_data_smithi188_104537_object106952:head# 2024-04-01T19:36:17.648 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:554a055a:::benchmark_data_smithi188_104537_object32463:head# 2024-04-01T19:36:17.648 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:554a367f:::benchmark_data_smithi188_104537_object155849:head# 2024-04-01T19:36:17.649 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:554a9290:::benchmark_data_smithi188_104537_object68281:head# 2024-04-01T19:36:17.649 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:554aabb6:::benchmark_data_smithi188_104537_object71780:head# 2024-04-01T19:36:17.650 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:554aaf0f:::benchmark_data_smithi188_104537_object63029:head# 2024-04-01T19:36:17.650 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:554b4d9a:::benchmark_data_smithi188_104537_object99206:head# 2024-04-01T19:36:17.651 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:554c2de1:::benchmark_data_smithi188_104537_object151132:head# 2024-04-01T19:36:17.651 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:554c759c:::benchmark_data_smithi188_104537_object114287:head# 2024-04-01T19:36:17.653 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:554d3b4e:::benchmark_data_smithi188_104537_object75393:head# 2024-04-01T19:36:17.653 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:554e4048:::benchmark_data_smithi188_104537_object20965:head# 2024-04-01T19:36:17.654 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:554f1af5:::benchmark_data_smithi188_104537_object132251:head# 2024-04-01T19:36:17.654 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:554f6d56:::benchmark_data_smithi188_104537_object141949:head# 2024-04-01T19:36:17.655 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:554f7c86:::benchmark_data_smithi188_104537_object144097:head# 2024-04-01T19:36:17.655 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55500940:::benchmark_data_smithi188_104537_object26075:head# 2024-04-01T19:36:17.656 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5550c132:::benchmark_data_smithi188_104537_object145825:head# 2024-04-01T19:36:17.656 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5550d6a1:::benchmark_data_smithi188_104537_object109983:head# 2024-04-01T19:36:17.656 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5551cb74:::benchmark_data_smithi188_104537_object127388:head# 2024-04-01T19:36:17.657 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55521646:::benchmark_data_smithi188_104537_object128807:head# 2024-04-01T19:36:17.657 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55521aef:::benchmark_data_smithi188_104537_object137431:head# 2024-04-01T19:36:17.658 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5552db6d:::benchmark_data_smithi188_104537_object52450:head# 2024-04-01T19:36:17.658 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55530a59:::benchmark_data_smithi188_104537_object59049:head# 2024-04-01T19:36:17.659 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55534f10:::benchmark_data_smithi188_104537_object170620:head# 2024-04-01T19:36:17.659 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55538ff2:::benchmark_data_smithi188_104537_object116442:head# 2024-04-01T19:36:17.659 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:555526d8:::benchmark_data_smithi188_104537_object88274:head# 2024-04-01T19:36:17.660 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55566406:::benchmark_data_smithi188_104537_object59494:head# 2024-04-01T19:36:17.660 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5556ecf3:::benchmark_data_smithi188_104537_object132801:head# 2024-04-01T19:36:17.661 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55574b2e:::benchmark_data_smithi188_104537_object92448:head# 2024-04-01T19:36:17.661 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:555844e5:::benchmark_data_smithi188_104537_object81107:head# 2024-04-01T19:36:17.662 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5558a636:::benchmark_data_smithi188_104537_object98185:head# 2024-04-01T19:36:17.662 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5558c07f:::benchmark_data_smithi188_104537_object55944:head# 2024-04-01T19:36:17.663 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5558da30:::benchmark_data_smithi188_104537_object88073:head# 2024-04-01T19:36:17.663 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5559162b:::benchmark_data_smithi188_104537_object54843:head# 2024-04-01T19:36:17.664 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:555923d2:::benchmark_data_smithi188_104537_object127361:head# 2024-04-01T19:36:17.664 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55596956:::benchmark_data_smithi188_104537_object97065:head# 2024-04-01T19:36:17.665 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:555a581e:::benchmark_data_smithi188_104537_object23441:head# 2024-04-01T19:36:17.666 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:555aa8a9:::benchmark_data_smithi188_104537_object27160:head# 2024-04-01T19:36:17.666 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:555bb21f:::benchmark_data_smithi188_104537_object139115:head# 2024-04-01T19:36:17.666 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:555bee52:::benchmark_data_smithi188_104537_object15741:head# 2024-04-01T19:36:17.667 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:555ca02c:::benchmark_data_smithi188_104537_object23021:head# 2024-04-01T19:36:17.667 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:555caf8e:::benchmark_data_smithi188_104537_object151063:head# 2024-04-01T19:36:17.668 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:555d26de:::benchmark_data_smithi188_104537_object26967:head# 2024-04-01T19:36:17.668 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:555d2f78:::benchmark_data_smithi188_104537_object136978:head# 2024-04-01T19:36:17.668 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:555d785e:::benchmark_data_smithi188_104537_object112069:head# 2024-04-01T19:36:17.669 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:555dd2bb:::benchmark_data_smithi188_104537_object26742:head# 2024-04-01T19:36:17.669 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:555e4de1:::benchmark_data_smithi188_104537_object158602:head# 2024-04-01T19:36:17.670 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:555e7d14:::benchmark_data_smithi188_104537_object71295:head# 2024-04-01T19:36:17.671 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:555e8f03:::benchmark_data_smithi188_104537_object14868:head# 2024-04-01T19:36:17.671 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:555e9740:::benchmark_data_smithi188_104537_object167705:head# 2024-04-01T19:36:17.671 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:555ede6a:::benchmark_data_smithi188_104537_object139356:head# 2024-04-01T19:36:17.672 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:555fcc7f:::benchmark_data_smithi188_104537_object44476:head# 2024-04-01T19:36:17.672 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:555ff117:::benchmark_data_smithi188_104537_object143525:head# 2024-04-01T19:36:17.673 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5560089f:::benchmark_data_smithi188_104537_object113519:head# 2024-04-01T19:36:17.673 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:556055bb:::benchmark_data_smithi188_104537_object32595:head# 2024-04-01T19:36:17.673 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5560685f:::benchmark_data_smithi188_104537_object57342:head# 2024-04-01T19:36:17.674 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55608db9:::benchmark_data_smithi188_104537_object162477:head# 2024-04-01T19:36:17.674 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55611a76:::benchmark_data_smithi188_104537_object82075:head# 2024-04-01T19:36:17.675 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:556169b3:::benchmark_data_smithi188_104537_object102750:head# 2024-04-01T19:36:17.675 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5561d757:::benchmark_data_smithi188_104537_object159767:head# 2024-04-01T19:36:17.676 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55622698:::benchmark_data_smithi188_104537_object135164:head# 2024-04-01T19:36:17.676 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55623cd6:::benchmark_data_smithi188_104537_object60958:head# 2024-04-01T19:36:17.677 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5562554f:::benchmark_data_smithi188_104537_object23188:head# 2024-04-01T19:36:17.677 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:556275e9:::benchmark_data_smithi188_104537_object66746:head# 2024-04-01T19:36:17.677 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55627d75:::benchmark_data_smithi188_104537_object15833:head# 2024-04-01T19:36:17.678 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:556341ec:::benchmark_data_smithi188_104537_object117569:head# 2024-04-01T19:36:17.678 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55638ffe:::benchmark_data_smithi188_104537_object25378:head# 2024-04-01T19:36:17.678 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5563a980:::benchmark_data_smithi188_104537_object126105:head# 2024-04-01T19:36:17.679 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5563f971:::benchmark_data_smithi188_104537_object87850:head# 2024-04-01T19:36:17.679 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5564469d:::benchmark_data_smithi188_104537_object34258:head# 2024-04-01T19:36:17.680 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55645711:::benchmark_data_smithi188_104537_object86002:head# 2024-04-01T19:36:17.680 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5565263b:::benchmark_data_smithi188_104537_object72528:head# 2024-04-01T19:36:17.681 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5565efa8:::benchmark_data_smithi188_104537_object29761:head# 2024-04-01T19:36:17.681 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:556668f7:::benchmark_data_smithi188_104537_object66853:head# 2024-04-01T19:36:17.681 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5566a330:::benchmark_data_smithi188_104537_object59240:head# 2024-04-01T19:36:17.682 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5566cceb:::benchmark_data_smithi188_104537_object13981:head# 2024-04-01T19:36:17.682 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5567ac51:::benchmark_data_smithi188_104537_object109867:head# 2024-04-01T19:36:17.683 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55681ddd:::benchmark_data_smithi188_104537_object101656:head# 2024-04-01T19:36:17.683 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:556893af:::benchmark_data_smithi188_104537_object148908:head# 2024-04-01T19:36:17.684 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5568b820:::benchmark_data_smithi188_104537_object93971:head# 2024-04-01T19:36:17.684 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5568ef26:::benchmark_data_smithi188_104537_object169463:head# 2024-04-01T19:36:17.684 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55690abf:::benchmark_data_smithi188_104537_object36498:head# 2024-04-01T19:36:17.685 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55693573:::benchmark_data_smithi188_104537_object12860:head# 2024-04-01T19:36:17.685 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55695610:::benchmark_data_smithi188_104537_object93000:head# 2024-04-01T19:36:17.686 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:556958a8:::benchmark_data_smithi188_104537_object47085:head# 2024-04-01T19:36:17.686 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55699c80:::benchmark_data_smithi188_104537_object60159:head# 2024-04-01T19:36:17.686 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5569a7c7:::benchmark_data_smithi188_104537_object75116:head# 2024-04-01T19:36:17.687 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:556a709e:::benchmark_data_smithi188_104537_object102138:head# 2024-04-01T19:36:17.687 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:556ae3dd:::benchmark_data_smithi188_104537_object166033:head# 2024-04-01T19:36:17.688 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:556b3436:::benchmark_data_smithi188_104537_object46550:head# 2024-04-01T19:36:17.688 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:556b5d7a:::benchmark_data_smithi188_104537_object63395:head# 2024-04-01T19:36:17.688 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:556bb7d7:::benchmark_data_smithi188_104537_object57537:head# 2024-04-01T19:36:17.689 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:556bf58f:::benchmark_data_smithi188_104537_object165786:head# 2024-04-01T19:36:17.689 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:556c02a3:::benchmark_data_smithi188_104537_object148126:head# 2024-04-01T19:36:17.689 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:556c5edd:::benchmark_data_smithi188_104537_object101687:head# 2024-04-01T19:36:17.690 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:556cb4db:::benchmark_data_smithi188_104537_object70279:head# 2024-04-01T19:36:17.690 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:556cdc00:::benchmark_data_smithi188_104537_object70615:head# 2024-04-01T19:36:17.691 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:556d4d30:::benchmark_data_smithi188_104537_object152892:head# 2024-04-01T19:36:17.691 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:556d9811:::benchmark_data_smithi188_104537_object107784:head# 2024-04-01T19:36:17.692 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:556db895:::benchmark_data_smithi188_104537_object86600:head# 2024-04-01T19:36:17.692 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:556dbc93:::benchmark_data_smithi188_104537_object64301:head# 2024-04-01T19:36:17.692 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:556e9c1f:::benchmark_data_smithi188_104537_object128553:head# 2024-04-01T19:36:17.693 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:556edeab:::benchmark_data_smithi188_104537_object11551:head# 2024-04-01T19:36:17.693 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:556f434f:::benchmark_data_smithi188_104537_object151874:head# 2024-04-01T19:36:17.694 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:556f50f3:::benchmark_data_smithi188_104537_object69477:head# 2024-04-01T19:36:17.694 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55700625:::benchmark_data_smithi188_104537_object51657:head# 2024-04-01T19:36:17.695 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55702d97:::benchmark_data_smithi188_104537_object51094:head# 2024-04-01T19:36:17.696 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55707a78:::benchmark_data_smithi188_104537_object19404:head# 2024-04-01T19:36:17.696 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5570e371:::benchmark_data_smithi188_104537_object26094:head# 2024-04-01T19:36:17.696 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:557220dc:::benchmark_data_smithi188_104537_object56742:head# 2024-04-01T19:36:17.697 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5572b51d:::benchmark_data_smithi188_104537_object138494:head# 2024-04-01T19:36:17.697 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55730f76:::benchmark_data_smithi188_104537_object22899:head# 2024-04-01T19:36:17.697 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55743fcc:::benchmark_data_smithi188_104537_object124145:head# 2024-04-01T19:36:17.698 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5575084f:::benchmark_data_smithi188_104537_object166655:head# 2024-04-01T19:36:17.698 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5575224f:::benchmark_data_smithi188_104537_object79438:head# 2024-04-01T19:36:17.699 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55753d8e:::benchmark_data_smithi188_104537_object64264:head# 2024-04-01T19:36:17.700 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:557590c9:::benchmark_data_smithi188_104537_object66952:head# 2024-04-01T19:36:17.700 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5576076a:::benchmark_data_smithi188_104537_object83558:head# 2024-04-01T19:36:17.700 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55762869:::benchmark_data_smithi188_104537_object130488:head# 2024-04-01T19:36:17.701 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55767852:::benchmark_data_smithi188_104537_object122127:head# 2024-04-01T19:36:17.701 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55769077:::benchmark_data_smithi188_104537_object47750:head# 2024-04-01T19:36:17.702 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5576ab29:::benchmark_data_smithi188_104537_object72587:head# 2024-04-01T19:36:17.702 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55775f01:::benchmark_data_smithi188_104537_object59797:head# 2024-04-01T19:36:17.702 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:557778a0:::benchmark_data_smithi188_104537_object16702:head# 2024-04-01T19:36:17.703 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5577a682:::benchmark_data_smithi188_104537_object136132:head# 2024-04-01T19:36:17.704 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5577c3ef:::benchmark_data_smithi188_104537_object153808:head# 2024-04-01T19:36:17.704 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5578e1c8:::benchmark_data_smithi188_104537_object35931:head# 2024-04-01T19:36:17.704 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5578e7bb:::benchmark_data_smithi188_104537_object64230:head# 2024-04-01T19:36:17.704 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:557a038b:::benchmark_data_smithi188_104537_object35831:head# 2024-04-01T19:36:17.705 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:557b04fa:::benchmark_data_smithi188_104537_object68847:head# 2024-04-01T19:36:17.705 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:557b99d7:::benchmark_data_smithi188_104537_object135333:head# 2024-04-01T19:36:17.706 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:557bf150:::benchmark_data_smithi188_104537_object164179:head# 2024-04-01T19:36:17.706 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:557bf655:::benchmark_data_smithi188_104537_object76203:head# 2024-04-01T19:36:17.707 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:557ca8c5:::benchmark_data_smithi188_104537_object164547:head# 2024-04-01T19:36:17.707 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:557cc77d:::benchmark_data_smithi188_104537_object90177:head# 2024-04-01T19:36:17.707 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:557ccbd2:::benchmark_data_smithi188_104537_object41166:head# 2024-04-01T19:36:17.708 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:557cf46a:::benchmark_data_smithi188_104537_object132271:head# 2024-04-01T19:36:17.708 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:557cf9c7:::benchmark_data_smithi188_104537_object86904:head# 2024-04-01T19:36:17.708 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:557d6d9a:::benchmark_data_smithi188_104537_object114402:head# 2024-04-01T19:36:17.709 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:557d9674:::benchmark_data_smithi188_104537_object28364:head# 2024-04-01T19:36:17.709 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:557dddba:::benchmark_data_smithi188_104537_object84985:head# 2024-04-01T19:36:17.710 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:557deffc:::benchmark_data_smithi188_104537_object122568:head# 2024-04-01T19:36:17.710 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:557e884c:::benchmark_data_smithi188_104537_object125269:head# 2024-04-01T19:36:17.711 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:557ecb7e:::benchmark_data_smithi188_104537_object86993:head# 2024-04-01T19:36:17.711 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:557ef4bd:::benchmark_data_smithi188_104537_object106494:head# 2024-04-01T19:36:17.711 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:557f7ba7:::benchmark_data_smithi188_104537_object145108:head# 2024-04-01T19:36:17.712 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:557fd4c9:::benchmark_data_smithi188_104537_object81263:head# 2024-04-01T19:36:17.712 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55802236:::benchmark_data_smithi188_104537_object157899:head# 2024-04-01T19:36:17.713 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5581f8a9:::benchmark_data_smithi188_104537_object171080:head# 2024-04-01T19:36:17.713 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55824f77:::benchmark_data_smithi188_104537_object70493:head# 2024-04-01T19:36:17.713 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5582505c:::benchmark_data_smithi188_104537_object165584:head# 2024-04-01T19:36:17.714 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5582e809:::benchmark_data_smithi188_104537_object90856:head# 2024-04-01T19:36:17.714 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5583b89e:::benchmark_data_smithi188_104537_object131029:head# 2024-04-01T19:36:17.715 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5583d745:::benchmark_data_smithi188_104537_object144044:head# 2024-04-01T19:36:17.715 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55846d48:::benchmark_data_smithi188_104537_object65988:head# 2024-04-01T19:36:17.715 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5584de0c:::benchmark_data_smithi188_104537_object70746:head# 2024-04-01T19:36:17.716 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5584e193:::benchmark_data_smithi188_104537_object29281:head# 2024-04-01T19:36:17.716 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5585bbf7:::benchmark_data_smithi188_104537_object76507:head# 2024-04-01T19:36:17.717 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5585c8fd:::benchmark_data_smithi188_104537_object63040:head# 2024-04-01T19:36:17.717 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5585db7b:::benchmark_data_smithi188_104537_object74545:head# 2024-04-01T19:36:17.718 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5585f3e8:::benchmark_data_smithi188_104537_object78671:head# 2024-04-01T19:36:17.718 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55861b58:::benchmark_data_smithi188_104537_object160308:head# 2024-04-01T19:36:17.718 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55864845:::benchmark_data_smithi188_104537_object28454:head# 2024-04-01T19:36:17.719 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5586c236:::benchmark_data_smithi188_104537_object39071:head# 2024-04-01T19:36:17.719 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:558760f3:::benchmark_data_smithi188_104537_object28458:head# 2024-04-01T19:36:17.720 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55877a71:::benchmark_data_smithi188_104537_object74528:head# 2024-04-01T19:36:17.720 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5587f405:::benchmark_data_smithi188_104537_object13145:head# 2024-04-01T19:36:17.721 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:558886c2:::benchmark_data_smithi188_104537_object163493:head# 2024-04-01T19:36:17.721 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5588ae3a:::benchmark_data_smithi188_104537_object134497:head# 2024-04-01T19:36:17.721 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5588e4b8:::benchmark_data_smithi188_104537_object113280:head# 2024-04-01T19:36:17.722 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:558a0694:::benchmark_data_smithi188_104537_object42117:head# 2024-04-01T19:36:17.722 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:558a3190:::benchmark_data_smithi188_104537_object92982:head# 2024-04-01T19:36:17.723 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:558b406a:::benchmark_data_smithi188_104537_object145586:head# 2024-04-01T19:36:17.723 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:558bbee5:::benchmark_data_smithi188_104537_object54273:head# 2024-04-01T19:36:17.724 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:558bc562:::benchmark_data_smithi188_104537_object50541:head# 2024-04-01T19:36:17.724 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:558bd631:::benchmark_data_smithi188_104537_object80170:head# 2024-04-01T19:36:17.725 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:558c019f:::benchmark_data_smithi188_104537_object109509:head# 2024-04-01T19:36:17.725 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:558cc9dc:::benchmark_data_smithi188_104537_object133089:head# 2024-04-01T19:36:17.725 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:558d65c1:::benchmark_data_smithi188_104537_object28376:head# 2024-04-01T19:36:17.726 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:558dfa68:::benchmark_data_smithi188_104537_object15316:head# 2024-04-01T19:36:17.726 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:558e5443:::benchmark_data_smithi188_104537_object142452:head# 2024-04-01T19:36:17.727 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:558e8a19:::benchmark_data_smithi188_104537_object70908:head# 2024-04-01T19:36:17.727 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:558f3d86:::benchmark_data_smithi188_104537_object112931:head# 2024-04-01T19:36:17.728 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55927e3a:::benchmark_data_smithi188_104537_object28168:head# 2024-04-01T19:36:17.728 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5592c1b1:::benchmark_data_smithi188_104537_object75919:head# 2024-04-01T19:36:17.728 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559301d8:::benchmark_data_smithi188_104537_object16654:head# 2024-04-01T19:36:17.729 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5593dc91:::benchmark_data_smithi188_104537_object100435:head# 2024-04-01T19:36:17.729 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5594316e:::benchmark_data_smithi188_104537_object117059:head# 2024-04-01T19:36:17.730 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559496a4:::benchmark_data_smithi188_104537_object90060:head# 2024-04-01T19:36:17.730 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559507d1:::benchmark_data_smithi188_104537_object125076:head# 2024-04-01T19:36:17.736 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559574bd:::benchmark_data_smithi188_104537_object100535:head# 2024-04-01T19:36:17.736 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55977f28:::benchmark_data_smithi188_104537_object49457:head# 2024-04-01T19:36:17.737 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5597e2a0:::benchmark_data_smithi188_104537_object158400:head# 2024-04-01T19:36:17.737 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55981b89:::benchmark_data_smithi188_104537_object137984:head# 2024-04-01T19:36:17.737 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55984be8:::benchmark_data_smithi188_104537_object146350:head# 2024-04-01T19:36:17.738 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5598a061:::benchmark_data_smithi188_104537_object170897:head# 2024-04-01T19:36:17.738 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5598b45c:::benchmark_data_smithi188_104537_object166973:head# 2024-04-01T19:36:17.739 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5598b734:::benchmark_data_smithi188_104537_object59231:head# 2024-04-01T19:36:17.739 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559a9378:::benchmark_data_smithi188_104537_object17501:head# 2024-04-01T19:36:17.739 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559add7e:::benchmark_data_smithi188_104537_object19911:head# 2024-04-01T19:36:17.740 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559b8325:::benchmark_data_smithi188_104537_object154390:head# 2024-04-01T19:36:17.740 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559b8ad5:::benchmark_data_smithi188_104537_object70178:head# 2024-04-01T19:36:17.741 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559bf51f:::benchmark_data_smithi188_104537_object149879:head# 2024-04-01T19:36:17.741 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559bf8ea:::benchmark_data_smithi188_104537_object148022:head# 2024-04-01T19:36:17.741 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559c0839:::benchmark_data_smithi188_104537_object37838:head# 2024-04-01T19:36:17.742 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559c0d70:::benchmark_data_smithi188_104537_object116336:head# 2024-04-01T19:36:17.742 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559c58d2:::benchmark_data_smithi188_104537_object105565:head# 2024-04-01T19:36:17.742 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559c6d27:::benchmark_data_smithi188_104537_object33634:head# 2024-04-01T19:36:17.743 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559cf7c7:::benchmark_data_smithi188_104537_object26136:head# 2024-04-01T19:36:17.743 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559d0e3a:::benchmark_data_smithi188_104537_object86390:head# 2024-04-01T19:36:17.743 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559d3060:::benchmark_data_smithi188_104537_object108646:head# 2024-04-01T19:36:17.744 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559d3067:::benchmark_data_smithi188_104537_object29452:head# 2024-04-01T19:36:17.744 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559d5aa6:::benchmark_data_smithi188_104537_object141587:head# 2024-04-01T19:36:17.745 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559d8f26:::benchmark_data_smithi188_104537_object147385:head# 2024-04-01T19:36:17.745 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559d918d:::benchmark_data_smithi188_104537_object135798:head# 2024-04-01T19:36:17.745 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559e21d3:::benchmark_data_smithi188_104537_object121270:head# 2024-04-01T19:36:17.746 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559e3bfc:::benchmark_data_smithi188_104537_object124505:head# 2024-04-01T19:36:17.746 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559e5757:::benchmark_data_smithi188_104537_object38482:head# 2024-04-01T19:36:17.747 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559efc80:::benchmark_data_smithi188_104537_object47230:head# 2024-04-01T19:36:17.747 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559f267b:::benchmark_data_smithi188_104537_object149833:head# 2024-04-01T19:36:17.748 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:559ffdb6:::benchmark_data_smithi188_104537_object118957:head# 2024-04-01T19:36:17.748 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55a07675:::benchmark_data_smithi188_104537_object97344:head# 2024-04-01T19:36:17.748 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55a0a12c:::benchmark_data_smithi188_104537_object162439:head# 2024-04-01T19:36:17.749 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55a0f1ef:::benchmark_data_smithi188_104537_object30496:head# 2024-04-01T19:36:17.749 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55a14e9b:::benchmark_data_smithi188_104537_object63585:head# 2024-04-01T19:36:17.750 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55a16bf1:::benchmark_data_smithi188_104537_object149127:head# 2024-04-01T19:36:17.750 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55a1e56b:::benchmark_data_smithi188_104537_object82691:head# 2024-04-01T19:36:17.751 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55a1fe6c:::benchmark_data_smithi188_104537_object34229:head# 2024-04-01T19:36:17.751 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55a22212:::benchmark_data_smithi188_104537_object131437:head# 2024-04-01T19:36:17.751 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55a25f6f:::benchmark_data_smithi188_104537_object56040:head# 2024-04-01T19:36:17.752 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55a2b960:::benchmark_data_smithi188_104537_object69904:head# 2024-04-01T19:36:17.752 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55a3940c:::benchmark_data_smithi188_104537_object121940:head# 2024-04-01T19:36:17.753 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55a3eff7:::benchmark_data_smithi188_104537_object29107:head# 2024-04-01T19:36:17.754 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55a4d2f3:::benchmark_data_smithi188_104537_object61650:head# 2024-04-01T19:36:17.754 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55a5419d:::benchmark_data_smithi188_104537_object52811:head# 2024-04-01T19:36:17.755 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55a55e9f:::benchmark_data_smithi188_104537_object47212:head# 2024-04-01T19:36:17.755 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55a5e239:::benchmark_data_smithi188_104537_object156371:head# 2024-04-01T19:36:17.755 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55a607ac:::benchmark_data_smithi188_104537_object48518:head# 2024-04-01T19:36:17.756 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55a63a83:::benchmark_data_smithi188_104537_object130474:head# 2024-04-01T19:36:17.756 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55a76c1a:::benchmark_data_smithi188_104537_object104211:head# 2024-04-01T19:36:17.757 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55a86162:::benchmark_data_smithi188_104537_object96004:head# 2024-04-01T19:36:17.757 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55a89ddf:::benchmark_data_smithi188_104537_object104586:head# 2024-04-01T19:36:17.757 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55a95b99:::benchmark_data_smithi188_104537_object37200:head# 2024-04-01T19:36:17.758 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55a98231:::benchmark_data_smithi188_104537_object86037:head# 2024-04-01T19:36:17.758 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55aaa600:::benchmark_data_smithi188_104537_object105477:head# 2024-04-01T19:36:17.759 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55aae492:::benchmark_data_smithi188_104537_object45855:head# 2024-04-01T19:36:17.759 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ab1906:::benchmark_data_smithi188_104537_object103666:head# 2024-04-01T19:36:17.759 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ac9711:::benchmark_data_smithi188_104537_object125256:head# 2024-04-01T19:36:17.760 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ac9cba:::benchmark_data_smithi188_104537_object149441:head# 2024-04-01T19:36:17.760 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55acb5e9:::benchmark_data_smithi188_104537_object139500:head# 2024-04-01T19:36:17.761 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ad24fa:::benchmark_data_smithi188_104537_object153421:head# 2024-04-01T19:36:17.762 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ad7291:::benchmark_data_smithi188_104537_object152214:head# 2024-04-01T19:36:17.762 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55adf194:::benchmark_data_smithi188_104537_object93253:head# 2024-04-01T19:36:17.763 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55adf807:::benchmark_data_smithi188_104537_object28468:head# 2024-04-01T19:36:17.763 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ae1bf3:::benchmark_data_smithi188_104537_object28385:head# 2024-04-01T19:36:17.763 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ae232a:::benchmark_data_smithi188_104537_object50851:head# 2024-04-01T19:36:17.764 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ae5511:::benchmark_data_smithi188_104537_object51922:head# 2024-04-01T19:36:17.764 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55af4441:::benchmark_data_smithi188_104537_object18523:head# 2024-04-01T19:36:17.765 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55afd8b6:::benchmark_data_smithi188_104537_object13857:head# 2024-04-01T19:36:17.765 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b1272e:::benchmark_data_smithi188_104537_object54406:head# 2024-04-01T19:36:17.766 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b12f02:::benchmark_data_smithi188_104537_object129766:head# 2024-04-01T19:36:17.766 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b1cae8:::benchmark_data_smithi188_104537_object108188:head# 2024-04-01T19:36:17.767 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b1cb8d:::benchmark_data_smithi188_104537_object48966:head# 2024-04-01T19:36:17.767 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b31751:::benchmark_data_smithi188_104537_object119090:head# 2024-04-01T19:36:17.768 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b3886b:::benchmark_data_smithi188_104537_object159542:head# 2024-04-01T19:36:17.768 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b3e081:::benchmark_data_smithi188_104537_object17096:head# 2024-04-01T19:36:17.768 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b41d8b:::benchmark_data_smithi188_104537_object45842:head# 2024-04-01T19:36:17.769 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b48731:::benchmark_data_smithi188_104537_object137462:head# 2024-04-01T19:36:17.769 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b49097:::benchmark_data_smithi188_104537_object162658:head# 2024-04-01T19:36:17.770 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b49e7b:::benchmark_data_smithi188_104537_object119784:head# 2024-04-01T19:36:17.770 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b4b5ce:::benchmark_data_smithi188_104537_object106072:head# 2024-04-01T19:36:17.771 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b4dc3f:::benchmark_data_smithi188_104537_object11946:head# 2024-04-01T19:36:17.771 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b4e3c5:::benchmark_data_smithi188_104537_object149819:head# 2024-04-01T19:36:17.771 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b53599:::benchmark_data_smithi188_104537_object128868:head# 2024-04-01T19:36:17.772 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b5b505:::benchmark_data_smithi188_104537_object81446:head# 2024-04-01T19:36:17.772 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b5b610:::benchmark_data_smithi188_104537_object97220:head# 2024-04-01T19:36:17.773 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b6a569:::benchmark_data_smithi188_104537_object22413:head# 2024-04-01T19:36:17.773 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b71474:::benchmark_data_smithi188_104537_object62295:head# 2024-04-01T19:36:17.774 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b72ff8:::benchmark_data_smithi188_104537_object142515:head# 2024-04-01T19:36:17.774 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b76fc9:::benchmark_data_smithi188_104537_object121788:head# 2024-04-01T19:36:17.774 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b77033:::benchmark_data_smithi188_104537_object119996:head# 2024-04-01T19:36:17.775 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b7a130:::benchmark_data_smithi188_104537_object170011:head# 2024-04-01T19:36:17.775 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b7c81f:::benchmark_data_smithi188_104537_object20728:head# 2024-04-01T19:36:17.776 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b840aa:::benchmark_data_smithi188_104537_object167241:head# 2024-04-01T19:36:17.776 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55b9733e:::benchmark_data_smithi188_104537_object53448:head# 2024-04-01T19:36:17.776 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ba0383:::benchmark_data_smithi188_104537_object114288:head# 2024-04-01T19:36:17.777 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ba0a52:::benchmark_data_smithi188_104537_object12628:head# 2024-04-01T19:36:17.777 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ba1fe9:::benchmark_data_smithi188_104537_object146203:head# 2024-04-01T19:36:17.778 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55bb2486:::benchmark_data_smithi188_104537_object90791:head# 2024-04-01T19:36:17.778 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55bb3546:::benchmark_data_smithi188_104537_object52773:head# 2024-04-01T19:36:17.783 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55bb8849:::benchmark_data_smithi188_104537_object26587:head# 2024-04-01T19:36:17.783 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55bb9c3a:::benchmark_data_smithi188_104537_object121468:head# 2024-04-01T19:36:17.783 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55bbd5f6:::benchmark_data_smithi188_104537_object171437:head# 2024-04-01T19:36:17.783 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55bbf4b7:::benchmark_data_smithi188_104537_object88111:head# 2024-04-01T19:36:17.783 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55bc2e38:::benchmark_data_smithi188_104537_object73002:head# 2024-04-01T19:36:17.783 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55bc5c5b:::benchmark_data_smithi188_104537_object82822:head# 2024-04-01T19:36:17.783 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55bc78db:::benchmark_data_smithi188_104537_object144141:head# 2024-04-01T19:36:17.783 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55bca728:::benchmark_data_smithi188_104537_object37074:head# 2024-04-01T19:36:17.784 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55bcbea6:::benchmark_data_smithi188_104537_object149033:head# 2024-04-01T19:36:17.784 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55bd9683:::benchmark_data_smithi188_104537_object67049:head# 2024-04-01T19:36:17.784 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55bdf339:::benchmark_data_smithi188_104537_object105559:head# 2024-04-01T19:36:17.784 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55bee2fa:::benchmark_data_smithi188_104537_object45228:head# 2024-04-01T19:36:17.784 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55bf8de6:::benchmark_data_smithi188_104537_object156983:head# 2024-04-01T19:36:17.785 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55bfdcf6:::benchmark_data_smithi188_104537_object33949:head# 2024-04-01T19:36:17.785 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55c017d4:::benchmark_data_smithi188_104537_object87898:head# 2024-04-01T19:36:17.785 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55c04772:::benchmark_data_smithi188_104537_object64277:head# 2024-04-01T19:36:17.785 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55c084f9:::benchmark_data_smithi188_104537_object113362:head# 2024-04-01T19:36:17.786 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55c0bafa:::benchmark_data_smithi188_104537_object112287:head# 2024-04-01T19:36:17.786 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55c0c272:::benchmark_data_smithi188_104537_object152815:head# 2024-04-01T19:36:17.787 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55c1d9d3:::benchmark_data_smithi188_104537_object62644:head# 2024-04-01T19:36:17.788 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55c2316d:::benchmark_data_smithi188_104537_object123834:head# 2024-04-01T19:36:17.788 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55c2d6c0:::benchmark_data_smithi188_104537_object135345:head# 2024-04-01T19:36:17.788 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55c3afc5:::benchmark_data_smithi188_104537_object165819:head# 2024-04-01T19:36:17.789 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55c4a537:::benchmark_data_smithi188_104537_object131504:head# 2024-04-01T19:36:17.789 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55c56722:::benchmark_data_smithi188_104537_object127655:head# 2024-04-01T19:36:17.790 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55c5b3c9:::benchmark_data_smithi188_104537_object158708:head# 2024-04-01T19:36:17.790 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55c5c41b:::benchmark_data_smithi188_104537_object48745:head# 2024-04-01T19:36:17.790 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55c6389a:::benchmark_data_smithi188_104537_object43582:head# 2024-04-01T19:36:17.791 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55c64ebe:::benchmark_data_smithi188_104537_object92912:head# 2024-04-01T19:36:17.791 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55c673cc:::benchmark_data_smithi188_104537_object142447:head# 2024-04-01T19:36:17.792 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55c6bfdd:::benchmark_data_smithi188_104537_object116076:head# 2024-04-01T19:36:17.792 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55c75083:::benchmark_data_smithi188_104537_object136693:head# 2024-04-01T19:36:17.792 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55c7f9ba:::benchmark_data_smithi188_104537_object168944:head# 2024-04-01T19:36:17.793 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55c86b18:::benchmark_data_smithi188_104537_object118296:head# 2024-04-01T19:36:17.793 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55c8e2ce:::benchmark_data_smithi188_104537_object61263:head# 2024-04-01T19:36:17.794 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55c97684:::benchmark_data_smithi188_104537_object11391:head# 2024-04-01T19:36:17.794 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55c99c2c:::benchmark_data_smithi188_104537_object36431:head# 2024-04-01T19:36:17.795 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55c9ca19:::benchmark_data_smithi188_104537_object18256:head# 2024-04-01T19:36:17.795 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ca1dd7:::benchmark_data_smithi188_104537_object72972:head# 2024-04-01T19:36:17.795 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ca2aad:::benchmark_data_smithi188_104537_object53101:head# 2024-04-01T19:36:17.796 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ca4e30:::benchmark_data_smithi188_104537_object85202:head# 2024-04-01T19:36:17.796 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55cb234d:::benchmark_data_smithi188_104537_object60394:head# 2024-04-01T19:36:17.797 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55cbb59b:::benchmark_data_smithi188_104537_object36600:head# 2024-04-01T19:36:17.798 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55cbc7dd:::benchmark_data_smithi188_104537_object124677:head# 2024-04-01T19:36:17.798 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55cc11b3:::benchmark_data_smithi188_104537_object40540:head# 2024-04-01T19:36:17.798 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55cc5d61:::benchmark_data_smithi188_104537_object60084:head# 2024-04-01T19:36:17.799 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55cc5ed1:::benchmark_data_smithi188_104537_object63758:head# 2024-04-01T19:36:17.799 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55cc8777:::benchmark_data_smithi188_104537_object57170:head# 2024-04-01T19:36:17.799 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55cc98e7:::benchmark_data_smithi188_104537_object45182:head# 2024-04-01T19:36:17.800 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55cd105e:::benchmark_data_smithi188_104537_object153155:head# 2024-04-01T19:36:17.800 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55cd5b52:::benchmark_data_smithi188_104537_object127584:head# 2024-04-01T19:36:17.801 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ce0e00:::benchmark_data_smithi188_104537_object117655:head# 2024-04-01T19:36:17.802 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ce98c2:::benchmark_data_smithi188_104537_object139819:head# 2024-04-01T19:36:17.802 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55cf0669:::benchmark_data_smithi188_104537_object150739:head# 2024-04-01T19:36:17.802 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55cf6e1e:::benchmark_data_smithi188_104537_object160167:head# 2024-04-01T19:36:17.802 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d034f4:::benchmark_data_smithi188_104537_object66480:head# 2024-04-01T19:36:17.803 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d047c5:::benchmark_data_smithi188_104537_object151943:head# 2024-04-01T19:36:17.803 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d049e2:::benchmark_data_smithi188_104537_object17292:head# 2024-04-01T19:36:17.804 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d04c70:::benchmark_data_smithi188_104537_object147800:head# 2024-04-01T19:36:17.804 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d0c0e9:::benchmark_data_smithi188_104537_object125502:head# 2024-04-01T19:36:17.805 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d171b8:::benchmark_data_smithi188_104537_object139338:head# 2024-04-01T19:36:17.805 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d17c35:::benchmark_data_smithi188_104537_object107124:head# 2024-04-01T19:36:17.806 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d217a0:::benchmark_data_smithi188_104537_object151185:head# 2024-04-01T19:36:17.806 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d22eed:::benchmark_data_smithi188_104537_object24951:head# 2024-04-01T19:36:17.807 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d240e8:::benchmark_data_smithi188_104537_object77135:head# 2024-04-01T19:36:17.807 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d28356:::benchmark_data_smithi188_104537_object64049:head# 2024-04-01T19:36:17.808 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d297a5:::benchmark_data_smithi188_104537_object23776:head# 2024-04-01T19:36:17.808 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d2e2cd:::benchmark_data_smithi188_104537_object132302:head# 2024-04-01T19:36:17.809 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d3c08b:::benchmark_data_smithi188_104537_object68628:head# 2024-04-01T19:36:17.809 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d3edad:::benchmark_data_smithi188_104537_object144973:head# 2024-04-01T19:36:17.810 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d44a6f:::benchmark_data_smithi188_104537_object153454:head# 2024-04-01T19:36:17.810 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d4542f:::benchmark_data_smithi188_104537_object53941:head# 2024-04-01T19:36:17.811 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d51a23:::benchmark_data_smithi188_104537_object128907:head# 2024-04-01T19:36:17.811 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d5620b:::benchmark_data_smithi188_104537_object76189:head# 2024-04-01T19:36:17.811 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d584cc:::benchmark_data_smithi188_104537_object141363:head# 2024-04-01T19:36:17.812 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d5bc74:::benchmark_data_smithi188_104537_object110953:head# 2024-04-01T19:36:17.812 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d6157e:::benchmark_data_smithi188_104537_object68493:head# 2024-04-01T19:36:17.813 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d66635:::benchmark_data_smithi188_104537_object20975:head# 2024-04-01T19:36:17.813 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d70dd4:::benchmark_data_smithi188_104537_object86971:head# 2024-04-01T19:36:17.814 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d7ffc8:::benchmark_data_smithi188_104537_object33626:head# 2024-04-01T19:36:17.814 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d84f5c:::benchmark_data_smithi188_104537_object160173:head# 2024-04-01T19:36:17.814 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d89629:::benchmark_data_smithi188_104537_object165947:head# 2024-04-01T19:36:17.815 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d8d08b:::benchmark_data_smithi188_104537_object21527:head# 2024-04-01T19:36:17.815 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d981fd:::benchmark_data_smithi188_104537_object109223:head# 2024-04-01T19:36:17.816 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d9994a:::benchmark_data_smithi188_104537_object89438:head# 2024-04-01T19:36:17.816 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55d9cd64:::benchmark_data_smithi188_104537_object46131:head# 2024-04-01T19:36:17.816 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55da1662:::benchmark_data_smithi188_104537_object101450:head# 2024-04-01T19:36:17.817 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55da1c21:::benchmark_data_smithi188_104537_object154361:head# 2024-04-01T19:36:17.817 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55daadd5:::benchmark_data_smithi188_104537_object128355:head# 2024-04-01T19:36:17.818 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55dad145:::benchmark_data_smithi188_104537_object54281:head# 2024-04-01T19:36:17.818 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55db6b43:::benchmark_data_smithi188_104537_object40516:head# 2024-04-01T19:36:17.819 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55dc5e4c:::benchmark_data_smithi188_104537_object66816:head# 2024-04-01T19:36:17.820 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ddbfc6:::benchmark_data_smithi188_104537_object66886:head# 2024-04-01T19:36:17.820 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55dddbf2:::benchmark_data_smithi188_104537_object24261:head# 2024-04-01T19:36:17.820 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55de6a25:::benchmark_data_smithi188_104537_object145049:head# 2024-04-01T19:36:17.821 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55de90c4:::benchmark_data_smithi188_104537_object109530:head# 2024-04-01T19:36:17.821 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55dec629:::benchmark_data_smithi188_104537_object117945:head# 2024-04-01T19:36:17.821 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55deca1a:::benchmark_data_smithi188_104537_object146200:head# 2024-04-01T19:36:17.822 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55df288a:::benchmark_data_smithi188_104537_object123194:head# 2024-04-01T19:36:17.822 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55df2efb:::benchmark_data_smithi188_104537_object88859:head# 2024-04-01T19:36:17.823 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55df488c:::benchmark_data_smithi188_104537_object14463:head# 2024-04-01T19:36:17.823 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55dfad15:::benchmark_data_smithi188_104537_object169320:head# 2024-04-01T19:36:17.824 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55dfe889:::benchmark_data_smithi188_104537_object48058:head# 2024-04-01T19:36:17.824 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e05ad3:::benchmark_data_smithi188_104537_object122533:head# 2024-04-01T19:36:17.825 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e06e0c:::benchmark_data_smithi188_104537_object134029:head# 2024-04-01T19:36:17.825 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e0862d:::benchmark_data_smithi188_104537_object32791:head# 2024-04-01T19:36:17.826 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e09e55:::benchmark_data_smithi188_104537_object131840:head# 2024-04-01T19:36:17.826 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e0c4a1:::benchmark_data_smithi188_104537_object29833:head# 2024-04-01T19:36:17.826 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e0fedf:::benchmark_data_smithi188_104537_object146507:head# 2024-04-01T19:36:17.827 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e18d2e:::benchmark_data_smithi188_104537_object38751:head# 2024-04-01T19:36:17.827 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e18eb7:::benchmark_data_smithi188_104537_object105315:head# 2024-04-01T19:36:17.828 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e1e6ba:::benchmark_data_smithi188_104537_object79178:head# 2024-04-01T19:36:17.828 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e3411b:::benchmark_data_smithi188_104537_object125644:head# 2024-04-01T19:36:17.829 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e3a75f:::benchmark_data_smithi188_104537_object58312:head# 2024-04-01T19:36:17.829 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e4195a:::benchmark_data_smithi188_104537_object162006:head# 2024-04-01T19:36:17.830 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e49e04:::benchmark_data_smithi188_104537_object28750:head# 2024-04-01T19:36:17.830 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e51fdf:::benchmark_data_smithi188_104537_object79967:head# 2024-04-01T19:36:17.831 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e5afd0:::benchmark_data_smithi188_104537_object115494:head# 2024-04-01T19:36:17.832 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e5ca1a:::benchmark_data_smithi188_104537_object164471:head# 2024-04-01T19:36:17.832 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e6012b:::benchmark_data_smithi188_104537_object114802:head# 2024-04-01T19:36:17.833 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e61dc6:::benchmark_data_smithi188_104537_object28252:head# 2024-04-01T19:36:17.833 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e63e42:::benchmark_data_smithi188_104537_object105029:head# 2024-04-01T19:36:17.833 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e65842:::benchmark_data_smithi188_104537_object126655:head# 2024-04-01T19:36:17.834 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e6b507:::benchmark_data_smithi188_104537_object11079:head# 2024-04-01T19:36:17.834 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e7dc3e:::benchmark_data_smithi188_104537_object35103:head# 2024-04-01T19:36:17.835 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e80ee1:::benchmark_data_smithi188_104537_object20095:head# 2024-04-01T19:36:17.835 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e86ec7:::benchmark_data_smithi188_104537_object167876:head# 2024-04-01T19:36:17.836 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e93b6c:::benchmark_data_smithi188_104537_object19262:head# 2024-04-01T19:36:17.836 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e94de3:::benchmark_data_smithi188_104537_object121576:head# 2024-04-01T19:36:17.837 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55e9b64a:::benchmark_data_smithi188_104537_object140481:head# 2024-04-01T19:36:17.837 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ea046a:::benchmark_data_smithi188_104537_object170208:head# 2024-04-01T19:36:17.837 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ea72b3:::benchmark_data_smithi188_104537_object148916:head# 2024-04-01T19:36:17.838 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55eae443:::benchmark_data_smithi188_104537_object43321:head# 2024-04-01T19:36:17.838 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55eb1eb1:::benchmark_data_smithi188_104537_object39424:head# 2024-04-01T19:36:17.839 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55eb53ad:::benchmark_data_smithi188_104537_object62881:head# 2024-04-01T19:36:17.839 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55eb6a29:::benchmark_data_smithi188_104537_object22999:head# 2024-04-01T19:36:17.839 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55eba71c:::benchmark_data_smithi188_104537_object31305:head# 2024-04-01T19:36:17.840 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ebc420:::benchmark_data_smithi188_104537_object72010:head# 2024-04-01T19:36:17.840 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ebd48a:::benchmark_data_smithi188_104537_object170923:head# 2024-04-01T19:36:17.841 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ec08e8:::benchmark_data_smithi188_104537_object19751:head# 2024-04-01T19:36:17.841 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ec0ac0:::benchmark_data_smithi188_104537_object78126:head# 2024-04-01T19:36:17.842 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ec3879:::benchmark_data_smithi188_104537_object99905:head# 2024-04-01T19:36:17.842 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ecefdc:::benchmark_data_smithi188_104537_object74170:head# 2024-04-01T19:36:17.842 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ecf98f:::benchmark_data_smithi188_104537_object124686:head# 2024-04-01T19:36:17.843 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ed3208:::benchmark_data_smithi188_104537_object32167:head# 2024-04-01T19:36:17.843 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ed3226:::benchmark_data_smithi188_104537_object119556:head# 2024-04-01T19:36:17.844 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55edbe26:::benchmark_data_smithi188_104537_object156431:head# 2024-04-01T19:36:17.844 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ee397c:::benchmark_data_smithi188_104537_object111195:head# 2024-04-01T19:36:17.844 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ee62c5:::benchmark_data_smithi188_104537_object53871:head# 2024-04-01T19:36:17.845 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ee85d6:::benchmark_data_smithi188_104537_object121970:head# 2024-04-01T19:36:17.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55eeba00:::benchmark_data_smithi188_104537_object30713:head# 2024-04-01T19:36:17.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ef43ad:::benchmark_data_smithi188_104537_object92736:head# 2024-04-01T19:36:17.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55f08764:::benchmark_data_smithi188_104537_object61683:head# 2024-04-01T19:36:17.847 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55f10924:::benchmark_data_smithi188_104537_object146937:head# 2024-04-01T19:36:17.847 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55f14100:::benchmark_data_smithi188_104537_object51281:head# 2024-04-01T19:36:17.848 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55f1668f:::benchmark_data_smithi188_104537_object64978:head# 2024-04-01T19:36:17.848 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55f250b7:::benchmark_data_smithi188_104537_object125396:head# 2024-04-01T19:36:17.848 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55f283da:::benchmark_data_smithi188_104537_object132596:head# 2024-04-01T19:36:17.849 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55f28c38:::benchmark_data_smithi188_104537_object86942:head# 2024-04-01T19:36:17.849 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55f2bfea:::benchmark_data_smithi188_104537_object15946:head# 2024-04-01T19:36:17.850 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55f36109:::benchmark_data_smithi188_104537_object149058:head# 2024-04-01T19:36:17.850 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55f3989e:::benchmark_data_smithi188_104537_object158758:head# 2024-04-01T19:36:17.851 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55f4863f:::benchmark_data_smithi188_104537_object30529:head# 2024-04-01T19:36:17.851 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55f4e1e4:::benchmark_data_smithi188_104537_object124962:head# 2024-04-01T19:36:17.852 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55f4ea68:::benchmark_data_smithi188_104537_object46735:head# 2024-04-01T19:36:17.852 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55f5be81:::benchmark_data_smithi188_104537_object20880:head# 2024-04-01T19:36:17.853 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55f5e3dd:::benchmark_data_smithi188_104537_object69927:head# 2024-04-01T19:36:17.853 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55f73b50:::benchmark_data_smithi188_104537_object171266:head# 2024-04-01T19:36:17.854 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55f7d0c2:::benchmark_data_smithi188_104537_object51234:head# 2024-04-01T19:36:17.854 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55f82bcf:::benchmark_data_smithi188_104537_object92329:head# 2024-04-01T19:36:17.855 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55f862f0:::benchmark_data_smithi188_104537_object110296:head# 2024-04-01T19:36:17.855 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55f8a178:::benchmark_data_smithi188_104537_object34001:head# 2024-04-01T19:36:17.855 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55f8cbe4:::benchmark_data_smithi188_104537_object37236:head# 2024-04-01T19:36:17.856 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55f97c81:::benchmark_data_smithi188_104537_object27103:head# 2024-04-01T19:36:17.856 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55f9831a:::benchmark_data_smithi188_104537_object54379:head# 2024-04-01T19:36:17.857 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55f9f092:::benchmark_data_smithi188_104537_object85859:head# 2024-04-01T19:36:17.857 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55faf917:::benchmark_data_smithi188_104537_object121747:head# 2024-04-01T19:36:17.858 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55fbd099:::benchmark_data_smithi188_104537_object77037:head# 2024-04-01T19:36:17.858 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55fc9479:::benchmark_data_smithi188_104537_object100449:head# 2024-04-01T19:36:17.859 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55fca0f1:::benchmark_data_smithi188_104537_object55146:head# 2024-04-01T19:36:17.859 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55fce67c:::benchmark_data_smithi188_104537_object27129:head# 2024-04-01T19:36:17.859 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55fd151c:::benchmark_data_smithi188_104537_object102972:head# 2024-04-01T19:36:17.860 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55feb9d8:::benchmark_data_smithi188_104537_object69006:head# 2024-04-01T19:36:17.860 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55fef52c:::benchmark_data_smithi188_104537_object70222:head# 2024-04-01T19:36:17.861 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ff0631:::benchmark_data_smithi188_104537_object133341:head# 2024-04-01T19:36:17.861 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ff2246:::benchmark_data_smithi188_104537_object154235:head# 2024-04-01T19:36:17.862 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ff8906:::benchmark_data_smithi188_104537_object59336:head# 2024-04-01T19:36:17.862 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ffa149:::benchmark_data_smithi188_104537_object32490:head# 2024-04-01T19:36:17.863 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55ffa871:::benchmark_data_smithi188_104537_object41681:head# 2024-04-01T19:36:17.864 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:55fff776:::benchmark_data_smithi188_104537_object108001:head# 2024-04-01T19:36:17.864 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56001bd0:::benchmark_data_smithi188_104537_object100932:head# 2024-04-01T19:36:17.865 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:560048ff:::benchmark_data_smithi188_104537_object145774:head# 2024-04-01T19:36:17.865 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5600d5c5:::benchmark_data_smithi188_104537_object125390:head# 2024-04-01T19:36:17.866 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56024f9d:::benchmark_data_smithi188_104537_object95921:head# 2024-04-01T19:36:17.866 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5602534d:::benchmark_data_smithi188_104537_object75186:head# 2024-04-01T19:36:17.867 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56031421:::benchmark_data_smithi188_104537_object118250:head# 2024-04-01T19:36:17.867 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5603872b:::benchmark_data_smithi188_104537_object100248:head# 2024-04-01T19:36:17.867 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56044e16:::benchmark_data_smithi188_104537_object56077:head# 2024-04-01T19:36:17.868 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56049c36:::benchmark_data_smithi188_104537_object16316:head# 2024-04-01T19:36:17.868 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5604b862:::benchmark_data_smithi188_104537_object159040:head# 2024-04-01T19:36:17.869 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5604bb79:::benchmark_data_smithi188_104537_object72810:head# 2024-04-01T19:36:17.869 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5604d291:::benchmark_data_smithi188_104537_object71437:head# 2024-04-01T19:36:17.869 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5605250b:::benchmark_data_smithi188_104537_object171971:head# 2024-04-01T19:36:17.870 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56057b62:::benchmark_data_smithi188_104537_object135266:head# 2024-04-01T19:36:17.870 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:560610c7:::benchmark_data_smithi188_104537_object75158:head# 2024-04-01T19:36:17.871 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5606456f:::benchmark_data_smithi188_104537_object54533:head# 2024-04-01T19:36:17.871 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56066ab8:::benchmark_data_smithi188_104537_object54129:head# 2024-04-01T19:36:17.872 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5606c4c6:::benchmark_data_smithi188_104537_object63798:head# 2024-04-01T19:36:17.872 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5606e13e:::benchmark_data_smithi188_104537_object50284:head# 2024-04-01T19:36:17.873 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56071a27:::benchmark_data_smithi188_104537_object123088:head# 2024-04-01T19:36:17.873 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56071b52:::benchmark_data_smithi188_104537_object69800:head# 2024-04-01T19:36:17.873 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:560733f7:::benchmark_data_smithi188_104537_object129795:head# 2024-04-01T19:36:17.874 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5607b3d6:::benchmark_data_smithi188_104537_object121635:head# 2024-04-01T19:36:17.874 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5607e7c6:::benchmark_data_smithi188_104537_object25131:head# 2024-04-01T19:36:17.875 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5608aed0:::benchmark_data_smithi188_104537_object153970:head# 2024-04-01T19:36:17.875 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56095571:::benchmark_data_smithi188_104537_object40861:head# 2024-04-01T19:36:17.875 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5609971b:::benchmark_data_smithi188_104537_object146366:head# 2024-04-01T19:36:17.876 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:560a3738:::benchmark_data_smithi188_104537_object60255:head# 2024-04-01T19:36:17.877 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:560a73f5:::benchmark_data_smithi188_104537_object18018:head# 2024-04-01T19:36:17.877 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:560ae535:::benchmark_data_smithi188_104537_object43283:head# 2024-04-01T19:36:17.878 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:560b087e:::benchmark_data_smithi188_104537_object35768:head# 2024-04-01T19:36:17.878 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:560cbd91:::benchmark_data_smithi188_104537_object12162:head# 2024-04-01T19:36:17.879 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:560dae66:::benchmark_data_smithi188_104537_object36768:head# 2024-04-01T19:36:17.879 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:560db363:::benchmark_data_smithi188_104537_object118840:head# 2024-04-01T19:36:17.879 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:560df48c:::benchmark_data_smithi188_104537_object95784:head# 2024-04-01T19:36:17.880 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:560e1003:::benchmark_data_smithi188_104537_object68934:head# 2024-04-01T19:36:17.880 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:560e35b5:::benchmark_data_smithi188_104537_object55294:head# 2024-04-01T19:36:17.881 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:560ea407:::benchmark_data_smithi188_104537_object115886:head# 2024-04-01T19:36:17.881 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:560f2d85:::benchmark_data_smithi188_104537_object160301:head# 2024-04-01T19:36:17.882 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:560f6919:::benchmark_data_smithi188_104537_object112986:head# 2024-04-01T19:36:17.882 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:561101c7:::benchmark_data_smithi188_104537_object64549:head# 2024-04-01T19:36:17.883 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5611e569:::benchmark_data_smithi188_104537_object151964:head# 2024-04-01T19:36:17.883 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5612351b:::benchmark_data_smithi188_104537_object162302:head# 2024-04-01T19:36:17.884 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5612390c:::benchmark_data_smithi188_104537_object136927:head# 2024-04-01T19:36:17.884 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5612c193:::benchmark_data_smithi188_104537_object57890:head# 2024-04-01T19:36:17.885 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5612f1f1:::benchmark_data_smithi188_104537_object117714:head# 2024-04-01T19:36:17.885 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56131634:::benchmark_data_smithi188_104537_object16871:head# 2024-04-01T19:36:17.886 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:561354ff:::benchmark_data_smithi188_104537_object118594:head# 2024-04-01T19:36:17.886 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56135913:::benchmark_data_smithi188_104537_object16816:head# 2024-04-01T19:36:17.886 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5614e864:::benchmark_data_smithi188_104537_object79772:head# 2024-04-01T19:36:17.887 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56156272:::benchmark_data_smithi188_104537_object87389:head# 2024-04-01T19:36:17.887 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56157d07:::benchmark_data_smithi188_104537_object23118:head# 2024-04-01T19:36:17.888 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5616c896:::benchmark_data_smithi188_104537_object40939:head# 2024-04-01T19:36:17.888 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5617285c:::benchmark_data_smithi188_104537_object35116:head# 2024-04-01T19:36:17.888 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56176afb:::benchmark_data_smithi188_104537_object154516:head# 2024-04-01T19:36:17.889 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5617b77c:::benchmark_data_smithi188_104537_object118574:head# 2024-04-01T19:36:17.889 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56185762:::benchmark_data_smithi188_104537_object46670:head# 2024-04-01T19:36:17.890 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56191d64:::benchmark_data_smithi188_104537_object134868:head# 2024-04-01T19:36:17.890 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56194012:::benchmark_data_smithi188_104537_object44741:head# 2024-04-01T19:36:17.892 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:561b1599:::benchmark_data_smithi188_104537_object86138:head# 2024-04-01T19:36:17.892 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:561b9ef4:::benchmark_data_smithi188_104537_object139698:head# 2024-04-01T19:36:17.893 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:561bec32:::benchmark_data_smithi188_104537_object25363:head# 2024-04-01T19:36:17.893 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:561c0659:::benchmark_data_smithi188_104537_object95195:head# 2024-04-01T19:36:17.893 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:561c7b82:::benchmark_data_smithi188_104537_object169130:head# 2024-04-01T19:36:17.894 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:561cfaa8:::benchmark_data_smithi188_104537_object41140:head# 2024-04-01T19:36:17.894 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:561e5d51:::benchmark_data_smithi188_104537_object45302:head# 2024-04-01T19:36:17.895 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:561ebd4c:::benchmark_data_smithi188_104537_object156750:head# 2024-04-01T19:36:17.895 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:561f2fb0:::benchmark_data_smithi188_104537_object156538:head# 2024-04-01T19:36:17.895 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:561f8577:::benchmark_data_smithi188_104537_object82325:head# 2024-04-01T19:36:17.896 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:561fa595:::benchmark_data_smithi188_104537_object47180:head# 2024-04-01T19:36:17.896 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:562013f0:::benchmark_data_smithi188_104537_object81733:head# 2024-04-01T19:36:17.897 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56207316:::benchmark_data_smithi188_104537_object113866:head# 2024-04-01T19:36:17.897 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5621cf83:::benchmark_data_smithi188_104537_object38130:head# 2024-04-01T19:36:17.898 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5621e8ae:::benchmark_data_smithi188_104537_object42019:head# 2024-04-01T19:36:17.898 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5621ff99:::benchmark_data_smithi188_104537_object75630:head# 2024-04-01T19:36:17.899 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56229328:::benchmark_data_smithi188_104537_object13206:head# 2024-04-01T19:36:17.899 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56235318:::benchmark_data_smithi188_104537_object20640:head# 2024-04-01T19:36:17.899 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5623978a:::benchmark_data_smithi188_104537_object60445:head# 2024-04-01T19:36:17.900 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5623c13a:::benchmark_data_smithi188_104537_object146557:head# 2024-04-01T19:36:17.900 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56244f23:::benchmark_data_smithi188_104537_object136089:head# 2024-04-01T19:36:17.901 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56258759:::benchmark_data_smithi188_104537_object37855:head# 2024-04-01T19:36:17.901 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5625c3b3:::benchmark_data_smithi188_104537_object68899:head# 2024-04-01T19:36:17.902 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5625ed43:::benchmark_data_smithi188_104537_object64039:head# 2024-04-01T19:36:17.902 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56274c0b:::benchmark_data_smithi188_104537_object47020:head# 2024-04-01T19:36:17.903 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5627cdfc:::benchmark_data_smithi188_104537_object39694:head# 2024-04-01T19:36:17.903 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5627ec8f:::benchmark_data_smithi188_104537_object35576:head# 2024-04-01T19:36:17.904 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5627f317:::benchmark_data_smithi188_104537_object92550:head# 2024-04-01T19:36:17.904 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:562840d3:::benchmark_data_smithi188_104537_object70186:head# 2024-04-01T19:36:17.905 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:562844c3:::benchmark_data_smithi188_104537_object102587:head# 2024-04-01T19:36:17.905 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:562871e5:::benchmark_data_smithi188_104537_object171990:head# 2024-04-01T19:36:17.906 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56289f16:::benchmark_data_smithi188_104537_object145770:head# 2024-04-01T19:36:17.906 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56290170:::benchmark_data_smithi188_104537_object12848:head# 2024-04-01T19:36:17.906 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56299171:::benchmark_data_smithi188_104537_object142464:head# 2024-04-01T19:36:17.907 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:562a6fca:::benchmark_data_smithi188_104537_object35539:head# 2024-04-01T19:36:17.907 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:562b6a57:::benchmark_data_smithi188_104537_object50023:head# 2024-04-01T19:36:17.908 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:562cae9a:::benchmark_data_smithi188_104537_object159275:head# 2024-04-01T19:36:17.908 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:562cb748:::benchmark_data_smithi188_104537_object42997:head# 2024-04-01T19:36:17.909 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:562cc414:::benchmark_data_smithi188_104537_object67865:head# 2024-04-01T19:36:17.909 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:562cfcb4:::benchmark_data_smithi188_104537_object38852:head# 2024-04-01T19:36:17.910 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:562d21a4:::benchmark_data_smithi188_104537_object160099:head# 2024-04-01T19:36:17.910 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:562d810f:::benchmark_data_smithi188_104537_object61602:head# 2024-04-01T19:36:17.911 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:562dc3d7:::benchmark_data_smithi188_104537_object106644:head# 2024-04-01T19:36:17.911 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:562dcb3c:::benchmark_data_smithi188_104537_object142049:head# 2024-04-01T19:36:17.911 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:562df4d6:::benchmark_data_smithi188_104537_object96034:head# 2024-04-01T19:36:17.912 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:562e132b:::benchmark_data_smithi188_104537_object28054:head# 2024-04-01T19:36:17.912 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:562e383f:::benchmark_data_smithi188_104537_object76856:head# 2024-04-01T19:36:17.913 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:562f962e:::benchmark_data_smithi188_104537_object101373:head# 2024-04-01T19:36:17.913 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5630521c:::benchmark_data_smithi188_104537_object134452:head# 2024-04-01T19:36:17.914 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5630ccf8:::benchmark_data_smithi188_104537_object112113:head# 2024-04-01T19:36:17.914 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5630dde4:::benchmark_data_smithi188_104537_object170419:head# 2024-04-01T19:36:17.914 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5630e1ce:::benchmark_data_smithi188_104537_object165854:head# 2024-04-01T19:36:17.915 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:563363a7:::benchmark_data_smithi188_104537_object17832:head# 2024-04-01T19:36:17.915 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5633b673:::benchmark_data_smithi188_104537_object72646:head# 2024-04-01T19:36:17.915 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5633be34:::benchmark_data_smithi188_104537_object112669:head# 2024-04-01T19:36:17.916 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5633cb47:::benchmark_data_smithi188_104537_object88044:head# 2024-04-01T19:36:17.917 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5633df58:::benchmark_data_smithi188_104537_object85231:head# 2024-04-01T19:36:17.917 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:563476ee:::benchmark_data_smithi188_104537_object126530:head# 2024-04-01T19:36:17.918 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56347948:::benchmark_data_smithi188_104537_object37277:head# 2024-04-01T19:36:17.918 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:563513a2:::benchmark_data_smithi188_104537_object137703:head# 2024-04-01T19:36:17.918 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56351a0c:::benchmark_data_smithi188_104537_object123748:head# 2024-04-01T19:36:17.919 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56355f7a:::benchmark_data_smithi188_104537_object110412:head# 2024-04-01T19:36:17.919 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56357052:::benchmark_data_smithi188_104537_object122644:head# 2024-04-01T19:36:17.919 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5635f3ab:::benchmark_data_smithi188_104537_object93641:head# 2024-04-01T19:36:17.920 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5636aac5:::benchmark_data_smithi188_104537_object146776:head# 2024-04-01T19:36:17.920 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56370d41:::benchmark_data_smithi188_104537_object54436:head# 2024-04-01T19:36:17.920 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56378272:::benchmark_data_smithi188_104537_object80197:head# 2024-04-01T19:36:17.921 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56379702:::benchmark_data_smithi188_104537_object150493:head# 2024-04-01T19:36:17.921 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5637ad3f:::benchmark_data_smithi188_104537_object100108:head# 2024-04-01T19:36:17.922 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56386bd4:::benchmark_data_smithi188_104537_object104283:head# 2024-04-01T19:36:17.922 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56388968:::benchmark_data_smithi188_104537_object68520:head# 2024-04-01T19:36:17.923 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56388e90:::benchmark_data_smithi188_104537_object97229:head# 2024-04-01T19:36:17.924 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56390322:::benchmark_data_smithi188_104537_object75185:head# 2024-04-01T19:36:17.924 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56390b8c:::benchmark_data_smithi188_104537_object31630:head# 2024-04-01T19:36:17.924 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:563929f3:::benchmark_data_smithi188_104537_object70555:head# 2024-04-01T19:36:17.925 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56394e64:::benchmark_data_smithi188_104537_object42459:head# 2024-04-01T19:36:17.925 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56396340:::benchmark_data_smithi188_104537_object139736:head# 2024-04-01T19:36:17.925 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56396656:::benchmark_data_smithi188_104537_object20002:head# 2024-04-01T19:36:17.926 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5639752e:::benchmark_data_smithi188_104537_object68584:head# 2024-04-01T19:36:17.926 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:563acdc3:::benchmark_data_smithi188_104537_object23023:head# 2024-04-01T19:36:17.927 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:563ad1f0:::benchmark_data_smithi188_104537_object103741:head# 2024-04-01T19:36:17.927 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:563b5796:::benchmark_data_smithi188_104537_object121508:head# 2024-04-01T19:36:17.928 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:563b7865:::benchmark_data_smithi188_104537_object16613:head# 2024-04-01T19:36:17.928 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:563bbe3b:::benchmark_data_smithi188_104537_object131866:head# 2024-04-01T19:36:17.929 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:563bff3c:::benchmark_data_smithi188_104537_object37321:head# 2024-04-01T19:36:17.929 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:563c1ba9:::benchmark_data_smithi188_104537_object165418:head# 2024-04-01T19:36:17.930 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:563c2ac1:::benchmark_data_smithi188_104537_object119673:head# 2024-04-01T19:36:17.930 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:563dd452:::benchmark_data_smithi188_104537_object61513:head# 2024-04-01T19:36:17.930 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:563de5d7:::benchmark_data_smithi188_104537_object110142:head# 2024-04-01T19:36:17.931 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:563ea7f9:::benchmark_data_smithi188_104537_object40420:head# 2024-04-01T19:36:17.931 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:563f7991:::benchmark_data_smithi188_104537_object51166:head# 2024-04-01T19:36:17.932 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56409246:::benchmark_data_smithi188_104537_object151458:head# 2024-04-01T19:36:17.932 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56410ad3:::benchmark_data_smithi188_104537_object87438:head# 2024-04-01T19:36:17.933 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5641338e:::benchmark_data_smithi188_104537_object135072:head# 2024-04-01T19:36:17.933 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56423122:::benchmark_data_smithi188_104537_object42959:head# 2024-04-01T19:36:17.933 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5642502e:::benchmark_data_smithi188_104537_object141264:head# 2024-04-01T19:36:17.934 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:564268b5:::benchmark_data_smithi188_104537_object127435:head# 2024-04-01T19:36:17.934 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56430dd5:::benchmark_data_smithi188_104537_object20785:head# 2024-04-01T19:36:17.935 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5643eb57:::benchmark_data_smithi188_104537_object38497:head# 2024-04-01T19:36:17.935 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:564503c3:::benchmark_data_smithi188_104537_object27948:head# 2024-04-01T19:36:17.936 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:564576f0:::benchmark_data_smithi188_104537_object106934:head# 2024-04-01T19:36:17.936 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5645a308:::benchmark_data_smithi188_104537_object146591:head# 2024-04-01T19:36:17.936 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5645b5cc:::benchmark_data_smithi188_104537_object42375:head# 2024-04-01T19:36:17.937 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5645bb31:::benchmark_data_smithi188_104537_object35832:head# 2024-04-01T19:36:17.937 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5645e8d7:::benchmark_data_smithi188_104537_object75522:head# 2024-04-01T19:36:17.938 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56472b6e:::benchmark_data_smithi188_104537_object75123:head# 2024-04-01T19:36:17.938 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56479b06:::benchmark_data_smithi188_104537_object86231:head# 2024-04-01T19:36:17.939 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:564806b3:::benchmark_data_smithi188_104537_object71012:head# 2024-04-01T19:36:17.939 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56481973:::benchmark_data_smithi188_104537_object95042:head# 2024-04-01T19:36:17.940 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5648bdc8:::benchmark_data_smithi188_104537_object56744:head# 2024-04-01T19:36:17.940 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56490146:::benchmark_data_smithi188_104537_object53984:head# 2024-04-01T19:36:17.941 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5649fefb:::benchmark_data_smithi188_104537_object93820:head# 2024-04-01T19:36:17.941 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:564c65b6:::benchmark_data_smithi188_104537_object123659:head# 2024-04-01T19:36:17.941 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:564c76fb:::benchmark_data_smithi188_104537_object132589:head# 2024-04-01T19:36:17.942 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:564cb2a1:::benchmark_data_smithi188_104537_object47414:head# 2024-04-01T19:36:17.943 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:564dbfe5:::benchmark_data_smithi188_104537_object16852:head# 2024-04-01T19:36:17.943 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:564f04db:::benchmark_data_smithi188_104537_object111889:head# 2024-04-01T19:36:17.944 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:564f17a6:::benchmark_data_smithi188_104537_object22265:head# 2024-04-01T19:36:17.944 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:564f34ee:::benchmark_data_smithi188_104537_object148534:head# 2024-04-01T19:36:17.945 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:564f52e6:::benchmark_data_smithi188_104537_object71957:head# 2024-04-01T19:36:17.945 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:564f7a34:::benchmark_data_smithi188_104537_object96773:head# 2024-04-01T19:36:17.946 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:564fa703:::benchmark_data_smithi188_104537_object99770:head# 2024-04-01T19:36:17.946 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:564faeac:::benchmark_data_smithi188_104537_object163101:head# 2024-04-01T19:36:17.947 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56505ddb:::benchmark_data_smithi188_104537_object46138:head# 2024-04-01T19:36:17.947 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5650714a:::benchmark_data_smithi188_104537_object108374:head# 2024-04-01T19:36:17.948 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5650bf91:::benchmark_data_smithi188_104537_object51823:head# 2024-04-01T19:36:17.948 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56512867:::benchmark_data_smithi188_104537_object119233:head# 2024-04-01T19:36:17.948 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56521185:::benchmark_data_smithi188_104537_object163227:head# 2024-04-01T19:36:17.949 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5652119d:::benchmark_data_smithi188_104537_object87266:head# 2024-04-01T19:36:17.949 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:565227f5:::benchmark_data_smithi188_104537_object151892:head# 2024-04-01T19:36:17.950 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56545771:::benchmark_data_smithi188_104537_object74313:head# 2024-04-01T19:36:17.950 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56554ea9:::benchmark_data_smithi188_104537_object74773:head# 2024-04-01T19:36:17.951 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5655571f:::benchmark_data_smithi188_104537_object107941:head# 2024-04-01T19:36:17.951 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56555a3c:::benchmark_data_smithi188_104537_object161977:head# 2024-04-01T19:36:17.952 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56556615:::benchmark_data_smithi188_104537_object118859:head# 2024-04-01T19:36:17.952 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5655adb8:::benchmark_data_smithi188_104537_object113537:head# 2024-04-01T19:36:17.953 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56564cb6:::benchmark_data_smithi188_104537_object113990:head# 2024-04-01T19:36:17.953 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:565660a1:::benchmark_data_smithi188_104537_object42015:head# 2024-04-01T19:36:17.954 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:565689ff:::benchmark_data_smithi188_104537_object135833:head# 2024-04-01T19:36:17.954 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5657c266:::benchmark_data_smithi188_104537_object137330:head# 2024-04-01T19:36:17.955 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5657e91f:::benchmark_data_smithi188_104537_object146059:head# 2024-04-01T19:36:17.955 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56592415:::benchmark_data_smithi188_104537_object28103:head# 2024-04-01T19:36:17.956 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:565977e5:::benchmark_data_smithi188_104537_object90323:head# 2024-04-01T19:36:17.957 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5659d95f:::benchmark_data_smithi188_104537_object72233:head# 2024-04-01T19:36:17.957 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:565a1788:::benchmark_data_smithi188_104537_object89830:head# 2024-04-01T19:36:17.959 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:565a1883:::benchmark_data_smithi188_104537_object130187:head# 2024-04-01T19:36:17.959 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:565a1ebf:::benchmark_data_smithi188_104537_object108722:head# 2024-04-01T19:36:17.959 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:565a1fd7:::benchmark_data_smithi188_104537_object56217:head# 2024-04-01T19:36:17.960 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:565ac8f5:::benchmark_data_smithi188_104537_object65667:head# 2024-04-01T19:36:17.961 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:565aee7d:::benchmark_data_smithi188_104537_object45205:head# 2024-04-01T19:36:17.961 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:565b5b96:::benchmark_data_smithi188_104537_object93757:head# 2024-04-01T19:36:17.962 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:565bf9d2:::benchmark_data_smithi188_104537_object141315:head# 2024-04-01T19:36:17.962 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:565c827b:::benchmark_data_smithi188_104537_object118043:head# 2024-04-01T19:36:17.962 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:565cb6c5:::benchmark_data_smithi188_104537_object18551:head# 2024-04-01T19:36:17.963 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:565d3c21:::benchmark_data_smithi188_104537_object94932:head# 2024-04-01T19:36:17.963 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:565da8a9:::benchmark_data_smithi188_104537_object133849:head# 2024-04-01T19:36:17.964 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:565e45a3:::benchmark_data_smithi188_104537_object34777:head# 2024-04-01T19:36:17.964 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:565eadda:::benchmark_data_smithi188_104537_object155893:head# 2024-04-01T19:36:17.965 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:565ff207:::benchmark_data_smithi188_104537_object13840:head# 2024-04-01T19:36:17.965 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56602e42:::benchmark_data_smithi188_104537_object77549:head# 2024-04-01T19:36:17.965 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56604341:::benchmark_data_smithi188_104537_object87453:head# 2024-04-01T19:36:17.966 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5661853a:::benchmark_data_smithi188_104537_object96577:head# 2024-04-01T19:36:17.967 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5661fa5a:::benchmark_data_smithi188_104537_object90202:head# 2024-04-01T19:36:17.967 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5661fed0:::benchmark_data_smithi188_104537_object75031:head# 2024-04-01T19:36:17.968 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56638ff3:::benchmark_data_smithi188_104537_object107494:head# 2024-04-01T19:36:17.968 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5663afe1:::benchmark_data_smithi188_104537_object78970:head# 2024-04-01T19:36:17.969 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56640811:::benchmark_data_smithi188_104537_object54392:head# 2024-04-01T19:36:17.969 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56646543:::benchmark_data_smithi188_104537_object102265:head# 2024-04-01T19:36:17.970 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56646624:::benchmark_data_smithi188_104537_object128870:head# 2024-04-01T19:36:17.971 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5664cf5b:::benchmark_data_smithi188_104537_object35949:head# 2024-04-01T19:36:17.971 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5665eb39:::benchmark_data_smithi188_104537_object159226:head# 2024-04-01T19:36:17.971 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56683bf1:::benchmark_data_smithi188_104537_object16315:head# 2024-04-01T19:36:17.972 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56691608:::benchmark_data_smithi188_104537_object148277:head# 2024-04-01T19:36:17.972 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5669a5f1:::benchmark_data_smithi188_104537_object98125:head# 2024-04-01T19:36:17.972 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:566add64:::benchmark_data_smithi188_104537_object38698:head# 2024-04-01T19:36:17.973 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:566b25ce:::benchmark_data_smithi188_104537_object35807:head# 2024-04-01T19:36:17.973 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:566ba1a4:::benchmark_data_smithi188_104537_object131031:head# 2024-04-01T19:36:17.974 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:566bd77e:::benchmark_data_smithi188_104537_object90480:head# 2024-04-01T19:36:17.974 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:566bf4ff:::benchmark_data_smithi188_104537_object11592:head# 2024-04-01T19:36:17.975 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:566bf5eb:::benchmark_data_smithi188_104537_object92044:head# 2024-04-01T19:36:17.975 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:566c3b31:::benchmark_data_smithi188_104537_object29722:head# 2024-04-01T19:36:17.976 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:566c6396:::benchmark_data_smithi188_104537_object54673:head# 2024-04-01T19:36:17.976 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:566ce27a:::benchmark_data_smithi188_104537_object105813:head# 2024-04-01T19:36:17.977 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:566d0b52:::benchmark_data_smithi188_104537_object73264:head# 2024-04-01T19:36:17.977 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:566db42c:::benchmark_data_smithi188_104537_object109209:head# 2024-04-01T19:36:17.978 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:566edc99:::benchmark_data_smithi188_104537_object158879:head# 2024-04-01T19:36:17.978 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:566f5bd6:::benchmark_data_smithi188_104537_object28912:head# 2024-04-01T19:36:17.978 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56708aaa:::benchmark_data_smithi188_104537_object35581:head# 2024-04-01T19:36:17.979 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5670b252:::benchmark_data_smithi188_104537_object53747:head# 2024-04-01T19:36:17.979 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5670c038:::benchmark_data_smithi188_104537_object131392:head# 2024-04-01T19:36:17.980 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5670e220:::benchmark_data_smithi188_104537_object88805:head# 2024-04-01T19:36:17.981 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5671a024:::benchmark_data_smithi188_104537_object110586:head# 2024-04-01T19:36:17.981 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5671c95d:::benchmark_data_smithi188_104537_object108366:head# 2024-04-01T19:36:17.982 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:567318da:::benchmark_data_smithi188_104537_object37614:head# 2024-04-01T19:36:17.988 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5673dd7d:::benchmark_data_smithi188_104537_object77793:head# 2024-04-01T19:36:17.988 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5674a58c:::benchmark_data_smithi188_104537_object170659:head# 2024-04-01T19:36:17.988 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:567503ca:::benchmark_data_smithi188_104537_object105158:head# 2024-04-01T19:36:17.988 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56751d1c:::benchmark_data_smithi188_104537_object136865:head# 2024-04-01T19:36:17.988 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56754bc9:::benchmark_data_smithi188_104537_object94712:head# 2024-04-01T19:36:17.988 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5675638c:::benchmark_data_smithi188_104537_object11275:head# 2024-04-01T19:36:17.988 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56768c81:::benchmark_data_smithi188_104537_object85644:head# 2024-04-01T19:36:17.988 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:567765e0:::benchmark_data_smithi188_104537_object129726:head# 2024-04-01T19:36:17.988 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5677b02e:::benchmark_data_smithi188_104537_object167748:head# 2024-04-01T19:36:17.989 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5677c338:::benchmark_data_smithi188_104537_object21628:head# 2024-04-01T19:36:17.989 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5677f4a7:::benchmark_data_smithi188_104537_object19230:head# 2024-04-01T19:36:17.989 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56781bcc:::benchmark_data_smithi188_104537_object33833:head# 2024-04-01T19:36:17.989 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56784aaf:::benchmark_data_smithi188_104537_object110915:head# 2024-04-01T19:36:17.989 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5678818f:::benchmark_data_smithi188_104537_object31902:head# 2024-04-01T19:36:17.989 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5678a52e:::benchmark_data_smithi188_104537_object108677:head# 2024-04-01T19:36:17.990 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56793d95:::benchmark_data_smithi188_104537_object168460:head# 2024-04-01T19:36:17.990 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56794d3b:::benchmark_data_smithi188_104537_object95342:head# 2024-04-01T19:36:17.991 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5679bccf:::benchmark_data_smithi188_104537_object162174:head# 2024-04-01T19:36:17.991 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:567a1987:::benchmark_data_smithi188_104537_object123742:head# 2024-04-01T19:36:17.992 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:567a2f7c:::benchmark_data_smithi188_104537_object158152:head# 2024-04-01T19:36:17.992 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:567a4825:::benchmark_data_smithi188_104537_object19516:head# 2024-04-01T19:36:17.992 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:567b12b3:::benchmark_data_smithi188_104537_object150176:head# 2024-04-01T19:36:17.993 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:567b2e12:::benchmark_data_smithi188_104537_object103900:head# 2024-04-01T19:36:17.993 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:567bb725:::benchmark_data_smithi188_104537_object142938:head# 2024-04-01T19:36:17.994 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:567c076d:::benchmark_data_smithi188_104537_object14945:head# 2024-04-01T19:36:17.994 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:567c2974:::benchmark_data_smithi188_104537_object137873:head# 2024-04-01T19:36:17.995 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:567c6389:::benchmark_data_smithi188_104537_object169167:head# 2024-04-01T19:36:17.995 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:567ccfba:::benchmark_data_smithi188_104537_object54952:head# 2024-04-01T19:36:17.996 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:567cff3e:::benchmark_data_smithi188_104537_object95498:head# 2024-04-01T19:36:17.996 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:567d0033:::benchmark_data_smithi188_104537_object93094:head# 2024-04-01T19:36:17.996 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:567d2be1:::benchmark_data_smithi188_104537_object55228:head# 2024-04-01T19:36:17.997 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:567d6a43:::benchmark_data_smithi188_104537_object121517:head# 2024-04-01T19:36:17.997 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:567ddde6:::benchmark_data_smithi188_104537_object21096:head# 2024-04-01T19:36:17.998 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:567e2551:::benchmark_data_smithi188_104537_object13533:head# 2024-04-01T19:36:17.998 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:567e5d3e:::benchmark_data_smithi188_104537_object124193:head# 2024-04-01T19:36:17.999 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:567f0161:::benchmark_data_smithi188_104537_object29300:head# 2024-04-01T19:36:17.999 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:567f0870:::benchmark_data_smithi188_104537_object150625:head# 2024-04-01T19:36:17.999 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:567f68fa:::benchmark_data_smithi188_104537_object110478:head# 2024-04-01T19:36:18.000 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:567f90d5:::benchmark_data_smithi188_104537_object109940:head# 2024-04-01T19:36:18.000 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:567fc298:::benchmark_data_smithi188_104537_object19469:head# 2024-04-01T19:36:18.001 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56811925:::benchmark_data_smithi188_104537_object63662:head# 2024-04-01T19:36:18.001 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:568157c0:::benchmark_data_smithi188_104537_object167631:head# 2024-04-01T19:36:18.002 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56818e83:::benchmark_data_smithi188_104537_object45539:head# 2024-04-01T19:36:18.002 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56820c97:::benchmark_data_smithi188_104537_object27824:head# 2024-04-01T19:36:18.003 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56823f73:::benchmark_data_smithi188_104537_object59251:head# 2024-04-01T19:36:18.003 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:568283e3:::benchmark_data_smithi188_104537_object71127:head# 2024-04-01T19:36:18.003 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5682ca68:::benchmark_data_smithi188_104537_object17855:head# 2024-04-01T19:36:18.004 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5682d808:::benchmark_data_smithi188_104537_object51592:head# 2024-04-01T19:36:18.004 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5683028d:::benchmark_data_smithi188_104537_object85255:head# 2024-04-01T19:36:18.005 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56834273:::benchmark_data_smithi188_104537_object86641:head# 2024-04-01T19:36:18.005 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56837a7f:::benchmark_data_smithi188_104537_object31289:head# 2024-04-01T19:36:18.006 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56837f2c:::benchmark_data_smithi188_104537_object41265:head# 2024-04-01T19:36:18.006 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:568478ca:::benchmark_data_smithi188_104537_object47178:head# 2024-04-01T19:36:18.006 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5684ead4:::benchmark_data_smithi188_104537_object164562:head# 2024-04-01T19:36:18.007 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5685a442:::benchmark_data_smithi188_104537_object107551:head# 2024-04-01T19:36:18.007 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5685d87f:::benchmark_data_smithi188_104537_object160931:head# 2024-04-01T19:36:18.008 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:568696d9:::benchmark_data_smithi188_104537_object141170:head# 2024-04-01T19:36:18.008 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5686fd55:::benchmark_data_smithi188_104537_object137090:head# 2024-04-01T19:36:18.009 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:568723fd:::benchmark_data_smithi188_104537_object12053:head# 2024-04-01T19:36:18.009 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5687bdbf:::benchmark_data_smithi188_104537_object147220:head# 2024-04-01T19:36:18.010 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56880eea:::benchmark_data_smithi188_104537_object94055:head# 2024-04-01T19:36:18.010 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56881ef1:::benchmark_data_smithi188_104537_object87865:head# 2024-04-01T19:36:18.010 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:568838ec:::benchmark_data_smithi188_104537_object146007:head# 2024-04-01T19:36:18.011 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5688576e:::benchmark_data_smithi188_104537_object119198:head# 2024-04-01T19:36:18.011 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:568894c5:::benchmark_data_smithi188_104537_object150429:head# 2024-04-01T19:36:18.012 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5688ef9f:::benchmark_data_smithi188_104537_object45612:head# 2024-04-01T19:36:18.012 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:568905ed:::benchmark_data_smithi188_104537_object151927:head# 2024-04-01T19:36:18.013 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56890aa4:::benchmark_data_smithi188_104537_object91835:head# 2024-04-01T19:36:18.013 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56896770:::benchmark_data_smithi188_104537_object114366:head# 2024-04-01T19:36:18.014 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5689890c:::benchmark_data_smithi188_104537_object125151:head# 2024-04-01T19:36:18.014 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56899c76:::benchmark_data_smithi188_104537_object136416:head# 2024-04-01T19:36:18.015 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5689eab2:::benchmark_data_smithi188_104537_object121045:head# 2024-04-01T19:36:18.015 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:568a5a8a:::benchmark_data_smithi188_104537_object47172:head# 2024-04-01T19:36:18.015 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:568b4e30:::benchmark_data_smithi188_104537_object40468:head# 2024-04-01T19:36:18.016 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:568b81a4:::benchmark_data_smithi188_104537_object75581:head# 2024-04-01T19:36:18.016 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:568c83c6:::benchmark_data_smithi188_104537_object30836:head# 2024-04-01T19:36:18.017 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:568cab19:::benchmark_data_smithi188_104537_object117242:head# 2024-04-01T19:36:18.017 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:568cdee3:::benchmark_data_smithi188_104537_object116743:head# 2024-04-01T19:36:18.018 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:568e3431:::benchmark_data_smithi188_104537_object95550:head# 2024-04-01T19:36:18.018 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:568e54d0:::benchmark_data_smithi188_104537_object110514:head# 2024-04-01T19:36:18.018 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:568e72be:::benchmark_data_smithi188_104537_object61144:head# 2024-04-01T19:36:18.019 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:568e7d29:::benchmark_data_smithi188_104537_object113639:head# 2024-04-01T19:36:18.019 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:568f1e2f:::benchmark_data_smithi188_104537_object123260:head# 2024-04-01T19:36:18.020 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:568f2a1b:::benchmark_data_smithi188_104537_object155306:head# 2024-04-01T19:36:18.020 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:568f4b0d:::benchmark_data_smithi188_104537_object104689:head# 2024-04-01T19:36:18.020 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:569002ca:::benchmark_data_smithi188_104537_object130973:head# 2024-04-01T19:36:18.021 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56900ef8:::benchmark_data_smithi188_104537_object136706:head# 2024-04-01T19:36:18.021 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5690b62f:::benchmark_data_smithi188_104537_object18468:head# 2024-04-01T19:36:18.022 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5692233e:::benchmark_data_smithi188_104537_object81717:head# 2024-04-01T19:36:18.022 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5692974d:::benchmark_data_smithi188_104537_object159443:head# 2024-04-01T19:36:18.023 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5692d967:::benchmark_data_smithi188_104537_object67274:head# 2024-04-01T19:36:18.023 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5693a071:::benchmark_data_smithi188_104537_object138163:head# 2024-04-01T19:36:18.023 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5693ac60:::benchmark_data_smithi188_104537_object55463:head# 2024-04-01T19:36:18.024 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5693d791:::benchmark_data_smithi188_104537_object50721:head# 2024-04-01T19:36:18.024 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5693dce1:::benchmark_data_smithi188_104537_object64770:head# 2024-04-01T19:36:18.025 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5694930d:::benchmark_data_smithi188_104537_object76551:head# 2024-04-01T19:36:18.025 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5694b34b:::benchmark_data_smithi188_104537_object54964:head# 2024-04-01T19:36:18.025 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5694e6b7:::benchmark_data_smithi188_104537_object45003:head# 2024-04-01T19:36:18.026 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56950056:::benchmark_data_smithi188_104537_object87849:head# 2024-04-01T19:36:18.026 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56950144:::benchmark_data_smithi188_104537_object115028:head# 2024-04-01T19:36:18.027 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56951199:::benchmark_data_smithi188_104537_object132347:head# 2024-04-01T19:36:18.027 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5695aa3d:::benchmark_data_smithi188_104537_object46790:head# 2024-04-01T19:36:18.028 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5695cd02:::benchmark_data_smithi188_104537_object147935:head# 2024-04-01T19:36:18.028 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5695ec15:::benchmark_data_smithi188_104537_object38162:head# 2024-04-01T19:36:18.029 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:569608a3:::benchmark_data_smithi188_104537_object122187:head# 2024-04-01T19:36:18.029 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:569630a5:::benchmark_data_smithi188_104537_object36924:head# 2024-04-01T19:36:18.030 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56967394:::benchmark_data_smithi188_104537_object55627:head# 2024-04-01T19:36:18.030 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5696b624:::benchmark_data_smithi188_104537_object32211:head# 2024-04-01T19:36:18.031 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5696bf4c:::benchmark_data_smithi188_104537_object42885:head# 2024-04-01T19:36:18.031 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5696c16a:::benchmark_data_smithi188_104537_object106200:head# 2024-04-01T19:36:18.031 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5697e637:::benchmark_data_smithi188_104537_object143608:head# 2024-04-01T19:36:18.032 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5698c421:::benchmark_data_smithi188_104537_object40806:head# 2024-04-01T19:36:18.032 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5698c432:::benchmark_data_smithi188_104537_object20359:head# 2024-04-01T19:36:18.033 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5698fd13:::benchmark_data_smithi188_104537_object27869:head# 2024-04-01T19:36:18.033 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5699043d:::benchmark_data_smithi188_104537_object54808:head# 2024-04-01T19:36:18.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5699fd03:::benchmark_data_smithi188_104537_object166394:head# 2024-04-01T19:36:18.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:569a04fc:::benchmark_data_smithi188_104537_object144199:head# 2024-04-01T19:36:18.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:569a8ba6:::benchmark_data_smithi188_104537_object66455:head# 2024-04-01T19:36:18.035 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:569aab27:::benchmark_data_smithi188_104537_object97633:head# 2024-04-01T19:36:18.035 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:569abedc:::benchmark_data_smithi188_104537_object95863:head# 2024-04-01T19:36:18.036 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:569bb66b:::benchmark_data_smithi188_104537_object124876:head# 2024-04-01T19:36:18.036 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:569beb93:::benchmark_data_smithi188_104537_object98007:head# 2024-04-01T19:36:18.037 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:569bfb80:::benchmark_data_smithi188_104537_object69727:head# 2024-04-01T19:36:18.037 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:569c2f26:::benchmark_data_smithi188_104537_object161701:head# 2024-04-01T19:36:18.038 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:569c4a9d:::benchmark_data_smithi188_104537_object119811:head# 2024-04-01T19:36:18.038 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:569ca8f7:::benchmark_data_smithi188_104537_object20690:head# 2024-04-01T19:36:18.039 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:569d3436:::benchmark_data_smithi188_104537_object49539:head# 2024-04-01T19:36:18.039 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:569d41f5:::benchmark_data_smithi188_104537_object75758:head# 2024-04-01T19:36:18.040 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:569d85fa:::benchmark_data_smithi188_104537_object166978:head# 2024-04-01T19:36:18.040 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:569eca46:::benchmark_data_smithi188_104537_object129179:head# 2024-04-01T19:36:18.040 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:569ef42a:::benchmark_data_smithi188_104537_object139361:head# 2024-04-01T19:36:18.041 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:569f3831:::benchmark_data_smithi188_104537_object159449:head# 2024-04-01T19:36:18.042 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:569fbe30:::benchmark_data_smithi188_104537_object59608:head# 2024-04-01T19:36:18.042 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:569ff793:::benchmark_data_smithi188_104537_object77207:head# 2024-04-01T19:36:18.042 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a033f9:::benchmark_data_smithi188_104537_object41737:head# 2024-04-01T19:36:18.043 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a0cb9d:::benchmark_data_smithi188_104537_object148799:head# 2024-04-01T19:36:18.043 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a12c24:::benchmark_data_smithi188_104537_object79573:head# 2024-04-01T19:36:18.044 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a17e53:::benchmark_data_smithi188_104537_object99614:head# 2024-04-01T19:36:18.044 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a18371:::benchmark_data_smithi188_104537_object151390:head# 2024-04-01T19:36:18.044 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a21f1a:::benchmark_data_smithi188_104537_object56892:head# 2024-04-01T19:36:18.045 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a23f9e:::benchmark_data_smithi188_104537_object165393:head# 2024-04-01T19:36:18.045 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a2816e:::benchmark_data_smithi188_104537_object68942:head# 2024-04-01T19:36:18.046 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a2a9b5:::benchmark_data_smithi188_104537_object26398:head# 2024-04-01T19:36:18.046 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a39ac8:::benchmark_data_smithi188_104537_object77045:head# 2024-04-01T19:36:18.046 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a3a11f:::benchmark_data_smithi188_104537_object66099:head# 2024-04-01T19:36:18.047 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a3dd25:::benchmark_data_smithi188_104537_object57602:head# 2024-04-01T19:36:18.047 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a3e1e0:::benchmark_data_smithi188_104537_object135736:head# 2024-04-01T19:36:18.048 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a42f33:::benchmark_data_smithi188_104537_object53986:head# 2024-04-01T19:36:18.048 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a4d679:::benchmark_data_smithi188_104537_object28203:head# 2024-04-01T19:36:18.049 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a4faf2:::benchmark_data_smithi188_104537_object144445:head# 2024-04-01T19:36:18.049 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a56809:::benchmark_data_smithi188_104537_object42745:head# 2024-04-01T19:36:18.049 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a58ffb:::benchmark_data_smithi188_104537_object45272:head# 2024-04-01T19:36:18.050 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a5b949:::benchmark_data_smithi188_104537_object36654:head# 2024-04-01T19:36:18.050 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a648fa:::benchmark_data_smithi188_104537_object152307:head# 2024-04-01T19:36:18.051 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a6b96b:::benchmark_data_smithi188_104537_object126199:head# 2024-04-01T19:36:18.051 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a7756e:::benchmark_data_smithi188_104537_object22131:head# 2024-04-01T19:36:18.052 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a7af34:::benchmark_data_smithi188_104537_object42667:head# 2024-04-01T19:36:18.052 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a7e693:::benchmark_data_smithi188_104537_object25292:head# 2024-04-01T19:36:18.052 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a85ff5:::benchmark_data_smithi188_104537_object139682:head# 2024-04-01T19:36:18.053 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a8a0ad:::benchmark_data_smithi188_104537_object18646:head# 2024-04-01T19:36:18.053 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a92183:::benchmark_data_smithi188_104537_object145938:head# 2024-04-01T19:36:18.054 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a958c1:::benchmark_data_smithi188_104537_object110527:head# 2024-04-01T19:36:18.055 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a95a98:::benchmark_data_smithi188_104537_object113047:head# 2024-04-01T19:36:18.055 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56a983e0:::benchmark_data_smithi188_104537_object73707:head# 2024-04-01T19:36:18.055 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ab5e79:::benchmark_data_smithi188_104537_object77319:head# 2024-04-01T19:36:18.056 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ac28cb:::benchmark_data_smithi188_104537_object145637:head# 2024-04-01T19:36:18.056 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ac3779:::benchmark_data_smithi188_104537_object132511:head# 2024-04-01T19:36:18.056 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56acde45:::benchmark_data_smithi188_104537_object43189:head# 2024-04-01T19:36:18.057 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56acf41c:::benchmark_data_smithi188_104537_object79477:head# 2024-04-01T19:36:18.057 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ad7f8a:::benchmark_data_smithi188_104537_object60731:head# 2024-04-01T19:36:18.058 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ad85ef:::benchmark_data_smithi188_104537_object66809:head# 2024-04-01T19:36:18.058 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56adf307:::benchmark_data_smithi188_104537_object68748:head# 2024-04-01T19:36:18.058 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ae1cb1:::benchmark_data_smithi188_104537_object119286:head# 2024-04-01T19:36:18.059 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56b04f51:::benchmark_data_smithi188_104537_object58441:head# 2024-04-01T19:36:18.060 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56b0ce3a:::benchmark_data_smithi188_104537_object63200:head# 2024-04-01T19:36:18.060 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56b1dc5f:::benchmark_data_smithi188_104537_object131749:head# 2024-04-01T19:36:18.060 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56b1f2d9:::benchmark_data_smithi188_104537_object122661:head# 2024-04-01T19:36:18.061 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56b29298:::benchmark_data_smithi188_104537_object102418:head# 2024-04-01T19:36:18.062 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56b30aa5:::benchmark_data_smithi188_104537_object90639:head# 2024-04-01T19:36:18.062 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56b4c1c6:::benchmark_data_smithi188_104537_object153138:head# 2024-04-01T19:36:18.063 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56b4c309:::benchmark_data_smithi188_104537_object17682:head# 2024-04-01T19:36:18.063 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56b4d315:::benchmark_data_smithi188_104537_object32958:head# 2024-04-01T19:36:18.064 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56b596cb:::benchmark_data_smithi188_104537_object51970:head# 2024-04-01T19:36:18.065 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56b5a716:::benchmark_data_smithi188_104537_object44664:head# 2024-04-01T19:36:18.065 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56b5d1ff:::benchmark_data_smithi188_104537_object55853:head# 2024-04-01T19:36:18.065 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56b5f3d1:::benchmark_data_smithi188_104537_object68864:head# 2024-04-01T19:36:18.066 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56b61b83:::benchmark_data_smithi188_104537_object18734:head# 2024-04-01T19:36:18.066 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56b6468e:::benchmark_data_smithi188_104537_object16046:head# 2024-04-01T19:36:18.067 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56b76f38:::benchmark_data_smithi188_104537_object152052:head# 2024-04-01T19:36:18.067 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56b7c4b4:::benchmark_data_smithi188_104537_object75622:head# 2024-04-01T19:36:18.068 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56b80bf5:::benchmark_data_smithi188_104537_object139491:head# 2024-04-01T19:36:18.068 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56b88ad7:::benchmark_data_smithi188_104537_object45575:head# 2024-04-01T19:36:18.069 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56b8d639:::benchmark_data_smithi188_104537_object113278:head# 2024-04-01T19:36:18.069 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56b97723:::benchmark_data_smithi188_104537_object170988:head# 2024-04-01T19:36:18.070 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56b9c480:::benchmark_data_smithi188_104537_object137657:head# 2024-04-01T19:36:18.070 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56b9d671:::benchmark_data_smithi188_104537_object51754:head# 2024-04-01T19:36:18.070 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ba2167:::benchmark_data_smithi188_104537_object38652:head# 2024-04-01T19:36:18.071 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ba53b8:::benchmark_data_smithi188_104537_object119451:head# 2024-04-01T19:36:18.072 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ba56cd:::benchmark_data_smithi188_104537_object53128:head# 2024-04-01T19:36:18.072 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56baa793:::benchmark_data_smithi188_104537_object106501:head# 2024-04-01T19:36:18.072 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56bbc13d:::benchmark_data_smithi188_104537_object129518:head# 2024-04-01T19:36:18.073 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56bbc571:::benchmark_data_smithi188_104537_object71777:head# 2024-04-01T19:36:18.073 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56bc3b5f:::benchmark_data_smithi188_104537_object90619:head# 2024-04-01T19:36:18.074 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56bdac8e:::benchmark_data_smithi188_104537_object83996:head# 2024-04-01T19:36:18.074 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56bdf1f1:::benchmark_data_smithi188_104537_object147424:head# 2024-04-01T19:36:18.074 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56be343f:::benchmark_data_smithi188_104537_object35486:head# 2024-04-01T19:36:18.075 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56bec81f:::benchmark_data_smithi188_104537_object21180:head# 2024-04-01T19:36:18.075 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56bed1cf:::benchmark_data_smithi188_104537_object42895:head# 2024-04-01T19:36:18.076 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56bf6b4f:::benchmark_data_smithi188_104537_object53710:head# 2024-04-01T19:36:18.076 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c00301:::benchmark_data_smithi188_104537_object156290:head# 2024-04-01T19:36:18.077 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c02b32:::benchmark_data_smithi188_104537_object99850:head# 2024-04-01T19:36:18.077 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c05826:::benchmark_data_smithi188_104537_object117011:head# 2024-04-01T19:36:18.078 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c061ab:::benchmark_data_smithi188_104537_object52509:head# 2024-04-01T19:36:18.078 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c08240:::benchmark_data_smithi188_104537_object80245:head# 2024-04-01T19:36:18.079 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c14d0a:::benchmark_data_smithi188_104537_object66645:head# 2024-04-01T19:36:18.079 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c15060:::benchmark_data_smithi188_104537_object14957:head# 2024-04-01T19:36:18.080 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c266f7:::benchmark_data_smithi188_104537_object119698:head# 2024-04-01T19:36:18.080 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c27621:::benchmark_data_smithi188_104537_object146723:head# 2024-04-01T19:36:18.081 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c2b46e:::benchmark_data_smithi188_104537_object99062:head# 2024-04-01T19:36:18.081 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c2c303:::benchmark_data_smithi188_104537_object34483:head# 2024-04-01T19:36:18.081 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c2e900:::benchmark_data_smithi188_104537_object36842:head# 2024-04-01T19:36:18.082 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c344ea:::benchmark_data_smithi188_104537_object146067:head# 2024-04-01T19:36:18.082 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c35291:::benchmark_data_smithi188_104537_object39309:head# 2024-04-01T19:36:18.083 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c38df6:::benchmark_data_smithi188_104537_object89202:head# 2024-04-01T19:36:18.084 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c3b358:::benchmark_data_smithi188_104537_object162393:head# 2024-04-01T19:36:18.084 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c47700:::benchmark_data_smithi188_104537_object134883:head# 2024-04-01T19:36:18.084 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c4a6f4:::benchmark_data_smithi188_104537_object71422:head# 2024-04-01T19:36:18.085 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c4b914:::benchmark_data_smithi188_104537_object86117:head# 2024-04-01T19:36:18.085 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c53b1c:::benchmark_data_smithi188_104537_object59114:head# 2024-04-01T19:36:18.086 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c54a15:::benchmark_data_smithi188_104537_object157365:head# 2024-04-01T19:36:18.086 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c5c653:::benchmark_data_smithi188_104537_object118377:head# 2024-04-01T19:36:18.087 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c79f42:::benchmark_data_smithi188_104537_object125868:head# 2024-04-01T19:36:18.087 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c7b620:::benchmark_data_smithi188_104537_object81597:head# 2024-04-01T19:36:18.088 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c7bb8f:::benchmark_data_smithi188_104537_object98694:head# 2024-04-01T19:36:18.088 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c7ef1f:::benchmark_data_smithi188_104537_object128675:head# 2024-04-01T19:36:18.089 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c80560:::benchmark_data_smithi188_104537_object93514:head# 2024-04-01T19:36:18.089 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c8069e:::benchmark_data_smithi188_104537_object74321:head# 2024-04-01T19:36:18.090 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c87dc6:::benchmark_data_smithi188_104537_object83557:head# 2024-04-01T19:36:18.090 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c88dba:::benchmark_data_smithi188_104537_object142722:head# 2024-04-01T19:36:18.091 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c8f785:::benchmark_data_smithi188_104537_object131777:head# 2024-04-01T19:36:18.092 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c961ab:::benchmark_data_smithi188_104537_object112554:head# 2024-04-01T19:36:18.092 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56c96925:::benchmark_data_smithi188_104537_object13681:head# 2024-04-01T19:36:18.092 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ca33e2:::benchmark_data_smithi188_104537_object57756:head# 2024-04-01T19:36:18.093 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56cabbf9:::benchmark_data_smithi188_104537_object118054:head# 2024-04-01T19:36:18.093 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56cad975:::benchmark_data_smithi188_104537_object166392:head# 2024-04-01T19:36:18.093 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56cb08a7:::benchmark_data_smithi188_104537_object22296:head# 2024-04-01T19:36:18.094 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56cb263c:::benchmark_data_smithi188_104537_object159522:head# 2024-04-01T19:36:18.095 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56cbd92b:::benchmark_data_smithi188_104537_object47508:head# 2024-04-01T19:36:18.095 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56cbfc5b:::benchmark_data_smithi188_104537_object105963:head# 2024-04-01T19:36:18.095 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56cc1d6e:::benchmark_data_smithi188_104537_object109082:head# 2024-04-01T19:36:18.096 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56cc3bc1:::benchmark_data_smithi188_104537_object109591:head# 2024-04-01T19:36:18.096 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56cca3a7:::benchmark_data_smithi188_104537_object84789:head# 2024-04-01T19:36:18.096 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56cce3eb:::benchmark_data_smithi188_104537_object141691:head# 2024-04-01T19:36:18.097 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56cd1292:::benchmark_data_smithi188_104537_object125236:head# 2024-04-01T19:36:18.097 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56cd3262:::benchmark_data_smithi188_104537_object49584:head# 2024-04-01T19:36:18.098 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56cd3968:::benchmark_data_smithi188_104537_object149371:head# 2024-04-01T19:36:18.098 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56cd7c9f:::benchmark_data_smithi188_104537_object15122:head# 2024-04-01T19:36:18.099 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ce0b95:::benchmark_data_smithi188_104537_object91015:head# 2024-04-01T19:36:18.099 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ce4614:::benchmark_data_smithi188_104537_object115929:head# 2024-04-01T19:36:18.101 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ce533b:::benchmark_data_smithi188_104537_object37513:head# 2024-04-01T19:36:18.101 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56cef0c4:::benchmark_data_smithi188_104537_object31096:head# 2024-04-01T19:36:18.101 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56cf9c19:::benchmark_data_smithi188_104537_object131557:head# 2024-04-01T19:36:18.102 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56cfa92d:::benchmark_data_smithi188_104537_object114625:head# 2024-04-01T19:36:18.102 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56cffcb6:::benchmark_data_smithi188_104537_object78529:head# 2024-04-01T19:36:18.103 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56d05a24:::benchmark_data_smithi188_104537_object68454:head# 2024-04-01T19:36:18.103 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56d0c275:::benchmark_data_smithi188_104537_object148390:head# 2024-04-01T19:36:18.104 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56d122d1:::benchmark_data_smithi188_104537_object122238:head# 2024-04-01T19:36:18.104 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56d16d3a:::benchmark_data_smithi188_104537_object157538:head# 2024-04-01T19:36:18.104 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56d27202:::benchmark_data_smithi188_104537_object34779:head# 2024-04-01T19:36:18.105 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56d2a25b:::benchmark_data_smithi188_104537_object136907:head# 2024-04-01T19:36:18.105 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56d2a7f5:::benchmark_data_smithi188_104537_object110669:head# 2024-04-01T19:36:18.106 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56d34224:::benchmark_data_smithi188_104537_object166796:head# 2024-04-01T19:36:18.106 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56d3c1cc:::benchmark_data_smithi188_104537_object102871:head# 2024-04-01T19:36:18.107 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56d41dae:::benchmark_data_smithi188_104537_object109156:head# 2024-04-01T19:36:18.107 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56d47163:::benchmark_data_smithi188_104537_object137859:head# 2024-04-01T19:36:18.108 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56d49997:::benchmark_data_smithi188_104537_object60761:head# 2024-04-01T19:36:18.108 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56d4c7d4:::benchmark_data_smithi188_104537_object146000:head# 2024-04-01T19:36:18.109 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56d4e12e:::benchmark_data_smithi188_104537_object154178:head# 2024-04-01T19:36:18.109 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56d694b3:::benchmark_data_smithi188_104537_object81376:head# 2024-04-01T19:36:18.109 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56d702a6:::benchmark_data_smithi188_104537_object138840:head# 2024-04-01T19:36:18.110 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56d7f997:::benchmark_data_smithi188_104537_object60561:head# 2024-04-01T19:36:18.110 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56d82cac:::benchmark_data_smithi188_104537_object55715:head# 2024-04-01T19:36:18.111 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56d8636c:::benchmark_data_smithi188_104537_object73010:head# 2024-04-01T19:36:18.111 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56d95b06:::benchmark_data_smithi188_104537_object153239:head# 2024-04-01T19:36:18.112 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56d95fc6:::benchmark_data_smithi188_104537_object132825:head# 2024-04-01T19:36:18.112 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56d96d3f:::benchmark_data_smithi188_104537_object99096:head# 2024-04-01T19:36:18.113 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56da942d:::benchmark_data_smithi188_104537_object118465:head# 2024-04-01T19:36:18.113 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56dacbda:::benchmark_data_smithi188_104537_object51840:head# 2024-04-01T19:36:18.114 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56db20aa:::benchmark_data_smithi188_104537_object107080:head# 2024-04-01T19:36:18.114 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56db43c2:::benchmark_data_smithi188_104537_object135754:head# 2024-04-01T19:36:18.114 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56dbf3de:::benchmark_data_smithi188_104537_object42325:head# 2024-04-01T19:36:18.115 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56dc4a0a:::benchmark_data_smithi188_104537_object124739:head# 2024-04-01T19:36:18.115 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56dc7165:::benchmark_data_smithi188_104537_object51477:head# 2024-04-01T19:36:18.116 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56dc7d68:::benchmark_data_smithi188_104537_object17455:head# 2024-04-01T19:36:18.116 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56dd0f45:::benchmark_data_smithi188_104537_object95044:head# 2024-04-01T19:36:18.117 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56dd51dd:::benchmark_data_smithi188_104537_object54388:head# 2024-04-01T19:36:18.117 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56dd6695:::benchmark_data_smithi188_104537_object31884:head# 2024-04-01T19:36:18.117 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56decfbb:::benchmark_data_smithi188_104537_object68011:head# 2024-04-01T19:36:18.118 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56deef4b:::benchmark_data_smithi188_104537_object76800:head# 2024-04-01T19:36:18.119 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56df5167:::benchmark_data_smithi188_104537_object56372:head# 2024-04-01T19:36:18.119 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56dfff5a:::benchmark_data_smithi188_104537_object141077:head# 2024-04-01T19:36:18.119 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e02d41:::benchmark_data_smithi188_104537_object92621:head# 2024-04-01T19:36:18.120 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e08311:::benchmark_data_smithi188_104537_object164482:head# 2024-04-01T19:36:18.120 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e08ec3:::benchmark_data_smithi188_104537_object83962:head# 2024-04-01T19:36:18.121 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e0c2a9:::benchmark_data_smithi188_104537_object134277:head# 2024-04-01T19:36:18.121 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e14198:::benchmark_data_smithi188_104537_object15158:head# 2024-04-01T19:36:18.122 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e20e91:::benchmark_data_smithi188_104537_object38395:head# 2024-04-01T19:36:18.125 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e2bffe:::benchmark_data_smithi188_104537_object94658:head# 2024-04-01T19:36:18.126 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e31433:::benchmark_data_smithi188_104537_object62476:head# 2024-04-01T19:36:18.126 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e34d11:::benchmark_data_smithi188_104537_object137160:head# 2024-04-01T19:36:18.126 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e38008:::benchmark_data_smithi188_104537_object162121:head# 2024-04-01T19:36:18.126 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e43346:::benchmark_data_smithi188_104537_object68255:head# 2024-04-01T19:36:18.126 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e446aa:::benchmark_data_smithi188_104537_object168342:head# 2024-04-01T19:36:18.126 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e45613:::benchmark_data_smithi188_104537_object116493:head# 2024-04-01T19:36:18.126 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e48a57:::benchmark_data_smithi188_104537_object121141:head# 2024-04-01T19:36:18.127 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e48dfd:::benchmark_data_smithi188_104537_object110248:head# 2024-04-01T19:36:18.127 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e4a1dc:::benchmark_data_smithi188_104537_object12936:head# 2024-04-01T19:36:18.127 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e4e93a:::benchmark_data_smithi188_104537_object31869:head# 2024-04-01T19:36:18.128 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e53666:::benchmark_data_smithi188_104537_object13593:head# 2024-04-01T19:36:18.128 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e55bb5:::benchmark_data_smithi188_104537_object36466:head# 2024-04-01T19:36:18.129 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e57c84:::benchmark_data_smithi188_104537_object133448:head# 2024-04-01T19:36:18.129 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e63e94:::benchmark_data_smithi188_104537_object37986:head# 2024-04-01T19:36:18.129 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e6d2c1:::benchmark_data_smithi188_104537_object117232:head# 2024-04-01T19:36:18.130 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e726fb:::benchmark_data_smithi188_104537_object95786:head# 2024-04-01T19:36:18.130 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e80c59:::benchmark_data_smithi188_104537_object50457:head# 2024-04-01T19:36:18.131 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e82f54:::benchmark_data_smithi188_104537_object127727:head# 2024-04-01T19:36:18.131 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e92724:::benchmark_data_smithi188_104537_object109668:head# 2024-04-01T19:36:18.132 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e98f70:::benchmark_data_smithi188_104537_object93627:head# 2024-04-01T19:36:18.132 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e99fcd:::benchmark_data_smithi188_104537_object83830:head# 2024-04-01T19:36:18.132 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56e9f5ef:::benchmark_data_smithi188_104537_object113996:head# 2024-04-01T19:36:18.133 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56eaae53:::benchmark_data_smithi188_104537_object90190:head# 2024-04-01T19:36:18.133 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56eae3ed:::benchmark_data_smithi188_104537_object82403:head# 2024-04-01T19:36:18.133 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56eb065b:::benchmark_data_smithi188_104537_object30548:head# 2024-04-01T19:36:18.134 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ec1914:::benchmark_data_smithi188_104537_object147401:head# 2024-04-01T19:36:18.134 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ec2f8c:::benchmark_data_smithi188_104537_object73953:head# 2024-04-01T19:36:18.135 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ec5df8:::benchmark_data_smithi188_104537_object136974:head# 2024-04-01T19:36:18.135 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ec5e83:::benchmark_data_smithi188_104537_object88703:head# 2024-04-01T19:36:18.135 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ecc5ca:::benchmark_data_smithi188_104537_object83123:head# 2024-04-01T19:36:18.136 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ed3477:::benchmark_data_smithi188_104537_object109657:head# 2024-04-01T19:36:18.136 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ed4413:::benchmark_data_smithi188_104537_object82358:head# 2024-04-01T19:36:18.137 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ed9817:::benchmark_data_smithi188_104537_object105216:head# 2024-04-01T19:36:18.137 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ee64a2:::benchmark_data_smithi188_104537_object84301:head# 2024-04-01T19:36:18.137 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ee880c:::benchmark_data_smithi188_104537_object81535:head# 2024-04-01T19:36:18.138 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56eec2e0:::benchmark_data_smithi188_104537_object73416:head# 2024-04-01T19:36:18.138 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56eee54c:::benchmark_data_smithi188_104537_object142078:head# 2024-04-01T19:36:18.139 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ef4943:::benchmark_data_smithi188_104537_object63674:head# 2024-04-01T19:36:18.139 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ef83ae:::benchmark_data_smithi188_104537_object23886:head# 2024-04-01T19:36:18.139 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ef9f71:::benchmark_data_smithi188_104537_object13148:head# 2024-04-01T19:36:18.140 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56efae17:::benchmark_data_smithi188_104537_object54849:head# 2024-04-01T19:36:18.140 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f01063:::benchmark_data_smithi188_104537_object166615:head# 2024-04-01T19:36:18.140 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f01f67:::benchmark_data_smithi188_104537_object18973:head# 2024-04-01T19:36:18.141 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f044da:::benchmark_data_smithi188_104537_object113361:head# 2024-04-01T19:36:18.141 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f0d307:::benchmark_data_smithi188_104537_object144673:head# 2024-04-01T19:36:18.142 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f12854:::benchmark_data_smithi188_104537_object65263:head# 2024-04-01T19:36:18.142 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f1d1e5:::benchmark_data_smithi188_104537_object91851:head# 2024-04-01T19:36:18.142 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f326b3:::benchmark_data_smithi188_104537_object132968:head# 2024-04-01T19:36:18.143 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f3313a:::benchmark_data_smithi188_104537_object41815:head# 2024-04-01T19:36:18.144 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f331c8:::benchmark_data_smithi188_104537_object85414:head# 2024-04-01T19:36:18.144 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f36809:::benchmark_data_smithi188_104537_object168840:head# 2024-04-01T19:36:18.144 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f38a47:::benchmark_data_smithi188_104537_object74485:head# 2024-04-01T19:36:18.145 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f3ad52:::benchmark_data_smithi188_104537_object169870:head# 2024-04-01T19:36:18.145 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f40c4c:::benchmark_data_smithi188_104537_object86728:head# 2024-04-01T19:36:18.146 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f50df1:::benchmark_data_smithi188_104537_object169266:head# 2024-04-01T19:36:18.146 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f5394e:::benchmark_data_smithi188_104537_object103878:head# 2024-04-01T19:36:18.147 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f57747:::benchmark_data_smithi188_104537_object153597:head# 2024-04-01T19:36:18.147 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f58ae6:::benchmark_data_smithi188_104537_object89682:head# 2024-04-01T19:36:18.148 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f63934:::benchmark_data_smithi188_104537_object74566:head# 2024-04-01T19:36:18.148 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f65e6d:::benchmark_data_smithi188_104537_object35901:head# 2024-04-01T19:36:18.149 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f667ec:::benchmark_data_smithi188_104537_object123577:head# 2024-04-01T19:36:18.149 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f679fa:::benchmark_data_smithi188_104537_object135234:head# 2024-04-01T19:36:18.149 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f67ee8:::benchmark_data_smithi188_104537_object64369:head# 2024-04-01T19:36:18.150 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f69f40:::benchmark_data_smithi188_104537_object153515:head# 2024-04-01T19:36:18.150 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f75e20:::benchmark_data_smithi188_104537_object74243:head# 2024-04-01T19:36:18.150 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f8c0a9:::benchmark_data_smithi188_104537_object51290:head# 2024-04-01T19:36:18.151 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f95ea3:::benchmark_data_smithi188_104537_object109247:head# 2024-04-01T19:36:18.151 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56f96c41:::benchmark_data_smithi188_104537_object48648:head# 2024-04-01T19:36:18.152 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56fa161c:::benchmark_data_smithi188_104537_object112903:head# 2024-04-01T19:36:18.152 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56fa195a:::benchmark_data_smithi188_104537_object120863:head# 2024-04-01T19:36:18.153 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56fc21f5:::benchmark_data_smithi188_104537_object46564:head# 2024-04-01T19:36:18.153 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56fc87f6:::benchmark_data_smithi188_104537_object165553:head# 2024-04-01T19:36:18.154 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56fde0b1:::benchmark_data_smithi188_104537_object13104:head# 2024-04-01T19:36:18.154 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56fe6454:::benchmark_data_smithi188_104537_object33288:head# 2024-04-01T19:36:18.154 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56fec318:::benchmark_data_smithi188_104537_object71791:head# 2024-04-01T19:36:18.155 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56feebf5:::benchmark_data_smithi188_104537_object96221:head# 2024-04-01T19:36:18.155 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:56ff10bf:::benchmark_data_smithi188_104537_object73392:head# 2024-04-01T19:36:18.156 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57003154:::benchmark_data_smithi188_104537_object119557:head# 2024-04-01T19:36:18.156 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57012442:::benchmark_data_smithi188_104537_object136808:head# 2024-04-01T19:36:18.157 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57012d17:::benchmark_data_smithi188_104537_object62914:head# 2024-04-01T19:36:18.157 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5701b13d:::benchmark_data_smithi188_104537_object151099:head# 2024-04-01T19:36:18.158 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57021743:::benchmark_data_smithi188_104537_object140367:head# 2024-04-01T19:36:18.158 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57036662:::benchmark_data_smithi188_104537_object110988:head# 2024-04-01T19:36:18.159 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5703c501:::benchmark_data_smithi188_104537_object75351:head# 2024-04-01T19:36:18.159 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5703f521:::benchmark_data_smithi188_104537_object82719:head# 2024-04-01T19:36:18.159 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57046c9b:::benchmark_data_smithi188_104537_object65870:head# 2024-04-01T19:36:18.160 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5704e751:::benchmark_data_smithi188_104537_object51860:head# 2024-04-01T19:36:18.160 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5704fe5b:::benchmark_data_smithi188_104537_object32988:head# 2024-04-01T19:36:18.161 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57056a19:::benchmark_data_smithi188_104537_object162927:head# 2024-04-01T19:36:18.161 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57058223:::benchmark_data_smithi188_104537_object149489:head# 2024-04-01T19:36:18.161 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57062916:::benchmark_data_smithi188_104537_object133302:head# 2024-04-01T19:36:18.162 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:570695e0:::benchmark_data_smithi188_104537_object13527:head# 2024-04-01T19:36:18.162 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57069f37:::benchmark_data_smithi188_104537_object147111:head# 2024-04-01T19:36:18.163 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5706d1d7:::benchmark_data_smithi188_104537_object95587:head# 2024-04-01T19:36:18.163 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5706d8a8:::benchmark_data_smithi188_104537_object83116:head# 2024-04-01T19:36:18.163 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:570799a9:::benchmark_data_smithi188_104537_object96756:head# 2024-04-01T19:36:18.164 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5707b925:::benchmark_data_smithi188_104537_object94715:head# 2024-04-01T19:36:18.164 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5707ff85:::benchmark_data_smithi188_104537_object129999:head# 2024-04-01T19:36:18.165 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57083bea:::benchmark_data_smithi188_104537_object136688:head# 2024-04-01T19:36:18.165 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57093118:::benchmark_data_smithi188_104537_object14792:head# 2024-04-01T19:36:18.165 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5709500a:::benchmark_data_smithi188_104537_object81926:head# 2024-04-01T19:36:18.166 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5709d4f7:::benchmark_data_smithi188_104537_object166170:head# 2024-04-01T19:36:18.167 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:570a28dd:::benchmark_data_smithi188_104537_object12297:head# 2024-04-01T19:36:18.167 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:570a5001:::benchmark_data_smithi188_104537_object145904:head# 2024-04-01T19:36:18.167 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:570a999b:::benchmark_data_smithi188_104537_object69634:head# 2024-04-01T19:36:18.168 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:570b7aa6:::benchmark_data_smithi188_104537_object148499:head# 2024-04-01T19:36:18.168 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:570b8d9e:::benchmark_data_smithi188_104537_object110543:head# 2024-04-01T19:36:18.168 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:570c14c0:::benchmark_data_smithi188_104537_object142516:head# 2024-04-01T19:36:18.169 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:570c4916:::benchmark_data_smithi188_104537_object137792:head# 2024-04-01T19:36:18.169 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:570d0d4f:::benchmark_data_smithi188_104537_object50787:head# 2024-04-01T19:36:18.170 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:570d1e56:::benchmark_data_smithi188_104537_object49719:head# 2024-04-01T19:36:18.170 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:570d2bbb:::benchmark_data_smithi188_104537_object28335:head# 2024-04-01T19:36:18.171 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:570d739b:::benchmark_data_smithi188_104537_object151895:head# 2024-04-01T19:36:18.171 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:570d874c:::benchmark_data_smithi188_104537_object91545:head# 2024-04-01T19:36:18.172 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:570da92e:::benchmark_data_smithi188_104537_object151097:head# 2024-04-01T19:36:18.172 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:570e4c9f:::benchmark_data_smithi188_104537_object62142:head# 2024-04-01T19:36:18.173 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:570e6716:::benchmark_data_smithi188_104537_object128445:head# 2024-04-01T19:36:18.173 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:570f0e9c:::benchmark_data_smithi188_104537_object33203:head# 2024-04-01T19:36:18.173 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:570fef4f:::benchmark_data_smithi188_104537_object67818:head# 2024-04-01T19:36:18.174 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57100ab4:::benchmark_data_smithi188_104537_object51222:head# 2024-04-01T19:36:18.174 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:571012d2:::benchmark_data_smithi188_104537_object121089:head# 2024-04-01T19:36:18.175 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5710d409:::benchmark_data_smithi188_104537_object166645:head# 2024-04-01T19:36:18.175 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57114627:::benchmark_data_smithi188_104537_object86413:head# 2024-04-01T19:36:18.175 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:571171cb:::benchmark_data_smithi188_104537_object136629:head# 2024-04-01T19:36:18.176 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:571176f0:::benchmark_data_smithi188_104537_object35659:head# 2024-04-01T19:36:18.177 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5711bf1f:::benchmark_data_smithi188_104537_object168280:head# 2024-04-01T19:36:18.177 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57124d13:::benchmark_data_smithi188_104537_object160431:head# 2024-04-01T19:36:18.178 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5712e71b:::benchmark_data_smithi188_104537_object139314:head# 2024-04-01T19:36:18.178 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57134076:::benchmark_data_smithi188_104537_object122356:head# 2024-04-01T19:36:18.178 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57163bb8:::benchmark_data_smithi188_104537_object84995:head# 2024-04-01T19:36:18.179 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57165c75:::benchmark_data_smithi188_104537_object149967:head# 2024-04-01T19:36:18.179 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5716f7dc:::benchmark_data_smithi188_104537_object125312:head# 2024-04-01T19:36:18.179 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57173345:::benchmark_data_smithi188_104537_object103581:head# 2024-04-01T19:36:18.180 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57174f21:::benchmark_data_smithi188_104537_object151377:head# 2024-04-01T19:36:18.180 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5717a383:::benchmark_data_smithi188_104537_object121453:head# 2024-04-01T19:36:18.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5718e6b4:::benchmark_data_smithi188_104537_object20804:head# 2024-04-01T19:36:18.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5719b815:::benchmark_data_smithi188_104537_object40012:head# 2024-04-01T19:36:18.182 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5719cebd:::benchmark_data_smithi188_104537_object165427:head# 2024-04-01T19:36:18.182 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:571a4a57:::benchmark_data_smithi188_104537_object155887:head# 2024-04-01T19:36:18.182 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:571a598c:::benchmark_data_smithi188_104537_object167308:head# 2024-04-01T19:36:18.183 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:571a59b6:::benchmark_data_smithi188_104537_object168711:head# 2024-04-01T19:36:18.183 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:571a8022:::benchmark_data_smithi188_104537_object124630:head# 2024-04-01T19:36:18.184 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:571a96d0:::benchmark_data_smithi188_104537_object162951:head# 2024-04-01T19:36:18.184 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:571ad4b4:::benchmark_data_smithi188_104537_object155444:head# 2024-04-01T19:36:18.184 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:571af3d9:::benchmark_data_smithi188_104537_object123724:head# 2024-04-01T19:36:18.185 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:571b2363:::benchmark_data_smithi188_104537_object67780:head# 2024-04-01T19:36:18.185 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:571b70d1:::benchmark_data_smithi188_104537_object112037:head# 2024-04-01T19:36:18.186 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:571bbf9a:::benchmark_data_smithi188_104537_object107084:head# 2024-04-01T19:36:18.186 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:571c0d33:::benchmark_data_smithi188_104537_object126775:head# 2024-04-01T19:36:18.187 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:571dcada:::benchmark_data_smithi188_104537_object124219:head# 2024-04-01T19:36:18.187 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:571e270d:::benchmark_data_smithi188_104537_object71988:head# 2024-04-01T19:36:18.187 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:571f07dd:::benchmark_data_smithi188_104537_object147823:head# 2024-04-01T19:36:18.188 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:571f16d6:::benchmark_data_smithi188_104537_object171650:head# 2024-04-01T19:36:18.188 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:571f7874:::benchmark_data_smithi188_104537_object113634:head# 2024-04-01T19:36:18.189 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:571f9723:::benchmark_data_smithi188_104537_object123958:head# 2024-04-01T19:36:18.189 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57208e5c:::benchmark_data_smithi188_104537_object37722:head# 2024-04-01T19:36:18.189 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5720b43d:::benchmark_data_smithi188_104537_object28116:head# 2024-04-01T19:36:18.190 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5720f2cb:::benchmark_data_smithi188_104537_object126098:head# 2024-04-01T19:36:18.195 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57220c08:::benchmark_data_smithi188_104537_object30065:head# 2024-04-01T19:36:18.195 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5722359d:::benchmark_data_smithi188_104537_object44473:head# 2024-04-01T19:36:18.195 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5722864e:::benchmark_data_smithi188_104537_object36144:head# 2024-04-01T19:36:18.196 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5722b2d0:::benchmark_data_smithi188_104537_object71537:head# 2024-04-01T19:36:18.196 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57232451:::benchmark_data_smithi188_104537_object60825:head# 2024-04-01T19:36:18.196 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57236390:::benchmark_data_smithi188_104537_object69503:head# 2024-04-01T19:36:18.196 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57237bcc:::benchmark_data_smithi188_104537_object159591:head# 2024-04-01T19:36:18.196 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5723a150:::benchmark_data_smithi188_104537_object27385:head# 2024-04-01T19:36:18.196 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57241985:::benchmark_data_smithi188_104537_object16803:head# 2024-04-01T19:36:18.196 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:572429c3:::benchmark_data_smithi188_104537_object116348:head# 2024-04-01T19:36:18.196 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57243874:::benchmark_data_smithi188_104537_object163448:head# 2024-04-01T19:36:18.197 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57245cc6:::benchmark_data_smithi188_104537_object33381:head# 2024-04-01T19:36:18.197 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:572530f7:::benchmark_data_smithi188_104537_object23557:head# 2024-04-01T19:36:18.197 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5725a848:::benchmark_data_smithi188_104537_object61398:head# 2024-04-01T19:36:18.198 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57262245:::benchmark_data_smithi188_104537_object63446:head# 2024-04-01T19:36:18.198 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:572644f8:::benchmark_data_smithi188_104537_object145138:head# 2024-04-01T19:36:18.199 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:572681b8:::benchmark_data_smithi188_104537_object133627:head# 2024-04-01T19:36:18.199 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57270935:::benchmark_data_smithi188_104537_object56749:head# 2024-04-01T19:36:18.201 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57285ca8:::benchmark_data_smithi188_104537_object27367:head# 2024-04-01T19:36:18.201 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5728b105:::benchmark_data_smithi188_104537_object145997:head# 2024-04-01T19:36:18.201 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:572930fc:::benchmark_data_smithi188_104537_object157794:head# 2024-04-01T19:36:18.201 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5729b1b6:::benchmark_data_smithi188_104537_object125689:head# 2024-04-01T19:36:18.202 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:572a63fe:::benchmark_data_smithi188_104537_object159400:head# 2024-04-01T19:36:18.202 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:572ad15e:::benchmark_data_smithi188_104537_object115113:head# 2024-04-01T19:36:18.202 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:572b4d4e:::benchmark_data_smithi188_104537_object41232:head# 2024-04-01T19:36:18.203 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:572b69a3:::benchmark_data_smithi188_104537_object92474:head# 2024-04-01T19:36:18.203 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:572b9899:::benchmark_data_smithi188_104537_object130421:head# 2024-04-01T19:36:18.204 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:572b9955:::benchmark_data_smithi188_104537_object168618:head# 2024-04-01T19:36:18.204 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:572bad07:::benchmark_data_smithi188_104537_object38095:head# 2024-04-01T19:36:18.204 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:572bd4e6:::benchmark_data_smithi188_104537_object12231:head# 2024-04-01T19:36:18.205 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:572c1255:::benchmark_data_smithi188_104537_object13540:head# 2024-04-01T19:36:18.205 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:572c434d:::benchmark_data_smithi188_104537_object148371:head# 2024-04-01T19:36:18.206 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:572c6d51:::benchmark_data_smithi188_104537_object133061:head# 2024-04-01T19:36:18.206 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:572c70e5:::benchmark_data_smithi188_104537_object79209:head# 2024-04-01T19:36:18.206 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:572caa9d:::benchmark_data_smithi188_104537_object71660:head# 2024-04-01T19:36:18.207 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:572cd1ec:::benchmark_data_smithi188_104537_object13276:head# 2024-04-01T19:36:18.207 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:572d01ce:::benchmark_data_smithi188_104537_object14265:head# 2024-04-01T19:36:18.207 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:572e9ab9:::benchmark_data_smithi188_104537_object141186:head# 2024-04-01T19:36:18.208 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:572ee0e0:::benchmark_data_smithi188_104537_object101441:head# 2024-04-01T19:36:18.209 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:572f7a8c:::benchmark_data_smithi188_104537_object116729:head# 2024-04-01T19:36:18.209 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:572fcaad:::benchmark_data_smithi188_104537_object45610:head# 2024-04-01T19:36:18.210 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5730a1ea:::benchmark_data_smithi188_104537_object53963:head# 2024-04-01T19:36:18.210 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57315d48:::benchmark_data_smithi188_104537_object170862:head# 2024-04-01T19:36:18.211 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:573184ab:::benchmark_data_smithi188_104537_object104156:head# 2024-04-01T19:36:18.211 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57324163:::benchmark_data_smithi188_104537_object83214:head# 2024-04-01T19:36:18.212 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5732ebcc:::benchmark_data_smithi188_104537_object169314:head# 2024-04-01T19:36:18.212 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5732ef4d:::benchmark_data_smithi188_104537_object76604:head# 2024-04-01T19:36:18.213 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:573306b8:::benchmark_data_smithi188_104537_object18482:head# 2024-04-01T19:36:18.213 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5733147b:::benchmark_data_smithi188_104537_object129055:head# 2024-04-01T19:36:18.214 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:573390ca:::benchmark_data_smithi188_104537_object46286:head# 2024-04-01T19:36:18.214 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5733bfb2:::benchmark_data_smithi188_104537_object146497:head# 2024-04-01T19:36:18.215 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5733f41d:::benchmark_data_smithi188_104537_object69847:head# 2024-04-01T19:36:18.215 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57346ceb:::benchmark_data_smithi188_104537_object82119:head# 2024-04-01T19:36:18.215 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:573471e6:::benchmark_data_smithi188_104537_object157973:head# 2024-04-01T19:36:18.216 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5734ec9b:::benchmark_data_smithi188_104537_object40403:head# 2024-04-01T19:36:18.216 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:573524cd:::benchmark_data_smithi188_104537_object67284:head# 2024-04-01T19:36:18.217 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57353a1d:::benchmark_data_smithi188_104537_object49355:head# 2024-04-01T19:36:18.218 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5735eacb:::benchmark_data_smithi188_104537_object35979:head# 2024-04-01T19:36:18.218 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5736c695:::benchmark_data_smithi188_104537_object36253:head# 2024-04-01T19:36:18.219 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:573726c9:::benchmark_data_smithi188_104537_object36633:head# 2024-04-01T19:36:18.219 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5737b665:::benchmark_data_smithi188_104537_object146036:head# 2024-04-01T19:36:18.219 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57382a82:::benchmark_data_smithi188_104537_object34070:head# 2024-04-01T19:36:18.220 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57382d0f:::benchmark_data_smithi188_104537_object40697:head# 2024-04-01T19:36:18.220 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:573898be:::benchmark_data_smithi188_104537_object69277:head# 2024-04-01T19:36:18.220 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5738f3dd:::benchmark_data_smithi188_104537_object121435:head# 2024-04-01T19:36:18.221 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:573affd5:::benchmark_data_smithi188_104537_object21003:head# 2024-04-01T19:36:18.221 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:573b4639:::benchmark_data_smithi188_104537_object43472:head# 2024-04-01T19:36:18.222 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:573baf32:::benchmark_data_smithi188_104537_object61933:head# 2024-04-01T19:36:18.222 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:573bba9f:::benchmark_data_smithi188_104537_object108734:head# 2024-04-01T19:36:18.223 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:573bdd41:::benchmark_data_smithi188_104537_object77462:head# 2024-04-01T19:36:18.223 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:573c2bdd:::benchmark_data_smithi188_104537_object100411:head# 2024-04-01T19:36:18.224 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:573c7426:::benchmark_data_smithi188_104537_object87298:head# 2024-04-01T19:36:18.224 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:573dd3d1:::benchmark_data_smithi188_104537_object150031:head# 2024-04-01T19:36:18.224 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:573e0879:::benchmark_data_smithi188_104537_object153559:head# 2024-04-01T19:36:18.225 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:573e6ef7:::benchmark_data_smithi188_104537_object139068:head# 2024-04-01T19:36:18.225 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:573efe3d:::benchmark_data_smithi188_104537_object116435:head# 2024-04-01T19:36:18.226 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:573f3b5e:::benchmark_data_smithi188_104537_object31343:head# 2024-04-01T19:36:18.226 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:573f79b4:::benchmark_data_smithi188_104537_object151554:head# 2024-04-01T19:36:18.227 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57411b8b:::benchmark_data_smithi188_104537_object116971:head# 2024-04-01T19:36:18.227 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57412371:::benchmark_data_smithi188_104537_object34624:head# 2024-04-01T19:36:18.228 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57413a80:::benchmark_data_smithi188_104537_object71021:head# 2024-04-01T19:36:18.228 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5741b266:::benchmark_data_smithi188_104537_object152053:head# 2024-04-01T19:36:18.228 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5741c36d:::benchmark_data_smithi188_104537_object79155:head# 2024-04-01T19:36:18.229 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5741ff39:::benchmark_data_smithi188_104537_object29827:head# 2024-04-01T19:36:18.229 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57421924:::benchmark_data_smithi188_104537_object21544:head# 2024-04-01T19:36:18.230 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57421bcc:::benchmark_data_smithi188_104537_object157029:head# 2024-04-01T19:36:18.230 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57422d43:::benchmark_data_smithi188_104537_object152030:head# 2024-04-01T19:36:18.231 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57424169:::benchmark_data_smithi188_104537_object99154:head# 2024-04-01T19:36:18.231 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5742ee06:::benchmark_data_smithi188_104537_object67828:head# 2024-04-01T19:36:18.231 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5743386f:::benchmark_data_smithi188_104537_object118323:head# 2024-04-01T19:36:18.232 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5743f5a9:::benchmark_data_smithi188_104537_object122498:head# 2024-04-01T19:36:18.232 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5743fb42:::benchmark_data_smithi188_104537_object12828:head# 2024-04-01T19:36:18.233 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5745dc7b:::benchmark_data_smithi188_104537_object116541:head# 2024-04-01T19:36:18.233 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57461713:::benchmark_data_smithi188_104537_object86061:head# 2024-04-01T19:36:18.233 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5746d559:::benchmark_data_smithi188_104537_object101465:head# 2024-04-01T19:36:18.234 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5746ed58:::benchmark_data_smithi188_104537_object69819:head# 2024-04-01T19:36:18.234 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5747869f:::benchmark_data_smithi188_104537_object133222:head# 2024-04-01T19:36:18.235 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5747a9b6:::benchmark_data_smithi188_104537_object21174:head# 2024-04-01T19:36:18.235 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:574851f6:::benchmark_data_smithi188_104537_object169121:head# 2024-04-01T19:36:18.235 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5748556e:::benchmark_data_smithi188_104537_object85618:head# 2024-04-01T19:36:18.236 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57499e57:::benchmark_data_smithi188_104537_object62971:head# 2024-04-01T19:36:18.236 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:574aa2eb:::benchmark_data_smithi188_104537_object98290:head# 2024-04-01T19:36:18.237 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:574ade64:::benchmark_data_smithi188_104537_object166496:head# 2024-04-01T19:36:18.237 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:574b26aa:::benchmark_data_smithi188_104537_object169488:head# 2024-04-01T19:36:18.238 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:574b5f40:::benchmark_data_smithi188_104537_object70641:head# 2024-04-01T19:36:18.238 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:574bcf67:::benchmark_data_smithi188_104537_object64998:head# 2024-04-01T19:36:18.239 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:574bd3a8:::benchmark_data_smithi188_104537_object54269:head# 2024-04-01T19:36:18.239 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:574bd8d9:::benchmark_data_smithi188_104537_object94390:head# 2024-04-01T19:36:18.239 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:574be10e:::benchmark_data_smithi188_104537_object95986:head# 2024-04-01T19:36:18.240 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:574bff8e:::benchmark_data_smithi188_104537_object157416:head# 2024-04-01T19:36:18.240 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:574cd2e1:::benchmark_data_smithi188_104537_object77717:head# 2024-04-01T19:36:18.241 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:574d16cb:::benchmark_data_smithi188_104537_object98019:head# 2024-04-01T19:36:18.241 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:574d1bf8:::benchmark_data_smithi188_104537_object99299:head# 2024-04-01T19:36:18.242 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:574d775f:::benchmark_data_smithi188_104537_object65115:head# 2024-04-01T19:36:18.243 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:574d9e75:::benchmark_data_smithi188_104537_object49958:head# 2024-04-01T19:36:18.243 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:574daeb3:::benchmark_data_smithi188_104537_object68564:head# 2024-04-01T19:36:18.243 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:574e443e:::benchmark_data_smithi188_104537_object151023:head# 2024-04-01T19:36:18.244 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:36:18.244 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:574e7831:::benchmark_data_smithi188_104537_object161023:head# 2024-04-01T19:36:18.245 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:574e85a5:::benchmark_data_smithi188_104537_object134164:head# 2024-04-01T19:36:18.245 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:574e85cb:::benchmark_data_smithi188_104537_object66885:head# 2024-04-01T19:36:18.245 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:574fea8e:::benchmark_data_smithi188_104537_object92166:head# 2024-04-01T19:36:18.246 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57500f29:::benchmark_data_smithi188_104537_object44270:head# 2024-04-01T19:36:18.246 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57505041:::benchmark_data_smithi188_104537_object28948:head# 2024-04-01T19:36:18.246 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:575062cc:::benchmark_data_smithi188_104537_object38882:head# 2024-04-01T19:36:18.247 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57508cf3:::benchmark_data_smithi188_104537_object47058:head# 2024-04-01T19:36:18.247 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:575094bc:::benchmark_data_smithi188_104537_object80297:head# 2024-04-01T19:36:18.248 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:18.248 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:18 smithi022 ceph-mon[39439]: pgmap v892: 17 pgs: 2 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 13580/321960 objects degraded (4.218%); 51 MiB/s, 808 objects/s recovering 2024-04-01T19:36:18.248 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:18 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:36:18.248 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:18 smithi022 ceph-mon[39439]: from='client.35648 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:36:18.248 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:18 smithi022 ceph-mon[39439]: osdmap e310: 12 total, 11 up, 11 in 2024-04-01T19:36:18.249 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:36:18.250 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57510743:::benchmark_data_smithi188_104537_object72257:head# 2024-04-01T19:36:18.250 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57517fbe:::benchmark_data_smithi188_104537_object32180:head# 2024-04-01T19:36:18.250 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57527940:::benchmark_data_smithi188_104537_object143825:head# 2024-04-01T19:36:18.250 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5752bddc:::benchmark_data_smithi188_104537_object39809:head# 2024-04-01T19:36:18.250 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57533168:::benchmark_data_smithi188_104537_object92526:head# 2024-04-01T19:36:18.250 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57542e24:::benchmark_data_smithi188_104537_object133926:head# 2024-04-01T19:36:18.251 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57545377:::benchmark_data_smithi188_104537_object105498:head# 2024-04-01T19:36:18.251 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:575522e5:::benchmark_data_smithi188_104537_object157534:head# 2024-04-01T19:36:18.252 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5755668c:::benchmark_data_smithi188_104537_object15433:head# 2024-04-01T19:36:18.252 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57557dce:::benchmark_data_smithi188_104537_object137053:head# 2024-04-01T19:36:18.253 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5755cd89:::benchmark_data_smithi188_104537_object155585:head# 2024-04-01T19:36:18.253 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57560a73:::benchmark_data_smithi188_104537_object28440:head# 2024-04-01T19:36:18.254 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57568d2c:::benchmark_data_smithi188_104537_object31049:head# 2024-04-01T19:36:18.255 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5757050b:::benchmark_data_smithi188_104537_object116848:head# 2024-04-01T19:36:18.255 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5757488d:::benchmark_data_smithi188_104537_object68332:head# 2024-04-01T19:36:18.255 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:575754ad:::benchmark_data_smithi188_104537_object169046:head# 2024-04-01T19:36:18.256 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5757bc01:::benchmark_data_smithi188_104537_object133226:head# 2024-04-01T19:36:18.256 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57582fea:::benchmark_data_smithi188_104537_object124457:head# 2024-04-01T19:36:18.257 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5758583d:::benchmark_data_smithi188_104537_object140692:head# 2024-04-01T19:36:18.257 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57587df0:::benchmark_data_smithi188_104537_object89514:head# 2024-04-01T19:36:18.258 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57591499:::benchmark_data_smithi188_104537_object19605:head# 2024-04-01T19:36:18.258 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57599dbe:::benchmark_data_smithi188_104537_object105752:head# 2024-04-01T19:36:18.259 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5759c1fa:::benchmark_data_smithi188_104537_object66167:head# 2024-04-01T19:36:18.259 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:575a361e:::benchmark_data_smithi188_104537_object139479:head# 2024-04-01T19:36:18.259 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:575a464d:::benchmark_data_smithi188_104537_object94632:head# 2024-04-01T19:36:18.260 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:575a6bae:::benchmark_data_smithi188_104537_object102244:head# 2024-04-01T19:36:18.260 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:575b5cc1:::benchmark_data_smithi188_104537_object158830:head# 2024-04-01T19:36:18.261 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:575b7529:::benchmark_data_smithi188_104537_object133012:head# 2024-04-01T19:36:18.261 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:575bfe55:::benchmark_data_smithi188_104537_object134762:head# 2024-04-01T19:36:18.262 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:575c09c2:::benchmark_data_smithi188_104537_object80277:head# 2024-04-01T19:36:18.262 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:575c4eaf:::benchmark_data_smithi188_104537_object163093:head# 2024-04-01T19:36:18.262 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:575c566e:::benchmark_data_smithi188_104537_object47218:head# 2024-04-01T19:36:18.263 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:575c845d:::benchmark_data_smithi188_104537_object38392:head# 2024-04-01T19:36:18.264 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:575c84f1:::benchmark_data_smithi188_104537_object161818:head# 2024-04-01T19:36:18.264 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:575cb5bb:::benchmark_data_smithi188_104537_object171484:head# 2024-04-01T19:36:18.264 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:575cced9:::benchmark_data_smithi188_104537_object170340:head# 2024-04-01T19:36:18.265 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:575d7630:::benchmark_data_smithi188_104537_object152254:head# 2024-04-01T19:36:18.265 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:575df3bf:::benchmark_data_smithi188_104537_object89629:head# 2024-04-01T19:36:18.266 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:575df6e6:::benchmark_data_smithi188_104537_object27009:head# 2024-04-01T19:36:18.266 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:575e3d2e:::benchmark_data_smithi188_104537_object51510:head# 2024-04-01T19:36:18.267 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:575e4156:::benchmark_data_smithi188_104537_object94190:head# 2024-04-01T19:36:18.267 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:575f8a0d:::benchmark_data_smithi188_104537_object146146:head# 2024-04-01T19:36:18.268 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:575fbafa:::benchmark_data_smithi188_104537_object51447:head# 2024-04-01T19:36:18.268 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5760314e:::benchmark_data_smithi188_104537_object13058:head# 2024-04-01T19:36:18.268 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57612193:::benchmark_data_smithi188_104537_object136255:head# 2024-04-01T19:36:18.269 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5761bf79:::benchmark_data_smithi188_104537_object14593:head# 2024-04-01T19:36:18.270 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5761f8da:::benchmark_data_smithi188_104537_object105933:head# 2024-04-01T19:36:18.270 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57622385:::benchmark_data_smithi188_104537_object121684:head# 2024-04-01T19:36:18.270 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5762bd10:::benchmark_data_smithi188_104537_object65764:head# 2024-04-01T19:36:18.271 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5762ddba:::benchmark_data_smithi188_104537_object111971:head# 2024-04-01T19:36:18.271 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5762fec3:::benchmark_data_smithi188_104537_object141936:head# 2024-04-01T19:36:18.272 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:576311ef:::benchmark_data_smithi188_104537_object72641:head# 2024-04-01T19:36:18.272 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:576323e4:::benchmark_data_smithi188_104537_object69506:head# 2024-04-01T19:36:18.272 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:576392a7:::benchmark_data_smithi188_104537_object163531:head# 2024-04-01T19:36:18.273 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5763ca4e:::benchmark_data_smithi188_104537_object39158:head# 2024-04-01T19:36:18.273 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57642a2a:::benchmark_data_smithi188_104537_object120229:head# 2024-04-01T19:36:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:576449f2:::benchmark_data_smithi188_104537_object135257:head# 2024-04-01T19:36:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57645979:::benchmark_data_smithi188_104537_object58282:head# 2024-04-01T19:36:18.275 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:576470ce:::benchmark_data_smithi188_104537_object68214:head# 2024-04-01T19:36:18.275 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57649929:::benchmark_data_smithi188_104537_object150162:head# 2024-04-01T19:36:18.275 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57651834:::benchmark_data_smithi188_104537_object26003:head# 2024-04-01T19:36:18.276 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5765792a:::benchmark_data_smithi188_104537_object170931:head# 2024-04-01T19:36:18.276 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5765a525:::benchmark_data_smithi188_104537_object79818:head# 2024-04-01T19:36:18.277 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5765dcf5:::benchmark_data_smithi188_104537_object50631:head# 2024-04-01T19:36:18.277 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:576641fe:::benchmark_data_smithi188_104537_object39529:head# 2024-04-01T19:36:18.277 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5766875a:::benchmark_data_smithi188_104537_object136433:head# 2024-04-01T19:36:18.278 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5766e886:::benchmark_data_smithi188_104537_object56029:head# 2024-04-01T19:36:18.278 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57677f96:::benchmark_data_smithi188_104537_object42176:head# 2024-04-01T19:36:18.278 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5767a4ac:::benchmark_data_smithi188_104537_object153481:head# 2024-04-01T19:36:18.279 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:576898be:::benchmark_data_smithi188_104537_object107774:head# 2024-04-01T19:36:18.279 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5768cdee:::benchmark_data_smithi188_104537_object52076:head# 2024-04-01T19:36:18.280 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5768ea7b:::benchmark_data_smithi188_104537_object138900:head# 2024-04-01T19:36:18.280 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57693f02:::benchmark_data_smithi188_104537_object52831:head# 2024-04-01T19:36:18.281 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57696780:::benchmark_data_smithi188_104537_object53535:head# 2024-04-01T19:36:18.281 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:576a2ed8:::benchmark_data_smithi188_104537_object158250:head# 2024-04-01T19:36:18.281 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:576b1fdb:::benchmark_data_smithi188_104537_object166409:head# 2024-04-01T19:36:18.282 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:576b8410:::benchmark_data_smithi188_104537_object63373:head# 2024-04-01T19:36:18.282 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:576c9201:::benchmark_data_smithi188_104537_object122477:head# 2024-04-01T19:36:18.283 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:576c9eb7:::benchmark_data_smithi188_104537_object71875:head# 2024-04-01T19:36:18.283 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:576ce8cf:::benchmark_data_smithi188_104537_object119813:head# 2024-04-01T19:36:18.284 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:576d7610:::benchmark_data_smithi188_104537_object79595:head# 2024-04-01T19:36:18.284 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:576e7ae5:::benchmark_data_smithi188_104537_object167766:head# 2024-04-01T19:36:18.284 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:576eaac9:::benchmark_data_smithi188_104537_object41407:head# 2024-04-01T19:36:18.285 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:576f2ba0:::benchmark_data_smithi188_104537_object63083:head# 2024-04-01T19:36:18.285 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:576ff101:::benchmark_data_smithi188_104537_object27158:head# 2024-04-01T19:36:18.286 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57705488:::benchmark_data_smithi188_104537_object169016:head# 2024-04-01T19:36:18.286 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577109d8:::benchmark_data_smithi188_104537_object116582:head# 2024-04-01T19:36:18.287 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577195d4:::benchmark_data_smithi188_104537_object82922:head# 2024-04-01T19:36:18.287 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57721caa:::benchmark_data_smithi188_104537_object124848:head# 2024-04-01T19:36:18.288 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577223cb:::benchmark_data_smithi188_104537_object138782:head# 2024-04-01T19:36:18.288 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57725690:::benchmark_data_smithi188_104537_object111525:head# 2024-04-01T19:36:18.289 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577287e3:::benchmark_data_smithi188_104537_object152749:head# 2024-04-01T19:36:18.289 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57740ce1:::benchmark_data_smithi188_104537_object94384:head# 2024-04-01T19:36:18.290 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5774b4f1:::benchmark_data_smithi188_104537_object116836:head# 2024-04-01T19:36:18.290 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5774baec:::benchmark_data_smithi188_104537_object170435:head# 2024-04-01T19:36:18.290 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5775d63d:::benchmark_data_smithi188_104537_object56342:head# 2024-04-01T19:36:18.291 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57764a68:::benchmark_data_smithi188_104537_object52143:head# 2024-04-01T19:36:18.291 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5776b9e4:::benchmark_data_smithi188_104537_object147488:head# 2024-04-01T19:36:18.291 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5776ccd7:::benchmark_data_smithi188_104537_object75722:head# 2024-04-01T19:36:18.292 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5776f07f:::benchmark_data_smithi188_104537_object124701:head# 2024-04-01T19:36:18.293 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577766ee:::benchmark_data_smithi188_104537_object44754:head# 2024-04-01T19:36:18.293 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5777a04c:::benchmark_data_smithi188_104537_object57228:head# 2024-04-01T19:36:18.293 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577821f5:::benchmark_data_smithi188_104537_object165592:head# 2024-04-01T19:36:18.294 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57784ee0:::benchmark_data_smithi188_104537_object26874:head# 2024-04-01T19:36:18.294 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57789eca:::benchmark_data_smithi188_104537_object24393:head# 2024-04-01T19:36:18.295 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5778acfc:::benchmark_data_smithi188_104537_object86190:head# 2024-04-01T19:36:18.296 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5779a6a7:::benchmark_data_smithi188_104537_object106019:head# 2024-04-01T19:36:18.296 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577a3734:::benchmark_data_smithi188_104537_object111006:head# 2024-04-01T19:36:18.296 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577a7a4f:::benchmark_data_smithi188_104537_object100451:head# 2024-04-01T19:36:18.296 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577a94ad:::benchmark_data_smithi188_104537_object40534:head# 2024-04-01T19:36:18.297 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577ac598:::benchmark_data_smithi188_104537_object130060:head# 2024-04-01T19:36:18.297 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577b75f1:::benchmark_data_smithi188_104537_object22990:head# 2024-04-01T19:36:18.298 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577baeb7:::benchmark_data_smithi188_104537_object125873:head# 2024-04-01T19:36:18.298 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577bdbaf:::benchmark_data_smithi188_104537_object111396:head# 2024-04-01T19:36:18.298 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577bdbf2:::benchmark_data_smithi188_104537_object73991:head# 2024-04-01T19:36:18.299 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577c04a8:::benchmark_data_smithi188_104537_object11002:head# 2024-04-01T19:36:18.299 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577c088c:::benchmark_data_smithi188_104537_object154614:head# 2024-04-01T19:36:18.299 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577c10a4:::benchmark_data_smithi188_104537_object124776:head# 2024-04-01T19:36:18.300 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577c3160:::benchmark_data_smithi188_104537_object94506:head# 2024-04-01T19:36:18.300 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577c9366:::benchmark_data_smithi188_104537_object153675:head# 2024-04-01T19:36:18.300 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577ca324:::benchmark_data_smithi188_104537_object121736:head# 2024-04-01T19:36:18.301 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577cc325:::benchmark_data_smithi188_104537_object89581:head# 2024-04-01T19:36:18.301 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577d41ff:::benchmark_data_smithi188_104537_object67179:head# 2024-04-01T19:36:18.302 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577d9b56:::benchmark_data_smithi188_104537_object128735:head# 2024-04-01T19:36:18.302 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577da86a:::benchmark_data_smithi188_104537_object157168:head# 2024-04-01T19:36:18.302 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577e1373:::benchmark_data_smithi188_104537_object47853:head# 2024-04-01T19:36:18.303 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577e370f:::benchmark_data_smithi188_104537_object147016:head# 2024-04-01T19:36:18.303 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577eb494:::benchmark_data_smithi188_104537_object107184:head# 2024-04-01T19:36:18.304 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577ebef9:::benchmark_data_smithi188_104537_object26839:head# 2024-04-01T19:36:18.304 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577ecf0b:::benchmark_data_smithi188_104537_object38762:head# 2024-04-01T19:36:18.304 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577efb76:::benchmark_data_smithi188_104537_object67604:head# 2024-04-01T19:36:18.305 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577f2aa3:::benchmark_data_smithi188_104537_object20017:head# 2024-04-01T19:36:18.305 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577f92d1:::benchmark_data_smithi188_104537_object17027:head# 2024-04-01T19:36:18.306 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577fc290:::benchmark_data_smithi188_104537_object18131:head# 2024-04-01T19:36:18.306 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:577fe5d1:::benchmark_data_smithi188_104537_object16691:head# 2024-04-01T19:36:18.307 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57808e72:::benchmark_data_smithi188_104537_object85642:head# 2024-04-01T19:36:18.307 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57811f14:::benchmark_data_smithi188_104537_object137922:head# 2024-04-01T19:36:18.307 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57817c21:::benchmark_data_smithi188_104537_object60329:head# 2024-04-01T19:36:18.308 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5781a838:::benchmark_data_smithi188_104537_object165152:head# 2024-04-01T19:36:18.308 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57821ded:::benchmark_data_smithi188_104537_object24128:head# 2024-04-01T19:36:18.309 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:578232d2:::benchmark_data_smithi188_104537_object31854:head# 2024-04-01T19:36:18.309 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57828472:::benchmark_data_smithi188_104537_object51057:head# 2024-04-01T19:36:18.310 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57828934:::benchmark_data_smithi188_104537_object169233:head# 2024-04-01T19:36:18.310 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5782cf4b:::benchmark_data_smithi188_104537_object26586:head# 2024-04-01T19:36:18.311 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57830964:::benchmark_data_smithi188_104537_object55260:head# 2024-04-01T19:36:18.311 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5783174c:::benchmark_data_smithi188_104537_object55128:head# 2024-04-01T19:36:18.312 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:578320e7:::benchmark_data_smithi188_104537_object65007:head# 2024-04-01T19:36:18.313 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:578350c7:::benchmark_data_smithi188_104537_object90850:head# 2024-04-01T19:36:18.313 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57840dd7:::benchmark_data_smithi188_104537_object17889:head# 2024-04-01T19:36:18.314 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57844919:::benchmark_data_smithi188_104537_object37467:head# 2024-04-01T19:36:18.315 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57850b51:::benchmark_data_smithi188_104537_object20385:head# 2024-04-01T19:36:18.316 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57851305:::benchmark_data_smithi188_104537_object93272:head# 2024-04-01T19:36:18.317 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5785580b:::benchmark_data_smithi188_104537_object32056:head# 2024-04-01T19:36:18.318 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5785de4e:::benchmark_data_smithi188_104537_object68448:head# 2024-04-01T19:36:18.318 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5785f361:::benchmark_data_smithi188_104537_object43989:head# 2024-04-01T19:36:18.318 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5786531a:::benchmark_data_smithi188_104537_object101544:head# 2024-04-01T19:36:18.319 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57866152:::benchmark_data_smithi188_104537_object68575:head# 2024-04-01T19:36:18.319 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57866678:::benchmark_data_smithi188_104537_object114660:head# 2024-04-01T19:36:18.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57867416:::benchmark_data_smithi188_104537_object133204:head# 2024-04-01T19:36:18.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5786b4fd:::benchmark_data_smithi188_104537_object164420:head# 2024-04-01T19:36:18.321 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57870dc7:::benchmark_data_smithi188_104537_object152415:head# 2024-04-01T19:36:18.321 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57873b95:::benchmark_data_smithi188_104537_object117575:head# 2024-04-01T19:36:18.322 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5788a65e:::benchmark_data_smithi188_104537_object11156:head# 2024-04-01T19:36:18.322 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5788bc1b:::benchmark_data_smithi188_104537_object72110:head# 2024-04-01T19:36:18.323 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5788ccd7:::benchmark_data_smithi188_104537_object14429:head# 2024-04-01T19:36:18.323 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57893ab1:::benchmark_data_smithi188_104537_object40550:head# 2024-04-01T19:36:18.324 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57895c9f:::benchmark_data_smithi188_104537_object105968:head# 2024-04-01T19:36:18.325 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57897855:::benchmark_data_smithi188_104537_object78720:head# 2024-04-01T19:36:18.325 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:578a48c8:::benchmark_data_smithi188_104537_object126187:head# 2024-04-01T19:36:18.326 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:578b0fe2:::benchmark_data_smithi188_104537_object115364:head# 2024-04-01T19:36:18.326 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:578c5627:::benchmark_data_smithi188_104537_object161030:head# 2024-04-01T19:36:18.326 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:578c8e10:::benchmark_data_smithi188_104537_object108542:head# 2024-04-01T19:36:18.327 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:578cd800:::benchmark_data_smithi188_104537_object164463:head# 2024-04-01T19:36:18.327 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:578d2de7:::benchmark_data_smithi188_104537_object73770:head# 2024-04-01T19:36:18.328 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:578de1bf:::benchmark_data_smithi188_104537_object122395:head# 2024-04-01T19:36:18.328 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:578df8a5:::benchmark_data_smithi188_104537_object126280:head# 2024-04-01T19:36:18.329 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:578e2114:::benchmark_data_smithi188_104537_object108404:head# 2024-04-01T19:36:18.329 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:578efeb5:::benchmark_data_smithi188_104537_object17803:head# 2024-04-01T19:36:18.329 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:578f8969:::benchmark_data_smithi188_104537_object117330:head# 2024-04-01T19:36:18.329 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57908215:::benchmark_data_smithi188_104537_object101953:head# 2024-04-01T19:36:18.330 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57915ad3:::benchmark_data_smithi188_104537_object141488:head# 2024-04-01T19:36:18.330 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5791bfff:::benchmark_data_smithi188_104537_object152067:head# 2024-04-01T19:36:18.331 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57927504:::benchmark_data_smithi188_104537_object57734:head# 2024-04-01T19:36:18.331 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5792efef:::benchmark_data_smithi188_104537_object118160:head# 2024-04-01T19:36:18.332 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57939b99:::benchmark_data_smithi188_104537_object96578:head# 2024-04-01T19:36:18.333 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:579490d7:::benchmark_data_smithi188_104537_object33603:head# 2024-04-01T19:36:18.334 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5795fc58:::benchmark_data_smithi188_104537_object153700:head# 2024-04-01T19:36:18.334 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57964a08:::benchmark_data_smithi188_104537_object97293:head# 2024-04-01T19:36:18.335 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5796c2c6:::benchmark_data_smithi188_104537_object171004:head# 2024-04-01T19:36:18.335 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:579818df:::benchmark_data_smithi188_104537_object143725:head# 2024-04-01T19:36:18.335 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:579855a4:::benchmark_data_smithi188_104537_object127260:head# 2024-04-01T19:36:18.336 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:579857f0:::benchmark_data_smithi188_104537_object102789:head# 2024-04-01T19:36:18.336 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57988fc0:::benchmark_data_smithi188_104537_object122360:head# 2024-04-01T19:36:18.337 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5798c06b:::benchmark_data_smithi188_104537_object149234:head# 2024-04-01T19:36:18.337 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:579a057a:::benchmark_data_smithi188_104537_object162974:head# 2024-04-01T19:36:18.338 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:579aeb29:::benchmark_data_smithi188_104537_object55404:head# 2024-04-01T19:36:18.338 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:579af343:::benchmark_data_smithi188_104537_object87995:head# 2024-04-01T19:36:18.339 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:579b3791:::benchmark_data_smithi188_104537_object156181:head# 2024-04-01T19:36:18.339 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:579b4a32:::benchmark_data_smithi188_104537_object62136:head# 2024-04-01T19:36:18.339 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:579b5528:::benchmark_data_smithi188_104537_object104319:head# 2024-04-01T19:36:18.340 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:579b7297:::benchmark_data_smithi188_104537_object29720:head# 2024-04-01T19:36:18.340 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:579b9fd5:::benchmark_data_smithi188_104537_object166160:head# 2024-04-01T19:36:18.341 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:579bf2a4:::benchmark_data_smithi188_104537_object166526:head# 2024-04-01T19:36:18.342 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:579e260c:::benchmark_data_smithi188_104537_object58024:head# 2024-04-01T19:36:18.342 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:579eee7f:::benchmark_data_smithi188_104537_object73512:head# 2024-04-01T19:36:18.343 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:579f0e22:::benchmark_data_smithi188_104537_object30458:head# 2024-04-01T19:36:18.343 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:579f9949:::benchmark_data_smithi188_104537_object31448:head# 2024-04-01T19:36:18.343 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57a08ecd:::benchmark_data_smithi188_104537_object78766:head# 2024-04-01T19:36:18.343 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57a0d697:::benchmark_data_smithi188_104537_object132743:head# 2024-04-01T19:36:18.344 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57a1074c:::benchmark_data_smithi188_104537_object106853:head# 2024-04-01T19:36:18.344 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57a142e3:::benchmark_data_smithi188_104537_object89819:head# 2024-04-01T19:36:18.345 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57a1690e:::benchmark_data_smithi188_104537_object125087:head# 2024-04-01T19:36:18.345 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57a24402:::benchmark_data_smithi188_104537_object47155:head# 2024-04-01T19:36:18.346 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57a25621:::benchmark_data_smithi188_104537_object135331:head# 2024-04-01T19:36:18.346 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57a3600f:::benchmark_data_smithi188_104537_object16420:head# 2024-04-01T19:36:18.347 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57a3695b:::benchmark_data_smithi188_104537_object142374:head# 2024-04-01T19:36:18.348 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57a38163:::benchmark_data_smithi188_104537_object152853:head# 2024-04-01T19:36:18.348 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57a38439:::benchmark_data_smithi188_104537_object34612:head# 2024-04-01T19:36:18.349 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57a38f3a:::benchmark_data_smithi188_104537_object62636:head# 2024-04-01T19:36:18.349 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57a637ec:::benchmark_data_smithi188_104537_object148699:head# 2024-04-01T19:36:18.349 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:36:18.351 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57a688b6:::benchmark_data_smithi188_104537_object80773:head# 2024-04-01T19:36:18.351 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57a6ada2:::benchmark_data_smithi188_104537_object75858:head# 2024-04-01T19:36:18.351 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57a72fbf:::benchmark_data_smithi188_104537_object24366:head# 2024-04-01T19:36:18.353 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57a7991f:::benchmark_data_smithi188_104537_object35401:head# 2024-04-01T19:36:18.353 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57a79a9a:::benchmark_data_smithi188_104537_object91498:head# 2024-04-01T19:36:18.353 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57a79cff:::benchmark_data_smithi188_104537_object103814:head# 2024-04-01T19:36:18.353 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57a7d43f:::benchmark_data_smithi188_104537_object103519:head# 2024-04-01T19:36:18.353 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57a89803:::benchmark_data_smithi188_104537_object148132:head# 2024-04-01T19:36:18.354 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57aa7bb0:::benchmark_data_smithi188_104537_object95105:head# 2024-04-01T19:36:18.354 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57aad50e:::benchmark_data_smithi188_104537_object101165:head# 2024-04-01T19:36:18.354 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57ab30c7:::benchmark_data_smithi188_104537_object130787:head# 2024-04-01T19:36:18.355 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57ac035b:::benchmark_data_smithi188_104537_object117069:head# 2024-04-01T19:36:18.355 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57ac3ffe:::benchmark_data_smithi188_104537_object97632:head# 2024-04-01T19:36:18.355 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57aca161:::benchmark_data_smithi188_104537_object163491:head# 2024-04-01T19:36:18.356 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57ace93b:::benchmark_data_smithi188_104537_object64963:head# 2024-04-01T19:36:18.356 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57add590:::benchmark_data_smithi188_104537_object98738:head# 2024-04-01T19:36:18.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57ae6993:::benchmark_data_smithi188_104537_object58358:head# 2024-04-01T19:36:18.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57ae94d9:::benchmark_data_smithi188_104537_object164189:head# 2024-04-01T19:36:18.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57ae9dda:::benchmark_data_smithi188_104537_object67458:head# 2024-04-01T19:36:18.358 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57aedd94:::benchmark_data_smithi188_104537_object93562:head# 2024-04-01T19:36:18.358 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57aef2cd:::benchmark_data_smithi188_104537_object97006:head# 2024-04-01T19:36:18.359 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57afaebc:::benchmark_data_smithi188_104537_object72433:head# 2024-04-01T19:36:18.359 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57afd22c:::benchmark_data_smithi188_104537_object14600:head# 2024-04-01T19:36:18.359 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57aff600:::benchmark_data_smithi188_104537_object124579:head# 2024-04-01T19:36:18.360 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57b0bd16:::benchmark_data_smithi188_104537_object121806:head# 2024-04-01T19:36:18.360 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57b17dcd:::benchmark_data_smithi188_104537_object93872:head# 2024-04-01T19:36:18.361 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57b1a40a:::benchmark_data_smithi188_104537_object55785:head# 2024-04-01T19:36:18.361 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57b1a488:::benchmark_data_smithi188_104537_object17714:head# 2024-04-01T19:36:18.361 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57b1c4dc:::benchmark_data_smithi188_104537_object88723:head# 2024-04-01T19:36:18.362 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57b2dd4e:::benchmark_data_smithi188_104537_object128474:head# 2024-04-01T19:36:18.362 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57b421ad:::benchmark_data_smithi188_104537_object78718:head# 2024-04-01T19:36:18.363 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57b47144:::benchmark_data_smithi188_104537_object90689:head# 2024-04-01T19:36:18.363 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57b49684:::benchmark_data_smithi188_104537_object82204:head# 2024-04-01T19:36:18.364 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57b4a3d6:::benchmark_data_smithi188_104537_object61348:head# 2024-04-01T19:36:18.364 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57b6b593:::benchmark_data_smithi188_104537_object108759:head# 2024-04-01T19:36:18.364 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57b7102d:::benchmark_data_smithi188_104537_object168277:head# 2024-04-01T19:36:18.365 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57b73354:::benchmark_data_smithi188_104537_object61420:head# 2024-04-01T19:36:18.365 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57b77f16:::benchmark_data_smithi188_104537_object74866:head# 2024-04-01T19:36:18.366 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57b7c271:::benchmark_data_smithi188_104537_object11416:head# 2024-04-01T19:36:18.366 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57b7c31e:::benchmark_data_smithi188_104537_object156829:head# 2024-04-01T19:36:18.366 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57b865c5:::benchmark_data_smithi188_104537_object155941:head# 2024-04-01T19:36:18.367 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57b883d1:::benchmark_data_smithi188_104537_object170382:head# 2024-04-01T19:36:18.367 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57b8bb9a:::benchmark_data_smithi188_104537_object94620:head# 2024-04-01T19:36:18.368 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57b8d7d9:::benchmark_data_smithi188_104537_object51360:head# 2024-04-01T19:36:18.368 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57b92dd4:::benchmark_data_smithi188_104537_object17569:head# 2024-04-01T19:36:18.369 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57b96eb5:::benchmark_data_smithi188_104537_object165875:head# 2024-04-01T19:36:18.369 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57ba8ec4:::benchmark_data_smithi188_104537_object142051:head# 2024-04-01T19:36:18.370 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57ba96ff:::benchmark_data_smithi188_104537_object104468:head# 2024-04-01T19:36:18.370 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57bb212e:::benchmark_data_smithi188_104537_object89925:head# 2024-04-01T19:36:18.371 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57bb63d8:::benchmark_data_smithi188_104537_object79023:head# 2024-04-01T19:36:18.371 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57bbd652:::benchmark_data_smithi188_104537_object31117:head# 2024-04-01T19:36:18.372 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57bd627c:::benchmark_data_smithi188_104537_object35387:head# 2024-04-01T19:36:18.372 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57be3bab:::benchmark_data_smithi188_104537_object121511:head# 2024-04-01T19:36:18.373 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57beaad2:::benchmark_data_smithi188_104537_object114752:head# 2024-04-01T19:36:18.373 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57bf3800:::benchmark_data_smithi188_104537_object83732:head# 2024-04-01T19:36:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:18 smithi188 ceph-mon[43939]: pgmap v892: 17 pgs: 2 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 13580/321960 objects degraded (4.218%); 51 MiB/s, 808 objects/s recovering 2024-04-01T19:36:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:18 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:36:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:18 smithi188 ceph-mon[43939]: from='client.35648 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:36:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:18 smithi188 ceph-mon[43939]: osdmap e310: 12 total, 11 up, 11 in 2024-04-01T19:36:18.375 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57bfcf82:::benchmark_data_smithi188_104537_object106620:head# 2024-04-01T19:36:18.375 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57c00b8b:::benchmark_data_smithi188_104537_object12065:head# 2024-04-01T19:36:18.375 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57c023aa:::benchmark_data_smithi188_104537_object162677:head# 2024-04-01T19:36:18.375 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57c0363c:::benchmark_data_smithi188_104537_object31069:head# 2024-04-01T19:36:18.376 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57c0b0cf:::benchmark_data_smithi188_104537_object136588:head# 2024-04-01T19:36:18.376 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57c24eb0:::benchmark_data_smithi188_104537_object41435:head# 2024-04-01T19:36:18.378 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57c25fa4:::benchmark_data_smithi188_104537_object169460:head# 2024-04-01T19:36:18.378 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57c27783:::benchmark_data_smithi188_104537_object114062:head# 2024-04-01T19:36:18.378 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57c2ef39:::benchmark_data_smithi188_104537_object27973:head# 2024-04-01T19:36:18.378 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57c35201:::benchmark_data_smithi188_104537_object122607:head# 2024-04-01T19:36:18.378 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57c51585:::benchmark_data_smithi188_104537_object150585:head# 2024-04-01T19:36:18.379 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57c546c4:::benchmark_data_smithi188_104537_object153086:head# 2024-04-01T19:36:18.379 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:18 smithi062 ceph-mon[44211]: pgmap v892: 17 pgs: 2 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 13580/321960 objects degraded (4.218%); 51 MiB/s, 808 objects/s recovering 2024-04-01T19:36:18.379 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:18 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:36:18.379 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:18 smithi062 ceph-mon[44211]: from='client.35648 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:36:18.379 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:18 smithi062 ceph-mon[44211]: osdmap e310: 12 total, 11 up, 11 in 2024-04-01T19:36:18.380 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57c587bd:::benchmark_data_smithi188_104537_object51733:head# 2024-04-01T19:36:18.380 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57c61680:::benchmark_data_smithi188_104537_object125088:head# 2024-04-01T19:36:18.380 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57c6604e:::benchmark_data_smithi188_104537_object154436:head# 2024-04-01T19:36:18.380 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57c67971:::benchmark_data_smithi188_104537_object164209:head# 2024-04-01T19:36:18.381 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57c70eb0:::benchmark_data_smithi188_104537_object107660:head# 2024-04-01T19:36:18.381 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57c79ec0:::benchmark_data_smithi188_104537_object120331:head# 2024-04-01T19:36:18.381 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57c7df70:::benchmark_data_smithi188_104537_object85636:head# 2024-04-01T19:36:18.382 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:18.382 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57c84dc8:::benchmark_data_smithi188_104537_object111912:head# 2024-04-01T19:36:18.382 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57c87405:::benchmark_data_smithi188_104537_object39170:head# 2024-04-01T19:36:18.382 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57c8c153:::benchmark_data_smithi188_104537_object37312:head# 2024-04-01T19:36:18.383 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57cb1c18:::benchmark_data_smithi188_104537_object156195:head# 2024-04-01T19:36:18.383 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57cb5b04:::benchmark_data_smithi188_104537_object86529:head# 2024-04-01T19:36:18.384 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57cbc4f8:::benchmark_data_smithi188_104537_object137164:head# 2024-04-01T19:36:18.384 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57cc0c76:::benchmark_data_smithi188_104537_object76662:head# 2024-04-01T19:36:18.385 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57cc1bcf:::benchmark_data_smithi188_104537_object42788:head# 2024-04-01T19:36:18.385 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57cc61d0:::benchmark_data_smithi188_104537_object158538:head# 2024-04-01T19:36:18.385 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57cce93b:::benchmark_data_smithi188_104537_object121108:head# 2024-04-01T19:36:18.386 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57cd3900:::benchmark_data_smithi188_104537_object171417:head# 2024-04-01T19:36:18.386 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57cd9b80:::benchmark_data_smithi188_104537_object107759:head# 2024-04-01T19:36:18.387 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57ce7f9a:::benchmark_data_smithi188_104537_object23641:head# 2024-04-01T19:36:18.387 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57ce83fd:::benchmark_data_smithi188_104537_object104869:head# 2024-04-01T19:36:18.388 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57ce8ecd:::benchmark_data_smithi188_104537_object144861:head# 2024-04-01T19:36:18.388 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57ceb2cb:::benchmark_data_smithi188_104537_object35899:head# 2024-04-01T19:36:18.389 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57ced45e:::benchmark_data_smithi188_104537_object113093:head# 2024-04-01T19:36:18.389 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57ced797:::benchmark_data_smithi188_104537_object55739:head# 2024-04-01T19:36:18.390 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57cf0314:::benchmark_data_smithi188_104537_object111925:head# 2024-04-01T19:36:18.390 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57cfc0eb:::benchmark_data_smithi188_104537_object117367:head# 2024-04-01T19:36:18.396 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d02b92:::benchmark_data_smithi188_104537_object127915:head# 2024-04-01T19:36:18.396 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d06e17:::benchmark_data_smithi188_104537_object159899:head# 2024-04-01T19:36:18.396 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d087cf:::benchmark_data_smithi188_104537_object145161:head# 2024-04-01T19:36:18.396 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d153ae:::benchmark_data_smithi188_104537_object11834:head# 2024-04-01T19:36:18.396 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d16a5d:::benchmark_data_smithi188_104537_object75074:head# 2024-04-01T19:36:18.396 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d1dfd1:::benchmark_data_smithi188_104537_object68479:head# 2024-04-01T19:36:18.396 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d1e737:::benchmark_data_smithi188_104537_object52234:head# 2024-04-01T19:36:18.396 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d254f6:::benchmark_data_smithi188_104537_object81407:head# 2024-04-01T19:36:18.396 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d258c9:::benchmark_data_smithi188_104537_object93442:head# 2024-04-01T19:36:18.396 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d32e50:::benchmark_data_smithi188_104537_object50656:head# 2024-04-01T19:36:18.396 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d3440a:::benchmark_data_smithi188_104537_object73984:head# 2024-04-01T19:36:18.397 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d34ed7:::benchmark_data_smithi188_104537_object67797:head# 2024-04-01T19:36:18.397 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d3e544:::benchmark_data_smithi188_104537_object59342:head# 2024-04-01T19:36:18.397 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d41720:::benchmark_data_smithi188_104537_object141701:head# 2024-04-01T19:36:18.398 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d435f5:::benchmark_data_smithi188_104537_object150208:head# 2024-04-01T19:36:18.398 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d4ffe9:::benchmark_data_smithi188_104537_object24838:head# 2024-04-01T19:36:18.398 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d50fa7:::benchmark_data_smithi188_104537_object48571:head# 2024-04-01T19:36:18.398 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d6057e:::benchmark_data_smithi188_104537_object36063:head# 2024-04-01T19:36:18.399 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d69b7b:::benchmark_data_smithi188_104537_object20507:head# 2024-04-01T19:36:18.399 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d7205a:::benchmark_data_smithi188_104537_object156087:head# 2024-04-01T19:36:18.399 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d81467:::benchmark_data_smithi188_104537_object153178:head# 2024-04-01T19:36:18.400 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d8245e:::benchmark_data_smithi188_104537_object81103:head# 2024-04-01T19:36:18.400 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d8314d:::benchmark_data_smithi188_104537_object127767:head# 2024-04-01T19:36:18.401 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d8c596:::benchmark_data_smithi188_104537_object136625:head# 2024-04-01T19:36:18.401 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d8f608:::benchmark_data_smithi188_104537_object64728:head# 2024-04-01T19:36:18.402 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d909ee:::benchmark_data_smithi188_104537_object158821:head# 2024-04-01T19:36:18.402 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d99b27:::benchmark_data_smithi188_104537_object104531:head# 2024-04-01T19:36:18.402 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d9aa93:::benchmark_data_smithi188_104537_object113775:head# 2024-04-01T19:36:18.403 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57d9e91c:::benchmark_data_smithi188_104537_object27161:head# 2024-04-01T19:36:18.404 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57dad3a9:::benchmark_data_smithi188_104537_object13911:head# 2024-04-01T19:36:18.404 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57db23a1:::benchmark_data_smithi188_104537_object86562:head# 2024-04-01T19:36:18.405 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57db40fb:::benchmark_data_smithi188_104537_object105228:head# 2024-04-01T19:36:18.405 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57dc0cb0:::benchmark_data_smithi188_104537_object139564:head# 2024-04-01T19:36:18.405 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57deccd6:::benchmark_data_smithi188_104537_object66728:head# 2024-04-01T19:36:18.406 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57dedf1a:::benchmark_data_smithi188_104537_object132402:head# 2024-04-01T19:36:18.406 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57df2fd2:::benchmark_data_smithi188_104537_object168203:head# 2024-04-01T19:36:18.406 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57df359c:::benchmark_data_smithi188_104537_object51052:head# 2024-04-01T19:36:18.407 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57dfd50d:::benchmark_data_smithi188_104537_object169192:head# 2024-04-01T19:36:18.407 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57e0a38f:::benchmark_data_smithi188_104537_object81126:head# 2024-04-01T19:36:18.408 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57e0fff8:::benchmark_data_smithi188_104537_object148793:head# 2024-04-01T19:36:18.408 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57e2525e:::benchmark_data_smithi188_104537_object129637:head# 2024-04-01T19:36:18.409 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57e27208:::benchmark_data_smithi188_104537_object102311:head# 2024-04-01T19:36:18.409 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57e33733:::benchmark_data_smithi188_104537_object35021:head# 2024-04-01T19:36:18.409 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57e38c9a:::benchmark_data_smithi188_104537_object171277:head# 2024-04-01T19:36:18.410 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57e3eb98:::benchmark_data_smithi188_104537_object81563:head# 2024-04-01T19:36:18.411 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57e47bb3:::benchmark_data_smithi188_104537_object139390:head# 2024-04-01T19:36:18.411 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57e62cd4:::benchmark_data_smithi188_104537_object11240:head# 2024-04-01T19:36:18.411 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57e69bca:::benchmark_data_smithi188_104537_object139063:head# 2024-04-01T19:36:18.412 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57e7d15a:::benchmark_data_smithi188_104537_object104951:head# 2024-04-01T19:36:18.412 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57e7f090:::benchmark_data_smithi188_104537_object168984:head# 2024-04-01T19:36:18.413 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57e8fa97:::benchmark_data_smithi188_104537_object113958:head# 2024-04-01T19:36:18.413 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57e91658:::benchmark_data_smithi188_104537_object54794:head# 2024-04-01T19:36:18.414 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57e918c6:::benchmark_data_smithi188_104537_object75162:head# 2024-04-01T19:36:18.414 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57e926d6:::benchmark_data_smithi188_104537_object110682:head# 2024-04-01T19:36:18.415 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57e96229:::benchmark_data_smithi188_104537_object26535:head# 2024-04-01T19:36:18.415 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57e9a11c:::benchmark_data_smithi188_104537_object147030:head# 2024-04-01T19:36:18.416 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57eafd00:::benchmark_data_smithi188_104537_object109012:head# 2024-04-01T19:36:18.416 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57eb795a:::benchmark_data_smithi188_104537_object147331:head# 2024-04-01T19:36:18.416 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57ebb04a:::benchmark_data_smithi188_104537_object101505:head# 2024-04-01T19:36:18.417 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57ebccf5:::benchmark_data_smithi188_104537_object106856:head# 2024-04-01T19:36:18.417 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57ec7fe3:::benchmark_data_smithi188_104537_object47022:head# 2024-04-01T19:36:18.418 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57ed2276:::benchmark_data_smithi188_104537_object164968:head# 2024-04-01T19:36:18.418 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57ed76e3:::benchmark_data_smithi188_104537_object77206:head# 2024-04-01T19:36:18.418 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57ed9c3c:::benchmark_data_smithi188_104537_object81836:head# 2024-04-01T19:36:18.419 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57edec72:::benchmark_data_smithi188_104537_object163461:head# 2024-04-01T19:36:18.419 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57edf983:::benchmark_data_smithi188_104537_object164574:head# 2024-04-01T19:36:18.420 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57edff7c:::benchmark_data_smithi188_104537_object89551:head# 2024-04-01T19:36:18.420 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57ee6ce7:::benchmark_data_smithi188_104537_object46689:head# 2024-04-01T19:36:18.421 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57eeaff4:::benchmark_data_smithi188_104537_object92487:head# 2024-04-01T19:36:18.421 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57eebfd3:::benchmark_data_smithi188_104537_object138150:head# 2024-04-01T19:36:18.422 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57ef8ccb:::benchmark_data_smithi188_104537_object117340:head# 2024-04-01T19:36:18.422 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f02526:::benchmark_data_smithi188_104537_object13513:head# 2024-04-01T19:36:18.423 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f07789:::benchmark_data_smithi188_104537_object52906:head# 2024-04-01T19:36:18.423 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f11c60:::benchmark_data_smithi188_104537_object16662:head# 2024-04-01T19:36:18.423 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f14bad:::benchmark_data_smithi188_104537_object100714:head# 2024-04-01T19:36:18.424 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f1b2dd:::benchmark_data_smithi188_104537_object133191:head# 2024-04-01T19:36:18.424 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f1cc91:::benchmark_data_smithi188_104537_object17424:head# 2024-04-01T19:36:18.425 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f1db4a:::benchmark_data_smithi188_104537_object90870:head# 2024-04-01T19:36:18.426 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f2d580:::benchmark_data_smithi188_104537_object111160:head# 2024-04-01T19:36:18.426 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f37168:::benchmark_data_smithi188_104537_object102752:head# 2024-04-01T19:36:18.426 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f3df90:::benchmark_data_smithi188_104537_object155010:head# 2024-04-01T19:36:18.427 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f40696:::benchmark_data_smithi188_104537_object169502:head# 2024-04-01T19:36:18.427 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f420c5:::benchmark_data_smithi188_104537_object36502:head# 2024-04-01T19:36:18.428 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f4d7d6:::benchmark_data_smithi188_104537_object87931:head# 2024-04-01T19:36:18.428 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f4dea6:::benchmark_data_smithi188_104537_object51584:head# 2024-04-01T19:36:18.429 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f4e4f7:::benchmark_data_smithi188_104537_object78743:head# 2024-04-01T19:36:18.429 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f5b817:::benchmark_data_smithi188_104537_object105308:head# 2024-04-01T19:36:18.430 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f63678:::benchmark_data_smithi188_104537_object17624:head# 2024-04-01T19:36:18.430 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f6a1a9:::benchmark_data_smithi188_104537_object123191:head# 2024-04-01T19:36:18.431 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f6f4ff:::benchmark_data_smithi188_104537_object111238:head# 2024-04-01T19:36:18.431 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f730b9:::benchmark_data_smithi188_104537_object133719:head# 2024-04-01T19:36:18.432 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f74d49:::benchmark_data_smithi188_104537_object17623:head# 2024-04-01T19:36:18.432 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f7f195:::benchmark_data_smithi188_104537_object96558:head# 2024-04-01T19:36:18.432 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f8727b:::benchmark_data_smithi188_104537_object118244:head# 2024-04-01T19:36:18.433 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f8e0c7:::benchmark_data_smithi188_104537_object93093:head# 2024-04-01T19:36:18.433 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f952b8:::benchmark_data_smithi188_104537_object125703:head# 2024-04-01T19:36:18.434 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f96710:::benchmark_data_smithi188_104537_object121450:head# 2024-04-01T19:36:18.434 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57f9ed7e:::benchmark_data_smithi188_104537_object143510:head# 2024-04-01T19:36:18.434 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57fa1533:::benchmark_data_smithi188_104537_object133322:head# 2024-04-01T19:36:18.435 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57fa8c32:::benchmark_data_smithi188_104537_object23654:head# 2024-04-01T19:36:18.435 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57fbb697:::benchmark_data_smithi188_104537_object75712:head# 2024-04-01T19:36:18.436 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57fbd0ff:::benchmark_data_smithi188_104537_object56415:head# 2024-04-01T19:36:18.436 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57fbd9f6:::benchmark_data_smithi188_104537_object105798:head# 2024-04-01T19:36:18.437 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57fc0208:::benchmark_data_smithi188_104537_object155015:head# 2024-04-01T19:36:18.437 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57fd301b:::benchmark_data_smithi188_104537_object153355:head# 2024-04-01T19:36:18.438 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57fd5abe:::benchmark_data_smithi188_104537_object156508:head# 2024-04-01T19:36:18.438 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57fdf9f6:::benchmark_data_smithi188_104537_object114519:head# 2024-04-01T19:36:18.439 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57fe0654:::benchmark_data_smithi188_104537_object142850:head# 2024-04-01T19:36:18.439 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57fe9797:::benchmark_data_smithi188_104537_object31296:head# 2024-04-01T19:36:18.439 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:57ff9280:::benchmark_data_smithi188_104537_object36681:head# 2024-04-01T19:36:18.440 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:580001ad:::benchmark_data_smithi188_104537_object136535:head# 2024-04-01T19:36:18.440 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:580011f0:::benchmark_data_smithi188_104537_object59230:head# 2024-04-01T19:36:18.441 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:580034b7:::benchmark_data_smithi188_104537_object18887:head# 2024-04-01T19:36:18.441 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58004ea3:::benchmark_data_smithi188_104537_object17465:head# 2024-04-01T19:36:18.442 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5800e8ff:::benchmark_data_smithi188_104537_object58372:head# 2024-04-01T19:36:18.442 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58018669:::benchmark_data_smithi188_104537_object86552:head# 2024-04-01T19:36:18.442 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58019f54:::benchmark_data_smithi188_104537_object125815:head# 2024-04-01T19:36:18.443 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:580249e5:::benchmark_data_smithi188_104537_object29622:head# 2024-04-01T19:36:18.443 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58025d5d:::benchmark_data_smithi188_104537_object159999:head# 2024-04-01T19:36:18.444 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5802abf9:::benchmark_data_smithi188_104537_object26329:head# 2024-04-01T19:36:18.444 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58032589:::benchmark_data_smithi188_104537_object93168:head# 2024-04-01T19:36:18.444 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5803368c:::benchmark_data_smithi188_104537_object68315:head# 2024-04-01T19:36:18.445 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:580374e1:::benchmark_data_smithi188_104537_object63965:head# 2024-04-01T19:36:18.445 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5803c917:::benchmark_data_smithi188_104537_object66696:head# 2024-04-01T19:36:18.446 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58042944:::benchmark_data_smithi188_104537_object84783:head# 2024-04-01T19:36:18.446 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:580441ec:::benchmark_data_smithi188_104537_object48978:head# 2024-04-01T19:36:18.446 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5804df35:::benchmark_data_smithi188_104537_object148306:head# 2024-04-01T19:36:18.447 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58056677:::benchmark_data_smithi188_104537_object65991:head# 2024-04-01T19:36:18.447 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58057cc2:::benchmark_data_smithi188_104537_object154317:head# 2024-04-01T19:36:18.448 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5805985b:::benchmark_data_smithi188_104537_object17864:head# 2024-04-01T19:36:18.448 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5805fa82:::benchmark_data_smithi188_104537_object19267:head# 2024-04-01T19:36:18.449 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5806b81a:::benchmark_data_smithi188_104537_object57860:head# 2024-04-01T19:36:18.449 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5807ac34:::benchmark_data_smithi188_104537_object40685:head# 2024-04-01T19:36:18.450 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5808a50f:::benchmark_data_smithi188_104537_object52994:head# 2024-04-01T19:36:18.450 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5808afa7:::benchmark_data_smithi188_104537_object31762:head# 2024-04-01T19:36:18.450 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58093281:::benchmark_data_smithi188_104537_object40530:head# 2024-04-01T19:36:18.451 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:580943c1:::benchmark_data_smithi188_104537_object11752:head# 2024-04-01T19:36:18.451 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58094543:::benchmark_data_smithi188_104537_object57343:head# 2024-04-01T19:36:18.452 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:580a5be0:::benchmark_data_smithi188_104537_object24927:head# 2024-04-01T19:36:18.452 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:580a66c8:::benchmark_data_smithi188_104537_object27149:head# 2024-04-01T19:36:18.453 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:580b1012:::benchmark_data_smithi188_104537_object96715:head# 2024-04-01T19:36:18.453 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:580b33d8:::benchmark_data_smithi188_104537_object22263:head# 2024-04-01T19:36:18.454 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:580c6a7a:::benchmark_data_smithi188_104537_object139793:head# 2024-04-01T19:36:18.454 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:580cb127:::benchmark_data_smithi188_104537_object96843:head# 2024-04-01T19:36:18.455 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:580d1d18:::benchmark_data_smithi188_104537_object63704:head# 2024-04-01T19:36:18.456 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:580d8b75:::benchmark_data_smithi188_104537_object59060:head# 2024-04-01T19:36:18.456 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:580db16e:::benchmark_data_smithi188_104537_object99315:head# 2024-04-01T19:36:18.457 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:580e3980:::benchmark_data_smithi188_104537_object107762:head# 2024-04-01T19:36:18.457 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:580ec146:::benchmark_data_smithi188_104537_object148118:head# 2024-04-01T19:36:18.457 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:580efcbb:::benchmark_data_smithi188_104537_object106144:head# 2024-04-01T19:36:18.458 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:580f7182:::benchmark_data_smithi188_104537_object75893:head# 2024-04-01T19:36:18.458 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:580fc634:::benchmark_data_smithi188_104537_object118343:head# 2024-04-01T19:36:18.459 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58103d92:::benchmark_data_smithi188_104537_object17004:head# 2024-04-01T19:36:18.459 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5810676a:::benchmark_data_smithi188_104537_object162490:head# 2024-04-01T19:36:18.460 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5810e05a:::benchmark_data_smithi188_104537_object65632:head# 2024-04-01T19:36:18.460 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58116f8a:::benchmark_data_smithi188_104537_object149438:head# 2024-04-01T19:36:18.461 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58119891:::benchmark_data_smithi188_104537_object73845:head# 2024-04-01T19:36:18.461 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58119b5f:::benchmark_data_smithi188_104537_object75346:head# 2024-04-01T19:36:18.461 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58122ae1:::benchmark_data_smithi188_104537_object151659:head# 2024-04-01T19:36:18.462 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5812fccf:::benchmark_data_smithi188_104537_object77381:head# 2024-04-01T19:36:18.462 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58131554:::benchmark_data_smithi188_104537_object65552:head# 2024-04-01T19:36:18.463 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5813a82f:::benchmark_data_smithi188_104537_object98958:head# 2024-04-01T19:36:18.463 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5813da4d:::benchmark_data_smithi188_104537_object31998:head# 2024-04-01T19:36:18.464 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5814669e:::benchmark_data_smithi188_104537_object128887:head# 2024-04-01T19:36:18.465 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5814ded5:::benchmark_data_smithi188_104537_object122677:head# 2024-04-01T19:36:18.465 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58153702:::benchmark_data_smithi188_104537_object62842:head# 2024-04-01T19:36:18.465 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58154cf2:::benchmark_data_smithi188_104537_object153569:head# 2024-04-01T19:36:18.466 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58155ce9:::benchmark_data_smithi188_104537_object69799:head# 2024-04-01T19:36:18.466 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5815a3fa:::benchmark_data_smithi188_104537_object132267:head# 2024-04-01T19:36:18.467 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5815df10:::benchmark_data_smithi188_104537_object123230:head# 2024-04-01T19:36:18.467 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5815e3b4:::benchmark_data_smithi188_104537_object121150:head# 2024-04-01T19:36:18.468 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5816dcc5:::benchmark_data_smithi188_104537_object72620:head# 2024-04-01T19:36:18.468 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58170a70:::benchmark_data_smithi188_104537_object149687:head# 2024-04-01T19:36:18.469 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5817422f:::benchmark_data_smithi188_104537_object140834:head# 2024-04-01T19:36:18.469 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5817a591:::benchmark_data_smithi188_104537_object107924:head# 2024-04-01T19:36:18.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5817d8db:::benchmark_data_smithi188_104537_object89637:head# 2024-04-01T19:36:18.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5818b5c9:::benchmark_data_smithi188_104537_object124160:head# 2024-04-01T19:36:18.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58190126:::benchmark_data_smithi188_104537_object134461:head# 2024-04-01T19:36:18.471 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58195e71:::benchmark_data_smithi188_104537_object163326:head# 2024-04-01T19:36:18.472 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58198f87:::benchmark_data_smithi188_104537_object140123:head# 2024-04-01T19:36:18.472 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5819aa8d:::benchmark_data_smithi188_104537_object101333:head# 2024-04-01T19:36:18.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:581a12f5:::benchmark_data_smithi188_104537_object160236:head# 2024-04-01T19:36:18.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:581a74d1:::benchmark_data_smithi188_104537_object38351:head# 2024-04-01T19:36:18.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:581a87d0:::benchmark_data_smithi188_104537_object19758:head# 2024-04-01T19:36:18.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:581a9223:::benchmark_data_smithi188_104537_object136651:head# 2024-04-01T19:36:18.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:581ba07f:::benchmark_data_smithi188_104537_object89555:head# 2024-04-01T19:36:18.475 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:581ba1cd:::benchmark_data_smithi188_104537_object27003:head# 2024-04-01T19:36:18.475 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:581bfa2d:::benchmark_data_smithi188_104537_object132916:head# 2024-04-01T19:36:18.475 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:581c1008:::benchmark_data_smithi188_104537_object73391:head# 2024-04-01T19:36:18.476 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:581c29de:::benchmark_data_smithi188_104537_object121929:head# 2024-04-01T19:36:18.476 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:581c40af:::benchmark_data_smithi188_104537_object47703:head# 2024-04-01T19:36:18.477 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:581c4d10:::benchmark_data_smithi188_104537_object165843:head# 2024-04-01T19:36:18.477 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:581cfcba:::benchmark_data_smithi188_104537_object35264:head# 2024-04-01T19:36:18.478 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:581d1cfc:::benchmark_data_smithi188_104537_object76826:head# 2024-04-01T19:36:18.478 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:581d6deb:::benchmark_data_smithi188_104537_object65968:head# 2024-04-01T19:36:18.478 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:581dea76:::benchmark_data_smithi188_104537_object94196:head# 2024-04-01T19:36:18.479 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:581e2ebc:::benchmark_data_smithi188_104537_object103340:head# 2024-04-01T19:36:18.480 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:581f90e9:::benchmark_data_smithi188_104537_object44113:head# 2024-04-01T19:36:18.480 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5820025a:::benchmark_data_smithi188_104537_object143601:head# 2024-04-01T19:36:18.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5820f7ea:::benchmark_data_smithi188_104537_object85256:head# 2024-04-01T19:36:18.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58229e7c:::benchmark_data_smithi188_104537_object138359:head# 2024-04-01T19:36:18.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:582300b6:::benchmark_data_smithi188_104537_object140329:head# 2024-04-01T19:36:18.482 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58239e66:::benchmark_data_smithi188_104537_object89778:head# 2024-04-01T19:36:18.482 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5823dc09:::benchmark_data_smithi188_104537_object167642:head# 2024-04-01T19:36:18.483 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5824f2d2:::benchmark_data_smithi188_104537_object114677:head# 2024-04-01T19:36:18.483 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5825153c:::benchmark_data_smithi188_104537_object96361:head# 2024-04-01T19:36:18.483 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58254ea3:::benchmark_data_smithi188_104537_object134271:head# 2024-04-01T19:36:18.484 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5825d4cd:::benchmark_data_smithi188_104537_object82065:head# 2024-04-01T19:36:18.484 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:582608fb:::benchmark_data_smithi188_104537_object132307:head# 2024-04-01T19:36:18.485 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5826cc72:::benchmark_data_smithi188_104537_object145104:head# 2024-04-01T19:36:18.485 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5826e6d1:::benchmark_data_smithi188_104537_object91894:head# 2024-04-01T19:36:18.486 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58273161:::benchmark_data_smithi188_104537_object155232:head# 2024-04-01T19:36:18.486 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58276faf:::benchmark_data_smithi188_104537_object149100:head# 2024-04-01T19:36:18.486 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5827c10b:::benchmark_data_smithi188_104537_object101405:head# 2024-04-01T19:36:18.487 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5827c9c7:::benchmark_data_smithi188_104537_object37774:head# 2024-04-01T19:36:18.487 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5827f745:::benchmark_data_smithi188_104537_object25196:head# 2024-04-01T19:36:18.488 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5828120e:::benchmark_data_smithi188_104537_object56570:head# 2024-04-01T19:36:18.488 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58281b7c:::benchmark_data_smithi188_104537_object45578:head# 2024-04-01T19:36:18.489 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58282c80:::benchmark_data_smithi188_104537_object163452:head# 2024-04-01T19:36:18.490 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5828db96:::benchmark_data_smithi188_104537_object151228:head# 2024-04-01T19:36:18.490 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58294afa:::benchmark_data_smithi188_104537_object71896:head# 2024-04-01T19:36:18.491 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58298bed:::benchmark_data_smithi188_104537_object31663:head# 2024-04-01T19:36:18.491 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:582a1eb3:::benchmark_data_smithi188_104537_object145005:head# 2024-04-01T19:36:18.491 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:582ab647:::benchmark_data_smithi188_104537_object155353:head# 2024-04-01T19:36:18.492 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:582b59fe:::benchmark_data_smithi188_104537_object47000:head# 2024-04-01T19:36:18.492 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:582d1c2b:::benchmark_data_smithi188_104537_object92002:head# 2024-04-01T19:36:18.493 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:582db24c:::benchmark_data_smithi188_104537_object65306:head# 2024-04-01T19:36:18.493 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:582dc9a3:::benchmark_data_smithi188_104537_object76980:head# 2024-04-01T19:36:18.494 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:582e9ecd:::benchmark_data_smithi188_104537_object34688:head# 2024-04-01T19:36:18.494 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:582f2824:::benchmark_data_smithi188_104537_object123025:head# 2024-04-01T19:36:18.495 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58300043:::benchmark_data_smithi188_104537_object61879:head# 2024-04-01T19:36:18.496 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58306ef9:::benchmark_data_smithi188_104537_object65821:head# 2024-04-01T19:36:18.496 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5830a601:::benchmark_data_smithi188_104537_object129772:head# 2024-04-01T19:36:18.496 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5830c193:::benchmark_data_smithi188_104537_object143456:head# 2024-04-01T19:36:18.497 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5830d4a9:::benchmark_data_smithi188_104537_object152549:head# 2024-04-01T19:36:18.497 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58318f6a:::benchmark_data_smithi188_104537_object30732:head# 2024-04-01T19:36:18.498 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:583235df:::benchmark_data_smithi188_104537_object88807:head# 2024-04-01T19:36:18.498 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58340238:::benchmark_data_smithi188_104537_object61259:head# 2024-04-01T19:36:18.499 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5834f627:::benchmark_data_smithi188_104537_object19253:head# 2024-04-01T19:36:18.499 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:583541f4:::benchmark_data_smithi188_104537_object28727:head# 2024-04-01T19:36:18.499 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58355215:::benchmark_data_smithi188_104537_object17947:head# 2024-04-01T19:36:18.500 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58356d12:::benchmark_data_smithi188_104537_object50430:head# 2024-04-01T19:36:18.500 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5835844c:::benchmark_data_smithi188_104537_object116342:head# 2024-04-01T19:36:18.500 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5835db96:::benchmark_data_smithi188_104537_object18848:head# 2024-04-01T19:36:18.501 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58365eb9:::benchmark_data_smithi188_104537_object64804:head# 2024-04-01T19:36:18.501 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5837a3be:::benchmark_data_smithi188_104537_object113185:head# 2024-04-01T19:36:18.502 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5838b69a:::benchmark_data_smithi188_104537_object112328:head# 2024-04-01T19:36:18.502 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:583964ae:::benchmark_data_smithi188_104537_object58176:head# 2024-04-01T19:36:18.502 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:583af599:::benchmark_data_smithi188_104537_object63706:head# 2024-04-01T19:36:18.503 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:583b0a51:::benchmark_data_smithi188_104537_object124517:head# 2024-04-01T19:36:18.503 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:583bb599:::benchmark_data_smithi188_104537_object130916:head# 2024-04-01T19:36:18.504 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:583bc270:::benchmark_data_smithi188_104537_object128547:head# 2024-04-01T19:36:18.504 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:583bcfac:::benchmark_data_smithi188_104537_object131097:head# 2024-04-01T19:36:18.504 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:583bd97f:::benchmark_data_smithi188_104537_object88299:head# 2024-04-01T19:36:18.505 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:583c494e:::benchmark_data_smithi188_104537_object99201:head# 2024-04-01T19:36:18.506 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:583cde4f:::benchmark_data_smithi188_104537_object15194:head# 2024-04-01T19:36:18.506 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:583cf066:::benchmark_data_smithi188_104537_object44112:head# 2024-04-01T19:36:18.507 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:583d04b8:::benchmark_data_smithi188_104537_object18388:head# 2024-04-01T19:36:18.507 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:583d3d68:::benchmark_data_smithi188_104537_object92892:head# 2024-04-01T19:36:18.507 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:583d5e6e:::benchmark_data_smithi188_104537_object138831:head# 2024-04-01T19:36:18.508 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:583da37f:::benchmark_data_smithi188_104537_object43483:head# 2024-04-01T19:36:18.509 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:583dcf2c:::benchmark_data_smithi188_104537_object146419:head# 2024-04-01T19:36:18.509 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:583dfd05:::benchmark_data_smithi188_104537_object79800:head# 2024-04-01T19:36:18.510 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:583ec43f:::benchmark_data_smithi188_104537_object52996:head# 2024-04-01T19:36:18.510 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:583f48ea:::benchmark_data_smithi188_104537_object82151:head# 2024-04-01T19:36:18.511 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:583f4f53:::benchmark_data_smithi188_104537_object54672:head# 2024-04-01T19:36:18.511 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:583f5037:::benchmark_data_smithi188_104537_object23488:head# 2024-04-01T19:36:18.512 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58405b17:::benchmark_data_smithi188_104537_object75532:head# 2024-04-01T19:36:18.512 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5841e3de:::benchmark_data_smithi188_104537_object115432:head# 2024-04-01T19:36:18.513 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58423923:::benchmark_data_smithi188_104537_object37016:head# 2024-04-01T19:36:18.513 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:584260b5:::benchmark_data_smithi188_104537_object162887:head# 2024-04-01T19:36:18.513 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5842cc2e:::benchmark_data_smithi188_104537_object132102:head# 2024-04-01T19:36:18.514 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5843084a:::benchmark_data_smithi188_104537_object149045:head# 2024-04-01T19:36:18.515 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58434789:::benchmark_data_smithi188_104537_object165354:head# 2024-04-01T19:36:18.515 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58435843:::benchmark_data_smithi188_104537_object151994:head# 2024-04-01T19:36:18.516 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:584372e6:::benchmark_data_smithi188_104537_object53367:head# 2024-04-01T19:36:18.516 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5844028c:::benchmark_data_smithi188_104537_object158128:head# 2024-04-01T19:36:18.517 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5844163b:::benchmark_data_smithi188_104537_object110504:head# 2024-04-01T19:36:18.517 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5844d3cc:::benchmark_data_smithi188_104537_object111995:head# 2024-04-01T19:36:18.517 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:584712c3:::benchmark_data_smithi188_104537_object157860:head# 2024-04-01T19:36:18.518 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58491807:::benchmark_data_smithi188_104537_object83285:head# 2024-04-01T19:36:18.518 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58493b56:::benchmark_data_smithi188_104537_object145460:head# 2024-04-01T19:36:18.519 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5849f5f3:::benchmark_data_smithi188_104537_object98070:head# 2024-04-01T19:36:18.519 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5849fd07:::benchmark_data_smithi188_104537_object69375:head# 2024-04-01T19:36:18.520 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:584a2ad1:::benchmark_data_smithi188_104537_object56112:head# 2024-04-01T19:36:18.520 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:584a46e4:::benchmark_data_smithi188_104537_object157940:head# 2024-04-01T19:36:18.521 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:584ab9b1:::benchmark_data_smithi188_104537_object152803:head# 2024-04-01T19:36:18.521 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:584bb32a:::benchmark_data_smithi188_104537_object162840:head# 2024-04-01T19:36:18.522 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:584c97c1:::benchmark_data_smithi188_104537_object40768:head# 2024-04-01T19:36:18.522 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:584ca983:::benchmark_data_smithi188_104537_object69036:head# 2024-04-01T19:36:18.523 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:584d5ecc:::benchmark_data_smithi188_104537_object112841:head# 2024-04-01T19:36:18.523 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:584da8e3:::benchmark_data_smithi188_104537_object122691:head# 2024-04-01T19:36:18.523 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:584e45da:::benchmark_data_smithi188_104537_object170418:head# 2024-04-01T19:36:18.524 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:584e809a:::benchmark_data_smithi188_104537_object98824:head# 2024-04-01T19:36:18.524 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:584f4ba0:::benchmark_data_smithi188_104537_object90529:head# 2024-04-01T19:36:18.525 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58502954:::benchmark_data_smithi188_104537_object114507:head# 2024-04-01T19:36:18.525 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5850d88f:::benchmark_data_smithi188_104537_object103696:head# 2024-04-01T19:36:18.526 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:585270d9:::benchmark_data_smithi188_104537_object15517:head# 2024-04-01T19:36:18.526 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5852e8fb:::benchmark_data_smithi188_104537_object66965:head# 2024-04-01T19:36:18.526 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5852f914:::benchmark_data_smithi188_104537_object140513:head# 2024-04-01T19:36:18.527 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58536f90:::benchmark_data_smithi188_104537_object65766:head# 2024-04-01T19:36:18.528 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5853a34c:::benchmark_data_smithi188_104537_object112944:head# 2024-04-01T19:36:18.528 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5853dd4e:::benchmark_data_smithi188_104537_object143810:head# 2024-04-01T19:36:18.528 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:585463dd:::benchmark_data_smithi188_104537_object22497:head# 2024-04-01T19:36:18.529 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58548b33:::benchmark_data_smithi188_104537_object139783:head# 2024-04-01T19:36:18.529 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5854c112:::benchmark_data_smithi188_104537_object55407:head# 2024-04-01T19:36:18.530 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5854f46a:::benchmark_data_smithi188_104537_object70744:head# 2024-04-01T19:36:18.530 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58550300:::benchmark_data_smithi188_104537_object87721:head# 2024-04-01T19:36:18.531 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58558fcb:::benchmark_data_smithi188_104537_object39712:head# 2024-04-01T19:36:18.531 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5856a064:::benchmark_data_smithi188_104537_object139404:head# 2024-04-01T19:36:18.532 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5856c4da:::benchmark_data_smithi188_104537_object157795:head# 2024-04-01T19:36:18.532 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58578159:::benchmark_data_smithi188_104537_object60721:head# 2024-04-01T19:36:18.533 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58584077:::benchmark_data_smithi188_104537_object141144:head# 2024-04-01T19:36:18.533 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58589bc5:::benchmark_data_smithi188_104537_object65233:head# 2024-04-01T19:36:18.533 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5858b2a9:::benchmark_data_smithi188_104537_object153288:head# 2024-04-01T19:36:18.534 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:585934c5:::benchmark_data_smithi188_104537_object107152:head# 2024-04-01T19:36:18.534 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5859ba55:::benchmark_data_smithi188_104537_object19980:head# 2024-04-01T19:36:18.535 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5859cc8c:::benchmark_data_smithi188_104537_object58461:head# 2024-04-01T19:36:18.535 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:585a6a87:::benchmark_data_smithi188_104537_object28431:head# 2024-04-01T19:36:18.536 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:585c3381:::benchmark_data_smithi188_104537_object126758:head# 2024-04-01T19:36:18.536 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:585c86c8:::benchmark_data_smithi188_104537_object16945:head# 2024-04-01T19:36:18.536 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:585d0f67:::benchmark_data_smithi188_104537_object35574:head# 2024-04-01T19:36:18.537 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:585d272e:::benchmark_data_smithi188_104537_object76591:head# 2024-04-01T19:36:18.537 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:585d4a34:::benchmark_data_smithi188_104537_object74699:head# 2024-04-01T19:36:18.538 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:585d9f67:::benchmark_data_smithi188_104537_object20047:head# 2024-04-01T19:36:18.538 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:585e3020:::benchmark_data_smithi188_104537_object105876:head# 2024-04-01T19:36:18.539 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:585f3265:::benchmark_data_smithi188_104537_object131872:head# 2024-04-01T19:36:18.539 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:585f46ea:::benchmark_data_smithi188_104537_object153152:head# 2024-04-01T19:36:18.539 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:585f7519:::benchmark_data_smithi188_104537_object123334:head# 2024-04-01T19:36:18.540 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:585f8e44:::benchmark_data_smithi188_104537_object56224:head# 2024-04-01T19:36:18.541 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:585fe7c6:::benchmark_data_smithi188_104537_object22995:head# 2024-04-01T19:36:18.541 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58601486:::benchmark_data_smithi188_104537_object138348:head# 2024-04-01T19:36:18.541 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58610eab:::benchmark_data_smithi188_104537_object147275:head# 2024-04-01T19:36:18.542 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58612ed1:::benchmark_data_smithi188_104537_object54763:head# 2024-04-01T19:36:18.542 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:586186a8:::benchmark_data_smithi188_104537_object143853:head# 2024-04-01T19:36:18.542 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58634996:::benchmark_data_smithi188_104537_object127579:head# 2024-04-01T19:36:18.543 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58635cef:::benchmark_data_smithi188_104537_object128645:head# 2024-04-01T19:36:18.543 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5863675a:::benchmark_data_smithi188_104537_object146445:head# 2024-04-01T19:36:18.544 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5864070b:::benchmark_data_smithi188_104537_object38562:head# 2024-04-01T19:36:18.544 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:586444a4:::benchmark_data_smithi188_104537_object106810:head# 2024-04-01T19:36:18.545 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5865ae82:::benchmark_data_smithi188_104537_object28225:head# 2024-04-01T19:36:18.545 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5865f00a:::benchmark_data_smithi188_104537_object91696:head# 2024-04-01T19:36:18.545 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58662895:::benchmark_data_smithi188_104537_object85175:head# 2024-04-01T19:36:18.546 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5868863c:::benchmark_data_smithi188_104537_object45484:head# 2024-04-01T19:36:18.547 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58688c28:::benchmark_data_smithi188_104537_object111665:head# 2024-04-01T19:36:18.547 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5868a9f4:::benchmark_data_smithi188_104537_object112108:head# 2024-04-01T19:36:18.547 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5868abde:::benchmark_data_smithi188_104537_object13146:head# 2024-04-01T19:36:18.548 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5868db17:::benchmark_data_smithi188_104537_object123435:head# 2024-04-01T19:36:18.548 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58696f18:::benchmark_data_smithi188_104537_object99709:head# 2024-04-01T19:36:18.549 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5869972c:::benchmark_data_smithi188_104537_object79470:head# 2024-04-01T19:36:18.549 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:586a5c59:::benchmark_data_smithi188_104537_object15210:head# 2024-04-01T19:36:18.549 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:586a8289:::benchmark_data_smithi188_104537_object41159:head# 2024-04-01T19:36:18.550 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:586ab23f:::benchmark_data_smithi188_104537_object122539:head# 2024-04-01T19:36:18.551 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:586ae814:::benchmark_data_smithi188_104537_object32832:head# 2024-04-01T19:36:18.551 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:586b2372:::benchmark_data_smithi188_104537_object149177:head# 2024-04-01T19:36:18.552 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:586b6929:::benchmark_data_smithi188_104537_object70083:head# 2024-04-01T19:36:18.552 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:586b6a25:::benchmark_data_smithi188_104537_object61778:head# 2024-04-01T19:36:18.552 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:586bb695:::benchmark_data_smithi188_104537_object153410:head# 2024-04-01T19:36:18.553 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:586bd2c7:::benchmark_data_smithi188_104537_object24467:head# 2024-04-01T19:36:18.553 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:586c26b5:::benchmark_data_smithi188_104537_object17670:head# 2024-04-01T19:36:18.553 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:586ccdd6:::benchmark_data_smithi188_104537_object36238:head# 2024-04-01T19:36:18.554 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:586d6857:::benchmark_data_smithi188_104537_object65028:head# 2024-04-01T19:36:18.554 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:586eb21d:::benchmark_data_smithi188_104537_object29810:head# 2024-04-01T19:36:18.555 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:586ec034:::benchmark_data_smithi188_104537_object113172:head# 2024-04-01T19:36:18.556 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:586f26e6:::benchmark_data_smithi188_104537_object73011:head# 2024-04-01T19:36:18.556 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:586f9e5b:::benchmark_data_smithi188_104537_object52946:head# 2024-04-01T19:36:18.557 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:586fe770:::benchmark_data_smithi188_104537_object65141:head# 2024-04-01T19:36:18.557 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58704198:::benchmark_data_smithi188_104537_object74148:head# 2024-04-01T19:36:18.557 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58706c60:::benchmark_data_smithi188_104537_object26308:head# 2024-04-01T19:36:18.557 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58713df8:::benchmark_data_smithi188_104537_object84092:head# 2024-04-01T19:36:18.558 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5871a3e5:::benchmark_data_smithi188_104537_object158990:head# 2024-04-01T19:36:18.558 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5871b765:::benchmark_data_smithi188_104537_object149775:head# 2024-04-01T19:36:18.559 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5871d00f:::benchmark_data_smithi188_104537_object112213:head# 2024-04-01T19:36:18.559 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5871f661:::benchmark_data_smithi188_104537_object118369:head# 2024-04-01T19:36:18.560 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5871f788:::benchmark_data_smithi188_104537_object32170:head# 2024-04-01T19:36:18.560 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:587243cd:::benchmark_data_smithi188_104537_object106233:head# 2024-04-01T19:36:18.560 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58726e1b:::benchmark_data_smithi188_104537_object161878:head# 2024-04-01T19:36:18.561 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:587271bb:::benchmark_data_smithi188_104537_object92113:head# 2024-04-01T19:36:18.561 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58727aa6:::benchmark_data_smithi188_104537_object80017:head# 2024-04-01T19:36:18.562 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58728e85:::benchmark_data_smithi188_104537_object155879:head# 2024-04-01T19:36:18.562 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:587312c8:::benchmark_data_smithi188_104537_object91281:head# 2024-04-01T19:36:18.562 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58732eaa:::benchmark_data_smithi188_104537_object130956:head# 2024-04-01T19:36:18.563 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58735a0b:::benchmark_data_smithi188_104537_object145973:head# 2024-04-01T19:36:18.563 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5873af2d:::benchmark_data_smithi188_104537_object143291:head# 2024-04-01T19:36:18.564 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58741043:::benchmark_data_smithi188_104537_object23227:head# 2024-04-01T19:36:18.564 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58759dad:::benchmark_data_smithi188_104537_object38418:head# 2024-04-01T19:36:18.565 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5875f17f:::benchmark_data_smithi188_104537_object19174:head# 2024-04-01T19:36:18.565 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58760159:::benchmark_data_smithi188_104537_object52285:head# 2024-04-01T19:36:18.565 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:587649ef:::benchmark_data_smithi188_104537_object49773:head# 2024-04-01T19:36:18.566 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58769720:::benchmark_data_smithi188_104537_object162464:head# 2024-04-01T19:36:18.566 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58769fc5:::benchmark_data_smithi188_104537_object130055:head# 2024-04-01T19:36:18.567 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5877953e:::benchmark_data_smithi188_104537_object71258:head# 2024-04-01T19:36:18.567 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58781077:::benchmark_data_smithi188_104537_object39861:head# 2024-04-01T19:36:18.568 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58785344:::benchmark_data_smithi188_104537_object52014:head# 2024-04-01T19:36:18.568 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5878b295:::benchmark_data_smithi188_104537_object164531:head# 2024-04-01T19:36:18.569 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58794d3a:::benchmark_data_smithi188_104537_object78303:head# 2024-04-01T19:36:18.569 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5879e138:::benchmark_data_smithi188_104537_object41974:head# 2024-04-01T19:36:18.570 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5879e27f:::benchmark_data_smithi188_104537_object100697:head# 2024-04-01T19:36:18.570 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5879e930:::benchmark_data_smithi188_104537_object88953:head# 2024-04-01T19:36:18.570 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:587a0e4d:::benchmark_data_smithi188_104537_object35327:head# 2024-04-01T19:36:18.571 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:587a0f8e:::benchmark_data_smithi188_104537_object53714:head# 2024-04-01T19:36:18.571 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:587a186e:::benchmark_data_smithi188_104537_object113196:head# 2024-04-01T19:36:18.572 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:587a3a81:::benchmark_data_smithi188_104537_object159098:head# 2024-04-01T19:36:18.572 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:587a61ac:::benchmark_data_smithi188_104537_object29973:head# 2024-04-01T19:36:18.572 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:587a7cc8:::benchmark_data_smithi188_104537_object137016:head# 2024-04-01T19:36:18.573 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:587b707b:::benchmark_data_smithi188_104537_object34596:head# 2024-04-01T19:36:18.573 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:587ca6cb:::benchmark_data_smithi188_104537_object145249:head# 2024-04-01T19:36:18.574 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:587d058f:::benchmark_data_smithi188_104537_object110995:head# 2024-04-01T19:36:18.574 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:587d2e40:::benchmark_data_smithi188_104537_object156040:head# 2024-04-01T19:36:18.575 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:587e0e57:::benchmark_data_smithi188_104537_object170978:head# 2024-04-01T19:36:18.575 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:587e8264:::benchmark_data_smithi188_104537_object109352:head# 2024-04-01T19:36:18.575 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:587eb82d:::benchmark_data_smithi188_104537_object58780:head# 2024-04-01T19:36:18.576 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:587eee4a:::benchmark_data_smithi188_104537_object100252:head# 2024-04-01T19:36:18.576 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:587f3c82:::benchmark_data_smithi188_104537_object72728:head# 2024-04-01T19:36:18.577 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:588044af:::benchmark_data_smithi188_104537_object39934:head# 2024-04-01T19:36:18.577 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5880a7e8:::benchmark_data_smithi188_104537_object61041:head# 2024-04-01T19:36:18.577 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5882aab7:::benchmark_data_smithi188_104537_object80094:head# 2024-04-01T19:36:18.578 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5882b01e:::benchmark_data_smithi188_104537_object118447:head# 2024-04-01T19:36:18.578 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5882c160:::benchmark_data_smithi188_104537_object114733:head# 2024-04-01T19:36:18.579 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5882c2cf:::benchmark_data_smithi188_104537_object15605:head# 2024-04-01T19:36:18.579 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58848081:::benchmark_data_smithi188_104537_object147104:head# 2024-04-01T19:36:18.579 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5884eb12:::benchmark_data_smithi188_104537_object89967:head# 2024-04-01T19:36:18.580 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:588538be:::benchmark_data_smithi188_104537_object105561:head# 2024-04-01T19:36:18.580 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5885e432:::benchmark_data_smithi188_104537_object102823:head# 2024-04-01T19:36:18.581 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58865100:::benchmark_data_smithi188_104537_object14808:head# 2024-04-01T19:36:18.581 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58866783:::benchmark_data_smithi188_104537_object93503:head# 2024-04-01T19:36:18.581 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58870061:::benchmark_data_smithi188_104537_object47227:head# 2024-04-01T19:36:18.582 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5887183b:::benchmark_data_smithi188_104537_object122886:head# 2024-04-01T19:36:18.582 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58874609:::benchmark_data_smithi188_104537_object170612:head# 2024-04-01T19:36:18.582 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5887a7e8:::benchmark_data_smithi188_104537_object79980:head# 2024-04-01T19:36:18.583 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:588811f7:::benchmark_data_smithi188_104537_object42250:head# 2024-04-01T19:36:18.583 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5888a7b0:::benchmark_data_smithi188_104537_object38845:head# 2024-04-01T19:36:18.584 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5889678f:::benchmark_data_smithi188_104537_object137663:head# 2024-04-01T19:36:18.584 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58899e57:::benchmark_data_smithi188_104537_object126638:head# 2024-04-01T19:36:18.584 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5889b5cf:::benchmark_data_smithi188_104537_object22031:head# 2024-04-01T19:36:18.585 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5889f820:::benchmark_data_smithi188_104537_object107450:head# 2024-04-01T19:36:18.585 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:588a022b:::benchmark_data_smithi188_104537_object79680:head# 2024-04-01T19:36:18.586 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:588a07d1:::benchmark_data_smithi188_104537_object64973:head# 2024-04-01T19:36:18.586 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:588a1730:::benchmark_data_smithi188_104537_object131700:head# 2024-04-01T19:36:18.586 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:588a292d:::benchmark_data_smithi188_104537_object86852:head# 2024-04-01T19:36:18.587 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:588a990e:::benchmark_data_smithi188_104537_object90375:head# 2024-04-01T19:36:18.587 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:588aab10:::benchmark_data_smithi188_104537_object89856:head# 2024-04-01T19:36:18.588 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:588acea2:::benchmark_data_smithi188_104537_object42089:head# 2024-04-01T19:36:18.588 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:588b35c7:::benchmark_data_smithi188_104537_object88647:head# 2024-04-01T19:36:18.588 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:588b7944:::benchmark_data_smithi188_104537_object34430:head# 2024-04-01T19:36:18.589 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:588bd546:::benchmark_data_smithi188_104537_object91940:head# 2024-04-01T19:36:18.589 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:588ca70c:::benchmark_data_smithi188_104537_object52943:head# 2024-04-01T19:36:18.590 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:588da11a:::benchmark_data_smithi188_104537_object157218:head# 2024-04-01T19:36:18.590 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:588daefc:::benchmark_data_smithi188_104537_object30784:head# 2024-04-01T19:36:18.590 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:588dd182:::benchmark_data_smithi188_104537_object91813:head# 2024-04-01T19:36:18.591 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:588ea82a:::benchmark_data_smithi188_104537_object88622:head# 2024-04-01T19:36:18.591 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:588f03f6:::benchmark_data_smithi188_104537_object91761:head# 2024-04-01T19:36:18.591 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:588f5954:::benchmark_data_smithi188_104537_object64957:head# 2024-04-01T19:36:18.592 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5890014c:::benchmark_data_smithi188_104537_object125420:head# 2024-04-01T19:36:18.592 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58911f70:::benchmark_data_smithi188_104537_object20341:head# 2024-04-01T19:36:18.593 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:589203d3:::benchmark_data_smithi188_104537_object30935:head# 2024-04-01T19:36:18.593 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5892096b:::benchmark_data_smithi188_104537_object170151:head# 2024-04-01T19:36:18.593 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:589287cc:::benchmark_data_smithi188_104537_object130675:head# 2024-04-01T19:36:18.594 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58928a2c:::benchmark_data_smithi188_104537_object68162:head# 2024-04-01T19:36:18.594 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5892a6b3:::benchmark_data_smithi188_104537_object41349:head# 2024-04-01T19:36:18.595 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5892ac2a:::benchmark_data_smithi188_104537_object162980:head# 2024-04-01T19:36:18.598 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:589309be:::benchmark_data_smithi188_104537_object28759:head# 2024-04-01T19:36:18.599 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:589341dc:::benchmark_data_smithi188_104537_object136432:head# 2024-04-01T19:36:18.599 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5894c071:::benchmark_data_smithi188_104537_object60099:head# 2024-04-01T19:36:18.599 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5894cc07:::benchmark_data_smithi188_104537_object65406:head# 2024-04-01T19:36:18.599 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5895112e:::benchmark_data_smithi188_104537_object110550:head# 2024-04-01T19:36:18.599 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:589566c2:::benchmark_data_smithi188_104537_object65363:head# 2024-04-01T19:36:18.599 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5895ac3a:::benchmark_data_smithi188_104537_object52011:head# 2024-04-01T19:36:18.599 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5895b464:::benchmark_data_smithi188_104537_object60789:head# 2024-04-01T19:36:18.599 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5896a6ad:::benchmark_data_smithi188_104537_object23582:head# 2024-04-01T19:36:18.599 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5896d272:::benchmark_data_smithi188_104537_object46001:head# 2024-04-01T19:36:18.600 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58970f8b:::benchmark_data_smithi188_104537_object37587:head# 2024-04-01T19:36:18.600 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5897cb70:::benchmark_data_smithi188_104537_object168115:head# 2024-04-01T19:36:18.600 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5897dc5c:::benchmark_data_smithi188_104537_object125587:head# 2024-04-01T19:36:18.601 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5897e382:::benchmark_data_smithi188_104537_object66117:head# 2024-04-01T19:36:18.601 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:589898b3:::benchmark_data_smithi188_104537_object38475:head# 2024-04-01T19:36:18.602 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5898c571:::benchmark_data_smithi188_104537_object77398:head# 2024-04-01T19:36:18.602 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5898cce8:::benchmark_data_smithi188_104537_object21197:head# 2024-04-01T19:36:18.602 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5899160c:::benchmark_data_smithi188_104537_object153651:head# 2024-04-01T19:36:18.603 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58995f55:::benchmark_data_smithi188_104537_object35182:head# 2024-04-01T19:36:18.603 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:589a709e:::benchmark_data_smithi188_104537_object51948:head# 2024-04-01T19:36:18.604 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:589baea8:::benchmark_data_smithi188_104537_object131736:head# 2024-04-01T19:36:18.604 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:589baebe:::benchmark_data_smithi188_104537_object166254:head# 2024-04-01T19:36:18.604 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:589bddd2:::benchmark_data_smithi188_104537_object95201:head# 2024-04-01T19:36:18.605 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:589c2b98:::benchmark_data_smithi188_104537_object75869:head# 2024-04-01T19:36:18.605 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:589c622d:::benchmark_data_smithi188_104537_object44335:head# 2024-04-01T19:36:18.606 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:589cc9cb:::benchmark_data_smithi188_104537_object26528:head# 2024-04-01T19:36:18.606 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:589d169f:::benchmark_data_smithi188_104537_object157700:head# 2024-04-01T19:36:18.607 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:589d6ed5:::benchmark_data_smithi188_104537_object145184:head# 2024-04-01T19:36:18.607 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:589de2d2:::benchmark_data_smithi188_104537_object108493:head# 2024-04-01T19:36:18.607 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:589ded5c:::benchmark_data_smithi188_104537_object49818:head# 2024-04-01T19:36:18.608 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58a0621f:::benchmark_data_smithi188_104537_object113980:head# 2024-04-01T19:36:18.608 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58a0658f:::benchmark_data_smithi188_104537_object68470:head# 2024-04-01T19:36:18.609 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58a1787f:::benchmark_data_smithi188_104537_object12207:head# 2024-04-01T19:36:18.609 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58a2231a:::benchmark_data_smithi188_104537_object27444:head# 2024-04-01T19:36:18.609 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58a232f4:::benchmark_data_smithi188_104537_object51975:head# 2024-04-01T19:36:18.610 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58a3382e:::benchmark_data_smithi188_104537_object17102:head# 2024-04-01T19:36:18.610 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58a39fa5:::benchmark_data_smithi188_104537_object132748:head# 2024-04-01T19:36:18.610 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58a3e0b6:::benchmark_data_smithi188_104537_object59360:head# 2024-04-01T19:36:18.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58a40cda:::benchmark_data_smithi188_104537_object19335:head# 2024-04-01T19:36:18.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58a441a0:::benchmark_data_smithi188_104537_object49208:head# 2024-04-01T19:36:18.612 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58a492fb:::benchmark_data_smithi188_104537_object102397:head# 2024-04-01T19:36:18.612 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58a4dc9f:::benchmark_data_smithi188_104537_object18398:head# 2024-04-01T19:36:18.612 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58a50aad:::benchmark_data_smithi188_104537_object13296:head# 2024-04-01T19:36:18.613 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58a528a6:::benchmark_data_smithi188_104537_object119995:head# 2024-04-01T19:36:18.613 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58a5c3fc:::benchmark_data_smithi188_104537_object152623:head# 2024-04-01T19:36:18.614 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58a684f7:::benchmark_data_smithi188_104537_object34819:head# 2024-04-01T19:36:18.614 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58a811e3:::benchmark_data_smithi188_104537_object164472:head# 2024-04-01T19:36:18.614 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58a83a67:::benchmark_data_smithi188_104537_object45973:head# 2024-04-01T19:36:18.615 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58a8b78c:::benchmark_data_smithi188_104537_object82107:head# 2024-04-01T19:36:18.615 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58a8c908:::benchmark_data_smithi188_104537_object123406:head# 2024-04-01T19:36:18.616 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58a921be:::benchmark_data_smithi188_104537_object95132:head# 2024-04-01T19:36:18.616 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58a93c58:::benchmark_data_smithi188_104537_object122881:head# 2024-04-01T19:36:18.616 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58a94a12:::benchmark_data_smithi188_104537_object158565:head# 2024-04-01T19:36:18.617 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58a9d027:::benchmark_data_smithi188_104537_object68338:head# 2024-04-01T19:36:18.617 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58a9d0e5:::benchmark_data_smithi188_104537_object36620:head# 2024-04-01T19:36:18.618 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58aa74bb:::benchmark_data_smithi188_104537_object165111:head# 2024-04-01T19:36:18.618 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58aaa9ca:::benchmark_data_smithi188_104537_object42838:head# 2024-04-01T19:36:18.618 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58aabd5c:::benchmark_data_smithi188_104537_object41485:head# 2024-04-01T19:36:18.619 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:36:18.619 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58aad24d:::benchmark_data_smithi188_104537_object23065:head# 2024-04-01T19:36:18.619 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ab16cf:::benchmark_data_smithi188_104537_object109326:head# 2024-04-01T19:36:18.620 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ab61c7:::benchmark_data_smithi188_104537_object42677:head# 2024-04-01T19:36:18.620 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58abfa87:::benchmark_data_smithi188_104537_object18440:head# 2024-04-01T19:36:18.621 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ac027b:::benchmark_data_smithi188_104537_object130813:head# 2024-04-01T19:36:18.621 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ac1757:::benchmark_data_smithi188_104537_object59917:head# 2024-04-01T19:36:18.622 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:18.622 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:36:18.623 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ac705d:::benchmark_data_smithi188_104537_object68889:head# 2024-04-01T19:36:18.623 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58acd192:::benchmark_data_smithi188_104537_object96971:head# 2024-04-01T19:36:18.623 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ace769:::benchmark_data_smithi188_104537_object57328:head# 2024-04-01T19:36:18.623 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58acf7bc:::benchmark_data_smithi188_104537_object132744:head# 2024-04-01T19:36:18.623 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ad1695:::benchmark_data_smithi188_104537_object130852:head# 2024-04-01T19:36:18.624 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58adde88:::benchmark_data_smithi188_104537_object23449:head# 2024-04-01T19:36:18.624 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58addef5:::benchmark_data_smithi188_104537_object131815:head# 2024-04-01T19:36:18.624 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58aea37e:::benchmark_data_smithi188_104537_object32527:head# 2024-04-01T19:36:18.625 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58aeb288:::benchmark_data_smithi188_104537_object149526:head# 2024-04-01T19:36:18.625 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58b073c2:::benchmark_data_smithi188_104537_object129282:head# 2024-04-01T19:36:18.625 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58b1b847:::benchmark_data_smithi188_104537_object81546:head# 2024-04-01T19:36:18.626 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58b1bf4a:::benchmark_data_smithi188_104537_object53413:head# 2024-04-01T19:36:18.626 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58b308ca:::benchmark_data_smithi188_104537_object170779:head# 2024-04-01T19:36:18.627 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58b32406:::benchmark_data_smithi188_104537_object38057:head# 2024-04-01T19:36:18.627 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58b389b2:::benchmark_data_smithi188_104537_object131503:head# 2024-04-01T19:36:18.627 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58b4cc45:::benchmark_data_smithi188_104537_object12840:head# 2024-04-01T19:36:18.628 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58b4cd7b:::benchmark_data_smithi188_104537_object29087:head# 2024-04-01T19:36:18.628 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58b58959:::benchmark_data_smithi188_104537_object80802:head# 2024-04-01T19:36:18.628 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58b5ea98:::benchmark_data_smithi188_104537_object132140:head# 2024-04-01T19:36:18.629 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58b61b37:::benchmark_data_smithi188_104537_object74725:head# 2024-04-01T19:36:18.629 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58b6647d:::benchmark_data_smithi188_104537_object109855:head# 2024-04-01T19:36:18.629 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58b6b720:::benchmark_data_smithi188_104537_object101800:head# 2024-04-01T19:36:18.630 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58b82062:::benchmark_data_smithi188_104537_object147586:head# 2024-04-01T19:36:18.630 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58b87ecb:::benchmark_data_smithi188_104537_object12375:head# 2024-04-01T19:36:18.631 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58b8ab51:::benchmark_data_smithi188_104537_object55286:head# 2024-04-01T19:36:18.631 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58b8faa6:::benchmark_data_smithi188_104537_object27472:head# 2024-04-01T19:36:18.631 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58b940de:::benchmark_data_smithi188_104537_object35377:head# 2024-04-01T19:36:18.632 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58b95699:::benchmark_data_smithi188_104537_object167601:head# 2024-04-01T19:36:18.632 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58b9991e:::benchmark_data_smithi188_104537_object83004:head# 2024-04-01T19:36:18.633 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58b99fb2:::benchmark_data_smithi188_104537_object152509:head# 2024-04-01T19:36:18.633 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58bac47e:::benchmark_data_smithi188_104537_object27971:head# 2024-04-01T19:36:18.633 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58bafadf:::benchmark_data_smithi188_104537_object108714:head# 2024-04-01T19:36:18.634 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58bb212c:::benchmark_data_smithi188_104537_object154202:head# 2024-04-01T19:36:18.634 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58bb6e73:::benchmark_data_smithi188_104537_object22059:head# 2024-04-01T19:36:18.635 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58bb8e29:::benchmark_data_smithi188_104537_object165443:head# 2024-04-01T19:36:18.635 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58bb9701:::benchmark_data_smithi188_104537_object59378:head# 2024-04-01T19:36:18.636 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58bc8ec9:::benchmark_data_smithi188_104537_object56147:head# 2024-04-01T19:36:18.636 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58bc9df5:::benchmark_data_smithi188_104537_object80953:head# 2024-04-01T19:36:18.636 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58bcdeb5:::benchmark_data_smithi188_104537_object140569:head# 2024-04-01T19:36:18.637 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58be172e:::benchmark_data_smithi188_104537_object140737:head# 2024-04-01T19:36:18.637 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58be9604:::benchmark_data_smithi188_104537_object112107:head# 2024-04-01T19:36:18.638 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58bf0da4:::benchmark_data_smithi188_104537_object161757:head# 2024-04-01T19:36:18.638 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58bfb3db:::benchmark_data_smithi188_104537_object79122:head# 2024-04-01T19:36:18.638 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c000eb:::benchmark_data_smithi188_104537_object126206:head# 2024-04-01T19:36:18.639 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c00266:::benchmark_data_smithi188_104537_object147330:head# 2024-04-01T19:36:18.639 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c0d650:::benchmark_data_smithi188_104537_object133109:head# 2024-04-01T19:36:18.640 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c137d3:::benchmark_data_smithi188_104537_object104585:head# 2024-04-01T19:36:18.640 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c1525e:::benchmark_data_smithi188_104537_object52723:head# 2024-04-01T19:36:18.641 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c1c121:::benchmark_data_smithi188_104537_object96888:head# 2024-04-01T19:36:18.641 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c22ca8:::benchmark_data_smithi188_104537_object49612:head# 2024-04-01T19:36:18.641 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c2765d:::benchmark_data_smithi188_104537_object171089:head# 2024-04-01T19:36:18.642 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c27aea:::benchmark_data_smithi188_104537_object97305:head# 2024-04-01T19:36:18.642 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c2dc27:::benchmark_data_smithi188_104537_object37331:head# 2024-04-01T19:36:18.643 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c3050f:::benchmark_data_smithi188_104537_object26564:head# 2024-04-01T19:36:18.643 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c30687:::benchmark_data_smithi188_104537_object17570:head# 2024-04-01T19:36:18.643 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c329eb:::benchmark_data_smithi188_104537_object28725:head# 2024-04-01T19:36:18.644 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c374f3:::benchmark_data_smithi188_104537_object35016:head# 2024-04-01T19:36:18.644 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c3b764:::benchmark_data_smithi188_104537_object98874:head# 2024-04-01T19:36:18.645 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c46cbf:::benchmark_data_smithi188_104537_object157711:head# 2024-04-01T19:36:18.645 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c551bf:::benchmark_data_smithi188_104537_object162702:head# 2024-04-01T19:36:18.646 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c56c88:::benchmark_data_smithi188_104537_object18401:head# 2024-04-01T19:36:18.646 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c5d527:::benchmark_data_smithi188_104537_object23071:head# 2024-04-01T19:36:18.646 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c66222:::benchmark_data_smithi188_104537_object99479:head# 2024-04-01T19:36:18.646 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c6b61d:::benchmark_data_smithi188_104537_object67752:head# 2024-04-01T19:36:18.647 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c6bfae:::benchmark_data_smithi188_104537_object112132:head# 2024-04-01T19:36:18.647 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c6f8b8:::benchmark_data_smithi188_104537_object150910:head# 2024-04-01T19:36:18.648 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c7121e:::benchmark_data_smithi188_104537_object160962:head# 2024-04-01T19:36:18.648 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c794d9:::benchmark_data_smithi188_104537_object44411:head# 2024-04-01T19:36:18.649 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c7ce3c:::benchmark_data_smithi188_104537_object91268:head# 2024-04-01T19:36:18.649 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c82f79:::benchmark_data_smithi188_104537_object115463:head# 2024-04-01T19:36:18.649 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c8402d:::benchmark_data_smithi188_104537_object38811:head# 2024-04-01T19:36:18.650 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c87690:::benchmark_data_smithi188_104537_object80647:head# 2024-04-01T19:36:18.650 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c8faa9:::benchmark_data_smithi188_104537_object99226:head# 2024-04-01T19:36:18.651 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c90670:::benchmark_data_smithi188_104537_object110876:head# 2024-04-01T19:36:18.651 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58c922ab:::benchmark_data_smithi188_104537_object139964:head# 2024-04-01T19:36:18.651 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ca695b:::benchmark_data_smithi188_104537_object68986:head# 2024-04-01T19:36:18.652 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58caaeee:::benchmark_data_smithi188_104537_object116288:head# 2024-04-01T19:36:18.652 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58cb86fa:::benchmark_data_smithi188_104537_object105785:head# 2024-04-01T19:36:18.653 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58cbccc6:::benchmark_data_smithi188_104537_object15313:head# 2024-04-01T19:36:18.654 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58cc6942:::benchmark_data_smithi188_104537_object99281:head# 2024-04-01T19:36:18.654 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ccbb76:::benchmark_data_smithi188_104537_object50705:head# 2024-04-01T19:36:18.654 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ccbfe5:::benchmark_data_smithi188_104537_object51736:head# 2024-04-01T19:36:18.655 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ccd172:::benchmark_data_smithi188_104537_object24200:head# 2024-04-01T19:36:18.655 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58cd3210:::benchmark_data_smithi188_104537_object105558:head# 2024-04-01T19:36:18.656 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ce1ca0:::benchmark_data_smithi188_104537_object117415:head# 2024-04-01T19:36:18.656 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ce6fc0:::benchmark_data_smithi188_104537_object158030:head# 2024-04-01T19:36:18.657 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ce7057:::benchmark_data_smithi188_104537_object131328:head# 2024-04-01T19:36:18.657 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ceaa82:::benchmark_data_smithi188_104537_object134209:head# 2024-04-01T19:36:18.657 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58cf6a7a:::benchmark_data_smithi188_104537_object76038:head# 2024-04-01T19:36:18.658 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58cff1af:::benchmark_data_smithi188_104537_object130061:head# 2024-04-01T19:36:18.658 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58cffbef:::benchmark_data_smithi188_104537_object69534:head# 2024-04-01T19:36:18.659 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d0235b:::benchmark_data_smithi188_104537_object65954:head# 2024-04-01T19:36:18.659 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d06963:::benchmark_data_smithi188_104537_object115145:head# 2024-04-01T19:36:18.660 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d0794e:::benchmark_data_smithi188_104537_object130088:head# 2024-04-01T19:36:18.660 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d1237a:::benchmark_data_smithi188_104537_object148374:head# 2024-04-01T19:36:18.661 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d123c5:::benchmark_data_smithi188_104537_object63979:head# 2024-04-01T19:36:18.661 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d12a75:::benchmark_data_smithi188_104537_object66268:head# 2024-04-01T19:36:18.662 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d1805a:::benchmark_data_smithi188_104537_object88496:head# 2024-04-01T19:36:18.662 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d25182:::benchmark_data_smithi188_104537_object110980:head# 2024-04-01T19:36:18.663 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d2a465:::benchmark_data_smithi188_104537_object107930:head# 2024-04-01T19:36:18.664 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d31bd8:::benchmark_data_smithi188_104537_object130223:head# 2024-04-01T19:36:18.664 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d482fb:::benchmark_data_smithi188_104537_object146396:head# 2024-04-01T19:36:18.664 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d4c89f:::benchmark_data_smithi188_104537_object145738:head# 2024-04-01T19:36:18.665 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d4d62a:::benchmark_data_smithi188_104537_object127087:head# 2024-04-01T19:36:18.666 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d50a74:::benchmark_data_smithi188_104537_object96347:head# 2024-04-01T19:36:18.666 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d53bcb:::benchmark_data_smithi188_104537_object29541:head# 2024-04-01T19:36:18.666 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d57e14:::benchmark_data_smithi188_104537_object35209:head# 2024-04-01T19:36:18.667 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d5b85d:::benchmark_data_smithi188_104537_object79032:head# 2024-04-01T19:36:18.667 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d69654:::benchmark_data_smithi188_104537_object75483:head# 2024-04-01T19:36:18.669 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d6d5f1:::benchmark_data_smithi188_104537_object11188:head# 2024-04-01T19:36:18.669 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d6eb13:::benchmark_data_smithi188_104537_object101488:head# 2024-04-01T19:36:18.669 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d753e2:::benchmark_data_smithi188_104537_object148325:head# 2024-04-01T19:36:18.669 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d7b633:::benchmark_data_smithi188_104537_object99110:head# 2024-04-01T19:36:18.670 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d80a28:::benchmark_data_smithi188_104537_object42535:head# 2024-04-01T19:36:18.670 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d8e14e:::benchmark_data_smithi188_104537_object97252:head# 2024-04-01T19:36:18.670 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d8ed9e:::benchmark_data_smithi188_104537_object39381:head# 2024-04-01T19:36:18.671 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d8f834:::benchmark_data_smithi188_104537_object87843:head# 2024-04-01T19:36:18.671 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d90c86:::benchmark_data_smithi188_104537_object12403:head# 2024-04-01T19:36:18.672 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d981b4:::benchmark_data_smithi188_104537_object104194:head# 2024-04-01T19:36:18.672 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d98bfa:::benchmark_data_smithi188_104537_object84919:head# 2024-04-01T19:36:18.673 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d9b253:::benchmark_data_smithi188_104537_object145830:head# 2024-04-01T19:36:18.673 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58d9cf4d:::benchmark_data_smithi188_104537_object94566:head# 2024-04-01T19:36:18.674 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58da3872:::benchmark_data_smithi188_104537_object77541:head# 2024-04-01T19:36:18.674 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58da778a:::benchmark_data_smithi188_104537_object49399:head# 2024-04-01T19:36:18.675 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58dab1e6:::benchmark_data_smithi188_104537_object76544:head# 2024-04-01T19:36:18.675 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58dad3b3:::benchmark_data_smithi188_104537_object67410:head# 2024-04-01T19:36:18.675 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58dad7cf:::benchmark_data_smithi188_104537_object155337:head# 2024-04-01T19:36:18.676 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58daed5c:::benchmark_data_smithi188_104537_object53543:head# 2024-04-01T19:36:18.676 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58dbd4d3:::benchmark_data_smithi188_104537_object91758:head# 2024-04-01T19:36:18.677 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58dbded4:::benchmark_data_smithi188_104537_object56647:head# 2024-04-01T19:36:18.678 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58dc6012:::benchmark_data_smithi188_104537_object166376:head# 2024-04-01T19:36:18.678 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58dc77b7:::benchmark_data_smithi188_104537_object82698:head# 2024-04-01T19:36:18.679 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58dca456:::benchmark_data_smithi188_104537_object105799:head# 2024-04-01T19:36:18.679 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58dcb924:::benchmark_data_smithi188_104537_object103484:head# 2024-04-01T19:36:18.679 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58dcdcb7:::benchmark_data_smithi188_104537_object112622:head# 2024-04-01T19:36:18.680 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58dce352:::benchmark_data_smithi188_104537_object153674:head# 2024-04-01T19:36:18.681 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58dd358b:::benchmark_data_smithi188_104537_object34861:head# 2024-04-01T19:36:18.681 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58dd7cdf:::benchmark_data_smithi188_104537_object42329:head# 2024-04-01T19:36:18.681 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58dde6b7:::benchmark_data_smithi188_104537_object146757:head# 2024-04-01T19:36:18.682 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58de30b5:::benchmark_data_smithi188_104537_object88879:head# 2024-04-01T19:36:18.682 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58debf36:::benchmark_data_smithi188_104537_object73937:head# 2024-04-01T19:36:18.682 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58dedfec:::benchmark_data_smithi188_104537_object157184:head# 2024-04-01T19:36:18.683 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58dfb035:::benchmark_data_smithi188_104537_object66267:head# 2024-04-01T19:36:18.684 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e066e0:::benchmark_data_smithi188_104537_object126349:head# 2024-04-01T19:36:18.684 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e06ccc:::benchmark_data_smithi188_104537_object137433:head# 2024-04-01T19:36:18.685 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e09eef:::benchmark_data_smithi188_104537_object121465:head# 2024-04-01T19:36:18.685 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e0ae45:::benchmark_data_smithi188_104537_object18493:head# 2024-04-01T19:36:18.686 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e0c5fe:::benchmark_data_smithi188_104537_object112706:head# 2024-04-01T19:36:18.686 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e0ce5b:::benchmark_data_smithi188_104537_object107763:head# 2024-04-01T19:36:18.686 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e14c82:::benchmark_data_smithi188_104537_object31003:head# 2024-04-01T19:36:18.687 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e19513:::benchmark_data_smithi188_104537_object58537:head# 2024-04-01T19:36:18.688 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e1a818:::benchmark_data_smithi188_104537_object24869:head# 2024-04-01T19:36:18.688 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e22497:::benchmark_data_smithi188_104537_object91327:head# 2024-04-01T19:36:18.689 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e22b60:::benchmark_data_smithi188_104537_object143639:head# 2024-04-01T19:36:18.689 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e2dcf6:::benchmark_data_smithi188_104537_object130719:head# 2024-04-01T19:36:18.690 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e30555:::benchmark_data_smithi188_104537_object152279:head# 2024-04-01T19:36:18.690 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e3c648:::benchmark_data_smithi188_104537_object129828:head# 2024-04-01T19:36:18.690 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e4a0ff:::benchmark_data_smithi188_104537_object137326:head# 2024-04-01T19:36:18.691 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e5959d:::benchmark_data_smithi188_104537_object146406:head# 2024-04-01T19:36:18.691 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e6243e:::benchmark_data_smithi188_104537_object38587:head# 2024-04-01T19:36:18.692 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e62cec:::benchmark_data_smithi188_104537_object61012:head# 2024-04-01T19:36:18.692 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e67391:::benchmark_data_smithi188_104537_object21862:head# 2024-04-01T19:36:18.692 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e69a71:::benchmark_data_smithi188_104537_object16731:head# 2024-04-01T19:36:18.693 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e6b28d:::benchmark_data_smithi188_104537_object28405:head# 2024-04-01T19:36:18.693 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e6b6db:::benchmark_data_smithi188_104537_object95408:head# 2024-04-01T19:36:18.694 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e6de3f:::benchmark_data_smithi188_104537_object46154:head# 2024-04-01T19:36:18.694 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e6e393:::benchmark_data_smithi188_104537_object88713:head# 2024-04-01T19:36:18.694 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e76356:::benchmark_data_smithi188_104537_object39578:head# 2024-04-01T19:36:18.695 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e78310:::benchmark_data_smithi188_104537_object120885:head# 2024-04-01T19:36:18.696 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e8356e:::benchmark_data_smithi188_104537_object37928:head# 2024-04-01T19:36:18.696 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e97dbe:::benchmark_data_smithi188_104537_object18779:head# 2024-04-01T19:36:18.696 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58e9a415:::benchmark_data_smithi188_104537_object162863:head# 2024-04-01T19:36:18.696 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ea389b:::benchmark_data_smithi188_104537_object35254:head# 2024-04-01T19:36:18.697 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ea69ef:::benchmark_data_smithi188_104537_object33808:head# 2024-04-01T19:36:18.697 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58eb1e55:::benchmark_data_smithi188_104537_object58843:head# 2024-04-01T19:36:18.698 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58eb7f7b:::benchmark_data_smithi188_104537_object156284:head# 2024-04-01T19:36:18.698 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ebba09:::benchmark_data_smithi188_104537_object131632:head# 2024-04-01T19:36:18.699 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ebe3fe:::benchmark_data_smithi188_104537_object87114:head# 2024-04-01T19:36:18.699 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ec0a2d:::benchmark_data_smithi188_104537_object18235:head# 2024-04-01T19:36:18.699 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ed1986:::benchmark_data_smithi188_104537_object112659:head# 2024-04-01T19:36:18.700 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ed7862:::benchmark_data_smithi188_104537_object21619:head# 2024-04-01T19:36:18.700 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ed9682:::benchmark_data_smithi188_104537_object159140:head# 2024-04-01T19:36:18.701 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ee93e9:::benchmark_data_smithi188_104537_object171938:head# 2024-04-01T19:36:18.701 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ef2345:::benchmark_data_smithi188_104537_object148278:head# 2024-04-01T19:36:18.701 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ef2f84:::benchmark_data_smithi188_104537_object146702:head# 2024-04-01T19:36:18.702 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ef4a5c:::benchmark_data_smithi188_104537_object137040:head# 2024-04-01T19:36:18.702 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ef7f76:::benchmark_data_smithi188_104537_object61891:head# 2024-04-01T19:36:18.703 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58efbf6d:::benchmark_data_smithi188_104537_object165802:head# 2024-04-01T19:36:18.704 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f029a3:::benchmark_data_smithi188_104537_object125467:head# 2024-04-01T19:36:18.704 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f0877a:::benchmark_data_smithi188_104537_object19806:head# 2024-04-01T19:36:18.705 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f09eb0:::benchmark_data_smithi188_104537_object130772:head# 2024-04-01T19:36:18.706 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f141f3:::benchmark_data_smithi188_104537_object15665:head# 2024-04-01T19:36:18.706 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f160f9:::benchmark_data_smithi188_104537_object84717:head# 2024-04-01T19:36:18.706 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f183ae:::benchmark_data_smithi188_104537_object108221:head# 2024-04-01T19:36:18.707 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f19a78:::benchmark_data_smithi188_104537_object108727:head# 2024-04-01T19:36:18.707 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f1f1e7:::benchmark_data_smithi188_104537_object139800:head# 2024-04-01T19:36:18.708 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f221e5:::benchmark_data_smithi188_104537_object22314:head# 2024-04-01T19:36:18.708 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f26042:::benchmark_data_smithi188_104537_object74805:head# 2024-04-01T19:36:18.709 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f286b9:::benchmark_data_smithi188_104537_object166762:head# 2024-04-01T19:36:18.709 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f37cb1:::benchmark_data_smithi188_104537_object41051:head# 2024-04-01T19:36:18.710 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f3812a:::benchmark_data_smithi188_104537_object134811:head# 2024-04-01T19:36:18.710 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f3908f:::benchmark_data_smithi188_104537_object85686:head# 2024-04-01T19:36:18.710 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f4019b:::benchmark_data_smithi188_104537_object154800:head# 2024-04-01T19:36:18.711 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f4842c:::benchmark_data_smithi188_104537_object98151:head# 2024-04-01T19:36:18.711 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f50b66:::benchmark_data_smithi188_104537_object49640:head# 2024-04-01T19:36:18.712 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f533c6:::benchmark_data_smithi188_104537_object101725:head# 2024-04-01T19:36:18.712 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f570a7:::benchmark_data_smithi188_104537_object110600:head# 2024-04-01T19:36:18.713 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f5d675:::benchmark_data_smithi188_104537_object31409:head# 2024-04-01T19:36:18.713 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f662eb:::benchmark_data_smithi188_104537_object32989:head# 2024-04-01T19:36:18.714 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f68495:::benchmark_data_smithi188_104537_object161301:head# 2024-04-01T19:36:18.714 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f6a274:::benchmark_data_smithi188_104537_object35215:head# 2024-04-01T19:36:18.715 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f702e1:::benchmark_data_smithi188_104537_object128767:head# 2024-04-01T19:36:18.715 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f7776b:::benchmark_data_smithi188_104537_object128206:head# 2024-04-01T19:36:18.716 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f7c8f3:::benchmark_data_smithi188_104537_object60481:head# 2024-04-01T19:36:18.716 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f81515:::benchmark_data_smithi188_104537_object171790:head# 2024-04-01T19:36:18.716 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f86c3b:::benchmark_data_smithi188_104537_object41816:head# 2024-04-01T19:36:18.717 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f8eb84:::benchmark_data_smithi188_104537_object85326:head# 2024-04-01T19:36:18.718 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f8f716:::benchmark_data_smithi188_104537_object126725:head# 2024-04-01T19:36:18.718 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f90618:::benchmark_data_smithi188_104537_object171445:head# 2024-04-01T19:36:18.718 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f95409:::benchmark_data_smithi188_104537_object169799:head# 2024-04-01T19:36:18.719 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f9afe8:::benchmark_data_smithi188_104537_object104752:head# 2024-04-01T19:36:18.719 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f9da3b:::benchmark_data_smithi188_104537_object59986:head# 2024-04-01T19:36:18.720 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58f9ef78:::benchmark_data_smithi188_104537_object34744:head# 2024-04-01T19:36:18.720 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58fa1939:::benchmark_data_smithi188_104537_object147904:head# 2024-04-01T19:36:18.721 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58fa2fd6:::benchmark_data_smithi188_104537_object48232:head# 2024-04-01T19:36:18.721 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58fa4439:::benchmark_data_smithi188_104537_object78707:head# 2024-04-01T19:36:18.722 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58fc74cf:::benchmark_data_smithi188_104537_object109644:head# 2024-04-01T19:36:18.722 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58fcab04:::benchmark_data_smithi188_104537_object81025:head# 2024-04-01T19:36:18.722 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58fdcc2a:::benchmark_data_smithi188_104537_object26389:head# 2024-04-01T19:36:18.723 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:36:18.723 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58fe1905:::benchmark_data_smithi188_104537_object160574:head# 2024-04-01T19:36:18.724 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58fedd2d:::benchmark_data_smithi188_104537_object101179:head# 2024-04-01T19:36:18.724 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ff3c27:::benchmark_data_smithi188_104537_object17314:head# 2024-04-01T19:36:18.724 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ffa739:::benchmark_data_smithi188_104537_object103130:head# 2024-04-01T19:36:18.725 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58ffd532:::benchmark_data_smithi188_104537_object11536:head# 2024-04-01T19:36:18.726 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:58fff98f:::benchmark_data_smithi188_104537_object34333:head# 2024-04-01T19:36:18.726 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5900059f:::benchmark_data_smithi188_104537_object37728:head# 2024-04-01T19:36:18.726 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:590070f6:::benchmark_data_smithi188_104537_object94014:head# 2024-04-01T19:36:18.727 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5900bd7f:::benchmark_data_smithi188_104537_object97123:head# 2024-04-01T19:36:18.727 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59011c64:::benchmark_data_smithi188_104537_object165961:head# 2024-04-01T19:36:18.727 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:590171b0:::benchmark_data_smithi188_104537_object26182:head# 2024-04-01T19:36:18.728 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5901e38b:::benchmark_data_smithi188_104537_object158260:head# 2024-04-01T19:36:18.728 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5901ff5a:::benchmark_data_smithi188_104537_object16619:head# 2024-04-01T19:36:18.729 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59023059:::benchmark_data_smithi188_104537_object154465:head# 2024-04-01T19:36:18.729 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:590263c8:::benchmark_data_smithi188_104537_object22264:head# 2024-04-01T19:36:18.730 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:590346fb:::benchmark_data_smithi188_104537_object162619:head# 2024-04-01T19:36:18.730 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59038d24:::benchmark_data_smithi188_104537_object109216:head# 2024-04-01T19:36:18.731 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59041627:::benchmark_data_smithi188_104537_object93184:head# 2024-04-01T19:36:18.732 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:590503ad:::benchmark_data_smithi188_104537_object152888:head# 2024-04-01T19:36:18.732 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59055ad9:::benchmark_data_smithi188_104537_object145043:head# 2024-04-01T19:36:18.732 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59058b56:::benchmark_data_smithi188_104537_object16249:head# 2024-04-01T19:36:18.733 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5906137a:::benchmark_data_smithi188_104537_object107821:head# 2024-04-01T19:36:18.733 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59067875:::benchmark_data_smithi188_104537_object90337:head# 2024-04-01T19:36:18.734 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59069723:::benchmark_data_smithi188_104537_object84575:head# 2024-04-01T19:36:18.734 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5906990c:::benchmark_data_smithi188_104537_object119413:head# 2024-04-01T19:36:18.735 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5906b275:::benchmark_data_smithi188_104537_object135469:head# 2024-04-01T19:36:18.735 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59073bc8:::benchmark_data_smithi188_104537_object95166:head# 2024-04-01T19:36:18.736 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5907bfcb:::benchmark_data_smithi188_104537_object134128:head# 2024-04-01T19:36:18.736 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59082819:::benchmark_data_smithi188_104537_object41017:head# 2024-04-01T19:36:18.736 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59088d81:::benchmark_data_smithi188_104537_object16655:head# 2024-04-01T19:36:18.737 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5909abca:::benchmark_data_smithi188_104537_object65677:head# 2024-04-01T19:36:18.737 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5909b0f1:::benchmark_data_smithi188_104537_object128123:head# 2024-04-01T19:36:18.738 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:590a706d:::benchmark_data_smithi188_104537_object104183:head# 2024-04-01T19:36:18.738 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:590a8f2d:::benchmark_data_smithi188_104537_object135666:head# 2024-04-01T19:36:18.738 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:590a91f4:::benchmark_data_smithi188_104537_object159511:head# 2024-04-01T19:36:18.739 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:590ab6cd:::benchmark_data_smithi188_104537_object162553:head# 2024-04-01T19:36:18.739 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:590baa1f:::benchmark_data_smithi188_104537_object140052:head# 2024-04-01T19:36:18.739 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:590c0171:::benchmark_data_smithi188_104537_object45045:head# 2024-04-01T19:36:18.740 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:590c100a:::benchmark_data_smithi188_104537_object31646:head# 2024-04-01T19:36:18.740 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:590c1127:::benchmark_data_smithi188_104537_object166677:head# 2024-04-01T19:36:18.741 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:590c11ce:::benchmark_data_smithi188_104537_object106679:head# 2024-04-01T19:36:18.741 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:590c3b92:::benchmark_data_smithi188_104537_object57669:head# 2024-04-01T19:36:18.742 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:590d4986:::benchmark_data_smithi188_104537_object67212:head# 2024-04-01T19:36:18.742 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:590e916c:::benchmark_data_smithi188_104537_object149025:head# 2024-04-01T19:36:18.743 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:590eeaa6:::benchmark_data_smithi188_104537_object19973:head# 2024-04-01T19:36:18.743 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:590ef37a:::benchmark_data_smithi188_104537_object109821:head# 2024-04-01T19:36:18.744 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:590f0046:::benchmark_data_smithi188_104537_object20930:head# 2024-04-01T19:36:18.744 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:590f08c9:::benchmark_data_smithi188_104537_object171468:head# 2024-04-01T19:36:18.745 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:591087b4:::benchmark_data_smithi188_104537_object62334:head# 2024-04-01T19:36:18.745 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:591087f8:::benchmark_data_smithi188_104537_object52089:head# 2024-04-01T19:36:18.745 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5910b6af:::benchmark_data_smithi188_104537_object91278:head# 2024-04-01T19:36:18.746 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5910e5f6:::benchmark_data_smithi188_104537_object156398:head# 2024-04-01T19:36:18.746 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5911dbab:::benchmark_data_smithi188_104537_object165829:head# 2024-04-01T19:36:18.746 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59121b3f:::benchmark_data_smithi188_104537_object46677:head# 2024-04-01T19:36:18.747 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59121d7e:::benchmark_data_smithi188_104537_object110790:head# 2024-04-01T19:36:18.747 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5912b907:::benchmark_data_smithi188_104537_object113029:head# 2024-04-01T19:36:18.748 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5912dfb7:::benchmark_data_smithi188_104537_object41397:head# 2024-04-01T19:36:18.748 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5913338a:::benchmark_data_smithi188_104537_object162025:head# 2024-04-01T19:36:18.748 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:591377dc:::benchmark_data_smithi188_104537_object40210:head# 2024-04-01T19:36:18.749 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5914fa7e:::benchmark_data_smithi188_104537_object152207:head# 2024-04-01T19:36:18.749 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5915ad64:::benchmark_data_smithi188_104537_object142059:head# 2024-04-01T19:36:18.750 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5916342a:::benchmark_data_smithi188_104537_object63989:head# 2024-04-01T19:36:18.750 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5917aeee:::benchmark_data_smithi188_104537_object17786:head# 2024-04-01T19:36:18.751 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59184172:::benchmark_data_smithi188_104537_object39103:head# 2024-04-01T19:36:18.751 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59194eea:::benchmark_data_smithi188_104537_object120162:head# 2024-04-01T19:36:18.752 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:591a7011:::benchmark_data_smithi188_104537_object52827:head# 2024-04-01T19:36:18.752 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:18.752 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:591b5bd7:::benchmark_data_smithi188_104537_object23921:head# 2024-04-01T19:36:18.753 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:591b78ef:::benchmark_data_smithi188_104537_object69160:head# 2024-04-01T19:36:18.753 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:591c42e0:::benchmark_data_smithi188_104537_object129590:head# 2024-04-01T19:36:18.754 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:591c4629:::benchmark_data_smithi188_104537_object54719:head# 2024-04-01T19:36:18.754 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:591c5a3a:::benchmark_data_smithi188_104537_object125373:head# 2024-04-01T19:36:18.755 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:591cae94:::benchmark_data_smithi188_104537_object33115:head# 2024-04-01T19:36:18.755 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:591d2e0c:::benchmark_data_smithi188_104537_object66832:head# 2024-04-01T19:36:18.756 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:591dd04b:::benchmark_data_smithi188_104537_object74397:head# 2024-04-01T19:36:18.756 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:591df3d1:::benchmark_data_smithi188_104537_object98220:head# 2024-04-01T19:36:18.756 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:591df7b9:::benchmark_data_smithi188_104537_object52957:head# 2024-04-01T19:36:18.756 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:591dfcf1:::benchmark_data_smithi188_104537_object101948:head# 2024-04-01T19:36:18.757 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:591ed194:::benchmark_data_smithi188_104537_object26578:head# 2024-04-01T19:36:18.758 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59205a97:::benchmark_data_smithi188_104537_object160676:head# 2024-04-01T19:36:18.758 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59207127:::benchmark_data_smithi188_104537_object70207:head# 2024-04-01T19:36:18.759 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59208d59:::benchmark_data_smithi188_104537_object29632:head# 2024-04-01T19:36:18.759 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5920a044:::benchmark_data_smithi188_104537_object67273:head# 2024-04-01T19:36:18.760 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59210d9e:::benchmark_data_smithi188_104537_object170450:head# 2024-04-01T19:36:18.760 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:592160a2:::benchmark_data_smithi188_104537_object46156:head# 2024-04-01T19:36:18.761 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5921ee63:::benchmark_data_smithi188_104537_object130548:head# 2024-04-01T19:36:18.761 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5922b147:::benchmark_data_smithi188_104537_object111937:head# 2024-04-01T19:36:18.761 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5922d182:::benchmark_data_smithi188_104537_object12311:head# 2024-04-01T19:36:18.762 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5922d83d:::benchmark_data_smithi188_104537_object75023:head# 2024-04-01T19:36:18.762 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5922ef1d:::benchmark_data_smithi188_104537_object28151:head# 2024-04-01T19:36:18.762 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5922fd65:::benchmark_data_smithi188_104537_object118748:head# 2024-04-01T19:36:18.763 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5923328c:::benchmark_data_smithi188_104537_object34810:head# 2024-04-01T19:36:18.763 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5923426f:::benchmark_data_smithi188_104537_object51151:head# 2024-04-01T19:36:18.764 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59239318:::benchmark_data_smithi188_104537_object83092:head# 2024-04-01T19:36:18.764 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5923ecc9:::benchmark_data_smithi188_104537_object64159:head# 2024-04-01T19:36:18.766 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59249272:::benchmark_data_smithi188_104537_object95544:head# 2024-04-01T19:36:18.766 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5924a3b5:::benchmark_data_smithi188_104537_object151836:head# 2024-04-01T19:36:18.766 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5924df69:::benchmark_data_smithi188_104537_object40303:head# 2024-04-01T19:36:18.767 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59251ce8:::benchmark_data_smithi188_104537_object13837:head# 2024-04-01T19:36:18.767 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:592539aa:::benchmark_data_smithi188_104537_object126022:head# 2024-04-01T19:36:18.767 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59256175:::benchmark_data_smithi188_104537_object80249:head# 2024-04-01T19:36:18.768 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5925c86f:::benchmark_data_smithi188_104537_object59538:head# 2024-04-01T19:36:18.768 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5926451e:::benchmark_data_smithi188_104537_object102719:head# 2024-04-01T19:36:18.769 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59267c87:::benchmark_data_smithi188_104537_object110400:head# 2024-04-01T19:36:18.769 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59270777:::benchmark_data_smithi188_104537_object103028:head# 2024-04-01T19:36:18.769 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59270f68:::benchmark_data_smithi188_104537_object33190:head# 2024-04-01T19:36:18.770 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59273526:::benchmark_data_smithi188_104537_object147756:head# 2024-04-01T19:36:18.770 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59273796:::benchmark_data_smithi188_104537_object121598:head# 2024-04-01T19:36:18.771 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59276109:::benchmark_data_smithi188_104537_object30468:head# 2024-04-01T19:36:18.771 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59278f90:::benchmark_data_smithi188_104537_object129700:head# 2024-04-01T19:36:18.771 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:592810a3:::benchmark_data_smithi188_104537_object56856:head# 2024-04-01T19:36:18.772 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59282440:::benchmark_data_smithi188_104537_object139567:head# 2024-04-01T19:36:18.772 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59283186:::benchmark_data_smithi188_104537_object55312:head# 2024-04-01T19:36:18.773 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:36:18.773 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5929047d:::benchmark_data_smithi188_104537_object80847:head# 2024-04-01T19:36:18.774 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:592a53f6:::benchmark_data_smithi188_104537_object29526:head# 2024-04-01T19:36:18.774 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:592b24fa:::benchmark_data_smithi188_104537_object28900:head# 2024-04-01T19:36:18.774 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:592b90dc:::benchmark_data_smithi188_104537_object142165:head# 2024-04-01T19:36:18.775 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:592c844b:::benchmark_data_smithi188_104537_object56739:head# 2024-04-01T19:36:18.775 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:18.776 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:36:18.776 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:592ccf94:::benchmark_data_smithi188_104537_object124268:head# 2024-04-01T19:36:18.776 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:592cd7e7:::benchmark_data_smithi188_104537_object154020:head# 2024-04-01T19:36:18.776 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:592d59f9:::benchmark_data_smithi188_104537_object68573:head# 2024-04-01T19:36:18.777 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:592e1539:::benchmark_data_smithi188_104537_object163538:head# 2024-04-01T19:36:18.777 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:592e5e37:::benchmark_data_smithi188_104537_object107975:head# 2024-04-01T19:36:18.777 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:592e74c9:::benchmark_data_smithi188_104537_object43421:head# 2024-04-01T19:36:18.778 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:592ef3ec:::benchmark_data_smithi188_104537_object135909:head# 2024-04-01T19:36:18.778 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:593038d0:::benchmark_data_smithi188_104537_object57920:head# 2024-04-01T19:36:18.779 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5930be6d:::benchmark_data_smithi188_104537_object33873:head# 2024-04-01T19:36:18.779 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5931633b:::benchmark_data_smithi188_104537_object74122:head# 2024-04-01T19:36:18.780 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5931aa0f:::benchmark_data_smithi188_104537_object107919:head# 2024-04-01T19:36:18.780 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5931c17d:::benchmark_data_smithi188_104537_object54622:head# 2024-04-01T19:36:18.780 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5931c734:::benchmark_data_smithi188_104537_object16890:head# 2024-04-01T19:36:18.781 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5932167a:::benchmark_data_smithi188_104537_object76532:head# 2024-04-01T19:36:18.781 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:593223de:::benchmark_data_smithi188_104537_object11441:head# 2024-04-01T19:36:18.782 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5932c7aa:::benchmark_data_smithi188_104537_object113304:head# 2024-04-01T19:36:18.782 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59333d5a:::benchmark_data_smithi188_104537_object72606:head# 2024-04-01T19:36:18.783 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5933a4bd:::benchmark_data_smithi188_104537_object71602:head# 2024-04-01T19:36:18.783 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59341ccc:::benchmark_data_smithi188_104537_object27623:head# 2024-04-01T19:36:18.784 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59342145:::benchmark_data_smithi188_104537_object99992:head# 2024-04-01T19:36:18.784 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59343933:::benchmark_data_smithi188_104537_object102813:head# 2024-04-01T19:36:18.784 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5934755f:::benchmark_data_smithi188_104537_object44992:head# 2024-04-01T19:36:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5934b31b:::benchmark_data_smithi188_104537_object44497:head# 2024-04-01T19:36:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5934feab:::benchmark_data_smithi188_104537_object131998:head# 2024-04-01T19:36:18.786 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59353ad5:::benchmark_data_smithi188_104537_object141846:head# 2024-04-01T19:36:18.786 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:593595f3:::benchmark_data_smithi188_104537_object46814:head# 2024-04-01T19:36:18.787 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5936684b:::benchmark_data_smithi188_104537_object22170:head# 2024-04-01T19:36:18.787 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5936a97d:::benchmark_data_smithi188_104537_object53681:head# 2024-04-01T19:36:18.788 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:593729c9:::benchmark_data_smithi188_104537_object13048:head# 2024-04-01T19:36:18.788 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59374c40:::benchmark_data_smithi188_104537_object83391:head# 2024-04-01T19:36:18.788 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5937ac4f:::benchmark_data_smithi188_104537_object151855:head# 2024-04-01T19:36:18.789 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:593877a9:::benchmark_data_smithi188_104537_object122837:head# 2024-04-01T19:36:18.789 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59389b3c:::benchmark_data_smithi188_104537_object21127:head# 2024-04-01T19:36:18.790 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59393bd2:::benchmark_data_smithi188_104537_object30824:head# 2024-04-01T19:36:18.790 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5939b66c:::benchmark_data_smithi188_104537_object153608:head# 2024-04-01T19:36:18.790 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:593a09cc:::benchmark_data_smithi188_104537_object166124:head# 2024-04-01T19:36:18.791 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:593a0e92:::benchmark_data_smithi188_104537_object79454:head# 2024-04-01T19:36:18.791 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:593a3a82:::benchmark_data_smithi188_104537_object112819:head# 2024-04-01T19:36:18.792 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:593a7609:::benchmark_data_smithi188_104537_object58347:head# 2024-04-01T19:36:18.792 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:593a9048:::benchmark_data_smithi188_104537_object149837:head# 2024-04-01T19:36:18.793 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:593ac17b:::benchmark_data_smithi188_104537_object59268:head# 2024-04-01T19:36:18.793 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:593b59ff:::benchmark_data_smithi188_104537_object62248:head# 2024-04-01T19:36:18.793 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:593bb9d1:::benchmark_data_smithi188_104537_object92848:head# 2024-04-01T19:36:18.794 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:593bbf39:::benchmark_data_smithi188_104537_object25350:head# 2024-04-01T19:36:18.794 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:593bc77b:::benchmark_data_smithi188_104537_object139993:head# 2024-04-01T19:36:18.795 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:593bc854:::benchmark_data_smithi188_104537_object119285:head# 2024-04-01T19:36:18.795 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:593be660:::benchmark_data_smithi188_104537_object43647:head# 2024-04-01T19:36:18.795 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:593d0df1:::benchmark_data_smithi188_104537_object121798:head# 2024-04-01T19:36:18.796 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:593e0a05:::benchmark_data_smithi188_104537_object36045:head# 2024-04-01T19:36:18.796 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:593f2563:::benchmark_data_smithi188_104537_object50240:head# 2024-04-01T19:36:18.797 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:593ffce1:::benchmark_data_smithi188_104537_object84182:head# 2024-04-01T19:36:18.797 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59412132:::benchmark_data_smithi188_104537_object64773:head# 2024-04-01T19:36:18.798 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5942d862:::benchmark_data_smithi188_104537_object35277:head# 2024-04-01T19:36:18.798 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5942e3e3:::benchmark_data_smithi188_104537_object158640:head# 2024-04-01T19:36:18.799 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:594536b3:::benchmark_data_smithi188_104537_object103245:head# 2024-04-01T19:36:18.799 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:594773a6:::benchmark_data_smithi188_104537_object102330:head# 2024-04-01T19:36:18.799 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5947a666:::benchmark_data_smithi188_104537_object100355:head# 2024-04-01T19:36:18.801 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5947cf2d:::benchmark_data_smithi188_104537_object117108:head# 2024-04-01T19:36:18.801 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5947fe4c:::benchmark_data_smithi188_104537_object113189:head# 2024-04-01T19:36:18.802 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59484a13:::benchmark_data_smithi188_104537_object62932:head# 2024-04-01T19:36:18.802 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5948fc89:::benchmark_data_smithi188_104537_object70860:head# 2024-04-01T19:36:18.802 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59491a3f:::benchmark_data_smithi188_104537_object46374:head# 2024-04-01T19:36:18.802 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59493bd7:::benchmark_data_smithi188_104537_object65914:head# 2024-04-01T19:36:18.802 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59494952:::benchmark_data_smithi188_104537_object115677:head# 2024-04-01T19:36:18.803 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5949985c:::benchmark_data_smithi188_104537_object142847:head# 2024-04-01T19:36:18.803 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5949dec8:::benchmark_data_smithi188_104537_object58326:head# 2024-04-01T19:36:18.803 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:594a21b0:::benchmark_data_smithi188_104537_object30430:head# 2024-04-01T19:36:18.804 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:594b41b4:::benchmark_data_smithi188_104537_object115373:head# 2024-04-01T19:36:18.804 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:594b5503:::benchmark_data_smithi188_104537_object151453:head# 2024-04-01T19:36:18.805 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:594c7622:::benchmark_data_smithi188_104537_object89098:head# 2024-04-01T19:36:18.806 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:594c9713:::benchmark_data_smithi188_104537_object108090:head# 2024-04-01T19:36:18.807 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:594ca6de:::benchmark_data_smithi188_104537_object151369:head# 2024-04-01T19:36:18.807 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:594d5b0a:::benchmark_data_smithi188_104537_object163177:head# 2024-04-01T19:36:18.808 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:594d8c9a:::benchmark_data_smithi188_104537_object122459:head# 2024-04-01T19:36:18.808 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:594dd073:::benchmark_data_smithi188_104537_object47910:head# 2024-04-01T19:36:18.808 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:594ee784:::benchmark_data_smithi188_104537_object56303:head# 2024-04-01T19:36:18.809 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:594ff48a:::benchmark_data_smithi188_104537_object51480:head# 2024-04-01T19:36:18.810 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59500743:::benchmark_data_smithi188_104537_object28732:head# 2024-04-01T19:36:18.810 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59523f05:::benchmark_data_smithi188_104537_object167619:head# 2024-04-01T19:36:18.810 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5952afcf:::benchmark_data_smithi188_104537_object77644:head# 2024-04-01T19:36:18.811 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5952c29d:::benchmark_data_smithi188_104537_object70536:head# 2024-04-01T19:36:18.811 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5953102f:::benchmark_data_smithi188_104537_object78254:head# 2024-04-01T19:36:18.812 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5953442a:::benchmark_data_smithi188_104537_object65871:head# 2024-04-01T19:36:18.812 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5953ac62:::benchmark_data_smithi188_104537_object168690:head# 2024-04-01T19:36:18.813 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5953b226:::benchmark_data_smithi188_104537_object62351:head# 2024-04-01T19:36:18.813 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5953ffa4:::benchmark_data_smithi188_104537_object92378:head# 2024-04-01T19:36:18.813 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59549999:::benchmark_data_smithi188_104537_object28616:head# 2024-04-01T19:36:18.814 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59550cb2:::benchmark_data_smithi188_104537_object26231:head# 2024-04-01T19:36:18.814 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59554be7:::benchmark_data_smithi188_104537_object129991:head# 2024-04-01T19:36:18.815 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5955b7b8:::benchmark_data_smithi188_104537_object129081:head# 2024-04-01T19:36:18.815 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59568705:::benchmark_data_smithi188_104537_object16057:head# 2024-04-01T19:36:18.816 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59572016:::benchmark_data_smithi188_104537_object140120:head# 2024-04-01T19:36:18.816 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59573e16:::benchmark_data_smithi188_104537_object129415:head# 2024-04-01T19:36:18.817 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:595820a7:::benchmark_data_smithi188_104537_object48041:head# 2024-04-01T19:36:18.817 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5958db33:::benchmark_data_smithi188_104537_object36304:head# 2024-04-01T19:36:18.818 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59590006:::benchmark_data_smithi188_104537_object84446:head# 2024-04-01T19:36:18.818 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5959e81f:::benchmark_data_smithi188_104537_object151375:head# 2024-04-01T19:36:18.818 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:595a73ce:::benchmark_data_smithi188_104537_object84817:head# 2024-04-01T19:36:18.819 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:595a769e:::benchmark_data_smithi188_104537_object130736:head# 2024-04-01T19:36:18.819 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:595ae22b:::benchmark_data_smithi188_104537_object58675:head# 2024-04-01T19:36:18.820 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:595b1b2e:::benchmark_data_smithi188_104537_object24364:head# 2024-04-01T19:36:18.820 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:595b32e4:::benchmark_data_smithi188_104537_object29713:head# 2024-04-01T19:36:18.820 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:595c1901:::benchmark_data_smithi188_104537_object53696:head# 2024-04-01T19:36:18.821 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:595c2beb:::benchmark_data_smithi188_104537_object121709:head# 2024-04-01T19:36:18.821 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:595c605f:::benchmark_data_smithi188_104537_object118683:head# 2024-04-01T19:36:18.822 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:595c9603:::benchmark_data_smithi188_104537_object15935:head# 2024-04-01T19:36:18.822 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:595ca0b7:::benchmark_data_smithi188_104537_object45929:head# 2024-04-01T19:36:18.823 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:595cbaa6:::benchmark_data_smithi188_104537_object119116:head# 2024-04-01T19:36:18.823 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:595d029c:::benchmark_data_smithi188_104537_object86970:head# 2024-04-01T19:36:18.824 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:595d8c52:::benchmark_data_smithi188_104537_object110152:head# 2024-04-01T19:36:18.824 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:595df332:::benchmark_data_smithi188_104537_object46511:head# 2024-04-01T19:36:18.824 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:595e1327:::benchmark_data_smithi188_104537_object171554:head# 2024-04-01T19:36:18.825 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:595edc57:::benchmark_data_smithi188_104537_object169113:head# 2024-04-01T19:36:18.825 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:595ee818:::benchmark_data_smithi188_104537_object31990:head# 2024-04-01T19:36:18.826 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:595f35f3:::benchmark_data_smithi188_104537_object75950:head# 2024-04-01T19:36:18.826 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:595fbf52:::benchmark_data_smithi188_104537_object72408:head# 2024-04-01T19:36:18.827 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59602be8:::benchmark_data_smithi188_104537_object127501:head# 2024-04-01T19:36:18.827 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:596072f2:::benchmark_data_smithi188_104537_object143166:head# 2024-04-01T19:36:18.828 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5960ca83:::benchmark_data_smithi188_104537_object162466:head# 2024-04-01T19:36:18.828 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59610ccc:::benchmark_data_smithi188_104537_object115757:head# 2024-04-01T19:36:18.829 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59611f29:::benchmark_data_smithi188_104537_object111147:head# 2024-04-01T19:36:18.829 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5961e35c:::benchmark_data_smithi188_104537_object165540:head# 2024-04-01T19:36:18.829 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:596220c2:::benchmark_data_smithi188_104537_object72002:head# 2024-04-01T19:36:18.830 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59625a87:::benchmark_data_smithi188_104537_object148215:head# 2024-04-01T19:36:18.830 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:596276c7:::benchmark_data_smithi188_104537_object71139:head# 2024-04-01T19:36:18.831 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:596287ae:::benchmark_data_smithi188_104537_object44415:head# 2024-04-01T19:36:18.832 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5962dd4f:::benchmark_data_smithi188_104537_object55343:head# 2024-04-01T19:36:18.832 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59633ab8:::benchmark_data_smithi188_104537_object49878:head# 2024-04-01T19:36:18.832 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5963f2cb:::benchmark_data_smithi188_104537_object113751:head# 2024-04-01T19:36:18.832 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:596418c3:::benchmark_data_smithi188_104537_object108982:head# 2024-04-01T19:36:18.833 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59647f1b:::benchmark_data_smithi188_104537_object49757:head# 2024-04-01T19:36:18.834 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59650bae:::benchmark_data_smithi188_104537_object47090:head# 2024-04-01T19:36:18.834 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59658374:::benchmark_data_smithi188_104537_object80780:head# 2024-04-01T19:36:18.835 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5965cca7:::benchmark_data_smithi188_104537_object90038:head# 2024-04-01T19:36:18.835 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59660f2f:::benchmark_data_smithi188_104537_object41927:head# 2024-04-01T19:36:18.835 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5966147a:::benchmark_data_smithi188_104537_object69107:head# 2024-04-01T19:36:18.836 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59662b59:::benchmark_data_smithi188_104537_object95189:head# 2024-04-01T19:36:18.836 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59673351:::benchmark_data_smithi188_104537_object64365:head# 2024-04-01T19:36:18.837 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:596758ab:::benchmark_data_smithi188_104537_object31077:head# 2024-04-01T19:36:18.837 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59677870:::benchmark_data_smithi188_104537_object166604:head# 2024-04-01T19:36:18.838 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59678b8c:::benchmark_data_smithi188_104537_object145511:head# 2024-04-01T19:36:18.838 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5967d38f:::benchmark_data_smithi188_104537_object100976:head# 2024-04-01T19:36:18.838 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:596908da:::benchmark_data_smithi188_104537_object54495:head# 2024-04-01T19:36:18.839 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:596985ea:::benchmark_data_smithi188_104537_object95566:head# 2024-04-01T19:36:18.839 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5969c7ed:::benchmark_data_smithi188_104537_object131959:head# 2024-04-01T19:36:18.840 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:596a83bb:::benchmark_data_smithi188_104537_object42348:head# 2024-04-01T19:36:18.840 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:596bfa7f:::benchmark_data_smithi188_104537_object28106:head# 2024-04-01T19:36:18.840 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:596c93a5:::benchmark_data_smithi188_104537_object143739:head# 2024-04-01T19:36:18.841 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:596cea36:::benchmark_data_smithi188_104537_object67341:head# 2024-04-01T19:36:18.841 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:596d12ad:::benchmark_data_smithi188_104537_object35709:head# 2024-04-01T19:36:18.842 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:596d543f:::benchmark_data_smithi188_104537_object98961:head# 2024-04-01T19:36:18.842 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:596d6e7e:::benchmark_data_smithi188_104537_object115709:head# 2024-04-01T19:36:18.842 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:596d8d0b:::benchmark_data_smithi188_104537_object137152:head# 2024-04-01T19:36:18.843 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:596ecf6a:::benchmark_data_smithi188_104537_object42947:head# 2024-04-01T19:36:18.843 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:596f5cba:::benchmark_data_smithi188_104537_object157834:head# 2024-04-01T19:36:18.844 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:597053e4:::benchmark_data_smithi188_104537_object151134:head# 2024-04-01T19:36:18.844 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59709a66:::benchmark_data_smithi188_104537_object21712:head# 2024-04-01T19:36:18.845 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59717340:::benchmark_data_smithi188_104537_object108711:head# 2024-04-01T19:36:18.845 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5971a4b5:::benchmark_data_smithi188_104537_object20253:head# 2024-04-01T19:36:18.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5971b9c3:::benchmark_data_smithi188_104537_object48508:head# 2024-04-01T19:36:18.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5971e25d:::benchmark_data_smithi188_104537_object121217:head# 2024-04-01T19:36:18.847 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5971e900:::benchmark_data_smithi188_104537_object46830:head# 2024-04-01T19:36:18.847 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:597283fa:::benchmark_data_smithi188_104537_object54883:head# 2024-04-01T19:36:18.847 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5972da28:::benchmark_data_smithi188_104537_object56171:head# 2024-04-01T19:36:18.848 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59738dd1:::benchmark_data_smithi188_104537_object65166:head# 2024-04-01T19:36:18.848 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5973ac3e:::benchmark_data_smithi188_104537_object136645:head# 2024-04-01T19:36:18.849 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5973b166:::benchmark_data_smithi188_104537_object73558:head# 2024-04-01T19:36:18.849 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59747329:::benchmark_data_smithi188_104537_object137706:head# 2024-04-01T19:36:18.850 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5974b35a:::benchmark_data_smithi188_104537_object93064:head# 2024-04-01T19:36:18.850 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5974e985:::benchmark_data_smithi188_104537_object83440:head# 2024-04-01T19:36:18.850 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:597539c4:::benchmark_data_smithi188_104537_object141547:head# 2024-04-01T19:36:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5975815c:::benchmark_data_smithi188_104537_object154515:head# 2024-04-01T19:36:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:597714bf:::benchmark_data_smithi188_104537_object147050:head# 2024-04-01T19:36:18.852 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59771da0:::benchmark_data_smithi188_104537_object14740:head# 2024-04-01T19:36:18.853 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59772919:::benchmark_data_smithi188_104537_object158372:head# 2024-04-01T19:36:18.853 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59779798:::benchmark_data_smithi188_104537_object89832:head# 2024-04-01T19:36:18.853 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5978da07:::benchmark_data_smithi188_104537_object79247:head# 2024-04-01T19:36:18.853 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:597936c2:::benchmark_data_smithi188_104537_object140240:head# 2024-04-01T19:36:18.854 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5979d7ea:::benchmark_data_smithi188_104537_object128397:head# 2024-04-01T19:36:18.854 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5979ffce:::benchmark_data_smithi188_104537_object90378:head# 2024-04-01T19:36:18.855 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:597a6e35:::benchmark_data_smithi188_104537_object156889:head# 2024-04-01T19:36:18.855 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:597bb800:::benchmark_data_smithi188_104537_object153801:head# 2024-04-01T19:36:18.856 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:597bf5a6:::benchmark_data_smithi188_104537_object104560:head# 2024-04-01T19:36:18.856 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:597c1908:::benchmark_data_smithi188_104537_object144918:head# 2024-04-01T19:36:18.857 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:597c4e0d:::benchmark_data_smithi188_104537_object27328:head# 2024-04-01T19:36:18.857 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:597c7402:::benchmark_data_smithi188_104537_object105984:head# 2024-04-01T19:36:18.858 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:597cec3d:::benchmark_data_smithi188_104537_object50154:head# 2024-04-01T19:36:18.858 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:597e49c0:::benchmark_data_smithi188_104537_object34305:head# 2024-04-01T19:36:18.859 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:597ea349:::benchmark_data_smithi188_104537_object61589:head# 2024-04-01T19:36:18.859 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:597f5a26:::benchmark_data_smithi188_104537_object29677:head# 2024-04-01T19:36:18.859 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:597f77f5:::benchmark_data_smithi188_104537_object170303:head# 2024-04-01T19:36:18.860 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:597ff248:::benchmark_data_smithi188_104537_object151531:head# 2024-04-01T19:36:18.860 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59806cf8:::benchmark_data_smithi188_104537_object75296:head# 2024-04-01T19:36:18.861 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59807c1b:::benchmark_data_smithi188_104537_object28196:head# 2024-04-01T19:36:18.861 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5980ccd7:::benchmark_data_smithi188_104537_object109377:head# 2024-04-01T19:36:18.861 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59810da1:::benchmark_data_smithi188_104537_object162571:head# 2024-04-01T19:36:18.862 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59815686:::benchmark_data_smithi188_104537_object80774:head# 2024-04-01T19:36:18.862 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59816a22:::benchmark_data_smithi188_104537_object74436:head# 2024-04-01T19:36:18.863 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59817869:::benchmark_data_smithi188_104537_object165699:head# 2024-04-01T19:36:18.863 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5982d0e4:::benchmark_data_smithi188_104537_object156499:head# 2024-04-01T19:36:18.864 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59837f37:::benchmark_data_smithi188_104537_object95591:head# 2024-04-01T19:36:18.865 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59852a66:::benchmark_data_smithi188_104537_object83757:head# 2024-04-01T19:36:18.865 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5985ca00:::benchmark_data_smithi188_104537_object70645:head# 2024-04-01T19:36:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5985e608:::benchmark_data_smithi188_104537_object145272:head# 2024-04-01T19:36:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5987446e:::benchmark_data_smithi188_104537_object111589:head# 2024-04-01T19:36:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59878cb4:::benchmark_data_smithi188_104537_object42630:head# 2024-04-01T19:36:18.867 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5987e978:::benchmark_data_smithi188_104537_object82438:head# 2024-04-01T19:36:18.868 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:598828a2:::benchmark_data_smithi188_104537_object79172:head# 2024-04-01T19:36:18.868 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:598839f5:::benchmark_data_smithi188_104537_object129300:head# 2024-04-01T19:36:18.868 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59885b86:::benchmark_data_smithi188_104537_object41370:head# 2024-04-01T19:36:18.869 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5988700f:::benchmark_data_smithi188_104537_object107033:head# 2024-04-01T19:36:18.869 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59888441:::benchmark_data_smithi188_104537_object123518:head# 2024-04-01T19:36:18.869 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5988abc8:::benchmark_data_smithi188_104537_object90586:head# 2024-04-01T19:36:18.870 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59898294:::benchmark_data_smithi188_104537_object99447:head# 2024-04-01T19:36:18.870 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5989c05c:::benchmark_data_smithi188_104537_object26310:head# 2024-04-01T19:36:18.871 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:598a2d40:::benchmark_data_smithi188_104537_object160780:head# 2024-04-01T19:36:18.871 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:598a771e:::benchmark_data_smithi188_104537_object168519:head# 2024-04-01T19:36:18.871 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:598bf7ab:::benchmark_data_smithi188_104537_object61653:head# 2024-04-01T19:36:18.872 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:598cb00e:::benchmark_data_smithi188_104537_object91846:head# 2024-04-01T19:36:18.872 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:598d14be:::benchmark_data_smithi188_104537_object12710:head# 2024-04-01T19:36:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:598d21ce:::benchmark_data_smithi188_104537_object144623:head# 2024-04-01T19:36:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:598d279f:::benchmark_data_smithi188_104537_object38260:head# 2024-04-01T19:36:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:598d55bb:::benchmark_data_smithi188_104537_object52589:head# 2024-04-01T19:36:18.874 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:598e2bb8:::benchmark_data_smithi188_104537_object117554:head# 2024-04-01T19:36:18.874 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:598e3d65:::benchmark_data_smithi188_104537_object91402:head# 2024-04-01T19:36:18.875 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:598e6bb1:::benchmark_data_smithi188_104537_object135202:head# 2024-04-01T19:36:18.875 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:598f5e77:::benchmark_data_smithi188_104537_object15944:head# 2024-04-01T19:36:18.876 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:598f700c:::benchmark_data_smithi188_104537_object121633:head# 2024-04-01T19:36:18.876 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:36:18.877 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:598fbfa7:::benchmark_data_smithi188_104537_object100729:head# 2024-04-01T19:36:18.877 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:599076f1:::benchmark_data_smithi188_104537_object164324:head# 2024-04-01T19:36:18.877 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59909c9e:::benchmark_data_smithi188_104537_object108358:head# 2024-04-01T19:36:18.877 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5992fbb6:::benchmark_data_smithi188_104537_object49925:head# 2024-04-01T19:36:18.879 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:599332fc:::benchmark_data_smithi188_104537_object110772:head# 2024-04-01T19:36:18.879 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59939fd2:::benchmark_data_smithi188_104537_object25165:head# 2024-04-01T19:36:18.879 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5993dce5:::benchmark_data_smithi188_104537_object59953:head# 2024-04-01T19:36:18.879 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59950595:::benchmark_data_smithi188_104537_object160659:head# 2024-04-01T19:36:18.879 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:599592d2:::benchmark_data_smithi188_104537_object64596:head# 2024-04-01T19:36:18.880 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5995b081:::benchmark_data_smithi188_104537_object46213:head# 2024-04-01T19:36:18.880 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:599659cc:::benchmark_data_smithi188_104537_object149383:head# 2024-04-01T19:36:18.881 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5996ba2d:::benchmark_data_smithi188_104537_object49664:head# 2024-04-01T19:36:18.881 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:599761b2:::benchmark_data_smithi188_104537_object138566:head# 2024-04-01T19:36:18.881 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:599784fd:::benchmark_data_smithi188_104537_object83064:head# 2024-04-01T19:36:18.882 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59983d18:::benchmark_data_smithi188_104537_object94305:head# 2024-04-01T19:36:18.882 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59985126:::benchmark_data_smithi188_104537_object95319:head# 2024-04-01T19:36:18.882 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5998b1b2:::benchmark_data_smithi188_104537_object166948:head# 2024-04-01T19:36:18.883 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5998b748:::benchmark_data_smithi188_104537_object140186:head# 2024-04-01T19:36:18.883 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5998c68f:::benchmark_data_smithi188_104537_object90009:head# 2024-04-01T19:36:18.883 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59996332:::benchmark_data_smithi188_104537_object164507:head# 2024-04-01T19:36:18.884 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:599a95f0:::benchmark_data_smithi188_104537_object99745:head# 2024-04-01T19:36:18.885 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:599ad0ed:::benchmark_data_smithi188_104537_object67721:head# 2024-04-01T19:36:18.885 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:599ad45f:::benchmark_data_smithi188_104537_object154819:head# 2024-04-01T19:36:18.886 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:599ad917:::benchmark_data_smithi188_104537_object88042:head# 2024-04-01T19:36:18.886 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:599bcccc:::benchmark_data_smithi188_104537_object56097:head# 2024-04-01T19:36:18.886 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:599e2dd5:::benchmark_data_smithi188_104537_object133499:head# 2024-04-01T19:36:18.887 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:599ea9b7:::benchmark_data_smithi188_104537_object142290:head# 2024-04-01T19:36:18.887 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:599ead2e:::benchmark_data_smithi188_104537_object159356:head# 2024-04-01T19:36:18.887 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:599f1248:::benchmark_data_smithi188_104537_object46500:head# 2024-04-01T19:36:18.888 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:599f5e5d:::benchmark_data_smithi188_104537_object122771:head# 2024-04-01T19:36:18.888 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:599fde83:::benchmark_data_smithi188_104537_object82037:head# 2024-04-01T19:36:18.888 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a075c0:::benchmark_data_smithi188_104537_object163431:head# 2024-04-01T19:36:18.889 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a0aa91:::benchmark_data_smithi188_104537_object34179:head# 2024-04-01T19:36:18.889 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a0c799:::benchmark_data_smithi188_104537_object138477:head# 2024-04-01T19:36:18.890 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a15acf:::benchmark_data_smithi188_104537_object97482:head# 2024-04-01T19:36:18.890 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a1b3c2:::benchmark_data_smithi188_104537_object40017:head# 2024-04-01T19:36:18.891 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a242f5:::benchmark_data_smithi188_104537_object136323:head# 2024-04-01T19:36:18.891 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a24fb0:::benchmark_data_smithi188_104537_object87559:head# 2024-04-01T19:36:18.892 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a2bc55:::benchmark_data_smithi188_104537_object66563:head# 2024-04-01T19:36:18.892 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a342e4:::benchmark_data_smithi188_104537_object54854:head# 2024-04-01T19:36:18.893 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a3be0e:::benchmark_data_smithi188_104537_object57550:head# 2024-04-01T19:36:18.893 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a3d322:::benchmark_data_smithi188_104537_object52703:head# 2024-04-01T19:36:18.893 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a4203a:::benchmark_data_smithi188_104537_object113237:head# 2024-04-01T19:36:18.894 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a479a4:::benchmark_data_smithi188_104537_object59220:head# 2024-04-01T19:36:18.894 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a4b1b9:::benchmark_data_smithi188_104537_object65038:head# 2024-04-01T19:36:18.895 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a4c4e4:::benchmark_data_smithi188_104537_object126010:head# 2024-04-01T19:36:18.895 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a5012b:::benchmark_data_smithi188_104537_object111724:head# 2024-04-01T19:36:18.897 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a580b4:::benchmark_data_smithi188_104537_object47706:head# 2024-04-01T19:36:18.897 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a63186:::benchmark_data_smithi188_104537_object35983:head# 2024-04-01T19:36:18.898 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a6b276:::benchmark_data_smithi188_104537_object165635:head# 2024-04-01T19:36:18.898 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a70c2c:::benchmark_data_smithi188_104537_object165301:head# 2024-04-01T19:36:18.898 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a778e9:::benchmark_data_smithi188_104537_object87710:head# 2024-04-01T19:36:18.898 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a77933:::benchmark_data_smithi188_104537_object112621:head# 2024-04-01T19:36:18.898 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a779c0:::benchmark_data_smithi188_104537_object112134:head# 2024-04-01T19:36:18.899 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a78338:::benchmark_data_smithi188_104537_object153443:head# 2024-04-01T19:36:18.899 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a838de:::benchmark_data_smithi188_104537_object17472:head# 2024-04-01T19:36:18.900 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a84705:::benchmark_data_smithi188_104537_object171674:head# 2024-04-01T19:36:18.900 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a95354:::benchmark_data_smithi188_104537_object79251:head# 2024-04-01T19:36:18.900 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a98378:::benchmark_data_smithi188_104537_object40579:head# 2024-04-01T19:36:18.901 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59a9ddb8:::benchmark_data_smithi188_104537_object126944:head# 2024-04-01T19:36:18.901 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59aaaace:::benchmark_data_smithi188_104537_object171162:head# 2024-04-01T19:36:18.902 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59aaebaf:::benchmark_data_smithi188_104537_object86005:head# 2024-04-01T19:36:18.902 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59ab060a:::benchmark_data_smithi188_104537_object146158:head# 2024-04-01T19:36:18.903 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59ac9dbf:::benchmark_data_smithi188_104537_object72530:head# 2024-04-01T19:36:18.903 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59ad3c69:::benchmark_data_smithi188_104537_object128225:head# 2024-04-01T19:36:18.903 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59ad4bf7:::benchmark_data_smithi188_104537_object22053:head# 2024-04-01T19:36:18.904 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59ada7da:::benchmark_data_smithi188_104537_object102536:head# 2024-04-01T19:36:18.904 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59ae3b07:::benchmark_data_smithi188_104537_object34328:head# 2024-04-01T19:36:18.905 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59ae83cd:::benchmark_data_smithi188_104537_object23461:head# 2024-04-01T19:36:18.905 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:18.906 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59aeaf98:::benchmark_data_smithi188_104537_object132886:head# 2024-04-01T19:36:18.906 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59aecfd6:::benchmark_data_smithi188_104537_object135848:head# 2024-04-01T19:36:18.906 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59aef08e:::benchmark_data_smithi188_104537_object17346:head# 2024-04-01T19:36:18.906 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59af1381:::benchmark_data_smithi188_104537_object47978:head# 2024-04-01T19:36:18.907 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59af2857:::benchmark_data_smithi188_104537_object61385:head# 2024-04-01T19:36:18.907 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59af28ec:::benchmark_data_smithi188_104537_object96367:head# 2024-04-01T19:36:18.908 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59afa533:::benchmark_data_smithi188_104537_object141540:head# 2024-04-01T19:36:18.908 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59b04e73:::benchmark_data_smithi188_104537_object59883:head# 2024-04-01T19:36:18.908 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59b0d2ae:::benchmark_data_smithi188_104537_object20260:head# 2024-04-01T19:36:18.909 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59b0e3aa:::benchmark_data_smithi188_104537_object163048:head# 2024-04-01T19:36:18.909 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59b13650:::benchmark_data_smithi188_104537_object46322:head# 2024-04-01T19:36:18.910 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59b165e4:::benchmark_data_smithi188_104537_object11608:head# 2024-04-01T19:36:18.910 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59b1a9a9:::benchmark_data_smithi188_104537_object84528:head# 2024-04-01T19:36:18.910 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59b1da4c:::benchmark_data_smithi188_104537_object134921:head# 2024-04-01T19:36:18.911 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59b1fca8:::benchmark_data_smithi188_104537_object65660:head# 2024-04-01T19:36:18.911 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59b2056c:::benchmark_data_smithi188_104537_object117219:head# 2024-04-01T19:36:18.912 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59b271bf:::benchmark_data_smithi188_104537_object18911:head# 2024-04-01T19:36:18.912 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59b31b71:::benchmark_data_smithi188_104537_object113279:head# 2024-04-01T19:36:18.912 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59b3cb58:::benchmark_data_smithi188_104537_object167826:head# 2024-04-01T19:36:18.913 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59b3d4a4:::benchmark_data_smithi188_104537_object146496:head# 2024-04-01T19:36:18.913 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59b3e222:::benchmark_data_smithi188_104537_object93423:head# 2024-04-01T19:36:18.914 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59b40204:::benchmark_data_smithi188_104537_object118437:head# 2024-04-01T19:36:18.914 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59b4b761:::benchmark_data_smithi188_104537_object79000:head# 2024-04-01T19:36:18.914 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59b651fb:::benchmark_data_smithi188_104537_object63600:head# 2024-04-01T19:36:18.915 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59b70ba0:::benchmark_data_smithi188_104537_object102867:head# 2024-04-01T19:36:18.915 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59b71cec:::benchmark_data_smithi188_104537_object157269:head# 2024-04-01T19:36:18.916 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59b7438a:::benchmark_data_smithi188_104537_object70028:head# 2024-04-01T19:36:18.916 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59b7ee61:::benchmark_data_smithi188_104537_object120166:head# 2024-04-01T19:36:18.917 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59b85721:::benchmark_data_smithi188_104537_object17631:head# 2024-04-01T19:36:18.917 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59b93547:::benchmark_data_smithi188_104537_object118710:head# 2024-04-01T19:36:18.917 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59b9d366:::benchmark_data_smithi188_104537_object97897:head# 2024-04-01T19:36:18.918 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59b9d8d9:::benchmark_data_smithi188_104537_object132784:head# 2024-04-01T19:36:18.918 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59ba2cc6:::benchmark_data_smithi188_104537_object52352:head# 2024-04-01T19:36:18.919 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59baa60d:::benchmark_data_smithi188_104537_object80355:head# 2024-04-01T19:36:18.919 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59bb5288:::benchmark_data_smithi188_104537_object73350:head# 2024-04-01T19:36:18.919 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59bb8987:::benchmark_data_smithi188_104537_object117658:head# 2024-04-01T19:36:18.920 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59bba01a:::benchmark_data_smithi188_104537_object103098:head# 2024-04-01T19:36:18.920 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59bbb1ed:::benchmark_data_smithi188_104537_object34732:head# 2024-04-01T19:36:18.921 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59bbf0dc:::benchmark_data_smithi188_104537_object54361:head# 2024-04-01T19:36:18.921 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59bc2526:::benchmark_data_smithi188_104537_object88506:head# 2024-04-01T19:36:18.922 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59bcb44b:::benchmark_data_smithi188_104537_object14698:head# 2024-04-01T19:36:18.922 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59bcc029:::benchmark_data_smithi188_104537_object100692:head# 2024-04-01T19:36:18.923 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59bff6f3:::benchmark_data_smithi188_104537_object128186:head# 2024-04-01T19:36:18.923 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59c0271b:::benchmark_data_smithi188_104537_object99351:head# 2024-04-01T19:36:18.923 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59c04717:::benchmark_data_smithi188_104537_object108350:head# 2024-04-01T19:36:18.923 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59c0649e:::benchmark_data_smithi188_104537_object100113:head# 2024-04-01T19:36:18.924 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59c11e58:::benchmark_data_smithi188_104537_object30816:head# 2024-04-01T19:36:18.924 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59c14b5d:::benchmark_data_smithi188_104537_object89535:head# 2024-04-01T19:36:18.925 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59c14bcb:::benchmark_data_smithi188_104537_object22792:head# 2024-04-01T19:36:18.925 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59c22562:::benchmark_data_smithi188_104537_object99869:head# 2024-04-01T19:36:18.926 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59c4c571:::benchmark_data_smithi188_104537_object133036:head# 2024-04-01T19:36:18.926 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59c511ae:::benchmark_data_smithi188_104537_object145015:head# 2024-04-01T19:36:18.927 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:36:18.927 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59c5dc71:::benchmark_data_smithi188_104537_object105693:head# 2024-04-01T19:36:18.927 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59c6c4ee:::benchmark_data_smithi188_104537_object13596:head# 2024-04-01T19:36:18.928 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59c6e134:::benchmark_data_smithi188_104537_object101134:head# 2024-04-01T19:36:18.928 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59c73293:::benchmark_data_smithi188_104537_object38726:head# 2024-04-01T19:36:18.929 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59c7710a:::benchmark_data_smithi188_104537_object158761:head# 2024-04-01T19:36:18.929 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:18.930 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:36:18.930 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59c7e56b:::benchmark_data_smithi188_104537_object13715:head# 2024-04-01T19:36:18.930 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59c844ab:::benchmark_data_smithi188_104537_object107614:head# 2024-04-01T19:36:18.930 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59c91e08:::benchmark_data_smithi188_104537_object90296:head# 2024-04-01T19:36:18.931 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59c9ab1f:::benchmark_data_smithi188_104537_object37132:head# 2024-04-01T19:36:18.931 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59c9db63:::benchmark_data_smithi188_104537_object69394:head# 2024-04-01T19:36:18.931 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59c9f000:::benchmark_data_smithi188_104537_object27924:head# 2024-04-01T19:36:18.931 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59cb7dc3:::benchmark_data_smithi188_104537_object61303:head# 2024-04-01T19:36:18.932 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59cbf910:::benchmark_data_smithi188_104537_object91991:head# 2024-04-01T19:36:18.933 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59cc01e0:::benchmark_data_smithi188_104537_object53600:head# 2024-04-01T19:36:18.933 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59cc3ecb:::benchmark_data_smithi188_104537_object149175:head# 2024-04-01T19:36:18.934 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59cc75e4:::benchmark_data_smithi188_104537_object148668:head# 2024-04-01T19:36:18.934 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59ccc5b3:::benchmark_data_smithi188_104537_object53285:head# 2024-04-01T19:36:18.935 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59cd473b:::benchmark_data_smithi188_104537_object105754:head# 2024-04-01T19:36:18.935 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59cd5000:::benchmark_data_smithi188_104537_object35276:head# 2024-04-01T19:36:18.936 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59cdbe2b:::benchmark_data_smithi188_104537_object20085:head# 2024-04-01T19:36:18.936 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59cdc351:::benchmark_data_smithi188_104537_object112017:head# 2024-04-01T19:36:18.937 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59cded87:::benchmark_data_smithi188_104537_object123551:head# 2024-04-01T19:36:18.937 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59ce24d2:::benchmark_data_smithi188_104537_object19101:head# 2024-04-01T19:36:18.938 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59cee678:::benchmark_data_smithi188_104537_object42930:head# 2024-04-01T19:36:18.938 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59cf331f:::benchmark_data_smithi188_104537_object126581:head# 2024-04-01T19:36:18.939 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59cf346f:::benchmark_data_smithi188_104537_object41148:head# 2024-04-01T19:36:18.939 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d0138e:::benchmark_data_smithi188_104537_object149524:head# 2024-04-01T19:36:18.940 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d10a65:::benchmark_data_smithi188_104537_object46469:head# 2024-04-01T19:36:18.940 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d11edb:::benchmark_data_smithi188_104537_object167451:head# 2024-04-01T19:36:18.941 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d129c7:::benchmark_data_smithi188_104537_object123616:head# 2024-04-01T19:36:18.941 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d2f091:::benchmark_data_smithi188_104537_object170424:head# 2024-04-01T19:36:18.941 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d372f2:::benchmark_data_smithi188_104537_object13490:head# 2024-04-01T19:36:18.942 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d52202:::benchmark_data_smithi188_104537_object47981:head# 2024-04-01T19:36:18.943 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d55533:::benchmark_data_smithi188_104537_object122396:head# 2024-04-01T19:36:18.943 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d5b8d3:::benchmark_data_smithi188_104537_object35370:head# 2024-04-01T19:36:18.943 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d5e3b8:::benchmark_data_smithi188_104537_object121866:head# 2024-04-01T19:36:18.944 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d5e9db:::benchmark_data_smithi188_104537_object108822:head# 2024-04-01T19:36:18.944 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d62466:::benchmark_data_smithi188_104537_object121757:head# 2024-04-01T19:36:18.945 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d662b8:::benchmark_data_smithi188_104537_object73090:head# 2024-04-01T19:36:18.945 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d68ffd:::benchmark_data_smithi188_104537_object170113:head# 2024-04-01T19:36:18.945 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d71f20:::benchmark_data_smithi188_104537_object138613:head# 2024-04-01T19:36:18.946 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d73dcd:::benchmark_data_smithi188_104537_object159388:head# 2024-04-01T19:36:18.946 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d81c12:::benchmark_data_smithi188_104537_object47371:head# 2024-04-01T19:36:18.947 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d821fe:::benchmark_data_smithi188_104537_object131596:head# 2024-04-01T19:36:18.947 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d8442b:::benchmark_data_smithi188_104537_object124545:head# 2024-04-01T19:36:18.948 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d84824:::benchmark_data_smithi188_104537_object57647:head# 2024-04-01T19:36:18.948 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d84d2a:::benchmark_data_smithi188_104537_object81171:head# 2024-04-01T19:36:18.948 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d8948e:::benchmark_data_smithi188_104537_object69023:head# 2024-04-01T19:36:18.949 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d89555:::benchmark_data_smithi188_104537_object95101:head# 2024-04-01T19:36:18.949 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d8dbff:::benchmark_data_smithi188_104537_object110718:head# 2024-04-01T19:36:18.950 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d8ed7b:::benchmark_data_smithi188_104537_object53706:head# 2024-04-01T19:36:18.950 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59d97ef7:::benchmark_data_smithi188_104537_object95450:head# 2024-04-01T19:36:18.950 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59da7011:::benchmark_data_smithi188_104537_object54255:head# 2024-04-01T19:36:18.951 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59da730f:::benchmark_data_smithi188_104537_object129114:head# 2024-04-01T19:36:18.951 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59dab1a3:::benchmark_data_smithi188_104537_object23189:head# 2024-04-01T19:36:18.952 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59db6f1d:::benchmark_data_smithi188_104537_object66850:head# 2024-04-01T19:36:18.952 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59dca794:::benchmark_data_smithi188_104537_object56083:head# 2024-04-01T19:36:18.953 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59dd2fa6:::benchmark_data_smithi188_104537_object117261:head# 2024-04-01T19:36:18.953 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59dd35bb:::benchmark_data_smithi188_104537_object61352:head# 2024-04-01T19:36:18.954 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59dd5b7b:::benchmark_data_smithi188_104537_object40880:head# 2024-04-01T19:36:18.954 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59dd8a3c:::benchmark_data_smithi188_104537_object88049:head# 2024-04-01T19:36:18.954 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59dd8d46:::benchmark_data_smithi188_104537_object129166:head# 2024-04-01T19:36:18.955 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59de29de:::benchmark_data_smithi188_104537_object22881:head# 2024-04-01T19:36:18.956 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59de8453:::benchmark_data_smithi188_104537_object24041:head# 2024-04-01T19:36:18.956 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59dec84a:::benchmark_data_smithi188_104537_object126196:head# 2024-04-01T19:36:18.956 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59df0960:::benchmark_data_smithi188_104537_object145503:head# 2024-04-01T19:36:18.957 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59df0d26:::benchmark_data_smithi188_104537_object12304:head# 2024-04-01T19:36:18.957 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59dfbc27:::benchmark_data_smithi188_104537_object23322:head# 2024-04-01T19:36:18.958 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59e02dd0:::benchmark_data_smithi188_104537_object144893:head# 2024-04-01T19:36:18.958 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59e0432f:::benchmark_data_smithi188_104537_object20770:head# 2024-04-01T19:36:18.959 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59e04ac7:::benchmark_data_smithi188_104537_object47046:head# 2024-04-01T19:36:18.959 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59e05249:::benchmark_data_smithi188_104537_object111075:head# 2024-04-01T19:36:18.960 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59e05648:::benchmark_data_smithi188_104537_object100077:head# 2024-04-01T19:36:18.960 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59e0c628:::benchmark_data_smithi188_104537_object152928:head# 2024-04-01T19:36:18.961 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59e1ed25:::benchmark_data_smithi188_104537_object101108:head# 2024-04-01T19:36:18.961 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59e203b1:::benchmark_data_smithi188_104537_object29499:head# 2024-04-01T19:36:18.961 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59e20f99:::benchmark_data_smithi188_104537_object112879:head# 2024-04-01T19:36:18.962 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59e26ec6:::benchmark_data_smithi188_104537_object46903:head# 2024-04-01T19:36:18.962 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59e29a24:::benchmark_data_smithi188_104537_object21035:head# 2024-04-01T19:36:18.963 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59e36275:::benchmark_data_smithi188_104537_object171394:head# 2024-04-01T19:36:18.963 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59e4872f:::benchmark_data_smithi188_104537_object133597:head# 2024-04-01T19:36:18.963 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59e49dc7:::benchmark_data_smithi188_104537_object51138:head# 2024-04-01T19:36:18.964 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59e4c054:::benchmark_data_smithi188_104537_object97727:head# 2024-04-01T19:36:18.964 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59e57b91:::benchmark_data_smithi188_104537_object74403:head# 2024-04-01T19:36:18.965 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59e57c70:::benchmark_data_smithi188_104537_object153539:head# 2024-04-01T19:36:18.965 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59e6b4fb:::benchmark_data_smithi188_104537_object151428:head# 2024-04-01T19:36:18.966 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59e81ee6:::benchmark_data_smithi188_104537_object156278:head# 2024-04-01T19:36:18.966 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59e85292:::benchmark_data_smithi188_104537_object135792:head# 2024-04-01T19:36:18.967 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59e9363a:::benchmark_data_smithi188_104537_object130347:head# 2024-04-01T19:36:18.967 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59e9eb72:::benchmark_data_smithi188_104537_object66932:head# 2024-04-01T19:36:18.968 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59eb96e4:::benchmark_data_smithi188_104537_object63982:head# 2024-04-01T19:36:18.968 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59ebc8d3:::benchmark_data_smithi188_104537_object15430:head# 2024-04-01T19:36:18.968 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59ebe785:::benchmark_data_smithi188_104537_object126982:head# 2024-04-01T19:36:18.969 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59eccb6f:::benchmark_data_smithi188_104537_object165420:head# 2024-04-01T19:36:18.969 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59ed3054:::benchmark_data_smithi188_104537_object132802:head# 2024-04-01T19:36:18.970 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59ed717d:::benchmark_data_smithi188_104537_object133730:head# 2024-04-01T19:36:18.970 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59ee9e73:::benchmark_data_smithi188_104537_object135552:head# 2024-04-01T19:36:18.970 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59eec76c:::benchmark_data_smithi188_104537_object77560:head# 2024-04-01T19:36:18.971 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59ef4ea7:::benchmark_data_smithi188_104537_object156228:head# 2024-04-01T19:36:18.971 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59ef5905:::benchmark_data_smithi188_104537_object147028:head# 2024-04-01T19:36:18.972 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59efcf52:::benchmark_data_smithi188_104537_object158036:head# 2024-04-01T19:36:18.972 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59effe6d:::benchmark_data_smithi188_104537_object127412:head# 2024-04-01T19:36:18.973 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59f060a6:::benchmark_data_smithi188_104537_object23346:head# 2024-04-01T19:36:18.974 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59f0806f:::benchmark_data_smithi188_104537_object66049:head# 2024-04-01T19:36:18.974 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59f1978c:::benchmark_data_smithi188_104537_object25360:head# 2024-04-01T19:36:18.975 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59f1b22d:::benchmark_data_smithi188_104537_object55092:head# 2024-04-01T19:36:18.975 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59f1eaef:::benchmark_data_smithi188_104537_object140937:head# 2024-04-01T19:36:18.976 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59f23e10:::benchmark_data_smithi188_104537_object106542:head# 2024-04-01T19:36:18.976 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59f25647:::benchmark_data_smithi188_104537_object145956:head# 2024-04-01T19:36:18.977 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59f28e58:::benchmark_data_smithi188_104537_object131438:head# 2024-04-01T19:36:18.977 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59f3406a:::benchmark_data_smithi188_104537_object75349:head# 2024-04-01T19:36:18.978 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59f3e2f4:::benchmark_data_smithi188_104537_object63980:head# 2024-04-01T19:36:18.978 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59f3ebb1:::benchmark_data_smithi188_104537_object160470:head# 2024-04-01T19:36:18.979 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59f50598:::benchmark_data_smithi188_104537_object100067:head# 2024-04-01T19:36:18.979 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59f5b90d:::benchmark_data_smithi188_104537_object129052:head# 2024-04-01T19:36:18.980 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59f60c5d:::benchmark_data_smithi188_104537_object20922:head# 2024-04-01T19:36:18.980 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59f64763:::benchmark_data_smithi188_104537_object132885:head# 2024-04-01T19:36:18.981 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59f6fb79:::benchmark_data_smithi188_104537_object32940:head# 2024-04-01T19:36:18.981 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59f850fa:::benchmark_data_smithi188_104537_object26785:head# 2024-04-01T19:36:18.982 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59f85c30:::benchmark_data_smithi188_104537_object90267:head# 2024-04-01T19:36:18.982 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59f8f3e1:::benchmark_data_smithi188_104537_object134488:head# 2024-04-01T19:36:18.982 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59f941c1:::benchmark_data_smithi188_104537_object104231:head# 2024-04-01T19:36:18.983 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59f95b84:::benchmark_data_smithi188_104537_object51266:head# 2024-04-01T19:36:18.983 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59f967c1:::benchmark_data_smithi188_104537_object64778:head# 2024-04-01T19:36:18.984 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59f9ac7d:::benchmark_data_smithi188_104537_object84241:head# 2024-04-01T19:36:18.984 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59fa356a:::benchmark_data_smithi188_104537_object146866:head# 2024-04-01T19:36:18.985 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59fa96a6:::benchmark_data_smithi188_104537_object79323:head# 2024-04-01T19:36:18.985 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59fc12ef:::benchmark_data_smithi188_104537_object112220:head# 2024-04-01T19:36:18.986 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59fc3b69:::benchmark_data_smithi188_104537_object150527:head# 2024-04-01T19:36:18.986 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59fc4682:::benchmark_data_smithi188_104537_object117494:head# 2024-04-01T19:36:18.987 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59fd2560:::benchmark_data_smithi188_104537_object161505:head# 2024-04-01T19:36:18.987 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59fd4b29:::benchmark_data_smithi188_104537_object157569:head# 2024-04-01T19:36:18.988 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59fd6cde:::benchmark_data_smithi188_104537_object103862:head# 2024-04-01T19:36:18.988 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59fd8979:::benchmark_data_smithi188_104537_object16454:head# 2024-04-01T19:36:18.989 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59fd8a33:::benchmark_data_smithi188_104537_object154611:head# 2024-04-01T19:36:18.989 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59fea7bc:::benchmark_data_smithi188_104537_object44968:head# 2024-04-01T19:36:18.990 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:59ff2492:::benchmark_data_smithi188_104537_object139188:head# 2024-04-01T19:36:18.990 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a002593:::benchmark_data_smithi188_104537_object112379:head# 2024-04-01T19:36:18.991 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a004847:::benchmark_data_smithi188_104537_object132591:head# 2024-04-01T19:36:18.991 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a014764:::benchmark_data_smithi188_104537_object13934:head# 2024-04-01T19:36:18.992 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a01b988:::benchmark_data_smithi188_104537_object38360:head# 2024-04-01T19:36:18.992 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a01bb09:::benchmark_data_smithi188_104537_object72756:head# 2024-04-01T19:36:18.993 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a02354a:::benchmark_data_smithi188_104537_object64335:head# 2024-04-01T19:36:18.993 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a033659:::benchmark_data_smithi188_104537_object17951:head# 2024-04-01T19:36:18.994 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a055185:::benchmark_data_smithi188_104537_object80236:head# 2024-04-01T19:36:18.994 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a05ed09:::benchmark_data_smithi188_104537_object123521:head# 2024-04-01T19:36:18.995 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a0619f0:::benchmark_data_smithi188_104537_object81412:head# 2024-04-01T19:36:18.995 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a06991b:::benchmark_data_smithi188_104537_object88486:head# 2024-04-01T19:36:18.996 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a06b6a0:::benchmark_data_smithi188_104537_object54898:head# 2024-04-01T19:36:18.996 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a08ba9d:::benchmark_data_smithi188_104537_object23341:head# 2024-04-01T19:36:18.997 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a08d0b1:::benchmark_data_smithi188_104537_object78887:head# 2024-04-01T19:36:18.999 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a09293c:::benchmark_data_smithi188_104537_object135985:head# 2024-04-01T19:36:18.999 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a09fcb4:::benchmark_data_smithi188_104537_object151305:head# 2024-04-01T19:36:18.999 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a0a199a:::benchmark_data_smithi188_104537_object39724:head# 2024-04-01T19:36:19.000 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a0ad2d5:::benchmark_data_smithi188_104537_object14189:head# 2024-04-01T19:36:19.000 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a0b855c:::benchmark_data_smithi188_104537_object135015:head# 2024-04-01T19:36:19.001 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a0b9041:::benchmark_data_smithi188_104537_object44804:head# 2024-04-01T19:36:19.001 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a0bf089:::benchmark_data_smithi188_104537_object123580:head# 2024-04-01T19:36:19.002 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a0c135c:::benchmark_data_smithi188_104537_object64668:head# 2024-04-01T19:36:19.002 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a0c5a39:::benchmark_data_smithi188_104537_object50886:head# 2024-04-01T19:36:19.002 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a0cd299:::benchmark_data_smithi188_104537_object78559:head# 2024-04-01T19:36:19.003 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a0ce829:::benchmark_data_smithi188_104537_object144251:head# 2024-04-01T19:36:19.005 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a0cebc0:::benchmark_data_smithi188_104537_object95853:head# 2024-04-01T19:36:19.006 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a0d34bf:::benchmark_data_smithi188_104537_object112018:head# 2024-04-01T19:36:19.006 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a0d45a0:::benchmark_data_smithi188_104537_object57667:head# 2024-04-01T19:36:19.006 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a0d52dd:::benchmark_data_smithi188_104537_object24111:head# 2024-04-01T19:36:19.006 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a0dd7b0:::benchmark_data_smithi188_104537_object122954:head# 2024-04-01T19:36:19.006 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a0e1b0e:::benchmark_data_smithi188_104537_object144885:head# 2024-04-01T19:36:19.007 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a0e5b84:::benchmark_data_smithi188_104537_object124919:head# 2024-04-01T19:36:19.007 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a0eb0d9:::benchmark_data_smithi188_104537_object161021:head# 2024-04-01T19:36:19.007 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a0ef84f:::benchmark_data_smithi188_104537_object119859:head# 2024-04-01T19:36:19.008 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a0fc694:::benchmark_data_smithi188_104537_object103754:head# 2024-04-01T19:36:19.008 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a105245:::benchmark_data_smithi188_104537_object154347:head# 2024-04-01T19:36:19.009 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a10b342:::benchmark_data_smithi188_104537_object145254:head# 2024-04-01T19:36:19.009 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a117395:::benchmark_data_smithi188_104537_object65777:head# 2024-04-01T19:36:19.010 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a117fbb:::benchmark_data_smithi188_104537_object104682:head# 2024-04-01T19:36:19.010 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a11efcc:::benchmark_data_smithi188_104537_object96199:head# 2024-04-01T19:36:19.011 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a124f4e:::benchmark_data_smithi188_104537_object152478:head# 2024-04-01T19:36:19.011 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a1252e8:::benchmark_data_smithi188_104537_object119580:head# 2024-04-01T19:36:19.012 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a129ec9:::benchmark_data_smithi188_104537_object51540:head# 2024-04-01T19:36:19.012 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a132d3e:::benchmark_data_smithi188_104537_object48788:head# 2024-04-01T19:36:19.013 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a133cb9:::benchmark_data_smithi188_104537_object163574:head# 2024-04-01T19:36:19.013 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a133ffd:::benchmark_data_smithi188_104537_object82720:head# 2024-04-01T19:36:19.014 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a135381:::benchmark_data_smithi188_104537_object89201:head# 2024-04-01T19:36:19.014 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a138617:::benchmark_data_smithi188_104537_object124703:head# 2024-04-01T19:36:19.015 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a14219c:::benchmark_data_smithi188_104537_object20270:head# 2024-04-01T19:36:19.015 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a146313:::benchmark_data_smithi188_104537_object74632:head# 2024-04-01T19:36:19.016 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a14ce98:::benchmark_data_smithi188_104537_object36244:head# 2024-04-01T19:36:19.016 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a14d4f1:::benchmark_data_smithi188_104537_object166862:head# 2024-04-01T19:36:19.017 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a14ec85:::benchmark_data_smithi188_104537_object51606:head# 2024-04-01T19:36:19.017 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a14f4e2:::benchmark_data_smithi188_104537_object118962:head# 2024-04-01T19:36:19.018 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a16093a:::benchmark_data_smithi188_104537_object89857:head# 2024-04-01T19:36:19.018 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a1631fe:::benchmark_data_smithi188_104537_object138538:head# 2024-04-01T19:36:19.019 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a168ac4:::benchmark_data_smithi188_104537_object145473:head# 2024-04-01T19:36:19.019 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a17e19a:::benchmark_data_smithi188_104537_object21478:head# 2024-04-01T19:36:19.020 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a1853e3:::benchmark_data_smithi188_104537_object161370:head# 2024-04-01T19:36:19.020 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a18604f:::benchmark_data_smithi188_104537_object77153:head# 2024-04-01T19:36:19.021 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a188078:::benchmark_data_smithi188_104537_object67964:head# 2024-04-01T19:36:19.021 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a18a605:::benchmark_data_smithi188_104537_object70972:head# 2024-04-01T19:36:19.022 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a18c409:::benchmark_data_smithi188_104537_object55002:head# 2024-04-01T19:36:19.022 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a196b78:::benchmark_data_smithi188_104537_object171136:head# 2024-04-01T19:36:19.023 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a197f43:::benchmark_data_smithi188_104537_object77361:head# 2024-04-01T19:36:19.023 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a1a1a5b:::benchmark_data_smithi188_104537_object88142:head# 2024-04-01T19:36:19.024 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a1a352f:::benchmark_data_smithi188_104537_object112295:head# 2024-04-01T19:36:19.024 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a1a74fa:::benchmark_data_smithi188_104537_object33723:head# 2024-04-01T19:36:19.025 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a1a95dd:::benchmark_data_smithi188_104537_object65735:head# 2024-04-01T19:36:19.025 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a1a9f59:::benchmark_data_smithi188_104537_object85364:head# 2024-04-01T19:36:19.025 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a1aaaa3:::benchmark_data_smithi188_104537_object16167:head# 2024-04-01T19:36:19.026 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a1abbe3:::benchmark_data_smithi188_104537_object26911:head# 2024-04-01T19:36:19.026 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a1ad99e:::benchmark_data_smithi188_104537_object101635:head# 2024-04-01T19:36:19.027 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a1b28dc:::benchmark_data_smithi188_104537_object134267:head# 2024-04-01T19:36:19.027 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a1b2b35:::benchmark_data_smithi188_104537_object11402:head# 2024-04-01T19:36:19.028 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a1c2cc2:::benchmark_data_smithi188_104537_object30253:head# 2024-04-01T19:36:19.028 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a1c3960:::benchmark_data_smithi188_104537_object59503:head# 2024-04-01T19:36:19.029 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a1c64fc:::benchmark_data_smithi188_104537_object39445:head# 2024-04-01T19:36:19.029 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a1cfafa:::benchmark_data_smithi188_104537_object38672:head# 2024-04-01T19:36:19.029 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a1d0fea:::benchmark_data_smithi188_104537_object51421:head# 2024-04-01T19:36:19.030 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:36:19.031 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a1d2ae2:::benchmark_data_smithi188_104537_object41417:head# 2024-04-01T19:36:19.031 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a1d3766:::benchmark_data_smithi188_104537_object36486:head# 2024-04-01T19:36:19.031 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a1d40e6:::benchmark_data_smithi188_104537_object99137:head# 2024-04-01T19:36:19.032 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a1d7034:::benchmark_data_smithi188_104537_object99077:head# 2024-04-01T19:36:19.032 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a1dabb0:::benchmark_data_smithi188_104537_object63693:head# 2024-04-01T19:36:19.032 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a1dd8c4:::benchmark_data_smithi188_104537_object93150:head# 2024-04-01T19:36:19.033 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a2055ce:::benchmark_data_smithi188_104537_object124705:head# 2024-04-01T19:36:19.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a205883:::benchmark_data_smithi188_104537_object161406:head# 2024-04-01T19:36:19.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a212721:::benchmark_data_smithi188_104537_object78514:head# 2024-04-01T19:36:19.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a2181d9:::benchmark_data_smithi188_104537_object129103:head# 2024-04-01T19:36:19.035 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a220147:::benchmark_data_smithi188_104537_object168615:head# 2024-04-01T19:36:19.035 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a226475:::benchmark_data_smithi188_104537_object104839:head# 2024-04-01T19:36:19.036 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a226a77:::benchmark_data_smithi188_104537_object86882:head# 2024-04-01T19:36:19.036 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a229af9:::benchmark_data_smithi188_104537_object117845:head# 2024-04-01T19:36:19.036 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a230cdd:::benchmark_data_smithi188_104537_object109544:head# 2024-04-01T19:36:19.037 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a23b6e3:::benchmark_data_smithi188_104537_object123310:head# 2024-04-01T19:36:19.037 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a23b7db:::benchmark_data_smithi188_104537_object96774:head# 2024-04-01T19:36:19.038 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a23ce72:::benchmark_data_smithi188_104537_object63072:head# 2024-04-01T19:36:19.038 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a243580:::benchmark_data_smithi188_104537_object80301:head# 2024-04-01T19:36:19.039 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a244317:::benchmark_data_smithi188_104537_object118820:head# 2024-04-01T19:36:19.039 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a244fa5:::benchmark_data_smithi188_104537_object19216:head# 2024-04-01T19:36:19.039 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a24aa2a:::benchmark_data_smithi188_104537_object94436:head# 2024-04-01T19:36:19.040 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a253b00:::benchmark_data_smithi188_104537_object138567:head# 2024-04-01T19:36:19.040 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a25b526:::benchmark_data_smithi188_104537_object115685:head# 2024-04-01T19:36:19.041 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a268806:::benchmark_data_smithi188_104537_object72457:head# 2024-04-01T19:36:19.041 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a28ccec:::benchmark_data_smithi188_104537_object128342:head# 2024-04-01T19:36:19.042 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a29893e:::benchmark_data_smithi188_104537_object143431:head# 2024-04-01T19:36:19.042 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a2a5760:::benchmark_data_smithi188_104537_object85031:head# 2024-04-01T19:36:19.043 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a2a5bc1:::benchmark_data_smithi188_104537_object61080:head# 2024-04-01T19:36:19.043 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a2ab4c2:::benchmark_data_smithi188_104537_object171652:head# 2024-04-01T19:36:19.044 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a2abaf9:::benchmark_data_smithi188_104537_object137753:head# 2024-04-01T19:36:19.044 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a2ae2fc:::benchmark_data_smithi188_104537_object71682:head# 2024-04-01T19:36:19.044 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a2ba715:::benchmark_data_smithi188_104537_object128095:head# 2024-04-01T19:36:19.045 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a2c1273:::benchmark_data_smithi188_104537_object65759:head# 2024-04-01T19:36:19.045 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a2d1943:::benchmark_data_smithi188_104537_object99417:head# 2024-04-01T19:36:19.046 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a2d6aaf:::benchmark_data_smithi188_104537_object55477:head# 2024-04-01T19:36:19.046 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a2d8bb6:::benchmark_data_smithi188_104537_object30800:head# 2024-04-01T19:36:19.046 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a2e79f6:::benchmark_data_smithi188_104537_object100645:head# 2024-04-01T19:36:19.047 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a2ee89d:::benchmark_data_smithi188_104537_object78111:head# 2024-04-01T19:36:19.047 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a2ef6f5:::benchmark_data_smithi188_104537_object61826:head# 2024-04-01T19:36:19.048 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a2ef8c3:::benchmark_data_smithi188_104537_object74469:head# 2024-04-01T19:36:19.048 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a2f260e:::benchmark_data_smithi188_104537_object117544:head# 2024-04-01T19:36:19.049 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a304484:::benchmark_data_smithi188_104537_object119613:head# 2024-04-01T19:36:19.049 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a3054cd:::benchmark_data_smithi188_104537_object57549:head# 2024-04-01T19:36:19.049 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a30a943:::benchmark_data_smithi188_104537_object147102:head# 2024-04-01T19:36:19.050 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a30cd03:::benchmark_data_smithi188_104537_object48902:head# 2024-04-01T19:36:19.050 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a314247:::benchmark_data_smithi188_104537_object42752:head# 2024-04-01T19:36:19.051 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a322698:::benchmark_data_smithi188_104537_object95569:head# 2024-04-01T19:36:19.051 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a32c364:::benchmark_data_smithi188_104537_object48326:head# 2024-04-01T19:36:19.051 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a32fc6d:::benchmark_data_smithi188_104537_object31591:head# 2024-04-01T19:36:19.052 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a330fd5:::benchmark_data_smithi188_104537_object87050:head# 2024-04-01T19:36:19.052 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a33a80c:::benchmark_data_smithi188_104537_object101383:head# 2024-04-01T19:36:19.053 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a33e569:::benchmark_data_smithi188_104537_object92791:head# 2024-04-01T19:36:19.053 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a340509:::benchmark_data_smithi188_104537_object59326:head# 2024-04-01T19:36:19.053 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a341d13:::benchmark_data_smithi188_104537_object70160:head# 2024-04-01T19:36:19.054 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a34868e:::benchmark_data_smithi188_104537_object139656:head# 2024-04-01T19:36:19.054 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a349ddd:::benchmark_data_smithi188_104537_object12823:head# 2024-04-01T19:36:19.055 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a35213b:::benchmark_data_smithi188_104537_object151824:head# 2024-04-01T19:36:19.055 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a352b87:::benchmark_data_smithi188_104537_object99121:head# 2024-04-01T19:36:19.055 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a359e2b:::benchmark_data_smithi188_104537_object58742:head# 2024-04-01T19:36:19.056 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a36becd:::benchmark_data_smithi188_104537_object144237:head# 2024-04-01T19:36:19.057 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a381fc8:::benchmark_data_smithi188_104537_object33279:head# 2024-04-01T19:36:19.057 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a38d2e8:::benchmark_data_smithi188_104537_object145255:head# 2024-04-01T19:36:19.058 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a39467b:::benchmark_data_smithi188_104537_object95274:head# 2024-04-01T19:36:19.058 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a39a3cb:::benchmark_data_smithi188_104537_object102563:head# 2024-04-01T19:36:19.058 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a39c400:::benchmark_data_smithi188_104537_object85694:head# 2024-04-01T19:36:19.059 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a39edb3:::benchmark_data_smithi188_104537_object167620:head# 2024-04-01T19:36:19.059 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a3a10fe:::benchmark_data_smithi188_104537_object82025:head# 2024-04-01T19:36:19.059 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a3a1653:::benchmark_data_smithi188_104537_object35239:head# 2024-04-01T19:36:19.060 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a3a963f:::benchmark_data_smithi188_104537_object81501:head# 2024-04-01T19:36:19.060 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a3ad7eb:::benchmark_data_smithi188_104537_object108326:head# 2024-04-01T19:36:19.061 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a3b2cb9:::benchmark_data_smithi188_104537_object15280:head# 2024-04-01T19:36:19.061 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a3bae4c:::benchmark_data_smithi188_104537_object29508:head# 2024-04-01T19:36:19.062 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a3c2bc1:::benchmark_data_smithi188_104537_object97328:head# 2024-04-01T19:36:19.062 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a3c2e72:::benchmark_data_smithi188_104537_object122402:head# 2024-04-01T19:36:19.063 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:19.064 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a3ce436:::benchmark_data_smithi188_104537_object83368:head# 2024-04-01T19:36:19.064 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a3d540a:::benchmark_data_smithi188_104537_object28979:head# 2024-04-01T19:36:19.064 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a3dd823:::benchmark_data_smithi188_104537_object18306:head# 2024-04-01T19:36:19.064 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a3df7e7:::benchmark_data_smithi188_104537_object108076:head# 2024-04-01T19:36:19.065 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a3e2c8a:::benchmark_data_smithi188_104537_object149831:head# 2024-04-01T19:36:19.065 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a3e3573:::benchmark_data_smithi188_104537_object169095:head# 2024-04-01T19:36:19.066 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a3e6fe1:::benchmark_data_smithi188_104537_object28395:head# 2024-04-01T19:36:19.066 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a3f5436:::benchmark_data_smithi188_104537_object52335:head# 2024-04-01T19:36:19.066 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a3f7c8c:::benchmark_data_smithi188_104537_object35040:head# 2024-04-01T19:36:19.067 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a402e7c:::benchmark_data_smithi188_104537_object28911:head# 2024-04-01T19:36:19.067 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a406f83:::benchmark_data_smithi188_104537_object125368:head# 2024-04-01T19:36:19.067 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a40a93a:::benchmark_data_smithi188_104537_object91720:head# 2024-04-01T19:36:19.068 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a413daf:::benchmark_data_smithi188_104537_object161153:head# 2024-04-01T19:36:19.068 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a413e71:::benchmark_data_smithi188_104537_object29866:head# 2024-04-01T19:36:19.068 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a415306:::benchmark_data_smithi188_104537_object157145:head# 2024-04-01T19:36:19.069 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a41a881:::benchmark_data_smithi188_104537_object98620:head# 2024-04-01T19:36:19.069 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a41cff7:::benchmark_data_smithi188_104537_object33685:head# 2024-04-01T19:36:19.070 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a4271a7:::benchmark_data_smithi188_104537_object85158:head# 2024-04-01T19:36:19.070 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a4291b1:::benchmark_data_smithi188_104537_object156316:head# 2024-04-01T19:36:19.070 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a429693:::benchmark_data_smithi188_104537_object59692:head# 2024-04-01T19:36:19.071 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a42ecc1:::benchmark_data_smithi188_104537_object119764:head# 2024-04-01T19:36:19.071 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a440b76:::benchmark_data_smithi188_104537_object39335:head# 2024-04-01T19:36:19.072 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a44d3a5:::benchmark_data_smithi188_104537_object148442:head# 2024-04-01T19:36:19.072 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a44f843:::benchmark_data_smithi188_104537_object76645:head# 2024-04-01T19:36:19.073 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a4515ab:::benchmark_data_smithi188_104537_object128788:head# 2024-04-01T19:36:19.074 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a452f75:::benchmark_data_smithi188_104537_object139059:head# 2024-04-01T19:36:19.074 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a459698:::benchmark_data_smithi188_104537_object135615:head# 2024-04-01T19:36:19.075 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a45eda4:::benchmark_data_smithi188_104537_object93492:head# 2024-04-01T19:36:19.075 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a466bd8:::benchmark_data_smithi188_104537_object68513:head# 2024-04-01T19:36:19.076 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a48428b:::benchmark_data_smithi188_104537_object13159:head# 2024-04-01T19:36:19.076 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a48628c:::benchmark_data_smithi188_104537_object16470:head# 2024-04-01T19:36:19.076 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a48de52:::benchmark_data_smithi188_104537_object133427:head# 2024-04-01T19:36:19.077 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a48f847:::benchmark_data_smithi188_104537_object58376:head# 2024-04-01T19:36:19.077 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a499351:::benchmark_data_smithi188_104537_object117622:head# 2024-04-01T19:36:19.077 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a4a34ba:::benchmark_data_smithi188_104537_object94991:head# 2024-04-01T19:36:19.078 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a4a37eb:::benchmark_data_smithi188_104537_object57373:head# 2024-04-01T19:36:19.078 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a4b0e0d:::benchmark_data_smithi188_104537_object97944:head# 2024-04-01T19:36:19.079 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a4b46ee:::benchmark_data_smithi188_104537_object50508:head# 2024-04-01T19:36:19.079 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a4b5bb2:::benchmark_data_smithi188_104537_object96995:head# 2024-04-01T19:36:19.079 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a4b7254:::benchmark_data_smithi188_104537_object163885:head# 2024-04-01T19:36:19.080 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a4c500f:::benchmark_data_smithi188_104537_object166064:head# 2024-04-01T19:36:19.080 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a4c73b8:::benchmark_data_smithi188_104537_object61502:head# 2024-04-01T19:36:19.081 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a4d45dc:::benchmark_data_smithi188_104537_object141039:head# 2024-04-01T19:36:19.081 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a4d814b:::benchmark_data_smithi188_104537_object64793:head# 2024-04-01T19:36:19.082 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a4daa13:::benchmark_data_smithi188_104537_object72737:head# 2024-04-01T19:36:19.082 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a4db8e9:::benchmark_data_smithi188_104537_object163394:head# 2024-04-01T19:36:19.082 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a4e0445:::benchmark_data_smithi188_104537_object53204:head# 2024-04-01T19:36:19.083 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a4e937e:::benchmark_data_smithi188_104537_object40067:head# 2024-04-01T19:36:19.083 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a4ea10a:::benchmark_data_smithi188_104537_object25803:head# 2024-04-01T19:36:19.084 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a4f05b4:::benchmark_data_smithi188_104537_object39308:head# 2024-04-01T19:36:19.084 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a4f5366:::benchmark_data_smithi188_104537_object121410:head# 2024-04-01T19:36:19.085 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a4f7f84:::benchmark_data_smithi188_104537_object64188:head# 2024-04-01T19:36:19.085 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a4fc139:::benchmark_data_smithi188_104537_object142717:head# 2024-04-01T19:36:19.085 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:36:19.086 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a4fd54a:::benchmark_data_smithi188_104537_object48982:head# 2024-04-01T19:36:19.086 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a50039b:::benchmark_data_smithi188_104537_object144872:head# 2024-04-01T19:36:19.086 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a502850:::benchmark_data_smithi188_104537_object143145:head# 2024-04-01T19:36:19.087 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a50336c:::benchmark_data_smithi188_104537_object132044:head# 2024-04-01T19:36:19.087 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a506657:::benchmark_data_smithi188_104537_object156626:head# 2024-04-01T19:36:19.088 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a507555:::benchmark_data_smithi188_104537_object41216:head# 2024-04-01T19:36:19.088 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:19.088 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:36:19.089 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a50bbf3:::benchmark_data_smithi188_104537_object111202:head# 2024-04-01T19:36:19.089 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a50e319:::benchmark_data_smithi188_104537_object90317:head# 2024-04-01T19:36:19.090 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a520a8a:::benchmark_data_smithi188_104537_object61421:head# 2024-04-01T19:36:19.090 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a52cdfa:::benchmark_data_smithi188_104537_object149959:head# 2024-04-01T19:36:19.091 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a52ea9b:::benchmark_data_smithi188_104537_object113299:head# 2024-04-01T19:36:19.091 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a5327dd:::benchmark_data_smithi188_104537_object25415:head# 2024-04-01T19:36:19.091 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a53602b:::benchmark_data_smithi188_104537_object16092:head# 2024-04-01T19:36:19.091 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a53bab7:::benchmark_data_smithi188_104537_object143209:head# 2024-04-01T19:36:19.092 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a53dd8a:::benchmark_data_smithi188_104537_object78855:head# 2024-04-01T19:36:19.092 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a5402e3:::benchmark_data_smithi188_104537_object36242:head# 2024-04-01T19:36:19.092 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a5421db:::benchmark_data_smithi188_104537_object34049:head# 2024-04-01T19:36:19.092 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a55142a:::benchmark_data_smithi188_104537_object67862:head# 2024-04-01T19:36:19.093 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a5547de:::benchmark_data_smithi188_104537_object34386:head# 2024-04-01T19:36:19.093 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a557a35:::benchmark_data_smithi188_104537_object95977:head# 2024-04-01T19:36:19.094 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a558a89:::benchmark_data_smithi188_104537_object80742:head# 2024-04-01T19:36:19.094 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a55c735:::benchmark_data_smithi188_104537_object80646:head# 2024-04-01T19:36:19.094 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a560b07:::benchmark_data_smithi188_104537_object75072:head# 2024-04-01T19:36:19.095 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a5673da:::benchmark_data_smithi188_104537_object96992:head# 2024-04-01T19:36:19.095 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a568d69:::benchmark_data_smithi188_104537_object161393:head# 2024-04-01T19:36:19.096 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a569556:::benchmark_data_smithi188_104537_object142297:head# 2024-04-01T19:36:19.096 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a57a18a:::benchmark_data_smithi188_104537_object118898:head# 2024-04-01T19:36:19.096 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a57e44f:::benchmark_data_smithi188_104537_object40556:head# 2024-04-01T19:36:19.097 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a5849f9:::benchmark_data_smithi188_104537_object52691:head# 2024-04-01T19:36:19.097 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a58a3be:::benchmark_data_smithi188_104537_object50230:head# 2024-04-01T19:36:19.098 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a58f7aa:::benchmark_data_smithi188_104537_object31573:head# 2024-04-01T19:36:19.098 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a595b5e:::benchmark_data_smithi188_104537_object79326:head# 2024-04-01T19:36:19.099 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a597f43:::benchmark_data_smithi188_104537_object125418:head# 2024-04-01T19:36:19.099 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a59ea1f:::benchmark_data_smithi188_104537_object69151:head# 2024-04-01T19:36:19.099 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a5ac327:::benchmark_data_smithi188_104537_object154035:head# 2024-04-01T19:36:19.100 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a5b77f8:::benchmark_data_smithi188_104537_object155907:head# 2024-04-01T19:36:19.100 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a5c7cb8:::benchmark_data_smithi188_104537_object156150:head# 2024-04-01T19:36:19.101 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a5ced6f:::benchmark_data_smithi188_104537_object122601:head# 2024-04-01T19:36:19.101 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a5d0b35:::benchmark_data_smithi188_104537_object98722:head# 2024-04-01T19:36:19.101 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a5d2326:::benchmark_data_smithi188_104537_object97382:head# 2024-04-01T19:36:19.102 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a5ea994:::benchmark_data_smithi188_104537_object114567:head# 2024-04-01T19:36:19.102 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a5ef383:::benchmark_data_smithi188_104537_object43239:head# 2024-04-01T19:36:19.103 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a5f6793:::benchmark_data_smithi188_104537_object116778:head# 2024-04-01T19:36:19.103 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a5fb493:::benchmark_data_smithi188_104537_object150229:head# 2024-04-01T19:36:19.103 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a608f3f:::benchmark_data_smithi188_104537_object48696:head# 2024-04-01T19:36:19.104 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a60cdef:::benchmark_data_smithi188_104537_object35271:head# 2024-04-01T19:36:19.104 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a60d02a:::benchmark_data_smithi188_104537_object142330:head# 2024-04-01T19:36:19.105 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a60da17:::benchmark_data_smithi188_104537_object165923:head# 2024-04-01T19:36:19.105 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a614cce:::benchmark_data_smithi188_104537_object59467:head# 2024-04-01T19:36:19.105 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a617869:::benchmark_data_smithi188_104537_object139706:head# 2024-04-01T19:36:19.106 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a618b34:::benchmark_data_smithi188_104537_object67528:head# 2024-04-01T19:36:19.106 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a625fb1:::benchmark_data_smithi188_104537_object83375:head# 2024-04-01T19:36:19.106 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a626e5f:::benchmark_data_smithi188_104537_object41807:head# 2024-04-01T19:36:19.107 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a62f121:::benchmark_data_smithi188_104537_object161871:head# 2024-04-01T19:36:19.107 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a639ce6:::benchmark_data_smithi188_104537_object155299:head# 2024-04-01T19:36:19.108 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a6444d5:::benchmark_data_smithi188_104537_object109708:head# 2024-04-01T19:36:19.108 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a6473cb:::benchmark_data_smithi188_104537_object138848:head# 2024-04-01T19:36:19.108 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a647e23:::benchmark_data_smithi188_104537_object110233:head# 2024-04-01T19:36:19.109 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a64abf5:::benchmark_data_smithi188_104537_object158782:head# 2024-04-01T19:36:19.109 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a64c12b:::benchmark_data_smithi188_104537_object76956:head# 2024-04-01T19:36:19.110 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a64c5bc:::benchmark_data_smithi188_104537_object159923:head# 2024-04-01T19:36:19.110 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a661eb6:::benchmark_data_smithi188_104537_object137148:head# 2024-04-01T19:36:19.110 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a672244:::benchmark_data_smithi188_104537_object116469:head# 2024-04-01T19:36:19.111 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a67930c:::benchmark_data_smithi188_104537_object58872:head# 2024-04-01T19:36:19.111 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a67afe2:::benchmark_data_smithi188_104537_object163342:head# 2024-04-01T19:36:19.112 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a67bd66:::benchmark_data_smithi188_104537_object25953:head# 2024-04-01T19:36:19.112 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a67cc7d:::benchmark_data_smithi188_104537_object22290:head# 2024-04-01T19:36:19.113 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a687729:::benchmark_data_smithi188_104537_object121887:head# 2024-04-01T19:36:19.113 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a68c737:::benchmark_data_smithi188_104537_object70723:head# 2024-04-01T19:36:19.113 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a695e06:::benchmark_data_smithi188_104537_object34936:head# 2024-04-01T19:36:19.114 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a699dd7:::benchmark_data_smithi188_104537_object88206:head# 2024-04-01T19:36:19.114 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a6a6da7:::benchmark_data_smithi188_104537_object127941:head# 2024-04-01T19:36:19.114 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a6aa0b9:::benchmark_data_smithi188_104537_object48891:head# 2024-04-01T19:36:19.115 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a6b125e:::benchmark_data_smithi188_104537_object41809:head# 2024-04-01T19:36:19.115 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a6b1947:::benchmark_data_smithi188_104537_object77256:head# 2024-04-01T19:36:19.116 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a6b5182:::benchmark_data_smithi188_104537_object116681:head# 2024-04-01T19:36:19.116 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a6b6076:::benchmark_data_smithi188_104537_object148053:head# 2024-04-01T19:36:19.117 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a6c66cf:::benchmark_data_smithi188_104537_object69539:head# 2024-04-01T19:36:19.117 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a6c7843:::benchmark_data_smithi188_104537_object130300:head# 2024-04-01T19:36:19.117 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a6ca008:::benchmark_data_smithi188_104537_object156471:head# 2024-04-01T19:36:19.118 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a6d4393:::benchmark_data_smithi188_104537_object71079:head# 2024-04-01T19:36:19.118 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a6d5a34:::benchmark_data_smithi188_104537_object107728:head# 2024-04-01T19:36:19.119 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a6d5ada:::benchmark_data_smithi188_104537_object97153:head# 2024-04-01T19:36:19.119 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a6daa97:::benchmark_data_smithi188_104537_object93210:head# 2024-04-01T19:36:19.120 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a6df4c8:::benchmark_data_smithi188_104537_object83615:head# 2024-04-01T19:36:19.120 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a6e1d50:::benchmark_data_smithi188_104537_object151231:head# 2024-04-01T19:36:19.120 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a6e4cac:::benchmark_data_smithi188_104537_object89656:head# 2024-04-01T19:36:19.121 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a6e6a38:::benchmark_data_smithi188_104537_object143731:head# 2024-04-01T19:36:19.121 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a6e6ae5:::benchmark_data_smithi188_104537_object44117:head# 2024-04-01T19:36:19.121 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a6e98aa:::benchmark_data_smithi188_104537_object85012:head# 2024-04-01T19:36:19.122 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a6ebc68:::benchmark_data_smithi188_104537_object166107:head# 2024-04-01T19:36:19.122 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a6f2a84:::benchmark_data_smithi188_104537_object85872:head# 2024-04-01T19:36:19.123 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a6fcf6b:::benchmark_data_smithi188_104537_object58172:head# 2024-04-01T19:36:19.123 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a720e71:::benchmark_data_smithi188_104537_object12970:head# 2024-04-01T19:36:19.125 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a758e11:::benchmark_data_smithi188_104537_object114713:head# 2024-04-01T19:36:19.125 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a75aed2:::benchmark_data_smithi188_104537_object94033:head# 2024-04-01T19:36:19.125 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a75b504:::benchmark_data_smithi188_104537_object76621:head# 2024-04-01T19:36:19.126 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a75c27f:::benchmark_data_smithi188_104537_object122733:head# 2024-04-01T19:36:19.126 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a76406e:::benchmark_data_smithi188_104537_object163286:head# 2024-04-01T19:36:19.127 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a7675f1:::benchmark_data_smithi188_104537_object72540:head# 2024-04-01T19:36:19.127 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a76b083:::benchmark_data_smithi188_104537_object81635:head# 2024-04-01T19:36:19.127 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a76c525:::benchmark_data_smithi188_104537_object28719:head# 2024-04-01T19:36:19.128 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a779987:::benchmark_data_smithi188_104537_object129168:head# 2024-04-01T19:36:19.128 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a7838a6:::benchmark_data_smithi188_104537_object161028:head# 2024-04-01T19:36:19.129 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a78aafa:::benchmark_data_smithi188_104537_object159244:head# 2024-04-01T19:36:19.129 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a793dc5:::benchmark_data_smithi188_104537_object78884:head# 2024-04-01T19:36:19.130 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a797b42:::benchmark_data_smithi188_104537_object93307:head# 2024-04-01T19:36:19.131 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a798487:::benchmark_data_smithi188_104537_object147248:head# 2024-04-01T19:36:19.131 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a79c242:::benchmark_data_smithi188_104537_object57954:head# 2024-04-01T19:36:19.131 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a79f3b9:::benchmark_data_smithi188_104537_object103864:head# 2024-04-01T19:36:19.132 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a7a159c:::benchmark_data_smithi188_104537_object81590:head# 2024-04-01T19:36:19.132 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a7a4533:::benchmark_data_smithi188_104537_object127578:head# 2024-04-01T19:36:19.132 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a7b01ac:::benchmark_data_smithi188_104537_object12072:head# 2024-04-01T19:36:19.133 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a7b282f:::benchmark_data_smithi188_104537_object17940:head# 2024-04-01T19:36:19.133 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a7c145d:::benchmark_data_smithi188_104537_object88325:head# 2024-04-01T19:36:19.134 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a7cbff8:::benchmark_data_smithi188_104537_object48155:head# 2024-04-01T19:36:19.134 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a7d9305:::benchmark_data_smithi188_104537_object112904:head# 2024-04-01T19:36:19.135 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a7dd199:::benchmark_data_smithi188_104537_object64082:head# 2024-04-01T19:36:19.135 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a7dd949:::benchmark_data_smithi188_104537_object21448:head# 2024-04-01T19:36:19.135 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a7e10d8:::benchmark_data_smithi188_104537_object145008:head# 2024-04-01T19:36:19.136 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a7ed45d:::benchmark_data_smithi188_104537_object156921:head# 2024-04-01T19:36:19.136 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a7f63f9:::benchmark_data_smithi188_104537_object129429:head# 2024-04-01T19:36:19.137 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a7fed69:::benchmark_data_smithi188_104537_object160618:head# 2024-04-01T19:36:19.137 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a807980:::benchmark_data_smithi188_104537_object46340:head# 2024-04-01T19:36:19.137 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a80ab6e:::benchmark_data_smithi188_104537_object66890:head# 2024-04-01T19:36:19.138 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a817ca2:::benchmark_data_smithi188_104537_object159430:head# 2024-04-01T19:36:19.138 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a82546c:::benchmark_data_smithi188_104537_object35841:head# 2024-04-01T19:36:19.138 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a829b74:::benchmark_data_smithi188_104537_object104727:head# 2024-04-01T19:36:19.139 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a82dd95:::benchmark_data_smithi188_104537_object143759:head# 2024-04-01T19:36:19.139 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a830cb5:::benchmark_data_smithi188_104537_object160127:head# 2024-04-01T19:36:19.140 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a8315a0:::benchmark_data_smithi188_104537_object66007:head# 2024-04-01T19:36:19.140 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a8389a8:::benchmark_data_smithi188_104537_object46338:head# 2024-04-01T19:36:19.140 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a842f57:::benchmark_data_smithi188_104537_object126998:head# 2024-04-01T19:36:19.141 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a844685:::benchmark_data_smithi188_104537_object95302:head# 2024-04-01T19:36:19.141 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a847997:::benchmark_data_smithi188_104537_object42957:head# 2024-04-01T19:36:19.142 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a84faa2:::benchmark_data_smithi188_104537_object64093:head# 2024-04-01T19:36:19.142 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a854be0:::benchmark_data_smithi188_104537_object89470:head# 2024-04-01T19:36:19.142 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a856b2c:::benchmark_data_smithi188_104537_object47867:head# 2024-04-01T19:36:19.143 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a8595ec:::benchmark_data_smithi188_104537_object38902:head# 2024-04-01T19:36:19.143 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a859ce0:::benchmark_data_smithi188_104537_object103538:head# 2024-04-01T19:36:19.144 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a867726:::benchmark_data_smithi188_104537_object122334:head# 2024-04-01T19:36:19.144 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a868787:::benchmark_data_smithi188_104537_object35920:head# 2024-04-01T19:36:19.144 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a86d209:::benchmark_data_smithi188_104537_object42025:head# 2024-04-01T19:36:19.145 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a873c99:::benchmark_data_smithi188_104537_object97431:head# 2024-04-01T19:36:19.145 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a897999:::benchmark_data_smithi188_104537_object19338:head# 2024-04-01T19:36:19.146 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a89aa98:::benchmark_data_smithi188_104537_object147512:head# 2024-04-01T19:36:19.146 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a89ef51:::benchmark_data_smithi188_104537_object64185:head# 2024-04-01T19:36:19.146 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a8a1779:::benchmark_data_smithi188_104537_object57502:head# 2024-04-01T19:36:19.147 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a8a4b40:::benchmark_data_smithi188_104537_object110751:head# 2024-04-01T19:36:19.147 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a8a583c:::benchmark_data_smithi188_104537_object15192:head# 2024-04-01T19:36:19.147 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a8b29cf:::benchmark_data_smithi188_104537_object63296:head# 2024-04-01T19:36:19.148 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a8b2bf3:::benchmark_data_smithi188_104537_object56431:head# 2024-04-01T19:36:19.148 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a8b91cd:::benchmark_data_smithi188_104537_object88245:head# 2024-04-01T19:36:19.149 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a8ba210:::benchmark_data_smithi188_104537_object25146:head# 2024-04-01T19:36:19.150 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a8bc36c:::benchmark_data_smithi188_104537_object46195:head# 2024-04-01T19:36:19.150 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a8cd5bb:::benchmark_data_smithi188_104537_object95290:head# 2024-04-01T19:36:19.151 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a8d4f2d:::benchmark_data_smithi188_104537_object165156:head# 2024-04-01T19:36:19.151 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a8d752f:::benchmark_data_smithi188_104537_object105329:head# 2024-04-01T19:36:19.152 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a8d7910:::benchmark_data_smithi188_104537_object25376:head# 2024-04-01T19:36:19.152 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a8da7aa:::benchmark_data_smithi188_104537_object44489:head# 2024-04-01T19:36:19.152 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a8dc431:::benchmark_data_smithi188_104537_object49491:head# 2024-04-01T19:36:19.153 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a8e683f:::benchmark_data_smithi188_104537_object82181:head# 2024-04-01T19:36:19.153 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a8ef2fc:::benchmark_data_smithi188_104537_object155909:head# 2024-04-01T19:36:19.153 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a8facbd:::benchmark_data_smithi188_104537_object28506:head# 2024-04-01T19:36:19.154 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a8fec87:::benchmark_data_smithi188_104537_object58454:head# 2024-04-01T19:36:19.154 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a9010eb:::benchmark_data_smithi188_104537_object106168:head# 2024-04-01T19:36:19.155 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a902573:::benchmark_data_smithi188_104537_object168943:head# 2024-04-01T19:36:19.155 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a90b846:::benchmark_data_smithi188_104537_object91850:head# 2024-04-01T19:36:19.155 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a912b0a:::benchmark_data_smithi188_104537_object100965:head# 2024-04-01T19:36:19.156 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a913b42:::benchmark_data_smithi188_104537_object162483:head# 2024-04-01T19:36:19.156 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a914c4d:::benchmark_data_smithi188_104537_object43761:head# 2024-04-01T19:36:19.156 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a919eff:::benchmark_data_smithi188_104537_object164338:head# 2024-04-01T19:36:19.157 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a91a15d:::benchmark_data_smithi188_104537_object130964:head# 2024-04-01T19:36:19.157 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a9303b9:::benchmark_data_smithi188_104537_object42683:head# 2024-04-01T19:36:19.158 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a931522:::benchmark_data_smithi188_104537_object143633:head# 2024-04-01T19:36:19.158 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a937b54:::benchmark_data_smithi188_104537_object33278:head# 2024-04-01T19:36:19.158 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a94b879:::benchmark_data_smithi188_104537_object95015:head# 2024-04-01T19:36:19.159 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a9507e9:::benchmark_data_smithi188_104537_object81233:head# 2024-04-01T19:36:19.159 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a952940:::benchmark_data_smithi188_104537_object84056:head# 2024-04-01T19:36:19.160 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a95bd5a:::benchmark_data_smithi188_104537_object24599:head# 2024-04-01T19:36:19.160 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a95ff4f:::benchmark_data_smithi188_104537_object97389:head# 2024-04-01T19:36:19.160 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a96b936:::benchmark_data_smithi188_104537_object53821:head# 2024-04-01T19:36:19.161 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a977f01:::benchmark_data_smithi188_104537_object98013:head# 2024-04-01T19:36:19.161 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a97de09:::benchmark_data_smithi188_104537_object21955:head# 2024-04-01T19:36:19.162 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a994d44:::benchmark_data_smithi188_104537_object135577:head# 2024-04-01T19:36:19.162 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a9a9a84:::benchmark_data_smithi188_104537_object105396:head# 2024-04-01T19:36:19.162 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a9ac3cd:::benchmark_data_smithi188_104537_object27420:head# 2024-04-01T19:36:19.163 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a9b26a5:::benchmark_data_smithi188_104537_object137497:head# 2024-04-01T19:36:19.163 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a9c0bb2:::benchmark_data_smithi188_104537_object122043:head# 2024-04-01T19:36:19.164 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a9c2af0:::benchmark_data_smithi188_104537_object75090:head# 2024-04-01T19:36:19.164 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a9c3d0a:::benchmark_data_smithi188_104537_object111610:head# 2024-04-01T19:36:19.164 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a9c7feb:::benchmark_data_smithi188_104537_object58110:head# 2024-04-01T19:36:19.165 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a9caa57:::benchmark_data_smithi188_104537_object33444:head# 2024-04-01T19:36:19.165 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a9caad4:::benchmark_data_smithi188_104537_object160213:head# 2024-04-01T19:36:19.166 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a9cf3bf:::benchmark_data_smithi188_104537_object135490:head# 2024-04-01T19:36:19.166 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a9d0dac:::benchmark_data_smithi188_104537_object79691:head# 2024-04-01T19:36:19.166 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a9decff:::benchmark_data_smithi188_104537_object147062:head# 2024-04-01T19:36:19.167 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a9df5ed:::benchmark_data_smithi188_104537_object73616:head# 2024-04-01T19:36:19.167 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a9e21ca:::benchmark_data_smithi188_104537_object92198:head# 2024-04-01T19:36:19.168 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a9e3521:::benchmark_data_smithi188_104537_object153633:head# 2024-04-01T19:36:19.168 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a9e7feb:::benchmark_data_smithi188_104537_object38870:head# 2024-04-01T19:36:19.169 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a9ecd21:::benchmark_data_smithi188_104537_object168215:head# 2024-04-01T19:36:19.169 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5a9f7266:::benchmark_data_smithi188_104537_object42778:head# 2024-04-01T19:36:19.170 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa02286:::benchmark_data_smithi188_104537_object80574:head# 2024-04-01T19:36:19.170 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa07ca1:::benchmark_data_smithi188_104537_object66466:head# 2024-04-01T19:36:19.170 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa15763:::benchmark_data_smithi188_104537_object125453:head# 2024-04-01T19:36:19.171 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa17d16:::benchmark_data_smithi188_104537_object144000:head# 2024-04-01T19:36:19.171 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa22eeb:::benchmark_data_smithi188_104537_object154847:head# 2024-04-01T19:36:19.171 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa24a05:::benchmark_data_smithi188_104537_object78021:head# 2024-04-01T19:36:19.172 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa416b0:::benchmark_data_smithi188_104537_object112618:head# 2024-04-01T19:36:19.172 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa49829:::benchmark_data_smithi188_104537_object99901:head# 2024-04-01T19:36:19.173 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa51a1d:::benchmark_data_smithi188_104537_object163357:head# 2024-04-01T19:36:19.173 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa56245:::benchmark_data_smithi188_104537_object133566:head# 2024-04-01T19:36:19.173 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa571da:::benchmark_data_smithi188_104537_object161142:head# 2024-04-01T19:36:19.174 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa5fcba:::benchmark_data_smithi188_104537_object23198:head# 2024-04-01T19:36:19.174 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa65889:::benchmark_data_smithi188_104537_object146524:head# 2024-04-01T19:36:19.175 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa6a075:::benchmark_data_smithi188_104537_object108219:head# 2024-04-01T19:36:19.175 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa6b9bb:::benchmark_data_smithi188_104537_object35136:head# 2024-04-01T19:36:19.175 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa6ed81:::benchmark_data_smithi188_104537_object85763:head# 2024-04-01T19:36:19.176 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa6f32a:::benchmark_data_smithi188_104537_object93362:head# 2024-04-01T19:36:19.177 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa6f61c:::benchmark_data_smithi188_104537_object133513:head# 2024-04-01T19:36:19.177 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa7726c:::benchmark_data_smithi188_104537_object38575:head# 2024-04-01T19:36:19.177 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa795c4:::benchmark_data_smithi188_104537_object166104:head# 2024-04-01T19:36:19.178 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa807ff:::benchmark_data_smithi188_104537_object162665:head# 2024-04-01T19:36:19.178 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa85e85:::benchmark_data_smithi188_104537_object80882:head# 2024-04-01T19:36:19.179 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa87096:::benchmark_data_smithi188_104537_object84857:head# 2024-04-01T19:36:19.179 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa883e1:::benchmark_data_smithi188_104537_object59054:head# 2024-04-01T19:36:19.179 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa8ac8a:::benchmark_data_smithi188_104537_object26570:head# 2024-04-01T19:36:19.179 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa8ae14:::benchmark_data_smithi188_104537_object105306:head# 2024-04-01T19:36:19.180 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa901af:::benchmark_data_smithi188_104537_object93874:head# 2024-04-01T19:36:19.180 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa92559:::benchmark_data_smithi188_104537_object161018:head# 2024-04-01T19:36:19.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa99b67:::benchmark_data_smithi188_104537_object36678:head# 2024-04-01T19:36:19.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aa9c0be:::benchmark_data_smithi188_104537_object154856:head# 2024-04-01T19:36:19.182 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aaa0459:::benchmark_data_smithi188_104537_object22166:head# 2024-04-01T19:36:19.182 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aaa22dc:::benchmark_data_smithi188_104537_object135996:head# 2024-04-01T19:36:19.182 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aaa6cec:::benchmark_data_smithi188_104537_object63500:head# 2024-04-01T19:36:19.183 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aaa96e9:::benchmark_data_smithi188_104537_object159471:head# 2024-04-01T19:36:19.183 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aab69bc:::benchmark_data_smithi188_104537_object86796:head# 2024-04-01T19:36:19.183 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aac2f00:::benchmark_data_smithi188_104537_object84337:head# 2024-04-01T19:36:19.184 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aac9331:::benchmark_data_smithi188_104537_object69314:head# 2024-04-01T19:36:19.184 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aacd0de:::benchmark_data_smithi188_104537_object76625:head# 2024-04-01T19:36:19.184 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aad8573:::benchmark_data_smithi188_104537_object22388:head# 2024-04-01T19:36:19.185 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aae7017:::benchmark_data_smithi188_104537_object164262:head# 2024-04-01T19:36:19.185 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aae732d:::benchmark_data_smithi188_104537_object14442:head# 2024-04-01T19:36:19.186 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aae89b1:::benchmark_data_smithi188_104537_object32661:head# 2024-04-01T19:36:19.186 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aaea003:::benchmark_data_smithi188_104537_object47405:head# 2024-04-01T19:36:19.187 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aaea144:::benchmark_data_smithi188_104537_object152122:head# 2024-04-01T19:36:19.187 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aaeadf0:::benchmark_data_smithi188_104537_object108265:head# 2024-04-01T19:36:19.187 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aaec65f:::benchmark_data_smithi188_104537_object72769:head# 2024-04-01T19:36:19.188 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aaeda27:::benchmark_data_smithi188_104537_object63298:head# 2024-04-01T19:36:19.188 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aaedae0:::benchmark_data_smithi188_104537_object34749:head# 2024-04-01T19:36:19.188 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aaf46c7:::benchmark_data_smithi188_104537_object61121:head# 2024-04-01T19:36:19.189 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aaf48aa:::benchmark_data_smithi188_104537_object75087:head# 2024-04-01T19:36:19.189 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:36:19.190 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aafd178:::benchmark_data_smithi188_104537_object15592:head# 2024-04-01T19:36:19.190 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aaff1cd:::benchmark_data_smithi188_104537_object133554:head# 2024-04-01T19:36:19.190 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ab18076:::benchmark_data_smithi188_104537_object50931:head# 2024-04-01T19:36:19.191 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ab2e625:::benchmark_data_smithi188_104537_object70365:head# 2024-04-01T19:36:19.191 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ab345f6:::benchmark_data_smithi188_104537_object43202:head# 2024-04-01T19:36:19.191 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ab3d96e:::benchmark_data_smithi188_104537_object41547:head# 2024-04-01T19:36:19.192 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ab40a51:::benchmark_data_smithi188_104537_object86574:head# 2024-04-01T19:36:19.193 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ab49e14:::benchmark_data_smithi188_104537_object130368:head# 2024-04-01T19:36:19.193 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ab4f4f8:::benchmark_data_smithi188_104537_object171294:head# 2024-04-01T19:36:19.193 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ab5263d:::benchmark_data_smithi188_104537_object134077:head# 2024-04-01T19:36:19.193 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ab5d310:::benchmark_data_smithi188_104537_object82738:head# 2024-04-01T19:36:19.194 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ab70798:::benchmark_data_smithi188_104537_object67277:head# 2024-04-01T19:36:19.194 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ab71f91:::benchmark_data_smithi188_104537_object126013:head# 2024-04-01T19:36:19.194 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ab7523e:::benchmark_data_smithi188_104537_object38093:head# 2024-04-01T19:36:19.195 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ab75f33:::benchmark_data_smithi188_104537_object49697:head# 2024-04-01T19:36:19.195 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ab77701:::benchmark_data_smithi188_104537_object52206:head# 2024-04-01T19:36:19.196 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ab815ab:::benchmark_data_smithi188_104537_object123709:head# 2024-04-01T19:36:19.196 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ab83c50:::benchmark_data_smithi188_104537_object48142:head# 2024-04-01T19:36:19.197 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5abade54:::benchmark_data_smithi188_104537_object96851:head# 2024-04-01T19:36:19.197 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5abb238a:::benchmark_data_smithi188_104537_object11936:head# 2024-04-01T19:36:19.197 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5abb70c4:::benchmark_data_smithi188_104537_object65076:head# 2024-04-01T19:36:19.198 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5abd287a:::benchmark_data_smithi188_104537_object53693:head# 2024-04-01T19:36:19.198 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5abd3270:::benchmark_data_smithi188_104537_object159633:head# 2024-04-01T19:36:19.198 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5abd43a9:::benchmark_data_smithi188_104537_object71556:head# 2024-04-01T19:36:19.199 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5abdd9e2:::benchmark_data_smithi188_104537_object143794:head# 2024-04-01T19:36:19.199 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5abe81bf:::benchmark_data_smithi188_104537_object64703:head# 2024-04-01T19:36:19.200 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5abf5c0f:::benchmark_data_smithi188_104537_object145154:head# 2024-04-01T19:36:19.200 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ac026d8:::benchmark_data_smithi188_104537_object134636:head# 2024-04-01T19:36:19.201 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ac0562a:::benchmark_data_smithi188_104537_object92530:head# 2024-04-01T19:36:19.201 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ac0f5db:::benchmark_data_smithi188_104537_object73622:head# 2024-04-01T19:36:19.202 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ac1c79b:::benchmark_data_smithi188_104537_object160622:head# 2024-04-01T19:36:19.202 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ac1e06c:::benchmark_data_smithi188_104537_object84511:head# 2024-04-01T19:36:19.202 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ac2d29a:::benchmark_data_smithi188_104537_object127214:head# 2024-04-01T19:36:19.203 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ac3606d:::benchmark_data_smithi188_104537_object85387:head# 2024-04-01T19:36:19.203 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ac3cd3d:::benchmark_data_smithi188_104537_object148837:head# 2024-04-01T19:36:19.204 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ac3e6b5:::benchmark_data_smithi188_104537_object15254:head# 2024-04-01T19:36:19.204 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ac421dc:::benchmark_data_smithi188_104537_object20202:head# 2024-04-01T19:36:19.204 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ac5a770:::benchmark_data_smithi188_104537_object17915:head# 2024-04-01T19:36:19.205 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ac5f096:::benchmark_data_smithi188_104537_object39012:head# 2024-04-01T19:36:19.205 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ac641cc:::benchmark_data_smithi188_104537_object107596:head# 2024-04-01T19:36:19.206 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ac673fb:::benchmark_data_smithi188_104537_object36656:head# 2024-04-01T19:36:19.206 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ac6e13b:::benchmark_data_smithi188_104537_object66596:head# 2024-04-01T19:36:19.206 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ac73416:::benchmark_data_smithi188_104537_object90005:head# 2024-04-01T19:36:19.207 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ac74948:::benchmark_data_smithi188_104537_object127779:head# 2024-04-01T19:36:19.208 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ac7542d:::benchmark_data_smithi188_104537_object21140:head# 2024-04-01T19:36:19.208 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ac7b9ca:::benchmark_data_smithi188_104537_object36509:head# 2024-04-01T19:36:19.208 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ac7bd5e:::benchmark_data_smithi188_104537_object167312:head# 2024-04-01T19:36:19.208 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ac7bfdb:::benchmark_data_smithi188_104537_object39363:head# 2024-04-01T19:36:19.209 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ac8291a:::benchmark_data_smithi188_104537_object31732:head# 2024-04-01T19:36:19.209 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ac97775:::benchmark_data_smithi188_104537_object21565:head# 2024-04-01T19:36:19.210 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aca4920:::benchmark_data_smithi188_104537_object58121:head# 2024-04-01T19:36:19.210 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aca5128:::benchmark_data_smithi188_104537_object71294:head# 2024-04-01T19:36:19.211 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aca631c:::benchmark_data_smithi188_104537_object72395:head# 2024-04-01T19:36:19.211 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5acaad4e:::benchmark_data_smithi188_104537_object164652:head# 2024-04-01T19:36:19.211 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5acad081:::benchmark_data_smithi188_104537_object130388:head# 2024-04-01T19:36:19.212 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5acb170a:::benchmark_data_smithi188_104537_object105815:head# 2024-04-01T19:36:19.212 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:36:19.212 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:36:19.213 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5acc2b5c:::benchmark_data_smithi188_104537_object18763:head# 2024-04-01T19:36:19.213 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5acc68dd:::benchmark_data_smithi188_104537_object30175:head# 2024-04-01T19:36:19.213 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5acc8206:::benchmark_data_smithi188_104537_object150087:head# 2024-04-01T19:36:19.213 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5accc301:::benchmark_data_smithi188_104537_object161083:head# 2024-04-01T19:36:19.214 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5acd0e22:::benchmark_data_smithi188_104537_object101579:head# 2024-04-01T19:36:19.214 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5acd45a2:::benchmark_data_smithi188_104537_object165278:head# 2024-04-01T19:36:19.215 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5acd59c6:::benchmark_data_smithi188_104537_object76353:head# 2024-04-01T19:36:19.215 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5acd6240:::benchmark_data_smithi188_104537_object62055:head# 2024-04-01T19:36:19.215 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5acd6a86:::benchmark_data_smithi188_104537_object62996:head# 2024-04-01T19:36:19.216 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5acdb8a2:::benchmark_data_smithi188_104537_object53077:head# 2024-04-01T19:36:19.216 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5acdbb9f:::benchmark_data_smithi188_104537_object88896:head# 2024-04-01T19:36:19.217 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ace295d:::benchmark_data_smithi188_104537_object75807:head# 2024-04-01T19:36:19.217 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ace9c41:::benchmark_data_smithi188_104537_object112691:head# 2024-04-01T19:36:19.218 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5acf35b9:::benchmark_data_smithi188_104537_object62217:head# 2024-04-01T19:36:19.218 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5acf527f:::benchmark_data_smithi188_104537_object135665:head# 2024-04-01T19:36:19.218 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5acf8d79:::benchmark_data_smithi188_104537_object159233:head# 2024-04-01T19:36:19.219 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:19.219 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5acfe31c:::benchmark_data_smithi188_104537_object33214:head# 2024-04-01T19:36:19.219 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ad14fb9:::benchmark_data_smithi188_104537_object116354:head# 2024-04-01T19:36:19.220 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ad19807:::benchmark_data_smithi188_104537_object78882:head# 2024-04-01T19:36:19.220 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ad1b496:::benchmark_data_smithi188_104537_object159981:head# 2024-04-01T19:36:19.220 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ad1d5b6:::benchmark_data_smithi188_104537_object114984:head# 2024-04-01T19:36:19.221 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ad1df94:::benchmark_data_smithi188_104537_object62323:head# 2024-04-01T19:36:19.221 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ad1e624:::benchmark_data_smithi188_104537_object61841:head# 2024-04-01T19:36:19.221 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ad232af:::benchmark_data_smithi188_104537_object38414:head# 2024-04-01T19:36:19.222 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ad2dc43:::benchmark_data_smithi188_104537_object109481:head# 2024-04-01T19:36:19.222 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ad340ff:::benchmark_data_smithi188_104537_object86836:head# 2024-04-01T19:36:19.223 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ad373ad:::benchmark_data_smithi188_104537_object110314:head# 2024-04-01T19:36:19.223 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ad3a31e:::benchmark_data_smithi188_104537_object102366:head# 2024-04-01T19:36:19.224 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ad3d9ce:::benchmark_data_smithi188_104537_object77332:head# 2024-04-01T19:36:19.224 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ad467b5:::benchmark_data_smithi188_104537_object30448:head# 2024-04-01T19:36:19.224 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ad4c092:::benchmark_data_smithi188_104537_object116068:head# 2024-04-01T19:36:19.225 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ad50e4a:::benchmark_data_smithi188_104537_object105608:head# 2024-04-01T19:36:19.225 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ad62ef6:::benchmark_data_smithi188_104537_object158085:head# 2024-04-01T19:36:19.226 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ad6dfbf:::benchmark_data_smithi188_104537_object32338:head# 2024-04-01T19:36:19.226 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ad6eb38:::benchmark_data_smithi188_104537_object44025:head# 2024-04-01T19:36:19.227 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ad70b52:::benchmark_data_smithi188_104537_object88324:head# 2024-04-01T19:36:19.227 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ad86f47:::benchmark_data_smithi188_104537_object72409:head# 2024-04-01T19:36:19.228 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ad9417e:::benchmark_data_smithi188_104537_object87197:head# 2024-04-01T19:36:19.228 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ada0f0c:::benchmark_data_smithi188_104537_object96215:head# 2024-04-01T19:36:19.228 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5adad969:::benchmark_data_smithi188_104537_object63160:head# 2024-04-01T19:36:19.229 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5adc3786:::benchmark_data_smithi188_104537_object133130:head# 2024-04-01T19:36:19.229 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5adc3daf:::benchmark_data_smithi188_104537_object125378:head# 2024-04-01T19:36:19.230 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ade0e64:::benchmark_data_smithi188_104537_object139714:head# 2024-04-01T19:36:19.230 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ade2e92:::benchmark_data_smithi188_104537_object148957:head# 2024-04-01T19:36:19.231 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ade872a:::benchmark_data_smithi188_104537_object100259:head# 2024-04-01T19:36:19.231 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5adef077:::benchmark_data_smithi188_104537_object119539:head# 2024-04-01T19:36:19.231 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5adf2743:::benchmark_data_smithi188_104537_object57903:head# 2024-04-01T19:36:19.232 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5adf4ad8:::benchmark_data_smithi188_104537_object141015:head# 2024-04-01T19:36:19.232 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5adf5455:::benchmark_data_smithi188_104537_object120127:head# 2024-04-01T19:36:19.233 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae008b3:::benchmark_data_smithi188_104537_object11953:head# 2024-04-01T19:36:19.233 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae09bf3:::benchmark_data_smithi188_104537_object53555:head# 2024-04-01T19:36:19.234 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae0f2b9:::benchmark_data_smithi188_104537_object95192:head# 2024-04-01T19:36:19.234 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae12b5a:::benchmark_data_smithi188_104537_object133288:head# 2024-04-01T19:36:19.234 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae14f5a:::benchmark_data_smithi188_104537_object113419:head# 2024-04-01T19:36:19.235 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae1c0d6:::benchmark_data_smithi188_104537_object165544:head# 2024-04-01T19:36:19.235 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae1d1ac:::benchmark_data_smithi188_104537_object27862:head# 2024-04-01T19:36:19.235 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae1e816:::benchmark_data_smithi188_104537_object52921:head# 2024-04-01T19:36:19.236 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae23dd8:::benchmark_data_smithi188_104537_object111588:head# 2024-04-01T19:36:19.236 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae2821d:::benchmark_data_smithi188_104537_object18432:head# 2024-04-01T19:36:19.236 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae318e6:::benchmark_data_smithi188_104537_object90179:head# 2024-04-01T19:36:19.237 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae340ce:::benchmark_data_smithi188_104537_object68400:head# 2024-04-01T19:36:19.237 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae36b83:::benchmark_data_smithi188_104537_object137621:head# 2024-04-01T19:36:19.238 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae3dd12:::benchmark_data_smithi188_104537_object112075:head# 2024-04-01T19:36:19.238 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae4318a:::benchmark_data_smithi188_104537_object73401:head# 2024-04-01T19:36:19.239 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae46c0d:::benchmark_data_smithi188_104537_object32009:head# 2024-04-01T19:36:19.239 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae49d14:::benchmark_data_smithi188_104537_object92565:head# 2024-04-01T19:36:19.239 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae4a7f3:::benchmark_data_smithi188_104537_object35261:head# 2024-04-01T19:36:19.240 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae4d8a6:::benchmark_data_smithi188_104537_object23532:head# 2024-04-01T19:36:19.240 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae51baf:::benchmark_data_smithi188_104537_object50280:head# 2024-04-01T19:36:19.241 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae5c420:::benchmark_data_smithi188_104537_object146348:head# 2024-04-01T19:36:19.241 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae677e4:::benchmark_data_smithi188_104537_object95077:head# 2024-04-01T19:36:19.241 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae6bf87:::benchmark_data_smithi188_104537_object42016:head# 2024-04-01T19:36:19.242 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae6d4fa:::benchmark_data_smithi188_104537_object43867:head# 2024-04-01T19:36:19.242 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae7281b:::benchmark_data_smithi188_104537_object141873:head# 2024-04-01T19:36:19.243 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae78f82:::benchmark_data_smithi188_104537_object63203:head# 2024-04-01T19:36:19.243 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ae8c3ff:::benchmark_data_smithi188_104537_object117767:head# 2024-04-01T19:36:19.243 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aeafe30:::benchmark_data_smithi188_104537_object141326:head# 2024-04-01T19:36:19.244 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aec3989:::benchmark_data_smithi188_104537_object41775:head# 2024-04-01T19:36:19.244 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aec94ca:::benchmark_data_smithi188_104537_object43269:head# 2024-04-01T19:36:19.245 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aeca570:::benchmark_data_smithi188_104537_object71559:head# 2024-04-01T19:36:19.245 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aed5130:::benchmark_data_smithi188_104537_object33043:head# 2024-04-01T19:36:19.246 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aedf8b5:::benchmark_data_smithi188_104537_object142511:head# 2024-04-01T19:36:19.246 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aee83d9:::benchmark_data_smithi188_104537_object97990:head# 2024-04-01T19:36:19.246 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aeecab0:::benchmark_data_smithi188_104537_object112827:head# 2024-04-01T19:36:19.247 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aef1182:::benchmark_data_smithi188_104537_object91007:head# 2024-04-01T19:36:19.247 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aef8ae7:::benchmark_data_smithi188_104537_object51390:head# 2024-04-01T19:36:19.248 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aefaf43:::benchmark_data_smithi188_104537_object145288:head# 2024-04-01T19:36:19.248 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af01881:::benchmark_data_smithi188_104537_object94336:head# 2024-04-01T19:36:19.248 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af063d4:::benchmark_data_smithi188_104537_object167070:head# 2024-04-01T19:36:19.249 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af0cadb:::benchmark_data_smithi188_104537_object123845:head# 2024-04-01T19:36:19.249 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af0efb7:::benchmark_data_smithi188_104537_object114356:head# 2024-04-01T19:36:19.250 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af1e505:::benchmark_data_smithi188_104537_object35814:head# 2024-04-01T19:36:19.250 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af1fdd7:::benchmark_data_smithi188_104537_object156266:head# 2024-04-01T19:36:19.251 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af272b5:::benchmark_data_smithi188_104537_object37451:head# 2024-04-01T19:36:19.251 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af275e3:::benchmark_data_smithi188_104537_object137661:head# 2024-04-01T19:36:19.252 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af2beec:::benchmark_data_smithi188_104537_object151408:head# 2024-04-01T19:36:19.253 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af34be4:::benchmark_data_smithi188_104537_object108125:head# 2024-04-01T19:36:19.254 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af3a05e:::benchmark_data_smithi188_104537_object114012:head# 2024-04-01T19:36:19.254 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af3ec54:::benchmark_data_smithi188_104537_object118042:head# 2024-04-01T19:36:19.254 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af4cd3d:::benchmark_data_smithi188_104537_object48217:head# 2024-04-01T19:36:19.255 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af4d398:::benchmark_data_smithi188_104537_object48274:head# 2024-04-01T19:36:19.255 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af4f562:::benchmark_data_smithi188_104537_object118867:head# 2024-04-01T19:36:19.256 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af53655:::benchmark_data_smithi188_104537_object125195:head# 2024-04-01T19:36:19.256 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af5cb93:::benchmark_data_smithi188_104537_object168257:head# 2024-04-01T19:36:19.257 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af5fb23:::benchmark_data_smithi188_104537_object31000:head# 2024-04-01T19:36:19.257 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af6738e:::benchmark_data_smithi188_104537_object133565:head# 2024-04-01T19:36:19.257 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af67e77:::benchmark_data_smithi188_104537_object12331:head# 2024-04-01T19:36:19.258 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af686a5:::benchmark_data_smithi188_104537_object30121:head# 2024-04-01T19:36:19.259 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af6c584:::benchmark_data_smithi188_104537_object103670:head# 2024-04-01T19:36:19.259 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af6ca81:::benchmark_data_smithi188_104537_object159395:head# 2024-04-01T19:36:19.259 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af6e2d2:::benchmark_data_smithi188_104537_object47594:head# 2024-04-01T19:36:19.260 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af764c1:::benchmark_data_smithi188_104537_object16163:head# 2024-04-01T19:36:19.260 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af7c9be:::benchmark_data_smithi188_104537_object151116:head# 2024-04-01T19:36:19.261 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af7fa44:::benchmark_data_smithi188_104537_object47728:head# 2024-04-01T19:36:19.261 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af88994:::benchmark_data_smithi188_104537_object122145:head# 2024-04-01T19:36:19.261 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af8cd7a:::benchmark_data_smithi188_104537_object151125:head# 2024-04-01T19:36:19.262 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5af98d94:::benchmark_data_smithi188_104537_object75854:head# 2024-04-01T19:36:19.262 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5afa5b8f:::benchmark_data_smithi188_104537_object167299:head# 2024-04-01T19:36:19.263 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5afaefd5:::benchmark_data_smithi188_104537_object45196:head# 2024-04-01T19:36:19.263 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5afb05bb:::benchmark_data_smithi188_104537_object45513:head# 2024-04-01T19:36:19.263 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5afb160b:::benchmark_data_smithi188_104537_object15226:head# 2024-04-01T19:36:19.264 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5afb6b16:::benchmark_data_smithi188_104537_object20374:head# 2024-04-01T19:36:19.264 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5afc57d0:::benchmark_data_smithi188_104537_object93533:head# 2024-04-01T19:36:19.265 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5afc8041:::benchmark_data_smithi188_104537_object135939:head# 2024-04-01T19:36:19.265 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5afc880f:::benchmark_data_smithi188_104537_object100157:head# 2024-04-01T19:36:19.265 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5afca19d:::benchmark_data_smithi188_104537_object73656:head# 2024-04-01T19:36:19.266 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5afd88e0:::benchmark_data_smithi188_104537_object56641:head# 2024-04-01T19:36:19.266 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5afdda85:::benchmark_data_smithi188_104537_object138120:head# 2024-04-01T19:36:19.267 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5afe089e:::benchmark_data_smithi188_104537_object44017:head# 2024-04-01T19:36:19.267 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5afeccb4:::benchmark_data_smithi188_104537_object49467:head# 2024-04-01T19:36:19.267 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5aff36de:::benchmark_data_smithi188_104537_object53654:head# 2024-04-01T19:36:19.268 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b00613a:::benchmark_data_smithi188_104537_object40095:head# 2024-04-01T19:36:19.268 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b00816a:::benchmark_data_smithi188_104537_object105516:head# 2024-04-01T19:36:19.268 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b00a8fc:::benchmark_data_smithi188_104537_object50763:head# 2024-04-01T19:36:19.269 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b00f1cc:::benchmark_data_smithi188_104537_object83025:head# 2024-04-01T19:36:19.269 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b00fd44:::benchmark_data_smithi188_104537_object111489:head# 2024-04-01T19:36:19.270 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b01205d:::benchmark_data_smithi188_104537_object83780:head# 2024-04-01T19:36:19.270 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b0121a6:::benchmark_data_smithi188_104537_object69270:head# 2024-04-01T19:36:19.271 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b016ebd:::benchmark_data_smithi188_104537_object141183:head# 2024-04-01T19:36:19.271 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b01b5ff:::benchmark_data_smithi188_104537_object138161:head# 2024-04-01T19:36:19.272 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b01cd23:::benchmark_data_smithi188_104537_object127006:head# 2024-04-01T19:36:19.272 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b01e51d:::benchmark_data_smithi188_104537_object93231:head# 2024-04-01T19:36:19.272 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b01f612:::benchmark_data_smithi188_104537_object99409:head# 2024-04-01T19:36:19.273 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b03180d:::benchmark_data_smithi188_104537_object133345:head# 2024-04-01T19:36:19.273 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b040aaa:::benchmark_data_smithi188_104537_object50175:head# 2024-04-01T19:36:19.274 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b042008:::benchmark_data_smithi188_104537_object19255:head# 2024-04-01T19:36:19.274 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b048393:::benchmark_data_smithi188_104537_object11273:head# 2024-04-01T19:36:19.275 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b04cb16:::benchmark_data_smithi188_104537_object112493:head# 2024-04-01T19:36:19.275 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b04e310:::benchmark_data_smithi188_104537_object82519:head# 2024-04-01T19:36:19.276 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b055c7e:::benchmark_data_smithi188_104537_object76971:head# 2024-04-01T19:36:19.276 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b06fd32:::benchmark_data_smithi188_104537_object27168:head# 2024-04-01T19:36:19.276 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b072eec:::benchmark_data_smithi188_104537_object123124:head# 2024-04-01T19:36:19.277 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b078386:::benchmark_data_smithi188_104537_object89882:head# 2024-04-01T19:36:19.278 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b07a502:::benchmark_data_smithi188_104537_object86438:head# 2024-04-01T19:36:19.278 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b07ebfe:::benchmark_data_smithi188_104537_object120041:head# 2024-04-01T19:36:19.278 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b08162f:::benchmark_data_smithi188_104537_object35611:head# 2024-04-01T19:36:19.279 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b086078:::benchmark_data_smithi188_104537_object112640:head# 2024-04-01T19:36:19.279 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b08d9f5:::benchmark_data_smithi188_104537_object167694:head# 2024-04-01T19:36:19.279 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b0b022f:::benchmark_data_smithi188_104537_object159908:head# 2024-04-01T19:36:19.280 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b0b10ea:::benchmark_data_smithi188_104537_object145320:head# 2024-04-01T19:36:19.280 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b0b3cdb:::benchmark_data_smithi188_104537_object87066:head# 2024-04-01T19:36:19.281 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b0b4c3b:::benchmark_data_smithi188_104537_object158774:head# 2024-04-01T19:36:19.281 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b0b736d:::benchmark_data_smithi188_104537_object72124:head# 2024-04-01T19:36:19.281 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b0bd399:::benchmark_data_smithi188_104537_object148517:head# 2024-04-01T19:36:19.281 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b0c77c5:::benchmark_data_smithi188_104537_object88993:head# 2024-04-01T19:36:19.282 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b0cb16d:::benchmark_data_smithi188_104537_object82883:head# 2024-04-01T19:36:19.282 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b0d1636:::benchmark_data_smithi188_104537_object167277:head# 2024-04-01T19:36:19.283 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b0d72c3:::benchmark_data_smithi188_104537_object158427:head# 2024-04-01T19:36:19.283 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b0dc1dd:::benchmark_data_smithi188_104537_object67228:head# 2024-04-01T19:36:19.284 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b0dc23e:::benchmark_data_smithi188_104537_object36077:head# 2024-04-01T19:36:19.284 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b0ded5c:::benchmark_data_smithi188_104537_object82429:head# 2024-04-01T19:36:19.285 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b0e9fcb:::benchmark_data_smithi188_104537_object112551:head# 2024-04-01T19:36:19.285 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b0eac3f:::benchmark_data_smithi188_104537_object108559:head# 2024-04-01T19:36:19.286 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b0eff78:::benchmark_data_smithi188_104537_object52571:head# 2024-04-01T19:36:19.286 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b0f5c15:::benchmark_data_smithi188_104537_object36068:head# 2024-04-01T19:36:19.287 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b109fc1:::benchmark_data_smithi188_104537_object111605:head# 2024-04-01T19:36:19.287 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b110954:::benchmark_data_smithi188_104537_object138320:head# 2024-04-01T19:36:19.287 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b11d805:::benchmark_data_smithi188_104537_object93299:head# 2024-04-01T19:36:19.288 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b120f78:::benchmark_data_smithi188_104537_object151547:head# 2024-04-01T19:36:19.288 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b126e7e:::benchmark_data_smithi188_104537_object64843:head# 2024-04-01T19:36:19.288 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b1347d0:::benchmark_data_smithi188_104537_object67710:head# 2024-04-01T19:36:19.289 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b13b94b:::benchmark_data_smithi188_104537_object24180:head# 2024-04-01T19:36:19.289 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b15506e:::benchmark_data_smithi188_104537_object79694:head# 2024-04-01T19:36:19.290 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b158a93:::benchmark_data_smithi188_104537_object121374:head# 2024-04-01T19:36:19.290 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b15981c:::benchmark_data_smithi188_104537_object42561:head# 2024-04-01T19:36:19.290 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b15ee55:::benchmark_data_smithi188_104537_object165271:head# 2024-04-01T19:36:19.291 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b1617ab:::benchmark_data_smithi188_104537_object37575:head# 2024-04-01T19:36:19.291 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b161db3:::benchmark_data_smithi188_104537_object130894:head# 2024-04-01T19:36:19.292 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b16d1b8:::benchmark_data_smithi188_104537_object125466:head# 2024-04-01T19:36:19.292 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b16fcbc:::benchmark_data_smithi188_104537_object92188:head# 2024-04-01T19:36:19.293 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b173d70:::benchmark_data_smithi188_104537_object43567:head# 2024-04-01T19:36:19.293 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b17e577:::benchmark_data_smithi188_104537_object162031:head# 2024-04-01T19:36:19.293 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b1812c5:::benchmark_data_smithi188_104537_object43770:head# 2024-04-01T19:36:19.294 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b1887de:::benchmark_data_smithi188_104537_object105112:head# 2024-04-01T19:36:19.295 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b18c70b:::benchmark_data_smithi188_104537_object21522:head# 2024-04-01T19:36:19.295 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b1a7a8a:::benchmark_data_smithi188_104537_object98096:head# 2024-04-01T19:36:19.295 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b1abc1b:::benchmark_data_smithi188_104537_object71928:head# 2024-04-01T19:36:19.296 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b1b1bee:::benchmark_data_smithi188_104537_object127791:head# 2024-04-01T19:36:19.296 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b1b4ee3:::benchmark_data_smithi188_104537_object47710:head# 2024-04-01T19:36:19.296 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b1b6001:::benchmark_data_smithi188_104537_object84414:head# 2024-04-01T19:36:19.297 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b1c61be:::benchmark_data_smithi188_104537_object135327:head# 2024-04-01T19:36:19.297 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b1cae6f:::benchmark_data_smithi188_104537_object155538:head# 2024-04-01T19:36:19.298 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b1cd1e6:::benchmark_data_smithi188_104537_object114560:head# 2024-04-01T19:36:19.298 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b1cd9bd:::benchmark_data_smithi188_104537_object169000:head# 2024-04-01T19:36:19.298 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b1d59ea:::benchmark_data_smithi188_104537_object72814:head# 2024-04-01T19:36:19.299 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b1e5948:::benchmark_data_smithi188_104537_object134111:head# 2024-04-01T19:36:19.299 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b1e5ed8:::benchmark_data_smithi188_104537_object123405:head# 2024-04-01T19:36:19.300 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b1f8dfd:::benchmark_data_smithi188_104537_object114438:head# 2024-04-01T19:36:19.300 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b1fc152:::benchmark_data_smithi188_104537_object157261:head# 2024-04-01T19:36:19.301 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b1fea5f:::benchmark_data_smithi188_104537_object15046:head# 2024-04-01T19:36:19.301 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b2048fc:::benchmark_data_smithi188_104537_object82436:head# 2024-04-01T19:36:19.302 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b21060e:::benchmark_data_smithi188_104537_object87783:head# 2024-04-01T19:36:19.302 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b210829:::benchmark_data_smithi188_104537_object159807:head# 2024-04-01T19:36:19.303 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b2109b1:::benchmark_data_smithi188_104537_object84035:head# 2024-04-01T19:36:19.303 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b219874:::benchmark_data_smithi188_104537_object164076:head# 2024-04-01T19:36:19.304 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b2219b1:::benchmark_data_smithi188_104537_object102610:head# 2024-04-01T19:36:19.304 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b22d1de:::benchmark_data_smithi188_104537_object33429:head# 2024-04-01T19:36:19.304 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b230321:::benchmark_data_smithi188_104537_object54227:head# 2024-04-01T19:36:19.305 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b231b66:::benchmark_data_smithi188_104537_object154188:head# 2024-04-01T19:36:19.305 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b23bc00:::benchmark_data_smithi188_104537_object43099:head# 2024-04-01T19:36:19.306 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b23be80:::benchmark_data_smithi188_104537_object78247:head# 2024-04-01T19:36:19.306 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b2463b4:::benchmark_data_smithi188_104537_object114220:head# 2024-04-01T19:36:19.307 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b253dcd:::benchmark_data_smithi188_104537_object115108:head# 2024-04-01T19:36:19.307 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b257f30:::benchmark_data_smithi188_104537_object20631:head# 2024-04-01T19:36:19.307 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b267dd2:::benchmark_data_smithi188_104537_object48309:head# 2024-04-01T19:36:19.308 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b26a2c0:::benchmark_data_smithi188_104537_object70010:head# 2024-04-01T19:36:19.308 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b27416d:::benchmark_data_smithi188_104537_object124013:head# 2024-04-01T19:36:19.309 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b275506:::benchmark_data_smithi188_104537_object28997:head# 2024-04-01T19:36:19.309 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b288597:::benchmark_data_smithi188_104537_object51627:head# 2024-04-01T19:36:19.310 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b28c73f:::benchmark_data_smithi188_104537_object133844:head# 2024-04-01T19:36:19.310 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b295830:::benchmark_data_smithi188_104537_object142845:head# 2024-04-01T19:36:19.310 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b2a7511:::benchmark_data_smithi188_104537_object54546:head# 2024-04-01T19:36:19.311 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b2aa6e2:::benchmark_data_smithi188_104537_object62008:head# 2024-04-01T19:36:19.311 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b2ab0f2:::benchmark_data_smithi188_104537_object41673:head# 2024-04-01T19:36:19.312 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b2b6f90:::benchmark_data_smithi188_104537_object139255:head# 2024-04-01T19:36:19.313 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b2c1590:::benchmark_data_smithi188_104537_object31381:head# 2024-04-01T19:36:19.313 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b2c2a92:::benchmark_data_smithi188_104537_object13719:head# 2024-04-01T19:36:19.314 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b2c4965:::benchmark_data_smithi188_104537_object57087:head# 2024-04-01T19:36:19.315 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b2c816f:::benchmark_data_smithi188_104537_object16493:head# 2024-04-01T19:36:19.315 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b2caedc:::benchmark_data_smithi188_104537_object99776:head# 2024-04-01T19:36:19.316 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b2cb8aa:::benchmark_data_smithi188_104537_object51033:head# 2024-04-01T19:36:19.316 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b2d2e39:::benchmark_data_smithi188_104537_object117646:head# 2024-04-01T19:36:19.316 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b2d940c:::benchmark_data_smithi188_104537_object142602:head# 2024-04-01T19:36:19.317 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b2dfab6:::benchmark_data_smithi188_104537_object138321:head# 2024-04-01T19:36:19.318 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b2f2215:::benchmark_data_smithi188_104537_object30250:head# 2024-04-01T19:36:19.318 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b2f5394:::benchmark_data_smithi188_104537_object92000:head# 2024-04-01T19:36:19.318 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b30b4cc:::benchmark_data_smithi188_104537_object133934:head# 2024-04-01T19:36:19.319 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b30db37:::benchmark_data_smithi188_104537_object40130:head# 2024-04-01T19:36:19.319 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3111d5:::benchmark_data_smithi188_104537_object88712:head# 2024-04-01T19:36:19.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b31debb:::benchmark_data_smithi188_104537_object60854:head# 2024-04-01T19:36:19.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b32e892:::benchmark_data_smithi188_104537_object40314:head# 2024-04-01T19:36:19.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3305cb:::benchmark_data_smithi188_104537_object147372:head# 2024-04-01T19:36:19.321 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3353cc:::benchmark_data_smithi188_104537_object18750:head# 2024-04-01T19:36:19.321 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b33d3fa:::benchmark_data_smithi188_104537_object152493:head# 2024-04-01T19:36:19.322 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b33f7ae:::benchmark_data_smithi188_104537_object58833:head# 2024-04-01T19:36:19.322 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b34cac0:::benchmark_data_smithi188_104537_object119989:head# 2024-04-01T19:36:19.323 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3548d9:::benchmark_data_smithi188_104537_object154338:head# 2024-04-01T19:36:19.323 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b354fab:::benchmark_data_smithi188_104537_object52125:head# 2024-04-01T19:36:19.324 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b357321:::benchmark_data_smithi188_104537_object12190:head# 2024-04-01T19:36:19.324 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b357d0a:::benchmark_data_smithi188_104537_object143158:head# 2024-04-01T19:36:19.324 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3684cb:::benchmark_data_smithi188_104537_object144646:head# 2024-04-01T19:36:19.326 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b370819:::benchmark_data_smithi188_104537_object35632:head# 2024-04-01T19:36:19.326 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b371f0a:::benchmark_data_smithi188_104537_object69169:head# 2024-04-01T19:36:19.327 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b37ecca:::benchmark_data_smithi188_104537_object86665:head# 2024-04-01T19:36:19.327 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b37fe44:::benchmark_data_smithi188_104537_object93631:head# 2024-04-01T19:36:19.328 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b387225:::benchmark_data_smithi188_104537_object162317:head# 2024-04-01T19:36:19.328 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b387da8:::benchmark_data_smithi188_104537_object94210:head# 2024-04-01T19:36:19.328 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b38d5de:::benchmark_data_smithi188_104537_object95232:head# 2024-04-01T19:36:19.329 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b397553:::benchmark_data_smithi188_104537_object79774:head# 2024-04-01T19:36:19.329 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b39819f:::benchmark_data_smithi188_104537_object75518:head# 2024-04-01T19:36:19.330 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b39ab76:::benchmark_data_smithi188_104537_object119093:head# 2024-04-01T19:36:19.330 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b39aeeb:::benchmark_data_smithi188_104537_object165541:head# 2024-04-01T19:36:19.331 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b39ee3d:::benchmark_data_smithi188_104537_object92080:head# 2024-04-01T19:36:19.331 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3a3f88:::benchmark_data_smithi188_104537_object53526:head# 2024-04-01T19:36:19.332 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3b0e8f:::benchmark_data_smithi188_104537_object15064:head# 2024-04-01T19:36:19.332 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3b1539:::benchmark_data_smithi188_104537_object27567:head# 2024-04-01T19:36:19.332 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3b3bdb:::benchmark_data_smithi188_104537_object13856:head# 2024-04-01T19:36:19.333 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3b4397:::benchmark_data_smithi188_104537_object81769:head# 2024-04-01T19:36:19.334 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3b473f:::benchmark_data_smithi188_104537_object66682:head# 2024-04-01T19:36:19.334 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3b80c9:::benchmark_data_smithi188_104537_object101308:head# 2024-04-01T19:36:19.334 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3b9f93:::benchmark_data_smithi188_104537_object24251:head# 2024-04-01T19:36:19.335 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3c6d66:::benchmark_data_smithi188_104537_object74970:head# 2024-04-01T19:36:19.335 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3c9e3e:::benchmark_data_smithi188_104537_object119834:head# 2024-04-01T19:36:19.336 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3cbe8c:::benchmark_data_smithi188_104537_object29171:head# 2024-04-01T19:36:19.336 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3cfa32:::benchmark_data_smithi188_104537_object115781:head# 2024-04-01T19:36:19.337 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3d77d8:::benchmark_data_smithi188_104537_object140541:head# 2024-04-01T19:36:19.337 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3dfbbb:::benchmark_data_smithi188_104537_object81884:head# 2024-04-01T19:36:19.337 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3e4b71:::benchmark_data_smithi188_104537_object16881:head# 2024-04-01T19:36:19.338 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3ea5e1:::benchmark_data_smithi188_104537_object100256:head# 2024-04-01T19:36:19.338 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3ea8f0:::benchmark_data_smithi188_104537_object76168:head# 2024-04-01T19:36:19.339 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3ed9bf:::benchmark_data_smithi188_104537_object111259:head# 2024-04-01T19:36:19.339 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3f21a3:::benchmark_data_smithi188_104537_object34343:head# 2024-04-01T19:36:19.339 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3f5230:::benchmark_data_smithi188_104537_object98202:head# 2024-04-01T19:36:19.340 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3f643b:::benchmark_data_smithi188_104537_object80192:head# 2024-04-01T19:36:19.340 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b3fb924:::benchmark_data_smithi188_104537_object48534:head# 2024-04-01T19:36:19.341 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b40530a:::benchmark_data_smithi188_104537_object153303:head# 2024-04-01T19:36:19.341 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b40904f:::benchmark_data_smithi188_104537_object135308:head# 2024-04-01T19:36:19.342 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b413ba2:::benchmark_data_smithi188_104537_object59555:head# 2024-04-01T19:36:19.342 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b418c71:::benchmark_data_smithi188_104537_object167317:head# 2024-04-01T19:36:19.343 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b41f21d:::benchmark_data_smithi188_104537_object47748:head# 2024-04-01T19:36:19.343 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b422669:::benchmark_data_smithi188_104537_object170842:head# 2024-04-01T19:36:19.344 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b422b02:::benchmark_data_smithi188_104537_object76112:head# 2024-04-01T19:36:19.344 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b427562:::benchmark_data_smithi188_104537_object13998:head# 2024-04-01T19:36:19.345 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b42a833:::benchmark_data_smithi188_104537_object49352:head# 2024-04-01T19:36:19.345 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b436457:::benchmark_data_smithi188_104537_object108162:head# 2024-04-01T19:36:19.346 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b43c0c1:::benchmark_data_smithi188_104537_object165529:head# 2024-04-01T19:36:19.346 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b43e69c:::benchmark_data_smithi188_104537_object145152:head# 2024-04-01T19:36:19.346 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b459d99:::benchmark_data_smithi188_104537_object79349:head# 2024-04-01T19:36:19.347 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b4737fa:::benchmark_data_smithi188_104537_object52568:head# 2024-04-01T19:36:19.347 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b489d20:::benchmark_data_smithi188_104537_object139591:head# 2024-04-01T19:36:19.348 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b48f893:::benchmark_data_smithi188_104537_object86018:head# 2024-04-01T19:36:19.348 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b491751:::benchmark_data_smithi188_104537_object44798:head# 2024-04-01T19:36:19.348 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b496932:::benchmark_data_smithi188_104537_object38758:head# 2024-04-01T19:36:19.349 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b496a3c:::benchmark_data_smithi188_104537_object37679:head# 2024-04-01T19:36:19.349 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b49b663:::benchmark_data_smithi188_104537_object59434:head# 2024-04-01T19:36:19.350 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b49b699:::benchmark_data_smithi188_104537_object80569:head# 2024-04-01T19:36:19.350 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b49e9c1:::benchmark_data_smithi188_104537_object111497:head# 2024-04-01T19:36:19.351 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b4b6cec:::benchmark_data_smithi188_104537_object127240:head# 2024-04-01T19:36:19.351 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b4bcba0:::benchmark_data_smithi188_104537_object168808:head# 2024-04-01T19:36:19.352 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b4c1228:::benchmark_data_smithi188_104537_object46065:head# 2024-04-01T19:36:19.352 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b4defeb:::benchmark_data_smithi188_104537_object13440:head# 2024-04-01T19:36:19.352 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b4e2ca0:::benchmark_data_smithi188_104537_object56088:head# 2024-04-01T19:36:19.353 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b4e65cf:::benchmark_data_smithi188_104537_object79134:head# 2024-04-01T19:36:19.353 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b4ec2ad:::benchmark_data_smithi188_104537_object118610:head# 2024-04-01T19:36:19.354 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b4f78ce:::benchmark_data_smithi188_104537_object43963:head# 2024-04-01T19:36:19.354 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b4fb8ac:::benchmark_data_smithi188_104537_object92506:head# 2024-04-01T19:36:19.354 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b5001ee:::benchmark_data_smithi188_104537_object20035:head# 2024-04-01T19:36:19.355 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b505ff7:::benchmark_data_smithi188_104537_object90214:head# 2024-04-01T19:36:19.355 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b50e31a:::benchmark_data_smithi188_104537_object15907:head# 2024-04-01T19:36:19.356 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b50fbe9:::benchmark_data_smithi188_104537_object98447:head# 2024-04-01T19:36:19.356 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b5112c1:::benchmark_data_smithi188_104537_object40851:head# 2024-04-01T19:36:19.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b512521:::benchmark_data_smithi188_104537_object39871:head# 2024-04-01T19:36:19.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b5143d3:::benchmark_data_smithi188_104537_object141071:head# 2024-04-01T19:36:19.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b51819b:::benchmark_data_smithi188_104537_object114388:head# 2024-04-01T19:36:19.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b51c901:::benchmark_data_smithi188_104537_object150226:head# 2024-04-01T19:36:19.358 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b51f0eb:::benchmark_data_smithi188_104537_object50132:head# 2024-04-01T19:36:19.358 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b5264e7:::benchmark_data_smithi188_104537_object125617:head# 2024-04-01T19:36:19.359 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b52c08f:::benchmark_data_smithi188_104537_object130438:head# 2024-04-01T19:36:19.359 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b52dd87:::benchmark_data_smithi188_104537_object144393:head# 2024-04-01T19:36:19.359 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b54c5d5:::benchmark_data_smithi188_104537_object125616:head# 2024-04-01T19:36:19.360 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b54f4e1:::benchmark_data_smithi188_104537_object101864:head# 2024-04-01T19:36:19.361 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b55260f:::benchmark_data_smithi188_104537_object123141:head# 2024-04-01T19:36:19.361 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b553295:::benchmark_data_smithi188_104537_object66738:head# 2024-04-01T19:36:19.362 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b55516e:::benchmark_data_smithi188_104537_object120621:head# 2024-04-01T19:36:19.362 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b561459:::benchmark_data_smithi188_104537_object109735:head# 2024-04-01T19:36:19.363 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b561fb5:::benchmark_data_smithi188_104537_object106219:head# 2024-04-01T19:36:19.363 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b57262c:::benchmark_data_smithi188_104537_object169071:head# 2024-04-01T19:36:19.364 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b57a18d:::benchmark_data_smithi188_104537_object46007:head# 2024-04-01T19:36:19.364 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b5801e0:::benchmark_data_smithi188_104537_object60228:head# 2024-04-01T19:36:19.365 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b5803d3:::benchmark_data_smithi188_104537_object110789:head# 2024-04-01T19:36:19.365 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b58148a:::benchmark_data_smithi188_104537_object55122:head# 2024-04-01T19:36:19.366 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b58dc77:::benchmark_data_smithi188_104537_object121268:head# 2024-04-01T19:36:19.366 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b59f1ca:::benchmark_data_smithi188_104537_object114512:head# 2024-04-01T19:36:19.367 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b5a2789:::benchmark_data_smithi188_104537_object56693:head# 2024-04-01T19:36:19.367 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b5d2829:::benchmark_data_smithi188_104537_object30772:head# 2024-04-01T19:36:19.368 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b5d32f2:::benchmark_data_smithi188_104537_object45955:head# 2024-04-01T19:36:19.368 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b5d76b4:::benchmark_data_smithi188_104537_object155191:head# 2024-04-01T19:36:19.369 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b5db92e:::benchmark_data_smithi188_104537_object160101:head# 2024-04-01T19:36:19.369 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b5edb0b:::benchmark_data_smithi188_104537_object148045:head# 2024-04-01T19:36:19.369 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b5f7fea:::benchmark_data_smithi188_104537_object76180:head# 2024-04-01T19:36:19.370 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b5fd60d:::benchmark_data_smithi188_104537_object163290:head# 2024-04-01T19:36:19.370 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b5fe199:::benchmark_data_smithi188_104537_object29548:head# 2024-04-01T19:36:19.370 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b6012e0:::benchmark_data_smithi188_104537_object141292:head# 2024-04-01T19:36:19.371 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b607411:::benchmark_data_smithi188_104537_object76137:head# 2024-04-01T19:36:19.371 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b6087aa:::benchmark_data_smithi188_104537_object65554:head# 2024-04-01T19:36:19.372 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b60a551:::benchmark_data_smithi188_104537_object100251:head# 2024-04-01T19:36:19.372 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b6179ad:::benchmark_data_smithi188_104537_object165708:head# 2024-04-01T19:36:19.373 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b61c450:::benchmark_data_smithi188_104537_object154230:head# 2024-04-01T19:36:19.373 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b62ab84:::benchmark_data_smithi188_104537_object29980:head# 2024-04-01T19:36:19.374 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b63a189:::benchmark_data_smithi188_104537_object27905:head# 2024-04-01T19:36:19.374 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b63f7e0:::benchmark_data_smithi188_104537_object131564:head# 2024-04-01T19:36:19.375 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b640023:::benchmark_data_smithi188_104537_object110239:head# 2024-04-01T19:36:19.375 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b6453b8:::benchmark_data_smithi188_104537_object123319:head# 2024-04-01T19:36:19.375 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b65988e:::benchmark_data_smithi188_104537_object36996:head# 2024-04-01T19:36:19.376 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b685319:::benchmark_data_smithi188_104537_object28091:head# 2024-04-01T19:36:19.376 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b68b588:::benchmark_data_smithi188_104537_object167916:head# 2024-04-01T19:36:19.377 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b68f6ae:::benchmark_data_smithi188_104537_object133782:head# 2024-04-01T19:36:19.377 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b697bd2:::benchmark_data_smithi188_104537_object103260:head# 2024-04-01T19:36:19.377 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b6984f7:::benchmark_data_smithi188_104537_object24584:head# 2024-04-01T19:36:19.378 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b69bf8b:::benchmark_data_smithi188_104537_object106890:head# 2024-04-01T19:36:19.378 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b69c8ef:::benchmark_data_smithi188_104537_object158669:head# 2024-04-01T19:36:19.379 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b6a2d69:::benchmark_data_smithi188_104537_object42755:head# 2024-04-01T19:36:19.379 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b6c0790:::benchmark_data_smithi188_104537_object147130:head# 2024-04-01T19:36:19.380 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b6c87ff:::benchmark_data_smithi188_104537_object149835:head# 2024-04-01T19:36:19.380 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b6d21d3:::benchmark_data_smithi188_104537_object127215:head# 2024-04-01T19:36:19.381 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b6d3e95:::benchmark_data_smithi188_104537_object77511:head# 2024-04-01T19:36:19.381 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b6d74f5:::benchmark_data_smithi188_104537_object37492:head# 2024-04-01T19:36:19.381 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b6d870c:::benchmark_data_smithi188_104537_object38211:head# 2024-04-01T19:36:19.382 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b6dc901:::benchmark_data_smithi188_104537_object43440:head# 2024-04-01T19:36:19.382 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b6de50c:::benchmark_data_smithi188_104537_object164876:head# 2024-04-01T19:36:19.383 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b6df486:::benchmark_data_smithi188_104537_object70246:head# 2024-04-01T19:36:19.383 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b6e7757:::benchmark_data_smithi188_104537_object12006:head# 2024-04-01T19:36:19.384 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b6e893b:::benchmark_data_smithi188_104537_object66243:head# 2024-04-01T19:36:19.384 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b6ec570:::benchmark_data_smithi188_104537_object113901:head# 2024-04-01T19:36:19.384 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b6f5e20:::benchmark_data_smithi188_104537_object120952:head# 2024-04-01T19:36:19.385 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b705509:::benchmark_data_smithi188_104537_object22850:head# 2024-04-01T19:36:19.385 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b70a2ba:::benchmark_data_smithi188_104537_object164037:head# 2024-04-01T19:36:19.386 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b70d802:::benchmark_data_smithi188_104537_object111438:head# 2024-04-01T19:36:19.387 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b70e46c:::benchmark_data_smithi188_104537_object88624:head# 2024-04-01T19:36:19.387 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b7139ea:::benchmark_data_smithi188_104537_object15600:head# 2024-04-01T19:36:19.387 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b7166f0:::benchmark_data_smithi188_104537_object38396:head# 2024-04-01T19:36:19.388 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b71b7c7:::benchmark_data_smithi188_104537_object37907:head# 2024-04-01T19:36:19.388 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b72a07e:::benchmark_data_smithi188_104537_object63836:head# 2024-04-01T19:36:19.389 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b7314a0:::benchmark_data_smithi188_104537_object48238:head# 2024-04-01T19:36:19.389 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b732949:::benchmark_data_smithi188_104537_object43601:head# 2024-04-01T19:36:19.389 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b73f3ff:::benchmark_data_smithi188_104537_object53804:head# 2024-04-01T19:36:19.390 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b745aa6:::benchmark_data_smithi188_104537_object159852:head# 2024-04-01T19:36:19.390 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b7491dc:::benchmark_data_smithi188_104537_object138432:head# 2024-04-01T19:36:19.391 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b74dc45:::benchmark_data_smithi188_104537_object69408:head# 2024-04-01T19:36:19.391 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b75453a:::benchmark_data_smithi188_104537_object33441:head# 2024-04-01T19:36:19.392 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b755064:::benchmark_data_smithi188_104537_object94021:head# 2024-04-01T19:36:19.392 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b758f9a:::benchmark_data_smithi188_104537_object131878:head# 2024-04-01T19:36:19.393 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b75aa46:::benchmark_data_smithi188_104537_object83438:head# 2024-04-01T19:36:19.393 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b766ce8:::benchmark_data_smithi188_104537_object127475:head# 2024-04-01T19:36:19.394 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b7740e9:::benchmark_data_smithi188_104537_object12178:head# 2024-04-01T19:36:19.394 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b774ad3:::benchmark_data_smithi188_104537_object69086:head# 2024-04-01T19:36:19.394 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b77c3b8:::benchmark_data_smithi188_104537_object47899:head# 2024-04-01T19:36:19.395 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b78446d:::benchmark_data_smithi188_104537_object83823:head# 2024-04-01T19:36:19.395 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b78a09e:::benchmark_data_smithi188_104537_object130735:head# 2024-04-01T19:36:19.396 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b795c37:::benchmark_data_smithi188_104537_object34564:head# 2024-04-01T19:36:19.396 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b7aa697:::benchmark_data_smithi188_104537_object20541:head# 2024-04-01T19:36:19.397 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b7aaf8a:::benchmark_data_smithi188_104537_object148065:head# 2024-04-01T19:36:19.397 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b7af96c:::benchmark_data_smithi188_104537_object62739:head# 2024-04-01T19:36:19.398 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b7b427b:::benchmark_data_smithi188_104537_object116630:head# 2024-04-01T19:36:19.398 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b7b8f65:::benchmark_data_smithi188_104537_object145072:head# 2024-04-01T19:36:19.399 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b7b947e:::benchmark_data_smithi188_104537_object159072:head# 2024-04-01T19:36:19.399 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b7bb63e:::benchmark_data_smithi188_104537_object77676:head# 2024-04-01T19:36:19.400 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b7c077c:::benchmark_data_smithi188_104537_object52465:head# 2024-04-01T19:36:19.400 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b7e1fd4:::benchmark_data_smithi188_104537_object44743:head# 2024-04-01T19:36:19.400 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b7f1123:::benchmark_data_smithi188_104537_object58122:head# 2024-04-01T19:36:19.401 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b7f3966:::benchmark_data_smithi188_104537_object69608:head# 2024-04-01T19:36:19.401 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b7f5ca3:::benchmark_data_smithi188_104537_object96013:head# 2024-04-01T19:36:19.402 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b7f71eb:::benchmark_data_smithi188_104537_object135870:head# 2024-04-01T19:36:19.402 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b7f9590:::benchmark_data_smithi188_104537_object81411:head# 2024-04-01T19:36:19.403 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b7fd8a9:::benchmark_data_smithi188_104537_object143190:head# 2024-04-01T19:36:19.403 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b8103a7:::benchmark_data_smithi188_104537_object18050:head# 2024-04-01T19:36:19.404 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b81cb6b:::benchmark_data_smithi188_104537_object71071:head# 2024-04-01T19:36:19.404 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b820a5f:::benchmark_data_smithi188_104537_object157981:head# 2024-04-01T19:36:19.405 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b823bc1:::benchmark_data_smithi188_104537_object158856:head# 2024-04-01T19:36:19.405 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b823f28:::benchmark_data_smithi188_104537_object35440:head# 2024-04-01T19:36:19.406 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b8248ce:::benchmark_data_smithi188_104537_object87666:head# 2024-04-01T19:36:19.406 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b828f8e:::benchmark_data_smithi188_104537_object43349:head# 2024-04-01T19:36:19.407 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b840572:::benchmark_data_smithi188_104537_object87489:head# 2024-04-01T19:36:19.407 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b849039:::benchmark_data_smithi188_104537_object119660:head# 2024-04-01T19:36:19.408 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b84fd59:::benchmark_data_smithi188_104537_object14149:head# 2024-04-01T19:36:19.408 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b864f0d:::benchmark_data_smithi188_104537_object51505:head# 2024-04-01T19:36:19.409 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b865a21:::benchmark_data_smithi188_104537_object88057:head# 2024-04-01T19:36:19.410 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b86a8f4:::benchmark_data_smithi188_104537_object169396:head# 2024-04-01T19:36:19.410 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b86d2d1:::benchmark_data_smithi188_104537_object27482:head# 2024-04-01T19:36:19.411 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b874167:::benchmark_data_smithi188_104537_object113526:head# 2024-04-01T19:36:19.411 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b87b6f7:::benchmark_data_smithi188_104537_object142466:head# 2024-04-01T19:36:19.412 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b888c1b:::benchmark_data_smithi188_104537_object17673:head# 2024-04-01T19:36:19.412 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b88aff6:::benchmark_data_smithi188_104537_object143535:head# 2024-04-01T19:36:19.412 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b89897f:::benchmark_data_smithi188_104537_object42737:head# 2024-04-01T19:36:19.413 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b89e0b1:::benchmark_data_smithi188_104537_object78052:head# 2024-04-01T19:36:19.413 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b8a1c56:::benchmark_data_smithi188_104537_object81207:head# 2024-04-01T19:36:19.414 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b8a2234:::benchmark_data_smithi188_104537_object42472:head# 2024-04-01T19:36:19.414 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b8a2d47:::benchmark_data_smithi188_104537_object139960:head# 2024-04-01T19:36:19.415 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b8a31f0:::benchmark_data_smithi188_104537_object80135:head# 2024-04-01T19:36:19.415 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b8a630b:::benchmark_data_smithi188_104537_object120212:head# 2024-04-01T19:36:19.415 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b8a8f6b:::benchmark_data_smithi188_104537_object22349:head# 2024-04-01T19:36:19.416 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b8af40f:::benchmark_data_smithi188_104537_object152202:head# 2024-04-01T19:36:19.416 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b8bb7fd:::benchmark_data_smithi188_104537_object28898:head# 2024-04-01T19:36:19.417 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b8bddd4:::benchmark_data_smithi188_104537_object169326:head# 2024-04-01T19:36:19.417 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b8c92c0:::benchmark_data_smithi188_104537_object21872:head# 2024-04-01T19:36:19.418 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b8d4e3d:::benchmark_data_smithi188_104537_object23555:head# 2024-04-01T19:36:19.418 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b8f05d7:::benchmark_data_smithi188_104537_object115139:head# 2024-04-01T19:36:19.419 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b8fb548:::benchmark_data_smithi188_104537_object145289:head# 2024-04-01T19:36:19.419 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b9010f0:::benchmark_data_smithi188_104537_object100499:head# 2024-04-01T19:36:19.420 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b9036e6:::benchmark_data_smithi188_104537_object57681:head# 2024-04-01T19:36:19.420 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b90a53d:::benchmark_data_smithi188_104537_object151644:head# 2024-04-01T19:36:19.421 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b90d089:::benchmark_data_smithi188_104537_object156695:head# 2024-04-01T19:36:19.421 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b90e932:::benchmark_data_smithi188_104537_object135496:head# 2024-04-01T19:36:19.421 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b91c286:::benchmark_data_smithi188_104537_object35411:head# 2024-04-01T19:36:19.422 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b91d7fa:::benchmark_data_smithi188_104537_object44211:head# 2024-04-01T19:36:19.422 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b91d9aa:::benchmark_data_smithi188_104537_object168983:head# 2024-04-01T19:36:19.423 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b92063a:::benchmark_data_smithi188_104537_object77763:head# 2024-04-01T19:36:19.423 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b938ef5:::benchmark_data_smithi188_104537_object111218:head# 2024-04-01T19:36:19.423 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b93cc0b:::benchmark_data_smithi188_104537_object74005:head# 2024-04-01T19:36:19.424 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b93fc67:::benchmark_data_smithi188_104537_object129959:head# 2024-04-01T19:36:19.424 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b942635:::benchmark_data_smithi188_104537_object112872:head# 2024-04-01T19:36:19.425 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b945adb:::benchmark_data_smithi188_104537_object34610:head# 2024-04-01T19:36:19.425 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b948f45:::benchmark_data_smithi188_104537_object104633:head# 2024-04-01T19:36:19.426 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b94f0bf:::benchmark_data_smithi188_104537_object16553:head# 2024-04-01T19:36:19.426 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b95095f:::benchmark_data_smithi188_104537_object159343:head# 2024-04-01T19:36:19.427 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b954003:::benchmark_data_smithi188_104537_object150380:head# 2024-04-01T19:36:19.427 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b95cc62:::benchmark_data_smithi188_104537_object71299:head# 2024-04-01T19:36:19.428 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b95d0d1:::benchmark_data_smithi188_104537_object68434:head# 2024-04-01T19:36:19.428 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b96da88:::benchmark_data_smithi188_104537_object165493:head# 2024-04-01T19:36:19.428 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b96f91a:::benchmark_data_smithi188_104537_object81335:head# 2024-04-01T19:36:19.429 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b970c08:::benchmark_data_smithi188_104537_object51890:head# 2024-04-01T19:36:19.429 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b97d537:::benchmark_data_smithi188_104537_object17076:head# 2024-04-01T19:36:19.430 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b9864c1:::benchmark_data_smithi188_104537_object146234:head# 2024-04-01T19:36:19.430 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b98677f:::benchmark_data_smithi188_104537_object56153:head# 2024-04-01T19:36:19.431 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b98956f:::benchmark_data_smithi188_104537_object156505:head# 2024-04-01T19:36:19.431 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b9a237b:::benchmark_data_smithi188_104537_object123105:head# 2024-04-01T19:36:19.432 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b9b92ac:::benchmark_data_smithi188_104537_object149030:head# 2024-04-01T19:36:19.432 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b9bb094:::benchmark_data_smithi188_104537_object93730:head# 2024-04-01T19:36:19.433 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b9bb751:::benchmark_data_smithi188_104537_object93623:head# 2024-04-01T19:36:19.433 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b9be971:::benchmark_data_smithi188_104537_object18249:head# 2024-04-01T19:36:19.433 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b9c0c19:::benchmark_data_smithi188_104537_object59276:head# 2024-04-01T19:36:19.435 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b9c1a4b:::benchmark_data_smithi188_104537_object167894:head# 2024-04-01T19:36:19.436 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b9c76fe:::benchmark_data_smithi188_104537_object31594:head# 2024-04-01T19:36:19.436 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b9d51a6:::benchmark_data_smithi188_104537_object55913:head# 2024-04-01T19:36:19.436 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b9d79c1:::benchmark_data_smithi188_104537_object167844:head# 2024-04-01T19:36:19.437 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b9db20d:::benchmark_data_smithi188_104537_object127830:head# 2024-04-01T19:36:19.437 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b9ee03f:::benchmark_data_smithi188_104537_object94206:head# 2024-04-01T19:36:19.438 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b9eed08:::benchmark_data_smithi188_104537_object110391:head# 2024-04-01T19:36:19.438 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b9f3e0c:::benchmark_data_smithi188_104537_object56841:head# 2024-04-01T19:36:19.439 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5b9f5ac2:::benchmark_data_smithi188_104537_object11502:head# 2024-04-01T19:36:19.439 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba064cb:::benchmark_data_smithi188_104537_object168548:head# 2024-04-01T19:36:19.440 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba0ebc0:::benchmark_data_smithi188_104537_object52617:head# 2024-04-01T19:36:19.440 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba14876:::benchmark_data_smithi188_104537_object63653:head# 2024-04-01T19:36:19.440 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba18c1f:::benchmark_data_smithi188_104537_object23009:head# 2024-04-01T19:36:19.441 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba22316:::benchmark_data_smithi188_104537_object115682:head# 2024-04-01T19:36:19.441 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba2a16d:::benchmark_data_smithi188_104537_object108962:head# 2024-04-01T19:36:19.442 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba2ef9e:::benchmark_data_smithi188_104537_object48106:head# 2024-04-01T19:36:19.442 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba2f02f:::benchmark_data_smithi188_104537_object27748:head# 2024-04-01T19:36:19.443 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba3048d:::benchmark_data_smithi188_104537_object114810:head# 2024-04-01T19:36:19.443 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba33528:::benchmark_data_smithi188_104537_object26460:head# 2024-04-01T19:36:19.444 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba3e86b:::benchmark_data_smithi188_104537_object34608:head# 2024-04-01T19:36:19.444 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba4624d:::benchmark_data_smithi188_104537_object26388:head# 2024-04-01T19:36:19.444 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba492da:::benchmark_data_smithi188_104537_object18487:head# 2024-04-01T19:36:19.445 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba4a54b:::benchmark_data_smithi188_104537_object124120:head# 2024-04-01T19:36:19.445 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba55fd1:::benchmark_data_smithi188_104537_object142013:head# 2024-04-01T19:36:19.445 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba719a0:::benchmark_data_smithi188_104537_object47079:head# 2024-04-01T19:36:19.446 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba7680d:::benchmark_data_smithi188_104537_object44942:head# 2024-04-01T19:36:19.446 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba787e2:::benchmark_data_smithi188_104537_object134047:head# 2024-04-01T19:36:19.447 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba790f7:::benchmark_data_smithi188_104537_object33788:head# 2024-04-01T19:36:19.447 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba7a9fb:::benchmark_data_smithi188_104537_object16886:head# 2024-04-01T19:36:19.448 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba7f5fc:::benchmark_data_smithi188_104537_object45840:head# 2024-04-01T19:36:19.448 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba7f6be:::benchmark_data_smithi188_104537_object149066:head# 2024-04-01T19:36:19.448 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba84269:::benchmark_data_smithi188_104537_object164148:head# 2024-04-01T19:36:19.449 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba86ba0:::benchmark_data_smithi188_104537_object170756:head# 2024-04-01T19:36:19.449 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba94a6e:::benchmark_data_smithi188_104537_object81564:head# 2024-04-01T19:36:19.450 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ba97f89:::benchmark_data_smithi188_104537_object141378:head# 2024-04-01T19:36:19.450 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5baa1570:::benchmark_data_smithi188_104537_object170869:head# 2024-04-01T19:36:19.450 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5baa4b7d:::benchmark_data_smithi188_104537_object119052:head# 2024-04-01T19:36:19.451 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5baaad42:::benchmark_data_smithi188_104537_object97327:head# 2024-04-01T19:36:19.451 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5baaaea9:::benchmark_data_smithi188_104537_object161275:head# 2024-04-01T19:36:19.452 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bab1c08:::benchmark_data_smithi188_104537_object69821:head# 2024-04-01T19:36:19.452 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bab6b98:::benchmark_data_smithi188_104537_object87008:head# 2024-04-01T19:36:19.453 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bab8bca:::benchmark_data_smithi188_104537_object89520:head# 2024-04-01T19:36:19.453 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5babefdd:::benchmark_data_smithi188_104537_object65309:head# 2024-04-01T19:36:19.454 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5babf908:::benchmark_data_smithi188_104537_object169169:head# 2024-04-01T19:36:19.454 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bac4a68:::benchmark_data_smithi188_104537_object162151:head# 2024-04-01T19:36:19.454 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bac9963:::benchmark_data_smithi188_104537_object76819:head# 2024-04-01T19:36:19.455 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bad15eb:::benchmark_data_smithi188_104537_object74832:head# 2024-04-01T19:36:19.455 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bad9a8a:::benchmark_data_smithi188_104537_object101582:head# 2024-04-01T19:36:19.456 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bae2219:::benchmark_data_smithi188_104537_object56599:head# 2024-04-01T19:36:19.456 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5baec5a6:::benchmark_data_smithi188_104537_object164077:head# 2024-04-01T19:36:19.457 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5baeeecb:::benchmark_data_smithi188_104537_object76439:head# 2024-04-01T19:36:19.457 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5baf2b11:::benchmark_data_smithi188_104537_object146144:head# 2024-04-01T19:36:19.458 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5baf3b34:::benchmark_data_smithi188_104537_object20429:head# 2024-04-01T19:36:19.458 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb0201f:::benchmark_data_smithi188_104537_object24612:head# 2024-04-01T19:36:19.458 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb0f0e7:::benchmark_data_smithi188_104537_object89833:head# 2024-04-01T19:36:19.459 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb115e0:::benchmark_data_smithi188_104537_object42759:head# 2024-04-01T19:36:19.459 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb14cff:::benchmark_data_smithi188_104537_object161655:head# 2024-04-01T19:36:19.460 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb172ae:::benchmark_data_smithi188_104537_object149963:head# 2024-04-01T19:36:19.460 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb1806d:::benchmark_data_smithi188_104537_object130022:head# 2024-04-01T19:36:19.461 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb1fe3a:::benchmark_data_smithi188_104537_object91485:head# 2024-04-01T19:36:19.461 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb22477:::benchmark_data_smithi188_104537_object118045:head# 2024-04-01T19:36:19.461 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb3899a:::benchmark_data_smithi188_104537_object56665:head# 2024-04-01T19:36:19.462 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb3a044:::benchmark_data_smithi188_104537_object163971:head# 2024-04-01T19:36:19.462 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb40efc:::benchmark_data_smithi188_104537_object41662:head# 2024-04-01T19:36:19.463 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb45b77:::benchmark_data_smithi188_104537_object49362:head# 2024-04-01T19:36:19.463 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb4a2ca:::benchmark_data_smithi188_104537_object44751:head# 2024-04-01T19:36:19.464 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb4bb6c:::benchmark_data_smithi188_104537_object168827:head# 2024-04-01T19:36:19.465 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb570a5:::benchmark_data_smithi188_104537_object18460:head# 2024-04-01T19:36:19.465 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb604ca:::benchmark_data_smithi188_104537_object118198:head# 2024-04-01T19:36:19.465 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb69880:::benchmark_data_smithi188_104537_object101866:head# 2024-04-01T19:36:19.466 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb6eaa1:::benchmark_data_smithi188_104537_object154625:head# 2024-04-01T19:36:19.466 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb71126:::benchmark_data_smithi188_104537_object166923:head# 2024-04-01T19:36:19.467 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb768bd:::benchmark_data_smithi188_104537_object136176:head# 2024-04-01T19:36:19.467 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb78baa:::benchmark_data_smithi188_104537_object37435:head# 2024-04-01T19:36:19.467 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb858fc:::benchmark_data_smithi188_104537_object72445:head# 2024-04-01T19:36:19.468 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb8732c:::benchmark_data_smithi188_104537_object114374:head# 2024-04-01T19:36:19.468 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb88786:::benchmark_data_smithi188_104537_object143299:head# 2024-04-01T19:36:19.469 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb88987:::benchmark_data_smithi188_104537_object75998:head# 2024-04-01T19:36:19.469 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bb8d641:::benchmark_data_smithi188_104537_object147829:head# 2024-04-01T19:36:19.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bba6691:::benchmark_data_smithi188_104537_object29363:head# 2024-04-01T19:36:19.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bba6e97:::benchmark_data_smithi188_104537_object30712:head# 2024-04-01T19:36:19.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bba9e3b:::benchmark_data_smithi188_104537_object129628:head# 2024-04-01T19:36:19.471 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bbb24a2:::benchmark_data_smithi188_104537_object16801:head# 2024-04-01T19:36:19.471 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bbb46f8:::benchmark_data_smithi188_104537_object63407:head# 2024-04-01T19:36:19.472 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bbcf779:::benchmark_data_smithi188_104537_object160496:head# 2024-04-01T19:36:19.472 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bbcfeb6:::benchmark_data_smithi188_104537_object116666:head# 2024-04-01T19:36:19.472 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bbd1ec9:::benchmark_data_smithi188_104537_object153625:head# 2024-04-01T19:36:19.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bbd43e1:::benchmark_data_smithi188_104537_object28321:head# 2024-04-01T19:36:19.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bbde1e7:::benchmark_data_smithi188_104537_object85923:head# 2024-04-01T19:36:19.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bbe203c:::benchmark_data_smithi188_104537_object164048:head# 2024-04-01T19:36:19.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bbf2a7d:::benchmark_data_smithi188_104537_object50554:head# 2024-04-01T19:36:19.475 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bc06fcd:::benchmark_data_smithi188_104537_object101649:head# 2024-04-01T19:36:19.475 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bc09710:::benchmark_data_smithi188_104537_object107681:head# 2024-04-01T19:36:19.476 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bc0b02c:::benchmark_data_smithi188_104537_object22807:head# 2024-04-01T19:36:19.476 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bc0d64e:::benchmark_data_smithi188_104537_object112549:head# 2024-04-01T19:36:19.477 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bc16d3b:::benchmark_data_smithi188_104537_object104321:head# 2024-04-01T19:36:19.477 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bc1bd3b:::benchmark_data_smithi188_104537_object163579:head# 2024-04-01T19:36:19.478 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bc1f35e:::benchmark_data_smithi188_104537_object93465:head# 2024-04-01T19:36:19.478 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bc25c51:::benchmark_data_smithi188_104537_object154706:head# 2024-04-01T19:36:19.479 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bc317de:::benchmark_data_smithi188_104537_object105298:head# 2024-04-01T19:36:19.479 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bc323e9:::benchmark_data_smithi188_104537_object44468:head# 2024-04-01T19:36:19.480 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bc35c9a:::benchmark_data_smithi188_104537_object126900:head# 2024-04-01T19:36:19.480 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bc37a7d:::benchmark_data_smithi188_104537_object44523:head# 2024-04-01T19:36:19.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bc48b0d:::benchmark_data_smithi188_104537_object75322:head# 2024-04-01T19:36:19.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bc4a3a0:::benchmark_data_smithi188_104537_object97353:head# 2024-04-01T19:36:19.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bc65fd4:::benchmark_data_smithi188_104537_object159736:head# 2024-04-01T19:36:19.482 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bc77fc5:::benchmark_data_smithi188_104537_object131393:head# 2024-04-01T19:36:19.482 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bc7855f:::benchmark_data_smithi188_104537_object98033:head# 2024-04-01T19:36:19.483 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bc79c49:::benchmark_data_smithi188_104537_object111544:head# 2024-04-01T19:36:19.483 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bc81f33:::benchmark_data_smithi188_104537_object63401:head# 2024-04-01T19:36:19.484 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bc821a8:::benchmark_data_smithi188_104537_object97256:head# 2024-04-01T19:36:19.484 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bc8edae:::benchmark_data_smithi188_104537_object78679:head# 2024-04-01T19:36:19.485 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bc9629f:::benchmark_data_smithi188_104537_object154749:head# 2024-04-01T19:36:19.485 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bc9ac55:::benchmark_data_smithi188_104537_object89886:head# 2024-04-01T19:36:19.486 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bc9c4b8:::benchmark_data_smithi188_104537_object154455:head# 2024-04-01T19:36:19.486 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bca66e0:::benchmark_data_smithi188_104537_object136955:head# 2024-04-01T19:36:19.487 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bcaa0a1:::benchmark_data_smithi188_104537_object98059:head# 2024-04-01T19:36:19.487 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bcaaedd:::benchmark_data_smithi188_104537_object101522:head# 2024-04-01T19:36:19.488 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bcab813:::benchmark_data_smithi188_104537_object97488:head# 2024-04-01T19:36:19.488 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bcbe46e:::benchmark_data_smithi188_104537_object143203:head# 2024-04-01T19:36:19.488 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bcc7202:::benchmark_data_smithi188_104537_object121464:head# 2024-04-01T19:36:19.489 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bcd1e7f:::benchmark_data_smithi188_104537_object110788:head# 2024-04-01T19:36:19.489 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bcd5aac:::benchmark_data_smithi188_104537_object80200:head# 2024-04-01T19:36:19.490 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bcd91ee:::benchmark_data_smithi188_104537_object104065:head# 2024-04-01T19:36:19.490 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bcdce97:::benchmark_data_smithi188_104537_object66548:head# 2024-04-01T19:36:19.491 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bcde3fe:::benchmark_data_smithi188_104537_object48824:head# 2024-04-01T19:36:19.491 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bce1edc:::benchmark_data_smithi188_104537_object151935:head# 2024-04-01T19:36:19.491 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bced3d0:::benchmark_data_smithi188_104537_object87022:head# 2024-04-01T19:36:19.492 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bcfeef9:::benchmark_data_smithi188_104537_object156288:head# 2024-04-01T19:36:19.492 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bd0168d:::benchmark_data_smithi188_104537_object144390:head# 2024-04-01T19:36:19.493 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bd079ca:::benchmark_data_smithi188_104537_object84676:head# 2024-04-01T19:36:19.493 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bd0a938:::benchmark_data_smithi188_104537_object32693:head# 2024-04-01T19:36:19.493 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bd0e155:::benchmark_data_smithi188_104537_object78916:head# 2024-04-01T19:36:19.494 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bd193f7:::benchmark_data_smithi188_104537_object154450:head# 2024-04-01T19:36:19.494 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bd2f3d7:::benchmark_data_smithi188_104537_object126475:head# 2024-04-01T19:36:19.495 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bd3d095:::benchmark_data_smithi188_104537_object95481:head# 2024-04-01T19:36:19.495 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bd4357a:::benchmark_data_smithi188_104537_object77672:head# 2024-04-01T19:36:19.496 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bd4de54:::benchmark_data_smithi188_104537_object128679:head# 2024-04-01T19:36:19.496 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bd53eb0:::benchmark_data_smithi188_104537_object22381:head# 2024-04-01T19:36:19.496 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bd574b1:::benchmark_data_smithi188_104537_object135077:head# 2024-04-01T19:36:19.497 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bd577db:::benchmark_data_smithi188_104537_object91307:head# 2024-04-01T19:36:19.497 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bd593a1:::benchmark_data_smithi188_104537_object158757:head# 2024-04-01T19:36:19.498 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bd5eb27:::benchmark_data_smithi188_104537_object61724:head# 2024-04-01T19:36:19.498 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bd68774:::benchmark_data_smithi188_104537_object106359:head# 2024-04-01T19:36:19.499 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bd78bb9:::benchmark_data_smithi188_104537_object59470:head# 2024-04-01T19:36:19.499 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bd796f3:::benchmark_data_smithi188_104537_object26205:head# 2024-04-01T19:36:19.500 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bd7c0ba:::benchmark_data_smithi188_104537_object156114:head# 2024-04-01T19:36:19.500 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bd813f2:::benchmark_data_smithi188_104537_object58072:head# 2024-04-01T19:36:19.501 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bd8b288:::benchmark_data_smithi188_104537_object96766:head# 2024-04-01T19:36:19.501 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bd9ca6a:::benchmark_data_smithi188_104537_object92845:head# 2024-04-01T19:36:19.502 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bd9da1e:::benchmark_data_smithi188_104537_object58076:head# 2024-04-01T19:36:19.502 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bd9ee5b:::benchmark_data_smithi188_104537_object37307:head# 2024-04-01T19:36:19.503 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bda0a79:::benchmark_data_smithi188_104537_object135806:head# 2024-04-01T19:36:19.503 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bda1017:::benchmark_data_smithi188_104537_object144400:head# 2024-04-01T19:36:19.504 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bdaec43:::benchmark_data_smithi188_104537_object86915:head# 2024-04-01T19:36:19.504 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bdb3116:::benchmark_data_smithi188_104537_object151314:head# 2024-04-01T19:36:19.504 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bdb7f07:::benchmark_data_smithi188_104537_object37284:head# 2024-04-01T19:36:19.505 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bdc65ca:::benchmark_data_smithi188_104537_object16559:head# 2024-04-01T19:36:19.505 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bdcb5d6:::benchmark_data_smithi188_104537_object43356:head# 2024-04-01T19:36:19.506 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bdcc3cc:::benchmark_data_smithi188_104537_object106740:head# 2024-04-01T19:36:19.506 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bdd9107:::benchmark_data_smithi188_104537_object85986:head# 2024-04-01T19:36:19.507 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bddec0f:::benchmark_data_smithi188_104537_object105719:head# 2024-04-01T19:36:19.507 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bddf735:::benchmark_data_smithi188_104537_object70826:head# 2024-04-01T19:36:19.507 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bddf909:::benchmark_data_smithi188_104537_object70991:head# 2024-04-01T19:36:19.508 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bde55e8:::benchmark_data_smithi188_104537_object154649:head# 2024-04-01T19:36:19.508 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bdedf12:::benchmark_data_smithi188_104537_object82934:head# 2024-04-01T19:36:19.509 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bdf95a6:::benchmark_data_smithi188_104537_object95822:head# 2024-04-01T19:36:19.509 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bdfb4fa:::benchmark_data_smithi188_104537_object19926:head# 2024-04-01T19:36:19.509 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bdfcc28:::benchmark_data_smithi188_104537_object55948:head# 2024-04-01T19:36:19.510 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bdfd561:::benchmark_data_smithi188_104537_object122953:head# 2024-04-01T19:36:19.510 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5be01462:::benchmark_data_smithi188_104537_object140497:head# 2024-04-01T19:36:19.511 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5be01d47:::benchmark_data_smithi188_104537_object165114:head# 2024-04-01T19:36:19.511 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5be05773:::benchmark_data_smithi188_104537_object94338:head# 2024-04-01T19:36:19.511 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5be075f6:::benchmark_data_smithi188_104537_object160772:head# 2024-04-01T19:36:19.512 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5be17cfb:::benchmark_data_smithi188_104537_object66486:head# 2024-04-01T19:36:19.512 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5be1c82f:::benchmark_data_smithi188_104537_object107739:head# 2024-04-01T19:36:19.513 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5be27361:::benchmark_data_smithi188_104537_object85828:head# 2024-04-01T19:36:19.513 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5be39d78:::benchmark_data_smithi188_104537_object118937:head# 2024-04-01T19:36:19.514 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5be3d332:::benchmark_data_smithi188_104537_object163703:head# 2024-04-01T19:36:19.514 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5be3d739:::benchmark_data_smithi188_104537_object71597:head# 2024-04-01T19:36:19.514 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5be440a1:::benchmark_data_smithi188_104537_object155474:head# 2024-04-01T19:36:19.515 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5be46935:::benchmark_data_smithi188_104537_object44823:head# 2024-04-01T19:36:19.515 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5be4cc12:::benchmark_data_smithi188_104537_object145619:head# 2024-04-01T19:36:19.516 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5be4e8bf:::benchmark_data_smithi188_104537_object37671:head# 2024-04-01T19:36:19.516 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5be50de5:::benchmark_data_smithi188_104537_object151870:head# 2024-04-01T19:36:19.516 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5be5613c:::benchmark_data_smithi188_104537_object37099:head# 2024-04-01T19:36:19.517 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5be58d98:::benchmark_data_smithi188_104537_object79841:head# 2024-04-01T19:36:19.517 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5be6a028:::benchmark_data_smithi188_104537_object53648:head# 2024-04-01T19:36:19.518 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5be702da:::benchmark_data_smithi188_104537_object29834:head# 2024-04-01T19:36:19.518 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5be78f05:::benchmark_data_smithi188_104537_object158700:head# 2024-04-01T19:36:19.519 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5be7a290:::benchmark_data_smithi188_104537_object124664:head# 2024-04-01T19:36:19.519 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5be7b622:::benchmark_data_smithi188_104537_object61006:head# 2024-04-01T19:36:19.520 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5be8c29e:::benchmark_data_smithi188_104537_object119848:head# 2024-04-01T19:36:19.520 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5be9aa2b:::benchmark_data_smithi188_104537_object164674:head# 2024-04-01T19:36:19.521 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5be9d8f2:::benchmark_data_smithi188_104537_object21210:head# 2024-04-01T19:36:19.521 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5beab86d:::benchmark_data_smithi188_104537_object83444:head# 2024-04-01T19:36:19.523 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5beb392e:::benchmark_data_smithi188_104537_object112842:head# 2024-04-01T19:36:19.523 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5beb54d8:::benchmark_data_smithi188_104537_object140743:head# 2024-04-01T19:36:19.524 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5beb63d9:::benchmark_data_smithi188_104537_object83009:head# 2024-04-01T19:36:19.524 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bebc67f:::benchmark_data_smithi188_104537_object118055:head# 2024-04-01T19:36:19.524 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bebd307:::benchmark_data_smithi188_104537_object50332:head# 2024-04-01T19:36:19.525 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bec177e:::benchmark_data_smithi188_104537_object129848:head# 2024-04-01T19:36:19.525 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bec8403:::benchmark_data_smithi188_104537_object27853:head# 2024-04-01T19:36:19.526 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5becfb52:::benchmark_data_smithi188_104537_object28504:head# 2024-04-01T19:36:19.526 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bed218d:::benchmark_data_smithi188_104537_object165745:head# 2024-04-01T19:36:19.526 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bee5781:::benchmark_data_smithi188_104537_object24568:head# 2024-04-01T19:36:19.527 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bee5f2c:::benchmark_data_smithi188_104537_object17299:head# 2024-04-01T19:36:19.527 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bef8890:::benchmark_data_smithi188_104537_object53853:head# 2024-04-01T19:36:19.528 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5befcb14:::benchmark_data_smithi188_104537_object36890:head# 2024-04-01T19:36:19.528 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf01261:::benchmark_data_smithi188_104537_object127576:head# 2024-04-01T19:36:19.528 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf035b9:::benchmark_data_smithi188_104537_object70728:head# 2024-04-01T19:36:19.528 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf0e057:::benchmark_data_smithi188_104537_object51083:head# 2024-04-01T19:36:19.529 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf0eba8:::benchmark_data_smithi188_104537_object20898:head# 2024-04-01T19:36:19.529 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf0f36f:::benchmark_data_smithi188_104537_object12191:head# 2024-04-01T19:36:19.530 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf1393e:::benchmark_data_smithi188_104537_object58319:head# 2024-04-01T19:36:19.530 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf1ccb4:::benchmark_data_smithi188_104537_object127768:head# 2024-04-01T19:36:19.530 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf2523f:::benchmark_data_smithi188_104537_object40706:head# 2024-04-01T19:36:19.531 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf2994e:::benchmark_data_smithi188_104537_object82596:head# 2024-04-01T19:36:19.531 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf2e0fc:::benchmark_data_smithi188_104537_object47827:head# 2024-04-01T19:36:19.532 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf3b494:::benchmark_data_smithi188_104537_object49213:head# 2024-04-01T19:36:19.533 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf3c2ba:::benchmark_data_smithi188_104537_object33755:head# 2024-04-01T19:36:19.533 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf4429c:::benchmark_data_smithi188_104537_object82277:head# 2024-04-01T19:36:19.533 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf45654:::benchmark_data_smithi188_104537_object148539:head# 2024-04-01T19:36:19.534 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf48186:::benchmark_data_smithi188_104537_object29198:head# 2024-04-01T19:36:19.534 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf508f0:::benchmark_data_smithi188_104537_object156355:head# 2024-04-01T19:36:19.535 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf5e49a:::benchmark_data_smithi188_104537_object163084:head# 2024-04-01T19:36:19.535 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf64b2f:::benchmark_data_smithi188_104537_object156766:head# 2024-04-01T19:36:19.536 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf66971:::benchmark_data_smithi188_104537_object30154:head# 2024-04-01T19:36:19.536 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf66c6d:::benchmark_data_smithi188_104537_object52017:head# 2024-04-01T19:36:19.536 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf6c9dd:::benchmark_data_smithi188_104537_object122525:head# 2024-04-01T19:36:19.537 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf715f0:::benchmark_data_smithi188_104537_object108248:head# 2024-04-01T19:36:19.537 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf74f33:::benchmark_data_smithi188_104537_object65709:head# 2024-04-01T19:36:19.538 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf74f3b:::benchmark_data_smithi188_104537_object128574:head# 2024-04-01T19:36:19.538 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf763af:::benchmark_data_smithi188_104537_object143953:head# 2024-04-01T19:36:19.538 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf774c4:::benchmark_data_smithi188_104537_object47156:head# 2024-04-01T19:36:19.539 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf7a40b:::benchmark_data_smithi188_104537_object63811:head# 2024-04-01T19:36:19.539 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf83333:::benchmark_data_smithi188_104537_object41174:head# 2024-04-01T19:36:19.540 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf8592c:::benchmark_data_smithi188_104537_object168124:head# 2024-04-01T19:36:19.540 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf8cb6a:::benchmark_data_smithi188_104537_object69690:head# 2024-04-01T19:36:19.540 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bf960c1:::benchmark_data_smithi188_104537_object87127:head# 2024-04-01T19:36:19.541 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bfa182e:::benchmark_data_smithi188_104537_object140959:head# 2024-04-01T19:36:19.541 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bfa48eb:::benchmark_data_smithi188_104537_object170703:head# 2024-04-01T19:36:19.542 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bfaffd1:::benchmark_data_smithi188_104537_object71266:head# 2024-04-01T19:36:19.542 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bfb8ed1:::benchmark_data_smithi188_104537_object134312:head# 2024-04-01T19:36:19.543 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bfb997a:::benchmark_data_smithi188_104537_object34159:head# 2024-04-01T19:36:19.543 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bfc3d4f:::benchmark_data_smithi188_104537_object157143:head# 2024-04-01T19:36:19.544 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bfc8fd9:::benchmark_data_smithi188_104537_object90804:head# 2024-04-01T19:36:19.544 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bfe0dbf:::benchmark_data_smithi188_104537_object113797:head# 2024-04-01T19:36:19.544 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bfe74b3:::benchmark_data_smithi188_104537_object170084:head# 2024-04-01T19:36:19.545 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bfed8b8:::benchmark_data_smithi188_104537_object147639:head# 2024-04-01T19:36:19.546 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bfefd9b:::benchmark_data_smithi188_104537_object22872:head# 2024-04-01T19:36:19.546 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bff011c:::benchmark_data_smithi188_104537_object90130:head# 2024-04-01T19:36:19.546 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5bff9a63:::benchmark_data_smithi188_104537_object49509:head# 2024-04-01T19:36:19.547 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c0098ba:::benchmark_data_smithi188_104537_object149052:head# 2024-04-01T19:36:19.547 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c00efd9:::benchmark_data_smithi188_104537_object27062:head# 2024-04-01T19:36:19.547 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c0207e1:::benchmark_data_smithi188_104537_object34175:head# 2024-04-01T19:36:19.548 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c02905f:::benchmark_data_smithi188_104537_object68382:head# 2024-04-01T19:36:19.549 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c02a70d:::benchmark_data_smithi188_104537_object23862:head# 2024-04-01T19:36:19.549 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c03a351:::benchmark_data_smithi188_104537_object61740:head# 2024-04-01T19:36:19.549 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c03f838:::benchmark_data_smithi188_104537_object38106:head# 2024-04-01T19:36:19.550 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c04cdfb:::benchmark_data_smithi188_104537_object131423:head# 2024-04-01T19:36:19.550 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c057f00:::benchmark_data_smithi188_104537_object101952:head# 2024-04-01T19:36:19.550 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c05fb21:::benchmark_data_smithi188_104537_object50945:head# 2024-04-01T19:36:19.551 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c064891:::benchmark_data_smithi188_104537_object29257:head# 2024-04-01T19:36:19.551 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c066b02:::benchmark_data_smithi188_104537_object132963:head# 2024-04-01T19:36:19.552 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c06eb88:::benchmark_data_smithi188_104537_object94263:head# 2024-04-01T19:36:19.552 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c07816f:::benchmark_data_smithi188_104537_object80416:head# 2024-04-01T19:36:19.553 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c07e57d:::benchmark_data_smithi188_104537_object40797:head# 2024-04-01T19:36:19.553 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c07f96e:::benchmark_data_smithi188_104537_object32184:head# 2024-04-01T19:36:19.554 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c084601:::benchmark_data_smithi188_104537_object110911:head# 2024-04-01T19:36:19.554 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c08c0b6:::benchmark_data_smithi188_104537_object61847:head# 2024-04-01T19:36:19.555 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c08c442:::benchmark_data_smithi188_104537_object54844:head# 2024-04-01T19:36:19.555 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c099b89:::benchmark_data_smithi188_104537_object93154:head# 2024-04-01T19:36:19.555 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c0a472e:::benchmark_data_smithi188_104537_object25629:head# 2024-04-01T19:36:19.556 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c0a6f8e:::benchmark_data_smithi188_104537_object19798:head# 2024-04-01T19:36:19.556 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c0ab5f8:::benchmark_data_smithi188_104537_object42928:head# 2024-04-01T19:36:19.557 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c0b3643:::benchmark_data_smithi188_104537_object151944:head# 2024-04-01T19:36:19.558 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c0b5e52:::benchmark_data_smithi188_104537_object28423:head# 2024-04-01T19:36:19.558 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c0b8f30:::benchmark_data_smithi188_104537_object49274:head# 2024-04-01T19:36:19.559 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c0c2ff1:::benchmark_data_smithi188_104537_object71917:head# 2024-04-01T19:36:19.559 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c0cd2a9:::benchmark_data_smithi188_104537_object76480:head# 2024-04-01T19:36:19.559 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c0ceeaf:::benchmark_data_smithi188_104537_object22904:head# 2024-04-01T19:36:19.560 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c0d1035:::benchmark_data_smithi188_104537_object66734:head# 2024-04-01T19:36:19.560 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c0d1cf4:::benchmark_data_smithi188_104537_object36934:head# 2024-04-01T19:36:19.561 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c0d2ab7:::benchmark_data_smithi188_104537_object12048:head# 2024-04-01T19:36:19.561 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c0e301b:::benchmark_data_smithi188_104537_object133621:head# 2024-04-01T19:36:19.562 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c0e4198:::benchmark_data_smithi188_104537_object114701:head# 2024-04-01T19:36:19.562 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c0f4629:::benchmark_data_smithi188_104537_object169485:head# 2024-04-01T19:36:19.563 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c0fea29:::benchmark_data_smithi188_104537_object134135:head# 2024-04-01T19:36:19.563 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c0feaeb:::benchmark_data_smithi188_104537_object131003:head# 2024-04-01T19:36:19.563 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c100b0b:::benchmark_data_smithi188_104537_object100832:head# 2024-04-01T19:36:19.564 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c10289a:::benchmark_data_smithi188_104537_object122723:head# 2024-04-01T19:36:19.564 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c103f0a:::benchmark_data_smithi188_104537_object79517:head# 2024-04-01T19:36:19.565 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c1059ea:::benchmark_data_smithi188_104537_object69494:head# 2024-04-01T19:36:19.565 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c10b1ed:::benchmark_data_smithi188_104537_object111078:head# 2024-04-01T19:36:19.566 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c10d80a:::benchmark_data_smithi188_104537_object121363:head# 2024-04-01T19:36:19.566 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c116007:::benchmark_data_smithi188_104537_object115189:head# 2024-04-01T19:36:19.567 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c116e25:::benchmark_data_smithi188_104537_object153763:head# 2024-04-01T19:36:19.567 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c11b03b:::benchmark_data_smithi188_104537_object56210:head# 2024-04-01T19:36:19.567 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c12489d:::benchmark_data_smithi188_104537_object80321:head# 2024-04-01T19:36:19.568 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c12db57:::benchmark_data_smithi188_104537_object11359:head# 2024-04-01T19:36:19.568 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c12ef6c:::benchmark_data_smithi188_104537_object124499:head# 2024-04-01T19:36:19.569 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c132489:::benchmark_data_smithi188_104537_object22351:head# 2024-04-01T19:36:19.569 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c136a4b:::benchmark_data_smithi188_104537_object97645:head# 2024-04-01T19:36:19.570 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c137e84:::benchmark_data_smithi188_104537_object80206:head# 2024-04-01T19:36:19.570 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c13845c:::benchmark_data_smithi188_104537_object90206:head# 2024-04-01T19:36:19.571 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c13a34d:::benchmark_data_smithi188_104537_object125237:head# 2024-04-01T19:36:19.571 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c140606:::benchmark_data_smithi188_104537_object140779:head# 2024-04-01T19:36:19.572 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c14b023:::benchmark_data_smithi188_104537_object28849:head# 2024-04-01T19:36:19.572 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c15d743:::benchmark_data_smithi188_104537_object72944:head# 2024-04-01T19:36:19.573 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c1648dd:::benchmark_data_smithi188_104537_object151555:head# 2024-04-01T19:36:19.573 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c16c193:::benchmark_data_smithi188_104537_object62589:head# 2024-04-01T19:36:19.574 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c17b988:::benchmark_data_smithi188_104537_object19368:head# 2024-04-01T19:36:19.574 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c1822fa:::benchmark_data_smithi188_104537_object113284:head# 2024-04-01T19:36:19.575 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c18703c:::benchmark_data_smithi188_104537_object97303:head# 2024-04-01T19:36:19.575 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c18a249:::benchmark_data_smithi188_104537_object42847:head# 2024-04-01T19:36:19.576 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c1916b5:::benchmark_data_smithi188_104537_object85797:head# 2024-04-01T19:36:19.576 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c19262d:::benchmark_data_smithi188_104537_object89090:head# 2024-04-01T19:36:19.577 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c1ae54c:::benchmark_data_smithi188_104537_object26660:head# 2024-04-01T19:36:19.577 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c1b2c83:::benchmark_data_smithi188_104537_object141365:head# 2024-04-01T19:36:19.577 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c1b8240:::benchmark_data_smithi188_104537_object102056:head# 2024-04-01T19:36:19.578 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c1b87db:::benchmark_data_smithi188_104537_object103395:head# 2024-04-01T19:36:19.578 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c1bbec2:::benchmark_data_smithi188_104537_object38173:head# 2024-04-01T19:36:19.579 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c1bc2c6:::benchmark_data_smithi188_104537_object156739:head# 2024-04-01T19:36:19.579 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c1c10fa:::benchmark_data_smithi188_104537_object100559:head# 2024-04-01T19:36:19.580 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c1c2390:::benchmark_data_smithi188_104537_object120001:head# 2024-04-01T19:36:19.580 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c1c4ae1:::benchmark_data_smithi188_104537_object120344:head# 2024-04-01T19:36:19.581 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c1cbf7f:::benchmark_data_smithi188_104537_object60153:head# 2024-04-01T19:36:19.582 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c1cd27f:::benchmark_data_smithi188_104537_object29962:head# 2024-04-01T19:36:19.582 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c1d0217:::benchmark_data_smithi188_104537_object91704:head# 2024-04-01T19:36:19.583 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c1d8107:::benchmark_data_smithi188_104537_object95957:head# 2024-04-01T19:36:19.583 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c1dc3df:::benchmark_data_smithi188_104537_object38154:head# 2024-04-01T19:36:19.584 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c1e1e9c:::benchmark_data_smithi188_104537_object83637:head# 2024-04-01T19:36:19.584 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c1e4819:::benchmark_data_smithi188_104537_object47458:head# 2024-04-01T19:36:19.585 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c1e4dc3:::benchmark_data_smithi188_104537_object95430:head# 2024-04-01T19:36:19.585 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c1eb322:::benchmark_data_smithi188_104537_object128164:head# 2024-04-01T19:36:19.586 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c208d58:::benchmark_data_smithi188_104537_object11921:head# 2024-04-01T19:36:19.586 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c20f869:::benchmark_data_smithi188_104537_object16194:head# 2024-04-01T19:36:19.587 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c213b09:::benchmark_data_smithi188_104537_object30360:head# 2024-04-01T19:36:19.587 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c216de0:::benchmark_data_smithi188_104537_object105292:head# 2024-04-01T19:36:19.587 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c21d275:::benchmark_data_smithi188_104537_object111285:head# 2024-04-01T19:36:19.588 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c225241:::benchmark_data_smithi188_104537_object157681:head# 2024-04-01T19:36:19.588 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c23d1e3:::benchmark_data_smithi188_104537_object105128:head# 2024-04-01T19:36:19.589 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c251acc:::benchmark_data_smithi188_104537_object51345:head# 2024-04-01T19:36:19.590 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c251f3a:::benchmark_data_smithi188_104537_object105461:head# 2024-04-01T19:36:19.590 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c25ab4e:::benchmark_data_smithi188_104537_object56215:head# 2024-04-01T19:36:19.590 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c25b9cc:::benchmark_data_smithi188_104537_object78239:head# 2024-04-01T19:36:19.591 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c2693e0:::benchmark_data_smithi188_104537_object168598:head# 2024-04-01T19:36:19.591 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c26f4b8:::benchmark_data_smithi188_104537_object112697:head# 2024-04-01T19:36:19.592 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c278254:::benchmark_data_smithi188_104537_object124368:head# 2024-04-01T19:36:19.593 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c279cd4:::benchmark_data_smithi188_104537_object119909:head# 2024-04-01T19:36:19.593 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c27f14a:::benchmark_data_smithi188_104537_object58634:head# 2024-04-01T19:36:19.594 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c283f47:::benchmark_data_smithi188_104537_object72941:head# 2024-04-01T19:36:19.595 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c288b5c:::benchmark_data_smithi188_104537_object106081:head# 2024-04-01T19:36:19.595 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c28ec58:::benchmark_data_smithi188_104537_object47068:head# 2024-04-01T19:36:19.596 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c298213:::benchmark_data_smithi188_104537_object148283:head# 2024-04-01T19:36:19.596 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c29de5b:::benchmark_data_smithi188_104537_object113363:head# 2024-04-01T19:36:19.597 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c29f1e2:::benchmark_data_smithi188_104537_object67034:head# 2024-04-01T19:36:19.597 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c2aeb7d:::benchmark_data_smithi188_104537_object154462:head# 2024-04-01T19:36:19.597 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c2bdb43:::benchmark_data_smithi188_104537_object63621:head# 2024-04-01T19:36:19.598 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c2be58e:::benchmark_data_smithi188_104537_object155627:head# 2024-04-01T19:36:19.598 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c2beb8b:::benchmark_data_smithi188_104537_object92444:head# 2024-04-01T19:36:19.599 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c2bed89:::benchmark_data_smithi188_104537_object27954:head# 2024-04-01T19:36:19.599 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c2c661a:::benchmark_data_smithi188_104537_object18871:head# 2024-04-01T19:36:19.599 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c2ceac6:::benchmark_data_smithi188_104537_object143269:head# 2024-04-01T19:36:19.600 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c2d66e7:::benchmark_data_smithi188_104537_object66968:head# 2024-04-01T19:36:19.600 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c2da4de:::benchmark_data_smithi188_104537_object74694:head# 2024-04-01T19:36:19.601 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c2da8a0:::benchmark_data_smithi188_104537_object105166:head# 2024-04-01T19:36:19.601 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c2df536:::benchmark_data_smithi188_104537_object141093:head# 2024-04-01T19:36:19.602 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c2e2295:::benchmark_data_smithi188_104537_object90033:head# 2024-04-01T19:36:19.602 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c2e66a6:::benchmark_data_smithi188_104537_object30441:head# 2024-04-01T19:36:19.602 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c2e684d:::benchmark_data_smithi188_104537_object127454:head# 2024-04-01T19:36:19.603 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c2ecbe4:::benchmark_data_smithi188_104537_object70446:head# 2024-04-01T19:36:19.604 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c2fa8f3:::benchmark_data_smithi188_104537_object72142:head# 2024-04-01T19:36:19.604 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c30c1b6:::benchmark_data_smithi188_104537_object134121:head# 2024-04-01T19:36:19.605 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c310eca:::benchmark_data_smithi188_104537_object47493:head# 2024-04-01T19:36:19.605 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c31461d:::benchmark_data_smithi188_104537_object149408:head# 2024-04-01T19:36:19.606 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c317370:::benchmark_data_smithi188_104537_object104296:head# 2024-04-01T19:36:19.606 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c31ff95:::benchmark_data_smithi188_104537_object93599:head# 2024-04-01T19:36:19.607 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c32456b:::benchmark_data_smithi188_104537_object83485:head# 2024-04-01T19:36:19.607 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c32a55d:::benchmark_data_smithi188_104537_object12791:head# 2024-04-01T19:36:19.607 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c32c57b:::benchmark_data_smithi188_104537_object141018:head# 2024-04-01T19:36:19.608 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c334b4b:::benchmark_data_smithi188_104537_object116800:head# 2024-04-01T19:36:19.608 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c337dea:::benchmark_data_smithi188_104537_object109670:head# 2024-04-01T19:36:19.609 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c34f9e7:::benchmark_data_smithi188_104537_object137296:head# 2024-04-01T19:36:19.609 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c356e21:::benchmark_data_smithi188_104537_object18694:head# 2024-04-01T19:36:19.610 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c357c01:::benchmark_data_smithi188_104537_object55400:head# 2024-04-01T19:36:19.610 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c35903d:::benchmark_data_smithi188_104537_object160875:head# 2024-04-01T19:36:19.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c35e560:::benchmark_data_smithi188_104537_object130405:head# 2024-04-01T19:36:19.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c361f7a:::benchmark_data_smithi188_104537_object98818:head# 2024-04-01T19:36:19.612 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c363196:::benchmark_data_smithi188_104537_object134989:head# 2024-04-01T19:36:19.612 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c36520a:::benchmark_data_smithi188_104537_object152310:head# 2024-04-01T19:36:19.613 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c36f642:::benchmark_data_smithi188_104537_object85233:head# 2024-04-01T19:36:19.613 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c381210:::benchmark_data_smithi188_104537_object128541:head# 2024-04-01T19:36:19.614 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c381feb:::benchmark_data_smithi188_104537_object128942:head# 2024-04-01T19:36:19.614 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c395215:::benchmark_data_smithi188_104537_object144303:head# 2024-04-01T19:36:19.614 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c39cbe5:::benchmark_data_smithi188_104537_object56957:head# 2024-04-01T19:36:19.615 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c3a30f6:::benchmark_data_smithi188_104537_object35390:head# 2024-04-01T19:36:19.615 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c3a70fe:::benchmark_data_smithi188_104537_object151923:head# 2024-04-01T19:36:19.615 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c3ae17b:::benchmark_data_smithi188_104537_object24100:head# 2024-04-01T19:36:19.616 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c3ae5d1:::benchmark_data_smithi188_104537_object127252:head# 2024-04-01T19:36:19.617 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c3b00a7:::benchmark_data_smithi188_104537_object110370:head# 2024-04-01T19:36:19.617 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c3b3ace:::benchmark_data_smithi188_104537_object108323:head# 2024-04-01T19:36:19.617 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c3bb2a1:::benchmark_data_smithi188_104537_object105427:head# 2024-04-01T19:36:19.618 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c3c1f6c:::benchmark_data_smithi188_104537_object27704:head# 2024-04-01T19:36:19.619 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c3c5074:::benchmark_data_smithi188_104537_object143029:head# 2024-04-01T19:36:19.619 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c3c57de:::benchmark_data_smithi188_104537_object106698:head# 2024-04-01T19:36:19.619 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c3c5d82:::benchmark_data_smithi188_104537_object26614:head# 2024-04-01T19:36:19.620 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c3e8561:::benchmark_data_smithi188_104537_object30416:head# 2024-04-01T19:36:19.622 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c3ec9e4:::benchmark_data_smithi188_104537_object145732:head# 2024-04-01T19:36:19.622 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c3ee6cb:::benchmark_data_smithi188_104537_object18798:head# 2024-04-01T19:36:19.622 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c3f9118:::benchmark_data_smithi188_104537_object133523:head# 2024-04-01T19:36:19.622 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c3f9675:::benchmark_data_smithi188_104537_object71484:head# 2024-04-01T19:36:19.622 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c401872:::benchmark_data_smithi188_104537_object65360:head# 2024-04-01T19:36:19.623 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c404ea0:::benchmark_data_smithi188_104537_object68223:head# 2024-04-01T19:36:19.623 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c40d124:::benchmark_data_smithi188_104537_object89747:head# 2024-04-01T19:36:19.623 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c411fd4:::benchmark_data_smithi188_104537_object158448:head# 2024-04-01T19:36:19.623 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c41bb2e:::benchmark_data_smithi188_104537_object28794:head# 2024-04-01T19:36:19.624 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c42891f:::benchmark_data_smithi188_104537_object108449:head# 2024-04-01T19:36:19.624 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c42aed4:::benchmark_data_smithi188_104537_object29864:head# 2024-04-01T19:36:19.625 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c438c47:::benchmark_data_smithi188_104537_object153366:head# 2024-04-01T19:36:19.625 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c43f370:::benchmark_data_smithi188_104537_object56962:head# 2024-04-01T19:36:19.625 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c43f47e:::benchmark_data_smithi188_104537_object113491:head# 2024-04-01T19:36:19.626 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c449c12:::benchmark_data_smithi188_104537_object83430:head# 2024-04-01T19:36:19.626 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c457a1d:::benchmark_data_smithi188_104537_object73101:head# 2024-04-01T19:36:19.627 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c4591a7:::benchmark_data_smithi188_104537_object138940:head# 2024-04-01T19:36:19.627 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c47bfcf:::benchmark_data_smithi188_104537_object86304:head# 2024-04-01T19:36:19.627 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c47fce1:::benchmark_data_smithi188_104537_object34599:head# 2024-04-01T19:36:19.628 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c48de61:::benchmark_data_smithi188_104537_object53655:head# 2024-04-01T19:36:19.629 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c494687:::benchmark_data_smithi188_104537_object163877:head# 2024-04-01T19:36:19.629 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c4950b6:::benchmark_data_smithi188_104537_object91561:head# 2024-04-01T19:36:19.629 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c49520e:::benchmark_data_smithi188_104537_object30325:head# 2024-04-01T19:36:19.630 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c4957a4:::benchmark_data_smithi188_104537_object31577:head# 2024-04-01T19:36:19.630 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c497305:::benchmark_data_smithi188_104537_object163808:head# 2024-04-01T19:36:19.631 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c49ad08:::benchmark_data_smithi188_104537_object110767:head# 2024-04-01T19:36:19.631 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c4a9898:::benchmark_data_smithi188_104537_object46090:head# 2024-04-01T19:36:19.632 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c4b2401:::benchmark_data_smithi188_104537_object87652:head# 2024-04-01T19:36:19.632 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c4b4d9f:::benchmark_data_smithi188_104537_object101978:head# 2024-04-01T19:36:19.633 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c4c0870:::benchmark_data_smithi188_104537_object124415:head# 2024-04-01T19:36:19.633 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c4c8a52:::benchmark_data_smithi188_104537_object142292:head# 2024-04-01T19:36:19.633 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c4d3819:::benchmark_data_smithi188_104537_object78893:head# 2024-04-01T19:36:19.634 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c4e46fc:::benchmark_data_smithi188_104537_object20553:head# 2024-04-01T19:36:19.634 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c4ebc4a:::benchmark_data_smithi188_104537_object33705:head# 2024-04-01T19:36:19.636 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c4f7e5d:::benchmark_data_smithi188_104537_object136326:head# 2024-04-01T19:36:19.636 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c502877:::benchmark_data_smithi188_104537_object32962:head# 2024-04-01T19:36:19.636 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c506d62:::benchmark_data_smithi188_104537_object30934:head# 2024-04-01T19:36:19.637 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c51426c:::benchmark_data_smithi188_104537_object104352:head# 2024-04-01T19:36:19.637 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c518e43:::benchmark_data_smithi188_104537_object12419:head# 2024-04-01T19:36:19.638 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c52d5f2:::benchmark_data_smithi188_104537_object115802:head# 2024-04-01T19:36:19.638 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c53e97b:::benchmark_data_smithi188_104537_object21347:head# 2024-04-01T19:36:19.638 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c53f797:::benchmark_data_smithi188_104537_object111528:head# 2024-04-01T19:36:19.639 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c54076f:::benchmark_data_smithi188_104537_object44607:head# 2024-04-01T19:36:19.639 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c54a842:::benchmark_data_smithi188_104537_object117294:head# 2024-04-01T19:36:19.640 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c54a973:::benchmark_data_smithi188_104537_object143118:head# 2024-04-01T19:36:19.641 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c54d607:::benchmark_data_smithi188_104537_object44720:head# 2024-04-01T19:36:19.641 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c55b9fe:::benchmark_data_smithi188_104537_object94778:head# 2024-04-01T19:36:19.641 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c56b24d:::benchmark_data_smithi188_104537_object149806:head# 2024-04-01T19:36:19.642 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c56e29a:::benchmark_data_smithi188_104537_object131225:head# 2024-04-01T19:36:19.642 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c574e34:::benchmark_data_smithi188_104537_object44123:head# 2024-04-01T19:36:19.643 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c57c666:::benchmark_data_smithi188_104537_object127346:head# 2024-04-01T19:36:19.643 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c57f2f8:::benchmark_data_smithi188_104537_object84962:head# 2024-04-01T19:36:19.644 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c582978:::benchmark_data_smithi188_104537_object150916:head# 2024-04-01T19:36:19.644 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c585261:::benchmark_data_smithi188_104537_object57014:head# 2024-04-01T19:36:19.645 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c58fd8b:::benchmark_data_smithi188_104537_object161664:head# 2024-04-01T19:36:19.645 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c595c8b:::benchmark_data_smithi188_104537_object11591:head# 2024-04-01T19:36:19.645 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c5a1c61:::benchmark_data_smithi188_104537_object170476:head# 2024-04-01T19:36:19.646 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c5abdcf:::benchmark_data_smithi188_104537_object86035:head# 2024-04-01T19:36:19.646 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c5b3b41:::benchmark_data_smithi188_104537_object159579:head# 2024-04-01T19:36:19.647 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c5b666f:::benchmark_data_smithi188_104537_object132173:head# 2024-04-01T19:36:19.647 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c5d65e8:::benchmark_data_smithi188_104537_object120930:head# 2024-04-01T19:36:19.648 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c5d72b1:::benchmark_data_smithi188_104537_object152705:head# 2024-04-01T19:36:19.648 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c5dd7c2:::benchmark_data_smithi188_104537_object54079:head# 2024-04-01T19:36:19.649 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c5e3368:::benchmark_data_smithi188_104537_object153965:head# 2024-04-01T19:36:19.649 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c603ba7:::benchmark_data_smithi188_104537_object90565:head# 2024-04-01T19:36:19.649 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c6157c8:::benchmark_data_smithi188_104537_object115725:head# 2024-04-01T19:36:19.650 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c6162ea:::benchmark_data_smithi188_104537_object50119:head# 2024-04-01T19:36:19.650 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c61be6b:::benchmark_data_smithi188_104537_object37131:head# 2024-04-01T19:36:19.651 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c6206cb:::benchmark_data_smithi188_104537_object71217:head# 2024-04-01T19:36:19.651 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c620ac5:::benchmark_data_smithi188_104537_object89972:head# 2024-04-01T19:36:19.652 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c62b9b6:::benchmark_data_smithi188_104537_object94497:head# 2024-04-01T19:36:19.652 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c63f22e:::benchmark_data_smithi188_104537_object169263:head# 2024-04-01T19:36:19.653 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c643062:::benchmark_data_smithi188_104537_object139972:head# 2024-04-01T19:36:19.653 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c651428:::benchmark_data_smithi188_104537_object15623:head# 2024-04-01T19:36:19.654 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c654e17:::benchmark_data_smithi188_104537_object141867:head# 2024-04-01T19:36:19.654 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c6560fb:::benchmark_data_smithi188_104537_object49906:head# 2024-04-01T19:36:19.655 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c65ba9e:::benchmark_data_smithi188_104537_object39340:head# 2024-04-01T19:36:19.655 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c66eae8:::benchmark_data_smithi188_104537_object54188:head# 2024-04-01T19:36:19.656 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c67baa0:::benchmark_data_smithi188_104537_object162050:head# 2024-04-01T19:36:19.656 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c67d154:::benchmark_data_smithi188_104537_object122078:head# 2024-04-01T19:36:19.656 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c67fc30:::benchmark_data_smithi188_104537_object85042:head# 2024-04-01T19:36:19.657 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c683175:::benchmark_data_smithi188_104537_object40690:head# 2024-04-01T19:36:19.657 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c6865d9:::benchmark_data_smithi188_104537_object33810:head# 2024-04-01T19:36:19.658 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c68ab12:::benchmark_data_smithi188_104537_object156769:head# 2024-04-01T19:36:19.658 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c68e8db:::benchmark_data_smithi188_104537_object71878:head# 2024-04-01T19:36:19.658 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c69b137:::benchmark_data_smithi188_104537_object105656:head# 2024-04-01T19:36:19.659 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c6b00d7:::benchmark_data_smithi188_104537_object37805:head# 2024-04-01T19:36:19.660 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c6b939d:::benchmark_data_smithi188_104537_object39298:head# 2024-04-01T19:36:19.660 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c6bbf12:::benchmark_data_smithi188_104537_object28676:head# 2024-04-01T19:36:19.661 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c6d1b8a:::benchmark_data_smithi188_104537_object89548:head# 2024-04-01T19:36:19.661 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c6d1c12:::benchmark_data_smithi188_104537_object33055:head# 2024-04-01T19:36:19.662 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c6d71cb:::benchmark_data_smithi188_104537_object103180:head# 2024-04-01T19:36:19.662 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c6e8686:::benchmark_data_smithi188_104537_object164829:head# 2024-04-01T19:36:19.663 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c6ead35:::benchmark_data_smithi188_104537_object126799:head# 2024-04-01T19:36:19.663 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c6ec863:::benchmark_data_smithi188_104537_object163414:head# 2024-04-01T19:36:19.664 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c6f0cf0:::benchmark_data_smithi188_104537_object72947:head# 2024-04-01T19:36:19.665 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c6f49be:::benchmark_data_smithi188_104537_object124954:head# 2024-04-01T19:36:19.665 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c6fb1be:::benchmark_data_smithi188_104537_object101873:head# 2024-04-01T19:36:19.665 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c6fcf5f:::benchmark_data_smithi188_104537_object12476:head# 2024-04-01T19:36:19.666 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c709919:::benchmark_data_smithi188_104537_object46603:head# 2024-04-01T19:36:19.666 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c71d2ef:::benchmark_data_smithi188_104537_object136186:head# 2024-04-01T19:36:19.666 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c726a13:::benchmark_data_smithi188_104537_object84172:head# 2024-04-01T19:36:19.667 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c728ae1:::benchmark_data_smithi188_104537_object146748:head# 2024-04-01T19:36:19.668 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c72da24:::benchmark_data_smithi188_104537_object92367:head# 2024-04-01T19:36:19.668 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c731927:::benchmark_data_smithi188_104537_object146924:head# 2024-04-01T19:36:19.668 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:36:19.669 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c7395f0:::benchmark_data_smithi188_104537_object147748:head# 2024-04-01T19:36:19.670 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c7398ef:::benchmark_data_smithi188_104537_object142892:head# 2024-04-01T19:36:19.670 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c739b63:::benchmark_data_smithi188_104537_object135946:head# 2024-04-01T19:36:19.670 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c7442aa:::benchmark_data_smithi188_104537_object117395:head# 2024-04-01T19:36:19.671 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c74bd67:::benchmark_data_smithi188_104537_object11329:head# 2024-04-01T19:36:19.671 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c7549a0:::benchmark_data_smithi188_104537_object15367:head# 2024-04-01T19:36:19.671 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c75c84c:::benchmark_data_smithi188_104537_object37818:head# 2024-04-01T19:36:19.672 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c75de73:::benchmark_data_smithi188_104537_object95174:head# 2024-04-01T19:36:19.672 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c764f73:::benchmark_data_smithi188_104537_object107904:head# 2024-04-01T19:36:19.673 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c76b5b0:::benchmark_data_smithi188_104537_object48836:head# 2024-04-01T19:36:19.673 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:19.674 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:36:19.675 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c76d5a8:::benchmark_data_smithi188_104537_object138062:head# 2024-04-01T19:36:19.675 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c78cdcf:::benchmark_data_smithi188_104537_object82474:head# 2024-04-01T19:36:19.675 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c796afa:::benchmark_data_smithi188_104537_object74010:head# 2024-04-01T19:36:19.675 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c79b941:::benchmark_data_smithi188_104537_object51061:head# 2024-04-01T19:36:19.675 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c79fe73:::benchmark_data_smithi188_104537_object48353:head# 2024-04-01T19:36:19.676 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c7a3fa8:::benchmark_data_smithi188_104537_object14200:head# 2024-04-01T19:36:19.676 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c7a5921:::benchmark_data_smithi188_104537_object59919:head# 2024-04-01T19:36:19.677 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c7a7ab7:::benchmark_data_smithi188_104537_object137942:head# 2024-04-01T19:36:19.677 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c7a81a5:::benchmark_data_smithi188_104537_object112378:head# 2024-04-01T19:36:19.677 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c7a90b2:::benchmark_data_smithi188_104537_object20777:head# 2024-04-01T19:36:19.678 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c7abf40:::benchmark_data_smithi188_104537_object110150:head# 2024-04-01T19:36:19.678 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c7b1ac6:::benchmark_data_smithi188_104537_object24129:head# 2024-04-01T19:36:19.679 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c7b9c15:::benchmark_data_smithi188_104537_object111613:head# 2024-04-01T19:36:19.680 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c7bba47:::benchmark_data_smithi188_104537_object90686:head# 2024-04-01T19:36:19.680 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c7be7e7:::benchmark_data_smithi188_104537_object18081:head# 2024-04-01T19:36:19.680 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c7bf797:::benchmark_data_smithi188_104537_object137504:head# 2024-04-01T19:36:19.681 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c7cc7e6:::benchmark_data_smithi188_104537_object122641:head# 2024-04-01T19:36:19.681 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c7ed275:::benchmark_data_smithi188_104537_object28846:head# 2024-04-01T19:36:19.682 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c7f7f54:::benchmark_data_smithi188_104537_object83418:head# 2024-04-01T19:36:19.682 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c808aa9:::benchmark_data_smithi188_104537_object98729:head# 2024-04-01T19:36:19.682 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c810669:::benchmark_data_smithi188_104537_object35331:head# 2024-04-01T19:36:19.683 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c8108f4:::benchmark_data_smithi188_104537_object123199:head# 2024-04-01T19:36:19.683 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c812bd8:::benchmark_data_smithi188_104537_object47757:head# 2024-04-01T19:36:19.684 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c817e95:::benchmark_data_smithi188_104537_object12478:head# 2024-04-01T19:36:19.685 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c83130e:::benchmark_data_smithi188_104537_object56552:head# 2024-04-01T19:36:19.685 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c8318d7:::benchmark_data_smithi188_104537_object153039:head# 2024-04-01T19:36:19.685 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c856b29:::benchmark_data_smithi188_104537_object80021:head# 2024-04-01T19:36:19.686 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c8590f1:::benchmark_data_smithi188_104537_object65726:head# 2024-04-01T19:36:19.686 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c865670:::benchmark_data_smithi188_104537_object82270:head# 2024-04-01T19:36:19.687 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c87031f:::benchmark_data_smithi188_104537_object92488:head# 2024-04-01T19:36:19.687 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c87c90b:::benchmark_data_smithi188_104537_object116546:head# 2024-04-01T19:36:19.687 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c87dc48:::benchmark_data_smithi188_104537_object110580:head# 2024-04-01T19:36:19.688 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c87edc8:::benchmark_data_smithi188_104537_object150469:head# 2024-04-01T19:36:19.688 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c8a6d58:::benchmark_data_smithi188_104537_object19614:head# 2024-04-01T19:36:19.688 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c8a8f58:::benchmark_data_smithi188_104537_object92718:head# 2024-04-01T19:36:19.689 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c8b9591:::benchmark_data_smithi188_104537_object136278:head# 2024-04-01T19:36:19.689 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c8daab7:::benchmark_data_smithi188_104537_object101668:head# 2024-04-01T19:36:19.691 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c8dbdc3:::benchmark_data_smithi188_104537_object158968:head# 2024-04-01T19:36:19.691 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c8e2687:::benchmark_data_smithi188_104537_object131514:head# 2024-04-01T19:36:19.691 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c8ef140:::benchmark_data_smithi188_104537_object171125:head# 2024-04-01T19:36:19.692 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c8ef46e:::benchmark_data_smithi188_104537_object82303:head# 2024-04-01T19:36:19.692 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c8f8996:::benchmark_data_smithi188_104537_object119298:head# 2024-04-01T19:36:19.692 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c904be7:::benchmark_data_smithi188_104537_object153400:head# 2024-04-01T19:36:19.692 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c912299:::benchmark_data_smithi188_104537_object146767:head# 2024-04-01T19:36:19.693 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c91ad35:::benchmark_data_smithi188_104537_object141692:head# 2024-04-01T19:36:19.693 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c921739:::benchmark_data_smithi188_104537_object128842:head# 2024-04-01T19:36:19.694 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c925a71:::benchmark_data_smithi188_104537_object48579:head# 2024-04-01T19:36:19.694 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c92d3c4:::benchmark_data_smithi188_104537_object135734:head# 2024-04-01T19:36:19.695 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c934c8e:::benchmark_data_smithi188_104537_object126778:head# 2024-04-01T19:36:19.695 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c938731:::benchmark_data_smithi188_104537_object72950:head# 2024-04-01T19:36:19.696 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c9433c7:::benchmark_data_smithi188_104537_object115597:head# 2024-04-01T19:36:19.696 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c94ddb1:::benchmark_data_smithi188_104537_object167311:head# 2024-04-01T19:36:19.697 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c94e185:::benchmark_data_smithi188_104537_object23081:head# 2024-04-01T19:36:19.697 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c94e741:::benchmark_data_smithi188_104537_object130260:head# 2024-04-01T19:36:19.697 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c95adf3:::benchmark_data_smithi188_104537_object99389:head# 2024-04-01T19:36:19.698 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c9642d8:::benchmark_data_smithi188_104537_object128015:head# 2024-04-01T19:36:19.698 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c96560c:::benchmark_data_smithi188_104537_object75938:head# 2024-04-01T19:36:19.699 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c966396:::benchmark_data_smithi188_104537_object135778:head# 2024-04-01T19:36:19.699 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c969f60:::benchmark_data_smithi188_104537_object72081:head# 2024-04-01T19:36:19.700 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c96ca58:::benchmark_data_smithi188_104537_object158286:head# 2024-04-01T19:36:19.700 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c978fb1:::benchmark_data_smithi188_104537_object52975:head# 2024-04-01T19:36:19.700 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c97c27b:::benchmark_data_smithi188_104537_object34273:head# 2024-04-01T19:36:19.701 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c989391:::benchmark_data_smithi188_104537_object157079:head# 2024-04-01T19:36:19.702 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c98c631:::benchmark_data_smithi188_104537_object115588:head# 2024-04-01T19:36:19.702 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c98c928:::benchmark_data_smithi188_104537_object36026:head# 2024-04-01T19:36:19.702 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c99572b:::benchmark_data_smithi188_104537_object67127:head# 2024-04-01T19:36:19.703 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c996f59:::benchmark_data_smithi188_104537_object42927:head# 2024-04-01T19:36:19.704 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c9a1e70:::benchmark_data_smithi188_104537_object137137:head# 2024-04-01T19:36:19.704 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c9a938d:::benchmark_data_smithi188_104537_object66378:head# 2024-04-01T19:36:19.704 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c9b47da:::benchmark_data_smithi188_104537_object38345:head# 2024-04-01T19:36:19.705 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c9b8ee9:::benchmark_data_smithi188_104537_object129918:head# 2024-04-01T19:36:19.705 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c9bf01d:::benchmark_data_smithi188_104537_object21062:head# 2024-04-01T19:36:19.706 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c9bfbf5:::benchmark_data_smithi188_104537_object51644:head# 2024-04-01T19:36:19.706 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c9c5eb0:::benchmark_data_smithi188_104537_object137623:head# 2024-04-01T19:36:19.707 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c9c859b:::benchmark_data_smithi188_104537_object145678:head# 2024-04-01T19:36:19.707 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c9cbeb6:::benchmark_data_smithi188_104537_object118794:head# 2024-04-01T19:36:19.708 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c9d6e5a:::benchmark_data_smithi188_104537_object60283:head# 2024-04-01T19:36:19.708 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c9d9290:::benchmark_data_smithi188_104537_object20111:head# 2024-04-01T19:36:19.709 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c9da88f:::benchmark_data_smithi188_104537_object50919:head# 2024-04-01T19:36:19.709 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c9deeca:::benchmark_data_smithi188_104537_object43469:head# 2024-04-01T19:36:19.710 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c9df6c8:::benchmark_data_smithi188_104537_object118562:head# 2024-04-01T19:36:19.710 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c9f0e13:::benchmark_data_smithi188_104537_object122925:head# 2024-04-01T19:36:19.710 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c9f95f4:::benchmark_data_smithi188_104537_object119058:head# 2024-04-01T19:36:19.710 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c9fd7cd:::benchmark_data_smithi188_104537_object120801:head# 2024-04-01T19:36:19.711 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5c9ff554:::benchmark_data_smithi188_104537_object29554:head# 2024-04-01T19:36:19.712 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca0d695:::benchmark_data_smithi188_104537_object87889:head# 2024-04-01T19:36:19.712 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca0e8f0:::benchmark_data_smithi188_104537_object63827:head# 2024-04-01T19:36:19.713 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca0fccf:::benchmark_data_smithi188_104537_object97860:head# 2024-04-01T19:36:19.713 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca12827:::benchmark_data_smithi188_104537_object49506:head# 2024-04-01T19:36:19.713 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca1d0f4:::benchmark_data_smithi188_104537_object134396:head# 2024-04-01T19:36:19.713 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca2d50d:::benchmark_data_smithi188_104537_object158728:head# 2024-04-01T19:36:19.715 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca2d598:::benchmark_data_smithi188_104537_object122130:head# 2024-04-01T19:36:19.716 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca2f0b8:::benchmark_data_smithi188_104537_object99188:head# 2024-04-01T19:36:19.716 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca306fa:::benchmark_data_smithi188_104537_object51876:head# 2024-04-01T19:36:19.716 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca3985d:::benchmark_data_smithi188_104537_object35049:head# 2024-04-01T19:36:19.716 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca42813:::benchmark_data_smithi188_104537_object76107:head# 2024-04-01T19:36:19.716 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca4b9ff:::benchmark_data_smithi188_104537_object134053:head# 2024-04-01T19:36:19.717 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca4dd2b:::benchmark_data_smithi188_104537_object134002:head# 2024-04-01T19:36:19.718 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca5cc48:::benchmark_data_smithi188_104537_object45300:head# 2024-04-01T19:36:19.718 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca615ae:::benchmark_data_smithi188_104537_object140890:head# 2024-04-01T19:36:19.718 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca69c2e:::benchmark_data_smithi188_104537_object100734:head# 2024-04-01T19:36:19.718 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca6b511:::benchmark_data_smithi188_104537_object68998:head# 2024-04-01T19:36:19.720 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca6bcdd:::benchmark_data_smithi188_104537_object131847:head# 2024-04-01T19:36:19.720 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca71ba4:::benchmark_data_smithi188_104537_object149623:head# 2024-04-01T19:36:19.720 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca82db7:::benchmark_data_smithi188_104537_object116491:head# 2024-04-01T19:36:19.721 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca84531:::benchmark_data_smithi188_104537_object17282:head# 2024-04-01T19:36:19.721 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca85006:::benchmark_data_smithi188_104537_object102745:head# 2024-04-01T19:36:19.721 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca8eba3:::benchmark_data_smithi188_104537_object161783:head# 2024-04-01T19:36:19.721 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca9010a:::benchmark_data_smithi188_104537_object55585:head# 2024-04-01T19:36:19.722 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca94849:::benchmark_data_smithi188_104537_object162400:head# 2024-04-01T19:36:19.722 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca99d46:::benchmark_data_smithi188_104537_object156341:head# 2024-04-01T19:36:19.722 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca9b37f:::benchmark_data_smithi188_104537_object85927:head# 2024-04-01T19:36:19.723 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ca9f8ee:::benchmark_data_smithi188_104537_object35651:head# 2024-04-01T19:36:19.723 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5caa16f9:::benchmark_data_smithi188_104537_object57112:head# 2024-04-01T19:36:19.723 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5caa29f3:::benchmark_data_smithi188_104537_object132424:head# 2024-04-01T19:36:19.724 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5caa79c2:::benchmark_data_smithi188_104537_object24492:head# 2024-04-01T19:36:19.724 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cabc5ab:::benchmark_data_smithi188_104537_object17722:head# 2024-04-01T19:36:19.725 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cabe9d5:::benchmark_data_smithi188_104537_object119269:head# 2024-04-01T19:36:19.725 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cac253e:::benchmark_data_smithi188_104537_object71310:head# 2024-04-01T19:36:19.726 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cac2970:::benchmark_data_smithi188_104537_object68486:head# 2024-04-01T19:36:19.726 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cacfe08:::benchmark_data_smithi188_104537_object167137:head# 2024-04-01T19:36:19.726 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cad5c04:::benchmark_data_smithi188_104537_object36711:head# 2024-04-01T19:36:19.727 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cad6104:::benchmark_data_smithi188_104537_object46274:head# 2024-04-01T19:36:19.728 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cad6568:::benchmark_data_smithi188_104537_object70038:head# 2024-04-01T19:36:19.728 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cadb8ef:::benchmark_data_smithi188_104537_object88347:head# 2024-04-01T19:36:19.728 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cae0867:::benchmark_data_smithi188_104537_object32848:head# 2024-04-01T19:36:19.729 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cae82db:::benchmark_data_smithi188_104537_object119504:head# 2024-04-01T19:36:19.729 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5caf1ac0:::benchmark_data_smithi188_104537_object165826:head# 2024-04-01T19:36:19.729 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb01fe2:::benchmark_data_smithi188_104537_object135166:head# 2024-04-01T19:36:19.730 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb04209:::benchmark_data_smithi188_104537_object134758:head# 2024-04-01T19:36:19.730 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb05e31:::benchmark_data_smithi188_104537_object97907:head# 2024-04-01T19:36:19.731 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb0cc44:::benchmark_data_smithi188_104537_object36481:head# 2024-04-01T19:36:19.731 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb12bf7:::benchmark_data_smithi188_104537_object56277:head# 2024-04-01T19:36:19.732 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb12f60:::benchmark_data_smithi188_104537_object72631:head# 2024-04-01T19:36:19.732 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb141db:::benchmark_data_smithi188_104537_object26623:head# 2024-04-01T19:36:19.733 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb17ada:::benchmark_data_smithi188_104537_object85487:head# 2024-04-01T19:36:19.733 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb1a698:::benchmark_data_smithi188_104537_object69546:head# 2024-04-01T19:36:19.733 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb21086:::benchmark_data_smithi188_104537_object87444:head# 2024-04-01T19:36:19.734 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb29599:::benchmark_data_smithi188_104537_object73741:head# 2024-04-01T19:36:19.734 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb2f2d3:::benchmark_data_smithi188_104537_object125321:head# 2024-04-01T19:36:19.735 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb32e92:::benchmark_data_smithi188_104537_object11853:head# 2024-04-01T19:36:19.735 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb39400:::benchmark_data_smithi188_104537_object90957:head# 2024-04-01T19:36:19.736 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb3ee4b:::benchmark_data_smithi188_104537_object137095:head# 2024-04-01T19:36:19.736 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb43aa4:::benchmark_data_smithi188_104537_object128558:head# 2024-04-01T19:36:19.737 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb45a93:::benchmark_data_smithi188_104537_object88821:head# 2024-04-01T19:36:19.737 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb4c0ab:::benchmark_data_smithi188_104537_object47741:head# 2024-04-01T19:36:19.737 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb4c18e:::benchmark_data_smithi188_104537_object157517:head# 2024-04-01T19:36:19.738 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb5985d:::benchmark_data_smithi188_104537_object50748:head# 2024-04-01T19:36:19.738 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb5add9:::benchmark_data_smithi188_104537_object115091:head# 2024-04-01T19:36:19.739 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb5ffec:::benchmark_data_smithi188_104537_object165329:head# 2024-04-01T19:36:19.739 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb64663:::benchmark_data_smithi188_104537_object142861:head# 2024-04-01T19:36:19.740 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb666c7:::benchmark_data_smithi188_104537_object31200:head# 2024-04-01T19:36:19.740 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb6ae5b:::benchmark_data_smithi188_104537_object113825:head# 2024-04-01T19:36:19.741 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb6beae:::benchmark_data_smithi188_104537_object61515:head# 2024-04-01T19:36:19.741 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb6d26f:::benchmark_data_smithi188_104537_object86158:head# 2024-04-01T19:36:19.742 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb8277a:::benchmark_data_smithi188_104537_object118407:head# 2024-04-01T19:36:19.742 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb8a84a:::benchmark_data_smithi188_104537_object144067:head# 2024-04-01T19:36:19.742 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb8c453:::benchmark_data_smithi188_104537_object45774:head# 2024-04-01T19:36:19.743 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb8cd83:::benchmark_data_smithi188_104537_object129023:head# 2024-04-01T19:36:19.743 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb8dd16:::benchmark_data_smithi188_104537_object103917:head# 2024-04-01T19:36:19.743 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb91b55:::benchmark_data_smithi188_104537_object21479:head# 2024-04-01T19:36:19.745 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cb9548a:::benchmark_data_smithi188_104537_object135252:head# 2024-04-01T19:36:19.745 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cba413c:::benchmark_data_smithi188_104537_object21369:head# 2024-04-01T19:36:19.746 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cba8597:::benchmark_data_smithi188_104537_object74363:head# 2024-04-01T19:36:19.747 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cbadd39:::benchmark_data_smithi188_104537_object126094:head# 2024-04-01T19:36:19.747 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cbbbb65:::benchmark_data_smithi188_104537_object119830:head# 2024-04-01T19:36:19.748 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cbc3e79:::benchmark_data_smithi188_104537_object145084:head# 2024-04-01T19:36:19.748 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cbc5239:::benchmark_data_smithi188_104537_object101923:head# 2024-04-01T19:36:19.748 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cbc92b5:::benchmark_data_smithi188_104537_object33661:head# 2024-04-01T19:36:19.749 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cbca9b2:::benchmark_data_smithi188_104537_object120610:head# 2024-04-01T19:36:19.749 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cbd4251:::benchmark_data_smithi188_104537_object90356:head# 2024-04-01T19:36:19.750 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cbdc8bc:::benchmark_data_smithi188_104537_object107282:head# 2024-04-01T19:36:19.750 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cbe03c4:::benchmark_data_smithi188_104537_object151095:head# 2024-04-01T19:36:19.751 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cbe1455:::benchmark_data_smithi188_104537_object58352:head# 2024-04-01T19:36:19.751 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cbe5890:::benchmark_data_smithi188_104537_object149386:head# 2024-04-01T19:36:19.751 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cbe64fd:::benchmark_data_smithi188_104537_object64813:head# 2024-04-01T19:36:19.752 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cbf2b36:::benchmark_data_smithi188_104537_object147378:head# 2024-04-01T19:36:19.752 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cbf6c45:::benchmark_data_smithi188_104537_object130461:head# 2024-04-01T19:36:19.752 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cbf9a2a:::benchmark_data_smithi188_104537_object100988:head# 2024-04-01T19:36:19.753 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cbfaffa:::benchmark_data_smithi188_104537_object67064:head# 2024-04-01T19:36:19.753 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cbfc337:::benchmark_data_smithi188_104537_object102190:head# 2024-04-01T19:36:19.753 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cbfd380:::benchmark_data_smithi188_104537_object158044:head# 2024-04-01T19:36:19.754 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc00d48:::benchmark_data_smithi188_104537_object54652:head# 2024-04-01T19:36:19.754 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc00f1f:::benchmark_data_smithi188_104537_object27095:head# 2024-04-01T19:36:19.757 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc02db7:::benchmark_data_smithi188_104537_object148608:head# 2024-04-01T19:36:19.757 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc0978f:::benchmark_data_smithi188_104537_object123896:head# 2024-04-01T19:36:19.757 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc0d423:::benchmark_data_smithi188_104537_object21264:head# 2024-04-01T19:36:19.757 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc1b324:::benchmark_data_smithi188_104537_object26752:head# 2024-04-01T19:36:19.757 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc1cfe7:::benchmark_data_smithi188_104537_object19930:head# 2024-04-01T19:36:19.758 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc22f15:::benchmark_data_smithi188_104537_object51974:head# 2024-04-01T19:36:19.758 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc2bd54:::benchmark_data_smithi188_104537_object166082:head# 2024-04-01T19:36:19.758 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc35131:::benchmark_data_smithi188_104537_object78171:head# 2024-04-01T19:36:19.758 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc365d4:::benchmark_data_smithi188_104537_object155938:head# 2024-04-01T19:36:19.759 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc36d2e:::benchmark_data_smithi188_104537_object98326:head# 2024-04-01T19:36:19.759 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc3bffa:::benchmark_data_smithi188_104537_object110161:head# 2024-04-01T19:36:19.760 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc3eda4:::benchmark_data_smithi188_104537_object153019:head# 2024-04-01T19:36:19.760 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc4797d:::benchmark_data_smithi188_104537_object94298:head# 2024-04-01T19:36:19.761 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc53f0c:::benchmark_data_smithi188_104537_object69011:head# 2024-04-01T19:36:19.761 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc59cd0:::benchmark_data_smithi188_104537_object161894:head# 2024-04-01T19:36:19.762 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc5d1fe:::benchmark_data_smithi188_104537_object132676:head# 2024-04-01T19:36:19.762 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc64e5c:::benchmark_data_smithi188_104537_object92712:head# 2024-04-01T19:36:19.763 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc6908a:::benchmark_data_smithi188_104537_object109911:head# 2024-04-01T19:36:19.763 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc6b235:::benchmark_data_smithi188_104537_object147814:head# 2024-04-01T19:36:19.763 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc6bdce:::benchmark_data_smithi188_104537_object80421:head# 2024-04-01T19:36:19.764 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc6bfee:::benchmark_data_smithi188_104537_object123631:head# 2024-04-01T19:36:19.764 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc6cf24:::benchmark_data_smithi188_104537_object77856:head# 2024-04-01T19:36:19.765 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc7051f:::benchmark_data_smithi188_104537_object144568:head# 2024-04-01T19:36:19.765 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc8081c:::benchmark_data_smithi188_104537_object61062:head# 2024-04-01T19:36:19.767 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc869c2:::benchmark_data_smithi188_104537_object156028:head# 2024-04-01T19:36:19.767 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc87644:::benchmark_data_smithi188_104537_object117331:head# 2024-04-01T19:36:19.767 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc8bd6c:::benchmark_data_smithi188_104537_object75379:head# 2024-04-01T19:36:19.767 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc9a18a:::benchmark_data_smithi188_104537_object14807:head# 2024-04-01T19:36:19.768 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc9b298:::benchmark_data_smithi188_104537_object95090:head# 2024-04-01T19:36:19.768 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cc9e5a6:::benchmark_data_smithi188_104537_object149256:head# 2024-04-01T19:36:19.768 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cca711d:::benchmark_data_smithi188_104537_object146014:head# 2024-04-01T19:36:19.769 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cca87d7:::benchmark_data_smithi188_104537_object138254:head# 2024-04-01T19:36:19.769 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cca8c19:::benchmark_data_smithi188_104537_object61118:head# 2024-04-01T19:36:19.770 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ccbdb8e:::benchmark_data_smithi188_104537_object39031:head# 2024-04-01T19:36:19.770 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ccbe2f9:::benchmark_data_smithi188_104537_object138607:head# 2024-04-01T19:36:19.770 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ccc9522:::benchmark_data_smithi188_104537_object10990:head# 2024-04-01T19:36:19.771 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ccd0a43:::benchmark_data_smithi188_104537_object100806:head# 2024-04-01T19:36:19.771 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ccd4c45:::benchmark_data_smithi188_104537_object33088:head# 2024-04-01T19:36:19.772 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ccd659b:::benchmark_data_smithi188_104537_object25762:head# 2024-04-01T19:36:19.772 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ccd769f:::benchmark_data_smithi188_104537_object43188:head# 2024-04-01T19:36:19.773 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ccdbd58:::benchmark_data_smithi188_104537_object40190:head# 2024-04-01T19:36:19.773 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ccdc8cc:::benchmark_data_smithi188_104537_object170451:head# 2024-04-01T19:36:19.773 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cce089d:::benchmark_data_smithi188_104537_object20772:head# 2024-04-01T19:36:19.774 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cce59be:::benchmark_data_smithi188_104537_object18178:head# 2024-04-01T19:36:19.774 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cced99b:::benchmark_data_smithi188_104537_object158464:head# 2024-04-01T19:36:19.774 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:36:19.776 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cceed22:::benchmark_data_smithi188_104537_object155661:head# 2024-04-01T19:36:19.776 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ccefcf5:::benchmark_data_smithi188_104537_object45111:head# 2024-04-01T19:36:19.776 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ccffd67:::benchmark_data_smithi188_104537_object24591:head# 2024-04-01T19:36:19.776 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cd04886:::benchmark_data_smithi188_104537_object95508:head# 2024-04-01T19:36:19.776 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cd07332:::benchmark_data_smithi188_104537_object128551:head# 2024-04-01T19:36:19.777 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cd0a225:::benchmark_data_smithi188_104537_object140171:head# 2024-04-01T19:36:19.778 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cd25c12:::benchmark_data_smithi188_104537_object160171:head# 2024-04-01T19:36:19.778 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cd27d53:::benchmark_data_smithi188_104537_object121110:head# 2024-04-01T19:36:19.778 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cd36b6c:::benchmark_data_smithi188_104537_object88269:head# 2024-04-01T19:36:19.779 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cd463f1:::benchmark_data_smithi188_104537_object25024:head# 2024-04-01T19:36:19.779 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cd46bdb:::benchmark_data_smithi188_104537_object168409:head# 2024-04-01T19:36:19.779 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cd4c167:::benchmark_data_smithi188_104537_object37483:head# 2024-04-01T19:36:19.779 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cd50e18:::benchmark_data_smithi188_104537_object42301:head# 2024-04-01T19:36:19.780 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cd545b5:::benchmark_data_smithi188_104537_object101732:head# 2024-04-01T19:36:19.780 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cd5ea04:::benchmark_data_smithi188_104537_object91054:head# 2024-04-01T19:36:19.781 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cd78807:::benchmark_data_smithi188_104537_object170616:head# 2024-04-01T19:36:19.781 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cd7f69b:::benchmark_data_smithi188_104537_object56288:head# 2024-04-01T19:36:19.782 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cd890eb:::benchmark_data_smithi188_104537_object114912:head# 2024-04-01T19:36:19.782 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cd8c02f:::benchmark_data_smithi188_104537_object109086:head# 2024-04-01T19:36:19.782 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cd8c08b:::benchmark_data_smithi188_104537_object12046:head# 2024-04-01T19:36:19.783 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cd8ea22:::benchmark_data_smithi188_104537_object141956:head# 2024-04-01T19:36:19.783 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cd97dc9:::benchmark_data_smithi188_104537_object164642:head# 2024-04-01T19:36:19.784 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cda2cfc:::benchmark_data_smithi188_104537_object140679:head# 2024-04-01T19:36:19.784 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cdb3a7f:::benchmark_data_smithi188_104537_object55779:head# 2024-04-01T19:36:19.785 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cdb4307:::benchmark_data_smithi188_104537_object127958:head# 2024-04-01T19:36:19.785 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cdb5d41:::benchmark_data_smithi188_104537_object55016:head# 2024-04-01T19:36:19.786 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cdc9cee:::benchmark_data_smithi188_104537_object155616:head# 2024-04-01T19:36:19.786 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cdcb60b:::benchmark_data_smithi188_104537_object134611:head# 2024-04-01T19:36:19.787 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cdcd647:::benchmark_data_smithi188_104537_object121060:head# 2024-04-01T19:36:19.787 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cdd2d1e:::benchmark_data_smithi188_104537_object90936:head# 2024-04-01T19:36:19.788 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cdd5ff9:::benchmark_data_smithi188_104537_object56830:head# 2024-04-01T19:36:19.788 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cdd9aa0:::benchmark_data_smithi188_104537_object164946:head# 2024-04-01T19:36:19.788 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cddbefb:::benchmark_data_smithi188_104537_object52816:head# 2024-04-01T19:36:19.789 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cde83fe:::benchmark_data_smithi188_104537_object164415:head# 2024-04-01T19:36:19.790 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cdec8dc:::benchmark_data_smithi188_104537_object154700:head# 2024-04-01T19:36:19.790 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cdedd4c:::benchmark_data_smithi188_104537_object161014:head# 2024-04-01T19:36:19.790 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cdee284:::benchmark_data_smithi188_104537_object131271:head# 2024-04-01T19:36:19.791 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cdf4629:::benchmark_data_smithi188_104537_object155450:head# 2024-04-01T19:36:19.791 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cdf7fc4:::benchmark_data_smithi188_104537_object38734:head# 2024-04-01T19:36:19.792 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cdf9cef:::benchmark_data_smithi188_104537_object171092:head# 2024-04-01T19:36:19.792 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ce02b44:::benchmark_data_smithi188_104537_object21177:head# 2024-04-01T19:36:19.792 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ce0698c:::benchmark_data_smithi188_104537_object132951:head# 2024-04-01T19:36:19.793 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ce0a50c:::benchmark_data_smithi188_104537_object111765:head# 2024-04-01T19:36:19.794 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ce0eec2:::benchmark_data_smithi188_104537_object158252:head# 2024-04-01T19:36:19.794 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ce11a4e:::benchmark_data_smithi188_104537_object164693:head# 2024-04-01T19:36:19.795 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ce30801:::benchmark_data_smithi188_104537_object19813:head# 2024-04-01T19:36:19.795 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ce408ea:::benchmark_data_smithi188_104537_object161112:head# 2024-04-01T19:36:19.796 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ce46e5c:::benchmark_data_smithi188_104537_object90211:head# 2024-04-01T19:36:19.796 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ce48cea:::benchmark_data_smithi188_104537_object31321:head# 2024-04-01T19:36:19.797 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ce4abf1:::benchmark_data_smithi188_104537_object165268:head# 2024-04-01T19:36:19.797 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ce4b88f:::benchmark_data_smithi188_104537_object98977:head# 2024-04-01T19:36:19.798 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ce5e5ab:::benchmark_data_smithi188_104537_object35448:head# 2024-04-01T19:36:19.798 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ce728ad:::benchmark_data_smithi188_104537_object130229:head# 2024-04-01T19:36:19.799 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ce768be:::benchmark_data_smithi188_104537_object18748:head# 2024-04-01T19:36:19.800 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ce769f4:::benchmark_data_smithi188_104537_object123937:head# 2024-04-01T19:36:19.800 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ce77ff0:::benchmark_data_smithi188_104537_object102307:head# 2024-04-01T19:36:19.800 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ce7d670:::benchmark_data_smithi188_104537_object75376:head# 2024-04-01T19:36:19.801 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ce81378:::benchmark_data_smithi188_104537_object54792:head# 2024-04-01T19:36:19.801 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ce86cf4:::benchmark_data_smithi188_104537_object111721:head# 2024-04-01T19:36:19.802 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ce880ee:::benchmark_data_smithi188_104537_object66107:head# 2024-04-01T19:36:19.802 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ce8b196:::benchmark_data_smithi188_104537_object106576:head# 2024-04-01T19:36:19.802 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ce96b37:::benchmark_data_smithi188_104537_object113575:head# 2024-04-01T19:36:19.803 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ce9bd78:::benchmark_data_smithi188_104537_object137026:head# 2024-04-01T19:36:19.804 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:19.804 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ce9cf71:::benchmark_data_smithi188_104537_object43905:head# 2024-04-01T19:36:19.804 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ce9df72:::benchmark_data_smithi188_104537_object34991:head# 2024-04-01T19:36:19.805 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ceaddb5:::benchmark_data_smithi188_104537_object19025:head# 2024-04-01T19:36:19.805 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ceafa04:::benchmark_data_smithi188_104537_object94018:head# 2024-04-01T19:36:19.805 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ceb2be5:::benchmark_data_smithi188_104537_object14976:head# 2024-04-01T19:36:19.806 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ceb76a7:::benchmark_data_smithi188_104537_object94102:head# 2024-04-01T19:36:19.806 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ceb8013:::benchmark_data_smithi188_104537_object31500:head# 2024-04-01T19:36:19.807 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cebfc4d:::benchmark_data_smithi188_104537_object113693:head# 2024-04-01T19:36:19.807 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cec0c4d:::benchmark_data_smithi188_104537_object102143:head# 2024-04-01T19:36:19.808 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cec2e34:::benchmark_data_smithi188_104537_object52524:head# 2024-04-01T19:36:19.808 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cedcd8f:::benchmark_data_smithi188_104537_object62516:head# 2024-04-01T19:36:19.809 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cee0125:::benchmark_data_smithi188_104537_object84815:head# 2024-04-01T19:36:19.809 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cee360c:::benchmark_data_smithi188_104537_object131032:head# 2024-04-01T19:36:19.809 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ceed71d:::benchmark_data_smithi188_104537_object13450:head# 2024-04-01T19:36:19.810 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ceeed89:::benchmark_data_smithi188_104537_object20497:head# 2024-04-01T19:36:19.811 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cef07b9:::benchmark_data_smithi188_104537_object148318:head# 2024-04-01T19:36:19.811 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cef094d:::benchmark_data_smithi188_104537_object21969:head# 2024-04-01T19:36:19.811 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cef2d13:::benchmark_data_smithi188_104537_object93883:head# 2024-04-01T19:36:19.811 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cef3d07:::benchmark_data_smithi188_104537_object77236:head# 2024-04-01T19:36:19.812 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cef9a63:::benchmark_data_smithi188_104537_object157900:head# 2024-04-01T19:36:19.812 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cef9fef:::benchmark_data_smithi188_104537_object38634:head# 2024-04-01T19:36:19.813 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cefef09:::benchmark_data_smithi188_104537_object95392:head# 2024-04-01T19:36:19.813 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf0dde1:::benchmark_data_smithi188_104537_object21341:head# 2024-04-01T19:36:19.814 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf234ab:::benchmark_data_smithi188_104537_object46767:head# 2024-04-01T19:36:19.814 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf2474c:::benchmark_data_smithi188_104537_object18688:head# 2024-04-01T19:36:19.814 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf27af4:::benchmark_data_smithi188_104537_object59847:head# 2024-04-01T19:36:19.815 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf2df08:::benchmark_data_smithi188_104537_object60346:head# 2024-04-01T19:36:19.815 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf2ed73:::benchmark_data_smithi188_104537_object75475:head# 2024-04-01T19:36:19.816 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf315b2:::benchmark_data_smithi188_104537_object128552:head# 2024-04-01T19:36:19.816 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf349ff:::benchmark_data_smithi188_104537_object49900:head# 2024-04-01T19:36:19.817 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf36596:::benchmark_data_smithi188_104537_object27592:head# 2024-04-01T19:36:19.817 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf3975c:::benchmark_data_smithi188_104537_object169369:head# 2024-04-01T19:36:19.818 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf414be:::benchmark_data_smithi188_104537_object119194:head# 2024-04-01T19:36:19.818 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf42968:::benchmark_data_smithi188_104537_object144108:head# 2024-04-01T19:36:19.818 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf476b1:::benchmark_data_smithi188_104537_object142841:head# 2024-04-01T19:36:19.819 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf4eabb:::benchmark_data_smithi188_104537_object26869:head# 2024-04-01T19:36:19.820 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf5523b:::benchmark_data_smithi188_104537_object105405:head# 2024-04-01T19:36:19.820 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf57700:::benchmark_data_smithi188_104537_object48643:head# 2024-04-01T19:36:19.820 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf5843c:::benchmark_data_smithi188_104537_object154234:head# 2024-04-01T19:36:19.821 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf58ad5:::benchmark_data_smithi188_104537_object85286:head# 2024-04-01T19:36:19.821 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf5a67d:::benchmark_data_smithi188_104537_object127237:head# 2024-04-01T19:36:19.821 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf5bacb:::benchmark_data_smithi188_104537_object122748:head# 2024-04-01T19:36:19.822 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf5f2bb:::benchmark_data_smithi188_104537_object103897:head# 2024-04-01T19:36:19.822 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf60984:::benchmark_data_smithi188_104537_object60416:head# 2024-04-01T19:36:19.823 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf62341:::benchmark_data_smithi188_104537_object171518:head# 2024-04-01T19:36:19.823 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf64f51:::benchmark_data_smithi188_104537_object41835:head# 2024-04-01T19:36:19.823 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf67ee3:::benchmark_data_smithi188_104537_object151580:head# 2024-04-01T19:36:19.824 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf6adec:::benchmark_data_smithi188_104537_object34551:head# 2024-04-01T19:36:19.824 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf6ed47:::benchmark_data_smithi188_104537_object86949:head# 2024-04-01T19:36:19.825 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf71b3a:::benchmark_data_smithi188_104537_object16368:head# 2024-04-01T19:36:19.825 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf725ba:::benchmark_data_smithi188_104537_object105062:head# 2024-04-01T19:36:19.826 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf8e44a:::benchmark_data_smithi188_104537_object157410:head# 2024-04-01T19:36:19.826 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf90724:::benchmark_data_smithi188_104537_object121922:head# 2024-04-01T19:36:19.826 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cf9539e:::benchmark_data_smithi188_104537_object128803:head# 2024-04-01T19:36:19.827 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cfb5ff7:::benchmark_data_smithi188_104537_object67004:head# 2024-04-01T19:36:19.827 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cfbaccb:::benchmark_data_smithi188_104537_object138570:head# 2024-04-01T19:36:19.828 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cfc9949:::benchmark_data_smithi188_104537_object43592:head# 2024-04-01T19:36:19.828 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cfca0ea:::benchmark_data_smithi188_104537_object163884:head# 2024-04-01T19:36:19.829 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cfcbac5:::benchmark_data_smithi188_104537_object134599:head# 2024-04-01T19:36:19.829 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cfcc81b:::benchmark_data_smithi188_104537_object72267:head# 2024-04-01T19:36:19.829 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cfdc675:::benchmark_data_smithi188_104537_object46376:head# 2024-04-01T19:36:19.830 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cfdce0a:::benchmark_data_smithi188_104537_object113048:head# 2024-04-01T19:36:19.830 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cfde7a1:::benchmark_data_smithi188_104537_object99856:head# 2024-04-01T19:36:19.831 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cfe1c1f:::benchmark_data_smithi188_104537_object93720:head# 2024-04-01T19:36:19.831 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cfe65fa:::benchmark_data_smithi188_104537_object113970:head# 2024-04-01T19:36:19.831 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cfe813b:::benchmark_data_smithi188_104537_object41115:head# 2024-04-01T19:36:19.832 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cfea88b:::benchmark_data_smithi188_104537_object27591:head# 2024-04-01T19:36:19.832 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cff27e3:::benchmark_data_smithi188_104537_object51535:head# 2024-04-01T19:36:19.832 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5cff64af:::benchmark_data_smithi188_104537_object70390:head# 2024-04-01T19:36:19.833 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d001d82:::benchmark_data_smithi188_104537_object21332:head# 2024-04-01T19:36:19.834 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d0085a1:::benchmark_data_smithi188_104537_object28681:head# 2024-04-01T19:36:19.834 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d019d85:::benchmark_data_smithi188_104537_object89271:head# 2024-04-01T19:36:19.834 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d024b1f:::benchmark_data_smithi188_104537_object150629:head# 2024-04-01T19:36:19.835 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d02b558:::benchmark_data_smithi188_104537_object123424:head# 2024-04-01T19:36:19.836 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d02c02c:::benchmark_data_smithi188_104537_object127049:head# 2024-04-01T19:36:19.836 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d02c0f7:::benchmark_data_smithi188_104537_object120674:head# 2024-04-01T19:36:19.836 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d02d7b8:::benchmark_data_smithi188_104537_object128796:head# 2024-04-01T19:36:19.837 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d02fefc:::benchmark_data_smithi188_104537_object164370:head# 2024-04-01T19:36:19.837 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d0368bb:::benchmark_data_smithi188_104537_object35397:head# 2024-04-01T19:36:19.838 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d05a50f:::benchmark_data_smithi188_104537_object48288:head# 2024-04-01T19:36:19.838 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d05d064:::benchmark_data_smithi188_104537_object24331:head# 2024-04-01T19:36:19.839 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d062f72:::benchmark_data_smithi188_104537_object134315:head# 2024-04-01T19:36:19.839 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d0665a9:::benchmark_data_smithi188_104537_object135529:head# 2024-04-01T19:36:19.839 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d0683b5:::benchmark_data_smithi188_104537_object74451:head# 2024-04-01T19:36:19.840 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d0699cf:::benchmark_data_smithi188_104537_object115193:head# 2024-04-01T19:36:19.840 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d06be50:::benchmark_data_smithi188_104537_object142791:head# 2024-04-01T19:36:19.841 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d074933:::benchmark_data_smithi188_104537_object36300:head# 2024-04-01T19:36:19.841 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d077c43:::benchmark_data_smithi188_104537_object95932:head# 2024-04-01T19:36:19.841 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d07bf20:::benchmark_data_smithi188_104537_object75321:head# 2024-04-01T19:36:19.842 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d07c8f4:::benchmark_data_smithi188_104537_object19202:head# 2024-04-01T19:36:19.843 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d083199:::benchmark_data_smithi188_104537_object52984:head# 2024-04-01T19:36:19.843 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d083277:::benchmark_data_smithi188_104537_object79664:head# 2024-04-01T19:36:19.843 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d09a1a0:::benchmark_data_smithi188_104537_object164975:head# 2024-04-01T19:36:19.843 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d09ac85:::benchmark_data_smithi188_104537_object84536:head# 2024-04-01T19:36:19.844 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d0aaf3c:::benchmark_data_smithi188_104537_object12933:head# 2024-04-01T19:36:19.845 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d0acfaf:::benchmark_data_smithi188_104537_object62436:head# 2024-04-01T19:36:19.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d0b0076:::benchmark_data_smithi188_104537_object149349:head# 2024-04-01T19:36:19.847 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d0b02ab:::benchmark_data_smithi188_104537_object54326:head# 2024-04-01T19:36:19.847 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d0b81c1:::benchmark_data_smithi188_104537_object62511:head# 2024-04-01T19:36:19.847 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d0ba274:::benchmark_data_smithi188_104537_object17343:head# 2024-04-01T19:36:19.847 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d0bafe1:::benchmark_data_smithi188_104537_object61376:head# 2024-04-01T19:36:19.848 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d0be63d:::benchmark_data_smithi188_104537_object33786:head# 2024-04-01T19:36:19.848 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d0c8b4e:::benchmark_data_smithi188_104537_object45298:head# 2024-04-01T19:36:19.849 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d0e1eaf:::benchmark_data_smithi188_104537_object43471:head# 2024-04-01T19:36:19.849 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d0e345f:::benchmark_data_smithi188_104537_object45976:head# 2024-04-01T19:36:19.850 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d0f15d4:::benchmark_data_smithi188_104537_object26370:head# 2024-04-01T19:36:19.850 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d0f7f1f:::benchmark_data_smithi188_104537_object24053:head# 2024-04-01T19:36:19.851 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d0f833d:::benchmark_data_smithi188_104537_object129466:head# 2024-04-01T19:36:19.851 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d0fc7bf:::benchmark_data_smithi188_104537_object59167:head# 2024-04-01T19:36:19.852 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d0fc879:::benchmark_data_smithi188_104537_object103147:head# 2024-04-01T19:36:19.852 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d0fde54:::benchmark_data_smithi188_104537_object12829:head# 2024-04-01T19:36:19.852 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d0ff5ee:::benchmark_data_smithi188_104537_object75375:head# 2024-04-01T19:36:19.853 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d103ae3:::benchmark_data_smithi188_104537_object104293:head# 2024-04-01T19:36:19.854 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d111c08:::benchmark_data_smithi188_104537_object57179:head# 2024-04-01T19:36:19.854 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d115ba9:::benchmark_data_smithi188_104537_object46278:head# 2024-04-01T19:36:19.855 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d11d1d3:::benchmark_data_smithi188_104537_object49871:head# 2024-04-01T19:36:19.855 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d121a56:::benchmark_data_smithi188_104537_object46403:head# 2024-04-01T19:36:19.856 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d13ba70:::benchmark_data_smithi188_104537_object136617:head# 2024-04-01T19:36:19.856 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d150e03:::benchmark_data_smithi188_104537_object112930:head# 2024-04-01T19:36:19.857 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d1511a9:::benchmark_data_smithi188_104537_object89784:head# 2024-04-01T19:36:19.857 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d15369d:::benchmark_data_smithi188_104537_object106182:head# 2024-04-01T19:36:19.858 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d157399:::benchmark_data_smithi188_104537_object152441:head# 2024-04-01T19:36:19.858 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d157e8e:::benchmark_data_smithi188_104537_object76037:head# 2024-04-01T19:36:19.858 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d1647db:::benchmark_data_smithi188_104537_object75365:head# 2024-04-01T19:36:19.859 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d16be84:::benchmark_data_smithi188_104537_object62477:head# 2024-04-01T19:36:19.859 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d1828e9:::benchmark_data_smithi188_104537_object113518:head# 2024-04-01T19:36:19.859 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d18654f:::benchmark_data_smithi188_104537_object131302:head# 2024-04-01T19:36:19.860 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d186595:::benchmark_data_smithi188_104537_object148586:head# 2024-04-01T19:36:19.860 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d18b55f:::benchmark_data_smithi188_104537_object107228:head# 2024-04-01T19:36:19.860 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d18be43:::benchmark_data_smithi188_104537_object149952:head# 2024-04-01T19:36:19.861 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d1a7b3f:::benchmark_data_smithi188_104537_object41408:head# 2024-04-01T19:36:19.861 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d1ae0a7:::benchmark_data_smithi188_104537_object101424:head# 2024-04-01T19:36:19.862 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d1ae631:::benchmark_data_smithi188_104537_object110622:head# 2024-04-01T19:36:19.862 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d1b3090:::benchmark_data_smithi188_104537_object56052:head# 2024-04-01T19:36:19.863 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d1b324c:::benchmark_data_smithi188_104537_object87395:head# 2024-04-01T19:36:19.863 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d1c32e3:::benchmark_data_smithi188_104537_object132416:head# 2024-04-01T19:36:19.864 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d1cccac:::benchmark_data_smithi188_104537_object79787:head# 2024-04-01T19:36:19.864 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d1d3fd8:::benchmark_data_smithi188_104537_object93294:head# 2024-04-01T19:36:19.865 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d1df30d:::benchmark_data_smithi188_104537_object27545:head# 2024-04-01T19:36:19.865 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d1e44dc:::benchmark_data_smithi188_104537_object141431:head# 2024-04-01T19:36:19.866 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d1ec8bc:::benchmark_data_smithi188_104537_object78547:head# 2024-04-01T19:36:19.866 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d1f1c5f:::benchmark_data_smithi188_104537_object46141:head# 2024-04-01T19:36:19.867 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d1f1fbd:::benchmark_data_smithi188_104537_object56393:head# 2024-04-01T19:36:19.867 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d1f31c6:::benchmark_data_smithi188_104537_object109957:head# 2024-04-01T19:36:19.868 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d1f3ee2:::benchmark_data_smithi188_104537_object129748:head# 2024-04-01T19:36:19.869 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d1f56cf:::benchmark_data_smithi188_104537_object164630:head# 2024-04-01T19:36:19.869 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d1f651d:::benchmark_data_smithi188_104537_object40734:head# 2024-04-01T19:36:19.869 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d1f8c32:::benchmark_data_smithi188_104537_object16849:head# 2024-04-01T19:36:19.870 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d1f94f8:::benchmark_data_smithi188_104537_object93186:head# 2024-04-01T19:36:19.870 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d1fa4d3:::benchmark_data_smithi188_104537_object148649:head# 2024-04-01T19:36:19.871 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d1fc5a1:::benchmark_data_smithi188_104537_object42213:head# 2024-04-01T19:36:19.871 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d21157b:::benchmark_data_smithi188_104537_object165311:head# 2024-04-01T19:36:19.872 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d21c81e:::benchmark_data_smithi188_104537_object23865:head# 2024-04-01T19:36:19.872 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d21ce9b:::benchmark_data_smithi188_104537_object73756:head# 2024-04-01T19:36:19.872 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d221a40:::benchmark_data_smithi188_104537_object23772:head# 2024-04-01T19:36:19.872 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d2258fb:::benchmark_data_smithi188_104537_object26877:head# 2024-04-01T19:36:19.873 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d2283f0:::benchmark_data_smithi188_104537_object70049:head# 2024-04-01T19:36:19.874 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d22f030:::benchmark_data_smithi188_104537_object116231:head# 2024-04-01T19:36:19.874 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d23eeba:::benchmark_data_smithi188_104537_object118249:head# 2024-04-01T19:36:19.875 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d2416a7:::benchmark_data_smithi188_104537_object83576:head# 2024-04-01T19:36:19.875 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d241cf3:::benchmark_data_smithi188_104537_object30295:head# 2024-04-01T19:36:19.876 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d246d32:::benchmark_data_smithi188_104537_object55581:head# 2024-04-01T19:36:19.876 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d24b5da:::benchmark_data_smithi188_104537_object163736:head# 2024-04-01T19:36:19.877 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d24f34a:::benchmark_data_smithi188_104537_object13007:head# 2024-04-01T19:36:19.877 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d2591c6:::benchmark_data_smithi188_104537_object122257:head# 2024-04-01T19:36:19.877 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d25ee77:::benchmark_data_smithi188_104537_object136254:head# 2024-04-01T19:36:19.878 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d2663da:::benchmark_data_smithi188_104537_object147922:head# 2024-04-01T19:36:19.878 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d28060d:::benchmark_data_smithi188_104537_object47481:head# 2024-04-01T19:36:19.879 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d288840:::benchmark_data_smithi188_104537_object67627:head# 2024-04-01T19:36:19.879 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d289152:::benchmark_data_smithi188_104537_object50226:head# 2024-04-01T19:36:19.880 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d28a5e1:::benchmark_data_smithi188_104537_object140338:head# 2024-04-01T19:36:19.880 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d28c5be:::benchmark_data_smithi188_104537_object12168:head# 2024-04-01T19:36:19.881 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d28cb45:::benchmark_data_smithi188_104537_object24647:head# 2024-04-01T19:36:19.881 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d28ef06:::benchmark_data_smithi188_104537_object41917:head# 2024-04-01T19:36:19.882 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d28f13c:::benchmark_data_smithi188_104537_object41457:head# 2024-04-01T19:36:19.882 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d290da3:::benchmark_data_smithi188_104537_object12524:head# 2024-04-01T19:36:19.882 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d29533f:::benchmark_data_smithi188_104537_object77772:head# 2024-04-01T19:36:19.883 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d29a896:::benchmark_data_smithi188_104537_object81322:head# 2024-04-01T19:36:19.883 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d29adcc:::benchmark_data_smithi188_104537_object134556:head# 2024-04-01T19:36:19.884 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d29d7c0:::benchmark_data_smithi188_104537_object139113:head# 2024-04-01T19:36:19.884 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d2a2cc5:::benchmark_data_smithi188_104537_object20422:head# 2024-04-01T19:36:19.885 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d2b6b79:::benchmark_data_smithi188_104537_object109292:head# 2024-04-01T19:36:19.885 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d2d4a3d:::benchmark_data_smithi188_104537_object116658:head# 2024-04-01T19:36:19.886 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d2db023:::benchmark_data_smithi188_104537_object124246:head# 2024-04-01T19:36:19.886 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d2e5990:::benchmark_data_smithi188_104537_object20264:head# 2024-04-01T19:36:19.886 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d2ee61c:::benchmark_data_smithi188_104537_object55701:head# 2024-04-01T19:36:19.887 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d2f7c37:::benchmark_data_smithi188_104537_object82420:head# 2024-04-01T19:36:19.887 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d2f8b4f:::benchmark_data_smithi188_104537_object17690:head# 2024-04-01T19:36:19.888 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d30c783:::benchmark_data_smithi188_104537_object156581:head# 2024-04-01T19:36:19.888 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d30dfc7:::benchmark_data_smithi188_104537_object42696:head# 2024-04-01T19:36:19.889 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d30e055:::benchmark_data_smithi188_104537_object129200:head# 2024-04-01T19:36:19.889 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d3175ce:::benchmark_data_smithi188_104537_object15406:head# 2024-04-01T19:36:19.890 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d3195fd:::benchmark_data_smithi188_104537_object34069:head# 2024-04-01T19:36:19.890 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d31fd18:::benchmark_data_smithi188_104537_object154952:head# 2024-04-01T19:36:19.890 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d323a0f:::benchmark_data_smithi188_104537_object100270:head# 2024-04-01T19:36:19.891 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d32a744:::benchmark_data_smithi188_104537_object143197:head# 2024-04-01T19:36:19.891 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d330d4f:::benchmark_data_smithi188_104537_object94221:head# 2024-04-01T19:36:19.892 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d333af6:::benchmark_data_smithi188_104537_object29603:head# 2024-04-01T19:36:19.892 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d33dad8:::benchmark_data_smithi188_104537_object48421:head# 2024-04-01T19:36:19.892 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d34088a:::benchmark_data_smithi188_104537_object127205:head# 2024-04-01T19:36:19.893 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d341494:::benchmark_data_smithi188_104537_object153361:head# 2024-04-01T19:36:19.893 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d349765:::benchmark_data_smithi188_104537_object33712:head# 2024-04-01T19:36:19.894 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d34d965:::benchmark_data_smithi188_104537_object109711:head# 2024-04-01T19:36:19.894 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d34e29e:::benchmark_data_smithi188_104537_object119717:head# 2024-04-01T19:36:19.894 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d35dffe:::benchmark_data_smithi188_104537_object159783:head# 2024-04-01T19:36:19.895 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d364b11:::benchmark_data_smithi188_104537_object151988:head# 2024-04-01T19:36:19.895 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d368cfc:::benchmark_data_smithi188_104537_object116012:head# 2024-04-01T19:36:19.895 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d373a9e:::benchmark_data_smithi188_104537_object111204:head# 2024-04-01T19:36:19.896 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d37899d:::benchmark_data_smithi188_104537_object67521:head# 2024-04-01T19:36:19.896 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d37fea4:::benchmark_data_smithi188_104537_object78067:head# 2024-04-01T19:36:19.897 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d38735b:::benchmark_data_smithi188_104537_object38953:head# 2024-04-01T19:36:19.897 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d39506a:::benchmark_data_smithi188_104537_object166047:head# 2024-04-01T19:36:19.898 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d3a39a2:::benchmark_data_smithi188_104537_object102842:head# 2024-04-01T19:36:19.898 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d3b1aaf:::benchmark_data_smithi188_104537_object124450:head# 2024-04-01T19:36:19.898 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d3b7857:::benchmark_data_smithi188_104537_object55017:head# 2024-04-01T19:36:19.899 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d3b951d:::benchmark_data_smithi188_104537_object63081:head# 2024-04-01T19:36:19.899 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d3b9b9e:::benchmark_data_smithi188_104537_object57110:head# 2024-04-01T19:36:19.900 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d3baa4c:::benchmark_data_smithi188_104537_object62850:head# 2024-04-01T19:36:19.900 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d3c48ef:::benchmark_data_smithi188_104537_object114741:head# 2024-04-01T19:36:19.900 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d3c652c:::benchmark_data_smithi188_104537_object71126:head# 2024-04-01T19:36:19.901 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d3deca0:::benchmark_data_smithi188_104537_object83023:head# 2024-04-01T19:36:19.901 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d3e0382:::benchmark_data_smithi188_104537_object22435:head# 2024-04-01T19:36:19.902 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d3ed166:::benchmark_data_smithi188_104537_object163364:head# 2024-04-01T19:36:19.902 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d3fbee8:::benchmark_data_smithi188_104537_object59713:head# 2024-04-01T19:36:19.902 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d3fec8d:::benchmark_data_smithi188_104537_object114386:head# 2024-04-01T19:36:19.903 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d3ff694:::benchmark_data_smithi188_104537_object121565:head# 2024-04-01T19:36:19.903 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4015d7:::benchmark_data_smithi188_104537_object12734:head# 2024-04-01T19:36:19.904 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4018b4:::benchmark_data_smithi188_104537_object65773:head# 2024-04-01T19:36:19.904 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d40f242:::benchmark_data_smithi188_104537_object97364:head# 2024-04-01T19:36:19.905 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:36:19.905 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d41029a:::benchmark_data_smithi188_104537_object26365:head# 2024-04-01T19:36:19.905 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4149ba:::benchmark_data_smithi188_104537_object35480:head# 2024-04-01T19:36:19.905 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d41d8a3:::benchmark_data_smithi188_104537_object131880:head# 2024-04-01T19:36:19.906 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4231bf:::benchmark_data_smithi188_104537_object109559:head# 2024-04-01T19:36:19.906 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d450e2b:::benchmark_data_smithi188_104537_object66473:head# 2024-04-01T19:36:19.907 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d455610:::benchmark_data_smithi188_104537_object73791:head# 2024-04-01T19:36:19.907 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d455795:::benchmark_data_smithi188_104537_object54814:head# 2024-04-01T19:36:19.908 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:19.908 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d46c313:::benchmark_data_smithi188_104537_object141750:head# 2024-04-01T19:36:19.909 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d46f3f2:::benchmark_data_smithi188_104537_object28041:head# 2024-04-01T19:36:19.909 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4711c5:::benchmark_data_smithi188_104537_object157543:head# 2024-04-01T19:36:19.909 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d479189:::benchmark_data_smithi188_104537_object146951:head# 2024-04-01T19:36:19.909 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:36:19.909 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d47bf2e:::benchmark_data_smithi188_104537_object113638:head# 2024-04-01T19:36:19.910 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d47d4c5:::benchmark_data_smithi188_104537_object89710:head# 2024-04-01T19:36:19.910 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d485366:::benchmark_data_smithi188_104537_object76744:head# 2024-04-01T19:36:19.910 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d493b36:::benchmark_data_smithi188_104537_object89187:head# 2024-04-01T19:36:19.911 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4949a6:::benchmark_data_smithi188_104537_object124352:head# 2024-04-01T19:36:19.911 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d49560b:::benchmark_data_smithi188_104537_object58990:head# 2024-04-01T19:36:19.911 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4964a4:::benchmark_data_smithi188_104537_object102051:head# 2024-04-01T19:36:19.912 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d49cd1f:::benchmark_data_smithi188_104537_object118538:head# 2024-04-01T19:36:19.912 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4a01e2:::benchmark_data_smithi188_104537_object98252:head# 2024-04-01T19:36:19.913 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4a059c:::benchmark_data_smithi188_104537_object111229:head# 2024-04-01T19:36:19.913 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4a2fdb:::benchmark_data_smithi188_104537_object34863:head# 2024-04-01T19:36:19.914 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4a6a71:::benchmark_data_smithi188_104537_object136661:head# 2024-04-01T19:36:19.914 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4aad82:::benchmark_data_smithi188_104537_object147582:head# 2024-04-01T19:36:19.915 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4ad1c1:::benchmark_data_smithi188_104537_object160342:head# 2024-04-01T19:36:19.915 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4b325c:::benchmark_data_smithi188_104537_object75448:head# 2024-04-01T19:36:19.915 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4b4c9a:::benchmark_data_smithi188_104537_object60992:head# 2024-04-01T19:36:19.916 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4c91e5:::benchmark_data_smithi188_104537_object76610:head# 2024-04-01T19:36:19.916 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4d0c9c:::benchmark_data_smithi188_104537_object29715:head# 2024-04-01T19:36:19.917 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4d2e74:::benchmark_data_smithi188_104537_object70502:head# 2024-04-01T19:36:19.917 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4d44d8:::benchmark_data_smithi188_104537_object140277:head# 2024-04-01T19:36:19.917 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4d665e:::benchmark_data_smithi188_104537_object123923:head# 2024-04-01T19:36:19.918 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4dafc1:::benchmark_data_smithi188_104537_object170325:head# 2024-04-01T19:36:19.918 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4e822f:::benchmark_data_smithi188_104537_object154040:head# 2024-04-01T19:36:19.919 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4e91df:::benchmark_data_smithi188_104537_object56445:head# 2024-04-01T19:36:19.919 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4f1350:::benchmark_data_smithi188_104537_object113421:head# 2024-04-01T19:36:19.919 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4f5dda:::benchmark_data_smithi188_104537_object131961:head# 2024-04-01T19:36:19.920 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4f6cec:::benchmark_data_smithi188_104537_object15317:head# 2024-04-01T19:36:19.920 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4f9d58:::benchmark_data_smithi188_104537_object164012:head# 2024-04-01T19:36:19.921 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d4ff1c6:::benchmark_data_smithi188_104537_object104808:head# 2024-04-01T19:36:19.921 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d50062f:::benchmark_data_smithi188_104537_object108624:head# 2024-04-01T19:36:19.922 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d509688:::benchmark_data_smithi188_104537_object134447:head# 2024-04-01T19:36:19.922 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d50a112:::benchmark_data_smithi188_104537_object165862:head# 2024-04-01T19:36:19.923 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d5227e5:::benchmark_data_smithi188_104537_object145593:head# 2024-04-01T19:36:19.923 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d52d38b:::benchmark_data_smithi188_104537_object151549:head# 2024-04-01T19:36:19.923 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d532e1a:::benchmark_data_smithi188_104537_object147995:head# 2024-04-01T19:36:19.924 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d5333f4:::benchmark_data_smithi188_104537_object100902:head# 2024-04-01T19:36:19.925 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d533538:::benchmark_data_smithi188_104537_object137111:head# 2024-04-01T19:36:19.925 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d53d97b:::benchmark_data_smithi188_104537_object124157:head# 2024-04-01T19:36:19.925 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d53dffc:::benchmark_data_smithi188_104537_object141124:head# 2024-04-01T19:36:19.926 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d53fec6:::benchmark_data_smithi188_104537_object31139:head# 2024-04-01T19:36:19.927 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d5471ea:::benchmark_data_smithi188_104537_object44377:head# 2024-04-01T19:36:19.927 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d550aa0:::benchmark_data_smithi188_104537_object111129:head# 2024-04-01T19:36:19.928 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d55bb78:::benchmark_data_smithi188_104537_object94024:head# 2024-04-01T19:36:19.928 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d5695a5:::benchmark_data_smithi188_104537_object66302:head# 2024-04-01T19:36:19.930 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d56b193:::benchmark_data_smithi188_104537_object90789:head# 2024-04-01T19:36:19.930 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d56d021:::benchmark_data_smithi188_104537_object165827:head# 2024-04-01T19:36:19.930 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d570bc6:::benchmark_data_smithi188_104537_object41304:head# 2024-04-01T19:36:19.931 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d584465:::benchmark_data_smithi188_104537_object24171:head# 2024-04-01T19:36:19.931 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d58d424:::benchmark_data_smithi188_104537_object81867:head# 2024-04-01T19:36:19.931 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d595263:::benchmark_data_smithi188_104537_object167866:head# 2024-04-01T19:36:19.932 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d597299:::benchmark_data_smithi188_104537_object160918:head# 2024-04-01T19:36:19.932 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d59a421:::benchmark_data_smithi188_104537_object160066:head# 2024-04-01T19:36:19.933 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d59babe:::benchmark_data_smithi188_104537_object160445:head# 2024-04-01T19:36:19.933 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d59f71e:::benchmark_data_smithi188_104537_object83634:head# 2024-04-01T19:36:19.934 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d5a1a97:::benchmark_data_smithi188_104537_object110144:head# 2024-04-01T19:36:19.934 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d5be3c5:::benchmark_data_smithi188_104537_object62127:head# 2024-04-01T19:36:19.934 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d5c490c:::benchmark_data_smithi188_104537_object106360:head# 2024-04-01T19:36:19.935 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d5c813d:::benchmark_data_smithi188_104537_object157201:head# 2024-04-01T19:36:19.936 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d5c9322:::benchmark_data_smithi188_104537_object50560:head# 2024-04-01T19:36:19.936 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d5c95a5:::benchmark_data_smithi188_104537_object73521:head# 2024-04-01T19:36:19.937 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d5cd9ef:::benchmark_data_smithi188_104537_object26478:head# 2024-04-01T19:36:19.937 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d5cda99:::benchmark_data_smithi188_104537_object67805:head# 2024-04-01T19:36:19.937 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d5d0b80:::benchmark_data_smithi188_104537_object120387:head# 2024-04-01T19:36:19.938 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d5db898:::benchmark_data_smithi188_104537_object31569:head# 2024-04-01T19:36:19.939 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d5dbbf4:::benchmark_data_smithi188_104537_object86417:head# 2024-04-01T19:36:19.939 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d5f2b55:::benchmark_data_smithi188_104537_object51678:head# 2024-04-01T19:36:19.940 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d5f6ebe:::benchmark_data_smithi188_104537_object22580:head# 2024-04-01T19:36:19.940 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d5fd627:::benchmark_data_smithi188_104537_object132745:head# 2024-04-01T19:36:19.941 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d5ff126:::benchmark_data_smithi188_104537_object127054:head# 2024-04-01T19:36:19.941 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d606561:::benchmark_data_smithi188_104537_object130897:head# 2024-04-01T19:36:19.942 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d6109bc:::benchmark_data_smithi188_104537_object98608:head# 2024-04-01T19:36:19.942 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d6245f6:::benchmark_data_smithi188_104537_object63346:head# 2024-04-01T19:36:19.943 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d6369e6:::benchmark_data_smithi188_104537_object150333:head# 2024-04-01T19:36:19.943 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d637a8a:::benchmark_data_smithi188_104537_object122183:head# 2024-04-01T19:36:19.944 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d64f589:::benchmark_data_smithi188_104537_object45047:head# 2024-04-01T19:36:19.944 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d654319:::benchmark_data_smithi188_104537_object87357:head# 2024-04-01T19:36:19.945 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d660480:::benchmark_data_smithi188_104537_object75366:head# 2024-04-01T19:36:19.945 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d662121:::benchmark_data_smithi188_104537_object133526:head# 2024-04-01T19:36:19.946 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d66217d:::benchmark_data_smithi188_104537_object18076:head# 2024-04-01T19:36:19.946 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d666686:::benchmark_data_smithi188_104537_object23721:head# 2024-04-01T19:36:19.947 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d66f7d5:::benchmark_data_smithi188_104537_object147201:head# 2024-04-01T19:36:19.947 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d6760cb:::benchmark_data_smithi188_104537_object38090:head# 2024-04-01T19:36:19.948 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d67aea8:::benchmark_data_smithi188_104537_object158247:head# 2024-04-01T19:36:19.948 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d68a4d1:::benchmark_data_smithi188_104537_object61180:head# 2024-04-01T19:36:19.949 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d690c02:::benchmark_data_smithi188_104537_object142111:head# 2024-04-01T19:36:19.949 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d691ddf:::benchmark_data_smithi188_104537_object74594:head# 2024-04-01T19:36:19.949 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d692583:::benchmark_data_smithi188_104537_object72609:head# 2024-04-01T19:36:19.950 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d692c59:::benchmark_data_smithi188_104537_object59094:head# 2024-04-01T19:36:19.950 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d69ec3f:::benchmark_data_smithi188_104537_object57538:head# 2024-04-01T19:36:19.951 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d69ef77:::benchmark_data_smithi188_104537_object100875:head# 2024-04-01T19:36:19.951 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d6a15d5:::benchmark_data_smithi188_104537_object78759:head# 2024-04-01T19:36:19.951 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d6b04e3:::benchmark_data_smithi188_104537_object139309:head# 2024-04-01T19:36:19.952 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d6bd7d7:::benchmark_data_smithi188_104537_object32681:head# 2024-04-01T19:36:19.952 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d6c6190:::benchmark_data_smithi188_104537_object53922:head# 2024-04-01T19:36:19.953 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d6c71c2:::benchmark_data_smithi188_104537_object31870:head# 2024-04-01T19:36:19.953 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d6d235b:::benchmark_data_smithi188_104537_object76218:head# 2024-04-01T19:36:19.954 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d6d8f01:::benchmark_data_smithi188_104537_object35128:head# 2024-04-01T19:36:19.954 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d6df7a5:::benchmark_data_smithi188_104537_object16070:head# 2024-04-01T19:36:19.954 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d6e44ce:::benchmark_data_smithi188_104537_object123329:head# 2024-04-01T19:36:19.955 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d6ec7dc:::benchmark_data_smithi188_104537_object16125:head# 2024-04-01T19:36:19.955 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d6ed0a9:::benchmark_data_smithi188_104537_object138355:head# 2024-04-01T19:36:19.956 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d6f2c7d:::benchmark_data_smithi188_104537_object120837:head# 2024-04-01T19:36:19.956 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d6f5727:::benchmark_data_smithi188_104537_object103310:head# 2024-04-01T19:36:19.957 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d6fcbd3:::benchmark_data_smithi188_104537_object162215:head# 2024-04-01T19:36:19.958 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d7149ad:::benchmark_data_smithi188_104537_object21377:head# 2024-04-01T19:36:19.958 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d719107:::benchmark_data_smithi188_104537_object161388:head# 2024-04-01T19:36:19.958 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d719fb9:::benchmark_data_smithi188_104537_object11276:head# 2024-04-01T19:36:19.959 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d71a562:::benchmark_data_smithi188_104537_object45498:head# 2024-04-01T19:36:19.959 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d72c40b:::benchmark_data_smithi188_104537_object25442:head# 2024-04-01T19:36:19.959 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d730e99:::benchmark_data_smithi188_104537_object153435:head# 2024-04-01T19:36:19.960 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d740816:::benchmark_data_smithi188_104537_object110989:head# 2024-04-01T19:36:19.961 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d7422ed:::benchmark_data_smithi188_104537_object139610:head# 2024-04-01T19:36:19.961 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d74404b:::benchmark_data_smithi188_104537_object73966:head# 2024-04-01T19:36:19.961 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d74f500:::benchmark_data_smithi188_104537_object144396:head# 2024-04-01T19:36:19.962 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d754a09:::benchmark_data_smithi188_104537_object105157:head# 2024-04-01T19:36:19.962 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d7790b5:::benchmark_data_smithi188_104537_object122080:head# 2024-04-01T19:36:19.963 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d77bd55:::benchmark_data_smithi188_104537_object114238:head# 2024-04-01T19:36:19.963 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d77e169:::benchmark_data_smithi188_104537_object91726:head# 2024-04-01T19:36:19.964 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d783157:::benchmark_data_smithi188_104537_object140191:head# 2024-04-01T19:36:19.964 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d78cd4d:::benchmark_data_smithi188_104537_object60092:head# 2024-04-01T19:36:19.965 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d7a7427:::benchmark_data_smithi188_104537_object45856:head# 2024-04-01T19:36:19.965 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d7aa750:::benchmark_data_smithi188_104537_object168993:head# 2024-04-01T19:36:19.965 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d7b2bc5:::benchmark_data_smithi188_104537_object146528:head# 2024-04-01T19:36:19.966 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d7b7980:::benchmark_data_smithi188_104537_object77355:head# 2024-04-01T19:36:19.967 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d7b7f79:::benchmark_data_smithi188_104537_object68116:head# 2024-04-01T19:36:19.967 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d7b94fe:::benchmark_data_smithi188_104537_object126989:head# 2024-04-01T19:36:19.968 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d7be926:::benchmark_data_smithi188_104537_object145132:head# 2024-04-01T19:36:19.968 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d7d2339:::benchmark_data_smithi188_104537_object88971:head# 2024-04-01T19:36:19.968 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d7e3771:::benchmark_data_smithi188_104537_object94070:head# 2024-04-01T19:36:19.969 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d7f3b15:::benchmark_data_smithi188_104537_object106968:head# 2024-04-01T19:36:19.969 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d7f849c:::benchmark_data_smithi188_104537_object60822:head# 2024-04-01T19:36:19.970 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d7fb826:::benchmark_data_smithi188_104537_object14690:head# 2024-04-01T19:36:19.970 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d807e35:::benchmark_data_smithi188_104537_object142509:head# 2024-04-01T19:36:19.971 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d80af65:::benchmark_data_smithi188_104537_object19016:head# 2024-04-01T19:36:19.971 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d811c1e:::benchmark_data_smithi188_104537_object52718:head# 2024-04-01T19:36:19.972 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d81a9cc:::benchmark_data_smithi188_104537_object54559:head# 2024-04-01T19:36:19.972 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d81f965:::benchmark_data_smithi188_104537_object66920:head# 2024-04-01T19:36:19.973 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d81fcca:::benchmark_data_smithi188_104537_object139162:head# 2024-04-01T19:36:19.973 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d82175d:::benchmark_data_smithi188_104537_object137332:head# 2024-04-01T19:36:19.973 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d828262:::benchmark_data_smithi188_104537_object25858:head# 2024-04-01T19:36:19.974 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d8321a5:::benchmark_data_smithi188_104537_object151588:head# 2024-04-01T19:36:19.974 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d8344fb:::benchmark_data_smithi188_104537_object16931:head# 2024-04-01T19:36:19.975 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d8361aa:::benchmark_data_smithi188_104537_object91297:head# 2024-04-01T19:36:19.975 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d847b8f:::benchmark_data_smithi188_104537_object108937:head# 2024-04-01T19:36:19.976 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d849b31:::benchmark_data_smithi188_104537_object166415:head# 2024-04-01T19:36:19.976 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d84bdc4:::benchmark_data_smithi188_104537_object37645:head# 2024-04-01T19:36:19.976 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d85153a:::benchmark_data_smithi188_104537_object54738:head# 2024-04-01T19:36:19.977 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d8518a0:::benchmark_data_smithi188_104537_object154610:head# 2024-04-01T19:36:19.978 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d8551fe:::benchmark_data_smithi188_104537_object131058:head# 2024-04-01T19:36:19.978 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d8590af:::benchmark_data_smithi188_104537_object24022:head# 2024-04-01T19:36:19.979 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d8666ce:::benchmark_data_smithi188_104537_object134854:head# 2024-04-01T19:36:19.979 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d86e7dc:::benchmark_data_smithi188_104537_object15989:head# 2024-04-01T19:36:19.979 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d871f24:::benchmark_data_smithi188_104537_object76370:head# 2024-04-01T19:36:19.980 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d875331:::benchmark_data_smithi188_104537_object126574:head# 2024-04-01T19:36:19.980 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d8801a9:::benchmark_data_smithi188_104537_object113474:head# 2024-04-01T19:36:19.981 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d8a4419:::benchmark_data_smithi188_104537_object64276:head# 2024-04-01T19:36:19.981 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d8a9762:::benchmark_data_smithi188_104537_object72763:head# 2024-04-01T19:36:19.982 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d8bbb73:::benchmark_data_smithi188_104537_object36354:head# 2024-04-01T19:36:19.982 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d8be33c:::benchmark_data_smithi188_104537_object168524:head# 2024-04-01T19:36:19.982 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d8c4a98:::benchmark_data_smithi188_104537_object139787:head# 2024-04-01T19:36:19.983 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d8c9402:::benchmark_data_smithi188_104537_object82992:head# 2024-04-01T19:36:19.983 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d8d31b8:::benchmark_data_smithi188_104537_object153119:head# 2024-04-01T19:36:19.984 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d8e5014:::benchmark_data_smithi188_104537_object35262:head# 2024-04-01T19:36:19.984 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d8ef839:::benchmark_data_smithi188_104537_object58353:head# 2024-04-01T19:36:19.985 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d8fe275:::benchmark_data_smithi188_104537_object145438:head# 2024-04-01T19:36:19.985 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d90570b:::benchmark_data_smithi188_104537_object127284:head# 2024-04-01T19:36:19.986 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d908e5b:::benchmark_data_smithi188_104537_object77597:head# 2024-04-01T19:36:19.986 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d90c51c:::benchmark_data_smithi188_104537_object145745:head# 2024-04-01T19:36:19.987 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d90f775:::benchmark_data_smithi188_104537_object50039:head# 2024-04-01T19:36:19.988 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d915245:::benchmark_data_smithi188_104537_object155888:head# 2024-04-01T19:36:19.988 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d91b541:::benchmark_data_smithi188_104537_object16294:head# 2024-04-01T19:36:19.988 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d91e305:::benchmark_data_smithi188_104537_object57254:head# 2024-04-01T19:36:19.989 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d920caa:::benchmark_data_smithi188_104537_object67702:head# 2024-04-01T19:36:19.989 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d922d2d:::benchmark_data_smithi188_104537_object89043:head# 2024-04-01T19:36:19.990 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d925f57:::benchmark_data_smithi188_104537_object77123:head# 2024-04-01T19:36:19.990 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d934d21:::benchmark_data_smithi188_104537_object66812:head# 2024-04-01T19:36:19.991 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d93e500:::benchmark_data_smithi188_104537_object60676:head# 2024-04-01T19:36:19.991 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d961ff6:::benchmark_data_smithi188_104537_object121133:head# 2024-04-01T19:36:19.992 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d962a0f:::benchmark_data_smithi188_104537_object100810:head# 2024-04-01T19:36:19.992 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d963adc:::benchmark_data_smithi188_104537_object82497:head# 2024-04-01T19:36:19.993 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d965148:::benchmark_data_smithi188_104537_object34793:head# 2024-04-01T19:36:19.993 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d96d3a2:::benchmark_data_smithi188_104537_object98675:head# 2024-04-01T19:36:19.994 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d97541b:::benchmark_data_smithi188_104537_object138173:head# 2024-04-01T19:36:19.994 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d97aa33:::benchmark_data_smithi188_104537_object155981:head# 2024-04-01T19:36:19.995 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d97de12:::benchmark_data_smithi188_104537_object168830:head# 2024-04-01T19:36:19.995 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d9850f8:::benchmark_data_smithi188_104537_object95486:head# 2024-04-01T19:36:19.995 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d98cdb6:::benchmark_data_smithi188_104537_object84988:head# 2024-04-01T19:36:19.996 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d994ce3:::benchmark_data_smithi188_104537_object127635:head# 2024-04-01T19:36:19.996 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d99d3a3:::benchmark_data_smithi188_104537_object42347:head# 2024-04-01T19:36:19.997 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d9afdba:::benchmark_data_smithi188_104537_object37515:head# 2024-04-01T19:36:20.001 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d9b2eae:::benchmark_data_smithi188_104537_object106930:head# 2024-04-01T19:36:20.001 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d9b7853:::benchmark_data_smithi188_104537_object120979:head# 2024-04-01T19:36:20.002 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d9bd3e4:::benchmark_data_smithi188_104537_object90759:head# 2024-04-01T19:36:20.003 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d9bd968:::benchmark_data_smithi188_104537_object132708:head# 2024-04-01T19:36:20.003 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d9bdf72:::benchmark_data_smithi188_104537_object158932:head# 2024-04-01T19:36:20.004 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d9c6f65:::benchmark_data_smithi188_104537_object47810:head# 2024-04-01T19:36:20.004 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d9c8544:::benchmark_data_smithi188_104537_object107812:head# 2024-04-01T19:36:20.005 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d9ce191:::benchmark_data_smithi188_104537_object170216:head# 2024-04-01T19:36:20.005 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d9ce99f:::benchmark_data_smithi188_104537_object156559:head# 2024-04-01T19:36:20.005 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d9e038e:::benchmark_data_smithi188_104537_object87151:head# 2024-04-01T19:36:20.006 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d9e6c58:::benchmark_data_smithi188_104537_object41620:head# 2024-04-01T19:36:20.006 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d9f17e8:::benchmark_data_smithi188_104537_object108046:head# 2024-04-01T19:36:20.006 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5d9f31da:::benchmark_data_smithi188_104537_object46483:head# 2024-04-01T19:36:20.007 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da10591:::benchmark_data_smithi188_104537_object161852:head# 2024-04-01T19:36:20.007 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da10a19:::benchmark_data_smithi188_104537_object122015:head# 2024-04-01T19:36:20.007 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da13b19:::benchmark_data_smithi188_104537_object120072:head# 2024-04-01T19:36:20.008 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da1400f:::benchmark_data_smithi188_104537_object12558:head# 2024-04-01T19:36:20.008 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da1cb37:::benchmark_data_smithi188_104537_object52938:head# 2024-04-01T19:36:20.009 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da1e005:::benchmark_data_smithi188_104537_object143272:head# 2024-04-01T19:36:20.009 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da234d9:::benchmark_data_smithi188_104537_object41750:head# 2024-04-01T19:36:20.009 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:36:20.010 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da287fe:::benchmark_data_smithi188_104537_object19762:head# 2024-04-01T19:36:20.011 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da2d858:::benchmark_data_smithi188_104537_object119793:head# 2024-04-01T19:36:20.011 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da30088:::benchmark_data_smithi188_104537_object101469:head# 2024-04-01T19:36:20.012 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da33001:::benchmark_data_smithi188_104537_object94086:head# 2024-04-01T19:36:20.012 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da3688a:::benchmark_data_smithi188_104537_object163020:head# 2024-04-01T19:36:20.013 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da4414e:::benchmark_data_smithi188_104537_object80609:head# 2024-04-01T19:36:20.013 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da45c55:::benchmark_data_smithi188_104537_object37947:head# 2024-04-01T19:36:20.013 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da4a44b:::benchmark_data_smithi188_104537_object14755:head# 2024-04-01T19:36:20.013 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da552a9:::benchmark_data_smithi188_104537_object16820:head# 2024-04-01T19:36:20.013 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da5a8b5:::benchmark_data_smithi188_104537_object35952:head# 2024-04-01T19:36:20.014 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da5edd1:::benchmark_data_smithi188_104537_object149497:head# 2024-04-01T19:36:20.014 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da5eef8:::benchmark_data_smithi188_104537_object158446:head# 2024-04-01T19:36:20.015 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da5efaa:::benchmark_data_smithi188_104537_object38651:head# 2024-04-01T19:36:20.015 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da6dd5b:::benchmark_data_smithi188_104537_object79620:head# 2024-04-01T19:36:20.015 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da74ae6:::benchmark_data_smithi188_104537_object48601:head# 2024-04-01T19:36:20.016 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da86515:::benchmark_data_smithi188_104537_object139271:head# 2024-04-01T19:36:20.016 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da87829:::benchmark_data_smithi188_104537_object149906:head# 2024-04-01T19:36:20.016 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da8867b:::benchmark_data_smithi188_104537_object159290:head# 2024-04-01T19:36:20.017 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da89d6f:::benchmark_data_smithi188_104537_object145296:head# 2024-04-01T19:36:20.017 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da8d981:::benchmark_data_smithi188_104537_object170070:head# 2024-04-01T19:36:20.018 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da8f478:::benchmark_data_smithi188_104537_object14156:head# 2024-04-01T19:36:20.018 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da90438:::benchmark_data_smithi188_104537_object158199:head# 2024-04-01T19:36:20.019 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5da9f2c1:::benchmark_data_smithi188_104537_object115944:head# 2024-04-01T19:36:20.019 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5daa42d6:::benchmark_data_smithi188_104537_object48311:head# 2024-04-01T19:36:20.019 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dab16d8:::benchmark_data_smithi188_104537_object150354:head# 2024-04-01T19:36:20.020 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dab25a7:::benchmark_data_smithi188_104537_object71515:head# 2024-04-01T19:36:20.020 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dabcded:::benchmark_data_smithi188_104537_object80656:head# 2024-04-01T19:36:20.020 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dabdbc7:::benchmark_data_smithi188_104537_object19525:head# 2024-04-01T19:36:20.021 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dac4fde:::benchmark_data_smithi188_104537_object111938:head# 2024-04-01T19:36:20.021 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dac9e82:::benchmark_data_smithi188_104537_object95282:head# 2024-04-01T19:36:20.022 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dacb8bd:::benchmark_data_smithi188_104537_object156496:head# 2024-04-01T19:36:20.022 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dacc965:::benchmark_data_smithi188_104537_object92849:head# 2024-04-01T19:36:20.023 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dad0508:::benchmark_data_smithi188_104537_object59810:head# 2024-04-01T19:36:20.026 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_blocked_ops 2024-04-01T19:36:20.027 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dad7189:::benchmark_data_smithi188_104537_object106158:head# 2024-04-01T19:36:20.027 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dad7cab:::benchmark_data_smithi188_104537_object80412:head# 2024-04-01T19:36:20.027 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dad9c5c:::benchmark_data_smithi188_104537_object17737:head# 2024-04-01T19:36:20.027 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5daecb76:::benchmark_data_smithi188_104537_object95752:head# 2024-04-01T19:36:20.027 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5db04ca2:::benchmark_data_smithi188_104537_object120585:head# 2024-04-01T19:36:20.028 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5db0a2c5:::benchmark_data_smithi188_104537_object153305:head# 2024-04-01T19:36:20.029 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5db0aa3f:::benchmark_data_smithi188_104537_object25775:head# 2024-04-01T19:36:20.029 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5db18eea:::benchmark_data_smithi188_104537_object53096:head# 2024-04-01T19:36:20.031 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5db1c79a:::benchmark_data_smithi188_104537_object43956:head# 2024-04-01T19:36:20.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5db24ec8:::benchmark_data_smithi188_104537_object52535:head# 2024-04-01T19:36:20.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5db2d81b:::benchmark_data_smithi188_104537_object41989:head# 2024-04-01T19:36:20.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5db427d2:::benchmark_data_smithi188_104537_object134473:head# 2024-04-01T19:36:20.035 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5db467d9:::benchmark_data_smithi188_104537_object161514:head# 2024-04-01T19:36:20.035 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5db4a7cd:::benchmark_data_smithi188_104537_object97071:head# 2024-04-01T19:36:20.036 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5db59ce6:::benchmark_data_smithi188_104537_object166729:head# 2024-04-01T19:36:20.036 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5db59ff9:::benchmark_data_smithi188_104537_object120902:head# 2024-04-01T19:36:20.037 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5db5b309:::benchmark_data_smithi188_104537_object56198:head# 2024-04-01T19:36:20.037 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5db5b8c3:::benchmark_data_smithi188_104537_object129650:head# 2024-04-01T19:36:20.038 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5db5c490:::benchmark_data_smithi188_104537_object153963:head# 2024-04-01T19:36:20.038 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5db5c912:::benchmark_data_smithi188_104537_object163143:head# 2024-04-01T19:36:20.038 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5db5d4cd:::benchmark_data_smithi188_104537_object167128:head# 2024-04-01T19:36:20.039 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5db60c08:::benchmark_data_smithi188_104537_object15629:head# 2024-04-01T19:36:20.039 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5db66ace:::benchmark_data_smithi188_104537_object154141:head# 2024-04-01T19:36:20.040 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5db67bcd:::benchmark_data_smithi188_104537_object15633:head# 2024-04-01T19:36:20.040 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5db7d560:::benchmark_data_smithi188_104537_object135638:head# 2024-04-01T19:36:20.041 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5db875bf:::benchmark_data_smithi188_104537_object46898:head# 2024-04-01T19:36:20.041 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5db8b62b:::benchmark_data_smithi188_104537_object163403:head# 2024-04-01T19:36:20.041 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dba3a43:::benchmark_data_smithi188_104537_object151653:head# 2024-04-01T19:36:20.042 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dbabdd9:::benchmark_data_smithi188_104537_object26166:head# 2024-04-01T19:36:20.042 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dbacb36:::benchmark_data_smithi188_104537_object117295:head# 2024-04-01T19:36:20.043 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dbb7348:::benchmark_data_smithi188_104537_object32114:head# 2024-04-01T19:36:20.043 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:20.044 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dbc4e12:::benchmark_data_smithi188_104537_object151624:head# 2024-04-01T19:36:20.044 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dbc7ca5:::benchmark_data_smithi188_104537_object147083:head# 2024-04-01T19:36:20.044 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dbc95f0:::benchmark_data_smithi188_104537_object92920:head# 2024-04-01T19:36:20.045 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dbdbb6b:::benchmark_data_smithi188_104537_object21610:head# 2024-04-01T19:36:20.045 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dbe6e73:::benchmark_data_smithi188_104537_object89457:head# 2024-04-01T19:36:20.046 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dbe99f0:::benchmark_data_smithi188_104537_object113420:head# 2024-04-01T19:36:20.046 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dbeaf64:::benchmark_data_smithi188_104537_object67812:head# 2024-04-01T19:36:20.047 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dbeeec7:::benchmark_data_smithi188_104537_object144924:head# 2024-04-01T19:36:20.047 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dbf0df1:::benchmark_data_smithi188_104537_object45279:head# 2024-04-01T19:36:20.048 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dbf0e85:::benchmark_data_smithi188_104537_object49575:head# 2024-04-01T19:36:20.048 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dbf5a25:::benchmark_data_smithi188_104537_object134060:head# 2024-04-01T19:36:20.049 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dbfd8b8:::benchmark_data_smithi188_104537_object43043:head# 2024-04-01T19:36:20.049 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dbfefa4:::benchmark_data_smithi188_104537_object69516:head# 2024-04-01T19:36:20.049 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dc04619:::benchmark_data_smithi188_104537_object46710:head# 2024-04-01T19:36:20.050 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dc059b8:::benchmark_data_smithi188_104537_object145960:head# 2024-04-01T19:36:20.050 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dc0c6d0:::benchmark_data_smithi188_104537_object123059:head# 2024-04-01T19:36:20.051 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dc0ef65:::benchmark_data_smithi188_104537_object103134:head# 2024-04-01T19:36:20.051 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dc116e7:::benchmark_data_smithi188_104537_object37066:head# 2024-04-01T19:36:20.052 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dc15e3f:::benchmark_data_smithi188_104537_object160905:head# 2024-04-01T19:36:20.052 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dc16745:::benchmark_data_smithi188_104537_object146152:head# 2024-04-01T19:36:20.053 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dc1d452:::benchmark_data_smithi188_104537_object164243:head# 2024-04-01T19:36:20.053 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dc20dfd:::benchmark_data_smithi188_104537_object19735:head# 2024-04-01T19:36:20.053 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dc265c5:::benchmark_data_smithi188_104537_object159371:head# 2024-04-01T19:36:20.054 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dc2e125:::benchmark_data_smithi188_104537_object89005:head# 2024-04-01T19:36:20.054 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dc2eb7b:::benchmark_data_smithi188_104537_object54915:head# 2024-04-01T19:36:20.055 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dc3dea3:::benchmark_data_smithi188_104537_object94598:head# 2024-04-01T19:36:20.055 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dc52c8e:::benchmark_data_smithi188_104537_object147327:head# 2024-04-01T19:36:20.056 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dc55b7f:::benchmark_data_smithi188_104537_object156241:head# 2024-04-01T19:36:20.056 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dc5edb4:::benchmark_data_smithi188_104537_object124335:head# 2024-04-01T19:36:20.057 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dc6deef:::benchmark_data_smithi188_104537_object15780:head# 2024-04-01T19:36:20.057 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dc80db5:::benchmark_data_smithi188_104537_object134310:head# 2024-04-01T19:36:20.058 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dc88290:::benchmark_data_smithi188_104537_object112139:head# 2024-04-01T19:36:20.058 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dc91615:::benchmark_data_smithi188_104537_object142689:head# 2024-04-01T19:36:20.059 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dc93661:::benchmark_data_smithi188_104537_object47955:head# 2024-04-01T19:36:20.059 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dc95752:::benchmark_data_smithi188_104537_object38398:head# 2024-04-01T19:36:20.059 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dc9a39e:::benchmark_data_smithi188_104537_object41189:head# 2024-04-01T19:36:20.059 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dc9b261:::benchmark_data_smithi188_104537_object40421:head# 2024-04-01T19:36:20.060 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dc9b539:::benchmark_data_smithi188_104537_object23549:head# 2024-04-01T19:36:20.060 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dca1594:::benchmark_data_smithi188_104537_object94565:head# 2024-04-01T19:36:20.061 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dca4934:::benchmark_data_smithi188_104537_object122000:head# 2024-04-01T19:36:20.061 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dca5e87:::benchmark_data_smithi188_104537_object48405:head# 2024-04-01T19:36:20.061 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dcb326f:::benchmark_data_smithi188_104537_object163001:head# 2024-04-01T19:36:20.062 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dcbc37a:::benchmark_data_smithi188_104537_object84671:head# 2024-04-01T19:36:20.062 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dcbc5a7:::benchmark_data_smithi188_104537_object17435:head# 2024-04-01T19:36:20.062 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dcc821b:::benchmark_data_smithi188_104537_object76453:head# 2024-04-01T19:36:20.063 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dcde385:::benchmark_data_smithi188_104537_object20136:head# 2024-04-01T19:36:20.064 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dce2f22:::benchmark_data_smithi188_104537_object132062:head# 2024-04-01T19:36:20.064 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dcea6fa:::benchmark_data_smithi188_104537_object12774:head# 2024-04-01T19:36:20.065 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dcecf8a:::benchmark_data_smithi188_104537_object68324:head# 2024-04-01T19:36:20.065 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dcf88aa:::benchmark_data_smithi188_104537_object43700:head# 2024-04-01T19:36:20.065 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd036fb:::benchmark_data_smithi188_104537_object116570:head# 2024-04-01T19:36:20.066 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd09a93:::benchmark_data_smithi188_104537_object64112:head# 2024-04-01T19:36:20.066 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd0d49d:::benchmark_data_smithi188_104537_object20572:head# 2024-04-01T19:36:20.067 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd1af7c:::benchmark_data_smithi188_104537_object125282:head# 2024-04-01T19:36:20.067 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd1e666:::benchmark_data_smithi188_104537_object163711:head# 2024-04-01T19:36:20.067 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd2c2a5:::benchmark_data_smithi188_104537_object108088:head# 2024-04-01T19:36:20.068 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd30ba5:::benchmark_data_smithi188_104537_object139505:head# 2024-04-01T19:36:20.068 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:36:20.069 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd314ff:::benchmark_data_smithi188_104537_object44021:head# 2024-04-01T19:36:20.069 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd3b1c5:::benchmark_data_smithi188_104537_object61817:head# 2024-04-01T19:36:20.069 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd414b3:::benchmark_data_smithi188_104537_object166169:head# 2024-04-01T19:36:20.070 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd44ef0:::benchmark_data_smithi188_104537_object152023:head# 2024-04-01T19:36:20.070 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd462c4:::benchmark_data_smithi188_104537_object110831:head# 2024-04-01T19:36:20.071 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:20.071 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:36:20.072 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd518d6:::benchmark_data_smithi188_104537_object38438:head# 2024-04-01T19:36:20.072 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd566cb:::benchmark_data_smithi188_104537_object31042:head# 2024-04-01T19:36:20.072 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd57efd:::benchmark_data_smithi188_104537_object103466:head# 2024-04-01T19:36:20.073 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd5b9c1:::benchmark_data_smithi188_104537_object34085:head# 2024-04-01T19:36:20.074 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd5e121:::benchmark_data_smithi188_104537_object141584:head# 2024-04-01T19:36:20.074 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd65679:::benchmark_data_smithi188_104537_object141442:head# 2024-04-01T19:36:20.075 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd6c53a:::benchmark_data_smithi188_104537_object117638:head# 2024-04-01T19:36:20.075 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd6f103:::benchmark_data_smithi188_104537_object40788:head# 2024-04-01T19:36:20.076 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd7174c:::benchmark_data_smithi188_104537_object77230:head# 2024-04-01T19:36:20.076 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd81f82:::benchmark_data_smithi188_104537_object115403:head# 2024-04-01T19:36:20.077 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd89a6b:::benchmark_data_smithi188_104537_object130848:head# 2024-04-01T19:36:20.077 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd8f5aa:::benchmark_data_smithi188_104537_object37888:head# 2024-04-01T19:36:20.078 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd909ca:::benchmark_data_smithi188_104537_object37406:head# 2024-04-01T19:36:20.078 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd90dd4:::benchmark_data_smithi188_104537_object80640:head# 2024-04-01T19:36:20.079 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dd9abb6:::benchmark_data_smithi188_104537_object95270:head# 2024-04-01T19:36:20.079 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dda1a35:::benchmark_data_smithi188_104537_object164520:head# 2024-04-01T19:36:20.079 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dda4442:::benchmark_data_smithi188_104537_object42553:head# 2024-04-01T19:36:20.079 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ddab528:::benchmark_data_smithi188_104537_object58218:head# 2024-04-01T19:36:20.080 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ddb4e52:::benchmark_data_smithi188_104537_object15541:head# 2024-04-01T19:36:20.080 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ddbafd2:::benchmark_data_smithi188_104537_object52972:head# 2024-04-01T19:36:20.081 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ddc4425:::benchmark_data_smithi188_104537_object16102:head# 2024-04-01T19:36:20.081 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ddd8b44:::benchmark_data_smithi188_104537_object111920:head# 2024-04-01T19:36:20.082 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ddd9d1e:::benchmark_data_smithi188_104537_object69954:head# 2024-04-01T19:36:20.082 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dde6542:::benchmark_data_smithi188_104537_object15650:head# 2024-04-01T19:36:20.083 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ddf459f:::benchmark_data_smithi188_104537_object18869:head# 2024-04-01T19:36:20.083 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5de09aca:::benchmark_data_smithi188_104537_object164455:head# 2024-04-01T19:36:20.083 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5de0d925:::benchmark_data_smithi188_104537_object141939:head# 2024-04-01T19:36:20.083 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5de0fb00:::benchmark_data_smithi188_104537_object165326:head# 2024-04-01T19:36:20.084 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5de101ad:::benchmark_data_smithi188_104537_object121479:head# 2024-04-01T19:36:20.084 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5de1256d:::benchmark_data_smithi188_104537_object149043:head# 2024-04-01T19:36:20.085 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5de144f6:::benchmark_data_smithi188_104537_object32570:head# 2024-04-01T19:36:20.085 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5de19293:::benchmark_data_smithi188_104537_object92037:head# 2024-04-01T19:36:20.085 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5de192ef:::benchmark_data_smithi188_104537_object114415:head# 2024-04-01T19:36:20.086 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5de1ecb4:::benchmark_data_smithi188_104537_object76162:head# 2024-04-01T19:36:20.086 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5de2a3a6:::benchmark_data_smithi188_104537_object109966:head# 2024-04-01T19:36:20.086 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5de4096c:::benchmark_data_smithi188_104537_object140555:head# 2024-04-01T19:36:20.087 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5de457ab:::benchmark_data_smithi188_104537_object44118:head# 2024-04-01T19:36:20.087 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5de6327a:::benchmark_data_smithi188_104537_object41452:head# 2024-04-01T19:36:20.087 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5de7d08a:::benchmark_data_smithi188_104537_object109429:head# 2024-04-01T19:36:20.088 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5de7fead:::benchmark_data_smithi188_104537_object72690:head# 2024-04-01T19:36:20.088 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5de85ed1:::benchmark_data_smithi188_104537_object108180:head# 2024-04-01T19:36:20.088 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5de96a02:::benchmark_data_smithi188_104537_object11942:head# 2024-04-01T19:36:20.089 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dea4944:::benchmark_data_smithi188_104537_object39334:head# 2024-04-01T19:36:20.089 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dea86b5:::benchmark_data_smithi188_104537_object74854:head# 2024-04-01T19:36:20.090 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5deaf3b9:::benchmark_data_smithi188_104537_object30220:head# 2024-04-01T19:36:20.090 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dec0621:::benchmark_data_smithi188_104537_object102430:head# 2024-04-01T19:36:20.090 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dec2445:::benchmark_data_smithi188_104537_object71456:head# 2024-04-01T19:36:20.091 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dec2b4f:::benchmark_data_smithi188_104537_object57623:head# 2024-04-01T19:36:20.091 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ded45d4:::benchmark_data_smithi188_104537_object59441:head# 2024-04-01T19:36:20.092 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dedaf52:::benchmark_data_smithi188_104537_object113051:head# 2024-04-01T19:36:20.092 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dedbc1b:::benchmark_data_smithi188_104537_object160658:head# 2024-04-01T19:36:20.092 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dee431e:::benchmark_data_smithi188_104537_object13695:head# 2024-04-01T19:36:20.093 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dee4fe5:::benchmark_data_smithi188_104537_object89566:head# 2024-04-01T19:36:20.093 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dee766c:::benchmark_data_smithi188_104537_object154284:head# 2024-04-01T19:36:20.094 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dee7cbb:::benchmark_data_smithi188_104537_object102711:head# 2024-04-01T19:36:20.094 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5deeab1e:::benchmark_data_smithi188_104537_object153767:head# 2024-04-01T19:36:20.094 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5defa5fa:::benchmark_data_smithi188_104537_object113812:head# 2024-04-01T19:36:20.095 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5defb437:::benchmark_data_smithi188_104537_object30779:head# 2024-04-01T19:36:20.095 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df0d9a9:::benchmark_data_smithi188_104537_object27244:head# 2024-04-01T19:36:20.096 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df12580:::benchmark_data_smithi188_104537_object23739:head# 2024-04-01T19:36:20.096 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df173dd:::benchmark_data_smithi188_104537_object56272:head# 2024-04-01T19:36:20.096 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df19708:::benchmark_data_smithi188_104537_object150723:head# 2024-04-01T19:36:20.097 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df1998f:::benchmark_data_smithi188_104537_object115983:head# 2024-04-01T19:36:20.097 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df1b577:::benchmark_data_smithi188_104537_object78085:head# 2024-04-01T19:36:20.097 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df1d87f:::benchmark_data_smithi188_104537_object167367:head# 2024-04-01T19:36:20.098 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df270a7:::benchmark_data_smithi188_104537_object164459:head# 2024-04-01T19:36:20.098 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df2c760:::benchmark_data_smithi188_104537_object34297:head# 2024-04-01T19:36:20.099 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df307bb:::benchmark_data_smithi188_104537_object26493:head# 2024-04-01T19:36:20.099 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df308b2:::benchmark_data_smithi188_104537_object28621:head# 2024-04-01T19:36:20.100 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df3ea88:::benchmark_data_smithi188_104537_object136313:head# 2024-04-01T19:36:20.100 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df3fee7:::benchmark_data_smithi188_104537_object83363:head# 2024-04-01T19:36:20.100 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df4d9f0:::benchmark_data_smithi188_104537_object115815:head# 2024-04-01T19:36:20.101 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df52db2:::benchmark_data_smithi188_104537_object123008:head# 2024-04-01T19:36:20.101 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df5622d:::benchmark_data_smithi188_104537_object49676:head# 2024-04-01T19:36:20.102 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df62ee4:::benchmark_data_smithi188_104537_object113236:head# 2024-04-01T19:36:20.102 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df64918:::benchmark_data_smithi188_104537_object66888:head# 2024-04-01T19:36:20.102 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df6adb1:::benchmark_data_smithi188_104537_object111064:head# 2024-04-01T19:36:20.103 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df6c9b8:::benchmark_data_smithi188_104537_object166715:head# 2024-04-01T19:36:20.103 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df76219:::benchmark_data_smithi188_104537_object17733:head# 2024-04-01T19:36:20.104 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df80d2b:::benchmark_data_smithi188_104537_object45515:head# 2024-04-01T19:36:20.104 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df811ba:::benchmark_data_smithi188_104537_object159251:head# 2024-04-01T19:36:20.104 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df87061:::benchmark_data_smithi188_104537_object85041:head# 2024-04-01T19:36:20.105 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df899d8:::benchmark_data_smithi188_104537_object149832:head# 2024-04-01T19:36:20.105 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df8a9f8:::benchmark_data_smithi188_104537_object21604:head# 2024-04-01T19:36:20.106 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df943e6:::benchmark_data_smithi188_104537_object97421:head# 2024-04-01T19:36:20.106 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df975f7:::benchmark_data_smithi188_104537_object32638:head# 2024-04-01T19:36:20.107 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5df98784:::benchmark_data_smithi188_104537_object170128:head# 2024-04-01T19:36:20.107 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dfb510e:::benchmark_data_smithi188_104537_object149306:head# 2024-04-01T19:36:20.107 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dfb9372:::benchmark_data_smithi188_104537_object41419:head# 2024-04-01T19:36:20.108 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dfc7c08:::benchmark_data_smithi188_104537_object95429:head# 2024-04-01T19:36:20.108 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dfcbfa7:::benchmark_data_smithi188_104537_object21986:head# 2024-04-01T19:36:20.109 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dfd603e:::benchmark_data_smithi188_104537_object170971:head# 2024-04-01T19:36:20.109 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dfe32d1:::benchmark_data_smithi188_104537_object19195:head# 2024-04-01T19:36:20.109 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dfe38ff:::benchmark_data_smithi188_104537_object69178:head# 2024-04-01T19:36:20.110 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dfe8f19:::benchmark_data_smithi188_104537_object48109:head# 2024-04-01T19:36:20.110 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dfeab74:::benchmark_data_smithi188_104537_object113329:head# 2024-04-01T19:36:20.111 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dfee924:::benchmark_data_smithi188_104537_object28590:head# 2024-04-01T19:36:20.111 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5dff8548:::benchmark_data_smithi188_104537_object76495:head# 2024-04-01T19:36:20.111 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e005aa5:::benchmark_data_smithi188_104537_object17866:head# 2024-04-01T19:36:20.112 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e00aa1a:::benchmark_data_smithi188_104537_object105836:head# 2024-04-01T19:36:20.112 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e01aae5:::benchmark_data_smithi188_104537_object163833:head# 2024-04-01T19:36:20.113 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e01ac25:::benchmark_data_smithi188_104537_object119886:head# 2024-04-01T19:36:20.113 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e023031:::benchmark_data_smithi188_104537_object15746:head# 2024-04-01T19:36:20.114 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0271aa:::benchmark_data_smithi188_104537_object124817:head# 2024-04-01T19:36:20.114 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0287b1:::benchmark_data_smithi188_104537_object133356:head# 2024-04-01T19:36:20.114 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e02f69b:::benchmark_data_smithi188_104537_object127561:head# 2024-04-01T19:36:20.115 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e03e3f3:::benchmark_data_smithi188_104537_object117243:head# 2024-04-01T19:36:20.115 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0404bf:::benchmark_data_smithi188_104537_object73735:head# 2024-04-01T19:36:20.116 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0408c4:::benchmark_data_smithi188_104537_object85896:head# 2024-04-01T19:36:20.116 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e044ee0:::benchmark_data_smithi188_104537_object87016:head# 2024-04-01T19:36:20.116 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e054166:::benchmark_data_smithi188_104537_object36568:head# 2024-04-01T19:36:20.117 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e05b0b9:::benchmark_data_smithi188_104537_object104761:head# 2024-04-01T19:36:20.117 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e05b3d1:::benchmark_data_smithi188_104537_object46668:head# 2024-04-01T19:36:20.118 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e066d3f:::benchmark_data_smithi188_104537_object64249:head# 2024-04-01T19:36:20.118 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e068e14:::benchmark_data_smithi188_104537_object127249:head# 2024-04-01T19:36:20.119 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0708d7:::benchmark_data_smithi188_104537_object106927:head# 2024-04-01T19:36:20.119 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e07c174:::benchmark_data_smithi188_104537_object27923:head# 2024-04-01T19:36:20.119 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e07c7e5:::benchmark_data_smithi188_104537_object89865:head# 2024-04-01T19:36:20.120 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0853e5:::benchmark_data_smithi188_104537_object86714:head# 2024-04-01T19:36:20.120 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e08a9b7:::benchmark_data_smithi188_104537_object44706:head# 2024-04-01T19:36:20.120 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0976d5:::benchmark_data_smithi188_104537_object26562:head# 2024-04-01T19:36:20.121 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0a4dfc:::benchmark_data_smithi188_104537_object162912:head# 2024-04-01T19:36:20.121 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0b4f8d:::benchmark_data_smithi188_104537_object66653:head# 2024-04-01T19:36:20.122 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0bac41:::benchmark_data_smithi188_104537_object60269:head# 2024-04-01T19:36:20.122 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0bc931:::benchmark_data_smithi188_104537_object164895:head# 2024-04-01T19:36:20.122 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0bda53:::benchmark_data_smithi188_104537_object102017:head# 2024-04-01T19:36:20.123 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0c3d88:::benchmark_data_smithi188_104537_object112402:head# 2024-04-01T19:36:20.123 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0d1dfa:::benchmark_data_smithi188_104537_object52324:head# 2024-04-01T19:36:20.124 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0d6ae3:::benchmark_data_smithi188_104537_object34193:head# 2024-04-01T19:36:20.124 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0d726e:::benchmark_data_smithi188_104537_object27470:head# 2024-04-01T19:36:20.124 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0e276b:::benchmark_data_smithi188_104537_object32787:head# 2024-04-01T19:36:20.125 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0e3288:::benchmark_data_smithi188_104537_object42353:head# 2024-04-01T19:36:20.125 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0e7a98:::benchmark_data_smithi188_104537_object54938:head# 2024-04-01T19:36:20.125 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0e7d36:::benchmark_data_smithi188_104537_object110993:head# 2024-04-01T19:36:20.126 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0ec75d:::benchmark_data_smithi188_104537_object102786:head# 2024-04-01T19:36:20.126 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0ef56b:::benchmark_data_smithi188_104537_object112286:head# 2024-04-01T19:36:20.127 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0f26bc:::benchmark_data_smithi188_104537_object36506:head# 2024-04-01T19:36:20.127 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0f31c2:::benchmark_data_smithi188_104537_object110059:head# 2024-04-01T19:36:20.128 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0f634d:::benchmark_data_smithi188_104537_object85579:head# 2024-04-01T19:36:20.128 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0f817a:::benchmark_data_smithi188_104537_object23801:head# 2024-04-01T19:36:20.128 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e0ff05d:::benchmark_data_smithi188_104537_object96295:head# 2024-04-01T19:36:20.129 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e10a45d:::benchmark_data_smithi188_104537_object136771:head# 2024-04-01T19:36:20.129 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e10fdf9:::benchmark_data_smithi188_104537_object12752:head# 2024-04-01T19:36:20.130 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e113430:::benchmark_data_smithi188_104537_object99242:head# 2024-04-01T19:36:20.130 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e115c77:::benchmark_data_smithi188_104537_object52061:head# 2024-04-01T19:36:20.130 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e11625f:::benchmark_data_smithi188_104537_object110585:head# 2024-04-01T19:36:20.131 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e126254:::benchmark_data_smithi188_104537_object19713:head# 2024-04-01T19:36:20.131 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e12802e:::benchmark_data_smithi188_104537_object145506:head# 2024-04-01T19:36:20.132 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e129a4c:::benchmark_data_smithi188_104537_object138638:head# 2024-04-01T19:36:20.132 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e12c471:::benchmark_data_smithi188_104537_object59071:head# 2024-04-01T19:36:20.133 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e132f8d:::benchmark_data_smithi188_104537_object159498:head# 2024-04-01T19:36:20.133 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e133a63:::benchmark_data_smithi188_104537_object158516:head# 2024-04-01T19:36:20.134 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e13b05c:::benchmark_data_smithi188_104537_object37265:head# 2024-04-01T19:36:20.134 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e13e7a9:::benchmark_data_smithi188_104537_object62731:head# 2024-04-01T19:36:20.134 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e13f56b:::benchmark_data_smithi188_104537_object105589:head# 2024-04-01T19:36:20.135 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e140d36:::benchmark_data_smithi188_104537_object106220:head# 2024-04-01T19:36:20.135 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e15ae74:::benchmark_data_smithi188_104537_object123208:head# 2024-04-01T19:36:20.136 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e15c759:::benchmark_data_smithi188_104537_object151850:head# 2024-04-01T19:36:20.136 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e167084:::benchmark_data_smithi188_104537_object63573:head# 2024-04-01T19:36:20.136 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e16a215:::benchmark_data_smithi188_104537_object20499:head# 2024-04-01T19:36:20.137 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e17482c:::benchmark_data_smithi188_104537_object157439:head# 2024-04-01T19:36:20.137 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e17b369:::benchmark_data_smithi188_104537_object74503:head# 2024-04-01T19:36:20.138 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e17c73b:::benchmark_data_smithi188_104537_object45565:head# 2024-04-01T19:36:20.138 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e17db83:::benchmark_data_smithi188_104537_object112130:head# 2024-04-01T19:36:20.138 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e18a76b:::benchmark_data_smithi188_104537_object68921:head# 2024-04-01T19:36:20.139 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e18f564:::benchmark_data_smithi188_104537_object132083:head# 2024-04-01T19:36:20.139 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e196755:::benchmark_data_smithi188_104537_object158106:head# 2024-04-01T19:36:20.140 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e19cc98:::benchmark_data_smithi188_104537_object39713:head# 2024-04-01T19:36:20.140 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e19d5fc:::benchmark_data_smithi188_104537_object96725:head# 2024-04-01T19:36:20.140 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e1a7ae4:::benchmark_data_smithi188_104537_object82297:head# 2024-04-01T19:36:20.141 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e1aff58:::benchmark_data_smithi188_104537_object72375:head# 2024-04-01T19:36:20.141 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e1b0c28:::benchmark_data_smithi188_104537_object108190:head# 2024-04-01T19:36:20.142 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e1b3f66:::benchmark_data_smithi188_104537_object146104:head# 2024-04-01T19:36:20.142 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e1b63ba:::benchmark_data_smithi188_104537_object35094:head# 2024-04-01T19:36:20.143 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e1bb3d9:::benchmark_data_smithi188_104537_object31025:head# 2024-04-01T19:36:20.143 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e1bccff:::benchmark_data_smithi188_104537_object60071:head# 2024-04-01T19:36:20.143 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e1d4a71:::benchmark_data_smithi188_104537_object47124:head# 2024-04-01T19:36:20.144 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e1d9938:::benchmark_data_smithi188_104537_object68569:head# 2024-04-01T19:36:20.144 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e1d9fbb:::benchmark_data_smithi188_104537_object132619:head# 2024-04-01T19:36:20.145 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e1dcda7:::benchmark_data_smithi188_104537_object135483:head# 2024-04-01T19:36:20.145 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e1ddf0b:::benchmark_data_smithi188_104537_object152628:head# 2024-04-01T19:36:20.145 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e1e0856:::benchmark_data_smithi188_104537_object149734:head# 2024-04-01T19:36:20.146 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e1fc308:::benchmark_data_smithi188_104537_object63414:head# 2024-04-01T19:36:20.146 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e201958:::benchmark_data_smithi188_104537_object92075:head# 2024-04-01T19:36:20.147 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e20c6c8:::benchmark_data_smithi188_104537_object47242:head# 2024-04-01T19:36:20.147 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e21a322:::benchmark_data_smithi188_104537_object72813:head# 2024-04-01T19:36:20.147 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e21c474:::benchmark_data_smithi188_104537_object48463:head# 2024-04-01T19:36:20.148 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e2238a0:::benchmark_data_smithi188_104537_object116662:head# 2024-04-01T19:36:20.148 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e230cc4:::benchmark_data_smithi188_104537_object70263:head# 2024-04-01T19:36:20.149 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e23a155:::benchmark_data_smithi188_104537_object22613:head# 2024-04-01T19:36:20.149 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e23bc25:::benchmark_data_smithi188_104537_object86674:head# 2024-04-01T19:36:20.149 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e240495:::benchmark_data_smithi188_104537_object67221:head# 2024-04-01T19:36:20.150 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e24d0f0:::benchmark_data_smithi188_104537_object55048:head# 2024-04-01T19:36:20.150 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e2567e5:::benchmark_data_smithi188_104537_object32424:head# 2024-04-01T19:36:20.151 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e25c49b:::benchmark_data_smithi188_104537_object116449:head# 2024-04-01T19:36:20.151 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e261d55:::benchmark_data_smithi188_104537_object98491:head# 2024-04-01T19:36:20.152 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e262fad:::benchmark_data_smithi188_104537_object41099:head# 2024-04-01T19:36:20.152 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e26d437:::benchmark_data_smithi188_104537_object82146:head# 2024-04-01T19:36:20.152 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e26fedb:::benchmark_data_smithi188_104537_object119350:head# 2024-04-01T19:36:20.153 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e2886a3:::benchmark_data_smithi188_104537_object29209:head# 2024-04-01T19:36:20.153 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e28b365:::benchmark_data_smithi188_104537_object37491:head# 2024-04-01T19:36:20.154 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e28e62a:::benchmark_data_smithi188_104537_object161839:head# 2024-04-01T19:36:20.154 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e28eaef:::benchmark_data_smithi188_104537_object113031:head# 2024-04-01T19:36:20.154 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e297b1e:::benchmark_data_smithi188_104537_object119536:head# 2024-04-01T19:36:20.155 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e2b55a8:::benchmark_data_smithi188_104537_object95411:head# 2024-04-01T19:36:20.155 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e2b758f:::benchmark_data_smithi188_104537_object21017:head# 2024-04-01T19:36:20.156 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e2c70b5:::benchmark_data_smithi188_104537_object126026:head# 2024-04-01T19:36:20.156 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e2cd750:::benchmark_data_smithi188_104537_object156969:head# 2024-04-01T19:36:20.156 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e2cef1b:::benchmark_data_smithi188_104537_object19584:head# 2024-04-01T19:36:20.157 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e2d118b:::benchmark_data_smithi188_104537_object107416:head# 2024-04-01T19:36:20.157 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e2d2453:::benchmark_data_smithi188_104537_object108637:head# 2024-04-01T19:36:20.158 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e2da495:::benchmark_data_smithi188_104537_object152941:head# 2024-04-01T19:36:20.158 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e2dadd6:::benchmark_data_smithi188_104537_object24457:head# 2024-04-01T19:36:20.158 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e2dcef9:::benchmark_data_smithi188_104537_object59912:head# 2024-04-01T19:36:20.159 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e2de567:::benchmark_data_smithi188_104537_object78691:head# 2024-04-01T19:36:20.159 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e2e0850:::benchmark_data_smithi188_104537_object127700:head# 2024-04-01T19:36:20.160 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e2e55c4:::benchmark_data_smithi188_104537_object80461:head# 2024-04-01T19:36:20.160 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e2e610a:::benchmark_data_smithi188_104537_object98621:head# 2024-04-01T19:36:20.161 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e2ec04d:::benchmark_data_smithi188_104537_object76024:head# 2024-04-01T19:36:20.161 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e2eeeb8:::benchmark_data_smithi188_104537_object42670:head# 2024-04-01T19:36:20.162 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e2f24d8:::benchmark_data_smithi188_104537_object123599:head# 2024-04-01T19:36:20.162 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e2f5240:::benchmark_data_smithi188_104537_object142065:head# 2024-04-01T19:36:20.162 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e2f7117:::benchmark_data_smithi188_104537_object28272:head# 2024-04-01T19:36:20.163 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e2f8552:::benchmark_data_smithi188_104537_object35026:head# 2024-04-01T19:36:20.163 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e2fa51b:::benchmark_data_smithi188_104537_object33526:head# 2024-04-01T19:36:20.163 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e2fecac:::benchmark_data_smithi188_104537_object115621:head# 2024-04-01T19:36:20.164 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e30fab6:::benchmark_data_smithi188_104537_object122809:head# 2024-04-01T19:36:20.164 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e313557:::benchmark_data_smithi188_104537_object137214:head# 2024-04-01T19:36:20.165 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e31f9ed:::benchmark_data_smithi188_104537_object108688:head# 2024-04-01T19:36:20.165 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e31fac3:::benchmark_data_smithi188_104537_object83579:head# 2024-04-01T19:36:20.166 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e322fb9:::benchmark_data_smithi188_104537_object135467:head# 2024-04-01T19:36:20.166 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e326e0d:::benchmark_data_smithi188_104537_object167629:head# 2024-04-01T19:36:20.167 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e3344ce:::benchmark_data_smithi188_104537_object133236:head# 2024-04-01T19:36:20.167 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e335920:::benchmark_data_smithi188_104537_object78774:head# 2024-04-01T19:36:20.167 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e33d0b1:::benchmark_data_smithi188_104537_object77268:head# 2024-04-01T19:36:20.168 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e33db40:::benchmark_data_smithi188_104537_object84559:head# 2024-04-01T19:36:20.168 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e34b0f0:::benchmark_data_smithi188_104537_object24963:head# 2024-04-01T19:36:20.169 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e35d217:::benchmark_data_smithi188_104537_object109724:head# 2024-04-01T19:36:20.169 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e35d2a0:::benchmark_data_smithi188_104537_object92403:head# 2024-04-01T19:36:20.169 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e360e37:::benchmark_data_smithi188_104537_object96357:head# 2024-04-01T19:36:20.170 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e362888:::benchmark_data_smithi188_104537_object100450:head# 2024-04-01T19:36:20.170 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e36c864:::benchmark_data_smithi188_104537_object104829:head# 2024-04-01T19:36:20.171 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e376e53:::benchmark_data_smithi188_104537_object111989:head# 2024-04-01T19:36:20.171 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e379ded:::benchmark_data_smithi188_104537_object122133:head# 2024-04-01T19:36:20.171 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e38a3f4:::benchmark_data_smithi188_104537_object156472:head# 2024-04-01T19:36:20.172 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e38e9f1:::benchmark_data_smithi188_104537_object101071:head# 2024-04-01T19:36:20.172 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:36:20.173 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e3900dd:::benchmark_data_smithi188_104537_object147603:head# 2024-04-01T19:36:20.173 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e395106:::benchmark_data_smithi188_104537_object60752:head# 2024-04-01T19:36:20.173 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e3982f3:::benchmark_data_smithi188_104537_object137645:head# 2024-04-01T19:36:20.175 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e399ba0:::benchmark_data_smithi188_104537_object154443:head# 2024-04-01T19:36:20.175 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e39bd0f:::benchmark_data_smithi188_104537_object166597:head# 2024-04-01T19:36:20.175 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e3a39ec:::benchmark_data_smithi188_104537_object70104:head# 2024-04-01T19:36:20.175 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e3a6e9e:::benchmark_data_smithi188_104537_object78372:head# 2024-04-01T19:36:20.175 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e3b0463:::benchmark_data_smithi188_104537_object158467:head# 2024-04-01T19:36:20.176 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e3b4620:::benchmark_data_smithi188_104537_object109057:head# 2024-04-01T19:36:20.176 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e3cfb9e:::benchmark_data_smithi188_104537_object56636:head# 2024-04-01T19:36:20.176 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e3d9431:::benchmark_data_smithi188_104537_object146589:head# 2024-04-01T19:36:20.176 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e3db791:::benchmark_data_smithi188_104537_object152862:head# 2024-04-01T19:36:20.177 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e3de70e:::benchmark_data_smithi188_104537_object27976:head# 2024-04-01T19:36:20.177 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e3e0aad:::benchmark_data_smithi188_104537_object15453:head# 2024-04-01T19:36:20.178 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e3eb553:::benchmark_data_smithi188_104537_object133633:head# 2024-04-01T19:36:20.178 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e3ee36c:::benchmark_data_smithi188_104537_object81240:head# 2024-04-01T19:36:20.179 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e3efcb9:::benchmark_data_smithi188_104537_object112337:head# 2024-04-01T19:36:20.179 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e3f844e:::benchmark_data_smithi188_104537_object70711:head# 2024-04-01T19:36:20.179 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e3f8e1b:::benchmark_data_smithi188_104537_object41533:head# 2024-04-01T19:36:20.180 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e40fba9:::benchmark_data_smithi188_104537_object23942:head# 2024-04-01T19:36:20.180 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e4171ee:::benchmark_data_smithi188_104537_object157577:head# 2024-04-01T19:36:20.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e417b6e:::benchmark_data_smithi188_104537_object56970:head# 2024-04-01T19:36:20.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e41e808:::benchmark_data_smithi188_104537_object55451:head# 2024-04-01T19:36:20.182 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e4235f8:::benchmark_data_smithi188_104537_object144230:head# 2024-04-01T19:36:20.182 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e427c9f:::benchmark_data_smithi188_104537_object56654:head# 2024-04-01T19:36:20.182 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e43a337:::benchmark_data_smithi188_104537_object133710:head# 2024-04-01T19:36:20.183 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e43afae:::benchmark_data_smithi188_104537_object104502:head# 2024-04-01T19:36:20.183 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e44086c:::benchmark_data_smithi188_104537_object109513:head# 2024-04-01T19:36:20.184 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e450498:::benchmark_data_smithi188_104537_object171382:head# 2024-04-01T19:36:20.184 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e45bd83:::benchmark_data_smithi188_104537_object115632:head# 2024-04-01T19:36:20.185 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e45e815:::benchmark_data_smithi188_104537_object42562:head# 2024-04-01T19:36:20.185 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e45ef1b:::benchmark_data_smithi188_104537_object60591:head# 2024-04-01T19:36:20.185 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e462146:::benchmark_data_smithi188_104537_object131152:head# 2024-04-01T19:36:20.186 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e4666e7:::benchmark_data_smithi188_104537_object140846:head# 2024-04-01T19:36:20.186 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e471af6:::benchmark_data_smithi188_104537_object160164:head# 2024-04-01T19:36:20.187 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e472001:::benchmark_data_smithi188_104537_object75336:head# 2024-04-01T19:36:20.187 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e47306e:::benchmark_data_smithi188_104537_object30649:head# 2024-04-01T19:36:20.187 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e4859d7:::benchmark_data_smithi188_104537_object63878:head# 2024-04-01T19:36:20.188 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e485c94:::benchmark_data_smithi188_104537_object57070:head# 2024-04-01T19:36:20.188 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e486d2e:::benchmark_data_smithi188_104537_object106508:head# 2024-04-01T19:36:20.189 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e48eef2:::benchmark_data_smithi188_104537_object115505:head# 2024-04-01T19:36:20.189 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e497eb9:::benchmark_data_smithi188_104537_object31441:head# 2024-04-01T19:36:20.189 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e499edd:::benchmark_data_smithi188_104537_object93133:head# 2024-04-01T19:36:20.190 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e4a506d:::benchmark_data_smithi188_104537_object86767:head# 2024-04-01T19:36:20.190 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e4b23ac:::benchmark_data_smithi188_104537_object53157:head# 2024-04-01T19:36:20.191 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e4c74c2:::benchmark_data_smithi188_104537_object91524:head# 2024-04-01T19:36:20.191 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e4c8f01:::benchmark_data_smithi188_104537_object22169:head# 2024-04-01T19:36:20.192 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e4c9e3d:::benchmark_data_smithi188_104537_object131793:head# 2024-04-01T19:36:20.192 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e4ce5ea:::benchmark_data_smithi188_104537_object62714:head# 2024-04-01T19:36:20.192 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e4d0806:::benchmark_data_smithi188_104537_object160970:head# 2024-04-01T19:36:20.193 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e4d8c3b:::benchmark_data_smithi188_104537_object165568:head# 2024-04-01T19:36:20.193 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e4e0c94:::benchmark_data_smithi188_104537_object51492:head# 2024-04-01T19:36:20.194 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e4edd56:::benchmark_data_smithi188_104537_object93507:head# 2024-04-01T19:36:20.194 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e4f075b:::benchmark_data_smithi188_104537_object58378:head# 2024-04-01T19:36:20.194 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e4fb063:::benchmark_data_smithi188_104537_object72006:head# 2024-04-01T19:36:20.195 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e4fcf81:::benchmark_data_smithi188_104537_object14547:head# 2024-04-01T19:36:20.195 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e504f69:::benchmark_data_smithi188_104537_object108844:head# 2024-04-01T19:36:20.196 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5060ba:::benchmark_data_smithi188_104537_object161536:head# 2024-04-01T19:36:20.197 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e506437:::benchmark_data_smithi188_104537_object76142:head# 2024-04-01T19:36:20.197 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e50afcf:::benchmark_data_smithi188_104537_object92505:head# 2024-04-01T19:36:20.197 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e50be6f:::benchmark_data_smithi188_104537_object76907:head# 2024-04-01T19:36:20.198 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e51762b:::benchmark_data_smithi188_104537_object21047:head# 2024-04-01T19:36:20.198 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e525f6f:::benchmark_data_smithi188_104537_object160420:head# 2024-04-01T19:36:20.199 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e52d997:::benchmark_data_smithi188_104537_object74163:head# 2024-04-01T19:36:20.199 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5308e6:::benchmark_data_smithi188_104537_object62073:head# 2024-04-01T19:36:20.200 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e53e7de:::benchmark_data_smithi188_104537_object83766:head# 2024-04-01T19:36:20.200 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e54656a:::benchmark_data_smithi188_104537_object155091:head# 2024-04-01T19:36:20.201 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e54bf15:::benchmark_data_smithi188_104537_object80085:head# 2024-04-01T19:36:20.201 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e54db9a:::benchmark_data_smithi188_104537_object134959:head# 2024-04-01T19:36:20.202 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e556972:::benchmark_data_smithi188_104537_object12926:head# 2024-04-01T19:36:20.202 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e557f7e:::benchmark_data_smithi188_104537_object131486:head# 2024-04-01T19:36:20.202 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:20.203 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e559b36:::benchmark_data_smithi188_104537_object106764:head# 2024-04-01T19:36:20.203 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5602e7:::benchmark_data_smithi188_104537_object59217:head# 2024-04-01T19:36:20.203 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5658ee:::benchmark_data_smithi188_104537_object136033:head# 2024-04-01T19:36:20.203 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e566580:::benchmark_data_smithi188_104537_object43738:head# 2024-04-01T19:36:20.204 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5677da:::benchmark_data_smithi188_104537_object113730:head# 2024-04-01T19:36:20.204 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e56b078:::benchmark_data_smithi188_104537_object118142:head# 2024-04-01T19:36:20.205 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e56bd4b:::benchmark_data_smithi188_104537_object99549:head# 2024-04-01T19:36:20.205 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e573c14:::benchmark_data_smithi188_104537_object62424:head# 2024-04-01T19:36:20.205 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e591ad1:::benchmark_data_smithi188_104537_object160843:head# 2024-04-01T19:36:20.206 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e592c1b:::benchmark_data_smithi188_104537_object70940:head# 2024-04-01T19:36:20.206 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e599ead:::benchmark_data_smithi188_104537_object44709:head# 2024-04-01T19:36:20.207 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e59ad55:::benchmark_data_smithi188_104537_object157786:head# 2024-04-01T19:36:20.207 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5a384f:::benchmark_data_smithi188_104537_object66288:head# 2024-04-01T19:36:20.208 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5a5d04:::benchmark_data_smithi188_104537_object131718:head# 2024-04-01T19:36:20.208 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5a9532:::benchmark_data_smithi188_104537_object158050:head# 2024-04-01T19:36:20.209 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5ab810:::benchmark_data_smithi188_104537_object146847:head# 2024-04-01T19:36:20.209 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5ac024:::benchmark_data_smithi188_104537_object75879:head# 2024-04-01T19:36:20.210 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5ac22f:::benchmark_data_smithi188_104537_object155559:head# 2024-04-01T19:36:20.210 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5b23a2:::benchmark_data_smithi188_104537_object60460:head# 2024-04-01T19:36:20.211 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5c679c:::benchmark_data_smithi188_104537_object64543:head# 2024-04-01T19:36:20.211 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5c90c8:::benchmark_data_smithi188_104537_object35616:head# 2024-04-01T19:36:20.211 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5c9ef8:::benchmark_data_smithi188_104537_object150774:head# 2024-04-01T19:36:20.211 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5cae49:::benchmark_data_smithi188_104537_object43293:head# 2024-04-01T19:36:20.212 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5cf2f3:::benchmark_data_smithi188_104537_object50992:head# 2024-04-01T19:36:20.212 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5cf3ff:::benchmark_data_smithi188_104537_object151418:head# 2024-04-01T19:36:20.213 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5d1228:::benchmark_data_smithi188_104537_object39119:head# 2024-04-01T19:36:20.213 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5ec3d9:::benchmark_data_smithi188_104537_object152738:head# 2024-04-01T19:36:20.214 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5edcd6:::benchmark_data_smithi188_104537_object90101:head# 2024-04-01T19:36:20.214 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5f06e2:::benchmark_data_smithi188_104537_object19507:head# 2024-04-01T19:36:20.215 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5f17cf:::benchmark_data_smithi188_104537_object125423:head# 2024-04-01T19:36:20.215 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5f980d:::benchmark_data_smithi188_104537_object160788:head# 2024-04-01T19:36:20.216 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5faaf8:::benchmark_data_smithi188_104537_object117925:head# 2024-04-01T19:36:20.216 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e5ff5a3:::benchmark_data_smithi188_104537_object25857:head# 2024-04-01T19:36:20.217 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e605e49:::benchmark_data_smithi188_104537_object171120:head# 2024-04-01T19:36:20.217 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e6096b2:::benchmark_data_smithi188_104537_object160823:head# 2024-04-01T19:36:20.217 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e60ccb9:::benchmark_data_smithi188_104537_object152247:head# 2024-04-01T19:36:20.218 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e61e152:::benchmark_data_smithi188_104537_object143274:head# 2024-04-01T19:36:20.218 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e621039:::benchmark_data_smithi188_104537_object150642:head# 2024-04-01T19:36:20.219 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e62ba32:::benchmark_data_smithi188_104537_object140684:head# 2024-04-01T19:36:20.219 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e62e8af:::benchmark_data_smithi188_104537_object31374:head# 2024-04-01T19:36:20.219 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e62f74d:::benchmark_data_smithi188_104537_object120136:head# 2024-04-01T19:36:20.220 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e63599e:::benchmark_data_smithi188_104537_object60673:head# 2024-04-01T19:36:20.221 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e636b03:::benchmark_data_smithi188_104537_object68579:head# 2024-04-01T19:36:20.221 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e6371ce:::benchmark_data_smithi188_104537_object128036:head# 2024-04-01T19:36:20.221 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e63f226:::benchmark_data_smithi188_104537_object141828:head# 2024-04-01T19:36:20.222 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e64bca3:::benchmark_data_smithi188_104537_object98309:head# 2024-04-01T19:36:20.222 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e64f77f:::benchmark_data_smithi188_104537_object138339:head# 2024-04-01T19:36:20.223 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e65a2b3:::benchmark_data_smithi188_104537_object57422:head# 2024-04-01T19:36:20.223 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e663c15:::benchmark_data_smithi188_104537_object85437:head# 2024-04-01T19:36:20.224 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:36:20.224 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e66afb1:::benchmark_data_smithi188_104537_object21690:head# 2024-04-01T19:36:20.224 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e66f943:::benchmark_data_smithi188_104537_object111712:head# 2024-04-01T19:36:20.224 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e679ec5:::benchmark_data_smithi188_104537_object117808:head# 2024-04-01T19:36:20.225 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e67a67e:::benchmark_data_smithi188_104537_object88195:head# 2024-04-01T19:36:20.225 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e68a5d4:::benchmark_data_smithi188_104537_object59137:head# 2024-04-01T19:36:20.226 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:20.227 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:36:20.227 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e68bef4:::benchmark_data_smithi188_104537_object72316:head# 2024-04-01T19:36:20.227 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e68f5a6:::benchmark_data_smithi188_104537_object19972:head# 2024-04-01T19:36:20.227 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e68ffea:::benchmark_data_smithi188_104537_object106186:head# 2024-04-01T19:36:20.228 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e6924ef:::benchmark_data_smithi188_104537_object152540:head# 2024-04-01T19:36:20.228 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e69a5c1:::benchmark_data_smithi188_104537_object40321:head# 2024-04-01T19:36:20.228 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e69ddf1:::benchmark_data_smithi188_104537_object55081:head# 2024-04-01T19:36:20.228 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e6a33f8:::benchmark_data_smithi188_104537_object164620:head# 2024-04-01T19:36:20.229 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e6a64d6:::benchmark_data_smithi188_104537_object149354:head# 2024-04-01T19:36:20.229 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e6b8f87:::benchmark_data_smithi188_104537_object86812:head# 2024-04-01T19:36:20.229 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e6ba8ef:::benchmark_data_smithi188_104537_object84686:head# 2024-04-01T19:36:20.230 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e6cd6b2:::benchmark_data_smithi188_104537_object166490:head# 2024-04-01T19:36:20.230 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e6d223e:::benchmark_data_smithi188_104537_object117637:head# 2024-04-01T19:36:20.231 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e6d546d:::benchmark_data_smithi188_104537_object31416:head# 2024-04-01T19:36:20.231 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e6d95eb:::benchmark_data_smithi188_104537_object51194:head# 2024-04-01T19:36:20.231 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e6eb11b:::benchmark_data_smithi188_104537_object75537:head# 2024-04-01T19:36:20.232 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e6eb31d:::benchmark_data_smithi188_104537_object170115:head# 2024-04-01T19:36:20.232 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e6ecbe1:::benchmark_data_smithi188_104537_object141646:head# 2024-04-01T19:36:20.233 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e6ecf90:::benchmark_data_smithi188_104537_object135229:head# 2024-04-01T19:36:20.233 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e6f4588:::benchmark_data_smithi188_104537_object114709:head# 2024-04-01T19:36:20.233 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e6f78b4:::benchmark_data_smithi188_104537_object163399:head# 2024-04-01T19:36:20.234 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e6f812c:::benchmark_data_smithi188_104537_object51902:head# 2024-04-01T19:36:20.234 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e70cebd:::benchmark_data_smithi188_104537_object154653:head# 2024-04-01T19:36:20.235 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e70e008:::benchmark_data_smithi188_104537_object166268:head# 2024-04-01T19:36:20.235 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e71d637:::benchmark_data_smithi188_104537_object153856:head# 2024-04-01T19:36:20.236 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e725244:::benchmark_data_smithi188_104537_object128609:head# 2024-04-01T19:36:20.236 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e72c99f:::benchmark_data_smithi188_104537_object145609:head# 2024-04-01T19:36:20.237 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e733d79:::benchmark_data_smithi188_104537_object38731:head# 2024-04-01T19:36:20.237 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e734ba0:::benchmark_data_smithi188_104537_object81026:head# 2024-04-01T19:36:20.238 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e7459d4:::benchmark_data_smithi188_104537_object68841:head# 2024-04-01T19:36:20.238 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e7527f1:::benchmark_data_smithi188_104537_object94341:head# 2024-04-01T19:36:20.239 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e753297:::benchmark_data_smithi188_104537_object152838:head# 2024-04-01T19:36:20.239 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e757119:::benchmark_data_smithi188_104537_object92127:head# 2024-04-01T19:36:20.240 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e757dcc:::benchmark_data_smithi188_104537_object40555:head# 2024-04-01T19:36:20.240 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e75a668:::benchmark_data_smithi188_104537_object95056:head# 2024-04-01T19:36:20.240 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e75abc5:::benchmark_data_smithi188_104537_object85843:head# 2024-04-01T19:36:20.241 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e75bb5d:::benchmark_data_smithi188_104537_object118576:head# 2024-04-01T19:36:20.241 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:36:20.242 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e75e6bb:::benchmark_data_smithi188_104537_object104094:head# 2024-04-01T19:36:20.242 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e761894:::benchmark_data_smithi188_104537_object155452:head# 2024-04-01T19:36:20.242 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e76ff33:::benchmark_data_smithi188_104537_object145148:head# 2024-04-01T19:36:20.243 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e77c89c:::benchmark_data_smithi188_104537_object141942:head# 2024-04-01T19:36:20.243 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e77fdd7:::benchmark_data_smithi188_104537_object112967:head# 2024-04-01T19:36:20.244 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e784d05:::benchmark_data_smithi188_104537_object80522:head# 2024-04-01T19:36:20.244 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e78da52:::benchmark_data_smithi188_104537_object47766:head# 2024-04-01T19:36:20.245 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e78e30e:::benchmark_data_smithi188_104537_object100705:head# 2024-04-01T19:36:20.245 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e795cde:::benchmark_data_smithi188_104537_object37034:head# 2024-04-01T19:36:20.245 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e796e9d:::benchmark_data_smithi188_104537_object93026:head# 2024-04-01T19:36:20.246 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e798d1f:::benchmark_data_smithi188_104537_object141206:head# 2024-04-01T19:36:20.246 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e79c17a:::benchmark_data_smithi188_104537_object117963:head# 2024-04-01T19:36:20.247 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e79db2a:::benchmark_data_smithi188_104537_object171511:head# 2024-04-01T19:36:20.247 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e7a0208:::benchmark_data_smithi188_104537_object76025:head# 2024-04-01T19:36:20.248 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e7a5349:::benchmark_data_smithi188_104537_object130200:head# 2024-04-01T19:36:20.248 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e7a624e:::benchmark_data_smithi188_104537_object97570:head# 2024-04-01T19:36:20.248 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e7ad1a6:::benchmark_data_smithi188_104537_object138230:head# 2024-04-01T19:36:20.249 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e7ad78f:::benchmark_data_smithi188_104537_object126273:head# 2024-04-01T19:36:20.249 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e7bc09d:::benchmark_data_smithi188_104537_object115482:head# 2024-04-01T19:36:20.250 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e7c4bbf:::benchmark_data_smithi188_104537_object135323:head# 2024-04-01T19:36:20.250 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e7cdbf3:::benchmark_data_smithi188_104537_object15431:head# 2024-04-01T19:36:20.250 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e7d5f05:::benchmark_data_smithi188_104537_object63924:head# 2024-04-01T19:36:20.251 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e7e211a:::benchmark_data_smithi188_104537_object132176:head# 2024-04-01T19:36:20.251 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e7f517a:::benchmark_data_smithi188_104537_object158660:head# 2024-04-01T19:36:20.252 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e811ad4:::benchmark_data_smithi188_104537_object40344:head# 2024-04-01T19:36:20.252 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e811eb2:::benchmark_data_smithi188_104537_object153107:head# 2024-04-01T19:36:20.253 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e81254c:::benchmark_data_smithi188_104537_object104320:head# 2024-04-01T19:36:20.253 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e81cba7:::benchmark_data_smithi188_104537_object65079:head# 2024-04-01T19:36:20.254 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e8221dd:::benchmark_data_smithi188_104537_object170806:head# 2024-04-01T19:36:20.254 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e8263d1:::benchmark_data_smithi188_104537_object69396:head# 2024-04-01T19:36:20.254 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e82ac17:::benchmark_data_smithi188_104537_object167849:head# 2024-04-01T19:36:20.255 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e82ba35:::benchmark_data_smithi188_104537_object43769:head# 2024-04-01T19:36:20.255 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e834b4d:::benchmark_data_smithi188_104537_object133749:head# 2024-04-01T19:36:20.256 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e834d86:::benchmark_data_smithi188_104537_object139011:head# 2024-04-01T19:36:20.256 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e83dfc5:::benchmark_data_smithi188_104537_object142755:head# 2024-04-01T19:36:20.257 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e83e1a9:::benchmark_data_smithi188_104537_object50054:head# 2024-04-01T19:36:20.257 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e842fea:::benchmark_data_smithi188_104537_object58343:head# 2024-04-01T19:36:20.257 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e848a72:::benchmark_data_smithi188_104537_object88849:head# 2024-04-01T19:36:20.258 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e858117:::benchmark_data_smithi188_104537_object98740:head# 2024-04-01T19:36:20.258 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e85dd82:::benchmark_data_smithi188_104537_object163282:head# 2024-04-01T19:36:20.259 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e860ed5:::benchmark_data_smithi188_104537_object155051:head# 2024-04-01T19:36:20.259 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e860eef:::benchmark_data_smithi188_104537_object143654:head# 2024-04-01T19:36:20.259 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e861ff1:::benchmark_data_smithi188_104537_object114690:head# 2024-04-01T19:36:20.260 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e868558:::benchmark_data_smithi188_104537_object152550:head# 2024-04-01T19:36:20.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:20 smithi062 ceph-mon[44211]: pgmap v894: 17 pgs: 2 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 10668/321960 objects degraded (3.313%); 64 MiB/s, 1.03k objects/s recovering 2024-04-01T19:36:20.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:20 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:36:20.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:20 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:36:20.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:20 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 10668/321960 objects degraded (3.313%), 2 pgs degraded (PG_DEGRADED) 2024-04-01T19:36:20.261 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e869959:::benchmark_data_smithi188_104537_object113497:head# 2024-04-01T19:36:20.261 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e86d618:::benchmark_data_smithi188_104537_object107037:head# 2024-04-01T19:36:20.261 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e8831ec:::benchmark_data_smithi188_104537_object32648:head# 2024-04-01T19:36:20.262 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e88b7b9:::benchmark_data_smithi188_104537_object63331:head# 2024-04-01T19:36:20.262 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e89de22:::benchmark_data_smithi188_104537_object40496:head# 2024-04-01T19:36:20.262 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e8a2c5c:::benchmark_data_smithi188_104537_object112184:head# 2024-04-01T19:36:20.262 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e8a5e2d:::benchmark_data_smithi188_104537_object124726:head# 2024-04-01T19:36:20.263 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e8a7572:::benchmark_data_smithi188_104537_object56532:head# 2024-04-01T19:36:20.263 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e8b117b:::benchmark_data_smithi188_104537_object107646:head# 2024-04-01T19:36:20.264 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:36:20.264 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e8b79ed:::benchmark_data_smithi188_104537_object58262:head# 2024-04-01T19:36:20.264 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e8bc1f1:::benchmark_data_smithi188_104537_object122538:head# 2024-04-01T19:36:20.264 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e8bfa29:::benchmark_data_smithi188_104537_object156051:head# 2024-04-01T19:36:20.265 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e8c17d5:::benchmark_data_smithi188_104537_object62934:head# 2024-04-01T19:36:20.265 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e8d8714:::benchmark_data_smithi188_104537_object80812:head# 2024-04-01T19:36:20.266 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e8f6267:::benchmark_data_smithi188_104537_object122624:head# 2024-04-01T19:36:20.266 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e8fd338:::benchmark_data_smithi188_104537_object87730:head# 2024-04-01T19:36:20.266 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e927317:::benchmark_data_smithi188_104537_object147822:head# 2024-04-01T19:36:20.267 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e93135c:::benchmark_data_smithi188_104537_object117914:head# 2024-04-01T19:36:20.267 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e932116:::benchmark_data_smithi188_104537_object169008:head# 2024-04-01T19:36:20.267 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e93b31e:::benchmark_data_smithi188_104537_object53453:head# 2024-04-01T19:36:20.268 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e93e6ee:::benchmark_data_smithi188_104537_object16283:head# 2024-04-01T19:36:20.268 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e94b813:::benchmark_data_smithi188_104537_object74677:head# 2024-04-01T19:36:20.269 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e94ced1:::benchmark_data_smithi188_104537_object33478:head# 2024-04-01T19:36:20.269 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e94e9bf:::benchmark_data_smithi188_104537_object74879:head# 2024-04-01T19:36:20.269 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e95ebf0:::benchmark_data_smithi188_104537_object171318:head# 2024-04-01T19:36:20.270 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e964228:::benchmark_data_smithi188_104537_object141133:head# 2024-04-01T19:36:20.270 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e96a1f7:::benchmark_data_smithi188_104537_object89073:head# 2024-04-01T19:36:20.271 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e97847b:::benchmark_data_smithi188_104537_object127153:head# 2024-04-01T19:36:20.271 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e979ccb:::benchmark_data_smithi188_104537_object150584:head# 2024-04-01T19:36:20.271 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e983571:::benchmark_data_smithi188_104537_object13895:head# 2024-04-01T19:36:20.272 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e9845dc:::benchmark_data_smithi188_104537_object54380:head# 2024-04-01T19:36:20.272 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e98d5a6:::benchmark_data_smithi188_104537_object110679:head# 2024-04-01T19:36:20.273 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e9930c5:::benchmark_data_smithi188_104537_object11676:head# 2024-04-01T19:36:20.273 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e993f5b:::benchmark_data_smithi188_104537_object124138:head# 2024-04-01T19:36:20.273 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e99d05a:::benchmark_data_smithi188_104537_object144273:head# 2024-04-01T19:36:20.274 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e9a0cf3:::benchmark_data_smithi188_104537_object150537:head# 2024-04-01T19:36:20.274 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e9a93a5:::benchmark_data_smithi188_104537_object64675:head# 2024-04-01T19:36:20.275 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e9a990f:::benchmark_data_smithi188_104537_object41506:head# 2024-04-01T19:36:20.275 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e9afd90:::benchmark_data_smithi188_104537_object13853:head# 2024-04-01T19:36:20.276 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e9b1c82:::benchmark_data_smithi188_104537_object34206:head# 2024-04-01T19:36:20.276 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e9c75e2:::benchmark_data_smithi188_104537_object43045:head# 2024-04-01T19:36:20.276 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e9d6829:::benchmark_data_smithi188_104537_object99435:head# 2024-04-01T19:36:20.277 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e9de5e3:::benchmark_data_smithi188_104537_object66261:head# 2024-04-01T19:36:20.277 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e9e0a68:::benchmark_data_smithi188_104537_object78501:head# 2024-04-01T19:36:20.278 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e9e362c:::benchmark_data_smithi188_104537_object136067:head# 2024-04-01T19:36:20.278 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e9e6d7a:::benchmark_data_smithi188_104537_object46473:head# 2024-04-01T19:36:20.279 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e9f7f73:::benchmark_data_smithi188_104537_object34572:head# 2024-04-01T19:36:20.279 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e9fd711:::benchmark_data_smithi188_104537_object94561:head# 2024-04-01T19:36:20.279 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e9fe5d3:::benchmark_data_smithi188_104537_object16865:head# 2024-04-01T19:36:20.280 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e9ff92d:::benchmark_data_smithi188_104537_object66725:head# 2024-04-01T19:36:20.280 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5e9ffdfa:::benchmark_data_smithi188_104537_object21208:head# 2024-04-01T19:36:20.281 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea01bbd:::benchmark_data_smithi188_104537_object25066:head# 2024-04-01T19:36:20.281 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea03ef4:::benchmark_data_smithi188_104537_object98581:head# 2024-04-01T19:36:20.281 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea08c78:::benchmark_data_smithi188_104537_object164666:head# 2024-04-01T19:36:20.282 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea09fe7:::benchmark_data_smithi188_104537_object58799:head# 2024-04-01T19:36:20.282 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea0c56a:::benchmark_data_smithi188_104537_object109770:head# 2024-04-01T19:36:20.283 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea13a27:::benchmark_data_smithi188_104537_object144721:head# 2024-04-01T19:36:20.283 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:36:20.284 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea22970:::benchmark_data_smithi188_104537_object110562:head# 2024-04-01T19:36:20.284 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea29dc1:::benchmark_data_smithi188_104537_object82899:head# 2024-04-01T19:36:20.284 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea2a785:::benchmark_data_smithi188_104537_object52757:head# 2024-04-01T19:36:20.284 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea4bd94:::benchmark_data_smithi188_104537_object12692:head# 2024-04-01T19:36:20.285 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea5ec56:::benchmark_data_smithi188_104537_object90851:head# 2024-04-01T19:36:20.285 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea60cc8:::benchmark_data_smithi188_104537_object139082:head# 2024-04-01T19:36:20.286 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea628e6:::benchmark_data_smithi188_104537_object69492:head# 2024-04-01T19:36:20.286 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea6d304:::benchmark_data_smithi188_104537_object38582:head# 2024-04-01T19:36:20.286 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea6fc6e:::benchmark_data_smithi188_104537_object85300:head# 2024-04-01T19:36:20.287 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea73414:::benchmark_data_smithi188_104537_object39543:head# 2024-04-01T19:36:20.287 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea7430f:::benchmark_data_smithi188_104537_object69781:head# 2024-04-01T19:36:20.287 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea7ce0e:::benchmark_data_smithi188_104537_object71206:head# 2024-04-01T19:36:20.288 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea87533:::benchmark_data_smithi188_104537_object147418:head# 2024-04-01T19:36:20.288 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea885b3:::benchmark_data_smithi188_104537_object12550:head# 2024-04-01T19:36:20.289 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea8c40d:::benchmark_data_smithi188_104537_object145004:head# 2024-04-01T19:36:20.289 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea92b62:::benchmark_data_smithi188_104537_object59118:head# 2024-04-01T19:36:20.289 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea9647a:::benchmark_data_smithi188_104537_object16006:head# 2024-04-01T19:36:20.290 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea9dc13:::benchmark_data_smithi188_104537_object171429:head# 2024-04-01T19:36:20.290 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea9e745:::benchmark_data_smithi188_104537_object53462:head# 2024-04-01T19:36:20.291 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea9ee3f:::benchmark_data_smithi188_104537_object91964:head# 2024-04-01T19:36:20.291 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ea9fbb2:::benchmark_data_smithi188_104537_object74656:head# 2024-04-01T19:36:20.291 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eaa7e20:::benchmark_data_smithi188_104537_object58155:head# 2024-04-01T19:36:20.292 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eaaf895:::benchmark_data_smithi188_104537_object110571:head# 2024-04-01T19:36:20.292 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eab2c79:::benchmark_data_smithi188_104537_object34966:head# 2024-04-01T19:36:20.293 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eababdd:::benchmark_data_smithi188_104537_object136879:head# 2024-04-01T19:36:20.293 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eac4ce6:::benchmark_data_smithi188_104537_object11914:head# 2024-04-01T19:36:20.294 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eac7903:::benchmark_data_smithi188_104537_object11675:head# 2024-04-01T19:36:20.294 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eacc152:::benchmark_data_smithi188_104537_object85580:head# 2024-04-01T19:36:20.294 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eadd44e:::benchmark_data_smithi188_104537_object143384:head# 2024-04-01T19:36:20.295 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eadd65d:::benchmark_data_smithi188_104537_object105515:head# 2024-04-01T19:36:20.295 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eadf523:::benchmark_data_smithi188_104537_object170915:head# 2024-04-01T19:36:20.296 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eae31ed:::benchmark_data_smithi188_104537_object26699:head# 2024-04-01T19:36:20.296 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eae90d7:::benchmark_data_smithi188_104537_object44506:head# 2024-04-01T19:36:20.296 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eaf09af:::benchmark_data_smithi188_104537_object131570:head# 2024-04-01T19:36:20.297 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eaf6b36:::benchmark_data_smithi188_104537_object156709:head# 2024-04-01T19:36:20.297 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eafeec6:::benchmark_data_smithi188_104537_object109105:head# 2024-04-01T19:36:20.298 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb09f4c:::benchmark_data_smithi188_104537_object43000:head# 2024-04-01T19:36:20.298 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb09f78:::benchmark_data_smithi188_104537_object147027:head# 2024-04-01T19:36:20.298 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb0dd2c:::benchmark_data_smithi188_104537_object164422:head# 2024-04-01T19:36:20.299 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb14272:::benchmark_data_smithi188_104537_object120824:head# 2024-04-01T19:36:20.299 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb213d6:::benchmark_data_smithi188_104537_object158811:head# 2024-04-01T19:36:20.300 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb237e1:::benchmark_data_smithi188_104537_object48828:head# 2024-04-01T19:36:20.300 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb237fb:::benchmark_data_smithi188_104537_object93491:head# 2024-04-01T19:36:20.301 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb23846:::benchmark_data_smithi188_104537_object104033:head# 2024-04-01T19:36:20.301 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb31a02:::benchmark_data_smithi188_104537_object85679:head# 2024-04-01T19:36:20.302 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb322c5:::benchmark_data_smithi188_104537_object127273:head# 2024-04-01T19:36:20.302 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb374ee:::benchmark_data_smithi188_104537_object143728:head# 2024-04-01T19:36:20.303 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb3a012:::benchmark_data_smithi188_104537_object148615:head# 2024-04-01T19:36:20.303 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb3a4be:::benchmark_data_smithi188_104537_object141632:head# 2024-04-01T19:36:20.303 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb3fd4b:::benchmark_data_smithi188_104537_object90499:head# 2024-04-01T19:36:20.304 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb4088e:::benchmark_data_smithi188_104537_object17407:head# 2024-04-01T19:36:20.304 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb4d1eb:::benchmark_data_smithi188_104537_object29525:head# 2024-04-01T19:36:20.305 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb5fbc8:::benchmark_data_smithi188_104537_object117812:head# 2024-04-01T19:36:20.305 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:36:20.306 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb6dad5:::benchmark_data_smithi188_104537_object18033:head# 2024-04-01T19:36:20.306 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb73c72:::benchmark_data_smithi188_104537_object52527:head# 2024-04-01T19:36:20.306 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb78cc6:::benchmark_data_smithi188_104537_object76796:head# 2024-04-01T19:36:20.307 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb7a39a:::benchmark_data_smithi188_104537_object86516:head# 2024-04-01T19:36:20.307 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb81655:::benchmark_data_smithi188_104537_object40886:head# 2024-04-01T19:36:20.307 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb81daf:::benchmark_data_smithi188_104537_object19559:head# 2024-04-01T19:36:20.308 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb8e4db:::benchmark_data_smithi188_104537_object26507:head# 2024-04-01T19:36:20.308 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb948b2:::benchmark_data_smithi188_104537_object49637:head# 2024-04-01T19:36:20.309 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eb9fce7:::benchmark_data_smithi188_104537_object22861:head# 2024-04-01T19:36:20.309 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ebaede6:::benchmark_data_smithi188_104537_object34131:head# 2024-04-01T19:36:20.309 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ebb195f:::benchmark_data_smithi188_104537_object73760:head# 2024-04-01T19:36:20.310 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ebb4f3c:::benchmark_data_smithi188_104537_object24296:head# 2024-04-01T19:36:20.310 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ebbee79:::benchmark_data_smithi188_104537_object77907:head# 2024-04-01T19:36:20.310 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ebc48cc:::benchmark_data_smithi188_104537_object23141:head# 2024-04-01T19:36:20.311 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ebc8eb5:::benchmark_data_smithi188_104537_object157781:head# 2024-04-01T19:36:20.311 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ebd30f0:::benchmark_data_smithi188_104537_object92322:head# 2024-04-01T19:36:20.312 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ebd4b12:::benchmark_data_smithi188_104537_object117686:head# 2024-04-01T19:36:20.312 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ebea645:::benchmark_data_smithi188_104537_object44822:head# 2024-04-01T19:36:20.313 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ebea859:::benchmark_data_smithi188_104537_object93003:head# 2024-04-01T19:36:20.313 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ebf93e7:::benchmark_data_smithi188_104537_object27355:head# 2024-04-01T19:36:20.313 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec03993:::benchmark_data_smithi188_104537_object51641:head# 2024-04-01T19:36:20.314 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec039d2:::benchmark_data_smithi188_104537_object153089:head# 2024-04-01T19:36:20.314 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec05277:::benchmark_data_smithi188_104537_object135600:head# 2024-04-01T19:36:20.315 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec08061:::benchmark_data_smithi188_104537_object155295:head# 2024-04-01T19:36:20.315 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec11411:::benchmark_data_smithi188_104537_object120227:head# 2024-04-01T19:36:20.315 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec18c3f:::benchmark_data_smithi188_104537_object81386:head# 2024-04-01T19:36:20.316 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec1926a:::benchmark_data_smithi188_104537_object121770:head# 2024-04-01T19:36:20.316 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec19354:::benchmark_data_smithi188_104537_object51158:head# 2024-04-01T19:36:20.317 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec20cb9:::benchmark_data_smithi188_104537_object11933:head# 2024-04-01T19:36:20.317 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec20fa7:::benchmark_data_smithi188_104537_object168514:head# 2024-04-01T19:36:20.318 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec2edfe:::benchmark_data_smithi188_104537_object42045:head# 2024-04-01T19:36:20.318 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec3705b:::benchmark_data_smithi188_104537_object121207:head# 2024-04-01T19:36:20.319 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec3a0b9:::benchmark_data_smithi188_104537_object136883:head# 2024-04-01T19:36:20.319 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:36:20.319 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec42d77:::benchmark_data_smithi188_104537_object115055:head# 2024-04-01T19:36:20.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec4a7b2:::benchmark_data_smithi188_104537_object29424:head# 2024-04-01T19:36:20.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec5c0aa:::benchmark_data_smithi188_104537_object33327:head# 2024-04-01T19:36:20.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec60875:::benchmark_data_smithi188_104537_object94980:head# 2024-04-01T19:36:20.321 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec73e22:::benchmark_data_smithi188_104537_object93569:head# 2024-04-01T19:36:20.321 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec815eb:::benchmark_data_smithi188_104537_object147677:head# 2024-04-01T19:36:20.322 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec81750:::benchmark_data_smithi188_104537_object19000:head# 2024-04-01T19:36:20.322 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec8a858:::benchmark_data_smithi188_104537_object170788:head# 2024-04-01T19:36:20.323 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec8eff6:::benchmark_data_smithi188_104537_object46566:head# 2024-04-01T19:36:20.323 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec948de:::benchmark_data_smithi188_104537_object156836:head# 2024-04-01T19:36:20.324 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec9798b:::benchmark_data_smithi188_104537_object27275:head# 2024-04-01T19:36:20.324 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec9aca4:::benchmark_data_smithi188_104537_object97321:head# 2024-04-01T19:36:20.325 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ec9eca0:::benchmark_data_smithi188_104537_object150160:head# 2024-04-01T19:36:20.325 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ecb3a57:::benchmark_data_smithi188_104537_object110813:head# 2024-04-01T19:36:20.326 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ecb9dbf:::benchmark_data_smithi188_104537_object72730:head# 2024-04-01T19:36:20.326 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ecc2832:::benchmark_data_smithi188_104537_object110018:head# 2024-04-01T19:36:20.326 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eccadd2:::benchmark_data_smithi188_104537_object78828:head# 2024-04-01T19:36:20.327 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:36:20.327 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:36:20.328 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ecccaf9:::benchmark_data_smithi188_104537_object115719:head# 2024-04-01T19:36:20.328 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ecd2a9d:::benchmark_data_smithi188_104537_object79748:head# 2024-04-01T19:36:20.328 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ecd72dd:::benchmark_data_smithi188_104537_object113233:head# 2024-04-01T19:36:20.329 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ecd9311:::benchmark_data_smithi188_104537_object57853:head# 2024-04-01T19:36:20.329 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ecd9f46:::benchmark_data_smithi188_104537_object54885:head# 2024-04-01T19:36:20.329 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ecdbea2:::benchmark_data_smithi188_104537_object26362:head# 2024-04-01T19:36:20.329 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ecdc694:::benchmark_data_smithi188_104537_object127188:head# 2024-04-01T19:36:20.330 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ecdd499:::benchmark_data_smithi188_104537_object17499:head# 2024-04-01T19:36:20.330 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ece62ee:::benchmark_data_smithi188_104537_object24044:head# 2024-04-01T19:36:20.331 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ecf053e:::benchmark_data_smithi188_104537_object65806:head# 2024-04-01T19:36:20.331 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ecf8aab:::benchmark_data_smithi188_104537_object44072:head# 2024-04-01T19:36:20.331 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ecf91ad:::benchmark_data_smithi188_104537_object123809:head# 2024-04-01T19:36:20.332 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ed04dad:::benchmark_data_smithi188_104537_object70204:head# 2024-04-01T19:36:20.332 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ed06113:::benchmark_data_smithi188_104537_object64598:head# 2024-04-01T19:36:20.332 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ed099af:::benchmark_data_smithi188_104537_object16521:head# 2024-04-01T19:36:20.333 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ed09d7a:::benchmark_data_smithi188_104537_object51122:head# 2024-04-01T19:36:20.333 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ed0e2c5:::benchmark_data_smithi188_104537_object90642:head# 2024-04-01T19:36:20.334 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ed103c2:::benchmark_data_smithi188_104537_object136398:head# 2024-04-01T19:36:20.334 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ed11358:::benchmark_data_smithi188_104537_object157462:head# 2024-04-01T19:36:20.335 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ed14f50:::benchmark_data_smithi188_104537_object78076:head# 2024-04-01T19:36:20.335 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ed16fd6:::benchmark_data_smithi188_104537_object48208:head# 2024-04-01T19:36:20.335 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ed256e7:::benchmark_data_smithi188_104537_object86689:head# 2024-04-01T19:36:20.336 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ed2ee53:::benchmark_data_smithi188_104537_object167279:head# 2024-04-01T19:36:20.336 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ed2f8c5:::benchmark_data_smithi188_104537_object75795:head# 2024-04-01T19:36:20.336 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ed42f1a:::benchmark_data_smithi188_104537_object52380:head# 2024-04-01T19:36:20.337 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ed4bd18:::benchmark_data_smithi188_104537_object156261:head# 2024-04-01T19:36:20.337 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ed55693:::benchmark_data_smithi188_104537_object91099:head# 2024-04-01T19:36:20.338 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ed5c480:::benchmark_data_smithi188_104537_object156357:head# 2024-04-01T19:36:20.338 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ed687d2:::benchmark_data_smithi188_104537_object35356:head# 2024-04-01T19:36:20.338 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ed69cbc:::benchmark_data_smithi188_104537_object128039:head# 2024-04-01T19:36:20.339 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ed6c46a:::benchmark_data_smithi188_104537_object153989:head# 2024-04-01T19:36:20.339 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ed76eb9:::benchmark_data_smithi188_104537_object41432:head# 2024-04-01T19:36:20.340 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ed8df91:::benchmark_data_smithi188_104537_object94759:head# 2024-04-01T19:36:20.340 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ed914ed:::benchmark_data_smithi188_104537_object63009:head# 2024-04-01T19:36:20.340 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ed976f0:::benchmark_data_smithi188_104537_object146778:head# 2024-04-01T19:36:20.341 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ed9ab4d:::benchmark_data_smithi188_104537_object93578:head# 2024-04-01T19:36:20.341 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eda3019:::benchmark_data_smithi188_104537_object99370:head# 2024-04-01T19:36:20.342 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5edac70e:::benchmark_data_smithi188_104537_object126487:head# 2024-04-01T19:36:20.342 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5edbcf4d:::benchmark_data_smithi188_104537_object32207:head# 2024-04-01T19:36:20.343 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5edd3435:::benchmark_data_smithi188_104537_object50854:head# 2024-04-01T19:36:20.343 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5edd5a32:::benchmark_data_smithi188_104537_object147022:head# 2024-04-01T19:36:20.343 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eddba0d:::benchmark_data_smithi188_104537_object24698:head# 2024-04-01T19:36:20.344 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eddd056:::benchmark_data_smithi188_104537_object165131:head# 2024-04-01T19:36:20.344 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5edde6f2:::benchmark_data_smithi188_104537_object167387:head# 2024-04-01T19:36:20.345 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ede317d:::benchmark_data_smithi188_104537_object85977:head# 2024-04-01T19:36:20.345 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ede3203:::benchmark_data_smithi188_104537_object31285:head# 2024-04-01T19:36:20.345 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5edeec8e:::benchmark_data_smithi188_104537_object98215:head# 2024-04-01T19:36:20.346 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5edf4dc7:::benchmark_data_smithi188_104537_object124158:head# 2024-04-01T19:36:20.346 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5edfb054:::benchmark_data_smithi188_104537_object141715:head# 2024-04-01T19:36:20.347 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5edff746:::benchmark_data_smithi188_104537_object87356:head# 2024-04-01T19:36:20.347 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ee01539:::benchmark_data_smithi188_104537_object127523:head# 2024-04-01T19:36:20.347 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ee0a7f6:::benchmark_data_smithi188_104537_object142418:head# 2024-04-01T19:36:20.348 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ee1f3a8:::benchmark_data_smithi188_104537_object90377:head# 2024-04-01T19:36:20.348 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ee20c44:::benchmark_data_smithi188_104537_object48032:head# 2024-04-01T19:36:20.348 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ee2aaf3:::benchmark_data_smithi188_104537_object166117:head# 2024-04-01T19:36:20.349 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ee350f9:::benchmark_data_smithi188_104537_object146631:head# 2024-04-01T19:36:20.349 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ee35866:::benchmark_data_smithi188_104537_object49886:head# 2024-04-01T19:36:20.350 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ee3db20:::benchmark_data_smithi188_104537_object116458:head# 2024-04-01T19:36:20.350 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ee423f7:::benchmark_data_smithi188_104537_object40695:head# 2024-04-01T19:36:20.351 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ee45ca1:::benchmark_data_smithi188_104537_object108897:head# 2024-04-01T19:36:20.351 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ee48b85:::benchmark_data_smithi188_104537_object120684:head# 2024-04-01T19:36:20.351 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ee65582:::benchmark_data_smithi188_104537_object135943:head# 2024-04-01T19:36:20.352 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:36:20.352 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ee6cb6e:::benchmark_data_smithi188_104537_object29187:head# 2024-04-01T19:36:20.352 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ee79b77:::benchmark_data_smithi188_104537_object21665:head# 2024-04-01T19:36:20.353 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ee7bedb:::benchmark_data_smithi188_104537_object126543:head# 2024-04-01T19:36:20.353 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ee81bf0:::benchmark_data_smithi188_104537_object36299:head# 2024-04-01T19:36:20.353 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ee83602:::benchmark_data_smithi188_104537_object160803:head# 2024-04-01T19:36:20.354 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ee85b20:::benchmark_data_smithi188_104537_object54466:head# 2024-04-01T19:36:20.355 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ee954aa:::benchmark_data_smithi188_104537_object39190:head# 2024-04-01T19:36:20.355 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ee9983c:::benchmark_data_smithi188_104537_object111411:head# 2024-04-01T19:36:20.355 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ee9afb0:::benchmark_data_smithi188_104537_object35978:head# 2024-04-01T19:36:20.356 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eea9ec2:::benchmark_data_smithi188_104537_object135186:head# 2024-04-01T19:36:20.356 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eeae412:::benchmark_data_smithi188_104537_object75412:head# 2024-04-01T19:36:20.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eeaf255:::benchmark_data_smithi188_104537_object20556:head# 2024-04-01T19:36:20.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eec06c3:::benchmark_data_smithi188_104537_object136835:head# 2024-04-01T19:36:20.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eec286b:::benchmark_data_smithi188_104537_object52546:head# 2024-04-01T19:36:20.358 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eec29d9:::benchmark_data_smithi188_104537_object154169:head# 2024-04-01T19:36:20.358 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:20 smithi022 ceph-mon[39439]: pgmap v894: 17 pgs: 2 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 10668/321960 objects degraded (3.313%); 64 MiB/s, 1.03k objects/s recovering 2024-04-01T19:36:20.358 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:20 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:36:20.359 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:20 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:36:20.359 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:20 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 10668/321960 objects degraded (3.313%), 2 pgs degraded (PG_DEGRADED) 2024-04-01T19:36:20.359 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eec357f:::benchmark_data_smithi188_104537_object163676:head# 2024-04-01T19:36:20.359 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eedfb1e:::benchmark_data_smithi188_104537_object169648:head# 2024-04-01T19:36:20.359 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eef34a2:::benchmark_data_smithi188_104537_object132133:head# 2024-04-01T19:36:20.359 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eef4554:::benchmark_data_smithi188_104537_object39570:head# 2024-04-01T19:36:20.360 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eef6733:::benchmark_data_smithi188_104537_object165176:head# 2024-04-01T19:36:20.360 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eef7ea4:::benchmark_data_smithi188_104537_object152893:head# 2024-04-01T19:36:20.360 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eefc2f6:::benchmark_data_smithi188_104537_object96107:head# 2024-04-01T19:36:20.361 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ef15cf7:::benchmark_data_smithi188_104537_object63350:head# 2024-04-01T19:36:20.361 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ef185af:::benchmark_data_smithi188_104537_object51884:head# 2024-04-01T19:36:20.362 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:20.362 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ef22e86:::benchmark_data_smithi188_104537_object96817:head# 2024-04-01T19:36:20.362 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ef264c6:::benchmark_data_smithi188_104537_object128990:head# 2024-04-01T19:36:20.363 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ef31e6f:::benchmark_data_smithi188_104537_object31960:head# 2024-04-01T19:36:20.363 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ef34fb7:::benchmark_data_smithi188_104537_object33459:head# 2024-04-01T19:36:20.364 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ef3d475:::benchmark_data_smithi188_104537_object171920:head# 2024-04-01T19:36:20.364 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ef46da4:::benchmark_data_smithi188_104537_object126397:head# 2024-04-01T19:36:20.365 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ef52275:::benchmark_data_smithi188_104537_object20786:head# 2024-04-01T19:36:20.365 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ef69499:::benchmark_data_smithi188_104537_object26568:head# 2024-04-01T19:36:20.365 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ef69d79:::benchmark_data_smithi188_104537_object137204:head# 2024-04-01T19:36:20.366 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ef6bad1:::benchmark_data_smithi188_104537_object73908:head# 2024-04-01T19:36:20.366 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ef78a90:::benchmark_data_smithi188_104537_object143995:head# 2024-04-01T19:36:20.367 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ef7b0e7:::benchmark_data_smithi188_104537_object71342:head# 2024-04-01T19:36:20.367 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ef8bf5a:::benchmark_data_smithi188_104537_object33108:head# 2024-04-01T19:36:20.368 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ef8c097:::benchmark_data_smithi188_104537_object143171:head# 2024-04-01T19:36:20.368 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ef8cbe5:::benchmark_data_smithi188_104537_object96545:head# 2024-04-01T19:36:20.369 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ef8cc99:::benchmark_data_smithi188_104537_object143638:head# 2024-04-01T19:36:20.369 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ef9d674:::benchmark_data_smithi188_104537_object49913:head# 2024-04-01T19:36:20.370 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5efa1b0c:::benchmark_data_smithi188_104537_object128606:head# 2024-04-01T19:36:20.370 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5efa4524:::benchmark_data_smithi188_104537_object161378:head# 2024-04-01T19:36:20.371 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5efabd5b:::benchmark_data_smithi188_104537_object18057:head# 2024-04-01T19:36:20.371 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5efae814:::benchmark_data_smithi188_104537_object148862:head# 2024-04-01T19:36:20.371 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5efb332f:::benchmark_data_smithi188_104537_object99377:head# 2024-04-01T19:36:20.372 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5efb4ce6:::benchmark_data_smithi188_104537_object154919:head# 2024-04-01T19:36:20.372 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5efbdcf1:::benchmark_data_smithi188_104537_object59372:head# 2024-04-01T19:36:20.372 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5efc27b5:::benchmark_data_smithi188_104537_object33198:head# 2024-04-01T19:36:20.373 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5efd6c0d:::benchmark_data_smithi188_104537_object100842:head# 2024-04-01T19:36:20.373 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5efe08ce:::benchmark_data_smithi188_104537_object121293:head# 2024-04-01T19:36:20.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:20 smithi188 ceph-mon[43939]: pgmap v894: 17 pgs: 2 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 10668/321960 objects degraded (3.313%); 64 MiB/s, 1.03k objects/s recovering 2024-04-01T19:36:20.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:20 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:36:20.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:20 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:36:20.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:20 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 10668/321960 objects degraded (3.313%), 2 pgs degraded (PG_DEGRADED) 2024-04-01T19:36:20.374 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5efe7fd7:::benchmark_data_smithi188_104537_object20274:head# 2024-04-01T19:36:20.375 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5efe96af:::benchmark_data_smithi188_104537_object81294:head# 2024-04-01T19:36:20.375 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5efebe75:::benchmark_data_smithi188_104537_object129933:head# 2024-04-01T19:36:20.375 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5eff7d97:::benchmark_data_smithi188_104537_object51871:head# 2024-04-01T19:36:20.376 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f001038:::benchmark_data_smithi188_104537_object68905:head# 2024-04-01T19:36:20.376 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f00a657:::benchmark_data_smithi188_104537_object60014:head# 2024-04-01T19:36:20.376 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f00ed6a:::benchmark_data_smithi188_104537_object16967:head# 2024-04-01T19:36:20.376 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f022b07:::benchmark_data_smithi188_104537_object149365:head# 2024-04-01T19:36:20.377 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f025448:::benchmark_data_smithi188_104537_object21521:head# 2024-04-01T19:36:20.377 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:36:20.377 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f027b28:::benchmark_data_smithi188_104537_object160597:head# 2024-04-01T19:36:20.378 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f02822d:::benchmark_data_smithi188_104537_object39813:head# 2024-04-01T19:36:20.378 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f04080b:::benchmark_data_smithi188_104537_object75310:head# 2024-04-01T19:36:20.379 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f045d06:::benchmark_data_smithi188_104537_object127964:head# 2024-04-01T19:36:20.379 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f04686a:::benchmark_data_smithi188_104537_object18473:head# 2024-04-01T19:36:20.379 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f04c174:::benchmark_data_smithi188_104537_object92457:head# 2024-04-01T19:36:20.380 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f051d49:::benchmark_data_smithi188_104537_object26530:head# 2024-04-01T19:36:20.380 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f0559ad:::benchmark_data_smithi188_104537_object96624:head# 2024-04-01T19:36:20.381 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f059e9b:::benchmark_data_smithi188_104537_object125244:head# 2024-04-01T19:36:20.381 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f05f068:::benchmark_data_smithi188_104537_object51111:head# 2024-04-01T19:36:20.381 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f05f6b2:::benchmark_data_smithi188_104537_object22686:head# 2024-04-01T19:36:20.382 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f065b6b:::benchmark_data_smithi188_104537_object21011:head# 2024-04-01T19:36:20.382 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f0680e0:::benchmark_data_smithi188_104537_object39594:head# 2024-04-01T19:36:20.383 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f074c9e:::benchmark_data_smithi188_104537_object169299:head# 2024-04-01T19:36:20.383 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f0807d5:::benchmark_data_smithi188_104537_object70570:head# 2024-04-01T19:36:20.384 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f084fd0:::benchmark_data_smithi188_104537_object90443:head# 2024-04-01T19:36:20.384 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:36:20.384 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f086b02:::benchmark_data_smithi188_104537_object67574:head# 2024-04-01T19:36:20.385 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f08e173:::benchmark_data_smithi188_104537_object37315:head# 2024-04-01T19:36:20.385 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f09a2f8:::benchmark_data_smithi188_104537_object19118:head# 2024-04-01T19:36:20.386 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f09c5e9:::benchmark_data_smithi188_104537_object109713:head# 2024-04-01T19:36:20.386 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f09df77:::benchmark_data_smithi188_104537_object83496:head# 2024-04-01T19:36:20.387 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:20.387 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:36:20.388 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f0ae08c:::benchmark_data_smithi188_104537_object48066:head# 2024-04-01T19:36:20.388 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f0afba6:::benchmark_data_smithi188_104537_object68688:head# 2024-04-01T19:36:20.388 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f0b46d9:::benchmark_data_smithi188_104537_object74350:head# 2024-04-01T19:36:20.388 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f0b6412:::benchmark_data_smithi188_104537_object118977:head# 2024-04-01T19:36:20.389 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f0c623f:::benchmark_data_smithi188_104537_object159801:head# 2024-04-01T19:36:20.389 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f0d006c:::benchmark_data_smithi188_104537_object94745:head# 2024-04-01T19:36:20.389 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f0d4953:::benchmark_data_smithi188_104537_object117388:head# 2024-04-01T19:36:20.389 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f0d6262:::benchmark_data_smithi188_104537_object133155:head# 2024-04-01T19:36:20.390 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f0e4eab:::benchmark_data_smithi188_104537_object71371:head# 2024-04-01T19:36:20.390 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f0e62d5:::benchmark_data_smithi188_104537_object63190:head# 2024-04-01T19:36:20.391 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f0f89eb:::benchmark_data_smithi188_104537_object70047:head# 2024-04-01T19:36:20.391 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f0f9c1c:::benchmark_data_smithi188_104537_object76207:head# 2024-04-01T19:36:20.392 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f0fe495:::benchmark_data_smithi188_104537_object61603:head# 2024-04-01T19:36:20.392 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f0fe5e4:::benchmark_data_smithi188_104537_object105078:head# 2024-04-01T19:36:20.393 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f101bad:::benchmark_data_smithi188_104537_object137039:head# 2024-04-01T19:36:20.393 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f105c20:::benchmark_data_smithi188_104537_object56983:head# 2024-04-01T19:36:20.393 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f1079b8:::benchmark_data_smithi188_104537_object70960:head# 2024-04-01T19:36:20.394 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f115cf5:::benchmark_data_smithi188_104537_object41669:head# 2024-04-01T19:36:20.394 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f12c31f:::benchmark_data_smithi188_104537_object76717:head# 2024-04-01T19:36:20.395 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f12d7f6:::benchmark_data_smithi188_104537_object33264:head# 2024-04-01T19:36:20.395 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f132153:::benchmark_data_smithi188_104537_object63519:head# 2024-04-01T19:36:20.396 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f132b5d:::benchmark_data_smithi188_104537_object117452:head# 2024-04-01T19:36:20.396 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f13cbd9:::benchmark_data_smithi188_104537_object121844:head# 2024-04-01T19:36:20.396 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f13dde2:::benchmark_data_smithi188_104537_object103197:head# 2024-04-01T19:36:20.397 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f13e082:::benchmark_data_smithi188_104537_object89801:head# 2024-04-01T19:36:20.397 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f140322:::benchmark_data_smithi188_104537_object126366:head# 2024-04-01T19:36:20.397 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f144c85:::benchmark_data_smithi188_104537_object96168:head# 2024-04-01T19:36:20.398 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f157ec9:::benchmark_data_smithi188_104537_object23706:head# 2024-04-01T19:36:20.398 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f15add1:::benchmark_data_smithi188_104537_object85075:head# 2024-04-01T19:36:20.399 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f163265:::benchmark_data_smithi188_104537_object93724:head# 2024-04-01T19:36:20.399 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f16843b:::benchmark_data_smithi188_104537_object99697:head# 2024-04-01T19:36:20.400 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f16db07:::benchmark_data_smithi188_104537_object67630:head# 2024-04-01T19:36:20.400 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f17f127:::benchmark_data_smithi188_104537_object162264:head# 2024-04-01T19:36:20.400 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f17fe57:::benchmark_data_smithi188_104537_object100652:head# 2024-04-01T19:36:20.401 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f18228c:::benchmark_data_smithi188_104537_object24560:head# 2024-04-01T19:36:20.401 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f1911c7:::benchmark_data_smithi188_104537_object75791:head# 2024-04-01T19:36:20.402 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:36:20.402 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f194b8d:::benchmark_data_smithi188_104537_object156108:head# 2024-04-01T19:36:20.403 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f196f26:::benchmark_data_smithi188_104537_object155512:head# 2024-04-01T19:36:20.403 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f198b97:::benchmark_data_smithi188_104537_object58261:head# 2024-04-01T19:36:20.404 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f19c97e:::benchmark_data_smithi188_104537_object85137:head# 2024-04-01T19:36:20.404 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f1a41dc:::benchmark_data_smithi188_104537_object58340:head# 2024-04-01T19:36:20.405 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f1b0027:::benchmark_data_smithi188_104537_object168899:head# 2024-04-01T19:36:20.405 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f1b8162:::benchmark_data_smithi188_104537_object170175:head# 2024-04-01T19:36:20.405 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f1b99d2:::benchmark_data_smithi188_104537_object147008:head# 2024-04-01T19:36:20.406 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f1ba42c:::benchmark_data_smithi188_104537_object90818:head# 2024-04-01T19:36:20.406 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f1c173e:::benchmark_data_smithi188_104537_object52422:head# 2024-04-01T19:36:20.407 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f1c8157:::benchmark_data_smithi188_104537_object94645:head# 2024-04-01T19:36:20.407 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f1c8ef7:::benchmark_data_smithi188_104537_object72240:head# 2024-04-01T19:36:20.408 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f1cc69a:::benchmark_data_smithi188_104537_object156370:head# 2024-04-01T19:36:20.408 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f1d8c7d:::benchmark_data_smithi188_104537_object98009:head# 2024-04-01T19:36:20.409 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f1dd910:::benchmark_data_smithi188_104537_object118680:head# 2024-04-01T19:36:20.409 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f1df368:::benchmark_data_smithi188_104537_object15261:head# 2024-04-01T19:36:20.409 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f1e49e5:::benchmark_data_smithi188_104537_object49598:head# 2024-04-01T19:36:20.410 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f1e6547:::benchmark_data_smithi188_104537_object12233:head# 2024-04-01T19:36:20.410 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f1eb4ad:::benchmark_data_smithi188_104537_object160924:head# 2024-04-01T19:36:20.411 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f1eec83:::benchmark_data_smithi188_104537_object154054:head# 2024-04-01T19:36:20.411 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f1f1100:::benchmark_data_smithi188_104537_object123427:head# 2024-04-01T19:36:20.412 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f1f6d03:::benchmark_data_smithi188_104537_object119632:head# 2024-04-01T19:36:20.412 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f2081e9:::benchmark_data_smithi188_104537_object26298:head# 2024-04-01T19:36:20.412 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f208f6a:::benchmark_data_smithi188_104537_object118869:head# 2024-04-01T19:36:20.413 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f209454:::benchmark_data_smithi188_104537_object52847:head# 2024-04-01T19:36:20.414 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f20f132:::benchmark_data_smithi188_104537_object134168:head# 2024-04-01T19:36:20.415 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f216e3d:::benchmark_data_smithi188_104537_object50005:head# 2024-04-01T19:36:20.415 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f21885e:::benchmark_data_smithi188_104537_object128187:head# 2024-04-01T19:36:20.416 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f219df4:::benchmark_data_smithi188_104537_object117711:head# 2024-04-01T19:36:20.416 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f2271d6:::benchmark_data_smithi188_104537_object138849:head# 2024-04-01T19:36:20.417 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f2292b9:::benchmark_data_smithi188_104537_object18707:head# 2024-04-01T19:36:20.417 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f22aed6:::benchmark_data_smithi188_104537_object74431:head# 2024-04-01T19:36:20.417 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f22d7e3:::benchmark_data_smithi188_104537_object158558:head# 2024-04-01T19:36:20.418 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f235a59:::benchmark_data_smithi188_104537_object114522:head# 2024-04-01T19:36:20.418 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f23da70:::benchmark_data_smithi188_104537_object34817:head# 2024-04-01T19:36:20.419 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f23e289:::benchmark_data_smithi188_104537_object151506:head# 2024-04-01T19:36:20.419 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f24313a:::benchmark_data_smithi188_104537_object108115:head# 2024-04-01T19:36:20.420 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f24422d:::benchmark_data_smithi188_104537_object23415:head# 2024-04-01T19:36:20.421 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f24c40e:::benchmark_data_smithi188_104537_object11197:head# 2024-04-01T19:36:20.421 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f2525b9:::benchmark_data_smithi188_104537_object27807:head# 2024-04-01T19:36:20.421 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f252ca8:::benchmark_data_smithi188_104537_object78072:head# 2024-04-01T19:36:20.422 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f25b089:::benchmark_data_smithi188_104537_object167972:head# 2024-04-01T19:36:20.422 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f26204a:::benchmark_data_smithi188_104537_object169726:head# 2024-04-01T19:36:20.423 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f26cf07:::benchmark_data_smithi188_104537_object148996:head# 2024-04-01T19:36:20.423 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f2708ec:::benchmark_data_smithi188_104537_object71094:head# 2024-04-01T19:36:20.424 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f273372:::benchmark_data_smithi188_104537_object98277:head# 2024-04-01T19:36:20.424 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f27d325:::benchmark_data_smithi188_104537_object95768:head# 2024-04-01T19:36:20.425 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f284116:::benchmark_data_smithi188_104537_object138802:head# 2024-04-01T19:36:20.425 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:36:20.425 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f28b214:::benchmark_data_smithi188_104537_object105362:head# 2024-04-01T19:36:20.426 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f28d63e:::benchmark_data_smithi188_104537_object30145:head# 2024-04-01T19:36:20.426 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f28eacf:::benchmark_data_smithi188_104537_object90600:head# 2024-04-01T19:36:20.426 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f294a98:::benchmark_data_smithi188_104537_object40268:head# 2024-04-01T19:36:20.427 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f295066:::benchmark_data_smithi188_104537_object68610:head# 2024-04-01T19:36:20.428 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f298002:::benchmark_data_smithi188_104537_object21078:head# 2024-04-01T19:36:20.428 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f29d864:::benchmark_data_smithi188_104537_object98629:head# 2024-04-01T19:36:20.429 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f2adccf:::benchmark_data_smithi188_104537_object120343:head# 2024-04-01T19:36:20.429 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f2b0176:::benchmark_data_smithi188_104537_object155011:head# 2024-04-01T19:36:20.429 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f2c7c1d:::benchmark_data_smithi188_104537_object86021:head# 2024-04-01T19:36:20.429 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f2c7c7a:::benchmark_data_smithi188_104537_object30613:head# 2024-04-01T19:36:20.430 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f2d168b:::benchmark_data_smithi188_104537_object20037:head# 2024-04-01T19:36:20.430 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f2d5133:::benchmark_data_smithi188_104537_object126970:head# 2024-04-01T19:36:20.431 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f2d98b6:::benchmark_data_smithi188_104537_object151664:head# 2024-04-01T19:36:20.431 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f2dba85:::benchmark_data_smithi188_104537_object77062:head# 2024-04-01T19:36:20.431 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f2e2f64:::benchmark_data_smithi188_104537_object102303:head# 2024-04-01T19:36:20.432 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f2ead98:::benchmark_data_smithi188_104537_object40780:head# 2024-04-01T19:36:20.432 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f2edf2b:::benchmark_data_smithi188_104537_object102925:head# 2024-04-01T19:36:20.433 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f2fb05c:::benchmark_data_smithi188_104537_object154907:head# 2024-04-01T19:36:20.433 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f2fbe18:::benchmark_data_smithi188_104537_object108139:head# 2024-04-01T19:36:20.434 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f305e31:::benchmark_data_smithi188_104537_object83476:head# 2024-04-01T19:36:20.434 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f30f34e:::benchmark_data_smithi188_104537_object154719:head# 2024-04-01T19:36:20.434 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f30f707:::benchmark_data_smithi188_104537_object68465:head# 2024-04-01T19:36:20.434 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f310852:::benchmark_data_smithi188_104537_object110862:head# 2024-04-01T19:36:20.435 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f31f28b:::benchmark_data_smithi188_104537_object162599:head# 2024-04-01T19:36:20.435 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f328e57:::benchmark_data_smithi188_104537_object138180:head# 2024-04-01T19:36:20.436 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f3295e8:::benchmark_data_smithi188_104537_object151094:head# 2024-04-01T19:36:20.436 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f32e28b:::benchmark_data_smithi188_104537_object159987:head# 2024-04-01T19:36:20.436 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f32e7b7:::benchmark_data_smithi188_104537_object81128:head# 2024-04-01T19:36:20.437 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f32fb9e:::benchmark_data_smithi188_104537_object19047:head# 2024-04-01T19:36:20.437 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f3325df:::benchmark_data_smithi188_104537_object138518:head# 2024-04-01T19:36:20.438 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f338b62:::benchmark_data_smithi188_104537_object143010:head# 2024-04-01T19:36:20.438 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f347a63:::benchmark_data_smithi188_104537_object152615:head# 2024-04-01T19:36:20.438 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f35205c:::benchmark_data_smithi188_104537_object147467:head# 2024-04-01T19:36:20.439 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f359ad5:::benchmark_data_smithi188_104537_object126376:head# 2024-04-01T19:36:20.440 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f35c64e:::benchmark_data_smithi188_104537_object66531:head# 2024-04-01T19:36:20.440 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f35e5e4:::benchmark_data_smithi188_104537_object144593:head# 2024-04-01T19:36:20.440 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f364233:::benchmark_data_smithi188_104537_object169338:head# 2024-04-01T19:36:20.441 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f3653cb:::benchmark_data_smithi188_104537_object58410:head# 2024-04-01T19:36:20.441 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f36caa7:::benchmark_data_smithi188_104537_object56367:head# 2024-04-01T19:36:20.441 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f373c47:::benchmark_data_smithi188_104537_object116972:head# 2024-04-01T19:36:20.442 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f374c57:::benchmark_data_smithi188_104537_object130627:head# 2024-04-01T19:36:20.442 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f37676b:::benchmark_data_smithi188_104537_object17200:head# 2024-04-01T19:36:20.442 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f37ee21:::benchmark_data_smithi188_104537_object161732:head# 2024-04-01T19:36:20.443 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f3821e0:::benchmark_data_smithi188_104537_object163120:head# 2024-04-01T19:36:20.444 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f386587:::benchmark_data_smithi188_104537_object127511:head# 2024-04-01T19:36:20.444 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f38b7c3:::benchmark_data_smithi188_104537_object68737:head# 2024-04-01T19:36:20.444 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f392de5:::benchmark_data_smithi188_104537_object105827:head# 2024-04-01T19:36:20.445 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f39b297:::benchmark_data_smithi188_104537_object132074:head# 2024-04-01T19:36:20.445 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f3a6852:::benchmark_data_smithi188_104537_object60974:head# 2024-04-01T19:36:20.445 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f3a730b:::benchmark_data_smithi188_104537_object39063:head# 2024-04-01T19:36:20.446 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f3b33fb:::benchmark_data_smithi188_104537_object145089:head# 2024-04-01T19:36:20.446 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f3b3d8d:::benchmark_data_smithi188_104537_object46130:head# 2024-04-01T19:36:20.447 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f3b6736:::benchmark_data_smithi188_104537_object23245:head# 2024-04-01T19:36:20.447 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f3bbcad:::benchmark_data_smithi188_104537_object136551:head# 2024-04-01T19:36:20.448 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:36:20.448 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f3c4110:::benchmark_data_smithi188_104537_object84856:head# 2024-04-01T19:36:20.448 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f3cd74f:::benchmark_data_smithi188_104537_object62851:head# 2024-04-01T19:36:20.449 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f3cfe31:::benchmark_data_smithi188_104537_object98025:head# 2024-04-01T19:36:20.449 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f3d49e7:::benchmark_data_smithi188_104537_object90387:head# 2024-04-01T19:36:20.450 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f3dc1e4:::benchmark_data_smithi188_104537_object72192:head# 2024-04-01T19:36:20.450 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f3de06e:::benchmark_data_smithi188_104537_object126472:head# 2024-04-01T19:36:20.450 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f3df89c:::benchmark_data_smithi188_104537_object125930:head# 2024-04-01T19:36:20.451 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f3f1fa9:::benchmark_data_smithi188_104537_object34955:head# 2024-04-01T19:36:20.451 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f3f5985:::benchmark_data_smithi188_104537_object140604:head# 2024-04-01T19:36:20.451 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f3f7750:::benchmark_data_smithi188_104537_object53838:head# 2024-04-01T19:36:20.452 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f3f7cae:::benchmark_data_smithi188_104537_object37116:head# 2024-04-01T19:36:20.453 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f3fa7eb:::benchmark_data_smithi188_104537_object105852:head# 2024-04-01T19:36:20.453 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f3fe17d:::benchmark_data_smithi188_104537_object128809:head# 2024-04-01T19:36:20.454 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f4121b6:::benchmark_data_smithi188_104537_object59154:head# 2024-04-01T19:36:20.454 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f416fc2:::benchmark_data_smithi188_104537_object81682:head# 2024-04-01T19:36:20.454 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f41c972:::benchmark_data_smithi188_104537_object148964:head# 2024-04-01T19:36:20.455 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f4202c7:::benchmark_data_smithi188_104537_object140927:head# 2024-04-01T19:36:20.455 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f422057:::benchmark_data_smithi188_104537_object142704:head# 2024-04-01T19:36:20.456 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f426760:::benchmark_data_smithi188_104537_object121212:head# 2024-04-01T19:36:20.456 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f429562:::benchmark_data_smithi188_104537_object126665:head# 2024-04-01T19:36:20.457 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f431739:::benchmark_data_smithi188_104537_object142391:head# 2024-04-01T19:36:20.458 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f4328cc:::benchmark_data_smithi188_104537_object54312:head# 2024-04-01T19:36:20.458 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f436b24:::benchmark_data_smithi188_104537_object65261:head# 2024-04-01T19:36:20.459 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f43a4f8:::benchmark_data_smithi188_104537_object15106:head# 2024-04-01T19:36:20.459 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f43d1b3:::benchmark_data_smithi188_104537_object83212:head# 2024-04-01T19:36:20.460 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f4448d5:::benchmark_data_smithi188_104537_object147156:head# 2024-04-01T19:36:20.460 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f4452cc:::benchmark_data_smithi188_104537_object93745:head# 2024-04-01T19:36:20.460 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f44d5a2:::benchmark_data_smithi188_104537_object104929:head# 2024-04-01T19:36:20.461 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f45086b:::benchmark_data_smithi188_104537_object169055:head# 2024-04-01T19:36:20.462 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f450941:::benchmark_data_smithi188_104537_object130100:head# 2024-04-01T19:36:20.462 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f453597:::benchmark_data_smithi188_104537_object170555:head# 2024-04-01T19:36:20.462 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f4548e4:::benchmark_data_smithi188_104537_object37335:head# 2024-04-01T19:36:20.463 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f455d81:::benchmark_data_smithi188_104537_object18975:head# 2024-04-01T19:36:20.463 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f45d194:::benchmark_data_smithi188_104537_object16438:head# 2024-04-01T19:36:20.463 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f45e84b:::benchmark_data_smithi188_104537_object141779:head# 2024-04-01T19:36:20.464 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f45fff7:::benchmark_data_smithi188_104537_object67840:head# 2024-04-01T19:36:20.464 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f467875:::benchmark_data_smithi188_104537_object74385:head# 2024-04-01T19:36:20.465 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f475db7:::benchmark_data_smithi188_104537_object73380:head# 2024-04-01T19:36:20.465 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f47caa0:::benchmark_data_smithi188_104537_object160662:head# 2024-04-01T19:36:20.465 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f48038d:::benchmark_data_smithi188_104537_object25366:head# 2024-04-01T19:36:20.466 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f481773:::benchmark_data_smithi188_104537_object71829:head# 2024-04-01T19:36:20.466 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f48e49c:::benchmark_data_smithi188_104537_object44787:head# 2024-04-01T19:36:20.466 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f48f65d:::benchmark_data_smithi188_104537_object141595:head# 2024-04-01T19:36:20.467 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f4931df:::benchmark_data_smithi188_104537_object95058:head# 2024-04-01T19:36:20.467 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f493829:::benchmark_data_smithi188_104537_object112409:head# 2024-04-01T19:36:20.468 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f495e9e:::benchmark_data_smithi188_104537_object70653:head# 2024-04-01T19:36:20.468 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f496b0f:::benchmark_data_smithi188_104537_object144040:head# 2024-04-01T19:36:20.468 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f49bc66:::benchmark_data_smithi188_104537_object82740:head# 2024-04-01T19:36:20.469 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f49c732:::benchmark_data_smithi188_104537_object77458:head# 2024-04-01T19:36:20.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f49e41d:::benchmark_data_smithi188_104537_object57719:head# 2024-04-01T19:36:20.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f4a9ed8:::benchmark_data_smithi188_104537_object138447:head# 2024-04-01T19:36:20.471 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:36:20.471 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:36:20.471 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:36:20.471 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:36:20.471 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:36:20.471 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:36:20.471 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:36:20.471 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:36:20.472 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:36:20.472 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:36:20.472 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:36:20.472 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:36:20.472 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:36:20.472 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f4af68c:::benchmark_data_smithi188_104537_object102070:head# 2024-04-01T19:36:20.472 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f4b534c:::benchmark_data_smithi188_104537_object155605:head# 2024-04-01T19:36:20.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f4b96cf:::benchmark_data_smithi188_104537_object123769:head# 2024-04-01T19:36:20.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f4c637c:::benchmark_data_smithi188_104537_object112302:head# 2024-04-01T19:36:20.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f4c7529:::benchmark_data_smithi188_104537_object35969:head# 2024-04-01T19:36:20.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f4c9013:::benchmark_data_smithi188_104537_object127470:head# 2024-04-01T19:36:20.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f4cfd4b:::benchmark_data_smithi188_104537_object171609:head# 2024-04-01T19:36:20.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f4d0bea:::benchmark_data_smithi188_104537_object93484:head# 2024-04-01T19:36:20.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f4dc67d:::benchmark_data_smithi188_104537_object26750:head# 2024-04-01T19:36:20.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f4e2f87:::benchmark_data_smithi188_104537_object94296:head# 2024-04-01T19:36:20.475 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f4e838f:::benchmark_data_smithi188_104537_object91803:head# 2024-04-01T19:36:20.475 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f4f3c19:::benchmark_data_smithi188_104537_object131593:head# 2024-04-01T19:36:20.476 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f500357:::benchmark_data_smithi188_104537_object158424:head# 2024-04-01T19:36:20.476 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f50d156:::benchmark_data_smithi188_104537_object69260:head# 2024-04-01T19:36:20.476 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f519310:::benchmark_data_smithi188_104537_object106545:head# 2024-04-01T19:36:20.477 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f5196d3:::benchmark_data_smithi188_104537_object118153:head# 2024-04-01T19:36:20.478 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f51d08d:::benchmark_data_smithi188_104537_object68132:head# 2024-04-01T19:36:20.478 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f524228:::benchmark_data_smithi188_104537_object36284:head# 2024-04-01T19:36:20.479 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f524fad:::benchmark_data_smithi188_104537_object103156:head# 2024-04-01T19:36:20.479 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f526f32:::benchmark_data_smithi188_104537_object31548:head# 2024-04-01T19:36:20.479 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f52b376:::benchmark_data_smithi188_104537_object132412:head# 2024-04-01T19:36:20.480 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f52c7b3:::benchmark_data_smithi188_104537_object83582:head# 2024-04-01T19:36:20.480 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f533977:::benchmark_data_smithi188_104537_object76116:head# 2024-04-01T19:36:20.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f535780:::benchmark_data_smithi188_104537_object108706:head# 2024-04-01T19:36:20.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f53eb78:::benchmark_data_smithi188_104537_object146566:head# 2024-04-01T19:36:20.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f5422a8:::benchmark_data_smithi188_104537_object81274:head# 2024-04-01T19:36:20.482 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f54854b:::benchmark_data_smithi188_104537_object89694:head# 2024-04-01T19:36:20.483 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f549312:::benchmark_data_smithi188_104537_object100417:head# 2024-04-01T19:36:20.483 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f558ea0:::benchmark_data_smithi188_104537_object130702:head# 2024-04-01T19:36:20.483 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f55f6ce:::benchmark_data_smithi188_104537_object91167:head# 2024-04-01T19:36:20.484 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f56de7f:::benchmark_data_smithi188_104537_object119708:head# 2024-04-01T19:36:20.484 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f56e611:::benchmark_data_smithi188_104537_object41021:head# 2024-04-01T19:36:20.484 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f56f0e8:::benchmark_data_smithi188_104537_object83179:head# 2024-04-01T19:36:20.485 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f56f397:::benchmark_data_smithi188_104537_object84768:head# 2024-04-01T19:36:20.485 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f576f7c:::benchmark_data_smithi188_104537_object59807:head# 2024-04-01T19:36:20.486 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f577222:::benchmark_data_smithi188_104537_object24202:head# 2024-04-01T19:36:20.486 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f57992c:::benchmark_data_smithi188_104537_object44172:head# 2024-04-01T19:36:20.487 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f58341a:::benchmark_data_smithi188_104537_object26529:head# 2024-04-01T19:36:20.487 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f584ff9:::benchmark_data_smithi188_104537_object32711:head# 2024-04-01T19:36:20.488 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f58ac3b:::benchmark_data_smithi188_104537_object90347:head# 2024-04-01T19:36:20.488 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:36:20.489 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f58d314:::benchmark_data_smithi188_104537_object113664:head# 2024-04-01T19:36:20.489 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f590fea:::benchmark_data_smithi188_104537_object152420:head# 2024-04-01T19:36:20.489 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f5949c3:::benchmark_data_smithi188_104537_object163106:head# 2024-04-01T19:36:20.490 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f595a87:::benchmark_data_smithi188_104537_object10944:head# 2024-04-01T19:36:20.491 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f59d689:::benchmark_data_smithi188_104537_object84472:head# 2024-04-01T19:36:20.491 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f59f740:::benchmark_data_smithi188_104537_object110138:head# 2024-04-01T19:36:20.491 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f5a54a5:::benchmark_data_smithi188_104537_object75075:head# 2024-04-01T19:36:20.492 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f5a6c2e:::benchmark_data_smithi188_104537_object132193:head# 2024-04-01T19:36:20.492 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f5ab0bf:::benchmark_data_smithi188_104537_object169786:head# 2024-04-01T19:36:20.493 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f5b953a:::benchmark_data_smithi188_104537_object24837:head# 2024-04-01T19:36:20.493 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f5bad77:::benchmark_data_smithi188_104537_object39058:head# 2024-04-01T19:36:20.494 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f5c0895:::benchmark_data_smithi188_104537_object62849:head# 2024-04-01T19:36:20.494 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f5c4ce8:::benchmark_data_smithi188_104537_object113403:head# 2024-04-01T19:36:20.495 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f5eaedd:::benchmark_data_smithi188_104537_object167745:head# 2024-04-01T19:36:20.495 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f5ebf04:::benchmark_data_smithi188_104537_object149538:head# 2024-04-01T19:36:20.495 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f5f0972:::benchmark_data_smithi188_104537_object87285:head# 2024-04-01T19:36:20.496 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f5f14e6:::benchmark_data_smithi188_104537_object85869:head# 2024-04-01T19:36:20.497 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f5fad28:::benchmark_data_smithi188_104537_object82258:head# 2024-04-01T19:36:20.497 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f6003da:::benchmark_data_smithi188_104537_object67164:head# 2024-04-01T19:36:20.498 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f606fd1:::benchmark_data_smithi188_104537_object105416:head# 2024-04-01T19:36:20.498 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f6076a3:::benchmark_data_smithi188_104537_object31742:head# 2024-04-01T19:36:20.499 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f6129c7:::benchmark_data_smithi188_104537_object13488:head# 2024-04-01T19:36:20.499 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f61771e:::benchmark_data_smithi188_104537_object12005:head# 2024-04-01T19:36:20.500 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f61c86e:::benchmark_data_smithi188_104537_object112171:head# 2024-04-01T19:36:20.500 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f621aa4:::benchmark_data_smithi188_104537_object65149:head# 2024-04-01T19:36:20.501 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f622df2:::benchmark_data_smithi188_104537_object112118:head# 2024-04-01T19:36:20.501 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f6252b8:::benchmark_data_smithi188_104537_object152959:head# 2024-04-01T19:36:20.502 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f63fa73:::benchmark_data_smithi188_104537_object155882:head# 2024-04-01T19:36:20.502 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f662f46:::benchmark_data_smithi188_104537_object163967:head# 2024-04-01T19:36:20.502 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f674569:::benchmark_data_smithi188_104537_object84910:head# 2024-04-01T19:36:20.503 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f67497d:::benchmark_data_smithi188_104537_object83312:head# 2024-04-01T19:36:20.503 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f678cbe:::benchmark_data_smithi188_104537_object154496:head# 2024-04-01T19:36:20.503 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f6814be:::benchmark_data_smithi188_104537_object113476:head# 2024-04-01T19:36:20.504 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f6843f3:::benchmark_data_smithi188_104537_object118137:head# 2024-04-01T19:36:20.504 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f687e9f:::benchmark_data_smithi188_104537_object46514:head# 2024-04-01T19:36:20.505 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f688d13:::benchmark_data_smithi188_104537_object161846:head# 2024-04-01T19:36:20.505 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f68ea8c:::benchmark_data_smithi188_104537_object54971:head# 2024-04-01T19:36:20.506 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f68f63b:::benchmark_data_smithi188_104537_object69834:head# 2024-04-01T19:36:20.506 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f68fee0:::benchmark_data_smithi188_104537_object69771:head# 2024-04-01T19:36:20.506 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f69b01a:::benchmark_data_smithi188_104537_object45919:head# 2024-04-01T19:36:20.507 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f69d6b7:::benchmark_data_smithi188_104537_object140287:head# 2024-04-01T19:36:20.507 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f6a1152:::benchmark_data_smithi188_104537_object120297:head# 2024-04-01T19:36:20.508 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f6a9004:::benchmark_data_smithi188_104537_object15397:head# 2024-04-01T19:36:20.508 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f6a9175:::benchmark_data_smithi188_104537_object131126:head# 2024-04-01T19:36:20.509 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f6abdab:::benchmark_data_smithi188_104537_object88759:head# 2024-04-01T19:36:20.509 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f6b50e5:::benchmark_data_smithi188_104537_object98214:head# 2024-04-01T19:36:20.510 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f6b5703:::benchmark_data_smithi188_104537_object109805:head# 2024-04-01T19:36:20.512 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f6c9854:::benchmark_data_smithi188_104537_object127107:head# 2024-04-01T19:36:20.513 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f6ce259:::benchmark_data_smithi188_104537_object139530:head# 2024-04-01T19:36:20.513 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f6d2457:::benchmark_data_smithi188_104537_object132551:head# 2024-04-01T19:36:20.514 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f6d77e4:::benchmark_data_smithi188_104537_object35299:head# 2024-04-01T19:36:20.514 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f6e80c5:::benchmark_data_smithi188_104537_object113738:head# 2024-04-01T19:36:20.515 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f6e8eca:::benchmark_data_smithi188_104537_object71638:head# 2024-04-01T19:36:20.515 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f6f5f66:::benchmark_data_smithi188_104537_object24434:head# 2024-04-01T19:36:20.516 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f6fa708:::benchmark_data_smithi188_104537_object137411:head# 2024-04-01T19:36:20.516 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f6fd104:::benchmark_data_smithi188_104537_object79710:head# 2024-04-01T19:36:20.517 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f70b0f1:::benchmark_data_smithi188_104537_object108000:head# 2024-04-01T19:36:20.517 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:20.518 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f70d630:::benchmark_data_smithi188_104537_object32529:head# 2024-04-01T19:36:20.518 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f710f00:::benchmark_data_smithi188_104537_object18276:head# 2024-04-01T19:36:20.518 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f7116e0:::benchmark_data_smithi188_104537_object152950:head# 2024-04-01T19:36:20.519 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f714d64:::benchmark_data_smithi188_104537_object84504:head# 2024-04-01T19:36:20.519 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f71ae0f:::benchmark_data_smithi188_104537_object22939:head# 2024-04-01T19:36:20.519 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f71fdd7:::benchmark_data_smithi188_104537_object134997:head# 2024-04-01T19:36:20.520 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f72776a:::benchmark_data_smithi188_104537_object27942:head# 2024-04-01T19:36:20.521 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f72a8d0:::benchmark_data_smithi188_104537_object139352:head# 2024-04-01T19:36:20.521 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f72b572:::benchmark_data_smithi188_104537_object170009:head# 2024-04-01T19:36:20.521 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f731603:::benchmark_data_smithi188_104537_object46963:head# 2024-04-01T19:36:20.522 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f73219a:::benchmark_data_smithi188_104537_object162187:head# 2024-04-01T19:36:20.522 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f73c507:::benchmark_data_smithi188_104537_object92102:head# 2024-04-01T19:36:20.523 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f7440be:::benchmark_data_smithi188_104537_object109372:head# 2024-04-01T19:36:20.524 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f748f84:::benchmark_data_smithi188_104537_object141815:head# 2024-04-01T19:36:20.524 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f74c8c2:::benchmark_data_smithi188_104537_object78142:head# 2024-04-01T19:36:20.525 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f7582a0:::benchmark_data_smithi188_104537_object13345:head# 2024-04-01T19:36:20.525 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f758c59:::benchmark_data_smithi188_104537_object87052:head# 2024-04-01T19:36:20.526 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f759551:::benchmark_data_smithi188_104537_object55523:head# 2024-04-01T19:36:20.527 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f75ca34:::benchmark_data_smithi188_104537_object73118:head# 2024-04-01T19:36:20.527 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f75cca4:::benchmark_data_smithi188_104537_object81121:head# 2024-04-01T19:36:20.527 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f760166:::benchmark_data_smithi188_104537_object51516:head# 2024-04-01T19:36:20.528 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f766d0f:::benchmark_data_smithi188_104537_object166351:head# 2024-04-01T19:36:20.528 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f7682db:::benchmark_data_smithi188_104537_object52053:head# 2024-04-01T19:36:20.528 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f76c75b:::benchmark_data_smithi188_104537_object17150:head# 2024-04-01T19:36:20.529 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f771b51:::benchmark_data_smithi188_104537_object31992:head# 2024-04-01T19:36:20.529 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f778716:::benchmark_data_smithi188_104537_object46864:head# 2024-04-01T19:36:20.530 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f77ac52:::benchmark_data_smithi188_104537_object135246:head# 2024-04-01T19:36:20.530 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f77d4c6:::benchmark_data_smithi188_104537_object122746:head# 2024-04-01T19:36:20.532 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f77dad5:::benchmark_data_smithi188_104537_object157947:head# 2024-04-01T19:36:20.532 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f77f04f:::benchmark_data_smithi188_104537_object13417:head# 2024-04-01T19:36:20.535 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f782f58:::benchmark_data_smithi188_104537_object168352:head# 2024-04-01T19:36:20.536 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f789461:::benchmark_data_smithi188_104537_object97441:head# 2024-04-01T19:36:20.536 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f796c3c:::benchmark_data_smithi188_104537_object109251:head# 2024-04-01T19:36:20.536 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f79b135:::benchmark_data_smithi188_104537_object64019:head# 2024-04-01T19:36:20.536 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f7a2bad:::benchmark_data_smithi188_104537_object26933:head# 2024-04-01T19:36:20.536 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f7afa1d:::benchmark_data_smithi188_104537_object155230:head# 2024-04-01T19:36:20.536 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f7b06b9:::benchmark_data_smithi188_104537_object21907:head# 2024-04-01T19:36:20.536 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f7be151:::benchmark_data_smithi188_104537_object59729:head# 2024-04-01T19:36:20.537 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f7beb96:::benchmark_data_smithi188_104537_object160598:head# 2024-04-01T19:36:20.537 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f7c0e81:::benchmark_data_smithi188_104537_object72800:head# 2024-04-01T19:36:20.537 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f7cbd4d:::benchmark_data_smithi188_104537_object163733:head# 2024-04-01T19:36:20.538 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f7d0ca1:::benchmark_data_smithi188_104537_object127882:head# 2024-04-01T19:36:20.538 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f7d4735:::benchmark_data_smithi188_104537_object29878:head# 2024-04-01T19:36:20.539 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f7da186:::benchmark_data_smithi188_104537_object57358:head# 2024-04-01T19:36:20.539 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f7e7a5b:::benchmark_data_smithi188_104537_object33539:head# 2024-04-01T19:36:20.539 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f7eb0a1:::benchmark_data_smithi188_104537_object169353:head# 2024-04-01T19:36:20.539 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f7fba07:::benchmark_data_smithi188_104537_object60843:head# 2024-04-01T19:36:20.540 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:36:20.540 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f80ba95:::benchmark_data_smithi188_104537_object141837:head# 2024-04-01T19:36:20.540 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f82504e:::benchmark_data_smithi188_104537_object72639:head# 2024-04-01T19:36:20.540 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f8396f8:::benchmark_data_smithi188_104537_object117273:head# 2024-04-01T19:36:20.542 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:20.543 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f846a0b:::benchmark_data_smithi188_104537_object46258:head# 2024-04-01T19:36:20.543 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f84ab8d:::benchmark_data_smithi188_104537_object92605:head# 2024-04-01T19:36:20.543 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f84c403:::benchmark_data_smithi188_104537_object12142:head# 2024-04-01T19:36:20.543 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f859716:::benchmark_data_smithi188_104537_object30010:head# 2024-04-01T19:36:20.544 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f85dd69:::benchmark_data_smithi188_104537_object129842:head# 2024-04-01T19:36:20.544 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:36:20.547 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f85f211:::benchmark_data_smithi188_104537_object64008:head# 2024-04-01T19:36:20.547 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f8623ed:::benchmark_data_smithi188_104537_object133266:head# 2024-04-01T19:36:20.547 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f86d16b:::benchmark_data_smithi188_104537_object30316:head# 2024-04-01T19:36:20.547 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f874ad6:::benchmark_data_smithi188_104537_object79081:head# 2024-04-01T19:36:20.548 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f880764:::benchmark_data_smithi188_104537_object105929:head# 2024-04-01T19:36:20.548 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f88a0c9:::benchmark_data_smithi188_104537_object29484:head# 2024-04-01T19:36:20.548 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f896cfd:::benchmark_data_smithi188_104537_object124717:head# 2024-04-01T19:36:20.548 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f8a6c8f:::benchmark_data_smithi188_104537_object19284:head# 2024-04-01T19:36:20.548 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f8af5b5:::benchmark_data_smithi188_104537_object89435:head# 2024-04-01T19:36:20.548 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f8b5c3e:::benchmark_data_smithi188_104537_object99687:head# 2024-04-01T19:36:20.548 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f8bcd5f:::benchmark_data_smithi188_104537_object76900:head# 2024-04-01T19:36:20.550 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f8c3375:::benchmark_data_smithi188_104537_object94364:head# 2024-04-01T19:36:20.550 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f8da14f:::benchmark_data_smithi188_104537_object144096:head# 2024-04-01T19:36:20.550 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f8dc747:::benchmark_data_smithi188_104537_object148282:head# 2024-04-01T19:36:20.550 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f8e9a7b:::benchmark_data_smithi188_104537_object28861:head# 2024-04-01T19:36:20.553 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f8ea08d:::benchmark_data_smithi188_104537_object142208:head# 2024-04-01T19:36:20.553 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f8f6397:::benchmark_data_smithi188_104537_object152442:head# 2024-04-01T19:36:20.554 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f8f9876:::benchmark_data_smithi188_104537_object161720:head# 2024-04-01T19:36:20.554 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f900e66:::benchmark_data_smithi188_104537_object137045:head# 2024-04-01T19:36:20.554 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f90cb76:::benchmark_data_smithi188_104537_object74953:head# 2024-04-01T19:36:20.554 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f90d1c5:::benchmark_data_smithi188_104537_object29877:head# 2024-04-01T19:36:20.554 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f912b5a:::benchmark_data_smithi188_104537_object33999:head# 2024-04-01T19:36:20.555 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f91638a:::benchmark_data_smithi188_104537_object30564:head# 2024-04-01T19:36:20.555 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f919705:::benchmark_data_smithi188_104537_object109391:head# 2024-04-01T19:36:20.555 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f91cfe6:::benchmark_data_smithi188_104537_object69909:head# 2024-04-01T19:36:20.555 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f92125c:::benchmark_data_smithi188_104537_object32289:head# 2024-04-01T19:36:20.555 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9214ac:::benchmark_data_smithi188_104537_object13651:head# 2024-04-01T19:36:20.557 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9282dc:::benchmark_data_smithi188_104537_object98254:head# 2024-04-01T19:36:20.557 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f92d189:::benchmark_data_smithi188_104537_object76904:head# 2024-04-01T19:36:20.557 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f93aba7:::benchmark_data_smithi188_104537_object96190:head# 2024-04-01T19:36:20.557 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f93f188:::benchmark_data_smithi188_104537_object52790:head# 2024-04-01T19:36:20.557 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f94c262:::benchmark_data_smithi188_104537_object128029:head# 2024-04-01T19:36:20.557 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f94d4e1:::benchmark_data_smithi188_104537_object24537:head# 2024-04-01T19:36:20.557 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f95656a:::benchmark_data_smithi188_104537_object33563:head# 2024-04-01T19:36:20.557 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f95ace3:::benchmark_data_smithi188_104537_object126864:head# 2024-04-01T19:36:20.558 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f95b571:::benchmark_data_smithi188_104537_object138134:head# 2024-04-01T19:36:20.558 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f95ec89:::benchmark_data_smithi188_104537_object166964:head# 2024-04-01T19:36:20.558 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f96b28f:::benchmark_data_smithi188_104537_object35568:head# 2024-04-01T19:36:20.558 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9718c9:::benchmark_data_smithi188_104537_object110717:head# 2024-04-01T19:36:20.559 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f974ca1:::benchmark_data_smithi188_104537_object161497:head# 2024-04-01T19:36:20.559 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f982d05:::benchmark_data_smithi188_104537_object96713:head# 2024-04-01T19:36:20.560 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9855f7:::benchmark_data_smithi188_104537_object81122:head# 2024-04-01T19:36:20.561 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f98a31e:::benchmark_data_smithi188_104537_object87878:head# 2024-04-01T19:36:20.562 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f990362:::benchmark_data_smithi188_104537_object21301:head# 2024-04-01T19:36:20.562 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f993f56:::benchmark_data_smithi188_104537_object106778:head# 2024-04-01T19:36:20.562 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9a218c:::benchmark_data_smithi188_104537_object102463:head# 2024-04-01T19:36:20.562 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9a2455:::benchmark_data_smithi188_104537_object32319:head# 2024-04-01T19:36:20.563 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9a54e9:::benchmark_data_smithi188_104537_object72924:head# 2024-04-01T19:36:20.563 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9a7f11:::benchmark_data_smithi188_104537_object92398:head# 2024-04-01T19:36:20.563 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9a81c0:::benchmark_data_smithi188_104537_object103425:head# 2024-04-01T19:36:20.563 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9aca32:::benchmark_data_smithi188_104537_object55486:head# 2024-04-01T19:36:20.564 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9b5472:::benchmark_data_smithi188_104537_object69317:head# 2024-04-01T19:36:20.564 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9b65b7:::benchmark_data_smithi188_104537_object46194:head# 2024-04-01T19:36:20.565 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9bbf55:::benchmark_data_smithi188_104537_object167555:head# 2024-04-01T19:36:20.565 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9c1ef9:::benchmark_data_smithi188_104537_object129777:head# 2024-04-01T19:36:20.566 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9c4882:::benchmark_data_smithi188_104537_object118251:head# 2024-04-01T19:36:20.566 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9caa44:::benchmark_data_smithi188_104537_object26174:head# 2024-04-01T19:36:20.567 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9ce502:::benchmark_data_smithi188_104537_object122595:head# 2024-04-01T19:36:20.567 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9d09bb:::benchmark_data_smithi188_104537_object68936:head# 2024-04-01T19:36:20.568 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9d703f:::benchmark_data_smithi188_104537_object108674:head# 2024-04-01T19:36:20.568 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9d75be:::benchmark_data_smithi188_104537_object106330:head# 2024-04-01T19:36:20.568 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9d97a4:::benchmark_data_smithi188_104537_object157835:head# 2024-04-01T19:36:20.570 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9da0a2:::benchmark_data_smithi188_104537_object26762:head# 2024-04-01T19:36:20.570 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9ece29:::benchmark_data_smithi188_104537_object168132:head# 2024-04-01T19:36:20.570 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9eec02:::benchmark_data_smithi188_104537_object34066:head# 2024-04-01T19:36:20.570 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9f9037:::benchmark_data_smithi188_104537_object34077:head# 2024-04-01T19:36:20.571 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5f9fb97f:::benchmark_data_smithi188_104537_object17165:head# 2024-04-01T19:36:20.571 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fa01c20:::benchmark_data_smithi188_104537_object76494:head# 2024-04-01T19:36:20.571 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fa05971:::benchmark_data_smithi188_104537_object44630:head# 2024-04-01T19:36:20.572 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fa0a3b2:::benchmark_data_smithi188_104537_object74734:head# 2024-04-01T19:36:20.572 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fa0e08f:::benchmark_data_smithi188_104537_object100926:head# 2024-04-01T19:36:20.573 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fa0f0aa:::benchmark_data_smithi188_104537_object52547:head# 2024-04-01T19:36:20.573 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fa1f484:::benchmark_data_smithi188_104537_object119722:head# 2024-04-01T19:36:20.573 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fa30560:::benchmark_data_smithi188_104537_object171144:head# 2024-04-01T19:36:20.574 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fa32f5e:::benchmark_data_smithi188_104537_object25758:head# 2024-04-01T19:36:20.574 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fa35c7e:::benchmark_data_smithi188_104537_object163238:head# 2024-04-01T19:36:20.574 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fa3ee40:::benchmark_data_smithi188_104537_object49244:head# 2024-04-01T19:36:20.575 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fa3fe44:::benchmark_data_smithi188_104537_object76863:head# 2024-04-01T19:36:20.575 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fa4e895:::benchmark_data_smithi188_104537_object158208:head# 2024-04-01T19:36:20.576 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fa5f282:::benchmark_data_smithi188_104537_object164656:head# 2024-04-01T19:36:20.576 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fa6c1d0:::benchmark_data_smithi188_104537_object157273:head# 2024-04-01T19:36:20.576 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fa6cf45:::benchmark_data_smithi188_104537_object39245:head# 2024-04-01T19:36:20.577 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fa91148:::benchmark_data_smithi188_104537_object150470:head# 2024-04-01T19:36:20.577 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fa9ac4e:::benchmark_data_smithi188_104537_object119143:head# 2024-04-01T19:36:20.578 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5faa08b3:::benchmark_data_smithi188_104537_object152105:head# 2024-04-01T19:36:20.578 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5faa0a54:::benchmark_data_smithi188_104537_object90360:head# 2024-04-01T19:36:20.578 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5faa4f49:::benchmark_data_smithi188_104537_object122231:head# 2024-04-01T19:36:20.579 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5faaebd9:::benchmark_data_smithi188_104537_object41856:head# 2024-04-01T19:36:20.579 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fabc5d6:::benchmark_data_smithi188_104537_object17059:head# 2024-04-01T19:36:20.580 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fabdb91:::benchmark_data_smithi188_104537_object44574:head# 2024-04-01T19:36:20.587 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fabecdc:::benchmark_data_smithi188_104537_object96618:head# 2024-04-01T19:36:20.587 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fac2b92:::benchmark_data_smithi188_104537_object166131:head# 2024-04-01T19:36:20.587 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5face81c:::benchmark_data_smithi188_104537_object68373:head# 2024-04-01T19:36:20.587 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5face856:::benchmark_data_smithi188_104537_object96138:head# 2024-04-01T19:36:20.587 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fad49a6:::benchmark_data_smithi188_104537_object147218:head# 2024-04-01T19:36:20.587 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fad793f:::benchmark_data_smithi188_104537_object62014:head# 2024-04-01T19:36:20.587 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fadd39b:::benchmark_data_smithi188_104537_object80910:head# 2024-04-01T19:36:20.588 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5faea41e:::benchmark_data_smithi188_104537_object101842:head# 2024-04-01T19:36:20.588 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fafd36d:::benchmark_data_smithi188_104537_object120084:head# 2024-04-01T19:36:20.588 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fb005f2:::benchmark_data_smithi188_104537_object59704:head# 2024-04-01T19:36:20.588 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fb00971:::benchmark_data_smithi188_104537_object84465:head# 2024-04-01T19:36:20.588 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fb0559c:::benchmark_data_smithi188_104537_object109466:head# 2024-04-01T19:36:20.588 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fb083df:::benchmark_data_smithi188_104537_object156387:head# 2024-04-01T19:36:20.588 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fb16d9f:::benchmark_data_smithi188_104537_object108786:head# 2024-04-01T19:36:20.588 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fb2406a:::benchmark_data_smithi188_104537_object51374:head# 2024-04-01T19:36:20.589 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fb3e146:::benchmark_data_smithi188_104537_object35181:head# 2024-04-01T19:36:20.589 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fb4ce3e:::benchmark_data_smithi188_104537_object151619:head# 2024-04-01T19:36:20.589 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fb536ff:::benchmark_data_smithi188_104537_object25550:head# 2024-04-01T19:36:20.589 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fb550e8:::benchmark_data_smithi188_104537_object78097:head# 2024-04-01T19:36:20.589 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fb554dd:::benchmark_data_smithi188_104537_object56722:head# 2024-04-01T19:36:20.590 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fb55aae:::benchmark_data_smithi188_104537_object50660:head# 2024-04-01T19:36:20.590 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fb5ad2a:::benchmark_data_smithi188_104537_object66669:head# 2024-04-01T19:36:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fb64c33:::benchmark_data_smithi188_104537_object153062:head# 2024-04-01T19:36:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fb74e81:::benchmark_data_smithi188_104537_object76592:head# 2024-04-01T19:36:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fb7e620:::benchmark_data_smithi188_104537_object101883:head# 2024-04-01T19:36:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fb7eb1b:::benchmark_data_smithi188_104537_object80120:head# 2024-04-01T19:36:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fb81c5b:::benchmark_data_smithi188_104537_object71277:head# 2024-04-01T19:36:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fb865bd:::benchmark_data_smithi188_104537_object17041:head# 2024-04-01T19:36:20.593 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fb96c5b:::benchmark_data_smithi188_104537_object133252:head# 2024-04-01T19:36:20.593 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fb96ca3:::benchmark_data_smithi188_104537_object112088:head# 2024-04-01T19:36:20.593 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fb9f41b:::benchmark_data_smithi188_104537_object34651:head# 2024-04-01T19:36:20.594 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fb9f988:::benchmark_data_smithi188_104537_object118278:head# 2024-04-01T19:36:20.594 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fba5053:::benchmark_data_smithi188_104537_object56876:head# 2024-04-01T19:36:20.594 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fbb8e45:::benchmark_data_smithi188_104537_object42464:head# 2024-04-01T19:36:20.595 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fbb9506:::benchmark_data_smithi188_104537_object85651:head# 2024-04-01T19:36:20.595 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fbba881:::benchmark_data_smithi188_104537_object23057:head# 2024-04-01T19:36:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fbc06b9:::benchmark_data_smithi188_104537_object163318:head# 2024-04-01T19:36:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fbc2a71:::benchmark_data_smithi188_104537_object159683:head# 2024-04-01T19:36:20.596 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fbc8bdf:::benchmark_data_smithi188_104537_object28447:head# 2024-04-01T19:36:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fbd6dc5:::benchmark_data_smithi188_104537_object85180:head# 2024-04-01T19:36:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fbd90c1:::benchmark_data_smithi188_104537_object20027:head# 2024-04-01T19:36:20.598 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fbd9ee4:::benchmark_data_smithi188_104537_object152042:head# 2024-04-01T19:36:20.598 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fbecb33:::benchmark_data_smithi188_104537_object127661:head# 2024-04-01T19:36:20.599 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fbed6c6:::benchmark_data_smithi188_104537_object146004:head# 2024-04-01T19:36:20.599 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fbf1748:::benchmark_data_smithi188_104537_object30093:head# 2024-04-01T19:36:20.600 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fbf6501:::benchmark_data_smithi188_104537_object160535:head# 2024-04-01T19:36:20.600 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fbf9b9d:::benchmark_data_smithi188_104537_object95831:head# 2024-04-01T19:36:20.600 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fbfdb06:::benchmark_data_smithi188_104537_object19596:head# 2024-04-01T19:36:20.600 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fbfeb29:::benchmark_data_smithi188_104537_object109116:head# 2024-04-01T19:36:20.601 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc13a9a:::benchmark_data_smithi188_104537_object132283:head# 2024-04-01T19:36:20.601 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc17054:::benchmark_data_smithi188_104537_object74722:head# 2024-04-01T19:36:20.602 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc31ada:::benchmark_data_smithi188_104537_object44914:head# 2024-04-01T19:36:20.602 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc32417:::benchmark_data_smithi188_104537_object156179:head# 2024-04-01T19:36:20.603 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc360aa:::benchmark_data_smithi188_104537_object43500:head# 2024-04-01T19:36:20.603 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc47665:::benchmark_data_smithi188_104537_object164966:head# 2024-04-01T19:36:20.603 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc49bac:::benchmark_data_smithi188_104537_object146709:head# 2024-04-01T19:36:20.604 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc51db9:::benchmark_data_smithi188_104537_object159055:head# 2024-04-01T19:36:20.604 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc54334:::benchmark_data_smithi188_104537_object79793:head# 2024-04-01T19:36:20.605 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc563a3:::benchmark_data_smithi188_104537_object71372:head# 2024-04-01T19:36:20.605 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc56c1d:::benchmark_data_smithi188_104537_object52933:head# 2024-04-01T19:36:20.606 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc585ec:::benchmark_data_smithi188_104537_object88825:head# 2024-04-01T19:36:20.606 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc5c715:::benchmark_data_smithi188_104537_object138229:head# 2024-04-01T19:36:20.607 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc5d419:::benchmark_data_smithi188_104537_object93329:head# 2024-04-01T19:36:20.607 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc65e1f:::benchmark_data_smithi188_104537_object26932:head# 2024-04-01T19:36:20.608 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc6cfc2:::benchmark_data_smithi188_104537_object23345:head# 2024-04-01T19:36:20.609 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc6e1b2:::benchmark_data_smithi188_104537_object91905:head# 2024-04-01T19:36:20.609 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc71302:::benchmark_data_smithi188_104537_object88384:head# 2024-04-01T19:36:20.609 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc73202:::benchmark_data_smithi188_104537_object138338:head# 2024-04-01T19:36:20.610 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc737f5:::benchmark_data_smithi188_104537_object121369:head# 2024-04-01T19:36:20.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc7d154:::benchmark_data_smithi188_104537_object169302:head# 2024-04-01T19:36:20.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc823bc:::benchmark_data_smithi188_104537_object112391:head# 2024-04-01T19:36:20.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc8448b:::benchmark_data_smithi188_104537_object81215:head# 2024-04-01T19:36:20.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc850d6:::benchmark_data_smithi188_104537_object34327:head# 2024-04-01T19:36:20.612 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc87f63:::benchmark_data_smithi188_104537_object149397:head# 2024-04-01T19:36:20.612 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fc8bf19:::benchmark_data_smithi188_104537_object102605:head# 2024-04-01T19:36:20.612 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fca00b1:::benchmark_data_smithi188_104537_object39787:head# 2024-04-01T19:36:20.613 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fca9f3a:::benchmark_data_smithi188_104537_object163054:head# 2024-04-01T19:36:20.613 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fcb99cf:::benchmark_data_smithi188_104537_object154349:head# 2024-04-01T19:36:20.614 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fcc54fa:::benchmark_data_smithi188_104537_object79979:head# 2024-04-01T19:36:20.614 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fcd4d02:::benchmark_data_smithi188_104537_object87164:head# 2024-04-01T19:36:20.614 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fcdfea2:::benchmark_data_smithi188_104537_object108521:head# 2024-04-01T19:36:20.615 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fcf1992:::benchmark_data_smithi188_104537_object74999:head# 2024-04-01T19:36:20.615 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fcfaf38:::benchmark_data_smithi188_104537_object65064:head# 2024-04-01T19:36:20.615 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd0032c:::benchmark_data_smithi188_104537_object37780:head# 2024-04-01T19:36:20.616 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd0059a:::benchmark_data_smithi188_104537_object14671:head# 2024-04-01T19:36:20.616 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd01ee1:::benchmark_data_smithi188_104537_object91125:head# 2024-04-01T19:36:20.616 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd0458f:::benchmark_data_smithi188_104537_object87948:head# 2024-04-01T19:36:20.617 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd09394:::benchmark_data_smithi188_104537_object12407:head# 2024-04-01T19:36:20.617 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd09931:::benchmark_data_smithi188_104537_object50856:head# 2024-04-01T19:36:20.618 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd09aba:::benchmark_data_smithi188_104537_object71513:head# 2024-04-01T19:36:20.618 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd09c2e:::benchmark_data_smithi188_104537_object140138:head# 2024-04-01T19:36:20.619 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd162b3:::benchmark_data_smithi188_104537_object28800:head# 2024-04-01T19:36:20.619 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd1acd3:::benchmark_data_smithi188_104537_object143388:head# 2024-04-01T19:36:20.619 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd1cbc4:::benchmark_data_smithi188_104537_object107353:head# 2024-04-01T19:36:20.620 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd331fc:::benchmark_data_smithi188_104537_object105142:head# 2024-04-01T19:36:20.620 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd3322a:::benchmark_data_smithi188_104537_object60429:head# 2024-04-01T19:36:20.621 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd34547:::benchmark_data_smithi188_104537_object49392:head# 2024-04-01T19:36:20.621 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd375c5:::benchmark_data_smithi188_104537_object26854:head# 2024-04-01T19:36:20.622 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd3f3a1:::benchmark_data_smithi188_104537_object165574:head# 2024-04-01T19:36:20.623 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd4791f:::benchmark_data_smithi188_104537_object12925:head# 2024-04-01T19:36:20.623 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd48d9d:::benchmark_data_smithi188_104537_object145388:head# 2024-04-01T19:36:20.623 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd4bedf:::benchmark_data_smithi188_104537_object102208:head# 2024-04-01T19:36:20.623 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd4d7ce:::benchmark_data_smithi188_104537_object154601:head# 2024-04-01T19:36:20.624 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd5d554:::benchmark_data_smithi188_104537_object56526:head# 2024-04-01T19:36:20.624 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd7316b:::benchmark_data_smithi188_104537_object154275:head# 2024-04-01T19:36:20.625 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd7583f:::benchmark_data_smithi188_104537_object74291:head# 2024-04-01T19:36:20.625 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd76b04:::benchmark_data_smithi188_104537_object152342:head# 2024-04-01T19:36:20.626 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd786a1:::benchmark_data_smithi188_104537_object44710:head# 2024-04-01T19:36:20.626 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd82f57:::benchmark_data_smithi188_104537_object14316:head# 2024-04-01T19:36:20.627 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd96f97:::benchmark_data_smithi188_104537_object145393:head# 2024-04-01T19:36:20.627 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd97be3:::benchmark_data_smithi188_104537_object171353:head# 2024-04-01T19:36:20.627 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fd9c127:::benchmark_data_smithi188_104537_object127479:head# 2024-04-01T19:36:20.628 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fda2381:::benchmark_data_smithi188_104537_object158305:head# 2024-04-01T19:36:20.628 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fdab196:::benchmark_data_smithi188_104537_object162686:head# 2024-04-01T19:36:20.629 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fdb0ffc:::benchmark_data_smithi188_104537_object142342:head# 2024-04-01T19:36:20.629 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fdb77c0:::benchmark_data_smithi188_104537_object156458:head# 2024-04-01T19:36:20.629 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fdb887b:::benchmark_data_smithi188_104537_object73596:head# 2024-04-01T19:36:20.630 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fdc17ee:::benchmark_data_smithi188_104537_object103014:head# 2024-04-01T19:36:20.630 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fdc2d1c:::benchmark_data_smithi188_104537_object159771:head# 2024-04-01T19:36:20.631 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fdc4b48:::benchmark_data_smithi188_104537_object89382:head# 2024-04-01T19:36:20.631 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fdc649c:::benchmark_data_smithi188_104537_object59878:head# 2024-04-01T19:36:20.632 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fdc6a48:::benchmark_data_smithi188_104537_object121113:head# 2024-04-01T19:36:20.632 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fdcdad1:::benchmark_data_smithi188_104537_object70140:head# 2024-04-01T19:36:20.632 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fdd3108:::benchmark_data_smithi188_104537_object107928:head# 2024-04-01T19:36:20.633 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fdd8122:::benchmark_data_smithi188_104537_object133393:head# 2024-04-01T19:36:20.633 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fddbf2f:::benchmark_data_smithi188_104537_object49496:head# 2024-04-01T19:36:20.634 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fdddd70:::benchmark_data_smithi188_104537_object82902:head# 2024-04-01T19:36:20.634 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fde1155:::benchmark_data_smithi188_104537_object60011:head# 2024-04-01T19:36:20.634 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fde1211:::benchmark_data_smithi188_104537_object123086:head# 2024-04-01T19:36:20.635 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fde2774:::benchmark_data_smithi188_104537_object27048:head# 2024-04-01T19:36:20.635 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fde60b8:::benchmark_data_smithi188_104537_object163526:head# 2024-04-01T19:36:20.636 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fdf299b:::benchmark_data_smithi188_104537_object78937:head# 2024-04-01T19:36:20.636 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fdf38f9:::benchmark_data_smithi188_104537_object19283:head# 2024-04-01T19:36:20.637 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fdf7d94:::benchmark_data_smithi188_104537_object14124:head# 2024-04-01T19:36:20.637 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe01b36:::benchmark_data_smithi188_104537_object21833:head# 2024-04-01T19:36:20.637 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe02271:::benchmark_data_smithi188_104537_object93309:head# 2024-04-01T19:36:20.638 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe137e3:::benchmark_data_smithi188_104537_object130322:head# 2024-04-01T19:36:20.638 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe17a7f:::benchmark_data_smithi188_104537_object45267:head# 2024-04-01T19:36:20.638 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe18a9e:::benchmark_data_smithi188_104537_object147514:head# 2024-04-01T19:36:20.639 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe2318a:::benchmark_data_smithi188_104537_object127106:head# 2024-04-01T19:36:20.639 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe2d934:::benchmark_data_smithi188_104537_object29555:head# 2024-04-01T19:36:20.640 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe2de40:::benchmark_data_smithi188_104537_object169802:head# 2024-04-01T19:36:20.640 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe33cb7:::benchmark_data_smithi188_104537_object42715:head# 2024-04-01T19:36:20.641 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe342c0:::benchmark_data_smithi188_104537_object123268:head# 2024-04-01T19:36:20.642 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe3c647:::benchmark_data_smithi188_104537_object133176:head# 2024-04-01T19:36:20.642 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe51c64:::benchmark_data_smithi188_104537_object29734:head# 2024-04-01T19:36:20.642 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe539ff:::benchmark_data_smithi188_104537_object31647:head# 2024-04-01T19:36:20.642 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe5807a:::benchmark_data_smithi188_104537_object146090:head# 2024-04-01T19:36:20.643 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe5a2a8:::benchmark_data_smithi188_104537_object86408:head# 2024-04-01T19:36:20.643 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe5af3d:::benchmark_data_smithi188_104537_object138194:head# 2024-04-01T19:36:20.644 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe69b37:::benchmark_data_smithi188_104537_object115411:head# 2024-04-01T19:36:20.644 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe6c5ae:::benchmark_data_smithi188_104537_object31921:head# 2024-04-01T19:36:20.644 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe6c6e5:::benchmark_data_smithi188_104537_object48693:head# 2024-04-01T19:36:20.644 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:36:20.646 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe6f26c:::benchmark_data_smithi188_104537_object166659:head# 2024-04-01T19:36:20.646 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe70cb3:::benchmark_data_smithi188_104537_object112434:head# 2024-04-01T19:36:20.646 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe7b54e:::benchmark_data_smithi188_104537_object109870:head# 2024-04-01T19:36:20.647 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe7e54e:::benchmark_data_smithi188_104537_object19287:head# 2024-04-01T19:36:20.647 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe82ad6:::benchmark_data_smithi188_104537_object29324:head# 2024-04-01T19:36:20.647 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe8ecb7:::benchmark_data_smithi188_104537_object97437:head# 2024-04-01T19:36:20.649 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe90c7e:::benchmark_data_smithi188_104537_object106297:head# 2024-04-01T19:36:20.649 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe9192b:::benchmark_data_smithi188_104537_object82806:head# 2024-04-01T19:36:20.649 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe92285:::benchmark_data_smithi188_104537_object76835:head# 2024-04-01T19:36:20.649 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe92448:::benchmark_data_smithi188_104537_object127179:head# 2024-04-01T19:36:20.650 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe95e2b:::benchmark_data_smithi188_104537_object91052:head# 2024-04-01T19:36:20.650 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe9da8e:::benchmark_data_smithi188_104537_object159066:head# 2024-04-01T19:36:20.652 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe9f349:::benchmark_data_smithi188_104537_object56629:head# 2024-04-01T19:36:20.652 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fe9f99b:::benchmark_data_smithi188_104537_object112469:head# 2024-04-01T19:36:20.652 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fea5f89:::benchmark_data_smithi188_104537_object18160:head# 2024-04-01T19:36:20.652 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5feac2b3:::benchmark_data_smithi188_104537_object15699:head# 2024-04-01T19:36:20.652 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5feafb1c:::benchmark_data_smithi188_104537_object112494:head# 2024-04-01T19:36:20.652 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5febcd67:::benchmark_data_smithi188_104537_object51507:head# 2024-04-01T19:36:20.652 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5febe598:::benchmark_data_smithi188_104537_object147789:head# 2024-04-01T19:36:20.653 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fec1f9f:::benchmark_data_smithi188_104537_object170062:head# 2024-04-01T19:36:20.653 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fec7062:::benchmark_data_smithi188_104537_object152055:head# 2024-04-01T19:36:20.653 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fecb290:::benchmark_data_smithi188_104537_object100644:head# 2024-04-01T19:36:20.654 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fecb6a5:::benchmark_data_smithi188_104537_object16330:head# 2024-04-01T19:36:20.654 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5feccd95:::benchmark_data_smithi188_104537_object70742:head# 2024-04-01T19:36:20.654 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fed20ac:::benchmark_data_smithi188_104537_object86162:head# 2024-04-01T19:36:20.655 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fed3075:::benchmark_data_smithi188_104537_object91970:head# 2024-04-01T19:36:20.655 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fed6cfc:::benchmark_data_smithi188_104537_object152222:head# 2024-04-01T19:36:20.655 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fef53b9:::benchmark_data_smithi188_104537_object149816:head# 2024-04-01T19:36:20.656 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fef60e4:::benchmark_data_smithi188_104537_object131960:head# 2024-04-01T19:36:20.656 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fef767f:::benchmark_data_smithi188_104537_object83731:head# 2024-04-01T19:36:20.657 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fefdf14:::benchmark_data_smithi188_104537_object158275:head# 2024-04-01T19:36:20.657 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ff0198b:::benchmark_data_smithi188_104537_object74349:head# 2024-04-01T19:36:20.657 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ff03a3f:::benchmark_data_smithi188_104537_object21848:head# 2024-04-01T19:36:20.658 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ff06ef8:::benchmark_data_smithi188_104537_object44633:head# 2024-04-01T19:36:20.659 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ff07513:::benchmark_data_smithi188_104537_object63406:head# 2024-04-01T19:36:20.659 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ff0988e:::benchmark_data_smithi188_104537_object138621:head# 2024-04-01T19:36:20.659 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ff2cb41:::benchmark_data_smithi188_104537_object106921:head# 2024-04-01T19:36:20.660 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ff33441:::benchmark_data_smithi188_104537_object165626:head# 2024-04-01T19:36:20.660 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ff42e9e:::benchmark_data_smithi188_104537_object113605:head# 2024-04-01T19:36:20.661 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ff44dec:::benchmark_data_smithi188_104537_object124068:head# 2024-04-01T19:36:20.661 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ff4788f:::benchmark_data_smithi188_104537_object127559:head# 2024-04-01T19:36:20.661 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ff584b5:::benchmark_data_smithi188_104537_object42660:head# 2024-04-01T19:36:20.662 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ff58ef9:::benchmark_data_smithi188_104537_object156402:head# 2024-04-01T19:36:20.663 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ff6bc8a:::benchmark_data_smithi188_104537_object115221:head# 2024-04-01T19:36:20.663 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ff6d625:::benchmark_data_smithi188_104537_object130943:head# 2024-04-01T19:36:20.663 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ff6fbf7:::benchmark_data_smithi188_104537_object54214:head# 2024-04-01T19:36:20.664 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ff7a7b2:::benchmark_data_smithi188_104537_object131415:head# 2024-04-01T19:36:20.664 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ff7becd:::benchmark_data_smithi188_104537_object110698:head# 2024-04-01T19:36:20.664 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ff8150e:::benchmark_data_smithi188_104537_object156226:head# 2024-04-01T19:36:20.665 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ff8b362:::benchmark_data_smithi188_104537_object84286:head# 2024-04-01T19:36:20.665 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ff8ea40:::benchmark_data_smithi188_104537_object19799:head# 2024-04-01T19:36:20.666 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ff8f89a:::benchmark_data_smithi188_104537_object17708:head# 2024-04-01T19:36:20.666 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ff9501a:::benchmark_data_smithi188_104537_object146429:head# 2024-04-01T19:36:20.667 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ff9620d:::benchmark_data_smithi188_104537_object157137:head# 2024-04-01T19:36:20.667 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ff9d9bf:::benchmark_data_smithi188_104537_object84425:head# 2024-04-01T19:36:20.668 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ffc6cfb:::benchmark_data_smithi188_104537_object14322:head# 2024-04-01T19:36:20.668 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ffc93ab:::benchmark_data_smithi188_104537_object84204:head# 2024-04-01T19:36:20.669 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ffca48b:::benchmark_data_smithi188_104537_object62284:head# 2024-04-01T19:36:20.669 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ffca56c:::benchmark_data_smithi188_104537_object110766:head# 2024-04-01T19:36:20.670 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ffcb0f5:::benchmark_data_smithi188_104537_object117619:head# 2024-04-01T19:36:20.670 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ffcc0a1:::benchmark_data_smithi188_104537_object81058:head# 2024-04-01T19:36:20.671 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ffce550:::benchmark_data_smithi188_104537_object81200:head# 2024-04-01T19:36:20.671 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ffcf707:::benchmark_data_smithi188_104537_object58938:head# 2024-04-01T19:36:20.671 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ffd4eac:::benchmark_data_smithi188_104537_object139192:head# 2024-04-01T19:36:20.672 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ffd736c:::benchmark_data_smithi188_104537_object69889:head# 2024-04-01T19:36:20.672 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ffda6f1:::benchmark_data_smithi188_104537_object22670:head# 2024-04-01T19:36:20.672 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ffdc182:::benchmark_data_smithi188_104537_object63549:head# 2024-04-01T19:36:20.673 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ffde346:::benchmark_data_smithi188_104537_object32337:head# 2024-04-01T19:36:20.673 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ffe0b54:::benchmark_data_smithi188_104537_object96763:head# 2024-04-01T19:36:20.674 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5ffe91cf:::benchmark_data_smithi188_104537_object154399:head# 2024-04-01T19:36:20.675 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fff1145:::benchmark_data_smithi188_104537_object61739:head# 2024-04-01T19:36:20.675 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fff244e:::benchmark_data_smithi188_104537_object27058:head# 2024-04-01T19:36:20.676 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fff4714:::benchmark_data_smithi188_104537_object47641:head# 2024-04-01T19:36:20.676 INFO:teuthology.orchestra.run.smithi062.stderr:Read #4:5fff76fe:::benchmark_data_smithi188_104537_object130668:head# 2024-04-01T19:36:20.677 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:20.680 INFO:teuthology.orchestra.run.smithi062.stderr:Export successful 2024-04-01T19:36:20.700 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:36:20.702 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:20.702 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:36:20.803 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:36:20.833 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:20.854 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:36:20.857 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:20.858 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:36:20.959 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:36:20.988 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:21.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:21 smithi022 ceph-mon[39439]: osdmap e311: 12 total, 11 up, 11 in 2024-04-01T19:36:21.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:21 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/504568929' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:36:21.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:21.034 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:21.035 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:21.035 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:21.035 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:21.035 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:21.092 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:36:21.112 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:36:21.113 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:21 smithi062 ceph-mon[44211]: osdmap e311: 12 total, 11 up, 11 in 2024-04-01T19:36:21.113 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:21 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/504568929' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:36:21.113 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:21.113 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:21.113 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:21.113 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:21.113 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:21.114 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:21.114 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:21.114 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:36:21.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:21 smithi188 ceph-mon[43939]: osdmap e311: 12 total, 11 up, 11 in 2024-04-01T19:36:21.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:21 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/504568929' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:36:21.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:21.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:21.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:21.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:21.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:21.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:21.215 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:36:21.245 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:21.271 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:36:21.274 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:21.274 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:36:21.294 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:36:21.295 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:36:21.375 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:36:21.404 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:21.405 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:36:21.425 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:36:21.427 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:21.428 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:36:21.529 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:36:21.558 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:21.710 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:36:21.713 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:21.713 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:36:21.814 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:36:21.844 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:21.920 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:36:21.922 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:21.922 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:36:22.023 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:36:22.052 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:22.074 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:36:22.077 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:22.077 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:36:22.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:22.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:22.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:22.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:22.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:22.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:22 smithi022 ceph-mon[39439]: pgmap v896: 17 pgs: 2 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 7100/321960 objects degraded (2.205%); 81 MiB/s, 1.30k objects/s recovering 2024-04-01T19:36:22.178 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:36:22.208 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:22.229 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:36:22.232 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:22.232 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:36:22.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:22.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:22.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:22.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:22.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:22.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:22 smithi062 ceph-mon[44211]: pgmap v896: 17 pgs: 2 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 7100/321960 objects degraded (2.205%); 81 MiB/s, 1.30k objects/s recovering 2024-04-01T19:36:22.333 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:36:22.358 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:36:22.358 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:36:22.358 INFO:teuthology.orchestra.run.smithi062.stdout: "complaint_time": 30, 2024-04-01T19:36:22.358 INFO:teuthology.orchestra.run.smithi062.stdout: "num_blocked_ops": 0 2024-04-01T19:36:22.358 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:36:22.363 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:22.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:22.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:22.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:22.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:22.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:22.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:22 smithi188 ceph-mon[43939]: pgmap v896: 17 pgs: 2 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 7100/321960 objects degraded (2.205%); 81 MiB/s, 1.30k objects/s recovering 2024-04-01T19:36:22.675 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -n osd.6 --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-6 --journal-path /var/lib/ceph/osd/ceph-6/journal --force --op remove --pgid 4.a 2024-04-01T19:36:22.914 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:36:22.916 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:22.916 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:36:22.930 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/osd.6/config 2024-04-01T19:36:23.018 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:36:23.047 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:23.067 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:36:23.070 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:23.070 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:36:23.172 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:36:23.202 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:23.226 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:36:23.230 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:23.230 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:36:23.296 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:36:23.331 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:36:23.371 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:23.380 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_historic_ops 2024-04-01T19:36:23.396 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:36:23.398 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:23.399 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:36:23.500 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:36:23.529 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:23.550 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:36:23.552 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:23.553 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:36:23.580 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:36:23.654 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:36:23.684 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:23.703 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:36:23.706 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:23.706 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:36:23.807 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:36:23.838 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:23.865 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:36:23.867 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:23.868 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:36:23.969 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:36:23.997 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:24.050 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:36:24.054 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:24 smithi022 ceph-mon[39439]: pgmap v897: 17 pgs: 2 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 4167/321960 objects degraded (1.294%); 74 MiB/s, 1.18k objects/s recovering 2024-04-01T19:36:24.054 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:24 smithi022 ceph-mon[39439]: osdmap e312: 12 total, 11 up, 11 in 2024-04-01T19:36:24.054 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:24 smithi022 ceph-mon[39439]: 4.2 scrub starts 2024-04-01T19:36:24.054 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:24 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4193958868' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:36:24.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:24 smithi188 ceph-mon[43939]: pgmap v897: 17 pgs: 2 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 4167/321960 objects degraded (1.294%); 74 MiB/s, 1.18k objects/s recovering 2024-04-01T19:36:24.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:24 smithi188 ceph-mon[43939]: osdmap e312: 12 total, 11 up, 11 in 2024-04-01T19:36:24.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:24 smithi188 ceph-mon[43939]: 4.2 scrub starts 2024-04-01T19:36:24.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:24 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4193958868' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:36:24.195 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:36:24.197 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:24 smithi062 ceph-mon[44211]: pgmap v897: 17 pgs: 2 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 4167/321960 objects degraded (1.294%); 74 MiB/s, 1.18k objects/s recovering 2024-04-01T19:36:24.197 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:24 smithi062 ceph-mon[44211]: osdmap e312: 12 total, 11 up, 11 in 2024-04-01T19:36:24.198 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:24 smithi062 ceph-mon[44211]: 4.2 scrub starts 2024-04-01T19:36:24.198 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:24 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4193958868' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:36:24.198 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:24.199 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:36:24.215 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:36:24.300 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:36:24.330 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:24.404 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:36:24.406 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:24.407 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:36:24.508 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:36:24.535 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:24.632 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:36:24.634 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:24.635 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:36:24.736 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:36:24.764 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:24.784 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:36:24.787 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:24.788 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:36:24.889 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:36:24.916 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:24.936 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:36:24.938 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:24.939 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:36:25.040 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:36:25.066 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:25 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:36:25.066 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:25 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4193958868' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:36:25.067 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:25 smithi062 ceph-mon[44211]: osdmap e313: 12 total, 11 up, 11 in 2024-04-01T19:36:25.067 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:25 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 4167/321960 objects degraded (1.294%), 2 pgs degraded (PG_DEGRADED) 2024-04-01T19:36:25.069 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:25.167 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:36:25.170 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:25.171 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:36:25.206 INFO:teuthology.orchestra.run.smithi062.stderr:Creating an OSD daemon form without an OSD FSID value 2024-04-01T19:36:25.272 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:36:25.297 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:25 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:36:25.297 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:25 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4193958868' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:36:25.297 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:25 smithi188 ceph-mon[43939]: osdmap e313: 12 total, 11 up, 11 in 2024-04-01T19:36:25.297 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:25 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 4167/321960 objects degraded (1.294%), 2 pgs degraded (PG_DEGRADED) 2024-04-01T19:36:25.299 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:25.317 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:36:25.319 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:25.320 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:36:25.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:25 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:36:25.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:25 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4193958868' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:36:25.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:25 smithi022 ceph-mon[39439]: osdmap e313: 12 total, 11 up, 11 in 2024-04-01T19:36:25.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:25 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 4167/321960 objects degraded (1.294%), 2 pgs degraded (PG_DEGRADED) 2024-04-01T19:36:25.420 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:36:25.448 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:25.521 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:36:25.524 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:25.524 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:36:25.625 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:36:25.661 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:25.811 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:36:25.814 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:25.815 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:36:25.916 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:36:25.949 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:25.969 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:36:25.972 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:25.972 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:36:26.073 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:36:26.107 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:26.127 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:36:26.129 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:26.130 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:36:26.231 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:36:26.261 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:26 smithi188 ceph-mon[43939]: pgmap v900: 17 pgs: 1 active+clean+scrubbing, 1 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 5 op/s; 1786/321892 objects degraded (0.555%); 92 MiB/s, 1.48k objects/s recovering 2024-04-01T19:36:26.263 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:26.284 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:36:26.286 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:26.286 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:36:26.311 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:26 smithi062 ceph-mon[44211]: pgmap v900: 17 pgs: 1 active+clean+scrubbing, 1 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 5 op/s; 1786/321892 objects degraded (0.555%); 92 MiB/s, 1.48k objects/s recovering 2024-04-01T19:36:26.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:26 smithi022 ceph-mon[39439]: pgmap v900: 17 pgs: 1 active+clean+scrubbing, 1 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 5 op/s; 1786/321892 objects degraded (0.555%); 92 MiB/s, 1.48k objects/s recovering 2024-04-01T19:36:26.361 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:36:26.378 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:36:26.387 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:36:26.397 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:36:26.416 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:36:26.418 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:26.437 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:36:26.458 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:36:26.481 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:36:26.502 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:36:26.523 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:36:26.543 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:36:26.564 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:36:26.564 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:36:26.564 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:36:26.565 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:36:26.565 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:36:26.565 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:36:26.565 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:36:26.565 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:36:26.565 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:36:26.565 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:36:26.565 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:36:26.565 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:36:26.565 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:36:26.569 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:36:26.572 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:26.573 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:36:26.674 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:36:26.703 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:26.801 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:36:26.805 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:26.805 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:36:26.887 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:36:26.887 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:36:26.906 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:36:26.937 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:27.004 INFO:teuthology.orchestra.run.smithi062.stdout: marking collection for removal 2024-04-01T19:36:27.004 INFO:teuthology.orchestra.run.smithi062.stdout:setting '_remove' omap key 2024-04-01T19:36:27.005 INFO:teuthology.orchestra.run.smithi062.stdout:finish_remove_pgs 4.a_head removing 4.a 2024-04-01T19:36:27.221 INFO:teuthology.orchestra.run.smithi062.stdout:Remove successful 2024-04-01T19:36:27.246 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:36:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:27 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:36:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:27 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:36:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:27 smithi062 ceph-mon[44211]: osdmap e314: 12 total, 11 up, 11 in 2024-04-01T19:36:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:27 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3100117617' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:36:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:27 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:36:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:27.307 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:27 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:36:27.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:27 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:36:27.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:27 smithi022 ceph-mon[39439]: osdmap e314: 12 total, 11 up, 11 in 2024-04-01T19:36:27.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:27 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3100117617' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:36:27.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:27.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:27.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:27 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:36:27.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:27.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:27.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:27.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:27.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:27 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:36:27.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:27 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:36:27.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:27 smithi188 ceph-mon[43939]: osdmap e314: 12 total, 11 up, 11 in 2024-04-01T19:36:27.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:27 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3100117617' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:36:27.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:27.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:27.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:27 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:36:27.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:27.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:27.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:27.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:27.393 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:36:27.399 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:27.400 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:36:27.415 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:36:27.415 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:36:27.500 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:36:27.530 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:27.554 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:36:27.558 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:27.559 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:36:27.660 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:36:27.696 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:27.708 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:36:27.729 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_ops_in_flight 2024-04-01T19:36:27.733 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:36:27.736 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:27.737 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:36:27.838 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:36:27.878 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:27.995 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:36:27.998 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:27.999 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:36:28.100 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:36:28.155 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:28.187 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:36:28.189 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:28.190 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:36:28.291 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:36:28.301 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:28 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:28.301 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:28 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:28.301 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:28 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:28.301 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:28 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:28.301 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:28 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:28.301 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:28 smithi022 ceph-mon[39439]: pgmap v902: 17 pgs: 1 active+clean+scrubbing, 1 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 12 op/s; 1786/321812 objects degraded (0.555%); 55 MiB/s, 885 objects/s recovering 2024-04-01T19:36:28.301 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:28 smithi022 ceph-mon[39439]: osdmap e315: 12 total, 11 up, 11 in 2024-04-01T19:36:28.301 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:36:28.301 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:36:28.301 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:28 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:36:28.320 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:28 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:28.320 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:28 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:28.320 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:28 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:28.321 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:28 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:28.321 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:28 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:28.321 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:28 smithi188 ceph-mon[43939]: pgmap v902: 17 pgs: 1 active+clean+scrubbing, 1 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 12 op/s; 1786/321812 objects degraded (0.555%); 55 MiB/s, 885 objects/s recovering 2024-04-01T19:36:28.321 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:28 smithi188 ceph-mon[43939]: osdmap e315: 12 total, 11 up, 11 in 2024-04-01T19:36:28.321 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:36:28.321 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:36:28.321 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:28 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:36:28.323 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:28.349 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:36:28.352 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:28.352 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:36:28.413 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:28 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:28.413 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:28 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:28.413 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:28 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:28.413 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:28 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:28.413 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:28 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:28.413 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:28 smithi062 ceph-mon[44211]: pgmap v902: 17 pgs: 1 active+clean+scrubbing, 1 undersized+degraded+remapped+backfilling+peered, 15 active+clean; 9.8 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 12 op/s; 1786/321812 objects degraded (0.555%); 55 MiB/s, 885 objects/s recovering 2024-04-01T19:36:28.413 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:28 smithi062 ceph-mon[44211]: osdmap e315: 12 total, 11 up, 11 in 2024-04-01T19:36:28.413 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:36:28.413 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:36:28.413 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:28 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:36:28.448 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -n osd.6 --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-6 --journal-path /var/lib/ceph/osd/ceph-6/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.4.a.6 2024-04-01T19:36:28.452 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:36:28.499 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:28.514 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:36:28.528 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:36:28.536 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:28.537 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:36:28.638 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:36:28.693 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:28.814 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/osd.6/config 2024-04-01T19:36:28.839 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:36:28.846 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:28.847 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:36:28.948 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:36:28.986 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:29.086 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:36:29.090 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:29.091 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:36:29.192 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:36:29.232 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:29.261 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:36:29.264 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:29.264 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:36:29.365 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:36:29.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:29 smithi188 ceph-mon[43939]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1786/321812 objects degraded (0.555%), 1 pg degraded) 2024-04-01T19:36:29.416 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:36:29.434 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:29 smithi022 ceph-mon[39439]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1786/321812 objects degraded (0.555%), 1 pg degraded) 2024-04-01T19:36:29.437 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:29.491 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:36:29.494 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:29.494 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:36:29.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:29 smithi062 ceph-mon[44211]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1786/321812 objects degraded (0.555%), 1 pg degraded) 2024-04-01T19:36:29.595 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:36:29.633 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:29.944 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:36:30.188 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:36:30.191 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:30.191 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:36:30.292 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:36:30.347 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:30.380 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:36:30.390 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:30.390 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:36:30.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:30 smithi022 ceph-mon[39439]: pgmap v904: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.8 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 24 op/s; 44 MiB/s, 710 objects/s recovering 2024-04-01T19:36:30.417 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:30 smithi062 ceph-mon[44211]: pgmap v904: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.8 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 24 op/s; 44 MiB/s, 710 objects/s recovering 2024-04-01T19:36:30.491 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:36:30.534 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:30 smithi188 ceph-mon[43939]: pgmap v904: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.8 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 24 op/s; 44 MiB/s, 710 objects/s recovering 2024-04-01T19:36:30.536 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:30.575 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:36:30.580 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:30.581 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:36:30.682 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:36:30.725 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:30.757 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:36:30.760 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:30.761 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:36:30.862 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:36:30.895 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:31.152 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:36:31.368 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:31 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:36:31.368 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:31 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:36:31.368 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:31 smithi022 ceph-mon[39439]: osdmap e316: 12 total, 11 up, 11 in 2024-04-01T19:36:31.368 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:31 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3353520325' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:36:31.368 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:31 smithi022 ceph-mon[39439]: from='client.35672 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:36:31.477 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:31 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:36:31.477 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:31 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:36:31.477 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:31 smithi062 ceph-mon[44211]: osdmap e316: 12 total, 11 up, 11 in 2024-04-01T19:36:31.477 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:31 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3353520325' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:36:31.477 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:31 smithi062 ceph-mon[44211]: from='client.35672 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:36:31.544 INFO:teuthology.orchestra.run.smithi062.stderr:Creating an OSD daemon form without an OSD FSID value 2024-04-01T19:36:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:31 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:36:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:31 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:36:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:31 smithi188 ceph-mon[43939]: osdmap e316: 12 total, 11 up, 11 in 2024-04-01T19:36:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:31 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3353520325' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:36:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:31 smithi188 ceph-mon[43939]: from='client.35672 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:36:31.851 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:36:31.855 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:31.855 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:36:31.956 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:36:31.991 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:32.021 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:36:32.024 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:32.025 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:36:32.111 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:36:32.111 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:36:32.126 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:36:32.179 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:32.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:32 smithi022 ceph-mon[39439]: pgmap v906: 17 pgs: 17 active+clean; 9.7 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 425 op/s; 19 MiB/s, 297 objects/s recovering 2024-04-01T19:36:32.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:32 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:36:32.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:32 smithi022 ceph-mon[39439]: from='client.35672 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:36:32.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:32 smithi022 ceph-mon[39439]: osdmap e317: 12 total, 11 up, 11 in 2024-04-01T19:36:32.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:32 smithi188 ceph-mon[43939]: pgmap v906: 17 pgs: 17 active+clean; 9.7 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 425 op/s; 19 MiB/s, 297 objects/s recovering 2024-04-01T19:36:32.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:32 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:36:32.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:32 smithi188 ceph-mon[43939]: from='client.35672 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:36:32.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:32 smithi188 ceph-mon[43939]: osdmap e317: 12 total, 11 up, 11 in 2024-04-01T19:36:32.404 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:36:32.406 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:32.407 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:36:32.422 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:32 smithi062 ceph-mon[44211]: pgmap v906: 17 pgs: 17 active+clean; 9.7 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 425 op/s; 19 MiB/s, 297 objects/s recovering 2024-04-01T19:36:32.422 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:32 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:36:32.422 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:32 smithi062 ceph-mon[44211]: from='client.35672 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:36:32.422 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:32 smithi062 ceph-mon[44211]: osdmap e317: 12 total, 11 up, 11 in 2024-04-01T19:36:32.507 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:36:32.546 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:32.772 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:36:32.805 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:36:32.840 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:36:32.881 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:36:32.914 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:36:32.938 INFO:teuthology.orchestra.run.smithi062.stdout:get_pg_num_history pg_num_history pg_num_history(e299 pg_nums {1={14=1},3={191=16},4={267=16}} deleted_pools 265,3) 2024-04-01T19:36:32.939 INFO:teuthology.orchestra.run.smithi062.stdout:Importing pgid 4.a 2024-04-01T19:36:32.943 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:36:32.948 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:500004d2:::benchmark_data_smithi188_104537_object159378:head# 2024-04-01T19:36:32.948 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.948 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5000091a:::benchmark_data_smithi188_104537_object97091:head# 2024-04-01T19:36:32.949 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.949 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:500052a7:::benchmark_data_smithi188_104537_object98176:head# 2024-04-01T19:36:32.949 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.950 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50017012:::benchmark_data_smithi188_104537_object119265:head# 2024-04-01T19:36:32.950 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.950 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5001d9df:::benchmark_data_smithi188_104537_object14696:head# 2024-04-01T19:36:32.950 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.950 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50021bd0:::benchmark_data_smithi188_104537_object22967:head# 2024-04-01T19:36:32.950 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.952 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50023270:::benchmark_data_smithi188_104537_object58010:head# 2024-04-01T19:36:32.952 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.952 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50028eae:::benchmark_data_smithi188_104537_object141649:head# 2024-04-01T19:36:32.952 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.952 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50036539:::benchmark_data_smithi188_104537_object132548:head# 2024-04-01T19:36:32.952 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.952 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50046cd6:::benchmark_data_smithi188_104537_object147121:head# 2024-04-01T19:36:32.952 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.952 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:500494ee:::benchmark_data_smithi188_104537_object169328:head# 2024-04-01T19:36:32.953 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.953 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5004a5f4:::benchmark_data_smithi188_104537_object59711:head# 2024-04-01T19:36:32.953 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.953 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50057449:::benchmark_data_smithi188_104537_object163921:head# 2024-04-01T19:36:32.953 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5005761f:::benchmark_data_smithi188_104537_object171645:head# 2024-04-01T19:36:32.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5005f15a:::benchmark_data_smithi188_104537_object99452:head# 2024-04-01T19:36:32.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50061cc2:::benchmark_data_smithi188_104537_object165562:head# 2024-04-01T19:36:32.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:500694fc:::benchmark_data_smithi188_104537_object64830:head# 2024-04-01T19:36:32.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.956 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5006c86c:::benchmark_data_smithi188_104537_object45686:head# 2024-04-01T19:36:32.956 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.956 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5006f573:::benchmark_data_smithi188_104537_object156074:head# 2024-04-01T19:36:32.956 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.956 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50078cf4:::benchmark_data_smithi188_104537_object42680:head# 2024-04-01T19:36:32.956 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.956 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50078d3e:::benchmark_data_smithi188_104537_object11671:head# 2024-04-01T19:36:32.956 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.956 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50079754:::benchmark_data_smithi188_104537_object102249:head# 2024-04-01T19:36:32.956 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.956 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5007fd4a:::benchmark_data_smithi188_104537_object104123:head# 2024-04-01T19:36:32.956 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.956 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50089291:::benchmark_data_smithi188_104537_object58247:head# 2024-04-01T19:36:32.956 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.957 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5008e730:::benchmark_data_smithi188_104537_object46110:head# 2024-04-01T19:36:32.957 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.959 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:500931e8:::benchmark_data_smithi188_104537_object108003:head# 2024-04-01T19:36:32.959 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.959 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:500a44c1:::benchmark_data_smithi188_104537_object148702:head# 2024-04-01T19:36:32.959 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.959 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:500a9416:::benchmark_data_smithi188_104537_object58918:head# 2024-04-01T19:36:32.959 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.959 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:500aa44d:::benchmark_data_smithi188_104537_object62852:head# 2024-04-01T19:36:32.959 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.959 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:500acdf2:::benchmark_data_smithi188_104537_object74034:head# 2024-04-01T19:36:32.959 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:500ad77a:::benchmark_data_smithi188_104537_object140852:head# 2024-04-01T19:36:32.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:500b433c:::benchmark_data_smithi188_104537_object130936:head# 2024-04-01T19:36:32.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:500b7899:::benchmark_data_smithi188_104537_object37819:head# 2024-04-01T19:36:32.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:500ba508:::benchmark_data_smithi188_104537_object66711:head# 2024-04-01T19:36:32.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:500bcd32:::benchmark_data_smithi188_104537_object39312:head# 2024-04-01T19:36:32.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:500c1784:::benchmark_data_smithi188_104537_object71378:head# 2024-04-01T19:36:32.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:500c5eab:::benchmark_data_smithi188_104537_object132315:head# 2024-04-01T19:36:32.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.962 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:500c7a33:::benchmark_data_smithi188_104537_object113132:head# 2024-04-01T19:36:32.962 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.962 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:500cb228:::benchmark_data_smithi188_104537_object13601:head# 2024-04-01T19:36:32.962 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.962 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:500cf026:::benchmark_data_smithi188_104537_object120152:head# 2024-04-01T19:36:32.962 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.962 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:500e9402:::benchmark_data_smithi188_104537_object129181:head# 2024-04-01T19:36:32.962 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.963 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:500f2475:::benchmark_data_smithi188_104537_object130227:head# 2024-04-01T19:36:32.963 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.963 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:500fae60:::benchmark_data_smithi188_104537_object128200:head# 2024-04-01T19:36:32.963 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.963 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:500fd519:::benchmark_data_smithi188_104537_object161907:head# 2024-04-01T19:36:32.963 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.963 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5010e436:::benchmark_data_smithi188_104537_object161101:head# 2024-04-01T19:36:32.963 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.963 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5010e7b9:::benchmark_data_smithi188_104537_object140147:head# 2024-04-01T19:36:32.963 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.963 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:501178bb:::benchmark_data_smithi188_104537_object127467:head# 2024-04-01T19:36:32.963 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.964 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50119c57:::benchmark_data_smithi188_104537_object69877:head# 2024-04-01T19:36:32.964 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.964 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5011d923:::benchmark_data_smithi188_104537_object56113:head# 2024-04-01T19:36:32.964 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.964 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5011dfd4:::benchmark_data_smithi188_104537_object146400:head# 2024-04-01T19:36:32.964 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.964 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50124cd0:::benchmark_data_smithi188_104537_object65758:head# 2024-04-01T19:36:32.964 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.968 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5012638f:::benchmark_data_smithi188_104537_object53418:head# 2024-04-01T19:36:32.968 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.968 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50129e28:::benchmark_data_smithi188_104537_object72586:head# 2024-04-01T19:36:32.968 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.968 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5012c2e3:::benchmark_data_smithi188_104537_object25719:head# 2024-04-01T19:36:32.968 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.969 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5012d935:::benchmark_data_smithi188_104537_object110675:head# 2024-04-01T19:36:32.969 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.969 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:501327d1:::benchmark_data_smithi188_104537_object11573:head# 2024-04-01T19:36:32.969 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.969 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5013c226:::benchmark_data_smithi188_104537_object89576:head# 2024-04-01T19:36:32.969 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.969 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50140002:::benchmark_data_smithi188_104537_object145905:head# 2024-04-01T19:36:32.969 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.969 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5014aae8:::benchmark_data_smithi188_104537_object12240:head# 2024-04-01T19:36:32.969 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.969 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5014b506:::benchmark_data_smithi188_104537_object157448:head# 2024-04-01T19:36:32.969 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.969 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50155c52:::benchmark_data_smithi188_104537_object121221:head# 2024-04-01T19:36:32.969 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.970 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50159760:::benchmark_data_smithi188_104537_object113288:head# 2024-04-01T19:36:32.970 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.970 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50160254:::benchmark_data_smithi188_104537_object163820:head# 2024-04-01T19:36:32.970 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.970 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:501634a6:::benchmark_data_smithi188_104537_object80456:head# 2024-04-01T19:36:32.970 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.970 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50168ddc:::benchmark_data_smithi188_104537_object124097:head# 2024-04-01T19:36:32.970 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.970 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5016b55b:::benchmark_data_smithi188_104537_object165971:head# 2024-04-01T19:36:32.970 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.970 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50177322:::benchmark_data_smithi188_104537_object47534:head# 2024-04-01T19:36:32.970 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.970 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50178295:::benchmark_data_smithi188_104537_object153263:head# 2024-04-01T19:36:32.970 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.971 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50179c3b:::benchmark_data_smithi188_104537_object43934:head# 2024-04-01T19:36:32.971 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.971 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5017c475:::benchmark_data_smithi188_104537_object113335:head# 2024-04-01T19:36:32.971 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.971 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5017c812:::benchmark_data_smithi188_104537_object92559:head# 2024-04-01T19:36:32.971 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.971 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:501839c5:::benchmark_data_smithi188_104537_object81246:head# 2024-04-01T19:36:32.971 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5018424b:::benchmark_data_smithi188_104537_object101583:head# 2024-04-01T19:36:32.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50184931:::benchmark_data_smithi188_104537_object56884:head# 2024-04-01T19:36:32.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5018abd4:::benchmark_data_smithi188_104537_object151347:head# 2024-04-01T19:36:32.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5019297f:::benchmark_data_smithi188_104537_object123763:head# 2024-04-01T19:36:32.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5019afc6:::benchmark_data_smithi188_104537_object143828:head# 2024-04-01T19:36:32.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:501a0f1e:::benchmark_data_smithi188_104537_object163369:head# 2024-04-01T19:36:32.973 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.973 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:501a3d88:::benchmark_data_smithi188_104537_object154513:head# 2024-04-01T19:36:32.973 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.973 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:501ab65f:::benchmark_data_smithi188_104537_object37295:head# 2024-04-01T19:36:32.973 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.973 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:501bc23f:::benchmark_data_smithi188_104537_object128563:head# 2024-04-01T19:36:32.973 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.973 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:501be0c5:::benchmark_data_smithi188_104537_object138421:head# 2024-04-01T19:36:32.973 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.973 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:501c08ca:::benchmark_data_smithi188_104537_object141604:head# 2024-04-01T19:36:32.973 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.973 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:501d986f:::benchmark_data_smithi188_104537_object167240:head# 2024-04-01T19:36:32.974 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.974 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:501ec02b:::benchmark_data_smithi188_104537_object12699:head# 2024-04-01T19:36:32.974 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.974 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:501ec7c4:::benchmark_data_smithi188_104537_object145027:head# 2024-04-01T19:36:32.974 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.974 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50201399:::benchmark_data_smithi188_104537_object170600:head# 2024-04-01T19:36:32.974 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.974 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50207a73:::benchmark_data_smithi188_104537_object116815:head# 2024-04-01T19:36:32.974 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.976 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5020d596:::benchmark_data_smithi188_104537_object16060:head# 2024-04-01T19:36:32.977 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.977 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50210752:::benchmark_data_smithi188_104537_object155547:head# 2024-04-01T19:36:32.977 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.977 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50212ea3:::benchmark_data_smithi188_104537_object60878:head# 2024-04-01T19:36:32.977 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.977 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50214214:::benchmark_data_smithi188_104537_object90989:head# 2024-04-01T19:36:32.977 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.977 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50217ce9:::benchmark_data_smithi188_104537_object97741:head# 2024-04-01T19:36:32.977 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.977 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5021ae84:::benchmark_data_smithi188_104537_object97948:head# 2024-04-01T19:36:32.977 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.977 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5021ee2e:::benchmark_data_smithi188_104537_object120301:head# 2024-04-01T19:36:32.977 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.977 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:502240dc:::benchmark_data_smithi188_104537_object97968:head# 2024-04-01T19:36:32.978 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.978 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50225ba1:::benchmark_data_smithi188_104537_object33397:head# 2024-04-01T19:36:32.978 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.978 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50229505:::benchmark_data_smithi188_104537_object41252:head# 2024-04-01T19:36:32.978 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.978 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5022d40b:::benchmark_data_smithi188_104537_object19036:head# 2024-04-01T19:36:32.978 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.978 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50238058:::benchmark_data_smithi188_104537_object48850:head# 2024-04-01T19:36:32.978 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.978 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5023db48:::benchmark_data_smithi188_104537_object113441:head# 2024-04-01T19:36:32.978 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.978 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5023f543:::benchmark_data_smithi188_104537_object171819:head# 2024-04-01T19:36:32.978 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.979 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:502426bb:::benchmark_data_smithi188_104537_object72404:head# 2024-04-01T19:36:32.979 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.979 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5024f327:::benchmark_data_smithi188_104537_object44027:head# 2024-04-01T19:36:32.979 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.981 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50255583:::benchmark_data_smithi188_104537_object59545:head# 2024-04-01T19:36:32.981 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.981 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50257020:::benchmark_data_smithi188_104537_object43101:head# 2024-04-01T19:36:32.981 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.981 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5025951b:::benchmark_data_smithi188_104537_object164159:head# 2024-04-01T19:36:32.981 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.981 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5025aed9:::benchmark_data_smithi188_104537_object84524:head# 2024-04-01T19:36:32.981 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.981 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5026415e:::benchmark_data_smithi188_104537_object30595:head# 2024-04-01T19:36:32.981 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.981 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50266820:::benchmark_data_smithi188_104537_object141992:head# 2024-04-01T19:36:32.981 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.981 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50270315:::benchmark_data_smithi188_104537_object147273:head# 2024-04-01T19:36:32.982 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.982 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50288c62:::benchmark_data_smithi188_104537_object56441:head# 2024-04-01T19:36:32.982 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.982 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5028a4be:::benchmark_data_smithi188_104537_object170228:head# 2024-04-01T19:36:32.982 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.982 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5028c311:::benchmark_data_smithi188_104537_object96332:head# 2024-04-01T19:36:32.982 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.982 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5028d37c:::benchmark_data_smithi188_104537_object101935:head# 2024-04-01T19:36:32.982 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.982 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:502903b0:::benchmark_data_smithi188_104537_object19151:head# 2024-04-01T19:36:32.982 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.982 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:502a2e85:::benchmark_data_smithi188_104537_object160440:head# 2024-04-01T19:36:32.982 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.983 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:502a5f1b:::benchmark_data_smithi188_104537_object68167:head# 2024-04-01T19:36:32.983 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.985 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:502ae596:::benchmark_data_smithi188_104537_object91513:head# 2024-04-01T19:36:32.985 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.985 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:502aee81:::benchmark_data_smithi188_104537_object30738:head# 2024-04-01T19:36:32.985 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.985 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:502c0da7:::benchmark_data_smithi188_104537_object29298:head# 2024-04-01T19:36:32.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:502c38fe:::benchmark_data_smithi188_104537_object32395:head# 2024-04-01T19:36:32.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:502c4a50:::benchmark_data_smithi188_104537_object169940:head# 2024-04-01T19:36:32.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:502d32a4:::benchmark_data_smithi188_104537_object103679:head# 2024-04-01T19:36:32.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:502d46bf:::benchmark_data_smithi188_104537_object83201:head# 2024-04-01T19:36:32.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:502d4833:::benchmark_data_smithi188_104537_object52644:head# 2024-04-01T19:36:32.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:502e0351:::benchmark_data_smithi188_104537_object90114:head# 2024-04-01T19:36:32.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:502e735b:::benchmark_data_smithi188_104537_object123347:head# 2024-04-01T19:36:32.987 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.987 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:502e81c2:::benchmark_data_smithi188_104537_object15366:head# 2024-04-01T19:36:32.987 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.987 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:502fd635:::benchmark_data_smithi188_104537_object87682:head# 2024-04-01T19:36:32.987 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.987 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50309369:::benchmark_data_smithi188_104537_object123877:head# 2024-04-01T19:36:32.987 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.987 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5030aaa1:::benchmark_data_smithi188_104537_object79645:head# 2024-04-01T19:36:32.987 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.987 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5030ddb5:::benchmark_data_smithi188_104537_object58696:head# 2024-04-01T19:36:32.987 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.987 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50319b0d:::benchmark_data_smithi188_104537_object159423:head# 2024-04-01T19:36:32.987 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.988 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5031ce31:::benchmark_data_smithi188_104537_object126192:head# 2024-04-01T19:36:32.988 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.988 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:36:32.988 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5032b999:::benchmark_data_smithi188_104537_object41474:head# 2024-04-01T19:36:32.988 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.990 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5032c81d:::benchmark_data_smithi188_104537_object112556:head# 2024-04-01T19:36:32.990 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.990 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5032d14c:::benchmark_data_smithi188_104537_object150958:head# 2024-04-01T19:36:32.991 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.991 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5033e294:::benchmark_data_smithi188_104537_object128188:head# 2024-04-01T19:36:32.991 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.991 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5034db85:::benchmark_data_smithi188_104537_object145472:head# 2024-04-01T19:36:32.991 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.991 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50354cae:::benchmark_data_smithi188_104537_object19157:head# 2024-04-01T19:36:32.991 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.991 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5035a531:::benchmark_data_smithi188_104537_object20851:head# 2024-04-01T19:36:32.991 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.992 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50360f5c:::benchmark_data_smithi188_104537_object109361:head# 2024-04-01T19:36:32.992 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.992 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50364ab3:::benchmark_data_smithi188_104537_object36887:head# 2024-04-01T19:36:32.992 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.993 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50364b7d:::benchmark_data_smithi188_104537_object148233:head# 2024-04-01T19:36:32.993 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.997 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50369053:::benchmark_data_smithi188_104537_object139198:head# 2024-04-01T19:36:32.997 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.997 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:503759cf:::benchmark_data_smithi188_104537_object136213:head# 2024-04-01T19:36:32.997 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.997 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5037929d:::benchmark_data_smithi188_104537_object62101:head# 2024-04-01T19:36:32.997 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.997 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5037baa2:::benchmark_data_smithi188_104537_object132246:head# 2024-04-01T19:36:32.997 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.997 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5037d520:::benchmark_data_smithi188_104537_object136613:head# 2024-04-01T19:36:32.998 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.998 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50385825:::benchmark_data_smithi188_104537_object73698:head# 2024-04-01T19:36:32.998 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.998 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5038e728:::benchmark_data_smithi188_104537_object44969:head# 2024-04-01T19:36:32.998 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.998 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:503913c8:::benchmark_data_smithi188_104537_object88545:head# 2024-04-01T19:36:32.998 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.998 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50396410:::benchmark_data_smithi188_104537_object29156:head# 2024-04-01T19:36:32.998 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.998 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5039acb3:::benchmark_data_smithi188_104537_object133880:head# 2024-04-01T19:36:32.998 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.998 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:503a4a72:::benchmark_data_smithi188_104537_object144661:head# 2024-04-01T19:36:32.998 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.999 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:503a72e5:::benchmark_data_smithi188_104537_object145002:head# 2024-04-01T19:36:32.999 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.999 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:503a9424:::benchmark_data_smithi188_104537_object11044:head# 2024-04-01T19:36:32.999 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.999 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:503af97f:::benchmark_data_smithi188_104537_object12018:head# 2024-04-01T19:36:32.999 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.999 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:503b5773:::benchmark_data_smithi188_104537_object20355:head# 2024-04-01T19:36:32.999 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.999 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:503b6848:::benchmark_data_smithi188_104537_object127520:head# 2024-04-01T19:36:32.999 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:32.999 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:503c1618:::benchmark_data_smithi188_104537_object99765:head# 2024-04-01T19:36:32.999 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.004 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:503c4393:::benchmark_data_smithi188_104537_object115338:head# 2024-04-01T19:36:33.004 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.004 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:503ca635:::benchmark_data_smithi188_104537_object135395:head# 2024-04-01T19:36:33.004 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.004 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:503cb583:::benchmark_data_smithi188_104537_object169931:head# 2024-04-01T19:36:33.004 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.005 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:503daa2e:::benchmark_data_smithi188_104537_object169545:head# 2024-04-01T19:36:33.005 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.005 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:503ddf99:::benchmark_data_smithi188_104537_object53857:head# 2024-04-01T19:36:33.005 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.005 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:503e3271:::benchmark_data_smithi188_104537_object81707:head# 2024-04-01T19:36:33.005 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.005 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:503fbf9d:::benchmark_data_smithi188_104537_object60747:head# 2024-04-01T19:36:33.005 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.005 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5041040c:::benchmark_data_smithi188_104537_object53521:head# 2024-04-01T19:36:33.005 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.005 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50414587:::benchmark_data_smithi188_104537_object165931:head# 2024-04-01T19:36:33.005 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.005 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:504148f1:::benchmark_data_smithi188_104537_object114587:head# 2024-04-01T19:36:33.006 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.006 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5041b181:::benchmark_data_smithi188_104537_object107165:head# 2024-04-01T19:36:33.006 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.006 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5042563b:::benchmark_data_smithi188_104537_object71143:head# 2024-04-01T19:36:33.006 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.006 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50429d88:::benchmark_data_smithi188_104537_object106541:head# 2024-04-01T19:36:33.006 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.006 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5043118b:::benchmark_data_smithi188_104537_object78340:head# 2024-04-01T19:36:33.006 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.006 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50436008:::benchmark_data_smithi188_104537_object154694:head# 2024-04-01T19:36:33.006 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.006 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:504375ff:::benchmark_data_smithi188_104537_object141047:head# 2024-04-01T19:36:33.007 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.007 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5043b91b:::benchmark_data_smithi188_104537_object54942:head# 2024-04-01T19:36:33.007 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.007 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5043e467:::benchmark_data_smithi188_104537_object12452:head# 2024-04-01T19:36:33.007 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.007 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50445e8c:::benchmark_data_smithi188_104537_object13504:head# 2024-04-01T19:36:33.007 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.007 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5044862f:::benchmark_data_smithi188_104537_object102390:head# 2024-04-01T19:36:33.007 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.007 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5045494c:::benchmark_data_smithi188_104537_object56170:head# 2024-04-01T19:36:33.007 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.007 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50461868:::benchmark_data_smithi188_104537_object161761:head# 2024-04-01T19:36:33.008 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.008 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50465a06:::benchmark_data_smithi188_104537_object132626:head# 2024-04-01T19:36:33.008 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.008 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5046a16f:::benchmark_data_smithi188_104537_object121654:head# 2024-04-01T19:36:33.008 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.008 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5046b2e2:::benchmark_data_smithi188_104537_object36478:head# 2024-04-01T19:36:33.008 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.008 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5046c78d:::benchmark_data_smithi188_104537_object19543:head# 2024-04-01T19:36:33.008 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.008 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50475344:::benchmark_data_smithi188_104537_object118073:head# 2024-04-01T19:36:33.008 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.008 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50477097:::benchmark_data_smithi188_104537_object115116:head# 2024-04-01T19:36:33.009 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.009 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5047d56e:::benchmark_data_smithi188_104537_object83207:head# 2024-04-01T19:36:33.009 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.013 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50480c80:::benchmark_data_smithi188_104537_object130997:head# 2024-04-01T19:36:33.013 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.013 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5048145c:::benchmark_data_smithi188_104537_object85242:head# 2024-04-01T19:36:33.013 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.014 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50483bac:::benchmark_data_smithi188_104537_object143586:head# 2024-04-01T19:36:33.014 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.014 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5048a6a5:::benchmark_data_smithi188_104537_object122540:head# 2024-04-01T19:36:33.014 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.014 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50491a26:::benchmark_data_smithi188_104537_object92579:head# 2024-04-01T19:36:33.014 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.014 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50492b70:::benchmark_data_smithi188_104537_object160039:head# 2024-04-01T19:36:33.014 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.014 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50497808:::benchmark_data_smithi188_104537_object115678:head# 2024-04-01T19:36:33.014 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.014 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50499e35:::benchmark_data_smithi188_104537_object103618:head# 2024-04-01T19:36:33.014 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.015 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:504ae1d5:::benchmark_data_smithi188_104537_object89851:head# 2024-04-01T19:36:33.015 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.015 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:504af14d:::benchmark_data_smithi188_104537_object78092:head# 2024-04-01T19:36:33.015 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.015 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:504b4952:::benchmark_data_smithi188_104537_object159261:head# 2024-04-01T19:36:33.015 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.015 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:504b6efd:::benchmark_data_smithi188_104537_object109194:head# 2024-04-01T19:36:33.015 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.015 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:504b7d4c:::benchmark_data_smithi188_104537_object15022:head# 2024-04-01T19:36:33.015 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.015 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:504b92f9:::benchmark_data_smithi188_104537_object130426:head# 2024-04-01T19:36:33.015 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.015 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:504bb755:::benchmark_data_smithi188_104537_object137321:head# 2024-04-01T19:36:33.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:504bed9d:::benchmark_data_smithi188_104537_object21320:head# 2024-04-01T19:36:33.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:504cb955:::benchmark_data_smithi188_104537_object92838:head# 2024-04-01T19:36:33.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:504d24d7:::benchmark_data_smithi188_104537_object50330:head# 2024-04-01T19:36:33.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:504db363:::benchmark_data_smithi188_104537_object118702:head# 2024-04-01T19:36:33.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:504e47f1:::benchmark_data_smithi188_104537_object58383:head# 2024-04-01T19:36:33.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:504eb2c9:::benchmark_data_smithi188_104537_object146227:head# 2024-04-01T19:36:33.017 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.017 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:504eef61:::benchmark_data_smithi188_104537_object152184:head# 2024-04-01T19:36:33.017 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.017 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:504fb450:::benchmark_data_smithi188_104537_object72367:head# 2024-04-01T19:36:33.017 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.017 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:504fe69e:::benchmark_data_smithi188_104537_object78851:head# 2024-04-01T19:36:33.017 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.017 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:505146d0:::benchmark_data_smithi188_104537_object102830:head# 2024-04-01T19:36:33.017 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.017 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50517d05:::benchmark_data_smithi188_104537_object87677:head# 2024-04-01T19:36:33.017 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.017 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:505295f8:::benchmark_data_smithi188_104537_object170742:head# 2024-04-01T19:36:33.018 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.018 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5052998c:::benchmark_data_smithi188_104537_object83470:head# 2024-04-01T19:36:33.018 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.018 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:505334e2:::benchmark_data_smithi188_104537_object15643:head# 2024-04-01T19:36:33.018 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.018 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:505386f0:::benchmark_data_smithi188_104537_object34695:head# 2024-04-01T19:36:33.018 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.018 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5053963b:::benchmark_data_smithi188_104537_object123739:head# 2024-04-01T19:36:33.018 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.019 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:36:33.022 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50539b66:::benchmark_data_smithi188_104537_object144468:head# 2024-04-01T19:36:33.022 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.022 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:505443d8:::benchmark_data_smithi188_104537_object14497:head# 2024-04-01T19:36:33.023 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.023 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50548766:::benchmark_data_smithi188_104537_object17334:head# 2024-04-01T19:36:33.023 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.023 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5054fd59:::benchmark_data_smithi188_104537_object144831:head# 2024-04-01T19:36:33.023 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.023 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50558dad:::benchmark_data_smithi188_104537_object125283:head# 2024-04-01T19:36:33.023 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.023 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5055df7e:::benchmark_data_smithi188_104537_object106544:head# 2024-04-01T19:36:33.023 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.023 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50560e32:::benchmark_data_smithi188_104537_object16467:head# 2024-04-01T19:36:33.023 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.024 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50568c97:::benchmark_data_smithi188_104537_object170252:head# 2024-04-01T19:36:33.024 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.024 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50572928:::benchmark_data_smithi188_104537_object79718:head# 2024-04-01T19:36:33.024 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.024 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5057a772:::benchmark_data_smithi188_104537_object121439:head# 2024-04-01T19:36:33.024 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.024 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5057fd15:::benchmark_data_smithi188_104537_object78812:head# 2024-04-01T19:36:33.024 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.024 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50580315:::benchmark_data_smithi188_104537_object85806:head# 2024-04-01T19:36:33.024 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.024 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50584e41:::benchmark_data_smithi188_104537_object20248:head# 2024-04-01T19:36:33.024 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.024 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50589870:::benchmark_data_smithi188_104537_object18327:head# 2024-04-01T19:36:33.024 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5059101e:::benchmark_data_smithi188_104537_object71649:head# 2024-04-01T19:36:33.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:505a59b5:::benchmark_data_smithi188_104537_object150134:head# 2024-04-01T19:36:33.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:505b0854:::benchmark_data_smithi188_104537_object120476:head# 2024-04-01T19:36:33.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:505b3234:::benchmark_data_smithi188_104537_object139856:head# 2024-04-01T19:36:33.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:505bb13a:::benchmark_data_smithi188_104537_object109726:head# 2024-04-01T19:36:33.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:505c1eab:::benchmark_data_smithi188_104537_object74712:head# 2024-04-01T19:36:33.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:505c8baa:::benchmark_data_smithi188_104537_object132079:head# 2024-04-01T19:36:33.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:505ca9d4:::benchmark_data_smithi188_104537_object52473:head# 2024-04-01T19:36:33.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:505cd72d:::benchmark_data_smithi188_104537_object162628:head# 2024-04-01T19:36:33.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:505d3974:::benchmark_data_smithi188_104537_object19730:head# 2024-04-01T19:36:33.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:505d9179:::benchmark_data_smithi188_104537_object41864:head# 2024-04-01T19:36:33.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:505dcd79:::benchmark_data_smithi188_104537_object12955:head# 2024-04-01T19:36:33.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:505de5be:::benchmark_data_smithi188_104537_object95478:head# 2024-04-01T19:36:33.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:505e21d7:::benchmark_data_smithi188_104537_object110599:head# 2024-04-01T19:36:33.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:505e8005:::benchmark_data_smithi188_104537_object131789:head# 2024-04-01T19:36:33.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:505ec45a:::benchmark_data_smithi188_104537_object69484:head# 2024-04-01T19:36:33.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:505ed4ee:::benchmark_data_smithi188_104537_object63222:head# 2024-04-01T19:36:33.035 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.035 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:505f2501:::benchmark_data_smithi188_104537_object16161:head# 2024-04-01T19:36:33.035 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.035 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:505fa586:::benchmark_data_smithi188_104537_object52169:head# 2024-04-01T19:36:33.035 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.035 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:505fadfc:::benchmark_data_smithi188_104537_object13767:head# 2024-04-01T19:36:33.035 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.035 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:505fd272:::benchmark_data_smithi188_104537_object44108:head# 2024-04-01T19:36:33.035 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.035 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50601f9b:::benchmark_data_smithi188_104537_object107109:head# 2024-04-01T19:36:33.035 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.035 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50608865:::benchmark_data_smithi188_104537_object128588:head# 2024-04-01T19:36:33.036 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.036 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5060b7c1:::benchmark_data_smithi188_104537_object52780:head# 2024-04-01T19:36:33.036 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.036 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5060ea35:::benchmark_data_smithi188_104537_object98758:head# 2024-04-01T19:36:33.036 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.036 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5060fbb1:::benchmark_data_smithi188_104537_object46588:head# 2024-04-01T19:36:33.036 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.036 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50617dfa:::benchmark_data_smithi188_104537_object83008:head# 2024-04-01T19:36:33.036 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.036 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50617f09:::benchmark_data_smithi188_104537_object100970:head# 2024-04-01T19:36:33.036 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.036 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5061829b:::benchmark_data_smithi188_104537_object95776:head# 2024-04-01T19:36:33.036 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.037 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5061c81b:::benchmark_data_smithi188_104537_object100909:head# 2024-04-01T19:36:33.037 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.037 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506245c5:::benchmark_data_smithi188_104537_object92459:head# 2024-04-01T19:36:33.037 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.037 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5062e999:::benchmark_data_smithi188_104537_object130520:head# 2024-04-01T19:36:33.037 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.037 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506324a5:::benchmark_data_smithi188_104537_object153464:head# 2024-04-01T19:36:33.037 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.037 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506362b3:::benchmark_data_smithi188_104537_object140210:head# 2024-04-01T19:36:33.037 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.037 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5063e7e8:::benchmark_data_smithi188_104537_object65896:head# 2024-04-01T19:36:33.037 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.037 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506400d7:::benchmark_data_smithi188_104537_object61407:head# 2024-04-01T19:36:33.038 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.038 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50655a3b:::benchmark_data_smithi188_104537_object74864:head# 2024-04-01T19:36:33.038 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.038 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5065a737:::benchmark_data_smithi188_104537_object110810:head# 2024-04-01T19:36:33.038 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.038 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5065ed5d:::benchmark_data_smithi188_104537_object47016:head# 2024-04-01T19:36:33.038 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.038 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506693dc:::benchmark_data_smithi188_104537_object110476:head# 2024-04-01T19:36:33.038 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.038 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5066b3e5:::benchmark_data_smithi188_104537_object57345:head# 2024-04-01T19:36:33.038 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.039 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5066b5b2:::benchmark_data_smithi188_104537_object153841:head# 2024-04-01T19:36:33.039 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.039 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5066bb84:::benchmark_data_smithi188_104537_object47025:head# 2024-04-01T19:36:33.039 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.039 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50670745:::benchmark_data_smithi188_104537_object165921:head# 2024-04-01T19:36:33.039 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.039 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506714c6:::benchmark_data_smithi188_104537_object64354:head# 2024-04-01T19:36:33.039 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.039 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50672b44:::benchmark_data_smithi188_104537_object13319:head# 2024-04-01T19:36:33.039 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.039 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50674aa0:::benchmark_data_smithi188_104537_object162451:head# 2024-04-01T19:36:33.039 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.039 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50677210:::benchmark_data_smithi188_104537_object28565:head# 2024-04-01T19:36:33.040 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.040 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5067ce6f:::benchmark_data_smithi188_104537_object120043:head# 2024-04-01T19:36:33.040 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.040 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5068debb:::benchmark_data_smithi188_104537_object32795:head# 2024-04-01T19:36:33.040 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.040 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5068e058:::benchmark_data_smithi188_104537_object157120:head# 2024-04-01T19:36:33.040 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.040 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5068fb67:::benchmark_data_smithi188_104537_object108694:head# 2024-04-01T19:36:33.040 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.040 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5069118d:::benchmark_data_smithi188_104537_object108085:head# 2024-04-01T19:36:33.040 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.040 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50692763:::benchmark_data_smithi188_104537_object22089:head# 2024-04-01T19:36:33.040 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.040 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50692a0e:::benchmark_data_smithi188_104537_object67526:head# 2024-04-01T19:36:33.041 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.041 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506a1cb1:::benchmark_data_smithi188_104537_object48582:head# 2024-04-01T19:36:33.041 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.041 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506ab620:::benchmark_data_smithi188_104537_object125748:head# 2024-04-01T19:36:33.041 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.041 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506ac9cd:::benchmark_data_smithi188_104537_object44355:head# 2024-04-01T19:36:33.041 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.041 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506af340:::benchmark_data_smithi188_104537_object135818:head# 2024-04-01T19:36:33.041 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.041 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506b24d1:::benchmark_data_smithi188_104537_object24452:head# 2024-04-01T19:36:33.041 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.041 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506b2560:::benchmark_data_smithi188_104537_object120580:head# 2024-04-01T19:36:33.041 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506b2cbf:::benchmark_data_smithi188_104537_object48908:head# 2024-04-01T19:36:33.046 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506b4c59:::benchmark_data_smithi188_104537_object24453:head# 2024-04-01T19:36:33.046 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506bf277:::benchmark_data_smithi188_104537_object25705:head# 2024-04-01T19:36:33.046 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506c81cd:::benchmark_data_smithi188_104537_object74757:head# 2024-04-01T19:36:33.047 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.047 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506cc19f:::benchmark_data_smithi188_104537_object152786:head# 2024-04-01T19:36:33.047 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.047 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506ccfed:::benchmark_data_smithi188_104537_object150232:head# 2024-04-01T19:36:33.047 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.047 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506ce9bc:::benchmark_data_smithi188_104537_object144142:head# 2024-04-01T19:36:33.047 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.047 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506da614:::benchmark_data_smithi188_104537_object128068:head# 2024-04-01T19:36:33.047 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.047 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506dea20:::benchmark_data_smithi188_104537_object37635:head# 2024-04-01T19:36:33.047 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.047 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506e30dc:::benchmark_data_smithi188_104537_object17781:head# 2024-04-01T19:36:33.047 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.048 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506e77c3:::benchmark_data_smithi188_104537_object15334:head# 2024-04-01T19:36:33.048 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.048 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506f2cb5:::benchmark_data_smithi188_104537_object55968:head# 2024-04-01T19:36:33.048 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.048 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506f7b94:::benchmark_data_smithi188_104537_object86995:head# 2024-04-01T19:36:33.048 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.048 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:506fd0e3:::benchmark_data_smithi188_104537_object157744:head# 2024-04-01T19:36:33.048 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.048 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50707199:::benchmark_data_smithi188_104537_object147276:head# 2024-04-01T19:36:33.048 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.048 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5070aa4b:::benchmark_data_smithi188_104537_object165063:head# 2024-04-01T19:36:33.048 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.048 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5070ab81:::benchmark_data_smithi188_104537_object150835:head# 2024-04-01T19:36:33.049 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.049 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5070cfe7:::benchmark_data_smithi188_104537_object53242:head# 2024-04-01T19:36:33.049 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.049 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50712c08:::benchmark_data_smithi188_104537_object152265:head# 2024-04-01T19:36:33.049 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.049 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5072a6b6:::benchmark_data_smithi188_104537_object80239:head# 2024-04-01T19:36:33.049 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.049 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5072c770:::benchmark_data_smithi188_104537_object114575:head# 2024-04-01T19:36:33.049 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.049 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5072df1f:::benchmark_data_smithi188_104537_object125002:head# 2024-04-01T19:36:33.049 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.049 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50734923:::benchmark_data_smithi188_104537_object49806:head# 2024-04-01T19:36:33.049 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.049 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5073db53:::benchmark_data_smithi188_104537_object60363:head# 2024-04-01T19:36:33.050 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.050 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5073f57c:::benchmark_data_smithi188_104537_object140165:head# 2024-04-01T19:36:33.050 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.050 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:507463c8:::benchmark_data_smithi188_104537_object73971:head# 2024-04-01T19:36:33.050 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.050 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50754b96:::benchmark_data_smithi188_104537_object129018:head# 2024-04-01T19:36:33.050 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.050 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:507551e2:::benchmark_data_smithi188_104537_object13328:head# 2024-04-01T19:36:33.050 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.050 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5075ab6c:::benchmark_data_smithi188_104537_object59254:head# 2024-04-01T19:36:33.050 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.050 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5076a55d:::benchmark_data_smithi188_104537_object146541:head# 2024-04-01T19:36:33.050 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.051 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50772978:::benchmark_data_smithi188_104537_object165275:head# 2024-04-01T19:36:33.051 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.051 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5077e591:::benchmark_data_smithi188_104537_object97062:head# 2024-04-01T19:36:33.051 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.051 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50781e03:::benchmark_data_smithi188_104537_object54765:head# 2024-04-01T19:36:33.051 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.051 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50789b17:::benchmark_data_smithi188_104537_object103521:head# 2024-04-01T19:36:33.051 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.051 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5078aa4f:::benchmark_data_smithi188_104537_object45507:head# 2024-04-01T19:36:33.051 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.051 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5078b8d8:::benchmark_data_smithi188_104537_object74878:head# 2024-04-01T19:36:33.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5078ff1a:::benchmark_data_smithi188_104537_object141149:head# 2024-04-01T19:36:33.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50790850:::benchmark_data_smithi188_104537_object120073:head# 2024-04-01T19:36:33.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50798df1:::benchmark_data_smithi188_104537_object111383:head# 2024-04-01T19:36:33.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:507ad12a:::benchmark_data_smithi188_104537_object45640:head# 2024-04-01T19:36:33.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:507adfee:::benchmark_data_smithi188_104537_object59468:head# 2024-04-01T19:36:33.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.053 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:36:33.057 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:507aff4b:::benchmark_data_smithi188_104537_object152553:head# 2024-04-01T19:36:33.057 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.057 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:507b84db:::benchmark_data_smithi188_104537_object108295:head# 2024-04-01T19:36:33.057 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.057 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:507b9442:::benchmark_data_smithi188_104537_object131659:head# 2024-04-01T19:36:33.057 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.058 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:507bbb8d:::benchmark_data_smithi188_104537_object52376:head# 2024-04-01T19:36:33.058 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.058 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:507c12a7:::benchmark_data_smithi188_104537_object50114:head# 2024-04-01T19:36:33.058 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.058 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:507c2ad0:::benchmark_data_smithi188_104537_object20348:head# 2024-04-01T19:36:33.058 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.058 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:507c45a4:::benchmark_data_smithi188_104537_object23944:head# 2024-04-01T19:36:33.058 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.058 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:507d1916:::benchmark_data_smithi188_104537_object162796:head# 2024-04-01T19:36:33.058 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.058 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:507d6293:::benchmark_data_smithi188_104537_object17938:head# 2024-04-01T19:36:33.058 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.058 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:507d7867:::benchmark_data_smithi188_104537_object41626:head# 2024-04-01T19:36:33.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:507db58d:::benchmark_data_smithi188_104537_object163071:head# 2024-04-01T19:36:33.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:507db63a:::benchmark_data_smithi188_104537_object26793:head# 2024-04-01T19:36:33.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:507dd9aa:::benchmark_data_smithi188_104537_object30388:head# 2024-04-01T19:36:33.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:507e0d61:::benchmark_data_smithi188_104537_object84640:head# 2024-04-01T19:36:33.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:507e669c:::benchmark_data_smithi188_104537_object161381:head# 2024-04-01T19:36:33.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:507e6904:::benchmark_data_smithi188_104537_object50317:head# 2024-04-01T19:36:33.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:507e7932:::benchmark_data_smithi188_104537_object161341:head# 2024-04-01T19:36:33.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:508002fb:::benchmark_data_smithi188_104537_object142345:head# 2024-04-01T19:36:33.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5080474e:::benchmark_data_smithi188_104537_object17021:head# 2024-04-01T19:36:33.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5080d5f7:::benchmark_data_smithi188_104537_object153907:head# 2024-04-01T19:36:33.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5080e0ce:::benchmark_data_smithi188_104537_object13029:head# 2024-04-01T19:36:33.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50818965:::benchmark_data_smithi188_104537_object29959:head# 2024-04-01T19:36:33.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50820308:::benchmark_data_smithi188_104537_object145275:head# 2024-04-01T19:36:33.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5082608e:::benchmark_data_smithi188_104537_object140714:head# 2024-04-01T19:36:33.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:508282f2:::benchmark_data_smithi188_104537_object41554:head# 2024-04-01T19:36:33.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5082a864:::benchmark_data_smithi188_104537_object108965:head# 2024-04-01T19:36:33.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5082b954:::benchmark_data_smithi188_104537_object163707:head# 2024-04-01T19:36:33.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5082d9a6:::benchmark_data_smithi188_104537_object60777:head# 2024-04-01T19:36:33.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.065 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50831865:::benchmark_data_smithi188_104537_object125393:head# 2024-04-01T19:36:33.065 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.065 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50836447:::benchmark_data_smithi188_104537_object94335:head# 2024-04-01T19:36:33.065 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.065 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50838f60:::benchmark_data_smithi188_104537_object115323:head# 2024-04-01T19:36:33.065 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.065 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50839c62:::benchmark_data_smithi188_104537_object139312:head# 2024-04-01T19:36:33.065 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.065 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5083b0a4:::benchmark_data_smithi188_104537_object102879:head# 2024-04-01T19:36:33.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:508401e7:::benchmark_data_smithi188_104537_object22928:head# 2024-04-01T19:36:33.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50842542:::benchmark_data_smithi188_104537_object72974:head# 2024-04-01T19:36:33.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50844e1b:::benchmark_data_smithi188_104537_object152244:head# 2024-04-01T19:36:33.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50848cc6:::benchmark_data_smithi188_104537_object76901:head# 2024-04-01T19:36:33.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5084d47e:::benchmark_data_smithi188_104537_object109445:head# 2024-04-01T19:36:33.067 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.067 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5084d7ef:::benchmark_data_smithi188_104537_object134162:head# 2024-04-01T19:36:33.067 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.067 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5084eb40:::benchmark_data_smithi188_104537_object25903:head# 2024-04-01T19:36:33.067 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.067 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5085165f:::benchmark_data_smithi188_104537_object51805:head# 2024-04-01T19:36:33.067 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.067 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50852f61:::benchmark_data_smithi188_104537_object64570:head# 2024-04-01T19:36:33.067 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.067 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50854823:::benchmark_data_smithi188_104537_object85932:head# 2024-04-01T19:36:33.067 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.067 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50856c5a:::benchmark_data_smithi188_104537_object100176:head# 2024-04-01T19:36:33.067 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.067 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50857c77:::benchmark_data_smithi188_104537_object34586:head# 2024-04-01T19:36:33.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50864bf9:::benchmark_data_smithi188_104537_object142196:head# 2024-04-01T19:36:33.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5086a3a9:::benchmark_data_smithi188_104537_object55461:head# 2024-04-01T19:36:33.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5086b101:::benchmark_data_smithi188_104537_object135437:head# 2024-04-01T19:36:33.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5086fd76:::benchmark_data_smithi188_104537_object11785:head# 2024-04-01T19:36:33.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50871183:::benchmark_data_smithi188_104537_object139994:head# 2024-04-01T19:36:33.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:508885e8:::benchmark_data_smithi188_104537_object80784:head# 2024-04-01T19:36:33.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5088b856:::benchmark_data_smithi188_104537_object70626:head# 2024-04-01T19:36:33.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5088d94e:::benchmark_data_smithi188_104537_object18179:head# 2024-04-01T19:36:33.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5088e04a:::benchmark_data_smithi188_104537_object137133:head# 2024-04-01T19:36:33.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50892084:::benchmark_data_smithi188_104537_object169702:head# 2024-04-01T19:36:33.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:508acaf6:::benchmark_data_smithi188_104537_object166837:head# 2024-04-01T19:36:33.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:508b02c7:::benchmark_data_smithi188_104537_object80040:head# 2024-04-01T19:36:33.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.070 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:508b7698:::benchmark_data_smithi188_104537_object62620:head# 2024-04-01T19:36:33.070 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.071 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:508b99f0:::benchmark_data_smithi188_104537_object20618:head# 2024-04-01T19:36:33.071 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.071 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:508bd685:::benchmark_data_smithi188_104537_object36933:head# 2024-04-01T19:36:33.071 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.071 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:508c7d27:::benchmark_data_smithi188_104537_object11451:head# 2024-04-01T19:36:33.071 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.071 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:508ceb72:::benchmark_data_smithi188_104537_object110173:head# 2024-04-01T19:36:33.071 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.071 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:508d8561:::benchmark_data_smithi188_104537_object115434:head# 2024-04-01T19:36:33.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:508e5518:::benchmark_data_smithi188_104537_object21679:head# 2024-04-01T19:36:33.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:508e6332:::benchmark_data_smithi188_104537_object36794:head# 2024-04-01T19:36:33.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:508ec6af:::benchmark_data_smithi188_104537_object170825:head# 2024-04-01T19:36:33.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:508ecdb5:::benchmark_data_smithi188_104537_object104913:head# 2024-04-01T19:36:33.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:508f77be:::benchmark_data_smithi188_104537_object41595:head# 2024-04-01T19:36:33.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:508ff2ca:::benchmark_data_smithi188_104537_object129636:head# 2024-04-01T19:36:33.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50907e3f:::benchmark_data_smithi188_104537_object25702:head# 2024-04-01T19:36:33.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5090aaa9:::benchmark_data_smithi188_104537_object144584:head# 2024-04-01T19:36:33.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5090cff0:::benchmark_data_smithi188_104537_object19837:head# 2024-04-01T19:36:33.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50911af8:::benchmark_data_smithi188_104537_object159002:head# 2024-04-01T19:36:33.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50917335:::benchmark_data_smithi188_104537_object58570:head# 2024-04-01T19:36:33.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5091a1eb:::benchmark_data_smithi188_104537_object88468:head# 2024-04-01T19:36:33.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.075 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5091a26f:::benchmark_data_smithi188_104537_object37375:head# 2024-04-01T19:36:33.075 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.075 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50934f8d:::benchmark_data_smithi188_104537_object129589:head# 2024-04-01T19:36:33.075 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.075 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5093953e:::benchmark_data_smithi188_104537_object21682:head# 2024-04-01T19:36:33.075 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.075 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5093df91:::benchmark_data_smithi188_104537_object76657:head# 2024-04-01T19:36:33.075 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.075 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5093f9af:::benchmark_data_smithi188_104537_object25256:head# 2024-04-01T19:36:33.075 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.075 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:509413bc:::benchmark_data_smithi188_104537_object100363:head# 2024-04-01T19:36:33.075 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.075 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5094d87b:::benchmark_data_smithi188_104537_object35790:head# 2024-04-01T19:36:33.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5094e306:::benchmark_data_smithi188_104537_object68070:head# 2024-04-01T19:36:33.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50951aed:::benchmark_data_smithi188_104537_object40423:head# 2024-04-01T19:36:33.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5095af3a:::benchmark_data_smithi188_104537_object135871:head# 2024-04-01T19:36:33.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50962da7:::benchmark_data_smithi188_104537_object165587:head# 2024-04-01T19:36:33.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50964f2c:::benchmark_data_smithi188_104537_object39619:head# 2024-04-01T19:36:33.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5097604b:::benchmark_data_smithi188_104537_object27992:head# 2024-04-01T19:36:33.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50982752:::benchmark_data_smithi188_104537_object25383:head# 2024-04-01T19:36:33.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5098286d:::benchmark_data_smithi188_104537_object103556:head# 2024-04-01T19:36:33.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50989fb1:::benchmark_data_smithi188_104537_object49009:head# 2024-04-01T19:36:33.078 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.078 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5098ec32:::benchmark_data_smithi188_104537_object139064:head# 2024-04-01T19:36:33.078 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.078 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50990e37:::benchmark_data_smithi188_104537_object45839:head# 2024-04-01T19:36:33.078 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.078 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5099ac03:::benchmark_data_smithi188_104537_object139078:head# 2024-04-01T19:36:33.079 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.079 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5099bb97:::benchmark_data_smithi188_104537_object33807:head# 2024-04-01T19:36:33.079 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.079 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:509a1df3:::benchmark_data_smithi188_104537_object148569:head# 2024-04-01T19:36:33.079 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.079 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:509a367d:::benchmark_data_smithi188_104537_object125093:head# 2024-04-01T19:36:33.079 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.079 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:509a52c4:::benchmark_data_smithi188_104537_object55393:head# 2024-04-01T19:36:33.079 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.079 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:509a58d3:::benchmark_data_smithi188_104537_object117076:head# 2024-04-01T19:36:33.079 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.079 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:509b3bd6:::benchmark_data_smithi188_104537_object163291:head# 2024-04-01T19:36:33.079 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.080 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:509b4567:::benchmark_data_smithi188_104537_object20712:head# 2024-04-01T19:36:33.080 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.080 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:509bddc5:::benchmark_data_smithi188_104537_object99469:head# 2024-04-01T19:36:33.080 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.080 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:509be4c6:::benchmark_data_smithi188_104537_object91419:head# 2024-04-01T19:36:33.080 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.080 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:36:33.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:509c64d4:::benchmark_data_smithi188_104537_object165651:head# 2024-04-01T19:36:33.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:509d38fa:::benchmark_data_smithi188_104537_object93821:head# 2024-04-01T19:36:33.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:509e2b65:::benchmark_data_smithi188_104537_object44572:head# 2024-04-01T19:36:33.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:509e4d21:::benchmark_data_smithi188_104537_object48549:head# 2024-04-01T19:36:33.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:509edfca:::benchmark_data_smithi188_104537_object120651:head# 2024-04-01T19:36:33.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:509f0a8d:::benchmark_data_smithi188_104537_object68053:head# 2024-04-01T19:36:33.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:509f7fb6:::benchmark_data_smithi188_104537_object60866:head# 2024-04-01T19:36:33.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:509fa7ab:::benchmark_data_smithi188_104537_object132871:head# 2024-04-01T19:36:33.083 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.083 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:509fbba3:::benchmark_data_smithi188_104537_object91496:head# 2024-04-01T19:36:33.083 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.083 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:509ffee9:::benchmark_data_smithi188_104537_object160826:head# 2024-04-01T19:36:33.083 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.085 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50a0b0fe:::benchmark_data_smithi188_104537_object43725:head# 2024-04-01T19:36:33.085 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.086 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50a1fc7b:::benchmark_data_smithi188_104537_object41104:head# 2024-04-01T19:36:33.086 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.086 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50a223f2:::benchmark_data_smithi188_104537_object22159:head# 2024-04-01T19:36:33.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50a246f0:::benchmark_data_smithi188_104537_object111436:head# 2024-04-01T19:36:33.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50a2d023:::benchmark_data_smithi188_104537_object85400:head# 2024-04-01T19:36:33.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50a315ea:::benchmark_data_smithi188_104537_object116868:head# 2024-04-01T19:36:33.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50a516d2:::benchmark_data_smithi188_104537_object165769:head# 2024-04-01T19:36:33.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50a52321:::benchmark_data_smithi188_104537_object149856:head# 2024-04-01T19:36:33.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.089 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50a59ccd:::benchmark_data_smithi188_104537_object133869:head# 2024-04-01T19:36:33.089 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.089 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50a64c73:::benchmark_data_smithi188_104537_object91663:head# 2024-04-01T19:36:33.089 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.089 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50a683e3:::benchmark_data_smithi188_104537_object167193:head# 2024-04-01T19:36:33.090 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.090 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50a6b652:::benchmark_data_smithi188_104537_object47678:head# 2024-04-01T19:36:33.090 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.090 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50a6ef61:::benchmark_data_smithi188_104537_object130353:head# 2024-04-01T19:36:33.091 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.091 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50a7fbb7:::benchmark_data_smithi188_104537_object62512:head# 2024-04-01T19:36:33.091 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.091 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50a847c3:::benchmark_data_smithi188_104537_object136195:head# 2024-04-01T19:36:33.091 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.091 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50a895c3:::benchmark_data_smithi188_104537_object117326:head# 2024-04-01T19:36:33.091 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.091 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50a90930:::benchmark_data_smithi188_104537_object121958:head# 2024-04-01T19:36:33.091 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50a937e2:::benchmark_data_smithi188_104537_object78008:head# 2024-04-01T19:36:33.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50a9a193:::benchmark_data_smithi188_104537_object34697:head# 2024-04-01T19:36:33.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50aa9589:::benchmark_data_smithi188_104537_object143847:head# 2024-04-01T19:36:33.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50aa9f6f:::benchmark_data_smithi188_104537_object86808:head# 2024-04-01T19:36:33.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50aab509:::benchmark_data_smithi188_104537_object109000:head# 2024-04-01T19:36:33.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50ab2e85:::benchmark_data_smithi188_104537_object115324:head# 2024-04-01T19:36:33.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.094 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50abcf38:::benchmark_data_smithi188_104537_object111796:head# 2024-04-01T19:36:33.094 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.094 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50ac723e:::benchmark_data_smithi188_104537_object86170:head# 2024-04-01T19:36:33.094 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50ad19d7:::benchmark_data_smithi188_104537_object14329:head# 2024-04-01T19:36:33.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50ad2278:::benchmark_data_smithi188_104537_object43772:head# 2024-04-01T19:36:33.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50ada471:::benchmark_data_smithi188_104537_object122779:head# 2024-04-01T19:36:33.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50adc8b7:::benchmark_data_smithi188_104537_object99563:head# 2024-04-01T19:36:33.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50adf386:::benchmark_data_smithi188_104537_object129171:head# 2024-04-01T19:36:33.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50ae5fa4:::benchmark_data_smithi188_104537_object133254:head# 2024-04-01T19:36:33.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50ae8a47:::benchmark_data_smithi188_104537_object114446:head# 2024-04-01T19:36:33.096 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.100 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50af9eb1:::benchmark_data_smithi188_104537_object154754:head# 2024-04-01T19:36:33.100 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.100 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b060b9:::benchmark_data_smithi188_104537_object123502:head# 2024-04-01T19:36:33.100 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.100 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b0be9c:::benchmark_data_smithi188_104537_object20523:head# 2024-04-01T19:36:33.100 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.100 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b0e746:::benchmark_data_smithi188_104537_object87042:head# 2024-04-01T19:36:33.100 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.100 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b0f5c1:::benchmark_data_smithi188_104537_object152282:head# 2024-04-01T19:36:33.101 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.101 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b18574:::benchmark_data_smithi188_104537_object155089:head# 2024-04-01T19:36:33.101 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.101 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b2b09a:::benchmark_data_smithi188_104537_object156016:head# 2024-04-01T19:36:33.101 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.101 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b2da14:::benchmark_data_smithi188_104537_object55826:head# 2024-04-01T19:36:33.101 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.101 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b329e1:::benchmark_data_smithi188_104537_object12943:head# 2024-04-01T19:36:33.101 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.101 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b33737:::benchmark_data_smithi188_104537_object69028:head# 2024-04-01T19:36:33.101 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.101 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b35d78:::benchmark_data_smithi188_104537_object145763:head# 2024-04-01T19:36:33.101 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.101 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b36c35:::benchmark_data_smithi188_104537_object82076:head# 2024-04-01T19:36:33.101 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b37467:::benchmark_data_smithi188_104537_object17294:head# 2024-04-01T19:36:33.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b3bb69:::benchmark_data_smithi188_104537_object134246:head# 2024-04-01T19:36:33.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b447cb:::benchmark_data_smithi188_104537_object126040:head# 2024-04-01T19:36:33.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b4b265:::benchmark_data_smithi188_104537_object50014:head# 2024-04-01T19:36:33.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b4da33:::benchmark_data_smithi188_104537_object45311:head# 2024-04-01T19:36:33.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b61db9:::benchmark_data_smithi188_104537_object95311:head# 2024-04-01T19:36:33.103 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.103 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b61e7a:::benchmark_data_smithi188_104537_object32649:head# 2024-04-01T19:36:33.103 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.103 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b64d25:::benchmark_data_smithi188_104537_object72759:head# 2024-04-01T19:36:33.103 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.103 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b6b19e:::benchmark_data_smithi188_104537_object41081:head# 2024-04-01T19:36:33.103 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.103 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b71f74:::benchmark_data_smithi188_104537_object101156:head# 2024-04-01T19:36:33.103 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.108 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b81df8:::benchmark_data_smithi188_104537_object120723:head# 2024-04-01T19:36:33.108 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.109 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b8abbb:::benchmark_data_smithi188_104537_object113425:head# 2024-04-01T19:36:33.109 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.109 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b8e9da:::benchmark_data_smithi188_104537_object128143:head# 2024-04-01T19:36:33.109 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.109 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b9d525:::benchmark_data_smithi188_104537_object84961:head# 2024-04-01T19:36:33.109 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.109 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50b9fa9e:::benchmark_data_smithi188_104537_object35751:head# 2024-04-01T19:36:33.109 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.109 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50bb52d7:::benchmark_data_smithi188_104537_object113285:head# 2024-04-01T19:36:33.109 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.109 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50bb653a:::benchmark_data_smithi188_104537_object28436:head# 2024-04-01T19:36:33.109 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.109 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50bbe5de:::benchmark_data_smithi188_104537_object169146:head# 2024-04-01T19:36:33.110 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.110 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50bbfff0:::benchmark_data_smithi188_104537_object169517:head# 2024-04-01T19:36:33.110 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.110 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50bc1c16:::benchmark_data_smithi188_104537_object103154:head# 2024-04-01T19:36:33.110 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.110 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50bcd826:::benchmark_data_smithi188_104537_object101035:head# 2024-04-01T19:36:33.110 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.110 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50bcef57:::benchmark_data_smithi188_104537_object138066:head# 2024-04-01T19:36:33.110 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.110 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50bdfc83:::benchmark_data_smithi188_104537_object147518:head# 2024-04-01T19:36:33.110 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.110 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50be46c7:::benchmark_data_smithi188_104537_object42530:head# 2024-04-01T19:36:33.111 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.111 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50bee573:::benchmark_data_smithi188_104537_object43942:head# 2024-04-01T19:36:33.111 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.111 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50bf7c37:::benchmark_data_smithi188_104537_object164103:head# 2024-04-01T19:36:33.111 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.111 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50bfefa3:::benchmark_data_smithi188_104537_object53372:head# 2024-04-01T19:36:33.111 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.111 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c02e75:::benchmark_data_smithi188_104537_object161689:head# 2024-04-01T19:36:33.111 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.111 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c03426:::benchmark_data_smithi188_104537_object57517:head# 2024-04-01T19:36:33.111 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.111 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c03e97:::benchmark_data_smithi188_104537_object53577:head# 2024-04-01T19:36:33.111 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.111 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c05515:::benchmark_data_smithi188_104537_object107799:head# 2024-04-01T19:36:33.111 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.112 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c09438:::benchmark_data_smithi188_104537_object13581:head# 2024-04-01T19:36:33.112 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.112 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c0eeac:::benchmark_data_smithi188_104537_object40647:head# 2024-04-01T19:36:33.112 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.112 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c1b0cb:::benchmark_data_smithi188_104537_object88130:head# 2024-04-01T19:36:33.112 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.112 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c2a906:::benchmark_data_smithi188_104537_object61928:head# 2024-04-01T19:36:33.112 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.112 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c2bbc7:::benchmark_data_smithi188_104537_object160365:head# 2024-04-01T19:36:33.112 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.112 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c4248e:::benchmark_data_smithi188_104537_object18759:head# 2024-04-01T19:36:33.112 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.112 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c4c40c:::benchmark_data_smithi188_104537_object162768:head# 2024-04-01T19:36:33.112 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.112 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c5a533:::benchmark_data_smithi188_104537_object21982:head# 2024-04-01T19:36:33.112 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.113 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c5a9e3:::benchmark_data_smithi188_104537_object112155:head# 2024-04-01T19:36:33.113 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.113 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c5c20d:::benchmark_data_smithi188_104537_object26420:head# 2024-04-01T19:36:33.113 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.113 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c5d6d1:::benchmark_data_smithi188_104537_object27065:head# 2024-04-01T19:36:33.113 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.113 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c6398f:::benchmark_data_smithi188_104537_object16143:head# 2024-04-01T19:36:33.113 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.116 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c66054:::benchmark_data_smithi188_104537_object49596:head# 2024-04-01T19:36:33.116 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.116 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c6b615:::benchmark_data_smithi188_104537_object44272:head# 2024-04-01T19:36:33.116 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.116 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c6f46e:::benchmark_data_smithi188_104537_object148861:head# 2024-04-01T19:36:33.116 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.116 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c73f27:::benchmark_data_smithi188_104537_object52403:head# 2024-04-01T19:36:33.117 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.117 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c76ec0:::benchmark_data_smithi188_104537_object51833:head# 2024-04-01T19:36:33.117 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.117 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c7d528:::benchmark_data_smithi188_104537_object24165:head# 2024-04-01T19:36:33.117 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.117 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c83e64:::benchmark_data_smithi188_104537_object84444:head# 2024-04-01T19:36:33.117 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.117 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c8993d:::benchmark_data_smithi188_104537_object107775:head# 2024-04-01T19:36:33.117 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.117 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c95470:::benchmark_data_smithi188_104537_object110433:head# 2024-04-01T19:36:33.117 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.117 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c97749:::benchmark_data_smithi188_104537_object150042:head# 2024-04-01T19:36:33.117 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.117 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50c984da:::benchmark_data_smithi188_104537_object88569:head# 2024-04-01T19:36:33.118 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.118 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50ca7fc9:::benchmark_data_smithi188_104537_object12238:head# 2024-04-01T19:36:33.118 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.118 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50ca9759:::benchmark_data_smithi188_104537_object143206:head# 2024-04-01T19:36:33.118 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.118 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50cb3254:::benchmark_data_smithi188_104537_object91433:head# 2024-04-01T19:36:33.118 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.118 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50cb62b3:::benchmark_data_smithi188_104537_object106583:head# 2024-04-01T19:36:33.118 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.118 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50ccc3bb:::benchmark_data_smithi188_104537_object39879:head# 2024-04-01T19:36:33.118 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.118 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50cd2e5c:::benchmark_data_smithi188_104537_object110999:head# 2024-04-01T19:36:33.119 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.119 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50cdf635:::benchmark_data_smithi188_104537_object66247:head# 2024-04-01T19:36:33.119 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.119 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50cdf87c:::benchmark_data_smithi188_104537_object133184:head# 2024-04-01T19:36:33.119 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.119 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50ce5723:::benchmark_data_smithi188_104537_object43945:head# 2024-04-01T19:36:33.119 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.119 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50cef6c1:::benchmark_data_smithi188_104537_object87580:head# 2024-04-01T19:36:33.119 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.119 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50cf0afc:::benchmark_data_smithi188_104537_object11557:head# 2024-04-01T19:36:33.119 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.119 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50d05389:::benchmark_data_smithi188_104537_object103489:head# 2024-04-01T19:36:33.119 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.119 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50d0d218:::benchmark_data_smithi188_104537_object138937:head# 2024-04-01T19:36:33.120 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.120 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50d105e3:::benchmark_data_smithi188_104537_object44752:head# 2024-04-01T19:36:33.120 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.120 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:36:33.121 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:36:33.121 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:36:33.121 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:36:33.121 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:36:33.121 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:36:33.121 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:36:33.121 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:36:33.121 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:36:33.121 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:36:33.121 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:36:33.121 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:36:33.122 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:36:33.125 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50d1487b:::benchmark_data_smithi188_104537_object49372:head# 2024-04-01T19:36:33.125 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.125 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50d1520c:::benchmark_data_smithi188_104537_object154288:head# 2024-04-01T19:36:33.125 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.125 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50d1cd80:::benchmark_data_smithi188_104537_object111386:head# 2024-04-01T19:36:33.125 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.125 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50d2849f:::benchmark_data_smithi188_104537_object69879:head# 2024-04-01T19:36:33.125 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.125 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50d28d64:::benchmark_data_smithi188_104537_object46503:head# 2024-04-01T19:36:33.125 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.125 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50d35369:::benchmark_data_smithi188_104537_object39386:head# 2024-04-01T19:36:33.125 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.125 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50d368eb:::benchmark_data_smithi188_104537_object99858:head# 2024-04-01T19:36:33.126 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.126 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50d3dc7a:::benchmark_data_smithi188_104537_object111183:head# 2024-04-01T19:36:33.126 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.126 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50d48083:::benchmark_data_smithi188_104537_object47150:head# 2024-04-01T19:36:33.126 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.126 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50d5058a:::benchmark_data_smithi188_104537_object34943:head# 2024-04-01T19:36:33.126 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.126 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50d54b75:::benchmark_data_smithi188_104537_object51338:head# 2024-04-01T19:36:33.126 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.126 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50d550c0:::benchmark_data_smithi188_104537_object63685:head# 2024-04-01T19:36:33.126 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.126 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50d5dc6e:::benchmark_data_smithi188_104537_object59204:head# 2024-04-01T19:36:33.127 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.127 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50d6a17f:::benchmark_data_smithi188_104537_object74529:head# 2024-04-01T19:36:33.127 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.127 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50d78664:::benchmark_data_smithi188_104537_object109482:head# 2024-04-01T19:36:33.127 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.127 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50d7ee1d:::benchmark_data_smithi188_104537_object40987:head# 2024-04-01T19:36:33.127 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.127 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50d8c333:::benchmark_data_smithi188_104537_object99109:head# 2024-04-01T19:36:33.127 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.127 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50d9d573:::benchmark_data_smithi188_104537_object113592:head# 2024-04-01T19:36:33.127 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50d9d688:::benchmark_data_smithi188_104537_object120677:head# 2024-04-01T19:36:33.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50da31b8:::benchmark_data_smithi188_104537_object72808:head# 2024-04-01T19:36:33.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50da6a4f:::benchmark_data_smithi188_104537_object84570:head# 2024-04-01T19:36:33.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50daaff8:::benchmark_data_smithi188_104537_object73143:head# 2024-04-01T19:36:33.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50dad233:::benchmark_data_smithi188_104537_object54318:head# 2024-04-01T19:36:33.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50dae341:::benchmark_data_smithi188_104537_object54003:head# 2024-04-01T19:36:33.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50db8298:::benchmark_data_smithi188_104537_object59621:head# 2024-04-01T19:36:33.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50dc02d1:::benchmark_data_smithi188_104537_object26996:head# 2024-04-01T19:36:33.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50dc6ec0:::benchmark_data_smithi188_104537_object109462:head# 2024-04-01T19:36:33.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.132 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50dd3e06:::benchmark_data_smithi188_104537_object58735:head# 2024-04-01T19:36:33.132 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.132 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50dd8e06:::benchmark_data_smithi188_104537_object37596:head# 2024-04-01T19:36:33.132 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.132 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50ddd817:::benchmark_data_smithi188_104537_object101808:head# 2024-04-01T19:36:33.132 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.132 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50ddf517:::benchmark_data_smithi188_104537_object40355:head# 2024-04-01T19:36:33.132 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.133 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50ddfdce:::benchmark_data_smithi188_104537_object17454:head# 2024-04-01T19:36:33.133 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.133 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50de31bd:::benchmark_data_smithi188_104537_object25284:head# 2024-04-01T19:36:33.133 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.133 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50de75e4:::benchmark_data_smithi188_104537_object167489:head# 2024-04-01T19:36:33.133 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.133 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50df714d:::benchmark_data_smithi188_104537_object93053:head# 2024-04-01T19:36:33.133 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.133 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50dff94a:::benchmark_data_smithi188_104537_object155412:head# 2024-04-01T19:36:33.133 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.133 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e048e4:::benchmark_data_smithi188_104537_object159448:head# 2024-04-01T19:36:33.133 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.134 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e0e3c0:::benchmark_data_smithi188_104537_object151823:head# 2024-04-01T19:36:33.134 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.134 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e0f62f:::benchmark_data_smithi188_104537_object19233:head# 2024-04-01T19:36:33.134 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.134 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e10454:::benchmark_data_smithi188_104537_object87897:head# 2024-04-01T19:36:33.134 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.134 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e14393:::benchmark_data_smithi188_104537_object70759:head# 2024-04-01T19:36:33.134 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.134 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e22cef:::benchmark_data_smithi188_104537_object14621:head# 2024-04-01T19:36:33.134 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.134 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e279a7:::benchmark_data_smithi188_104537_object18134:head# 2024-04-01T19:36:33.134 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.135 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e2a52b:::benchmark_data_smithi188_104537_object77501:head# 2024-04-01T19:36:33.135 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.135 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e2b67b:::benchmark_data_smithi188_104537_object106754:head# 2024-04-01T19:36:33.135 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.135 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e2e747:::benchmark_data_smithi188_104537_object171150:head# 2024-04-01T19:36:33.135 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.135 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e31764:::benchmark_data_smithi188_104537_object44171:head# 2024-04-01T19:36:33.135 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.135 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e31ece:::benchmark_data_smithi188_104537_object97452:head# 2024-04-01T19:36:33.135 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.135 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e35783:::benchmark_data_smithi188_104537_object75460:head# 2024-04-01T19:36:33.135 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.135 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e3886d:::benchmark_data_smithi188_104537_object116438:head# 2024-04-01T19:36:33.135 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.136 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e3b2d8:::benchmark_data_smithi188_104537_object156095:head# 2024-04-01T19:36:33.136 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.136 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e43cfd:::benchmark_data_smithi188_104537_object53258:head# 2024-04-01T19:36:33.136 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.136 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e473f0:::benchmark_data_smithi188_104537_object115528:head# 2024-04-01T19:36:33.136 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.137 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e4d780:::benchmark_data_smithi188_104537_object78059:head# 2024-04-01T19:36:33.137 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.137 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e52a2a:::benchmark_data_smithi188_104537_object139547:head# 2024-04-01T19:36:33.137 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.137 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e628df:::benchmark_data_smithi188_104537_object153418:head# 2024-04-01T19:36:33.137 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.137 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e72714:::benchmark_data_smithi188_104537_object19235:head# 2024-04-01T19:36:33.137 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.137 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e73a95:::benchmark_data_smithi188_104537_object94719:head# 2024-04-01T19:36:33.137 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.137 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e7a0d5:::benchmark_data_smithi188_104537_object107708:head# 2024-04-01T19:36:33.137 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.137 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e7bf3b:::benchmark_data_smithi188_104537_object68558:head# 2024-04-01T19:36:33.138 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.138 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e88129:::benchmark_data_smithi188_104537_object162298:head# 2024-04-01T19:36:33.138 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.138 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e8ec66:::benchmark_data_smithi188_104537_object64096:head# 2024-04-01T19:36:33.138 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.138 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e955b4:::benchmark_data_smithi188_104537_object125103:head# 2024-04-01T19:36:33.138 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.138 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e97d23:::benchmark_data_smithi188_104537_object130375:head# 2024-04-01T19:36:33.138 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.138 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50e9c570:::benchmark_data_smithi188_104537_object33658:head# 2024-04-01T19:36:33.138 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.139 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50eb53d8:::benchmark_data_smithi188_104537_object156250:head# 2024-04-01T19:36:33.139 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.139 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50ec845f:::benchmark_data_smithi188_104537_object102209:head# 2024-04-01T19:36:33.139 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.139 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50ec87db:::benchmark_data_smithi188_104537_object81105:head# 2024-04-01T19:36:33.139 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.139 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50ed4431:::benchmark_data_smithi188_104537_object45519:head# 2024-04-01T19:36:33.139 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.139 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50ed8684:::benchmark_data_smithi188_104537_object170219:head# 2024-04-01T19:36:33.139 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.139 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50ee8878:::benchmark_data_smithi188_104537_object126804:head# 2024-04-01T19:36:33.139 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.139 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50eeb665:::benchmark_data_smithi188_104537_object155383:head# 2024-04-01T19:36:33.139 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.140 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50ef2bbf:::benchmark_data_smithi188_104537_object146094:head# 2024-04-01T19:36:33.140 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.140 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50f026da:::benchmark_data_smithi188_104537_object90318:head# 2024-04-01T19:36:33.140 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.140 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50f040ce:::benchmark_data_smithi188_104537_object68657:head# 2024-04-01T19:36:33.140 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.140 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50f0bf17:::benchmark_data_smithi188_104537_object170658:head# 2024-04-01T19:36:33.140 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.140 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50f138d9:::benchmark_data_smithi188_104537_object115077:head# 2024-04-01T19:36:33.140 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.140 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50f1b09e:::benchmark_data_smithi188_104537_object94499:head# 2024-04-01T19:36:33.140 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.144 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50f21c69:::benchmark_data_smithi188_104537_object89402:head# 2024-04-01T19:36:33.144 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.144 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50f262a6:::benchmark_data_smithi188_104537_object27555:head# 2024-04-01T19:36:33.144 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.144 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50f28757:::benchmark_data_smithi188_104537_object25170:head# 2024-04-01T19:36:33.144 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.145 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50f2efec:::benchmark_data_smithi188_104537_object165399:head# 2024-04-01T19:36:33.145 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.145 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50f2fc65:::benchmark_data_smithi188_104537_object152032:head# 2024-04-01T19:36:33.145 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.145 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50f5f4c3:::benchmark_data_smithi188_104537_object144972:head# 2024-04-01T19:36:33.145 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.145 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50f60aa0:::benchmark_data_smithi188_104537_object71877:head# 2024-04-01T19:36:33.145 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.145 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50f6a75a:::benchmark_data_smithi188_104537_object48315:head# 2024-04-01T19:36:33.145 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.145 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50f72f1b:::benchmark_data_smithi188_104537_object78158:head# 2024-04-01T19:36:33.145 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.145 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50f77969:::benchmark_data_smithi188_104537_object94113:head# 2024-04-01T19:36:33.145 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.146 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50f82192:::benchmark_data_smithi188_104537_object30820:head# 2024-04-01T19:36:33.146 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.146 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50f86c2b:::benchmark_data_smithi188_104537_object56306:head# 2024-04-01T19:36:33.146 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.146 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50f8e9f3:::benchmark_data_smithi188_104537_object91955:head# 2024-04-01T19:36:33.146 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.146 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50fa4fdb:::benchmark_data_smithi188_104537_object51765:head# 2024-04-01T19:36:33.146 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.146 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50fa8b7a:::benchmark_data_smithi188_104537_object86499:head# 2024-04-01T19:36:33.146 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.146 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50fb0286:::benchmark_data_smithi188_104537_object120558:head# 2024-04-01T19:36:33.146 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.146 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50fb4a2c:::benchmark_data_smithi188_104537_object131496:head# 2024-04-01T19:36:33.146 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.146 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50fbd201:::benchmark_data_smithi188_104537_object128172:head# 2024-04-01T19:36:33.147 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.147 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50fc126d:::benchmark_data_smithi188_104537_object126169:head# 2024-04-01T19:36:33.147 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.147 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50fc4842:::benchmark_data_smithi188_104537_object87987:head# 2024-04-01T19:36:33.147 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.147 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50fcbe37:::benchmark_data_smithi188_104537_object51525:head# 2024-04-01T19:36:33.147 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.147 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50fd3f12:::benchmark_data_smithi188_104537_object132889:head# 2024-04-01T19:36:33.147 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.147 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50fdae35:::benchmark_data_smithi188_104537_object43911:head# 2024-04-01T19:36:33.147 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.147 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50fe213b:::benchmark_data_smithi188_104537_object164291:head# 2024-04-01T19:36:33.147 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.147 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50feba1b:::benchmark_data_smithi188_104537_object37846:head# 2024-04-01T19:36:33.147 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.149 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50fedd6e:::benchmark_data_smithi188_104537_object145775:head# 2024-04-01T19:36:33.149 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.150 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:50ff489c:::benchmark_data_smithi188_104537_object83779:head# 2024-04-01T19:36:33.150 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.150 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51000e6b:::benchmark_data_smithi188_104537_object149711:head# 2024-04-01T19:36:33.150 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.150 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51008acd:::benchmark_data_smithi188_104537_object93476:head# 2024-04-01T19:36:33.150 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.150 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51012eab:::benchmark_data_smithi188_104537_object34860:head# 2024-04-01T19:36:33.150 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.150 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5101cd65:::benchmark_data_smithi188_104537_object71824:head# 2024-04-01T19:36:33.150 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.150 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5101da52:::benchmark_data_smithi188_104537_object47013:head# 2024-04-01T19:36:33.150 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.151 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51021144:::benchmark_data_smithi188_104537_object95413:head# 2024-04-01T19:36:33.151 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.151 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:510290b0:::benchmark_data_smithi188_104537_object17932:head# 2024-04-01T19:36:33.151 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.151 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5102dfcf:::benchmark_data_smithi188_104537_object21856:head# 2024-04-01T19:36:33.151 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.151 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5103a678:::benchmark_data_smithi188_104537_object66559:head# 2024-04-01T19:36:33.151 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.151 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5103b644:::benchmark_data_smithi188_104537_object168864:head# 2024-04-01T19:36:33.151 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.151 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51044fa2:::benchmark_data_smithi188_104537_object170236:head# 2024-04-01T19:36:33.151 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.151 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5104c304:::benchmark_data_smithi188_104537_object97748:head# 2024-04-01T19:36:33.151 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.152 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5104f09a:::benchmark_data_smithi188_104537_object147469:head# 2024-04-01T19:36:33.152 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.155 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:510596a3:::benchmark_data_smithi188_104537_object147646:head# 2024-04-01T19:36:33.155 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.155 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5105f8bb:::benchmark_data_smithi188_104537_object76302:head# 2024-04-01T19:36:33.155 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.155 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5105fafa:::benchmark_data_smithi188_104537_object80818:head# 2024-04-01T19:36:33.155 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.155 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:510610e1:::benchmark_data_smithi188_104537_object95335:head# 2024-04-01T19:36:33.155 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.155 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51063f8b:::benchmark_data_smithi188_104537_object79113:head# 2024-04-01T19:36:33.156 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.156 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5106e2d0:::benchmark_data_smithi188_104537_object48165:head# 2024-04-01T19:36:33.156 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.156 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5107c032:::benchmark_data_smithi188_104537_object86625:head# 2024-04-01T19:36:33.156 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.156 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5107fcd1:::benchmark_data_smithi188_104537_object124779:head# 2024-04-01T19:36:33.156 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.156 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51085ff2:::benchmark_data_smithi188_104537_object145522:head# 2024-04-01T19:36:33.156 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.156 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51098b95:::benchmark_data_smithi188_104537_object63115:head# 2024-04-01T19:36:33.156 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.157 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:510990e0:::benchmark_data_smithi188_104537_object138489:head# 2024-04-01T19:36:33.157 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.157 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5109949e:::benchmark_data_smithi188_104537_object161042:head# 2024-04-01T19:36:33.157 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.157 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51099837:::benchmark_data_smithi188_104537_object144528:head# 2024-04-01T19:36:33.157 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.157 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5109a9b3:::benchmark_data_smithi188_104537_object60959:head# 2024-04-01T19:36:33.157 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.157 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5109cc5f:::benchmark_data_smithi188_104537_object171919:head# 2024-04-01T19:36:33.157 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.157 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5109d699:::benchmark_data_smithi188_104537_object98373:head# 2024-04-01T19:36:33.157 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.157 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:510a6dbb:::benchmark_data_smithi188_104537_object55471:head# 2024-04-01T19:36:33.158 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.158 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:510a6ee7:::benchmark_data_smithi188_104537_object168317:head# 2024-04-01T19:36:33.158 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.158 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:510b5b80:::benchmark_data_smithi188_104537_object115544:head# 2024-04-01T19:36:33.158 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.158 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:510bfd27:::benchmark_data_smithi188_104537_object160270:head# 2024-04-01T19:36:33.158 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.158 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:510c85ae:::benchmark_data_smithi188_104537_object93022:head# 2024-04-01T19:36:33.158 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.160 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:510cf7f9:::benchmark_data_smithi188_104537_object139204:head# 2024-04-01T19:36:33.160 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.160 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:510dc563:::benchmark_data_smithi188_104537_object22889:head# 2024-04-01T19:36:33.160 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.161 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:510eee54:::benchmark_data_smithi188_104537_object165385:head# 2024-04-01T19:36:33.161 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.161 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:510ff344:::benchmark_data_smithi188_104537_object77777:head# 2024-04-01T19:36:33.161 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.161 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:511017d4:::benchmark_data_smithi188_104537_object154950:head# 2024-04-01T19:36:33.161 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.161 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51102451:::benchmark_data_smithi188_104537_object39671:head# 2024-04-01T19:36:33.161 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.161 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:511030d8:::benchmark_data_smithi188_104537_object157891:head# 2024-04-01T19:36:33.161 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.161 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5110803c:::benchmark_data_smithi188_104537_object112649:head# 2024-04-01T19:36:33.161 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.161 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5111823e:::benchmark_data_smithi188_104537_object100122:head# 2024-04-01T19:36:33.162 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.162 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5111abeb:::benchmark_data_smithi188_104537_object117909:head# 2024-04-01T19:36:33.162 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.162 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5111cb4c:::benchmark_data_smithi188_104537_object16577:head# 2024-04-01T19:36:33.162 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.162 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51142485:::benchmark_data_smithi188_104537_object46554:head# 2024-04-01T19:36:33.162 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.162 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51145fbf:::benchmark_data_smithi188_104537_object127224:head# 2024-04-01T19:36:33.162 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.162 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:511474b4:::benchmark_data_smithi188_104537_object95516:head# 2024-04-01T19:36:33.162 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.163 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:511548f2:::benchmark_data_smithi188_104537_object165505:head# 2024-04-01T19:36:33.163 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.163 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51155c1c:::benchmark_data_smithi188_104537_object31826:head# 2024-04-01T19:36:33.163 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.163 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5115bdb4:::benchmark_data_smithi188_104537_object26275:head# 2024-04-01T19:36:33.163 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.163 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5115ce27:::benchmark_data_smithi188_104537_object41811:head# 2024-04-01T19:36:33.163 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.164 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51178223:::benchmark_data_smithi188_104537_object85111:head# 2024-04-01T19:36:33.164 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.164 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5117b0ff:::benchmark_data_smithi188_104537_object137492:head# 2024-04-01T19:36:33.164 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.164 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51185914:::benchmark_data_smithi188_104537_object90577:head# 2024-04-01T19:36:33.164 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.164 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5118e21c:::benchmark_data_smithi188_104537_object38264:head# 2024-04-01T19:36:33.164 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.164 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5119c8ee:::benchmark_data_smithi188_104537_object101642:head# 2024-04-01T19:36:33.164 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.164 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:511a31b5:::benchmark_data_smithi188_104537_object159703:head# 2024-04-01T19:36:33.164 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.164 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:511a6aaf:::benchmark_data_smithi188_104537_object22697:head# 2024-04-01T19:36:33.165 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.165 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:511aa87e:::benchmark_data_smithi188_104537_object30234:head# 2024-04-01T19:36:33.165 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.165 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:511b1442:::benchmark_data_smithi188_104537_object41437:head# 2024-04-01T19:36:33.165 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.165 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:511b2aad:::benchmark_data_smithi188_104537_object14587:head# 2024-04-01T19:36:33.165 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.166 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:511be06b:::benchmark_data_smithi188_104537_object70789:head# 2024-04-01T19:36:33.166 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.166 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:511c6acd:::benchmark_data_smithi188_104537_object158011:head# 2024-04-01T19:36:33.166 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.166 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:511c6ff2:::benchmark_data_smithi188_104537_object144815:head# 2024-04-01T19:36:33.167 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.167 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:511c84c0:::benchmark_data_smithi188_104537_object16908:head# 2024-04-01T19:36:33.167 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.167 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:511d2810:::benchmark_data_smithi188_104537_object21272:head# 2024-04-01T19:36:33.167 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.167 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:511d66e8:::benchmark_data_smithi188_104537_object87753:head# 2024-04-01T19:36:33.167 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.167 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:511ec531:::benchmark_data_smithi188_104537_object18089:head# 2024-04-01T19:36:33.167 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.167 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:511ec533:::benchmark_data_smithi188_104537_object79450:head# 2024-04-01T19:36:33.167 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.167 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:511f2f62:::benchmark_data_smithi188_104537_object114508:head# 2024-04-01T19:36:33.167 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.167 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:511fcb1c:::benchmark_data_smithi188_104537_object74333:head# 2024-04-01T19:36:33.168 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.169 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:511fe22b:::benchmark_data_smithi188_104537_object68686:head# 2024-04-01T19:36:33.169 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.169 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51202f13:::benchmark_data_smithi188_104537_object11969:head# 2024-04-01T19:36:33.169 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.169 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51217530:::benchmark_data_smithi188_104537_object70006:head# 2024-04-01T19:36:33.170 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.170 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:512184a2:::benchmark_data_smithi188_104537_object30642:head# 2024-04-01T19:36:33.170 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.170 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:512211e1:::benchmark_data_smithi188_104537_object155902:head# 2024-04-01T19:36:33.170 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51237b94:::benchmark_data_smithi188_104537_object128470:head# 2024-04-01T19:36:33.171 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5123a737:::benchmark_data_smithi188_104537_object53974:head# 2024-04-01T19:36:33.171 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5124f1a5:::benchmark_data_smithi188_104537_object11270:head# 2024-04-01T19:36:33.171 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51255f35:::benchmark_data_smithi188_104537_object160549:head# 2024-04-01T19:36:33.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5126748e:::benchmark_data_smithi188_104537_object164317:head# 2024-04-01T19:36:33.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.173 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51268983:::benchmark_data_smithi188_104537_object142064:head# 2024-04-01T19:36:33.173 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.173 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:512689e4:::benchmark_data_smithi188_104537_object143736:head# 2024-04-01T19:36:33.173 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.173 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51268c59:::benchmark_data_smithi188_104537_object133432:head# 2024-04-01T19:36:33.173 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.173 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5126b8f6:::benchmark_data_smithi188_104537_object161847:head# 2024-04-01T19:36:33.173 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.174 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51276efd:::benchmark_data_smithi188_104537_object165811:head# 2024-04-01T19:36:33.174 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.174 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51279927:::benchmark_data_smithi188_104537_object133887:head# 2024-04-01T19:36:33.174 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.174 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:512837b5:::benchmark_data_smithi188_104537_object18437:head# 2024-04-01T19:36:33.174 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.174 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51284d82:::benchmark_data_smithi188_104537_object79475:head# 2024-04-01T19:36:33.174 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.174 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5128d2c6:::benchmark_data_smithi188_104537_object133449:head# 2024-04-01T19:36:33.175 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.178 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:512a499a:::benchmark_data_smithi188_104537_object82959:head# 2024-04-01T19:36:33.178 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.178 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:512acb20:::benchmark_data_smithi188_104537_object139700:head# 2024-04-01T19:36:33.178 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.178 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:512b5d3a:::benchmark_data_smithi188_104537_object112365:head# 2024-04-01T19:36:33.178 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.178 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:512bb503:::benchmark_data_smithi188_104537_object95641:head# 2024-04-01T19:36:33.178 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.178 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:512c70f0:::benchmark_data_smithi188_104537_object33298:head# 2024-04-01T19:36:33.178 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.178 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:512ccc37:::benchmark_data_smithi188_104537_object54165:head# 2024-04-01T19:36:33.179 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.179 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:512d18de:::benchmark_data_smithi188_104537_object107054:head# 2024-04-01T19:36:33.179 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.179 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:512d28df:::benchmark_data_smithi188_104537_object18972:head# 2024-04-01T19:36:33.179 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.179 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:512dccdd:::benchmark_data_smithi188_104537_object93914:head# 2024-04-01T19:36:33.179 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.179 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:512e1e18:::benchmark_data_smithi188_104537_object25612:head# 2024-04-01T19:36:33.179 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.179 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:512e25ac:::benchmark_data_smithi188_104537_object156202:head# 2024-04-01T19:36:33.179 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.179 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:512ed593:::benchmark_data_smithi188_104537_object37901:head# 2024-04-01T19:36:33.179 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.179 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:512f6fbd:::benchmark_data_smithi188_104537_object133907:head# 2024-04-01T19:36:33.179 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.180 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:512f80f4:::benchmark_data_smithi188_104537_object94368:head# 2024-04-01T19:36:33.180 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.180 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:512fd3aa:::benchmark_data_smithi188_104537_object59668:head# 2024-04-01T19:36:33.180 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.180 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:512fea65:::benchmark_data_smithi188_104537_object110945:head# 2024-04-01T19:36:33.180 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.181 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:512feda0:::benchmark_data_smithi188_104537_object153379:head# 2024-04-01T19:36:33.181 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.181 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:512ffd0d:::benchmark_data_smithi188_104537_object103167:head# 2024-04-01T19:36:33.181 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.181 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51303a29:::benchmark_data_smithi188_104537_object126979:head# 2024-04-01T19:36:33.181 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.181 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51305c9d:::benchmark_data_smithi188_104537_object119491:head# 2024-04-01T19:36:33.181 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.182 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:513069e2:::benchmark_data_smithi188_104537_object47233:head# 2024-04-01T19:36:33.182 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.182 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5131263b:::benchmark_data_smithi188_104537_object131010:head# 2024-04-01T19:36:33.182 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.182 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51319b75:::benchmark_data_smithi188_104537_object165633:head# 2024-04-01T19:36:33.182 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.182 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5131cb06:::benchmark_data_smithi188_104537_object103967:head# 2024-04-01T19:36:33.182 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.182 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5131e45b:::benchmark_data_smithi188_104537_object58182:head# 2024-04-01T19:36:33.182 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.182 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5132cd55:::benchmark_data_smithi188_104537_object86143:head# 2024-04-01T19:36:33.182 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.184 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5132fb6d:::benchmark_data_smithi188_104537_object152671:head# 2024-04-01T19:36:33.184 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.184 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:513358c0:::benchmark_data_smithi188_104537_object11724:head# 2024-04-01T19:36:33.184 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.184 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5134236f:::benchmark_data_smithi188_104537_object109426:head# 2024-04-01T19:36:33.184 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.185 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51347437:::benchmark_data_smithi188_104537_object93450:head# 2024-04-01T19:36:33.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.185 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51349989:::benchmark_data_smithi188_104537_object12964:head# 2024-04-01T19:36:33.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.185 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51349a38:::benchmark_data_smithi188_104537_object168001:head# 2024-04-01T19:36:33.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.185 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5134ff8d:::benchmark_data_smithi188_104537_object59568:head# 2024-04-01T19:36:33.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.185 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51353ea5:::benchmark_data_smithi188_104537_object21357:head# 2024-04-01T19:36:33.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.185 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51364476:::benchmark_data_smithi188_104537_object44964:head# 2024-04-01T19:36:33.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.185 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:513698b7:::benchmark_data_smithi188_104537_object166909:head# 2024-04-01T19:36:33.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.186 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51378634:::benchmark_data_smithi188_104537_object161902:head# 2024-04-01T19:36:33.186 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.186 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5137ac3e:::benchmark_data_smithi188_104537_object124951:head# 2024-04-01T19:36:33.186 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.187 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5137df97:::benchmark_data_smithi188_104537_object36712:head# 2024-04-01T19:36:33.187 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.187 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51390b57:::benchmark_data_smithi188_104537_object126195:head# 2024-04-01T19:36:33.187 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.187 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:513915e8:::benchmark_data_smithi188_104537_object154585:head# 2024-04-01T19:36:33.188 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.188 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:513a84d1:::benchmark_data_smithi188_104537_object170726:head# 2024-04-01T19:36:33.188 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.188 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:513aa3e3:::benchmark_data_smithi188_104537_object149221:head# 2024-04-01T19:36:33.188 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.188 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:513ac12f:::benchmark_data_smithi188_104537_object29285:head# 2024-04-01T19:36:33.188 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.188 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:513bad91:::benchmark_data_smithi188_104537_object82835:head# 2024-04-01T19:36:33.188 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.188 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:513bb182:::benchmark_data_smithi188_104537_object165561:head# 2024-04-01T19:36:33.188 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.188 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:513c0f6a:::benchmark_data_smithi188_104537_object100933:head# 2024-04-01T19:36:33.188 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.188 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:513cb1a0:::benchmark_data_smithi188_104537_object32263:head# 2024-04-01T19:36:33.189 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.189 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:513db722:::benchmark_data_smithi188_104537_object128154:head# 2024-04-01T19:36:33.189 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.189 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:513e1399:::benchmark_data_smithi188_104537_object106603:head# 2024-04-01T19:36:33.189 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.191 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:513e62bd:::benchmark_data_smithi188_104537_object122089:head# 2024-04-01T19:36:33.191 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.191 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:513f4c9e:::benchmark_data_smithi188_104537_object124039:head# 2024-04-01T19:36:33.191 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.191 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:513f631e:::benchmark_data_smithi188_104537_object95538:head# 2024-04-01T19:36:33.191 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.191 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:513f7566:::benchmark_data_smithi188_104537_object100690:head# 2024-04-01T19:36:33.192 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.192 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5140670c:::benchmark_data_smithi188_104537_object122340:head# 2024-04-01T19:36:33.192 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.192 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:514112dc:::benchmark_data_smithi188_104537_object117885:head# 2024-04-01T19:36:33.192 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.192 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5141210c:::benchmark_data_smithi188_104537_object168453:head# 2024-04-01T19:36:33.192 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.192 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51414c26:::benchmark_data_smithi188_104537_object159734:head# 2024-04-01T19:36:33.192 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.192 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5141b04a:::benchmark_data_smithi188_104537_object56964:head# 2024-04-01T19:36:33.192 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.192 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5141e774:::benchmark_data_smithi188_104537_object109248:head# 2024-04-01T19:36:33.192 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.192 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:514248db:::benchmark_data_smithi188_104537_object76843:head# 2024-04-01T19:36:33.192 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.193 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:514270a8:::benchmark_data_smithi188_104537_object68492:head# 2024-04-01T19:36:33.193 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.193 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:514271b7:::benchmark_data_smithi188_104537_object48809:head# 2024-04-01T19:36:33.193 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.193 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5142afa7:::benchmark_data_smithi188_104537_object132407:head# 2024-04-01T19:36:33.193 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.194 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:514334cd:::benchmark_data_smithi188_104537_object76851:head# 2024-04-01T19:36:33.194 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.194 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5143a18a:::benchmark_data_smithi188_104537_object146522:head# 2024-04-01T19:36:33.194 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.194 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5143e350:::benchmark_data_smithi188_104537_object144259:head# 2024-04-01T19:36:33.194 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.194 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:514478d4:::benchmark_data_smithi188_104537_object85205:head# 2024-04-01T19:36:33.194 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.197 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:514516a0:::benchmark_data_smithi188_104537_object67082:head# 2024-04-01T19:36:33.197 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.197 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51454086:::benchmark_data_smithi188_104537_object80717:head# 2024-04-01T19:36:33.197 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.197 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51454414:::benchmark_data_smithi188_104537_object84773:head# 2024-04-01T19:36:33.197 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.197 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5145c0e6:::benchmark_data_smithi188_104537_object151989:head# 2024-04-01T19:36:33.198 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.198 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5145e109:::benchmark_data_smithi188_104537_object157510:head# 2024-04-01T19:36:33.198 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.198 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5145e1a8:::benchmark_data_smithi188_104537_object156247:head# 2024-04-01T19:36:33.198 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.198 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51462323:::benchmark_data_smithi188_104537_object105855:head# 2024-04-01T19:36:33.198 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.198 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5148815d:::benchmark_data_smithi188_104537_object74327:head# 2024-04-01T19:36:33.198 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.199 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51488490:::benchmark_data_smithi188_104537_object58270:head# 2024-04-01T19:36:33.199 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.199 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5148f919:::benchmark_data_smithi188_104537_object45800:head# 2024-04-01T19:36:33.199 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.199 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:514911ea:::benchmark_data_smithi188_104537_object106147:head# 2024-04-01T19:36:33.199 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.199 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51498706:::benchmark_data_smithi188_104537_object33841:head# 2024-04-01T19:36:33.199 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.199 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:514a88a2:::benchmark_data_smithi188_104537_object75584:head# 2024-04-01T19:36:33.199 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.199 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:514af02f:::benchmark_data_smithi188_104537_object160108:head# 2024-04-01T19:36:33.199 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.199 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:514b2537:::benchmark_data_smithi188_104537_object161079:head# 2024-04-01T19:36:33.200 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.201 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:514b7347:::benchmark_data_smithi188_104537_object72889:head# 2024-04-01T19:36:33.201 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.201 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:514c615e:::benchmark_data_smithi188_104537_object154263:head# 2024-04-01T19:36:33.201 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.201 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:514cb800:::benchmark_data_smithi188_104537_object154144:head# 2024-04-01T19:36:33.201 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.201 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:514d3329:::benchmark_data_smithi188_104537_object67759:head# 2024-04-01T19:36:33.201 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.201 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:514d431e:::benchmark_data_smithi188_104537_object43759:head# 2024-04-01T19:36:33.201 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.202 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:514de22e:::benchmark_data_smithi188_104537_object83278:head# 2024-04-01T19:36:33.202 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.202 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:514e13ee:::benchmark_data_smithi188_104537_object97215:head# 2024-04-01T19:36:33.202 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.202 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:514fafa1:::benchmark_data_smithi188_104537_object92419:head# 2024-04-01T19:36:33.202 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.203 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:514fd385:::benchmark_data_smithi188_104537_object94888:head# 2024-04-01T19:36:33.203 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.203 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:514fe7e4:::benchmark_data_smithi188_104537_object122922:head# 2024-04-01T19:36:33.203 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.203 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:515018aa:::benchmark_data_smithi188_104537_object42716:head# 2024-04-01T19:36:33.204 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.204 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5150419e:::benchmark_data_smithi188_104537_object35718:head# 2024-04-01T19:36:33.204 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.204 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5150a457:::benchmark_data_smithi188_104537_object162812:head# 2024-04-01T19:36:33.204 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.204 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:515103e7:::benchmark_data_smithi188_104537_object20423:head# 2024-04-01T19:36:33.204 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.204 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5151e535:::benchmark_data_smithi188_104537_object58770:head# 2024-04-01T19:36:33.204 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.204 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51520260:::benchmark_data_smithi188_104537_object138065:head# 2024-04-01T19:36:33.204 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.204 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5153e55d:::benchmark_data_smithi188_104537_object78653:head# 2024-04-01T19:36:33.204 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.206 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51541980:::benchmark_data_smithi188_104537_object164943:head# 2024-04-01T19:36:33.207 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.207 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51542179:::benchmark_data_smithi188_104537_object61967:head# 2024-04-01T19:36:33.207 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.207 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:515439ff:::benchmark_data_smithi188_104537_object61051:head# 2024-04-01T19:36:33.207 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.207 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51543e04:::benchmark_data_smithi188_104537_object122812:head# 2024-04-01T19:36:33.207 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.207 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:515444d4:::benchmark_data_smithi188_104537_object125097:head# 2024-04-01T19:36:33.207 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.207 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5154e86d:::benchmark_data_smithi188_104537_object13478:head# 2024-04-01T19:36:33.207 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.207 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:515589e6:::benchmark_data_smithi188_104537_object13696:head# 2024-04-01T19:36:33.207 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.207 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51562b8e:::benchmark_data_smithi188_104537_object114897:head# 2024-04-01T19:36:33.208 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.208 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5156e5d5:::benchmark_data_smithi188_104537_object66829:head# 2024-04-01T19:36:33.208 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.208 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51581530:::benchmark_data_smithi188_104537_object104524:head# 2024-04-01T19:36:33.208 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.208 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5158656d:::benchmark_data_smithi188_104537_object119902:head# 2024-04-01T19:36:33.208 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.209 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51587b2b:::benchmark_data_smithi188_104537_object161043:head# 2024-04-01T19:36:33.209 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.212 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5158bac4:::benchmark_data_smithi188_104537_object47526:head# 2024-04-01T19:36:33.212 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.212 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5159f4e6:::benchmark_data_smithi188_104537_object59948:head# 2024-04-01T19:36:33.212 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.212 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:515a1746:::benchmark_data_smithi188_104537_object106002:head# 2024-04-01T19:36:33.212 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.212 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:515b3fdd:::benchmark_data_smithi188_104537_object34163:head# 2024-04-01T19:36:33.212 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.212 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:515b9100:::benchmark_data_smithi188_104537_object149784:head# 2024-04-01T19:36:33.212 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.212 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:515c780c:::benchmark_data_smithi188_104537_object19706:head# 2024-04-01T19:36:33.212 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.213 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:515ce2cf:::benchmark_data_smithi188_104537_object31005:head# 2024-04-01T19:36:33.213 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.213 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:515d6ed2:::benchmark_data_smithi188_104537_object88236:head# 2024-04-01T19:36:33.213 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.213 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:515e4cd5:::benchmark_data_smithi188_104537_object130293:head# 2024-04-01T19:36:33.213 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.213 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:515e8032:::benchmark_data_smithi188_104537_object16864:head# 2024-04-01T19:36:33.213 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.213 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:515f1bd7:::benchmark_data_smithi188_104537_object152117:head# 2024-04-01T19:36:33.213 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.213 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:515f5292:::benchmark_data_smithi188_104537_object84382:head# 2024-04-01T19:36:33.213 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.213 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51608213:::benchmark_data_smithi188_104537_object40393:head# 2024-04-01T19:36:33.213 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.213 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5160974e:::benchmark_data_smithi188_104537_object44561:head# 2024-04-01T19:36:33.214 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.214 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5160d7a2:::benchmark_data_smithi188_104537_object40510:head# 2024-04-01T19:36:33.214 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.214 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:516266cf:::benchmark_data_smithi188_104537_object50665:head# 2024-04-01T19:36:33.214 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.214 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51629501:::benchmark_data_smithi188_104537_object142793:head# 2024-04-01T19:36:33.214 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.214 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51635464:::benchmark_data_smithi188_104537_object17613:head# 2024-04-01T19:36:33.214 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.214 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51635b51:::benchmark_data_smithi188_104537_object75284:head# 2024-04-01T19:36:33.214 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.214 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5163ace2:::benchmark_data_smithi188_104537_object135569:head# 2024-04-01T19:36:33.214 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.214 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5164240e:::benchmark_data_smithi188_104537_object134190:head# 2024-04-01T19:36:33.215 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.218 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51647b00:::benchmark_data_smithi188_104537_object61174:head# 2024-04-01T19:36:33.218 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.218 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5164b058:::benchmark_data_smithi188_104537_object133631:head# 2024-04-01T19:36:33.218 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.218 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5164ece3:::benchmark_data_smithi188_104537_object84295:head# 2024-04-01T19:36:33.218 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.219 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51658913:::benchmark_data_smithi188_104537_object95836:head# 2024-04-01T19:36:33.219 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.219 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51658df8:::benchmark_data_smithi188_104537_object50786:head# 2024-04-01T19:36:33.219 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.219 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51663db6:::benchmark_data_smithi188_104537_object20319:head# 2024-04-01T19:36:33.219 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.219 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51665b02:::benchmark_data_smithi188_104537_object131469:head# 2024-04-01T19:36:33.219 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.219 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51670070:::benchmark_data_smithi188_104537_object51047:head# 2024-04-01T19:36:33.219 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.219 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5167c4fa:::benchmark_data_smithi188_104537_object164193:head# 2024-04-01T19:36:33.219 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.219 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51680a5c:::benchmark_data_smithi188_104537_object75348:head# 2024-04-01T19:36:33.219 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.220 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51685d15:::benchmark_data_smithi188_104537_object156536:head# 2024-04-01T19:36:33.220 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.220 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5168d3e8:::benchmark_data_smithi188_104537_object167527:head# 2024-04-01T19:36:33.220 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.220 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51698993:::benchmark_data_smithi188_104537_object138255:head# 2024-04-01T19:36:33.220 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.220 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5169af0e:::benchmark_data_smithi188_104537_object147567:head# 2024-04-01T19:36:33.220 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.220 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5169b051:::benchmark_data_smithi188_104537_object34645:head# 2024-04-01T19:36:33.220 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.220 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5169ec7d:::benchmark_data_smithi188_104537_object49151:head# 2024-04-01T19:36:33.220 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.220 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:516ab5fa:::benchmark_data_smithi188_104537_object60552:head# 2024-04-01T19:36:33.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:516abf89:::benchmark_data_smithi188_104537_object89093:head# 2024-04-01T19:36:33.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:516bb528:::benchmark_data_smithi188_104537_object141883:head# 2024-04-01T19:36:33.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:516bdaed:::benchmark_data_smithi188_104537_object58062:head# 2024-04-01T19:36:33.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:516c1039:::benchmark_data_smithi188_104537_object19494:head# 2024-04-01T19:36:33.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:516d04b3:::benchmark_data_smithi188_104537_object156557:head# 2024-04-01T19:36:33.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:516d339e:::benchmark_data_smithi188_104537_object23771:head# 2024-04-01T19:36:33.222 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.222 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:516d3743:::benchmark_data_smithi188_104537_object114498:head# 2024-04-01T19:36:33.222 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.226 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:516d6fc8:::benchmark_data_smithi188_104537_object158397:head# 2024-04-01T19:36:33.227 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:516d8c0c:::benchmark_data_smithi188_104537_object54578:head# 2024-04-01T19:36:33.227 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:516db42e:::benchmark_data_smithi188_104537_object18367:head# 2024-04-01T19:36:33.227 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:516dbb0f:::benchmark_data_smithi188_104537_object117594:head# 2024-04-01T19:36:33.227 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:516dc660:::benchmark_data_smithi188_104537_object12427:head# 2024-04-01T19:36:33.227 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:516e33e2:::benchmark_data_smithi188_104537_object114160:head# 2024-04-01T19:36:33.227 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:516f0118:::benchmark_data_smithi188_104537_object85107:head# 2024-04-01T19:36:33.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.228 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:516f3563:::benchmark_data_smithi188_104537_object70116:head# 2024-04-01T19:36:33.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.228 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51700db8:::benchmark_data_smithi188_104537_object32418:head# 2024-04-01T19:36:33.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.228 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5170ebcc:::benchmark_data_smithi188_104537_object130946:head# 2024-04-01T19:36:33.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.228 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5171276e:::benchmark_data_smithi188_104537_object87260:head# 2024-04-01T19:36:33.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.228 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51717633:::benchmark_data_smithi188_104537_object108203:head# 2024-04-01T19:36:33.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.228 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5171b289:::benchmark_data_smithi188_104537_object53256:head# 2024-04-01T19:36:33.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.229 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5171b8e0:::benchmark_data_smithi188_104537_object171553:head# 2024-04-01T19:36:33.229 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.229 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5173390c:::benchmark_data_smithi188_104537_object120819:head# 2024-04-01T19:36:33.229 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.229 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5173774a:::benchmark_data_smithi188_104537_object135613:head# 2024-04-01T19:36:33.229 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.229 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5174ed82:::benchmark_data_smithi188_104537_object96340:head# 2024-04-01T19:36:33.229 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.229 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51754dea:::benchmark_data_smithi188_104537_object149032:head# 2024-04-01T19:36:33.229 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.229 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:517643b4:::benchmark_data_smithi188_104537_object48012:head# 2024-04-01T19:36:33.229 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.229 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51765bea:::benchmark_data_smithi188_104537_object57935:head# 2024-04-01T19:36:33.229 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.230 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5176f011:::benchmark_data_smithi188_104537_object59294:head# 2024-04-01T19:36:33.230 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.230 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5177484a:::benchmark_data_smithi188_104537_object11412:head# 2024-04-01T19:36:33.230 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.230 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5177ea80:::benchmark_data_smithi188_104537_object21452:head# 2024-04-01T19:36:33.230 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.230 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51785940:::benchmark_data_smithi188_104537_object130519:head# 2024-04-01T19:36:33.230 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.230 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5179511d:::benchmark_data_smithi188_104537_object112338:head# 2024-04-01T19:36:33.230 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.230 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51795f28:::benchmark_data_smithi188_104537_object39984:head# 2024-04-01T19:36:33.230 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.230 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:517a350a:::benchmark_data_smithi188_104537_object15346:head# 2024-04-01T19:36:33.231 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.231 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:517b641c:::benchmark_data_smithi188_104537_object93669:head# 2024-04-01T19:36:33.231 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.231 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:517c7480:::benchmark_data_smithi188_104537_object60381:head# 2024-04-01T19:36:33.231 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.231 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:517cce44:::benchmark_data_smithi188_104537_object170588:head# 2024-04-01T19:36:33.231 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.231 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:517d39b3:::benchmark_data_smithi188_104537_object43026:head# 2024-04-01T19:36:33.231 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.231 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:517d6bbf:::benchmark_data_smithi188_104537_object78822:head# 2024-04-01T19:36:33.231 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.231 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:517e03a5:::benchmark_data_smithi188_104537_object74799:head# 2024-04-01T19:36:33.232 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.233 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:517e6a30:::benchmark_data_smithi188_104537_object139773:head# 2024-04-01T19:36:33.233 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.233 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:517ec416:::benchmark_data_smithi188_104537_object121272:head# 2024-04-01T19:36:33.233 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.233 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:517edfd8:::benchmark_data_smithi188_104537_object29695:head# 2024-04-01T19:36:33.233 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.233 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:517f726d:::benchmark_data_smithi188_104537_object45100:head# 2024-04-01T19:36:33.233 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.233 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:517f7909:::benchmark_data_smithi188_104537_object64631:head# 2024-04-01T19:36:33.233 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.233 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:517f9767:::benchmark_data_smithi188_104537_object109380:head# 2024-04-01T19:36:33.234 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.234 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51800e19:::benchmark_data_smithi188_104537_object152856:head# 2024-04-01T19:36:33.234 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.234 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51801748:::benchmark_data_smithi188_104537_object64333:head# 2024-04-01T19:36:33.234 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.234 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:518068aa:::benchmark_data_smithi188_104537_object144027:head# 2024-04-01T19:36:33.234 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.234 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5180bc61:::benchmark_data_smithi188_104537_object162060:head# 2024-04-01T19:36:33.234 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.234 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51811d8d:::benchmark_data_smithi188_104537_object91235:head# 2024-04-01T19:36:33.234 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.234 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5181a90a:::benchmark_data_smithi188_104537_object130245:head# 2024-04-01T19:36:33.234 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:518311fd:::benchmark_data_smithi188_104537_object162390:head# 2024-04-01T19:36:33.235 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51831763:::benchmark_data_smithi188_104537_object51618:head# 2024-04-01T19:36:33.235 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:518370dc:::benchmark_data_smithi188_104537_object126362:head# 2024-04-01T19:36:33.235 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5184dbd4:::benchmark_data_smithi188_104537_object55148:head# 2024-04-01T19:36:33.235 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51862918:::benchmark_data_smithi188_104537_object59361:head# 2024-04-01T19:36:33.235 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51865424:::benchmark_data_smithi188_104537_object131295:head# 2024-04-01T19:36:33.235 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51868546:::benchmark_data_smithi188_104537_object159708:head# 2024-04-01T19:36:33.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51871c72:::benchmark_data_smithi188_104537_object79177:head# 2024-04-01T19:36:33.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5187ad6b:::benchmark_data_smithi188_104537_object73916:head# 2024-04-01T19:36:33.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5187bba6:::benchmark_data_smithi188_104537_object98217:head# 2024-04-01T19:36:33.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5187d3fb:::benchmark_data_smithi188_104537_object163274:head# 2024-04-01T19:36:33.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5187f0e3:::benchmark_data_smithi188_104537_object160123:head# 2024-04-01T19:36:33.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.239 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51880e62:::benchmark_data_smithi188_104537_object95053:head# 2024-04-01T19:36:33.239 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.239 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:518914c1:::benchmark_data_smithi188_104537_object150329:head# 2024-04-01T19:36:33.239 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.239 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51891566:::benchmark_data_smithi188_104537_object83411:head# 2024-04-01T19:36:33.239 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5189200a:::benchmark_data_smithi188_104537_object31864:head# 2024-04-01T19:36:33.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5189415b:::benchmark_data_smithi188_104537_object98141:head# 2024-04-01T19:36:33.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51899e01:::benchmark_data_smithi188_104537_object168355:head# 2024-04-01T19:36:33.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5189c9a5:::benchmark_data_smithi188_104537_object61260:head# 2024-04-01T19:36:33.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5189f762:::benchmark_data_smithi188_104537_object134275:head# 2024-04-01T19:36:33.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:518a1344:::benchmark_data_smithi188_104537_object38858:head# 2024-04-01T19:36:33.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:518a35ec:::benchmark_data_smithi188_104537_object98598:head# 2024-04-01T19:36:33.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.241 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:518a8d12:::benchmark_data_smithi188_104537_object150064:head# 2024-04-01T19:36:33.241 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.241 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:518b2f07:::benchmark_data_smithi188_104537_object69187:head# 2024-04-01T19:36:33.241 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.241 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:518b5a8e:::benchmark_data_smithi188_104537_object25137:head# 2024-04-01T19:36:33.241 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.241 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:518df2db:::benchmark_data_smithi188_104537_object39479:head# 2024-04-01T19:36:33.241 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.241 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:518e43af:::benchmark_data_smithi188_104537_object69456:head# 2024-04-01T19:36:33.241 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.241 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:518e6843:::benchmark_data_smithi188_104537_object153748:head# 2024-04-01T19:36:33.241 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.242 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:518e6b61:::benchmark_data_smithi188_104537_object27377:head# 2024-04-01T19:36:33.242 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.242 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:518e7a59:::benchmark_data_smithi188_104537_object120018:head# 2024-04-01T19:36:33.242 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.242 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:518ead88:::benchmark_data_smithi188_104537_object91911:head# 2024-04-01T19:36:33.242 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.242 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:518f8523:::benchmark_data_smithi188_104537_object78167:head# 2024-04-01T19:36:33.242 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.242 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:518fc511:::benchmark_data_smithi188_104537_object130583:head# 2024-04-01T19:36:33.242 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.242 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51904fe8:::benchmark_data_smithi188_104537_object23724:head# 2024-04-01T19:36:33.243 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.243 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:519052c0:::benchmark_data_smithi188_104537_object29406:head# 2024-04-01T19:36:33.243 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.248 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51905326:::benchmark_data_smithi188_104537_object77174:head# 2024-04-01T19:36:33.248 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.248 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5190ec3d:::benchmark_data_smithi188_104537_object80187:head# 2024-04-01T19:36:33.248 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.248 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5191701d:::benchmark_data_smithi188_104537_object127745:head# 2024-04-01T19:36:33.248 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.248 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51919966:::benchmark_data_smithi188_104537_object151528:head# 2024-04-01T19:36:33.248 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.248 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5192145f:::benchmark_data_smithi188_104537_object133547:head# 2024-04-01T19:36:33.248 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.248 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:519381bc:::benchmark_data_smithi188_104537_object87522:head# 2024-04-01T19:36:33.249 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.249 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5193868a:::benchmark_data_smithi188_104537_object135035:head# 2024-04-01T19:36:33.249 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.249 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51940596:::benchmark_data_smithi188_104537_object153657:head# 2024-04-01T19:36:33.249 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.249 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:519416f0:::benchmark_data_smithi188_104537_object148873:head# 2024-04-01T19:36:33.249 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.249 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51944647:::benchmark_data_smithi188_104537_object155215:head# 2024-04-01T19:36:33.249 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.249 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5194f3a9:::benchmark_data_smithi188_104537_object155526:head# 2024-04-01T19:36:33.249 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.249 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5194f933:::benchmark_data_smithi188_104537_object77805:head# 2024-04-01T19:36:33.249 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.249 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51950aea:::benchmark_data_smithi188_104537_object129613:head# 2024-04-01T19:36:33.249 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.250 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51958d44:::benchmark_data_smithi188_104537_object30249:head# 2024-04-01T19:36:33.250 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.250 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51959cb1:::benchmark_data_smithi188_104537_object114671:head# 2024-04-01T19:36:33.250 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.250 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51960879:::benchmark_data_smithi188_104537_object145941:head# 2024-04-01T19:36:33.250 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.250 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:519617c9:::benchmark_data_smithi188_104537_object171060:head# 2024-04-01T19:36:33.250 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.250 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5196cd84:::benchmark_data_smithi188_104537_object23883:head# 2024-04-01T19:36:33.250 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.250 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51978b7d:::benchmark_data_smithi188_104537_object62983:head# 2024-04-01T19:36:33.250 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.251 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51980740:::benchmark_data_smithi188_104537_object158010:head# 2024-04-01T19:36:33.251 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.251 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51983e71:::benchmark_data_smithi188_104537_object163834:head# 2024-04-01T19:36:33.251 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.251 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51985056:::benchmark_data_smithi188_104537_object102239:head# 2024-04-01T19:36:33.251 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.251 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51987465:::benchmark_data_smithi188_104537_object69323:head# 2024-04-01T19:36:33.251 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.251 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:519949ba:::benchmark_data_smithi188_104537_object60230:head# 2024-04-01T19:36:33.251 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.251 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5199b336:::benchmark_data_smithi188_104537_object52849:head# 2024-04-01T19:36:33.251 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.252 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:519aac70:::benchmark_data_smithi188_104537_object44740:head# 2024-04-01T19:36:33.252 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.252 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:519ab0d5:::benchmark_data_smithi188_104537_object145201:head# 2024-04-01T19:36:33.252 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.252 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:519b2b79:::benchmark_data_smithi188_104537_object140769:head# 2024-04-01T19:36:33.252 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.252 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:519b6ce8:::benchmark_data_smithi188_104537_object21216:head# 2024-04-01T19:36:33.252 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.252 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:519c33d5:::benchmark_data_smithi188_104537_object68327:head# 2024-04-01T19:36:33.252 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.252 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:519ca2ee:::benchmark_data_smithi188_104537_object44937:head# 2024-04-01T19:36:33.252 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.252 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:519cb535:::benchmark_data_smithi188_104537_object156643:head# 2024-04-01T19:36:33.253 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.257 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:519cbf10:::benchmark_data_smithi188_104537_object36134:head# 2024-04-01T19:36:33.257 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.257 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:519d6d18:::benchmark_data_smithi188_104537_object95238:head# 2024-04-01T19:36:33.257 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.257 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:519daf3d:::benchmark_data_smithi188_104537_object44786:head# 2024-04-01T19:36:33.257 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.258 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:519db98d:::benchmark_data_smithi188_104537_object167762:head# 2024-04-01T19:36:33.258 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.258 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:519dc18b:::benchmark_data_smithi188_104537_object133422:head# 2024-04-01T19:36:33.258 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.258 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:519dd6f3:::benchmark_data_smithi188_104537_object29131:head# 2024-04-01T19:36:33.258 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.258 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:519e7ac0:::benchmark_data_smithi188_104537_object55653:head# 2024-04-01T19:36:33.258 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.258 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:519f315a:::benchmark_data_smithi188_104537_object136441:head# 2024-04-01T19:36:33.258 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.258 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:519f800d:::benchmark_data_smithi188_104537_object48115:head# 2024-04-01T19:36:33.258 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.259 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51a08a4f:::benchmark_data_smithi188_104537_object47798:head# 2024-04-01T19:36:33.259 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.259 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51a08f52:::benchmark_data_smithi188_104537_object88440:head# 2024-04-01T19:36:33.259 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.259 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51a184ec:::benchmark_data_smithi188_104537_object86235:head# 2024-04-01T19:36:33.259 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.259 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51a21ca4:::benchmark_data_smithi188_104537_object160983:head# 2024-04-01T19:36:33.259 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.259 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51a24920:::benchmark_data_smithi188_104537_object65510:head# 2024-04-01T19:36:33.259 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.259 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51a307e0:::benchmark_data_smithi188_104537_object126793:head# 2024-04-01T19:36:33.259 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.259 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51a31439:::benchmark_data_smithi188_104537_object68770:head# 2024-04-01T19:36:33.259 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.260 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51a34db9:::benchmark_data_smithi188_104537_object92071:head# 2024-04-01T19:36:33.260 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.260 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51a39f7f:::benchmark_data_smithi188_104537_object96898:head# 2024-04-01T19:36:33.260 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.260 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51a4f42a:::benchmark_data_smithi188_104537_object14014:head# 2024-04-01T19:36:33.260 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.260 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51a50598:::benchmark_data_smithi188_104537_object148408:head# 2024-04-01T19:36:33.260 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.260 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51a58ed5:::benchmark_data_smithi188_104537_object125869:head# 2024-04-01T19:36:33.260 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.260 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51a59067:::benchmark_data_smithi188_104537_object116355:head# 2024-04-01T19:36:33.260 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.260 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51a5e9bf:::benchmark_data_smithi188_104537_object25036:head# 2024-04-01T19:36:33.260 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.261 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51a66314:::benchmark_data_smithi188_104537_object146279:head# 2024-04-01T19:36:33.261 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.261 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51a80c56:::benchmark_data_smithi188_104537_object68153:head# 2024-04-01T19:36:33.261 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.261 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51a897bc:::benchmark_data_smithi188_104537_object124974:head# 2024-04-01T19:36:33.261 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.261 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51a8a723:::benchmark_data_smithi188_104537_object18718:head# 2024-04-01T19:36:33.261 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.261 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51a8ed62:::benchmark_data_smithi188_104537_object139520:head# 2024-04-01T19:36:33.261 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.261 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51a962d5:::benchmark_data_smithi188_104537_object171325:head# 2024-04-01T19:36:33.261 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.261 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51ab9149:::benchmark_data_smithi188_104537_object125704:head# 2024-04-01T19:36:33.262 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.262 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51ac4d1a:::benchmark_data_smithi188_104537_object11263:head# 2024-04-01T19:36:33.262 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.262 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51ac9e89:::benchmark_data_smithi188_104537_object51655:head# 2024-04-01T19:36:33.262 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.262 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51aded62:::benchmark_data_smithi188_104537_object71871:head# 2024-04-01T19:36:33.262 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.262 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51ae0452:::benchmark_data_smithi188_104537_object18275:head# 2024-04-01T19:36:33.262 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.262 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51ae0dab:::benchmark_data_smithi188_104537_object81093:head# 2024-04-01T19:36:33.263 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.268 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51ae1cdb:::benchmark_data_smithi188_104537_object53738:head# 2024-04-01T19:36:33.268 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.268 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51ae5ac9:::benchmark_data_smithi188_104537_object44222:head# 2024-04-01T19:36:33.268 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.268 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51aef234:::benchmark_data_smithi188_104537_object77832:head# 2024-04-01T19:36:33.268 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.268 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51af2304:::benchmark_data_smithi188_104537_object26990:head# 2024-04-01T19:36:33.268 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.268 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51af4c06:::benchmark_data_smithi188_104537_object77424:head# 2024-04-01T19:36:33.268 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.268 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51af7b32:::benchmark_data_smithi188_104537_object91756:head# 2024-04-01T19:36:33.268 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.268 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51aff20b:::benchmark_data_smithi188_104537_object89733:head# 2024-04-01T19:36:33.269 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.269 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b002cd:::benchmark_data_smithi188_104537_object154648:head# 2024-04-01T19:36:33.269 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.269 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b081be:::benchmark_data_smithi188_104537_object54703:head# 2024-04-01T19:36:33.269 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.269 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b08c6c:::benchmark_data_smithi188_104537_object146762:head# 2024-04-01T19:36:33.269 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.269 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b0b08e:::benchmark_data_smithi188_104537_object120156:head# 2024-04-01T19:36:33.269 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.269 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b10bd9:::benchmark_data_smithi188_104537_object108593:head# 2024-04-01T19:36:33.269 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.269 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b10e35:::benchmark_data_smithi188_104537_object46291:head# 2024-04-01T19:36:33.269 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.270 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b11af1:::benchmark_data_smithi188_104537_object155579:head# 2024-04-01T19:36:33.270 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.270 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b2f13c:::benchmark_data_smithi188_104537_object158444:head# 2024-04-01T19:36:33.270 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.270 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b3894f:::benchmark_data_smithi188_104537_object132279:head# 2024-04-01T19:36:33.270 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.270 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b40538:::benchmark_data_smithi188_104537_object19197:head# 2024-04-01T19:36:33.270 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.270 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b40ab8:::benchmark_data_smithi188_104537_object135365:head# 2024-04-01T19:36:33.270 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.270 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b43a15:::benchmark_data_smithi188_104537_object25203:head# 2024-04-01T19:36:33.270 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.271 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b4dcff:::benchmark_data_smithi188_104537_object150864:head# 2024-04-01T19:36:33.271 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.271 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b55f49:::benchmark_data_smithi188_104537_object148563:head# 2024-04-01T19:36:33.271 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.271 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b57be8:::benchmark_data_smithi188_104537_object122003:head# 2024-04-01T19:36:33.271 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.271 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b5af4b:::benchmark_data_smithi188_104537_object98299:head# 2024-04-01T19:36:33.271 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.271 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b615e3:::benchmark_data_smithi188_104537_object154315:head# 2024-04-01T19:36:33.271 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.271 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b6c107:::benchmark_data_smithi188_104537_object83241:head# 2024-04-01T19:36:33.271 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.271 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b724cb:::benchmark_data_smithi188_104537_object171304:head# 2024-04-01T19:36:33.272 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.272 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b74685:::benchmark_data_smithi188_104537_object110049:head# 2024-04-01T19:36:33.272 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.272 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b77013:::benchmark_data_smithi188_104537_object170535:head# 2024-04-01T19:36:33.272 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.272 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b787ca:::benchmark_data_smithi188_104537_object90069:head# 2024-04-01T19:36:33.272 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.272 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b7b965:::benchmark_data_smithi188_104537_object119450:head# 2024-04-01T19:36:33.272 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.272 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b7c790:::benchmark_data_smithi188_104537_object108239:head# 2024-04-01T19:36:33.272 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.272 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b8cb96:::benchmark_data_smithi188_104537_object92479:head# 2024-04-01T19:36:33.273 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.273 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b8f50f:::benchmark_data_smithi188_104537_object118477:head# 2024-04-01T19:36:33.273 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.273 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b93291:::benchmark_data_smithi188_104537_object105311:head# 2024-04-01T19:36:33.273 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.273 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51b9c4f8:::benchmark_data_smithi188_104537_object20149:head# 2024-04-01T19:36:33.273 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.273 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51babd9b:::benchmark_data_smithi188_104537_object162982:head# 2024-04-01T19:36:33.273 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.273 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51bafa19:::benchmark_data_smithi188_104537_object169104:head# 2024-04-01T19:36:33.273 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.273 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51bbea0e:::benchmark_data_smithi188_104537_object122480:head# 2024-04-01T19:36:33.273 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.273 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51bc3ea1:::benchmark_data_smithi188_104537_object61383:head# 2024-04-01T19:36:33.273 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.274 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51bc4ef5:::benchmark_data_smithi188_104537_object81620:head# 2024-04-01T19:36:33.274 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.274 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51bcf719:::benchmark_data_smithi188_104537_object75113:head# 2024-04-01T19:36:33.274 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.274 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51bd3462:::benchmark_data_smithi188_104537_object112934:head# 2024-04-01T19:36:33.274 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.282 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51be2ac7:::benchmark_data_smithi188_104537_object70394:head# 2024-04-01T19:36:33.282 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.282 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51be7b86:::benchmark_data_smithi188_104537_object87993:head# 2024-04-01T19:36:33.282 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.282 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51bf76e9:::benchmark_data_smithi188_104537_object137574:head# 2024-04-01T19:36:33.282 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.282 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51bfa4e0:::benchmark_data_smithi188_104537_object119420:head# 2024-04-01T19:36:33.282 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.282 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51bfa88b:::benchmark_data_smithi188_104537_object53820:head# 2024-04-01T19:36:33.282 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.282 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51c00904:::benchmark_data_smithi188_104537_object97456:head# 2024-04-01T19:36:33.282 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.283 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51c021d4:::benchmark_data_smithi188_104537_object96560:head# 2024-04-01T19:36:33.283 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.283 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51c09442:::benchmark_data_smithi188_104537_object69191:head# 2024-04-01T19:36:33.283 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.283 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51c0fb2d:::benchmark_data_smithi188_104537_object165491:head# 2024-04-01T19:36:33.283 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.283 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51c146a3:::benchmark_data_smithi188_104537_object105218:head# 2024-04-01T19:36:33.283 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.283 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51c17f9c:::benchmark_data_smithi188_104537_object138556:head# 2024-04-01T19:36:33.283 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.283 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51c1a377:::benchmark_data_smithi188_104537_object119827:head# 2024-04-01T19:36:33.283 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.283 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51c1ccc7:::benchmark_data_smithi188_104537_object47253:head# 2024-04-01T19:36:33.283 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.283 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51c261bd:::benchmark_data_smithi188_104537_object60823:head# 2024-04-01T19:36:33.284 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.284 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51c2d4df:::benchmark_data_smithi188_104537_object51916:head# 2024-04-01T19:36:33.284 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.284 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51c2dcba:::benchmark_data_smithi188_104537_object131537:head# 2024-04-01T19:36:33.284 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.284 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51c30393:::benchmark_data_smithi188_104537_object170932:head# 2024-04-01T19:36:33.284 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.284 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51c34125:::benchmark_data_smithi188_104537_object62764:head# 2024-04-01T19:36:33.284 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.284 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51c3ccb0:::benchmark_data_smithi188_104537_object93789:head# 2024-04-01T19:36:33.284 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.284 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51c447b9:::benchmark_data_smithi188_104537_object28788:head# 2024-04-01T19:36:33.284 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.284 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51c4a983:::benchmark_data_smithi188_104537_object151956:head# 2024-04-01T19:36:33.285 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.285 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51c5d6ee:::benchmark_data_smithi188_104537_object103547:head# 2024-04-01T19:36:33.285 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.285 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51c691d9:::benchmark_data_smithi188_104537_object95266:head# 2024-04-01T19:36:33.285 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.285 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51c8148e:::benchmark_data_smithi188_104537_object38518:head# 2024-04-01T19:36:33.285 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.285 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51c88ee0:::benchmark_data_smithi188_104537_object19010:head# 2024-04-01T19:36:33.285 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.285 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51c8aea8:::benchmark_data_smithi188_104537_object167231:head# 2024-04-01T19:36:33.285 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.285 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51c9233d:::benchmark_data_smithi188_104537_object165972:head# 2024-04-01T19:36:33.285 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.285 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51c987b1:::benchmark_data_smithi188_104537_object127112:head# 2024-04-01T19:36:33.286 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.286 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51cb919d:::benchmark_data_smithi188_104537_object74453:head# 2024-04-01T19:36:33.286 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.286 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51cb91a6:::benchmark_data_smithi188_104537_object105769:head# 2024-04-01T19:36:33.286 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.286 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51cc2c69:::benchmark_data_smithi188_104537_object125709:head# 2024-04-01T19:36:33.286 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.286 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51cc9101:::benchmark_data_smithi188_104537_object70749:head# 2024-04-01T19:36:33.286 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.286 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51ccf1f4:::benchmark_data_smithi188_104537_object66155:head# 2024-04-01T19:36:33.286 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.286 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51cfdc18:::benchmark_data_smithi188_104537_object38654:head# 2024-04-01T19:36:33.287 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.287 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d01338:::benchmark_data_smithi188_104537_object47770:head# 2024-04-01T19:36:33.287 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.287 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d053ae:::benchmark_data_smithi188_104537_object88549:head# 2024-04-01T19:36:33.287 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.287 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d085e2:::benchmark_data_smithi188_104537_object140443:head# 2024-04-01T19:36:33.287 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.287 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d08801:::benchmark_data_smithi188_104537_object121173:head# 2024-04-01T19:36:33.287 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.287 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d0b5c3:::benchmark_data_smithi188_104537_object17985:head# 2024-04-01T19:36:33.287 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.287 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d0c747:::benchmark_data_smithi188_104537_object14917:head# 2024-04-01T19:36:33.287 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.287 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d10b6a:::benchmark_data_smithi188_104537_object46931:head# 2024-04-01T19:36:33.288 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.288 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d1687b:::benchmark_data_smithi188_104537_object14702:head# 2024-04-01T19:36:33.288 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.288 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d23564:::benchmark_data_smithi188_104537_object93793:head# 2024-04-01T19:36:33.288 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.288 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d2396f:::benchmark_data_smithi188_104537_object66180:head# 2024-04-01T19:36:33.288 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.288 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d2605b:::benchmark_data_smithi188_104537_object146351:head# 2024-04-01T19:36:33.288 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.288 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d2f576:::benchmark_data_smithi188_104537_object122045:head# 2024-04-01T19:36:33.288 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.288 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d34ffc:::benchmark_data_smithi188_104537_object55924:head# 2024-04-01T19:36:33.288 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.288 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d419f0:::benchmark_data_smithi188_104537_object139535:head# 2024-04-01T19:36:33.289 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.289 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d4a7cf:::benchmark_data_smithi188_104537_object127816:head# 2024-04-01T19:36:33.289 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.289 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d5dc9a:::benchmark_data_smithi188_104537_object108575:head# 2024-04-01T19:36:33.289 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.289 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d60ef5:::benchmark_data_smithi188_104537_object46377:head# 2024-04-01T19:36:33.289 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.289 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d62849:::benchmark_data_smithi188_104537_object51157:head# 2024-04-01T19:36:33.289 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.289 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d64a79:::benchmark_data_smithi188_104537_object121228:head# 2024-04-01T19:36:33.289 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.292 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d69726:::benchmark_data_smithi188_104537_object49586:head# 2024-04-01T19:36:33.293 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.293 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d69bcc:::benchmark_data_smithi188_104537_object56102:head# 2024-04-01T19:36:33.293 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.293 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d6cdc5:::benchmark_data_smithi188_104537_object16885:head# 2024-04-01T19:36:33.293 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.293 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d7355c:::benchmark_data_smithi188_104537_object51519:head# 2024-04-01T19:36:33.293 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.293 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d8e81e:::benchmark_data_smithi188_104537_object161777:head# 2024-04-01T19:36:33.293 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.293 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d8f6fe:::benchmark_data_smithi188_104537_object49587:head# 2024-04-01T19:36:33.293 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.293 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51d9408f:::benchmark_data_smithi188_104537_object46542:head# 2024-04-01T19:36:33.293 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.294 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51da01d2:::benchmark_data_smithi188_104537_object32215:head# 2024-04-01T19:36:33.294 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.294 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51da5683:::benchmark_data_smithi188_104537_object85509:head# 2024-04-01T19:36:33.294 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.294 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51daae3e:::benchmark_data_smithi188_104537_object127156:head# 2024-04-01T19:36:33.294 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.294 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51daf7be:::benchmark_data_smithi188_104537_object162435:head# 2024-04-01T19:36:33.294 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.294 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51db2a3e:::benchmark_data_smithi188_104537_object14166:head# 2024-04-01T19:36:33.294 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.294 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51dbb12c:::benchmark_data_smithi188_104537_object65288:head# 2024-04-01T19:36:33.294 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.294 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51dbff34:::benchmark_data_smithi188_104537_object71761:head# 2024-04-01T19:36:33.295 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.295 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51dc0a17:::benchmark_data_smithi188_104537_object26093:head# 2024-04-01T19:36:33.295 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.295 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51dca719:::benchmark_data_smithi188_104537_object153276:head# 2024-04-01T19:36:33.295 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.295 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51de1f15:::benchmark_data_smithi188_104537_object152262:head# 2024-04-01T19:36:33.295 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.295 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51dfa340:::benchmark_data_smithi188_104537_object69345:head# 2024-04-01T19:36:33.295 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.295 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e0594e:::benchmark_data_smithi188_104537_object149821:head# 2024-04-01T19:36:33.295 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.295 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e05d5a:::benchmark_data_smithi188_104537_object53707:head# 2024-04-01T19:36:33.295 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.295 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e0844b:::benchmark_data_smithi188_104537_object160605:head# 2024-04-01T19:36:33.296 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.296 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e0b661:::benchmark_data_smithi188_104537_object51117:head# 2024-04-01T19:36:33.296 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.296 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e0d212:::benchmark_data_smithi188_104537_object40927:head# 2024-04-01T19:36:33.296 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.296 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e1b0be:::benchmark_data_smithi188_104537_object59347:head# 2024-04-01T19:36:33.296 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.296 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e1f688:::benchmark_data_smithi188_104537_object36566:head# 2024-04-01T19:36:33.296 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.296 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e23b89:::benchmark_data_smithi188_104537_object135390:head# 2024-04-01T19:36:33.296 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.296 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e29546:::benchmark_data_smithi188_104537_object59605:head# 2024-04-01T19:36:33.296 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.296 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e33920:::benchmark_data_smithi188_104537_object50639:head# 2024-04-01T19:36:33.297 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.297 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e38a72:::benchmark_data_smithi188_104537_object103533:head# 2024-04-01T19:36:33.297 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.298 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e3eac2:::benchmark_data_smithi188_104537_object49339:head# 2024-04-01T19:36:33.298 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.298 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e436c1:::benchmark_data_smithi188_104537_object100508:head# 2024-04-01T19:36:33.299 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.299 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e45d67:::benchmark_data_smithi188_104537_object47944:head# 2024-04-01T19:36:33.299 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.299 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e4b41b:::benchmark_data_smithi188_104537_object97923:head# 2024-04-01T19:36:33.299 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.299 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e4e401:::benchmark_data_smithi188_104537_object138499:head# 2024-04-01T19:36:33.299 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.299 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e4ed1a:::benchmark_data_smithi188_104537_object142343:head# 2024-04-01T19:36:33.299 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.299 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e5866e:::benchmark_data_smithi188_104537_object31843:head# 2024-04-01T19:36:33.299 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.299 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e58aff:::benchmark_data_smithi188_104537_object48814:head# 2024-04-01T19:36:33.299 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.299 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e60623:::benchmark_data_smithi188_104537_object59335:head# 2024-04-01T19:36:33.299 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.300 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e69625:::benchmark_data_smithi188_104537_object48441:head# 2024-04-01T19:36:33.300 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.300 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e73030:::benchmark_data_smithi188_104537_object167488:head# 2024-04-01T19:36:33.300 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.300 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e73d17:::benchmark_data_smithi188_104537_object85521:head# 2024-04-01T19:36:33.300 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.300 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e7795e:::benchmark_data_smithi188_104537_object45892:head# 2024-04-01T19:36:33.300 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.300 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e7c0c7:::benchmark_data_smithi188_104537_object48661:head# 2024-04-01T19:36:33.300 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.300 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e835f3:::benchmark_data_smithi188_104537_object134679:head# 2024-04-01T19:36:33.300 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.300 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e88e4d:::benchmark_data_smithi188_104537_object111551:head# 2024-04-01T19:36:33.300 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.300 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e8feef:::benchmark_data_smithi188_104537_object32503:head# 2024-04-01T19:36:33.300 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.301 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e9080b:::benchmark_data_smithi188_104537_object59949:head# 2024-04-01T19:36:33.301 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.301 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e941dd:::benchmark_data_smithi188_104537_object101784:head# 2024-04-01T19:36:33.301 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.301 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51e971d3:::benchmark_data_smithi188_104537_object128408:head# 2024-04-01T19:36:33.301 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.301 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51ea016b:::benchmark_data_smithi188_104537_object21143:head# 2024-04-01T19:36:33.301 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.301 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51eb824c:::benchmark_data_smithi188_104537_object92975:head# 2024-04-01T19:36:33.301 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.301 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51eb87f1:::benchmark_data_smithi188_104537_object65107:head# 2024-04-01T19:36:33.301 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.301 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51eb997d:::benchmark_data_smithi188_104537_object137691:head# 2024-04-01T19:36:33.301 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.302 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51ebcd9c:::benchmark_data_smithi188_104537_object22396:head# 2024-04-01T19:36:33.302 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.302 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51ecf633:::benchmark_data_smithi188_104537_object164279:head# 2024-04-01T19:36:33.302 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.304 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51ed196e:::benchmark_data_smithi188_104537_object129153:head# 2024-04-01T19:36:33.304 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.307 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51ed493a:::benchmark_data_smithi188_104537_object43432:head# 2024-04-01T19:36:33.307 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.309 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51edb2c9:::benchmark_data_smithi188_104537_object157639:head# 2024-04-01T19:36:33.310 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.310 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51edba84:::benchmark_data_smithi188_104537_object119768:head# 2024-04-01T19:36:33.310 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.310 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51ee7485:::benchmark_data_smithi188_104537_object134341:head# 2024-04-01T19:36:33.310 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.311 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51eec1ae:::benchmark_data_smithi188_104537_object109616:head# 2024-04-01T19:36:33.311 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.311 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51ef2604:::benchmark_data_smithi188_104537_object17484:head# 2024-04-01T19:36:33.311 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.311 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51efd11c:::benchmark_data_smithi188_104537_object28123:head# 2024-04-01T19:36:33.311 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.312 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f02a52:::benchmark_data_smithi188_104537_object79189:head# 2024-04-01T19:36:33.312 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.312 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f099db:::benchmark_data_smithi188_104537_object51565:head# 2024-04-01T19:36:33.312 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.313 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f0b3e6:::benchmark_data_smithi188_104537_object56917:head# 2024-04-01T19:36:33.313 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.313 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f0b3eb:::benchmark_data_smithi188_104537_object167803:head# 2024-04-01T19:36:33.313 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.314 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f1506e:::benchmark_data_smithi188_104537_object51144:head# 2024-04-01T19:36:33.314 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.320 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f1ed5b:::benchmark_data_smithi188_104537_object96852:head# 2024-04-01T19:36:33.320 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.321 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f28dc2:::benchmark_data_smithi188_104537_object143044:head# 2024-04-01T19:36:33.321 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.321 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f295a5:::benchmark_data_smithi188_104537_object54684:head# 2024-04-01T19:36:33.321 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.321 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f2e89e:::benchmark_data_smithi188_104537_object42825:head# 2024-04-01T19:36:33.321 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.321 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f3bd63:::benchmark_data_smithi188_104537_object108062:head# 2024-04-01T19:36:33.321 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.321 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f42063:::benchmark_data_smithi188_104537_object20540:head# 2024-04-01T19:36:33.321 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.321 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f4725d:::benchmark_data_smithi188_104537_object152500:head# 2024-04-01T19:36:33.321 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.321 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f4dfc2:::benchmark_data_smithi188_104537_object168671:head# 2024-04-01T19:36:33.321 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.322 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f5a04e:::benchmark_data_smithi188_104537_object113104:head# 2024-04-01T19:36:33.322 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.322 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f5d5a2:::benchmark_data_smithi188_104537_object56345:head# 2024-04-01T19:36:33.322 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.322 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f6a9d7:::benchmark_data_smithi188_104537_object77878:head# 2024-04-01T19:36:33.322 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.323 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f6be92:::benchmark_data_smithi188_104537_object98417:head# 2024-04-01T19:36:33.323 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.323 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f883ae:::benchmark_data_smithi188_104537_object69872:head# 2024-04-01T19:36:33.323 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.323 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f88a88:::benchmark_data_smithi188_104537_object63408:head# 2024-04-01T19:36:33.323 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.323 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f89693:::benchmark_data_smithi188_104537_object21322:head# 2024-04-01T19:36:33.323 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.324 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f91018:::benchmark_data_smithi188_104537_object116645:head# 2024-04-01T19:36:33.324 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.324 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f9929c:::benchmark_data_smithi188_104537_object115078:head# 2024-04-01T19:36:33.324 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.325 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f9b4ac:::benchmark_data_smithi188_104537_object138452:head# 2024-04-01T19:36:33.325 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.325 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f9b61b:::benchmark_data_smithi188_104537_object80491:head# 2024-04-01T19:36:33.325 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.325 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f9cf87:::benchmark_data_smithi188_104537_object54389:head# 2024-04-01T19:36:33.325 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.325 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51f9f538:::benchmark_data_smithi188_104537_object13842:head# 2024-04-01T19:36:33.325 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.326 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51fa4eae:::benchmark_data_smithi188_104537_object88864:head# 2024-04-01T19:36:33.326 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.326 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51fa8c85:::benchmark_data_smithi188_104537_object86698:head# 2024-04-01T19:36:33.326 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.326 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51fab183:::benchmark_data_smithi188_104537_object157881:head# 2024-04-01T19:36:33.326 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.327 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51fb7b45:::benchmark_data_smithi188_104537_object134207:head# 2024-04-01T19:36:33.327 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.327 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51fbbaa3:::benchmark_data_smithi188_104537_object132590:head# 2024-04-01T19:36:33.327 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.327 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51fc1437:::benchmark_data_smithi188_104537_object108644:head# 2024-04-01T19:36:33.327 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.327 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51fc71b8:::benchmark_data_smithi188_104537_object10977:head# 2024-04-01T19:36:33.327 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.327 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51fcd91f:::benchmark_data_smithi188_104537_object106449:head# 2024-04-01T19:36:33.327 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.327 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51fd1508:::benchmark_data_smithi188_104537_object142661:head# 2024-04-01T19:36:33.328 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.328 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51fd5e62:::benchmark_data_smithi188_104537_object48976:head# 2024-04-01T19:36:33.328 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.329 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51fd8f98:::benchmark_data_smithi188_104537_object120587:head# 2024-04-01T19:36:33.329 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.329 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51fd95ba:::benchmark_data_smithi188_104537_object113955:head# 2024-04-01T19:36:33.329 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.329 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51fde6a7:::benchmark_data_smithi188_104537_object144724:head# 2024-04-01T19:36:33.329 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.330 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51fe00a4:::benchmark_data_smithi188_104537_object12202:head# 2024-04-01T19:36:33.330 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.330 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51fe059d:::benchmark_data_smithi188_104537_object31094:head# 2024-04-01T19:36:33.330 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.330 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51fe3486:::benchmark_data_smithi188_104537_object149622:head# 2024-04-01T19:36:33.330 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.330 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51fe6527:::benchmark_data_smithi188_104537_object136794:head# 2024-04-01T19:36:33.330 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.330 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:51fe6549:::benchmark_data_smithi188_104537_object98601:head# 2024-04-01T19:36:33.330 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.331 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52006898:::benchmark_data_smithi188_104537_object119664:head# 2024-04-01T19:36:33.331 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.331 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52009539:::benchmark_data_smithi188_104537_object89519:head# 2024-04-01T19:36:33.331 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.331 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5200a8e3:::benchmark_data_smithi188_104537_object158489:head# 2024-04-01T19:36:33.332 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.332 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5202b693:::benchmark_data_smithi188_104537_object15829:head# 2024-04-01T19:36:33.332 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.332 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5202edc5:::benchmark_data_smithi188_104537_object23369:head# 2024-04-01T19:36:33.332 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.332 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5203adf1:::benchmark_data_smithi188_104537_object142628:head# 2024-04-01T19:36:33.332 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.332 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5203fffa:::benchmark_data_smithi188_104537_object82419:head# 2024-04-01T19:36:33.332 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.333 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:520435bb:::benchmark_data_smithi188_104537_object137732:head# 2024-04-01T19:36:33.333 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.333 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5205815b:::benchmark_data_smithi188_104537_object144865:head# 2024-04-01T19:36:33.333 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.333 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5205aa66:::benchmark_data_smithi188_104537_object53584:head# 2024-04-01T19:36:33.333 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.333 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52065f65:::benchmark_data_smithi188_104537_object31657:head# 2024-04-01T19:36:33.333 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.333 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5207ad25:::benchmark_data_smithi188_104537_object84744:head# 2024-04-01T19:36:33.334 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.334 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5208397c:::benchmark_data_smithi188_104537_object123200:head# 2024-04-01T19:36:33.334 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.335 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5208417d:::benchmark_data_smithi188_104537_object150311:head# 2024-04-01T19:36:33.335 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.335 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52084fd7:::benchmark_data_smithi188_104537_object25458:head# 2024-04-01T19:36:33.335 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.335 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5208c289:::benchmark_data_smithi188_104537_object70122:head# 2024-04-01T19:36:33.335 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.335 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5208c693:::benchmark_data_smithi188_104537_object48051:head# 2024-04-01T19:36:33.335 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.335 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5208f30f:::benchmark_data_smithi188_104537_object45563:head# 2024-04-01T19:36:33.335 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.335 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:520a12de:::benchmark_data_smithi188_104537_object35551:head# 2024-04-01T19:36:33.335 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.336 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:520a48a9:::benchmark_data_smithi188_104537_object50104:head# 2024-04-01T19:36:33.336 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.336 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:520a6d64:::benchmark_data_smithi188_104537_object142016:head# 2024-04-01T19:36:33.337 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.337 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:520ae7e9:::benchmark_data_smithi188_104537_object23805:head# 2024-04-01T19:36:33.337 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.337 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:520b1811:::benchmark_data_smithi188_104537_object26668:head# 2024-04-01T19:36:33.337 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.337 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:520b4276:::benchmark_data_smithi188_104537_object61591:head# 2024-04-01T19:36:33.337 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.337 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:520b7b70:::benchmark_data_smithi188_104537_object96990:head# 2024-04-01T19:36:33.337 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.337 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:520b9a13:::benchmark_data_smithi188_104537_object25105:head# 2024-04-01T19:36:33.337 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.337 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:520baa90:::benchmark_data_smithi188_104537_object23395:head# 2024-04-01T19:36:33.337 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.340 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:520bc13f:::benchmark_data_smithi188_104537_object116829:head# 2024-04-01T19:36:33.340 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.340 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:520bd27b:::benchmark_data_smithi188_104537_object42601:head# 2024-04-01T19:36:33.340 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.340 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:520c396a:::benchmark_data_smithi188_104537_object64897:head# 2024-04-01T19:36:33.340 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.340 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:520cd9b3:::benchmark_data_smithi188_104537_object140524:head# 2024-04-01T19:36:33.340 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.340 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:520d3ca3:::benchmark_data_smithi188_104537_object157077:head# 2024-04-01T19:36:33.340 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.340 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:520d4ca0:::benchmark_data_smithi188_104537_object168706:head# 2024-04-01T19:36:33.340 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.340 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:520e8d23:::benchmark_data_smithi188_104537_object46211:head# 2024-04-01T19:36:33.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:520ea805:::benchmark_data_smithi188_104537_object132952:head# 2024-04-01T19:36:33.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:520ed993:::benchmark_data_smithi188_104537_object102959:head# 2024-04-01T19:36:33.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:520edcf6:::benchmark_data_smithi188_104537_object82246:head# 2024-04-01T19:36:33.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:520ee67e:::benchmark_data_smithi188_104537_object19554:head# 2024-04-01T19:36:33.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5210377e:::benchmark_data_smithi188_104537_object154385:head# 2024-04-01T19:36:33.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.342 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52106c1d:::benchmark_data_smithi188_104537_object170851:head# 2024-04-01T19:36:33.342 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.342 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5210ff91:::benchmark_data_smithi188_104537_object99443:head# 2024-04-01T19:36:33.342 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.342 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52113d77:::benchmark_data_smithi188_104537_object170598:head# 2024-04-01T19:36:33.342 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.343 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5211667e:::benchmark_data_smithi188_104537_object64905:head# 2024-04-01T19:36:33.343 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.345 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5211db3e:::benchmark_data_smithi188_104537_object31919:head# 2024-04-01T19:36:33.345 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.346 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52122314:::benchmark_data_smithi188_104537_object171342:head# 2024-04-01T19:36:33.346 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.346 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52126192:::benchmark_data_smithi188_104537_object138128:head# 2024-04-01T19:36:33.346 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.347 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52126d2f:::benchmark_data_smithi188_104537_object28493:head# 2024-04-01T19:36:33.347 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.347 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52127fc6:::benchmark_data_smithi188_104537_object114602:head# 2024-04-01T19:36:33.347 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.347 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52135d10:::benchmark_data_smithi188_104537_object124943:head# 2024-04-01T19:36:33.347 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.348 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5213ae4d:::benchmark_data_smithi188_104537_object39421:head# 2024-04-01T19:36:33.348 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.349 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52151047:::benchmark_data_smithi188_104537_object92789:head# 2024-04-01T19:36:33.349 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.349 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52156f43:::benchmark_data_smithi188_104537_object125531:head# 2024-04-01T19:36:33.349 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.349 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:521570f4:::benchmark_data_smithi188_104537_object147236:head# 2024-04-01T19:36:33.349 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.349 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5215aa0b:::benchmark_data_smithi188_104537_object154183:head# 2024-04-01T19:36:33.349 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.349 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5215f203:::benchmark_data_smithi188_104537_object167814:head# 2024-04-01T19:36:33.349 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.349 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52176fb0:::benchmark_data_smithi188_104537_object19467:head# 2024-04-01T19:36:33.349 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.350 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5217f1d1:::benchmark_data_smithi188_104537_object83705:head# 2024-04-01T19:36:33.350 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.350 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5217f76a:::benchmark_data_smithi188_104537_object92823:head# 2024-04-01T19:36:33.350 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.350 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:521a86eb:::benchmark_data_smithi188_104537_object115197:head# 2024-04-01T19:36:33.351 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.351 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:521ab0c4:::benchmark_data_smithi188_104537_object39285:head# 2024-04-01T19:36:33.351 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.351 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:521ac697:::benchmark_data_smithi188_104537_object94272:head# 2024-04-01T19:36:33.351 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.352 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:521b7f51:::benchmark_data_smithi188_104537_object51642:head# 2024-04-01T19:36:33.352 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.352 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:521bf9b8:::benchmark_data_smithi188_104537_object160316:head# 2024-04-01T19:36:33.352 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.352 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:521c122a:::benchmark_data_smithi188_104537_object93269:head# 2024-04-01T19:36:33.352 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.352 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:521c5ee4:::benchmark_data_smithi188_104537_object165847:head# 2024-04-01T19:36:33.352 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.352 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:521d1417:::benchmark_data_smithi188_104537_object160981:head# 2024-04-01T19:36:33.352 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.353 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:521d39fd:::benchmark_data_smithi188_104537_object44018:head# 2024-04-01T19:36:33.353 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.353 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:521ddb0c:::benchmark_data_smithi188_104537_object20589:head# 2024-04-01T19:36:33.353 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.354 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:521e1935:::benchmark_data_smithi188_104537_object41173:head# 2024-04-01T19:36:33.354 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.354 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:521e8d95:::benchmark_data_smithi188_104537_object68963:head# 2024-04-01T19:36:33.354 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.354 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:521ea1bc:::benchmark_data_smithi188_104537_object133901:head# 2024-04-01T19:36:33.354 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.354 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:521ebb12:::benchmark_data_smithi188_104537_object35410:head# 2024-04-01T19:36:33.354 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.354 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:521f7a38:::benchmark_data_smithi188_104537_object125711:head# 2024-04-01T19:36:33.354 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.357 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:521f7c97:::benchmark_data_smithi188_104537_object137131:head# 2024-04-01T19:36:33.357 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.357 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52205a0f:::benchmark_data_smithi188_104537_object94518:head# 2024-04-01T19:36:33.357 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.357 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52206349:::benchmark_data_smithi188_104537_object18147:head# 2024-04-01T19:36:33.357 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.358 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52206982:::benchmark_data_smithi188_104537_object92273:head# 2024-04-01T19:36:33.358 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.358 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5221457e:::benchmark_data_smithi188_104537_object133939:head# 2024-04-01T19:36:33.358 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.358 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52215d37:::benchmark_data_smithi188_104537_object171357:head# 2024-04-01T19:36:33.358 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.359 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52222747:::benchmark_data_smithi188_104537_object151159:head# 2024-04-01T19:36:33.359 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.359 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5222e140:::benchmark_data_smithi188_104537_object157726:head# 2024-04-01T19:36:33.359 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.360 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52230f65:::benchmark_data_smithi188_104537_object106739:head# 2024-04-01T19:36:33.360 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.360 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5223614b:::benchmark_data_smithi188_104537_object92376:head# 2024-04-01T19:36:33.360 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.360 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5224e8c9:::benchmark_data_smithi188_104537_object55059:head# 2024-04-01T19:36:33.360 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.361 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5224fec0:::benchmark_data_smithi188_104537_object67578:head# 2024-04-01T19:36:33.361 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.361 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5225a941:::benchmark_data_smithi188_104537_object73623:head# 2024-04-01T19:36:33.361 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.361 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5225b43b:::benchmark_data_smithi188_104537_object132681:head# 2024-04-01T19:36:33.361 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.361 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:522608f8:::benchmark_data_smithi188_104537_object160639:head# 2024-04-01T19:36:33.361 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.362 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5226f944:::benchmark_data_smithi188_104537_object92830:head# 2024-04-01T19:36:33.362 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.362 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52282690:::benchmark_data_smithi188_104537_object103660:head# 2024-04-01T19:36:33.362 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.362 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52284daa:::benchmark_data_smithi188_104537_object49456:head# 2024-04-01T19:36:33.362 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.362 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5228a822:::benchmark_data_smithi188_104537_object137271:head# 2024-04-01T19:36:33.362 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.362 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5229b708:::benchmark_data_smithi188_104537_object153969:head# 2024-04-01T19:36:33.362 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.364 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5229dc94:::benchmark_data_smithi188_104537_object160603:head# 2024-04-01T19:36:33.364 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.364 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:522a32ae:::benchmark_data_smithi188_104537_object40587:head# 2024-04-01T19:36:33.364 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.364 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:522a4465:::benchmark_data_smithi188_104537_object55940:head# 2024-04-01T19:36:33.364 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.364 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:522aab36:::benchmark_data_smithi188_104537_object86402:head# 2024-04-01T19:36:33.364 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.364 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:522b3b34:::benchmark_data_smithi188_104537_object152224:head# 2024-04-01T19:36:33.364 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.364 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:522c496b:::benchmark_data_smithi188_104537_object67006:head# 2024-04-01T19:36:33.364 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.365 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:522d0da8:::benchmark_data_smithi188_104537_object144564:head# 2024-04-01T19:36:33.365 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.365 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:522d1567:::benchmark_data_smithi188_104537_object75840:head# 2024-04-01T19:36:33.365 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.365 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:522eaddb:::benchmark_data_smithi188_104537_object71172:head# 2024-04-01T19:36:33.365 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.368 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:522f4952:::benchmark_data_smithi188_104537_object95751:head# 2024-04-01T19:36:33.368 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.368 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:522f9bac:::benchmark_data_smithi188_104537_object58549:head# 2024-04-01T19:36:33.368 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.368 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:522faf8e:::benchmark_data_smithi188_104537_object163214:head# 2024-04-01T19:36:33.368 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.368 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52311f37:::benchmark_data_smithi188_104537_object42672:head# 2024-04-01T19:36:33.368 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.369 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:523129e3:::benchmark_data_smithi188_104537_object65185:head# 2024-04-01T19:36:33.369 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.370 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5231e8d9:::benchmark_data_smithi188_104537_object146492:head# 2024-04-01T19:36:33.370 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.370 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52323f1d:::benchmark_data_smithi188_104537_object146281:head# 2024-04-01T19:36:33.370 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.370 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5232638b:::benchmark_data_smithi188_104537_object118975:head# 2024-04-01T19:36:33.370 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.370 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5232f3f2:::benchmark_data_smithi188_104537_object157290:head# 2024-04-01T19:36:33.370 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.370 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52335620:::benchmark_data_smithi188_104537_object131562:head# 2024-04-01T19:36:33.370 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.371 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5233969e:::benchmark_data_smithi188_104537_object141330:head# 2024-04-01T19:36:33.371 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.371 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5233d57e:::benchmark_data_smithi188_104537_object136280:head# 2024-04-01T19:36:33.371 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.372 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5233f45c:::benchmark_data_smithi188_104537_object81843:head# 2024-04-01T19:36:33.372 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.372 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5234fcbc:::benchmark_data_smithi188_104537_object31466:head# 2024-04-01T19:36:33.372 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.372 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52353530:::benchmark_data_smithi188_104537_object112583:head# 2024-04-01T19:36:33.372 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.372 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5235b7dd:::benchmark_data_smithi188_104537_object171450:head# 2024-04-01T19:36:33.372 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.372 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5236707e:::benchmark_data_smithi188_104537_object166649:head# 2024-04-01T19:36:33.372 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.372 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5236e938:::benchmark_data_smithi188_104537_object103100:head# 2024-04-01T19:36:33.372 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.373 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5236f2ee:::benchmark_data_smithi188_104537_object50257:head# 2024-04-01T19:36:33.374 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.374 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5237e64c:::benchmark_data_smithi188_104537_object100243:head# 2024-04-01T19:36:33.374 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.374 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5238c2ca:::benchmark_data_smithi188_104537_object163415:head# 2024-04-01T19:36:33.374 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.374 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5238d3bd:::benchmark_data_smithi188_104537_object87990:head# 2024-04-01T19:36:33.374 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.374 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5239545d:::benchmark_data_smithi188_104537_object142660:head# 2024-04-01T19:36:33.374 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.374 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5239c57e:::benchmark_data_smithi188_104537_object44194:head# 2024-04-01T19:36:33.374 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.378 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:523a0407:::benchmark_data_smithi188_104537_object28181:head# 2024-04-01T19:36:33.378 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.379 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:523a524c:::benchmark_data_smithi188_104537_object136795:head# 2024-04-01T19:36:33.379 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.379 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:523a88bb:::benchmark_data_smithi188_104537_object11296:head# 2024-04-01T19:36:33.379 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.380 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:523bcdc7:::benchmark_data_smithi188_104537_object44399:head# 2024-04-01T19:36:33.380 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.380 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:523c8e2b:::benchmark_data_smithi188_104537_object81437:head# 2024-04-01T19:36:33.380 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.382 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:523db9da:::benchmark_data_smithi188_104537_object13093:head# 2024-04-01T19:36:33.382 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.382 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:523e1f2e:::benchmark_data_smithi188_104537_object21595:head# 2024-04-01T19:36:33.382 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.383 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:523e3d86:::benchmark_data_smithi188_104537_object135315:head# 2024-04-01T19:36:33.383 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.383 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:523e40f9:::benchmark_data_smithi188_104537_object114868:head# 2024-04-01T19:36:33.383 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.383 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:523eae33:::benchmark_data_smithi188_104537_object54256:head# 2024-04-01T19:36:33.383 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.383 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:523ff693:::benchmark_data_smithi188_104537_object48333:head# 2024-04-01T19:36:33.383 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.388 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:524056fc:::benchmark_data_smithi188_104537_object95763:head# 2024-04-01T19:36:33.388 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.388 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:524063d1:::benchmark_data_smithi188_104537_object41717:head# 2024-04-01T19:36:33.388 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.388 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52412fa3:::benchmark_data_smithi188_104537_object45377:head# 2024-04-01T19:36:33.389 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.389 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:524182f2:::benchmark_data_smithi188_104537_object71433:head# 2024-04-01T19:36:33.389 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.390 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52420e9c:::benchmark_data_smithi188_104537_object112825:head# 2024-04-01T19:36:33.390 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.391 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52426293:::benchmark_data_smithi188_104537_object72831:head# 2024-04-01T19:36:33.391 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.391 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5242705b:::benchmark_data_smithi188_104537_object104650:head# 2024-04-01T19:36:33.391 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.392 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5242bac8:::benchmark_data_smithi188_104537_object139927:head# 2024-04-01T19:36:33.392 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.392 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5243ff52:::benchmark_data_smithi188_104537_object99289:head# 2024-04-01T19:36:33.392 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.392 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:524487d2:::benchmark_data_smithi188_104537_object62746:head# 2024-04-01T19:36:33.392 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.393 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5244b2db:::benchmark_data_smithi188_104537_object17036:head# 2024-04-01T19:36:33.393 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.393 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52451ae7:::benchmark_data_smithi188_104537_object13722:head# 2024-04-01T19:36:33.393 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.393 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52457e35:::benchmark_data_smithi188_104537_object127906:head# 2024-04-01T19:36:33.393 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.393 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52457eb3:::benchmark_data_smithi188_104537_object22402:head# 2024-04-01T19:36:33.394 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.394 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5245da23:::benchmark_data_smithi188_104537_object152723:head# 2024-04-01T19:36:33.394 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.394 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52460f27:::benchmark_data_smithi188_104537_object62762:head# 2024-04-01T19:36:33.394 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.395 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52463894:::benchmark_data_smithi188_104537_object25312:head# 2024-04-01T19:36:33.395 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.395 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:524695a4:::benchmark_data_smithi188_104537_object23066:head# 2024-04-01T19:36:33.395 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.395 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52476feb:::benchmark_data_smithi188_104537_object57189:head# 2024-04-01T19:36:33.395 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.395 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5247a231:::benchmark_data_smithi188_104537_object82981:head# 2024-04-01T19:36:33.395 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.396 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5247af72:::benchmark_data_smithi188_104537_object143155:head# 2024-04-01T19:36:33.396 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.396 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52482024:::benchmark_data_smithi188_104537_object68172:head# 2024-04-01T19:36:33.396 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.396 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5248e862:::benchmark_data_smithi188_104537_object79245:head# 2024-04-01T19:36:33.397 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.397 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5249529f:::benchmark_data_smithi188_104537_object65321:head# 2024-04-01T19:36:33.397 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.397 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:524ab582:::benchmark_data_smithi188_104537_object130990:head# 2024-04-01T19:36:33.397 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.397 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:524af767:::benchmark_data_smithi188_104537_object118701:head# 2024-04-01T19:36:33.398 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.398 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:524afaf8:::benchmark_data_smithi188_104537_object114082:head# 2024-04-01T19:36:33.398 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.398 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:524b3301:::benchmark_data_smithi188_104537_object164533:head# 2024-04-01T19:36:33.398 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.398 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:524be726:::benchmark_data_smithi188_104537_object49530:head# 2024-04-01T19:36:33.398 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.399 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:524c2a37:::benchmark_data_smithi188_104537_object138658:head# 2024-04-01T19:36:33.399 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.399 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:524c3bcf:::benchmark_data_smithi188_104537_object36100:head# 2024-04-01T19:36:33.399 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.399 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:524c512e:::benchmark_data_smithi188_104537_object29331:head# 2024-04-01T19:36:33.399 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.399 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:524d63b5:::benchmark_data_smithi188_104537_object147618:head# 2024-04-01T19:36:33.399 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.399 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:524de911:::benchmark_data_smithi188_104537_object34637:head# 2024-04-01T19:36:33.399 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.400 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:524e82ef:::benchmark_data_smithi188_104537_object70386:head# 2024-04-01T19:36:33.400 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.400 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:524eac49:::benchmark_data_smithi188_104537_object56715:head# 2024-04-01T19:36:33.400 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.403 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:524ec268:::benchmark_data_smithi188_104537_object164523:head# 2024-04-01T19:36:33.403 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.403 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:524eed69:::benchmark_data_smithi188_104537_object88094:head# 2024-04-01T19:36:33.403 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.403 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:524fad79:::benchmark_data_smithi188_104537_object88191:head# 2024-04-01T19:36:33.403 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.403 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:524fed3a:::benchmark_data_smithi188_104537_object33354:head# 2024-04-01T19:36:33.404 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.404 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5250fc81:::benchmark_data_smithi188_104537_object94067:head# 2024-04-01T19:36:33.404 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.404 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52513ba3:::benchmark_data_smithi188_104537_object117049:head# 2024-04-01T19:36:33.404 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.404 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52515efb:::benchmark_data_smithi188_104537_object166298:head# 2024-04-01T19:36:33.404 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.404 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52523abe:::benchmark_data_smithi188_104537_object126108:head# 2024-04-01T19:36:33.404 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.404 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52527e88:::benchmark_data_smithi188_104537_object88699:head# 2024-04-01T19:36:33.404 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.404 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5252adfb:::benchmark_data_smithi188_104537_object122597:head# 2024-04-01T19:36:33.404 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.405 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5252c6a8:::benchmark_data_smithi188_104537_object99065:head# 2024-04-01T19:36:33.405 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.405 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5252d1ec:::benchmark_data_smithi188_104537_object52728:head# 2024-04-01T19:36:33.405 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.406 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5253030a:::benchmark_data_smithi188_104537_object170759:head# 2024-04-01T19:36:33.406 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.406 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52530ce5:::benchmark_data_smithi188_104537_object12725:head# 2024-04-01T19:36:33.406 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.406 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52531a7b:::benchmark_data_smithi188_104537_object47385:head# 2024-04-01T19:36:33.406 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.406 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:525351ab:::benchmark_data_smithi188_104537_object116089:head# 2024-04-01T19:36:33.406 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.407 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5253540a:::benchmark_data_smithi188_104537_object81375:head# 2024-04-01T19:36:33.407 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.407 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:525374a5:::benchmark_data_smithi188_104537_object162836:head# 2024-04-01T19:36:33.407 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.407 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5253e523:::benchmark_data_smithi188_104537_object28689:head# 2024-04-01T19:36:33.408 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.408 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52549b7d:::benchmark_data_smithi188_104537_object106579:head# 2024-04-01T19:36:33.408 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.408 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52552495:::benchmark_data_smithi188_104537_object22972:head# 2024-04-01T19:36:33.408 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.408 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:525604be:::benchmark_data_smithi188_104537_object154755:head# 2024-04-01T19:36:33.408 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.409 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52568323:::benchmark_data_smithi188_104537_object119576:head# 2024-04-01T19:36:33.409 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.409 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52572953:::benchmark_data_smithi188_104537_object144167:head# 2024-04-01T19:36:33.409 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.409 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52578d78:::benchmark_data_smithi188_104537_object26907:head# 2024-04-01T19:36:33.409 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.409 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:525798b7:::benchmark_data_smithi188_104537_object171464:head# 2024-04-01T19:36:33.409 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.409 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5257b305:::benchmark_data_smithi188_104537_object32059:head# 2024-04-01T19:36:33.409 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.410 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5258b9e7:::benchmark_data_smithi188_104537_object160065:head# 2024-04-01T19:36:33.410 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.414 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5258ecc0:::benchmark_data_smithi188_104537_object19062:head# 2024-04-01T19:36:33.414 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.414 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52591a38:::benchmark_data_smithi188_104537_object67591:head# 2024-04-01T19:36:33.414 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.415 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52597fa8:::benchmark_data_smithi188_104537_object55898:head# 2024-04-01T19:36:33.415 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.415 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:525a35f1:::benchmark_data_smithi188_104537_object73159:head# 2024-04-01T19:36:33.415 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.415 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:525a706a:::benchmark_data_smithi188_104537_object124293:head# 2024-04-01T19:36:33.415 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.415 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:525b7b3f:::benchmark_data_smithi188_104537_object118418:head# 2024-04-01T19:36:33.415 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.415 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:525c2da0:::benchmark_data_smithi188_104537_object119177:head# 2024-04-01T19:36:33.415 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.416 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_blocked_ops 2024-04-01T19:36:33.417 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:525c900c:::benchmark_data_smithi188_104537_object19506:head# 2024-04-01T19:36:33.417 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.417 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:525ca761:::benchmark_data_smithi188_104537_object20176:head# 2024-04-01T19:36:33.417 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.419 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:525cbded:::benchmark_data_smithi188_104537_object150594:head# 2024-04-01T19:36:33.419 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.419 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:525d86d9:::benchmark_data_smithi188_104537_object128497:head# 2024-04-01T19:36:33.419 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.419 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:525d89dc:::benchmark_data_smithi188_104537_object26407:head# 2024-04-01T19:36:33.419 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.420 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:525e755e:::benchmark_data_smithi188_104537_object46961:head# 2024-04-01T19:36:33.420 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.421 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:525eaf92:::benchmark_data_smithi188_104537_object64247:head# 2024-04-01T19:36:33.421 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.421 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:525f0ee5:::benchmark_data_smithi188_104537_object43426:head# 2024-04-01T19:36:33.422 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.422 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:525f5eeb:::benchmark_data_smithi188_104537_object140681:head# 2024-04-01T19:36:33.422 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.422 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:526010da:::benchmark_data_smithi188_104537_object138911:head# 2024-04-01T19:36:33.422 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.422 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52604fb8:::benchmark_data_smithi188_104537_object25257:head# 2024-04-01T19:36:33.422 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.422 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5261805e:::benchmark_data_smithi188_104537_object134279:head# 2024-04-01T19:36:33.422 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.422 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52619e51:::benchmark_data_smithi188_104537_object121440:head# 2024-04-01T19:36:33.422 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.422 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5261aaaf:::benchmark_data_smithi188_104537_object131145:head# 2024-04-01T19:36:33.422 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.423 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52629db0:::benchmark_data_smithi188_104537_object40748:head# 2024-04-01T19:36:33.423 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.423 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5262a859:::benchmark_data_smithi188_104537_object34973:head# 2024-04-01T19:36:33.423 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.424 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52630794:::benchmark_data_smithi188_104537_object31099:head# 2024-04-01T19:36:33.424 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.424 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52635270:::benchmark_data_smithi188_104537_object138268:head# 2024-04-01T19:36:33.424 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.424 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52636a4e:::benchmark_data_smithi188_104537_object49807:head# 2024-04-01T19:36:33.424 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.424 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52644d86:::benchmark_data_smithi188_104537_object50538:head# 2024-04-01T19:36:33.424 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.425 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52665a06:::benchmark_data_smithi188_104537_object59242:head# 2024-04-01T19:36:33.425 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.425 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5266e332:::benchmark_data_smithi188_104537_object169995:head# 2024-04-01T19:36:33.425 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.425 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5268318e:::benchmark_data_smithi188_104537_object100168:head# 2024-04-01T19:36:33.425 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.425 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5268a57c:::benchmark_data_smithi188_104537_object129789:head# 2024-04-01T19:36:33.426 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.426 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5269aede:::benchmark_data_smithi188_104537_object88780:head# 2024-04-01T19:36:33.426 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.426 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5269c2b3:::benchmark_data_smithi188_104537_object96324:head# 2024-04-01T19:36:33.426 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.426 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:526a2ffd:::benchmark_data_smithi188_104537_object19023:head# 2024-04-01T19:36:33.427 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.427 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:526a8782:::benchmark_data_smithi188_104537_object121807:head# 2024-04-01T19:36:33.427 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.427 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:526a9e67:::benchmark_data_smithi188_104537_object28625:head# 2024-04-01T19:36:33.427 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.427 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:36:33.427 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:526adf16:::benchmark_data_smithi188_104537_object99120:head# 2024-04-01T19:36:33.427 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.433 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:526b7484:::benchmark_data_smithi188_104537_object138961:head# 2024-04-01T19:36:33.433 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.433 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:526bde72:::benchmark_data_smithi188_104537_object128038:head# 2024-04-01T19:36:33.433 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.433 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:526bf30e:::benchmark_data_smithi188_104537_object131417:head# 2024-04-01T19:36:33.433 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.433 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:526c9d2d:::benchmark_data_smithi188_104537_object168323:head# 2024-04-01T19:36:33.433 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.433 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:526ca0bd:::benchmark_data_smithi188_104537_object168030:head# 2024-04-01T19:36:33.433 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.433 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:526cd5eb:::benchmark_data_smithi188_104537_object154113:head# 2024-04-01T19:36:33.433 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.434 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:526d4578:::benchmark_data_smithi188_104537_object18710:head# 2024-04-01T19:36:33.434 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.434 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:33.435 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:526dc56b:::benchmark_data_smithi188_104537_object65480:head# 2024-04-01T19:36:33.435 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.435 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:526e8d92:::benchmark_data_smithi188_104537_object11172:head# 2024-04-01T19:36:33.435 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.435 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:526f250d:::benchmark_data_smithi188_104537_object115653:head# 2024-04-01T19:36:33.435 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.435 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:526f4b00:::benchmark_data_smithi188_104537_object73117:head# 2024-04-01T19:36:33.435 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.435 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:526f71c2:::benchmark_data_smithi188_104537_object94324:head# 2024-04-01T19:36:33.435 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.435 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:526fc9eb:::benchmark_data_smithi188_104537_object116827:head# 2024-04-01T19:36:33.435 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.436 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:36:33.436 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52711cc3:::benchmark_data_smithi188_104537_object97963:head# 2024-04-01T19:36:33.437 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.437 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52718e80:::benchmark_data_smithi188_104537_object164843:head# 2024-04-01T19:36:33.437 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.437 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5272770a:::benchmark_data_smithi188_104537_object77811:head# 2024-04-01T19:36:33.437 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.437 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5272840f:::benchmark_data_smithi188_104537_object75744:head# 2024-04-01T19:36:33.437 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.439 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:527381e2:::benchmark_data_smithi188_104537_object44305:head# 2024-04-01T19:36:33.439 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.439 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5273995b:::benchmark_data_smithi188_104537_object135789:head# 2024-04-01T19:36:33.439 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.439 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5273ad75:::benchmark_data_smithi188_104537_object75568:head# 2024-04-01T19:36:33.439 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.439 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5273da6a:::benchmark_data_smithi188_104537_object149771:head# 2024-04-01T19:36:33.439 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.439 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52743f88:::benchmark_data_smithi188_104537_object73837:head# 2024-04-01T19:36:33.439 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.439 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52751ddd:::benchmark_data_smithi188_104537_object104428:head# 2024-04-01T19:36:33.439 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.439 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52754c28:::benchmark_data_smithi188_104537_object165929:head# 2024-04-01T19:36:33.439 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.440 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52762a05:::benchmark_data_smithi188_104537_object115004:head# 2024-04-01T19:36:33.440 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.440 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52766524:::benchmark_data_smithi188_104537_object78152:head# 2024-04-01T19:36:33.440 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.441 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:527669a6:::benchmark_data_smithi188_104537_object146817:head# 2024-04-01T19:36:33.441 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.442 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52767a87:::benchmark_data_smithi188_104537_object161270:head# 2024-04-01T19:36:33.442 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.442 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:527695de:::benchmark_data_smithi188_104537_object58556:head# 2024-04-01T19:36:33.442 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.442 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5276c0e9:::benchmark_data_smithi188_104537_object109434:head# 2024-04-01T19:36:33.442 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.442 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5276d713:::benchmark_data_smithi188_104537_object129872:head# 2024-04-01T19:36:33.442 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.448 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52773d5f:::benchmark_data_smithi188_104537_object44539:head# 2024-04-01T19:36:33.448 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.448 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52779c33:::benchmark_data_smithi188_104537_object37748:head# 2024-04-01T19:36:33.449 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.449 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52779d06:::benchmark_data_smithi188_104537_object12434:head# 2024-04-01T19:36:33.449 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.449 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52781858:::benchmark_data_smithi188_104537_object139172:head# 2024-04-01T19:36:33.449 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.449 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5278e1cb:::benchmark_data_smithi188_104537_object93456:head# 2024-04-01T19:36:33.449 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.449 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5279004e:::benchmark_data_smithi188_104537_object91880:head# 2024-04-01T19:36:33.449 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.449 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5279127d:::benchmark_data_smithi188_104537_object171537:head# 2024-04-01T19:36:33.450 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.450 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52791dff:::benchmark_data_smithi188_104537_object96873:head# 2024-04-01T19:36:33.450 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.450 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52794b73:::benchmark_data_smithi188_104537_object34042:head# 2024-04-01T19:36:33.450 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.450 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52796104:::benchmark_data_smithi188_104537_object19384:head# 2024-04-01T19:36:33.450 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.450 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5279aeb7:::benchmark_data_smithi188_104537_object62236:head# 2024-04-01T19:36:33.450 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.450 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:527a16e5:::benchmark_data_smithi188_104537_object62112:head# 2024-04-01T19:36:33.450 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.450 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:527bb51a:::benchmark_data_smithi188_104537_object32792:head# 2024-04-01T19:36:33.451 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.452 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:527ce1f9:::benchmark_data_smithi188_104537_object89094:head# 2024-04-01T19:36:33.452 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.452 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:527d4515:::benchmark_data_smithi188_104537_object121611:head# 2024-04-01T19:36:33.452 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.452 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:527d4843:::benchmark_data_smithi188_104537_object77942:head# 2024-04-01T19:36:33.452 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.452 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:527d5b3d:::benchmark_data_smithi188_104537_object45405:head# 2024-04-01T19:36:33.452 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.452 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:527e0b44:::benchmark_data_smithi188_104537_object70377:head# 2024-04-01T19:36:33.452 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.453 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:527e0c70:::benchmark_data_smithi188_104537_object54511:head# 2024-04-01T19:36:33.453 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.453 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:527e43d9:::benchmark_data_smithi188_104537_object169406:head# 2024-04-01T19:36:33.453 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.453 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:527ea103:::benchmark_data_smithi188_104537_object134696:head# 2024-04-01T19:36:33.453 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.453 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:527ef244:::benchmark_data_smithi188_104537_object155235:head# 2024-04-01T19:36:33.453 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.453 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:527f765c:::benchmark_data_smithi188_104537_object142808:head# 2024-04-01T19:36:33.453 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.453 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52817815:::benchmark_data_smithi188_104537_object35382:head# 2024-04-01T19:36:33.454 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.454 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:528180c7:::benchmark_data_smithi188_104537_object52809:head# 2024-04-01T19:36:33.454 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.454 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52831466:::benchmark_data_smithi188_104537_object16763:head# 2024-04-01T19:36:33.454 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.454 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5283d56d:::benchmark_data_smithi188_104537_object118796:head# 2024-04-01T19:36:33.454 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.457 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5283f636:::benchmark_data_smithi188_104537_object23142:head# 2024-04-01T19:36:33.458 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.458 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52854239:::benchmark_data_smithi188_104537_object31551:head# 2024-04-01T19:36:33.458 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.458 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52854e85:::benchmark_data_smithi188_104537_object66147:head# 2024-04-01T19:36:33.458 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.458 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52859e8e:::benchmark_data_smithi188_104537_object143267:head# 2024-04-01T19:36:33.458 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.458 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5285c675:::benchmark_data_smithi188_104537_object112089:head# 2024-04-01T19:36:33.458 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.458 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52862b32:::benchmark_data_smithi188_104537_object110092:head# 2024-04-01T19:36:33.458 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.458 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5286766d:::benchmark_data_smithi188_104537_object168709:head# 2024-04-01T19:36:33.459 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.459 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5286c7f4:::benchmark_data_smithi188_104537_object25048:head# 2024-04-01T19:36:33.459 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.459 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5286f708:::benchmark_data_smithi188_104537_object97342:head# 2024-04-01T19:36:33.459 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.459 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52873a56:::benchmark_data_smithi188_104537_object133217:head# 2024-04-01T19:36:33.459 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.459 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52876ed6:::benchmark_data_smithi188_104537_object42671:head# 2024-04-01T19:36:33.459 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.459 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5288189b:::benchmark_data_smithi188_104537_object130001:head# 2024-04-01T19:36:33.459 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.459 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52886818:::benchmark_data_smithi188_104537_object76225:head# 2024-04-01T19:36:33.459 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.459 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5288c834:::benchmark_data_smithi188_104537_object168039:head# 2024-04-01T19:36:33.460 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.460 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5289249a:::benchmark_data_smithi188_104537_object53753:head# 2024-04-01T19:36:33.460 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.460 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52892738:::benchmark_data_smithi188_104537_object96475:head# 2024-04-01T19:36:33.460 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.460 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52893ff4:::benchmark_data_smithi188_104537_object117851:head# 2024-04-01T19:36:33.460 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.460 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52899a08:::benchmark_data_smithi188_104537_object167760:head# 2024-04-01T19:36:33.460 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.460 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5289b6ef:::benchmark_data_smithi188_104537_object47131:head# 2024-04-01T19:36:33.460 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.460 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5289f11c:::benchmark_data_smithi188_104537_object43825:head# 2024-04-01T19:36:33.461 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.465 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:528a0def:::benchmark_data_smithi188_104537_object106225:head# 2024-04-01T19:36:33.465 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.465 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:528a1092:::benchmark_data_smithi188_104537_object11022:head# 2024-04-01T19:36:33.465 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.465 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:528abaa7:::benchmark_data_smithi188_104537_object151507:head# 2024-04-01T19:36:33.465 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.465 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:528c215b:::benchmark_data_smithi188_104537_object59638:head# 2024-04-01T19:36:33.465 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.466 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:528c636b:::benchmark_data_smithi188_104537_object152209:head# 2024-04-01T19:36:33.466 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.466 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:528d00b0:::benchmark_data_smithi188_104537_object73666:head# 2024-04-01T19:36:33.466 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.466 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:528e5e82:::benchmark_data_smithi188_104537_object50848:head# 2024-04-01T19:36:33.466 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.466 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:528ec257:::benchmark_data_smithi188_104537_object64664:head# 2024-04-01T19:36:33.466 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.466 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52900839:::benchmark_data_smithi188_104537_object130277:head# 2024-04-01T19:36:33.466 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.466 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5290967f:::benchmark_data_smithi188_104537_object112012:head# 2024-04-01T19:36:33.466 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.466 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5290c2d6:::benchmark_data_smithi188_104537_object142392:head# 2024-04-01T19:36:33.467 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.467 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5290de07:::benchmark_data_smithi188_104537_object33007:head# 2024-04-01T19:36:33.467 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.467 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52928df7:::benchmark_data_smithi188_104537_object171959:head# 2024-04-01T19:36:33.467 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.467 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:529398f8:::benchmark_data_smithi188_104537_object97989:head# 2024-04-01T19:36:33.467 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.467 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5293dc10:::benchmark_data_smithi188_104537_object133867:head# 2024-04-01T19:36:33.467 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.467 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52941115:::benchmark_data_smithi188_104537_object56666:head# 2024-04-01T19:36:33.467 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.467 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52946102:::benchmark_data_smithi188_104537_object60433:head# 2024-04-01T19:36:33.468 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.468 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52959f63:::benchmark_data_smithi188_104537_object171666:head# 2024-04-01T19:36:33.468 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.468 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5295ca35:::benchmark_data_smithi188_104537_object45908:head# 2024-04-01T19:36:33.468 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.468 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5295d116:::benchmark_data_smithi188_104537_object136680:head# 2024-04-01T19:36:33.468 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.468 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52962482:::benchmark_data_smithi188_104537_object78796:head# 2024-04-01T19:36:33.468 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.468 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5296319b:::benchmark_data_smithi188_104537_object146553:head# 2024-04-01T19:36:33.468 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.468 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:529665ef:::benchmark_data_smithi188_104537_object33499:head# 2024-04-01T19:36:33.469 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.469 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5296e32b:::benchmark_data_smithi188_104537_object165270:head# 2024-04-01T19:36:33.469 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.469 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5296e4d3:::benchmark_data_smithi188_104537_object145687:head# 2024-04-01T19:36:33.469 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.469 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:529880ee:::benchmark_data_smithi188_104537_object64608:head# 2024-04-01T19:36:33.469 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.469 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5298ac13:::benchmark_data_smithi188_104537_object161271:head# 2024-04-01T19:36:33.469 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.472 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5298d785:::benchmark_data_smithi188_104537_object119535:head# 2024-04-01T19:36:33.472 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.472 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5299c266:::benchmark_data_smithi188_104537_object61690:head# 2024-04-01T19:36:33.472 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.472 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:529a1f7e:::benchmark_data_smithi188_104537_object167783:head# 2024-04-01T19:36:33.472 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.472 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:529a241a:::benchmark_data_smithi188_104537_object86664:head# 2024-04-01T19:36:33.473 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.473 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:529ac1e8:::benchmark_data_smithi188_104537_object162625:head# 2024-04-01T19:36:33.473 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.473 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:529b24ea:::benchmark_data_smithi188_104537_object72100:head# 2024-04-01T19:36:33.473 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.473 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:529b4522:::benchmark_data_smithi188_104537_object102076:head# 2024-04-01T19:36:33.473 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.473 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:529bf82e:::benchmark_data_smithi188_104537_object49695:head# 2024-04-01T19:36:33.473 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.473 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:529c2599:::benchmark_data_smithi188_104537_object109338:head# 2024-04-01T19:36:33.473 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.473 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:529c3952:::benchmark_data_smithi188_104537_object114843:head# 2024-04-01T19:36:33.474 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.474 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:529c3dcc:::benchmark_data_smithi188_104537_object33961:head# 2024-04-01T19:36:33.474 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.474 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:529c8171:::benchmark_data_smithi188_104537_object160498:head# 2024-04-01T19:36:33.474 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.474 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:529cc1d5:::benchmark_data_smithi188_104537_object55560:head# 2024-04-01T19:36:33.474 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.474 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:529d756b:::benchmark_data_smithi188_104537_object74606:head# 2024-04-01T19:36:33.474 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.474 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:529e561f:::benchmark_data_smithi188_104537_object53490:head# 2024-04-01T19:36:33.474 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.474 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:529e7591:::benchmark_data_smithi188_104537_object29051:head# 2024-04-01T19:36:33.474 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.475 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:529eb0ee:::benchmark_data_smithi188_104537_object66213:head# 2024-04-01T19:36:33.475 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.475 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:529ebd77:::benchmark_data_smithi188_104537_object45506:head# 2024-04-01T19:36:33.475 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.475 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:529edcc8:::benchmark_data_smithi188_104537_object168345:head# 2024-04-01T19:36:33.475 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.475 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:529eebc8:::benchmark_data_smithi188_104537_object51752:head# 2024-04-01T19:36:33.475 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.475 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:529f08c0:::benchmark_data_smithi188_104537_object137818:head# 2024-04-01T19:36:33.475 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.476 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:529f599a:::benchmark_data_smithi188_104537_object16148:head# 2024-04-01T19:36:33.476 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.479 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:529fe0f9:::benchmark_data_smithi188_104537_object139006:head# 2024-04-01T19:36:33.479 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.479 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52a00597:::benchmark_data_smithi188_104537_object168015:head# 2024-04-01T19:36:33.479 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.479 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52a04056:::benchmark_data_smithi188_104537_object117144:head# 2024-04-01T19:36:33.479 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.479 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52a0a33f:::benchmark_data_smithi188_104537_object49120:head# 2024-04-01T19:36:33.479 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.480 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52a0a58d:::benchmark_data_smithi188_104537_object47276:head# 2024-04-01T19:36:33.480 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.480 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52a14548:::benchmark_data_smithi188_104537_object40921:head# 2024-04-01T19:36:33.480 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.480 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52a36fdc:::benchmark_data_smithi188_104537_object120200:head# 2024-04-01T19:36:33.480 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.480 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52a3f804:::benchmark_data_smithi188_104537_object165767:head# 2024-04-01T19:36:33.480 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.480 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52a427d6:::benchmark_data_smithi188_104537_object18999:head# 2024-04-01T19:36:33.480 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.480 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52a5a079:::benchmark_data_smithi188_104537_object74185:head# 2024-04-01T19:36:33.480 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.480 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52a6acdd:::benchmark_data_smithi188_104537_object88985:head# 2024-04-01T19:36:33.480 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.480 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52a727d9:::benchmark_data_smithi188_104537_object116113:head# 2024-04-01T19:36:33.480 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.481 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52a7e105:::benchmark_data_smithi188_104537_object67214:head# 2024-04-01T19:36:33.481 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.481 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52a80e25:::benchmark_data_smithi188_104537_object14348:head# 2024-04-01T19:36:33.481 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.481 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52a8387f:::benchmark_data_smithi188_104537_object152311:head# 2024-04-01T19:36:33.481 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.481 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52a8ad85:::benchmark_data_smithi188_104537_object154983:head# 2024-04-01T19:36:33.481 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.481 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52a8d4e7:::benchmark_data_smithi188_104537_object88923:head# 2024-04-01T19:36:33.481 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.481 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52a9d868:::benchmark_data_smithi188_104537_object26678:head# 2024-04-01T19:36:33.481 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.481 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52aa6779:::benchmark_data_smithi188_104537_object106460:head# 2024-04-01T19:36:33.481 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.482 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52aa6d2a:::benchmark_data_smithi188_104537_object113459:head# 2024-04-01T19:36:33.482 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.483 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52aa83fd:::benchmark_data_smithi188_104537_object169975:head# 2024-04-01T19:36:33.484 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.484 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52aafbf8:::benchmark_data_smithi188_104537_object122350:head# 2024-04-01T19:36:33.484 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.484 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52ac1d71:::benchmark_data_smithi188_104537_object58443:head# 2024-04-01T19:36:33.484 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.484 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52ac6723:::benchmark_data_smithi188_104537_object87044:head# 2024-04-01T19:36:33.484 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.484 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52ad7592:::benchmark_data_smithi188_104537_object74275:head# 2024-04-01T19:36:33.484 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.484 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52ad7fe5:::benchmark_data_smithi188_104537_object72164:head# 2024-04-01T19:36:33.484 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.484 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52ae2a05:::benchmark_data_smithi188_104537_object81467:head# 2024-04-01T19:36:33.485 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.485 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52ae4158:::benchmark_data_smithi188_104537_object64167:head# 2024-04-01T19:36:33.485 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.485 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52ae514e:::benchmark_data_smithi188_104537_object151979:head# 2024-04-01T19:36:33.485 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.485 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52ae680d:::benchmark_data_smithi188_104537_object101975:head# 2024-04-01T19:36:33.485 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.485 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52aeb012:::benchmark_data_smithi188_104537_object106180:head# 2024-04-01T19:36:33.485 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.485 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52af0877:::benchmark_data_smithi188_104537_object115663:head# 2024-04-01T19:36:33.485 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.485 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52afcdd3:::benchmark_data_smithi188_104537_object125674:head# 2024-04-01T19:36:33.486 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.486 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52b007fd:::benchmark_data_smithi188_104537_object83100:head# 2024-04-01T19:36:33.486 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.486 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52b1bb2c:::benchmark_data_smithi188_104537_object91471:head# 2024-04-01T19:36:33.486 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.486 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52b1f9ff:::benchmark_data_smithi188_104537_object129998:head# 2024-04-01T19:36:33.486 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.486 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52b21a98:::benchmark_data_smithi188_104537_object78819:head# 2024-04-01T19:36:33.486 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.486 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52b223a6:::benchmark_data_smithi188_104537_object95204:head# 2024-04-01T19:36:33.486 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.487 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52b25009:::benchmark_data_smithi188_104537_object151567:head# 2024-04-01T19:36:33.487 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.487 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52b25e36:::benchmark_data_smithi188_104537_object53433:head# 2024-04-01T19:36:33.487 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.494 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52b27ad1:::benchmark_data_smithi188_104537_object46027:head# 2024-04-01T19:36:33.494 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.494 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52b2d89f:::benchmark_data_smithi188_104537_object78456:head# 2024-04-01T19:36:33.494 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.494 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52b32947:::benchmark_data_smithi188_104537_object18366:head# 2024-04-01T19:36:33.494 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.494 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52b34015:::benchmark_data_smithi188_104537_object26432:head# 2024-04-01T19:36:33.494 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.494 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52b3eb5d:::benchmark_data_smithi188_104537_object22710:head# 2024-04-01T19:36:33.494 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.494 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52b48f6a:::benchmark_data_smithi188_104537_object32592:head# 2024-04-01T19:36:33.495 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.495 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52b51ba9:::benchmark_data_smithi188_104537_object34775:head# 2024-04-01T19:36:33.495 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.495 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52b58ca8:::benchmark_data_smithi188_104537_object117580:head# 2024-04-01T19:36:33.495 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.495 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52b59ef6:::benchmark_data_smithi188_104537_object62219:head# 2024-04-01T19:36:33.495 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.495 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52b6fabd:::benchmark_data_smithi188_104537_object35476:head# 2024-04-01T19:36:33.495 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.495 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52b7b267:::benchmark_data_smithi188_104537_object18711:head# 2024-04-01T19:36:33.495 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.495 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52b7e8e1:::benchmark_data_smithi188_104537_object73545:head# 2024-04-01T19:36:33.495 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.495 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52b98fa8:::benchmark_data_smithi188_104537_object155565:head# 2024-04-01T19:36:33.495 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.496 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52b9a9a0:::benchmark_data_smithi188_104537_object135120:head# 2024-04-01T19:36:33.496 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.496 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52baed34:::benchmark_data_smithi188_104537_object60503:head# 2024-04-01T19:36:33.496 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.496 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52bb1a07:::benchmark_data_smithi188_104537_object120427:head# 2024-04-01T19:36:33.496 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.496 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52bb330c:::benchmark_data_smithi188_104537_object123233:head# 2024-04-01T19:36:33.496 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.496 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52bb7734:::benchmark_data_smithi188_104537_object105736:head# 2024-04-01T19:36:33.496 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.496 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52bba9f8:::benchmark_data_smithi188_104537_object26220:head# 2024-04-01T19:36:33.496 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.496 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52bc8b82:::benchmark_data_smithi188_104537_object117110:head# 2024-04-01T19:36:33.496 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.496 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52bcb250:::benchmark_data_smithi188_104537_object14706:head# 2024-04-01T19:36:33.496 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.497 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52bcf6b3:::benchmark_data_smithi188_104537_object135715:head# 2024-04-01T19:36:33.497 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.497 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52bd0fed:::benchmark_data_smithi188_104537_object171872:head# 2024-04-01T19:36:33.497 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.497 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52bd37de:::benchmark_data_smithi188_104537_object131077:head# 2024-04-01T19:36:33.497 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.497 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52bd3836:::benchmark_data_smithi188_104537_object96234:head# 2024-04-01T19:36:33.497 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.497 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52bd5ed0:::benchmark_data_smithi188_104537_object33533:head# 2024-04-01T19:36:33.497 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.497 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52bd6d67:::benchmark_data_smithi188_104537_object109056:head# 2024-04-01T19:36:33.497 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.497 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52bd74a1:::benchmark_data_smithi188_104537_object129489:head# 2024-04-01T19:36:33.497 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.497 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52bdabd7:::benchmark_data_smithi188_104537_object86128:head# 2024-04-01T19:36:33.497 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.498 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52bdcf8a:::benchmark_data_smithi188_104537_object50742:head# 2024-04-01T19:36:33.498 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.498 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52be2ffe:::benchmark_data_smithi188_104537_object134179:head# 2024-04-01T19:36:33.498 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.498 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52be48d7:::benchmark_data_smithi188_104537_object125568:head# 2024-04-01T19:36:33.498 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.498 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52be5446:::benchmark_data_smithi188_104537_object54934:head# 2024-04-01T19:36:33.498 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.498 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52beea4d:::benchmark_data_smithi188_104537_object30581:head# 2024-04-01T19:36:33.498 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.498 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52beec9e:::benchmark_data_smithi188_104537_object143635:head# 2024-04-01T19:36:33.498 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.498 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52bef0d4:::benchmark_data_smithi188_104537_object137506:head# 2024-04-01T19:36:33.498 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.499 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52bef997:::benchmark_data_smithi188_104537_object39349:head# 2024-04-01T19:36:33.499 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.500 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52bf063b:::benchmark_data_smithi188_104537_object138536:head# 2024-04-01T19:36:33.500 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.500 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52bfb5bf:::benchmark_data_smithi188_104537_object161629:head# 2024-04-01T19:36:33.500 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.500 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52bff079:::benchmark_data_smithi188_104537_object122558:head# 2024-04-01T19:36:33.500 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.500 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c0783a:::benchmark_data_smithi188_104537_object66319:head# 2024-04-01T19:36:33.500 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.501 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c07fa1:::benchmark_data_smithi188_104537_object108686:head# 2024-04-01T19:36:33.501 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.501 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c0c0f5:::benchmark_data_smithi188_104537_object100841:head# 2024-04-01T19:36:33.501 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.501 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c14f6a:::benchmark_data_smithi188_104537_object163490:head# 2024-04-01T19:36:33.502 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.502 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c1f144:::benchmark_data_smithi188_104537_object112162:head# 2024-04-01T19:36:33.502 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.502 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c208a4:::benchmark_data_smithi188_104537_object157098:head# 2024-04-01T19:36:33.502 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.502 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c2bc4a:::benchmark_data_smithi188_104537_object12893:head# 2024-04-01T19:36:33.502 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.503 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c2c9bc:::benchmark_data_smithi188_104537_object103208:head# 2024-04-01T19:36:33.503 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.503 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c314f8:::benchmark_data_smithi188_104537_object59795:head# 2024-04-01T19:36:33.503 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.503 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c32853:::benchmark_data_smithi188_104537_object43398:head# 2024-04-01T19:36:33.503 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.508 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c45926:::benchmark_data_smithi188_104537_object94153:head# 2024-04-01T19:36:33.508 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.508 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c476ca:::benchmark_data_smithi188_104537_object28379:head# 2024-04-01T19:36:33.508 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.508 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c4946b:::benchmark_data_smithi188_104537_object129278:head# 2024-04-01T19:36:33.508 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.508 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c4c4a2:::benchmark_data_smithi188_104537_object102543:head# 2024-04-01T19:36:33.508 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.508 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c4c844:::benchmark_data_smithi188_104537_object105013:head# 2024-04-01T19:36:33.508 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c4cc5e:::benchmark_data_smithi188_104537_object76394:head# 2024-04-01T19:36:33.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c5bd71:::benchmark_data_smithi188_104537_object69962:head# 2024-04-01T19:36:33.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c658df:::benchmark_data_smithi188_104537_object165637:head# 2024-04-01T19:36:33.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c6b7aa:::benchmark_data_smithi188_104537_object80141:head# 2024-04-01T19:36:33.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c821ea:::benchmark_data_smithi188_104537_object63460:head# 2024-04-01T19:36:33.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c84271:::benchmark_data_smithi188_104537_object70470:head# 2024-04-01T19:36:33.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c84a2f:::benchmark_data_smithi188_104537_object47281:head# 2024-04-01T19:36:33.510 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.510 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c892cc:::benchmark_data_smithi188_104537_object84320:head# 2024-04-01T19:36:33.510 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.510 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c89333:::benchmark_data_smithi188_104537_object170523:head# 2024-04-01T19:36:33.510 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.510 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c90c52:::benchmark_data_smithi188_104537_object165259:head# 2024-04-01T19:36:33.510 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.510 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c9156f:::benchmark_data_smithi188_104537_object81577:head# 2024-04-01T19:36:33.510 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.510 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c95371:::benchmark_data_smithi188_104537_object43436:head# 2024-04-01T19:36:33.511 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.511 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c98b81:::benchmark_data_smithi188_104537_object139848:head# 2024-04-01T19:36:33.511 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.511 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c9bc3e:::benchmark_data_smithi188_104537_object101492:head# 2024-04-01T19:36:33.511 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.511 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c9f745:::benchmark_data_smithi188_104537_object25047:head# 2024-04-01T19:36:33.511 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.511 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52c9fb5f:::benchmark_data_smithi188_104537_object112981:head# 2024-04-01T19:36:33.511 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.516 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52ca1584:::benchmark_data_smithi188_104537_object42973:head# 2024-04-01T19:36:33.516 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.516 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52ca6578:::benchmark_data_smithi188_104537_object21751:head# 2024-04-01T19:36:33.516 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.516 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52cb4d2b:::benchmark_data_smithi188_104537_object131421:head# 2024-04-01T19:36:33.516 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.516 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52cc2045:::benchmark_data_smithi188_104537_object109953:head# 2024-04-01T19:36:33.516 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.517 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52cc4013:::benchmark_data_smithi188_104537_object156640:head# 2024-04-01T19:36:33.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.517 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52cd1644:::benchmark_data_smithi188_104537_object94685:head# 2024-04-01T19:36:33.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.517 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52cdaf45:::benchmark_data_smithi188_104537_object57252:head# 2024-04-01T19:36:33.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.517 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52cdc816:::benchmark_data_smithi188_104537_object95817:head# 2024-04-01T19:36:33.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.517 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52cf0da9:::benchmark_data_smithi188_104537_object157443:head# 2024-04-01T19:36:33.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.517 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52cf1d36:::benchmark_data_smithi188_104537_object78149:head# 2024-04-01T19:36:33.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.517 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52cf2fe1:::benchmark_data_smithi188_104537_object60628:head# 2024-04-01T19:36:33.518 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.518 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52cf8060:::benchmark_data_smithi188_104537_object82399:head# 2024-04-01T19:36:33.518 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.518 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52d04765:::benchmark_data_smithi188_104537_object48811:head# 2024-04-01T19:36:33.518 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.518 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52d05d95:::benchmark_data_smithi188_104537_object131898:head# 2024-04-01T19:36:33.518 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.518 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52d1120d:::benchmark_data_smithi188_104537_object102363:head# 2024-04-01T19:36:33.518 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.518 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52d1140f:::benchmark_data_smithi188_104537_object94201:head# 2024-04-01T19:36:33.518 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.518 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52d1e1df:::benchmark_data_smithi188_104537_object69383:head# 2024-04-01T19:36:33.519 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.519 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52d23210:::benchmark_data_smithi188_104537_object16500:head# 2024-04-01T19:36:33.519 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.519 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52d2ed22:::benchmark_data_smithi188_104537_object146242:head# 2024-04-01T19:36:33.519 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.519 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52d3055b:::benchmark_data_smithi188_104537_object52461:head# 2024-04-01T19:36:33.519 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.519 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52d36b5d:::benchmark_data_smithi188_104537_object98118:head# 2024-04-01T19:36:33.519 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.519 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52d36fb6:::benchmark_data_smithi188_104537_object61145:head# 2024-04-01T19:36:33.519 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.519 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52d38848:::benchmark_data_smithi188_104537_object126808:head# 2024-04-01T19:36:33.519 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.520 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52d3dcb3:::benchmark_data_smithi188_104537_object97685:head# 2024-04-01T19:36:33.520 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.520 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52d3ef94:::benchmark_data_smithi188_104537_object46730:head# 2024-04-01T19:36:33.520 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.520 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52d41c8f:::benchmark_data_smithi188_104537_object127814:head# 2024-04-01T19:36:33.520 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.520 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52d4585d:::benchmark_data_smithi188_104537_object134102:head# 2024-04-01T19:36:33.520 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.520 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52d49a9d:::benchmark_data_smithi188_104537_object95406:head# 2024-04-01T19:36:33.520 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.520 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52d4f580:::benchmark_data_smithi188_104537_object130154:head# 2024-04-01T19:36:33.520 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.523 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52d54c2a:::benchmark_data_smithi188_104537_object128752:head# 2024-04-01T19:36:33.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52d79ba8:::benchmark_data_smithi188_104537_object140596:head# 2024-04-01T19:36:33.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52d7e395:::benchmark_data_smithi188_104537_object96854:head# 2024-04-01T19:36:33.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52d80205:::benchmark_data_smithi188_104537_object34221:head# 2024-04-01T19:36:33.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52d8da14:::benchmark_data_smithi188_104537_object27197:head# 2024-04-01T19:36:33.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52d973e0:::benchmark_data_smithi188_104537_object124154:head# 2024-04-01T19:36:33.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52d9db1b:::benchmark_data_smithi188_104537_object38470:head# 2024-04-01T19:36:33.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.525 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52da71d8:::benchmark_data_smithi188_104537_object130720:head# 2024-04-01T19:36:33.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.525 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52daf63d:::benchmark_data_smithi188_104537_object135249:head# 2024-04-01T19:36:33.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.525 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52db7900:::benchmark_data_smithi188_104537_object121200:head# 2024-04-01T19:36:33.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.525 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52db7975:::benchmark_data_smithi188_104537_object75039:head# 2024-04-01T19:36:33.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.525 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52dc23c6:::benchmark_data_smithi188_104537_object144905:head# 2024-04-01T19:36:33.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.525 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52dc3bba:::benchmark_data_smithi188_104537_object150516:head# 2024-04-01T19:36:33.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.525 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52dc8b75:::benchmark_data_smithi188_104537_object94590:head# 2024-04-01T19:36:33.526 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.526 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52dd3b3a:::benchmark_data_smithi188_104537_object138506:head# 2024-04-01T19:36:33.526 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.526 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52dd3d68:::benchmark_data_smithi188_104537_object28265:head# 2024-04-01T19:36:33.526 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.526 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52de03e5:::benchmark_data_smithi188_104537_object105034:head# 2024-04-01T19:36:33.526 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.526 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52de6298:::benchmark_data_smithi188_104537_object132792:head# 2024-04-01T19:36:33.526 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.526 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52de6d59:::benchmark_data_smithi188_104537_object57672:head# 2024-04-01T19:36:33.526 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.526 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52dee373:::benchmark_data_smithi188_104537_object25956:head# 2024-04-01T19:36:33.527 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.527 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52df509d:::benchmark_data_smithi188_104537_object90182:head# 2024-04-01T19:36:33.527 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.528 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52dfa37a:::benchmark_data_smithi188_104537_object47516:head# 2024-04-01T19:36:33.528 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.528 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52dfcab7:::benchmark_data_smithi188_104537_object24124:head# 2024-04-01T19:36:33.528 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.528 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52e0b406:::benchmark_data_smithi188_104537_object142568:head# 2024-04-01T19:36:33.528 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.528 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52e0dbd5:::benchmark_data_smithi188_104537_object149281:head# 2024-04-01T19:36:33.528 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.528 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52e11474:::benchmark_data_smithi188_104537_object122919:head# 2024-04-01T19:36:33.528 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.528 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52e1181b:::benchmark_data_smithi188_104537_object158511:head# 2024-04-01T19:36:33.529 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.529 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52e29bf3:::benchmark_data_smithi188_104537_object127808:head# 2024-04-01T19:36:33.529 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.529 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52e2dc4b:::benchmark_data_smithi188_104537_object170661:head# 2024-04-01T19:36:33.529 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.529 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52e38807:::benchmark_data_smithi188_104537_object153408:head# 2024-04-01T19:36:33.530 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.530 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52e39720:::benchmark_data_smithi188_104537_object54366:head# 2024-04-01T19:36:33.530 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.531 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52e40ca5:::benchmark_data_smithi188_104537_object67252:head# 2024-04-01T19:36:33.531 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.531 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52e4fabf:::benchmark_data_smithi188_104537_object79021:head# 2024-04-01T19:36:33.531 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.531 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52e51194:::benchmark_data_smithi188_104537_object71826:head# 2024-04-01T19:36:33.531 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.531 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52e5e91e:::benchmark_data_smithi188_104537_object99042:head# 2024-04-01T19:36:33.531 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.532 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52e6addf:::benchmark_data_smithi188_104537_object14709:head# 2024-04-01T19:36:33.532 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.532 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52e70172:::benchmark_data_smithi188_104537_object126038:head# 2024-04-01T19:36:33.532 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.532 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52e70f02:::benchmark_data_smithi188_104537_object67028:head# 2024-04-01T19:36:33.532 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.532 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52e7dda6:::benchmark_data_smithi188_104537_object14863:head# 2024-04-01T19:36:33.533 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.533 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52e81c39:::benchmark_data_smithi188_104537_object101983:head# 2024-04-01T19:36:33.533 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.533 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52e97bd0:::benchmark_data_smithi188_104537_object114913:head# 2024-04-01T19:36:33.533 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.536 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52ea5ae4:::benchmark_data_smithi188_104537_object171176:head# 2024-04-01T19:36:33.536 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.536 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52ea8f31:::benchmark_data_smithi188_104537_object136644:head# 2024-04-01T19:36:33.536 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.536 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52eb4784:::benchmark_data_smithi188_104537_object117944:head# 2024-04-01T19:36:33.536 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.536 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52eb4e62:::benchmark_data_smithi188_104537_object79097:head# 2024-04-01T19:36:33.536 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.536 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52ec17cf:::benchmark_data_smithi188_104537_object90701:head# 2024-04-01T19:36:33.536 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52ec6b93:::benchmark_data_smithi188_104537_object64229:head# 2024-04-01T19:36:33.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52eca39a:::benchmark_data_smithi188_104537_object55631:head# 2024-04-01T19:36:33.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52ed336a:::benchmark_data_smithi188_104537_object109103:head# 2024-04-01T19:36:33.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52eeb379:::benchmark_data_smithi188_104537_object66397:head# 2024-04-01T19:36:33.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52ef42cb:::benchmark_data_smithi188_104537_object106970:head# 2024-04-01T19:36:33.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f035ad:::benchmark_data_smithi188_104537_object142814:head# 2024-04-01T19:36:33.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f07e53:::benchmark_data_smithi188_104537_object118678:head# 2024-04-01T19:36:33.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.538 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:36:33.538 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f188f5:::benchmark_data_smithi188_104537_object115566:head# 2024-04-01T19:36:33.538 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.542 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f18da8:::benchmark_data_smithi188_104537_object74487:head# 2024-04-01T19:36:33.542 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.542 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f19295:::benchmark_data_smithi188_104537_object171772:head# 2024-04-01T19:36:33.542 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.542 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f1c178:::benchmark_data_smithi188_104537_object48557:head# 2024-04-01T19:36:33.542 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.542 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f28c89:::benchmark_data_smithi188_104537_object131711:head# 2024-04-01T19:36:33.542 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.542 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f33626:::benchmark_data_smithi188_104537_object31905:head# 2024-04-01T19:36:33.542 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.542 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f3896e:::benchmark_data_smithi188_104537_object66726:head# 2024-04-01T19:36:33.543 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.543 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f42fab:::benchmark_data_smithi188_104537_object55746:head# 2024-04-01T19:36:33.543 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.543 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f445fa:::benchmark_data_smithi188_104537_object111451:head# 2024-04-01T19:36:33.543 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.543 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f47ed0:::benchmark_data_smithi188_104537_object167521:head# 2024-04-01T19:36:33.543 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.543 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f4c557:::benchmark_data_smithi188_104537_object44219:head# 2024-04-01T19:36:33.543 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.543 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f64572:::benchmark_data_smithi188_104537_object123083:head# 2024-04-01T19:36:33.543 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.543 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f66db8:::benchmark_data_smithi188_104537_object141924:head# 2024-04-01T19:36:33.543 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.543 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f6b786:::benchmark_data_smithi188_104537_object29747:head# 2024-04-01T19:36:33.544 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.544 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f6c129:::benchmark_data_smithi188_104537_object126002:head# 2024-04-01T19:36:33.544 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.544 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f6dbe1:::benchmark_data_smithi188_104537_object27575:head# 2024-04-01T19:36:33.544 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.544 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f6f7a4:::benchmark_data_smithi188_104537_object61560:head# 2024-04-01T19:36:33.544 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.544 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f70593:::benchmark_data_smithi188_104537_object165011:head# 2024-04-01T19:36:33.544 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.544 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f70897:::benchmark_data_smithi188_104537_object34021:head# 2024-04-01T19:36:33.544 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.544 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f761f1:::benchmark_data_smithi188_104537_object79241:head# 2024-04-01T19:36:33.544 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.544 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f7c809:::benchmark_data_smithi188_104537_object91198:head# 2024-04-01T19:36:33.545 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.549 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f7cf69:::benchmark_data_smithi188_104537_object66228:head# 2024-04-01T19:36:33.549 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.550 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f82655:::benchmark_data_smithi188_104537_object61799:head# 2024-04-01T19:36:33.550 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.550 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f96670:::benchmark_data_smithi188_104537_object86613:head# 2024-04-01T19:36:33.550 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.550 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f98145:::benchmark_data_smithi188_104537_object92009:head# 2024-04-01T19:36:33.550 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.550 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52f9ff06:::benchmark_data_smithi188_104537_object59732:head# 2024-04-01T19:36:33.550 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.550 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52fa5c1c:::benchmark_data_smithi188_104537_object114061:head# 2024-04-01T19:36:33.550 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.550 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52fae166:::benchmark_data_smithi188_104537_object45590:head# 2024-04-01T19:36:33.550 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.550 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52fb77c8:::benchmark_data_smithi188_104537_object62255:head# 2024-04-01T19:36:33.551 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.551 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52fbbaeb:::benchmark_data_smithi188_104537_object122218:head# 2024-04-01T19:36:33.551 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.551 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52fc24ab:::benchmark_data_smithi188_104537_object111867:head# 2024-04-01T19:36:33.551 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.551 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52fc3de5:::benchmark_data_smithi188_104537_object103285:head# 2024-04-01T19:36:33.551 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.551 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52fc60dc:::benchmark_data_smithi188_104537_object105574:head# 2024-04-01T19:36:33.551 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.551 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52fd15d9:::benchmark_data_smithi188_104537_object117684:head# 2024-04-01T19:36:33.551 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.551 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52fdc94e:::benchmark_data_smithi188_104537_object51218:head# 2024-04-01T19:36:33.551 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.552 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52fe182f:::benchmark_data_smithi188_104537_object168316:head# 2024-04-01T19:36:33.552 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.552 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52fe70a3:::benchmark_data_smithi188_104537_object28789:head# 2024-04-01T19:36:33.552 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.552 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:52fe7795:::benchmark_data_smithi188_104537_object142128:head# 2024-04-01T19:36:33.552 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.552 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:530081fb:::benchmark_data_smithi188_104537_object25573:head# 2024-04-01T19:36:33.552 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.552 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5300985e:::benchmark_data_smithi188_104537_object132429:head# 2024-04-01T19:36:33.552 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.552 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5300d6a3:::benchmark_data_smithi188_104537_object34880:head# 2024-04-01T19:36:33.552 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5300f276:::benchmark_data_smithi188_104537_object138941:head# 2024-04-01T19:36:33.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:530105be:::benchmark_data_smithi188_104537_object151792:head# 2024-04-01T19:36:33.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53016926:::benchmark_data_smithi188_104537_object102434:head# 2024-04-01T19:36:33.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5301f400:::benchmark_data_smithi188_104537_object118373:head# 2024-04-01T19:36:33.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5302b7db:::benchmark_data_smithi188_104537_object76967:head# 2024-04-01T19:36:33.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53034047:::benchmark_data_smithi188_104537_object171909:head# 2024-04-01T19:36:33.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53034050:::benchmark_data_smithi188_104537_object40708:head# 2024-04-01T19:36:33.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53046018:::benchmark_data_smithi188_104537_object162993:head# 2024-04-01T19:36:33.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.554 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53060a5f:::benchmark_data_smithi188_104537_object59357:head# 2024-04-01T19:36:33.554 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.554 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5306810d:::benchmark_data_smithi188_104537_object24360:head# 2024-04-01T19:36:33.554 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.556 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5306aba1:::benchmark_data_smithi188_104537_object44882:head# 2024-04-01T19:36:33.556 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.556 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5306be86:::benchmark_data_smithi188_104537_object23124:head# 2024-04-01T19:36:33.556 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.556 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5306f574:::benchmark_data_smithi188_104537_object43280:head# 2024-04-01T19:36:33.556 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.556 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:530720ca:::benchmark_data_smithi188_104537_object71757:head# 2024-04-01T19:36:33.556 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.556 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53073d73:::benchmark_data_smithi188_104537_object85258:head# 2024-04-01T19:36:33.556 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.556 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53080561:::benchmark_data_smithi188_104537_object43286:head# 2024-04-01T19:36:33.556 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.557 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53087d76:::benchmark_data_smithi188_104537_object150401:head# 2024-04-01T19:36:33.557 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.557 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5308dca4:::benchmark_data_smithi188_104537_object62265:head# 2024-04-01T19:36:33.557 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.557 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53091493:::benchmark_data_smithi188_104537_object167397:head# 2024-04-01T19:36:33.557 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.557 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53091925:::benchmark_data_smithi188_104537_object162170:head# 2024-04-01T19:36:33.557 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.557 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53094e31:::benchmark_data_smithi188_104537_object21209:head# 2024-04-01T19:36:33.557 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.558 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53095e96:::benchmark_data_smithi188_104537_object82411:head# 2024-04-01T19:36:33.558 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.558 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:530a113d:::benchmark_data_smithi188_104537_object44586:head# 2024-04-01T19:36:33.558 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.558 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:530a2309:::benchmark_data_smithi188_104537_object53048:head# 2024-04-01T19:36:33.558 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.558 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:530a8fde:::benchmark_data_smithi188_104537_object140156:head# 2024-04-01T19:36:33.558 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.558 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:530aad6f:::benchmark_data_smithi188_104537_object121196:head# 2024-04-01T19:36:33.559 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.559 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:530b1b30:::benchmark_data_smithi188_104537_object137551:head# 2024-04-01T19:36:33.559 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.559 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:530b9eca:::benchmark_data_smithi188_104537_object149941:head# 2024-04-01T19:36:33.559 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.559 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:530bd7a3:::benchmark_data_smithi188_104537_object141214:head# 2024-04-01T19:36:33.559 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.559 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:530ca7f7:::benchmark_data_smithi188_104537_object134205:head# 2024-04-01T19:36:33.559 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.559 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:530ce7aa:::benchmark_data_smithi188_104537_object130337:head# 2024-04-01T19:36:33.559 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.560 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:530d5323:::benchmark_data_smithi188_104537_object142801:head# 2024-04-01T19:36:33.560 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.560 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:530e4d31:::benchmark_data_smithi188_104537_object167529:head# 2024-04-01T19:36:33.560 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.560 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:530f192a:::benchmark_data_smithi188_104537_object36099:head# 2024-04-01T19:36:33.560 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.560 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:530f2441:::benchmark_data_smithi188_104537_object11414:head# 2024-04-01T19:36:33.560 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.560 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:530f97dd:::benchmark_data_smithi188_104537_object149823:head# 2024-04-01T19:36:33.560 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.560 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:530fd370:::benchmark_data_smithi188_104537_object39994:head# 2024-04-01T19:36:33.560 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.563 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:530ff694:::benchmark_data_smithi188_104537_object107335:head# 2024-04-01T19:36:33.563 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.563 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53101e96:::benchmark_data_smithi188_104537_object68961:head# 2024-04-01T19:36:33.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53102862:::benchmark_data_smithi188_104537_object88331:head# 2024-04-01T19:36:33.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53109988:::benchmark_data_smithi188_104537_object128348:head# 2024-04-01T19:36:33.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53110dae:::benchmark_data_smithi188_104537_object132636:head# 2024-04-01T19:36:33.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5312095c:::benchmark_data_smithi188_104537_object53456:head# 2024-04-01T19:36:33.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53129618:::benchmark_data_smithi188_104537_object23524:head# 2024-04-01T19:36:33.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5312e0e6:::benchmark_data_smithi188_104537_object91193:head# 2024-04-01T19:36:33.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5313124c:::benchmark_data_smithi188_104537_object15979:head# 2024-04-01T19:36:33.565 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.565 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53131300:::benchmark_data_smithi188_104537_object163419:head# 2024-04-01T19:36:33.565 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.565 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5314587c:::benchmark_data_smithi188_104537_object163612:head# 2024-04-01T19:36:33.565 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.565 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53146bc7:::benchmark_data_smithi188_104537_object161579:head# 2024-04-01T19:36:33.565 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.565 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5314caad:::benchmark_data_smithi188_104537_object45046:head# 2024-04-01T19:36:33.565 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.565 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53156886:::benchmark_data_smithi188_104537_object155612:head# 2024-04-01T19:36:33.565 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.565 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53160d9c:::benchmark_data_smithi188_104537_object27348:head# 2024-04-01T19:36:33.565 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.565 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53161fc9:::benchmark_data_smithi188_104537_object65765:head# 2024-04-01T19:36:33.565 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.566 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53164071:::benchmark_data_smithi188_104537_object126451:head# 2024-04-01T19:36:33.566 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.566 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53165415:::benchmark_data_smithi188_104537_object96745:head# 2024-04-01T19:36:33.566 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.566 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5316568d:::benchmark_data_smithi188_104537_object20744:head# 2024-04-01T19:36:33.566 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.566 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53171418:::benchmark_data_smithi188_104537_object48428:head# 2024-04-01T19:36:33.566 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.566 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53173d17:::benchmark_data_smithi188_104537_object106313:head# 2024-04-01T19:36:33.566 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.567 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53174797:::benchmark_data_smithi188_104537_object58114:head# 2024-04-01T19:36:33.567 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:33 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2700879020' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:36:33.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:33.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:33.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:33.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:33.572 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5317688f:::benchmark_data_smithi188_104537_object101696:head# 2024-04-01T19:36:33.573 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.573 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5317babf:::benchmark_data_smithi188_104537_object18642:head# 2024-04-01T19:36:33.573 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.573 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53180081:::benchmark_data_smithi188_104537_object13667:head# 2024-04-01T19:36:33.573 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.573 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53181047:::benchmark_data_smithi188_104537_object143477:head# 2024-04-01T19:36:33.573 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.573 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:531830ab:::benchmark_data_smithi188_104537_object95675:head# 2024-04-01T19:36:33.573 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.573 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53189fb2:::benchmark_data_smithi188_104537_object169027:head# 2024-04-01T19:36:33.573 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.573 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:531a3a6f:::benchmark_data_smithi188_104537_object68101:head# 2024-04-01T19:36:33.574 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.574 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:531ae285:::benchmark_data_smithi188_104537_object54169:head# 2024-04-01T19:36:33.574 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.574 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:531b0b54:::benchmark_data_smithi188_104537_object169924:head# 2024-04-01T19:36:33.574 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.574 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:531b715c:::benchmark_data_smithi188_104537_object76389:head# 2024-04-01T19:36:33.574 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.574 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:531b7b6c:::benchmark_data_smithi188_104537_object54549:head# 2024-04-01T19:36:33.574 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.574 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:531bb7d9:::benchmark_data_smithi188_104537_object126054:head# 2024-04-01T19:36:33.574 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.574 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:531c45a6:::benchmark_data_smithi188_104537_object47975:head# 2024-04-01T19:36:33.575 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.575 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:531c6a1c:::benchmark_data_smithi188_104537_object137566:head# 2024-04-01T19:36:33.575 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.575 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:531cad8e:::benchmark_data_smithi188_104537_object14969:head# 2024-04-01T19:36:33.575 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.575 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:531cd9d2:::benchmark_data_smithi188_104537_object69995:head# 2024-04-01T19:36:33.575 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.575 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:531ce6f3:::benchmark_data_smithi188_104537_object133492:head# 2024-04-01T19:36:33.575 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.575 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:531d5518:::benchmark_data_smithi188_104537_object166682:head# 2024-04-01T19:36:33.575 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.575 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:531e401e:::benchmark_data_smithi188_104537_object114973:head# 2024-04-01T19:36:33.575 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.575 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:531e6935:::benchmark_data_smithi188_104537_object59655:head# 2024-04-01T19:36:33.576 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.576 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:531ea0ee:::benchmark_data_smithi188_104537_object74281:head# 2024-04-01T19:36:33.576 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.576 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:531edbe4:::benchmark_data_smithi188_104537_object133215:head# 2024-04-01T19:36:33.576 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.576 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:531f2250:::benchmark_data_smithi188_104537_object165167:head# 2024-04-01T19:36:33.576 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.576 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:531fc800:::benchmark_data_smithi188_104537_object113400:head# 2024-04-01T19:36:33.576 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.576 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:531fdc40:::benchmark_data_smithi188_104537_object91567:head# 2024-04-01T19:36:33.576 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.576 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5320a743:::benchmark_data_smithi188_104537_object93412:head# 2024-04-01T19:36:33.576 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.576 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5320feda:::benchmark_data_smithi188_104537_object20706:head# 2024-04-01T19:36:33.576 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.576 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5321235a:::benchmark_data_smithi188_104537_object95404:head# 2024-04-01T19:36:33.577 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.577 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53216e4c:::benchmark_data_smithi188_104537_object63614:head# 2024-04-01T19:36:33.577 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.577 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5321ee3a:::benchmark_data_smithi188_104537_object124076:head# 2024-04-01T19:36:33.577 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.577 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5322485d:::benchmark_data_smithi188_104537_object166282:head# 2024-04-01T19:36:33.577 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.577 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53228c6c:::benchmark_data_smithi188_104537_object156844:head# 2024-04-01T19:36:33.577 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.577 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53239388:::benchmark_data_smithi188_104537_object47754:head# 2024-04-01T19:36:33.577 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.577 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5323c3ea:::benchmark_data_smithi188_104537_object22347:head# 2024-04-01T19:36:33.577 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.577 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:532428dc:::benchmark_data_smithi188_104537_object169329:head# 2024-04-01T19:36:33.578 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.578 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:33 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2700879020' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:36:33.578 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:33.578 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:33.578 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:33.578 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:33.578 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:33.579 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53245ab5:::benchmark_data_smithi188_104537_object64492:head# 2024-04-01T19:36:33.580 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.580 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5324c57c:::benchmark_data_smithi188_104537_object101933:head# 2024-04-01T19:36:33.580 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.580 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5324e098:::benchmark_data_smithi188_104537_object117651:head# 2024-04-01T19:36:33.580 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.580 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53255eee:::benchmark_data_smithi188_104537_object151395:head# 2024-04-01T19:36:33.580 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.580 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:532572ca:::benchmark_data_smithi188_104537_object85121:head# 2024-04-01T19:36:33.580 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.580 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5325b6b5:::benchmark_data_smithi188_104537_object161314:head# 2024-04-01T19:36:33.580 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.580 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5325be26:::benchmark_data_smithi188_104537_object166371:head# 2024-04-01T19:36:33.580 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.581 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53260363:::benchmark_data_smithi188_104537_object102184:head# 2024-04-01T19:36:33.581 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.581 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:532641cf:::benchmark_data_smithi188_104537_object104342:head# 2024-04-01T19:36:33.581 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.581 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53272b11:::benchmark_data_smithi188_104537_object71582:head# 2024-04-01T19:36:33.581 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.581 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:532752d4:::benchmark_data_smithi188_104537_object147511:head# 2024-04-01T19:36:33.581 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.581 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53275d80:::benchmark_data_smithi188_104537_object166986:head# 2024-04-01T19:36:33.581 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.581 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5328ef3f:::benchmark_data_smithi188_104537_object14386:head# 2024-04-01T19:36:33.581 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.581 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5329015c:::benchmark_data_smithi188_104537_object29509:head# 2024-04-01T19:36:33.581 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.581 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:532933ba:::benchmark_data_smithi188_104537_object17829:head# 2024-04-01T19:36:33.581 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.582 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5329576f:::benchmark_data_smithi188_104537_object78241:head# 2024-04-01T19:36:33.582 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.582 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53298fc4:::benchmark_data_smithi188_104537_object38008:head# 2024-04-01T19:36:33.582 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.582 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5329be94:::benchmark_data_smithi188_104537_object148865:head# 2024-04-01T19:36:33.582 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.582 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:532aac0e:::benchmark_data_smithi188_104537_object111394:head# 2024-04-01T19:36:33.582 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.582 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:532b016c:::benchmark_data_smithi188_104537_object52637:head# 2024-04-01T19:36:33.582 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:532b1f97:::benchmark_data_smithi188_104537_object124016:head# 2024-04-01T19:36:33.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:532b4293:::benchmark_data_smithi188_104537_object53260:head# 2024-04-01T19:36:33.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:532c1f67:::benchmark_data_smithi188_104537_object56494:head# 2024-04-01T19:36:33.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:532c8da0:::benchmark_data_smithi188_104537_object96040:head# 2024-04-01T19:36:33.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:532d4f11:::benchmark_data_smithi188_104537_object148594:head# 2024-04-01T19:36:33.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:532d6c7c:::benchmark_data_smithi188_104537_object136916:head# 2024-04-01T19:36:33.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:532db872:::benchmark_data_smithi188_104537_object27066:head# 2024-04-01T19:36:33.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:532df8ad:::benchmark_data_smithi188_104537_object24433:head# 2024-04-01T19:36:33.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:532e0bab:::benchmark_data_smithi188_104537_object13995:head# 2024-04-01T19:36:33.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:532e9ac4:::benchmark_data_smithi188_104537_object92801:head# 2024-04-01T19:36:33.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:532ef0c3:::benchmark_data_smithi188_104537_object31936:head# 2024-04-01T19:36:33.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:532f15d4:::benchmark_data_smithi188_104537_object23932:head# 2024-04-01T19:36:33.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.585 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:532f4b47:::benchmark_data_smithi188_104537_object20041:head# 2024-04-01T19:36:33.585 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.585 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53300f8f:::benchmark_data_smithi188_104537_object46760:head# 2024-04-01T19:36:33.585 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:533046c1:::benchmark_data_smithi188_104537_object130254:head# 2024-04-01T19:36:33.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:533054c3:::benchmark_data_smithi188_104537_object85972:head# 2024-04-01T19:36:33.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53307db2:::benchmark_data_smithi188_104537_object170322:head# 2024-04-01T19:36:33.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53308937:::benchmark_data_smithi188_104537_object84626:head# 2024-04-01T19:36:33.589 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.589 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:533104f3:::benchmark_data_smithi188_104537_object81305:head# 2024-04-01T19:36:33.589 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.589 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53314dd5:::benchmark_data_smithi188_104537_object33536:head# 2024-04-01T19:36:33.589 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.589 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53315b83:::benchmark_data_smithi188_104537_object105239:head# 2024-04-01T19:36:33.589 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.589 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:533188fa:::benchmark_data_smithi188_104537_object153052:head# 2024-04-01T19:36:33.589 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.589 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5331c700:::benchmark_data_smithi188_104537_object150953:head# 2024-04-01T19:36:33.589 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.589 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5332a9c0:::benchmark_data_smithi188_104537_object103108:head# 2024-04-01T19:36:33.590 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.590 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5332b68d:::benchmark_data_smithi188_104537_object105303:head# 2024-04-01T19:36:33.590 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.590 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5333ae66:::benchmark_data_smithi188_104537_object96206:head# 2024-04-01T19:36:33.590 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.590 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5333bafc:::benchmark_data_smithi188_104537_object77897:head# 2024-04-01T19:36:33.590 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.590 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5334bdf4:::benchmark_data_smithi188_104537_object110236:head# 2024-04-01T19:36:33.590 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.590 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5334d188:::benchmark_data_smithi188_104537_object129302:head# 2024-04-01T19:36:33.590 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.590 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53350de8:::benchmark_data_smithi188_104537_object30617:head# 2024-04-01T19:36:33.591 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.591 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5336222f:::benchmark_data_smithi188_104537_object14838:head# 2024-04-01T19:36:33.591 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.591 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53367cf6:::benchmark_data_smithi188_104537_object108089:head# 2024-04-01T19:36:33.591 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.591 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53368081:::benchmark_data_smithi188_104537_object104052:head# 2024-04-01T19:36:33.591 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.591 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53370305:::benchmark_data_smithi188_104537_object114725:head# 2024-04-01T19:36:33.591 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.591 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53373539:::benchmark_data_smithi188_104537_object81825:head# 2024-04-01T19:36:33.591 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.597 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:36:33.599 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:533797c0:::benchmark_data_smithi188_104537_object123865:head# 2024-04-01T19:36:33.599 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.599 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:533874f8:::benchmark_data_smithi188_104537_object118019:head# 2024-04-01T19:36:33.599 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.599 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5338c65e:::benchmark_data_smithi188_104537_object72752:head# 2024-04-01T19:36:33.599 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.599 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:533925b9:::benchmark_data_smithi188_104537_object131409:head# 2024-04-01T19:36:33.599 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.600 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53393224:::benchmark_data_smithi188_104537_object106347:head# 2024-04-01T19:36:33.600 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.600 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5339d5ec:::benchmark_data_smithi188_104537_object63700:head# 2024-04-01T19:36:33.600 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.600 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:533a42cc:::benchmark_data_smithi188_104537_object39920:head# 2024-04-01T19:36:33.600 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.600 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:533a435b:::benchmark_data_smithi188_104537_object111787:head# 2024-04-01T19:36:33.600 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.600 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:533aaa13:::benchmark_data_smithi188_104537_object83913:head# 2024-04-01T19:36:33.600 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.600 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:533af6d9:::benchmark_data_smithi188_104537_object41600:head# 2024-04-01T19:36:33.600 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.600 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:533b9aa8:::benchmark_data_smithi188_104537_object66291:head# 2024-04-01T19:36:33.600 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.601 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:533c083f:::benchmark_data_smithi188_104537_object132027:head# 2024-04-01T19:36:33.601 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.601 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:533c6f2b:::benchmark_data_smithi188_104537_object138622:head# 2024-04-01T19:36:33.601 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.601 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:533cc7f3:::benchmark_data_smithi188_104537_object11221:head# 2024-04-01T19:36:33.601 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.601 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:533e044a:::benchmark_data_smithi188_104537_object35516:head# 2024-04-01T19:36:33.601 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.601 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:533e949a:::benchmark_data_smithi188_104537_object44534:head# 2024-04-01T19:36:33.601 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.601 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:533f2e46:::benchmark_data_smithi188_104537_object21258:head# 2024-04-01T19:36:33.601 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.601 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:533f7e13:::benchmark_data_smithi188_104537_object103105:head# 2024-04-01T19:36:33.601 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.602 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53402c11:::benchmark_data_smithi188_104537_object120757:head# 2024-04-01T19:36:33.602 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.602 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5340cbeb:::benchmark_data_smithi188_104537_object81634:head# 2024-04-01T19:36:33.602 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.602 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:534132ae:::benchmark_data_smithi188_104537_object90625:head# 2024-04-01T19:36:33.602 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.602 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53415153:::benchmark_data_smithi188_104537_object140303:head# 2024-04-01T19:36:33.602 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.602 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5341e11a:::benchmark_data_smithi188_104537_object162261:head# 2024-04-01T19:36:33.602 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.602 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5343344d:::benchmark_data_smithi188_104537_object134113:head# 2024-04-01T19:36:33.603 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.603 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53434e6b:::benchmark_data_smithi188_104537_object64715:head# 2024-04-01T19:36:33.603 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.603 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5343939b:::benchmark_data_smithi188_104537_object123142:head# 2024-04-01T19:36:33.603 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.603 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5343b559:::benchmark_data_smithi188_104537_object132755:head# 2024-04-01T19:36:33.603 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.603 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5343cf54:::benchmark_data_smithi188_104537_object146619:head# 2024-04-01T19:36:33.603 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.603 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5344bbb5:::benchmark_data_smithi188_104537_object22379:head# 2024-04-01T19:36:33.603 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.603 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5345149f:::benchmark_data_smithi188_104537_object129177:head# 2024-04-01T19:36:33.603 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.604 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53454ea4:::benchmark_data_smithi188_104537_object32966:head# 2024-04-01T19:36:33.604 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.604 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5345767b:::benchmark_data_smithi188_104537_object170330:head# 2024-04-01T19:36:33.604 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.604 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53458876:::benchmark_data_smithi188_104537_object162080:head# 2024-04-01T19:36:33.604 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.604 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53459539:::benchmark_data_smithi188_104537_object67664:head# 2024-04-01T19:36:33.604 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.604 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53459b4b:::benchmark_data_smithi188_104537_object169180:head# 2024-04-01T19:36:33.604 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.604 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5345d00f:::benchmark_data_smithi188_104537_object58715:head# 2024-04-01T19:36:33.604 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.605 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5345e117:::benchmark_data_smithi188_104537_object20207:head# 2024-04-01T19:36:33.605 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.605 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:534765b0:::benchmark_data_smithi188_104537_object52997:head# 2024-04-01T19:36:33.605 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.605 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5347d8f0:::benchmark_data_smithi188_104537_object92263:head# 2024-04-01T19:36:33.605 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.605 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5347ddc5:::benchmark_data_smithi188_104537_object150111:head# 2024-04-01T19:36:33.605 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.605 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5348cb86:::benchmark_data_smithi188_104537_object45422:head# 2024-04-01T19:36:33.605 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.606 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:33.607 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:36:33.615 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5349f5ec:::benchmark_data_smithi188_104537_object46186:head# 2024-04-01T19:36:33.615 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.615 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:534a7c86:::benchmark_data_smithi188_104537_object22665:head# 2024-04-01T19:36:33.615 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.615 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:534a9d89:::benchmark_data_smithi188_104537_object74920:head# 2024-04-01T19:36:33.616 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.616 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:534ab3c3:::benchmark_data_smithi188_104537_object38851:head# 2024-04-01T19:36:33.616 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.616 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:534b9815:::benchmark_data_smithi188_104537_object111446:head# 2024-04-01T19:36:33.616 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.616 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:534bddbd:::benchmark_data_smithi188_104537_object45701:head# 2024-04-01T19:36:33.616 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.616 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:534c95e8:::benchmark_data_smithi188_104537_object141262:head# 2024-04-01T19:36:33.616 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.616 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:534ccfd3:::benchmark_data_smithi188_104537_object40805:head# 2024-04-01T19:36:33.616 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.616 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:534de9ab:::benchmark_data_smithi188_104537_object128327:head# 2024-04-01T19:36:33.616 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.617 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:534e3928:::benchmark_data_smithi188_104537_object116807:head# 2024-04-01T19:36:33.617 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.617 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:534e7142:::benchmark_data_smithi188_104537_object132039:head# 2024-04-01T19:36:33.617 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.617 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:534e9d30:::benchmark_data_smithi188_104537_object135284:head# 2024-04-01T19:36:33.617 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.617 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:534ea576:::benchmark_data_smithi188_104537_object118320:head# 2024-04-01T19:36:33.617 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.617 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:534f4b47:::benchmark_data_smithi188_104537_object131771:head# 2024-04-01T19:36:33.617 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.617 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:534f617e:::benchmark_data_smithi188_104537_object103708:head# 2024-04-01T19:36:33.617 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.617 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:534f6ada:::benchmark_data_smithi188_104537_object127959:head# 2024-04-01T19:36:33.617 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.618 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53512430:::benchmark_data_smithi188_104537_object171661:head# 2024-04-01T19:36:33.618 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.618 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535216fc:::benchmark_data_smithi188_104537_object51198:head# 2024-04-01T19:36:33.618 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.618 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53525ff2:::benchmark_data_smithi188_104537_object141459:head# 2024-04-01T19:36:33.618 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.618 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5353374e:::benchmark_data_smithi188_104537_object83245:head# 2024-04-01T19:36:33.618 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.618 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535359e8:::benchmark_data_smithi188_104537_object113604:head# 2024-04-01T19:36:33.618 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.618 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5354c228:::benchmark_data_smithi188_104537_object148921:head# 2024-04-01T19:36:33.618 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.619 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535541ef:::benchmark_data_smithi188_104537_object31060:head# 2024-04-01T19:36:33.619 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.619 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535561e0:::benchmark_data_smithi188_104537_object103587:head# 2024-04-01T19:36:33.619 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.619 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53563856:::benchmark_data_smithi188_104537_object93557:head# 2024-04-01T19:36:33.619 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.619 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5356471c:::benchmark_data_smithi188_104537_object143494:head# 2024-04-01T19:36:33.619 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.619 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53575bcb:::benchmark_data_smithi188_104537_object56809:head# 2024-04-01T19:36:33.619 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.619 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53578422:::benchmark_data_smithi188_104537_object129324:head# 2024-04-01T19:36:33.619 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.620 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5357b190:::benchmark_data_smithi188_104537_object138189:head# 2024-04-01T19:36:33.620 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.620 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53582f83:::benchmark_data_smithi188_104537_object129005:head# 2024-04-01T19:36:33.620 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.620 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5358b4b1:::benchmark_data_smithi188_104537_object37524:head# 2024-04-01T19:36:33.620 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.620 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5358cb8a:::benchmark_data_smithi188_104537_object149889:head# 2024-04-01T19:36:33.620 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.620 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5359192d:::benchmark_data_smithi188_104537_object77127:head# 2024-04-01T19:36:33.620 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.620 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535943dd:::benchmark_data_smithi188_104537_object153137:head# 2024-04-01T19:36:33.620 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.621 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535987bc:::benchmark_data_smithi188_104537_object65899:head# 2024-04-01T19:36:33.621 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.621 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5359bfb8:::benchmark_data_smithi188_104537_object97005:head# 2024-04-01T19:36:33.621 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.621 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535a3be8:::benchmark_data_smithi188_104537_object47613:head# 2024-04-01T19:36:33.621 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.621 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535a739f:::benchmark_data_smithi188_104537_object17509:head# 2024-04-01T19:36:33.621 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.621 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535a95c1:::benchmark_data_smithi188_104537_object52397:head# 2024-04-01T19:36:33.621 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.621 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535a9790:::benchmark_data_smithi188_104537_object14814:head# 2024-04-01T19:36:33.621 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.621 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535ac229:::benchmark_data_smithi188_104537_object141821:head# 2024-04-01T19:36:33.621 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.621 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535ad477:::benchmark_data_smithi188_104537_object107181:head# 2024-04-01T19:36:33.622 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.622 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535b0420:::benchmark_data_smithi188_104537_object152784:head# 2024-04-01T19:36:33.622 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.622 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535b1afd:::benchmark_data_smithi188_104537_object78598:head# 2024-04-01T19:36:33.622 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.622 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535bf5b2:::benchmark_data_smithi188_104537_object95379:head# 2024-04-01T19:36:33.622 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.622 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535cf714:::benchmark_data_smithi188_104537_object28909:head# 2024-04-01T19:36:33.622 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.622 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535d9934:::benchmark_data_smithi188_104537_object98188:head# 2024-04-01T19:36:33.622 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.622 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535d9e41:::benchmark_data_smithi188_104537_object87780:head# 2024-04-01T19:36:33.622 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535e35e7:::benchmark_data_smithi188_104537_object101242:head# 2024-04-01T19:36:33.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535e7c25:::benchmark_data_smithi188_104537_object53274:head# 2024-04-01T19:36:33.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535e9e36:::benchmark_data_smithi188_104537_object31806:head# 2024-04-01T19:36:33.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535ee526:::benchmark_data_smithi188_104537_object43270:head# 2024-04-01T19:36:33.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535f1006:::benchmark_data_smithi188_104537_object109200:head# 2024-04-01T19:36:33.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535f44e3:::benchmark_data_smithi188_104537_object156240:head# 2024-04-01T19:36:33.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535f490c:::benchmark_data_smithi188_104537_object12217:head# 2024-04-01T19:36:33.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.624 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:535fdcf4:::benchmark_data_smithi188_104537_object29614:head# 2024-04-01T19:36:33.624 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.624 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53606c1f:::benchmark_data_smithi188_104537_object96118:head# 2024-04-01T19:36:33.624 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.624 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53609727:::benchmark_data_smithi188_104537_object43781:head# 2024-04-01T19:36:33.624 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.624 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5360f64e:::benchmark_data_smithi188_104537_object120549:head# 2024-04-01T19:36:33.624 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.632 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53610c27:::benchmark_data_smithi188_104537_object163744:head# 2024-04-01T19:36:33.632 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.632 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53611cb5:::benchmark_data_smithi188_104537_object100204:head# 2024-04-01T19:36:33.632 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.632 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53612da4:::benchmark_data_smithi188_104537_object63156:head# 2024-04-01T19:36:33.632 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.632 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:536152de:::benchmark_data_smithi188_104537_object88580:head# 2024-04-01T19:36:33.632 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.633 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53615572:::benchmark_data_smithi188_104537_object129930:head# 2024-04-01T19:36:33.633 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.633 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5361c5cd:::benchmark_data_smithi188_104537_object62474:head# 2024-04-01T19:36:33.633 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.633 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53624147:::benchmark_data_smithi188_104537_object73008:head# 2024-04-01T19:36:33.633 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.633 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53629e05:::benchmark_data_smithi188_104537_object40819:head# 2024-04-01T19:36:33.633 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.633 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5362cbfc:::benchmark_data_smithi188_104537_object48924:head# 2024-04-01T19:36:33.633 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.633 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5362f64d:::benchmark_data_smithi188_104537_object60554:head# 2024-04-01T19:36:33.633 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.633 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5363880e:::benchmark_data_smithi188_104537_object79719:head# 2024-04-01T19:36:33.633 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.634 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5363c79d:::benchmark_data_smithi188_104537_object99872:head# 2024-04-01T19:36:33.634 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.634 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:536456ea:::benchmark_data_smithi188_104537_object103506:head# 2024-04-01T19:36:33.634 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.634 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53654576:::benchmark_data_smithi188_104537_object88040:head# 2024-04-01T19:36:33.634 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.634 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53654ebe:::benchmark_data_smithi188_104537_object92655:head# 2024-04-01T19:36:33.634 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.634 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53667bb9:::benchmark_data_smithi188_104537_object26540:head# 2024-04-01T19:36:33.634 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.634 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5367ccea:::benchmark_data_smithi188_104537_object80619:head# 2024-04-01T19:36:33.634 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.634 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:536808d8:::benchmark_data_smithi188_104537_object167597:head# 2024-04-01T19:36:33.634 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.635 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:536935f0:::benchmark_data_smithi188_104537_object35038:head# 2024-04-01T19:36:33.635 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.635 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53696a56:::benchmark_data_smithi188_104537_object122695:head# 2024-04-01T19:36:33.635 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.635 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53699d27:::benchmark_data_smithi188_104537_object33321:head# 2024-04-01T19:36:33.635 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.635 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:536a8435:::benchmark_data_smithi188_104537_object24508:head# 2024-04-01T19:36:33.635 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.635 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:536ab10d:::benchmark_data_smithi188_104537_object169892:head# 2024-04-01T19:36:33.635 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.635 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:536aec2e:::benchmark_data_smithi188_104537_object143049:head# 2024-04-01T19:36:33.635 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.635 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:536b1189:::benchmark_data_smithi188_104537_object118959:head# 2024-04-01T19:36:33.635 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.636 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:536bdf6a:::benchmark_data_smithi188_104537_object16646:head# 2024-04-01T19:36:33.636 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.636 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:536ca248:::benchmark_data_smithi188_104537_object30274:head# 2024-04-01T19:36:33.636 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.636 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:536d320d:::benchmark_data_smithi188_104537_object116360:head# 2024-04-01T19:36:33.636 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.636 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:536d3a30:::benchmark_data_smithi188_104537_object38542:head# 2024-04-01T19:36:33.636 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.636 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:536d6aea:::benchmark_data_smithi188_104537_object19388:head# 2024-04-01T19:36:33.636 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.636 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:536ddb84:::benchmark_data_smithi188_104537_object138708:head# 2024-04-01T19:36:33.636 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:536f20e2:::benchmark_data_smithi188_104537_object122305:head# 2024-04-01T19:36:33.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:536f492e:::benchmark_data_smithi188_104537_object151516:head# 2024-04-01T19:36:33.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:536f98e6:::benchmark_data_smithi188_104537_object147006:head# 2024-04-01T19:36:33.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:536faf49:::benchmark_data_smithi188_104537_object126583:head# 2024-04-01T19:36:33.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5370a070:::benchmark_data_smithi188_104537_object33474:head# 2024-04-01T19:36:33.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5370bceb:::benchmark_data_smithi188_104537_object72986:head# 2024-04-01T19:36:33.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53712d8a:::benchmark_data_smithi188_104537_object17245:head# 2024-04-01T19:36:33.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5371cde9:::benchmark_data_smithi188_104537_object170123:head# 2024-04-01T19:36:33.638 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.638 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53720712:::benchmark_data_smithi188_104537_object29518:head# 2024-04-01T19:36:33.638 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.638 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53721d6d:::benchmark_data_smithi188_104537_object69097:head# 2024-04-01T19:36:33.638 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.638 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:537407db:::benchmark_data_smithi188_104537_object82764:head# 2024-04-01T19:36:33.638 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.638 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53742b6e:::benchmark_data_smithi188_104537_object27052:head# 2024-04-01T19:36:33.638 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.638 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5374ecbc:::benchmark_data_smithi188_104537_object66780:head# 2024-04-01T19:36:33.638 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.638 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:537519eb:::benchmark_data_smithi188_104537_object51967:head# 2024-04-01T19:36:33.638 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:537587ed:::benchmark_data_smithi188_104537_object130015:head# 2024-04-01T19:36:33.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5376033c:::benchmark_data_smithi188_104537_object17423:head# 2024-04-01T19:36:33.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53761984:::benchmark_data_smithi188_104537_object37291:head# 2024-04-01T19:36:33.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53761e21:::benchmark_data_smithi188_104537_object116010:head# 2024-04-01T19:36:33.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5376b1fc:::benchmark_data_smithi188_104537_object43992:head# 2024-04-01T19:36:33.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5376d1dd:::benchmark_data_smithi188_104537_object119408:head# 2024-04-01T19:36:33.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5376ed80:::benchmark_data_smithi188_104537_object86466:head# 2024-04-01T19:36:33.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5377382c:::benchmark_data_smithi188_104537_object41395:head# 2024-04-01T19:36:33.640 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.640 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5377c1f2:::benchmark_data_smithi188_104537_object26172:head# 2024-04-01T19:36:33.640 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.640 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53781319:::benchmark_data_smithi188_104537_object96516:head# 2024-04-01T19:36:33.640 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.640 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53782849:::benchmark_data_smithi188_104537_object65242:head# 2024-04-01T19:36:33.640 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.640 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:537885ea:::benchmark_data_smithi188_104537_object70730:head# 2024-04-01T19:36:33.640 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.640 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53789649:::benchmark_data_smithi188_104537_object162794:head# 2024-04-01T19:36:33.640 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.640 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5378e53b:::benchmark_data_smithi188_104537_object160381:head# 2024-04-01T19:36:33.640 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.640 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5378fc78:::benchmark_data_smithi188_104537_object44189:head# 2024-04-01T19:36:33.641 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.641 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53794bc1:::benchmark_data_smithi188_104537_object73704:head# 2024-04-01T19:36:33.641 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.641 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5379cb4c:::benchmark_data_smithi188_104537_object126230:head# 2024-04-01T19:36:33.641 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.641 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:537a34c8:::benchmark_data_smithi188_104537_object149429:head# 2024-04-01T19:36:33.641 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.641 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:537ae9cf:::benchmark_data_smithi188_104537_object57761:head# 2024-04-01T19:36:33.641 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.641 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:537b05d9:::benchmark_data_smithi188_104537_object134697:head# 2024-04-01T19:36:33.642 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.642 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:537bc076:::benchmark_data_smithi188_104537_object169357:head# 2024-04-01T19:36:33.642 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.642 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:537bc4ba:::benchmark_data_smithi188_104537_object156122:head# 2024-04-01T19:36:33.642 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.643 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:537bcace:::benchmark_data_smithi188_104537_object121351:head# 2024-04-01T19:36:33.643 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.643 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:537c41c8:::benchmark_data_smithi188_104537_object125021:head# 2024-04-01T19:36:33.643 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.643 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:537c64b9:::benchmark_data_smithi188_104537_object142177:head# 2024-04-01T19:36:33.644 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.644 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:537e3b5f:::benchmark_data_smithi188_104537_object34952:head# 2024-04-01T19:36:33.644 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.644 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:537ec720:::benchmark_data_smithi188_104537_object113356:head# 2024-04-01T19:36:33.644 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.645 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:537eca0a:::benchmark_data_smithi188_104537_object157036:head# 2024-04-01T19:36:33.645 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.646 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:537ed502:::benchmark_data_smithi188_104537_object101559:head# 2024-04-01T19:36:33.646 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.646 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53804928:::benchmark_data_smithi188_104537_object131794:head# 2024-04-01T19:36:33.646 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.646 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53818a80:::benchmark_data_smithi188_104537_object53828:head# 2024-04-01T19:36:33.646 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.646 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5381fa54:::benchmark_data_smithi188_104537_object46666:head# 2024-04-01T19:36:33.646 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.646 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53824710:::benchmark_data_smithi188_104537_object157776:head# 2024-04-01T19:36:33.647 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.647 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53838b30:::benchmark_data_smithi188_104537_object44734:head# 2024-04-01T19:36:33.647 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.648 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:538417ef:::benchmark_data_smithi188_104537_object152524:head# 2024-04-01T19:36:33.648 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.648 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5384208e:::benchmark_data_smithi188_104537_object33251:head# 2024-04-01T19:36:33.648 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.648 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53848559:::benchmark_data_smithi188_104537_object89756:head# 2024-04-01T19:36:33.648 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.648 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5384de9b:::benchmark_data_smithi188_104537_object96846:head# 2024-04-01T19:36:33.648 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.648 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53874f95:::benchmark_data_smithi188_104537_object111606:head# 2024-04-01T19:36:33.648 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.648 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:538783f2:::benchmark_data_smithi188_104537_object153717:head# 2024-04-01T19:36:33.649 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.649 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5387bbe9:::benchmark_data_smithi188_104537_object160005:head# 2024-04-01T19:36:33.649 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.653 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5387e0b3:::benchmark_data_smithi188_104537_object103194:head# 2024-04-01T19:36:33.653 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.654 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:538800cb:::benchmark_data_smithi188_104537_object104778:head# 2024-04-01T19:36:33.654 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.654 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:538892cf:::benchmark_data_smithi188_104537_object170909:head# 2024-04-01T19:36:33.654 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.655 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:538b25cc:::benchmark_data_smithi188_104537_object156410:head# 2024-04-01T19:36:33.655 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.655 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:538b28e8:::benchmark_data_smithi188_104537_object21397:head# 2024-04-01T19:36:33.655 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.655 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:538c91c8:::benchmark_data_smithi188_104537_object56376:head# 2024-04-01T19:36:33.655 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.655 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:538cb46e:::benchmark_data_smithi188_104537_object68757:head# 2024-04-01T19:36:33.656 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.656 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:538d6f1b:::benchmark_data_smithi188_104537_object124750:head# 2024-04-01T19:36:33.656 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.656 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:538da68a:::benchmark_data_smithi188_104537_object62224:head# 2024-04-01T19:36:33.657 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.657 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:538e5c56:::benchmark_data_smithi188_104537_object171738:head# 2024-04-01T19:36:33.657 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.657 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:538ed744:::benchmark_data_smithi188_104537_object19131:head# 2024-04-01T19:36:33.657 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.658 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:538feeb3:::benchmark_data_smithi188_104537_object119392:head# 2024-04-01T19:36:33.658 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.658 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53904e97:::benchmark_data_smithi188_104537_object11484:head# 2024-04-01T19:36:33.658 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.658 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5390fb81:::benchmark_data_smithi188_104537_object80359:head# 2024-04-01T19:36:33.658 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.658 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5391557e:::benchmark_data_smithi188_104537_object115176:head# 2024-04-01T19:36:33.658 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.658 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53918e64:::benchmark_data_smithi188_104537_object141194:head# 2024-04-01T19:36:33.659 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.660 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5391cba9:::benchmark_data_smithi188_104537_object66475:head# 2024-04-01T19:36:33.660 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.660 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5391fb13:::benchmark_data_smithi188_104537_object128082:head# 2024-04-01T19:36:33.660 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.660 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53921921:::benchmark_data_smithi188_104537_object96133:head# 2024-04-01T19:36:33.660 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.660 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5392210f:::benchmark_data_smithi188_104537_object146542:head# 2024-04-01T19:36:33.660 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.660 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53926926:::benchmark_data_smithi188_104537_object163549:head# 2024-04-01T19:36:33.660 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.661 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53927850:::benchmark_data_smithi188_104537_object127263:head# 2024-04-01T19:36:33.661 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.662 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5392a069:::benchmark_data_smithi188_104537_object114413:head# 2024-04-01T19:36:33.662 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.662 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5393f8e6:::benchmark_data_smithi188_104537_object96940:head# 2024-04-01T19:36:33.662 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.662 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5394781e:::benchmark_data_smithi188_104537_object54433:head# 2024-04-01T19:36:33.662 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.662 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5394da97:::benchmark_data_smithi188_104537_object78031:head# 2024-04-01T19:36:33.662 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.662 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53959e06:::benchmark_data_smithi188_104537_object31046:head# 2024-04-01T19:36:33.662 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.662 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5395da32:::benchmark_data_smithi188_104537_object89943:head# 2024-04-01T19:36:33.662 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.663 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:539700f3:::benchmark_data_smithi188_104537_object155824:head# 2024-04-01T19:36:33.663 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.663 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53971758:::benchmark_data_smithi188_104537_object150245:head# 2024-04-01T19:36:33.663 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5397661f:::benchmark_data_smithi188_104537_object133358:head# 2024-04-01T19:36:33.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53977832:::benchmark_data_smithi188_104537_object107168:head# 2024-04-01T19:36:33.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5397dae6:::benchmark_data_smithi188_104537_object67672:head# 2024-04-01T19:36:33.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:539866be:::benchmark_data_smithi188_104537_object150668:head# 2024-04-01T19:36:33.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5398946f:::benchmark_data_smithi188_104537_object25152:head# 2024-04-01T19:36:33.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53994085:::benchmark_data_smithi188_104537_object150306:head# 2024-04-01T19:36:33.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53994711:::benchmark_data_smithi188_104537_object87251:head# 2024-04-01T19:36:33.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:539a76a8:::benchmark_data_smithi188_104537_object13539:head# 2024-04-01T19:36:33.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:539a7cfd:::benchmark_data_smithi188_104537_object97564:head# 2024-04-01T19:36:33.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:539b253c:::benchmark_data_smithi188_104537_object110965:head# 2024-04-01T19:36:33.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:539ba94a:::benchmark_data_smithi188_104537_object12056:head# 2024-04-01T19:36:33.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:539bf831:::benchmark_data_smithi188_104537_object126667:head# 2024-04-01T19:36:33.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.669 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:539bfd51:::benchmark_data_smithi188_104537_object138048:head# 2024-04-01T19:36:33.669 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.669 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:539c015f:::benchmark_data_smithi188_104537_object86872:head# 2024-04-01T19:36:33.669 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.669 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:539c72a6:::benchmark_data_smithi188_104537_object148628:head# 2024-04-01T19:36:33.669 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.670 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:539c8199:::benchmark_data_smithi188_104537_object131797:head# 2024-04-01T19:36:33.670 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.670 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:539cbb6a:::benchmark_data_smithi188_104537_object171462:head# 2024-04-01T19:36:33.671 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.671 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:539d4193:::benchmark_data_smithi188_104537_object37990:head# 2024-04-01T19:36:33.671 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.671 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:539d58db:::benchmark_data_smithi188_104537_object86834:head# 2024-04-01T19:36:33.671 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.671 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:539dcea0:::benchmark_data_smithi188_104537_object50195:head# 2024-04-01T19:36:33.671 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.671 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:539e3344:::benchmark_data_smithi188_104537_object70211:head# 2024-04-01T19:36:33.671 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.671 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:539e4a5d:::benchmark_data_smithi188_104537_object126025:head# 2024-04-01T19:36:33.671 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.671 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:539e8331:::benchmark_data_smithi188_104537_object45284:head# 2024-04-01T19:36:33.671 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.671 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:539ee745:::benchmark_data_smithi188_104537_object92217:head# 2024-04-01T19:36:33.672 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.672 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:539f9f23:::benchmark_data_smithi188_104537_object103272:head# 2024-04-01T19:36:33.672 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.672 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:539fc9a6:::benchmark_data_smithi188_104537_object114471:head# 2024-04-01T19:36:33.672 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.672 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a02eb3:::benchmark_data_smithi188_104537_object16919:head# 2024-04-01T19:36:33.672 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.674 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a06cdd:::benchmark_data_smithi188_104537_object166435:head# 2024-04-01T19:36:33.674 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.674 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a08801:::benchmark_data_smithi188_104537_object101069:head# 2024-04-01T19:36:33.674 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.675 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a0f27b:::benchmark_data_smithi188_104537_object63109:head# 2024-04-01T19:36:33.675 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.675 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a187c0:::benchmark_data_smithi188_104537_object108413:head# 2024-04-01T19:36:33.675 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.675 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a1ddd9:::benchmark_data_smithi188_104537_object39725:head# 2024-04-01T19:36:33.675 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.675 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a1e26b:::benchmark_data_smithi188_104537_object96011:head# 2024-04-01T19:36:33.675 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.675 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a2291b:::benchmark_data_smithi188_104537_object135494:head# 2024-04-01T19:36:33.675 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.676 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a26045:::benchmark_data_smithi188_104537_object22080:head# 2024-04-01T19:36:33.676 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.676 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a28289:::benchmark_data_smithi188_104537_object51989:head# 2024-04-01T19:36:33.676 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.677 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a28d76:::benchmark_data_smithi188_104537_object107046:head# 2024-04-01T19:36:33.677 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.677 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a2b399:::benchmark_data_smithi188_104537_object52333:head# 2024-04-01T19:36:33.677 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.677 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a2cd33:::benchmark_data_smithi188_104537_object162210:head# 2024-04-01T19:36:33.677 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.677 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a30ee2:::benchmark_data_smithi188_104537_object123841:head# 2024-04-01T19:36:33.678 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.678 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a33104:::benchmark_data_smithi188_104537_object38782:head# 2024-04-01T19:36:33.678 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.682 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a33404:::benchmark_data_smithi188_104537_object83590:head# 2024-04-01T19:36:33.682 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.683 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a352ad:::benchmark_data_smithi188_104537_object162473:head# 2024-04-01T19:36:33.683 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.683 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a376a8:::benchmark_data_smithi188_104537_object100255:head# 2024-04-01T19:36:33.683 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.683 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a3833b:::benchmark_data_smithi188_104537_object20710:head# 2024-04-01T19:36:33.683 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.685 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a3f322:::benchmark_data_smithi188_104537_object67427:head# 2024-04-01T19:36:33.685 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.685 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a41538:::benchmark_data_smithi188_104537_object93656:head# 2024-04-01T19:36:33.685 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.685 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a44178:::benchmark_data_smithi188_104537_object49329:head# 2024-04-01T19:36:33.685 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.685 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a526fa:::benchmark_data_smithi188_104537_object160789:head# 2024-04-01T19:36:33.685 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.685 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a56739:::benchmark_data_smithi188_104537_object29706:head# 2024-04-01T19:36:33.685 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.686 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a5a012:::benchmark_data_smithi188_104537_object147519:head# 2024-04-01T19:36:33.686 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.687 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a5ab75:::benchmark_data_smithi188_104537_object55681:head# 2024-04-01T19:36:33.687 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.687 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a6077a:::benchmark_data_smithi188_104537_object23748:head# 2024-04-01T19:36:33.687 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.687 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a64d61:::benchmark_data_smithi188_104537_object131141:head# 2024-04-01T19:36:33.687 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.687 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a72f5e:::benchmark_data_smithi188_104537_object109074:head# 2024-04-01T19:36:33.687 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.688 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a7797a:::benchmark_data_smithi188_104537_object152260:head# 2024-04-01T19:36:33.688 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.688 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a7f066:::benchmark_data_smithi188_104537_object98678:head# 2024-04-01T19:36:33.688 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.689 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a8362e:::benchmark_data_smithi188_104537_object117390:head# 2024-04-01T19:36:33.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.689 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a85ff7:::benchmark_data_smithi188_104537_object76094:head# 2024-04-01T19:36:33.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.689 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a8669c:::benchmark_data_smithi188_104537_object113094:head# 2024-04-01T19:36:33.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.690 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a89f6b:::benchmark_data_smithi188_104537_object156842:head# 2024-04-01T19:36:33.690 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.691 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a8ef35:::benchmark_data_smithi188_104537_object123746:head# 2024-04-01T19:36:33.691 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.691 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a91235:::benchmark_data_smithi188_104537_object78440:head# 2024-04-01T19:36:33.692 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.692 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53a913ed:::benchmark_data_smithi188_104537_object128729:head# 2024-04-01T19:36:33.692 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.692 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53aa129b:::benchmark_data_smithi188_104537_object114773:head# 2024-04-01T19:36:33.692 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.693 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53aadd06:::benchmark_data_smithi188_104537_object145064:head# 2024-04-01T19:36:33.693 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.693 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53aafef2:::benchmark_data_smithi188_104537_object136799:head# 2024-04-01T19:36:33.693 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.693 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53abe602:::benchmark_data_smithi188_104537_object57226:head# 2024-04-01T19:36:33.694 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.694 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53abe993:::benchmark_data_smithi188_104537_object58540:head# 2024-04-01T19:36:33.694 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.694 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53abf997:::benchmark_data_smithi188_104537_object165492:head# 2024-04-01T19:36:33.694 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.695 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53ac21cb:::benchmark_data_smithi188_104537_object139027:head# 2024-04-01T19:36:33.695 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.695 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53ac22e0:::benchmark_data_smithi188_104537_object96934:head# 2024-04-01T19:36:33.695 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.695 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53ac570e:::benchmark_data_smithi188_104537_object17963:head# 2024-04-01T19:36:33.696 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.696 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53acb899:::benchmark_data_smithi188_104537_object46481:head# 2024-04-01T19:36:33.696 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.696 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53ad31b4:::benchmark_data_smithi188_104537_object139863:head# 2024-04-01T19:36:33.696 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.696 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53ad60ac:::benchmark_data_smithi188_104537_object41042:head# 2024-04-01T19:36:33.696 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.696 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53adcf1c:::benchmark_data_smithi188_104537_object99928:head# 2024-04-01T19:36:33.696 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53aef779:::benchmark_data_smithi188_104537_object51901:head# 2024-04-01T19:36:33.698 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.698 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53b009fa:::benchmark_data_smithi188_104537_object58701:head# 2024-04-01T19:36:33.698 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.698 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53b0a8be:::benchmark_data_smithi188_104537_object152613:head# 2024-04-01T19:36:33.698 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.698 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53b0c8c5:::benchmark_data_smithi188_104537_object52160:head# 2024-04-01T19:36:33.698 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.698 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53b19918:::benchmark_data_smithi188_104537_object64782:head# 2024-04-01T19:36:33.698 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.698 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53b1aa40:::benchmark_data_smithi188_104537_object100544:head# 2024-04-01T19:36:33.698 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53b27b50:::benchmark_data_smithi188_104537_object136505:head# 2024-04-01T19:36:33.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.702 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53b2d4d8:::benchmark_data_smithi188_104537_object84807:head# 2024-04-01T19:36:33.702 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.705 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53b2e07e:::benchmark_data_smithi188_104537_object83361:head# 2024-04-01T19:36:33.705 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.705 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53b31e43:::benchmark_data_smithi188_104537_object80023:head# 2024-04-01T19:36:33.705 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.705 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53b33620:::benchmark_data_smithi188_104537_object114576:head# 2024-04-01T19:36:33.705 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.705 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53b41ca5:::benchmark_data_smithi188_104537_object41945:head# 2024-04-01T19:36:33.705 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.705 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53b48750:::benchmark_data_smithi188_104537_object31438:head# 2024-04-01T19:36:33.705 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.706 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53b584ef:::benchmark_data_smithi188_104537_object75573:head# 2024-04-01T19:36:33.706 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.706 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53b6a217:::benchmark_data_smithi188_104537_object79711:head# 2024-04-01T19:36:33.706 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.706 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53b6c48b:::benchmark_data_smithi188_104537_object12211:head# 2024-04-01T19:36:33.706 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.706 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53b6da80:::benchmark_data_smithi188_104537_object27068:head# 2024-04-01T19:36:33.706 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.706 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53b6e9c7:::benchmark_data_smithi188_104537_object22069:head# 2024-04-01T19:36:33.706 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.707 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53b6f920:::benchmark_data_smithi188_104537_object53520:head# 2024-04-01T19:36:33.707 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.708 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53b71e12:::benchmark_data_smithi188_104537_object140146:head# 2024-04-01T19:36:33.708 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.708 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53b72b29:::benchmark_data_smithi188_104537_object163222:head# 2024-04-01T19:36:33.708 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.708 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53b8644f:::benchmark_data_smithi188_104537_object32634:head# 2024-04-01T19:36:33.708 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.708 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53b8f10f:::benchmark_data_smithi188_104537_object134610:head# 2024-04-01T19:36:33.708 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.708 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53b9537d:::benchmark_data_smithi188_104537_object109346:head# 2024-04-01T19:36:33.708 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.708 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53b9ecb2:::benchmark_data_smithi188_104537_object92877:head# 2024-04-01T19:36:33.708 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.709 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:36:33.713 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53ba63d8:::benchmark_data_smithi188_104537_object29013:head# 2024-04-01T19:36:33.713 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53bab0f4:::benchmark_data_smithi188_104537_object157472:head# 2024-04-01T19:36:33.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53bb1389:::benchmark_data_smithi188_104537_object150364:head# 2024-04-01T19:36:33.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53bb5a6c:::benchmark_data_smithi188_104537_object77887:head# 2024-04-01T19:36:33.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53bbb0db:::benchmark_data_smithi188_104537_object126343:head# 2024-04-01T19:36:33.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.716 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53bbb406:::benchmark_data_smithi188_104537_object139608:head# 2024-04-01T19:36:33.716 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.717 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53bbb785:::benchmark_data_smithi188_104537_object33096:head# 2024-04-01T19:36:33.717 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.717 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53bbd480:::benchmark_data_smithi188_104537_object12941:head# 2024-04-01T19:36:33.717 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.717 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53bc97d9:::benchmark_data_smithi188_104537_object48215:head# 2024-04-01T19:36:33.717 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.718 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53bcc72f:::benchmark_data_smithi188_104537_object63770:head# 2024-04-01T19:36:33.718 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.718 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53bd5a7b:::benchmark_data_smithi188_104537_object62053:head# 2024-04-01T19:36:33.718 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.718 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53bd99f9:::benchmark_data_smithi188_104537_object115217:head# 2024-04-01T19:36:33.718 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.718 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53bdbe5f:::benchmark_data_smithi188_104537_object101511:head# 2024-04-01T19:36:33.718 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.718 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53be3de9:::benchmark_data_smithi188_104537_object97614:head# 2024-04-01T19:36:33.718 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.718 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53be8f49:::benchmark_data_smithi188_104537_object73851:head# 2024-04-01T19:36:33.718 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53bec0e8:::benchmark_data_smithi188_104537_object31604:head# 2024-04-01T19:36:33.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53bf01ac:::benchmark_data_smithi188_104537_object68595:head# 2024-04-01T19:36:33.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53bf8129:::benchmark_data_smithi188_104537_object48997:head# 2024-04-01T19:36:33.721 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.721 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53bf973a:::benchmark_data_smithi188_104537_object142957:head# 2024-04-01T19:36:33.721 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.721 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53bfc2f3:::benchmark_data_smithi188_104537_object148550:head# 2024-04-01T19:36:33.721 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.721 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c02069:::benchmark_data_smithi188_104537_object162200:head# 2024-04-01T19:36:33.721 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.721 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c03365:::benchmark_data_smithi188_104537_object20615:head# 2024-04-01T19:36:33.721 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.721 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c04906:::benchmark_data_smithi188_104537_object30327:head# 2024-04-01T19:36:33.721 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.721 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c0576e:::benchmark_data_smithi188_104537_object46430:head# 2024-04-01T19:36:33.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.723 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c05e43:::benchmark_data_smithi188_104537_object76587:head# 2024-04-01T19:36:33.723 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.723 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c0c340:::benchmark_data_smithi188_104537_object138660:head# 2024-04-01T19:36:33.723 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.723 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c0e15e:::benchmark_data_smithi188_104537_object43812:head# 2024-04-01T19:36:33.723 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.723 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c2b895:::benchmark_data_smithi188_104537_object22951:head# 2024-04-01T19:36:33.723 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.723 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c2c228:::benchmark_data_smithi188_104537_object42735:head# 2024-04-01T19:36:33.723 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.727 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c2c53e:::benchmark_data_smithi188_104537_object83238:head# 2024-04-01T19:36:33.727 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.727 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c3d59c:::benchmark_data_smithi188_104537_object41587:head# 2024-04-01T19:36:33.727 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.729 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c404d1:::benchmark_data_smithi188_104537_object15864:head# 2024-04-01T19:36:33.729 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.729 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c428c0:::benchmark_data_smithi188_104537_object92987:head# 2024-04-01T19:36:33.729 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.729 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c4bcab:::benchmark_data_smithi188_104537_object166608:head# 2024-04-01T19:36:33.729 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.729 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c4d122:::benchmark_data_smithi188_104537_object139354:head# 2024-04-01T19:36:33.729 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.729 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c52e0b:::benchmark_data_smithi188_104537_object150244:head# 2024-04-01T19:36:33.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c5f1b8:::benchmark_data_smithi188_104537_object23999:head# 2024-04-01T19:36:33.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.731 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c69ce0:::benchmark_data_smithi188_104537_object131178:head# 2024-04-01T19:36:33.731 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.731 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c6ae1e:::benchmark_data_smithi188_104537_object95390:head# 2024-04-01T19:36:33.731 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.732 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c6eaec:::benchmark_data_smithi188_104537_object168059:head# 2024-04-01T19:36:33.732 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.732 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c6fde1:::benchmark_data_smithi188_104537_object90058:head# 2024-04-01T19:36:33.732 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.732 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c70a74:::benchmark_data_smithi188_104537_object74919:head# 2024-04-01T19:36:33.732 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.732 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c7996e:::benchmark_data_smithi188_104537_object74682:head# 2024-04-01T19:36:33.732 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.732 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c79fc2:::benchmark_data_smithi188_104537_object78446:head# 2024-04-01T19:36:33.732 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.733 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c7da09:::benchmark_data_smithi188_104537_object71956:head# 2024-04-01T19:36:33.733 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.734 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c7ee74:::benchmark_data_smithi188_104537_object141526:head# 2024-04-01T19:36:33.734 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.734 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c82034:::benchmark_data_smithi188_104537_object70243:head# 2024-04-01T19:36:33.734 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.734 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c88373:::benchmark_data_smithi188_104537_object167063:head# 2024-04-01T19:36:33.734 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.734 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c932a3:::benchmark_data_smithi188_104537_object17658:head# 2024-04-01T19:36:33.734 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.734 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c9f868:::benchmark_data_smithi188_104537_object24602:head# 2024-04-01T19:36:33.734 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.734 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53c9ffcf:::benchmark_data_smithi188_104537_object171175:head# 2024-04-01T19:36:33.734 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.736 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53ca7423:::benchmark_data_smithi188_104537_object58610:head# 2024-04-01T19:36:33.736 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.736 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53cb4222:::benchmark_data_smithi188_104537_object100599:head# 2024-04-01T19:36:33.736 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.736 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53cb5428:::benchmark_data_smithi188_104537_object154922:head# 2024-04-01T19:36:33.736 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.736 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53cb8d1e:::benchmark_data_smithi188_104537_object67280:head# 2024-04-01T19:36:33.736 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.736 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53cbd414:::benchmark_data_smithi188_104537_object47574:head# 2024-04-01T19:36:33.736 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.736 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53cc7b39:::benchmark_data_smithi188_104537_object137579:head# 2024-04-01T19:36:33.736 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.736 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53ccaf82:::benchmark_data_smithi188_104537_object83221:head# 2024-04-01T19:36:33.737 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.737 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53ccee40:::benchmark_data_smithi188_104537_object154657:head# 2024-04-01T19:36:33.737 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53cdec19:::benchmark_data_smithi188_104537_object63124:head# 2024-04-01T19:36:33.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53ce4418:::benchmark_data_smithi188_104537_object139140:head# 2024-04-01T19:36:33.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53cf6293:::benchmark_data_smithi188_104537_object136390:head# 2024-04-01T19:36:33.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53cf8be3:::benchmark_data_smithi188_104537_object116082:head# 2024-04-01T19:36:33.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53cfa59c:::benchmark_data_smithi188_104537_object71332:head# 2024-04-01T19:36:33.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53cfda95:::benchmark_data_smithi188_104537_object69862:head# 2024-04-01T19:36:33.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53cfdb3a:::benchmark_data_smithi188_104537_object75901:head# 2024-04-01T19:36:33.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53d1195c:::benchmark_data_smithi188_104537_object136667:head# 2024-04-01T19:36:33.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53d11d05:::benchmark_data_smithi188_104537_object121509:head# 2024-04-01T19:36:33.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.741 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53d1cf61:::benchmark_data_smithi188_104537_object108804:head# 2024-04-01T19:36:33.741 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.741 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53d1e873:::benchmark_data_smithi188_104537_object21019:head# 2024-04-01T19:36:33.741 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.741 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53d204db:::benchmark_data_smithi188_104537_object144796:head# 2024-04-01T19:36:33.741 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.741 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53d2ac99:::benchmark_data_smithi188_104537_object27506:head# 2024-04-01T19:36:33.741 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.741 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53d2be4d:::benchmark_data_smithi188_104537_object100682:head# 2024-04-01T19:36:33.741 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.741 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53d2d42b:::benchmark_data_smithi188_104537_object132081:head# 2024-04-01T19:36:33.741 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.742 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53d49668:::benchmark_data_smithi188_104537_object149310:head# 2024-04-01T19:36:33.742 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.742 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53d6d8a1:::benchmark_data_smithi188_104537_object160046:head# 2024-04-01T19:36:33.742 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.742 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53d6f5a0:::benchmark_data_smithi188_104537_object117067:head# 2024-04-01T19:36:33.742 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.742 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53d76d14:::benchmark_data_smithi188_104537_object74249:head# 2024-04-01T19:36:33.742 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.748 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53d7aecc:::benchmark_data_smithi188_104537_object64551:head# 2024-04-01T19:36:33.748 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.748 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53d9cacf:::benchmark_data_smithi188_104537_object72804:head# 2024-04-01T19:36:33.749 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.749 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53d9e55a:::benchmark_data_smithi188_104537_object99931:head# 2024-04-01T19:36:33.749 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.750 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53da531c:::benchmark_data_smithi188_104537_object52188:head# 2024-04-01T19:36:33.750 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.750 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53daadf2:::benchmark_data_smithi188_104537_object56648:head# 2024-04-01T19:36:33.751 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.751 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53db2cf4:::benchmark_data_smithi188_104537_object65264:head# 2024-04-01T19:36:33.751 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.751 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53db772e:::benchmark_data_smithi188_104537_object45889:head# 2024-04-01T19:36:33.751 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.751 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53dbb043:::benchmark_data_smithi188_104537_object73590:head# 2024-04-01T19:36:33.751 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.751 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53dbbcbe:::benchmark_data_smithi188_104537_object45674:head# 2024-04-01T19:36:33.751 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.752 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:33.755 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53dc0dc7:::benchmark_data_smithi188_104537_object98698:head# 2024-04-01T19:36:33.755 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.755 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53dc390f:::benchmark_data_smithi188_104537_object153635:head# 2024-04-01T19:36:33.755 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.756 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53dc6c1a:::benchmark_data_smithi188_104537_object48547:head# 2024-04-01T19:36:33.756 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.756 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53dc92c5:::benchmark_data_smithi188_104537_object129108:head# 2024-04-01T19:36:33.756 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.757 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53dcd6c6:::benchmark_data_smithi188_104537_object103684:head# 2024-04-01T19:36:33.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53dd09cb:::benchmark_data_smithi188_104537_object124643:head# 2024-04-01T19:36:33.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53dd5ddd:::benchmark_data_smithi188_104537_object144321:head# 2024-04-01T19:36:33.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53de806d:::benchmark_data_smithi188_104537_object133078:head# 2024-04-01T19:36:33.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53df454e:::benchmark_data_smithi188_104537_object76403:head# 2024-04-01T19:36:33.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53df5f38:::benchmark_data_smithi188_104537_object95642:head# 2024-04-01T19:36:33.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e068e3:::benchmark_data_smithi188_104537_object65052:head# 2024-04-01T19:36:33.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.760 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e0c1c8:::benchmark_data_smithi188_104537_object16162:head# 2024-04-01T19:36:33.760 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.760 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e0db90:::benchmark_data_smithi188_104537_object152901:head# 2024-04-01T19:36:33.760 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.760 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e12efc:::benchmark_data_smithi188_104537_object24565:head# 2024-04-01T19:36:33.760 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.760 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e1e35c:::benchmark_data_smithi188_104537_object47663:head# 2024-04-01T19:36:33.760 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.760 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e26493:::benchmark_data_smithi188_104537_object62864:head# 2024-04-01T19:36:33.760 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:33 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2700879020' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:36:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:33.761 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e275b9:::benchmark_data_smithi188_104537_object163773:head# 2024-04-01T19:36:33.761 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.762 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e2d245:::benchmark_data_smithi188_104537_object41514:head# 2024-04-01T19:36:33.762 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.762 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e2d3f2:::benchmark_data_smithi188_104537_object84045:head# 2024-04-01T19:36:33.763 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.763 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e38ab0:::benchmark_data_smithi188_104537_object37987:head# 2024-04-01T19:36:33.763 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.763 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e3be8c:::benchmark_data_smithi188_104537_object129760:head# 2024-04-01T19:36:33.763 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.764 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e44ae6:::benchmark_data_smithi188_104537_object160223:head# 2024-04-01T19:36:33.764 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.764 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e4e534:::benchmark_data_smithi188_104537_object75558:head# 2024-04-01T19:36:33.764 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e4e8d5:::benchmark_data_smithi188_104537_object154017:head# 2024-04-01T19:36:33.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.766 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e569f5:::benchmark_data_smithi188_104537_object155398:head# 2024-04-01T19:36:33.766 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.771 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e56ad9:::benchmark_data_smithi188_104537_object12306:head# 2024-04-01T19:36:33.771 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.771 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e66156:::benchmark_data_smithi188_104537_object45624:head# 2024-04-01T19:36:33.771 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.771 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e6b77f:::benchmark_data_smithi188_104537_object40820:head# 2024-04-01T19:36:33.771 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.771 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e7c9ea:::benchmark_data_smithi188_104537_object163842:head# 2024-04-01T19:36:33.771 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.771 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e82915:::benchmark_data_smithi188_104537_object116542:head# 2024-04-01T19:36:33.771 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.771 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e84dda:::benchmark_data_smithi188_104537_object20689:head# 2024-04-01T19:36:33.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e8666a:::benchmark_data_smithi188_104537_object92582:head# 2024-04-01T19:36:33.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e8acc4:::benchmark_data_smithi188_104537_object168088:head# 2024-04-01T19:36:33.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e98178:::benchmark_data_smithi188_104537_object87406:head# 2024-04-01T19:36:33.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e99903:::benchmark_data_smithi188_104537_object109367:head# 2024-04-01T19:36:33.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53e9b252:::benchmark_data_smithi188_104537_object122888:head# 2024-04-01T19:36:33.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53ea3104:::benchmark_data_smithi188_104537_object114985:head# 2024-04-01T19:36:33.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53ea4873:::benchmark_data_smithi188_104537_object60871:head# 2024-04-01T19:36:33.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53eae52c:::benchmark_data_smithi188_104537_object61600:head# 2024-04-01T19:36:33.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53eb3dbd:::benchmark_data_smithi188_104537_object28988:head# 2024-04-01T19:36:33.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53eb7c90:::benchmark_data_smithi188_104537_object160113:head# 2024-04-01T19:36:33.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53ec254c:::benchmark_data_smithi188_104537_object146283:head# 2024-04-01T19:36:33.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53ec3335:::benchmark_data_smithi188_104537_object29070:head# 2024-04-01T19:36:33.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.776 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53ec441d:::benchmark_data_smithi188_104537_object18793:head# 2024-04-01T19:36:33.776 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53ecbb67:::benchmark_data_smithi188_104537_object139267:head# 2024-04-01T19:36:33.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53ece765:::benchmark_data_smithi188_104537_object57808:head# 2024-04-01T19:36:33.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53ed89b5:::benchmark_data_smithi188_104537_object80596:head# 2024-04-01T19:36:33.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53edf78a:::benchmark_data_smithi188_104537_object132700:head# 2024-04-01T19:36:33.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53edfefe:::benchmark_data_smithi188_104537_object99411:head# 2024-04-01T19:36:33.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53eff8d7:::benchmark_data_smithi188_104537_object24164:head# 2024-04-01T19:36:33.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53f05833:::benchmark_data_smithi188_104537_object66604:head# 2024-04-01T19:36:33.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53f1bcdc:::benchmark_data_smithi188_104537_object68880:head# 2024-04-01T19:36:33.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53f22317:::benchmark_data_smithi188_104537_object150365:head# 2024-04-01T19:36:33.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53f223e2:::benchmark_data_smithi188_104537_object121918:head# 2024-04-01T19:36:33.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53f2cd7b:::benchmark_data_smithi188_104537_object119935:head# 2024-04-01T19:36:33.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53f2ede1:::benchmark_data_smithi188_104537_object137371:head# 2024-04-01T19:36:33.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53f2f51a:::benchmark_data_smithi188_104537_object140107:head# 2024-04-01T19:36:33.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53f35a11:::benchmark_data_smithi188_104537_object32459:head# 2024-04-01T19:36:33.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.779 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53f42970:::benchmark_data_smithi188_104537_object89854:head# 2024-04-01T19:36:33.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.779 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53f436f3:::benchmark_data_smithi188_104537_object48538:head# 2024-04-01T19:36:33.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.779 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53f465f8:::benchmark_data_smithi188_104537_object27912:head# 2024-04-01T19:36:33.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.779 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53f48b2f:::benchmark_data_smithi188_104537_object18583:head# 2024-04-01T19:36:33.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.779 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53f5f8c1:::benchmark_data_smithi188_104537_object116368:head# 2024-04-01T19:36:33.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.782 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53f65d7f:::benchmark_data_smithi188_104537_object92651:head# 2024-04-01T19:36:33.782 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.782 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53f69c57:::benchmark_data_smithi188_104537_object150784:head# 2024-04-01T19:36:33.782 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.782 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53f6e4e4:::benchmark_data_smithi188_104537_object162774:head# 2024-04-01T19:36:33.783 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.783 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53f7371b:::benchmark_data_smithi188_104537_object42229:head# 2024-04-01T19:36:33.783 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.783 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53f79543:::benchmark_data_smithi188_104537_object53630:head# 2024-04-01T19:36:33.783 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.783 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53f7b8c3:::benchmark_data_smithi188_104537_object123413:head# 2024-04-01T19:36:33.783 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.783 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53f829d1:::benchmark_data_smithi188_104537_object170522:head# 2024-04-01T19:36:33.783 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.783 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53f947a3:::benchmark_data_smithi188_104537_object157958:head# 2024-04-01T19:36:33.783 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.783 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53f97f6a:::benchmark_data_smithi188_104537_object41323:head# 2024-04-01T19:36:33.783 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.783 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53f9a891:::benchmark_data_smithi188_104537_object138530:head# 2024-04-01T19:36:33.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.784 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53fa2556:::benchmark_data_smithi188_104537_object42179:head# 2024-04-01T19:36:33.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.784 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53fa700d:::benchmark_data_smithi188_104537_object53095:head# 2024-04-01T19:36:33.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.784 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53faa640:::benchmark_data_smithi188_104537_object155604:head# 2024-04-01T19:36:33.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.784 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53fb5340:::benchmark_data_smithi188_104537_object117414:head# 2024-04-01T19:36:33.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.784 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53fbce5a:::benchmark_data_smithi188_104537_object145812:head# 2024-04-01T19:36:33.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.784 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53fbecda:::benchmark_data_smithi188_104537_object87345:head# 2024-04-01T19:36:33.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.784 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53fc8b7c:::benchmark_data_smithi188_104537_object110557:head# 2024-04-01T19:36:33.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.785 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53fca9c9:::benchmark_data_smithi188_104537_object60383:head# 2024-04-01T19:36:33.785 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53fccb8c:::benchmark_data_smithi188_104537_object34882:head# 2024-04-01T19:36:33.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53ff1819:::benchmark_data_smithi188_104537_object102150:head# 2024-04-01T19:36:33.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53ff3046:::benchmark_data_smithi188_104537_object14717:head# 2024-04-01T19:36:33.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53ff85ca:::benchmark_data_smithi188_104537_object53723:head# 2024-04-01T19:36:33.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:53ffa60f:::benchmark_data_smithi188_104537_object38277:head# 2024-04-01T19:36:33.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54008845:::benchmark_data_smithi188_104537_object80447:head# 2024-04-01T19:36:33.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5401eb21:::benchmark_data_smithi188_104537_object69856:head# 2024-04-01T19:36:33.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54020976:::benchmark_data_smithi188_104537_object107185:head# 2024-04-01T19:36:33.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54021f55:::benchmark_data_smithi188_104537_object162122:head# 2024-04-01T19:36:33.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:540258a4:::benchmark_data_smithi188_104537_object73220:head# 2024-04-01T19:36:33.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5402bcfe:::benchmark_data_smithi188_104537_object147483:head# 2024-04-01T19:36:33.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5402e0fb:::benchmark_data_smithi188_104537_object37062:head# 2024-04-01T19:36:33.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:540354a8:::benchmark_data_smithi188_104537_object170263:head# 2024-04-01T19:36:33.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54035b89:::benchmark_data_smithi188_104537_object165551:head# 2024-04-01T19:36:33.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:540386d0:::benchmark_data_smithi188_104537_object12082:head# 2024-04-01T19:36:33.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.789 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5404621e:::benchmark_data_smithi188_104537_object117850:head# 2024-04-01T19:36:33.789 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.789 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54047e18:::benchmark_data_smithi188_104537_object137784:head# 2024-04-01T19:36:33.789 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.789 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:540571f9:::benchmark_data_smithi188_104537_object67740:head# 2024-04-01T19:36:33.789 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.789 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5406bf67:::benchmark_data_smithi188_104537_object73788:head# 2024-04-01T19:36:33.790 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.791 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:540776b8:::benchmark_data_smithi188_104537_object144603:head# 2024-04-01T19:36:33.791 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.791 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:540815bb:::benchmark_data_smithi188_104537_object15314:head# 2024-04-01T19:36:33.791 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.791 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54090f80:::benchmark_data_smithi188_104537_object30049:head# 2024-04-01T19:36:33.791 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.791 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5409b846:::benchmark_data_smithi188_104537_object38393:head# 2024-04-01T19:36:33.791 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.791 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:540a2a0e:::benchmark_data_smithi188_104537_object55079:head# 2024-04-01T19:36:33.791 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.791 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:540af463:::benchmark_data_smithi188_104537_object170013:head# 2024-04-01T19:36:33.791 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.791 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:540bcf2f:::benchmark_data_smithi188_104537_object99706:head# 2024-04-01T19:36:33.792 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.792 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:540c7008:::benchmark_data_smithi188_104537_object129404:head# 2024-04-01T19:36:33.792 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.792 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:540c872d:::benchmark_data_smithi188_104537_object72538:head# 2024-04-01T19:36:33.792 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:540cf9b2:::benchmark_data_smithi188_104537_object128332:head# 2024-04-01T19:36:33.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.795 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:540d0bb3:::benchmark_data_smithi188_104537_object88670:head# 2024-04-01T19:36:33.795 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.795 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:540d4191:::benchmark_data_smithi188_104537_object116994:head# 2024-04-01T19:36:33.795 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.795 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:540db1b5:::benchmark_data_smithi188_104537_object13562:head# 2024-04-01T19:36:33.795 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.795 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:540e1165:::benchmark_data_smithi188_104537_object21371:head# 2024-04-01T19:36:33.795 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.795 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:540e2255:::benchmark_data_smithi188_104537_object169037:head# 2024-04-01T19:36:33.795 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.795 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:540e5778:::benchmark_data_smithi188_104537_object148648:head# 2024-04-01T19:36:33.795 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.795 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:540e7151:::benchmark_data_smithi188_104537_object21490:head# 2024-04-01T19:36:33.795 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:540e9394:::benchmark_data_smithi188_104537_object121886:head# 2024-04-01T19:36:33.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:540eb0a4:::benchmark_data_smithi188_104537_object163883:head# 2024-04-01T19:36:33.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:540eb22d:::benchmark_data_smithi188_104537_object92952:head# 2024-04-01T19:36:33.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:541018e9:::benchmark_data_smithi188_104537_object165145:head# 2024-04-01T19:36:33.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54102440:::benchmark_data_smithi188_104537_object91767:head# 2024-04-01T19:36:33.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5410934c:::benchmark_data_smithi188_104537_object147217:head# 2024-04-01T19:36:33.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.797 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:36:33.799 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54109fc4:::benchmark_data_smithi188_104537_object136814:head# 2024-04-01T19:36:33.799 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.799 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5410c5eb:::benchmark_data_smithi188_104537_object82967:head# 2024-04-01T19:36:33.799 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.799 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5410fdf8:::benchmark_data_smithi188_104537_object165184:head# 2024-04-01T19:36:33.799 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.799 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54112131:::benchmark_data_smithi188_104537_object57464:head# 2024-04-01T19:36:33.799 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.799 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5411a85f:::benchmark_data_smithi188_104537_object43880:head# 2024-04-01T19:36:33.799 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.800 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5411a889:::benchmark_data_smithi188_104537_object136369:head# 2024-04-01T19:36:33.800 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.800 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54127383:::benchmark_data_smithi188_104537_object119216:head# 2024-04-01T19:36:33.800 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.800 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:541353e3:::benchmark_data_smithi188_104537_object101992:head# 2024-04-01T19:36:33.800 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.800 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:541467c2:::benchmark_data_smithi188_104537_object118335:head# 2024-04-01T19:36:33.800 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.800 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54149755:::benchmark_data_smithi188_104537_object90988:head# 2024-04-01T19:36:33.800 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.800 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:541504f0:::benchmark_data_smithi188_104537_object64521:head# 2024-04-01T19:36:33.800 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.800 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54150b1a:::benchmark_data_smithi188_104537_object132227:head# 2024-04-01T19:36:33.800 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.800 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54154175:::benchmark_data_smithi188_104537_object55032:head# 2024-04-01T19:36:33.801 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.801 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5415d2c0:::benchmark_data_smithi188_104537_object68781:head# 2024-04-01T19:36:33.801 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.801 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5416067a:::benchmark_data_smithi188_104537_object166815:head# 2024-04-01T19:36:33.801 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.802 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:33.802 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54161d2a:::benchmark_data_smithi188_104537_object148321:head# 2024-04-01T19:36:33.802 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.802 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54167290:::benchmark_data_smithi188_104537_object165021:head# 2024-04-01T19:36:33.802 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.802 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:36:33.803 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:36:33.806 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5416a731:::benchmark_data_smithi188_104537_object49162:head# 2024-04-01T19:36:33.806 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.806 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54170612:::benchmark_data_smithi188_104537_object168195:head# 2024-04-01T19:36:33.806 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.806 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54182c2e:::benchmark_data_smithi188_104537_object71322:head# 2024-04-01T19:36:33.806 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.807 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54185748:::benchmark_data_smithi188_104537_object43277:head# 2024-04-01T19:36:33.807 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.807 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5418e909:::benchmark_data_smithi188_104537_object90737:head# 2024-04-01T19:36:33.807 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.807 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5419d2a3:::benchmark_data_smithi188_104537_object72627:head# 2024-04-01T19:36:33.807 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.807 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:541a5c7f:::benchmark_data_smithi188_104537_object32628:head# 2024-04-01T19:36:33.807 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.807 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:541a9e8f:::benchmark_data_smithi188_104537_object38561:head# 2024-04-01T19:36:33.807 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.807 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:541b42c9:::benchmark_data_smithi188_104537_object75165:head# 2024-04-01T19:36:33.807 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.807 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:541d18a6:::benchmark_data_smithi188_104537_object69509:head# 2024-04-01T19:36:33.807 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.808 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:541d4078:::benchmark_data_smithi188_104537_object159949:head# 2024-04-01T19:36:33.808 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.808 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:541d5f04:::benchmark_data_smithi188_104537_object147775:head# 2024-04-01T19:36:33.808 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.808 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:541d9e56:::benchmark_data_smithi188_104537_object113056:head# 2024-04-01T19:36:33.808 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.808 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:541dc688:::benchmark_data_smithi188_104537_object93373:head# 2024-04-01T19:36:33.808 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.808 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:541e1cb8:::benchmark_data_smithi188_104537_object171099:head# 2024-04-01T19:36:33.808 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.808 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:541e6c61:::benchmark_data_smithi188_104537_object56649:head# 2024-04-01T19:36:33.808 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.808 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:541e9a74:::benchmark_data_smithi188_104537_object152438:head# 2024-04-01T19:36:33.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.809 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:541ebe05:::benchmark_data_smithi188_104537_object23054:head# 2024-04-01T19:36:33.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.809 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:541f0507:::benchmark_data_smithi188_104537_object47082:head# 2024-04-01T19:36:33.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.809 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:541f0bf2:::benchmark_data_smithi188_104537_object166708:head# 2024-04-01T19:36:33.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.809 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:541f3de5:::benchmark_data_smithi188_104537_object63070:head# 2024-04-01T19:36:33.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.809 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:541fb9a5:::benchmark_data_smithi188_104537_object91459:head# 2024-04-01T19:36:33.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.809 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:541fedc3:::benchmark_data_smithi188_104537_object38016:head# 2024-04-01T19:36:33.810 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.810 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54206d4b:::benchmark_data_smithi188_104537_object70070:head# 2024-04-01T19:36:33.810 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.811 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5421075d:::benchmark_data_smithi188_104537_object111689:head# 2024-04-01T19:36:33.811 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.811 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:542199c7:::benchmark_data_smithi188_104537_object66241:head# 2024-04-01T19:36:33.811 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.811 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5421dd36:::benchmark_data_smithi188_104537_object128925:head# 2024-04-01T19:36:33.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5421f9af:::benchmark_data_smithi188_104537_object71640:head# 2024-04-01T19:36:33.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54220070:::benchmark_data_smithi188_104537_object80576:head# 2024-04-01T19:36:33.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54228153:::benchmark_data_smithi188_104537_object36152:head# 2024-04-01T19:36:33.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5422857e:::benchmark_data_smithi188_104537_object112860:head# 2024-04-01T19:36:33.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54229678:::benchmark_data_smithi188_104537_object96810:head# 2024-04-01T19:36:33.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5423461e:::benchmark_data_smithi188_104537_object23177:head# 2024-04-01T19:36:33.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.813 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5423dc8e:::benchmark_data_smithi188_104537_object18311:head# 2024-04-01T19:36:33.813 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.813 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5423e0e3:::benchmark_data_smithi188_104537_object170640:head# 2024-04-01T19:36:33.813 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.813 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:542412f3:::benchmark_data_smithi188_104537_object139246:head# 2024-04-01T19:36:33.813 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.813 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5424f948:::benchmark_data_smithi188_104537_object47797:head# 2024-04-01T19:36:33.813 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.813 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54267b2f:::benchmark_data_smithi188_104537_object64866:head# 2024-04-01T19:36:33.813 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.813 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54272c3a:::benchmark_data_smithi188_104537_object102452:head# 2024-04-01T19:36:33.813 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.813 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5427b7a7:::benchmark_data_smithi188_104537_object128233:head# 2024-04-01T19:36:33.814 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.814 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5427ba2f:::benchmark_data_smithi188_104537_object72604:head# 2024-04-01T19:36:33.814 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.814 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5427c32d:::benchmark_data_smithi188_104537_object92434:head# 2024-04-01T19:36:33.814 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.816 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5427ccea:::benchmark_data_smithi188_104537_object158725:head# 2024-04-01T19:36:33.816 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.816 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54283524:::benchmark_data_smithi188_104537_object79445:head# 2024-04-01T19:36:33.816 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.816 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:542926c7:::benchmark_data_smithi188_104537_object112415:head# 2024-04-01T19:36:33.816 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.817 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:542a29d1:::benchmark_data_smithi188_104537_object33078:head# 2024-04-01T19:36:33.817 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.817 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:542b1f4b:::benchmark_data_smithi188_104537_object43427:head# 2024-04-01T19:36:33.817 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.817 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:542b7230:::benchmark_data_smithi188_104537_object166625:head# 2024-04-01T19:36:33.817 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.817 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:542b8dfa:::benchmark_data_smithi188_104537_object94129:head# 2024-04-01T19:36:33.817 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.817 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:542b9b6e:::benchmark_data_smithi188_104537_object135761:head# 2024-04-01T19:36:33.817 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.817 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:542bee22:::benchmark_data_smithi188_104537_object43895:head# 2024-04-01T19:36:33.817 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.817 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:542bf1f2:::benchmark_data_smithi188_104537_object141667:head# 2024-04-01T19:36:33.817 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.817 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:542c3f4b:::benchmark_data_smithi188_104537_object39366:head# 2024-04-01T19:36:33.818 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:542ce068:::benchmark_data_smithi188_104537_object108099:head# 2024-04-01T19:36:33.818 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:542d1992:::benchmark_data_smithi188_104537_object96933:head# 2024-04-01T19:36:33.818 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:542e3a91:::benchmark_data_smithi188_104537_object165951:head# 2024-04-01T19:36:33.818 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:542eea0d:::benchmark_data_smithi188_104537_object80689:head# 2024-04-01T19:36:33.818 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:542ef183:::benchmark_data_smithi188_104537_object126384:head# 2024-04-01T19:36:33.818 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.819 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:542ef3d9:::benchmark_data_smithi188_104537_object70281:head# 2024-04-01T19:36:33.819 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.820 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:542f7133:::benchmark_data_smithi188_104537_object166936:head# 2024-04-01T19:36:33.820 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.820 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:542f9c8c:::benchmark_data_smithi188_104537_object93576:head# 2024-04-01T19:36:33.820 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.820 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:543018cf:::benchmark_data_smithi188_104537_object142266:head# 2024-04-01T19:36:33.820 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.820 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54302993:::benchmark_data_smithi188_104537_object161593:head# 2024-04-01T19:36:33.820 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.821 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54304203:::benchmark_data_smithi188_104537_object84943:head# 2024-04-01T19:36:33.821 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.821 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5430e119:::benchmark_data_smithi188_104537_object79049:head# 2024-04-01T19:36:33.821 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.821 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5431f28e:::benchmark_data_smithi188_104537_object139665:head# 2024-04-01T19:36:33.821 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.821 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5432afdd:::benchmark_data_smithi188_104537_object154413:head# 2024-04-01T19:36:33.821 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.821 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5433be0c:::benchmark_data_smithi188_104537_object66764:head# 2024-04-01T19:36:33.821 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.821 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:543559a4:::benchmark_data_smithi188_104537_object32064:head# 2024-04-01T19:36:33.822 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.822 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5435727e:::benchmark_data_smithi188_104537_object152024:head# 2024-04-01T19:36:33.822 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.822 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:543678b4:::benchmark_data_smithi188_104537_object25792:head# 2024-04-01T19:36:33.822 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.823 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54374b69:::benchmark_data_smithi188_104537_object137821:head# 2024-04-01T19:36:33.823 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.823 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54376729:::benchmark_data_smithi188_104537_object17214:head# 2024-04-01T19:36:33.823 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.823 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:543828b7:::benchmark_data_smithi188_104537_object146882:head# 2024-04-01T19:36:33.823 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.823 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5438c35a:::benchmark_data_smithi188_104537_object125939:head# 2024-04-01T19:36:33.823 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.823 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54390c1d:::benchmark_data_smithi188_104537_object68822:head# 2024-04-01T19:36:33.823 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.826 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54398515:::benchmark_data_smithi188_104537_object89346:head# 2024-04-01T19:36:33.826 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.826 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5439d38e:::benchmark_data_smithi188_104537_object165904:head# 2024-04-01T19:36:33.826 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.827 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:543a1173:::benchmark_data_smithi188_104537_object71785:head# 2024-04-01T19:36:33.827 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.832 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:543a4383:::benchmark_data_smithi188_104537_object67761:head# 2024-04-01T19:36:33.832 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.832 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:543b22a3:::benchmark_data_smithi188_104537_object22678:head# 2024-04-01T19:36:33.832 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.832 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:543b2a68:::benchmark_data_smithi188_104537_object95252:head# 2024-04-01T19:36:33.832 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.832 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:543b5685:::benchmark_data_smithi188_104537_object11947:head# 2024-04-01T19:36:33.832 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.832 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:543cd25d:::benchmark_data_smithi188_104537_object37666:head# 2024-04-01T19:36:33.833 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.833 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:543cebe1:::benchmark_data_smithi188_104537_object73333:head# 2024-04-01T19:36:33.833 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.833 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:543d231b:::benchmark_data_smithi188_104537_object159136:head# 2024-04-01T19:36:33.833 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.833 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:543d354a:::benchmark_data_smithi188_104537_object116893:head# 2024-04-01T19:36:33.833 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.833 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:543d4f52:::benchmark_data_smithi188_104537_object29602:head# 2024-04-01T19:36:33.833 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.833 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:543d685c:::benchmark_data_smithi188_104537_object104916:head# 2024-04-01T19:36:33.833 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.833 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:543d8095:::benchmark_data_smithi188_104537_object157390:head# 2024-04-01T19:36:33.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.834 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:543e6eb1:::benchmark_data_smithi188_104537_object92465:head# 2024-04-01T19:36:33.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.834 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:543eb58a:::benchmark_data_smithi188_104537_object133961:head# 2024-04-01T19:36:33.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.834 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:543f086d:::benchmark_data_smithi188_104537_object82623:head# 2024-04-01T19:36:33.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.834 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:543f0bb0:::benchmark_data_smithi188_104537_object31056:head# 2024-04-01T19:36:33.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.834 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:543f24eb:::benchmark_data_smithi188_104537_object104838:head# 2024-04-01T19:36:33.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.836 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:544008f5:::benchmark_data_smithi188_104537_object145645:head# 2024-04-01T19:36:33.836 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.836 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5440651b:::benchmark_data_smithi188_104537_object149442:head# 2024-04-01T19:36:33.836 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.836 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5440940b:::benchmark_data_smithi188_104537_object156127:head# 2024-04-01T19:36:33.836 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.836 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5440eb53:::benchmark_data_smithi188_104537_object54290:head# 2024-04-01T19:36:33.836 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.836 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54410422:::benchmark_data_smithi188_104537_object158466:head# 2024-04-01T19:36:33.836 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.837 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54411636:::benchmark_data_smithi188_104537_object163858:head# 2024-04-01T19:36:33.837 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.837 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54411c0b:::benchmark_data_smithi188_104537_object154095:head# 2024-04-01T19:36:33.837 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.837 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54414055:::benchmark_data_smithi188_104537_object155309:head# 2024-04-01T19:36:33.837 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.837 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54423187:::benchmark_data_smithi188_104537_object67482:head# 2024-04-01T19:36:33.837 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.837 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5442e651:::benchmark_data_smithi188_104537_object66276:head# 2024-04-01T19:36:33.837 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.839 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5443e941:::benchmark_data_smithi188_104537_object152190:head# 2024-04-01T19:36:33.839 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.839 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54444b7b:::benchmark_data_smithi188_104537_object61003:head# 2024-04-01T19:36:33.839 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.839 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5444928e:::benchmark_data_smithi188_104537_object16377:head# 2024-04-01T19:36:33.840 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.840 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54451f32:::benchmark_data_smithi188_104537_object158971:head# 2024-04-01T19:36:33.840 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.840 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54458775:::benchmark_data_smithi188_104537_object73396:head# 2024-04-01T19:36:33.840 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.840 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5445aa22:::benchmark_data_smithi188_104537_object110019:head# 2024-04-01T19:36:33.840 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.840 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5447625b:::benchmark_data_smithi188_104537_object57599:head# 2024-04-01T19:36:33.840 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.840 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5447a0c4:::benchmark_data_smithi188_104537_object140860:head# 2024-04-01T19:36:33.841 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.841 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54498f9b:::benchmark_data_smithi188_104537_object153869:head# 2024-04-01T19:36:33.841 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.841 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5449a4d3:::benchmark_data_smithi188_104537_object56975:head# 2024-04-01T19:36:33.841 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.842 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5449b3a4:::benchmark_data_smithi188_104537_object72956:head# 2024-04-01T19:36:33.842 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.843 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:544a3eea:::benchmark_data_smithi188_104537_object21922:head# 2024-04-01T19:36:33.843 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.843 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:544ae70c:::benchmark_data_smithi188_104537_object131702:head# 2024-04-01T19:36:33.843 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.843 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:544b5ede:::benchmark_data_smithi188_104537_object138986:head# 2024-04-01T19:36:33.843 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.843 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:544bc287:::benchmark_data_smithi188_104537_object53581:head# 2024-04-01T19:36:33.843 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.843 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:544beb37:::benchmark_data_smithi188_104537_object52569:head# 2024-04-01T19:36:33.843 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.843 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:544c324a:::benchmark_data_smithi188_104537_object76388:head# 2024-04-01T19:36:33.843 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.843 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:544c70da:::benchmark_data_smithi188_104537_object22674:head# 2024-04-01T19:36:33.843 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.844 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:544c7c40:::benchmark_data_smithi188_104537_object30152:head# 2024-04-01T19:36:33.844 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.847 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:544ce47d:::benchmark_data_smithi188_104537_object169430:head# 2024-04-01T19:36:33.847 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.848 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:544d5359:::benchmark_data_smithi188_104537_object98784:head# 2024-04-01T19:36:33.848 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.848 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:544e461c:::benchmark_data_smithi188_104537_object30164:head# 2024-04-01T19:36:33.848 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.849 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:544f61ef:::benchmark_data_smithi188_104537_object89844:head# 2024-04-01T19:36:33.849 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.849 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:544ffc8a:::benchmark_data_smithi188_104537_object115900:head# 2024-04-01T19:36:33.849 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.849 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5450f800:::benchmark_data_smithi188_104537_object136032:head# 2024-04-01T19:36:33.849 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.850 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5450ffb0:::benchmark_data_smithi188_104537_object150078:head# 2024-04-01T19:36:33.850 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.850 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54515e33:::benchmark_data_smithi188_104537_object82111:head# 2024-04-01T19:36:33.850 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.850 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:545161a9:::benchmark_data_smithi188_104537_object169168:head# 2024-04-01T19:36:33.850 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.850 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54521668:::benchmark_data_smithi188_104537_object90595:head# 2024-04-01T19:36:33.850 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.851 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54525df1:::benchmark_data_smithi188_104537_object43937:head# 2024-04-01T19:36:33.851 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.851 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:545328d6:::benchmark_data_smithi188_104537_object111042:head# 2024-04-01T19:36:33.851 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.852 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54539d32:::benchmark_data_smithi188_104537_object57068:head# 2024-04-01T19:36:33.852 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.852 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5453a4da:::benchmark_data_smithi188_104537_object45471:head# 2024-04-01T19:36:33.852 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.852 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5453d6c8:::benchmark_data_smithi188_104537_object164406:head# 2024-04-01T19:36:33.852 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.856 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5454327f:::benchmark_data_smithi188_104537_object32287:head# 2024-04-01T19:36:33.856 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.857 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5455c2f2:::benchmark_data_smithi188_104537_object154327:head# 2024-04-01T19:36:33.857 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.857 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:545645c1:::benchmark_data_smithi188_104537_object15161:head# 2024-04-01T19:36:33.857 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.858 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5456d66b:::benchmark_data_smithi188_104537_object93348:head# 2024-04-01T19:36:33.858 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.858 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54575f5b:::benchmark_data_smithi188_104537_object167703:head# 2024-04-01T19:36:33.858 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.858 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54585f54:::benchmark_data_smithi188_104537_object112668:head# 2024-04-01T19:36:33.858 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.859 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5458a14d:::benchmark_data_smithi188_104537_object113930:head# 2024-04-01T19:36:33.859 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.859 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5458c2bf:::benchmark_data_smithi188_104537_object20480:head# 2024-04-01T19:36:33.860 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.860 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54597cbf:::benchmark_data_smithi188_104537_object159711:head# 2024-04-01T19:36:33.860 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.860 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5459b5f6:::benchmark_data_smithi188_104537_object115239:head# 2024-04-01T19:36:33.860 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.860 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5459f283:::benchmark_data_smithi188_104537_object151633:head# 2024-04-01T19:36:33.860 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.860 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:545a9a2c:::benchmark_data_smithi188_104537_object122262:head# 2024-04-01T19:36:33.860 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.861 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:545ab40e:::benchmark_data_smithi188_104537_object121592:head# 2024-04-01T19:36:33.861 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.861 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:545b927d:::benchmark_data_smithi188_104537_object15134:head# 2024-04-01T19:36:33.862 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.862 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:545be60f:::benchmark_data_smithi188_104537_object54660:head# 2024-04-01T19:36:33.862 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.862 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:545bf7e1:::benchmark_data_smithi188_104537_object164558:head# 2024-04-01T19:36:33.862 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.862 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:545c14a7:::benchmark_data_smithi188_104537_object123254:head# 2024-04-01T19:36:33.862 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.862 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:545c43c4:::benchmark_data_smithi188_104537_object73713:head# 2024-04-01T19:36:33.862 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.863 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:545ccfdc:::benchmark_data_smithi188_104537_object127207:head# 2024-04-01T19:36:33.864 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.864 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:545d71d6:::benchmark_data_smithi188_104537_object79120:head# 2024-04-01T19:36:33.864 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.864 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:545ded5e:::benchmark_data_smithi188_104537_object69482:head# 2024-04-01T19:36:33.864 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.864 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:545f40bd:::benchmark_data_smithi188_104537_object82920:head# 2024-04-01T19:36:33.864 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.864 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:545f9661:::benchmark_data_smithi188_104537_object19937:head# 2024-04-01T19:36:33.864 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.864 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:545f98b1:::benchmark_data_smithi188_104537_object87938:head# 2024-04-01T19:36:33.864 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.864 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:546044ab:::benchmark_data_smithi188_104537_object37294:head# 2024-04-01T19:36:33.865 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.865 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:546068e0:::benchmark_data_smithi188_104537_object158211:head# 2024-04-01T19:36:33.865 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.866 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54606ad9:::benchmark_data_smithi188_104537_object69626:head# 2024-04-01T19:36:33.866 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.866 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5461e0e2:::benchmark_data_smithi188_104537_object162725:head# 2024-04-01T19:36:33.866 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.866 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5461e6d0:::benchmark_data_smithi188_104537_object81245:head# 2024-04-01T19:36:33.866 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.867 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54622fd3:::benchmark_data_smithi188_104537_object52340:head# 2024-04-01T19:36:33.867 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.867 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5462528a:::benchmark_data_smithi188_104537_object28344:head# 2024-04-01T19:36:33.867 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.867 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54625823:::benchmark_data_smithi188_104537_object59677:head# 2024-04-01T19:36:33.867 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.867 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54628123:::benchmark_data_smithi188_104537_object149288:head# 2024-04-01T19:36:33.867 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.867 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5462a681:::benchmark_data_smithi188_104537_object109297:head# 2024-04-01T19:36:33.867 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.867 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54632c2e:::benchmark_data_smithi188_104537_object100201:head# 2024-04-01T19:36:33.867 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.869 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54633954:::benchmark_data_smithi188_104537_object116901:head# 2024-04-01T19:36:33.869 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.869 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5463b422:::benchmark_data_smithi188_104537_object137489:head# 2024-04-01T19:36:33.869 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.869 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5463ddfe:::benchmark_data_smithi188_104537_object151339:head# 2024-04-01T19:36:33.869 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.869 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54643d57:::benchmark_data_smithi188_104537_object140609:head# 2024-04-01T19:36:33.869 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.869 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54646394:::benchmark_data_smithi188_104537_object125853:head# 2024-04-01T19:36:33.869 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.869 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5464e006:::benchmark_data_smithi188_104537_object92612:head# 2024-04-01T19:36:33.869 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.870 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5464f30a:::benchmark_data_smithi188_104537_object14661:head# 2024-04-01T19:36:33.870 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.870 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5464f6a3:::benchmark_data_smithi188_104537_object103448:head# 2024-04-01T19:36:33.870 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.870 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5465539c:::benchmark_data_smithi188_104537_object112955:head# 2024-04-01T19:36:33.870 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.870 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5465571c:::benchmark_data_smithi188_104537_object21794:head# 2024-04-01T19:36:33.870 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.872 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54655a91:::benchmark_data_smithi188_104537_object49603:head# 2024-04-01T19:36:33.872 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.872 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54657971:::benchmark_data_smithi188_104537_object134529:head# 2024-04-01T19:36:33.872 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.872 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5465e1d6:::benchmark_data_smithi188_104537_object19207:head# 2024-04-01T19:36:33.872 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.872 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5465fb00:::benchmark_data_smithi188_104537_object157969:head# 2024-04-01T19:36:33.872 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.872 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54668da7:::benchmark_data_smithi188_104537_object134212:head# 2024-04-01T19:36:33.872 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.872 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5466ab79:::benchmark_data_smithi188_104537_object27919:head# 2024-04-01T19:36:33.872 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.873 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5467fb13:::benchmark_data_smithi188_104537_object11753:head# 2024-04-01T19:36:33.873 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.873 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54687b66:::benchmark_data_smithi188_104537_object24767:head# 2024-04-01T19:36:33.873 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.873 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:546880f0:::benchmark_data_smithi188_104537_object28211:head# 2024-04-01T19:36:33.873 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.873 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54691f94:::benchmark_data_smithi188_104537_object161801:head# 2024-04-01T19:36:33.873 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.873 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54697a84:::benchmark_data_smithi188_104537_object108784:head# 2024-04-01T19:36:33.873 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.875 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5469a305:::benchmark_data_smithi188_104537_object15538:head# 2024-04-01T19:36:33.875 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.875 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:546a2f1e:::benchmark_data_smithi188_104537_object129652:head# 2024-04-01T19:36:33.875 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.875 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:546a2f7e:::benchmark_data_smithi188_104537_object125624:head# 2024-04-01T19:36:33.875 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.875 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:546a6d87:::benchmark_data_smithi188_104537_object57350:head# 2024-04-01T19:36:33.875 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.876 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:546ab1bc:::benchmark_data_smithi188_104537_object94827:head# 2024-04-01T19:36:33.876 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.876 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:546ab6ff:::benchmark_data_smithi188_104537_object116260:head# 2024-04-01T19:36:33.876 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.876 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:546ad340:::benchmark_data_smithi188_104537_object161334:head# 2024-04-01T19:36:33.876 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.876 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:546b8536:::benchmark_data_smithi188_104537_object35211:head# 2024-04-01T19:36:33.876 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.876 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:546b9ee4:::benchmark_data_smithi188_104537_object156605:head# 2024-04-01T19:36:33.876 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.876 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:546ba447:::benchmark_data_smithi188_104537_object101213:head# 2024-04-01T19:36:33.876 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.876 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:546bf91a:::benchmark_data_smithi188_104537_object35926:head# 2024-04-01T19:36:33.876 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.878 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:546c339e:::benchmark_data_smithi188_104537_object142656:head# 2024-04-01T19:36:33.878 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.878 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:546c534b:::benchmark_data_smithi188_104537_object127428:head# 2024-04-01T19:36:33.878 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.878 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:546c6d1f:::benchmark_data_smithi188_104537_object33815:head# 2024-04-01T19:36:33.878 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.878 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:546c7bb5:::benchmark_data_smithi188_104537_object101416:head# 2024-04-01T19:36:33.878 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.878 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:546d2865:::benchmark_data_smithi188_104537_object34972:head# 2024-04-01T19:36:33.879 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.879 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:546d88fb:::benchmark_data_smithi188_104537_object108629:head# 2024-04-01T19:36:33.879 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.879 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:546e4ade:::benchmark_data_smithi188_104537_object158533:head# 2024-04-01T19:36:33.879 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.879 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:546e824a:::benchmark_data_smithi188_104537_object119604:head# 2024-04-01T19:36:33.879 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.879 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:546ea93d:::benchmark_data_smithi188_104537_object47076:head# 2024-04-01T19:36:33.879 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.879 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:546eb33d:::benchmark_data_smithi188_104537_object59681:head# 2024-04-01T19:36:33.879 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.881 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:546fe1b8:::benchmark_data_smithi188_104537_object19353:head# 2024-04-01T19:36:33.881 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.881 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:547002de:::benchmark_data_smithi188_104537_object63308:head# 2024-04-01T19:36:33.881 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.881 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54700890:::benchmark_data_smithi188_104537_object141765:head# 2024-04-01T19:36:33.881 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.881 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54703cfc:::benchmark_data_smithi188_104537_object123582:head# 2024-04-01T19:36:33.881 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.881 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5470f37f:::benchmark_data_smithi188_104537_object38997:head# 2024-04-01T19:36:33.881 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.881 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5471137e:::benchmark_data_smithi188_104537_object137360:head# 2024-04-01T19:36:33.881 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.882 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54716540:::benchmark_data_smithi188_104537_object123240:head# 2024-04-01T19:36:33.882 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.882 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54722238:::benchmark_data_smithi188_104537_object83723:head# 2024-04-01T19:36:33.882 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.882 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54727c0b:::benchmark_data_smithi188_104537_object72380:head# 2024-04-01T19:36:33.882 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.883 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5472aa8e:::benchmark_data_smithi188_104537_object142039:head# 2024-04-01T19:36:33.883 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.883 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5472df3e:::benchmark_data_smithi188_104537_object78054:head# 2024-04-01T19:36:33.883 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.883 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54730f56:::benchmark_data_smithi188_104537_object131176:head# 2024-04-01T19:36:33.883 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.884 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5473c918:::benchmark_data_smithi188_104537_object27668:head# 2024-04-01T19:36:33.884 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.884 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54745836:::benchmark_data_smithi188_104537_object118180:head# 2024-04-01T19:36:33.884 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.884 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54748c65:::benchmark_data_smithi188_104537_object61036:head# 2024-04-01T19:36:33.884 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.885 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54748ea9:::benchmark_data_smithi188_104537_object38453:head# 2024-04-01T19:36:33.885 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.885 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5474afe5:::benchmark_data_smithi188_104537_object108285:head# 2024-04-01T19:36:33.885 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.885 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5475667d:::benchmark_data_smithi188_104537_object21108:head# 2024-04-01T19:36:33.885 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.885 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5476297e:::benchmark_data_smithi188_104537_object13604:head# 2024-04-01T19:36:33.885 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.886 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:547639bd:::benchmark_data_smithi188_104537_object150325:head# 2024-04-01T19:36:33.886 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.886 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5476a7c7:::benchmark_data_smithi188_104537_object74760:head# 2024-04-01T19:36:33.886 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.886 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5476a885:::benchmark_data_smithi188_104537_object38900:head# 2024-04-01T19:36:33.886 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.886 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5476af27:::benchmark_data_smithi188_104537_object28629:head# 2024-04-01T19:36:33.886 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.887 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5476bcef:::benchmark_data_smithi188_104537_object122613:head# 2024-04-01T19:36:33.887 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.887 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54776638:::benchmark_data_smithi188_104537_object50136:head# 2024-04-01T19:36:33.888 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.888 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5478020a:::benchmark_data_smithi188_104537_object138777:head# 2024-04-01T19:36:33.888 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.888 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54783cd1:::benchmark_data_smithi188_104537_object75497:head# 2024-04-01T19:36:33.888 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.888 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54792c00:::benchmark_data_smithi188_104537_object150893:head# 2024-04-01T19:36:33.888 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.888 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54793177:::benchmark_data_smithi188_104537_object16109:head# 2024-04-01T19:36:33.888 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.888 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54795b3f:::benchmark_data_smithi188_104537_object73383:head# 2024-04-01T19:36:33.888 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.888 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5479d439:::benchmark_data_smithi188_104537_object71487:head# 2024-04-01T19:36:33.888 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.889 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5479fd62:::benchmark_data_smithi188_104537_object57043:head# 2024-04-01T19:36:33.890 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.890 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:547b35ee:::benchmark_data_smithi188_104537_object54329:head# 2024-04-01T19:36:33.890 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.890 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:547c36c5:::benchmark_data_smithi188_104537_object155032:head# 2024-04-01T19:36:33.890 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.890 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:547cb9e0:::benchmark_data_smithi188_104537_object94850:head# 2024-04-01T19:36:33.890 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.890 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:547cf6fc:::benchmark_data_smithi188_104537_object15328:head# 2024-04-01T19:36:33.890 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.890 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:547d3fa2:::benchmark_data_smithi188_104537_object149284:head# 2024-04-01T19:36:33.890 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.890 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:547d5596:::benchmark_data_smithi188_104537_object101431:head# 2024-04-01T19:36:33.890 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.891 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:547d813f:::benchmark_data_smithi188_104537_object151349:head# 2024-04-01T19:36:33.891 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.892 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:547dfd97:::benchmark_data_smithi188_104537_object94665:head# 2024-04-01T19:36:33.892 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.892 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:547e364e:::benchmark_data_smithi188_104537_object97385:head# 2024-04-01T19:36:33.892 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.892 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:547e42e0:::benchmark_data_smithi188_104537_object123394:head# 2024-04-01T19:36:33.892 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.892 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:548027cf:::benchmark_data_smithi188_104537_object83121:head# 2024-04-01T19:36:33.892 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.892 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:548074c6:::benchmark_data_smithi188_104537_object127598:head# 2024-04-01T19:36:33.892 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.892 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5480ae74:::benchmark_data_smithi188_104537_object59594:head# 2024-04-01T19:36:33.893 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.893 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5480f6e2:::benchmark_data_smithi188_104537_object139389:head# 2024-04-01T19:36:33.893 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.893 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5481047b:::benchmark_data_smithi188_104537_object80404:head# 2024-04-01T19:36:33.893 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.894 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54812981:::benchmark_data_smithi188_104537_object87212:head# 2024-04-01T19:36:33.894 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.895 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54819f71:::benchmark_data_smithi188_104537_object143278:head# 2024-04-01T19:36:33.895 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.895 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54823afa:::benchmark_data_smithi188_104537_object130571:head# 2024-04-01T19:36:33.895 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.895 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54826240:::benchmark_data_smithi188_104537_object139635:head# 2024-04-01T19:36:33.895 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.895 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54838b85:::benchmark_data_smithi188_104537_object94591:head# 2024-04-01T19:36:33.895 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.895 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5483c985:::benchmark_data_smithi188_104537_object146918:head# 2024-04-01T19:36:33.895 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.895 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5484fdaa:::benchmark_data_smithi188_104537_object99462:head# 2024-04-01T19:36:33.895 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.895 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54856912:::benchmark_data_smithi188_104537_object124663:head# 2024-04-01T19:36:33.895 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.895 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:548581a6:::benchmark_data_smithi188_104537_object69070:head# 2024-04-01T19:36:33.896 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.897 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54859cbf:::benchmark_data_smithi188_104537_object49019:head# 2024-04-01T19:36:33.897 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.897 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5486c2ae:::benchmark_data_smithi188_104537_object73885:head# 2024-04-01T19:36:33.897 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.897 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:548769ed:::benchmark_data_smithi188_104537_object148925:head# 2024-04-01T19:36:33.897 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.897 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54877a94:::benchmark_data_smithi188_104537_object36571:head# 2024-04-01T19:36:33.897 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.898 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54881471:::benchmark_data_smithi188_104537_object20143:head# 2024-04-01T19:36:33.898 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.898 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54883b2e:::benchmark_data_smithi188_104537_object15937:head# 2024-04-01T19:36:33.898 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.899 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54884061:::benchmark_data_smithi188_104537_object32639:head# 2024-04-01T19:36:33.899 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.899 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5489942b:::benchmark_data_smithi188_104537_object85957:head# 2024-04-01T19:36:33.899 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.900 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5489a7f3:::benchmark_data_smithi188_104537_object166076:head# 2024-04-01T19:36:33.900 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.900 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:548a1e51:::benchmark_data_smithi188_104537_object29676:head# 2024-04-01T19:36:33.900 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.900 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:548aedbc:::benchmark_data_smithi188_104537_object127287:head# 2024-04-01T19:36:33.900 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.900 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:548bae24:::benchmark_data_smithi188_104537_object112681:head# 2024-04-01T19:36:33.900 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.900 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:548c405e:::benchmark_data_smithi188_104537_object143622:head# 2024-04-01T19:36:33.900 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.900 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:548c41af:::benchmark_data_smithi188_104537_object61571:head# 2024-04-01T19:36:33.900 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.901 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:548c4d5c:::benchmark_data_smithi188_104537_object64300:head# 2024-04-01T19:36:33.901 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.901 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:548c6f1d:::benchmark_data_smithi188_104537_object44802:head# 2024-04-01T19:36:33.901 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.901 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:548cad41:::benchmark_data_smithi188_104537_object97135:head# 2024-04-01T19:36:33.901 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.901 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:548eedef:::benchmark_data_smithi188_104537_object135270:head# 2024-04-01T19:36:33.901 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.903 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:548fbeb1:::benchmark_data_smithi188_104537_object28942:head# 2024-04-01T19:36:33.903 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.904 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:548fca9c:::benchmark_data_smithi188_104537_object129299:head# 2024-04-01T19:36:33.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.904 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:548fd410:::benchmark_data_smithi188_104537_object126239:head# 2024-04-01T19:36:33.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.904 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5490a4c9:::benchmark_data_smithi188_104537_object38219:head# 2024-04-01T19:36:33.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.904 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54912cd8:::benchmark_data_smithi188_104537_object48990:head# 2024-04-01T19:36:33.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.904 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5491bbd4:::benchmark_data_smithi188_104537_object13921:head# 2024-04-01T19:36:33.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.904 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5491cf46:::benchmark_data_smithi188_104537_object110491:head# 2024-04-01T19:36:33.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.904 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5491d6d0:::benchmark_data_smithi188_104537_object95944:head# 2024-04-01T19:36:33.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.905 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5491eab5:::benchmark_data_smithi188_104537_object147457:head# 2024-04-01T19:36:33.905 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.905 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:549232a5:::benchmark_data_smithi188_104537_object151356:head# 2024-04-01T19:36:33.905 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.905 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:549393b6:::benchmark_data_smithi188_104537_object59876:head# 2024-04-01T19:36:33.905 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.905 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:36:33.908 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5493fa42:::benchmark_data_smithi188_104537_object15296:head# 2024-04-01T19:36:33.908 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.908 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54946d9a:::benchmark_data_smithi188_104537_object122036:head# 2024-04-01T19:36:33.908 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.908 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:549486f8:::benchmark_data_smithi188_104537_object71657:head# 2024-04-01T19:36:33.908 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.908 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5495984a:::benchmark_data_smithi188_104537_object30764:head# 2024-04-01T19:36:33.908 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.908 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54959da3:::benchmark_data_smithi188_104537_object67911:head# 2024-04-01T19:36:33.908 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.909 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5495e860:::benchmark_data_smithi188_104537_object89293:head# 2024-04-01T19:36:33.909 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.909 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54962c38:::benchmark_data_smithi188_104537_object55103:head# 2024-04-01T19:36:33.909 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.909 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5497498b:::benchmark_data_smithi188_104537_object84616:head# 2024-04-01T19:36:33.909 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.909 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5497eef6:::benchmark_data_smithi188_104537_object128756:head# 2024-04-01T19:36:33.909 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.909 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54989c5c:::benchmark_data_smithi188_104537_object14539:head# 2024-04-01T19:36:33.909 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.909 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5498ef02:::benchmark_data_smithi188_104537_object72781:head# 2024-04-01T19:36:33.909 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.909 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5498f826:::benchmark_data_smithi188_104537_object19833:head# 2024-04-01T19:36:33.909 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.909 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:549909cb:::benchmark_data_smithi188_104537_object24678:head# 2024-04-01T19:36:33.910 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.910 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5499925c:::benchmark_data_smithi188_104537_object88405:head# 2024-04-01T19:36:33.910 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.910 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:549b312d:::benchmark_data_smithi188_104537_object102000:head# 2024-04-01T19:36:33.910 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.910 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:549bb147:::benchmark_data_smithi188_104537_object99914:head# 2024-04-01T19:36:33.910 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.914 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:549bf23f:::benchmark_data_smithi188_104537_object111707:head# 2024-04-01T19:36:33.914 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.914 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:549cf4b6:::benchmark_data_smithi188_104537_object63513:head# 2024-04-01T19:36:33.914 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.914 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:549d5afb:::benchmark_data_smithi188_104537_object158596:head# 2024-04-01T19:36:33.914 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.915 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:549df488:::benchmark_data_smithi188_104537_object55421:head# 2024-04-01T19:36:33.915 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.915 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:549e0647:::benchmark_data_smithi188_104537_object21723:head# 2024-04-01T19:36:33.915 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.915 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:549e6efd:::benchmark_data_smithi188_104537_object137225:head# 2024-04-01T19:36:33.915 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.915 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:549e79af:::benchmark_data_smithi188_104537_object161561:head# 2024-04-01T19:36:33.915 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.915 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:549efe6b:::benchmark_data_smithi188_104537_object135810:head# 2024-04-01T19:36:33.915 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.915 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:549f4ed5:::benchmark_data_smithi188_104537_object77005:head# 2024-04-01T19:36:33.915 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.915 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:549f6666:::benchmark_data_smithi188_104537_object54371:head# 2024-04-01T19:36:33.915 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.915 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:549f7eea:::benchmark_data_smithi188_104537_object35925:head# 2024-04-01T19:36:33.916 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.916 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:549facfb:::benchmark_data_smithi188_104537_object170920:head# 2024-04-01T19:36:33.916 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.916 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54a13e60:::benchmark_data_smithi188_104537_object163521:head# 2024-04-01T19:36:33.916 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.916 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54a1f711:::benchmark_data_smithi188_104537_object96064:head# 2024-04-01T19:36:33.916 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.916 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54a217f0:::benchmark_data_smithi188_104537_object50192:head# 2024-04-01T19:36:33.916 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.916 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54a223e2:::benchmark_data_smithi188_104537_object69244:head# 2024-04-01T19:36:33.916 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.916 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54a242da:::benchmark_data_smithi188_104537_object170106:head# 2024-04-01T19:36:33.916 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.916 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54a2eafe:::benchmark_data_smithi188_104537_object155515:head# 2024-04-01T19:36:33.916 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.917 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54a2fce1:::benchmark_data_smithi188_104537_object98166:head# 2024-04-01T19:36:33.917 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.917 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54a307a9:::benchmark_data_smithi188_104537_object169380:head# 2024-04-01T19:36:33.917 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.917 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54a35b6a:::benchmark_data_smithi188_104537_object12122:head# 2024-04-01T19:36:33.917 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.917 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54a3b30a:::benchmark_data_smithi188_104537_object80462:head# 2024-04-01T19:36:33.917 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.917 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54a46c05:::benchmark_data_smithi188_104537_object12795:head# 2024-04-01T19:36:33.917 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.917 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54a50163:::benchmark_data_smithi188_104537_object137377:head# 2024-04-01T19:36:33.918 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.921 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54a55e32:::benchmark_data_smithi188_104537_object83333:head# 2024-04-01T19:36:33.921 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.921 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54a60d42:::benchmark_data_smithi188_104537_object90641:head# 2024-04-01T19:36:33.921 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.921 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54a61722:::benchmark_data_smithi188_104537_object42037:head# 2024-04-01T19:36:33.922 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.922 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54a6ee38:::benchmark_data_smithi188_104537_object154062:head# 2024-04-01T19:36:33.922 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.922 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54a74098:::benchmark_data_smithi188_104537_object15867:head# 2024-04-01T19:36:33.922 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.922 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54a752d0:::benchmark_data_smithi188_104537_object61662:head# 2024-04-01T19:36:33.922 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.922 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54a82410:::benchmark_data_smithi188_104537_object103835:head# 2024-04-01T19:36:33.922 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.922 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54a87155:::benchmark_data_smithi188_104537_object134726:head# 2024-04-01T19:36:33.922 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.922 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54a8b97e:::benchmark_data_smithi188_104537_object124760:head# 2024-04-01T19:36:33.922 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.923 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54a8fda7:::benchmark_data_smithi188_104537_object27843:head# 2024-04-01T19:36:33.923 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.923 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54aa0822:::benchmark_data_smithi188_104537_object85128:head# 2024-04-01T19:36:33.923 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.923 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54aa09d6:::benchmark_data_smithi188_104537_object161566:head# 2024-04-01T19:36:33.923 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.923 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54aa4474:::benchmark_data_smithi188_104537_object31533:head# 2024-04-01T19:36:33.923 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.923 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54aa5c5a:::benchmark_data_smithi188_104537_object86724:head# 2024-04-01T19:36:33.923 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.923 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54aade45:::benchmark_data_smithi188_104537_object109387:head# 2024-04-01T19:36:33.923 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.923 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54abeb71:::benchmark_data_smithi188_104537_object71471:head# 2024-04-01T19:36:33.923 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.923 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54ac5c63:::benchmark_data_smithi188_104537_object79079:head# 2024-04-01T19:36:33.923 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54acf270:::benchmark_data_smithi188_104537_object140348:head# 2024-04-01T19:36:33.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54acf689:::benchmark_data_smithi188_104537_object80851:head# 2024-04-01T19:36:33.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54ad2ef7:::benchmark_data_smithi188_104537_object127471:head# 2024-04-01T19:36:33.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54adf101:::benchmark_data_smithi188_104537_object75565:head# 2024-04-01T19:36:33.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54ae7fe3:::benchmark_data_smithi188_104537_object122001:head# 2024-04-01T19:36:33.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54aec2ca:::benchmark_data_smithi188_104537_object46347:head# 2024-04-01T19:36:33.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54af24b7:::benchmark_data_smithi188_104537_object88792:head# 2024-04-01T19:36:33.925 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.925 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b04e6a:::benchmark_data_smithi188_104537_object98855:head# 2024-04-01T19:36:33.925 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.925 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b0a894:::benchmark_data_smithi188_104537_object133701:head# 2024-04-01T19:36:33.925 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.925 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b10ef7:::benchmark_data_smithi188_104537_object77044:head# 2024-04-01T19:36:33.925 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.929 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b1c2b7:::benchmark_data_smithi188_104537_object148683:head# 2024-04-01T19:36:33.929 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.930 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b21a90:::benchmark_data_smithi188_104537_object171717:head# 2024-04-01T19:36:33.930 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.930 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b23f2f:::benchmark_data_smithi188_104537_object63570:head# 2024-04-01T19:36:33.930 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.930 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b26648:::benchmark_data_smithi188_104537_object170473:head# 2024-04-01T19:36:33.930 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.930 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b26e10:::benchmark_data_smithi188_104537_object48929:head# 2024-04-01T19:36:33.930 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.930 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b2bf4e:::benchmark_data_smithi188_104537_object104513:head# 2024-04-01T19:36:33.930 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.930 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b3f5a2:::benchmark_data_smithi188_104537_object152050:head# 2024-04-01T19:36:33.930 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.930 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b431b7:::benchmark_data_smithi188_104537_object17979:head# 2024-04-01T19:36:33.930 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.930 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b47db6:::benchmark_data_smithi188_104537_object142923:head# 2024-04-01T19:36:33.931 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.931 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b68aa6:::benchmark_data_smithi188_104537_object141219:head# 2024-04-01T19:36:33.931 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.931 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b699f1:::benchmark_data_smithi188_104537_object37056:head# 2024-04-01T19:36:33.931 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.931 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b70d51:::benchmark_data_smithi188_104537_object138734:head# 2024-04-01T19:36:33.931 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.931 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b71307:::benchmark_data_smithi188_104537_object167942:head# 2024-04-01T19:36:33.931 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.931 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b730d6:::benchmark_data_smithi188_104537_object39240:head# 2024-04-01T19:36:33.931 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.931 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b741e4:::benchmark_data_smithi188_104537_object157560:head# 2024-04-01T19:36:33.931 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.931 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b74f87:::benchmark_data_smithi188_104537_object56980:head# 2024-04-01T19:36:33.931 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.931 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b755fc:::benchmark_data_smithi188_104537_object22407:head# 2024-04-01T19:36:33.932 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.932 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b76921:::benchmark_data_smithi188_104537_object115271:head# 2024-04-01T19:36:33.932 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.932 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b79d0c:::benchmark_data_smithi188_104537_object130319:head# 2024-04-01T19:36:33.932 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.932 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b86fd6:::benchmark_data_smithi188_104537_object147879:head# 2024-04-01T19:36:33.932 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.932 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b88e8d:::benchmark_data_smithi188_104537_object23043:head# 2024-04-01T19:36:33.932 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.932 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b8abd6:::benchmark_data_smithi188_104537_object41372:head# 2024-04-01T19:36:33.932 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.932 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b8f7a6:::benchmark_data_smithi188_104537_object30290:head# 2024-04-01T19:36:33.932 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.933 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b8f84a:::benchmark_data_smithi188_104537_object84229:head# 2024-04-01T19:36:33.934 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.934 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54b98b39:::benchmark_data_smithi188_104537_object77508:head# 2024-04-01T19:36:33.934 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.934 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54ba0b52:::benchmark_data_smithi188_104537_object20926:head# 2024-04-01T19:36:33.934 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.934 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54ba19f1:::benchmark_data_smithi188_104537_object132642:head# 2024-04-01T19:36:33.934 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.934 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54ba5444:::benchmark_data_smithi188_104537_object100303:head# 2024-04-01T19:36:33.934 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.934 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54bab1ea:::benchmark_data_smithi188_104537_object43271:head# 2024-04-01T19:36:33.934 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.934 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54babb9f:::benchmark_data_smithi188_104537_object93321:head# 2024-04-01T19:36:33.935 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54baddea:::benchmark_data_smithi188_104537_object27921:head# 2024-04-01T19:36:33.935 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54bbb9ba:::benchmark_data_smithi188_104537_object17793:head# 2024-04-01T19:36:33.935 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54bc446d:::benchmark_data_smithi188_104537_object79531:head# 2024-04-01T19:36:33.935 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54bce594:::benchmark_data_smithi188_104537_object116129:head# 2024-04-01T19:36:33.935 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54bd83b2:::benchmark_data_smithi188_104537_object95223:head# 2024-04-01T19:36:33.935 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54bda53e:::benchmark_data_smithi188_104537_object46631:head# 2024-04-01T19:36:33.935 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54bdd0d5:::benchmark_data_smithi188_104537_object17006:head# 2024-04-01T19:36:33.936 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.936 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54be0e3c:::benchmark_data_smithi188_104537_object143178:head# 2024-04-01T19:36:33.936 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.936 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54be393a:::benchmark_data_smithi188_104537_object146770:head# 2024-04-01T19:36:33.936 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.936 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54be6928:::benchmark_data_smithi188_104537_object93334:head# 2024-04-01T19:36:33.936 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.936 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54beafa5:::benchmark_data_smithi188_104537_object21142:head# 2024-04-01T19:36:33.936 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.936 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54bfce1b:::benchmark_data_smithi188_104537_object118900:head# 2024-04-01T19:36:33.936 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.936 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54bfce4f:::benchmark_data_smithi188_104537_object75140:head# 2024-04-01T19:36:33.936 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.936 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54c0142b:::benchmark_data_smithi188_104537_object101988:head# 2024-04-01T19:36:33.936 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.940 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54c0cd22:::benchmark_data_smithi188_104537_object139746:head# 2024-04-01T19:36:33.940 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.940 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54c11c31:::benchmark_data_smithi188_104537_object153199:head# 2024-04-01T19:36:33.940 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.940 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54c1747b:::benchmark_data_smithi188_104537_object121478:head# 2024-04-01T19:36:33.940 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.940 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54c2a1c5:::benchmark_data_smithi188_104537_object75832:head# 2024-04-01T19:36:33.940 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.940 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54c34015:::benchmark_data_smithi188_104537_object166037:head# 2024-04-01T19:36:33.940 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.940 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54c365ef:::benchmark_data_smithi188_104537_object14169:head# 2024-04-01T19:36:33.940 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.941 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54c39606:::benchmark_data_smithi188_104537_object19592:head# 2024-04-01T19:36:33.941 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.941 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54c3e2cd:::benchmark_data_smithi188_104537_object80592:head# 2024-04-01T19:36:33.941 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.941 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54c40db8:::benchmark_data_smithi188_104537_object24249:head# 2024-04-01T19:36:33.941 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.941 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54c4c843:::benchmark_data_smithi188_104537_object59208:head# 2024-04-01T19:36:33.941 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.941 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54c4c8a0:::benchmark_data_smithi188_104537_object152505:head# 2024-04-01T19:36:33.941 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.941 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54c55611:::benchmark_data_smithi188_104537_object109211:head# 2024-04-01T19:36:33.941 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.941 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54c5caa3:::benchmark_data_smithi188_104537_object158278:head# 2024-04-01T19:36:33.941 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.941 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54c5e851:::benchmark_data_smithi188_104537_object134303:head# 2024-04-01T19:36:33.941 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.942 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54c684f8:::benchmark_data_smithi188_104537_object125242:head# 2024-04-01T19:36:33.942 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.942 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54c6d0b9:::benchmark_data_smithi188_104537_object96112:head# 2024-04-01T19:36:33.942 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.942 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54c71e6f:::benchmark_data_smithi188_104537_object107305:head# 2024-04-01T19:36:33.942 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.942 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54c722ea:::benchmark_data_smithi188_104537_object53197:head# 2024-04-01T19:36:33.942 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.942 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54c746e3:::benchmark_data_smithi188_104537_object14951:head# 2024-04-01T19:36:33.942 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.942 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54c7ec0e:::benchmark_data_smithi188_104537_object157995:head# 2024-04-01T19:36:33.942 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.942 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54c83f04:::benchmark_data_smithi188_104537_object161175:head# 2024-04-01T19:36:33.942 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.942 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54c86d1e:::benchmark_data_smithi188_104537_object153533:head# 2024-04-01T19:36:33.943 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.943 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54c9d303:::benchmark_data_smithi188_104537_object106564:head# 2024-04-01T19:36:33.943 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.945 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54c9deaf:::benchmark_data_smithi188_104537_object54990:head# 2024-04-01T19:36:33.945 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.945 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54ca853b:::benchmark_data_smithi188_104537_object74079:head# 2024-04-01T19:36:33.945 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.945 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54cab651:::benchmark_data_smithi188_104537_object93734:head# 2024-04-01T19:36:33.946 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.946 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54cb03c5:::benchmark_data_smithi188_104537_object85234:head# 2024-04-01T19:36:33.946 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.946 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54cbd313:::benchmark_data_smithi188_104537_object11835:head# 2024-04-01T19:36:33.946 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.946 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54cbf321:::benchmark_data_smithi188_104537_object46436:head# 2024-04-01T19:36:33.946 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.946 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54cbf85e:::benchmark_data_smithi188_104537_object18932:head# 2024-04-01T19:36:33.946 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.946 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54cbf97d:::benchmark_data_smithi188_104537_object91592:head# 2024-04-01T19:36:33.946 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.946 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54cc3394:::benchmark_data_smithi188_104537_object74522:head# 2024-04-01T19:36:33.946 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.946 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54cc4411:::benchmark_data_smithi188_104537_object43590:head# 2024-04-01T19:36:33.946 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.946 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54cc892c:::benchmark_data_smithi188_104537_object34332:head# 2024-04-01T19:36:33.947 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.947 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54cd21a7:::benchmark_data_smithi188_104537_object38030:head# 2024-04-01T19:36:33.947 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.947 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54cd84b0:::benchmark_data_smithi188_104537_object57806:head# 2024-04-01T19:36:33.947 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.947 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54cdb1d6:::benchmark_data_smithi188_104537_object68295:head# 2024-04-01T19:36:33.947 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.947 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54cea81b:::benchmark_data_smithi188_104537_object74721:head# 2024-04-01T19:36:33.947 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.947 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54ced2f4:::benchmark_data_smithi188_104537_object82531:head# 2024-04-01T19:36:33.947 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.947 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54cfe01b:::benchmark_data_smithi188_104537_object23431:head# 2024-04-01T19:36:33.947 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.947 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54d02c3f:::benchmark_data_smithi188_104537_object22774:head# 2024-04-01T19:36:33.948 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.948 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54d0eddc:::benchmark_data_smithi188_104537_object45863:head# 2024-04-01T19:36:33.948 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.948 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54d18df9:::benchmark_data_smithi188_104537_object44753:head# 2024-04-01T19:36:33.948 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.948 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54d38cbf:::benchmark_data_smithi188_104537_object16478:head# 2024-04-01T19:36:33.948 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.948 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:33.952 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54d48ed0:::benchmark_data_smithi188_104537_object12676:head# 2024-04-01T19:36:33.952 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.952 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54d4ea1a:::benchmark_data_smithi188_104537_object77877:head# 2024-04-01T19:36:33.952 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.952 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54d5dd98:::benchmark_data_smithi188_104537_object86998:head# 2024-04-01T19:36:33.953 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.953 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54d637ed:::benchmark_data_smithi188_104537_object122992:head# 2024-04-01T19:36:33.953 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.953 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54d6a544:::benchmark_data_smithi188_104537_object128688:head# 2024-04-01T19:36:33.953 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.953 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54d80e4d:::benchmark_data_smithi188_104537_object143104:head# 2024-04-01T19:36:33.953 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.953 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54d83d78:::benchmark_data_smithi188_104537_object160224:head# 2024-04-01T19:36:33.953 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.953 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54d89ab6:::benchmark_data_smithi188_104537_object61103:head# 2024-04-01T19:36:33.953 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.953 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54d8aa0c:::benchmark_data_smithi188_104537_object140468:head# 2024-04-01T19:36:33.953 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.953 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54d8bdf1:::benchmark_data_smithi188_104537_object111406:head# 2024-04-01T19:36:33.954 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.954 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54d90c98:::benchmark_data_smithi188_104537_object112766:head# 2024-04-01T19:36:33.954 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.954 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54d99734:::benchmark_data_smithi188_104537_object61485:head# 2024-04-01T19:36:33.954 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.954 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54d9cfa8:::benchmark_data_smithi188_104537_object21669:head# 2024-04-01T19:36:33.954 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.954 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54dab818:::benchmark_data_smithi188_104537_object110621:head# 2024-04-01T19:36:33.954 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.954 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54db3bd3:::benchmark_data_smithi188_104537_object121901:head# 2024-04-01T19:36:33.954 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.954 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54db9431:::benchmark_data_smithi188_104537_object158099:head# 2024-04-01T19:36:33.954 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.954 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54dd0cce:::benchmark_data_smithi188_104537_object92599:head# 2024-04-01T19:36:33.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54dd91a6:::benchmark_data_smithi188_104537_object56464:head# 2024-04-01T19:36:33.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54ddcb9c:::benchmark_data_smithi188_104537_object139345:head# 2024-04-01T19:36:33.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54de0045:::benchmark_data_smithi188_104537_object32799:head# 2024-04-01T19:36:33.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54de9494:::benchmark_data_smithi188_104537_object111311:head# 2024-04-01T19:36:33.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54df21c7:::benchmark_data_smithi188_104537_object133293:head# 2024-04-01T19:36:33.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54df94db:::benchmark_data_smithi188_104537_object92924:head# 2024-04-01T19:36:33.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54dfbdcf:::benchmark_data_smithi188_104537_object37229:head# 2024-04-01T19:36:33.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.956 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54dff67e:::benchmark_data_smithi188_104537_object117145:head# 2024-04-01T19:36:33.956 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.957 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54e0ae19:::benchmark_data_smithi188_104537_object24152:head# 2024-04-01T19:36:33.958 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.958 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54e0efb5:::benchmark_data_smithi188_104537_object91698:head# 2024-04-01T19:36:33.958 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.958 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54e1596d:::benchmark_data_smithi188_104537_object75530:head# 2024-04-01T19:36:33.958 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.958 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54e1776b:::benchmark_data_smithi188_104537_object85819:head# 2024-04-01T19:36:33.958 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.958 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54e2910b:::benchmark_data_smithi188_104537_object81732:head# 2024-04-01T19:36:33.958 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.958 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54e2d086:::benchmark_data_smithi188_104537_object84420:head# 2024-04-01T19:36:33.958 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.959 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54e2e4b3:::benchmark_data_smithi188_104537_object132450:head# 2024-04-01T19:36:33.959 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.959 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54e3bef0:::benchmark_data_smithi188_104537_object106287:head# 2024-04-01T19:36:33.959 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.959 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54e593f8:::benchmark_data_smithi188_104537_object62771:head# 2024-04-01T19:36:33.959 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.959 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54e5c55d:::benchmark_data_smithi188_104537_object70855:head# 2024-04-01T19:36:33.959 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.959 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54e6e19f:::benchmark_data_smithi188_104537_object156277:head# 2024-04-01T19:36:33.959 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.959 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54e76de3:::benchmark_data_smithi188_104537_object13813:head# 2024-04-01T19:36:33.959 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.959 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54e7d1bc:::benchmark_data_smithi188_104537_object76331:head# 2024-04-01T19:36:33.959 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.959 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54e7dacd:::benchmark_data_smithi188_104537_object151218:head# 2024-04-01T19:36:33.959 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.959 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54e89b64:::benchmark_data_smithi188_104537_object114154:head# 2024-04-01T19:36:33.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54e92913:::benchmark_data_smithi188_104537_object91093:head# 2024-04-01T19:36:33.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54e9d511:::benchmark_data_smithi188_104537_object73178:head# 2024-04-01T19:36:33.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54eac2fb:::benchmark_data_smithi188_104537_object145230:head# 2024-04-01T19:36:33.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54eacc12:::benchmark_data_smithi188_104537_object29829:head# 2024-04-01T19:36:33.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54ec082e:::benchmark_data_smithi188_104537_object19320:head# 2024-04-01T19:36:33.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.961 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54ecc0da:::benchmark_data_smithi188_104537_object136804:head# 2024-04-01T19:36:33.961 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.961 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54ecea92:::benchmark_data_smithi188_104537_object85503:head# 2024-04-01T19:36:33.961 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.961 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54ed4241:::benchmark_data_smithi188_104537_object148304:head# 2024-04-01T19:36:33.961 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.961 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54ee2453:::benchmark_data_smithi188_104537_object57007:head# 2024-04-01T19:36:33.961 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.962 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54ee2669:::benchmark_data_smithi188_104537_object160275:head# 2024-04-01T19:36:33.962 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.962 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54eee996:::benchmark_data_smithi188_104537_object169919:head# 2024-04-01T19:36:33.962 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.962 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54f029a7:::benchmark_data_smithi188_104537_object130674:head# 2024-04-01T19:36:33.963 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.963 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54f05034:::benchmark_data_smithi188_104537_object58830:head# 2024-04-01T19:36:33.963 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.963 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54f09fb6:::benchmark_data_smithi188_104537_object67633:head# 2024-04-01T19:36:33.963 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.965 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54f19518:::benchmark_data_smithi188_104537_object20731:head# 2024-04-01T19:36:33.965 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.965 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54f1b583:::benchmark_data_smithi188_104537_object64170:head# 2024-04-01T19:36:33.965 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.965 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54f1ca7d:::benchmark_data_smithi188_104537_object19123:head# 2024-04-01T19:36:33.965 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.965 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54f1cc76:::benchmark_data_smithi188_104537_object53991:head# 2024-04-01T19:36:33.965 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.965 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54f27bf9:::benchmark_data_smithi188_104537_object157550:head# 2024-04-01T19:36:33.965 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.965 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54f29d5b:::benchmark_data_smithi188_104537_object114102:head# 2024-04-01T19:36:33.965 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.965 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54f34963:::benchmark_data_smithi188_104537_object126310:head# 2024-04-01T19:36:33.965 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.966 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54f3a337:::benchmark_data_smithi188_104537_object114992:head# 2024-04-01T19:36:33.967 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.967 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54f3d370:::benchmark_data_smithi188_104537_object65039:head# 2024-04-01T19:36:33.967 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.967 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54f42cb6:::benchmark_data_smithi188_104537_object149041:head# 2024-04-01T19:36:33.967 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.967 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54f46e3a:::benchmark_data_smithi188_104537_object114084:head# 2024-04-01T19:36:33.967 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.967 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54f48360:::benchmark_data_smithi188_104537_object42856:head# 2024-04-01T19:36:33.967 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.967 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54f4d9a8:::benchmark_data_smithi188_104537_object68341:head# 2024-04-01T19:36:33.967 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.967 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54f4ea47:::benchmark_data_smithi188_104537_object143033:head# 2024-04-01T19:36:33.967 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.969 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54f56012:::benchmark_data_smithi188_104537_object148294:head# 2024-04-01T19:36:33.969 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.969 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54f5aa9f:::benchmark_data_smithi188_104537_object99680:head# 2024-04-01T19:36:33.969 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.969 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54f7b475:::benchmark_data_smithi188_104537_object121345:head# 2024-04-01T19:36:33.969 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.969 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54f7d744:::benchmark_data_smithi188_104537_object18667:head# 2024-04-01T19:36:33.969 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.969 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54f943e4:::benchmark_data_smithi188_104537_object103956:head# 2024-04-01T19:36:33.970 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.970 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54f9769a:::benchmark_data_smithi188_104537_object128760:head# 2024-04-01T19:36:33.970 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.970 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54f9b007:::benchmark_data_smithi188_104537_object94770:head# 2024-04-01T19:36:33.970 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.970 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54fa86a3:::benchmark_data_smithi188_104537_object93513:head# 2024-04-01T19:36:33.970 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.970 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54faa078:::benchmark_data_smithi188_104537_object154081:head# 2024-04-01T19:36:33.970 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.971 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54fb1ec4:::benchmark_data_smithi188_104537_object111560:head# 2024-04-01T19:36:33.971 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.971 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54fbf014:::benchmark_data_smithi188_104537_object15822:head# 2024-04-01T19:36:33.971 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.971 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54fc3aa3:::benchmark_data_smithi188_104537_object15487:head# 2024-04-01T19:36:33.971 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54fc7625:::benchmark_data_smithi188_104537_object54413:head# 2024-04-01T19:36:33.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54fdafa2:::benchmark_data_smithi188_104537_object60617:head# 2024-04-01T19:36:33.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54fdcd4f:::benchmark_data_smithi188_104537_object13046:head# 2024-04-01T19:36:33.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54fe05f5:::benchmark_data_smithi188_104537_object23414:head# 2024-04-01T19:36:33.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54fe2eba:::benchmark_data_smithi188_104537_object143932:head# 2024-04-01T19:36:33.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54fe6e4f:::benchmark_data_smithi188_104537_object113395:head# 2024-04-01T19:36:33.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.973 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54fe726d:::benchmark_data_smithi188_104537_object63791:head# 2024-04-01T19:36:33.974 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.974 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54fe7ab7:::benchmark_data_smithi188_104537_object17014:head# 2024-04-01T19:36:33.974 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.974 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54fea476:::benchmark_data_smithi188_104537_object127697:head# 2024-04-01T19:36:33.974 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.974 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54feab60:::benchmark_data_smithi188_104537_object153758:head# 2024-04-01T19:36:33.974 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.974 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54feccf5:::benchmark_data_smithi188_104537_object130930:head# 2024-04-01T19:36:33.974 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.974 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54fee088:::benchmark_data_smithi188_104537_object115440:head# 2024-04-01T19:36:33.974 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.974 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54ff3539:::benchmark_data_smithi188_104537_object31645:head# 2024-04-01T19:36:33.974 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.974 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54ffbb76:::benchmark_data_smithi188_104537_object168934:head# 2024-04-01T19:36:33.974 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.975 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:54fff857:::benchmark_data_smithi188_104537_object70024:head# 2024-04-01T19:36:33.975 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.975 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:36:33.977 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55005d4f:::benchmark_data_smithi188_104537_object120383:head# 2024-04-01T19:36:33.977 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.977 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55008d58:::benchmark_data_smithi188_104537_object89563:head# 2024-04-01T19:36:33.977 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.977 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55009fac:::benchmark_data_smithi188_104537_object135758:head# 2024-04-01T19:36:33.977 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.977 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5500a15f:::benchmark_data_smithi188_104537_object16348:head# 2024-04-01T19:36:33.977 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.977 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5500e905:::benchmark_data_smithi188_104537_object85695:head# 2024-04-01T19:36:33.977 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.977 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55010251:::benchmark_data_smithi188_104537_object120106:head# 2024-04-01T19:36:33.977 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.977 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55013179:::benchmark_data_smithi188_104537_object96416:head# 2024-04-01T19:36:33.977 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.977 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5501823c:::benchmark_data_smithi188_104537_object134007:head# 2024-04-01T19:36:33.978 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.978 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5501f02a:::benchmark_data_smithi188_104537_object12952:head# 2024-04-01T19:36:33.978 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.978 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5502356d:::benchmark_data_smithi188_104537_object115641:head# 2024-04-01T19:36:33.978 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.978 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55024f6c:::benchmark_data_smithi188_104537_object106234:head# 2024-04-01T19:36:33.978 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.979 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55026bdb:::benchmark_data_smithi188_104537_object123067:head# 2024-04-01T19:36:33.979 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.979 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55028819:::benchmark_data_smithi188_104537_object43503:head# 2024-04-01T19:36:33.979 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.979 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55031215:::benchmark_data_smithi188_104537_object107173:head# 2024-04-01T19:36:33.979 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.979 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55031fa4:::benchmark_data_smithi188_104537_object17148:head# 2024-04-01T19:36:33.979 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.980 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5503249c:::benchmark_data_smithi188_104537_object71157:head# 2024-04-01T19:36:33.980 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.980 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55036a67:::benchmark_data_smithi188_104537_object98039:head# 2024-04-01T19:36:33.980 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.980 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55045537:::benchmark_data_smithi188_104537_object109154:head# 2024-04-01T19:36:33.980 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.980 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55048dc5:::benchmark_data_smithi188_104537_object164708:head# 2024-04-01T19:36:33.980 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.980 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55054cff:::benchmark_data_smithi188_104537_object76845:head# 2024-04-01T19:36:33.980 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.980 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:33.982 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:36:33.982 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5506093b:::benchmark_data_smithi188_104537_object64510:head# 2024-04-01T19:36:33.983 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.983 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55068819:::benchmark_data_smithi188_104537_object146393:head# 2024-04-01T19:36:33.983 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.983 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5506b3fc:::benchmark_data_smithi188_104537_object25307:head# 2024-04-01T19:36:33.983 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.983 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:550701f9:::benchmark_data_smithi188_104537_object171104:head# 2024-04-01T19:36:33.983 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.983 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55076585:::benchmark_data_smithi188_104537_object111029:head# 2024-04-01T19:36:33.983 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.983 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5507775b:::benchmark_data_smithi188_104537_object157352:head# 2024-04-01T19:36:33.983 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.983 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:550783d1:::benchmark_data_smithi188_104537_object103005:head# 2024-04-01T19:36:33.983 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.983 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5507decb:::benchmark_data_smithi188_104537_object52063:head# 2024-04-01T19:36:33.983 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.984 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5508b032:::benchmark_data_smithi188_104537_object27628:head# 2024-04-01T19:36:33.984 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.984 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:550962ec:::benchmark_data_smithi188_104537_object89130:head# 2024-04-01T19:36:33.984 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.984 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55096785:::benchmark_data_smithi188_104537_object15695:head# 2024-04-01T19:36:33.984 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.984 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55099d20:::benchmark_data_smithi188_104537_object122366:head# 2024-04-01T19:36:33.984 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.984 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:550aa432:::benchmark_data_smithi188_104537_object149305:head# 2024-04-01T19:36:33.984 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.985 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:550acf94:::benchmark_data_smithi188_104537_object49796:head# 2024-04-01T19:36:33.985 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.985 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:550b3258:::benchmark_data_smithi188_104537_object143818:head# 2024-04-01T19:36:33.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:550b4fdd:::benchmark_data_smithi188_104537_object15084:head# 2024-04-01T19:36:33.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:550b7b2c:::benchmark_data_smithi188_104537_object25676:head# 2024-04-01T19:36:33.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:550d254b:::benchmark_data_smithi188_104537_object58826:head# 2024-04-01T19:36:33.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:550d84e8:::benchmark_data_smithi188_104537_object54215:head# 2024-04-01T19:36:33.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:550d8693:::benchmark_data_smithi188_104537_object124393:head# 2024-04-01T19:36:33.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:550dd3c2:::benchmark_data_smithi188_104537_object92852:head# 2024-04-01T19:36:33.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.987 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:550ddff4:::benchmark_data_smithi188_104537_object64281:head# 2024-04-01T19:36:33.987 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.987 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:550de451:::benchmark_data_smithi188_104537_object109121:head# 2024-04-01T19:36:33.987 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.987 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:550de5e7:::benchmark_data_smithi188_104537_object79451:head# 2024-04-01T19:36:33.987 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.989 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:550f1910:::benchmark_data_smithi188_104537_object140614:head# 2024-04-01T19:36:33.989 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.989 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:550fd5e0:::benchmark_data_smithi188_104537_object101366:head# 2024-04-01T19:36:33.989 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.989 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:550fda69:::benchmark_data_smithi188_104537_object123408:head# 2024-04-01T19:36:33.989 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.989 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:550feb11:::benchmark_data_smithi188_104537_object17175:head# 2024-04-01T19:36:33.989 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.989 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55100b41:::benchmark_data_smithi188_104537_object98997:head# 2024-04-01T19:36:33.989 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.989 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55107b7f:::benchmark_data_smithi188_104537_object81179:head# 2024-04-01T19:36:33.989 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.990 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:551089d1:::benchmark_data_smithi188_104537_object84108:head# 2024-04-01T19:36:33.990 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.990 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55109c3d:::benchmark_data_smithi188_104537_object147439:head# 2024-04-01T19:36:33.990 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.990 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5510ca67:::benchmark_data_smithi188_104537_object30368:head# 2024-04-01T19:36:33.990 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.990 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5510dafd:::benchmark_data_smithi188_104537_object105276:head# 2024-04-01T19:36:33.990 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.990 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5510fabe:::benchmark_data_smithi188_104537_object153321:head# 2024-04-01T19:36:33.990 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.990 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55111235:::benchmark_data_smithi188_104537_object111266:head# 2024-04-01T19:36:33.990 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.993 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55125481:::benchmark_data_smithi188_104537_object99278:head# 2024-04-01T19:36:33.993 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.993 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5512b0af:::benchmark_data_smithi188_104537_object77199:head# 2024-04-01T19:36:33.993 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.993 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5512f4c1:::benchmark_data_smithi188_104537_object129625:head# 2024-04-01T19:36:33.993 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.993 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55131735:::benchmark_data_smithi188_104537_object141293:head# 2024-04-01T19:36:33.993 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.993 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55133694:::benchmark_data_smithi188_104537_object68031:head# 2024-04-01T19:36:33.993 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.993 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5513f393:::benchmark_data_smithi188_104537_object25377:head# 2024-04-01T19:36:33.993 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.993 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:551438b8:::benchmark_data_smithi188_104537_object36133:head# 2024-04-01T19:36:33.993 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.993 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5514bba1:::benchmark_data_smithi188_104537_object54330:head# 2024-04-01T19:36:33.994 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.994 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5514f19e:::benchmark_data_smithi188_104537_object44931:head# 2024-04-01T19:36:33.994 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.994 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5515a704:::benchmark_data_smithi188_104537_object142506:head# 2024-04-01T19:36:33.994 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.994 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5516be64:::benchmark_data_smithi188_104537_object40836:head# 2024-04-01T19:36:33.994 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.994 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55172c76:::benchmark_data_smithi188_104537_object102221:head# 2024-04-01T19:36:33.994 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.994 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55198c3c:::benchmark_data_smithi188_104537_object142720:head# 2024-04-01T19:36:33.994 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.994 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5519aff9:::benchmark_data_smithi188_104537_object123365:head# 2024-04-01T19:36:33.994 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.994 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:551a0ffd:::benchmark_data_smithi188_104537_object15919:head# 2024-04-01T19:36:33.994 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.997 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:551a3980:::benchmark_data_smithi188_104537_object121046:head# 2024-04-01T19:36:33.997 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.998 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:551a40e4:::benchmark_data_smithi188_104537_object106902:head# 2024-04-01T19:36:33.998 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.998 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:551a49a1:::benchmark_data_smithi188_104537_object63008:head# 2024-04-01T19:36:33.998 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.998 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:551ab405:::benchmark_data_smithi188_104537_object167459:head# 2024-04-01T19:36:33.998 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.998 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:551ab6c8:::benchmark_data_smithi188_104537_object89931:head# 2024-04-01T19:36:33.998 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.998 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:551ab9b5:::benchmark_data_smithi188_104537_object123035:head# 2024-04-01T19:36:33.998 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.998 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:551afd36:::benchmark_data_smithi188_104537_object32563:head# 2024-04-01T19:36:33.998 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.998 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:551c3086:::benchmark_data_smithi188_104537_object165215:head# 2024-04-01T19:36:33.998 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.999 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:551cffd1:::benchmark_data_smithi188_104537_object142247:head# 2024-04-01T19:36:33.999 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.999 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:551d09fd:::benchmark_data_smithi188_104537_object64052:head# 2024-04-01T19:36:33.999 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.999 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:551d47a5:::benchmark_data_smithi188_104537_object169699:head# 2024-04-01T19:36:33.999 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.999 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:551e30f6:::benchmark_data_smithi188_104537_object99060:head# 2024-04-01T19:36:33.999 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.999 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:551e31be:::benchmark_data_smithi188_104537_object111062:head# 2024-04-01T19:36:33.999 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.999 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:551ea001:::benchmark_data_smithi188_104537_object169010:head# 2024-04-01T19:36:33.999 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.999 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:551eb14f:::benchmark_data_smithi188_104537_object155672:head# 2024-04-01T19:36:33.999 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:33.999 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:551f1242:::benchmark_data_smithi188_104537_object94357:head# 2024-04-01T19:36:34.000 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.000 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:551f5a7f:::benchmark_data_smithi188_104537_object24730:head# 2024-04-01T19:36:34.000 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.000 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:551f7267:::benchmark_data_smithi188_104537_object15687:head# 2024-04-01T19:36:34.000 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.000 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:551ff1d1:::benchmark_data_smithi188_104537_object21027:head# 2024-04-01T19:36:34.000 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.000 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55206786:::benchmark_data_smithi188_104537_object164458:head# 2024-04-01T19:36:34.000 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.003 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55208561:::benchmark_data_smithi188_104537_object37546:head# 2024-04-01T19:36:34.003 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.003 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5520a5f4:::benchmark_data_smithi188_104537_object20368:head# 2024-04-01T19:36:34.003 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.003 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55218911:::benchmark_data_smithi188_104537_object17843:head# 2024-04-01T19:36:34.003 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.003 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5521cf18:::benchmark_data_smithi188_104537_object100327:head# 2024-04-01T19:36:34.003 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.003 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5521d5e0:::benchmark_data_smithi188_104537_object12586:head# 2024-04-01T19:36:34.003 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.003 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55228c30:::benchmark_data_smithi188_104537_object71847:head# 2024-04-01T19:36:34.003 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.003 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55230f04:::benchmark_data_smithi188_104537_object67945:head# 2024-04-01T19:36:34.003 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.004 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:552320c0:::benchmark_data_smithi188_104537_object53292:head# 2024-04-01T19:36:34.004 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.004 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55238a21:::benchmark_data_smithi188_104537_object33981:head# 2024-04-01T19:36:34.004 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.004 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5524b43e:::benchmark_data_smithi188_104537_object120349:head# 2024-04-01T19:36:34.004 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.004 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5524c1ce:::benchmark_data_smithi188_104537_object45203:head# 2024-04-01T19:36:34.004 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.004 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55259fd4:::benchmark_data_smithi188_104537_object48424:head# 2024-04-01T19:36:34.004 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.004 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5525d883:::benchmark_data_smithi188_104537_object151861:head# 2024-04-01T19:36:34.004 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.004 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5525fa4e:::benchmark_data_smithi188_104537_object70511:head# 2024-04-01T19:36:34.004 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.004 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5526268a:::benchmark_data_smithi188_104537_object49893:head# 2024-04-01T19:36:34.004 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.005 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55264611:::benchmark_data_smithi188_104537_object76896:head# 2024-04-01T19:36:34.005 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.005 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5527b26a:::benchmark_data_smithi188_104537_object77010:head# 2024-04-01T19:36:34.005 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.005 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5527c937:::benchmark_data_smithi188_104537_object71760:head# 2024-04-01T19:36:34.005 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.005 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5527f0e9:::benchmark_data_smithi188_104537_object97541:head# 2024-04-01T19:36:34.005 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.009 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:552885f4:::benchmark_data_smithi188_104537_object166858:head# 2024-04-01T19:36:34.009 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.009 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5528d621:::benchmark_data_smithi188_104537_object12261:head# 2024-04-01T19:36:34.009 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.009 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55293ec3:::benchmark_data_smithi188_104537_object132849:head# 2024-04-01T19:36:34.009 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.009 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:552963e8:::benchmark_data_smithi188_104537_object121751:head# 2024-04-01T19:36:34.009 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.009 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:552a213b:::benchmark_data_smithi188_104537_object98755:head# 2024-04-01T19:36:34.009 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.009 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:552b2b66:::benchmark_data_smithi188_104537_object160238:head# 2024-04-01T19:36:34.009 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.009 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:552bd759:::benchmark_data_smithi188_104537_object115943:head# 2024-04-01T19:36:34.010 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.010 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:552c0259:::benchmark_data_smithi188_104537_object69899:head# 2024-04-01T19:36:34.010 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.010 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:552c6b47:::benchmark_data_smithi188_104537_object104714:head# 2024-04-01T19:36:34.010 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.010 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:552c88c4:::benchmark_data_smithi188_104537_object66347:head# 2024-04-01T19:36:34.010 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.010 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:552cfd3c:::benchmark_data_smithi188_104537_object60623:head# 2024-04-01T19:36:34.010 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.010 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:552db2dd:::benchmark_data_smithi188_104537_object60941:head# 2024-04-01T19:36:34.010 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.010 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:552f2892:::benchmark_data_smithi188_104537_object28980:head# 2024-04-01T19:36:34.010 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.010 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:552ffd6f:::benchmark_data_smithi188_104537_object169208:head# 2024-04-01T19:36:34.011 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.011 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55300d7f:::benchmark_data_smithi188_104537_object44886:head# 2024-04-01T19:36:34.011 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.011 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:553031f8:::benchmark_data_smithi188_104537_object67629:head# 2024-04-01T19:36:34.011 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.011 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5530b10c:::benchmark_data_smithi188_104537_object161304:head# 2024-04-01T19:36:34.011 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.011 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5531593e:::benchmark_data_smithi188_104537_object83733:head# 2024-04-01T19:36:34.011 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.011 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55318202:::benchmark_data_smithi188_104537_object123184:head# 2024-04-01T19:36:34.011 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.011 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5531aa23:::benchmark_data_smithi188_104537_object155649:head# 2024-04-01T19:36:34.011 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.011 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:553203aa:::benchmark_data_smithi188_104537_object62052:head# 2024-04-01T19:36:34.011 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.012 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55320ce9:::benchmark_data_smithi188_104537_object132091:head# 2024-04-01T19:36:34.012 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.014 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55327d51:::benchmark_data_smithi188_104537_object20788:head# 2024-04-01T19:36:34.014 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.014 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5532fd6a:::benchmark_data_smithi188_104537_object60482:head# 2024-04-01T19:36:34.014 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.014 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5533775b:::benchmark_data_smithi188_104537_object37093:head# 2024-04-01T19:36:34.014 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.015 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5533c4e9:::benchmark_data_smithi188_104537_object31970:head# 2024-04-01T19:36:34.015 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.015 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:553406b8:::benchmark_data_smithi188_104537_object166471:head# 2024-04-01T19:36:34.015 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.015 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55345dd1:::benchmark_data_smithi188_104537_object95775:head# 2024-04-01T19:36:34.015 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.015 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55357ee8:::benchmark_data_smithi188_104537_object163288:head# 2024-04-01T19:36:34.015 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.015 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5536cab2:::benchmark_data_smithi188_104537_object163062:head# 2024-04-01T19:36:34.015 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.015 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:553719a7:::benchmark_data_smithi188_104537_object144867:head# 2024-04-01T19:36:34.015 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.015 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55373303:::benchmark_data_smithi188_104537_object110301:head# 2024-04-01T19:36:34.015 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55379c15:::benchmark_data_smithi188_104537_object132721:head# 2024-04-01T19:36:34.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5538ab9b:::benchmark_data_smithi188_104537_object102549:head# 2024-04-01T19:36:34.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55394530:::benchmark_data_smithi188_104537_object72595:head# 2024-04-01T19:36:34.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:553a0c26:::benchmark_data_smithi188_104537_object112426:head# 2024-04-01T19:36:34.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:553a7722:::benchmark_data_smithi188_104537_object166377:head# 2024-04-01T19:36:34.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:553ae226:::benchmark_data_smithi188_104537_object88492:head# 2024-04-01T19:36:34.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:553b381d:::benchmark_data_smithi188_104537_object157845:head# 2024-04-01T19:36:34.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:553b4447:::benchmark_data_smithi188_104537_object86735:head# 2024-04-01T19:36:34.017 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.017 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:553b4ef0:::benchmark_data_smithi188_104537_object63960:head# 2024-04-01T19:36:34.017 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.017 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:553b8dad:::benchmark_data_smithi188_104537_object138664:head# 2024-04-01T19:36:34.017 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.020 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:553ba4c1:::benchmark_data_smithi188_104537_object70911:head# 2024-04-01T19:36:34.020 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.020 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:553bc55b:::benchmark_data_smithi188_104537_object111835:head# 2024-04-01T19:36:34.020 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.020 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:553cfdd3:::benchmark_data_smithi188_104537_object45261:head# 2024-04-01T19:36:34.020 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.020 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:553d2b21:::benchmark_data_smithi188_104537_object42633:head# 2024-04-01T19:36:34.020 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.020 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:553d4537:::benchmark_data_smithi188_104537_object23509:head# 2024-04-01T19:36:34.020 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.020 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:553d497d:::benchmark_data_smithi188_104537_object94292:head# 2024-04-01T19:36:34.021 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.021 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:553d7ccd:::benchmark_data_smithi188_104537_object93127:head# 2024-04-01T19:36:34.021 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.021 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:553d98ad:::benchmark_data_smithi188_104537_object12093:head# 2024-04-01T19:36:34.021 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.021 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:553ef4b1:::benchmark_data_smithi188_104537_object150334:head# 2024-04-01T19:36:34.021 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.021 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:553f72c7:::benchmark_data_smithi188_104537_object103051:head# 2024-04-01T19:36:34.021 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.021 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:553fbe81:::benchmark_data_smithi188_104537_object117073:head# 2024-04-01T19:36:34.021 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.021 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55407d23:::benchmark_data_smithi188_104537_object152165:head# 2024-04-01T19:36:34.021 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.021 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55436811:::benchmark_data_smithi188_104537_object146685:head# 2024-04-01T19:36:34.021 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.021 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5543b32a:::benchmark_data_smithi188_104537_object56880:head# 2024-04-01T19:36:34.022 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.022 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5544747b:::benchmark_data_smithi188_104537_object29409:head# 2024-04-01T19:36:34.022 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.022 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5544779f:::benchmark_data_smithi188_104537_object113449:head# 2024-04-01T19:36:34.022 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.022 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5544aad1:::benchmark_data_smithi188_104537_object127984:head# 2024-04-01T19:36:34.022 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.022 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5544c8d0:::benchmark_data_smithi188_104537_object102277:head# 2024-04-01T19:36:34.022 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.022 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:554510a5:::benchmark_data_smithi188_104537_object18882:head# 2024-04-01T19:36:34.022 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.022 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5545c99d:::benchmark_data_smithi188_104537_object35702:head# 2024-04-01T19:36:34.022 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.023 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55460014:::benchmark_data_smithi188_104537_object97335:head# 2024-04-01T19:36:34.023 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55461b07:::benchmark_data_smithi188_104537_object38460:head# 2024-04-01T19:36:34.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:554641a9:::benchmark_data_smithi188_104537_object109152:head# 2024-04-01T19:36:34.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5546a91a:::benchmark_data_smithi188_104537_object163635:head# 2024-04-01T19:36:34.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5546b41e:::benchmark_data_smithi188_104537_object113698:head# 2024-04-01T19:36:34.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5546dce1:::benchmark_data_smithi188_104537_object96982:head# 2024-04-01T19:36:34.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:554764fe:::benchmark_data_smithi188_104537_object168254:head# 2024-04-01T19:36:34.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5548053f:::benchmark_data_smithi188_104537_object115928:head# 2024-04-01T19:36:34.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55489af6:::benchmark_data_smithi188_104537_object106952:head# 2024-04-01T19:36:34.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:554a055a:::benchmark_data_smithi188_104537_object32463:head# 2024-04-01T19:36:34.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:554a367f:::benchmark_data_smithi188_104537_object155849:head# 2024-04-01T19:36:34.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:554a9290:::benchmark_data_smithi188_104537_object68281:head# 2024-04-01T19:36:34.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:554aabb6:::benchmark_data_smithi188_104537_object71780:head# 2024-04-01T19:36:34.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:554aaf0f:::benchmark_data_smithi188_104537_object63029:head# 2024-04-01T19:36:34.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:554b4d9a:::benchmark_data_smithi188_104537_object99206:head# 2024-04-01T19:36:34.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:554c2de1:::benchmark_data_smithi188_104537_object151132:head# 2024-04-01T19:36:34.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:554c759c:::benchmark_data_smithi188_104537_object114287:head# 2024-04-01T19:36:34.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:554d3b4e:::benchmark_data_smithi188_104537_object75393:head# 2024-04-01T19:36:34.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:554e4048:::benchmark_data_smithi188_104537_object20965:head# 2024-04-01T19:36:34.028 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.028 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:554f1af5:::benchmark_data_smithi188_104537_object132251:head# 2024-04-01T19:36:34.028 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.029 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:554f6d56:::benchmark_data_smithi188_104537_object141949:head# 2024-04-01T19:36:34.029 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.029 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:554f7c86:::benchmark_data_smithi188_104537_object144097:head# 2024-04-01T19:36:34.029 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.030 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55500940:::benchmark_data_smithi188_104537_object26075:head# 2024-04-01T19:36:34.030 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.030 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5550c132:::benchmark_data_smithi188_104537_object145825:head# 2024-04-01T19:36:34.030 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.030 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5550d6a1:::benchmark_data_smithi188_104537_object109983:head# 2024-04-01T19:36:34.030 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.030 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5551cb74:::benchmark_data_smithi188_104537_object127388:head# 2024-04-01T19:36:34.030 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.030 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55521646:::benchmark_data_smithi188_104537_object128807:head# 2024-04-01T19:36:34.030 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.030 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55521aef:::benchmark_data_smithi188_104537_object137431:head# 2024-04-01T19:36:34.030 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.030 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5552db6d:::benchmark_data_smithi188_104537_object52450:head# 2024-04-01T19:36:34.030 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.031 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55530a59:::benchmark_data_smithi188_104537_object59049:head# 2024-04-01T19:36:34.031 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.031 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55534f10:::benchmark_data_smithi188_104537_object170620:head# 2024-04-01T19:36:34.031 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.031 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55538ff2:::benchmark_data_smithi188_104537_object116442:head# 2024-04-01T19:36:34.031 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.031 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:555526d8:::benchmark_data_smithi188_104537_object88274:head# 2024-04-01T19:36:34.031 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.031 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55566406:::benchmark_data_smithi188_104537_object59494:head# 2024-04-01T19:36:34.031 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.031 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5556ecf3:::benchmark_data_smithi188_104537_object132801:head# 2024-04-01T19:36:34.031 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.031 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55574b2e:::benchmark_data_smithi188_104537_object92448:head# 2024-04-01T19:36:34.031 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.031 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:555844e5:::benchmark_data_smithi188_104537_object81107:head# 2024-04-01T19:36:34.031 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.033 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5558a636:::benchmark_data_smithi188_104537_object98185:head# 2024-04-01T19:36:34.033 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.033 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5558c07f:::benchmark_data_smithi188_104537_object55944:head# 2024-04-01T19:36:34.033 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.033 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5558da30:::benchmark_data_smithi188_104537_object88073:head# 2024-04-01T19:36:34.033 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.033 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5559162b:::benchmark_data_smithi188_104537_object54843:head# 2024-04-01T19:36:34.033 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.033 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:555923d2:::benchmark_data_smithi188_104537_object127361:head# 2024-04-01T19:36:34.033 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55596956:::benchmark_data_smithi188_104537_object97065:head# 2024-04-01T19:36:34.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:555a581e:::benchmark_data_smithi188_104537_object23441:head# 2024-04-01T19:36:34.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:555aa8a9:::benchmark_data_smithi188_104537_object27160:head# 2024-04-01T19:36:34.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:555bb21f:::benchmark_data_smithi188_104537_object139115:head# 2024-04-01T19:36:34.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:555bee52:::benchmark_data_smithi188_104537_object15741:head# 2024-04-01T19:36:34.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:555ca02c:::benchmark_data_smithi188_104537_object23021:head# 2024-04-01T19:36:34.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:555caf8e:::benchmark_data_smithi188_104537_object151063:head# 2024-04-01T19:36:34.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:555d26de:::benchmark_data_smithi188_104537_object26967:head# 2024-04-01T19:36:34.035 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.035 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:555d2f78:::benchmark_data_smithi188_104537_object136978:head# 2024-04-01T19:36:34.035 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.037 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:555d785e:::benchmark_data_smithi188_104537_object112069:head# 2024-04-01T19:36:34.037 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.037 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:555dd2bb:::benchmark_data_smithi188_104537_object26742:head# 2024-04-01T19:36:34.037 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.037 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:555e4de1:::benchmark_data_smithi188_104537_object158602:head# 2024-04-01T19:36:34.037 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.037 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:555e7d14:::benchmark_data_smithi188_104537_object71295:head# 2024-04-01T19:36:34.037 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.037 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:555e8f03:::benchmark_data_smithi188_104537_object14868:head# 2024-04-01T19:36:34.037 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.037 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:555e9740:::benchmark_data_smithi188_104537_object167705:head# 2024-04-01T19:36:34.037 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.037 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:555ede6a:::benchmark_data_smithi188_104537_object139356:head# 2024-04-01T19:36:34.038 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.038 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:555fcc7f:::benchmark_data_smithi188_104537_object44476:head# 2024-04-01T19:36:34.038 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.038 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:555ff117:::benchmark_data_smithi188_104537_object143525:head# 2024-04-01T19:36:34.038 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.038 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5560089f:::benchmark_data_smithi188_104537_object113519:head# 2024-04-01T19:36:34.038 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.038 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:556055bb:::benchmark_data_smithi188_104537_object32595:head# 2024-04-01T19:36:34.038 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.038 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5560685f:::benchmark_data_smithi188_104537_object57342:head# 2024-04-01T19:36:34.038 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.038 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55608db9:::benchmark_data_smithi188_104537_object162477:head# 2024-04-01T19:36:34.038 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.039 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55611a76:::benchmark_data_smithi188_104537_object82075:head# 2024-04-01T19:36:34.039 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.039 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:556169b3:::benchmark_data_smithi188_104537_object102750:head# 2024-04-01T19:36:34.039 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.039 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5561d757:::benchmark_data_smithi188_104537_object159767:head# 2024-04-01T19:36:34.039 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.041 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55622698:::benchmark_data_smithi188_104537_object135164:head# 2024-04-01T19:36:34.041 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.041 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55623cd6:::benchmark_data_smithi188_104537_object60958:head# 2024-04-01T19:36:34.041 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.041 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5562554f:::benchmark_data_smithi188_104537_object23188:head# 2024-04-01T19:36:34.041 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.041 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:556275e9:::benchmark_data_smithi188_104537_object66746:head# 2024-04-01T19:36:34.041 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.041 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55627d75:::benchmark_data_smithi188_104537_object15833:head# 2024-04-01T19:36:34.041 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.041 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:556341ec:::benchmark_data_smithi188_104537_object117569:head# 2024-04-01T19:36:34.041 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.041 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55638ffe:::benchmark_data_smithi188_104537_object25378:head# 2024-04-01T19:36:34.042 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.042 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5563a980:::benchmark_data_smithi188_104537_object126105:head# 2024-04-01T19:36:34.042 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.042 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5563f971:::benchmark_data_smithi188_104537_object87850:head# 2024-04-01T19:36:34.042 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.042 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5564469d:::benchmark_data_smithi188_104537_object34258:head# 2024-04-01T19:36:34.042 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.042 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55645711:::benchmark_data_smithi188_104537_object86002:head# 2024-04-01T19:36:34.042 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.042 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5565263b:::benchmark_data_smithi188_104537_object72528:head# 2024-04-01T19:36:34.042 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.042 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5565efa8:::benchmark_data_smithi188_104537_object29761:head# 2024-04-01T19:36:34.042 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.042 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:556668f7:::benchmark_data_smithi188_104537_object66853:head# 2024-04-01T19:36:34.042 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.042 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5566a330:::benchmark_data_smithi188_104537_object59240:head# 2024-04-01T19:36:34.043 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.045 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5566cceb:::benchmark_data_smithi188_104537_object13981:head# 2024-04-01T19:36:34.045 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.045 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5567ac51:::benchmark_data_smithi188_104537_object109867:head# 2024-04-01T19:36:34.045 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.045 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55681ddd:::benchmark_data_smithi188_104537_object101656:head# 2024-04-01T19:36:34.045 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.045 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:556893af:::benchmark_data_smithi188_104537_object148908:head# 2024-04-01T19:36:34.045 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.045 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5568b820:::benchmark_data_smithi188_104537_object93971:head# 2024-04-01T19:36:34.045 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.045 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5568ef26:::benchmark_data_smithi188_104537_object169463:head# 2024-04-01T19:36:34.045 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.045 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55690abf:::benchmark_data_smithi188_104537_object36498:head# 2024-04-01T19:36:34.045 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55693573:::benchmark_data_smithi188_104537_object12860:head# 2024-04-01T19:36:34.046 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55695610:::benchmark_data_smithi188_104537_object93000:head# 2024-04-01T19:36:34.046 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:556958a8:::benchmark_data_smithi188_104537_object47085:head# 2024-04-01T19:36:34.046 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55699c80:::benchmark_data_smithi188_104537_object60159:head# 2024-04-01T19:36:34.046 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5569a7c7:::benchmark_data_smithi188_104537_object75116:head# 2024-04-01T19:36:34.046 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:556a709e:::benchmark_data_smithi188_104537_object102138:head# 2024-04-01T19:36:34.046 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:556ae3dd:::benchmark_data_smithi188_104537_object166033:head# 2024-04-01T19:36:34.046 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:556b3436:::benchmark_data_smithi188_104537_object46550:head# 2024-04-01T19:36:34.047 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.049 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:556b5d7a:::benchmark_data_smithi188_104537_object63395:head# 2024-04-01T19:36:34.049 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.050 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:556bb7d7:::benchmark_data_smithi188_104537_object57537:head# 2024-04-01T19:36:34.051 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.051 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:556bf58f:::benchmark_data_smithi188_104537_object165786:head# 2024-04-01T19:36:34.051 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.051 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:556c02a3:::benchmark_data_smithi188_104537_object148126:head# 2024-04-01T19:36:34.051 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.051 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:556c5edd:::benchmark_data_smithi188_104537_object101687:head# 2024-04-01T19:36:34.051 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:556cb4db:::benchmark_data_smithi188_104537_object70279:head# 2024-04-01T19:36:34.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:556cdc00:::benchmark_data_smithi188_104537_object70615:head# 2024-04-01T19:36:34.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:556d4d30:::benchmark_data_smithi188_104537_object152892:head# 2024-04-01T19:36:34.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:556d9811:::benchmark_data_smithi188_104537_object107784:head# 2024-04-01T19:36:34.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.053 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:556db895:::benchmark_data_smithi188_104537_object86600:head# 2024-04-01T19:36:34.053 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.053 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:556dbc93:::benchmark_data_smithi188_104537_object64301:head# 2024-04-01T19:36:34.053 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.054 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:556e9c1f:::benchmark_data_smithi188_104537_object128553:head# 2024-04-01T19:36:34.054 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.055 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:556edeab:::benchmark_data_smithi188_104537_object11551:head# 2024-04-01T19:36:34.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.055 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:556f434f:::benchmark_data_smithi188_104537_object151874:head# 2024-04-01T19:36:34.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.055 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:556f50f3:::benchmark_data_smithi188_104537_object69477:head# 2024-04-01T19:36:34.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.055 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55700625:::benchmark_data_smithi188_104537_object51657:head# 2024-04-01T19:36:34.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.055 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55702d97:::benchmark_data_smithi188_104537_object51094:head# 2024-04-01T19:36:34.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.055 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55707a78:::benchmark_data_smithi188_104537_object19404:head# 2024-04-01T19:36:34.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.055 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5570e371:::benchmark_data_smithi188_104537_object26094:head# 2024-04-01T19:36:34.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.055 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:557220dc:::benchmark_data_smithi188_104537_object56742:head# 2024-04-01T19:36:34.056 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.056 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5572b51d:::benchmark_data_smithi188_104537_object138494:head# 2024-04-01T19:36:34.056 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.056 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:36:34.057 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:36:34.057 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55730f76:::benchmark_data_smithi188_104537_object22899:head# 2024-04-01T19:36:34.057 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.057 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55743fcc:::benchmark_data_smithi188_104537_object124145:head# 2024-04-01T19:36:34.058 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.058 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5575084f:::benchmark_data_smithi188_104537_object166655:head# 2024-04-01T19:36:34.058 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5575224f:::benchmark_data_smithi188_104537_object79438:head# 2024-04-01T19:36:34.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55753d8e:::benchmark_data_smithi188_104537_object64264:head# 2024-04-01T19:36:34.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:557590c9:::benchmark_data_smithi188_104537_object66952:head# 2024-04-01T19:36:34.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5576076a:::benchmark_data_smithi188_104537_object83558:head# 2024-04-01T19:36:34.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55762869:::benchmark_data_smithi188_104537_object130488:head# 2024-04-01T19:36:34.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55767852:::benchmark_data_smithi188_104537_object122127:head# 2024-04-01T19:36:34.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55769077:::benchmark_data_smithi188_104537_object47750:head# 2024-04-01T19:36:34.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5576ab29:::benchmark_data_smithi188_104537_object72587:head# 2024-04-01T19:36:34.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55775f01:::benchmark_data_smithi188_104537_object59797:head# 2024-04-01T19:36:34.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:557778a0:::benchmark_data_smithi188_104537_object16702:head# 2024-04-01T19:36:34.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5577a682:::benchmark_data_smithi188_104537_object136132:head# 2024-04-01T19:36:34.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5577c3ef:::benchmark_data_smithi188_104537_object153808:head# 2024-04-01T19:36:34.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5578e1c8:::benchmark_data_smithi188_104537_object35931:head# 2024-04-01T19:36:34.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5578e7bb:::benchmark_data_smithi188_104537_object64230:head# 2024-04-01T19:36:34.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:557a038b:::benchmark_data_smithi188_104537_object35831:head# 2024-04-01T19:36:34.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.062 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:557b04fa:::benchmark_data_smithi188_104537_object68847:head# 2024-04-01T19:36:34.062 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.064 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:557b99d7:::benchmark_data_smithi188_104537_object135333:head# 2024-04-01T19:36:34.064 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.064 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:557bf150:::benchmark_data_smithi188_104537_object164179:head# 2024-04-01T19:36:34.065 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.065 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:557bf655:::benchmark_data_smithi188_104537_object76203:head# 2024-04-01T19:36:34.065 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.065 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:557ca8c5:::benchmark_data_smithi188_104537_object164547:head# 2024-04-01T19:36:34.065 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.065 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:557cc77d:::benchmark_data_smithi188_104537_object90177:head# 2024-04-01T19:36:34.065 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.065 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:557ccbd2:::benchmark_data_smithi188_104537_object41166:head# 2024-04-01T19:36:34.065 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.065 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:557cf46a:::benchmark_data_smithi188_104537_object132271:head# 2024-04-01T19:36:34.065 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.065 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:557cf9c7:::benchmark_data_smithi188_104537_object86904:head# 2024-04-01T19:36:34.065 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.065 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:557d6d9a:::benchmark_data_smithi188_104537_object114402:head# 2024-04-01T19:36:34.065 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:557d9674:::benchmark_data_smithi188_104537_object28364:head# 2024-04-01T19:36:34.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:557dddba:::benchmark_data_smithi188_104537_object84985:head# 2024-04-01T19:36:34.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:557deffc:::benchmark_data_smithi188_104537_object122568:head# 2024-04-01T19:36:34.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:557e884c:::benchmark_data_smithi188_104537_object125269:head# 2024-04-01T19:36:34.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:557ecb7e:::benchmark_data_smithi188_104537_object86993:head# 2024-04-01T19:36:34.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:557ef4bd:::benchmark_data_smithi188_104537_object106494:head# 2024-04-01T19:36:34.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:557f7ba7:::benchmark_data_smithi188_104537_object145108:head# 2024-04-01T19:36:34.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.067 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:557fd4c9:::benchmark_data_smithi188_104537_object81263:head# 2024-04-01T19:36:34.067 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55802236:::benchmark_data_smithi188_104537_object157899:head# 2024-04-01T19:36:34.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5581f8a9:::benchmark_data_smithi188_104537_object171080:head# 2024-04-01T19:36:34.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55824f77:::benchmark_data_smithi188_104537_object70493:head# 2024-04-01T19:36:34.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5582505c:::benchmark_data_smithi188_104537_object165584:head# 2024-04-01T19:36:34.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5582e809:::benchmark_data_smithi188_104537_object90856:head# 2024-04-01T19:36:34.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5583b89e:::benchmark_data_smithi188_104537_object131029:head# 2024-04-01T19:36:34.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5583d745:::benchmark_data_smithi188_104537_object144044:head# 2024-04-01T19:36:34.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55846d48:::benchmark_data_smithi188_104537_object65988:head# 2024-04-01T19:36:34.070 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.070 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5584de0c:::benchmark_data_smithi188_104537_object70746:head# 2024-04-01T19:36:34.070 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.070 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5584e193:::benchmark_data_smithi188_104537_object29281:head# 2024-04-01T19:36:34.070 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.070 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5585bbf7:::benchmark_data_smithi188_104537_object76507:head# 2024-04-01T19:36:34.070 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.070 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5585c8fd:::benchmark_data_smithi188_104537_object63040:head# 2024-04-01T19:36:34.070 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.070 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5585db7b:::benchmark_data_smithi188_104537_object74545:head# 2024-04-01T19:36:34.070 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.070 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5585f3e8:::benchmark_data_smithi188_104537_object78671:head# 2024-04-01T19:36:34.070 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.071 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55861b58:::benchmark_data_smithi188_104537_object160308:head# 2024-04-01T19:36:34.071 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.071 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55864845:::benchmark_data_smithi188_104537_object28454:head# 2024-04-01T19:36:34.071 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5586c236:::benchmark_data_smithi188_104537_object39071:head# 2024-04-01T19:36:34.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:558760f3:::benchmark_data_smithi188_104537_object28458:head# 2024-04-01T19:36:34.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55877a71:::benchmark_data_smithi188_104537_object74528:head# 2024-04-01T19:36:34.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5587f405:::benchmark_data_smithi188_104537_object13145:head# 2024-04-01T19:36:34.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:558886c2:::benchmark_data_smithi188_104537_object163493:head# 2024-04-01T19:36:34.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5588ae3a:::benchmark_data_smithi188_104537_object134497:head# 2024-04-01T19:36:34.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5588e4b8:::benchmark_data_smithi188_104537_object113280:head# 2024-04-01T19:36:34.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:558a0694:::benchmark_data_smithi188_104537_object42117:head# 2024-04-01T19:36:34.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:558a3190:::benchmark_data_smithi188_104537_object92982:head# 2024-04-01T19:36:34.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:558b406a:::benchmark_data_smithi188_104537_object145586:head# 2024-04-01T19:36:34.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:558bbee5:::benchmark_data_smithi188_104537_object54273:head# 2024-04-01T19:36:34.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:558bc562:::benchmark_data_smithi188_104537_object50541:head# 2024-04-01T19:36:34.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:558bd631:::benchmark_data_smithi188_104537_object80170:head# 2024-04-01T19:36:34.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:558c019f:::benchmark_data_smithi188_104537_object109509:head# 2024-04-01T19:36:34.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:558cc9dc:::benchmark_data_smithi188_104537_object133089:head# 2024-04-01T19:36:34.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:558d65c1:::benchmark_data_smithi188_104537_object28376:head# 2024-04-01T19:36:34.075 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:558dfa68:::benchmark_data_smithi188_104537_object15316:head# 2024-04-01T19:36:34.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:558e5443:::benchmark_data_smithi188_104537_object142452:head# 2024-04-01T19:36:34.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:558e8a19:::benchmark_data_smithi188_104537_object70908:head# 2024-04-01T19:36:34.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:558f3d86:::benchmark_data_smithi188_104537_object112931:head# 2024-04-01T19:36:34.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55927e3a:::benchmark_data_smithi188_104537_object28168:head# 2024-04-01T19:36:34.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5592c1b1:::benchmark_data_smithi188_104537_object75919:head# 2024-04-01T19:36:34.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559301d8:::benchmark_data_smithi188_104537_object16654:head# 2024-04-01T19:36:34.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5593dc91:::benchmark_data_smithi188_104537_object100435:head# 2024-04-01T19:36:34.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5594316e:::benchmark_data_smithi188_104537_object117059:head# 2024-04-01T19:36:34.078 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.078 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559496a4:::benchmark_data_smithi188_104537_object90060:head# 2024-04-01T19:36:34.078 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.078 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559507d1:::benchmark_data_smithi188_104537_object125076:head# 2024-04-01T19:36:34.078 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.078 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559574bd:::benchmark_data_smithi188_104537_object100535:head# 2024-04-01T19:36:34.078 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.078 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55977f28:::benchmark_data_smithi188_104537_object49457:head# 2024-04-01T19:36:34.078 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.078 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5597e2a0:::benchmark_data_smithi188_104537_object158400:head# 2024-04-01T19:36:34.078 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.078 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55981b89:::benchmark_data_smithi188_104537_object137984:head# 2024-04-01T19:36:34.078 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.079 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55984be8:::benchmark_data_smithi188_104537_object146350:head# 2024-04-01T19:36:34.079 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.080 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5598a061:::benchmark_data_smithi188_104537_object170897:head# 2024-04-01T19:36:34.080 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.080 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5598b45c:::benchmark_data_smithi188_104537_object166973:head# 2024-04-01T19:36:34.080 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5598b734:::benchmark_data_smithi188_104537_object59231:head# 2024-04-01T19:36:34.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559a9378:::benchmark_data_smithi188_104537_object17501:head# 2024-04-01T19:36:34.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559add7e:::benchmark_data_smithi188_104537_object19911:head# 2024-04-01T19:36:34.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559b8325:::benchmark_data_smithi188_104537_object154390:head# 2024-04-01T19:36:34.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559b8ad5:::benchmark_data_smithi188_104537_object70178:head# 2024-04-01T19:36:34.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559bf51f:::benchmark_data_smithi188_104537_object149879:head# 2024-04-01T19:36:34.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559bf8ea:::benchmark_data_smithi188_104537_object148022:head# 2024-04-01T19:36:34.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559c0839:::benchmark_data_smithi188_104537_object37838:head# 2024-04-01T19:36:34.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559c0d70:::benchmark_data_smithi188_104537_object116336:head# 2024-04-01T19:36:34.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559c58d2:::benchmark_data_smithi188_104537_object105565:head# 2024-04-01T19:36:34.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559c6d27:::benchmark_data_smithi188_104537_object33634:head# 2024-04-01T19:36:34.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559cf7c7:::benchmark_data_smithi188_104537_object26136:head# 2024-04-01T19:36:34.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559d0e3a:::benchmark_data_smithi188_104537_object86390:head# 2024-04-01T19:36:34.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.082 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:36:34.086 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559d3060:::benchmark_data_smithi188_104537_object108646:head# 2024-04-01T19:36:34.086 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.086 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559d3067:::benchmark_data_smithi188_104537_object29452:head# 2024-04-01T19:36:34.086 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.086 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559d5aa6:::benchmark_data_smithi188_104537_object141587:head# 2024-04-01T19:36:34.086 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.086 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559d8f26:::benchmark_data_smithi188_104537_object147385:head# 2024-04-01T19:36:34.086 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.086 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559d918d:::benchmark_data_smithi188_104537_object135798:head# 2024-04-01T19:36:34.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559e21d3:::benchmark_data_smithi188_104537_object121270:head# 2024-04-01T19:36:34.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559e3bfc:::benchmark_data_smithi188_104537_object124505:head# 2024-04-01T19:36:34.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559e5757:::benchmark_data_smithi188_104537_object38482:head# 2024-04-01T19:36:34.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559efc80:::benchmark_data_smithi188_104537_object47230:head# 2024-04-01T19:36:34.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559f267b:::benchmark_data_smithi188_104537_object149833:head# 2024-04-01T19:36:34.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:559ffdb6:::benchmark_data_smithi188_104537_object118957:head# 2024-04-01T19:36:34.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55a07675:::benchmark_data_smithi188_104537_object97344:head# 2024-04-01T19:36:34.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55a0a12c:::benchmark_data_smithi188_104537_object162439:head# 2024-04-01T19:36:34.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55a0f1ef:::benchmark_data_smithi188_104537_object30496:head# 2024-04-01T19:36:34.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55a14e9b:::benchmark_data_smithi188_104537_object63585:head# 2024-04-01T19:36:34.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55a16bf1:::benchmark_data_smithi188_104537_object149127:head# 2024-04-01T19:36:34.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55a1e56b:::benchmark_data_smithi188_104537_object82691:head# 2024-04-01T19:36:34.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55a1fe6c:::benchmark_data_smithi188_104537_object34229:head# 2024-04-01T19:36:34.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55a22212:::benchmark_data_smithi188_104537_object131437:head# 2024-04-01T19:36:34.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55a25f6f:::benchmark_data_smithi188_104537_object56040:head# 2024-04-01T19:36:34.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.089 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55a2b960:::benchmark_data_smithi188_104537_object69904:head# 2024-04-01T19:36:34.089 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.089 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55a3940c:::benchmark_data_smithi188_104537_object121940:head# 2024-04-01T19:36:34.089 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.091 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55a3eff7:::benchmark_data_smithi188_104537_object29107:head# 2024-04-01T19:36:34.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55a4d2f3:::benchmark_data_smithi188_104537_object61650:head# 2024-04-01T19:36:34.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55a5419d:::benchmark_data_smithi188_104537_object52811:head# 2024-04-01T19:36:34.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55a55e9f:::benchmark_data_smithi188_104537_object47212:head# 2024-04-01T19:36:34.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55a5e239:::benchmark_data_smithi188_104537_object156371:head# 2024-04-01T19:36:34.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55a607ac:::benchmark_data_smithi188_104537_object48518:head# 2024-04-01T19:36:34.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55a63a83:::benchmark_data_smithi188_104537_object130474:head# 2024-04-01T19:36:34.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55a76c1a:::benchmark_data_smithi188_104537_object104211:head# 2024-04-01T19:36:34.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55a86162:::benchmark_data_smithi188_104537_object96004:head# 2024-04-01T19:36:34.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55a89ddf:::benchmark_data_smithi188_104537_object104586:head# 2024-04-01T19:36:34.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55a95b99:::benchmark_data_smithi188_104537_object37200:head# 2024-04-01T19:36:34.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55a98231:::benchmark_data_smithi188_104537_object86037:head# 2024-04-01T19:36:34.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55aaa600:::benchmark_data_smithi188_104537_object105477:head# 2024-04-01T19:36:34.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55aae492:::benchmark_data_smithi188_104537_object45855:head# 2024-04-01T19:36:34.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ab1906:::benchmark_data_smithi188_104537_object103666:head# 2024-04-01T19:36:34.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ac9711:::benchmark_data_smithi188_104537_object125256:head# 2024-04-01T19:36:34.094 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.094 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ac9cba:::benchmark_data_smithi188_104537_object149441:head# 2024-04-01T19:36:34.094 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.094 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55acb5e9:::benchmark_data_smithi188_104537_object139500:head# 2024-04-01T19:36:34.094 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ad24fa:::benchmark_data_smithi188_104537_object153421:head# 2024-04-01T19:36:34.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ad7291:::benchmark_data_smithi188_104537_object152214:head# 2024-04-01T19:36:34.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55adf194:::benchmark_data_smithi188_104537_object93253:head# 2024-04-01T19:36:34.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.096 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55adf807:::benchmark_data_smithi188_104537_object28468:head# 2024-04-01T19:36:34.096 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.096 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ae1bf3:::benchmark_data_smithi188_104537_object28385:head# 2024-04-01T19:36:34.096 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.098 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ae232a:::benchmark_data_smithi188_104537_object50851:head# 2024-04-01T19:36:34.098 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.098 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ae5511:::benchmark_data_smithi188_104537_object51922:head# 2024-04-01T19:36:34.098 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.098 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55af4441:::benchmark_data_smithi188_104537_object18523:head# 2024-04-01T19:36:34.098 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.098 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55afd8b6:::benchmark_data_smithi188_104537_object13857:head# 2024-04-01T19:36:34.098 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.098 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b1272e:::benchmark_data_smithi188_104537_object54406:head# 2024-04-01T19:36:34.098 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.098 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b12f02:::benchmark_data_smithi188_104537_object129766:head# 2024-04-01T19:36:34.099 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.100 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b1cae8:::benchmark_data_smithi188_104537_object108188:head# 2024-04-01T19:36:34.100 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.100 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b1cb8d:::benchmark_data_smithi188_104537_object48966:head# 2024-04-01T19:36:34.100 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.100 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b31751:::benchmark_data_smithi188_104537_object119090:head# 2024-04-01T19:36:34.100 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.100 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b3886b:::benchmark_data_smithi188_104537_object159542:head# 2024-04-01T19:36:34.100 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.104 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b3e081:::benchmark_data_smithi188_104537_object17096:head# 2024-04-01T19:36:34.104 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.104 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b41d8b:::benchmark_data_smithi188_104537_object45842:head# 2024-04-01T19:36:34.104 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.107 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b48731:::benchmark_data_smithi188_104537_object137462:head# 2024-04-01T19:36:34.108 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.108 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b49097:::benchmark_data_smithi188_104537_object162658:head# 2024-04-01T19:36:34.109 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.109 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b49e7b:::benchmark_data_smithi188_104537_object119784:head# 2024-04-01T19:36:34.109 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.109 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b4b5ce:::benchmark_data_smithi188_104537_object106072:head# 2024-04-01T19:36:34.109 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.109 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b4dc3f:::benchmark_data_smithi188_104537_object11946:head# 2024-04-01T19:36:34.109 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.110 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b4e3c5:::benchmark_data_smithi188_104537_object149819:head# 2024-04-01T19:36:34.110 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.113 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b53599:::benchmark_data_smithi188_104537_object128868:head# 2024-04-01T19:36:34.113 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.115 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b5b505:::benchmark_data_smithi188_104537_object81446:head# 2024-04-01T19:36:34.115 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.115 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b5b610:::benchmark_data_smithi188_104537_object97220:head# 2024-04-01T19:36:34.115 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.115 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b6a569:::benchmark_data_smithi188_104537_object22413:head# 2024-04-01T19:36:34.116 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.116 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b71474:::benchmark_data_smithi188_104537_object62295:head# 2024-04-01T19:36:34.116 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.116 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b72ff8:::benchmark_data_smithi188_104537_object142515:head# 2024-04-01T19:36:34.116 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.116 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b76fc9:::benchmark_data_smithi188_104537_object121788:head# 2024-04-01T19:36:34.116 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.118 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b77033:::benchmark_data_smithi188_104537_object119996:head# 2024-04-01T19:36:34.118 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.120 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:36:34.121 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b7a130:::benchmark_data_smithi188_104537_object170011:head# 2024-04-01T19:36:34.121 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.121 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b7c81f:::benchmark_data_smithi188_104537_object20728:head# 2024-04-01T19:36:34.121 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.121 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b840aa:::benchmark_data_smithi188_104537_object167241:head# 2024-04-01T19:36:34.121 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.122 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55b9733e:::benchmark_data_smithi188_104537_object53448:head# 2024-04-01T19:36:34.122 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.122 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ba0383:::benchmark_data_smithi188_104537_object114288:head# 2024-04-01T19:36:34.122 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.123 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ba0a52:::benchmark_data_smithi188_104537_object12628:head# 2024-04-01T19:36:34.123 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.123 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ba1fe9:::benchmark_data_smithi188_104537_object146203:head# 2024-04-01T19:36:34.123 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.123 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55bb2486:::benchmark_data_smithi188_104537_object90791:head# 2024-04-01T19:36:34.123 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.123 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55bb3546:::benchmark_data_smithi188_104537_object52773:head# 2024-04-01T19:36:34.123 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.124 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55bb8849:::benchmark_data_smithi188_104537_object26587:head# 2024-04-01T19:36:34.124 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.125 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55bb9c3a:::benchmark_data_smithi188_104537_object121468:head# 2024-04-01T19:36:34.125 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.125 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55bbd5f6:::benchmark_data_smithi188_104537_object171437:head# 2024-04-01T19:36:34.125 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.125 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55bbf4b7:::benchmark_data_smithi188_104537_object88111:head# 2024-04-01T19:36:34.125 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.126 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55bc2e38:::benchmark_data_smithi188_104537_object73002:head# 2024-04-01T19:36:34.126 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.126 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55bc5c5b:::benchmark_data_smithi188_104537_object82822:head# 2024-04-01T19:36:34.126 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.126 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55bc78db:::benchmark_data_smithi188_104537_object144141:head# 2024-04-01T19:36:34.126 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.127 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55bca728:::benchmark_data_smithi188_104537_object37074:head# 2024-04-01T19:36:34.127 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55bcbea6:::benchmark_data_smithi188_104537_object149033:head# 2024-04-01T19:36:34.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55bd9683:::benchmark_data_smithi188_104537_object67049:head# 2024-04-01T19:36:34.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55bdf339:::benchmark_data_smithi188_104537_object105559:head# 2024-04-01T19:36:34.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55bee2fa:::benchmark_data_smithi188_104537_object45228:head# 2024-04-01T19:36:34.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55bf8de6:::benchmark_data_smithi188_104537_object156983:head# 2024-04-01T19:36:34.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55bfdcf6:::benchmark_data_smithi188_104537_object33949:head# 2024-04-01T19:36:34.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.130 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55c017d4:::benchmark_data_smithi188_104537_object87898:head# 2024-04-01T19:36:34.130 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.130 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55c04772:::benchmark_data_smithi188_104537_object64277:head# 2024-04-01T19:36:34.130 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.130 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55c084f9:::benchmark_data_smithi188_104537_object113362:head# 2024-04-01T19:36:34.130 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.130 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55c0bafa:::benchmark_data_smithi188_104537_object112287:head# 2024-04-01T19:36:34.130 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.133 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55c0c272:::benchmark_data_smithi188_104537_object152815:head# 2024-04-01T19:36:34.133 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.133 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55c1d9d3:::benchmark_data_smithi188_104537_object62644:head# 2024-04-01T19:36:34.133 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.135 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55c2316d:::benchmark_data_smithi188_104537_object123834:head# 2024-04-01T19:36:34.135 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.135 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55c2d6c0:::benchmark_data_smithi188_104537_object135345:head# 2024-04-01T19:36:34.135 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.135 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55c3afc5:::benchmark_data_smithi188_104537_object165819:head# 2024-04-01T19:36:34.135 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.135 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55c4a537:::benchmark_data_smithi188_104537_object131504:head# 2024-04-01T19:36:34.135 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.135 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55c56722:::benchmark_data_smithi188_104537_object127655:head# 2024-04-01T19:36:34.136 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.136 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55c5b3c9:::benchmark_data_smithi188_104537_object158708:head# 2024-04-01T19:36:34.136 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.136 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55c5c41b:::benchmark_data_smithi188_104537_object48745:head# 2024-04-01T19:36:34.136 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.136 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55c6389a:::benchmark_data_smithi188_104537_object43582:head# 2024-04-01T19:36:34.136 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.136 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55c64ebe:::benchmark_data_smithi188_104537_object92912:head# 2024-04-01T19:36:34.136 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.136 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55c673cc:::benchmark_data_smithi188_104537_object142447:head# 2024-04-01T19:36:34.136 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.136 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55c6bfdd:::benchmark_data_smithi188_104537_object116076:head# 2024-04-01T19:36:34.136 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.136 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55c75083:::benchmark_data_smithi188_104537_object136693:head# 2024-04-01T19:36:34.136 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.137 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55c7f9ba:::benchmark_data_smithi188_104537_object168944:head# 2024-04-01T19:36:34.137 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.137 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55c86b18:::benchmark_data_smithi188_104537_object118296:head# 2024-04-01T19:36:34.137 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.137 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55c8e2ce:::benchmark_data_smithi188_104537_object61263:head# 2024-04-01T19:36:34.137 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.137 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55c97684:::benchmark_data_smithi188_104537_object11391:head# 2024-04-01T19:36:34.137 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.137 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55c99c2c:::benchmark_data_smithi188_104537_object36431:head# 2024-04-01T19:36:34.137 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.138 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:34.139 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55c9ca19:::benchmark_data_smithi188_104537_object18256:head# 2024-04-01T19:36:34.140 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.140 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ca1dd7:::benchmark_data_smithi188_104537_object72972:head# 2024-04-01T19:36:34.140 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.140 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ca2aad:::benchmark_data_smithi188_104537_object53101:head# 2024-04-01T19:36:34.140 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.140 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ca4e30:::benchmark_data_smithi188_104537_object85202:head# 2024-04-01T19:36:34.140 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.140 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55cb234d:::benchmark_data_smithi188_104537_object60394:head# 2024-04-01T19:36:34.140 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.140 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55cbb59b:::benchmark_data_smithi188_104537_object36600:head# 2024-04-01T19:36:34.140 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.140 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55cbc7dd:::benchmark_data_smithi188_104537_object124677:head# 2024-04-01T19:36:34.140 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55cc11b3:::benchmark_data_smithi188_104537_object40540:head# 2024-04-01T19:36:34.141 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55cc5d61:::benchmark_data_smithi188_104537_object60084:head# 2024-04-01T19:36:34.141 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55cc5ed1:::benchmark_data_smithi188_104537_object63758:head# 2024-04-01T19:36:34.141 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55cc8777:::benchmark_data_smithi188_104537_object57170:head# 2024-04-01T19:36:34.141 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55cc98e7:::benchmark_data_smithi188_104537_object45182:head# 2024-04-01T19:36:34.141 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55cd105e:::benchmark_data_smithi188_104537_object153155:head# 2024-04-01T19:36:34.141 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55cd5b52:::benchmark_data_smithi188_104537_object127584:head# 2024-04-01T19:36:34.141 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.142 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ce0e00:::benchmark_data_smithi188_104537_object117655:head# 2024-04-01T19:36:34.142 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.144 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ce98c2:::benchmark_data_smithi188_104537_object139819:head# 2024-04-01T19:36:34.144 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.144 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55cf0669:::benchmark_data_smithi188_104537_object150739:head# 2024-04-01T19:36:34.144 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.145 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55cf6e1e:::benchmark_data_smithi188_104537_object160167:head# 2024-04-01T19:36:34.145 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.145 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d034f4:::benchmark_data_smithi188_104537_object66480:head# 2024-04-01T19:36:34.145 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.145 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d047c5:::benchmark_data_smithi188_104537_object151943:head# 2024-04-01T19:36:34.145 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.145 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d049e2:::benchmark_data_smithi188_104537_object17292:head# 2024-04-01T19:36:34.145 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.145 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d04c70:::benchmark_data_smithi188_104537_object147800:head# 2024-04-01T19:36:34.145 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.145 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d0c0e9:::benchmark_data_smithi188_104537_object125502:head# 2024-04-01T19:36:34.145 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.145 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d171b8:::benchmark_data_smithi188_104537_object139338:head# 2024-04-01T19:36:34.146 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.146 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d17c35:::benchmark_data_smithi188_104537_object107124:head# 2024-04-01T19:36:34.146 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.146 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d217a0:::benchmark_data_smithi188_104537_object151185:head# 2024-04-01T19:36:34.146 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.146 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d22eed:::benchmark_data_smithi188_104537_object24951:head# 2024-04-01T19:36:34.146 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.146 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d240e8:::benchmark_data_smithi188_104537_object77135:head# 2024-04-01T19:36:34.146 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.146 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d28356:::benchmark_data_smithi188_104537_object64049:head# 2024-04-01T19:36:34.146 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.146 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d297a5:::benchmark_data_smithi188_104537_object23776:head# 2024-04-01T19:36:34.146 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.147 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d2e2cd:::benchmark_data_smithi188_104537_object132302:head# 2024-04-01T19:36:34.147 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.147 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d3c08b:::benchmark_data_smithi188_104537_object68628:head# 2024-04-01T19:36:34.147 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.147 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d3edad:::benchmark_data_smithi188_104537_object144973:head# 2024-04-01T19:36:34.147 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.147 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d44a6f:::benchmark_data_smithi188_104537_object153454:head# 2024-04-01T19:36:34.147 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.148 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d4542f:::benchmark_data_smithi188_104537_object53941:head# 2024-04-01T19:36:34.148 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.148 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d51a23:::benchmark_data_smithi188_104537_object128907:head# 2024-04-01T19:36:34.148 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.148 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d5620b:::benchmark_data_smithi188_104537_object76189:head# 2024-04-01T19:36:34.148 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.148 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d584cc:::benchmark_data_smithi188_104537_object141363:head# 2024-04-01T19:36:34.149 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.149 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d5bc74:::benchmark_data_smithi188_104537_object110953:head# 2024-04-01T19:36:34.149 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.149 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d6157e:::benchmark_data_smithi188_104537_object68493:head# 2024-04-01T19:36:34.149 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.149 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d66635:::benchmark_data_smithi188_104537_object20975:head# 2024-04-01T19:36:34.149 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.150 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d70dd4:::benchmark_data_smithi188_104537_object86971:head# 2024-04-01T19:36:34.150 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.150 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d7ffc8:::benchmark_data_smithi188_104537_object33626:head# 2024-04-01T19:36:34.150 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.151 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d84f5c:::benchmark_data_smithi188_104537_object160173:head# 2024-04-01T19:36:34.151 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.151 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d89629:::benchmark_data_smithi188_104537_object165947:head# 2024-04-01T19:36:34.151 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.151 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d8d08b:::benchmark_data_smithi188_104537_object21527:head# 2024-04-01T19:36:34.151 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.151 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d981fd:::benchmark_data_smithi188_104537_object109223:head# 2024-04-01T19:36:34.151 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.152 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d9994a:::benchmark_data_smithi188_104537_object89438:head# 2024-04-01T19:36:34.152 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.152 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55d9cd64:::benchmark_data_smithi188_104537_object46131:head# 2024-04-01T19:36:34.152 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.152 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55da1662:::benchmark_data_smithi188_104537_object101450:head# 2024-04-01T19:36:34.152 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.152 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55da1c21:::benchmark_data_smithi188_104537_object154361:head# 2024-04-01T19:36:34.153 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.153 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55daadd5:::benchmark_data_smithi188_104537_object128355:head# 2024-04-01T19:36:34.153 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.153 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55dad145:::benchmark_data_smithi188_104537_object54281:head# 2024-04-01T19:36:34.154 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.154 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55db6b43:::benchmark_data_smithi188_104537_object40516:head# 2024-04-01T19:36:34.154 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.154 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55dc5e4c:::benchmark_data_smithi188_104537_object66816:head# 2024-04-01T19:36:34.154 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.154 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ddbfc6:::benchmark_data_smithi188_104537_object66886:head# 2024-04-01T19:36:34.154 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.154 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55dddbf2:::benchmark_data_smithi188_104537_object24261:head# 2024-04-01T19:36:34.154 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.154 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55de6a25:::benchmark_data_smithi188_104537_object145049:head# 2024-04-01T19:36:34.154 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.155 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55de90c4:::benchmark_data_smithi188_104537_object109530:head# 2024-04-01T19:36:34.155 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.156 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55dec629:::benchmark_data_smithi188_104537_object117945:head# 2024-04-01T19:36:34.156 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.156 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55deca1a:::benchmark_data_smithi188_104537_object146200:head# 2024-04-01T19:36:34.156 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.156 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55df288a:::benchmark_data_smithi188_104537_object123194:head# 2024-04-01T19:36:34.156 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.156 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55df2efb:::benchmark_data_smithi188_104537_object88859:head# 2024-04-01T19:36:34.156 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.156 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55df488c:::benchmark_data_smithi188_104537_object14463:head# 2024-04-01T19:36:34.156 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.156 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55dfad15:::benchmark_data_smithi188_104537_object169320:head# 2024-04-01T19:36:34.156 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.156 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55dfe889:::benchmark_data_smithi188_104537_object48058:head# 2024-04-01T19:36:34.156 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.158 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e05ad3:::benchmark_data_smithi188_104537_object122533:head# 2024-04-01T19:36:34.158 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.158 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e06e0c:::benchmark_data_smithi188_104537_object134029:head# 2024-04-01T19:36:34.158 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.158 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e0862d:::benchmark_data_smithi188_104537_object32791:head# 2024-04-01T19:36:34.158 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.158 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e09e55:::benchmark_data_smithi188_104537_object131840:head# 2024-04-01T19:36:34.158 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.158 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e0c4a1:::benchmark_data_smithi188_104537_object29833:head# 2024-04-01T19:36:34.158 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.159 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e0fedf:::benchmark_data_smithi188_104537_object146507:head# 2024-04-01T19:36:34.159 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.159 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e18d2e:::benchmark_data_smithi188_104537_object38751:head# 2024-04-01T19:36:34.159 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.159 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e18eb7:::benchmark_data_smithi188_104537_object105315:head# 2024-04-01T19:36:34.159 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.159 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e1e6ba:::benchmark_data_smithi188_104537_object79178:head# 2024-04-01T19:36:34.159 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.159 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e3411b:::benchmark_data_smithi188_104537_object125644:head# 2024-04-01T19:36:34.159 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.160 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e3a75f:::benchmark_data_smithi188_104537_object58312:head# 2024-04-01T19:36:34.160 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.161 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e4195a:::benchmark_data_smithi188_104537_object162006:head# 2024-04-01T19:36:34.161 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.161 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e49e04:::benchmark_data_smithi188_104537_object28750:head# 2024-04-01T19:36:34.161 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.161 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e51fdf:::benchmark_data_smithi188_104537_object79967:head# 2024-04-01T19:36:34.162 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.164 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e5afd0:::benchmark_data_smithi188_104537_object115494:head# 2024-04-01T19:36:34.164 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.164 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e5ca1a:::benchmark_data_smithi188_104537_object164471:head# 2024-04-01T19:36:34.165 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.165 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e6012b:::benchmark_data_smithi188_104537_object114802:head# 2024-04-01T19:36:34.165 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.165 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e61dc6:::benchmark_data_smithi188_104537_object28252:head# 2024-04-01T19:36:34.165 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.165 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e63e42:::benchmark_data_smithi188_104537_object105029:head# 2024-04-01T19:36:34.165 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.165 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e65842:::benchmark_data_smithi188_104537_object126655:head# 2024-04-01T19:36:34.165 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.165 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e6b507:::benchmark_data_smithi188_104537_object11079:head# 2024-04-01T19:36:34.165 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.165 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e7dc3e:::benchmark_data_smithi188_104537_object35103:head# 2024-04-01T19:36:34.165 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.165 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e80ee1:::benchmark_data_smithi188_104537_object20095:head# 2024-04-01T19:36:34.165 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.165 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e86ec7:::benchmark_data_smithi188_104537_object167876:head# 2024-04-01T19:36:34.166 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.166 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e93b6c:::benchmark_data_smithi188_104537_object19262:head# 2024-04-01T19:36:34.166 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.166 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e94de3:::benchmark_data_smithi188_104537_object121576:head# 2024-04-01T19:36:34.166 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.168 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55e9b64a:::benchmark_data_smithi188_104537_object140481:head# 2024-04-01T19:36:34.168 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.168 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ea046a:::benchmark_data_smithi188_104537_object170208:head# 2024-04-01T19:36:34.168 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.168 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ea72b3:::benchmark_data_smithi188_104537_object148916:head# 2024-04-01T19:36:34.168 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.168 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55eae443:::benchmark_data_smithi188_104537_object43321:head# 2024-04-01T19:36:34.168 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.168 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55eb1eb1:::benchmark_data_smithi188_104537_object39424:head# 2024-04-01T19:36:34.168 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.168 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55eb53ad:::benchmark_data_smithi188_104537_object62881:head# 2024-04-01T19:36:34.169 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.169 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55eb6a29:::benchmark_data_smithi188_104537_object22999:head# 2024-04-01T19:36:34.169 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.169 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55eba71c:::benchmark_data_smithi188_104537_object31305:head# 2024-04-01T19:36:34.169 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.169 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ebc420:::benchmark_data_smithi188_104537_object72010:head# 2024-04-01T19:36:34.169 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.169 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ebd48a:::benchmark_data_smithi188_104537_object170923:head# 2024-04-01T19:36:34.169 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.169 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ec08e8:::benchmark_data_smithi188_104537_object19751:head# 2024-04-01T19:36:34.169 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.169 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ec0ac0:::benchmark_data_smithi188_104537_object78126:head# 2024-04-01T19:36:34.169 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.169 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ec3879:::benchmark_data_smithi188_104537_object99905:head# 2024-04-01T19:36:34.169 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.170 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ecefdc:::benchmark_data_smithi188_104537_object74170:head# 2024-04-01T19:36:34.170 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ecf98f:::benchmark_data_smithi188_104537_object124686:head# 2024-04-01T19:36:34.171 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ed3208:::benchmark_data_smithi188_104537_object32167:head# 2024-04-01T19:36:34.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ed3226:::benchmark_data_smithi188_104537_object119556:head# 2024-04-01T19:36:34.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55edbe26:::benchmark_data_smithi188_104537_object156431:head# 2024-04-01T19:36:34.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ee397c:::benchmark_data_smithi188_104537_object111195:head# 2024-04-01T19:36:34.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ee62c5:::benchmark_data_smithi188_104537_object53871:head# 2024-04-01T19:36:34.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ee85d6:::benchmark_data_smithi188_104537_object121970:head# 2024-04-01T19:36:34.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55eeba00:::benchmark_data_smithi188_104537_object30713:head# 2024-04-01T19:36:34.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ef43ad:::benchmark_data_smithi188_104537_object92736:head# 2024-04-01T19:36:34.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55f08764:::benchmark_data_smithi188_104537_object61683:head# 2024-04-01T19:36:34.173 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.173 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55f10924:::benchmark_data_smithi188_104537_object146937:head# 2024-04-01T19:36:34.173 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.173 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55f14100:::benchmark_data_smithi188_104537_object51281:head# 2024-04-01T19:36:34.173 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.173 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55f1668f:::benchmark_data_smithi188_104537_object64978:head# 2024-04-01T19:36:34.173 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.173 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55f250b7:::benchmark_data_smithi188_104537_object125396:head# 2024-04-01T19:36:34.173 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.173 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55f283da:::benchmark_data_smithi188_104537_object132596:head# 2024-04-01T19:36:34.173 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.175 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55f28c38:::benchmark_data_smithi188_104537_object86942:head# 2024-04-01T19:36:34.175 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.175 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55f2bfea:::benchmark_data_smithi188_104537_object15946:head# 2024-04-01T19:36:34.175 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.175 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55f36109:::benchmark_data_smithi188_104537_object149058:head# 2024-04-01T19:36:34.175 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.175 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55f3989e:::benchmark_data_smithi188_104537_object158758:head# 2024-04-01T19:36:34.176 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.176 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55f4863f:::benchmark_data_smithi188_104537_object30529:head# 2024-04-01T19:36:34.176 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.176 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55f4e1e4:::benchmark_data_smithi188_104537_object124962:head# 2024-04-01T19:36:34.176 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.176 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55f4ea68:::benchmark_data_smithi188_104537_object46735:head# 2024-04-01T19:36:34.176 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.176 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55f5be81:::benchmark_data_smithi188_104537_object20880:head# 2024-04-01T19:36:34.176 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.176 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55f5e3dd:::benchmark_data_smithi188_104537_object69927:head# 2024-04-01T19:36:34.176 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.176 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55f73b50:::benchmark_data_smithi188_104537_object171266:head# 2024-04-01T19:36:34.176 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.176 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55f7d0c2:::benchmark_data_smithi188_104537_object51234:head# 2024-04-01T19:36:34.177 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.177 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55f82bcf:::benchmark_data_smithi188_104537_object92329:head# 2024-04-01T19:36:34.177 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.177 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55f862f0:::benchmark_data_smithi188_104537_object110296:head# 2024-04-01T19:36:34.177 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.177 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55f8a178:::benchmark_data_smithi188_104537_object34001:head# 2024-04-01T19:36:34.177 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.177 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55f8cbe4:::benchmark_data_smithi188_104537_object37236:head# 2024-04-01T19:36:34.177 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.179 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55f97c81:::benchmark_data_smithi188_104537_object27103:head# 2024-04-01T19:36:34.179 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.179 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55f9831a:::benchmark_data_smithi188_104537_object54379:head# 2024-04-01T19:36:34.179 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.180 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55f9f092:::benchmark_data_smithi188_104537_object85859:head# 2024-04-01T19:36:34.180 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.180 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55faf917:::benchmark_data_smithi188_104537_object121747:head# 2024-04-01T19:36:34.180 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.180 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55fbd099:::benchmark_data_smithi188_104537_object77037:head# 2024-04-01T19:36:34.180 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.180 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55fc9479:::benchmark_data_smithi188_104537_object100449:head# 2024-04-01T19:36:34.180 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.180 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55fca0f1:::benchmark_data_smithi188_104537_object55146:head# 2024-04-01T19:36:34.180 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.180 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55fce67c:::benchmark_data_smithi188_104537_object27129:head# 2024-04-01T19:36:34.180 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.180 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55fd151c:::benchmark_data_smithi188_104537_object102972:head# 2024-04-01T19:36:34.180 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.180 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55feb9d8:::benchmark_data_smithi188_104537_object69006:head# 2024-04-01T19:36:34.180 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.181 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55fef52c:::benchmark_data_smithi188_104537_object70222:head# 2024-04-01T19:36:34.181 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.181 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ff0631:::benchmark_data_smithi188_104537_object133341:head# 2024-04-01T19:36:34.181 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.181 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ff2246:::benchmark_data_smithi188_104537_object154235:head# 2024-04-01T19:36:34.181 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.181 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ff8906:::benchmark_data_smithi188_104537_object59336:head# 2024-04-01T19:36:34.181 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.181 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ffa149:::benchmark_data_smithi188_104537_object32490:head# 2024-04-01T19:36:34.181 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.181 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55ffa871:::benchmark_data_smithi188_104537_object41681:head# 2024-04-01T19:36:34.181 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.181 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:55fff776:::benchmark_data_smithi188_104537_object108001:head# 2024-04-01T19:36:34.181 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.182 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:36:34.185 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56001bd0:::benchmark_data_smithi188_104537_object100932:head# 2024-04-01T19:36:34.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.186 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:560048ff:::benchmark_data_smithi188_104537_object145774:head# 2024-04-01T19:36:34.186 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.186 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5600d5c5:::benchmark_data_smithi188_104537_object125390:head# 2024-04-01T19:36:34.186 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.186 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56024f9d:::benchmark_data_smithi188_104537_object95921:head# 2024-04-01T19:36:34.186 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.186 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5602534d:::benchmark_data_smithi188_104537_object75186:head# 2024-04-01T19:36:34.186 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.186 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56031421:::benchmark_data_smithi188_104537_object118250:head# 2024-04-01T19:36:34.186 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.186 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5603872b:::benchmark_data_smithi188_104537_object100248:head# 2024-04-01T19:36:34.186 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.187 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56044e16:::benchmark_data_smithi188_104537_object56077:head# 2024-04-01T19:36:34.187 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.187 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56049c36:::benchmark_data_smithi188_104537_object16316:head# 2024-04-01T19:36:34.187 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.187 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5604b862:::benchmark_data_smithi188_104537_object159040:head# 2024-04-01T19:36:34.187 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.187 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5604bb79:::benchmark_data_smithi188_104537_object72810:head# 2024-04-01T19:36:34.187 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.187 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5604d291:::benchmark_data_smithi188_104537_object71437:head# 2024-04-01T19:36:34.187 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.187 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5605250b:::benchmark_data_smithi188_104537_object171971:head# 2024-04-01T19:36:34.187 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.187 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56057b62:::benchmark_data_smithi188_104537_object135266:head# 2024-04-01T19:36:34.187 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.188 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:560610c7:::benchmark_data_smithi188_104537_object75158:head# 2024-04-01T19:36:34.188 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.188 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5606456f:::benchmark_data_smithi188_104537_object54533:head# 2024-04-01T19:36:34.188 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.188 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56066ab8:::benchmark_data_smithi188_104537_object54129:head# 2024-04-01T19:36:34.188 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.188 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5606c4c6:::benchmark_data_smithi188_104537_object63798:head# 2024-04-01T19:36:34.188 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.188 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5606e13e:::benchmark_data_smithi188_104537_object50284:head# 2024-04-01T19:36:34.188 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.188 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56071a27:::benchmark_data_smithi188_104537_object123088:head# 2024-04-01T19:36:34.188 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.188 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56071b52:::benchmark_data_smithi188_104537_object69800:head# 2024-04-01T19:36:34.188 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.189 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:560733f7:::benchmark_data_smithi188_104537_object129795:head# 2024-04-01T19:36:34.189 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.189 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5607b3d6:::benchmark_data_smithi188_104537_object121635:head# 2024-04-01T19:36:34.189 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.189 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5607e7c6:::benchmark_data_smithi188_104537_object25131:head# 2024-04-01T19:36:34.189 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.190 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:34.191 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:36:34.193 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5608aed0:::benchmark_data_smithi188_104537_object153970:head# 2024-04-01T19:36:34.193 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.193 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56095571:::benchmark_data_smithi188_104537_object40861:head# 2024-04-01T19:36:34.193 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.193 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5609971b:::benchmark_data_smithi188_104537_object146366:head# 2024-04-01T19:36:34.193 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.194 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:560a3738:::benchmark_data_smithi188_104537_object60255:head# 2024-04-01T19:36:34.194 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.194 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:560a73f5:::benchmark_data_smithi188_104537_object18018:head# 2024-04-01T19:36:34.194 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.194 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:560ae535:::benchmark_data_smithi188_104537_object43283:head# 2024-04-01T19:36:34.194 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.194 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:560b087e:::benchmark_data_smithi188_104537_object35768:head# 2024-04-01T19:36:34.194 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.194 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:560cbd91:::benchmark_data_smithi188_104537_object12162:head# 2024-04-01T19:36:34.194 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.194 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:560dae66:::benchmark_data_smithi188_104537_object36768:head# 2024-04-01T19:36:34.194 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.194 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:560db363:::benchmark_data_smithi188_104537_object118840:head# 2024-04-01T19:36:34.195 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.195 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:560df48c:::benchmark_data_smithi188_104537_object95784:head# 2024-04-01T19:36:34.195 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.195 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:560e1003:::benchmark_data_smithi188_104537_object68934:head# 2024-04-01T19:36:34.195 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.195 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:560e35b5:::benchmark_data_smithi188_104537_object55294:head# 2024-04-01T19:36:34.195 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.195 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:560ea407:::benchmark_data_smithi188_104537_object115886:head# 2024-04-01T19:36:34.195 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.195 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:560f2d85:::benchmark_data_smithi188_104537_object160301:head# 2024-04-01T19:36:34.195 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.195 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:560f6919:::benchmark_data_smithi188_104537_object112986:head# 2024-04-01T19:36:34.195 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.195 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:561101c7:::benchmark_data_smithi188_104537_object64549:head# 2024-04-01T19:36:34.195 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.196 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5611e569:::benchmark_data_smithi188_104537_object151964:head# 2024-04-01T19:36:34.196 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.196 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5612351b:::benchmark_data_smithi188_104537_object162302:head# 2024-04-01T19:36:34.196 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.196 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5612390c:::benchmark_data_smithi188_104537_object136927:head# 2024-04-01T19:36:34.196 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.196 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5612c193:::benchmark_data_smithi188_104537_object57890:head# 2024-04-01T19:36:34.196 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.196 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5612f1f1:::benchmark_data_smithi188_104537_object117714:head# 2024-04-01T19:36:34.196 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.196 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56131634:::benchmark_data_smithi188_104537_object16871:head# 2024-04-01T19:36:34.196 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.196 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:561354ff:::benchmark_data_smithi188_104537_object118594:head# 2024-04-01T19:36:34.196 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.197 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56135913:::benchmark_data_smithi188_104537_object16816:head# 2024-04-01T19:36:34.197 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.197 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5614e864:::benchmark_data_smithi188_104537_object79772:head# 2024-04-01T19:36:34.197 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.197 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56156272:::benchmark_data_smithi188_104537_object87389:head# 2024-04-01T19:36:34.197 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.197 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56157d07:::benchmark_data_smithi188_104537_object23118:head# 2024-04-01T19:36:34.197 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.199 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5616c896:::benchmark_data_smithi188_104537_object40939:head# 2024-04-01T19:36:34.199 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.199 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5617285c:::benchmark_data_smithi188_104537_object35116:head# 2024-04-01T19:36:34.199 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.199 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56176afb:::benchmark_data_smithi188_104537_object154516:head# 2024-04-01T19:36:34.199 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.199 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5617b77c:::benchmark_data_smithi188_104537_object118574:head# 2024-04-01T19:36:34.199 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.199 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56185762:::benchmark_data_smithi188_104537_object46670:head# 2024-04-01T19:36:34.199 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.200 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56191d64:::benchmark_data_smithi188_104537_object134868:head# 2024-04-01T19:36:34.200 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.200 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56194012:::benchmark_data_smithi188_104537_object44741:head# 2024-04-01T19:36:34.200 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.200 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:561b1599:::benchmark_data_smithi188_104537_object86138:head# 2024-04-01T19:36:34.200 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.200 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:561b9ef4:::benchmark_data_smithi188_104537_object139698:head# 2024-04-01T19:36:34.200 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.200 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:561bec32:::benchmark_data_smithi188_104537_object25363:head# 2024-04-01T19:36:34.200 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.200 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:561c0659:::benchmark_data_smithi188_104537_object95195:head# 2024-04-01T19:36:34.200 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.200 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:561c7b82:::benchmark_data_smithi188_104537_object169130:head# 2024-04-01T19:36:34.200 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.205 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:561cfaa8:::benchmark_data_smithi188_104537_object41140:head# 2024-04-01T19:36:34.205 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.205 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:561e5d51:::benchmark_data_smithi188_104537_object45302:head# 2024-04-01T19:36:34.205 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.205 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:561ebd4c:::benchmark_data_smithi188_104537_object156750:head# 2024-04-01T19:36:34.205 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.205 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:561f2fb0:::benchmark_data_smithi188_104537_object156538:head# 2024-04-01T19:36:34.205 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.206 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:561f8577:::benchmark_data_smithi188_104537_object82325:head# 2024-04-01T19:36:34.206 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.206 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:561fa595:::benchmark_data_smithi188_104537_object47180:head# 2024-04-01T19:36:34.206 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.206 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:562013f0:::benchmark_data_smithi188_104537_object81733:head# 2024-04-01T19:36:34.206 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.206 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56207316:::benchmark_data_smithi188_104537_object113866:head# 2024-04-01T19:36:34.206 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.206 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5621cf83:::benchmark_data_smithi188_104537_object38130:head# 2024-04-01T19:36:34.206 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.206 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5621e8ae:::benchmark_data_smithi188_104537_object42019:head# 2024-04-01T19:36:34.206 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.206 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5621ff99:::benchmark_data_smithi188_104537_object75630:head# 2024-04-01T19:36:34.207 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.207 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56229328:::benchmark_data_smithi188_104537_object13206:head# 2024-04-01T19:36:34.207 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.207 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56235318:::benchmark_data_smithi188_104537_object20640:head# 2024-04-01T19:36:34.207 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.207 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5623978a:::benchmark_data_smithi188_104537_object60445:head# 2024-04-01T19:36:34.207 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.210 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5623c13a:::benchmark_data_smithi188_104537_object146557:head# 2024-04-01T19:36:34.210 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.210 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56244f23:::benchmark_data_smithi188_104537_object136089:head# 2024-04-01T19:36:34.211 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.211 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56258759:::benchmark_data_smithi188_104537_object37855:head# 2024-04-01T19:36:34.211 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.211 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5625c3b3:::benchmark_data_smithi188_104537_object68899:head# 2024-04-01T19:36:34.211 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.211 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5625ed43:::benchmark_data_smithi188_104537_object64039:head# 2024-04-01T19:36:34.211 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.211 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56274c0b:::benchmark_data_smithi188_104537_object47020:head# 2024-04-01T19:36:34.211 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.211 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5627cdfc:::benchmark_data_smithi188_104537_object39694:head# 2024-04-01T19:36:34.211 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.211 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5627ec8f:::benchmark_data_smithi188_104537_object35576:head# 2024-04-01T19:36:34.211 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.211 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5627f317:::benchmark_data_smithi188_104537_object92550:head# 2024-04-01T19:36:34.212 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.212 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:562840d3:::benchmark_data_smithi188_104537_object70186:head# 2024-04-01T19:36:34.212 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.212 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:562844c3:::benchmark_data_smithi188_104537_object102587:head# 2024-04-01T19:36:34.212 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.212 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:562871e5:::benchmark_data_smithi188_104537_object171990:head# 2024-04-01T19:36:34.212 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.212 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56289f16:::benchmark_data_smithi188_104537_object145770:head# 2024-04-01T19:36:34.212 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.212 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56290170:::benchmark_data_smithi188_104537_object12848:head# 2024-04-01T19:36:34.212 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.212 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56299171:::benchmark_data_smithi188_104537_object142464:head# 2024-04-01T19:36:34.212 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.212 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:562a6fca:::benchmark_data_smithi188_104537_object35539:head# 2024-04-01T19:36:34.213 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.215 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:562b6a57:::benchmark_data_smithi188_104537_object50023:head# 2024-04-01T19:36:34.216 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.216 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:562cae9a:::benchmark_data_smithi188_104537_object159275:head# 2024-04-01T19:36:34.216 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.216 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:562cb748:::benchmark_data_smithi188_104537_object42997:head# 2024-04-01T19:36:34.216 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.216 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:562cc414:::benchmark_data_smithi188_104537_object67865:head# 2024-04-01T19:36:34.216 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.216 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:562cfcb4:::benchmark_data_smithi188_104537_object38852:head# 2024-04-01T19:36:34.216 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.216 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:562d21a4:::benchmark_data_smithi188_104537_object160099:head# 2024-04-01T19:36:34.216 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.216 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:562d810f:::benchmark_data_smithi188_104537_object61602:head# 2024-04-01T19:36:34.216 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.217 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:562dc3d7:::benchmark_data_smithi188_104537_object106644:head# 2024-04-01T19:36:34.217 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.217 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:562dcb3c:::benchmark_data_smithi188_104537_object142049:head# 2024-04-01T19:36:34.217 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.217 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:562df4d6:::benchmark_data_smithi188_104537_object96034:head# 2024-04-01T19:36:34.217 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.217 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:562e132b:::benchmark_data_smithi188_104537_object28054:head# 2024-04-01T19:36:34.217 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.217 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:562e383f:::benchmark_data_smithi188_104537_object76856:head# 2024-04-01T19:36:34.217 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.217 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:562f962e:::benchmark_data_smithi188_104537_object101373:head# 2024-04-01T19:36:34.217 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.217 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5630521c:::benchmark_data_smithi188_104537_object134452:head# 2024-04-01T19:36:34.217 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.218 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5630ccf8:::benchmark_data_smithi188_104537_object112113:head# 2024-04-01T19:36:34.218 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.218 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5630dde4:::benchmark_data_smithi188_104537_object170419:head# 2024-04-01T19:36:34.218 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.218 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5630e1ce:::benchmark_data_smithi188_104537_object165854:head# 2024-04-01T19:36:34.218 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.218 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:563363a7:::benchmark_data_smithi188_104537_object17832:head# 2024-04-01T19:36:34.218 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.218 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5633b673:::benchmark_data_smithi188_104537_object72646:head# 2024-04-01T19:36:34.218 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.220 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5633be34:::benchmark_data_smithi188_104537_object112669:head# 2024-04-01T19:36:34.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5633cb47:::benchmark_data_smithi188_104537_object88044:head# 2024-04-01T19:36:34.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5633df58:::benchmark_data_smithi188_104537_object85231:head# 2024-04-01T19:36:34.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:563476ee:::benchmark_data_smithi188_104537_object126530:head# 2024-04-01T19:36:34.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56347948:::benchmark_data_smithi188_104537_object37277:head# 2024-04-01T19:36:34.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:563513a2:::benchmark_data_smithi188_104537_object137703:head# 2024-04-01T19:36:34.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56351a0c:::benchmark_data_smithi188_104537_object123748:head# 2024-04-01T19:36:34.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56355f7a:::benchmark_data_smithi188_104537_object110412:head# 2024-04-01T19:36:34.222 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.222 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56357052:::benchmark_data_smithi188_104537_object122644:head# 2024-04-01T19:36:34.222 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.222 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5635f3ab:::benchmark_data_smithi188_104537_object93641:head# 2024-04-01T19:36:34.222 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.222 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5636aac5:::benchmark_data_smithi188_104537_object146776:head# 2024-04-01T19:36:34.222 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.222 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56370d41:::benchmark_data_smithi188_104537_object54436:head# 2024-04-01T19:36:34.222 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.222 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56378272:::benchmark_data_smithi188_104537_object80197:head# 2024-04-01T19:36:34.222 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.222 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56379702:::benchmark_data_smithi188_104537_object150493:head# 2024-04-01T19:36:34.222 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.222 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5637ad3f:::benchmark_data_smithi188_104537_object100108:head# 2024-04-01T19:36:34.223 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.223 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56386bd4:::benchmark_data_smithi188_104537_object104283:head# 2024-04-01T19:36:34.223 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.223 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56388968:::benchmark_data_smithi188_104537_object68520:head# 2024-04-01T19:36:34.223 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.223 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56388e90:::benchmark_data_smithi188_104537_object97229:head# 2024-04-01T19:36:34.223 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.223 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56390322:::benchmark_data_smithi188_104537_object75185:head# 2024-04-01T19:36:34.223 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.225 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56390b8c:::benchmark_data_smithi188_104537_object31630:head# 2024-04-01T19:36:34.225 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.226 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:563929f3:::benchmark_data_smithi188_104537_object70555:head# 2024-04-01T19:36:34.226 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.226 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56394e64:::benchmark_data_smithi188_104537_object42459:head# 2024-04-01T19:36:34.226 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.226 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56396340:::benchmark_data_smithi188_104537_object139736:head# 2024-04-01T19:36:34.226 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.226 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56396656:::benchmark_data_smithi188_104537_object20002:head# 2024-04-01T19:36:34.226 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.226 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5639752e:::benchmark_data_smithi188_104537_object68584:head# 2024-04-01T19:36:34.226 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.226 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:563acdc3:::benchmark_data_smithi188_104537_object23023:head# 2024-04-01T19:36:34.226 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.226 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:563ad1f0:::benchmark_data_smithi188_104537_object103741:head# 2024-04-01T19:36:34.227 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:563b5796:::benchmark_data_smithi188_104537_object121508:head# 2024-04-01T19:36:34.227 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:563b7865:::benchmark_data_smithi188_104537_object16613:head# 2024-04-01T19:36:34.227 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:563bbe3b:::benchmark_data_smithi188_104537_object131866:head# 2024-04-01T19:36:34.227 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:563bff3c:::benchmark_data_smithi188_104537_object37321:head# 2024-04-01T19:36:34.227 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:563c1ba9:::benchmark_data_smithi188_104537_object165418:head# 2024-04-01T19:36:34.227 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:563c2ac1:::benchmark_data_smithi188_104537_object119673:head# 2024-04-01T19:36:34.227 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:563dd452:::benchmark_data_smithi188_104537_object61513:head# 2024-04-01T19:36:34.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.228 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:563de5d7:::benchmark_data_smithi188_104537_object110142:head# 2024-04-01T19:36:34.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.230 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:563ea7f9:::benchmark_data_smithi188_104537_object40420:head# 2024-04-01T19:36:34.231 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.231 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:563f7991:::benchmark_data_smithi188_104537_object51166:head# 2024-04-01T19:36:34.231 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.231 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56409246:::benchmark_data_smithi188_104537_object151458:head# 2024-04-01T19:36:34.231 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.231 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56410ad3:::benchmark_data_smithi188_104537_object87438:head# 2024-04-01T19:36:34.231 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.231 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5641338e:::benchmark_data_smithi188_104537_object135072:head# 2024-04-01T19:36:34.231 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.231 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56423122:::benchmark_data_smithi188_104537_object42959:head# 2024-04-01T19:36:34.231 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.231 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5642502e:::benchmark_data_smithi188_104537_object141264:head# 2024-04-01T19:36:34.231 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.231 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:564268b5:::benchmark_data_smithi188_104537_object127435:head# 2024-04-01T19:36:34.231 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.232 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56430dd5:::benchmark_data_smithi188_104537_object20785:head# 2024-04-01T19:36:34.232 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.232 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5643eb57:::benchmark_data_smithi188_104537_object38497:head# 2024-04-01T19:36:34.232 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.232 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:564503c3:::benchmark_data_smithi188_104537_object27948:head# 2024-04-01T19:36:34.232 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.232 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:564576f0:::benchmark_data_smithi188_104537_object106934:head# 2024-04-01T19:36:34.232 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.232 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5645a308:::benchmark_data_smithi188_104537_object146591:head# 2024-04-01T19:36:34.232 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.232 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5645b5cc:::benchmark_data_smithi188_104537_object42375:head# 2024-04-01T19:36:34.232 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.232 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5645bb31:::benchmark_data_smithi188_104537_object35832:head# 2024-04-01T19:36:34.232 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.232 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5645e8d7:::benchmark_data_smithi188_104537_object75522:head# 2024-04-01T19:36:34.232 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.233 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56472b6e:::benchmark_data_smithi188_104537_object75123:head# 2024-04-01T19:36:34.233 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.233 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56479b06:::benchmark_data_smithi188_104537_object86231:head# 2024-04-01T19:36:34.233 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.233 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:564806b3:::benchmark_data_smithi188_104537_object71012:head# 2024-04-01T19:36:34.233 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.233 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56481973:::benchmark_data_smithi188_104537_object95042:head# 2024-04-01T19:36:34.233 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.233 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5648bdc8:::benchmark_data_smithi188_104537_object56744:head# 2024-04-01T19:36:34.233 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.233 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56490146:::benchmark_data_smithi188_104537_object53984:head# 2024-04-01T19:36:34.233 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5649fefb:::benchmark_data_smithi188_104537_object93820:head# 2024-04-01T19:36:34.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:564c65b6:::benchmark_data_smithi188_104537_object123659:head# 2024-04-01T19:36:34.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:564c76fb:::benchmark_data_smithi188_104537_object132589:head# 2024-04-01T19:36:34.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:564cb2a1:::benchmark_data_smithi188_104537_object47414:head# 2024-04-01T19:36:34.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:564dbfe5:::benchmark_data_smithi188_104537_object16852:head# 2024-04-01T19:36:34.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:564f04db:::benchmark_data_smithi188_104537_object111889:head# 2024-04-01T19:36:34.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:564f17a6:::benchmark_data_smithi188_104537_object22265:head# 2024-04-01T19:36:34.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.237 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:564f34ee:::benchmark_data_smithi188_104537_object148534:head# 2024-04-01T19:36:34.237 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.237 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:564f52e6:::benchmark_data_smithi188_104537_object71957:head# 2024-04-01T19:36:34.237 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.237 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:564f7a34:::benchmark_data_smithi188_104537_object96773:head# 2024-04-01T19:36:34.237 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.237 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:564fa703:::benchmark_data_smithi188_104537_object99770:head# 2024-04-01T19:36:34.237 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.237 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:564faeac:::benchmark_data_smithi188_104537_object163101:head# 2024-04-01T19:36:34.237 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.237 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56505ddb:::benchmark_data_smithi188_104537_object46138:head# 2024-04-01T19:36:34.237 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.237 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5650714a:::benchmark_data_smithi188_104537_object108374:head# 2024-04-01T19:36:34.237 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.237 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5650bf91:::benchmark_data_smithi188_104537_object51823:head# 2024-04-01T19:36:34.238 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.238 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56512867:::benchmark_data_smithi188_104537_object119233:head# 2024-04-01T19:36:34.238 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.239 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56521185:::benchmark_data_smithi188_104537_object163227:head# 2024-04-01T19:36:34.239 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.239 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5652119d:::benchmark_data_smithi188_104537_object87266:head# 2024-04-01T19:36:34.239 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.239 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:565227f5:::benchmark_data_smithi188_104537_object151892:head# 2024-04-01T19:36:34.239 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.239 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56545771:::benchmark_data_smithi188_104537_object74313:head# 2024-04-01T19:36:34.239 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.239 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56554ea9:::benchmark_data_smithi188_104537_object74773:head# 2024-04-01T19:36:34.239 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.239 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5655571f:::benchmark_data_smithi188_104537_object107941:head# 2024-04-01T19:36:34.239 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.239 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56555a3c:::benchmark_data_smithi188_104537_object161977:head# 2024-04-01T19:36:34.239 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56556615:::benchmark_data_smithi188_104537_object118859:head# 2024-04-01T19:36:34.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5655adb8:::benchmark_data_smithi188_104537_object113537:head# 2024-04-01T19:36:34.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56564cb6:::benchmark_data_smithi188_104537_object113990:head# 2024-04-01T19:36:34.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:565660a1:::benchmark_data_smithi188_104537_object42015:head# 2024-04-01T19:36:34.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:565689ff:::benchmark_data_smithi188_104537_object135833:head# 2024-04-01T19:36:34.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5657c266:::benchmark_data_smithi188_104537_object137330:head# 2024-04-01T19:36:34.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5657e91f:::benchmark_data_smithi188_104537_object146059:head# 2024-04-01T19:36:34.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56592415:::benchmark_data_smithi188_104537_object28103:head# 2024-04-01T19:36:34.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.242 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:565977e5:::benchmark_data_smithi188_104537_object90323:head# 2024-04-01T19:36:34.242 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.242 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5659d95f:::benchmark_data_smithi188_104537_object72233:head# 2024-04-01T19:36:34.243 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.243 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:565a1788:::benchmark_data_smithi188_104537_object89830:head# 2024-04-01T19:36:34.243 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.243 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:565a1883:::benchmark_data_smithi188_104537_object130187:head# 2024-04-01T19:36:34.243 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.243 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:565a1ebf:::benchmark_data_smithi188_104537_object108722:head# 2024-04-01T19:36:34.243 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.243 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:565a1fd7:::benchmark_data_smithi188_104537_object56217:head# 2024-04-01T19:36:34.243 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.243 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:565ac8f5:::benchmark_data_smithi188_104537_object65667:head# 2024-04-01T19:36:34.243 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.243 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:565aee7d:::benchmark_data_smithi188_104537_object45205:head# 2024-04-01T19:36:34.243 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.243 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:565b5b96:::benchmark_data_smithi188_104537_object93757:head# 2024-04-01T19:36:34.243 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.243 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:565bf9d2:::benchmark_data_smithi188_104537_object141315:head# 2024-04-01T19:36:34.244 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.244 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:565c827b:::benchmark_data_smithi188_104537_object118043:head# 2024-04-01T19:36:34.244 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.244 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:565cb6c5:::benchmark_data_smithi188_104537_object18551:head# 2024-04-01T19:36:34.244 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.244 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:565d3c21:::benchmark_data_smithi188_104537_object94932:head# 2024-04-01T19:36:34.244 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.245 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:565da8a9:::benchmark_data_smithi188_104537_object133849:head# 2024-04-01T19:36:34.245 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.245 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:565e45a3:::benchmark_data_smithi188_104537_object34777:head# 2024-04-01T19:36:34.245 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.245 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:565eadda:::benchmark_data_smithi188_104537_object155893:head# 2024-04-01T19:36:34.246 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.246 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:565ff207:::benchmark_data_smithi188_104537_object13840:head# 2024-04-01T19:36:34.246 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.246 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56602e42:::benchmark_data_smithi188_104537_object77549:head# 2024-04-01T19:36:34.246 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.246 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56604341:::benchmark_data_smithi188_104537_object87453:head# 2024-04-01T19:36:34.246 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.246 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5661853a:::benchmark_data_smithi188_104537_object96577:head# 2024-04-01T19:36:34.246 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.246 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5661fa5a:::benchmark_data_smithi188_104537_object90202:head# 2024-04-01T19:36:34.246 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.246 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5661fed0:::benchmark_data_smithi188_104537_object75031:head# 2024-04-01T19:36:34.246 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.246 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56638ff3:::benchmark_data_smithi188_104537_object107494:head# 2024-04-01T19:36:34.247 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.249 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5663afe1:::benchmark_data_smithi188_104537_object78970:head# 2024-04-01T19:36:34.249 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.249 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56640811:::benchmark_data_smithi188_104537_object54392:head# 2024-04-01T19:36:34.249 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.249 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56646543:::benchmark_data_smithi188_104537_object102265:head# 2024-04-01T19:36:34.249 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.249 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56646624:::benchmark_data_smithi188_104537_object128870:head# 2024-04-01T19:36:34.249 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.249 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5664cf5b:::benchmark_data_smithi188_104537_object35949:head# 2024-04-01T19:36:34.249 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.249 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5665eb39:::benchmark_data_smithi188_104537_object159226:head# 2024-04-01T19:36:34.249 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.250 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56683bf1:::benchmark_data_smithi188_104537_object16315:head# 2024-04-01T19:36:34.250 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.250 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56691608:::benchmark_data_smithi188_104537_object148277:head# 2024-04-01T19:36:34.250 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.250 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5669a5f1:::benchmark_data_smithi188_104537_object98125:head# 2024-04-01T19:36:34.250 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.250 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:566add64:::benchmark_data_smithi188_104537_object38698:head# 2024-04-01T19:36:34.250 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.250 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:566b25ce:::benchmark_data_smithi188_104537_object35807:head# 2024-04-01T19:36:34.250 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.250 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:566ba1a4:::benchmark_data_smithi188_104537_object131031:head# 2024-04-01T19:36:34.250 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.250 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:566bd77e:::benchmark_data_smithi188_104537_object90480:head# 2024-04-01T19:36:34.250 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.253 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:566bf4ff:::benchmark_data_smithi188_104537_object11592:head# 2024-04-01T19:36:34.253 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.253 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:566bf5eb:::benchmark_data_smithi188_104537_object92044:head# 2024-04-01T19:36:34.253 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.253 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:566c3b31:::benchmark_data_smithi188_104537_object29722:head# 2024-04-01T19:36:34.253 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.253 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:566c6396:::benchmark_data_smithi188_104537_object54673:head# 2024-04-01T19:36:34.253 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.253 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:566ce27a:::benchmark_data_smithi188_104537_object105813:head# 2024-04-01T19:36:34.253 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.253 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:566d0b52:::benchmark_data_smithi188_104537_object73264:head# 2024-04-01T19:36:34.253 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.253 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:566db42c:::benchmark_data_smithi188_104537_object109209:head# 2024-04-01T19:36:34.254 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.254 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:566edc99:::benchmark_data_smithi188_104537_object158879:head# 2024-04-01T19:36:34.254 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.254 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:566f5bd6:::benchmark_data_smithi188_104537_object28912:head# 2024-04-01T19:36:34.254 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.254 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56708aaa:::benchmark_data_smithi188_104537_object35581:head# 2024-04-01T19:36:34.254 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.254 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5670b252:::benchmark_data_smithi188_104537_object53747:head# 2024-04-01T19:36:34.254 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.254 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5670c038:::benchmark_data_smithi188_104537_object131392:head# 2024-04-01T19:36:34.254 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.254 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5670e220:::benchmark_data_smithi188_104537_object88805:head# 2024-04-01T19:36:34.254 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.255 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5671a024:::benchmark_data_smithi188_104537_object110586:head# 2024-04-01T19:36:34.255 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.255 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5671c95d:::benchmark_data_smithi188_104537_object108366:head# 2024-04-01T19:36:34.255 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.257 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:567318da:::benchmark_data_smithi188_104537_object37614:head# 2024-04-01T19:36:34.257 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.257 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5673dd7d:::benchmark_data_smithi188_104537_object77793:head# 2024-04-01T19:36:34.257 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.257 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5674a58c:::benchmark_data_smithi188_104537_object170659:head# 2024-04-01T19:36:34.257 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.257 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:567503ca:::benchmark_data_smithi188_104537_object105158:head# 2024-04-01T19:36:34.257 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.257 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56751d1c:::benchmark_data_smithi188_104537_object136865:head# 2024-04-01T19:36:34.257 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.257 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56754bc9:::benchmark_data_smithi188_104537_object94712:head# 2024-04-01T19:36:34.257 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.257 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5675638c:::benchmark_data_smithi188_104537_object11275:head# 2024-04-01T19:36:34.258 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.258 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56768c81:::benchmark_data_smithi188_104537_object85644:head# 2024-04-01T19:36:34.258 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.258 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:567765e0:::benchmark_data_smithi188_104537_object129726:head# 2024-04-01T19:36:34.258 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.258 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5677b02e:::benchmark_data_smithi188_104537_object167748:head# 2024-04-01T19:36:34.258 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.258 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5677c338:::benchmark_data_smithi188_104537_object21628:head# 2024-04-01T19:36:34.258 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.258 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5677f4a7:::benchmark_data_smithi188_104537_object19230:head# 2024-04-01T19:36:34.258 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.258 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56781bcc:::benchmark_data_smithi188_104537_object33833:head# 2024-04-01T19:36:34.258 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.258 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56784aaf:::benchmark_data_smithi188_104537_object110915:head# 2024-04-01T19:36:34.259 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.260 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5678818f:::benchmark_data_smithi188_104537_object31902:head# 2024-04-01T19:36:34.260 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.260 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5678a52e:::benchmark_data_smithi188_104537_object108677:head# 2024-04-01T19:36:34.261 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.261 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56793d95:::benchmark_data_smithi188_104537_object168460:head# 2024-04-01T19:36:34.261 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.261 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56794d3b:::benchmark_data_smithi188_104537_object95342:head# 2024-04-01T19:36:34.261 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.261 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5679bccf:::benchmark_data_smithi188_104537_object162174:head# 2024-04-01T19:36:34.261 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.261 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:567a1987:::benchmark_data_smithi188_104537_object123742:head# 2024-04-01T19:36:34.261 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.261 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:567a2f7c:::benchmark_data_smithi188_104537_object158152:head# 2024-04-01T19:36:34.261 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.261 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:567a4825:::benchmark_data_smithi188_104537_object19516:head# 2024-04-01T19:36:34.261 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.261 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:567b12b3:::benchmark_data_smithi188_104537_object150176:head# 2024-04-01T19:36:34.262 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.262 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:567b2e12:::benchmark_data_smithi188_104537_object103900:head# 2024-04-01T19:36:34.262 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.262 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:567bb725:::benchmark_data_smithi188_104537_object142938:head# 2024-04-01T19:36:34.262 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.262 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:567c076d:::benchmark_data_smithi188_104537_object14945:head# 2024-04-01T19:36:34.262 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.262 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:567c2974:::benchmark_data_smithi188_104537_object137873:head# 2024-04-01T19:36:34.262 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.264 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:567c6389:::benchmark_data_smithi188_104537_object169167:head# 2024-04-01T19:36:34.264 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.264 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:567ccfba:::benchmark_data_smithi188_104537_object54952:head# 2024-04-01T19:36:34.264 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.264 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:567cff3e:::benchmark_data_smithi188_104537_object95498:head# 2024-04-01T19:36:34.264 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.264 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:567d0033:::benchmark_data_smithi188_104537_object93094:head# 2024-04-01T19:36:34.264 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.264 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:567d2be1:::benchmark_data_smithi188_104537_object55228:head# 2024-04-01T19:36:34.264 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.264 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:567d6a43:::benchmark_data_smithi188_104537_object121517:head# 2024-04-01T19:36:34.264 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.265 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:567ddde6:::benchmark_data_smithi188_104537_object21096:head# 2024-04-01T19:36:34.265 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.265 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:567e2551:::benchmark_data_smithi188_104537_object13533:head# 2024-04-01T19:36:34.265 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.265 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:567e5d3e:::benchmark_data_smithi188_104537_object124193:head# 2024-04-01T19:36:34.265 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.265 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:567f0161:::benchmark_data_smithi188_104537_object29300:head# 2024-04-01T19:36:34.265 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.265 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:567f0870:::benchmark_data_smithi188_104537_object150625:head# 2024-04-01T19:36:34.265 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.265 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:567f68fa:::benchmark_data_smithi188_104537_object110478:head# 2024-04-01T19:36:34.265 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.266 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:567f90d5:::benchmark_data_smithi188_104537_object109940:head# 2024-04-01T19:36:34.267 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.267 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:567fc298:::benchmark_data_smithi188_104537_object19469:head# 2024-04-01T19:36:34.267 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.267 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56811925:::benchmark_data_smithi188_104537_object63662:head# 2024-04-01T19:36:34.267 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.267 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:568157c0:::benchmark_data_smithi188_104537_object167631:head# 2024-04-01T19:36:34.267 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.267 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56818e83:::benchmark_data_smithi188_104537_object45539:head# 2024-04-01T19:36:34.267 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.267 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56820c97:::benchmark_data_smithi188_104537_object27824:head# 2024-04-01T19:36:34.267 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.267 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56823f73:::benchmark_data_smithi188_104537_object59251:head# 2024-04-01T19:36:34.267 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.268 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:568283e3:::benchmark_data_smithi188_104537_object71127:head# 2024-04-01T19:36:34.268 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.268 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5682ca68:::benchmark_data_smithi188_104537_object17855:head# 2024-04-01T19:36:34.268 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.268 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5682d808:::benchmark_data_smithi188_104537_object51592:head# 2024-04-01T19:36:34.268 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.269 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5683028d:::benchmark_data_smithi188_104537_object85255:head# 2024-04-01T19:36:34.269 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.269 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56834273:::benchmark_data_smithi188_104537_object86641:head# 2024-04-01T19:36:34.269 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.269 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56837a7f:::benchmark_data_smithi188_104537_object31289:head# 2024-04-01T19:36:34.269 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.269 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56837f2c:::benchmark_data_smithi188_104537_object41265:head# 2024-04-01T19:36:34.269 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.275 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:568478ca:::benchmark_data_smithi188_104537_object47178:head# 2024-04-01T19:36:34.275 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.275 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5684ead4:::benchmark_data_smithi188_104537_object164562:head# 2024-04-01T19:36:34.275 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.275 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5685a442:::benchmark_data_smithi188_104537_object107551:head# 2024-04-01T19:36:34.275 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.275 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5685d87f:::benchmark_data_smithi188_104537_object160931:head# 2024-04-01T19:36:34.275 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.275 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:568696d9:::benchmark_data_smithi188_104537_object141170:head# 2024-04-01T19:36:34.275 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.275 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5686fd55:::benchmark_data_smithi188_104537_object137090:head# 2024-04-01T19:36:34.276 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.276 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:568723fd:::benchmark_data_smithi188_104537_object12053:head# 2024-04-01T19:36:34.276 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.276 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5687bdbf:::benchmark_data_smithi188_104537_object147220:head# 2024-04-01T19:36:34.276 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.276 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56880eea:::benchmark_data_smithi188_104537_object94055:head# 2024-04-01T19:36:34.276 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.276 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56881ef1:::benchmark_data_smithi188_104537_object87865:head# 2024-04-01T19:36:34.276 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.276 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:568838ec:::benchmark_data_smithi188_104537_object146007:head# 2024-04-01T19:36:34.276 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.276 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5688576e:::benchmark_data_smithi188_104537_object119198:head# 2024-04-01T19:36:34.276 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.276 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:568894c5:::benchmark_data_smithi188_104537_object150429:head# 2024-04-01T19:36:34.277 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.277 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5688ef9f:::benchmark_data_smithi188_104537_object45612:head# 2024-04-01T19:36:34.277 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.277 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:568905ed:::benchmark_data_smithi188_104537_object151927:head# 2024-04-01T19:36:34.277 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.277 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56890aa4:::benchmark_data_smithi188_104537_object91835:head# 2024-04-01T19:36:34.277 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.277 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56896770:::benchmark_data_smithi188_104537_object114366:head# 2024-04-01T19:36:34.277 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.277 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5689890c:::benchmark_data_smithi188_104537_object125151:head# 2024-04-01T19:36:34.277 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.279 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56899c76:::benchmark_data_smithi188_104537_object136416:head# 2024-04-01T19:36:34.279 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.279 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5689eab2:::benchmark_data_smithi188_104537_object121045:head# 2024-04-01T19:36:34.280 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.280 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:568a5a8a:::benchmark_data_smithi188_104537_object47172:head# 2024-04-01T19:36:34.280 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.280 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:568b4e30:::benchmark_data_smithi188_104537_object40468:head# 2024-04-01T19:36:34.280 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.280 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:568b81a4:::benchmark_data_smithi188_104537_object75581:head# 2024-04-01T19:36:34.280 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.280 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:568c83c6:::benchmark_data_smithi188_104537_object30836:head# 2024-04-01T19:36:34.280 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.280 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:568cab19:::benchmark_data_smithi188_104537_object117242:head# 2024-04-01T19:36:34.280 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.280 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:568cdee3:::benchmark_data_smithi188_104537_object116743:head# 2024-04-01T19:36:34.280 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.285 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:568e3431:::benchmark_data_smithi188_104537_object95550:head# 2024-04-01T19:36:34.285 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.285 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:568e54d0:::benchmark_data_smithi188_104537_object110514:head# 2024-04-01T19:36:34.285 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.285 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:568e72be:::benchmark_data_smithi188_104537_object61144:head# 2024-04-01T19:36:34.285 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.285 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:568e7d29:::benchmark_data_smithi188_104537_object113639:head# 2024-04-01T19:36:34.285 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.285 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:568f1e2f:::benchmark_data_smithi188_104537_object123260:head# 2024-04-01T19:36:34.286 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.286 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:568f2a1b:::benchmark_data_smithi188_104537_object155306:head# 2024-04-01T19:36:34.286 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.286 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:568f4b0d:::benchmark_data_smithi188_104537_object104689:head# 2024-04-01T19:36:34.286 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.286 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:569002ca:::benchmark_data_smithi188_104537_object130973:head# 2024-04-01T19:36:34.286 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.286 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56900ef8:::benchmark_data_smithi188_104537_object136706:head# 2024-04-01T19:36:34.286 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.286 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5690b62f:::benchmark_data_smithi188_104537_object18468:head# 2024-04-01T19:36:34.286 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.287 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5692233e:::benchmark_data_smithi188_104537_object81717:head# 2024-04-01T19:36:34.287 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.287 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5692974d:::benchmark_data_smithi188_104537_object159443:head# 2024-04-01T19:36:34.287 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.287 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5692d967:::benchmark_data_smithi188_104537_object67274:head# 2024-04-01T19:36:34.287 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.287 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5693a071:::benchmark_data_smithi188_104537_object138163:head# 2024-04-01T19:36:34.287 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.287 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5693ac60:::benchmark_data_smithi188_104537_object55463:head# 2024-04-01T19:36:34.287 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.287 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5693d791:::benchmark_data_smithi188_104537_object50721:head# 2024-04-01T19:36:34.287 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.287 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5693dce1:::benchmark_data_smithi188_104537_object64770:head# 2024-04-01T19:36:34.288 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.288 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5694930d:::benchmark_data_smithi188_104537_object76551:head# 2024-04-01T19:36:34.288 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.288 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5694b34b:::benchmark_data_smithi188_104537_object54964:head# 2024-04-01T19:36:34.288 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.288 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5694e6b7:::benchmark_data_smithi188_104537_object45003:head# 2024-04-01T19:36:34.288 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.290 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56950056:::benchmark_data_smithi188_104537_object87849:head# 2024-04-01T19:36:34.290 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56950144:::benchmark_data_smithi188_104537_object115028:head# 2024-04-01T19:36:34.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56951199:::benchmark_data_smithi188_104537_object132347:head# 2024-04-01T19:36:34.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5695aa3d:::benchmark_data_smithi188_104537_object46790:head# 2024-04-01T19:36:34.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5695cd02:::benchmark_data_smithi188_104537_object147935:head# 2024-04-01T19:36:34.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5695ec15:::benchmark_data_smithi188_104537_object38162:head# 2024-04-01T19:36:34.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:569608a3:::benchmark_data_smithi188_104537_object122187:head# 2024-04-01T19:36:34.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:569630a5:::benchmark_data_smithi188_104537_object36924:head# 2024-04-01T19:36:34.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.292 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56967394:::benchmark_data_smithi188_104537_object55627:head# 2024-04-01T19:36:34.292 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.292 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5696b624:::benchmark_data_smithi188_104537_object32211:head# 2024-04-01T19:36:34.292 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.292 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5696bf4c:::benchmark_data_smithi188_104537_object42885:head# 2024-04-01T19:36:34.292 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.292 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5696c16a:::benchmark_data_smithi188_104537_object106200:head# 2024-04-01T19:36:34.292 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.292 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5697e637:::benchmark_data_smithi188_104537_object143608:head# 2024-04-01T19:36:34.292 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.292 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5698c421:::benchmark_data_smithi188_104537_object40806:head# 2024-04-01T19:36:34.292 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.292 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5698c432:::benchmark_data_smithi188_104537_object20359:head# 2024-04-01T19:36:34.292 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.292 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5698fd13:::benchmark_data_smithi188_104537_object27869:head# 2024-04-01T19:36:34.293 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.293 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5699043d:::benchmark_data_smithi188_104537_object54808:head# 2024-04-01T19:36:34.293 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.293 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5699fd03:::benchmark_data_smithi188_104537_object166394:head# 2024-04-01T19:36:34.293 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.293 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:36:34.294 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:569a04fc:::benchmark_data_smithi188_104537_object144199:head# 2024-04-01T19:36:34.294 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.294 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:569a8ba6:::benchmark_data_smithi188_104537_object66455:head# 2024-04-01T19:36:34.294 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.295 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:569aab27:::benchmark_data_smithi188_104537_object97633:head# 2024-04-01T19:36:34.295 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.295 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:569abedc:::benchmark_data_smithi188_104537_object95863:head# 2024-04-01T19:36:34.295 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.295 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:569bb66b:::benchmark_data_smithi188_104537_object124876:head# 2024-04-01T19:36:34.295 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.295 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:569beb93:::benchmark_data_smithi188_104537_object98007:head# 2024-04-01T19:36:34.295 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.295 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:569bfb80:::benchmark_data_smithi188_104537_object69727:head# 2024-04-01T19:36:34.295 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.295 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:569c2f26:::benchmark_data_smithi188_104537_object161701:head# 2024-04-01T19:36:34.295 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.295 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:569c4a9d:::benchmark_data_smithi188_104537_object119811:head# 2024-04-01T19:36:34.295 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.296 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:569ca8f7:::benchmark_data_smithi188_104537_object20690:head# 2024-04-01T19:36:34.296 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.298 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:569d3436:::benchmark_data_smithi188_104537_object49539:head# 2024-04-01T19:36:34.298 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.298 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:569d41f5:::benchmark_data_smithi188_104537_object75758:head# 2024-04-01T19:36:34.298 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.298 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:569d85fa:::benchmark_data_smithi188_104537_object166978:head# 2024-04-01T19:36:34.298 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.298 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:569eca46:::benchmark_data_smithi188_104537_object129179:head# 2024-04-01T19:36:34.298 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.298 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:569ef42a:::benchmark_data_smithi188_104537_object139361:head# 2024-04-01T19:36:34.298 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.298 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:569f3831:::benchmark_data_smithi188_104537_object159449:head# 2024-04-01T19:36:34.298 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.299 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:569fbe30:::benchmark_data_smithi188_104537_object59608:head# 2024-04-01T19:36:34.299 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.299 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:569ff793:::benchmark_data_smithi188_104537_object77207:head# 2024-04-01T19:36:34.299 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.299 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a033f9:::benchmark_data_smithi188_104537_object41737:head# 2024-04-01T19:36:34.299 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.299 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a0cb9d:::benchmark_data_smithi188_104537_object148799:head# 2024-04-01T19:36:34.299 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.299 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a12c24:::benchmark_data_smithi188_104537_object79573:head# 2024-04-01T19:36:34.299 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.299 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a17e53:::benchmark_data_smithi188_104537_object99614:head# 2024-04-01T19:36:34.299 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.299 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a18371:::benchmark_data_smithi188_104537_object151390:head# 2024-04-01T19:36:34.300 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.302 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a21f1a:::benchmark_data_smithi188_104537_object56892:head# 2024-04-01T19:36:34.302 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.302 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a23f9e:::benchmark_data_smithi188_104537_object165393:head# 2024-04-01T19:36:34.302 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.302 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a2816e:::benchmark_data_smithi188_104537_object68942:head# 2024-04-01T19:36:34.302 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.302 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a2a9b5:::benchmark_data_smithi188_104537_object26398:head# 2024-04-01T19:36:34.302 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.302 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a39ac8:::benchmark_data_smithi188_104537_object77045:head# 2024-04-01T19:36:34.302 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.302 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a3a11f:::benchmark_data_smithi188_104537_object66099:head# 2024-04-01T19:36:34.302 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.302 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a3dd25:::benchmark_data_smithi188_104537_object57602:head# 2024-04-01T19:36:34.303 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.303 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a3e1e0:::benchmark_data_smithi188_104537_object135736:head# 2024-04-01T19:36:34.303 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.303 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a42f33:::benchmark_data_smithi188_104537_object53986:head# 2024-04-01T19:36:34.303 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.303 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a4d679:::benchmark_data_smithi188_104537_object28203:head# 2024-04-01T19:36:34.303 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.303 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a4faf2:::benchmark_data_smithi188_104537_object144445:head# 2024-04-01T19:36:34.303 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.303 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a56809:::benchmark_data_smithi188_104537_object42745:head# 2024-04-01T19:36:34.303 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.303 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a58ffb:::benchmark_data_smithi188_104537_object45272:head# 2024-04-01T19:36:34.303 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.303 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a5b949:::benchmark_data_smithi188_104537_object36654:head# 2024-04-01T19:36:34.304 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.305 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a648fa:::benchmark_data_smithi188_104537_object152307:head# 2024-04-01T19:36:34.305 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.306 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a6b96b:::benchmark_data_smithi188_104537_object126199:head# 2024-04-01T19:36:34.306 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.306 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a7756e:::benchmark_data_smithi188_104537_object22131:head# 2024-04-01T19:36:34.306 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.306 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a7af34:::benchmark_data_smithi188_104537_object42667:head# 2024-04-01T19:36:34.306 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.306 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a7e693:::benchmark_data_smithi188_104537_object25292:head# 2024-04-01T19:36:34.306 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.306 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a85ff5:::benchmark_data_smithi188_104537_object139682:head# 2024-04-01T19:36:34.306 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.306 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a8a0ad:::benchmark_data_smithi188_104537_object18646:head# 2024-04-01T19:36:34.306 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.306 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a92183:::benchmark_data_smithi188_104537_object145938:head# 2024-04-01T19:36:34.307 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.307 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a958c1:::benchmark_data_smithi188_104537_object110527:head# 2024-04-01T19:36:34.307 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.307 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a95a98:::benchmark_data_smithi188_104537_object113047:head# 2024-04-01T19:36:34.307 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.307 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56a983e0:::benchmark_data_smithi188_104537_object73707:head# 2024-04-01T19:36:34.307 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.307 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ab5e79:::benchmark_data_smithi188_104537_object77319:head# 2024-04-01T19:36:34.307 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.307 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ac28cb:::benchmark_data_smithi188_104537_object145637:head# 2024-04-01T19:36:34.307 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.307 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ac3779:::benchmark_data_smithi188_104537_object132511:head# 2024-04-01T19:36:34.307 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.307 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56acde45:::benchmark_data_smithi188_104537_object43189:head# 2024-04-01T19:36:34.308 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.309 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56acf41c:::benchmark_data_smithi188_104537_object79477:head# 2024-04-01T19:36:34.309 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.309 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ad7f8a:::benchmark_data_smithi188_104537_object60731:head# 2024-04-01T19:36:34.309 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.309 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ad85ef:::benchmark_data_smithi188_104537_object66809:head# 2024-04-01T19:36:34.309 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.309 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56adf307:::benchmark_data_smithi188_104537_object68748:head# 2024-04-01T19:36:34.309 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.310 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ae1cb1:::benchmark_data_smithi188_104537_object119286:head# 2024-04-01T19:36:34.310 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.310 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56b04f51:::benchmark_data_smithi188_104537_object58441:head# 2024-04-01T19:36:34.310 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.310 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56b0ce3a:::benchmark_data_smithi188_104537_object63200:head# 2024-04-01T19:36:34.310 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.310 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56b1dc5f:::benchmark_data_smithi188_104537_object131749:head# 2024-04-01T19:36:34.310 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.310 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56b1f2d9:::benchmark_data_smithi188_104537_object122661:head# 2024-04-01T19:36:34.310 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.310 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56b29298:::benchmark_data_smithi188_104537_object102418:head# 2024-04-01T19:36:34.310 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.311 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:34.311 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:34 smithi022 ceph-mon[39439]: pgmap v908: 17 pgs: 17 active+clean; 9.6 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 706 op/s; 19 MiB/s, 297 objects/s recovering 2024-04-01T19:36:34.311 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:34.311 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:34.311 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:34.311 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:34.311 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:34.311 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:34.312 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56b30aa5:::benchmark_data_smithi188_104537_object90639:head# 2024-04-01T19:36:34.312 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.312 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56b4c1c6:::benchmark_data_smithi188_104537_object153138:head# 2024-04-01T19:36:34.312 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.312 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56b4c309:::benchmark_data_smithi188_104537_object17682:head# 2024-04-01T19:36:34.313 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.313 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56b4d315:::benchmark_data_smithi188_104537_object32958:head# 2024-04-01T19:36:34.313 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.313 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56b596cb:::benchmark_data_smithi188_104537_object51970:head# 2024-04-01T19:36:34.313 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.315 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56b5a716:::benchmark_data_smithi188_104537_object44664:head# 2024-04-01T19:36:34.315 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.316 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56b5d1ff:::benchmark_data_smithi188_104537_object55853:head# 2024-04-01T19:36:34.316 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.316 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56b5f3d1:::benchmark_data_smithi188_104537_object68864:head# 2024-04-01T19:36:34.316 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.316 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56b61b83:::benchmark_data_smithi188_104537_object18734:head# 2024-04-01T19:36:34.316 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.316 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56b6468e:::benchmark_data_smithi188_104537_object16046:head# 2024-04-01T19:36:34.316 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.316 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56b76f38:::benchmark_data_smithi188_104537_object152052:head# 2024-04-01T19:36:34.316 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.316 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56b7c4b4:::benchmark_data_smithi188_104537_object75622:head# 2024-04-01T19:36:34.316 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.316 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56b80bf5:::benchmark_data_smithi188_104537_object139491:head# 2024-04-01T19:36:34.316 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.317 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56b88ad7:::benchmark_data_smithi188_104537_object45575:head# 2024-04-01T19:36:34.317 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.317 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56b8d639:::benchmark_data_smithi188_104537_object113278:head# 2024-04-01T19:36:34.317 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.317 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56b97723:::benchmark_data_smithi188_104537_object170988:head# 2024-04-01T19:36:34.317 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.317 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56b9c480:::benchmark_data_smithi188_104537_object137657:head# 2024-04-01T19:36:34.317 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.319 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56b9d671:::benchmark_data_smithi188_104537_object51754:head# 2024-04-01T19:36:34.319 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.319 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ba2167:::benchmark_data_smithi188_104537_object38652:head# 2024-04-01T19:36:34.319 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.319 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ba53b8:::benchmark_data_smithi188_104537_object119451:head# 2024-04-01T19:36:34.319 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.319 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ba56cd:::benchmark_data_smithi188_104537_object53128:head# 2024-04-01T19:36:34.319 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.319 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56baa793:::benchmark_data_smithi188_104537_object106501:head# 2024-04-01T19:36:34.319 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.319 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56bbc13d:::benchmark_data_smithi188_104537_object129518:head# 2024-04-01T19:36:34.319 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.319 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56bbc571:::benchmark_data_smithi188_104537_object71777:head# 2024-04-01T19:36:34.320 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.320 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56bc3b5f:::benchmark_data_smithi188_104537_object90619:head# 2024-04-01T19:36:34.320 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.320 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56bdac8e:::benchmark_data_smithi188_104537_object83996:head# 2024-04-01T19:36:34.320 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.320 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56bdf1f1:::benchmark_data_smithi188_104537_object147424:head# 2024-04-01T19:36:34.320 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.320 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56be343f:::benchmark_data_smithi188_104537_object35486:head# 2024-04-01T19:36:34.320 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.320 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56bec81f:::benchmark_data_smithi188_104537_object21180:head# 2024-04-01T19:36:34.320 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.321 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56bed1cf:::benchmark_data_smithi188_104537_object42895:head# 2024-04-01T19:36:34.321 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.321 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56bf6b4f:::benchmark_data_smithi188_104537_object53710:head# 2024-04-01T19:36:34.322 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.322 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c00301:::benchmark_data_smithi188_104537_object156290:head# 2024-04-01T19:36:34.322 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.322 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c02b32:::benchmark_data_smithi188_104537_object99850:head# 2024-04-01T19:36:34.322 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.322 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c05826:::benchmark_data_smithi188_104537_object117011:head# 2024-04-01T19:36:34.322 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.322 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c061ab:::benchmark_data_smithi188_104537_object52509:head# 2024-04-01T19:36:34.322 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.324 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c08240:::benchmark_data_smithi188_104537_object80245:head# 2024-04-01T19:36:34.324 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.324 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c14d0a:::benchmark_data_smithi188_104537_object66645:head# 2024-04-01T19:36:34.325 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.325 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c15060:::benchmark_data_smithi188_104537_object14957:head# 2024-04-01T19:36:34.325 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.325 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c266f7:::benchmark_data_smithi188_104537_object119698:head# 2024-04-01T19:36:34.325 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.325 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c27621:::benchmark_data_smithi188_104537_object146723:head# 2024-04-01T19:36:34.325 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.325 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c2b46e:::benchmark_data_smithi188_104537_object99062:head# 2024-04-01T19:36:34.325 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.325 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c2c303:::benchmark_data_smithi188_104537_object34483:head# 2024-04-01T19:36:34.325 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.325 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c2e900:::benchmark_data_smithi188_104537_object36842:head# 2024-04-01T19:36:34.325 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.325 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c344ea:::benchmark_data_smithi188_104537_object146067:head# 2024-04-01T19:36:34.326 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.326 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c35291:::benchmark_data_smithi188_104537_object39309:head# 2024-04-01T19:36:34.326 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.326 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c38df6:::benchmark_data_smithi188_104537_object89202:head# 2024-04-01T19:36:34.326 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.326 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c3b358:::benchmark_data_smithi188_104537_object162393:head# 2024-04-01T19:36:34.326 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.326 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c47700:::benchmark_data_smithi188_104537_object134883:head# 2024-04-01T19:36:34.326 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.326 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c4a6f4:::benchmark_data_smithi188_104537_object71422:head# 2024-04-01T19:36:34.326 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.326 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c4b914:::benchmark_data_smithi188_104537_object86117:head# 2024-04-01T19:36:34.326 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.328 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c53b1c:::benchmark_data_smithi188_104537_object59114:head# 2024-04-01T19:36:34.328 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.328 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c54a15:::benchmark_data_smithi188_104537_object157365:head# 2024-04-01T19:36:34.328 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.328 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c5c653:::benchmark_data_smithi188_104537_object118377:head# 2024-04-01T19:36:34.328 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.329 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c79f42:::benchmark_data_smithi188_104537_object125868:head# 2024-04-01T19:36:34.329 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.329 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c7b620:::benchmark_data_smithi188_104537_object81597:head# 2024-04-01T19:36:34.329 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.329 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c7bb8f:::benchmark_data_smithi188_104537_object98694:head# 2024-04-01T19:36:34.329 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.329 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c7ef1f:::benchmark_data_smithi188_104537_object128675:head# 2024-04-01T19:36:34.329 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.329 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c80560:::benchmark_data_smithi188_104537_object93514:head# 2024-04-01T19:36:34.329 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.329 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c8069e:::benchmark_data_smithi188_104537_object74321:head# 2024-04-01T19:36:34.329 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.329 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c87dc6:::benchmark_data_smithi188_104537_object83557:head# 2024-04-01T19:36:34.329 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.329 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c88dba:::benchmark_data_smithi188_104537_object142722:head# 2024-04-01T19:36:34.330 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.330 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c8f785:::benchmark_data_smithi188_104537_object131777:head# 2024-04-01T19:36:34.330 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.330 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c961ab:::benchmark_data_smithi188_104537_object112554:head# 2024-04-01T19:36:34.331 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.331 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56c96925:::benchmark_data_smithi188_104537_object13681:head# 2024-04-01T19:36:34.331 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.331 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ca33e2:::benchmark_data_smithi188_104537_object57756:head# 2024-04-01T19:36:34.331 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.331 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56cabbf9:::benchmark_data_smithi188_104537_object118054:head# 2024-04-01T19:36:34.331 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.331 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56cad975:::benchmark_data_smithi188_104537_object166392:head# 2024-04-01T19:36:34.331 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.331 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56cb08a7:::benchmark_data_smithi188_104537_object22296:head# 2024-04-01T19:36:34.331 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.331 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56cb263c:::benchmark_data_smithi188_104537_object159522:head# 2024-04-01T19:36:34.331 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.331 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56cbd92b:::benchmark_data_smithi188_104537_object47508:head# 2024-04-01T19:36:34.332 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.332 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56cbfc5b:::benchmark_data_smithi188_104537_object105963:head# 2024-04-01T19:36:34.332 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.333 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56cc1d6e:::benchmark_data_smithi188_104537_object109082:head# 2024-04-01T19:36:34.333 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.333 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56cc3bc1:::benchmark_data_smithi188_104537_object109591:head# 2024-04-01T19:36:34.333 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.333 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56cca3a7:::benchmark_data_smithi188_104537_object84789:head# 2024-04-01T19:36:34.333 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.333 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56cce3eb:::benchmark_data_smithi188_104537_object141691:head# 2024-04-01T19:36:34.333 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.333 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56cd1292:::benchmark_data_smithi188_104537_object125236:head# 2024-04-01T19:36:34.333 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.333 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56cd3262:::benchmark_data_smithi188_104537_object49584:head# 2024-04-01T19:36:34.334 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.334 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56cd3968:::benchmark_data_smithi188_104537_object149371:head# 2024-04-01T19:36:34.334 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.334 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56cd7c9f:::benchmark_data_smithi188_104537_object15122:head# 2024-04-01T19:36:34.334 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.340 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ce0b95:::benchmark_data_smithi188_104537_object91015:head# 2024-04-01T19:36:34.340 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.340 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ce4614:::benchmark_data_smithi188_104537_object115929:head# 2024-04-01T19:36:34.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ce533b:::benchmark_data_smithi188_104537_object37513:head# 2024-04-01T19:36:34.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56cef0c4:::benchmark_data_smithi188_104537_object31096:head# 2024-04-01T19:36:34.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56cf9c19:::benchmark_data_smithi188_104537_object131557:head# 2024-04-01T19:36:34.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56cfa92d:::benchmark_data_smithi188_104537_object114625:head# 2024-04-01T19:36:34.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56cffcb6:::benchmark_data_smithi188_104537_object78529:head# 2024-04-01T19:36:34.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56d05a24:::benchmark_data_smithi188_104537_object68454:head# 2024-04-01T19:36:34.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56d0c275:::benchmark_data_smithi188_104537_object148390:head# 2024-04-01T19:36:34.342 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.342 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56d122d1:::benchmark_data_smithi188_104537_object122238:head# 2024-04-01T19:36:34.342 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.342 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56d16d3a:::benchmark_data_smithi188_104537_object157538:head# 2024-04-01T19:36:34.342 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.342 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56d27202:::benchmark_data_smithi188_104537_object34779:head# 2024-04-01T19:36:34.342 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.342 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56d2a25b:::benchmark_data_smithi188_104537_object136907:head# 2024-04-01T19:36:34.342 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.342 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56d2a7f5:::benchmark_data_smithi188_104537_object110669:head# 2024-04-01T19:36:34.342 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.342 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56d34224:::benchmark_data_smithi188_104537_object166796:head# 2024-04-01T19:36:34.343 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.343 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56d3c1cc:::benchmark_data_smithi188_104537_object102871:head# 2024-04-01T19:36:34.343 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.343 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56d41dae:::benchmark_data_smithi188_104537_object109156:head# 2024-04-01T19:36:34.343 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.343 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56d47163:::benchmark_data_smithi188_104537_object137859:head# 2024-04-01T19:36:34.343 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.343 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56d49997:::benchmark_data_smithi188_104537_object60761:head# 2024-04-01T19:36:34.343 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.343 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56d4c7d4:::benchmark_data_smithi188_104537_object146000:head# 2024-04-01T19:36:34.343 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.343 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56d4e12e:::benchmark_data_smithi188_104537_object154178:head# 2024-04-01T19:36:34.343 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.343 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56d694b3:::benchmark_data_smithi188_104537_object81376:head# 2024-04-01T19:36:34.343 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.344 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56d702a6:::benchmark_data_smithi188_104537_object138840:head# 2024-04-01T19:36:34.344 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.344 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56d7f997:::benchmark_data_smithi188_104537_object60561:head# 2024-04-01T19:36:34.344 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.344 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56d82cac:::benchmark_data_smithi188_104537_object55715:head# 2024-04-01T19:36:34.344 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.344 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56d8636c:::benchmark_data_smithi188_104537_object73010:head# 2024-04-01T19:36:34.344 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.344 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56d95b06:::benchmark_data_smithi188_104537_object153239:head# 2024-04-01T19:36:34.344 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.346 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56d95fc6:::benchmark_data_smithi188_104537_object132825:head# 2024-04-01T19:36:34.346 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.346 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56d96d3f:::benchmark_data_smithi188_104537_object99096:head# 2024-04-01T19:36:34.346 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.346 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56da942d:::benchmark_data_smithi188_104537_object118465:head# 2024-04-01T19:36:34.346 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.346 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56dacbda:::benchmark_data_smithi188_104537_object51840:head# 2024-04-01T19:36:34.346 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.346 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56db20aa:::benchmark_data_smithi188_104537_object107080:head# 2024-04-01T19:36:34.346 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.346 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56db43c2:::benchmark_data_smithi188_104537_object135754:head# 2024-04-01T19:36:34.346 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.346 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56dbf3de:::benchmark_data_smithi188_104537_object42325:head# 2024-04-01T19:36:34.347 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.347 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56dc4a0a:::benchmark_data_smithi188_104537_object124739:head# 2024-04-01T19:36:34.347 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.347 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56dc7165:::benchmark_data_smithi188_104537_object51477:head# 2024-04-01T19:36:34.347 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.347 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56dc7d68:::benchmark_data_smithi188_104537_object17455:head# 2024-04-01T19:36:34.347 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.347 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56dd0f45:::benchmark_data_smithi188_104537_object95044:head# 2024-04-01T19:36:34.347 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.347 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56dd51dd:::benchmark_data_smithi188_104537_object54388:head# 2024-04-01T19:36:34.347 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.347 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56dd6695:::benchmark_data_smithi188_104537_object31884:head# 2024-04-01T19:36:34.347 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.348 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56decfbb:::benchmark_data_smithi188_104537_object68011:head# 2024-04-01T19:36:34.348 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.348 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:34.350 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56deef4b:::benchmark_data_smithi188_104537_object76800:head# 2024-04-01T19:36:34.350 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.350 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56df5167:::benchmark_data_smithi188_104537_object56372:head# 2024-04-01T19:36:34.350 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.350 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56dfff5a:::benchmark_data_smithi188_104537_object141077:head# 2024-04-01T19:36:34.350 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.350 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e02d41:::benchmark_data_smithi188_104537_object92621:head# 2024-04-01T19:36:34.350 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.351 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e08311:::benchmark_data_smithi188_104537_object164482:head# 2024-04-01T19:36:34.351 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.351 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e08ec3:::benchmark_data_smithi188_104537_object83962:head# 2024-04-01T19:36:34.351 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.351 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e0c2a9:::benchmark_data_smithi188_104537_object134277:head# 2024-04-01T19:36:34.351 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.351 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e14198:::benchmark_data_smithi188_104537_object15158:head# 2024-04-01T19:36:34.351 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.351 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e20e91:::benchmark_data_smithi188_104537_object38395:head# 2024-04-01T19:36:34.351 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.351 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e2bffe:::benchmark_data_smithi188_104537_object94658:head# 2024-04-01T19:36:34.351 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.351 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e31433:::benchmark_data_smithi188_104537_object62476:head# 2024-04-01T19:36:34.351 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.352 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e34d11:::benchmark_data_smithi188_104537_object137160:head# 2024-04-01T19:36:34.352 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.352 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e38008:::benchmark_data_smithi188_104537_object162121:head# 2024-04-01T19:36:34.352 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.352 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e43346:::benchmark_data_smithi188_104537_object68255:head# 2024-04-01T19:36:34.352 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.352 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e446aa:::benchmark_data_smithi188_104537_object168342:head# 2024-04-01T19:36:34.352 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.354 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e45613:::benchmark_data_smithi188_104537_object116493:head# 2024-04-01T19:36:34.355 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.355 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e48a57:::benchmark_data_smithi188_104537_object121141:head# 2024-04-01T19:36:34.355 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.355 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e48dfd:::benchmark_data_smithi188_104537_object110248:head# 2024-04-01T19:36:34.355 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.355 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e4a1dc:::benchmark_data_smithi188_104537_object12936:head# 2024-04-01T19:36:34.355 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.355 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e4e93a:::benchmark_data_smithi188_104537_object31869:head# 2024-04-01T19:36:34.355 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.355 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e53666:::benchmark_data_smithi188_104537_object13593:head# 2024-04-01T19:36:34.355 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.355 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e55bb5:::benchmark_data_smithi188_104537_object36466:head# 2024-04-01T19:36:34.355 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.355 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e57c84:::benchmark_data_smithi188_104537_object133448:head# 2024-04-01T19:36:34.355 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.356 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e63e94:::benchmark_data_smithi188_104537_object37986:head# 2024-04-01T19:36:34.356 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.356 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e6d2c1:::benchmark_data_smithi188_104537_object117232:head# 2024-04-01T19:36:34.356 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.356 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e726fb:::benchmark_data_smithi188_104537_object95786:head# 2024-04-01T19:36:34.356 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.356 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e80c59:::benchmark_data_smithi188_104537_object50457:head# 2024-04-01T19:36:34.356 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.356 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e82f54:::benchmark_data_smithi188_104537_object127727:head# 2024-04-01T19:36:34.356 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.356 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e92724:::benchmark_data_smithi188_104537_object109668:head# 2024-04-01T19:36:34.356 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.357 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e98f70:::benchmark_data_smithi188_104537_object93627:head# 2024-04-01T19:36:34.357 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.357 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e99fcd:::benchmark_data_smithi188_104537_object83830:head# 2024-04-01T19:36:34.357 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.358 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56e9f5ef:::benchmark_data_smithi188_104537_object113996:head# 2024-04-01T19:36:34.358 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.358 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56eaae53:::benchmark_data_smithi188_104537_object90190:head# 2024-04-01T19:36:34.358 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.358 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56eae3ed:::benchmark_data_smithi188_104537_object82403:head# 2024-04-01T19:36:34.358 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.358 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56eb065b:::benchmark_data_smithi188_104537_object30548:head# 2024-04-01T19:36:34.358 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.358 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ec1914:::benchmark_data_smithi188_104537_object147401:head# 2024-04-01T19:36:34.358 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.358 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ec2f8c:::benchmark_data_smithi188_104537_object73953:head# 2024-04-01T19:36:34.358 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.359 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ec5df8:::benchmark_data_smithi188_104537_object136974:head# 2024-04-01T19:36:34.359 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.359 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ec5e83:::benchmark_data_smithi188_104537_object88703:head# 2024-04-01T19:36:34.359 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.359 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ecc5ca:::benchmark_data_smithi188_104537_object83123:head# 2024-04-01T19:36:34.359 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.359 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ed3477:::benchmark_data_smithi188_104537_object109657:head# 2024-04-01T19:36:34.359 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.359 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ed4413:::benchmark_data_smithi188_104537_object82358:head# 2024-04-01T19:36:34.360 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.360 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ed9817:::benchmark_data_smithi188_104537_object105216:head# 2024-04-01T19:36:34.360 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.360 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ee64a2:::benchmark_data_smithi188_104537_object84301:head# 2024-04-01T19:36:34.360 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.361 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ee880c:::benchmark_data_smithi188_104537_object81535:head# 2024-04-01T19:36:34.361 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.362 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56eec2e0:::benchmark_data_smithi188_104537_object73416:head# 2024-04-01T19:36:34.362 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.362 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56eee54c:::benchmark_data_smithi188_104537_object142078:head# 2024-04-01T19:36:34.362 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.362 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ef4943:::benchmark_data_smithi188_104537_object63674:head# 2024-04-01T19:36:34.362 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.362 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ef83ae:::benchmark_data_smithi188_104537_object23886:head# 2024-04-01T19:36:34.362 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.362 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ef9f71:::benchmark_data_smithi188_104537_object13148:head# 2024-04-01T19:36:34.362 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.362 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56efae17:::benchmark_data_smithi188_104537_object54849:head# 2024-04-01T19:36:34.362 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.362 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f01063:::benchmark_data_smithi188_104537_object166615:head# 2024-04-01T19:36:34.362 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.363 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f01f67:::benchmark_data_smithi188_104537_object18973:head# 2024-04-01T19:36:34.363 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.363 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f044da:::benchmark_data_smithi188_104537_object113361:head# 2024-04-01T19:36:34.363 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.363 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f0d307:::benchmark_data_smithi188_104537_object144673:head# 2024-04-01T19:36:34.363 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.363 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f12854:::benchmark_data_smithi188_104537_object65263:head# 2024-04-01T19:36:34.363 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.365 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f1d1e5:::benchmark_data_smithi188_104537_object91851:head# 2024-04-01T19:36:34.365 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.365 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f326b3:::benchmark_data_smithi188_104537_object132968:head# 2024-04-01T19:36:34.365 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.365 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f3313a:::benchmark_data_smithi188_104537_object41815:head# 2024-04-01T19:36:34.365 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.365 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f331c8:::benchmark_data_smithi188_104537_object85414:head# 2024-04-01T19:36:34.365 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.365 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f36809:::benchmark_data_smithi188_104537_object168840:head# 2024-04-01T19:36:34.365 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.365 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f38a47:::benchmark_data_smithi188_104537_object74485:head# 2024-04-01T19:36:34.366 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.366 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f3ad52:::benchmark_data_smithi188_104537_object169870:head# 2024-04-01T19:36:34.366 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.366 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f40c4c:::benchmark_data_smithi188_104537_object86728:head# 2024-04-01T19:36:34.366 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.366 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f50df1:::benchmark_data_smithi188_104537_object169266:head# 2024-04-01T19:36:34.366 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.366 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f5394e:::benchmark_data_smithi188_104537_object103878:head# 2024-04-01T19:36:34.366 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.366 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f57747:::benchmark_data_smithi188_104537_object153597:head# 2024-04-01T19:36:34.366 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.366 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f58ae6:::benchmark_data_smithi188_104537_object89682:head# 2024-04-01T19:36:34.366 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.367 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f63934:::benchmark_data_smithi188_104537_object74566:head# 2024-04-01T19:36:34.367 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.368 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f65e6d:::benchmark_data_smithi188_104537_object35901:head# 2024-04-01T19:36:34.368 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.368 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f667ec:::benchmark_data_smithi188_104537_object123577:head# 2024-04-01T19:36:34.368 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.368 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f679fa:::benchmark_data_smithi188_104537_object135234:head# 2024-04-01T19:36:34.368 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.368 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f67ee8:::benchmark_data_smithi188_104537_object64369:head# 2024-04-01T19:36:34.368 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.368 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f69f40:::benchmark_data_smithi188_104537_object153515:head# 2024-04-01T19:36:34.369 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.369 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f75e20:::benchmark_data_smithi188_104537_object74243:head# 2024-04-01T19:36:34.369 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.369 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f8c0a9:::benchmark_data_smithi188_104537_object51290:head# 2024-04-01T19:36:34.369 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.369 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f95ea3:::benchmark_data_smithi188_104537_object109247:head# 2024-04-01T19:36:34.369 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.369 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56f96c41:::benchmark_data_smithi188_104537_object48648:head# 2024-04-01T19:36:34.369 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.369 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56fa161c:::benchmark_data_smithi188_104537_object112903:head# 2024-04-01T19:36:34.369 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.369 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56fa195a:::benchmark_data_smithi188_104537_object120863:head# 2024-04-01T19:36:34.369 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.370 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56fc21f5:::benchmark_data_smithi188_104537_object46564:head# 2024-04-01T19:36:34.370 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.370 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56fc87f6:::benchmark_data_smithi188_104537_object165553:head# 2024-04-01T19:36:34.370 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.371 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56fde0b1:::benchmark_data_smithi188_104537_object13104:head# 2024-04-01T19:36:34.371 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.371 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56fe6454:::benchmark_data_smithi188_104537_object33288:head# 2024-04-01T19:36:34.371 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.371 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56fec318:::benchmark_data_smithi188_104537_object71791:head# 2024-04-01T19:36:34.371 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.371 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56feebf5:::benchmark_data_smithi188_104537_object96221:head# 2024-04-01T19:36:34.371 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.375 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:56ff10bf:::benchmark_data_smithi188_104537_object73392:head# 2024-04-01T19:36:34.375 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.375 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57003154:::benchmark_data_smithi188_104537_object119557:head# 2024-04-01T19:36:34.375 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.375 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57012442:::benchmark_data_smithi188_104537_object136808:head# 2024-04-01T19:36:34.376 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.376 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57012d17:::benchmark_data_smithi188_104537_object62914:head# 2024-04-01T19:36:34.376 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.378 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:36:34.379 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5701b13d:::benchmark_data_smithi188_104537_object151099:head# 2024-04-01T19:36:34.380 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.380 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57021743:::benchmark_data_smithi188_104537_object140367:head# 2024-04-01T19:36:34.380 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.382 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:34.382 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:36:34.383 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57036662:::benchmark_data_smithi188_104537_object110988:head# 2024-04-01T19:36:34.383 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.383 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5703c501:::benchmark_data_smithi188_104537_object75351:head# 2024-04-01T19:36:34.383 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.383 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5703f521:::benchmark_data_smithi188_104537_object82719:head# 2024-04-01T19:36:34.383 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.383 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57046c9b:::benchmark_data_smithi188_104537_object65870:head# 2024-04-01T19:36:34.383 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.386 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5704e751:::benchmark_data_smithi188_104537_object51860:head# 2024-04-01T19:36:34.386 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.386 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5704fe5b:::benchmark_data_smithi188_104537_object32988:head# 2024-04-01T19:36:34.386 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.386 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57056a19:::benchmark_data_smithi188_104537_object162927:head# 2024-04-01T19:36:34.386 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.386 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57058223:::benchmark_data_smithi188_104537_object149489:head# 2024-04-01T19:36:34.386 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.387 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57062916:::benchmark_data_smithi188_104537_object133302:head# 2024-04-01T19:36:34.387 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.387 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:570695e0:::benchmark_data_smithi188_104537_object13527:head# 2024-04-01T19:36:34.387 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.387 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57069f37:::benchmark_data_smithi188_104537_object147111:head# 2024-04-01T19:36:34.387 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.387 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5706d1d7:::benchmark_data_smithi188_104537_object95587:head# 2024-04-01T19:36:34.387 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.387 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5706d8a8:::benchmark_data_smithi188_104537_object83116:head# 2024-04-01T19:36:34.387 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.387 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:570799a9:::benchmark_data_smithi188_104537_object96756:head# 2024-04-01T19:36:34.387 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.387 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5707b925:::benchmark_data_smithi188_104537_object94715:head# 2024-04-01T19:36:34.387 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.387 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5707ff85:::benchmark_data_smithi188_104537_object129999:head# 2024-04-01T19:36:34.388 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.389 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57083bea:::benchmark_data_smithi188_104537_object136688:head# 2024-04-01T19:36:34.389 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.389 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57093118:::benchmark_data_smithi188_104537_object14792:head# 2024-04-01T19:36:34.389 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.389 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5709500a:::benchmark_data_smithi188_104537_object81926:head# 2024-04-01T19:36:34.389 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.389 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5709d4f7:::benchmark_data_smithi188_104537_object166170:head# 2024-04-01T19:36:34.389 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.389 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:570a28dd:::benchmark_data_smithi188_104537_object12297:head# 2024-04-01T19:36:34.389 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.389 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:570a5001:::benchmark_data_smithi188_104537_object145904:head# 2024-04-01T19:36:34.390 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.390 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:570a999b:::benchmark_data_smithi188_104537_object69634:head# 2024-04-01T19:36:34.390 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.390 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:570b7aa6:::benchmark_data_smithi188_104537_object148499:head# 2024-04-01T19:36:34.390 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.390 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:570b8d9e:::benchmark_data_smithi188_104537_object110543:head# 2024-04-01T19:36:34.390 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.390 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:570c14c0:::benchmark_data_smithi188_104537_object142516:head# 2024-04-01T19:36:34.390 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.391 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:570c4916:::benchmark_data_smithi188_104537_object137792:head# 2024-04-01T19:36:34.391 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.391 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:570d0d4f:::benchmark_data_smithi188_104537_object50787:head# 2024-04-01T19:36:34.391 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.391 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:570d1e56:::benchmark_data_smithi188_104537_object49719:head# 2024-04-01T19:36:34.391 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.391 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:570d2bbb:::benchmark_data_smithi188_104537_object28335:head# 2024-04-01T19:36:34.392 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.392 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:570d739b:::benchmark_data_smithi188_104537_object151895:head# 2024-04-01T19:36:34.392 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.392 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:570d874c:::benchmark_data_smithi188_104537_object91545:head# 2024-04-01T19:36:34.392 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.392 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:570da92e:::benchmark_data_smithi188_104537_object151097:head# 2024-04-01T19:36:34.392 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.392 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:570e4c9f:::benchmark_data_smithi188_104537_object62142:head# 2024-04-01T19:36:34.392 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.392 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:570e6716:::benchmark_data_smithi188_104537_object128445:head# 2024-04-01T19:36:34.393 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.393 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:570f0e9c:::benchmark_data_smithi188_104537_object33203:head# 2024-04-01T19:36:34.393 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.396 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:570fef4f:::benchmark_data_smithi188_104537_object67818:head# 2024-04-01T19:36:34.396 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.397 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57100ab4:::benchmark_data_smithi188_104537_object51222:head# 2024-04-01T19:36:34.397 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.397 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:571012d2:::benchmark_data_smithi188_104537_object121089:head# 2024-04-01T19:36:34.397 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.401 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5710d409:::benchmark_data_smithi188_104537_object166645:head# 2024-04-01T19:36:34.401 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.401 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57114627:::benchmark_data_smithi188_104537_object86413:head# 2024-04-01T19:36:34.401 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.401 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:571171cb:::benchmark_data_smithi188_104537_object136629:head# 2024-04-01T19:36:34.402 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.402 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:571176f0:::benchmark_data_smithi188_104537_object35659:head# 2024-04-01T19:36:34.402 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.402 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5711bf1f:::benchmark_data_smithi188_104537_object168280:head# 2024-04-01T19:36:34.402 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.402 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57124d13:::benchmark_data_smithi188_104537_object160431:head# 2024-04-01T19:36:34.402 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.402 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5712e71b:::benchmark_data_smithi188_104537_object139314:head# 2024-04-01T19:36:34.402 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.402 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57134076:::benchmark_data_smithi188_104537_object122356:head# 2024-04-01T19:36:34.402 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.402 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57163bb8:::benchmark_data_smithi188_104537_object84995:head# 2024-04-01T19:36:34.402 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.402 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57165c75:::benchmark_data_smithi188_104537_object149967:head# 2024-04-01T19:36:34.402 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.403 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5716f7dc:::benchmark_data_smithi188_104537_object125312:head# 2024-04-01T19:36:34.403 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.403 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57173345:::benchmark_data_smithi188_104537_object103581:head# 2024-04-01T19:36:34.403 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.404 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57174f21:::benchmark_data_smithi188_104537_object151377:head# 2024-04-01T19:36:34.404 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.404 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5717a383:::benchmark_data_smithi188_104537_object121453:head# 2024-04-01T19:36:34.404 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.404 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5718e6b4:::benchmark_data_smithi188_104537_object20804:head# 2024-04-01T19:36:34.404 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.404 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5719b815:::benchmark_data_smithi188_104537_object40012:head# 2024-04-01T19:36:34.404 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.404 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5719cebd:::benchmark_data_smithi188_104537_object165427:head# 2024-04-01T19:36:34.405 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.405 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:571a4a57:::benchmark_data_smithi188_104537_object155887:head# 2024-04-01T19:36:34.405 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.405 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:571a598c:::benchmark_data_smithi188_104537_object167308:head# 2024-04-01T19:36:34.405 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.405 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:571a59b6:::benchmark_data_smithi188_104537_object168711:head# 2024-04-01T19:36:34.405 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.405 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:571a8022:::benchmark_data_smithi188_104537_object124630:head# 2024-04-01T19:36:34.405 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.407 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:571a96d0:::benchmark_data_smithi188_104537_object162951:head# 2024-04-01T19:36:34.407 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.408 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:571ad4b4:::benchmark_data_smithi188_104537_object155444:head# 2024-04-01T19:36:34.408 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.408 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:571af3d9:::benchmark_data_smithi188_104537_object123724:head# 2024-04-01T19:36:34.408 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.408 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:571b2363:::benchmark_data_smithi188_104537_object67780:head# 2024-04-01T19:36:34.408 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.408 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:571b70d1:::benchmark_data_smithi188_104537_object112037:head# 2024-04-01T19:36:34.408 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.408 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:571bbf9a:::benchmark_data_smithi188_104537_object107084:head# 2024-04-01T19:36:34.408 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.408 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:571c0d33:::benchmark_data_smithi188_104537_object126775:head# 2024-04-01T19:36:34.408 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.408 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:571dcada:::benchmark_data_smithi188_104537_object124219:head# 2024-04-01T19:36:34.408 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.409 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:571e270d:::benchmark_data_smithi188_104537_object71988:head# 2024-04-01T19:36:34.409 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.409 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:571f07dd:::benchmark_data_smithi188_104537_object147823:head# 2024-04-01T19:36:34.409 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.409 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:571f16d6:::benchmark_data_smithi188_104537_object171650:head# 2024-04-01T19:36:34.409 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.409 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:571f7874:::benchmark_data_smithi188_104537_object113634:head# 2024-04-01T19:36:34.409 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.409 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:571f9723:::benchmark_data_smithi188_104537_object123958:head# 2024-04-01T19:36:34.409 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.412 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57208e5c:::benchmark_data_smithi188_104537_object37722:head# 2024-04-01T19:36:34.412 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.412 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5720b43d:::benchmark_data_smithi188_104537_object28116:head# 2024-04-01T19:36:34.413 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.413 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5720f2cb:::benchmark_data_smithi188_104537_object126098:head# 2024-04-01T19:36:34.413 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.413 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57220c08:::benchmark_data_smithi188_104537_object30065:head# 2024-04-01T19:36:34.413 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.413 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5722359d:::benchmark_data_smithi188_104537_object44473:head# 2024-04-01T19:36:34.413 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.413 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5722864e:::benchmark_data_smithi188_104537_object36144:head# 2024-04-01T19:36:34.413 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.413 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5722b2d0:::benchmark_data_smithi188_104537_object71537:head# 2024-04-01T19:36:34.413 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.413 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57232451:::benchmark_data_smithi188_104537_object60825:head# 2024-04-01T19:36:34.413 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.414 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57236390:::benchmark_data_smithi188_104537_object69503:head# 2024-04-01T19:36:34.414 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.414 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57237bcc:::benchmark_data_smithi188_104537_object159591:head# 2024-04-01T19:36:34.414 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.414 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5723a150:::benchmark_data_smithi188_104537_object27385:head# 2024-04-01T19:36:34.414 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.414 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57241985:::benchmark_data_smithi188_104537_object16803:head# 2024-04-01T19:36:34.414 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.414 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:572429c3:::benchmark_data_smithi188_104537_object116348:head# 2024-04-01T19:36:34.414 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.414 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57243874:::benchmark_data_smithi188_104537_object163448:head# 2024-04-01T19:36:34.414 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.414 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57245cc6:::benchmark_data_smithi188_104537_object33381:head# 2024-04-01T19:36:34.414 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.415 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:572530f7:::benchmark_data_smithi188_104537_object23557:head# 2024-04-01T19:36:34.415 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.415 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5725a848:::benchmark_data_smithi188_104537_object61398:head# 2024-04-01T19:36:34.415 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.415 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57262245:::benchmark_data_smithi188_104537_object63446:head# 2024-04-01T19:36:34.415 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.419 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:572644f8:::benchmark_data_smithi188_104537_object145138:head# 2024-04-01T19:36:34.419 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.419 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:572681b8:::benchmark_data_smithi188_104537_object133627:head# 2024-04-01T19:36:34.419 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.419 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57270935:::benchmark_data_smithi188_104537_object56749:head# 2024-04-01T19:36:34.419 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.419 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57285ca8:::benchmark_data_smithi188_104537_object27367:head# 2024-04-01T19:36:34.420 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.420 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5728b105:::benchmark_data_smithi188_104537_object145997:head# 2024-04-01T19:36:34.420 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.420 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:572930fc:::benchmark_data_smithi188_104537_object157794:head# 2024-04-01T19:36:34.420 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.420 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5729b1b6:::benchmark_data_smithi188_104537_object125689:head# 2024-04-01T19:36:34.420 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.420 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:572a63fe:::benchmark_data_smithi188_104537_object159400:head# 2024-04-01T19:36:34.420 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.420 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:572ad15e:::benchmark_data_smithi188_104537_object115113:head# 2024-04-01T19:36:34.420 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.420 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:572b4d4e:::benchmark_data_smithi188_104537_object41232:head# 2024-04-01T19:36:34.420 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.421 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:572b69a3:::benchmark_data_smithi188_104537_object92474:head# 2024-04-01T19:36:34.421 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.421 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:572b9899:::benchmark_data_smithi188_104537_object130421:head# 2024-04-01T19:36:34.421 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.421 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:572b9955:::benchmark_data_smithi188_104537_object168618:head# 2024-04-01T19:36:34.421 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.421 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:572bad07:::benchmark_data_smithi188_104537_object38095:head# 2024-04-01T19:36:34.421 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.421 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:572bd4e6:::benchmark_data_smithi188_104537_object12231:head# 2024-04-01T19:36:34.421 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.421 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:572c1255:::benchmark_data_smithi188_104537_object13540:head# 2024-04-01T19:36:34.421 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.421 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:572c434d:::benchmark_data_smithi188_104537_object148371:head# 2024-04-01T19:36:34.421 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.421 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:572c6d51:::benchmark_data_smithi188_104537_object133061:head# 2024-04-01T19:36:34.422 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.422 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:572c70e5:::benchmark_data_smithi188_104537_object79209:head# 2024-04-01T19:36:34.422 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.422 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:572caa9d:::benchmark_data_smithi188_104537_object71660:head# 2024-04-01T19:36:34.422 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.422 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:572cd1ec:::benchmark_data_smithi188_104537_object13276:head# 2024-04-01T19:36:34.422 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.422 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:572d01ce:::benchmark_data_smithi188_104537_object14265:head# 2024-04-01T19:36:34.422 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.422 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:572e9ab9:::benchmark_data_smithi188_104537_object141186:head# 2024-04-01T19:36:34.422 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.422 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:572ee0e0:::benchmark_data_smithi188_104537_object101441:head# 2024-04-01T19:36:34.422 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.423 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:572f7a8c:::benchmark_data_smithi188_104537_object116729:head# 2024-04-01T19:36:34.423 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.423 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:572fcaad:::benchmark_data_smithi188_104537_object45610:head# 2024-04-01T19:36:34.423 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.427 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5730a1ea:::benchmark_data_smithi188_104537_object53963:head# 2024-04-01T19:36:34.427 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.427 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57315d48:::benchmark_data_smithi188_104537_object170862:head# 2024-04-01T19:36:34.427 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.427 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:573184ab:::benchmark_data_smithi188_104537_object104156:head# 2024-04-01T19:36:34.427 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.427 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57324163:::benchmark_data_smithi188_104537_object83214:head# 2024-04-01T19:36:34.427 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.427 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5732ebcc:::benchmark_data_smithi188_104537_object169314:head# 2024-04-01T19:36:34.428 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.428 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5732ef4d:::benchmark_data_smithi188_104537_object76604:head# 2024-04-01T19:36:34.428 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.428 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:573306b8:::benchmark_data_smithi188_104537_object18482:head# 2024-04-01T19:36:34.428 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.428 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5733147b:::benchmark_data_smithi188_104537_object129055:head# 2024-04-01T19:36:34.428 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.428 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:573390ca:::benchmark_data_smithi188_104537_object46286:head# 2024-04-01T19:36:34.428 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.428 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5733bfb2:::benchmark_data_smithi188_104537_object146497:head# 2024-04-01T19:36:34.428 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.428 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5733f41d:::benchmark_data_smithi188_104537_object69847:head# 2024-04-01T19:36:34.428 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.429 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57346ceb:::benchmark_data_smithi188_104537_object82119:head# 2024-04-01T19:36:34.429 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.429 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:573471e6:::benchmark_data_smithi188_104537_object157973:head# 2024-04-01T19:36:34.429 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.429 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5734ec9b:::benchmark_data_smithi188_104537_object40403:head# 2024-04-01T19:36:34.429 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.429 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:573524cd:::benchmark_data_smithi188_104537_object67284:head# 2024-04-01T19:36:34.429 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.429 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57353a1d:::benchmark_data_smithi188_104537_object49355:head# 2024-04-01T19:36:34.429 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.429 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5735eacb:::benchmark_data_smithi188_104537_object35979:head# 2024-04-01T19:36:34.429 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.429 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5736c695:::benchmark_data_smithi188_104537_object36253:head# 2024-04-01T19:36:34.429 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.430 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:573726c9:::benchmark_data_smithi188_104537_object36633:head# 2024-04-01T19:36:34.430 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.430 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5737b665:::benchmark_data_smithi188_104537_object146036:head# 2024-04-01T19:36:34.430 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.430 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57382a82:::benchmark_data_smithi188_104537_object34070:head# 2024-04-01T19:36:34.430 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.430 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57382d0f:::benchmark_data_smithi188_104537_object40697:head# 2024-04-01T19:36:34.430 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.430 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:573898be:::benchmark_data_smithi188_104537_object69277:head# 2024-04-01T19:36:34.430 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.430 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5738f3dd:::benchmark_data_smithi188_104537_object121435:head# 2024-04-01T19:36:34.430 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.430 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:573affd5:::benchmark_data_smithi188_104537_object21003:head# 2024-04-01T19:36:34.430 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.431 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:573b4639:::benchmark_data_smithi188_104537_object43472:head# 2024-04-01T19:36:34.431 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.431 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:573baf32:::benchmark_data_smithi188_104537_object61933:head# 2024-04-01T19:36:34.431 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.431 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:573bba9f:::benchmark_data_smithi188_104537_object108734:head# 2024-04-01T19:36:34.431 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.431 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:573bdd41:::benchmark_data_smithi188_104537_object77462:head# 2024-04-01T19:36:34.431 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.436 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:573c2bdd:::benchmark_data_smithi188_104537_object100411:head# 2024-04-01T19:36:34.436 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.436 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:573c7426:::benchmark_data_smithi188_104537_object87298:head# 2024-04-01T19:36:34.436 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.436 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:573dd3d1:::benchmark_data_smithi188_104537_object150031:head# 2024-04-01T19:36:34.436 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.436 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:573e0879:::benchmark_data_smithi188_104537_object153559:head# 2024-04-01T19:36:34.436 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.436 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:573e6ef7:::benchmark_data_smithi188_104537_object139068:head# 2024-04-01T19:36:34.437 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.437 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:573efe3d:::benchmark_data_smithi188_104537_object116435:head# 2024-04-01T19:36:34.437 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.437 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:573f3b5e:::benchmark_data_smithi188_104537_object31343:head# 2024-04-01T19:36:34.437 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.437 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:573f79b4:::benchmark_data_smithi188_104537_object151554:head# 2024-04-01T19:36:34.437 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.437 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57411b8b:::benchmark_data_smithi188_104537_object116971:head# 2024-04-01T19:36:34.437 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.437 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57412371:::benchmark_data_smithi188_104537_object34624:head# 2024-04-01T19:36:34.437 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.437 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57413a80:::benchmark_data_smithi188_104537_object71021:head# 2024-04-01T19:36:34.437 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.437 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5741b266:::benchmark_data_smithi188_104537_object152053:head# 2024-04-01T19:36:34.437 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.438 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5741c36d:::benchmark_data_smithi188_104537_object79155:head# 2024-04-01T19:36:34.438 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.438 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5741ff39:::benchmark_data_smithi188_104537_object29827:head# 2024-04-01T19:36:34.438 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.438 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57421924:::benchmark_data_smithi188_104537_object21544:head# 2024-04-01T19:36:34.438 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.438 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57421bcc:::benchmark_data_smithi188_104537_object157029:head# 2024-04-01T19:36:34.438 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.438 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57422d43:::benchmark_data_smithi188_104537_object152030:head# 2024-04-01T19:36:34.438 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.438 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57424169:::benchmark_data_smithi188_104537_object99154:head# 2024-04-01T19:36:34.438 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.438 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5742ee06:::benchmark_data_smithi188_104537_object67828:head# 2024-04-01T19:36:34.439 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.439 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5743386f:::benchmark_data_smithi188_104537_object118323:head# 2024-04-01T19:36:34.439 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.439 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5743f5a9:::benchmark_data_smithi188_104537_object122498:head# 2024-04-01T19:36:34.439 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.439 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5743fb42:::benchmark_data_smithi188_104537_object12828:head# 2024-04-01T19:36:34.439 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.439 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5745dc7b:::benchmark_data_smithi188_104537_object116541:head# 2024-04-01T19:36:34.439 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.439 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57461713:::benchmark_data_smithi188_104537_object86061:head# 2024-04-01T19:36:34.439 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.439 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5746d559:::benchmark_data_smithi188_104537_object101465:head# 2024-04-01T19:36:34.439 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.439 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5746ed58:::benchmark_data_smithi188_104537_object69819:head# 2024-04-01T19:36:34.439 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.439 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5747869f:::benchmark_data_smithi188_104537_object133222:head# 2024-04-01T19:36:34.440 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.440 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5747a9b6:::benchmark_data_smithi188_104537_object21174:head# 2024-04-01T19:36:34.440 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.440 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:574851f6:::benchmark_data_smithi188_104537_object169121:head# 2024-04-01T19:36:34.440 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.440 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5748556e:::benchmark_data_smithi188_104537_object85618:head# 2024-04-01T19:36:34.440 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.440 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57499e57:::benchmark_data_smithi188_104537_object62971:head# 2024-04-01T19:36:34.440 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.440 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:574aa2eb:::benchmark_data_smithi188_104537_object98290:head# 2024-04-01T19:36:34.440 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.440 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:574ade64:::benchmark_data_smithi188_104537_object166496:head# 2024-04-01T19:36:34.440 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.440 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:574b26aa:::benchmark_data_smithi188_104537_object169488:head# 2024-04-01T19:36:34.440 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.441 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:574b5f40:::benchmark_data_smithi188_104537_object70641:head# 2024-04-01T19:36:34.441 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.444 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:574bcf67:::benchmark_data_smithi188_104537_object64998:head# 2024-04-01T19:36:34.444 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.444 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:574bd3a8:::benchmark_data_smithi188_104537_object54269:head# 2024-04-01T19:36:34.444 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.444 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:574bd8d9:::benchmark_data_smithi188_104537_object94390:head# 2024-04-01T19:36:34.444 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.444 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:574be10e:::benchmark_data_smithi188_104537_object95986:head# 2024-04-01T19:36:34.444 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.444 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:574bff8e:::benchmark_data_smithi188_104537_object157416:head# 2024-04-01T19:36:34.444 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.444 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:574cd2e1:::benchmark_data_smithi188_104537_object77717:head# 2024-04-01T19:36:34.444 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.445 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:574d16cb:::benchmark_data_smithi188_104537_object98019:head# 2024-04-01T19:36:34.445 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.445 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:574d1bf8:::benchmark_data_smithi188_104537_object99299:head# 2024-04-01T19:36:34.445 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.445 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:574d775f:::benchmark_data_smithi188_104537_object65115:head# 2024-04-01T19:36:34.445 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.445 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:574d9e75:::benchmark_data_smithi188_104537_object49958:head# 2024-04-01T19:36:34.445 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.445 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:574daeb3:::benchmark_data_smithi188_104537_object68564:head# 2024-04-01T19:36:34.445 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.445 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:574e443e:::benchmark_data_smithi188_104537_object151023:head# 2024-04-01T19:36:34.445 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.445 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:574e7831:::benchmark_data_smithi188_104537_object161023:head# 2024-04-01T19:36:34.445 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.445 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:574e85a5:::benchmark_data_smithi188_104537_object134164:head# 2024-04-01T19:36:34.446 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.446 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:574e85cb:::benchmark_data_smithi188_104537_object66885:head# 2024-04-01T19:36:34.446 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.446 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:574fea8e:::benchmark_data_smithi188_104537_object92166:head# 2024-04-01T19:36:34.446 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.446 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57500f29:::benchmark_data_smithi188_104537_object44270:head# 2024-04-01T19:36:34.446 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.446 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57505041:::benchmark_data_smithi188_104537_object28948:head# 2024-04-01T19:36:34.446 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.446 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:575062cc:::benchmark_data_smithi188_104537_object38882:head# 2024-04-01T19:36:34.446 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.446 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57508cf3:::benchmark_data_smithi188_104537_object47058:head# 2024-04-01T19:36:34.446 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.446 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:575094bc:::benchmark_data_smithi188_104537_object80297:head# 2024-04-01T19:36:34.446 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.446 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57510743:::benchmark_data_smithi188_104537_object72257:head# 2024-04-01T19:36:34.447 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.447 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57517fbe:::benchmark_data_smithi188_104537_object32180:head# 2024-04-01T19:36:34.447 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.447 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57527940:::benchmark_data_smithi188_104537_object143825:head# 2024-04-01T19:36:34.447 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.447 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5752bddc:::benchmark_data_smithi188_104537_object39809:head# 2024-04-01T19:36:34.447 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.447 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57533168:::benchmark_data_smithi188_104537_object92526:head# 2024-04-01T19:36:34.447 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.447 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57542e24:::benchmark_data_smithi188_104537_object133926:head# 2024-04-01T19:36:34.447 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.447 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57545377:::benchmark_data_smithi188_104537_object105498:head# 2024-04-01T19:36:34.447 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.447 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:575522e5:::benchmark_data_smithi188_104537_object157534:head# 2024-04-01T19:36:34.447 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.450 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5755668c:::benchmark_data_smithi188_104537_object15433:head# 2024-04-01T19:36:34.450 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.450 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57557dce:::benchmark_data_smithi188_104537_object137053:head# 2024-04-01T19:36:34.450 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.450 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5755cd89:::benchmark_data_smithi188_104537_object155585:head# 2024-04-01T19:36:34.450 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.450 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57560a73:::benchmark_data_smithi188_104537_object28440:head# 2024-04-01T19:36:34.450 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.450 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57568d2c:::benchmark_data_smithi188_104537_object31049:head# 2024-04-01T19:36:34.450 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.450 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5757050b:::benchmark_data_smithi188_104537_object116848:head# 2024-04-01T19:36:34.450 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.450 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5757488d:::benchmark_data_smithi188_104537_object68332:head# 2024-04-01T19:36:34.451 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.451 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:575754ad:::benchmark_data_smithi188_104537_object169046:head# 2024-04-01T19:36:34.451 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.451 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5757bc01:::benchmark_data_smithi188_104537_object133226:head# 2024-04-01T19:36:34.451 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.451 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57582fea:::benchmark_data_smithi188_104537_object124457:head# 2024-04-01T19:36:34.451 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.451 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5758583d:::benchmark_data_smithi188_104537_object140692:head# 2024-04-01T19:36:34.451 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.451 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57587df0:::benchmark_data_smithi188_104537_object89514:head# 2024-04-01T19:36:34.451 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.451 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57591499:::benchmark_data_smithi188_104537_object19605:head# 2024-04-01T19:36:34.451 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.451 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57599dbe:::benchmark_data_smithi188_104537_object105752:head# 2024-04-01T19:36:34.451 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.452 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5759c1fa:::benchmark_data_smithi188_104537_object66167:head# 2024-04-01T19:36:34.452 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.452 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:575a361e:::benchmark_data_smithi188_104537_object139479:head# 2024-04-01T19:36:34.452 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.452 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:575a464d:::benchmark_data_smithi188_104537_object94632:head# 2024-04-01T19:36:34.452 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.452 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:575a6bae:::benchmark_data_smithi188_104537_object102244:head# 2024-04-01T19:36:34.452 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.452 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:575b5cc1:::benchmark_data_smithi188_104537_object158830:head# 2024-04-01T19:36:34.452 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.452 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:575b7529:::benchmark_data_smithi188_104537_object133012:head# 2024-04-01T19:36:34.452 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.452 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:575bfe55:::benchmark_data_smithi188_104537_object134762:head# 2024-04-01T19:36:34.452 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.453 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:575c09c2:::benchmark_data_smithi188_104537_object80277:head# 2024-04-01T19:36:34.453 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.453 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:575c4eaf:::benchmark_data_smithi188_104537_object163093:head# 2024-04-01T19:36:34.453 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.453 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:575c566e:::benchmark_data_smithi188_104537_object47218:head# 2024-04-01T19:36:34.453 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.453 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:575c845d:::benchmark_data_smithi188_104537_object38392:head# 2024-04-01T19:36:34.453 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.456 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:575c84f1:::benchmark_data_smithi188_104537_object161818:head# 2024-04-01T19:36:34.456 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.456 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:575cb5bb:::benchmark_data_smithi188_104537_object171484:head# 2024-04-01T19:36:34.456 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.456 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:575cced9:::benchmark_data_smithi188_104537_object170340:head# 2024-04-01T19:36:34.456 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.456 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:575d7630:::benchmark_data_smithi188_104537_object152254:head# 2024-04-01T19:36:34.456 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.456 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:575df3bf:::benchmark_data_smithi188_104537_object89629:head# 2024-04-01T19:36:34.456 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.456 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:575df6e6:::benchmark_data_smithi188_104537_object27009:head# 2024-04-01T19:36:34.456 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.456 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:575e3d2e:::benchmark_data_smithi188_104537_object51510:head# 2024-04-01T19:36:34.456 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.456 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:575e4156:::benchmark_data_smithi188_104537_object94190:head# 2024-04-01T19:36:34.457 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.457 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:575f8a0d:::benchmark_data_smithi188_104537_object146146:head# 2024-04-01T19:36:34.457 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.457 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:575fbafa:::benchmark_data_smithi188_104537_object51447:head# 2024-04-01T19:36:34.457 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.457 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5760314e:::benchmark_data_smithi188_104537_object13058:head# 2024-04-01T19:36:34.457 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.457 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57612193:::benchmark_data_smithi188_104537_object136255:head# 2024-04-01T19:36:34.457 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.457 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5761bf79:::benchmark_data_smithi188_104537_object14593:head# 2024-04-01T19:36:34.457 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.457 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5761f8da:::benchmark_data_smithi188_104537_object105933:head# 2024-04-01T19:36:34.457 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.458 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57622385:::benchmark_data_smithi188_104537_object121684:head# 2024-04-01T19:36:34.458 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.458 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5762bd10:::benchmark_data_smithi188_104537_object65764:head# 2024-04-01T19:36:34.458 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.458 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5762ddba:::benchmark_data_smithi188_104537_object111971:head# 2024-04-01T19:36:34.458 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.460 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5762fec3:::benchmark_data_smithi188_104537_object141936:head# 2024-04-01T19:36:34.460 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.460 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:576311ef:::benchmark_data_smithi188_104537_object72641:head# 2024-04-01T19:36:34.460 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.460 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:576323e4:::benchmark_data_smithi188_104537_object69506:head# 2024-04-01T19:36:34.460 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.460 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:576392a7:::benchmark_data_smithi188_104537_object163531:head# 2024-04-01T19:36:34.460 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.460 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5763ca4e:::benchmark_data_smithi188_104537_object39158:head# 2024-04-01T19:36:34.460 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.460 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57642a2a:::benchmark_data_smithi188_104537_object120229:head# 2024-04-01T19:36:34.460 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.461 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:576449f2:::benchmark_data_smithi188_104537_object135257:head# 2024-04-01T19:36:34.461 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.461 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57645979:::benchmark_data_smithi188_104537_object58282:head# 2024-04-01T19:36:34.461 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.461 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:576470ce:::benchmark_data_smithi188_104537_object68214:head# 2024-04-01T19:36:34.461 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.461 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57649929:::benchmark_data_smithi188_104537_object150162:head# 2024-04-01T19:36:34.461 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.461 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57651834:::benchmark_data_smithi188_104537_object26003:head# 2024-04-01T19:36:34.461 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.461 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5765792a:::benchmark_data_smithi188_104537_object170931:head# 2024-04-01T19:36:34.461 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.461 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5765a525:::benchmark_data_smithi188_104537_object79818:head# 2024-04-01T19:36:34.461 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.462 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5765dcf5:::benchmark_data_smithi188_104537_object50631:head# 2024-04-01T19:36:34.462 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.462 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:576641fe:::benchmark_data_smithi188_104537_object39529:head# 2024-04-01T19:36:34.462 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.463 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5766875a:::benchmark_data_smithi188_104537_object136433:head# 2024-04-01T19:36:34.463 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.463 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5766e886:::benchmark_data_smithi188_104537_object56029:head# 2024-04-01T19:36:34.464 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.464 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57677f96:::benchmark_data_smithi188_104537_object42176:head# 2024-04-01T19:36:34.464 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.464 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5767a4ac:::benchmark_data_smithi188_104537_object153481:head# 2024-04-01T19:36:34.464 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.464 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:576898be:::benchmark_data_smithi188_104537_object107774:head# 2024-04-01T19:36:34.464 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.464 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5768cdee:::benchmark_data_smithi188_104537_object52076:head# 2024-04-01T19:36:34.464 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.464 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5768ea7b:::benchmark_data_smithi188_104537_object138900:head# 2024-04-01T19:36:34.464 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.464 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57693f02:::benchmark_data_smithi188_104537_object52831:head# 2024-04-01T19:36:34.464 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.464 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57696780:::benchmark_data_smithi188_104537_object53535:head# 2024-04-01T19:36:34.465 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.465 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:576a2ed8:::benchmark_data_smithi188_104537_object158250:head# 2024-04-01T19:36:34.465 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.465 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:576b1fdb:::benchmark_data_smithi188_104537_object166409:head# 2024-04-01T19:36:34.465 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.465 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:576b8410:::benchmark_data_smithi188_104537_object63373:head# 2024-04-01T19:36:34.465 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.465 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:576c9201:::benchmark_data_smithi188_104537_object122477:head# 2024-04-01T19:36:34.465 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.468 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:576c9eb7:::benchmark_data_smithi188_104537_object71875:head# 2024-04-01T19:36:34.468 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.468 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:576ce8cf:::benchmark_data_smithi188_104537_object119813:head# 2024-04-01T19:36:34.468 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.468 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:576d7610:::benchmark_data_smithi188_104537_object79595:head# 2024-04-01T19:36:34.468 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.469 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:576e7ae5:::benchmark_data_smithi188_104537_object167766:head# 2024-04-01T19:36:34.469 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.469 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:576eaac9:::benchmark_data_smithi188_104537_object41407:head# 2024-04-01T19:36:34.469 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.469 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:576f2ba0:::benchmark_data_smithi188_104537_object63083:head# 2024-04-01T19:36:34.469 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.469 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:576ff101:::benchmark_data_smithi188_104537_object27158:head# 2024-04-01T19:36:34.469 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.469 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57705488:::benchmark_data_smithi188_104537_object169016:head# 2024-04-01T19:36:34.469 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.469 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577109d8:::benchmark_data_smithi188_104537_object116582:head# 2024-04-01T19:36:34.469 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.469 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577195d4:::benchmark_data_smithi188_104537_object82922:head# 2024-04-01T19:36:34.469 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.470 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57721caa:::benchmark_data_smithi188_104537_object124848:head# 2024-04-01T19:36:34.470 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.470 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577223cb:::benchmark_data_smithi188_104537_object138782:head# 2024-04-01T19:36:34.470 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.470 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57725690:::benchmark_data_smithi188_104537_object111525:head# 2024-04-01T19:36:34.470 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.470 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577287e3:::benchmark_data_smithi188_104537_object152749:head# 2024-04-01T19:36:34.470 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.470 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57740ce1:::benchmark_data_smithi188_104537_object94384:head# 2024-04-01T19:36:34.470 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.470 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5774b4f1:::benchmark_data_smithi188_104537_object116836:head# 2024-04-01T19:36:34.470 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.470 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5774baec:::benchmark_data_smithi188_104537_object170435:head# 2024-04-01T19:36:34.470 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.471 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5775d63d:::benchmark_data_smithi188_104537_object56342:head# 2024-04-01T19:36:34.471 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.471 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57764a68:::benchmark_data_smithi188_104537_object52143:head# 2024-04-01T19:36:34.471 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.472 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5776b9e4:::benchmark_data_smithi188_104537_object147488:head# 2024-04-01T19:36:34.472 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.472 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5776ccd7:::benchmark_data_smithi188_104537_object75722:head# 2024-04-01T19:36:34.472 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.473 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5776f07f:::benchmark_data_smithi188_104537_object124701:head# 2024-04-01T19:36:34.473 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.473 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577766ee:::benchmark_data_smithi188_104537_object44754:head# 2024-04-01T19:36:34.473 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.473 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5777a04c:::benchmark_data_smithi188_104537_object57228:head# 2024-04-01T19:36:34.473 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.473 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577821f5:::benchmark_data_smithi188_104537_object165592:head# 2024-04-01T19:36:34.473 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.473 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57784ee0:::benchmark_data_smithi188_104537_object26874:head# 2024-04-01T19:36:34.473 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.473 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57789eca:::benchmark_data_smithi188_104537_object24393:head# 2024-04-01T19:36:34.473 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.473 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5778acfc:::benchmark_data_smithi188_104537_object86190:head# 2024-04-01T19:36:34.473 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.474 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5779a6a7:::benchmark_data_smithi188_104537_object106019:head# 2024-04-01T19:36:34.474 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.474 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577a3734:::benchmark_data_smithi188_104537_object111006:head# 2024-04-01T19:36:34.474 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.476 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577a7a4f:::benchmark_data_smithi188_104537_object100451:head# 2024-04-01T19:36:34.476 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.476 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577a94ad:::benchmark_data_smithi188_104537_object40534:head# 2024-04-01T19:36:34.476 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.476 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577ac598:::benchmark_data_smithi188_104537_object130060:head# 2024-04-01T19:36:34.476 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.476 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577b75f1:::benchmark_data_smithi188_104537_object22990:head# 2024-04-01T19:36:34.476 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.476 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577baeb7:::benchmark_data_smithi188_104537_object125873:head# 2024-04-01T19:36:34.477 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.477 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577bdbaf:::benchmark_data_smithi188_104537_object111396:head# 2024-04-01T19:36:34.477 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.477 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577bdbf2:::benchmark_data_smithi188_104537_object73991:head# 2024-04-01T19:36:34.477 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.477 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577c04a8:::benchmark_data_smithi188_104537_object11002:head# 2024-04-01T19:36:34.477 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.477 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577c088c:::benchmark_data_smithi188_104537_object154614:head# 2024-04-01T19:36:34.477 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.477 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577c10a4:::benchmark_data_smithi188_104537_object124776:head# 2024-04-01T19:36:34.477 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.477 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577c3160:::benchmark_data_smithi188_104537_object94506:head# 2024-04-01T19:36:34.477 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.477 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577c9366:::benchmark_data_smithi188_104537_object153675:head# 2024-04-01T19:36:34.477 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.478 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577ca324:::benchmark_data_smithi188_104537_object121736:head# 2024-04-01T19:36:34.478 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.478 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577cc325:::benchmark_data_smithi188_104537_object89581:head# 2024-04-01T19:36:34.478 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.478 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577d41ff:::benchmark_data_smithi188_104537_object67179:head# 2024-04-01T19:36:34.478 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.478 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577d9b56:::benchmark_data_smithi188_104537_object128735:head# 2024-04-01T19:36:34.478 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.478 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577da86a:::benchmark_data_smithi188_104537_object157168:head# 2024-04-01T19:36:34.478 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.478 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577e1373:::benchmark_data_smithi188_104537_object47853:head# 2024-04-01T19:36:34.478 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.479 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577e370f:::benchmark_data_smithi188_104537_object147016:head# 2024-04-01T19:36:34.479 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.479 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577eb494:::benchmark_data_smithi188_104537_object107184:head# 2024-04-01T19:36:34.479 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.479 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577ebef9:::benchmark_data_smithi188_104537_object26839:head# 2024-04-01T19:36:34.480 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.480 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577ecf0b:::benchmark_data_smithi188_104537_object38762:head# 2024-04-01T19:36:34.480 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.480 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577efb76:::benchmark_data_smithi188_104537_object67604:head# 2024-04-01T19:36:34.480 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.480 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577f2aa3:::benchmark_data_smithi188_104537_object20017:head# 2024-04-01T19:36:34.480 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.480 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577f92d1:::benchmark_data_smithi188_104537_object17027:head# 2024-04-01T19:36:34.480 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.480 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577fc290:::benchmark_data_smithi188_104537_object18131:head# 2024-04-01T19:36:34.480 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.480 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:577fe5d1:::benchmark_data_smithi188_104537_object16691:head# 2024-04-01T19:36:34.480 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.480 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57808e72:::benchmark_data_smithi188_104537_object85642:head# 2024-04-01T19:36:34.480 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.481 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57811f14:::benchmark_data_smithi188_104537_object137922:head# 2024-04-01T19:36:34.481 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.481 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57817c21:::benchmark_data_smithi188_104537_object60329:head# 2024-04-01T19:36:34.481 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.482 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5781a838:::benchmark_data_smithi188_104537_object165152:head# 2024-04-01T19:36:34.483 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.483 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57821ded:::benchmark_data_smithi188_104537_object24128:head# 2024-04-01T19:36:34.483 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.483 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:578232d2:::benchmark_data_smithi188_104537_object31854:head# 2024-04-01T19:36:34.483 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.483 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57828472:::benchmark_data_smithi188_104537_object51057:head# 2024-04-01T19:36:34.483 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.483 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57828934:::benchmark_data_smithi188_104537_object169233:head# 2024-04-01T19:36:34.483 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.483 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5782cf4b:::benchmark_data_smithi188_104537_object26586:head# 2024-04-01T19:36:34.483 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.483 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57830964:::benchmark_data_smithi188_104537_object55260:head# 2024-04-01T19:36:34.483 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.483 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5783174c:::benchmark_data_smithi188_104537_object55128:head# 2024-04-01T19:36:34.484 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.484 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:578320e7:::benchmark_data_smithi188_104537_object65007:head# 2024-04-01T19:36:34.484 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.484 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:578350c7:::benchmark_data_smithi188_104537_object90850:head# 2024-04-01T19:36:34.484 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.484 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57840dd7:::benchmark_data_smithi188_104537_object17889:head# 2024-04-01T19:36:34.484 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.484 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57844919:::benchmark_data_smithi188_104537_object37467:head# 2024-04-01T19:36:34.484 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.484 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:36:34.486 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57850b51:::benchmark_data_smithi188_104537_object20385:head# 2024-04-01T19:36:34.486 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.486 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57851305:::benchmark_data_smithi188_104537_object93272:head# 2024-04-01T19:36:34.486 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.486 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5785580b:::benchmark_data_smithi188_104537_object32056:head# 2024-04-01T19:36:34.486 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.486 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5785de4e:::benchmark_data_smithi188_104537_object68448:head# 2024-04-01T19:36:34.487 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.487 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5785f361:::benchmark_data_smithi188_104537_object43989:head# 2024-04-01T19:36:34.487 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.487 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5786531a:::benchmark_data_smithi188_104537_object101544:head# 2024-04-01T19:36:34.487 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.487 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57866152:::benchmark_data_smithi188_104537_object68575:head# 2024-04-01T19:36:34.487 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.487 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57866678:::benchmark_data_smithi188_104537_object114660:head# 2024-04-01T19:36:34.487 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.488 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57867416:::benchmark_data_smithi188_104537_object133204:head# 2024-04-01T19:36:34.488 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.488 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5786b4fd:::benchmark_data_smithi188_104537_object164420:head# 2024-04-01T19:36:34.488 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.488 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57870dc7:::benchmark_data_smithi188_104537_object152415:head# 2024-04-01T19:36:34.488 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.488 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57873b95:::benchmark_data_smithi188_104537_object117575:head# 2024-04-01T19:36:34.488 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.488 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5788a65e:::benchmark_data_smithi188_104537_object11156:head# 2024-04-01T19:36:34.488 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.489 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5788bc1b:::benchmark_data_smithi188_104537_object72110:head# 2024-04-01T19:36:34.489 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.489 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5788ccd7:::benchmark_data_smithi188_104537_object14429:head# 2024-04-01T19:36:34.489 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.489 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57893ab1:::benchmark_data_smithi188_104537_object40550:head# 2024-04-01T19:36:34.489 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.491 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57895c9f:::benchmark_data_smithi188_104537_object105968:head# 2024-04-01T19:36:34.491 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.491 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57897855:::benchmark_data_smithi188_104537_object78720:head# 2024-04-01T19:36:34.491 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.491 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:578a48c8:::benchmark_data_smithi188_104537_object126187:head# 2024-04-01T19:36:34.491 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.491 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:578b0fe2:::benchmark_data_smithi188_104537_object115364:head# 2024-04-01T19:36:34.491 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.491 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:578c5627:::benchmark_data_smithi188_104537_object161030:head# 2024-04-01T19:36:34.491 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.491 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:578c8e10:::benchmark_data_smithi188_104537_object108542:head# 2024-04-01T19:36:34.491 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.491 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:578cd800:::benchmark_data_smithi188_104537_object164463:head# 2024-04-01T19:36:34.491 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.491 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:578d2de7:::benchmark_data_smithi188_104537_object73770:head# 2024-04-01T19:36:34.492 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.492 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:578de1bf:::benchmark_data_smithi188_104537_object122395:head# 2024-04-01T19:36:34.492 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.492 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:578df8a5:::benchmark_data_smithi188_104537_object126280:head# 2024-04-01T19:36:34.492 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.492 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:578e2114:::benchmark_data_smithi188_104537_object108404:head# 2024-04-01T19:36:34.492 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.493 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:578efeb5:::benchmark_data_smithi188_104537_object17803:head# 2024-04-01T19:36:34.493 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.493 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:578f8969:::benchmark_data_smithi188_104537_object117330:head# 2024-04-01T19:36:34.493 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.493 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57908215:::benchmark_data_smithi188_104537_object101953:head# 2024-04-01T19:36:34.493 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.493 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57915ad3:::benchmark_data_smithi188_104537_object141488:head# 2024-04-01T19:36:34.493 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.493 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5791bfff:::benchmark_data_smithi188_104537_object152067:head# 2024-04-01T19:36:34.493 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.493 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57927504:::benchmark_data_smithi188_104537_object57734:head# 2024-04-01T19:36:34.493 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.495 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5792efef:::benchmark_data_smithi188_104537_object118160:head# 2024-04-01T19:36:34.496 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.496 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57939b99:::benchmark_data_smithi188_104537_object96578:head# 2024-04-01T19:36:34.496 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.496 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:579490d7:::benchmark_data_smithi188_104537_object33603:head# 2024-04-01T19:36:34.496 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.497 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5795fc58:::benchmark_data_smithi188_104537_object153700:head# 2024-04-01T19:36:34.497 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.498 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57964a08:::benchmark_data_smithi188_104537_object97293:head# 2024-04-01T19:36:34.498 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.502 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5796c2c6:::benchmark_data_smithi188_104537_object171004:head# 2024-04-01T19:36:34.502 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.502 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:579818df:::benchmark_data_smithi188_104537_object143725:head# 2024-04-01T19:36:34.502 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:34.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:34 smithi062 ceph-mon[44211]: pgmap v908: 17 pgs: 17 active+clean; 9.6 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 706 op/s; 19 MiB/s, 297 objects/s recovering 2024-04-01T19:36:34.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:34.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:34.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:34.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:34.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:34.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:34.514 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:579855a4:::benchmark_data_smithi188_104537_object127260:head# 2024-04-01T19:36:34.515 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.515 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:579857f0:::benchmark_data_smithi188_104537_object102789:head# 2024-04-01T19:36:34.515 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.515 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57988fc0:::benchmark_data_smithi188_104537_object122360:head# 2024-04-01T19:36:34.515 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.515 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5798c06b:::benchmark_data_smithi188_104537_object149234:head# 2024-04-01T19:36:34.515 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.515 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:579a057a:::benchmark_data_smithi188_104537_object162974:head# 2024-04-01T19:36:34.515 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.515 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:579aeb29:::benchmark_data_smithi188_104537_object55404:head# 2024-04-01T19:36:34.515 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.515 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:579af343:::benchmark_data_smithi188_104537_object87995:head# 2024-04-01T19:36:34.515 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.515 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:579b3791:::benchmark_data_smithi188_104537_object156181:head# 2024-04-01T19:36:34.515 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.516 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:579b4a32:::benchmark_data_smithi188_104537_object62136:head# 2024-04-01T19:36:34.516 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.516 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:579b5528:::benchmark_data_smithi188_104537_object104319:head# 2024-04-01T19:36:34.516 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.516 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:579b7297:::benchmark_data_smithi188_104537_object29720:head# 2024-04-01T19:36:34.516 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.516 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:579b9fd5:::benchmark_data_smithi188_104537_object166160:head# 2024-04-01T19:36:34.516 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.516 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:579bf2a4:::benchmark_data_smithi188_104537_object166526:head# 2024-04-01T19:36:34.516 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.516 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:579e260c:::benchmark_data_smithi188_104537_object58024:head# 2024-04-01T19:36:34.516 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.516 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:579eee7f:::benchmark_data_smithi188_104537_object73512:head# 2024-04-01T19:36:34.516 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.516 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:579f0e22:::benchmark_data_smithi188_104537_object30458:head# 2024-04-01T19:36:34.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.517 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:579f9949:::benchmark_data_smithi188_104537_object31448:head# 2024-04-01T19:36:34.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.517 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57a08ecd:::benchmark_data_smithi188_104537_object78766:head# 2024-04-01T19:36:34.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.517 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57a0d697:::benchmark_data_smithi188_104537_object132743:head# 2024-04-01T19:36:34.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.517 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57a1074c:::benchmark_data_smithi188_104537_object106853:head# 2024-04-01T19:36:34.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.517 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57a142e3:::benchmark_data_smithi188_104537_object89819:head# 2024-04-01T19:36:34.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.517 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57a1690e:::benchmark_data_smithi188_104537_object125087:head# 2024-04-01T19:36:34.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.517 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57a24402:::benchmark_data_smithi188_104537_object47155:head# 2024-04-01T19:36:34.518 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.519 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57a25621:::benchmark_data_smithi188_104537_object135331:head# 2024-04-01T19:36:34.519 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.519 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57a3600f:::benchmark_data_smithi188_104537_object16420:head# 2024-04-01T19:36:34.519 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.519 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57a3695b:::benchmark_data_smithi188_104537_object142374:head# 2024-04-01T19:36:34.519 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.519 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57a38163:::benchmark_data_smithi188_104537_object152853:head# 2024-04-01T19:36:34.519 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.519 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57a38439:::benchmark_data_smithi188_104537_object34612:head# 2024-04-01T19:36:34.520 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.520 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57a38f3a:::benchmark_data_smithi188_104537_object62636:head# 2024-04-01T19:36:34.520 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.520 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57a637ec:::benchmark_data_smithi188_104537_object148699:head# 2024-04-01T19:36:34.520 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.520 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57a688b6:::benchmark_data_smithi188_104537_object80773:head# 2024-04-01T19:36:34.520 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.520 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57a6ada2:::benchmark_data_smithi188_104537_object75858:head# 2024-04-01T19:36:34.520 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.521 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57a72fbf:::benchmark_data_smithi188_104537_object24366:head# 2024-04-01T19:36:34.521 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.521 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57a7991f:::benchmark_data_smithi188_104537_object35401:head# 2024-04-01T19:36:34.521 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.521 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57a79a9a:::benchmark_data_smithi188_104537_object91498:head# 2024-04-01T19:36:34.521 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.521 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57a79cff:::benchmark_data_smithi188_104537_object103814:head# 2024-04-01T19:36:34.521 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.521 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57a7d43f:::benchmark_data_smithi188_104537_object103519:head# 2024-04-01T19:36:34.521 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.522 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57a89803:::benchmark_data_smithi188_104537_object148132:head# 2024-04-01T19:36:34.522 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.522 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57aa7bb0:::benchmark_data_smithi188_104537_object95105:head# 2024-04-01T19:36:34.522 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.522 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57aad50e:::benchmark_data_smithi188_104537_object101165:head# 2024-04-01T19:36:34.522 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.522 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57ab30c7:::benchmark_data_smithi188_104537_object130787:head# 2024-04-01T19:36:34.522 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.523 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57ac035b:::benchmark_data_smithi188_104537_object117069:head# 2024-04-01T19:36:34.523 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.523 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:34.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57ac3ffe:::benchmark_data_smithi188_104537_object97632:head# 2024-04-01T19:36:34.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57aca161:::benchmark_data_smithi188_104537_object163491:head# 2024-04-01T19:36:34.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57ace93b:::benchmark_data_smithi188_104537_object64963:head# 2024-04-01T19:36:34.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.525 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57add590:::benchmark_data_smithi188_104537_object98738:head# 2024-04-01T19:36:34.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.525 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57ae6993:::benchmark_data_smithi188_104537_object58358:head# 2024-04-01T19:36:34.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.525 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57ae94d9:::benchmark_data_smithi188_104537_object164189:head# 2024-04-01T19:36:34.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.526 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57ae9dda:::benchmark_data_smithi188_104537_object67458:head# 2024-04-01T19:36:34.526 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.526 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57aedd94:::benchmark_data_smithi188_104537_object93562:head# 2024-04-01T19:36:34.526 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.526 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57aef2cd:::benchmark_data_smithi188_104537_object97006:head# 2024-04-01T19:36:34.526 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.527 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57afaebc:::benchmark_data_smithi188_104537_object72433:head# 2024-04-01T19:36:34.527 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.527 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57afd22c:::benchmark_data_smithi188_104537_object14600:head# 2024-04-01T19:36:34.527 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.527 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57aff600:::benchmark_data_smithi188_104537_object124579:head# 2024-04-01T19:36:34.527 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.527 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57b0bd16:::benchmark_data_smithi188_104537_object121806:head# 2024-04-01T19:36:34.527 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.527 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57b17dcd:::benchmark_data_smithi188_104537_object93872:head# 2024-04-01T19:36:34.528 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.529 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57b1a40a:::benchmark_data_smithi188_104537_object55785:head# 2024-04-01T19:36:34.529 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.529 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57b1a488:::benchmark_data_smithi188_104537_object17714:head# 2024-04-01T19:36:34.529 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.529 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57b1c4dc:::benchmark_data_smithi188_104537_object88723:head# 2024-04-01T19:36:34.529 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.529 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57b2dd4e:::benchmark_data_smithi188_104537_object128474:head# 2024-04-01T19:36:34.529 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.529 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57b421ad:::benchmark_data_smithi188_104537_object78718:head# 2024-04-01T19:36:34.529 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.529 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57b47144:::benchmark_data_smithi188_104537_object90689:head# 2024-04-01T19:36:34.529 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.530 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57b49684:::benchmark_data_smithi188_104537_object82204:head# 2024-04-01T19:36:34.530 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.530 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57b4a3d6:::benchmark_data_smithi188_104537_object61348:head# 2024-04-01T19:36:34.530 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.531 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57b6b593:::benchmark_data_smithi188_104537_object108759:head# 2024-04-01T19:36:34.531 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.531 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57b7102d:::benchmark_data_smithi188_104537_object168277:head# 2024-04-01T19:36:34.531 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.531 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57b73354:::benchmark_data_smithi188_104537_object61420:head# 2024-04-01T19:36:34.531 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.531 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57b77f16:::benchmark_data_smithi188_104537_object74866:head# 2024-04-01T19:36:34.531 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.531 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57b7c271:::benchmark_data_smithi188_104537_object11416:head# 2024-04-01T19:36:34.532 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.532 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57b7c31e:::benchmark_data_smithi188_104537_object156829:head# 2024-04-01T19:36:34.532 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.532 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57b865c5:::benchmark_data_smithi188_104537_object155941:head# 2024-04-01T19:36:34.532 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.532 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57b883d1:::benchmark_data_smithi188_104537_object170382:head# 2024-04-01T19:36:34.532 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.533 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57b8bb9a:::benchmark_data_smithi188_104537_object94620:head# 2024-04-01T19:36:34.533 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.533 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57b8d7d9:::benchmark_data_smithi188_104537_object51360:head# 2024-04-01T19:36:34.533 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.533 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57b92dd4:::benchmark_data_smithi188_104537_object17569:head# 2024-04-01T19:36:34.533 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.534 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57b96eb5:::benchmark_data_smithi188_104537_object165875:head# 2024-04-01T19:36:34.534 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.534 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57ba8ec4:::benchmark_data_smithi188_104537_object142051:head# 2024-04-01T19:36:34.534 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.534 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57ba96ff:::benchmark_data_smithi188_104537_object104468:head# 2024-04-01T19:36:34.534 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.534 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57bb212e:::benchmark_data_smithi188_104537_object89925:head# 2024-04-01T19:36:34.534 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.534 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57bb63d8:::benchmark_data_smithi188_104537_object79023:head# 2024-04-01T19:36:34.534 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.535 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57bbd652:::benchmark_data_smithi188_104537_object31117:head# 2024-04-01T19:36:34.535 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.535 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57bd627c:::benchmark_data_smithi188_104537_object35387:head# 2024-04-01T19:36:34.535 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57be3bab:::benchmark_data_smithi188_104537_object121511:head# 2024-04-01T19:36:34.538 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.538 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57beaad2:::benchmark_data_smithi188_104537_object114752:head# 2024-04-01T19:36:34.538 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.538 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57bf3800:::benchmark_data_smithi188_104537_object83732:head# 2024-04-01T19:36:34.538 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.538 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57bfcf82:::benchmark_data_smithi188_104537_object106620:head# 2024-04-01T19:36:34.538 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.538 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57c00b8b:::benchmark_data_smithi188_104537_object12065:head# 2024-04-01T19:36:34.538 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.538 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57c023aa:::benchmark_data_smithi188_104537_object162677:head# 2024-04-01T19:36:34.538 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.538 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57c0363c:::benchmark_data_smithi188_104537_object31069:head# 2024-04-01T19:36:34.539 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.539 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57c0b0cf:::benchmark_data_smithi188_104537_object136588:head# 2024-04-01T19:36:34.539 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.539 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57c24eb0:::benchmark_data_smithi188_104537_object41435:head# 2024-04-01T19:36:34.539 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.539 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57c25fa4:::benchmark_data_smithi188_104537_object169460:head# 2024-04-01T19:36:34.539 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.540 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57c27783:::benchmark_data_smithi188_104537_object114062:head# 2024-04-01T19:36:34.540 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.540 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57c2ef39:::benchmark_data_smithi188_104537_object27973:head# 2024-04-01T19:36:34.540 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.540 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57c35201:::benchmark_data_smithi188_104537_object122607:head# 2024-04-01T19:36:34.540 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.540 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57c51585:::benchmark_data_smithi188_104537_object150585:head# 2024-04-01T19:36:34.540 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.540 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57c546c4:::benchmark_data_smithi188_104537_object153086:head# 2024-04-01T19:36:34.540 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.540 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57c587bd:::benchmark_data_smithi188_104537_object51733:head# 2024-04-01T19:36:34.541 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.541 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57c61680:::benchmark_data_smithi188_104537_object125088:head# 2024-04-01T19:36:34.541 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.541 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57c6604e:::benchmark_data_smithi188_104537_object154436:head# 2024-04-01T19:36:34.541 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.542 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57c67971:::benchmark_data_smithi188_104537_object164209:head# 2024-04-01T19:36:34.542 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.542 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57c70eb0:::benchmark_data_smithi188_104537_object107660:head# 2024-04-01T19:36:34.542 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.542 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57c79ec0:::benchmark_data_smithi188_104537_object120331:head# 2024-04-01T19:36:34.542 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.542 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57c7df70:::benchmark_data_smithi188_104537_object85636:head# 2024-04-01T19:36:34.542 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.542 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57c84dc8:::benchmark_data_smithi188_104537_object111912:head# 2024-04-01T19:36:34.542 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.542 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57c87405:::benchmark_data_smithi188_104537_object39170:head# 2024-04-01T19:36:34.542 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.543 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57c8c153:::benchmark_data_smithi188_104537_object37312:head# 2024-04-01T19:36:34.543 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.543 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57cb1c18:::benchmark_data_smithi188_104537_object156195:head# 2024-04-01T19:36:34.545 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.545 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57cb5b04:::benchmark_data_smithi188_104537_object86529:head# 2024-04-01T19:36:34.545 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.545 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57cbc4f8:::benchmark_data_smithi188_104537_object137164:head# 2024-04-01T19:36:34.545 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.546 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57cc0c76:::benchmark_data_smithi188_104537_object76662:head# 2024-04-01T19:36:34.546 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.546 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57cc1bcf:::benchmark_data_smithi188_104537_object42788:head# 2024-04-01T19:36:34.546 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.547 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57cc61d0:::benchmark_data_smithi188_104537_object158538:head# 2024-04-01T19:36:34.547 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.547 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57cce93b:::benchmark_data_smithi188_104537_object121108:head# 2024-04-01T19:36:34.547 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.547 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57cd3900:::benchmark_data_smithi188_104537_object171417:head# 2024-04-01T19:36:34.547 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.547 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57cd9b80:::benchmark_data_smithi188_104537_object107759:head# 2024-04-01T19:36:34.547 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.547 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57ce7f9a:::benchmark_data_smithi188_104537_object23641:head# 2024-04-01T19:36:34.547 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.547 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57ce83fd:::benchmark_data_smithi188_104537_object104869:head# 2024-04-01T19:36:34.547 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.548 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57ce8ecd:::benchmark_data_smithi188_104537_object144861:head# 2024-04-01T19:36:34.548 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.548 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57ceb2cb:::benchmark_data_smithi188_104537_object35899:head# 2024-04-01T19:36:34.548 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.548 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57ced45e:::benchmark_data_smithi188_104537_object113093:head# 2024-04-01T19:36:34.548 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.548 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57ced797:::benchmark_data_smithi188_104537_object55739:head# 2024-04-01T19:36:34.548 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.548 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57cf0314:::benchmark_data_smithi188_104537_object111925:head# 2024-04-01T19:36:34.548 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.552 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57cfc0eb:::benchmark_data_smithi188_104537_object117367:head# 2024-04-01T19:36:34.552 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.552 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d02b92:::benchmark_data_smithi188_104537_object127915:head# 2024-04-01T19:36:34.552 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d06e17:::benchmark_data_smithi188_104537_object159899:head# 2024-04-01T19:36:34.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d087cf:::benchmark_data_smithi188_104537_object145161:head# 2024-04-01T19:36:34.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d153ae:::benchmark_data_smithi188_104537_object11834:head# 2024-04-01T19:36:34.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d16a5d:::benchmark_data_smithi188_104537_object75074:head# 2024-04-01T19:36:34.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d1dfd1:::benchmark_data_smithi188_104537_object68479:head# 2024-04-01T19:36:34.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d1e737:::benchmark_data_smithi188_104537_object52234:head# 2024-04-01T19:36:34.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d254f6:::benchmark_data_smithi188_104537_object81407:head# 2024-04-01T19:36:34.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d258c9:::benchmark_data_smithi188_104537_object93442:head# 2024-04-01T19:36:34.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d32e50:::benchmark_data_smithi188_104537_object50656:head# 2024-04-01T19:36:34.554 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.554 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d3440a:::benchmark_data_smithi188_104537_object73984:head# 2024-04-01T19:36:34.554 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.554 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d34ed7:::benchmark_data_smithi188_104537_object67797:head# 2024-04-01T19:36:34.554 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.557 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d3e544:::benchmark_data_smithi188_104537_object59342:head# 2024-04-01T19:36:34.558 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.558 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d41720:::benchmark_data_smithi188_104537_object141701:head# 2024-04-01T19:36:34.558 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.558 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d435f5:::benchmark_data_smithi188_104537_object150208:head# 2024-04-01T19:36:34.558 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.558 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d4ffe9:::benchmark_data_smithi188_104537_object24838:head# 2024-04-01T19:36:34.558 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.559 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d50fa7:::benchmark_data_smithi188_104537_object48571:head# 2024-04-01T19:36:34.559 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.559 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d6057e:::benchmark_data_smithi188_104537_object36063:head# 2024-04-01T19:36:34.559 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.559 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d69b7b:::benchmark_data_smithi188_104537_object20507:head# 2024-04-01T19:36:34.559 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.559 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d7205a:::benchmark_data_smithi188_104537_object156087:head# 2024-04-01T19:36:34.559 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.560 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d81467:::benchmark_data_smithi188_104537_object153178:head# 2024-04-01T19:36:34.560 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.560 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d8245e:::benchmark_data_smithi188_104537_object81103:head# 2024-04-01T19:36:34.560 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.561 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d8314d:::benchmark_data_smithi188_104537_object127767:head# 2024-04-01T19:36:34.561 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.561 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d8c596:::benchmark_data_smithi188_104537_object136625:head# 2024-04-01T19:36:34.561 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.561 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d8f608:::benchmark_data_smithi188_104537_object64728:head# 2024-04-01T19:36:34.561 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.561 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d909ee:::benchmark_data_smithi188_104537_object158821:head# 2024-04-01T19:36:34.561 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.561 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d99b27:::benchmark_data_smithi188_104537_object104531:head# 2024-04-01T19:36:34.562 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.562 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d9aa93:::benchmark_data_smithi188_104537_object113775:head# 2024-04-01T19:36:34.562 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.563 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57d9e91c:::benchmark_data_smithi188_104537_object27161:head# 2024-04-01T19:36:34.563 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.563 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57dad3a9:::benchmark_data_smithi188_104537_object13911:head# 2024-04-01T19:36:34.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57db23a1:::benchmark_data_smithi188_104537_object86562:head# 2024-04-01T19:36:34.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57db40fb:::benchmark_data_smithi188_104537_object105228:head# 2024-04-01T19:36:34.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57dc0cb0:::benchmark_data_smithi188_104537_object139564:head# 2024-04-01T19:36:34.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57deccd6:::benchmark_data_smithi188_104537_object66728:head# 2024-04-01T19:36:34.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57dedf1a:::benchmark_data_smithi188_104537_object132402:head# 2024-04-01T19:36:34.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57df2fd2:::benchmark_data_smithi188_104537_object168203:head# 2024-04-01T19:36:34.565 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.565 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57df359c:::benchmark_data_smithi188_104537_object51052:head# 2024-04-01T19:36:34.565 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.566 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57dfd50d:::benchmark_data_smithi188_104537_object169192:head# 2024-04-01T19:36:34.566 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.566 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57e0a38f:::benchmark_data_smithi188_104537_object81126:head# 2024-04-01T19:36:34.566 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.566 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57e0fff8:::benchmark_data_smithi188_104537_object148793:head# 2024-04-01T19:36:34.566 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.566 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57e2525e:::benchmark_data_smithi188_104537_object129637:head# 2024-04-01T19:36:34.566 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.566 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57e27208:::benchmark_data_smithi188_104537_object102311:head# 2024-04-01T19:36:34.566 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.568 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57e33733:::benchmark_data_smithi188_104537_object35021:head# 2024-04-01T19:36:34.568 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.568 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57e38c9a:::benchmark_data_smithi188_104537_object171277:head# 2024-04-01T19:36:34.568 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.568 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57e3eb98:::benchmark_data_smithi188_104537_object81563:head# 2024-04-01T19:36:34.568 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.568 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57e47bb3:::benchmark_data_smithi188_104537_object139390:head# 2024-04-01T19:36:34.568 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.569 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57e62cd4:::benchmark_data_smithi188_104537_object11240:head# 2024-04-01T19:36:34.569 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.569 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57e69bca:::benchmark_data_smithi188_104537_object139063:head# 2024-04-01T19:36:34.569 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.569 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57e7d15a:::benchmark_data_smithi188_104537_object104951:head# 2024-04-01T19:36:34.569 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.569 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57e7f090:::benchmark_data_smithi188_104537_object168984:head# 2024-04-01T19:36:34.569 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.571 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57e8fa97:::benchmark_data_smithi188_104537_object113958:head# 2024-04-01T19:36:34.571 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.571 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57e91658:::benchmark_data_smithi188_104537_object54794:head# 2024-04-01T19:36:34.571 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.571 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57e918c6:::benchmark_data_smithi188_104537_object75162:head# 2024-04-01T19:36:34.571 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.571 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57e926d6:::benchmark_data_smithi188_104537_object110682:head# 2024-04-01T19:36:34.571 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.572 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57e96229:::benchmark_data_smithi188_104537_object26535:head# 2024-04-01T19:36:34.572 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.572 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57e9a11c:::benchmark_data_smithi188_104537_object147030:head# 2024-04-01T19:36:34.572 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.572 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57eafd00:::benchmark_data_smithi188_104537_object109012:head# 2024-04-01T19:36:34.572 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.572 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57eb795a:::benchmark_data_smithi188_104537_object147331:head# 2024-04-01T19:36:34.572 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.572 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57ebb04a:::benchmark_data_smithi188_104537_object101505:head# 2024-04-01T19:36:34.572 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.573 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57ebccf5:::benchmark_data_smithi188_104537_object106856:head# 2024-04-01T19:36:34.574 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.574 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57ec7fe3:::benchmark_data_smithi188_104537_object47022:head# 2024-04-01T19:36:34.574 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.574 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57ed2276:::benchmark_data_smithi188_104537_object164968:head# 2024-04-01T19:36:34.574 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.574 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57ed76e3:::benchmark_data_smithi188_104537_object77206:head# 2024-04-01T19:36:34.574 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.574 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57ed9c3c:::benchmark_data_smithi188_104537_object81836:head# 2024-04-01T19:36:34.574 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.574 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57edec72:::benchmark_data_smithi188_104537_object163461:head# 2024-04-01T19:36:34.574 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.574 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57edf983:::benchmark_data_smithi188_104537_object164574:head# 2024-04-01T19:36:34.574 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.575 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57edff7c:::benchmark_data_smithi188_104537_object89551:head# 2024-04-01T19:36:34.575 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.575 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57ee6ce7:::benchmark_data_smithi188_104537_object46689:head# 2024-04-01T19:36:34.575 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.575 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57eeaff4:::benchmark_data_smithi188_104537_object92487:head# 2024-04-01T19:36:34.575 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.575 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57eebfd3:::benchmark_data_smithi188_104537_object138150:head# 2024-04-01T19:36:34.575 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.575 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57ef8ccb:::benchmark_data_smithi188_104537_object117340:head# 2024-04-01T19:36:34.575 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.575 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f02526:::benchmark_data_smithi188_104537_object13513:head# 2024-04-01T19:36:34.575 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.577 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f07789:::benchmark_data_smithi188_104537_object52906:head# 2024-04-01T19:36:34.577 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.577 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f11c60:::benchmark_data_smithi188_104537_object16662:head# 2024-04-01T19:36:34.577 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.577 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f14bad:::benchmark_data_smithi188_104537_object100714:head# 2024-04-01T19:36:34.577 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.577 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f1b2dd:::benchmark_data_smithi188_104537_object133191:head# 2024-04-01T19:36:34.577 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.577 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f1cc91:::benchmark_data_smithi188_104537_object17424:head# 2024-04-01T19:36:34.577 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.578 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f1db4a:::benchmark_data_smithi188_104537_object90870:head# 2024-04-01T19:36:34.578 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.578 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f2d580:::benchmark_data_smithi188_104537_object111160:head# 2024-04-01T19:36:34.579 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.579 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f37168:::benchmark_data_smithi188_104537_object102752:head# 2024-04-01T19:36:34.579 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.579 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f3df90:::benchmark_data_smithi188_104537_object155010:head# 2024-04-01T19:36:34.579 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.579 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f40696:::benchmark_data_smithi188_104537_object169502:head# 2024-04-01T19:36:34.579 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.579 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f420c5:::benchmark_data_smithi188_104537_object36502:head# 2024-04-01T19:36:34.579 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.579 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f4d7d6:::benchmark_data_smithi188_104537_object87931:head# 2024-04-01T19:36:34.579 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.579 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f4dea6:::benchmark_data_smithi188_104537_object51584:head# 2024-04-01T19:36:34.579 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.580 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f4e4f7:::benchmark_data_smithi188_104537_object78743:head# 2024-04-01T19:36:34.580 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.580 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f5b817:::benchmark_data_smithi188_104537_object105308:head# 2024-04-01T19:36:34.580 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.580 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f63678:::benchmark_data_smithi188_104537_object17624:head# 2024-04-01T19:36:34.580 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.580 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f6a1a9:::benchmark_data_smithi188_104537_object123191:head# 2024-04-01T19:36:34.580 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.582 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f6f4ff:::benchmark_data_smithi188_104537_object111238:head# 2024-04-01T19:36:34.582 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.582 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f730b9:::benchmark_data_smithi188_104537_object133719:head# 2024-04-01T19:36:34.582 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.582 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f74d49:::benchmark_data_smithi188_104537_object17623:head# 2024-04-01T19:36:34.582 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.582 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f7f195:::benchmark_data_smithi188_104537_object96558:head# 2024-04-01T19:36:34.582 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f8727b:::benchmark_data_smithi188_104537_object118244:head# 2024-04-01T19:36:34.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f8e0c7:::benchmark_data_smithi188_104537_object93093:head# 2024-04-01T19:36:34.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f952b8:::benchmark_data_smithi188_104537_object125703:head# 2024-04-01T19:36:34.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f96710:::benchmark_data_smithi188_104537_object121450:head# 2024-04-01T19:36:34.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57f9ed7e:::benchmark_data_smithi188_104537_object143510:head# 2024-04-01T19:36:34.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57fa1533:::benchmark_data_smithi188_104537_object133322:head# 2024-04-01T19:36:34.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57fa8c32:::benchmark_data_smithi188_104537_object23654:head# 2024-04-01T19:36:34.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57fbb697:::benchmark_data_smithi188_104537_object75712:head# 2024-04-01T19:36:34.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57fbd0ff:::benchmark_data_smithi188_104537_object56415:head# 2024-04-01T19:36:34.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.586 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57fbd9f6:::benchmark_data_smithi188_104537_object105798:head# 2024-04-01T19:36:34.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57fc0208:::benchmark_data_smithi188_104537_object155015:head# 2024-04-01T19:36:34.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57fd301b:::benchmark_data_smithi188_104537_object153355:head# 2024-04-01T19:36:34.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57fd5abe:::benchmark_data_smithi188_104537_object156508:head# 2024-04-01T19:36:34.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57fdf9f6:::benchmark_data_smithi188_104537_object114519:head# 2024-04-01T19:36:34.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57fe0654:::benchmark_data_smithi188_104537_object142850:head# 2024-04-01T19:36:34.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57fe9797:::benchmark_data_smithi188_104537_object31296:head# 2024-04-01T19:36:34.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:57ff9280:::benchmark_data_smithi188_104537_object36681:head# 2024-04-01T19:36:34.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:580001ad:::benchmark_data_smithi188_104537_object136535:head# 2024-04-01T19:36:34.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:580011f0:::benchmark_data_smithi188_104537_object59230:head# 2024-04-01T19:36:34.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:580034b7:::benchmark_data_smithi188_104537_object18887:head# 2024-04-01T19:36:34.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58004ea3:::benchmark_data_smithi188_104537_object17465:head# 2024-04-01T19:36:34.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5800e8ff:::benchmark_data_smithi188_104537_object58372:head# 2024-04-01T19:36:34.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58018669:::benchmark_data_smithi188_104537_object86552:head# 2024-04-01T19:36:34.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.589 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58019f54:::benchmark_data_smithi188_104537_object125815:head# 2024-04-01T19:36:34.589 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.589 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:580249e5:::benchmark_data_smithi188_104537_object29622:head# 2024-04-01T19:36:34.590 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.590 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58025d5d:::benchmark_data_smithi188_104537_object159999:head# 2024-04-01T19:36:34.590 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.590 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5802abf9:::benchmark_data_smithi188_104537_object26329:head# 2024-04-01T19:36:34.590 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.590 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58032589:::benchmark_data_smithi188_104537_object93168:head# 2024-04-01T19:36:34.590 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.590 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5803368c:::benchmark_data_smithi188_104537_object68315:head# 2024-04-01T19:36:34.590 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.590 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:580374e1:::benchmark_data_smithi188_104537_object63965:head# 2024-04-01T19:36:34.591 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.591 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5803c917:::benchmark_data_smithi188_104537_object66696:head# 2024-04-01T19:36:34.591 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.591 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58042944:::benchmark_data_smithi188_104537_object84783:head# 2024-04-01T19:36:34.591 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.591 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:580441ec:::benchmark_data_smithi188_104537_object48978:head# 2024-04-01T19:36:34.591 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.591 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5804df35:::benchmark_data_smithi188_104537_object148306:head# 2024-04-01T19:36:34.591 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.591 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58056677:::benchmark_data_smithi188_104537_object65991:head# 2024-04-01T19:36:34.591 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.592 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:36:34.593 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58057cc2:::benchmark_data_smithi188_104537_object154317:head# 2024-04-01T19:36:34.593 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.593 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5805985b:::benchmark_data_smithi188_104537_object17864:head# 2024-04-01T19:36:34.593 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.593 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5805fa82:::benchmark_data_smithi188_104537_object19267:head# 2024-04-01T19:36:34.593 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.593 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5806b81a:::benchmark_data_smithi188_104537_object57860:head# 2024-04-01T19:36:34.593 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.594 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5807ac34:::benchmark_data_smithi188_104537_object40685:head# 2024-04-01T19:36:34.594 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.594 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5808a50f:::benchmark_data_smithi188_104537_object52994:head# 2024-04-01T19:36:34.594 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.594 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5808afa7:::benchmark_data_smithi188_104537_object31762:head# 2024-04-01T19:36:34.594 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.594 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58093281:::benchmark_data_smithi188_104537_object40530:head# 2024-04-01T19:36:34.594 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.594 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:580943c1:::benchmark_data_smithi188_104537_object11752:head# 2024-04-01T19:36:34.594 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.597 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58094543:::benchmark_data_smithi188_104537_object57343:head# 2024-04-01T19:36:34.597 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.597 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:580a5be0:::benchmark_data_smithi188_104537_object24927:head# 2024-04-01T19:36:34.597 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.598 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:580a66c8:::benchmark_data_smithi188_104537_object27149:head# 2024-04-01T19:36:34.598 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.598 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:580b1012:::benchmark_data_smithi188_104537_object96715:head# 2024-04-01T19:36:34.598 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.598 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:580b33d8:::benchmark_data_smithi188_104537_object22263:head# 2024-04-01T19:36:34.598 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.600 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:580c6a7a:::benchmark_data_smithi188_104537_object139793:head# 2024-04-01T19:36:34.600 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.600 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:580cb127:::benchmark_data_smithi188_104537_object96843:head# 2024-04-01T19:36:34.600 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.600 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:580d1d18:::benchmark_data_smithi188_104537_object63704:head# 2024-04-01T19:36:34.600 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.600 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:580d8b75:::benchmark_data_smithi188_104537_object59060:head# 2024-04-01T19:36:34.600 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.600 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:580db16e:::benchmark_data_smithi188_104537_object99315:head# 2024-04-01T19:36:34.601 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.601 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:580e3980:::benchmark_data_smithi188_104537_object107762:head# 2024-04-01T19:36:34.601 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.601 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:580ec146:::benchmark_data_smithi188_104537_object148118:head# 2024-04-01T19:36:34.601 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.602 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:580efcbb:::benchmark_data_smithi188_104537_object106144:head# 2024-04-01T19:36:34.602 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.603 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:580f7182:::benchmark_data_smithi188_104537_object75893:head# 2024-04-01T19:36:34.603 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.603 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:580fc634:::benchmark_data_smithi188_104537_object118343:head# 2024-04-01T19:36:34.603 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.603 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58103d92:::benchmark_data_smithi188_104537_object17004:head# 2024-04-01T19:36:34.603 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.603 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5810676a:::benchmark_data_smithi188_104537_object162490:head# 2024-04-01T19:36:34.603 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.603 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5810e05a:::benchmark_data_smithi188_104537_object65632:head# 2024-04-01T19:36:34.603 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.603 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58116f8a:::benchmark_data_smithi188_104537_object149438:head# 2024-04-01T19:36:34.603 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.603 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58119891:::benchmark_data_smithi188_104537_object73845:head# 2024-04-01T19:36:34.603 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.604 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58119b5f:::benchmark_data_smithi188_104537_object75346:head# 2024-04-01T19:36:34.604 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.606 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58122ae1:::benchmark_data_smithi188_104537_object151659:head# 2024-04-01T19:36:34.606 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.606 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5812fccf:::benchmark_data_smithi188_104537_object77381:head# 2024-04-01T19:36:34.606 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.606 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58131554:::benchmark_data_smithi188_104537_object65552:head# 2024-04-01T19:36:34.606 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.606 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5813a82f:::benchmark_data_smithi188_104537_object98958:head# 2024-04-01T19:36:34.606 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.606 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5813da4d:::benchmark_data_smithi188_104537_object31998:head# 2024-04-01T19:36:34.607 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.607 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5814669e:::benchmark_data_smithi188_104537_object128887:head# 2024-04-01T19:36:34.607 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.607 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5814ded5:::benchmark_data_smithi188_104537_object122677:head# 2024-04-01T19:36:34.607 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.607 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58153702:::benchmark_data_smithi188_104537_object62842:head# 2024-04-01T19:36:34.607 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.607 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58154cf2:::benchmark_data_smithi188_104537_object153569:head# 2024-04-01T19:36:34.607 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.607 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58155ce9:::benchmark_data_smithi188_104537_object69799:head# 2024-04-01T19:36:34.607 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.607 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5815a3fa:::benchmark_data_smithi188_104537_object132267:head# 2024-04-01T19:36:34.607 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.607 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5815df10:::benchmark_data_smithi188_104537_object123230:head# 2024-04-01T19:36:34.608 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.608 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5815e3b4:::benchmark_data_smithi188_104537_object121150:head# 2024-04-01T19:36:34.608 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.608 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5816dcc5:::benchmark_data_smithi188_104537_object72620:head# 2024-04-01T19:36:34.608 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.609 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58170a70:::benchmark_data_smithi188_104537_object149687:head# 2024-04-01T19:36:34.609 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.609 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5817422f:::benchmark_data_smithi188_104537_object140834:head# 2024-04-01T19:36:34.609 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.609 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5817a591:::benchmark_data_smithi188_104537_object107924:head# 2024-04-01T19:36:34.610 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.610 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5817d8db:::benchmark_data_smithi188_104537_object89637:head# 2024-04-01T19:36:34.610 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.610 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5818b5c9:::benchmark_data_smithi188_104537_object124160:head# 2024-04-01T19:36:34.610 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.610 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58190126:::benchmark_data_smithi188_104537_object134461:head# 2024-04-01T19:36:34.610 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.610 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58195e71:::benchmark_data_smithi188_104537_object163326:head# 2024-04-01T19:36:34.610 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.610 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58198f87:::benchmark_data_smithi188_104537_object140123:head# 2024-04-01T19:36:34.610 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.610 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5819aa8d:::benchmark_data_smithi188_104537_object101333:head# 2024-04-01T19:36:34.610 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.610 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:581a12f5:::benchmark_data_smithi188_104537_object160236:head# 2024-04-01T19:36:34.611 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.611 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:581a74d1:::benchmark_data_smithi188_104537_object38351:head# 2024-04-01T19:36:34.611 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.611 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:581a87d0:::benchmark_data_smithi188_104537_object19758:head# 2024-04-01T19:36:34.611 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.613 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:581a9223:::benchmark_data_smithi188_104537_object136651:head# 2024-04-01T19:36:34.613 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.613 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:581ba07f:::benchmark_data_smithi188_104537_object89555:head# 2024-04-01T19:36:34.613 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.613 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:581ba1cd:::benchmark_data_smithi188_104537_object27003:head# 2024-04-01T19:36:34.613 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.613 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:581bfa2d:::benchmark_data_smithi188_104537_object132916:head# 2024-04-01T19:36:34.613 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.613 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:581c1008:::benchmark_data_smithi188_104537_object73391:head# 2024-04-01T19:36:34.614 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.614 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:581c29de:::benchmark_data_smithi188_104537_object121929:head# 2024-04-01T19:36:34.614 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.614 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:581c40af:::benchmark_data_smithi188_104537_object47703:head# 2024-04-01T19:36:34.614 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.614 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:581c4d10:::benchmark_data_smithi188_104537_object165843:head# 2024-04-01T19:36:34.614 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.614 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:581cfcba:::benchmark_data_smithi188_104537_object35264:head# 2024-04-01T19:36:34.614 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.614 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:581d1cfc:::benchmark_data_smithi188_104537_object76826:head# 2024-04-01T19:36:34.614 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.614 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:581d6deb:::benchmark_data_smithi188_104537_object65968:head# 2024-04-01T19:36:34.614 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.614 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:581dea76:::benchmark_data_smithi188_104537_object94196:head# 2024-04-01T19:36:34.615 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.615 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:581e2ebc:::benchmark_data_smithi188_104537_object103340:head# 2024-04-01T19:36:34.615 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.615 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:581f90e9:::benchmark_data_smithi188_104537_object44113:head# 2024-04-01T19:36:34.615 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.618 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5820025a:::benchmark_data_smithi188_104537_object143601:head# 2024-04-01T19:36:34.618 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.618 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5820f7ea:::benchmark_data_smithi188_104537_object85256:head# 2024-04-01T19:36:34.618 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.618 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58229e7c:::benchmark_data_smithi188_104537_object138359:head# 2024-04-01T19:36:34.618 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.618 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:582300b6:::benchmark_data_smithi188_104537_object140329:head# 2024-04-01T19:36:34.619 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.619 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58239e66:::benchmark_data_smithi188_104537_object89778:head# 2024-04-01T19:36:34.619 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.619 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5823dc09:::benchmark_data_smithi188_104537_object167642:head# 2024-04-01T19:36:34.619 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.619 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5824f2d2:::benchmark_data_smithi188_104537_object114677:head# 2024-04-01T19:36:34.619 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.619 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5825153c:::benchmark_data_smithi188_104537_object96361:head# 2024-04-01T19:36:34.619 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.619 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58254ea3:::benchmark_data_smithi188_104537_object134271:head# 2024-04-01T19:36:34.619 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.619 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5825d4cd:::benchmark_data_smithi188_104537_object82065:head# 2024-04-01T19:36:34.619 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.619 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:582608fb:::benchmark_data_smithi188_104537_object132307:head# 2024-04-01T19:36:34.620 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.620 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5826cc72:::benchmark_data_smithi188_104537_object145104:head# 2024-04-01T19:36:34.620 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.620 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5826e6d1:::benchmark_data_smithi188_104537_object91894:head# 2024-04-01T19:36:34.620 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.620 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58273161:::benchmark_data_smithi188_104537_object155232:head# 2024-04-01T19:36:34.620 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.620 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58276faf:::benchmark_data_smithi188_104537_object149100:head# 2024-04-01T19:36:34.620 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.620 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5827c10b:::benchmark_data_smithi188_104537_object101405:head# 2024-04-01T19:36:34.620 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.620 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5827c9c7:::benchmark_data_smithi188_104537_object37774:head# 2024-04-01T19:36:34.620 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.620 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5827f745:::benchmark_data_smithi188_104537_object25196:head# 2024-04-01T19:36:34.621 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.621 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5828120e:::benchmark_data_smithi188_104537_object56570:head# 2024-04-01T19:36:34.621 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.621 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58281b7c:::benchmark_data_smithi188_104537_object45578:head# 2024-04-01T19:36:34.621 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58282c80:::benchmark_data_smithi188_104537_object163452:head# 2024-04-01T19:36:34.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5828db96:::benchmark_data_smithi188_104537_object151228:head# 2024-04-01T19:36:34.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58294afa:::benchmark_data_smithi188_104537_object71896:head# 2024-04-01T19:36:34.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58298bed:::benchmark_data_smithi188_104537_object31663:head# 2024-04-01T19:36:34.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:582a1eb3:::benchmark_data_smithi188_104537_object145005:head# 2024-04-01T19:36:34.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:582ab647:::benchmark_data_smithi188_104537_object155353:head# 2024-04-01T19:36:34.624 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.624 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:582b59fe:::benchmark_data_smithi188_104537_object47000:head# 2024-04-01T19:36:34.624 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.624 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:582d1c2b:::benchmark_data_smithi188_104537_object92002:head# 2024-04-01T19:36:34.624 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.624 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:582db24c:::benchmark_data_smithi188_104537_object65306:head# 2024-04-01T19:36:34.624 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.624 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:582dc9a3:::benchmark_data_smithi188_104537_object76980:head# 2024-04-01T19:36:34.624 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.624 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:582e9ecd:::benchmark_data_smithi188_104537_object34688:head# 2024-04-01T19:36:34.624 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.624 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:582f2824:::benchmark_data_smithi188_104537_object123025:head# 2024-04-01T19:36:34.624 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.624 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58300043:::benchmark_data_smithi188_104537_object61879:head# 2024-04-01T19:36:34.625 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.625 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58306ef9:::benchmark_data_smithi188_104537_object65821:head# 2024-04-01T19:36:34.625 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.625 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5830a601:::benchmark_data_smithi188_104537_object129772:head# 2024-04-01T19:36:34.625 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.625 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5830c193:::benchmark_data_smithi188_104537_object143456:head# 2024-04-01T19:36:34.625 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:34.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:34 smithi188 ceph-mon[43939]: pgmap v908: 17 pgs: 17 active+clean; 9.6 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 706 op/s; 19 MiB/s, 297 objects/s recovering 2024-04-01T19:36:34.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:34.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:34.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:34.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:34.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:34.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:34.626 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5830d4a9:::benchmark_data_smithi188_104537_object152549:head# 2024-04-01T19:36:34.627 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.627 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58318f6a:::benchmark_data_smithi188_104537_object30732:head# 2024-04-01T19:36:34.627 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.627 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:583235df:::benchmark_data_smithi188_104537_object88807:head# 2024-04-01T19:36:34.627 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.627 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58340238:::benchmark_data_smithi188_104537_object61259:head# 2024-04-01T19:36:34.627 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.628 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5834f627:::benchmark_data_smithi188_104537_object19253:head# 2024-04-01T19:36:34.628 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.628 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:583541f4:::benchmark_data_smithi188_104537_object28727:head# 2024-04-01T19:36:34.628 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.629 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58355215:::benchmark_data_smithi188_104537_object17947:head# 2024-04-01T19:36:34.629 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.629 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58356d12:::benchmark_data_smithi188_104537_object50430:head# 2024-04-01T19:36:34.629 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.629 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5835844c:::benchmark_data_smithi188_104537_object116342:head# 2024-04-01T19:36:34.629 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.630 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5835db96:::benchmark_data_smithi188_104537_object18848:head# 2024-04-01T19:36:34.630 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.630 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58365eb9:::benchmark_data_smithi188_104537_object64804:head# 2024-04-01T19:36:34.630 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.630 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5837a3be:::benchmark_data_smithi188_104537_object113185:head# 2024-04-01T19:36:34.630 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.630 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5838b69a:::benchmark_data_smithi188_104537_object112328:head# 2024-04-01T19:36:34.630 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.631 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:583964ae:::benchmark_data_smithi188_104537_object58176:head# 2024-04-01T19:36:34.631 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.631 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:583af599:::benchmark_data_smithi188_104537_object63706:head# 2024-04-01T19:36:34.631 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.632 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:583b0a51:::benchmark_data_smithi188_104537_object124517:head# 2024-04-01T19:36:34.632 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.632 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:583bb599:::benchmark_data_smithi188_104537_object130916:head# 2024-04-01T19:36:34.632 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.632 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:583bc270:::benchmark_data_smithi188_104537_object128547:head# 2024-04-01T19:36:34.632 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.636 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:583bcfac:::benchmark_data_smithi188_104537_object131097:head# 2024-04-01T19:36:34.636 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.636 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:583bd97f:::benchmark_data_smithi188_104537_object88299:head# 2024-04-01T19:36:34.636 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.636 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:583c494e:::benchmark_data_smithi188_104537_object99201:head# 2024-04-01T19:36:34.636 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.636 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:583cde4f:::benchmark_data_smithi188_104537_object15194:head# 2024-04-01T19:36:34.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:583cf066:::benchmark_data_smithi188_104537_object44112:head# 2024-04-01T19:36:34.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:583d04b8:::benchmark_data_smithi188_104537_object18388:head# 2024-04-01T19:36:34.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:583d3d68:::benchmark_data_smithi188_104537_object92892:head# 2024-04-01T19:36:34.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:583d5e6e:::benchmark_data_smithi188_104537_object138831:head# 2024-04-01T19:36:34.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:583da37f:::benchmark_data_smithi188_104537_object43483:head# 2024-04-01T19:36:34.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:583dcf2c:::benchmark_data_smithi188_104537_object146419:head# 2024-04-01T19:36:34.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:583dfd05:::benchmark_data_smithi188_104537_object79800:head# 2024-04-01T19:36:34.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:583ec43f:::benchmark_data_smithi188_104537_object52996:head# 2024-04-01T19:36:34.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:583f48ea:::benchmark_data_smithi188_104537_object82151:head# 2024-04-01T19:36:34.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:583f4f53:::benchmark_data_smithi188_104537_object54672:head# 2024-04-01T19:36:34.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:583f5037:::benchmark_data_smithi188_104537_object23488:head# 2024-04-01T19:36:34.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58405b17:::benchmark_data_smithi188_104537_object75532:head# 2024-04-01T19:36:34.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5841e3de:::benchmark_data_smithi188_104537_object115432:head# 2024-04-01T19:36:34.640 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.640 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58423923:::benchmark_data_smithi188_104537_object37016:head# 2024-04-01T19:36:34.640 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.640 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:584260b5:::benchmark_data_smithi188_104537_object162887:head# 2024-04-01T19:36:34.640 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.641 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5842cc2e:::benchmark_data_smithi188_104537_object132102:head# 2024-04-01T19:36:34.641 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.641 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5843084a:::benchmark_data_smithi188_104537_object149045:head# 2024-04-01T19:36:34.641 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.641 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58434789:::benchmark_data_smithi188_104537_object165354:head# 2024-04-01T19:36:34.641 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.641 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58435843:::benchmark_data_smithi188_104537_object151994:head# 2024-04-01T19:36:34.641 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.642 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:584372e6:::benchmark_data_smithi188_104537_object53367:head# 2024-04-01T19:36:34.642 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.642 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5844028c:::benchmark_data_smithi188_104537_object158128:head# 2024-04-01T19:36:34.642 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.642 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5844163b:::benchmark_data_smithi188_104537_object110504:head# 2024-04-01T19:36:34.643 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.643 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5844d3cc:::benchmark_data_smithi188_104537_object111995:head# 2024-04-01T19:36:34.643 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.643 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:584712c3:::benchmark_data_smithi188_104537_object157860:head# 2024-04-01T19:36:34.643 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.648 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58491807:::benchmark_data_smithi188_104537_object83285:head# 2024-04-01T19:36:34.648 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.648 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58493b56:::benchmark_data_smithi188_104537_object145460:head# 2024-04-01T19:36:34.648 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.649 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5849f5f3:::benchmark_data_smithi188_104537_object98070:head# 2024-04-01T19:36:34.649 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.649 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5849fd07:::benchmark_data_smithi188_104537_object69375:head# 2024-04-01T19:36:34.649 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.649 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:584a2ad1:::benchmark_data_smithi188_104537_object56112:head# 2024-04-01T19:36:34.649 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.649 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:584a46e4:::benchmark_data_smithi188_104537_object157940:head# 2024-04-01T19:36:34.649 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.649 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:584ab9b1:::benchmark_data_smithi188_104537_object152803:head# 2024-04-01T19:36:34.649 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.649 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:584bb32a:::benchmark_data_smithi188_104537_object162840:head# 2024-04-01T19:36:34.649 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.649 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:584c97c1:::benchmark_data_smithi188_104537_object40768:head# 2024-04-01T19:36:34.649 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.650 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:584ca983:::benchmark_data_smithi188_104537_object69036:head# 2024-04-01T19:36:34.650 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.650 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:584d5ecc:::benchmark_data_smithi188_104537_object112841:head# 2024-04-01T19:36:34.650 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.650 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:584da8e3:::benchmark_data_smithi188_104537_object122691:head# 2024-04-01T19:36:34.650 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.650 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:584e45da:::benchmark_data_smithi188_104537_object170418:head# 2024-04-01T19:36:34.650 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.650 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:584e809a:::benchmark_data_smithi188_104537_object98824:head# 2024-04-01T19:36:34.650 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.650 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:584f4ba0:::benchmark_data_smithi188_104537_object90529:head# 2024-04-01T19:36:34.650 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.650 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58502954:::benchmark_data_smithi188_104537_object114507:head# 2024-04-01T19:36:34.650 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.651 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5850d88f:::benchmark_data_smithi188_104537_object103696:head# 2024-04-01T19:36:34.651 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.651 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:585270d9:::benchmark_data_smithi188_104537_object15517:head# 2024-04-01T19:36:34.651 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.651 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5852e8fb:::benchmark_data_smithi188_104537_object66965:head# 2024-04-01T19:36:34.651 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.651 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5852f914:::benchmark_data_smithi188_104537_object140513:head# 2024-04-01T19:36:34.651 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.651 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58536f90:::benchmark_data_smithi188_104537_object65766:head# 2024-04-01T19:36:34.651 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.651 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5853a34c:::benchmark_data_smithi188_104537_object112944:head# 2024-04-01T19:36:34.651 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.655 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5853dd4e:::benchmark_data_smithi188_104537_object143810:head# 2024-04-01T19:36:34.655 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.655 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:585463dd:::benchmark_data_smithi188_104537_object22497:head# 2024-04-01T19:36:34.655 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.655 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58548b33:::benchmark_data_smithi188_104537_object139783:head# 2024-04-01T19:36:34.656 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.656 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5854c112:::benchmark_data_smithi188_104537_object55407:head# 2024-04-01T19:36:34.656 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.656 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5854f46a:::benchmark_data_smithi188_104537_object70744:head# 2024-04-01T19:36:34.656 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.656 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58550300:::benchmark_data_smithi188_104537_object87721:head# 2024-04-01T19:36:34.656 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.656 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58558fcb:::benchmark_data_smithi188_104537_object39712:head# 2024-04-01T19:36:34.656 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.656 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5856a064:::benchmark_data_smithi188_104537_object139404:head# 2024-04-01T19:36:34.656 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.656 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5856c4da:::benchmark_data_smithi188_104537_object157795:head# 2024-04-01T19:36:34.656 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.657 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58578159:::benchmark_data_smithi188_104537_object60721:head# 2024-04-01T19:36:34.657 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.657 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58584077:::benchmark_data_smithi188_104537_object141144:head# 2024-04-01T19:36:34.657 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.657 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58589bc5:::benchmark_data_smithi188_104537_object65233:head# 2024-04-01T19:36:34.657 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.657 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5858b2a9:::benchmark_data_smithi188_104537_object153288:head# 2024-04-01T19:36:34.657 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.657 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:585934c5:::benchmark_data_smithi188_104537_object107152:head# 2024-04-01T19:36:34.657 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.657 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5859ba55:::benchmark_data_smithi188_104537_object19980:head# 2024-04-01T19:36:34.657 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.657 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5859cc8c:::benchmark_data_smithi188_104537_object58461:head# 2024-04-01T19:36:34.657 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.658 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:585a6a87:::benchmark_data_smithi188_104537_object28431:head# 2024-04-01T19:36:34.658 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.658 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:585c3381:::benchmark_data_smithi188_104537_object126758:head# 2024-04-01T19:36:34.658 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.658 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:585c86c8:::benchmark_data_smithi188_104537_object16945:head# 2024-04-01T19:36:34.658 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.658 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:585d0f67:::benchmark_data_smithi188_104537_object35574:head# 2024-04-01T19:36:34.658 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.658 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:585d272e:::benchmark_data_smithi188_104537_object76591:head# 2024-04-01T19:36:34.658 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.658 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:585d4a34:::benchmark_data_smithi188_104537_object74699:head# 2024-04-01T19:36:34.658 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.658 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:585d9f67:::benchmark_data_smithi188_104537_object20047:head# 2024-04-01T19:36:34.658 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.659 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:585e3020:::benchmark_data_smithi188_104537_object105876:head# 2024-04-01T19:36:34.659 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.659 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:585f3265:::benchmark_data_smithi188_104537_object131872:head# 2024-04-01T19:36:34.659 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.659 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:585f46ea:::benchmark_data_smithi188_104537_object153152:head# 2024-04-01T19:36:34.659 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.664 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:585f7519:::benchmark_data_smithi188_104537_object123334:head# 2024-04-01T19:36:34.664 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.664 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:585f8e44:::benchmark_data_smithi188_104537_object56224:head# 2024-04-01T19:36:34.664 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.664 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:585fe7c6:::benchmark_data_smithi188_104537_object22995:head# 2024-04-01T19:36:34.664 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.664 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58601486:::benchmark_data_smithi188_104537_object138348:head# 2024-04-01T19:36:34.664 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.664 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58610eab:::benchmark_data_smithi188_104537_object147275:head# 2024-04-01T19:36:34.664 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.664 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58612ed1:::benchmark_data_smithi188_104537_object54763:head# 2024-04-01T19:36:34.664 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.664 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:586186a8:::benchmark_data_smithi188_104537_object143853:head# 2024-04-01T19:36:34.665 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.665 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58634996:::benchmark_data_smithi188_104537_object127579:head# 2024-04-01T19:36:34.665 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.665 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58635cef:::benchmark_data_smithi188_104537_object128645:head# 2024-04-01T19:36:34.665 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.665 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5863675a:::benchmark_data_smithi188_104537_object146445:head# 2024-04-01T19:36:34.665 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.665 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5864070b:::benchmark_data_smithi188_104537_object38562:head# 2024-04-01T19:36:34.665 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.665 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:586444a4:::benchmark_data_smithi188_104537_object106810:head# 2024-04-01T19:36:34.665 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.665 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5865ae82:::benchmark_data_smithi188_104537_object28225:head# 2024-04-01T19:36:34.665 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.665 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5865f00a:::benchmark_data_smithi188_104537_object91696:head# 2024-04-01T19:36:34.666 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.666 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58662895:::benchmark_data_smithi188_104537_object85175:head# 2024-04-01T19:36:34.666 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.666 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5868863c:::benchmark_data_smithi188_104537_object45484:head# 2024-04-01T19:36:34.666 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.666 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58688c28:::benchmark_data_smithi188_104537_object111665:head# 2024-04-01T19:36:34.666 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.666 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5868a9f4:::benchmark_data_smithi188_104537_object112108:head# 2024-04-01T19:36:34.666 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.666 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5868abde:::benchmark_data_smithi188_104537_object13146:head# 2024-04-01T19:36:34.666 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.666 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5868db17:::benchmark_data_smithi188_104537_object123435:head# 2024-04-01T19:36:34.666 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58696f18:::benchmark_data_smithi188_104537_object99709:head# 2024-04-01T19:36:34.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5869972c:::benchmark_data_smithi188_104537_object79470:head# 2024-04-01T19:36:34.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:586a5c59:::benchmark_data_smithi188_104537_object15210:head# 2024-04-01T19:36:34.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:586a8289:::benchmark_data_smithi188_104537_object41159:head# 2024-04-01T19:36:34.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:586ab23f:::benchmark_data_smithi188_104537_object122539:head# 2024-04-01T19:36:34.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:586ae814:::benchmark_data_smithi188_104537_object32832:head# 2024-04-01T19:36:34.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:586b2372:::benchmark_data_smithi188_104537_object149177:head# 2024-04-01T19:36:34.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:586b6929:::benchmark_data_smithi188_104537_object70083:head# 2024-04-01T19:36:34.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:586b6a25:::benchmark_data_smithi188_104537_object61778:head# 2024-04-01T19:36:34.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:586bb695:::benchmark_data_smithi188_104537_object153410:head# 2024-04-01T19:36:34.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:586bd2c7:::benchmark_data_smithi188_104537_object24467:head# 2024-04-01T19:36:34.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:586c26b5:::benchmark_data_smithi188_104537_object17670:head# 2024-04-01T19:36:34.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:586ccdd6:::benchmark_data_smithi188_104537_object36238:head# 2024-04-01T19:36:34.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:586d6857:::benchmark_data_smithi188_104537_object65028:head# 2024-04-01T19:36:34.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.673 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:586eb21d:::benchmark_data_smithi188_104537_object29810:head# 2024-04-01T19:36:34.673 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.673 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:586ec034:::benchmark_data_smithi188_104537_object113172:head# 2024-04-01T19:36:34.673 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.673 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:586f26e6:::benchmark_data_smithi188_104537_object73011:head# 2024-04-01T19:36:34.673 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.673 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:586f9e5b:::benchmark_data_smithi188_104537_object52946:head# 2024-04-01T19:36:34.673 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.673 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:586fe770:::benchmark_data_smithi188_104537_object65141:head# 2024-04-01T19:36:34.673 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.674 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58704198:::benchmark_data_smithi188_104537_object74148:head# 2024-04-01T19:36:34.674 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.674 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58706c60:::benchmark_data_smithi188_104537_object26308:head# 2024-04-01T19:36:34.674 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.674 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58713df8:::benchmark_data_smithi188_104537_object84092:head# 2024-04-01T19:36:34.674 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.674 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5871a3e5:::benchmark_data_smithi188_104537_object158990:head# 2024-04-01T19:36:34.674 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.674 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5871b765:::benchmark_data_smithi188_104537_object149775:head# 2024-04-01T19:36:34.674 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.674 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5871d00f:::benchmark_data_smithi188_104537_object112213:head# 2024-04-01T19:36:34.674 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.674 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5871f661:::benchmark_data_smithi188_104537_object118369:head# 2024-04-01T19:36:34.674 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.675 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5871f788:::benchmark_data_smithi188_104537_object32170:head# 2024-04-01T19:36:34.675 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.675 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:587243cd:::benchmark_data_smithi188_104537_object106233:head# 2024-04-01T19:36:34.675 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.675 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58726e1b:::benchmark_data_smithi188_104537_object161878:head# 2024-04-01T19:36:34.675 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.675 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:587271bb:::benchmark_data_smithi188_104537_object92113:head# 2024-04-01T19:36:34.675 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.675 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58727aa6:::benchmark_data_smithi188_104537_object80017:head# 2024-04-01T19:36:34.675 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.675 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58728e85:::benchmark_data_smithi188_104537_object155879:head# 2024-04-01T19:36:34.675 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.675 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:587312c8:::benchmark_data_smithi188_104537_object91281:head# 2024-04-01T19:36:34.676 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.676 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58732eaa:::benchmark_data_smithi188_104537_object130956:head# 2024-04-01T19:36:34.676 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.676 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58735a0b:::benchmark_data_smithi188_104537_object145973:head# 2024-04-01T19:36:34.676 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.676 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5873af2d:::benchmark_data_smithi188_104537_object143291:head# 2024-04-01T19:36:34.676 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.676 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58741043:::benchmark_data_smithi188_104537_object23227:head# 2024-04-01T19:36:34.676 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.676 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58759dad:::benchmark_data_smithi188_104537_object38418:head# 2024-04-01T19:36:34.676 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.676 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5875f17f:::benchmark_data_smithi188_104537_object19174:head# 2024-04-01T19:36:34.676 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.676 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58760159:::benchmark_data_smithi188_104537_object52285:head# 2024-04-01T19:36:34.677 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.677 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:587649ef:::benchmark_data_smithi188_104537_object49773:head# 2024-04-01T19:36:34.677 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.677 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58769720:::benchmark_data_smithi188_104537_object162464:head# 2024-04-01T19:36:34.677 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.677 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58769fc5:::benchmark_data_smithi188_104537_object130055:head# 2024-04-01T19:36:34.677 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.677 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5877953e:::benchmark_data_smithi188_104537_object71258:head# 2024-04-01T19:36:34.677 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.677 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58781077:::benchmark_data_smithi188_104537_object39861:head# 2024-04-01T19:36:34.678 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.678 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58785344:::benchmark_data_smithi188_104537_object52014:head# 2024-04-01T19:36:34.678 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.678 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5878b295:::benchmark_data_smithi188_104537_object164531:head# 2024-04-01T19:36:34.678 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.678 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58794d3a:::benchmark_data_smithi188_104537_object78303:head# 2024-04-01T19:36:34.678 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.678 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5879e138:::benchmark_data_smithi188_104537_object41974:head# 2024-04-01T19:36:34.678 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.678 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5879e27f:::benchmark_data_smithi188_104537_object100697:head# 2024-04-01T19:36:34.678 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.679 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:36:34.681 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5879e930:::benchmark_data_smithi188_104537_object88953:head# 2024-04-01T19:36:34.681 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.681 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:587a0e4d:::benchmark_data_smithi188_104537_object35327:head# 2024-04-01T19:36:34.681 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.682 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:587a0f8e:::benchmark_data_smithi188_104537_object53714:head# 2024-04-01T19:36:34.682 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.682 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:587a186e:::benchmark_data_smithi188_104537_object113196:head# 2024-04-01T19:36:34.682 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.682 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:587a3a81:::benchmark_data_smithi188_104537_object159098:head# 2024-04-01T19:36:34.682 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.682 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:587a61ac:::benchmark_data_smithi188_104537_object29973:head# 2024-04-01T19:36:34.682 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.682 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:587a7cc8:::benchmark_data_smithi188_104537_object137016:head# 2024-04-01T19:36:34.682 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.683 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:34.683 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:36:34.685 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:587b707b:::benchmark_data_smithi188_104537_object34596:head# 2024-04-01T19:36:34.685 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.685 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:587ca6cb:::benchmark_data_smithi188_104537_object145249:head# 2024-04-01T19:36:34.685 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.686 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:587d058f:::benchmark_data_smithi188_104537_object110995:head# 2024-04-01T19:36:34.686 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.686 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:587d2e40:::benchmark_data_smithi188_104537_object156040:head# 2024-04-01T19:36:34.686 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.686 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:587e0e57:::benchmark_data_smithi188_104537_object170978:head# 2024-04-01T19:36:34.686 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.686 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:587e8264:::benchmark_data_smithi188_104537_object109352:head# 2024-04-01T19:36:34.686 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.686 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:587eb82d:::benchmark_data_smithi188_104537_object58780:head# 2024-04-01T19:36:34.686 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.686 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:587eee4a:::benchmark_data_smithi188_104537_object100252:head# 2024-04-01T19:36:34.686 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.686 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:587f3c82:::benchmark_data_smithi188_104537_object72728:head# 2024-04-01T19:36:34.687 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.687 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:588044af:::benchmark_data_smithi188_104537_object39934:head# 2024-04-01T19:36:34.687 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.687 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5880a7e8:::benchmark_data_smithi188_104537_object61041:head# 2024-04-01T19:36:34.687 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.687 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5882aab7:::benchmark_data_smithi188_104537_object80094:head# 2024-04-01T19:36:34.687 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.687 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5882b01e:::benchmark_data_smithi188_104537_object118447:head# 2024-04-01T19:36:34.687 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.688 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5882c160:::benchmark_data_smithi188_104537_object114733:head# 2024-04-01T19:36:34.688 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.688 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5882c2cf:::benchmark_data_smithi188_104537_object15605:head# 2024-04-01T19:36:34.688 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.688 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58848081:::benchmark_data_smithi188_104537_object147104:head# 2024-04-01T19:36:34.688 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.689 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5884eb12:::benchmark_data_smithi188_104537_object89967:head# 2024-04-01T19:36:34.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.689 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:588538be:::benchmark_data_smithi188_104537_object105561:head# 2024-04-01T19:36:34.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.689 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5885e432:::benchmark_data_smithi188_104537_object102823:head# 2024-04-01T19:36:34.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.689 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58865100:::benchmark_data_smithi188_104537_object14808:head# 2024-04-01T19:36:34.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.690 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58866783:::benchmark_data_smithi188_104537_object93503:head# 2024-04-01T19:36:34.690 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.691 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58870061:::benchmark_data_smithi188_104537_object47227:head# 2024-04-01T19:36:34.691 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.691 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5887183b:::benchmark_data_smithi188_104537_object122886:head# 2024-04-01T19:36:34.691 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.691 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58874609:::benchmark_data_smithi188_104537_object170612:head# 2024-04-01T19:36:34.691 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.691 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5887a7e8:::benchmark_data_smithi188_104537_object79980:head# 2024-04-01T19:36:34.691 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.691 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:588811f7:::benchmark_data_smithi188_104537_object42250:head# 2024-04-01T19:36:34.691 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.691 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5888a7b0:::benchmark_data_smithi188_104537_object38845:head# 2024-04-01T19:36:34.691 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.692 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5889678f:::benchmark_data_smithi188_104537_object137663:head# 2024-04-01T19:36:34.692 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.692 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58899e57:::benchmark_data_smithi188_104537_object126638:head# 2024-04-01T19:36:34.692 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.692 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5889b5cf:::benchmark_data_smithi188_104537_object22031:head# 2024-04-01T19:36:34.692 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.692 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5889f820:::benchmark_data_smithi188_104537_object107450:head# 2024-04-01T19:36:34.692 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.693 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:588a022b:::benchmark_data_smithi188_104537_object79680:head# 2024-04-01T19:36:34.694 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.694 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:588a07d1:::benchmark_data_smithi188_104537_object64973:head# 2024-04-01T19:36:34.694 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.694 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:588a1730:::benchmark_data_smithi188_104537_object131700:head# 2024-04-01T19:36:34.694 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.694 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:588a292d:::benchmark_data_smithi188_104537_object86852:head# 2024-04-01T19:36:34.694 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.694 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:588a990e:::benchmark_data_smithi188_104537_object90375:head# 2024-04-01T19:36:34.694 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.694 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:588aab10:::benchmark_data_smithi188_104537_object89856:head# 2024-04-01T19:36:34.694 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.694 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:588acea2:::benchmark_data_smithi188_104537_object42089:head# 2024-04-01T19:36:34.694 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.694 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:588b35c7:::benchmark_data_smithi188_104537_object88647:head# 2024-04-01T19:36:34.695 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.695 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:588b7944:::benchmark_data_smithi188_104537_object34430:head# 2024-04-01T19:36:34.695 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.695 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:588bd546:::benchmark_data_smithi188_104537_object91940:head# 2024-04-01T19:36:34.695 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.696 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:588ca70c:::benchmark_data_smithi188_104537_object52943:head# 2024-04-01T19:36:34.696 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.696 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:588da11a:::benchmark_data_smithi188_104537_object157218:head# 2024-04-01T19:36:34.696 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.696 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:588daefc:::benchmark_data_smithi188_104537_object30784:head# 2024-04-01T19:36:34.696 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.696 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:588dd182:::benchmark_data_smithi188_104537_object91813:head# 2024-04-01T19:36:34.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:588ea82a:::benchmark_data_smithi188_104537_object88622:head# 2024-04-01T19:36:34.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:588f03f6:::benchmark_data_smithi188_104537_object91761:head# 2024-04-01T19:36:34.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:588f5954:::benchmark_data_smithi188_104537_object64957:head# 2024-04-01T19:36:34.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5890014c:::benchmark_data_smithi188_104537_object125420:head# 2024-04-01T19:36:34.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58911f70:::benchmark_data_smithi188_104537_object20341:head# 2024-04-01T19:36:34.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.699 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:589203d3:::benchmark_data_smithi188_104537_object30935:head# 2024-04-01T19:36:34.699 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.699 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5892096b:::benchmark_data_smithi188_104537_object170151:head# 2024-04-01T19:36:34.699 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.699 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:589287cc:::benchmark_data_smithi188_104537_object130675:head# 2024-04-01T19:36:34.699 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.699 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58928a2c:::benchmark_data_smithi188_104537_object68162:head# 2024-04-01T19:36:34.699 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.699 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5892a6b3:::benchmark_data_smithi188_104537_object41349:head# 2024-04-01T19:36:34.699 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.699 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5892ac2a:::benchmark_data_smithi188_104537_object162980:head# 2024-04-01T19:36:34.699 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.699 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:589309be:::benchmark_data_smithi188_104537_object28759:head# 2024-04-01T19:36:34.700 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.700 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:589341dc:::benchmark_data_smithi188_104537_object136432:head# 2024-04-01T19:36:34.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5894c071:::benchmark_data_smithi188_104537_object60099:head# 2024-04-01T19:36:34.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5894cc07:::benchmark_data_smithi188_104537_object65406:head# 2024-04-01T19:36:34.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5895112e:::benchmark_data_smithi188_104537_object110550:head# 2024-04-01T19:36:34.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:589566c2:::benchmark_data_smithi188_104537_object65363:head# 2024-04-01T19:36:34.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5895ac3a:::benchmark_data_smithi188_104537_object52011:head# 2024-04-01T19:36:34.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5895b464:::benchmark_data_smithi188_104537_object60789:head# 2024-04-01T19:36:34.702 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.702 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5896a6ad:::benchmark_data_smithi188_104537_object23582:head# 2024-04-01T19:36:34.702 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.703 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5896d272:::benchmark_data_smithi188_104537_object46001:head# 2024-04-01T19:36:34.703 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.703 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58970f8b:::benchmark_data_smithi188_104537_object37587:head# 2024-04-01T19:36:34.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5897cb70:::benchmark_data_smithi188_104537_object168115:head# 2024-04-01T19:36:34.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5897dc5c:::benchmark_data_smithi188_104537_object125587:head# 2024-04-01T19:36:34.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5897e382:::benchmark_data_smithi188_104537_object66117:head# 2024-04-01T19:36:34.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:589898b3:::benchmark_data_smithi188_104537_object38475:head# 2024-04-01T19:36:34.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5898c571:::benchmark_data_smithi188_104537_object77398:head# 2024-04-01T19:36:34.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5898cce8:::benchmark_data_smithi188_104537_object21197:head# 2024-04-01T19:36:34.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.705 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5899160c:::benchmark_data_smithi188_104537_object153651:head# 2024-04-01T19:36:34.705 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.706 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58995f55:::benchmark_data_smithi188_104537_object35182:head# 2024-04-01T19:36:34.706 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.706 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:589a709e:::benchmark_data_smithi188_104537_object51948:head# 2024-04-01T19:36:34.706 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.706 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:589baea8:::benchmark_data_smithi188_104537_object131736:head# 2024-04-01T19:36:34.706 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.706 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:589baebe:::benchmark_data_smithi188_104537_object166254:head# 2024-04-01T19:36:34.706 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.706 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:589bddd2:::benchmark_data_smithi188_104537_object95201:head# 2024-04-01T19:36:34.706 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.706 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:589c2b98:::benchmark_data_smithi188_104537_object75869:head# 2024-04-01T19:36:34.706 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.706 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:589c622d:::benchmark_data_smithi188_104537_object44335:head# 2024-04-01T19:36:34.707 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.707 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:589cc9cb:::benchmark_data_smithi188_104537_object26528:head# 2024-04-01T19:36:34.707 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.708 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:589d169f:::benchmark_data_smithi188_104537_object157700:head# 2024-04-01T19:36:34.708 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.708 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:589d6ed5:::benchmark_data_smithi188_104537_object145184:head# 2024-04-01T19:36:34.708 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:589de2d2:::benchmark_data_smithi188_104537_object108493:head# 2024-04-01T19:36:34.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:589ded5c:::benchmark_data_smithi188_104537_object49818:head# 2024-04-01T19:36:34.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58a0621f:::benchmark_data_smithi188_104537_object113980:head# 2024-04-01T19:36:34.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58a0658f:::benchmark_data_smithi188_104537_object68470:head# 2024-04-01T19:36:34.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58a1787f:::benchmark_data_smithi188_104537_object12207:head# 2024-04-01T19:36:34.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58a2231a:::benchmark_data_smithi188_104537_object27444:head# 2024-04-01T19:36:34.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58a232f4:::benchmark_data_smithi188_104537_object51975:head# 2024-04-01T19:36:34.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.710 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58a3382e:::benchmark_data_smithi188_104537_object17102:head# 2024-04-01T19:36:34.710 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.710 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58a39fa5:::benchmark_data_smithi188_104537_object132748:head# 2024-04-01T19:36:34.710 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.711 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58a3e0b6:::benchmark_data_smithi188_104537_object59360:head# 2024-04-01T19:36:34.711 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.711 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58a40cda:::benchmark_data_smithi188_104537_object19335:head# 2024-04-01T19:36:34.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58a441a0:::benchmark_data_smithi188_104537_object49208:head# 2024-04-01T19:36:34.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58a492fb:::benchmark_data_smithi188_104537_object102397:head# 2024-04-01T19:36:34.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58a4dc9f:::benchmark_data_smithi188_104537_object18398:head# 2024-04-01T19:36:34.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58a50aad:::benchmark_data_smithi188_104537_object13296:head# 2024-04-01T19:36:34.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58a528a6:::benchmark_data_smithi188_104537_object119995:head# 2024-04-01T19:36:34.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58a5c3fc:::benchmark_data_smithi188_104537_object152623:head# 2024-04-01T19:36:34.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.713 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58a684f7:::benchmark_data_smithi188_104537_object34819:head# 2024-04-01T19:36:34.713 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.713 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58a811e3:::benchmark_data_smithi188_104537_object164472:head# 2024-04-01T19:36:34.713 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.713 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58a83a67:::benchmark_data_smithi188_104537_object45973:head# 2024-04-01T19:36:34.713 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.713 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58a8b78c:::benchmark_data_smithi188_104537_object82107:head# 2024-04-01T19:36:34.713 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.714 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58a8c908:::benchmark_data_smithi188_104537_object123406:head# 2024-04-01T19:36:34.714 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58a921be:::benchmark_data_smithi188_104537_object95132:head# 2024-04-01T19:36:34.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58a93c58:::benchmark_data_smithi188_104537_object122881:head# 2024-04-01T19:36:34.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58a94a12:::benchmark_data_smithi188_104537_object158565:head# 2024-04-01T19:36:34.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58a9d027:::benchmark_data_smithi188_104537_object68338:head# 2024-04-01T19:36:34.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58a9d0e5:::benchmark_data_smithi188_104537_object36620:head# 2024-04-01T19:36:34.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58aa74bb:::benchmark_data_smithi188_104537_object165111:head# 2024-04-01T19:36:34.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58aaa9ca:::benchmark_data_smithi188_104537_object42838:head# 2024-04-01T19:36:34.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.716 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58aabd5c:::benchmark_data_smithi188_104537_object41485:head# 2024-04-01T19:36:34.716 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.716 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58aad24d:::benchmark_data_smithi188_104537_object23065:head# 2024-04-01T19:36:34.716 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ab16cf:::benchmark_data_smithi188_104537_object109326:head# 2024-04-01T19:36:34.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.721 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ab61c7:::benchmark_data_smithi188_104537_object42677:head# 2024-04-01T19:36:34.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58abfa87:::benchmark_data_smithi188_104537_object18440:head# 2024-04-01T19:36:34.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ac027b:::benchmark_data_smithi188_104537_object130813:head# 2024-04-01T19:36:34.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ac1757:::benchmark_data_smithi188_104537_object59917:head# 2024-04-01T19:36:34.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ac705d:::benchmark_data_smithi188_104537_object68889:head# 2024-04-01T19:36:34.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.726 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58acd192:::benchmark_data_smithi188_104537_object96971:head# 2024-04-01T19:36:34.726 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.726 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ace769:::benchmark_data_smithi188_104537_object57328:head# 2024-04-01T19:36:34.726 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.726 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58acf7bc:::benchmark_data_smithi188_104537_object132744:head# 2024-04-01T19:36:34.727 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.727 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ad1695:::benchmark_data_smithi188_104537_object130852:head# 2024-04-01T19:36:34.727 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.727 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58adde88:::benchmark_data_smithi188_104537_object23449:head# 2024-04-01T19:36:34.727 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.727 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58addef5:::benchmark_data_smithi188_104537_object131815:head# 2024-04-01T19:36:34.727 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.727 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58aea37e:::benchmark_data_smithi188_104537_object32527:head# 2024-04-01T19:36:34.727 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.727 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58aeb288:::benchmark_data_smithi188_104537_object149526:head# 2024-04-01T19:36:34.727 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.727 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58b073c2:::benchmark_data_smithi188_104537_object129282:head# 2024-04-01T19:36:34.727 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.728 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58b1b847:::benchmark_data_smithi188_104537_object81546:head# 2024-04-01T19:36:34.728 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.728 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58b1bf4a:::benchmark_data_smithi188_104537_object53413:head# 2024-04-01T19:36:34.728 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.728 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58b308ca:::benchmark_data_smithi188_104537_object170779:head# 2024-04-01T19:36:34.728 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.728 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58b32406:::benchmark_data_smithi188_104537_object38057:head# 2024-04-01T19:36:34.728 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.728 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58b389b2:::benchmark_data_smithi188_104537_object131503:head# 2024-04-01T19:36:34.728 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58b4cc45:::benchmark_data_smithi188_104537_object12840:head# 2024-04-01T19:36:34.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58b4cd7b:::benchmark_data_smithi188_104537_object29087:head# 2024-04-01T19:36:34.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58b58959:::benchmark_data_smithi188_104537_object80802:head# 2024-04-01T19:36:34.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58b5ea98:::benchmark_data_smithi188_104537_object132140:head# 2024-04-01T19:36:34.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58b61b37:::benchmark_data_smithi188_104537_object74725:head# 2024-04-01T19:36:34.731 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.731 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58b6647d:::benchmark_data_smithi188_104537_object109855:head# 2024-04-01T19:36:34.731 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.731 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58b6b720:::benchmark_data_smithi188_104537_object101800:head# 2024-04-01T19:36:34.731 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.731 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58b82062:::benchmark_data_smithi188_104537_object147586:head# 2024-04-01T19:36:34.731 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.731 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58b87ecb:::benchmark_data_smithi188_104537_object12375:head# 2024-04-01T19:36:34.731 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.731 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58b8ab51:::benchmark_data_smithi188_104537_object55286:head# 2024-04-01T19:36:34.731 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.732 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58b8faa6:::benchmark_data_smithi188_104537_object27472:head# 2024-04-01T19:36:34.733 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.733 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58b940de:::benchmark_data_smithi188_104537_object35377:head# 2024-04-01T19:36:34.733 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.733 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58b95699:::benchmark_data_smithi188_104537_object167601:head# 2024-04-01T19:36:34.733 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.733 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58b9991e:::benchmark_data_smithi188_104537_object83004:head# 2024-04-01T19:36:34.733 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.733 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58b99fb2:::benchmark_data_smithi188_104537_object152509:head# 2024-04-01T19:36:34.733 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.733 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58bac47e:::benchmark_data_smithi188_104537_object27971:head# 2024-04-01T19:36:34.733 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.733 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58bafadf:::benchmark_data_smithi188_104537_object108714:head# 2024-04-01T19:36:34.733 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58bb212c:::benchmark_data_smithi188_104537_object154202:head# 2024-04-01T19:36:34.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58bb6e73:::benchmark_data_smithi188_104537_object22059:head# 2024-04-01T19:36:34.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58bb8e29:::benchmark_data_smithi188_104537_object165443:head# 2024-04-01T19:36:34.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58bb9701:::benchmark_data_smithi188_104537_object59378:head# 2024-04-01T19:36:34.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58bc8ec9:::benchmark_data_smithi188_104537_object56147:head# 2024-04-01T19:36:34.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58bc9df5:::benchmark_data_smithi188_104537_object80953:head# 2024-04-01T19:36:34.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.740 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58bcdeb5:::benchmark_data_smithi188_104537_object140569:head# 2024-04-01T19:36:34.740 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.740 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58be172e:::benchmark_data_smithi188_104537_object140737:head# 2024-04-01T19:36:34.740 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.740 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58be9604:::benchmark_data_smithi188_104537_object112107:head# 2024-04-01T19:36:34.740 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.740 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58bf0da4:::benchmark_data_smithi188_104537_object161757:head# 2024-04-01T19:36:34.740 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.740 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58bfb3db:::benchmark_data_smithi188_104537_object79122:head# 2024-04-01T19:36:34.740 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.740 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c000eb:::benchmark_data_smithi188_104537_object126206:head# 2024-04-01T19:36:34.740 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.742 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c00266:::benchmark_data_smithi188_104537_object147330:head# 2024-04-01T19:36:34.743 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.743 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c0d650:::benchmark_data_smithi188_104537_object133109:head# 2024-04-01T19:36:34.743 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.743 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c137d3:::benchmark_data_smithi188_104537_object104585:head# 2024-04-01T19:36:34.743 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.743 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c1525e:::benchmark_data_smithi188_104537_object52723:head# 2024-04-01T19:36:34.743 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.743 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c1c121:::benchmark_data_smithi188_104537_object96888:head# 2024-04-01T19:36:34.743 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.743 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c22ca8:::benchmark_data_smithi188_104537_object49612:head# 2024-04-01T19:36:34.743 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.743 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c2765d:::benchmark_data_smithi188_104537_object171089:head# 2024-04-01T19:36:34.743 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.743 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c27aea:::benchmark_data_smithi188_104537_object97305:head# 2024-04-01T19:36:34.744 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.744 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c2dc27:::benchmark_data_smithi188_104537_object37331:head# 2024-04-01T19:36:34.744 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.744 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c3050f:::benchmark_data_smithi188_104537_object26564:head# 2024-04-01T19:36:34.744 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.744 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c30687:::benchmark_data_smithi188_104537_object17570:head# 2024-04-01T19:36:34.744 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.744 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c329eb:::benchmark_data_smithi188_104537_object28725:head# 2024-04-01T19:36:34.744 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.746 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c374f3:::benchmark_data_smithi188_104537_object35016:head# 2024-04-01T19:36:34.746 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.746 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c3b764:::benchmark_data_smithi188_104537_object98874:head# 2024-04-01T19:36:34.746 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.746 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c46cbf:::benchmark_data_smithi188_104537_object157711:head# 2024-04-01T19:36:34.746 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.746 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c551bf:::benchmark_data_smithi188_104537_object162702:head# 2024-04-01T19:36:34.746 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.746 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c56c88:::benchmark_data_smithi188_104537_object18401:head# 2024-04-01T19:36:34.746 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.746 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c5d527:::benchmark_data_smithi188_104537_object23071:head# 2024-04-01T19:36:34.746 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.746 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c66222:::benchmark_data_smithi188_104537_object99479:head# 2024-04-01T19:36:34.747 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.747 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c6b61d:::benchmark_data_smithi188_104537_object67752:head# 2024-04-01T19:36:34.747 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.747 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c6bfae:::benchmark_data_smithi188_104537_object112132:head# 2024-04-01T19:36:34.747 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.753 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c6f8b8:::benchmark_data_smithi188_104537_object150910:head# 2024-04-01T19:36:34.753 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.753 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c7121e:::benchmark_data_smithi188_104537_object160962:head# 2024-04-01T19:36:34.754 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.754 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c794d9:::benchmark_data_smithi188_104537_object44411:head# 2024-04-01T19:36:34.754 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.754 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c7ce3c:::benchmark_data_smithi188_104537_object91268:head# 2024-04-01T19:36:34.754 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.754 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c82f79:::benchmark_data_smithi188_104537_object115463:head# 2024-04-01T19:36:34.755 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.755 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c8402d:::benchmark_data_smithi188_104537_object38811:head# 2024-04-01T19:36:34.755 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.755 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c87690:::benchmark_data_smithi188_104537_object80647:head# 2024-04-01T19:36:34.755 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.755 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c8faa9:::benchmark_data_smithi188_104537_object99226:head# 2024-04-01T19:36:34.755 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.757 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c90670:::benchmark_data_smithi188_104537_object110876:head# 2024-04-01T19:36:34.757 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.757 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58c922ab:::benchmark_data_smithi188_104537_object139964:head# 2024-04-01T19:36:34.757 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.757 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ca695b:::benchmark_data_smithi188_104537_object68986:head# 2024-04-01T19:36:34.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58caaeee:::benchmark_data_smithi188_104537_object116288:head# 2024-04-01T19:36:34.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58cb86fa:::benchmark_data_smithi188_104537_object105785:head# 2024-04-01T19:36:34.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58cbccc6:::benchmark_data_smithi188_104537_object15313:head# 2024-04-01T19:36:34.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58cc6942:::benchmark_data_smithi188_104537_object99281:head# 2024-04-01T19:36:34.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ccbb76:::benchmark_data_smithi188_104537_object50705:head# 2024-04-01T19:36:34.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ccbfe5:::benchmark_data_smithi188_104537_object51736:head# 2024-04-01T19:36:34.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.759 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ccd172:::benchmark_data_smithi188_104537_object24200:head# 2024-04-01T19:36:34.759 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.759 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58cd3210:::benchmark_data_smithi188_104537_object105558:head# 2024-04-01T19:36:34.759 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.760 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ce1ca0:::benchmark_data_smithi188_104537_object117415:head# 2024-04-01T19:36:34.761 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.761 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ce6fc0:::benchmark_data_smithi188_104537_object158030:head# 2024-04-01T19:36:34.761 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.761 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ce7057:::benchmark_data_smithi188_104537_object131328:head# 2024-04-01T19:36:34.761 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.761 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ceaa82:::benchmark_data_smithi188_104537_object134209:head# 2024-04-01T19:36:34.761 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.761 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58cf6a7a:::benchmark_data_smithi188_104537_object76038:head# 2024-04-01T19:36:34.761 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.761 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58cff1af:::benchmark_data_smithi188_104537_object130061:head# 2024-04-01T19:36:34.761 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.761 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58cffbef:::benchmark_data_smithi188_104537_object69534:head# 2024-04-01T19:36:34.761 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.762 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d0235b:::benchmark_data_smithi188_104537_object65954:head# 2024-04-01T19:36:34.762 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.762 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d06963:::benchmark_data_smithi188_104537_object115145:head# 2024-04-01T19:36:34.762 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.762 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d0794e:::benchmark_data_smithi188_104537_object130088:head# 2024-04-01T19:36:34.762 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.762 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d1237a:::benchmark_data_smithi188_104537_object148374:head# 2024-04-01T19:36:34.762 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d123c5:::benchmark_data_smithi188_104537_object63979:head# 2024-04-01T19:36:34.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d12a75:::benchmark_data_smithi188_104537_object66268:head# 2024-04-01T19:36:34.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.766 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d1805a:::benchmark_data_smithi188_104537_object88496:head# 2024-04-01T19:36:34.766 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.766 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d25182:::benchmark_data_smithi188_104537_object110980:head# 2024-04-01T19:36:34.766 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.766 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d2a465:::benchmark_data_smithi188_104537_object107930:head# 2024-04-01T19:36:34.766 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.766 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d31bd8:::benchmark_data_smithi188_104537_object130223:head# 2024-04-01T19:36:34.766 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.766 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d482fb:::benchmark_data_smithi188_104537_object146396:head# 2024-04-01T19:36:34.766 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.766 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d4c89f:::benchmark_data_smithi188_104537_object145738:head# 2024-04-01T19:36:34.766 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.766 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d4d62a:::benchmark_data_smithi188_104537_object127087:head# 2024-04-01T19:36:34.767 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.767 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d50a74:::benchmark_data_smithi188_104537_object96347:head# 2024-04-01T19:36:34.767 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.767 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d53bcb:::benchmark_data_smithi188_104537_object29541:head# 2024-04-01T19:36:34.767 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.767 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d57e14:::benchmark_data_smithi188_104537_object35209:head# 2024-04-01T19:36:34.767 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.767 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d5b85d:::benchmark_data_smithi188_104537_object79032:head# 2024-04-01T19:36:34.767 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.767 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d69654:::benchmark_data_smithi188_104537_object75483:head# 2024-04-01T19:36:34.767 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.767 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d6d5f1:::benchmark_data_smithi188_104537_object11188:head# 2024-04-01T19:36:34.767 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.767 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d6eb13:::benchmark_data_smithi188_104537_object101488:head# 2024-04-01T19:36:34.768 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.768 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d753e2:::benchmark_data_smithi188_104537_object148325:head# 2024-04-01T19:36:34.768 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.768 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d7b633:::benchmark_data_smithi188_104537_object99110:head# 2024-04-01T19:36:34.768 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.768 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d80a28:::benchmark_data_smithi188_104537_object42535:head# 2024-04-01T19:36:34.768 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.771 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d8e14e:::benchmark_data_smithi188_104537_object97252:head# 2024-04-01T19:36:34.771 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.771 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d8ed9e:::benchmark_data_smithi188_104537_object39381:head# 2024-04-01T19:36:34.771 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.771 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d8f834:::benchmark_data_smithi188_104537_object87843:head# 2024-04-01T19:36:34.771 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.771 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d90c86:::benchmark_data_smithi188_104537_object12403:head# 2024-04-01T19:36:34.771 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.771 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d981b4:::benchmark_data_smithi188_104537_object104194:head# 2024-04-01T19:36:34.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d98bfa:::benchmark_data_smithi188_104537_object84919:head# 2024-04-01T19:36:34.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d9b253:::benchmark_data_smithi188_104537_object145830:head# 2024-04-01T19:36:34.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58d9cf4d:::benchmark_data_smithi188_104537_object94566:head# 2024-04-01T19:36:34.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58da3872:::benchmark_data_smithi188_104537_object77541:head# 2024-04-01T19:36:34.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58da778a:::benchmark_data_smithi188_104537_object49399:head# 2024-04-01T19:36:34.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58dab1e6:::benchmark_data_smithi188_104537_object76544:head# 2024-04-01T19:36:34.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58dad3b3:::benchmark_data_smithi188_104537_object67410:head# 2024-04-01T19:36:34.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58dad7cf:::benchmark_data_smithi188_104537_object155337:head# 2024-04-01T19:36:34.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58daed5c:::benchmark_data_smithi188_104537_object53543:head# 2024-04-01T19:36:34.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58dbd4d3:::benchmark_data_smithi188_104537_object91758:head# 2024-04-01T19:36:34.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58dbded4:::benchmark_data_smithi188_104537_object56647:head# 2024-04-01T19:36:34.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58dc6012:::benchmark_data_smithi188_104537_object166376:head# 2024-04-01T19:36:34.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58dc77b7:::benchmark_data_smithi188_104537_object82698:head# 2024-04-01T19:36:34.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58dca456:::benchmark_data_smithi188_104537_object105799:head# 2024-04-01T19:36:34.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.774 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58dcb924:::benchmark_data_smithi188_104537_object103484:head# 2024-04-01T19:36:34.774 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.774 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58dcdcb7:::benchmark_data_smithi188_104537_object112622:head# 2024-04-01T19:36:34.774 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.774 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58dce352:::benchmark_data_smithi188_104537_object153674:head# 2024-04-01T19:36:34.774 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.774 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58dd358b:::benchmark_data_smithi188_104537_object34861:head# 2024-04-01T19:36:34.774 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58dd7cdf:::benchmark_data_smithi188_104537_object42329:head# 2024-04-01T19:36:34.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58dde6b7:::benchmark_data_smithi188_104537_object146757:head# 2024-04-01T19:36:34.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58de30b5:::benchmark_data_smithi188_104537_object88879:head# 2024-04-01T19:36:34.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58debf36:::benchmark_data_smithi188_104537_object73937:head# 2024-04-01T19:36:34.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58dedfec:::benchmark_data_smithi188_104537_object157184:head# 2024-04-01T19:36:34.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58dfb035:::benchmark_data_smithi188_104537_object66267:head# 2024-04-01T19:36:34.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e066e0:::benchmark_data_smithi188_104537_object126349:head# 2024-04-01T19:36:34.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e06ccc:::benchmark_data_smithi188_104537_object137433:head# 2024-04-01T19:36:34.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.779 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e09eef:::benchmark_data_smithi188_104537_object121465:head# 2024-04-01T19:36:34.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.779 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e0ae45:::benchmark_data_smithi188_104537_object18493:head# 2024-04-01T19:36:34.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.779 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e0c5fe:::benchmark_data_smithi188_104537_object112706:head# 2024-04-01T19:36:34.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.779 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e0ce5b:::benchmark_data_smithi188_104537_object107763:head# 2024-04-01T19:36:34.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.779 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e14c82:::benchmark_data_smithi188_104537_object31003:head# 2024-04-01T19:36:34.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.779 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e19513:::benchmark_data_smithi188_104537_object58537:head# 2024-04-01T19:36:34.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.779 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e1a818:::benchmark_data_smithi188_104537_object24869:head# 2024-04-01T19:36:34.780 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.780 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e22497:::benchmark_data_smithi188_104537_object91327:head# 2024-04-01T19:36:34.780 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.780 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e22b60:::benchmark_data_smithi188_104537_object143639:head# 2024-04-01T19:36:34.780 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.780 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e2dcf6:::benchmark_data_smithi188_104537_object130719:head# 2024-04-01T19:36:34.780 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.780 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e30555:::benchmark_data_smithi188_104537_object152279:head# 2024-04-01T19:36:34.780 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.780 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e3c648:::benchmark_data_smithi188_104537_object129828:head# 2024-04-01T19:36:34.780 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.780 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e4a0ff:::benchmark_data_smithi188_104537_object137326:head# 2024-04-01T19:36:34.780 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.781 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e5959d:::benchmark_data_smithi188_104537_object146406:head# 2024-04-01T19:36:34.781 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.781 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e6243e:::benchmark_data_smithi188_104537_object38587:head# 2024-04-01T19:36:34.781 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.785 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e62cec:::benchmark_data_smithi188_104537_object61012:head# 2024-04-01T19:36:34.785 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.785 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e67391:::benchmark_data_smithi188_104537_object21862:head# 2024-04-01T19:36:34.785 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.785 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e69a71:::benchmark_data_smithi188_104537_object16731:head# 2024-04-01T19:36:34.785 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.785 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e6b28d:::benchmark_data_smithi188_104537_object28405:head# 2024-04-01T19:36:34.785 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.785 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e6b6db:::benchmark_data_smithi188_104537_object95408:head# 2024-04-01T19:36:34.785 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e6de3f:::benchmark_data_smithi188_104537_object46154:head# 2024-04-01T19:36:34.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e6e393:::benchmark_data_smithi188_104537_object88713:head# 2024-04-01T19:36:34.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e76356:::benchmark_data_smithi188_104537_object39578:head# 2024-04-01T19:36:34.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e78310:::benchmark_data_smithi188_104537_object120885:head# 2024-04-01T19:36:34.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e8356e:::benchmark_data_smithi188_104537_object37928:head# 2024-04-01T19:36:34.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e97dbe:::benchmark_data_smithi188_104537_object18779:head# 2024-04-01T19:36:34.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58e9a415:::benchmark_data_smithi188_104537_object162863:head# 2024-04-01T19:36:34.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ea389b:::benchmark_data_smithi188_104537_object35254:head# 2024-04-01T19:36:34.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ea69ef:::benchmark_data_smithi188_104537_object33808:head# 2024-04-01T19:36:34.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58eb1e55:::benchmark_data_smithi188_104537_object58843:head# 2024-04-01T19:36:34.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58eb7f7b:::benchmark_data_smithi188_104537_object156284:head# 2024-04-01T19:36:34.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ebba09:::benchmark_data_smithi188_104537_object131632:head# 2024-04-01T19:36:34.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ebe3fe:::benchmark_data_smithi188_104537_object87114:head# 2024-04-01T19:36:34.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ec0a2d:::benchmark_data_smithi188_104537_object18235:head# 2024-04-01T19:36:34.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ed1986:::benchmark_data_smithi188_104537_object112659:head# 2024-04-01T19:36:34.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ed7862:::benchmark_data_smithi188_104537_object21619:head# 2024-04-01T19:36:34.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ed9682:::benchmark_data_smithi188_104537_object159140:head# 2024-04-01T19:36:34.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ee93e9:::benchmark_data_smithi188_104537_object171938:head# 2024-04-01T19:36:34.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ef2345:::benchmark_data_smithi188_104537_object148278:head# 2024-04-01T19:36:34.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ef2f84:::benchmark_data_smithi188_104537_object146702:head# 2024-04-01T19:36:34.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ef4a5c:::benchmark_data_smithi188_104537_object137040:head# 2024-04-01T19:36:34.789 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.789 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:36:34.790 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ef7f76:::benchmark_data_smithi188_104537_object61891:head# 2024-04-01T19:36:34.790 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.790 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58efbf6d:::benchmark_data_smithi188_104537_object165802:head# 2024-04-01T19:36:34.790 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.790 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f029a3:::benchmark_data_smithi188_104537_object125467:head# 2024-04-01T19:36:34.790 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.790 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f0877a:::benchmark_data_smithi188_104537_object19806:head# 2024-04-01T19:36:34.791 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.791 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f09eb0:::benchmark_data_smithi188_104537_object130772:head# 2024-04-01T19:36:34.791 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.791 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f141f3:::benchmark_data_smithi188_104537_object15665:head# 2024-04-01T19:36:34.791 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.792 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f160f9:::benchmark_data_smithi188_104537_object84717:head# 2024-04-01T19:36:34.792 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.792 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f183ae:::benchmark_data_smithi188_104537_object108221:head# 2024-04-01T19:36:34.792 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.792 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f19a78:::benchmark_data_smithi188_104537_object108727:head# 2024-04-01T19:36:34.792 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.792 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f1f1e7:::benchmark_data_smithi188_104537_object139800:head# 2024-04-01T19:36:34.792 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.793 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f221e5:::benchmark_data_smithi188_104537_object22314:head# 2024-04-01T19:36:34.793 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f26042:::benchmark_data_smithi188_104537_object74805:head# 2024-04-01T19:36:34.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f286b9:::benchmark_data_smithi188_104537_object166762:head# 2024-04-01T19:36:34.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f37cb1:::benchmark_data_smithi188_104537_object41051:head# 2024-04-01T19:36:34.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f3812a:::benchmark_data_smithi188_104537_object134811:head# 2024-04-01T19:36:34.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f3908f:::benchmark_data_smithi188_104537_object85686:head# 2024-04-01T19:36:34.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.795 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f4019b:::benchmark_data_smithi188_104537_object154800:head# 2024-04-01T19:36:34.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f4842c:::benchmark_data_smithi188_104537_object98151:head# 2024-04-01T19:36:34.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f50b66:::benchmark_data_smithi188_104537_object49640:head# 2024-04-01T19:36:34.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f533c6:::benchmark_data_smithi188_104537_object101725:head# 2024-04-01T19:36:34.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f570a7:::benchmark_data_smithi188_104537_object110600:head# 2024-04-01T19:36:34.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f5d675:::benchmark_data_smithi188_104537_object31409:head# 2024-04-01T19:36:34.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.797 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f662eb:::benchmark_data_smithi188_104537_object32989:head# 2024-04-01T19:36:34.797 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.797 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f68495:::benchmark_data_smithi188_104537_object161301:head# 2024-04-01T19:36:34.797 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.797 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f6a274:::benchmark_data_smithi188_104537_object35215:head# 2024-04-01T19:36:34.797 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.798 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f702e1:::benchmark_data_smithi188_104537_object128767:head# 2024-04-01T19:36:34.798 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.798 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f7776b:::benchmark_data_smithi188_104537_object128206:head# 2024-04-01T19:36:34.798 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.798 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f7c8f3:::benchmark_data_smithi188_104537_object60481:head# 2024-04-01T19:36:34.799 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.799 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f81515:::benchmark_data_smithi188_104537_object171790:head# 2024-04-01T19:36:34.799 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.806 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f86c3b:::benchmark_data_smithi188_104537_object41816:head# 2024-04-01T19:36:34.806 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.807 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f8eb84:::benchmark_data_smithi188_104537_object85326:head# 2024-04-01T19:36:34.807 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.807 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f8f716:::benchmark_data_smithi188_104537_object126725:head# 2024-04-01T19:36:34.807 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.807 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f90618:::benchmark_data_smithi188_104537_object171445:head# 2024-04-01T19:36:34.807 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.807 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f95409:::benchmark_data_smithi188_104537_object169799:head# 2024-04-01T19:36:34.807 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.807 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f9afe8:::benchmark_data_smithi188_104537_object104752:head# 2024-04-01T19:36:34.807 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.809 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f9da3b:::benchmark_data_smithi188_104537_object59986:head# 2024-04-01T19:36:34.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.809 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58f9ef78:::benchmark_data_smithi188_104537_object34744:head# 2024-04-01T19:36:34.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.809 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58fa1939:::benchmark_data_smithi188_104537_object147904:head# 2024-04-01T19:36:34.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.809 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58fa2fd6:::benchmark_data_smithi188_104537_object48232:head# 2024-04-01T19:36:34.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.809 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58fa4439:::benchmark_data_smithi188_104537_object78707:head# 2024-04-01T19:36:34.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.809 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58fc74cf:::benchmark_data_smithi188_104537_object109644:head# 2024-04-01T19:36:34.810 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.810 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58fcab04:::benchmark_data_smithi188_104537_object81025:head# 2024-04-01T19:36:34.810 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.810 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58fdcc2a:::benchmark_data_smithi188_104537_object26389:head# 2024-04-01T19:36:34.810 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.810 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58fe1905:::benchmark_data_smithi188_104537_object160574:head# 2024-04-01T19:36:34.810 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58fedd2d:::benchmark_data_smithi188_104537_object101179:head# 2024-04-01T19:36:34.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ff3c27:::benchmark_data_smithi188_104537_object17314:head# 2024-04-01T19:36:34.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ffa739:::benchmark_data_smithi188_104537_object103130:head# 2024-04-01T19:36:34.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58ffd532:::benchmark_data_smithi188_104537_object11536:head# 2024-04-01T19:36:34.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:58fff98f:::benchmark_data_smithi188_104537_object34333:head# 2024-04-01T19:36:34.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5900059f:::benchmark_data_smithi188_104537_object37728:head# 2024-04-01T19:36:34.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.813 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:590070f6:::benchmark_data_smithi188_104537_object94014:head# 2024-04-01T19:36:34.813 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.813 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5900bd7f:::benchmark_data_smithi188_104537_object97123:head# 2024-04-01T19:36:34.813 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.813 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59011c64:::benchmark_data_smithi188_104537_object165961:head# 2024-04-01T19:36:34.813 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.814 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:590171b0:::benchmark_data_smithi188_104537_object26182:head# 2024-04-01T19:36:34.814 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.814 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5901e38b:::benchmark_data_smithi188_104537_object158260:head# 2024-04-01T19:36:34.814 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.814 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5901ff5a:::benchmark_data_smithi188_104537_object16619:head# 2024-04-01T19:36:34.814 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.814 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59023059:::benchmark_data_smithi188_104537_object154465:head# 2024-04-01T19:36:34.815 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.815 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:590263c8:::benchmark_data_smithi188_104537_object22264:head# 2024-04-01T19:36:34.815 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.815 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:590346fb:::benchmark_data_smithi188_104537_object162619:head# 2024-04-01T19:36:34.815 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.815 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59038d24:::benchmark_data_smithi188_104537_object109216:head# 2024-04-01T19:36:34.815 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.815 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59041627:::benchmark_data_smithi188_104537_object93184:head# 2024-04-01T19:36:34.815 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.816 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:590503ad:::benchmark_data_smithi188_104537_object152888:head# 2024-04-01T19:36:34.816 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.816 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59055ad9:::benchmark_data_smithi188_104537_object145043:head# 2024-04-01T19:36:34.816 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.816 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59058b56:::benchmark_data_smithi188_104537_object16249:head# 2024-04-01T19:36:34.816 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.816 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5906137a:::benchmark_data_smithi188_104537_object107821:head# 2024-04-01T19:36:34.816 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.817 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59067875:::benchmark_data_smithi188_104537_object90337:head# 2024-04-01T19:36:34.817 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.817 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59069723:::benchmark_data_smithi188_104537_object84575:head# 2024-04-01T19:36:34.817 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5906990c:::benchmark_data_smithi188_104537_object119413:head# 2024-04-01T19:36:34.818 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5906b275:::benchmark_data_smithi188_104537_object135469:head# 2024-04-01T19:36:34.818 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59073bc8:::benchmark_data_smithi188_104537_object95166:head# 2024-04-01T19:36:34.818 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5907bfcb:::benchmark_data_smithi188_104537_object134128:head# 2024-04-01T19:36:34.818 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59082819:::benchmark_data_smithi188_104537_object41017:head# 2024-04-01T19:36:34.818 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59088d81:::benchmark_data_smithi188_104537_object16655:head# 2024-04-01T19:36:34.819 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.819 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5909abca:::benchmark_data_smithi188_104537_object65677:head# 2024-04-01T19:36:34.819 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.819 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5909b0f1:::benchmark_data_smithi188_104537_object128123:head# 2024-04-01T19:36:34.820 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.820 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:590a706d:::benchmark_data_smithi188_104537_object104183:head# 2024-04-01T19:36:34.820 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.820 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:590a8f2d:::benchmark_data_smithi188_104537_object135666:head# 2024-04-01T19:36:34.820 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.821 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:590a91f4:::benchmark_data_smithi188_104537_object159511:head# 2024-04-01T19:36:34.821 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.821 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:590ab6cd:::benchmark_data_smithi188_104537_object162553:head# 2024-04-01T19:36:34.821 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.821 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:590baa1f:::benchmark_data_smithi188_104537_object140052:head# 2024-04-01T19:36:34.821 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.821 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:590c0171:::benchmark_data_smithi188_104537_object45045:head# 2024-04-01T19:36:34.821 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.821 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:590c100a:::benchmark_data_smithi188_104537_object31646:head# 2024-04-01T19:36:34.821 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.822 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:590c1127:::benchmark_data_smithi188_104537_object166677:head# 2024-04-01T19:36:34.822 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.822 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:590c11ce:::benchmark_data_smithi188_104537_object106679:head# 2024-04-01T19:36:34.822 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.823 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:590c3b92:::benchmark_data_smithi188_104537_object57669:head# 2024-04-01T19:36:34.823 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.825 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:590d4986:::benchmark_data_smithi188_104537_object67212:head# 2024-04-01T19:36:34.825 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.825 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:590e916c:::benchmark_data_smithi188_104537_object149025:head# 2024-04-01T19:36:34.826 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.826 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:590eeaa6:::benchmark_data_smithi188_104537_object19973:head# 2024-04-01T19:36:34.826 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.826 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:590ef37a:::benchmark_data_smithi188_104537_object109821:head# 2024-04-01T19:36:34.826 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.826 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:590f0046:::benchmark_data_smithi188_104537_object20930:head# 2024-04-01T19:36:34.826 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.826 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:590f08c9:::benchmark_data_smithi188_104537_object171468:head# 2024-04-01T19:36:34.826 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.826 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:591087b4:::benchmark_data_smithi188_104537_object62334:head# 2024-04-01T19:36:34.826 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.826 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:591087f8:::benchmark_data_smithi188_104537_object52089:head# 2024-04-01T19:36:34.826 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.827 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5910b6af:::benchmark_data_smithi188_104537_object91278:head# 2024-04-01T19:36:34.827 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.827 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5910e5f6:::benchmark_data_smithi188_104537_object156398:head# 2024-04-01T19:36:34.827 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.827 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5911dbab:::benchmark_data_smithi188_104537_object165829:head# 2024-04-01T19:36:34.827 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.827 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59121b3f:::benchmark_data_smithi188_104537_object46677:head# 2024-04-01T19:36:34.827 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.827 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59121d7e:::benchmark_data_smithi188_104537_object110790:head# 2024-04-01T19:36:34.827 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.827 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5912b907:::benchmark_data_smithi188_104537_object113029:head# 2024-04-01T19:36:34.827 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.828 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5912dfb7:::benchmark_data_smithi188_104537_object41397:head# 2024-04-01T19:36:34.828 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.830 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5913338a:::benchmark_data_smithi188_104537_object162025:head# 2024-04-01T19:36:34.830 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.830 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:591377dc:::benchmark_data_smithi188_104537_object40210:head# 2024-04-01T19:36:34.830 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.831 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5914fa7e:::benchmark_data_smithi188_104537_object152207:head# 2024-04-01T19:36:34.831 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.831 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5915ad64:::benchmark_data_smithi188_104537_object142059:head# 2024-04-01T19:36:34.831 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.831 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5916342a:::benchmark_data_smithi188_104537_object63989:head# 2024-04-01T19:36:34.831 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.831 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5917aeee:::benchmark_data_smithi188_104537_object17786:head# 2024-04-01T19:36:34.831 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.831 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59184172:::benchmark_data_smithi188_104537_object39103:head# 2024-04-01T19:36:34.831 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.831 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59194eea:::benchmark_data_smithi188_104537_object120162:head# 2024-04-01T19:36:34.831 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.831 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:591a7011:::benchmark_data_smithi188_104537_object52827:head# 2024-04-01T19:36:34.832 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.832 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:591b5bd7:::benchmark_data_smithi188_104537_object23921:head# 2024-04-01T19:36:34.832 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.832 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:591b78ef:::benchmark_data_smithi188_104537_object69160:head# 2024-04-01T19:36:34.832 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.832 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:591c42e0:::benchmark_data_smithi188_104537_object129590:head# 2024-04-01T19:36:34.832 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.832 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:591c4629:::benchmark_data_smithi188_104537_object54719:head# 2024-04-01T19:36:34.832 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.832 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:591c5a3a:::benchmark_data_smithi188_104537_object125373:head# 2024-04-01T19:36:34.832 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.832 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:591cae94:::benchmark_data_smithi188_104537_object33115:head# 2024-04-01T19:36:34.832 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.833 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:591d2e0c:::benchmark_data_smithi188_104537_object66832:head# 2024-04-01T19:36:34.833 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.833 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:591dd04b:::benchmark_data_smithi188_104537_object74397:head# 2024-04-01T19:36:34.833 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.833 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:591df3d1:::benchmark_data_smithi188_104537_object98220:head# 2024-04-01T19:36:34.833 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.834 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:591df7b9:::benchmark_data_smithi188_104537_object52957:head# 2024-04-01T19:36:34.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.834 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:591dfcf1:::benchmark_data_smithi188_104537_object101948:head# 2024-04-01T19:36:34.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.834 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:591ed194:::benchmark_data_smithi188_104537_object26578:head# 2024-04-01T19:36:34.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.834 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59205a97:::benchmark_data_smithi188_104537_object160676:head# 2024-04-01T19:36:34.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.834 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59207127:::benchmark_data_smithi188_104537_object70207:head# 2024-04-01T19:36:34.835 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.835 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59208d59:::benchmark_data_smithi188_104537_object29632:head# 2024-04-01T19:36:34.835 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.835 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5920a044:::benchmark_data_smithi188_104537_object67273:head# 2024-04-01T19:36:34.835 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.835 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59210d9e:::benchmark_data_smithi188_104537_object170450:head# 2024-04-01T19:36:34.835 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.838 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:592160a2:::benchmark_data_smithi188_104537_object46156:head# 2024-04-01T19:36:34.838 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.838 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5921ee63:::benchmark_data_smithi188_104537_object130548:head# 2024-04-01T19:36:34.838 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.838 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5922b147:::benchmark_data_smithi188_104537_object111937:head# 2024-04-01T19:36:34.838 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.838 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5922d182:::benchmark_data_smithi188_104537_object12311:head# 2024-04-01T19:36:34.838 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.838 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5922d83d:::benchmark_data_smithi188_104537_object75023:head# 2024-04-01T19:36:34.838 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.839 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5922ef1d:::benchmark_data_smithi188_104537_object28151:head# 2024-04-01T19:36:34.839 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.839 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5922fd65:::benchmark_data_smithi188_104537_object118748:head# 2024-04-01T19:36:34.839 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.839 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5923328c:::benchmark_data_smithi188_104537_object34810:head# 2024-04-01T19:36:34.839 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.839 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5923426f:::benchmark_data_smithi188_104537_object51151:head# 2024-04-01T19:36:34.839 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.839 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59239318:::benchmark_data_smithi188_104537_object83092:head# 2024-04-01T19:36:34.839 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.839 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5923ecc9:::benchmark_data_smithi188_104537_object64159:head# 2024-04-01T19:36:34.839 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.839 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59249272:::benchmark_data_smithi188_104537_object95544:head# 2024-04-01T19:36:34.840 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.840 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5924a3b5:::benchmark_data_smithi188_104537_object151836:head# 2024-04-01T19:36:34.840 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.840 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5924df69:::benchmark_data_smithi188_104537_object40303:head# 2024-04-01T19:36:34.840 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.840 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59251ce8:::benchmark_data_smithi188_104537_object13837:head# 2024-04-01T19:36:34.840 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.841 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:592539aa:::benchmark_data_smithi188_104537_object126022:head# 2024-04-01T19:36:34.841 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.841 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59256175:::benchmark_data_smithi188_104537_object80249:head# 2024-04-01T19:36:34.841 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.841 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5925c86f:::benchmark_data_smithi188_104537_object59538:head# 2024-04-01T19:36:34.841 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.841 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5926451e:::benchmark_data_smithi188_104537_object102719:head# 2024-04-01T19:36:34.841 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.841 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59267c87:::benchmark_data_smithi188_104537_object110400:head# 2024-04-01T19:36:34.841 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.841 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59270777:::benchmark_data_smithi188_104537_object103028:head# 2024-04-01T19:36:34.842 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.842 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:34.842 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59270f68:::benchmark_data_smithi188_104537_object33190:head# 2024-04-01T19:36:34.843 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.843 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59273526:::benchmark_data_smithi188_104537_object147756:head# 2024-04-01T19:36:34.843 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.843 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59273796:::benchmark_data_smithi188_104537_object121598:head# 2024-04-01T19:36:34.843 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.843 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59276109:::benchmark_data_smithi188_104537_object30468:head# 2024-04-01T19:36:34.843 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.843 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59278f90:::benchmark_data_smithi188_104537_object129700:head# 2024-04-01T19:36:34.843 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.843 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:592810a3:::benchmark_data_smithi188_104537_object56856:head# 2024-04-01T19:36:34.843 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.843 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59282440:::benchmark_data_smithi188_104537_object139567:head# 2024-04-01T19:36:34.843 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.845 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59283186:::benchmark_data_smithi188_104537_object55312:head# 2024-04-01T19:36:34.845 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.846 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5929047d:::benchmark_data_smithi188_104537_object80847:head# 2024-04-01T19:36:34.846 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.846 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:592a53f6:::benchmark_data_smithi188_104537_object29526:head# 2024-04-01T19:36:34.846 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.846 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:592b24fa:::benchmark_data_smithi188_104537_object28900:head# 2024-04-01T19:36:34.846 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.846 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:592b90dc:::benchmark_data_smithi188_104537_object142165:head# 2024-04-01T19:36:34.846 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.847 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:592c844b:::benchmark_data_smithi188_104537_object56739:head# 2024-04-01T19:36:34.847 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.847 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:592ccf94:::benchmark_data_smithi188_104537_object124268:head# 2024-04-01T19:36:34.847 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.847 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:592cd7e7:::benchmark_data_smithi188_104537_object154020:head# 2024-04-01T19:36:34.847 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.848 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:592d59f9:::benchmark_data_smithi188_104537_object68573:head# 2024-04-01T19:36:34.848 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.848 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:592e1539:::benchmark_data_smithi188_104537_object163538:head# 2024-04-01T19:36:34.848 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.848 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:592e5e37:::benchmark_data_smithi188_104537_object107975:head# 2024-04-01T19:36:34.848 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.848 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:592e74c9:::benchmark_data_smithi188_104537_object43421:head# 2024-04-01T19:36:34.849 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.849 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:592ef3ec:::benchmark_data_smithi188_104537_object135909:head# 2024-04-01T19:36:34.849 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.849 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:593038d0:::benchmark_data_smithi188_104537_object57920:head# 2024-04-01T19:36:34.849 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.853 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5930be6d:::benchmark_data_smithi188_104537_object33873:head# 2024-04-01T19:36:34.854 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.854 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5931633b:::benchmark_data_smithi188_104537_object74122:head# 2024-04-01T19:36:34.854 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.858 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5931aa0f:::benchmark_data_smithi188_104537_object107919:head# 2024-04-01T19:36:34.858 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.858 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5931c17d:::benchmark_data_smithi188_104537_object54622:head# 2024-04-01T19:36:34.858 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.858 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5931c734:::benchmark_data_smithi188_104537_object16890:head# 2024-04-01T19:36:34.858 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.859 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5932167a:::benchmark_data_smithi188_104537_object76532:head# 2024-04-01T19:36:34.859 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.859 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:593223de:::benchmark_data_smithi188_104537_object11441:head# 2024-04-01T19:36:34.859 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.859 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5932c7aa:::benchmark_data_smithi188_104537_object113304:head# 2024-04-01T19:36:34.859 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.859 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59333d5a:::benchmark_data_smithi188_104537_object72606:head# 2024-04-01T19:36:34.859 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.859 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5933a4bd:::benchmark_data_smithi188_104537_object71602:head# 2024-04-01T19:36:34.859 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.859 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59341ccc:::benchmark_data_smithi188_104537_object27623:head# 2024-04-01T19:36:34.859 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.859 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59342145:::benchmark_data_smithi188_104537_object99992:head# 2024-04-01T19:36:34.859 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.859 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59343933:::benchmark_data_smithi188_104537_object102813:head# 2024-04-01T19:36:34.859 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.860 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5934755f:::benchmark_data_smithi188_104537_object44992:head# 2024-04-01T19:36:34.860 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.860 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5934b31b:::benchmark_data_smithi188_104537_object44497:head# 2024-04-01T19:36:34.860 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.860 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5934feab:::benchmark_data_smithi188_104537_object131998:head# 2024-04-01T19:36:34.860 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.860 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59353ad5:::benchmark_data_smithi188_104537_object141846:head# 2024-04-01T19:36:34.861 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.861 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:593595f3:::benchmark_data_smithi188_104537_object46814:head# 2024-04-01T19:36:34.861 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.861 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5936684b:::benchmark_data_smithi188_104537_object22170:head# 2024-04-01T19:36:34.862 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.862 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5936a97d:::benchmark_data_smithi188_104537_object53681:head# 2024-04-01T19:36:34.862 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.862 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:593729c9:::benchmark_data_smithi188_104537_object13048:head# 2024-04-01T19:36:34.862 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.862 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59374c40:::benchmark_data_smithi188_104537_object83391:head# 2024-04-01T19:36:34.862 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.862 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5937ac4f:::benchmark_data_smithi188_104537_object151855:head# 2024-04-01T19:36:34.862 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.864 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:593877a9:::benchmark_data_smithi188_104537_object122837:head# 2024-04-01T19:36:34.864 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.865 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59389b3c:::benchmark_data_smithi188_104537_object21127:head# 2024-04-01T19:36:34.865 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.866 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59393bd2:::benchmark_data_smithi188_104537_object30824:head# 2024-04-01T19:36:34.867 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.867 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5939b66c:::benchmark_data_smithi188_104537_object153608:head# 2024-04-01T19:36:34.867 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.867 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:593a09cc:::benchmark_data_smithi188_104537_object166124:head# 2024-04-01T19:36:34.868 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.868 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:593a0e92:::benchmark_data_smithi188_104537_object79454:head# 2024-04-01T19:36:34.868 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.868 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:593a3a82:::benchmark_data_smithi188_104537_object112819:head# 2024-04-01T19:36:34.869 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.869 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:593a7609:::benchmark_data_smithi188_104537_object58347:head# 2024-04-01T19:36:34.869 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.869 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:593a9048:::benchmark_data_smithi188_104537_object149837:head# 2024-04-01T19:36:34.869 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.869 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:593ac17b:::benchmark_data_smithi188_104537_object59268:head# 2024-04-01T19:36:34.869 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.869 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:593b59ff:::benchmark_data_smithi188_104537_object62248:head# 2024-04-01T19:36:34.869 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.870 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:593bb9d1:::benchmark_data_smithi188_104537_object92848:head# 2024-04-01T19:36:34.870 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.873 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:593bbf39:::benchmark_data_smithi188_104537_object25350:head# 2024-04-01T19:36:34.873 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.874 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:593bc77b:::benchmark_data_smithi188_104537_object139993:head# 2024-04-01T19:36:34.874 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.874 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:593bc854:::benchmark_data_smithi188_104537_object119285:head# 2024-04-01T19:36:34.874 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.874 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:593be660:::benchmark_data_smithi188_104537_object43647:head# 2024-04-01T19:36:34.874 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.874 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:593d0df1:::benchmark_data_smithi188_104537_object121798:head# 2024-04-01T19:36:34.874 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.874 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:593e0a05:::benchmark_data_smithi188_104537_object36045:head# 2024-04-01T19:36:34.874 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.874 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:593f2563:::benchmark_data_smithi188_104537_object50240:head# 2024-04-01T19:36:34.874 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.875 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:593ffce1:::benchmark_data_smithi188_104537_object84182:head# 2024-04-01T19:36:34.875 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.875 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59412132:::benchmark_data_smithi188_104537_object64773:head# 2024-04-01T19:36:34.875 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.875 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5942d862:::benchmark_data_smithi188_104537_object35277:head# 2024-04-01T19:36:34.875 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.875 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5942e3e3:::benchmark_data_smithi188_104537_object158640:head# 2024-04-01T19:36:34.875 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.875 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:594536b3:::benchmark_data_smithi188_104537_object103245:head# 2024-04-01T19:36:34.875 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.875 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:594773a6:::benchmark_data_smithi188_104537_object102330:head# 2024-04-01T19:36:34.876 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.876 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5947a666:::benchmark_data_smithi188_104537_object100355:head# 2024-04-01T19:36:34.876 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.876 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5947cf2d:::benchmark_data_smithi188_104537_object117108:head# 2024-04-01T19:36:34.876 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.876 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5947fe4c:::benchmark_data_smithi188_104537_object113189:head# 2024-04-01T19:36:34.876 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.879 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59484a13:::benchmark_data_smithi188_104537_object62932:head# 2024-04-01T19:36:34.879 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.879 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5948fc89:::benchmark_data_smithi188_104537_object70860:head# 2024-04-01T19:36:34.879 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.880 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59491a3f:::benchmark_data_smithi188_104537_object46374:head# 2024-04-01T19:36:34.880 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.880 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59493bd7:::benchmark_data_smithi188_104537_object65914:head# 2024-04-01T19:36:34.880 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.880 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59494952:::benchmark_data_smithi188_104537_object115677:head# 2024-04-01T19:36:34.880 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.880 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5949985c:::benchmark_data_smithi188_104537_object142847:head# 2024-04-01T19:36:34.880 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.880 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5949dec8:::benchmark_data_smithi188_104537_object58326:head# 2024-04-01T19:36:34.880 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.880 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:594a21b0:::benchmark_data_smithi188_104537_object30430:head# 2024-04-01T19:36:34.880 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.881 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:594b41b4:::benchmark_data_smithi188_104537_object115373:head# 2024-04-01T19:36:34.881 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.881 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:594b5503:::benchmark_data_smithi188_104537_object151453:head# 2024-04-01T19:36:34.881 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.881 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:594c7622:::benchmark_data_smithi188_104537_object89098:head# 2024-04-01T19:36:34.881 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.881 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:594c9713:::benchmark_data_smithi188_104537_object108090:head# 2024-04-01T19:36:34.881 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.881 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:594ca6de:::benchmark_data_smithi188_104537_object151369:head# 2024-04-01T19:36:34.881 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.881 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:594d5b0a:::benchmark_data_smithi188_104537_object163177:head# 2024-04-01T19:36:34.881 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.881 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:594d8c9a:::benchmark_data_smithi188_104537_object122459:head# 2024-04-01T19:36:34.881 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.882 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:594dd073:::benchmark_data_smithi188_104537_object47910:head# 2024-04-01T19:36:34.882 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.882 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:594ee784:::benchmark_data_smithi188_104537_object56303:head# 2024-04-01T19:36:34.882 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.882 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:594ff48a:::benchmark_data_smithi188_104537_object51480:head# 2024-04-01T19:36:34.882 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.882 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59500743:::benchmark_data_smithi188_104537_object28732:head# 2024-04-01T19:36:34.882 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.882 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59523f05:::benchmark_data_smithi188_104537_object167619:head# 2024-04-01T19:36:34.882 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.882 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5952afcf:::benchmark_data_smithi188_104537_object77644:head# 2024-04-01T19:36:34.882 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.882 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5952c29d:::benchmark_data_smithi188_104537_object70536:head# 2024-04-01T19:36:34.883 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.887 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5953102f:::benchmark_data_smithi188_104537_object78254:head# 2024-04-01T19:36:34.887 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.887 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5953442a:::benchmark_data_smithi188_104537_object65871:head# 2024-04-01T19:36:34.887 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.887 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5953ac62:::benchmark_data_smithi188_104537_object168690:head# 2024-04-01T19:36:34.887 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.887 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5953b226:::benchmark_data_smithi188_104537_object62351:head# 2024-04-01T19:36:34.887 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.887 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5953ffa4:::benchmark_data_smithi188_104537_object92378:head# 2024-04-01T19:36:34.888 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.888 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59549999:::benchmark_data_smithi188_104537_object28616:head# 2024-04-01T19:36:34.888 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.888 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59550cb2:::benchmark_data_smithi188_104537_object26231:head# 2024-04-01T19:36:34.888 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.888 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59554be7:::benchmark_data_smithi188_104537_object129991:head# 2024-04-01T19:36:34.888 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.888 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5955b7b8:::benchmark_data_smithi188_104537_object129081:head# 2024-04-01T19:36:34.888 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.888 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59568705:::benchmark_data_smithi188_104537_object16057:head# 2024-04-01T19:36:34.888 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.888 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59572016:::benchmark_data_smithi188_104537_object140120:head# 2024-04-01T19:36:34.888 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.889 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59573e16:::benchmark_data_smithi188_104537_object129415:head# 2024-04-01T19:36:34.889 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.889 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:595820a7:::benchmark_data_smithi188_104537_object48041:head# 2024-04-01T19:36:34.889 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.889 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5958db33:::benchmark_data_smithi188_104537_object36304:head# 2024-04-01T19:36:34.889 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.889 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59590006:::benchmark_data_smithi188_104537_object84446:head# 2024-04-01T19:36:34.889 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.889 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5959e81f:::benchmark_data_smithi188_104537_object151375:head# 2024-04-01T19:36:34.889 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.889 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:595a73ce:::benchmark_data_smithi188_104537_object84817:head# 2024-04-01T19:36:34.889 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.889 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:595a769e:::benchmark_data_smithi188_104537_object130736:head# 2024-04-01T19:36:34.889 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.890 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:595ae22b:::benchmark_data_smithi188_104537_object58675:head# 2024-04-01T19:36:34.890 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.890 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:595b1b2e:::benchmark_data_smithi188_104537_object24364:head# 2024-04-01T19:36:34.890 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.890 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:595b32e4:::benchmark_data_smithi188_104537_object29713:head# 2024-04-01T19:36:34.890 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.890 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:595c1901:::benchmark_data_smithi188_104537_object53696:head# 2024-04-01T19:36:34.890 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.890 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:595c2beb:::benchmark_data_smithi188_104537_object121709:head# 2024-04-01T19:36:34.890 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.890 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:595c605f:::benchmark_data_smithi188_104537_object118683:head# 2024-04-01T19:36:34.890 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.890 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:595c9603:::benchmark_data_smithi188_104537_object15935:head# 2024-04-01T19:36:34.890 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.891 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:595ca0b7:::benchmark_data_smithi188_104537_object45929:head# 2024-04-01T19:36:34.891 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.891 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:595cbaa6:::benchmark_data_smithi188_104537_object119116:head# 2024-04-01T19:36:34.891 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.891 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:595d029c:::benchmark_data_smithi188_104537_object86970:head# 2024-04-01T19:36:34.891 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.894 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:595d8c52:::benchmark_data_smithi188_104537_object110152:head# 2024-04-01T19:36:34.895 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.895 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:595df332:::benchmark_data_smithi188_104537_object46511:head# 2024-04-01T19:36:34.895 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.895 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:595e1327:::benchmark_data_smithi188_104537_object171554:head# 2024-04-01T19:36:34.895 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.895 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:595edc57:::benchmark_data_smithi188_104537_object169113:head# 2024-04-01T19:36:34.895 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.895 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:595ee818:::benchmark_data_smithi188_104537_object31990:head# 2024-04-01T19:36:34.895 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.895 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:595f35f3:::benchmark_data_smithi188_104537_object75950:head# 2024-04-01T19:36:34.895 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.895 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:595fbf52:::benchmark_data_smithi188_104537_object72408:head# 2024-04-01T19:36:34.895 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.895 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59602be8:::benchmark_data_smithi188_104537_object127501:head# 2024-04-01T19:36:34.896 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.896 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:596072f2:::benchmark_data_smithi188_104537_object143166:head# 2024-04-01T19:36:34.896 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.896 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5960ca83:::benchmark_data_smithi188_104537_object162466:head# 2024-04-01T19:36:34.896 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.896 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59610ccc:::benchmark_data_smithi188_104537_object115757:head# 2024-04-01T19:36:34.896 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.896 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59611f29:::benchmark_data_smithi188_104537_object111147:head# 2024-04-01T19:36:34.896 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.896 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5961e35c:::benchmark_data_smithi188_104537_object165540:head# 2024-04-01T19:36:34.896 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.896 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:596220c2:::benchmark_data_smithi188_104537_object72002:head# 2024-04-01T19:36:34.896 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.896 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59625a87:::benchmark_data_smithi188_104537_object148215:head# 2024-04-01T19:36:34.897 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.897 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:596276c7:::benchmark_data_smithi188_104537_object71139:head# 2024-04-01T19:36:34.897 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.897 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:596287ae:::benchmark_data_smithi188_104537_object44415:head# 2024-04-01T19:36:34.897 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.897 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5962dd4f:::benchmark_data_smithi188_104537_object55343:head# 2024-04-01T19:36:34.897 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.897 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59633ab8:::benchmark_data_smithi188_104537_object49878:head# 2024-04-01T19:36:34.897 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.897 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5963f2cb:::benchmark_data_smithi188_104537_object113751:head# 2024-04-01T19:36:34.897 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.897 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:596418c3:::benchmark_data_smithi188_104537_object108982:head# 2024-04-01T19:36:34.897 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.897 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59647f1b:::benchmark_data_smithi188_104537_object49757:head# 2024-04-01T19:36:34.898 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.898 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59650bae:::benchmark_data_smithi188_104537_object47090:head# 2024-04-01T19:36:34.898 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.898 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59658374:::benchmark_data_smithi188_104537_object80780:head# 2024-04-01T19:36:34.898 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.898 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5965cca7:::benchmark_data_smithi188_104537_object90038:head# 2024-04-01T19:36:34.898 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.898 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59660f2f:::benchmark_data_smithi188_104537_object41927:head# 2024-04-01T19:36:34.898 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.898 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5966147a:::benchmark_data_smithi188_104537_object69107:head# 2024-04-01T19:36:34.898 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.898 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59662b59:::benchmark_data_smithi188_104537_object95189:head# 2024-04-01T19:36:34.898 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.903 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59673351:::benchmark_data_smithi188_104537_object64365:head# 2024-04-01T19:36:34.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.904 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:596758ab:::benchmark_data_smithi188_104537_object31077:head# 2024-04-01T19:36:34.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.904 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59677870:::benchmark_data_smithi188_104537_object166604:head# 2024-04-01T19:36:34.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.904 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59678b8c:::benchmark_data_smithi188_104537_object145511:head# 2024-04-01T19:36:34.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.904 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5967d38f:::benchmark_data_smithi188_104537_object100976:head# 2024-04-01T19:36:34.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.904 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:596908da:::benchmark_data_smithi188_104537_object54495:head# 2024-04-01T19:36:34.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.904 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:596985ea:::benchmark_data_smithi188_104537_object95566:head# 2024-04-01T19:36:34.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.905 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5969c7ed:::benchmark_data_smithi188_104537_object131959:head# 2024-04-01T19:36:34.905 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.905 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:596a83bb:::benchmark_data_smithi188_104537_object42348:head# 2024-04-01T19:36:34.905 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.905 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:596bfa7f:::benchmark_data_smithi188_104537_object28106:head# 2024-04-01T19:36:34.905 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.905 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:596c93a5:::benchmark_data_smithi188_104537_object143739:head# 2024-04-01T19:36:34.905 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.905 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:596cea36:::benchmark_data_smithi188_104537_object67341:head# 2024-04-01T19:36:34.905 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.905 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:596d12ad:::benchmark_data_smithi188_104537_object35709:head# 2024-04-01T19:36:34.905 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.905 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:596d543f:::benchmark_data_smithi188_104537_object98961:head# 2024-04-01T19:36:34.905 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.906 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:596d6e7e:::benchmark_data_smithi188_104537_object115709:head# 2024-04-01T19:36:34.906 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.906 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:596d8d0b:::benchmark_data_smithi188_104537_object137152:head# 2024-04-01T19:36:34.906 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.906 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:596ecf6a:::benchmark_data_smithi188_104537_object42947:head# 2024-04-01T19:36:34.906 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.906 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:596f5cba:::benchmark_data_smithi188_104537_object157834:head# 2024-04-01T19:36:34.906 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.906 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:597053e4:::benchmark_data_smithi188_104537_object151134:head# 2024-04-01T19:36:34.906 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.906 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59709a66:::benchmark_data_smithi188_104537_object21712:head# 2024-04-01T19:36:34.907 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.907 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59717340:::benchmark_data_smithi188_104537_object108711:head# 2024-04-01T19:36:34.907 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.907 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5971a4b5:::benchmark_data_smithi188_104537_object20253:head# 2024-04-01T19:36:34.907 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.907 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5971b9c3:::benchmark_data_smithi188_104537_object48508:head# 2024-04-01T19:36:34.907 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.907 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5971e25d:::benchmark_data_smithi188_104537_object121217:head# 2024-04-01T19:36:34.907 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.907 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5971e900:::benchmark_data_smithi188_104537_object46830:head# 2024-04-01T19:36:34.907 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.907 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:597283fa:::benchmark_data_smithi188_104537_object54883:head# 2024-04-01T19:36:34.907 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.908 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5972da28:::benchmark_data_smithi188_104537_object56171:head# 2024-04-01T19:36:34.908 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.908 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59738dd1:::benchmark_data_smithi188_104537_object65166:head# 2024-04-01T19:36:34.908 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.908 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5973ac3e:::benchmark_data_smithi188_104537_object136645:head# 2024-04-01T19:36:34.908 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.908 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5973b166:::benchmark_data_smithi188_104537_object73558:head# 2024-04-01T19:36:34.908 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.908 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59747329:::benchmark_data_smithi188_104537_object137706:head# 2024-04-01T19:36:34.908 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.908 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5974b35a:::benchmark_data_smithi188_104537_object93064:head# 2024-04-01T19:36:34.908 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.909 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5974e985:::benchmark_data_smithi188_104537_object83440:head# 2024-04-01T19:36:34.909 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.909 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:597539c4:::benchmark_data_smithi188_104537_object141547:head# 2024-04-01T19:36:34.909 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.912 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5975815c:::benchmark_data_smithi188_104537_object154515:head# 2024-04-01T19:36:34.912 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.912 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:597714bf:::benchmark_data_smithi188_104537_object147050:head# 2024-04-01T19:36:34.912 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.912 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59771da0:::benchmark_data_smithi188_104537_object14740:head# 2024-04-01T19:36:34.913 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.913 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59772919:::benchmark_data_smithi188_104537_object158372:head# 2024-04-01T19:36:34.913 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.913 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59779798:::benchmark_data_smithi188_104537_object89832:head# 2024-04-01T19:36:34.913 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.913 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5978da07:::benchmark_data_smithi188_104537_object79247:head# 2024-04-01T19:36:34.913 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.913 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:597936c2:::benchmark_data_smithi188_104537_object140240:head# 2024-04-01T19:36:34.913 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.913 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5979d7ea:::benchmark_data_smithi188_104537_object128397:head# 2024-04-01T19:36:34.913 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.913 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5979ffce:::benchmark_data_smithi188_104537_object90378:head# 2024-04-01T19:36:34.913 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.914 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:597a6e35:::benchmark_data_smithi188_104537_object156889:head# 2024-04-01T19:36:34.914 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.914 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:597bb800:::benchmark_data_smithi188_104537_object153801:head# 2024-04-01T19:36:34.914 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.914 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:597bf5a6:::benchmark_data_smithi188_104537_object104560:head# 2024-04-01T19:36:34.914 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.914 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:597c1908:::benchmark_data_smithi188_104537_object144918:head# 2024-04-01T19:36:34.914 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.914 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:597c4e0d:::benchmark_data_smithi188_104537_object27328:head# 2024-04-01T19:36:34.914 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.914 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:597c7402:::benchmark_data_smithi188_104537_object105984:head# 2024-04-01T19:36:34.914 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.914 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:597cec3d:::benchmark_data_smithi188_104537_object50154:head# 2024-04-01T19:36:34.915 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.915 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:597e49c0:::benchmark_data_smithi188_104537_object34305:head# 2024-04-01T19:36:34.915 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.915 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:597ea349:::benchmark_data_smithi188_104537_object61589:head# 2024-04-01T19:36:34.915 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.915 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:597f5a26:::benchmark_data_smithi188_104537_object29677:head# 2024-04-01T19:36:34.915 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.915 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:597f77f5:::benchmark_data_smithi188_104537_object170303:head# 2024-04-01T19:36:34.915 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.915 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:597ff248:::benchmark_data_smithi188_104537_object151531:head# 2024-04-01T19:36:34.915 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.915 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59806cf8:::benchmark_data_smithi188_104537_object75296:head# 2024-04-01T19:36:34.915 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.916 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59807c1b:::benchmark_data_smithi188_104537_object28196:head# 2024-04-01T19:36:34.916 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.916 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5980ccd7:::benchmark_data_smithi188_104537_object109377:head# 2024-04-01T19:36:34.916 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.916 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59810da1:::benchmark_data_smithi188_104537_object162571:head# 2024-04-01T19:36:34.916 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.916 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59815686:::benchmark_data_smithi188_104537_object80774:head# 2024-04-01T19:36:34.916 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.916 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59816a22:::benchmark_data_smithi188_104537_object74436:head# 2024-04-01T19:36:34.916 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.917 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59817869:::benchmark_data_smithi188_104537_object165699:head# 2024-04-01T19:36:34.917 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.917 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5982d0e4:::benchmark_data_smithi188_104537_object156499:head# 2024-04-01T19:36:34.917 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.917 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59837f37:::benchmark_data_smithi188_104537_object95591:head# 2024-04-01T19:36:34.917 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.920 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59852a66:::benchmark_data_smithi188_104537_object83757:head# 2024-04-01T19:36:34.921 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.921 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5985ca00:::benchmark_data_smithi188_104537_object70645:head# 2024-04-01T19:36:34.921 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.921 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5985e608:::benchmark_data_smithi188_104537_object145272:head# 2024-04-01T19:36:34.921 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.921 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5987446e:::benchmark_data_smithi188_104537_object111589:head# 2024-04-01T19:36:34.921 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.921 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59878cb4:::benchmark_data_smithi188_104537_object42630:head# 2024-04-01T19:36:34.921 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.921 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5987e978:::benchmark_data_smithi188_104537_object82438:head# 2024-04-01T19:36:34.921 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.921 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:598828a2:::benchmark_data_smithi188_104537_object79172:head# 2024-04-01T19:36:34.922 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.922 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:598839f5:::benchmark_data_smithi188_104537_object129300:head# 2024-04-01T19:36:34.922 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.922 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59885b86:::benchmark_data_smithi188_104537_object41370:head# 2024-04-01T19:36:34.922 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.922 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5988700f:::benchmark_data_smithi188_104537_object107033:head# 2024-04-01T19:36:34.922 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.922 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59888441:::benchmark_data_smithi188_104537_object123518:head# 2024-04-01T19:36:34.922 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.922 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5988abc8:::benchmark_data_smithi188_104537_object90586:head# 2024-04-01T19:36:34.922 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.922 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59898294:::benchmark_data_smithi188_104537_object99447:head# 2024-04-01T19:36:34.922 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.923 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5989c05c:::benchmark_data_smithi188_104537_object26310:head# 2024-04-01T19:36:34.923 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.923 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:598a2d40:::benchmark_data_smithi188_104537_object160780:head# 2024-04-01T19:36:34.923 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.923 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:598a771e:::benchmark_data_smithi188_104537_object168519:head# 2024-04-01T19:36:34.923 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.923 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:598bf7ab:::benchmark_data_smithi188_104537_object61653:head# 2024-04-01T19:36:34.923 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.923 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:598cb00e:::benchmark_data_smithi188_104537_object91846:head# 2024-04-01T19:36:34.923 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.923 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:598d14be:::benchmark_data_smithi188_104537_object12710:head# 2024-04-01T19:36:34.923 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.923 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:598d21ce:::benchmark_data_smithi188_104537_object144623:head# 2024-04-01T19:36:34.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:598d279f:::benchmark_data_smithi188_104537_object38260:head# 2024-04-01T19:36:34.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:598d55bb:::benchmark_data_smithi188_104537_object52589:head# 2024-04-01T19:36:34.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:598e2bb8:::benchmark_data_smithi188_104537_object117554:head# 2024-04-01T19:36:34.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:598e3d65:::benchmark_data_smithi188_104537_object91402:head# 2024-04-01T19:36:34.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:598e6bb1:::benchmark_data_smithi188_104537_object135202:head# 2024-04-01T19:36:34.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:598f5e77:::benchmark_data_smithi188_104537_object15944:head# 2024-04-01T19:36:34.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:598f700c:::benchmark_data_smithi188_104537_object121633:head# 2024-04-01T19:36:34.925 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.925 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:598fbfa7:::benchmark_data_smithi188_104537_object100729:head# 2024-04-01T19:36:34.925 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.925 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:599076f1:::benchmark_data_smithi188_104537_object164324:head# 2024-04-01T19:36:34.925 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.927 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59909c9e:::benchmark_data_smithi188_104537_object108358:head# 2024-04-01T19:36:34.927 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.928 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5992fbb6:::benchmark_data_smithi188_104537_object49925:head# 2024-04-01T19:36:34.928 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.928 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:599332fc:::benchmark_data_smithi188_104537_object110772:head# 2024-04-01T19:36:34.928 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.928 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59939fd2:::benchmark_data_smithi188_104537_object25165:head# 2024-04-01T19:36:34.928 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.928 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5993dce5:::benchmark_data_smithi188_104537_object59953:head# 2024-04-01T19:36:34.928 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.928 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59950595:::benchmark_data_smithi188_104537_object160659:head# 2024-04-01T19:36:34.928 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.928 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:599592d2:::benchmark_data_smithi188_104537_object64596:head# 2024-04-01T19:36:34.928 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.928 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5995b081:::benchmark_data_smithi188_104537_object46213:head# 2024-04-01T19:36:34.929 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.929 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:599659cc:::benchmark_data_smithi188_104537_object149383:head# 2024-04-01T19:36:34.929 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.929 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5996ba2d:::benchmark_data_smithi188_104537_object49664:head# 2024-04-01T19:36:34.929 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.929 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:599761b2:::benchmark_data_smithi188_104537_object138566:head# 2024-04-01T19:36:34.929 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.929 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:599784fd:::benchmark_data_smithi188_104537_object83064:head# 2024-04-01T19:36:34.929 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.929 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59983d18:::benchmark_data_smithi188_104537_object94305:head# 2024-04-01T19:36:34.929 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.929 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59985126:::benchmark_data_smithi188_104537_object95319:head# 2024-04-01T19:36:34.929 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.930 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5998b1b2:::benchmark_data_smithi188_104537_object166948:head# 2024-04-01T19:36:34.930 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.930 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5998b748:::benchmark_data_smithi188_104537_object140186:head# 2024-04-01T19:36:34.930 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.930 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5998c68f:::benchmark_data_smithi188_104537_object90009:head# 2024-04-01T19:36:34.930 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.930 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59996332:::benchmark_data_smithi188_104537_object164507:head# 2024-04-01T19:36:34.930 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.930 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:599a95f0:::benchmark_data_smithi188_104537_object99745:head# 2024-04-01T19:36:34.930 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.930 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:599ad0ed:::benchmark_data_smithi188_104537_object67721:head# 2024-04-01T19:36:34.930 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.930 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:599ad45f:::benchmark_data_smithi188_104537_object154819:head# 2024-04-01T19:36:34.931 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:599ad917:::benchmark_data_smithi188_104537_object88042:head# 2024-04-01T19:36:34.935 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:599bcccc:::benchmark_data_smithi188_104537_object56097:head# 2024-04-01T19:36:34.935 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:599e2dd5:::benchmark_data_smithi188_104537_object133499:head# 2024-04-01T19:36:34.935 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:599ea9b7:::benchmark_data_smithi188_104537_object142290:head# 2024-04-01T19:36:34.935 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:599ead2e:::benchmark_data_smithi188_104537_object159356:head# 2024-04-01T19:36:34.935 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:599f1248:::benchmark_data_smithi188_104537_object46500:head# 2024-04-01T19:36:34.936 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.936 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:599f5e5d:::benchmark_data_smithi188_104537_object122771:head# 2024-04-01T19:36:34.936 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.936 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:599fde83:::benchmark_data_smithi188_104537_object82037:head# 2024-04-01T19:36:34.936 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.936 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a075c0:::benchmark_data_smithi188_104537_object163431:head# 2024-04-01T19:36:34.936 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.936 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a0aa91:::benchmark_data_smithi188_104537_object34179:head# 2024-04-01T19:36:34.936 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.936 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a0c799:::benchmark_data_smithi188_104537_object138477:head# 2024-04-01T19:36:34.936 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.936 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a15acf:::benchmark_data_smithi188_104537_object97482:head# 2024-04-01T19:36:34.936 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.937 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a1b3c2:::benchmark_data_smithi188_104537_object40017:head# 2024-04-01T19:36:34.937 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.937 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a242f5:::benchmark_data_smithi188_104537_object136323:head# 2024-04-01T19:36:34.937 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.937 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a24fb0:::benchmark_data_smithi188_104537_object87559:head# 2024-04-01T19:36:34.937 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.937 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a2bc55:::benchmark_data_smithi188_104537_object66563:head# 2024-04-01T19:36:34.937 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.937 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a342e4:::benchmark_data_smithi188_104537_object54854:head# 2024-04-01T19:36:34.937 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.937 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a3be0e:::benchmark_data_smithi188_104537_object57550:head# 2024-04-01T19:36:34.937 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.937 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a3d322:::benchmark_data_smithi188_104537_object52703:head# 2024-04-01T19:36:34.937 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.937 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a4203a:::benchmark_data_smithi188_104537_object113237:head# 2024-04-01T19:36:34.937 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.938 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a479a4:::benchmark_data_smithi188_104537_object59220:head# 2024-04-01T19:36:34.938 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.938 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a4b1b9:::benchmark_data_smithi188_104537_object65038:head# 2024-04-01T19:36:34.938 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.938 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a4c4e4:::benchmark_data_smithi188_104537_object126010:head# 2024-04-01T19:36:34.938 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.938 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a5012b:::benchmark_data_smithi188_104537_object111724:head# 2024-04-01T19:36:34.938 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.938 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a580b4:::benchmark_data_smithi188_104537_object47706:head# 2024-04-01T19:36:34.938 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.938 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a63186:::benchmark_data_smithi188_104537_object35983:head# 2024-04-01T19:36:34.938 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.939 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a6b276:::benchmark_data_smithi188_104537_object165635:head# 2024-04-01T19:36:34.939 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.941 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a70c2c:::benchmark_data_smithi188_104537_object165301:head# 2024-04-01T19:36:34.941 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.941 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a778e9:::benchmark_data_smithi188_104537_object87710:head# 2024-04-01T19:36:34.941 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.941 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a77933:::benchmark_data_smithi188_104537_object112621:head# 2024-04-01T19:36:34.941 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.941 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a779c0:::benchmark_data_smithi188_104537_object112134:head# 2024-04-01T19:36:34.941 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.941 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a78338:::benchmark_data_smithi188_104537_object153443:head# 2024-04-01T19:36:34.941 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.941 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a838de:::benchmark_data_smithi188_104537_object17472:head# 2024-04-01T19:36:34.941 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.942 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a84705:::benchmark_data_smithi188_104537_object171674:head# 2024-04-01T19:36:34.942 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.942 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a95354:::benchmark_data_smithi188_104537_object79251:head# 2024-04-01T19:36:34.942 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.942 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a98378:::benchmark_data_smithi188_104537_object40579:head# 2024-04-01T19:36:34.942 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.942 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59a9ddb8:::benchmark_data_smithi188_104537_object126944:head# 2024-04-01T19:36:34.942 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.942 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59aaaace:::benchmark_data_smithi188_104537_object171162:head# 2024-04-01T19:36:34.942 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.942 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59aaebaf:::benchmark_data_smithi188_104537_object86005:head# 2024-04-01T19:36:34.942 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.942 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59ab060a:::benchmark_data_smithi188_104537_object146158:head# 2024-04-01T19:36:34.943 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.943 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59ac9dbf:::benchmark_data_smithi188_104537_object72530:head# 2024-04-01T19:36:34.943 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.943 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59ad3c69:::benchmark_data_smithi188_104537_object128225:head# 2024-04-01T19:36:34.943 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.943 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59ad4bf7:::benchmark_data_smithi188_104537_object22053:head# 2024-04-01T19:36:34.943 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.943 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59ada7da:::benchmark_data_smithi188_104537_object102536:head# 2024-04-01T19:36:34.943 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.943 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59ae3b07:::benchmark_data_smithi188_104537_object34328:head# 2024-04-01T19:36:34.943 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.943 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59ae83cd:::benchmark_data_smithi188_104537_object23461:head# 2024-04-01T19:36:34.943 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.944 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59aeaf98:::benchmark_data_smithi188_104537_object132886:head# 2024-04-01T19:36:34.944 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.944 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59aecfd6:::benchmark_data_smithi188_104537_object135848:head# 2024-04-01T19:36:34.944 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.944 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59aef08e:::benchmark_data_smithi188_104537_object17346:head# 2024-04-01T19:36:34.944 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.944 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59af1381:::benchmark_data_smithi188_104537_object47978:head# 2024-04-01T19:36:34.944 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.944 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59af2857:::benchmark_data_smithi188_104537_object61385:head# 2024-04-01T19:36:34.944 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.948 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59af28ec:::benchmark_data_smithi188_104537_object96367:head# 2024-04-01T19:36:34.948 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.948 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59afa533:::benchmark_data_smithi188_104537_object141540:head# 2024-04-01T19:36:34.948 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.948 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59b04e73:::benchmark_data_smithi188_104537_object59883:head# 2024-04-01T19:36:34.948 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.948 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59b0d2ae:::benchmark_data_smithi188_104537_object20260:head# 2024-04-01T19:36:34.948 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.948 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59b0e3aa:::benchmark_data_smithi188_104537_object163048:head# 2024-04-01T19:36:34.949 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.949 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59b13650:::benchmark_data_smithi188_104537_object46322:head# 2024-04-01T19:36:34.949 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.949 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59b165e4:::benchmark_data_smithi188_104537_object11608:head# 2024-04-01T19:36:34.949 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.949 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59b1a9a9:::benchmark_data_smithi188_104537_object84528:head# 2024-04-01T19:36:34.949 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.949 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59b1da4c:::benchmark_data_smithi188_104537_object134921:head# 2024-04-01T19:36:34.949 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.949 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59b1fca8:::benchmark_data_smithi188_104537_object65660:head# 2024-04-01T19:36:34.949 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.949 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59b2056c:::benchmark_data_smithi188_104537_object117219:head# 2024-04-01T19:36:34.949 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.949 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59b271bf:::benchmark_data_smithi188_104537_object18911:head# 2024-04-01T19:36:34.950 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.950 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59b31b71:::benchmark_data_smithi188_104537_object113279:head# 2024-04-01T19:36:34.950 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.950 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59b3cb58:::benchmark_data_smithi188_104537_object167826:head# 2024-04-01T19:36:34.950 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.950 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59b3d4a4:::benchmark_data_smithi188_104537_object146496:head# 2024-04-01T19:36:34.950 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.950 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59b3e222:::benchmark_data_smithi188_104537_object93423:head# 2024-04-01T19:36:34.950 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.950 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59b40204:::benchmark_data_smithi188_104537_object118437:head# 2024-04-01T19:36:34.950 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.950 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59b4b761:::benchmark_data_smithi188_104537_object79000:head# 2024-04-01T19:36:34.951 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.951 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59b651fb:::benchmark_data_smithi188_104537_object63600:head# 2024-04-01T19:36:34.951 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.951 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59b70ba0:::benchmark_data_smithi188_104537_object102867:head# 2024-04-01T19:36:34.951 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.951 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59b71cec:::benchmark_data_smithi188_104537_object157269:head# 2024-04-01T19:36:34.951 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.951 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59b7438a:::benchmark_data_smithi188_104537_object70028:head# 2024-04-01T19:36:34.951 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.951 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59b7ee61:::benchmark_data_smithi188_104537_object120166:head# 2024-04-01T19:36:34.951 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.951 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59b85721:::benchmark_data_smithi188_104537_object17631:head# 2024-04-01T19:36:34.951 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.951 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59b93547:::benchmark_data_smithi188_104537_object118710:head# 2024-04-01T19:36:34.951 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.951 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59b9d366:::benchmark_data_smithi188_104537_object97897:head# 2024-04-01T19:36:34.952 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.952 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59b9d8d9:::benchmark_data_smithi188_104537_object132784:head# 2024-04-01T19:36:34.952 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.952 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59ba2cc6:::benchmark_data_smithi188_104537_object52352:head# 2024-04-01T19:36:34.952 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.952 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59baa60d:::benchmark_data_smithi188_104537_object80355:head# 2024-04-01T19:36:34.952 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.952 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59bb5288:::benchmark_data_smithi188_104537_object73350:head# 2024-04-01T19:36:34.952 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.953 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59bb8987:::benchmark_data_smithi188_104537_object117658:head# 2024-04-01T19:36:34.954 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.954 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59bba01a:::benchmark_data_smithi188_104537_object103098:head# 2024-04-01T19:36:34.954 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.954 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59bbb1ed:::benchmark_data_smithi188_104537_object34732:head# 2024-04-01T19:36:34.954 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.954 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59bbf0dc:::benchmark_data_smithi188_104537_object54361:head# 2024-04-01T19:36:34.954 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.954 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59bc2526:::benchmark_data_smithi188_104537_object88506:head# 2024-04-01T19:36:34.954 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.954 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59bcb44b:::benchmark_data_smithi188_104537_object14698:head# 2024-04-01T19:36:34.954 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.954 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59bcc029:::benchmark_data_smithi188_104537_object100692:head# 2024-04-01T19:36:34.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59bff6f3:::benchmark_data_smithi188_104537_object128186:head# 2024-04-01T19:36:34.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59c0271b:::benchmark_data_smithi188_104537_object99351:head# 2024-04-01T19:36:34.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59c04717:::benchmark_data_smithi188_104537_object108350:head# 2024-04-01T19:36:34.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59c0649e:::benchmark_data_smithi188_104537_object100113:head# 2024-04-01T19:36:34.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59c11e58:::benchmark_data_smithi188_104537_object30816:head# 2024-04-01T19:36:34.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59c14b5d:::benchmark_data_smithi188_104537_object89535:head# 2024-04-01T19:36:34.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59c14bcb:::benchmark_data_smithi188_104537_object22792:head# 2024-04-01T19:36:34.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.956 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59c22562:::benchmark_data_smithi188_104537_object99869:head# 2024-04-01T19:36:34.956 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.956 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59c4c571:::benchmark_data_smithi188_104537_object133036:head# 2024-04-01T19:36:34.956 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.956 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59c511ae:::benchmark_data_smithi188_104537_object145015:head# 2024-04-01T19:36:34.956 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.956 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59c5dc71:::benchmark_data_smithi188_104537_object105693:head# 2024-04-01T19:36:34.956 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.956 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59c6c4ee:::benchmark_data_smithi188_104537_object13596:head# 2024-04-01T19:36:34.956 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.956 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59c6e134:::benchmark_data_smithi188_104537_object101134:head# 2024-04-01T19:36:34.956 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.957 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59c73293:::benchmark_data_smithi188_104537_object38726:head# 2024-04-01T19:36:34.957 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.957 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59c7710a:::benchmark_data_smithi188_104537_object158761:head# 2024-04-01T19:36:34.957 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.957 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59c7e56b:::benchmark_data_smithi188_104537_object13715:head# 2024-04-01T19:36:34.957 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.959 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59c844ab:::benchmark_data_smithi188_104537_object107614:head# 2024-04-01T19:36:34.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59c91e08:::benchmark_data_smithi188_104537_object90296:head# 2024-04-01T19:36:34.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59c9ab1f:::benchmark_data_smithi188_104537_object37132:head# 2024-04-01T19:36:34.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59c9db63:::benchmark_data_smithi188_104537_object69394:head# 2024-04-01T19:36:34.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59c9f000:::benchmark_data_smithi188_104537_object27924:head# 2024-04-01T19:36:34.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59cb7dc3:::benchmark_data_smithi188_104537_object61303:head# 2024-04-01T19:36:34.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.961 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59cbf910:::benchmark_data_smithi188_104537_object91991:head# 2024-04-01T19:36:34.961 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.961 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59cc01e0:::benchmark_data_smithi188_104537_object53600:head# 2024-04-01T19:36:34.961 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.961 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59cc3ecb:::benchmark_data_smithi188_104537_object149175:head# 2024-04-01T19:36:34.961 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.964 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59cc75e4:::benchmark_data_smithi188_104537_object148668:head# 2024-04-01T19:36:34.964 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.964 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59ccc5b3:::benchmark_data_smithi188_104537_object53285:head# 2024-04-01T19:36:34.964 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.964 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59cd473b:::benchmark_data_smithi188_104537_object105754:head# 2024-04-01T19:36:34.964 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.964 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59cd5000:::benchmark_data_smithi188_104537_object35276:head# 2024-04-01T19:36:34.964 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.965 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59cdbe2b:::benchmark_data_smithi188_104537_object20085:head# 2024-04-01T19:36:34.965 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.965 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59cdc351:::benchmark_data_smithi188_104537_object112017:head# 2024-04-01T19:36:34.965 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.965 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59cded87:::benchmark_data_smithi188_104537_object123551:head# 2024-04-01T19:36:34.965 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.965 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59ce24d2:::benchmark_data_smithi188_104537_object19101:head# 2024-04-01T19:36:34.965 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.965 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59cee678:::benchmark_data_smithi188_104537_object42930:head# 2024-04-01T19:36:34.965 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.965 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59cf331f:::benchmark_data_smithi188_104537_object126581:head# 2024-04-01T19:36:34.965 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.966 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59cf346f:::benchmark_data_smithi188_104537_object41148:head# 2024-04-01T19:36:34.966 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.966 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d0138e:::benchmark_data_smithi188_104537_object149524:head# 2024-04-01T19:36:34.966 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.966 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d10a65:::benchmark_data_smithi188_104537_object46469:head# 2024-04-01T19:36:34.966 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.966 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d11edb:::benchmark_data_smithi188_104537_object167451:head# 2024-04-01T19:36:34.966 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.966 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d129c7:::benchmark_data_smithi188_104537_object123616:head# 2024-04-01T19:36:34.966 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.966 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d2f091:::benchmark_data_smithi188_104537_object170424:head# 2024-04-01T19:36:34.966 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.970 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d372f2:::benchmark_data_smithi188_104537_object13490:head# 2024-04-01T19:36:34.971 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.971 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d52202:::benchmark_data_smithi188_104537_object47981:head# 2024-04-01T19:36:34.971 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.971 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d55533:::benchmark_data_smithi188_104537_object122396:head# 2024-04-01T19:36:34.971 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.971 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d5b8d3:::benchmark_data_smithi188_104537_object35370:head# 2024-04-01T19:36:34.971 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.971 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d5e3b8:::benchmark_data_smithi188_104537_object121866:head# 2024-04-01T19:36:34.971 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.971 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d5e9db:::benchmark_data_smithi188_104537_object108822:head# 2024-04-01T19:36:34.971 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.971 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d62466:::benchmark_data_smithi188_104537_object121757:head# 2024-04-01T19:36:34.971 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d662b8:::benchmark_data_smithi188_104537_object73090:head# 2024-04-01T19:36:34.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d68ffd:::benchmark_data_smithi188_104537_object170113:head# 2024-04-01T19:36:34.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d71f20:::benchmark_data_smithi188_104537_object138613:head# 2024-04-01T19:36:34.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d73dcd:::benchmark_data_smithi188_104537_object159388:head# 2024-04-01T19:36:34.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d81c12:::benchmark_data_smithi188_104537_object47371:head# 2024-04-01T19:36:34.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d821fe:::benchmark_data_smithi188_104537_object131596:head# 2024-04-01T19:36:34.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d8442b:::benchmark_data_smithi188_104537_object124545:head# 2024-04-01T19:36:34.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d84824:::benchmark_data_smithi188_104537_object57647:head# 2024-04-01T19:36:34.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.973 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d84d2a:::benchmark_data_smithi188_104537_object81171:head# 2024-04-01T19:36:34.973 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.973 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d8948e:::benchmark_data_smithi188_104537_object69023:head# 2024-04-01T19:36:34.973 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.973 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d89555:::benchmark_data_smithi188_104537_object95101:head# 2024-04-01T19:36:34.973 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.973 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d8dbff:::benchmark_data_smithi188_104537_object110718:head# 2024-04-01T19:36:34.973 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.973 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d8ed7b:::benchmark_data_smithi188_104537_object53706:head# 2024-04-01T19:36:34.973 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.973 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59d97ef7:::benchmark_data_smithi188_104537_object95450:head# 2024-04-01T19:36:34.973 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.973 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59da7011:::benchmark_data_smithi188_104537_object54255:head# 2024-04-01T19:36:34.973 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.974 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59da730f:::benchmark_data_smithi188_104537_object129114:head# 2024-04-01T19:36:34.974 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.974 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59dab1a3:::benchmark_data_smithi188_104537_object23189:head# 2024-04-01T19:36:34.974 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.974 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59db6f1d:::benchmark_data_smithi188_104537_object66850:head# 2024-04-01T19:36:34.974 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.974 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59dca794:::benchmark_data_smithi188_104537_object56083:head# 2024-04-01T19:36:34.974 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.975 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59dd2fa6:::benchmark_data_smithi188_104537_object117261:head# 2024-04-01T19:36:34.975 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.975 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59dd35bb:::benchmark_data_smithi188_104537_object61352:head# 2024-04-01T19:36:34.975 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.975 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59dd5b7b:::benchmark_data_smithi188_104537_object40880:head# 2024-04-01T19:36:34.975 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.975 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59dd8a3c:::benchmark_data_smithi188_104537_object88049:head# 2024-04-01T19:36:34.975 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.977 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59dd8d46:::benchmark_data_smithi188_104537_object129166:head# 2024-04-01T19:36:34.977 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.977 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59de29de:::benchmark_data_smithi188_104537_object22881:head# 2024-04-01T19:36:34.978 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.978 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59de8453:::benchmark_data_smithi188_104537_object24041:head# 2024-04-01T19:36:34.978 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.980 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59dec84a:::benchmark_data_smithi188_104537_object126196:head# 2024-04-01T19:36:34.980 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.980 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59df0960:::benchmark_data_smithi188_104537_object145503:head# 2024-04-01T19:36:34.980 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.980 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59df0d26:::benchmark_data_smithi188_104537_object12304:head# 2024-04-01T19:36:34.980 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.981 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59dfbc27:::benchmark_data_smithi188_104537_object23322:head# 2024-04-01T19:36:34.981 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.981 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59e02dd0:::benchmark_data_smithi188_104537_object144893:head# 2024-04-01T19:36:34.981 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.981 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59e0432f:::benchmark_data_smithi188_104537_object20770:head# 2024-04-01T19:36:34.981 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.981 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59e04ac7:::benchmark_data_smithi188_104537_object47046:head# 2024-04-01T19:36:34.981 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.981 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59e05249:::benchmark_data_smithi188_104537_object111075:head# 2024-04-01T19:36:34.981 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.981 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59e05648:::benchmark_data_smithi188_104537_object100077:head# 2024-04-01T19:36:34.981 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.983 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59e0c628:::benchmark_data_smithi188_104537_object152928:head# 2024-04-01T19:36:34.983 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.983 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59e1ed25:::benchmark_data_smithi188_104537_object101108:head# 2024-04-01T19:36:34.983 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.983 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59e203b1:::benchmark_data_smithi188_104537_object29499:head# 2024-04-01T19:36:34.983 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.983 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59e20f99:::benchmark_data_smithi188_104537_object112879:head# 2024-04-01T19:36:34.983 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.983 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59e26ec6:::benchmark_data_smithi188_104537_object46903:head# 2024-04-01T19:36:34.983 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.983 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59e29a24:::benchmark_data_smithi188_104537_object21035:head# 2024-04-01T19:36:34.984 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.984 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59e36275:::benchmark_data_smithi188_104537_object171394:head# 2024-04-01T19:36:34.984 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.984 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59e4872f:::benchmark_data_smithi188_104537_object133597:head# 2024-04-01T19:36:34.984 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.984 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59e49dc7:::benchmark_data_smithi188_104537_object51138:head# 2024-04-01T19:36:34.984 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.985 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59e4c054:::benchmark_data_smithi188_104537_object97727:head# 2024-04-01T19:36:34.985 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.985 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59e57b91:::benchmark_data_smithi188_104537_object74403:head# 2024-04-01T19:36:34.985 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59e57c70:::benchmark_data_smithi188_104537_object153539:head# 2024-04-01T19:36:34.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59e6b4fb:::benchmark_data_smithi188_104537_object151428:head# 2024-04-01T19:36:34.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59e81ee6:::benchmark_data_smithi188_104537_object156278:head# 2024-04-01T19:36:34.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59e85292:::benchmark_data_smithi188_104537_object135792:head# 2024-04-01T19:36:34.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59e9363a:::benchmark_data_smithi188_104537_object130347:head# 2024-04-01T19:36:34.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59e9eb72:::benchmark_data_smithi188_104537_object66932:head# 2024-04-01T19:36:34.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59eb96e4:::benchmark_data_smithi188_104537_object63982:head# 2024-04-01T19:36:34.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.987 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59ebc8d3:::benchmark_data_smithi188_104537_object15430:head# 2024-04-01T19:36:34.987 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.987 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59ebe785:::benchmark_data_smithi188_104537_object126982:head# 2024-04-01T19:36:34.987 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.987 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59eccb6f:::benchmark_data_smithi188_104537_object165420:head# 2024-04-01T19:36:34.988 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.988 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59ed3054:::benchmark_data_smithi188_104537_object132802:head# 2024-04-01T19:36:34.988 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.989 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59ed717d:::benchmark_data_smithi188_104537_object133730:head# 2024-04-01T19:36:34.989 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.992 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59ee9e73:::benchmark_data_smithi188_104537_object135552:head# 2024-04-01T19:36:34.992 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.993 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59eec76c:::benchmark_data_smithi188_104537_object77560:head# 2024-04-01T19:36:34.993 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.993 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59ef4ea7:::benchmark_data_smithi188_104537_object156228:head# 2024-04-01T19:36:34.993 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.994 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59ef5905:::benchmark_data_smithi188_104537_object147028:head# 2024-04-01T19:36:34.994 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.994 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59efcf52:::benchmark_data_smithi188_104537_object158036:head# 2024-04-01T19:36:34.994 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:34.999 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59effe6d:::benchmark_data_smithi188_104537_object127412:head# 2024-04-01T19:36:35.000 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.005 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59f060a6:::benchmark_data_smithi188_104537_object23346:head# 2024-04-01T19:36:35.005 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.005 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59f0806f:::benchmark_data_smithi188_104537_object66049:head# 2024-04-01T19:36:35.005 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.006 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59f1978c:::benchmark_data_smithi188_104537_object25360:head# 2024-04-01T19:36:35.006 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.006 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59f1b22d:::benchmark_data_smithi188_104537_object55092:head# 2024-04-01T19:36:35.006 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.007 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59f1eaef:::benchmark_data_smithi188_104537_object140937:head# 2024-04-01T19:36:35.007 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.007 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59f23e10:::benchmark_data_smithi188_104537_object106542:head# 2024-04-01T19:36:35.007 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.007 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59f25647:::benchmark_data_smithi188_104537_object145956:head# 2024-04-01T19:36:35.007 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.007 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59f28e58:::benchmark_data_smithi188_104537_object131438:head# 2024-04-01T19:36:35.007 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.008 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59f3406a:::benchmark_data_smithi188_104537_object75349:head# 2024-04-01T19:36:35.008 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.008 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59f3e2f4:::benchmark_data_smithi188_104537_object63980:head# 2024-04-01T19:36:35.008 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.008 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59f3ebb1:::benchmark_data_smithi188_104537_object160470:head# 2024-04-01T19:36:35.008 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.011 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59f50598:::benchmark_data_smithi188_104537_object100067:head# 2024-04-01T19:36:35.011 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.012 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59f5b90d:::benchmark_data_smithi188_104537_object129052:head# 2024-04-01T19:36:35.013 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.013 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59f60c5d:::benchmark_data_smithi188_104537_object20922:head# 2024-04-01T19:36:35.013 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.013 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59f64763:::benchmark_data_smithi188_104537_object132885:head# 2024-04-01T19:36:35.013 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.013 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59f6fb79:::benchmark_data_smithi188_104537_object32940:head# 2024-04-01T19:36:35.013 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.013 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59f850fa:::benchmark_data_smithi188_104537_object26785:head# 2024-04-01T19:36:35.013 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.014 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59f85c30:::benchmark_data_smithi188_104537_object90267:head# 2024-04-01T19:36:35.014 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.014 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59f8f3e1:::benchmark_data_smithi188_104537_object134488:head# 2024-04-01T19:36:35.014 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.014 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59f941c1:::benchmark_data_smithi188_104537_object104231:head# 2024-04-01T19:36:35.015 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.015 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59f95b84:::benchmark_data_smithi188_104537_object51266:head# 2024-04-01T19:36:35.015 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.015 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59f967c1:::benchmark_data_smithi188_104537_object64778:head# 2024-04-01T19:36:35.015 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59f9ac7d:::benchmark_data_smithi188_104537_object84241:head# 2024-04-01T19:36:35.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59fa356a:::benchmark_data_smithi188_104537_object146866:head# 2024-04-01T19:36:35.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59fa96a6:::benchmark_data_smithi188_104537_object79323:head# 2024-04-01T19:36:35.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59fc12ef:::benchmark_data_smithi188_104537_object112220:head# 2024-04-01T19:36:35.017 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.017 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59fc3b69:::benchmark_data_smithi188_104537_object150527:head# 2024-04-01T19:36:35.017 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.017 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59fc4682:::benchmark_data_smithi188_104537_object117494:head# 2024-04-01T19:36:35.017 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.017 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59fd2560:::benchmark_data_smithi188_104537_object161505:head# 2024-04-01T19:36:35.017 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.018 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59fd4b29:::benchmark_data_smithi188_104537_object157569:head# 2024-04-01T19:36:35.018 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.018 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59fd6cde:::benchmark_data_smithi188_104537_object103862:head# 2024-04-01T19:36:35.019 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.019 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59fd8979:::benchmark_data_smithi188_104537_object16454:head# 2024-04-01T19:36:35.019 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.019 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59fd8a33:::benchmark_data_smithi188_104537_object154611:head# 2024-04-01T19:36:35.019 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.019 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59fea7bc:::benchmark_data_smithi188_104537_object44968:head# 2024-04-01T19:36:35.019 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.020 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:59ff2492:::benchmark_data_smithi188_104537_object139188:head# 2024-04-01T19:36:35.020 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.020 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a002593:::benchmark_data_smithi188_104537_object112379:head# 2024-04-01T19:36:35.020 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.021 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a004847:::benchmark_data_smithi188_104537_object132591:head# 2024-04-01T19:36:35.021 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.021 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a014764:::benchmark_data_smithi188_104537_object13934:head# 2024-04-01T19:36:35.021 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.021 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a01b988:::benchmark_data_smithi188_104537_object38360:head# 2024-04-01T19:36:35.021 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.021 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a01bb09:::benchmark_data_smithi188_104537_object72756:head# 2024-04-01T19:36:35.021 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.022 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a02354a:::benchmark_data_smithi188_104537_object64335:head# 2024-04-01T19:36:35.023 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.023 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a033659:::benchmark_data_smithi188_104537_object17951:head# 2024-04-01T19:36:35.023 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.023 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a055185:::benchmark_data_smithi188_104537_object80236:head# 2024-04-01T19:36:35.023 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.023 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a05ed09:::benchmark_data_smithi188_104537_object123521:head# 2024-04-01T19:36:35.023 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.023 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a0619f0:::benchmark_data_smithi188_104537_object81412:head# 2024-04-01T19:36:35.023 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.023 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a06991b:::benchmark_data_smithi188_104537_object88486:head# 2024-04-01T19:36:35.023 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.023 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a06b6a0:::benchmark_data_smithi188_104537_object54898:head# 2024-04-01T19:36:35.024 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.024 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a08ba9d:::benchmark_data_smithi188_104537_object23341:head# 2024-04-01T19:36:35.024 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a08d0b1:::benchmark_data_smithi188_104537_object78887:head# 2024-04-01T19:36:35.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a09293c:::benchmark_data_smithi188_104537_object135985:head# 2024-04-01T19:36:35.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a09fcb4:::benchmark_data_smithi188_104537_object151305:head# 2024-04-01T19:36:35.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a0a199a:::benchmark_data_smithi188_104537_object39724:head# 2024-04-01T19:36:35.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a0ad2d5:::benchmark_data_smithi188_104537_object14189:head# 2024-04-01T19:36:35.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a0b855c:::benchmark_data_smithi188_104537_object135015:head# 2024-04-01T19:36:35.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a0b9041:::benchmark_data_smithi188_104537_object44804:head# 2024-04-01T19:36:35.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a0bf089:::benchmark_data_smithi188_104537_object123580:head# 2024-04-01T19:36:35.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a0c135c:::benchmark_data_smithi188_104537_object64668:head# 2024-04-01T19:36:35.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a0c5a39:::benchmark_data_smithi188_104537_object50886:head# 2024-04-01T19:36:35.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.028 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a0cd299:::benchmark_data_smithi188_104537_object78559:head# 2024-04-01T19:36:35.028 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.028 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a0ce829:::benchmark_data_smithi188_104537_object144251:head# 2024-04-01T19:36:35.028 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.028 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a0cebc0:::benchmark_data_smithi188_104537_object95853:head# 2024-04-01T19:36:35.028 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.028 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a0d34bf:::benchmark_data_smithi188_104537_object112018:head# 2024-04-01T19:36:35.028 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.029 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a0d45a0:::benchmark_data_smithi188_104537_object57667:head# 2024-04-01T19:36:35.029 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.029 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a0d52dd:::benchmark_data_smithi188_104537_object24111:head# 2024-04-01T19:36:35.029 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.029 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a0dd7b0:::benchmark_data_smithi188_104537_object122954:head# 2024-04-01T19:36:35.029 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.030 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a0e1b0e:::benchmark_data_smithi188_104537_object144885:head# 2024-04-01T19:36:35.030 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.030 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a0e5b84:::benchmark_data_smithi188_104537_object124919:head# 2024-04-01T19:36:35.030 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.031 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a0eb0d9:::benchmark_data_smithi188_104537_object161021:head# 2024-04-01T19:36:35.031 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a0ef84f:::benchmark_data_smithi188_104537_object119859:head# 2024-04-01T19:36:35.035 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.035 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a0fc694:::benchmark_data_smithi188_104537_object103754:head# 2024-04-01T19:36:35.036 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.038 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a105245:::benchmark_data_smithi188_104537_object154347:head# 2024-04-01T19:36:35.038 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.039 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a10b342:::benchmark_data_smithi188_104537_object145254:head# 2024-04-01T19:36:35.039 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.039 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a117395:::benchmark_data_smithi188_104537_object65777:head# 2024-04-01T19:36:35.039 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.039 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a117fbb:::benchmark_data_smithi188_104537_object104682:head# 2024-04-01T19:36:35.039 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.040 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a11efcc:::benchmark_data_smithi188_104537_object96199:head# 2024-04-01T19:36:35.040 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.045 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a124f4e:::benchmark_data_smithi188_104537_object152478:head# 2024-04-01T19:36:35.045 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.045 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a1252e8:::benchmark_data_smithi188_104537_object119580:head# 2024-04-01T19:36:35.045 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.045 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a129ec9:::benchmark_data_smithi188_104537_object51540:head# 2024-04-01T19:36:35.045 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.045 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a132d3e:::benchmark_data_smithi188_104537_object48788:head# 2024-04-01T19:36:35.045 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a133cb9:::benchmark_data_smithi188_104537_object163574:head# 2024-04-01T19:36:35.046 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a133ffd:::benchmark_data_smithi188_104537_object82720:head# 2024-04-01T19:36:35.046 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a135381:::benchmark_data_smithi188_104537_object89201:head# 2024-04-01T19:36:35.046 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a138617:::benchmark_data_smithi188_104537_object124703:head# 2024-04-01T19:36:35.046 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a14219c:::benchmark_data_smithi188_104537_object20270:head# 2024-04-01T19:36:35.046 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a146313:::benchmark_data_smithi188_104537_object74632:head# 2024-04-01T19:36:35.047 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.047 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a14ce98:::benchmark_data_smithi188_104537_object36244:head# 2024-04-01T19:36:35.047 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.047 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a14d4f1:::benchmark_data_smithi188_104537_object166862:head# 2024-04-01T19:36:35.047 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.047 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a14ec85:::benchmark_data_smithi188_104537_object51606:head# 2024-04-01T19:36:35.047 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.047 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a14f4e2:::benchmark_data_smithi188_104537_object118962:head# 2024-04-01T19:36:35.047 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.047 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a16093a:::benchmark_data_smithi188_104537_object89857:head# 2024-04-01T19:36:35.047 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.047 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a1631fe:::benchmark_data_smithi188_104537_object138538:head# 2024-04-01T19:36:35.047 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.047 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a168ac4:::benchmark_data_smithi188_104537_object145473:head# 2024-04-01T19:36:35.048 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.048 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a17e19a:::benchmark_data_smithi188_104537_object21478:head# 2024-04-01T19:36:35.048 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.048 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a1853e3:::benchmark_data_smithi188_104537_object161370:head# 2024-04-01T19:36:35.048 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.048 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a18604f:::benchmark_data_smithi188_104537_object77153:head# 2024-04-01T19:36:35.048 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.051 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a188078:::benchmark_data_smithi188_104537_object67964:head# 2024-04-01T19:36:35.051 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a18a605:::benchmark_data_smithi188_104537_object70972:head# 2024-04-01T19:36:35.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a18c409:::benchmark_data_smithi188_104537_object55002:head# 2024-04-01T19:36:35.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a196b78:::benchmark_data_smithi188_104537_object171136:head# 2024-04-01T19:36:35.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a197f43:::benchmark_data_smithi188_104537_object77361:head# 2024-04-01T19:36:35.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a1a1a5b:::benchmark_data_smithi188_104537_object88142:head# 2024-04-01T19:36:35.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a1a352f:::benchmark_data_smithi188_104537_object112295:head# 2024-04-01T19:36:35.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a1a74fa:::benchmark_data_smithi188_104537_object33723:head# 2024-04-01T19:36:35.053 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.053 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a1a95dd:::benchmark_data_smithi188_104537_object65735:head# 2024-04-01T19:36:35.053 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.053 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a1a9f59:::benchmark_data_smithi188_104537_object85364:head# 2024-04-01T19:36:35.053 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.053 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a1aaaa3:::benchmark_data_smithi188_104537_object16167:head# 2024-04-01T19:36:35.053 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.053 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a1abbe3:::benchmark_data_smithi188_104537_object26911:head# 2024-04-01T19:36:35.053 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.053 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a1ad99e:::benchmark_data_smithi188_104537_object101635:head# 2024-04-01T19:36:35.053 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.053 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a1b28dc:::benchmark_data_smithi188_104537_object134267:head# 2024-04-01T19:36:35.054 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.054 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a1b2b35:::benchmark_data_smithi188_104537_object11402:head# 2024-04-01T19:36:35.054 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.054 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a1c2cc2:::benchmark_data_smithi188_104537_object30253:head# 2024-04-01T19:36:35.054 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.054 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a1c3960:::benchmark_data_smithi188_104537_object59503:head# 2024-04-01T19:36:35.054 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.054 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a1c64fc:::benchmark_data_smithi188_104537_object39445:head# 2024-04-01T19:36:35.054 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.054 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a1cfafa:::benchmark_data_smithi188_104537_object38672:head# 2024-04-01T19:36:35.054 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.054 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a1d0fea:::benchmark_data_smithi188_104537_object51421:head# 2024-04-01T19:36:35.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.055 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a1d2ae2:::benchmark_data_smithi188_104537_object41417:head# 2024-04-01T19:36:35.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.056 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a1d3766:::benchmark_data_smithi188_104537_object36486:head# 2024-04-01T19:36:35.056 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.057 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a1d40e6:::benchmark_data_smithi188_104537_object99137:head# 2024-04-01T19:36:35.058 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.058 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a1d7034:::benchmark_data_smithi188_104537_object99077:head# 2024-04-01T19:36:35.058 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.058 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a1dabb0:::benchmark_data_smithi188_104537_object63693:head# 2024-04-01T19:36:35.058 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.058 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a1dd8c4:::benchmark_data_smithi188_104537_object93150:head# 2024-04-01T19:36:35.058 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a2055ce:::benchmark_data_smithi188_104537_object124705:head# 2024-04-01T19:36:35.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a205883:::benchmark_data_smithi188_104537_object161406:head# 2024-04-01T19:36:35.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a212721:::benchmark_data_smithi188_104537_object78514:head# 2024-04-01T19:36:35.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a2181d9:::benchmark_data_smithi188_104537_object129103:head# 2024-04-01T19:36:35.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a220147:::benchmark_data_smithi188_104537_object168615:head# 2024-04-01T19:36:35.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a226475:::benchmark_data_smithi188_104537_object104839:head# 2024-04-01T19:36:35.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a226a77:::benchmark_data_smithi188_104537_object86882:head# 2024-04-01T19:36:35.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.062 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a229af9:::benchmark_data_smithi188_104537_object117845:head# 2024-04-01T19:36:35.062 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.062 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a230cdd:::benchmark_data_smithi188_104537_object109544:head# 2024-04-01T19:36:35.062 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.062 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a23b6e3:::benchmark_data_smithi188_104537_object123310:head# 2024-04-01T19:36:35.062 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.062 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a23b7db:::benchmark_data_smithi188_104537_object96774:head# 2024-04-01T19:36:35.063 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.063 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a23ce72:::benchmark_data_smithi188_104537_object63072:head# 2024-04-01T19:36:35.063 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.063 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a243580:::benchmark_data_smithi188_104537_object80301:head# 2024-04-01T19:36:35.063 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.063 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a244317:::benchmark_data_smithi188_104537_object118820:head# 2024-04-01T19:36:35.063 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.063 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a244fa5:::benchmark_data_smithi188_104537_object19216:head# 2024-04-01T19:36:35.063 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.063 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a24aa2a:::benchmark_data_smithi188_104537_object94436:head# 2024-04-01T19:36:35.063 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.063 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a253b00:::benchmark_data_smithi188_104537_object138567:head# 2024-04-01T19:36:35.063 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.065 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a25b526:::benchmark_data_smithi188_104537_object115685:head# 2024-04-01T19:36:35.065 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.065 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a268806:::benchmark_data_smithi188_104537_object72457:head# 2024-04-01T19:36:35.065 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a28ccec:::benchmark_data_smithi188_104537_object128342:head# 2024-04-01T19:36:35.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a29893e:::benchmark_data_smithi188_104537_object143431:head# 2024-04-01T19:36:35.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a2a5760:::benchmark_data_smithi188_104537_object85031:head# 2024-04-01T19:36:35.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a2a5bc1:::benchmark_data_smithi188_104537_object61080:head# 2024-04-01T19:36:35.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a2ab4c2:::benchmark_data_smithi188_104537_object171652:head# 2024-04-01T19:36:35.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a2abaf9:::benchmark_data_smithi188_104537_object137753:head# 2024-04-01T19:36:35.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a2ae2fc:::benchmark_data_smithi188_104537_object71682:head# 2024-04-01T19:36:35.067 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.067 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a2ba715:::benchmark_data_smithi188_104537_object128095:head# 2024-04-01T19:36:35.067 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.067 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a2c1273:::benchmark_data_smithi188_104537_object65759:head# 2024-04-01T19:36:35.067 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a2d1943:::benchmark_data_smithi188_104537_object99417:head# 2024-04-01T19:36:35.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a2d6aaf:::benchmark_data_smithi188_104537_object55477:head# 2024-04-01T19:36:35.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a2d8bb6:::benchmark_data_smithi188_104537_object30800:head# 2024-04-01T19:36:35.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a2e79f6:::benchmark_data_smithi188_104537_object100645:head# 2024-04-01T19:36:35.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a2ee89d:::benchmark_data_smithi188_104537_object78111:head# 2024-04-01T19:36:35.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a2ef6f5:::benchmark_data_smithi188_104537_object61826:head# 2024-04-01T19:36:35.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a2ef8c3:::benchmark_data_smithi188_104537_object74469:head# 2024-04-01T19:36:35.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a2f260e:::benchmark_data_smithi188_104537_object117544:head# 2024-04-01T19:36:35.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a304484:::benchmark_data_smithi188_104537_object119613:head# 2024-04-01T19:36:35.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a3054cd:::benchmark_data_smithi188_104537_object57549:head# 2024-04-01T19:36:35.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a30a943:::benchmark_data_smithi188_104537_object147102:head# 2024-04-01T19:36:35.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a30cd03:::benchmark_data_smithi188_104537_object48902:head# 2024-04-01T19:36:35.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a314247:::benchmark_data_smithi188_104537_object42752:head# 2024-04-01T19:36:35.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a322698:::benchmark_data_smithi188_104537_object95569:head# 2024-04-01T19:36:35.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a32c364:::benchmark_data_smithi188_104537_object48326:head# 2024-04-01T19:36:35.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a32fc6d:::benchmark_data_smithi188_104537_object31591:head# 2024-04-01T19:36:35.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a330fd5:::benchmark_data_smithi188_104537_object87050:head# 2024-04-01T19:36:35.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a33a80c:::benchmark_data_smithi188_104537_object101383:head# 2024-04-01T19:36:35.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a33e569:::benchmark_data_smithi188_104537_object92791:head# 2024-04-01T19:36:35.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a340509:::benchmark_data_smithi188_104537_object59326:head# 2024-04-01T19:36:35.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a341d13:::benchmark_data_smithi188_104537_object70160:head# 2024-04-01T19:36:35.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a34868e:::benchmark_data_smithi188_104537_object139656:head# 2024-04-01T19:36:35.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.075 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a349ddd:::benchmark_data_smithi188_104537_object12823:head# 2024-04-01T19:36:35.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a35213b:::benchmark_data_smithi188_104537_object151824:head# 2024-04-01T19:36:35.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a352b87:::benchmark_data_smithi188_104537_object99121:head# 2024-04-01T19:36:35.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a359e2b:::benchmark_data_smithi188_104537_object58742:head# 2024-04-01T19:36:35.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a36becd:::benchmark_data_smithi188_104537_object144237:head# 2024-04-01T19:36:35.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a381fc8:::benchmark_data_smithi188_104537_object33279:head# 2024-04-01T19:36:35.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a38d2e8:::benchmark_data_smithi188_104537_object145255:head# 2024-04-01T19:36:35.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a39467b:::benchmark_data_smithi188_104537_object95274:head# 2024-04-01T19:36:35.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a39a3cb:::benchmark_data_smithi188_104537_object102563:head# 2024-04-01T19:36:35.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a39c400:::benchmark_data_smithi188_104537_object85694:head# 2024-04-01T19:36:35.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a39edb3:::benchmark_data_smithi188_104537_object167620:head# 2024-04-01T19:36:35.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.078 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a3a10fe:::benchmark_data_smithi188_104537_object82025:head# 2024-04-01T19:36:35.078 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.078 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a3a1653:::benchmark_data_smithi188_104537_object35239:head# 2024-04-01T19:36:35.078 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.078 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a3a963f:::benchmark_data_smithi188_104537_object81501:head# 2024-04-01T19:36:35.078 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.079 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a3ad7eb:::benchmark_data_smithi188_104537_object108326:head# 2024-04-01T19:36:35.079 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.079 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a3b2cb9:::benchmark_data_smithi188_104537_object15280:head# 2024-04-01T19:36:35.080 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.080 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a3bae4c:::benchmark_data_smithi188_104537_object29508:head# 2024-04-01T19:36:35.080 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.080 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a3c2bc1:::benchmark_data_smithi188_104537_object97328:head# 2024-04-01T19:36:35.080 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.080 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a3c2e72:::benchmark_data_smithi188_104537_object122402:head# 2024-04-01T19:36:35.080 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.080 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a3ce436:::benchmark_data_smithi188_104537_object83368:head# 2024-04-01T19:36:35.080 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a3d540a:::benchmark_data_smithi188_104537_object28979:head# 2024-04-01T19:36:35.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a3dd823:::benchmark_data_smithi188_104537_object18306:head# 2024-04-01T19:36:35.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a3df7e7:::benchmark_data_smithi188_104537_object108076:head# 2024-04-01T19:36:35.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a3e2c8a:::benchmark_data_smithi188_104537_object149831:head# 2024-04-01T19:36:35.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a3e3573:::benchmark_data_smithi188_104537_object169095:head# 2024-04-01T19:36:35.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.086 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a3e6fe1:::benchmark_data_smithi188_104537_object28395:head# 2024-04-01T19:36:35.086 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.086 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a3f5436:::benchmark_data_smithi188_104537_object52335:head# 2024-04-01T19:36:35.086 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.086 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a3f7c8c:::benchmark_data_smithi188_104537_object35040:head# 2024-04-01T19:36:35.086 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.086 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a402e7c:::benchmark_data_smithi188_104537_object28911:head# 2024-04-01T19:36:35.086 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.086 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a406f83:::benchmark_data_smithi188_104537_object125368:head# 2024-04-01T19:36:35.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a40a93a:::benchmark_data_smithi188_104537_object91720:head# 2024-04-01T19:36:35.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a413daf:::benchmark_data_smithi188_104537_object161153:head# 2024-04-01T19:36:35.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a413e71:::benchmark_data_smithi188_104537_object29866:head# 2024-04-01T19:36:35.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a415306:::benchmark_data_smithi188_104537_object157145:head# 2024-04-01T19:36:35.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a41a881:::benchmark_data_smithi188_104537_object98620:head# 2024-04-01T19:36:35.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a41cff7:::benchmark_data_smithi188_104537_object33685:head# 2024-04-01T19:36:35.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a4271a7:::benchmark_data_smithi188_104537_object85158:head# 2024-04-01T19:36:35.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a4291b1:::benchmark_data_smithi188_104537_object156316:head# 2024-04-01T19:36:35.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a429693:::benchmark_data_smithi188_104537_object59692:head# 2024-04-01T19:36:35.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.089 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a42ecc1:::benchmark_data_smithi188_104537_object119764:head# 2024-04-01T19:36:35.089 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.089 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a440b76:::benchmark_data_smithi188_104537_object39335:head# 2024-04-01T19:36:35.089 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.089 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a44d3a5:::benchmark_data_smithi188_104537_object148442:head# 2024-04-01T19:36:35.089 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.089 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a44f843:::benchmark_data_smithi188_104537_object76645:head# 2024-04-01T19:36:35.089 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a4515ab:::benchmark_data_smithi188_104537_object128788:head# 2024-04-01T19:36:35.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a452f75:::benchmark_data_smithi188_104537_object139059:head# 2024-04-01T19:36:35.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a459698:::benchmark_data_smithi188_104537_object135615:head# 2024-04-01T19:36:35.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a45eda4:::benchmark_data_smithi188_104537_object93492:head# 2024-04-01T19:36:35.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a466bd8:::benchmark_data_smithi188_104537_object68513:head# 2024-04-01T19:36:35.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a48428b:::benchmark_data_smithi188_104537_object13159:head# 2024-04-01T19:36:35.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a48628c:::benchmark_data_smithi188_104537_object16470:head# 2024-04-01T19:36:35.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a48de52:::benchmark_data_smithi188_104537_object133427:head# 2024-04-01T19:36:35.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a48f847:::benchmark_data_smithi188_104537_object58376:head# 2024-04-01T19:36:35.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a499351:::benchmark_data_smithi188_104537_object117622:head# 2024-04-01T19:36:35.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a4a34ba:::benchmark_data_smithi188_104537_object94991:head# 2024-04-01T19:36:35.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.094 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a4a37eb:::benchmark_data_smithi188_104537_object57373:head# 2024-04-01T19:36:35.094 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.094 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a4b0e0d:::benchmark_data_smithi188_104537_object97944:head# 2024-04-01T19:36:35.094 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.094 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a4b46ee:::benchmark_data_smithi188_104537_object50508:head# 2024-04-01T19:36:35.094 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.094 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a4b5bb2:::benchmark_data_smithi188_104537_object96995:head# 2024-04-01T19:36:35.094 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a4b7254:::benchmark_data_smithi188_104537_object163885:head# 2024-04-01T19:36:35.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a4c500f:::benchmark_data_smithi188_104537_object166064:head# 2024-04-01T19:36:35.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.098 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a4c73b8:::benchmark_data_smithi188_104537_object61502:head# 2024-04-01T19:36:35.098 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.098 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a4d45dc:::benchmark_data_smithi188_104537_object141039:head# 2024-04-01T19:36:35.098 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.098 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a4d814b:::benchmark_data_smithi188_104537_object64793:head# 2024-04-01T19:36:35.098 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.098 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a4daa13:::benchmark_data_smithi188_104537_object72737:head# 2024-04-01T19:36:35.098 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.098 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a4db8e9:::benchmark_data_smithi188_104537_object163394:head# 2024-04-01T19:36:35.098 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.099 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a4e0445:::benchmark_data_smithi188_104537_object53204:head# 2024-04-01T19:36:35.099 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.099 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a4e937e:::benchmark_data_smithi188_104537_object40067:head# 2024-04-01T19:36:35.099 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.099 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a4ea10a:::benchmark_data_smithi188_104537_object25803:head# 2024-04-01T19:36:35.099 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.099 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a4f05b4:::benchmark_data_smithi188_104537_object39308:head# 2024-04-01T19:36:35.099 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.099 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a4f5366:::benchmark_data_smithi188_104537_object121410:head# 2024-04-01T19:36:35.099 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.099 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a4f7f84:::benchmark_data_smithi188_104537_object64188:head# 2024-04-01T19:36:35.099 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.100 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a4fc139:::benchmark_data_smithi188_104537_object142717:head# 2024-04-01T19:36:35.100 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.101 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a4fd54a:::benchmark_data_smithi188_104537_object48982:head# 2024-04-01T19:36:35.101 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.101 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a50039b:::benchmark_data_smithi188_104537_object144872:head# 2024-04-01T19:36:35.101 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.101 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a502850:::benchmark_data_smithi188_104537_object143145:head# 2024-04-01T19:36:35.101 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.101 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a50336c:::benchmark_data_smithi188_104537_object132044:head# 2024-04-01T19:36:35.101 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a506657:::benchmark_data_smithi188_104537_object156626:head# 2024-04-01T19:36:35.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a507555:::benchmark_data_smithi188_104537_object41216:head# 2024-04-01T19:36:35.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a50bbf3:::benchmark_data_smithi188_104537_object111202:head# 2024-04-01T19:36:35.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a50e319:::benchmark_data_smithi188_104537_object90317:head# 2024-04-01T19:36:35.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.104 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a520a8a:::benchmark_data_smithi188_104537_object61421:head# 2024-04-01T19:36:35.104 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.105 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a52cdfa:::benchmark_data_smithi188_104537_object149959:head# 2024-04-01T19:36:35.105 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.105 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a52ea9b:::benchmark_data_smithi188_104537_object113299:head# 2024-04-01T19:36:35.105 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.105 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a5327dd:::benchmark_data_smithi188_104537_object25415:head# 2024-04-01T19:36:35.105 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.105 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a53602b:::benchmark_data_smithi188_104537_object16092:head# 2024-04-01T19:36:35.105 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.106 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a53bab7:::benchmark_data_smithi188_104537_object143209:head# 2024-04-01T19:36:35.106 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.106 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a53dd8a:::benchmark_data_smithi188_104537_object78855:head# 2024-04-01T19:36:35.106 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.106 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a5402e3:::benchmark_data_smithi188_104537_object36242:head# 2024-04-01T19:36:35.106 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.106 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a5421db:::benchmark_data_smithi188_104537_object34049:head# 2024-04-01T19:36:35.106 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.106 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a55142a:::benchmark_data_smithi188_104537_object67862:head# 2024-04-01T19:36:35.106 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.106 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a5547de:::benchmark_data_smithi188_104537_object34386:head# 2024-04-01T19:36:35.106 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.106 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a557a35:::benchmark_data_smithi188_104537_object95977:head# 2024-04-01T19:36:35.106 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.107 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a558a89:::benchmark_data_smithi188_104537_object80742:head# 2024-04-01T19:36:35.107 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.107 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a55c735:::benchmark_data_smithi188_104537_object80646:head# 2024-04-01T19:36:35.107 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.108 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a560b07:::benchmark_data_smithi188_104537_object75072:head# 2024-04-01T19:36:35.108 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.108 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a5673da:::benchmark_data_smithi188_104537_object96992:head# 2024-04-01T19:36:35.108 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.108 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a568d69:::benchmark_data_smithi188_104537_object161393:head# 2024-04-01T19:36:35.108 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.108 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a569556:::benchmark_data_smithi188_104537_object142297:head# 2024-04-01T19:36:35.108 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.108 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a57a18a:::benchmark_data_smithi188_104537_object118898:head# 2024-04-01T19:36:35.108 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.108 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a57e44f:::benchmark_data_smithi188_104537_object40556:head# 2024-04-01T19:36:35.108 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.109 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a5849f9:::benchmark_data_smithi188_104537_object52691:head# 2024-04-01T19:36:35.109 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.109 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a58a3be:::benchmark_data_smithi188_104537_object50230:head# 2024-04-01T19:36:35.109 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.109 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a58f7aa:::benchmark_data_smithi188_104537_object31573:head# 2024-04-01T19:36:35.109 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.109 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a595b5e:::benchmark_data_smithi188_104537_object79326:head# 2024-04-01T19:36:35.109 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.109 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a597f43:::benchmark_data_smithi188_104537_object125418:head# 2024-04-01T19:36:35.109 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.109 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a59ea1f:::benchmark_data_smithi188_104537_object69151:head# 2024-04-01T19:36:35.109 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.109 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a5ac327:::benchmark_data_smithi188_104537_object154035:head# 2024-04-01T19:36:35.109 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.110 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a5b77f8:::benchmark_data_smithi188_104537_object155907:head# 2024-04-01T19:36:35.110 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.110 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a5c7cb8:::benchmark_data_smithi188_104537_object156150:head# 2024-04-01T19:36:35.110 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.111 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a5ced6f:::benchmark_data_smithi188_104537_object122601:head# 2024-04-01T19:36:35.111 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.113 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a5d0b35:::benchmark_data_smithi188_104537_object98722:head# 2024-04-01T19:36:35.113 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.114 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a5d2326:::benchmark_data_smithi188_104537_object97382:head# 2024-04-01T19:36:35.114 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.115 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a5ea994:::benchmark_data_smithi188_104537_object114567:head# 2024-04-01T19:36:35.115 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.115 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a5ef383:::benchmark_data_smithi188_104537_object43239:head# 2024-04-01T19:36:35.115 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.115 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a5f6793:::benchmark_data_smithi188_104537_object116778:head# 2024-04-01T19:36:35.115 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.115 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a5fb493:::benchmark_data_smithi188_104537_object150229:head# 2024-04-01T19:36:35.115 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.115 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a608f3f:::benchmark_data_smithi188_104537_object48696:head# 2024-04-01T19:36:35.115 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.117 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a60cdef:::benchmark_data_smithi188_104537_object35271:head# 2024-04-01T19:36:35.117 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.117 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a60d02a:::benchmark_data_smithi188_104537_object142330:head# 2024-04-01T19:36:35.117 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.117 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a60da17:::benchmark_data_smithi188_104537_object165923:head# 2024-04-01T19:36:35.117 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.117 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a614cce:::benchmark_data_smithi188_104537_object59467:head# 2024-04-01T19:36:35.117 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.117 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a617869:::benchmark_data_smithi188_104537_object139706:head# 2024-04-01T19:36:35.118 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.118 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a618b34:::benchmark_data_smithi188_104537_object67528:head# 2024-04-01T19:36:35.118 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.118 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a625fb1:::benchmark_data_smithi188_104537_object83375:head# 2024-04-01T19:36:35.118 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.118 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a626e5f:::benchmark_data_smithi188_104537_object41807:head# 2024-04-01T19:36:35.118 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.120 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a62f121:::benchmark_data_smithi188_104537_object161871:head# 2024-04-01T19:36:35.120 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.120 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a639ce6:::benchmark_data_smithi188_104537_object155299:head# 2024-04-01T19:36:35.120 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.121 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a6444d5:::benchmark_data_smithi188_104537_object109708:head# 2024-04-01T19:36:35.121 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.121 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a6473cb:::benchmark_data_smithi188_104537_object138848:head# 2024-04-01T19:36:35.121 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.121 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a647e23:::benchmark_data_smithi188_104537_object110233:head# 2024-04-01T19:36:35.121 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.121 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a64abf5:::benchmark_data_smithi188_104537_object158782:head# 2024-04-01T19:36:35.121 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.121 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a64c12b:::benchmark_data_smithi188_104537_object76956:head# 2024-04-01T19:36:35.121 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.121 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a64c5bc:::benchmark_data_smithi188_104537_object159923:head# 2024-04-01T19:36:35.122 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.122 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a661eb6:::benchmark_data_smithi188_104537_object137148:head# 2024-04-01T19:36:35.122 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.122 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a672244:::benchmark_data_smithi188_104537_object116469:head# 2024-04-01T19:36:35.122 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.122 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a67930c:::benchmark_data_smithi188_104537_object58872:head# 2024-04-01T19:36:35.122 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.122 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a67afe2:::benchmark_data_smithi188_104537_object163342:head# 2024-04-01T19:36:35.122 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.122 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a67bd66:::benchmark_data_smithi188_104537_object25953:head# 2024-04-01T19:36:35.122 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.126 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a67cc7d:::benchmark_data_smithi188_104537_object22290:head# 2024-04-01T19:36:35.126 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.126 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a687729:::benchmark_data_smithi188_104537_object121887:head# 2024-04-01T19:36:35.127 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.127 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a68c737:::benchmark_data_smithi188_104537_object70723:head# 2024-04-01T19:36:35.127 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.127 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a695e06:::benchmark_data_smithi188_104537_object34936:head# 2024-04-01T19:36:35.127 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.127 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a699dd7:::benchmark_data_smithi188_104537_object88206:head# 2024-04-01T19:36:35.127 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.127 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a6a6da7:::benchmark_data_smithi188_104537_object127941:head# 2024-04-01T19:36:35.127 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.127 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a6aa0b9:::benchmark_data_smithi188_104537_object48891:head# 2024-04-01T19:36:35.127 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.127 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a6b125e:::benchmark_data_smithi188_104537_object41809:head# 2024-04-01T19:36:35.127 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a6b1947:::benchmark_data_smithi188_104537_object77256:head# 2024-04-01T19:36:35.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a6b5182:::benchmark_data_smithi188_104537_object116681:head# 2024-04-01T19:36:35.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a6b6076:::benchmark_data_smithi188_104537_object148053:head# 2024-04-01T19:36:35.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a6c66cf:::benchmark_data_smithi188_104537_object69539:head# 2024-04-01T19:36:35.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a6c7843:::benchmark_data_smithi188_104537_object130300:head# 2024-04-01T19:36:35.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a6ca008:::benchmark_data_smithi188_104537_object156471:head# 2024-04-01T19:36:35.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a6d4393:::benchmark_data_smithi188_104537_object71079:head# 2024-04-01T19:36:35.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a6d5a34:::benchmark_data_smithi188_104537_object107728:head# 2024-04-01T19:36:35.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a6d5ada:::benchmark_data_smithi188_104537_object97153:head# 2024-04-01T19:36:35.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a6daa97:::benchmark_data_smithi188_104537_object93210:head# 2024-04-01T19:36:35.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a6df4c8:::benchmark_data_smithi188_104537_object83615:head# 2024-04-01T19:36:35.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a6e1d50:::benchmark_data_smithi188_104537_object151231:head# 2024-04-01T19:36:35.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a6e4cac:::benchmark_data_smithi188_104537_object89656:head# 2024-04-01T19:36:35.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a6e6a38:::benchmark_data_smithi188_104537_object143731:head# 2024-04-01T19:36:35.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.130 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a6e6ae5:::benchmark_data_smithi188_104537_object44117:head# 2024-04-01T19:36:35.130 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.130 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a6e98aa:::benchmark_data_smithi188_104537_object85012:head# 2024-04-01T19:36:35.130 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.132 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a6ebc68:::benchmark_data_smithi188_104537_object166107:head# 2024-04-01T19:36:35.132 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.132 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a6f2a84:::benchmark_data_smithi188_104537_object85872:head# 2024-04-01T19:36:35.132 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.132 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a6fcf6b:::benchmark_data_smithi188_104537_object58172:head# 2024-04-01T19:36:35.132 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.133 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a720e71:::benchmark_data_smithi188_104537_object12970:head# 2024-04-01T19:36:35.133 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.133 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a758e11:::benchmark_data_smithi188_104537_object114713:head# 2024-04-01T19:36:35.133 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.133 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a75aed2:::benchmark_data_smithi188_104537_object94033:head# 2024-04-01T19:36:35.133 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.133 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a75b504:::benchmark_data_smithi188_104537_object76621:head# 2024-04-01T19:36:35.133 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.133 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a75c27f:::benchmark_data_smithi188_104537_object122733:head# 2024-04-01T19:36:35.133 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.133 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a76406e:::benchmark_data_smithi188_104537_object163286:head# 2024-04-01T19:36:35.133 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.134 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a7675f1:::benchmark_data_smithi188_104537_object72540:head# 2024-04-01T19:36:35.134 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.134 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a76b083:::benchmark_data_smithi188_104537_object81635:head# 2024-04-01T19:36:35.134 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.134 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a76c525:::benchmark_data_smithi188_104537_object28719:head# 2024-04-01T19:36:35.134 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.134 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a779987:::benchmark_data_smithi188_104537_object129168:head# 2024-04-01T19:36:35.134 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.134 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a7838a6:::benchmark_data_smithi188_104537_object161028:head# 2024-04-01T19:36:35.134 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.134 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a78aafa:::benchmark_data_smithi188_104537_object159244:head# 2024-04-01T19:36:35.134 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.135 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a793dc5:::benchmark_data_smithi188_104537_object78884:head# 2024-04-01T19:36:35.135 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.135 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a797b42:::benchmark_data_smithi188_104537_object93307:head# 2024-04-01T19:36:35.135 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.139 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a798487:::benchmark_data_smithi188_104537_object147248:head# 2024-04-01T19:36:35.139 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.139 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a79c242:::benchmark_data_smithi188_104537_object57954:head# 2024-04-01T19:36:35.139 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.139 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a79f3b9:::benchmark_data_smithi188_104537_object103864:head# 2024-04-01T19:36:35.140 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.140 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a7a159c:::benchmark_data_smithi188_104537_object81590:head# 2024-04-01T19:36:35.140 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.140 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a7a4533:::benchmark_data_smithi188_104537_object127578:head# 2024-04-01T19:36:35.140 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.140 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a7b01ac:::benchmark_data_smithi188_104537_object12072:head# 2024-04-01T19:36:35.140 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.140 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a7b282f:::benchmark_data_smithi188_104537_object17940:head# 2024-04-01T19:36:35.140 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.140 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a7c145d:::benchmark_data_smithi188_104537_object88325:head# 2024-04-01T19:36:35.140 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.140 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a7cbff8:::benchmark_data_smithi188_104537_object48155:head# 2024-04-01T19:36:35.141 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a7d9305:::benchmark_data_smithi188_104537_object112904:head# 2024-04-01T19:36:35.141 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a7dd199:::benchmark_data_smithi188_104537_object64082:head# 2024-04-01T19:36:35.141 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a7dd949:::benchmark_data_smithi188_104537_object21448:head# 2024-04-01T19:36:35.141 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a7e10d8:::benchmark_data_smithi188_104537_object145008:head# 2024-04-01T19:36:35.141 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a7ed45d:::benchmark_data_smithi188_104537_object156921:head# 2024-04-01T19:36:35.141 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a7f63f9:::benchmark_data_smithi188_104537_object129429:head# 2024-04-01T19:36:35.141 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.142 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a7fed69:::benchmark_data_smithi188_104537_object160618:head# 2024-04-01T19:36:35.142 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.142 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a807980:::benchmark_data_smithi188_104537_object46340:head# 2024-04-01T19:36:35.142 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.142 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a80ab6e:::benchmark_data_smithi188_104537_object66890:head# 2024-04-01T19:36:35.142 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.142 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a817ca2:::benchmark_data_smithi188_104537_object159430:head# 2024-04-01T19:36:35.142 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.142 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a82546c:::benchmark_data_smithi188_104537_object35841:head# 2024-04-01T19:36:35.142 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.142 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a829b74:::benchmark_data_smithi188_104537_object104727:head# 2024-04-01T19:36:35.142 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.143 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a82dd95:::benchmark_data_smithi188_104537_object143759:head# 2024-04-01T19:36:35.143 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.143 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a830cb5:::benchmark_data_smithi188_104537_object160127:head# 2024-04-01T19:36:35.143 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.143 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a8315a0:::benchmark_data_smithi188_104537_object66007:head# 2024-04-01T19:36:35.143 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.143 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a8389a8:::benchmark_data_smithi188_104537_object46338:head# 2024-04-01T19:36:35.143 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.143 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a842f57:::benchmark_data_smithi188_104537_object126998:head# 2024-04-01T19:36:35.143 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.143 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a844685:::benchmark_data_smithi188_104537_object95302:head# 2024-04-01T19:36:35.143 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.143 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a847997:::benchmark_data_smithi188_104537_object42957:head# 2024-04-01T19:36:35.144 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.150 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a84faa2:::benchmark_data_smithi188_104537_object64093:head# 2024-04-01T19:36:35.150 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.150 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a854be0:::benchmark_data_smithi188_104537_object89470:head# 2024-04-01T19:36:35.150 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.150 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a856b2c:::benchmark_data_smithi188_104537_object47867:head# 2024-04-01T19:36:35.150 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.150 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a8595ec:::benchmark_data_smithi188_104537_object38902:head# 2024-04-01T19:36:35.151 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.151 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a859ce0:::benchmark_data_smithi188_104537_object103538:head# 2024-04-01T19:36:35.151 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.151 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a867726:::benchmark_data_smithi188_104537_object122334:head# 2024-04-01T19:36:35.151 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.151 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a868787:::benchmark_data_smithi188_104537_object35920:head# 2024-04-01T19:36:35.151 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.151 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a86d209:::benchmark_data_smithi188_104537_object42025:head# 2024-04-01T19:36:35.151 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.151 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a873c99:::benchmark_data_smithi188_104537_object97431:head# 2024-04-01T19:36:35.151 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.151 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a897999:::benchmark_data_smithi188_104537_object19338:head# 2024-04-01T19:36:35.152 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.152 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a89aa98:::benchmark_data_smithi188_104537_object147512:head# 2024-04-01T19:36:35.152 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.152 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a89ef51:::benchmark_data_smithi188_104537_object64185:head# 2024-04-01T19:36:35.152 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.152 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a8a1779:::benchmark_data_smithi188_104537_object57502:head# 2024-04-01T19:36:35.152 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.152 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a8a4b40:::benchmark_data_smithi188_104537_object110751:head# 2024-04-01T19:36:35.152 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.152 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a8a583c:::benchmark_data_smithi188_104537_object15192:head# 2024-04-01T19:36:35.152 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.152 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a8b29cf:::benchmark_data_smithi188_104537_object63296:head# 2024-04-01T19:36:35.152 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.153 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a8b2bf3:::benchmark_data_smithi188_104537_object56431:head# 2024-04-01T19:36:35.153 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.153 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a8b91cd:::benchmark_data_smithi188_104537_object88245:head# 2024-04-01T19:36:35.153 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.153 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a8ba210:::benchmark_data_smithi188_104537_object25146:head# 2024-04-01T19:36:35.153 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.153 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a8bc36c:::benchmark_data_smithi188_104537_object46195:head# 2024-04-01T19:36:35.153 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.153 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a8cd5bb:::benchmark_data_smithi188_104537_object95290:head# 2024-04-01T19:36:35.153 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.153 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a8d4f2d:::benchmark_data_smithi188_104537_object165156:head# 2024-04-01T19:36:35.153 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.154 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a8d752f:::benchmark_data_smithi188_104537_object105329:head# 2024-04-01T19:36:35.154 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.154 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a8d7910:::benchmark_data_smithi188_104537_object25376:head# 2024-04-01T19:36:35.154 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.154 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a8da7aa:::benchmark_data_smithi188_104537_object44489:head# 2024-04-01T19:36:35.154 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.154 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a8dc431:::benchmark_data_smithi188_104537_object49491:head# 2024-04-01T19:36:35.154 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.154 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a8e683f:::benchmark_data_smithi188_104537_object82181:head# 2024-04-01T19:36:35.154 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.154 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a8ef2fc:::benchmark_data_smithi188_104537_object155909:head# 2024-04-01T19:36:35.154 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.154 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a8facbd:::benchmark_data_smithi188_104537_object28506:head# 2024-04-01T19:36:35.155 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.155 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a8fec87:::benchmark_data_smithi188_104537_object58454:head# 2024-04-01T19:36:35.155 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.155 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a9010eb:::benchmark_data_smithi188_104537_object106168:head# 2024-04-01T19:36:35.155 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.155 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a902573:::benchmark_data_smithi188_104537_object168943:head# 2024-04-01T19:36:35.155 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.155 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a90b846:::benchmark_data_smithi188_104537_object91850:head# 2024-04-01T19:36:35.155 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.155 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a912b0a:::benchmark_data_smithi188_104537_object100965:head# 2024-04-01T19:36:35.155 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.155 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a913b42:::benchmark_data_smithi188_104537_object162483:head# 2024-04-01T19:36:35.155 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.156 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a914c4d:::benchmark_data_smithi188_104537_object43761:head# 2024-04-01T19:36:35.156 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.156 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a919eff:::benchmark_data_smithi188_104537_object164338:head# 2024-04-01T19:36:35.156 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.156 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a91a15d:::benchmark_data_smithi188_104537_object130964:head# 2024-04-01T19:36:35.157 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.157 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a9303b9:::benchmark_data_smithi188_104537_object42683:head# 2024-04-01T19:36:35.157 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.157 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a931522:::benchmark_data_smithi188_104537_object143633:head# 2024-04-01T19:36:35.157 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.157 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a937b54:::benchmark_data_smithi188_104537_object33278:head# 2024-04-01T19:36:35.157 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.157 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a94b879:::benchmark_data_smithi188_104537_object95015:head# 2024-04-01T19:36:35.157 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.159 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a9507e9:::benchmark_data_smithi188_104537_object81233:head# 2024-04-01T19:36:35.159 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.160 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a952940:::benchmark_data_smithi188_104537_object84056:head# 2024-04-01T19:36:35.160 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.160 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a95bd5a:::benchmark_data_smithi188_104537_object24599:head# 2024-04-01T19:36:35.160 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.160 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a95ff4f:::benchmark_data_smithi188_104537_object97389:head# 2024-04-01T19:36:35.160 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.160 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a96b936:::benchmark_data_smithi188_104537_object53821:head# 2024-04-01T19:36:35.160 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.160 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a977f01:::benchmark_data_smithi188_104537_object98013:head# 2024-04-01T19:36:35.160 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.160 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a97de09:::benchmark_data_smithi188_104537_object21955:head# 2024-04-01T19:36:35.160 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.160 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a994d44:::benchmark_data_smithi188_104537_object135577:head# 2024-04-01T19:36:35.160 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.161 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a9a9a84:::benchmark_data_smithi188_104537_object105396:head# 2024-04-01T19:36:35.161 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.161 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a9ac3cd:::benchmark_data_smithi188_104537_object27420:head# 2024-04-01T19:36:35.161 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.161 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a9b26a5:::benchmark_data_smithi188_104537_object137497:head# 2024-04-01T19:36:35.161 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.161 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a9c0bb2:::benchmark_data_smithi188_104537_object122043:head# 2024-04-01T19:36:35.161 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.161 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a9c2af0:::benchmark_data_smithi188_104537_object75090:head# 2024-04-01T19:36:35.161 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.162 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a9c3d0a:::benchmark_data_smithi188_104537_object111610:head# 2024-04-01T19:36:35.162 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.162 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a9c7feb:::benchmark_data_smithi188_104537_object58110:head# 2024-04-01T19:36:35.162 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.162 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a9caa57:::benchmark_data_smithi188_104537_object33444:head# 2024-04-01T19:36:35.162 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.162 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a9caad4:::benchmark_data_smithi188_104537_object160213:head# 2024-04-01T19:36:35.162 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.162 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a9cf3bf:::benchmark_data_smithi188_104537_object135490:head# 2024-04-01T19:36:35.162 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.162 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a9d0dac:::benchmark_data_smithi188_104537_object79691:head# 2024-04-01T19:36:35.163 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.163 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a9decff:::benchmark_data_smithi188_104537_object147062:head# 2024-04-01T19:36:35.163 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.163 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a9df5ed:::benchmark_data_smithi188_104537_object73616:head# 2024-04-01T19:36:35.163 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.163 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a9e21ca:::benchmark_data_smithi188_104537_object92198:head# 2024-04-01T19:36:35.163 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.163 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a9e3521:::benchmark_data_smithi188_104537_object153633:head# 2024-04-01T19:36:35.163 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.163 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a9e7feb:::benchmark_data_smithi188_104537_object38870:head# 2024-04-01T19:36:35.163 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.163 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a9ecd21:::benchmark_data_smithi188_104537_object168215:head# 2024-04-01T19:36:35.164 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.165 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5a9f7266:::benchmark_data_smithi188_104537_object42778:head# 2024-04-01T19:36:35.165 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.165 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa02286:::benchmark_data_smithi188_104537_object80574:head# 2024-04-01T19:36:35.165 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.165 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa07ca1:::benchmark_data_smithi188_104537_object66466:head# 2024-04-01T19:36:35.165 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.166 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa15763:::benchmark_data_smithi188_104537_object125453:head# 2024-04-01T19:36:35.166 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.166 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa17d16:::benchmark_data_smithi188_104537_object144000:head# 2024-04-01T19:36:35.166 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.166 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa22eeb:::benchmark_data_smithi188_104537_object154847:head# 2024-04-01T19:36:35.166 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.166 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa24a05:::benchmark_data_smithi188_104537_object78021:head# 2024-04-01T19:36:35.166 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.166 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa416b0:::benchmark_data_smithi188_104537_object112618:head# 2024-04-01T19:36:35.166 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.170 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa49829:::benchmark_data_smithi188_104537_object99901:head# 2024-04-01T19:36:35.170 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.170 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa51a1d:::benchmark_data_smithi188_104537_object163357:head# 2024-04-01T19:36:35.170 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.170 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa56245:::benchmark_data_smithi188_104537_object133566:head# 2024-04-01T19:36:35.170 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.170 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa571da:::benchmark_data_smithi188_104537_object161142:head# 2024-04-01T19:36:35.170 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.170 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa5fcba:::benchmark_data_smithi188_104537_object23198:head# 2024-04-01T19:36:35.170 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa65889:::benchmark_data_smithi188_104537_object146524:head# 2024-04-01T19:36:35.171 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa6a075:::benchmark_data_smithi188_104537_object108219:head# 2024-04-01T19:36:35.171 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa6b9bb:::benchmark_data_smithi188_104537_object35136:head# 2024-04-01T19:36:35.171 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa6ed81:::benchmark_data_smithi188_104537_object85763:head# 2024-04-01T19:36:35.171 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa6f32a:::benchmark_data_smithi188_104537_object93362:head# 2024-04-01T19:36:35.171 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa6f61c:::benchmark_data_smithi188_104537_object133513:head# 2024-04-01T19:36:35.171 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa7726c:::benchmark_data_smithi188_104537_object38575:head# 2024-04-01T19:36:35.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa795c4:::benchmark_data_smithi188_104537_object166104:head# 2024-04-01T19:36:35.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa807ff:::benchmark_data_smithi188_104537_object162665:head# 2024-04-01T19:36:35.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa85e85:::benchmark_data_smithi188_104537_object80882:head# 2024-04-01T19:36:35.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa87096:::benchmark_data_smithi188_104537_object84857:head# 2024-04-01T19:36:35.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa883e1:::benchmark_data_smithi188_104537_object59054:head# 2024-04-01T19:36:35.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa8ac8a:::benchmark_data_smithi188_104537_object26570:head# 2024-04-01T19:36:35.173 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.173 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa8ae14:::benchmark_data_smithi188_104537_object105306:head# 2024-04-01T19:36:35.173 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.177 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa901af:::benchmark_data_smithi188_104537_object93874:head# 2024-04-01T19:36:35.177 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.177 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa92559:::benchmark_data_smithi188_104537_object161018:head# 2024-04-01T19:36:35.177 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.177 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa99b67:::benchmark_data_smithi188_104537_object36678:head# 2024-04-01T19:36:35.177 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.177 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aa9c0be:::benchmark_data_smithi188_104537_object154856:head# 2024-04-01T19:36:35.178 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.178 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aaa0459:::benchmark_data_smithi188_104537_object22166:head# 2024-04-01T19:36:35.178 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.178 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aaa22dc:::benchmark_data_smithi188_104537_object135996:head# 2024-04-01T19:36:35.178 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.178 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aaa6cec:::benchmark_data_smithi188_104537_object63500:head# 2024-04-01T19:36:35.178 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.178 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aaa96e9:::benchmark_data_smithi188_104537_object159471:head# 2024-04-01T19:36:35.178 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.178 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aab69bc:::benchmark_data_smithi188_104537_object86796:head# 2024-04-01T19:36:35.178 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.178 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aac2f00:::benchmark_data_smithi188_104537_object84337:head# 2024-04-01T19:36:35.179 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.179 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aac9331:::benchmark_data_smithi188_104537_object69314:head# 2024-04-01T19:36:35.179 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.179 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aacd0de:::benchmark_data_smithi188_104537_object76625:head# 2024-04-01T19:36:35.179 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.179 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aad8573:::benchmark_data_smithi188_104537_object22388:head# 2024-04-01T19:36:35.179 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.179 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aae7017:::benchmark_data_smithi188_104537_object164262:head# 2024-04-01T19:36:35.179 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.179 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aae732d:::benchmark_data_smithi188_104537_object14442:head# 2024-04-01T19:36:35.179 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.179 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aae89b1:::benchmark_data_smithi188_104537_object32661:head# 2024-04-01T19:36:35.179 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.180 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aaea003:::benchmark_data_smithi188_104537_object47405:head# 2024-04-01T19:36:35.180 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.180 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aaea144:::benchmark_data_smithi188_104537_object152122:head# 2024-04-01T19:36:35.180 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.180 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aaeadf0:::benchmark_data_smithi188_104537_object108265:head# 2024-04-01T19:36:35.180 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.180 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aaec65f:::benchmark_data_smithi188_104537_object72769:head# 2024-04-01T19:36:35.180 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.180 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aaeda27:::benchmark_data_smithi188_104537_object63298:head# 2024-04-01T19:36:35.180 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.180 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aaedae0:::benchmark_data_smithi188_104537_object34749:head# 2024-04-01T19:36:35.180 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.181 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aaf46c7:::benchmark_data_smithi188_104537_object61121:head# 2024-04-01T19:36:35.181 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.181 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aaf48aa:::benchmark_data_smithi188_104537_object75087:head# 2024-04-01T19:36:35.181 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.181 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aafd178:::benchmark_data_smithi188_104537_object15592:head# 2024-04-01T19:36:35.181 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.181 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aaff1cd:::benchmark_data_smithi188_104537_object133554:head# 2024-04-01T19:36:35.181 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.181 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ab18076:::benchmark_data_smithi188_104537_object50931:head# 2024-04-01T19:36:35.181 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.184 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ab2e625:::benchmark_data_smithi188_104537_object70365:head# 2024-04-01T19:36:35.184 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.184 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ab345f6:::benchmark_data_smithi188_104537_object43202:head# 2024-04-01T19:36:35.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.185 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ab3d96e:::benchmark_data_smithi188_104537_object41547:head# 2024-04-01T19:36:35.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.185 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ab40a51:::benchmark_data_smithi188_104537_object86574:head# 2024-04-01T19:36:35.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.185 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ab49e14:::benchmark_data_smithi188_104537_object130368:head# 2024-04-01T19:36:35.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.185 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ab4f4f8:::benchmark_data_smithi188_104537_object171294:head# 2024-04-01T19:36:35.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.185 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ab5263d:::benchmark_data_smithi188_104537_object134077:head# 2024-04-01T19:36:35.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.185 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ab5d310:::benchmark_data_smithi188_104537_object82738:head# 2024-04-01T19:36:35.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.185 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ab70798:::benchmark_data_smithi188_104537_object67277:head# 2024-04-01T19:36:35.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.186 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ab71f91:::benchmark_data_smithi188_104537_object126013:head# 2024-04-01T19:36:35.186 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.186 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ab7523e:::benchmark_data_smithi188_104537_object38093:head# 2024-04-01T19:36:35.186 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.186 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ab75f33:::benchmark_data_smithi188_104537_object49697:head# 2024-04-01T19:36:35.186 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.186 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ab77701:::benchmark_data_smithi188_104537_object52206:head# 2024-04-01T19:36:35.186 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.186 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ab815ab:::benchmark_data_smithi188_104537_object123709:head# 2024-04-01T19:36:35.186 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.186 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ab83c50:::benchmark_data_smithi188_104537_object48142:head# 2024-04-01T19:36:35.186 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.186 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5abade54:::benchmark_data_smithi188_104537_object96851:head# 2024-04-01T19:36:35.187 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.187 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5abb238a:::benchmark_data_smithi188_104537_object11936:head# 2024-04-01T19:36:35.187 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.187 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5abb70c4:::benchmark_data_smithi188_104537_object65076:head# 2024-04-01T19:36:35.187 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.187 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5abd287a:::benchmark_data_smithi188_104537_object53693:head# 2024-04-01T19:36:35.187 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.187 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5abd3270:::benchmark_data_smithi188_104537_object159633:head# 2024-04-01T19:36:35.187 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.187 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5abd43a9:::benchmark_data_smithi188_104537_object71556:head# 2024-04-01T19:36:35.187 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.187 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5abdd9e2:::benchmark_data_smithi188_104537_object143794:head# 2024-04-01T19:36:35.187 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.187 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5abe81bf:::benchmark_data_smithi188_104537_object64703:head# 2024-04-01T19:36:35.187 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.187 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5abf5c0f:::benchmark_data_smithi188_104537_object145154:head# 2024-04-01T19:36:35.188 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.188 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ac026d8:::benchmark_data_smithi188_104537_object134636:head# 2024-04-01T19:36:35.188 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.188 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ac0562a:::benchmark_data_smithi188_104537_object92530:head# 2024-04-01T19:36:35.188 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.188 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ac0f5db:::benchmark_data_smithi188_104537_object73622:head# 2024-04-01T19:36:35.188 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.189 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ac1c79b:::benchmark_data_smithi188_104537_object160622:head# 2024-04-01T19:36:35.189 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.189 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ac1e06c:::benchmark_data_smithi188_104537_object84511:head# 2024-04-01T19:36:35.190 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.190 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ac2d29a:::benchmark_data_smithi188_104537_object127214:head# 2024-04-01T19:36:35.190 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.191 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ac3606d:::benchmark_data_smithi188_104537_object85387:head# 2024-04-01T19:36:35.191 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.191 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ac3cd3d:::benchmark_data_smithi188_104537_object148837:head# 2024-04-01T19:36:35.191 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.191 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ac3e6b5:::benchmark_data_smithi188_104537_object15254:head# 2024-04-01T19:36:35.191 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.191 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ac421dc:::benchmark_data_smithi188_104537_object20202:head# 2024-04-01T19:36:35.191 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.191 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ac5a770:::benchmark_data_smithi188_104537_object17915:head# 2024-04-01T19:36:35.191 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.192 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ac5f096:::benchmark_data_smithi188_104537_object39012:head# 2024-04-01T19:36:35.192 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.196 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ac641cc:::benchmark_data_smithi188_104537_object107596:head# 2024-04-01T19:36:35.196 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.196 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ac673fb:::benchmark_data_smithi188_104537_object36656:head# 2024-04-01T19:36:35.196 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.196 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ac6e13b:::benchmark_data_smithi188_104537_object66596:head# 2024-04-01T19:36:35.196 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.196 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ac73416:::benchmark_data_smithi188_104537_object90005:head# 2024-04-01T19:36:35.196 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.196 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ac74948:::benchmark_data_smithi188_104537_object127779:head# 2024-04-01T19:36:35.196 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.197 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:36:35.198 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ac7542d:::benchmark_data_smithi188_104537_object21140:head# 2024-04-01T19:36:35.198 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.198 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ac7b9ca:::benchmark_data_smithi188_104537_object36509:head# 2024-04-01T19:36:35.198 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.198 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ac7bd5e:::benchmark_data_smithi188_104537_object167312:head# 2024-04-01T19:36:35.198 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.198 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ac7bfdb:::benchmark_data_smithi188_104537_object39363:head# 2024-04-01T19:36:35.198 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.198 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ac8291a:::benchmark_data_smithi188_104537_object31732:head# 2024-04-01T19:36:35.198 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.199 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ac97775:::benchmark_data_smithi188_104537_object21565:head# 2024-04-01T19:36:35.199 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.199 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aca4920:::benchmark_data_smithi188_104537_object58121:head# 2024-04-01T19:36:35.199 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.200 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aca5128:::benchmark_data_smithi188_104537_object71294:head# 2024-04-01T19:36:35.200 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.200 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aca631c:::benchmark_data_smithi188_104537_object72395:head# 2024-04-01T19:36:35.200 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.200 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5acaad4e:::benchmark_data_smithi188_104537_object164652:head# 2024-04-01T19:36:35.200 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.201 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5acad081:::benchmark_data_smithi188_104537_object130388:head# 2024-04-01T19:36:35.201 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.201 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5acb170a:::benchmark_data_smithi188_104537_object105815:head# 2024-04-01T19:36:35.201 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.201 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5acc2b5c:::benchmark_data_smithi188_104537_object18763:head# 2024-04-01T19:36:35.201 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.201 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5acc68dd:::benchmark_data_smithi188_104537_object30175:head# 2024-04-01T19:36:35.201 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.201 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5acc8206:::benchmark_data_smithi188_104537_object150087:head# 2024-04-01T19:36:35.201 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.203 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5accc301:::benchmark_data_smithi188_104537_object161083:head# 2024-04-01T19:36:35.203 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.203 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5acd0e22:::benchmark_data_smithi188_104537_object101579:head# 2024-04-01T19:36:35.203 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.203 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5acd45a2:::benchmark_data_smithi188_104537_object165278:head# 2024-04-01T19:36:35.203 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.203 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5acd59c6:::benchmark_data_smithi188_104537_object76353:head# 2024-04-01T19:36:35.203 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.203 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5acd6240:::benchmark_data_smithi188_104537_object62055:head# 2024-04-01T19:36:35.203 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.204 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5acd6a86:::benchmark_data_smithi188_104537_object62996:head# 2024-04-01T19:36:35.204 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.204 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5acdb8a2:::benchmark_data_smithi188_104537_object53077:head# 2024-04-01T19:36:35.204 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.204 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5acdbb9f:::benchmark_data_smithi188_104537_object88896:head# 2024-04-01T19:36:35.204 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.204 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ace295d:::benchmark_data_smithi188_104537_object75807:head# 2024-04-01T19:36:35.205 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.205 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ace9c41:::benchmark_data_smithi188_104537_object112691:head# 2024-04-01T19:36:35.205 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.205 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:35.206 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:36:35.208 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5acf35b9:::benchmark_data_smithi188_104537_object62217:head# 2024-04-01T19:36:35.208 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.208 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5acf527f:::benchmark_data_smithi188_104537_object135665:head# 2024-04-01T19:36:35.208 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.208 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5acf8d79:::benchmark_data_smithi188_104537_object159233:head# 2024-04-01T19:36:35.208 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.208 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5acfe31c:::benchmark_data_smithi188_104537_object33214:head# 2024-04-01T19:36:35.208 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.208 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ad14fb9:::benchmark_data_smithi188_104537_object116354:head# 2024-04-01T19:36:35.208 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.209 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ad19807:::benchmark_data_smithi188_104537_object78882:head# 2024-04-01T19:36:35.209 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.209 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ad1b496:::benchmark_data_smithi188_104537_object159981:head# 2024-04-01T19:36:35.209 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.209 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ad1d5b6:::benchmark_data_smithi188_104537_object114984:head# 2024-04-01T19:36:35.209 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.209 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ad1df94:::benchmark_data_smithi188_104537_object62323:head# 2024-04-01T19:36:35.209 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.209 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ad1e624:::benchmark_data_smithi188_104537_object61841:head# 2024-04-01T19:36:35.209 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.209 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ad232af:::benchmark_data_smithi188_104537_object38414:head# 2024-04-01T19:36:35.209 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.209 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ad2dc43:::benchmark_data_smithi188_104537_object109481:head# 2024-04-01T19:36:35.209 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.209 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ad340ff:::benchmark_data_smithi188_104537_object86836:head# 2024-04-01T19:36:35.210 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.210 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ad373ad:::benchmark_data_smithi188_104537_object110314:head# 2024-04-01T19:36:35.210 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.210 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ad3a31e:::benchmark_data_smithi188_104537_object102366:head# 2024-04-01T19:36:35.210 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.213 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ad3d9ce:::benchmark_data_smithi188_104537_object77332:head# 2024-04-01T19:36:35.213 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.214 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ad467b5:::benchmark_data_smithi188_104537_object30448:head# 2024-04-01T19:36:35.214 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.215 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ad4c092:::benchmark_data_smithi188_104537_object116068:head# 2024-04-01T19:36:35.215 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.217 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ad50e4a:::benchmark_data_smithi188_104537_object105608:head# 2024-04-01T19:36:35.217 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.217 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ad62ef6:::benchmark_data_smithi188_104537_object158085:head# 2024-04-01T19:36:35.217 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.217 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ad6dfbf:::benchmark_data_smithi188_104537_object32338:head# 2024-04-01T19:36:35.217 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.217 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ad6eb38:::benchmark_data_smithi188_104537_object44025:head# 2024-04-01T19:36:35.217 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.217 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ad70b52:::benchmark_data_smithi188_104537_object88324:head# 2024-04-01T19:36:35.218 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.218 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ad86f47:::benchmark_data_smithi188_104537_object72409:head# 2024-04-01T19:36:35.218 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.218 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ad9417e:::benchmark_data_smithi188_104537_object87197:head# 2024-04-01T19:36:35.218 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.218 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ada0f0c:::benchmark_data_smithi188_104537_object96215:head# 2024-04-01T19:36:35.219 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.219 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5adad969:::benchmark_data_smithi188_104537_object63160:head# 2024-04-01T19:36:35.219 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.220 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5adc3786:::benchmark_data_smithi188_104537_object133130:head# 2024-04-01T19:36:35.220 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5adc3daf:::benchmark_data_smithi188_104537_object125378:head# 2024-04-01T19:36:35.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ade0e64:::benchmark_data_smithi188_104537_object139714:head# 2024-04-01T19:36:35.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ade2e92:::benchmark_data_smithi188_104537_object148957:head# 2024-04-01T19:36:35.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ade872a:::benchmark_data_smithi188_104537_object100259:head# 2024-04-01T19:36:35.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5adef077:::benchmark_data_smithi188_104537_object119539:head# 2024-04-01T19:36:35.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.222 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5adf2743:::benchmark_data_smithi188_104537_object57903:head# 2024-04-01T19:36:35.223 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.223 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5adf4ad8:::benchmark_data_smithi188_104537_object141015:head# 2024-04-01T19:36:35.223 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.223 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5adf5455:::benchmark_data_smithi188_104537_object120127:head# 2024-04-01T19:36:35.223 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.223 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae008b3:::benchmark_data_smithi188_104537_object11953:head# 2024-04-01T19:36:35.223 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.223 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae09bf3:::benchmark_data_smithi188_104537_object53555:head# 2024-04-01T19:36:35.223 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.223 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae0f2b9:::benchmark_data_smithi188_104537_object95192:head# 2024-04-01T19:36:35.223 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.223 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae12b5a:::benchmark_data_smithi188_104537_object133288:head# 2024-04-01T19:36:35.224 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.224 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae14f5a:::benchmark_data_smithi188_104537_object113419:head# 2024-04-01T19:36:35.224 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.226 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae1c0d6:::benchmark_data_smithi188_104537_object165544:head# 2024-04-01T19:36:35.226 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.226 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae1d1ac:::benchmark_data_smithi188_104537_object27862:head# 2024-04-01T19:36:35.226 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae1e816:::benchmark_data_smithi188_104537_object52921:head# 2024-04-01T19:36:35.227 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae23dd8:::benchmark_data_smithi188_104537_object111588:head# 2024-04-01T19:36:35.227 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae2821d:::benchmark_data_smithi188_104537_object18432:head# 2024-04-01T19:36:35.227 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae318e6:::benchmark_data_smithi188_104537_object90179:head# 2024-04-01T19:36:35.227 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae340ce:::benchmark_data_smithi188_104537_object68400:head# 2024-04-01T19:36:35.227 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae36b83:::benchmark_data_smithi188_104537_object137621:head# 2024-04-01T19:36:35.227 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae3dd12:::benchmark_data_smithi188_104537_object112075:head# 2024-04-01T19:36:35.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.228 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae4318a:::benchmark_data_smithi188_104537_object73401:head# 2024-04-01T19:36:35.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.228 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae46c0d:::benchmark_data_smithi188_104537_object32009:head# 2024-04-01T19:36:35.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.228 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae49d14:::benchmark_data_smithi188_104537_object92565:head# 2024-04-01T19:36:35.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.228 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae4a7f3:::benchmark_data_smithi188_104537_object35261:head# 2024-04-01T19:36:35.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.231 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae4d8a6:::benchmark_data_smithi188_104537_object23532:head# 2024-04-01T19:36:35.231 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.231 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae51baf:::benchmark_data_smithi188_104537_object50280:head# 2024-04-01T19:36:35.231 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.231 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae5c420:::benchmark_data_smithi188_104537_object146348:head# 2024-04-01T19:36:35.231 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.231 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae677e4:::benchmark_data_smithi188_104537_object95077:head# 2024-04-01T19:36:35.231 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.232 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae6bf87:::benchmark_data_smithi188_104537_object42016:head# 2024-04-01T19:36:35.232 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.232 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae6d4fa:::benchmark_data_smithi188_104537_object43867:head# 2024-04-01T19:36:35.232 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.232 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae7281b:::benchmark_data_smithi188_104537_object141873:head# 2024-04-01T19:36:35.232 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.232 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae78f82:::benchmark_data_smithi188_104537_object63203:head# 2024-04-01T19:36:35.232 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.232 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ae8c3ff:::benchmark_data_smithi188_104537_object117767:head# 2024-04-01T19:36:35.232 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.232 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aeafe30:::benchmark_data_smithi188_104537_object141326:head# 2024-04-01T19:36:35.232 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.232 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aec3989:::benchmark_data_smithi188_104537_object41775:head# 2024-04-01T19:36:35.233 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.233 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aec94ca:::benchmark_data_smithi188_104537_object43269:head# 2024-04-01T19:36:35.233 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.233 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aeca570:::benchmark_data_smithi188_104537_object71559:head# 2024-04-01T19:36:35.233 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.233 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aed5130:::benchmark_data_smithi188_104537_object33043:head# 2024-04-01T19:36:35.233 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.233 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aedf8b5:::benchmark_data_smithi188_104537_object142511:head# 2024-04-01T19:36:35.233 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.233 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aee83d9:::benchmark_data_smithi188_104537_object97990:head# 2024-04-01T19:36:35.233 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.234 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aeecab0:::benchmark_data_smithi188_104537_object112827:head# 2024-04-01T19:36:35.234 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aef1182:::benchmark_data_smithi188_104537_object91007:head# 2024-04-01T19:36:35.235 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aef8ae7:::benchmark_data_smithi188_104537_object51390:head# 2024-04-01T19:36:35.235 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aefaf43:::benchmark_data_smithi188_104537_object145288:head# 2024-04-01T19:36:35.235 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af01881:::benchmark_data_smithi188_104537_object94336:head# 2024-04-01T19:36:35.235 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af063d4:::benchmark_data_smithi188_104537_object167070:head# 2024-04-01T19:36:35.235 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af0cadb:::benchmark_data_smithi188_104537_object123845:head# 2024-04-01T19:36:35.235 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af0efb7:::benchmark_data_smithi188_104537_object114356:head# 2024-04-01T19:36:35.235 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af1e505:::benchmark_data_smithi188_104537_object35814:head# 2024-04-01T19:36:35.241 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.241 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af1fdd7:::benchmark_data_smithi188_104537_object156266:head# 2024-04-01T19:36:35.241 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.241 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af272b5:::benchmark_data_smithi188_104537_object37451:head# 2024-04-01T19:36:35.241 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.241 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af275e3:::benchmark_data_smithi188_104537_object137661:head# 2024-04-01T19:36:35.241 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.241 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af2beec:::benchmark_data_smithi188_104537_object151408:head# 2024-04-01T19:36:35.241 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.241 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af34be4:::benchmark_data_smithi188_104537_object108125:head# 2024-04-01T19:36:35.241 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.241 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af3a05e:::benchmark_data_smithi188_104537_object114012:head# 2024-04-01T19:36:35.242 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.242 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af3ec54:::benchmark_data_smithi188_104537_object118042:head# 2024-04-01T19:36:35.242 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.242 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af4cd3d:::benchmark_data_smithi188_104537_object48217:head# 2024-04-01T19:36:35.242 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.242 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af4d398:::benchmark_data_smithi188_104537_object48274:head# 2024-04-01T19:36:35.242 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.242 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af4f562:::benchmark_data_smithi188_104537_object118867:head# 2024-04-01T19:36:35.242 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.242 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af53655:::benchmark_data_smithi188_104537_object125195:head# 2024-04-01T19:36:35.242 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.242 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af5cb93:::benchmark_data_smithi188_104537_object168257:head# 2024-04-01T19:36:35.243 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.243 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af5fb23:::benchmark_data_smithi188_104537_object31000:head# 2024-04-01T19:36:35.243 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.243 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af6738e:::benchmark_data_smithi188_104537_object133565:head# 2024-04-01T19:36:35.243 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.246 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af67e77:::benchmark_data_smithi188_104537_object12331:head# 2024-04-01T19:36:35.246 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.246 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af686a5:::benchmark_data_smithi188_104537_object30121:head# 2024-04-01T19:36:35.246 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.246 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af6c584:::benchmark_data_smithi188_104537_object103670:head# 2024-04-01T19:36:35.246 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.246 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af6ca81:::benchmark_data_smithi188_104537_object159395:head# 2024-04-01T19:36:35.246 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.246 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af6e2d2:::benchmark_data_smithi188_104537_object47594:head# 2024-04-01T19:36:35.246 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.246 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af764c1:::benchmark_data_smithi188_104537_object16163:head# 2024-04-01T19:36:35.247 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.247 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af7c9be:::benchmark_data_smithi188_104537_object151116:head# 2024-04-01T19:36:35.247 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.247 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af7fa44:::benchmark_data_smithi188_104537_object47728:head# 2024-04-01T19:36:35.247 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.247 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af88994:::benchmark_data_smithi188_104537_object122145:head# 2024-04-01T19:36:35.247 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.247 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af8cd7a:::benchmark_data_smithi188_104537_object151125:head# 2024-04-01T19:36:35.247 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.247 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5af98d94:::benchmark_data_smithi188_104537_object75854:head# 2024-04-01T19:36:35.247 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.247 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5afa5b8f:::benchmark_data_smithi188_104537_object167299:head# 2024-04-01T19:36:35.247 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.248 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5afaefd5:::benchmark_data_smithi188_104537_object45196:head# 2024-04-01T19:36:35.248 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.248 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5afb05bb:::benchmark_data_smithi188_104537_object45513:head# 2024-04-01T19:36:35.248 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.248 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5afb160b:::benchmark_data_smithi188_104537_object15226:head# 2024-04-01T19:36:35.248 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.248 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5afb6b16:::benchmark_data_smithi188_104537_object20374:head# 2024-04-01T19:36:35.248 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.248 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5afc57d0:::benchmark_data_smithi188_104537_object93533:head# 2024-04-01T19:36:35.248 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.248 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5afc8041:::benchmark_data_smithi188_104537_object135939:head# 2024-04-01T19:36:35.248 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.249 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5afc880f:::benchmark_data_smithi188_104537_object100157:head# 2024-04-01T19:36:35.249 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.250 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5afca19d:::benchmark_data_smithi188_104537_object73656:head# 2024-04-01T19:36:35.250 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.250 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5afd88e0:::benchmark_data_smithi188_104537_object56641:head# 2024-04-01T19:36:35.250 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.254 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5afdda85:::benchmark_data_smithi188_104537_object138120:head# 2024-04-01T19:36:35.254 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.254 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5afe089e:::benchmark_data_smithi188_104537_object44017:head# 2024-04-01T19:36:35.254 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.254 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5afeccb4:::benchmark_data_smithi188_104537_object49467:head# 2024-04-01T19:36:35.254 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.255 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5aff36de:::benchmark_data_smithi188_104537_object53654:head# 2024-04-01T19:36:35.255 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.255 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b00613a:::benchmark_data_smithi188_104537_object40095:head# 2024-04-01T19:36:35.255 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.255 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b00816a:::benchmark_data_smithi188_104537_object105516:head# 2024-04-01T19:36:35.255 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.256 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b00a8fc:::benchmark_data_smithi188_104537_object50763:head# 2024-04-01T19:36:35.257 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.257 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b00f1cc:::benchmark_data_smithi188_104537_object83025:head# 2024-04-01T19:36:35.257 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.257 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b00fd44:::benchmark_data_smithi188_104537_object111489:head# 2024-04-01T19:36:35.257 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.257 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b01205d:::benchmark_data_smithi188_104537_object83780:head# 2024-04-01T19:36:35.257 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.257 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b0121a6:::benchmark_data_smithi188_104537_object69270:head# 2024-04-01T19:36:35.257 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.264 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b016ebd:::benchmark_data_smithi188_104537_object141183:head# 2024-04-01T19:36:35.264 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.264 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b01b5ff:::benchmark_data_smithi188_104537_object138161:head# 2024-04-01T19:36:35.264 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.265 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b01cd23:::benchmark_data_smithi188_104537_object127006:head# 2024-04-01T19:36:35.265 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.265 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b01e51d:::benchmark_data_smithi188_104537_object93231:head# 2024-04-01T19:36:35.265 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.265 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b01f612:::benchmark_data_smithi188_104537_object99409:head# 2024-04-01T19:36:35.265 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.265 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b03180d:::benchmark_data_smithi188_104537_object133345:head# 2024-04-01T19:36:35.265 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.265 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b040aaa:::benchmark_data_smithi188_104537_object50175:head# 2024-04-01T19:36:35.265 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.266 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b042008:::benchmark_data_smithi188_104537_object19255:head# 2024-04-01T19:36:35.267 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.268 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b048393:::benchmark_data_smithi188_104537_object11273:head# 2024-04-01T19:36:35.268 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.268 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b04cb16:::benchmark_data_smithi188_104537_object112493:head# 2024-04-01T19:36:35.268 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.268 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b04e310:::benchmark_data_smithi188_104537_object82519:head# 2024-04-01T19:36:35.268 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.269 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b055c7e:::benchmark_data_smithi188_104537_object76971:head# 2024-04-01T19:36:35.269 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.269 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b06fd32:::benchmark_data_smithi188_104537_object27168:head# 2024-04-01T19:36:35.269 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.269 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b072eec:::benchmark_data_smithi188_104537_object123124:head# 2024-04-01T19:36:35.269 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.270 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b078386:::benchmark_data_smithi188_104537_object89882:head# 2024-04-01T19:36:35.270 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.270 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b07a502:::benchmark_data_smithi188_104537_object86438:head# 2024-04-01T19:36:35.270 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.271 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b07ebfe:::benchmark_data_smithi188_104537_object120041:head# 2024-04-01T19:36:35.271 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.271 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b08162f:::benchmark_data_smithi188_104537_object35611:head# 2024-04-01T19:36:35.271 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.272 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b086078:::benchmark_data_smithi188_104537_object112640:head# 2024-04-01T19:36:35.272 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.272 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b08d9f5:::benchmark_data_smithi188_104537_object167694:head# 2024-04-01T19:36:35.272 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.272 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b0b022f:::benchmark_data_smithi188_104537_object159908:head# 2024-04-01T19:36:35.272 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.272 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b0b10ea:::benchmark_data_smithi188_104537_object145320:head# 2024-04-01T19:36:35.272 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.272 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b0b3cdb:::benchmark_data_smithi188_104537_object87066:head# 2024-04-01T19:36:35.272 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.273 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b0b4c3b:::benchmark_data_smithi188_104537_object158774:head# 2024-04-01T19:36:35.273 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.273 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b0b736d:::benchmark_data_smithi188_104537_object72124:head# 2024-04-01T19:36:35.273 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.273 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b0bd399:::benchmark_data_smithi188_104537_object148517:head# 2024-04-01T19:36:35.273 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.273 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b0c77c5:::benchmark_data_smithi188_104537_object88993:head# 2024-04-01T19:36:35.274 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.277 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b0cb16d:::benchmark_data_smithi188_104537_object82883:head# 2024-04-01T19:36:35.277 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.278 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b0d1636:::benchmark_data_smithi188_104537_object167277:head# 2024-04-01T19:36:35.278 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.279 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b0d72c3:::benchmark_data_smithi188_104537_object158427:head# 2024-04-01T19:36:35.279 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.279 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b0dc1dd:::benchmark_data_smithi188_104537_object67228:head# 2024-04-01T19:36:35.279 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.280 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b0dc23e:::benchmark_data_smithi188_104537_object36077:head# 2024-04-01T19:36:35.280 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.280 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b0ded5c:::benchmark_data_smithi188_104537_object82429:head# 2024-04-01T19:36:35.280 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.280 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b0e9fcb:::benchmark_data_smithi188_104537_object112551:head# 2024-04-01T19:36:35.280 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.281 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b0eac3f:::benchmark_data_smithi188_104537_object108559:head# 2024-04-01T19:36:35.281 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.281 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b0eff78:::benchmark_data_smithi188_104537_object52571:head# 2024-04-01T19:36:35.281 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.281 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b0f5c15:::benchmark_data_smithi188_104537_object36068:head# 2024-04-01T19:36:35.281 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.281 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b109fc1:::benchmark_data_smithi188_104537_object111605:head# 2024-04-01T19:36:35.281 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.282 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b110954:::benchmark_data_smithi188_104537_object138320:head# 2024-04-01T19:36:35.282 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.283 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b11d805:::benchmark_data_smithi188_104537_object93299:head# 2024-04-01T19:36:35.283 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.283 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b120f78:::benchmark_data_smithi188_104537_object151547:head# 2024-04-01T19:36:35.283 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.283 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b126e7e:::benchmark_data_smithi188_104537_object64843:head# 2024-04-01T19:36:35.283 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.287 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b1347d0:::benchmark_data_smithi188_104537_object67710:head# 2024-04-01T19:36:35.287 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.287 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b13b94b:::benchmark_data_smithi188_104537_object24180:head# 2024-04-01T19:36:35.287 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.287 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b15506e:::benchmark_data_smithi188_104537_object79694:head# 2024-04-01T19:36:35.287 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.287 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b158a93:::benchmark_data_smithi188_104537_object121374:head# 2024-04-01T19:36:35.287 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.287 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b15981c:::benchmark_data_smithi188_104537_object42561:head# 2024-04-01T19:36:35.287 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.287 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b15ee55:::benchmark_data_smithi188_104537_object165271:head# 2024-04-01T19:36:35.287 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.287 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b1617ab:::benchmark_data_smithi188_104537_object37575:head# 2024-04-01T19:36:35.288 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.288 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b161db3:::benchmark_data_smithi188_104537_object130894:head# 2024-04-01T19:36:35.288 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.288 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b16d1b8:::benchmark_data_smithi188_104537_object125466:head# 2024-04-01T19:36:35.288 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.288 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b16fcbc:::benchmark_data_smithi188_104537_object92188:head# 2024-04-01T19:36:35.288 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.288 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b173d70:::benchmark_data_smithi188_104537_object43567:head# 2024-04-01T19:36:35.288 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.288 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b17e577:::benchmark_data_smithi188_104537_object162031:head# 2024-04-01T19:36:35.288 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.288 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b1812c5:::benchmark_data_smithi188_104537_object43770:head# 2024-04-01T19:36:35.288 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.288 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b1887de:::benchmark_data_smithi188_104537_object105112:head# 2024-04-01T19:36:35.289 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.289 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b18c70b:::benchmark_data_smithi188_104537_object21522:head# 2024-04-01T19:36:35.289 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.290 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b1a7a8a:::benchmark_data_smithi188_104537_object98096:head# 2024-04-01T19:36:35.290 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.290 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b1abc1b:::benchmark_data_smithi188_104537_object71928:head# 2024-04-01T19:36:35.290 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b1b1bee:::benchmark_data_smithi188_104537_object127791:head# 2024-04-01T19:36:35.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b1b4ee3:::benchmark_data_smithi188_104537_object47710:head# 2024-04-01T19:36:35.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b1b6001:::benchmark_data_smithi188_104537_object84414:head# 2024-04-01T19:36:35.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b1c61be:::benchmark_data_smithi188_104537_object135327:head# 2024-04-01T19:36:35.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b1cae6f:::benchmark_data_smithi188_104537_object155538:head# 2024-04-01T19:36:35.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b1cd1e6:::benchmark_data_smithi188_104537_object114560:head# 2024-04-01T19:36:35.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b1cd9bd:::benchmark_data_smithi188_104537_object169000:head# 2024-04-01T19:36:35.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.292 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b1d59ea:::benchmark_data_smithi188_104537_object72814:head# 2024-04-01T19:36:35.292 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.292 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b1e5948:::benchmark_data_smithi188_104537_object134111:head# 2024-04-01T19:36:35.292 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.292 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b1e5ed8:::benchmark_data_smithi188_104537_object123405:head# 2024-04-01T19:36:35.292 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.292 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b1f8dfd:::benchmark_data_smithi188_104537_object114438:head# 2024-04-01T19:36:35.292 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.293 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b1fc152:::benchmark_data_smithi188_104537_object157261:head# 2024-04-01T19:36:35.293 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.293 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b1fea5f:::benchmark_data_smithi188_104537_object15046:head# 2024-04-01T19:36:35.293 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.293 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b2048fc:::benchmark_data_smithi188_104537_object82436:head# 2024-04-01T19:36:35.293 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.293 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b21060e:::benchmark_data_smithi188_104537_object87783:head# 2024-04-01T19:36:35.294 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.294 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b210829:::benchmark_data_smithi188_104537_object159807:head# 2024-04-01T19:36:35.294 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.294 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b2109b1:::benchmark_data_smithi188_104537_object84035:head# 2024-04-01T19:36:35.294 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.297 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b219874:::benchmark_data_smithi188_104537_object164076:head# 2024-04-01T19:36:35.297 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.297 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b2219b1:::benchmark_data_smithi188_104537_object102610:head# 2024-04-01T19:36:35.297 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.297 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b22d1de:::benchmark_data_smithi188_104537_object33429:head# 2024-04-01T19:36:35.297 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.297 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b230321:::benchmark_data_smithi188_104537_object54227:head# 2024-04-01T19:36:35.297 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.297 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b231b66:::benchmark_data_smithi188_104537_object154188:head# 2024-04-01T19:36:35.297 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.301 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b23bc00:::benchmark_data_smithi188_104537_object43099:head# 2024-04-01T19:36:35.301 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.301 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b23be80:::benchmark_data_smithi188_104537_object78247:head# 2024-04-01T19:36:35.301 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.301 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b2463b4:::benchmark_data_smithi188_104537_object114220:head# 2024-04-01T19:36:35.301 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.301 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b253dcd:::benchmark_data_smithi188_104537_object115108:head# 2024-04-01T19:36:35.301 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.301 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b257f30:::benchmark_data_smithi188_104537_object20631:head# 2024-04-01T19:36:35.301 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.302 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b267dd2:::benchmark_data_smithi188_104537_object48309:head# 2024-04-01T19:36:35.302 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.302 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b26a2c0:::benchmark_data_smithi188_104537_object70010:head# 2024-04-01T19:36:35.302 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.302 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b27416d:::benchmark_data_smithi188_104537_object124013:head# 2024-04-01T19:36:35.302 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.302 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b275506:::benchmark_data_smithi188_104537_object28997:head# 2024-04-01T19:36:35.302 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.302 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b288597:::benchmark_data_smithi188_104537_object51627:head# 2024-04-01T19:36:35.302 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.304 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b28c73f:::benchmark_data_smithi188_104537_object133844:head# 2024-04-01T19:36:35.304 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.304 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b295830:::benchmark_data_smithi188_104537_object142845:head# 2024-04-01T19:36:35.304 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.304 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b2a7511:::benchmark_data_smithi188_104537_object54546:head# 2024-04-01T19:36:35.304 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.304 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b2aa6e2:::benchmark_data_smithi188_104537_object62008:head# 2024-04-01T19:36:35.304 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.304 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b2ab0f2:::benchmark_data_smithi188_104537_object41673:head# 2024-04-01T19:36:35.304 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.304 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b2b6f90:::benchmark_data_smithi188_104537_object139255:head# 2024-04-01T19:36:35.304 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.305 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b2c1590:::benchmark_data_smithi188_104537_object31381:head# 2024-04-01T19:36:35.305 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.305 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b2c2a92:::benchmark_data_smithi188_104537_object13719:head# 2024-04-01T19:36:35.305 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.305 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b2c4965:::benchmark_data_smithi188_104537_object57087:head# 2024-04-01T19:36:35.305 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.305 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b2c816f:::benchmark_data_smithi188_104537_object16493:head# 2024-04-01T19:36:35.305 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.305 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b2caedc:::benchmark_data_smithi188_104537_object99776:head# 2024-04-01T19:36:35.305 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.307 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b2cb8aa:::benchmark_data_smithi188_104537_object51033:head# 2024-04-01T19:36:35.307 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.307 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b2d2e39:::benchmark_data_smithi188_104537_object117646:head# 2024-04-01T19:36:35.307 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.307 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b2d940c:::benchmark_data_smithi188_104537_object142602:head# 2024-04-01T19:36:35.307 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.307 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b2dfab6:::benchmark_data_smithi188_104537_object138321:head# 2024-04-01T19:36:35.307 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.307 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b2f2215:::benchmark_data_smithi188_104537_object30250:head# 2024-04-01T19:36:35.307 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.308 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b2f5394:::benchmark_data_smithi188_104537_object92000:head# 2024-04-01T19:36:35.308 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.308 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b30b4cc:::benchmark_data_smithi188_104537_object133934:head# 2024-04-01T19:36:35.308 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.308 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b30db37:::benchmark_data_smithi188_104537_object40130:head# 2024-04-01T19:36:35.308 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.308 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3111d5:::benchmark_data_smithi188_104537_object88712:head# 2024-04-01T19:36:35.308 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.308 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b31debb:::benchmark_data_smithi188_104537_object60854:head# 2024-04-01T19:36:35.308 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.308 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b32e892:::benchmark_data_smithi188_104537_object40314:head# 2024-04-01T19:36:35.308 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.309 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3305cb:::benchmark_data_smithi188_104537_object147372:head# 2024-04-01T19:36:35.309 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.309 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:36:35.311 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3353cc:::benchmark_data_smithi188_104537_object18750:head# 2024-04-01T19:36:35.311 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.312 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b33d3fa:::benchmark_data_smithi188_104537_object152493:head# 2024-04-01T19:36:35.312 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.312 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b33f7ae:::benchmark_data_smithi188_104537_object58833:head# 2024-04-01T19:36:35.312 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.312 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b34cac0:::benchmark_data_smithi188_104537_object119989:head# 2024-04-01T19:36:35.312 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.312 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3548d9:::benchmark_data_smithi188_104537_object154338:head# 2024-04-01T19:36:35.312 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.312 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b354fab:::benchmark_data_smithi188_104537_object52125:head# 2024-04-01T19:36:35.312 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.312 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b357321:::benchmark_data_smithi188_104537_object12190:head# 2024-04-01T19:36:35.312 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.312 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b357d0a:::benchmark_data_smithi188_104537_object143158:head# 2024-04-01T19:36:35.313 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.315 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3684cb:::benchmark_data_smithi188_104537_object144646:head# 2024-04-01T19:36:35.316 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.316 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b370819:::benchmark_data_smithi188_104537_object35632:head# 2024-04-01T19:36:35.316 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.316 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b371f0a:::benchmark_data_smithi188_104537_object69169:head# 2024-04-01T19:36:35.316 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.316 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b37ecca:::benchmark_data_smithi188_104537_object86665:head# 2024-04-01T19:36:35.316 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.316 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b37fe44:::benchmark_data_smithi188_104537_object93631:head# 2024-04-01T19:36:35.316 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.316 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b387225:::benchmark_data_smithi188_104537_object162317:head# 2024-04-01T19:36:35.316 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.316 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b387da8:::benchmark_data_smithi188_104537_object94210:head# 2024-04-01T19:36:35.316 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.317 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b38d5de:::benchmark_data_smithi188_104537_object95232:head# 2024-04-01T19:36:35.317 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.317 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b397553:::benchmark_data_smithi188_104537_object79774:head# 2024-04-01T19:36:35.317 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.317 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b39819f:::benchmark_data_smithi188_104537_object75518:head# 2024-04-01T19:36:35.317 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.317 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b39ab76:::benchmark_data_smithi188_104537_object119093:head# 2024-04-01T19:36:35.317 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.317 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b39aeeb:::benchmark_data_smithi188_104537_object165541:head# 2024-04-01T19:36:35.317 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.317 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b39ee3d:::benchmark_data_smithi188_104537_object92080:head# 2024-04-01T19:36:35.317 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.317 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3a3f88:::benchmark_data_smithi188_104537_object53526:head# 2024-04-01T19:36:35.317 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.318 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3b0e8f:::benchmark_data_smithi188_104537_object15064:head# 2024-04-01T19:36:35.318 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.319 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3b1539:::benchmark_data_smithi188_104537_object27567:head# 2024-04-01T19:36:35.319 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.319 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3b3bdb:::benchmark_data_smithi188_104537_object13856:head# 2024-04-01T19:36:35.319 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.319 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3b4397:::benchmark_data_smithi188_104537_object81769:head# 2024-04-01T19:36:35.319 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.319 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3b473f:::benchmark_data_smithi188_104537_object66682:head# 2024-04-01T19:36:35.319 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.319 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3b80c9:::benchmark_data_smithi188_104537_object101308:head# 2024-04-01T19:36:35.319 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.319 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3b9f93:::benchmark_data_smithi188_104537_object24251:head# 2024-04-01T19:36:35.320 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.322 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3c6d66:::benchmark_data_smithi188_104537_object74970:head# 2024-04-01T19:36:35.322 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.322 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3c9e3e:::benchmark_data_smithi188_104537_object119834:head# 2024-04-01T19:36:35.322 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.323 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3cbe8c:::benchmark_data_smithi188_104537_object29171:head# 2024-04-01T19:36:35.323 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.323 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3cfa32:::benchmark_data_smithi188_104537_object115781:head# 2024-04-01T19:36:35.323 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.323 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3d77d8:::benchmark_data_smithi188_104537_object140541:head# 2024-04-01T19:36:35.323 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.325 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3dfbbb:::benchmark_data_smithi188_104537_object81884:head# 2024-04-01T19:36:35.325 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.325 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3e4b71:::benchmark_data_smithi188_104537_object16881:head# 2024-04-01T19:36:35.325 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.325 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3ea5e1:::benchmark_data_smithi188_104537_object100256:head# 2024-04-01T19:36:35.325 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.325 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3ea8f0:::benchmark_data_smithi188_104537_object76168:head# 2024-04-01T19:36:35.325 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.325 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3ed9bf:::benchmark_data_smithi188_104537_object111259:head# 2024-04-01T19:36:35.325 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.325 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3f21a3:::benchmark_data_smithi188_104537_object34343:head# 2024-04-01T19:36:35.326 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.326 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3f5230:::benchmark_data_smithi188_104537_object98202:head# 2024-04-01T19:36:35.326 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.327 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3f643b:::benchmark_data_smithi188_104537_object80192:head# 2024-04-01T19:36:35.327 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.327 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b3fb924:::benchmark_data_smithi188_104537_object48534:head# 2024-04-01T19:36:35.327 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.327 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b40530a:::benchmark_data_smithi188_104537_object153303:head# 2024-04-01T19:36:35.327 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.327 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b40904f:::benchmark_data_smithi188_104537_object135308:head# 2024-04-01T19:36:35.327 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.327 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b413ba2:::benchmark_data_smithi188_104537_object59555:head# 2024-04-01T19:36:35.327 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.327 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b418c71:::benchmark_data_smithi188_104537_object167317:head# 2024-04-01T19:36:35.327 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.328 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b41f21d:::benchmark_data_smithi188_104537_object47748:head# 2024-04-01T19:36:35.328 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.328 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b422669:::benchmark_data_smithi188_104537_object170842:head# 2024-04-01T19:36:35.329 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.329 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b422b02:::benchmark_data_smithi188_104537_object76112:head# 2024-04-01T19:36:35.329 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.329 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b427562:::benchmark_data_smithi188_104537_object13998:head# 2024-04-01T19:36:35.329 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.329 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b42a833:::benchmark_data_smithi188_104537_object49352:head# 2024-04-01T19:36:35.329 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.329 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b436457:::benchmark_data_smithi188_104537_object108162:head# 2024-04-01T19:36:35.329 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.329 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b43c0c1:::benchmark_data_smithi188_104537_object165529:head# 2024-04-01T19:36:35.329 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.330 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b43e69c:::benchmark_data_smithi188_104537_object145152:head# 2024-04-01T19:36:35.330 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.335 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b459d99:::benchmark_data_smithi188_104537_object79349:head# 2024-04-01T19:36:35.335 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.335 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b4737fa:::benchmark_data_smithi188_104537_object52568:head# 2024-04-01T19:36:35.335 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.335 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b489d20:::benchmark_data_smithi188_104537_object139591:head# 2024-04-01T19:36:35.335 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.335 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b48f893:::benchmark_data_smithi188_104537_object86018:head# 2024-04-01T19:36:35.335 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.335 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b491751:::benchmark_data_smithi188_104537_object44798:head# 2024-04-01T19:36:35.335 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.335 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b496932:::benchmark_data_smithi188_104537_object38758:head# 2024-04-01T19:36:35.335 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.335 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b496a3c:::benchmark_data_smithi188_104537_object37679:head# 2024-04-01T19:36:35.336 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.336 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b49b663:::benchmark_data_smithi188_104537_object59434:head# 2024-04-01T19:36:35.336 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.336 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b49b699:::benchmark_data_smithi188_104537_object80569:head# 2024-04-01T19:36:35.336 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.336 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b49e9c1:::benchmark_data_smithi188_104537_object111497:head# 2024-04-01T19:36:35.336 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.336 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b4b6cec:::benchmark_data_smithi188_104537_object127240:head# 2024-04-01T19:36:35.336 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.336 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b4bcba0:::benchmark_data_smithi188_104537_object168808:head# 2024-04-01T19:36:35.336 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.336 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b4c1228:::benchmark_data_smithi188_104537_object46065:head# 2024-04-01T19:36:35.336 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.336 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b4defeb:::benchmark_data_smithi188_104537_object13440:head# 2024-04-01T19:36:35.337 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.337 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b4e2ca0:::benchmark_data_smithi188_104537_object56088:head# 2024-04-01T19:36:35.337 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.337 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b4e65cf:::benchmark_data_smithi188_104537_object79134:head# 2024-04-01T19:36:35.337 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.337 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b4ec2ad:::benchmark_data_smithi188_104537_object118610:head# 2024-04-01T19:36:35.337 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.337 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b4f78ce:::benchmark_data_smithi188_104537_object43963:head# 2024-04-01T19:36:35.337 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.337 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b4fb8ac:::benchmark_data_smithi188_104537_object92506:head# 2024-04-01T19:36:35.337 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.337 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b5001ee:::benchmark_data_smithi188_104537_object20035:head# 2024-04-01T19:36:35.337 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.340 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b505ff7:::benchmark_data_smithi188_104537_object90214:head# 2024-04-01T19:36:35.340 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.340 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b50e31a:::benchmark_data_smithi188_104537_object15907:head# 2024-04-01T19:36:35.340 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.340 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b50fbe9:::benchmark_data_smithi188_104537_object98447:head# 2024-04-01T19:36:35.340 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.340 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b5112c1:::benchmark_data_smithi188_104537_object40851:head# 2024-04-01T19:36:35.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b512521:::benchmark_data_smithi188_104537_object39871:head# 2024-04-01T19:36:35.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b5143d3:::benchmark_data_smithi188_104537_object141071:head# 2024-04-01T19:36:35.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b51819b:::benchmark_data_smithi188_104537_object114388:head# 2024-04-01T19:36:35.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b51c901:::benchmark_data_smithi188_104537_object150226:head# 2024-04-01T19:36:35.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b51f0eb:::benchmark_data_smithi188_104537_object50132:head# 2024-04-01T19:36:35.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b5264e7:::benchmark_data_smithi188_104537_object125617:head# 2024-04-01T19:36:35.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b52c08f:::benchmark_data_smithi188_104537_object130438:head# 2024-04-01T19:36:35.342 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.342 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b52dd87:::benchmark_data_smithi188_104537_object144393:head# 2024-04-01T19:36:35.342 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.342 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b54c5d5:::benchmark_data_smithi188_104537_object125616:head# 2024-04-01T19:36:35.342 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.342 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b54f4e1:::benchmark_data_smithi188_104537_object101864:head# 2024-04-01T19:36:35.342 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.342 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b55260f:::benchmark_data_smithi188_104537_object123141:head# 2024-04-01T19:36:35.342 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.342 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b553295:::benchmark_data_smithi188_104537_object66738:head# 2024-04-01T19:36:35.342 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.342 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b55516e:::benchmark_data_smithi188_104537_object120621:head# 2024-04-01T19:36:35.342 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.342 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b561459:::benchmark_data_smithi188_104537_object109735:head# 2024-04-01T19:36:35.343 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.343 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b561fb5:::benchmark_data_smithi188_104537_object106219:head# 2024-04-01T19:36:35.343 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.343 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b57262c:::benchmark_data_smithi188_104537_object169071:head# 2024-04-01T19:36:35.343 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.345 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b57a18d:::benchmark_data_smithi188_104537_object46007:head# 2024-04-01T19:36:35.345 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.345 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b5801e0:::benchmark_data_smithi188_104537_object60228:head# 2024-04-01T19:36:35.345 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.345 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b5803d3:::benchmark_data_smithi188_104537_object110789:head# 2024-04-01T19:36:35.345 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.345 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b58148a:::benchmark_data_smithi188_104537_object55122:head# 2024-04-01T19:36:35.345 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.345 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b58dc77:::benchmark_data_smithi188_104537_object121268:head# 2024-04-01T19:36:35.345 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.345 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b59f1ca:::benchmark_data_smithi188_104537_object114512:head# 2024-04-01T19:36:35.346 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.346 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b5a2789:::benchmark_data_smithi188_104537_object56693:head# 2024-04-01T19:36:35.346 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.346 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b5d2829:::benchmark_data_smithi188_104537_object30772:head# 2024-04-01T19:36:35.346 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.346 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b5d32f2:::benchmark_data_smithi188_104537_object45955:head# 2024-04-01T19:36:35.346 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.346 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b5d76b4:::benchmark_data_smithi188_104537_object155191:head# 2024-04-01T19:36:35.346 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.346 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b5db92e:::benchmark_data_smithi188_104537_object160101:head# 2024-04-01T19:36:35.346 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.346 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b5edb0b:::benchmark_data_smithi188_104537_object148045:head# 2024-04-01T19:36:35.346 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.347 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b5f7fea:::benchmark_data_smithi188_104537_object76180:head# 2024-04-01T19:36:35.347 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.347 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b5fd60d:::benchmark_data_smithi188_104537_object163290:head# 2024-04-01T19:36:35.347 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.347 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b5fe199:::benchmark_data_smithi188_104537_object29548:head# 2024-04-01T19:36:35.347 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.347 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b6012e0:::benchmark_data_smithi188_104537_object141292:head# 2024-04-01T19:36:35.347 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.347 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b607411:::benchmark_data_smithi188_104537_object76137:head# 2024-04-01T19:36:35.347 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.348 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b6087aa:::benchmark_data_smithi188_104537_object65554:head# 2024-04-01T19:36:35.348 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.348 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b60a551:::benchmark_data_smithi188_104537_object100251:head# 2024-04-01T19:36:35.348 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.349 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b6179ad:::benchmark_data_smithi188_104537_object165708:head# 2024-04-01T19:36:35.349 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.349 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b61c450:::benchmark_data_smithi188_104537_object154230:head# 2024-04-01T19:36:35.349 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.349 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b62ab84:::benchmark_data_smithi188_104537_object29980:head# 2024-04-01T19:36:35.349 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.349 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b63a189:::benchmark_data_smithi188_104537_object27905:head# 2024-04-01T19:36:35.349 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.350 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b63f7e0:::benchmark_data_smithi188_104537_object131564:head# 2024-04-01T19:36:35.350 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.351 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b640023:::benchmark_data_smithi188_104537_object110239:head# 2024-04-01T19:36:35.351 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.351 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b6453b8:::benchmark_data_smithi188_104537_object123319:head# 2024-04-01T19:36:35.351 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.351 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b65988e:::benchmark_data_smithi188_104537_object36996:head# 2024-04-01T19:36:35.351 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.351 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b685319:::benchmark_data_smithi188_104537_object28091:head# 2024-04-01T19:36:35.351 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.351 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b68b588:::benchmark_data_smithi188_104537_object167916:head# 2024-04-01T19:36:35.351 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.352 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b68f6ae:::benchmark_data_smithi188_104537_object133782:head# 2024-04-01T19:36:35.352 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.353 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b697bd2:::benchmark_data_smithi188_104537_object103260:head# 2024-04-01T19:36:35.353 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.353 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b6984f7:::benchmark_data_smithi188_104537_object24584:head# 2024-04-01T19:36:35.353 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.354 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b69bf8b:::benchmark_data_smithi188_104537_object106890:head# 2024-04-01T19:36:35.354 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.354 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b69c8ef:::benchmark_data_smithi188_104537_object158669:head# 2024-04-01T19:36:35.354 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.354 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b6a2d69:::benchmark_data_smithi188_104537_object42755:head# 2024-04-01T19:36:35.354 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.355 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:35.356 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b6c0790:::benchmark_data_smithi188_104537_object147130:head# 2024-04-01T19:36:35.356 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.356 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b6c87ff:::benchmark_data_smithi188_104537_object149835:head# 2024-04-01T19:36:35.356 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.356 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b6d21d3:::benchmark_data_smithi188_104537_object127215:head# 2024-04-01T19:36:35.356 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.356 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b6d3e95:::benchmark_data_smithi188_104537_object77511:head# 2024-04-01T19:36:35.356 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.356 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b6d74f5:::benchmark_data_smithi188_104537_object37492:head# 2024-04-01T19:36:35.356 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.356 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b6d870c:::benchmark_data_smithi188_104537_object38211:head# 2024-04-01T19:36:35.356 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.357 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b6dc901:::benchmark_data_smithi188_104537_object43440:head# 2024-04-01T19:36:35.357 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.359 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b6de50c:::benchmark_data_smithi188_104537_object164876:head# 2024-04-01T19:36:35.359 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.359 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b6df486:::benchmark_data_smithi188_104537_object70246:head# 2024-04-01T19:36:35.359 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.359 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b6e7757:::benchmark_data_smithi188_104537_object12006:head# 2024-04-01T19:36:35.361 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.361 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b6e893b:::benchmark_data_smithi188_104537_object66243:head# 2024-04-01T19:36:35.361 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.361 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b6ec570:::benchmark_data_smithi188_104537_object113901:head# 2024-04-01T19:36:35.361 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.361 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b6f5e20:::benchmark_data_smithi188_104537_object120952:head# 2024-04-01T19:36:35.361 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.361 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b705509:::benchmark_data_smithi188_104537_object22850:head# 2024-04-01T19:36:35.361 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.362 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b70a2ba:::benchmark_data_smithi188_104537_object164037:head# 2024-04-01T19:36:35.362 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.362 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b70d802:::benchmark_data_smithi188_104537_object111438:head# 2024-04-01T19:36:35.362 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.362 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b70e46c:::benchmark_data_smithi188_104537_object88624:head# 2024-04-01T19:36:35.362 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.362 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b7139ea:::benchmark_data_smithi188_104537_object15600:head# 2024-04-01T19:36:35.362 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.362 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b7166f0:::benchmark_data_smithi188_104537_object38396:head# 2024-04-01T19:36:35.362 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.362 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b71b7c7:::benchmark_data_smithi188_104537_object37907:head# 2024-04-01T19:36:35.362 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.362 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b72a07e:::benchmark_data_smithi188_104537_object63836:head# 2024-04-01T19:36:35.363 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.368 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b7314a0:::benchmark_data_smithi188_104537_object48238:head# 2024-04-01T19:36:35.368 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.369 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b732949:::benchmark_data_smithi188_104537_object43601:head# 2024-04-01T19:36:35.369 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.369 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b73f3ff:::benchmark_data_smithi188_104537_object53804:head# 2024-04-01T19:36:35.369 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.369 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b745aa6:::benchmark_data_smithi188_104537_object159852:head# 2024-04-01T19:36:35.369 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.369 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b7491dc:::benchmark_data_smithi188_104537_object138432:head# 2024-04-01T19:36:35.369 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.369 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b74dc45:::benchmark_data_smithi188_104537_object69408:head# 2024-04-01T19:36:35.369 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.369 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b75453a:::benchmark_data_smithi188_104537_object33441:head# 2024-04-01T19:36:35.369 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.369 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b755064:::benchmark_data_smithi188_104537_object94021:head# 2024-04-01T19:36:35.370 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.370 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b758f9a:::benchmark_data_smithi188_104537_object131878:head# 2024-04-01T19:36:35.370 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.370 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b75aa46:::benchmark_data_smithi188_104537_object83438:head# 2024-04-01T19:36:35.370 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.370 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b766ce8:::benchmark_data_smithi188_104537_object127475:head# 2024-04-01T19:36:35.370 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.370 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b7740e9:::benchmark_data_smithi188_104537_object12178:head# 2024-04-01T19:36:35.370 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.370 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b774ad3:::benchmark_data_smithi188_104537_object69086:head# 2024-04-01T19:36:35.370 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.370 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b77c3b8:::benchmark_data_smithi188_104537_object47899:head# 2024-04-01T19:36:35.370 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.371 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b78446d:::benchmark_data_smithi188_104537_object83823:head# 2024-04-01T19:36:35.371 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.371 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b78a09e:::benchmark_data_smithi188_104537_object130735:head# 2024-04-01T19:36:35.371 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.371 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b795c37:::benchmark_data_smithi188_104537_object34564:head# 2024-04-01T19:36:35.371 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.371 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b7aa697:::benchmark_data_smithi188_104537_object20541:head# 2024-04-01T19:36:35.371 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.371 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b7aaf8a:::benchmark_data_smithi188_104537_object148065:head# 2024-04-01T19:36:35.371 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.371 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b7af96c:::benchmark_data_smithi188_104537_object62739:head# 2024-04-01T19:36:35.371 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.371 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b7b427b:::benchmark_data_smithi188_104537_object116630:head# 2024-04-01T19:36:35.371 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.372 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b7b8f65:::benchmark_data_smithi188_104537_object145072:head# 2024-04-01T19:36:35.372 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.372 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b7b947e:::benchmark_data_smithi188_104537_object159072:head# 2024-04-01T19:36:35.372 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.372 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b7bb63e:::benchmark_data_smithi188_104537_object77676:head# 2024-04-01T19:36:35.372 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.372 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b7c077c:::benchmark_data_smithi188_104537_object52465:head# 2024-04-01T19:36:35.372 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.372 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b7e1fd4:::benchmark_data_smithi188_104537_object44743:head# 2024-04-01T19:36:35.372 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.372 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b7f1123:::benchmark_data_smithi188_104537_object58122:head# 2024-04-01T19:36:35.372 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.372 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b7f3966:::benchmark_data_smithi188_104537_object69608:head# 2024-04-01T19:36:35.373 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.373 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b7f5ca3:::benchmark_data_smithi188_104537_object96013:head# 2024-04-01T19:36:35.373 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.373 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b7f71eb:::benchmark_data_smithi188_104537_object135870:head# 2024-04-01T19:36:35.373 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.373 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b7f9590:::benchmark_data_smithi188_104537_object81411:head# 2024-04-01T19:36:35.373 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.373 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b7fd8a9:::benchmark_data_smithi188_104537_object143190:head# 2024-04-01T19:36:35.373 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.373 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b8103a7:::benchmark_data_smithi188_104537_object18050:head# 2024-04-01T19:36:35.373 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.373 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b81cb6b:::benchmark_data_smithi188_104537_object71071:head# 2024-04-01T19:36:35.374 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.381 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b820a5f:::benchmark_data_smithi188_104537_object157981:head# 2024-04-01T19:36:35.381 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.381 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b823bc1:::benchmark_data_smithi188_104537_object158856:head# 2024-04-01T19:36:35.381 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.381 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b823f28:::benchmark_data_smithi188_104537_object35440:head# 2024-04-01T19:36:35.381 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.381 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b8248ce:::benchmark_data_smithi188_104537_object87666:head# 2024-04-01T19:36:35.381 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.381 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b828f8e:::benchmark_data_smithi188_104537_object43349:head# 2024-04-01T19:36:35.381 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.381 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b840572:::benchmark_data_smithi188_104537_object87489:head# 2024-04-01T19:36:35.381 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.381 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b849039:::benchmark_data_smithi188_104537_object119660:head# 2024-04-01T19:36:35.382 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.382 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b84fd59:::benchmark_data_smithi188_104537_object14149:head# 2024-04-01T19:36:35.382 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.382 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b864f0d:::benchmark_data_smithi188_104537_object51505:head# 2024-04-01T19:36:35.382 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.382 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b865a21:::benchmark_data_smithi188_104537_object88057:head# 2024-04-01T19:36:35.382 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.382 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b86a8f4:::benchmark_data_smithi188_104537_object169396:head# 2024-04-01T19:36:35.382 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.382 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b86d2d1:::benchmark_data_smithi188_104537_object27482:head# 2024-04-01T19:36:35.382 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.382 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b874167:::benchmark_data_smithi188_104537_object113526:head# 2024-04-01T19:36:35.383 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.383 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b87b6f7:::benchmark_data_smithi188_104537_object142466:head# 2024-04-01T19:36:35.383 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.383 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b888c1b:::benchmark_data_smithi188_104537_object17673:head# 2024-04-01T19:36:35.383 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.383 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b88aff6:::benchmark_data_smithi188_104537_object143535:head# 2024-04-01T19:36:35.383 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.383 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b89897f:::benchmark_data_smithi188_104537_object42737:head# 2024-04-01T19:36:35.383 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.383 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b89e0b1:::benchmark_data_smithi188_104537_object78052:head# 2024-04-01T19:36:35.383 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.383 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b8a1c56:::benchmark_data_smithi188_104537_object81207:head# 2024-04-01T19:36:35.383 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.384 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b8a2234:::benchmark_data_smithi188_104537_object42472:head# 2024-04-01T19:36:35.384 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.384 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b8a2d47:::benchmark_data_smithi188_104537_object139960:head# 2024-04-01T19:36:35.384 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.384 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b8a31f0:::benchmark_data_smithi188_104537_object80135:head# 2024-04-01T19:36:35.384 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.384 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b8a630b:::benchmark_data_smithi188_104537_object120212:head# 2024-04-01T19:36:35.384 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.384 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b8a8f6b:::benchmark_data_smithi188_104537_object22349:head# 2024-04-01T19:36:35.384 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.384 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b8af40f:::benchmark_data_smithi188_104537_object152202:head# 2024-04-01T19:36:35.384 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.384 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b8bb7fd:::benchmark_data_smithi188_104537_object28898:head# 2024-04-01T19:36:35.384 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.385 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b8bddd4:::benchmark_data_smithi188_104537_object169326:head# 2024-04-01T19:36:35.385 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.385 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b8c92c0:::benchmark_data_smithi188_104537_object21872:head# 2024-04-01T19:36:35.385 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.385 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b8d4e3d:::benchmark_data_smithi188_104537_object23555:head# 2024-04-01T19:36:35.385 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.385 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b8f05d7:::benchmark_data_smithi188_104537_object115139:head# 2024-04-01T19:36:35.385 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.385 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b8fb548:::benchmark_data_smithi188_104537_object145289:head# 2024-04-01T19:36:35.385 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.385 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b9010f0:::benchmark_data_smithi188_104537_object100499:head# 2024-04-01T19:36:35.385 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.385 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b9036e6:::benchmark_data_smithi188_104537_object57681:head# 2024-04-01T19:36:35.385 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.386 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b90a53d:::benchmark_data_smithi188_104537_object151644:head# 2024-04-01T19:36:35.386 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.386 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b90d089:::benchmark_data_smithi188_104537_object156695:head# 2024-04-01T19:36:35.386 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.386 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b90e932:::benchmark_data_smithi188_104537_object135496:head# 2024-04-01T19:36:35.386 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.386 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b91c286:::benchmark_data_smithi188_104537_object35411:head# 2024-04-01T19:36:35.386 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.386 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b91d7fa:::benchmark_data_smithi188_104537_object44211:head# 2024-04-01T19:36:35.386 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.386 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b91d9aa:::benchmark_data_smithi188_104537_object168983:head# 2024-04-01T19:36:35.386 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.386 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b92063a:::benchmark_data_smithi188_104537_object77763:head# 2024-04-01T19:36:35.387 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.387 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b938ef5:::benchmark_data_smithi188_104537_object111218:head# 2024-04-01T19:36:35.387 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.387 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b93cc0b:::benchmark_data_smithi188_104537_object74005:head# 2024-04-01T19:36:35.387 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.387 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b93fc67:::benchmark_data_smithi188_104537_object129959:head# 2024-04-01T19:36:35.387 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.387 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b942635:::benchmark_data_smithi188_104537_object112872:head# 2024-04-01T19:36:35.387 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.387 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b945adb:::benchmark_data_smithi188_104537_object34610:head# 2024-04-01T19:36:35.387 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.387 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b948f45:::benchmark_data_smithi188_104537_object104633:head# 2024-04-01T19:36:35.387 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.387 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b94f0bf:::benchmark_data_smithi188_104537_object16553:head# 2024-04-01T19:36:35.387 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.388 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b95095f:::benchmark_data_smithi188_104537_object159343:head# 2024-04-01T19:36:35.388 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.388 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b954003:::benchmark_data_smithi188_104537_object150380:head# 2024-04-01T19:36:35.388 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.388 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b95cc62:::benchmark_data_smithi188_104537_object71299:head# 2024-04-01T19:36:35.388 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.395 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b95d0d1:::benchmark_data_smithi188_104537_object68434:head# 2024-04-01T19:36:35.395 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.395 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b96da88:::benchmark_data_smithi188_104537_object165493:head# 2024-04-01T19:36:35.395 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.395 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b96f91a:::benchmark_data_smithi188_104537_object81335:head# 2024-04-01T19:36:35.395 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.395 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b970c08:::benchmark_data_smithi188_104537_object51890:head# 2024-04-01T19:36:35.395 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.395 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b97d537:::benchmark_data_smithi188_104537_object17076:head# 2024-04-01T19:36:35.395 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.395 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b9864c1:::benchmark_data_smithi188_104537_object146234:head# 2024-04-01T19:36:35.396 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.396 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b98677f:::benchmark_data_smithi188_104537_object56153:head# 2024-04-01T19:36:35.396 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.396 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b98956f:::benchmark_data_smithi188_104537_object156505:head# 2024-04-01T19:36:35.396 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.396 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b9a237b:::benchmark_data_smithi188_104537_object123105:head# 2024-04-01T19:36:35.396 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.396 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b9b92ac:::benchmark_data_smithi188_104537_object149030:head# 2024-04-01T19:36:35.396 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.396 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b9bb094:::benchmark_data_smithi188_104537_object93730:head# 2024-04-01T19:36:35.396 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.396 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b9bb751:::benchmark_data_smithi188_104537_object93623:head# 2024-04-01T19:36:35.396 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.396 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b9be971:::benchmark_data_smithi188_104537_object18249:head# 2024-04-01T19:36:35.397 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.397 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b9c0c19:::benchmark_data_smithi188_104537_object59276:head# 2024-04-01T19:36:35.397 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.397 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b9c1a4b:::benchmark_data_smithi188_104537_object167894:head# 2024-04-01T19:36:35.397 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.397 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b9c76fe:::benchmark_data_smithi188_104537_object31594:head# 2024-04-01T19:36:35.397 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.397 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b9d51a6:::benchmark_data_smithi188_104537_object55913:head# 2024-04-01T19:36:35.397 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.397 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b9d79c1:::benchmark_data_smithi188_104537_object167844:head# 2024-04-01T19:36:35.397 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.397 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b9db20d:::benchmark_data_smithi188_104537_object127830:head# 2024-04-01T19:36:35.397 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.398 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b9ee03f:::benchmark_data_smithi188_104537_object94206:head# 2024-04-01T19:36:35.398 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.398 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b9eed08:::benchmark_data_smithi188_104537_object110391:head# 2024-04-01T19:36:35.398 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.398 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b9f3e0c:::benchmark_data_smithi188_104537_object56841:head# 2024-04-01T19:36:35.398 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.398 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5b9f5ac2:::benchmark_data_smithi188_104537_object11502:head# 2024-04-01T19:36:35.398 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.398 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba064cb:::benchmark_data_smithi188_104537_object168548:head# 2024-04-01T19:36:35.398 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.398 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba0ebc0:::benchmark_data_smithi188_104537_object52617:head# 2024-04-01T19:36:35.398 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.398 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba14876:::benchmark_data_smithi188_104537_object63653:head# 2024-04-01T19:36:35.399 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.399 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba18c1f:::benchmark_data_smithi188_104537_object23009:head# 2024-04-01T19:36:35.399 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.399 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba22316:::benchmark_data_smithi188_104537_object115682:head# 2024-04-01T19:36:35.399 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.399 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba2a16d:::benchmark_data_smithi188_104537_object108962:head# 2024-04-01T19:36:35.399 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.399 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba2ef9e:::benchmark_data_smithi188_104537_object48106:head# 2024-04-01T19:36:35.399 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.399 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba2f02f:::benchmark_data_smithi188_104537_object27748:head# 2024-04-01T19:36:35.399 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.399 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba3048d:::benchmark_data_smithi188_104537_object114810:head# 2024-04-01T19:36:35.399 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.399 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba33528:::benchmark_data_smithi188_104537_object26460:head# 2024-04-01T19:36:35.400 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.400 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba3e86b:::benchmark_data_smithi188_104537_object34608:head# 2024-04-01T19:36:35.400 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.400 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba4624d:::benchmark_data_smithi188_104537_object26388:head# 2024-04-01T19:36:35.400 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.400 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba492da:::benchmark_data_smithi188_104537_object18487:head# 2024-04-01T19:36:35.400 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.400 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba4a54b:::benchmark_data_smithi188_104537_object124120:head# 2024-04-01T19:36:35.400 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.400 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba55fd1:::benchmark_data_smithi188_104537_object142013:head# 2024-04-01T19:36:35.400 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.400 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba719a0:::benchmark_data_smithi188_104537_object47079:head# 2024-04-01T19:36:35.400 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.400 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba7680d:::benchmark_data_smithi188_104537_object44942:head# 2024-04-01T19:36:35.401 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.401 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba787e2:::benchmark_data_smithi188_104537_object134047:head# 2024-04-01T19:36:35.401 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.401 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba790f7:::benchmark_data_smithi188_104537_object33788:head# 2024-04-01T19:36:35.401 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.401 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba7a9fb:::benchmark_data_smithi188_104537_object16886:head# 2024-04-01T19:36:35.401 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.401 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba7f5fc:::benchmark_data_smithi188_104537_object45840:head# 2024-04-01T19:36:35.401 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.401 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba7f6be:::benchmark_data_smithi188_104537_object149066:head# 2024-04-01T19:36:35.401 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.401 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba84269:::benchmark_data_smithi188_104537_object164148:head# 2024-04-01T19:36:35.401 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.401 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba86ba0:::benchmark_data_smithi188_104537_object170756:head# 2024-04-01T19:36:35.401 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.402 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba94a6e:::benchmark_data_smithi188_104537_object81564:head# 2024-04-01T19:36:35.402 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.402 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ba97f89:::benchmark_data_smithi188_104537_object141378:head# 2024-04-01T19:36:35.402 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.402 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5baa1570:::benchmark_data_smithi188_104537_object170869:head# 2024-04-01T19:36:35.402 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.402 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5baa4b7d:::benchmark_data_smithi188_104537_object119052:head# 2024-04-01T19:36:35.402 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.402 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5baaad42:::benchmark_data_smithi188_104537_object97327:head# 2024-04-01T19:36:35.402 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.402 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5baaaea9:::benchmark_data_smithi188_104537_object161275:head# 2024-04-01T19:36:35.402 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.402 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bab1c08:::benchmark_data_smithi188_104537_object69821:head# 2024-04-01T19:36:35.402 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.403 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bab6b98:::benchmark_data_smithi188_104537_object87008:head# 2024-04-01T19:36:35.403 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.403 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bab8bca:::benchmark_data_smithi188_104537_object89520:head# 2024-04-01T19:36:35.403 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.403 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5babefdd:::benchmark_data_smithi188_104537_object65309:head# 2024-04-01T19:36:35.403 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.403 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5babf908:::benchmark_data_smithi188_104537_object169169:head# 2024-04-01T19:36:35.403 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.411 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bac4a68:::benchmark_data_smithi188_104537_object162151:head# 2024-04-01T19:36:35.411 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.411 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bac9963:::benchmark_data_smithi188_104537_object76819:head# 2024-04-01T19:36:35.411 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.411 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bad15eb:::benchmark_data_smithi188_104537_object74832:head# 2024-04-01T19:36:35.412 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.412 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bad9a8a:::benchmark_data_smithi188_104537_object101582:head# 2024-04-01T19:36:35.412 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.412 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bae2219:::benchmark_data_smithi188_104537_object56599:head# 2024-04-01T19:36:35.412 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.412 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5baec5a6:::benchmark_data_smithi188_104537_object164077:head# 2024-04-01T19:36:35.412 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.412 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5baeeecb:::benchmark_data_smithi188_104537_object76439:head# 2024-04-01T19:36:35.412 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.412 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5baf2b11:::benchmark_data_smithi188_104537_object146144:head# 2024-04-01T19:36:35.412 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.412 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5baf3b34:::benchmark_data_smithi188_104537_object20429:head# 2024-04-01T19:36:35.412 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.413 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb0201f:::benchmark_data_smithi188_104537_object24612:head# 2024-04-01T19:36:35.413 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.413 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb0f0e7:::benchmark_data_smithi188_104537_object89833:head# 2024-04-01T19:36:35.413 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.413 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb115e0:::benchmark_data_smithi188_104537_object42759:head# 2024-04-01T19:36:35.413 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.413 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb14cff:::benchmark_data_smithi188_104537_object161655:head# 2024-04-01T19:36:35.413 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.413 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb172ae:::benchmark_data_smithi188_104537_object149963:head# 2024-04-01T19:36:35.413 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.413 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb1806d:::benchmark_data_smithi188_104537_object130022:head# 2024-04-01T19:36:35.413 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.413 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb1fe3a:::benchmark_data_smithi188_104537_object91485:head# 2024-04-01T19:36:35.414 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.414 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb22477:::benchmark_data_smithi188_104537_object118045:head# 2024-04-01T19:36:35.414 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.414 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb3899a:::benchmark_data_smithi188_104537_object56665:head# 2024-04-01T19:36:35.414 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.414 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb3a044:::benchmark_data_smithi188_104537_object163971:head# 2024-04-01T19:36:35.414 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.414 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb40efc:::benchmark_data_smithi188_104537_object41662:head# 2024-04-01T19:36:35.414 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.414 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb45b77:::benchmark_data_smithi188_104537_object49362:head# 2024-04-01T19:36:35.414 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.414 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb4a2ca:::benchmark_data_smithi188_104537_object44751:head# 2024-04-01T19:36:35.414 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.415 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb4bb6c:::benchmark_data_smithi188_104537_object168827:head# 2024-04-01T19:36:35.415 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.415 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb570a5:::benchmark_data_smithi188_104537_object18460:head# 2024-04-01T19:36:35.415 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.415 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb604ca:::benchmark_data_smithi188_104537_object118198:head# 2024-04-01T19:36:35.415 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.415 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb69880:::benchmark_data_smithi188_104537_object101866:head# 2024-04-01T19:36:35.415 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.415 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb6eaa1:::benchmark_data_smithi188_104537_object154625:head# 2024-04-01T19:36:35.415 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.415 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb71126:::benchmark_data_smithi188_104537_object166923:head# 2024-04-01T19:36:35.415 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.415 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb768bd:::benchmark_data_smithi188_104537_object136176:head# 2024-04-01T19:36:35.416 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.416 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb78baa:::benchmark_data_smithi188_104537_object37435:head# 2024-04-01T19:36:35.416 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.416 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb858fc:::benchmark_data_smithi188_104537_object72445:head# 2024-04-01T19:36:35.416 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.416 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb8732c:::benchmark_data_smithi188_104537_object114374:head# 2024-04-01T19:36:35.416 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.416 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb88786:::benchmark_data_smithi188_104537_object143299:head# 2024-04-01T19:36:35.416 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.416 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb88987:::benchmark_data_smithi188_104537_object75998:head# 2024-04-01T19:36:35.416 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.416 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bb8d641:::benchmark_data_smithi188_104537_object147829:head# 2024-04-01T19:36:35.416 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.416 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bba6691:::benchmark_data_smithi188_104537_object29363:head# 2024-04-01T19:36:35.417 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.417 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bba6e97:::benchmark_data_smithi188_104537_object30712:head# 2024-04-01T19:36:35.417 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.417 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bba9e3b:::benchmark_data_smithi188_104537_object129628:head# 2024-04-01T19:36:35.417 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.417 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bbb24a2:::benchmark_data_smithi188_104537_object16801:head# 2024-04-01T19:36:35.417 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.417 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bbb46f8:::benchmark_data_smithi188_104537_object63407:head# 2024-04-01T19:36:35.417 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.417 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bbcf779:::benchmark_data_smithi188_104537_object160496:head# 2024-04-01T19:36:35.417 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.417 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bbcfeb6:::benchmark_data_smithi188_104537_object116666:head# 2024-04-01T19:36:35.417 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.417 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bbd1ec9:::benchmark_data_smithi188_104537_object153625:head# 2024-04-01T19:36:35.418 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.418 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bbd43e1:::benchmark_data_smithi188_104537_object28321:head# 2024-04-01T19:36:35.418 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.418 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bbde1e7:::benchmark_data_smithi188_104537_object85923:head# 2024-04-01T19:36:35.418 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.418 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bbe203c:::benchmark_data_smithi188_104537_object164048:head# 2024-04-01T19:36:35.418 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.418 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bbf2a7d:::benchmark_data_smithi188_104537_object50554:head# 2024-04-01T19:36:35.418 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.418 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bc06fcd:::benchmark_data_smithi188_104537_object101649:head# 2024-04-01T19:36:35.418 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.418 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bc09710:::benchmark_data_smithi188_104537_object107681:head# 2024-04-01T19:36:35.418 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.418 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bc0b02c:::benchmark_data_smithi188_104537_object22807:head# 2024-04-01T19:36:35.419 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.419 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bc0d64e:::benchmark_data_smithi188_104537_object112549:head# 2024-04-01T19:36:35.419 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.419 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bc16d3b:::benchmark_data_smithi188_104537_object104321:head# 2024-04-01T19:36:35.419 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.419 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bc1bd3b:::benchmark_data_smithi188_104537_object163579:head# 2024-04-01T19:36:35.419 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.419 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bc1f35e:::benchmark_data_smithi188_104537_object93465:head# 2024-04-01T19:36:35.419 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.419 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bc25c51:::benchmark_data_smithi188_104537_object154706:head# 2024-04-01T19:36:35.419 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.419 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bc317de:::benchmark_data_smithi188_104537_object105298:head# 2024-04-01T19:36:35.419 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.419 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bc323e9:::benchmark_data_smithi188_104537_object44468:head# 2024-04-01T19:36:35.420 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.420 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bc35c9a:::benchmark_data_smithi188_104537_object126900:head# 2024-04-01T19:36:35.420 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.420 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bc37a7d:::benchmark_data_smithi188_104537_object44523:head# 2024-04-01T19:36:35.420 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.420 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bc48b0d:::benchmark_data_smithi188_104537_object75322:head# 2024-04-01T19:36:35.420 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.420 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bc4a3a0:::benchmark_data_smithi188_104537_object97353:head# 2024-04-01T19:36:35.420 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.420 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bc65fd4:::benchmark_data_smithi188_104537_object159736:head# 2024-04-01T19:36:35.420 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.420 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bc77fc5:::benchmark_data_smithi188_104537_object131393:head# 2024-04-01T19:36:35.420 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.420 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bc7855f:::benchmark_data_smithi188_104537_object98033:head# 2024-04-01T19:36:35.420 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.421 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bc79c49:::benchmark_data_smithi188_104537_object111544:head# 2024-04-01T19:36:35.421 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.421 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bc81f33:::benchmark_data_smithi188_104537_object63401:head# 2024-04-01T19:36:35.421 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.421 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bc821a8:::benchmark_data_smithi188_104537_object97256:head# 2024-04-01T19:36:35.421 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.421 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bc8edae:::benchmark_data_smithi188_104537_object78679:head# 2024-04-01T19:36:35.421 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.421 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bc9629f:::benchmark_data_smithi188_104537_object154749:head# 2024-04-01T19:36:35.421 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.428 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bc9ac55:::benchmark_data_smithi188_104537_object89886:head# 2024-04-01T19:36:35.428 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.429 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bc9c4b8:::benchmark_data_smithi188_104537_object154455:head# 2024-04-01T19:36:35.429 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.429 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bca66e0:::benchmark_data_smithi188_104537_object136955:head# 2024-04-01T19:36:35.429 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.429 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bcaa0a1:::benchmark_data_smithi188_104537_object98059:head# 2024-04-01T19:36:35.429 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.429 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bcaaedd:::benchmark_data_smithi188_104537_object101522:head# 2024-04-01T19:36:35.429 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.429 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bcab813:::benchmark_data_smithi188_104537_object97488:head# 2024-04-01T19:36:35.429 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.429 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bcbe46e:::benchmark_data_smithi188_104537_object143203:head# 2024-04-01T19:36:35.429 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.430 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bcc7202:::benchmark_data_smithi188_104537_object121464:head# 2024-04-01T19:36:35.430 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.430 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bcd1e7f:::benchmark_data_smithi188_104537_object110788:head# 2024-04-01T19:36:35.430 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.430 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bcd5aac:::benchmark_data_smithi188_104537_object80200:head# 2024-04-01T19:36:35.430 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.430 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bcd91ee:::benchmark_data_smithi188_104537_object104065:head# 2024-04-01T19:36:35.430 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.430 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bcdce97:::benchmark_data_smithi188_104537_object66548:head# 2024-04-01T19:36:35.430 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.430 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bcde3fe:::benchmark_data_smithi188_104537_object48824:head# 2024-04-01T19:36:35.430 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.430 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bce1edc:::benchmark_data_smithi188_104537_object151935:head# 2024-04-01T19:36:35.431 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.431 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bced3d0:::benchmark_data_smithi188_104537_object87022:head# 2024-04-01T19:36:35.431 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.431 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bcfeef9:::benchmark_data_smithi188_104537_object156288:head# 2024-04-01T19:36:35.431 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.431 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bd0168d:::benchmark_data_smithi188_104537_object144390:head# 2024-04-01T19:36:35.431 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.431 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bd079ca:::benchmark_data_smithi188_104537_object84676:head# 2024-04-01T19:36:35.431 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.431 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bd0a938:::benchmark_data_smithi188_104537_object32693:head# 2024-04-01T19:36:35.431 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.431 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bd0e155:::benchmark_data_smithi188_104537_object78916:head# 2024-04-01T19:36:35.431 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.432 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bd193f7:::benchmark_data_smithi188_104537_object154450:head# 2024-04-01T19:36:35.432 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.432 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bd2f3d7:::benchmark_data_smithi188_104537_object126475:head# 2024-04-01T19:36:35.432 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.432 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bd3d095:::benchmark_data_smithi188_104537_object95481:head# 2024-04-01T19:36:35.432 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.432 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bd4357a:::benchmark_data_smithi188_104537_object77672:head# 2024-04-01T19:36:35.432 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.432 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bd4de54:::benchmark_data_smithi188_104537_object128679:head# 2024-04-01T19:36:35.432 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.432 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bd53eb0:::benchmark_data_smithi188_104537_object22381:head# 2024-04-01T19:36:35.432 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.432 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bd574b1:::benchmark_data_smithi188_104537_object135077:head# 2024-04-01T19:36:35.432 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.432 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bd577db:::benchmark_data_smithi188_104537_object91307:head# 2024-04-01T19:36:35.433 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.433 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bd593a1:::benchmark_data_smithi188_104537_object158757:head# 2024-04-01T19:36:35.433 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.433 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bd5eb27:::benchmark_data_smithi188_104537_object61724:head# 2024-04-01T19:36:35.433 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.433 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bd68774:::benchmark_data_smithi188_104537_object106359:head# 2024-04-01T19:36:35.433 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.433 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bd78bb9:::benchmark_data_smithi188_104537_object59470:head# 2024-04-01T19:36:35.433 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.433 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bd796f3:::benchmark_data_smithi188_104537_object26205:head# 2024-04-01T19:36:35.433 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.433 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bd7c0ba:::benchmark_data_smithi188_104537_object156114:head# 2024-04-01T19:36:35.433 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.433 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bd813f2:::benchmark_data_smithi188_104537_object58072:head# 2024-04-01T19:36:35.434 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.434 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bd8b288:::benchmark_data_smithi188_104537_object96766:head# 2024-04-01T19:36:35.434 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.434 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bd9ca6a:::benchmark_data_smithi188_104537_object92845:head# 2024-04-01T19:36:35.434 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.434 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bd9da1e:::benchmark_data_smithi188_104537_object58076:head# 2024-04-01T19:36:35.434 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.434 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bd9ee5b:::benchmark_data_smithi188_104537_object37307:head# 2024-04-01T19:36:35.434 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.434 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bda0a79:::benchmark_data_smithi188_104537_object135806:head# 2024-04-01T19:36:35.434 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.435 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bda1017:::benchmark_data_smithi188_104537_object144400:head# 2024-04-01T19:36:35.435 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.435 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bdaec43:::benchmark_data_smithi188_104537_object86915:head# 2024-04-01T19:36:35.435 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.435 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bdb3116:::benchmark_data_smithi188_104537_object151314:head# 2024-04-01T19:36:35.435 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.435 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bdb7f07:::benchmark_data_smithi188_104537_object37284:head# 2024-04-01T19:36:35.435 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.435 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bdc65ca:::benchmark_data_smithi188_104537_object16559:head# 2024-04-01T19:36:35.435 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.435 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bdcb5d6:::benchmark_data_smithi188_104537_object43356:head# 2024-04-01T19:36:35.435 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.435 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bdcc3cc:::benchmark_data_smithi188_104537_object106740:head# 2024-04-01T19:36:35.435 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.435 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bdd9107:::benchmark_data_smithi188_104537_object85986:head# 2024-04-01T19:36:35.436 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.436 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bddec0f:::benchmark_data_smithi188_104537_object105719:head# 2024-04-01T19:36:35.436 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.436 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bddf735:::benchmark_data_smithi188_104537_object70826:head# 2024-04-01T19:36:35.436 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.436 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bddf909:::benchmark_data_smithi188_104537_object70991:head# 2024-04-01T19:36:35.436 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.436 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bde55e8:::benchmark_data_smithi188_104537_object154649:head# 2024-04-01T19:36:35.436 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.436 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bdedf12:::benchmark_data_smithi188_104537_object82934:head# 2024-04-01T19:36:35.436 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.436 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bdf95a6:::benchmark_data_smithi188_104537_object95822:head# 2024-04-01T19:36:35.436 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.439 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bdfb4fa:::benchmark_data_smithi188_104537_object19926:head# 2024-04-01T19:36:35.439 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.439 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bdfcc28:::benchmark_data_smithi188_104537_object55948:head# 2024-04-01T19:36:35.440 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.440 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bdfd561:::benchmark_data_smithi188_104537_object122953:head# 2024-04-01T19:36:35.440 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.440 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5be01462:::benchmark_data_smithi188_104537_object140497:head# 2024-04-01T19:36:35.440 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.440 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5be01d47:::benchmark_data_smithi188_104537_object165114:head# 2024-04-01T19:36:35.440 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.440 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5be05773:::benchmark_data_smithi188_104537_object94338:head# 2024-04-01T19:36:35.440 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.440 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5be075f6:::benchmark_data_smithi188_104537_object160772:head# 2024-04-01T19:36:35.440 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.440 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5be17cfb:::benchmark_data_smithi188_104537_object66486:head# 2024-04-01T19:36:35.440 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.440 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5be1c82f:::benchmark_data_smithi188_104537_object107739:head# 2024-04-01T19:36:35.441 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.441 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5be27361:::benchmark_data_smithi188_104537_object85828:head# 2024-04-01T19:36:35.441 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.441 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5be39d78:::benchmark_data_smithi188_104537_object118937:head# 2024-04-01T19:36:35.441 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.441 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5be3d332:::benchmark_data_smithi188_104537_object163703:head# 2024-04-01T19:36:35.441 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.441 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5be3d739:::benchmark_data_smithi188_104537_object71597:head# 2024-04-01T19:36:35.441 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.441 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5be440a1:::benchmark_data_smithi188_104537_object155474:head# 2024-04-01T19:36:35.441 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.441 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5be46935:::benchmark_data_smithi188_104537_object44823:head# 2024-04-01T19:36:35.441 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.442 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5be4cc12:::benchmark_data_smithi188_104537_object145619:head# 2024-04-01T19:36:35.442 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.442 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5be4e8bf:::benchmark_data_smithi188_104537_object37671:head# 2024-04-01T19:36:35.442 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.442 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5be50de5:::benchmark_data_smithi188_104537_object151870:head# 2024-04-01T19:36:35.442 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.442 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5be5613c:::benchmark_data_smithi188_104537_object37099:head# 2024-04-01T19:36:35.442 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.442 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5be58d98:::benchmark_data_smithi188_104537_object79841:head# 2024-04-01T19:36:35.442 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.442 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5be6a028:::benchmark_data_smithi188_104537_object53648:head# 2024-04-01T19:36:35.442 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.442 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5be702da:::benchmark_data_smithi188_104537_object29834:head# 2024-04-01T19:36:35.442 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.442 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5be78f05:::benchmark_data_smithi188_104537_object158700:head# 2024-04-01T19:36:35.443 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.444 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5be7a290:::benchmark_data_smithi188_104537_object124664:head# 2024-04-01T19:36:35.444 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.444 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5be7b622:::benchmark_data_smithi188_104537_object61006:head# 2024-04-01T19:36:35.444 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.444 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5be8c29e:::benchmark_data_smithi188_104537_object119848:head# 2024-04-01T19:36:35.444 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.444 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5be9aa2b:::benchmark_data_smithi188_104537_object164674:head# 2024-04-01T19:36:35.444 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.445 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5be9d8f2:::benchmark_data_smithi188_104537_object21210:head# 2024-04-01T19:36:35.445 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.445 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5beab86d:::benchmark_data_smithi188_104537_object83444:head# 2024-04-01T19:36:35.445 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.445 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5beb392e:::benchmark_data_smithi188_104537_object112842:head# 2024-04-01T19:36:35.445 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.445 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5beb54d8:::benchmark_data_smithi188_104537_object140743:head# 2024-04-01T19:36:35.446 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.446 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5beb63d9:::benchmark_data_smithi188_104537_object83009:head# 2024-04-01T19:36:35.446 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.446 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bebc67f:::benchmark_data_smithi188_104537_object118055:head# 2024-04-01T19:36:35.446 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.447 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bebd307:::benchmark_data_smithi188_104537_object50332:head# 2024-04-01T19:36:35.447 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.447 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bec177e:::benchmark_data_smithi188_104537_object129848:head# 2024-04-01T19:36:35.447 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.447 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bec8403:::benchmark_data_smithi188_104537_object27853:head# 2024-04-01T19:36:35.447 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.448 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5becfb52:::benchmark_data_smithi188_104537_object28504:head# 2024-04-01T19:36:35.448 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.451 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bed218d:::benchmark_data_smithi188_104537_object165745:head# 2024-04-01T19:36:35.452 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.452 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bee5781:::benchmark_data_smithi188_104537_object24568:head# 2024-04-01T19:36:35.452 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.452 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bee5f2c:::benchmark_data_smithi188_104537_object17299:head# 2024-04-01T19:36:35.452 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.453 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bef8890:::benchmark_data_smithi188_104537_object53853:head# 2024-04-01T19:36:35.453 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.453 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5befcb14:::benchmark_data_smithi188_104537_object36890:head# 2024-04-01T19:36:35.453 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.453 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf01261:::benchmark_data_smithi188_104537_object127576:head# 2024-04-01T19:36:35.453 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.453 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf035b9:::benchmark_data_smithi188_104537_object70728:head# 2024-04-01T19:36:35.453 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.454 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf0e057:::benchmark_data_smithi188_104537_object51083:head# 2024-04-01T19:36:35.454 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.454 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf0eba8:::benchmark_data_smithi188_104537_object20898:head# 2024-04-01T19:36:35.454 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.455 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf0f36f:::benchmark_data_smithi188_104537_object12191:head# 2024-04-01T19:36:35.455 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.455 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf1393e:::benchmark_data_smithi188_104537_object58319:head# 2024-04-01T19:36:35.455 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.459 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf1ccb4:::benchmark_data_smithi188_104537_object127768:head# 2024-04-01T19:36:35.459 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.459 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf2523f:::benchmark_data_smithi188_104537_object40706:head# 2024-04-01T19:36:35.459 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.459 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf2994e:::benchmark_data_smithi188_104537_object82596:head# 2024-04-01T19:36:35.459 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.459 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf2e0fc:::benchmark_data_smithi188_104537_object47827:head# 2024-04-01T19:36:35.459 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.459 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf3b494:::benchmark_data_smithi188_104537_object49213:head# 2024-04-01T19:36:35.459 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.459 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf3c2ba:::benchmark_data_smithi188_104537_object33755:head# 2024-04-01T19:36:35.459 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.460 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf4429c:::benchmark_data_smithi188_104537_object82277:head# 2024-04-01T19:36:35.460 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.460 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf45654:::benchmark_data_smithi188_104537_object148539:head# 2024-04-01T19:36:35.460 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.460 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf48186:::benchmark_data_smithi188_104537_object29198:head# 2024-04-01T19:36:35.460 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.460 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf508f0:::benchmark_data_smithi188_104537_object156355:head# 2024-04-01T19:36:35.460 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.460 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf5e49a:::benchmark_data_smithi188_104537_object163084:head# 2024-04-01T19:36:35.460 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.460 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf64b2f:::benchmark_data_smithi188_104537_object156766:head# 2024-04-01T19:36:35.460 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.460 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf66971:::benchmark_data_smithi188_104537_object30154:head# 2024-04-01T19:36:35.461 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.461 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf66c6d:::benchmark_data_smithi188_104537_object52017:head# 2024-04-01T19:36:35.461 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.461 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf6c9dd:::benchmark_data_smithi188_104537_object122525:head# 2024-04-01T19:36:35.461 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.461 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf715f0:::benchmark_data_smithi188_104537_object108248:head# 2024-04-01T19:36:35.461 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.462 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf74f33:::benchmark_data_smithi188_104537_object65709:head# 2024-04-01T19:36:35.462 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.462 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf74f3b:::benchmark_data_smithi188_104537_object128574:head# 2024-04-01T19:36:35.463 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.463 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf763af:::benchmark_data_smithi188_104537_object143953:head# 2024-04-01T19:36:35.463 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.463 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf774c4:::benchmark_data_smithi188_104537_object47156:head# 2024-04-01T19:36:35.463 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.463 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf7a40b:::benchmark_data_smithi188_104537_object63811:head# 2024-04-01T19:36:35.463 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.463 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf83333:::benchmark_data_smithi188_104537_object41174:head# 2024-04-01T19:36:35.463 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.463 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf8592c:::benchmark_data_smithi188_104537_object168124:head# 2024-04-01T19:36:35.463 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.463 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf8cb6a:::benchmark_data_smithi188_104537_object69690:head# 2024-04-01T19:36:35.463 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.464 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bf960c1:::benchmark_data_smithi188_104537_object87127:head# 2024-04-01T19:36:35.464 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.464 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bfa182e:::benchmark_data_smithi188_104537_object140959:head# 2024-04-01T19:36:35.465 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.465 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bfa48eb:::benchmark_data_smithi188_104537_object170703:head# 2024-04-01T19:36:35.465 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.465 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bfaffd1:::benchmark_data_smithi188_104537_object71266:head# 2024-04-01T19:36:35.465 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.465 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bfb8ed1:::benchmark_data_smithi188_104537_object134312:head# 2024-04-01T19:36:35.465 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.465 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bfb997a:::benchmark_data_smithi188_104537_object34159:head# 2024-04-01T19:36:35.465 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.465 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bfc3d4f:::benchmark_data_smithi188_104537_object157143:head# 2024-04-01T19:36:35.465 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.467 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bfc8fd9:::benchmark_data_smithi188_104537_object90804:head# 2024-04-01T19:36:35.467 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.467 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bfe0dbf:::benchmark_data_smithi188_104537_object113797:head# 2024-04-01T19:36:35.467 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.467 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bfe74b3:::benchmark_data_smithi188_104537_object170084:head# 2024-04-01T19:36:35.467 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.467 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bfed8b8:::benchmark_data_smithi188_104537_object147639:head# 2024-04-01T19:36:35.467 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.467 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bfefd9b:::benchmark_data_smithi188_104537_object22872:head# 2024-04-01T19:36:35.467 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.467 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bff011c:::benchmark_data_smithi188_104537_object90130:head# 2024-04-01T19:36:35.468 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.468 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5bff9a63:::benchmark_data_smithi188_104537_object49509:head# 2024-04-01T19:36:35.468 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.468 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c0098ba:::benchmark_data_smithi188_104537_object149052:head# 2024-04-01T19:36:35.468 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.468 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c00efd9:::benchmark_data_smithi188_104537_object27062:head# 2024-04-01T19:36:35.468 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.469 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c0207e1:::benchmark_data_smithi188_104537_object34175:head# 2024-04-01T19:36:35.470 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.470 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c02905f:::benchmark_data_smithi188_104537_object68382:head# 2024-04-01T19:36:35.470 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.470 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c02a70d:::benchmark_data_smithi188_104537_object23862:head# 2024-04-01T19:36:35.470 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.470 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c03a351:::benchmark_data_smithi188_104537_object61740:head# 2024-04-01T19:36:35.470 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.470 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c03f838:::benchmark_data_smithi188_104537_object38106:head# 2024-04-01T19:36:35.470 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.470 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c04cdfb:::benchmark_data_smithi188_104537_object131423:head# 2024-04-01T19:36:35.470 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.471 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c057f00:::benchmark_data_smithi188_104537_object101952:head# 2024-04-01T19:36:35.471 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.471 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c05fb21:::benchmark_data_smithi188_104537_object50945:head# 2024-04-01T19:36:35.471 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.471 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c064891:::benchmark_data_smithi188_104537_object29257:head# 2024-04-01T19:36:35.471 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.473 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c066b02:::benchmark_data_smithi188_104537_object132963:head# 2024-04-01T19:36:35.473 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.473 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c06eb88:::benchmark_data_smithi188_104537_object94263:head# 2024-04-01T19:36:35.473 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.473 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c07816f:::benchmark_data_smithi188_104537_object80416:head# 2024-04-01T19:36:35.473 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.473 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c07e57d:::benchmark_data_smithi188_104537_object40797:head# 2024-04-01T19:36:35.473 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.473 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c07f96e:::benchmark_data_smithi188_104537_object32184:head# 2024-04-01T19:36:35.474 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.474 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c084601:::benchmark_data_smithi188_104537_object110911:head# 2024-04-01T19:36:35.474 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.474 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c08c0b6:::benchmark_data_smithi188_104537_object61847:head# 2024-04-01T19:36:35.474 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.474 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c08c442:::benchmark_data_smithi188_104537_object54844:head# 2024-04-01T19:36:35.474 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.474 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c099b89:::benchmark_data_smithi188_104537_object93154:head# 2024-04-01T19:36:35.474 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.474 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c0a472e:::benchmark_data_smithi188_104537_object25629:head# 2024-04-01T19:36:35.474 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.474 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c0a6f8e:::benchmark_data_smithi188_104537_object19798:head# 2024-04-01T19:36:35.475 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.475 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c0ab5f8:::benchmark_data_smithi188_104537_object42928:head# 2024-04-01T19:36:35.475 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.477 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c0b3643:::benchmark_data_smithi188_104537_object151944:head# 2024-04-01T19:36:35.477 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.477 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c0b5e52:::benchmark_data_smithi188_104537_object28423:head# 2024-04-01T19:36:35.477 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.477 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c0b8f30:::benchmark_data_smithi188_104537_object49274:head# 2024-04-01T19:36:35.477 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.477 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c0c2ff1:::benchmark_data_smithi188_104537_object71917:head# 2024-04-01T19:36:35.477 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.477 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c0cd2a9:::benchmark_data_smithi188_104537_object76480:head# 2024-04-01T19:36:35.478 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.478 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c0ceeaf:::benchmark_data_smithi188_104537_object22904:head# 2024-04-01T19:36:35.478 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.478 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c0d1035:::benchmark_data_smithi188_104537_object66734:head# 2024-04-01T19:36:35.478 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.478 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c0d1cf4:::benchmark_data_smithi188_104537_object36934:head# 2024-04-01T19:36:35.478 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.478 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c0d2ab7:::benchmark_data_smithi188_104537_object12048:head# 2024-04-01T19:36:35.478 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.478 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c0e301b:::benchmark_data_smithi188_104537_object133621:head# 2024-04-01T19:36:35.478 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.478 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c0e4198:::benchmark_data_smithi188_104537_object114701:head# 2024-04-01T19:36:35.478 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.479 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c0f4629:::benchmark_data_smithi188_104537_object169485:head# 2024-04-01T19:36:35.479 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.480 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c0fea29:::benchmark_data_smithi188_104537_object134135:head# 2024-04-01T19:36:35.480 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.480 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c0feaeb:::benchmark_data_smithi188_104537_object131003:head# 2024-04-01T19:36:35.480 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.481 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c100b0b:::benchmark_data_smithi188_104537_object100832:head# 2024-04-01T19:36:35.481 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.481 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c10289a:::benchmark_data_smithi188_104537_object122723:head# 2024-04-01T19:36:35.481 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.481 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c103f0a:::benchmark_data_smithi188_104537_object79517:head# 2024-04-01T19:36:35.481 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.481 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c1059ea:::benchmark_data_smithi188_104537_object69494:head# 2024-04-01T19:36:35.481 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.481 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c10b1ed:::benchmark_data_smithi188_104537_object111078:head# 2024-04-01T19:36:35.481 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.481 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c10d80a:::benchmark_data_smithi188_104537_object121363:head# 2024-04-01T19:36:35.481 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.481 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c116007:::benchmark_data_smithi188_104537_object115189:head# 2024-04-01T19:36:35.481 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.482 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c116e25:::benchmark_data_smithi188_104537_object153763:head# 2024-04-01T19:36:35.482 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.482 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c11b03b:::benchmark_data_smithi188_104537_object56210:head# 2024-04-01T19:36:35.482 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.482 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c12489d:::benchmark_data_smithi188_104537_object80321:head# 2024-04-01T19:36:35.482 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.482 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c12db57:::benchmark_data_smithi188_104537_object11359:head# 2024-04-01T19:36:35.483 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.483 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c12ef6c:::benchmark_data_smithi188_104537_object124499:head# 2024-04-01T19:36:35.483 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.486 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c132489:::benchmark_data_smithi188_104537_object22351:head# 2024-04-01T19:36:35.486 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.486 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c136a4b:::benchmark_data_smithi188_104537_object97645:head# 2024-04-01T19:36:35.486 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.486 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c137e84:::benchmark_data_smithi188_104537_object80206:head# 2024-04-01T19:36:35.486 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.486 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c13845c:::benchmark_data_smithi188_104537_object90206:head# 2024-04-01T19:36:35.486 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.487 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c13a34d:::benchmark_data_smithi188_104537_object125237:head# 2024-04-01T19:36:35.487 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.487 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c140606:::benchmark_data_smithi188_104537_object140779:head# 2024-04-01T19:36:35.487 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.487 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c14b023:::benchmark_data_smithi188_104537_object28849:head# 2024-04-01T19:36:35.487 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.487 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c15d743:::benchmark_data_smithi188_104537_object72944:head# 2024-04-01T19:36:35.487 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.487 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c1648dd:::benchmark_data_smithi188_104537_object151555:head# 2024-04-01T19:36:35.487 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.487 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c16c193:::benchmark_data_smithi188_104537_object62589:head# 2024-04-01T19:36:35.487 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.487 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c17b988:::benchmark_data_smithi188_104537_object19368:head# 2024-04-01T19:36:35.487 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.488 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c1822fa:::benchmark_data_smithi188_104537_object113284:head# 2024-04-01T19:36:35.488 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.488 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c18703c:::benchmark_data_smithi188_104537_object97303:head# 2024-04-01T19:36:35.488 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.488 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c18a249:::benchmark_data_smithi188_104537_object42847:head# 2024-04-01T19:36:35.488 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.488 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c1916b5:::benchmark_data_smithi188_104537_object85797:head# 2024-04-01T19:36:35.488 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.488 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c19262d:::benchmark_data_smithi188_104537_object89090:head# 2024-04-01T19:36:35.488 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.488 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c1ae54c:::benchmark_data_smithi188_104537_object26660:head# 2024-04-01T19:36:35.488 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.488 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c1b2c83:::benchmark_data_smithi188_104537_object141365:head# 2024-04-01T19:36:35.488 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.488 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c1b8240:::benchmark_data_smithi188_104537_object102056:head# 2024-04-01T19:36:35.489 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.489 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c1b87db:::benchmark_data_smithi188_104537_object103395:head# 2024-04-01T19:36:35.489 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.489 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c1bbec2:::benchmark_data_smithi188_104537_object38173:head# 2024-04-01T19:36:35.490 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.490 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c1bc2c6:::benchmark_data_smithi188_104537_object156739:head# 2024-04-01T19:36:35.490 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.490 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c1c10fa:::benchmark_data_smithi188_104537_object100559:head# 2024-04-01T19:36:35.491 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.491 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c1c2390:::benchmark_data_smithi188_104537_object120001:head# 2024-04-01T19:36:35.492 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.492 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c1c4ae1:::benchmark_data_smithi188_104537_object120344:head# 2024-04-01T19:36:35.492 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.492 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c1cbf7f:::benchmark_data_smithi188_104537_object60153:head# 2024-04-01T19:36:35.492 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.492 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c1cd27f:::benchmark_data_smithi188_104537_object29962:head# 2024-04-01T19:36:35.492 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.492 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c1d0217:::benchmark_data_smithi188_104537_object91704:head# 2024-04-01T19:36:35.493 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.496 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c1d8107:::benchmark_data_smithi188_104537_object95957:head# 2024-04-01T19:36:35.496 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.496 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c1dc3df:::benchmark_data_smithi188_104537_object38154:head# 2024-04-01T19:36:35.496 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.497 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c1e1e9c:::benchmark_data_smithi188_104537_object83637:head# 2024-04-01T19:36:35.497 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.497 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c1e4819:::benchmark_data_smithi188_104537_object47458:head# 2024-04-01T19:36:35.498 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.498 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c1e4dc3:::benchmark_data_smithi188_104537_object95430:head# 2024-04-01T19:36:35.498 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.498 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c1eb322:::benchmark_data_smithi188_104537_object128164:head# 2024-04-01T19:36:35.498 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.498 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c208d58:::benchmark_data_smithi188_104537_object11921:head# 2024-04-01T19:36:35.498 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.498 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c20f869:::benchmark_data_smithi188_104537_object16194:head# 2024-04-01T19:36:35.498 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.500 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c213b09:::benchmark_data_smithi188_104537_object30360:head# 2024-04-01T19:36:35.500 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.500 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c216de0:::benchmark_data_smithi188_104537_object105292:head# 2024-04-01T19:36:35.500 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.500 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c21d275:::benchmark_data_smithi188_104537_object111285:head# 2024-04-01T19:36:35.501 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.501 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c225241:::benchmark_data_smithi188_104537_object157681:head# 2024-04-01T19:36:35.501 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.501 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c23d1e3:::benchmark_data_smithi188_104537_object105128:head# 2024-04-01T19:36:35.501 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.501 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c251acc:::benchmark_data_smithi188_104537_object51345:head# 2024-04-01T19:36:35.501 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.501 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c251f3a:::benchmark_data_smithi188_104537_object105461:head# 2024-04-01T19:36:35.501 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.501 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c25ab4e:::benchmark_data_smithi188_104537_object56215:head# 2024-04-01T19:36:35.501 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.501 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c25b9cc:::benchmark_data_smithi188_104537_object78239:head# 2024-04-01T19:36:35.501 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.502 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c2693e0:::benchmark_data_smithi188_104537_object168598:head# 2024-04-01T19:36:35.502 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.503 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c26f4b8:::benchmark_data_smithi188_104537_object112697:head# 2024-04-01T19:36:35.503 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.503 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c278254:::benchmark_data_smithi188_104537_object124368:head# 2024-04-01T19:36:35.503 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.503 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c279cd4:::benchmark_data_smithi188_104537_object119909:head# 2024-04-01T19:36:35.503 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.503 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c27f14a:::benchmark_data_smithi188_104537_object58634:head# 2024-04-01T19:36:35.503 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.503 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c283f47:::benchmark_data_smithi188_104537_object72941:head# 2024-04-01T19:36:35.504 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.504 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c288b5c:::benchmark_data_smithi188_104537_object106081:head# 2024-04-01T19:36:35.504 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.504 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c28ec58:::benchmark_data_smithi188_104537_object47068:head# 2024-04-01T19:36:35.504 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.504 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c298213:::benchmark_data_smithi188_104537_object148283:head# 2024-04-01T19:36:35.504 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.505 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c29de5b:::benchmark_data_smithi188_104537_object113363:head# 2024-04-01T19:36:35.505 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.506 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c29f1e2:::benchmark_data_smithi188_104537_object67034:head# 2024-04-01T19:36:35.506 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.506 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c2aeb7d:::benchmark_data_smithi188_104537_object154462:head# 2024-04-01T19:36:35.506 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.506 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c2bdb43:::benchmark_data_smithi188_104537_object63621:head# 2024-04-01T19:36:35.506 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.506 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c2be58e:::benchmark_data_smithi188_104537_object155627:head# 2024-04-01T19:36:35.506 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.506 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c2beb8b:::benchmark_data_smithi188_104537_object92444:head# 2024-04-01T19:36:35.506 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.506 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c2bed89:::benchmark_data_smithi188_104537_object27954:head# 2024-04-01T19:36:35.506 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.506 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c2c661a:::benchmark_data_smithi188_104537_object18871:head# 2024-04-01T19:36:35.507 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.507 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c2ceac6:::benchmark_data_smithi188_104537_object143269:head# 2024-04-01T19:36:35.507 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.507 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c2d66e7:::benchmark_data_smithi188_104537_object66968:head# 2024-04-01T19:36:35.507 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.508 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c2da4de:::benchmark_data_smithi188_104537_object74694:head# 2024-04-01T19:36:35.508 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.508 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c2da8a0:::benchmark_data_smithi188_104537_object105166:head# 2024-04-01T19:36:35.508 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.508 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c2df536:::benchmark_data_smithi188_104537_object141093:head# 2024-04-01T19:36:35.508 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c2e2295:::benchmark_data_smithi188_104537_object90033:head# 2024-04-01T19:36:35.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c2e66a6:::benchmark_data_smithi188_104537_object30441:head# 2024-04-01T19:36:35.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c2e684d:::benchmark_data_smithi188_104537_object127454:head# 2024-04-01T19:36:35.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c2ecbe4:::benchmark_data_smithi188_104537_object70446:head# 2024-04-01T19:36:35.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c2fa8f3:::benchmark_data_smithi188_104537_object72142:head# 2024-04-01T19:36:35.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c30c1b6:::benchmark_data_smithi188_104537_object134121:head# 2024-04-01T19:36:35.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c310eca:::benchmark_data_smithi188_104537_object47493:head# 2024-04-01T19:36:35.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.510 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c31461d:::benchmark_data_smithi188_104537_object149408:head# 2024-04-01T19:36:35.510 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.510 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c317370:::benchmark_data_smithi188_104537_object104296:head# 2024-04-01T19:36:35.510 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.510 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c31ff95:::benchmark_data_smithi188_104537_object93599:head# 2024-04-01T19:36:35.510 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.514 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c32456b:::benchmark_data_smithi188_104537_object83485:head# 2024-04-01T19:36:35.514 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.514 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c32a55d:::benchmark_data_smithi188_104537_object12791:head# 2024-04-01T19:36:35.514 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.514 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c32c57b:::benchmark_data_smithi188_104537_object141018:head# 2024-04-01T19:36:35.515 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.515 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c334b4b:::benchmark_data_smithi188_104537_object116800:head# 2024-04-01T19:36:35.515 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.515 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c337dea:::benchmark_data_smithi188_104537_object109670:head# 2024-04-01T19:36:35.515 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.515 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c34f9e7:::benchmark_data_smithi188_104537_object137296:head# 2024-04-01T19:36:35.515 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.515 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c356e21:::benchmark_data_smithi188_104537_object18694:head# 2024-04-01T19:36:35.515 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.515 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c357c01:::benchmark_data_smithi188_104537_object55400:head# 2024-04-01T19:36:35.515 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.515 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c35903d:::benchmark_data_smithi188_104537_object160875:head# 2024-04-01T19:36:35.515 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.515 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c35e560:::benchmark_data_smithi188_104537_object130405:head# 2024-04-01T19:36:35.516 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.516 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c361f7a:::benchmark_data_smithi188_104537_object98818:head# 2024-04-01T19:36:35.516 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.516 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c363196:::benchmark_data_smithi188_104537_object134989:head# 2024-04-01T19:36:35.516 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.516 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c36520a:::benchmark_data_smithi188_104537_object152310:head# 2024-04-01T19:36:35.516 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.516 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c36f642:::benchmark_data_smithi188_104537_object85233:head# 2024-04-01T19:36:35.516 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.521 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c381210:::benchmark_data_smithi188_104537_object128541:head# 2024-04-01T19:36:35.521 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.521 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c381feb:::benchmark_data_smithi188_104537_object128942:head# 2024-04-01T19:36:35.521 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.521 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c395215:::benchmark_data_smithi188_104537_object144303:head# 2024-04-01T19:36:35.521 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.521 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c39cbe5:::benchmark_data_smithi188_104537_object56957:head# 2024-04-01T19:36:35.521 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.521 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c3a30f6:::benchmark_data_smithi188_104537_object35390:head# 2024-04-01T19:36:35.521 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.522 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c3a70fe:::benchmark_data_smithi188_104537_object151923:head# 2024-04-01T19:36:35.522 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.522 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c3ae17b:::benchmark_data_smithi188_104537_object24100:head# 2024-04-01T19:36:35.522 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.522 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c3ae5d1:::benchmark_data_smithi188_104537_object127252:head# 2024-04-01T19:36:35.522 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.522 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c3b00a7:::benchmark_data_smithi188_104537_object110370:head# 2024-04-01T19:36:35.522 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.522 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c3b3ace:::benchmark_data_smithi188_104537_object108323:head# 2024-04-01T19:36:35.522 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.522 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c3bb2a1:::benchmark_data_smithi188_104537_object105427:head# 2024-04-01T19:36:35.522 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.522 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c3c1f6c:::benchmark_data_smithi188_104537_object27704:head# 2024-04-01T19:36:35.523 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.523 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c3c5074:::benchmark_data_smithi188_104537_object143029:head# 2024-04-01T19:36:35.523 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.523 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c3c57de:::benchmark_data_smithi188_104537_object106698:head# 2024-04-01T19:36:35.523 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.523 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c3c5d82:::benchmark_data_smithi188_104537_object26614:head# 2024-04-01T19:36:35.523 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.523 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c3e8561:::benchmark_data_smithi188_104537_object30416:head# 2024-04-01T19:36:35.523 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.523 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c3ec9e4:::benchmark_data_smithi188_104537_object145732:head# 2024-04-01T19:36:35.523 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.523 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c3ee6cb:::benchmark_data_smithi188_104537_object18798:head# 2024-04-01T19:36:35.523 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.523 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c3f9118:::benchmark_data_smithi188_104537_object133523:head# 2024-04-01T19:36:35.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c3f9675:::benchmark_data_smithi188_104537_object71484:head# 2024-04-01T19:36:35.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c401872:::benchmark_data_smithi188_104537_object65360:head# 2024-04-01T19:36:35.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c404ea0:::benchmark_data_smithi188_104537_object68223:head# 2024-04-01T19:36:35.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c40d124:::benchmark_data_smithi188_104537_object89747:head# 2024-04-01T19:36:35.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c411fd4:::benchmark_data_smithi188_104537_object158448:head# 2024-04-01T19:36:35.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c41bb2e:::benchmark_data_smithi188_104537_object28794:head# 2024-04-01T19:36:35.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c42891f:::benchmark_data_smithi188_104537_object108449:head# 2024-04-01T19:36:35.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.525 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c42aed4:::benchmark_data_smithi188_104537_object29864:head# 2024-04-01T19:36:35.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.525 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c438c47:::benchmark_data_smithi188_104537_object153366:head# 2024-04-01T19:36:35.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.529 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c43f370:::benchmark_data_smithi188_104537_object56962:head# 2024-04-01T19:36:35.529 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.529 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c43f47e:::benchmark_data_smithi188_104537_object113491:head# 2024-04-01T19:36:35.529 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.529 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c449c12:::benchmark_data_smithi188_104537_object83430:head# 2024-04-01T19:36:35.529 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.529 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c457a1d:::benchmark_data_smithi188_104537_object73101:head# 2024-04-01T19:36:35.529 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.529 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c4591a7:::benchmark_data_smithi188_104537_object138940:head# 2024-04-01T19:36:35.529 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.529 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c47bfcf:::benchmark_data_smithi188_104537_object86304:head# 2024-04-01T19:36:35.529 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.529 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c47fce1:::benchmark_data_smithi188_104537_object34599:head# 2024-04-01T19:36:35.530 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.530 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c48de61:::benchmark_data_smithi188_104537_object53655:head# 2024-04-01T19:36:35.530 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.530 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c494687:::benchmark_data_smithi188_104537_object163877:head# 2024-04-01T19:36:35.530 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.530 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c4950b6:::benchmark_data_smithi188_104537_object91561:head# 2024-04-01T19:36:35.530 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.530 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c49520e:::benchmark_data_smithi188_104537_object30325:head# 2024-04-01T19:36:35.530 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.530 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c4957a4:::benchmark_data_smithi188_104537_object31577:head# 2024-04-01T19:36:35.530 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.530 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c497305:::benchmark_data_smithi188_104537_object163808:head# 2024-04-01T19:36:35.530 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.531 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c49ad08:::benchmark_data_smithi188_104537_object110767:head# 2024-04-01T19:36:35.531 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.531 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c4a9898:::benchmark_data_smithi188_104537_object46090:head# 2024-04-01T19:36:35.531 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.531 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c4b2401:::benchmark_data_smithi188_104537_object87652:head# 2024-04-01T19:36:35.531 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.531 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c4b4d9f:::benchmark_data_smithi188_104537_object101978:head# 2024-04-01T19:36:35.531 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.531 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c4c0870:::benchmark_data_smithi188_104537_object124415:head# 2024-04-01T19:36:35.531 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.531 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c4c8a52:::benchmark_data_smithi188_104537_object142292:head# 2024-04-01T19:36:35.531 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.531 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c4d3819:::benchmark_data_smithi188_104537_object78893:head# 2024-04-01T19:36:35.531 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.532 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c4e46fc:::benchmark_data_smithi188_104537_object20553:head# 2024-04-01T19:36:35.532 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.532 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c4ebc4a:::benchmark_data_smithi188_104537_object33705:head# 2024-04-01T19:36:35.532 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.532 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c4f7e5d:::benchmark_data_smithi188_104537_object136326:head# 2024-04-01T19:36:35.532 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.532 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c502877:::benchmark_data_smithi188_104537_object32962:head# 2024-04-01T19:36:35.532 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.532 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c506d62:::benchmark_data_smithi188_104537_object30934:head# 2024-04-01T19:36:35.532 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.532 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c51426c:::benchmark_data_smithi188_104537_object104352:head# 2024-04-01T19:36:35.532 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.532 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c518e43:::benchmark_data_smithi188_104537_object12419:head# 2024-04-01T19:36:35.532 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.533 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c52d5f2:::benchmark_data_smithi188_104537_object115802:head# 2024-04-01T19:36:35.533 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.533 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c53e97b:::benchmark_data_smithi188_104537_object21347:head# 2024-04-01T19:36:35.533 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.533 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c53f797:::benchmark_data_smithi188_104537_object111528:head# 2024-04-01T19:36:35.533 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.536 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c54076f:::benchmark_data_smithi188_104537_object44607:head# 2024-04-01T19:36:35.536 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.536 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c54a842:::benchmark_data_smithi188_104537_object117294:head# 2024-04-01T19:36:35.536 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.536 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c54a973:::benchmark_data_smithi188_104537_object143118:head# 2024-04-01T19:36:35.536 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.536 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c54d607:::benchmark_data_smithi188_104537_object44720:head# 2024-04-01T19:36:35.536 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.536 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c55b9fe:::benchmark_data_smithi188_104537_object94778:head# 2024-04-01T19:36:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c56b24d:::benchmark_data_smithi188_104537_object149806:head# 2024-04-01T19:36:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c56e29a:::benchmark_data_smithi188_104537_object131225:head# 2024-04-01T19:36:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c574e34:::benchmark_data_smithi188_104537_object44123:head# 2024-04-01T19:36:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c57c666:::benchmark_data_smithi188_104537_object127346:head# 2024-04-01T19:36:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c57f2f8:::benchmark_data_smithi188_104537_object84962:head# 2024-04-01T19:36:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c582978:::benchmark_data_smithi188_104537_object150916:head# 2024-04-01T19:36:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.538 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c585261:::benchmark_data_smithi188_104537_object57014:head# 2024-04-01T19:36:35.538 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.538 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c58fd8b:::benchmark_data_smithi188_104537_object161664:head# 2024-04-01T19:36:35.538 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.538 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c595c8b:::benchmark_data_smithi188_104537_object11591:head# 2024-04-01T19:36:35.538 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.538 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c5a1c61:::benchmark_data_smithi188_104537_object170476:head# 2024-04-01T19:36:35.538 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.538 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c5abdcf:::benchmark_data_smithi188_104537_object86035:head# 2024-04-01T19:36:35.538 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.538 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c5b3b41:::benchmark_data_smithi188_104537_object159579:head# 2024-04-01T19:36:35.538 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.538 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c5b666f:::benchmark_data_smithi188_104537_object132173:head# 2024-04-01T19:36:35.539 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.539 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c5d65e8:::benchmark_data_smithi188_104537_object120930:head# 2024-04-01T19:36:35.539 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.539 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c5d72b1:::benchmark_data_smithi188_104537_object152705:head# 2024-04-01T19:36:35.539 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.539 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c5dd7c2:::benchmark_data_smithi188_104537_object54079:head# 2024-04-01T19:36:35.539 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.539 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c5e3368:::benchmark_data_smithi188_104537_object153965:head# 2024-04-01T19:36:35.539 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.539 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c603ba7:::benchmark_data_smithi188_104537_object90565:head# 2024-04-01T19:36:35.539 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.539 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c6157c8:::benchmark_data_smithi188_104537_object115725:head# 2024-04-01T19:36:35.539 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.540 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c6162ea:::benchmark_data_smithi188_104537_object50119:head# 2024-04-01T19:36:35.540 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.540 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c61be6b:::benchmark_data_smithi188_104537_object37131:head# 2024-04-01T19:36:35.540 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.540 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c6206cb:::benchmark_data_smithi188_104537_object71217:head# 2024-04-01T19:36:35.540 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.540 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c620ac5:::benchmark_data_smithi188_104537_object89972:head# 2024-04-01T19:36:35.540 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.541 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c62b9b6:::benchmark_data_smithi188_104537_object94497:head# 2024-04-01T19:36:35.541 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.541 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c63f22e:::benchmark_data_smithi188_104537_object169263:head# 2024-04-01T19:36:35.541 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.541 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c643062:::benchmark_data_smithi188_104537_object139972:head# 2024-04-01T19:36:35.541 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.542 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c651428:::benchmark_data_smithi188_104537_object15623:head# 2024-04-01T19:36:35.542 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.542 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c654e17:::benchmark_data_smithi188_104537_object141867:head# 2024-04-01T19:36:35.542 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.542 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c6560fb:::benchmark_data_smithi188_104537_object49906:head# 2024-04-01T19:36:35.542 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.542 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c65ba9e:::benchmark_data_smithi188_104537_object39340:head# 2024-04-01T19:36:35.542 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.542 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c66eae8:::benchmark_data_smithi188_104537_object54188:head# 2024-04-01T19:36:35.543 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.544 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c67baa0:::benchmark_data_smithi188_104537_object162050:head# 2024-04-01T19:36:35.544 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.544 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c67d154:::benchmark_data_smithi188_104537_object122078:head# 2024-04-01T19:36:35.544 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.544 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c67fc30:::benchmark_data_smithi188_104537_object85042:head# 2024-04-01T19:36:35.544 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.544 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c683175:::benchmark_data_smithi188_104537_object40690:head# 2024-04-01T19:36:35.544 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.544 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c6865d9:::benchmark_data_smithi188_104537_object33810:head# 2024-04-01T19:36:35.544 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.545 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c68ab12:::benchmark_data_smithi188_104537_object156769:head# 2024-04-01T19:36:35.545 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.545 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c68e8db:::benchmark_data_smithi188_104537_object71878:head# 2024-04-01T19:36:35.545 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.545 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c69b137:::benchmark_data_smithi188_104537_object105656:head# 2024-04-01T19:36:35.545 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.545 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c6b00d7:::benchmark_data_smithi188_104537_object37805:head# 2024-04-01T19:36:35.545 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.545 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c6b939d:::benchmark_data_smithi188_104537_object39298:head# 2024-04-01T19:36:35.545 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.547 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c6bbf12:::benchmark_data_smithi188_104537_object28676:head# 2024-04-01T19:36:35.547 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.547 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c6d1b8a:::benchmark_data_smithi188_104537_object89548:head# 2024-04-01T19:36:35.547 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.547 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c6d1c12:::benchmark_data_smithi188_104537_object33055:head# 2024-04-01T19:36:35.547 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.547 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c6d71cb:::benchmark_data_smithi188_104537_object103180:head# 2024-04-01T19:36:35.547 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.547 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c6e8686:::benchmark_data_smithi188_104537_object164829:head# 2024-04-01T19:36:35.548 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.548 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c6ead35:::benchmark_data_smithi188_104537_object126799:head# 2024-04-01T19:36:35.548 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.548 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c6ec863:::benchmark_data_smithi188_104537_object163414:head# 2024-04-01T19:36:35.548 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.548 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c6f0cf0:::benchmark_data_smithi188_104537_object72947:head# 2024-04-01T19:36:35.548 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.548 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c6f49be:::benchmark_data_smithi188_104537_object124954:head# 2024-04-01T19:36:35.548 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.548 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c6fb1be:::benchmark_data_smithi188_104537_object101873:head# 2024-04-01T19:36:35.548 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.549 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c6fcf5f:::benchmark_data_smithi188_104537_object12476:head# 2024-04-01T19:36:35.549 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.549 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c709919:::benchmark_data_smithi188_104537_object46603:head# 2024-04-01T19:36:35.549 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.549 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c71d2ef:::benchmark_data_smithi188_104537_object136186:head# 2024-04-01T19:36:35.549 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.550 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c726a13:::benchmark_data_smithi188_104537_object84172:head# 2024-04-01T19:36:35.550 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.550 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c728ae1:::benchmark_data_smithi188_104537_object146748:head# 2024-04-01T19:36:35.550 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c72da24:::benchmark_data_smithi188_104537_object92367:head# 2024-04-01T19:36:35.554 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.554 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c731927:::benchmark_data_smithi188_104537_object146924:head# 2024-04-01T19:36:35.554 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.554 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c7395f0:::benchmark_data_smithi188_104537_object147748:head# 2024-04-01T19:36:35.554 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.554 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c7398ef:::benchmark_data_smithi188_104537_object142892:head# 2024-04-01T19:36:35.554 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.554 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c739b63:::benchmark_data_smithi188_104537_object135946:head# 2024-04-01T19:36:35.554 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.554 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c7442aa:::benchmark_data_smithi188_104537_object117395:head# 2024-04-01T19:36:35.554 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.554 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c74bd67:::benchmark_data_smithi188_104537_object11329:head# 2024-04-01T19:36:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c7549a0:::benchmark_data_smithi188_104537_object15367:head# 2024-04-01T19:36:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c75c84c:::benchmark_data_smithi188_104537_object37818:head# 2024-04-01T19:36:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c75de73:::benchmark_data_smithi188_104537_object95174:head# 2024-04-01T19:36:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c764f73:::benchmark_data_smithi188_104537_object107904:head# 2024-04-01T19:36:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c76b5b0:::benchmark_data_smithi188_104537_object48836:head# 2024-04-01T19:36:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c76d5a8:::benchmark_data_smithi188_104537_object138062:head# 2024-04-01T19:36:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c78cdcf:::benchmark_data_smithi188_104537_object82474:head# 2024-04-01T19:36:35.556 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.556 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c796afa:::benchmark_data_smithi188_104537_object74010:head# 2024-04-01T19:36:35.556 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.557 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c79b941:::benchmark_data_smithi188_104537_object51061:head# 2024-04-01T19:36:35.557 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.557 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c79fe73:::benchmark_data_smithi188_104537_object48353:head# 2024-04-01T19:36:35.557 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.557 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c7a3fa8:::benchmark_data_smithi188_104537_object14200:head# 2024-04-01T19:36:35.557 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.557 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c7a5921:::benchmark_data_smithi188_104537_object59919:head# 2024-04-01T19:36:35.557 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.557 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c7a7ab7:::benchmark_data_smithi188_104537_object137942:head# 2024-04-01T19:36:35.557 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c7a81a5:::benchmark_data_smithi188_104537_object112378:head# 2024-04-01T19:36:35.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c7a90b2:::benchmark_data_smithi188_104537_object20777:head# 2024-04-01T19:36:35.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c7abf40:::benchmark_data_smithi188_104537_object110150:head# 2024-04-01T19:36:35.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c7b1ac6:::benchmark_data_smithi188_104537_object24129:head# 2024-04-01T19:36:35.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c7b9c15:::benchmark_data_smithi188_104537_object111613:head# 2024-04-01T19:36:35.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c7bba47:::benchmark_data_smithi188_104537_object90686:head# 2024-04-01T19:36:35.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.565 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c7be7e7:::benchmark_data_smithi188_104537_object18081:head# 2024-04-01T19:36:35.565 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.566 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c7bf797:::benchmark_data_smithi188_104537_object137504:head# 2024-04-01T19:36:35.566 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.566 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c7cc7e6:::benchmark_data_smithi188_104537_object122641:head# 2024-04-01T19:36:35.566 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.566 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c7ed275:::benchmark_data_smithi188_104537_object28846:head# 2024-04-01T19:36:35.566 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.566 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c7f7f54:::benchmark_data_smithi188_104537_object83418:head# 2024-04-01T19:36:35.566 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.566 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c808aa9:::benchmark_data_smithi188_104537_object98729:head# 2024-04-01T19:36:35.567 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.567 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c810669:::benchmark_data_smithi188_104537_object35331:head# 2024-04-01T19:36:35.567 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.567 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c8108f4:::benchmark_data_smithi188_104537_object123199:head# 2024-04-01T19:36:35.567 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.567 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c812bd8:::benchmark_data_smithi188_104537_object47757:head# 2024-04-01T19:36:35.567 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.567 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c817e95:::benchmark_data_smithi188_104537_object12478:head# 2024-04-01T19:36:35.568 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.568 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c83130e:::benchmark_data_smithi188_104537_object56552:head# 2024-04-01T19:36:35.568 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.568 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c8318d7:::benchmark_data_smithi188_104537_object153039:head# 2024-04-01T19:36:35.568 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.569 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c856b29:::benchmark_data_smithi188_104537_object80021:head# 2024-04-01T19:36:35.569 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.569 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c8590f1:::benchmark_data_smithi188_104537_object65726:head# 2024-04-01T19:36:35.569 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.569 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c865670:::benchmark_data_smithi188_104537_object82270:head# 2024-04-01T19:36:35.569 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.569 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c87031f:::benchmark_data_smithi188_104537_object92488:head# 2024-04-01T19:36:35.569 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.569 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c87c90b:::benchmark_data_smithi188_104537_object116546:head# 2024-04-01T19:36:35.569 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.570 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c87dc48:::benchmark_data_smithi188_104537_object110580:head# 2024-04-01T19:36:35.570 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.570 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c87edc8:::benchmark_data_smithi188_104537_object150469:head# 2024-04-01T19:36:35.570 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.570 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c8a6d58:::benchmark_data_smithi188_104537_object19614:head# 2024-04-01T19:36:35.570 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.572 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:36:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c8a8f58:::benchmark_data_smithi188_104537_object92718:head# 2024-04-01T19:36:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c8b9591:::benchmark_data_smithi188_104537_object136278:head# 2024-04-01T19:36:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c8daab7:::benchmark_data_smithi188_104537_object101668:head# 2024-04-01T19:36:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c8dbdc3:::benchmark_data_smithi188_104537_object158968:head# 2024-04-01T19:36:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c8e2687:::benchmark_data_smithi188_104537_object131514:head# 2024-04-01T19:36:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c8ef140:::benchmark_data_smithi188_104537_object171125:head# 2024-04-01T19:36:35.574 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.574 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c8ef46e:::benchmark_data_smithi188_104537_object82303:head# 2024-04-01T19:36:35.574 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.574 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c8f8996:::benchmark_data_smithi188_104537_object119298:head# 2024-04-01T19:36:35.574 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.578 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:35.578 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c904be7:::benchmark_data_smithi188_104537_object153400:head# 2024-04-01T19:36:35.578 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.578 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c912299:::benchmark_data_smithi188_104537_object146767:head# 2024-04-01T19:36:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c91ad35:::benchmark_data_smithi188_104537_object141692:head# 2024-04-01T19:36:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c921739:::benchmark_data_smithi188_104537_object128842:head# 2024-04-01T19:36:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c925a71:::benchmark_data_smithi188_104537_object48579:head# 2024-04-01T19:36:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c92d3c4:::benchmark_data_smithi188_104537_object135734:head# 2024-04-01T19:36:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c934c8e:::benchmark_data_smithi188_104537_object126778:head# 2024-04-01T19:36:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c938731:::benchmark_data_smithi188_104537_object72950:head# 2024-04-01T19:36:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c9433c7:::benchmark_data_smithi188_104537_object115597:head# 2024-04-01T19:36:35.580 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.580 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:36:35.598 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c94ddb1:::benchmark_data_smithi188_104537_object167311:head# 2024-04-01T19:36:35.598 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.602 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c94e185:::benchmark_data_smithi188_104537_object23081:head# 2024-04-01T19:36:35.602 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.606 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c94e741:::benchmark_data_smithi188_104537_object130260:head# 2024-04-01T19:36:35.606 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.607 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c95adf3:::benchmark_data_smithi188_104537_object99389:head# 2024-04-01T19:36:35.607 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.607 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c9642d8:::benchmark_data_smithi188_104537_object128015:head# 2024-04-01T19:36:35.607 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.607 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c96560c:::benchmark_data_smithi188_104537_object75938:head# 2024-04-01T19:36:35.608 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.608 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c966396:::benchmark_data_smithi188_104537_object135778:head# 2024-04-01T19:36:35.608 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.608 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c969f60:::benchmark_data_smithi188_104537_object72081:head# 2024-04-01T19:36:35.608 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.610 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c96ca58:::benchmark_data_smithi188_104537_object158286:head# 2024-04-01T19:36:35.611 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.611 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c978fb1:::benchmark_data_smithi188_104537_object52975:head# 2024-04-01T19:36:35.612 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.612 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c97c27b:::benchmark_data_smithi188_104537_object34273:head# 2024-04-01T19:36:35.612 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.612 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c989391:::benchmark_data_smithi188_104537_object157079:head# 2024-04-01T19:36:35.612 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.612 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c98c631:::benchmark_data_smithi188_104537_object115588:head# 2024-04-01T19:36:35.612 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.613 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c98c928:::benchmark_data_smithi188_104537_object36026:head# 2024-04-01T19:36:35.613 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c99572b:::benchmark_data_smithi188_104537_object67127:head# 2024-04-01T19:36:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c996f59:::benchmark_data_smithi188_104537_object42927:head# 2024-04-01T19:36:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c9a1e70:::benchmark_data_smithi188_104537_object137137:head# 2024-04-01T19:36:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c9a938d:::benchmark_data_smithi188_104537_object66378:head# 2024-04-01T19:36:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c9b47da:::benchmark_data_smithi188_104537_object38345:head# 2024-04-01T19:36:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c9b8ee9:::benchmark_data_smithi188_104537_object129918:head# 2024-04-01T19:36:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.615 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c9bf01d:::benchmark_data_smithi188_104537_object21062:head# 2024-04-01T19:36:35.615 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.616 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c9bfbf5:::benchmark_data_smithi188_104537_object51644:head# 2024-04-01T19:36:35.616 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.616 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c9c5eb0:::benchmark_data_smithi188_104537_object137623:head# 2024-04-01T19:36:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c9c859b:::benchmark_data_smithi188_104537_object145678:head# 2024-04-01T19:36:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c9cbeb6:::benchmark_data_smithi188_104537_object118794:head# 2024-04-01T19:36:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c9d6e5a:::benchmark_data_smithi188_104537_object60283:head# 2024-04-01T19:36:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c9d9290:::benchmark_data_smithi188_104537_object20111:head# 2024-04-01T19:36:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c9da88f:::benchmark_data_smithi188_104537_object50919:head# 2024-04-01T19:36:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c9deeca:::benchmark_data_smithi188_104537_object43469:head# 2024-04-01T19:36:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c9df6c8:::benchmark_data_smithi188_104537_object118562:head# 2024-04-01T19:36:35.618 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.618 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c9f0e13:::benchmark_data_smithi188_104537_object122925:head# 2024-04-01T19:36:35.618 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.618 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c9f95f4:::benchmark_data_smithi188_104537_object119058:head# 2024-04-01T19:36:35.618 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c9fd7cd:::benchmark_data_smithi188_104537_object120801:head# 2024-04-01T19:36:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5c9ff554:::benchmark_data_smithi188_104537_object29554:head# 2024-04-01T19:36:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca0d695:::benchmark_data_smithi188_104537_object87889:head# 2024-04-01T19:36:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca0e8f0:::benchmark_data_smithi188_104537_object63827:head# 2024-04-01T19:36:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca0fccf:::benchmark_data_smithi188_104537_object97860:head# 2024-04-01T19:36:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca12827:::benchmark_data_smithi188_104537_object49506:head# 2024-04-01T19:36:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca1d0f4:::benchmark_data_smithi188_104537_object134396:head# 2024-04-01T19:36:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca2d50d:::benchmark_data_smithi188_104537_object158728:head# 2024-04-01T19:36:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca2d598:::benchmark_data_smithi188_104537_object122130:head# 2024-04-01T19:36:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca2f0b8:::benchmark_data_smithi188_104537_object99188:head# 2024-04-01T19:36:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca306fa:::benchmark_data_smithi188_104537_object51876:head# 2024-04-01T19:36:35.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca3985d:::benchmark_data_smithi188_104537_object35049:head# 2024-04-01T19:36:35.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca42813:::benchmark_data_smithi188_104537_object76107:head# 2024-04-01T19:36:35.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca4b9ff:::benchmark_data_smithi188_104537_object134053:head# 2024-04-01T19:36:35.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca4dd2b:::benchmark_data_smithi188_104537_object134002:head# 2024-04-01T19:36:35.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca5cc48:::benchmark_data_smithi188_104537_object45300:head# 2024-04-01T19:36:35.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca615ae:::benchmark_data_smithi188_104537_object140890:head# 2024-04-01T19:36:35.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.627 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca69c2e:::benchmark_data_smithi188_104537_object100734:head# 2024-04-01T19:36:35.627 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.627 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca6b511:::benchmark_data_smithi188_104537_object68998:head# 2024-04-01T19:36:35.627 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.627 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca6bcdd:::benchmark_data_smithi188_104537_object131847:head# 2024-04-01T19:36:35.627 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.627 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca71ba4:::benchmark_data_smithi188_104537_object149623:head# 2024-04-01T19:36:35.627 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.627 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca82db7:::benchmark_data_smithi188_104537_object116491:head# 2024-04-01T19:36:35.627 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.627 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca84531:::benchmark_data_smithi188_104537_object17282:head# 2024-04-01T19:36:35.627 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.628 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca85006:::benchmark_data_smithi188_104537_object102745:head# 2024-04-01T19:36:35.628 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.628 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca8eba3:::benchmark_data_smithi188_104537_object161783:head# 2024-04-01T19:36:35.628 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.628 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca9010a:::benchmark_data_smithi188_104537_object55585:head# 2024-04-01T19:36:35.628 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.628 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca94849:::benchmark_data_smithi188_104537_object162400:head# 2024-04-01T19:36:35.628 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.628 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca99d46:::benchmark_data_smithi188_104537_object156341:head# 2024-04-01T19:36:35.628 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.628 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca9b37f:::benchmark_data_smithi188_104537_object85927:head# 2024-04-01T19:36:35.628 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.628 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ca9f8ee:::benchmark_data_smithi188_104537_object35651:head# 2024-04-01T19:36:35.628 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5caa16f9:::benchmark_data_smithi188_104537_object57112:head# 2024-04-01T19:36:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5caa29f3:::benchmark_data_smithi188_104537_object132424:head# 2024-04-01T19:36:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5caa79c2:::benchmark_data_smithi188_104537_object24492:head# 2024-04-01T19:36:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cabc5ab:::benchmark_data_smithi188_104537_object17722:head# 2024-04-01T19:36:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cabe9d5:::benchmark_data_smithi188_104537_object119269:head# 2024-04-01T19:36:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cac253e:::benchmark_data_smithi188_104537_object71310:head# 2024-04-01T19:36:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cac2970:::benchmark_data_smithi188_104537_object68486:head# 2024-04-01T19:36:35.630 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.630 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cacfe08:::benchmark_data_smithi188_104537_object167137:head# 2024-04-01T19:36:35.630 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.630 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cad5c04:::benchmark_data_smithi188_104537_object36711:head# 2024-04-01T19:36:35.630 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.634 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cad6104:::benchmark_data_smithi188_104537_object46274:head# 2024-04-01T19:36:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cad6568:::benchmark_data_smithi188_104537_object70038:head# 2024-04-01T19:36:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cadb8ef:::benchmark_data_smithi188_104537_object88347:head# 2024-04-01T19:36:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cae0867:::benchmark_data_smithi188_104537_object32848:head# 2024-04-01T19:36:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cae82db:::benchmark_data_smithi188_104537_object119504:head# 2024-04-01T19:36:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5caf1ac0:::benchmark_data_smithi188_104537_object165826:head# 2024-04-01T19:36:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb01fe2:::benchmark_data_smithi188_104537_object135166:head# 2024-04-01T19:36:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb04209:::benchmark_data_smithi188_104537_object134758:head# 2024-04-01T19:36:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb05e31:::benchmark_data_smithi188_104537_object97907:head# 2024-04-01T19:36:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb0cc44:::benchmark_data_smithi188_104537_object36481:head# 2024-04-01T19:36:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb12bf7:::benchmark_data_smithi188_104537_object56277:head# 2024-04-01T19:36:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb12f60:::benchmark_data_smithi188_104537_object72631:head# 2024-04-01T19:36:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb141db:::benchmark_data_smithi188_104537_object26623:head# 2024-04-01T19:36:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb17ada:::benchmark_data_smithi188_104537_object85487:head# 2024-04-01T19:36:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb1a698:::benchmark_data_smithi188_104537_object69546:head# 2024-04-01T19:36:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb21086:::benchmark_data_smithi188_104537_object87444:head# 2024-04-01T19:36:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb29599:::benchmark_data_smithi188_104537_object73741:head# 2024-04-01T19:36:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb2f2d3:::benchmark_data_smithi188_104537_object125321:head# 2024-04-01T19:36:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb32e92:::benchmark_data_smithi188_104537_object11853:head# 2024-04-01T19:36:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb39400:::benchmark_data_smithi188_104537_object90957:head# 2024-04-01T19:36:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb3ee4b:::benchmark_data_smithi188_104537_object137095:head# 2024-04-01T19:36:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb43aa4:::benchmark_data_smithi188_104537_object128558:head# 2024-04-01T19:36:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb45a93:::benchmark_data_smithi188_104537_object88821:head# 2024-04-01T19:36:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb4c0ab:::benchmark_data_smithi188_104537_object47741:head# 2024-04-01T19:36:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb4c18e:::benchmark_data_smithi188_104537_object157517:head# 2024-04-01T19:36:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb5985d:::benchmark_data_smithi188_104537_object50748:head# 2024-04-01T19:36:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb5add9:::benchmark_data_smithi188_104537_object115091:head# 2024-04-01T19:36:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb5ffec:::benchmark_data_smithi188_104537_object165329:head# 2024-04-01T19:36:35.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb64663:::benchmark_data_smithi188_104537_object142861:head# 2024-04-01T19:36:35.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb666c7:::benchmark_data_smithi188_104537_object31200:head# 2024-04-01T19:36:35.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.641 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb6ae5b:::benchmark_data_smithi188_104537_object113825:head# 2024-04-01T19:36:35.641 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.641 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb6beae:::benchmark_data_smithi188_104537_object61515:head# 2024-04-01T19:36:35.641 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.641 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb6d26f:::benchmark_data_smithi188_104537_object86158:head# 2024-04-01T19:36:35.641 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.641 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb8277a:::benchmark_data_smithi188_104537_object118407:head# 2024-04-01T19:36:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb8a84a:::benchmark_data_smithi188_104537_object144067:head# 2024-04-01T19:36:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb8c453:::benchmark_data_smithi188_104537_object45774:head# 2024-04-01T19:36:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb8cd83:::benchmark_data_smithi188_104537_object129023:head# 2024-04-01T19:36:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb8dd16:::benchmark_data_smithi188_104537_object103917:head# 2024-04-01T19:36:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb91b55:::benchmark_data_smithi188_104537_object21479:head# 2024-04-01T19:36:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cb9548a:::benchmark_data_smithi188_104537_object135252:head# 2024-04-01T19:36:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cba413c:::benchmark_data_smithi188_104537_object21369:head# 2024-04-01T19:36:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cba8597:::benchmark_data_smithi188_104537_object74363:head# 2024-04-01T19:36:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cbadd39:::benchmark_data_smithi188_104537_object126094:head# 2024-04-01T19:36:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cbbbb65:::benchmark_data_smithi188_104537_object119830:head# 2024-04-01T19:36:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cbc3e79:::benchmark_data_smithi188_104537_object145084:head# 2024-04-01T19:36:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cbc5239:::benchmark_data_smithi188_104537_object101923:head# 2024-04-01T19:36:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cbc92b5:::benchmark_data_smithi188_104537_object33661:head# 2024-04-01T19:36:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.645 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cbca9b2:::benchmark_data_smithi188_104537_object120610:head# 2024-04-01T19:36:35.645 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.645 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cbd4251:::benchmark_data_smithi188_104537_object90356:head# 2024-04-01T19:36:35.645 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.645 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cbdc8bc:::benchmark_data_smithi188_104537_object107282:head# 2024-04-01T19:36:35.645 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.645 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cbe03c4:::benchmark_data_smithi188_104537_object151095:head# 2024-04-01T19:36:35.646 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.646 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cbe1455:::benchmark_data_smithi188_104537_object58352:head# 2024-04-01T19:36:35.646 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.646 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cbe5890:::benchmark_data_smithi188_104537_object149386:head# 2024-04-01T19:36:35.646 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.646 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cbe64fd:::benchmark_data_smithi188_104537_object64813:head# 2024-04-01T19:36:35.646 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.646 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cbf2b36:::benchmark_data_smithi188_104537_object147378:head# 2024-04-01T19:36:35.646 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.648 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cbf6c45:::benchmark_data_smithi188_104537_object130461:head# 2024-04-01T19:36:35.648 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.648 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cbf9a2a:::benchmark_data_smithi188_104537_object100988:head# 2024-04-01T19:36:35.648 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.648 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cbfaffa:::benchmark_data_smithi188_104537_object67064:head# 2024-04-01T19:36:35.648 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.648 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cbfc337:::benchmark_data_smithi188_104537_object102190:head# 2024-04-01T19:36:35.648 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.648 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cbfd380:::benchmark_data_smithi188_104537_object158044:head# 2024-04-01T19:36:35.648 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.649 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc00d48:::benchmark_data_smithi188_104537_object54652:head# 2024-04-01T19:36:35.649 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.649 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc00f1f:::benchmark_data_smithi188_104537_object27095:head# 2024-04-01T19:36:35.649 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.649 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc02db7:::benchmark_data_smithi188_104537_object148608:head# 2024-04-01T19:36:35.649 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.649 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc0978f:::benchmark_data_smithi188_104537_object123896:head# 2024-04-01T19:36:35.649 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.649 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc0d423:::benchmark_data_smithi188_104537_object21264:head# 2024-04-01T19:36:35.649 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.651 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc1b324:::benchmark_data_smithi188_104537_object26752:head# 2024-04-01T19:36:35.651 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.651 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc1cfe7:::benchmark_data_smithi188_104537_object19930:head# 2024-04-01T19:36:35.651 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.651 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc22f15:::benchmark_data_smithi188_104537_object51974:head# 2024-04-01T19:36:35.651 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.651 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc2bd54:::benchmark_data_smithi188_104537_object166082:head# 2024-04-01T19:36:35.651 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.651 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc35131:::benchmark_data_smithi188_104537_object78171:head# 2024-04-01T19:36:35.651 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.651 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc365d4:::benchmark_data_smithi188_104537_object155938:head# 2024-04-01T19:36:35.651 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.652 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc36d2e:::benchmark_data_smithi188_104537_object98326:head# 2024-04-01T19:36:35.652 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.652 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc3bffa:::benchmark_data_smithi188_104537_object110161:head# 2024-04-01T19:36:35.652 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.652 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc3eda4:::benchmark_data_smithi188_104537_object153019:head# 2024-04-01T19:36:35.652 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.653 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc4797d:::benchmark_data_smithi188_104537_object94298:head# 2024-04-01T19:36:35.653 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.653 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc53f0c:::benchmark_data_smithi188_104537_object69011:head# 2024-04-01T19:36:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc59cd0:::benchmark_data_smithi188_104537_object161894:head# 2024-04-01T19:36:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc5d1fe:::benchmark_data_smithi188_104537_object132676:head# 2024-04-01T19:36:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc64e5c:::benchmark_data_smithi188_104537_object92712:head# 2024-04-01T19:36:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc6908a:::benchmark_data_smithi188_104537_object109911:head# 2024-04-01T19:36:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc6b235:::benchmark_data_smithi188_104537_object147814:head# 2024-04-01T19:36:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc6bdce:::benchmark_data_smithi188_104537_object80421:head# 2024-04-01T19:36:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc6bfee:::benchmark_data_smithi188_104537_object123631:head# 2024-04-01T19:36:35.655 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.656 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc6cf24:::benchmark_data_smithi188_104537_object77856:head# 2024-04-01T19:36:35.656 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.656 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc7051f:::benchmark_data_smithi188_104537_object144568:head# 2024-04-01T19:36:35.656 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc8081c:::benchmark_data_smithi188_104537_object61062:head# 2024-04-01T19:36:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc869c2:::benchmark_data_smithi188_104537_object156028:head# 2024-04-01T19:36:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc87644:::benchmark_data_smithi188_104537_object117331:head# 2024-04-01T19:36:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc8bd6c:::benchmark_data_smithi188_104537_object75379:head# 2024-04-01T19:36:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc9a18a:::benchmark_data_smithi188_104537_object14807:head# 2024-04-01T19:36:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc9b298:::benchmark_data_smithi188_104537_object95090:head# 2024-04-01T19:36:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cc9e5a6:::benchmark_data_smithi188_104537_object149256:head# 2024-04-01T19:36:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.658 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cca711d:::benchmark_data_smithi188_104537_object146014:head# 2024-04-01T19:36:35.658 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.658 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cca87d7:::benchmark_data_smithi188_104537_object138254:head# 2024-04-01T19:36:35.658 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.659 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cca8c19:::benchmark_data_smithi188_104537_object61118:head# 2024-04-01T19:36:35.659 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.659 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ccbdb8e:::benchmark_data_smithi188_104537_object39031:head# 2024-04-01T19:36:35.659 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.660 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ccbe2f9:::benchmark_data_smithi188_104537_object138607:head# 2024-04-01T19:36:35.660 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.660 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ccc9522:::benchmark_data_smithi188_104537_object10990:head# 2024-04-01T19:36:35.660 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.660 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ccd0a43:::benchmark_data_smithi188_104537_object100806:head# 2024-04-01T19:36:35.660 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.660 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ccd4c45:::benchmark_data_smithi188_104537_object33088:head# 2024-04-01T19:36:35.660 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.660 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ccd659b:::benchmark_data_smithi188_104537_object25762:head# 2024-04-01T19:36:35.660 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.660 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ccd769f:::benchmark_data_smithi188_104537_object43188:head# 2024-04-01T19:36:35.660 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.660 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ccdbd58:::benchmark_data_smithi188_104537_object40190:head# 2024-04-01T19:36:35.661 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.662 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ccdc8cc:::benchmark_data_smithi188_104537_object170451:head# 2024-04-01T19:36:35.662 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.662 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cce089d:::benchmark_data_smithi188_104537_object20772:head# 2024-04-01T19:36:35.662 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.662 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cce59be:::benchmark_data_smithi188_104537_object18178:head# 2024-04-01T19:36:35.662 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.662 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cced99b:::benchmark_data_smithi188_104537_object158464:head# 2024-04-01T19:36:35.662 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.662 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cceed22:::benchmark_data_smithi188_104537_object155661:head# 2024-04-01T19:36:35.662 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.662 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ccefcf5:::benchmark_data_smithi188_104537_object45111:head# 2024-04-01T19:36:35.662 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.663 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ccffd67:::benchmark_data_smithi188_104537_object24591:head# 2024-04-01T19:36:35.663 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.663 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cd04886:::benchmark_data_smithi188_104537_object95508:head# 2024-04-01T19:36:35.663 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.665 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cd07332:::benchmark_data_smithi188_104537_object128551:head# 2024-04-01T19:36:35.665 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.665 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cd0a225:::benchmark_data_smithi188_104537_object140171:head# 2024-04-01T19:36:35.665 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.665 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cd25c12:::benchmark_data_smithi188_104537_object160171:head# 2024-04-01T19:36:35.666 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.666 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cd27d53:::benchmark_data_smithi188_104537_object121110:head# 2024-04-01T19:36:35.666 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.666 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cd36b6c:::benchmark_data_smithi188_104537_object88269:head# 2024-04-01T19:36:35.666 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cd463f1:::benchmark_data_smithi188_104537_object25024:head# 2024-04-01T19:36:35.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cd46bdb:::benchmark_data_smithi188_104537_object168409:head# 2024-04-01T19:36:35.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cd4c167:::benchmark_data_smithi188_104537_object37483:head# 2024-04-01T19:36:35.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cd50e18:::benchmark_data_smithi188_104537_object42301:head# 2024-04-01T19:36:35.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cd545b5:::benchmark_data_smithi188_104537_object101732:head# 2024-04-01T19:36:35.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cd5ea04:::benchmark_data_smithi188_104537_object91054:head# 2024-04-01T19:36:35.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cd78807:::benchmark_data_smithi188_104537_object170616:head# 2024-04-01T19:36:35.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cd7f69b:::benchmark_data_smithi188_104537_object56288:head# 2024-04-01T19:36:35.669 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.669 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cd890eb:::benchmark_data_smithi188_104537_object114912:head# 2024-04-01T19:36:35.669 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.669 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cd8c02f:::benchmark_data_smithi188_104537_object109086:head# 2024-04-01T19:36:35.669 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.669 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cd8c08b:::benchmark_data_smithi188_104537_object12046:head# 2024-04-01T19:36:35.670 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.670 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cd8ea22:::benchmark_data_smithi188_104537_object141956:head# 2024-04-01T19:36:35.670 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.671 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cd97dc9:::benchmark_data_smithi188_104537_object164642:head# 2024-04-01T19:36:35.671 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.671 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cda2cfc:::benchmark_data_smithi188_104537_object140679:head# 2024-04-01T19:36:35.671 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.671 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cdb3a7f:::benchmark_data_smithi188_104537_object55779:head# 2024-04-01T19:36:35.671 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.672 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cdb4307:::benchmark_data_smithi188_104537_object127958:head# 2024-04-01T19:36:35.672 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.672 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cdb5d41:::benchmark_data_smithi188_104537_object55016:head# 2024-04-01T19:36:35.672 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.672 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cdc9cee:::benchmark_data_smithi188_104537_object155616:head# 2024-04-01T19:36:35.672 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.672 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cdcb60b:::benchmark_data_smithi188_104537_object134611:head# 2024-04-01T19:36:35.672 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.673 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cdcd647:::benchmark_data_smithi188_104537_object121060:head# 2024-04-01T19:36:35.673 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.673 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cdd2d1e:::benchmark_data_smithi188_104537_object90936:head# 2024-04-01T19:36:35.673 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.674 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cdd5ff9:::benchmark_data_smithi188_104537_object56830:head# 2024-04-01T19:36:35.674 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.674 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cdd9aa0:::benchmark_data_smithi188_104537_object164946:head# 2024-04-01T19:36:35.674 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.674 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cddbefb:::benchmark_data_smithi188_104537_object52816:head# 2024-04-01T19:36:35.674 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.674 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cde83fe:::benchmark_data_smithi188_104537_object164415:head# 2024-04-01T19:36:35.674 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.674 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cdec8dc:::benchmark_data_smithi188_104537_object154700:head# 2024-04-01T19:36:35.674 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.674 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cdedd4c:::benchmark_data_smithi188_104537_object161014:head# 2024-04-01T19:36:35.675 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.675 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cdee284:::benchmark_data_smithi188_104537_object131271:head# 2024-04-01T19:36:35.675 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.678 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cdf4629:::benchmark_data_smithi188_104537_object155450:head# 2024-04-01T19:36:35.678 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.678 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cdf7fc4:::benchmark_data_smithi188_104537_object38734:head# 2024-04-01T19:36:35.678 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.679 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cdf9cef:::benchmark_data_smithi188_104537_object171092:head# 2024-04-01T19:36:35.679 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.679 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ce02b44:::benchmark_data_smithi188_104537_object21177:head# 2024-04-01T19:36:35.679 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.681 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ce0698c:::benchmark_data_smithi188_104537_object132951:head# 2024-04-01T19:36:35.681 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.681 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ce0a50c:::benchmark_data_smithi188_104537_object111765:head# 2024-04-01T19:36:35.681 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.681 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ce0eec2:::benchmark_data_smithi188_104537_object158252:head# 2024-04-01T19:36:35.681 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.681 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ce11a4e:::benchmark_data_smithi188_104537_object164693:head# 2024-04-01T19:36:35.681 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.681 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ce30801:::benchmark_data_smithi188_104537_object19813:head# 2024-04-01T19:36:35.682 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.682 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ce408ea:::benchmark_data_smithi188_104537_object161112:head# 2024-04-01T19:36:35.682 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.682 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ce46e5c:::benchmark_data_smithi188_104537_object90211:head# 2024-04-01T19:36:35.682 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.682 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:36:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ce48cea:::benchmark_data_smithi188_104537_object31321:head# 2024-04-01T19:36:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ce4abf1:::benchmark_data_smithi188_104537_object165268:head# 2024-04-01T19:36:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ce4b88f:::benchmark_data_smithi188_104537_object98977:head# 2024-04-01T19:36:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ce5e5ab:::benchmark_data_smithi188_104537_object35448:head# 2024-04-01T19:36:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ce728ad:::benchmark_data_smithi188_104537_object130229:head# 2024-04-01T19:36:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ce768be:::benchmark_data_smithi188_104537_object18748:head# 2024-04-01T19:36:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.685 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ce769f4:::benchmark_data_smithi188_104537_object123937:head# 2024-04-01T19:36:35.685 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.685 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ce77ff0:::benchmark_data_smithi188_104537_object102307:head# 2024-04-01T19:36:35.685 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.685 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ce7d670:::benchmark_data_smithi188_104537_object75376:head# 2024-04-01T19:36:35.685 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.686 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ce81378:::benchmark_data_smithi188_104537_object54792:head# 2024-04-01T19:36:35.686 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.686 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ce86cf4:::benchmark_data_smithi188_104537_object111721:head# 2024-04-01T19:36:35.686 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.686 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ce880ee:::benchmark_data_smithi188_104537_object66107:head# 2024-04-01T19:36:35.686 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.688 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ce8b196:::benchmark_data_smithi188_104537_object106576:head# 2024-04-01T19:36:35.688 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.692 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ce96b37:::benchmark_data_smithi188_104537_object113575:head# 2024-04-01T19:36:35.692 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.692 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ce9bd78:::benchmark_data_smithi188_104537_object137026:head# 2024-04-01T19:36:35.692 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.692 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ce9cf71:::benchmark_data_smithi188_104537_object43905:head# 2024-04-01T19:36:35.692 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.692 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ce9df72:::benchmark_data_smithi188_104537_object34991:head# 2024-04-01T19:36:35.692 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.692 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ceaddb5:::benchmark_data_smithi188_104537_object19025:head# 2024-04-01T19:36:35.692 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ceafa04:::benchmark_data_smithi188_104537_object94018:head# 2024-04-01T19:36:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ceb2be5:::benchmark_data_smithi188_104537_object14976:head# 2024-04-01T19:36:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ceb76a7:::benchmark_data_smithi188_104537_object94102:head# 2024-04-01T19:36:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ceb8013:::benchmark_data_smithi188_104537_object31500:head# 2024-04-01T19:36:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cebfc4d:::benchmark_data_smithi188_104537_object113693:head# 2024-04-01T19:36:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cec0c4d:::benchmark_data_smithi188_104537_object102143:head# 2024-04-01T19:36:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cec2e34:::benchmark_data_smithi188_104537_object52524:head# 2024-04-01T19:36:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.696 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cedcd8f:::benchmark_data_smithi188_104537_object62516:head# 2024-04-01T19:36:35.696 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.696 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cee0125:::benchmark_data_smithi188_104537_object84815:head# 2024-04-01T19:36:35.696 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.696 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cee360c:::benchmark_data_smithi188_104537_object131032:head# 2024-04-01T19:36:35.696 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.696 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ceed71d:::benchmark_data_smithi188_104537_object13450:head# 2024-04-01T19:36:35.696 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ceeed89:::benchmark_data_smithi188_104537_object20497:head# 2024-04-01T19:36:35.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cef07b9:::benchmark_data_smithi188_104537_object148318:head# 2024-04-01T19:36:35.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cef094d:::benchmark_data_smithi188_104537_object21969:head# 2024-04-01T19:36:35.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cef2d13:::benchmark_data_smithi188_104537_object93883:head# 2024-04-01T19:36:35.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cef3d07:::benchmark_data_smithi188_104537_object77236:head# 2024-04-01T19:36:35.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cef9a63:::benchmark_data_smithi188_104537_object157900:head# 2024-04-01T19:36:35.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cef9fef:::benchmark_data_smithi188_104537_object38634:head# 2024-04-01T19:36:35.698 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.698 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cefef09:::benchmark_data_smithi188_104537_object95392:head# 2024-04-01T19:36:35.698 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.698 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf0dde1:::benchmark_data_smithi188_104537_object21341:head# 2024-04-01T19:36:35.698 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.703 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf234ab:::benchmark_data_smithi188_104537_object46767:head# 2024-04-01T19:36:35.703 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.703 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf2474c:::benchmark_data_smithi188_104537_object18688:head# 2024-04-01T19:36:35.703 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf27af4:::benchmark_data_smithi188_104537_object59847:head# 2024-04-01T19:36:35.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf2df08:::benchmark_data_smithi188_104537_object60346:head# 2024-04-01T19:36:35.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf2ed73:::benchmark_data_smithi188_104537_object75475:head# 2024-04-01T19:36:35.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf315b2:::benchmark_data_smithi188_104537_object128552:head# 2024-04-01T19:36:35.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf349ff:::benchmark_data_smithi188_104537_object49900:head# 2024-04-01T19:36:35.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf36596:::benchmark_data_smithi188_104537_object27592:head# 2024-04-01T19:36:35.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf3975c:::benchmark_data_smithi188_104537_object169369:head# 2024-04-01T19:36:35.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.705 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf414be:::benchmark_data_smithi188_104537_object119194:head# 2024-04-01T19:36:35.705 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.705 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf42968:::benchmark_data_smithi188_104537_object144108:head# 2024-04-01T19:36:35.705 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.705 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf476b1:::benchmark_data_smithi188_104537_object142841:head# 2024-04-01T19:36:35.705 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.705 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf4eabb:::benchmark_data_smithi188_104537_object26869:head# 2024-04-01T19:36:35.705 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.707 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf5523b:::benchmark_data_smithi188_104537_object105405:head# 2024-04-01T19:36:35.707 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.707 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf57700:::benchmark_data_smithi188_104537_object48643:head# 2024-04-01T19:36:35.707 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.707 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf5843c:::benchmark_data_smithi188_104537_object154234:head# 2024-04-01T19:36:35.707 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.707 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf58ad5:::benchmark_data_smithi188_104537_object85286:head# 2024-04-01T19:36:35.708 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.708 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf5a67d:::benchmark_data_smithi188_104537_object127237:head# 2024-04-01T19:36:35.708 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.708 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf5bacb:::benchmark_data_smithi188_104537_object122748:head# 2024-04-01T19:36:35.708 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.708 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf5f2bb:::benchmark_data_smithi188_104537_object103897:head# 2024-04-01T19:36:35.708 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.708 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf60984:::benchmark_data_smithi188_104537_object60416:head# 2024-04-01T19:36:35.708 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.708 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf62341:::benchmark_data_smithi188_104537_object171518:head# 2024-04-01T19:36:35.708 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.708 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf64f51:::benchmark_data_smithi188_104537_object41835:head# 2024-04-01T19:36:35.708 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.708 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf67ee3:::benchmark_data_smithi188_104537_object151580:head# 2024-04-01T19:36:35.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf6adec:::benchmark_data_smithi188_104537_object34551:head# 2024-04-01T19:36:35.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf6ed47:::benchmark_data_smithi188_104537_object86949:head# 2024-04-01T19:36:35.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf71b3a:::benchmark_data_smithi188_104537_object16368:head# 2024-04-01T19:36:35.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf725ba:::benchmark_data_smithi188_104537_object105062:head# 2024-04-01T19:36:35.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.710 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf8e44a:::benchmark_data_smithi188_104537_object157410:head# 2024-04-01T19:36:35.710 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.710 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf90724:::benchmark_data_smithi188_104537_object121922:head# 2024-04-01T19:36:35.710 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cf9539e:::benchmark_data_smithi188_104537_object128803:head# 2024-04-01T19:36:35.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cfb5ff7:::benchmark_data_smithi188_104537_object67004:head# 2024-04-01T19:36:35.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cfbaccb:::benchmark_data_smithi188_104537_object138570:head# 2024-04-01T19:36:35.713 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.713 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cfc9949:::benchmark_data_smithi188_104537_object43592:head# 2024-04-01T19:36:35.713 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.713 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cfca0ea:::benchmark_data_smithi188_104537_object163884:head# 2024-04-01T19:36:35.713 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.713 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cfcbac5:::benchmark_data_smithi188_104537_object134599:head# 2024-04-01T19:36:35.713 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.714 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cfcc81b:::benchmark_data_smithi188_104537_object72267:head# 2024-04-01T19:36:35.714 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.714 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cfdc675:::benchmark_data_smithi188_104537_object46376:head# 2024-04-01T19:36:35.714 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.714 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cfdce0a:::benchmark_data_smithi188_104537_object113048:head# 2024-04-01T19:36:35.714 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cfde7a1:::benchmark_data_smithi188_104537_object99856:head# 2024-04-01T19:36:35.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cfe1c1f:::benchmark_data_smithi188_104537_object93720:head# 2024-04-01T19:36:35.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cfe65fa:::benchmark_data_smithi188_104537_object113970:head# 2024-04-01T19:36:35.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cfe813b:::benchmark_data_smithi188_104537_object41115:head# 2024-04-01T19:36:35.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cfea88b:::benchmark_data_smithi188_104537_object27591:head# 2024-04-01T19:36:35.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cff27e3:::benchmark_data_smithi188_104537_object51535:head# 2024-04-01T19:36:35.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5cff64af:::benchmark_data_smithi188_104537_object70390:head# 2024-04-01T19:36:35.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.716 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d001d82:::benchmark_data_smithi188_104537_object21332:head# 2024-04-01T19:36:35.716 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.716 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d0085a1:::benchmark_data_smithi188_104537_object28681:head# 2024-04-01T19:36:35.716 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.716 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d019d85:::benchmark_data_smithi188_104537_object89271:head# 2024-04-01T19:36:35.716 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.716 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d024b1f:::benchmark_data_smithi188_104537_object150629:head# 2024-04-01T19:36:35.716 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.716 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d02b558:::benchmark_data_smithi188_104537_object123424:head# 2024-04-01T19:36:35.716 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.716 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d02c02c:::benchmark_data_smithi188_104537_object127049:head# 2024-04-01T19:36:35.716 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.719 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d02c0f7:::benchmark_data_smithi188_104537_object120674:head# 2024-04-01T19:36:35.719 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.719 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d02d7b8:::benchmark_data_smithi188_104537_object128796:head# 2024-04-01T19:36:35.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d02fefc:::benchmark_data_smithi188_104537_object164370:head# 2024-04-01T19:36:35.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d0368bb:::benchmark_data_smithi188_104537_object35397:head# 2024-04-01T19:36:35.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d05a50f:::benchmark_data_smithi188_104537_object48288:head# 2024-04-01T19:36:35.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d05d064:::benchmark_data_smithi188_104537_object24331:head# 2024-04-01T19:36:35.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d062f72:::benchmark_data_smithi188_104537_object134315:head# 2024-04-01T19:36:35.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d0665a9:::benchmark_data_smithi188_104537_object135529:head# 2024-04-01T19:36:35.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d0683b5:::benchmark_data_smithi188_104537_object74451:head# 2024-04-01T19:36:35.721 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.721 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d0699cf:::benchmark_data_smithi188_104537_object115193:head# 2024-04-01T19:36:35.721 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.721 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d06be50:::benchmark_data_smithi188_104537_object142791:head# 2024-04-01T19:36:35.721 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.721 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d074933:::benchmark_data_smithi188_104537_object36300:head# 2024-04-01T19:36:35.721 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.721 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d077c43:::benchmark_data_smithi188_104537_object95932:head# 2024-04-01T19:36:35.721 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.721 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d07bf20:::benchmark_data_smithi188_104537_object75321:head# 2024-04-01T19:36:35.721 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.721 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d07c8f4:::benchmark_data_smithi188_104537_object19202:head# 2024-04-01T19:36:35.721 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d083199:::benchmark_data_smithi188_104537_object52984:head# 2024-04-01T19:36:35.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d083277:::benchmark_data_smithi188_104537_object79664:head# 2024-04-01T19:36:35.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d09a1a0:::benchmark_data_smithi188_104537_object164975:head# 2024-04-01T19:36:35.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d09ac85:::benchmark_data_smithi188_104537_object84536:head# 2024-04-01T19:36:35.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d0aaf3c:::benchmark_data_smithi188_104537_object12933:head# 2024-04-01T19:36:35.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d0acfaf:::benchmark_data_smithi188_104537_object62436:head# 2024-04-01T19:36:35.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.727 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d0b0076:::benchmark_data_smithi188_104537_object149349:head# 2024-04-01T19:36:35.727 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.727 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d0b02ab:::benchmark_data_smithi188_104537_object54326:head# 2024-04-01T19:36:35.727 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.728 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d0b81c1:::benchmark_data_smithi188_104537_object62511:head# 2024-04-01T19:36:35.728 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.728 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d0ba274:::benchmark_data_smithi188_104537_object17343:head# 2024-04-01T19:36:35.728 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.728 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d0bafe1:::benchmark_data_smithi188_104537_object61376:head# 2024-04-01T19:36:35.728 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.728 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d0be63d:::benchmark_data_smithi188_104537_object33786:head# 2024-04-01T19:36:35.728 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.728 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d0c8b4e:::benchmark_data_smithi188_104537_object45298:head# 2024-04-01T19:36:35.728 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.728 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d0e1eaf:::benchmark_data_smithi188_104537_object43471:head# 2024-04-01T19:36:35.728 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.728 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d0e345f:::benchmark_data_smithi188_104537_object45976:head# 2024-04-01T19:36:35.729 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.729 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d0f15d4:::benchmark_data_smithi188_104537_object26370:head# 2024-04-01T19:36:35.729 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.729 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d0f7f1f:::benchmark_data_smithi188_104537_object24053:head# 2024-04-01T19:36:35.729 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.729 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d0f833d:::benchmark_data_smithi188_104537_object129466:head# 2024-04-01T19:36:35.729 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.729 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d0fc7bf:::benchmark_data_smithi188_104537_object59167:head# 2024-04-01T19:36:35.729 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.729 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d0fc879:::benchmark_data_smithi188_104537_object103147:head# 2024-04-01T19:36:35.729 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.729 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d0fde54:::benchmark_data_smithi188_104537_object12829:head# 2024-04-01T19:36:35.729 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d0ff5ee:::benchmark_data_smithi188_104537_object75375:head# 2024-04-01T19:36:35.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d103ae3:::benchmark_data_smithi188_104537_object104293:head# 2024-04-01T19:36:35.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d111c08:::benchmark_data_smithi188_104537_object57179:head# 2024-04-01T19:36:35.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d115ba9:::benchmark_data_smithi188_104537_object46278:head# 2024-04-01T19:36:35.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d11d1d3:::benchmark_data_smithi188_104537_object49871:head# 2024-04-01T19:36:35.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d121a56:::benchmark_data_smithi188_104537_object46403:head# 2024-04-01T19:36:35.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.731 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d13ba70:::benchmark_data_smithi188_104537_object136617:head# 2024-04-01T19:36:35.731 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.731 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d150e03:::benchmark_data_smithi188_104537_object112930:head# 2024-04-01T19:36:35.731 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.731 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d1511a9:::benchmark_data_smithi188_104537_object89784:head# 2024-04-01T19:36:35.731 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.731 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d15369d:::benchmark_data_smithi188_104537_object106182:head# 2024-04-01T19:36:35.731 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.731 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d157399:::benchmark_data_smithi188_104537_object152441:head# 2024-04-01T19:36:35.731 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.731 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d157e8e:::benchmark_data_smithi188_104537_object76037:head# 2024-04-01T19:36:35.731 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.731 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d1647db:::benchmark_data_smithi188_104537_object75365:head# 2024-04-01T19:36:35.731 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.732 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d16be84:::benchmark_data_smithi188_104537_object62477:head# 2024-04-01T19:36:35.732 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.732 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:35.735 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d1828e9:::benchmark_data_smithi188_104537_object113518:head# 2024-04-01T19:36:35.735 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.736 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d18654f:::benchmark_data_smithi188_104537_object131302:head# 2024-04-01T19:36:35.736 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.736 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d186595:::benchmark_data_smithi188_104537_object148586:head# 2024-04-01T19:36:35.736 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.736 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d18b55f:::benchmark_data_smithi188_104537_object107228:head# 2024-04-01T19:36:35.736 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.736 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d18be43:::benchmark_data_smithi188_104537_object149952:head# 2024-04-01T19:36:35.736 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.736 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d1a7b3f:::benchmark_data_smithi188_104537_object41408:head# 2024-04-01T19:36:35.736 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.736 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d1ae0a7:::benchmark_data_smithi188_104537_object101424:head# 2024-04-01T19:36:35.736 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.736 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d1ae631:::benchmark_data_smithi188_104537_object110622:head# 2024-04-01T19:36:35.736 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.737 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d1b3090:::benchmark_data_smithi188_104537_object56052:head# 2024-04-01T19:36:35.737 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.737 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d1b324c:::benchmark_data_smithi188_104537_object87395:head# 2024-04-01T19:36:35.737 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.737 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d1c32e3:::benchmark_data_smithi188_104537_object132416:head# 2024-04-01T19:36:35.737 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.737 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d1cccac:::benchmark_data_smithi188_104537_object79787:head# 2024-04-01T19:36:35.737 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.737 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d1d3fd8:::benchmark_data_smithi188_104537_object93294:head# 2024-04-01T19:36:35.737 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.737 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d1df30d:::benchmark_data_smithi188_104537_object27545:head# 2024-04-01T19:36:35.737 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.737 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d1e44dc:::benchmark_data_smithi188_104537_object141431:head# 2024-04-01T19:36:35.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d1ec8bc:::benchmark_data_smithi188_104537_object78547:head# 2024-04-01T19:36:35.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d1f1c5f:::benchmark_data_smithi188_104537_object46141:head# 2024-04-01T19:36:35.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d1f1fbd:::benchmark_data_smithi188_104537_object56393:head# 2024-04-01T19:36:35.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d1f31c6:::benchmark_data_smithi188_104537_object109957:head# 2024-04-01T19:36:35.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d1f3ee2:::benchmark_data_smithi188_104537_object129748:head# 2024-04-01T19:36:35.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d1f56cf:::benchmark_data_smithi188_104537_object164630:head# 2024-04-01T19:36:35.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d1f651d:::benchmark_data_smithi188_104537_object40734:head# 2024-04-01T19:36:35.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d1f8c32:::benchmark_data_smithi188_104537_object16849:head# 2024-04-01T19:36:35.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d1f94f8:::benchmark_data_smithi188_104537_object93186:head# 2024-04-01T19:36:35.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d1fa4d3:::benchmark_data_smithi188_104537_object148649:head# 2024-04-01T19:36:35.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d1fc5a1:::benchmark_data_smithi188_104537_object42213:head# 2024-04-01T19:36:35.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d21157b:::benchmark_data_smithi188_104537_object165311:head# 2024-04-01T19:36:35.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d21c81e:::benchmark_data_smithi188_104537_object23865:head# 2024-04-01T19:36:35.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.740 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d21ce9b:::benchmark_data_smithi188_104537_object73756:head# 2024-04-01T19:36:35.740 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.740 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d221a40:::benchmark_data_smithi188_104537_object23772:head# 2024-04-01T19:36:35.740 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.740 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d2258fb:::benchmark_data_smithi188_104537_object26877:head# 2024-04-01T19:36:35.740 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.744 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d2283f0:::benchmark_data_smithi188_104537_object70049:head# 2024-04-01T19:36:35.744 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.745 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d22f030:::benchmark_data_smithi188_104537_object116231:head# 2024-04-01T19:36:35.745 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.746 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d23eeba:::benchmark_data_smithi188_104537_object118249:head# 2024-04-01T19:36:35.746 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.746 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d2416a7:::benchmark_data_smithi188_104537_object83576:head# 2024-04-01T19:36:35.746 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.746 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d241cf3:::benchmark_data_smithi188_104537_object30295:head# 2024-04-01T19:36:35.746 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.747 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d246d32:::benchmark_data_smithi188_104537_object55581:head# 2024-04-01T19:36:35.747 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.747 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d24b5da:::benchmark_data_smithi188_104537_object163736:head# 2024-04-01T19:36:35.747 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.747 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d24f34a:::benchmark_data_smithi188_104537_object13007:head# 2024-04-01T19:36:35.747 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.747 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d2591c6:::benchmark_data_smithi188_104537_object122257:head# 2024-04-01T19:36:35.747 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.748 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d25ee77:::benchmark_data_smithi188_104537_object136254:head# 2024-04-01T19:36:35.749 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.749 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d2663da:::benchmark_data_smithi188_104537_object147922:head# 2024-04-01T19:36:35.749 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.749 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d28060d:::benchmark_data_smithi188_104537_object47481:head# 2024-04-01T19:36:35.749 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.749 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d288840:::benchmark_data_smithi188_104537_object67627:head# 2024-04-01T19:36:35.749 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.749 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d289152:::benchmark_data_smithi188_104537_object50226:head# 2024-04-01T19:36:35.749 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.749 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d28a5e1:::benchmark_data_smithi188_104537_object140338:head# 2024-04-01T19:36:35.749 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.752 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d28c5be:::benchmark_data_smithi188_104537_object12168:head# 2024-04-01T19:36:35.752 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.753 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d28cb45:::benchmark_data_smithi188_104537_object24647:head# 2024-04-01T19:36:35.753 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.753 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d28ef06:::benchmark_data_smithi188_104537_object41917:head# 2024-04-01T19:36:35.753 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.754 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d28f13c:::benchmark_data_smithi188_104537_object41457:head# 2024-04-01T19:36:35.754 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.754 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d290da3:::benchmark_data_smithi188_104537_object12524:head# 2024-04-01T19:36:35.754 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.755 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:36:35.756 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d29533f:::benchmark_data_smithi188_104537_object77772:head# 2024-04-01T19:36:35.756 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.756 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d29a896:::benchmark_data_smithi188_104537_object81322:head# 2024-04-01T19:36:35.756 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.756 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d29adcc:::benchmark_data_smithi188_104537_object134556:head# 2024-04-01T19:36:35.756 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.756 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d29d7c0:::benchmark_data_smithi188_104537_object139113:head# 2024-04-01T19:36:35.756 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.756 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d2a2cc5:::benchmark_data_smithi188_104537_object20422:head# 2024-04-01T19:36:35.756 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.758 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:35.759 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:36:35.761 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d2b6b79:::benchmark_data_smithi188_104537_object109292:head# 2024-04-01T19:36:35.762 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.762 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d2d4a3d:::benchmark_data_smithi188_104537_object116658:head# 2024-04-01T19:36:35.762 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.762 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d2db023:::benchmark_data_smithi188_104537_object124246:head# 2024-04-01T19:36:35.762 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.762 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d2e5990:::benchmark_data_smithi188_104537_object20264:head# 2024-04-01T19:36:35.762 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.762 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d2ee61c:::benchmark_data_smithi188_104537_object55701:head# 2024-04-01T19:36:35.762 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.762 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d2f7c37:::benchmark_data_smithi188_104537_object82420:head# 2024-04-01T19:36:35.762 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.764 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d2f8b4f:::benchmark_data_smithi188_104537_object17690:head# 2024-04-01T19:36:35.764 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.764 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d30c783:::benchmark_data_smithi188_104537_object156581:head# 2024-04-01T19:36:35.764 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.764 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d30dfc7:::benchmark_data_smithi188_104537_object42696:head# 2024-04-01T19:36:35.764 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d30e055:::benchmark_data_smithi188_104537_object129200:head# 2024-04-01T19:36:35.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d3175ce:::benchmark_data_smithi188_104537_object15406:head# 2024-04-01T19:36:35.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d3195fd:::benchmark_data_smithi188_104537_object34069:head# 2024-04-01T19:36:35.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d31fd18:::benchmark_data_smithi188_104537_object154952:head# 2024-04-01T19:36:35.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d323a0f:::benchmark_data_smithi188_104537_object100270:head# 2024-04-01T19:36:35.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.768 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d32a744:::benchmark_data_smithi188_104537_object143197:head# 2024-04-01T19:36:35.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d330d4f:::benchmark_data_smithi188_104537_object94221:head# 2024-04-01T19:36:35.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d333af6:::benchmark_data_smithi188_104537_object29603:head# 2024-04-01T19:36:35.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d33dad8:::benchmark_data_smithi188_104537_object48421:head# 2024-04-01T19:36:35.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d34088a:::benchmark_data_smithi188_104537_object127205:head# 2024-04-01T19:36:35.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d341494:::benchmark_data_smithi188_104537_object153361:head# 2024-04-01T19:36:35.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d349765:::benchmark_data_smithi188_104537_object33712:head# 2024-04-01T19:36:35.770 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.770 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d34d965:::benchmark_data_smithi188_104537_object109711:head# 2024-04-01T19:36:35.770 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.770 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d34e29e:::benchmark_data_smithi188_104537_object119717:head# 2024-04-01T19:36:35.770 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.770 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d35dffe:::benchmark_data_smithi188_104537_object159783:head# 2024-04-01T19:36:35.770 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.770 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d364b11:::benchmark_data_smithi188_104537_object151988:head# 2024-04-01T19:36:35.770 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.770 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d368cfc:::benchmark_data_smithi188_104537_object116012:head# 2024-04-01T19:36:35.770 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.771 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d373a9e:::benchmark_data_smithi188_104537_object111204:head# 2024-04-01T19:36:35.771 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.771 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d37899d:::benchmark_data_smithi188_104537_object67521:head# 2024-04-01T19:36:35.771 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.771 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d37fea4:::benchmark_data_smithi188_104537_object78067:head# 2024-04-01T19:36:35.771 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.771 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d38735b:::benchmark_data_smithi188_104537_object38953:head# 2024-04-01T19:36:35.771 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.771 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d39506a:::benchmark_data_smithi188_104537_object166047:head# 2024-04-01T19:36:35.771 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.775 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d3a39a2:::benchmark_data_smithi188_104537_object102842:head# 2024-04-01T19:36:35.775 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.775 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d3b1aaf:::benchmark_data_smithi188_104537_object124450:head# 2024-04-01T19:36:35.776 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.776 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d3b7857:::benchmark_data_smithi188_104537_object55017:head# 2024-04-01T19:36:35.776 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.776 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d3b951d:::benchmark_data_smithi188_104537_object63081:head# 2024-04-01T19:36:35.776 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.776 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d3b9b9e:::benchmark_data_smithi188_104537_object57110:head# 2024-04-01T19:36:35.776 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.776 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d3baa4c:::benchmark_data_smithi188_104537_object62850:head# 2024-04-01T19:36:35.776 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.776 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d3c48ef:::benchmark_data_smithi188_104537_object114741:head# 2024-04-01T19:36:35.776 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.776 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d3c652c:::benchmark_data_smithi188_104537_object71126:head# 2024-04-01T19:36:35.776 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d3deca0:::benchmark_data_smithi188_104537_object83023:head# 2024-04-01T19:36:35.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d3e0382:::benchmark_data_smithi188_104537_object22435:head# 2024-04-01T19:36:35.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d3ed166:::benchmark_data_smithi188_104537_object163364:head# 2024-04-01T19:36:35.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d3fbee8:::benchmark_data_smithi188_104537_object59713:head# 2024-04-01T19:36:35.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d3fec8d:::benchmark_data_smithi188_104537_object114386:head# 2024-04-01T19:36:35.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d3ff694:::benchmark_data_smithi188_104537_object121565:head# 2024-04-01T19:36:35.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4015d7:::benchmark_data_smithi188_104537_object12734:head# 2024-04-01T19:36:35.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4018b4:::benchmark_data_smithi188_104537_object65773:head# 2024-04-01T19:36:35.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d40f242:::benchmark_data_smithi188_104537_object97364:head# 2024-04-01T19:36:35.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d41029a:::benchmark_data_smithi188_104537_object26365:head# 2024-04-01T19:36:35.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4149ba:::benchmark_data_smithi188_104537_object35480:head# 2024-04-01T19:36:35.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d41d8a3:::benchmark_data_smithi188_104537_object131880:head# 2024-04-01T19:36:35.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4231bf:::benchmark_data_smithi188_104537_object109559:head# 2024-04-01T19:36:35.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d450e2b:::benchmark_data_smithi188_104537_object66473:head# 2024-04-01T19:36:35.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.779 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d455610:::benchmark_data_smithi188_104537_object73791:head# 2024-04-01T19:36:35.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.779 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d455795:::benchmark_data_smithi188_104537_object54814:head# 2024-04-01T19:36:35.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.779 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d46c313:::benchmark_data_smithi188_104537_object141750:head# 2024-04-01T19:36:35.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.780 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d46f3f2:::benchmark_data_smithi188_104537_object28041:head# 2024-04-01T19:36:35.780 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.780 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4711c5:::benchmark_data_smithi188_104537_object157543:head# 2024-04-01T19:36:35.780 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.781 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d479189:::benchmark_data_smithi188_104537_object146951:head# 2024-04-01T19:36:35.781 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.781 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d47bf2e:::benchmark_data_smithi188_104537_object113638:head# 2024-04-01T19:36:35.781 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.781 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d47d4c5:::benchmark_data_smithi188_104537_object89710:head# 2024-04-01T19:36:35.781 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.781 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d485366:::benchmark_data_smithi188_104537_object76744:head# 2024-04-01T19:36:35.781 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.784 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d493b36:::benchmark_data_smithi188_104537_object89187:head# 2024-04-01T19:36:35.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.784 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4949a6:::benchmark_data_smithi188_104537_object124352:head# 2024-04-01T19:36:35.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.784 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d49560b:::benchmark_data_smithi188_104537_object58990:head# 2024-04-01T19:36:35.785 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.785 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4964a4:::benchmark_data_smithi188_104537_object102051:head# 2024-04-01T19:36:35.785 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.785 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d49cd1f:::benchmark_data_smithi188_104537_object118538:head# 2024-04-01T19:36:35.785 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.785 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4a01e2:::benchmark_data_smithi188_104537_object98252:head# 2024-04-01T19:36:35.785 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.785 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4a059c:::benchmark_data_smithi188_104537_object111229:head# 2024-04-01T19:36:35.785 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.785 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4a2fdb:::benchmark_data_smithi188_104537_object34863:head# 2024-04-01T19:36:35.785 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.785 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4a6a71:::benchmark_data_smithi188_104537_object136661:head# 2024-04-01T19:36:35.785 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4aad82:::benchmark_data_smithi188_104537_object147582:head# 2024-04-01T19:36:35.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4ad1c1:::benchmark_data_smithi188_104537_object160342:head# 2024-04-01T19:36:35.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4b325c:::benchmark_data_smithi188_104537_object75448:head# 2024-04-01T19:36:35.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4b4c9a:::benchmark_data_smithi188_104537_object60992:head# 2024-04-01T19:36:35.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4c91e5:::benchmark_data_smithi188_104537_object76610:head# 2024-04-01T19:36:35.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4d0c9c:::benchmark_data_smithi188_104537_object29715:head# 2024-04-01T19:36:35.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4d2e74:::benchmark_data_smithi188_104537_object70502:head# 2024-04-01T19:36:35.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4d44d8:::benchmark_data_smithi188_104537_object140277:head# 2024-04-01T19:36:35.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4d665e:::benchmark_data_smithi188_104537_object123923:head# 2024-04-01T19:36:35.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4dafc1:::benchmark_data_smithi188_104537_object170325:head# 2024-04-01T19:36:35.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4e822f:::benchmark_data_smithi188_104537_object154040:head# 2024-04-01T19:36:35.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4e91df:::benchmark_data_smithi188_104537_object56445:head# 2024-04-01T19:36:35.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4f1350:::benchmark_data_smithi188_104537_object113421:head# 2024-04-01T19:36:35.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4f5dda:::benchmark_data_smithi188_104537_object131961:head# 2024-04-01T19:36:35.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4f6cec:::benchmark_data_smithi188_104537_object15317:head# 2024-04-01T19:36:35.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.791 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4f9d58:::benchmark_data_smithi188_104537_object164012:head# 2024-04-01T19:36:35.791 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.791 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d4ff1c6:::benchmark_data_smithi188_104537_object104808:head# 2024-04-01T19:36:35.791 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.791 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d50062f:::benchmark_data_smithi188_104537_object108624:head# 2024-04-01T19:36:35.791 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.791 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d509688:::benchmark_data_smithi188_104537_object134447:head# 2024-04-01T19:36:35.791 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.792 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d50a112:::benchmark_data_smithi188_104537_object165862:head# 2024-04-01T19:36:35.792 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.792 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d5227e5:::benchmark_data_smithi188_104537_object145593:head# 2024-04-01T19:36:35.792 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.792 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d52d38b:::benchmark_data_smithi188_104537_object151549:head# 2024-04-01T19:36:35.792 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.792 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d532e1a:::benchmark_data_smithi188_104537_object147995:head# 2024-04-01T19:36:35.792 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.792 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d5333f4:::benchmark_data_smithi188_104537_object100902:head# 2024-04-01T19:36:35.792 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.792 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d533538:::benchmark_data_smithi188_104537_object137111:head# 2024-04-01T19:36:35.792 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.793 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d53d97b:::benchmark_data_smithi188_104537_object124157:head# 2024-04-01T19:36:35.793 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.793 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d53dffc:::benchmark_data_smithi188_104537_object141124:head# 2024-04-01T19:36:35.793 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.793 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d53fec6:::benchmark_data_smithi188_104537_object31139:head# 2024-04-01T19:36:35.793 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.793 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d5471ea:::benchmark_data_smithi188_104537_object44377:head# 2024-04-01T19:36:35.793 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.793 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d550aa0:::benchmark_data_smithi188_104537_object111129:head# 2024-04-01T19:36:35.793 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.793 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d55bb78:::benchmark_data_smithi188_104537_object94024:head# 2024-04-01T19:36:35.793 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d5695a5:::benchmark_data_smithi188_104537_object66302:head# 2024-04-01T19:36:35.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d56b193:::benchmark_data_smithi188_104537_object90789:head# 2024-04-01T19:36:35.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d56d021:::benchmark_data_smithi188_104537_object165827:head# 2024-04-01T19:36:35.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d570bc6:::benchmark_data_smithi188_104537_object41304:head# 2024-04-01T19:36:35.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d584465:::benchmark_data_smithi188_104537_object24171:head# 2024-04-01T19:36:35.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d58d424:::benchmark_data_smithi188_104537_object81867:head# 2024-04-01T19:36:35.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d595263:::benchmark_data_smithi188_104537_object167866:head# 2024-04-01T19:36:35.795 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.795 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d597299:::benchmark_data_smithi188_104537_object160918:head# 2024-04-01T19:36:35.795 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.795 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d59a421:::benchmark_data_smithi188_104537_object160066:head# 2024-04-01T19:36:35.795 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.795 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d59babe:::benchmark_data_smithi188_104537_object160445:head# 2024-04-01T19:36:35.795 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.795 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d59f71e:::benchmark_data_smithi188_104537_object83634:head# 2024-04-01T19:36:35.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d5a1a97:::benchmark_data_smithi188_104537_object110144:head# 2024-04-01T19:36:35.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d5be3c5:::benchmark_data_smithi188_104537_object62127:head# 2024-04-01T19:36:35.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d5c490c:::benchmark_data_smithi188_104537_object106360:head# 2024-04-01T19:36:35.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.798 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d5c813d:::benchmark_data_smithi188_104537_object157201:head# 2024-04-01T19:36:35.798 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.798 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d5c9322:::benchmark_data_smithi188_104537_object50560:head# 2024-04-01T19:36:35.798 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.799 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d5c95a5:::benchmark_data_smithi188_104537_object73521:head# 2024-04-01T19:36:35.799 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.799 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d5cd9ef:::benchmark_data_smithi188_104537_object26478:head# 2024-04-01T19:36:35.799 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.799 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d5cda99:::benchmark_data_smithi188_104537_object67805:head# 2024-04-01T19:36:35.799 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.799 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d5d0b80:::benchmark_data_smithi188_104537_object120387:head# 2024-04-01T19:36:35.799 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.801 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d5db898:::benchmark_data_smithi188_104537_object31569:head# 2024-04-01T19:36:35.801 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.802 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d5dbbf4:::benchmark_data_smithi188_104537_object86417:head# 2024-04-01T19:36:35.803 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.803 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d5f2b55:::benchmark_data_smithi188_104537_object51678:head# 2024-04-01T19:36:35.803 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.803 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d5f6ebe:::benchmark_data_smithi188_104537_object22580:head# 2024-04-01T19:36:35.803 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.803 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d5fd627:::benchmark_data_smithi188_104537_object132745:head# 2024-04-01T19:36:35.803 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.805 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d5ff126:::benchmark_data_smithi188_104537_object127054:head# 2024-04-01T19:36:35.805 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.805 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d606561:::benchmark_data_smithi188_104537_object130897:head# 2024-04-01T19:36:35.805 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.805 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d6109bc:::benchmark_data_smithi188_104537_object98608:head# 2024-04-01T19:36:35.805 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.805 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d6245f6:::benchmark_data_smithi188_104537_object63346:head# 2024-04-01T19:36:35.805 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.805 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d6369e6:::benchmark_data_smithi188_104537_object150333:head# 2024-04-01T19:36:35.805 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.805 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d637a8a:::benchmark_data_smithi188_104537_object122183:head# 2024-04-01T19:36:35.805 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.806 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d64f589:::benchmark_data_smithi188_104537_object45047:head# 2024-04-01T19:36:35.806 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.808 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d654319:::benchmark_data_smithi188_104537_object87357:head# 2024-04-01T19:36:35.808 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.808 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d660480:::benchmark_data_smithi188_104537_object75366:head# 2024-04-01T19:36:35.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.809 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d662121:::benchmark_data_smithi188_104537_object133526:head# 2024-04-01T19:36:35.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.809 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d66217d:::benchmark_data_smithi188_104537_object18076:head# 2024-04-01T19:36:35.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.809 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d666686:::benchmark_data_smithi188_104537_object23721:head# 2024-04-01T19:36:35.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.809 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d66f7d5:::benchmark_data_smithi188_104537_object147201:head# 2024-04-01T19:36:35.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.809 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d6760cb:::benchmark_data_smithi188_104537_object38090:head# 2024-04-01T19:36:35.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.809 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d67aea8:::benchmark_data_smithi188_104537_object158247:head# 2024-04-01T19:36:35.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.810 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d68a4d1:::benchmark_data_smithi188_104537_object61180:head# 2024-04-01T19:36:35.810 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.810 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d690c02:::benchmark_data_smithi188_104537_object142111:head# 2024-04-01T19:36:35.810 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.810 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d691ddf:::benchmark_data_smithi188_104537_object74594:head# 2024-04-01T19:36:35.810 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.810 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d692583:::benchmark_data_smithi188_104537_object72609:head# 2024-04-01T19:36:35.810 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.810 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d692c59:::benchmark_data_smithi188_104537_object59094:head# 2024-04-01T19:36:35.810 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.810 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d69ec3f:::benchmark_data_smithi188_104537_object57538:head# 2024-04-01T19:36:35.810 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d69ef77:::benchmark_data_smithi188_104537_object100875:head# 2024-04-01T19:36:35.813 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.813 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d6a15d5:::benchmark_data_smithi188_104537_object78759:head# 2024-04-01T19:36:35.813 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.813 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d6b04e3:::benchmark_data_smithi188_104537_object139309:head# 2024-04-01T19:36:35.813 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.813 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d6bd7d7:::benchmark_data_smithi188_104537_object32681:head# 2024-04-01T19:36:35.813 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.813 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d6c6190:::benchmark_data_smithi188_104537_object53922:head# 2024-04-01T19:36:35.813 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.813 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d6c71c2:::benchmark_data_smithi188_104537_object31870:head# 2024-04-01T19:36:35.813 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.814 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d6d235b:::benchmark_data_smithi188_104537_object76218:head# 2024-04-01T19:36:35.814 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.814 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d6d8f01:::benchmark_data_smithi188_104537_object35128:head# 2024-04-01T19:36:35.814 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.814 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d6df7a5:::benchmark_data_smithi188_104537_object16070:head# 2024-04-01T19:36:35.814 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.814 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d6e44ce:::benchmark_data_smithi188_104537_object123329:head# 2024-04-01T19:36:35.814 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.814 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d6ec7dc:::benchmark_data_smithi188_104537_object16125:head# 2024-04-01T19:36:35.814 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.814 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d6ed0a9:::benchmark_data_smithi188_104537_object138355:head# 2024-04-01T19:36:35.814 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.815 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d6f2c7d:::benchmark_data_smithi188_104537_object120837:head# 2024-04-01T19:36:35.815 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.815 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d6f5727:::benchmark_data_smithi188_104537_object103310:head# 2024-04-01T19:36:35.815 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.815 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d6fcbd3:::benchmark_data_smithi188_104537_object162215:head# 2024-04-01T19:36:35.815 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d7149ad:::benchmark_data_smithi188_104537_object21377:head# 2024-04-01T19:36:35.818 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d719107:::benchmark_data_smithi188_104537_object161388:head# 2024-04-01T19:36:35.818 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d719fb9:::benchmark_data_smithi188_104537_object11276:head# 2024-04-01T19:36:35.818 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d71a562:::benchmark_data_smithi188_104537_object45498:head# 2024-04-01T19:36:35.818 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d72c40b:::benchmark_data_smithi188_104537_object25442:head# 2024-04-01T19:36:35.819 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.819 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d730e99:::benchmark_data_smithi188_104537_object153435:head# 2024-04-01T19:36:35.819 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.819 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d740816:::benchmark_data_smithi188_104537_object110989:head# 2024-04-01T19:36:35.819 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.819 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d7422ed:::benchmark_data_smithi188_104537_object139610:head# 2024-04-01T19:36:35.819 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.819 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d74404b:::benchmark_data_smithi188_104537_object73966:head# 2024-04-01T19:36:35.819 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.819 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d74f500:::benchmark_data_smithi188_104537_object144396:head# 2024-04-01T19:36:35.819 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.819 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d754a09:::benchmark_data_smithi188_104537_object105157:head# 2024-04-01T19:36:35.819 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.820 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d7790b5:::benchmark_data_smithi188_104537_object122080:head# 2024-04-01T19:36:35.820 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.820 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d77bd55:::benchmark_data_smithi188_104537_object114238:head# 2024-04-01T19:36:35.820 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.820 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d77e169:::benchmark_data_smithi188_104537_object91726:head# 2024-04-01T19:36:35.820 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.820 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d783157:::benchmark_data_smithi188_104537_object140191:head# 2024-04-01T19:36:35.820 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.820 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d78cd4d:::benchmark_data_smithi188_104537_object60092:head# 2024-04-01T19:36:35.820 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.820 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d7a7427:::benchmark_data_smithi188_104537_object45856:head# 2024-04-01T19:36:35.820 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.820 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d7aa750:::benchmark_data_smithi188_104537_object168993:head# 2024-04-01T19:36:35.820 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.820 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d7b2bc5:::benchmark_data_smithi188_104537_object146528:head# 2024-04-01T19:36:35.821 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.821 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d7b7980:::benchmark_data_smithi188_104537_object77355:head# 2024-04-01T19:36:35.821 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.821 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d7b7f79:::benchmark_data_smithi188_104537_object68116:head# 2024-04-01T19:36:35.821 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.821 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d7b94fe:::benchmark_data_smithi188_104537_object126989:head# 2024-04-01T19:36:35.821 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.823 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d7be926:::benchmark_data_smithi188_104537_object145132:head# 2024-04-01T19:36:35.823 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.825 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d7d2339:::benchmark_data_smithi188_104537_object88971:head# 2024-04-01T19:36:35.825 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.825 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d7e3771:::benchmark_data_smithi188_104537_object94070:head# 2024-04-01T19:36:35.825 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.825 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d7f3b15:::benchmark_data_smithi188_104537_object106968:head# 2024-04-01T19:36:35.826 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.826 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d7f849c:::benchmark_data_smithi188_104537_object60822:head# 2024-04-01T19:36:35.826 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.826 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d7fb826:::benchmark_data_smithi188_104537_object14690:head# 2024-04-01T19:36:35.826 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.827 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d807e35:::benchmark_data_smithi188_104537_object142509:head# 2024-04-01T19:36:35.827 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.827 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d80af65:::benchmark_data_smithi188_104537_object19016:head# 2024-04-01T19:36:35.827 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.827 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d811c1e:::benchmark_data_smithi188_104537_object52718:head# 2024-04-01T19:36:35.827 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.827 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d81a9cc:::benchmark_data_smithi188_104537_object54559:head# 2024-04-01T19:36:35.828 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.828 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d81f965:::benchmark_data_smithi188_104537_object66920:head# 2024-04-01T19:36:35.828 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.828 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d81fcca:::benchmark_data_smithi188_104537_object139162:head# 2024-04-01T19:36:35.828 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.829 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d82175d:::benchmark_data_smithi188_104537_object137332:head# 2024-04-01T19:36:35.829 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.829 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d828262:::benchmark_data_smithi188_104537_object25858:head# 2024-04-01T19:36:35.830 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.830 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d8321a5:::benchmark_data_smithi188_104537_object151588:head# 2024-04-01T19:36:35.830 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.830 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d8344fb:::benchmark_data_smithi188_104537_object16931:head# 2024-04-01T19:36:35.830 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.830 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d8361aa:::benchmark_data_smithi188_104537_object91297:head# 2024-04-01T19:36:35.830 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.830 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d847b8f:::benchmark_data_smithi188_104537_object108937:head# 2024-04-01T19:36:35.830 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.834 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d849b31:::benchmark_data_smithi188_104537_object166415:head# 2024-04-01T19:36:35.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.834 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d84bdc4:::benchmark_data_smithi188_104537_object37645:head# 2024-04-01T19:36:35.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.834 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d85153a:::benchmark_data_smithi188_104537_object54738:head# 2024-04-01T19:36:35.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.834 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d8518a0:::benchmark_data_smithi188_104537_object154610:head# 2024-04-01T19:36:35.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.836 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d8551fe:::benchmark_data_smithi188_104537_object131058:head# 2024-04-01T19:36:35.836 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.836 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d8590af:::benchmark_data_smithi188_104537_object24022:head# 2024-04-01T19:36:35.836 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.836 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d8666ce:::benchmark_data_smithi188_104537_object134854:head# 2024-04-01T19:36:35.836 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.836 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d86e7dc:::benchmark_data_smithi188_104537_object15989:head# 2024-04-01T19:36:35.836 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.836 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d871f24:::benchmark_data_smithi188_104537_object76370:head# 2024-04-01T19:36:35.836 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.836 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d875331:::benchmark_data_smithi188_104537_object126574:head# 2024-04-01T19:36:35.837 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.837 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d8801a9:::benchmark_data_smithi188_104537_object113474:head# 2024-04-01T19:36:35.837 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.845 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d8a4419:::benchmark_data_smithi188_104537_object64276:head# 2024-04-01T19:36:35.846 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.846 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d8a9762:::benchmark_data_smithi188_104537_object72763:head# 2024-04-01T19:36:35.846 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.846 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d8bbb73:::benchmark_data_smithi188_104537_object36354:head# 2024-04-01T19:36:35.846 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.846 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d8be33c:::benchmark_data_smithi188_104537_object168524:head# 2024-04-01T19:36:35.846 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.846 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d8c4a98:::benchmark_data_smithi188_104537_object139787:head# 2024-04-01T19:36:35.846 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.846 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d8c9402:::benchmark_data_smithi188_104537_object82992:head# 2024-04-01T19:36:35.846 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.850 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d8d31b8:::benchmark_data_smithi188_104537_object153119:head# 2024-04-01T19:36:35.850 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.850 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d8e5014:::benchmark_data_smithi188_104537_object35262:head# 2024-04-01T19:36:35.850 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.850 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d8ef839:::benchmark_data_smithi188_104537_object58353:head# 2024-04-01T19:36:35.850 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.851 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d8fe275:::benchmark_data_smithi188_104537_object145438:head# 2024-04-01T19:36:35.851 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.851 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d90570b:::benchmark_data_smithi188_104537_object127284:head# 2024-04-01T19:36:35.851 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.851 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d908e5b:::benchmark_data_smithi188_104537_object77597:head# 2024-04-01T19:36:35.851 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.851 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d90c51c:::benchmark_data_smithi188_104537_object145745:head# 2024-04-01T19:36:35.851 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.851 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d90f775:::benchmark_data_smithi188_104537_object50039:head# 2024-04-01T19:36:35.851 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.851 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d915245:::benchmark_data_smithi188_104537_object155888:head# 2024-04-01T19:36:35.851 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.852 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d91b541:::benchmark_data_smithi188_104537_object16294:head# 2024-04-01T19:36:35.852 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.852 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d91e305:::benchmark_data_smithi188_104537_object57254:head# 2024-04-01T19:36:35.852 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.852 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d920caa:::benchmark_data_smithi188_104537_object67702:head# 2024-04-01T19:36:35.852 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.852 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d922d2d:::benchmark_data_smithi188_104537_object89043:head# 2024-04-01T19:36:35.852 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.852 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d925f57:::benchmark_data_smithi188_104537_object77123:head# 2024-04-01T19:36:35.852 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.852 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d934d21:::benchmark_data_smithi188_104537_object66812:head# 2024-04-01T19:36:35.852 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.852 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d93e500:::benchmark_data_smithi188_104537_object60676:head# 2024-04-01T19:36:35.852 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.853 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d961ff6:::benchmark_data_smithi188_104537_object121133:head# 2024-04-01T19:36:35.853 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.854 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d962a0f:::benchmark_data_smithi188_104537_object100810:head# 2024-04-01T19:36:35.854 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.855 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d963adc:::benchmark_data_smithi188_104537_object82497:head# 2024-04-01T19:36:35.855 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.855 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d965148:::benchmark_data_smithi188_104537_object34793:head# 2024-04-01T19:36:35.855 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.855 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d96d3a2:::benchmark_data_smithi188_104537_object98675:head# 2024-04-01T19:36:35.855 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.855 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d97541b:::benchmark_data_smithi188_104537_object138173:head# 2024-04-01T19:36:35.855 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.855 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d97aa33:::benchmark_data_smithi188_104537_object155981:head# 2024-04-01T19:36:35.855 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.855 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d97de12:::benchmark_data_smithi188_104537_object168830:head# 2024-04-01T19:36:35.855 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.856 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d9850f8:::benchmark_data_smithi188_104537_object95486:head# 2024-04-01T19:36:35.856 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.856 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d98cdb6:::benchmark_data_smithi188_104537_object84988:head# 2024-04-01T19:36:35.856 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.856 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d994ce3:::benchmark_data_smithi188_104537_object127635:head# 2024-04-01T19:36:35.856 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.856 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d99d3a3:::benchmark_data_smithi188_104537_object42347:head# 2024-04-01T19:36:35.856 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.856 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d9afdba:::benchmark_data_smithi188_104537_object37515:head# 2024-04-01T19:36:35.856 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.856 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d9b2eae:::benchmark_data_smithi188_104537_object106930:head# 2024-04-01T19:36:35.856 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.858 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d9b7853:::benchmark_data_smithi188_104537_object120979:head# 2024-04-01T19:36:35.859 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.859 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d9bd3e4:::benchmark_data_smithi188_104537_object90759:head# 2024-04-01T19:36:35.859 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.859 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d9bd968:::benchmark_data_smithi188_104537_object132708:head# 2024-04-01T19:36:35.859 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.859 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d9bdf72:::benchmark_data_smithi188_104537_object158932:head# 2024-04-01T19:36:35.859 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.859 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d9c6f65:::benchmark_data_smithi188_104537_object47810:head# 2024-04-01T19:36:35.859 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.859 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d9c8544:::benchmark_data_smithi188_104537_object107812:head# 2024-04-01T19:36:35.859 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.859 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d9ce191:::benchmark_data_smithi188_104537_object170216:head# 2024-04-01T19:36:35.859 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.860 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d9ce99f:::benchmark_data_smithi188_104537_object156559:head# 2024-04-01T19:36:35.860 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.860 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d9e038e:::benchmark_data_smithi188_104537_object87151:head# 2024-04-01T19:36:35.860 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.860 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d9e6c58:::benchmark_data_smithi188_104537_object41620:head# 2024-04-01T19:36:35.860 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.860 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d9f17e8:::benchmark_data_smithi188_104537_object108046:head# 2024-04-01T19:36:35.860 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.860 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5d9f31da:::benchmark_data_smithi188_104537_object46483:head# 2024-04-01T19:36:35.860 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.860 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da10591:::benchmark_data_smithi188_104537_object161852:head# 2024-04-01T19:36:35.860 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.860 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da10a19:::benchmark_data_smithi188_104537_object122015:head# 2024-04-01T19:36:35.860 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.861 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da13b19:::benchmark_data_smithi188_104537_object120072:head# 2024-04-01T19:36:35.861 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.861 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da1400f:::benchmark_data_smithi188_104537_object12558:head# 2024-04-01T19:36:35.861 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.861 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:36:35.865 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da1cb37:::benchmark_data_smithi188_104537_object52938:head# 2024-04-01T19:36:35.865 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.865 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da1e005:::benchmark_data_smithi188_104537_object143272:head# 2024-04-01T19:36:35.865 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.865 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da234d9:::benchmark_data_smithi188_104537_object41750:head# 2024-04-01T19:36:35.865 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.865 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da287fe:::benchmark_data_smithi188_104537_object19762:head# 2024-04-01T19:36:35.865 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.865 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da2d858:::benchmark_data_smithi188_104537_object119793:head# 2024-04-01T19:36:35.865 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.865 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da30088:::benchmark_data_smithi188_104537_object101469:head# 2024-04-01T19:36:35.866 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.866 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da33001:::benchmark_data_smithi188_104537_object94086:head# 2024-04-01T19:36:35.866 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.866 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da3688a:::benchmark_data_smithi188_104537_object163020:head# 2024-04-01T19:36:35.866 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.866 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da4414e:::benchmark_data_smithi188_104537_object80609:head# 2024-04-01T19:36:35.866 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.866 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da45c55:::benchmark_data_smithi188_104537_object37947:head# 2024-04-01T19:36:35.866 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.866 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da4a44b:::benchmark_data_smithi188_104537_object14755:head# 2024-04-01T19:36:35.866 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.866 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da552a9:::benchmark_data_smithi188_104537_object16820:head# 2024-04-01T19:36:35.866 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.866 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da5a8b5:::benchmark_data_smithi188_104537_object35952:head# 2024-04-01T19:36:35.867 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.867 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da5edd1:::benchmark_data_smithi188_104537_object149497:head# 2024-04-01T19:36:35.867 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.867 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da5eef8:::benchmark_data_smithi188_104537_object158446:head# 2024-04-01T19:36:35.867 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.867 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da5efaa:::benchmark_data_smithi188_104537_object38651:head# 2024-04-01T19:36:35.867 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.867 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da6dd5b:::benchmark_data_smithi188_104537_object79620:head# 2024-04-01T19:36:35.867 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.867 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da74ae6:::benchmark_data_smithi188_104537_object48601:head# 2024-04-01T19:36:35.867 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.867 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da86515:::benchmark_data_smithi188_104537_object139271:head# 2024-04-01T19:36:35.867 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.868 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da87829:::benchmark_data_smithi188_104537_object149906:head# 2024-04-01T19:36:35.868 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.868 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da8867b:::benchmark_data_smithi188_104537_object159290:head# 2024-04-01T19:36:35.868 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.868 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da89d6f:::benchmark_data_smithi188_104537_object145296:head# 2024-04-01T19:36:35.868 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.868 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da8d981:::benchmark_data_smithi188_104537_object170070:head# 2024-04-01T19:36:35.868 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.868 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da8f478:::benchmark_data_smithi188_104537_object14156:head# 2024-04-01T19:36:35.868 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.872 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da90438:::benchmark_data_smithi188_104537_object158199:head# 2024-04-01T19:36:35.872 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.872 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5da9f2c1:::benchmark_data_smithi188_104537_object115944:head# 2024-04-01T19:36:35.872 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.872 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5daa42d6:::benchmark_data_smithi188_104537_object48311:head# 2024-04-01T19:36:35.872 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.872 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dab16d8:::benchmark_data_smithi188_104537_object150354:head# 2024-04-01T19:36:35.872 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.873 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dab25a7:::benchmark_data_smithi188_104537_object71515:head# 2024-04-01T19:36:35.873 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.873 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dabcded:::benchmark_data_smithi188_104537_object80656:head# 2024-04-01T19:36:35.873 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.873 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dabdbc7:::benchmark_data_smithi188_104537_object19525:head# 2024-04-01T19:36:35.873 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.873 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dac4fde:::benchmark_data_smithi188_104537_object111938:head# 2024-04-01T19:36:35.873 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.873 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dac9e82:::benchmark_data_smithi188_104537_object95282:head# 2024-04-01T19:36:35.873 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.873 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dacb8bd:::benchmark_data_smithi188_104537_object156496:head# 2024-04-01T19:36:35.873 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.873 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dacc965:::benchmark_data_smithi188_104537_object92849:head# 2024-04-01T19:36:35.873 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.874 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dad0508:::benchmark_data_smithi188_104537_object59810:head# 2024-04-01T19:36:35.874 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.874 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dad7189:::benchmark_data_smithi188_104537_object106158:head# 2024-04-01T19:36:35.874 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.874 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dad7cab:::benchmark_data_smithi188_104537_object80412:head# 2024-04-01T19:36:35.874 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.874 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dad9c5c:::benchmark_data_smithi188_104537_object17737:head# 2024-04-01T19:36:35.874 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.874 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5daecb76:::benchmark_data_smithi188_104537_object95752:head# 2024-04-01T19:36:35.874 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.874 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5db04ca2:::benchmark_data_smithi188_104537_object120585:head# 2024-04-01T19:36:35.874 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.875 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5db0a2c5:::benchmark_data_smithi188_104537_object153305:head# 2024-04-01T19:36:35.875 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.875 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5db0aa3f:::benchmark_data_smithi188_104537_object25775:head# 2024-04-01T19:36:35.875 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.875 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5db18eea:::benchmark_data_smithi188_104537_object53096:head# 2024-04-01T19:36:35.875 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.878 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5db1c79a:::benchmark_data_smithi188_104537_object43956:head# 2024-04-01T19:36:35.878 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.878 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5db24ec8:::benchmark_data_smithi188_104537_object52535:head# 2024-04-01T19:36:35.878 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.886 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5db2d81b:::benchmark_data_smithi188_104537_object41989:head# 2024-04-01T19:36:35.886 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.888 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5db427d2:::benchmark_data_smithi188_104537_object134473:head# 2024-04-01T19:36:35.888 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.889 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5db467d9:::benchmark_data_smithi188_104537_object161514:head# 2024-04-01T19:36:35.889 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.889 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5db4a7cd:::benchmark_data_smithi188_104537_object97071:head# 2024-04-01T19:36:35.889 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.889 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5db59ce6:::benchmark_data_smithi188_104537_object166729:head# 2024-04-01T19:36:35.889 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.889 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5db59ff9:::benchmark_data_smithi188_104537_object120902:head# 2024-04-01T19:36:35.889 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.889 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5db5b309:::benchmark_data_smithi188_104537_object56198:head# 2024-04-01T19:36:35.889 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.889 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5db5b8c3:::benchmark_data_smithi188_104537_object129650:head# 2024-04-01T19:36:35.889 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.890 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5db5c490:::benchmark_data_smithi188_104537_object153963:head# 2024-04-01T19:36:35.890 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.890 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5db5c912:::benchmark_data_smithi188_104537_object163143:head# 2024-04-01T19:36:35.890 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.890 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5db5d4cd:::benchmark_data_smithi188_104537_object167128:head# 2024-04-01T19:36:35.890 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.890 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5db60c08:::benchmark_data_smithi188_104537_object15629:head# 2024-04-01T19:36:35.890 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.891 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5db66ace:::benchmark_data_smithi188_104537_object154141:head# 2024-04-01T19:36:35.891 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.891 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5db67bcd:::benchmark_data_smithi188_104537_object15633:head# 2024-04-01T19:36:35.891 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.891 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5db7d560:::benchmark_data_smithi188_104537_object135638:head# 2024-04-01T19:36:35.891 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.891 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5db875bf:::benchmark_data_smithi188_104537_object46898:head# 2024-04-01T19:36:35.892 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.896 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5db8b62b:::benchmark_data_smithi188_104537_object163403:head# 2024-04-01T19:36:35.896 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.896 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dba3a43:::benchmark_data_smithi188_104537_object151653:head# 2024-04-01T19:36:35.896 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.896 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dbabdd9:::benchmark_data_smithi188_104537_object26166:head# 2024-04-01T19:36:35.896 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.897 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dbacb36:::benchmark_data_smithi188_104537_object117295:head# 2024-04-01T19:36:35.897 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.897 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dbb7348:::benchmark_data_smithi188_104537_object32114:head# 2024-04-01T19:36:35.897 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.897 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dbc4e12:::benchmark_data_smithi188_104537_object151624:head# 2024-04-01T19:36:35.897 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.898 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dbc7ca5:::benchmark_data_smithi188_104537_object147083:head# 2024-04-01T19:36:35.898 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.898 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dbc95f0:::benchmark_data_smithi188_104537_object92920:head# 2024-04-01T19:36:35.898 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.898 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dbdbb6b:::benchmark_data_smithi188_104537_object21610:head# 2024-04-01T19:36:35.898 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.902 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dbe6e73:::benchmark_data_smithi188_104537_object89457:head# 2024-04-01T19:36:35.903 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.903 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dbe99f0:::benchmark_data_smithi188_104537_object113420:head# 2024-04-01T19:36:35.903 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.903 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dbeaf64:::benchmark_data_smithi188_104537_object67812:head# 2024-04-01T19:36:35.903 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.903 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dbeeec7:::benchmark_data_smithi188_104537_object144924:head# 2024-04-01T19:36:35.903 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.903 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dbf0df1:::benchmark_data_smithi188_104537_object45279:head# 2024-04-01T19:36:35.903 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.903 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dbf0e85:::benchmark_data_smithi188_104537_object49575:head# 2024-04-01T19:36:35.903 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.903 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dbf5a25:::benchmark_data_smithi188_104537_object134060:head# 2024-04-01T19:36:35.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.904 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dbfd8b8:::benchmark_data_smithi188_104537_object43043:head# 2024-04-01T19:36:35.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.904 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dbfefa4:::benchmark_data_smithi188_104537_object69516:head# 2024-04-01T19:36:35.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.904 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dc04619:::benchmark_data_smithi188_104537_object46710:head# 2024-04-01T19:36:35.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.904 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dc059b8:::benchmark_data_smithi188_104537_object145960:head# 2024-04-01T19:36:35.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.904 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dc0c6d0:::benchmark_data_smithi188_104537_object123059:head# 2024-04-01T19:36:35.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.904 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dc0ef65:::benchmark_data_smithi188_104537_object103134:head# 2024-04-01T19:36:35.905 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.905 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dc116e7:::benchmark_data_smithi188_104537_object37066:head# 2024-04-01T19:36:35.905 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.905 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dc15e3f:::benchmark_data_smithi188_104537_object160905:head# 2024-04-01T19:36:35.905 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.907 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dc16745:::benchmark_data_smithi188_104537_object146152:head# 2024-04-01T19:36:35.907 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.907 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dc1d452:::benchmark_data_smithi188_104537_object164243:head# 2024-04-01T19:36:35.907 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.907 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dc20dfd:::benchmark_data_smithi188_104537_object19735:head# 2024-04-01T19:36:35.907 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.907 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dc265c5:::benchmark_data_smithi188_104537_object159371:head# 2024-04-01T19:36:35.908 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.908 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dc2e125:::benchmark_data_smithi188_104537_object89005:head# 2024-04-01T19:36:35.908 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.908 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dc2eb7b:::benchmark_data_smithi188_104537_object54915:head# 2024-04-01T19:36:35.908 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.908 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dc3dea3:::benchmark_data_smithi188_104537_object94598:head# 2024-04-01T19:36:35.908 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.908 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dc52c8e:::benchmark_data_smithi188_104537_object147327:head# 2024-04-01T19:36:35.908 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.908 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dc55b7f:::benchmark_data_smithi188_104537_object156241:head# 2024-04-01T19:36:35.908 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.908 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dc5edb4:::benchmark_data_smithi188_104537_object124335:head# 2024-04-01T19:36:35.908 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.908 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dc6deef:::benchmark_data_smithi188_104537_object15780:head# 2024-04-01T19:36:35.908 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.909 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dc80db5:::benchmark_data_smithi188_104537_object134310:head# 2024-04-01T19:36:35.909 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.909 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dc88290:::benchmark_data_smithi188_104537_object112139:head# 2024-04-01T19:36:35.909 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.911 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:35.912 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dc91615:::benchmark_data_smithi188_104537_object142689:head# 2024-04-01T19:36:35.912 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.912 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dc93661:::benchmark_data_smithi188_104537_object47955:head# 2024-04-01T19:36:35.912 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.913 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dc95752:::benchmark_data_smithi188_104537_object38398:head# 2024-04-01T19:36:35.913 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.913 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dc9a39e:::benchmark_data_smithi188_104537_object41189:head# 2024-04-01T19:36:35.913 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.913 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dc9b261:::benchmark_data_smithi188_104537_object40421:head# 2024-04-01T19:36:35.914 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.914 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dc9b539:::benchmark_data_smithi188_104537_object23549:head# 2024-04-01T19:36:35.914 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.916 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dca1594:::benchmark_data_smithi188_104537_object94565:head# 2024-04-01T19:36:35.916 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.917 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dca4934:::benchmark_data_smithi188_104537_object122000:head# 2024-04-01T19:36:35.917 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.917 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dca5e87:::benchmark_data_smithi188_104537_object48405:head# 2024-04-01T19:36:35.917 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.917 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dcb326f:::benchmark_data_smithi188_104537_object163001:head# 2024-04-01T19:36:35.917 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.917 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dcbc37a:::benchmark_data_smithi188_104537_object84671:head# 2024-04-01T19:36:35.917 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.917 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dcbc5a7:::benchmark_data_smithi188_104537_object17435:head# 2024-04-01T19:36:35.917 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.917 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dcc821b:::benchmark_data_smithi188_104537_object76453:head# 2024-04-01T19:36:35.917 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.918 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dcde385:::benchmark_data_smithi188_104537_object20136:head# 2024-04-01T19:36:35.918 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.918 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dce2f22:::benchmark_data_smithi188_104537_object132062:head# 2024-04-01T19:36:35.918 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.918 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dcea6fa:::benchmark_data_smithi188_104537_object12774:head# 2024-04-01T19:36:35.918 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.918 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dcecf8a:::benchmark_data_smithi188_104537_object68324:head# 2024-04-01T19:36:35.918 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.918 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dcf88aa:::benchmark_data_smithi188_104537_object43700:head# 2024-04-01T19:36:35.918 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.920 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd036fb:::benchmark_data_smithi188_104537_object116570:head# 2024-04-01T19:36:35.920 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.920 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd09a93:::benchmark_data_smithi188_104537_object64112:head# 2024-04-01T19:36:35.920 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.920 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd0d49d:::benchmark_data_smithi188_104537_object20572:head# 2024-04-01T19:36:35.921 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.921 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd1af7c:::benchmark_data_smithi188_104537_object125282:head# 2024-04-01T19:36:35.921 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.921 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd1e666:::benchmark_data_smithi188_104537_object163711:head# 2024-04-01T19:36:35.921 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.921 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd2c2a5:::benchmark_data_smithi188_104537_object108088:head# 2024-04-01T19:36:35.921 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.921 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd30ba5:::benchmark_data_smithi188_104537_object139505:head# 2024-04-01T19:36:35.921 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.921 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd314ff:::benchmark_data_smithi188_104537_object44021:head# 2024-04-01T19:36:35.922 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.922 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd3b1c5:::benchmark_data_smithi188_104537_object61817:head# 2024-04-01T19:36:35.922 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.922 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd414b3:::benchmark_data_smithi188_104537_object166169:head# 2024-04-01T19:36:35.922 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.922 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd44ef0:::benchmark_data_smithi188_104537_object152023:head# 2024-04-01T19:36:35.922 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.922 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd462c4:::benchmark_data_smithi188_104537_object110831:head# 2024-04-01T19:36:35.922 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.922 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd518d6:::benchmark_data_smithi188_104537_object38438:head# 2024-04-01T19:36:35.922 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.923 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:36:35.923 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:36:35.923 INFO:teuthology.orchestra.run.smithi062.stdout: "complaint_time": 30, 2024-04-01T19:36:35.923 INFO:teuthology.orchestra.run.smithi062.stdout: "num_blocked_ops": 0 2024-04-01T19:36:35.923 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:36:35.927 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd566cb:::benchmark_data_smithi188_104537_object31042:head# 2024-04-01T19:36:35.927 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.927 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd57efd:::benchmark_data_smithi188_104537_object103466:head# 2024-04-01T19:36:35.927 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.927 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd5b9c1:::benchmark_data_smithi188_104537_object34085:head# 2024-04-01T19:36:35.927 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.927 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd5e121:::benchmark_data_smithi188_104537_object141584:head# 2024-04-01T19:36:35.927 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.927 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd65679:::benchmark_data_smithi188_104537_object141442:head# 2024-04-01T19:36:35.927 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.928 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd6c53a:::benchmark_data_smithi188_104537_object117638:head# 2024-04-01T19:36:35.928 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.928 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd6f103:::benchmark_data_smithi188_104537_object40788:head# 2024-04-01T19:36:35.928 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.928 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd7174c:::benchmark_data_smithi188_104537_object77230:head# 2024-04-01T19:36:35.928 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.928 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd81f82:::benchmark_data_smithi188_104537_object115403:head# 2024-04-01T19:36:35.928 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.928 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd89a6b:::benchmark_data_smithi188_104537_object130848:head# 2024-04-01T19:36:35.928 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.928 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd8f5aa:::benchmark_data_smithi188_104537_object37888:head# 2024-04-01T19:36:35.929 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.929 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd909ca:::benchmark_data_smithi188_104537_object37406:head# 2024-04-01T19:36:35.929 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.929 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd90dd4:::benchmark_data_smithi188_104537_object80640:head# 2024-04-01T19:36:35.929 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.929 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dd9abb6:::benchmark_data_smithi188_104537_object95270:head# 2024-04-01T19:36:35.929 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.929 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dda1a35:::benchmark_data_smithi188_104537_object164520:head# 2024-04-01T19:36:35.929 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.929 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dda4442:::benchmark_data_smithi188_104537_object42553:head# 2024-04-01T19:36:35.929 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.929 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ddab528:::benchmark_data_smithi188_104537_object58218:head# 2024-04-01T19:36:35.930 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.930 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ddb4e52:::benchmark_data_smithi188_104537_object15541:head# 2024-04-01T19:36:35.930 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.930 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ddbafd2:::benchmark_data_smithi188_104537_object52972:head# 2024-04-01T19:36:35.930 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.930 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ddc4425:::benchmark_data_smithi188_104537_object16102:head# 2024-04-01T19:36:35.930 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.930 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ddd8b44:::benchmark_data_smithi188_104537_object111920:head# 2024-04-01T19:36:35.930 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.930 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ddd9d1e:::benchmark_data_smithi188_104537_object69954:head# 2024-04-01T19:36:35.930 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.931 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dde6542:::benchmark_data_smithi188_104537_object15650:head# 2024-04-01T19:36:35.931 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.933 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ddf459f:::benchmark_data_smithi188_104537_object18869:head# 2024-04-01T19:36:35.933 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.933 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5de09aca:::benchmark_data_smithi188_104537_object164455:head# 2024-04-01T19:36:35.933 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.933 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5de0d925:::benchmark_data_smithi188_104537_object141939:head# 2024-04-01T19:36:35.933 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.933 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5de0fb00:::benchmark_data_smithi188_104537_object165326:head# 2024-04-01T19:36:35.933 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.933 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5de101ad:::benchmark_data_smithi188_104537_object121479:head# 2024-04-01T19:36:35.933 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.934 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5de1256d:::benchmark_data_smithi188_104537_object149043:head# 2024-04-01T19:36:35.934 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.934 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5de144f6:::benchmark_data_smithi188_104537_object32570:head# 2024-04-01T19:36:35.934 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.934 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5de19293:::benchmark_data_smithi188_104537_object92037:head# 2024-04-01T19:36:35.934 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.934 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5de192ef:::benchmark_data_smithi188_104537_object114415:head# 2024-04-01T19:36:35.934 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.934 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5de1ecb4:::benchmark_data_smithi188_104537_object76162:head# 2024-04-01T19:36:35.934 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.934 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5de2a3a6:::benchmark_data_smithi188_104537_object109966:head# 2024-04-01T19:36:35.934 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.934 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5de4096c:::benchmark_data_smithi188_104537_object140555:head# 2024-04-01T19:36:35.934 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5de457ab:::benchmark_data_smithi188_104537_object44118:head# 2024-04-01T19:36:35.935 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5de6327a:::benchmark_data_smithi188_104537_object41452:head# 2024-04-01T19:36:35.935 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5de7d08a:::benchmark_data_smithi188_104537_object109429:head# 2024-04-01T19:36:35.935 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5de7fead:::benchmark_data_smithi188_104537_object72690:head# 2024-04-01T19:36:35.935 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5de85ed1:::benchmark_data_smithi188_104537_object108180:head# 2024-04-01T19:36:35.935 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.936 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5de96a02:::benchmark_data_smithi188_104537_object11942:head# 2024-04-01T19:36:35.936 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.936 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dea4944:::benchmark_data_smithi188_104537_object39334:head# 2024-04-01T19:36:35.937 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.937 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dea86b5:::benchmark_data_smithi188_104537_object74854:head# 2024-04-01T19:36:35.937 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.937 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5deaf3b9:::benchmark_data_smithi188_104537_object30220:head# 2024-04-01T19:36:35.937 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.937 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dec0621:::benchmark_data_smithi188_104537_object102430:head# 2024-04-01T19:36:35.937 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.937 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dec2445:::benchmark_data_smithi188_104537_object71456:head# 2024-04-01T19:36:35.937 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.937 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dec2b4f:::benchmark_data_smithi188_104537_object57623:head# 2024-04-01T19:36:35.937 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.937 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ded45d4:::benchmark_data_smithi188_104537_object59441:head# 2024-04-01T19:36:35.937 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.938 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dedaf52:::benchmark_data_smithi188_104537_object113051:head# 2024-04-01T19:36:35.938 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.938 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dedbc1b:::benchmark_data_smithi188_104537_object160658:head# 2024-04-01T19:36:35.938 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.938 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dee431e:::benchmark_data_smithi188_104537_object13695:head# 2024-04-01T19:36:35.938 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.938 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dee4fe5:::benchmark_data_smithi188_104537_object89566:head# 2024-04-01T19:36:35.938 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.938 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dee766c:::benchmark_data_smithi188_104537_object154284:head# 2024-04-01T19:36:35.938 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.938 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dee7cbb:::benchmark_data_smithi188_104537_object102711:head# 2024-04-01T19:36:35.938 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.938 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5deeab1e:::benchmark_data_smithi188_104537_object153767:head# 2024-04-01T19:36:35.939 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.939 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5defa5fa:::benchmark_data_smithi188_104537_object113812:head# 2024-04-01T19:36:35.939 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.939 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5defb437:::benchmark_data_smithi188_104537_object30779:head# 2024-04-01T19:36:35.939 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.939 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df0d9a9:::benchmark_data_smithi188_104537_object27244:head# 2024-04-01T19:36:35.939 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.939 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df12580:::benchmark_data_smithi188_104537_object23739:head# 2024-04-01T19:36:35.939 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.940 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df173dd:::benchmark_data_smithi188_104537_object56272:head# 2024-04-01T19:36:35.940 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.940 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df19708:::benchmark_data_smithi188_104537_object150723:head# 2024-04-01T19:36:35.940 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.940 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df1998f:::benchmark_data_smithi188_104537_object115983:head# 2024-04-01T19:36:35.940 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.940 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df1b577:::benchmark_data_smithi188_104537_object78085:head# 2024-04-01T19:36:35.940 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.941 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df1d87f:::benchmark_data_smithi188_104537_object167367:head# 2024-04-01T19:36:35.942 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.946 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df270a7:::benchmark_data_smithi188_104537_object164459:head# 2024-04-01T19:36:35.946 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.948 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df2c760:::benchmark_data_smithi188_104537_object34297:head# 2024-04-01T19:36:35.948 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.948 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df307bb:::benchmark_data_smithi188_104537_object26493:head# 2024-04-01T19:36:35.948 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.948 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df308b2:::benchmark_data_smithi188_104537_object28621:head# 2024-04-01T19:36:35.948 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.948 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df3ea88:::benchmark_data_smithi188_104537_object136313:head# 2024-04-01T19:36:35.949 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.949 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df3fee7:::benchmark_data_smithi188_104537_object83363:head# 2024-04-01T19:36:35.949 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.949 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df4d9f0:::benchmark_data_smithi188_104537_object115815:head# 2024-04-01T19:36:35.949 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.950 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df52db2:::benchmark_data_smithi188_104537_object123008:head# 2024-04-01T19:36:35.950 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.950 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df5622d:::benchmark_data_smithi188_104537_object49676:head# 2024-04-01T19:36:35.950 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.950 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df62ee4:::benchmark_data_smithi188_104537_object113236:head# 2024-04-01T19:36:35.951 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.951 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df64918:::benchmark_data_smithi188_104537_object66888:head# 2024-04-01T19:36:35.951 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.951 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df6adb1:::benchmark_data_smithi188_104537_object111064:head# 2024-04-01T19:36:35.951 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.951 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df6c9b8:::benchmark_data_smithi188_104537_object166715:head# 2024-04-01T19:36:35.951 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.951 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df76219:::benchmark_data_smithi188_104537_object17733:head# 2024-04-01T19:36:35.951 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.951 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df80d2b:::benchmark_data_smithi188_104537_object45515:head# 2024-04-01T19:36:35.951 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.954 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df811ba:::benchmark_data_smithi188_104537_object159251:head# 2024-04-01T19:36:35.954 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.954 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df87061:::benchmark_data_smithi188_104537_object85041:head# 2024-04-01T19:36:35.954 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.954 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df899d8:::benchmark_data_smithi188_104537_object149832:head# 2024-04-01T19:36:35.954 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.954 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df8a9f8:::benchmark_data_smithi188_104537_object21604:head# 2024-04-01T19:36:35.954 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.954 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df943e6:::benchmark_data_smithi188_104537_object97421:head# 2024-04-01T19:36:35.954 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.954 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df975f7:::benchmark_data_smithi188_104537_object32638:head# 2024-04-01T19:36:35.954 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5df98784:::benchmark_data_smithi188_104537_object170128:head# 2024-04-01T19:36:35.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dfb510e:::benchmark_data_smithi188_104537_object149306:head# 2024-04-01T19:36:35.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dfb9372:::benchmark_data_smithi188_104537_object41419:head# 2024-04-01T19:36:35.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dfc7c08:::benchmark_data_smithi188_104537_object95429:head# 2024-04-01T19:36:35.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dfcbfa7:::benchmark_data_smithi188_104537_object21986:head# 2024-04-01T19:36:35.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dfd603e:::benchmark_data_smithi188_104537_object170971:head# 2024-04-01T19:36:35.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dfe32d1:::benchmark_data_smithi188_104537_object19195:head# 2024-04-01T19:36:35.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.959 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dfe38ff:::benchmark_data_smithi188_104537_object69178:head# 2024-04-01T19:36:35.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dfe8f19:::benchmark_data_smithi188_104537_object48109:head# 2024-04-01T19:36:35.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dfeab74:::benchmark_data_smithi188_104537_object113329:head# 2024-04-01T19:36:35.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dfee924:::benchmark_data_smithi188_104537_object28590:head# 2024-04-01T19:36:35.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5dff8548:::benchmark_data_smithi188_104537_object76495:head# 2024-04-01T19:36:35.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e005aa5:::benchmark_data_smithi188_104537_object17866:head# 2024-04-01T19:36:35.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e00aa1a:::benchmark_data_smithi188_104537_object105836:head# 2024-04-01T19:36:35.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.961 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e01aae5:::benchmark_data_smithi188_104537_object163833:head# 2024-04-01T19:36:35.961 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.961 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e01ac25:::benchmark_data_smithi188_104537_object119886:head# 2024-04-01T19:36:35.961 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.961 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e023031:::benchmark_data_smithi188_104537_object15746:head# 2024-04-01T19:36:35.961 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.961 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0271aa:::benchmark_data_smithi188_104537_object124817:head# 2024-04-01T19:36:35.961 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.961 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0287b1:::benchmark_data_smithi188_104537_object133356:head# 2024-04-01T19:36:35.961 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.961 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e02f69b:::benchmark_data_smithi188_104537_object127561:head# 2024-04-01T19:36:35.961 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.961 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e03e3f3:::benchmark_data_smithi188_104537_object117243:head# 2024-04-01T19:36:35.962 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.962 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0404bf:::benchmark_data_smithi188_104537_object73735:head# 2024-04-01T19:36:35.962 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.962 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0408c4:::benchmark_data_smithi188_104537_object85896:head# 2024-04-01T19:36:35.962 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.962 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e044ee0:::benchmark_data_smithi188_104537_object87016:head# 2024-04-01T19:36:35.962 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.962 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e054166:::benchmark_data_smithi188_104537_object36568:head# 2024-04-01T19:36:35.962 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.962 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e05b0b9:::benchmark_data_smithi188_104537_object104761:head# 2024-04-01T19:36:35.962 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.962 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e05b3d1:::benchmark_data_smithi188_104537_object46668:head# 2024-04-01T19:36:35.963 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.963 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e066d3f:::benchmark_data_smithi188_104537_object64249:head# 2024-04-01T19:36:35.963 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.963 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e068e14:::benchmark_data_smithi188_104537_object127249:head# 2024-04-01T19:36:35.963 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.965 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0708d7:::benchmark_data_smithi188_104537_object106927:head# 2024-04-01T19:36:35.965 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.965 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e07c174:::benchmark_data_smithi188_104537_object27923:head# 2024-04-01T19:36:35.965 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.966 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e07c7e5:::benchmark_data_smithi188_104537_object89865:head# 2024-04-01T19:36:35.966 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.966 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0853e5:::benchmark_data_smithi188_104537_object86714:head# 2024-04-01T19:36:35.966 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.966 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e08a9b7:::benchmark_data_smithi188_104537_object44706:head# 2024-04-01T19:36:35.966 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.966 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0976d5:::benchmark_data_smithi188_104537_object26562:head# 2024-04-01T19:36:35.966 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.966 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0a4dfc:::benchmark_data_smithi188_104537_object162912:head# 2024-04-01T19:36:35.966 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.966 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0b4f8d:::benchmark_data_smithi188_104537_object66653:head# 2024-04-01T19:36:35.966 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.966 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0bac41:::benchmark_data_smithi188_104537_object60269:head# 2024-04-01T19:36:35.967 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.967 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0bc931:::benchmark_data_smithi188_104537_object164895:head# 2024-04-01T19:36:35.967 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.967 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0bda53:::benchmark_data_smithi188_104537_object102017:head# 2024-04-01T19:36:35.967 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.967 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0c3d88:::benchmark_data_smithi188_104537_object112402:head# 2024-04-01T19:36:35.967 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.967 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0d1dfa:::benchmark_data_smithi188_104537_object52324:head# 2024-04-01T19:36:35.967 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.968 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0d6ae3:::benchmark_data_smithi188_104537_object34193:head# 2024-04-01T19:36:35.968 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.968 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0d726e:::benchmark_data_smithi188_104537_object27470:head# 2024-04-01T19:36:35.968 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.971 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0e276b:::benchmark_data_smithi188_104537_object32787:head# 2024-04-01T19:36:35.971 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.971 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0e3288:::benchmark_data_smithi188_104537_object42353:head# 2024-04-01T19:36:35.971 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.971 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0e7a98:::benchmark_data_smithi188_104537_object54938:head# 2024-04-01T19:36:35.971 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.977 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0e7d36:::benchmark_data_smithi188_104537_object110993:head# 2024-04-01T19:36:35.977 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.980 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0ec75d:::benchmark_data_smithi188_104537_object102786:head# 2024-04-01T19:36:35.980 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.980 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0ef56b:::benchmark_data_smithi188_104537_object112286:head# 2024-04-01T19:36:35.981 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0f26bc:::benchmark_data_smithi188_104537_object36506:head# 2024-04-01T19:36:35.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.988 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0f31c2:::benchmark_data_smithi188_104537_object110059:head# 2024-04-01T19:36:35.988 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.989 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0f634d:::benchmark_data_smithi188_104537_object85579:head# 2024-04-01T19:36:35.989 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.989 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0f817a:::benchmark_data_smithi188_104537_object23801:head# 2024-04-01T19:36:35.989 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.990 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e0ff05d:::benchmark_data_smithi188_104537_object96295:head# 2024-04-01T19:36:35.990 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.990 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e10a45d:::benchmark_data_smithi188_104537_object136771:head# 2024-04-01T19:36:35.990 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.992 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e10fdf9:::benchmark_data_smithi188_104537_object12752:head# 2024-04-01T19:36:35.992 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.992 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e113430:::benchmark_data_smithi188_104537_object99242:head# 2024-04-01T19:36:35.992 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.992 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e115c77:::benchmark_data_smithi188_104537_object52061:head# 2024-04-01T19:36:35.992 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.992 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e11625f:::benchmark_data_smithi188_104537_object110585:head# 2024-04-01T19:36:35.992 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.993 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e126254:::benchmark_data_smithi188_104537_object19713:head# 2024-04-01T19:36:35.993 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.993 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e12802e:::benchmark_data_smithi188_104537_object145506:head# 2024-04-01T19:36:35.993 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.993 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e129a4c:::benchmark_data_smithi188_104537_object138638:head# 2024-04-01T19:36:35.993 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.994 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e12c471:::benchmark_data_smithi188_104537_object59071:head# 2024-04-01T19:36:35.994 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.994 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e132f8d:::benchmark_data_smithi188_104537_object159498:head# 2024-04-01T19:36:35.994 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.994 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e133a63:::benchmark_data_smithi188_104537_object158516:head# 2024-04-01T19:36:35.994 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.995 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e13b05c:::benchmark_data_smithi188_104537_object37265:head# 2024-04-01T19:36:35.995 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.996 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e13e7a9:::benchmark_data_smithi188_104537_object62731:head# 2024-04-01T19:36:35.996 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.996 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e13f56b:::benchmark_data_smithi188_104537_object105589:head# 2024-04-01T19:36:35.996 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.996 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e140d36:::benchmark_data_smithi188_104537_object106220:head# 2024-04-01T19:36:35.996 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.996 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e15ae74:::benchmark_data_smithi188_104537_object123208:head# 2024-04-01T19:36:35.997 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.997 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e15c759:::benchmark_data_smithi188_104537_object151850:head# 2024-04-01T19:36:35.997 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.997 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e167084:::benchmark_data_smithi188_104537_object63573:head# 2024-04-01T19:36:35.997 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.998 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e16a215:::benchmark_data_smithi188_104537_object20499:head# 2024-04-01T19:36:35.998 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.998 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e17482c:::benchmark_data_smithi188_104537_object157439:head# 2024-04-01T19:36:35.998 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.998 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e17b369:::benchmark_data_smithi188_104537_object74503:head# 2024-04-01T19:36:35.998 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.998 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e17c73b:::benchmark_data_smithi188_104537_object45565:head# 2024-04-01T19:36:35.999 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.999 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e17db83:::benchmark_data_smithi188_104537_object112130:head# 2024-04-01T19:36:35.999 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.999 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e18a76b:::benchmark_data_smithi188_104537_object68921:head# 2024-04-01T19:36:35.999 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:35.999 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e18f564:::benchmark_data_smithi188_104537_object132083:head# 2024-04-01T19:36:35.999 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.001 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e196755:::benchmark_data_smithi188_104537_object158106:head# 2024-04-01T19:36:36.001 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.001 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e19cc98:::benchmark_data_smithi188_104537_object39713:head# 2024-04-01T19:36:36.001 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.001 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e19d5fc:::benchmark_data_smithi188_104537_object96725:head# 2024-04-01T19:36:36.001 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.001 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e1a7ae4:::benchmark_data_smithi188_104537_object82297:head# 2024-04-01T19:36:36.001 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.001 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e1aff58:::benchmark_data_smithi188_104537_object72375:head# 2024-04-01T19:36:36.001 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.001 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e1b0c28:::benchmark_data_smithi188_104537_object108190:head# 2024-04-01T19:36:36.002 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.002 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e1b3f66:::benchmark_data_smithi188_104537_object146104:head# 2024-04-01T19:36:36.002 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.002 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e1b63ba:::benchmark_data_smithi188_104537_object35094:head# 2024-04-01T19:36:36.002 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.002 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e1bb3d9:::benchmark_data_smithi188_104537_object31025:head# 2024-04-01T19:36:36.002 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.002 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e1bccff:::benchmark_data_smithi188_104537_object60071:head# 2024-04-01T19:36:36.002 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.002 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e1d4a71:::benchmark_data_smithi188_104537_object47124:head# 2024-04-01T19:36:36.002 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.004 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e1d9938:::benchmark_data_smithi188_104537_object68569:head# 2024-04-01T19:36:36.004 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.004 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e1d9fbb:::benchmark_data_smithi188_104537_object132619:head# 2024-04-01T19:36:36.004 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.004 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e1dcda7:::benchmark_data_smithi188_104537_object135483:head# 2024-04-01T19:36:36.004 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.004 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e1ddf0b:::benchmark_data_smithi188_104537_object152628:head# 2024-04-01T19:36:36.004 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.005 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e1e0856:::benchmark_data_smithi188_104537_object149734:head# 2024-04-01T19:36:36.005 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.005 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e1fc308:::benchmark_data_smithi188_104537_object63414:head# 2024-04-01T19:36:36.005 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.005 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e201958:::benchmark_data_smithi188_104537_object92075:head# 2024-04-01T19:36:36.005 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.005 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e20c6c8:::benchmark_data_smithi188_104537_object47242:head# 2024-04-01T19:36:36.005 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.005 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e21a322:::benchmark_data_smithi188_104537_object72813:head# 2024-04-01T19:36:36.005 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.005 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e21c474:::benchmark_data_smithi188_104537_object48463:head# 2024-04-01T19:36:36.005 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.005 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e2238a0:::benchmark_data_smithi188_104537_object116662:head# 2024-04-01T19:36:36.005 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.006 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e230cc4:::benchmark_data_smithi188_104537_object70263:head# 2024-04-01T19:36:36.006 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.006 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e23a155:::benchmark_data_smithi188_104537_object22613:head# 2024-04-01T19:36:36.006 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.008 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e23bc25:::benchmark_data_smithi188_104537_object86674:head# 2024-04-01T19:36:36.008 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.008 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e240495:::benchmark_data_smithi188_104537_object67221:head# 2024-04-01T19:36:36.008 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.008 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e24d0f0:::benchmark_data_smithi188_104537_object55048:head# 2024-04-01T19:36:36.008 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.008 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e2567e5:::benchmark_data_smithi188_104537_object32424:head# 2024-04-01T19:36:36.008 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.008 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e25c49b:::benchmark_data_smithi188_104537_object116449:head# 2024-04-01T19:36:36.009 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.009 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e261d55:::benchmark_data_smithi188_104537_object98491:head# 2024-04-01T19:36:36.009 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.009 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e262fad:::benchmark_data_smithi188_104537_object41099:head# 2024-04-01T19:36:36.009 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.009 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e26d437:::benchmark_data_smithi188_104537_object82146:head# 2024-04-01T19:36:36.009 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.009 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e26fedb:::benchmark_data_smithi188_104537_object119350:head# 2024-04-01T19:36:36.009 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.009 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e2886a3:::benchmark_data_smithi188_104537_object29209:head# 2024-04-01T19:36:36.009 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.009 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e28b365:::benchmark_data_smithi188_104537_object37491:head# 2024-04-01T19:36:36.009 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.009 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e28e62a:::benchmark_data_smithi188_104537_object161839:head# 2024-04-01T19:36:36.010 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.010 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e28eaef:::benchmark_data_smithi188_104537_object113031:head# 2024-04-01T19:36:36.010 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.010 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e297b1e:::benchmark_data_smithi188_104537_object119536:head# 2024-04-01T19:36:36.010 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.010 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e2b55a8:::benchmark_data_smithi188_104537_object95411:head# 2024-04-01T19:36:36.010 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.012 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e2b758f:::benchmark_data_smithi188_104537_object21017:head# 2024-04-01T19:36:36.012 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.012 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e2c70b5:::benchmark_data_smithi188_104537_object126026:head# 2024-04-01T19:36:36.013 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.013 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e2cd750:::benchmark_data_smithi188_104537_object156969:head# 2024-04-01T19:36:36.013 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.013 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e2cef1b:::benchmark_data_smithi188_104537_object19584:head# 2024-04-01T19:36:36.013 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.013 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e2d118b:::benchmark_data_smithi188_104537_object107416:head# 2024-04-01T19:36:36.013 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.013 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e2d2453:::benchmark_data_smithi188_104537_object108637:head# 2024-04-01T19:36:36.013 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.013 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e2da495:::benchmark_data_smithi188_104537_object152941:head# 2024-04-01T19:36:36.013 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.013 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e2dadd6:::benchmark_data_smithi188_104537_object24457:head# 2024-04-01T19:36:36.014 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.014 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e2dcef9:::benchmark_data_smithi188_104537_object59912:head# 2024-04-01T19:36:36.014 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.014 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e2de567:::benchmark_data_smithi188_104537_object78691:head# 2024-04-01T19:36:36.014 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.014 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e2e0850:::benchmark_data_smithi188_104537_object127700:head# 2024-04-01T19:36:36.014 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.014 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e2e55c4:::benchmark_data_smithi188_104537_object80461:head# 2024-04-01T19:36:36.014 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.014 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e2e610a:::benchmark_data_smithi188_104537_object98621:head# 2024-04-01T19:36:36.014 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.014 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e2ec04d:::benchmark_data_smithi188_104537_object76024:head# 2024-04-01T19:36:36.015 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.015 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e2eeeb8:::benchmark_data_smithi188_104537_object42670:head# 2024-04-01T19:36:36.015 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.015 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e2f24d8:::benchmark_data_smithi188_104537_object123599:head# 2024-04-01T19:36:36.015 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.017 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e2f5240:::benchmark_data_smithi188_104537_object142065:head# 2024-04-01T19:36:36.017 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.017 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e2f7117:::benchmark_data_smithi188_104537_object28272:head# 2024-04-01T19:36:36.017 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.018 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e2f8552:::benchmark_data_smithi188_104537_object35026:head# 2024-04-01T19:36:36.018 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.018 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e2fa51b:::benchmark_data_smithi188_104537_object33526:head# 2024-04-01T19:36:36.018 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.018 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e2fecac:::benchmark_data_smithi188_104537_object115621:head# 2024-04-01T19:36:36.018 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.018 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e30fab6:::benchmark_data_smithi188_104537_object122809:head# 2024-04-01T19:36:36.018 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.018 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e313557:::benchmark_data_smithi188_104537_object137214:head# 2024-04-01T19:36:36.018 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.018 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e31f9ed:::benchmark_data_smithi188_104537_object108688:head# 2024-04-01T19:36:36.018 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.018 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e31fac3:::benchmark_data_smithi188_104537_object83579:head# 2024-04-01T19:36:36.019 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.019 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e322fb9:::benchmark_data_smithi188_104537_object135467:head# 2024-04-01T19:36:36.019 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.019 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e326e0d:::benchmark_data_smithi188_104537_object167629:head# 2024-04-01T19:36:36.019 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.019 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e3344ce:::benchmark_data_smithi188_104537_object133236:head# 2024-04-01T19:36:36.019 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.019 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e335920:::benchmark_data_smithi188_104537_object78774:head# 2024-04-01T19:36:36.019 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.019 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e33d0b1:::benchmark_data_smithi188_104537_object77268:head# 2024-04-01T19:36:36.019 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.019 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e33db40:::benchmark_data_smithi188_104537_object84559:head# 2024-04-01T19:36:36.019 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.019 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e34b0f0:::benchmark_data_smithi188_104537_object24963:head# 2024-04-01T19:36:36.020 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.020 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e35d217:::benchmark_data_smithi188_104537_object109724:head# 2024-04-01T19:36:36.020 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.020 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e35d2a0:::benchmark_data_smithi188_104537_object92403:head# 2024-04-01T19:36:36.020 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.024 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e360e37:::benchmark_data_smithi188_104537_object96357:head# 2024-04-01T19:36:36.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e362888:::benchmark_data_smithi188_104537_object100450:head# 2024-04-01T19:36:36.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e36c864:::benchmark_data_smithi188_104537_object104829:head# 2024-04-01T19:36:36.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e376e53:::benchmark_data_smithi188_104537_object111989:head# 2024-04-01T19:36:36.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e379ded:::benchmark_data_smithi188_104537_object122133:head# 2024-04-01T19:36:36.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e38a3f4:::benchmark_data_smithi188_104537_object156472:head# 2024-04-01T19:36:36.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e38e9f1:::benchmark_data_smithi188_104537_object101071:head# 2024-04-01T19:36:36.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e3900dd:::benchmark_data_smithi188_104537_object147603:head# 2024-04-01T19:36:36.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e395106:::benchmark_data_smithi188_104537_object60752:head# 2024-04-01T19:36:36.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e3982f3:::benchmark_data_smithi188_104537_object137645:head# 2024-04-01T19:36:36.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e399ba0:::benchmark_data_smithi188_104537_object154443:head# 2024-04-01T19:36:36.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e39bd0f:::benchmark_data_smithi188_104537_object166597:head# 2024-04-01T19:36:36.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e3a39ec:::benchmark_data_smithi188_104537_object70104:head# 2024-04-01T19:36:36.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e3a6e9e:::benchmark_data_smithi188_104537_object78372:head# 2024-04-01T19:36:36.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e3b0463:::benchmark_data_smithi188_104537_object158467:head# 2024-04-01T19:36:36.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e3b4620:::benchmark_data_smithi188_104537_object109057:head# 2024-04-01T19:36:36.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e3cfb9e:::benchmark_data_smithi188_104537_object56636:head# 2024-04-01T19:36:36.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e3d9431:::benchmark_data_smithi188_104537_object146589:head# 2024-04-01T19:36:36.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e3db791:::benchmark_data_smithi188_104537_object152862:head# 2024-04-01T19:36:36.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e3de70e:::benchmark_data_smithi188_104537_object27976:head# 2024-04-01T19:36:36.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e3e0aad:::benchmark_data_smithi188_104537_object15453:head# 2024-04-01T19:36:36.028 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.028 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e3eb553:::benchmark_data_smithi188_104537_object133633:head# 2024-04-01T19:36:36.028 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.028 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e3ee36c:::benchmark_data_smithi188_104537_object81240:head# 2024-04-01T19:36:36.028 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.028 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e3efcb9:::benchmark_data_smithi188_104537_object112337:head# 2024-04-01T19:36:36.028 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.028 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e3f844e:::benchmark_data_smithi188_104537_object70711:head# 2024-04-01T19:36:36.028 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.028 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e3f8e1b:::benchmark_data_smithi188_104537_object41533:head# 2024-04-01T19:36:36.028 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.028 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e40fba9:::benchmark_data_smithi188_104537_object23942:head# 2024-04-01T19:36:36.028 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.032 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e4171ee:::benchmark_data_smithi188_104537_object157577:head# 2024-04-01T19:36:36.032 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.032 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e417b6e:::benchmark_data_smithi188_104537_object56970:head# 2024-04-01T19:36:36.033 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.033 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e41e808:::benchmark_data_smithi188_104537_object55451:head# 2024-04-01T19:36:36.033 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.033 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e4235f8:::benchmark_data_smithi188_104537_object144230:head# 2024-04-01T19:36:36.033 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.033 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e427c9f:::benchmark_data_smithi188_104537_object56654:head# 2024-04-01T19:36:36.033 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.033 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e43a337:::benchmark_data_smithi188_104537_object133710:head# 2024-04-01T19:36:36.033 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.033 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e43afae:::benchmark_data_smithi188_104537_object104502:head# 2024-04-01T19:36:36.033 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.033 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e44086c:::benchmark_data_smithi188_104537_object109513:head# 2024-04-01T19:36:36.033 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.033 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e450498:::benchmark_data_smithi188_104537_object171382:head# 2024-04-01T19:36:36.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e45bd83:::benchmark_data_smithi188_104537_object115632:head# 2024-04-01T19:36:36.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e45e815:::benchmark_data_smithi188_104537_object42562:head# 2024-04-01T19:36:36.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e45ef1b:::benchmark_data_smithi188_104537_object60591:head# 2024-04-01T19:36:36.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e462146:::benchmark_data_smithi188_104537_object131152:head# 2024-04-01T19:36:36.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e4666e7:::benchmark_data_smithi188_104537_object140846:head# 2024-04-01T19:36:36.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e471af6:::benchmark_data_smithi188_104537_object160164:head# 2024-04-01T19:36:36.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.035 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e472001:::benchmark_data_smithi188_104537_object75336:head# 2024-04-01T19:36:36.035 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.035 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e47306e:::benchmark_data_smithi188_104537_object30649:head# 2024-04-01T19:36:36.035 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.035 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e4859d7:::benchmark_data_smithi188_104537_object63878:head# 2024-04-01T19:36:36.035 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.035 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e485c94:::benchmark_data_smithi188_104537_object57070:head# 2024-04-01T19:36:36.035 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.035 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e486d2e:::benchmark_data_smithi188_104537_object106508:head# 2024-04-01T19:36:36.035 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.035 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e48eef2:::benchmark_data_smithi188_104537_object115505:head# 2024-04-01T19:36:36.035 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.035 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e497eb9:::benchmark_data_smithi188_104537_object31441:head# 2024-04-01T19:36:36.035 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.036 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e499edd:::benchmark_data_smithi188_104537_object93133:head# 2024-04-01T19:36:36.036 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.036 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e4a506d:::benchmark_data_smithi188_104537_object86767:head# 2024-04-01T19:36:36.036 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.036 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e4b23ac:::benchmark_data_smithi188_104537_object53157:head# 2024-04-01T19:36:36.036 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.036 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e4c74c2:::benchmark_data_smithi188_104537_object91524:head# 2024-04-01T19:36:36.036 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.036 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e4c8f01:::benchmark_data_smithi188_104537_object22169:head# 2024-04-01T19:36:36.036 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.036 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e4c9e3d:::benchmark_data_smithi188_104537_object131793:head# 2024-04-01T19:36:36.036 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.036 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e4ce5ea:::benchmark_data_smithi188_104537_object62714:head# 2024-04-01T19:36:36.036 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.041 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e4d0806:::benchmark_data_smithi188_104537_object160970:head# 2024-04-01T19:36:36.041 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.041 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e4d8c3b:::benchmark_data_smithi188_104537_object165568:head# 2024-04-01T19:36:36.041 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.041 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e4e0c94:::benchmark_data_smithi188_104537_object51492:head# 2024-04-01T19:36:36.041 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.041 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e4edd56:::benchmark_data_smithi188_104537_object93507:head# 2024-04-01T19:36:36.041 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.041 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e4f075b:::benchmark_data_smithi188_104537_object58378:head# 2024-04-01T19:36:36.041 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.042 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e4fb063:::benchmark_data_smithi188_104537_object72006:head# 2024-04-01T19:36:36.042 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.042 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e4fcf81:::benchmark_data_smithi188_104537_object14547:head# 2024-04-01T19:36:36.042 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.042 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e504f69:::benchmark_data_smithi188_104537_object108844:head# 2024-04-01T19:36:36.042 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.042 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5060ba:::benchmark_data_smithi188_104537_object161536:head# 2024-04-01T19:36:36.042 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.042 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e506437:::benchmark_data_smithi188_104537_object76142:head# 2024-04-01T19:36:36.042 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.042 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e50afcf:::benchmark_data_smithi188_104537_object92505:head# 2024-04-01T19:36:36.042 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.042 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e50be6f:::benchmark_data_smithi188_104537_object76907:head# 2024-04-01T19:36:36.043 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.043 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e51762b:::benchmark_data_smithi188_104537_object21047:head# 2024-04-01T19:36:36.043 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.043 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e525f6f:::benchmark_data_smithi188_104537_object160420:head# 2024-04-01T19:36:36.043 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.043 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e52d997:::benchmark_data_smithi188_104537_object74163:head# 2024-04-01T19:36:36.043 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.043 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5308e6:::benchmark_data_smithi188_104537_object62073:head# 2024-04-01T19:36:36.043 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.043 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e53e7de:::benchmark_data_smithi188_104537_object83766:head# 2024-04-01T19:36:36.043 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.044 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e54656a:::benchmark_data_smithi188_104537_object155091:head# 2024-04-01T19:36:36.044 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.044 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e54bf15:::benchmark_data_smithi188_104537_object80085:head# 2024-04-01T19:36:36.044 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.044 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e54db9a:::benchmark_data_smithi188_104537_object134959:head# 2024-04-01T19:36:36.044 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.044 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e556972:::benchmark_data_smithi188_104537_object12926:head# 2024-04-01T19:36:36.044 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.044 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e557f7e:::benchmark_data_smithi188_104537_object131486:head# 2024-04-01T19:36:36.044 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.044 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e559b36:::benchmark_data_smithi188_104537_object106764:head# 2024-04-01T19:36:36.044 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.044 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5602e7:::benchmark_data_smithi188_104537_object59217:head# 2024-04-01T19:36:36.045 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.045 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5658ee:::benchmark_data_smithi188_104537_object136033:head# 2024-04-01T19:36:36.045 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.045 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e566580:::benchmark_data_smithi188_104537_object43738:head# 2024-04-01T19:36:36.045 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.045 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5677da:::benchmark_data_smithi188_104537_object113730:head# 2024-04-01T19:36:36.045 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.045 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e56b078:::benchmark_data_smithi188_104537_object118142:head# 2024-04-01T19:36:36.045 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.045 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e56bd4b:::benchmark_data_smithi188_104537_object99549:head# 2024-04-01T19:36:36.045 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.045 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e573c14:::benchmark_data_smithi188_104537_object62424:head# 2024-04-01T19:36:36.045 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.045 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e591ad1:::benchmark_data_smithi188_104537_object160843:head# 2024-04-01T19:36:36.046 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e592c1b:::benchmark_data_smithi188_104537_object70940:head# 2024-04-01T19:36:36.046 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e599ead:::benchmark_data_smithi188_104537_object44709:head# 2024-04-01T19:36:36.046 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.053 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:36:36.054 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e59ad55:::benchmark_data_smithi188_104537_object157786:head# 2024-04-01T19:36:36.054 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.055 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5a384f:::benchmark_data_smithi188_104537_object66288:head# 2024-04-01T19:36:36.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.055 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5a5d04:::benchmark_data_smithi188_104537_object131718:head# 2024-04-01T19:36:36.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.055 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5a9532:::benchmark_data_smithi188_104537_object158050:head# 2024-04-01T19:36:36.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.055 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5ab810:::benchmark_data_smithi188_104537_object146847:head# 2024-04-01T19:36:36.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.055 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5ac024:::benchmark_data_smithi188_104537_object75879:head# 2024-04-01T19:36:36.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.055 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5ac22f:::benchmark_data_smithi188_104537_object155559:head# 2024-04-01T19:36:36.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.056 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5b23a2:::benchmark_data_smithi188_104537_object60460:head# 2024-04-01T19:36:36.056 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.056 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5c679c:::benchmark_data_smithi188_104537_object64543:head# 2024-04-01T19:36:36.056 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.056 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5c90c8:::benchmark_data_smithi188_104537_object35616:head# 2024-04-01T19:36:36.056 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.056 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5c9ef8:::benchmark_data_smithi188_104537_object150774:head# 2024-04-01T19:36:36.056 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.056 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5cae49:::benchmark_data_smithi188_104537_object43293:head# 2024-04-01T19:36:36.056 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.056 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5cf2f3:::benchmark_data_smithi188_104537_object50992:head# 2024-04-01T19:36:36.056 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.056 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5cf3ff:::benchmark_data_smithi188_104537_object151418:head# 2024-04-01T19:36:36.056 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.057 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5d1228:::benchmark_data_smithi188_104537_object39119:head# 2024-04-01T19:36:36.057 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.057 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5ec3d9:::benchmark_data_smithi188_104537_object152738:head# 2024-04-01T19:36:36.057 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.057 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5edcd6:::benchmark_data_smithi188_104537_object90101:head# 2024-04-01T19:36:36.057 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.057 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5f06e2:::benchmark_data_smithi188_104537_object19507:head# 2024-04-01T19:36:36.057 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.057 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5f17cf:::benchmark_data_smithi188_104537_object125423:head# 2024-04-01T19:36:36.057 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.057 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5f980d:::benchmark_data_smithi188_104537_object160788:head# 2024-04-01T19:36:36.057 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.057 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5faaf8:::benchmark_data_smithi188_104537_object117925:head# 2024-04-01T19:36:36.058 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.058 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e5ff5a3:::benchmark_data_smithi188_104537_object25857:head# 2024-04-01T19:36:36.058 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.058 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e605e49:::benchmark_data_smithi188_104537_object171120:head# 2024-04-01T19:36:36.058 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.058 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e6096b2:::benchmark_data_smithi188_104537_object160823:head# 2024-04-01T19:36:36.058 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.058 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e60ccb9:::benchmark_data_smithi188_104537_object152247:head# 2024-04-01T19:36:36.058 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.058 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e61e152:::benchmark_data_smithi188_104537_object143274:head# 2024-04-01T19:36:36.058 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.058 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e621039:::benchmark_data_smithi188_104537_object150642:head# 2024-04-01T19:36:36.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e62ba32:::benchmark_data_smithi188_104537_object140684:head# 2024-04-01T19:36:36.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e62e8af:::benchmark_data_smithi188_104537_object31374:head# 2024-04-01T19:36:36.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e62f74d:::benchmark_data_smithi188_104537_object120136:head# 2024-04-01T19:36:36.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e63599e:::benchmark_data_smithi188_104537_object60673:head# 2024-04-01T19:36:36.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e636b03:::benchmark_data_smithi188_104537_object68579:head# 2024-04-01T19:36:36.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e6371ce:::benchmark_data_smithi188_104537_object128036:head# 2024-04-01T19:36:36.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e63f226:::benchmark_data_smithi188_104537_object141828:head# 2024-04-01T19:36:36.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e64bca3:::benchmark_data_smithi188_104537_object98309:head# 2024-04-01T19:36:36.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e64f77f:::benchmark_data_smithi188_104537_object138339:head# 2024-04-01T19:36:36.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e65a2b3:::benchmark_data_smithi188_104537_object57422:head# 2024-04-01T19:36:36.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e663c15:::benchmark_data_smithi188_104537_object85437:head# 2024-04-01T19:36:36.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e66afb1:::benchmark_data_smithi188_104537_object21690:head# 2024-04-01T19:36:36.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e66f943:::benchmark_data_smithi188_104537_object111712:head# 2024-04-01T19:36:36.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e679ec5:::benchmark_data_smithi188_104537_object117808:head# 2024-04-01T19:36:36.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e67a67e:::benchmark_data_smithi188_104537_object88195:head# 2024-04-01T19:36:36.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e68a5d4:::benchmark_data_smithi188_104537_object59137:head# 2024-04-01T19:36:36.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e68bef4:::benchmark_data_smithi188_104537_object72316:head# 2024-04-01T19:36:36.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e68f5a6:::benchmark_data_smithi188_104537_object19972:head# 2024-04-01T19:36:36.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e68ffea:::benchmark_data_smithi188_104537_object106186:head# 2024-04-01T19:36:36.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e6924ef:::benchmark_data_smithi188_104537_object152540:head# 2024-04-01T19:36:36.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e69a5c1:::benchmark_data_smithi188_104537_object40321:head# 2024-04-01T19:36:36.062 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.062 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e69ddf1:::benchmark_data_smithi188_104537_object55081:head# 2024-04-01T19:36:36.062 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.062 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e6a33f8:::benchmark_data_smithi188_104537_object164620:head# 2024-04-01T19:36:36.062 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.062 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:36:36.063 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:36.064 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:36:36.070 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e6a64d6:::benchmark_data_smithi188_104537_object149354:head# 2024-04-01T19:36:36.070 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.071 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e6b8f87:::benchmark_data_smithi188_104537_object86812:head# 2024-04-01T19:36:36.071 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.071 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e6ba8ef:::benchmark_data_smithi188_104537_object84686:head# 2024-04-01T19:36:36.071 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.071 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e6cd6b2:::benchmark_data_smithi188_104537_object166490:head# 2024-04-01T19:36:36.071 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.071 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e6d223e:::benchmark_data_smithi188_104537_object117637:head# 2024-04-01T19:36:36.071 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.071 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e6d546d:::benchmark_data_smithi188_104537_object31416:head# 2024-04-01T19:36:36.071 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.071 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e6d95eb:::benchmark_data_smithi188_104537_object51194:head# 2024-04-01T19:36:36.071 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.071 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e6eb11b:::benchmark_data_smithi188_104537_object75537:head# 2024-04-01T19:36:36.071 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e6eb31d:::benchmark_data_smithi188_104537_object170115:head# 2024-04-01T19:36:36.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e6ecbe1:::benchmark_data_smithi188_104537_object141646:head# 2024-04-01T19:36:36.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e6ecf90:::benchmark_data_smithi188_104537_object135229:head# 2024-04-01T19:36:36.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e6f4588:::benchmark_data_smithi188_104537_object114709:head# 2024-04-01T19:36:36.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e6f78b4:::benchmark_data_smithi188_104537_object163399:head# 2024-04-01T19:36:36.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e6f812c:::benchmark_data_smithi188_104537_object51902:head# 2024-04-01T19:36:36.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e70cebd:::benchmark_data_smithi188_104537_object154653:head# 2024-04-01T19:36:36.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e70e008:::benchmark_data_smithi188_104537_object166268:head# 2024-04-01T19:36:36.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e71d637:::benchmark_data_smithi188_104537_object153856:head# 2024-04-01T19:36:36.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e725244:::benchmark_data_smithi188_104537_object128609:head# 2024-04-01T19:36:36.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e72c99f:::benchmark_data_smithi188_104537_object145609:head# 2024-04-01T19:36:36.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e733d79:::benchmark_data_smithi188_104537_object38731:head# 2024-04-01T19:36:36.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e734ba0:::benchmark_data_smithi188_104537_object81026:head# 2024-04-01T19:36:36.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e7459d4:::benchmark_data_smithi188_104537_object68841:head# 2024-04-01T19:36:36.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e7527f1:::benchmark_data_smithi188_104537_object94341:head# 2024-04-01T19:36:36.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e753297:::benchmark_data_smithi188_104537_object152838:head# 2024-04-01T19:36:36.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e757119:::benchmark_data_smithi188_104537_object92127:head# 2024-04-01T19:36:36.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e757dcc:::benchmark_data_smithi188_104537_object40555:head# 2024-04-01T19:36:36.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e75a668:::benchmark_data_smithi188_104537_object95056:head# 2024-04-01T19:36:36.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e75abc5:::benchmark_data_smithi188_104537_object85843:head# 2024-04-01T19:36:36.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e75bb5d:::benchmark_data_smithi188_104537_object118576:head# 2024-04-01T19:36:36.075 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.075 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e75e6bb:::benchmark_data_smithi188_104537_object104094:head# 2024-04-01T19:36:36.075 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.075 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e761894:::benchmark_data_smithi188_104537_object155452:head# 2024-04-01T19:36:36.075 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.075 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e76ff33:::benchmark_data_smithi188_104537_object145148:head# 2024-04-01T19:36:36.075 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.075 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e77c89c:::benchmark_data_smithi188_104537_object141942:head# 2024-04-01T19:36:36.075 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.075 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e77fdd7:::benchmark_data_smithi188_104537_object112967:head# 2024-04-01T19:36:36.075 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.075 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e784d05:::benchmark_data_smithi188_104537_object80522:head# 2024-04-01T19:36:36.075 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.075 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e78da52:::benchmark_data_smithi188_104537_object47766:head# 2024-04-01T19:36:36.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e78e30e:::benchmark_data_smithi188_104537_object100705:head# 2024-04-01T19:36:36.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e795cde:::benchmark_data_smithi188_104537_object37034:head# 2024-04-01T19:36:36.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e796e9d:::benchmark_data_smithi188_104537_object93026:head# 2024-04-01T19:36:36.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e798d1f:::benchmark_data_smithi188_104537_object141206:head# 2024-04-01T19:36:36.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e79c17a:::benchmark_data_smithi188_104537_object117963:head# 2024-04-01T19:36:36.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e79db2a:::benchmark_data_smithi188_104537_object171511:head# 2024-04-01T19:36:36.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e7a0208:::benchmark_data_smithi188_104537_object76025:head# 2024-04-01T19:36:36.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e7a5349:::benchmark_data_smithi188_104537_object130200:head# 2024-04-01T19:36:36.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e7a624e:::benchmark_data_smithi188_104537_object97570:head# 2024-04-01T19:36:36.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e7ad1a6:::benchmark_data_smithi188_104537_object138230:head# 2024-04-01T19:36:36.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e7ad78f:::benchmark_data_smithi188_104537_object126273:head# 2024-04-01T19:36:36.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e7bc09d:::benchmark_data_smithi188_104537_object115482:head# 2024-04-01T19:36:36.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e7c4bbf:::benchmark_data_smithi188_104537_object135323:head# 2024-04-01T19:36:36.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e7cdbf3:::benchmark_data_smithi188_104537_object15431:head# 2024-04-01T19:36:36.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.083 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e7d5f05:::benchmark_data_smithi188_104537_object63924:head# 2024-04-01T19:36:36.083 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.083 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e7e211a:::benchmark_data_smithi188_104537_object132176:head# 2024-04-01T19:36:36.083 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.083 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e7f517a:::benchmark_data_smithi188_104537_object158660:head# 2024-04-01T19:36:36.083 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.083 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e811ad4:::benchmark_data_smithi188_104537_object40344:head# 2024-04-01T19:36:36.083 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.084 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e811eb2:::benchmark_data_smithi188_104537_object153107:head# 2024-04-01T19:36:36.084 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.084 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e81254c:::benchmark_data_smithi188_104537_object104320:head# 2024-04-01T19:36:36.084 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.084 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e81cba7:::benchmark_data_smithi188_104537_object65079:head# 2024-04-01T19:36:36.084 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.084 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e8221dd:::benchmark_data_smithi188_104537_object170806:head# 2024-04-01T19:36:36.084 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.084 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e8263d1:::benchmark_data_smithi188_104537_object69396:head# 2024-04-01T19:36:36.084 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.084 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e82ac17:::benchmark_data_smithi188_104537_object167849:head# 2024-04-01T19:36:36.084 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.084 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e82ba35:::benchmark_data_smithi188_104537_object43769:head# 2024-04-01T19:36:36.085 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.085 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e834b4d:::benchmark_data_smithi188_104537_object133749:head# 2024-04-01T19:36:36.085 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.085 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e834d86:::benchmark_data_smithi188_104537_object139011:head# 2024-04-01T19:36:36.085 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.085 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e83dfc5:::benchmark_data_smithi188_104537_object142755:head# 2024-04-01T19:36:36.085 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.085 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e83e1a9:::benchmark_data_smithi188_104537_object50054:head# 2024-04-01T19:36:36.085 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.085 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e842fea:::benchmark_data_smithi188_104537_object58343:head# 2024-04-01T19:36:36.085 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.085 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e848a72:::benchmark_data_smithi188_104537_object88849:head# 2024-04-01T19:36:36.085 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.085 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e858117:::benchmark_data_smithi188_104537_object98740:head# 2024-04-01T19:36:36.086 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.086 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e85dd82:::benchmark_data_smithi188_104537_object163282:head# 2024-04-01T19:36:36.086 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.086 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e860ed5:::benchmark_data_smithi188_104537_object155051:head# 2024-04-01T19:36:36.086 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.086 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e860eef:::benchmark_data_smithi188_104537_object143654:head# 2024-04-01T19:36:36.086 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.086 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e861ff1:::benchmark_data_smithi188_104537_object114690:head# 2024-04-01T19:36:36.086 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.086 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e868558:::benchmark_data_smithi188_104537_object152550:head# 2024-04-01T19:36:36.086 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.086 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e869959:::benchmark_data_smithi188_104537_object113497:head# 2024-04-01T19:36:36.086 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e86d618:::benchmark_data_smithi188_104537_object107037:head# 2024-04-01T19:36:36.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e8831ec:::benchmark_data_smithi188_104537_object32648:head# 2024-04-01T19:36:36.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e88b7b9:::benchmark_data_smithi188_104537_object63331:head# 2024-04-01T19:36:36.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e89de22:::benchmark_data_smithi188_104537_object40496:head# 2024-04-01T19:36:36.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e8a2c5c:::benchmark_data_smithi188_104537_object112184:head# 2024-04-01T19:36:36.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e8a5e2d:::benchmark_data_smithi188_104537_object124726:head# 2024-04-01T19:36:36.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e8a7572:::benchmark_data_smithi188_104537_object56532:head# 2024-04-01T19:36:36.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e8b117b:::benchmark_data_smithi188_104537_object107646:head# 2024-04-01T19:36:36.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e8b79ed:::benchmark_data_smithi188_104537_object58262:head# 2024-04-01T19:36:36.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e8bc1f1:::benchmark_data_smithi188_104537_object122538:head# 2024-04-01T19:36:36.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e8bfa29:::benchmark_data_smithi188_104537_object156051:head# 2024-04-01T19:36:36.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e8c17d5:::benchmark_data_smithi188_104537_object62934:head# 2024-04-01T19:36:36.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e8d8714:::benchmark_data_smithi188_104537_object80812:head# 2024-04-01T19:36:36.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e8f6267:::benchmark_data_smithi188_104537_object122624:head# 2024-04-01T19:36:36.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.089 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e8fd338:::benchmark_data_smithi188_104537_object87730:head# 2024-04-01T19:36:36.089 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.091 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e927317:::benchmark_data_smithi188_104537_object147822:head# 2024-04-01T19:36:36.091 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.091 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e93135c:::benchmark_data_smithi188_104537_object117914:head# 2024-04-01T19:36:36.091 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.091 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e932116:::benchmark_data_smithi188_104537_object169008:head# 2024-04-01T19:36:36.091 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e93b31e:::benchmark_data_smithi188_104537_object53453:head# 2024-04-01T19:36:36.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e93e6ee:::benchmark_data_smithi188_104537_object16283:head# 2024-04-01T19:36:36.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e94b813:::benchmark_data_smithi188_104537_object74677:head# 2024-04-01T19:36:36.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e94ced1:::benchmark_data_smithi188_104537_object33478:head# 2024-04-01T19:36:36.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e94e9bf:::benchmark_data_smithi188_104537_object74879:head# 2024-04-01T19:36:36.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e95ebf0:::benchmark_data_smithi188_104537_object171318:head# 2024-04-01T19:36:36.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e964228:::benchmark_data_smithi188_104537_object141133:head# 2024-04-01T19:36:36.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e96a1f7:::benchmark_data_smithi188_104537_object89073:head# 2024-04-01T19:36:36.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e97847b:::benchmark_data_smithi188_104537_object127153:head# 2024-04-01T19:36:36.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e979ccb:::benchmark_data_smithi188_104537_object150584:head# 2024-04-01T19:36:36.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e983571:::benchmark_data_smithi188_104537_object13895:head# 2024-04-01T19:36:36.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e9845dc:::benchmark_data_smithi188_104537_object54380:head# 2024-04-01T19:36:36.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e98d5a6:::benchmark_data_smithi188_104537_object110679:head# 2024-04-01T19:36:36.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e9930c5:::benchmark_data_smithi188_104537_object11676:head# 2024-04-01T19:36:36.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.094 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e993f5b:::benchmark_data_smithi188_104537_object124138:head# 2024-04-01T19:36:36.094 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.094 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e99d05a:::benchmark_data_smithi188_104537_object144273:head# 2024-04-01T19:36:36.094 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.094 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e9a0cf3:::benchmark_data_smithi188_104537_object150537:head# 2024-04-01T19:36:36.094 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.094 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e9a93a5:::benchmark_data_smithi188_104537_object64675:head# 2024-04-01T19:36:36.094 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.094 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e9a990f:::benchmark_data_smithi188_104537_object41506:head# 2024-04-01T19:36:36.094 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.094 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e9afd90:::benchmark_data_smithi188_104537_object13853:head# 2024-04-01T19:36:36.094 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.094 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e9b1c82:::benchmark_data_smithi188_104537_object34206:head# 2024-04-01T19:36:36.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e9c75e2:::benchmark_data_smithi188_104537_object43045:head# 2024-04-01T19:36:36.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e9d6829:::benchmark_data_smithi188_104537_object99435:head# 2024-04-01T19:36:36.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e9de5e3:::benchmark_data_smithi188_104537_object66261:head# 2024-04-01T19:36:36.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e9e0a68:::benchmark_data_smithi188_104537_object78501:head# 2024-04-01T19:36:36.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e9e362c:::benchmark_data_smithi188_104537_object136067:head# 2024-04-01T19:36:36.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.097 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e9e6d7a:::benchmark_data_smithi188_104537_object46473:head# 2024-04-01T19:36:36.097 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.097 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e9f7f73:::benchmark_data_smithi188_104537_object34572:head# 2024-04-01T19:36:36.097 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.097 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e9fd711:::benchmark_data_smithi188_104537_object94561:head# 2024-04-01T19:36:36.097 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.097 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e9fe5d3:::benchmark_data_smithi188_104537_object16865:head# 2024-04-01T19:36:36.098 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.098 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e9ff92d:::benchmark_data_smithi188_104537_object66725:head# 2024-04-01T19:36:36.098 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.098 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5e9ffdfa:::benchmark_data_smithi188_104537_object21208:head# 2024-04-01T19:36:36.098 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.098 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea01bbd:::benchmark_data_smithi188_104537_object25066:head# 2024-04-01T19:36:36.098 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.098 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea03ef4:::benchmark_data_smithi188_104537_object98581:head# 2024-04-01T19:36:36.098 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.098 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea08c78:::benchmark_data_smithi188_104537_object164666:head# 2024-04-01T19:36:36.098 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.098 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea09fe7:::benchmark_data_smithi188_104537_object58799:head# 2024-04-01T19:36:36.098 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.099 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea0c56a:::benchmark_data_smithi188_104537_object109770:head# 2024-04-01T19:36:36.099 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.099 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea13a27:::benchmark_data_smithi188_104537_object144721:head# 2024-04-01T19:36:36.099 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.099 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea22970:::benchmark_data_smithi188_104537_object110562:head# 2024-04-01T19:36:36.099 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.099 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea29dc1:::benchmark_data_smithi188_104537_object82899:head# 2024-04-01T19:36:36.099 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.099 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea2a785:::benchmark_data_smithi188_104537_object52757:head# 2024-04-01T19:36:36.099 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.099 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea4bd94:::benchmark_data_smithi188_104537_object12692:head# 2024-04-01T19:36:36.099 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.099 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea5ec56:::benchmark_data_smithi188_104537_object90851:head# 2024-04-01T19:36:36.099 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.101 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea60cc8:::benchmark_data_smithi188_104537_object139082:head# 2024-04-01T19:36:36.101 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.101 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea628e6:::benchmark_data_smithi188_104537_object69492:head# 2024-04-01T19:36:36.101 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.101 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea6d304:::benchmark_data_smithi188_104537_object38582:head# 2024-04-01T19:36:36.101 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea6fc6e:::benchmark_data_smithi188_104537_object85300:head# 2024-04-01T19:36:36.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea73414:::benchmark_data_smithi188_104537_object39543:head# 2024-04-01T19:36:36.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea7430f:::benchmark_data_smithi188_104537_object69781:head# 2024-04-01T19:36:36.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.103 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea7ce0e:::benchmark_data_smithi188_104537_object71206:head# 2024-04-01T19:36:36.103 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.104 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea87533:::benchmark_data_smithi188_104537_object147418:head# 2024-04-01T19:36:36.104 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.104 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea885b3:::benchmark_data_smithi188_104537_object12550:head# 2024-04-01T19:36:36.104 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.105 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea8c40d:::benchmark_data_smithi188_104537_object145004:head# 2024-04-01T19:36:36.105 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.105 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea92b62:::benchmark_data_smithi188_104537_object59118:head# 2024-04-01T19:36:36.105 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.105 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea9647a:::benchmark_data_smithi188_104537_object16006:head# 2024-04-01T19:36:36.105 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.106 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea9dc13:::benchmark_data_smithi188_104537_object171429:head# 2024-04-01T19:36:36.106 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.109 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea9e745:::benchmark_data_smithi188_104537_object53462:head# 2024-04-01T19:36:36.109 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.109 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea9ee3f:::benchmark_data_smithi188_104537_object91964:head# 2024-04-01T19:36:36.109 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.109 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ea9fbb2:::benchmark_data_smithi188_104537_object74656:head# 2024-04-01T19:36:36.109 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.110 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eaa7e20:::benchmark_data_smithi188_104537_object58155:head# 2024-04-01T19:36:36.110 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.110 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eaaf895:::benchmark_data_smithi188_104537_object110571:head# 2024-04-01T19:36:36.110 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.110 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eab2c79:::benchmark_data_smithi188_104537_object34966:head# 2024-04-01T19:36:36.110 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.110 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eababdd:::benchmark_data_smithi188_104537_object136879:head# 2024-04-01T19:36:36.110 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.110 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eac4ce6:::benchmark_data_smithi188_104537_object11914:head# 2024-04-01T19:36:36.110 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.110 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eac7903:::benchmark_data_smithi188_104537_object11675:head# 2024-04-01T19:36:36.110 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.111 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eacc152:::benchmark_data_smithi188_104537_object85580:head# 2024-04-01T19:36:36.111 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.111 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eadd44e:::benchmark_data_smithi188_104537_object143384:head# 2024-04-01T19:36:36.111 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.111 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eadd65d:::benchmark_data_smithi188_104537_object105515:head# 2024-04-01T19:36:36.111 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.111 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eadf523:::benchmark_data_smithi188_104537_object170915:head# 2024-04-01T19:36:36.111 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.111 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eae31ed:::benchmark_data_smithi188_104537_object26699:head# 2024-04-01T19:36:36.111 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.115 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eae90d7:::benchmark_data_smithi188_104537_object44506:head# 2024-04-01T19:36:36.115 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.115 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eaf09af:::benchmark_data_smithi188_104537_object131570:head# 2024-04-01T19:36:36.115 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.115 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eaf6b36:::benchmark_data_smithi188_104537_object156709:head# 2024-04-01T19:36:36.115 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.115 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eafeec6:::benchmark_data_smithi188_104537_object109105:head# 2024-04-01T19:36:36.115 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.115 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb09f4c:::benchmark_data_smithi188_104537_object43000:head# 2024-04-01T19:36:36.115 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.115 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb09f78:::benchmark_data_smithi188_104537_object147027:head# 2024-04-01T19:36:36.115 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.115 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb0dd2c:::benchmark_data_smithi188_104537_object164422:head# 2024-04-01T19:36:36.116 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.116 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb14272:::benchmark_data_smithi188_104537_object120824:head# 2024-04-01T19:36:36.116 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.116 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb213d6:::benchmark_data_smithi188_104537_object158811:head# 2024-04-01T19:36:36.116 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.116 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb237e1:::benchmark_data_smithi188_104537_object48828:head# 2024-04-01T19:36:36.116 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.116 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb237fb:::benchmark_data_smithi188_104537_object93491:head# 2024-04-01T19:36:36.116 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.116 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb23846:::benchmark_data_smithi188_104537_object104033:head# 2024-04-01T19:36:36.116 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.116 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb31a02:::benchmark_data_smithi188_104537_object85679:head# 2024-04-01T19:36:36.116 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.116 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb322c5:::benchmark_data_smithi188_104537_object127273:head# 2024-04-01T19:36:36.117 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.117 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb374ee:::benchmark_data_smithi188_104537_object143728:head# 2024-04-01T19:36:36.117 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.117 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb3a012:::benchmark_data_smithi188_104537_object148615:head# 2024-04-01T19:36:36.117 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.117 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb3a4be:::benchmark_data_smithi188_104537_object141632:head# 2024-04-01T19:36:36.117 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.117 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb3fd4b:::benchmark_data_smithi188_104537_object90499:head# 2024-04-01T19:36:36.117 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.119 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb4088e:::benchmark_data_smithi188_104537_object17407:head# 2024-04-01T19:36:36.119 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.119 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb4d1eb:::benchmark_data_smithi188_104537_object29525:head# 2024-04-01T19:36:36.119 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.120 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb5fbc8:::benchmark_data_smithi188_104537_object117812:head# 2024-04-01T19:36:36.120 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.120 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb6dad5:::benchmark_data_smithi188_104537_object18033:head# 2024-04-01T19:36:36.120 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.120 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb73c72:::benchmark_data_smithi188_104537_object52527:head# 2024-04-01T19:36:36.120 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.120 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb78cc6:::benchmark_data_smithi188_104537_object76796:head# 2024-04-01T19:36:36.120 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.120 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb7a39a:::benchmark_data_smithi188_104537_object86516:head# 2024-04-01T19:36:36.120 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.120 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb81655:::benchmark_data_smithi188_104537_object40886:head# 2024-04-01T19:36:36.120 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.121 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb81daf:::benchmark_data_smithi188_104537_object19559:head# 2024-04-01T19:36:36.121 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.121 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb8e4db:::benchmark_data_smithi188_104537_object26507:head# 2024-04-01T19:36:36.121 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.121 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb948b2:::benchmark_data_smithi188_104537_object49637:head# 2024-04-01T19:36:36.121 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.121 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eb9fce7:::benchmark_data_smithi188_104537_object22861:head# 2024-04-01T19:36:36.121 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.121 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ebaede6:::benchmark_data_smithi188_104537_object34131:head# 2024-04-01T19:36:36.121 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.121 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ebb195f:::benchmark_data_smithi188_104537_object73760:head# 2024-04-01T19:36:36.121 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.121 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ebb4f3c:::benchmark_data_smithi188_104537_object24296:head# 2024-04-01T19:36:36.122 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.122 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ebbee79:::benchmark_data_smithi188_104537_object77907:head# 2024-04-01T19:36:36.122 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.122 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ebc48cc:::benchmark_data_smithi188_104537_object23141:head# 2024-04-01T19:36:36.122 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.122 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ebc8eb5:::benchmark_data_smithi188_104537_object157781:head# 2024-04-01T19:36:36.122 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.122 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ebd30f0:::benchmark_data_smithi188_104537_object92322:head# 2024-04-01T19:36:36.122 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.125 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ebd4b12:::benchmark_data_smithi188_104537_object117686:head# 2024-04-01T19:36:36.125 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.125 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ebea645:::benchmark_data_smithi188_104537_object44822:head# 2024-04-01T19:36:36.125 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.125 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ebea859:::benchmark_data_smithi188_104537_object93003:head# 2024-04-01T19:36:36.126 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.126 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ebf93e7:::benchmark_data_smithi188_104537_object27355:head# 2024-04-01T19:36:36.126 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.126 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec03993:::benchmark_data_smithi188_104537_object51641:head# 2024-04-01T19:36:36.126 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.126 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec039d2:::benchmark_data_smithi188_104537_object153089:head# 2024-04-01T19:36:36.126 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.126 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec05277:::benchmark_data_smithi188_104537_object135600:head# 2024-04-01T19:36:36.126 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.126 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec08061:::benchmark_data_smithi188_104537_object155295:head# 2024-04-01T19:36:36.126 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.126 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec11411:::benchmark_data_smithi188_104537_object120227:head# 2024-04-01T19:36:36.127 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.127 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec18c3f:::benchmark_data_smithi188_104537_object81386:head# 2024-04-01T19:36:36.127 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.127 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec1926a:::benchmark_data_smithi188_104537_object121770:head# 2024-04-01T19:36:36.127 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.127 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec19354:::benchmark_data_smithi188_104537_object51158:head# 2024-04-01T19:36:36.127 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.127 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec20cb9:::benchmark_data_smithi188_104537_object11933:head# 2024-04-01T19:36:36.127 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.127 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec20fa7:::benchmark_data_smithi188_104537_object168514:head# 2024-04-01T19:36:36.127 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.127 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec2edfe:::benchmark_data_smithi188_104537_object42045:head# 2024-04-01T19:36:36.127 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec3705b:::benchmark_data_smithi188_104537_object121207:head# 2024-04-01T19:36:36.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec3a0b9:::benchmark_data_smithi188_104537_object136883:head# 2024-04-01T19:36:36.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec42d77:::benchmark_data_smithi188_104537_object115055:head# 2024-04-01T19:36:36.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec4a7b2:::benchmark_data_smithi188_104537_object29424:head# 2024-04-01T19:36:36.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec5c0aa:::benchmark_data_smithi188_104537_object33327:head# 2024-04-01T19:36:36.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec60875:::benchmark_data_smithi188_104537_object94980:head# 2024-04-01T19:36:36.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec73e22:::benchmark_data_smithi188_104537_object93569:head# 2024-04-01T19:36:36.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec815eb:::benchmark_data_smithi188_104537_object147677:head# 2024-04-01T19:36:36.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec81750:::benchmark_data_smithi188_104537_object19000:head# 2024-04-01T19:36:36.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.136 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec8a858:::benchmark_data_smithi188_104537_object170788:head# 2024-04-01T19:36:36.582 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.582 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec8eff6:::benchmark_data_smithi188_104537_object46566:head# 2024-04-01T19:36:36.582 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.582 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec948de:::benchmark_data_smithi188_104537_object156836:head# 2024-04-01T19:36:36.582 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.582 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec9798b:::benchmark_data_smithi188_104537_object27275:head# 2024-04-01T19:36:36.582 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.582 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec9aca4:::benchmark_data_smithi188_104537_object97321:head# 2024-04-01T19:36:36.582 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.582 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ec9eca0:::benchmark_data_smithi188_104537_object150160:head# 2024-04-01T19:36:36.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ecb3a57:::benchmark_data_smithi188_104537_object110813:head# 2024-04-01T19:36:36.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ecb9dbf:::benchmark_data_smithi188_104537_object72730:head# 2024-04-01T19:36:36.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ecc2832:::benchmark_data_smithi188_104537_object110018:head# 2024-04-01T19:36:36.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eccadd2:::benchmark_data_smithi188_104537_object78828:head# 2024-04-01T19:36:36.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ecccaf9:::benchmark_data_smithi188_104537_object115719:head# 2024-04-01T19:36:36.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ecd2a9d:::benchmark_data_smithi188_104537_object79748:head# 2024-04-01T19:36:36.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ecd72dd:::benchmark_data_smithi188_104537_object113233:head# 2024-04-01T19:36:36.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ecd9311:::benchmark_data_smithi188_104537_object57853:head# 2024-04-01T19:36:36.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ecd9f46:::benchmark_data_smithi188_104537_object54885:head# 2024-04-01T19:36:36.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ecdbea2:::benchmark_data_smithi188_104537_object26362:head# 2024-04-01T19:36:36.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ecdc694:::benchmark_data_smithi188_104537_object127188:head# 2024-04-01T19:36:36.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ecdd499:::benchmark_data_smithi188_104537_object17499:head# 2024-04-01T19:36:36.585 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.585 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ece62ee:::benchmark_data_smithi188_104537_object24044:head# 2024-04-01T19:36:36.585 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.585 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ecf053e:::benchmark_data_smithi188_104537_object65806:head# 2024-04-01T19:36:36.585 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.585 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ecf8aab:::benchmark_data_smithi188_104537_object44072:head# 2024-04-01T19:36:36.585 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.585 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ecf91ad:::benchmark_data_smithi188_104537_object123809:head# 2024-04-01T19:36:36.585 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.585 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ed04dad:::benchmark_data_smithi188_104537_object70204:head# 2024-04-01T19:36:36.585 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.585 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ed06113:::benchmark_data_smithi188_104537_object64598:head# 2024-04-01T19:36:36.585 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.585 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ed099af:::benchmark_data_smithi188_104537_object16521:head# 2024-04-01T19:36:36.585 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.586 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ed09d7a:::benchmark_data_smithi188_104537_object51122:head# 2024-04-01T19:36:36.586 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.586 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ed0e2c5:::benchmark_data_smithi188_104537_object90642:head# 2024-04-01T19:36:36.586 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.586 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ed103c2:::benchmark_data_smithi188_104537_object136398:head# 2024-04-01T19:36:36.586 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.586 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ed11358:::benchmark_data_smithi188_104537_object157462:head# 2024-04-01T19:36:36.586 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.586 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ed14f50:::benchmark_data_smithi188_104537_object78076:head# 2024-04-01T19:36:36.586 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ed16fd6:::benchmark_data_smithi188_104537_object48208:head# 2024-04-01T19:36:36.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ed256e7:::benchmark_data_smithi188_104537_object86689:head# 2024-04-01T19:36:36.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ed2ee53:::benchmark_data_smithi188_104537_object167279:head# 2024-04-01T19:36:36.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ed2f8c5:::benchmark_data_smithi188_104537_object75795:head# 2024-04-01T19:36:36.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ed42f1a:::benchmark_data_smithi188_104537_object52380:head# 2024-04-01T19:36:36.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ed4bd18:::benchmark_data_smithi188_104537_object156261:head# 2024-04-01T19:36:36.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ed55693:::benchmark_data_smithi188_104537_object91099:head# 2024-04-01T19:36:36.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ed5c480:::benchmark_data_smithi188_104537_object156357:head# 2024-04-01T19:36:36.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ed687d2:::benchmark_data_smithi188_104537_object35356:head# 2024-04-01T19:36:36.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ed69cbc:::benchmark_data_smithi188_104537_object128039:head# 2024-04-01T19:36:36.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ed6c46a:::benchmark_data_smithi188_104537_object153989:head# 2024-04-01T19:36:36.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ed76eb9:::benchmark_data_smithi188_104537_object41432:head# 2024-04-01T19:36:36.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ed8df91:::benchmark_data_smithi188_104537_object94759:head# 2024-04-01T19:36:36.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.589 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:36:36.590 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:36 smithi022 ceph-mon[39439]: pgmap v909: 17 pgs: 17 active+clean; 9.4 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 841 op/s; 14 MiB/s, 227 objects/s recovering 2024-04-01T19:36:36.637 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:36 smithi188 ceph-mon[43939]: pgmap v909: 17 pgs: 17 active+clean; 9.4 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 841 op/s; 14 MiB/s, 227 objects/s recovering 2024-04-01T19:36:36.637 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:36.655 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:36:36.661 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:36.663 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:36:36.688 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ed914ed:::benchmark_data_smithi188_104537_object63009:head# 2024-04-01T19:36:36.688 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.688 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ed976f0:::benchmark_data_smithi188_104537_object146778:head# 2024-04-01T19:36:36.688 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.688 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ed9ab4d:::benchmark_data_smithi188_104537_object93578:head# 2024-04-01T19:36:36.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.689 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eda3019:::benchmark_data_smithi188_104537_object99370:head# 2024-04-01T19:36:36.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.689 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5edac70e:::benchmark_data_smithi188_104537_object126487:head# 2024-04-01T19:36:36.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.689 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5edbcf4d:::benchmark_data_smithi188_104537_object32207:head# 2024-04-01T19:36:36.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.689 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5edd3435:::benchmark_data_smithi188_104537_object50854:head# 2024-04-01T19:36:36.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.689 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5edd5a32:::benchmark_data_smithi188_104537_object147022:head# 2024-04-01T19:36:36.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.689 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eddba0d:::benchmark_data_smithi188_104537_object24698:head# 2024-04-01T19:36:36.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.690 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eddd056:::benchmark_data_smithi188_104537_object165131:head# 2024-04-01T19:36:36.690 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.690 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5edde6f2:::benchmark_data_smithi188_104537_object167387:head# 2024-04-01T19:36:36.690 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.690 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ede317d:::benchmark_data_smithi188_104537_object85977:head# 2024-04-01T19:36:36.690 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.690 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ede3203:::benchmark_data_smithi188_104537_object31285:head# 2024-04-01T19:36:36.690 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.690 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5edeec8e:::benchmark_data_smithi188_104537_object98215:head# 2024-04-01T19:36:36.690 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.690 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5edf4dc7:::benchmark_data_smithi188_104537_object124158:head# 2024-04-01T19:36:36.690 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.691 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5edfb054:::benchmark_data_smithi188_104537_object141715:head# 2024-04-01T19:36:36.691 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.691 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5edff746:::benchmark_data_smithi188_104537_object87356:head# 2024-04-01T19:36:36.691 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.691 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ee01539:::benchmark_data_smithi188_104537_object127523:head# 2024-04-01T19:36:36.691 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.691 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ee0a7f6:::benchmark_data_smithi188_104537_object142418:head# 2024-04-01T19:36:36.691 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.691 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ee1f3a8:::benchmark_data_smithi188_104537_object90377:head# 2024-04-01T19:36:36.692 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.692 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ee20c44:::benchmark_data_smithi188_104537_object48032:head# 2024-04-01T19:36:36.692 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.692 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ee2aaf3:::benchmark_data_smithi188_104537_object166117:head# 2024-04-01T19:36:36.692 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.692 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ee350f9:::benchmark_data_smithi188_104537_object146631:head# 2024-04-01T19:36:36.692 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.692 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ee35866:::benchmark_data_smithi188_104537_object49886:head# 2024-04-01T19:36:36.692 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.692 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ee3db20:::benchmark_data_smithi188_104537_object116458:head# 2024-04-01T19:36:36.692 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.693 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ee423f7:::benchmark_data_smithi188_104537_object40695:head# 2024-04-01T19:36:36.693 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.693 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ee45ca1:::benchmark_data_smithi188_104537_object108897:head# 2024-04-01T19:36:36.693 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.693 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ee48b85:::benchmark_data_smithi188_104537_object120684:head# 2024-04-01T19:36:36.693 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.693 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ee65582:::benchmark_data_smithi188_104537_object135943:head# 2024-04-01T19:36:36.693 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.693 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ee6cb6e:::benchmark_data_smithi188_104537_object29187:head# 2024-04-01T19:36:36.693 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.693 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ee79b77:::benchmark_data_smithi188_104537_object21665:head# 2024-04-01T19:36:36.693 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.693 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ee7bedb:::benchmark_data_smithi188_104537_object126543:head# 2024-04-01T19:36:36.693 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.694 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ee81bf0:::benchmark_data_smithi188_104537_object36299:head# 2024-04-01T19:36:36.694 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.694 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ee83602:::benchmark_data_smithi188_104537_object160803:head# 2024-04-01T19:36:36.694 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.694 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ee85b20:::benchmark_data_smithi188_104537_object54466:head# 2024-04-01T19:36:36.694 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.694 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ee954aa:::benchmark_data_smithi188_104537_object39190:head# 2024-04-01T19:36:36.694 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.694 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ee9983c:::benchmark_data_smithi188_104537_object111411:head# 2024-04-01T19:36:36.694 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.695 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ee9afb0:::benchmark_data_smithi188_104537_object35978:head# 2024-04-01T19:36:36.695 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.695 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eea9ec2:::benchmark_data_smithi188_104537_object135186:head# 2024-04-01T19:36:36.695 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.695 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eeae412:::benchmark_data_smithi188_104537_object75412:head# 2024-04-01T19:36:36.695 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.695 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eeaf255:::benchmark_data_smithi188_104537_object20556:head# 2024-04-01T19:36:36.695 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.695 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eec06c3:::benchmark_data_smithi188_104537_object136835:head# 2024-04-01T19:36:36.695 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.695 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eec286b:::benchmark_data_smithi188_104537_object52546:head# 2024-04-01T19:36:36.696 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.696 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eec29d9:::benchmark_data_smithi188_104537_object154169:head# 2024-04-01T19:36:36.696 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.696 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eec357f:::benchmark_data_smithi188_104537_object163676:head# 2024-04-01T19:36:36.696 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.696 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eedfb1e:::benchmark_data_smithi188_104537_object169648:head# 2024-04-01T19:36:36.696 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eef34a2:::benchmark_data_smithi188_104537_object132133:head# 2024-04-01T19:36:36.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eef4554:::benchmark_data_smithi188_104537_object39570:head# 2024-04-01T19:36:36.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eef6733:::benchmark_data_smithi188_104537_object165176:head# 2024-04-01T19:36:36.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eef7ea4:::benchmark_data_smithi188_104537_object152893:head# 2024-04-01T19:36:36.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eefc2f6:::benchmark_data_smithi188_104537_object96107:head# 2024-04-01T19:36:36.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.698 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ef15cf7:::benchmark_data_smithi188_104537_object63350:head# 2024-04-01T19:36:36.698 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.698 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ef185af:::benchmark_data_smithi188_104537_object51884:head# 2024-04-01T19:36:36.698 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.698 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ef22e86:::benchmark_data_smithi188_104537_object96817:head# 2024-04-01T19:36:36.699 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.699 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ef264c6:::benchmark_data_smithi188_104537_object128990:head# 2024-04-01T19:36:36.699 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.699 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ef31e6f:::benchmark_data_smithi188_104537_object31960:head# 2024-04-01T19:36:36.699 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.699 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ef34fb7:::benchmark_data_smithi188_104537_object33459:head# 2024-04-01T19:36:36.699 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.699 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ef3d475:::benchmark_data_smithi188_104537_object171920:head# 2024-04-01T19:36:36.699 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.699 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ef46da4:::benchmark_data_smithi188_104537_object126397:head# 2024-04-01T19:36:36.699 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.699 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ef52275:::benchmark_data_smithi188_104537_object20786:head# 2024-04-01T19:36:36.699 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.699 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ef69499:::benchmark_data_smithi188_104537_object26568:head# 2024-04-01T19:36:36.700 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.700 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ef69d79:::benchmark_data_smithi188_104537_object137204:head# 2024-04-01T19:36:36.700 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.700 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ef6bad1:::benchmark_data_smithi188_104537_object73908:head# 2024-04-01T19:36:36.700 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.700 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ef78a90:::benchmark_data_smithi188_104537_object143995:head# 2024-04-01T19:36:36.700 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.700 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ef7b0e7:::benchmark_data_smithi188_104537_object71342:head# 2024-04-01T19:36:36.700 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.700 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ef8bf5a:::benchmark_data_smithi188_104537_object33108:head# 2024-04-01T19:36:36.700 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.700 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ef8c097:::benchmark_data_smithi188_104537_object143171:head# 2024-04-01T19:36:36.700 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.700 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ef8cbe5:::benchmark_data_smithi188_104537_object96545:head# 2024-04-01T19:36:36.700 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ef8cc99:::benchmark_data_smithi188_104537_object143638:head# 2024-04-01T19:36:36.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ef9d674:::benchmark_data_smithi188_104537_object49913:head# 2024-04-01T19:36:36.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5efa1b0c:::benchmark_data_smithi188_104537_object128606:head# 2024-04-01T19:36:36.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5efa4524:::benchmark_data_smithi188_104537_object161378:head# 2024-04-01T19:36:36.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5efabd5b:::benchmark_data_smithi188_104537_object18057:head# 2024-04-01T19:36:36.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5efae814:::benchmark_data_smithi188_104537_object148862:head# 2024-04-01T19:36:36.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5efb332f:::benchmark_data_smithi188_104537_object99377:head# 2024-04-01T19:36:36.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5efb4ce6:::benchmark_data_smithi188_104537_object154919:head# 2024-04-01T19:36:36.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.702 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5efbdcf1:::benchmark_data_smithi188_104537_object59372:head# 2024-04-01T19:36:36.702 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.702 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5efc27b5:::benchmark_data_smithi188_104537_object33198:head# 2024-04-01T19:36:36.702 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.702 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5efd6c0d:::benchmark_data_smithi188_104537_object100842:head# 2024-04-01T19:36:36.702 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.702 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5efe08ce:::benchmark_data_smithi188_104537_object121293:head# 2024-04-01T19:36:36.702 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.702 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5efe7fd7:::benchmark_data_smithi188_104537_object20274:head# 2024-04-01T19:36:36.702 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.702 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5efe96af:::benchmark_data_smithi188_104537_object81294:head# 2024-04-01T19:36:36.702 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.702 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5efebe75:::benchmark_data_smithi188_104537_object129933:head# 2024-04-01T19:36:36.702 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.703 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5eff7d97:::benchmark_data_smithi188_104537_object51871:head# 2024-04-01T19:36:36.703 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.703 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f001038:::benchmark_data_smithi188_104537_object68905:head# 2024-04-01T19:36:36.703 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.703 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f00a657:::benchmark_data_smithi188_104537_object60014:head# 2024-04-01T19:36:36.703 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.703 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f00ed6a:::benchmark_data_smithi188_104537_object16967:head# 2024-04-01T19:36:36.703 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.703 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f022b07:::benchmark_data_smithi188_104537_object149365:head# 2024-04-01T19:36:36.703 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.703 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f025448:::benchmark_data_smithi188_104537_object21521:head# 2024-04-01T19:36:36.703 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.703 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f027b28:::benchmark_data_smithi188_104537_object160597:head# 2024-04-01T19:36:36.703 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.703 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f02822d:::benchmark_data_smithi188_104537_object39813:head# 2024-04-01T19:36:36.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f04080b:::benchmark_data_smithi188_104537_object75310:head# 2024-04-01T19:36:36.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f045d06:::benchmark_data_smithi188_104537_object127964:head# 2024-04-01T19:36:36.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f04686a:::benchmark_data_smithi188_104537_object18473:head# 2024-04-01T19:36:36.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f04c174:::benchmark_data_smithi188_104537_object92457:head# 2024-04-01T19:36:36.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f051d49:::benchmark_data_smithi188_104537_object26530:head# 2024-04-01T19:36:36.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f0559ad:::benchmark_data_smithi188_104537_object96624:head# 2024-04-01T19:36:36.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f059e9b:::benchmark_data_smithi188_104537_object125244:head# 2024-04-01T19:36:36.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.705 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f05f068:::benchmark_data_smithi188_104537_object51111:head# 2024-04-01T19:36:36.705 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.705 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f05f6b2:::benchmark_data_smithi188_104537_object22686:head# 2024-04-01T19:36:36.705 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.705 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f065b6b:::benchmark_data_smithi188_104537_object21011:head# 2024-04-01T19:36:36.705 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.705 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f0680e0:::benchmark_data_smithi188_104537_object39594:head# 2024-04-01T19:36:36.705 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.705 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f074c9e:::benchmark_data_smithi188_104537_object169299:head# 2024-04-01T19:36:36.705 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.705 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f0807d5:::benchmark_data_smithi188_104537_object70570:head# 2024-04-01T19:36:36.705 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.705 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f084fd0:::benchmark_data_smithi188_104537_object90443:head# 2024-04-01T19:36:36.705 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.705 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f086b02:::benchmark_data_smithi188_104537_object67574:head# 2024-04-01T19:36:36.706 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.706 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f08e173:::benchmark_data_smithi188_104537_object37315:head# 2024-04-01T19:36:36.706 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.706 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f09a2f8:::benchmark_data_smithi188_104537_object19118:head# 2024-04-01T19:36:36.706 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.706 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f09c5e9:::benchmark_data_smithi188_104537_object109713:head# 2024-04-01T19:36:36.706 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.706 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f09df77:::benchmark_data_smithi188_104537_object83496:head# 2024-04-01T19:36:36.706 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.706 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f0ae08c:::benchmark_data_smithi188_104537_object48066:head# 2024-04-01T19:36:36.706 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.706 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f0afba6:::benchmark_data_smithi188_104537_object68688:head# 2024-04-01T19:36:36.706 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.706 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f0b46d9:::benchmark_data_smithi188_104537_object74350:head# 2024-04-01T19:36:36.707 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.707 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f0b6412:::benchmark_data_smithi188_104537_object118977:head# 2024-04-01T19:36:36.707 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.707 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f0c623f:::benchmark_data_smithi188_104537_object159801:head# 2024-04-01T19:36:36.707 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.707 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f0d006c:::benchmark_data_smithi188_104537_object94745:head# 2024-04-01T19:36:36.707 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.707 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f0d4953:::benchmark_data_smithi188_104537_object117388:head# 2024-04-01T19:36:36.707 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.707 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f0d6262:::benchmark_data_smithi188_104537_object133155:head# 2024-04-01T19:36:36.707 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.707 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f0e4eab:::benchmark_data_smithi188_104537_object71371:head# 2024-04-01T19:36:36.707 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.707 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f0e62d5:::benchmark_data_smithi188_104537_object63190:head# 2024-04-01T19:36:36.707 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.707 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f0f89eb:::benchmark_data_smithi188_104537_object70047:head# 2024-04-01T19:36:36.708 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.708 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f0f9c1c:::benchmark_data_smithi188_104537_object76207:head# 2024-04-01T19:36:36.708 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.708 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f0fe495:::benchmark_data_smithi188_104537_object61603:head# 2024-04-01T19:36:36.708 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.708 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f0fe5e4:::benchmark_data_smithi188_104537_object105078:head# 2024-04-01T19:36:36.708 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.708 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f101bad:::benchmark_data_smithi188_104537_object137039:head# 2024-04-01T19:36:36.708 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.708 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f105c20:::benchmark_data_smithi188_104537_object56983:head# 2024-04-01T19:36:36.708 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.708 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f1079b8:::benchmark_data_smithi188_104537_object70960:head# 2024-04-01T19:36:36.708 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.708 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f115cf5:::benchmark_data_smithi188_104537_object41669:head# 2024-04-01T19:36:36.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f12c31f:::benchmark_data_smithi188_104537_object76717:head# 2024-04-01T19:36:36.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f12d7f6:::benchmark_data_smithi188_104537_object33264:head# 2024-04-01T19:36:36.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f132153:::benchmark_data_smithi188_104537_object63519:head# 2024-04-01T19:36:36.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f132b5d:::benchmark_data_smithi188_104537_object117452:head# 2024-04-01T19:36:36.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f13cbd9:::benchmark_data_smithi188_104537_object121844:head# 2024-04-01T19:36:36.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f13dde2:::benchmark_data_smithi188_104537_object103197:head# 2024-04-01T19:36:36.710 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.710 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f13e082:::benchmark_data_smithi188_104537_object89801:head# 2024-04-01T19:36:36.710 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.710 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f140322:::benchmark_data_smithi188_104537_object126366:head# 2024-04-01T19:36:36.710 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.710 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f144c85:::benchmark_data_smithi188_104537_object96168:head# 2024-04-01T19:36:36.710 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.710 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f157ec9:::benchmark_data_smithi188_104537_object23706:head# 2024-04-01T19:36:36.710 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.710 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f15add1:::benchmark_data_smithi188_104537_object85075:head# 2024-04-01T19:36:36.710 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.710 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f163265:::benchmark_data_smithi188_104537_object93724:head# 2024-04-01T19:36:36.710 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.711 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f16843b:::benchmark_data_smithi188_104537_object99697:head# 2024-04-01T19:36:36.711 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.711 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f16db07:::benchmark_data_smithi188_104537_object67630:head# 2024-04-01T19:36:36.711 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.711 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f17f127:::benchmark_data_smithi188_104537_object162264:head# 2024-04-01T19:36:36.711 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.711 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f17fe57:::benchmark_data_smithi188_104537_object100652:head# 2024-04-01T19:36:36.711 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.711 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f18228c:::benchmark_data_smithi188_104537_object24560:head# 2024-04-01T19:36:36.711 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.711 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f1911c7:::benchmark_data_smithi188_104537_object75791:head# 2024-04-01T19:36:36.711 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.711 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f194b8d:::benchmark_data_smithi188_104537_object156108:head# 2024-04-01T19:36:36.711 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f196f26:::benchmark_data_smithi188_104537_object155512:head# 2024-04-01T19:36:36.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f198b97:::benchmark_data_smithi188_104537_object58261:head# 2024-04-01T19:36:36.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f19c97e:::benchmark_data_smithi188_104537_object85137:head# 2024-04-01T19:36:36.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f1a41dc:::benchmark_data_smithi188_104537_object58340:head# 2024-04-01T19:36:36.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f1b0027:::benchmark_data_smithi188_104537_object168899:head# 2024-04-01T19:36:36.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f1b8162:::benchmark_data_smithi188_104537_object170175:head# 2024-04-01T19:36:36.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f1b99d2:::benchmark_data_smithi188_104537_object147008:head# 2024-04-01T19:36:36.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f1ba42c:::benchmark_data_smithi188_104537_object90818:head# 2024-04-01T19:36:36.713 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.713 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f1c173e:::benchmark_data_smithi188_104537_object52422:head# 2024-04-01T19:36:36.713 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.713 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f1c8157:::benchmark_data_smithi188_104537_object94645:head# 2024-04-01T19:36:36.713 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.713 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f1c8ef7:::benchmark_data_smithi188_104537_object72240:head# 2024-04-01T19:36:36.713 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.713 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f1cc69a:::benchmark_data_smithi188_104537_object156370:head# 2024-04-01T19:36:36.713 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.713 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f1d8c7d:::benchmark_data_smithi188_104537_object98009:head# 2024-04-01T19:36:36.713 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.713 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f1dd910:::benchmark_data_smithi188_104537_object118680:head# 2024-04-01T19:36:36.713 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.714 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f1df368:::benchmark_data_smithi188_104537_object15261:head# 2024-04-01T19:36:36.714 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.714 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f1e49e5:::benchmark_data_smithi188_104537_object49598:head# 2024-04-01T19:36:36.714 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.714 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f1e6547:::benchmark_data_smithi188_104537_object12233:head# 2024-04-01T19:36:36.714 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.714 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f1eb4ad:::benchmark_data_smithi188_104537_object160924:head# 2024-04-01T19:36:36.714 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.714 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f1eec83:::benchmark_data_smithi188_104537_object154054:head# 2024-04-01T19:36:36.714 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.714 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f1f1100:::benchmark_data_smithi188_104537_object123427:head# 2024-04-01T19:36:36.714 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.714 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f1f6d03:::benchmark_data_smithi188_104537_object119632:head# 2024-04-01T19:36:36.714 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.714 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f2081e9:::benchmark_data_smithi188_104537_object26298:head# 2024-04-01T19:36:36.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f208f6a:::benchmark_data_smithi188_104537_object118869:head# 2024-04-01T19:36:36.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f209454:::benchmark_data_smithi188_104537_object52847:head# 2024-04-01T19:36:36.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f20f132:::benchmark_data_smithi188_104537_object134168:head# 2024-04-01T19:36:36.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f216e3d:::benchmark_data_smithi188_104537_object50005:head# 2024-04-01T19:36:36.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f21885e:::benchmark_data_smithi188_104537_object128187:head# 2024-04-01T19:36:36.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f219df4:::benchmark_data_smithi188_104537_object117711:head# 2024-04-01T19:36:36.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f2271d6:::benchmark_data_smithi188_104537_object138849:head# 2024-04-01T19:36:36.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.716 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f2292b9:::benchmark_data_smithi188_104537_object18707:head# 2024-04-01T19:36:36.716 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.716 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f22aed6:::benchmark_data_smithi188_104537_object74431:head# 2024-04-01T19:36:36.716 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.716 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f22d7e3:::benchmark_data_smithi188_104537_object158558:head# 2024-04-01T19:36:36.716 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.716 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f235a59:::benchmark_data_smithi188_104537_object114522:head# 2024-04-01T19:36:36.716 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.716 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f23da70:::benchmark_data_smithi188_104537_object34817:head# 2024-04-01T19:36:36.716 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.716 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f23e289:::benchmark_data_smithi188_104537_object151506:head# 2024-04-01T19:36:36.716 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.716 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f24313a:::benchmark_data_smithi188_104537_object108115:head# 2024-04-01T19:36:36.716 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.716 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f24422d:::benchmark_data_smithi188_104537_object23415:head# 2024-04-01T19:36:36.717 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.717 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f24c40e:::benchmark_data_smithi188_104537_object11197:head# 2024-04-01T19:36:36.717 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.717 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f2525b9:::benchmark_data_smithi188_104537_object27807:head# 2024-04-01T19:36:36.717 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.717 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f252ca8:::benchmark_data_smithi188_104537_object78072:head# 2024-04-01T19:36:36.717 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.717 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f25b089:::benchmark_data_smithi188_104537_object167972:head# 2024-04-01T19:36:36.717 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.717 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f26204a:::benchmark_data_smithi188_104537_object169726:head# 2024-04-01T19:36:36.717 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.717 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f26cf07:::benchmark_data_smithi188_104537_object148996:head# 2024-04-01T19:36:36.717 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.717 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f2708ec:::benchmark_data_smithi188_104537_object71094:head# 2024-04-01T19:36:36.718 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.718 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f273372:::benchmark_data_smithi188_104537_object98277:head# 2024-04-01T19:36:36.718 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.718 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f27d325:::benchmark_data_smithi188_104537_object95768:head# 2024-04-01T19:36:36.718 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.718 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f284116:::benchmark_data_smithi188_104537_object138802:head# 2024-04-01T19:36:36.718 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.718 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f28b214:::benchmark_data_smithi188_104537_object105362:head# 2024-04-01T19:36:36.718 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.718 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f28d63e:::benchmark_data_smithi188_104537_object30145:head# 2024-04-01T19:36:36.718 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.718 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f28eacf:::benchmark_data_smithi188_104537_object90600:head# 2024-04-01T19:36:36.718 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.719 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f294a98:::benchmark_data_smithi188_104537_object40268:head# 2024-04-01T19:36:36.719 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.719 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f295066:::benchmark_data_smithi188_104537_object68610:head# 2024-04-01T19:36:36.719 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.719 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f298002:::benchmark_data_smithi188_104537_object21078:head# 2024-04-01T19:36:36.719 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.719 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f29d864:::benchmark_data_smithi188_104537_object98629:head# 2024-04-01T19:36:36.719 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.719 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f2adccf:::benchmark_data_smithi188_104537_object120343:head# 2024-04-01T19:36:36.719 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.719 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f2b0176:::benchmark_data_smithi188_104537_object155011:head# 2024-04-01T19:36:36.719 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.719 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f2c7c1d:::benchmark_data_smithi188_104537_object86021:head# 2024-04-01T19:36:36.719 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.719 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f2c7c7a:::benchmark_data_smithi188_104537_object30613:head# 2024-04-01T19:36:36.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f2d168b:::benchmark_data_smithi188_104537_object20037:head# 2024-04-01T19:36:36.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f2d5133:::benchmark_data_smithi188_104537_object126970:head# 2024-04-01T19:36:36.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f2d98b6:::benchmark_data_smithi188_104537_object151664:head# 2024-04-01T19:36:36.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f2dba85:::benchmark_data_smithi188_104537_object77062:head# 2024-04-01T19:36:36.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f2e2f64:::benchmark_data_smithi188_104537_object102303:head# 2024-04-01T19:36:36.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f2ead98:::benchmark_data_smithi188_104537_object40780:head# 2024-04-01T19:36:36.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f2edf2b:::benchmark_data_smithi188_104537_object102925:head# 2024-04-01T19:36:36.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.721 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f2fb05c:::benchmark_data_smithi188_104537_object154907:head# 2024-04-01T19:36:36.721 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.721 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f2fbe18:::benchmark_data_smithi188_104537_object108139:head# 2024-04-01T19:36:36.721 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.721 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f305e31:::benchmark_data_smithi188_104537_object83476:head# 2024-04-01T19:36:36.721 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.721 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f30f34e:::benchmark_data_smithi188_104537_object154719:head# 2024-04-01T19:36:36.721 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.721 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f30f707:::benchmark_data_smithi188_104537_object68465:head# 2024-04-01T19:36:36.721 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.721 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f310852:::benchmark_data_smithi188_104537_object110862:head# 2024-04-01T19:36:36.721 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.721 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f31f28b:::benchmark_data_smithi188_104537_object162599:head# 2024-04-01T19:36:36.721 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.721 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f328e57:::benchmark_data_smithi188_104537_object138180:head# 2024-04-01T19:36:36.721 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f3295e8:::benchmark_data_smithi188_104537_object151094:head# 2024-04-01T19:36:36.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f32e28b:::benchmark_data_smithi188_104537_object159987:head# 2024-04-01T19:36:36.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f32e7b7:::benchmark_data_smithi188_104537_object81128:head# 2024-04-01T19:36:36.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f32fb9e:::benchmark_data_smithi188_104537_object19047:head# 2024-04-01T19:36:36.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f3325df:::benchmark_data_smithi188_104537_object138518:head# 2024-04-01T19:36:36.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f338b62:::benchmark_data_smithi188_104537_object143010:head# 2024-04-01T19:36:36.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f347a63:::benchmark_data_smithi188_104537_object152615:head# 2024-04-01T19:36:36.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.723 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f35205c:::benchmark_data_smithi188_104537_object147467:head# 2024-04-01T19:36:36.723 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.723 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f359ad5:::benchmark_data_smithi188_104537_object126376:head# 2024-04-01T19:36:36.723 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.723 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f35c64e:::benchmark_data_smithi188_104537_object66531:head# 2024-04-01T19:36:36.723 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.723 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f35e5e4:::benchmark_data_smithi188_104537_object144593:head# 2024-04-01T19:36:36.723 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.723 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f364233:::benchmark_data_smithi188_104537_object169338:head# 2024-04-01T19:36:36.723 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.723 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f3653cb:::benchmark_data_smithi188_104537_object58410:head# 2024-04-01T19:36:36.723 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.723 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f36caa7:::benchmark_data_smithi188_104537_object56367:head# 2024-04-01T19:36:36.723 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.723 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f373c47:::benchmark_data_smithi188_104537_object116972:head# 2024-04-01T19:36:36.723 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.724 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f374c57:::benchmark_data_smithi188_104537_object130627:head# 2024-04-01T19:36:36.724 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.724 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f37676b:::benchmark_data_smithi188_104537_object17200:head# 2024-04-01T19:36:36.724 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.724 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f37ee21:::benchmark_data_smithi188_104537_object161732:head# 2024-04-01T19:36:36.724 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.724 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f3821e0:::benchmark_data_smithi188_104537_object163120:head# 2024-04-01T19:36:36.724 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.724 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f386587:::benchmark_data_smithi188_104537_object127511:head# 2024-04-01T19:36:36.724 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.724 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f38b7c3:::benchmark_data_smithi188_104537_object68737:head# 2024-04-01T19:36:36.724 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.724 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f392de5:::benchmark_data_smithi188_104537_object105827:head# 2024-04-01T19:36:36.724 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.724 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f39b297:::benchmark_data_smithi188_104537_object132074:head# 2024-04-01T19:36:36.724 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.725 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f3a6852:::benchmark_data_smithi188_104537_object60974:head# 2024-04-01T19:36:36.725 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.725 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f3a730b:::benchmark_data_smithi188_104537_object39063:head# 2024-04-01T19:36:36.725 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.725 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f3b33fb:::benchmark_data_smithi188_104537_object145089:head# 2024-04-01T19:36:36.725 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.725 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f3b3d8d:::benchmark_data_smithi188_104537_object46130:head# 2024-04-01T19:36:36.725 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.725 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f3b6736:::benchmark_data_smithi188_104537_object23245:head# 2024-04-01T19:36:36.725 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.725 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f3bbcad:::benchmark_data_smithi188_104537_object136551:head# 2024-04-01T19:36:36.725 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.725 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f3c4110:::benchmark_data_smithi188_104537_object84856:head# 2024-04-01T19:36:36.725 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.726 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f3cd74f:::benchmark_data_smithi188_104537_object62851:head# 2024-04-01T19:36:36.726 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.726 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f3cfe31:::benchmark_data_smithi188_104537_object98025:head# 2024-04-01T19:36:36.726 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.726 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f3d49e7:::benchmark_data_smithi188_104537_object90387:head# 2024-04-01T19:36:36.726 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.726 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f3dc1e4:::benchmark_data_smithi188_104537_object72192:head# 2024-04-01T19:36:36.726 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.726 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f3de06e:::benchmark_data_smithi188_104537_object126472:head# 2024-04-01T19:36:36.726 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.726 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f3df89c:::benchmark_data_smithi188_104537_object125930:head# 2024-04-01T19:36:36.726 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.726 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f3f1fa9:::benchmark_data_smithi188_104537_object34955:head# 2024-04-01T19:36:36.727 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.727 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f3f5985:::benchmark_data_smithi188_104537_object140604:head# 2024-04-01T19:36:36.727 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.727 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f3f7750:::benchmark_data_smithi188_104537_object53838:head# 2024-04-01T19:36:36.727 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.727 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f3f7cae:::benchmark_data_smithi188_104537_object37116:head# 2024-04-01T19:36:36.727 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.727 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f3fa7eb:::benchmark_data_smithi188_104537_object105852:head# 2024-04-01T19:36:36.727 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.727 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f3fe17d:::benchmark_data_smithi188_104537_object128809:head# 2024-04-01T19:36:36.727 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.727 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f4121b6:::benchmark_data_smithi188_104537_object59154:head# 2024-04-01T19:36:36.727 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.728 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f416fc2:::benchmark_data_smithi188_104537_object81682:head# 2024-04-01T19:36:36.728 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.728 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f41c972:::benchmark_data_smithi188_104537_object148964:head# 2024-04-01T19:36:36.728 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.728 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f4202c7:::benchmark_data_smithi188_104537_object140927:head# 2024-04-01T19:36:36.728 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.728 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f422057:::benchmark_data_smithi188_104537_object142704:head# 2024-04-01T19:36:36.728 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.728 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f426760:::benchmark_data_smithi188_104537_object121212:head# 2024-04-01T19:36:36.728 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.728 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f429562:::benchmark_data_smithi188_104537_object126665:head# 2024-04-01T19:36:36.729 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.729 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f431739:::benchmark_data_smithi188_104537_object142391:head# 2024-04-01T19:36:36.729 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.729 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f4328cc:::benchmark_data_smithi188_104537_object54312:head# 2024-04-01T19:36:36.729 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.729 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f436b24:::benchmark_data_smithi188_104537_object65261:head# 2024-04-01T19:36:36.729 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.729 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f43a4f8:::benchmark_data_smithi188_104537_object15106:head# 2024-04-01T19:36:36.729 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.729 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f43d1b3:::benchmark_data_smithi188_104537_object83212:head# 2024-04-01T19:36:36.729 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.729 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f4448d5:::benchmark_data_smithi188_104537_object147156:head# 2024-04-01T19:36:36.729 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.729 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f4452cc:::benchmark_data_smithi188_104537_object93745:head# 2024-04-01T19:36:36.729 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.729 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f44d5a2:::benchmark_data_smithi188_104537_object104929:head# 2024-04-01T19:36:36.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f45086b:::benchmark_data_smithi188_104537_object169055:head# 2024-04-01T19:36:36.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f450941:::benchmark_data_smithi188_104537_object130100:head# 2024-04-01T19:36:36.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f453597:::benchmark_data_smithi188_104537_object170555:head# 2024-04-01T19:36:36.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f4548e4:::benchmark_data_smithi188_104537_object37335:head# 2024-04-01T19:36:36.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f455d81:::benchmark_data_smithi188_104537_object18975:head# 2024-04-01T19:36:36.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f45d194:::benchmark_data_smithi188_104537_object16438:head# 2024-04-01T19:36:36.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f45e84b:::benchmark_data_smithi188_104537_object141779:head# 2024-04-01T19:36:36.731 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.731 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f45fff7:::benchmark_data_smithi188_104537_object67840:head# 2024-04-01T19:36:36.731 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.731 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f467875:::benchmark_data_smithi188_104537_object74385:head# 2024-04-01T19:36:36.731 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.731 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f475db7:::benchmark_data_smithi188_104537_object73380:head# 2024-04-01T19:36:36.731 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.731 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f47caa0:::benchmark_data_smithi188_104537_object160662:head# 2024-04-01T19:36:36.731 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.731 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f48038d:::benchmark_data_smithi188_104537_object25366:head# 2024-04-01T19:36:36.732 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.732 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f481773:::benchmark_data_smithi188_104537_object71829:head# 2024-04-01T19:36:36.732 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.732 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f48e49c:::benchmark_data_smithi188_104537_object44787:head# 2024-04-01T19:36:36.732 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.732 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f48f65d:::benchmark_data_smithi188_104537_object141595:head# 2024-04-01T19:36:36.732 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.732 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f4931df:::benchmark_data_smithi188_104537_object95058:head# 2024-04-01T19:36:36.732 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.732 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f493829:::benchmark_data_smithi188_104537_object112409:head# 2024-04-01T19:36:36.732 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.732 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f495e9e:::benchmark_data_smithi188_104537_object70653:head# 2024-04-01T19:36:36.732 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.733 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f496b0f:::benchmark_data_smithi188_104537_object144040:head# 2024-04-01T19:36:36.733 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.733 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f49bc66:::benchmark_data_smithi188_104537_object82740:head# 2024-04-01T19:36:36.733 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.733 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f49c732:::benchmark_data_smithi188_104537_object77458:head# 2024-04-01T19:36:36.733 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.733 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f49e41d:::benchmark_data_smithi188_104537_object57719:head# 2024-04-01T19:36:36.733 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.733 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f4a9ed8:::benchmark_data_smithi188_104537_object138447:head# 2024-04-01T19:36:36.733 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.733 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f4af68c:::benchmark_data_smithi188_104537_object102070:head# 2024-04-01T19:36:36.733 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.733 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f4b534c:::benchmark_data_smithi188_104537_object155605:head# 2024-04-01T19:36:36.734 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.734 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f4b96cf:::benchmark_data_smithi188_104537_object123769:head# 2024-04-01T19:36:36.734 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.734 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f4c637c:::benchmark_data_smithi188_104537_object112302:head# 2024-04-01T19:36:36.734 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.734 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f4c7529:::benchmark_data_smithi188_104537_object35969:head# 2024-04-01T19:36:36.734 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.734 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f4c9013:::benchmark_data_smithi188_104537_object127470:head# 2024-04-01T19:36:36.734 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.734 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f4cfd4b:::benchmark_data_smithi188_104537_object171609:head# 2024-04-01T19:36:36.734 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.734 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f4d0bea:::benchmark_data_smithi188_104537_object93484:head# 2024-04-01T19:36:36.734 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.735 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f4dc67d:::benchmark_data_smithi188_104537_object26750:head# 2024-04-01T19:36:36.735 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.735 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f4e2f87:::benchmark_data_smithi188_104537_object94296:head# 2024-04-01T19:36:36.735 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.735 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f4e838f:::benchmark_data_smithi188_104537_object91803:head# 2024-04-01T19:36:36.735 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.735 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f4f3c19:::benchmark_data_smithi188_104537_object131593:head# 2024-04-01T19:36:36.735 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.735 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f500357:::benchmark_data_smithi188_104537_object158424:head# 2024-04-01T19:36:36.735 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.735 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f50d156:::benchmark_data_smithi188_104537_object69260:head# 2024-04-01T19:36:36.735 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.735 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f519310:::benchmark_data_smithi188_104537_object106545:head# 2024-04-01T19:36:36.735 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.735 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f5196d3:::benchmark_data_smithi188_104537_object118153:head# 2024-04-01T19:36:36.736 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.736 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f51d08d:::benchmark_data_smithi188_104537_object68132:head# 2024-04-01T19:36:36.736 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.736 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f524228:::benchmark_data_smithi188_104537_object36284:head# 2024-04-01T19:36:36.736 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.736 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f524fad:::benchmark_data_smithi188_104537_object103156:head# 2024-04-01T19:36:36.736 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.736 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f526f32:::benchmark_data_smithi188_104537_object31548:head# 2024-04-01T19:36:36.736 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.736 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f52b376:::benchmark_data_smithi188_104537_object132412:head# 2024-04-01T19:36:36.736 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.736 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f52c7b3:::benchmark_data_smithi188_104537_object83582:head# 2024-04-01T19:36:36.736 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.736 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f533977:::benchmark_data_smithi188_104537_object76116:head# 2024-04-01T19:36:36.737 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.737 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f535780:::benchmark_data_smithi188_104537_object108706:head# 2024-04-01T19:36:36.737 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.737 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f53eb78:::benchmark_data_smithi188_104537_object146566:head# 2024-04-01T19:36:36.737 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.737 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f5422a8:::benchmark_data_smithi188_104537_object81274:head# 2024-04-01T19:36:36.737 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.737 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f54854b:::benchmark_data_smithi188_104537_object89694:head# 2024-04-01T19:36:36.737 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.737 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f549312:::benchmark_data_smithi188_104537_object100417:head# 2024-04-01T19:36:36.737 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.737 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f558ea0:::benchmark_data_smithi188_104537_object130702:head# 2024-04-01T19:36:36.737 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.737 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f55f6ce:::benchmark_data_smithi188_104537_object91167:head# 2024-04-01T19:36:36.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f56de7f:::benchmark_data_smithi188_104537_object119708:head# 2024-04-01T19:36:36.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f56e611:::benchmark_data_smithi188_104537_object41021:head# 2024-04-01T19:36:36.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f56f0e8:::benchmark_data_smithi188_104537_object83179:head# 2024-04-01T19:36:36.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f56f397:::benchmark_data_smithi188_104537_object84768:head# 2024-04-01T19:36:36.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f576f7c:::benchmark_data_smithi188_104537_object59807:head# 2024-04-01T19:36:36.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f577222:::benchmark_data_smithi188_104537_object24202:head# 2024-04-01T19:36:36.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f57992c:::benchmark_data_smithi188_104537_object44172:head# 2024-04-01T19:36:36.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f58341a:::benchmark_data_smithi188_104537_object26529:head# 2024-04-01T19:36:36.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f584ff9:::benchmark_data_smithi188_104537_object32711:head# 2024-04-01T19:36:36.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f58ac3b:::benchmark_data_smithi188_104537_object90347:head# 2024-04-01T19:36:36.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f58d314:::benchmark_data_smithi188_104537_object113664:head# 2024-04-01T19:36:36.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f590fea:::benchmark_data_smithi188_104537_object152420:head# 2024-04-01T19:36:36.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.740 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f5949c3:::benchmark_data_smithi188_104537_object163106:head# 2024-04-01T19:36:36.740 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.740 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f595a87:::benchmark_data_smithi188_104537_object10944:head# 2024-04-01T19:36:36.740 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.740 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f59d689:::benchmark_data_smithi188_104537_object84472:head# 2024-04-01T19:36:36.740 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.740 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f59f740:::benchmark_data_smithi188_104537_object110138:head# 2024-04-01T19:36:36.740 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.740 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f5a54a5:::benchmark_data_smithi188_104537_object75075:head# 2024-04-01T19:36:36.740 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.740 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f5a6c2e:::benchmark_data_smithi188_104537_object132193:head# 2024-04-01T19:36:36.740 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.740 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f5ab0bf:::benchmark_data_smithi188_104537_object169786:head# 2024-04-01T19:36:36.740 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.740 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f5b953a:::benchmark_data_smithi188_104537_object24837:head# 2024-04-01T19:36:36.741 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.741 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f5bad77:::benchmark_data_smithi188_104537_object39058:head# 2024-04-01T19:36:36.741 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.741 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f5c0895:::benchmark_data_smithi188_104537_object62849:head# 2024-04-01T19:36:36.741 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.741 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f5c4ce8:::benchmark_data_smithi188_104537_object113403:head# 2024-04-01T19:36:36.741 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.741 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f5eaedd:::benchmark_data_smithi188_104537_object167745:head# 2024-04-01T19:36:36.741 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.741 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f5ebf04:::benchmark_data_smithi188_104537_object149538:head# 2024-04-01T19:36:36.741 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.741 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f5f0972:::benchmark_data_smithi188_104537_object87285:head# 2024-04-01T19:36:36.741 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.741 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f5f14e6:::benchmark_data_smithi188_104537_object85869:head# 2024-04-01T19:36:36.741 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.742 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f5fad28:::benchmark_data_smithi188_104537_object82258:head# 2024-04-01T19:36:36.742 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.742 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f6003da:::benchmark_data_smithi188_104537_object67164:head# 2024-04-01T19:36:36.742 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.742 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f606fd1:::benchmark_data_smithi188_104537_object105416:head# 2024-04-01T19:36:36.742 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.742 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f6076a3:::benchmark_data_smithi188_104537_object31742:head# 2024-04-01T19:36:36.742 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.742 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f6129c7:::benchmark_data_smithi188_104537_object13488:head# 2024-04-01T19:36:36.742 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.742 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f61771e:::benchmark_data_smithi188_104537_object12005:head# 2024-04-01T19:36:36.742 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.742 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f61c86e:::benchmark_data_smithi188_104537_object112171:head# 2024-04-01T19:36:36.743 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.743 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f621aa4:::benchmark_data_smithi188_104537_object65149:head# 2024-04-01T19:36:36.743 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.743 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f622df2:::benchmark_data_smithi188_104537_object112118:head# 2024-04-01T19:36:36.743 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.743 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f6252b8:::benchmark_data_smithi188_104537_object152959:head# 2024-04-01T19:36:36.743 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.743 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f63fa73:::benchmark_data_smithi188_104537_object155882:head# 2024-04-01T19:36:36.743 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.743 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f662f46:::benchmark_data_smithi188_104537_object163967:head# 2024-04-01T19:36:36.743 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.743 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f674569:::benchmark_data_smithi188_104537_object84910:head# 2024-04-01T19:36:36.743 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.743 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f67497d:::benchmark_data_smithi188_104537_object83312:head# 2024-04-01T19:36:36.743 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.744 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f678cbe:::benchmark_data_smithi188_104537_object154496:head# 2024-04-01T19:36:36.744 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.744 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f6814be:::benchmark_data_smithi188_104537_object113476:head# 2024-04-01T19:36:36.744 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.744 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f6843f3:::benchmark_data_smithi188_104537_object118137:head# 2024-04-01T19:36:36.744 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.744 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f687e9f:::benchmark_data_smithi188_104537_object46514:head# 2024-04-01T19:36:36.744 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.744 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f688d13:::benchmark_data_smithi188_104537_object161846:head# 2024-04-01T19:36:36.744 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.744 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f68ea8c:::benchmark_data_smithi188_104537_object54971:head# 2024-04-01T19:36:36.744 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.744 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f68f63b:::benchmark_data_smithi188_104537_object69834:head# 2024-04-01T19:36:36.744 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.744 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f68fee0:::benchmark_data_smithi188_104537_object69771:head# 2024-04-01T19:36:36.745 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.745 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f69b01a:::benchmark_data_smithi188_104537_object45919:head# 2024-04-01T19:36:36.745 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.745 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f69d6b7:::benchmark_data_smithi188_104537_object140287:head# 2024-04-01T19:36:36.745 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.745 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f6a1152:::benchmark_data_smithi188_104537_object120297:head# 2024-04-01T19:36:36.745 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.745 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f6a9004:::benchmark_data_smithi188_104537_object15397:head# 2024-04-01T19:36:36.745 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.745 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f6a9175:::benchmark_data_smithi188_104537_object131126:head# 2024-04-01T19:36:36.745 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.745 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f6abdab:::benchmark_data_smithi188_104537_object88759:head# 2024-04-01T19:36:36.745 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.745 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f6b50e5:::benchmark_data_smithi188_104537_object98214:head# 2024-04-01T19:36:36.746 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.746 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f6b5703:::benchmark_data_smithi188_104537_object109805:head# 2024-04-01T19:36:36.746 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.746 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f6c9854:::benchmark_data_smithi188_104537_object127107:head# 2024-04-01T19:36:36.746 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.746 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f6ce259:::benchmark_data_smithi188_104537_object139530:head# 2024-04-01T19:36:36.746 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.747 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f6d2457:::benchmark_data_smithi188_104537_object132551:head# 2024-04-01T19:36:36.747 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.747 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f6d77e4:::benchmark_data_smithi188_104537_object35299:head# 2024-04-01T19:36:36.747 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.747 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f6e80c5:::benchmark_data_smithi188_104537_object113738:head# 2024-04-01T19:36:36.747 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.747 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f6e8eca:::benchmark_data_smithi188_104537_object71638:head# 2024-04-01T19:36:36.747 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.747 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f6f5f66:::benchmark_data_smithi188_104537_object24434:head# 2024-04-01T19:36:36.747 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.747 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f6fa708:::benchmark_data_smithi188_104537_object137411:head# 2024-04-01T19:36:36.747 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.747 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f6fd104:::benchmark_data_smithi188_104537_object79710:head# 2024-04-01T19:36:36.747 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.748 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f70b0f1:::benchmark_data_smithi188_104537_object108000:head# 2024-04-01T19:36:36.748 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.748 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f70d630:::benchmark_data_smithi188_104537_object32529:head# 2024-04-01T19:36:36.748 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.748 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f710f00:::benchmark_data_smithi188_104537_object18276:head# 2024-04-01T19:36:36.748 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.748 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f7116e0:::benchmark_data_smithi188_104537_object152950:head# 2024-04-01T19:36:36.748 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.748 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f714d64:::benchmark_data_smithi188_104537_object84504:head# 2024-04-01T19:36:36.748 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.748 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f71ae0f:::benchmark_data_smithi188_104537_object22939:head# 2024-04-01T19:36:36.748 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.749 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f71fdd7:::benchmark_data_smithi188_104537_object134997:head# 2024-04-01T19:36:36.749 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.749 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f72776a:::benchmark_data_smithi188_104537_object27942:head# 2024-04-01T19:36:36.749 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.749 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f72a8d0:::benchmark_data_smithi188_104537_object139352:head# 2024-04-01T19:36:36.749 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.749 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f72b572:::benchmark_data_smithi188_104537_object170009:head# 2024-04-01T19:36:36.749 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.749 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f731603:::benchmark_data_smithi188_104537_object46963:head# 2024-04-01T19:36:36.749 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.749 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f73219a:::benchmark_data_smithi188_104537_object162187:head# 2024-04-01T19:36:36.749 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.749 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f73c507:::benchmark_data_smithi188_104537_object92102:head# 2024-04-01T19:36:36.749 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.750 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f7440be:::benchmark_data_smithi188_104537_object109372:head# 2024-04-01T19:36:36.750 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.750 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f748f84:::benchmark_data_smithi188_104537_object141815:head# 2024-04-01T19:36:36.750 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.750 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f74c8c2:::benchmark_data_smithi188_104537_object78142:head# 2024-04-01T19:36:36.750 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.750 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f7582a0:::benchmark_data_smithi188_104537_object13345:head# 2024-04-01T19:36:36.750 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.750 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f758c59:::benchmark_data_smithi188_104537_object87052:head# 2024-04-01T19:36:36.750 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.750 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f759551:::benchmark_data_smithi188_104537_object55523:head# 2024-04-01T19:36:36.750 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.751 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f75ca34:::benchmark_data_smithi188_104537_object73118:head# 2024-04-01T19:36:36.751 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.751 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f75cca4:::benchmark_data_smithi188_104537_object81121:head# 2024-04-01T19:36:36.751 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.751 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f760166:::benchmark_data_smithi188_104537_object51516:head# 2024-04-01T19:36:36.751 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.751 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f766d0f:::benchmark_data_smithi188_104537_object166351:head# 2024-04-01T19:36:36.751 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.751 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f7682db:::benchmark_data_smithi188_104537_object52053:head# 2024-04-01T19:36:36.752 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.752 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f76c75b:::benchmark_data_smithi188_104537_object17150:head# 2024-04-01T19:36:36.752 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.752 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f771b51:::benchmark_data_smithi188_104537_object31992:head# 2024-04-01T19:36:36.752 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.752 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f778716:::benchmark_data_smithi188_104537_object46864:head# 2024-04-01T19:36:36.752 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.752 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f77ac52:::benchmark_data_smithi188_104537_object135246:head# 2024-04-01T19:36:36.752 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.752 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f77d4c6:::benchmark_data_smithi188_104537_object122746:head# 2024-04-01T19:36:36.752 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.752 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f77dad5:::benchmark_data_smithi188_104537_object157947:head# 2024-04-01T19:36:36.752 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.752 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f77f04f:::benchmark_data_smithi188_104537_object13417:head# 2024-04-01T19:36:36.753 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.753 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f782f58:::benchmark_data_smithi188_104537_object168352:head# 2024-04-01T19:36:36.753 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.753 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f789461:::benchmark_data_smithi188_104537_object97441:head# 2024-04-01T19:36:36.753 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.753 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f796c3c:::benchmark_data_smithi188_104537_object109251:head# 2024-04-01T19:36:36.753 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.753 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f79b135:::benchmark_data_smithi188_104537_object64019:head# 2024-04-01T19:36:36.753 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.753 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f7a2bad:::benchmark_data_smithi188_104537_object26933:head# 2024-04-01T19:36:36.753 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.753 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f7afa1d:::benchmark_data_smithi188_104537_object155230:head# 2024-04-01T19:36:36.753 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.753 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f7b06b9:::benchmark_data_smithi188_104537_object21907:head# 2024-04-01T19:36:36.753 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.754 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f7be151:::benchmark_data_smithi188_104537_object59729:head# 2024-04-01T19:36:36.754 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.754 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f7beb96:::benchmark_data_smithi188_104537_object160598:head# 2024-04-01T19:36:36.754 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.754 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f7c0e81:::benchmark_data_smithi188_104537_object72800:head# 2024-04-01T19:36:36.754 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.754 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f7cbd4d:::benchmark_data_smithi188_104537_object163733:head# 2024-04-01T19:36:36.754 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.754 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f7d0ca1:::benchmark_data_smithi188_104537_object127882:head# 2024-04-01T19:36:36.754 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.754 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f7d4735:::benchmark_data_smithi188_104537_object29878:head# 2024-04-01T19:36:36.754 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.754 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f7da186:::benchmark_data_smithi188_104537_object57358:head# 2024-04-01T19:36:36.755 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.755 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f7e7a5b:::benchmark_data_smithi188_104537_object33539:head# 2024-04-01T19:36:36.755 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.755 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f7eb0a1:::benchmark_data_smithi188_104537_object169353:head# 2024-04-01T19:36:36.755 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.755 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f7fba07:::benchmark_data_smithi188_104537_object60843:head# 2024-04-01T19:36:36.755 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.755 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f80ba95:::benchmark_data_smithi188_104537_object141837:head# 2024-04-01T19:36:36.755 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.755 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f82504e:::benchmark_data_smithi188_104537_object72639:head# 2024-04-01T19:36:36.755 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.755 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f8396f8:::benchmark_data_smithi188_104537_object117273:head# 2024-04-01T19:36:36.755 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.755 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f846a0b:::benchmark_data_smithi188_104537_object46258:head# 2024-04-01T19:36:36.755 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.756 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f84ab8d:::benchmark_data_smithi188_104537_object92605:head# 2024-04-01T19:36:36.756 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.756 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f84c403:::benchmark_data_smithi188_104537_object12142:head# 2024-04-01T19:36:36.756 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.756 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f859716:::benchmark_data_smithi188_104537_object30010:head# 2024-04-01T19:36:36.756 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.756 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f85dd69:::benchmark_data_smithi188_104537_object129842:head# 2024-04-01T19:36:36.756 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.756 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f85f211:::benchmark_data_smithi188_104537_object64008:head# 2024-04-01T19:36:36.756 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.756 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f8623ed:::benchmark_data_smithi188_104537_object133266:head# 2024-04-01T19:36:36.756 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.756 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f86d16b:::benchmark_data_smithi188_104537_object30316:head# 2024-04-01T19:36:36.756 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.756 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f874ad6:::benchmark_data_smithi188_104537_object79081:head# 2024-04-01T19:36:36.756 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.757 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f880764:::benchmark_data_smithi188_104537_object105929:head# 2024-04-01T19:36:36.757 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.757 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f88a0c9:::benchmark_data_smithi188_104537_object29484:head# 2024-04-01T19:36:36.757 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.757 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f896cfd:::benchmark_data_smithi188_104537_object124717:head# 2024-04-01T19:36:36.757 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.757 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f8a6c8f:::benchmark_data_smithi188_104537_object19284:head# 2024-04-01T19:36:36.757 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.757 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f8af5b5:::benchmark_data_smithi188_104537_object89435:head# 2024-04-01T19:36:36.757 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.757 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f8b5c3e:::benchmark_data_smithi188_104537_object99687:head# 2024-04-01T19:36:36.757 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f8bcd5f:::benchmark_data_smithi188_104537_object76900:head# 2024-04-01T19:36:36.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f8c3375:::benchmark_data_smithi188_104537_object94364:head# 2024-04-01T19:36:36.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f8da14f:::benchmark_data_smithi188_104537_object144096:head# 2024-04-01T19:36:36.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f8dc747:::benchmark_data_smithi188_104537_object148282:head# 2024-04-01T19:36:36.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f8e9a7b:::benchmark_data_smithi188_104537_object28861:head# 2024-04-01T19:36:36.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.759 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f8ea08d:::benchmark_data_smithi188_104537_object142208:head# 2024-04-01T19:36:36.759 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.759 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f8f6397:::benchmark_data_smithi188_104537_object152442:head# 2024-04-01T19:36:36.759 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.759 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f8f9876:::benchmark_data_smithi188_104537_object161720:head# 2024-04-01T19:36:36.759 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.759 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f900e66:::benchmark_data_smithi188_104537_object137045:head# 2024-04-01T19:36:36.759 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.759 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f90cb76:::benchmark_data_smithi188_104537_object74953:head# 2024-04-01T19:36:36.759 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.759 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f90d1c5:::benchmark_data_smithi188_104537_object29877:head# 2024-04-01T19:36:36.759 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.759 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f912b5a:::benchmark_data_smithi188_104537_object33999:head# 2024-04-01T19:36:36.759 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.759 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f91638a:::benchmark_data_smithi188_104537_object30564:head# 2024-04-01T19:36:36.759 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.760 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f919705:::benchmark_data_smithi188_104537_object109391:head# 2024-04-01T19:36:36.760 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.760 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f91cfe6:::benchmark_data_smithi188_104537_object69909:head# 2024-04-01T19:36:36.760 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.760 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f92125c:::benchmark_data_smithi188_104537_object32289:head# 2024-04-01T19:36:36.760 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.760 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9214ac:::benchmark_data_smithi188_104537_object13651:head# 2024-04-01T19:36:36.760 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.760 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9282dc:::benchmark_data_smithi188_104537_object98254:head# 2024-04-01T19:36:36.760 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.760 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f92d189:::benchmark_data_smithi188_104537_object76904:head# 2024-04-01T19:36:36.760 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.760 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f93aba7:::benchmark_data_smithi188_104537_object96190:head# 2024-04-01T19:36:36.761 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.761 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f93f188:::benchmark_data_smithi188_104537_object52790:head# 2024-04-01T19:36:36.761 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.761 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f94c262:::benchmark_data_smithi188_104537_object128029:head# 2024-04-01T19:36:36.761 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.761 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f94d4e1:::benchmark_data_smithi188_104537_object24537:head# 2024-04-01T19:36:36.761 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.761 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f95656a:::benchmark_data_smithi188_104537_object33563:head# 2024-04-01T19:36:36.761 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.761 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f95ace3:::benchmark_data_smithi188_104537_object126864:head# 2024-04-01T19:36:36.761 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.761 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f95b571:::benchmark_data_smithi188_104537_object138134:head# 2024-04-01T19:36:36.761 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.761 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f95ec89:::benchmark_data_smithi188_104537_object166964:head# 2024-04-01T19:36:36.761 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.762 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f96b28f:::benchmark_data_smithi188_104537_object35568:head# 2024-04-01T19:36:36.762 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.762 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9718c9:::benchmark_data_smithi188_104537_object110717:head# 2024-04-01T19:36:36.762 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.762 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f974ca1:::benchmark_data_smithi188_104537_object161497:head# 2024-04-01T19:36:36.762 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.762 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f982d05:::benchmark_data_smithi188_104537_object96713:head# 2024-04-01T19:36:36.762 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.762 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9855f7:::benchmark_data_smithi188_104537_object81122:head# 2024-04-01T19:36:36.762 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.762 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f98a31e:::benchmark_data_smithi188_104537_object87878:head# 2024-04-01T19:36:36.762 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.762 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f990362:::benchmark_data_smithi188_104537_object21301:head# 2024-04-01T19:36:36.762 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.763 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f993f56:::benchmark_data_smithi188_104537_object106778:head# 2024-04-01T19:36:36.763 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.763 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9a218c:::benchmark_data_smithi188_104537_object102463:head# 2024-04-01T19:36:36.763 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.763 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9a2455:::benchmark_data_smithi188_104537_object32319:head# 2024-04-01T19:36:36.763 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.763 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9a54e9:::benchmark_data_smithi188_104537_object72924:head# 2024-04-01T19:36:36.763 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.763 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9a7f11:::benchmark_data_smithi188_104537_object92398:head# 2024-04-01T19:36:36.763 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.763 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9a81c0:::benchmark_data_smithi188_104537_object103425:head# 2024-04-01T19:36:36.763 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.763 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9aca32:::benchmark_data_smithi188_104537_object55486:head# 2024-04-01T19:36:36.763 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.763 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9b5472:::benchmark_data_smithi188_104537_object69317:head# 2024-04-01T19:36:36.764 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.764 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9b65b7:::benchmark_data_smithi188_104537_object46194:head# 2024-04-01T19:36:36.764 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.764 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9bbf55:::benchmark_data_smithi188_104537_object167555:head# 2024-04-01T19:36:36.764 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.764 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9c1ef9:::benchmark_data_smithi188_104537_object129777:head# 2024-04-01T19:36:36.764 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.764 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9c4882:::benchmark_data_smithi188_104537_object118251:head# 2024-04-01T19:36:36.764 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.764 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9caa44:::benchmark_data_smithi188_104537_object26174:head# 2024-04-01T19:36:36.764 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.764 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9ce502:::benchmark_data_smithi188_104537_object122595:head# 2024-04-01T19:36:36.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9d09bb:::benchmark_data_smithi188_104537_object68936:head# 2024-04-01T19:36:36.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9d703f:::benchmark_data_smithi188_104537_object108674:head# 2024-04-01T19:36:36.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9d75be:::benchmark_data_smithi188_104537_object106330:head# 2024-04-01T19:36:36.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9d97a4:::benchmark_data_smithi188_104537_object157835:head# 2024-04-01T19:36:36.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9da0a2:::benchmark_data_smithi188_104537_object26762:head# 2024-04-01T19:36:36.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9ece29:::benchmark_data_smithi188_104537_object168132:head# 2024-04-01T19:36:36.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.766 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9eec02:::benchmark_data_smithi188_104537_object34066:head# 2024-04-01T19:36:36.766 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.766 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9f9037:::benchmark_data_smithi188_104537_object34077:head# 2024-04-01T19:36:36.766 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.766 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5f9fb97f:::benchmark_data_smithi188_104537_object17165:head# 2024-04-01T19:36:36.766 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.766 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fa01c20:::benchmark_data_smithi188_104537_object76494:head# 2024-04-01T19:36:36.766 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.766 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fa05971:::benchmark_data_smithi188_104537_object44630:head# 2024-04-01T19:36:36.766 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.766 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fa0a3b2:::benchmark_data_smithi188_104537_object74734:head# 2024-04-01T19:36:36.766 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.766 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fa0e08f:::benchmark_data_smithi188_104537_object100926:head# 2024-04-01T19:36:36.767 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.767 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fa0f0aa:::benchmark_data_smithi188_104537_object52547:head# 2024-04-01T19:36:36.767 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.767 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fa1f484:::benchmark_data_smithi188_104537_object119722:head# 2024-04-01T19:36:36.767 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.767 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fa30560:::benchmark_data_smithi188_104537_object171144:head# 2024-04-01T19:36:36.767 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.767 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fa32f5e:::benchmark_data_smithi188_104537_object25758:head# 2024-04-01T19:36:36.767 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.767 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fa35c7e:::benchmark_data_smithi188_104537_object163238:head# 2024-04-01T19:36:36.767 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.767 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fa3ee40:::benchmark_data_smithi188_104537_object49244:head# 2024-04-01T19:36:36.767 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.767 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fa3fe44:::benchmark_data_smithi188_104537_object76863:head# 2024-04-01T19:36:36.767 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.767 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fa4e895:::benchmark_data_smithi188_104537_object158208:head# 2024-04-01T19:36:36.768 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.768 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fa5f282:::benchmark_data_smithi188_104537_object164656:head# 2024-04-01T19:36:36.768 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.768 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fa6c1d0:::benchmark_data_smithi188_104537_object157273:head# 2024-04-01T19:36:36.768 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.768 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fa6cf45:::benchmark_data_smithi188_104537_object39245:head# 2024-04-01T19:36:36.768 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.768 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fa91148:::benchmark_data_smithi188_104537_object150470:head# 2024-04-01T19:36:36.768 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.768 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fa9ac4e:::benchmark_data_smithi188_104537_object119143:head# 2024-04-01T19:36:36.768 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.768 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5faa08b3:::benchmark_data_smithi188_104537_object152105:head# 2024-04-01T19:36:36.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5faa0a54:::benchmark_data_smithi188_104537_object90360:head# 2024-04-01T19:36:36.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5faa4f49:::benchmark_data_smithi188_104537_object122231:head# 2024-04-01T19:36:36.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5faaebd9:::benchmark_data_smithi188_104537_object41856:head# 2024-04-01T19:36:36.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fabc5d6:::benchmark_data_smithi188_104537_object17059:head# 2024-04-01T19:36:36.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fabdb91:::benchmark_data_smithi188_104537_object44574:head# 2024-04-01T19:36:36.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fabecdc:::benchmark_data_smithi188_104537_object96618:head# 2024-04-01T19:36:36.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fac2b92:::benchmark_data_smithi188_104537_object166131:head# 2024-04-01T19:36:36.770 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.770 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5face81c:::benchmark_data_smithi188_104537_object68373:head# 2024-04-01T19:36:36.770 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.770 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5face856:::benchmark_data_smithi188_104537_object96138:head# 2024-04-01T19:36:36.770 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.770 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fad49a6:::benchmark_data_smithi188_104537_object147218:head# 2024-04-01T19:36:36.770 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.770 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fad793f:::benchmark_data_smithi188_104537_object62014:head# 2024-04-01T19:36:36.770 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.770 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fadd39b:::benchmark_data_smithi188_104537_object80910:head# 2024-04-01T19:36:36.770 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.770 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5faea41e:::benchmark_data_smithi188_104537_object101842:head# 2024-04-01T19:36:36.771 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.771 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fafd36d:::benchmark_data_smithi188_104537_object120084:head# 2024-04-01T19:36:36.771 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.771 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fb005f2:::benchmark_data_smithi188_104537_object59704:head# 2024-04-01T19:36:36.771 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.771 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fb00971:::benchmark_data_smithi188_104537_object84465:head# 2024-04-01T19:36:36.771 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.771 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fb0559c:::benchmark_data_smithi188_104537_object109466:head# 2024-04-01T19:36:36.771 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.771 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fb083df:::benchmark_data_smithi188_104537_object156387:head# 2024-04-01T19:36:36.771 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.771 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fb16d9f:::benchmark_data_smithi188_104537_object108786:head# 2024-04-01T19:36:36.771 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.771 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fb2406a:::benchmark_data_smithi188_104537_object51374:head# 2024-04-01T19:36:36.771 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fb3e146:::benchmark_data_smithi188_104537_object35181:head# 2024-04-01T19:36:36.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fb4ce3e:::benchmark_data_smithi188_104537_object151619:head# 2024-04-01T19:36:36.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fb536ff:::benchmark_data_smithi188_104537_object25550:head# 2024-04-01T19:36:36.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fb550e8:::benchmark_data_smithi188_104537_object78097:head# 2024-04-01T19:36:36.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fb554dd:::benchmark_data_smithi188_104537_object56722:head# 2024-04-01T19:36:36.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fb55aae:::benchmark_data_smithi188_104537_object50660:head# 2024-04-01T19:36:36.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fb5ad2a:::benchmark_data_smithi188_104537_object66669:head# 2024-04-01T19:36:36.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fb64c33:::benchmark_data_smithi188_104537_object153062:head# 2024-04-01T19:36:36.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fb74e81:::benchmark_data_smithi188_104537_object76592:head# 2024-04-01T19:36:36.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fb7e620:::benchmark_data_smithi188_104537_object101883:head# 2024-04-01T19:36:36.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fb7eb1b:::benchmark_data_smithi188_104537_object80120:head# 2024-04-01T19:36:36.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fb81c5b:::benchmark_data_smithi188_104537_object71277:head# 2024-04-01T19:36:36.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fb865bd:::benchmark_data_smithi188_104537_object17041:head# 2024-04-01T19:36:36.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fb96c5b:::benchmark_data_smithi188_104537_object133252:head# 2024-04-01T19:36:36.774 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.774 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fb96ca3:::benchmark_data_smithi188_104537_object112088:head# 2024-04-01T19:36:36.774 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.774 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fb9f41b:::benchmark_data_smithi188_104537_object34651:head# 2024-04-01T19:36:36.774 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.774 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fb9f988:::benchmark_data_smithi188_104537_object118278:head# 2024-04-01T19:36:36.774 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.774 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fba5053:::benchmark_data_smithi188_104537_object56876:head# 2024-04-01T19:36:36.774 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.774 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fbb8e45:::benchmark_data_smithi188_104537_object42464:head# 2024-04-01T19:36:36.774 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.774 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fbb9506:::benchmark_data_smithi188_104537_object85651:head# 2024-04-01T19:36:36.774 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.774 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fbba881:::benchmark_data_smithi188_104537_object23057:head# 2024-04-01T19:36:36.775 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.775 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fbc06b9:::benchmark_data_smithi188_104537_object163318:head# 2024-04-01T19:36:36.775 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.775 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fbc2a71:::benchmark_data_smithi188_104537_object159683:head# 2024-04-01T19:36:36.775 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.775 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fbc8bdf:::benchmark_data_smithi188_104537_object28447:head# 2024-04-01T19:36:36.775 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.775 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fbd6dc5:::benchmark_data_smithi188_104537_object85180:head# 2024-04-01T19:36:36.776 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.776 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fbd90c1:::benchmark_data_smithi188_104537_object20027:head# 2024-04-01T19:36:36.776 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.776 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fbd9ee4:::benchmark_data_smithi188_104537_object152042:head# 2024-04-01T19:36:36.776 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.776 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fbecb33:::benchmark_data_smithi188_104537_object127661:head# 2024-04-01T19:36:36.776 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.776 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fbed6c6:::benchmark_data_smithi188_104537_object146004:head# 2024-04-01T19:36:36.776 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fbf1748:::benchmark_data_smithi188_104537_object30093:head# 2024-04-01T19:36:36.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fbf6501:::benchmark_data_smithi188_104537_object160535:head# 2024-04-01T19:36:36.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fbf9b9d:::benchmark_data_smithi188_104537_object95831:head# 2024-04-01T19:36:36.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fbfdb06:::benchmark_data_smithi188_104537_object19596:head# 2024-04-01T19:36:36.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fbfeb29:::benchmark_data_smithi188_104537_object109116:head# 2024-04-01T19:36:36.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc13a9a:::benchmark_data_smithi188_104537_object132283:head# 2024-04-01T19:36:36.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc17054:::benchmark_data_smithi188_104537_object74722:head# 2024-04-01T19:36:36.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc31ada:::benchmark_data_smithi188_104537_object44914:head# 2024-04-01T19:36:36.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc32417:::benchmark_data_smithi188_104537_object156179:head# 2024-04-01T19:36:36.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc360aa:::benchmark_data_smithi188_104537_object43500:head# 2024-04-01T19:36:36.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc47665:::benchmark_data_smithi188_104537_object164966:head# 2024-04-01T19:36:36.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc49bac:::benchmark_data_smithi188_104537_object146709:head# 2024-04-01T19:36:36.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc51db9:::benchmark_data_smithi188_104537_object159055:head# 2024-04-01T19:36:36.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc54334:::benchmark_data_smithi188_104537_object79793:head# 2024-04-01T19:36:36.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.779 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc563a3:::benchmark_data_smithi188_104537_object71372:head# 2024-04-01T19:36:36.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.779 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc56c1d:::benchmark_data_smithi188_104537_object52933:head# 2024-04-01T19:36:36.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.779 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc585ec:::benchmark_data_smithi188_104537_object88825:head# 2024-04-01T19:36:36.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.779 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc5c715:::benchmark_data_smithi188_104537_object138229:head# 2024-04-01T19:36:36.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.779 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc5d419:::benchmark_data_smithi188_104537_object93329:head# 2024-04-01T19:36:36.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.779 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc65e1f:::benchmark_data_smithi188_104537_object26932:head# 2024-04-01T19:36:36.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.779 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc6cfc2:::benchmark_data_smithi188_104537_object23345:head# 2024-04-01T19:36:36.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.780 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc6e1b2:::benchmark_data_smithi188_104537_object91905:head# 2024-04-01T19:36:36.780 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.780 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc71302:::benchmark_data_smithi188_104537_object88384:head# 2024-04-01T19:36:36.780 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.780 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc73202:::benchmark_data_smithi188_104537_object138338:head# 2024-04-01T19:36:36.780 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.780 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc737f5:::benchmark_data_smithi188_104537_object121369:head# 2024-04-01T19:36:36.780 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.780 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc7d154:::benchmark_data_smithi188_104537_object169302:head# 2024-04-01T19:36:36.780 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.780 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc823bc:::benchmark_data_smithi188_104537_object112391:head# 2024-04-01T19:36:36.780 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.780 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc8448b:::benchmark_data_smithi188_104537_object81215:head# 2024-04-01T19:36:36.780 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.781 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc850d6:::benchmark_data_smithi188_104537_object34327:head# 2024-04-01T19:36:36.781 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.781 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc87f63:::benchmark_data_smithi188_104537_object149397:head# 2024-04-01T19:36:36.781 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.781 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fc8bf19:::benchmark_data_smithi188_104537_object102605:head# 2024-04-01T19:36:36.781 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.781 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fca00b1:::benchmark_data_smithi188_104537_object39787:head# 2024-04-01T19:36:36.781 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.781 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fca9f3a:::benchmark_data_smithi188_104537_object163054:head# 2024-04-01T19:36:36.781 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.781 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fcb99cf:::benchmark_data_smithi188_104537_object154349:head# 2024-04-01T19:36:36.781 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.781 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fcc54fa:::benchmark_data_smithi188_104537_object79979:head# 2024-04-01T19:36:36.781 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.781 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fcd4d02:::benchmark_data_smithi188_104537_object87164:head# 2024-04-01T19:36:36.782 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.782 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fcdfea2:::benchmark_data_smithi188_104537_object108521:head# 2024-04-01T19:36:36.782 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.782 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fcf1992:::benchmark_data_smithi188_104537_object74999:head# 2024-04-01T19:36:36.782 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.782 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fcfaf38:::benchmark_data_smithi188_104537_object65064:head# 2024-04-01T19:36:36.782 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.782 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd0032c:::benchmark_data_smithi188_104537_object37780:head# 2024-04-01T19:36:36.782 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.782 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd0059a:::benchmark_data_smithi188_104537_object14671:head# 2024-04-01T19:36:36.782 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.782 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd01ee1:::benchmark_data_smithi188_104537_object91125:head# 2024-04-01T19:36:36.782 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.782 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd0458f:::benchmark_data_smithi188_104537_object87948:head# 2024-04-01T19:36:36.783 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.783 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd09394:::benchmark_data_smithi188_104537_object12407:head# 2024-04-01T19:36:36.783 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.783 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd09931:::benchmark_data_smithi188_104537_object50856:head# 2024-04-01T19:36:36.783 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.783 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd09aba:::benchmark_data_smithi188_104537_object71513:head# 2024-04-01T19:36:36.783 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.783 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd09c2e:::benchmark_data_smithi188_104537_object140138:head# 2024-04-01T19:36:36.783 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.783 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd162b3:::benchmark_data_smithi188_104537_object28800:head# 2024-04-01T19:36:36.783 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.783 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd1acd3:::benchmark_data_smithi188_104537_object143388:head# 2024-04-01T19:36:36.783 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.783 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd1cbc4:::benchmark_data_smithi188_104537_object107353:head# 2024-04-01T19:36:36.783 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.783 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd331fc:::benchmark_data_smithi188_104537_object105142:head# 2024-04-01T19:36:36.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.784 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd3322a:::benchmark_data_smithi188_104537_object60429:head# 2024-04-01T19:36:36.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.784 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd34547:::benchmark_data_smithi188_104537_object49392:head# 2024-04-01T19:36:36.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.784 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd375c5:::benchmark_data_smithi188_104537_object26854:head# 2024-04-01T19:36:36.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.784 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd3f3a1:::benchmark_data_smithi188_104537_object165574:head# 2024-04-01T19:36:36.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.784 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd4791f:::benchmark_data_smithi188_104537_object12925:head# 2024-04-01T19:36:36.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.784 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd48d9d:::benchmark_data_smithi188_104537_object145388:head# 2024-04-01T19:36:36.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.785 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd4bedf:::benchmark_data_smithi188_104537_object102208:head# 2024-04-01T19:36:36.785 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.785 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd4d7ce:::benchmark_data_smithi188_104537_object154601:head# 2024-04-01T19:36:36.785 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.785 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd5d554:::benchmark_data_smithi188_104537_object56526:head# 2024-04-01T19:36:36.785 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.785 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd7316b:::benchmark_data_smithi188_104537_object154275:head# 2024-04-01T19:36:36.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd7583f:::benchmark_data_smithi188_104537_object74291:head# 2024-04-01T19:36:36.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd76b04:::benchmark_data_smithi188_104537_object152342:head# 2024-04-01T19:36:36.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd786a1:::benchmark_data_smithi188_104537_object44710:head# 2024-04-01T19:36:36.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd82f57:::benchmark_data_smithi188_104537_object14316:head# 2024-04-01T19:36:36.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd96f97:::benchmark_data_smithi188_104537_object145393:head# 2024-04-01T19:36:36.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd97be3:::benchmark_data_smithi188_104537_object171353:head# 2024-04-01T19:36:36.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fd9c127:::benchmark_data_smithi188_104537_object127479:head# 2024-04-01T19:36:36.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fda2381:::benchmark_data_smithi188_104537_object158305:head# 2024-04-01T19:36:36.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fdab196:::benchmark_data_smithi188_104537_object162686:head# 2024-04-01T19:36:36.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fdb0ffc:::benchmark_data_smithi188_104537_object142342:head# 2024-04-01T19:36:36.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fdb77c0:::benchmark_data_smithi188_104537_object156458:head# 2024-04-01T19:36:36.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fdb887b:::benchmark_data_smithi188_104537_object73596:head# 2024-04-01T19:36:36.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fdc17ee:::benchmark_data_smithi188_104537_object103014:head# 2024-04-01T19:36:36.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fdc2d1c:::benchmark_data_smithi188_104537_object159771:head# 2024-04-01T19:36:36.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fdc4b48:::benchmark_data_smithi188_104537_object89382:head# 2024-04-01T19:36:36.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fdc649c:::benchmark_data_smithi188_104537_object59878:head# 2024-04-01T19:36:36.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fdc6a48:::benchmark_data_smithi188_104537_object121113:head# 2024-04-01T19:36:36.789 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.789 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fdcdad1:::benchmark_data_smithi188_104537_object70140:head# 2024-04-01T19:36:36.789 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.789 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fdd3108:::benchmark_data_smithi188_104537_object107928:head# 2024-04-01T19:36:36.789 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.789 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fdd8122:::benchmark_data_smithi188_104537_object133393:head# 2024-04-01T19:36:36.789 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.789 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fddbf2f:::benchmark_data_smithi188_104537_object49496:head# 2024-04-01T19:36:36.789 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.789 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fdddd70:::benchmark_data_smithi188_104537_object82902:head# 2024-04-01T19:36:36.789 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.790 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fde1155:::benchmark_data_smithi188_104537_object60011:head# 2024-04-01T19:36:36.790 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.790 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fde1211:::benchmark_data_smithi188_104537_object123086:head# 2024-04-01T19:36:36.790 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.790 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fde2774:::benchmark_data_smithi188_104537_object27048:head# 2024-04-01T19:36:36.790 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.790 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fde60b8:::benchmark_data_smithi188_104537_object163526:head# 2024-04-01T19:36:36.791 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.791 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fdf299b:::benchmark_data_smithi188_104537_object78937:head# 2024-04-01T19:36:36.791 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.791 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fdf38f9:::benchmark_data_smithi188_104537_object19283:head# 2024-04-01T19:36:36.791 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.791 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fdf7d94:::benchmark_data_smithi188_104537_object14124:head# 2024-04-01T19:36:36.791 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.791 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe01b36:::benchmark_data_smithi188_104537_object21833:head# 2024-04-01T19:36:36.791 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.791 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe02271:::benchmark_data_smithi188_104537_object93309:head# 2024-04-01T19:36:36.791 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.791 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe137e3:::benchmark_data_smithi188_104537_object130322:head# 2024-04-01T19:36:36.791 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.791 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe17a7f:::benchmark_data_smithi188_104537_object45267:head# 2024-04-01T19:36:36.791 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.791 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe18a9e:::benchmark_data_smithi188_104537_object147514:head# 2024-04-01T19:36:36.792 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.792 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe2318a:::benchmark_data_smithi188_104537_object127106:head# 2024-04-01T19:36:36.792 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.792 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe2d934:::benchmark_data_smithi188_104537_object29555:head# 2024-04-01T19:36:36.792 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.792 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe2de40:::benchmark_data_smithi188_104537_object169802:head# 2024-04-01T19:36:36.792 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.792 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe33cb7:::benchmark_data_smithi188_104537_object42715:head# 2024-04-01T19:36:36.792 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.792 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe342c0:::benchmark_data_smithi188_104537_object123268:head# 2024-04-01T19:36:36.792 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.793 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe3c647:::benchmark_data_smithi188_104537_object133176:head# 2024-04-01T19:36:36.793 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.793 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe51c64:::benchmark_data_smithi188_104537_object29734:head# 2024-04-01T19:36:36.793 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.793 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe539ff:::benchmark_data_smithi188_104537_object31647:head# 2024-04-01T19:36:36.793 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.793 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe5807a:::benchmark_data_smithi188_104537_object146090:head# 2024-04-01T19:36:36.793 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.793 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe5a2a8:::benchmark_data_smithi188_104537_object86408:head# 2024-04-01T19:36:36.793 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.793 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe5af3d:::benchmark_data_smithi188_104537_object138194:head# 2024-04-01T19:36:36.793 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.793 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe69b37:::benchmark_data_smithi188_104537_object115411:head# 2024-04-01T19:36:36.793 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.793 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe6c5ae:::benchmark_data_smithi188_104537_object31921:head# 2024-04-01T19:36:36.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe6c6e5:::benchmark_data_smithi188_104537_object48693:head# 2024-04-01T19:36:36.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe6f26c:::benchmark_data_smithi188_104537_object166659:head# 2024-04-01T19:36:36.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe70cb3:::benchmark_data_smithi188_104537_object112434:head# 2024-04-01T19:36:36.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe7b54e:::benchmark_data_smithi188_104537_object109870:head# 2024-04-01T19:36:36.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe7e54e:::benchmark_data_smithi188_104537_object19287:head# 2024-04-01T19:36:36.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe82ad6:::benchmark_data_smithi188_104537_object29324:head# 2024-04-01T19:36:36.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.795 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe8ecb7:::benchmark_data_smithi188_104537_object97437:head# 2024-04-01T19:36:36.795 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.795 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe90c7e:::benchmark_data_smithi188_104537_object106297:head# 2024-04-01T19:36:36.795 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.795 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe9192b:::benchmark_data_smithi188_104537_object82806:head# 2024-04-01T19:36:36.795 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.795 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe92285:::benchmark_data_smithi188_104537_object76835:head# 2024-04-01T19:36:36.795 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.795 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe92448:::benchmark_data_smithi188_104537_object127179:head# 2024-04-01T19:36:36.795 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.795 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe95e2b:::benchmark_data_smithi188_104537_object91052:head# 2024-04-01T19:36:36.795 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.795 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe9da8e:::benchmark_data_smithi188_104537_object159066:head# 2024-04-01T19:36:36.795 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.795 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe9f349:::benchmark_data_smithi188_104537_object56629:head# 2024-04-01T19:36:36.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fe9f99b:::benchmark_data_smithi188_104537_object112469:head# 2024-04-01T19:36:36.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fea5f89:::benchmark_data_smithi188_104537_object18160:head# 2024-04-01T19:36:36.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5feac2b3:::benchmark_data_smithi188_104537_object15699:head# 2024-04-01T19:36:36.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5feafb1c:::benchmark_data_smithi188_104537_object112494:head# 2024-04-01T19:36:36.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5febcd67:::benchmark_data_smithi188_104537_object51507:head# 2024-04-01T19:36:36.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5febe598:::benchmark_data_smithi188_104537_object147789:head# 2024-04-01T19:36:36.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fec1f9f:::benchmark_data_smithi188_104537_object170062:head# 2024-04-01T19:36:36.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.797 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fec7062:::benchmark_data_smithi188_104537_object152055:head# 2024-04-01T19:36:36.797 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.797 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fecb290:::benchmark_data_smithi188_104537_object100644:head# 2024-04-01T19:36:36.797 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.797 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fecb6a5:::benchmark_data_smithi188_104537_object16330:head# 2024-04-01T19:36:36.797 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.797 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5feccd95:::benchmark_data_smithi188_104537_object70742:head# 2024-04-01T19:36:36.797 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.797 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fed20ac:::benchmark_data_smithi188_104537_object86162:head# 2024-04-01T19:36:36.797 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.797 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fed3075:::benchmark_data_smithi188_104537_object91970:head# 2024-04-01T19:36:36.798 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.798 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fed6cfc:::benchmark_data_smithi188_104537_object152222:head# 2024-04-01T19:36:36.798 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.798 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fef53b9:::benchmark_data_smithi188_104537_object149816:head# 2024-04-01T19:36:36.798 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.799 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fef60e4:::benchmark_data_smithi188_104537_object131960:head# 2024-04-01T19:36:36.799 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.799 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fef767f:::benchmark_data_smithi188_104537_object83731:head# 2024-04-01T19:36:36.799 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.799 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fefdf14:::benchmark_data_smithi188_104537_object158275:head# 2024-04-01T19:36:36.799 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.800 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ff0198b:::benchmark_data_smithi188_104537_object74349:head# 2024-04-01T19:36:36.800 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.800 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ff03a3f:::benchmark_data_smithi188_104537_object21848:head# 2024-04-01T19:36:36.800 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.800 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ff06ef8:::benchmark_data_smithi188_104537_object44633:head# 2024-04-01T19:36:36.800 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.800 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ff07513:::benchmark_data_smithi188_104537_object63406:head# 2024-04-01T19:36:36.800 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.800 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ff0988e:::benchmark_data_smithi188_104537_object138621:head# 2024-04-01T19:36:36.800 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.801 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ff2cb41:::benchmark_data_smithi188_104537_object106921:head# 2024-04-01T19:36:36.801 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.801 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ff33441:::benchmark_data_smithi188_104537_object165626:head# 2024-04-01T19:36:36.801 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.801 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ff42e9e:::benchmark_data_smithi188_104537_object113605:head# 2024-04-01T19:36:36.801 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.801 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ff44dec:::benchmark_data_smithi188_104537_object124068:head# 2024-04-01T19:36:36.801 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.801 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ff4788f:::benchmark_data_smithi188_104537_object127559:head# 2024-04-01T19:36:36.801 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.801 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ff584b5:::benchmark_data_smithi188_104537_object42660:head# 2024-04-01T19:36:36.801 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.801 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ff58ef9:::benchmark_data_smithi188_104537_object156402:head# 2024-04-01T19:36:36.801 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.801 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ff6bc8a:::benchmark_data_smithi188_104537_object115221:head# 2024-04-01T19:36:36.802 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.802 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ff6d625:::benchmark_data_smithi188_104537_object130943:head# 2024-04-01T19:36:36.802 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.802 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ff6fbf7:::benchmark_data_smithi188_104537_object54214:head# 2024-04-01T19:36:36.802 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.802 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ff7a7b2:::benchmark_data_smithi188_104537_object131415:head# 2024-04-01T19:36:36.802 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.802 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ff7becd:::benchmark_data_smithi188_104537_object110698:head# 2024-04-01T19:36:36.802 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.802 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ff8150e:::benchmark_data_smithi188_104537_object156226:head# 2024-04-01T19:36:36.802 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.802 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ff8b362:::benchmark_data_smithi188_104537_object84286:head# 2024-04-01T19:36:36.802 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.803 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ff8ea40:::benchmark_data_smithi188_104537_object19799:head# 2024-04-01T19:36:36.803 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.803 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ff8f89a:::benchmark_data_smithi188_104537_object17708:head# 2024-04-01T19:36:36.803 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.803 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ff9501a:::benchmark_data_smithi188_104537_object146429:head# 2024-04-01T19:36:36.803 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.803 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ff9620d:::benchmark_data_smithi188_104537_object157137:head# 2024-04-01T19:36:36.803 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.803 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ff9d9bf:::benchmark_data_smithi188_104537_object84425:head# 2024-04-01T19:36:36.803 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.803 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ffc6cfb:::benchmark_data_smithi188_104537_object14322:head# 2024-04-01T19:36:36.803 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.803 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ffc93ab:::benchmark_data_smithi188_104537_object84204:head# 2024-04-01T19:36:36.804 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.804 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ffca48b:::benchmark_data_smithi188_104537_object62284:head# 2024-04-01T19:36:36.804 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.804 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ffca56c:::benchmark_data_smithi188_104537_object110766:head# 2024-04-01T19:36:36.804 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.804 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ffcb0f5:::benchmark_data_smithi188_104537_object117619:head# 2024-04-01T19:36:36.804 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.804 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ffcc0a1:::benchmark_data_smithi188_104537_object81058:head# 2024-04-01T19:36:36.804 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.804 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ffce550:::benchmark_data_smithi188_104537_object81200:head# 2024-04-01T19:36:36.805 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.805 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ffcf707:::benchmark_data_smithi188_104537_object58938:head# 2024-04-01T19:36:36.805 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.805 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ffd4eac:::benchmark_data_smithi188_104537_object139192:head# 2024-04-01T19:36:36.805 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.805 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ffd736c:::benchmark_data_smithi188_104537_object69889:head# 2024-04-01T19:36:36.805 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.805 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ffda6f1:::benchmark_data_smithi188_104537_object22670:head# 2024-04-01T19:36:36.805 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.805 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ffdc182:::benchmark_data_smithi188_104537_object63549:head# 2024-04-01T19:36:36.805 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.805 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ffde346:::benchmark_data_smithi188_104537_object32337:head# 2024-04-01T19:36:36.805 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.805 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ffe0b54:::benchmark_data_smithi188_104537_object96763:head# 2024-04-01T19:36:36.806 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.806 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5ffe91cf:::benchmark_data_smithi188_104537_object154399:head# 2024-04-01T19:36:36.806 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.806 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fff1145:::benchmark_data_smithi188_104537_object61739:head# 2024-04-01T19:36:36.806 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.806 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fff244e:::benchmark_data_smithi188_104537_object27058:head# 2024-04-01T19:36:36.806 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.806 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fff4714:::benchmark_data_smithi188_104537_object47641:head# 2024-04-01T19:36:36.806 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.806 INFO:teuthology.orchestra.run.smithi062.stdout:Write #4:5fff76fe:::benchmark_data_smithi188_104537_object130668:head# 2024-04-01T19:36:36.806 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:36:36.806 INFO:teuthology.orchestra.run.smithi062.stdout:write_pg epoch 299 info 4.a( v 299'11547 (272'1500,299'11547] local-lis/les=267/268 n=10107 ec=267/267 lis/c=267/267 les/c/f=268/268/0 sis=267) 2024-04-01T19:36:36.806 INFO:teuthology.orchestra.run.smithi062.stdout:Import successful 2024-04-01T19:36:36.807 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:36:36.808 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:36 smithi062 ceph-mon[44211]: pgmap v909: 17 pgs: 17 active+clean; 9.4 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 841 op/s; 14 MiB/s, 227 objects/s recovering 2024-04-01T19:36:36.828 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:36:36.843 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:36.878 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:36:36.881 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:36.882 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:36:36.983 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:36:37.021 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:37.049 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:36:37.055 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:37.055 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:36:37.156 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:36:37.194 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:37.226 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:36:37.232 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:37.233 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:36:37.334 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:36:37.349 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:36:37.384 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:37.471 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:37 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3377023665' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:36:37.471 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:37 smithi022 ceph-mon[39439]: from='client.25639 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:36:37.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:37 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3377023665' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:36:37.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:37 smithi188 ceph-mon[43939]: from='client.25639 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:36:37.654 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:36:37.666 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:37.667 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:36:37.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:37 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3377023665' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:36:37.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:37 smithi062 ceph-mon[44211]: from='client.25639 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:36:37.767 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:36:37.806 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:38.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:38 smithi022 ceph-mon[39439]: pgmap v910: 17 pgs: 17 active+clean; 9.2 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:36:38.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:38 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:36:38.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:38 smithi022 ceph-mon[39439]: from='client.25639 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:36:38.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:38 smithi022 ceph-mon[39439]: osdmap e318: 12 total, 11 up, 11 in 2024-04-01T19:36:38.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:38 smithi022 ceph-mon[39439]: 4.0 scrub starts 2024-04-01T19:36:38.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:38 smithi188 ceph-mon[43939]: pgmap v910: 17 pgs: 17 active+clean; 9.2 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:36:38.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:38 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:36:38.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:38 smithi188 ceph-mon[43939]: from='client.25639 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:36:38.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:38 smithi188 ceph-mon[43939]: osdmap e318: 12 total, 11 up, 11 in 2024-04-01T19:36:38.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:38 smithi188 ceph-mon[43939]: 4.0 scrub starts 2024-04-01T19:36:38.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:38 smithi062 ceph-mon[44211]: pgmap v910: 17 pgs: 17 active+clean; 9.2 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:36:38.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:38 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:36:38.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:38 smithi062 ceph-mon[44211]: from='client.25639 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:36:38.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:38 smithi062 ceph-mon[44211]: osdmap e318: 12 total, 11 up, 11 in 2024-04-01T19:36:38.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:38 smithi062 ceph-mon[44211]: 4.0 scrub starts 2024-04-01T19:36:39.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:39 smithi022 ceph-mon[39439]: 4.f scrub starts 2024-04-01T19:36:39.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:39 smithi188 ceph-mon[43939]: 4.f scrub starts 2024-04-01T19:36:39.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:39 smithi062 ceph-mon[44211]: 4.f scrub starts 2024-04-01T19:36:39.863 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:36:39.870 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:39.871 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:36:39.887 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:36:39.928 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:36:39.967 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:36:39.972 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:36:40.004 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:36:40.012 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:40.037 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:36:40.038 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:36:40.045 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:40.045 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:36:40.068 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:36:40.112 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:36:40.143 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:36:40.146 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:36:40.174 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:36:40.178 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:40.200 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:36:40.206 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:40.207 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:36:40.207 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:36:40.237 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:36:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:36:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:36:40.238 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:36:40.238 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:36:40.238 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:36:40.238 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:36:40.238 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:36:40.238 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:36:40.238 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:36:40.238 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:36:40.238 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:36:40.238 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:36:40.297 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:36:40.307 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:36:40.340 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:40.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:40 smithi022 ceph-mon[39439]: pgmap v912: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.2 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 988 op/s 2024-04-01T19:36:40.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:40 smithi022 ceph-mon[39439]: 4.d scrub starts 2024-04-01T19:36:40.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:40 smithi022 ceph-mon[39439]: 4.0 scrub ok 2024-04-01T19:36:40.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:40 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3063124274' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:36:40.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:40.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:40.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:40.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:40.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:40.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:40 smithi188 ceph-mon[43939]: pgmap v912: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.2 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 988 op/s 2024-04-01T19:36:40.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:40 smithi188 ceph-mon[43939]: 4.d scrub starts 2024-04-01T19:36:40.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:40 smithi188 ceph-mon[43939]: 4.0 scrub ok 2024-04-01T19:36:40.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:40 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3063124274' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:36:40.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:40.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:40.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:40.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:40.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:40 smithi062 ceph-mon[44211]: pgmap v912: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.2 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 988 op/s 2024-04-01T19:36:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:40 smithi062 ceph-mon[44211]: 4.d scrub starts 2024-04-01T19:36:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:40 smithi062 ceph-mon[44211]: 4.0 scrub ok 2024-04-01T19:36:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:40 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3063124274' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:36:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:40.996 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:36:40.999 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:41.000 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:36:41.019 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_historic_ops 2024-04-01T19:36:41.078 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:36:41.079 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:36:41.101 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:36:41.139 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:41.171 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:36:41.173 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:41.174 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:36:41.175 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:36:41.275 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:36:41.308 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:41.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:41 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:41.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:41 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:41.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:41 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:41.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:41 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:41.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:41 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:41.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:41 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:41.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:41 smithi022 ceph-mon[39439]: 4.d scrub ok 2024-04-01T19:36:41.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:41 smithi022 ceph-mon[39439]: 4.f scrub ok 2024-04-01T19:36:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:41 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:41 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:41 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:41 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:41 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:41 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:41 smithi188 ceph-mon[43939]: 4.d scrub ok 2024-04-01T19:36:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:41 smithi188 ceph-mon[43939]: 4.f scrub ok 2024-04-01T19:36:41.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:41 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:41.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:41 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:41.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:41 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:41.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:41 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:41.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:41 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:41.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:41 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:41.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:41 smithi062 ceph-mon[44211]: 4.d scrub ok 2024-04-01T19:36:41.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:41 smithi062 ceph-mon[44211]: 4.f scrub ok 2024-04-01T19:36:42.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:42 smithi022 ceph-mon[39439]: pgmap v913: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.9 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:36:42.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:42 smithi022 ceph-mon[39439]: 4.a scrub starts 2024-04-01T19:36:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:42 smithi188 ceph-mon[43939]: pgmap v913: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.9 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:36:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:42 smithi188 ceph-mon[43939]: 4.a scrub starts 2024-04-01T19:36:42.724 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:42 smithi062 ceph-mon[44211]: pgmap v913: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.9 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:36:42.724 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:42 smithi062 ceph-mon[44211]: 4.a scrub starts 2024-04-01T19:36:42.759 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/exp.4.a.6 2024-04-01T19:36:42.768 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:36:42.773 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:42.774 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:36:42.837 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:36:42.875 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:36:42.891 INFO:tasks.thrashosds.thrasher:Waiting for clean again 2024-04-01T19:36:42.891 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-01T19:36:42.891 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:36:42.914 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:42.945 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:36:42.950 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:42.950 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:36:43.051 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:36:43.080 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:36:43.080 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:43.120 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:36:43.123 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:43.123 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:36:43.224 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:36:43.272 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:43.335 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:36:43.344 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:43.345 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:36:43.445 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:36:43.478 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:43.502 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:36:43.507 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:43.507 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:36:43.563 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:36:43.608 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:36:43.651 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:43.708 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:36:43.712 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:43.713 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:36:43.814 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:36:43.879 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:43.905 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:36:43.912 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:43.913 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:36:44.014 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:36:44.055 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:44.090 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:36:44.096 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:44.096 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:36:44.197 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:36:44.236 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:44.275 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:36:44.282 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:44.283 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:36:44.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:44 smithi188 ceph-mon[43939]: pgmap v914: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.8 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:36:44.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:44 smithi188 ceph-mon[43939]: 4.c scrub starts 2024-04-01T19:36:44.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:44 smithi188 ceph-mon[43939]: 4.a scrub ok 2024-04-01T19:36:44.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:44 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/584471664' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:36:44.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:44 smithi188 ceph-mon[43939]: from='client.35696 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:36:44.384 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:36:44.391 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:36:44.418 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:36:44.433 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:44.672 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:44 smithi062 ceph-mon[44211]: pgmap v914: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.8 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:36:44.672 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:44 smithi062 ceph-mon[44211]: 4.c scrub starts 2024-04-01T19:36:44.672 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:44 smithi062 ceph-mon[44211]: 4.a scrub ok 2024-04-01T19:36:44.673 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:44 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/584471664' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:36:44.673 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:44 smithi062 ceph-mon[44211]: from='client.35696 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:36:44.687 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:36:44.694 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:44.695 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:36:44.795 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:36:44.796 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:44 smithi022 ceph-mon[39439]: pgmap v914: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.8 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:36:44.796 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:44 smithi022 ceph-mon[39439]: 4.c scrub starts 2024-04-01T19:36:44.796 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:44 smithi022 ceph-mon[39439]: 4.a scrub ok 2024-04-01T19:36:44.797 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:44 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/584471664' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:36:44.797 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:44 smithi022 ceph-mon[39439]: from='client.35696 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:36:44.828 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:44.962 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:36:44.964 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:44.965 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:36:44.998 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:36:44.998 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:36:45.066 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:36:45.105 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:45.130 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:36:45.133 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:45.133 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:36:45.234 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:36:45.267 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:45.369 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:36:45.387 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:45.387 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:36:45.488 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:36:45.539 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:45.567 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:36:45.576 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:45.576 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:36:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:45 smithi022 ceph-mon[39439]: 4.3 scrub starts 2024-04-01T19:36:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:45 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:36:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:45 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:36:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:45 smithi022 ceph-mon[39439]: from='client.35696 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:36:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:45 smithi022 ceph-mon[39439]: osdmap e319: 12 total, 11 up, 11 in 2024-04-01T19:36:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:45 smithi022 ceph-mon[39439]: 4.c scrub ok 2024-04-01T19:36:45.677 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:36:45.707 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:45.708 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:45 smithi062 ceph-mon[44211]: 4.3 scrub starts 2024-04-01T19:36:45.708 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:45 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:36:45.708 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:45 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:36:45.708 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:45 smithi062 ceph-mon[44211]: from='client.35696 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:36:45.708 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:45 smithi062 ceph-mon[44211]: osdmap e319: 12 total, 11 up, 11 in 2024-04-01T19:36:45.708 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:45 smithi062 ceph-mon[44211]: 4.c scrub ok 2024-04-01T19:36:45.739 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_ops_in_flight 2024-04-01T19:36:45.794 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:45 smithi188 ceph-mon[43939]: 4.3 scrub starts 2024-04-01T19:36:45.794 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:45 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:36:45.794 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:45 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:36:45.794 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:45 smithi188 ceph-mon[43939]: from='client.35696 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:36:45.794 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:45 smithi188 ceph-mon[43939]: osdmap e319: 12 total, 11 up, 11 in 2024-04-01T19:36:45.794 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:45 smithi188 ceph-mon[43939]: 4.c scrub ok 2024-04-01T19:36:45.916 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:36:45.922 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:45.923 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:36:46.024 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:36:46.086 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:46.117 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:36:46.124 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:46.124 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:36:46.166 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:36:46.226 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:36:46.259 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:46.303 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:36:46.307 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:46.308 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:36:46.409 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:36:46.443 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:46 smithi022 ceph-mon[39439]: 4.5 deep-scrub starts 2024-04-01T19:36:46.443 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:46 smithi022 ceph-mon[39439]: pgmap v916: 17 pgs: 17 active+clean; 8.7 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.11k op/s 2024-04-01T19:36:46.443 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:46 smithi022 ceph-mon[39439]: 4.2 scrub starts 2024-04-01T19:36:46.443 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:46 smithi022 ceph-mon[39439]: 4.3 scrub ok 2024-04-01T19:36:46.446 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:46.600 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:36:46.603 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:46.604 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:36:46.705 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:36:46.738 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:46 smithi062 ceph-mon[44211]: 4.5 deep-scrub starts 2024-04-01T19:36:46.739 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:46 smithi062 ceph-mon[44211]: pgmap v916: 17 pgs: 17 active+clean; 8.7 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.11k op/s 2024-04-01T19:36:46.739 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:46 smithi062 ceph-mon[44211]: 4.2 scrub starts 2024-04-01T19:36:46.739 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:46 smithi062 ceph-mon[44211]: 4.3 scrub ok 2024-04-01T19:36:46.742 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:46.745 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:46 smithi188 ceph-mon[43939]: 4.5 deep-scrub starts 2024-04-01T19:36:46.745 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:46 smithi188 ceph-mon[43939]: pgmap v916: 17 pgs: 17 active+clean; 8.7 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.11k op/s 2024-04-01T19:36:46.745 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:46 smithi188 ceph-mon[43939]: 4.2 scrub starts 2024-04-01T19:36:46.746 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:46 smithi188 ceph-mon[43939]: 4.3 scrub ok 2024-04-01T19:36:46.766 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:36:46.769 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:46.769 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:36:46.871 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:36:46.903 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:47.106 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:36:47.108 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:47.109 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:36:47.210 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:36:47.234 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:36:47.239 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:47.264 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:36:47.267 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:47.267 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:36:47.368 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:36:47.419 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:47.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:47 smithi062 ceph-mon[44211]: 4.1 deep-scrub starts 2024-04-01T19:36:47.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:47 smithi062 ceph-mon[44211]: 4.2 scrub ok 2024-04-01T19:36:47.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:47 smithi188 ceph-mon[43939]: 4.1 deep-scrub starts 2024-04-01T19:36:47.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:47 smithi188 ceph-mon[43939]: 4.2 scrub ok 2024-04-01T19:36:47.696 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:36:47.698 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:36:47.727 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:47 smithi022 ceph-mon[39439]: 4.1 deep-scrub starts 2024-04-01T19:36:47.727 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:47 smithi022 ceph-mon[39439]: 4.2 scrub ok 2024-04-01T19:36:47.792 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:36:47.830 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:36:47.859 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:36:47.886 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:36:47.910 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:36:47.936 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:36:47.958 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:36:47.980 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:36:48.004 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:36:48.006 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:36:48.007 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:48.008 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:36:48.040 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:36:48.070 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:36:48.070 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:36:48.070 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:36:48.070 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:36:48.070 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:36:48.070 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:36:48.070 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:36:48.070 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:36:48.071 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:36:48.071 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:36:48.071 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:36:48.071 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:36:48.071 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:36:48.108 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:36:48.138 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:48.157 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:36:48.160 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:48.160 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:36:48.261 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:36:48.291 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:48.313 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:36:48.315 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:48.316 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:36:48.376 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:36:48.377 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:36:48.377 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-01T19:36:48.377 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:36:48.417 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:36:48.463 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:48.667 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:36:48.669 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:48 smithi188 ceph-mon[43939]: pgmap v917: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.5 GiB data, 20 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:36:48.669 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:48 smithi188 ceph-mon[43939]: from='client.25651 v1:172.21.15.22:0/2926370208' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:36:48.669 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:48 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2648328223' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:36:48.669 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:48 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:48.669 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:48 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:48.670 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:48 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:48.670 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:48 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:48.670 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:48 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:48.670 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:48 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:48.670 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:48 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:48.670 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:48.671 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:36:48.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:48 smithi062 ceph-mon[44211]: pgmap v917: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.5 GiB data, 20 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:36:48.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:48 smithi062 ceph-mon[44211]: from='client.25651 v1:172.21.15.22:0/2926370208' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:36:48.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:48 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2648328223' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:36:48.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:48 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:48.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:48 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:48.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:48 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:48.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:48 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:48.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:48 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:48.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:48 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:48.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:48 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:48.772 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:36:48.816 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:48.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:48 smithi022 ceph-mon[39439]: pgmap v917: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.5 GiB data, 20 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:36:48.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:48 smithi022 ceph-mon[39439]: from='client.25651 v1:172.21.15.22:0/2926370208' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:36:48.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:48 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2648328223' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:36:48.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:48 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:48.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:48 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:48.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:48 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:48.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:48 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:48.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:48 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:48.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:48 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:48.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:48 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:49.183 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:36:49.189 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:49.189 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:36:49.199 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_blocked_ops 2024-04-01T19:36:49.290 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:36:49.377 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:49.403 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:36:49.408 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:49.409 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:36:49.451 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:49.451 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:49.451 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:49.451 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:49.452 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:49 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:36:49.452 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:49 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:36:49.509 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:36:49.563 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:49.617 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:36:49.622 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:49.622 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:36:49.660 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:36:49.723 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:36:49.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:49.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:49.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:49.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:49.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:49 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:36:49.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:49 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:36:49.798 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:49.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:49.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:49.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:49.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:36:49.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:49 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:36:49.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:49 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:36:50.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:50 smithi062 ceph-mon[44211]: pgmap v918: 17 pgs: 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 15 active+clean; 8.5 GiB data, 20 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:36:50.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:50 smithi062 ceph-mon[44211]: 4.e deep-scrub starts 2024-04-01T19:36:50.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:50 smithi062 ceph-mon[44211]: osdmap e320: 12 total, 11 up, 11 in 2024-04-01T19:36:50.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:50 smithi062 ceph-mon[44211]: 4.7 scrub starts 2024-04-01T19:36:50.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:50 smithi022 ceph-mon[39439]: pgmap v918: 17 pgs: 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 15 active+clean; 8.5 GiB data, 20 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:36:50.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:50 smithi022 ceph-mon[39439]: 4.e deep-scrub starts 2024-04-01T19:36:50.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:50 smithi022 ceph-mon[39439]: osdmap e320: 12 total, 11 up, 11 in 2024-04-01T19:36:50.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:50 smithi022 ceph-mon[39439]: 4.7 scrub starts 2024-04-01T19:36:50.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:50 smithi188 ceph-mon[43939]: pgmap v918: 17 pgs: 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 15 active+clean; 8.5 GiB data, 20 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:36:50.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:50 smithi188 ceph-mon[43939]: 4.e deep-scrub starts 2024-04-01T19:36:50.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:50 smithi188 ceph-mon[43939]: osdmap e320: 12 total, 11 up, 11 in 2024-04-01T19:36:50.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:50 smithi188 ceph-mon[43939]: 4.7 scrub starts 2024-04-01T19:36:51.246 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:36:51.254 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:51.254 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:36:51.355 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:36:51.397 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:51.452 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:36:51.455 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:51.455 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:36:51.556 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:36:51.590 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:51.609 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:36:51.614 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:51.614 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:36:51.666 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":917,"stamp":"2024-04-01T19:36:46.914729+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":9156166200,"num_objects":139706,"num_object_clones":0,"num_object_copies":279412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139706,"num_whiteouts":0,"num_read":127,"num_read_kb":110,"num_write":204461,"num_write_kb":11010363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20052,"num_bytes_recovered":1315719296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160819,"ondisk_log_size":160819,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":11,"num_per_pool_osds":11,"num_per_pool_omap_osds":10,"kb":1031196672,"kb_used":20790332,"kb_used_data":18029400,"kb_used_omap":147,"kb_used_meta":2760620,"kb_avail":1010406340,"statfs":{"total":1055945392128,"available":1034656092160,"internally_reserved":0,"allocated":18462105600,"data_stored":18458166338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":151403,"internal_metadata":2826875029},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-730595328,"num_objects":-11148,"num_object_clones":0,"num_object_copies":-22296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-11148,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11148,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.583709"},"pg_stats":[{"pgid":"4.f","version":"319'12806","reported_seq":13130,"reported_epoch":319,"state":"active+clean","last_fresh":"2024-04-01T19:36:44.409736+0000","last_change":"2024-04-01T19:36:40.940550+0000","last_active":"2024-04-01T19:36:44.409736+0000","last_peered":"2024-04-01T19:36:44.409736+0000","last_clean":"2024-04-01T19:36:44.409736+0000","last_became_active":"2024-04-01T19:33:59.106174+0000","last_became_peered":"2024-04-01T19:33:59.106174+0000","last_unstale":"2024-04-01T19:36:44.409736+0000","last_undegraded":"2024-04-01T19:36:44.409736+0000","last_fullsized":"2024-04-01T19:36:44.409736+0000","mapping_epoch":267,"log_start":"274'2800","ondisk_log_start":"274'2800","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"318'12531","last_scrub_stamp":"2024-04-01T19:36:40.940239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:36:40.940239+0000","objects_scrubbed":9095,"log_size":10006,"log_dups_size":0,"ondisk_log_size":10006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:07.909191+0000","scrub_duration":2440,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":572129280,"num_objects":8730,"num_object_clones":0,"num_object_copies":17460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8730,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12806,"num_write_kb":689152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"319'12816","reported_seq":13034,"reported_epoch":319,"state":"active+clean","last_fresh":"2024-04-01T19:36:46.395962+0000","last_change":"2024-04-01T19:35:20.427536+0000","last_active":"2024-04-01T19:36:46.395962+0000","last_peered":"2024-04-01T19:36:46.395962+0000","last_clean":"2024-04-01T19:36:46.395962+0000","last_became_active":"2024-04-01T19:33:59.258540+0000","last_became_peered":"2024-04-01T19:33:59.258540+0000","last_unstale":"2024-04-01T19:36:46.395962+0000","last_undegraded":"2024-04-01T19:36:46.395962+0000","last_fullsized":"2024-04-01T19:36:46.395962+0000","mapping_epoch":267,"log_start":"274'2800","ondisk_log_start":"274'2800","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"293'9671","last_scrub_stamp":"2024-04-01T19:35:20.427381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:35:20.427381+0000","objects_scrubbed":9629,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:36:48.711349+0000","scrub_duration":1582,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566886400,"num_objects":8650,"num_object_clones":0,"num_object_copies":17300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8650,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12816,"num_write_kb":686912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.d","version":"319'12822","reported_seq":13144,"reported_epoch":319,"state":"active+clean","last_fresh":"2024-04-01T19:36:46.364180+0000","last_change":"2024-04-01T19:36:40.578123+0000","last_active":"2024-04-01T19:36:46.364180+0000","last_peered":"2024-04-01T19:36:46.364180+0000","last_clean":"2024-04-01T19:36:46.364180+0000","last_became_active":"2024-04-01T19:33:59.105279+0000","last_became_peered":"2024-04-01T19:33:59.105279+0000","last_unstale":"2024-04-01T19:36:46.364180+0000","last_undegraded":"2024-04-01T19:36:46.364180+0000","last_fullsized":"2024-04-01T19:36:46.364180+0000","mapping_epoch":267,"log_start":"274'2800","ondisk_log_start":"274'2800","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"318'12455","last_scrub_stamp":"2024-04-01T19:36:40.577988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:36:40.577988+0000","objects_scrubbed":9078,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:04.395617+0000","scrub_duration":1330,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568393752,"num_objects":8674,"num_object_clones":0,"num_object_copies":17348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8674,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12822,"num_write_kb":687809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.c","version":"319'12856","reported_seq":13173,"reported_epoch":319,"state":"active+clean","last_fresh":"2024-04-01T19:36:46.326574+0000","last_change":"2024-04-01T19:36:44.783000+0000","last_active":"2024-04-01T19:36:46.326574+0000","last_peered":"2024-04-01T19:36:46.326574+0000","last_clean":"2024-04-01T19:36:46.326574+0000","last_became_active":"2024-04-01T19:33:59.105051+0000","last_became_peered":"2024-04-01T19:33:59.105051+0000","last_unstale":"2024-04-01T19:36:46.326574+0000","last_undegraded":"2024-04-01T19:36:46.326574+0000","last_fullsized":"2024-04-01T19:36:46.326574+0000","mapping_epoch":267,"log_start":"274'2800","ondisk_log_start":"274'2800","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"319'12770","last_scrub_stamp":"2024-04-01T19:36:44.782900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:36:44.782900+0000","objects_scrubbed":8825,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:37:59.694644+0000","scrub_duration":1499,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570294272,"num_objects":8702,"num_object_clones":0,"num_object_copies":17404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8702,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12856,"num_write_kb":689856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.b","version":"319'12727","reported_seq":12954,"reported_epoch":319,"state":"active+clean","last_fresh":"2024-04-01T19:36:45.289873+0000","last_change":"2024-04-01T19:35:32.501254+0000","last_active":"2024-04-01T19:36:45.289873+0000","last_peered":"2024-04-01T19:36:45.289873+0000","last_clean":"2024-04-01T19:36:45.289873+0000","last_became_active":"2024-04-01T19:33:59.105705+0000","last_became_peered":"2024-04-01T19:33:59.105705+0000","last_unstale":"2024-04-01T19:36:45.289873+0000","last_undegraded":"2024-04-01T19:36:45.289873+0000","last_fullsized":"2024-04-01T19:36:45.289873+0000","mapping_epoch":267,"log_start":"274'2700","ondisk_log_start":"274'2700","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"294'10458","last_scrub_stamp":"2024-04-01T19:35:32.501153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:35:32.501153+0000","objects_scrubbed":10369,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:36:55.024650+0000","scrub_duration":2341,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568000512,"num_objects":8667,"num_object_clones":0,"num_object_copies":17334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8667,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12727,"num_write_kb":684608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"319'12855","reported_seq":33400,"reported_epoch":319,"state":"active+clean","last_fresh":"2024-04-01T19:36:44.409636+0000","last_change":"2024-04-01T19:36:43.521051+0000","last_active":"2024-04-01T19:36:44.409636+0000","last_peered":"2024-04-01T19:36:44.409636+0000","last_clean":"2024-04-01T19:36:44.409636+0000","last_became_active":"2024-04-01T19:36:24.053650+0000","last_became_peered":"2024-04-01T19:36:24.053650+0000","last_unstale":"2024-04-01T19:36:44.409636+0000","last_undegraded":"2024-04-01T19:36:44.409636+0000","last_fullsized":"2024-04-01T19:36:44.409636+0000","mapping_epoch":312,"log_start":"274'2800","ondisk_log_start":"274'2800","created":267,"last_epoch_clean":313,"parent":"0.0","parent_split_bits":0,"last_scrub":"318'12800","last_scrub_stamp":"2024-04-01T19:36:43.520856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:36:43.520856+0000","objects_scrubbed":8928,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:04.896376+0000","scrub_duration":2024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576651264,"num_objects":8799,"num_object_clones":0,"num_object_copies":17598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8799,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12855,"num_write_kb":692928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10107,"num_bytes_recovered":662372352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"319'12960","reported_seq":13184,"reported_epoch":319,"state":"active+clean","last_fresh":"2024-04-01T19:36:45.612482+0000","last_change":"2024-04-01T19:35:25.820745+0000","last_active":"2024-04-01T19:36:45.612482+0000","last_peered":"2024-04-01T19:36:45.612482+0000","last_clean":"2024-04-01T19:36:45.612482+0000","last_became_active":"2024-04-01T19:33:59.106492+0000","last_became_peered":"2024-04-01T19:33:59.106492+0000","last_unstale":"2024-04-01T19:36:45.612482+0000","last_undegraded":"2024-04-01T19:36:45.612482+0000","last_fullsized":"2024-04-01T19:36:45.612482+0000","mapping_epoch":267,"log_start":"274'2900","ondisk_log_start":"274'2900","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"293'10226","last_scrub_stamp":"2024-04-01T19:35:25.820619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:35:25.820619+0000","objects_scrubbed":10153,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:36:51.177869+0000","scrub_duration":2362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":581566464,"num_objects":8874,"num_object_clones":0,"num_object_copies":17748,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8874,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12960,"num_write_kb":698688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.8","version":"319'12761","reported_seq":12980,"reported_epoch":319,"state":"active+clean","last_fresh":"2024-04-01T19:36:45.610448+0000","last_change":"2024-04-01T19:35:21.232879+0000","last_active":"2024-04-01T19:36:45.610448+0000","last_peered":"2024-04-01T19:36:45.610448+0000","last_clean":"2024-04-01T19:36:45.610448+0000","last_became_active":"2024-04-01T19:33:59.258615+0000","last_became_peered":"2024-04-01T19:33:59.258615+0000","last_unstale":"2024-04-01T19:36:45.610448+0000","last_undegraded":"2024-04-01T19:36:45.610448+0000","last_fullsized":"2024-04-01T19:36:45.610448+0000","mapping_epoch":267,"log_start":"274'2700","ondisk_log_start":"274'2700","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"293'9718","last_scrub_stamp":"2024-04-01T19:35:21.232741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:35:21.232741+0000","objects_scrubbed":9673,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1805,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568131584,"num_objects":8669,"num_object_clones":0,"num_object_copies":17338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12761,"num_write_kb":685760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.7","version":"319'12722","reported_seq":12941,"reported_epoch":319,"state":"active+clean","last_fresh":"2024-04-01T19:36:44.409633+0000","last_change":"2024-04-01T19:35:23.842424+0000","last_active":"2024-04-01T19:36:44.409633+0000","last_peered":"2024-04-01T19:36:44.409633+0000","last_clean":"2024-04-01T19:36:44.409633+0000","last_became_active":"2024-04-01T19:33:59.258696+0000","last_became_peered":"2024-04-01T19:33:59.258696+0000","last_unstale":"2024-04-01T19:36:44.409633+0000","last_undegraded":"2024-04-01T19:36:44.409633+0000","last_fullsized":"2024-04-01T19:36:44.409633+0000","mapping_epoch":267,"log_start":"274'2700","ondisk_log_start":"274'2700","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"293'9929","last_scrub_stamp":"2024-04-01T19:35:23.842165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:35:23.842165+0000","objects_scrubbed":9847,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:36:45.628758+0000","scrub_duration":2535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574750720,"num_objects":8770,"num_object_clones":0,"num_object_copies":17540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8770,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12722,"num_write_kb":687744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"319'12664","reported_seq":12886,"reported_epoch":319,"state":"active+clean","last_fresh":"2024-04-01T19:36:44.863987+0000","last_change":"2024-04-01T19:35:30.092283+0000","last_active":"2024-04-01T19:36:44.863987+0000","last_peered":"2024-04-01T19:36:44.863987+0000","last_clean":"2024-04-01T19:36:44.863987+0000","last_became_active":"2024-04-01T19:33:59.105657+0000","last_became_peered":"2024-04-01T19:33:59.105657+0000","last_unstale":"2024-04-01T19:36:44.863987+0000","last_undegraded":"2024-04-01T19:36:44.863987+0000","last_fullsized":"2024-04-01T19:36:44.863987+0000","mapping_epoch":267,"log_start":"274'2600","ondisk_log_start":"274'2600","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"294'10242","last_scrub_stamp":"2024-04-01T19:35:30.092040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:35:30.092040+0000","objects_scrubbed":10181,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:36:58.525075+0000","scrub_duration":2017,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569114624,"num_objects":8684,"num_object_clones":0,"num_object_copies":17368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8684,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12664,"num_write_kb":683136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.4","version":"319'12819","reported_seq":13039,"reported_epoch":319,"state":"active+clean","last_fresh":"2024-04-01T19:36:44.419851+0000","last_change":"2024-04-01T19:35:26.868754+0000","last_active":"2024-04-01T19:36:44.419851+0000","last_peered":"2024-04-01T19:36:44.419851+0000","last_clean":"2024-04-01T19:36:44.419851+0000","last_became_active":"2024-04-01T19:33:59.257653+0000","last_became_peered":"2024-04-01T19:33:59.257653+0000","last_unstale":"2024-04-01T19:36:44.419851+0000","last_undegraded":"2024-04-01T19:36:44.419851+0000","last_fullsized":"2024-04-01T19:36:44.419851+0000","mapping_epoch":267,"log_start":"274'2800","ondisk_log_start":"274'2800","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"293'10133","last_scrub_stamp":"2024-04-01T19:35:26.868604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:35:26.868604+0000","objects_scrubbed":10045,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:36:50.870043+0000","scrub_duration":2502,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":571539456,"num_objects":8721,"num_object_clones":0,"num_object_copies":17442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8721,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12819,"num_write_kb":689280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"319'12663","reported_seq":12974,"reported_epoch":319,"state":"active+clean+scrubbing","last_fresh":"2024-04-01T19:36:45.639908+0000","last_change":"2024-04-01T19:36:43.973339+0000","last_active":"2024-04-01T19:36:45.639908+0000","last_peered":"2024-04-01T19:36:45.639908+0000","last_clean":"2024-04-01T19:36:45.639908+0000","last_became_active":"2024-04-01T19:33:59.258172+0000","last_became_peered":"2024-04-01T19:33:59.258172+0000","last_unstale":"2024-04-01T19:36:45.639908+0000","last_undegraded":"2024-04-01T19:36:45.639908+0000","last_fullsized":"2024-04-01T19:36:45.639908+0000","mapping_epoch":267,"log_start":"274'2600","ondisk_log_start":"274'2600","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"293'9743","last_scrub_stamp":"2024-04-01T19:35:22.931986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:35:22.931986+0000","objects_scrubbed":8674,"log_size":10063,"log_dups_size":0,"ondisk_log_size":10063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"scrubbing for 1s","scrub_duration":1501,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568131584,"num_objects":8669,"num_object_clones":0,"num_object_copies":17338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12663,"num_write_kb":682624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"319'12846","reported_seq":13164,"reported_epoch":319,"state":"active+clean","last_fresh":"2024-04-01T19:36:44.855806+0000","last_change":"2024-04-01T19:36:26.552690+0000","last_active":"2024-04-01T19:36:44.855806+0000","last_peered":"2024-04-01T19:36:44.855806+0000","last_clean":"2024-04-01T19:36:44.855806+0000","last_became_active":"2024-04-01T19:33:59.102135+0000","last_became_peered":"2024-04-01T19:33:59.102135+0000","last_unstale":"2024-04-01T19:36:44.855806+0000","last_undegraded":"2024-04-01T19:36:44.855806+0000","last_fullsized":"2024-04-01T19:36:44.855806+0000","mapping_epoch":267,"log_start":"274'2800","ondisk_log_start":"274'2800","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"293'9721","last_scrub_stamp":"2024-04-01T19:35:20.973993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:35:20.973993+0000","objects_scrubbed":9799,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1740,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":571342848,"num_objects":8718,"num_object_clones":0,"num_object_copies":17436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12846,"num_write_kb":690048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5],"acting":[9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1","version":"319'12894","reported_seq":13112,"reported_epoch":319,"state":"active+clean","last_fresh":"2024-04-01T19:36:45.612626+0000","last_change":"2024-04-01T19:35:19.560634+0000","last_active":"2024-04-01T19:36:45.612626+0000","last_peered":"2024-04-01T19:36:45.612626+0000","last_clean":"2024-04-01T19:36:45.612626+0000","last_became_active":"2024-04-01T19:33:59.105816+0000","last_became_peered":"2024-04-01T19:33:59.105816+0000","last_unstale":"2024-04-01T19:36:45.612626+0000","last_undegraded":"2024-04-01T19:36:45.612626+0000","last_fullsized":"2024-04-01T19:36:45.612626+0000","mapping_epoch":267,"log_start":"274'2800","ondisk_log_start":"274'2800","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"293'9655","last_scrub_stamp":"2024-04-01T19:35:19.560476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:35:19.560476+0000","objects_scrubbed":9563,"log_size":10094,"log_dups_size":0,"ondisk_log_size":10094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"queued for scrub","scrub_duration":2161,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":572522496,"num_objects":8736,"num_object_clones":0,"num_object_copies":17472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8736,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12894,"num_write_kb":692160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.0","version":"318'12525","reported_seq":12844,"reported_epoch":318,"state":"active+clean","last_fresh":"2024-04-01T19:36:42.553823+0000","last_change":"2024-04-01T19:36:39.491283+0000","last_active":"2024-04-01T19:36:42.553823+0000","last_peered":"2024-04-01T19:36:42.553823+0000","last_clean":"2024-04-01T19:36:42.553823+0000","last_became_active":"2024-04-01T19:33:59.258519+0000","last_became_peered":"2024-04-01T19:33:59.258519+0000","last_unstale":"2024-04-01T19:36:42.553823+0000","last_undegraded":"2024-04-01T19:36:42.553823+0000","last_fullsized":"2024-04-01T19:36:42.553823+0000","mapping_epoch":267,"log_start":"274'2500","ondisk_log_start":"274'2500","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"318'12302","last_scrub_stamp":"2024-04-01T19:36:39.491135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:36:39.491135+0000","objects_scrubbed":9156,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:00.246693+0000","scrub_duration":1952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580976640,"num_objects":8865,"num_object_clones":0,"num_object_copies":17730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8865,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12525,"num_write_kb":684480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"318'12544","reported_seq":32652,"reported_epoch":318,"state":"active+clean","last_fresh":"2024-04-01T19:36:42.259826+0000","last_change":"2024-04-01T19:36:27.085409+0000","last_active":"2024-04-01T19:36:42.259826+0000","last_peered":"2024-04-01T19:36:42.259826+0000","last_clean":"2024-04-01T19:36:42.259826+0000","last_became_active":"2024-04-01T19:36:27.067895+0000","last_became_peered":"2024-04-01T19:36:27.067895+0000","last_unstale":"2024-04-01T19:36:42.259826+0000","last_undegraded":"2024-04-01T19:36:42.259826+0000","last_fullsized":"2024-04-01T19:36:42.259826+0000","mapping_epoch":314,"log_start":"274'2500","ondisk_log_start":"274'2500","created":267,"last_epoch_clean":315,"parent":"0.0","parent_split_bits":0,"last_scrub":"294'10215","last_scrub_stamp":"2024-04-01T19:35:29.500732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:35:29.500732+0000","objects_scrubbed":10154,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:36:44.370651+0000","scrub_duration":1796,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575143936,"num_objects":8776,"num_object_clones":0,"num_object_copies":17552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8776,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12544,"num_write_kb":682240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9937,"num_bytes_recovered":651231232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,11],"acting":[10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":850,"reported_epoch":318,"state":"active+clean","last_fresh":"2024-04-01T19:36:37.331403+0000","last_change":"2024-04-01T19:36:13.759798+0000","last_active":"2024-04-01T19:36:37.331403+0000","last_peered":"2024-04-01T19:36:37.331403+0000","last_clean":"2024-04-01T19:36:37.331403+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:36:37.331403+0000","last_undegraded":"2024-04-01T19:36:37.331403+0000","last_fullsized":"2024-04-01T19:36:37.331403+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:36:13.759638+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:36:13.759638+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:37:38.925224+0000","scrub_duration":64,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":9155575832,"num_objects":139704,"num_object_clones":0,"num_object_copies":279408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139704,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":204280,"num_write_kb":11007425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20044,"num_bytes_recovered":1313603584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19712253952,"data_stored":19712245808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160680,"ondisk_log_size":160680,"up":32,"acting":32,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220330,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3218700,"kb_used_data":2794628,"kb_used_omap":1,"kb_used_meta":424062,"kb_avail":90526452,"statfs":{"total":95995035648,"available":92699086848,"internally_reserved":0,"allocated":2861699072,"data_stored":2861334892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":434239940},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":77,"seq":330712481965,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2457016,"kb_used_data":2281456,"kb_used_omap":1,"kb_used_meta":175550,"kb_avail":91288136,"statfs":{"total":95995035648,"available":93479051264,"internally_reserved":0,"allocated":2336210944,"data_stored":2335856418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":179763648},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678197,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1958524,"kb_used_data":1684404,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":91786628,"statfs":{"total":95995035648,"available":93989507072,"internally_reserved":0,"allocated":1724829696,"data_stored":1724471118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":280689088},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557393,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":74428,"kb_used_data":688,"kb_used_omap":132,"kb_used_meta":73595,"kb_avail":93670724,"statfs":{"total":95995035648,"available":95918821376,"internally_reserved":0,"allocated":704512,"data_stored":350006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":75362023},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234174,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1981568,"kb_used_data":1701880,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":91763584,"statfs":{"total":95995035648,"available":93965910016,"internally_reserved":0,"allocated":1742725120,"data_stored":1742367062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":286390730},"hb_peers":[0,1,2,3,4,5,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575068,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":4291384,"kb_used_data":3957552,"kb_used_omap":1,"kb_used_meta":333822,"kb_avail":89453768,"statfs":{"total":95995035648,"available":91600658432,"internally_reserved":0,"allocated":4052533248,"data_stored":4052178742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":341834181},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738595,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":807096,"kb_used_data":559344,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":92938056,"statfs":{"total":95995035648,"available":95168569344,"internally_reserved":0,"allocated":572768256,"data_stored":572413750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253688261},"hb_peers":[1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346137,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":652872,"kb_used_data":555068,"kb_used_omap":1,"kb_used_meta":97790,"kb_avail":93092280,"statfs":{"total":95995035648,"available":95326494720,"internally_reserved":0,"allocated":568389632,"data_stored":568029024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100137413},"hb_peers":[0,1,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149905,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2031544,"kb_used_data":1707440,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":91713608,"statfs":{"total":95995035648,"available":93914734592,"internally_reserved":0,"allocated":1748418560,"data_stored":1748064054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":331872711},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953677,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1996168,"kb_used_data":1667904,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":91748984,"statfs":{"total":95995035648,"available":93950959616,"internally_reserved":0,"allocated":1707933696,"data_stored":1707569016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,1,2,3,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790153,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1321032,"kb_used_data":1119036,"kb_used_omap":1,"kb_used_meta":201918,"kb_avail":92424120,"statfs":{"total":95995035648,"available":94642298880,"internally_reserved":0,"allocated":1145892864,"data_stored":1145532256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":206764485},"hb_peers":[0,1,2,3,4,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":568000512,"data_stored":568000512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4024303616,"data_stored":4024303616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":565248000,"data_stored":565248000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1746665472,"data_stored":1746665472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1705512960,"data_stored":1705508888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1142095872,"data_stored":1142095872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1334575104,"data_stored":1334575104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1735589888,"data_stored":1735589888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":1712721920,"data_stored":1712717848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":2328428544,"data_stored":2328428544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":2849112064,"data_stored":2849112064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:36:51.667 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:36:51.715 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:36:51.730 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:36:51.733 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:51 smithi022 ceph-mon[39439]: 4.8 scrub starts 2024-04-01T19:36:51.733 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:51 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:36:51.733 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:51 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:36:51.733 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:51 smithi022 ceph-mon[39439]: 4.7 scrub ok 2024-04-01T19:36:51.740 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:51 smithi062 ceph-mon[44211]: 4.8 scrub starts 2024-04-01T19:36:51.741 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:51 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:36:51.741 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:51 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:36:51.741 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:51 smithi062 ceph-mon[44211]: 4.7 scrub ok 2024-04-01T19:36:51.743 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:51.765 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:36:51.769 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:51.770 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:36:51.871 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:36:51.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:51 smithi188 ceph-mon[43939]: 4.8 scrub starts 2024-04-01T19:36:51.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:51 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:36:51.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:51 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:36:51.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:51 smithi188 ceph-mon[43939]: 4.7 scrub ok 2024-04-01T19:36:51.905 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:52.599 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:52 smithi188 ceph-mon[43939]: pgmap v920: 17 pgs: 1 active+clean+scrubbing, 2 active+clean+scrubbing+deep, 14 active+clean; 8.3 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 989 op/s 2024-04-01T19:36:52.600 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:52 smithi188 ceph-mon[43939]: 4.8 scrub ok 2024-04-01T19:36:52.600 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:52 smithi188 ceph-mon[43939]: osdmap e321: 12 total, 11 up, 11 in 2024-04-01T19:36:52.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:52 smithi062 ceph-mon[44211]: pgmap v920: 17 pgs: 1 active+clean+scrubbing, 2 active+clean+scrubbing+deep, 14 active+clean; 8.3 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 989 op/s 2024-04-01T19:36:52.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:52 smithi062 ceph-mon[44211]: 4.8 scrub ok 2024-04-01T19:36:52.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:52 smithi062 ceph-mon[44211]: osdmap e321: 12 total, 11 up, 11 in 2024-04-01T19:36:52.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:52 smithi022 ceph-mon[39439]: pgmap v920: 17 pgs: 1 active+clean+scrubbing, 2 active+clean+scrubbing+deep, 14 active+clean; 8.3 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 989 op/s 2024-04-01T19:36:52.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:52 smithi022 ceph-mon[39439]: 4.8 scrub ok 2024-04-01T19:36:52.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:52 smithi022 ceph-mon[39439]: osdmap e321: 12 total, 11 up, 11 in 2024-04-01T19:36:52.989 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:36:52.989 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:36:52.990 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-01T19:36:52.990 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-01T19:36:52.990 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:36:53.091 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:36:53.091 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:36:53.358 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:36:53.364 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:53.364 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:36:53.466 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:36:53.497 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:53.523 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:36:53.527 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:53.527 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:36:53.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:53 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:36:53.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:53 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:36:53.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:53 smithi022 ceph-mon[39439]: osdmap e322: 12 total, 11 up, 11 in 2024-04-01T19:36:53.628 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:36:53.658 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:53.682 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:36:53.684 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:53.685 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:36:53.729 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:53 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:36:53.729 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:53 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:36:53.729 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:53 smithi188 ceph-mon[43939]: osdmap e322: 12 total, 11 up, 11 in 2024-04-01T19:36:53.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:53 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:36:53.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:53 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:36:53.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:53 smithi062 ceph-mon[44211]: osdmap e322: 12 total, 11 up, 11 in 2024-04-01T19:36:53.769 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_historic_ops 2024-04-01T19:36:53.785 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:36:53.813 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:53.835 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:36:53.841 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:53.841 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:36:53.942 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:36:54.022 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:54.066 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:36:54.069 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:54.070 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:36:54.171 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:36:54.200 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:54.202 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:36:54.429 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:36:54.450 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:36:54.453 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:54.453 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:36:54.554 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:36:54.609 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:54.639 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:36:54.641 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:54.642 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:36:54.696 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:54 smithi022 ceph-mon[39439]: pgmap v923: 17 pgs: 1 active+clean+scrubbing, 3 active+clean+scrubbing+deep, 13 active+clean; 8.3 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 661 op/s 2024-04-01T19:36:54.743 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:36:54.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:54 smithi062 ceph-mon[44211]: pgmap v923: 17 pgs: 1 active+clean+scrubbing, 3 active+clean+scrubbing+deep, 13 active+clean; 8.3 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 661 op/s 2024-04-01T19:36:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:54.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:54 smithi188 ceph-mon[43939]: pgmap v923: 17 pgs: 1 active+clean+scrubbing, 3 active+clean+scrubbing+deep, 13 active+clean; 8.3 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 661 op/s 2024-04-01T19:36:55.020 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:36:55.023 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:55.024 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:36:55.093 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:36:55.124 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:36:55.159 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:55.189 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:36:55.192 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:55.193 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:36:55.294 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:36:55.326 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:55.349 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:36:55.352 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:55.352 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:36:55.454 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:36:55.500 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:55.808 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:36:55.815 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:55.815 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:36:55.916 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:36:55.944 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:55.967 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:36:55.969 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:55.970 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:36:56.019 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:36:56.071 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:36:56.101 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:56.122 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:36:56.127 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:56.127 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:36:56.228 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:36:56.258 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:56.283 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:36:56.285 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:56.286 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:36:56.387 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:36:56.409 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:36:56.410 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:36:56.410 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:36:56.410 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:36:56.410 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.410 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:248721 2.d 2:b1003e65:::benchmark_data_smithi188_77607_object81317:head [delete] snapc 0=[] ondisk+write+known_if_redirected e156)", 2024-04-01T19:36:56.410 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:46.897485+0000", 2024-04-01T19:36:56.410 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 549.51113317399995, 2024-04-01T19:36:56.410 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16256036500000001, 2024-04-01T19:36:56.410 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:36:56.410 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:36:56.410 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:56.411 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:36:56.411 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:36:56.411 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:36:56.411 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 248721 2024-04-01T19:36:56.411 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.411 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:36:56.411 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.411 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:36:56.411 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.897485+0000", 2024-04-01T19:36:56.411 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.411 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.411 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.411 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:36:56.411 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.897485+0000", 2024-04-01T19:36:56.412 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.412 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.412 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.412 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:36:56.412 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.897487+0000", 2024-04-01T19:36:56.412 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9860000000000001e-06 2024-04-01T19:36:56.412 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.412 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.412 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:36:56.412 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.897493+0000", 2024-04-01T19:36:56.412 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7239999999999997e-06 2024-04-01T19:36:56.412 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.412 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.413 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:36:56.413 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.897506+0000", 2024-04-01T19:36:56.413 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2774e-05 2024-04-01T19:36:56.413 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.413 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.413 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:36:56.413 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.897514+0000", 2024-04-01T19:36:56.413 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1850000000000004e-06 2024-04-01T19:36:56.413 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.413 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.413 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.413 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.923769+0000", 2024-04-01T19:36:56.413 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026255392999999998 2024-04-01T19:36:56.413 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.414 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.414 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:36:56.414 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.923894+0000", 2024-04-01T19:36:56.414 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012517 2024-04-01T19:36:56.414 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.414 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.414 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:36:56.414 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.924022+0000", 2024-04-01T19:36:56.414 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012779100000000001 2024-04-01T19:36:56.414 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.414 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.414 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:56.414 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:46.928773+0000", 2024-04-01T19:36:56.415 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0047510039999999996 2024-04-01T19:36:56.415 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.415 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.415 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:36:56.415 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.059965+0000", 2024-04-01T19:36:56.415 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13119133199999999 2024-04-01T19:36:56.415 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.415 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.415 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:36:56.415 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.060002+0000", 2024-04-01T19:36:56.415 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7548e-05 2024-04-01T19:36:56.415 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.415 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.415 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:36:56.416 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.060046+0000", 2024-04-01T19:36:56.416 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3458000000000003e-05 2024-04-01T19:36:56.416 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.416 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:36:56.416 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.416 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.416 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.416 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:249236 2.d 2:b6ce699d:::benchmark_data_smithi188_77607_object81832:head [delete] snapc 0=[] ondisk+write+known_if_redirected e156)", 2024-04-01T19:36:56.416 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:47.591312+0000", 2024-04-01T19:36:56.416 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 548.81730641800004, 2024-04-01T19:36:56.416 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.181560891, 2024-04-01T19:36:56.416 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:36:56.416 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:36:56.416 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:56.417 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:36:56.417 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:36:56.417 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:36:56.417 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 249236 2024-04-01T19:36:56.417 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.417 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:36:56.417 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.417 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:36:56.417 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.591312+0000", 2024-04-01T19:36:56.417 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.417 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.417 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.417 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:36:56.417 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.591312+0000", 2024-04-01T19:36:56.417 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.418 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.418 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.418 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:36:56.418 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.591314+0000", 2024-04-01T19:36:56.418 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.385e-06 2024-04-01T19:36:56.418 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.418 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.418 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:36:56.418 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.591321+0000", 2024-04-01T19:36:56.418 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0840000000000003e-06 2024-04-01T19:36:56.418 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.418 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.418 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:36:56.419 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.591336+0000", 2024-04-01T19:36:56.419 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4575e-05 2024-04-01T19:36:56.419 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.419 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.419 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:36:56.419 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.591356+0000", 2024-04-01T19:36:56.419 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9755e-05 2024-04-01T19:36:56.419 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.419 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.419 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.420 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.626225+0000", 2024-04-01T19:36:56.420 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034869270000000001 2024-04-01T19:36:56.420 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.420 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.420 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:36:56.420 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.626348+0000", 2024-04-01T19:36:56.420 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012279399999999999 2024-04-01T19:36:56.420 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.420 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.420 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:36:56.420 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.626469+0000", 2024-04-01T19:36:56.420 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012113 2024-04-01T19:36:56.420 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.420 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.421 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:56.421 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.655862+0000", 2024-04-01T19:36:56.421 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029392686000000001 2024-04-01T19:36:56.421 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.421 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.421 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:36:56.421 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.772758+0000", 2024-04-01T19:36:56.421 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.11689601199999999 2024-04-01T19:36:56.421 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.421 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.421 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:36:56.421 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.772812+0000", 2024-04-01T19:36:56.421 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4122999999999997e-05 2024-04-01T19:36:56.421 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.422 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.422 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:36:56.422 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:47.772873+0000", 2024-04-01T19:36:56.422 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1076999999999998e-05 2024-04-01T19:36:56.422 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.422 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:36:56.422 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.422 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.422 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.422 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:250183 2.d 2:b6dffcc1:::benchmark_data_smithi188_77607_object82779:head [delete] snapc 0=[] ondisk+write+known_if_redirected e156)", 2024-04-01T19:36:56.422 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:48.757562+0000", 2024-04-01T19:36:56.422 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 547.651056455, 2024-04-01T19:36:56.422 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16188115, 2024-04-01T19:36:56.422 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:36:56.423 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:36:56.423 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:56.423 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:36:56.423 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:36:56.423 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:36:56.423 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 250183 2024-04-01T19:36:56.423 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.423 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:36:56.423 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.423 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:36:56.423 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.757562+0000", 2024-04-01T19:36:56.423 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.423 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.423 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.423 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:36:56.424 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.757562+0000", 2024-04-01T19:36:56.424 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.424 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.424 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.424 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:36:56.424 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.757564+0000", 2024-04-01T19:36:56.424 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2089999999999999e-06 2024-04-01T19:36:56.424 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.424 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.424 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:36:56.424 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.757571+0000", 2024-04-01T19:36:56.424 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8700000000000003e-06 2024-04-01T19:36:56.424 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.425 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.425 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:36:56.425 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.757586+0000", 2024-04-01T19:36:56.425 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5325999999999999e-05 2024-04-01T19:36:56.425 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.425 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.425 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:36:56.425 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.757596+0000", 2024-04-01T19:36:56.425 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0013000000000001e-05 2024-04-01T19:36:56.425 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.425 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.425 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.425 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.787384+0000", 2024-04-01T19:36:56.425 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029787991 2024-04-01T19:36:56.426 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.426 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.426 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:36:56.426 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.787515+0000", 2024-04-01T19:36:56.426 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013011199999999999 2024-04-01T19:36:56.426 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.426 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.426 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:36:56.426 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.787644+0000", 2024-04-01T19:36:56.426 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000129164 2024-04-01T19:36:56.426 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.426 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.426 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:56.426 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.803111+0000", 2024-04-01T19:36:56.427 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015466881 2024-04-01T19:36:56.427 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.427 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.427 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:36:56.427 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.919319+0000", 2024-04-01T19:36:56.427 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.116208031 2024-04-01T19:36:56.427 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.427 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.427 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:36:56.427 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.919379+0000", 2024-04-01T19:36:56.427 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0327e-05 2024-04-01T19:36:56.427 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.427 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.427 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:36:56.428 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.919443+0000", 2024-04-01T19:36:56.428 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4226000000000005e-05 2024-04-01T19:36:56.428 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.428 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:36:56.428 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.428 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.428 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.428 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:250195 2.d 2:b3613023:::benchmark_data_smithi188_77607_object82791:head [delete] snapc 0=[] ondisk+write+known_if_redirected e156)", 2024-04-01T19:36:56.428 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:48.769498+0000", 2024-04-01T19:36:56.428 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 547.63912041100002, 2024-04-01T19:36:56.428 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.150167941, 2024-04-01T19:36:56.428 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:36:56.428 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:36:56.428 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:56.429 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:36:56.429 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:36:56.429 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:36:56.429 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 250195 2024-04-01T19:36:56.429 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.429 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:36:56.429 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.429 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:36:56.429 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.769498+0000", 2024-04-01T19:36:56.429 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.429 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.429 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.429 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:36:56.430 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.769498+0000", 2024-04-01T19:36:56.430 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.430 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.430 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.430 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:36:56.430 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.769500+0000", 2024-04-01T19:36:56.430 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3870000000000002e-06 2024-04-01T19:36:56.430 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.430 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.430 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:36:56.431 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.769508+0000", 2024-04-01T19:36:56.431 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1430000000000001e-06 2024-04-01T19:36:56.431 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.431 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.431 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:36:56.431 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.769523+0000", 2024-04-01T19:36:56.431 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5625e-05 2024-04-01T19:36:56.431 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.431 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.431 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:36:56.431 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.769531+0000", 2024-04-01T19:36:56.431 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3110000000000006e-06 2024-04-01T19:36:56.431 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.431 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.432 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.432 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.792882+0000", 2024-04-01T19:36:56.432 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023350724999999999 2024-04-01T19:36:56.432 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.432 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.432 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:36:56.432 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.793022+0000", 2024-04-01T19:36:56.432 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014011000000000001 2024-04-01T19:36:56.432 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.432 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.432 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:36:56.432 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.793168+0000", 2024-04-01T19:36:56.432 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014591699999999999 2024-04-01T19:36:56.432 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.433 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.433 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:56.433 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.803160+0000", 2024-04-01T19:36:56.433 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0099919559999999998 2024-04-01T19:36:56.433 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.433 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.433 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:36:56.433 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.919577+0000", 2024-04-01T19:36:56.433 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.116416319 2024-04-01T19:36:56.433 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.433 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.433 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:36:56.433 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.919620+0000", 2024-04-01T19:36:56.433 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3188000000000001e-05 2024-04-01T19:36:56.433 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.434 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.434 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:36:56.434 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.919666+0000", 2024-04-01T19:36:56.434 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6260000000000001e-05 2024-04-01T19:36:56.434 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.434 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:36:56.434 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.434 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.434 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.434 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:250350 2.d 2:b8eceb9e:::benchmark_data_smithi188_77607_object82946:head [delete] snapc 0=[] ondisk+write+known_if_redirected e156)", 2024-04-01T19:36:56.434 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:48.978621+0000", 2024-04-01T19:36:56.434 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 547.42999726300002, 2024-04-01T19:36:56.434 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.146024284, 2024-04-01T19:36:56.434 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:36:56.435 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:36:56.435 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:56.435 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:36:56.435 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:36:56.435 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:36:56.435 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 250350 2024-04-01T19:36:56.435 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.435 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:36:56.435 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.435 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:36:56.435 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.978621+0000", 2024-04-01T19:36:56.435 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.435 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.435 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.436 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:36:56.436 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.978621+0000", 2024-04-01T19:36:56.436 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.436 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.436 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.436 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:36:56.436 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.978622+0000", 2024-04-01T19:36:56.436 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8999999999999996e-07 2024-04-01T19:36:56.436 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.436 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.436 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:36:56.436 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.978625+0000", 2024-04-01T19:36:56.436 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7350000000000001e-06 2024-04-01T19:36:56.436 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.437 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.437 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:36:56.437 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.978631+0000", 2024-04-01T19:36:56.437 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2450000000000003e-06 2024-04-01T19:36:56.437 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.437 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.437 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:36:56.437 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.978636+0000", 2024-04-01T19:36:56.437 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8590000000000004e-06 2024-04-01T19:36:56.437 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.437 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.438 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.438 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.989548+0000", 2024-04-01T19:36:56.438 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010912478999999999 2024-04-01T19:36:56.438 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.438 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.438 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:36:56.438 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.989667+0000", 2024-04-01T19:36:56.438 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000118585 2024-04-01T19:36:56.438 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.438 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.438 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:36:56.438 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.989790+0000", 2024-04-01T19:36:56.438 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012361800000000001 2024-04-01T19:36:56.438 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.439 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.439 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:56.439 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:48.994628+0000", 2024-04-01T19:36:56.439 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0048380970000000004 2024-04-01T19:36:56.439 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.439 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.439 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:36:56.439 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.124528+0000", 2024-04-01T19:36:56.439 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.12989994599999999 2024-04-01T19:36:56.439 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.439 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.439 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:36:56.439 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.124577+0000", 2024-04-01T19:36:56.439 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8554999999999998e-05 2024-04-01T19:36:56.440 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.440 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.440 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:36:56.440 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.124645+0000", 2024-04-01T19:36:56.440 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8474999999999997e-05 2024-04-01T19:36:56.440 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.440 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:36:56.440 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.440 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.441 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.441 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:250603 2.d 2:b946184c:::benchmark_data_smithi188_77607_object83199:head [delete] snapc 0=[] ondisk+write+known_if_redirected e156)", 2024-04-01T19:36:56.441 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:49.293661+0000", 2024-04-01T19:36:56.441 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 547.11495768999998, 2024-04-01T19:36:56.441 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14584196399999999, 2024-04-01T19:36:56.441 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:36:56.441 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:36:56.441 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:56.441 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:36:56.441 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:36:56.441 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:36:56.441 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 250603 2024-04-01T19:36:56.441 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.442 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:36:56.442 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.442 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:36:56.442 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.293661+0000", 2024-04-01T19:36:56.442 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.442 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.442 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.442 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:36:56.442 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.293661+0000", 2024-04-01T19:36:56.442 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.442 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.442 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.442 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:36:56.443 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.293663+0000", 2024-04-01T19:36:56.443 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0150000000000002e-06 2024-04-01T19:36:56.443 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.443 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.443 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:36:56.443 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.293668+0000", 2024-04-01T19:36:56.443 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6869999999999999e-06 2024-04-01T19:36:56.443 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.443 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.443 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:36:56.443 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.293680+0000", 2024-04-01T19:36:56.443 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1810999999999999e-05 2024-04-01T19:36:56.443 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.443 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.444 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:36:56.444 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.293686+0000", 2024-04-01T19:36:56.444 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6679999999999998e-06 2024-04-01T19:36:56.444 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.444 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.444 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.444 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.314363+0000", 2024-04-01T19:36:56.444 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020676792999999999 2024-04-01T19:36:56.444 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.444 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.444 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:36:56.444 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.314466+0000", 2024-04-01T19:36:56.444 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000103162 2024-04-01T19:36:56.444 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.445 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:36:56.445 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.314533+0000", 2024-04-01T19:36:56.445 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6952000000000005e-05 2024-04-01T19:36:56.445 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.445 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:36:56.445 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.326788+0000", 2024-04-01T19:36:56.445 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012254699000000001 2024-04-01T19:36:56.445 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.445 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:56.445 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.439418+0000", 2024-04-01T19:36:56.445 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.112630336 2024-04-01T19:36:56.446 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.446 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.446 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:36:56.446 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.439452+0000", 2024-04-01T19:36:56.446 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4051000000000003e-05 2024-04-01T19:36:56.446 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.446 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.446 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:36:56.446 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:49.439503+0000", 2024-04-01T19:36:56.446 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.079e-05 2024-04-01T19:36:56.446 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.446 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:36:56.446 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.447 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.447 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.447 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:251569 2.d 2:bc483287:::benchmark_data_smithi188_77607_object84165:head [delete] snapc 0=[] ondisk+write+known_if_redirected e157)", 2024-04-01T19:36:56.447 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:50.522652+0000", 2024-04-01T19:36:56.447 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 545.88596679199998, 2024-04-01T19:36:56.447 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16137095300000001, 2024-04-01T19:36:56.447 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:36:56.447 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:36:56.447 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:56.447 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:36:56.447 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:36:56.447 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:36:56.447 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 251569 2024-04-01T19:36:56.447 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.448 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:36:56.448 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.448 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:36:56.448 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.522652+0000", 2024-04-01T19:36:56.448 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.448 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.448 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.448 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:36:56.448 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.522652+0000", 2024-04-01T19:36:56.448 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.448 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.448 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.448 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:36:56.448 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.522654+0000", 2024-04-01T19:36:56.449 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2369999999999999e-06 2024-04-01T19:36:56.449 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.449 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.449 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:36:56.449 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.522670+0000", 2024-04-01T19:36:56.449 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5888000000000001e-05 2024-04-01T19:36:56.449 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.449 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.449 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:36:56.449 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.522686+0000", 2024-04-01T19:36:56.449 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5928999999999999e-05 2024-04-01T19:36:56.449 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.449 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.449 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:36:56.449 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.522693+0000", 2024-04-01T19:36:56.450 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7680000000000008e-06 2024-04-01T19:36:56.450 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.450 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.450 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.450 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.548310+0000", 2024-04-01T19:36:56.450 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.025616173999999999 2024-04-01T19:36:56.450 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.450 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.450 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:36:56.450 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.548442+0000", 2024-04-01T19:36:56.450 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000132772 2024-04-01T19:36:56.450 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.450 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.451 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:36:56.451 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.548556+0000", 2024-04-01T19:36:56.451 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000113393 2024-04-01T19:36:56.451 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.451 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.451 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:56.451 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.683906+0000", 2024-04-01T19:36:56.451 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.135349792 2024-04-01T19:36:56.451 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.452 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.452 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:36:56.452 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.683921+0000", 2024-04-01T19:36:56.452 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5631e-05 2024-04-01T19:36:56.452 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.452 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.452 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:36:56.452 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.683968+0000", 2024-04-01T19:36:56.452 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6279000000000002e-05 2024-04-01T19:36:56.452 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.452 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.452 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:36:56.452 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.684023+0000", 2024-04-01T19:36:56.452 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5090000000000003e-05 2024-04-01T19:36:56.452 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.453 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:36:56.453 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.453 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.453 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.453 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:251601 2.d 2:bd354f70:::benchmark_data_smithi188_77607_object84197:head [delete] snapc 0=[] ondisk+write+known_if_redirected e157)", 2024-04-01T19:36:56.453 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:50.549151+0000", 2024-04-01T19:36:56.453 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 545.85946753799999, 2024-04-01T19:36:56.453 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.146277241, 2024-04-01T19:36:56.453 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:36:56.453 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:36:56.453 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:56.453 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:36:56.453 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:36:56.454 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:36:56.454 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 251601 2024-04-01T19:36:56.454 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.454 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:36:56.454 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.454 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:36:56.454 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.549151+0000", 2024-04-01T19:36:56.454 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.454 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.454 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.454 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:36:56.454 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.549151+0000", 2024-04-01T19:36:56.455 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.455 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.455 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.455 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:36:56.455 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.549153+0000", 2024-04-01T19:36:56.455 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7090000000000001e-06 2024-04-01T19:36:56.455 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.455 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.455 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:36:56.455 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.549159+0000", 2024-04-01T19:36:56.455 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3520000000000003e-06 2024-04-01T19:36:56.455 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.455 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.455 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:36:56.456 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.549169+0000", 2024-04-01T19:36:56.456 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.798e-06 2024-04-01T19:36:56.456 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.456 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.456 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:36:56.456 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.549188+0000", 2024-04-01T19:36:56.456 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9017000000000001e-05 2024-04-01T19:36:56.456 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.457 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.457 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.457 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.679851+0000", 2024-04-01T19:36:56.457 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13066309100000001 2024-04-01T19:36:56.457 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.457 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.457 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:36:56.457 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.679937+0000", 2024-04-01T19:36:56.457 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5829999999999996e-05 2024-04-01T19:36:56.457 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.457 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.457 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:36:56.457 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.680015+0000", 2024-04-01T19:36:56.457 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8287000000000004e-05 2024-04-01T19:36:56.458 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.458 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.458 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:36:56.458 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.684239+0000", 2024-04-01T19:36:56.458 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0042242579999999998 2024-04-01T19:36:56.458 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.458 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.458 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:56.458 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.695316+0000", 2024-04-01T19:36:56.458 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011076618999999999 2024-04-01T19:36:56.458 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.458 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.458 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:36:56.458 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.695377+0000", 2024-04-01T19:36:56.459 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0841000000000002e-05 2024-04-01T19:36:56.459 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.459 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.459 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:36:56.459 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:50.695428+0000", 2024-04-01T19:36:56.459 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1439e-05 2024-04-01T19:36:56.459 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.459 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:36:56.459 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.459 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.459 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.459 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:253518 2.d 2:b2dfd025:::benchmark_data_smithi188_77607_object86114:head [delete] snapc 0=[] ondisk+write+known_if_redirected e157)", 2024-04-01T19:36:56.459 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:52.998586+0000", 2024-04-01T19:36:56.459 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 543.41003204699996, 2024-04-01T19:36:56.460 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.17168951199999999, 2024-04-01T19:36:56.460 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:36:56.460 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:36:56.460 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:56.460 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:36:56.460 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:36:56.460 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:36:56.460 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 253518 2024-04-01T19:36:56.460 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.460 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:36:56.460 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.460 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:36:56.460 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:52.998586+0000", 2024-04-01T19:36:56.460 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.461 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.461 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.461 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:36:56.461 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:52.998586+0000", 2024-04-01T19:36:56.461 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.461 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.461 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.461 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:36:56.461 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:52.998589+0000", 2024-04-01T19:36:56.462 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1320000000000001e-06 2024-04-01T19:36:56.462 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.462 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.462 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:36:56.462 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:52.998595+0000", 2024-04-01T19:36:56.462 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7129999999999999e-06 2024-04-01T19:36:56.462 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.462 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.462 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:36:56.462 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:52.998607+0000", 2024-04-01T19:36:56.462 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1582e-05 2024-04-01T19:36:56.462 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.462 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.463 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:36:56.463 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:52.998615+0000", 2024-04-01T19:36:56.463 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0029999999999994e-06 2024-04-01T19:36:56.463 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.463 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.463 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.463 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.039964+0000", 2024-04-01T19:36:56.463 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041349412000000002 2024-04-01T19:36:56.463 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.463 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.463 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:36:56.463 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.040085+0000", 2024-04-01T19:36:56.463 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012086099999999999 2024-04-01T19:36:56.463 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.464 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.464 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:36:56.464 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.040214+0000", 2024-04-01T19:36:56.464 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012912000000000001 2024-04-01T19:36:56.464 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.464 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.464 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:56.464 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.061849+0000", 2024-04-01T19:36:56.464 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.021635031999999998 2024-04-01T19:36:56.464 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.464 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.464 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:36:56.464 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.170163+0000", 2024-04-01T19:36:56.464 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.10831364 2024-04-01T19:36:56.465 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.465 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.465 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:36:56.465 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.170214+0000", 2024-04-01T19:36:56.465 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0695999999999997e-05 2024-04-01T19:36:56.465 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.465 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.465 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:36:56.465 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.170276+0000", 2024-04-01T19:36:56.465 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2321000000000002e-05 2024-04-01T19:36:56.465 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.465 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:36:56.465 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.465 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.466 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.466 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:254281 2.d 2:b91f57e9:::benchmark_data_smithi188_77607_object86877:head [delete] snapc 0=[] ondisk+write+known_if_redirected e157)", 2024-04-01T19:36:56.466 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:53.999010+0000", 2024-04-01T19:36:56.466 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 542.40960796399997, 2024-04-01T19:36:56.466 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.199172619, 2024-04-01T19:36:56.466 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:36:56.466 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:36:56.466 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:56.466 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:36:56.466 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:36:56.466 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:36:56.466 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 254281 2024-04-01T19:36:56.466 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.467 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:36:56.467 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.467 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:36:56.467 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.999010+0000", 2024-04-01T19:36:56.467 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.467 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.467 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.467 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:36:56.467 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.999010+0000", 2024-04-01T19:36:56.467 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.467 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.467 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.467 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:36:56.467 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.999012+0000", 2024-04-01T19:36:56.468 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5889999999999999e-06 2024-04-01T19:36:56.468 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.468 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.468 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:36:56.468 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.999017+0000", 2024-04-01T19:36:56.468 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7419999999999997e-06 2024-04-01T19:36:56.468 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.468 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.468 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:36:56.468 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.999026+0000", 2024-04-01T19:36:56.468 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5740000000000002e-06 2024-04-01T19:36:56.468 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.468 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.468 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:36:56.469 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:53.999034+0000", 2024-04-01T19:36:56.469 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.396e-06 2024-04-01T19:36:56.469 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.469 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.469 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.469 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.056758+0000", 2024-04-01T19:36:56.469 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057724567999999997 2024-04-01T19:36:56.469 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.469 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.469 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:36:56.469 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.056871+0000", 2024-04-01T19:36:56.469 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000112892 2024-04-01T19:36:56.469 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.469 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.470 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:36:56.470 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.056984+0000", 2024-04-01T19:36:56.470 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011265900000000001 2024-04-01T19:36:56.470 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.470 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.470 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:56.470 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.061837+0000", 2024-04-01T19:36:56.470 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0048528169999999997 2024-04-01T19:36:56.470 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.470 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.470 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:36:56.470 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.198068+0000", 2024-04-01T19:36:56.470 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13623084599999999 2024-04-01T19:36:56.470 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.471 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.471 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:36:56.471 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.198113+0000", 2024-04-01T19:36:56.471 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5890999999999998e-05 2024-04-01T19:36:56.471 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.471 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.471 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:36:56.471 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.198183+0000", 2024-04-01T19:36:56.471 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9645000000000002e-05 2024-04-01T19:36:56.471 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.471 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:36:56.471 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.471 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.471 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.472 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:254452 2.d 2:b233dfb5:::benchmark_data_smithi188_77607_object87048:head [delete] snapc 0=[] ondisk+write+known_if_redirected e157)", 2024-04-01T19:36:56.472 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:54.264275+0000", 2024-04-01T19:36:56.472 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 542.14434363999999, 2024-04-01T19:36:56.472 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14739497600000001, 2024-04-01T19:36:56.472 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:36:56.472 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:36:56.472 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:56.472 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:36:56.472 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:36:56.472 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:36:56.473 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 254452 2024-04-01T19:36:56.473 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.473 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:36:56.473 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.473 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:36:56.473 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.264275+0000", 2024-04-01T19:36:56.473 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.473 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.473 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.473 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:36:56.473 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.264275+0000", 2024-04-01T19:36:56.473 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.473 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.474 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.474 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:36:56.474 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.264277+0000", 2024-04-01T19:36:56.474 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0470000000000001e-06 2024-04-01T19:36:56.474 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.474 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.474 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:36:56.474 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.264283+0000", 2024-04-01T19:36:56.474 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0689999999999998e-06 2024-04-01T19:36:56.474 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.474 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.474 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:36:56.474 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.264291+0000", 2024-04-01T19:36:56.475 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8299999999999996e-06 2024-04-01T19:36:56.475 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.475 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.475 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:36:56.475 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.264298+0000", 2024-04-01T19:36:56.475 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3420000000000002e-06 2024-04-01T19:36:56.475 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.475 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.475 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.475 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.385001+0000", 2024-04-01T19:36:56.475 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.120703242 2024-04-01T19:36:56.475 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.475 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.475 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:36:56.476 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.385108+0000", 2024-04-01T19:36:56.476 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000106902 2024-04-01T19:36:56.476 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.476 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.476 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:36:56.476 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.385222+0000", 2024-04-01T19:36:56.476 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000113738 2024-04-01T19:36:56.476 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.476 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.476 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:56.476 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.410153+0000", 2024-04-01T19:36:56.476 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.024931471 2024-04-01T19:36:56.476 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.476 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.477 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:36:56.477 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.411612+0000", 2024-04-01T19:36:56.477 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014584369999999999 2024-04-01T19:36:56.477 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.477 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.477 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:36:56.477 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.411642+0000", 2024-04-01T19:36:56.477 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0540999999999998e-05 2024-04-01T19:36:56.477 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.477 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.477 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:36:56.477 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:54.411670+0000", 2024-04-01T19:36:56.477 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7356999999999999e-05 2024-04-01T19:36:56.477 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.478 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:36:56.478 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.478 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.478 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.478 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:255080 2.d 2:b280a3fb:::benchmark_data_smithi188_77607_object87676:head [delete] snapc 0=[] ondisk+write+known_if_redirected e157)", 2024-04-01T19:36:56.478 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:27:55.090210+0000", 2024-04-01T19:36:56.478 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 541.31840806399998, 2024-04-01T19:36:56.478 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.15887069700000001, 2024-04-01T19:36:56.478 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:36:56.478 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:36:56.478 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:56.478 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:36:56.478 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:36:56.478 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:36:56.479 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 255080 2024-04-01T19:36:56.479 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.479 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:36:56.479 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.479 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:36:56.479 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.090210+0000", 2024-04-01T19:36:56.479 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.479 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.479 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.479 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:36:56.479 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.090210+0000", 2024-04-01T19:36:56.479 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.479 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.479 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.480 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:36:56.480 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.090212+0000", 2024-04-01T19:36:56.480 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7400000000000001e-06 2024-04-01T19:36:56.480 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.480 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.480 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:36:56.480 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.090216+0000", 2024-04-01T19:36:56.480 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2379999999999999e-06 2024-04-01T19:36:56.480 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.480 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.480 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:36:56.480 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.090226+0000", 2024-04-01T19:36:56.481 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1740000000000006e-06 2024-04-01T19:36:56.481 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.481 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.481 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:36:56.481 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.090231+0000", 2024-04-01T19:36:56.481 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8830000000000003e-06 2024-04-01T19:36:56.481 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.482 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.482 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.482 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.110454+0000", 2024-04-01T19:36:56.482 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020223042 2024-04-01T19:36:56.482 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.482 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.482 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:36:56.482 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.110549+0000", 2024-04-01T19:36:56.482 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4320000000000005e-05 2024-04-01T19:36:56.483 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.483 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.483 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:36:56.483 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.110629+0000", 2024-04-01T19:36:56.483 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9950000000000005e-05 2024-04-01T19:36:56.483 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.483 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.483 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:56.483 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.114631+0000", 2024-04-01T19:36:56.483 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040024049999999997 2024-04-01T19:36:56.483 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.483 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.483 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:36:56.484 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.248950+0000", 2024-04-01T19:36:56.484 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13431896800000001 2024-04-01T19:36:56.484 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.484 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.484 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:36:56.484 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.249010+0000", 2024-04-01T19:36:56.484 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0134999999999999e-05 2024-04-01T19:36:56.484 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.484 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.484 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:36:56.485 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:27:55.249081+0000", 2024-04-01T19:36:56.485 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0841999999999997e-05 2024-04-01T19:36:56.485 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.485 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:36:56.485 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.485 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.485 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.485 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:265187 2.f 2.575ca2f (undecoded) ondisk+retry+write+known_if_redirected e169)", 2024-04-01T19:36:56.485 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:28:30.804284+0000", 2024-04-01T19:36:56.485 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 505.60433412700002, 2024-04-01T19:36:56.485 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85333816100000004, 2024-04-01T19:36:56.486 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:36:56.486 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:36:56.486 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:36:56.486 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:36:56.486 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:36:56.486 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:36:56.486 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 265187 2024-04-01T19:36:56.486 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.486 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:36:56.486 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.486 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:36:56.486 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804284+0000", 2024-04-01T19:36:56.487 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.487 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.487 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.487 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:36:56.487 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804284+0000", 2024-04-01T19:36:56.487 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.487 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.487 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.487 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:36:56.487 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804287+0000", 2024-04-01T19:36:56.487 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8600000000000001e-06 2024-04-01T19:36:56.487 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.487 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.487 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:36:56.488 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804297+0000", 2024-04-01T19:36:56.488 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8300000000000008e-06 2024-04-01T19:36:56.488 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.488 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.488 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:36:56.488 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804309+0000", 2024-04-01T19:36:56.488 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1943000000000001e-05 2024-04-01T19:36:56.488 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.488 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.488 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:36:56.488 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804326+0000", 2024-04-01T19:36:56.488 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7348000000000001e-05 2024-04-01T19:36:56.488 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.488 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.489 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.489 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804481+0000", 2024-04-01T19:36:56.489 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015451500000000001 2024-04-01T19:36:56.489 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.489 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.489 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:36:56.489 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804496+0000", 2024-04-01T19:36:56.489 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5682999999999999e-05 2024-04-01T19:36:56.489 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.489 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.489 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.489 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.657594+0000", 2024-04-01T19:36:56.489 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85309795300000002 2024-04-01T19:36:56.489 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.490 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.490 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:36:56.490 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.657622+0000", 2024-04-01T19:36:56.490 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8028999999999999e-05 2024-04-01T19:36:56.490 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.490 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:36:56.490 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.490 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.490 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.490 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:265204 2.f 2.e8d255ff (undecoded) ondisk+retry+write+known_if_redirected e169)", 2024-04-01T19:36:56.490 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:28:30.804397+0000", 2024-04-01T19:36:56.490 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 505.60422175799999, 2024-04-01T19:36:56.490 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85341209200000001, 2024-04-01T19:36:56.491 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:36:56.491 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:36:56.491 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:36:56.491 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:36:56.491 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:36:56.491 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:36:56.491 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 265204 2024-04-01T19:36:56.491 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.491 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:36:56.491 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.491 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:36:56.491 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804397+0000", 2024-04-01T19:36:56.492 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.492 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.492 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.492 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:36:56.492 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804397+0000", 2024-04-01T19:36:56.492 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.492 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.492 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.492 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:36:56.492 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804398+0000", 2024-04-01T19:36:56.492 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4300000000000001e-07 2024-04-01T19:36:56.492 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.492 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.492 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:36:56.493 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804403+0000", 2024-04-01T19:36:56.493 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9069999999999998e-06 2024-04-01T19:36:56.493 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.493 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.493 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:36:56.493 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804468+0000", 2024-04-01T19:36:56.493 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5566000000000002e-05 2024-04-01T19:36:56.493 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.493 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.494 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:36:56.494 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804512+0000", 2024-04-01T19:36:56.494 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3782000000000002e-05 2024-04-01T19:36:56.494 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.494 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.494 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.494 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804571+0000", 2024-04-01T19:36:56.494 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8758000000000002e-05 2024-04-01T19:36:56.494 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.494 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.494 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:36:56.494 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804581+0000", 2024-04-01T19:36:56.494 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.995e-06 2024-04-01T19:36:56.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.495 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.495 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.495 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.657801+0000", 2024-04-01T19:36:56.495 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85322052199999998 2024-04-01T19:36:56.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.495 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.495 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:36:56.495 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.657809+0000", 2024-04-01T19:36:56.495 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6190000000000002e-06 2024-04-01T19:36:56.495 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.495 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:36:56.495 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.496 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.496 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:265211 2.f 2.997101df (undecoded) ondisk+retry+write+known_if_redirected e169)", 2024-04-01T19:36:56.496 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:28:30.804530+0000", 2024-04-01T19:36:56.496 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 505.60408802900002, 2024-04-01T19:36:56.496 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85332372400000001, 2024-04-01T19:36:56.496 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:36:56.496 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:36:56.496 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:36:56.496 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:36:56.496 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:36:56.496 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:36:56.496 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 265211 2024-04-01T19:36:56.496 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.496 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:36:56.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:36:56.497 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804530+0000", 2024-04-01T19:36:56.497 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.497 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:36:56.497 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804530+0000", 2024-04-01T19:36:56.497 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.497 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:36:56.497 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804531+0000", 2024-04-01T19:36:56.497 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7000000000000003e-07 2024-04-01T19:36:56.498 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.498 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.498 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:36:56.498 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804536+0000", 2024-04-01T19:36:56.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7679999999999999e-06 2024-04-01T19:36:56.498 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.498 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.498 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:36:56.498 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804551+0000", 2024-04-01T19:36:56.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4962e-05 2024-04-01T19:36:56.498 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.498 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.498 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:36:56.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804565+0000", 2024-04-01T19:36:56.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3964999999999999e-05 2024-04-01T19:36:56.499 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.499 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804606+0000", 2024-04-01T19:36:56.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1044999999999998e-05 2024-04-01T19:36:56.499 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.499 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:36:56.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804614+0000", 2024-04-01T19:36:56.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0460000000000006e-06 2024-04-01T19:36:56.499 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.500 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.500 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.657845+0000", 2024-04-01T19:36:56.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85323087399999997 2024-04-01T19:36:56.500 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.500 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.500 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:36:56.500 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.657854+0000", 2024-04-01T19:36:56.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0939999999999997e-06 2024-04-01T19:36:56.500 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.500 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:36:56.500 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.500 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.500 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.500 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:265236 2.f 2.41e78bff (undecoded) ondisk+retry+write+known_if_redirected e169)", 2024-04-01T19:36:56.500 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:28:30.804573+0000", 2024-04-01T19:36:56.501 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 505.60404562000002, 2024-04-01T19:36:56.501 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85330377800000001, 2024-04-01T19:36:56.501 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:36:56.501 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:36:56.501 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:36:56.501 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:36:56.501 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:36:56.501 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:36:56.501 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 265236 2024-04-01T19:36:56.501 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.501 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:36:56.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.501 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:36:56.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804573+0000", 2024-04-01T19:36:56.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.502 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.502 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:36:56.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804573+0000", 2024-04-01T19:36:56.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.502 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.502 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:36:56.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804574+0000", 2024-04-01T19:36:56.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8599999999999998e-07 2024-04-01T19:36:56.502 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:36:56.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804597+0000", 2024-04-01T19:36:56.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3825e-05 2024-04-01T19:36:56.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:36:56.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804606+0000", 2024-04-01T19:36:56.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3100000000000001e-06 2024-04-01T19:36:56.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:36:56.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804613+0000", 2024-04-01T19:36:56.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5700000000000004e-06 2024-04-01T19:36:56.504 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.504 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804654+0000", 2024-04-01T19:36:56.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0377000000000003e-05 2024-04-01T19:36:56.504 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.504 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:36:56.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804662+0000", 2024-04-01T19:36:56.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8089999999999999e-06 2024-04-01T19:36:56.505 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.505 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.505 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.505 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.657871+0000", 2024-04-01T19:36:56.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85320828800000004 2024-04-01T19:36:56.505 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.505 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.505 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:36:56.505 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.657877+0000", 2024-04-01T19:36:56.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.913e-06 2024-04-01T19:36:56.505 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.506 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:36:56.506 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.506 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.506 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:265242 2.f 2.74f080ef (undecoded) ondisk+retry+write+known_if_redirected e169)", 2024-04-01T19:36:56.506 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:28:30.804623+0000", 2024-04-01T19:36:56.506 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 505.60399568999998, 2024-04-01T19:36:56.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85341866099999997, 2024-04-01T19:36:56.506 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:36:56.506 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:36:56.506 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:36:56.506 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:36:56.506 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:36:56.507 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:36:56.507 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 265242 2024-04-01T19:36:56.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.507 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:36:56.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:36:56.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804623+0000", 2024-04-01T19:36:56.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:36:56.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804623+0000", 2024-04-01T19:36:56.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:36:56.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804624+0000", 2024-04-01T19:36:56.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9800000000000003e-07 2024-04-01T19:36:56.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:36:56.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804638+0000", 2024-04-01T19:36:56.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4379000000000001e-05 2024-04-01T19:36:56.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:36:56.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804644+0000", 2024-04-01T19:36:56.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9220000000000002e-06 2024-04-01T19:36:56.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:36:56.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804650+0000", 2024-04-01T19:36:56.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0059999999999998e-06 2024-04-01T19:36:56.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804690+0000", 2024-04-01T19:36:56.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0031999999999999e-05 2024-04-01T19:36:56.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:36:56.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804697+0000", 2024-04-01T19:36:56.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8870000000000003e-06 2024-04-01T19:36:56.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.510 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.658037+0000", 2024-04-01T19:36:56.510 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85334062099999997 2024-04-01T19:36:56.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.510 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:36:56.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.658041+0000", 2024-04-01T19:36:56.510 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0160000000000002e-06 2024-04-01T19:36:56.510 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.510 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:36:56.510 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.511 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.24751.0:265243 2.f 2.5c78d94f (undecoded) ondisk+retry+write+known_if_redirected e169)", 2024-04-01T19:36:56.511 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:28:30.804666+0000", 2024-04-01T19:36:56.511 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 505.60395272, 2024-04-01T19:36:56.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.85341545600000002, 2024-04-01T19:36:56.511 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:36:56.511 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:36:56.511 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:36:56.511 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:36:56.511 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.24751", 2024-04-01T19:36:56.511 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4129483618", 2024-04-01T19:36:56.511 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 265243 2024-04-01T19:36:56.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.512 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:36:56.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:36:56.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804666+0000", 2024-04-01T19:36:56.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:36:56.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804666+0000", 2024-04-01T19:36:56.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:36:56.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804666+0000", 2024-04-01T19:36:56.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4099999999999998e-07 2024-04-01T19:36:56.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:36:56.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804670+0000", 2024-04-01T19:36:56.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5140000000000002e-06 2024-04-01T19:36:56.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:36:56.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804676+0000", 2024-04-01T19:36:56.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3559999999999998e-06 2024-04-01T19:36:56.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:36:56.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804692+0000", 2024-04-01T19:36:56.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5933000000000001e-05 2024-04-01T19:36:56.514 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804724+0000", 2024-04-01T19:36:56.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1254999999999998e-05 2024-04-01T19:36:56.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:36:56.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:30.804731+0000", 2024-04-01T19:36:56.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.605e-06 2024-04-01T19:36:56.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.658074+0000", 2024-04-01T19:36:56.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.853342657 2024-04-01T19:36:56.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:36:56.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:28:31.658081+0000", 2024-04-01T19:36:56.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3950000000000003e-06 2024-04-01T19:36:56.516 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.516 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:36:56.516 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.516 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:181505 4.6 4:6a64cfa4:::benchmark_data_smithi188_104537_object9511:head [delete] snapc 0=[] ondisk+write+known_if_redirected e298)", 2024-04-01T19:36:56.516 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:35:43.031941+0000", 2024-04-01T19:36:56.517 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 73.376677197000006, 2024-04-01T19:36:56.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18799569099999999, 2024-04-01T19:36:56.517 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:36:56.517 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:36:56.517 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:56.517 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:36:56.517 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:36:56.517 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:36:56.517 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 181505 2024-04-01T19:36:56.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.517 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:36:56.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:36:56.518 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.031941+0000", 2024-04-01T19:36:56.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.518 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.518 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:36:56.518 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.031941+0000", 2024-04-01T19:36:56.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.518 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.518 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:36:56.518 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.031943+0000", 2024-04-01T19:36:56.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.216e-06 2024-04-01T19:36:56.518 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:36:56.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.031949+0000", 2024-04-01T19:36:56.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.254e-06 2024-04-01T19:36:56.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:36:56.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.031961+0000", 2024-04-01T19:36:56.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.239e-05 2024-04-01T19:36:56.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:36:56.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.031969+0000", 2024-04-01T19:36:56.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6090000000000003e-06 2024-04-01T19:36:56.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.032013+0000", 2024-04-01T19:36:56.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4455e-05 2024-04-01T19:36:56.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:36:56.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.032096+0000", 2024-04-01T19:36:56.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2977000000000002e-05 2024-04-01T19:36:56.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-01T19:36:56.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.032170+0000", 2024-04-01T19:36:56.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4066000000000005e-05 2024-04-01T19:36:56.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:36:56.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.035606+0000", 2024-04-01T19:36:56.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0034360340000000001 2024-04-01T19:36:56.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:56.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.219840+0000", 2024-04-01T19:36:56.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.184233911 2024-04-01T19:36:56.522 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.522 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:36:56.522 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.219892+0000", 2024-04-01T19:36:56.522 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1771999999999998e-05 2024-04-01T19:36:56.522 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.522 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:36:56.522 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.219937+0000", 2024-04-01T19:36:56.522 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5006999999999998e-05 2024-04-01T19:36:56.522 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.522 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:36:56.522 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.523 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:181508 4.6 4:65332a75:::benchmark_data_smithi188_104537_object9514:head [delete] snapc 0=[] ondisk+write+known_if_redirected e298)", 2024-04-01T19:36:56.523 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:35:43.037524+0000", 2024-04-01T19:36:56.523 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 73.371093981000001, 2024-04-01T19:36:56.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18254949300000001, 2024-04-01T19:36:56.523 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:36:56.523 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:36:56.523 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:36:56.523 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:36:56.523 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:36:56.523 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:36:56.523 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 181508 2024-04-01T19:36:56.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.524 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:36:56.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:36:56.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.037524+0000", 2024-04-01T19:36:56.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:36:56.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.037524+0000", 2024-04-01T19:36:56.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:36:56.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.525 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:36:56.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.037526+0000", 2024-04-01T19:36:56.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4479999999999999e-06 2024-04-01T19:36:56.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.525 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:36:56.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.037530+0000", 2024-04-01T19:36:56.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0380000000000001e-06 2024-04-01T19:36:56.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.525 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:36:56.526 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.037539+0000", 2024-04-01T19:36:56.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4099999999999997e-06 2024-04-01T19:36:56.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.526 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:36:56.526 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.037545+0000", 2024-04-01T19:36:56.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7699999999999998e-06 2024-04-01T19:36:56.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.526 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:36:56.526 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.037580+0000", 2024-04-01T19:36:56.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4861999999999999e-05 2024-04-01T19:36:56.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:36:56.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.037649+0000", 2024-04-01T19:36:56.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8843000000000005e-05 2024-04-01T19:36:56.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-01T19:36:56.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.037718+0000", 2024-04-01T19:36:56.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9461999999999993e-05 2024-04-01T19:36:56.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:36:56.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.040130+0000", 2024-04-01T19:36:56.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0024120930000000001 2024-04-01T19:36:56.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:36:56.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.219986+0000", 2024-04-01T19:36:56.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.179856039 2024-04-01T19:36:56.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:36:56.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.220036+0000", 2024-04-01T19:36:56.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9969999999999998e-05 2024-04-01T19:36:56.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:36:56.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:36:56.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:36:56.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.220074+0000", 2024-04-01T19:36:56.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7558000000000002e-05 2024-04-01T19:36:56.528 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.529 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:36:56.529 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.529 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:36:56.529 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:36:56.529 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:36:56.530 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:56.530 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:56.530 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:36:56.531 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:36:56.531 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:56 smithi062 ceph-mon[44211]: pgmap v924: 17 pgs: 1 active+clean+scrubbing, 3 active+clean+scrubbing+deep, 13 active+clean; 8.2 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 723 op/s 2024-04-01T19:36:56.531 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:56 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:36:56.531 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:56 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:36:56.531 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:56 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2051910864' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:36:56.531 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:56 smithi062 ceph-mon[44211]: from='client.35714 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:36:56.531 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:56 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:36:56.531 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:56 smithi062 ceph-mon[44211]: from='client.35714 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:36:56.531 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:56 smithi062 ceph-mon[44211]: osdmap e323: 12 total, 11 up, 11 in 2024-04-01T19:36:56.631 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:36:56.662 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:56.685 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:36:56.688 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:36:56.688 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:36:56.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:56 smithi022 ceph-mon[39439]: pgmap v924: 17 pgs: 1 active+clean+scrubbing, 3 active+clean+scrubbing+deep, 13 active+clean; 8.2 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 723 op/s 2024-04-01T19:36:56.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:56 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:36:56.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:56 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:36:56.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:56 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2051910864' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:36:56.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:56 smithi022 ceph-mon[39439]: from='client.35714 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:36:56.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:56 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:36:56.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:56 smithi022 ceph-mon[39439]: from='client.35714 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:36:56.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:56 smithi022 ceph-mon[39439]: osdmap e323: 12 total, 11 up, 11 in 2024-04-01T19:36:56.789 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:36:56.850 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:56 smithi188 ceph-mon[43939]: pgmap v924: 17 pgs: 1 active+clean+scrubbing, 3 active+clean+scrubbing+deep, 13 active+clean; 8.2 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 723 op/s 2024-04-01T19:36:56.850 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:56 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:36:56.850 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:56 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:36:56.850 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:56 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2051910864' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:36:56.850 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:56 smithi188 ceph-mon[43939]: from='client.35714 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:36:56.850 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:56 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:36:56.850 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:56 smithi188 ceph-mon[43939]: from='client.35714 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:36:56.850 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:56 smithi188 ceph-mon[43939]: osdmap e323: 12 total, 11 up, 11 in 2024-04-01T19:36:56.853 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:36:57.300 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:36:57.303 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:36:57.833 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:36:58.320 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":926,"stamp":"2024-04-01T19:36:56.916548+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8740209208,"num_objects":133359,"num_object_clones":0,"num_object_copies":266718,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133359,"num_whiteouts":0,"num_read":127,"num_read_kb":110,"num_write":210808,"num_write_kb":11010363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20052,"num_bytes_recovered":1315719296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160973,"ondisk_log_size":160973,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":11,"num_per_pool_osds":11,"num_per_pool_omap_osds":10,"kb":1031196672,"kb_used":19898608,"kb_used_data":17158508,"kb_used_omap":147,"kb_used_meta":2739820,"kb_avail":1011298064,"statfs":{"total":1055945392128,"available":1035569217536,"internally_reserved":0,"allocated":17570312192,"data_stored":17566136552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":151403,"internal_metadata":2805575829},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,4,2,2,5,6,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-215285760,"num_objects":-3285,"num_object_clones":0,"num_object_copies":-6570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3285,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3285,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001077"},"pg_stats":[{"pgid":"4.f","version":"322'13209","reported_seq":13539,"reported_epoch":322,"state":"active+clean","last_fresh":"2024-04-01T19:36:54.404190+0000","last_change":"2024-04-01T19:36:40.940550+0000","last_active":"2024-04-01T19:36:54.404190+0000","last_peered":"2024-04-01T19:36:54.404190+0000","last_clean":"2024-04-01T19:36:54.404190+0000","last_became_active":"2024-04-01T19:33:59.106174+0000","last_became_peered":"2024-04-01T19:33:59.106174+0000","last_unstale":"2024-04-01T19:36:54.404190+0000","last_undegraded":"2024-04-01T19:36:54.404190+0000","last_fullsized":"2024-04-01T19:36:54.404190+0000","mapping_epoch":267,"log_start":"274'3200","ondisk_log_start":"274'3200","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"318'12531","last_scrub_stamp":"2024-04-01T19:36:40.940239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:36:40.940239+0000","objects_scrubbed":9095,"log_size":10009,"log_dups_size":0,"ondisk_log_size":10009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:07.909191+0000","scrub_duration":2440,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":545718272,"num_objects":8327,"num_object_clones":0,"num_object_copies":16654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8327,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13209,"num_write_kb":689152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"323'14400","reported_seq":14675,"reported_epoch":323,"state":"active+clean+scrubbing+deep","last_fresh":"2024-04-01T19:36:56.443344+0000","last_change":"2024-04-01T19:36:49.318287+0000","last_active":"2024-04-01T19:36:56.443344+0000","last_peered":"2024-04-01T19:36:56.443344+0000","last_clean":"2024-04-01T19:36:56.443344+0000","last_became_active":"2024-04-01T19:33:59.258540+0000","last_became_peered":"2024-04-01T19:33:59.258540+0000","last_unstale":"2024-04-01T19:36:56.443344+0000","last_undegraded":"2024-04-01T19:36:56.443344+0000","last_fullsized":"2024-04-01T19:36:56.443344+0000","mapping_epoch":267,"log_start":"275'4302","ondisk_log_start":"275'4302","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"293'9671","last_scrub_stamp":"2024-04-01T19:35:20.427381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:35:20.427381+0000","objects_scrubbed":1224,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"deep scrubbing for 7s","scrub_duration":1582,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":543293440,"num_objects":8290,"num_object_clones":0,"num_object_copies":16580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8290,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13176,"num_write_kb":686912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.d","version":"323'13190","reported_seq":13520,"reported_epoch":323,"state":"active+clean","last_fresh":"2024-04-01T19:36:56.379879+0000","last_change":"2024-04-01T19:36:40.578123+0000","last_active":"2024-04-01T19:36:56.379879+0000","last_peered":"2024-04-01T19:36:56.379879+0000","last_clean":"2024-04-01T19:36:56.379879+0000","last_became_active":"2024-04-01T19:33:59.105279+0000","last_became_peered":"2024-04-01T19:33:59.105279+0000","last_unstale":"2024-04-01T19:36:56.379879+0000","last_undegraded":"2024-04-01T19:36:56.379879+0000","last_fullsized":"2024-04-01T19:36:56.379879+0000","mapping_epoch":267,"log_start":"274'3100","ondisk_log_start":"274'3100","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"318'12455","last_scrub_stamp":"2024-04-01T19:36:40.577988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:36:40.577988+0000","objects_scrubbed":9078,"log_size":10090,"log_dups_size":0,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:04.395617+0000","scrub_duration":1330,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":544276504,"num_objects":8306,"num_object_clones":0,"num_object_copies":16612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8306,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13190,"num_write_kb":687809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.c","version":"323'13221","reported_seq":13546,"reported_epoch":323,"state":"active+clean","last_fresh":"2024-04-01T19:36:56.421136+0000","last_change":"2024-04-01T19:36:44.783000+0000","last_active":"2024-04-01T19:36:56.421136+0000","last_peered":"2024-04-01T19:36:56.421136+0000","last_clean":"2024-04-01T19:36:56.421136+0000","last_became_active":"2024-04-01T19:33:59.105051+0000","last_became_peered":"2024-04-01T19:33:59.105051+0000","last_unstale":"2024-04-01T19:36:56.421136+0000","last_undegraded":"2024-04-01T19:36:56.421136+0000","last_fullsized":"2024-04-01T19:36:56.421136+0000","mapping_epoch":267,"log_start":"274'3200","ondisk_log_start":"274'3200","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"319'12770","last_scrub_stamp":"2024-04-01T19:36:44.782900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:36:44.782900+0000","objects_scrubbed":8825,"log_size":10021,"log_dups_size":0,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:37:59.694644+0000","scrub_duration":1499,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":546373632,"num_objects":8337,"num_object_clones":0,"num_object_copies":16674,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8337,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13221,"num_write_kb":689856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.b","version":"322'13094","reported_seq":13327,"reported_epoch":322,"state":"active+clean","last_fresh":"2024-04-01T19:36:55.274644+0000","last_change":"2024-04-01T19:35:32.501254+0000","last_active":"2024-04-01T19:36:55.274644+0000","last_peered":"2024-04-01T19:36:55.274644+0000","last_clean":"2024-04-01T19:36:55.274644+0000","last_became_active":"2024-04-01T19:33:59.105705+0000","last_became_peered":"2024-04-01T19:33:59.105705+0000","last_unstale":"2024-04-01T19:36:55.274644+0000","last_undegraded":"2024-04-01T19:36:55.274644+0000","last_fullsized":"2024-04-01T19:36:55.274644+0000","mapping_epoch":267,"log_start":"274'3000","ondisk_log_start":"274'3000","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"294'10458","last_scrub_stamp":"2024-04-01T19:35:32.501153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:35:32.501153+0000","objects_scrubbed":10369,"log_size":10094,"log_dups_size":0,"ondisk_log_size":10094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"queued for scrub","scrub_duration":2341,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":543948800,"num_objects":8300,"num_object_clones":0,"num_object_copies":16600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8300,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13094,"num_write_kb":684608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"322'13261","reported_seq":33812,"reported_epoch":322,"state":"active+clean","last_fresh":"2024-04-01T19:36:54.360832+0000","last_change":"2024-04-01T19:36:43.521051+0000","last_active":"2024-04-01T19:36:54.360832+0000","last_peered":"2024-04-01T19:36:54.360832+0000","last_clean":"2024-04-01T19:36:54.360832+0000","last_became_active":"2024-04-01T19:36:24.053650+0000","last_became_peered":"2024-04-01T19:36:24.053650+0000","last_unstale":"2024-04-01T19:36:54.360832+0000","last_undegraded":"2024-04-01T19:36:54.360832+0000","last_fullsized":"2024-04-01T19:36:54.360832+0000","mapping_epoch":312,"log_start":"274'3200","ondisk_log_start":"274'3200","created":267,"last_epoch_clean":313,"parent":"0.0","parent_split_bits":0,"last_scrub":"318'12800","last_scrub_stamp":"2024-04-01T19:36:43.520856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:36:43.520856+0000","objects_scrubbed":8928,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:04.896376+0000","scrub_duration":2024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550043648,"num_objects":8393,"num_object_clones":0,"num_object_copies":16786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8393,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13261,"num_write_kb":692928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10107,"num_bytes_recovered":662372352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"322'13376","reported_seq":13606,"reported_epoch":322,"state":"active+clean","last_fresh":"2024-04-01T19:36:55.769555+0000","last_change":"2024-04-01T19:35:25.820745+0000","last_active":"2024-04-01T19:36:55.769555+0000","last_peered":"2024-04-01T19:36:55.769555+0000","last_clean":"2024-04-01T19:36:55.769555+0000","last_became_active":"2024-04-01T19:33:59.106492+0000","last_became_peered":"2024-04-01T19:33:59.106492+0000","last_unstale":"2024-04-01T19:36:55.769555+0000","last_undegraded":"2024-04-01T19:36:55.769555+0000","last_fullsized":"2024-04-01T19:36:55.769555+0000","mapping_epoch":267,"log_start":"274'3300","ondisk_log_start":"274'3300","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"293'10226","last_scrub_stamp":"2024-04-01T19:35:25.820619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:35:25.820619+0000","objects_scrubbed":10153,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"queued for scrub","scrub_duration":2362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554303488,"num_objects":8458,"num_object_clones":0,"num_object_copies":16916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8458,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13376,"num_write_kb":698688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.8","version":"322'13154","reported_seq":13472,"reported_epoch":322,"state":"active+clean","last_fresh":"2024-04-01T19:36:55.728015+0000","last_change":"2024-04-01T19:36:51.183591+0000","last_active":"2024-04-01T19:36:55.728015+0000","last_peered":"2024-04-01T19:36:55.728015+0000","last_clean":"2024-04-01T19:36:55.728015+0000","last_became_active":"2024-04-01T19:33:59.258615+0000","last_became_peered":"2024-04-01T19:33:59.258615+0000","last_unstale":"2024-04-01T19:36:55.728015+0000","last_undegraded":"2024-04-01T19:36:55.728015+0000","last_fullsized":"2024-04-01T19:36:55.728015+0000","mapping_epoch":267,"log_start":"274'3100","ondisk_log_start":"274'3100","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"320'12988","last_scrub_stamp":"2024-04-01T19:36:51.183381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:36:51.183381+0000","objects_scrubbed":8456,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:12.053027+0000","scrub_duration":1254,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":542375936,"num_objects":8276,"num_object_clones":0,"num_object_copies":16552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8276,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13154,"num_write_kb":685760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.7","version":"322'13118","reported_seq":13436,"reported_epoch":322,"state":"active+clean","last_fresh":"2024-04-01T19:36:54.369883+0000","last_change":"2024-04-01T19:36:50.859330+0000","last_active":"2024-04-01T19:36:54.369883+0000","last_peered":"2024-04-01T19:36:54.369883+0000","last_clean":"2024-04-01T19:36:54.369883+0000","last_became_active":"2024-04-01T19:33:59.258696+0000","last_became_peered":"2024-04-01T19:33:59.258696+0000","last_unstale":"2024-04-01T19:36:54.369883+0000","last_undegraded":"2024-04-01T19:36:54.369883+0000","last_fullsized":"2024-04-01T19:36:54.369883+0000","mapping_epoch":267,"log_start":"274'3100","ondisk_log_start":"274'3100","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"320'12986","last_scrub_stamp":"2024-04-01T19:36:50.859186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:36:50.859186+0000","objects_scrubbed":8518,"log_size":10018,"log_dups_size":0,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:37:58.025558+0000","scrub_duration":1350,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":548798464,"num_objects":8374,"num_object_clones":0,"num_object_copies":16748,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8374,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13118,"num_write_kb":687744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"322'13041","reported_seq":13269,"reported_epoch":322,"state":"active+clean","last_fresh":"2024-04-01T19:36:54.836645+0000","last_change":"2024-04-01T19:35:30.092283+0000","last_active":"2024-04-01T19:36:54.836645+0000","last_peered":"2024-04-01T19:36:54.836645+0000","last_clean":"2024-04-01T19:36:54.836645+0000","last_became_active":"2024-04-01T19:33:59.105657+0000","last_became_peered":"2024-04-01T19:33:59.105657+0000","last_unstale":"2024-04-01T19:36:54.836645+0000","last_undegraded":"2024-04-01T19:36:54.836645+0000","last_fullsized":"2024-04-01T19:36:54.836645+0000","mapping_epoch":267,"log_start":"274'3000","ondisk_log_start":"274'3000","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"294'10242","last_scrub_stamp":"2024-04-01T19:35:30.092040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:35:30.092040+0000","objects_scrubbed":10181,"log_size":10041,"log_dups_size":0,"ondisk_log_size":10041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:36:58.525075+0000","scrub_duration":2017,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":544407552,"num_objects":8307,"num_object_clones":0,"num_object_copies":16614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8307,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13041,"num_write_kb":683136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.4","version":"322'13205","reported_seq":13433,"reported_epoch":322,"state":"active+clean","last_fresh":"2024-04-01T19:36:54.385007+0000","last_change":"2024-04-01T19:35:26.868754+0000","last_active":"2024-04-01T19:36:54.385007+0000","last_peered":"2024-04-01T19:36:54.385007+0000","last_clean":"2024-04-01T19:36:54.385007+0000","last_became_active":"2024-04-01T19:33:59.257653+0000","last_became_peered":"2024-04-01T19:33:59.257653+0000","last_unstale":"2024-04-01T19:36:54.385007+0000","last_undegraded":"2024-04-01T19:36:54.385007+0000","last_fullsized":"2024-04-01T19:36:54.385007+0000","mapping_epoch":267,"log_start":"274'3200","ondisk_log_start":"274'3200","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"293'10133","last_scrub_stamp":"2024-04-01T19:35:26.868604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:35:26.868604+0000","objects_scrubbed":10045,"log_size":10005,"log_dups_size":0,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"queued for scrub","scrub_duration":2502,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":546242560,"num_objects":8335,"num_object_clones":0,"num_object_copies":16670,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8335,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13205,"num_write_kb":689280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"322'13054","reported_seq":13376,"reported_epoch":322,"state":"active+clean","last_fresh":"2024-04-01T19:36:55.789817+0000","last_change":"2024-04-01T19:36:45.653878+0000","last_active":"2024-04-01T19:36:55.789817+0000","last_peered":"2024-04-01T19:36:55.789817+0000","last_clean":"2024-04-01T19:36:55.789817+0000","last_became_active":"2024-04-01T19:33:59.258172+0000","last_became_peered":"2024-04-01T19:33:59.258172+0000","last_unstale":"2024-04-01T19:36:55.789817+0000","last_undegraded":"2024-04-01T19:36:55.789817+0000","last_fullsized":"2024-04-01T19:36:55.789817+0000","mapping_epoch":267,"log_start":"274'3000","ondisk_log_start":"274'3000","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"319'12663","last_scrub_stamp":"2024-04-01T19:36:45.653705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:36:45.653705+0000","objects_scrubbed":8712,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:37:51.090799+0000","scrub_duration":1679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":542507008,"num_objects":8278,"num_object_clones":0,"num_object_copies":16556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8278,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13054,"num_write_kb":682624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"322'13238","reported_seq":13657,"reported_epoch":322,"state":"active+clean","last_fresh":"2024-04-01T19:36:54.706893+0000","last_change":"2024-04-01T19:36:46.671481+0000","last_active":"2024-04-01T19:36:54.706893+0000","last_peered":"2024-04-01T19:36:54.706893+0000","last_clean":"2024-04-01T19:36:54.706893+0000","last_became_active":"2024-04-01T19:33:59.102135+0000","last_became_peered":"2024-04-01T19:33:59.102135+0000","last_unstale":"2024-04-01T19:36:54.706893+0000","last_undegraded":"2024-04-01T19:36:54.706893+0000","last_fullsized":"2024-04-01T19:36:54.706893+0000","mapping_epoch":267,"log_start":"274'3200","ondisk_log_start":"274'3200","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"319'12943","last_scrub_stamp":"2024-04-01T19:36:46.671377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:36:46.671377+0000","objects_scrubbed":8662,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:37:51.688314+0000","scrub_duration":1508,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":545652736,"num_objects":8326,"num_object_clones":0,"num_object_copies":16652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8326,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13238,"num_write_kb":690048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5],"acting":[9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1","version":"322'14474","reported_seq":14748,"reported_epoch":322,"state":"active+clean+scrubbing+deep","last_fresh":"2024-04-01T19:36:55.813383+0000","last_change":"2024-04-01T19:36:45.990668+0000","last_active":"2024-04-01T19:36:55.813383+0000","last_peered":"2024-04-01T19:36:55.813383+0000","last_clean":"2024-04-01T19:36:55.813383+0000","last_became_active":"2024-04-01T19:33:59.105816+0000","last_became_peered":"2024-04-01T19:33:59.105816+0000","last_unstale":"2024-04-01T19:36:55.813383+0000","last_undegraded":"2024-04-01T19:36:55.813383+0000","last_fullsized":"2024-04-01T19:36:55.813383+0000","mapping_epoch":267,"log_start":"275'4400","ondisk_log_start":"275'4400","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"293'9655","last_scrub_stamp":"2024-04-01T19:35:19.560476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:35:19.560476+0000","objects_scrubbed":1186,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"deep scrubbing for 9s","scrub_duration":2161,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":546701312,"num_objects":8342,"num_object_clones":0,"num_object_copies":16684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8342,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13288,"num_write_kb":692160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.0","version":"322'12984","reported_seq":13311,"reported_epoch":322,"state":"active+clean","last_fresh":"2024-04-01T19:36:52.474810+0000","last_change":"2024-04-01T19:36:39.491283+0000","last_active":"2024-04-01T19:36:52.474810+0000","last_peered":"2024-04-01T19:36:52.474810+0000","last_clean":"2024-04-01T19:36:52.474810+0000","last_became_active":"2024-04-01T19:33:59.258519+0000","last_became_peered":"2024-04-01T19:33:59.258519+0000","last_unstale":"2024-04-01T19:36:52.474810+0000","last_undegraded":"2024-04-01T19:36:52.474810+0000","last_fullsized":"2024-04-01T19:36:52.474810+0000","mapping_epoch":267,"log_start":"274'2900","ondisk_log_start":"274'2900","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"318'12302","last_scrub_stamp":"2024-04-01T19:36:39.491135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:36:39.491135+0000","objects_scrubbed":9156,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:00.246693+0000","scrub_duration":1952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550895616,"num_objects":8406,"num_object_clones":0,"num_object_copies":16812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8406,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12984,"num_write_kb":684480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"321'14217","reported_seq":34382,"reported_epoch":321,"state":"active+clean+scrubbing+deep","last_fresh":"2024-04-01T19:36:52.370200+0000","last_change":"2024-04-01T19:36:44.846384+0000","last_active":"2024-04-01T19:36:52.370200+0000","last_peered":"2024-04-01T19:36:52.370200+0000","last_clean":"2024-04-01T19:36:52.370200+0000","last_became_active":"2024-04-01T19:36:27.067895+0000","last_became_peered":"2024-04-01T19:36:27.067895+0000","last_unstale":"2024-04-01T19:36:52.370200+0000","last_undegraded":"2024-04-01T19:36:52.370200+0000","last_fullsized":"2024-04-01T19:36:52.370200+0000","mapping_epoch":314,"log_start":"275'4200","ondisk_log_start":"275'4200","created":267,"last_epoch_clean":315,"parent":"0.0","parent_split_bits":0,"last_scrub":"294'10215","last_scrub_stamp":"2024-04-01T19:35:29.500732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:35:29.500732+0000","objects_scrubbed":1199,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"deep scrubbing for 7s","scrub_duration":1796,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":544079872,"num_objects":8302,"num_object_clones":0,"num_object_copies":16604,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8302,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13018,"num_write_kb":682240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9937,"num_bytes_recovered":651231232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,11],"acting":[10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":858,"reported_epoch":322,"state":"active+clean","last_fresh":"2024-04-01T19:36:52.474452+0000","last_change":"2024-04-01T19:36:13.759798+0000","last_active":"2024-04-01T19:36:52.474452+0000","last_peered":"2024-04-01T19:36:52.474452+0000","last_clean":"2024-04-01T19:36:52.474452+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:36:52.474452+0000","last_undegraded":"2024-04-01T19:36:52.474452+0000","last_fullsized":"2024-04-01T19:36:52.474452+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:36:13.759638+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:36:13.759638+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:37:38.925224+0000","scrub_duration":64,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":8739618840,"num_objects":133357,"num_object_clones":0,"num_object_copies":266714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133357,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":210627,"num_write_kb":11007425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20044,"num_bytes_recovered":1313603584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18852683776,"data_stored":18852675632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160834,"ondisk_log_size":160834,"up":32,"acting":32,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220332,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3092720,"kb_used_data":2668648,"kb_used_omap":1,"kb_used_meta":424062,"kb_avail":90652432,"statfs":{"total":95995035648,"available":92828090368,"internally_reserved":0,"allocated":2732695552,"data_stored":2732313216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":434239940},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":77,"seq":330712481967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2329824,"kb_used_data":2158420,"kb_used_omap":1,"kb_used_meta":171390,"kb_avail":91415328,"statfs":{"total":95995035648,"available":93609295872,"internally_reserved":0,"allocated":2210222080,"data_stored":2209849348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":175503808},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,2,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678199,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1866736,"kb_used_data":1605092,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":91878416,"statfs":{"total":95995035648,"available":94083497984,"internally_reserved":0,"allocated":1643614208,"data_stored":1643231372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":267909568},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557395,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":74480,"kb_used_data":736,"kb_used_omap":132,"kb_used_meta":73595,"kb_avail":93670672,"statfs":{"total":95995035648,"available":95918768128,"internally_reserved":0,"allocated":753664,"data_stored":374900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":75362023},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234176,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1896120,"kb_used_data":1612264,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":91849032,"statfs":{"total":95995035648,"available":94053408768,"internally_reserved":0,"allocated":1650958336,"data_stored":1650576020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":290650570},"hb_peers":[0,1,2,3,4,5,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575070,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":4109676,"kb_used_data":3763360,"kb_used_omap":1,"kb_used_meta":346302,"kb_avail":89635476,"statfs":{"total":95995035648,"available":91786727424,"internally_reserved":0,"allocated":3853680640,"data_stored":3853301876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":354613701},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738597,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":785324,"kb_used_data":533408,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":92959828,"statfs":{"total":95995035648,"available":95190863872,"internally_reserved":0,"allocated":546209792,"data_stored":545831028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346139,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":613032,"kb_used_data":531872,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":93132120,"statfs":{"total":95995035648,"available":95367290880,"internally_reserved":0,"allocated":544636928,"data_stored":544258164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149907,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1946656,"kb_used_data":1618388,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":91798496,"statfs":{"total":95995035648,"available":94001659904,"internally_reserved":0,"allocated":1657229312,"data_stored":1656856600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":336132551},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953679,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1921276,"kb_used_data":1597168,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":91823876,"statfs":{"total":95995035648,"available":94027649024,"internally_reserved":0,"allocated":1635500032,"data_stored":1635111144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":331872709},"hb_peers":[0,1,2,3,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,0,0,2,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790155,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1262764,"kb_used_data":1069152,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":92482388,"statfs":{"total":95995035648,"available":94701965312,"internally_reserved":0,"allocated":1094811648,"data_stored":1094432884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":198244805},"hb_peers":[0,1,2,3,4,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":543883264,"data_stored":543883264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3839361024,"data_stored":3839361024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":542769152,"data_stored":542769152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1655111680,"data_stored":1655111680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1633947648,"data_stored":1633943576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1092026368,"data_stored":1092026368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1334575104,"data_stored":1334575104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1645936640,"data_stored":1645936640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":1638797312,"data_stored":1638793240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":2205548544,"data_stored":2205548544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":2720727040,"data_stored":2720727040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:36:58.321 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-01T19:36:58.321 INFO:tasks.thrashosds.thrasher:Waiting for trim 2024-04-01T19:36:58.540 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:58 smithi022 ceph-mon[39439]: pgmap v926: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 8.1 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 547 op/s 2024-04-01T19:36:58.541 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:58 smithi022 ceph-mon[39439]: from='client.35720 v1:172.21.15.22:0/2844087487' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:36:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:58 smithi062 ceph-mon[44211]: pgmap v926: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 8.1 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 547 op/s 2024-04-01T19:36:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:58 smithi062 ceph-mon[44211]: from='client.35720 v1:172.21.15.22:0/2844087487' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:36:58.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:58 smithi188 ceph-mon[43939]: pgmap v926: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 8.1 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 547 op/s 2024-04-01T19:36:58.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:58 smithi188 ceph-mon[43939]: from='client.35720 v1:172.21.15.22:0/2844087487' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:36:59.612 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:36:59.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:59 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:36:59.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:36:59 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:36:59.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:59 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:36:59.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:36:59 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:36:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:59 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:36:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:36:59 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:37:00.346 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:37:00.353 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:37:00.370 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:37:00.402 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:37:00.425 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:37:00.446 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:37:00.470 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:37:00.503 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:37:00.535 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:37:00.557 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:37:00.578 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:37:00.598 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:37:00.599 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:37:00.599 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:37:00.599 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:37:00.599 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:37:00.599 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:37:00.599 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:37:00.599 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:37:00.599 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:37:00.599 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:37:00.599 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:37:00.599 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:37:00.599 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:37:00.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:00 smithi062 ceph-mon[44211]: pgmap v927: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 8.1 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 411 op/s 2024-04-01T19:37:00.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:00 smithi062 ceph-mon[44211]: osdmap e324: 12 total, 11 up, 11 in 2024-04-01T19:37:00.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:00 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:37:00.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:00 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:37:00.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:00 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1200799049' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:37:00.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:00 smithi022 ceph-mon[39439]: pgmap v927: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 8.1 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 411 op/s 2024-04-01T19:37:00.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:00 smithi022 ceph-mon[39439]: osdmap e324: 12 total, 11 up, 11 in 2024-04-01T19:37:00.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:00 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:37:00.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:00 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:37:00.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:00 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1200799049' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:37:00.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:00 smithi188 ceph-mon[43939]: pgmap v927: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 8.1 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 411 op/s 2024-04-01T19:37:00.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:00 smithi188 ceph-mon[43939]: osdmap e324: 12 total, 11 up, 11 in 2024-04-01T19:37:00.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:00 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:37:00.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:00 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:37:00.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:00 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1200799049' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:37:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:01 smithi062 ceph-mon[44211]: osdmap e325: 12 total, 11 up, 11 in 2024-04-01T19:37:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.776 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.776 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.776 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.777 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.777 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.777 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.777 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:01 smithi188 ceph-mon[43939]: osdmap e325: 12 total, 11 up, 11 in 2024-04-01T19:37:01.777 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.777 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.777 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.777 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.777 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.778 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_ops_in_flight 2024-04-01T19:37:01.826 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:37:01.831 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:01.831 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:37:01.839 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.839 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.839 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.839 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.839 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.840 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.840 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:01 smithi022 ceph-mon[39439]: osdmap e325: 12 total, 11 up, 11 in 2024-04-01T19:37:01.840 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.840 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.840 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.840 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.840 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:01.865 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:37:01.866 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:37:01.932 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:37:01.963 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:01.987 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:37:01.990 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:01.990 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:37:02.092 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:37:02.123 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:02.144 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:37:02.148 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:02.148 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:37:02.200 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:37:02.249 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:02.299 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:02.511 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:02.520 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:02.520 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:02.621 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:37:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:02 smithi188 ceph-mon[43939]: pgmap v930: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 8.0 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 620 op/s 2024-04-01T19:37:02.658 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:02.752 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:02 smithi022 ceph-mon[39439]: pgmap v930: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 8.0 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 620 op/s 2024-04-01T19:37:02.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:02 smithi062 ceph-mon[44211]: pgmap v930: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 8.0 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 620 op/s 2024-04-01T19:37:03.509 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:37:03.527 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:37:03.532 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:03.533 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:37:03.634 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:37:03.674 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:03.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:03 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4103655237' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:37:03.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:03 smithi062 ceph-mon[44211]: from='client.35732 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:37:03.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:03 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4103655237' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:37:03.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:03 smithi022 ceph-mon[39439]: from='client.35732 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:37:03.867 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:37:03.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:03 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4103655237' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:37:03.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:03 smithi188 ceph-mon[43939]: from='client.35732 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:37:03.889 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:37:03.902 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:03.902 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:37:04.003 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:37:04.056 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:04.192 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:37:04.195 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:04.195 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:37:04.226 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:37:04.226 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:37:04.297 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:37:04.341 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:04.360 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:37:04.365 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:04.365 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:37:04.466 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:37:04.505 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:04.509 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:37:04.652 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:37:04.657 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:04.658 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:37:04.759 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:37:04.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:04 smithi062 ceph-mon[44211]: pgmap v931: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 7.9 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 536 op/s 2024-04-01T19:37:04.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:04 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:37:04.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:04 smithi062 ceph-mon[44211]: from='client.35732 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:37:04.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:04 smithi062 ceph-mon[44211]: osdmap e326: 12 total, 11 up, 11 in 2024-04-01T19:37:04.786 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:04 smithi022 ceph-mon[39439]: pgmap v931: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 7.9 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 536 op/s 2024-04-01T19:37:04.786 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:04 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:37:04.786 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:04 smithi022 ceph-mon[39439]: from='client.35732 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:37:04.787 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:04 smithi022 ceph-mon[39439]: osdmap e326: 12 total, 11 up, 11 in 2024-04-01T19:37:04.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:04 smithi188 ceph-mon[43939]: pgmap v931: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 7.9 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 536 op/s 2024-04-01T19:37:04.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:04 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:37:04.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:04 smithi188 ceph-mon[43939]: from='client.35732 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:37:04.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:04 smithi188 ceph-mon[43939]: osdmap e326: 12 total, 11 up, 11 in 2024-04-01T19:37:04.802 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:05.009 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:37:05.015 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:05.015 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:37:05.050 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_blocked_ops 2024-04-01T19:37:05.116 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:37:05.148 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:05.179 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:37:05.183 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:05.183 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:37:05.284 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:37:05.327 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:05.367 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:37:05.374 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:05.374 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:37:05.469 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:37:05.475 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:37:05.520 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:05.893 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:37:05.895 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:05.896 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:37:05.997 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:06.049 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:06.443 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:37:06.551 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:37:06.622 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:37:06.653 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:37:06.697 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:37:06.730 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:37:06.767 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:37:06.825 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:37:06.826 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:06 smithi188 ceph-mon[43939]: pgmap v933: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 7.9 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 684 op/s 2024-04-01T19:37:06.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:06 smithi022 ceph-mon[39439]: pgmap v933: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 7.9 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 684 op/s 2024-04-01T19:37:06.895 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:37:06.897 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:37:06.904 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:37:06.908 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:06.918 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:06.919 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:06.945 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:37:06.984 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:37:06.984 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:37:06.984 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:37:06.984 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:37:06.984 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:37:06.984 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:37:06.984 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:37:06.984 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:37:06.985 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:37:06.985 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:37:06.985 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:37:06.985 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:37:06.985 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:37:07.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:06 smithi062 ceph-mon[44211]: pgmap v933: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 7.9 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 684 op/s 2024-04-01T19:37:07.020 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:37:07.058 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:07.223 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:37:07.228 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:07.229 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:37:07.330 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:37:07.375 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:07.410 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:37:07.414 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:07.415 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:37:07.516 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:37:07.517 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:07 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2417102916' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:37:07.517 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:07.517 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:07.575 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:07.603 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:37:07.608 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:07.608 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:37:07.617 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:37:07.617 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:37:07.617 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-01T19:37:07.617 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-01T19:37:07.617 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:37:07.709 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:37:07.763 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:07 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2417102916' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:37:07.763 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:07.764 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:07.764 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:07.764 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:07.764 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:07.764 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:07.764 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:07.764 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:07.766 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:07.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:07.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:07.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:07.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:07.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:07.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:07.977 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:37:07.989 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:07.989 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:37:07.994 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:37:07.994 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:37:08.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:07 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2417102916' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:37:08.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:08.091 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:08.142 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:08.414 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:08.422 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:08.422 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:08.432 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_historic_ops 2024-04-01T19:37:08.524 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:37:08.576 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:08.618 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:37:08.631 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:08.632 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:37:08.732 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:37:08.768 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:08.835 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:08.835 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:08 smithi022 ceph-mon[39439]: pgmap v934: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 7.7 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 747 op/s 2024-04-01T19:37:08.835 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:08.835 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:08.836 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:37:08.845 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:08.846 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:37:08.865 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:37:08.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:08.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:08 smithi188 ceph-mon[43939]: pgmap v934: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 7.7 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 747 op/s 2024-04-01T19:37:08.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:08.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:08.947 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:37:09.005 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:09.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:09.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:08 smithi062 ceph-mon[44211]: pgmap v934: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 7.7 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 747 op/s 2024-04-01T19:37:09.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:09.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:09.299 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:37:09.301 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:09.302 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:37:09.403 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:37:09.456 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:09.663 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:37:09.667 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:09.667 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:37:09.768 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:37:09.801 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:09.831 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:37:09.834 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:09.834 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:37:09.936 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:37:09.973 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:09.995 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:37:09.997 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:37:10.000 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:10.000 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:37:10.101 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:37:10.140 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:10.395 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:37:10.400 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:10.401 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:37:10.431 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:37:10.502 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:37:10.536 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:37:10.542 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:10.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:10 smithi022 ceph-mon[39439]: pgmap v935: 17 pgs: 17 active+clean; 7.7 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 670 op/s 2024-04-01T19:37:10.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:10 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3897615919' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:37:10.794 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:10 smithi188 ceph-mon[43939]: pgmap v935: 17 pgs: 17 active+clean; 7.7 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 670 op/s 2024-04-01T19:37:10.794 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:10 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3897615919' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:37:10.804 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:37:10.812 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:10.812 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:37:10.913 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:37:10.960 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:10.987 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:37:10.994 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:10.994 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:37:11.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:10 smithi062 ceph-mon[44211]: pgmap v935: 17 pgs: 17 active+clean; 7.7 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 670 op/s 2024-04-01T19:37:11.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:10 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3897615919' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:37:11.095 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:37:11.130 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:11.165 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:37:11.169 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:37:11.169 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:37:11.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:37:11.169 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:37:11.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.169 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:182926 4.5 4.307d4f85 (undecoded) ondisk+retry+write+known_if_redirected e307)", 2024-04-01T19:37:11.169 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:08.018084+0000", 2024-04-01T19:37:11.169 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.147358404999999, 2024-04-01T19:37:11.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25820638400000001, 2024-04-01T19:37:11.169 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:37:11.170 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:37:11.170 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:37:11.170 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:37:11.170 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:37:11.170 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:37:11.170 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 182926 2024-04-01T19:37:11.170 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.170 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:37:11.170 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:37:11.171 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018084+0000", 2024-04-01T19:37:11.171 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.171 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.172 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.172 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:37:11.172 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018084+0000", 2024-04-01T19:37:11.172 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.172 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.172 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.172 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:37:11.172 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018087+0000", 2024-04-01T19:37:11.172 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1489999999999998e-06 2024-04-01T19:37:11.172 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.172 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.172 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:37:11.172 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018100+0000", 2024-04-01T19:37:11.172 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3169e-05 2024-04-01T19:37:11.173 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:37:11.173 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018123+0000", 2024-04-01T19:37:11.173 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3286e-05 2024-04-01T19:37:11.173 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:37:11.173 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018139+0000", 2024-04-01T19:37:11.173 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5999e-05 2024-04-01T19:37:11.173 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.173 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018232+0000", 2024-04-01T19:37:11.174 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2864999999999999e-05 2024-04-01T19:37:11.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.174 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:37:11.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018241+0000", 2024-04-01T19:37:11.174 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8140000000000007e-06 2024-04-01T19:37:11.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.174 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276252+0000", 2024-04-01T19:37:11.174 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25801112399999998 2024-04-01T19:37:11.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.175 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:37:11.175 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276290+0000", 2024-04-01T19:37:11.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7978000000000001e-05 2024-04-01T19:37:11.175 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.175 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:37:11.175 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.175 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:182958 4.5 4.15597fc5 (undecoded) ondisk+retry+write+known_if_redirected e307)", 2024-04-01T19:37:11.175 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:08.018192+0000", 2024-04-01T19:37:11.175 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.147250217, 2024-04-01T19:37:11.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25822557600000001, 2024-04-01T19:37:11.175 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:37:11.176 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:37:11.176 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:37:11.176 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:37:11.176 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:37:11.176 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:37:11.176 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 182958 2024-04-01T19:37:11.176 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.176 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:37:11.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.176 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:37:11.176 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018192+0000", 2024-04-01T19:37:11.176 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.176 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.177 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:37:11.177 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018192+0000", 2024-04-01T19:37:11.177 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.177 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.177 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.177 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:37:11.177 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018193+0000", 2024-04-01T19:37:11.177 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1149999999999999e-06 2024-04-01T19:37:11.177 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.177 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.177 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:37:11.177 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018198+0000", 2024-04-01T19:37:11.177 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.933e-06 2024-04-01T19:37:11.177 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.178 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.178 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:37:11.178 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018206+0000", 2024-04-01T19:37:11.178 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7279999999999995e-06 2024-04-01T19:37:11.178 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.178 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.178 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:37:11.178 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018212+0000", 2024-04-01T19:37:11.178 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2650000000000002e-06 2024-04-01T19:37:11.178 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.178 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.178 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.178 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018291+0000", 2024-04-01T19:37:11.179 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9515e-05 2024-04-01T19:37:11.179 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.179 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.179 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:37:11.179 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018302+0000", 2024-04-01T19:37:11.179 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0200000000000001e-05 2024-04-01T19:37:11.179 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.179 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.179 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.179 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276411+0000", 2024-04-01T19:37:11.179 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25810939799999999 2024-04-01T19:37:11.179 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.179 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.179 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:37:11.180 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276417+0000", 2024-04-01T19:37:11.180 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4219999999999997e-06 2024-04-01T19:37:11.180 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.180 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:37:11.180 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.180 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.180 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.180 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:182978 4.5 4.6c6e3705 (undecoded) ondisk+retry+write+known_if_redirected e307)", 2024-04-01T19:37:11.180 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:08.018222+0000", 2024-04-01T19:37:11.180 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.147220547000003, 2024-04-01T19:37:11.180 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25823965199999999, 2024-04-01T19:37:11.180 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:37:11.180 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:37:11.180 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:37:11.180 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:37:11.181 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:37:11.181 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:37:11.181 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 182978 2024-04-01T19:37:11.181 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.181 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:37:11.181 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.181 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:37:11.181 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018222+0000", 2024-04-01T19:37:11.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.181 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.181 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.181 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:37:11.181 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018222+0000", 2024-04-01T19:37:11.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.181 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.181 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.182 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:37:11.182 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018222+0000", 2024-04-01T19:37:11.182 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.51e-07 2024-04-01T19:37:11.182 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.182 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.182 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:37:11.182 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018225+0000", 2024-04-01T19:37:11.182 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2849999999999999e-06 2024-04-01T19:37:11.182 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.182 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.182 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:37:11.182 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018232+0000", 2024-04-01T19:37:11.182 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2299999999999996e-06 2024-04-01T19:37:11.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:37:11.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018238+0000", 2024-04-01T19:37:11.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1639999999999998e-06 2024-04-01T19:37:11.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018354+0000", 2024-04-01T19:37:11.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011577400000000001 2024-04-01T19:37:11.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:37:11.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018362+0000", 2024-04-01T19:37:11.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8710000000000003e-06 2024-04-01T19:37:11.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.184 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.184 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.184 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276455+0000", 2024-04-01T19:37:11.184 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25809243100000001 2024-04-01T19:37:11.184 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.184 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.184 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:37:11.184 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276461+0000", 2024-04-01T19:37:11.184 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3459999999999999e-06 2024-04-01T19:37:11.184 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.184 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:37:11.184 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.184 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.184 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.185 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:182997 4.5 4.f27b5a65 (undecoded) ondisk+retry+write+known_if_redirected e307)", 2024-04-01T19:37:11.185 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:08.018245+0000", 2024-04-01T19:37:11.185 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.147197308000003, 2024-04-01T19:37:11.185 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25825687400000003, 2024-04-01T19:37:11.185 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:37:11.185 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:37:11.185 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:37:11.185 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:37:11.185 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:37:11.185 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:37:11.185 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 182997 2024-04-01T19:37:11.185 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.185 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:37:11.185 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.185 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:37:11.186 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018245+0000", 2024-04-01T19:37:11.186 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.186 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.186 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.186 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:37:11.186 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018245+0000", 2024-04-01T19:37:11.186 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.186 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.189 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.190 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:37:11.190 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018245+0000", 2024-04-01T19:37:11.190 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2099999999999996e-07 2024-04-01T19:37:11.190 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.190 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.190 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:37:11.190 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018248+0000", 2024-04-01T19:37:11.190 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5040000000000001e-06 2024-04-01T19:37:11.190 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.190 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.190 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:37:11.190 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018254+0000", 2024-04-01T19:37:11.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6840000000000001e-06 2024-04-01T19:37:11.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:37:11.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018259+0000", 2024-04-01T19:37:11.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4090000000000002e-06 2024-04-01T19:37:11.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018398+0000", 2024-04-01T19:37:11.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000138589 2024-04-01T19:37:11.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:37:11.192 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018405+0000", 2024-04-01T19:37:11.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3010000000000001e-06 2024-04-01T19:37:11.192 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.192 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.192 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276492+0000", 2024-04-01T19:37:11.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25808752400000001 2024-04-01T19:37:11.192 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.192 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:37:11.192 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276502+0000", 2024-04-01T19:37:11.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2420000000000006e-06 2024-04-01T19:37:11.192 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.192 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:37:11.192 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.193 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.193 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.193 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:183000 4.5 4.4f043115 (undecoded) ondisk+retry+write+known_if_redirected e307)", 2024-04-01T19:37:11.193 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:08.018282+0000", 2024-04-01T19:37:11.193 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.147160542000002, 2024-04-01T19:37:11.193 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25833936800000001, 2024-04-01T19:37:11.193 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:37:11.193 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:37:11.193 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:37:11.193 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:37:11.193 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:37:11.193 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:37:11.193 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 183000 2024-04-01T19:37:11.193 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.194 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:37:11.194 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.194 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:37:11.194 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018282+0000", 2024-04-01T19:37:11.194 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.194 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.194 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.194 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:37:11.194 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018282+0000", 2024-04-01T19:37:11.194 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.194 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.194 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.194 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:37:11.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018283+0000", 2024-04-01T19:37:11.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.68e-06 2024-04-01T19:37:11.195 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.195 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:37:11.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018289+0000", 2024-04-01T19:37:11.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1809999999999998e-06 2024-04-01T19:37:11.195 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.195 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:37:11.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018300+0000", 2024-04-01T19:37:11.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0298e-05 2024-04-01T19:37:11.195 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.196 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:37:11.196 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018308+0000", 2024-04-01T19:37:11.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1689999999999992e-06 2024-04-01T19:37:11.196 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.196 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.196 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018447+0000", 2024-04-01T19:37:11.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013947100000000001 2024-04-01T19:37:11.196 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.196 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:37:11.196 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018455+0000", 2024-04-01T19:37:11.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6290000000000001e-06 2024-04-01T19:37:11.196 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.197 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.197 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276616+0000", 2024-04-01T19:37:11.197 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25816092800000001 2024-04-01T19:37:11.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.197 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:37:11.197 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276621+0000", 2024-04-01T19:37:11.197 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0119999999999996e-06 2024-04-01T19:37:11.197 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.197 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:37:11.197 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.198 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:183006 4.5 4.8f74a225 (undecoded) ondisk+retry+write+known_if_redirected e307)", 2024-04-01T19:37:11.198 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:08.018333+0000", 2024-04-01T19:37:11.198 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.147109104000002, 2024-04-01T19:37:11.198 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25831768599999999, 2024-04-01T19:37:11.198 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:37:11.198 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:37:11.198 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:37:11.198 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:37:11.198 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:37:11.198 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:37:11.198 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 183006 2024-04-01T19:37:11.198 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.199 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:37:11.199 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.199 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:37:11.199 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018333+0000", 2024-04-01T19:37:11.199 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.199 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.199 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.199 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:37:11.199 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018333+0000", 2024-04-01T19:37:11.199 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.199 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.199 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.199 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:37:11.199 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018334+0000", 2024-04-01T19:37:11.200 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2299999999999999e-07 2024-04-01T19:37:11.200 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.200 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:37:11.200 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018337+0000", 2024-04-01T19:37:11.200 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.551e-06 2024-04-01T19:37:11.200 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.200 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:37:11.200 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018350+0000", 2024-04-01T19:37:11.200 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2736e-05 2024-04-01T19:37:11.200 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.200 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:37:11.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018356+0000", 2024-04-01T19:37:11.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1199999999999999e-06 2024-04-01T19:37:11.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018518+0000", 2024-04-01T19:37:11.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000161323 2024-04-01T19:37:11.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:37:11.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018523+0000", 2024-04-01T19:37:11.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0900000000000004e-06 2024-04-01T19:37:11.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.202 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276641+0000", 2024-04-01T19:37:11.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25811862800000002 2024-04-01T19:37:11.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.202 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:37:11.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276651+0000", 2024-04-01T19:37:11.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3149999999999998e-06 2024-04-01T19:37:11.202 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.202 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:37:11.202 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.203 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:183010 4.5 4.8d559a65 (undecoded) ondisk+retry+write+known_if_redirected e307)", 2024-04-01T19:37:11.203 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:08.018365+0000", 2024-04-01T19:37:11.203 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.147076812000002, 2024-04-01T19:37:11.203 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.258304168, 2024-04-01T19:37:11.203 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:37:11.203 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:37:11.203 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:37:11.203 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:37:11.203 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:37:11.203 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:37:11.203 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 183010 2024-04-01T19:37:11.203 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.203 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:37:11.203 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.203 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:37:11.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018365+0000", 2024-04-01T19:37:11.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:37:11.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018365+0000", 2024-04-01T19:37:11.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:37:11.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018366+0000", 2024-04-01T19:37:11.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3200000000000004e-07 2024-04-01T19:37:11.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.205 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:37:11.205 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018369+0000", 2024-04-01T19:37:11.205 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.179e-06 2024-04-01T19:37:11.205 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.205 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.205 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:37:11.205 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018375+0000", 2024-04-01T19:37:11.205 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0109999999999997e-06 2024-04-01T19:37:11.205 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.205 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.205 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:37:11.205 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018381+0000", 2024-04-01T19:37:11.205 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2709999999999998e-06 2024-04-01T19:37:11.205 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.206 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.206 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.206 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018539+0000", 2024-04-01T19:37:11.206 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000157646 2024-04-01T19:37:11.206 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.206 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.206 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:37:11.206 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018542+0000", 2024-04-01T19:37:11.206 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3919999999999999e-06 2024-04-01T19:37:11.206 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.206 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.206 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.206 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276665+0000", 2024-04-01T19:37:11.207 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25812278100000002 2024-04-01T19:37:11.207 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.207 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.207 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:37:11.207 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276669+0000", 2024-04-01T19:37:11.207 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1559999999999997e-06 2024-04-01T19:37:11.207 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.207 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:37:11.207 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.207 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.207 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.207 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:183011 4.5 4.ce6e5d5 (undecoded) ondisk+retry+write+known_if_redirected e307)", 2024-04-01T19:37:11.207 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:08.018388+0000", 2024-04-01T19:37:11.207 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.147054375000003, 2024-04-01T19:37:11.208 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25831146799999999, 2024-04-01T19:37:11.208 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:37:11.208 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:37:11.208 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:37:11.208 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:37:11.208 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:37:11.208 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:37:11.208 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 183011 2024-04-01T19:37:11.208 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.208 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:37:11.208 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.208 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:37:11.208 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018388+0000", 2024-04-01T19:37:11.208 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.208 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.208 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.208 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:37:11.209 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018388+0000", 2024-04-01T19:37:11.209 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.209 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.209 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:37:11.209 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018388+0000", 2024-04-01T19:37:11.209 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4000000000000001e-07 2024-04-01T19:37:11.209 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.209 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:37:11.209 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018391+0000", 2024-04-01T19:37:11.209 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3949999999999999e-06 2024-04-01T19:37:11.209 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.209 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:37:11.210 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018396+0000", 2024-04-01T19:37:11.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1680000000000003e-06 2024-04-01T19:37:11.210 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.210 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.210 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:37:11.210 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018401+0000", 2024-04-01T19:37:11.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3489999999999999e-06 2024-04-01T19:37:11.210 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.210 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.210 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.210 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018557+0000", 2024-04-01T19:37:11.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000155737 2024-04-01T19:37:11.211 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.211 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.211 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:37:11.211 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018561+0000", 2024-04-01T19:37:11.211 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6619999999999998e-06 2024-04-01T19:37:11.211 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.211 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.211 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.211 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276692+0000", 2024-04-01T19:37:11.211 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25813150299999998 2024-04-01T19:37:11.211 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.211 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.211 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:37:11.212 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276699+0000", 2024-04-01T19:37:11.212 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0140000000000001e-06 2024-04-01T19:37:11.212 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.212 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:37:11.212 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.212 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.212 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.212 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:183017 4.5 4.e681cec5 (undecoded) ondisk+retry+write+known_if_redirected e307)", 2024-04-01T19:37:11.212 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:08.018407+0000", 2024-04-01T19:37:11.212 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.147035281999997, 2024-04-01T19:37:11.212 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25830894199999999, 2024-04-01T19:37:11.212 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:37:11.212 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:37:11.212 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:37:11.213 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:37:11.213 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:37:11.213 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:37:11.213 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 183017 2024-04-01T19:37:11.213 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.213 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:37:11.213 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.213 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:37:11.213 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018407+0000", 2024-04-01T19:37:11.213 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.213 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.213 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.213 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:37:11.213 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018407+0000", 2024-04-01T19:37:11.213 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.214 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.214 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.214 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:37:11.214 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018407+0000", 2024-04-01T19:37:11.214 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5199999999999997e-07 2024-04-01T19:37:11.214 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.214 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.214 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:37:11.214 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018410+0000", 2024-04-01T19:37:11.214 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1780000000000002e-06 2024-04-01T19:37:11.214 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.214 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.214 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:37:11.215 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018414+0000", 2024-04-01T19:37:11.215 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7879999999999997e-06 2024-04-01T19:37:11.215 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.215 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.215 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:37:11.215 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018419+0000", 2024-04-01T19:37:11.215 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1710000000000001e-06 2024-04-01T19:37:11.215 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.215 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.215 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.215 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018576+0000", 2024-04-01T19:37:11.215 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000156909 2024-04-01T19:37:11.215 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.215 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.215 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:37:11.215 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018580+0000", 2024-04-01T19:37:11.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3170000000000002e-06 2024-04-01T19:37:11.216 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.216 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276711+0000", 2024-04-01T19:37:11.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25813166700000001 2024-04-01T19:37:11.216 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:37:11.216 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276716+0000", 2024-04-01T19:37:11.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3599999999999998e-06 2024-04-01T19:37:11.216 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.216 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:37:11.217 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.217 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.217 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.217 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:183020 4.5 4.f1f374b5 (undecoded) ondisk+retry+write+known_if_redirected e307)", 2024-04-01T19:37:11.217 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:08.018439+0000", 2024-04-01T19:37:11.217 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.147002704000002, 2024-04-01T19:37:11.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25830040300000001, 2024-04-01T19:37:11.217 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:37:11.217 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:37:11.217 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:37:11.217 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:37:11.217 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:37:11.217 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:37:11.217 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 183020 2024-04-01T19:37:11.218 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.218 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:37:11.218 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.218 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:37:11.218 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018439+0000", 2024-04-01T19:37:11.218 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.218 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.218 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.218 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:37:11.218 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018439+0000", 2024-04-01T19:37:11.218 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.218 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:37:11.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018440+0000", 2024-04-01T19:37:11.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5799999999999999e-07 2024-04-01T19:37:11.219 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:37:11.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018455+0000", 2024-04-01T19:37:11.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4803999999999999e-05 2024-04-01T19:37:11.219 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:37:11.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018461+0000", 2024-04-01T19:37:11.220 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7919999999999998e-06 2024-04-01T19:37:11.220 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.220 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:37:11.220 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018466+0000", 2024-04-01T19:37:11.220 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7660000000000004e-06 2024-04-01T19:37:11.220 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.220 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.220 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018594+0000", 2024-04-01T19:37:11.220 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000127496 2024-04-01T19:37:11.220 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.221 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:37:11.221 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018598+0000", 2024-04-01T19:37:11.221 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7409999999999998e-06 2024-04-01T19:37:11.221 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.221 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.221 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.221 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276735+0000", 2024-04-01T19:37:11.221 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25813781099999999 2024-04-01T19:37:11.221 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.221 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.221 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:37:11.221 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276740+0000", 2024-04-01T19:37:11.221 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.335e-06 2024-04-01T19:37:11.221 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.222 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:37:11.222 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.222 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.222 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.222 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:183023 4.5 4.22567245 (undecoded) ondisk+retry+write+known_if_redirected e307)", 2024-04-01T19:37:11.222 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:08.018479+0000", 2024-04-01T19:37:11.222 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.146962729999998, 2024-04-01T19:37:11.222 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25828352999999998, 2024-04-01T19:37:11.222 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:37:11.222 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:37:11.222 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:37:11.222 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:37:11.222 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:37:11.223 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:37:11.223 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 183023 2024-04-01T19:37:11.223 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.223 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:37:11.223 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.223 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:37:11.223 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018479+0000", 2024-04-01T19:37:11.223 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.223 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.223 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.223 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:37:11.223 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018479+0000", 2024-04-01T19:37:11.223 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.223 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.223 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:37:11.224 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018480+0000", 2024-04-01T19:37:11.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6300000000000004e-07 2024-04-01T19:37:11.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:37:11.224 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018484+0000", 2024-04-01T19:37:11.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.811e-06 2024-04-01T19:37:11.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:37:11.224 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018490+0000", 2024-04-01T19:37:11.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2009999999999996e-06 2024-04-01T19:37:11.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:37:11.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018496+0000", 2024-04-01T19:37:11.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9710000000000001e-06 2024-04-01T19:37:11.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018613+0000", 2024-04-01T19:37:11.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000116505 2024-04-01T19:37:11.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:37:11.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018616+0000", 2024-04-01T19:37:11.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4630000000000001e-06 2024-04-01T19:37:11.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.226 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.226 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.226 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276759+0000", 2024-04-01T19:37:11.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25814283900000001 2024-04-01T19:37:11.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.226 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.226 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:37:11.226 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276763+0000", 2024-04-01T19:37:11.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8770000000000003e-06 2024-04-01T19:37:11.226 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.226 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:37:11.226 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.226 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.227 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:207778 4.5 4:ad15b13a:::benchmark_data_smithi188_104537_object35784:head [delete] snapc 0=[] ondisk+write+known_if_redirected e320)", 2024-04-01T19:37:11.227 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:49.533205+0000", 2024-04-01T19:37:11.227 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 21.632236653, 2024-04-01T19:37:11.227 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.173145628, 2024-04-01T19:37:11.227 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:37:11.227 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:37:11.227 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:37:11.227 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:37:11.227 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:37:11.227 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:37:11.227 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 207778 2024-04-01T19:37:11.227 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.227 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:37:11.227 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.227 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:37:11.227 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.533205+0000", 2024-04-01T19:37:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:37:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.533205+0000", 2024-04-01T19:37:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:37:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.533208+0000", 2024-04-01T19:37:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.429e-06 2024-04-01T19:37:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:37:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.533215+0000", 2024-04-01T19:37:11.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3919999999999997e-06 2024-04-01T19:37:11.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:37:11.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.533229+0000", 2024-04-01T19:37:11.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.384e-05 2024-04-01T19:37:11.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:37:11.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.533238+0000", 2024-04-01T19:37:11.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0510000000000002e-06 2024-04-01T19:37:11.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.555099+0000", 2024-04-01T19:37:11.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.021861129999999999 2024-04-01T19:37:11.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:37:11.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.555208+0000", 2024-04-01T19:37:11.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000109098 2024-04-01T19:37:11.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:37:11.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.555310+0000", 2024-04-01T19:37:11.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101939 2024-04-01T19:37:11.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:37:11.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.706169+0000", 2024-04-01T19:37:11.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.150858677 2024-04-01T19:37:11.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:37:11.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.706241+0000", 2024-04-01T19:37:11.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2225999999999996e-05 2024-04-01T19:37:11.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:37:11.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.706287+0000", 2024-04-01T19:37:11.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6171000000000002e-05 2024-04-01T19:37:11.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:37:11.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.706351+0000", 2024-04-01T19:37:11.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3675000000000003e-05 2024-04-01T19:37:11.232 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.232 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:37:11.232 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.232 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.232 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:207786 4.5 4:a617adc9:::benchmark_data_smithi188_104537_object35792:head [delete] snapc 0=[] ondisk+write+known_if_redirected e320)", 2024-04-01T19:37:11.232 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:49.541668+0000", 2024-04-01T19:37:11.232 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 21.623774229999999, 2024-04-01T19:37:11.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16477785, 2024-04-01T19:37:11.232 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:37:11.232 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:37:11.233 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:37:11.233 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:37:11.233 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:37:11.233 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:37:11.233 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 207786 2024-04-01T19:37:11.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.233 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:37:11.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.233 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:37:11.233 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.541668+0000", 2024-04-01T19:37:11.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.234 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:37:11.234 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.541668+0000", 2024-04-01T19:37:11.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.234 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.234 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:37:11.234 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.541671+0000", 2024-04-01T19:37:11.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6809999999999998e-06 2024-04-01T19:37:11.234 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.234 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:37:11.234 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.541679+0000", 2024-04-01T19:37:11.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3790000000000006e-06 2024-04-01T19:37:11.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:37:11.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.541694+0000", 2024-04-01T19:37:11.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5460000000000001e-05 2024-04-01T19:37:11.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:37:11.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.541704+0000", 2024-04-01T19:37:11.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.6879999999999994e-06 2024-04-01T19:37:11.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.560337+0000", 2024-04-01T19:37:11.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018632836 2024-04-01T19:37:11.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:37:11.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.560467+0000", 2024-04-01T19:37:11.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000130419 2024-04-01T19:37:11.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:37:11.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.560585+0000", 2024-04-01T19:37:11.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117478 2024-04-01T19:37:11.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:37:11.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.706228+0000", 2024-04-01T19:37:11.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14564348699999999 2024-04-01T19:37:11.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:37:11.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.706360+0000", 2024-04-01T19:37:11.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013131699999999999 2024-04-01T19:37:11.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:37:11.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.706402+0000", 2024-04-01T19:37:11.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2125000000000001e-05 2024-04-01T19:37:11.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.238 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:37:11.238 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.706446+0000", 2024-04-01T19:37:11.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3980000000000002e-05 2024-04-01T19:37:11.238 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.238 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:37:11.238 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.238 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.238 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.238 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:207800 4.5 4:a8fb0164:::benchmark_data_smithi188_104537_object35806:head [delete] snapc 0=[] ondisk+write+known_if_redirected e320)", 2024-04-01T19:37:11.238 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:49.567392+0000", 2024-04-01T19:37:11.238 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 21.598049696, 2024-04-01T19:37:11.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.155628725, 2024-04-01T19:37:11.238 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:37:11.239 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:37:11.239 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:37:11.239 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:37:11.239 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:37:11.239 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:37:11.239 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 207800 2024-04-01T19:37:11.239 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.239 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:37:11.239 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.239 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:37:11.239 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.567392+0000", 2024-04-01T19:37:11.239 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.239 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.239 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.239 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:37:11.239 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.567392+0000", 2024-04-01T19:37:11.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:37:11.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.567395+0000", 2024-04-01T19:37:11.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4480000000000001e-06 2024-04-01T19:37:11.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:37:11.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.567403+0000", 2024-04-01T19:37:11.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4149999999999999e-06 2024-04-01T19:37:11.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:37:11.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.567417+0000", 2024-04-01T19:37:11.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4076999999999999e-05 2024-04-01T19:37:11.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:37:11.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.567427+0000", 2024-04-01T19:37:11.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.6090000000000007e-06 2024-04-01T19:37:11.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.708624+0000", 2024-04-01T19:37:11.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14119704799999999 2024-04-01T19:37:11.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:37:11.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.708732+0000", 2024-04-01T19:37:11.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108229 2024-04-01T19:37:11.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:37:11.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.708839+0000", 2024-04-01T19:37:11.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010730699999999999 2024-04-01T19:37:11.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:37:11.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.718117+0000", 2024-04-01T19:37:11.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0092780090000000003 2024-04-01T19:37:11.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:37:11.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.722863+0000", 2024-04-01T19:37:11.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0047452709999999997 2024-04-01T19:37:11.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:37:11.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.722966+0000", 2024-04-01T19:37:11.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000103361 2024-04-01T19:37:11.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:37:11.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.723021+0000", 2024-04-01T19:37:11.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4951000000000003e-05 2024-04-01T19:37:11.243 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.244 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:37:11.244 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.244 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:207804 4.5 4:ac812de4:::benchmark_data_smithi188_104537_object35810:head [delete] snapc 0=[] ondisk+write+known_if_redirected e320)", 2024-04-01T19:37:11.244 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:49.571670+0000", 2024-04-01T19:37:11.244 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 21.593771931999999, 2024-04-01T19:37:11.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.17248928899999999, 2024-04-01T19:37:11.244 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:37:11.244 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:37:11.244 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:37:11.244 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:37:11.244 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:37:11.244 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:37:11.244 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 207804 2024-04-01T19:37:11.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.245 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:37:11.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.245 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:37:11.245 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.571670+0000", 2024-04-01T19:37:11.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.245 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:37:11.245 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.571670+0000", 2024-04-01T19:37:11.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.245 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:37:11.245 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.571673+0000", 2024-04-01T19:37:11.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4949999999999998e-06 2024-04-01T19:37:11.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:37:11.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.571680+0000", 2024-04-01T19:37:11.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5299999999999999e-06 2024-04-01T19:37:11.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:37:11.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.571694+0000", 2024-04-01T19:37:11.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3379e-05 2024-04-01T19:37:11.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:37:11.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.571703+0000", 2024-04-01T19:37:11.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.6180000000000001e-06 2024-04-01T19:37:11.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.713291+0000", 2024-04-01T19:37:11.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14158736799999999 2024-04-01T19:37:11.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:37:11.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.713404+0000", 2024-04-01T19:37:11.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000113955 2024-04-01T19:37:11.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:37:11.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.713513+0000", 2024-04-01T19:37:11.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010830199999999999 2024-04-01T19:37:11.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:37:11.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.722774+0000", 2024-04-01T19:37:11.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0092613230000000001 2024-04-01T19:37:11.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:37:11.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.744045+0000", 2024-04-01T19:37:11.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.021270474000000001 2024-04-01T19:37:11.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.249 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:37:11.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.744100+0000", 2024-04-01T19:37:11.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5284000000000001e-05 2024-04-01T19:37:11.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.249 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:37:11.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.744159+0000", 2024-04-01T19:37:11.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9561000000000001e-05 2024-04-01T19:37:11.249 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.249 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:37:11.249 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.249 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:208080 4.5 4:a7eec836:::benchmark_data_smithi188_104537_object36086:head [delete] snapc 0=[] ondisk+write+known_if_redirected e320)", 2024-04-01T19:37:11.249 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:50.169012+0000", 2024-04-01T19:37:11.249 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 20.996430411999999, 2024-04-01T19:37:11.250 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16025637000000001, 2024-04-01T19:37:11.250 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:37:11.250 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:37:11.250 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:37:11.250 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:37:11.250 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:37:11.250 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:37:11.250 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 208080 2024-04-01T19:37:11.250 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.250 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:37:11.250 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.250 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:37:11.250 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.169012+0000", 2024-04-01T19:37:11.250 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.250 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.251 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.251 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:37:11.251 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.169012+0000", 2024-04-01T19:37:11.251 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.251 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.251 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.251 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:37:11.251 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.169013+0000", 2024-04-01T19:37:11.251 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.852e-06 2024-04-01T19:37:11.251 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.251 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.251 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:37:11.251 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.169018+0000", 2024-04-01T19:37:11.251 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6349999999999997e-06 2024-04-01T19:37:11.251 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:37:11.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.169027+0000", 2024-04-01T19:37:11.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.329e-06 2024-04-01T19:37:11.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:37:11.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.169033+0000", 2024-04-01T19:37:11.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4140000000000002e-06 2024-04-01T19:37:11.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.169776+0000", 2024-04-01T19:37:11.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00074334399999999995 2024-04-01T19:37:11.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:37:11.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.169886+0000", 2024-04-01T19:37:11.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000109672 2024-04-01T19:37:11.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:37:11.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.169993+0000", 2024-04-01T19:37:11.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000106767 2024-04-01T19:37:11.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:37:11.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.174446+0000", 2024-04-01T19:37:11.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0044537759999999996 2024-04-01T19:37:11.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.254 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:37:11.254 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.329189+0000", 2024-04-01T19:37:11.254 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.154742405 2024-04-01T19:37:11.254 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.254 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.254 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:37:11.254 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.329228+0000", 2024-04-01T19:37:11.254 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9425999999999998e-05 2024-04-01T19:37:11.254 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.254 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.254 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:37:11.254 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.329268+0000", 2024-04-01T19:37:11.254 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9749999999999997e-05 2024-04-01T19:37:11.254 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.255 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:37:11.255 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.255 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.255 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.255 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:209453 4.5 4:a651b8d3:::benchmark_data_smithi188_104537_object37459:head [delete] snapc 0=[] ondisk+write+known_if_redirected e322)", 2024-04-01T19:37:11.255 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:52.799375+0000", 2024-04-01T19:37:11.255 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 18.366066833000001, 2024-04-01T19:37:11.255 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.175671785, 2024-04-01T19:37:11.255 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:37:11.255 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:37:11.255 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:37:11.255 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:37:11.255 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:37:11.255 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:37:11.256 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 209453 2024-04-01T19:37:11.256 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.256 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:37:11.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.256 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:37:11.256 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:52.799375+0000", 2024-04-01T19:37:11.256 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.256 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.256 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:37:11.256 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:52.799375+0000", 2024-04-01T19:37:11.256 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.256 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.256 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:37:11.257 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:52.799377+0000", 2024-04-01T19:37:11.257 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8050000000000001e-06 2024-04-01T19:37:11.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.257 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.257 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:37:11.257 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:52.799383+0000", 2024-04-01T19:37:11.257 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6060000000000002e-06 2024-04-01T19:37:11.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.257 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.257 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:37:11.257 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:52.799392+0000", 2024-04-01T19:37:11.257 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2590000000000006e-06 2024-04-01T19:37:11.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.257 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.258 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:37:11.258 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:52.799398+0000", 2024-04-01T19:37:11.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0759999999999999e-06 2024-04-01T19:37:11.258 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.258 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.258 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:52.825481+0000", 2024-04-01T19:37:11.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026082931 2024-04-01T19:37:11.258 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.258 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:37:11.258 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:52.825606+0000", 2024-04-01T19:37:11.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012500099999999999 2024-04-01T19:37:11.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.259 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.259 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:37:11.259 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:52.825727+0000", 2024-04-01T19:37:11.259 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000120992 2024-04-01T19:37:11.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.259 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.259 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:37:11.259 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:52.849829+0000", 2024-04-01T19:37:11.259 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.024102511 2024-04-01T19:37:11.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.259 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.259 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:37:11.259 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:52.974906+0000", 2024-04-01T19:37:11.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.12507707300000001 2024-04-01T19:37:11.260 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.260 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.260 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:37:11.260 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:52.974977+0000", 2024-04-01T19:37:11.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0847999999999997e-05 2024-04-01T19:37:11.260 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.260 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.260 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:37:11.260 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:52.975047+0000", 2024-04-01T19:37:11.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9683000000000004e-05 2024-04-01T19:37:11.260 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.260 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:37:11.260 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.261 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.261 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.261 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:212211 4.5 4:a86d6cbc:::benchmark_data_smithi188_104537_object40217:head [delete] snapc 0=[] ondisk+write+known_if_redirected e323)", 2024-04-01T19:37:11.261 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:57.812359+0000", 2024-04-01T19:37:11.261 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 13.353083292000001, 2024-04-01T19:37:11.261 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.155154086, 2024-04-01T19:37:11.261 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:37:11.261 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:37:11.261 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:37:11.261 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:37:11.261 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:37:11.261 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:37:11.261 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 212211 2024-04-01T19:37:11.261 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.262 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:37:11.262 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.262 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:37:11.262 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.812359+0000", 2024-04-01T19:37:11.262 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.262 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.262 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.262 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:37:11.262 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.812359+0000", 2024-04-01T19:37:11.262 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.262 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.262 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.262 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:37:11.263 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.812361+0000", 2024-04-01T19:37:11.263 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7579999999999999e-06 2024-04-01T19:37:11.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.263 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.263 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:37:11.263 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.812365+0000", 2024-04-01T19:37:11.263 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.493e-06 2024-04-01T19:37:11.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.263 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.263 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:37:11.263 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.812377+0000", 2024-04-01T19:37:11.263 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2087e-05 2024-04-01T19:37:11.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.263 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.263 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:37:11.264 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.812385+0000", 2024-04-01T19:37:11.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9330000000000001e-06 2024-04-01T19:37:11.264 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.264 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.264 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.812437+0000", 2024-04-01T19:37:11.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.24e-05 2024-04-01T19:37:11.264 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.264 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:37:11.264 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.812568+0000", 2024-04-01T19:37:11.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013101500000000001 2024-04-01T19:37:11.264 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:37:11.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.812688+0000", 2024-04-01T19:37:11.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119455 2024-04-01T19:37:11.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.265 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:37:11.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.967023+0000", 2024-04-01T19:37:11.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.154335523 2024-04-01T19:37:11.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.265 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:37:11.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.967389+0000", 2024-04-01T19:37:11.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036598400000000003 2024-04-01T19:37:11.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.266 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.266 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:37:11.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.967447+0000", 2024-04-01T19:37:11.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7878999999999999e-05 2024-04-01T19:37:11.266 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.266 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.266 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:37:11.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.967513+0000", 2024-04-01T19:37:11.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5559e-05 2024-04-01T19:37:11.266 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.266 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:37:11.266 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.266 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.266 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.267 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:212226 4.5 4:aef650d4:::benchmark_data_smithi188_104537_object40232:head [delete] snapc 0=[] ondisk+write+known_if_redirected e323)", 2024-04-01T19:37:11.267 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:57.841253+0000", 2024-04-01T19:37:11.267 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 13.324189032, 2024-04-01T19:37:11.267 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16197756399999999, 2024-04-01T19:37:11.267 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:37:11.267 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:37:11.267 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:37:11.267 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:37:11.267 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:37:11.267 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:37:11.267 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 212226 2024-04-01T19:37:11.267 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.267 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:37:11.268 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.268 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:37:11.268 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.841253+0000", 2024-04-01T19:37:11.268 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.268 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.268 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.268 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:37:11.268 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.841253+0000", 2024-04-01T19:37:11.268 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.268 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.268 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.268 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:37:11.269 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.841255+0000", 2024-04-01T19:37:11.269 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.795e-06 2024-04-01T19:37:11.269 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.269 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:37:11.269 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.841262+0000", 2024-04-01T19:37:11.269 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.686e-06 2024-04-01T19:37:11.269 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.269 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:37:11.269 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.841274+0000", 2024-04-01T19:37:11.269 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2204999999999999e-05 2024-04-01T19:37:11.269 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:37:11.270 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.841280+0000", 2024-04-01T19:37:11.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5230000000000001e-06 2024-04-01T19:37:11.270 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.270 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.270 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.968945+0000", 2024-04-01T19:37:11.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.12766461300000001 2024-04-01T19:37:11.270 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.270 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:37:11.270 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.969065+0000", 2024-04-01T19:37:11.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012036699999999999 2024-04-01T19:37:11.270 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:37:11.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.969183+0000", 2024-04-01T19:37:11.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117707 2024-04-01T19:37:11.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:37:11.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.978527+0000", 2024-04-01T19:37:11.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0093442170000000001 2024-04-01T19:37:11.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:37:11.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.003118+0000", 2024-04-01T19:37:11.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.024591128 2024-04-01T19:37:11.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.272 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.272 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:37:11.272 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.003179+0000", 2024-04-01T19:37:11.272 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0282999999999999e-05 2024-04-01T19:37:11.272 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.272 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.272 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:37:11.272 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.003231+0000", 2024-04-01T19:37:11.272 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2040000000000003e-05 2024-04-01T19:37:11.272 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.272 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:37:11.272 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.272 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.273 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.273 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:212763 4.5 4:a7e78513:::benchmark_data_smithi188_104537_object40769:head [delete] snapc 0=[] ondisk+write+known_if_redirected e323)", 2024-04-01T19:37:11.273 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:58.886846+0000", 2024-04-01T19:37:11.273 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 12.278595639000001, 2024-04-01T19:37:11.273 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.17031390199999999, 2024-04-01T19:37:11.273 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:37:11.273 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:37:11.273 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:37:11.273 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:37:11.273 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:37:11.273 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:37:11.273 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 212763 2024-04-01T19:37:11.273 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.273 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:37:11.274 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.274 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:37:11.274 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.886846+0000", 2024-04-01T19:37:11.274 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.274 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.274 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.274 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:37:11.274 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.886846+0000", 2024-04-01T19:37:11.274 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:37:11.274 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.274 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.274 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:37:11.274 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.886849+0000", 2024-04-01T19:37:11.274 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.88e-06 2024-04-01T19:37:11.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:37:11.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.886856+0000", 2024-04-01T19:37:11.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1430000000000001e-06 2024-04-01T19:37:11.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:37:11.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.924670+0000", 2024-04-01T19:37:11.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.037813483000000002 2024-04-01T19:37:11.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:37:11.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.924682+0000", 2024-04-01T19:37:11.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2140999999999999e-05 2024-04-01T19:37:11.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:37:11.276 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:59.032937+0000", 2024-04-01T19:37:11.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.10825485 2024-04-01T19:37:11.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:37:11.276 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:59.033029+0000", 2024-04-01T19:37:11.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2588000000000002e-05 2024-04-01T19:37:11.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:37:11.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:59.033139+0000", 2024-04-01T19:37:11.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000109925 2024-04-01T19:37:11.277 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.277 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.277 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:37:11.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:59.047876+0000", 2024-04-01T19:37:11.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014736694999999999 2024-04-01T19:37:11.277 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.277 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.277 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:37:11.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:59.057100+0000", 2024-04-01T19:37:11.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0092242360000000002 2024-04-01T19:37:11.277 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.277 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.278 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:37:11.278 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:59.057131+0000", 2024-04-01T19:37:11.278 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0583999999999997e-05 2024-04-01T19:37:11.278 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:37:11.278 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:37:11.278 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:37:11.278 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:59.057160+0000", 2024-04-01T19:37:11.278 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9377e-05 2024-04-01T19:37:11.278 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.278 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:37:11.278 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.278 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:37:11.278 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:37:11.278 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:37:11.279 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:11.280 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:37:11.380 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:37:11.409 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:11.434 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:37:11.441 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:11.441 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:37:11.542 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:37:11.581 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:11.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:11 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:37:11.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:11 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:37:11.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:11 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:37:11.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:11 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3897615919' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:37:11.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:11 smithi062 ceph-mon[44211]: osdmap e327: 12 total, 11 up, 11 in 2024-04-01T19:37:11.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:11 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:37:11.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:11 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:37:11.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:11 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:37:11.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:11 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3897615919' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:37:11.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:11 smithi022 ceph-mon[39439]: osdmap e327: 12 total, 11 up, 11 in 2024-04-01T19:37:11.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:11 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:37:11.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:11 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:37:11.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:11 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:37:11.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:11 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3897615919' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:37:11.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:11 smithi188 ceph-mon[43939]: osdmap e327: 12 total, 11 up, 11 in 2024-04-01T19:37:11.937 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:37:11.943 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:11.944 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:37:11.976 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_ops_in_flight 2024-04-01T19:37:12.045 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:37:12.083 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:12.121 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:37:12.131 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:12.131 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:37:12.233 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:37:12.271 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:12.312 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:37:12.316 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:12.316 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:37:12.406 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:37:12.418 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:37:12.450 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:12.600 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:37:12.604 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:12.605 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:37:12.706 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:37:12.755 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:12.784 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:37:12.787 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:12 smithi188 ceph-mon[43939]: pgmap v937: 17 pgs: 17 active+clean; 7.4 GiB data, 18 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T19:37:12.788 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:12.788 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:37:12.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:12 smithi022 ceph-mon[39439]: pgmap v937: 17 pgs: 17 active+clean; 7.4 GiB data, 18 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T19:37:12.888 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:12.921 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:13.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:12 smithi062 ceph-mon[44211]: pgmap v937: 17 pgs: 17 active+clean; 7.4 GiB data, 18 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T19:37:13.241 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:37:13.262 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:37:13.286 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:37:13.309 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:37:13.333 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:37:13.368 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:37:13.398 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:37:13.433 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:37:13.472 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:37:13.518 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:37:13.559 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:37:13.560 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:37:13.560 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:37:13.560 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:37:13.560 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:37:13.560 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:37:13.560 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:37:13.560 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:37:13.560 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:37:13.560 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:37:13.560 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:37:13.560 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:37:13.560 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:37:13.706 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:13 smithi188 ceph-mon[43939]: 4.6 scrub starts 2024-04-01T19:37:13.706 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:13 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2662151234' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:37:13.799 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:13.802 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:13.803 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:13.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:13 smithi022 ceph-mon[39439]: 4.6 scrub starts 2024-04-01T19:37:13.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:13 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2662151234' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:37:13.904 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:13.949 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:13.976 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:13.979 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:13.979 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:14.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:13 smithi062 ceph-mon[44211]: 4.6 scrub starts 2024-04-01T19:37:14.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:13 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2662151234' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:37:14.080 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:14.152 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:14.442 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:14.447 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:14.448 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:14.515 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:37:14.516 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:37:14.549 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:37:14.580 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:14.604 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:37:14.609 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:14.609 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:37:14.635 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:37:14.711 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:37:14.743 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:14 smithi188 ceph-mon[43939]: pgmap v938: 17 pgs: 17 active+clean; 7.3 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:37:14.744 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:14 smithi188 ceph-mon[43939]: 4.5 scrub starts 2024-04-01T19:37:14.744 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.744 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.744 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.744 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:14 smithi188 ceph-mon[43939]: 4.e scrub starts 2024-04-01T19:37:14.744 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.744 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.744 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.744 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.744 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.744 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.744 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.745 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.745 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:14 smithi188 ceph-mon[43939]: 4.4 scrub starts 2024-04-01T19:37:14.745 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:14 smithi188 ceph-mon[43939]: 4.6 scrub ok 2024-04-01T19:37:14.746 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:14.764 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:37:14.766 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:14.766 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:37:14.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:14 smithi022 ceph-mon[39439]: pgmap v938: 17 pgs: 17 active+clean; 7.3 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:37:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:14 smithi022 ceph-mon[39439]: 4.5 scrub starts 2024-04-01T19:37:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:14 smithi022 ceph-mon[39439]: 4.e scrub starts 2024-04-01T19:37:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:14 smithi022 ceph-mon[39439]: 4.4 scrub starts 2024-04-01T19:37:14.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:14 smithi022 ceph-mon[39439]: 4.6 scrub ok 2024-04-01T19:37:14.867 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:37:14.896 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:14 smithi062 ceph-mon[44211]: pgmap v938: 17 pgs: 17 active+clean; 7.3 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:37:14.896 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:14 smithi062 ceph-mon[44211]: 4.5 scrub starts 2024-04-01T19:37:14.897 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.897 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.897 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.897 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:14 smithi062 ceph-mon[44211]: 4.e scrub starts 2024-04-01T19:37:14.897 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.897 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.897 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.897 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.898 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.898 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.898 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.898 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:14.898 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:14 smithi062 ceph-mon[44211]: 4.4 scrub starts 2024-04-01T19:37:14.898 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:14 smithi062 ceph-mon[44211]: 4.6 scrub ok 2024-04-01T19:37:14.900 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:14.924 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:37:14.928 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:14.929 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:37:15.030 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:37:15.066 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:15.232 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:37:15.237 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:15.237 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:37:15.266 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_blocked_ops 2024-04-01T19:37:15.339 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:37:15.389 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:15.433 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:37:15.438 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:15.438 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:37:15.539 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:37:15.591 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:15 smithi188 ceph-mon[43939]: 4.e scrub ok 2024-04-01T19:37:15.591 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:15 smithi188 ceph-mon[43939]: 4.b scrub starts 2024-04-01T19:37:15.591 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:15 smithi188 ceph-mon[43939]: 4.5 scrub ok 2024-04-01T19:37:15.592 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:15.625 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:37:15.629 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:15.630 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:37:15.703 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:37:15.730 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:37:15.759 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:15.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:15 smithi022 ceph-mon[39439]: 4.e scrub ok 2024-04-01T19:37:15.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:15 smithi022 ceph-mon[39439]: 4.b scrub starts 2024-04-01T19:37:15.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:15 smithi022 ceph-mon[39439]: 4.5 scrub ok 2024-04-01T19:37:16.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:15 smithi062 ceph-mon[44211]: 4.e scrub ok 2024-04-01T19:37:16.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:15 smithi062 ceph-mon[44211]: 4.b scrub starts 2024-04-01T19:37:16.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:15 smithi062 ceph-mon[44211]: 4.5 scrub ok 2024-04-01T19:37:16.803 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:37:16.803 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:37:16.828 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:37:16.832 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:16.833 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:37:16.833 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:16 smithi022 ceph-mon[39439]: pgmap v939: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 7.2 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:37:16.833 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:16 smithi022 ceph-mon[39439]: 4.4 scrub ok 2024-04-01T19:37:16.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:16 smithi188 ceph-mon[43939]: pgmap v939: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 7.2 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:37:16.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:16 smithi188 ceph-mon[43939]: 4.4 scrub ok 2024-04-01T19:37:16.909 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:37:16.933 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:37:16.970 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:17.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:16 smithi062 ceph-mon[44211]: pgmap v939: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 7.2 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:37:17.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:16 smithi062 ceph-mon[44211]: 4.4 scrub ok 2024-04-01T19:37:17.224 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:37:17.226 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:17.227 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:37:17.328 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:37:17.367 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:17.456 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:37:17.458 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:17.459 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:37:17.560 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:37:17.605 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:17.652 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:37:17.658 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:17.658 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:37:17.759 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:37:17.791 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:17.815 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:37:17.818 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:17.819 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:37:17.836 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:37:17.836 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:37:17.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:17 smithi022 ceph-mon[39439]: 4.b scrub ok 2024-04-01T19:37:17.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:17 smithi022 ceph-mon[39439]: 4.1 scrub starts 2024-04-01T19:37:17.868 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:17 smithi188 ceph-mon[43939]: 4.b scrub ok 2024-04-01T19:37:17.868 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:17 smithi188 ceph-mon[43939]: 4.1 scrub starts 2024-04-01T19:37:17.919 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:37:17.978 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:18.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:17 smithi062 ceph-mon[44211]: 4.b scrub ok 2024-04-01T19:37:18.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:17 smithi062 ceph-mon[44211]: 4.1 scrub starts 2024-04-01T19:37:18.096 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:37:18.098 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:18.099 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:37:18.200 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:18.241 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:18.616 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:18.624 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:18.625 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:18.669 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_historic_ops 2024-04-01T19:37:18.726 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:37:18.770 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:18 smithi022 ceph-mon[39439]: pgmap v940: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 7.0 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:37:18.770 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:18 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:37:18.770 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:18 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:37:18.770 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:18 smithi022 ceph-mon[39439]: osdmap e328: 12 total, 11 up, 11 in 2024-04-01T19:37:18.790 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:18.805 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:37:18.817 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:37:18.823 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:18.823 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:37:18.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:18 smithi188 ceph-mon[43939]: pgmap v940: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 7.0 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:37:18.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:18 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:37:18.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:18 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:37:18.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:18 smithi188 ceph-mon[43939]: osdmap e328: 12 total, 11 up, 11 in 2024-04-01T19:37:18.924 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:18.979 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:19.008 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:19.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:18 smithi062 ceph-mon[44211]: pgmap v940: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 7.0 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:37:19.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:18 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:37:19.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:18 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:37:19.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:18 smithi062 ceph-mon[44211]: osdmap e328: 12 total, 11 up, 11 in 2024-04-01T19:37:19.016 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:19.017 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:19.069 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:37:19.118 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:37:19.177 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:19.206 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:37:19.216 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:19.217 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:37:19.245 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:37:19.317 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:19.366 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:19.397 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:19.400 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:19.400 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:19.502 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:37:19.555 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:19.587 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:37:19.594 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:19.594 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:37:19.623 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:37:19.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:19 smithi188 ceph-mon[43939]: 4.1 scrub ok 2024-04-01T19:37:19.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:19 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3565499979' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:37:19.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:19 smithi188 ceph-mon[43939]: from='client.35756 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:37:19.695 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:19.755 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:19.791 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:19 smithi022 ceph-mon[39439]: 4.1 scrub ok 2024-04-01T19:37:19.791 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:19 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3565499979' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:37:19.791 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:19 smithi022 ceph-mon[39439]: from='client.35756 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:37:20.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:19 smithi062 ceph-mon[44211]: 4.1 scrub ok 2024-04-01T19:37:20.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:19 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3565499979' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:37:20.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:19 smithi062 ceph-mon[44211]: from='client.35756 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:37:20.011 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:20.017 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:20.017 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:20.118 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:37:20.158 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:20.301 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:37:20.306 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:20.307 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:37:20.408 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:20.451 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:20.593 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:20.599 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:20.599 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:20.700 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:37:20.731 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:20.757 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:37:20.759 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:20.760 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:37:20.860 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:37:20.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:20 smithi022 ceph-mon[39439]: 4.9 scrub starts 2024-04-01T19:37:20.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:20 smithi022 ceph-mon[39439]: pgmap v942: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 7.0 GiB data, 17 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T19:37:20.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:20 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:37:20.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:20 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:37:20.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:20 smithi022 ceph-mon[39439]: from='client.35756 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:37:20.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:20 smithi022 ceph-mon[39439]: osdmap e329: 12 total, 11 up, 11 in 2024-04-01T19:37:20.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:20 smithi188 ceph-mon[43939]: 4.9 scrub starts 2024-04-01T19:37:20.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:20 smithi188 ceph-mon[43939]: pgmap v942: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 7.0 GiB data, 17 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T19:37:20.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:20 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:37:20.881 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:20 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:37:20.881 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:20 smithi188 ceph-mon[43939]: from='client.35756 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:37:20.881 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:20 smithi188 ceph-mon[43939]: osdmap e329: 12 total, 11 up, 11 in 2024-04-01T19:37:20.920 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:20.956 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:37:20.963 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:20.964 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:37:21.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:20 smithi062 ceph-mon[44211]: 4.9 scrub starts 2024-04-01T19:37:21.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:20 smithi062 ceph-mon[44211]: pgmap v942: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 7.0 GiB data, 17 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T19:37:21.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:20 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:37:21.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:20 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:37:21.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:20 smithi062 ceph-mon[44211]: from='client.35756 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:37:21.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:20 smithi062 ceph-mon[44211]: osdmap e329: 12 total, 11 up, 11 in 2024-04-01T19:37:21.064 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:37:21.097 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:21.119 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:37:21.121 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:21.122 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:37:21.223 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:37:21.255 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:21.276 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:37:21.279 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:21.279 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:37:21.321 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:37:21.322 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:37:21.380 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:37:21.450 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:21.620 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:37:21.623 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:21.624 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:37:21.725 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:37:21.757 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:22.058 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:37:22.100 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:37:22.136 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:37:22.177 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:37:22.232 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:37:22.261 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:37:22.286 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:37:22.323 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:37:22.358 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:37:22.394 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:37:22.426 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:37:22.427 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:37:22.427 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:37:22.427 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:37:22.427 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:37:22.427 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:37:22.427 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:37:22.427 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:37:22.427 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:37:22.427 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:37:22.427 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:37:22.427 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:37:22.427 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:37:22.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:22 smithi022 ceph-mon[39439]: pgmap v944: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.8 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:37:22.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:22 smithi022 ceph-mon[39439]: 4.9 scrub ok 2024-04-01T19:37:22.828 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:22 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2154536549' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:37:22.828 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:22.828 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:22.828 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:22.828 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:22 smithi188 ceph-mon[43939]: pgmap v944: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.8 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:37:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:22 smithi188 ceph-mon[43939]: 4.9 scrub ok 2024-04-01T19:37:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:22 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2154536549' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:37:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:22.919 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:37:23.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:22 smithi062 ceph-mon[44211]: pgmap v944: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.8 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:37:23.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:22 smithi062 ceph-mon[44211]: 4.9 scrub ok 2024-04-01T19:37:23.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:22 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2154536549' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:37:23.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:23.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:23.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:23.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:23.181 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:37:23.181 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:37:23.320 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:37:23.533 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_ops_in_flight 2024-04-01T19:37:23.538 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:37:23.542 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:23.543 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:37:23.644 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:37:23.700 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:23.750 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:37:23.753 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:23.753 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:37:23.855 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:23.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:23.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:23.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:23.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:23.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:23.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:23.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:23.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:23.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:23.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:23.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:23.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:23.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:23.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:23.898 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:23.926 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:37:23.934 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:23.940 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:23.941 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:24.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:24.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:24.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:24.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:24.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:24.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:24.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:24.041 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:37:24.097 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:24.209 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:37:24.217 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:24.218 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:37:24.318 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:37:24.349 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:24.373 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:37:24.376 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:24.376 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:37:24.477 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:37:24.527 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:24.832 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:24 smithi022 ceph-mon[39439]: pgmap v945: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.7 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:37:24.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:24 smithi188 ceph-mon[43939]: pgmap v945: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.7 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:37:24.887 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:37:24.893 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:24.894 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:37:24.995 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:37:25.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:24 smithi062 ceph-mon[44211]: pgmap v945: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.7 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:37:25.040 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:25.182 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:37:25.505 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:37:25.509 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:25.509 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:37:25.610 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:37:25.634 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:37:25.639 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:25.661 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:37:25.664 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:25.665 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:37:25.765 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:37:25.795 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:25.815 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:37:25.822 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:25.822 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:37:25.923 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:25.986 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:26.038 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:26.041 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:26.041 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:26.125 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:37:26.125 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:37:26.125 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-01T19:37:26.125 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:37:26.142 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:26.205 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:26.409 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:26.415 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:26.415 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:26.516 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:37:26.562 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:26.605 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:37:26.617 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:26.618 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:37:26.625 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:37:26.719 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:37:26.749 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:26.771 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:37:26.773 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:26.773 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:37:26.855 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:26 smithi188 ceph-mon[43939]: pgmap v946: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.5 GiB data, 16 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:37:26.855 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:26 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/435948668' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:37:26.855 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:26 smithi188 ceph-mon[43939]: from='client.25687 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:37:26.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:26 smithi022 ceph-mon[39439]: pgmap v946: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.5 GiB data, 16 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:37:26.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:26 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/435948668' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:37:26.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:26 smithi022 ceph-mon[39439]: from='client.25687 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:37:26.874 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:26.896 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_blocked_ops 2024-04-01T19:37:26.927 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:26.957 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:26.963 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:26.964 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:27.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:26 smithi062 ceph-mon[44211]: pgmap v946: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.5 GiB data, 16 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:37:27.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:26 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/435948668' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:37:27.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:26 smithi062 ceph-mon[44211]: from='client.25687 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:37:27.064 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:37:27.109 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:27.153 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:37:27.161 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:27.161 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:37:27.262 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:37:27.309 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:27.318 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:37:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:27 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:37:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:27 smithi188 ceph-mon[43939]: from='client.25687 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:37:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:27 smithi188 ceph-mon[43939]: osdmap e330: 12 total, 11 up, 11 in 2024-04-01T19:37:28.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:27 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:37:28.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:27 smithi062 ceph-mon[44211]: from='client.25687 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:37:28.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:27 smithi062 ceph-mon[44211]: osdmap e330: 12 total, 11 up, 11 in 2024-04-01T19:37:28.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:27 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:37:28.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:27 smithi022 ceph-mon[39439]: from='client.25687 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:37:28.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:27 smithi022 ceph-mon[39439]: osdmap e330: 12 total, 11 up, 11 in 2024-04-01T19:37:28.837 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:28 smithi188 ceph-mon[43939]: pgmap v948: 17 pgs: 17 active+clean; 6.4 GiB data, 16 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 1.34k op/s 2024-04-01T19:37:28.838 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:37:28.838 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:28 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:37:28.838 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:28 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:37:28.838 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:28 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:37:28.838 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:28 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:37:29.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:28 smithi062 ceph-mon[44211]: pgmap v948: 17 pgs: 17 active+clean; 6.4 GiB data, 16 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 1.34k op/s 2024-04-01T19:37:29.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:37:29.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:28 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:37:29.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:28 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:37:29.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:28 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:37:29.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:28 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:37:29.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:28 smithi022 ceph-mon[39439]: pgmap v948: 17 pgs: 17 active+clean; 6.4 GiB data, 16 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 1.34k op/s 2024-04-01T19:37:29.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:37:29.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:28 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:37:29.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:28 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:37:29.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:28 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:37:29.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:28 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:37:29.543 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:37:29.543 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:37:29.544 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-01T19:37:29.544 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-01T19:37:29.544 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:37:29.783 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:37:29.786 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:29.787 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:37:29.887 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:37:29.944 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:30.018 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:37:30.024 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:30.024 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:37:30.125 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:37:30.174 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:30.250 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:37:30.255 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:30.255 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:37:30.356 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:30.372 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_historic_ops 2024-04-01T19:37:30.416 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:30.431 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:37:30.447 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:30.451 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:30.451 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:30.463 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:37:30.501 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:37:30.532 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:37:30.552 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:30.572 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:37:30.598 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:30.603 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:37:30.633 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:37:30.638 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:30.644 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:30.645 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:30.666 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:37:30.709 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:37:30.743 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:37:30.746 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:37:30.779 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:30.786 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:37:30.786 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:37:30.786 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:37:30.786 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:37:30.786 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:37:30.787 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:37:30.787 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:37:30.787 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:37:30.787 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:37:30.787 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:37:30.787 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:37:30.787 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:37:30.787 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:37:30.795 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:37:30.800 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:37:30.803 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:30.803 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:37:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:30 smithi188 ceph-mon[43939]: pgmap v949: 17 pgs: 17 active+clean; 6.3 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:37:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:30 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2321663352' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:37:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:30 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:37:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:30 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:37:30.903 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:37:30.948 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:31.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:30 smithi062 ceph-mon[44211]: pgmap v949: 17 pgs: 17 active+clean; 6.3 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:37:31.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:30 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2321663352' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:37:31.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:30 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:37:31.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:30 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:37:31.086 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:37:31.089 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:31.089 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:37:31.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:30 smithi022 ceph-mon[39439]: pgmap v949: 17 pgs: 17 active+clean; 6.3 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:37:31.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:30 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2321663352' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:37:31.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:30 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:37:31.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:30 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:37:31.190 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:31.227 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:31.386 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:31.391 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:31.391 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:31.492 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:37:31.532 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:31.554 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:37:31.561 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:31.561 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:37:31.662 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:37:31.682 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:37:31.683 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:37:31.691 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:31.713 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:37:31.716 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:31.717 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:37:31.818 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:37:31.846 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:31.846 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:31.846 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:31.847 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:31.847 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:31.847 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:31.847 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:31.847 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:31.847 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:31.847 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:31.847 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:31.847 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:31 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:37:31.847 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:31 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:37:31.847 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:31 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:37:31.848 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:31.873 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:37:31.876 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:31.876 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:37:31.977 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:37:32.032 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:32.032 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:32.032 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:32.033 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:32.033 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:32.033 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:32.033 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:32.033 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:32.033 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:32.033 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:32.033 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:32.033 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:31 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:37:32.033 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:31 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:37:32.033 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:31 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:37:32.034 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:32.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:32.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:32.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:32.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:32.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:32.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:32.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:32.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:32.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:32.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:32.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:32.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:31 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:37:32.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:31 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:37:32.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:31 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:37:32.168 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:37:32.172 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:32.173 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:37:32.274 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:32.312 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:32.572 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:32.576 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:32.577 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:32.678 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:37:32.714 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:32.752 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:37:32.758 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:32.758 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:37:32.824 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:37:32.859 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:37:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: pgmap v950: 17 pgs: 17 active+clean; 6.1 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:37:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {auth=31,config=2,health=12,kv=55} crc {auth=2540470316,config=3313370793,health=551204407,kv=3873651037}) 2024-04-01T19:37:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {kv=1,logm=99} crc {kv=1142868796,logm=3632866521}) 2024-04-01T19:37:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3437060043}) 2024-04-01T19:37:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3280290041}) 2024-04-01T19:37:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=566392029}) 2024-04-01T19:37:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4139371806}) 2024-04-01T19:37:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3720377083}) 2024-04-01T19:37:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=779299114}) 2024-04-01T19:37:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4135429860}) 2024-04-01T19:37:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2339106309}) 2024-04-01T19:37:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=104683787}) 2024-04-01T19:37:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=167629733}) 2024-04-01T19:37:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1710191660}) 2024-04-01T19:37:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1318321679}) 2024-04-01T19:37:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2208682855}) 2024-04-01T19:37:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3305894457}) 2024-04-01T19:37:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=255629122}) 2024-04-01T19:37:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4147170155}) 2024-04-01T19:37:32.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4082744618}) 2024-04-01T19:37:32.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3765773987}) 2024-04-01T19:37:32.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2797585607}) 2024-04-01T19:37:32.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=695276527}) 2024-04-01T19:37:32.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=790657602}) 2024-04-01T19:37:32.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2759284727}) 2024-04-01T19:37:32.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1017074114}) 2024-04-01T19:37:32.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1055995577}) 2024-04-01T19:37:32.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1841741634}) 2024-04-01T19:37:32.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4060748382}) 2024-04-01T19:37:32.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3640458045}) 2024-04-01T19:37:32.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2765855047}) 2024-04-01T19:37:32.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3067366513}) 2024-04-01T19:37:32.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3864698684}) 2024-04-01T19:37:32.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=6788625}) 2024-04-01T19:37:32.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3665700489}) 2024-04-01T19:37:32.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3662991117}) 2024-04-01T19:37:32.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2865051796}) 2024-04-01T19:37:32.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1226498177}) 2024-04-01T19:37:32.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2504892582}) 2024-04-01T19:37:32.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1135375189}) 2024-04-01T19:37:32.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4275100081}) 2024-04-01T19:37:32.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2848303018}) 2024-04-01T19:37:32.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1982138397}) 2024-04-01T19:37:32.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1753451289}) 2024-04-01T19:37:32.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2739088641}) 2024-04-01T19:37:32.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2337714904}) 2024-04-01T19:37:32.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3484934586}) 2024-04-01T19:37:32.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=10168859}) 2024-04-01T19:37:32.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=70,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=2,mgrstat=6} crc {logm=805442311,mdsmap=2840952586,mgr=1734247563,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=227069607}) 2024-04-01T19:37:32.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=11,mon_config_key=89} crc {mgrstat=1678829453,mon_config_key=2287842600}) 2024-04-01T19:37:32.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=3099723500}) 2024-04-01T19:37:32.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=97,monmap=3} crc {mon_config_key=2011133793,monmap=2491647911}) 2024-04-01T19:37:32.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {monmap=2,osd_metadata=12,osd_pg_creating=1,osdmap=85} crc {monmap=692619927,osd_metadata=1571792687,osd_pg_creating=796197252,osdmap=367384856}) 2024-04-01T19:37:32.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=32} crc {osdmap=2318621418}) 2024-04-01T19:37:32.886 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:32.909 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:37:32.912 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:32.912 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:37:32.922 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:37:32.922 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:37:33.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: pgmap v950: 17 pgs: 17 active+clean; 6.1 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:37:33.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {auth=31,config=2,health=12,kv=55} crc {auth=2540470316,config=3313370793,health=551204407,kv=3873651037}) 2024-04-01T19:37:33.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {kv=1,logm=99} crc {kv=1142868796,logm=3632866521}) 2024-04-01T19:37:33.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3437060043}) 2024-04-01T19:37:33.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3280290041}) 2024-04-01T19:37:33.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=566392029}) 2024-04-01T19:37:33.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4139371806}) 2024-04-01T19:37:33.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3720377083}) 2024-04-01T19:37:33.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=779299114}) 2024-04-01T19:37:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4135429860}) 2024-04-01T19:37:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2339106309}) 2024-04-01T19:37:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=104683787}) 2024-04-01T19:37:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=167629733}) 2024-04-01T19:37:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1710191660}) 2024-04-01T19:37:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1318321679}) 2024-04-01T19:37:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2208682855}) 2024-04-01T19:37:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3305894457}) 2024-04-01T19:37:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=255629122}) 2024-04-01T19:37:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4147170155}) 2024-04-01T19:37:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4082744618}) 2024-04-01T19:37:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3765773987}) 2024-04-01T19:37:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2797585607}) 2024-04-01T19:37:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=695276527}) 2024-04-01T19:37:33.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=790657602}) 2024-04-01T19:37:33.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2759284727}) 2024-04-01T19:37:33.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1017074114}) 2024-04-01T19:37:33.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1055995577}) 2024-04-01T19:37:33.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1841741634}) 2024-04-01T19:37:33.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4060748382}) 2024-04-01T19:37:33.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3640458045}) 2024-04-01T19:37:33.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2765855047}) 2024-04-01T19:37:33.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3067366513}) 2024-04-01T19:37:33.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3864698684}) 2024-04-01T19:37:33.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=6788625}) 2024-04-01T19:37:33.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3665700489}) 2024-04-01T19:37:33.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3662991117}) 2024-04-01T19:37:33.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2865051796}) 2024-04-01T19:37:33.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1226498177}) 2024-04-01T19:37:33.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2504892582}) 2024-04-01T19:37:33.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1135375189}) 2024-04-01T19:37:33.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4275100081}) 2024-04-01T19:37:33.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2848303018}) 2024-04-01T19:37:33.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1982138397}) 2024-04-01T19:37:33.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1753451289}) 2024-04-01T19:37:33.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2739088641}) 2024-04-01T19:37:33.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2337714904}) 2024-04-01T19:37:33.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3484934586}) 2024-04-01T19:37:33.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=10168859}) 2024-04-01T19:37:33.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=70,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=2,mgrstat=6} crc {logm=805442311,mdsmap=2840952586,mgr=1734247563,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=227069607}) 2024-04-01T19:37:33.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=11,mon_config_key=89} crc {mgrstat=1678829453,mon_config_key=2287842600}) 2024-04-01T19:37:33.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=3099723500}) 2024-04-01T19:37:33.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=97,monmap=3} crc {mon_config_key=2011133793,monmap=2491647911}) 2024-04-01T19:37:33.015 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {monmap=2,osd_metadata=12,osd_pg_creating=1,osdmap=85} crc {monmap=692619927,osd_metadata=1571792687,osd_pg_creating=796197252,osdmap=367384856}) 2024-04-01T19:37:33.015 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=32} crc {osdmap=2318621418}) 2024-04-01T19:37:33.015 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:33.062 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:33.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: pgmap v950: 17 pgs: 17 active+clean; 6.1 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:37:33.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {auth=31,config=2,health=12,kv=55} crc {auth=2540470316,config=3313370793,health=551204407,kv=3873651037}) 2024-04-01T19:37:33.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {kv=1,logm=99} crc {kv=1142868796,logm=3632866521}) 2024-04-01T19:37:33.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3437060043}) 2024-04-01T19:37:33.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3280290041}) 2024-04-01T19:37:33.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=566392029}) 2024-04-01T19:37:33.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4139371806}) 2024-04-01T19:37:33.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3720377083}) 2024-04-01T19:37:33.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=779299114}) 2024-04-01T19:37:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4135429860}) 2024-04-01T19:37:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2339106309}) 2024-04-01T19:37:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=104683787}) 2024-04-01T19:37:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=167629733}) 2024-04-01T19:37:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1710191660}) 2024-04-01T19:37:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1318321679}) 2024-04-01T19:37:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2208682855}) 2024-04-01T19:37:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3305894457}) 2024-04-01T19:37:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=255629122}) 2024-04-01T19:37:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4147170155}) 2024-04-01T19:37:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4082744618}) 2024-04-01T19:37:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3765773987}) 2024-04-01T19:37:33.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2797585607}) 2024-04-01T19:37:33.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=695276527}) 2024-04-01T19:37:33.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=790657602}) 2024-04-01T19:37:33.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2759284727}) 2024-04-01T19:37:33.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1017074114}) 2024-04-01T19:37:33.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1055995577}) 2024-04-01T19:37:33.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1841741634}) 2024-04-01T19:37:33.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4060748382}) 2024-04-01T19:37:33.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3640458045}) 2024-04-01T19:37:33.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2765855047}) 2024-04-01T19:37:33.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3067366513}) 2024-04-01T19:37:33.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3864698684}) 2024-04-01T19:37:33.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=6788625}) 2024-04-01T19:37:33.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3665700489}) 2024-04-01T19:37:33.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3662991117}) 2024-04-01T19:37:33.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2865051796}) 2024-04-01T19:37:33.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1226498177}) 2024-04-01T19:37:33.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2504892582}) 2024-04-01T19:37:33.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1135375189}) 2024-04-01T19:37:33.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4275100081}) 2024-04-01T19:37:33.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2848303018}) 2024-04-01T19:37:33.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1982138397}) 2024-04-01T19:37:33.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1753451289}) 2024-04-01T19:37:33.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2739088641}) 2024-04-01T19:37:33.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2337714904}) 2024-04-01T19:37:33.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3484934586}) 2024-04-01T19:37:33.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=10168859}) 2024-04-01T19:37:33.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=70,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=2,mgrstat=6} crc {logm=805442311,mdsmap=2840952586,mgr=1734247563,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=227069607}) 2024-04-01T19:37:33.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=11,mon_config_key=89} crc {mgrstat=1678829453,mon_config_key=2287842600}) 2024-04-01T19:37:33.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=3099723500}) 2024-04-01T19:37:33.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=97,monmap=3} crc {mon_config_key=2011133793,monmap=2491647911}) 2024-04-01T19:37:33.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {monmap=2,osd_metadata=12,osd_pg_creating=1,osdmap=85} crc {monmap=692619927,osd_metadata=1571792687,osd_pg_creating=796197252,osdmap=367384856}) 2024-04-01T19:37:33.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=32} crc {osdmap=2318621418}) 2024-04-01T19:37:33.171 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:33.176 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:33.176 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:33.222 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:37:33.277 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:37:33.317 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:33.367 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:37:33.372 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:33.372 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:37:33.473 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:37:33.504 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:33.526 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:37:33.528 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:33.529 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:37:33.630 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:37:33.672 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:33.684 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:37:33.724 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_ops_in_flight 2024-04-01T19:37:33.740 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:37:33.747 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:33.748 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:37:33.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:33 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:37:33.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:33 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:37:33.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:33 smithi062 ceph-mon[44211]: osdmap e331: 12 total, 11 up, 11 in 2024-04-01T19:37:33.848 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:37:33.889 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:33.913 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:37:33.916 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:33 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:37:33.916 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:33 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:37:33.916 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:33 smithi188 ceph-mon[43939]: osdmap e331: 12 total, 11 up, 11 in 2024-04-01T19:37:33.917 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:33.917 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:37:34.018 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:37:34.054 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:33 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:37:34.054 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:33 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:37:34.054 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:33 smithi022 ceph-mon[39439]: osdmap e331: 12 total, 11 up, 11 in 2024-04-01T19:37:34.057 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:34.096 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:37:34.099 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:34.100 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:37:34.201 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:37:34.232 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:34.260 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:37:34.267 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:34.267 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:37:34.368 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:37:34.408 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:34.762 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:37:34.768 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:37:34.779 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:34.779 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:37:34.779 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:37:34.880 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:37:34.918 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:34.945 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:37:34.949 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:34.949 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:37:34.950 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:34 smithi188 ceph-mon[43939]: pgmap v952: 17 pgs: 17 active+clean; 6.0 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 1.18k op/s 2024-04-01T19:37:35.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:34 smithi062 ceph-mon[44211]: pgmap v952: 17 pgs: 17 active+clean; 6.0 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 1.18k op/s 2024-04-01T19:37:35.050 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:37:35.094 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:35.098 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:34 smithi022 ceph-mon[39439]: pgmap v952: 17 pgs: 17 active+clean; 6.0 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 1.18k op/s 2024-04-01T19:37:35.119 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:37:35.124 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:35.124 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:37:35.225 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:37:35.260 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:35.300 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:37:35.305 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:35.306 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:37:35.407 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:37:35.446 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:35.471 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:37:35.480 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:35.481 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:37:35.582 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:37:35.609 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:35.631 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:37:35.633 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:35.634 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:37:35.735 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:37:35.765 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:35.789 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:37:35.795 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:35.795 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:37:35.896 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:37:35.951 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:36.617 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:37:36.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:36.628 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:37:36.698 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:37:36.729 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:36.732 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:36 smithi022 ceph-mon[39439]: pgmap v953: 17 pgs: 17 active+clean; 5.8 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T19:37:36.732 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:36 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1169200226' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:37:36.732 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:36 smithi022 ceph-mon[39439]: from='client.35780 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:37:36.765 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:36.788 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:36.793 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:36.793 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:36.894 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:37:36.925 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:36.946 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:37:36.948 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:36 smithi062 ceph-mon[44211]: pgmap v953: 17 pgs: 17 active+clean; 5.8 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T19:37:36.948 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:36 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1169200226' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:37:36.949 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:36 smithi062 ceph-mon[44211]: from='client.35780 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:37:36.949 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:36.950 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:37:37.051 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:37:37.082 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:37.105 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:37:37.108 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:37.108 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:37:37.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:36 smithi188 ceph-mon[43939]: pgmap v953: 17 pgs: 17 active+clean; 5.8 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T19:37:37.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:36 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1169200226' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:37:37.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:36 smithi188 ceph-mon[43939]: from='client.35780 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:37:37.209 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:37:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:37.261 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:37:37.263 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:37.264 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:37:37.365 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:37:37.420 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:37.483 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:37:37.487 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:37.488 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:37:37.589 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:37:37.678 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:37.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:37 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:37:37.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:37 smithi022 ceph-mon[39439]: from='client.35780 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:37:37.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:37 smithi022 ceph-mon[39439]: osdmap e332: 12 total, 11 up, 11 in 2024-04-01T19:37:38.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:37 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:37:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:37 smithi062 ceph-mon[44211]: from='client.35780 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:37:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:37 smithi062 ceph-mon[44211]: osdmap e332: 12 total, 11 up, 11 in 2024-04-01T19:37:38.057 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:37:38.064 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:38.064 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:37:38.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:37 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:37:38.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:37 smithi188 ceph-mon[43939]: from='client.35780 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:37:38.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:37 smithi188 ceph-mon[43939]: osdmap e332: 12 total, 11 up, 11 in 2024-04-01T19:37:38.165 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:37:38.207 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:38.233 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:37:38.239 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:38.240 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:37:38.321 INFO:tasks.thrashosds.thrasher:Reviving osd 6 2024-04-01T19:37:38.322 INFO:tasks.cephadm.osd.6:Restarting osd.6 (starting--it wasn't running)... 2024-04-01T19:37:38.322 DEBUG:teuthology.orchestra.run.smithi062:osd.6> sudo journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.6.service 2024-04-01T19:37:38.324 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl start ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.6 2024-04-01T19:37:38.340 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:37:38.354 INFO:journalctl@ceph.osd.6.smithi062.stdout:-- Logs begin at Mon 2024-04-01 19:04:11 UTC. -- 2024-04-01T19:37:38.395 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:38.715 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:37:38 smithi062 systemd[1]: Starting Ceph osd.6 for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T19:37:38.910 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:37:38.910 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:37:39.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:38 smithi062 ceph-mon[44211]: pgmap v955: 17 pgs: 17 active+clean; 5.6 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 1.36k op/s 2024-04-01T19:37:39.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:38 smithi022 ceph-mon[39439]: pgmap v955: 17 pgs: 17 active+clean; 5.6 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 1.36k op/s 2024-04-01T19:37:39.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:38 smithi188 ceph-mon[43939]: pgmap v955: 17 pgs: 17 active+clean; 5.6 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 1.36k op/s 2024-04-01T19:37:39.354 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:37:39.355 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:37:39.355 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:37:39.355 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:37:39.355 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:37:39.355 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:37:39.366 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:37:39.372 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:39.373 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:37:39.405 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:37:39.436 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:37:39.474 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:39.475 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:37:39.506 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:37:39.514 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:39.541 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:37:39.542 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:37:39.542 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:37:39.542 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:37:39.542 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:37:39.542 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:37:39.542 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:37:39.542 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:37:39.542 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:37:39.542 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:37:39.542 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:37:39.542 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:37:39.542 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:37:39.545 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:39.551 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:39.552 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:39.653 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:37:39.688 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:39.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:39 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1703435225' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:37:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:39.761 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:37:39 smithi062 bash[115747]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-01T19:37:39.761 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:37:39 smithi062 bash[115747]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-01T19:37:39.761 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:37:39 smithi062 bash[115747]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-01T19:37:39.761 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:37:39 smithi062 bash[115747]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-01T19:37:39.761 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:37:39 smithi062 bash[115747]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-04-01T19:37:39.761 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:37:39 smithi062 bash[115747]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-01T19:37:39.761 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:37:39 smithi062 bash[115747]: --> ceph-volume raw activate successful for osd ID: 6 2024-04-01T19:37:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:39 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1703435225' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:37:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:39.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:39 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1703435225' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:37:39.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:39.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:39.899 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:37:39.902 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:39.903 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:37:40.003 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:37:40.042 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:40.072 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:37:40.079 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:40.080 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:37:40.181 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:37:40.231 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:40.965 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:40 smithi022 ceph-mon[39439]: pgmap v956: 17 pgs: 17 active+clean; 5.6 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 955 op/s 2024-04-01T19:37:40.965 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:40.965 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:40.966 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:40.966 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:40.966 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:40.966 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:40.966 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:40.966 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:40.966 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:40.991 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:37:40.996 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:40.996 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:37:41.004 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_blocked_ops 2024-04-01T19:37:41.010 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:37:40 smithi062 ceph-osd[116048]: -- 172.21.15.62:0/37996168 <== mon.2 v1:172.21.15.62:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 3761219731 0 0) 0x55c724ebf680 con 0x55c724e89400 2024-04-01T19:37:41.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:40 smithi062 ceph-mon[44211]: pgmap v956: 17 pgs: 17 active+clean; 5.6 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 955 op/s 2024-04-01T19:37:41.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:41.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:41.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:41.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:41.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:41.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:41.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:41.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:41.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:41.044 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_ops_in_flight 2024-04-01T19:37:41.097 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:40 smithi188 ceph-mon[43939]: pgmap v956: 17 pgs: 17 active+clean; 5.6 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 955 op/s 2024-04-01T19:37:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:41.134 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:41.169 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:41.173 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:41.174 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:41.274 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:37:41.328 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:41.382 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:37:41.478 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:37:41 smithi062 bash[116012]: bd9deb571e8514da00b6750809cc9e62efd66fb7784249c52d292a52bf0a2f98 2024-04-01T19:37:41.478 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:37:41 smithi062 systemd[1]: Started Ceph osd.6 for 09f6b846-f05c-11ee-b647-cb9ed24678a4. 2024-04-01T19:37:41.478 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:37:41 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[116025]: 2024-04-01T19:37:41.477+0000 7f1dfa9317c0 -1 Falling back to public interface 2024-04-01T19:37:41.550 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:37:41.558 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:41.559 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:37:41.603 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:37:41.604 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:37:41.660 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:37:41.677 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:37:41.725 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:41.902 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:37:41.993 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:37:42.000 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:42.000 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:37:42.102 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:37:42.170 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:42.259 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:37:42.265 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:42.266 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:37:42.367 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:37:42.402 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:42.423 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:37:42.426 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:42.427 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:37:42.527 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:37:42.574 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:42.595 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:37:42.598 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:42.599 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:37:42.691 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:37:42.700 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:37:42.730 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:42.837 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:42 smithi022 ceph-mon[39439]: pgmap v957: 17 pgs: 17 active+clean; 5.4 GiB data, 14 GiB used, 970 GiB / 983 GiB avail; 0 B/s wr, 1.02k op/s 2024-04-01T19:37:43.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:42 smithi062 ceph-mon[44211]: pgmap v957: 17 pgs: 17 active+clean; 5.4 GiB data, 14 GiB used, 970 GiB / 983 GiB avail; 0 B/s wr, 1.02k op/s 2024-04-01T19:37:43.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:42 smithi188 ceph-mon[43939]: pgmap v957: 17 pgs: 17 active+clean; 5.4 GiB data, 14 GiB used, 970 GiB / 983 GiB avail; 0 B/s wr, 1.02k op/s 2024-04-01T19:37:43.605 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:37:44.694 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:37:44.695 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:37:44.695 INFO:teuthology.orchestra.run.smithi022.stdout: "complaint_time": 30, 2024-04-01T19:37:44.695 INFO:teuthology.orchestra.run.smithi022.stdout: "num_blocked_ops": 0 2024-04-01T19:37:44.695 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:37:44.825 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:44 smithi062 ceph-mon[44211]: pgmap v958: 17 pgs: 17 active+clean; 5.2 GiB data, 13 GiB used, 970 GiB / 983 GiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:37:44.825 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:44 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:37:44.825 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:44 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:37:44.825 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:44 smithi062 ceph-mon[44211]: osdmap e333: 12 total, 11 up, 11 in 2024-04-01T19:37:44.825 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:44 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:37:44.825 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:44 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:37:44.826 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:44 smithi062 ceph-mon[44211]: from='osd.6 v1:172.21.15.62:6808/4216302213' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-01T19:37:44.826 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:37:44 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[116025]: 2024-04-01T19:37:44.532+0000 7f1dfa9317c0 -1 osd.6 299 log_to_monitors true 2024-04-01T19:37:45.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:44 smithi022 ceph-mon[39439]: pgmap v958: 17 pgs: 17 active+clean; 5.2 GiB data, 13 GiB used, 970 GiB / 983 GiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:37:45.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:44 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:37:45.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:44 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:37:45.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:44 smithi022 ceph-mon[39439]: osdmap e333: 12 total, 11 up, 11 in 2024-04-01T19:37:45.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:44 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:37:45.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:44 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:37:45.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:44 smithi022 ceph-mon[39439]: from='osd.6 v1:172.21.15.62:6808/4216302213' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-01T19:37:45.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:44 smithi188 ceph-mon[43939]: pgmap v958: 17 pgs: 17 active+clean; 5.2 GiB data, 13 GiB used, 970 GiB / 983 GiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:37:45.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:44 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:37:45.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:44 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:37:45.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:44 smithi188 ceph-mon[43939]: osdmap e333: 12 total, 11 up, 11 in 2024-04-01T19:37:45.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:44 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:37:45.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:44 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:37:45.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:44 smithi188 ceph-mon[43939]: from='osd.6 v1:172.21.15.62:6808/4216302213' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-01T19:37:45.260 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:37:44 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[116025]: 2024-04-01T19:37:44.851+0000 7f1debd89700 -1 osd.6 334 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T19:37:45.433 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:37:45.436 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:45.436 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:37:45.537 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:37:45.571 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:45.602 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:37:45.609 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:45.609 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:37:45.710 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:37:45.748 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:45.780 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:37:45.783 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:45.784 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:37:45.843 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:45 smithi188 ceph-mon[43939]: from='osd.6 v1:172.21.15.62:6808/4216302213' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-01T19:37:45.843 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:45 smithi188 ceph-mon[43939]: osdmap e334: 12 total, 11 up, 11 in 2024-04-01T19:37:45.843 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:45 smithi188 ceph-mon[43939]: from='osd.6 v1:172.21.15.62:6808/4216302213' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:37:45.844 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:45 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:37:45.885 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:37:45.926 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:45.947 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_historic_ops 2024-04-01T19:37:45.953 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:37:45.956 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:45.956 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:37:46.057 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:37:46.098 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:45 smithi062 ceph-mon[44211]: from='osd.6 v1:172.21.15.62:6808/4216302213' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-01T19:37:46.098 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:45 smithi062 ceph-mon[44211]: osdmap e334: 12 total, 11 up, 11 in 2024-04-01T19:37:46.098 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:45 smithi062 ceph-mon[44211]: from='osd.6 v1:172.21.15.62:6808/4216302213' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:37:46.098 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:45 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:37:46.103 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:45 smithi022 ceph-mon[39439]: from='osd.6 v1:172.21.15.62:6808/4216302213' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-01T19:37:46.103 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:45 smithi022 ceph-mon[39439]: osdmap e334: 12 total, 11 up, 11 in 2024-04-01T19:37:46.103 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:45 smithi022 ceph-mon[39439]: from='osd.6 v1:172.21.15.62:6808/4216302213' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:37:46.103 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:45 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:37:46.110 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:46.148 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:37:46.149 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:37:46.149 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:37:46.149 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 0 2024-04-01T19:37:46.149 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:37:46.153 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:46.153 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:37:46.241 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:37:46.254 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:37:46.290 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:46.325 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:37:46.331 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:46.331 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:37:46.432 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:37:46.475 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:46.900 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-01T19:37:46.901 INFO:tasks.thrashosds.thrasher:Adding osd 6 2024-04-01T19:37:46.901 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd in 6 2024-04-01T19:37:46.926 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:37:46.933 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:46.933 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:37:47.034 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:47.039 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:46 smithi022 ceph-mon[39439]: pgmap v961: 17 pgs: 17 active+clean; 5.1 GiB data, 13 GiB used, 970 GiB / 983 GiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:37:47.039 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:46 smithi022 ceph-mon[39439]: osd.6 v1:172.21.15.62:6808/4216302213 boot 2024-04-01T19:37:47.039 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:46 smithi022 ceph-mon[39439]: osdmap e335: 12 total, 12 up, 11 in 2024-04-01T19:37:47.039 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:37:47.079 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:47.108 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:47.111 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:46 smithi188 ceph-mon[43939]: pgmap v961: 17 pgs: 17 active+clean; 5.1 GiB data, 13 GiB used, 970 GiB / 983 GiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:37:47.111 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:46 smithi188 ceph-mon[43939]: osd.6 v1:172.21.15.62:6808/4216302213 boot 2024-04-01T19:37:47.112 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:46 smithi188 ceph-mon[43939]: osdmap e335: 12 total, 12 up, 11 in 2024-04-01T19:37:47.112 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:46 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:37:47.112 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:47.112 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:47.213 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:37:47.242 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:46 smithi062 ceph-mon[44211]: pgmap v961: 17 pgs: 17 active+clean; 5.1 GiB data, 13 GiB used, 970 GiB / 983 GiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:37:47.242 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:46 smithi062 ceph-mon[44211]: osd.6 v1:172.21.15.62:6808/4216302213 boot 2024-04-01T19:37:47.242 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:46 smithi062 ceph-mon[44211]: osdmap e335: 12 total, 12 up, 11 in 2024-04-01T19:37:47.242 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:46 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:37:47.245 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:47.270 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:37:47.273 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:47.274 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:37:47.367 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:37:47.374 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:37:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:47.653 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:37:47.660 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:47.661 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:37:47.762 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:37:47.814 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:47.901 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:37:48.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:48.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:47 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:37:48.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:47 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:37:48.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:47 smithi022 ceph-mon[39439]: osdmap e336: 12 total, 12 up, 11 in 2024-04-01T19:37:48.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:47 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2283926952' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:37:48.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:47 smithi022 ceph-mon[39439]: from='client.35795 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:37:48.127 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:48.127 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:47 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:37:48.127 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:47 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:37:48.127 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:47 smithi188 ceph-mon[43939]: osdmap e336: 12 total, 12 up, 11 in 2024-04-01T19:37:48.127 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:47 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2283926952' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:37:48.127 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:47 smithi188 ceph-mon[43939]: from='client.35795 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:37:48.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:48.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:47 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:37:48.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:47 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:37:48.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:47 smithi062 ceph-mon[44211]: osdmap e336: 12 total, 12 up, 11 in 2024-04-01T19:37:48.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:47 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2283926952' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:37:48.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:47 smithi062 ceph-mon[44211]: from='client.35795 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:37:49.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:48 smithi188 ceph-mon[43939]: pgmap v964: 17 pgs: 17 active+clean; 4.9 GiB data, 13 GiB used, 971 GiB / 983 GiB avail; 0 B/s wr, 1.31k op/s 2024-04-01T19:37:49.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:48 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:37:49.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:48 smithi188 ceph-mon[43939]: from='client.35795 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:37:49.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:48 smithi188 ceph-mon[43939]: osdmap e337: 12 total, 12 up, 11 in 2024-04-01T19:37:49.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:48 smithi062 ceph-mon[44211]: pgmap v964: 17 pgs: 17 active+clean; 4.9 GiB data, 13 GiB used, 971 GiB / 983 GiB avail; 0 B/s wr, 1.31k op/s 2024-04-01T19:37:49.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:48 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:37:49.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:48 smithi062 ceph-mon[44211]: from='client.35795 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:37:49.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:48 smithi062 ceph-mon[44211]: osdmap e337: 12 total, 12 up, 11 in 2024-04-01T19:37:49.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:48 smithi022 ceph-mon[39439]: pgmap v964: 17 pgs: 17 active+clean; 4.9 GiB data, 13 GiB used, 971 GiB / 983 GiB avail; 0 B/s wr, 1.31k op/s 2024-04-01T19:37:49.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:48 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:37:49.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:48 smithi022 ceph-mon[39439]: from='client.35795 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:37:49.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:48 smithi022 ceph-mon[39439]: osdmap e337: 12 total, 12 up, 11 in 2024-04-01T19:37:49.478 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:37:49.484 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:49.484 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:37:49.586 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:37:49.622 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:49.649 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:37:49.652 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:49.653 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:37:49.754 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:37:49.794 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:49.814 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:37:49.829 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:37:49.832 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:49.833 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:37:49.843 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:37:49.879 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:37:49.910 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:37:49.933 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:37:49.943 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:37:49.963 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:49.984 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:37:49.987 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:49.988 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:37:49.993 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:37:50.025 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:37:50.060 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:37:50.088 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:37:50.089 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:37:50.117 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:50.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:49 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1324972008' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:37:50.138 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:37:50.143 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:49 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1324972008' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:37:50.144 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:50.144 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:37:50.144 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:37:50.187 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:37:50.217 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:37:50.219 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:37:50.219 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:37:50.219 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:37:50.220 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:37:50.220 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:37:50.220 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:37:50.220 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:37:50.221 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:37:50.221 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:37:50.221 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:37:50.221 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:37:50.221 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:37:50.245 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:50.256 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:49 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1324972008' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:37:50.290 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:50.316 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:50.319 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:50.319 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:50.421 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:37:50.483 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:50.604 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:37:50.610 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:50.611 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:37:50.712 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:37:50.749 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:50.780 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:37:50.791 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:50.792 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:37:50.893 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:37:50.937 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:51.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:50 smithi188 ceph-mon[43939]: pgmap v966: 17 pgs: 17 active+clean; 4.9 GiB data, 13 GiB used, 971 GiB / 983 GiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:37:51.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:50 smithi062 ceph-mon[44211]: pgmap v966: 17 pgs: 17 active+clean; 4.9 GiB data, 13 GiB used, 971 GiB / 983 GiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:37:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:50 smithi022 ceph-mon[39439]: pgmap v966: 17 pgs: 17 active+clean; 4.9 GiB data, 13 GiB used, 971 GiB / 983 GiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:37:51.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:51.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:52.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:52.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:51 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T19:37:52.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:51 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T19:37:52.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:51 smithi062 ceph-mon[44211]: pgmap v967: 17 pgs: 17 active+clean; 4.7 GiB data, 12 GiB used, 971 GiB / 983 GiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:37:52.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:52.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:51 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T19:37:52.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:51 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T19:37:52.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:51 smithi022 ceph-mon[39439]: pgmap v967: 17 pgs: 17 active+clean; 4.7 GiB data, 12 GiB used, 971 GiB / 983 GiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:37:52.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:37:52.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:51 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T19:37:52.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:51 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T19:37:52.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:51 smithi188 ceph-mon[43939]: pgmap v967: 17 pgs: 17 active+clean; 4.7 GiB data, 12 GiB used, 971 GiB / 983 GiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:37:52.799 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:37:52.810 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:52.810 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:37:52.911 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:37:52.944 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:52.970 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:37:52.977 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:52.978 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:37:53.079 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:37:53.147 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:53.174 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:37:53.181 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:53.181 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:37:53.266 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:37:53.266 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:37:53.282 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:37:53.313 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:53.338 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:37:53.342 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:53.342 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:37:53.444 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:37:53.474 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:53.499 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:37:53.502 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:53.503 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:37:53.604 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:37:53.637 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:53.662 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:37:53.664 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:53.665 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:37:53.766 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:37:53.831 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:53.864 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:37:53.871 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:53.872 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:37:53.973 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:37:54.008 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:54.014 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:37:54.038 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:37:54.042 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:54.043 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:37:54.046 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_ops_in_flight 2024-04-01T19:37:54.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:53 smithi188 ceph-mon[43939]: pgmap v968: 17 pgs: 17 active+clean; 4.5 GiB data, 12 GiB used, 971 GiB / 983 GiB avail; 0 B/s wr, 1.31k op/s 2024-04-01T19:37:54.144 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:37:54.180 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:54.203 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:37:54.206 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:54.206 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:37:54.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:53 smithi062 ceph-mon[44211]: pgmap v968: 17 pgs: 17 active+clean; 4.5 GiB data, 12 GiB used, 971 GiB / 983 GiB avail; 0 B/s wr, 1.31k op/s 2024-04-01T19:37:54.308 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:37:54.351 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:53 smithi022 ceph-mon[39439]: pgmap v968: 17 pgs: 17 active+clean; 4.5 GiB data, 12 GiB used, 971 GiB / 983 GiB avail; 0 B/s wr, 1.31k op/s 2024-04-01T19:37:54.352 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:54.372 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:37:54.375 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:54.375 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:37:54.477 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:37:54.507 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:54.530 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:37:54.534 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:54.534 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:37:54.635 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:37:54.689 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:54.721 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:37:54.907 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:37:54.914 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:54.915 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:37:55.016 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:37:55.064 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:55.088 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:37:55.092 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:55.092 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:37:55.175 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:37:55.194 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:37:55.232 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:54 smithi022 ceph-mon[39439]: 4.3 scrub starts 2024-04-01T19:37:55.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:54 smithi062 ceph-mon[44211]: 4.3 scrub starts 2024-04-01T19:37:55.266 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:55.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:54 smithi188 ceph-mon[43939]: 4.3 scrub starts 2024-04-01T19:37:55.494 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:37:55.537 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:37:55.542 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:55.543 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:37:55.644 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:37:55.680 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:55.703 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:37:55.709 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:55.710 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:37:55.811 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:37:55.878 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:56.050 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:56 smithi022 ceph-mon[39439]: pgmap v969: 17 pgs: 17 active+clean; 4.4 GiB data, 12 GiB used, 972 GiB / 983 GiB avail; 0 B/s wr, 1.02k op/s 2024-04-01T19:37:56.050 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:56 smithi022 ceph-mon[39439]: 4.3 scrub ok 2024-04-01T19:37:56.246 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:37:56.249 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:56.250 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:37:56.351 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:37:56.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:56 smithi188 ceph-mon[43939]: pgmap v969: 17 pgs: 17 active+clean; 4.4 GiB data, 12 GiB used, 972 GiB / 983 GiB avail; 0 B/s wr, 1.02k op/s 2024-04-01T19:37:56.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:56 smithi188 ceph-mon[43939]: 4.3 scrub ok 2024-04-01T19:37:56.377 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:56 smithi062 ceph-mon[44211]: pgmap v969: 17 pgs: 17 active+clean; 4.4 GiB data, 12 GiB used, 972 GiB / 983 GiB avail; 0 B/s wr, 1.02k op/s 2024-04-01T19:37:56.377 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:56 smithi062 ceph-mon[44211]: 4.3 scrub ok 2024-04-01T19:37:56.380 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:56.402 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:37:56.405 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:56.405 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:37:56.507 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:37:56.562 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:56.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:56 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[39416]: 2024-04-01T19:37:56.803+0000 7fd025a9f700 -1 mon.a@0(leader).osd e337 definitely_dead 0 2024-04-01T19:37:57.122 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:37:57.140 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:37:57.146 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:57.147 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:37:57.248 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:37:57.276 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:57.295 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:37:57.297 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:57.297 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:37:57.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:57 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2073168368' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["6"]}]: dispatch 2024-04-01T19:37:57.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:57 smithi022 ceph-mon[39439]: from='client.25714 ' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["6"]}]: dispatch 2024-04-01T19:37:57.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:57 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2073168368' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["6"]}]: dispatch 2024-04-01T19:37:57.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:57 smithi188 ceph-mon[43939]: from='client.25714 ' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["6"]}]: dispatch 2024-04-01T19:37:57.398 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:37:57.424 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:57 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2073168368' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["6"]}]: dispatch 2024-04-01T19:37:57.424 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:57 smithi062 ceph-mon[44211]: from='client.25714 ' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["6"]}]: dispatch 2024-04-01T19:37:57.425 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:57.446 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:37:57.448 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:57.449 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:37:57.476 INFO:teuthology.orchestra.run.smithi022.stderr:marked in osd.6. 2024-04-01T19:37:57.549 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:37:57.577 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:57.596 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:37:57.598 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:57.599 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:37:57.700 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:37:57.728 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:57.747 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:37:57.750 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:57.750 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:37:57.851 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:37:57.879 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:57.898 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:37:57.900 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:57.901 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:37:58.002 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:37:58.032 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:58.052 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:37:58.058 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:58.058 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:37:58.076 INFO:tasks.thrashosds.thrasher:Added osd 6 2024-04-01T19:37:58.159 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:37:58.184 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:58 smithi188 ceph-mon[43939]: pgmap v970: 17 pgs: 17 active+clean; 4.2 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:37:58.184 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:58 smithi188 ceph-mon[43939]: from='client.25714 ' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["6"]}]': finished 2024-04-01T19:37:58.184 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:58 smithi188 ceph-mon[43939]: osdmap e338: 12 total, 12 up, 12 in 2024-04-01T19:37:58.186 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:58.205 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:37:58.207 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:58.208 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:37:58.309 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:37:58.336 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:58.354 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:37:58.356 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:58.356 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:37:58.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:58 smithi022 ceph-mon[39439]: pgmap v970: 17 pgs: 17 active+clean; 4.2 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:37:58.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:58 smithi022 ceph-mon[39439]: from='client.25714 ' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["6"]}]': finished 2024-04-01T19:37:58.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:58 smithi022 ceph-mon[39439]: osdmap e338: 12 total, 12 up, 12 in 2024-04-01T19:37:58.447 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:37:58.457 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:37:58.485 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:58 smithi062 ceph-mon[44211]: pgmap v970: 17 pgs: 17 active+clean; 4.2 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:37:58.485 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:58 smithi062 ceph-mon[44211]: from='client.25714 ' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["6"]}]': finished 2024-04-01T19:37:58.485 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:58 smithi062 ceph-mon[44211]: osdmap e338: 12 total, 12 up, 12 in 2024-04-01T19:37:58.487 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:58.507 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:37:58.509 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:58.510 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:37:58.611 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:37:58.645 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:37:59.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:37:59 smithi022 ceph-mon[39439]: osdmap e339: 12 total, 12 up, 12 in 2024-04-01T19:37:59.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:37:59 smithi188 ceph-mon[43939]: osdmap e339: 12 total, 12 up, 12 in 2024-04-01T19:37:59.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:37:59 smithi062 ceph-mon[44211]: osdmap e339: 12 total, 12 up, 12 in 2024-04-01T19:37:59.514 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:37:59.514 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:37:59.896 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:37:59.910 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:37:59.910 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:38:00.012 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:38:00.066 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:00.068 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:00 smithi022 ceph-mon[39439]: pgmap v973: 17 pgs: 17 active+clean; 4.2 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 0 B/s wr, 1.11k op/s 2024-04-01T19:38:00.068 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:00 smithi022 ceph-mon[39439]: osdmap e340: 12 total, 12 up, 12 in 2024-04-01T19:38:00.068 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:00 smithi022 ceph-mon[39439]: 4.a starting backfill to osd.6 from (272'1500,299'11547] MIN to 337'17460 2024-04-01T19:38:00.068 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:00 smithi022 ceph-mon[39439]: 4.5 starting backfill to osd.6 from (272'1300,299'11383] MIN to 337'20257 2024-04-01T19:38:00.105 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:38:00.110 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:00.110 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:38:00.211 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:38:00.251 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_blocked_ops 2024-04-01T19:38:00.255 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:00.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:00 smithi188 ceph-mon[43939]: pgmap v973: 17 pgs: 17 active+clean; 4.2 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 0 B/s wr, 1.11k op/s 2024-04-01T19:38:00.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:00 smithi188 ceph-mon[43939]: osdmap e340: 12 total, 12 up, 12 in 2024-04-01T19:38:00.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:00 smithi188 ceph-mon[43939]: 4.a starting backfill to osd.6 from (272'1500,299'11547] MIN to 337'17460 2024-04-01T19:38:00.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:00 smithi188 ceph-mon[43939]: 4.5 starting backfill to osd.6 from (272'1300,299'11383] MIN to 337'20257 2024-04-01T19:38:00.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:00 smithi062 ceph-mon[44211]: pgmap v973: 17 pgs: 17 active+clean; 4.2 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 0 B/s wr, 1.11k op/s 2024-04-01T19:38:00.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:00 smithi062 ceph-mon[44211]: osdmap e340: 12 total, 12 up, 12 in 2024-04-01T19:38:00.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:00 smithi062 ceph-mon[44211]: 4.a starting backfill to osd.6 from (272'1500,299'11547] MIN to 337'17460 2024-04-01T19:38:00.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:00 smithi062 ceph-mon[44211]: 4.5 starting backfill to osd.6 from (272'1300,299'11383] MIN to 337'20257 2024-04-01T19:38:01.242 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:38:01.243 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:01 smithi022 ceph-mon[39439]: 4.2 scrub starts 2024-04-01T19:38:01.244 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:01 smithi022 ceph-mon[39439]: 4.2 scrub ok 2024-04-01T19:38:01.245 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:01.245 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:38:01.346 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:38:01.373 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:01 smithi062 ceph-mon[44211]: 4.2 scrub starts 2024-04-01T19:38:01.373 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:01 smithi062 ceph-mon[44211]: 4.2 scrub ok 2024-04-01T19:38:01.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:01 smithi188 ceph-mon[43939]: 4.2 scrub starts 2024-04-01T19:38:01.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:01 smithi188 ceph-mon[43939]: 4.2 scrub ok 2024-04-01T19:38:01.375 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:01.397 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:38:01.399 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:01.400 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:38:01.501 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:38:01.531 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:01.551 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:38:01.556 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:01.557 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:38:01.657 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:38:01.708 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:01.909 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:38:01.913 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:01.913 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:38:02.015 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:38:02.046 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:02.069 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:38:02.071 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:02.072 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:38:02.094 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:38:02.173 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:38:02.203 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:02.229 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:38:02.232 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:02.232 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:38:02.256 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:38:02.287 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:38:02.317 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:38:02.332 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:38:02.345 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:38:02.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:02 smithi022 ceph-mon[39439]: pgmap v975: 17 pgs: 1 activating+remapped, 16 active+clean; 4.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 874 op/s; 4194/133998 objects misplaced (3.130%) 2024-04-01T19:38:02.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:02 smithi022 ceph-mon[39439]: 4.0 scrub starts 2024-04-01T19:38:02.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:02 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1863728999' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:38:02.361 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:02 smithi188 ceph-mon[43939]: pgmap v975: 17 pgs: 1 activating+remapped, 16 active+clean; 4.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 874 op/s; 4194/133998 objects misplaced (3.130%) 2024-04-01T19:38:02.361 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:02 smithi188 ceph-mon[43939]: 4.0 scrub starts 2024-04-01T19:38:02.361 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:02 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1863728999' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:38:02.364 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:02.385 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:38:02.392 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:38:02.395 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:02.396 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:38:02.396 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:38:02.420 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:38:02.451 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:38:02.472 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:38:02.496 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:38:02.499 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:38:02.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:02 smithi062 ceph-mon[44211]: pgmap v975: 17 pgs: 1 activating+remapped, 16 active+clean; 4.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 874 op/s; 4194/133998 objects misplaced (3.130%) 2024-04-01T19:38:02.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:02 smithi062 ceph-mon[44211]: 4.0 scrub starts 2024-04-01T19:38:02.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:02 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1863728999' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:38:02.528 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:38:02.530 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:02.559 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:38:02.562 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:02.562 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:38:02.573 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:38:02.605 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:38:02.614 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:38:02.614 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:38:02.614 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:38:02.614 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:38:02.614 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:38:02.615 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:38:02.615 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:38:02.615 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:38:02.615 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:38:02.615 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:38:02.615 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:38:02.615 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:38:02.664 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:38:02.694 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:02.718 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:38:02.725 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:02.725 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:38:02.826 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:38:02.879 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:03.077 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 9, 10, 11, 8, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 7, 9, 10, 11, 8, 6] 2024-04-01T19:38:03.077 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-01T19:38:03.077 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-01T19:38:03.077 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 1.000000 2024-04-01T19:38:03.078 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd primary-affinity 2 1 2024-04-01T19:38:03.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:03 smithi022 ceph-mon[39439]: 4.0 scrub ok 2024-04-01T19:38:03.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:03 smithi188 ceph-mon[43939]: 4.0 scrub ok 2024-04-01T19:38:03.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:03 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:38:03.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:03 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:38:03.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:03 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1863728999' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:38:03.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:03 smithi188 ceph-mon[43939]: osdmap e341: 12 total, 12 up, 12 in 2024-04-01T19:38:03.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:03 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2763479351' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:38:03.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:03.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:03.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:03 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:38:03.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:03 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:38:03.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:03.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:03.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:03.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:03.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:03.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:03 smithi062 ceph-mon[44211]: 4.0 scrub ok 2024-04-01T19:38:03.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:03 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:38:03.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:03 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:38:03.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:03 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1863728999' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:38:03.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:03 smithi062 ceph-mon[44211]: osdmap e341: 12 total, 12 up, 12 in 2024-04-01T19:38:03.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:03 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2763479351' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:38:03.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:03.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:03.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:03 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:38:03.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:03 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:38:03.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:03.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:03.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:03.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:03.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:03.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:03 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:38:03.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:03 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:38:03.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:03 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1863728999' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:38:03.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:03 smithi022 ceph-mon[39439]: osdmap e341: 12 total, 12 up, 12 in 2024-04-01T19:38:03.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:03 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2763479351' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:38:03.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:03.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:03.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:03 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:38:03.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:03 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:38:03.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:03.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:03.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:03.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:03.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:04.051 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:38:04.059 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:04.060 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:38:04.161 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:38:04.191 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:04.222 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:38:04.228 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:04.229 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:38:04.330 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:38:04.360 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:04.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:04.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:04.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:04.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:04.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:04.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:04 smithi022 ceph-mon[39439]: pgmap v977: 17 pgs: 1 active+remapped+backfilling, 1 activating+remapped, 15 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 555 op/s; 7513/130584 objects misplaced (5.753%); 6.6 MiB/s, 104 objects/s recovering 2024-04-01T19:38:04.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:04 smithi022 ceph-mon[39439]: osdmap e342: 12 total, 12 up, 12 in 2024-04-01T19:38:04.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:04.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:04.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:04.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:04.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:04.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:04 smithi188 ceph-mon[43939]: pgmap v977: 17 pgs: 1 active+remapped+backfilling, 1 activating+remapped, 15 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 555 op/s; 7513/130584 objects misplaced (5.753%); 6.6 MiB/s, 104 objects/s recovering 2024-04-01T19:38:04.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:04 smithi188 ceph-mon[43939]: osdmap e342: 12 total, 12 up, 12 in 2024-04-01T19:38:04.384 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:38:04.389 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:04.390 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:38:04.490 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:38:04.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:04.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:04.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:04.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:04.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:04.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:04 smithi062 ceph-mon[44211]: pgmap v977: 17 pgs: 1 active+remapped+backfilling, 1 activating+remapped, 15 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 555 op/s; 7513/130584 objects misplaced (5.753%); 6.6 MiB/s, 104 objects/s recovering 2024-04-01T19:38:04.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:04 smithi062 ceph-mon[44211]: osdmap e342: 12 total, 12 up, 12 in 2024-04-01T19:38:04.518 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:04.538 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:38:04.543 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:04.543 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:38:04.644 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:38:04.679 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:04.893 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:38:04.897 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:04.898 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:38:04.906 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:38:04.998 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:38:05.024 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:05.059 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:38:05.064 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:05.064 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:38:05.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:05 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:38:05.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:05 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:38:05.165 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:38:05.193 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:05.214 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:38:05.216 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:05.217 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:38:05.317 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:38:05.347 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:05 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:38:05.347 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:05 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:38:05.348 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:05.371 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:38:05.374 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:05.374 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:38:05.476 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:38:05.504 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:05.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:05 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:38:05.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:05 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:38:05.720 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:38:05.753 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:38:05.756 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:05.757 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:38:05.858 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:38:05.884 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:05.907 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:38:05.909 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:05.910 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:38:06.011 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:38:06.036 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:06.054 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:38:06.057 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:06.058 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:38:06.158 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:38:06.189 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:06.213 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:38:06.217 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:06.217 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:38:06.269 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:06 smithi022 ceph-mon[39439]: pgmap v979: 17 pgs: 2 active+remapped+backfilling, 15 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 631 op/s; 3733/128878 objects misplaced (2.897%); 8.1 MiB/s, 129 objects/s recovering 2024-04-01T19:38:06.270 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:06 smithi022 ceph-mon[39439]: osdmap e343: 12 total, 12 up, 12 in 2024-04-01T19:38:06.318 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:38:06.350 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:06.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:06 smithi188 ceph-mon[43939]: pgmap v979: 17 pgs: 2 active+remapped+backfilling, 15 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 631 op/s; 3733/128878 objects misplaced (2.897%); 8.1 MiB/s, 129 objects/s recovering 2024-04-01T19:38:06.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:06 smithi188 ceph-mon[43939]: osdmap e343: 12 total, 12 up, 12 in 2024-04-01T19:38:06.374 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:38:06.375 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:06 smithi062 ceph-mon[44211]: pgmap v979: 17 pgs: 2 active+remapped+backfilling, 15 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 631 op/s; 3733/128878 objects misplaced (2.897%); 8.1 MiB/s, 129 objects/s recovering 2024-04-01T19:38:06.376 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:06 smithi062 ceph-mon[44211]: osdmap e343: 12 total, 12 up, 12 in 2024-04-01T19:38:06.376 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:06.377 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:38:06.477 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:38:06.523 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:06.550 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:38:06.556 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:06.557 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:38:06.658 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:38:06.693 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:06.729 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:38:06.736 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:06.736 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:38:06.837 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:38:06.888 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:38:06.895 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:06.929 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:38:06.939 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:06.940 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:38:07.041 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:38:07.061 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:38:07.061 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:38:07.061 INFO:teuthology.orchestra.run.smithi022.stdout: "complaint_time": 30, 2024-04-01T19:38:07.061 INFO:teuthology.orchestra.run.smithi022.stdout: "num_blocked_ops": 0 2024-04-01T19:38:07.061 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:38:07.072 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:07.098 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:38:07.106 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:07.107 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:38:07.208 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:38:07.238 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:07.239 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:07 smithi188 ceph-mon[43939]: 4.c scrub starts 2024-04-01T19:38:07.239 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:07 smithi188 ceph-mon[43939]: 4.c scrub ok 2024-04-01T19:38:07.239 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:07 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:38:07.239 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:07 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:38:07.239 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:07 smithi188 ceph-mon[43939]: osdmap e344: 12 total, 12 up, 12 in 2024-04-01T19:38:07.264 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:38:07.267 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:07.267 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:38:07.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:07 smithi022 ceph-mon[39439]: 4.c scrub starts 2024-04-01T19:38:07.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:07 smithi022 ceph-mon[39439]: 4.c scrub ok 2024-04-01T19:38:07.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:07 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:38:07.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:07 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:38:07.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:07 smithi022 ceph-mon[39439]: osdmap e344: 12 total, 12 up, 12 in 2024-04-01T19:38:07.368 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:38:07.396 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:07.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:07 smithi062 ceph-mon[44211]: 4.c scrub starts 2024-04-01T19:38:07.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:07 smithi062 ceph-mon[44211]: 4.c scrub ok 2024-04-01T19:38:07.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:07 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:38:07.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:07 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:38:07.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:07 smithi062 ceph-mon[44211]: osdmap e344: 12 total, 12 up, 12 in 2024-04-01T19:38:07.520 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:38:07.522 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:07.523 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:38:07.624 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:38:07.650 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:07.669 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:38:07.672 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:07.672 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:38:07.773 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:38:07.801 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:07.821 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:38:07.823 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:07.824 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:38:07.925 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:38:07.954 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:08.153 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:38:08.155 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_historic_ops 2024-04-01T19:38:08.155 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:08.156 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:38:08.216 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:38:08.257 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:38:08.295 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:08.319 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:38:08.322 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:08.322 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:38:08.423 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:38:08.455 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:08 smithi062 ceph-mon[44211]: pgmap v982: 17 pgs: 1 peering, 1 active+remapped+backfilling, 15 active+clean; 3.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 702 op/s; 3319/125126 objects misplaced (2.653%); 10 MiB/s, 160 objects/s recovering 2024-04-01T19:38:08.455 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:08 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:38:08.456 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:08 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:38:08.456 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:08 smithi062 ceph-mon[44211]: osdmap e345: 12 total, 12 up, 12 in 2024-04-01T19:38:08.458 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:08.479 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:08 smithi022 ceph-mon[39439]: pgmap v982: 17 pgs: 1 peering, 1 active+remapped+backfilling, 15 active+clean; 3.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 702 op/s; 3319/125126 objects misplaced (2.653%); 10 MiB/s, 160 objects/s recovering 2024-04-01T19:38:08.479 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:08 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:38:08.479 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:08 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:38:08.480 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:08 smithi022 ceph-mon[39439]: osdmap e345: 12 total, 12 up, 12 in 2024-04-01T19:38:08.480 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:38:08.483 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:08.483 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:38:08.584 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:38:08.616 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:08.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:08 smithi188 ceph-mon[43939]: pgmap v982: 17 pgs: 1 peering, 1 active+remapped+backfilling, 15 active+clean; 3.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 702 op/s; 3319/125126 objects misplaced (2.653%); 10 MiB/s, 160 objects/s recovering 2024-04-01T19:38:08.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:08 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:38:08.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:08 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:38:08.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:08 smithi188 ceph-mon[43939]: osdmap e345: 12 total, 12 up, 12 in 2024-04-01T19:38:08.640 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:38:08.645 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:08.645 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:38:08.746 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:38:08.801 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:08.907 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:38:08.914 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:08.914 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:38:08.915 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:38:09.016 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:38:09.091 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:09.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:09 smithi022 ceph-mon[39439]: osdmap e346: 12 total, 12 up, 12 in 2024-04-01T19:38:09.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:09 smithi062 ceph-mon[44211]: osdmap e346: 12 total, 12 up, 12 in 2024-04-01T19:38:09.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:09 smithi188 ceph-mon[43939]: osdmap e346: 12 total, 12 up, 12 in 2024-04-01T19:38:09.700 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:38:09.705 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:09.706 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:38:09.807 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:38:09.870 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:10.210 INFO:teuthology.orchestra.run.smithi022.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-01T19:38:10.235 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:38:10.239 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:10.239 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:38:10.340 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:38:10.388 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:10.415 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:38:10.419 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:10 smithi062 ceph-mon[44211]: pgmap v985: 17 pgs: 1 active+clean+remapped, 1 peering, 15 active+clean; 3.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 563 op/s; 13 MiB/s, 202 objects/s recovering 2024-04-01T19:38:10.419 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:10 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3948135146' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:38:10.419 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:10 smithi062 ceph-mon[44211]: from='client.35825 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:38:10.420 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:10.421 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:38:10.522 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:38:10.556 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:10 smithi188 ceph-mon[43939]: pgmap v985: 17 pgs: 1 active+clean+remapped, 1 peering, 15 active+clean; 3.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 563 op/s; 13 MiB/s, 202 objects/s recovering 2024-04-01T19:38:10.556 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:10 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3948135146' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:38:10.556 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:10 smithi188 ceph-mon[43939]: from='client.35825 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:38:10.558 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:10.588 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:38:10.591 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:10.591 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:38:10.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:10 smithi022 ceph-mon[39439]: pgmap v985: 17 pgs: 1 active+clean+remapped, 1 peering, 15 active+clean; 3.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 563 op/s; 13 MiB/s, 202 objects/s recovering 2024-04-01T19:38:10.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:10 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3948135146' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:38:10.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:10 smithi022 ceph-mon[39439]: from='client.35825 ' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:38:10.692 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:38:10.731 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:10.755 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:38:10.769 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:10.769 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:38:10.870 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:38:10.905 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:10.930 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:38:10.933 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:10.933 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:38:11.034 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:38:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:11.142 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:38:11.149 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:11.150 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:38:11.251 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:38:11.287 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:11.313 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:38:11.316 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:11.316 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:38:11.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:11 smithi022 ceph-mon[39439]: 4.a scrub starts 2024-04-01T19:38:11.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:11 smithi022 ceph-mon[39439]: 4.d scrub starts 2024-04-01T19:38:11.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:11 smithi022 ceph-mon[39439]: from='client.35825 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]': finished 2024-04-01T19:38:11.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:11 smithi022 ceph-mon[39439]: osdmap e347: 12 total, 12 up, 12 in 2024-04-01T19:38:11.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:11 smithi022 ceph-mon[39439]: 4.a scrub ok 2024-04-01T19:38:11.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:11 smithi022 ceph-mon[39439]: 4.d scrub ok 2024-04-01T19:38:11.417 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:38:11.450 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:11.452 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:11 smithi188 ceph-mon[43939]: 4.a scrub starts 2024-04-01T19:38:11.452 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:11 smithi188 ceph-mon[43939]: 4.d scrub starts 2024-04-01T19:38:11.452 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:11 smithi188 ceph-mon[43939]: from='client.35825 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]': finished 2024-04-01T19:38:11.452 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:11 smithi188 ceph-mon[43939]: osdmap e347: 12 total, 12 up, 12 in 2024-04-01T19:38:11.452 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:11 smithi188 ceph-mon[43939]: 4.a scrub ok 2024-04-01T19:38:11.452 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:11 smithi188 ceph-mon[43939]: 4.d scrub ok 2024-04-01T19:38:11.479 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:38:11.485 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:11.485 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:38:11.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:11 smithi062 ceph-mon[44211]: 4.a scrub starts 2024-04-01T19:38:11.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:11 smithi062 ceph-mon[44211]: 4.d scrub starts 2024-04-01T19:38:11.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:11 smithi062 ceph-mon[44211]: from='client.35825 ' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]': finished 2024-04-01T19:38:11.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:11 smithi062 ceph-mon[44211]: osdmap e347: 12 total, 12 up, 12 in 2024-04-01T19:38:11.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:11 smithi062 ceph-mon[44211]: 4.a scrub ok 2024-04-01T19:38:11.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:11 smithi062 ceph-mon[44211]: 4.d scrub ok 2024-04-01T19:38:11.586 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:38:11.638 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:12.199 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:38:12.205 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:12.206 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:38:12.307 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:38:12.339 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:12.358 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:12 smithi022 ceph-mon[39439]: pgmap v987: 17 pgs: 17 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 553 op/s; 11 MiB/s, 168 objects/s recovering 2024-04-01T19:38:12.364 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:38:12.372 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:12.372 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:38:12.473 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:38:12.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:12 smithi062 ceph-mon[44211]: pgmap v987: 17 pgs: 17 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 553 op/s; 11 MiB/s, 168 objects/s recovering 2024-04-01T19:38:12.526 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:12 smithi188 ceph-mon[43939]: pgmap v987: 17 pgs: 17 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 553 op/s; 11 MiB/s, 168 objects/s recovering 2024-04-01T19:38:12.873 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:38:12.897 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:38:12.901 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:12.902 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:38:13.003 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:38:13.009 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:38:13.009 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:38:13.010 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:38:13.040 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:13.045 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:38:13.064 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:38:13.067 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:13.068 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:38:13.091 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:38:13.136 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:38:13.169 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:38:13.190 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:38:13.201 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:13.205 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:13 smithi022 ceph-mon[39439]: 4.7 scrub starts 2024-04-01T19:38:13.205 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:13 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2513570926' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:38:13.205 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:13.205 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:13.205 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:13.226 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:38:13.228 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:38:13.232 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:13.233 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:38:13.263 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:38:13.298 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:38:13.329 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:38:13.333 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:38:13.360 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:13 smithi188 ceph-mon[43939]: 4.7 scrub starts 2024-04-01T19:38:13.361 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:13 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2513570926' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:38:13.361 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:13.361 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:13.361 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:13.364 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:13.378 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:38:13.387 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:38:13.388 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:38:13.388 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:38:13.388 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:38:13.388 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:38:13.388 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:38:13.388 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:38:13.388 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:38:13.388 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:38:13.388 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:38:13.388 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:38:13.388 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:38:13.395 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:38:13.406 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:13.407 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:38:13.508 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:38:13.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:13 smithi062 ceph-mon[44211]: 4.7 scrub starts 2024-04-01T19:38:13.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:13 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2513570926' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:38:13.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:13.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:13.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:13.564 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:13.657 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:38:13.660 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:13.660 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:38:13.761 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:38:13.791 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:13.821 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:38:13.825 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:13.826 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:38:13.927 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:38:13.973 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:14.215 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:38:14.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:14 smithi062 ceph-mon[44211]: 4.7 scrub ok 2024-04-01T19:38:14.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:14 smithi062 ceph-mon[44211]: pgmap v988: 17 pgs: 17 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 754 op/s; 8.5 MiB/s, 135 objects/s recovering 2024-04-01T19:38:14.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:14 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:38:14.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:14 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:38:14.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:14 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4157682241' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:38:14.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:14 smithi062 ceph-mon[44211]: from='client.25738 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:38:14.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:14 smithi062 ceph-mon[44211]: 4.8 scrub starts 2024-04-01T19:38:14.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:14 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:38:14.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:14 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:38:14.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:14 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:38:14.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:14 smithi022 ceph-mon[39439]: 4.7 scrub ok 2024-04-01T19:38:14.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:14 smithi022 ceph-mon[39439]: pgmap v988: 17 pgs: 17 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 754 op/s; 8.5 MiB/s, 135 objects/s recovering 2024-04-01T19:38:14.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:14 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:38:14.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:14 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:38:14.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:14 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4157682241' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:38:14.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:14 smithi022 ceph-mon[39439]: from='client.25738 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:38:14.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:14 smithi022 ceph-mon[39439]: 4.8 scrub starts 2024-04-01T19:38:14.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:14 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:38:14.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:14 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:38:14.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:14 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:38:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:14 smithi188 ceph-mon[43939]: 4.7 scrub ok 2024-04-01T19:38:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:14 smithi188 ceph-mon[43939]: pgmap v988: 17 pgs: 17 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 754 op/s; 8.5 MiB/s, 135 objects/s recovering 2024-04-01T19:38:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:14 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:38:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:14 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:38:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:14 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4157682241' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:38:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:14 smithi188 ceph-mon[43939]: from='client.25738 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:38:14.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:14.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:14 smithi188 ceph-mon[43939]: 4.8 scrub starts 2024-04-01T19:38:14.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:14 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:38:14.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:14 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:38:14.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:14 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:38:15.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:15 smithi062 ceph-mon[44211]: from='client.25738 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:38:15.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:15 smithi062 ceph-mon[44211]: osdmap e348: 12 total, 12 up, 12 in 2024-04-01T19:38:15.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:15 smithi022 ceph-mon[39439]: from='client.25738 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:38:15.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:15 smithi022 ceph-mon[39439]: osdmap e348: 12 total, 12 up, 12 in 2024-04-01T19:38:15.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:15 smithi188 ceph-mon[43939]: from='client.25738 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:38:15.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:15 smithi188 ceph-mon[43939]: osdmap e348: 12 total, 12 up, 12 in 2024-04-01T19:38:16.168 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 9, 10, 11, 8, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 7, 9, 10, 11, 8, 6] 2024-04-01T19:38:16.168 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-01T19:38:16.169 INFO:tasks.thrashosds.thrasher:Removing osd 8, in_osds are: [0, 1, 2, 3, 4, 5, 7, 9, 10, 11, 8, 6] 2024-04-01T19:38:16.169 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd out 8 2024-04-01T19:38:16.438 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:38:16.442 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:16.443 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:38:16.489 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:16 smithi022 ceph-mon[39439]: pgmap v990: 17 pgs: 17 active+clean; 3.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 773 op/s 2024-04-01T19:38:16.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:16 smithi062 ceph-mon[44211]: pgmap v990: 17 pgs: 17 active+clean; 3.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 773 op/s 2024-04-01T19:38:16.544 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:38:16.580 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:16.604 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:38:16.606 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:16.607 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:38:16.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:16 smithi188 ceph-mon[43939]: pgmap v990: 17 pgs: 17 active+clean; 3.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 773 op/s 2024-04-01T19:38:16.703 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:38:16.707 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:38:16.746 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:16.775 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:38:16.778 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:16.779 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:38:16.794 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:38:16.815 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:38:16.815 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:38:16.879 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:38:16.909 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:16.932 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:38:16.935 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:16.935 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:38:17.036 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:38:17.086 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:17.122 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:38:17.125 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:17.126 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:38:17.227 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:38:17.262 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:17.289 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:38:17.292 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:17.293 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:38:17.394 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:38:17.459 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:18.254 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:38:18.261 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:18.262 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:38:18.285 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_ops_in_flight 2024-04-01T19:38:18.287 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:38:18.363 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:38:18.397 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:38:18.467 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:18.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:18 smithi062 ceph-mon[44211]: pgmap v991: 17 pgs: 17 active+clean; 3.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:38:18.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:18 smithi022 ceph-mon[39439]: pgmap v991: 17 pgs: 17 active+clean; 3.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:38:18.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:18 smithi188 ceph-mon[43939]: pgmap v991: 17 pgs: 17 active+clean; 3.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:38:18.697 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:38:18.702 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:18.703 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:38:18.804 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:38:18.834 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:18.862 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:38:18.865 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:18.866 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:38:18.967 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:38:19.005 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:19.262 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:38:19.266 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:19.267 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:38:19.368 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:38:19.410 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:19.447 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:38:19.454 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:19.454 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:38:19.555 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:38:19.588 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:19.622 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:38:19.624 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:19.625 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:38:19.726 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:38:19.775 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:19.987 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:38:19.993 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:19.994 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:38:20.095 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:38:20.138 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:20.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:20 smithi022 ceph-mon[39439]: pgmap v992: 17 pgs: 17 active+clean; 3.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:38:20.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:20 smithi188 ceph-mon[43939]: pgmap v992: 17 pgs: 17 active+clean; 3.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:38:20.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:20 smithi062 ceph-mon[44211]: pgmap v992: 17 pgs: 17 active+clean; 3.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:38:20.806 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:38:20.822 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:20.823 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:38:20.845 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:38:20.846 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:38:20.923 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:38:20.975 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:21.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:20 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[39416]: 2024-04-01T19:38:20.780+0000 7fd025a9f700 -1 mon.a@0(leader).osd e348 definitely_dead 0 2024-04-01T19:38:21.295 INFO:teuthology.orchestra.run.smithi022.stderr:marked out osd.8. 2024-04-01T19:38:21.353 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:38:21.356 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:21.357 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:38:21.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:21 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/741775931' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["8"]}]: dispatch 2024-04-01T19:38:21.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:21 smithi022 ceph-mon[39439]: Client client.admin marked osd.8 out, while it was still marked up 2024-04-01T19:38:21.458 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:38:21.496 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:21.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:21 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/741775931' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["8"]}]: dispatch 2024-04-01T19:38:21.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:21 smithi188 ceph-mon[43939]: Client client.admin marked osd.8 out, while it was still marked up 2024-04-01T19:38:21.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:21 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/741775931' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["8"]}]: dispatch 2024-04-01T19:38:21.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:21 smithi062 ceph-mon[44211]: Client client.admin marked osd.8 out, while it was still marked up 2024-04-01T19:38:22.605 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:22 smithi022 ceph-mon[39439]: pgmap v993: 17 pgs: 17 active+clean; 3.0 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:38:22.605 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:22 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/741775931' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["8"]}]': finished 2024-04-01T19:38:22.605 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:22 smithi022 ceph-mon[39439]: osdmap e349: 12 total, 12 up, 11 in 2024-04-01T19:38:22.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:22 smithi188 ceph-mon[43939]: pgmap v993: 17 pgs: 17 active+clean; 3.0 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:38:22.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:22 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/741775931' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["8"]}]': finished 2024-04-01T19:38:22.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:22 smithi188 ceph-mon[43939]: osdmap e349: 12 total, 12 up, 11 in 2024-04-01T19:38:22.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:22 smithi062 ceph-mon[44211]: pgmap v993: 17 pgs: 17 active+clean; 3.0 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:38:22.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:22 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/741775931' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["8"]}]': finished 2024-04-01T19:38:22.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:22 smithi062 ceph-mon[44211]: osdmap e349: 12 total, 12 up, 11 in 2024-04-01T19:38:22.879 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:38:22.882 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:22.883 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:38:22.984 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:38:23.018 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:23.388 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:38:23.391 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:23.392 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:38:23.493 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:38:23.522 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:23.544 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:38:23.550 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:23.550 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:38:23.651 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:38:23.682 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:23.704 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:38:23.708 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:23.708 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:38:23.809 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:38:23.842 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:23.863 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:38:23.868 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:23.868 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:38:23.943 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:38:23.943 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:38:23.944 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:38:23.944 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:38:23.944 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:38:23.944 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:38:23.944 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:38:23.963 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:38:23.969 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:38:24.006 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:38:24.031 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:24.036 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:38:24.074 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:38:24.107 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:38:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:38:24.109 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:38:24.109 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:38:24.109 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:38:24.109 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:38:24.109 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:38:24.109 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:38:24.109 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:38:24.109 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:38:24.109 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:38:24.109 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:38:24.109 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:38:24.302 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:38:24.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:24 smithi022 ceph-mon[39439]: pgmap v995: 17 pgs: 17 active+clean; 2.8 GiB data, 8.5 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 1.40k op/s 2024-04-01T19:38:24.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:24 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2067679093' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:38:24.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:24.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:24.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:24.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:24.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:24.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:24 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/338706375' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:38:24.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:24 smithi188 ceph-mon[43939]: pgmap v995: 17 pgs: 17 active+clean; 2.8 GiB data, 8.5 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 1.40k op/s 2024-04-01T19:38:24.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:24 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2067679093' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:38:24.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:24.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:24.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:24.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:24.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:24.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:24 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/338706375' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:38:24.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:24 smithi062 ceph-mon[44211]: pgmap v995: 17 pgs: 17 active+clean; 2.8 GiB data, 8.5 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 1.40k op/s 2024-04-01T19:38:24.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:24 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2067679093' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:38:24.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:24.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:24.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:24.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:24.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:24.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:24 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/338706375' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:38:25.029 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:38:25.042 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:25.043 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:38:25.143 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:38:25.198 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:25.316 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:25.316 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:25.316 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:25.316 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:25.316 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:25.316 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:25.316 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:25.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:25 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:38:25.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:25 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/338706375' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:38:25.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:25 smithi022 ceph-mon[39439]: osdmap e350: 12 total, 12 up, 11 in 2024-04-01T19:38:25.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:25.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:25.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:25.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:25.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:25.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:25.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:25.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:25 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:38:25.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:25 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/338706375' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:38:25.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:25 smithi188 ceph-mon[43939]: osdmap e350: 12 total, 12 up, 11 in 2024-04-01T19:38:25.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:25.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:25.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:25.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:25.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:25.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:25.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:25.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:25 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:38:25.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:25 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/338706375' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:38:25.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:25 smithi062 ceph-mon[44211]: osdmap e350: 12 total, 12 up, 11 in 2024-04-01T19:38:26.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:26 smithi022 ceph-mon[39439]: pgmap v997: 17 pgs: 17 active+clean; 2.7 GiB data, 8.3 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 955 op/s 2024-04-01T19:38:26.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:26 smithi188 ceph-mon[43939]: pgmap v997: 17 pgs: 17 active+clean; 2.7 GiB data, 8.3 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 955 op/s 2024-04-01T19:38:26.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:26 smithi062 ceph-mon[44211]: pgmap v997: 17 pgs: 17 active+clean; 2.7 GiB data, 8.3 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 955 op/s 2024-04-01T19:38:27.877 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:38:27.885 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:27.885 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:38:27.986 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:38:28.018 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:28.043 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:38:28.047 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:28.047 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:38:28.148 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:38:28.200 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:28.326 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:28 smithi188 ceph-mon[43939]: pgmap v998: 17 pgs: 17 active+clean; 2.4 GiB data, 7.9 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.50k op/s 2024-04-01T19:38:28.538 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:38:28.538 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:38:28.538 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:28.538 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25465.0:308081 4.4 e350/267 4:232b30b3:::benchmark_data_smithi188_104537_object136087:head v 350'19267, mlcod=350'19265)", 2024-04-01T19:38:28.538 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:28.537901+0000", 2024-04-01T19:38:28.538 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0022269619999999999, 2024-04-01T19:38:28.538 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0022616479999999998, 2024-04-01T19:38:28.539 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:38:28.539 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:38:28.539 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:38:28.539 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:38:28.539 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:28.539 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:38:28.539 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:28.537901+0000", 2024-04-01T19:38:28.539 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:38:28.539 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:28.539 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:28.539 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:38:28.539 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:28.537901+0000", 2024-04-01T19:38:28.539 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:38:28.539 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:28.539 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:28.540 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:38:28.540 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:28.537903+0000", 2024-04-01T19:38:28.540 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.677e-06 2024-04-01T19:38:28.540 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:28.540 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:28.540 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:38:28.540 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:28.537912+0000", 2024-04-01T19:38:28.540 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.9959999999999999e-06 2024-04-01T19:38:28.540 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:28.540 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:28.540 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:38:28.540 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:28.537923+0000", 2024-04-01T19:38:28.540 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1606e-05 2024-04-01T19:38:28.540 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:28.540 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:28.540 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:38:28.541 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:28.537930+0000", 2024-04-01T19:38:28.541 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0149999999999998e-06 2024-04-01T19:38:28.541 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:28.541 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:28.541 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:38:28.541 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:28.537979+0000", 2024-04-01T19:38:28.541 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8980999999999997e-05 2024-04-01T19:38:28.541 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:28.541 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:28.541 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:38:28.541 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:28.537994+0000", 2024-04-01T19:38:28.541 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4498000000000001e-05 2024-04-01T19:38:28.541 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:28.541 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:28.541 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:28.541 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:28.542 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T19:38:28.542 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 1 2024-04-01T19:38:28.542 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:38:28.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:28 smithi022 ceph-mon[39439]: pgmap v998: 17 pgs: 17 active+clean; 2.4 GiB data, 7.9 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.50k op/s 2024-04-01T19:38:28.569 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:38:28.573 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:28.574 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:38:28.675 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:38:28.729 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:28.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:28 smithi062 ceph-mon[44211]: pgmap v998: 17 pgs: 17 active+clean; 2.4 GiB data, 7.9 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.50k op/s 2024-04-01T19:38:28.796 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:38:28.800 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:28.800 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:38:28.848 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:38:28.901 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:38:28.987 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:29.323 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_blocked_ops 2024-04-01T19:38:29.351 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:38:29.354 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:29.355 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:38:29.407 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:38:29.456 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:38:29.490 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:29.513 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:38:29.515 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:29.516 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:38:29.529 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:38:29.616 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:38:29.644 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:29.674 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:38:29.676 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:29.677 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:38:29.777 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:38:29.815 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:29.846 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:38:29.849 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:29.849 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:38:29.950 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:38:30.018 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:30.081 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 9, 10, 11, 6] out_osds: [8] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 7, 9, 10, 11, 8, 6] 2024-04-01T19:38:30.081 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-01T19:38:30.082 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-01T19:38:30.082 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd dump -f json-pretty 2024-04-01T19:38:30.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:30 smithi022 ceph-mon[39439]: pgmap v999: 17 pgs: 17 active+clean; 2.4 GiB data, 7.7 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:38:30.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:30 smithi188 ceph-mon[43939]: pgmap v999: 17 pgs: 17 active+clean; 2.4 GiB data, 7.7 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:38:30.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:30 smithi062 ceph-mon[44211]: pgmap v999: 17 pgs: 17 active+clean; 2.4 GiB data, 7.7 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:38:30.949 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:38:30.952 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:38:30.996 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:38:31.002 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:31.003 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:38:31.104 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:38:31.139 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:31.167 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:38:31.172 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:31.172 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:38:31.273 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:38:31.310 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:31.338 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:38:31.341 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:31.342 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:38:31.443 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:38:31.475 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:31.499 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:38:31.502 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:31.502 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:38:31.603 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:38:31.639 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:31.667 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:38:31.673 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:31.673 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:38:31.774 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:38:31.826 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:31.925 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:38:31.931 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:31.931 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:38:32.032 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:38:32.077 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:32.190 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:38:32.196 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:32.197 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:38:32.297 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:38:32.375 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:32.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:32 smithi022 ceph-mon[39439]: pgmap v1000: 17 pgs: 17 active+clean; 2.2 GiB data, 7.3 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:38:32.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:32 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:38:32.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:32 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:38:32.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:32 smithi022 ceph-mon[39439]: osdmap e351: 12 total, 12 up, 11 in 2024-04-01T19:38:32.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:38:32.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:32 smithi062 ceph-mon[44211]: pgmap v1000: 17 pgs: 17 active+clean; 2.2 GiB data, 7.3 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:38:32.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:32 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:38:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:32 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:38:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:32 smithi062 ceph-mon[44211]: osdmap e351: 12 total, 12 up, 11 in 2024-04-01T19:38:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:38:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:32 smithi188 ceph-mon[43939]: pgmap v1000: 17 pgs: 17 active+clean; 2.2 GiB data, 7.3 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:38:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:32 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:38:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:32 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:38:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:32 smithi188 ceph-mon[43939]: osdmap e351: 12 total, 12 up, 11 in 2024-04-01T19:38:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:38:33.141 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:38:33.149 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:33.150 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:38:33.251 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:38:33.292 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:33.327 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:38:33.330 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:33.330 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:38:33.431 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:38:33.474 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:33.573 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:38:33.580 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:33.580 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:38:33.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:33 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:38:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:33 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:38:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:33 smithi188 ceph-mon[43939]: osdmap e352: 12 total, 12 up, 11 in 2024-04-01T19:38:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:38:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:38:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:33 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:38:33.681 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:38:33.692 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:38:33.717 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:33 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:38:33.717 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:33 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:38:33.717 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:33 smithi022 ceph-mon[39439]: osdmap e352: 12 total, 12 up, 11 in 2024-04-01T19:38:33.717 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:38:33.717 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:38:33.717 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:33 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:38:33.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:33 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:38:33.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:33 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:38:33.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:33 smithi062 ceph-mon[44211]: osdmap e352: 12 total, 12 up, 11 in 2024-04-01T19:38:33.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:38:33.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:38:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:33 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:38:33.762 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:33.972 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:38:33.980 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:33.980 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:38:34.081 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:38:34.152 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:34.181 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:38:34.188 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:34.188 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:38:34.289 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:38:34.345 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:34.407 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:38:34.453 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:38:34.490 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:38:34.549 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:38:34.586 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:38:34.618 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:38:34.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:34 smithi022 ceph-mon[39439]: pgmap v1003: 17 pgs: 17 active+clean; 2.0 GiB data, 7.0 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.42k op/s 2024-04-01T19:38:34.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:34 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1477315346' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:38:34.637 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:38:34.645 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:34.645 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:38:34.654 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:38:34.691 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:38:34.727 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:38:34.746 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:38:34.755 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:38:34.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:34 smithi062 ceph-mon[44211]: pgmap v1003: 17 pgs: 17 active+clean; 2.0 GiB data, 7.0 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.42k op/s 2024-04-01T19:38:34.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:34 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1477315346' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:38:34.783 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:34.788 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:38:34.815 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:38:34.818 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:34.818 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:38:34.819 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:38:34.831 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:38:34.831 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:38:34.831 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:38:34.831 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:38:34.831 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:38:34.831 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:38:34.831 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:38:34.831 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:38:34.831 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:38:34.831 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:38:34.831 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:38:34.831 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:38:34.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:34 smithi188 ceph-mon[43939]: pgmap v1003: 17 pgs: 17 active+clean; 2.0 GiB data, 7.0 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.42k op/s 2024-04-01T19:38:34.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:34 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1477315346' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:38:34.919 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:38:34.947 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:34.974 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:38:34.977 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:34.977 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:38:35.078 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:38:35.108 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:35.136 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:38:35.141 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:35.141 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:38:35.242 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:38:35.275 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:35.301 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:38:35.303 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:35.304 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:38:35.405 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:38:35.437 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:35.460 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:38:35.463 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:35.463 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:38:35.525 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.525 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.525 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.525 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.525 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.525 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.525 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:35 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3452830048' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:38:35.525 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.525 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.526 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.527 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:38:35.555 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.555 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.555 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.555 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.555 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.555 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.555 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:35 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3452830048' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:38:35.555 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.555 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.555 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.564 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:38:35.593 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:35.627 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:38:35.632 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:35.632 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:38:35.733 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:38:35.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:35 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3452830048' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:38:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:35.778 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:35.806 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:38:35.809 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:35.809 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:38:35.910 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:38:35.946 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:35.981 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:38:35.987 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:35.987 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:38:36.088 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:38:36.124 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:36.153 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:38:36.156 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:36.157 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:38:36.258 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:38:36.289 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:36.316 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:38:36.318 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:36.318 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:38:36.341 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:38:36.341 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:38:36.419 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:38:36.454 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:36.480 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:38:36.486 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:36.487 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:38:36.523 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:36 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:36.523 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:36 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:36.523 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:36 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:36.523 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:36 smithi022 ceph-mon[39439]: pgmap v1004: 17 pgs: 17 active+clean; 2.0 GiB data, 6.8 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 967 op/s 2024-04-01T19:38:36.523 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:36 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:38:36.523 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:36 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3452830048' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:38:36.524 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:36 smithi022 ceph-mon[39439]: osdmap e353: 12 total, 12 up, 11 in 2024-04-01T19:38:36.588 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:38:36.640 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:36.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:36 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:36.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:36 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:36.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:36 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:36.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:36 smithi062 ceph-mon[44211]: pgmap v1004: 17 pgs: 17 active+clean; 2.0 GiB data, 6.8 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 967 op/s 2024-04-01T19:38:36.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:36 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:38:36.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:36 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3452830048' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:38:36.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:36 smithi062 ceph-mon[44211]: osdmap e353: 12 total, 12 up, 11 in 2024-04-01T19:38:36.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:36 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:36.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:36 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:36.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:36 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:36.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:36 smithi188 ceph-mon[43939]: pgmap v1004: 17 pgs: 17 active+clean; 2.0 GiB data, 6.8 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 967 op/s 2024-04-01T19:38:36.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:36 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:38:36.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:36 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3452830048' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:38:36.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:36 smithi188 ceph-mon[43939]: osdmap e353: 12 total, 12 up, 11 in 2024-04-01T19:38:38.526 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:38 smithi022 ceph-mon[39439]: 4.5 scrub starts 2024-04-01T19:38:38.526 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:38 smithi022 ceph-mon[39439]: 4.5 scrub ok 2024-04-01T19:38:38.527 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:38 smithi022 ceph-mon[39439]: pgmap v1006: 17 pgs: 17 active+clean; 1.7 GiB data, 6.4 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.46k op/s 2024-04-01T19:38:38.527 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:38 smithi022 ceph-mon[39439]: 4.f scrub starts 2024-04-01T19:38:38.527 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:38 smithi022 ceph-mon[39439]: 4.f scrub ok 2024-04-01T19:38:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:38 smithi188 ceph-mon[43939]: 4.5 scrub starts 2024-04-01T19:38:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:38 smithi188 ceph-mon[43939]: 4.5 scrub ok 2024-04-01T19:38:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:38 smithi188 ceph-mon[43939]: pgmap v1006: 17 pgs: 17 active+clean; 1.7 GiB data, 6.4 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.46k op/s 2024-04-01T19:38:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:38 smithi188 ceph-mon[43939]: 4.f scrub starts 2024-04-01T19:38:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:38 smithi188 ceph-mon[43939]: 4.f scrub ok 2024-04-01T19:38:39.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:38 smithi062 ceph-mon[44211]: 4.5 scrub starts 2024-04-01T19:38:39.074 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:38 smithi062 ceph-mon[44211]: 4.5 scrub ok 2024-04-01T19:38:39.074 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:38 smithi062 ceph-mon[44211]: pgmap v1006: 17 pgs: 17 active+clean; 1.7 GiB data, 6.4 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.46k op/s 2024-04-01T19:38:39.074 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:38 smithi062 ceph-mon[44211]: 4.f scrub starts 2024-04-01T19:38:39.074 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:38 smithi062 ceph-mon[44211]: 4.f scrub ok 2024-04-01T19:38:40.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:40 smithi022 ceph-mon[39439]: pgmap v1007: 17 pgs: 17 active+clean; 1.7 GiB data, 6.2 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 996 op/s 2024-04-01T19:38:40.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:40 smithi022 ceph-mon[39439]: 4.8 scrub starts 2024-04-01T19:38:40.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:40 smithi022 ceph-mon[39439]: 4.8 scrub ok 2024-04-01T19:38:40.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:40 smithi188 ceph-mon[43939]: pgmap v1007: 17 pgs: 17 active+clean; 1.7 GiB data, 6.2 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 996 op/s 2024-04-01T19:38:40.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:40 smithi188 ceph-mon[43939]: 4.8 scrub starts 2024-04-01T19:38:40.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:40 smithi188 ceph-mon[43939]: 4.8 scrub ok 2024-04-01T19:38:41.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:40 smithi062 ceph-mon[44211]: pgmap v1007: 17 pgs: 17 active+clean; 1.7 GiB data, 6.2 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 996 op/s 2024-04-01T19:38:41.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:40 smithi062 ceph-mon[44211]: 4.8 scrub starts 2024-04-01T19:38:41.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:40 smithi062 ceph-mon[44211]: 4.8 scrub ok 2024-04-01T19:38:41.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:41 smithi022 ceph-mon[39439]: 4.9 scrub starts 2024-04-01T19:38:41.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:41 smithi022 ceph-mon[39439]: 4.9 scrub ok 2024-04-01T19:38:41.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:41 smithi022 ceph-mon[39439]: 4.e scrub starts 2024-04-01T19:38:41.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:41 smithi188 ceph-mon[43939]: 4.9 scrub starts 2024-04-01T19:38:41.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:41 smithi188 ceph-mon[43939]: 4.9 scrub ok 2024-04-01T19:38:41.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:41 smithi188 ceph-mon[43939]: 4.e scrub starts 2024-04-01T19:38:42.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:41 smithi062 ceph-mon[44211]: 4.9 scrub starts 2024-04-01T19:38:42.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:41 smithi062 ceph-mon[44211]: 4.9 scrub ok 2024-04-01T19:38:42.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:41 smithi062 ceph-mon[44211]: 4.e scrub starts 2024-04-01T19:38:42.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:42 smithi022 ceph-mon[39439]: pgmap v1008: 17 pgs: 17 active+clean; 1.5 GiB data, 5.9 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.11k op/s 2024-04-01T19:38:42.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:42 smithi022 ceph-mon[39439]: 4.6 scrub starts 2024-04-01T19:38:42.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:42 smithi022 ceph-mon[39439]: 4.e scrub ok 2024-04-01T19:38:42.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:42 smithi022 ceph-mon[39439]: 4.6 scrub ok 2024-04-01T19:38:42.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:42 smithi188 ceph-mon[43939]: pgmap v1008: 17 pgs: 17 active+clean; 1.5 GiB data, 5.9 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.11k op/s 2024-04-01T19:38:42.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:42 smithi188 ceph-mon[43939]: 4.6 scrub starts 2024-04-01T19:38:42.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:42 smithi188 ceph-mon[43939]: 4.e scrub ok 2024-04-01T19:38:42.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:42 smithi188 ceph-mon[43939]: 4.6 scrub ok 2024-04-01T19:38:43.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:42 smithi062 ceph-mon[44211]: pgmap v1008: 17 pgs: 17 active+clean; 1.5 GiB data, 5.9 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.11k op/s 2024-04-01T19:38:43.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:42 smithi062 ceph-mon[44211]: 4.6 scrub starts 2024-04-01T19:38:43.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:42 smithi062 ceph-mon[44211]: 4.e scrub ok 2024-04-01T19:38:43.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:42 smithi062 ceph-mon[44211]: 4.6 scrub ok 2024-04-01T19:38:43.802 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:38:43.865 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:43.866 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:38:43.967 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:38:43.998 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:44.022 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:38:44.024 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:44.025 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:38:44.050 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_historic_ops 2024-04-01T19:38:44.126 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:38:44.165 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:44.204 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:38:44.209 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:44.209 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:38:44.310 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:38:44.340 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:44.366 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:38:44.371 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:44.371 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:38:44.472 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:38:44.502 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:44.527 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:38:44.532 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:44.533 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:38:44.634 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:38:44.703 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:44 smithi022 ceph-mon[39439]: pgmap v1009: 17 pgs: 17 active+clean; 1.3 GiB data, 5.6 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:38:44.704 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:44.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:44 smithi062 ceph-mon[44211]: pgmap v1009: 17 pgs: 17 active+clean; 1.3 GiB data, 5.6 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:38:44.813 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:38:44.827 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:44.827 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:38:44.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:44 smithi188 ceph-mon[43939]: pgmap v1009: 17 pgs: 17 active+clean; 1.3 GiB data, 5.6 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:38:44.928 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:38:44.982 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:45.089 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:38:45.089 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:38:45.090 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 353, 2024-04-01T19:38:45.090 INFO:teuthology.orchestra.run.smithi022.stdout: "fsid": "09f6b846-f05c-11ee-b647-cb9ed24678a4", 2024-04-01T19:38:45.090 INFO:teuthology.orchestra.run.smithi022.stdout: "created": "2024-04-01T19:15:34.344221+0000", 2024-04-01T19:38:45.090 INFO:teuthology.orchestra.run.smithi022.stdout: "modified": "2024-04-01T19:38:35.511502+0000", 2024-04-01T19:38:45.090 INFO:teuthology.orchestra.run.smithi022.stdout: "last_up_change": "2024-04-01T19:37:45.832405+0000", 2024-04-01T19:38:45.090 INFO:teuthology.orchestra.run.smithi022.stdout: "last_in_change": "2024-04-01T19:38:21.274265+0000", 2024-04-01T19:38:45.090 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-01T19:38:45.090 INFO:teuthology.orchestra.run.smithi022.stdout: "flags_num": 5804032, 2024-04-01T19:38:45.090 INFO:teuthology.orchestra.run.smithi022.stdout: "flags_set": [ 2024-04-01T19:38:45.090 INFO:teuthology.orchestra.run.smithi022.stdout: "nodeep-scrub", 2024-04-01T19:38:45.090 INFO:teuthology.orchestra.run.smithi022.stdout: "pglog_hardlimit", 2024-04-01T19:38:45.090 INFO:teuthology.orchestra.run.smithi022.stdout: "purged_snapdirs", 2024-04-01T19:38:45.091 INFO:teuthology.orchestra.run.smithi022.stdout: "recovery_deletes", 2024-04-01T19:38:45.091 INFO:teuthology.orchestra.run.smithi022.stdout: "sortbitwise" 2024-04-01T19:38:45.091 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T19:38:45.091 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_version": 29, 2024-04-01T19:38:45.091 INFO:teuthology.orchestra.run.smithi022.stdout: "full_ratio": 0.94999998807907104, 2024-04-01T19:38:45.091 INFO:teuthology.orchestra.run.smithi022.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-01T19:38:45.091 INFO:teuthology.orchestra.run.smithi022.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-01T19:38:45.091 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_snapshot": "", 2024-04-01T19:38:45.091 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_max": 4, 2024-04-01T19:38:45.091 INFO:teuthology.orchestra.run.smithi022.stdout: "max_osd": 12, 2024-04-01T19:38:45.091 INFO:teuthology.orchestra.run.smithi022.stdout: "require_min_compat_client": "luminous", 2024-04-01T19:38:45.091 INFO:teuthology.orchestra.run.smithi022.stdout: "min_compat_client": "jewel", 2024-04-01T19:38:45.091 INFO:teuthology.orchestra.run.smithi022.stdout: "require_osd_release": "squid", 2024-04-01T19:38:45.091 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_crimson": false, 2024-04-01T19:38:45.091 INFO:teuthology.orchestra.run.smithi022.stdout: "pools": [ 2024-04-01T19:38:45.092 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.092 INFO:teuthology.orchestra.run.smithi022.stdout: "pool": 1, 2024-04-01T19:38:45.092 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_name": ".mgr", 2024-04-01T19:38:45.092 INFO:teuthology.orchestra.run.smithi022.stdout: "create_time": "2024-04-01T19:18:34.605751+0000", 2024-04-01T19:38:45.092 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-04-01T19:38:45.092 INFO:teuthology.orchestra.run.smithi022.stdout: "flags_names": "hashpspool", 2024-04-01T19:38:45.092 INFO:teuthology.orchestra.run.smithi022.stdout: "type": 1, 2024-04-01T19:38:45.092 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 2, 2024-04-01T19:38:45.092 INFO:teuthology.orchestra.run.smithi022.stdout: "min_size": 2, 2024-04-01T19:38:45.092 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_rule": 0, 2024-04-01T19:38:45.092 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_count": 0, 2024-04-01T19:38:45.092 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_target": 0, 2024-04-01T19:38:45.092 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_barrier": 0, 2024-04-01T19:38:45.092 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-01T19:38:45.092 INFO:teuthology.orchestra.run.smithi022.stdout: "object_hash": 2, 2024-04-01T19:38:45.093 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscale_mode": "off", 2024-04-01T19:38:45.093 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num": 1, 2024-04-01T19:38:45.093 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_placement_num": 1, 2024-04-01T19:38:45.093 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_placement_num_target": 1, 2024-04-01T19:38:45.093 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num_target": 1, 2024-04-01T19:38:45.093 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num_pending": 1, 2024-04-01T19:38:45.093 INFO:teuthology.orchestra.run.smithi022.stdout: "last_pg_merge_meta": { 2024-04-01T19:38:45.093 INFO:teuthology.orchestra.run.smithi022.stdout: "source_pgid": "0.0", 2024-04-01T19:38:45.093 INFO:teuthology.orchestra.run.smithi022.stdout: "ready_epoch": 0, 2024-04-01T19:38:45.093 INFO:teuthology.orchestra.run.smithi022.stdout: "last_epoch_started": 0, 2024-04-01T19:38:45.093 INFO:teuthology.orchestra.run.smithi022.stdout: "last_epoch_clean": 0, 2024-04-01T19:38:45.093 INFO:teuthology.orchestra.run.smithi022.stdout: "source_version": "0'0", 2024-04-01T19:38:45.093 INFO:teuthology.orchestra.run.smithi022.stdout: "target_version": "0'0" 2024-04-01T19:38:45.093 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.093 INFO:teuthology.orchestra.run.smithi022.stdout: "last_change": "16", 2024-04-01T19:38:45.094 INFO:teuthology.orchestra.run.smithi022.stdout: "last_force_op_resend": "0", 2024-04-01T19:38:45.094 INFO:teuthology.orchestra.run.smithi022.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-01T19:38:45.094 INFO:teuthology.orchestra.run.smithi022.stdout: "last_force_op_resend_preluminous": "0", 2024-04-01T19:38:45.094 INFO:teuthology.orchestra.run.smithi022.stdout: "auid": 0, 2024-04-01T19:38:45.094 INFO:teuthology.orchestra.run.smithi022.stdout: "snap_mode": "selfmanaged", 2024-04-01T19:38:45.094 INFO:teuthology.orchestra.run.smithi022.stdout: "snap_seq": 0, 2024-04-01T19:38:45.094 INFO:teuthology.orchestra.run.smithi022.stdout: "snap_epoch": 0, 2024-04-01T19:38:45.094 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_snaps": [], 2024-04-01T19:38:45.094 INFO:teuthology.orchestra.run.smithi022.stdout: "removed_snaps": "[]", 2024-04-01T19:38:45.094 INFO:teuthology.orchestra.run.smithi022.stdout: "quota_max_bytes": 0, 2024-04-01T19:38:45.094 INFO:teuthology.orchestra.run.smithi022.stdout: "quota_max_objects": 0, 2024-04-01T19:38:45.094 INFO:teuthology.orchestra.run.smithi022.stdout: "tiers": [], 2024-04-01T19:38:45.094 INFO:teuthology.orchestra.run.smithi022.stdout: "tier_of": -1, 2024-04-01T19:38:45.094 INFO:teuthology.orchestra.run.smithi022.stdout: "read_tier": -1, 2024-04-01T19:38:45.095 INFO:teuthology.orchestra.run.smithi022.stdout: "write_tier": -1, 2024-04-01T19:38:45.095 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_mode": "none", 2024-04-01T19:38:45.095 INFO:teuthology.orchestra.run.smithi022.stdout: "target_max_bytes": 0, 2024-04-01T19:38:45.095 INFO:teuthology.orchestra.run.smithi022.stdout: "target_max_objects": 0, 2024-04-01T19:38:45.095 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-01T19:38:45.095 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-01T19:38:45.095 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-01T19:38:45.095 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_min_flush_age": 0, 2024-04-01T19:38:45.095 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_min_evict_age": 0, 2024-04-01T19:38:45.095 INFO:teuthology.orchestra.run.smithi022.stdout: "erasure_code_profile": "", 2024-04-01T19:38:45.095 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_params": { 2024-04-01T19:38:45.095 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "none" 2024-04-01T19:38:45.096 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.096 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_period": 0, 2024-04-01T19:38:45.096 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_count": 0, 2024-04-01T19:38:45.096 INFO:teuthology.orchestra.run.smithi022.stdout: "use_gmt_hitset": true, 2024-04-01T19:38:45.096 INFO:teuthology.orchestra.run.smithi022.stdout: "min_read_recency_for_promote": 0, 2024-04-01T19:38:45.096 INFO:teuthology.orchestra.run.smithi022.stdout: "min_write_recency_for_promote": 0, 2024-04-01T19:38:45.096 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_grade_decay_rate": 0, 2024-04-01T19:38:45.096 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_search_last_n": 0, 2024-04-01T19:38:45.096 INFO:teuthology.orchestra.run.smithi022.stdout: "grade_table": [], 2024-04-01T19:38:45.096 INFO:teuthology.orchestra.run.smithi022.stdout: "stripe_width": 0, 2024-04-01T19:38:45.096 INFO:teuthology.orchestra.run.smithi022.stdout: "expected_num_objects": 0, 2024-04-01T19:38:45.097 INFO:teuthology.orchestra.run.smithi022.stdout: "fast_read": false, 2024-04-01T19:38:45.097 INFO:teuthology.orchestra.run.smithi022.stdout: "options": { 2024-04-01T19:38:45.097 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num_max": 32, 2024-04-01T19:38:45.097 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num_min": 1 2024-04-01T19:38:45.097 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.097 INFO:teuthology.orchestra.run.smithi022.stdout: "application_metadata": { 2024-04-01T19:38:45.097 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": {} 2024-04-01T19:38:45.097 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.097 INFO:teuthology.orchestra.run.smithi022.stdout: "read_balance": { 2024-04-01T19:38:45.097 INFO:teuthology.orchestra.run.smithi022.stdout: "score_type": "Fair distribution", 2024-04-01T19:38:45.097 INFO:teuthology.orchestra.run.smithi022.stdout: "score_acting": 11.760000228881836, 2024-04-01T19:38:45.097 INFO:teuthology.orchestra.run.smithi022.stdout: "score_stable": 11.760000228881836, 2024-04-01T19:38:45.097 INFO:teuthology.orchestra.run.smithi022.stdout: "optimal_score": 0.17000000178813934, 2024-04-01T19:38:45.097 INFO:teuthology.orchestra.run.smithi022.stdout: "raw_score_acting": 2, 2024-04-01T19:38:45.098 INFO:teuthology.orchestra.run.smithi022.stdout: "raw_score_stable": 2, 2024-04-01T19:38:45.098 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity_weighted": 0.99999988079071045, 2024-04-01T19:38:45.098 INFO:teuthology.orchestra.run.smithi022.stdout: "average_primary_affinity": 1, 2024-04-01T19:38:45.098 INFO:teuthology.orchestra.run.smithi022.stdout: "average_primary_affinity_weighted": 1 2024-04-01T19:38:45.098 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.098 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.098 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.098 INFO:teuthology.orchestra.run.smithi022.stdout: "pool": 4, 2024-04-01T19:38:45.098 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_name": "unique_pool_2", 2024-04-01T19:38:45.098 INFO:teuthology.orchestra.run.smithi022.stdout: "create_time": "2024-04-01T19:33:57.141554+0000", 2024-04-01T19:38:45.098 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-04-01T19:38:45.098 INFO:teuthology.orchestra.run.smithi022.stdout: "flags_names": "hashpspool", 2024-04-01T19:38:45.098 INFO:teuthology.orchestra.run.smithi022.stdout: "type": 1, 2024-04-01T19:38:45.098 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 2, 2024-04-01T19:38:45.098 INFO:teuthology.orchestra.run.smithi022.stdout: "min_size": 2, 2024-04-01T19:38:45.099 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_rule": 0, 2024-04-01T19:38:45.099 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_count": 0, 2024-04-01T19:38:45.099 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_target": 0, 2024-04-01T19:38:45.099 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_barrier": 0, 2024-04-01T19:38:45.099 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-01T19:38:45.099 INFO:teuthology.orchestra.run.smithi022.stdout: "object_hash": 2, 2024-04-01T19:38:45.099 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscale_mode": "off", 2024-04-01T19:38:45.099 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num": 16, 2024-04-01T19:38:45.099 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_placement_num": 16, 2024-04-01T19:38:45.099 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_placement_num_target": 16, 2024-04-01T19:38:45.099 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num_target": 16, 2024-04-01T19:38:45.099 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num_pending": 16, 2024-04-01T19:38:45.099 INFO:teuthology.orchestra.run.smithi022.stdout: "last_pg_merge_meta": { 2024-04-01T19:38:45.099 INFO:teuthology.orchestra.run.smithi022.stdout: "source_pgid": "0.0", 2024-04-01T19:38:45.099 INFO:teuthology.orchestra.run.smithi022.stdout: "ready_epoch": 0, 2024-04-01T19:38:45.100 INFO:teuthology.orchestra.run.smithi022.stdout: "last_epoch_started": 0, 2024-04-01T19:38:45.100 INFO:teuthology.orchestra.run.smithi022.stdout: "last_epoch_clean": 0, 2024-04-01T19:38:45.100 INFO:teuthology.orchestra.run.smithi022.stdout: "source_version": "0'0", 2024-04-01T19:38:45.100 INFO:teuthology.orchestra.run.smithi022.stdout: "target_version": "0'0" 2024-04-01T19:38:45.100 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.100 INFO:teuthology.orchestra.run.smithi022.stdout: "last_change": "271", 2024-04-01T19:38:45.100 INFO:teuthology.orchestra.run.smithi022.stdout: "last_force_op_resend": "0", 2024-04-01T19:38:45.100 INFO:teuthology.orchestra.run.smithi022.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-01T19:38:45.100 INFO:teuthology.orchestra.run.smithi022.stdout: "last_force_op_resend_preluminous": "0", 2024-04-01T19:38:45.100 INFO:teuthology.orchestra.run.smithi022.stdout: "auid": 0, 2024-04-01T19:38:45.100 INFO:teuthology.orchestra.run.smithi022.stdout: "snap_mode": "selfmanaged", 2024-04-01T19:38:45.100 INFO:teuthology.orchestra.run.smithi022.stdout: "snap_seq": 0, 2024-04-01T19:38:45.100 INFO:teuthology.orchestra.run.smithi022.stdout: "snap_epoch": 0, 2024-04-01T19:38:45.100 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_snaps": [], 2024-04-01T19:38:45.100 INFO:teuthology.orchestra.run.smithi022.stdout: "removed_snaps": "[]", 2024-04-01T19:38:45.100 INFO:teuthology.orchestra.run.smithi022.stdout: "quota_max_bytes": 0, 2024-04-01T19:38:45.101 INFO:teuthology.orchestra.run.smithi022.stdout: "quota_max_objects": 0, 2024-04-01T19:38:45.101 INFO:teuthology.orchestra.run.smithi022.stdout: "tiers": [], 2024-04-01T19:38:45.101 INFO:teuthology.orchestra.run.smithi022.stdout: "tier_of": -1, 2024-04-01T19:38:45.101 INFO:teuthology.orchestra.run.smithi022.stdout: "read_tier": -1, 2024-04-01T19:38:45.101 INFO:teuthology.orchestra.run.smithi022.stdout: "write_tier": -1, 2024-04-01T19:38:45.101 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_mode": "none", 2024-04-01T19:38:45.101 INFO:teuthology.orchestra.run.smithi022.stdout: "target_max_bytes": 0, 2024-04-01T19:38:45.101 INFO:teuthology.orchestra.run.smithi022.stdout: "target_max_objects": 0, 2024-04-01T19:38:45.101 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-01T19:38:45.101 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-01T19:38:45.101 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-01T19:38:45.101 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_min_flush_age": 0, 2024-04-01T19:38:45.101 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_min_evict_age": 0, 2024-04-01T19:38:45.101 INFO:teuthology.orchestra.run.smithi022.stdout: "erasure_code_profile": "", 2024-04-01T19:38:45.102 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_params": { 2024-04-01T19:38:45.102 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "none" 2024-04-01T19:38:45.102 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.102 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_period": 0, 2024-04-01T19:38:45.102 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_count": 0, 2024-04-01T19:38:45.102 INFO:teuthology.orchestra.run.smithi022.stdout: "use_gmt_hitset": true, 2024-04-01T19:38:45.102 INFO:teuthology.orchestra.run.smithi022.stdout: "min_read_recency_for_promote": 0, 2024-04-01T19:38:45.102 INFO:teuthology.orchestra.run.smithi022.stdout: "min_write_recency_for_promote": 0, 2024-04-01T19:38:45.102 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_grade_decay_rate": 0, 2024-04-01T19:38:45.102 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_search_last_n": 0, 2024-04-01T19:38:45.102 INFO:teuthology.orchestra.run.smithi022.stdout: "grade_table": [], 2024-04-01T19:38:45.102 INFO:teuthology.orchestra.run.smithi022.stdout: "stripe_width": 0, 2024-04-01T19:38:45.102 INFO:teuthology.orchestra.run.smithi022.stdout: "expected_num_objects": 0, 2024-04-01T19:38:45.102 INFO:teuthology.orchestra.run.smithi022.stdout: "fast_read": false, 2024-04-01T19:38:45.103 INFO:teuthology.orchestra.run.smithi022.stdout: "options": {}, 2024-04-01T19:38:45.103 INFO:teuthology.orchestra.run.smithi022.stdout: "application_metadata": { 2024-04-01T19:38:45.103 INFO:teuthology.orchestra.run.smithi022.stdout: "rados": {} 2024-04-01T19:38:45.103 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.103 INFO:teuthology.orchestra.run.smithi022.stdout: "read_balance": { 2024-04-01T19:38:45.103 INFO:teuthology.orchestra.run.smithi022.stdout: "score_type": "Fair distribution", 2024-04-01T19:38:45.103 INFO:teuthology.orchestra.run.smithi022.stdout: "score_acting": 2.9900000095367432, 2024-04-01T19:38:45.103 INFO:teuthology.orchestra.run.smithi022.stdout: "score_stable": 2.9900000095367432, 2024-04-01T19:38:45.103 INFO:teuthology.orchestra.run.smithi022.stdout: "optimal_score": 0.92000001668930054, 2024-04-01T19:38:45.103 INFO:teuthology.orchestra.run.smithi022.stdout: "raw_score_acting": 2.75, 2024-04-01T19:38:45.103 INFO:teuthology.orchestra.run.smithi022.stdout: "raw_score_stable": 2.75, 2024-04-01T19:38:45.103 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity_weighted": 0.99999988079071045, 2024-04-01T19:38:45.103 INFO:teuthology.orchestra.run.smithi022.stdout: "average_primary_affinity": 1, 2024-04-01T19:38:45.103 INFO:teuthology.orchestra.run.smithi022.stdout: "average_primary_affinity_weighted": 1 2024-04-01T19:38:45.103 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.104 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.104 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T19:38:45.104 INFO:teuthology.orchestra.run.smithi022.stdout: "osds": [ 2024-04-01T19:38:45.104 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.104 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 0, 2024-04-01T19:38:45.104 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "cfd4aa7e-a933-42e2-aac8-f93a3d9fcc3d", 2024-04-01T19:38:45.104 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2024-04-01T19:38:45.104 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2024-04-01T19:38:45.104 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2024-04-01T19:38:45.104 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2024-04-01T19:38:45.104 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 0, 2024-04-01T19:38:45.104 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 0, 2024-04-01T19:38:45.104 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 8, 2024-04-01T19:38:45.104 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 267, 2024-04-01T19:38:45.105 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 0, 2024-04-01T19:38:45.105 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2024-04-01T19:38:45.105 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2024-04-01T19:38:45.105 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.105 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.105 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.105 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6801", 2024-04-01T19:38:45.105 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1419201649 2024-04-01T19:38:45.105 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.105 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.105 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.105 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2024-04-01T19:38:45.105 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.105 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.106 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.106 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6802", 2024-04-01T19:38:45.106 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1419201649 2024-04-01T19:38:45.106 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.106 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.106 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.106 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2024-04-01T19:38:45.106 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.106 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.106 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.106 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6804", 2024-04-01T19:38:45.106 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1419201649 2024-04-01T19:38:45.106 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.106 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.107 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.107 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2024-04-01T19:38:45.107 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.107 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.107 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.107 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6803", 2024-04-01T19:38:45.107 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1419201649 2024-04-01T19:38:45.107 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.107 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.107 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.107 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.22:6801/1419201649", 2024-04-01T19:38:45.107 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.22:6802/1419201649", 2024-04-01T19:38:45.107 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.22:6804/1419201649", 2024-04-01T19:38:45.108 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.22:6803/1419201649", 2024-04-01T19:38:45.108 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2024-04-01T19:38:45.108 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2024-04-01T19:38:45.108 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2024-04-01T19:38:45.108 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.108 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.108 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.108 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 1, 2024-04-01T19:38:45.108 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "6ddadf19-2b4e-4c01-8918-9d51c323925b", 2024-04-01T19:38:45.108 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2024-04-01T19:38:45.108 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2024-04-01T19:38:45.108 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2024-04-01T19:38:45.108 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2024-04-01T19:38:45.108 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 0, 2024-04-01T19:38:45.109 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 0, 2024-04-01T19:38:45.109 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 13, 2024-04-01T19:38:45.109 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 342, 2024-04-01T19:38:45.109 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 0, 2024-04-01T19:38:45.109 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2024-04-01T19:38:45.109 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2024-04-01T19:38:45.109 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.109 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.109 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.109 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6805", 2024-04-01T19:38:45.109 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2579227110 2024-04-01T19:38:45.109 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.109 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.109 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.109 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2024-04-01T19:38:45.110 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.110 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.110 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.110 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6806", 2024-04-01T19:38:45.110 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2579227110 2024-04-01T19:38:45.110 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.110 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.110 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.110 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2024-04-01T19:38:45.110 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.110 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.110 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.110 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6808", 2024-04-01T19:38:45.110 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2579227110 2024-04-01T19:38:45.110 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.111 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.111 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.111 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2024-04-01T19:38:45.111 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.111 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.111 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.111 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6807", 2024-04-01T19:38:45.111 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2579227110 2024-04-01T19:38:45.111 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.111 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.111 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.111 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.22:6805/2579227110", 2024-04-01T19:38:45.111 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.22:6806/2579227110", 2024-04-01T19:38:45.111 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.22:6808/2579227110", 2024-04-01T19:38:45.111 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.22:6807/2579227110", 2024-04-01T19:38:45.112 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2024-04-01T19:38:45.112 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2024-04-01T19:38:45.112 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2024-04-01T19:38:45.112 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.112 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.112 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.112 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 2, 2024-04-01T19:38:45.112 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "4af1f44c-f47c-4ce6-87ba-1aeec3960969", 2024-04-01T19:38:45.112 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2024-04-01T19:38:45.112 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2024-04-01T19:38:45.112 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2024-04-01T19:38:45.112 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2024-04-01T19:38:45.112 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 0, 2024-04-01T19:38:45.112 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 0, 2024-04-01T19:38:45.112 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 20, 2024-04-01T19:38:45.112 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 106, 2024-04-01T19:38:45.113 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 0, 2024-04-01T19:38:45.113 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2024-04-01T19:38:45.113 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2024-04-01T19:38:45.113 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.113 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.113 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.113 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6809", 2024-04-01T19:38:45.113 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 835455757 2024-04-01T19:38:45.113 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.113 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.113 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.113 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2024-04-01T19:38:45.113 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.113 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.113 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.114 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6810", 2024-04-01T19:38:45.114 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 835455757 2024-04-01T19:38:45.114 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.114 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.114 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.114 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2024-04-01T19:38:45.114 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.114 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.114 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.114 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6812", 2024-04-01T19:38:45.114 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 835455757 2024-04-01T19:38:45.114 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.114 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.114 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.114 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2024-04-01T19:38:45.115 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.115 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.115 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.115 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6811", 2024-04-01T19:38:45.115 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 835455757 2024-04-01T19:38:45.115 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.115 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.115 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.115 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.22:6809/835455757", 2024-04-01T19:38:45.115 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.22:6810/835455757", 2024-04-01T19:38:45.115 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.22:6812/835455757", 2024-04-01T19:38:45.115 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.22:6811/835455757", 2024-04-01T19:38:45.115 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2024-04-01T19:38:45.115 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2024-04-01T19:38:45.115 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2024-04-01T19:38:45.116 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.116 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.116 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.116 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 3, 2024-04-01T19:38:45.116 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "c399f336-23c7-414a-822e-63793daf85c1", 2024-04-01T19:38:45.116 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2024-04-01T19:38:45.116 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2024-04-01T19:38:45.116 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2024-04-01T19:38:45.116 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2024-04-01T19:38:45.116 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 0, 2024-04-01T19:38:45.116 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 0, 2024-04-01T19:38:45.116 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 26, 2024-04-01T19:38:45.116 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 267, 2024-04-01T19:38:45.116 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 0, 2024-04-01T19:38:45.116 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2024-04-01T19:38:45.117 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2024-04-01T19:38:45.117 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.117 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.117 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.117 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6813", 2024-04-01T19:38:45.117 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 90988887 2024-04-01T19:38:45.117 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.117 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.117 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.117 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2024-04-01T19:38:45.117 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.117 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.117 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.117 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6814", 2024-04-01T19:38:45.117 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 90988887 2024-04-01T19:38:45.117 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.118 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.118 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.118 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2024-04-01T19:38:45.118 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.118 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.118 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.118 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6816", 2024-04-01T19:38:45.118 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 90988887 2024-04-01T19:38:45.118 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.118 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.118 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.118 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2024-04-01T19:38:45.118 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.119 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.119 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.119 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6815", 2024-04-01T19:38:45.119 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 90988887 2024-04-01T19:38:45.119 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.119 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.119 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.119 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.22:6813/90988887", 2024-04-01T19:38:45.119 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.22:6814/90988887", 2024-04-01T19:38:45.119 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.22:6816/90988887", 2024-04-01T19:38:45.119 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.22:6815/90988887", 2024-04-01T19:38:45.119 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2024-04-01T19:38:45.119 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2024-04-01T19:38:45.119 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2024-04-01T19:38:45.119 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.119 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.120 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.120 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 4, 2024-04-01T19:38:45.120 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "0a2690dc-e5b6-4d29-b517-980018519d76", 2024-04-01T19:38:45.120 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2024-04-01T19:38:45.120 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2024-04-01T19:38:45.120 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2024-04-01T19:38:45.120 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2024-04-01T19:38:45.120 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 0, 2024-04-01T19:38:45.120 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 0, 2024-04-01T19:38:45.120 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 32, 2024-04-01T19:38:45.120 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 267, 2024-04-01T19:38:45.120 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 0, 2024-04-01T19:38:45.120 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2024-04-01T19:38:45.120 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2024-04-01T19:38:45.120 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.120 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.121 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.121 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6800", 2024-04-01T19:38:45.121 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2408168690 2024-04-01T19:38:45.121 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.121 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.121 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.121 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2024-04-01T19:38:45.121 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.121 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.121 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.121 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6801", 2024-04-01T19:38:45.121 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2408168690 2024-04-01T19:38:45.121 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.121 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.121 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.122 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2024-04-01T19:38:45.122 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.122 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.122 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.122 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6803", 2024-04-01T19:38:45.122 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2408168690 2024-04-01T19:38:45.122 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.122 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.122 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.122 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2024-04-01T19:38:45.122 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.122 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.122 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.122 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6802", 2024-04-01T19:38:45.122 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2408168690 2024-04-01T19:38:45.123 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.123 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.123 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.123 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.62:6800/2408168690", 2024-04-01T19:38:45.123 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.62:6801/2408168690", 2024-04-01T19:38:45.123 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.62:6803/2408168690", 2024-04-01T19:38:45.123 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.62:6802/2408168690", 2024-04-01T19:38:45.123 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2024-04-01T19:38:45.123 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2024-04-01T19:38:45.123 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2024-04-01T19:38:45.123 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.123 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.123 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.123 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 5, 2024-04-01T19:38:45.123 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "c6830412-959a-4f1e-8c3d-f4b2d88673e6", 2024-04-01T19:38:45.124 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2024-04-01T19:38:45.124 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2024-04-01T19:38:45.124 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2024-04-01T19:38:45.124 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2024-04-01T19:38:45.124 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 0, 2024-04-01T19:38:45.124 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 0, 2024-04-01T19:38:45.124 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 37, 2024-04-01T19:38:45.124 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 191, 2024-04-01T19:38:45.124 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 0, 2024-04-01T19:38:45.124 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2024-04-01T19:38:45.124 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2024-04-01T19:38:45.124 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.124 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.124 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.124 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6804", 2024-04-01T19:38:45.125 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 386874616 2024-04-01T19:38:45.125 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.125 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.125 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.125 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2024-04-01T19:38:45.125 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.125 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.125 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.125 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6805", 2024-04-01T19:38:45.125 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 386874616 2024-04-01T19:38:45.125 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.125 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.125 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.125 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2024-04-01T19:38:45.125 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.126 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.126 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.126 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6807", 2024-04-01T19:38:45.126 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 386874616 2024-04-01T19:38:45.126 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.126 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.126 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.126 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2024-04-01T19:38:45.126 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.126 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.126 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.126 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6806", 2024-04-01T19:38:45.126 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 386874616 2024-04-01T19:38:45.126 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.127 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.127 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.127 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.62:6804/386874616", 2024-04-01T19:38:45.127 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.62:6805/386874616", 2024-04-01T19:38:45.127 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.62:6807/386874616", 2024-04-01T19:38:45.127 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.62:6806/386874616", 2024-04-01T19:38:45.127 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2024-04-01T19:38:45.127 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2024-04-01T19:38:45.127 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2024-04-01T19:38:45.127 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.127 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.127 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.127 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 6, 2024-04-01T19:38:45.127 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "f646310b-91a4-4259-a51f-6a0e92b7cba8", 2024-04-01T19:38:45.128 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2024-04-01T19:38:45.128 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2024-04-01T19:38:45.128 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2024-04-01T19:38:45.128 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2024-04-01T19:38:45.128 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 45, 2024-04-01T19:38:45.128 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 299, 2024-04-01T19:38:45.128 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 335, 2024-04-01T19:38:45.128 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 345, 2024-04-01T19:38:45.128 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 300, 2024-04-01T19:38:45.128 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2024-04-01T19:38:45.128 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2024-04-01T19:38:45.128 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.128 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.128 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.129 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6808", 2024-04-01T19:38:45.129 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 4216302213 2024-04-01T19:38:45.129 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.129 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.129 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.129 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2024-04-01T19:38:45.129 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.129 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.129 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.129 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6809", 2024-04-01T19:38:45.129 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 4216302213 2024-04-01T19:38:45.129 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.129 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.129 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.129 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2024-04-01T19:38:45.130 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.130 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.130 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.130 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6811", 2024-04-01T19:38:45.130 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 4216302213 2024-04-01T19:38:45.130 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.130 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.130 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.130 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2024-04-01T19:38:45.130 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.130 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.130 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.131 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6810", 2024-04-01T19:38:45.131 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 4216302213 2024-04-01T19:38:45.131 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.131 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.131 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.131 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.62:6808/4216302213", 2024-04-01T19:38:45.131 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.62:6809/4216302213", 2024-04-01T19:38:45.131 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.62:6811/4216302213", 2024-04-01T19:38:45.131 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.62:6810/4216302213", 2024-04-01T19:38:45.131 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2024-04-01T19:38:45.131 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2024-04-01T19:38:45.131 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2024-04-01T19:38:45.132 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.132 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.132 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.132 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 7, 2024-04-01T19:38:45.132 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "afe5f371-c892-43e9-b82e-c2d911354e9a", 2024-04-01T19:38:45.132 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2024-04-01T19:38:45.132 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2024-04-01T19:38:45.132 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2024-04-01T19:38:45.132 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2024-04-01T19:38:45.132 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 0, 2024-04-01T19:38:45.132 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 0, 2024-04-01T19:38:45.132 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 54, 2024-04-01T19:38:45.132 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 211, 2024-04-01T19:38:45.133 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 0, 2024-04-01T19:38:45.133 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2024-04-01T19:38:45.133 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2024-04-01T19:38:45.133 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.133 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.133 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.133 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6812", 2024-04-01T19:38:45.133 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2055487337 2024-04-01T19:38:45.133 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.133 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.133 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.133 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2024-04-01T19:38:45.133 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.133 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.133 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.134 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6813", 2024-04-01T19:38:45.134 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2055487337 2024-04-01T19:38:45.134 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.134 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.134 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.134 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2024-04-01T19:38:45.134 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.134 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.134 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.134 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6815", 2024-04-01T19:38:45.134 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2055487337 2024-04-01T19:38:45.134 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.135 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.135 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.135 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2024-04-01T19:38:45.135 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.135 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.135 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.135 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6814", 2024-04-01T19:38:45.135 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2055487337 2024-04-01T19:38:45.135 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.135 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.135 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.135 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.62:6812/2055487337", 2024-04-01T19:38:45.135 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.62:6813/2055487337", 2024-04-01T19:38:45.135 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.62:6815/2055487337", 2024-04-01T19:38:45.135 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.62:6814/2055487337", 2024-04-01T19:38:45.136 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2024-04-01T19:38:45.136 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2024-04-01T19:38:45.136 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2024-04-01T19:38:45.136 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.136 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.136 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.136 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 8, 2024-04-01T19:38:45.136 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "b7eb6461-f6fa-4a12-864c-6e6748e6337e", 2024-04-01T19:38:45.136 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2024-04-01T19:38:45.136 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 0, 2024-04-01T19:38:45.136 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 0, 2024-04-01T19:38:45.136 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2024-04-01T19:38:45.136 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 63, 2024-04-01T19:38:45.137 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 159, 2024-04-01T19:38:45.137 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 197, 2024-04-01T19:38:45.137 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 212, 2024-04-01T19:38:45.137 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 160, 2024-04-01T19:38:45.137 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2024-04-01T19:38:45.137 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2024-04-01T19:38:45.137 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.137 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.137 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.137 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6800", 2024-04-01T19:38:45.137 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1873408265 2024-04-01T19:38:45.137 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.137 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.137 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.137 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2024-04-01T19:38:45.138 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.138 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.138 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.138 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6801", 2024-04-01T19:38:45.138 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1873408265 2024-04-01T19:38:45.138 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.138 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.138 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.138 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2024-04-01T19:38:45.138 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.138 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.138 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.138 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6803", 2024-04-01T19:38:45.138 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1873408265 2024-04-01T19:38:45.138 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.139 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.139 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2024-04-01T19:38:45.139 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.139 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.139 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.139 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6802", 2024-04-01T19:38:45.139 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1873408265 2024-04-01T19:38:45.139 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.139 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.139 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.188:6800/1873408265", 2024-04-01T19:38:45.139 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.188:6801/1873408265", 2024-04-01T19:38:45.139 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.188:6803/1873408265", 2024-04-01T19:38:45.139 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.188:6802/1873408265", 2024-04-01T19:38:45.140 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2024-04-01T19:38:45.140 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2024-04-01T19:38:45.140 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2024-04-01T19:38:45.140 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.140 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.140 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.140 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 9, 2024-04-01T19:38:45.140 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "7d496ad5-46bf-485a-81d9-2b9da2a59882", 2024-04-01T19:38:45.140 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2024-04-01T19:38:45.140 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2024-04-01T19:38:45.140 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2024-04-01T19:38:45.140 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2024-04-01T19:38:45.140 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 0, 2024-04-01T19:38:45.140 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 0, 2024-04-01T19:38:45.140 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 71, 2024-04-01T19:38:45.140 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 267, 2024-04-01T19:38:45.141 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 0, 2024-04-01T19:38:45.141 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2024-04-01T19:38:45.141 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2024-04-01T19:38:45.141 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.141 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.141 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.141 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6804", 2024-04-01T19:38:45.141 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1755990887 2024-04-01T19:38:45.141 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.141 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.141 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.141 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2024-04-01T19:38:45.141 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.141 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.141 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.141 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6805", 2024-04-01T19:38:45.142 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1755990887 2024-04-01T19:38:45.142 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.142 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.142 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.142 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2024-04-01T19:38:45.142 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.142 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.142 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.142 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6807", 2024-04-01T19:38:45.142 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1755990887 2024-04-01T19:38:45.142 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.142 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.142 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.143 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2024-04-01T19:38:45.143 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.143 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.143 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.143 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6806", 2024-04-01T19:38:45.143 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1755990887 2024-04-01T19:38:45.143 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.143 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.143 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.143 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.188:6804/1755990887", 2024-04-01T19:38:45.143 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.188:6805/1755990887", 2024-04-01T19:38:45.143 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.188:6807/1755990887", 2024-04-01T19:38:45.143 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.188:6806/1755990887", 2024-04-01T19:38:45.143 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2024-04-01T19:38:45.143 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2024-04-01T19:38:45.143 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2024-04-01T19:38:45.144 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.144 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.144 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.144 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 10, 2024-04-01T19:38:45.144 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "6cbb80ce-37f7-48df-9090-09a6068e4490", 2024-04-01T19:38:45.144 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2024-04-01T19:38:45.144 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2024-04-01T19:38:45.144 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2024-04-01T19:38:45.144 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2024-04-01T19:38:45.144 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 0, 2024-04-01T19:38:45.144 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 0, 2024-04-01T19:38:45.144 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 77, 2024-04-01T19:38:45.144 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 344, 2024-04-01T19:38:45.144 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 0, 2024-04-01T19:38:45.144 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2024-04-01T19:38:45.145 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2024-04-01T19:38:45.145 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.145 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.145 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.145 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6808", 2024-04-01T19:38:45.145 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3777340429 2024-04-01T19:38:45.145 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.145 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.145 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.145 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2024-04-01T19:38:45.145 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.145 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.145 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.145 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6809", 2024-04-01T19:38:45.145 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3777340429 2024-04-01T19:38:45.145 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.146 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.146 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.146 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2024-04-01T19:38:45.146 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.146 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.146 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.146 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6811", 2024-04-01T19:38:45.146 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3777340429 2024-04-01T19:38:45.146 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.146 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.146 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.146 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2024-04-01T19:38:45.146 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.146 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.146 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.147 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6810", 2024-04-01T19:38:45.147 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3777340429 2024-04-01T19:38:45.147 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.147 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.147 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.147 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.188:6808/3777340429", 2024-04-01T19:38:45.147 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.188:6809/3777340429", 2024-04-01T19:38:45.147 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.188:6811/3777340429", 2024-04-01T19:38:45.147 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.188:6810/3777340429", 2024-04-01T19:38:45.147 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2024-04-01T19:38:45.147 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2024-04-01T19:38:45.147 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2024-04-01T19:38:45.147 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.147 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.147 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.148 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 11, 2024-04-01T19:38:45.148 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "c03517c4-fdb0-4587-96c1-b959041c4344", 2024-04-01T19:38:45.148 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2024-04-01T19:38:45.148 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2024-04-01T19:38:45.148 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2024-04-01T19:38:45.148 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2024-04-01T19:38:45.148 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 0, 2024-04-01T19:38:45.148 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 0, 2024-04-01T19:38:45.148 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 85, 2024-04-01T19:38:45.148 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 267, 2024-04-01T19:38:45.148 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 0, 2024-04-01T19:38:45.148 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2024-04-01T19:38:45.148 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2024-04-01T19:38:45.148 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.149 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.149 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.149 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6812", 2024-04-01T19:38:45.149 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3987199514 2024-04-01T19:38:45.149 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.149 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.149 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.149 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2024-04-01T19:38:45.149 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.149 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.149 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.149 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6813", 2024-04-01T19:38:45.150 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3987199514 2024-04-01T19:38:45.150 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.150 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.150 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.150 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2024-04-01T19:38:45.150 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.150 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.150 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.150 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6815", 2024-04-01T19:38:45.150 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3987199514 2024-04-01T19:38:45.150 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.150 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.150 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.151 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2024-04-01T19:38:45.151 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:38:45.151 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.151 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:38:45.151 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6814", 2024-04-01T19:38:45.151 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3987199514 2024-04-01T19:38:45.151 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.151 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.151 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.151 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.188:6812/3987199514", 2024-04-01T19:38:45.151 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.188:6813/3987199514", 2024-04-01T19:38:45.151 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.188:6815/3987199514", 2024-04-01T19:38:45.151 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.188:6814/3987199514", 2024-04-01T19:38:45.151 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2024-04-01T19:38:45.151 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2024-04-01T19:38:45.151 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2024-04-01T19:38:45.152 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:38:45.152 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.152 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T19:38:45.152 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_xinfo": [ 2024-04-01T19:38:45.152 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.152 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 0, 2024-04-01T19:38:45.152 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2024-04-01T19:38:45.152 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2024-04-01T19:38:45.152 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2024-04-01T19:38:45.152 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540701547738038271, 2024-04-01T19:38:45.152 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2024-04-01T19:38:45.152 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "2024-04-01T19:38:13.947727+0000", 2024-04-01T19:38:45.152 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 0 2024-04-01T19:38:45.153 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.153 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.153 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 1, 2024-04-01T19:38:45.153 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2024-04-01T19:38:45.153 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2024-04-01T19:38:45.153 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2024-04-01T19:38:45.153 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540701547738038271, 2024-04-01T19:38:45.153 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2024-04-01T19:38:45.153 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "2024-04-01T19:38:13.192409+0000", 2024-04-01T19:38:45.153 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 0 2024-04-01T19:38:45.153 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.153 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.153 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 2, 2024-04-01T19:38:45.154 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2024-04-01T19:38:45.154 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2024-04-01T19:38:45.154 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2024-04-01T19:38:45.154 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540701547738038271, 2024-04-01T19:38:45.154 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2024-04-01T19:38:45.154 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "2024-04-01T19:37:43.831906+0000", 2024-04-01T19:38:45.154 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 0 2024-04-01T19:38:45.154 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.154 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.154 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 3, 2024-04-01T19:38:45.154 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2024-04-01T19:38:45.154 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2024-04-01T19:38:45.154 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2024-04-01T19:38:45.155 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540701547738038271, 2024-04-01T19:38:45.155 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2024-04-01T19:38:45.155 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "2024-04-01T19:37:32.614227+0000", 2024-04-01T19:38:45.155 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 0 2024-04-01T19:38:45.155 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.155 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.155 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 4, 2024-04-01T19:38:45.155 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2024-04-01T19:38:45.155 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2024-04-01T19:38:45.155 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2024-04-01T19:38:45.155 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540701547738038271, 2024-04-01T19:38:45.155 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2024-04-01T19:38:45.155 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "2024-04-01T19:38:31.299968+0000", 2024-04-01T19:38:45.155 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 0 2024-04-01T19:38:45.155 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.156 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.156 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 5, 2024-04-01T19:38:45.156 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2024-04-01T19:38:45.156 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2024-04-01T19:38:45.156 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2024-04-01T19:38:45.156 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540701547738038271, 2024-04-01T19:38:45.156 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2024-04-01T19:38:45.156 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "2024-04-01T19:37:43.527859+0000", 2024-04-01T19:38:45.156 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 0 2024-04-01T19:38:45.156 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.156 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.156 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 6, 2024-04-01T19:38:45.156 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2024-04-01T19:38:45.156 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2024-04-01T19:38:45.156 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2024-04-01T19:38:45.157 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540701547738038271, 2024-04-01T19:38:45.157 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2024-04-01T19:38:45.157 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "2024-04-01T19:37:45.496127+0000", 2024-04-01T19:38:45.157 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 299 2024-04-01T19:38:45.157 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.157 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.157 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 7, 2024-04-01T19:38:45.157 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2024-04-01T19:38:45.157 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2024-04-01T19:38:45.157 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2024-04-01T19:38:45.157 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540701547738038271, 2024-04-01T19:38:45.157 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2024-04-01T19:38:45.157 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "2024-04-01T19:38:06.107532+0000", 2024-04-01T19:38:45.157 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 0 2024-04-01T19:38:45.158 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.158 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.158 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 8, 2024-04-01T19:38:45.158 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2024-04-01T19:38:45.158 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2024-04-01T19:38:45.158 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2024-04-01T19:38:45.158 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540701547738038271, 2024-04-01T19:38:45.158 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 65536, 2024-04-01T19:38:45.158 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "2024-04-01T19:38:31.826258+0000", 2024-04-01T19:38:45.158 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 159 2024-04-01T19:38:45.158 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.158 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.159 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 9, 2024-04-01T19:38:45.159 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2024-04-01T19:38:45.159 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2024-04-01T19:38:45.159 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2024-04-01T19:38:45.159 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540701547738038271, 2024-04-01T19:38:45.159 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2024-04-01T19:38:45.159 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "2024-04-01T19:38:04.891155+0000", 2024-04-01T19:38:45.159 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 0 2024-04-01T19:38:45.159 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.159 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.159 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 10, 2024-04-01T19:38:45.159 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2024-04-01T19:38:45.159 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2024-04-01T19:38:45.159 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2024-04-01T19:38:45.160 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540701547738038271, 2024-04-01T19:38:45.160 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2024-04-01T19:38:45.160 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "2024-04-01T19:38:07.099946+0000", 2024-04-01T19:38:45.160 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 0 2024-04-01T19:38:45.160 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.160 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:38:45.160 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 11, 2024-04-01T19:38:45.160 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2024-04-01T19:38:45.160 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2024-04-01T19:38:45.160 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2024-04-01T19:38:45.160 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540701547738038271, 2024-04-01T19:38:45.160 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2024-04-01T19:38:45.160 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "2024-04-01T19:38:02.326732+0000", 2024-04-01T19:38:45.161 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 0 2024-04-01T19:38:45.161 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.161 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T19:38:45.161 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_upmap": [], 2024-04-01T19:38:45.161 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_upmap_items": [], 2024-04-01T19:38:45.161 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_upmap_primaries": [], 2024-04-01T19:38:45.161 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_temp": [], 2024-04-01T19:38:45.161 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_temp": [], 2024-04-01T19:38:45.161 INFO:teuthology.orchestra.run.smithi022.stdout: "blocklist": { 2024-04-01T19:38:45.161 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.22:0/3735983556": "2024-04-02T19:16:30.513384+0000", 2024-04-01T19:38:45.161 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.22:0/3575578250": "2024-04-02T19:16:30.513384+0000", 2024-04-01T19:38:45.161 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.22:0/2493529775": "2024-04-02T19:16:02.302343+0000", 2024-04-01T19:38:45.162 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.22:6800/2678666836": "2024-04-02T19:16:30.513384+0000", 2024-04-01T19:38:45.162 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.22:0/2389537847": "2024-04-02T19:16:02.302343+0000", 2024-04-01T19:38:45.162 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.22:0/798807675": "2024-04-02T19:16:02.302343+0000", 2024-04-01T19:38:45.162 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.22:6800/1090179981": "2024-04-02T19:16:02.302343+0000", 2024-04-01T19:38:45.162 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.22:0/51907384": "2024-04-02T19:16:30.513384+0000" 2024-04-01T19:38:45.162 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.162 INFO:teuthology.orchestra.run.smithi022.stdout: "range_blocklist": {}, 2024-04-01T19:38:45.162 INFO:teuthology.orchestra.run.smithi022.stdout: "erasure_code_profiles": { 2024-04-01T19:38:45.162 INFO:teuthology.orchestra.run.smithi022.stdout: "default": { 2024-04-01T19:38:45.162 INFO:teuthology.orchestra.run.smithi022.stdout: "crush-failure-domain": "osd", 2024-04-01T19:38:45.162 INFO:teuthology.orchestra.run.smithi022.stdout: "k": "2", 2024-04-01T19:38:45.162 INFO:teuthology.orchestra.run.smithi022.stdout: "m": "1", 2024-04-01T19:38:45.162 INFO:teuthology.orchestra.run.smithi022.stdout: "plugin": "jerasure", 2024-04-01T19:38:45.163 INFO:teuthology.orchestra.run.smithi022.stdout: "technique": "reed_sol_van" 2024-04-01T19:38:45.163 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.163 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:38:45.163 INFO:teuthology.orchestra.run.smithi022.stdout: "removed_snaps_queue": [], 2024-04-01T19:38:45.163 INFO:teuthology.orchestra.run.smithi022.stdout: "new_removed_snaps": [], 2024-04-01T19:38:45.163 INFO:teuthology.orchestra.run.smithi022.stdout: "new_purged_snaps": [], 2024-04-01T19:38:45.163 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_node_flags": {}, 2024-04-01T19:38:45.163 INFO:teuthology.orchestra.run.smithi022.stdout: "device_class_flags": {}, 2024-04-01T19:38:45.163 INFO:teuthology.orchestra.run.smithi022.stdout: "stretch_mode": { 2024-04-01T19:38:45.163 INFO:teuthology.orchestra.run.smithi022.stdout: "stretch_mode_enabled": false, 2024-04-01T19:38:45.163 INFO:teuthology.orchestra.run.smithi022.stdout: "stretch_bucket_count": 0, 2024-04-01T19:38:45.163 INFO:teuthology.orchestra.run.smithi022.stdout: "degraded_stretch_mode": 0, 2024-04-01T19:38:45.163 INFO:teuthology.orchestra.run.smithi022.stdout: "recovering_stretch_mode": 0, 2024-04-01T19:38:45.164 INFO:teuthology.orchestra.run.smithi022.stdout: "stretch_mode_bucket": 0 2024-04-01T19:38:45.164 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:38:45.164 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:38:45.564 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:45 smithi022 ceph-mon[39439]: 4.1 scrub starts 2024-04-01T19:38:45.564 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:45 smithi022 ceph-mon[39439]: 4.1 scrub ok 2024-04-01T19:38:45.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:45 smithi022 ceph-mon[39439]: 4.4 scrub starts 2024-04-01T19:38:45.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:45 smithi022 ceph-mon[39439]: 4.4 scrub ok 2024-04-01T19:38:45.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:45 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2000661808' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-04-01T19:38:45.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:45 smithi188 ceph-mon[43939]: 4.1 scrub starts 2024-04-01T19:38:45.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:45 smithi188 ceph-mon[43939]: 4.1 scrub ok 2024-04-01T19:38:45.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:45 smithi188 ceph-mon[43939]: 4.4 scrub starts 2024-04-01T19:38:45.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:45 smithi188 ceph-mon[43939]: 4.4 scrub ok 2024-04-01T19:38:45.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:45 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2000661808' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-04-01T19:38:46.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:45 smithi062 ceph-mon[44211]: 4.1 scrub starts 2024-04-01T19:38:46.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:45 smithi062 ceph-mon[44211]: 4.1 scrub ok 2024-04-01T19:38:46.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:45 smithi062 ceph-mon[44211]: 4.4 scrub starts 2024-04-01T19:38:46.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:45 smithi062 ceph-mon[44211]: 4.4 scrub ok 2024-04-01T19:38:46.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:45 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2000661808' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-04-01T19:38:46.089 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:38:46.120 INFO:tasks.thrashosds.thrasher:j is {'epoch': 353, 'fsid': '09f6b846-f05c-11ee-b647-cb9ed24678a4', 'created': '2024-04-01T19:15:34.344221+0000', 'modified': '2024-04-01T19:38:35.511502+0000', 'last_up_change': '2024-04-01T19:37:45.832405+0000', 'last_in_change': '2024-04-01T19:38:21.274265+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 29, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 12, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T19:18:34.605751+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'unique_pool_2', 'create_time': '2024-04-01T19:33:57.141554+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '271', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.9200000166893005, 'raw_score_acting': 2.75, 'raw_score_stable': 2.75, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'cfd4aa7e-a933-42e2-aac8-f93a3d9fcc3d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 267, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6801', 'nonce': 1419201649}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6802', 'nonce': 1419201649}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6804', 'nonce': 1419201649}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6803', 'nonce': 1419201649}]}, 'public_addr': '172.21.15.22:6801/1419201649', 'cluster_addr': '172.21.15.22:6802/1419201649', 'heartbeat_back_addr': '172.21.15.22:6804/1419201649', 'heartbeat_front_addr': '172.21.15.22:6803/1419201649', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '6ddadf19-2b4e-4c01-8918-9d51c323925b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 342, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6805', 'nonce': 2579227110}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6806', 'nonce': 2579227110}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6808', 'nonce': 2579227110}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6807', 'nonce': 2579227110}]}, 'public_addr': '172.21.15.22:6805/2579227110', 'cluster_addr': '172.21.15.22:6806/2579227110', 'heartbeat_back_addr': '172.21.15.22:6808/2579227110', 'heartbeat_front_addr': '172.21.15.22:6807/2579227110', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '4af1f44c-f47c-4ce6-87ba-1aeec3960969', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 20, 'up_thru': 106, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6809', 'nonce': 835455757}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6810', 'nonce': 835455757}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6812', 'nonce': 835455757}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6811', 'nonce': 835455757}]}, 'public_addr': '172.21.15.22:6809/835455757', 'cluster_addr': '172.21.15.22:6810/835455757', 'heartbeat_back_addr': '172.21.15.22:6812/835455757', 'heartbeat_front_addr': '172.21.15.22:6811/835455757', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'c399f336-23c7-414a-822e-63793daf85c1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 26, 'up_thru': 267, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6813', 'nonce': 90988887}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6814', 'nonce': 90988887}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6816', 'nonce': 90988887}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6815', 'nonce': 90988887}]}, 'public_addr': '172.21.15.22:6813/90988887', 'cluster_addr': '172.21.15.22:6814/90988887', 'heartbeat_back_addr': '172.21.15.22:6816/90988887', 'heartbeat_front_addr': '172.21.15.22:6815/90988887', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '0a2690dc-e5b6-4d29-b517-980018519d76', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 32, 'up_thru': 267, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6800', 'nonce': 2408168690}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6801', 'nonce': 2408168690}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6803', 'nonce': 2408168690}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6802', 'nonce': 2408168690}]}, 'public_addr': '172.21.15.62:6800/2408168690', 'cluster_addr': '172.21.15.62:6801/2408168690', 'heartbeat_back_addr': '172.21.15.62:6803/2408168690', 'heartbeat_front_addr': '172.21.15.62:6802/2408168690', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'c6830412-959a-4f1e-8c3d-f4b2d88673e6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 37, 'up_thru': 191, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6804', 'nonce': 386874616}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6805', 'nonce': 386874616}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6807', 'nonce': 386874616}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6806', 'nonce': 386874616}]}, 'public_addr': '172.21.15.62:6804/386874616', 'cluster_addr': '172.21.15.62:6805/386874616', 'heartbeat_back_addr': '172.21.15.62:6807/386874616', 'heartbeat_front_addr': '172.21.15.62:6806/386874616', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'f646310b-91a4-4259-a51f-6a0e92b7cba8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 45, 'last_clean_end': 299, 'up_from': 335, 'up_thru': 345, 'down_at': 300, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6808', 'nonce': 4216302213}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6809', 'nonce': 4216302213}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6811', 'nonce': 4216302213}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6810', 'nonce': 4216302213}]}, 'public_addr': '172.21.15.62:6808/4216302213', 'cluster_addr': '172.21.15.62:6809/4216302213', 'heartbeat_back_addr': '172.21.15.62:6811/4216302213', 'heartbeat_front_addr': '172.21.15.62:6810/4216302213', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'afe5f371-c892-43e9-b82e-c2d911354e9a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 54, 'up_thru': 211, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6812', 'nonce': 2055487337}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6813', 'nonce': 2055487337}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6815', 'nonce': 2055487337}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6814', 'nonce': 2055487337}]}, 'public_addr': '172.21.15.62:6812/2055487337', 'cluster_addr': '172.21.15.62:6813/2055487337', 'heartbeat_back_addr': '172.21.15.62:6815/2055487337', 'heartbeat_front_addr': '172.21.15.62:6814/2055487337', 'state': ['exists', 'up']}, {'osd': 8, 'uuid': 'b7eb6461-f6fa-4a12-864c-6e6748e6337e', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 63, 'last_clean_end': 159, 'up_from': 197, 'up_thru': 212, 'down_at': 160, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6800', 'nonce': 1873408265}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6801', 'nonce': 1873408265}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6803', 'nonce': 1873408265}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6802', 'nonce': 1873408265}]}, 'public_addr': '172.21.15.188:6800/1873408265', 'cluster_addr': '172.21.15.188:6801/1873408265', 'heartbeat_back_addr': '172.21.15.188:6803/1873408265', 'heartbeat_front_addr': '172.21.15.188:6802/1873408265', 'state': ['exists', 'up']}, {'osd': 9, 'uuid': '7d496ad5-46bf-485a-81d9-2b9da2a59882', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 71, 'up_thru': 267, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6804', 'nonce': 1755990887}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6805', 'nonce': 1755990887}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6807', 'nonce': 1755990887}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6806', 'nonce': 1755990887}]}, 'public_addr': '172.21.15.188:6804/1755990887', 'cluster_addr': '172.21.15.188:6805/1755990887', 'heartbeat_back_addr': '172.21.15.188:6807/1755990887', 'heartbeat_front_addr': '172.21.15.188:6806/1755990887', 'state': ['exists', 'up']}, {'osd': 10, 'uuid': '6cbb80ce-37f7-48df-9090-09a6068e4490', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 77, 'up_thru': 344, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6808', 'nonce': 3777340429}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6809', 'nonce': 3777340429}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6811', 'nonce': 3777340429}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6810', 'nonce': 3777340429}]}, 'public_addr': '172.21.15.188:6808/3777340429', 'cluster_addr': '172.21.15.188:6809/3777340429', 'heartbeat_back_addr': '172.21.15.188:6811/3777340429', 'heartbeat_front_addr': '172.21.15.188:6810/3777340429', 'state': ['exists', 'up']}, {'osd': 11, 'uuid': 'c03517c4-fdb0-4587-96c1-b959041c4344', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 85, 'up_thru': 267, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6812', 'nonce': 3987199514}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6813', 'nonce': 3987199514}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6815', 'nonce': 3987199514}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6814', 'nonce': 3987199514}]}, 'public_addr': '172.21.15.188:6812/3987199514', 'cluster_addr': '172.21.15.188:6813/3987199514', 'heartbeat_back_addr': '172.21.15.188:6815/3987199514', 'heartbeat_front_addr': '172.21.15.188:6814/3987199514', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-01T19:38:13.947727+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-01T19:38:13.192409+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-01T19:37:43.831906+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-01T19:37:32.614227+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-01T19:38:31.299968+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-01T19:37:43.527859+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-01T19:37:45.496127+0000', 'dead_epoch': 299}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-01T19:38:06.107532+0000', 'dead_epoch': 0}, {'osd': 8, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-04-01T19:38:31.826258+0000', 'dead_epoch': 159}, {'osd': 9, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-01T19:38:04.891155+0000', 'dead_epoch': 0}, {'osd': 10, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-01T19:38:07.099946+0000', 'dead_epoch': 0}, {'osd': 11, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-01T19:38:02.326732+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {'172.21.15.22:0/3735983556': '2024-04-02T19:16:30.513384+0000', '172.21.15.22:0/3575578250': '2024-04-02T19:16:30.513384+0000', '172.21.15.22:0/2493529775': '2024-04-02T19:16:02.302343+0000', '172.21.15.22:6800/2678666836': '2024-04-02T19:16:30.513384+0000', '172.21.15.22:0/2389537847': '2024-04-02T19:16:02.302343+0000', '172.21.15.22:0/798807675': '2024-04-02T19:16:02.302343+0000', '172.21.15.22:6800/1090179981': '2024-04-02T19:16:02.302343+0000', '172.21.15.22:0/51907384': '2024-04-02T19:16:30.513384+0000'}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-01T19:38:46.120 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:38:46.137 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:38:46.463 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:38:46.466 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:46.467 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:38:46.568 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:38:46.615 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:46.729 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:38:46.738 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:46.739 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:38:46.739 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:46 smithi022 ceph-mon[39439]: pgmap v1010: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 1.2 GiB data, 5.4 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.24k op/s 2024-04-01T19:38:46.840 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:38:46.873 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:46 smithi062 ceph-mon[44211]: pgmap v1010: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 1.2 GiB data, 5.4 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.24k op/s 2024-04-01T19:38:46.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:46 smithi188 ceph-mon[43939]: pgmap v1010: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 1.2 GiB data, 5.4 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.24k op/s 2024-04-01T19:38:46.878 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:46.904 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:38:46.915 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:46.915 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:38:47.016 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:38:47.047 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:47.077 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:38:47.079 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:47.079 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:38:47.180 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:38:47.214 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:47.243 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:38:47.249 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:47.250 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:38:47.317 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:38:47.350 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:38:47.387 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:47.415 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:38:47.420 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:47.420 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:38:47.521 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:38:47.550 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:47.581 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:38:47.587 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:47.588 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:38:47.670 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:38:47.687 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:38:47.688 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:38:47.718 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:47.741 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:38:47.744 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:47.744 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:38:47.845 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:38:47.877 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:47.908 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:38:47.912 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:47.912 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:38:48.013 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:38:48.048 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:48.077 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:38:48.080 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:48.080 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:38:48.181 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:38:48.216 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:48.245 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:38:48.251 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:48.251 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:38:48.352 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:38:48.386 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:48.408 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:38:48.411 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:48.411 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:38:48.513 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:38:48.547 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:48.574 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:38:48.578 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:48.579 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:38:48.680 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:38:48.716 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:48.746 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:38:48.750 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:48.750 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:38:48.851 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:38:48.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:48 smithi022 ceph-mon[39439]: pgmap v1011: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 951 MiB data, 5.0 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.39k op/s 2024-04-01T19:38:48.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:48 smithi022 ceph-mon[39439]: 4.b scrub starts 2024-04-01T19:38:48.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:48 smithi022 ceph-mon[39439]: 4.b scrub ok 2024-04-01T19:38:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:48 smithi188 ceph-mon[43939]: pgmap v1011: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 951 MiB data, 5.0 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.39k op/s 2024-04-01T19:38:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:48 smithi188 ceph-mon[43939]: 4.b scrub starts 2024-04-01T19:38:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:48 smithi188 ceph-mon[43939]: 4.b scrub ok 2024-04-01T19:38:48.884 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:48.916 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:38:48.918 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:48.919 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:38:49.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:48 smithi062 ceph-mon[44211]: pgmap v1011: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 951 MiB data, 5.0 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.39k op/s 2024-04-01T19:38:49.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:48 smithi062 ceph-mon[44211]: 4.b scrub starts 2024-04-01T19:38:49.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:48 smithi062 ceph-mon[44211]: 4.b scrub ok 2024-04-01T19:38:49.020 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:38:49.071 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:49.683 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:38:49.998 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:38:49.998 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:38:50.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:50 smithi022 ceph-mon[39439]: pgmap v1012: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 927 MiB data, 4.8 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:38:50.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:50 smithi188 ceph-mon[43939]: pgmap v1012: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 927 MiB data, 4.8 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:38:51.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:50 smithi062 ceph-mon[44211]: pgmap v1012: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 927 MiB data, 4.8 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:38:51.341 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:38:51.348 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:51.349 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:38:51.450 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:38:51.482 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:51.504 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:38:51.506 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:51.507 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:38:51.608 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:38:51.639 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:51.663 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:38:51.666 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:51.666 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:38:51.767 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:38:51.801 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:51.826 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:38:51.829 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:51.830 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:38:51.931 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:38:51.987 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:52.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:52 smithi022 ceph-mon[39439]: pgmap v1013: 17 pgs: 17 active+clean; 740 MiB data, 4.5 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1.29k op/s 2024-04-01T19:38:52.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:52 smithi188 ceph-mon[43939]: pgmap v1013: 17 pgs: 17 active+clean; 740 MiB data, 4.5 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1.29k op/s 2024-04-01T19:38:53.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:52 smithi062 ceph-mon[44211]: pgmap v1013: 17 pgs: 17 active+clean; 740 MiB data, 4.5 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1.29k op/s 2024-04-01T19:38:53.035 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:38:53.035 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:38:53.596 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:53 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:38:53.596 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:53 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:38:53.597 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:53 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2570705298' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:38:53.657 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:38:53.663 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:38:53.693 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:38:53.729 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:38:53.756 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:38:53.787 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:38:53.816 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:38:53.850 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:38:53.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:53 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:38:53.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:53 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:38:53.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:53 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2570705298' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:38:53.880 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:38:53.912 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:38:53.947 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:38:53.987 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:38:54.002 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:38:54.002 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:38:54.002 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:38:54.002 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:38:54.002 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:38:54.003 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:38:54.003 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:38:54.003 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:38:54.003 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:38:54.003 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:38:54.003 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:38:54.003 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:38:54.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:53 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:38:54.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:53 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:38:54.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:53 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2570705298' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:38:54.136 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_ops_in_flight 2024-04-01T19:38:54.568 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:38:54.575 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:54.576 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:38:54.677 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:38:54.710 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:54.736 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:38:54.739 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:54.739 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:38:54.841 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:38:54.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:54 smithi022 ceph-mon[39439]: pgmap v1014: 17 pgs: 17 active+clean; 544 MiB data, 4.1 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1.29k op/s 2024-04-01T19:38:54.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:54 smithi022 ceph-mon[39439]: from='client.35873 v1:172.21.15.22:0/1049813217' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:38:54.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:54 smithi022 ceph-mon[39439]: osdmap e354: 12 total, 12 up, 11 in 2024-04-01T19:38:54.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:54.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:54.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:54.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:54.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:54.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:54.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:54.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:54.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:54.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:54.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:54 smithi188 ceph-mon[43939]: pgmap v1014: 17 pgs: 17 active+clean; 544 MiB data, 4.1 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1.29k op/s 2024-04-01T19:38:54.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:54 smithi188 ceph-mon[43939]: from='client.35873 v1:172.21.15.22:0/1049813217' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:38:54.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:54 smithi188 ceph-mon[43939]: osdmap e354: 12 total, 12 up, 11 in 2024-04-01T19:38:54.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:54.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:54.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:54.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:54.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:54.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:54.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:54.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:54.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:54.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:54.903 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:54.984 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:38:54.995 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:54.995 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:38:55.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:54 smithi062 ceph-mon[44211]: pgmap v1014: 17 pgs: 17 active+clean; 544 MiB data, 4.1 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1.29k op/s 2024-04-01T19:38:55.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:54 smithi062 ceph-mon[44211]: from='client.35873 v1:172.21.15.22:0/1049813217' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:38:55.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:54 smithi062 ceph-mon[44211]: osdmap e354: 12 total, 12 up, 11 in 2024-04-01T19:38:55.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:55.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:55.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:55.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:55.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:55.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:55.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:55.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:55.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:55.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:55.096 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:38:55.134 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:55.161 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:38:55.166 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:55.167 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:38:55.268 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:38:55.306 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:55.422 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:38:55.435 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:55.436 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:38:55.476 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":1014,"stamp":"2024-04-01T19:38:52.955900+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":570294840,"num_objects":8696,"num_object_clones":0,"num_object_copies":17392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8696,"num_whiteouts":0,"num_read":127,"num_read_kb":110,"num_write":335471,"num_write_kb":11010363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21644,"num_bytes_recovered":1420052608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160802,"ondisk_log_size":160802,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":11,"num_per_pool_osds":11,"num_per_pool_omap_osds":11,"kb":1031196672,"kb_used":4351048,"kb_used_data":1224560,"kb_used_omap":307,"kb_used_meta":3126092,"kb_avail":1026845624,"statfs":{"total":1055945392128,"available":1051489918976,"internally_reserved":0,"allocated":1253949440,"data_stored":1249928799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":315235,"internal_metadata":3201118365},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1016070144,"num_objects":-15504,"num_object_clones":0,"num_object_copies":-31008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15504,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15504,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002484"},"pg_stats":[{"pgid":"4.f","version":"353'20917","reported_seq":21332,"reported_epoch":353,"state":"active+clean","last_fresh":"2024-04-01T19:38:49.717093+0000","last_change":"2024-04-01T19:38:38.156055+0000","last_active":"2024-04-01T19:38:49.717093+0000","last_peered":"2024-04-01T19:38:49.717093+0000","last_clean":"2024-04-01T19:38:49.717093+0000","last_became_active":"2024-04-01T19:33:59.106174+0000","last_became_peered":"2024-04-01T19:33:59.106174+0000","last_unstale":"2024-04-01T19:38:49.717093+0000","last_undegraded":"2024-04-01T19:38:49.717093+0000","last_fullsized":"2024-04-01T19:38:49.717093+0000","mapping_epoch":267,"log_start":"296'10900","ondisk_log_start":"296'10900","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"353'20061","last_scrub_stamp":"2024-04-01T19:38:38.155744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:38:38.155744+0000","objects_scrubbed":1489,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:40:04.041989+0000","scrub_duration":543,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40566784,"num_objects":619,"num_object_clones":0,"num_object_copies":1238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":619,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20917,"num_write_kb":689152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"353'23411","reported_seq":23902,"reported_epoch":353,"state":"active+clean","last_fresh":"2024-04-01T19:38:51.501646+0000","last_change":"2024-04-01T19:38:41.372493+0000","last_active":"2024-04-01T19:38:51.501646+0000","last_peered":"2024-04-01T19:38:51.501646+0000","last_clean":"2024-04-01T19:38:51.501646+0000","last_became_active":"2024-04-01T19:33:59.258540+0000","last_became_peered":"2024-04-01T19:33:59.258540+0000","last_unstale":"2024-04-01T19:38:51.501646+0000","last_undegraded":"2024-04-01T19:38:51.501646+0000","last_fullsized":"2024-04-01T19:38:51.501646+0000","mapping_epoch":267,"log_start":"321'13402","ondisk_log_start":"321'13402","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"353'22648","last_scrub_stamp":"2024-04-01T19:38:41.372403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:38:41.372403+0000","objects_scrubbed":1266,"log_size":10009,"log_dups_size":0,"ondisk_log_size":10009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:39:49.179429+0000","scrub_duration":222,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32571392,"num_objects":497,"num_object_clones":0,"num_object_copies":994,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":497,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20969,"num_write_kb":686912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.d","version":"353'21018","reported_seq":21454,"reported_epoch":353,"state":"active+clean","last_fresh":"2024-04-01T19:38:51.503813+0000","last_change":"2024-04-01T19:38:10.785960+0000","last_active":"2024-04-01T19:38:51.503813+0000","last_peered":"2024-04-01T19:38:51.503813+0000","last_clean":"2024-04-01T19:38:51.503813+0000","last_became_active":"2024-04-01T19:33:59.105279+0000","last_became_peered":"2024-04-01T19:33:59.105279+0000","last_unstale":"2024-04-01T19:38:51.503813+0000","last_undegraded":"2024-04-01T19:38:51.503813+0000","last_fullsized":"2024-04-01T19:38:51.503813+0000","mapping_epoch":267,"log_start":"297'11000","ondisk_log_start":"297'11000","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"347'17819","last_scrub_stamp":"2024-04-01T19:38:10.785869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:38:10.785869+0000","objects_scrubbed":3700,"log_size":10018,"log_dups_size":0,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:39:34.914978+0000","scrub_duration":632,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31260696,"num_objects":478,"num_object_clones":0,"num_object_copies":956,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":478,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":21018,"num_write_kb":687809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.c","version":"353'21079","reported_seq":21512,"reported_epoch":353,"state":"active+clean","last_fresh":"2024-04-01T19:38:51.495919+0000","last_change":"2024-04-01T19:38:05.587665+0000","last_active":"2024-04-01T19:38:51.495919+0000","last_peered":"2024-04-01T19:38:51.495919+0000","last_clean":"2024-04-01T19:38:51.495919+0000","last_became_active":"2024-04-01T19:33:59.105051+0000","last_became_peered":"2024-04-01T19:33:59.105051+0000","last_unstale":"2024-04-01T19:38:51.495919+0000","last_undegraded":"2024-04-01T19:38:51.495919+0000","last_fullsized":"2024-04-01T19:38:51.495919+0000","mapping_epoch":267,"log_start":"297'11000","ondisk_log_start":"297'11000","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"343'17654","last_scrub_stamp":"2024-04-01T19:38:05.587561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:38:05.587561+0000","objects_scrubbed":3904,"log_size":10079,"log_dups_size":0,"ondisk_log_size":10079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:39:21.764485+0000","scrub_duration":353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31391744,"num_objects":479,"num_object_clones":0,"num_object_copies":958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":479,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21079,"num_write_kb":689856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.b","version":"353'20828","reported_seq":21219,"reported_epoch":353,"state":"active+clean","last_fresh":"2024-04-01T19:38:50.336756+0000","last_change":"2024-04-01T19:38:47.553891+0000","last_active":"2024-04-01T19:38:50.336756+0000","last_peered":"2024-04-01T19:38:50.336756+0000","last_clean":"2024-04-01T19:38:50.336756+0000","last_became_active":"2024-04-01T19:33:59.105705+0000","last_became_peered":"2024-04-01T19:33:59.105705+0000","last_unstale":"2024-04-01T19:38:50.336756+0000","last_undegraded":"2024-04-01T19:38:50.336756+0000","last_fullsized":"2024-04-01T19:38:50.336756+0000","mapping_epoch":267,"log_start":"296'10800","ondisk_log_start":"296'10800","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"353'20616","last_scrub_stamp":"2024-04-01T19:38:47.553569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:38:47.553569+0000","objects_scrubbed":787,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:40:08.941777+0000","scrub_duration":259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37093376,"num_objects":566,"num_object_clones":0,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20828,"num_write_kb":684608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"353'21116","reported_seq":42111,"reported_epoch":353,"state":"active+clean","last_fresh":"2024-04-01T19:38:50.837941+0000","last_change":"2024-04-01T19:38:10.388972+0000","last_active":"2024-04-01T19:38:50.837941+0000","last_peered":"2024-04-01T19:38:50.837941+0000","last_clean":"2024-04-01T19:38:50.837941+0000","last_became_active":"2024-04-01T19:38:06.122433+0000","last_became_peered":"2024-04-01T19:38:06.122433+0000","last_unstale":"2024-04-01T19:38:50.837941+0000","last_undegraded":"2024-04-01T19:38:50.837941+0000","last_fullsized":"2024-04-01T19:38:50.837941+0000","mapping_epoch":343,"log_start":"297'11100","ondisk_log_start":"297'11100","created":267,"last_epoch_clean":344,"parent":"0.0","parent_split_bits":0,"last_scrub":"347'17990","last_scrub_stamp":"2024-04-01T19:38:10.388715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:38:10.388715+0000","objects_scrubbed":3711,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:39:28.868556+0000","scrub_duration":767,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35258368,"num_objects":538,"num_object_clones":0,"num_object_copies":1076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":538,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21116,"num_write_kb":692928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10269,"num_bytes_recovered":672989184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"353'21322","reported_seq":21716,"reported_epoch":353,"state":"active+clean","last_fresh":"2024-04-01T19:38:51.009549+0000","last_change":"2024-04-01T19:38:40.468467+0000","last_active":"2024-04-01T19:38:51.009549+0000","last_peered":"2024-04-01T19:38:51.009549+0000","last_clean":"2024-04-01T19:38:51.009549+0000","last_became_active":"2024-04-01T19:33:59.106492+0000","last_became_peered":"2024-04-01T19:33:59.106492+0000","last_unstale":"2024-04-01T19:38:51.009549+0000","last_undegraded":"2024-04-01T19:38:51.009549+0000","last_fullsized":"2024-04-01T19:38:51.009549+0000","mapping_epoch":267,"log_start":"298'11300","ondisk_log_start":"298'11300","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"353'20541","last_scrub_stamp":"2024-04-01T19:38:40.468381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:38:40.468381+0000","objects_scrubbed":1309,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:40:06.469493+0000","scrub_duration":347,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":512,"num_object_clones":0,"num_object_copies":1024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":512,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21322,"num_write_kb":698688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.8","version":"353'20919","reported_seq":21351,"reported_epoch":353,"state":"active+clean","last_fresh":"2024-04-01T19:38:51.001928+0000","last_change":"2024-04-01T19:38:39.376172+0000","last_active":"2024-04-01T19:38:51.001928+0000","last_peered":"2024-04-01T19:38:51.001928+0000","last_clean":"2024-04-01T19:38:51.001928+0000","last_became_active":"2024-04-01T19:33:59.258615+0000","last_became_peered":"2024-04-01T19:33:59.258615+0000","last_unstale":"2024-04-01T19:38:51.001928+0000","last_undegraded":"2024-04-01T19:38:51.001928+0000","last_fullsized":"2024-04-01T19:38:51.001928+0000","mapping_epoch":267,"log_start":"296'10900","ondisk_log_start":"296'10900","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"353'20030","last_scrub_stamp":"2024-04-01T19:38:39.376045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:38:39.376045+0000","objects_scrubbed":1414,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:39:45.179249+0000","scrub_duration":304,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33488896,"num_objects":511,"num_object_clones":0,"num_object_copies":1022,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":511,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20919,"num_write_kb":685760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.7","version":"353'20883","reported_seq":21307,"reported_epoch":353,"state":"active+clean","last_fresh":"2024-04-01T19:38:49.713653+0000","last_change":"2024-04-01T19:38:12.745917+0000","last_active":"2024-04-01T19:38:49.713653+0000","last_peered":"2024-04-01T19:38:49.713653+0000","last_clean":"2024-04-01T19:38:49.713653+0000","last_became_active":"2024-04-01T19:33:59.258696+0000","last_became_peered":"2024-04-01T19:33:59.258696+0000","last_unstale":"2024-04-01T19:38:49.713653+0000","last_undegraded":"2024-04-01T19:38:49.713653+0000","last_fullsized":"2024-04-01T19:38:49.713653+0000","mapping_epoch":267,"log_start":"295'10800","ondisk_log_start":"295'10800","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"347'18021","last_scrub_stamp":"2024-04-01T19:38:12.745666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:38:12.745666+0000","objects_scrubbed":3510,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:39:30.290777+0000","scrub_duration":1090,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39911424,"num_objects":609,"num_object_clones":0,"num_object_copies":1218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":609,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20883,"num_write_kb":687744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"353'20711","reported_seq":21104,"reported_epoch":353,"state":"active+clean","last_fresh":"2024-04-01T19:38:50.000057+0000","last_change":"2024-04-01T19:38:41.528389+0000","last_active":"2024-04-01T19:38:50.000057+0000","last_peered":"2024-04-01T19:38:50.000057+0000","last_clean":"2024-04-01T19:38:50.000057+0000","last_became_active":"2024-04-01T19:33:59.105657+0000","last_became_peered":"2024-04-01T19:33:59.105657+0000","last_unstale":"2024-04-01T19:38:50.000057+0000","last_undegraded":"2024-04-01T19:38:50.000057+0000","last_fullsized":"2024-04-01T19:38:50.000057+0000","mapping_epoch":267,"log_start":"295'10700","ondisk_log_start":"295'10700","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"353'20096","last_scrub_stamp":"2024-04-01T19:38:41.528180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:38:41.528180+0000","objects_scrubbed":1264,"log_size":10011,"log_dups_size":0,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:39:58.214694+0000","scrub_duration":239,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41746432,"num_objects":637,"num_object_clones":0,"num_object_copies":1274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":637,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20711,"num_write_kb":683136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.4","version":"353'20907","reported_seq":21297,"reported_epoch":353,"state":"active+clean","last_fresh":"2024-04-01T19:38:49.724088+0000","last_change":"2024-04-01T19:38:44.895328+0000","last_active":"2024-04-01T19:38:49.724088+0000","last_peered":"2024-04-01T19:38:49.724088+0000","last_clean":"2024-04-01T19:38:49.724088+0000","last_became_active":"2024-04-01T19:33:59.257653+0000","last_became_peered":"2024-04-01T19:33:59.257653+0000","last_unstale":"2024-04-01T19:38:49.724088+0000","last_undegraded":"2024-04-01T19:38:49.724088+0000","last_fullsized":"2024-04-01T19:38:49.724088+0000","mapping_epoch":267,"log_start":"296'10900","ondisk_log_start":"296'10900","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"353'20541","last_scrub_stamp":"2024-04-01T19:38:44.895186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:38:44.895186+0000","objects_scrubbed":1011,"log_size":10007,"log_dups_size":0,"ondisk_log_size":10007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:40:12.161504+0000","scrub_duration":332,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41484288,"num_objects":633,"num_object_clones":0,"num_object_copies":1266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":633,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20907,"num_write_kb":689280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"353'20800","reported_seq":21234,"reported_epoch":353,"state":"active+clean","last_fresh":"2024-04-01T19:38:51.022982+0000","last_change":"2024-04-01T19:37:55.515929+0000","last_active":"2024-04-01T19:38:51.022982+0000","last_peered":"2024-04-01T19:38:51.022982+0000","last_clean":"2024-04-01T19:38:51.022982+0000","last_became_active":"2024-04-01T19:33:59.258172+0000","last_became_peered":"2024-04-01T19:33:59.258172+0000","last_unstale":"2024-04-01T19:38:51.022982+0000","last_undegraded":"2024-04-01T19:38:51.022982+0000","last_fullsized":"2024-04-01T19:38:51.022982+0000","mapping_epoch":267,"log_start":"295'10700","ondisk_log_start":"295'10700","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"337'17073","last_scrub_stamp":"2024-04-01T19:37:55.515753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:37:55.515753+0000","objects_scrubbed":4290,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:39:03.945051+0000","scrub_duration":817,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34865152,"num_objects":532,"num_object_clones":0,"num_object_copies":1064,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":532,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20800,"num_write_kb":682624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"353'20953","reported_seq":21484,"reported_epoch":353,"state":"active+clean","last_fresh":"2024-04-01T19:38:49.971637+0000","last_change":"2024-04-01T19:38:00.712953+0000","last_active":"2024-04-01T19:38:49.971637+0000","last_peered":"2024-04-01T19:38:49.971637+0000","last_clean":"2024-04-01T19:38:49.971637+0000","last_became_active":"2024-04-01T19:33:59.102135+0000","last_became_peered":"2024-04-01T19:33:59.102135+0000","last_unstale":"2024-04-01T19:38:49.971637+0000","last_undegraded":"2024-04-01T19:38:49.971637+0000","last_fullsized":"2024-04-01T19:38:49.971637+0000","mapping_epoch":267,"log_start":"296'10900","ondisk_log_start":"296'10900","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"340'17480","last_scrub_stamp":"2024-04-01T19:38:00.712799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:38:00.712799+0000","objects_scrubbed":4099,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:39:01.840802+0000","scrub_duration":691,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40042496,"num_objects":611,"num_object_clones":0,"num_object_copies":1222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":611,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20953,"num_write_kb":690048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5],"acting":[9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1","version":"353'23240","reported_seq":23713,"reported_epoch":353,"state":"active+clean","last_fresh":"2024-04-01T19:38:51.004789+0000","last_change":"2024-04-01T19:38:44.236517+0000","last_active":"2024-04-01T19:38:51.004789+0000","last_peered":"2024-04-01T19:38:51.004789+0000","last_clean":"2024-04-01T19:38:51.004789+0000","last_became_active":"2024-04-01T19:33:59.105816+0000","last_became_peered":"2024-04-01T19:33:59.105816+0000","last_unstale":"2024-04-01T19:38:51.004789+0000","last_undegraded":"2024-04-01T19:38:51.004789+0000","last_fullsized":"2024-04-01T19:38:51.004789+0000","mapping_epoch":267,"log_start":"319'13200","ondisk_log_start":"319'13200","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"353'22700","last_scrub_stamp":"2024-04-01T19:38:44.236425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:38:44.236425+0000","objects_scrubbed":1069,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:40:08.817911+0000","scrub_duration":222,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34471936,"num_objects":526,"num_object_clones":0,"num_object_copies":1052,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":526,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21104,"num_write_kb":692160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.0","version":"353'20986","reported_seq":21424,"reported_epoch":353,"state":"active+clean","last_fresh":"2024-04-01T19:38:52.591364+0000","last_change":"2024-04-01T19:38:01.434387+0000","last_active":"2024-04-01T19:38:52.591364+0000","last_peered":"2024-04-01T19:38:52.591364+0000","last_clean":"2024-04-01T19:38:52.591364+0000","last_became_active":"2024-04-01T19:33:59.258519+0000","last_became_peered":"2024-04-01T19:33:59.258519+0000","last_unstale":"2024-04-01T19:38:52.591364+0000","last_undegraded":"2024-04-01T19:38:52.591364+0000","last_fullsized":"2024-04-01T19:38:52.591364+0000","mapping_epoch":267,"log_start":"296'10900","ondisk_log_start":"296'10900","created":267,"last_epoch_clean":268,"parent":"0.0","parent_split_bits":0,"last_scrub":"340'17370","last_scrub_stamp":"2024-04-01T19:38:01.434290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:38:01.434290+0000","objects_scrubbed":4026,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:39:19.828262+0000","scrub_duration":467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26476544,"num_objects":404,"num_object_clones":0,"num_object_copies":808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":404,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20986,"num_write_kb":684480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"353'23777","reported_seq":47055,"reported_epoch":353,"state":"active+clean","last_fresh":"2024-04-01T19:38:50.828051+0000","last_change":"2024-04-01T19:38:36.950037+0000","last_active":"2024-04-01T19:38:50.828051+0000","last_peered":"2024-04-01T19:38:50.828051+0000","last_clean":"2024-04-01T19:38:50.828051+0000","last_became_active":"2024-04-01T19:38:08.141459+0000","last_became_peered":"2024-04-01T19:38:08.141459+0000","last_unstale":"2024-04-01T19:38:50.828051+0000","last_undegraded":"2024-04-01T19:38:50.828051+0000","last_fullsized":"2024-04-01T19:38:50.828051+0000","mapping_epoch":345,"log_start":"320'13702","ondisk_log_start":"320'13702","created":267,"last_epoch_clean":346,"parent":"0.0","parent_split_bits":0,"last_scrub":"353'22745","last_scrub_stamp":"2024-04-01T19:38:36.949837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:33:58.088058+0000","last_clean_scrub_stamp":"2024-04-01T19:38:36.949837+0000","objects_scrubbed":1590,"log_size":10075,"log_dups_size":0,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:39:47.276538+0000","scrub_duration":307,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35520512,"num_objects":542,"num_object_clones":0,"num_object_copies":1084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":542,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20778,"num_write_kb":682240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11367,"num_bytes_recovered":744947712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":929,"reported_epoch":353,"state":"active+clean","last_fresh":"2024-04-01T19:38:35.536192+0000","last_change":"2024-04-01T19:37:50.740649+0000","last_active":"2024-04-01T19:38:35.536192+0000","last_peered":"2024-04-01T19:38:35.536192+0000","last_clean":"2024-04-01T19:38:35.536192+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:38:35.536192+0000","last_undegraded":"2024-04-01T19:38:35.536192+0000","last_fullsized":"2024-04-01T19:38:35.536192+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:37:50.740555+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:37:50.740555+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:39:13.782517+0000","scrub_duration":94,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":569704472,"num_objects":8694,"num_object_clones":0,"num_object_copies":17388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8694,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":335290,"num_write_kb":11007425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21636,"num_bytes_recovered":1417936896,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1164189696,"data_stored":1164181552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":294873,"internal_metadata":0},"log_size":160663,"ondisk_log_size":160663,"up":32,"acting":32,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220355,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":665048,"kb_used_data":156304,"kb_used_omap":1,"kb_used_meta":508734,"kb_avail":93080104,"statfs":{"total":95995035648,"available":95314026496,"internally_reserved":0,"allocated":160055296,"data_stored":159687601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":520944068},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":77,"seq":330712481991,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":306256,"kb_used_data":86280,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":93438896,"statfs":{"total":95995035648,"available":95681429504,"internally_reserved":0,"allocated":88350720,"data_stored":87986577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":225245632},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678222,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":435988,"kb_used_data":129932,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":93309164,"statfs":{"total":95995035648,"available":95548583936,"internally_reserved":0,"allocated":133050368,"data_stored":132682173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":313391552},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":0,"seq":846108557418,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234199,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":487448,"kb_used_data":155024,"kb_used_omap":1,"kb_used_meta":332414,"kb_avail":93257704,"statfs":{"total":95995035648,"available":95495888896,"internally_reserved":0,"allocated":158744576,"data_stored":158376901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":340392394},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":335,"seq":1438814044174,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":121552,"kb_used_data":72264,"kb_used_omap":292,"kb_used_meta":48987,"kb_avail":93623600,"statfs":{"total":95995035648,"available":95870566400,"internally_reserved":0,"allocated":73998336,"data_stored":73634213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":299281,"internal_metadata":50163439},"hb_peers":[0,1,2,3,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575093,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":665872,"kb_used_data":283464,"kb_used_omap":1,"kb_used_meta":382398,"kb_avail":93079280,"statfs":{"total":95995035648,"available":95313182720,"internally_reserved":0,"allocated":290267136,"data_stored":289903013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":391576005},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738620,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":302736,"kb_used_data":36936,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93442416,"statfs":{"total":95995035648,"available":95685033984,"internally_reserved":0,"allocated":37822464,"data_stored":37458341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346162,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":172368,"kb_used_data":38472,"kb_used_omap":1,"kb_used_meta":133886,"kb_avail":93572784,"statfs":{"total":95995035648,"available":95818530816,"internally_reserved":0,"allocated":39395328,"data_stored":39031205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":137099717},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149931,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":442512,"kb_used_data":86472,"kb_used_omap":1,"kb_used_meta":356030,"kb_avail":93302640,"statfs":{"total":95995035648,"available":95541903360,"internally_reserved":0,"allocated":88547328,"data_stored":88183205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":364575175},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953702,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":461268,"kb_used_data":101068,"kb_used_omap":1,"kb_used_meta":360190,"kb_avail":93283884,"statfs":{"total":95995035648,"available":95522697216,"internally_reserved":0,"allocated":103493632,"data_stored":103125437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":368835013},"hb_peers":[0,1,2,3,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790178,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":290000,"kb_used_data":78344,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":93455152,"statfs":{"total":95995035648,"available":95698075648,"internally_reserved":0,"allocated":80224256,"data_stored":79860133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":216725957},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":37093376,"data_stored":37093376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":286523392,"data_stored":286523392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33619968,"data_stored":33619968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":78512128,"data_stored":78512128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":95162368,"data_stored":95158296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":74055680,"data_stored":74055680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":70582272,"data_stored":70582272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":294873,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":145162240,"data_stored":145162240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":121049088,"data_stored":121045016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86114304,"data_stored":86114304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":136314880,"data_stored":136314880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:38:55.478 INFO:tasks.thrashosds.thrasher:Setting 4.8 to [1, 7, 6, 4] 2024-04-01T19:38:55.478 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.8', '1', '7', '6', '4'] 2024-04-01T19:38:55.478 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pg-upmap-items 4.8 1 7 6 4 2024-04-01T19:38:55.537 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:38:55.567 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:55.589 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:38:55.599 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:55.600 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:38:55.643 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:38:55.700 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:38:55.776 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:55.867 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:55 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:55.867 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:55 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:55.867 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:55 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1307325271' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:38:55.868 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:55 smithi022 ceph-mon[39439]: from='client.35885 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:38:55.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:55 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:55.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:55 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:55.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:55 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1307325271' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:38:55.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:55 smithi188 ceph-mon[43939]: from='client.35885 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:38:56.001 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:38:56.004 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:56.005 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:38:56.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:55 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:56.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:55 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:38:56.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:55 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1307325271' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:38:56.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:55 smithi062 ceph-mon[44211]: from='client.35885 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:38:56.106 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:38:56.139 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:56.164 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:38:56.167 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:56.168 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:38:56.263 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:38:56.269 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:38:56.333 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:56.388 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:38:56.401 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:56.401 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:38:56.502 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:38:56.534 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:56.559 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:38:56.565 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:56.566 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:38:56.667 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:38:56.724 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:56.837 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:38:56.846 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:56.847 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:38:56.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:56 smithi188 ceph-mon[43939]: pgmap v1016: 17 pgs: 17 active+clean; 473 MiB data, 3.9 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:38:56.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:56 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:38:56.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:56 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:38:56.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:56 smithi188 ceph-mon[43939]: from='client.35885 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:38:56.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:56 smithi188 ceph-mon[43939]: osdmap e355: 12 total, 12 up, 11 in 2024-04-01T19:38:56.878 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:56 smithi022 ceph-mon[39439]: pgmap v1016: 17 pgs: 17 active+clean; 473 MiB data, 3.9 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:38:56.878 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:56 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:38:56.878 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:56 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:38:56.878 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:56 smithi022 ceph-mon[39439]: from='client.35885 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:38:56.878 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:56 smithi022 ceph-mon[39439]: osdmap e355: 12 total, 12 up, 11 in 2024-04-01T19:38:56.948 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:38:57.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:56 smithi062 ceph-mon[44211]: pgmap v1016: 17 pgs: 17 active+clean; 473 MiB data, 3.9 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:38:57.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:56 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:38:57.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:56 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:38:57.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:56 smithi062 ceph-mon[44211]: from='client.35885 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:38:57.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:56 smithi062 ceph-mon[44211]: osdmap e355: 12 total, 12 up, 11 in 2024-04-01T19:38:57.011 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:57.086 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:38:57.093 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:57.094 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:38:57.195 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:38:57.235 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:57.368 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:38:57.373 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:57.374 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:38:57.475 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:38:57.509 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:57.535 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:38:57.538 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:57.539 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:38:57.639 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:38:57.678 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:57.706 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:38:57.713 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:38:57.713 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:57.714 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:38:57.815 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:38:57.833 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Removed 171991 objects 2024-04-01T19:38:57.833 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Clean up completed and total clean up time :202.241 2024-04-01T19:38:57.845 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:57.863 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:38:57.865 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:38:57.866 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:38:57.967 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:38:57.997 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:38:58.019 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:38:58.457 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_2 2024-04-01T19:38:58.457 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pool rm unique_pool_2 unique_pool_2 --yes-i-really-really-mean-it 2024-04-01T19:38:58.725 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:38:58 smithi022 ceph-mon[39439]: pgmap v1018: 17 pgs: 17 active+clean; 180 MiB data, 3.5 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 1.49k op/s 2024-04-01T19:38:58.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:38:58 smithi188 ceph-mon[43939]: pgmap v1018: 17 pgs: 17 active+clean; 180 MiB data, 3.5 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 1.49k op/s 2024-04-01T19:38:58.876 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:38:59.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:38:58 smithi062 ceph-mon[44211]: pgmap v1018: 17 pgs: 17 active+clean; 180 MiB data, 3.5 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 1.49k op/s 2024-04-01T19:38:59.676 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:38:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:38:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 0 2024-04-01T19:38:59.677 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:39:00.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:00 smithi188 ceph-mon[43939]: pgmap v1019: 17 pgs: 17 active+clean; 156 MiB data, 3.3 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:39:01.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:00 smithi062 ceph-mon[44211]: pgmap v1019: 17 pgs: 17 active+clean; 156 MiB data, 3.3 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:39:01.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:00 smithi022 ceph-mon[39439]: pgmap v1019: 17 pgs: 17 active+clean; 156 MiB data, 3.3 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:39:01.350 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:39:01.353 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:01.354 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:39:01.455 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:39:01.488 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:01.614 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:39:01.618 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:01.618 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:39:01.719 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:39:01.751 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:01.772 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:39:01.775 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:01.775 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:39:01.876 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:39:01.905 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:01.907 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:39:01.925 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:39:01.928 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:01.928 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:39:02.029 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:39:02.062 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:02.084 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:39:02.086 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:02.087 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:39:02.188 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:39:02.218 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:02.238 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:39:02.240 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:02.241 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:39:02.341 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_blocked_ops 2024-04-01T19:39:02.342 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:39:02.372 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:02.379 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:39:02.626 INFO:teuthology.orchestra.run.smithi022.stderr:set 4.8 pg_upmap_items mapping to [1->7,6->4] 2024-04-01T19:39:02.629 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:39:02.635 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:02.635 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:39:02.736 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:39:02.765 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:02.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:02 smithi022 ceph-mon[39439]: pgmap v1020: 17 pgs: 17 active+clean; 53 MiB data, 3.1 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 981 op/s 2024-04-01T19:39:02.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:02 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:39:02.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:02 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:39:02.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:02 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3374551250' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "4.8", "id": [1, 7, 6, 4]}]: dispatch 2024-04-01T19:39:03.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:02 smithi062 ceph-mon[44211]: pgmap v1020: 17 pgs: 17 active+clean; 53 MiB data, 3.1 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 981 op/s 2024-04-01T19:39:03.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:02 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:39:03.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:02 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:39:03.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:02 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3374551250' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "4.8", "id": [1, 7, 6, 4]}]: dispatch 2024-04-01T19:39:03.067 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:39:03.071 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:03.071 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:39:03.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:02 smithi188 ceph-mon[43939]: pgmap v1020: 17 pgs: 17 active+clean; 53 MiB data, 3.1 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 981 op/s 2024-04-01T19:39:03.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:02 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:39:03.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:02 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:39:03.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:02 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3374551250' entity='client.admin' cmd=[{"prefix": "osd pg-upmap-items", "pgid": "4.8", "id": [1, 7, 6, 4]}]: dispatch 2024-04-01T19:39:03.172 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:39:03.205 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:03.227 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:39:03.230 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:03.230 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:39:03.331 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:39:03.362 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:03.384 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:39:03.386 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:03.387 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:39:03.487 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:39:03.519 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:03.540 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:39:03.543 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:03.543 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:39:03.644 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:39:03.677 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:03.699 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:39:03.702 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:03.702 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:39:03.803 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:39:03.832 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:03 smithi022 ceph-mon[39439]: 4.2 scrub starts 2024-04-01T19:39:03.832 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:03 smithi022 ceph-mon[39439]: 4.2 scrub ok 2024-04-01T19:39:03.832 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:03 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3374551250' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "4.8", "id": [1, 7, 6, 4]}]': finished 2024-04-01T19:39:03.832 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:03 smithi022 ceph-mon[39439]: osdmap e356: 12 total, 12 up, 11 in 2024-04-01T19:39:03.835 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:03.873 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:39:03.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:03 smithi188 ceph-mon[43939]: 4.2 scrub starts 2024-04-01T19:39:03.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:03 smithi188 ceph-mon[43939]: 4.2 scrub ok 2024-04-01T19:39:03.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:03 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3374551250' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "4.8", "id": [1, 7, 6, 4]}]': finished 2024-04-01T19:39:03.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:03 smithi188 ceph-mon[43939]: osdmap e356: 12 total, 12 up, 11 in 2024-04-01T19:39:03.876 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:03.876 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:39:03.977 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:39:04.008 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:04.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:03 smithi062 ceph-mon[44211]: 4.2 scrub starts 2024-04-01T19:39:04.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:03 smithi062 ceph-mon[44211]: 4.2 scrub ok 2024-04-01T19:39:04.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:03 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3374551250' entity='client.admin' cmd='[{"prefix": "osd pg-upmap-items", "pgid": "4.8", "id": [1, 7, 6, 4]}]': finished 2024-04-01T19:39:04.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:03 smithi062 ceph-mon[44211]: osdmap e356: 12 total, 12 up, 11 in 2024-04-01T19:39:04.028 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:39:04.031 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:04.031 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:39:04.132 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:39:04.161 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:04.180 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:39:04.183 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:04.183 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:39:04.284 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:39:04.315 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:04.416 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:39:04.419 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:04.419 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:39:04.520 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:39:04.548 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:04.568 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:39:04.570 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:04.571 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:39:04.672 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:39:04.763 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:04.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:04 smithi188 ceph-mon[43939]: pgmap v1022: 17 pgs: 17 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 945 op/s 2024-04-01T19:39:05.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:04 smithi062 ceph-mon[44211]: pgmap v1022: 17 pgs: 17 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 945 op/s 2024-04-01T19:39:05.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:04 smithi022 ceph-mon[39439]: pgmap v1022: 17 pgs: 17 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 945 op/s 2024-04-01T19:39:05.217 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:39:05.220 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:05.220 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:39:05.321 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:39:05.351 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:05.552 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:39:05.554 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:05.554 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:39:05.655 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:39:05.687 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:05.708 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:39:05.711 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:05.711 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:39:05.812 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:39:05.842 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:05.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:05 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:39:05.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:05 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:39:05.861 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:39:05.864 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:05.865 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:39:05.966 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:39:05.996 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:05 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:39:05.996 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:05 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:39:05.999 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:06.020 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:39:06.023 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:06.023 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:39:06.123 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:39:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:05 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:39:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:05 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:39:06.154 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:06.174 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:39:06.177 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:06.177 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:39:06.178 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:39:06.183 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:39:06.221 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:39:06.240 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:39:06.259 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:39:06.278 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:39:06.279 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:39:06.298 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:39:06.310 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:06.318 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:39:06.332 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:39:06.334 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:06.335 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:39:06.338 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:39:06.357 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:39:06.377 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:39:06.397 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:39:06.417 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:39:06.436 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:39:06.441 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:39:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:39:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:39:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:39:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:39:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:39:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:39:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:39:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:39:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:39:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:39:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:39:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:39:06.466 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:06.486 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:39:06.489 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:06.489 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:39:06.590 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:39:06.622 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:06.643 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:39:06.646 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:06.647 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:39:06.649 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:39:06.748 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:39:06.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:06 smithi062 ceph-mon[44211]: pgmap v1023: 17 pgs: 17 active+clean; 577 KiB data, 2.9 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 683 op/s 2024-04-01T19:39:06.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:06 smithi062 ceph-mon[44211]: osdmap e357: 12 total, 12 up, 11 in 2024-04-01T19:39:06.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:06 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1951318339' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:39:06.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:06 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2890955725' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:39:06.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:06.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:06.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:06.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:06.777 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:06.797 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:39:06.800 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:06.800 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:39:06.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:06 smithi022 ceph-mon[39439]: pgmap v1023: 17 pgs: 17 active+clean; 577 KiB data, 2.9 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 683 op/s 2024-04-01T19:39:06.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:06 smithi022 ceph-mon[39439]: osdmap e357: 12 total, 12 up, 11 in 2024-04-01T19:39:06.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:06 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1951318339' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:39:06.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:06 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2890955725' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:39:06.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:06.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:06.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:06.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:06.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:06 smithi188 ceph-mon[43939]: pgmap v1023: 17 pgs: 17 active+clean; 577 KiB data, 2.9 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 683 op/s 2024-04-01T19:39:06.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:06 smithi188 ceph-mon[43939]: osdmap e357: 12 total, 12 up, 11 in 2024-04-01T19:39:06.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:06 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1951318339' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:39:06.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:06 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2890955725' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:39:06.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:06.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:06.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:06.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:06.901 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:39:06.929 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:06.949 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:39:06.951 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:06.952 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:39:07.053 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:39:07.088 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:07.109 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:39:07.112 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:07.112 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:39:07.213 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:39:07.243 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:07.264 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:39:07.266 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:07.267 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:39:07.368 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:39:07.401 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:07.421 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:39:07.424 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:07.424 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:39:07.525 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:39:07.555 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:07.574 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:39:07.577 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:07.577 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:39:07.678 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:39:07.704 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:07.704 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:07.704 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:07.704 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:07.704 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:07.704 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:07.704 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:07.704 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:07.704 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:07 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:39:07.704 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:07 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1951318339' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:39:07.705 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:07 smithi188 ceph-mon[43939]: osdmap e358: 12 total, 12 up, 11 in 2024-04-01T19:39:07.706 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:07.725 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:39:07.728 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:07.728 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:39:07.829 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:39:07.857 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:07.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:07.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:07.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:07.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:07.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:07.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:07.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:07.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:07.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:07 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:39:07.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:07 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1951318339' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:39:07.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:07 smithi022 ceph-mon[39439]: osdmap e358: 12 total, 12 up, 11 in 2024-04-01T19:39:07.875 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:39:07.877 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:07.878 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:39:07.979 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:39:08.008 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:08.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:07 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:39:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:07 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1951318339' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:39:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:07 smithi062 ceph-mon[44211]: osdmap e358: 12 total, 12 up, 11 in 2024-04-01T19:39:09.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:08 smithi062 ceph-mon[44211]: pgmap v1026: 17 pgs: 17 active+clean; 577 KiB data, 2.9 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 139 op/s 2024-04-01T19:39:09.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:08 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:39:09.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:08 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:39:09.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:08 smithi022 ceph-mon[39439]: pgmap v1026: 17 pgs: 17 active+clean; 577 KiB data, 2.9 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 139 op/s 2024-04-01T19:39:09.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:08 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:39:09.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:08 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:39:09.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:08 smithi188 ceph-mon[43939]: pgmap v1026: 17 pgs: 17 active+clean; 577 KiB data, 2.9 GiB used, 980 GiB / 983 GiB avail; 0 B/s wr, 139 op/s 2024-04-01T19:39:09.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:08 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:39:09.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:08 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:39:09.759 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:39:09.762 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:09.763 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:39:09.783 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:39:09.783 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:39:09.788 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 9, 10, 11, 6] out_osds: [8] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 7, 9, 10, 11, 8, 6] 2024-04-01T19:39:09.789 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-01T19:39:09.789 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-01T19:39:09.789 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd dump -f json-pretty 2024-04-01T19:39:09.810 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:09 smithi022 ceph-mon[39439]: osdmap e359: 12 total, 12 up, 11 in 2024-04-01T19:39:09.864 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:39:09.897 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:09.919 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:39:09.920 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:09 smithi062 ceph-mon[44211]: osdmap e359: 12 total, 12 up, 11 in 2024-04-01T19:39:09.922 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:09.922 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:39:10.023 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:39:10.055 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:10.076 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:39:10.079 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:10.079 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:39:10.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:09 smithi188 ceph-mon[43939]: osdmap e359: 12 total, 12 up, 11 in 2024-04-01T19:39:10.180 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:39:10.211 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:10.233 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:39:10.235 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:10.236 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:39:10.337 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:39:10.366 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:10.386 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:39:10.389 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:10.389 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:39:10.490 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:39:10.519 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:10.538 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:39:10.541 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:10.541 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:39:10.642 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:39:10.676 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:10.697 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:39:10.700 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:10.700 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:39:10.800 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:39:10.801 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:39:10.826 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:10 smithi188 ceph-mon[43939]: pgmap v1028: 17 pgs: 17 active+clean; 577 KiB data, 2.9 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:10.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:10 smithi022 ceph-mon[39439]: pgmap v1028: 17 pgs: 17 active+clean; 577 KiB data, 2.9 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:10.828 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:10.847 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:39:10.849 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:10.850 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:39:10.951 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:39:10.981 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:10 smithi062 ceph-mon[44211]: pgmap v1028: 17 pgs: 17 active+clean; 577 KiB data, 2.9 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:10.984 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:11.005 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:39:11.008 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:11.009 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:39:11.109 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:39:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:11.162 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:39:11.165 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:11.166 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:39:11.181 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_historic_ops 2024-04-01T19:39:11.234 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:39:11.266 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:39:11.300 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:11.321 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:39:11.324 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:11.324 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:39:11.425 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:39:11.469 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:11.474 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:39:11.483 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:39:11.500 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:39:11.503 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:11.503 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:39:11.604 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:39:11.635 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:11.657 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:39:11.659 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:11.660 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:39:11.761 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:39:11.790 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:11.810 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:39:11.812 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:11.813 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:39:11.914 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:39:11.947 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:11.969 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:39:11.972 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:11.972 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:39:12.073 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:39:12.103 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:12.123 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:39:12.125 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:12.126 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:39:12.227 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:39:12.258 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:12.279 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:39:12.281 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:12.282 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:39:12.383 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:39:12.408 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:39:12.414 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:12.435 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:39:12.438 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:12.439 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:39:12.540 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:39:12.569 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:12.672 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'unique_pool_2' removed 2024-04-01T19:39:12.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:12 smithi022 ceph-mon[39439]: pgmap v1029: 17 pgs: 17 active+clean; 577 KiB data, 2.9 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:12.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:12 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1452820174' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:39:13.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:12 smithi062 ceph-mon[44211]: pgmap v1029: 17 pgs: 17 active+clean; 577 KiB data, 2.9 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:13.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:12 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1452820174' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:39:13.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:12 smithi188 ceph-mon[43939]: pgmap v1029: 17 pgs: 17 active+clean; 577 KiB data, 2.9 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:13.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:12 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1452820174' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:39:14.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:13 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1452820174' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T19:39:14.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:13 smithi062 ceph-mon[44211]: osdmap e360: 12 total, 12 up, 11 in 2024-04-01T19:39:14.077 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:13 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1452820174' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T19:39:14.077 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:13 smithi022 ceph-mon[39439]: osdmap e360: 12 total, 12 up, 11 in 2024-04-01T19:39:14.107 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-04-01T19:39:14.107 INFO:tasks.radosbench:Beginning radosbench... 2024-04-01T19:39:14.107 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_3 2024-04-01T19:39:14.108 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pool create unique_pool_3 16 2024-04-01T19:39:14.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:13 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1452820174' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T19:39:14.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:13 smithi188 ceph-mon[43939]: osdmap e360: 12 total, 12 up, 11 in 2024-04-01T19:39:14.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:14 smithi022 ceph-mon[39439]: pgmap v1031: 1 pgs: 1 active+clean; 577 KiB data, 2.9 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:15.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:14 smithi062 ceph-mon[44211]: pgmap v1031: 1 pgs: 1 active+clean; 577 KiB data, 2.9 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:15.021 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:39:15.023 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:15.023 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:39:15.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:14 smithi188 ceph-mon[43939]: pgmap v1031: 1 pgs: 1 active+clean; 577 KiB data, 2.9 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:15.124 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:39:15.155 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:15.330 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:39:15.504 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:39:15.507 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:15.508 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:39:15.569 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:39:15.569 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:39:15.569 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 360, 2024-04-01T19:39:15.569 INFO:teuthology.orchestra.run.smithi022.stdout: "fsid": "09f6b846-f05c-11ee-b647-cb9ed24678a4", 2024-04-01T19:39:15.569 INFO:teuthology.orchestra.run.smithi022.stdout: "created": "2024-04-01T19:15:34.344221+0000", 2024-04-01T19:39:15.569 INFO:teuthology.orchestra.run.smithi022.stdout: "modified": "2024-04-01T19:39:12.664456+0000", 2024-04-01T19:39:15.569 INFO:teuthology.orchestra.run.smithi022.stdout: "last_up_change": "2024-04-01T19:37:45.832405+0000", 2024-04-01T19:39:15.570 INFO:teuthology.orchestra.run.smithi022.stdout: "last_in_change": "2024-04-01T19:38:21.274265+0000", 2024-04-01T19:39:15.570 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-01T19:39:15.570 INFO:teuthology.orchestra.run.smithi022.stdout: "flags_num": 5801984, 2024-04-01T19:39:15.570 INFO:teuthology.orchestra.run.smithi022.stdout: "flags_set": [ 2024-04-01T19:39:15.570 INFO:teuthology.orchestra.run.smithi022.stdout: "noscrub", 2024-04-01T19:39:15.570 INFO:teuthology.orchestra.run.smithi022.stdout: "pglog_hardlimit", 2024-04-01T19:39:15.570 INFO:teuthology.orchestra.run.smithi022.stdout: "purged_snapdirs", 2024-04-01T19:39:15.570 INFO:teuthology.orchestra.run.smithi022.stdout: "recovery_deletes", 2024-04-01T19:39:15.570 INFO:teuthology.orchestra.run.smithi022.stdout: "sortbitwise" 2024-04-01T19:39:15.570 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T19:39:15.570 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_version": 29, 2024-04-01T19:39:15.570 INFO:teuthology.orchestra.run.smithi022.stdout: "full_ratio": 0.94999998807907104, 2024-04-01T19:39:15.570 INFO:teuthology.orchestra.run.smithi022.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-01T19:39:15.570 INFO:teuthology.orchestra.run.smithi022.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-01T19:39:15.571 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_snapshot": "", 2024-04-01T19:39:15.571 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_max": 4, 2024-04-01T19:39:15.571 INFO:teuthology.orchestra.run.smithi022.stdout: "max_osd": 12, 2024-04-01T19:39:15.571 INFO:teuthology.orchestra.run.smithi022.stdout: "require_min_compat_client": "luminous", 2024-04-01T19:39:15.571 INFO:teuthology.orchestra.run.smithi022.stdout: "min_compat_client": "jewel", 2024-04-01T19:39:15.571 INFO:teuthology.orchestra.run.smithi022.stdout: "require_osd_release": "squid", 2024-04-01T19:39:15.571 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_crimson": false, 2024-04-01T19:39:15.571 INFO:teuthology.orchestra.run.smithi022.stdout: "pools": [ 2024-04-01T19:39:15.571 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.571 INFO:teuthology.orchestra.run.smithi022.stdout: "pool": 1, 2024-04-01T19:39:15.571 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_name": ".mgr", 2024-04-01T19:39:15.571 INFO:teuthology.orchestra.run.smithi022.stdout: "create_time": "2024-04-01T19:18:34.605751+0000", 2024-04-01T19:39:15.571 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-04-01T19:39:15.571 INFO:teuthology.orchestra.run.smithi022.stdout: "flags_names": "hashpspool", 2024-04-01T19:39:15.571 INFO:teuthology.orchestra.run.smithi022.stdout: "type": 1, 2024-04-01T19:39:15.571 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 2, 2024-04-01T19:39:15.572 INFO:teuthology.orchestra.run.smithi022.stdout: "min_size": 2, 2024-04-01T19:39:15.572 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_rule": 0, 2024-04-01T19:39:15.572 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_count": 0, 2024-04-01T19:39:15.572 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_target": 0, 2024-04-01T19:39:15.572 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_barrier": 0, 2024-04-01T19:39:15.572 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-01T19:39:15.572 INFO:teuthology.orchestra.run.smithi022.stdout: "object_hash": 2, 2024-04-01T19:39:15.572 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscale_mode": "off", 2024-04-01T19:39:15.572 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num": 1, 2024-04-01T19:39:15.572 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_placement_num": 1, 2024-04-01T19:39:15.572 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_placement_num_target": 1, 2024-04-01T19:39:15.572 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num_target": 1, 2024-04-01T19:39:15.572 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num_pending": 1, 2024-04-01T19:39:15.572 INFO:teuthology.orchestra.run.smithi022.stdout: "last_pg_merge_meta": { 2024-04-01T19:39:15.572 INFO:teuthology.orchestra.run.smithi022.stdout: "source_pgid": "0.0", 2024-04-01T19:39:15.572 INFO:teuthology.orchestra.run.smithi022.stdout: "ready_epoch": 0, 2024-04-01T19:39:15.573 INFO:teuthology.orchestra.run.smithi022.stdout: "last_epoch_started": 0, 2024-04-01T19:39:15.573 INFO:teuthology.orchestra.run.smithi022.stdout: "last_epoch_clean": 0, 2024-04-01T19:39:15.573 INFO:teuthology.orchestra.run.smithi022.stdout: "source_version": "0'0", 2024-04-01T19:39:15.573 INFO:teuthology.orchestra.run.smithi022.stdout: "target_version": "0'0" 2024-04-01T19:39:15.573 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.573 INFO:teuthology.orchestra.run.smithi022.stdout: "last_change": "16", 2024-04-01T19:39:15.573 INFO:teuthology.orchestra.run.smithi022.stdout: "last_force_op_resend": "0", 2024-04-01T19:39:15.573 INFO:teuthology.orchestra.run.smithi022.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-01T19:39:15.573 INFO:teuthology.orchestra.run.smithi022.stdout: "last_force_op_resend_preluminous": "0", 2024-04-01T19:39:15.573 INFO:teuthology.orchestra.run.smithi022.stdout: "auid": 0, 2024-04-01T19:39:15.573 INFO:teuthology.orchestra.run.smithi022.stdout: "snap_mode": "selfmanaged", 2024-04-01T19:39:15.573 INFO:teuthology.orchestra.run.smithi022.stdout: "snap_seq": 0, 2024-04-01T19:39:15.573 INFO:teuthology.orchestra.run.smithi022.stdout: "snap_epoch": 0, 2024-04-01T19:39:15.573 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_snaps": [], 2024-04-01T19:39:15.573 INFO:teuthology.orchestra.run.smithi022.stdout: "removed_snaps": "[]", 2024-04-01T19:39:15.574 INFO:teuthology.orchestra.run.smithi022.stdout: "quota_max_bytes": 0, 2024-04-01T19:39:15.574 INFO:teuthology.orchestra.run.smithi022.stdout: "quota_max_objects": 0, 2024-04-01T19:39:15.574 INFO:teuthology.orchestra.run.smithi022.stdout: "tiers": [], 2024-04-01T19:39:15.574 INFO:teuthology.orchestra.run.smithi022.stdout: "tier_of": -1, 2024-04-01T19:39:15.574 INFO:teuthology.orchestra.run.smithi022.stdout: "read_tier": -1, 2024-04-01T19:39:15.574 INFO:teuthology.orchestra.run.smithi022.stdout: "write_tier": -1, 2024-04-01T19:39:15.574 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_mode": "none", 2024-04-01T19:39:15.574 INFO:teuthology.orchestra.run.smithi022.stdout: "target_max_bytes": 0, 2024-04-01T19:39:15.574 INFO:teuthology.orchestra.run.smithi022.stdout: "target_max_objects": 0, 2024-04-01T19:39:15.574 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-01T19:39:15.574 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-01T19:39:15.574 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-01T19:39:15.574 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_min_flush_age": 0, 2024-04-01T19:39:15.574 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_min_evict_age": 0, 2024-04-01T19:39:15.574 INFO:teuthology.orchestra.run.smithi022.stdout: "erasure_code_profile": "", 2024-04-01T19:39:15.575 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_params": { 2024-04-01T19:39:15.575 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "none" 2024-04-01T19:39:15.575 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.575 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_period": 0, 2024-04-01T19:39:15.575 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_count": 0, 2024-04-01T19:39:15.575 INFO:teuthology.orchestra.run.smithi022.stdout: "use_gmt_hitset": true, 2024-04-01T19:39:15.575 INFO:teuthology.orchestra.run.smithi022.stdout: "min_read_recency_for_promote": 0, 2024-04-01T19:39:15.575 INFO:teuthology.orchestra.run.smithi022.stdout: "min_write_recency_for_promote": 0, 2024-04-01T19:39:15.575 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_grade_decay_rate": 0, 2024-04-01T19:39:15.575 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_search_last_n": 0, 2024-04-01T19:39:15.575 INFO:teuthology.orchestra.run.smithi022.stdout: "grade_table": [], 2024-04-01T19:39:15.575 INFO:teuthology.orchestra.run.smithi022.stdout: "stripe_width": 0, 2024-04-01T19:39:15.575 INFO:teuthology.orchestra.run.smithi022.stdout: "expected_num_objects": 0, 2024-04-01T19:39:15.575 INFO:teuthology.orchestra.run.smithi022.stdout: "fast_read": false, 2024-04-01T19:39:15.575 INFO:teuthology.orchestra.run.smithi022.stdout: "options": { 2024-04-01T19:39:15.576 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num_max": 32, 2024-04-01T19:39:15.576 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num_min": 1 2024-04-01T19:39:15.576 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.576 INFO:teuthology.orchestra.run.smithi022.stdout: "application_metadata": { 2024-04-01T19:39:15.576 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": {} 2024-04-01T19:39:15.576 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.576 INFO:teuthology.orchestra.run.smithi022.stdout: "read_balance": { 2024-04-01T19:39:15.576 INFO:teuthology.orchestra.run.smithi022.stdout: "score_type": "Fair distribution", 2024-04-01T19:39:15.576 INFO:teuthology.orchestra.run.smithi022.stdout: "score_acting": 11.760000228881836, 2024-04-01T19:39:15.576 INFO:teuthology.orchestra.run.smithi022.stdout: "score_stable": 11.760000228881836, 2024-04-01T19:39:15.576 INFO:teuthology.orchestra.run.smithi022.stdout: "optimal_score": 0.17000000178813934, 2024-04-01T19:39:15.576 INFO:teuthology.orchestra.run.smithi022.stdout: "raw_score_acting": 2, 2024-04-01T19:39:15.576 INFO:teuthology.orchestra.run.smithi022.stdout: "raw_score_stable": 2, 2024-04-01T19:39:15.577 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity_weighted": 0.99999988079071045, 2024-04-01T19:39:15.577 INFO:teuthology.orchestra.run.smithi022.stdout: "average_primary_affinity": 1, 2024-04-01T19:39:15.577 INFO:teuthology.orchestra.run.smithi022.stdout: "average_primary_affinity_weighted": 1 2024-04-01T19:39:15.577 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.577 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.577 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T19:39:15.577 INFO:teuthology.orchestra.run.smithi022.stdout: "osds": [ 2024-04-01T19:39:15.577 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.577 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 0, 2024-04-01T19:39:15.577 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "cfd4aa7e-a933-42e2-aac8-f93a3d9fcc3d", 2024-04-01T19:39:15.577 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2024-04-01T19:39:15.577 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2024-04-01T19:39:15.577 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2024-04-01T19:39:15.577 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2024-04-01T19:39:15.577 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 0, 2024-04-01T19:39:15.578 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 0, 2024-04-01T19:39:15.578 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 8, 2024-04-01T19:39:15.578 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 267, 2024-04-01T19:39:15.578 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 0, 2024-04-01T19:39:15.578 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2024-04-01T19:39:15.578 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2024-04-01T19:39:15.578 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.578 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.578 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.578 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6801", 2024-04-01T19:39:15.578 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1419201649 2024-04-01T19:39:15.578 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.578 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.579 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.579 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2024-04-01T19:39:15.579 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.579 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.579 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.579 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6802", 2024-04-01T19:39:15.579 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1419201649 2024-04-01T19:39:15.579 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.579 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.579 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.579 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2024-04-01T19:39:15.579 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.579 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.579 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.579 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6804", 2024-04-01T19:39:15.579 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1419201649 2024-04-01T19:39:15.580 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.580 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.580 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.580 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2024-04-01T19:39:15.580 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.580 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.580 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.580 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6803", 2024-04-01T19:39:15.580 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1419201649 2024-04-01T19:39:15.580 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.580 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.580 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.580 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.22:6801/1419201649", 2024-04-01T19:39:15.580 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.22:6802/1419201649", 2024-04-01T19:39:15.580 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.22:6804/1419201649", 2024-04-01T19:39:15.580 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.22:6803/1419201649", 2024-04-01T19:39:15.581 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2024-04-01T19:39:15.581 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2024-04-01T19:39:15.581 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2024-04-01T19:39:15.581 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.581 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.581 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.581 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 1, 2024-04-01T19:39:15.581 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "6ddadf19-2b4e-4c01-8918-9d51c323925b", 2024-04-01T19:39:15.581 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2024-04-01T19:39:15.581 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2024-04-01T19:39:15.581 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2024-04-01T19:39:15.581 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2024-04-01T19:39:15.581 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 0, 2024-04-01T19:39:15.581 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 0, 2024-04-01T19:39:15.581 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 13, 2024-04-01T19:39:15.582 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 342, 2024-04-01T19:39:15.582 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 0, 2024-04-01T19:39:15.582 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2024-04-01T19:39:15.582 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2024-04-01T19:39:15.582 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.582 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.582 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.582 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6805", 2024-04-01T19:39:15.582 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2579227110 2024-04-01T19:39:15.582 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.582 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.582 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.582 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2024-04-01T19:39:15.582 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.583 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.583 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.583 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6806", 2024-04-01T19:39:15.583 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2579227110 2024-04-01T19:39:15.583 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.583 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.583 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.583 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2024-04-01T19:39:15.583 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.583 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.583 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.583 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6808", 2024-04-01T19:39:15.584 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2579227110 2024-04-01T19:39:15.584 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.584 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.584 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.584 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2024-04-01T19:39:15.584 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.584 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.584 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.584 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6807", 2024-04-01T19:39:15.584 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2579227110 2024-04-01T19:39:15.584 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.584 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.584 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.584 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.22:6805/2579227110", 2024-04-01T19:39:15.584 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.22:6806/2579227110", 2024-04-01T19:39:15.584 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.22:6808/2579227110", 2024-04-01T19:39:15.585 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.22:6807/2579227110", 2024-04-01T19:39:15.585 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2024-04-01T19:39:15.585 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2024-04-01T19:39:15.585 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2024-04-01T19:39:15.585 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.585 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.585 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.585 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 2, 2024-04-01T19:39:15.585 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "4af1f44c-f47c-4ce6-87ba-1aeec3960969", 2024-04-01T19:39:15.585 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2024-04-01T19:39:15.585 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2024-04-01T19:39:15.585 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2024-04-01T19:39:15.585 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2024-04-01T19:39:15.585 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 0, 2024-04-01T19:39:15.585 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 0, 2024-04-01T19:39:15.585 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 20, 2024-04-01T19:39:15.586 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 106, 2024-04-01T19:39:15.586 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 0, 2024-04-01T19:39:15.586 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2024-04-01T19:39:15.586 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2024-04-01T19:39:15.586 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.586 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.586 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.586 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6809", 2024-04-01T19:39:15.586 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 835455757 2024-04-01T19:39:15.586 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.586 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.586 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.586 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2024-04-01T19:39:15.586 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.587 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.587 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.587 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6810", 2024-04-01T19:39:15.587 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 835455757 2024-04-01T19:39:15.587 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.587 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.587 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.587 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2024-04-01T19:39:15.587 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.587 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.587 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.587 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6812", 2024-04-01T19:39:15.587 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 835455757 2024-04-01T19:39:15.587 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.587 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.588 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.588 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2024-04-01T19:39:15.588 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.588 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.588 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.588 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6811", 2024-04-01T19:39:15.588 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 835455757 2024-04-01T19:39:15.588 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.588 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.588 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.588 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.22:6809/835455757", 2024-04-01T19:39:15.588 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.22:6810/835455757", 2024-04-01T19:39:15.588 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.22:6812/835455757", 2024-04-01T19:39:15.588 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.22:6811/835455757", 2024-04-01T19:39:15.589 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2024-04-01T19:39:15.589 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2024-04-01T19:39:15.589 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2024-04-01T19:39:15.589 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.589 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.589 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.589 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 3, 2024-04-01T19:39:15.589 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "c399f336-23c7-414a-822e-63793daf85c1", 2024-04-01T19:39:15.589 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2024-04-01T19:39:15.589 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2024-04-01T19:39:15.589 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2024-04-01T19:39:15.589 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2024-04-01T19:39:15.589 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 0, 2024-04-01T19:39:15.589 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 0, 2024-04-01T19:39:15.590 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 26, 2024-04-01T19:39:15.590 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 267, 2024-04-01T19:39:15.590 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 0, 2024-04-01T19:39:15.590 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2024-04-01T19:39:15.590 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2024-04-01T19:39:15.590 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.590 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.590 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.590 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6813", 2024-04-01T19:39:15.590 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 90988887 2024-04-01T19:39:15.590 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.590 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.590 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.590 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2024-04-01T19:39:15.591 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.591 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.591 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.591 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6814", 2024-04-01T19:39:15.591 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 90988887 2024-04-01T19:39:15.591 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.591 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.591 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.591 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2024-04-01T19:39:15.591 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.591 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.591 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.591 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6816", 2024-04-01T19:39:15.591 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 90988887 2024-04-01T19:39:15.591 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.592 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.592 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.592 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2024-04-01T19:39:15.592 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.592 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.592 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.592 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6815", 2024-04-01T19:39:15.592 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 90988887 2024-04-01T19:39:15.592 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.592 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.592 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.592 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.22:6813/90988887", 2024-04-01T19:39:15.592 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.22:6814/90988887", 2024-04-01T19:39:15.592 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.22:6816/90988887", 2024-04-01T19:39:15.592 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.22:6815/90988887", 2024-04-01T19:39:15.593 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2024-04-01T19:39:15.593 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2024-04-01T19:39:15.593 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2024-04-01T19:39:15.593 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.593 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.593 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.593 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 4, 2024-04-01T19:39:15.593 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "0a2690dc-e5b6-4d29-b517-980018519d76", 2024-04-01T19:39:15.593 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2024-04-01T19:39:15.593 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2024-04-01T19:39:15.593 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2024-04-01T19:39:15.593 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2024-04-01T19:39:15.593 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 0, 2024-04-01T19:39:15.593 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 0, 2024-04-01T19:39:15.593 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 32, 2024-04-01T19:39:15.594 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 267, 2024-04-01T19:39:15.594 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 0, 2024-04-01T19:39:15.594 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2024-04-01T19:39:15.594 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2024-04-01T19:39:15.594 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.594 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.594 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.594 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6800", 2024-04-01T19:39:15.594 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2408168690 2024-04-01T19:39:15.594 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.594 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.594 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.594 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2024-04-01T19:39:15.594 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.595 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.595 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.595 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6801", 2024-04-01T19:39:15.595 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2408168690 2024-04-01T19:39:15.595 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.595 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.595 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.595 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2024-04-01T19:39:15.595 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.595 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.595 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.595 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6803", 2024-04-01T19:39:15.595 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2408168690 2024-04-01T19:39:15.595 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.595 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.596 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.596 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2024-04-01T19:39:15.596 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.596 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.596 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.596 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6802", 2024-04-01T19:39:15.596 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2408168690 2024-04-01T19:39:15.596 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.596 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.596 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.596 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.62:6800/2408168690", 2024-04-01T19:39:15.596 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.62:6801/2408168690", 2024-04-01T19:39:15.596 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.62:6803/2408168690", 2024-04-01T19:39:15.596 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.62:6802/2408168690", 2024-04-01T19:39:15.597 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2024-04-01T19:39:15.597 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2024-04-01T19:39:15.597 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2024-04-01T19:39:15.597 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.597 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.597 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.597 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 5, 2024-04-01T19:39:15.597 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "c6830412-959a-4f1e-8c3d-f4b2d88673e6", 2024-04-01T19:39:15.597 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2024-04-01T19:39:15.597 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2024-04-01T19:39:15.597 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2024-04-01T19:39:15.597 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2024-04-01T19:39:15.597 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 0, 2024-04-01T19:39:15.597 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 0, 2024-04-01T19:39:15.597 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 37, 2024-04-01T19:39:15.597 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 191, 2024-04-01T19:39:15.598 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 0, 2024-04-01T19:39:15.598 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2024-04-01T19:39:15.598 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2024-04-01T19:39:15.598 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.598 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.598 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.598 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6804", 2024-04-01T19:39:15.598 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 386874616 2024-04-01T19:39:15.598 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.598 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.598 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.598 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2024-04-01T19:39:15.598 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.598 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.599 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.599 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6805", 2024-04-01T19:39:15.599 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 386874616 2024-04-01T19:39:15.599 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.599 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.599 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.599 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2024-04-01T19:39:15.599 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.599 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.599 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.599 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6807", 2024-04-01T19:39:15.599 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 386874616 2024-04-01T19:39:15.599 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.599 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.600 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.600 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2024-04-01T19:39:15.600 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.600 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.600 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.600 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6806", 2024-04-01T19:39:15.600 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 386874616 2024-04-01T19:39:15.600 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.600 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.600 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.600 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.62:6804/386874616", 2024-04-01T19:39:15.600 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.62:6805/386874616", 2024-04-01T19:39:15.600 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.62:6807/386874616", 2024-04-01T19:39:15.600 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.62:6806/386874616", 2024-04-01T19:39:15.600 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2024-04-01T19:39:15.601 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2024-04-01T19:39:15.601 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2024-04-01T19:39:15.601 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.601 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.601 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.601 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 6, 2024-04-01T19:39:15.601 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "f646310b-91a4-4259-a51f-6a0e92b7cba8", 2024-04-01T19:39:15.601 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2024-04-01T19:39:15.601 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2024-04-01T19:39:15.601 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2024-04-01T19:39:15.601 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2024-04-01T19:39:15.601 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 45, 2024-04-01T19:39:15.601 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 299, 2024-04-01T19:39:15.601 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 335, 2024-04-01T19:39:15.601 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 345, 2024-04-01T19:39:15.602 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 300, 2024-04-01T19:39:15.602 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2024-04-01T19:39:15.602 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2024-04-01T19:39:15.602 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.602 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.602 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.602 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6808", 2024-04-01T19:39:15.602 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 4216302213 2024-04-01T19:39:15.602 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.602 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.602 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.602 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2024-04-01T19:39:15.602 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.602 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.603 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.603 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6809", 2024-04-01T19:39:15.603 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 4216302213 2024-04-01T19:39:15.603 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.603 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.603 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.603 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2024-04-01T19:39:15.603 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.603 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.603 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.603 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6811", 2024-04-01T19:39:15.603 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 4216302213 2024-04-01T19:39:15.603 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.603 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.603 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.604 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2024-04-01T19:39:15.604 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.604 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.604 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.604 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6810", 2024-04-01T19:39:15.604 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 4216302213 2024-04-01T19:39:15.604 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.604 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.604 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.604 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.62:6808/4216302213", 2024-04-01T19:39:15.604 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.62:6809/4216302213", 2024-04-01T19:39:15.604 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.62:6811/4216302213", 2024-04-01T19:39:15.604 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.62:6810/4216302213", 2024-04-01T19:39:15.604 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2024-04-01T19:39:15.605 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2024-04-01T19:39:15.605 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2024-04-01T19:39:15.605 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.605 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.605 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.605 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 7, 2024-04-01T19:39:15.605 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "afe5f371-c892-43e9-b82e-c2d911354e9a", 2024-04-01T19:39:15.605 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2024-04-01T19:39:15.605 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2024-04-01T19:39:15.605 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2024-04-01T19:39:15.605 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2024-04-01T19:39:15.605 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 0, 2024-04-01T19:39:15.605 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 0, 2024-04-01T19:39:15.605 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 54, 2024-04-01T19:39:15.605 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 211, 2024-04-01T19:39:15.606 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 0, 2024-04-01T19:39:15.606 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2024-04-01T19:39:15.606 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2024-04-01T19:39:15.606 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.606 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.606 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.606 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6812", 2024-04-01T19:39:15.606 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2055487337 2024-04-01T19:39:15.606 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.606 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.606 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.606 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2024-04-01T19:39:15.606 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.606 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.607 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.607 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6813", 2024-04-01T19:39:15.607 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2055487337 2024-04-01T19:39:15.607 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.607 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.607 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.607 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2024-04-01T19:39:15.607 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.607 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.607 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.607 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6815", 2024-04-01T19:39:15.607 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2055487337 2024-04-01T19:39:15.607 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.607 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.608 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.608 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2024-04-01T19:39:15.608 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.608 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.608 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.608 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.62:6814", 2024-04-01T19:39:15.608 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2055487337 2024-04-01T19:39:15.608 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.608 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.608 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.608 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.62:6812/2055487337", 2024-04-01T19:39:15.608 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.62:6813/2055487337", 2024-04-01T19:39:15.608 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.62:6815/2055487337", 2024-04-01T19:39:15.608 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.62:6814/2055487337", 2024-04-01T19:39:15.609 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2024-04-01T19:39:15.609 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2024-04-01T19:39:15.609 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2024-04-01T19:39:15.609 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.609 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.609 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.609 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 8, 2024-04-01T19:39:15.609 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "b7eb6461-f6fa-4a12-864c-6e6748e6337e", 2024-04-01T19:39:15.609 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2024-04-01T19:39:15.609 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 0, 2024-04-01T19:39:15.609 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 0, 2024-04-01T19:39:15.609 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2024-04-01T19:39:15.609 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 63, 2024-04-01T19:39:15.609 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 159, 2024-04-01T19:39:15.610 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 197, 2024-04-01T19:39:15.610 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 212, 2024-04-01T19:39:15.610 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 160, 2024-04-01T19:39:15.610 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2024-04-01T19:39:15.610 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2024-04-01T19:39:15.610 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.610 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.610 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.610 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6800", 2024-04-01T19:39:15.610 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1873408265 2024-04-01T19:39:15.610 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.610 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.611 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.611 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2024-04-01T19:39:15.611 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.611 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.611 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.611 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6801", 2024-04-01T19:39:15.611 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1873408265 2024-04-01T19:39:15.611 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.611 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.611 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.611 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2024-04-01T19:39:15.611 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.611 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.611 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.612 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6803", 2024-04-01T19:39:15.612 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1873408265 2024-04-01T19:39:15.612 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.612 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.612 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.612 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2024-04-01T19:39:15.612 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.612 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.612 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.612 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6802", 2024-04-01T19:39:15.612 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1873408265 2024-04-01T19:39:15.612 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.612 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.612 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.613 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.188:6800/1873408265", 2024-04-01T19:39:15.613 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.188:6801/1873408265", 2024-04-01T19:39:15.613 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.188:6803/1873408265", 2024-04-01T19:39:15.613 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.188:6802/1873408265", 2024-04-01T19:39:15.613 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2024-04-01T19:39:15.613 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2024-04-01T19:39:15.613 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2024-04-01T19:39:15.613 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.613 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.613 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.613 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 9, 2024-04-01T19:39:15.613 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "7d496ad5-46bf-485a-81d9-2b9da2a59882", 2024-04-01T19:39:15.613 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2024-04-01T19:39:15.613 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2024-04-01T19:39:15.614 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2024-04-01T19:39:15.614 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2024-04-01T19:39:15.614 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 0, 2024-04-01T19:39:15.614 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 0, 2024-04-01T19:39:15.614 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 71, 2024-04-01T19:39:15.614 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 267, 2024-04-01T19:39:15.614 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 0, 2024-04-01T19:39:15.614 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2024-04-01T19:39:15.614 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2024-04-01T19:39:15.614 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.614 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.614 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.614 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6804", 2024-04-01T19:39:15.614 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1755990887 2024-04-01T19:39:15.615 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.615 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.615 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.615 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2024-04-01T19:39:15.615 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.615 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.615 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.615 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6805", 2024-04-01T19:39:15.615 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1755990887 2024-04-01T19:39:15.615 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.615 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.615 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.615 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2024-04-01T19:39:15.615 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.615 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.615 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.616 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6807", 2024-04-01T19:39:15.616 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1755990887 2024-04-01T19:39:15.616 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.616 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.616 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.616 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2024-04-01T19:39:15.616 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.616 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.616 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.616 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6806", 2024-04-01T19:39:15.616 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1755990887 2024-04-01T19:39:15.616 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.616 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.616 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.617 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.188:6804/1755990887", 2024-04-01T19:39:15.617 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.188:6805/1755990887", 2024-04-01T19:39:15.617 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.188:6807/1755990887", 2024-04-01T19:39:15.617 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.188:6806/1755990887", 2024-04-01T19:39:15.617 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2024-04-01T19:39:15.617 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2024-04-01T19:39:15.617 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2024-04-01T19:39:15.617 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.617 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.617 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.617 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 10, 2024-04-01T19:39:15.617 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "6cbb80ce-37f7-48df-9090-09a6068e4490", 2024-04-01T19:39:15.617 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2024-04-01T19:39:15.618 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2024-04-01T19:39:15.618 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2024-04-01T19:39:15.618 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2024-04-01T19:39:15.618 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 0, 2024-04-01T19:39:15.618 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 0, 2024-04-01T19:39:15.618 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 77, 2024-04-01T19:39:15.618 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 344, 2024-04-01T19:39:15.618 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 0, 2024-04-01T19:39:15.618 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2024-04-01T19:39:15.618 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2024-04-01T19:39:15.618 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.618 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.618 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.618 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6808", 2024-04-01T19:39:15.618 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3777340429 2024-04-01T19:39:15.619 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.619 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.619 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.619 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2024-04-01T19:39:15.619 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.619 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.619 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.619 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6809", 2024-04-01T19:39:15.619 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3777340429 2024-04-01T19:39:15.619 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.619 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.619 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.619 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2024-04-01T19:39:15.619 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.619 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.620 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.620 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6811", 2024-04-01T19:39:15.620 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3777340429 2024-04-01T19:39:15.620 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.620 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.620 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.620 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2024-04-01T19:39:15.620 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.620 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.620 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.620 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6810", 2024-04-01T19:39:15.620 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3777340429 2024-04-01T19:39:15.620 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.620 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.620 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.621 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.188:6808/3777340429", 2024-04-01T19:39:15.621 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.188:6809/3777340429", 2024-04-01T19:39:15.621 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.188:6811/3777340429", 2024-04-01T19:39:15.621 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.188:6810/3777340429", 2024-04-01T19:39:15.621 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2024-04-01T19:39:15.621 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2024-04-01T19:39:15.621 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2024-04-01T19:39:15.621 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.621 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.621 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.621 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 11, 2024-04-01T19:39:15.621 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "c03517c4-fdb0-4587-96c1-b959041c4344", 2024-04-01T19:39:15.621 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2024-04-01T19:39:15.621 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2024-04-01T19:39:15.622 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2024-04-01T19:39:15.622 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2024-04-01T19:39:15.622 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 0, 2024-04-01T19:39:15.622 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 0, 2024-04-01T19:39:15.622 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 85, 2024-04-01T19:39:15.622 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 267, 2024-04-01T19:39:15.622 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 0, 2024-04-01T19:39:15.622 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2024-04-01T19:39:15.622 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2024-04-01T19:39:15.622 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.622 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.622 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.622 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6812", 2024-04-01T19:39:15.622 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3987199514 2024-04-01T19:39:15.623 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.623 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.623 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.623 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2024-04-01T19:39:15.623 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.623 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.623 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.623 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6813", 2024-04-01T19:39:15.623 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3987199514 2024-04-01T19:39:15.623 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.623 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.623 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.623 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2024-04-01T19:39:15.623 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.623 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.624 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.624 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6815", 2024-04-01T19:39:15.624 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3987199514 2024-04-01T19:39:15.624 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.624 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.624 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.624 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2024-04-01T19:39:15.624 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-04-01T19:39:15.624 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.624 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-04-01T19:39:15.624 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.188:6814", 2024-04-01T19:39:15.624 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3987199514 2024-04-01T19:39:15.625 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.625 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.625 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.625 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.188:6812/3987199514", 2024-04-01T19:39:15.625 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.188:6813/3987199514", 2024-04-01T19:39:15.625 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.188:6815/3987199514", 2024-04-01T19:39:15.625 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.188:6814/3987199514", 2024-04-01T19:39:15.625 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2024-04-01T19:39:15.625 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2024-04-01T19:39:15.625 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2024-04-01T19:39:15.625 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:15.625 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.625 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T19:39:15.625 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_xinfo": [ 2024-04-01T19:39:15.625 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.626 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 0, 2024-04-01T19:39:15.626 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2024-04-01T19:39:15.626 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2024-04-01T19:39:15.626 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2024-04-01T19:39:15.626 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540701547738038271, 2024-04-01T19:39:15.626 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2024-04-01T19:39:15.626 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "2024-04-01T19:38:13.947727+0000", 2024-04-01T19:39:15.626 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 0 2024-04-01T19:39:15.626 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.626 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.626 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 1, 2024-04-01T19:39:15.626 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2024-04-01T19:39:15.626 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2024-04-01T19:39:15.627 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2024-04-01T19:39:15.627 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540701547738038271, 2024-04-01T19:39:15.627 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2024-04-01T19:39:15.627 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "2024-04-01T19:38:13.192409+0000", 2024-04-01T19:39:15.627 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 0 2024-04-01T19:39:15.627 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.627 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.627 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 2, 2024-04-01T19:39:15.627 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2024-04-01T19:39:15.627 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2024-04-01T19:39:15.627 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2024-04-01T19:39:15.627 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540701547738038271, 2024-04-01T19:39:15.627 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2024-04-01T19:39:15.627 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "2024-04-01T19:39:04.864242+0000", 2024-04-01T19:39:15.628 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 0 2024-04-01T19:39:15.628 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.628 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.628 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 3, 2024-04-01T19:39:15.628 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2024-04-01T19:39:15.628 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2024-04-01T19:39:15.628 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2024-04-01T19:39:15.628 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540701547738038271, 2024-04-01T19:39:15.628 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2024-04-01T19:39:15.628 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "2024-04-01T19:38:52.795261+0000", 2024-04-01T19:39:15.628 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 0 2024-04-01T19:39:15.628 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.628 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.628 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 4, 2024-04-01T19:39:15.629 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2024-04-01T19:39:15.629 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2024-04-01T19:39:15.629 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2024-04-01T19:39:15.629 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540701547738038271, 2024-04-01T19:39:15.629 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2024-04-01T19:39:15.629 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "2024-04-01T19:38:31.299968+0000", 2024-04-01T19:39:15.629 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 0 2024-04-01T19:39:15.629 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.629 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.629 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 5, 2024-04-01T19:39:15.629 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2024-04-01T19:39:15.629 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2024-04-01T19:39:15.629 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2024-04-01T19:39:15.629 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540701547738038271, 2024-04-01T19:39:15.629 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2024-04-01T19:39:15.630 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "2024-04-01T19:39:07.872505+0000", 2024-04-01T19:39:15.630 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 0 2024-04-01T19:39:15.630 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.630 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.630 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 6, 2024-04-01T19:39:15.630 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2024-04-01T19:39:15.630 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2024-04-01T19:39:15.630 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2024-04-01T19:39:15.630 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540701547738038271, 2024-04-01T19:39:15.630 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2024-04-01T19:39:15.630 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "2024-04-01T19:39:02.161102+0000", 2024-04-01T19:39:15.630 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 299 2024-04-01T19:39:15.630 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.630 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.630 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 7, 2024-04-01T19:39:15.631 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2024-04-01T19:39:15.631 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2024-04-01T19:39:15.631 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2024-04-01T19:39:15.631 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540701547738038271, 2024-04-01T19:39:15.631 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2024-04-01T19:39:15.631 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "2024-04-01T19:38:06.107532+0000", 2024-04-01T19:39:15.631 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 0 2024-04-01T19:39:15.631 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.631 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.631 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 8, 2024-04-01T19:39:15.631 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2024-04-01T19:39:15.631 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2024-04-01T19:39:15.631 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2024-04-01T19:39:15.632 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540701547738038271, 2024-04-01T19:39:15.632 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 65536, 2024-04-01T19:39:15.632 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "2024-04-01T19:38:31.826258+0000", 2024-04-01T19:39:15.632 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 159 2024-04-01T19:39:15.632 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.632 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.632 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 9, 2024-04-01T19:39:15.632 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2024-04-01T19:39:15.632 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2024-04-01T19:39:15.632 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2024-04-01T19:39:15.632 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540701547738038271, 2024-04-01T19:39:15.632 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2024-04-01T19:39:15.632 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "2024-04-01T19:38:04.891155+0000", 2024-04-01T19:39:15.632 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 0 2024-04-01T19:39:15.632 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.632 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.633 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 10, 2024-04-01T19:39:15.633 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2024-04-01T19:39:15.633 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2024-04-01T19:39:15.633 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2024-04-01T19:39:15.633 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540701547738038271, 2024-04-01T19:39:15.633 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2024-04-01T19:39:15.633 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "2024-04-01T19:38:07.099946+0000", 2024-04-01T19:39:15.633 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 0 2024-04-01T19:39:15.633 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.633 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:15.633 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 11, 2024-04-01T19:39:15.633 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2024-04-01T19:39:15.633 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2024-04-01T19:39:15.633 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2024-04-01T19:39:15.633 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540701547738038271, 2024-04-01T19:39:15.633 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2024-04-01T19:39:15.634 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "2024-04-01T19:38:02.326732+0000", 2024-04-01T19:39:15.634 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 0 2024-04-01T19:39:15.634 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.634 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T19:39:15.634 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_upmap": [], 2024-04-01T19:39:15.634 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_upmap_items": [], 2024-04-01T19:39:15.634 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_upmap_primaries": [], 2024-04-01T19:39:15.634 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_temp": [], 2024-04-01T19:39:15.634 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_temp": [], 2024-04-01T19:39:15.634 INFO:teuthology.orchestra.run.smithi022.stdout: "blocklist": { 2024-04-01T19:39:15.634 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.22:0/3735983556": "2024-04-02T19:16:30.513384+0000", 2024-04-01T19:39:15.634 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.22:0/3575578250": "2024-04-02T19:16:30.513384+0000", 2024-04-01T19:39:15.634 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.22:0/2493529775": "2024-04-02T19:16:02.302343+0000", 2024-04-01T19:39:15.635 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.22:6800/2678666836": "2024-04-02T19:16:30.513384+0000", 2024-04-01T19:39:15.635 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.22:0/2389537847": "2024-04-02T19:16:02.302343+0000", 2024-04-01T19:39:15.635 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.22:0/798807675": "2024-04-02T19:16:02.302343+0000", 2024-04-01T19:39:15.635 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.22:6800/1090179981": "2024-04-02T19:16:02.302343+0000", 2024-04-01T19:39:15.635 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.22:0/51907384": "2024-04-02T19:16:30.513384+0000" 2024-04-01T19:39:15.635 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.635 INFO:teuthology.orchestra.run.smithi022.stdout: "range_blocklist": {}, 2024-04-01T19:39:15.635 INFO:teuthology.orchestra.run.smithi022.stdout: "erasure_code_profiles": { 2024-04-01T19:39:15.635 INFO:teuthology.orchestra.run.smithi022.stdout: "default": { 2024-04-01T19:39:15.635 INFO:teuthology.orchestra.run.smithi022.stdout: "crush-failure-domain": "osd", 2024-04-01T19:39:15.635 INFO:teuthology.orchestra.run.smithi022.stdout: "k": "2", 2024-04-01T19:39:15.635 INFO:teuthology.orchestra.run.smithi022.stdout: "m": "1", 2024-04-01T19:39:15.635 INFO:teuthology.orchestra.run.smithi022.stdout: "plugin": "jerasure", 2024-04-01T19:39:15.635 INFO:teuthology.orchestra.run.smithi022.stdout: "technique": "reed_sol_van" 2024-04-01T19:39:15.635 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.635 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:15.636 INFO:teuthology.orchestra.run.smithi022.stdout: "removed_snaps_queue": [], 2024-04-01T19:39:15.636 INFO:teuthology.orchestra.run.smithi022.stdout: "new_removed_snaps": [], 2024-04-01T19:39:15.636 INFO:teuthology.orchestra.run.smithi022.stdout: "new_purged_snaps": [], 2024-04-01T19:39:15.636 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_node_flags": {}, 2024-04-01T19:39:15.636 INFO:teuthology.orchestra.run.smithi022.stdout: "device_class_flags": {}, 2024-04-01T19:39:15.636 INFO:teuthology.orchestra.run.smithi022.stdout: "stretch_mode": { 2024-04-01T19:39:15.636 INFO:teuthology.orchestra.run.smithi022.stdout: "stretch_mode_enabled": false, 2024-04-01T19:39:15.636 INFO:teuthology.orchestra.run.smithi022.stdout: "stretch_bucket_count": 0, 2024-04-01T19:39:15.636 INFO:teuthology.orchestra.run.smithi022.stdout: "degraded_stretch_mode": 0, 2024-04-01T19:39:15.636 INFO:teuthology.orchestra.run.smithi022.stdout: "recovering_stretch_mode": 0, 2024-04-01T19:39:15.636 INFO:teuthology.orchestra.run.smithi022.stdout: "stretch_mode_bucket": 0 2024-04-01T19:39:15.636 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:15.636 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:39:15.636 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:39:15.666 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:16.290 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:39:16.312 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:39:16.331 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:39:16.350 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:39:16.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:16 smithi022 ceph-mon[39439]: pgmap v1032: 1 pgs: 1 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:16.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:16 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/851053956' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-04-01T19:39:16.371 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:39:16.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:16 smithi188 ceph-mon[43939]: pgmap v1032: 1 pgs: 1 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:16.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:16 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/851053956' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-04-01T19:39:16.391 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:39:16.414 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:39:16.435 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:39:16.455 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:39:16.475 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:39:16.495 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:39:16.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:16 smithi062 ceph-mon[44211]: pgmap v1032: 1 pgs: 1 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:16.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:16 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/851053956' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json-pretty"}]: dispatch 2024-04-01T19:39:16.516 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:39:16.516 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:39:16.518 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:39:16.518 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:39:16.518 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:39:16.518 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:39:16.518 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:39:16.518 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:39:16.519 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:39:16.519 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:39:16.519 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:39:16.519 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:39:16.519 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:39:16.519 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:39:16.525 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:16.526 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:39:16.627 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:39:16.655 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:17.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:17 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2691643534' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:39:17.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:17.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:17.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:17.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:17.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:17.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:17.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:17.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:17 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2691643534' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:39:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:17.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:17 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2691643534' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:39:17.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:17.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:17.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:17.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:17.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:17.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:17.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:18.148 INFO:tasks.thrashosds.thrasher:j is {'epoch': 360, 'fsid': '09f6b846-f05c-11ee-b647-cb9ed24678a4', 'created': '2024-04-01T19:15:34.344221+0000', 'modified': '2024-04-01T19:39:12.664456+0000', 'last_up_change': '2024-04-01T19:37:45.832405+0000', 'last_in_change': '2024-04-01T19:38:21.274265+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 29, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 12, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T19:18:34.605751+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'cfd4aa7e-a933-42e2-aac8-f93a3d9fcc3d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 267, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6801', 'nonce': 1419201649}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6802', 'nonce': 1419201649}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6804', 'nonce': 1419201649}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6803', 'nonce': 1419201649}]}, 'public_addr': '172.21.15.22:6801/1419201649', 'cluster_addr': '172.21.15.22:6802/1419201649', 'heartbeat_back_addr': '172.21.15.22:6804/1419201649', 'heartbeat_front_addr': '172.21.15.22:6803/1419201649', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '6ddadf19-2b4e-4c01-8918-9d51c323925b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 342, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6805', 'nonce': 2579227110}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6806', 'nonce': 2579227110}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6808', 'nonce': 2579227110}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6807', 'nonce': 2579227110}]}, 'public_addr': '172.21.15.22:6805/2579227110', 'cluster_addr': '172.21.15.22:6806/2579227110', 'heartbeat_back_addr': '172.21.15.22:6808/2579227110', 'heartbeat_front_addr': '172.21.15.22:6807/2579227110', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '4af1f44c-f47c-4ce6-87ba-1aeec3960969', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 20, 'up_thru': 106, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6809', 'nonce': 835455757}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6810', 'nonce': 835455757}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6812', 'nonce': 835455757}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6811', 'nonce': 835455757}]}, 'public_addr': '172.21.15.22:6809/835455757', 'cluster_addr': '172.21.15.22:6810/835455757', 'heartbeat_back_addr': '172.21.15.22:6812/835455757', 'heartbeat_front_addr': '172.21.15.22:6811/835455757', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'c399f336-23c7-414a-822e-63793daf85c1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 26, 'up_thru': 267, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6813', 'nonce': 90988887}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6814', 'nonce': 90988887}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6816', 'nonce': 90988887}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6815', 'nonce': 90988887}]}, 'public_addr': '172.21.15.22:6813/90988887', 'cluster_addr': '172.21.15.22:6814/90988887', 'heartbeat_back_addr': '172.21.15.22:6816/90988887', 'heartbeat_front_addr': '172.21.15.22:6815/90988887', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '0a2690dc-e5b6-4d29-b517-980018519d76', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 32, 'up_thru': 267, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6800', 'nonce': 2408168690}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6801', 'nonce': 2408168690}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6803', 'nonce': 2408168690}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6802', 'nonce': 2408168690}]}, 'public_addr': '172.21.15.62:6800/2408168690', 'cluster_addr': '172.21.15.62:6801/2408168690', 'heartbeat_back_addr': '172.21.15.62:6803/2408168690', 'heartbeat_front_addr': '172.21.15.62:6802/2408168690', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'c6830412-959a-4f1e-8c3d-f4b2d88673e6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 37, 'up_thru': 191, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6804', 'nonce': 386874616}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6805', 'nonce': 386874616}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6807', 'nonce': 386874616}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6806', 'nonce': 386874616}]}, 'public_addr': '172.21.15.62:6804/386874616', 'cluster_addr': '172.21.15.62:6805/386874616', 'heartbeat_back_addr': '172.21.15.62:6807/386874616', 'heartbeat_front_addr': '172.21.15.62:6806/386874616', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'f646310b-91a4-4259-a51f-6a0e92b7cba8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 45, 'last_clean_end': 299, 'up_from': 335, 'up_thru': 345, 'down_at': 300, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6808', 'nonce': 4216302213}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6809', 'nonce': 4216302213}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6811', 'nonce': 4216302213}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6810', 'nonce': 4216302213}]}, 'public_addr': '172.21.15.62:6808/4216302213', 'cluster_addr': '172.21.15.62:6809/4216302213', 'heartbeat_back_addr': '172.21.15.62:6811/4216302213', 'heartbeat_front_addr': '172.21.15.62:6810/4216302213', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'afe5f371-c892-43e9-b82e-c2d911354e9a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 54, 'up_thru': 211, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6812', 'nonce': 2055487337}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6813', 'nonce': 2055487337}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6815', 'nonce': 2055487337}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.62:6814', 'nonce': 2055487337}]}, 'public_addr': '172.21.15.62:6812/2055487337', 'cluster_addr': '172.21.15.62:6813/2055487337', 'heartbeat_back_addr': '172.21.15.62:6815/2055487337', 'heartbeat_front_addr': '172.21.15.62:6814/2055487337', 'state': ['exists', 'up']}, {'osd': 8, 'uuid': 'b7eb6461-f6fa-4a12-864c-6e6748e6337e', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 63, 'last_clean_end': 159, 'up_from': 197, 'up_thru': 212, 'down_at': 160, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6800', 'nonce': 1873408265}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6801', 'nonce': 1873408265}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6803', 'nonce': 1873408265}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6802', 'nonce': 1873408265}]}, 'public_addr': '172.21.15.188:6800/1873408265', 'cluster_addr': '172.21.15.188:6801/1873408265', 'heartbeat_back_addr': '172.21.15.188:6803/1873408265', 'heartbeat_front_addr': '172.21.15.188:6802/1873408265', 'state': ['exists', 'up']}, {'osd': 9, 'uuid': '7d496ad5-46bf-485a-81d9-2b9da2a59882', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 71, 'up_thru': 267, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6804', 'nonce': 1755990887}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6805', 'nonce': 1755990887}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6807', 'nonce': 1755990887}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6806', 'nonce': 1755990887}]}, 'public_addr': '172.21.15.188:6804/1755990887', 'cluster_addr': '172.21.15.188:6805/1755990887', 'heartbeat_back_addr': '172.21.15.188:6807/1755990887', 'heartbeat_front_addr': '172.21.15.188:6806/1755990887', 'state': ['exists', 'up']}, {'osd': 10, 'uuid': '6cbb80ce-37f7-48df-9090-09a6068e4490', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 77, 'up_thru': 344, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6808', 'nonce': 3777340429}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6809', 'nonce': 3777340429}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6811', 'nonce': 3777340429}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6810', 'nonce': 3777340429}]}, 'public_addr': '172.21.15.188:6808/3777340429', 'cluster_addr': '172.21.15.188:6809/3777340429', 'heartbeat_back_addr': '172.21.15.188:6811/3777340429', 'heartbeat_front_addr': '172.21.15.188:6810/3777340429', 'state': ['exists', 'up']}, {'osd': 11, 'uuid': 'c03517c4-fdb0-4587-96c1-b959041c4344', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 85, 'up_thru': 267, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6812', 'nonce': 3987199514}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6813', 'nonce': 3987199514}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6815', 'nonce': 3987199514}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.188:6814', 'nonce': 3987199514}]}, 'public_addr': '172.21.15.188:6812/3987199514', 'cluster_addr': '172.21.15.188:6813/3987199514', 'heartbeat_back_addr': '172.21.15.188:6815/3987199514', 'heartbeat_front_addr': '172.21.15.188:6814/3987199514', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-01T19:38:13.947727+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-01T19:38:13.192409+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-01T19:39:04.864242+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-01T19:38:52.795261+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-01T19:38:31.299968+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-01T19:39:07.872505+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-01T19:39:02.161102+0000', 'dead_epoch': 299}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-01T19:38:06.107532+0000', 'dead_epoch': 0}, {'osd': 8, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-04-01T19:38:31.826258+0000', 'dead_epoch': 159}, {'osd': 9, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-01T19:38:04.891155+0000', 'dead_epoch': 0}, {'osd': 10, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-01T19:38:07.099946+0000', 'dead_epoch': 0}, {'osd': 11, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-01T19:38:02.326732+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {'172.21.15.22:0/3735983556': '2024-04-02T19:16:30.513384+0000', '172.21.15.22:0/3575578250': '2024-04-02T19:16:30.513384+0000', '172.21.15.22:0/2493529775': '2024-04-02T19:16:02.302343+0000', '172.21.15.22:6800/2678666836': '2024-04-02T19:16:30.513384+0000', '172.21.15.22:0/2389537847': '2024-04-02T19:16:02.302343+0000', '172.21.15.22:0/798807675': '2024-04-02T19:16:02.302343+0000', '172.21.15.22:6800/1090179981': '2024-04-02T19:16:02.302343+0000', '172.21.15.22:0/51907384': '2024-04-02T19:16:30.513384+0000'}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-01T19:39:18.148 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-04-01T19:39:18.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:18.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:18.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:18.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:18.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:18.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:18 smithi022 ceph-mon[39439]: pgmap v1033: 1 pgs: 1 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:18.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:18 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:39:18.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:18 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:39:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:18 smithi188 ceph-mon[43939]: pgmap v1033: 1 pgs: 1 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:18 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:39:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:18 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:39:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:18 smithi062 ceph-mon[44211]: pgmap v1033: 1 pgs: 1 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:18 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:39:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:18 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:39:18.807 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:39:18.810 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:18.811 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:39:18.912 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:39:18.945 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:18.968 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:39:18.971 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:18.971 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:39:19.072 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:39:19.104 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:19.125 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:39:19.127 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:19.128 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:39:19.229 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:39:19.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:19 smithi062 ceph-mon[44211]: osdmap e361: 12 total, 12 up, 11 in 2024-04-01T19:39:19.262 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:19.283 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:39:19.286 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:19.286 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:39:19.345 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:19 smithi022 ceph-mon[39439]: osdmap e361: 12 total, 12 up, 11 in 2024-04-01T19:39:19.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:19 smithi188 ceph-mon[43939]: osdmap e361: 12 total, 12 up, 11 in 2024-04-01T19:39:19.387 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:39:19.418 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:19.438 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:39:19.441 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:19.442 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:39:19.543 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:39:19.574 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:19.597 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:39:19.599 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:19.600 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:39:19.701 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:39:19.732 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:19.754 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:39:19.756 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:19.757 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:39:19.764 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:39:19.764 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 20, 2024-04-01T19:39:19.764 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 600, 2024-04-01T19:39:19.764 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:39:19.764 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.764 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:148823 3.7 3:ee362c40:::benchmark_data_smithi188_92122_object148822:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e220)", 2024-04-01T19:39:19.764 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:15.680681+0000", 2024-04-01T19:39:19.764 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 483.68929796399999, 2024-04-01T19:39:19.764 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.23053715599999999, 2024-04-01T19:39:19.764 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:39:19.765 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:39:19.765 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:19.765 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:39:19.765 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:39:19.765 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:19.765 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 148823 2024-04-01T19:39:19.765 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.765 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:39:19.765 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.765 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:39:19.765 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680681+0000", 2024-04-01T19:39:19.765 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.765 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.765 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.766 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:39:19.766 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680681+0000", 2024-04-01T19:39:19.766 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.766 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.766 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.766 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:39:19.766 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680682+0000", 2024-04-01T19:39:19.766 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.015e-06 2024-04-01T19:39:19.766 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.766 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.766 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:39:19.766 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680720+0000", 2024-04-01T19:39:19.767 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7586999999999998e-05 2024-04-01T19:39:19.767 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.767 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.767 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:39:19.767 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680728+0000", 2024-04-01T19:39:19.767 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6660000000000008e-06 2024-04-01T19:39:19.767 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.767 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.767 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:39:19.767 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680734+0000", 2024-04-01T19:39:19.767 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2380000000000002e-06 2024-04-01T19:39:19.767 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.767 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.767 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:39:19.768 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680831+0000", 2024-04-01T19:39:19.768 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.6881999999999998e-05 2024-04-01T19:39:19.768 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.768 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.768 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:39:19.768 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680949+0000", 2024-04-01T19:39:19.768 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00011820999999999999 2024-04-01T19:39:19.768 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.768 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.768 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 11", 2024-04-01T19:39:19.768 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.681080+0000", 2024-04-01T19:39:19.768 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013095399999999999 2024-04-01T19:39:19.768 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.768 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.769 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:39:19.769 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.689897+0000", 2024-04-01T19:39:19.769 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0088173039999999998 2024-04-01T19:39:19.769 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.769 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.769 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:19.769 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.911098+0000", 2024-04-01T19:39:19.769 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.221200906 2024-04-01T19:39:19.769 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.769 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.769 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:39:19.769 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.911162+0000", 2024-04-01T19:39:19.769 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4022000000000005e-05 2024-04-01T19:39:19.769 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.769 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.770 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:39:19.770 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.911219+0000", 2024-04-01T19:39:19.770 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6372000000000002e-05 2024-04-01T19:39:19.770 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.770 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:19.770 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.770 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.770 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.770 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:148825 3.7 3:e8f36808:::benchmark_data_smithi188_92122_object148824:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e220)", 2024-04-01T19:39:19.770 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:15.680743+0000", 2024-04-01T19:39:19.770 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 483.68923617399997, 2024-04-01T19:39:19.770 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.23060560799999999, 2024-04-01T19:39:19.770 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:39:19.771 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:39:19.771 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:19.771 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:39:19.771 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:39:19.771 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:19.771 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 148825 2024-04-01T19:39:19.771 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.771 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:39:19.771 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.771 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:39:19.771 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680743+0000", 2024-04-01T19:39:19.771 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.771 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.771 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.771 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:39:19.772 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680743+0000", 2024-04-01T19:39:19.772 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.772 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.772 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.772 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:39:19.772 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680745+0000", 2024-04-01T19:39:19.772 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1550000000000001e-06 2024-04-01T19:39:19.772 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.772 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.772 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:39:19.772 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680766+0000", 2024-04-01T19:39:19.772 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0455999999999999e-05 2024-04-01T19:39:19.772 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.772 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.772 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:39:19.773 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680772+0000", 2024-04-01T19:39:19.773 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2530000000000001e-06 2024-04-01T19:39:19.773 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.773 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.773 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:39:19.773 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.680778+0000", 2024-04-01T19:39:19.773 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8810000000000001e-06 2024-04-01T19:39:19.773 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.773 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.773 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:39:19.773 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.685722+0000", 2024-04-01T19:39:19.773 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.004943996 2024-04-01T19:39:19.773 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.773 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.774 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:39:19.774 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.685918+0000", 2024-04-01T19:39:19.774 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00019609799999999999 2024-04-01T19:39:19.774 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.774 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.774 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 11", 2024-04-01T19:39:19.774 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.686042+0000", 2024-04-01T19:39:19.774 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012375600000000001 2024-04-01T19:39:19.774 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.774 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.774 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:39:19.774 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.694464+0000", 2024-04-01T19:39:19.774 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0084217579999999997 2024-04-01T19:39:19.774 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.775 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.775 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:19.775 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.911265+0000", 2024-04-01T19:39:19.775 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21680168399999999 2024-04-01T19:39:19.775 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.775 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.775 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:39:19.775 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.911314+0000", 2024-04-01T19:39:19.775 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8352000000000001e-05 2024-04-01T19:39:19.775 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.775 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.775 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:39:19.775 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.911349+0000", 2024-04-01T19:39:19.775 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5219000000000003e-05 2024-04-01T19:39:19.775 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.776 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:19.776 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.776 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.776 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.776 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:148870 3.7 3:e44d9249:::benchmark_data_smithi188_92122_object148869:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e220)", 2024-04-01T19:39:19.776 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:15.723501+0000", 2024-04-01T19:39:19.776 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 483.64647883800001, 2024-04-01T19:39:19.776 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.192572565, 2024-04-01T19:39:19.776 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:39:19.776 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:39:19.776 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:19.776 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:39:19.776 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:39:19.776 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:19.777 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 148870 2024-04-01T19:39:19.777 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.777 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:39:19.777 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.777 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:39:19.777 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.723501+0000", 2024-04-01T19:39:19.777 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.777 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.777 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.777 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:39:19.777 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.723501+0000", 2024-04-01T19:39:19.777 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.777 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.777 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.778 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:39:19.778 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.723503+0000", 2024-04-01T19:39:19.778 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9489999999999999e-06 2024-04-01T19:39:19.778 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.778 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.778 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:39:19.778 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.723547+0000", 2024-04-01T19:39:19.778 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4650000000000001e-05 2024-04-01T19:39:19.778 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.778 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.778 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:39:19.778 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.723563+0000", 2024-04-01T19:39:19.778 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5648e-05 2024-04-01T19:39:19.779 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.779 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.779 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:39:19.779 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.723572+0000", 2024-04-01T19:39:19.779 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.7099999999999996e-06 2024-04-01T19:39:19.779 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.779 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.779 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:39:19.779 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.723639+0000", 2024-04-01T19:39:19.779 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.7899999999999997e-05 2024-04-01T19:39:19.779 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.779 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.779 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:39:19.779 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.723766+0000", 2024-04-01T19:39:19.780 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000126866 2024-04-01T19:39:19.780 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.780 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.780 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 11", 2024-04-01T19:39:19.780 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.723914+0000", 2024-04-01T19:39:19.780 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014736 2024-04-01T19:39:19.780 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.780 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.780 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:39:19.780 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.728167+0000", 2024-04-01T19:39:19.780 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0042528790000000002 2024-04-01T19:39:19.780 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.780 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.780 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:19.781 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.915937+0000", 2024-04-01T19:39:19.781 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.187770837 2024-04-01T19:39:19.781 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.781 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.781 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:39:19.781 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.916012+0000", 2024-04-01T19:39:19.781 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4481999999999996e-05 2024-04-01T19:39:19.781 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.781 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.781 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:39:19.781 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.916073+0000", 2024-04-01T19:39:19.781 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1284000000000005e-05 2024-04-01T19:39:19.781 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.781 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:19.782 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.782 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.782 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.782 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:148878 3.7 3:e6c4fcb6:::benchmark_data_smithi188_92122_object148877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e220)", 2024-04-01T19:39:19.782 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:15.734454+0000", 2024-04-01T19:39:19.782 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 483.63552528600002, 2024-04-01T19:39:19.782 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.18392858200000001, 2024-04-01T19:39:19.782 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:39:19.782 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:39:19.782 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:19.782 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:39:19.782 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:39:19.783 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:19.783 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 148878 2024-04-01T19:39:19.783 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.783 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:39:19.783 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.783 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:39:19.783 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.734454+0000", 2024-04-01T19:39:19.783 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.783 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.783 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.783 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:39:19.783 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.734454+0000", 2024-04-01T19:39:19.783 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.783 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.784 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.784 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:39:19.784 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.734457+0000", 2024-04-01T19:39:19.784 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3740000000000001e-06 2024-04-01T19:39:19.784 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.784 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.784 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:39:19.784 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.734514+0000", 2024-04-01T19:39:19.784 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7914000000000002e-05 2024-04-01T19:39:19.784 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.784 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.784 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:39:19.784 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.734527+0000", 2024-04-01T19:39:19.784 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2435999999999999e-05 2024-04-01T19:39:19.785 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.785 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.785 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:39:19.785 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.734534+0000", 2024-04-01T19:39:19.785 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2439999999999996e-06 2024-04-01T19:39:19.785 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.785 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.785 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:39:19.785 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.734585+0000", 2024-04-01T19:39:19.785 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0739000000000003e-05 2024-04-01T19:39:19.785 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.785 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.785 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:39:19.785 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.734696+0000", 2024-04-01T19:39:19.785 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000111444 2024-04-01T19:39:19.786 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.786 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.786 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 11", 2024-04-01T19:39:19.786 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.734850+0000", 2024-04-01T19:39:19.786 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015382300000000001 2024-04-01T19:39:19.786 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.786 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.786 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:39:19.786 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.738171+0000", 2024-04-01T19:39:19.786 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0033207029999999999 2024-04-01T19:39:19.786 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.786 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.786 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:19.787 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.918297+0000", 2024-04-01T19:39:19.787 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.180126434 2024-04-01T19:39:19.787 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.787 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.787 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:39:19.787 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.918337+0000", 2024-04-01T19:39:19.787 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9990000000000002e-05 2024-04-01T19:39:19.787 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.787 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.787 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:39:19.787 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.918383+0000", 2024-04-01T19:39:19.787 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5481e-05 2024-04-01T19:39:19.788 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.788 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:19.788 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.788 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.788 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.788 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:148906 3.7 3:e033df60:::benchmark_data_smithi188_92122_object148905:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e220)", 2024-04-01T19:39:19.788 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:15.756560+0000", 2024-04-01T19:39:19.788 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 483.61341938599998, 2024-04-01T19:39:19.788 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.16191088200000001, 2024-04-01T19:39:19.788 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:39:19.788 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:39:19.788 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:19.788 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:39:19.788 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:39:19.789 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:19.789 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 148906 2024-04-01T19:39:19.789 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.789 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:39:19.789 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.789 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:39:19.789 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.756560+0000", 2024-04-01T19:39:19.789 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.789 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.789 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.789 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:39:19.789 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.756560+0000", 2024-04-01T19:39:19.789 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.789 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.790 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.790 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:39:19.790 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.756561+0000", 2024-04-01T19:39:19.790 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.325e-06 2024-04-01T19:39:19.790 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.790 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.790 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:39:19.790 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.756590+0000", 2024-04-01T19:39:19.790 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.8243e-05 2024-04-01T19:39:19.790 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.790 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.790 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:39:19.791 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.756601+0000", 2024-04-01T19:39:19.791 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1525000000000001e-05 2024-04-01T19:39:19.791 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.791 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.791 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:39:19.791 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.756611+0000", 2024-04-01T19:39:19.791 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0325e-05 2024-04-01T19:39:19.791 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.791 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.791 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:39:19.791 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.756664+0000", 2024-04-01T19:39:19.791 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2843999999999998e-05 2024-04-01T19:39:19.791 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.792 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.792 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:39:19.792 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.756770+0000", 2024-04-01T19:39:19.792 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000105821 2024-04-01T19:39:19.792 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.792 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.792 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 11", 2024-04-01T19:39:19.792 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.756910+0000", 2024-04-01T19:39:19.792 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013955200000000001 2024-04-01T19:39:19.792 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.792 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.792 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:39:19.792 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.763044+0000", 2024-04-01T19:39:19.793 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0061343259999999998 2024-04-01T19:39:19.793 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.793 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.793 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:19.793 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.918409+0000", 2024-04-01T19:39:19.793 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.155365118 2024-04-01T19:39:19.793 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.793 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.793 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:39:19.793 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.918438+0000", 2024-04-01T19:39:19.793 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.8611000000000001e-05 2024-04-01T19:39:19.793 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.793 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.794 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:39:19.794 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.918471+0000", 2024-04-01T19:39:19.794 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3191999999999997e-05 2024-04-01T19:39:19.794 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.794 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:19.794 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.794 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.794 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.794 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:148920 3.7 3:e8ee5001:::benchmark_data_smithi188_92122_object148919:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e220)", 2024-04-01T19:39:19.794 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:15.773529+0000", 2024-04-01T19:39:19.794 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 483.59645056300002, 2024-04-01T19:39:19.794 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.14847933999999999, 2024-04-01T19:39:19.795 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:39:19.795 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:39:19.795 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:19.795 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:39:19.795 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:39:19.795 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:19.795 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 148920 2024-04-01T19:39:19.795 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.795 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:39:19.795 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.795 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:39:19.796 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.773529+0000", 2024-04-01T19:39:19.796 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.796 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.796 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.796 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:39:19.796 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.773529+0000", 2024-04-01T19:39:19.796 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.796 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.796 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.796 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:39:19.796 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.773532+0000", 2024-04-01T19:39:19.796 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.134e-06 2024-04-01T19:39:19.796 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.796 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.796 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:39:19.797 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.773576+0000", 2024-04-01T19:39:19.797 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4014000000000002e-05 2024-04-01T19:39:19.797 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.797 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.797 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:39:19.797 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.773593+0000", 2024-04-01T19:39:19.797 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6796e-05 2024-04-01T19:39:19.797 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.797 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.797 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:39:19.797 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.773604+0000", 2024-04-01T19:39:19.797 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1083e-05 2024-04-01T19:39:19.797 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.797 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.798 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:39:19.798 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.773673+0000", 2024-04-01T19:39:19.798 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8860000000000001e-05 2024-04-01T19:39:19.798 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.798 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.798 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:39:19.798 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.773758+0000", 2024-04-01T19:39:19.798 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5511000000000002e-05 2024-04-01T19:39:19.798 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.798 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.798 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 11", 2024-04-01T19:39:19.798 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.773844+0000", 2024-04-01T19:39:19.799 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6197000000000002e-05 2024-04-01T19:39:19.799 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.799 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.799 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:39:19.799 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.777441+0000", 2024-04-01T19:39:19.799 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0035961970000000002 2024-04-01T19:39:19.799 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.799 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.799 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:19.799 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.921896+0000", 2024-04-01T19:39:19.799 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.14445524400000001 2024-04-01T19:39:19.799 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.799 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.799 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:39:19.799 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.921956+0000", 2024-04-01T19:39:19.799 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0443999999999999e-05 2024-04-01T19:39:19.800 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.800 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.800 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:39:19.800 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.922008+0000", 2024-04-01T19:39:19.800 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.1860000000000002e-05 2024-04-01T19:39:19.800 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.800 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:19.800 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.800 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.800 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.800 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:148927 3.7 3:e98e16cd:::benchmark_data_smithi188_92122_object148926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e220)", 2024-04-01T19:39:19.800 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:15.777641+0000", 2024-04-01T19:39:19.800 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 483.59233868000001, 2024-04-01T19:39:19.800 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.144497763, 2024-04-01T19:39:19.801 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:39:19.801 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:39:19.801 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:19.801 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:39:19.801 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:39:19.801 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:19.801 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 148927 2024-04-01T19:39:19.801 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.801 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:39:19.801 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.801 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:39:19.801 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.777641+0000", 2024-04-01T19:39:19.801 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.801 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.801 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.802 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:39:19.802 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.777641+0000", 2024-04-01T19:39:19.802 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.802 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.802 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.802 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:39:19.802 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.777643+0000", 2024-04-01T19:39:19.802 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4540000000000001e-06 2024-04-01T19:39:19.802 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.802 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.802 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:39:19.802 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.777684+0000", 2024-04-01T19:39:19.803 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1035000000000003e-05 2024-04-01T19:39:19.803 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.803 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.803 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:39:19.803 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.777702+0000", 2024-04-01T19:39:19.803 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7819e-05 2024-04-01T19:39:19.803 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.803 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.803 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:39:19.803 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.777710+0000", 2024-04-01T19:39:19.803 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2609999999999993e-06 2024-04-01T19:39:19.803 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.803 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.803 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:39:19.804 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.778676+0000", 2024-04-01T19:39:19.804 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00096519800000000001 2024-04-01T19:39:19.804 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.804 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.804 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:39:19.804 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.778769+0000", 2024-04-01T19:39:19.804 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.3930000000000004e-05 2024-04-01T19:39:19.804 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.804 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.804 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 11", 2024-04-01T19:39:19.804 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.778857+0000", 2024-04-01T19:39:19.804 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.7577000000000005e-05 2024-04-01T19:39:19.804 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.804 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.804 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:39:19.805 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.793914+0000", 2024-04-01T19:39:19.805 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.015057143 2024-04-01T19:39:19.805 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.805 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.805 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:19.805 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.922048+0000", 2024-04-01T19:39:19.805 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.12813411799999999 2024-04-01T19:39:19.805 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.805 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.805 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:39:19.805 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.922101+0000", 2024-04-01T19:39:19.805 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2374999999999999e-05 2024-04-01T19:39:19.805 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.805 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.806 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:39:19.806 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:15.922139+0000", 2024-04-01T19:39:19.806 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7852999999999998e-05 2024-04-01T19:39:19.806 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.806 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:19.806 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.806 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.806 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.806 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:194273 3.b 3:de601cd8:::benchmark_data_smithi188_92122_object28682:head [delete] snapc 0=[] ondisk+write+known_if_redirected e230)", 2024-04-01T19:39:19.806 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:53.260941+0000", 2024-04-01T19:39:19.806 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 446.10903850900002, 2024-04-01T19:39:19.806 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21903962399999999, 2024-04-01T19:39:19.807 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:39:19.807 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:39:19.807 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:19.807 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:39:19.807 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:39:19.807 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:19.807 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 194273 2024-04-01T19:39:19.807 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.807 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:39:19.807 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.807 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:39:19.807 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.260941+0000", 2024-04-01T19:39:19.807 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.807 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.807 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.808 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:39:19.808 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.260941+0000", 2024-04-01T19:39:19.808 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.808 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.808 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.808 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:39:19.808 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.260942+0000", 2024-04-01T19:39:19.808 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.418e-06 2024-04-01T19:39:19.808 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.808 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.808 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:39:19.809 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.260947+0000", 2024-04-01T19:39:19.809 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0019999999999997e-06 2024-04-01T19:39:19.809 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.809 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.809 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:39:19.809 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.260958+0000", 2024-04-01T19:39:19.809 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0166999999999999e-05 2024-04-01T19:39:19.809 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.809 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.809 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:39:19.809 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.260963+0000", 2024-04-01T19:39:19.809 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7930000000000003e-06 2024-04-01T19:39:19.809 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.810 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.810 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:39:19.810 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.261018+0000", 2024-04-01T19:39:19.810 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4691000000000002e-05 2024-04-01T19:39:19.810 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.810 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.810 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:39:19.810 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.261090+0000", 2024-04-01T19:39:19.810 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2131000000000004e-05 2024-04-01T19:39:19.810 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.810 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.810 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:39:19.811 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.261156+0000", 2024-04-01T19:39:19.811 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5462000000000004e-05 2024-04-01T19:39:19.811 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.811 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.811 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:39:19.811 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.264691+0000", 2024-04-01T19:39:19.811 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.003535201 2024-04-01T19:39:19.811 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.811 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.811 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:19.811 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.479894+0000", 2024-04-01T19:39:19.811 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21520278500000001 2024-04-01T19:39:19.811 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.811 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.811 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:39:19.812 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.479945+0000", 2024-04-01T19:39:19.812 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0949999999999998e-05 2024-04-01T19:39:19.812 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.812 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.812 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:39:19.812 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.479981+0000", 2024-04-01T19:39:19.812 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.6023999999999999e-05 2024-04-01T19:39:19.812 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.812 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:19.812 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.812 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.812 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.812 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:194319 3.b 3:dd2a0756:::benchmark_data_smithi188_92122_object28728:head [delete] snapc 0=[] ondisk+write+known_if_redirected e230)", 2024-04-01T19:39:19.812 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:53.296858+0000", 2024-04-01T19:39:19.813 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 446.07312115500002, 2024-04-01T19:39:19.813 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.183193935, 2024-04-01T19:39:19.813 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:39:19.813 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:39:19.813 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:19.813 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:39:19.813 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:39:19.813 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:19.813 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 194319 2024-04-01T19:39:19.813 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.813 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:39:19.813 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.813 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:39:19.814 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.296858+0000", 2024-04-01T19:39:19.814 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.814 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.814 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.814 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:39:19.814 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.296858+0000", 2024-04-01T19:39:19.814 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.814 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.814 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.814 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:39:19.814 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.296859+0000", 2024-04-01T19:39:19.815 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.2999999999999999e-07 2024-04-01T19:39:19.815 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.815 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.815 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:39:19.815 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.296866+0000", 2024-04-01T19:39:19.815 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3110000000000002e-06 2024-04-01T19:39:19.815 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.815 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.815 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:39:19.815 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.296873+0000", 2024-04-01T19:39:19.815 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7789999999999996e-06 2024-04-01T19:39:19.815 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.816 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.816 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:39:19.816 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.296879+0000", 2024-04-01T19:39:19.816 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0839999999999997e-06 2024-04-01T19:39:19.816 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.816 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.816 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:39:19.816 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.296951+0000", 2024-04-01T19:39:19.816 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.1916999999999996e-05 2024-04-01T19:39:19.816 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.816 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.817 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:39:19.817 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.297075+0000", 2024-04-01T19:39:19.817 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000123399 2024-04-01T19:39:19.817 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.817 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.817 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:39:19.817 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.297706+0000", 2024-04-01T19:39:19.817 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00063164299999999998 2024-04-01T19:39:19.817 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.817 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.817 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:39:19.817 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.302007+0000", 2024-04-01T19:39:19.817 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0043007710000000001 2024-04-01T19:39:19.817 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.818 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.818 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:19.818 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.480005+0000", 2024-04-01T19:39:19.818 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.17799791500000001 2024-04-01T19:39:19.818 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.818 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.818 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:39:19.818 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.480032+0000", 2024-04-01T19:39:19.818 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6539000000000001e-05 2024-04-01T19:39:19.818 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.818 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.818 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:39:19.818 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.480052+0000", 2024-04-01T19:39:19.819 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0647000000000001e-05 2024-04-01T19:39:19.819 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.819 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:19.819 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.819 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.819 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.819 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:194338 3.b 3:d74388c7:::benchmark_data_smithi188_92122_object28747:head [delete] snapc 0=[] ondisk+write+known_if_redirected e230)", 2024-04-01T19:39:19.819 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:53.312611+0000", 2024-04-01T19:39:19.819 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 446.05736821800002, 2024-04-01T19:39:19.819 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.167506657, 2024-04-01T19:39:19.819 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:39:19.819 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:39:19.819 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:19.819 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:39:19.819 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:39:19.820 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:19.820 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 194338 2024-04-01T19:39:19.820 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.820 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:39:19.820 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.820 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:39:19.820 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.312611+0000", 2024-04-01T19:39:19.820 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.820 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.820 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.820 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:39:19.820 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.312611+0000", 2024-04-01T19:39:19.820 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.820 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.821 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.821 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:39:19.821 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.312612+0000", 2024-04-01T19:39:19.821 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2079999999999999e-06 2024-04-01T19:39:19.821 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.821 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.821 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:39:19.821 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.312617+0000", 2024-04-01T19:39:19.821 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4789999999999998e-06 2024-04-01T19:39:19.821 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.821 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.821 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:39:19.821 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.312626+0000", 2024-04-01T19:39:19.822 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8359999999999998e-06 2024-04-01T19:39:19.822 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.822 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.822 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:39:19.822 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.312632+0000", 2024-04-01T19:39:19.822 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.6490000000000002e-06 2024-04-01T19:39:19.822 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.822 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.822 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:39:19.822 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.312683+0000", 2024-04-01T19:39:19.822 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0850000000000003e-05 2024-04-01T19:39:19.822 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.823 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.823 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:39:19.823 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.312793+0000", 2024-04-01T19:39:19.823 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00010964299999999999 2024-04-01T19:39:19.823 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.823 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.823 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:39:19.823 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.312901+0000", 2024-04-01T19:39:19.823 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00010823900000000001 2024-04-01T19:39:19.823 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.823 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.823 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:39:19.823 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.317232+0000", 2024-04-01T19:39:19.823 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0043310370000000003 2024-04-01T19:39:19.824 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.824 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.824 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:19.824 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.480073+0000", 2024-04-01T19:39:19.824 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.162841238 2024-04-01T19:39:19.824 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.824 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.824 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:39:19.824 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.480099+0000", 2024-04-01T19:39:19.824 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5179999999999999e-05 2024-04-01T19:39:19.824 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.824 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.824 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:39:19.825 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.480118+0000", 2024-04-01T19:39:19.825 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9298000000000001e-05 2024-04-01T19:39:19.825 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.825 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:19.825 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.825 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.825 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.825 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:194367 3.b 3:d1b8978a:::benchmark_data_smithi188_92122_object28776:head [delete] snapc 0=[] ondisk+write+known_if_redirected e230)", 2024-04-01T19:39:19.825 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:53.337487+0000", 2024-04-01T19:39:19.825 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 446.03249266500001, 2024-04-01T19:39:19.825 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.14908616699999999, 2024-04-01T19:39:19.825 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:39:19.825 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:39:19.825 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:19.826 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:39:19.826 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:39:19.826 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:19.826 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 194367 2024-04-01T19:39:19.826 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.826 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:39:19.826 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.826 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:39:19.826 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.337487+0000", 2024-04-01T19:39:19.826 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.826 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.826 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.826 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:39:19.827 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.337487+0000", 2024-04-01T19:39:19.827 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.827 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.827 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.827 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:39:19.827 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.337490+0000", 2024-04-01T19:39:19.827 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.7779999999999999e-06 2024-04-01T19:39:19.827 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.827 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.827 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:39:19.827 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.337497+0000", 2024-04-01T19:39:19.827 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.447e-06 2024-04-01T19:39:19.827 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.827 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.828 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:39:19.828 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.337526+0000", 2024-04-01T19:39:19.828 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.9195000000000001e-05 2024-04-01T19:39:19.828 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.828 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.828 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:39:19.828 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.337535+0000", 2024-04-01T19:39:19.828 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6470000000000004e-06 2024-04-01T19:39:19.828 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.828 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.828 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:39:19.828 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.337579+0000", 2024-04-01T19:39:19.828 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4508999999999997e-05 2024-04-01T19:39:19.829 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.829 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.829 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:39:19.829 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.337668+0000", 2024-04-01T19:39:19.829 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8261000000000001e-05 2024-04-01T19:39:19.829 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.829 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.829 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:39:19.829 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.337759+0000", 2024-04-01T19:39:19.829 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.1328000000000004e-05 2024-04-01T19:39:19.829 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.829 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.829 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:39:19.829 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.341905+0000", 2024-04-01T19:39:19.829 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0041456829999999998 2024-04-01T19:39:19.830 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.830 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.830 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:19.830 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.486462+0000", 2024-04-01T19:39:19.830 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.144557871 2024-04-01T19:39:19.830 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.830 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.830 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:39:19.830 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.486524+0000", 2024-04-01T19:39:19.830 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1369000000000001e-05 2024-04-01T19:39:19.830 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.830 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.830 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:39:19.831 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.486573+0000", 2024-04-01T19:39:19.831 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9079000000000002e-05 2024-04-01T19:39:19.831 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.831 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:19.831 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.831 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.831 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.831 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:194382 3.b 3:d8d4e65f:::benchmark_data_smithi188_92122_object28791:head [delete] snapc 0=[] ondisk+write+known_if_redirected e230)", 2024-04-01T19:39:19.831 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:31:53.350327+0000", 2024-04-01T19:39:19.831 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 446.01965253499998, 2024-04-01T19:39:19.831 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.14341351199999999, 2024-04-01T19:39:19.831 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:39:19.831 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:39:19.831 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:19.831 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:39:19.832 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:39:19.832 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:19.832 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 194382 2024-04-01T19:39:19.832 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.832 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:39:19.832 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.832 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:39:19.832 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.350327+0000", 2024-04-01T19:39:19.832 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.832 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.832 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.832 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:39:19.832 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.350327+0000", 2024-04-01T19:39:19.832 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.832 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.832 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.833 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:39:19.833 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.350329+0000", 2024-04-01T19:39:19.833 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5749999999999999e-06 2024-04-01T19:39:19.833 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.833 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.833 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:39:19.833 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.350337+0000", 2024-04-01T19:39:19.833 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.1489999999999997e-06 2024-04-01T19:39:19.833 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.833 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.833 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:39:19.833 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.350356+0000", 2024-04-01T19:39:19.833 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9275000000000001e-05 2024-04-01T19:39:19.833 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.833 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.833 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:39:19.834 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.350366+0000", 2024-04-01T19:39:19.834 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0373999999999999e-05 2024-04-01T19:39:19.834 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.834 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.834 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:39:19.834 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.350446+0000", 2024-04-01T19:39:19.834 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0037000000000006e-05 2024-04-01T19:39:19.834 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.834 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.834 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:39:19.834 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.350588+0000", 2024-04-01T19:39:19.834 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014181799999999999 2024-04-01T19:39:19.835 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.835 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.835 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:39:19.837 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.350680+0000", 2024-04-01T19:39:19.837 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.1850999999999999e-05 2024-04-01T19:39:19.838 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.838 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.838 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:39:19.838 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.354625+0000", 2024-04-01T19:39:19.838 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0039449469999999999 2024-04-01T19:39:19.838 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.838 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.838 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:19.838 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.493671+0000", 2024-04-01T19:39:19.838 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13904586799999999 2024-04-01T19:39:19.838 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.838 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.839 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:39:19.839 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.493708+0000", 2024-04-01T19:39:19.839 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7401000000000003e-05 2024-04-01T19:39:19.839 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.839 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.839 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:39:19.839 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:31:53.493740+0000", 2024-04-01T19:39:19.839 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.2217e-05 2024-04-01T19:39:19.839 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.839 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:19.839 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.839 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.839 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.840 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:203450 3.b 3:dcc0e3f0:::benchmark_data_smithi188_92122_object37859:head [delete] snapc 0=[] ondisk+write+known_if_redirected e232)", 2024-04-01T19:39:19.840 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:32:00.596659+0000", 2024-04-01T19:39:19.840 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 438.77332014500001, 2024-04-01T19:39:19.840 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21783223199999999, 2024-04-01T19:39:19.840 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:39:19.840 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:39:19.840 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:19.840 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:39:19.840 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:39:19.840 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:19.840 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 203450 2024-04-01T19:39:19.840 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.840 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:39:19.840 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.841 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:39:19.841 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.596659+0000", 2024-04-01T19:39:19.841 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.841 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.841 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.841 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:39:19.841 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.596659+0000", 2024-04-01T19:39:19.841 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.841 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.841 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.841 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:39:19.842 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.596661+0000", 2024-04-01T19:39:19.842 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.798e-06 2024-04-01T19:39:19.842 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.842 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.842 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:39:19.842 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.596666+0000", 2024-04-01T19:39:19.842 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2000000000000002e-06 2024-04-01T19:39:19.842 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.842 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.842 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:39:19.842 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.596679+0000", 2024-04-01T19:39:19.842 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2345e-05 2024-04-01T19:39:19.842 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.843 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.843 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:39:19.843 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.596686+0000", 2024-04-01T19:39:19.843 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4370000000000001e-06 2024-04-01T19:39:19.843 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.843 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.843 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:39:19.843 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.596743+0000", 2024-04-01T19:39:19.843 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7003000000000003e-05 2024-04-01T19:39:19.843 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.843 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.843 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:39:19.843 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.596854+0000", 2024-04-01T19:39:19.843 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000110893 2024-04-01T19:39:19.844 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.844 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.844 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:39:19.844 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.596958+0000", 2024-04-01T19:39:19.844 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000104225 2024-04-01T19:39:19.844 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.844 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.844 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:39:19.844 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.605240+0000", 2024-04-01T19:39:19.844 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0082815370000000003 2024-04-01T19:39:19.844 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.844 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.844 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:19.844 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.814430+0000", 2024-04-01T19:39:19.844 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.20919001100000001 2024-04-01T19:39:19.845 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.845 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.845 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:39:19.845 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.814463+0000", 2024-04-01T19:39:19.845 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3083000000000002e-05 2024-04-01T19:39:19.845 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.845 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.845 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:39:19.845 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.814492+0000", 2024-04-01T19:39:19.845 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.87e-05 2024-04-01T19:39:19.845 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.845 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:19.845 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.845 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.845 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.846 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:203452 3.b 3:d88decb6:::benchmark_data_smithi188_92122_object37861:head [delete] snapc 0=[] ondisk+write+known_if_redirected e232)", 2024-04-01T19:39:19.846 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:32:00.597081+0000", 2024-04-01T19:39:19.846 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 438.77289879699998, 2024-04-01T19:39:19.846 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.22275341300000001, 2024-04-01T19:39:19.846 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:39:19.846 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:39:19.846 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:19.846 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:39:19.846 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:39:19.846 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:19.846 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 203452 2024-04-01T19:39:19.846 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.847 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:39:19.847 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.847 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:39:19.847 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.597081+0000", 2024-04-01T19:39:19.847 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.847 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.847 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.847 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:39:19.847 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.597081+0000", 2024-04-01T19:39:19.847 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.847 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.847 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.847 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:39:19.847 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.597082+0000", 2024-04-01T19:39:19.848 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7519999999999999e-06 2024-04-01T19:39:19.848 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.848 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.848 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:39:19.848 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.597088+0000", 2024-04-01T19:39:19.848 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3430000000000003e-06 2024-04-01T19:39:19.848 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.848 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.848 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:39:19.848 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.597099+0000", 2024-04-01T19:39:19.848 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.136e-05 2024-04-01T19:39:19.848 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.848 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.848 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:39:19.849 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.597107+0000", 2024-04-01T19:39:19.849 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5920000000000003e-06 2024-04-01T19:39:19.849 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.849 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.849 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:39:19.849 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.601775+0000", 2024-04-01T19:39:19.849 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0046678930000000002 2024-04-01T19:39:19.849 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.849 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.849 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:39:19.849 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.601854+0000", 2024-04-01T19:39:19.849 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9621000000000002e-05 2024-04-01T19:39:19.849 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.850 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.850 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:39:19.850 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.601928+0000", 2024-04-01T19:39:19.850 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3775000000000004e-05 2024-04-01T19:39:19.850 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.850 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.850 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:39:19.850 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.609107+0000", 2024-04-01T19:39:19.850 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0071786749999999998 2024-04-01T19:39:19.850 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.850 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.850 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:19.850 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.819715+0000", 2024-04-01T19:39:19.851 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21060874700000001 2024-04-01T19:39:19.851 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.851 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.851 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:39:19.851 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.819776+0000", 2024-04-01T19:39:19.851 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0554999999999999e-05 2024-04-01T19:39:19.852 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.852 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.852 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:39:19.852 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.819834+0000", 2024-04-01T19:39:19.852 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8100000000000003e-05 2024-04-01T19:39:19.852 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.852 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:19.853 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.853 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.853 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.853 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:203468 3.b 3:df17487f:::benchmark_data_smithi188_92122_object37877:head [delete] snapc 0=[] ondisk+write+known_if_redirected e232)", 2024-04-01T19:39:19.853 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:32:00.605518+0000", 2024-04-01T19:39:19.853 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 438.76446162500002, 2024-04-01T19:39:19.853 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21447159700000001, 2024-04-01T19:39:19.853 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:39:19.853 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:39:19.853 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:19.853 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:39:19.853 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:39:19.853 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:19.854 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 203468 2024-04-01T19:39:19.854 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.854 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:39:19.854 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.854 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:39:19.854 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.605518+0000", 2024-04-01T19:39:19.854 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.854 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.854 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.854 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:39:19.854 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.605518+0000", 2024-04-01T19:39:19.854 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.855 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.855 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.855 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:39:19.855 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.605519+0000", 2024-04-01T19:39:19.855 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3200000000000001e-06 2024-04-01T19:39:19.855 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.855 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.855 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:39:19.855 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.605524+0000", 2024-04-01T19:39:19.855 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7049999999999998e-06 2024-04-01T19:39:19.855 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.855 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.855 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:39:19.856 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.605533+0000", 2024-04-01T19:39:19.856 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.2e-06 2024-04-01T19:39:19.856 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.856 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.856 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:39:19.856 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.605539+0000", 2024-04-01T19:39:19.856 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.392e-06 2024-04-01T19:39:19.856 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.856 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.856 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:39:19.856 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.605589+0000", 2024-04-01T19:39:19.856 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9257e-05 2024-04-01T19:39:19.856 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.856 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.856 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:39:19.857 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.605720+0000", 2024-04-01T19:39:19.857 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013134400000000001 2024-04-01T19:39:19.857 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.857 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.857 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:39:19.857 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.605843+0000", 2024-04-01T19:39:19.857 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000122705 2024-04-01T19:39:19.857 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.857 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.857 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:39:19.857 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.609179+0000", 2024-04-01T19:39:19.857 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0033365629999999999 2024-04-01T19:39:19.857 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.857 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.857 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:19.857 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.819883+0000", 2024-04-01T19:39:19.858 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21070414600000001 2024-04-01T19:39:19.858 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.858 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.858 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:39:19.858 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.819944+0000", 2024-04-01T19:39:19.858 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0517999999999999e-05 2024-04-01T19:39:19.858 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.858 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.858 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:39:19.858 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.819989+0000", 2024-04-01T19:39:19.858 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5447e-05 2024-04-01T19:39:19.858 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.858 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:19.859 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.859 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.859 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.859 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:203518 3.b 3:dd1c4ef6:::benchmark_data_smithi188_92122_object37927:head [delete] snapc 0=[] ondisk+write+known_if_redirected e232)", 2024-04-01T19:39:19.859 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:32:00.644942+0000", 2024-04-01T19:39:19.859 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 438.725037907, 2024-04-01T19:39:19.859 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.18017075599999999, 2024-04-01T19:39:19.859 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:39:19.859 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:39:19.859 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:19.859 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:39:19.859 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:39:19.859 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:19.859 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 203518 2024-04-01T19:39:19.859 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.860 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:39:19.860 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.860 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:39:19.860 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.644942+0000", 2024-04-01T19:39:19.860 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.860 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.860 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.860 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:39:19.860 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.644942+0000", 2024-04-01T19:39:19.860 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.860 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.860 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.860 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:39:19.861 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.644944+0000", 2024-04-01T19:39:19.861 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.8770000000000002e-06 2024-04-01T19:39:19.861 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.861 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.861 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:39:19.861 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.644952+0000", 2024-04-01T19:39:19.861 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9869999999999999e-06 2024-04-01T19:39:19.861 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.861 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.861 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:39:19.861 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.644968+0000", 2024-04-01T19:39:19.861 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5715000000000001e-05 2024-04-01T19:39:19.861 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.861 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.861 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:39:19.861 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.644977+0000", 2024-04-01T19:39:19.862 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.1849999999999993e-06 2024-04-01T19:39:19.862 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.862 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.862 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:39:19.862 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.645057+0000", 2024-04-01T19:39:19.862 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9501999999999999e-05 2024-04-01T19:39:19.862 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.862 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.862 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:39:19.862 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.645144+0000", 2024-04-01T19:39:19.862 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.7257999999999997e-05 2024-04-01T19:39:19.862 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.862 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.863 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:39:19.863 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.645216+0000", 2024-04-01T19:39:19.863 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2078999999999999e-05 2024-04-01T19:39:19.863 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.863 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.863 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:39:19.863 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.648796+0000", 2024-04-01T19:39:19.863 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0035800789999999999 2024-04-01T19:39:19.863 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.863 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.863 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:19.863 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.825032+0000", 2024-04-01T19:39:19.863 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.17623623699999999 2024-04-01T19:39:19.864 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.864 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.864 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:39:19.864 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.825069+0000", 2024-04-01T19:39:19.864 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.6798999999999998e-05 2024-04-01T19:39:19.864 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.864 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.864 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:39:19.864 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.825112+0000", 2024-04-01T19:39:19.864 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.3037999999999997e-05 2024-04-01T19:39:19.864 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.864 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:19.864 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.864 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.864 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.865 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:203525 3.b 3:d0e726e4:::benchmark_data_smithi188_92122_object37934:head [delete] snapc 0=[] ondisk+write+known_if_redirected e232)", 2024-04-01T19:39:19.865 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:32:00.651620+0000", 2024-04-01T19:39:19.865 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 438.71835902399999, 2024-04-01T19:39:19.865 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.17363524, 2024-04-01T19:39:19.865 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:39:19.865 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:39:19.865 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:19.865 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:39:19.865 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:39:19.865 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:19.865 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 203525 2024-04-01T19:39:19.865 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.865 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:39:19.865 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.865 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:39:19.866 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.651620+0000", 2024-04-01T19:39:19.866 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.866 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.866 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.866 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:39:19.866 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.651620+0000", 2024-04-01T19:39:19.866 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.866 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.866 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.866 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:39:19.866 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.651622+0000", 2024-04-01T19:39:19.866 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.069e-06 2024-04-01T19:39:19.866 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.867 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.867 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:39:19.867 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.651629+0000", 2024-04-01T19:39:19.867 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.596e-06 2024-04-01T19:39:19.867 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.867 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.867 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:39:19.867 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.651641+0000", 2024-04-01T19:39:19.867 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2356e-05 2024-04-01T19:39:19.867 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.867 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.867 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:39:19.867 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.651648+0000", 2024-04-01T19:39:19.867 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9349999999999997e-06 2024-04-01T19:39:19.867 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.868 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.868 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:39:19.868 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.651694+0000", 2024-04-01T19:39:19.868 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5324000000000002e-05 2024-04-01T19:39:19.868 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.868 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.868 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:39:19.868 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.651778+0000", 2024-04-01T19:39:19.868 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4318000000000001e-05 2024-04-01T19:39:19.868 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.868 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.868 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:39:19.868 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.651852+0000", 2024-04-01T19:39:19.868 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3536999999999997e-05 2024-04-01T19:39:19.869 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.869 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.869 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:39:19.869 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.655216+0000", 2024-04-01T19:39:19.869 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.003364704 2024-04-01T19:39:19.869 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.869 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.869 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:19.869 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.825157+0000", 2024-04-01T19:39:19.869 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.169941011 2024-04-01T19:39:19.869 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.869 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.869 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:39:19.870 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.825211+0000", 2024-04-01T19:39:19.870 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4020000000000001e-05 2024-04-01T19:39:19.870 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.870 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.870 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:39:19.870 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.825256+0000", 2024-04-01T19:39:19.870 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4369999999999997e-05 2024-04-01T19:39:19.870 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.870 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:19.870 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.871 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.871 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.871 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:203539 3.b 3:d8c57bdc:::benchmark_data_smithi188_92122_object37948:head [delete] snapc 0=[] ondisk+write+known_if_redirected e232)", 2024-04-01T19:39:19.871 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:32:00.660792+0000", 2024-04-01T19:39:19.871 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 438.70918779099998, 2024-04-01T19:39:19.871 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.172239949, 2024-04-01T19:39:19.871 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:39:19.871 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:39:19.871 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:19.871 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:39:19.871 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:39:19.871 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:19.871 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 203539 2024-04-01T19:39:19.872 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.872 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:39:19.872 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.872 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:39:19.872 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660792+0000", 2024-04-01T19:39:19.872 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.872 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.872 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.872 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:39:19.872 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660792+0000", 2024-04-01T19:39:19.872 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.872 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.872 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.872 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:39:19.872 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660793+0000", 2024-04-01T19:39:19.873 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0640000000000001e-06 2024-04-01T19:39:19.873 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.873 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.873 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:39:19.873 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660796+0000", 2024-04-01T19:39:19.873 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3349999999999998e-06 2024-04-01T19:39:19.873 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.873 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.873 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:39:19.873 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660804+0000", 2024-04-01T19:39:19.874 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.8569999999999995e-06 2024-04-01T19:39:19.874 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.874 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.874 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:39:19.874 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660809+0000", 2024-04-01T19:39:19.874 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6149999999999999e-06 2024-04-01T19:39:19.874 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.874 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.874 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:39:19.874 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660853+0000", 2024-04-01T19:39:19.874 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4873999999999998e-05 2024-04-01T19:39:19.874 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.874 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.874 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:39:19.875 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660930+0000", 2024-04-01T19:39:19.875 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6279999999999995e-05 2024-04-01T19:39:19.875 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.875 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.875 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:39:19.875 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660999+0000", 2024-04-01T19:39:19.875 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8875999999999996e-05 2024-04-01T19:39:19.875 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.875 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.875 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:39:19.875 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.668640+0000", 2024-04-01T19:39:19.875 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0076412509999999999 2024-04-01T19:39:19.875 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.875 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.876 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:19.876 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.832956+0000", 2024-04-01T19:39:19.876 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.16431617800000001 2024-04-01T19:39:19.876 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.876 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.876 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:39:19.876 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.832988+0000", 2024-04-01T19:39:19.876 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.2069000000000001e-05 2024-04-01T19:39:19.876 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.876 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.876 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:39:19.876 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.833032+0000", 2024-04-01T19:39:19.877 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.3550000000000001e-05 2024-04-01T19:39:19.877 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.877 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:19.877 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.877 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.877 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.877 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:203540 3.b 3:d41f05ce:::benchmark_data_smithi188_92122_object37949:head [delete] snapc 0=[] ondisk+write+known_if_redirected e232)", 2024-04-01T19:39:19.877 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:32:00.660818+0000", 2024-04-01T19:39:19.877 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 438.70916161100001, 2024-04-01T19:39:19.877 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.17715509300000001, 2024-04-01T19:39:19.877 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:39:19.877 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:39:19.877 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:19.877 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:39:19.878 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:39:19.878 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:19.878 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 203540 2024-04-01T19:39:19.878 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.878 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:39:19.878 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.878 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:39:19.878 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660818+0000", 2024-04-01T19:39:19.878 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.878 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.878 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.878 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:39:19.878 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660818+0000", 2024-04-01T19:39:19.879 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.879 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.879 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.879 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:39:19.879 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660818+0000", 2024-04-01T19:39:19.879 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5600000000000001e-07 2024-04-01T19:39:19.879 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.879 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.879 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:39:19.879 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660820+0000", 2024-04-01T19:39:19.879 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8199999999999999e-06 2024-04-01T19:39:19.879 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.879 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.879 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:39:19.880 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660823+0000", 2024-04-01T19:39:19.880 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3189999999999999e-06 2024-04-01T19:39:19.880 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.880 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.880 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:39:19.880 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.660828+0000", 2024-04-01T19:39:19.880 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.69e-06 2024-04-01T19:39:19.880 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.880 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.880 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:39:19.880 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.664362+0000", 2024-04-01T19:39:19.880 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0035334709999999998 2024-04-01T19:39:19.881 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.881 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.881 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:39:19.881 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.664452+0000", 2024-04-01T19:39:19.881 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.0044999999999996e-05 2024-04-01T19:39:19.881 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.881 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.881 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:39:19.881 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.665003+0000", 2024-04-01T19:39:19.881 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00055186500000000002 2024-04-01T19:39:19.881 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.881 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.881 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:39:19.881 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.668751+0000", 2024-04-01T19:39:19.882 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.003747139 2024-04-01T19:39:19.882 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.882 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.882 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:19.882 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.837876+0000", 2024-04-01T19:39:19.882 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.16912496699999999 2024-04-01T19:39:19.882 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.882 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.882 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:39:19.882 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.837928+0000", 2024-04-01T19:39:19.882 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2420000000000003e-05 2024-04-01T19:39:19.882 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.882 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.883 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:39:19.883 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.837973+0000", 2024-04-01T19:39:19.883 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4901000000000003e-05 2024-04-01T19:39:19.883 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.883 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:19.883 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.883 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.883 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.883 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25117.0:203561 3.b 3:d09e1d7a:::benchmark_data_smithi188_92122_object37970:head [delete] snapc 0=[] ondisk+write+known_if_redirected e232)", 2024-04-01T19:39:19.883 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:32:00.682776+0000", 2024-04-01T19:39:19.883 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 438.68720373600001, 2024-04-01T19:39:19.883 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.16111267200000001, 2024-04-01T19:39:19.883 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:39:19.883 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:39:19.883 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:19.884 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:39:19.884 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25117", 2024-04-01T19:39:19.884 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:19.884 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 203561 2024-04-01T19:39:19.884 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.884 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:39:19.884 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.884 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:39:19.884 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.682776+0000", 2024-04-01T19:39:19.884 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.884 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.885 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.885 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:39:19.885 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.682776+0000", 2024-04-01T19:39:19.885 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:39:19.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.885 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.885 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:39:19.885 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.682778+0000", 2024-04-01T19:39:19.885 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5969999999999999e-06 2024-04-01T19:39:19.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.885 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.885 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:39:19.885 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.682786+0000", 2024-04-01T19:39:19.885 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6939999999999995e-06 2024-04-01T19:39:19.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.886 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.886 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:39:19.886 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.682802+0000", 2024-04-01T19:39:19.886 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6206999999999999e-05 2024-04-01T19:39:19.886 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.886 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.886 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:39:19.886 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.682811+0000", 2024-04-01T19:39:19.886 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6430000000000001e-06 2024-04-01T19:39:19.886 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.886 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.886 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:39:19.886 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.682867+0000", 2024-04-01T19:39:19.886 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6388000000000003e-05 2024-04-01T19:39:19.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.887 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.887 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:39:19.887 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.682952+0000", 2024-04-01T19:39:19.887 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4846999999999996e-05 2024-04-01T19:39:19.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.887 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.887 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 0", 2024-04-01T19:39:19.887 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.683023+0000", 2024-04-01T19:39:19.887 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.1422999999999997e-05 2024-04-01T19:39:19.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.887 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.887 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:39:19.887 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.686537+0000", 2024-04-01T19:39:19.888 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0035138809999999999 2024-04-01T19:39:19.888 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.888 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.888 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:19.888 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.843783+0000", 2024-04-01T19:39:19.888 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.157245251 2024-04-01T19:39:19.888 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.888 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.888 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:39:19.888 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.843839+0000", 2024-04-01T19:39:19.888 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5890000000000002e-05 2024-04-01T19:39:19.888 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:39:19.888 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:39:19.888 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:39:19.889 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:32:00.843888+0000", 2024-04-01T19:39:19.889 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9851000000000001e-05 2024-04-01T19:39:19.889 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.889 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:19.889 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.889 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:39:19.889 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:39:19.889 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:39:19.889 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:39:19.920 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:19.941 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:39:19.944 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:19.944 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:39:20.045 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:39:20.078 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:20.100 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:39:20.103 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:20.104 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:39:20.205 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:39:20.232 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:20.251 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:39:20.254 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:20.254 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:39:20.355 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:39:20.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:20 smithi022 ceph-mon[39439]: pgmap v1035: 1 pgs: 1 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:20.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:20 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:39:20.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:20 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:39:20.364 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:20 smithi188 ceph-mon[43939]: pgmap v1035: 1 pgs: 1 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:20.364 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:20 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:39:20.364 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:20 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:39:20.380 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:20 smithi062 ceph-mon[44211]: pgmap v1035: 1 pgs: 1 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:20.381 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:20 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:39:20.381 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:20 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:39:20.383 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:20.401 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:39:20.404 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:20.404 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:39:20.505 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:39:20.538 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:20.775 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:39:20.791 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:39:20.795 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:20.795 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:39:20.815 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_ops_in_flight 2024-04-01T19:39:20.896 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:39:20.926 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:21.089 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:39:21.301 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:21 smithi022 ceph-mon[39439]: osdmap e362: 12 total, 12 up, 11 in 2024-04-01T19:39:21.347 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:21 smithi062 ceph-mon[44211]: osdmap e362: 12 total, 12 up, 11 in 2024-04-01T19:39:21.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:21 smithi188 ceph-mon[43939]: osdmap e362: 12 total, 12 up, 11 in 2024-04-01T19:39:21.676 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:39:21.679 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:21.679 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:39:21.780 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:39:21.812 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:22.013 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:39:22.015 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:22.016 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:39:22.117 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:39:22.145 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:22.317 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:39:22.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:22 smithi022 ceph-mon[39439]: pgmap v1037: 1 pgs: 1 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:22.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:22 smithi188 ceph-mon[43939]: pgmap v1037: 1 pgs: 1 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:22.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:22 smithi062 ceph-mon[44211]: pgmap v1037: 1 pgs: 1 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:22.694 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:39:22.698 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:22.698 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:39:22.799 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:39:22.831 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:23.107 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:39:23.149 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 9, 10, 11, 6] out_osds: [8] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 7, 9, 10, 11, 8, 6] 2024-04-01T19:39:23.149 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 0 1 2024-04-01T19:39:23.199 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:39:23.199 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:39:23.200 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 0 2024-04-01T19:39:23.200 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:39:23.221 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:23 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/839476332' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:39:23.221 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:23 smithi062 ceph-mon[44211]: from='client.25825 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:39:23.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:23 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/839476332' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:39:23.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:23 smithi022 ceph-mon[39439]: from='client.25825 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:39:23.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:23 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/839476332' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:39:23.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:23 smithi188 ceph-mon[43939]: from='client.25825 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:39:23.480 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:39:23.484 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:23.484 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:39:23.585 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:39:23.617 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:23.906 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_blocked_ops 2024-04-01T19:39:23.967 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:39:23.970 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:23.971 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:39:24.005 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:39:24.047 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:39:24.071 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:39:24.101 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'unique_pool_3' created 2024-04-01T19:39:24.225 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:39:24.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:24 smithi062 ceph-mon[44211]: pgmap v1038: 1 pgs: 1 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:24.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:24 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:39:24.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:24 smithi062 ceph-mon[44211]: from='client.25825 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:39:24.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:24 smithi062 ceph-mon[44211]: osdmap e363: 12 total, 12 up, 11 in 2024-04-01T19:39:24.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:24 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1686186112' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]: dispatch 2024-04-01T19:39:24.352 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:39:24.354 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:24 smithi022 ceph-mon[39439]: pgmap v1038: 1 pgs: 1 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:24.354 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:24 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:39:24.354 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:24 smithi022 ceph-mon[39439]: from='client.25825 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:39:24.354 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:24 smithi022 ceph-mon[39439]: osdmap e363: 12 total, 12 up, 11 in 2024-04-01T19:39:24.354 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:24 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1686186112' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]: dispatch 2024-04-01T19:39:24.355 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:24.355 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:39:24.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:24 smithi188 ceph-mon[43939]: pgmap v1038: 1 pgs: 1 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:24.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:24 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:39:24.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:24 smithi188 ceph-mon[43939]: from='client.25825 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:39:24.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:24 smithi188 ceph-mon[43939]: osdmap e363: 12 total, 12 up, 11 in 2024-04-01T19:39:24.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:24 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1686186112' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]: dispatch 2024-04-01T19:39:24.456 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:39:24.489 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:24.509 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:39:24.512 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:24.512 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:39:24.613 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:39:24.643 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:24.993 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:39:24.996 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:24.996 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:39:24.999 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pool application enable unique_pool_3 rados --yes-i-really-mean-it || true 2024-04-01T19:39:25.097 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:39:25.240 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:25 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1686186112' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]': finished 2024-04-01T19:39:25.240 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:25 smithi022 ceph-mon[39439]: osdmap e364: 12 total, 12 up, 11 in 2024-04-01T19:39:25.273 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:25.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:25 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1686186112' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]': finished 2024-04-01T19:39:25.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:25 smithi188 ceph-mon[43939]: osdmap e364: 12 total, 12 up, 11 in 2024-04-01T19:39:25.391 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:25 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1686186112' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]': finished 2024-04-01T19:39:25.391 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:25 smithi062 ceph-mon[44211]: osdmap e364: 12 total, 12 up, 11 in 2024-04-01T19:39:26.045 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:39:26.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:26 smithi022 ceph-mon[39439]: pgmap v1041: 17 pgs: 1 creating+peering, 15 unknown, 1 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:26.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:26 smithi022 ceph-mon[39439]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T19:39:26.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:26 smithi022 ceph-mon[39439]: osdmap e365: 12 total, 12 up, 11 in 2024-04-01T19:39:26.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:26 smithi188 ceph-mon[43939]: pgmap v1041: 17 pgs: 1 creating+peering, 15 unknown, 1 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:26.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:26 smithi188 ceph-mon[43939]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T19:39:26.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:26 smithi188 ceph-mon[43939]: osdmap e365: 12 total, 12 up, 11 in 2024-04-01T19:39:26.380 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:26 smithi062 ceph-mon[44211]: pgmap v1041: 17 pgs: 1 creating+peering, 15 unknown, 1 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:26.380 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:26 smithi062 ceph-mon[44211]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T19:39:26.380 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:26 smithi062 ceph-mon[44211]: osdmap e365: 12 total, 12 up, 11 in 2024-04-01T19:39:26.423 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:39:26.426 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:26.426 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:39:26.527 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:39:26.561 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:26.661 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:39:26.663 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:26.664 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:39:26.677 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:39:26.677 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:39:26.677 INFO:teuthology.orchestra.run.smithi062.stdout: "complaint_time": 30, 2024-04-01T19:39:26.677 INFO:teuthology.orchestra.run.smithi062.stdout: "num_blocked_ops": 0 2024-04-01T19:39:26.677 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:39:26.765 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:39:26.795 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:27.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:27 smithi062 ceph-mon[44211]: osdmap e366: 12 total, 12 up, 11 in 2024-04-01T19:39:27.347 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_historic_ops 2024-04-01T19:39:27.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:27 smithi188 ceph-mon[43939]: osdmap e366: 12 total, 12 up, 11 in 2024-04-01T19:39:27.396 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:27 smithi022 ceph-mon[39439]: osdmap e366: 12 total, 12 up, 11 in 2024-04-01T19:39:27.662 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:39:27.872 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:39:27.872 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:39:27.872 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:39:27.872 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:39:27.891 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:39:27.902 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:39:27.923 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:39:27.931 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:39:27.953 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:39:27.973 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:39:27.993 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:39:28.013 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:39:28.033 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:39:28.054 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:39:28.055 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:39:28.055 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:39:28.055 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:39:28.055 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:39:28.056 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:39:28.056 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:39:28.056 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:39:28.056 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:39:28.056 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:39:28.056 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:39:28.056 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:39:28.125 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.0 to 1 (10000) 2024-04-01T19:39:28.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:28 smithi062 ceph-mon[44211]: pgmap v1044: 17 pgs: 3 creating+peering, 3 unknown, 11 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:28 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1861475228' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:39:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:28 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:28 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:28 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3894091193' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T19:39:28.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:28 smithi022 ceph-mon[39439]: pgmap v1044: 17 pgs: 3 creating+peering, 3 unknown, 11 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:28.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:28 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1861475228' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:39:28.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:28 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:28.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:28 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:28.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:28 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3894091193' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T19:39:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:28 smithi188 ceph-mon[43939]: pgmap v1044: 17 pgs: 3 creating+peering, 3 unknown, 11 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:28 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1861475228' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:39:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:28 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:28 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:28 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3894091193' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T19:39:29.417 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.417 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.417 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.417 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:29 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3894091193' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-04-01T19:39:29.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:29 smithi022 ceph-mon[39439]: osdmap e367: 12 total, 12 up, 11 in 2024-04-01T19:39:29.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:29 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:39:29.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:29 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:39:29.442 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:39:29.442 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:39:29.460 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.460 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.460 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.461 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.461 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.461 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.461 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.461 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.461 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.461 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.461 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:29 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3894091193' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-04-01T19:39:29.461 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:29 smithi062 ceph-mon[44211]: osdmap e367: 12 total, 12 up, 11 in 2024-04-01T19:39:29.461 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:29 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:39:29.461 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:29 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:39:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:29.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:29 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3894091193' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-04-01T19:39:29.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:29 smithi188 ceph-mon[43939]: osdmap e367: 12 total, 12 up, 11 in 2024-04-01T19:39:29.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:29 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:39:29.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:29 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:39:30.047 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:39:30.051 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:30.051 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:39:30.128 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_ops_in_flight 2024-04-01T19:39:30.152 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:39:30.185 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:30.403 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:39:30.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:30 smithi062 ceph-mon[44211]: pgmap v1046: 17 pgs: 3 creating+peering, 14 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:30.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:30 smithi062 ceph-mon[44211]: osdmap e368: 12 total, 12 up, 11 in 2024-04-01T19:39:30.596 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:30 smithi022 ceph-mon[39439]: pgmap v1046: 17 pgs: 3 creating+peering, 14 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:30.596 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:30 smithi022 ceph-mon[39439]: osdmap e368: 12 total, 12 up, 11 in 2024-04-01T19:39:30.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:30 smithi188 ceph-mon[43939]: pgmap v1046: 17 pgs: 3 creating+peering, 14 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:30.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:30 smithi188 ceph-mon[43939]: osdmap e368: 12 total, 12 up, 11 in 2024-04-01T19:39:30.627 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 1 1 2024-04-01T19:39:31.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:31 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:39:31.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:31 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:39:31.402 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:31 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:39:31.402 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:31 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:39:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:31 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:39:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:31 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:39:32.248 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:39:32.248 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:39:32.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:32 smithi062 ceph-mon[44211]: pgmap v1048: 17 pgs: 17 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:32.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:32 smithi062 ceph-mon[44211]: osdmap e369: 12 total, 12 up, 11 in 2024-04-01T19:39:32.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:32 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2063308494' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:39:32.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:32 smithi062 ceph-mon[44211]: from='client.25849 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:39:32.343 INFO:teuthology.orchestra.run.smithi022.stderr:enabled application 'rados' on pool 'unique_pool_3' 2024-04-01T19:39:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:32 smithi022 ceph-mon[39439]: pgmap v1048: 17 pgs: 17 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:32 smithi022 ceph-mon[39439]: osdmap e369: 12 total, 12 up, 11 in 2024-04-01T19:39:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:32 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2063308494' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:39:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:32 smithi022 ceph-mon[39439]: from='client.25849 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:39:32.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:32 smithi188 ceph-mon[43939]: pgmap v1048: 17 pgs: 17 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:32.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:32 smithi188 ceph-mon[43939]: osdmap e369: 12 total, 12 up, 11 in 2024-04-01T19:39:32.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:32 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2063308494' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:39:32.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:32 smithi188 ceph-mon[43939]: from='client.25849 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:39:32.636 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:39:32.639 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:32.640 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:39:32.741 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:39:32.773 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:32.874 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:39:32.877 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:32.877 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:39:32.901 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_blocked_ops 2024-04-01T19:39:32.978 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:39:33.008 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:33.060 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:39:33.076 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:33.076 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:39:33.151 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:39:33.177 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:39:33.182 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:39:33.206 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:33.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:33 smithi022 ceph-mon[39439]: from='client.25849 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:39:33.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:33 smithi022 ceph-mon[39439]: osdmap e370: 12 total, 12 up, 11 in 2024-04-01T19:39:33.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:33 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:39:33.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:33 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:39:33.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:33 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:39:33.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:33 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3990723669' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:39:33.430 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:33 smithi062 ceph-mon[44211]: from='client.25849 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:39:33.430 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:33 smithi062 ceph-mon[44211]: osdmap e370: 12 total, 12 up, 11 in 2024-04-01T19:39:33.430 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:33 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:39:33.430 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:33 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:39:33.430 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:33 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:39:33.430 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:33 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3990723669' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:39:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:33 smithi188 ceph-mon[43939]: from='client.25849 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:39:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:33 smithi188 ceph-mon[43939]: osdmap e370: 12 total, 12 up, 11 in 2024-04-01T19:39:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:33 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:39:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:33 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:39:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:33 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:39:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:33 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3990723669' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:39:33.821 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:39:34.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:34 smithi062 ceph-mon[44211]: pgmap v1051: 17 pgs: 17 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:34.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:34 smithi062 ceph-mon[44211]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T19:39:34.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:34 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:39:34.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:34 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3990723669' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:39:34.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:34 smithi062 ceph-mon[44211]: osdmap e371: 12 total, 12 up, 11 in 2024-04-01T19:39:34.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:34 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:39:34.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:34 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:39:34.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:34 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:39:34.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:34 smithi022 ceph-mon[39439]: pgmap v1051: 17 pgs: 17 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:34.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:34 smithi022 ceph-mon[39439]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T19:39:34.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:34 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:39:34.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:34 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3990723669' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:39:34.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:34 smithi022 ceph-mon[39439]: osdmap e371: 12 total, 12 up, 11 in 2024-04-01T19:39:34.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:34 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:39:34.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:34 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:39:34.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:34 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:39:34.525 DEBUG:teuthology.orchestra.run.smithi188:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.2 -b 65536 --object-size 65536 -p unique_pool_3 bench 90 write' 2024-04-01T19:39:34.528 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-04-01T19:39:34.528 INFO:teuthology.orchestra.run:waiting for 3000 2024-04-01T19:39:34.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:34 smithi188 ceph-mon[43939]: pgmap v1051: 17 pgs: 17 active+clean; 577 KiB data, 3.0 GiB used, 980 GiB / 983 GiB avail 2024-04-01T19:39:34.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:34 smithi188 ceph-mon[43939]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T19:39:34.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:34 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:39:34.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:34 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3990723669' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:39:34.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:34 smithi188 ceph-mon[43939]: osdmap e371: 12 total, 12 up, 11 in 2024-04-01T19:39:34.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:34 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:39:34.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:34 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:39:34.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:34 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:39:34.625 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:hints = 1 2024-04-01T19:39:34.625 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-04-01T19:39:34.625 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Object prefix: benchmark_data_smithi188_119427 2024-04-01T19:39:34.625 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:39:34.625 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 0 0 0 0 0 0 - 0 2024-04-01T19:39:34.890 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:39:35.001 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:39:35.001 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:39:35.565 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:39:35.572 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:35.573 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:39:35.596 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:39:35.625 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 1 16 5731 5715 357.169 357.188 0.00254353 0.00279496 2024-04-01T19:39:35.675 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:39:35.717 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:35.748 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:39:35.754 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:35.754 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:39:35.760 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_historic_ops 2024-04-01T19:39:35.855 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:39:35.910 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:35.944 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:39:35.948 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:35.948 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:39:36.049 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:39:36.086 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:36.114 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:39:36.115 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:36.116 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:39:36.192 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:39:36.216 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:39:36.261 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:36.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:36 smithi022 ceph-mon[39439]: pgmap v1053: 17 pgs: 17 active+clean; 3.8 MiB data, 3.0 GiB used, 980 GiB / 983 GiB avail; 560 KiB/s wr, 8 op/s 2024-04-01T19:39:36.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:36 smithi022 ceph-mon[39439]: osdmap e372: 12 total, 12 up, 11 in 2024-04-01T19:39:36.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:36 smithi188 ceph-mon[43939]: pgmap v1053: 17 pgs: 17 active+clean; 3.8 MiB data, 3.0 GiB used, 980 GiB / 983 GiB avail; 560 KiB/s wr, 8 op/s 2024-04-01T19:39:36.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:36 smithi188 ceph-mon[43939]: osdmap e372: 12 total, 12 up, 11 in 2024-04-01T19:39:36.499 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:36 smithi062 ceph-mon[44211]: pgmap v1053: 17 pgs: 17 active+clean; 3.8 MiB data, 3.0 GiB used, 980 GiB / 983 GiB avail; 560 KiB/s wr, 8 op/s 2024-04-01T19:39:36.500 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:36 smithi062 ceph-mon[44211]: osdmap e372: 12 total, 12 up, 11 in 2024-04-01T19:39:36.516 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:39:36.520 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:36.520 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:39:36.621 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:39:36.625 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 2 15 10795 10780 336.849 316.562 0.0042436 0.00296318 2024-04-01T19:39:36.672 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:36.735 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:39:37.081 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.1 to 1 (10000) 2024-04-01T19:39:37.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:37 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2850852627' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T19:39:37.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:37 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2850852627' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T19:39:37.439 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:39:37.443 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:37.443 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:39:37.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:37 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2850852627' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T19:39:37.544 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:39:37.598 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:37.625 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 3 16 15376 15360 319.975 286.25 0.00518919 0.00312163 2024-04-01T19:39:37.626 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:39:37.629 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:37.629 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:39:37.730 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:39:37.775 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:37.804 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:39:37.820 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:37.820 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:39:37.921 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:39:37.958 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:38.087 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:38 smithi022 ceph-mon[39439]: pgmap v1055: 17 pgs: 17 active+clean; 306 MiB data, 3.4 GiB used, 980 GiB / 983 GiB avail; 52 MiB/s wr, 839 op/s 2024-04-01T19:39:38.087 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:38 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2850852627' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-04-01T19:39:38.087 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:38 smithi022 ceph-mon[39439]: osdmap e373: 12 total, 12 up, 11 in 2024-04-01T19:39:38.137 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:39:38.145 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:38.146 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:39:38.181 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 2 1 2024-04-01T19:39:38.247 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:39:38.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:38 smithi062 ceph-mon[44211]: pgmap v1055: 17 pgs: 17 active+clean; 306 MiB data, 3.4 GiB used, 980 GiB / 983 GiB avail; 52 MiB/s wr, 839 op/s 2024-04-01T19:39:38.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:38 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2850852627' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-04-01T19:39:38.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:38 smithi062 ceph-mon[44211]: osdmap e373: 12 total, 12 up, 11 in 2024-04-01T19:39:38.274 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:39:38.274 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:39:38.289 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:38.317 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:39:38.323 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:38.323 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:39:38.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:38 smithi188 ceph-mon[43939]: pgmap v1055: 17 pgs: 17 active+clean; 306 MiB data, 3.4 GiB used, 980 GiB / 983 GiB avail; 52 MiB/s wr, 839 op/s 2024-04-01T19:39:38.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:38 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2850852627' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-04-01T19:39:38.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:38 smithi188 ceph-mon[43939]: osdmap e373: 12 total, 12 up, 11 in 2024-04-01T19:39:38.424 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:39:38.461 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:38.506 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:39:38.509 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:38.509 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:39:38.610 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:39:38.626 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 4 16 19598 19582 305.916 263.875 0.00526707 0.00326638 2024-04-01T19:39:38.664 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:38.696 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:39:38.707 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:38.708 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:39:38.708 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:39:38.806 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:39:38.809 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:39:38.843 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:38.855 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:39:38.868 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:39:38.871 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:38.871 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:39:38.892 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:39:38.930 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:39:38.967 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:39:38.972 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:39:39.004 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:39:39.009 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:39.034 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:39:39.038 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:39.039 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:39:39.044 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:39:39.061 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_ops_in_flight 2024-04-01T19:39:39.083 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:39:39.095 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:39 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/248550325' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:39:39.096 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:39.119 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:39:39.139 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:39:39.152 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:39:39.173 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:39.181 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:39:39.199 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:39:39.202 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:39.203 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:39:39.214 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:39:39.220 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:39:39.220 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:39:39.220 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:39:39.220 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:39:39.220 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:39:39.220 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:39:39.221 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:39:39.221 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:39:39.221 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:39:39.221 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:39:39.221 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:39:39.221 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:39:39.304 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:39:39.348 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:39 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/248550325' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:39:39.348 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:39.354 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:39.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:39 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/248550325' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:39:39.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:39.382 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:39:39.386 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:39.386 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:39:39.466 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:39:39.487 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:39:39.513 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:39.531 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:39:39.533 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:39.534 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:39:39.626 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 5 16 22746 22730 284.077 196.75 0.00191501 0.00339384 2024-04-01T19:39:39.634 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:39:39.670 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:39.696 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:39:39.699 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:39.700 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:39:39.801 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:39:39.840 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:39.866 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:39:39.869 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:39.870 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:39:39.971 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:39:40.022 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:40.062 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:39:40.078 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:40.078 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:39:40.179 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:39:40.228 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:40.256 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:39:40.259 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:40.259 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:39:40.360 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:39:40.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:40 smithi022 ceph-mon[39439]: pgmap v1057: 17 pgs: 17 active+clean; 480 MiB data, 3.6 GiB used, 980 GiB / 983 GiB avail; 80 MiB/s wr, 1.28k op/s 2024-04-01T19:39:40.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:40 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:39:40.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:40 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:39:40.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:40 smithi022 ceph-mon[39439]: osdmap e374: 12 total, 12 up, 11 in 2024-04-01T19:39:40.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:40 smithi188 ceph-mon[43939]: pgmap v1057: 17 pgs: 17 active+clean; 480 MiB data, 3.6 GiB used, 980 GiB / 983 GiB avail; 80 MiB/s wr, 1.28k op/s 2024-04-01T19:39:40.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:40 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:39:40.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:40 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:39:40.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:40 smithi188 ceph-mon[43939]: osdmap e374: 12 total, 12 up, 11 in 2024-04-01T19:39:40.394 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:40.419 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:39:40.423 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:40.423 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:39:40.448 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.448 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.448 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:40 smithi062 ceph-mon[44211]: pgmap v1057: 17 pgs: 17 active+clean; 480 MiB data, 3.6 GiB used, 980 GiB / 983 GiB avail; 80 MiB/s wr, 1.28k op/s 2024-04-01T19:39:40.448 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.448 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.448 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.448 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.448 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.448 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.448 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.449 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:40.449 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:40 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:39:40.449 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:40 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:39:40.449 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:40 smithi062 ceph-mon[44211]: osdmap e374: 12 total, 12 up, 11 in 2024-04-01T19:39:40.524 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:39:40.562 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:40.626 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 6 16 26603 26587 276.905 241.062 0.00345897 0.00360949 2024-04-01T19:39:40.978 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:39:41.124 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:39:41.127 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:41.128 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:39:41.229 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:39:41.266 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:41.311 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:39:41.319 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:41.320 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:39:41.420 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:39:41.454 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:41.479 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:39:41.482 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:41.483 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:39:41.584 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:39:41.618 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:41.626 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 7 15 30258 30243 269.988 228.5 0.00311741 0.00370174 2024-04-01T19:39:41.644 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:39:41.648 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:41.649 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:39:41.750 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:39:41.792 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:39:41.792 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:39:41.792 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 0 2024-04-01T19:39:41.792 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:39:41.811 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:42.025 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:39:42.034 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:42.035 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:39:42.136 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:39:42.189 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:42.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:42 smithi188 ceph-mon[43939]: pgmap v1059: 17 pgs: 17 active+clean; 1.1 GiB data, 5.2 GiB used, 978 GiB / 983 GiB avail; 189 MiB/s wr, 3.03k op/s 2024-04-01T19:39:42.491 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:39:42.500 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:42 smithi062 ceph-mon[44211]: pgmap v1059: 17 pgs: 17 active+clean; 1.1 GiB data, 5.2 GiB used, 978 GiB / 983 GiB avail; 189 MiB/s wr, 3.03k op/s 2024-04-01T19:39:42.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:42 smithi022 ceph-mon[39439]: pgmap v1059: 17 pgs: 17 active+clean; 1.1 GiB data, 5.2 GiB used, 978 GiB / 983 GiB avail; 189 MiB/s wr, 3.03k op/s 2024-04-01T19:39:42.544 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_blocked_ops 2024-04-01T19:39:42.554 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:39:42.559 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:42.559 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:39:42.626 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 8 16 33571 33555 262.112 207 0.00282248 0.00381319 2024-04-01T19:39:42.661 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:39:42.700 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:42.742 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:39:42.747 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:42.747 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:39:42.848 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:39:42.882 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:42.909 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:39:42.911 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:42.912 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:39:42.940 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:39:43.013 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:39:43.057 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:43.142 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:39:43.218 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:39:43.220 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:43.220 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:39:43.321 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:39:43.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:43 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1598440959' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:39:43.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:43 smithi022 ceph-mon[39439]: from='client.35981 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:39:43.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:43 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1598440959' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:39:43.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:43 smithi188 ceph-mon[43939]: from='client.35981 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:39:43.378 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:43.408 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:39:43.414 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:43.414 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:39:43.471 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:43 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1598440959' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:39:43.472 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:43 smithi062 ceph-mon[44211]: from='client.35981 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:39:43.515 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:39:43.548 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:43.571 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:39:43.573 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:43.574 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:39:43.626 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 9 16 36493 36477 253.28 182.625 0.00514238 0.00394606 2024-04-01T19:39:43.675 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:39:43.726 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:44.136 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:44 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T19:39:44.137 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:44 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T19:39:44.137 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:44 smithi062 ceph-mon[44211]: pgmap v1060: 17 pgs: 17 active+clean; 1.6 GiB data, 6.1 GiB used, 977 GiB / 983 GiB avail; 210 MiB/s wr, 3.37k op/s 2024-04-01T19:39:44.137 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:44 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:39:44.137 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:44 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:39:44.137 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:44 smithi062 ceph-mon[44211]: from='client.35981 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:39:44.137 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:44 smithi062 ceph-mon[44211]: osdmap e375: 12 total, 12 up, 11 in 2024-04-01T19:39:44.137 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:44 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3117596379' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:39:44.137 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:44 smithi062 ceph-mon[44211]: from='client.25879 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:39:44.147 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.2 to 1 (10000) 2024-04-01T19:39:44.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:44 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T19:39:44.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:44 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T19:39:44.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:44 smithi022 ceph-mon[39439]: pgmap v1060: 17 pgs: 17 active+clean; 1.6 GiB data, 6.1 GiB used, 977 GiB / 983 GiB avail; 210 MiB/s wr, 3.37k op/s 2024-04-01T19:39:44.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:44 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:39:44.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:44 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:39:44.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:44 smithi022 ceph-mon[39439]: from='client.35981 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:39:44.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:44 smithi022 ceph-mon[39439]: osdmap e375: 12 total, 12 up, 11 in 2024-04-01T19:39:44.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:44 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3117596379' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:39:44.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:44 smithi022 ceph-mon[39439]: from='client.25879 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:39:44.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:44 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T19:39:44.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:44 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T19:39:44.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:44 smithi188 ceph-mon[43939]: pgmap v1060: 17 pgs: 17 active+clean; 1.6 GiB data, 6.1 GiB used, 977 GiB / 983 GiB avail; 210 MiB/s wr, 3.37k op/s 2024-04-01T19:39:44.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:44 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:39:44.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:44 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:39:44.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:44 smithi188 ceph-mon[43939]: from='client.35981 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:39:44.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:44 smithi188 ceph-mon[43939]: osdmap e375: 12 total, 12 up, 11 in 2024-04-01T19:39:44.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:44 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3117596379' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:39:44.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:44 smithi188 ceph-mon[43939]: from='client.25879 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:39:44.626 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 10 16 39312 39296 245.569 176.188 0.00252658 0.00407056 2024-04-01T19:39:44.937 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:39:44.937 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:39:44.937 INFO:teuthology.orchestra.run.smithi062.stdout: "complaint_time": 30, 2024-04-01T19:39:44.937 INFO:teuthology.orchestra.run.smithi062.stdout: "num_blocked_ops": 0 2024-04-01T19:39:44.937 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:39:45.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:45 smithi062 ceph-mon[44211]: from='client.25879 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-04-01T19:39:45.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:45 smithi062 ceph-mon[44211]: osdmap e376: 12 total, 12 up, 11 in 2024-04-01T19:39:45.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:45 smithi062 ceph-mon[44211]: osdmap e377: 12 total, 12 up, 11 in 2024-04-01T19:39:45.306 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:39:45.312 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:45.313 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:39:45.413 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:39:45.459 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:45 smithi022 ceph-mon[39439]: from='client.25879 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-04-01T19:39:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:45 smithi022 ceph-mon[39439]: osdmap e376: 12 total, 12 up, 11 in 2024-04-01T19:39:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:45 smithi022 ceph-mon[39439]: osdmap e377: 12 total, 12 up, 11 in 2024-04-01T19:39:45.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:45 smithi188 ceph-mon[43939]: from='client.25879 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-04-01T19:39:45.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:45 smithi188 ceph-mon[43939]: osdmap e376: 12 total, 12 up, 11 in 2024-04-01T19:39:45.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:45 smithi188 ceph-mon[43939]: osdmap e377: 12 total, 12 up, 11 in 2024-04-01T19:39:45.626 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 11 16 42341 42325 240.454 189.312 0.00437632 0.00415731 2024-04-01T19:39:45.666 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:39:45.671 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:45.671 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:39:45.711 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_historic_ops 2024-04-01T19:39:45.772 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:39:45.851 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:45.880 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:39:45.884 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:45.884 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:39:45.985 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:39:46.019 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:46.048 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:39:46.052 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:46.053 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:39:46.153 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:39:46.153 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:39:46.200 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:46.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:46 smithi188 ceph-mon[43939]: pgmap v1063: 17 pgs: 17 active+clean; 1.8 GiB data, 6.4 GiB used, 977 GiB / 983 GiB avail; 222 MiB/s wr, 3.55k op/s 2024-04-01T19:39:46.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:46 smithi062 ceph-mon[44211]: pgmap v1063: 17 pgs: 17 active+clean; 1.8 GiB data, 6.4 GiB used, 977 GiB / 983 GiB avail; 222 MiB/s wr, 3.55k op/s 2024-04-01T19:39:46.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:46 smithi022 ceph-mon[39439]: pgmap v1063: 17 pgs: 17 active+clean; 1.8 GiB data, 6.4 GiB used, 977 GiB / 983 GiB avail; 222 MiB/s wr, 3.55k op/s 2024-04-01T19:39:46.626 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 12 16 45337 45321 236.019 187.25 0.00581708 0.00423523 2024-04-01T19:39:47.321 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:39:47.626 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 13 16 47963 47947 230.488 164.125 0.00394906 0.00433684 2024-04-01T19:39:47.792 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:39:48.013 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:39:48.020 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:48.020 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:39:48.121 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:39:48.149 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:48.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:48 smithi062 ceph-mon[44211]: pgmap v1065: 17 pgs: 17 active+clean; 2.5 GiB data, 7.9 GiB used, 975 GiB / 983 GiB avail; 235 MiB/s wr, 3.76k op/s 2024-04-01T19:39:48.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:48 smithi022 ceph-mon[39439]: pgmap v1065: 17 pgs: 17 active+clean; 2.5 GiB data, 7.9 GiB used, 975 GiB / 983 GiB avail; 235 MiB/s wr, 3.76k op/s 2024-04-01T19:39:48.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:48 smithi188 ceph-mon[43939]: pgmap v1065: 17 pgs: 17 active+clean; 2.5 GiB data, 7.9 GiB used, 975 GiB / 983 GiB avail; 235 MiB/s wr, 3.76k op/s 2024-04-01T19:39:48.626 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 14 16 50597 50581 225.783 164.625 0.00444037 0.00442741 2024-04-01T19:39:49.047 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:39:49.047 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 20, 2024-04-01T19:39:49.047 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 600, 2024-04-01T19:39:49.048 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:39:49.048 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.048 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:111576 3.9 3:90e22c59:::benchmark_data_smithi188_92122_object111575:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e211)", 2024-04-01T19:39:49.048 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:30:48.610162+0000", 2024-04-01T19:39:49.048 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 540.43511193400002, 2024-04-01T19:39:49.048 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.058928480999999998, 2024-04-01T19:39:49.048 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:39:49.048 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:39:49.048 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:49.048 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:39:49.048 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:39:49.048 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:49.048 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 111576 2024-04-01T19:39:49.048 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.049 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:39:49.049 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.049 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:39:49.049 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.610162+0000", 2024-04-01T19:39:49.049 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.049 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.049 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.049 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:39:49.049 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.610162+0000", 2024-04-01T19:39:49.049 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.049 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.049 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.049 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:39:49.049 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.610163+0000", 2024-04-01T19:39:49.049 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.6000000000000002e-07 2024-04-01T19:39:49.050 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.050 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.050 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:39:49.050 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.610281+0000", 2024-04-01T19:39:49.050 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000118713 2024-04-01T19:39:49.050 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.050 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.050 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:39:49.050 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.610289+0000", 2024-04-01T19:39:49.050 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.7840000000000004e-06 2024-04-01T19:39:49.050 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.050 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.050 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:39:49.053 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.610296+0000", 2024-04-01T19:39:49.053 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.4999999999999996e-06 2024-04-01T19:39:49.053 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.053 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.053 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:39:49.053 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.614386+0000", 2024-04-01T19:39:49.053 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0040905630000000002 2024-04-01T19:39:49.053 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.054 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.054 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:39:49.054 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.614511+0000", 2024-04-01T19:39:49.054 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012448599999999999 2024-04-01T19:39:49.054 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.054 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.054 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8,11", 2024-04-01T19:39:49.054 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.614616+0000", 2024-04-01T19:39:49.054 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00010497600000000001 2024-04-01T19:39:49.054 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.054 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.054 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:39:49.054 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.618897+0000", 2024-04-01T19:39:49.054 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0042812479999999997 2024-04-01T19:39:49.055 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.055 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.055 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:49.055 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.618924+0000", 2024-04-01T19:39:49.055 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.7124e-05 2024-04-01T19:39:49.055 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.055 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.055 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:49.055 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.668854+0000", 2024-04-01T19:39:49.055 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.049930337999999998 2024-04-01T19:39:49.055 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.055 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.055 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:39:49.055 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.668895+0000", 2024-04-01T19:39:49.055 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0813999999999999e-05 2024-04-01T19:39:49.056 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.056 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.056 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:39:49.056 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.669090+0000", 2024-04-01T19:39:49.056 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00019507500000000001 2024-04-01T19:39:49.056 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.056 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:39:49.056 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.056 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.056 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.056 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:111589 3.9 3:9269ca68:::benchmark_data_smithi188_92122_object111588:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e211)", 2024-04-01T19:39:49.056 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:30:48.619133+0000", 2024-04-01T19:39:49.056 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 540.42614048600001, 2024-04-01T19:39:49.056 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.050211113000000002, 2024-04-01T19:39:49.057 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:39:49.057 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:39:49.057 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:49.057 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:39:49.057 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:39:49.057 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:49.057 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 111589 2024-04-01T19:39:49.057 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.057 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:39:49.057 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.057 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:39:49.057 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.619133+0000", 2024-04-01T19:39:49.057 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.057 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.057 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.058 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:39:49.058 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.619133+0000", 2024-04-01T19:39:49.058 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.058 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.058 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.058 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:39:49.058 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.619135+0000", 2024-04-01T19:39:49.058 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1629999999999999e-06 2024-04-01T19:39:49.058 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.058 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.058 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:39:49.058 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.619189+0000", 2024-04-01T19:39:49.058 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3499999999999999e-05 2024-04-01T19:39:49.058 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.058 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.059 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:39:49.059 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.619201+0000", 2024-04-01T19:39:49.059 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2568999999999999e-05 2024-04-01T19:39:49.059 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.059 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.059 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:39:49.059 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.619209+0000", 2024-04-01T19:39:49.059 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0709999999999995e-06 2024-04-01T19:39:49.059 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.059 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.059 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:39:49.059 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.619246+0000", 2024-04-01T19:39:49.059 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.6758000000000003e-05 2024-04-01T19:39:49.059 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.059 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.059 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:39:49.060 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.619338+0000", 2024-04-01T19:39:49.060 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1648000000000001e-05 2024-04-01T19:39:49.060 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.060 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.060 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8,11", 2024-04-01T19:39:49.060 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.619443+0000", 2024-04-01T19:39:49.060 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000104986 2024-04-01T19:39:49.060 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.060 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.060 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:39:49.060 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.622686+0000", 2024-04-01T19:39:49.060 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0032434540000000002 2024-04-01T19:39:49.060 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.060 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.060 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:49.061 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.623900+0000", 2024-04-01T19:39:49.061 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.001213607 2024-04-01T19:39:49.061 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.061 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.061 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:49.061 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.669130+0000", 2024-04-01T19:39:49.061 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.045230489999999998 2024-04-01T19:39:49.061 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.061 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.061 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:39:49.061 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.669166+0000", 2024-04-01T19:39:49.061 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.5599000000000003e-05 2024-04-01T19:39:49.061 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.061 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.062 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:39:49.062 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.669344+0000", 2024-04-01T19:39:49.062 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00017826800000000001 2024-04-01T19:39:49.062 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.062 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:39:49.062 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.062 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.062 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.062 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:111598 3.f 3:f732535b:::benchmark_data_smithi188_92122_object111597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e211)", 2024-04-01T19:39:49.062 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:30:48.623615+0000", 2024-04-01T19:39:49.062 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 540.42165825400002, 2024-04-01T19:39:49.062 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.053557410999999999, 2024-04-01T19:39:49.062 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:39:49.062 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:39:49.062 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:49.063 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:39:49.063 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:39:49.063 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:49.063 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 111598 2024-04-01T19:39:49.063 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.063 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:39:49.063 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.063 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:39:49.063 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.623615+0000", 2024-04-01T19:39:49.063 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.063 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.063 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.063 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:39:49.063 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.623615+0000", 2024-04-01T19:39:49.063 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.064 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.064 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.064 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:39:49.064 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.623618+0000", 2024-04-01T19:39:49.064 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.5749999999999999e-06 2024-04-01T19:39:49.064 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.064 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.064 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:39:49.064 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.623658+0000", 2024-04-01T19:39:49.064 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9703000000000003e-05 2024-04-01T19:39:49.064 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.064 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.064 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:39:49.064 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.623670+0000", 2024-04-01T19:39:49.064 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2408999999999999e-05 2024-04-01T19:39:49.065 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.065 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.065 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:39:49.065 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.623680+0000", 2024-04-01T19:39:49.065 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.4089999999999992e-06 2024-04-01T19:39:49.065 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.065 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.065 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:39:49.065 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.623736+0000", 2024-04-01T19:39:49.065 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6824999999999999e-05 2024-04-01T19:39:49.065 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.065 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.065 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:39:49.065 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.623870+0000", 2024-04-01T19:39:49.065 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000133604 2024-04-01T19:39:49.065 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.066 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.066 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T19:39:49.066 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.623959+0000", 2024-04-01T19:39:49.066 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.8737000000000001e-05 2024-04-01T19:39:49.066 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.066 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.066 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:39:49.066 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.626693+0000", 2024-04-01T19:39:49.066 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0027341610000000001 2024-04-01T19:39:49.066 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.066 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.066 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:49.066 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.677059+0000", 2024-04-01T19:39:49.066 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.050366485000000003 2024-04-01T19:39:49.066 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.067 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.067 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:39:49.067 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.677125+0000", 2024-04-01T19:39:49.067 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6057999999999997e-05 2024-04-01T19:39:49.067 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.067 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.067 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:39:49.067 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.677173+0000", 2024-04-01T19:39:49.067 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7444999999999997e-05 2024-04-01T19:39:49.067 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.067 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:39:49.067 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.067 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.067 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.068 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:112041 3.9 3:98a28997:::benchmark_data_smithi188_92122_object112040:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e211)", 2024-04-01T19:39:49.068 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:30:48.940118+0000", 2024-04-01T19:39:49.068 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 540.10515526699999, 2024-04-01T19:39:49.068 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.050635123999999997, 2024-04-01T19:39:49.068 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:39:49.068 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:39:49.068 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:49.068 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:39:49.068 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:39:49.068 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:49.068 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 112041 2024-04-01T19:39:49.068 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.068 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:39:49.068 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.068 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:39:49.069 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.940118+0000", 2024-04-01T19:39:49.069 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.069 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.069 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.069 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:39:49.069 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.940118+0000", 2024-04-01T19:39:49.069 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.069 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.069 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.069 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:39:49.069 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.940120+0000", 2024-04-01T19:39:49.069 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.841e-06 2024-04-01T19:39:49.069 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.069 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.069 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:39:49.070 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.940206+0000", 2024-04-01T19:39:49.070 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.5953999999999997e-05 2024-04-01T19:39:49.070 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.070 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.070 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:39:49.070 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.940221+0000", 2024-04-01T19:39:49.070 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4579000000000001e-05 2024-04-01T19:39:49.070 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.070 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.070 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:39:49.070 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.940230+0000", 2024-04-01T19:39:49.070 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.9400000000000008e-06 2024-04-01T19:39:49.070 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.071 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.071 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:39:49.071 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.940289+0000", 2024-04-01T19:39:49.071 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.9043999999999999e-05 2024-04-01T19:39:49.071 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.071 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.071 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:39:49.071 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.940444+0000", 2024-04-01T19:39:49.071 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00015518800000000001 2024-04-01T19:39:49.071 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.071 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.071 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8,11", 2024-04-01T19:39:49.071 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.940620+0000", 2024-04-01T19:39:49.071 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00017629899999999999 2024-04-01T19:39:49.071 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.071 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.072 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:49.072 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.946349+0000", 2024-04-01T19:39:49.072 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0057284939999999998 2024-04-01T19:39:49.072 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.072 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.072 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:39:49.072 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.946369+0000", 2024-04-01T19:39:49.072 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.9870000000000001e-05 2024-04-01T19:39:49.072 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.072 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.072 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:49.072 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.990496+0000", 2024-04-01T19:39:49.072 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.044127878000000002 2024-04-01T19:39:49.072 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.072 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.073 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:39:49.073 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.990540+0000", 2024-04-01T19:39:49.073 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3228e-05 2024-04-01T19:39:49.073 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.073 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.073 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:39:49.073 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.990754+0000", 2024-04-01T19:39:49.073 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000213809 2024-04-01T19:39:49.073 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.073 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:39:49.073 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.073 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.073 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.073 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:112043 3.f 3:f3fea994:::benchmark_data_smithi188_92122_object112042:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e211)", 2024-04-01T19:39:49.073 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:30:48.942376+0000", 2024-04-01T19:39:49.073 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 540.10289725999996, 2024-04-01T19:39:49.074 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.048110685, 2024-04-01T19:39:49.074 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:39:49.074 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:39:49.074 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:49.074 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:39:49.074 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:39:49.074 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:49.074 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 112043 2024-04-01T19:39:49.074 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.074 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:39:49.074 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.074 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:39:49.074 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.942376+0000", 2024-04-01T19:39:49.074 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.074 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.075 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.075 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:39:49.075 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.942376+0000", 2024-04-01T19:39:49.075 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.075 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.075 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.075 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:39:49.075 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.942378+0000", 2024-04-01T19:39:49.075 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.9309999999999998e-06 2024-04-01T19:39:49.075 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.075 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.075 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:39:49.075 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.942427+0000", 2024-04-01T19:39:49.075 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9081e-05 2024-04-01T19:39:49.076 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.076 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.076 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:39:49.076 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.942439+0000", 2024-04-01T19:39:49.076 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1826e-05 2024-04-01T19:39:49.076 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.076 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.076 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:39:49.076 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.942447+0000", 2024-04-01T19:39:49.076 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.5170000000000002e-06 2024-04-01T19:39:49.076 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.076 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.076 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:39:49.076 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.942495+0000", 2024-04-01T19:39:49.076 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7941000000000001e-05 2024-04-01T19:39:49.077 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.077 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.077 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:39:49.077 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.942631+0000", 2024-04-01T19:39:49.077 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000136317 2024-04-01T19:39:49.077 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.077 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.077 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T19:39:49.077 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.942789+0000", 2024-04-01T19:39:49.077 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000158374 2024-04-01T19:39:49.077 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.077 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.077 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:39:49.077 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.946059+0000", 2024-04-01T19:39:49.077 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0032700709999999998 2024-04-01T19:39:49.078 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.078 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.078 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:49.078 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.990372+0000", 2024-04-01T19:39:49.078 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.044312374000000002 2024-04-01T19:39:49.078 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.078 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.078 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:39:49.078 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.990435+0000", 2024-04-01T19:39:49.078 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3397000000000003e-05 2024-04-01T19:39:49.078 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.078 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.078 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:39:49.078 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.990487+0000", 2024-04-01T19:39:49.079 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1856e-05 2024-04-01T19:39:49.079 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.079 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:39:49.079 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.079 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.079 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.079 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:112051 3.f 3:f41e5a84:::benchmark_data_smithi188_92122_object112050:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e211)", 2024-04-01T19:39:49.079 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:30:48.948909+0000", 2024-04-01T19:39:49.079 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 540.096364935, 2024-04-01T19:39:49.079 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.048102574000000002, 2024-04-01T19:39:49.079 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:39:49.079 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:39:49.079 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:49.079 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:39:49.079 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:39:49.079 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:49.080 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 112051 2024-04-01T19:39:49.080 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.080 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:39:49.080 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.080 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:39:49.080 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.948909+0000", 2024-04-01T19:39:49.080 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.080 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.080 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.080 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:39:49.080 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.948909+0000", 2024-04-01T19:39:49.080 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.080 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.080 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.080 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:39:49.081 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.948911+0000", 2024-04-01T19:39:49.081 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3910000000000001e-06 2024-04-01T19:39:49.081 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.081 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.081 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:39:49.081 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.948954+0000", 2024-04-01T19:39:49.081 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3201000000000002e-05 2024-04-01T19:39:49.081 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.081 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.081 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:39:49.081 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.948965+0000", 2024-04-01T19:39:49.081 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0412e-05 2024-04-01T19:39:49.081 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.081 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.081 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:39:49.082 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.948973+0000", 2024-04-01T19:39:49.082 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.456e-06 2024-04-01T19:39:49.082 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.082 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.082 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:39:49.082 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.949024+0000", 2024-04-01T19:39:49.082 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1279000000000002e-05 2024-04-01T19:39:49.082 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.082 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.082 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:39:49.082 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.949152+0000", 2024-04-01T19:39:49.082 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012785199999999999 2024-04-01T19:39:49.082 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.083 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.083 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T19:39:49.083 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.949295+0000", 2024-04-01T19:39:49.083 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014224800000000001 2024-04-01T19:39:49.083 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.083 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.083 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:39:49.083 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.952480+0000", 2024-04-01T19:39:49.083 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0031854510000000002 2024-04-01T19:39:49.083 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.083 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.083 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:49.083 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.996903+0000", 2024-04-01T19:39:49.083 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.044423074999999999 2024-04-01T19:39:49.083 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.084 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.084 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:39:49.084 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.996967+0000", 2024-04-01T19:39:49.084 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3827999999999999e-05 2024-04-01T19:39:49.084 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.084 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.084 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:39:49.084 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:30:48.997011+0000", 2024-04-01T19:39:49.084 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.4381000000000001e-05 2024-04-01T19:39:49.084 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.084 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:39:49.084 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.084 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.084 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.084 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:176971 3.f 3:f912767f:::benchmark_data_smithi188_92122_object11380:head [delete] snapc 0=[] ondisk+write+known_if_redirected e228)", 2024-04-01T19:39:49.084 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:31:39.705365+0000", 2024-04-01T19:39:49.085 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 489.33990902800002, 2024-04-01T19:39:49.085 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.044689417000000002, 2024-04-01T19:39:49.085 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:39:49.085 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:39:49.085 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:49.085 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:39:49.085 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:39:49.085 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:49.085 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 176971 2024-04-01T19:39:49.085 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.085 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:39:49.085 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.085 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:39:49.085 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.705365+0000", 2024-04-01T19:39:49.085 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.086 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.086 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.086 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:39:49.086 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.705365+0000", 2024-04-01T19:39:49.086 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.086 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.086 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.086 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:39:49.086 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.705366+0000", 2024-04-01T19:39:49.086 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.722e-06 2024-04-01T19:39:49.086 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.086 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.086 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:39:49.086 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.705371+0000", 2024-04-01T19:39:49.086 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8130000000000003e-06 2024-04-01T19:39:49.087 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.087 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.087 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:39:49.087 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.705381+0000", 2024-04-01T19:39:49.087 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.8889999999999997e-06 2024-04-01T19:39:49.087 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.087 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.087 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:39:49.087 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.705388+0000", 2024-04-01T19:39:49.087 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1359999999999999e-06 2024-04-01T19:39:49.087 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.087 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.087 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:39:49.087 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.706880+0000", 2024-04-01T19:39:49.087 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.001491528 2024-04-01T19:39:49.088 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.088 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.088 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:39:49.088 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.707014+0000", 2024-04-01T19:39:49.088 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013426399999999999 2024-04-01T19:39:49.088 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.088 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.088 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T19:39:49.088 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.707141+0000", 2024-04-01T19:39:49.088 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000127119 2024-04-01T19:39:49.088 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.088 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.088 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:39:49.089 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.710970+0000", 2024-04-01T19:39:49.089 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0038289790000000001 2024-04-01T19:39:49.089 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.089 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.089 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:49.089 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.749956+0000", 2024-04-01T19:39:49.089 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.038986189999999997 2024-04-01T19:39:49.089 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.089 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.089 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:39:49.089 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.749996+0000", 2024-04-01T19:39:49.089 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9694000000000003e-05 2024-04-01T19:39:49.089 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.089 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.089 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:39:49.090 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:31:39.750054+0000", 2024-04-01T19:39:49.090 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8082999999999999e-05 2024-04-01T19:39:49.090 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.090 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:39:49.090 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.090 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.090 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.090 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:261219 3.d 3:b2923ebb:::benchmark_data_smithi188_92122_object95628:head [delete] snapc 0=[] ondisk+write+known_if_redirected e244)", 2024-04-01T19:39:49.090 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:32:46.731927+0000", 2024-04-01T19:39:49.090 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 422.31334623800001, 2024-04-01T19:39:49.090 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.045473831999999999, 2024-04-01T19:39:49.090 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:39:49.090 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:39:49.090 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:49.091 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:39:49.091 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:39:49.091 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:49.091 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 261219 2024-04-01T19:39:49.091 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.091 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:39:49.091 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.091 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:39:49.091 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.731927+0000", 2024-04-01T19:39:49.091 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.091 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.091 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.091 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:39:49.091 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.731927+0000", 2024-04-01T19:39:49.091 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.092 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.092 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.092 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:39:49.092 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.731929+0000", 2024-04-01T19:39:49.092 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.378e-06 2024-04-01T19:39:49.092 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.092 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.092 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:39:49.092 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.731934+0000", 2024-04-01T19:39:49.092 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9649999999999999e-06 2024-04-01T19:39:49.092 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.092 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.092 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:39:49.092 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.731947+0000", 2024-04-01T19:39:49.092 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2825e-05 2024-04-01T19:39:49.093 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.093 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.093 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:39:49.093 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.731954+0000", 2024-04-01T19:39:49.093 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1489999999999997e-06 2024-04-01T19:39:49.093 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.093 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.093 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:39:49.093 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.745696+0000", 2024-04-01T19:39:49.093 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.01374218 2024-04-01T19:39:49.093 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.093 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.093 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:39:49.093 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.745831+0000", 2024-04-01T19:39:49.093 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013500400000000001 2024-04-01T19:39:49.094 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.094 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.094 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 5", 2024-04-01T19:39:49.094 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.745956+0000", 2024-04-01T19:39:49.094 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000124898 2024-04-01T19:39:49.094 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.094 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.094 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:39:49.094 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.758885+0000", 2024-04-01T19:39:49.094 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.012928966 2024-04-01T19:39:49.094 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.094 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.094 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:49.094 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.777288+0000", 2024-04-01T19:39:49.094 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.018403116000000001 2024-04-01T19:39:49.095 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.095 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.095 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:39:49.095 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.777350+0000", 2024-04-01T19:39:49.095 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2419e-05 2024-04-01T19:39:49.095 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.095 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.095 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:39:49.095 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.777401+0000", 2024-04-01T19:39:49.095 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0932e-05 2024-04-01T19:39:49.095 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.095 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:39:49.095 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.095 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.095 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.096 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25117.0:261220 3.d 3:b6bbee84:::benchmark_data_smithi188_92122_object95629:head [delete] snapc 0=[] ondisk+write+known_if_redirected e244)", 2024-04-01T19:39:49.096 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:32:46.731997+0000", 2024-04-01T19:39:49.096 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 422.31327707600002, 2024-04-01T19:39:49.096 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.054216997000000003, 2024-04-01T19:39:49.096 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:39:49.096 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:39:49.096 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:49.096 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:39:49.096 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25117", 2024-04-01T19:39:49.096 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:39:49.096 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 261220 2024-04-01T19:39:49.096 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.096 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:39:49.096 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.096 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:39:49.097 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.731997+0000", 2024-04-01T19:39:49.097 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.097 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.097 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.097 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:39:49.097 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.731997+0000", 2024-04-01T19:39:49.097 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.097 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.097 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.097 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:39:49.097 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.731998+0000", 2024-04-01T19:39:49.097 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0240000000000001e-06 2024-04-01T19:39:49.097 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.097 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.098 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:39:49.098 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.732001+0000", 2024-04-01T19:39:49.098 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.7960000000000002e-06 2024-04-01T19:39:49.098 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.098 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.098 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:39:49.098 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.732010+0000", 2024-04-01T19:39:49.098 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.4370000000000007e-06 2024-04-01T19:39:49.098 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.098 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.098 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:39:49.098 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.732016+0000", 2024-04-01T19:39:49.098 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7169999999999996e-06 2024-04-01T19:39:49.098 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.098 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.099 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:39:49.099 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.749671+0000", 2024-04-01T19:39:49.099 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.017655502999999999 2024-04-01T19:39:49.099 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.099 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.099 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:39:49.099 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.749796+0000", 2024-04-01T19:39:49.099 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012520899999999999 2024-04-01T19:39:49.099 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.099 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.099 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 5", 2024-04-01T19:39:49.099 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.749915+0000", 2024-04-01T19:39:49.099 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000118233 2024-04-01T19:39:49.099 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.099 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.100 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:39:49.100 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.762635+0000", 2024-04-01T19:39:49.100 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.012720247 2024-04-01T19:39:49.100 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.100 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.100 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:49.100 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.786099+0000", 2024-04-01T19:39:49.100 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.023464631999999999 2024-04-01T19:39:49.100 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.100 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.100 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:39:49.100 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.786162+0000", 2024-04-01T19:39:49.100 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3002000000000004e-05 2024-04-01T19:39:49.100 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.100 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.101 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:39:49.101 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:32:46.786214+0000", 2024-04-01T19:39:49.101 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1196999999999998e-05 2024-04-01T19:39:49.101 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.101 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:39:49.101 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.101 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.101 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.101 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.25465.0:312844 4.0 e352/267 4:0413d19c:::benchmark_data_smithi188_104537_object140850:head v 352'19499, mlcod=352'19495)", 2024-04-01T19:39:49.101 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:38:32.581628+0000", 2024-04-01T19:39:49.101 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 76.463645227000001, 2024-04-01T19:39:49.101 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.026963879999999999, 2024-04-01T19:39:49.101 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:39:49.101 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:39:49.102 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:49.102 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:39:49.102 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.102 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:39:49.102 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:32.581628+0000", 2024-04-01T19:39:49.102 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.102 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.102 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.102 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:39:49.102 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:32.581628+0000", 2024-04-01T19:39:49.102 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.102 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.102 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.102 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:39:49.102 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:32.581631+0000", 2024-04-01T19:39:49.103 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.182e-06 2024-04-01T19:39:49.103 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.103 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.103 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:39:49.103 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:32.581639+0000", 2024-04-01T19:39:49.103 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.7700000000000007e-06 2024-04-01T19:39:49.103 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.103 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.103 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:39:49.103 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:32.581648+0000", 2024-04-01T19:39:49.103 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.0780000000000002e-06 2024-04-01T19:39:49.103 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.103 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.104 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:39:49.104 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:32.581656+0000", 2024-04-01T19:39:49.104 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.0999999999999998e-06 2024-04-01T19:39:49.104 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.104 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.104 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:39:49.104 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:32.585998+0000", 2024-04-01T19:39:49.104 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0043426810000000001 2024-04-01T19:39:49.104 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.104 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.104 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:39:49.104 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:32.586021+0000", 2024-04-01T19:39:49.104 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.2966999999999999e-05 2024-04-01T19:39:49.104 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.104 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.105 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:39:49.105 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:32.608553+0000", 2024-04-01T19:39:49.105 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.022531562000000002 2024-04-01T19:39:49.105 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.105 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.105 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:39:49.105 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:32.608592+0000", 2024-04-01T19:39:49.105 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9539999999999998e-05 2024-04-01T19:39:49.105 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.105 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:39:49.105 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.105 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.105 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.105 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.25465.0:312848 4.0 e352/267 4:056b565e:::benchmark_data_smithi188_104537_object140854:head v 352'19501, mlcod=352'19495)", 2024-04-01T19:39:49.105 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:38:32.590158+0000", 2024-04-01T19:39:49.106 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 76.455115379000006, 2024-04-01T19:39:49.106 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.025797174999999999, 2024-04-01T19:39:49.106 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:39:49.106 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:39:49.106 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:49.106 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:39:49.106 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.106 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:39:49.106 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:32.590158+0000", 2024-04-01T19:39:49.106 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.106 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.106 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.106 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:39:49.107 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:32.590158+0000", 2024-04-01T19:39:49.107 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.107 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.107 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.107 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:39:49.107 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:32.590159+0000", 2024-04-01T19:39:49.107 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.11e-06 2024-04-01T19:39:49.107 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.107 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.107 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:39:49.107 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:32.590166+0000", 2024-04-01T19:39:49.107 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6699999999999997e-06 2024-04-01T19:39:49.107 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.107 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.107 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:39:49.108 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:32.590171+0000", 2024-04-01T19:39:49.108 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1599999999999997e-06 2024-04-01T19:39:49.108 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.108 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.108 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:39:49.108 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:32.590176+0000", 2024-04-01T19:39:49.108 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8509999999999998e-06 2024-04-01T19:39:49.108 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.108 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.108 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:39:49.108 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:32.594359+0000", 2024-04-01T19:39:49.108 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0041833829999999997 2024-04-01T19:39:49.108 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.108 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.108 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:39:49.109 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:32.594383+0000", 2024-04-01T19:39:49.109 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3150999999999999e-05 2024-04-01T19:39:49.109 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.109 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.109 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:39:49.109 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:32.615911+0000", 2024-04-01T19:39:49.109 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.021528872000000001 2024-04-01T19:39:49.109 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.109 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.109 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:39:49.109 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:32.615955+0000", 2024-04-01T19:39:49.109 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3977999999999998e-05 2024-04-01T19:39:49.109 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.109 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:39:49.110 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.110 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.110 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.110 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.25465.0:343146 4.8 e355/267 4:11266e79:::benchmark_data_smithi188_104537_object171152:head v 355'21373, mlcod=355'21369)", 2024-04-01T19:39:49.110 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:38:57.178063+0000", 2024-04-01T19:39:49.110 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 51.867210530000001, 2024-04-01T19:39:49.110 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.026154829000000001, 2024-04-01T19:39:49.110 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:39:49.110 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:39:49.110 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:49.110 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:39:49.110 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.110 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:39:49.110 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:57.178063+0000", 2024-04-01T19:39:49.111 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.111 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.111 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.111 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:39:49.111 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:57.178063+0000", 2024-04-01T19:39:49.111 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.111 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.111 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.111 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:39:49.111 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:57.178064+0000", 2024-04-01T19:39:49.111 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0759999999999999e-06 2024-04-01T19:39:49.111 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.111 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.111 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:39:49.112 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:57.178074+0000", 2024-04-01T19:39:49.112 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0193e-05 2024-04-01T19:39:49.112 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.112 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.112 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:39:49.112 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:57.178082+0000", 2024-04-01T19:39:49.112 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9659999999999996e-06 2024-04-01T19:39:49.112 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.112 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.112 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:39:49.112 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:57.178088+0000", 2024-04-01T19:39:49.112 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6679999999999998e-06 2024-04-01T19:39:49.112 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.112 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.112 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:39:49.113 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:57.182707+0000", 2024-04-01T19:39:49.113 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0046190479999999997 2024-04-01T19:39:49.113 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.113 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.113 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:39:49.113 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:57.182728+0000", 2024-04-01T19:39:49.113 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1197000000000001e-05 2024-04-01T19:39:49.113 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.113 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.113 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:39:49.113 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:57.204173+0000", 2024-04-01T19:39:49.113 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.021444670999999998 2024-04-01T19:39:49.113 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.113 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.113 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:39:49.114 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:57.204218+0000", 2024-04-01T19:39:49.114 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.5009999999999998e-05 2024-04-01T19:39:49.114 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.114 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:39:49.114 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.114 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.114 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.114 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.25465.0:343155 4.8 e355/267 4:11e28aed:::benchmark_data_smithi188_104537_object171161:head v 355'21374, mlcod=355'21371)", 2024-04-01T19:39:49.114 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:38:57.182625+0000", 2024-04-01T19:39:49.114 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 51.862648663000002, 2024-04-01T19:39:49.114 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.025364504, 2024-04-01T19:39:49.114 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:39:49.114 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:39:49.114 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:49.114 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:39:49.115 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.115 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:39:49.115 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:57.182625+0000", 2024-04-01T19:39:49.115 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.115 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.115 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.115 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:39:49.115 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:57.182625+0000", 2024-04-01T19:39:49.115 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.115 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.115 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.115 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:39:49.115 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:57.182626+0000", 2024-04-01T19:39:49.115 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.156e-06 2024-04-01T19:39:49.116 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.116 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.116 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:39:49.116 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:57.182634+0000", 2024-04-01T19:39:49.116 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.7489999999999998e-06 2024-04-01T19:39:49.116 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.116 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.116 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:39:49.116 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:57.182647+0000", 2024-04-01T19:39:49.116 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2841e-05 2024-04-01T19:39:49.116 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.116 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.116 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:39:49.116 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:57.182655+0000", 2024-04-01T19:39:49.117 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0760000000000003e-06 2024-04-01T19:39:49.117 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.117 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.117 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:39:49.117 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:57.188808+0000", 2024-04-01T19:39:49.117 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0061530070000000003 2024-04-01T19:39:49.117 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.117 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.117 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:39:49.117 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:57.188827+0000", 2024-04-01T19:39:49.117 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.9321e-05 2024-04-01T19:39:49.117 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.117 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.117 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:39:49.117 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:57.207954+0000", 2024-04-01T19:39:49.117 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.019126425999999998 2024-04-01T19:39:49.118 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.118 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.118 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:39:49.118 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:38:57.207990+0000", 2024-04-01T19:39:49.118 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.5927999999999999e-05 2024-04-01T19:39:49.118 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.118 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:39:49.118 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.118 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.118 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.118 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:33757 5.9 5:9a73e971:::benchmark_data_smithi188_119427_object33756:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e374)", 2024-04-01T19:39:49.118 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:39:42.701495+0000", 2024-04-01T19:39:49.118 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 6.3437782880000002, 2024-04-01T19:39:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.013951384000000001, 2024-04-01T19:39:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:39:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:39:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:39:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:39:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:39:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 33757 2024-04-01T19:39:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:39:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:39:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:42.701495+0000", 2024-04-01T19:39:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:39:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:42.701495+0000", 2024-04-01T19:39:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:39:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:42.701498+0000", 2024-04-01T19:39:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.9749999999999999e-06 2024-04-01T19:39:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:39:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:42.701537+0000", 2024-04-01T19:39:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8383999999999997e-05 2024-04-01T19:39:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:39:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:42.701556+0000", 2024-04-01T19:39:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.9686000000000001e-05 2024-04-01T19:39:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:39:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:42.701569+0000", 2024-04-01T19:39:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2081e-05 2024-04-01T19:39:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:39:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:42.701641+0000", 2024-04-01T19:39:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.2230000000000005e-05 2024-04-01T19:39:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:39:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:42.701789+0000", 2024-04-01T19:39:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014830400000000001 2024-04-01T19:39:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 6", 2024-04-01T19:39:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:42.701933+0000", 2024-04-01T19:39:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014414199999999999 2024-04-01T19:39:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:42.713849+0000", 2024-04-01T19:39:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.011916312 2024-04-01T19:39:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:39:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:42.715336+0000", 2024-04-01T19:39:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.001486018 2024-04-01T19:39:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:39:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:42.715397+0000", 2024-04-01T19:39:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.1860999999999996e-05 2024-04-01T19:39:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:39:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:42.715447+0000", 2024-04-01T19:39:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9391000000000002e-05 2024-04-01T19:39:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.124 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:39:49.124 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.124 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.124 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.124 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:38770 5.9 5:9eca8b37:::benchmark_data_smithi188_119427_object38769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e376)", 2024-04-01T19:39:49.124 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:39:44.314398+0000", 2024-04-01T19:39:49.124 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 4.7308757239999997, 2024-04-01T19:39:49.124 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.013498049, 2024-04-01T19:39:49.124 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:39:49.124 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:39:49.124 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:49.124 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:39:49.124 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:39:49.124 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:39:49.124 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 38770 2024-04-01T19:39:49.125 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.125 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:39:49.125 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.125 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:39:49.125 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.314398+0000", 2024-04-01T19:39:49.125 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.125 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.125 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.125 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:39:49.125 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.314398+0000", 2024-04-01T19:39:49.125 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.125 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.125 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.125 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:39:49.125 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.314400+0000", 2024-04-01T19:39:49.126 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3690000000000001e-06 2024-04-01T19:39:49.126 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.126 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.126 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:39:49.126 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.314442+0000", 2024-04-01T19:39:49.126 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.1631000000000002e-05 2024-04-01T19:39:49.126 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.126 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.126 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:39:49.126 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.314459+0000", 2024-04-01T19:39:49.126 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.7487e-05 2024-04-01T19:39:49.126 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.126 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.126 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:39:49.126 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.314469+0000", 2024-04-01T19:39:49.127 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.9110000000000005e-06 2024-04-01T19:39:49.127 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.127 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.127 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:39:49.127 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.314626+0000", 2024-04-01T19:39:49.127 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00015659800000000001 2024-04-01T19:39:49.127 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.127 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.127 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:39:49.127 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.314771+0000", 2024-04-01T19:39:49.127 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000145334 2024-04-01T19:39:49.127 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.127 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.127 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 6", 2024-04-01T19:39:49.127 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.314908+0000", 2024-04-01T19:39:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013694999999999999 2024-04-01T19:39:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:39:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.317815+0000", 2024-04-01T19:39:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0029067369999999999 2024-04-01T19:39:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.327770+0000", 2024-04-01T19:39:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0099545940000000006 2024-04-01T19:39:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:39:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.327838+0000", 2024-04-01T19:39:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8150000000000003e-05 2024-04-01T19:39:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:39:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.327896+0000", 2024-04-01T19:39:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8288000000000002e-05 2024-04-01T19:39:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:39:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:38775 5.9 5:96ab2ec8:::benchmark_data_smithi188_119427_object38774:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e376)", 2024-04-01T19:39:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:39:44.314492+0000", 2024-04-01T19:39:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 4.7307818619999997, 2024-04-01T19:39:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.013509693, 2024-04-01T19:39:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:39:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:39:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:39:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:39:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:39:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 38775 2024-04-01T19:39:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:39:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:39:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.314492+0000", 2024-04-01T19:39:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:39:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.314492+0000", 2024-04-01T19:39:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:39:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.314493+0000", 2024-04-01T19:39:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.7199999999999997e-07 2024-04-01T19:39:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:39:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.314529+0000", 2024-04-01T19:39:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.5973999999999998e-05 2024-04-01T19:39:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:39:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.314541+0000", 2024-04-01T19:39:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1770000000000001e-05 2024-04-01T19:39:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:39:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.314547+0000", 2024-04-01T19:39:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9589999999999998e-06 2024-04-01T19:39:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.133 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:39:49.133 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.316291+0000", 2024-04-01T19:39:49.133 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0017434099999999999 2024-04-01T19:39:49.133 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.133 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.133 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:39:49.133 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.316414+0000", 2024-04-01T19:39:49.133 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012265600000000001 2024-04-01T19:39:49.133 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.133 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.133 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 6", 2024-04-01T19:39:49.133 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.316549+0000", 2024-04-01T19:39:49.133 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000135525 2024-04-01T19:39:49.133 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.133 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.134 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:39:49.134 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.318155+0000", 2024-04-01T19:39:49.134 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00160593 2024-04-01T19:39:49.134 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.134 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.134 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:49.134 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.327944+0000", 2024-04-01T19:39:49.134 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0097891379999999993 2024-04-01T19:39:49.134 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.134 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.134 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:39:49.134 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.327980+0000", 2024-04-01T19:39:49.134 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.5553999999999999e-05 2024-04-01T19:39:49.134 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.134 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.135 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:39:49.135 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:44.328001+0000", 2024-04-01T19:39:49.135 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1804999999999999e-05 2024-04-01T19:39:49.135 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.135 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:39:49.135 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.135 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.135 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.135 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:41983 5.9 5:93923a4b:::benchmark_data_smithi188_119427_object41982:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e377)", 2024-04-01T19:39:49.135 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:39:45.480056+0000", 2024-04-01T19:39:49.135 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 3.5652176170000001, 2024-04-01T19:39:49.135 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.013952703, 2024-04-01T19:39:49.135 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:39:49.135 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:39:49.135 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:49.136 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:39:49.136 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:39:49.136 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:39:49.136 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 41983 2024-04-01T19:39:49.136 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.136 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:39:49.136 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.136 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:39:49.136 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:45.480056+0000", 2024-04-01T19:39:49.136 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.136 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.136 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.136 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:39:49.136 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:45.480056+0000", 2024-04-01T19:39:49.136 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.137 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.137 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.137 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:39:49.137 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:45.480057+0000", 2024-04-01T19:39:49.137 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0890000000000001e-06 2024-04-01T19:39:49.137 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.137 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.137 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:39:49.137 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:45.480100+0000", 2024-04-01T19:39:49.137 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.2760999999999999e-05 2024-04-01T19:39:49.137 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.137 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.137 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:39:49.137 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:45.480107+0000", 2024-04-01T19:39:49.137 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1860000000000003e-06 2024-04-01T19:39:49.137 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.138 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.138 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:39:49.138 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:45.480114+0000", 2024-04-01T19:39:49.138 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.533e-06 2024-04-01T19:39:49.138 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.138 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.138 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:39:49.138 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:45.481558+0000", 2024-04-01T19:39:49.138 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0014439920000000001 2024-04-01T19:39:49.138 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.138 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.138 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:39:49.138 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:45.481691+0000", 2024-04-01T19:39:49.138 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013304199999999999 2024-04-01T19:39:49.139 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.139 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.139 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 6", 2024-04-01T19:39:49.139 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:45.481850+0000", 2024-04-01T19:39:49.139 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00015908299999999999 2024-04-01T19:39:49.139 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.139 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.139 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:39:49.139 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:45.490129+0000", 2024-04-01T19:39:49.139 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0082788600000000007 2024-04-01T19:39:49.139 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.139 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.139 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:49.139 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:45.493918+0000", 2024-04-01T19:39:49.140 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0037894690000000002 2024-04-01T19:39:49.140 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.140 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.140 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:39:49.140 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:45.493977+0000", 2024-04-01T19:39:49.140 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.9181999999999997e-05 2024-04-01T19:39:49.140 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.140 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.140 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:39:49.140 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:45.494009+0000", 2024-04-01T19:39:49.140 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.1506e-05 2024-04-01T19:39:49.140 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.140 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:39:49.140 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.140 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.140 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.141 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:43702 5.9 5:9322691f:::benchmark_data_smithi188_119427_object43701:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e377)", 2024-04-01T19:39:49.141 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:39:46.084261+0000", 2024-04-01T19:39:49.141 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 2.9610121999999999, 2024-04-01T19:39:49.141 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.012178588000000001, 2024-04-01T19:39:49.141 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:39:49.141 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:39:49.141 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:49.141 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:39:49.141 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:39:49.141 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:39:49.141 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 43702 2024-04-01T19:39:49.141 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.141 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:39:49.141 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.141 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:39:49.142 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:46.084261+0000", 2024-04-01T19:39:49.142 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.142 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.142 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.142 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:39:49.142 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:46.084261+0000", 2024-04-01T19:39:49.142 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.142 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.142 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.142 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:39:49.142 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:46.084263+0000", 2024-04-01T19:39:49.142 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.7829999999999999e-06 2024-04-01T19:39:49.142 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.142 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.143 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:39:49.143 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:46.084319+0000", 2024-04-01T19:39:49.143 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5402999999999998e-05 2024-04-01T19:39:49.143 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.143 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.143 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:39:49.143 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:46.084328+0000", 2024-04-01T19:39:49.143 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.7040000000000006e-06 2024-04-01T19:39:49.143 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.143 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.143 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:39:49.143 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:46.084335+0000", 2024-04-01T19:39:49.143 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3289999999999999e-06 2024-04-01T19:39:49.143 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.143 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.143 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:39:49.144 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:46.084753+0000", 2024-04-01T19:39:49.144 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00041878400000000001 2024-04-01T19:39:49.144 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.144 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.144 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:39:49.144 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:46.084876+0000", 2024-04-01T19:39:49.144 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012284700000000001 2024-04-01T19:39:49.144 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.144 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.144 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 6", 2024-04-01T19:39:49.144 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:46.085027+0000", 2024-04-01T19:39:49.144 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00015068199999999999 2024-04-01T19:39:49.144 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.144 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.144 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:39:49.145 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:46.088268+0000", 2024-04-01T19:39:49.145 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00324143 2024-04-01T19:39:49.145 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.145 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.145 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:49.145 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:46.096315+0000", 2024-04-01T19:39:49.145 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0080465339999999993 2024-04-01T19:39:49.145 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.145 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.145 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:39:49.145 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:46.096387+0000", 2024-04-01T19:39:49.145 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1859000000000004e-05 2024-04-01T19:39:49.145 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.145 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.145 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:39:49.146 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:46.096440+0000", 2024-04-01T19:39:49.146 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3232999999999997e-05 2024-04-01T19:39:49.146 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.146 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:39:49.146 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.146 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.146 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.146 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:49678 5.9 5:917ff35c:::benchmark_data_smithi188_119427_object49677:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e377)", 2024-04-01T19:39:49.146 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:39:48.279561+0000", 2024-04-01T19:39:49.146 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.76571242500000003, 2024-04-01T19:39:49.146 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.012631595000000001, 2024-04-01T19:39:49.146 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:39:49.146 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:39:49.146 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:49.146 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:39:49.147 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:39:49.147 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:39:49.147 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 49678 2024-04-01T19:39:49.147 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.147 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:39:49.147 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.147 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:39:49.147 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:48.279561+0000", 2024-04-01T19:39:49.147 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.147 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.147 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.147 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:39:49.147 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:48.279561+0000", 2024-04-01T19:39:49.147 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.148 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.148 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.148 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:39:49.148 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:48.279562+0000", 2024-04-01T19:39:49.148 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.7000000000000003e-07 2024-04-01T19:39:49.148 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.148 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.148 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:39:49.148 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:48.279708+0000", 2024-04-01T19:39:49.148 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014624500000000001 2024-04-01T19:39:49.148 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.148 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.148 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:39:49.148 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:48.279717+0000", 2024-04-01T19:39:49.148 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.67e-06 2024-04-01T19:39:49.148 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.149 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.149 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:39:49.149 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:48.279725+0000", 2024-04-01T19:39:49.149 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.5329999999999997e-06 2024-04-01T19:39:49.149 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.149 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.149 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:39:49.149 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:48.283369+0000", 2024-04-01T19:39:49.149 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0036443809999999999 2024-04-01T19:39:49.149 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.149 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.149 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:39:49.149 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:48.283487+0000", 2024-04-01T19:39:49.149 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000117692 2024-04-01T19:39:49.149 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.149 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.150 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 6", 2024-04-01T19:39:49.150 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:48.283618+0000", 2024-04-01T19:39:49.150 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000131843 2024-04-01T19:39:49.150 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.150 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.150 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:39:49.150 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:48.286758+0000", 2024-04-01T19:39:49.150 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0031396869999999999 2024-04-01T19:39:49.150 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.150 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.150 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:49.150 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:48.292088+0000", 2024-04-01T19:39:49.150 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0053301279999999999 2024-04-01T19:39:49.150 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.151 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.151 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:39:49.151 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:48.292147+0000", 2024-04-01T19:39:49.151 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8254999999999997e-05 2024-04-01T19:39:49.151 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.151 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.151 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:39:49.151 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:48.292193+0000", 2024-04-01T19:39:49.151 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6291000000000001e-05 2024-04-01T19:39:49.151 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.151 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:39:49.151 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.151 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.151 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.151 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:51632 5.9 5:932e7bbc:::benchmark_data_smithi188_119427_object51631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e377)", 2024-04-01T19:39:49.152 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:39:49.000066+0000", 2024-04-01T19:39:49.152 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.045207772, 2024-04-01T19:39:49.152 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.013112721000000001, 2024-04-01T19:39:49.152 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:39:49.152 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:39:49.152 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:39:49.152 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:39:49.152 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:39:49.152 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:39:49.152 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 51632 2024-04-01T19:39:49.152 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.152 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:39:49.152 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.152 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:39:49.152 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:49.000066+0000", 2024-04-01T19:39:49.152 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.153 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.153 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.153 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:39:49.153 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:49.000066+0000", 2024-04-01T19:39:49.153 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:39:49.153 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.153 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.153 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:39:49.153 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:49.000068+0000", 2024-04-01T19:39:49.153 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.6339999999999999e-06 2024-04-01T19:39:49.153 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.153 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.153 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:39:49.153 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:49.000124+0000", 2024-04-01T19:39:49.153 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6376999999999999e-05 2024-04-01T19:39:49.153 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.154 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.154 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:39:49.154 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:49.000136+0000", 2024-04-01T19:39:49.154 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2309e-05 2024-04-01T19:39:49.154 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.154 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.154 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:39:49.154 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:49.000143+0000", 2024-04-01T19:39:49.154 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1189999999999999e-06 2024-04-01T19:39:49.154 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.154 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.154 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:39:49.154 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:49.000193+0000", 2024-04-01T19:39:49.154 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9441000000000003e-05 2024-04-01T19:39:49.155 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.155 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.155 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:39:49.155 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:49.000280+0000", 2024-04-01T19:39:49.155 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.7268999999999994e-05 2024-04-01T19:39:49.155 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.155 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.155 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 6", 2024-04-01T19:39:49.155 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:49.000369+0000", 2024-04-01T19:39:49.155 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.9349000000000001e-05 2024-04-01T19:39:49.155 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.155 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.155 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:39:49.155 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:49.009485+0000", 2024-04-01T19:39:49.155 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.009115115 2024-04-01T19:39:49.156 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.156 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.156 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:39:49.156 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:49.013081+0000", 2024-04-01T19:39:49.156 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0035967740000000001 2024-04-01T19:39:49.156 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.156 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.156 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:39:49.156 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:49.013132+0000", 2024-04-01T19:39:49.156 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0798999999999999e-05 2024-04-01T19:39:49.156 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:39:49.156 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:39:49.156 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:39:49.156 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:39:49.013179+0000", 2024-04-01T19:39:49.156 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6535000000000001e-05 2024-04-01T19:39:49.156 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.157 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:39:49.157 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.157 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:39:49.157 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:39:49.157 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:39:49.627 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 15 16 53336 53320 222.142 171.188 0.00410631 0.00449983 2024-04-01T19:39:49.813 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:39:49.817 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:49.818 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:39:49.865 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_ops_in_flight 2024-04-01T19:39:49.918 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:39:49.969 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:50.154 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:50 smithi062 ceph-mon[44211]: pgmap v1066: 17 pgs: 17 active+clean; 2.7 GiB data, 8.3 GiB used, 975 GiB / 983 GiB avail; 173 MiB/s wr, 2.77k op/s 2024-04-01T19:39:50.223 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:39:50.225 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:39:50.229 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:50.229 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:39:50.261 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 3 1 2024-04-01T19:39:50.331 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:39:50.362 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:50.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:50 smithi022 ceph-mon[39439]: pgmap v1066: 17 pgs: 17 active+clean; 2.7 GiB data, 8.3 GiB used, 975 GiB / 983 GiB avail; 173 MiB/s wr, 2.77k op/s 2024-04-01T19:39:50.565 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:39:50.566 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:50 smithi188 ceph-mon[43939]: pgmap v1066: 17 pgs: 17 active+clean; 2.7 GiB data, 8.3 GiB used, 975 GiB / 983 GiB avail; 173 MiB/s wr, 2.77k op/s 2024-04-01T19:39:50.566 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:50.567 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:39:50.627 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 16 15 55852 55837 218.09 157.312 0.00204158 0.00458377 2024-04-01T19:39:50.667 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:39:50.695 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:50.810 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:39:50.883 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:39:51.389 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:51 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:39:51.389 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:51 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:39:51.389 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:51 smithi022 ceph-mon[39439]: osdmap e378: 12 total, 12 up, 11 in 2024-04-01T19:39:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:51 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:39:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:51 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:39:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:51 smithi062 ceph-mon[44211]: osdmap e378: 12 total, 12 up, 11 in 2024-04-01T19:39:51.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:51 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:39:51.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:51 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:39:51.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:51 smithi188 ceph-mon[43939]: osdmap e378: 12 total, 12 up, 11 in 2024-04-01T19:39:51.627 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 17 16 58214 58198 213.941 147.562 0.00684277 0.00467215 2024-04-01T19:39:52.046 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:39:52.082 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:39:52.117 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:39:52.152 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:39:52.184 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:39:52.213 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:39:52.233 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:39:52.265 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:39:52.306 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:39:52.338 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:39:52.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:52 smithi022 ceph-mon[39439]: pgmap v1068: 17 pgs: 17 active+clean; 3.1 GiB data, 9.3 GiB used, 974 GiB / 983 GiB avail; 204 MiB/s wr, 3.26k op/s 2024-04-01T19:39:52.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:52 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3526548480' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:39:52.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:52.367 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:39:52.403 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:39:52.416 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:39:52.416 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:39:52.417 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:39:52.417 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:39:52.417 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:39:52.417 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:39:52.417 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:39:52.417 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:39:52.417 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:39:52.417 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:39:52.417 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:39:52.417 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:39:52.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:52 smithi062 ceph-mon[44211]: pgmap v1068: 17 pgs: 17 active+clean; 3.1 GiB data, 9.3 GiB used, 974 GiB / 983 GiB avail; 204 MiB/s wr, 3.26k op/s 2024-04-01T19:39:52.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:52 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3526548480' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:39:52.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:52.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:52 smithi188 ceph-mon[43939]: pgmap v1068: 17 pgs: 17 active+clean; 3.1 GiB data, 9.3 GiB used, 974 GiB / 983 GiB avail; 204 MiB/s wr, 3.26k op/s 2024-04-01T19:39:52.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:52 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3526548480' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:39:52.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:52.627 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 18 15 60550 60535 210.169 146.062 0.0061257 0.0047567 2024-04-01T19:39:53.048 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:39:53.052 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:53.053 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:39:53.154 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:39:53.193 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:53.252 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:39:53.255 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:53.255 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:39:53.356 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:39:53.389 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:53.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:53 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:39:53.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:53 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:39:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:53 smithi062 ceph-mon[44211]: osdmap e379: 12 total, 12 up, 11 in 2024-04-01T19:39:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:53 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:39:53.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:53 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:39:53.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:53 smithi022 ceph-mon[39439]: osdmap e379: 12 total, 12 up, 11 in 2024-04-01T19:39:53.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:53 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:39:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:53 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:39:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:53 smithi188 ceph-mon[43939]: osdmap e379: 12 total, 12 up, 11 in 2024-04-01T19:39:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:39:53.627 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 19 16 63006 62990 207.183 153.438 0.00309235 0.00482515 2024-04-01T19:39:53.644 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:39:53.647 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:53.647 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:39:53.748 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:39:53.793 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:53.827 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:39:53.831 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:53.831 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:39:53.932 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:39:53.969 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:53.993 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:39:53.997 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:53.998 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:39:54.099 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:39:54.137 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:54.159 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:39:54.163 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:54.163 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:39:54.264 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:39:54.300 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:54.328 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:39:54.331 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:54.332 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:39:54.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:54 smithi022 ceph-mon[39439]: pgmap v1070: 17 pgs: 17 active+clean; 3.4 GiB data, 10 GiB used, 973 GiB / 983 GiB avail; 198 MiB/s wr, 3.16k op/s 2024-04-01T19:39:54.432 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:39:54.467 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:54 smithi062 ceph-mon[44211]: pgmap v1070: 17 pgs: 17 active+clean; 3.4 GiB data, 10 GiB used, 973 GiB / 983 GiB avail; 198 MiB/s wr, 3.16k op/s 2024-04-01T19:39:54.470 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:54.499 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:39:54.505 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:54.505 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:39:54.568 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:54 smithi188 ceph-mon[43939]: pgmap v1070: 17 pgs: 17 active+clean; 3.4 GiB data, 10 GiB used, 973 GiB / 983 GiB avail; 198 MiB/s wr, 3.16k op/s 2024-04-01T19:39:54.606 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:39:54.627 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:39:54.630425 min lat: 0.00113025 max lat: 0.209539 avg lat: 0.00490567 2024-04-01T19:39:54.627 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:39:54.627 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 20 15 65230 65215 203.776 139.062 0.00470356 0.00490567 2024-04-01T19:39:54.648 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:54.673 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:39:54.677 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:54.677 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:39:54.778 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:39:54.834 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:54.893 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:39:54.894 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:39:55.254 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:55 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/264378974' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:39:55.254 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:55 smithi188 ceph-mon[43939]: from='client.25888 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:39:55.292 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:39:55.309 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:39:55.318 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:55.319 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:39:55.420 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:39:55.454 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:55.479 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:39:55.483 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:55.483 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:39:55.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:55 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/264378974' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:39:55.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:55 smithi062 ceph-mon[44211]: from='client.25888 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:39:55.586 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:39:55.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:55 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/264378974' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:39:55.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:55 smithi022 ceph-mon[39439]: from='client.25888 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:39:55.627 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 21 16 67329 67313 200.316 131.125 0.00610775 0.00499051 2024-04-01T19:39:55.652 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:55.684 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_blocked_ops 2024-04-01T19:39:55.709 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:39:55.729 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:55.729 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:39:55.830 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:39:55.974 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:56.536 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:56 smithi062 ceph-mon[44211]: pgmap v1071: 17 pgs: 17 active+clean; 3.5 GiB data, 10 GiB used, 973 GiB / 983 GiB avail; 130 MiB/s wr, 2.09k op/s 2024-04-01T19:39:56.536 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:56 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:39:56.536 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:56 smithi062 ceph-mon[44211]: from='client.25888 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:39:56.536 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:56 smithi062 ceph-mon[44211]: osdmap e380: 12 total, 12 up, 11 in 2024-04-01T19:39:56.536 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:56 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3142579780' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:39:56.536 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:56 smithi062 ceph-mon[44211]: from='client.36005 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:39:56.537 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:56.538 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.3 to 1 (10000) 2024-04-01T19:39:56.538 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:39:56.538 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:56 smithi022 ceph-mon[39439]: pgmap v1071: 17 pgs: 17 active+clean; 3.5 GiB data, 10 GiB used, 973 GiB / 983 GiB avail; 130 MiB/s wr, 2.09k op/s 2024-04-01T19:39:56.539 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:56 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:39:56.539 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:56 smithi022 ceph-mon[39439]: from='client.25888 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:39:56.539 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:56 smithi022 ceph-mon[39439]: osdmap e380: 12 total, 12 up, 11 in 2024-04-01T19:39:56.539 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:56 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3142579780' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:39:56.539 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:56 smithi022 ceph-mon[39439]: from='client.36005 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:39:56.539 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:39:56.539 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:39:56.615 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:56 smithi188 ceph-mon[43939]: pgmap v1071: 17 pgs: 17 active+clean; 3.5 GiB data, 10 GiB used, 973 GiB / 983 GiB avail; 130 MiB/s wr, 2.09k op/s 2024-04-01T19:39:56.615 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:56 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:39:56.615 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:56 smithi188 ceph-mon[43939]: from='client.25888 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:39:56.615 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:56 smithi188 ceph-mon[43939]: osdmap e380: 12 total, 12 up, 11 in 2024-04-01T19:39:56.616 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:56 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3142579780' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:39:56.616 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:56 smithi188 ceph-mon[43939]: from='client.36005 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:39:56.627 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 22 16 69568 69552 197.571 139.938 0.00387941 0.00506011 2024-04-01T19:39:56.640 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:39:56.675 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:56.708 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:39:56.712 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:56.713 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:39:56.814 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:39:56.883 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:57.073 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:39:57.100 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:39:57.109 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:57.110 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:39:57.153 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 4 1 2024-04-01T19:39:57.210 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:39:57.244 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:57.272 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:39:57.278 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:57.278 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:39:57.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:57 smithi022 ceph-mon[39439]: from='client.36005 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-04-01T19:39:57.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:57 smithi022 ceph-mon[39439]: osdmap e381: 12 total, 12 up, 11 in 2024-04-01T19:39:57.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:57 smithi188 ceph-mon[43939]: from='client.36005 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-04-01T19:39:57.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:57 smithi188 ceph-mon[43939]: osdmap e381: 12 total, 12 up, 11 in 2024-04-01T19:39:57.379 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:39:57.418 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:57.442 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:39:57.445 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:57.445 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:39:57.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:57 smithi062 ceph-mon[44211]: from='client.36005 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-04-01T19:39:57.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:57 smithi062 ceph-mon[44211]: osdmap e381: 12 total, 12 up, 11 in 2024-04-01T19:39:57.546 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:39:57.601 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:57.609 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:39:57.627 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 23 16 71581 71565 194.451 125.812 0.0128916 0.00514081 2024-04-01T19:39:57.648 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:39:57.655 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:57.656 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:39:57.663 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:39:57.757 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:39:57.792 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:57.819 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:39:57.824 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:57.824 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:39:57.925 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:39:57.957 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:57.985 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:39:57.988 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:57.988 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:39:58.090 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:39:58.113 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:39:58.113 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:39:58.145 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:58.212 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:39:58.217 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:58.218 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:39:58.319 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:39:58.357 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:58.380 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:39:58.383 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:58.384 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:39:58.483 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:39:58 smithi188 ceph-mon[43939]: pgmap v1074: 17 pgs: 17 active+clean; 4.0 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 164 MiB/s wr, 2.63k op/s 2024-04-01T19:39:58.484 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:39:58.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:39:58 smithi022 ceph-mon[39439]: pgmap v1074: 17 pgs: 17 active+clean; 4.0 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 164 MiB/s wr, 2.63k op/s 2024-04-01T19:39:58.536 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:58.539 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:39:58.627 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 24 16 73555 73539 191.489 123.375 0.0115512 0.00522092 2024-04-01T19:39:58.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:39:58 smithi062 ceph-mon[44211]: pgmap v1074: 17 pgs: 17 active+clean; 4.0 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 164 MiB/s wr, 2.63k op/s 2024-04-01T19:39:58.824 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:39:58.828 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:58.829 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:39:58.906 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_historic_ops 2024-04-01T19:39:58.929 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:39:58.985 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:59.013 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:39:59.018 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:59.018 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:39:59.119 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:39:59.162 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:59.199 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:39:59.203 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:59.204 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:39:59.255 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:39:59.304 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:39:59.343 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:59.372 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:39:59.377 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:59.377 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:39:59.478 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:39:59.523 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:59.627 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 25 16 75565 75549 188.854 125.625 0.0156086 0.00529375 2024-04-01T19:39:59.738 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:39:59.751 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:59.751 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:39:59.852 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:39:59.889 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:39:59.914 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:39:59.916 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:39:59.917 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:40:00.017 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:40:00.065 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:00.189 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:40:00.194 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:00.195 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:40:00.296 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:40:00.336 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:00.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:00 smithi022 ceph-mon[39439]: pgmap v1075: 17 pgs: 17 active+clean; 4.2 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 113 MiB/s wr, 1.80k op/s 2024-04-01T19:40:00.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:00 smithi022 ceph-mon[39439]: Health detail: HEALTH_WARN noscrub flag(s) set 2024-04-01T19:40:00.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:00 smithi022 ceph-mon[39439]: [WRN] OSDMAP_FLAGS: noscrub flag(s) set 2024-04-01T19:40:00.362 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:40:00.367 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:00.367 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:40:00.468 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:40:00.498 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:00 smithi188 ceph-mon[43939]: pgmap v1075: 17 pgs: 17 active+clean; 4.2 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 113 MiB/s wr, 1.80k op/s 2024-04-01T19:40:00.498 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:00 smithi188 ceph-mon[43939]: Health detail: HEALTH_WARN noscrub flag(s) set 2024-04-01T19:40:00.498 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:00 smithi188 ceph-mon[43939]: [WRN] OSDMAP_FLAGS: noscrub flag(s) set 2024-04-01T19:40:00.502 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:00.627 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 26 16 77569 77553 186.407 125.25 0.00572397 0.00536328 2024-04-01T19:40:00.709 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:40:00.713 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:00.714 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:40:00.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:00 smithi062 ceph-mon[44211]: pgmap v1075: 17 pgs: 17 active+clean; 4.2 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 113 MiB/s wr, 1.80k op/s 2024-04-01T19:40:00.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:00 smithi062 ceph-mon[44211]: Health detail: HEALTH_WARN noscrub flag(s) set 2024-04-01T19:40:00.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:00 smithi062 ceph-mon[44211]: [WRN] OSDMAP_FLAGS: noscrub flag(s) set 2024-04-01T19:40:00.804 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:40:00.815 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:40:00.850 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:00.873 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:40:00.877 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:00.878 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:40:00.979 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:40:01.010 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:01.038 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:40:01.043 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:01.044 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:40:01.145 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:40:01.179 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:01.206 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:40:01.209 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:01.209 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:40:01.297 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:01 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2489063064' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T19:40:01.297 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:01 smithi188 ceph-mon[43939]: from='client.25894 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T19:40:01.310 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.4 to 1 (10000) 2024-04-01T19:40:01.310 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:40:01.346 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:01.373 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:40:01.376 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:01.377 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:40:01.412 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:40:01.412 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:40:01.478 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:40:01.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:01 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2489063064' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T19:40:01.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:01 smithi062 ceph-mon[44211]: from='client.25894 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T19:40:01.518 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:01.522 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:40:01.542 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:40:01.545 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:01.546 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:40:01.564 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:40:01.607 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:40:01.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:01 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2489063064' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T19:40:01.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:01 smithi022 ceph-mon[39439]: from='client.25894 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T19:40:01.627 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 27 16 79371 79355 183.674 112.625 0.00305903 0.00544279 2024-04-01T19:40:01.647 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:40:01.648 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:40:01.677 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:40:01.681 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:01.709 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:40:01.710 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:40:01.712 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:01.712 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:40:01.745 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:40:01.773 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:40:01.809 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:40:01.813 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:40:01.844 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:40:01.847 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:01.878 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:40:01.918 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:40:01.926 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:40:01.926 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:40:01.926 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:40:01.926 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:40:01.926 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:40:01.927 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:40:01.927 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:40:01.927 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:40:01.927 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:40:01.927 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:40:01.927 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:40:01.927 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:40:02.206 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:40:02.211 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:02.212 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:40:02.236 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_ops_in_flight 2024-04-01T19:40:02.313 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:40:02.331 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 5 1 2024-04-01T19:40:02.358 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:02.392 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:40:02.396 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:02.397 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:40:02.498 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:40:02.570 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:02 smithi022 ceph-mon[39439]: pgmap v1076: 17 pgs: 17 active+clean; 4.5 GiB data, 12 GiB used, 971 GiB / 983 GiB avail; 135 MiB/s wr, 2.17k op/s 2024-04-01T19:40:02.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:02 smithi022 ceph-mon[39439]: from='client.25894 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-04-01T19:40:02.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:02 smithi022 ceph-mon[39439]: osdmap e382: 12 total, 12 up, 11 in 2024-04-01T19:40:02.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:02 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/643140887' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:40:02.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:02.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:02.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:02.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:02.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:02.574 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:02.619 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:40:02.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:02 smithi188 ceph-mon[43939]: pgmap v1076: 17 pgs: 17 active+clean; 4.5 GiB data, 12 GiB used, 971 GiB / 983 GiB avail; 135 MiB/s wr, 2.17k op/s 2024-04-01T19:40:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:02 smithi188 ceph-mon[43939]: from='client.25894 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-04-01T19:40:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:02 smithi188 ceph-mon[43939]: osdmap e382: 12 total, 12 up, 11 in 2024-04-01T19:40:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:02 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/643140887' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:40:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:02.628 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 28 16 81240 81224 181.286 116.812 0.0139061 0.00551404 2024-04-01T19:40:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:02 smithi062 ceph-mon[44211]: pgmap v1076: 17 pgs: 17 active+clean; 4.5 GiB data, 12 GiB used, 971 GiB / 983 GiB avail; 135 MiB/s wr, 2.17k op/s 2024-04-01T19:40:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:02 smithi062 ceph-mon[44211]: from='client.25894 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-04-01T19:40:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:02 smithi062 ceph-mon[44211]: osdmap e382: 12 total, 12 up, 11 in 2024-04-01T19:40:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:02 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/643140887' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:40:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:03.041 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:40:03.050 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:03.051 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:40:03.152 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:40:03.187 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:03.316 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:03.316 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:03.316 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:03.316 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:03.316 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:03.316 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:03.316 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:03.597 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:03.597 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:03.597 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:03.597 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:03.597 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:03.597 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:03.598 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:03.628 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 29 15 83286 83271 179.446 127.938 0.00778782 0.00557083 2024-04-01T19:40:03.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:03.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:03.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:03.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:03.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:03.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:03.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:03.944 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:40:03.952 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:03.953 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:40:04.054 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:40:04.128 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:04.160 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:40:04.164 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:04.165 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:40:04.266 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:40:04.302 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:04.320 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:04 smithi022 ceph-mon[39439]: pgmap v1078: 17 pgs: 17 active+clean; 4.7 GiB data, 13 GiB used, 971 GiB / 983 GiB avail; 152 MiB/s wr, 2.43k op/s 2024-04-01T19:40:04.331 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:40:04.333 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:04.334 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:40:04.435 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:40:04.468 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:04.500 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:40:04.505 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:04.505 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:40:04.602 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:40:04.602 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:40:04.602 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:04.602 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:85123 5.4 5:27f13eec:::benchmark_data_smithi188_119427_object85122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e382)", 2024-04-01T19:40:04.602 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:40:04.601605+0000", 2024-04-01T19:40:04.602 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.002677989, 2024-04-01T19:40:04.602 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00271076, 2024-04-01T19:40:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:40:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:40:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:40:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 85123 2024-04-01T19:40:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:04.601605+0000", 2024-04-01T19:40:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:04.601605+0000", 2024-04-01T19:40:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:04.601608+0000", 2024-04-01T19:40:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5799999999999999e-06 2024-04-01T19:40:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:04.601631+0000", 2024-04-01T19:40:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3048999999999999e-05 2024-04-01T19:40:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:04.601644+0000", 2024-04-01T19:40:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3319000000000001e-05 2024-04-01T19:40:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:04.601652+0000", 2024-04-01T19:40:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8720000000000002e-06 2024-04-01T19:40:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:04.601798+0000", 2024-04-01T19:40:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000146167 2024-04-01T19:40:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:04.601891+0000", 2024-04-01T19:40:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2795999999999997e-05 2024-04-01T19:40:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:40:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:04.602009+0000", 2024-04-01T19:40:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011788199999999999 2024-04-01T19:40:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:85124 5.0 5:0dcea8f3:::benchmark_data_smithi188_119427_object85123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e382)", 2024-04-01T19:40:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:40:04.601675+0000", 2024-04-01T19:40:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.002607772, 2024-04-01T19:40:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002734266, 2024-04-01T19:40:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:40:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:40:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:40:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 85124 2024-04-01T19:40:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:04.601675+0000", 2024-04-01T19:40:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:04.601675+0000", 2024-04-01T19:40:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:04.601676+0000", 2024-04-01T19:40:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.85e-07 2024-04-01T19:40:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:04.601702+0000", 2024-04-01T19:40:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5845000000000001e-05 2024-04-01T19:40:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:04.601711+0000", 2024-04-01T19:40:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7050000000000005e-06 2024-04-01T19:40:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:04.601718+0000", 2024-04-01T19:40:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1459999999999999e-06 2024-04-01T19:40:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:04.601784+0000", 2024-04-01T19:40:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5811999999999999e-05 2024-04-01T19:40:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:04.601909+0000", 2024-04-01T19:40:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012535700000000001 2024-04-01T19:40:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-01T19:40:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:04.602036+0000", 2024-04-01T19:40:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012676000000000001 2024-04-01T19:40:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: ], 2024-04-01T19:40:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 2 2024-04-01T19:40:04.611 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:40:04.612 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:40:04.622 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:04 smithi188 ceph-mon[43939]: pgmap v1078: 17 pgs: 17 active+clean; 4.7 GiB data, 13 GiB used, 971 GiB / 983 GiB avail; 152 MiB/s wr, 2.43k op/s 2024-04-01T19:40:04.628 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 30 16 85181 85165 177.41 118.375 0.00970781 0.00563526 2024-04-01T19:40:04.646 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:04 smithi062 ceph-mon[44211]: pgmap v1078: 17 pgs: 17 active+clean; 4.7 GiB data, 13 GiB used, 971 GiB / 983 GiB avail; 152 MiB/s wr, 2.43k op/s 2024-04-01T19:40:04.651 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:04.672 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:40:04.677 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:40:04.681 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:04.682 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:40:04.783 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:40:04.817 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:04.850 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:40:04.854 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:04.855 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:40:04.956 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:40:04.990 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:05.017 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:40:05.022 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:05.022 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:40:05.123 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:40:05.158 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:05.190 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:40:05.194 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:05.194 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:40:05.295 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:40:05.333 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:05.358 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:40:05.361 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:05.362 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:40:05.376 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_blocked_ops 2024-04-01T19:40:05.462 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:40:05.498 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:05.525 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:40:05.529 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:05.530 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:40:05.628 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 31 16 86937 86921 175.227 109.75 0.00469136 0.0057055 2024-04-01T19:40:05.631 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:40:05.666 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:40:05.683 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:05.728 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:40:06.124 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:40:06.303 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:06 smithi188 ceph-mon[43939]: pgmap v1079: 17 pgs: 17 active+clean; 4.8 GiB data, 13 GiB used, 971 GiB / 983 GiB avail; 107 MiB/s wr, 1.72k op/s 2024-04-01T19:40:06.303 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:06 smithi188 ceph-mon[43939]: osdmap e383: 12 total, 12 up, 11 in 2024-04-01T19:40:06.303 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:06 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1010434472' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:40:06.303 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:06 smithi188 ceph-mon[43939]: from='client.25903 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:40:06.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:06 smithi022 ceph-mon[39439]: pgmap v1079: 17 pgs: 17 active+clean; 4.8 GiB data, 13 GiB used, 971 GiB / 983 GiB avail; 107 MiB/s wr, 1.72k op/s 2024-04-01T19:40:06.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:06 smithi022 ceph-mon[39439]: osdmap e383: 12 total, 12 up, 11 in 2024-04-01T19:40:06.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:06 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1010434472' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:40:06.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:06 smithi022 ceph-mon[39439]: from='client.25903 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:40:06.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:06 smithi062 ceph-mon[44211]: pgmap v1079: 17 pgs: 17 active+clean; 4.8 GiB data, 13 GiB used, 971 GiB / 983 GiB avail; 107 MiB/s wr, 1.72k op/s 2024-04-01T19:40:06.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:06 smithi062 ceph-mon[44211]: osdmap e383: 12 total, 12 up, 11 in 2024-04-01T19:40:06.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:06 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1010434472' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:40:06.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:06 smithi062 ceph-mon[44211]: from='client.25903 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:40:06.628 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 32 16 88731 88715 173.255 112.125 0.00735214 0.00577058 2024-04-01T19:40:07.152 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:40:07.160 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:07.160 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:40:07.261 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:40:07.301 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:07 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:40:07.301 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:07 smithi022 ceph-mon[39439]: from='client.25903 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:40:07.301 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:07 smithi022 ceph-mon[39439]: osdmap e384: 12 total, 12 up, 11 in 2024-04-01T19:40:07.309 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:07.344 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:40:07.351 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:07.351 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:40:07.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:07 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:40:07.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:07 smithi188 ceph-mon[43939]: from='client.25903 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:40:07.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:07 smithi188 ceph-mon[43939]: osdmap e384: 12 total, 12 up, 11 in 2024-04-01T19:40:07.452 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:40:07.483 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:07 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:40:07.483 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:07 smithi062 ceph-mon[44211]: from='client.25903 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:40:07.484 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:07 smithi062 ceph-mon[44211]: osdmap e384: 12 total, 12 up, 11 in 2024-04-01T19:40:07.486 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:07.513 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:40:07.518 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:07.518 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:40:07.619 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:40:07.628 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 33 16 90579 90563 171.505 115.5 0.00902979 0.00582899 2024-04-01T19:40:07.656 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:40:07.687 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:07.757 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:40:07.758 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:40:07.758 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-01T19:40:07.758 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-01T19:40:07.758 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:40:07.971 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:40:07.976 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:07.976 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:40:08.077 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:40:08.138 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:08.141 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.5 to 1 (10000) 2024-04-01T19:40:08.275 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:40:08.282 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:08.283 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:40:08.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:08 smithi022 ceph-mon[39439]: pgmap v1082: 17 pgs: 17 active+clean; 5.2 GiB data, 14 GiB used, 970 GiB / 983 GiB avail; 131 MiB/s wr, 2.10k op/s 2024-04-01T19:40:08.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:08 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:40:08.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:08 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:40:08.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:08 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2236427109' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T19:40:08.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:08 smithi022 ceph-mon[39439]: from='client.25909 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T19:40:08.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:08 smithi188 ceph-mon[43939]: pgmap v1082: 17 pgs: 17 active+clean; 5.2 GiB data, 14 GiB used, 970 GiB / 983 GiB avail; 131 MiB/s wr, 2.10k op/s 2024-04-01T19:40:08.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:08 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:40:08.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:08 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:40:08.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:08 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2236427109' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T19:40:08.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:08 smithi188 ceph-mon[43939]: from='client.25909 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T19:40:08.383 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:40:08.424 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:08 smithi062 ceph-mon[44211]: pgmap v1082: 17 pgs: 17 active+clean; 5.2 GiB data, 14 GiB used, 970 GiB / 983 GiB avail; 131 MiB/s wr, 2.10k op/s 2024-04-01T19:40:08.424 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:08 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:40:08.424 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:08 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:40:08.424 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:08 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2236427109' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T19:40:08.424 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:08 smithi062 ceph-mon[44211]: from='client.25909 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T19:40:08.427 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:08.452 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:40:08.456 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:08.457 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:40:08.508 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_historic_ops 2024-04-01T19:40:08.557 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:40:08.604 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:08.628 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 34 16 92266 92250 169.561 105.438 0.00842199 0.00589611 2024-04-01T19:40:08.638 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:40:08.641 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:08.642 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:40:08.743 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:40:08.777 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:08.807 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:40:08.810 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:08.811 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:40:08.862 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:40:08.912 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:40:08.967 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:09.095 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:40:09.325 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:09 smithi022 ceph-mon[39439]: from='client.25909 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-04-01T19:40:09.325 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:09 smithi022 ceph-mon[39439]: osdmap e385: 12 total, 12 up, 11 in 2024-04-01T19:40:09.334 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:40:09.343 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:09.343 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:40:09.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:09 smithi188 ceph-mon[43939]: from='client.25909 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-04-01T19:40:09.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:09 smithi188 ceph-mon[43939]: osdmap e385: 12 total, 12 up, 11 in 2024-04-01T19:40:09.444 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:40:09.477 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:09 smithi062 ceph-mon[44211]: from='client.25909 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-04-01T19:40:09.477 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:09 smithi062 ceph-mon[44211]: osdmap e385: 12 total, 12 up, 11 in 2024-04-01T19:40:09.481 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:09.515 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:40:09.521 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:09.521 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:40:09.622 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:40:09.628 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 35 16 94003 93987 167.818 108.562 0.00739454 0.00595734 2024-04-01T19:40:09.670 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:10.237 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 7 1 2024-04-01T19:40:10.269 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:10 smithi188 ceph-mon[43939]: pgmap v1084: 17 pgs: 17 active+clean; 5.4 GiB data, 14 GiB used, 970 GiB / 983 GiB avail; 104 MiB/s wr, 1.66k op/s 2024-04-01T19:40:10.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:10 smithi022 ceph-mon[39439]: pgmap v1084: 17 pgs: 17 active+clean; 5.4 GiB data, 14 GiB used, 970 GiB / 983 GiB avail; 104 MiB/s wr, 1.66k op/s 2024-04-01T19:40:10.449 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:40:10.463 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:10.464 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:40:10.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:10 smithi062 ceph-mon[44211]: pgmap v1084: 17 pgs: 17 active+clean; 5.4 GiB data, 14 GiB used, 970 GiB / 983 GiB avail; 104 MiB/s wr, 1.66k op/s 2024-04-01T19:40:10.565 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:40:10.604 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:10.628 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 36 16 95673 95657 166.056 104.375 0.0158396 0.00602062 2024-04-01T19:40:10.743 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:40:10.749 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:10.750 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:40:10.827 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:40:10.837 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:40:10.851 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:40:10.889 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:40:10.901 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:40:10.916 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:10.932 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:40:10.933 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:40:10.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:40:10.933 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:40:10.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.933 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:182926 4.5 4.307d4f85 (undecoded) ondisk+retry+write+known_if_redirected e307)", 2024-04-01T19:40:10.933 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:08.018084+0000", 2024-04-01T19:40:10.933 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 242.914717268, 2024-04-01T19:40:10.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25820638400000001, 2024-04-01T19:40:10.933 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:10.933 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:10.933 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:40:10.934 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:10.934 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:10.934 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:10.934 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 182926 2024-04-01T19:40:10.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.934 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:10.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:10.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018084+0000", 2024-04-01T19:40:10.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:10.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018084+0000", 2024-04-01T19:40:10.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:10.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018087+0000", 2024-04-01T19:40:10.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1489999999999998e-06 2024-04-01T19:40:10.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:10.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018100+0000", 2024-04-01T19:40:10.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3169e-05 2024-04-01T19:40:10.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:10.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018123+0000", 2024-04-01T19:40:10.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3286e-05 2024-04-01T19:40:10.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:10.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018139+0000", 2024-04-01T19:40:10.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5999e-05 2024-04-01T19:40:10.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:10.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018232+0000", 2024-04-01T19:40:10.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2864999999999999e-05 2024-04-01T19:40:10.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:40:10.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018241+0000", 2024-04-01T19:40:10.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8140000000000007e-06 2024-04-01T19:40:10.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:10.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276252+0000", 2024-04-01T19:40:10.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25801112399999998 2024-04-01T19:40:10.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:10.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276290+0000", 2024-04-01T19:40:10.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7978000000000001e-05 2024-04-01T19:40:10.938 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:10.938 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:10.938 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:10.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.938 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:182958 4.5 4.15597fc5 (undecoded) ondisk+retry+write+known_if_redirected e307)", 2024-04-01T19:40:10.938 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:08.018192+0000", 2024-04-01T19:40:10.938 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 242.91460907999999, 2024-04-01T19:40:10.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25822557600000001, 2024-04-01T19:40:10.938 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:10.939 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:10.939 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:40:10.939 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:10.939 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:10.939 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:10.939 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 182958 2024-04-01T19:40:10.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.939 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:10.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:10.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018192+0000", 2024-04-01T19:40:10.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:10.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018192+0000", 2024-04-01T19:40:10.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:10.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018193+0000", 2024-04-01T19:40:10.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1149999999999999e-06 2024-04-01T19:40:10.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:10.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018198+0000", 2024-04-01T19:40:10.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.933e-06 2024-04-01T19:40:10.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:10.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018206+0000", 2024-04-01T19:40:10.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7279999999999995e-06 2024-04-01T19:40:10.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:10.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018212+0000", 2024-04-01T19:40:10.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2650000000000002e-06 2024-04-01T19:40:10.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:10.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018291+0000", 2024-04-01T19:40:10.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9515e-05 2024-04-01T19:40:10.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:40:10.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018302+0000", 2024-04-01T19:40:10.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0200000000000001e-05 2024-04-01T19:40:10.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:10.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276411+0000", 2024-04-01T19:40:10.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25810939799999999 2024-04-01T19:40:10.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:10.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276417+0000", 2024-04-01T19:40:10.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4219999999999997e-06 2024-04-01T19:40:10.943 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:10.943 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:10.943 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:10.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.943 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:182978 4.5 4.6c6e3705 (undecoded) ondisk+retry+write+known_if_redirected e307)", 2024-04-01T19:40:10.943 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:08.018222+0000", 2024-04-01T19:40:10.943 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 242.91457940999999, 2024-04-01T19:40:10.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25823965199999999, 2024-04-01T19:40:10.944 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:10.944 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:10.944 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:40:10.944 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:10.944 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:10.944 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:10.944 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 182978 2024-04-01T19:40:10.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.944 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:10.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:10.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018222+0000", 2024-04-01T19:40:10.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.945 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:10.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018222+0000", 2024-04-01T19:40:10.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.945 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:10.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018222+0000", 2024-04-01T19:40:10.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.51e-07 2024-04-01T19:40:10.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.945 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:10.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018225+0000", 2024-04-01T19:40:10.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2849999999999999e-06 2024-04-01T19:40:10.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:10.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018232+0000", 2024-04-01T19:40:10.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2299999999999996e-06 2024-04-01T19:40:10.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:10.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018238+0000", 2024-04-01T19:40:10.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1639999999999998e-06 2024-04-01T19:40:10.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:10.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018354+0000", 2024-04-01T19:40:10.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011577400000000001 2024-04-01T19:40:10.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:40:10.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018362+0000", 2024-04-01T19:40:10.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8710000000000003e-06 2024-04-01T19:40:10.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:10.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276455+0000", 2024-04-01T19:40:10.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25809243100000001 2024-04-01T19:40:10.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:10.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276461+0000", 2024-04-01T19:40:10.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3459999999999999e-06 2024-04-01T19:40:10.947 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:10.948 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:10.948 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:10.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.948 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:182997 4.5 4.f27b5a65 (undecoded) ondisk+retry+write+known_if_redirected e307)", 2024-04-01T19:40:10.949 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:08.018245+0000", 2024-04-01T19:40:10.949 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 242.91455617099999, 2024-04-01T19:40:10.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25825687400000003, 2024-04-01T19:40:10.949 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:10.949 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:10.949 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:40:10.950 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:10.950 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:10.950 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:10.950 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 182997 2024-04-01T19:40:10.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.950 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:10.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:10.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018245+0000", 2024-04-01T19:40:10.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:10.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018245+0000", 2024-04-01T19:40:10.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:10.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018245+0000", 2024-04-01T19:40:10.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2099999999999996e-07 2024-04-01T19:40:10.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:10.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018248+0000", 2024-04-01T19:40:10.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5040000000000001e-06 2024-04-01T19:40:10.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:10.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018254+0000", 2024-04-01T19:40:10.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6840000000000001e-06 2024-04-01T19:40:10.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:10.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018259+0000", 2024-04-01T19:40:10.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4090000000000002e-06 2024-04-01T19:40:10.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:10.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018398+0000", 2024-04-01T19:40:10.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000138589 2024-04-01T19:40:10.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:40:10.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018405+0000", 2024-04-01T19:40:10.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3010000000000001e-06 2024-04-01T19:40:10.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:10.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276492+0000", 2024-04-01T19:40:10.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25808752400000001 2024-04-01T19:40:10.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:10.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276502+0000", 2024-04-01T19:40:10.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2420000000000006e-06 2024-04-01T19:40:10.956 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:10.956 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:10.956 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:10.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.956 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:183000 4.5 4.4f043115 (undecoded) ondisk+retry+write+known_if_redirected e307)", 2024-04-01T19:40:10.956 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:08.018282+0000", 2024-04-01T19:40:10.956 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 242.91451940499999, 2024-04-01T19:40:10.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25833936800000001, 2024-04-01T19:40:10.956 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:10.956 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:10.957 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:40:10.957 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:10.957 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:10.957 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:10.957 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 183000 2024-04-01T19:40:10.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.957 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:10.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:10.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018282+0000", 2024-04-01T19:40:10.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:10.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018282+0000", 2024-04-01T19:40:10.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:10.958 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018283+0000", 2024-04-01T19:40:10.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.68e-06 2024-04-01T19:40:10.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:10.958 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018289+0000", 2024-04-01T19:40:10.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1809999999999998e-06 2024-04-01T19:40:10.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:10.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018300+0000", 2024-04-01T19:40:10.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0298e-05 2024-04-01T19:40:10.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:10.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018308+0000", 2024-04-01T19:40:10.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1689999999999992e-06 2024-04-01T19:40:10.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:10.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018447+0000", 2024-04-01T19:40:10.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013947100000000001 2024-04-01T19:40:10.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:40:10.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018455+0000", 2024-04-01T19:40:10.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6290000000000001e-06 2024-04-01T19:40:10.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:10.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276616+0000", 2024-04-01T19:40:10.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25816092800000001 2024-04-01T19:40:10.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:10.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276621+0000", 2024-04-01T19:40:10.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0119999999999996e-06 2024-04-01T19:40:10.960 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:10.960 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:10.960 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:10.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.961 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:183006 4.5 4.8f74a225 (undecoded) ondisk+retry+write+known_if_redirected e307)", 2024-04-01T19:40:10.961 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:08.018333+0000", 2024-04-01T19:40:10.961 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 242.91446796700001, 2024-04-01T19:40:10.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25831768599999999, 2024-04-01T19:40:10.961 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:10.961 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:10.961 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:40:10.961 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:10.961 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:10.961 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:10.961 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 183006 2024-04-01T19:40:10.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.961 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:10.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:10.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018333+0000", 2024-04-01T19:40:10.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:10.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018333+0000", 2024-04-01T19:40:10.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:10.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018334+0000", 2024-04-01T19:40:10.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2299999999999999e-07 2024-04-01T19:40:10.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.963 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:10.963 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018337+0000", 2024-04-01T19:40:10.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.551e-06 2024-04-01T19:40:10.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.963 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:10.963 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018350+0000", 2024-04-01T19:40:10.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2736e-05 2024-04-01T19:40:10.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.963 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:10.963 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018356+0000", 2024-04-01T19:40:10.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1199999999999999e-06 2024-04-01T19:40:10.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:10.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018518+0000", 2024-04-01T19:40:10.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000161323 2024-04-01T19:40:10.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:40:10.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018523+0000", 2024-04-01T19:40:10.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0900000000000004e-06 2024-04-01T19:40:10.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:10.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276641+0000", 2024-04-01T19:40:10.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25811862800000002 2024-04-01T19:40:10.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.965 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:10.965 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276651+0000", 2024-04-01T19:40:10.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3149999999999998e-06 2024-04-01T19:40:10.965 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:10.965 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:10.965 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:10.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.965 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:183010 4.5 4.8d559a65 (undecoded) ondisk+retry+write+known_if_redirected e307)", 2024-04-01T19:40:10.965 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:08.018365+0000", 2024-04-01T19:40:10.965 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 242.91443567499999, 2024-04-01T19:40:10.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.258304168, 2024-04-01T19:40:10.965 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:10.965 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:10.965 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:40:10.966 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:10.966 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:10.966 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:10.966 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 183010 2024-04-01T19:40:10.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.966 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:10.966 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:10.966 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018365+0000", 2024-04-01T19:40:10.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.966 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:10.966 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018365+0000", 2024-04-01T19:40:10.967 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.967 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.967 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:10.967 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018366+0000", 2024-04-01T19:40:10.967 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3200000000000004e-07 2024-04-01T19:40:10.967 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.967 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:10.967 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018369+0000", 2024-04-01T19:40:10.967 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.179e-06 2024-04-01T19:40:10.967 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.967 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:10.967 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018375+0000", 2024-04-01T19:40:10.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0109999999999997e-06 2024-04-01T19:40:10.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.968 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:10.968 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018381+0000", 2024-04-01T19:40:10.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2709999999999998e-06 2024-04-01T19:40:10.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.968 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:10.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018539+0000", 2024-04-01T19:40:10.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000157646 2024-04-01T19:40:10.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.969 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:40:10.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018542+0000", 2024-04-01T19:40:10.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3919999999999999e-06 2024-04-01T19:40:10.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.969 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:10.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276665+0000", 2024-04-01T19:40:10.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25812278100000002 2024-04-01T19:40:10.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:10.970 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276669+0000", 2024-04-01T19:40:10.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1559999999999997e-06 2024-04-01T19:40:10.970 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:10.970 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:10.970 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:10.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.970 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:183011 4.5 4.ce6e5d5 (undecoded) ondisk+retry+write+known_if_redirected e307)", 2024-04-01T19:40:10.970 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:08.018388+0000", 2024-04-01T19:40:10.970 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 242.91441323800001, 2024-04-01T19:40:10.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25831146799999999, 2024-04-01T19:40:10.971 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:10.971 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:10.971 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:40:10.971 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:10.971 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:10.971 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:10.971 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 183011 2024-04-01T19:40:10.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.971 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:10.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.971 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:10.971 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018388+0000", 2024-04-01T19:40:10.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.972 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:10.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018388+0000", 2024-04-01T19:40:10.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.972 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:10.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018388+0000", 2024-04-01T19:40:10.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4000000000000001e-07 2024-04-01T19:40:10.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.972 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:10.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018391+0000", 2024-04-01T19:40:10.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3949999999999999e-06 2024-04-01T19:40:10.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.973 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.973 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:10.973 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018396+0000", 2024-04-01T19:40:10.973 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1680000000000003e-06 2024-04-01T19:40:10.973 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.973 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.973 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:10.973 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018401+0000", 2024-04-01T19:40:10.973 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3489999999999999e-06 2024-04-01T19:40:10.973 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.973 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.973 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:10.974 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018557+0000", 2024-04-01T19:40:10.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000155737 2024-04-01T19:40:10.974 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.974 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.974 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:40:10.974 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018561+0000", 2024-04-01T19:40:10.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6619999999999998e-06 2024-04-01T19:40:10.974 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.974 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.974 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:10.974 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276692+0000", 2024-04-01T19:40:10.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25813150299999998 2024-04-01T19:40:10.974 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.974 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.974 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:10.975 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276699+0000", 2024-04-01T19:40:10.975 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0140000000000001e-06 2024-04-01T19:40:10.975 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:10.975 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:10.975 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:10.975 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.975 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.975 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:183017 4.5 4.e681cec5 (undecoded) ondisk+retry+write+known_if_redirected e307)", 2024-04-01T19:40:10.975 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:08.018407+0000", 2024-04-01T19:40:10.975 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 242.91439414499999, 2024-04-01T19:40:10.975 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25830894199999999, 2024-04-01T19:40:10.975 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:10.975 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:10.975 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:40:10.975 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:10.976 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:10.976 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:10.976 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 183017 2024-04-01T19:40:10.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.976 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:10.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.976 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:10.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018407+0000", 2024-04-01T19:40:10.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.976 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:10.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018407+0000", 2024-04-01T19:40:10.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:10.977 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018407+0000", 2024-04-01T19:40:10.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5199999999999997e-07 2024-04-01T19:40:10.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:10.977 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018410+0000", 2024-04-01T19:40:10.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1780000000000002e-06 2024-04-01T19:40:10.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:10.977 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018414+0000", 2024-04-01T19:40:10.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7879999999999997e-06 2024-04-01T19:40:10.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:10.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018419+0000", 2024-04-01T19:40:10.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1710000000000001e-06 2024-04-01T19:40:10.978 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.978 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.978 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:10.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018576+0000", 2024-04-01T19:40:10.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000156909 2024-04-01T19:40:10.978 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.978 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.978 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:40:10.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018580+0000", 2024-04-01T19:40:10.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3170000000000002e-06 2024-04-01T19:40:10.978 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.978 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.978 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:10.979 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276711+0000", 2024-04-01T19:40:10.979 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25813166700000001 2024-04-01T19:40:10.979 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.979 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.979 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:10.979 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276716+0000", 2024-04-01T19:40:10.979 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3599999999999998e-06 2024-04-01T19:40:10.979 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:10.979 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:10.979 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:10.979 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.979 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.979 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:183020 4.5 4.f1f374b5 (undecoded) ondisk+retry+write+known_if_redirected e307)", 2024-04-01T19:40:10.979 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:08.018439+0000", 2024-04-01T19:40:10.979 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 242.91436156699999, 2024-04-01T19:40:10.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25830040300000001, 2024-04-01T19:40:10.980 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:10.980 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:10.980 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:40:10.980 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:10.980 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:10.980 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:10.980 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 183020 2024-04-01T19:40:10.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.980 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:10.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:10.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018439+0000", 2024-04-01T19:40:10.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:10.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018439+0000", 2024-04-01T19:40:10.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:10.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018440+0000", 2024-04-01T19:40:10.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5799999999999999e-07 2024-04-01T19:40:10.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:10.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018455+0000", 2024-04-01T19:40:10.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4803999999999999e-05 2024-04-01T19:40:10.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:10.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018461+0000", 2024-04-01T19:40:10.982 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7919999999999998e-06 2024-04-01T19:40:10.982 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.982 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.982 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:10.982 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018466+0000", 2024-04-01T19:40:10.982 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7660000000000004e-06 2024-04-01T19:40:10.982 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.982 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.982 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:10.982 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018594+0000", 2024-04-01T19:40:10.982 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000127496 2024-04-01T19:40:10.982 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.983 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:40:10.983 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018598+0000", 2024-04-01T19:40:10.983 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7409999999999998e-06 2024-04-01T19:40:10.983 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.983 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:10.983 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276735+0000", 2024-04-01T19:40:10.983 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25813781099999999 2024-04-01T19:40:10.983 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.983 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:10.983 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276740+0000", 2024-04-01T19:40:10.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.335e-06 2024-04-01T19:40:10.984 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:10.984 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:10.984 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:10.984 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.984 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.984 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:183023 4.5 4.22567245 (undecoded) ondisk+retry+write+known_if_redirected e307)", 2024-04-01T19:40:10.984 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:08.018479+0000", 2024-04-01T19:40:10.984 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 242.91432159300001, 2024-04-01T19:40:10.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25828352999999998, 2024-04-01T19:40:10.984 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:10.984 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:10.984 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:40:10.984 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:10.984 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:10.985 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:10.985 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 183023 2024-04-01T19:40:10.985 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.985 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:10.985 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.985 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:10.985 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018479+0000", 2024-04-01T19:40:10.985 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.985 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.985 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.985 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:10.985 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018479+0000", 2024-04-01T19:40:10.985 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.985 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.985 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.985 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:10.986 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018480+0000", 2024-04-01T19:40:10.986 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6300000000000004e-07 2024-04-01T19:40:10.986 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.986 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.986 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:10.986 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018484+0000", 2024-04-01T19:40:10.986 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.811e-06 2024-04-01T19:40:10.986 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.986 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.986 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:10.986 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018490+0000", 2024-04-01T19:40:10.986 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2009999999999996e-06 2024-04-01T19:40:10.987 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.987 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.987 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:10.987 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018496+0000", 2024-04-01T19:40:10.987 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9710000000000001e-06 2024-04-01T19:40:10.987 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.987 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.987 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:10.987 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018613+0000", 2024-04-01T19:40:10.987 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000116505 2024-04-01T19:40:10.987 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.987 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.987 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:40:10.987 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.018616+0000", 2024-04-01T19:40:10.987 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4630000000000001e-06 2024-04-01T19:40:10.988 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.988 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.988 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:10.988 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276759+0000", 2024-04-01T19:40:10.988 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25814283900000001 2024-04-01T19:40:10.988 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.988 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.988 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:10.988 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:08.276763+0000", 2024-04-01T19:40:10.988 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8770000000000003e-06 2024-04-01T19:40:10.988 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:10.988 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:10.988 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:10.988 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.988 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.988 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:281310 4.5 4:ad19ef9e:::benchmark_data_smithi188_104537_object109316:head [delete] snapc 0=[] ondisk+write+known_if_redirected e342)", 2024-04-01T19:40:10.989 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:38:04.642837+0000", 2024-04-01T19:40:10.989 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 126.28996349000001, 2024-04-01T19:40:10.989 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.23518202599999999, 2024-04-01T19:40:10.989 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:10.989 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:10.989 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:10.989 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:10.989 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:10.989 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:10.989 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 281310 2024-04-01T19:40:10.989 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.989 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:10.989 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.989 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:10.989 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.642837+0000", 2024-04-01T19:40:10.989 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.990 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:10.990 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.642837+0000", 2024-04-01T19:40:10.990 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.990 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:10.990 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.642839+0000", 2024-04-01T19:40:10.990 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.372e-06 2024-04-01T19:40:10.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.990 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:10.990 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.642844+0000", 2024-04-01T19:40:10.990 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.091e-06 2024-04-01T19:40:10.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:10.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.642854+0000", 2024-04-01T19:40:10.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.6460000000000005e-06 2024-04-01T19:40:10.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:10.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.642859+0000", 2024-04-01T19:40:10.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8429999999999998e-06 2024-04-01T19:40:10.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:10.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.660551+0000", 2024-04-01T19:40:10.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017691555000000001 2024-04-01T19:40:10.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.992 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.992 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:10.992 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.660661+0000", 2024-04-01T19:40:10.992 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0001099 2024-04-01T19:40:10.992 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.992 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.992 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 6,11", 2024-04-01T19:40:10.992 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.660746+0000", 2024-04-01T19:40:10.992 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5175999999999999e-05 2024-04-01T19:40:10.992 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.992 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.992 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:10.992 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.665379+0000", 2024-04-01T19:40:10.992 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046326240000000001 2024-04-01T19:40:10.992 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.993 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:10.993 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.877752+0000", 2024-04-01T19:40:10.993 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.21237312799999999 2024-04-01T19:40:10.993 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.993 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:10.993 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.877819+0000", 2024-04-01T19:40:10.993 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7340000000000002e-05 2024-04-01T19:40:10.993 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.993 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:10.993 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.877900+0000", 2024-04-01T19:40:10.993 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0542000000000002e-05 2024-04-01T19:40:10.993 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.994 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.994 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:10.994 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.878019+0000", 2024-04-01T19:40:10.994 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119809 2024-04-01T19:40:10.994 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:10.994 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:10.994 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:10.994 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.994 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.994 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:281443 4.5 4:aa94b55b:::benchmark_data_smithi188_104537_object109449:head [delete] snapc 0=[] ondisk+write+known_if_redirected e342)", 2024-04-01T19:40:10.994 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:38:04.905309+0000", 2024-04-01T19:40:10.994 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 126.027491532, 2024-04-01T19:40:10.994 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.33545849599999999, 2024-04-01T19:40:10.994 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:10.994 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:10.994 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:10.995 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:10.995 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:10.995 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:10.995 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 281443 2024-04-01T19:40:10.995 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.995 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:10.995 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.995 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:10.995 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.905309+0000", 2024-04-01T19:40:10.995 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.995 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.995 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.995 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:10.995 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.905309+0000", 2024-04-01T19:40:10.995 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:10.996 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.996 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.996 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:10.996 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.905311+0000", 2024-04-01T19:40:10.996 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9300000000000002e-06 2024-04-01T19:40:10.996 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.996 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.996 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:10.997 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.905321+0000", 2024-04-01T19:40:10.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0091999999999999e-05 2024-04-01T19:40:10.997 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.997 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.997 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:10.997 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.905331+0000", 2024-04-01T19:40:10.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9119999999999993e-06 2024-04-01T19:40:10.997 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.997 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.997 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:10.997 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.905339+0000", 2024-04-01T19:40:10.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7800000000000001e-06 2024-04-01T19:40:10.997 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.998 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:10.998 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.041187+0000", 2024-04-01T19:40:10.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.135847521 2024-04-01T19:40:10.998 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.998 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:10.998 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.041363+0000", 2024-04-01T19:40:10.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000176627 2024-04-01T19:40:10.998 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.998 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 6,11", 2024-04-01T19:40:10.998 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.041524+0000", 2024-04-01T19:40:10.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000160588 2024-04-01T19:40:10.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:10.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.057260+0000", 2024-04-01T19:40:10.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015736387000000001 2024-04-01T19:40:10.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:10.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.057360+0000", 2024-04-01T19:40:10.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9852999999999994e-05 2024-04-01T19:40:10.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:10.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:10.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:10.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.240653+0000", 2024-04-01T19:40:11.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18329307 2024-04-01T19:40:11.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.000 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.000 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:11.000 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.240692+0000", 2024-04-01T19:40:11.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8979000000000001e-05 2024-04-01T19:40:11.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.000 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.000 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:11.000 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.240768+0000", 2024-04-01T19:40:11.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5757e-05 2024-04-01T19:40:11.000 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:11.000 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:11.000 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:11.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.001 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:281448 4.5 4:a0ab512f:::benchmark_data_smithi188_104537_object109454:head [delete] snapc 0=[] ondisk+write+known_if_redirected e342)", 2024-04-01T19:40:11.001 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:38:04.911116+0000", 2024-04-01T19:40:11.001 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 126.021685342, 2024-04-01T19:40:11.001 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.32981671200000001, 2024-04-01T19:40:11.001 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:11.001 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:11.001 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:11.001 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:11.001 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:11.001 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:11.001 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 281448 2024-04-01T19:40:11.001 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.001 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:11.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.001 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:11.002 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.911116+0000", 2024-04-01T19:40:11.002 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:11.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.002 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.002 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:11.002 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.911116+0000", 2024-04-01T19:40:11.002 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:11.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.002 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.002 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:11.002 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.911117+0000", 2024-04-01T19:40:11.002 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5099999999999999e-06 2024-04-01T19:40:11.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.002 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.002 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:11.002 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.911122+0000", 2024-04-01T19:40:11.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3720000000000004e-06 2024-04-01T19:40:11.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.003 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.003 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:11.003 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.911133+0000", 2024-04-01T19:40:11.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0934000000000001e-05 2024-04-01T19:40:11.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.003 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.003 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:11.003 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.911140+0000", 2024-04-01T19:40:11.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3040000000000001e-06 2024-04-01T19:40:11.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.003 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.003 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:11.003 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.047213+0000", 2024-04-01T19:40:11.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13607369 2024-04-01T19:40:11.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.004 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:11.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.047378+0000", 2024-04-01T19:40:11.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016510299999999999 2024-04-01T19:40:11.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.004 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 6,11", 2024-04-01T19:40:11.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.047538+0000", 2024-04-01T19:40:11.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000159028 2024-04-01T19:40:11.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.004 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:11.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.057309+0000", 2024-04-01T19:40:11.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.009771287 2024-04-01T19:40:11.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:11.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.240778+0000", 2024-04-01T19:40:11.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18346937899999999 2024-04-01T19:40:11.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:11.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.240830+0000", 2024-04-01T19:40:11.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1746999999999998e-05 2024-04-01T19:40:11.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:11.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.240865+0000", 2024-04-01T19:40:11.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4841000000000001e-05 2024-04-01T19:40:11.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.006 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:11.006 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.240932+0000", 2024-04-01T19:40:11.006 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7516999999999997e-05 2024-04-01T19:40:11.006 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:11.006 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:11.006 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:11.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.006 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.006 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:281451 4.5 4:a258960f:::benchmark_data_smithi188_104537_object109457:head [delete] snapc 0=[] ondisk+write+known_if_redirected e342)", 2024-04-01T19:40:11.006 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:38:04.912698+0000", 2024-04-01T19:40:11.006 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 126.020102689, 2024-04-01T19:40:11.006 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.32849012900000002, 2024-04-01T19:40:11.006 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:11.006 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:11.007 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:11.007 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:11.007 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:11.007 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:11.007 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 281451 2024-04-01T19:40:11.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.007 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:11.007 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.007 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:11.007 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.912698+0000", 2024-04-01T19:40:11.007 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:11.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.007 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.007 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:11.007 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.912698+0000", 2024-04-01T19:40:11.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:11.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.008 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:11.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.912700+0000", 2024-04-01T19:40:11.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4219999999999999e-06 2024-04-01T19:40:11.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.008 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:11.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.912705+0000", 2024-04-01T19:40:11.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.899e-06 2024-04-01T19:40:11.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.008 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:11.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.912715+0000", 2024-04-01T19:40:11.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0745e-05 2024-04-01T19:40:11.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.009 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:11.009 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.912724+0000", 2024-04-01T19:40:11.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3319999999999992e-06 2024-04-01T19:40:11.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.009 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:11.009 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.052879+0000", 2024-04-01T19:40:11.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14015583500000001 2024-04-01T19:40:11.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.009 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:11.009 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.053038+0000", 2024-04-01T19:40:11.010 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015863100000000001 2024-04-01T19:40:11.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 6,11", 2024-04-01T19:40:11.010 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.053147+0000", 2024-04-01T19:40:11.010 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108712 2024-04-01T19:40:11.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:11.010 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.240589+0000", 2024-04-01T19:40:11.010 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18744208900000001 2024-04-01T19:40:11.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:11.011 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.240995+0000", 2024-04-01T19:40:11.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00040601100000000001 2024-04-01T19:40:11.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.011 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:11.011 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.241013+0000", 2024-04-01T19:40:11.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7852000000000001e-05 2024-04-01T19:40:11.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.011 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:11.011 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.241072+0000", 2024-04-01T19:40:11.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8820000000000003e-05 2024-04-01T19:40:11.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.012 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.012 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:11.012 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.241188+0000", 2024-04-01T19:40:11.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011678100000000001 2024-04-01T19:40:11.012 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:11.012 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:11.012 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:11.012 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.012 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.012 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:281459 4.5 4:a18d9226:::benchmark_data_smithi188_104537_object109465:head [delete] snapc 0=[] ondisk+write+known_if_redirected e342)", 2024-04-01T19:40:11.012 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:38:04.926917+0000", 2024-04-01T19:40:11.012 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 126.005884063, 2024-04-01T19:40:11.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.31441828700000002, 2024-04-01T19:40:11.012 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:11.012 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 281459 2024-04-01T19:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.926917+0000", 2024-04-01T19:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.926917+0000", 2024-04-01T19:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.926919+0000", 2024-04-01T19:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0159999999999998e-06 2024-04-01T19:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.926924+0000", 2024-04-01T19:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4949999999999999e-06 2024-04-01T19:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.926935+0000", 2024-04-01T19:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0353999999999999e-05 2024-04-01T19:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:04.926941+0000", 2024-04-01T19:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3260000000000001e-06 2024-04-01T19:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.057392+0000", 2024-04-01T19:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13045077699999999 2024-04-01T19:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.016 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.016 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:11.016 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.057543+0000", 2024-04-01T19:40:11.016 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015160099999999999 2024-04-01T19:40:11.016 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.016 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.016 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 6,11", 2024-04-01T19:40:11.016 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.057677+0000", 2024-04-01T19:40:11.016 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000133867 2024-04-01T19:40:11.016 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.016 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.016 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:11.016 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.240641+0000", 2024-04-01T19:40:11.016 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18296353100000001 2024-04-01T19:40:11.017 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.017 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.017 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:11.017 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.241198+0000", 2024-04-01T19:40:11.017 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00055705499999999999 2024-04-01T19:40:11.017 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.017 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.017 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:11.017 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.241240+0000", 2024-04-01T19:40:11.017 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2160000000000003e-05 2024-04-01T19:40:11.017 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.017 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.017 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:11.017 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.241274+0000", 2024-04-01T19:40:11.018 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4453999999999999e-05 2024-04-01T19:40:11.018 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.018 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.018 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:11.018 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.241335+0000", 2024-04-01T19:40:11.018 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0650999999999999e-05 2024-04-01T19:40:11.018 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:11.018 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:11.018 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:11.018 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.018 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.018 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:281676 4.5 4:a2c733cb:::benchmark_data_smithi188_104537_object109682:head [delete] snapc 0=[] ondisk+write+known_if_redirected e343)", 2024-04-01T19:40:11.018 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:38:05.303895+0000", 2024-04-01T19:40:11.018 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 125.62890580200001, 2024-04-01T19:40:11.019 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.28363212500000001, 2024-04-01T19:40:11.019 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:11.019 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:11.019 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:11.019 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:11.019 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:11.019 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:11.019 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 281676 2024-04-01T19:40:11.019 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.019 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:11.019 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.019 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:11.019 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.303895+0000", 2024-04-01T19:40:11.019 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:11.019 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.019 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.020 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:11.020 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.303895+0000", 2024-04-01T19:40:11.020 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:11.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.020 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.020 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:11.020 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.303897+0000", 2024-04-01T19:40:11.020 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7799999999999999e-06 2024-04-01T19:40:11.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.020 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.020 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:11.020 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.303902+0000", 2024-04-01T19:40:11.020 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3589999999999999e-06 2024-04-01T19:40:11.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.020 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.020 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:11.021 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.303913+0000", 2024-04-01T19:40:11.021 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0851e-05 2024-04-01T19:40:11.021 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.021 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.021 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:11.021 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.303919+0000", 2024-04-01T19:40:11.021 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2870000000000001e-06 2024-04-01T19:40:11.021 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.021 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.021 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:11.021 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.468722+0000", 2024-04-01T19:40:11.021 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16480286 2024-04-01T19:40:11.021 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.021 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.021 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:11.021 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.468804+0000", 2024-04-01T19:40:11.022 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1434000000000007e-05 2024-04-01T19:40:11.022 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.022 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.022 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 6,11", 2024-04-01T19:40:11.022 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.468884+0000", 2024-04-01T19:40:11.022 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0073000000000004e-05 2024-04-01T19:40:11.022 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.022 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.022 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:11.022 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.587311+0000", 2024-04-01T19:40:11.022 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.11842702500000001 2024-04-01T19:40:11.022 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.022 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.022 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:11.023 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.587374+0000", 2024-04-01T19:40:11.023 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3527000000000003e-05 2024-04-01T19:40:11.023 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.023 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.023 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:11.023 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.587414+0000", 2024-04-01T19:40:11.023 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9578e-05 2024-04-01T19:40:11.023 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.023 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.023 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:11.023 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.587456+0000", 2024-04-01T19:40:11.023 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1990000000000003e-05 2024-04-01T19:40:11.023 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.023 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.023 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:11.024 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.587527+0000", 2024-04-01T19:40:11.024 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1360999999999997e-05 2024-04-01T19:40:11.024 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:11.024 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:11.024 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:11.024 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.024 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.024 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:281686 4.5 4:acb3c631:::benchmark_data_smithi188_104537_object109692:head [delete] snapc 0=[] ondisk+write+known_if_redirected e343)", 2024-04-01T19:40:11.024 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:38:05.320651+0000", 2024-04-01T19:40:11.024 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 125.612150414, 2024-04-01T19:40:11.024 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.26705694600000002, 2024-04-01T19:40:11.024 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:11.024 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:11.024 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:11.024 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:11.024 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:11.025 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:11.025 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 281686 2024-04-01T19:40:11.025 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.025 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:11.025 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.025 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:11.025 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.320651+0000", 2024-04-01T19:40:11.025 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:11.025 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.025 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.025 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:11.025 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.320651+0000", 2024-04-01T19:40:11.025 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:11.025 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.025 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.026 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:11.026 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.320653+0000", 2024-04-01T19:40:11.026 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2819999999999999e-06 2024-04-01T19:40:11.026 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.026 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.026 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:11.026 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.320659+0000", 2024-04-01T19:40:11.026 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.801e-06 2024-04-01T19:40:11.026 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.026 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.026 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:11.026 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.320684+0000", 2024-04-01T19:40:11.026 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5425000000000001e-05 2024-04-01T19:40:11.027 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.027 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.027 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:11.027 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.320692+0000", 2024-04-01T19:40:11.027 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6429999999999995e-06 2024-04-01T19:40:11.027 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.027 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.027 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:11.027 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.472676+0000", 2024-04-01T19:40:11.027 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.15198444799999999 2024-04-01T19:40:11.027 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.028 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.028 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:11.028 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.472782+0000", 2024-04-01T19:40:11.028 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010563799999999999 2024-04-01T19:40:11.028 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.028 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.028 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 6,11", 2024-04-01T19:40:11.028 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.472871+0000", 2024-04-01T19:40:11.028 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9582999999999999e-05 2024-04-01T19:40:11.028 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.028 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.028 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:11.029 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.587362+0000", 2024-04-01T19:40:11.029 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.11449060699999999 2024-04-01T19:40:11.029 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.029 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.029 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:11.029 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.587382+0000", 2024-04-01T19:40:11.029 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9732e-05 2024-04-01T19:40:11.029 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.029 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.029 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:11.029 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.587568+0000", 2024-04-01T19:40:11.029 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018682799999999999 2024-04-01T19:40:11.029 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.029 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.029 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:11.029 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.587617+0000", 2024-04-01T19:40:11.030 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8337000000000002e-05 2024-04-01T19:40:11.030 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.030 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.030 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:11.030 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.587707+0000", 2024-04-01T19:40:11.030 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0622000000000001e-05 2024-04-01T19:40:11.030 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:11.030 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:11.030 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:11.030 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.030 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.030 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:281761 4.5 4:ac327aaa:::benchmark_data_smithi188_104537_object109767:head [delete] snapc 0=[] ondisk+write+known_if_redirected e343)", 2024-04-01T19:40:11.030 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:38:05.607456+0000", 2024-04-01T19:40:11.030 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 125.325344703, 2024-04-01T19:40:11.030 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.30897571099999999, 2024-04-01T19:40:11.030 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:11.031 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:11.031 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:11.031 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:11.031 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:11.031 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:11.031 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 281761 2024-04-01T19:40:11.031 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.031 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:11.031 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.031 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:11.031 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.607456+0000", 2024-04-01T19:40:11.031 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:11.031 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.031 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.031 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:11.032 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.607456+0000", 2024-04-01T19:40:11.032 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:11.032 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.032 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.032 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:11.032 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.607458+0000", 2024-04-01T19:40:11.032 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6810000000000001e-06 2024-04-01T19:40:11.032 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.032 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.033 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:11.033 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.607463+0000", 2024-04-01T19:40:11.033 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3890000000000004e-06 2024-04-01T19:40:11.033 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.033 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.033 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:11.033 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.607475+0000", 2024-04-01T19:40:11.033 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1514e-05 2024-04-01T19:40:11.033 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.033 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.033 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:11.033 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.607483+0000", 2024-04-01T19:40:11.033 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8089999999999993e-06 2024-04-01T19:40:11.033 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.033 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.033 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:11.034 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.772714+0000", 2024-04-01T19:40:11.034 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16523169300000001 2024-04-01T19:40:11.034 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.034 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.034 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:11.034 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.772803+0000", 2024-04-01T19:40:11.034 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8603000000000005e-05 2024-04-01T19:40:11.034 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.034 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.034 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 6,11", 2024-04-01T19:40:11.034 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.772887+0000", 2024-04-01T19:40:11.034 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3749000000000001e-05 2024-04-01T19:40:11.034 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.034 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.034 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:11.035 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.916253+0000", 2024-04-01T19:40:11.035 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14336639700000001 2024-04-01T19:40:11.035 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.035 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.035 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:11.035 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.916268+0000", 2024-04-01T19:40:11.035 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4752e-05 2024-04-01T19:40:11.035 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.035 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.035 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:11.035 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.916304+0000", 2024-04-01T19:40:11.035 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840999999999998e-05 2024-04-01T19:40:11.035 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.035 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.035 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:11.035 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.916351+0000", 2024-04-01T19:40:11.036 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7660000000000001e-05 2024-04-01T19:40:11.036 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.036 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.036 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:11.036 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.916432+0000", 2024-04-01T19:40:11.036 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0623000000000004e-05 2024-04-01T19:40:11.036 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:11.036 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:11.036 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:11.036 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.036 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.036 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:281770 4.5 4:a1d18bc8:::benchmark_data_smithi188_104537_object109776:head [delete] snapc 0=[] ondisk+write+known_if_redirected e343)", 2024-04-01T19:40:11.036 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:38:05.804976+0000", 2024-04-01T19:40:11.036 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 125.12782530200001, 2024-04-01T19:40:11.036 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.255068454, 2024-04-01T19:40:11.037 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:11.037 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:11.037 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:11.037 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:11.037 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:11.037 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:11.037 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 281770 2024-04-01T19:40:11.037 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.037 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:11.037 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.037 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:11.037 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.804976+0000", 2024-04-01T19:40:11.037 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:11.037 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.037 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.038 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:11.038 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.804976+0000", 2024-04-01T19:40:11.038 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:11.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.038 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.038 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:11.038 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.804978+0000", 2024-04-01T19:40:11.038 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7439999999999999e-06 2024-04-01T19:40:11.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.038 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.038 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:11.038 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.804986+0000", 2024-04-01T19:40:11.038 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9070000000000007e-06 2024-04-01T19:40:11.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.038 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.039 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:11.039 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.804997+0000", 2024-04-01T19:40:11.039 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1124999999999999e-05 2024-04-01T19:40:11.039 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.039 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.039 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:11.039 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.805005+0000", 2024-04-01T19:40:11.039 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6450000000000005e-06 2024-04-01T19:40:11.039 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.039 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.039 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:11.039 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.916734+0000", 2024-04-01T19:40:11.039 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.11172942 2024-04-01T19:40:11.039 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.039 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.039 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:11.040 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.916810+0000", 2024-04-01T19:40:11.040 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5327999999999994e-05 2024-04-01T19:40:11.040 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.040 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.040 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 6,11", 2024-04-01T19:40:11.040 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:05.916899+0000", 2024-04-01T19:40:11.040 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8926999999999997e-05 2024-04-01T19:40:11.040 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.040 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.040 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:11.040 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:06.059872+0000", 2024-04-01T19:40:11.040 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.142973515 2024-04-01T19:40:11.040 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.040 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.040 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:11.040 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:06.059922+0000", 2024-04-01T19:40:11.041 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9734999999999997e-05 2024-04-01T19:40:11.041 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.041 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.041 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:11.041 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:06.059934+0000", 2024-04-01T19:40:11.041 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1848000000000001e-05 2024-04-01T19:40:11.041 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.041 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.041 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:11.041 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:06.059969+0000", 2024-04-01T19:40:11.041 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5302000000000002e-05 2024-04-01T19:40:11.041 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:11.041 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:11.041 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:11.041 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:06.060044+0000", 2024-04-01T19:40:11.041 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4957999999999996e-05 2024-04-01T19:40:11.041 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:11.042 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:11.042 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:11.042 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:11.042 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:11.042 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:40:11.042 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:40:11.043 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:40:11.043 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:40:11.064 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:40:11.096 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:40:11.140 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:40:11.143 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:11.144 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:40:11.144 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:40:11.199 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:40:11.245 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:40:11.246 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:40:11.271 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:40:11.275 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:11.306 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:40:11.311 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:11.311 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:40:11.316 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:40:11.329 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:40:11.329 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:40:11.329 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:40:11.329 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:40:11.329 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:40:11.330 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:40:11.330 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:40:11.330 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:40:11.330 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:40:11.330 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:40:11.330 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:40:11.330 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:40:11.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:11 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1725808234' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:40:11.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:11.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:11.412 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:40:11.449 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:11.465 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:11 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1725808234' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:40:11.466 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:11.466 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:11.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:11 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1725808234' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:40:11.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:11.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:11.628 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 37 16 97231 97215 164.199 97.375 0.012377 0.00608862 2024-04-01T19:40:11.700 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:40:11.707 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:11.708 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:40:11.732 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_ops_in_flight 2024-04-01T19:40:11.809 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:40:11.853 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:11.994 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:40:12.004 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:12.004 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:40:12.106 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:40:12.113 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:40:12.142 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:12.170 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:40:12.174 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:12.175 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:40:12.276 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:40:12.316 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:12.353 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:40:12.356 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:12.356 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:40:12.406 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:12 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:40:12.407 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:12 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:40:12.407 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.407 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:12 smithi188 ceph-mon[43939]: pgmap v1085: 17 pgs: 17 active+clean; 5.6 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 137 MiB/s wr, 2.20k op/s 2024-04-01T19:40:12.407 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.407 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.407 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.407 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.407 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.407 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:12 smithi188 ceph-mon[43939]: osdmap e386: 12 total, 12 up, 11 in 2024-04-01T19:40:12.407 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.407 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.407 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.407 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:12 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:40:12.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:12 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:40:12.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:12 smithi022 ceph-mon[39439]: pgmap v1085: 17 pgs: 17 active+clean; 5.6 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 137 MiB/s wr, 2.20k op/s 2024-04-01T19:40:12.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:12 smithi022 ceph-mon[39439]: osdmap e386: 12 total, 12 up, 11 in 2024-04-01T19:40:12.451 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.451 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.451 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.451 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.457 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:40:12.491 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:12.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:12 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:40:12.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:12 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:40:12.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:12 smithi062 ceph-mon[44211]: pgmap v1085: 17 pgs: 17 active+clean; 5.6 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 137 MiB/s wr, 2.20k op/s 2024-04-01T19:40:12.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:12 smithi062 ceph-mon[44211]: osdmap e386: 12 total, 12 up, 11 in 2024-04-01T19:40:12.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:12.592 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:40:12.595 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:12.596 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:40:12.628 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 38 16 98970 98954 162.738 108.688 0.00503408 0.00614354 2024-04-01T19:40:12.697 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:40:12.732 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:12.765 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:40:12.774 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:12.775 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:40:12.876 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:40:12.908 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:13.009 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:40:13.013 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:13.013 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:40:13.114 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:40:13.149 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:13.500 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:40:13.509 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:13.509 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:40:13.611 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:40:13.629 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 39 16 100720 100704 161.37 109.375 0.00905998 0.00619557 2024-04-01T19:40:13.645 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:13.851 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:40:13.857 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:13.857 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:40:13.958 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:40:14.021 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:14.054 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:40:14.059 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:14.060 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:40:14.161 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:40:14.170 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:40:14.171 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:40:14.200 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:14.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:14 smithi022 ceph-mon[39439]: pgmap v1087: 17 pgs: 17 active+clean; 5.8 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 106 MiB/s wr, 1.70k op/s 2024-04-01T19:40:14.451 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:40:14.453 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:14 smithi188 ceph-mon[43939]: pgmap v1087: 17 pgs: 17 active+clean; 5.8 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 106 MiB/s wr, 1.70k op/s 2024-04-01T19:40:14.454 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:14.454 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:40:14.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:14 smithi062 ceph-mon[44211]: pgmap v1087: 17 pgs: 17 active+clean; 5.8 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 106 MiB/s wr, 1.70k op/s 2024-04-01T19:40:14.555 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:40:14.622 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:14.628 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:40:14.632043 min lat: 0.00113025 max lat: 0.209539 avg lat: 0.00625216 2024-04-01T19:40:14.629 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:40:14.629 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 40 15 102355 102340 159.892 102.25 0.00837076 0.00625216 2024-04-01T19:40:14.741 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:40:14.747 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:14.748 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:40:14.849 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:40:14.887 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:14.915 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:40:14.917 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:14.918 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:40:14.988 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_blocked_ops 2024-04-01T19:40:15.019 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:40:15.065 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:15.088 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:40:15.091 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:15.092 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:40:15.117 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:40:15.193 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:40:15.231 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:15.260 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:40:15.262 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:15.263 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:40:15.339 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:40:15.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:15 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/770896775' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:40:15.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:15 smithi022 ceph-mon[39439]: from='client.36032 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:40:15.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:15 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:40:15.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:15 smithi022 ceph-mon[39439]: from='client.36032 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:40:15.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:15 smithi022 ceph-mon[39439]: osdmap e387: 12 total, 12 up, 11 in 2024-04-01T19:40:15.364 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:40:15.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:15 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/770896775' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:40:15.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:15 smithi188 ceph-mon[43939]: from='client.36032 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:40:15.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:15 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:40:15.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:15 smithi188 ceph-mon[43939]: from='client.36032 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:40:15.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:15 smithi188 ceph-mon[43939]: osdmap e387: 12 total, 12 up, 11 in 2024-04-01T19:40:15.424 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:15.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:15 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/770896775' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:40:15.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:15 smithi062 ceph-mon[44211]: from='client.36032 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:40:15.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:15 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:40:15.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:15 smithi062 ceph-mon[44211]: from='client.36032 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:40:15.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:15 smithi062 ceph-mon[44211]: osdmap e387: 12 total, 12 up, 11 in 2024-04-01T19:40:15.629 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 41 16 103989 103973 158.48 102.062 0.00705766 0.0063088 2024-04-01T19:40:15.955 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:40:16.206 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.7 to 1 (10000) 2024-04-01T19:40:16.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:16 smithi022 ceph-mon[39439]: pgmap v1088: 17 pgs: 17 active+clean; 5.9 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 85 MiB/s wr, 1.36k op/s 2024-04-01T19:40:16.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:16 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2145717223' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T19:40:16.479 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:16 smithi188 ceph-mon[43939]: pgmap v1088: 17 pgs: 17 active+clean; 5.9 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 85 MiB/s wr, 1.36k op/s 2024-04-01T19:40:16.479 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:16 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2145717223' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T19:40:16.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:16 smithi062 ceph-mon[44211]: pgmap v1088: 17 pgs: 17 active+clean; 5.9 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 85 MiB/s wr, 1.36k op/s 2024-04-01T19:40:16.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:16 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2145717223' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T19:40:16.629 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 42 16 105552 105536 157.033 97.6875 0.00978541 0.00636652 2024-04-01T19:40:17.082 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 9 1 2024-04-01T19:40:17.221 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:40:17.236 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:17.236 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:40:17.251 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:40:17.337 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:40:17.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:17 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2145717223' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-04-01T19:40:17.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:17 smithi022 ceph-mon[39439]: osdmap e388: 12 total, 12 up, 11 in 2024-04-01T19:40:17.380 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:17.405 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:40:17.410 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:17.410 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:40:17.495 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:40:17.495 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:40:17.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:17 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2145717223' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-04-01T19:40:17.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:17 smithi062 ceph-mon[44211]: osdmap e388: 12 total, 12 up, 11 in 2024-04-01T19:40:17.512 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:40:17.516 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:17 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2145717223' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-04-01T19:40:17.516 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:17 smithi188 ceph-mon[43939]: osdmap e388: 12 total, 12 up, 11 in 2024-04-01T19:40:17.552 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:17.582 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:40:17.585 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:17.585 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:40:17.629 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 43 16 107109 107093 155.644 97.3125 0.00900991 0.00642293 2024-04-01T19:40:17.686 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:40:17.728 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:17.765 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:40:17.768 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:17.768 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:40:17.869 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:40:17.903 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:18.255 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:40:18.259 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:18.259 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:40:18.289 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_historic_ops 2024-04-01T19:40:18.360 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:40:18.414 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:18.443 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:40:18.453 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:18.453 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:40:18.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:18 smithi062 ceph-mon[44211]: pgmap v1091: 17 pgs: 17 active+clean; 6.3 GiB data, 16 GiB used, 968 GiB / 983 GiB avail; 115 MiB/s wr, 1.84k op/s 2024-04-01T19:40:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:18 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:40:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:18 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:40:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:18 smithi062 ceph-mon[44211]: osdmap e389: 12 total, 12 up, 11 in 2024-04-01T19:40:18.554 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:40:18.591 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:18 smithi022 ceph-mon[39439]: pgmap v1091: 17 pgs: 17 active+clean; 6.3 GiB data, 16 GiB used, 968 GiB / 983 GiB avail; 115 MiB/s wr, 1.84k op/s 2024-04-01T19:40:18.591 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:18 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:40:18.591 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:18 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:40:18.591 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:18 smithi022 ceph-mon[39439]: osdmap e389: 12 total, 12 up, 11 in 2024-04-01T19:40:18.601 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:18.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:18 smithi188 ceph-mon[43939]: pgmap v1091: 17 pgs: 17 active+clean; 6.3 GiB data, 16 GiB used, 968 GiB / 983 GiB avail; 115 MiB/s wr, 1.84k op/s 2024-04-01T19:40:18.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:18 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:40:18.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:18 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:40:18.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:18 smithi188 ceph-mon[43939]: osdmap e389: 12 total, 12 up, 11 in 2024-04-01T19:40:18.632 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 44 16 108733 108717 154.403 101.5 0.00353506 0.00647511 2024-04-01T19:40:18.678 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:40:18.724 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:40:18.738 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:40:18.742 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:18.743 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:40:18.844 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:40:18.903 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:19.063 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:40:19.069 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:19.070 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:40:19.170 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:40:19.220 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:19.251 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:40:19.269 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:40:19.277 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:19.277 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:40:19.378 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:40:19.431 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:19.519 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:40:19.532 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:19.533 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:40:19.632 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 45 16 110117 110101 152.894 86.5 0.00848366 0.00653908 2024-04-01T19:40:19.634 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:40:19.669 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:19.700 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:40:19.708 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:19.709 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:40:19.809 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:40:19.842 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:19.867 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:40:19.873 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:19.873 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:40:19.974 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:40:19.985 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:40:19.985 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:40:19.985 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:40:19.985 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:40:19.985 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:40:19.985 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:40:19.985 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:40:19.985 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:40:19.993 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:40:20.007 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:20.029 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:40:20.061 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:40:20.097 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:40:20.123 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:40:20.123 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:40:20.123 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:40:20.123 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:40:20.123 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:40:20.123 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:40:20.123 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:40:20.123 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:40:20.124 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:40:20.124 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:40:20.124 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:40:20.124 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:40:20.259 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:40:20.266 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:20.266 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:40:20.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:20 smithi022 ceph-mon[39439]: pgmap v1093: 17 pgs: 17 active+clean; 6.4 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 92 MiB/s wr, 1.47k op/s 2024-04-01T19:40:20.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:20 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3816298917' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:40:20.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:20.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:20.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:20.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:20.368 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:40:20.412 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:20.446 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:40:20.452 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:20.452 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:40:20.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:20 smithi062 ceph-mon[44211]: pgmap v1093: 17 pgs: 17 active+clean; 6.4 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 92 MiB/s wr, 1.47k op/s 2024-04-01T19:40:20.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:20 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3816298917' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:40:20.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:20.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:20.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:20.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:20.537 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:20 smithi188 ceph-mon[43939]: pgmap v1093: 17 pgs: 17 active+clean; 6.4 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 92 MiB/s wr, 1.47k op/s 2024-04-01T19:40:20.537 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:20 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3816298917' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:40:20.537 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:20.537 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:20.537 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:20.537 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:20.552 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:40:20.609 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:20.632 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 46 16 111638 111622 151.637 95.0625 0.00732962 0.00659323 2024-04-01T19:40:20.731 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:40:20.742 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:20.743 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:40:20.844 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:40:20.852 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:40:20.852 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:40:20.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:40:20.852 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:40:20.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.852 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:207666 4.1 4:8fd59321:::benchmark_data_smithi188_104537_object35672:head [delete] snapc 0=[] ondisk+write+known_if_redirected e319)", 2024-04-01T19:40:20.853 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:49.304960+0000", 2024-04-01T19:40:20.853 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 211.54671642900001, 2024-04-01T19:40:20.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18102294299999999, 2024-04-01T19:40:20.853 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:20.853 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:20.853 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:20.853 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:20.853 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:20.853 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:20.853 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 207666 2024-04-01T19:40:20.853 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.853 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:20.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.853 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:20.853 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.304960+0000", 2024-04-01T19:40:20.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.854 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.854 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.854 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:20.854 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.304960+0000", 2024-04-01T19:40:20.854 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.854 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.854 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.854 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:20.854 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.304961+0000", 2024-04-01T19:40:20.854 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3149999999999999e-06 2024-04-01T19:40:20.854 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.854 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.854 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:20.854 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.304966+0000", 2024-04-01T19:40:20.854 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2849999999999996e-06 2024-04-01T19:40:20.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:20.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.304974+0000", 2024-04-01T19:40:20.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3690000000000007e-06 2024-04-01T19:40:20.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:20.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.304982+0000", 2024-04-01T19:40:20.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6580000000000002e-06 2024-04-01T19:40:20.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:20.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.333648+0000", 2024-04-01T19:40:20.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028666476999999999 2024-04-01T19:40:20.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.856 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:20.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.333765+0000", 2024-04-01T19:40:20.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000116638 2024-04-01T19:40:20.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.856 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 5", 2024-04-01T19:40:20.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.333878+0000", 2024-04-01T19:40:20.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000113564 2024-04-01T19:40:20.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.856 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:20.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.339669+0000", 2024-04-01T19:40:20.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00579029 2024-04-01T19:40:20.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:20.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.485869+0000", 2024-04-01T19:40:20.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14619980399999999 2024-04-01T19:40:20.857 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:20.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.485909+0000", 2024-04-01T19:40:20.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0120000000000002e-05 2024-04-01T19:40:20.857 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:20.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.485983+0000", 2024-04-01T19:40:20.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4423000000000002e-05 2024-04-01T19:40:20.857 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.858 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:20.858 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.858 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:207766 4.1 4:8294c602:::benchmark_data_smithi188_104537_object35772:head [delete] snapc 0=[] ondisk+write+known_if_redirected e320)", 2024-04-01T19:40:20.858 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:49.522712+0000", 2024-04-01T19:40:20.858 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 211.328964278, 2024-04-01T19:40:20.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18247834199999999, 2024-04-01T19:40:20.858 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:20.858 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:20.858 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:20.858 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:20.858 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:20.858 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:20.859 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 207766 2024-04-01T19:40:20.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.859 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:20.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:20.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.522712+0000", 2024-04-01T19:40:20.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:20.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.522712+0000", 2024-04-01T19:40:20.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:20.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.522717+0000", 2024-04-01T19:40:20.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3490000000000002e-06 2024-04-01T19:40:20.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.860 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:20.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.522724+0000", 2024-04-01T19:40:20.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9349999999999997e-06 2024-04-01T19:40:20.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.860 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:20.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.522736+0000", 2024-04-01T19:40:20.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2381000000000001e-05 2024-04-01T19:40:20.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.860 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:20.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.522745+0000", 2024-04-01T19:40:20.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8769999999999999e-06 2024-04-01T19:40:20.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:20.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.525443+0000", 2024-04-01T19:40:20.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0026986639999999999 2024-04-01T19:40:20.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:20.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.525587+0000", 2024-04-01T19:40:20.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014398300000000001 2024-04-01T19:40:20.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 5", 2024-04-01T19:40:20.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.525730+0000", 2024-04-01T19:40:20.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014288699999999999 2024-04-01T19:40:20.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:20.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.531284+0000", 2024-04-01T19:40:20.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0055541399999999999 2024-04-01T19:40:20.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:20.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.705065+0000", 2024-04-01T19:40:20.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.173780979 2024-04-01T19:40:20.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:20.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.705122+0000", 2024-04-01T19:40:20.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6678000000000002e-05 2024-04-01T19:40:20.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:20.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.705191+0000", 2024-04-01T19:40:20.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8468999999999998e-05 2024-04-01T19:40:20.863 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.863 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:20.863 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.863 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:208038 4.1 4:8ba2b583:::benchmark_data_smithi188_104537_object36044:head [delete] snapc 0=[] ondisk+write+known_if_redirected e320)", 2024-04-01T19:40:20.863 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:50.042530+0000", 2024-04-01T19:40:20.863 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 210.809146309, 2024-04-01T19:40:20.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.27495873399999998, 2024-04-01T19:40:20.863 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:20.863 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:20.864 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:20.864 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:20.864 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:20.864 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:20.864 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 208038 2024-04-01T19:40:20.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.864 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:20.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:20.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.042530+0000", 2024-04-01T19:40:20.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:20.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.042530+0000", 2024-04-01T19:40:20.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:20.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.042532+0000", 2024-04-01T19:40:20.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.902e-06 2024-04-01T19:40:20.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:20.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.042537+0000", 2024-04-01T19:40:20.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4209999999999997e-06 2024-04-01T19:40:20.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:20.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.042546+0000", 2024-04-01T19:40:20.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9940000000000006e-06 2024-04-01T19:40:20.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:20.866 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.042551+0000", 2024-04-01T19:40:20.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6570000000000002e-06 2024-04-01T19:40:20.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:20.866 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.132615+0000", 2024-04-01T19:40:20.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.090064273 2024-04-01T19:40:20.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:20.866 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.132724+0000", 2024-04-01T19:40:20.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010902400000000001 2024-04-01T19:40:20.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 5", 2024-04-01T19:40:20.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.132850+0000", 2024-04-01T19:40:20.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012504000000000001 2024-04-01T19:40:20.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:20.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.155391+0000", 2024-04-01T19:40:20.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022541733000000001 2024-04-01T19:40:20.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:20.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.317365+0000", 2024-04-01T19:40:20.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16197342100000001 2024-04-01T19:40:20.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:20.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.317417+0000", 2024-04-01T19:40:20.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2123000000000002e-05 2024-04-01T19:40:20.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:20.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.317489+0000", 2024-04-01T19:40:20.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2145999999999997e-05 2024-04-01T19:40:20.868 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.868 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:20.868 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.868 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:208054 4.9 4:90244fc4:::benchmark_data_smithi188_104537_object36060:head [delete] snapc 0=[] ondisk+write+known_if_redirected e320)", 2024-04-01T19:40:20.868 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:50.125290+0000", 2024-04-01T19:40:20.868 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 210.726386598, 2024-04-01T19:40:20.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.19631580600000001, 2024-04-01T19:40:20.869 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:20.869 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:20.869 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:20.869 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:20.869 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:20.869 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:20.869 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 208054 2024-04-01T19:40:20.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.869 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:20.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:20.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.125290+0000", 2024-04-01T19:40:20.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:20.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.125290+0000", 2024-04-01T19:40:20.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:20.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.125292+0000", 2024-04-01T19:40:20.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8139999999999999e-06 2024-04-01T19:40:20.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:20.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.125297+0000", 2024-04-01T19:40:20.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5300000000000004e-06 2024-04-01T19:40:20.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:20.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.125307+0000", 2024-04-01T19:40:20.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0098000000000001e-05 2024-04-01T19:40:20.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:20.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.125316+0000", 2024-04-01T19:40:20.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8200000000000003e-06 2024-04-01T19:40:20.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:20.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.137943+0000", 2024-04-01T19:40:20.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012626686 2024-04-01T19:40:20.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:20.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.138073+0000", 2024-04-01T19:40:20.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000130214 2024-04-01T19:40:20.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-01T19:40:20.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.138187+0000", 2024-04-01T19:40:20.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000113402 2024-04-01T19:40:20.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:20.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.155424+0000", 2024-04-01T19:40:20.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017237676 2024-04-01T19:40:20.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:20.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.321508+0000", 2024-04-01T19:40:20.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16608384500000001 2024-04-01T19:40:20.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:20.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.321559+0000", 2024-04-01T19:40:20.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0809000000000001e-05 2024-04-01T19:40:20.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:20.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.321606+0000", 2024-04-01T19:40:20.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6912000000000001e-05 2024-04-01T19:40:20.873 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.873 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:20.873 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.874 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:208063 4.9 4:92b559b5:::benchmark_data_smithi188_104537_object36069:head [delete] snapc 0=[] ondisk+write+known_if_redirected e320)", 2024-04-01T19:40:20.874 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:50.141351+0000", 2024-04-01T19:40:20.874 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 210.710325955, 2024-04-01T19:40:20.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.190232871, 2024-04-01T19:40:20.874 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:20.874 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:20.874 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:20.874 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:20.874 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:20.874 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:20.874 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 208063 2024-04-01T19:40:20.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.875 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:20.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:20.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.141351+0000", 2024-04-01T19:40:20.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:20.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.141351+0000", 2024-04-01T19:40:20.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:20.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.141353+0000", 2024-04-01T19:40:20.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9369999999999998e-06 2024-04-01T19:40:20.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:20.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.141358+0000", 2024-04-01T19:40:20.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8610000000000003e-06 2024-04-01T19:40:20.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:20.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.141377+0000", 2024-04-01T19:40:20.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8383e-05 2024-04-01T19:40:20.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:20.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.141385+0000", 2024-04-01T19:40:20.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6500000000000002e-06 2024-04-01T19:40:20.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.877 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.877 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:20.877 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.155554+0000", 2024-04-01T19:40:20.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014168373 2024-04-01T19:40:20.877 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.877 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.877 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:20.877 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.155670+0000", 2024-04-01T19:40:20.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000116434 2024-04-01T19:40:20.877 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.877 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.877 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-01T19:40:20.877 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.155778+0000", 2024-04-01T19:40:20.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000107864 2024-04-01T19:40:20.877 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.878 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.878 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:20.878 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.316643+0000", 2024-04-01T19:40:20.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16086519599999999 2024-04-01T19:40:20.878 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.878 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.878 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:20.878 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.331485+0000", 2024-04-01T19:40:20.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014841462999999999 2024-04-01T19:40:20.878 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.878 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.878 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:20.878 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.331539+0000", 2024-04-01T19:40:20.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4240999999999998e-05 2024-04-01T19:40:20.878 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:20.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.331583+0000", 2024-04-01T19:40:20.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4468999999999997e-05 2024-04-01T19:40:20.879 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.879 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:20.879 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.879 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:208064 4.9 4:9afa93c5:::benchmark_data_smithi188_104537_object36070:head [delete] snapc 0=[] ondisk+write+known_if_redirected e320)", 2024-04-01T19:40:20.879 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:50.141398+0000", 2024-04-01T19:40:20.879 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 210.710278321, 2024-04-01T19:40:20.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.19027006599999999, 2024-04-01T19:40:20.879 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:20.879 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:20.880 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:20.880 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:20.880 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:20.880 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:20.880 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 208064 2024-04-01T19:40:20.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.880 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:20.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:20.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.141398+0000", 2024-04-01T19:40:20.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:20.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.141398+0000", 2024-04-01T19:40:20.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:20.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.141399+0000", 2024-04-01T19:40:20.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9299999999999997e-07 2024-04-01T19:40:20.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:20.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.141402+0000", 2024-04-01T19:40:20.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.942e-06 2024-04-01T19:40:20.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:20.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.141408+0000", 2024-04-01T19:40:20.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9050000000000002e-06 2024-04-01T19:40:20.882 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.882 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.882 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:20.882 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.141413+0000", 2024-04-01T19:40:20.882 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4539999999999998e-06 2024-04-01T19:40:20.882 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.882 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.882 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:20.882 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.160848+0000", 2024-04-01T19:40:20.882 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019434679999999999 2024-04-01T19:40:20.882 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.882 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.882 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:20.882 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.160943+0000", 2024-04-01T19:40:20.882 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4841999999999998e-05 2024-04-01T19:40:20.882 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-01T19:40:20.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.161034+0000", 2024-04-01T19:40:20.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1428999999999995e-05 2024-04-01T19:40:20.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:20.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.316680+0000", 2024-04-01T19:40:20.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.15564567300000001 2024-04-01T19:40:20.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:20.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.331593+0000", 2024-04-01T19:40:20.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014912965 2024-04-01T19:40:20.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:20.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.331634+0000", 2024-04-01T19:40:20.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1031000000000001e-05 2024-04-01T19:40:20.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:20.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.331668+0000", 2024-04-01T19:40:20.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4351999999999999e-05 2024-04-01T19:40:20.884 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.884 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:20.884 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.884 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:208317 4.9 4:9ac99b3b:::benchmark_data_smithi188_104537_object36323:head [delete] snapc 0=[] ondisk+write+known_if_redirected e320)", 2024-04-01T19:40:20.884 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:50.752624+0000", 2024-04-01T19:40:20.885 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 210.09905246599999, 2024-04-01T19:40:20.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.19514612200000001, 2024-04-01T19:40:20.885 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:20.885 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:20.885 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:20.885 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:20.885 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:20.885 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:20.885 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 208317 2024-04-01T19:40:20.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.885 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:20.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.885 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:20.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.752624+0000", 2024-04-01T19:40:20.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:20.886 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.752624+0000", 2024-04-01T19:40:20.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:20.886 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.752626+0000", 2024-04-01T19:40:20.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9199999999999998e-06 2024-04-01T19:40:20.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:20.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.752631+0000", 2024-04-01T19:40:20.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4790000000000004e-06 2024-04-01T19:40:20.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:20.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.752641+0000", 2024-04-01T19:40:20.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9879999999999999e-06 2024-04-01T19:40:20.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:20.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.752649+0000", 2024-04-01T19:40:20.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3309999999999998e-06 2024-04-01T19:40:20.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:20.888 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.793955+0000", 2024-04-01T19:40:20.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041306465000000001 2024-04-01T19:40:20.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:20.888 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.794053+0000", 2024-04-01T19:40:20.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7882999999999998e-05 2024-04-01T19:40:20.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-01T19:40:20.888 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.794162+0000", 2024-04-01T19:40:20.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010841900000000001 2024-04-01T19:40:20.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:20.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.804348+0000", 2024-04-01T19:40:20.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010186176999999999 2024-04-01T19:40:20.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:20.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.947666+0000", 2024-04-01T19:40:20.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14331859899999999 2024-04-01T19:40:20.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:20.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.947724+0000", 2024-04-01T19:40:20.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7732999999999998e-05 2024-04-01T19:40:20.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:20.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.947770+0000", 2024-04-01T19:40:20.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6128000000000003e-05 2024-04-01T19:40:20.890 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.890 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:20.890 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.890 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:209977 4.1 4:8ec9d9d5:::benchmark_data_smithi188_104537_object37983:head [delete] snapc 0=[] ondisk+write+known_if_redirected e322)", 2024-04-01T19:40:20.890 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:53.851277+0000", 2024-04-01T19:40:20.891 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 207.00039942500001, 2024-04-01T19:40:20.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.22157722299999999, 2024-04-01T19:40:20.891 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:20.891 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:20.891 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:20.891 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:20.891 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:20.891 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:20.891 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 209977 2024-04-01T19:40:20.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.891 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:20.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:20.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.851277+0000", 2024-04-01T19:40:20.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:20.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.851277+0000", 2024-04-01T19:40:20.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:20.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.851278+0000", 2024-04-01T19:40:20.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.203e-06 2024-04-01T19:40:20.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:20.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.851283+0000", 2024-04-01T19:40:20.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7010000000000004e-06 2024-04-01T19:40:20.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:20.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.851290+0000", 2024-04-01T19:40:20.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1849999999999998e-06 2024-04-01T19:40:20.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:20.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.851296+0000", 2024-04-01T19:40:20.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2190000000000001e-06 2024-04-01T19:40:20.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:20.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.874237+0000", 2024-04-01T19:40:20.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022940283999999998 2024-04-01T19:40:20.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.894 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:20.894 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.874349+0000", 2024-04-01T19:40:20.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000112525 2024-04-01T19:40:20.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.894 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 5", 2024-04-01T19:40:20.894 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.874457+0000", 2024-04-01T19:40:20.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000107589 2024-04-01T19:40:20.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.894 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:20.894 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.879544+0000", 2024-04-01T19:40:20.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0050869280000000001 2024-04-01T19:40:20.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:20.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:54.072733+0000", 2024-04-01T19:40:20.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.19318964399999999 2024-04-01T19:40:20.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:20.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:54.072789+0000", 2024-04-01T19:40:20.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5541000000000002e-05 2024-04-01T19:40:20.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:20.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:54.072854+0000", 2024-04-01T19:40:20.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5403999999999999e-05 2024-04-01T19:40:20.896 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.896 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:20.896 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.896 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:209993 4.1 4:8b3547f4:::benchmark_data_smithi188_104537_object37999:head [delete] snapc 0=[] ondisk+write+known_if_redirected e322)", 2024-04-01T19:40:20.896 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:53.873501+0000", 2024-04-01T19:40:20.896 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 206.978175153, 2024-04-01T19:40:20.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.199461623, 2024-04-01T19:40:20.896 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:20.896 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:20.896 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:20.896 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:20.896 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:20.896 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:20.896 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 209993 2024-04-01T19:40:20.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.897 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:20.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.897 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:20.897 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.873501+0000", 2024-04-01T19:40:20.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.897 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:20.897 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.873501+0000", 2024-04-01T19:40:20.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.897 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:20.897 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.873503+0000", 2024-04-01T19:40:20.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8020000000000001e-06 2024-04-01T19:40:20.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:20.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.873509+0000", 2024-04-01T19:40:20.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.173e-06 2024-04-01T19:40:20.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:20.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.873520+0000", 2024-04-01T19:40:20.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0674e-05 2024-04-01T19:40:20.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:20.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.873528+0000", 2024-04-01T19:40:20.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6720000000000004e-06 2024-04-01T19:40:20.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:20.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.879575+0000", 2024-04-01T19:40:20.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060471359999999998 2024-04-01T19:40:20.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:20.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.879694+0000", 2024-04-01T19:40:20.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011883300000000001 2024-04-01T19:40:20.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 5", 2024-04-01T19:40:20.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.879806+0000", 2024-04-01T19:40:20.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000112539 2024-04-01T19:40:20.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:20.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:54.026828+0000", 2024-04-01T19:40:20.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14702155 2024-04-01T19:40:20.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:20.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:54.072868+0000", 2024-04-01T19:40:20.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.046040191000000001 2024-04-01T19:40:20.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:20.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:54.072913+0000", 2024-04-01T19:40:20.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5053999999999999e-05 2024-04-01T19:40:20.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:20.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:54.072963+0000", 2024-04-01T19:40:20.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9999e-05 2024-04-01T19:40:20.901 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.901 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:20.901 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.901 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:212237 4.1 4:8bf49f99:::benchmark_data_smithi188_104537_object40243:head [delete] snapc 0=[] ondisk+write+known_if_redirected e323)", 2024-04-01T19:40:20.901 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:57.853545+0000", 2024-04-01T19:40:20.901 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 202.99813180000001, 2024-04-01T19:40:20.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.207956684, 2024-04-01T19:40:20.902 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:20.902 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:20.902 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:20.902 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:20.902 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:20.902 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:20.902 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 212237 2024-04-01T19:40:20.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.902 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:20.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:20.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.853545+0000", 2024-04-01T19:40:20.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:20.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.853545+0000", 2024-04-01T19:40:20.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:20.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.853547+0000", 2024-04-01T19:40:20.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9889999999999999e-06 2024-04-01T19:40:20.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:20.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.853553+0000", 2024-04-01T19:40:20.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6540000000000002e-06 2024-04-01T19:40:20.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:20.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.853566+0000", 2024-04-01T19:40:20.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2802e-05 2024-04-01T19:40:20.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:20.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.853574+0000", 2024-04-01T19:40:20.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7270000000000007e-06 2024-04-01T19:40:20.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:20.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.864382+0000", 2024-04-01T19:40:20.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010808135999999999 2024-04-01T19:40:20.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:20.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.864484+0000", 2024-04-01T19:40:20.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000102074 2024-04-01T19:40:20.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 5", 2024-04-01T19:40:20.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.864588+0000", 2024-04-01T19:40:20.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000103638 2024-04-01T19:40:20.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:20.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.873687+0000", 2024-04-01T19:40:20.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0090992009999999995 2024-04-01T19:40:20.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:20.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.061376+0000", 2024-04-01T19:40:20.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18768897500000001 2024-04-01T19:40:20.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:20.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.061432+0000", 2024-04-01T19:40:20.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6459999999999998e-05 2024-04-01T19:40:20.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:20.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.061501+0000", 2024-04-01T19:40:20.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9028000000000004e-05 2024-04-01T19:40:20.906 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.907 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:20.907 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.907 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:212250 4.1 4:8195daf0:::benchmark_data_smithi188_104537_object40256:head [delete] snapc 0=[] ondisk+write+known_if_redirected e323)", 2024-04-01T19:40:20.907 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:57.863122+0000", 2024-04-01T19:40:20.907 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 202.988554854, 2024-04-01T19:40:20.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.19870327199999999, 2024-04-01T19:40:20.907 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:20.907 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:20.907 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:20.907 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:20.907 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:20.908 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:20.908 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 212250 2024-04-01T19:40:20.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.908 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:20.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:20.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.863122+0000", 2024-04-01T19:40:20.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:20.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.863122+0000", 2024-04-01T19:40:20.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:20.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.863123+0000", 2024-04-01T19:40:20.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.449e-06 2024-04-01T19:40:20.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:20.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.863128+0000", 2024-04-01T19:40:20.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1739999999999999e-06 2024-04-01T19:40:20.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:20.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.863140+0000", 2024-04-01T19:40:20.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1853e-05 2024-04-01T19:40:20.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:20.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.863148+0000", 2024-04-01T19:40:20.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1729999999999995e-06 2024-04-01T19:40:20.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:20.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.869139+0000", 2024-04-01T19:40:20.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005990736 2024-04-01T19:40:20.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:20.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.869277+0000", 2024-04-01T19:40:20.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013777700000000001 2024-04-01T19:40:20.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 5", 2024-04-01T19:40:20.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.869422+0000", 2024-04-01T19:40:20.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014546700000000001 2024-04-01T19:40:20.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:20.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.873864+0000", 2024-04-01T19:40:20.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0044419050000000003 2024-04-01T19:40:20.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:20.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.061729+0000", 2024-04-01T19:40:20.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18786441000000001 2024-04-01T19:40:20.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:20.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.061772+0000", 2024-04-01T19:40:20.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3096000000000002e-05 2024-04-01T19:40:20.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:20.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.061825+0000", 2024-04-01T19:40:20.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3232000000000001e-05 2024-04-01T19:40:20.912 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.912 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:20.912 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.912 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:212271 4.1 4:88226390:::benchmark_data_smithi188_104537_object40277:head [delete] snapc 0=[] ondisk+write+known_if_redirected e323)", 2024-04-01T19:40:20.912 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:57.897413+0000", 2024-04-01T19:40:20.912 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 202.95426387000001, 2024-04-01T19:40:20.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18474895899999999, 2024-04-01T19:40:20.913 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:20.913 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:20.913 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:20.913 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:20.913 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:20.913 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:20.913 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 212271 2024-04-01T19:40:20.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.913 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:20.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:20.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.897413+0000", 2024-04-01T19:40:20.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:20.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.897413+0000", 2024-04-01T19:40:20.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:20.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.897416+0000", 2024-04-01T19:40:20.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1669999999999999e-06 2024-04-01T19:40:20.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:20.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.897423+0000", 2024-04-01T19:40:20.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2019999999999998e-06 2024-04-01T19:40:20.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:20.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.956948+0000", 2024-04-01T19:40:20.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.059524588000000003 2024-04-01T19:40:20.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:20.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.956973+0000", 2024-04-01T19:40:20.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4961e-05 2024-04-01T19:40:20.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:20.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.063870+0000", 2024-04-01T19:40:20.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.10689742000000001 2024-04-01T19:40:20.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:20.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.063945+0000", 2024-04-01T19:40:20.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5326000000000004e-05 2024-04-01T19:40:20.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 5", 2024-04-01T19:40:20.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.064010+0000", 2024-04-01T19:40:20.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4789999999999995e-05 2024-04-01T19:40:20.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:20.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.072579+0000", 2024-04-01T19:40:20.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085689700000000004 2024-04-01T19:40:20.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:20.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.082046+0000", 2024-04-01T19:40:20.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0094665679999999999 2024-04-01T19:40:20.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:20.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.082103+0000", 2024-04-01T19:40:20.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6847e-05 2024-04-01T19:40:20.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:20.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.082162+0000", 2024-04-01T19:40:20.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9120000000000003e-05 2024-04-01T19:40:20.918 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.918 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:20.918 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.918 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:212506 4.9 4:9160a4a0:::benchmark_data_smithi188_104537_object40512:head [delete] snapc 0=[] ondisk+write+known_if_redirected e323)", 2024-04-01T19:40:20.918 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:58.361086+0000", 2024-04-01T19:40:20.918 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 202.490590309, 2024-04-01T19:40:20.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18223913799999999, 2024-04-01T19:40:20.918 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:20.919 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:20.919 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:20.919 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:20.919 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:20.919 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:20.919 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 212506 2024-04-01T19:40:20.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.919 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:20.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:20.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.361086+0000", 2024-04-01T19:40:20.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:20.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.361086+0000", 2024-04-01T19:40:20.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:20.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.361087+0000", 2024-04-01T19:40:20.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9699999999999995e-07 2024-04-01T19:40:20.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:20.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.361091+0000", 2024-04-01T19:40:20.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6720000000000002e-06 2024-04-01T19:40:20.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:20.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.361097+0000", 2024-04-01T19:40:20.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3790000000000003e-06 2024-04-01T19:40:20.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:20.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.361103+0000", 2024-04-01T19:40:20.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.913e-06 2024-04-01T19:40:20.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:20.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.522861+0000", 2024-04-01T19:40:20.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16175811700000001 2024-04-01T19:40:20.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:20.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.522976+0000", 2024-04-01T19:40:20.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000114938 2024-04-01T19:40:20.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-01T19:40:20.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.523095+0000", 2024-04-01T19:40:20.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011924700000000001 2024-04-01T19:40:20.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:20.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.533252+0000", 2024-04-01T19:40:20.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010156992 2024-04-01T19:40:20.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:20.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.543224+0000", 2024-04-01T19:40:20.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.009971967 2024-04-01T19:40:20.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:20.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.543272+0000", 2024-04-01T19:40:20.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7488999999999999e-05 2024-04-01T19:40:20.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:20.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.543325+0000", 2024-04-01T19:40:20.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3627e-05 2024-04-01T19:40:20.923 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.923 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:20.923 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.924 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:212507 4.9 4:95df974f:::benchmark_data_smithi188_104537_object40513:head [delete] snapc 0=[] ondisk+write+known_if_redirected e323)", 2024-04-01T19:40:20.924 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:58.361110+0000", 2024-04-01T19:40:20.924 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 202.49056666000001, 2024-04-01T19:40:20.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18230745200000001, 2024-04-01T19:40:20.924 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:20.924 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:20.924 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:20.924 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:20.924 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:20.924 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:20.924 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 212507 2024-04-01T19:40:20.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.924 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:20.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:20.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.361110+0000", 2024-04-01T19:40:20.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:20.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.361110+0000", 2024-04-01T19:40:20.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:20.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.361110+0000", 2024-04-01T19:40:20.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.13e-07 2024-04-01T19:40:20.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:20.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.361113+0000", 2024-04-01T19:40:20.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5299999999999999e-06 2024-04-01T19:40:20.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:20.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.361118+0000", 2024-04-01T19:40:20.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1460000000000004e-06 2024-04-01T19:40:20.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:20.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.361124+0000", 2024-04-01T19:40:20.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5389999999999998e-06 2024-04-01T19:40:20.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:20.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.528103+0000", 2024-04-01T19:40:20.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16697953300000001 2024-04-01T19:40:20.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:20.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.528229+0000", 2024-04-01T19:40:20.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012565800000000001 2024-04-01T19:40:20.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-01T19:40:20.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.528357+0000", 2024-04-01T19:40:20.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000127677 2024-04-01T19:40:20.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:20.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.533298+0000", 2024-04-01T19:40:20.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0049418099999999996 2024-04-01T19:40:20.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:20.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.543332+0000", 2024-04-01T19:40:20.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010033858 2024-04-01T19:40:20.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:20.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.543382+0000", 2024-04-01T19:40:20.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9534999999999999e-05 2024-04-01T19:40:20.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:20.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.543417+0000", 2024-04-01T19:40:20.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5553000000000003e-05 2024-04-01T19:40:20.928 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.928 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:20.929 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.929 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:280604 4.9 4:9eb9220e:::benchmark_data_smithi188_104537_object108610:head [delete] snapc 0=[] ondisk+write+known_if_redirected e342)", 2024-04-01T19:40:20.929 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:38:03.368477+0000", 2024-04-01T19:40:20.929 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 137.48320000199999, 2024-04-01T19:40:20.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.064710290000000004, 2024-04-01T19:40:20.929 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:20.929 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:20.929 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:20.929 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:20.929 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:20.929 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:20.929 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 280604 2024-04-01T19:40:20.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.930 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:20.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:20.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:03.368477+0000", 2024-04-01T19:40:20.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:20.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:03.368477+0000", 2024-04-01T19:40:20.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:20.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:03.368478+0000", 2024-04-01T19:40:20.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1179999999999999e-06 2024-04-01T19:40:20.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:20.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:03.368482+0000", 2024-04-01T19:40:20.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.07e-06 2024-04-01T19:40:20.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:20.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:03.368491+0000", 2024-04-01T19:40:20.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9719999999999998e-06 2024-04-01T19:40:20.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:20.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:03.368497+0000", 2024-04-01T19:40:20.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1759999999999998e-06 2024-04-01T19:40:20.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:20.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:03.368542+0000", 2024-04-01T19:40:20.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5102000000000003e-05 2024-04-01T19:40:20.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:20.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:03.368663+0000", 2024-04-01T19:40:20.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000120777 2024-04-01T19:40:20.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-01T19:40:20.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:03.368767+0000", 2024-04-01T19:40:20.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000103965 2024-04-01T19:40:20.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:20.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:03.377513+0000", 2024-04-01T19:40:20.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0087463309999999996 2024-04-01T19:40:20.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:20.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:03.433097+0000", 2024-04-01T19:40:20.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.055584199000000001 2024-04-01T19:40:20.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:20.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:03.433139+0000", 2024-04-01T19:40:20.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1974000000000002e-05 2024-04-01T19:40:20.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:20.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:03.433187+0000", 2024-04-01T19:40:20.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7605999999999998e-05 2024-04-01T19:40:20.934 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.934 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:20.934 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.934 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:304012 4.9 4:94997ef9:::benchmark_data_smithi188_104537_object132018:head [delete] snapc 0=[] ondisk+write+known_if_redirected e350)", 2024-04-01T19:40:20.934 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:38:25.384774+0000", 2024-04-01T19:40:20.934 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 115.466902584, 2024-04-01T19:40:20.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.075501716999999996, 2024-04-01T19:40:20.934 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:20.934 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:20.935 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:20.935 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:20.935 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:20.935 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:20.935 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 304012 2024-04-01T19:40:20.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.935 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:20.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:20.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.384774+0000", 2024-04-01T19:40:20.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:20.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.384774+0000", 2024-04-01T19:40:20.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:20.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.384774+0000", 2024-04-01T19:40:20.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7999999999999996e-07 2024-04-01T19:40:20.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:20.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.384777+0000", 2024-04-01T19:40:20.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.503e-06 2024-04-01T19:40:20.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:20.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.384783+0000", 2024-04-01T19:40:20.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5770000000000001e-06 2024-04-01T19:40:20.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:20.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.384787+0000", 2024-04-01T19:40:20.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6269999999999999e-06 2024-04-01T19:40:20.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:20.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.400441+0000", 2024-04-01T19:40:20.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015653990999999999 2024-04-01T19:40:20.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:20.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.400522+0000", 2024-04-01T19:40:20.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1359000000000005e-05 2024-04-01T19:40:20.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-01T19:40:20.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.400592+0000", 2024-04-01T19:40:20.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9590000000000003e-05 2024-04-01T19:40:20.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:20.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.417869+0000", 2024-04-01T19:40:20.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017277223000000001 2024-04-01T19:40:20.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:20.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.460205+0000", 2024-04-01T19:40:20.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042335206 2024-04-01T19:40:20.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:20.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.460238+0000", 2024-04-01T19:40:20.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3565999999999997e-05 2024-04-01T19:40:20.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:20.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.460276+0000", 2024-04-01T19:40:20.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7595000000000002e-05 2024-04-01T19:40:20.940 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.940 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:20.940 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.940 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:304017 4.9 4:92353d88:::benchmark_data_smithi188_104537_object132023:head [delete] snapc 0=[] ondisk+write+known_if_redirected e350)", 2024-04-01T19:40:20.940 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:38:25.384808+0000", 2024-04-01T19:40:20.940 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 115.46686887, 2024-04-01T19:40:20.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.075605337999999994, 2024-04-01T19:40:20.940 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:20.940 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:20.940 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:20.940 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:20.940 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:20.940 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:20.940 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 304017 2024-04-01T19:40:20.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.941 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:20.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:20.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.384808+0000", 2024-04-01T19:40:20.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:20.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.384808+0000", 2024-04-01T19:40:20.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:20.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.384808+0000", 2024-04-01T19:40:20.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0400000000000002e-07 2024-04-01T19:40:20.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:20.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.384810+0000", 2024-04-01T19:40:20.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.916e-06 2024-04-01T19:40:20.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:20.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.384814+0000", 2024-04-01T19:40:20.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.425e-06 2024-04-01T19:40:20.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:20.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.384819+0000", 2024-04-01T19:40:20.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7809999999999996e-06 2024-04-01T19:40:20.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:20.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.404539+0000", 2024-04-01T19:40:20.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019719548999999999 2024-04-01T19:40:20.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:20.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.404661+0000", 2024-04-01T19:40:20.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012218299999999999 2024-04-01T19:40:20.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-01T19:40:20.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.404770+0000", 2024-04-01T19:40:20.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108824 2024-04-01T19:40:20.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:20.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.417878+0000", 2024-04-01T19:40:20.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013107898999999999 2024-04-01T19:40:20.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:20.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.460330+0000", 2024-04-01T19:40:20.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042452700000000003 2024-04-01T19:40:20.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:20.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.460376+0000", 2024-04-01T19:40:20.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5967000000000002e-05 2024-04-01T19:40:20.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.945 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:20.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.460413+0000", 2024-04-01T19:40:20.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6690000000000003e-05 2024-04-01T19:40:20.945 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.945 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:20.945 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.945 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:304018 4.9 4:977c5262:::benchmark_data_smithi188_104537_object132024:head [delete] snapc 0=[] ondisk+write+known_if_redirected e350)", 2024-04-01T19:40:20.945 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:38:25.384826+0000", 2024-04-01T19:40:20.945 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 115.46685029, 2024-04-01T19:40:20.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.075730499000000007, 2024-04-01T19:40:20.946 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:20.946 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:20.946 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:20.946 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:20.946 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:40:20.946 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:40:20.946 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 304018 2024-04-01T19:40:20.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.946 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:20.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:20.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.384826+0000", 2024-04-01T19:40:20.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:20.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.384826+0000", 2024-04-01T19:40:20.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:20.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.384827+0000", 2024-04-01T19:40:20.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4400000000000001e-07 2024-04-01T19:40:20.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:20.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.384829+0000", 2024-04-01T19:40:20.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.979e-06 2024-04-01T19:40:20.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:20.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.384832+0000", 2024-04-01T19:40:20.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9720000000000001e-06 2024-04-01T19:40:20.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:20.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.384834+0000", 2024-04-01T19:40:20.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6390000000000001e-06 2024-04-01T19:40:20.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:20.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.409322+0000", 2024-04-01T19:40:20.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.024487575000000001 2024-04-01T19:40:20.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:20.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.409420+0000", 2024-04-01T19:40:20.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8374000000000004e-05 2024-04-01T19:40:20.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-01T19:40:20.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.409514+0000", 2024-04-01T19:40:20.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4098000000000006e-05 2024-04-01T19:40:20.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:20.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.417885+0000", 2024-04-01T19:40:20.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0083702189999999999 2024-04-01T19:40:20.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:20.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.460477+0000", 2024-04-01T19:40:20.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042591954000000001 2024-04-01T19:40:20.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:20.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.460518+0000", 2024-04-01T19:40:20.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1085999999999999e-05 2024-04-01T19:40:20.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:20.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:38:25.460557+0000", 2024-04-01T19:40:20.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9159000000000002e-05 2024-04-01T19:40:20.951 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.951 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:20.951 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.951 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:47684 5.8 5:141d2c81:::benchmark_data_smithi188_119427_object47683:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e377)", 2024-04-01T19:40:20.951 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:39:47.465704+0000", 2024-04-01T19:40:20.951 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 33.385972103999997, 2024-04-01T19:40:20.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.067750394000000005, 2024-04-01T19:40:20.951 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:20.951 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:20.951 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:20.951 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:20.951 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:40:20.951 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:40:20.952 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 47684 2024-04-01T19:40:20.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.952 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:20.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:20.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:47.465704+0000", 2024-04-01T19:40:20.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:20.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:47.465704+0000", 2024-04-01T19:40:20.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:20.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:47.465706+0000", 2024-04-01T19:40:20.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4529999999999999e-06 2024-04-01T19:40:20.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:20.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:47.465727+0000", 2024-04-01T19:40:20.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1435999999999999e-05 2024-04-01T19:40:20.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:20.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:47.465740+0000", 2024-04-01T19:40:20.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3134e-05 2024-04-01T19:40:20.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:20.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:47.465750+0000", 2024-04-01T19:40:20.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0459999999999994e-06 2024-04-01T19:40:20.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:20.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:47.465813+0000", 2024-04-01T19:40:20.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3968999999999997e-05 2024-04-01T19:40:20.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:20.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:47.465942+0000", 2024-04-01T19:40:20.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012814099999999999 2024-04-01T19:40:20.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:40:20.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:47.466133+0000", 2024-04-01T19:40:20.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000191736 2024-04-01T19:40:20.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:20.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:47.469030+0000", 2024-04-01T19:40:20.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0028962300000000001 2024-04-01T19:40:20.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:20.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:47.533338+0000", 2024-04-01T19:40:20.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.064308294000000002 2024-04-01T19:40:20.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:20.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:47.533410+0000", 2024-04-01T19:40:20.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2063000000000004e-05 2024-04-01T19:40:20.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:20.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:47.533455+0000", 2024-04-01T19:40:20.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4892000000000003e-05 2024-04-01T19:40:20.956 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.956 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:20.956 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.956 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:49326 5.8 5:1082799d:::benchmark_data_smithi188_119427_object49325:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e377)", 2024-04-01T19:40:20.956 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:39:48.108325+0000", 2024-04-01T19:40:20.956 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 32.743351378, 2024-04-01T19:40:20.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057470009000000002, 2024-04-01T19:40:20.957 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:20.957 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:20.957 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:20.957 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:20.957 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:40:20.957 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:40:20.957 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 49326 2024-04-01T19:40:20.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.957 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:20.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:20.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:48.108325+0000", 2024-04-01T19:40:20.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:20.958 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:48.108325+0000", 2024-04-01T19:40:20.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:20.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:20.958 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:48.108326+0000", 2024-04-01T19:40:20.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3230000000000001e-06 2024-04-01T19:40:20.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:20.958 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:48.108351+0000", 2024-04-01T19:40:20.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4383e-05 2024-04-01T19:40:20.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:20.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:48.108360+0000", 2024-04-01T19:40:20.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0270000000000001e-06 2024-04-01T19:40:20.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:20.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:48.108366+0000", 2024-04-01T19:40:20.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7780000000000004e-06 2024-04-01T19:40:20.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:20.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:48.108412+0000", 2024-04-01T19:40:20.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6511999999999998e-05 2024-04-01T19:40:20.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:20.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:48.108540+0000", 2024-04-01T19:40:20.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012778 2024-04-01T19:40:20.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:40:20.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:48.108683+0000", 2024-04-01T19:40:20.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000143456 2024-04-01T19:40:20.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:20.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:48.110476+0000", 2024-04-01T19:40:20.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0017927010000000001 2024-04-01T19:40:20.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:20.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:48.165684+0000", 2024-04-01T19:40:20.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.055208370999999999 2024-04-01T19:40:20.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:20.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:48.165750+0000", 2024-04-01T19:40:20.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5574000000000006e-05 2024-04-01T19:40:20.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:20.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:20.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:20.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:39:48.165795+0000", 2024-04-01T19:40:20.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5104e-05 2024-04-01T19:40:20.961 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.961 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:20.961 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.962 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:20.962 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:20.962 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:40:20.962 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:20.963 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:20.963 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:40:20.963 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:40:21.064 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:40:21.103 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:21.145 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:40:21.148 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:21.148 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:40:21.249 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:40:21.291 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:21.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:21.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:21.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:21.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:21.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:21.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:21.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:21.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:21.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:21.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:21.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:21.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:21.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:21.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:21.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:21.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:21.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:21.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:21.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:21.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:21.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:21.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:21.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:21.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:21.632 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 47 16 113233 113217 150.532 99.6875 0.00443117 0.00664096 2024-04-01T19:40:21.699 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_ops_in_flight 2024-04-01T19:40:22.035 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:40:22.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:22 smithi062 ceph-mon[44211]: pgmap v1094: 17 pgs: 17 active+clean; 6.6 GiB data, 17 GiB used, 967 GiB / 983 GiB avail; 121 MiB/s wr, 1.93k op/s 2024-04-01T19:40:22.558 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:22 smithi188 ceph-mon[43939]: pgmap v1094: 17 pgs: 17 active+clean; 6.6 GiB data, 17 GiB used, 967 GiB / 983 GiB avail; 121 MiB/s wr, 1.93k op/s 2024-04-01T19:40:22.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:22 smithi022 ceph-mon[39439]: pgmap v1094: 17 pgs: 17 active+clean; 6.6 GiB data, 17 GiB used, 967 GiB / 983 GiB avail; 121 MiB/s wr, 1.93k op/s 2024-04-01T19:40:22.632 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 48 16 114850 114834 149.501 101.062 0.00594724 0.00668752 2024-04-01T19:40:23.633 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 49 16 116429 116413 148.464 98.6875 0.00567078 0.00673428 2024-04-01T19:40:24.463 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:40:24.463 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:40:24.463 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-01T19:40:24.463 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:40:24.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:24 smithi062 ceph-mon[44211]: pgmap v1095: 17 pgs: 17 active+clean; 6.8 GiB data, 17 GiB used, 967 GiB / 983 GiB avail; 110 MiB/s wr, 1.77k op/s 2024-04-01T19:40:24.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:24 smithi022 ceph-mon[39439]: pgmap v1095: 17 pgs: 17 active+clean; 6.8 GiB data, 17 GiB used, 967 GiB / 983 GiB avail; 110 MiB/s wr, 1.77k op/s 2024-04-01T19:40:24.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:24 smithi188 ceph-mon[43939]: pgmap v1095: 17 pgs: 17 active+clean; 6.8 GiB data, 17 GiB used, 967 GiB / 983 GiB avail; 110 MiB/s wr, 1.77k op/s 2024-04-01T19:40:24.632 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 50 16 117925 117909 147.364 93.5 0.00453342 0.00678424 2024-04-01T19:40:25.321 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_blocked_ops 2024-04-01T19:40:25.633 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 51 16 119482 119466 146.383 97.3125 0.00863615 0.00682978 2024-04-01T19:40:25.664 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:40:26.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:26 smithi062 ceph-mon[44211]: pgmap v1096: 17 pgs: 17 active+clean; 6.9 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 80 MiB/s wr, 1.28k op/s 2024-04-01T19:40:26.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:26 smithi062 ceph-mon[44211]: 5.5 scrub starts 2024-04-01T19:40:26.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:26 smithi022 ceph-mon[39439]: pgmap v1096: 17 pgs: 17 active+clean; 6.9 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 80 MiB/s wr, 1.28k op/s 2024-04-01T19:40:26.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:26 smithi022 ceph-mon[39439]: 5.5 scrub starts 2024-04-01T19:40:26.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:26 smithi188 ceph-mon[43939]: pgmap v1096: 17 pgs: 17 active+clean; 6.9 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 80 MiB/s wr, 1.28k op/s 2024-04-01T19:40:26.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:26 smithi188 ceph-mon[43939]: 5.5 scrub starts 2024-04-01T19:40:26.632 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 52 16 120743 120727 145.084 78.8125 0.0251825 0.00689107 2024-04-01T19:40:26.963 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:40:26.964 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:40:26.964 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:26.964 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:40:27.065 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:40:27.100 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:27.126 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:40:27.132 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:27.133 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:40:27.234 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:40:27.271 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:27.271 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:27 smithi022 ceph-mon[39439]: 5.b scrub starts 2024-04-01T19:40:27.308 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:40:27.310 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:27.311 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:40:27.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:27 smithi188 ceph-mon[43939]: 5.b scrub starts 2024-04-01T19:40:27.412 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:40:27.475 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:27.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:27 smithi062 ceph-mon[44211]: 5.b scrub starts 2024-04-01T19:40:27.633 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 53 16 121960 121944 143.781 76.0625 0.00539211 0.00695391 2024-04-01T19:40:27.755 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:40:27.755 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:40:27.755 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-01T19:40:27.755 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-01T19:40:27.756 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:40:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:28 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:40:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:28 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:40:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:28 smithi188 ceph-mon[43939]: pgmap v1097: 17 pgs: 17 active+clean; 7.2 GiB data, 18 GiB used, 966 GiB / 983 GiB avail; 97 MiB/s wr, 1.55k op/s 2024-04-01T19:40:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:28 smithi188 ceph-mon[43939]: osdmap e390: 12 total, 12 up, 11 in 2024-04-01T19:40:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:28 smithi188 ceph-mon[43939]: 5.2 scrub starts 2024-04-01T19:40:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:28 smithi188 ceph-mon[43939]: 5.5 scrub ok 2024-04-01T19:40:28.488 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_historic_ops 2024-04-01T19:40:28.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:28 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:40:28.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:28 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:40:28.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:28 smithi022 ceph-mon[39439]: pgmap v1097: 17 pgs: 17 active+clean; 7.2 GiB data, 18 GiB used, 966 GiB / 983 GiB avail; 97 MiB/s wr, 1.55k op/s 2024-04-01T19:40:28.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:28 smithi022 ceph-mon[39439]: osdmap e390: 12 total, 12 up, 11 in 2024-04-01T19:40:28.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:28 smithi022 ceph-mon[39439]: 5.2 scrub starts 2024-04-01T19:40:28.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:28 smithi022 ceph-mon[39439]: 5.5 scrub ok 2024-04-01T19:40:28.633 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 54 16 123248 123232 142.609 80.5 0.0142955 0.00701073 2024-04-01T19:40:28.655 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:40:28.680 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:28.680 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:40:28.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:28 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:40:28.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:28 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:40:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:28 smithi062 ceph-mon[44211]: pgmap v1097: 17 pgs: 17 active+clean; 7.2 GiB data, 18 GiB used, 966 GiB / 983 GiB avail; 97 MiB/s wr, 1.55k op/s 2024-04-01T19:40:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:28 smithi062 ceph-mon[44211]: osdmap e390: 12 total, 12 up, 11 in 2024-04-01T19:40:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:28 smithi062 ceph-mon[44211]: 5.2 scrub starts 2024-04-01T19:40:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:28 smithi062 ceph-mon[44211]: 5.5 scrub ok 2024-04-01T19:40:28.781 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:40:28.817 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:40:28.828 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:28.954 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:40:28.958 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:28.959 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:40:28.960 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:40:29.060 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:40:29.091 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:29.116 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:40:29.122 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:29.122 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:40:29.223 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:40:29.258 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:29.284 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:40:29.288 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:29.289 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:40:29.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:29 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:40:29.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:29 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:40:29.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:29 smithi188 ceph-mon[43939]: osdmap e391: 12 total, 12 up, 11 in 2024-04-01T19:40:29.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:29 smithi188 ceph-mon[43939]: 5.b scrub ok 2024-04-01T19:40:29.389 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:40:29.475 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:29.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:29 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:40:29.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:29 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:40:29.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:29 smithi062 ceph-mon[44211]: osdmap e391: 12 total, 12 up, 11 in 2024-04-01T19:40:29.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:29 smithi062 ceph-mon[44211]: 5.b scrub ok 2024-04-01T19:40:29.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:29 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:40:29.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:29 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:40:29.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:29 smithi022 ceph-mon[39439]: osdmap e391: 12 total, 12 up, 11 in 2024-04-01T19:40:29.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:29 smithi022 ceph-mon[39439]: 5.b scrub ok 2024-04-01T19:40:29.633 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 55 16 124514 124498 141.454 79.125 0.0053102 0.00706807 2024-04-01T19:40:29.691 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:40:29.698 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:29.699 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:40:29.800 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:40:29.843 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:29.873 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:40:29.877 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:29.878 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:40:29.979 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:40:30.026 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:30.245 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:40:30.250 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:30.251 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:40:30.315 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:30 smithi022 ceph-mon[39439]: pgmap v1100: 17 pgs: 17 active+clean; 7.3 GiB data, 18 GiB used, 966 GiB / 983 GiB avail; 90 MiB/s wr, 1.43k op/s 2024-04-01T19:40:30.315 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:30 smithi022 ceph-mon[39439]: 5.2 scrub ok 2024-04-01T19:40:30.315 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:30 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2417321287' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T19:40:30.318 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:40:30.352 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:40:30.354 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.9 to 1 (10000) 2024-04-01T19:40:30.387 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:30.504 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:30 smithi188 ceph-mon[43939]: pgmap v1100: 17 pgs: 17 active+clean; 7.3 GiB data, 18 GiB used, 966 GiB / 983 GiB avail; 90 MiB/s wr, 1.43k op/s 2024-04-01T19:40:30.504 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:30 smithi188 ceph-mon[43939]: 5.2 scrub ok 2024-04-01T19:40:30.504 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:30 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2417321287' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T19:40:30.516 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:40:30.518 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:30.518 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:40:30.619 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:40:30.633 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 56 16 125892 125876 140.466 86.125 0.00805335 0.0071176 2024-04-01T19:40:30.666 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:30.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:30 smithi062 ceph-mon[44211]: pgmap v1100: 17 pgs: 17 active+clean; 7.3 GiB data, 18 GiB used, 966 GiB / 983 GiB avail; 90 MiB/s wr, 1.43k op/s 2024-04-01T19:40:30.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:30 smithi062 ceph-mon[44211]: 5.2 scrub ok 2024-04-01T19:40:30.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:30 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2417321287' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T19:40:30.819 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:40:30.819 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:40:30.819 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:40:30.819 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:40:30.819 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.819 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:148071 3.9 3:99144c84:::benchmark_data_smithi188_92122_object148070:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e219)", 2024-04-01T19:40:30.819 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:15.124459+0000", 2024-04-01T19:40:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 555.69427999799996, 2024-04-01T19:40:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027354364999999999, 2024-04-01T19:40:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:40:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:40:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 148071 2024-04-01T19:40:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124459+0000", 2024-04-01T19:40:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124459+0000", 2024-04-01T19:40:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124461+0000", 2024-04-01T19:40:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1069999999999999e-06 2024-04-01T19:40:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124482+0000", 2024-04-01T19:40:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1294e-05 2024-04-01T19:40:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124493+0000", 2024-04-01T19:40:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1246e-05 2024-04-01T19:40:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124503+0000", 2024-04-01T19:40:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0720000000000006e-06 2024-04-01T19:40:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.126589+0000", 2024-04-01T19:40:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0020860169999999999 2024-04-01T19:40:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.126723+0000", 2024-04-01T19:40:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000134136 2024-04-01T19:40:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:40:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.126876+0000", 2024-04-01T19:40:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015317099999999999 2024-04-01T19:40:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.143003+0000", 2024-04-01T19:40:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016126939999999999 2024-04-01T19:40:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.151716+0000", 2024-04-01T19:40:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0087129459999999992 2024-04-01T19:40:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.151771+0000", 2024-04-01T19:40:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5503e-05 2024-04-01T19:40:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.151813+0000", 2024-04-01T19:40:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1933e-05 2024-04-01T19:40:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:148075 3.9 3:9c08ae7a:::benchmark_data_smithi188_92122_object148074:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e219)", 2024-04-01T19:40:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:15.124595+0000", 2024-04-01T19:40:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 555.69414358799997, 2024-04-01T19:40:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027365482, 2024-04-01T19:40:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:40:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:40:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 148075 2024-04-01T19:40:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124595+0000", 2024-04-01T19:40:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124595+0000", 2024-04-01T19:40:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124602+0000", 2024-04-01T19:40:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4370000000000004e-06 2024-04-01T19:40:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124630+0000", 2024-04-01T19:40:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8262000000000001e-05 2024-04-01T19:40:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124638+0000", 2024-04-01T19:40:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0099999999999995e-06 2024-04-01T19:40:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124644+0000", 2024-04-01T19:40:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0859999999999998e-06 2024-04-01T19:40:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.130698+0000", 2024-04-01T19:40:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060540189999999999 2024-04-01T19:40:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.130853+0000", 2024-04-01T19:40:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015509399999999999 2024-04-01T19:40:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:40:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.131009+0000", 2024-04-01T19:40:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015546099999999999 2024-04-01T19:40:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.143011+0000", 2024-04-01T19:40:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.01200273 2024-04-01T19:40:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.151869+0000", 2024-04-01T19:40:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0088579069999999999 2024-04-01T19:40:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.151919+0000", 2024-04-01T19:40:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9654000000000003e-05 2024-04-01T19:40:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.151961+0000", 2024-04-01T19:40:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1822e-05 2024-04-01T19:40:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:148078 3.9 3:9a843ce1:::benchmark_data_smithi188_92122_object148077:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e219)", 2024-04-01T19:40:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:15.124826+0000", 2024-04-01T19:40:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 555.69391293199999, 2024-04-01T19:40:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027264575999999999, 2024-04-01T19:40:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:40:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:40:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 148078 2024-04-01T19:40:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124826+0000", 2024-04-01T19:40:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124826+0000", 2024-04-01T19:40:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124827+0000", 2024-04-01T19:40:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2920000000000001e-06 2024-04-01T19:40:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124846+0000", 2024-04-01T19:40:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8423e-05 2024-04-01T19:40:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124853+0000", 2024-04-01T19:40:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0729999999999999e-06 2024-04-01T19:40:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.124865+0000", 2024-04-01T19:40:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2262000000000001e-05 2024-04-01T19:40:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.134963+0000", 2024-04-01T19:40:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.01009839 2024-04-01T19:40:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.135108+0000", 2024-04-01T19:40:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000144606 2024-04-01T19:40:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:40:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.135266+0000", 2024-04-01T19:40:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000158412 2024-04-01T19:40:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.143110+0000", 2024-04-01T19:40:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0078440550000000008 2024-04-01T19:40:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.152013+0000", 2024-04-01T19:40:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0089021299999999994 2024-04-01T19:40:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.152054+0000", 2024-04-01T19:40:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1436000000000001e-05 2024-04-01T19:40:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:15.152090+0000", 2024-04-01T19:40:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6497e-05 2024-04-01T19:40:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:163103 3.9 3:9d8f00c2:::benchmark_data_smithi188_92122_object163102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e224)", 2024-04-01T19:40:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:28.265835+0000", 2024-04-01T19:40:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 542.55290428800004, 2024-04-01T19:40:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029696488, 2024-04-01T19:40:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:40:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:40:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 163103 2024-04-01T19:40:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.265835+0000", 2024-04-01T19:40:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.265835+0000", 2024-04-01T19:40:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.265835+0000", 2024-04-01T19:40:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5000000000000002e-07 2024-04-01T19:40:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.265854+0000", 2024-04-01T19:40:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8678e-05 2024-04-01T19:40:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.265860+0000", 2024-04-01T19:40:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3439999999999997e-06 2024-04-01T19:40:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.265866+0000", 2024-04-01T19:40:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6760000000000004e-06 2024-04-01T19:40:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.270474+0000", 2024-04-01T19:40:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.004608043 2024-04-01T19:40:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.270623+0000", 2024-04-01T19:40:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014932199999999999 2024-04-01T19:40:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:40:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.270786+0000", 2024-04-01T19:40:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016298500000000001 2024-04-01T19:40:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.283776+0000", 2024-04-01T19:40:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012989877 2024-04-01T19:40:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:30.842 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.295416+0000", 2024-04-01T19:40:30.842 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011639943 2024-04-01T19:40:30.842 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.842 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.842 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:30.842 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.295477+0000", 2024-04-01T19:40:30.842 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1156999999999997e-05 2024-04-01T19:40:30.842 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.842 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.842 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:30.842 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.295531+0000", 2024-04-01T19:40:30.842 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3813000000000001e-05 2024-04-01T19:40:30.842 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.842 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:30.843 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.843 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.843 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.843 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:163105 3.9 3:9ddc7cf3:::benchmark_data_smithi188_92122_object163104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e224)", 2024-04-01T19:40:30.843 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:28.266122+0000", 2024-04-01T19:40:30.843 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 542.55261656200003, 2024-04-01T19:40:30.843 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029525068000000002, 2024-04-01T19:40:30.843 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:30.843 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:30.843 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:30.843 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:30.843 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:40:30.843 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:40:30.843 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 163105 2024-04-01T19:40:30.843 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.843 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:30.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:30.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.266122+0000", 2024-04-01T19:40:30.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:30.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.266122+0000", 2024-04-01T19:40:30.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:30.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.266123+0000", 2024-04-01T19:40:30.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.257e-06 2024-04-01T19:40:30.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:30.845 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.266146+0000", 2024-04-01T19:40:30.845 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.26e-05 2024-04-01T19:40:30.845 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:30.845 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.266155+0000", 2024-04-01T19:40:30.845 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8910000000000001e-06 2024-04-01T19:40:30.845 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:30.845 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.266162+0000", 2024-04-01T19:40:30.845 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6789999999999999e-06 2024-04-01T19:40:30.845 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:30.846 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.274857+0000", 2024-04-01T19:40:30.846 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0086949509999999994 2024-04-01T19:40:30.846 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.846 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.846 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:30.846 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.275007+0000", 2024-04-01T19:40:30.846 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015065599999999999 2024-04-01T19:40:30.846 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.846 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.846 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:40:30.846 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.275172+0000", 2024-04-01T19:40:30.846 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016463 2024-04-01T19:40:30.846 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.847 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.847 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:30.847 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.283784+0000", 2024-04-01T19:40:30.847 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0086125860000000002 2024-04-01T19:40:30.847 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.847 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.847 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:30.847 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.295569+0000", 2024-04-01T19:40:30.847 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011784559999999999 2024-04-01T19:40:30.847 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.847 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.847 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:30.847 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.295616+0000", 2024-04-01T19:40:30.847 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6582000000000002e-05 2024-04-01T19:40:30.847 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.848 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.848 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:30.848 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:28.295647+0000", 2024-04-01T19:40:30.848 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1676e-05 2024-04-01T19:40:30.848 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.848 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:30.848 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.848 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.848 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.848 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:168901 3.9 3:9a790eaf:::benchmark_data_smithi188_92122_object3310:head [delete] snapc 0=[] ondisk+write+known_if_redirected e226)", 2024-04-01T19:40:30.848 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:33.240638+0000", 2024-04-01T19:40:30.848 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 537.57810106299996, 2024-04-01T19:40:30.848 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034426845999999997, 2024-04-01T19:40:30.849 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:30.849 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:30.849 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:30.849 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:30.849 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:40:30.849 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:40:30.849 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 168901 2024-04-01T19:40:30.849 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.849 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:30.849 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.849 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:30.849 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240638+0000", 2024-04-01T19:40:30.849 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.849 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.849 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:30.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240638+0000", 2024-04-01T19:40:30.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.850 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:30.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240640+0000", 2024-04-01T19:40:30.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.429e-06 2024-04-01T19:40:30.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.850 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:30.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240646+0000", 2024-04-01T19:40:30.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5219999999999998e-06 2024-04-01T19:40:30.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.851 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:30.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240656+0000", 2024-04-01T19:40:30.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0791000000000001e-05 2024-04-01T19:40:30.851 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.851 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:30.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240665+0000", 2024-04-01T19:40:30.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6260000000000001e-06 2024-04-01T19:40:30.851 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.851 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:30.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240747+0000", 2024-04-01T19:40:30.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1833000000000001e-05 2024-04-01T19:40:30.851 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:30.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240873+0000", 2024-04-01T19:40:30.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000126203 2024-04-01T19:40:30.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:40:30.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240997+0000", 2024-04-01T19:40:30.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000124108 2024-04-01T19:40:30.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:30.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.247758+0000", 2024-04-01T19:40:30.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067612319999999998 2024-04-01T19:40:30.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.853 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:30.853 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.274954+0000", 2024-04-01T19:40:30.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027195286999999999 2024-04-01T19:40:30.853 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.853 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:30.853 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.275014+0000", 2024-04-01T19:40:30.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0677000000000002e-05 2024-04-01T19:40:30.853 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.853 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:30.853 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.275065+0000", 2024-04-01T19:40:30.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0138e-05 2024-04-01T19:40:30.853 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.853 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:30.853 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.854 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.854 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.854 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:168902 3.9 3:9c3bc715:::benchmark_data_smithi188_92122_object3311:head [delete] snapc 0=[] ondisk+write+known_if_redirected e226)", 2024-04-01T19:40:30.854 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:33.240687+0000", 2024-04-01T19:40:30.854 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 537.57805135499996, 2024-04-01T19:40:30.854 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034487716000000002, 2024-04-01T19:40:30.854 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:30.854 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:30.854 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:30.854 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:30.854 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:40:30.854 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:40:30.854 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 168902 2024-04-01T19:40:30.854 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.854 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:30.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:30.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240687+0000", 2024-04-01T19:40:30.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:30.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240687+0000", 2024-04-01T19:40:30.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:30.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240688+0000", 2024-04-01T19:40:30.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1399999999999996e-07 2024-04-01T19:40:30.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.856 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:30.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240691+0000", 2024-04-01T19:40:30.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.824e-06 2024-04-01T19:40:30.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.856 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:30.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240697+0000", 2024-04-01T19:40:30.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4210000000000003e-06 2024-04-01T19:40:30.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.856 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:30.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.240702+0000", 2024-04-01T19:40:30.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9889999999999997e-06 2024-04-01T19:40:30.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:30.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.244160+0000", 2024-04-01T19:40:30.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0034571820000000001 2024-04-01T19:40:30.857 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:30.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.244289+0000", 2024-04-01T19:40:30.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012960099999999999 2024-04-01T19:40:30.857 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:40:30.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.244434+0000", 2024-04-01T19:40:30.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014468 2024-04-01T19:40:30.857 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.858 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:30.858 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.256089+0000", 2024-04-01T19:40:30.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011655522999999999 2024-04-01T19:40:30.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.858 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:30.858 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.275101+0000", 2024-04-01T19:40:30.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019011954000000001 2024-04-01T19:40:30.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.858 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:30.858 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.275142+0000", 2024-04-01T19:40:30.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0465e-05 2024-04-01T19:40:30.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:30.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.275175+0000", 2024-04-01T19:40:30.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3263000000000003e-05 2024-04-01T19:40:30.859 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.859 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:30.859 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.859 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:168903 3.9 3:9ad3f095:::benchmark_data_smithi188_92122_object3312:head [delete] snapc 0=[] ondisk+write+known_if_redirected e226)", 2024-04-01T19:40:30.859 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:33.245855+0000", 2024-04-01T19:40:30.859 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 537.57288380399996, 2024-04-01T19:40:30.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029426130000000002, 2024-04-01T19:40:30.859 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:30.859 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:30.860 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:30.860 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:30.860 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:40:30.860 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:40:30.860 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 168903 2024-04-01T19:40:30.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.860 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:30.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.860 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:30.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.245855+0000", 2024-04-01T19:40:30.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.860 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:30.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.245855+0000", 2024-04-01T19:40:30.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:30.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.245858+0000", 2024-04-01T19:40:30.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7010000000000001e-06 2024-04-01T19:40:30.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:30.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.245865+0000", 2024-04-01T19:40:30.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9e-06 2024-04-01T19:40:30.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:30.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.245880+0000", 2024-04-01T19:40:30.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5534000000000001e-05 2024-04-01T19:40:30.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:30.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.245890+0000", 2024-04-01T19:40:30.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7240000000000004e-06 2024-04-01T19:40:30.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:30.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.247793+0000", 2024-04-01T19:40:30.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0019034849999999999 2024-04-01T19:40:30.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:30.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.247909+0000", 2024-04-01T19:40:30.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000115463 2024-04-01T19:40:30.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:40:30.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.248024+0000", 2024-04-01T19:40:30.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000115439 2024-04-01T19:40:30.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:30.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.260247+0000", 2024-04-01T19:40:30.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012222749999999999 2024-04-01T19:40:30.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:30.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.275208+0000", 2024-04-01T19:40:30.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014960588 2024-04-01T19:40:30.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:30.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.275247+0000", 2024-04-01T19:40:30.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9628000000000001e-05 2024-04-01T19:40:30.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:30.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.275281+0000", 2024-04-01T19:40:30.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3918000000000003e-05 2024-04-01T19:40:30.865 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.865 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:30.865 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.865 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:168904 3.9 3:90476aec:::benchmark_data_smithi188_92122_object3313:head [delete] snapc 0=[] ondisk+write+known_if_redirected e226)", 2024-04-01T19:40:30.865 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:33.247843+0000", 2024-04-01T19:40:30.865 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 537.57089547199996, 2024-04-01T19:40:30.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027547312000000001, 2024-04-01T19:40:30.865 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:30.865 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:30.865 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:30.865 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:30.865 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:40:30.866 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:40:30.866 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 168904 2024-04-01T19:40:30.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.866 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:30.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:30.866 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.247843+0000", 2024-04-01T19:40:30.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:30.866 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.247843+0000", 2024-04-01T19:40:30.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:30.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.247845+0000", 2024-04-01T19:40:30.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4279999999999999e-06 2024-04-01T19:40:30.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:30.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.247851+0000", 2024-04-01T19:40:30.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8680000000000004e-06 2024-04-01T19:40:30.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:30.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.247859+0000", 2024-04-01T19:40:30.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2649999999999996e-06 2024-04-01T19:40:30.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:30.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.247867+0000", 2024-04-01T19:40:30.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1289999999999996e-06 2024-04-01T19:40:30.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:30.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.252198+0000", 2024-04-01T19:40:30.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0043308679999999999 2024-04-01T19:40:30.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:30.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.252300+0000", 2024-04-01T19:40:30.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000102105 2024-04-01T19:40:30.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:40:30.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.252389+0000", 2024-04-01T19:40:30.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8980999999999994e-05 2024-04-01T19:40:30.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:30.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.260252+0000", 2024-04-01T19:40:30.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0078629990000000007 2024-04-01T19:40:30.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:30.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.275314+0000", 2024-04-01T19:40:30.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015061779000000001 2024-04-01T19:40:30.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:30.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.275359+0000", 2024-04-01T19:40:30.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5666e-05 2024-04-01T19:40:30.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:30.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:33.275391+0000", 2024-04-01T19:40:30.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1223999999999998e-05 2024-04-01T19:40:30.870 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.870 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:30.870 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.870 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:172598 3.9 3:9cf4f1c3:::benchmark_data_smithi188_92122_object7007:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-04-01T19:40:30.870 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:36.272444+0000", 2024-04-01T19:40:30.871 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 534.54629512199995, 2024-04-01T19:40:30.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.032034100000000003, 2024-04-01T19:40:30.871 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:30.871 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:30.871 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:30.871 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:30.871 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:40:30.871 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:40:30.871 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 172598 2024-04-01T19:40:30.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.871 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:30.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:30.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.272444+0000", 2024-04-01T19:40:30.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:30.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.272444+0000", 2024-04-01T19:40:30.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:30.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.272445+0000", 2024-04-01T19:40:30.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.578e-06 2024-04-01T19:40:30.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:30.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.272450+0000", 2024-04-01T19:40:30.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0019999999999997e-06 2024-04-01T19:40:30.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:30.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.272462+0000", 2024-04-01T19:40:30.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1357e-05 2024-04-01T19:40:30.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:30.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.272469+0000", 2024-04-01T19:40:30.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.357e-06 2024-04-01T19:40:30.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:30.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.274667+0000", 2024-04-01T19:40:30.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0021985070000000002 2024-04-01T19:40:30.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:30.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.274791+0000", 2024-04-01T19:40:30.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012366800000000001 2024-04-01T19:40:30.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:40:30.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.274917+0000", 2024-04-01T19:40:30.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012541700000000001 2024-04-01T19:40:30.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:30.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.289080+0000", 2024-04-01T19:40:30.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014163904999999999 2024-04-01T19:40:30.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:30.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.304382+0000", 2024-04-01T19:40:30.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015301248 2024-04-01T19:40:30.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:30.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.304440+0000", 2024-04-01T19:40:30.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8087000000000001e-05 2024-04-01T19:40:30.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:30.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.304478+0000", 2024-04-01T19:40:30.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7973999999999999e-05 2024-04-01T19:40:30.876 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.876 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:30.876 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.876 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:172599 3.9 3:97be2d43:::benchmark_data_smithi188_92122_object7008:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-04-01T19:40:30.876 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:36.272484+0000", 2024-04-01T19:40:30.877 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 534.54625448599995, 2024-04-01T19:40:30.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.032104537000000002, 2024-04-01T19:40:30.877 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:30.877 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:30.877 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:30.877 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:30.877 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:40:30.877 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:40:30.877 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 172599 2024-04-01T19:40:30.877 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.877 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:30.877 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.877 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:30.877 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.272484+0000", 2024-04-01T19:40:30.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.878 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.878 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.878 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:30.878 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.272484+0000", 2024-04-01T19:40:30.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.878 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.878 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.878 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:30.878 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.272485+0000", 2024-04-01T19:40:30.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.44e-07 2024-04-01T19:40:30.878 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.878 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.878 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:30.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.272488+0000", 2024-04-01T19:40:30.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6170000000000001e-06 2024-04-01T19:40:30.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:30.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.272493+0000", 2024-04-01T19:40:30.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4020000000000001e-06 2024-04-01T19:40:30.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:30.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.272498+0000", 2024-04-01T19:40:30.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0039999999999999e-06 2024-04-01T19:40:30.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:30.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.278534+0000", 2024-04-01T19:40:30.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006036451 2024-04-01T19:40:30.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:30.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.278642+0000", 2024-04-01T19:40:30.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000107632 2024-04-01T19:40:30.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:40:30.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.278753+0000", 2024-04-01T19:40:30.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011083500000000001 2024-04-01T19:40:30.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:30.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.289088+0000", 2024-04-01T19:40:30.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010334826 2024-04-01T19:40:30.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:30.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.304525+0000", 2024-04-01T19:40:30.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015437288 2024-04-01T19:40:30.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:30.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.304554+0000", 2024-04-01T19:40:30.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8683999999999998e-05 2024-04-01T19:40:30.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:30.882 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.304589+0000", 2024-04-01T19:40:30.882 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5154000000000003e-05 2024-04-01T19:40:30.882 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.882 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:30.882 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.882 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.882 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.882 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:172604 3.9 3:927c03aa:::benchmark_data_smithi188_92122_object7013:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-04-01T19:40:30.882 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:36.277529+0000", 2024-04-01T19:40:30.882 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 534.54121023100004, 2024-04-01T19:40:30.882 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029372993999999999, 2024-04-01T19:40:30.883 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:30.883 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:30.883 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:30.883 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:30.883 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:40:30.883 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:40:30.883 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 172604 2024-04-01T19:40:30.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.883 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:30.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:30.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.277529+0000", 2024-04-01T19:40:30.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:30.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.277529+0000", 2024-04-01T19:40:30.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:30.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.277531+0000", 2024-04-01T19:40:30.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.429e-06 2024-04-01T19:40:30.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:30.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.277538+0000", 2024-04-01T19:40:30.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1829999999999997e-06 2024-04-01T19:40:30.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.885 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:30.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.277551+0000", 2024-04-01T19:40:30.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2541000000000001e-05 2024-04-01T19:40:30.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.885 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:30.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.277558+0000", 2024-04-01T19:40:30.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5159999999999997e-06 2024-04-01T19:40:30.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.885 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:30.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.282682+0000", 2024-04-01T19:40:30.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0051240039999999997 2024-04-01T19:40:30.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:30.886 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.282765+0000", 2024-04-01T19:40:30.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2850999999999997e-05 2024-04-01T19:40:30.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:40:30.886 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.282883+0000", 2024-04-01T19:40:30.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011825 2024-04-01T19:40:30.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:30.886 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.292783+0000", 2024-04-01T19:40:30.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0098992799999999999 2024-04-01T19:40:30.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:30.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.306811+0000", 2024-04-01T19:40:30.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014028250000000001 2024-04-01T19:40:30.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:30.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.306861+0000", 2024-04-01T19:40:30.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0501999999999999e-05 2024-04-01T19:40:30.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:30.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.306902+0000", 2024-04-01T19:40:30.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0188000000000002e-05 2024-04-01T19:40:30.887 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.887 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:30.888 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.888 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:172616 3.9 3:933f80de:::benchmark_data_smithi188_92122_object7025:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-04-01T19:40:30.888 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:36.288390+0000", 2024-04-01T19:40:30.888 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 534.53034860399998, 2024-04-01T19:40:30.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029023908000000001, 2024-04-01T19:40:30.888 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:30.888 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:30.888 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:30.888 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:30.888 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:40:30.888 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:40:30.888 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 172616 2024-04-01T19:40:30.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.889 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:30.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:30.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.288390+0000", 2024-04-01T19:40:30.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:30.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.288390+0000", 2024-04-01T19:40:30.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:30.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.288392+0000", 2024-04-01T19:40:30.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1969999999999999e-06 2024-04-01T19:40:30.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:30.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.288399+0000", 2024-04-01T19:40:30.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1469999999999998e-06 2024-04-01T19:40:30.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:30.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.288412+0000", 2024-04-01T19:40:30.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3237999999999999e-05 2024-04-01T19:40:30.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:30.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.288419+0000", 2024-04-01T19:40:30.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6990000000000003e-06 2024-04-01T19:40:30.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:30.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.289118+0000", 2024-04-01T19:40:30.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00069862799999999997 2024-04-01T19:40:30.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:30.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.289245+0000", 2024-04-01T19:40:30.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012723899999999999 2024-04-01T19:40:30.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:40:30.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.289380+0000", 2024-04-01T19:40:30.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013506100000000001 2024-04-01T19:40:30.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:30.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.300775+0000", 2024-04-01T19:40:30.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011394757 2024-04-01T19:40:30.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:30.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.317302+0000", 2024-04-01T19:40:30.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016526948999999999 2024-04-01T19:40:30.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:30.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.317367+0000", 2024-04-01T19:40:30.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4976999999999998e-05 2024-04-01T19:40:30.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:30.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.317414+0000", 2024-04-01T19:40:30.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7015999999999998e-05 2024-04-01T19:40:30.893 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.893 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:30.894 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.894 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:172618 3.9 3:97819161:::benchmark_data_smithi188_92122_object7027:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-04-01T19:40:30.894 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:36.288595+0000", 2024-04-01T19:40:30.894 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 534.53014411699996, 2024-04-01T19:40:30.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031716123999999998, 2024-04-01T19:40:30.894 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:30.894 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:30.894 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:30.894 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:30.894 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:40:30.894 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:40:30.895 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 172618 2024-04-01T19:40:30.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.895 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:30.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:30.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.288595+0000", 2024-04-01T19:40:30.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:30.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.288595+0000", 2024-04-01T19:40:30.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:30.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.288596+0000", 2024-04-01T19:40:30.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1299999999999998e-07 2024-04-01T19:40:30.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:30.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.288599+0000", 2024-04-01T19:40:30.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5889999999999999e-06 2024-04-01T19:40:30.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:30.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.288607+0000", 2024-04-01T19:40:30.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1110000000000008e-06 2024-04-01T19:40:30.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:30.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.288613+0000", 2024-04-01T19:40:30.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8579999999999996e-06 2024-04-01T19:40:30.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.897 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:30.897 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.292831+0000", 2024-04-01T19:40:30.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0042178090000000003 2024-04-01T19:40:30.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.897 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:30.897 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.292946+0000", 2024-04-01T19:40:30.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000114683 2024-04-01T19:40:30.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.897 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:40:30.897 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.293015+0000", 2024-04-01T19:40:30.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8924999999999995e-05 2024-04-01T19:40:30.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:30.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.300780+0000", 2024-04-01T19:40:30.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077651810000000003 2024-04-01T19:40:30.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:30.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.320231+0000", 2024-04-01T19:40:30.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019451428 2024-04-01T19:40:30.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:30.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.320278+0000", 2024-04-01T19:40:30.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6477000000000002e-05 2024-04-01T19:40:30.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:30.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.320311+0000", 2024-04-01T19:40:30.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3149999999999999e-05 2024-04-01T19:40:30.899 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.899 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:30.899 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.899 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:172621 3.9 3:944d919c:::benchmark_data_smithi188_92122_object7030:head [delete] snapc 0=[] ondisk+write+known_if_redirected e227)", 2024-04-01T19:40:30.899 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:31:36.292038+0000", 2024-04-01T19:40:30.899 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 534.52670083500004, 2024-04-01T19:40:30.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028436669000000001, 2024-04-01T19:40:30.900 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:30.900 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:30.900 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:30.900 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:30.900 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:40:30.900 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:40:30.900 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 172621 2024-04-01T19:40:30.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.900 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:30.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:30.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.292038+0000", 2024-04-01T19:40:30.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:30.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.292038+0000", 2024-04-01T19:40:30.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:30.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.292040+0000", 2024-04-01T19:40:30.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.731e-06 2024-04-01T19:40:30.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:30.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.292045+0000", 2024-04-01T19:40:30.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4349999999999996e-06 2024-04-01T19:40:30.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:30.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.292056+0000", 2024-04-01T19:40:30.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1325000000000001e-05 2024-04-01T19:40:30.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:30.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.292063+0000", 2024-04-01T19:40:30.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2790000000000004e-06 2024-04-01T19:40:30.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:30.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.296540+0000", 2024-04-01T19:40:30.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0044769759999999997 2024-04-01T19:40:30.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:30.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.296663+0000", 2024-04-01T19:40:30.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012368200000000001 2024-04-01T19:40:30.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:40:30.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.296800+0000", 2024-04-01T19:40:30.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000136327 2024-04-01T19:40:30.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:30.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.304491+0000", 2024-04-01T19:40:30.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076913110000000002 2024-04-01T19:40:30.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:30.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.320378+0000", 2024-04-01T19:40:30.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015886498999999998 2024-04-01T19:40:30.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:30.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.320429+0000", 2024-04-01T19:40:30.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1873999999999998e-05 2024-04-01T19:40:30.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:30.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:31:36.320475+0000", 2024-04-01T19:40:30.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5229999999999999e-05 2024-04-01T19:40:30.905 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.905 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:30.905 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.905 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:206792 3.9 3:9697cd20:::benchmark_data_smithi188_92122_object41201:head [delete] snapc 0=[] ondisk+write+known_if_redirected e233)", 2024-04-01T19:40:30.906 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:32:03.257189+0000", 2024-04-01T19:40:30.906 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 507.56154970900002, 2024-04-01T19:40:30.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029571714999999998, 2024-04-01T19:40:30.906 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:30.906 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:30.906 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:30.906 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:30.906 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:40:30.906 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:40:30.906 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 206792 2024-04-01T19:40:30.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.907 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:30.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:30.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257189+0000", 2024-04-01T19:40:30.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:30.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257189+0000", 2024-04-01T19:40:30.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:30.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257191+0000", 2024-04-01T19:40:30.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9460000000000001e-06 2024-04-01T19:40:30.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:30.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257196+0000", 2024-04-01T19:40:30.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3319999999999999e-06 2024-04-01T19:40:30.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:30.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257209+0000", 2024-04-01T19:40:30.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2907e-05 2024-04-01T19:40:30.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:30.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257228+0000", 2024-04-01T19:40:30.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8904999999999999e-05 2024-04-01T19:40:30.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:30.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257327+0000", 2024-04-01T19:40:30.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8431999999999995e-05 2024-04-01T19:40:30.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:30.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257440+0000", 2024-04-01T19:40:30.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000113812 2024-04-01T19:40:30.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:40:30.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257544+0000", 2024-04-01T19:40:30.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010329 2024-04-01T19:40:30.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:30.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.265602+0000", 2024-04-01T19:40:30.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080578430000000003 2024-04-01T19:40:30.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:30.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.286665+0000", 2024-04-01T19:40:30.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.021063620000000002 2024-04-01T19:40:30.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:30.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.286714+0000", 2024-04-01T19:40:30.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9288e-05 2024-04-01T19:40:30.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:30.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.286761+0000", 2024-04-01T19:40:30.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.634e-05 2024-04-01T19:40:30.912 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.912 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:30.912 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.912 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:206795 3.9 3:992bcee8:::benchmark_data_smithi188_92122_object41204:head [delete] snapc 0=[] ondisk+write+known_if_redirected e233)", 2024-04-01T19:40:30.912 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:32:03.257247+0000", 2024-04-01T19:40:30.912 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 507.56149149399999, 2024-04-01T19:40:30.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029662869000000001, 2024-04-01T19:40:30.912 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:30.912 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:30.912 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:30.912 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:30.913 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:40:30.913 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:40:30.913 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 206795 2024-04-01T19:40:30.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.913 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:30.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:30.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257247+0000", 2024-04-01T19:40:30.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:30.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257247+0000", 2024-04-01T19:40:30.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:30.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257248+0000", 2024-04-01T19:40:30.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1800000000000005e-07 2024-04-01T19:40:30.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:30.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257251+0000", 2024-04-01T19:40:30.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9790000000000002e-06 2024-04-01T19:40:30.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:30.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257258+0000", 2024-04-01T19:40:30.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7939999999999997e-06 2024-04-01T19:40:30.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:30.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.257263+0000", 2024-04-01T19:40:30.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1789999999999999e-06 2024-04-01T19:40:30.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:30.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.261883+0000", 2024-04-01T19:40:30.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.004619672 2024-04-01T19:40:30.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:30.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.262001+0000", 2024-04-01T19:40:30.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117818 2024-04-01T19:40:30.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:40:30.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.262127+0000", 2024-04-01T19:40:30.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012600799999999999 2024-04-01T19:40:30.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:30.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.265794+0000", 2024-04-01T19:40:30.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036671009999999999 2024-04-01T19:40:30.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:30.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.286823+0000", 2024-04-01T19:40:30.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.021029711999999999 2024-04-01T19:40:30.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:30.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.286870+0000", 2024-04-01T19:40:30.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6776000000000001e-05 2024-04-01T19:40:30.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:30.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:03.286910+0000", 2024-04-01T19:40:30.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0012000000000002e-05 2024-04-01T19:40:30.917 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.917 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:30.918 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.918 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:233380 3.9 3:9f878984:::benchmark_data_smithi188_92122_object67789:head [delete] snapc 0=[] ondisk+write+known_if_redirected e240)", 2024-04-01T19:40:30.918 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:32:24.276074+0000", 2024-04-01T19:40:30.918 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 486.54266456200003, 2024-04-01T19:40:30.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029768269999999999, 2024-04-01T19:40:30.918 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:30.918 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:30.918 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:30.918 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:30.918 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:40:30.918 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:40:30.919 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 233380 2024-04-01T19:40:30.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.919 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:30.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:30.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.276074+0000", 2024-04-01T19:40:30.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:30.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.276074+0000", 2024-04-01T19:40:30.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:30.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.276076+0000", 2024-04-01T19:40:30.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0549999999999998e-06 2024-04-01T19:40:30.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:30.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.276083+0000", 2024-04-01T19:40:30.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.601e-06 2024-04-01T19:40:30.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:30.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.276097+0000", 2024-04-01T19:40:30.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.447e-05 2024-04-01T19:40:30.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:30.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.276104+0000", 2024-04-01T19:40:30.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2190000000000001e-06 2024-04-01T19:40:30.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:30.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.280914+0000", 2024-04-01T19:40:30.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0048100959999999998 2024-04-01T19:40:30.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:30.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.281039+0000", 2024-04-01T19:40:30.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012482899999999999 2024-04-01T19:40:30.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:40:30.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.281153+0000", 2024-04-01T19:40:30.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000114386 2024-04-01T19:40:30.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:30.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.294101+0000", 2024-04-01T19:40:30.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012947718 2024-04-01T19:40:30.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:30.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.305758+0000", 2024-04-01T19:40:30.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011657410999999999 2024-04-01T19:40:30.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:30.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.305792+0000", 2024-04-01T19:40:30.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4387000000000001e-05 2024-04-01T19:40:30.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:30.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:32:24.305843+0000", 2024-04-01T19:40:30.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0098e-05 2024-04-01T19:40:30.923 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.923 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:30.923 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.924 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:288104 3.9 3:99586915:::benchmark_data_smithi188_92122_object122513:head [delete] snapc 0=[] ondisk+write+known_if_redirected e249)", 2024-04-01T19:40:30.924 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:33:08.991272+0000", 2024-04-01T19:40:30.924 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 441.82746680100001, 2024-04-01T19:40:30.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033197938000000003, 2024-04-01T19:40:30.924 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:30.924 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:30.924 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:30.924 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:30.924 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:40:30.924 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:40:30.924 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 288104 2024-04-01T19:40:30.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.924 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:30.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:30.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:08.991272+0000", 2024-04-01T19:40:30.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:30.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:08.991272+0000", 2024-04-01T19:40:30.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:30.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:08.991274+0000", 2024-04-01T19:40:30.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.12e-06 2024-04-01T19:40:30.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:30.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:08.991281+0000", 2024-04-01T19:40:30.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5309999999999998e-06 2024-04-01T19:40:30.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:30.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:08.991289+0000", 2024-04-01T19:40:30.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5310000000000001e-06 2024-04-01T19:40:30.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:30.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:08.991298+0000", 2024-04-01T19:40:30.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4309999999999994e-06 2024-04-01T19:40:30.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:30.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:08.991373+0000", 2024-04-01T19:40:30.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5236999999999998e-05 2024-04-01T19:40:30.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:30.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:08.991493+0000", 2024-04-01T19:40:30.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119716 2024-04-01T19:40:30.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:40:30.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:08.991594+0000", 2024-04-01T19:40:30.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010182499999999999 2024-04-01T19:40:30.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:30.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:08.996257+0000", 2024-04-01T19:40:30.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046627750000000001 2024-04-01T19:40:30.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:30.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:09.024370+0000", 2024-04-01T19:40:30.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028113082000000001 2024-04-01T19:40:30.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:30.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:09.024426+0000", 2024-04-01T19:40:30.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5368000000000003e-05 2024-04-01T19:40:30.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:30.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:09.024470+0000", 2024-04-01T19:40:30.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4322e-05 2024-04-01T19:40:30.929 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.929 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:30.929 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.929 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25117.0:294144 3.9 3:98ed1b01:::benchmark_data_smithi188_92122_object128553:head [delete] snapc 0=[] ondisk+write+known_if_redirected e252)", 2024-04-01T19:40:30.929 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:33:14.001589+0000", 2024-04-01T19:40:30.929 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 436.81714941799999, 2024-04-01T19:40:30.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034811092000000002, 2024-04-01T19:40:30.929 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:40:30.929 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:40:30.929 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:40:30.930 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:40:30.930 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25117", 2024-04-01T19:40:30.930 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3532267189", 2024-04-01T19:40:30.930 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 294144 2024-04-01T19:40:30.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.930 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:40:30.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:40:30.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.001589+0000", 2024-04-01T19:40:30.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:40:30.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.001589+0000", 2024-04-01T19:40:30.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:40:30.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:40:30.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.001591+0000", 2024-04-01T19:40:30.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.48e-06 2024-04-01T19:40:30.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:40:30.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.001596+0000", 2024-04-01T19:40:30.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6999999999999999e-06 2024-04-01T19:40:30.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:40:30.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.001609+0000", 2024-04-01T19:40:30.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3335e-05 2024-04-01T19:40:30.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:40:30.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.001616+0000", 2024-04-01T19:40:30.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4850000000000003e-06 2024-04-01T19:40:30.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:40:30.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.009625+0000", 2024-04-01T19:40:30.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080084990000000005 2024-04-01T19:40:30.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:40:30.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.009741+0000", 2024-04-01T19:40:30.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000116118 2024-04-01T19:40:30.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 11", 2024-04-01T19:40:30.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.009855+0000", 2024-04-01T19:40:30.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011373400000000001 2024-04-01T19:40:30.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:40:30.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.022482+0000", 2024-04-01T19:40:30.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012627189 2024-04-01T19:40:30.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:40:30.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.036302+0000", 2024-04-01T19:40:30.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013820569 2024-04-01T19:40:30.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:40:30.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.036359+0000", 2024-04-01T19:40:30.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6107999999999999e-05 2024-04-01T19:40:30.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:40:30.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:40:30.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:40:30.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:33:14.036400+0000", 2024-04-01T19:40:30.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1875000000000001e-05 2024-04-01T19:40:30.935 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.935 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:30.935 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.935 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:40:30.935 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:40:30.935 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:40:31.321 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:31 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2417321287' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]': finished 2024-04-01T19:40:31.321 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:31 smithi022 ceph-mon[39439]: osdmap e392: 12 total, 12 up, 11 in 2024-04-01T19:40:31.454 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 10 1 2024-04-01T19:40:31.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:31 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2417321287' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]': finished 2024-04-01T19:40:31.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:31 smithi188 ceph-mon[43939]: osdmap e392: 12 total, 12 up, 11 in 2024-04-01T19:40:31.583 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_ops_in_flight 2024-04-01T19:40:31.612 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:31 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2417321287' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]': finished 2024-04-01T19:40:31.612 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:31 smithi062 ceph-mon[44211]: osdmap e392: 12 total, 12 up, 11 in 2024-04-01T19:40:31.628 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:40:31.633 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 57 16 127294 127278 139.538 87.625 0.0208907 0.00716484 2024-04-01T19:40:31.636 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:31.637 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:40:31.737 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:40:31.779 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:31.805 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:40:31.808 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:31.809 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:40:31.910 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:40:31.945 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:31.968 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:40:31.969 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:40:31.971 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:31.972 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:40:32.073 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:40:32.135 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:32.337 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:32 smithi022 ceph-mon[39439]: pgmap v1102: 17 pgs: 17 active+clean; 7.5 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 109 MiB/s wr, 1.75k op/s 2024-04-01T19:40:32.337 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:32 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1036675333' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:40:32.341 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:40:32.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:32 smithi062 ceph-mon[44211]: pgmap v1102: 17 pgs: 17 active+clean; 7.5 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 109 MiB/s wr, 1.75k op/s 2024-04-01T19:40:32.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:32 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1036675333' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:40:32.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:32 smithi188 ceph-mon[43939]: pgmap v1102: 17 pgs: 17 active+clean; 7.5 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 109 MiB/s wr, 1.75k op/s 2024-04-01T19:40:32.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:32 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1036675333' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:40:32.633 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 58 16 128586 128570 138.525 80.75 0.00551333 0.00721741 2024-04-01T19:40:33.338 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:33 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:40:33.338 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:33 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:40:33.338 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:33 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1036675333' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:40:33.339 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:33 smithi022 ceph-mon[39439]: osdmap e393: 12 total, 12 up, 11 in 2024-04-01T19:40:33.411 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:33.412 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:40:33.412 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:40:33.462 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:33 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:40:33.462 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:33 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:40:33.463 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:33 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1036675333' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:40:33.463 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:33 smithi062 ceph-mon[44211]: osdmap e393: 12 total, 12 up, 11 in 2024-04-01T19:40:33.513 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:40:33.567 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:33 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:40:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:33 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:40:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:33 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1036675333' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:40:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:33 smithi188 ceph-mon[43939]: osdmap e393: 12 total, 12 up, 11 in 2024-04-01T19:40:33.633 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 59 16 129976 129960 137.649 86.875 0.00733347 0.00726314 2024-04-01T19:40:33.893 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:40:33.900 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:33.901 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:40:34.002 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:40:34.034 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:34.062 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:40:34.065 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:34.065 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:40:34.166 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:40:34.187 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:40:34.187 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:40:34.187 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:40:34.188 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.25864.0:130536 5.3 e393/364 5:c13b0232:::benchmark_data_smithi188_119427_object130535:head v 393'8186, mlcod=393'8184)", 2024-04-01T19:40:34.188 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:40:34.189456+0000", 2024-04-01T19:40:34.188 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.000679632, 2024-04-01T19:40:34.188 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00070088300000000002, 2024-04-01T19:40:34.188 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:40:34.188 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:40:34.188 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "started", 2024-04-01T19:40:34.188 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:40:34.188 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:40:34.188 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:40:34.188 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:34.189456+0000", 2024-04-01T19:40:34.188 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:40:34.188 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:40:34.189 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:40:34.189 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:40:34.189 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:34.189456+0000", 2024-04-01T19:40:34.189 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:40:34.189 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:40:34.189 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:40:34.189 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:40:34.189 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:34.189457+0000", 2024-04-01T19:40:34.189 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.7e-07 2024-04-01T19:40:34.189 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:40:34.189 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:40:34.189 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:40:34.189 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:34.189482+0000", 2024-04-01T19:40:34.190 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.5548e-05 2024-04-01T19:40:34.190 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:40:34.190 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:40:34.190 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:40:34.190 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:34.189487+0000", 2024-04-01T19:40:34.190 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3429999999999998e-06 2024-04-01T19:40:34.190 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:40:34.190 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:40:34.190 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:40:34.190 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:34.189490+0000", 2024-04-01T19:40:34.190 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.4199999999999999e-06 2024-04-01T19:40:34.190 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:40:34.190 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:40:34.191 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:40:34.191 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:34.189533+0000", 2024-04-01T19:40:34.191 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3117000000000001e-05 2024-04-01T19:40:34.191 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:40:34.191 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:40:34.191 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:40:34.191 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:34.189555+0000", 2024-04-01T19:40:34.191 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.2252999999999999e-05 2024-04-01T19:40:34.191 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:40:34.191 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:40:34.191 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:40:34.191 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:40:34.191 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-04-01T19:40:34.191 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 1 2024-04-01T19:40:34.192 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:40:34.229 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:34.231 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:40:34.231 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:40:34.231 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:40:34.231 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:40:34.231 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:40:34.232 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:40:34.262 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:40:34.267 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:40:34.268 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:40:34.271 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:34.271 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:40:34.309 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:40:34.347 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:34 smithi022 ceph-mon[39439]: pgmap v1104: 17 pgs: 17 active+clean; 7.7 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 71 MiB/s wr, 1.14k op/s 2024-04-01T19:40:34.347 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:34 smithi022 ceph-mon[39439]: 5.8 scrub starts 2024-04-01T19:40:34.347 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:34 smithi022 ceph-mon[39439]: 5.a scrub starts 2024-04-01T19:40:34.347 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:34 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:40:34.348 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:34 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/710693965' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:40:34.348 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:34.348 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:34.348 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:34.348 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:34.348 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:34.348 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:34 smithi022 ceph-mon[39439]: 5.f scrub starts 2024-04-01T19:40:34.352 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:40:34.372 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:40:34.402 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:40:34.437 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:40:34.440 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:34.486 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:40:34.490 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:34.491 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:40:34.491 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:40:34.506 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:40:34.506 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:40:34.506 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:40:34.506 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:40:34.506 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:40:34.507 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:40:34.507 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:40:34.507 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:40:34.507 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:40:34.507 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:40:34.507 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:40:34.507 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:40:34.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:34 smithi062 ceph-mon[44211]: pgmap v1104: 17 pgs: 17 active+clean; 7.7 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 71 MiB/s wr, 1.14k op/s 2024-04-01T19:40:34.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:34 smithi062 ceph-mon[44211]: 5.8 scrub starts 2024-04-01T19:40:34.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:34 smithi062 ceph-mon[44211]: 5.a scrub starts 2024-04-01T19:40:34.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:34 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:40:34.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:34 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/710693965' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:40:34.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:34.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:34.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:34.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:34.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:34.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:34 smithi062 ceph-mon[44211]: 5.f scrub starts 2024-04-01T19:40:34.592 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:40:34.623 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:34.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:34 smithi188 ceph-mon[43939]: pgmap v1104: 17 pgs: 17 active+clean; 7.7 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 71 MiB/s wr, 1.14k op/s 2024-04-01T19:40:34.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:34 smithi188 ceph-mon[43939]: 5.8 scrub starts 2024-04-01T19:40:34.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:34 smithi188 ceph-mon[43939]: 5.a scrub starts 2024-04-01T19:40:34.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:34 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:40:34.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:34 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/710693965' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:40:34.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:34.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:34.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:34.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:34.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:34.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:34 smithi188 ceph-mon[43939]: 5.f scrub starts 2024-04-01T19:40:34.634 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:40:34.637107 min lat: 0.00113025 max lat: 0.209539 avg lat: 0.00732971 2024-04-01T19:40:34.634 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:40:34.634 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 60 16 130987 130971 136.408 63.1875 0.0137657 0.00732971 2024-04-01T19:40:34.648 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:40:34.651 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:34.652 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:40:34.753 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:40:34.783 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:34.817 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:40:34.820 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:34.820 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:40:34.921 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:40:34.970 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:35.360 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:35.360 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:35.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:35 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:40:35.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:35 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:40:35.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:35.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:35.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:35 smithi022 ceph-mon[39439]: osdmap e394: 12 total, 12 up, 11 in 2024-04-01T19:40:35.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:35.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:35.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:35.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:35 smithi022 ceph-mon[39439]: osdmap e395: 12 total, 12 up, 11 in 2024-04-01T19:40:35.427 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_blocked_ops 2024-04-01T19:40:35.464 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:40:35.470 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:35.471 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:40:35.572 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:40:35.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:35 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:40:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:35 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:40:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:35 smithi188 ceph-mon[43939]: osdmap e394: 12 total, 12 up, 11 in 2024-04-01T19:40:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:35 smithi188 ceph-mon[43939]: osdmap e395: 12 total, 12 up, 11 in 2024-04-01T19:40:35.625 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:35.634 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 61 16 132164 132148 135.378 73.5625 0.00640698 0.00738458 2024-04-01T19:40:35.718 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:40:35.724 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:35.724 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:40:35.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:35.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:35.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:35 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:40:35.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:35 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:40:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:35 smithi062 ceph-mon[44211]: osdmap e394: 12 total, 12 up, 11 in 2024-04-01T19:40:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:35 smithi062 ceph-mon[44211]: osdmap e395: 12 total, 12 up, 11 in 2024-04-01T19:40:35.772 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:40:35.825 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:40:35.860 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:35.882 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:40:35.886 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:35.886 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:40:35.987 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:40:36.026 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:36.050 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:40:36.051 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:36.052 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:40:36.122 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:40:36.153 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:40:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:36.323 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:40:36.329 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:36.329 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:40:36.430 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:40:36.468 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:36.540 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:36 smithi022 ceph-mon[39439]: pgmap v1106: 17 pgs: 17 active+clean; 7.7 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 72 MiB/s wr, 1.14k op/s 2024-04-01T19:40:36.540 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:36 smithi022 ceph-mon[39439]: 5.8 scrub ok 2024-04-01T19:40:36.540 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:36 smithi022 ceph-mon[39439]: 5.4 deep-scrub starts 2024-04-01T19:40:36.540 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:36 smithi022 ceph-mon[39439]: 5.f scrub ok 2024-04-01T19:40:36.540 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:36 smithi022 ceph-mon[39439]: 5.a scrub ok 2024-04-01T19:40:36.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:36 smithi188 ceph-mon[43939]: pgmap v1106: 17 pgs: 17 active+clean; 7.7 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 72 MiB/s wr, 1.14k op/s 2024-04-01T19:40:36.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:36 smithi188 ceph-mon[43939]: 5.8 scrub ok 2024-04-01T19:40:36.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:36 smithi188 ceph-mon[43939]: 5.4 deep-scrub starts 2024-04-01T19:40:36.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:36 smithi188 ceph-mon[43939]: 5.f scrub ok 2024-04-01T19:40:36.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:36 smithi188 ceph-mon[43939]: 5.a scrub ok 2024-04-01T19:40:36.634 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 62 16 133283 133267 134.323 69.9375 0.0133118 0.00744345 2024-04-01T19:40:36.731 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:40:36.734 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:36 smithi062 ceph-mon[44211]: pgmap v1106: 17 pgs: 17 active+clean; 7.7 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 72 MiB/s wr, 1.14k op/s 2024-04-01T19:40:36.734 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:36 smithi062 ceph-mon[44211]: 5.8 scrub ok 2024-04-01T19:40:36.734 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:36 smithi062 ceph-mon[44211]: 5.4 deep-scrub starts 2024-04-01T19:40:36.734 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:36 smithi062 ceph-mon[44211]: 5.f scrub ok 2024-04-01T19:40:36.734 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:36 smithi062 ceph-mon[44211]: 5.a scrub ok 2024-04-01T19:40:36.735 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:36.735 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:40:36.836 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:40:36.868 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:36.888 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:40:36.892 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:36.892 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:40:36.994 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:40:37.026 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:37.280 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:40:37.285 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:37.285 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:40:37.387 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:40:37.399 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.10 to 1 (10000) 2024-04-01T19:40:37.443 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:37.484 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:40:37.493 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:37.494 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:40:37.586 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:37 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:40:37.586 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:37 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:40:37.586 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:37 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1137683974' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T19:40:37.586 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:37 smithi062 ceph-mon[44211]: from='client.36056 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T19:40:37.594 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:40:37.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:37 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:40:37.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:37 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:40:37.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:37 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1137683974' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T19:40:37.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:37 smithi188 ceph-mon[43939]: from='client.36056 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T19:40:37.631 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:37 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:40:37.631 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:37 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:40:37.631 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:37 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1137683974' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T19:40:37.631 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:37 smithi022 ceph-mon[39439]: from='client.36056 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T19:40:37.634 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 63 16 134363 134347 133.262 67.5 0.0142398 0.00750258 2024-04-01T19:40:37.636 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:37.715 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:40:37.721 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:37.721 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:40:37.822 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:40:37.877 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:37.910 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:40:37.910 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:40:38.223 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:40:38.239 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:40:38.259 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:40:38.268 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:38.268 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:40:38.277 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 11 1 2024-04-01T19:40:38.369 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:40:38.484 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:38 smithi022 ceph-mon[39439]: pgmap v1108: 17 pgs: 17 active+clean; 8.0 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 86 MiB/s wr, 1.38k op/s 2024-04-01T19:40:38.484 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:38 smithi022 ceph-mon[39439]: from='client.36056 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]': finished 2024-04-01T19:40:38.484 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:38 smithi022 ceph-mon[39439]: osdmap e396: 12 total, 12 up, 11 in 2024-04-01T19:40:38.485 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:38 smithi022 ceph-mon[39439]: 5.c scrub starts 2024-04-01T19:40:38.485 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:38.570 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:40:38.578 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:38.578 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:40:38.634 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 64 16 135313 135297 132.107 59.375 0.00826749 0.00756749 2024-04-01T19:40:38.661 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:38 smithi062 ceph-mon[44211]: pgmap v1108: 17 pgs: 17 active+clean; 8.0 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 86 MiB/s wr, 1.38k op/s 2024-04-01T19:40:38.661 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:38 smithi062 ceph-mon[44211]: from='client.36056 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]': finished 2024-04-01T19:40:38.661 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:38 smithi062 ceph-mon[44211]: osdmap e396: 12 total, 12 up, 11 in 2024-04-01T19:40:38.661 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:38 smithi062 ceph-mon[44211]: 5.c scrub starts 2024-04-01T19:40:38.679 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:40:38.689 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_historic_ops 2024-04-01T19:40:38.708 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:38 smithi188 ceph-mon[43939]: pgmap v1108: 17 pgs: 17 active+clean; 8.0 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 86 MiB/s wr, 1.38k op/s 2024-04-01T19:40:38.708 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:38 smithi188 ceph-mon[43939]: from='client.36056 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]': finished 2024-04-01T19:40:38.708 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:38 smithi188 ceph-mon[43939]: osdmap e396: 12 total, 12 up, 11 in 2024-04-01T19:40:38.708 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:38 smithi188 ceph-mon[43939]: 5.c scrub starts 2024-04-01T19:40:38.710 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:38.732 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:40:38.736 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:38.736 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:40:38.837 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:40:38.868 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:38.901 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:40:38.905 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:38.905 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:40:39.007 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:40:39.045 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:40:39.062 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:39.230 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:40:39.234 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:39.235 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:40:39.337 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:40:39.365 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:39.389 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:40:39.392 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:39.393 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:40:39.494 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:40:39.526 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:39.551 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:40:39.557 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:39.557 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:40:39.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:39 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:40:39.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:39 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:40:39.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:39 smithi022 ceph-mon[39439]: osdmap e397: 12 total, 12 up, 11 in 2024-04-01T19:40:39.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:39 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:40:39.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:39 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:40:39.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:39 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:40:39.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:39 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:40:39.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:39 smithi188 ceph-mon[43939]: osdmap e397: 12 total, 12 up, 11 in 2024-04-01T19:40:39.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:39 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:40:39.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:39 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:40:39.634 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 65 16 136284 136268 131.009 60.6875 0.0230238 0.0076319 2024-04-01T19:40:39.652 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:39 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:40:39.652 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:39 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:40:39.652 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:39 smithi062 ceph-mon[44211]: osdmap e397: 12 total, 12 up, 11 in 2024-04-01T19:40:39.652 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:39 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:40:39.652 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:39 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:40:39.658 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:40:39.703 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:39.731 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:40:39.746 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:39.746 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:40:39.762 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:40:39.781 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:40:39.847 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:40:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:40.014 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:40:40.017 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:40.018 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:40:40.118 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:40:40.147 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:40.176 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:40:40.178 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:40.179 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:40:40.280 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:40:40.310 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:40.334 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:40:40.340 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:40.340 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:40:40.441 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:40:40.473 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:40.495 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:40:40.498 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:40.499 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:40:40.599 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:40:40.634 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 66 16 137359 137343 130.042 67.1875 0.0172482 0.00768844 2024-04-01T19:40:40.647 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:40.759 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:40:40.766 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:40.767 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:40:40.868 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:40:40.950 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:41.081 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:40 smithi022 ceph-mon[39439]: pgmap v1111: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.1 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 83 MiB/s wr, 1.32k op/s 2024-04-01T19:40:41.081 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:40 smithi022 ceph-mon[39439]: 5.c scrub ok 2024-04-01T19:40:41.081 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:40 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:40:41.081 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:40 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:40:41.081 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:40 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:40:41.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:40 smithi062 ceph-mon[44211]: pgmap v1111: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.1 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 83 MiB/s wr, 1.32k op/s 2024-04-01T19:40:41.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:40 smithi062 ceph-mon[44211]: 5.c scrub ok 2024-04-01T19:40:41.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:40 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:40:41.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:40 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:40:41.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:40 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:40:41.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:40 smithi188 ceph-mon[43939]: pgmap v1111: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.1 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 83 MiB/s wr, 1.32k op/s 2024-04-01T19:40:41.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:40 smithi188 ceph-mon[43939]: 5.c scrub ok 2024-04-01T19:40:41.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:40 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:40:41.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:40 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:40:41.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:40 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:40:41.634 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 67 16 138445 138429 129.114 67.875 0.00997753 0.00774378 2024-04-01T19:40:41.954 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:40:41.992 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:41 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/449259181' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:40:42.049 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:40:42.055 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:42.056 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:40:42.157 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:40:42.193 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:41 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/449259181' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:40:42.195 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:42.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:41 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/449259181' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:40:42.634 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 68 16 139579 139563 128.257 70.875 0.00508625 0.00779504 2024-04-01T19:40:42.961 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.11 to 1 (10000) 2024-04-01T19:40:43.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:42 smithi062 ceph-mon[44211]: pgmap v1112: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.3 GiB data, 20 GiB used, 964 GiB / 983 GiB avail; 87 MiB/s wr, 1.39k op/s 2024-04-01T19:40:43.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:42 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:40:43.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:42 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/449259181' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:40:43.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:42 smithi062 ceph-mon[44211]: osdmap e398: 12 total, 12 up, 11 in 2024-04-01T19:40:43.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:42 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1795076262' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T19:40:43.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:42 smithi062 ceph-mon[44211]: from='client.36068 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T19:40:43.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:42 smithi022 ceph-mon[39439]: pgmap v1112: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.3 GiB data, 20 GiB used, 964 GiB / 983 GiB avail; 87 MiB/s wr, 1.39k op/s 2024-04-01T19:40:43.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:42 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:40:43.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:42 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/449259181' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:40:43.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:42 smithi022 ceph-mon[39439]: osdmap e398: 12 total, 12 up, 11 in 2024-04-01T19:40:43.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:42 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1795076262' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T19:40:43.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:42 smithi022 ceph-mon[39439]: from='client.36068 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T19:40:43.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:42 smithi188 ceph-mon[43939]: pgmap v1112: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.3 GiB data, 20 GiB used, 964 GiB / 983 GiB avail; 87 MiB/s wr, 1.39k op/s 2024-04-01T19:40:43.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:42 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:40:43.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:42 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/449259181' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:40:43.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:42 smithi188 ceph-mon[43939]: osdmap e398: 12 total, 12 up, 11 in 2024-04-01T19:40:43.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:42 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1795076262' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T19:40:43.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:42 smithi188 ceph-mon[43939]: from='client.36068 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T19:40:43.452 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:40:43.456 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:43.456 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:40:43.557 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:40:43.594 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:43.634 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 69 16 140699 140683 127.413 70 0.00586287 0.00784715 2024-04-01T19:40:43.657 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:40:43.661 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:43.661 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:40:43.730 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:40:43.730 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:40:43.761 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:40:43.817 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:44.023 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:40:44.027 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:44.027 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:40:44.106 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:43 smithi022 ceph-mon[39439]: from='client.36068 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]': finished 2024-04-01T19:40:44.106 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:43 smithi022 ceph-mon[39439]: osdmap e399: 12 total, 12 up, 11 in 2024-04-01T19:40:44.128 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:40:44.139 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 6 1 2024-04-01T19:40:44.198 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:44.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:43 smithi062 ceph-mon[44211]: from='client.36068 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]': finished 2024-04-01T19:40:44.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:43 smithi062 ceph-mon[44211]: osdmap e399: 12 total, 12 up, 11 in 2024-04-01T19:40:44.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:43 smithi188 ceph-mon[43939]: from='client.36068 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]': finished 2024-04-01T19:40:44.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:43 smithi188 ceph-mon[43939]: osdmap e399: 12 total, 12 up, 11 in 2024-04-01T19:40:44.625 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_ops_in_flight 2024-04-01T19:40:44.634 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 70 16 141800 141784 126.576 68.8125 0.00412602 0.00789844 2024-04-01T19:40:44.685 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:40:44.698 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:44.699 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:40:44.788 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:40:44.799 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:40:44.833 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:44.861 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:40:44.864 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:44.865 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:40:44.965 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:40:44.967 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:44 smithi022 ceph-mon[39439]: pgmap v1115: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.4 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 58 MiB/s wr, 930 op/s 2024-04-01T19:40:44.995 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:45.021 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:40:45.025 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:45.025 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:40:45.126 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:40:45.156 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:45.181 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:40:45.187 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:45.188 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:40:45.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:44 smithi062 ceph-mon[44211]: pgmap v1115: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.4 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 58 MiB/s wr, 930 op/s 2024-04-01T19:40:45.289 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:40:45.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:44 smithi188 ceph-mon[43939]: pgmap v1115: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.4 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 58 MiB/s wr, 930 op/s 2024-04-01T19:40:45.378 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:45.510 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:40:45.523 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:40:45.532 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:45.533 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:40:45.634 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:40:45.635 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 71 16 142770 142754 125.647 60.625 0.098521 0.00795578 2024-04-01T19:40:45.652 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:40:45.652 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:40:45.652 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:40:45.660 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:40:45.662 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:45.684 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:40:45.687 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:45.687 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:40:45.698 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:40:45.752 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:40:45.788 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:40:45.794 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:40:45.817 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:45.827 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:40:45.842 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:40:45.845 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:45.846 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:40:45.867 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:40:45.893 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:40:45.938 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:40:45.946 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:40:45.974 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:40:45.987 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:45.991 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:40:45.991 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:40:45.991 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:40:45.991 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:40:45.991 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:40:45.991 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:40:45.991 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:40:45.991 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:40:45.991 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:40:45.991 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:40:45.992 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:40:45.992 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:40:46.008 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:40:46.013 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:46.013 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:40:46.114 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:40:46.143 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:46.166 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:40:46.170 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:46.171 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:40:46.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:45 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1967001309' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:40:46.272 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:40:46.304 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:46.330 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:40:46.334 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:46.335 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:40:46.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:45 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1967001309' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:40:46.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:45 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1967001309' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:40:46.435 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:40:46.467 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:46.489 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:40:46.496 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:46.497 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:40:46.597 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:40:46.635 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 72 15 143805 143790 124.801 64.75 0.0126478 0.00801113 2024-04-01T19:40:46.650 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:47.021 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:40:47.026 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:47.027 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:40:47.128 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:40:47.159 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:47.184 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:40:47.187 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:47.188 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:40:47.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:46 smithi062 ceph-mon[44211]: pgmap v1116: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.4 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 53 MiB/s wr, 845 op/s 2024-04-01T19:40:47.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.289 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:40:47.335 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:47.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:46 smithi022 ceph-mon[39439]: pgmap v1116: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.4 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 53 MiB/s wr, 845 op/s 2024-04-01T19:40:47.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.362 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:40:47.365 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:47.366 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:40:47.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:46 smithi188 ceph-mon[43939]: pgmap v1116: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.4 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 53 MiB/s wr, 845 op/s 2024-04-01T19:40:47.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:47.466 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:40:47.497 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:47.520 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:40:47.523 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:47.523 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:40:47.609 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:40:47.624 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:40:47.635 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 73 16 144932 144916 124.055 70.375 0.00456153 0.00805862 2024-04-01T19:40:47.681 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:40:47.700 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:48.212 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:47 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:40:48.212 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:47 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:40:48.212 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:47 smithi022 ceph-mon[39439]: osdmap e400: 12 total, 12 up, 11 in 2024-04-01T19:40:48.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:47 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:40:48.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:47 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:40:48.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:47 smithi062 ceph-mon[44211]: osdmap e400: 12 total, 12 up, 11 in 2024-04-01T19:40:48.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:47 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:40:48.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:47 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:40:48.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:47 smithi188 ceph-mon[43939]: osdmap e400: 12 total, 12 up, 11 in 2024-04-01T19:40:48.635 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 74 16 145991 145975 123.273 66.1875 0.0108101 0.0081089 2024-04-01T19:40:48.997 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:48 smithi022 ceph-mon[39439]: pgmap v1118: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.7 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 73 MiB/s wr, 1.16k op/s 2024-04-01T19:40:48.997 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:48 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:40:48.997 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:48 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:40:49.043 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:40:49.220 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:40:49.224 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:49.224 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:40:49.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:48 smithi062 ceph-mon[44211]: pgmap v1118: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.7 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 73 MiB/s wr, 1.16k op/s 2024-04-01T19:40:49.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:49 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:40:49.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:49 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:40:49.325 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:40:49.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:49 smithi188 ceph-mon[43939]: pgmap v1118: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.7 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 73 MiB/s wr, 1.16k op/s 2024-04-01T19:40:49.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:49 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:40:49.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:49 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:40:49.410 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:49.440 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:40:49.444 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:49.445 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:40:49.545 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:40:49.602 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:49.635 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 75 16 147056 147040 122.517 66.5625 0.00541174 0.00815903 2024-04-01T19:40:49.807 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:40:49.815 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:49.815 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:40:49.916 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:40:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:50.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:50 smithi022 ceph-mon[39439]: pgmap v1119: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.7 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 57 MiB/s wr, 914 op/s 2024-04-01T19:40:50.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:50 smithi022 ceph-mon[39439]: osdmap e401: 12 total, 12 up, 11 in 2024-04-01T19:40:50.340 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:40:50.353 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:50.354 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:40:50.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:50 smithi188 ceph-mon[43939]: pgmap v1119: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.7 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 57 MiB/s wr, 914 op/s 2024-04-01T19:40:50.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:50 smithi188 ceph-mon[43939]: osdmap e401: 12 total, 12 up, 11 in 2024-04-01T19:40:50.454 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:40:50.491 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:50.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:50 smithi062 ceph-mon[44211]: pgmap v1119: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.7 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 57 MiB/s wr, 914 op/s 2024-04-01T19:40:50.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:50 smithi062 ceph-mon[44211]: osdmap e401: 12 total, 12 up, 11 in 2024-04-01T19:40:50.515 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:40:50.518 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:50.519 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:40:50.619 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:40:50.635 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 76 16 148062 148046 121.732 62.875 0.00791198 0.00821256 2024-04-01T19:40:50.649 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:50.674 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:40:50.676 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:50.676 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:40:50.777 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:40:50.856 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:51.138 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.6 to 1 (10000) 2024-04-01T19:40:51.461 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:40:51.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:51 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4050788433' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T19:40:51.589 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:51 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4050788433' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T19:40:51.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:51 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4050788433' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T19:40:51.635 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 77 16 149098 149082 120.992 64.75 0.00777156 0.00826233 2024-04-01T19:40:52.099 INFO:tasks.thrashosds.thrasher:test_map_discontinuity 2024-04-01T19:40:52.099 INFO:tasks.thrashosds.thrasher:Waiting for recovery 2024-04-01T19:40:52.099 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-01T19:40:52.100 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-04-01T19:40:52.336 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:40:52.345 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:52 smithi022 ceph-mon[39439]: pgmap v1121: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.9 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 66 MiB/s wr, 1.05k op/s 2024-04-01T19:40:52.345 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:52 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4050788433' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-04-01T19:40:52.345 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:52 smithi022 ceph-mon[39439]: osdmap e402: 12 total, 12 up, 11 in 2024-04-01T19:40:52.345 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:52 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2530675335' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:40:52.345 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:52 smithi022 ceph-mon[39439]: from='client.25981 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:40:52.345 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:52.346 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:40:52.442 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:40:52.447 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:40:52.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:52 smithi062 ceph-mon[44211]: pgmap v1121: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.9 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 66 MiB/s wr, 1.05k op/s 2024-04-01T19:40:52.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:52 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4050788433' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-04-01T19:40:52.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:52 smithi062 ceph-mon[44211]: osdmap e402: 12 total, 12 up, 11 in 2024-04-01T19:40:52.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:52 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2530675335' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:40:52.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:52 smithi062 ceph-mon[44211]: from='client.25981 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:40:52.529 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:52.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:52 smithi188 ceph-mon[43939]: pgmap v1121: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.9 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 66 MiB/s wr, 1.05k op/s 2024-04-01T19:40:52.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:52 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4050788433' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-04-01T19:40:52.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:52 smithi188 ceph-mon[43939]: osdmap e402: 12 total, 12 up, 11 in 2024-04-01T19:40:52.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:52 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2530675335' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:40:52.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:52 smithi188 ceph-mon[43939]: from='client.25981 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:40:52.635 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 78 16 150227 150211 120.346 70.5625 0.00939355 0.00830801 2024-04-01T19:40:53.228 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:40:53.228 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:40:53.228 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.228 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:150950 5.3 5:c0e2fea5:::benchmark_data_smithi188_119427_object150949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e403)", 2024-04-01T19:40:53.228 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:53.224392+0000", 2024-04-01T19:40:53.228 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0058291300000000001, 2024-04-01T19:40:53.228 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0058665499999999999, 2024-04-01T19:40:53.228 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:40:53.228 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:40:53.228 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:40:53.228 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:40:53.229 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:40:53.229 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:40:53.229 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 150950 2024-04-01T19:40:53.229 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.229 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:40:53.229 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.229 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:40:53.229 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.224392+0000", 2024-04-01T19:40:53.229 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:40:53.229 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.229 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.229 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:40:53.229 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.224392+0000", 2024-04-01T19:40:53.229 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:40:53.230 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.230 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.230 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:40:53.230 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.224395+0000", 2024-04-01T19:40:53.230 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2450000000000001e-06 2024-04-01T19:40:53.230 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.230 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.230 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:40:53.230 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.224447+0000", 2024-04-01T19:40:53.230 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2898000000000001e-05 2024-04-01T19:40:53.230 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.230 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.231 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:40:53.231 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.224470+0000", 2024-04-01T19:40:53.231 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2634e-05 2024-04-01T19:40:53.231 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.231 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.231 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:40:53.231 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.224480+0000", 2024-04-01T19:40:53.231 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.4599999999999992e-06 2024-04-01T19:40:53.231 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.231 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.231 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:40:53.231 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.224537+0000", 2024-04-01T19:40:53.231 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7843999999999997e-05 2024-04-01T19:40:53.231 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.232 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.232 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:40:53.232 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.224672+0000", 2024-04-01T19:40:53.232 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000135081 2024-04-01T19:40:53.232 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.232 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.232 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6", 2024-04-01T19:40:53.232 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.224844+0000", 2024-04-01T19:40:53.232 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00017118 2024-04-01T19:40:53.232 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:40:53.232 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:40:53.232 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:40:53.232 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.232 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.233 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:150952 5.3 5:cd6d91ae:::benchmark_data_smithi188_119427_object150951:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e403)", 2024-04-01T19:40:53.233 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:53.229263+0000", 2024-04-01T19:40:53.233 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.00095867100000000002, 2024-04-01T19:40:53.233 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00108533, 2024-04-01T19:40:53.233 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:40:53.233 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:40:53.233 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:40:53.233 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:40:53.233 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:40:53.233 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:40:53.233 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 150952 2024-04-01T19:40:53.233 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.233 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:40:53.234 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.234 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:40:53.234 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.229263+0000", 2024-04-01T19:40:53.234 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:40:53.234 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.234 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.234 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:40:53.234 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.229263+0000", 2024-04-01T19:40:53.234 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:40:53.234 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.234 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.234 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:40:53.234 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.229265+0000", 2024-04-01T19:40:53.234 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3159999999999999e-06 2024-04-01T19:40:53.235 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.235 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.235 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:40:53.235 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.229307+0000", 2024-04-01T19:40:53.235 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1638999999999999e-05 2024-04-01T19:40:53.237 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.237 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.237 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:40:53.237 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.229319+0000", 2024-04-01T19:40:53.238 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1963999999999999e-05 2024-04-01T19:40:53.238 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.238 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.238 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:40:53.238 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.229327+0000", 2024-04-01T19:40:53.238 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3510000000000002e-06 2024-04-01T19:40:53.238 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.238 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.238 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:40:53.238 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.229376+0000", 2024-04-01T19:40:53.238 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9144000000000002e-05 2024-04-01T19:40:53.238 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.238 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.239 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:40:53.239 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.229530+0000", 2024-04-01T19:40:53.239 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000154287 2024-04-01T19:40:53.239 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.239 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.239 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6", 2024-04-01T19:40:53.239 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.229679+0000", 2024-04-01T19:40:53.239 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014891700000000001 2024-04-01T19:40:53.239 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:40:53.239 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:40:53.239 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:40:53.239 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.239 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.240 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:150958 5.e e403/364 5:71fbd092:::benchmark_data_smithi188_119427_object150957:head v 403'9388, mlcod=403'9386)", 2024-04-01T19:40:53.240 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:53.230095+0000", 2024-04-01T19:40:53.240 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.00012603399999999999, 2024-04-01T19:40:53.240 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00029992400000000002, 2024-04-01T19:40:53.240 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:40:53.240 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:40:53.240 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:40:53.240 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:40:53.240 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.240 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:40:53.240 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.230095+0000", 2024-04-01T19:40:53.240 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:40:53.240 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.240 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.241 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:40:53.241 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.230095+0000", 2024-04-01T19:40:53.241 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:40:53.241 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.241 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.241 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:40:53.241 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.230096+0000", 2024-04-01T19:40:53.241 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.9800000000000002e-07 2024-04-01T19:40:53.241 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.241 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.241 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:40:53.241 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.230190+0000", 2024-04-01T19:40:53.241 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.3831000000000003e-05 2024-04-01T19:40:53.241 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.242 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.242 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:40:53.242 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.230202+0000", 2024-04-01T19:40:53.242 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1257000000000001e-05 2024-04-01T19:40:53.242 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.242 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.242 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:40:53.242 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.230209+0000", 2024-04-01T19:40:53.242 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.1099999999999997e-06 2024-04-01T19:40:53.242 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.242 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.242 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:40:53.242 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.230264+0000", 2024-04-01T19:40:53.242 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5259000000000001e-05 2024-04-01T19:40:53.243 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.243 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.243 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:40:53.243 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.230284+0000", 2024-04-01T19:40:53.243 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9789999999999999e-05 2024-04-01T19:40:53.243 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:40:53.243 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:40:53.243 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:40:53.243 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.243 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.243 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:150948 5.b e403/364 5:d35e5210:::benchmark_data_smithi188_119427_object150947:head v 403'9414, mlcod=403'9411)", 2024-04-01T19:40:53.243 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:53.224214+0000", 2024-04-01T19:40:53.243 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.006007592, 2024-04-01T19:40:53.243 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0062161480000000003, 2024-04-01T19:40:53.244 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:40:53.244 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:40:53.244 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:40:53.244 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:40:53.244 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.244 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:40:53.244 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.224214+0000", 2024-04-01T19:40:53.244 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:40:53.244 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.244 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.244 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:40:53.244 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.224214+0000", 2024-04-01T19:40:53.244 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:40:53.244 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.245 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.245 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:40:53.245 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.224215+0000", 2024-04-01T19:40:53.245 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3880000000000001e-06 2024-04-01T19:40:53.245 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.245 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.245 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:40:53.245 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.224248+0000", 2024-04-01T19:40:53.245 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3232999999999998e-05 2024-04-01T19:40:53.245 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.245 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.245 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:40:53.245 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.224257+0000", 2024-04-01T19:40:53.245 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.9660000000000002e-06 2024-04-01T19:40:53.246 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.246 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.246 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:40:53.246 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.224264+0000", 2024-04-01T19:40:53.246 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1829999999999999e-06 2024-04-01T19:40:53.246 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.246 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.246 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:40:53.246 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.224352+0000", 2024-04-01T19:40:53.246 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.865e-05 2024-04-01T19:40:53.246 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:40:53.246 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:40:53.246 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:40:53.247 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:53.224416+0000", 2024-04-01T19:40:53.247 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3669000000000003e-05 2024-04-01T19:40:53.247 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:40:53.247 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:40:53.247 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:40:53.247 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:40:53.247 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T19:40:53.247 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 4 2024-04-01T19:40:53.247 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:40:53.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:53 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:40:53.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:53 smithi062 ceph-mon[44211]: from='client.25981 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:40:53.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:53 smithi062 ceph-mon[44211]: osdmap e403: 12 total, 12 up, 11 in 2024-04-01T19:40:53.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:53 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:40:53.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:53 smithi022 ceph-mon[39439]: from='client.25981 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:40:53.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:53 smithi022 ceph-mon[39439]: osdmap e403: 12 total, 12 up, 11 in 2024-04-01T19:40:53.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:53 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:40:53.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:53 smithi188 ceph-mon[43939]: from='client.25981 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:40:53.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:53 smithi188 ceph-mon[43939]: osdmap e403: 12 total, 12 up, 11 in 2024-04-01T19:40:53.635 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 79 16 151492 151476 119.823 79.0625 0.0279606 0.00834436 2024-04-01T19:40:54.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:54 smithi062 ceph-mon[44211]: pgmap v1124: 17 pgs: 17 active+clean; 9.0 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 63 MiB/s wr, 1.01k op/s 2024-04-01T19:40:54.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:54 smithi022 ceph-mon[39439]: pgmap v1124: 17 pgs: 17 active+clean; 9.0 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 63 MiB/s wr, 1.01k op/s 2024-04-01T19:40:54.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:54 smithi188 ceph-mon[43939]: pgmap v1124: 17 pgs: 17 active+clean; 9.0 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 63 MiB/s wr, 1.01k op/s 2024-04-01T19:40:54.635 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:40:54.638755 min lat: 0.00113025 max lat: 0.209539 avg lat: 0.00837898 2024-04-01T19:40:54.635 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:40:54.635 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 80 16 152770 152754 119.324 79.875 0.015845 0.00837898 2024-04-01T19:40:54.684 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:40:54.689 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:54.690 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:40:54.790 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:40:54.842 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:55.185 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_blocked_ops 2024-04-01T19:40:55.218 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:40:55.220 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:40:55.227 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:55.228 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:40:55.328 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:40:55.358 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:55.383 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:40:55.388 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:55.388 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:40:55.489 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:40:55.519 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:55.542 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:40:55.545 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:55.545 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:40:55.635 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 81 16 153950 153934 118.761 73.75 0.00910779 0.00841907 2024-04-01T19:40:55.646 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:40:55.652 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:40:55.712 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:56.097 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:40:56.100 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:56.101 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:40:56.202 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:40:56.229 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:56.253 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:40:56.258 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:56.259 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:40:56.359 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:40:56.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:56 smithi022 ceph-mon[39439]: pgmap v1125: 17 pgs: 17 active+clean; 9.1 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 59 MiB/s wr, 945 op/s 2024-04-01T19:40:56.419 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:56.459 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:40:56.465 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:56.465 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:40:56.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:56 smithi062 ceph-mon[44211]: pgmap v1125: 17 pgs: 17 active+clean; 9.1 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 59 MiB/s wr, 945 op/s 2024-04-01T19:40:56.566 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:40:56.608 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:56.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:56 smithi188 ceph-mon[43939]: pgmap v1125: 17 pgs: 17 active+clean; 9.1 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 59 MiB/s wr, 945 op/s 2024-04-01T19:40:56.635 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 82 16 155084 155068 118.177 70.875 0.00961999 0.00846076 2024-04-01T19:40:56.648 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:40:56.653 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:56.653 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:40:56.754 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:40:56.814 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:56.949 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:40:56.955 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:56.955 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:40:57.056 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:40:57.090 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:57.115 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:40:57.120 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:57.120 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:40:57.221 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:40:57.273 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:57.430 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:40:57.439 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:57.440 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:40:57.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:57 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:40:57.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:57 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:40:57.540 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:40:57.576 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:57.603 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:40:57.607 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:57.607 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:40:57.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:57 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:40:57.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:57 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:40:57.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:57 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:40:57.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:57 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:40:57.635 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 83 16 156300 156284 117.669 76 0.015834 0.00849633 2024-04-01T19:40:57.708 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:40:57.743 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:40:57.768 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:57.830 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:40:57.879 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:40:57.927 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:40:57.966 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:40:57.970 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:57.970 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:40:57.975 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:40:58.012 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:40:58.052 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:40:58.071 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:40:58.083 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:40:58.100 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:58.120 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:40:58.123 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:58.124 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:40:58.125 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:40:58.155 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:40:58.188 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:40:58.221 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:40:58.224 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:40:58.257 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:58.262 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:40:58.277 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:40:58.277 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:40:58.277 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:40:58.277 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:40:58.278 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:40:58.278 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:40:58.278 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:40:58.278 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:40:58.278 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:40:58.278 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:40:58.278 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:40:58.278 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:40:58.281 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:40:58.284 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:58.285 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:40:58.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:58 smithi188 ceph-mon[43939]: pgmap v1126: 17 pgs: 17 active+clean; 9.4 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 79 MiB/s wr, 1.26k op/s 2024-04-01T19:40:58.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:58 smithi188 ceph-mon[43939]: osdmap e404: 12 total, 12 up, 11 in 2024-04-01T19:40:58.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:58 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:40:58.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:58 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:40:58.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:58 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1599653122' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:40:58.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:58.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:58.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:58.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:58.385 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:40:58.456 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:58.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:58 smithi062 ceph-mon[44211]: pgmap v1126: 17 pgs: 17 active+clean; 9.4 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 79 MiB/s wr, 1.26k op/s 2024-04-01T19:40:58.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:58 smithi062 ceph-mon[44211]: osdmap e404: 12 total, 12 up, 11 in 2024-04-01T19:40:58.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:58 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:40:58.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:58 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:40:58.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:58 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1599653122' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:40:58.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:58.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:58.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:58.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:58.556 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:40:58.559 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:58.560 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:40:58.561 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:58 smithi022 ceph-mon[39439]: pgmap v1126: 17 pgs: 17 active+clean; 9.4 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 79 MiB/s wr, 1.26k op/s 2024-04-01T19:40:58.561 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:58 smithi022 ceph-mon[39439]: osdmap e404: 12 total, 12 up, 11 in 2024-04-01T19:40:58.561 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:58 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:40:58.561 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:58 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:40:58.561 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:58 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1599653122' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:40:58.561 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:58.561 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:58.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:58.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:58.635 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 84 16 157365 157349 117.06 66.5625 0.0161839 0.00854123 2024-04-01T19:40:58.661 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:40:58.720 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:58.888 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:40:58.893 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:40:58.893 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:40:58.913 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:40:58.913 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":405,"fsid":"09f6b846-f05c-11ee-b647-cb9ed24678a4","created":"2024-04-01T19:15:34.344221+0000","modified":"2024-04-01T19:40:58.226014+0000","last_up_change":"2024-04-01T19:37:45.832405+0000","last_in_change":"2024-04-01T19:38:21.274265+0000","flags":"noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5806080,"flags_set":["nodeep-scrub","noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":29,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T19:18:34.605751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"unique_pool_3","create_time":"2024-04-01T19:39:23.486824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"370","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":0.92000001668930054,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfd4aa7e-a933-42e2-aac8-f93a3d9fcc3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":364,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":1419201649}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":1419201649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":1419201649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":1419201649}]},"public_addr":"172.21.15.22:6801/1419201649","cluster_addr":"172.21.15.22:6802/1419201649","heartbeat_back_addr":"172.21.15.22:6804/1419201649","heartbeat_front_addr":"172.21.15.22:6803/1419201649","state":["exists","up"]},{"osd":1,"uuid":"6ddadf19-2b4e-4c01-8918-9d51c323925b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":364,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":2579227110}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":2579227110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6808","nonce":2579227110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":2579227110}]},"public_addr":"172.21.15.22:6805/2579227110","cluster_addr":"172.21.15.22:6806/2579227110","heartbeat_back_addr":"172.21.15.22:6808/2579227110","heartbeat_front_addr":"172.21.15.22:6807/2579227110","state":["exists","up"]},{"osd":2,"uuid":"4af1f44c-f47c-4ce6-87ba-1aeec3960969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":364,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":835455757}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":835455757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":835455757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":835455757}]},"public_addr":"172.21.15.22:6809/835455757","cluster_addr":"172.21.15.22:6810/835455757","heartbeat_back_addr":"172.21.15.22:6812/835455757","heartbeat_front_addr":"172.21.15.22:6811/835455757","state":["exists","up"]},{"osd":3,"uuid":"c399f336-23c7-414a-822e-63793daf85c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":267,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":90988887}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":90988887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":90988887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":90988887}]},"public_addr":"172.21.15.22:6813/90988887","cluster_addr":"172.21.15.22:6814/90988887","heartbeat_back_addr":"172.21.15.22:6816/90988887","heartbeat_front_addr":"172.21.15.22:6815/90988887","state":["exists","up"]},{"osd":4,"uuid":"0a2690dc-e5b6-4d29-b517-980018519d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":364,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6800","nonce":2408168690}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6801","nonce":2408168690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6803","nonce":2408168690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6802","nonce":2408168690}]},"public_addr":"172.21.15.62:6800/2408168690","cluster_addr":"172.21.15.62:6801/2408168690","heartbeat_back_addr":"172.21.15.62:6803/2408168690","heartbeat_front_addr":"172.21.15.62:6802/2408168690","state":["exists","up"]},{"osd":5,"uuid":"c6830412-959a-4f1e-8c3d-f4b2d88673e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":364,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6804","nonce":386874616}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6805","nonce":386874616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6807","nonce":386874616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6806","nonce":386874616}]},"public_addr":"172.21.15.62:6804/386874616","cluster_addr":"172.21.15.62:6805/386874616","heartbeat_back_addr":"172.21.15.62:6807/386874616","heartbeat_front_addr":"172.21.15.62:6806/386874616","state":["exists","up"]},{"osd":6,"uuid":"f646310b-91a4-4259-a51f-6a0e92b7cba8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":45,"last_clean_end":299,"up_from":335,"up_thru":364,"down_at":300,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6808","nonce":4216302213}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6809","nonce":4216302213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6811","nonce":4216302213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6810","nonce":4216302213}]},"public_addr":"172.21.15.62:6808/4216302213","cluster_addr":"172.21.15.62:6809/4216302213","heartbeat_back_addr":"172.21.15.62:6811/4216302213","heartbeat_front_addr":"172.21.15.62:6810/4216302213","state":["exists","up"]},{"osd":7,"uuid":"afe5f371-c892-43e9-b82e-c2d911354e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":364,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6812","nonce":2055487337}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6813","nonce":2055487337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6815","nonce":2055487337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6814","nonce":2055487337}]},"public_addr":"172.21.15.62:6812/2055487337","cluster_addr":"172.21.15.62:6813/2055487337","heartbeat_back_addr":"172.21.15.62:6815/2055487337","heartbeat_front_addr":"172.21.15.62:6814/2055487337","state":["exists","up"]},{"osd":8,"uuid":"b7eb6461-f6fa-4a12-864c-6e6748e6337e","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":63,"last_clean_end":159,"up_from":197,"up_thru":212,"down_at":160,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6800","nonce":1873408265}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6801","nonce":1873408265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6803","nonce":1873408265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6802","nonce":1873408265}]},"public_addr":"172.21.15.188:6800/1873408265","cluster_addr":"172.21.15.188:6801/1873408265","heartbeat_back_addr":"172.21.15.188:6803/1873408265","heartbeat_front_addr":"172.21.15.188:6802/1873408265","state":["exists","up"]},{"osd":9,"uuid":"7d496ad5-46bf-485a-81d9-2b9da2a59882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":364,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6804","nonce":1755990887}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6805","nonce":1755990887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6807","nonce":1755990887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6806","nonce":1755990887}]},"public_addr":"172.21.15.188:6804/1755990887","cluster_addr":"172.21.15.188:6805/1755990887","heartbeat_back_addr":"172.21.15.188:6807/1755990887","heartbeat_front_addr":"172.21.15.188:6806/1755990887","state":["exists","up"]},{"osd":10,"uuid":"6cbb80ce-37f7-48df-9090-09a6068e4490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":364,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6808","nonce":3777340429}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6809","nonce":3777340429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6811","nonce":3777340429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6810","nonce":3777340429}]},"public_addr":"172.21.15.188:6808/3777340429","cluster_addr":"172.21.15.188:6809/3777340429","heartbeat_back_addr":"172.21.15.188:6811/3777340429","heartbeat_front_addr":"172.21.15.188:6810/3777340429","state":["exists","up"]},{"osd":11,"uuid":"c03517c4-fdb0-4587-96c1-b959041c4344","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":364,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6812","nonce":3987199514}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6813","nonce":3987199514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6815","nonce":3987199514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6814","nonce":3987199514}]},"public_addr":"172.21.15.188:6812/3987199514","cluster_addr":"172.21.15.188:6813/3987199514","heartbeat_back_addr":"172.21.15.188:6815/3987199514","heartbeat_front_addr":"172.21.15.188:6814/3987199514","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:40:46.202454+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:40:26.375006+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:40:07.868743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:40:10.569759+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:40:56.492089+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:40:27.973828+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:40:17.063237+0000","dead_epoch":299},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:40:38.347840+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":65536,"last_purged_snaps_scrub":"2024-04-01T19:40:57.365378+0000","dead_epoch":159},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:40:36.884230+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:40:48.230398+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:40:34.275288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/3735983556":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/3575578250":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/2493529775":"2024-04-02T19:16:02.302343+0000","172.21.15.22:6800/2678666836":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/2389537847":"2024-04-02T19:16:02.302343+0000","172.21.15.22:0/798807675":"2024-04-02T19:16:02.302343+0000","172.21.15.22:6800/1090179981":"2024-04-02T19:16:02.302343+0000","172.21.15.22:0/51907384":"2024-04-02T19:16:30.513384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T19:40:58.995 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:40:59.061 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:40:59.256 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:59.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:59.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:59.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:59.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:59.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:59.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:59.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:59.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:59 smithi062 ceph-mon[44211]: osdmap e405: 12 total, 12 up, 11 in 2024-04-01T19:40:59.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:59.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:40:59 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/419783937' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T19:40:59.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:59.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:59.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:59.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:59.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:59.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:59.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:59 smithi022 ceph-mon[39439]: osdmap e405: 12 total, 12 up, 11 in 2024-04-01T19:40:59.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:59.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:40:59 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/419783937' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T19:40:59.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:59.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:59.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:59.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:59.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:59.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:59.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:59.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:59 smithi188 ceph-mon[43939]: osdmap e405: 12 total, 12 up, 11 in 2024-04-01T19:40:59.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:40:59.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:40:59 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/419783937' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T19:40:59.635 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 85 16 158541 158525 116.548 73.5 0.0176953 0.00857856 2024-04-01T19:41:00.331 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:41:00.334 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:00.334 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:41:00.435 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:41:00.463 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:00.491 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:41:00.497 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:00.497 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:41:00.598 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:41:00.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:00 smithi022 ceph-mon[39439]: pgmap v1129: 17 pgs: 17 active+clean; 9.4 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 63 MiB/s wr, 1.01k op/s 2024-04-01T19:41:00.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:00 smithi188 ceph-mon[43939]: pgmap v1129: 17 pgs: 17 active+clean; 9.4 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 63 MiB/s wr, 1.01k op/s 2024-04-01T19:41:00.626 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:00.636 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 86 16 159787 159771 116.098 77.875 0.0050745 0.00861204 2024-04-01T19:41:00.654 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:41:00.657 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:00.658 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:41:00.758 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:41:00.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:00 smithi062 ceph-mon[44211]: pgmap v1129: 17 pgs: 17 active+clean; 9.4 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 63 MiB/s wr, 1.01k op/s 2024-04-01T19:41:00.812 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:00.837 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:41:00.844 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:00.844 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:41:00.945 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:41:00.975 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:00.996 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:41:01.000 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:01.000 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:41:01.101 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:41:01.154 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:01.636 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 87 16 160985 160969 115.624 74.875 0.0196828 0.00864737 2024-04-01T19:41:02.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:02 smithi022 ceph-mon[39439]: pgmap v1130: 17 pgs: 17 active+clean; 9.6 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 71 MiB/s wr, 1.14k op/s 2024-04-01T19:41:02.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:02 smithi188 ceph-mon[43939]: pgmap v1130: 17 pgs: 17 active+clean; 9.6 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 71 MiB/s wr, 1.14k op/s 2024-04-01T19:41:02.636 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 88 15 162232 162217 115.197 78 0.0105584 0.00867963 2024-04-01T19:41:02.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:02 smithi062 ceph-mon[44211]: pgmap v1130: 17 pgs: 17 active+clean; 9.6 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 71 MiB/s wr, 1.14k op/s 2024-04-01T19:41:03.636 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 89 16 163495 163479 114.788 78.875 0.00608273 0.00871012 2024-04-01T19:41:04.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:04 smithi022 ceph-mon[39439]: pgmap v1131: 17 pgs: 17 active+clean; 9.8 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 86 MiB/s wr, 1.37k op/s 2024-04-01T19:41:04.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:04 smithi188 ceph-mon[43939]: pgmap v1131: 17 pgs: 17 active+clean; 9.8 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 86 MiB/s wr, 1.37k op/s 2024-04-01T19:41:04.636 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Total time run: 90.0073 2024-04-01T19:41:04.636 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Total writes made: 164696 2024-04-01T19:41:04.636 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Write size: 65536 2024-04-01T19:41:04.636 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Object size: 65536 2024-04-01T19:41:04.637 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Bandwidth (MB/sec): 114.363 2024-04-01T19:41:04.637 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Stddev Bandwidth: 58.8369 2024-04-01T19:41:04.637 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Max bandwidth (MB/sec): 357.188 2024-04-01T19:41:04.637 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Min bandwidth (MB/sec): 59.375 2024-04-01T19:41:04.637 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Average IOPS: 1829 2024-04-01T19:41:04.637 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Stddev IOPS: 941.39 2024-04-01T19:41:04.637 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Max IOPS: 5715 2024-04-01T19:41:04.637 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Min IOPS: 950 2024-04-01T19:41:04.637 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Average Latency(s): 0.00874352 2024-04-01T19:41:04.637 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Stddev Latency(s): 0.00810725 2024-04-01T19:41:04.637 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Max latency(s): 0.209539 2024-04-01T19:41:04.637 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Min latency(s): 0.00113025 2024-04-01T19:41:04.640 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Cleaning up (deleting benchmark objects) 2024-04-01T19:41:04.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:04 smithi062 ceph-mon[44211]: pgmap v1131: 17 pgs: 17 active+clean; 9.8 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 86 MiB/s wr, 1.37k op/s 2024-04-01T19:41:05.156 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:41:05.157 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:05.158 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:41:05.258 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:41:05.300 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:05.334 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:41:05.338 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:05.339 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:41:05.439 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:41:05.506 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:05.707 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:41:05.755 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-01T19:41:06.483 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:06 smithi022 ceph-mon[39439]: pgmap v1132: 17 pgs: 17 active+clean; 9.8 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 57 MiB/s wr, 919 op/s 2024-04-01T19:41:06.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:06 smithi188 ceph-mon[43939]: pgmap v1132: 17 pgs: 17 active+clean; 9.8 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 57 MiB/s wr, 919 op/s 2024-04-01T19:41:06.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:06 smithi062 ceph-mon[44211]: pgmap v1132: 17 pgs: 17 active+clean; 9.8 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 57 MiB/s wr, 919 op/s 2024-04-01T19:41:07.018 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:41:07.127 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:41:07.128 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:41:08.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:08 smithi022 ceph-mon[39439]: pgmap v1133: 17 pgs: 17 active+clean; 10 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 104 B/s rd, 70 MiB/s wr, 1.23k op/s 2024-04-01T19:41:08.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:08 smithi188 ceph-mon[43939]: pgmap v1133: 17 pgs: 17 active+clean; 10 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 104 B/s rd, 70 MiB/s wr, 1.23k op/s 2024-04-01T19:41:08.664 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:41:08.677 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:08.678 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:41:08.716 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_historic_ops 2024-04-01T19:41:08.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:08 smithi062 ceph-mon[44211]: pgmap v1133: 17 pgs: 17 active+clean; 10 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 104 B/s rd, 70 MiB/s wr, 1.23k op/s 2024-04-01T19:41:08.778 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:41:08.810 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:08.832 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:41:08.839 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:08.840 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:41:08.941 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:41:08.997 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:09.040 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:41:09.048 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:09.049 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:41:09.150 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:41:09.190 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:09.222 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:41:09.224 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:09.225 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:41:09.326 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:41:09.353 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:41:09.356 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:09.377 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:41:09.380 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:09.380 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:41:09.481 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:41:09.512 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:09.536 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:41:09.542 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:09.542 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:41:09.643 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:41:09.682 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:09.708 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:41:09.713 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:09.714 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:41:09.814 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:41:09.843 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:09.864 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:41:09.868 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:09.869 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:41:09.969 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:41:10.019 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:10.286 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:41:10.296 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:41:10.310 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:10.311 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:41:10.381 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:41:10.412 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:41:10.448 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:10.480 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:41:10.485 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:10.486 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:41:10.586 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:41:10.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:10 smithi022 ceph-mon[39439]: pgmap v1134: 17 pgs: 17 active+clean; 9.9 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 95 B/s rd, 62 MiB/s wr, 1.16k op/s 2024-04-01T19:41:10.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:10 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3709761375' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:41:10.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:10 smithi022 ceph-mon[39439]: from='client.25999 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:41:10.616 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:10.643 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:41:10.646 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:10.647 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:41:10.748 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:41:10.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:10 smithi062 ceph-mon[44211]: pgmap v1134: 17 pgs: 17 active+clean; 9.9 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 95 B/s rd, 62 MiB/s wr, 1.16k op/s 2024-04-01T19:41:10.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:10 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3709761375' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:41:10.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:10 smithi062 ceph-mon[44211]: from='client.25999 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:41:10.800 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:10.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:10 smithi188 ceph-mon[43939]: pgmap v1134: 17 pgs: 17 active+clean; 9.9 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 95 B/s rd, 62 MiB/s wr, 1.16k op/s 2024-04-01T19:41:10.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:10 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3709761375' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:41:10.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:10 smithi188 ceph-mon[43939]: from='client.25999 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:41:11.682 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:11 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:41:11.682 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:11 smithi022 ceph-mon[39439]: from='client.25999 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:41:11.683 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:11 smithi022 ceph-mon[39439]: osdmap e406: 12 total, 12 up, 11 in 2024-04-01T19:41:11.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:11 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:41:11.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:11 smithi062 ceph-mon[44211]: from='client.25999 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:41:11.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:11 smithi062 ceph-mon[44211]: osdmap e406: 12 total, 12 up, 11 in 2024-04-01T19:41:11.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:11 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:41:11.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:11 smithi188 ceph-mon[43939]: from='client.25999 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:41:11.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:11 smithi188 ceph-mon[43939]: osdmap e406: 12 total, 12 up, 11 in 2024-04-01T19:41:12.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:12 smithi022 ceph-mon[39439]: pgmap v1136: 17 pgs: 17 active+clean; 9.8 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 102 B/s rd, 46 MiB/s wr, 1.22k op/s 2024-04-01T19:41:12.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:12 smithi022 ceph-mon[39439]: 5.4 scrub starts 2024-04-01T19:41:12.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:12 smithi062 ceph-mon[44211]: pgmap v1136: 17 pgs: 17 active+clean; 9.8 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 102 B/s rd, 46 MiB/s wr, 1.22k op/s 2024-04-01T19:41:12.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:12 smithi062 ceph-mon[44211]: 5.4 scrub starts 2024-04-01T19:41:12.831 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:41:12.832 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:41:12.832 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:41:12.832 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:41:12.832 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:41:12.832 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:41:12.833 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:41:12.859 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:41:12.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:12 smithi188 ceph-mon[43939]: pgmap v1136: 17 pgs: 17 active+clean; 9.8 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 102 B/s rd, 46 MiB/s wr, 1.22k op/s 2024-04-01T19:41:12.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:12 smithi188 ceph-mon[43939]: 5.4 scrub starts 2024-04-01T19:41:12.895 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:41:12.898 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:41:12.900 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:12.901 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:41:12.943 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:41:12.979 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:41:13.002 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:41:13.032 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:41:13.057 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:41:13.057 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:41:13.057 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:41:13.057 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:41:13.057 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:41:13.057 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:41:13.057 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:41:13.057 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:41:13.057 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:41:13.057 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:41:13.058 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:41:13.058 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:41:13.058 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:13.550 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:41:13.553 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:13.554 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:41:13.654 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:41:13.710 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:13 smithi022 ceph-mon[39439]: 5.0 scrub starts 2024-04-01T19:41:13.710 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:13 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3210397518' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:41:13.710 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:13.710 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:13.711 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:13.711 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:13.711 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:13.711 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:13.711 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:13.711 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:13.711 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:13 smithi022 ceph-mon[39439]: 5.7 scrub starts 2024-04-01T19:41:13.712 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:41:13.723 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:13.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:13 smithi062 ceph-mon[44211]: 5.0 scrub starts 2024-04-01T19:41:13.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:13 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3210397518' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:41:13.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:13.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:13.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:13.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:13.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:13.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:13.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:13.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:13.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:13 smithi062 ceph-mon[44211]: 5.7 scrub starts 2024-04-01T19:41:13.778 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:41:13.788 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:13.789 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:41:13.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:13 smithi188 ceph-mon[43939]: 5.0 scrub starts 2024-04-01T19:41:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:13 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3210397518' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:41:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:13 smithi188 ceph-mon[43939]: 5.7 scrub starts 2024-04-01T19:41:13.890 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:41:13.919 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:13.940 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:41:13.946 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:13.946 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:41:14.047 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:41:14.075 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:14.097 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:41:14.101 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:14.101 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:41:14.202 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:41:14.235 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:14.261 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:41:14.268 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:14.269 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:41:14.370 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:41:14.397 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:14.417 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:41:14.420 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:14.420 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:41:14.521 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:41:14.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:14.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:14.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:14.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:14 smithi188 ceph-mon[43939]: 5.4 scrub ok 2024-04-01T19:41:14.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:14 smithi188 ceph-mon[43939]: pgmap v1137: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.6 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 102 B/s rd, 30 MiB/s wr, 1.24k op/s 2024-04-01T19:41:14.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:14.549 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:14 smithi188 ceph-mon[43939]: 5.6 scrub starts 2024-04-01T19:41:14.551 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:14.578 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:41:14.581 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:14.581 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:41:14.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:14.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:14.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:14.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:14 smithi022 ceph-mon[39439]: 5.4 scrub ok 2024-04-01T19:41:14.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:14 smithi022 ceph-mon[39439]: pgmap v1137: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.6 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 102 B/s rd, 30 MiB/s wr, 1.24k op/s 2024-04-01T19:41:14.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:14.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:14 smithi022 ceph-mon[39439]: 5.6 scrub starts 2024-04-01T19:41:14.682 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:41:14.717 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:14.717 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:14.717 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:14.717 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:14 smithi062 ceph-mon[44211]: 5.4 scrub ok 2024-04-01T19:41:14.717 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:14 smithi062 ceph-mon[44211]: pgmap v1137: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.6 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 102 B/s rd, 30 MiB/s wr, 1.24k op/s 2024-04-01T19:41:14.717 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:14.717 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:14 smithi062 ceph-mon[44211]: 5.6 scrub starts 2024-04-01T19:41:14.720 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:14.757 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:41:14.762 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:14.762 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:41:14.863 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:41:14.935 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:14.965 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:41:14.966 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:41:14.966 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 20, 2024-04-01T19:41:14.966 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 600, 2024-04-01T19:41:14.966 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:41:14.967 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.967 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:181518 4.b 4:d653702f:::benchmark_data_smithi188_104537_object9524:head [delete] snapc 0=[] ondisk+write+known_if_redirected e298)", 2024-04-01T19:41:14.967 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:35:43.084338+0000", 2024-04-01T19:41:14.967 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 331.87357287600003, 2024-04-01T19:41:14.967 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.12701379400000001, 2024-04-01T19:41:14.967 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:14.967 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:14.967 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:14.967 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:14.967 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:41:14.967 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:41:14.967 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 181518 2024-04-01T19:41:14.967 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.968 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:14.968 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.968 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:14.968 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.084338+0000", 2024-04-01T19:41:14.968 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:14.968 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.968 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.968 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:14.968 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.084338+0000", 2024-04-01T19:41:14.968 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:14.968 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.968 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.968 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:14.968 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.084341+0000", 2024-04-01T19:41:14.969 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6410000000000002e-06 2024-04-01T19:41:14.969 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.969 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.969 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:14.969 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.084350+0000", 2024-04-01T19:41:14.969 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.7710000000000001e-06 2024-04-01T19:41:14.969 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.969 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.969 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:14.969 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.084367+0000", 2024-04-01T19:41:14.969 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7061000000000001e-05 2024-04-01T19:41:14.969 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.969 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.970 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:14.970 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.084375+0000", 2024-04-01T19:41:14.970 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3930000000000002e-06 2024-04-01T19:41:14.970 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.970 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.971 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:14.971 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.084444+0000", 2024-04-01T19:41:14.971 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8868999999999994e-05 2024-04-01T19:41:14.971 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.971 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.971 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:14.971 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.084593+0000", 2024-04-01T19:41:14.971 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000149665 2024-04-01T19:41:14.971 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.971 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.971 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 1", 2024-04-01T19:41:14.971 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.084731+0000", 2024-04-01T19:41:14.972 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000137782 2024-04-01T19:41:14.972 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.972 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.972 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:14.972 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.093178+0000", 2024-04-01T19:41:14.972 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0084469720000000005 2024-04-01T19:41:14.972 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.972 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.972 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:14.972 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.211221+0000", 2024-04-01T19:41:14.972 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.118043457 2024-04-01T19:41:14.972 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.972 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.973 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:14.973 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.211285+0000", 2024-04-01T19:41:14.973 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3126000000000005e-05 2024-04-01T19:41:14.973 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.973 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.973 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:14.973 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.211352+0000", 2024-04-01T19:41:14.973 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.7057000000000005e-05 2024-04-01T19:41:14.973 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:14.973 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:14.973 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:14.973 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.973 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.973 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:181525 4.b 4:d82f5fc8:::benchmark_data_smithi188_104537_object9531:head [delete] snapc 0=[] ondisk+write+known_if_redirected e298)", 2024-04-01T19:41:14.974 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:35:43.085676+0000", 2024-04-01T19:41:14.974 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 331.87223435099997, 2024-04-01T19:41:14.974 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13434543299999999, 2024-04-01T19:41:14.974 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:14.974 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:14.974 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:14.974 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:14.974 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:41:14.974 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:41:14.974 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 181525 2024-04-01T19:41:14.974 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.974 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:14.974 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.974 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:14.975 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.085676+0000", 2024-04-01T19:41:14.975 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:14.975 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.975 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.975 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:14.975 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.085676+0000", 2024-04-01T19:41:14.975 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:14.975 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.975 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.975 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:14.975 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.085678+0000", 2024-04-01T19:41:14.975 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.33e-06 2024-04-01T19:41:14.975 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.975 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.976 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:14.976 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.085682+0000", 2024-04-01T19:41:14.976 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5859999999999998e-06 2024-04-01T19:41:14.976 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.976 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.976 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:14.976 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.085693+0000", 2024-04-01T19:41:14.976 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0713999999999999e-05 2024-04-01T19:41:14.976 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.976 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.976 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:14.976 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.085699+0000", 2024-04-01T19:41:14.976 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8309999999999997e-06 2024-04-01T19:41:14.976 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.977 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.977 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:14.977 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.089415+0000", 2024-04-01T19:41:14.977 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0037160909999999999 2024-04-01T19:41:14.977 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.977 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.977 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:14.977 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.089564+0000", 2024-04-01T19:41:14.977 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014948699999999999 2024-04-01T19:41:14.977 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.977 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.977 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 1", 2024-04-01T19:41:14.977 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.089709+0000", 2024-04-01T19:41:14.977 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014458299999999999 2024-04-01T19:41:14.978 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.978 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.978 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:14.978 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.096171+0000", 2024-04-01T19:41:14.978 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0064624469999999996 2024-04-01T19:41:14.978 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.978 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.978 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:14.978 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.219933+0000", 2024-04-01T19:41:14.978 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.12376155599999999 2024-04-01T19:41:14.978 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.978 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.978 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:14.979 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.219971+0000", 2024-04-01T19:41:14.979 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.8056999999999998e-05 2024-04-01T19:41:14.979 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.979 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.979 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:14.979 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.220022+0000", 2024-04-01T19:41:14.980 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0751000000000002e-05 2024-04-01T19:41:14.980 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:14.980 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:14.980 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:14.980 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.980 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.981 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:181528 4.b 4:da993e2f:::benchmark_data_smithi188_104537_object9534:head [delete] snapc 0=[] ondisk+write+known_if_redirected e298)", 2024-04-01T19:41:14.981 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:35:43.088785+0000", 2024-04-01T19:41:14.981 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 331.86912601, 2024-04-01T19:41:14.981 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13138290799999999, 2024-04-01T19:41:14.981 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:14.981 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:14.981 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:14.981 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:14.982 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:41:14.982 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:41:14.982 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 181528 2024-04-01T19:41:14.982 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.982 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:14.982 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.982 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:14.982 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.088785+0000", 2024-04-01T19:41:14.982 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:14.983 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.983 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.983 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:14.983 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.088785+0000", 2024-04-01T19:41:14.983 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:14.983 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.983 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.983 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:14.983 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.088786+0000", 2024-04-01T19:41:14.984 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5579999999999999e-06 2024-04-01T19:41:14.984 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.984 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.984 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:14.984 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.088791+0000", 2024-04-01T19:41:14.984 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.1030000000000001e-06 2024-04-01T19:41:14.984 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.984 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.984 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:14.984 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.088801+0000", 2024-04-01T19:41:14.984 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.4849999999999998e-06 2024-04-01T19:41:14.984 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.984 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.984 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:14.985 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.088807+0000", 2024-04-01T19:41:14.985 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7899999999999996e-06 2024-04-01T19:41:14.985 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.985 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.985 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:14.985 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.093216+0000", 2024-04-01T19:41:14.985 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0044091620000000003 2024-04-01T19:41:14.985 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.985 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.985 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:14.985 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.093296+0000", 2024-04-01T19:41:14.985 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0211999999999997e-05 2024-04-01T19:41:14.985 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.985 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.986 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 1", 2024-04-01T19:41:14.986 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.093368+0000", 2024-04-01T19:41:14.986 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2003999999999997e-05 2024-04-01T19:41:14.986 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.986 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.986 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:14.986 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.096306+0000", 2024-04-01T19:41:14.986 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0029376290000000002 2024-04-01T19:41:14.986 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.986 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.986 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:14.986 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.220081+0000", 2024-04-01T19:41:14.986 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.123775581 2024-04-01T19:41:14.986 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.987 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.987 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:14.987 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.220141+0000", 2024-04-01T19:41:14.987 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9746e-05 2024-04-01T19:41:14.987 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.987 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.987 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:14.987 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.220168+0000", 2024-04-01T19:41:14.987 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6638000000000001e-05 2024-04-01T19:41:14.987 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:14.987 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:14.987 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:14.987 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.988 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.988 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:49336 5.b e377/364 5:d75e0814:::benchmark_data_smithi188_119427_object49335:head v 377'3127, mlcod=377'3125)", 2024-04-01T19:41:14.988 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:39:48.111738+0000", 2024-04-01T19:41:14.988 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 86.846172457999998, 2024-04-01T19:41:14.988 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.075129093999999993, 2024-04-01T19:41:14.988 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:14.988 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:14.988 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:14.988 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:14.988 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.988 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:14.988 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:39:48.111738+0000", 2024-04-01T19:41:14.988 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:14.988 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.989 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.989 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:14.989 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:39:48.111738+0000", 2024-04-01T19:41:14.989 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:14.989 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.989 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.989 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:14.989 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:39:48.111740+0000", 2024-04-01T19:41:14.989 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4139999999999999e-06 2024-04-01T19:41:14.989 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.989 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.989 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:14.989 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:39:48.111795+0000", 2024-04-01T19:41:14.989 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5594999999999999e-05 2024-04-01T19:41:14.990 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.990 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.990 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:14.990 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:39:48.111804+0000", 2024-04-01T19:41:14.990 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.9199999999999993e-06 2024-04-01T19:41:14.990 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.990 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.990 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:14.990 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:39:48.111811+0000", 2024-04-01T19:41:14.990 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.7599999999999997e-06 2024-04-01T19:41:14.990 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.990 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.990 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:14.990 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:39:48.111865+0000", 2024-04-01T19:41:14.991 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3909000000000002e-05 2024-04-01T19:41:14.991 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.991 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.991 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:14.991 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:39:48.111877+0000", 2024-04-01T19:41:14.991 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.243e-05 2024-04-01T19:41:14.991 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.991 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.991 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:14.991 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:39:48.176771+0000", 2024-04-01T19:41:14.991 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.064893240000000005 2024-04-01T19:41:14.991 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.991 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.992 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:14.992 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:39:48.186867+0000", 2024-04-01T19:41:14.992 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010096826 2024-04-01T19:41:14.992 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:14.992 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:14.992 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:14.992 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.992 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.992 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:116744 5.5 5:ad20eb5b:::benchmark_data_smithi188_119427_object116743:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e389)", 2024-04-01T19:41:14.992 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:23.830588+0000", 2024-04-01T19:41:14.992 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 51.127322868999997, 2024-04-01T19:41:14.992 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.076404213999999998, 2024-04-01T19:41:14.992 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:14.992 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:14.992 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:14.993 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:14.993 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:41:14.993 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:41:14.993 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 116744 2024-04-01T19:41:14.993 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.993 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:14.993 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.993 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:14.993 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:23.830588+0000", 2024-04-01T19:41:14.993 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:14.993 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.993 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.993 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:14.993 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:23.830588+0000", 2024-04-01T19:41:14.993 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:14.994 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.994 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.994 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:14.994 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:23.830590+0000", 2024-04-01T19:41:14.994 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.818e-06 2024-04-01T19:41:14.994 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.994 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.994 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:14.994 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:23.830640+0000", 2024-04-01T19:41:14.994 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9879999999999997e-05 2024-04-01T19:41:14.994 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.994 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.995 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:14.995 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:23.830649+0000", 2024-04-01T19:41:14.995 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.2390000000000008e-06 2024-04-01T19:41:14.995 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.995 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.995 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:14.995 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:23.830655+0000", 2024-04-01T19:41:14.995 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8300000000000001e-06 2024-04-01T19:41:14.995 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.995 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.995 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:14.995 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:23.833249+0000", 2024-04-01T19:41:14.995 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0025942410000000002 2024-04-01T19:41:14.995 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.996 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.996 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:14.996 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:23.833357+0000", 2024-04-01T19:41:14.996 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000107922 2024-04-01T19:41:14.996 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.996 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.996 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 1", 2024-04-01T19:41:14.996 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:23.833477+0000", 2024-04-01T19:41:14.996 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012040900000000001 2024-04-01T19:41:14.996 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.996 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.996 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:14.996 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:23.906837+0000", 2024-04-01T19:41:14.996 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.073359580999999993 2024-04-01T19:41:14.996 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.997 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.997 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:14.997 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:23.906889+0000", 2024-04-01T19:41:14.997 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2268999999999997e-05 2024-04-01T19:41:14.997 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.997 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.997 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:14.997 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:23.906944+0000", 2024-04-01T19:41:14.997 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4941000000000001e-05 2024-04-01T19:41:14.997 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.997 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.997 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:14.997 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:23.906992+0000", 2024-04-01T19:41:14.998 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8084000000000002e-05 2024-04-01T19:41:14.998 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:14.998 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:14.998 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:14.998 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.998 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.998 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:116750 5.2 e389/364 5:4eb49557:::benchmark_data_smithi188_119427_object116749:head v 389'7345, mlcod=389'7343)", 2024-04-01T19:41:14.998 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:23.836537+0000", 2024-04-01T19:41:14.998 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 51.121374009999997, 2024-04-01T19:41:14.998 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.075866160000000002, 2024-04-01T19:41:14.998 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:14.998 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:14.999 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:14.999 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:14.999 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.999 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:14.999 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:23.836537+0000", 2024-04-01T19:41:14.999 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:14.999 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.999 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.999 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:14.999 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:23.836537+0000", 2024-04-01T19:41:14.999 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:14.999 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:14.999 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:14.999 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:14.999 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:23.836538+0000", 2024-04-01T19:41:15.000 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2529999999999999e-06 2024-04-01T19:41:15.000 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.000 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.000 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:15.000 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:23.836576+0000", 2024-04-01T19:41:15.000 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.8316999999999999e-05 2024-04-01T19:41:15.000 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.000 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.000 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:15.000 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:23.903027+0000", 2024-04-01T19:41:15.000 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.066450817999999995 2024-04-01T19:41:15.000 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.000 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.000 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:15.000 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:23.903042+0000", 2024-04-01T19:41:15.001 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4684e-05 2024-04-01T19:41:15.001 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.001 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.001 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:15.001 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:23.903240+0000", 2024-04-01T19:41:15.001 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0001985 2024-04-01T19:41:15.001 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.001 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.001 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:15.001 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:23.903265+0000", 2024-04-01T19:41:15.001 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4626000000000001e-05 2024-04-01T19:41:15.001 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.001 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.001 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:15.001 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:23.912351+0000", 2024-04-01T19:41:15.002 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0090859570000000004 2024-04-01T19:41:15.002 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.002 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.002 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:15.002 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:23.912403+0000", 2024-04-01T19:41:15.002 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2005000000000001e-05 2024-04-01T19:41:15.002 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.002 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:15.002 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.002 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.002 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.002 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:120111 5.3 5:c02b5b9d:::benchmark_data_smithi188_119427_object120110:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e389)", 2024-04-01T19:41:15.002 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:26.059272+0000", 2024-04-01T19:41:15.002 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 48.898638505999998, 2024-04-01T19:41:15.002 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.082533087000000005, 2024-04-01T19:41:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:41:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:41:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 120111 2024-04-01T19:41:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.059272+0000", 2024-04-01T19:41:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.059272+0000", 2024-04-01T19:41:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.059273+0000", 2024-04-01T19:41:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4000000000000002e-07 2024-04-01T19:41:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.059295+0000", 2024-04-01T19:41:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2789000000000002e-05 2024-04-01T19:41:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.059299+0000", 2024-04-01T19:41:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7840000000000001e-06 2024-04-01T19:41:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.059302+0000", 2024-04-01T19:41:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.005e-06 2024-04-01T19:41:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.059353+0000", 2024-04-01T19:41:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0379e-05 2024-04-01T19:41:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.059478+0000", 2024-04-01T19:41:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012563799999999999 2024-04-01T19:41:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6", 2024-04-01T19:41:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.059615+0000", 2024-04-01T19:41:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013714900000000001 2024-04-01T19:41:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.117507+0000", 2024-04-01T19:41:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.057891284000000001 2024-04-01T19:41:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.141714+0000", 2024-04-01T19:41:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.024207131 2024-04-01T19:41:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.141767+0000", 2024-04-01T19:41:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3214000000000002e-05 2024-04-01T19:41:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.141805+0000", 2024-04-01T19:41:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.8274e-05 2024-04-01T19:41:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:120109 5.e e389/364 5:7f9ce89d:::benchmark_data_smithi188_119427_object120108:head v 389'7499, mlcod=389'7494)", 2024-04-01T19:41:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:26.060654+0000", 2024-04-01T19:41:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 48.897256683000002, 2024-04-01T19:41:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.081100959, 2024-04-01T19:41:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.060654+0000", 2024-04-01T19:41:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.060654+0000", 2024-04-01T19:41:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.060655+0000", 2024-04-01T19:41:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5899999999999996e-07 2024-04-01T19:41:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.060800+0000", 2024-04-01T19:41:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000144864 2024-04-01T19:41:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.060807+0000", 2024-04-01T19:41:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9970000000000001e-06 2024-04-01T19:41:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.060812+0000", 2024-04-01T19:41:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.1019999999999996e-06 2024-04-01T19:41:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.116845+0000", 2024-04-01T19:41:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.056033544999999997 2024-04-01T19:41:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.116868+0000", 2024-04-01T19:41:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2436999999999999e-05 2024-04-01T19:41:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.141716+0000", 2024-04-01T19:41:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.024848565999999999 2024-04-01T19:41:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.141755+0000", 2024-04-01T19:41:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.8788999999999997e-05 2024-04-01T19:41:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:120114 5.b e389/364 5:d198c7d8:::benchmark_data_smithi188_119427_object120113:head v 389'7460, mlcod=389'7458)", 2024-04-01T19:41:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:26.061697+0000", 2024-04-01T19:41:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 48.896213799999998, 2024-04-01T19:41:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.080149531999999996, 2024-04-01T19:41:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.061697+0000", 2024-04-01T19:41:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.061697+0000", 2024-04-01T19:41:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.061698+0000", 2024-04-01T19:41:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.116e-06 2024-04-01T19:41:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.061763+0000", 2024-04-01T19:41:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5199999999999999e-05 2024-04-01T19:41:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.061772+0000", 2024-04-01T19:41:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4610000000000008e-06 2024-04-01T19:41:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.061778+0000", 2024-04-01T19:41:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.6529999999999997e-06 2024-04-01T19:41:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.061823+0000", 2024-04-01T19:41:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4756000000000003e-05 2024-04-01T19:41:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.061842+0000", 2024-04-01T19:41:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9340000000000001e-05 2024-04-01T19:41:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.141811+0000", 2024-04-01T19:41:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.079968549999999999 2024-04-01T19:41:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.141846+0000", 2024-04-01T19:41:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5456000000000001e-05 2024-04-01T19:41:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:120521 5.5 5:a1392dcd:::benchmark_data_smithi188_119427_object120520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e389)", 2024-04-01T19:41:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:26.423226+0000", 2024-04-01T19:41:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 48.534684511999998, 2024-04-01T19:41:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.087570133999999994, 2024-04-01T19:41:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:41:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:41:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 120521 2024-04-01T19:41:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.423226+0000", 2024-04-01T19:41:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.423226+0000", 2024-04-01T19:41:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.423227+0000", 2024-04-01T19:41:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.102e-06 2024-04-01T19:41:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.423266+0000", 2024-04-01T19:41:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.8714999999999998e-05 2024-04-01T19:41:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.423275+0000", 2024-04-01T19:41:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.4050000000000006e-06 2024-04-01T19:41:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.423282+0000", 2024-04-01T19:41:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.054e-06 2024-04-01T19:41:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.423334+0000", 2024-04-01T19:41:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2054e-05 2024-04-01T19:41:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.423465+0000", 2024-04-01T19:41:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000131777 2024-04-01T19:41:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 1", 2024-04-01T19:41:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.423647+0000", 2024-04-01T19:41:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00018159 2024-04-01T19:41:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.433184+0000", 2024-04-01T19:41:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0095366640000000003 2024-04-01T19:41:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.510665+0000", 2024-04-01T19:41:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.077481596 2024-04-01T19:41:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.510728+0000", 2024-04-01T19:41:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2749000000000005e-05 2024-04-01T19:41:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.510796+0000", 2024-04-01T19:41:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8428000000000003e-05 2024-04-01T19:41:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:120522 5.5 5:a923f665:::benchmark_data_smithi188_119427_object120521:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e389)", 2024-04-01T19:41:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:26.423298+0000", 2024-04-01T19:41:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 48.534612529, 2024-04-01T19:41:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.087654356000000003, 2024-04-01T19:41:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:41:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:41:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 120522 2024-04-01T19:41:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.423298+0000", 2024-04-01T19:41:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.423298+0000", 2024-04-01T19:41:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.423299+0000", 2024-04-01T19:41:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.7599999999999996e-07 2024-04-01T19:41:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.423325+0000", 2024-04-01T19:41:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5942999999999999e-05 2024-04-01T19:41:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.423331+0000", 2024-04-01T19:41:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0000000000000002e-06 2024-04-01T19:41:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.423336+0000", 2024-04-01T19:41:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0030000000000002e-06 2024-04-01T19:41:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.426979+0000", 2024-04-01T19:41:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0036425030000000001 2024-04-01T19:41:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.427112+0000", 2024-04-01T19:41:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013351199999999999 2024-04-01T19:41:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 1", 2024-04-01T19:41:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.427263+0000", 2024-04-01T19:41:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015120699999999999 2024-04-01T19:41:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.433195+0000", 2024-04-01T19:41:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0059318130000000002 2024-04-01T19:41:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.510854+0000", 2024-04-01T19:41:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.077659211000000006 2024-04-01T19:41:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.510901+0000", 2024-04-01T19:41:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6862e-05 2024-04-01T19:41:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.510953+0000", 2024-04-01T19:41:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.1425999999999999e-05 2024-04-01T19:41:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:120524 5.5 5:aea0ea9a:::benchmark_data_smithi188_119427_object120523:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e389)", 2024-04-01T19:41:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:26.426420+0000", 2024-04-01T19:41:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 48.531490730999998, 2024-04-01T19:41:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.084679329999999997, 2024-04-01T19:41:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:41:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:41:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 120524 2024-04-01T19:41:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.426420+0000", 2024-04-01T19:41:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.426420+0000", 2024-04-01T19:41:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.426422+0000", 2024-04-01T19:41:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.742e-06 2024-04-01T19:41:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.426488+0000", 2024-04-01T19:41:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5747000000000006e-05 2024-04-01T19:41:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.426500+0000", 2024-04-01T19:41:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2114e-05 2024-04-01T19:41:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.426508+0000", 2024-04-01T19:41:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0630000000000006e-06 2024-04-01T19:41:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.430427+0000", 2024-04-01T19:41:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0039189050000000003 2024-04-01T19:41:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.430573+0000", 2024-04-01T19:41:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014661399999999999 2024-04-01T19:41:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 1", 2024-04-01T19:41:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.430661+0000", 2024-04-01T19:41:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.7454000000000007e-05 2024-04-01T19:41:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.433321+0000", 2024-04-01T19:41:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.002660277 2024-04-01T19:41:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.511006+0000", 2024-04-01T19:41:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.077684854999999997 2024-04-01T19:41:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.511050+0000", 2024-04-01T19:41:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4536000000000002e-05 2024-04-01T19:41:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.511099+0000", 2024-04-01T19:41:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9023000000000001e-05 2024-04-01T19:41:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:120813 5.3 5:cd34281e:::benchmark_data_smithi188_119427_object120812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e389)", 2024-04-01T19:41:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:26.683879+0000", 2024-04-01T19:41:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 48.274031645000001, 2024-04-01T19:41:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.093211688000000001, 2024-04-01T19:41:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:41:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:41:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 120813 2024-04-01T19:41:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.683879+0000", 2024-04-01T19:41:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.683879+0000", 2024-04-01T19:41:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.683881+0000", 2024-04-01T19:41:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.95e-06 2024-04-01T19:41:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.683919+0000", 2024-04-01T19:41:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7574999999999999e-05 2024-04-01T19:41:15.038 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.038 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.038 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:15.038 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.683930+0000", 2024-04-01T19:41:15.038 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0883999999999999e-05 2024-04-01T19:41:15.038 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.038 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.038 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:15.038 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.683937+0000", 2024-04-01T19:41:15.038 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4159999999999998e-06 2024-04-01T19:41:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.684016+0000", 2024-04-01T19:41:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.8749000000000001e-05 2024-04-01T19:41:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.684158+0000", 2024-04-01T19:41:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014234299999999999 2024-04-01T19:41:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6", 2024-04-01T19:41:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.684304+0000", 2024-04-01T19:41:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000146286 2024-04-01T19:41:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688270+0000", 2024-04-01T19:41:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0039653739999999998 2024-04-01T19:41:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.776977+0000", 2024-04-01T19:41:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.088706850000000004 2024-04-01T19:41:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.777036+0000", 2024-04-01T19:41:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9744999999999998e-05 2024-04-01T19:41:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.777091+0000", 2024-04-01T19:41:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4515999999999998e-05 2024-04-01T19:41:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:120808 5.b e389/364 5:d226b62b:::benchmark_data_smithi188_119427_object120807:head v 389'7507, mlcod=389'7505)", 2024-04-01T19:41:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:26.683964+0000", 2024-04-01T19:41:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 48.273946309999999, 2024-04-01T19:41:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.099583120999999997, 2024-04-01T19:41:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.683964+0000", 2024-04-01T19:41:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.683964+0000", 2024-04-01T19:41:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.683966+0000", 2024-04-01T19:41:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0229999999999999e-06 2024-04-01T19:41:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.684004+0000", 2024-04-01T19:41:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7276e-05 2024-04-01T19:41:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.684014+0000", 2024-04-01T19:41:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.7999999999999993e-06 2024-04-01T19:41:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.684020+0000", 2024-04-01T19:41:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4320000000000004e-06 2024-04-01T19:41:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688016+0000", 2024-04-01T19:41:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0039960029999999997 2024-04-01T19:41:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688036+0000", 2024-04-01T19:41:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0055e-05 2024-04-01T19:41:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.783490+0000", 2024-04-01T19:41:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.095454392999999998 2024-04-01T19:41:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.783548+0000", 2024-04-01T19:41:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7139000000000003e-05 2024-04-01T19:41:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:120815 5.e e389/364 5:7e895dd4:::benchmark_data_smithi188_119427_object120814:head v 389'7538, mlcod=389'7536)", 2024-04-01T19:41:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:26.688569+0000", 2024-04-01T19:41:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 48.269341437999998, 2024-04-01T19:41:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.084442064999999997, 2024-04-01T19:41:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688569+0000", 2024-04-01T19:41:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688569+0000", 2024-04-01T19:41:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688571+0000", 2024-04-01T19:41:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6810000000000001e-06 2024-04-01T19:41:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688603+0000", 2024-04-01T19:41:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.2008000000000003e-05 2024-04-01T19:41:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688611+0000", 2024-04-01T19:41:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4079999999999998e-06 2024-04-01T19:41:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688618+0000", 2024-04-01T19:41:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4640000000000003e-06 2024-04-01T19:41:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688669+0000", 2024-04-01T19:41:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0695000000000002e-05 2024-04-01T19:41:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688688+0000", 2024-04-01T19:41:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9017000000000001e-05 2024-04-01T19:41:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.772969+0000", 2024-04-01T19:41:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.084281143000000003 2024-04-01T19:41:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.773011+0000", 2024-04-01T19:41:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.2648999999999998e-05 2024-04-01T19:41:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:120818 5.b e389/364 5:d1ea8709:::benchmark_data_smithi188_119427_object120817:head v 389'7508, mlcod=389'7505)", 2024-04-01T19:41:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:26.688634+0000", 2024-04-01T19:41:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 48.269277236999997, 2024-04-01T19:41:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.102478002, 2024-04-01T19:41:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688634+0000", 2024-04-01T19:41:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688634+0000", 2024-04-01T19:41:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688634+0000", 2024-04-01T19:41:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1600000000000002e-07 2024-04-01T19:41:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688654+0000", 2024-04-01T19:41:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0519000000000001e-05 2024-04-01T19:41:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688659+0000", 2024-04-01T19:41:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1489999999999996e-06 2024-04-01T19:41:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688662+0000", 2024-04-01T19:41:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.095e-06 2024-04-01T19:41:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.773545+0000", 2024-04-01T19:41:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.084883713999999999 2024-04-01T19:41:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.773571+0000", 2024-04-01T19:41:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6007999999999999e-05 2024-04-01T19:41:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.791065+0000", 2024-04-01T19:41:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.017493121 2024-04-01T19:41:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.791112+0000", 2024-04-01T19:41:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6980000000000001e-05 2024-04-01T19:41:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:120817 5.2 e389/364 5:4c9e212b:::benchmark_data_smithi188_119427_object120816:head v 389'7604, mlcod=389'7600)", 2024-04-01T19:41:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:26.688674+0000", 2024-04-01T19:41:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 48.269236800000002, 2024-04-01T19:41:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.084866154999999999, 2024-04-01T19:41:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688674+0000", 2024-04-01T19:41:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688674+0000", 2024-04-01T19:41:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688675+0000", 2024-04-01T19:41:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5799999999999999e-07 2024-04-01T19:41:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688700+0000", 2024-04-01T19:41:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5942999999999999e-05 2024-04-01T19:41:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688705+0000", 2024-04-01T19:41:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.318e-06 2024-04-01T19:41:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688708+0000", 2024-04-01T19:41:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.8279999999999999e-06 2024-04-01T19:41:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688739+0000", 2024-04-01T19:41:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.0981e-05 2024-04-01T19:41:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688756+0000", 2024-04-01T19:41:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7550999999999998e-05 2024-04-01T19:41:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.772927+0000", 2024-04-01T19:41:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.084170429000000005 2024-04-01T19:41:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.773540+0000", 2024-04-01T19:41:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00061354699999999999 2024-04-01T19:41:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:120819 5.b e389/364 5:d5df3617:::benchmark_data_smithi188_119427_object120818:head v 389'7509, mlcod=389'7505)", 2024-04-01T19:41:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:26.691278+0000", 2024-04-01T19:41:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 48.266632518999998, 2024-04-01T19:41:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.099984090999999997, 2024-04-01T19:41:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.691278+0000", 2024-04-01T19:41:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.060 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.060 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.060 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:15.060 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.691278+0000", 2024-04-01T19:41:15.060 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.060 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.060 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.060 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:15.060 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.691280+0000", 2024-04-01T19:41:15.060 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4410000000000001e-06 2024-04-01T19:41:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.691338+0000", 2024-04-01T19:41:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8788e-05 2024-04-01T19:41:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.772898+0000", 2024-04-01T19:41:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.081559650999999997 2024-04-01T19:41:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.772911+0000", 2024-04-01T19:41:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3169e-05 2024-04-01T19:41:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.777126+0000", 2024-04-01T19:41:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0042149910000000004 2024-04-01T19:41:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.777146+0000", 2024-04-01T19:41:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9269000000000001e-05 2024-04-01T19:41:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.791238+0000", 2024-04-01T19:41:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014092357 2024-04-01T19:41:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.791262+0000", 2024-04-01T19:41:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4425000000000001e-05 2024-04-01T19:41:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:120827 5.8 e389/364 5:1550fc16:::benchmark_data_smithi188_119427_object120826:head v 389'7696, mlcod=389'7694)", 2024-04-01T19:41:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:26.692398+0000", 2024-04-01T19:41:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 48.265512782999998, 2024-04-01T19:41:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.087262144999999999, 2024-04-01T19:41:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.692398+0000", 2024-04-01T19:41:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.692398+0000", 2024-04-01T19:41:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.692400+0000", 2024-04-01T19:41:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.561e-06 2024-04-01T19:41:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.692480+0000", 2024-04-01T19:41:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0069999999999997e-05 2024-04-01T19:41:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.772894+0000", 2024-04-01T19:41:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.080414434000000007 2024-04-01T19:41:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.772909+0000", 2024-04-01T19:41:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5268e-05 2024-04-01T19:41:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.772982+0000", 2024-04-01T19:41:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3032000000000001e-05 2024-04-01T19:41:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.773005+0000", 2024-04-01T19:41:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2954000000000001e-05 2024-04-01T19:41:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.779614+0000", 2024-04-01T19:41:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0066091279999999997 2024-04-01T19:41:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.779660+0000", 2024-04-01T19:41:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5698000000000002e-05 2024-04-01T19:41:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:120837 5.3 5:c9d23f1d:::benchmark_data_smithi188_119427_object120836:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e389)", 2024-04-01T19:41:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:26.701045+0000", 2024-04-01T19:41:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 48.256865722000001, 2024-04-01T19:41:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.090188949000000004, 2024-04-01T19:41:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:41:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:41:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 120837 2024-04-01T19:41:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.701045+0000", 2024-04-01T19:41:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.701045+0000", 2024-04-01T19:41:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.701053+0000", 2024-04-01T19:41:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6249999999999998e-06 2024-04-01T19:41:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.701085+0000", 2024-04-01T19:41:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.2638000000000002e-05 2024-04-01T19:41:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.772892+0000", 2024-04-01T19:41:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.071806439999999999 2024-04-01T19:41:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.772911+0000", 2024-04-01T19:41:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9415999999999998e-05 2024-04-01T19:41:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.772995+0000", 2024-04-01T19:41:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3421e-05 2024-04-01T19:41:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.773162+0000", 2024-04-01T19:41:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000167381 2024-04-01T19:41:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6", 2024-04-01T19:41:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.773326+0000", 2024-04-01T19:41:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00016415399999999999 2024-04-01T19:41:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.780918+0000", 2024-04-01T19:41:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0075921599999999997 2024-04-01T19:41:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.791134+0000", 2024-04-01T19:41:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010215771 2024-04-01T19:41:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.791180+0000", 2024-04-01T19:41:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6205999999999998e-05 2024-04-01T19:41:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.791234+0000", 2024-04-01T19:41:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3736999999999997e-05 2024-04-01T19:41:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:15.073 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:41:15.074 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:41:15.074 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:15.075 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:41:15.176 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:41:15.215 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:15.241 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:41:15.244 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:15.244 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:41:15.345 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:41:15.403 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:15.445 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:41:15.451 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:15.452 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:41:15.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:15 smithi062 ceph-mon[44211]: 5.0 scrub ok 2024-04-01T19:41:15.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:15 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T19:41:15.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:15 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T19:41:15.553 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:41:15.620 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:15.743 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:41:15.752 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:15.752 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:41:15.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:15 smithi022 ceph-mon[39439]: 5.0 scrub ok 2024-04-01T19:41:15.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:15 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T19:41:15.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:15 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T19:41:15.854 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:41:15.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:15 smithi188 ceph-mon[43939]: 5.0 scrub ok 2024-04-01T19:41:15.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:15 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T19:41:15.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:15 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T19:41:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:16.051 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:41:16.059 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:16.059 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:41:16.160 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:41:16.204 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:16.404 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:41:16.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:16 smithi062 ceph-mon[44211]: pgmap v1138: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.6 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 102 B/s rd, 25 MiB/s wr, 1.22k op/s 2024-04-01T19:41:16.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:16 smithi062 ceph-mon[44211]: 5.d scrub starts 2024-04-01T19:41:16.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:16 smithi062 ceph-mon[44211]: 5.7 scrub ok 2024-04-01T19:41:16.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:16 smithi062 ceph-mon[44211]: 5.e scrub starts 2024-04-01T19:41:16.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:16 smithi062 ceph-mon[44211]: 5.3 scrub starts 2024-04-01T19:41:16.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:16 smithi062 ceph-mon[44211]: 5.6 scrub ok 2024-04-01T19:41:16.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:16 smithi022 ceph-mon[39439]: pgmap v1138: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.6 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 102 B/s rd, 25 MiB/s wr, 1.22k op/s 2024-04-01T19:41:16.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:16 smithi022 ceph-mon[39439]: 5.d scrub starts 2024-04-01T19:41:16.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:16 smithi022 ceph-mon[39439]: 5.7 scrub ok 2024-04-01T19:41:16.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:16 smithi022 ceph-mon[39439]: 5.e scrub starts 2024-04-01T19:41:16.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:16 smithi022 ceph-mon[39439]: 5.3 scrub starts 2024-04-01T19:41:16.867 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:16 smithi022 ceph-mon[39439]: 5.6 scrub ok 2024-04-01T19:41:16.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:16 smithi188 ceph-mon[43939]: pgmap v1138: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.6 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 102 B/s rd, 25 MiB/s wr, 1.22k op/s 2024-04-01T19:41:16.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:16 smithi188 ceph-mon[43939]: 5.d scrub starts 2024-04-01T19:41:16.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:16 smithi188 ceph-mon[43939]: 5.7 scrub ok 2024-04-01T19:41:16.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:16 smithi188 ceph-mon[43939]: 5.e scrub starts 2024-04-01T19:41:16.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:16 smithi188 ceph-mon[43939]: 5.3 scrub starts 2024-04-01T19:41:16.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:16 smithi188 ceph-mon[43939]: 5.6 scrub ok 2024-04-01T19:41:16.961 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_ops_in_flight 2024-04-01T19:41:17.233 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:41:17.242 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:17.242 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:41:17.343 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:41:17.379 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:17.404 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:41:17.406 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:17.406 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:41:17.507 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:41:17.585 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:17.586 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:41:17.611 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:41:17.620 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:17.621 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:41:17.722 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:41:17.747 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:17 smithi188 ceph-mon[43939]: 5.d scrub ok 2024-04-01T19:41:17.747 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:17 smithi188 ceph-mon[43939]: 5.9 scrub starts 2024-04-01T19:41:17.747 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:17 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:41:17.747 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:17 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:41:17.749 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:17.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:17 smithi062 ceph-mon[44211]: 5.d scrub ok 2024-04-01T19:41:17.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:17 smithi062 ceph-mon[44211]: 5.9 scrub starts 2024-04-01T19:41:17.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:17 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:41:17.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:17 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:41:17.772 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:41:17.776 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:17.776 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:41:17.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:17 smithi022 ceph-mon[39439]: 5.d scrub ok 2024-04-01T19:41:17.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:17 smithi022 ceph-mon[39439]: 5.9 scrub starts 2024-04-01T19:41:17.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:17 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:41:17.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:17 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:41:17.877 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:41:17.925 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:41:17.926 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:17.959 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:41:17.967 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:17.968 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:41:18.068 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:41:18.100 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:18.122 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:41:18.128 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:18.128 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:41:18.229 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:41:18.256 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:18.278 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:41:18.281 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:18.281 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:41:18.382 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:41:18.412 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:18.440 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:41:18.443 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:18.443 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:41:18.486 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:41:18.516 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:18 smithi022 ceph-mon[39439]: pgmap v1139: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 9.3 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 2.9 MiB/s wr, 1.17k op/s 2024-04-01T19:41:18.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:18 smithi022 ceph-mon[39439]: osdmap e407: 12 total, 12 up, 11 in 2024-04-01T19:41:18.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:18 smithi022 ceph-mon[39439]: 5.e scrub ok 2024-04-01T19:41:18.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:18 smithi022 ceph-mon[39439]: 5.9 scrub ok 2024-04-01T19:41:18.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:18 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3374205670' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:41:18.544 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:41:18.584 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:18.610 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:41:18.612 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:18.613 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:41:18.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:18 smithi188 ceph-mon[43939]: pgmap v1139: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 9.3 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 2.9 MiB/s wr, 1.17k op/s 2024-04-01T19:41:18.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:18 smithi188 ceph-mon[43939]: osdmap e407: 12 total, 12 up, 11 in 2024-04-01T19:41:18.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:18 smithi188 ceph-mon[43939]: 5.e scrub ok 2024-04-01T19:41:18.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:18 smithi188 ceph-mon[43939]: 5.9 scrub ok 2024-04-01T19:41:18.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:18 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3374205670' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:41:18.713 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:41:18.743 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:18.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:18 smithi062 ceph-mon[44211]: pgmap v1139: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 9.3 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 2.9 MiB/s wr, 1.17k op/s 2024-04-01T19:41:18.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:18 smithi062 ceph-mon[44211]: osdmap e407: 12 total, 12 up, 11 in 2024-04-01T19:41:18.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:18 smithi062 ceph-mon[44211]: 5.e scrub ok 2024-04-01T19:41:18.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:18 smithi062 ceph-mon[44211]: 5.9 scrub ok 2024-04-01T19:41:18.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:18 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3374205670' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:41:18.764 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:41:18.767 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:18.767 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:41:18.868 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:41:18.902 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:18.927 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:41:18.930 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:18.931 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:41:19.032 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:41:19.082 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:19.268 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:41:19.270 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:19.270 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:41:19.371 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:41:19.409 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:19.433 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:41:19.439 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:19.439 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:41:19.540 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:41:19.567 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:19.594 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:41:19.596 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:19.597 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:41:19.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:19 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:41:19.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:19 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:41:19.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:19 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3374205670' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:41:19.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:19 smithi022 ceph-mon[39439]: osdmap e408: 12 total, 12 up, 11 in 2024-04-01T19:41:19.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:19 smithi022 ceph-mon[39439]: 5.3 scrub ok 2024-04-01T19:41:19.698 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:41:19.729 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:19 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:41:19.729 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:19 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:41:19.729 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:19 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3374205670' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:41:19.729 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:19 smithi062 ceph-mon[44211]: osdmap e408: 12 total, 12 up, 11 in 2024-04-01T19:41:19.729 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:19 smithi062 ceph-mon[44211]: 5.3 scrub ok 2024-04-01T19:41:19.733 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:19.768 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:41:19.777 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:19.778 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:41:19.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:19 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:41:19.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:19 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:41:19.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:19 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3374205670' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:41:19.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:19 smithi188 ceph-mon[43939]: osdmap e408: 12 total, 12 up, 11 in 2024-04-01T19:41:19.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:19 smithi188 ceph-mon[43939]: 5.3 scrub ok 2024-04-01T19:41:19.878 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:41:19.910 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:19.934 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:41:19.941 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:19.941 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:41:20.042 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:41:20.074 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:20.102 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:41:20.107 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:20.107 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:41:20.208 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:41:20.235 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:20.260 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:41:20.264 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:20.264 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:41:20.365 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:41:20.396 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:20.416 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:41:20.419 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:20.420 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:41:20.520 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:41:20.586 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:20.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:20 smithi062 ceph-mon[44211]: pgmap v1142: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.2 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T19:41:20.868 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:20 smithi022 ceph-mon[39439]: pgmap v1142: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.2 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T19:41:20.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:20 smithi188 ceph-mon[43939]: pgmap v1142: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.2 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T19:41:21.054 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:41:21.060 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:21.061 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:41:21.162 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:41:21.191 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:21.221 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:41:21.227 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:21.227 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:41:21.328 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:41:21.358 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:21.379 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:41:21.383 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:21.383 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:41:21.484 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:41:21.538 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:21.566 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:41:21.570 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:21.571 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:41:21.672 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:41:21.709 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:21.748 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:41:21.751 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:21.751 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:41:21.852 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:41:21.854 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:41:21.887 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:41:21.923 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:21.924 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:41:22.024 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:41:22.027 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:41:22.056 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:22.073 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:41:22.083 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:41:22.087 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:22.087 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:41:22.127 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:41:22.153 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:41:22.153 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:41:22.153 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:22.153 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:184842 5.7 e408/364 5:e8b13de4:::benchmark_data_smithi188_119427_object20143:head v 408'11453, mlcod=408'11451)", 2024-04-01T19:41:22.153 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:41:22.064914+0000", 2024-04-01T19:41:22.154 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0036649640000000002, 2024-04-01T19:41:22.154 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0036901870000000002, 2024-04-01T19:41:22.154 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:22.154 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:22.154 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:41:22.154 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:22.154 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:22.154 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:22.154 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:22.064914+0000", 2024-04-01T19:41:22.154 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:22.154 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:22.154 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:22.154 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:22.155 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:22.064914+0000", 2024-04-01T19:41:22.155 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:22.155 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:22.155 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:22.155 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:22.155 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:22.064916+0000", 2024-04-01T19:41:22.155 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.745e-06 2024-04-01T19:41:22.155 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:22.155 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:22.155 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:22.155 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:22.064925+0000", 2024-04-01T19:41:22.155 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8699999999999998e-06 2024-04-01T19:41:22.155 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:22.155 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:22.155 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:22.156 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:22.064939+0000", 2024-04-01T19:41:22.156 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4679e-05 2024-04-01T19:41:22.156 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:22.156 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:22.156 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:22.156 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:22.064947+0000", 2024-04-01T19:41:22.156 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6199999999999999e-06 2024-04-01T19:41:22.156 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:22.156 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:22.156 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:22.156 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:22.065035+0000", 2024-04-01T19:41:22.156 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.7949999999999996e-05 2024-04-01T19:41:22.156 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:22.156 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:22.156 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:22.157 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:22.065055+0000", 2024-04-01T19:41:22.157 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0537e-05 2024-04-01T19:41:22.157 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:22.157 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:22.157 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:22.157 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:22.157 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T19:41:22.157 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 1 2024-04-01T19:41:22.157 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:41:22.157 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:41:22.188 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:41:22.198 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:41:22.235 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:41:22.251 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:22.269 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:41:22.299 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:41:22.342 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:41:22.370 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:41:22.375 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:22.375 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:41:22.383 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:41:22.420 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:41:22.458 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:41:22.466 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:41:22.466 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:41:22.466 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:41:22.466 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:41:22.466 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:41:22.466 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:41:22.466 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:41:22.467 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:41:22.467 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:41:22.467 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:41:22.467 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:41:22.467 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:41:22.476 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:41:22.500 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:22 smithi022 ceph-mon[39439]: pgmap v1143: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.1 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:41:22.500 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:22 smithi022 ceph-mon[39439]: 5.1 scrub starts 2024-04-01T19:41:22.500 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:22 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3843085577' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:41:22.500 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:22.500 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:22.500 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:22.500 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:22.500 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:22.500 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:22.542 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:22.602 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:41:22.613 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:22.614 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:41:22.714 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:41:22.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:22 smithi062 ceph-mon[44211]: pgmap v1143: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.1 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:41:22.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:22 smithi062 ceph-mon[44211]: 5.1 scrub starts 2024-04-01T19:41:22.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:22 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3843085577' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:41:22.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:22.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:22.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:22.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:22.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:22.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:22.774 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:22.829 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:41:22.832 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:22.833 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:41:22.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:22 smithi188 ceph-mon[43939]: pgmap v1143: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.1 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:41:22.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:22 smithi188 ceph-mon[43939]: 5.1 scrub starts 2024-04-01T19:41:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:22 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3843085577' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:41:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:22.933 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:41:22.971 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:23.009 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:41:23.019 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:23.020 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:41:23.120 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:41:23.153 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:23.175 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:41:23.177 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:23.178 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:41:23.279 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:41:23.308 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:23.334 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:41:23.336 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:23.337 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:41:23.348 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_blocked_ops 2024-04-01T19:41:23.437 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:41:23.468 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:23.500 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:41:23.508 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:23.508 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:41:23.610 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:41:23.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:23.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:23.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:23.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:23.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:23.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:23.694 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:23.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:23.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:23.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:23.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:23.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:23.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:23.842 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:41:23.848 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:23.849 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:41:23.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:23.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:23.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:23.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:23.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:23.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:23.935 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:41:23.950 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:41:23.966 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:41:24.024 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:24.251 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:41:24.268 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:24.268 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:41:24.369 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:41:24.435 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:41:24.493 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:24.494 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:41:24.595 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:41:24.624 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:24.648 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:41:24.651 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:24.651 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:41:24.752 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:41:24.781 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:24 smithi188 ceph-mon[43939]: pgmap v1144: 17 pgs: 17 active+clean; 8.9 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 1.31k op/s 2024-04-01T19:41:24.781 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:24 smithi188 ceph-mon[43939]: 5.1 scrub ok 2024-04-01T19:41:24.783 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:24.805 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:41:24.808 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:24.809 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:41:24.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:24 smithi022 ceph-mon[39439]: pgmap v1144: 17 pgs: 17 active+clean; 8.9 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 1.31k op/s 2024-04-01T19:41:24.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:24 smithi022 ceph-mon[39439]: 5.1 scrub ok 2024-04-01T19:41:24.910 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:41:24.952 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:25.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:24 smithi062 ceph-mon[44211]: pgmap v1144: 17 pgs: 17 active+clean; 8.9 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 1.31k op/s 2024-04-01T19:41:25.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:24 smithi062 ceph-mon[44211]: 5.1 scrub ok 2024-04-01T19:41:25.412 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:41:25.421 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:25.421 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:41:25.522 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:41:25.552 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:25.581 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:41:25.586 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:25.586 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:41:25.687 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:41:25.720 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:25.741 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:41:25.743 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:25.744 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:41:25.756 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-01T19:41:25.756 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:41:25.844 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:41:25.870 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:25.886 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:41:25.892 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:41:25.894 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:25.895 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:41:25.996 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:41:26.023 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:26.043 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:41:26.046 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:26.046 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:41:26.147 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:41:26.179 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:26.199 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:41:26.203 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:26.204 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:41:26.304 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:41:26.346 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:26.379 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:41:26.382 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:26.383 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:41:26.484 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:41:26.513 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:26.534 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:41:26.537 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:26.537 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:41:26.638 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:41:26.697 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:26.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:26 smithi062 ceph-mon[44211]: pgmap v1145: 17 pgs: 17 active+clean; 8.9 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 880 op/s 2024-04-01T19:41:26.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:26 smithi022 ceph-mon[39439]: pgmap v1145: 17 pgs: 17 active+clean; 8.9 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 880 op/s 2024-04-01T19:41:26.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:26 smithi188 ceph-mon[43939]: pgmap v1145: 17 pgs: 17 active+clean; 8.9 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 880 op/s 2024-04-01T19:41:27.272 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:41:27.281 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:27.282 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:41:27.383 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:41:27.449 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:27.464 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:41:27.550 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:27 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/483437152' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:41:27.550 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:27 smithi022 ceph-mon[39439]: from='client.36104 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:41:27.569 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:41:27.702 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:41:27.711 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:27.711 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:41:27.813 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:41:27.840 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:27 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/483437152' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:41:27.840 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:27 smithi188 ceph-mon[43939]: from='client.36104 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:41:27.843 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:27.867 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:41:27.873 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:27.873 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:41:27.974 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:41:28.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:27 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/483437152' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:41:28.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:27 smithi062 ceph-mon[44211]: from='client.36104 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:41:28.024 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:28.122 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:41:28.129 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:28.129 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:41:28.156 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:41:28.202 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:41:28.202 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:41:28.230 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:41:28.327 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:28.349 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:41:28.353 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:28.353 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:41:28.454 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:41:28.499 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:28.524 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:41:28.527 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:28.527 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:41:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:28 smithi188 ceph-mon[43939]: pgmap v1146: 17 pgs: 17 active+clean; 8.6 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:41:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:28 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:41:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:28 smithi188 ceph-mon[43939]: from='client.36104 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:41:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:28 smithi188 ceph-mon[43939]: osdmap e409: 12 total, 12 up, 11 in 2024-04-01T19:41:28.627 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:41:28.685 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:28 smithi022 ceph-mon[39439]: pgmap v1146: 17 pgs: 17 active+clean; 8.6 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:41:28.686 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:28 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:41:28.686 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:28 smithi022 ceph-mon[39439]: from='client.36104 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:41:28.686 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:28 smithi022 ceph-mon[39439]: osdmap e409: 12 total, 12 up, 11 in 2024-04-01T19:41:28.688 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:28.744 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:41:28.746 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:28.747 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:41:28.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:28 smithi062 ceph-mon[44211]: pgmap v1146: 17 pgs: 17 active+clean; 8.6 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:41:28.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:28 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:41:28.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:28 smithi062 ceph-mon[44211]: from='client.36104 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:41:28.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:28 smithi062 ceph-mon[44211]: osdmap e409: 12 total, 12 up, 11 in 2024-04-01T19:41:28.847 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:41:28.909 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:29.071 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:41:29.080 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:29.081 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:41:29.182 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:41:29.215 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:29.253 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:41:29.255 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:29.256 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:41:29.357 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:41:29.404 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:29.434 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:41:29.437 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:29.437 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:41:29.538 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:41:29.580 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:29.652 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:41:29.657 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:29.657 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:41:29.758 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:41:29.798 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:29.835 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:41:29.837 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:29.837 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:41:29.838 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:29 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:41:29.838 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:29 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:41:29.838 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:29 smithi062 ceph-mon[44211]: osdmap e410: 12 total, 12 up, 11 in 2024-04-01T19:41:29.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:29 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:41:29.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:29 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:41:29.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:29 smithi022 ceph-mon[39439]: osdmap e410: 12 total, 12 up, 11 in 2024-04-01T19:41:29.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:29 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:41:29.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:29 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:41:29.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:29 smithi188 ceph-mon[43939]: osdmap e410: 12 total, 12 up, 11 in 2024-04-01T19:41:29.939 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:41:29.974 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:30.012 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:41:30.015 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:30.016 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:41:30.117 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:41:30.169 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:30.547 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_historic_ops 2024-04-01T19:41:30.746 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:41:30.753 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:30.754 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:41:30.759 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:30 smithi022 ceph-mon[39439]: pgmap v1149: 17 pgs: 17 active+clean; 8.5 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:41:30.759 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:30 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:41:30.759 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:30 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:41:30.759 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:30 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:41:30.759 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:30 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:41:30.854 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:41:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:30 smithi188 ceph-mon[43939]: pgmap v1149: 17 pgs: 17 active+clean; 8.5 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:41:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:30 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:41:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:30 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:41:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:30 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:41:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:30 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:41:30.903 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:31.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:30 smithi062 ceph-mon[44211]: pgmap v1149: 17 pgs: 17 active+clean; 8.5 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:41:31.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:30 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:41:31.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:30 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:41:31.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:30 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:41:31.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:30 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:41:31.117 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:41:31.128 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:31.128 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:41:31.229 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:41:31.258 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:31.280 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:41:31.282 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:31.283 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:41:31.384 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:41:31.412 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:31.435 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:41:31.440 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:31.440 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:41:31.541 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:41:31.571 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:31.592 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:41:31.597 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:31.597 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:41:31.639 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:41:31.650 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:41:31.698 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:41:31.731 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:31.756 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:41:31.759 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:31.759 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:41:31.860 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:41:31.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:31 smithi188 ceph-mon[43939]: osdmap e411: 12 total, 12 up, 11 in 2024-04-01T19:41:31.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:31 smithi022 ceph-mon[39439]: osdmap e411: 12 total, 12 up, 11 in 2024-04-01T19:41:31.905 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:31.957 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:41:31.963 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:31.963 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:41:32.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:31 smithi062 ceph-mon[44211]: osdmap e411: 12 total, 12 up, 11 in 2024-04-01T19:41:32.064 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:41:32.126 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:32.369 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:41:32.376 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:32.376 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:41:32.478 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:41:32.521 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:32.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:32 smithi022 ceph-mon[39439]: pgmap v1151: 17 pgs: 17 active+clean; 8.4 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.39k op/s 2024-04-01T19:41:32.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:32 smithi022 ceph-mon[39439]: from='client.16083 v1:172.21.15.22:0/4192965410' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:41:32.780 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:41:32.786 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:32.787 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:41:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:32 smithi188 ceph-mon[43939]: pgmap v1151: 17 pgs: 17 active+clean; 8.4 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.39k op/s 2024-04-01T19:41:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:32 smithi188 ceph-mon[43939]: from='client.16083 v1:172.21.15.22:0/4192965410' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:41:32.888 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:41:32.926 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:32.960 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:41:32.968 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:32.969 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:41:33.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:32 smithi062 ceph-mon[44211]: pgmap v1151: 17 pgs: 17 active+clean; 8.4 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.39k op/s 2024-04-01T19:41:33.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:32 smithi062 ceph-mon[44211]: from='client.16083 v1:172.21.15.22:0/4192965410' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:41:33.070 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:41:33.112 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:33.147 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:41:33.151 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:33.151 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:41:33.252 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:41:33.289 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:33.314 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:41:33.318 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:33.318 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:41:33.419 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:41:33.449 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:33.469 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:41:33.475 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:33.475 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:41:33.576 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:41:33.606 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:33.637 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:41:33.639 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:33.640 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:41:33.741 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:41:33.825 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:33.826 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":1151,"stamp":"2024-04-01T19:41:31.021295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8974107192,"num_objects":136928,"num_object_clones":0,"num_object_copies":273856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136928,"num_whiteouts":0,"num_read":127,"num_read_kb":110,"num_write":192649,"num_write_kb":10543483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160887,"ondisk_log_size":160887,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":11,"num_per_pool_osds":11,"num_per_pool_omap_osds":11,"kb":1031196672,"kb_used":21256948,"kb_used_data":17535956,"kb_used_omap":307,"kb_used_meta":3720332,"kb_avail":1009939724,"statfs":{"total":1055945392128,"available":1034178277376,"internally_reserved":0,"allocated":17956818944,"data_stored":17952686203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":315235,"internal_metadata":3809620125},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-548012032,"num_objects":-8362,"num_object_clones":0,"num_object_copies":-16724,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-8362,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8362,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001732"},"pg_stats":[{"pgid":"5.f","version":"411'12202","reported_seq":12394,"reported_epoch":411,"state":"active+clean","last_fresh":"2024-04-01T19:41:30.622589+0000","last_change":"2024-04-01T19:40:35.422971+0000","last_active":"2024-04-01T19:41:30.622589+0000","last_peered":"2024-04-01T19:41:30.622589+0000","last_clean":"2024-04-01T19:41:30.622589+0000","last_became_active":"2024-04-01T19:39:25.119689+0000","last_became_peered":"2024-04-01T19:39:25.119689+0000","last_unstale":"2024-04-01T19:41:30.622589+0000","last_undegraded":"2024-04-01T19:41:30.622589+0000","last_fullsized":"2024-04-01T19:41:30.622589+0000","mapping_epoch":364,"log_start":"375'2200","ondisk_log_start":"375'2200","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"395'8245","last_scrub_stamp":"2024-04-01T19:40:35.422848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:40:35.422848+0000","objects_scrubbed":8211,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:41:37.399421+0000","scrub_duration":1159,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":551288832,"num_objects":8412,"num_object_clones":0,"num_object_copies":16824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8412,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12202,"num_write_kb":659648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"410'12089","reported_seq":12293,"reported_epoch":410,"state":"active+clean","last_fresh":"2024-04-01T19:41:30.027772+0000","last_change":"2024-04-01T19:41:17.580374+0000","last_active":"2024-04-01T19:41:30.027772+0000","last_peered":"2024-04-01T19:41:30.027772+0000","last_clean":"2024-04-01T19:41:30.027772+0000","last_became_active":"2024-04-01T19:39:25.125227+0000","last_became_peered":"2024-04-01T19:39:25.125227+0000","last_unstale":"2024-04-01T19:41:30.027772+0000","last_undegraded":"2024-04-01T19:41:30.027772+0000","last_fullsized":"2024-04-01T19:41:30.027772+0000","mapping_epoch":364,"log_start":"374'2000","ondisk_log_start":"374'2000","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"407'11199","last_scrub_stamp":"2024-04-01T19:41:17.580272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:17.580272+0000","objects_scrubbed":9397,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:42:42.317647+0000","scrub_duration":1907,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":553058304,"num_objects":8439,"num_object_clones":0,"num_object_copies":16878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8439,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12089,"num_write_kb":656896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.d","version":"408'11861","reported_seq":12063,"reported_epoch":408,"state":"active+clean","last_fresh":"2024-04-01T19:41:26.066016+0000","last_change":"2024-04-01T19:41:16.492999+0000","last_active":"2024-04-01T19:41:26.066016+0000","last_peered":"2024-04-01T19:41:26.066016+0000","last_clean":"2024-04-01T19:41:26.066016+0000","last_became_active":"2024-04-01T19:39:25.121522+0000","last_became_peered":"2024-04-01T19:39:25.121522+0000","last_unstale":"2024-04-01T19:41:26.066016+0000","last_undegraded":"2024-04-01T19:41:26.066016+0000","last_fullsized":"2024-04-01T19:41:26.066016+0000","mapping_epoch":364,"log_start":"374'1800","ondisk_log_start":"374'1800","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"406'11162","last_scrub_stamp":"2024-04-01T19:41:16.492775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:16.492775+0000","objects_scrubbed":9473,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:42:34.375374+0000","scrub_duration":1350,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":572391448,"num_objects":8735,"num_object_clones":0,"num_object_copies":17470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8735,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11861,"num_write_kb":659009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.c","version":"410'11897","reported_seq":12087,"reported_epoch":410,"state":"active+clean","last_fresh":"2024-04-01T19:41:29.837729+0000","last_change":"2024-04-01T19:40:39.473907+0000","last_active":"2024-04-01T19:41:29.837729+0000","last_peered":"2024-04-01T19:41:29.837729+0000","last_clean":"2024-04-01T19:41:29.837729+0000","last_became_active":"2024-04-01T19:39:25.119799+0000","last_became_peered":"2024-04-01T19:39:25.119799+0000","last_unstale":"2024-04-01T19:41:29.837729+0000","last_undegraded":"2024-04-01T19:41:29.837729+0000","last_fullsized":"2024-04-01T19:41:29.837729+0000","mapping_epoch":364,"log_start":"374'1800","ondisk_log_start":"374'1800","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"397'8366","last_scrub_stamp":"2024-04-01T19:40:39.473749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:40:39.473749+0000","objects_scrubbed":8319,"log_size":10097,"log_dups_size":0,"ondisk_log_size":10097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:41:54.041870+0000","scrub_duration":1754,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":553058304,"num_objects":8439,"num_object_clones":0,"num_object_copies":16878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8439,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11897,"num_write_kb":650752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"410'12102","reported_seq":12289,"reported_epoch":410,"state":"active+clean","last_fresh":"2024-04-01T19:41:30.027813+0000","last_change":"2024-04-01T19:40:28.585818+0000","last_active":"2024-04-01T19:41:30.027813+0000","last_peered":"2024-04-01T19:41:30.027813+0000","last_clean":"2024-04-01T19:41:30.027813+0000","last_became_active":"2024-04-01T19:39:25.125524+0000","last_became_peered":"2024-04-01T19:39:25.125524+0000","last_unstale":"2024-04-01T19:41:30.027813+0000","last_undegraded":"2024-04-01T19:41:30.027813+0000","last_fullsized":"2024-04-01T19:41:30.027813+0000","mapping_epoch":364,"log_start":"374'2100","ondisk_log_start":"374'2100","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"391'7665","last_scrub_stamp":"2024-04-01T19:40:28.585681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:40:28.585681+0000","objects_scrubbed":7583,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:41:54.733158+0000","scrub_duration":1831,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":551419904,"num_objects":8414,"num_object_clones":0,"num_object_copies":16828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8414,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12102,"num_write_kb":656512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.a","version":"408'12065","reported_seq":12250,"reported_epoch":408,"state":"active+clean","last_fresh":"2024-04-01T19:41:26.495660+0000","last_change":"2024-04-01T19:40:35.574465+0000","last_active":"2024-04-01T19:41:26.495660+0000","last_peered":"2024-04-01T19:41:26.495660+0000","last_clean":"2024-04-01T19:41:26.495660+0000","last_became_active":"2024-04-01T19:39:25.124303+0000","last_became_peered":"2024-04-01T19:39:25.124303+0000","last_unstale":"2024-04-01T19:41:26.495660+0000","last_undegraded":"2024-04-01T19:41:26.495660+0000","last_fullsized":"2024-04-01T19:41:26.495660+0000","mapping_epoch":364,"log_start":"374'2000","ondisk_log_start":"374'2000","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"395'8465","last_scrub_stamp":"2024-04-01T19:40:35.574258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:40:35.574258+0000","objects_scrubbed":8369,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:41:49.319258+0000","scrub_duration":2110,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575733760,"num_objects":8785,"num_object_clones":0,"num_object_copies":17570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8785,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12065,"num_write_kb":667200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"409'12002","reported_seq":12202,"reported_epoch":409,"state":"active+clean","last_fresh":"2024-04-01T19:41:28.317193+0000","last_change":"2024-04-01T19:41:17.930217+0000","last_active":"2024-04-01T19:41:28.317193+0000","last_peered":"2024-04-01T19:41:28.317193+0000","last_clean":"2024-04-01T19:41:28.317193+0000","last_became_active":"2024-04-01T19:39:25.119264+0000","last_became_peered":"2024-04-01T19:39:25.119264+0000","last_unstale":"2024-04-01T19:41:28.317193+0000","last_undegraded":"2024-04-01T19:41:28.317193+0000","last_fullsized":"2024-04-01T19:41:28.317193+0000","mapping_epoch":364,"log_start":"374'2000","ondisk_log_start":"374'2000","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"407'11265","last_scrub_stamp":"2024-04-01T19:41:17.929723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:17.929723+0000","objects_scrubbed":9466,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:42:19.889972+0000","scrub_duration":1416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569114624,"num_objects":8684,"num_object_clones":0,"num_object_copies":17368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8684,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12002,"num_write_kb":661952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"408'12034","reported_seq":12222,"reported_epoch":408,"state":"active+clean","last_fresh":"2024-04-01T19:41:26.078863+0000","last_change":"2024-04-01T19:40:34.998827+0000","last_active":"2024-04-01T19:41:26.078863+0000","last_peered":"2024-04-01T19:41:26.078863+0000","last_clean":"2024-04-01T19:41:26.078863+0000","last_became_active":"2024-04-01T19:39:25.125727+0000","last_became_peered":"2024-04-01T19:39:25.125727+0000","last_unstale":"2024-04-01T19:41:26.078863+0000","last_undegraded":"2024-04-01T19:41:26.078863+0000","last_fullsized":"2024-04-01T19:41:26.078863+0000","mapping_epoch":364,"log_start":"374'2000","ondisk_log_start":"374'2000","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"394'8334","last_scrub_stamp":"2024-04-01T19:40:34.998701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:40:34.998701+0000","objects_scrubbed":8283,"log_size":10034,"log_dups_size":0,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:41:35.351603+0000","scrub_duration":1539,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":581828608,"num_objects":8878,"num_object_clones":0,"num_object_copies":17756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8878,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12034,"num_write_kb":669184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.7","version":"411'12107","reported_seq":12311,"reported_epoch":411,"state":"active+clean","last_fresh":"2024-04-01T19:41:30.649214+0000","last_change":"2024-04-01T19:41:15.363567+0000","last_active":"2024-04-01T19:41:30.649214+0000","last_peered":"2024-04-01T19:41:30.649214+0000","last_clean":"2024-04-01T19:41:30.649214+0000","last_became_active":"2024-04-01T19:39:25.119054+0000","last_became_peered":"2024-04-01T19:39:25.119054+0000","last_unstale":"2024-04-01T19:41:30.649214+0000","last_undegraded":"2024-04-01T19:41:30.649214+0000","last_fullsized":"2024-04-01T19:41:30.649214+0000","mapping_epoch":364,"log_start":"374'2100","ondisk_log_start":"374'2100","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"406'10961","last_scrub_stamp":"2024-04-01T19:41:15.363320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:15.363320+0000","objects_scrubbed":9538,"log_size":10007,"log_dups_size":0,"ondisk_log_size":10007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:42:36.011024+0000","scrub_duration":2196,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":545980416,"num_objects":8331,"num_object_clones":0,"num_object_copies":16662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8331,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12107,"num_write_kb":654016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"408'11971","reported_seq":12171,"reported_epoch":408,"state":"active+clean","last_fresh":"2024-04-01T19:41:26.508218+0000","last_change":"2024-04-01T19:41:15.875163+0000","last_active":"2024-04-01T19:41:26.508218+0000","last_peered":"2024-04-01T19:41:26.508218+0000","last_clean":"2024-04-01T19:41:26.508218+0000","last_became_active":"2024-04-01T19:39:25.119237+0000","last_became_peered":"2024-04-01T19:39:25.119237+0000","last_unstale":"2024-04-01T19:41:26.508218+0000","last_undegraded":"2024-04-01T19:41:26.508218+0000","last_fullsized":"2024-04-01T19:41:26.508218+0000","mapping_epoch":364,"log_start":"374'1900","ondisk_log_start":"374'1900","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"406'11206","last_scrub_stamp":"2024-04-01T19:41:15.875080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:15.875080+0000","objects_scrubbed":9651,"log_size":10071,"log_dups_size":0,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:42:40.574493+0000","scrub_duration":2214,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":577961984,"num_objects":8819,"num_object_clones":0,"num_object_copies":17638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8819,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11971,"num_write_kb":665280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"410'12001","reported_seq":12183,"reported_epoch":410,"state":"active+clean","last_fresh":"2024-04-01T19:41:30.572945+0000","last_change":"2024-04-01T19:40:28.058038+0000","last_active":"2024-04-01T19:41:30.572945+0000","last_peered":"2024-04-01T19:41:30.572945+0000","last_clean":"2024-04-01T19:41:30.572945+0000","last_became_active":"2024-04-01T19:39:25.126777+0000","last_became_peered":"2024-04-01T19:39:25.126777+0000","last_unstale":"2024-04-01T19:41:30.572945+0000","last_undegraded":"2024-04-01T19:41:30.572945+0000","last_fullsized":"2024-04-01T19:41:30.572945+0000","mapping_epoch":364,"log_start":"374'2000","ondisk_log_start":"374'2000","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"390'7579","last_scrub_stamp":"2024-04-01T19:40:28.057807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:40:28.057807+0000","objects_scrubbed":7499,"log_size":10001,"log_dups_size":0,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:41:32.788637+0000","scrub_duration":2108,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":547160064,"num_objects":8349,"num_object_clones":0,"num_object_copies":16698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8349,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12001,"num_write_kb":651200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"410'12208","reported_seq":12409,"reported_epoch":410,"state":"active+clean","last_fresh":"2024-04-01T19:41:30.573297+0000","last_change":"2024-04-01T19:41:18.561092+0000","last_active":"2024-04-01T19:41:30.573297+0000","last_peered":"2024-04-01T19:41:30.573297+0000","last_clean":"2024-04-01T19:41:30.573297+0000","last_became_active":"2024-04-01T19:39:25.125241+0000","last_became_peered":"2024-04-01T19:39:25.125241+0000","last_unstale":"2024-04-01T19:41:30.573297+0000","last_undegraded":"2024-04-01T19:41:30.573297+0000","last_fullsized":"2024-04-01T19:41:30.573297+0000","mapping_epoch":364,"log_start":"374'2200","ondisk_log_start":"374'2200","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"408'11305","last_scrub_stamp":"2024-04-01T19:41:18.560910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:18.560910+0000","objects_scrubbed":9378,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:42:46.096056+0000","scrub_duration":2692,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":548929536,"num_objects":8376,"num_object_clones":0,"num_object_copies":16752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8376,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12208,"num_write_kb":658688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"411'12197","reported_seq":12384,"reported_epoch":411,"state":"active+clean","last_fresh":"2024-04-01T19:41:30.900691+0000","last_change":"2024-04-01T19:40:29.057223+0000","last_active":"2024-04-01T19:41:30.900691+0000","last_peered":"2024-04-01T19:41:30.900691+0000","last_clean":"2024-04-01T19:41:30.900691+0000","last_became_active":"2024-04-01T19:39:25.125236+0000","last_became_peered":"2024-04-01T19:39:25.125236+0000","last_unstale":"2024-04-01T19:41:30.900691+0000","last_undegraded":"2024-04-01T19:41:30.900691+0000","last_fullsized":"2024-04-01T19:41:30.900691+0000","mapping_epoch":364,"log_start":"374'2100","ondisk_log_start":"374'2100","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"391'7791","last_scrub_stamp":"2024-04-01T19:40:29.057044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:40:29.057044+0000","objects_scrubbed":7716,"log_size":10097,"log_dups_size":0,"ondisk_log_size":10097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:41:54.386310+0000","scrub_duration":1585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":553713664,"num_objects":8449,"num_object_clones":0,"num_object_copies":16898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12197,"num_write_kb":660672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1","version":"408'11970","reported_seq":12165,"reported_epoch":408,"state":"active+clean","last_fresh":"2024-04-01T19:41:26.583296+0000","last_change":"2024-04-01T19:41:23.372406+0000","last_active":"2024-04-01T19:41:26.583296+0000","last_peered":"2024-04-01T19:41:26.583296+0000","last_clean":"2024-04-01T19:41:26.583296+0000","last_became_active":"2024-04-01T19:39:25.185686+0000","last_became_peered":"2024-04-01T19:39:25.185686+0000","last_unstale":"2024-04-01T19:41:26.583296+0000","last_undegraded":"2024-04-01T19:41:26.583296+0000","last_fullsized":"2024-04-01T19:41:26.583296+0000","mapping_epoch":364,"log_start":"374'1900","ondisk_log_start":"374'1900","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"408'11736","last_scrub_stamp":"2024-04-01T19:41:23.372284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:23.372284+0000","objects_scrubbed":9013,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:42:43.104028+0000","scrub_duration":1760,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":571080704,"num_objects":8714,"num_object_clones":0,"num_object_copies":17428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8714,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11970,"num_write_kb":661888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"408'11849","reported_seq":12050,"reported_epoch":408,"state":"active+clean","last_fresh":"2024-04-01T19:41:27.245907+0000","last_change":"2024-04-01T19:41:13.951860+0000","last_active":"2024-04-01T19:41:27.245907+0000","last_peered":"2024-04-01T19:41:27.245907+0000","last_clean":"2024-04-01T19:41:27.245907+0000","last_became_active":"2024-04-01T19:39:25.124672+0000","last_became_peered":"2024-04-01T19:39:25.124672+0000","last_unstale":"2024-04-01T19:41:27.245907+0000","last_undegraded":"2024-04-01T19:41:27.245907+0000","last_fullsized":"2024-04-01T19:41:27.245907+0000","mapping_epoch":364,"log_start":"374'1800","ondisk_log_start":"374'1800","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"406'10897","last_scrub_stamp":"2024-04-01T19:41:13.951627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:13.951627+0000","objects_scrubbed":9554,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:42:16.154341+0000","scrub_duration":1748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":559742976,"num_objects":8541,"num_object_clones":0,"num_object_copies":17082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8541,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11849,"num_write_kb":652480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"5.4","version":"408'14393","reported_seq":14739,"reported_epoch":408,"state":"active+clean","last_fresh":"2024-04-01T19:41:27.247244+0000","last_change":"2024-04-01T19:41:12.999560+0000","last_active":"2024-04-01T19:41:27.247244+0000","last_peered":"2024-04-01T19:41:27.247244+0000","last_clean":"2024-04-01T19:41:27.247244+0000","last_became_active":"2024-04-01T19:39:25.125519+0000","last_became_peered":"2024-04-01T19:39:25.125519+0000","last_unstale":"2024-04-01T19:41:27.247244+0000","last_undegraded":"2024-04-01T19:41:27.247244+0000","last_fullsized":"2024-04-01T19:41:27.247244+0000","mapping_epoch":364,"log_start":"380'4300","ondisk_log_start":"380'4300","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"406'13387","last_scrub_stamp":"2024-04-01T19:41:12.999424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:12.999424+0000","objects_scrubbed":9659,"log_size":10093,"log_dups_size":0,"ondisk_log_size":10093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:42:22.772691+0000","scrub_duration":1797,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":561053696,"num_objects":8561,"num_object_clones":0,"num_object_copies":17122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11913,"num_write_kb":655168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":1057,"reported_epoch":409,"state":"active+clean","last_fresh":"2024-04-01T19:41:27.557954+0000","last_change":"2024-04-01T19:41:14.658361+0000","last_active":"2024-04-01T19:41:27.557954+0000","last_peered":"2024-04-01T19:41:27.557954+0000","last_clean":"2024-04-01T19:41:27.557954+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:41:27.557954+0000","last_undegraded":"2024-04-01T19:41:27.557954+0000","last_fullsized":"2024-04-01T19:41:27.557954+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:41:14.658204+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:41:14.658204+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:42:31.774806+0000","scrub_duration":121,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":8973516824,"num_objects":136926,"num_object_clones":0,"num_object_copies":273852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136926,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":192468,"num_write_kb":10540545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17887993856,"data_stored":17887985712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160748,"ondisk_log_size":160748,"up":32,"acting":32,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220386,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1665248,"kb_used_data":1128728,"kb_used_omap":1,"kb_used_meta":536510,"kb_avail":92079904,"statfs":{"total":95995035648,"available":94289821696,"internally_reserved":0,"allocated":1155817472,"data_stored":1155440995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":549386692},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":77,"seq":330712482022,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1976084,"kb_used_data":1656140,"kb_used_omap":1,"kb_used_meta":319934,"kb_avail":91769068,"statfs":{"total":95995035648,"available":93971525632,"internally_reserved":0,"allocated":1695887360,"data_stored":1695518507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":327612864},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678254,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1415404,"kb_used_data":1081572,"kb_used_omap":1,"kb_used_meta":333822,"kb_avail":92329748,"statfs":{"total":95995035648,"available":94545661952,"internally_reserved":0,"allocated":1107529728,"data_stored":1107148837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":341834176},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":0,"seq":846108557450,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234232,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":903644,"kb_used_data":561492,"kb_used_omap":1,"kb_used_meta":342142,"kb_avail":92841508,"statfs":{"total":95995035648,"available":95069704192,"internally_reserved":0,"allocated":574967808,"data_stored":574595423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":350353866},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":335,"seq":1438814044207,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1742444,"kb_used_data":1625124,"kb_used_omap":292,"kb_used_meta":117019,"kb_avail":92002708,"statfs":{"total":95995035648,"available":94210772992,"internally_reserved":0,"allocated":1664126976,"data_stored":1663746085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":299281,"internal_metadata":119828207},"hb_peers":[0,1,2,3,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575125,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2646064,"kb_used_data":2159268,"kb_used_omap":1,"kb_used_meta":486526,"kb_avail":91099088,"statfs":{"total":95995035648,"available":93285466112,"internally_reserved":0,"allocated":2211090432,"data_stored":2210709541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":498203077},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738653,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3598320,"kb_used_data":3247844,"kb_used_omap":1,"kb_used_meta":350462,"kb_avail":90146832,"statfs":{"total":95995035648,"available":92310355968,"internally_reserved":0,"allocated":3325792256,"data_stored":3325411365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":358873541},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346193,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1840660,"kb_used_data":1687308,"kb_used_omap":1,"kb_used_meta":153342,"kb_avail":91904492,"statfs":{"total":95995035648,"available":94110199808,"internally_reserved":0,"allocated":1727803392,"data_stored":1727434559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":157022661},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149963,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":917140,"kb_used_data":556940,"kb_used_omap":1,"kb_used_meta":360190,"kb_avail":92828012,"statfs":{"total":95995035648,"available":95055884288,"internally_reserved":0,"allocated":570306560,"data_stored":569937727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":368835015},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953733,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2063508,"kb_used_data":1671372,"kb_used_omap":1,"kb_used_meta":392126,"kb_avail":91681644,"statfs":{"total":95995035648,"available":93882003456,"internally_reserved":0,"allocated":1711484928,"data_stored":1711116095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":401537477},"hb_peers":[0,1,2,3,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790210,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2488432,"kb_used_data":2160168,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":91256720,"statfs":{"total":95995035648,"available":93446881280,"internally_reserved":0,"allocated":2212012032,"data_stored":2211627069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3308781568,"data_stored":3308781568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2201419776,"data_stored":2201419776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1718550528,"data_stored":1718550528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":566558720,"data_stored":566558720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1710292992,"data_stored":1710292992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2202865664,"data_stored":2202861592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1658650624,"data_stored":1658650624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":569114624,"data_stored":569114624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":1104281600,"data_stored":1104281600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":1693253632,"data_stored":1693253632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":1154224128,"data_stored":1154220056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:41:33.828 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:41:33.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:33 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2631141097' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:41:34.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:33 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2631141097' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:41:34.038 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:41:34.038 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:41:34.038 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:41:34.039 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:41:34.039 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:41:34.039 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:41:34.039 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:41:34.039 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:41:34.039 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:41:34.039 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:41:34.048 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:41:34.065 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:41:34.069 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:41:34.078 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:34.079 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:41:34.080 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:33 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2631141097' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:41:34.090 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:41:34.113 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:41:34.113 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:41:34.113 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:41:34.113 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:41:34.113 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:41:34.113 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:41:34.113 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:41:34.113 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:41:34.114 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:41:34.114 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:41:34.114 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:41:34.114 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:41:34.180 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:41:34.210 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:34.237 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:41:34.242 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:34.242 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:41:34.343 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:41:34.398 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:34.646 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:34 smithi022 ceph-mon[39439]: pgmap v1152: 17 pgs: 17 active+clean; 8.2 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:41:34.646 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:34.647 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:34.647 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:34.647 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:34.647 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:34.647 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:34.647 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:34.647 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:34.782 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:41:35.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:34 smithi062 ceph-mon[44211]: pgmap v1152: 17 pgs: 17 active+clean; 8.2 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:41:35.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:34 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:34 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:34 smithi188 ceph-mon[43939]: pgmap v1152: 17 pgs: 17 active+clean; 8.2 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:41:35.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:34 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.681 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:41:35.690 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:35.691 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:41:35.792 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:41:35.823 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:35.844 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:41:35.849 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:35.849 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:41:35.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:35 smithi022 ceph-mon[39439]: pgmap v1153: 17 pgs: 17 active+clean; 8.2 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 892 op/s 2024-04-01T19:41:35.950 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:41:35.992 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.992 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:35.992 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:35 smithi062 ceph-mon[44211]: pgmap v1153: 17 pgs: 17 active+clean; 8.2 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 892 op/s 2024-04-01T19:41:35.995 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:36.028 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:41:36.033 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:36.034 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:41:36.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:36.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:36.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:35 smithi188 ceph-mon[43939]: pgmap v1153: 17 pgs: 17 active+clean; 8.2 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 892 op/s 2024-04-01T19:41:36.135 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:41:36.166 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:36.190 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:41:36.194 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:41:36.199 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:36.199 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:41:36.200 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:41:36.300 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:41:36.332 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:36.355 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:41:36.360 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:36.360 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:41:36.461 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:41:36.496 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:36.523 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:41:36.526 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:36.526 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:41:36.627 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:41:36.682 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:37.646 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:41:37.659 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:37.660 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:41:37.761 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:41:37.790 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:37.811 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:41:37.813 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:37.814 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:41:37.914 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:41:37.941 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:37 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:41:37.941 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:37 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:41:37.941 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:37 smithi062 ceph-mon[44211]: osdmap e412: 12 total, 12 up, 11 in 2024-04-01T19:41:37.941 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:37 smithi062 ceph-mon[44211]: pgmap v1155: 17 pgs: 17 active+clean; 7.9 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 1.34k op/s 2024-04-01T19:41:37.944 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:37.973 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:41:37.977 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:37.978 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:41:38.079 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:41:38.107 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:37 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:41:38.107 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:37 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:41:38.107 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:37 smithi188 ceph-mon[43939]: osdmap e412: 12 total, 12 up, 11 in 2024-04-01T19:41:38.107 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:37 smithi188 ceph-mon[43939]: pgmap v1155: 17 pgs: 17 active+clean; 7.9 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 1.34k op/s 2024-04-01T19:41:38.108 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:38.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:37 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:41:38.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:37 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:41:38.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:37 smithi022 ceph-mon[39439]: osdmap e412: 12 total, 12 up, 11 in 2024-04-01T19:41:38.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:37 smithi022 ceph-mon[39439]: pgmap v1155: 17 pgs: 17 active+clean; 7.9 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 1.34k op/s 2024-04-01T19:41:38.129 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:41:38.132 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:38.132 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:41:38.194 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:41:38.232 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:41:38.260 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:38.283 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:41:38.291 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:38.291 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:41:38.392 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:41:38.436 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:39.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:39 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:41:39.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:39 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:41:39.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:39 smithi022 ceph-mon[39439]: pgmap v1156: 17 pgs: 17 active+clean; 7.8 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:41:39.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:39 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:41:39.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:39 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:41:39.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:39 smithi188 ceph-mon[43939]: pgmap v1156: 17 pgs: 17 active+clean; 7.8 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:41:39.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:39 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:41:39.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:39 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:41:39.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:39 smithi062 ceph-mon[44211]: pgmap v1156: 17 pgs: 17 active+clean; 7.8 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:41:39.880 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:41:39.881 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 20, 2024-04-01T19:41:39.881 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 600, 2024-04-01T19:41:39.881 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:41:39.881 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.881 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280259 4.a 4:5aaeadf0:::benchmark_data_smithi188_104537_object108265:head [delete] snapc 0=[] ondisk+write+known_if_redirected e341)", 2024-04-01T19:41:39.881 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:02.880407+0000", 2024-04-01T19:41:39.881 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 216.88138012799999, 2024-04-01T19:41:39.881 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.37092404699999998, 2024-04-01T19:41:39.881 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:39.881 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:39.881 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:39.881 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:39.882 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:41:39.882 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:41:39.882 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280259 2024-04-01T19:41:39.882 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.882 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:39.882 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.882 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:39.882 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.880407+0000", 2024-04-01T19:41:39.882 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.882 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.882 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.883 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:39.883 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.880407+0000", 2024-04-01T19:41:39.883 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.883 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.883 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.883 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:39.883 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.880408+0000", 2024-04-01T19:41:39.883 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.203e-06 2024-04-01T19:41:39.883 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.883 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.883 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:39.883 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.880412+0000", 2024-04-01T19:41:39.883 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.0439999999999997e-06 2024-04-01T19:41:39.884 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.884 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.884 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:39.884 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.880419+0000", 2024-04-01T19:41:39.884 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0570000000000004e-06 2024-04-01T19:41:39.884 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.884 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.884 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:39.884 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.880426+0000", 2024-04-01T19:41:39.884 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0949999999999998e-06 2024-04-01T19:41:39.884 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.884 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.885 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:39.885 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.043602+0000", 2024-04-01T19:41:39.885 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.16317563700000001 2024-04-01T19:41:39.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.885 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.885 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:39.885 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.043737+0000", 2024-04-01T19:41:39.885 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013481999999999999 2024-04-01T19:41:39.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.885 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.886 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:41:39.886 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.043823+0000", 2024-04-01T19:41:39.886 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6428000000000007e-05 2024-04-01T19:41:39.886 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.886 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.886 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:39.886 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.047945+0000", 2024-04-01T19:41:39.886 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0041217750000000003 2024-04-01T19:41:39.886 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.886 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.886 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.886 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.057853+0000", 2024-04-01T19:41:39.886 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0099078080000000006 2024-04-01T19:41:39.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.887 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.887 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.887 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.251133+0000", 2024-04-01T19:41:39.887 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.19328063300000001 2024-04-01T19:41:39.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.887 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.887 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:39.887 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.251197+0000", 2024-04-01T19:41:39.887 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3244999999999995e-05 2024-04-01T19:41:39.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.887 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.887 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:39.887 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.251331+0000", 2024-04-01T19:41:39.888 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013430199999999999 2024-04-01T19:41:39.888 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.888 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:39.888 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.888 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.888 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.888 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280279 4.a 4:5474afe5:::benchmark_data_smithi188_104537_object108285:head [delete] snapc 0=[] ondisk+write+known_if_redirected e341)", 2024-04-01T19:41:39.888 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:02.918543+0000", 2024-04-01T19:41:39.888 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 216.84324382400001, 2024-04-01T19:41:39.888 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.33306474000000003, 2024-04-01T19:41:39.888 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:39.888 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:39.888 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:39.889 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:39.889 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:41:39.889 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:41:39.889 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280279 2024-04-01T19:41:39.889 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.889 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:39.889 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.889 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:39.889 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.918543+0000", 2024-04-01T19:41:39.889 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.889 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.889 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.889 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:39.889 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.918543+0000", 2024-04-01T19:41:39.889 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.890 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.890 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.890 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:39.890 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.918545+0000", 2024-04-01T19:41:39.890 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6729999999999999e-06 2024-04-01T19:41:39.890 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.890 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.890 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:39.890 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.918550+0000", 2024-04-01T19:41:39.890 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3680000000000001e-06 2024-04-01T19:41:39.890 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.890 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.890 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:39.890 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.918561+0000", 2024-04-01T19:41:39.891 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0621e-05 2024-04-01T19:41:39.891 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.891 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.891 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:39.891 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.918567+0000", 2024-04-01T19:41:39.891 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2190000000000001e-06 2024-04-01T19:41:39.891 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.891 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.891 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:39.891 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.048050+0000", 2024-04-01T19:41:39.891 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.12948316300000001 2024-04-01T19:41:39.891 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.891 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.891 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:39.892 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.048134+0000", 2024-04-01T19:41:39.892 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3809999999999999e-05 2024-04-01T19:41:39.892 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.892 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.892 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:41:39.892 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.048249+0000", 2024-04-01T19:41:39.892 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000114777 2024-04-01T19:41:39.892 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.892 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.892 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:39.892 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.057218+0000", 2024-04-01T19:41:39.892 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0089692220000000007 2024-04-01T19:41:39.893 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.893 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.893 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.893 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.057903+0000", 2024-04-01T19:41:39.893 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00068458699999999996 2024-04-01T19:41:39.893 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.893 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.893 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.893 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.251396+0000", 2024-04-01T19:41:39.893 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.19349359399999999 2024-04-01T19:41:39.893 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.893 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.893 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:39.893 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.251465+0000", 2024-04-01T19:41:39.894 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8649e-05 2024-04-01T19:41:39.894 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.894 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.894 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:39.894 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.251608+0000", 2024-04-01T19:41:39.894 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014305700000000001 2024-04-01T19:41:39.894 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.894 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:39.894 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.894 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.894 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.894 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280289 4.a 4:507b84db:::benchmark_data_smithi188_104537_object108295:head [delete] snapc 0=[] ondisk+write+known_if_redirected e341)", 2024-04-01T19:41:39.894 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:02.936137+0000", 2024-04-01T19:41:39.895 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 216.825649664, 2024-04-01T19:41:39.895 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.315722528, 2024-04-01T19:41:39.895 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:39.895 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:39.895 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:39.895 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:39.895 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:41:39.895 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:41:39.895 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280289 2024-04-01T19:41:39.895 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.895 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:39.895 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.895 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:39.896 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.936137+0000", 2024-04-01T19:41:39.896 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.896 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.896 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.896 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:39.896 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.936137+0000", 2024-04-01T19:41:39.896 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.896 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.896 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.896 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:39.896 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.936139+0000", 2024-04-01T19:41:39.896 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5770000000000001e-06 2024-04-01T19:41:39.896 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.896 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.897 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:39.897 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.936144+0000", 2024-04-01T19:41:39.897 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7489999999999998e-06 2024-04-01T19:41:39.897 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.897 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.897 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:39.897 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.936154+0000", 2024-04-01T19:41:39.897 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0267e-05 2024-04-01T19:41:39.897 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.897 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.897 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:39.897 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.936162+0000", 2024-04-01T19:41:39.897 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3850000000000002e-06 2024-04-01T19:41:39.897 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.897 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.898 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:39.898 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.052037+0000", 2024-04-01T19:41:39.898 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.115874912 2024-04-01T19:41:39.898 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.898 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.898 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:39.898 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.052152+0000", 2024-04-01T19:41:39.898 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000115147 2024-04-01T19:41:39.898 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.898 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.898 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:41:39.898 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.052302+0000", 2024-04-01T19:41:39.898 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000149271 2024-04-01T19:41:39.898 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.899 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.899 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:39.899 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.057357+0000", 2024-04-01T19:41:39.899 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0050550300000000003 2024-04-01T19:41:39.899 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.899 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.899 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.899 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.057950+0000", 2024-04-01T19:41:39.899 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00059334399999999999 2024-04-01T19:41:39.899 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.899 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.899 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.899 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.251681+0000", 2024-04-01T19:41:39.899 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.193731178 2024-04-01T19:41:39.900 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.900 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.900 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:39.900 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.251743+0000", 2024-04-01T19:41:39.900 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1285999999999996e-05 2024-04-01T19:41:39.900 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.900 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.900 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:39.900 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.251860+0000", 2024-04-01T19:41:39.900 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000117382 2024-04-01T19:41:39.901 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.901 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:39.901 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.901 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.901 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.901 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280668 4.a 4:5f9d703f:::benchmark_data_smithi188_104537_object108674:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e342)", 2024-04-01T19:41:39.901 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.572593+0000", 2024-04-01T19:41:39.901 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 216.189194456, 2024-04-01T19:41:39.901 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.31502582299999998, 2024-04-01T19:41:39.901 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:39.901 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:39.901 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:39.901 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:39.901 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:41:39.902 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:41:39.902 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280668 2024-04-01T19:41:39.902 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.902 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:39.902 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.902 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:39.902 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572593+0000", 2024-04-01T19:41:39.902 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.902 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.902 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.902 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:39.902 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572593+0000", 2024-04-01T19:41:39.902 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.902 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.903 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.903 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:39.903 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572593+0000", 2024-04-01T19:41:39.903 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.82e-07 2024-04-01T19:41:39.903 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.903 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.903 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:39.903 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572595+0000", 2024-04-01T19:41:39.903 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.069e-06 2024-04-01T19:41:39.903 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.903 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.903 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:39.903 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572601+0000", 2024-04-01T19:41:39.904 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0680000000000002e-06 2024-04-01T19:41:39.904 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.904 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.904 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:39.904 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572607+0000", 2024-04-01T19:41:39.904 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8449999999999999e-06 2024-04-01T19:41:39.904 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.904 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.904 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:39.904 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.871983+0000", 2024-04-01T19:41:39.904 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.29937640399999998 2024-04-01T19:41:39.904 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.904 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.904 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:39.905 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.872076+0000", 2024-04-01T19:41:39.905 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.2752999999999998e-05 2024-04-01T19:41:39.905 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.905 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.905 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:41:39.905 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.872214+0000", 2024-04-01T19:41:39.905 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000138121 2024-04-01T19:41:39.905 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.905 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.905 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.905 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.881643+0000", 2024-04-01T19:41:39.905 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0094283549999999994 2024-04-01T19:41:39.905 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.906 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.906 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:39.906 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.881715+0000", 2024-04-01T19:41:39.906 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2582000000000004e-05 2024-04-01T19:41:39.906 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.906 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.906 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.906 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887484+0000", 2024-04-01T19:41:39.906 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0057684260000000001 2024-04-01T19:41:39.906 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.906 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.906 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:39.907 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887530+0000", 2024-04-01T19:41:39.907 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5859999999999998e-05 2024-04-01T19:41:39.907 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.907 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.907 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:39.907 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887618+0000", 2024-04-01T19:41:39.907 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8857999999999995e-05 2024-04-01T19:41:39.907 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.907 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:39.907 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.907 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.907 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.907 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280671 4.a 4:5678a52e:::benchmark_data_smithi188_104537_object108677:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e342)", 2024-04-01T19:41:39.907 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.572613+0000", 2024-04-01T19:41:39.908 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 216.189173926, 2024-04-01T19:41:39.908 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.31520125100000002, 2024-04-01T19:41:39.908 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:39.908 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:39.908 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:39.908 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:39.908 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:41:39.908 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:41:39.908 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280671 2024-04-01T19:41:39.908 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.908 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:39.908 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.908 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:39.908 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572613+0000", 2024-04-01T19:41:39.909 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.909 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.909 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.909 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:39.909 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572613+0000", 2024-04-01T19:41:39.909 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.909 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.909 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.909 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:39.909 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572614+0000", 2024-04-01T19:41:39.909 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1199999999999998e-07 2024-04-01T19:41:39.909 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.909 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.909 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:39.909 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572616+0000", 2024-04-01T19:41:39.910 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9700000000000002e-06 2024-04-01T19:41:39.910 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.910 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.910 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:39.910 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572621+0000", 2024-04-01T19:41:39.910 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7200000000000003e-06 2024-04-01T19:41:39.910 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.910 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.910 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:39.910 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572626+0000", 2024-04-01T19:41:39.910 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9810000000000003e-06 2024-04-01T19:41:39.910 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.910 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.911 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:39.911 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.877001+0000", 2024-04-01T19:41:39.911 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.30437526399999998 2024-04-01T19:41:39.911 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.911 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.911 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:39.911 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.877142+0000", 2024-04-01T19:41:39.911 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014064700000000001 2024-04-01T19:41:39.911 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.911 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.911 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:41:39.911 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.877247+0000", 2024-04-01T19:41:39.911 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00010501300000000001 2024-04-01T19:41:39.911 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.911 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.911 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.912 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.881701+0000", 2024-04-01T19:41:39.912 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0044534010000000001 2024-04-01T19:41:39.912 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.912 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.912 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.912 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887662+0000", 2024-04-01T19:41:39.912 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0059614719999999998 2024-04-01T19:41:39.912 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.912 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.912 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:39.912 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887709+0000", 2024-04-01T19:41:39.912 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6757e-05 2024-04-01T19:41:39.912 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.913 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.913 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:39.913 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887740+0000", 2024-04-01T19:41:39.913 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.0864000000000001e-05 2024-04-01T19:41:39.913 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.913 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.913 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:39.913 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887814+0000", 2024-04-01T19:41:39.913 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4750000000000001e-05 2024-04-01T19:41:39.913 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.913 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:39.913 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.913 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.914 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.914 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280680 4.a 4:52c07fa1:::benchmark_data_smithi188_104537_object108686:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e342)", 2024-04-01T19:41:39.914 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.572631+0000", 2024-04-01T19:41:39.914 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 216.189156172, 2024-04-01T19:41:39.914 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.32162606599999999, 2024-04-01T19:41:39.914 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:39.914 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:39.914 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:39.914 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:39.914 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:41:39.914 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:41:39.914 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280680 2024-04-01T19:41:39.914 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.914 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:39.914 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.915 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:39.915 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572631+0000", 2024-04-01T19:41:39.915 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.915 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.915 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.915 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:39.915 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572631+0000", 2024-04-01T19:41:39.915 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.915 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.915 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.915 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:39.915 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572631+0000", 2024-04-01T19:41:39.915 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9999999999999998e-07 2024-04-01T19:41:39.915 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.915 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.916 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:39.916 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572637+0000", 2024-04-01T19:41:39.916 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6359999999999999e-06 2024-04-01T19:41:39.916 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.916 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.916 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:39.916 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572643+0000", 2024-04-01T19:41:39.916 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1500000000000004e-06 2024-04-01T19:41:39.916 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.916 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.916 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:39.916 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572648+0000", 2024-04-01T19:41:39.916 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8420000000000004e-06 2024-04-01T19:41:39.916 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.917 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.917 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:39.917 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.881733+0000", 2024-04-01T19:41:39.917 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.30908518400000001 2024-04-01T19:41:39.917 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.917 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.917 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:39.917 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.881823+0000", 2024-04-01T19:41:39.917 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.9461000000000003e-05 2024-04-01T19:41:39.917 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.917 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.917 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:41:39.917 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.881906+0000", 2024-04-01T19:41:39.917 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3122999999999997e-05 2024-04-01T19:41:39.917 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.918 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.918 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.918 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887699+0000", 2024-04-01T19:41:39.918 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0057936979999999999 2024-04-01T19:41:39.918 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.918 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.918 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:39.918 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887821+0000", 2024-04-01T19:41:39.918 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012160200000000001 2024-04-01T19:41:39.918 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.918 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.918 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.918 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.894148+0000", 2024-04-01T19:41:39.918 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0063270569999999996 2024-04-01T19:41:39.919 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.919 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.919 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:39.919 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.894181+0000", 2024-04-01T19:41:39.919 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3297999999999999e-05 2024-04-01T19:41:39.919 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.919 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.919 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:39.919 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.894257+0000", 2024-04-01T19:41:39.919 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5615e-05 2024-04-01T19:41:39.919 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.919 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:39.919 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.919 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.919 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.919 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280682 4.a 4:5e31f9ed:::benchmark_data_smithi188_104537_object108688:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e342)", 2024-04-01T19:41:39.920 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.572654+0000", 2024-04-01T19:41:39.920 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 216.18913292100001, 2024-04-01T19:41:39.920 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.32646417599999999, 2024-04-01T19:41:39.920 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:39.920 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:39.920 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:39.920 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:39.920 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:41:39.920 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:41:39.920 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280682 2024-04-01T19:41:39.920 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.920 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:39.920 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.920 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:39.920 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572654+0000", 2024-04-01T19:41:39.920 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.921 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.921 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.921 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:39.921 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572654+0000", 2024-04-01T19:41:39.921 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.921 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.921 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.921 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:39.921 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572655+0000", 2024-04-01T19:41:39.921 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0399999999999996e-07 2024-04-01T19:41:39.921 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.921 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.921 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:39.921 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572657+0000", 2024-04-01T19:41:39.921 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.04e-06 2024-04-01T19:41:39.921 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.922 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.922 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:39.922 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572662+0000", 2024-04-01T19:41:39.922 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7350000000000001e-06 2024-04-01T19:41:39.922 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.922 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.922 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:39.922 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572667+0000", 2024-04-01T19:41:39.922 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7999999999999998e-06 2024-04-01T19:41:39.922 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.922 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.922 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:39.922 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.885081+0000", 2024-04-01T19:41:39.922 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.31241408599999998 2024-04-01T19:41:39.922 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.923 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.923 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:39.923 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.885168+0000", 2024-04-01T19:41:39.923 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6565999999999998e-05 2024-04-01T19:41:39.923 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.923 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.923 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:41:39.923 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.885257+0000", 2024-04-01T19:41:39.923 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.9629000000000005e-05 2024-04-01T19:41:39.923 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.923 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.923 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:39.923 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887825+0000", 2024-04-01T19:41:39.923 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0025676750000000002 2024-04-01T19:41:39.923 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.924 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.924 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.924 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887859+0000", 2024-04-01T19:41:39.924 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3898e-05 2024-04-01T19:41:39.924 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.924 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.924 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.924 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.899001+0000", 2024-04-01T19:41:39.924 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.011141977000000001 2024-04-01T19:41:39.924 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.924 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.924 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:39.924 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.899042+0000", 2024-04-01T19:41:39.924 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1326999999999999e-05 2024-04-01T19:41:39.924 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.924 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.925 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:39.925 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.899118+0000", 2024-04-01T19:41:39.925 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5939000000000006e-05 2024-04-01T19:41:39.925 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.925 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:39.925 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.925 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.925 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.925 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280688 4.a 4:5068fb67:::benchmark_data_smithi188_104537_object108694:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e342)", 2024-04-01T19:41:39.925 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.572673+0000", 2024-04-01T19:41:39.925 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 216.189114098, 2024-04-01T19:41:39.925 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.326602581, 2024-04-01T19:41:39.925 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:39.925 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:39.925 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:39.925 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:39.926 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:41:39.926 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:41:39.926 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280688 2024-04-01T19:41:39.926 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.926 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:39.926 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.926 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:39.926 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572673+0000", 2024-04-01T19:41:39.926 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.926 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.926 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.926 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:39.926 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572673+0000", 2024-04-01T19:41:39.926 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.927 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.927 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.927 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:39.927 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572673+0000", 2024-04-01T19:41:39.927 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.0600000000000001e-07 2024-04-01T19:41:39.927 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.927 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.927 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:39.927 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572675+0000", 2024-04-01T19:41:39.927 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1280000000000002e-06 2024-04-01T19:41:39.927 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.927 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.927 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:39.927 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572681+0000", 2024-04-01T19:41:39.927 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6189999999999999e-06 2024-04-01T19:41:39.927 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.928 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.928 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:39.928 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572688+0000", 2024-04-01T19:41:39.928 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4779999999999996e-06 2024-04-01T19:41:39.928 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.928 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.928 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:39.928 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887890+0000", 2024-04-01T19:41:39.928 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.31520266699999999 2024-04-01T19:41:39.928 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.928 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.928 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:39.928 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887972+0000", 2024-04-01T19:41:39.929 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2123e-05 2024-04-01T19:41:39.929 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.929 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.929 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:41:39.929 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.888053+0000", 2024-04-01T19:41:39.929 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0934999999999997e-05 2024-04-01T19:41:39.929 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.929 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.929 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.929 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.894307+0000", 2024-04-01T19:41:39.929 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0062534399999999999 2024-04-01T19:41:39.929 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.929 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.929 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:39.929 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.896683+0000", 2024-04-01T19:41:39.930 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0023765739999999998 2024-04-01T19:41:39.930 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.930 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.930 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.930 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.899162+0000", 2024-04-01T19:41:39.930 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0024782440000000001 2024-04-01T19:41:39.930 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.930 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.930 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:39.930 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.899196+0000", 2024-04-01T19:41:39.930 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.4026999999999998e-05 2024-04-01T19:41:39.930 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.930 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.931 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:39.931 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.899276+0000", 2024-04-01T19:41:39.931 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9939999999999997e-05 2024-04-01T19:41:39.931 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.931 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:39.931 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.931 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.931 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.931 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280700 4.a 4:5f535780:::benchmark_data_smithi188_104537_object108706:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e342)", 2024-04-01T19:41:39.931 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.572692+0000", 2024-04-01T19:41:39.931 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 216.18909491299999, 2024-04-01T19:41:39.931 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.34045793499999999, 2024-04-01T19:41:39.931 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:39.931 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:39.931 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:39.932 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:39.932 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:41:39.932 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:41:39.932 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280700 2024-04-01T19:41:39.932 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.932 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:39.932 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.932 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:39.932 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572692+0000", 2024-04-01T19:41:39.932 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.932 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.932 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.932 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:39.933 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572692+0000", 2024-04-01T19:41:39.933 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.933 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.933 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.933 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:39.933 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572693+0000", 2024-04-01T19:41:39.933 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1899999999999998e-07 2024-04-01T19:41:39.933 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.933 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.933 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:39.933 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572694+0000", 2024-04-01T19:41:39.933 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9309999999999998e-06 2024-04-01T19:41:39.933 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.933 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.934 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:39.934 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572700+0000", 2024-04-01T19:41:39.934 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6280000000000002e-06 2024-04-01T19:41:39.934 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.934 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.934 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:39.934 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572705+0000", 2024-04-01T19:41:39.934 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3020000000000002e-06 2024-04-01T19:41:39.934 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.934 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.934 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:39.934 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.890646+0000", 2024-04-01T19:41:39.934 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.31794064999999999 2024-04-01T19:41:39.935 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.935 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.935 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:39.935 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.890772+0000", 2024-04-01T19:41:39.935 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012627999999999999 2024-04-01T19:41:39.935 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.935 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.935 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:41:39.935 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.890919+0000", 2024-04-01T19:41:39.935 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014695299999999999 2024-04-01T19:41:39.935 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.935 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.935 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.935 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.894348+0000", 2024-04-01T19:41:39.936 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0034283180000000001 2024-04-01T19:41:39.936 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.936 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.936 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:39.936 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.896687+0000", 2024-04-01T19:41:39.936 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.002339402 2024-04-01T19:41:39.936 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.936 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.936 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.936 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.912959+0000", 2024-04-01T19:41:39.936 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.016271601 2024-04-01T19:41:39.936 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.936 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.936 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:39.937 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.913025+0000", 2024-04-01T19:41:39.937 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.6524000000000002e-05 2024-04-01T19:41:39.937 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.937 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.937 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:39.937 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.913150+0000", 2024-04-01T19:41:39.937 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012492699999999999 2024-04-01T19:41:39.937 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.937 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:39.937 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.937 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.937 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.937 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280705 4.a 4:59717340:::benchmark_data_smithi188_104537_object108711:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e342)", 2024-04-01T19:41:39.937 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.572711+0000", 2024-04-01T19:41:39.938 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 216.18907586200001, 2024-04-01T19:41:39.938 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.34923071100000003, 2024-04-01T19:41:39.938 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:39.938 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:39.938 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:39.938 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:39.938 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:41:39.938 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:41:39.938 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280705 2024-04-01T19:41:39.938 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.938 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:39.938 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.938 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:39.939 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572711+0000", 2024-04-01T19:41:39.939 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.939 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.939 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.939 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:39.939 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572711+0000", 2024-04-01T19:41:39.939 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.939 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.939 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.939 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:39.939 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572712+0000", 2024-04-01T19:41:39.939 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9999999999999998e-07 2024-04-01T19:41:39.939 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.939 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.940 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:39.940 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572714+0000", 2024-04-01T19:41:39.940 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0870000000000001e-06 2024-04-01T19:41:39.940 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.940 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.940 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:39.940 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572719+0000", 2024-04-01T19:41:39.940 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2970000000000003e-06 2024-04-01T19:41:39.940 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.940 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.940 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:39.940 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572725+0000", 2024-04-01T19:41:39.941 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7849999999999997e-06 2024-04-01T19:41:39.941 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.941 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.941 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:39.941 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.894379+0000", 2024-04-01T19:41:39.941 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.321654104 2024-04-01T19:41:39.941 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.941 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.941 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:39.941 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.894465+0000", 2024-04-01T19:41:39.941 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6127999999999999e-05 2024-04-01T19:41:39.941 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.941 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.942 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:41:39.942 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.894559+0000", 2024-04-01T19:41:39.942 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.4486000000000003e-05 2024-04-01T19:41:39.942 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.942 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.942 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:39.942 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.899286+0000", 2024-04-01T19:41:39.942 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0047264830000000001 2024-04-01T19:41:39.942 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.942 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.942 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.942 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.905641+0000", 2024-04-01T19:41:39.943 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.006355449 2024-04-01T19:41:39.943 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.943 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.943 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.943 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.921834+0000", 2024-04-01T19:41:39.943 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.016192959999999999 2024-04-01T19:41:39.943 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.943 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.943 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:39.943 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.921877+0000", 2024-04-01T19:41:39.943 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.2576e-05 2024-04-01T19:41:39.943 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.943 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.943 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:39.943 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.921942+0000", 2024-04-01T19:41:39.944 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4956000000000006e-05 2024-04-01T19:41:39.944 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.944 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:39.944 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.944 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.944 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.944 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280708 4.a 4:58bafadf:::benchmark_data_smithi188_104537_object108714:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e342)", 2024-04-01T19:41:39.944 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.572729+0000", 2024-04-01T19:41:39.944 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 216.18905773399999, 2024-04-01T19:41:39.944 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.34934728500000001, 2024-04-01T19:41:39.944 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:39.944 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:39.944 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:39.944 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:39.944 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:41:39.945 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:41:39.945 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280708 2024-04-01T19:41:39.945 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.945 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:39.945 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.945 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:39.945 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572729+0000", 2024-04-01T19:41:39.945 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.945 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.945 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.945 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:39.945 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572729+0000", 2024-04-01T19:41:39.945 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.945 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.945 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.946 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:39.946 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572730+0000", 2024-04-01T19:41:39.946 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1600000000000002e-07 2024-04-01T19:41:39.946 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.946 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.946 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:39.946 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572732+0000", 2024-04-01T19:41:39.946 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9700000000000002e-06 2024-04-01T19:41:39.946 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.946 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.946 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:39.946 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572737+0000", 2024-04-01T19:41:39.946 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7710000000000003e-06 2024-04-01T19:41:39.946 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.946 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.947 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:39.947 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572744+0000", 2024-04-01T19:41:39.947 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.674e-06 2024-04-01T19:41:39.947 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.947 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.947 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:39.947 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.896705+0000", 2024-04-01T19:41:39.947 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.32396117800000002 2024-04-01T19:41:39.947 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.947 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.947 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:39.947 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.896783+0000", 2024-04-01T19:41:39.947 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7198000000000002e-05 2024-04-01T19:41:39.947 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.947 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.947 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:41:39.948 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.896860+0000", 2024-04-01T19:41:39.948 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7474999999999999e-05 2024-04-01T19:41:39.948 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.948 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.948 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.948 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.905701+0000", 2024-04-01T19:41:39.948 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0088405659999999994 2024-04-01T19:41:39.948 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.948 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.948 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:39.948 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.905717+0000", 2024-04-01T19:41:39.948 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6181e-05 2024-04-01T19:41:39.948 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.948 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.948 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.949 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.921981+0000", 2024-04-01T19:41:39.949 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.016264321000000002 2024-04-01T19:41:39.949 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.949 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.949 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:39.949 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.922018+0000", 2024-04-01T19:41:39.949 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.6616999999999999e-05 2024-04-01T19:41:39.949 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.949 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.949 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:39.949 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.922077+0000", 2024-04-01T19:41:39.949 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8918000000000001e-05 2024-04-01T19:41:39.949 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.949 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:39.949 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.949 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.950 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.950 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280716 4.a 4:565a1ebf:::benchmark_data_smithi188_104537_object108722:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e342)", 2024-04-01T19:41:39.950 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.572749+0000", 2024-04-01T19:41:39.950 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 216.18903836800001, 2024-04-01T19:41:39.950 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.34945212799999997, 2024-04-01T19:41:39.950 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:39.950 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:39.950 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:39.950 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:39.950 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:41:39.950 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:41:39.950 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280716 2024-04-01T19:41:39.950 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.951 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:39.951 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.951 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:39.951 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572749+0000", 2024-04-01T19:41:39.951 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.951 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.951 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.951 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:39.951 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572749+0000", 2024-04-01T19:41:39.951 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.951 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.951 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.951 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:39.951 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572749+0000", 2024-04-01T19:41:39.951 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1600000000000002e-07 2024-04-01T19:41:39.952 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.952 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.952 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:39.952 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572751+0000", 2024-04-01T19:41:39.952 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0449999999999999e-06 2024-04-01T19:41:39.952 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.952 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.952 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:39.952 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572757+0000", 2024-04-01T19:41:39.952 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5639999999999996e-06 2024-04-01T19:41:39.952 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.952 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.952 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:39.952 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572762+0000", 2024-04-01T19:41:39.953 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2299999999999999e-06 2024-04-01T19:41:39.953 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.953 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.953 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:39.953 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.899313+0000", 2024-04-01T19:41:39.953 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.32655144699999999 2024-04-01T19:41:39.953 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.953 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.953 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:39.953 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.899397+0000", 2024-04-01T19:41:39.953 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3267000000000001e-05 2024-04-01T19:41:39.953 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.953 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.954 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:41:39.954 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.899474+0000", 2024-04-01T19:41:39.954 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7848000000000004e-05 2024-04-01T19:41:39.954 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.954 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.954 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.954 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.905743+0000", 2024-04-01T19:41:39.954 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0062688800000000001 2024-04-01T19:41:39.954 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.954 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.954 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:39.954 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.909147+0000", 2024-04-01T19:41:39.954 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0034036019999999999 2024-04-01T19:41:39.955 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.955 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.955 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.955 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.922113+0000", 2024-04-01T19:41:39.955 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.012966030999999999 2024-04-01T19:41:39.955 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.955 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.955 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:39.955 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.922145+0000", 2024-04-01T19:41:39.955 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.1701e-05 2024-04-01T19:41:39.955 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.955 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.955 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:39.955 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.922201+0000", 2024-04-01T19:41:39.956 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6097000000000002e-05 2024-04-01T19:41:39.956 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.956 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:39.956 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.956 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.956 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.956 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280721 4.a 4:58f19a78:::benchmark_data_smithi188_104537_object108727:head [delete] snapc 0=[] ondisk+write+known_if_redirected e342)", 2024-04-01T19:41:39.956 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.576436+0000", 2024-04-01T19:41:39.956 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 216.18535143899999, 2024-04-01T19:41:39.956 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.34588794, 2024-04-01T19:41:39.956 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:39.956 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:39.956 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:39.956 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:39.957 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:41:39.957 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:41:39.957 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280721 2024-04-01T19:41:39.957 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.957 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:39.957 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.957 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:39.957 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.576436+0000", 2024-04-01T19:41:39.957 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.957 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.957 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.957 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:39.957 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.576436+0000", 2024-04-01T19:41:39.957 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.958 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.958 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.958 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:39.958 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.576437+0000", 2024-04-01T19:41:39.958 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.514e-06 2024-04-01T19:41:39.958 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.958 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.958 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:39.958 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.576443+0000", 2024-04-01T19:41:39.958 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4009999999999996e-06 2024-04-01T19:41:39.958 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.958 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.959 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:39.959 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.576452+0000", 2024-04-01T19:41:39.959 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.8139999999999995e-06 2024-04-01T19:41:39.959 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.959 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.959 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:39.959 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.576460+0000", 2024-04-01T19:41:39.959 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2110000000000001e-06 2024-04-01T19:41:39.959 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.959 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.959 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:39.959 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.902499+0000", 2024-04-01T19:41:39.959 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.32603918999999998 2024-04-01T19:41:39.960 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.960 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.960 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:39.960 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.902605+0000", 2024-04-01T19:41:39.960 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000105884 2024-04-01T19:41:39.960 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.960 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.960 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:41:39.960 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.902689+0000", 2024-04-01T19:41:39.960 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4604000000000005e-05 2024-04-01T19:41:39.960 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.960 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.960 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.960 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.912818+0000", 2024-04-01T19:41:39.961 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010129098 2024-04-01T19:41:39.961 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.961 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.961 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:39.961 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.912837+0000", 2024-04-01T19:41:39.961 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8329e-05 2024-04-01T19:41:39.961 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.961 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.961 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.961 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.922236+0000", 2024-04-01T19:41:39.961 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0093993359999999995 2024-04-01T19:41:39.961 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.961 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.961 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:39.961 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.922267+0000", 2024-04-01T19:41:39.962 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.0855999999999997e-05 2024-04-01T19:41:39.962 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.962 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.962 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:39.962 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.922324+0000", 2024-04-01T19:41:39.962 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6703000000000002e-05 2024-04-01T19:41:39.962 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.962 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:39.962 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.962 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.962 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.962 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280728 4.a 4:573bba9f:::benchmark_data_smithi188_104537_object108734:head [delete] snapc 0=[] ondisk+write+known_if_redirected e342)", 2024-04-01T19:41:39.962 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.586751+0000", 2024-04-01T19:41:39.963 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 216.175036167, 2024-04-01T19:41:39.963 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.33572831400000003, 2024-04-01T19:41:39.963 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:39.963 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:39.963 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:39.963 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:39.963 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:41:39.963 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:41:39.963 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280728 2024-04-01T19:41:39.963 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.963 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:39.963 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.963 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:39.963 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.586751+0000", 2024-04-01T19:41:39.964 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.964 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.964 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.964 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:39.964 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.586751+0000", 2024-04-01T19:41:39.964 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.964 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.964 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.964 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:39.964 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.586752+0000", 2024-04-01T19:41:39.964 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5579999999999999e-06 2024-04-01T19:41:39.964 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.964 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.964 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:39.965 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.586756+0000", 2024-04-01T19:41:39.965 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9360000000000001e-06 2024-04-01T19:41:39.965 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.965 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.965 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:39.965 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.586765+0000", 2024-04-01T19:41:39.965 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.9050000000000003e-06 2024-04-01T19:41:39.965 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.965 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.965 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:39.965 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.586771+0000", 2024-04-01T19:41:39.965 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4179999999999996e-06 2024-04-01T19:41:39.965 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.965 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.966 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:39.966 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.905786+0000", 2024-04-01T19:41:39.966 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.31901577599999997 2024-04-01T19:41:39.966 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.966 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.966 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:39.966 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.905922+0000", 2024-04-01T19:41:39.966 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000135883 2024-04-01T19:41:39.966 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.966 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.966 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:41:39.966 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.906072+0000", 2024-04-01T19:41:39.966 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015011700000000001 2024-04-01T19:41:39.967 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.967 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.967 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.967 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.912898+0000", 2024-04-01T19:41:39.967 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0068258040000000004 2024-04-01T19:41:39.967 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.967 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.967 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:39.967 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.913165+0000", 2024-04-01T19:41:39.967 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00026646100000000001 2024-04-01T19:41:39.967 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.967 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.967 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.968 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.922364+0000", 2024-04-01T19:41:39.968 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0091992170000000009 2024-04-01T19:41:39.968 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.968 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.968 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:39.968 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.922399+0000", 2024-04-01T19:41:39.968 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.4736000000000001e-05 2024-04-01T19:41:39.968 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.968 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.968 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:39.968 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.922479+0000", 2024-04-01T19:41:39.968 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0502999999999998e-05 2024-04-01T19:41:39.968 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.969 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:39.969 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.969 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.969 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.969 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280753 4.a 4:57b6b593:::benchmark_data_smithi188_104537_object108759:head [delete] snapc 0=[] ondisk+write+known_if_redirected e342)", 2024-04-01T19:41:39.969 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.630968+0000", 2024-04-01T19:41:39.969 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 216.13081951999999, 2024-04-01T19:41:39.969 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.54604825899999998, 2024-04-01T19:41:39.969 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:39.969 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:39.969 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:39.970 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:39.970 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:41:39.970 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:41:39.970 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280753 2024-04-01T19:41:39.970 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.970 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:39.970 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.970 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:39.970 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.630968+0000", 2024-04-01T19:41:39.970 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.970 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.970 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.971 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:39.971 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.630968+0000", 2024-04-01T19:41:39.971 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.971 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.971 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.971 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:39.971 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.630969+0000", 2024-04-01T19:41:39.971 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.079e-06 2024-04-01T19:41:39.971 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.971 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.971 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:39.971 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.630972+0000", 2024-04-01T19:41:39.971 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3950000000000001e-06 2024-04-01T19:41:39.971 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.972 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.972 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:39.972 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.630981+0000", 2024-04-01T19:41:39.972 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8130000000000002e-06 2024-04-01T19:41:39.972 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.972 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.972 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:39.972 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.630986+0000", 2024-04-01T19:41:39.972 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.1039999999999998e-06 2024-04-01T19:41:39.972 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.972 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.972 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:39.972 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.909181+0000", 2024-04-01T19:41:39.972 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.278195103 2024-04-01T19:41:39.972 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.973 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.973 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:39.973 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.909323+0000", 2024-04-01T19:41:39.973 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014192799999999999 2024-04-01T19:41:39.973 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.973 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.973 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:41:39.973 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.909478+0000", 2024-04-01T19:41:39.973 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015519700000000001 2024-04-01T19:41:39.973 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.973 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.973 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.973 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.913220+0000", 2024-04-01T19:41:39.973 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0037419319999999999 2024-04-01T19:41:39.974 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.974 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.974 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:39.974 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.916829+0000", 2024-04-01T19:41:39.974 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.003609236 2024-04-01T19:41:39.974 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.974 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.974 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.974 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.176813+0000", 2024-04-01T19:41:39.974 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.25998363200000002 2024-04-01T19:41:39.974 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.974 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.975 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:39.975 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.176883+0000", 2024-04-01T19:41:39.975 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0119999999999999e-05 2024-04-01T19:41:39.975 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.975 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.975 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:39.975 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.177016+0000", 2024-04-01T19:41:39.975 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013271999999999999 2024-04-01T19:41:39.975 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.975 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:39.975 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.975 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.975 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.975 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280778 4.a 4:54697a84:::benchmark_data_smithi188_104537_object108784:head [delete] snapc 0=[] ondisk+write+known_if_redirected e342)", 2024-04-01T19:41:39.975 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.696916+0000", 2024-04-01T19:41:39.975 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 216.064870676, 2024-04-01T19:41:39.976 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.48040244799999998, 2024-04-01T19:41:39.976 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:39.976 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:39.976 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:39.976 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:39.976 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:41:39.976 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:41:39.976 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280778 2024-04-01T19:41:39.976 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.976 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:39.976 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.976 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:39.976 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.696916+0000", 2024-04-01T19:41:39.976 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.976 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.976 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.977 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:39.977 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.696916+0000", 2024-04-01T19:41:39.977 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.977 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.977 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.977 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:39.977 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.696917+0000", 2024-04-01T19:41:39.977 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.4200000000000004e-07 2024-04-01T19:41:39.977 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.977 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.977 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:39.977 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.696921+0000", 2024-04-01T19:41:39.977 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5080000000000001e-06 2024-04-01T19:41:39.977 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.978 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.978 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:39.978 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.696929+0000", 2024-04-01T19:41:39.978 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9519999999999994e-06 2024-04-01T19:41:39.978 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.978 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.978 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:39.978 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.696936+0000", 2024-04-01T19:41:39.978 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3379999999999999e-06 2024-04-01T19:41:39.978 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.978 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.978 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:39.978 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.913266+0000", 2024-04-01T19:41:39.979 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21632944800000001 2024-04-01T19:41:39.979 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.979 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.979 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:39.979 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.913408+0000", 2024-04-01T19:41:39.979 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014255299999999999 2024-04-01T19:41:39.979 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.979 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.979 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:41:39.979 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.913562+0000", 2024-04-01T19:41:39.979 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015434100000000001 2024-04-01T19:41:39.979 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.979 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.979 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.979 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.919210+0000", 2024-04-01T19:41:39.980 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.005647104 2024-04-01T19:41:39.980 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.980 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.980 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:39.980 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.919219+0000", 2024-04-01T19:41:39.980 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.9649999999999997e-06 2024-04-01T19:41:39.980 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.980 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.980 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.980 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.177141+0000", 2024-04-01T19:41:39.980 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.25792264199999998 2024-04-01T19:41:39.980 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.980 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.980 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:39.980 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.177204+0000", 2024-04-01T19:41:39.980 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2388e-05 2024-04-01T19:41:39.981 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.981 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.981 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:39.981 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.177319+0000", 2024-04-01T19:41:39.981 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00011526700000000001 2024-04-01T19:41:39.981 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.981 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:39.981 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.981 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.981 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.981 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280780 4.a 4:5fb16d9f:::benchmark_data_smithi188_104537_object108786:head [delete] snapc 0=[] ondisk+write+known_if_redirected e342)", 2024-04-01T19:41:39.981 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.706847+0000", 2024-04-01T19:41:39.981 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 216.05494000499999, 2024-04-01T19:41:39.981 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.47077487200000001, 2024-04-01T19:41:39.981 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:39.982 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:39.982 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:39.982 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:39.982 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:41:39.982 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:41:39.982 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280780 2024-04-01T19:41:39.982 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.982 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:39.982 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.982 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:39.982 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.706847+0000", 2024-04-01T19:41:39.982 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.982 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.982 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.983 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:39.983 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.706847+0000", 2024-04-01T19:41:39.983 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.983 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.983 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.983 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:39.983 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.706848+0000", 2024-04-01T19:41:39.983 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4279999999999999e-06 2024-04-01T19:41:39.983 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.983 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.983 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:39.983 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.706853+0000", 2024-04-01T19:41:39.983 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.2080000000000002e-06 2024-04-01T19:41:39.983 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.983 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.984 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:39.984 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.706862+0000", 2024-04-01T19:41:39.984 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.183e-06 2024-04-01T19:41:39.984 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.984 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.984 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:39.984 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.706870+0000", 2024-04-01T19:41:39.984 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2919999999999996e-06 2024-04-01T19:41:39.984 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.984 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.984 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:39.984 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.916850+0000", 2024-04-01T19:41:39.984 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.209980051 2024-04-01T19:41:39.985 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.985 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.985 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:39.985 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.916931+0000", 2024-04-01T19:41:39.985 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.1198000000000004e-05 2024-04-01T19:41:39.985 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.985 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.985 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:41:39.985 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.917009+0000", 2024-04-01T19:41:39.985 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7379000000000006e-05 2024-04-01T19:41:39.985 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.985 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.985 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.985 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.921774+0000", 2024-04-01T19:41:39.985 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0047650030000000003 2024-04-01T19:41:39.986 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.986 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.986 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:39.986 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.922209+0000", 2024-04-01T19:41:39.986 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00043543299999999999 2024-04-01T19:41:39.986 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.986 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.986 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.986 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.177445+0000", 2024-04-01T19:41:39.986 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.25523606199999999 2024-04-01T19:41:39.986 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.986 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.986 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:39.986 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.177507+0000", 2024-04-01T19:41:39.987 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2008000000000007e-05 2024-04-01T19:41:39.987 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.987 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.987 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:39.987 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.177622+0000", 2024-04-01T19:41:39.987 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000114627 2024-04-01T19:41:39.987 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.987 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:39.987 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.987 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.987 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.987 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:281241 4.a 4:56f95ea3:::benchmark_data_smithi188_104537_object109247:head [delete] snapc 0=[] ondisk+write+known_if_redirected e342)", 2024-04-01T19:41:39.987 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:04.502549+0000", 2024-04-01T19:41:39.987 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 215.259237872, 2024-04-01T19:41:39.988 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.32777840800000002, 2024-04-01T19:41:39.988 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:39.988 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:39.988 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:39.988 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:39.988 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:41:39.988 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:41:39.988 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 281241 2024-04-01T19:41:39.988 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.988 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:39.988 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.988 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:39.988 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.502549+0000", 2024-04-01T19:41:39.988 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.989 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.989 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.989 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:39.989 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.502549+0000", 2024-04-01T19:41:39.989 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.989 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.989 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.989 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:39.989 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.502551+0000", 2024-04-01T19:41:39.989 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2290000000000002e-06 2024-04-01T19:41:39.989 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.989 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.989 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:39.989 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.502559+0000", 2024-04-01T19:41:39.989 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3780000000000003e-06 2024-04-01T19:41:39.990 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.990 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.990 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:39.990 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.502570+0000", 2024-04-01T19:41:39.990 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1311999999999999e-05 2024-04-01T19:41:39.990 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.990 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.990 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:39.990 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.502577+0000", 2024-04-01T19:41:39.990 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4629999999999998e-06 2024-04-01T19:41:39.990 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.990 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.990 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:39.991 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.614393+0000", 2024-04-01T19:41:39.991 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.111816596 2024-04-01T19:41:39.991 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.991 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.991 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:39.991 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.614479+0000", 2024-04-01T19:41:39.991 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6218999999999996e-05 2024-04-01T19:41:39.991 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.991 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.991 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:41:39.991 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.614578+0000", 2024-04-01T19:41:39.991 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.9117999999999995e-05 2024-04-01T19:41:39.991 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.991 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.992 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.992 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.621913+0000", 2024-04-01T19:41:39.992 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.007334531 2024-04-01T19:41:39.992 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.992 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.992 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:39.992 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.621940+0000", 2024-04-01T19:41:39.992 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.7138e-05 2024-04-01T19:41:39.992 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.992 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.992 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.992 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.830200+0000", 2024-04-01T19:41:39.993 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.208260221 2024-04-01T19:41:39.993 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.993 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.993 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:39.993 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.830246+0000", 2024-04-01T19:41:39.993 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5719000000000001e-05 2024-04-01T19:41:39.993 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.993 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.993 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:39.993 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.830328+0000", 2024-04-01T19:41:39.993 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.1483999999999994e-05 2024-04-01T19:41:39.994 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.994 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:39.994 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:39.994 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.994 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.994 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:281242 4.a 4:5141e774:::benchmark_data_smithi188_104537_object109248:head [delete] snapc 0=[] ondisk+write+known_if_redirected e342)", 2024-04-01T19:41:39.994 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:04.502594+0000", 2024-04-01T19:41:39.994 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 215.25919263399999, 2024-04-01T19:41:39.994 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.327909334, 2024-04-01T19:41:39.994 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:39.994 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:39.994 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:39.994 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:39.995 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:41:39.995 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:41:39.995 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 281242 2024-04-01T19:41:39.995 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.995 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:39.995 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.995 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:39.995 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.502594+0000", 2024-04-01T19:41:39.995 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.995 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.995 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.995 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:39.995 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.502594+0000", 2024-04-01T19:41:39.996 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:39.996 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.996 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.996 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:39.996 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.502595+0000", 2024-04-01T19:41:39.996 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7899999999999998e-07 2024-04-01T19:41:39.996 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.996 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.996 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:39.996 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.502598+0000", 2024-04-01T19:41:39.996 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5399999999999998e-06 2024-04-01T19:41:39.997 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.997 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.997 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:39.997 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.502602+0000", 2024-04-01T19:41:39.997 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7929999999999997e-06 2024-04-01T19:41:39.997 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.997 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.998 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:39.998 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.502606+0000", 2024-04-01T19:41:39.998 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5090000000000002e-06 2024-04-01T19:41:39.998 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.998 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.998 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:39.998 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.617433+0000", 2024-04-01T19:41:39.998 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.11482761599999999 2024-04-01T19:41:39.998 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.998 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.998 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:39.998 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.617578+0000", 2024-04-01T19:41:39.999 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014499700000000001 2024-04-01T19:41:39.999 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.999 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.999 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:41:39.999 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.617716+0000", 2024-04-01T19:41:39.999 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013726799999999999 2024-04-01T19:41:39.999 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:39.999 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:39.999 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:39.999 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.621969+0000", 2024-04-01T19:41:39.999 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0042530500000000004 2024-04-01T19:41:39.999 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.625446+0000", 2024-04-01T19:41:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0034773030000000002 2024-04-01T19:41:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.830407+0000", 2024-04-01T19:41:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.20496082400000001 2024-04-01T19:41:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.830442+0000", 2024-04-01T19:41:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5488000000000003e-05 2024-04-01T19:41:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.830504+0000", 2024-04-01T19:41:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1366999999999997e-05 2024-04-01T19:41:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:281245 4.a 4:5f796c3c:::benchmark_data_smithi188_104537_object109251:head [delete] snapc 0=[] ondisk+write+known_if_redirected e342)", 2024-04-01T19:41:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:04.514287+0000", 2024-04-01T19:41:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 215.247499605, 2024-04-01T19:41:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.31636779300000001, 2024-04-01T19:41:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:40.002 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:41:40.002 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:40.002 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:41:40.002 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:41:40.002 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 281245 2024-04-01T19:41:40.002 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:40.002 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:40.002 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:40.002 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:40.002 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.514287+0000", 2024-04-01T19:41:40.002 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:40.002 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:40.002 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:40.003 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:40.003 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.514287+0000", 2024-04-01T19:41:40.003 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:40.003 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:40.003 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:40.003 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:40.003 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.514289+0000", 2024-04-01T19:41:40.003 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6479999999999999e-06 2024-04-01T19:41:40.003 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:40.003 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:40.003 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:40.003 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.514295+0000", 2024-04-01T19:41:40.003 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9100000000000002e-06 2024-04-01T19:41:40.003 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:40.003 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:40.003 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:40.004 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.514306+0000", 2024-04-01T19:41:40.004 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0872e-05 2024-04-01T19:41:40.004 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:40.004 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:40.004 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:40.004 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.514313+0000", 2024-04-01T19:41:40.004 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3730000000000004e-06 2024-04-01T19:41:40.004 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:40.004 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:40.004 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:40.004 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.622006+0000", 2024-04-01T19:41:40.004 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.107692344 2024-04-01T19:41:40.004 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:40.004 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:40.004 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:40.004 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.622127+0000", 2024-04-01T19:41:40.005 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000121712 2024-04-01T19:41:40.005 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:40.005 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:40.005 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:41:40.005 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.622210+0000", 2024-04-01T19:41:40.005 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2909000000000002e-05 2024-04-01T19:41:40.005 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:40.005 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:40.005 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:40.005 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.629938+0000", 2024-04-01T19:41:40.005 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.007727958 2024-04-01T19:41:40.005 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:40.005 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:40.005 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:41:40.005 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.630016+0000", 2024-04-01T19:41:40.005 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.8009000000000005e-05 2024-04-01T19:41:40.005 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:40.006 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:40.006 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:41:40.006 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.830547+0000", 2024-04-01T19:41:40.006 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.20053106200000001 2024-04-01T19:41:40.006 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:40.006 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:40.006 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:41:40.006 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.830585+0000", 2024-04-01T19:41:40.006 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7360999999999997e-05 2024-04-01T19:41:40.006 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:40.006 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:40.006 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:41:40.006 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.830655+0000", 2024-04-01T19:41:40.006 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0635000000000004e-05 2024-04-01T19:41:40.007 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:40.007 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:40.007 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:40.007 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:40.007 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:40.007 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:41:40.104 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:41:40.110 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:40.110 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:41:40.211 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:41:40.244 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:40.270 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:41:40.273 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:40.274 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:41:40.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:40 smithi022 ceph-mon[39439]: osdmap e413: 12 total, 12 up, 11 in 2024-04-01T19:41:40.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:40 smithi188 ceph-mon[43939]: osdmap e413: 12 total, 12 up, 11 in 2024-04-01T19:41:40.375 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:41:40.407 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:40.437 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:41:40.440 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:40.441 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:41:40.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:40 smithi062 ceph-mon[44211]: osdmap e413: 12 total, 12 up, 11 in 2024-04-01T19:41:40.541 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:41:40.584 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:40.613 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:41:40.615 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:40.616 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:41:40.717 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:41:40.772 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:40.794 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:41:40.797 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:40.797 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:41:40.898 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:41:40.935 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:40.962 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:41:40.967 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:40.967 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:41:41.068 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:41:41.118 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:41.173 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:41:41.181 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:41.181 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:41:41.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:41 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:41:41.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:41 smithi062 ceph-mon[44211]: pgmap v1158: 17 pgs: 17 active+clean; 7.6 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:41:41.282 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:41:41.315 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:41.340 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:41:41.343 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:41.343 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:41:41.444 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:41:41.477 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:41 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:41:41.478 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:41 smithi022 ceph-mon[39439]: pgmap v1158: 17 pgs: 17 active+clean; 7.6 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:41:41.506 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:41.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:41 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:41:41.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:41 smithi188 ceph-mon[43939]: pgmap v1158: 17 pgs: 17 active+clean; 7.6 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:41:42.083 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_ops_in_flight 2024-04-01T19:41:42.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:42 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:41:42.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:42 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:41:42.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:42 smithi022 ceph-mon[39439]: osdmap e414: 12 total, 12 up, 11 in 2024-04-01T19:41:42.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:42 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:41:42.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:42 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:41:42.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:42 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:41:42.395 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:42.395 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:41:42.395 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:41:42.496 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:41:42.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:42 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:41:42.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:42 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:41:42.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:42 smithi062 ceph-mon[44211]: osdmap e414: 12 total, 12 up, 11 in 2024-04-01T19:41:42.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:42 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:41:42.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:42 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:41:42.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:42 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:41:42.529 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:42.559 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:41:42.566 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:42.566 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:41:42.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:42 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:41:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:42 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:41:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:42 smithi188 ceph-mon[43939]: osdmap e414: 12 total, 12 up, 11 in 2024-04-01T19:41:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:42 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:41:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:42 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:41:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:42 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:41:42.667 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:41:42.710 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:42.734 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:41:42.738 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:42.738 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:41:42.839 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:41:42.906 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:42.930 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:41:43.174 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:43 smithi022 ceph-mon[39439]: pgmap v1160: 17 pgs: 17 active+clean; 7.5 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T19:41:43.417 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:41:43.423 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:43.423 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:41:43.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:43 smithi062 ceph-mon[44211]: pgmap v1160: 17 pgs: 17 active+clean; 7.5 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T19:41:43.525 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:41:43.562 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:43.596 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:41:43.601 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:43.602 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:41:43.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:43 smithi188 ceph-mon[43939]: pgmap v1160: 17 pgs: 17 active+clean; 7.5 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T19:41:43.704 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:41:43.737 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:43.763 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:41:43.766 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:43.766 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:41:43.867 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:41:43.895 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:43.917 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:41:43.920 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:43.920 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:41:44.021 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:41:44.050 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:44.072 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:41:44.075 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:44.075 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:41:44.176 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:41:44.206 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:44.209 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:41:44.228 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:41:44.231 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:44.231 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:41:44.234 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:41:44.325 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:41:44.331 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:41:44.357 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:41:44.362 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:44.387 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:41:44.389 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:44.390 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:41:44.491 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:41:44.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:44 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:41:44.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:44 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:41:44.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:44 smithi062 ceph-mon[44211]: osdmap e415: 12 total, 12 up, 11 in 2024-04-01T19:41:44.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:44 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1130400474' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:41:44.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:44 smithi062 ceph-mon[44211]: from='client.26029 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:41:44.546 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:44 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:41:44.546 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:44 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:41:44.546 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:44 smithi022 ceph-mon[39439]: osdmap e415: 12 total, 12 up, 11 in 2024-04-01T19:41:44.546 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:44 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1130400474' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:41:44.547 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:44 smithi022 ceph-mon[39439]: from='client.26029 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:41:44.550 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:44.599 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:41:44.608 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:44.608 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:41:44.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:44 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:41:44.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:44 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:41:44.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:44 smithi188 ceph-mon[43939]: osdmap e415: 12 total, 12 up, 11 in 2024-04-01T19:41:44.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:44 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1130400474' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:41:44.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:44 smithi188 ceph-mon[43939]: from='client.26029 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:41:44.709 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:41:44.741 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:44.764 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:41:44.766 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:44.766 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:41:44.867 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:41:44.926 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:44.981 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:41:44.986 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:44.987 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:41:45.088 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:41:45.126 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:45.156 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:41:45.159 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:45.160 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:41:45.261 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:41:45.308 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:45.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:45 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:41:45.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:45 smithi062 ceph-mon[44211]: from='client.26029 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:41:45.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:45 smithi062 ceph-mon[44211]: osdmap e416: 12 total, 12 up, 11 in 2024-04-01T19:41:45.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:45 smithi062 ceph-mon[44211]: from='client.26032 v1:172.21.15.22:0/890893303' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:41:45.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:45 smithi062 ceph-mon[44211]: pgmap v1163: 17 pgs: 17 active+clean; 7.4 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:41:45.511 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:45 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:41:45.511 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:45 smithi022 ceph-mon[39439]: from='client.26029 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:41:45.511 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:45 smithi022 ceph-mon[39439]: osdmap e416: 12 total, 12 up, 11 in 2024-04-01T19:41:45.511 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:45 smithi022 ceph-mon[39439]: from='client.26032 v1:172.21.15.22:0/890893303' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:41:45.511 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:45 smithi022 ceph-mon[39439]: pgmap v1163: 17 pgs: 17 active+clean; 7.4 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:41:45.526 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:41:45.533 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:45.533 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:41:45.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:45 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:41:45.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:45 smithi188 ceph-mon[43939]: from='client.26029 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:41:45.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:45 smithi188 ceph-mon[43939]: osdmap e416: 12 total, 12 up, 11 in 2024-04-01T19:41:45.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:45 smithi188 ceph-mon[43939]: from='client.26032 v1:172.21.15.22:0/890893303' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:41:45.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:45 smithi188 ceph-mon[43939]: pgmap v1163: 17 pgs: 17 active+clean; 7.4 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:41:45.634 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:41:45.673 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:45.698 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:41:45.702 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:45.703 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:41:45.804 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:41:45.858 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:45.895 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:41:45.915 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:45.915 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:41:46.016 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:41:46.048 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:46.073 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:41:46.082 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:46.083 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:41:46.184 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:41:46.246 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:46.271 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:41:46.276 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:46.277 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:41:46.286 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":1162,"stamp":"2024-04-01T19:41:44.194747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7993885240,"num_objects":121971,"num_object_clones":0,"num_object_copies":243942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121971,"num_whiteouts":0,"num_read":127,"num_read_kb":110,"num_write":207606,"num_write_kb":10543483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160944,"ondisk_log_size":160944,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":11,"num_per_pool_osds":11,"num_per_pool_omap_osds":11,"kb":1031196672,"kb_used":19470900,"kb_used_data":15709560,"kb_used_omap":307,"kb_used_meta":3760588,"kb_avail":1011725772,"statfs":{"total":1055945392128,"available":1036007190528,"internally_reserved":0,"allocated":16086589440,"data_stored":16082828781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":315235,"internal_metadata":3850842269},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,3,5,8,4,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-396623872,"num_objects":-6052,"num_object_clones":0,"num_object_copies":-12104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-6052,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6052,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.166679"},"pg_stats":[{"pgid":"5.f","version":"413'12939","reported_seq":13136,"reported_epoch":413,"state":"active+clean","last_fresh":"2024-04-01T19:41:40.607887+0000","last_change":"2024-04-01T19:40:35.422971+0000","last_active":"2024-04-01T19:41:40.607887+0000","last_peered":"2024-04-01T19:41:40.607887+0000","last_clean":"2024-04-01T19:41:40.607887+0000","last_became_active":"2024-04-01T19:39:25.119689+0000","last_became_peered":"2024-04-01T19:39:25.119689+0000","last_unstale":"2024-04-01T19:41:40.607887+0000","last_undegraded":"2024-04-01T19:41:40.607887+0000","last_fullsized":"2024-04-01T19:41:40.607887+0000","mapping_epoch":364,"log_start":"377'2900","ondisk_log_start":"377'2900","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"395'8245","last_scrub_stamp":"2024-04-01T19:40:35.422848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:40:35.422848+0000","objects_scrubbed":8211,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1159,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502988800,"num_objects":7675,"num_object_clones":0,"num_object_copies":15350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7675,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12939,"num_write_kb":659648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"413'12825","reported_seq":13033,"reported_epoch":413,"state":"active+clean","last_fresh":"2024-04-01T19:41:40.058294+0000","last_change":"2024-04-01T19:41:17.580374+0000","last_active":"2024-04-01T19:41:40.058294+0000","last_peered":"2024-04-01T19:41:40.058294+0000","last_clean":"2024-04-01T19:41:40.058294+0000","last_became_active":"2024-04-01T19:39:25.125227+0000","last_became_peered":"2024-04-01T19:39:25.125227+0000","last_unstale":"2024-04-01T19:41:40.058294+0000","last_undegraded":"2024-04-01T19:41:40.058294+0000","last_fullsized":"2024-04-01T19:41:40.058294+0000","mapping_epoch":364,"log_start":"377'2800","ondisk_log_start":"377'2800","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"407'11199","last_scrub_stamp":"2024-04-01T19:41:17.580272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:17.580272+0000","objects_scrubbed":9397,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:42:42.317647+0000","scrub_duration":1907,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":504823808,"num_objects":7703,"num_object_clones":0,"num_object_copies":15406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7703,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12825,"num_write_kb":656896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.d","version":"413'12994","reported_seq":13206,"reported_epoch":413,"state":"active+clean","last_fresh":"2024-04-01T19:41:40.953260+0000","last_change":"2024-04-01T19:41:16.492999+0000","last_active":"2024-04-01T19:41:40.953260+0000","last_peered":"2024-04-01T19:41:40.953260+0000","last_clean":"2024-04-01T19:41:40.953260+0000","last_became_active":"2024-04-01T19:39:25.121522+0000","last_became_peered":"2024-04-01T19:39:25.121522+0000","last_unstale":"2024-04-01T19:41:40.953260+0000","last_undegraded":"2024-04-01T19:41:40.953260+0000","last_fullsized":"2024-04-01T19:41:40.953260+0000","mapping_epoch":364,"log_start":"377'2900","ondisk_log_start":"377'2900","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"406'11162","last_scrub_stamp":"2024-04-01T19:41:16.492775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:16.492775+0000","objects_scrubbed":9473,"log_size":10094,"log_dups_size":0,"ondisk_log_size":10094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:42:34.375374+0000","scrub_duration":1350,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":498139160,"num_objects":7602,"num_object_clones":0,"num_object_copies":15204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7602,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12994,"num_write_kb":659009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.c","version":"413'12612","reported_seq":12811,"reported_epoch":413,"state":"active+clean","last_fresh":"2024-04-01T19:41:39.825561+0000","last_change":"2024-04-01T19:40:39.473907+0000","last_active":"2024-04-01T19:41:39.825561+0000","last_peered":"2024-04-01T19:41:39.825561+0000","last_clean":"2024-04-01T19:41:39.825561+0000","last_became_active":"2024-04-01T19:39:25.119799+0000","last_became_peered":"2024-04-01T19:39:25.119799+0000","last_unstale":"2024-04-01T19:41:39.825561+0000","last_undegraded":"2024-04-01T19:41:39.825561+0000","last_fullsized":"2024-04-01T19:41:39.825561+0000","mapping_epoch":364,"log_start":"377'2600","ondisk_log_start":"377'2600","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"397'8366","last_scrub_stamp":"2024-04-01T19:40:39.473749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:40:39.473749+0000","objects_scrubbed":8319,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:41:54.041870+0000","scrub_duration":1754,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":506200064,"num_objects":7724,"num_object_clones":0,"num_object_copies":15448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7724,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12612,"num_write_kb":650752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"413'12892","reported_seq":13084,"reported_epoch":413,"state":"active+clean","last_fresh":"2024-04-01T19:41:40.047407+0000","last_change":"2024-04-01T19:40:28.585818+0000","last_active":"2024-04-01T19:41:40.047407+0000","last_peered":"2024-04-01T19:41:40.047407+0000","last_clean":"2024-04-01T19:41:40.047407+0000","last_became_active":"2024-04-01T19:39:25.125524+0000","last_became_peered":"2024-04-01T19:39:25.125524+0000","last_unstale":"2024-04-01T19:41:40.047407+0000","last_undegraded":"2024-04-01T19:41:40.047407+0000","last_fullsized":"2024-04-01T19:41:40.047407+0000","mapping_epoch":364,"log_start":"377'2800","ondisk_log_start":"377'2800","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"391'7665","last_scrub_stamp":"2024-04-01T19:40:28.585681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:40:28.585681+0000","objects_scrubbed":7583,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:41:54.733158+0000","scrub_duration":1831,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":499646464,"num_objects":7624,"num_object_clones":0,"num_object_copies":15248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7624,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12892,"num_write_kb":656512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.a","version":"414'13192","reported_seq":13392,"reported_epoch":414,"state":"active+clean","last_fresh":"2024-04-01T19:41:41.568042+0000","last_change":"2024-04-01T19:40:35.574465+0000","last_active":"2024-04-01T19:41:41.568042+0000","last_peered":"2024-04-01T19:41:41.568042+0000","last_clean":"2024-04-01T19:41:41.568042+0000","last_became_active":"2024-04-01T19:39:25.124303+0000","last_became_peered":"2024-04-01T19:39:25.124303+0000","last_unstale":"2024-04-01T19:41:41.568042+0000","last_undegraded":"2024-04-01T19:41:41.568042+0000","last_fullsized":"2024-04-01T19:41:41.568042+0000","mapping_epoch":364,"log_start":"377'3100","ondisk_log_start":"377'3100","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"395'8465","last_scrub_stamp":"2024-04-01T19:40:35.574258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:40:35.574258+0000","objects_scrubbed":8369,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:41:49.319258+0000","scrub_duration":2110,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":501874688,"num_objects":7658,"num_object_clones":0,"num_object_copies":15316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7658,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13192,"num_write_kb":667200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"415'13117","reported_seq":13330,"reported_epoch":415,"state":"active+clean","last_fresh":"2024-04-01T19:41:43.333002+0000","last_change":"2024-04-01T19:41:17.930217+0000","last_active":"2024-04-01T19:41:43.333002+0000","last_peered":"2024-04-01T19:41:43.333002+0000","last_clean":"2024-04-01T19:41:43.333002+0000","last_became_active":"2024-04-01T19:39:25.119264+0000","last_became_peered":"2024-04-01T19:39:25.119264+0000","last_unstale":"2024-04-01T19:41:43.333002+0000","last_undegraded":"2024-04-01T19:41:43.333002+0000","last_fullsized":"2024-04-01T19:41:43.333002+0000","mapping_epoch":364,"log_start":"377'3100","ondisk_log_start":"377'3100","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"407'11265","last_scrub_stamp":"2024-04-01T19:41:17.929723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:17.929723+0000","objects_scrubbed":9466,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:42:19.889972+0000","scrub_duration":1416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":496041984,"num_objects":7569,"num_object_clones":0,"num_object_copies":15138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7569,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13117,"num_write_kb":661952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"413'13170","reported_seq":13369,"reported_epoch":413,"state":"active+clean","last_fresh":"2024-04-01T19:41:41.081776+0000","last_change":"2024-04-01T19:40:34.998827+0000","last_active":"2024-04-01T19:41:41.081776+0000","last_peered":"2024-04-01T19:41:41.081776+0000","last_clean":"2024-04-01T19:41:41.081776+0000","last_became_active":"2024-04-01T19:39:25.125727+0000","last_became_peered":"2024-04-01T19:39:25.125727+0000","last_unstale":"2024-04-01T19:41:41.081776+0000","last_undegraded":"2024-04-01T19:41:41.081776+0000","last_fullsized":"2024-04-01T19:41:41.081776+0000","mapping_epoch":364,"log_start":"377'3100","ondisk_log_start":"377'3100","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"394'8334","last_scrub_stamp":"2024-04-01T19:40:34.998701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:40:34.998701+0000","objects_scrubbed":8283,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1539,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":507379712,"num_objects":7742,"num_object_clones":0,"num_object_copies":15484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7742,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13170,"num_write_kb":669184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.7","version":"413'12846","reported_seq":13055,"reported_epoch":413,"state":"active+clean","last_fresh":"2024-04-01T19:41:40.531956+0000","last_change":"2024-04-01T19:41:15.363567+0000","last_active":"2024-04-01T19:41:40.531956+0000","last_peered":"2024-04-01T19:41:40.531956+0000","last_clean":"2024-04-01T19:41:40.531956+0000","last_became_active":"2024-04-01T19:39:25.119054+0000","last_became_peered":"2024-04-01T19:39:25.119054+0000","last_unstale":"2024-04-01T19:41:40.531956+0000","last_undegraded":"2024-04-01T19:41:40.531956+0000","last_fullsized":"2024-04-01T19:41:40.531956+0000","mapping_epoch":364,"log_start":"377'2800","ondisk_log_start":"377'2800","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"406'10961","last_scrub_stamp":"2024-04-01T19:41:15.363320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:15.363320+0000","objects_scrubbed":9538,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:42:36.011024+0000","scrub_duration":2196,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":497549312,"num_objects":7592,"num_object_clones":0,"num_object_copies":15184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7592,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12846,"num_write_kb":654016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"414'13093","reported_seq":13305,"reported_epoch":414,"state":"active+clean","last_fresh":"2024-04-01T19:41:41.558532+0000","last_change":"2024-04-01T19:41:15.875163+0000","last_active":"2024-04-01T19:41:41.558532+0000","last_peered":"2024-04-01T19:41:41.558532+0000","last_clean":"2024-04-01T19:41:41.558532+0000","last_became_active":"2024-04-01T19:39:25.119237+0000","last_became_peered":"2024-04-01T19:39:25.119237+0000","last_unstale":"2024-04-01T19:41:41.558532+0000","last_undegraded":"2024-04-01T19:41:41.558532+0000","last_fullsized":"2024-04-01T19:41:41.558532+0000","mapping_epoch":364,"log_start":"377'3000","ondisk_log_start":"377'3000","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"406'11206","last_scrub_stamp":"2024-04-01T19:41:15.875080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:15.875080+0000","objects_scrubbed":9651,"log_size":10093,"log_dups_size":0,"ondisk_log_size":10093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:42:40.574493+0000","scrub_duration":2214,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":504430592,"num_objects":7697,"num_object_clones":0,"num_object_copies":15394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7697,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13093,"num_write_kb":665280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"413'12719","reported_seq":12907,"reported_epoch":413,"state":"active+clean","last_fresh":"2024-04-01T19:41:40.587288+0000","last_change":"2024-04-01T19:40:28.058038+0000","last_active":"2024-04-01T19:41:40.587288+0000","last_peered":"2024-04-01T19:41:40.587288+0000","last_clean":"2024-04-01T19:41:40.587288+0000","last_became_active":"2024-04-01T19:39:25.126777+0000","last_became_peered":"2024-04-01T19:39:25.126777+0000","last_unstale":"2024-04-01T19:41:40.587288+0000","last_undegraded":"2024-04-01T19:41:40.587288+0000","last_fullsized":"2024-04-01T19:41:40.587288+0000","mapping_epoch":364,"log_start":"377'2700","ondisk_log_start":"377'2700","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"390'7579","last_scrub_stamp":"2024-04-01T19:40:28.057807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:40:28.057807+0000","objects_scrubbed":7499,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"queued for scrub","scrub_duration":2108,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":500105216,"num_objects":7631,"num_object_clones":0,"num_object_copies":15262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7631,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12719,"num_write_kb":651200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"413'12969","reported_seq":13177,"reported_epoch":413,"state":"active+clean","last_fresh":"2024-04-01T19:41:40.539961+0000","last_change":"2024-04-01T19:41:18.561092+0000","last_active":"2024-04-01T19:41:40.539961+0000","last_peered":"2024-04-01T19:41:40.539961+0000","last_clean":"2024-04-01T19:41:40.539961+0000","last_became_active":"2024-04-01T19:39:25.125241+0000","last_became_peered":"2024-04-01T19:39:25.125241+0000","last_unstale":"2024-04-01T19:41:40.539961+0000","last_undegraded":"2024-04-01T19:41:40.539961+0000","last_fullsized":"2024-04-01T19:41:40.539961+0000","mapping_epoch":364,"log_start":"377'2900","ondisk_log_start":"377'2900","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"408'11305","last_scrub_stamp":"2024-04-01T19:41:18.560910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:18.560910+0000","objects_scrubbed":9378,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:42:46.096056+0000","scrub_duration":2692,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":499056640,"num_objects":7615,"num_object_clones":0,"num_object_copies":15230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7615,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12969,"num_write_kb":658688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"413'12950","reported_seq":13141,"reported_epoch":413,"state":"active+clean","last_fresh":"2024-04-01T19:41:40.905962+0000","last_change":"2024-04-01T19:40:29.057223+0000","last_active":"2024-04-01T19:41:40.905962+0000","last_peered":"2024-04-01T19:41:40.905962+0000","last_clean":"2024-04-01T19:41:40.905962+0000","last_became_active":"2024-04-01T19:39:25.125236+0000","last_became_peered":"2024-04-01T19:39:25.125236+0000","last_unstale":"2024-04-01T19:41:40.905962+0000","last_undegraded":"2024-04-01T19:41:40.905962+0000","last_fullsized":"2024-04-01T19:41:40.905962+0000","mapping_epoch":364,"log_start":"377'2900","ondisk_log_start":"377'2900","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"391'7791","last_scrub_stamp":"2024-04-01T19:40:29.057044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:40:29.057044+0000","objects_scrubbed":7716,"log_size":10050,"log_dups_size":0,"ondisk_log_size":10050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:41:54.386310+0000","scrub_duration":1585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":504365056,"num_objects":7696,"num_object_clones":0,"num_object_copies":15392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7696,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12950,"num_write_kb":660672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1","version":"414'13130","reported_seq":13338,"reported_epoch":414,"state":"active+clean","last_fresh":"2024-04-01T19:41:41.567788+0000","last_change":"2024-04-01T19:41:23.372406+0000","last_active":"2024-04-01T19:41:41.567788+0000","last_peered":"2024-04-01T19:41:41.567788+0000","last_clean":"2024-04-01T19:41:41.567788+0000","last_became_active":"2024-04-01T19:39:25.185686+0000","last_became_peered":"2024-04-01T19:39:25.185686+0000","last_unstale":"2024-04-01T19:41:41.567788+0000","last_undegraded":"2024-04-01T19:41:41.567788+0000","last_fullsized":"2024-04-01T19:41:41.567788+0000","mapping_epoch":364,"log_start":"377'3100","ondisk_log_start":"377'3100","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"408'11736","last_scrub_stamp":"2024-04-01T19:41:23.372284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:23.372284+0000","objects_scrubbed":9013,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:42:43.104028+0000","scrub_duration":1760,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":495058944,"num_objects":7554,"num_object_clones":0,"num_object_copies":15108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7554,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13130,"num_write_kb":661888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"414'12955","reported_seq":13168,"reported_epoch":414,"state":"active+clean","last_fresh":"2024-04-01T19:41:42.238682+0000","last_change":"2024-04-01T19:41:13.951860+0000","last_active":"2024-04-01T19:41:42.238682+0000","last_peered":"2024-04-01T19:41:42.238682+0000","last_clean":"2024-04-01T19:41:42.238682+0000","last_became_active":"2024-04-01T19:39:25.124672+0000","last_became_peered":"2024-04-01T19:39:25.124672+0000","last_unstale":"2024-04-01T19:41:42.238682+0000","last_undegraded":"2024-04-01T19:41:42.238682+0000","last_fullsized":"2024-04-01T19:41:42.238682+0000","mapping_epoch":364,"log_start":"377'2900","ondisk_log_start":"377'2900","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"406'10897","last_scrub_stamp":"2024-04-01T19:41:13.951627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:13.951627+0000","objects_scrubbed":9554,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:42:16.154341+0000","scrub_duration":1748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":487260160,"num_objects":7435,"num_object_clones":0,"num_object_copies":14870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7435,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12955,"num_write_kb":652480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"5.4","version":"414'15502","reported_seq":15858,"reported_epoch":414,"state":"active+clean","last_fresh":"2024-04-01T19:41:42.263870+0000","last_change":"2024-04-01T19:41:12.999560+0000","last_active":"2024-04-01T19:41:42.263870+0000","last_peered":"2024-04-01T19:41:42.263870+0000","last_clean":"2024-04-01T19:41:42.263870+0000","last_became_active":"2024-04-01T19:39:25.125519+0000","last_became_peered":"2024-04-01T19:39:25.125519+0000","last_unstale":"2024-04-01T19:41:42.263870+0000","last_undegraded":"2024-04-01T19:41:42.263870+0000","last_fullsized":"2024-04-01T19:41:42.263870+0000","mapping_epoch":364,"log_start":"384'5500","ondisk_log_start":"384'5500","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"406'13387","last_scrub_stamp":"2024-04-01T19:41:12.999424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:12.999424+0000","objects_scrubbed":9659,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:42:22.772691+0000","scrub_duration":1797,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":488374272,"num_objects":7452,"num_object_clones":0,"num_object_copies":14904,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7452,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13022,"num_write_kb":655168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":1069,"reported_epoch":415,"state":"active+clean","last_fresh":"2024-04-01T19:41:43.223703+0000","last_change":"2024-04-01T19:41:14.658361+0000","last_active":"2024-04-01T19:41:43.223703+0000","last_peered":"2024-04-01T19:41:43.223703+0000","last_clean":"2024-04-01T19:41:43.223703+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:41:43.223703+0000","last_undegraded":"2024-04-01T19:41:43.223703+0000","last_fullsized":"2024-04-01T19:41:43.223703+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:41:14.658204+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:41:14.658204+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:42:31.774806+0000","scrub_duration":121,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":7993294872,"num_objects":121969,"num_object_clones":0,"num_object_copies":243938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121969,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":207425,"num_write_kb":10540545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15999574016,"data_stored":15999565872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160805,"ondisk_log_size":160805,"up":32,"acting":32,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220389,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1537700,"kb_used_data":992860,"kb_used_omap":1,"kb_used_meta":544830,"kb_avail":92207452,"statfs":{"total":95995035648,"available":94420430848,"internally_reserved":0,"allocated":1016688640,"data_stored":1016342691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":557906372},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":77,"seq":330712482025,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1761960,"kb_used_data":1446172,"kb_used_omap":1,"kb_used_meta":315774,"kb_avail":91983192,"statfs":{"total":95995035648,"available":94190788608,"internally_reserved":0,"allocated":1480880128,"data_stored":1480535799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":323353024},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678256,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1322524,"kb_used_data":984528,"kb_used_omap":1,"kb_used_meta":337982,"kb_avail":92422628,"statfs":{"total":95995035648,"available":94640771072,"internally_reserved":0,"allocated":1008156672,"data_stored":1007818367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":346094016},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,0,1,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":0,"seq":846108557452,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234235,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":853484,"kb_used_data":489124,"kb_used_omap":1,"kb_used_meta":364350,"kb_avail":92891668,"statfs":{"total":95995035648,"available":95121068032,"internally_reserved":0,"allocated":500862976,"data_stored":500515115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":373094858},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":335,"seq":1438814044209,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1589852,"kb_used_data":1480656,"kb_used_omap":292,"kb_used_meta":108699,"kb_avail":92155300,"statfs":{"total":95995035648,"available":94367027200,"internally_reserved":0,"allocated":1516191744,"data_stored":1515853439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":299281,"internal_metadata":111308527},"hb_peers":[0,1,2,3,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575127,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2449564,"kb_used_data":1967184,"kb_used_omap":1,"kb_used_meta":482366,"kb_avail":91295588,"statfs":{"total":95995035648,"available":93486682112,"internally_reserved":0,"allocated":2014396416,"data_stored":2014058111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":493943237},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738655,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3307228,"kb_used_data":2960848,"kb_used_omap":1,"kb_used_meta":346302,"kb_avail":90437924,"statfs":{"total":95995035648,"available":92608434176,"internally_reserved":0,"allocated":3031908352,"data_stored":3031570047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":354613701},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,3,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346196,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1637340,"kb_used_data":1471440,"kb_used_omap":1,"kb_used_meta":165822,"kb_avail":92107812,"statfs":{"total":95995035648,"available":94318399488,"internally_reserved":0,"allocated":1506754560,"data_stored":1506416255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169802181},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149966,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":865384,"kb_used_data":482972,"kb_used_omap":1,"kb_used_meta":382398,"kb_avail":92879768,"statfs":{"total":95995035648,"available":95108882432,"internally_reserved":0,"allocated":494563328,"data_stored":494219019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":391576007},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953736,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1847272,"kb_used_data":1459292,"kb_used_omap":1,"kb_used_meta":387966,"kb_avail":91897880,"statfs":{"total":95995035648,"available":94103429120,"internally_reserved":0,"allocated":1494315008,"data_stored":1493970699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":397277637},"hb_peers":[0,1,2,3,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790212,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2298592,"kb_used_data":1974484,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":91446560,"statfs":{"total":95995035648,"available":93641277440,"internally_reserved":0,"allocated":2021871616,"data_stored":2021529239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":331872709},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3013607424,"data_stored":3013607424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2008481792,"data_stored":2008481792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1498480640,"data_stored":1498480640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":490340352,"data_stored":490340352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1491402752,"data_stored":1491402752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2008420352,"data_stored":2008416280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1509163008,"data_stored":1509163008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":496041984,"data_stored":496041984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":1004470272,"data_stored":1004470272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":1473642496,"data_stored":1473642496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":1005522944,"data_stored":1005518872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:41:46.287 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-01T19:41:46.378 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:41:46.434 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:46.518 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:41:46.525 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:46.525 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:41:46.626 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:41:46.674 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:46.760 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:41:46.763 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:46.766 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:41:46.866 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:41:46.903 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:46.936 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:41:46.939 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:46.940 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:41:47.041 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:41:47.091 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:47.121 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:41:47.124 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:47.125 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:41:47.226 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:41:47.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:47 smithi062 ceph-mon[44211]: pgmap v1164: 17 pgs: 17 active+clean; 7.2 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 1.30k op/s 2024-04-01T19:41:47.270 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:47.296 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:41:47.307 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:47.307 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:41:47.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:47 smithi022 ceph-mon[39439]: pgmap v1164: 17 pgs: 17 active+clean; 7.2 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 1.30k op/s 2024-04-01T19:41:47.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:47 smithi188 ceph-mon[43939]: pgmap v1164: 17 pgs: 17 active+clean; 7.2 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 1.30k op/s 2024-04-01T19:41:47.408 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:41:47.438 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:47.465 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:41:47.470 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:47.470 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:41:47.542 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:41:47.571 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:41:47.605 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:47.626 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:41:47.629 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:47.630 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:41:47.730 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:41:47.786 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:48.010 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:41:48.013 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:48.013 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:41:48.114 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:41:48.117 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:41:48.193 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:48.316 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:41:48.325 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:48.326 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:41:48.427 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:41:48.462 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:48.487 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:41:48.490 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:48.490 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:41:48.591 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:41:48.641 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:48.693 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:41:48.702 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:48.703 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:41:48.804 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:41:48.866 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:48.883 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:41:48.883 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:216506 5.6 5:6f6c0cd9:::benchmark_data_smithi188_119427_object51807:head [delete] snapc 0=[] ondisk+write+known_if_redirected e417)", 2024-04-01T19:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:41:48.880086+0000", 2024-04-01T19:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.005820202, 2024-04-01T19:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0058451570000000001, 2024-04-01T19:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 216506 2024-04-01T19:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:41:48.885 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:48.880086+0000", 2024-04-01T19:41:48.885 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:48.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:48.885 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:48.885 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:41:48.885 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:48.880086+0000", 2024-04-01T19:41:48.885 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:41:48.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:48.885 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:48.885 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:41:48.885 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:48.880088+0000", 2024-04-01T19:41:48.885 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.846e-06 2024-04-01T19:41:48.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:48.885 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:48.885 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:48.880093+0000", 2024-04-01T19:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0150000000000003e-06 2024-04-01T19:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:48.880104+0000", 2024-04-01T19:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1202e-05 2024-04-01T19:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:48.880112+0000", 2024-04-01T19:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6129999999999998e-06 2024-04-01T19:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:48.880166+0000", 2024-04-01T19:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4599999999999999e-05 2024-04-01T19:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:48.880285+0000", 2024-04-01T19:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000119152 2024-04-01T19:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:48.880396+0000", 2024-04-01T19:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000110411 2024-04-01T19:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T19:41:48.888 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 1 2024-04-01T19:41:48.888 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:41:49.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:49 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:41:49.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:49 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:41:49.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:49 smithi022 ceph-mon[39439]: osdmap e417: 12 total, 12 up, 11 in 2024-04-01T19:41:49.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:49 smithi022 ceph-mon[39439]: pgmap v1166: 17 pgs: 17 active+clean; 7.1 GiB data, 18 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T19:41:49.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:49 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:41:49.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:49 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:41:49.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:49 smithi188 ceph-mon[43939]: osdmap e417: 12 total, 12 up, 11 in 2024-04-01T19:41:49.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:49 smithi188 ceph-mon[43939]: pgmap v1166: 17 pgs: 17 active+clean; 7.1 GiB data, 18 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T19:41:50.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:49 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:41:50.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:49 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:41:50.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:49 smithi062 ceph-mon[44211]: osdmap e417: 12 total, 12 up, 11 in 2024-04-01T19:41:50.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:49 smithi062 ceph-mon[44211]: pgmap v1166: 17 pgs: 17 active+clean; 7.1 GiB data, 18 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T19:41:50.516 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_blocked_ops 2024-04-01T19:41:51.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:51 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:41:51.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:51 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:41:51.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:51 smithi022 ceph-mon[39439]: osdmap e418: 12 total, 12 up, 11 in 2024-04-01T19:41:51.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:51 smithi022 ceph-mon[39439]: pgmap v1168: 17 pgs: 17 active+clean; 6.9 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.30k op/s 2024-04-01T19:41:51.402 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:41:51.444 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:41:51.479 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:41:51.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:51 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:41:51.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:51 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:41:51.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:51 smithi062 ceph-mon[44211]: osdmap e418: 12 total, 12 up, 11 in 2024-04-01T19:41:51.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:51 smithi062 ceph-mon[44211]: pgmap v1168: 17 pgs: 17 active+clean; 6.9 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.30k op/s 2024-04-01T19:41:51.517 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:41:51.560 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:41:51.587 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:41:51.589 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:51.590 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:41:51.613 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:41:51.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:51 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:41:51.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:51 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:41:51.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:51 smithi188 ceph-mon[43939]: osdmap e418: 12 total, 12 up, 11 in 2024-04-01T19:41:51.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:51 smithi188 ceph-mon[43939]: pgmap v1168: 17 pgs: 17 active+clean; 6.9 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.30k op/s 2024-04-01T19:41:51.651 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:41:51.691 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:41:51.703 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:41:51.731 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:41:51.758 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:41:51.782 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:51.824 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:41:51.862 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:41:51.907 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:41:51.919 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:41:51.919 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:41:51.919 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:41:51.919 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:41:51.919 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:41:51.919 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:41:51.920 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:41:51.920 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:41:51.920 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:41:51.920 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:41:51.920 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:41:51.920 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:41:52.356 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:52 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/321036852' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:41:52.357 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:52.357 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:52 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/191140188' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:41:52.357 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:52 smithi022 ceph-mon[39439]: from='client.26041 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:41:52.367 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:41:52.373 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:52.374 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:41:52.474 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:41:52.503 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:52 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/321036852' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:41:52.503 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:52.503 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:52 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/191140188' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:41:52.503 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:52 smithi062 ceph-mon[44211]: from='client.26041 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:41:52.505 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:52.531 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:41:52.538 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:52.539 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:41:52.568 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:41:52.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:52 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/321036852' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:41:52.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:52.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:52 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/191140188' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:41:52.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:52 smithi188 ceph-mon[43939]: from='client.26041 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:41:52.639 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:41:52.710 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:52.925 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:41:52.946 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:52.946 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:41:53.047 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:41:53.103 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:53.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:53 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:41:53.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:53 smithi022 ceph-mon[39439]: from='client.26041 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:41:53.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:53 smithi022 ceph-mon[39439]: osdmap e419: 12 total, 12 up, 11 in 2024-04-01T19:41:53.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:53 smithi022 ceph-mon[39439]: pgmap v1170: 17 pgs: 17 active+clean; 6.7 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:41:53.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:53 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:41:53.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:53 smithi062 ceph-mon[44211]: from='client.26041 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:41:53.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:53 smithi062 ceph-mon[44211]: osdmap e419: 12 total, 12 up, 11 in 2024-04-01T19:41:53.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:53 smithi062 ceph-mon[44211]: pgmap v1170: 17 pgs: 17 active+clean; 6.7 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:41:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:53 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:41:53.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:53 smithi188 ceph-mon[43939]: from='client.26041 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:41:53.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:53 smithi188 ceph-mon[43939]: osdmap e419: 12 total, 12 up, 11 in 2024-04-01T19:41:53.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:53 smithi188 ceph-mon[43939]: pgmap v1170: 17 pgs: 17 active+clean; 6.7 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:41:53.783 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:41:53.787 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:53.787 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:41:53.888 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:41:53.939 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:53.983 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:41:53.987 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:53.987 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:41:54.088 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:41:54.146 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:54.516 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:41:54.519 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:54.519 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:41:54.620 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:41:54.666 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:54.689 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:41:54.692 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:54.692 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:41:54.771 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:54 smithi022 ceph-mon[39439]: 5.f scrub starts 2024-04-01T19:41:54.793 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:41:54.844 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:54 smithi062 ceph-mon[44211]: 5.f scrub starts 2024-04-01T19:41:54.844 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:54.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:54 smithi188 ceph-mon[43939]: 5.f scrub starts 2024-04-01T19:41:54.882 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:41:54.894 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:54.894 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:41:54.971 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:41:54.995 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:41:55.034 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:55.062 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:41:55.066 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:55.067 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:41:55.168 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:41:55.210 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:55.248 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:41:55.253 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:55.254 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:41:55.256 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:41:55.256 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:41:55.355 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:41:55.397 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:55.531 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:55.532 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:41:55.532 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:41:55.633 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:41:55.663 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:55.686 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:41:55.688 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:55.689 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:41:55.790 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:41:55.816 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:55 smithi188 ceph-mon[43939]: pgmap v1171: 17 pgs: 17 active+clean; 6.7 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 977 op/s 2024-04-01T19:41:55.819 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:55.841 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:41:55.845 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:55.845 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:41:55.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:55 smithi022 ceph-mon[39439]: pgmap v1171: 17 pgs: 17 active+clean; 6.7 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 977 op/s 2024-04-01T19:41:55.945 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:41:55.973 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:55.994 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:41:55.997 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:55.998 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:41:56.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:55 smithi062 ceph-mon[44211]: pgmap v1171: 17 pgs: 17 active+clean; 6.7 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 977 op/s 2024-04-01T19:41:56.099 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:41:56.125 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:56.146 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:41:56.148 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_historic_ops 2024-04-01T19:41:56.149 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:56.149 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:41:56.170 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:41:56.250 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:41:56.340 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:56.508 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:41:56.518 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:41:56.520 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:56.521 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:41:56.622 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:41:56.652 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:56.674 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:41:56.677 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:56.677 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:41:56.778 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:41:56.811 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:56.836 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:41:56.842 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:56 smithi062 ceph-mon[44211]: 5.2 scrub starts 2024-04-01T19:41:56.842 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:56 smithi062 ceph-mon[44211]: 5.f scrub ok 2024-04-01T19:41:56.842 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:56 smithi062 ceph-mon[44211]: 5.2 scrub ok 2024-04-01T19:41:56.842 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:56 smithi062 ceph-mon[44211]: 5.5 scrub starts 2024-04-01T19:41:56.843 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:56.843 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:41:56.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:56 smithi022 ceph-mon[39439]: 5.2 scrub starts 2024-04-01T19:41:56.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:56 smithi022 ceph-mon[39439]: 5.f scrub ok 2024-04-01T19:41:56.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:56 smithi022 ceph-mon[39439]: 5.2 scrub ok 2024-04-01T19:41:56.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:56 smithi022 ceph-mon[39439]: 5.5 scrub starts 2024-04-01T19:41:56.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:56 smithi188 ceph-mon[43939]: 5.2 scrub starts 2024-04-01T19:41:56.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:56 smithi188 ceph-mon[43939]: 5.f scrub ok 2024-04-01T19:41:56.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:56 smithi188 ceph-mon[43939]: 5.2 scrub ok 2024-04-01T19:41:56.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:56 smithi188 ceph-mon[43939]: 5.5 scrub starts 2024-04-01T19:41:56.944 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:41:57.011 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:57.788 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:41:57.798 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:57.799 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:41:57.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:57 smithi022 ceph-mon[39439]: 5.8 scrub starts 2024-04-01T19:41:57.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:57 smithi022 ceph-mon[39439]: pgmap v1172: 17 pgs: 17 active+clean; 6.4 GiB data, 17 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 1.35k op/s 2024-04-01T19:41:57.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:57 smithi188 ceph-mon[43939]: 5.8 scrub starts 2024-04-01T19:41:57.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:57 smithi188 ceph-mon[43939]: pgmap v1172: 17 pgs: 17 active+clean; 6.4 GiB data, 17 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 1.35k op/s 2024-04-01T19:41:57.899 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:41:57.900 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:41:57.921 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:41:57.935 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:57.954 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:41:57.957 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:57.957 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:41:58.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:57 smithi062 ceph-mon[44211]: 5.8 scrub starts 2024-04-01T19:41:58.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:57 smithi062 ceph-mon[44211]: pgmap v1172: 17 pgs: 17 active+clean; 6.4 GiB data, 17 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 1.35k op/s 2024-04-01T19:41:58.058 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:41:58.090 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:58.119 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:41:58.122 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:58.123 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:41:58.224 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:41:58.252 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:58.279 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:41:58.283 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:58.283 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:41:58.384 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:41:58.421 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:58.443 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:41:58.447 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:58.447 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:41:58.548 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:41:58.624 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:58.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:58 smithi022 ceph-mon[39439]: 5.5 scrub ok 2024-04-01T19:41:58.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:58 smithi022 ceph-mon[39439]: 5.b scrub starts 2024-04-01T19:41:58.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:58 smithi022 ceph-mon[39439]: 5.8 scrub ok 2024-04-01T19:41:58.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:58 smithi022 ceph-mon[39439]: 5.c scrub starts 2024-04-01T19:41:58.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:58 smithi188 ceph-mon[43939]: 5.5 scrub ok 2024-04-01T19:41:58.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:58 smithi188 ceph-mon[43939]: 5.b scrub starts 2024-04-01T19:41:58.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:58 smithi188 ceph-mon[43939]: 5.8 scrub ok 2024-04-01T19:41:58.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:58 smithi188 ceph-mon[43939]: 5.c scrub starts 2024-04-01T19:41:59.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:58 smithi062 ceph-mon[44211]: 5.5 scrub ok 2024-04-01T19:41:59.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:58 smithi062 ceph-mon[44211]: 5.b scrub starts 2024-04-01T19:41:59.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:58 smithi062 ceph-mon[44211]: 5.8 scrub ok 2024-04-01T19:41:59.015 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:58 smithi062 ceph-mon[44211]: 5.c scrub starts 2024-04-01T19:41:59.033 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:41:59.033 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:41:59.033 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:41:59.033 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:41:59.033 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:41:59.033 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:41:59.033 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:41:59.034 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:41:59.061 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:41:59.095 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:41:59.098 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:59.099 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:41:59.099 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:41:59.157 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:41:59.196 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:41:59.200 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:41:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:41:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:41:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:41:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:41:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:41:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:41:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:41:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:41:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:41:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:41:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:41:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:41:59.230 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:59.259 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:41:59.265 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:59.265 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:41:59.366 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:41:59.400 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:59.421 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:41:59.429 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:59.429 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:41:59.530 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:41:59.588 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:59.626 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:41:59.635 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:59.635 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:41:59.736 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:41:59.766 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:59.786 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:41:59.789 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:59.789 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:41:59.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:59 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:41:59.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:59 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:41:59.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:59 smithi022 ceph-mon[39439]: osdmap e420: 12 total, 12 up, 11 in 2024-04-01T19:41:59.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:59 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1605954210' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:41:59.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:59.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:59.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:59.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:59.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:59.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:59 smithi022 ceph-mon[39439]: pgmap v1174: 17 pgs: 17 active+clean; 6.4 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:41:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:41:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:59.890 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:41:59.920 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:59 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:41:59.920 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:59 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:41:59.920 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:59 smithi188 ceph-mon[43939]: osdmap e420: 12 total, 12 up, 11 in 2024-04-01T19:41:59.920 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:59 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1605954210' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:41:59.921 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:59.921 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:59.921 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:59.921 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:59.921 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:59.921 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:59.921 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:59.921 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:59.921 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:59 smithi188 ceph-mon[43939]: pgmap v1174: 17 pgs: 17 active+clean; 6.4 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:41:59.921 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:41:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:41:59.923 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:41:59.949 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:41:59.954 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:41:59.954 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:42:00.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:59 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:42:00.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:59 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:42:00.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:59 smithi062 ceph-mon[44211]: osdmap e420: 12 total, 12 up, 11 in 2024-04-01T19:42:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:59 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1605954210' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:42:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:59 smithi062 ceph-mon[44211]: pgmap v1174: 17 pgs: 17 active+clean; 6.4 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:42:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:41:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:00.055 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:42:00.103 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:00.136 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:42:00.140 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:00.140 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:42:00.241 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:42:00.298 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:00.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:00.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:00.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:00 smithi022 ceph-mon[39439]: 5.b scrub ok 2024-04-01T19:42:00.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:00.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:00 smithi022 ceph-mon[39439]: 5.c scrub ok 2024-04-01T19:42:01.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:01.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:01.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:00 smithi062 ceph-mon[44211]: 5.b scrub ok 2024-04-01T19:42:01.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:01.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:00 smithi062 ceph-mon[44211]: 5.c scrub ok 2024-04-01T19:42:01.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:01.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:01.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:00 smithi188 ceph-mon[43939]: 5.b scrub ok 2024-04-01T19:42:01.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:01.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:00 smithi188 ceph-mon[43939]: 5.c scrub ok 2024-04-01T19:42:01.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:01 smithi022 ceph-mon[39439]: pgmap v1175: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.2 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:42:01.690 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:42:01.694 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:01.695 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:42:01.796 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:42:01.824 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:01.850 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:42:01.853 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:01.853 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:42:01.954 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:42:01.982 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:01 smithi062 ceph-mon[44211]: pgmap v1175: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.2 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:42:01.984 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:02.010 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:42:02.014 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:02.015 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:42:02.116 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:42:02.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:01 smithi188 ceph-mon[43939]: pgmap v1175: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.2 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:42:02.161 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:02.185 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:42:02.191 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:02.191 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:42:02.292 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:42:02.321 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:02.345 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:42:02.347 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:02.347 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:42:02.448 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:42:02.479 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:02.501 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:42:02.503 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:02.503 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:42:02.604 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:42:02.638 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:02.663 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:42:02.667 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:02.667 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:42:02.768 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:42:02.813 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:02.826 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:42:02.826 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 20, 2024-04-01T19:42:02.826 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 600, 2024-04-01T19:42:02.826 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:42:02.826 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.826 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.10.0:28480 5.4 e399/364 5:242b9fb2:::benchmark_data_smithi188_119427_object65469:head v 399'10448, mlcod=399'10434)", 2024-04-01T19:42:02.826 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:45.600870+0000", 2024-04-01T19:42:02.826 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 77.218739819999996, 2024-04-01T19:42:02.826 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.076337125000000006, 2024-04-01T19:42:02.826 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:02.827 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:02.827 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:02.827 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:02.827 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.827 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:02.827 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:45.600870+0000", 2024-04-01T19:42:02.827 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.827 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.827 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.827 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:02.827 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:45.600870+0000", 2024-04-01T19:42:02.827 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.827 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.828 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.828 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:02.828 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:45.600871+0000", 2024-04-01T19:42:02.828 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0419999999999999e-06 2024-04-01T19:42:02.828 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.828 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.828 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:02.828 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:45.600878+0000", 2024-04-01T19:42:02.828 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0589999999999997e-06 2024-04-01T19:42:02.828 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.828 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.828 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:02.828 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:45.600889+0000", 2024-04-01T19:42:02.828 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1358999999999999e-05 2024-04-01T19:42:02.829 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.829 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.829 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:02.829 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:45.600895+0000", 2024-04-01T19:42:02.829 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3779999999999998e-06 2024-04-01T19:42:02.829 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.829 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.829 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:02.829 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:45.614353+0000", 2024-04-01T19:42:02.829 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.01345794 2024-04-01T19:42:02.829 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.829 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.829 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:02.829 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:45.614374+0000", 2024-04-01T19:42:02.830 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0930000000000001e-05 2024-04-01T19:42:02.830 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.830 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.830 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:02.830 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:45.677187+0000", 2024-04-01T19:42:02.830 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.062812552999999993 2024-04-01T19:42:02.830 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.830 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.830 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:02.830 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:45.677207+0000", 2024-04-01T19:42:02.830 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9864000000000002e-05 2024-04-01T19:42:02.830 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.830 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:02.831 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.831 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.831 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.831 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.10.0:28481 5.4 e399/364 5:242c3671:::benchmark_data_smithi188_119427_object84877:head v 399'10449, mlcod=399'10434)", 2024-04-01T19:42:02.831 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:45.601095+0000", 2024-04-01T19:42:02.831 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 77.218513917999999, 2024-04-01T19:42:02.831 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.076132632000000006, 2024-04-01T19:42:02.831 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:02.831 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:02.831 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:02.831 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:02.831 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.831 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:02.831 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:45.601095+0000", 2024-04-01T19:42:02.831 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:45.601095+0000", 2024-04-01T19:42:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:45.601096+0000", 2024-04-01T19:42:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.2399999999999996e-07 2024-04-01T19:42:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:45.601102+0000", 2024-04-01T19:42:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3199999999999999e-06 2024-04-01T19:42:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.833 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.833 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:02.833 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:45.601111+0000", 2024-04-01T19:42:02.833 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.0059999999999998e-06 2024-04-01T19:42:02.833 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.833 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.833 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:02.833 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:45.601116+0000", 2024-04-01T19:42:02.833 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9790000000000001e-06 2024-04-01T19:42:02.833 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.833 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.833 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:02.833 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:45.618883+0000", 2024-04-01T19:42:02.833 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.017767762999999999 2024-04-01T19:42:02.834 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.834 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.834 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:02.834 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:45.618901+0000", 2024-04-01T19:42:02.834 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7414e-05 2024-04-01T19:42:02.834 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.834 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.834 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:02.834 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:45.677209+0000", 2024-04-01T19:42:02.834 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.058307927000000002 2024-04-01T19:42:02.834 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.834 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.834 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:02.834 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:45.677228+0000", 2024-04-01T19:42:02.835 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9298999999999999e-05 2024-04-01T19:42:02.835 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.835 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:02.835 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.835 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.835 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.835 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:146994 5.4 e401/364 5:2159b12a:::benchmark_data_smithi188_119427_object146993:head v 401'11281, mlcod=401'11278)", 2024-04-01T19:42:02.835 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:49.581923+0000", 2024-04-01T19:42:02.835 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 73.237686045000004, 2024-04-01T19:42:02.835 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.069992279000000004, 2024-04-01T19:42:02.835 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:02.835 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:02.835 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:02.836 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:02.836 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.836 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:02.836 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:49.581923+0000", 2024-04-01T19:42:02.836 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.836 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.836 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.836 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:02.836 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:49.581923+0000", 2024-04-01T19:42:02.836 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.836 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.836 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.836 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:02.836 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:49.581926+0000", 2024-04-01T19:42:02.836 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6419999999999999e-06 2024-04-01T19:42:02.837 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.837 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.837 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:02.837 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:49.581977+0000", 2024-04-01T19:42:02.837 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.1180000000000001e-05 2024-04-01T19:42:02.837 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.837 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.837 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:02.837 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:49.581992+0000", 2024-04-01T19:42:02.837 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4893e-05 2024-04-01T19:42:02.837 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.837 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.837 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:02.837 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:49.582001+0000", 2024-04-01T19:42:02.837 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5029999999999997e-06 2024-04-01T19:42:02.838 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.838 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.838 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:02.838 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:49.582060+0000", 2024-04-01T19:42:02.838 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9126999999999998e-05 2024-04-01T19:42:02.838 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.838 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.838 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:02.838 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:49.582082+0000", 2024-04-01T19:42:02.838 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1942000000000001e-05 2024-04-01T19:42:02.838 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.838 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.838 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:02.838 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:49.651863+0000", 2024-04-01T19:42:02.838 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.069781550999999997 2024-04-01T19:42:02.839 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.839 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.839 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:02.839 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:49.651916+0000", 2024-04-01T19:42:02.839 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2441000000000002e-05 2024-04-01T19:42:02.839 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.839 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:02.839 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.839 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.839 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.839 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:146998 5.4 e401/364 5:290f67df:::benchmark_data_smithi188_119427_object146997:head v 401'11282, mlcod=401'11279)", 2024-04-01T19:42:02.839 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:49.586108+0000", 2024-04-01T19:42:02.839 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 73.233501649999994, 2024-04-01T19:42:02.839 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.070323460000000004, 2024-04-01T19:42:02.839 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:02.840 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:02.840 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:02.840 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:02.840 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.840 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:02.840 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:49.586108+0000", 2024-04-01T19:42:02.840 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.840 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.840 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.840 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:02.840 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:49.586108+0000", 2024-04-01T19:42:02.840 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.840 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.840 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.840 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:02.841 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:49.586110+0000", 2024-04-01T19:42:02.841 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4660000000000002e-06 2024-04-01T19:42:02.841 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.841 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.841 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:02.841 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:49.586154+0000", 2024-04-01T19:42:02.841 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4218000000000003e-05 2024-04-01T19:42:02.841 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.841 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.841 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:02.841 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:49.586174+0000", 2024-04-01T19:42:02.841 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9232000000000002e-05 2024-04-01T19:42:02.841 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.842 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.842 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:02.842 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:49.586184+0000", 2024-04-01T19:42:02.842 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.9990000000000003e-06 2024-04-01T19:42:02.842 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.842 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.842 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:02.842 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:49.586772+0000", 2024-04-01T19:42:02.842 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00058860900000000003 2024-04-01T19:42:02.842 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.842 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.842 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:02.842 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:49.586794+0000", 2024-04-01T19:42:02.842 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2007000000000001e-05 2024-04-01T19:42:02.843 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.843 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.843 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:02.843 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:49.656385+0000", 2024-04-01T19:42:02.843 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.069590672000000006 2024-04-01T19:42:02.843 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.843 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.843 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:02.843 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:49.656431+0000", 2024-04-01T19:42:02.843 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6257000000000001e-05 2024-04-01T19:42:02.843 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.843 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:02.843 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.843 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.843 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.843 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.10.0:29718 5.4 e401/364 5:25a83f71:::benchmark_data_smithi188_119427_object63740:head v 401'11385, mlcod=401'11374)", 2024-04-01T19:42:02.844 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:50.060623+0000", 2024-04-01T19:42:02.844 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 72.758986500999995, 2024-04-01T19:42:02.844 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.080985217999999998, 2024-04-01T19:42:02.844 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:02.844 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:02.844 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:02.844 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:02.844 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.844 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:02.844 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.060623+0000", 2024-04-01T19:42:02.844 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.844 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.844 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.844 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:02.845 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.060623+0000", 2024-04-01T19:42:02.845 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.845 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.845 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.845 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:02.845 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.060624+0000", 2024-04-01T19:42:02.845 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6160000000000001e-06 2024-04-01T19:42:02.845 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.845 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.845 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:02.845 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.060633+0000", 2024-04-01T19:42:02.845 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.9719999999999998e-06 2024-04-01T19:42:02.845 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.845 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.846 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:02.846 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.060650+0000", 2024-04-01T19:42:02.846 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6659000000000001e-05 2024-04-01T19:42:02.846 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.846 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.846 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:02.846 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.060658+0000", 2024-04-01T19:42:02.846 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0930000000000003e-06 2024-04-01T19:42:02.846 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.846 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.846 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:02.846 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.075188+0000", 2024-04-01T19:42:02.846 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014529716999999999 2024-04-01T19:42:02.846 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.846 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.847 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:02.847 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.075209+0000", 2024-04-01T19:42:02.847 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1033e-05 2024-04-01T19:42:02.847 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.847 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.847 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:02.847 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.141562+0000", 2024-04-01T19:42:02.847 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.066352624999999998 2024-04-01T19:42:02.847 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.847 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.847 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:02.847 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.141608+0000", 2024-04-01T19:42:02.847 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6502999999999998e-05 2024-04-01T19:42:02.847 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.847 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:02.848 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.848 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.848 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.848 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.10.0:29719 5.4 e401/364 5:25a98f0c:::benchmark_data_smithi188_119427_object56063:head v 401'11386, mlcod=401'11374)", 2024-04-01T19:42:02.848 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:50.065062+0000", 2024-04-01T19:42:02.848 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 72.754547079000005, 2024-04-01T19:42:02.848 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.076563617, 2024-04-01T19:42:02.848 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:02.848 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:02.848 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:02.848 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:02.848 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.848 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:02.848 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.065062+0000", 2024-04-01T19:42:02.848 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.848 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.849 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.849 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:02.849 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.065062+0000", 2024-04-01T19:42:02.849 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.849 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.849 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.849 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:02.849 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.065064+0000", 2024-04-01T19:42:02.849 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4440000000000001e-06 2024-04-01T19:42:02.849 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.849 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.849 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:02.849 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.065072+0000", 2024-04-01T19:42:02.849 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3100000000000001e-06 2024-04-01T19:42:02.849 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.849 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.850 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:02.850 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.065084+0000", 2024-04-01T19:42:02.850 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2313999999999999e-05 2024-04-01T19:42:02.850 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.850 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.850 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:02.850 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.065091+0000", 2024-04-01T19:42:02.850 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4189999999999999e-06 2024-04-01T19:42:02.850 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.850 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.850 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:02.850 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.079597+0000", 2024-04-01T19:42:02.850 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014506661000000001 2024-04-01T19:42:02.850 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.850 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.850 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:02.851 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.079622+0000", 2024-04-01T19:42:02.851 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4357000000000001e-05 2024-04-01T19:42:02.851 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.851 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.851 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:02.851 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.141611+0000", 2024-04-01T19:42:02.851 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.061989061999999998 2024-04-01T19:42:02.851 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.851 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.851 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:02.851 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.141626+0000", 2024-04-01T19:42:02.851 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.505e-05 2024-04-01T19:42:02.851 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.851 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:02.851 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.852 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.852 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.852 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.10.0:29720 5.4 e401/364 5:25a9d65a:::benchmark_data_smithi188_119427_object35341:head v 401'11387, mlcod=401'11374)", 2024-04-01T19:42:02.852 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:50.070569+0000", 2024-04-01T19:42:02.852 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 72.749040539000006, 2024-04-01T19:42:02.852 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.071071310999999998, 2024-04-01T19:42:02.852 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:02.852 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:02.852 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:02.852 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:02.852 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.852 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:02.852 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.070569+0000", 2024-04-01T19:42:02.852 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.853 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.853 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.853 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:02.853 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.070569+0000", 2024-04-01T19:42:02.853 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.853 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.853 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.853 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:02.853 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.070571+0000", 2024-04-01T19:42:02.853 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.835e-06 2024-04-01T19:42:02.853 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.853 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.853 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:02.853 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.070583+0000", 2024-04-01T19:42:02.853 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2329e-05 2024-04-01T19:42:02.853 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.854 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.854 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:02.854 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.070601+0000", 2024-04-01T19:42:02.854 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7652e-05 2024-04-01T19:42:02.854 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.854 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.854 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:02.854 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.070611+0000", 2024-04-01T19:42:02.854 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0543000000000001e-05 2024-04-01T19:42:02.854 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.854 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.854 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:02.854 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.083324+0000", 2024-04-01T19:42:02.854 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.012713204000000001 2024-04-01T19:42:02.855 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.855 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.855 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:02.855 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.083341+0000", 2024-04-01T19:42:02.855 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6569999999999999e-05 2024-04-01T19:42:02.855 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.855 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.855 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:02.855 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.141627+0000", 2024-04-01T19:42:02.855 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.058286330999999997 2024-04-01T19:42:02.855 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.855 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.855 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:02.855 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:50.141640+0000", 2024-04-01T19:42:02.855 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2847000000000001e-05 2024-04-01T19:42:02.856 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.856 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:02.856 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.856 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.856 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.856 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.10.0:30059 5.4 e402/364 5:260e0116:::benchmark_data_smithi188_119427_object99726:head v 402'11642, mlcod=402'11630)", 2024-04-01T19:42:02.856 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:51.313142+0000", 2024-04-01T19:42:02.856 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 71.506467509999993, 2024-04-01T19:42:02.856 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.102399318, 2024-04-01T19:42:02.856 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:02.856 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:02.856 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:02.856 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:02.856 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.857 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:02.857 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.313142+0000", 2024-04-01T19:42:02.857 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.857 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.857 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.857 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:02.857 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.313142+0000", 2024-04-01T19:42:02.857 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.857 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.857 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.857 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:02.857 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.313143+0000", 2024-04-01T19:42:02.857 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.265e-06 2024-04-01T19:42:02.858 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.858 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.858 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:02.858 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.313151+0000", 2024-04-01T19:42:02.858 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4399999999999999e-06 2024-04-01T19:42:02.858 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.858 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.858 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:02.858 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.313158+0000", 2024-04-01T19:42:02.858 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4850000000000003e-06 2024-04-01T19:42:02.858 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.858 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.858 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:02.859 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.313165+0000", 2024-04-01T19:42:02.859 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.7900000000000002e-06 2024-04-01T19:42:02.859 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.859 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.859 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:02.859 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.321998+0000", 2024-04-01T19:42:02.859 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0088327389999999992 2024-04-01T19:42:02.859 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.859 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.859 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:02.859 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.322020+0000", 2024-04-01T19:42:02.859 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2549e-05 2024-04-01T19:42:02.860 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.860 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.860 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:02.860 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.415501+0000", 2024-04-01T19:42:02.860 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.093480785999999996 2024-04-01T19:42:02.860 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.860 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.860 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:02.860 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.415541+0000", 2024-04-01T19:42:02.860 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.0263999999999999e-05 2024-04-01T19:42:02.860 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.860 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:02.860 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.860 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.861 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.861 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.10.0:30060 5.4 e402/364 5:260e0fd7:::benchmark_data_smithi188_119427_object92730:head v 402'11643, mlcod=402'11630)", 2024-04-01T19:42:02.861 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:51.313392+0000", 2024-04-01T19:42:02.861 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 71.506217264, 2024-04-01T19:42:02.861 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.102176949, 2024-04-01T19:42:02.861 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:02.861 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:02.861 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:02.861 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:02.861 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.861 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:02.861 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.313392+0000", 2024-04-01T19:42:02.861 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.862 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.862 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.862 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:02.862 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.313392+0000", 2024-04-01T19:42:02.862 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.862 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.862 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.862 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:02.862 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.313393+0000", 2024-04-01T19:42:02.862 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6899999999999996e-07 2024-04-01T19:42:02.862 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.862 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.862 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:02.862 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.313398+0000", 2024-04-01T19:42:02.862 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4190000000000001e-06 2024-04-01T19:42:02.863 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.863 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.863 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:02.863 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.313404+0000", 2024-04-01T19:42:02.863 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2700000000000004e-06 2024-04-01T19:42:02.863 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.863 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.863 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:02.863 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.313407+0000", 2024-04-01T19:42:02.863 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.6969999999999999e-06 2024-04-01T19:42:02.863 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.863 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.863 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:02.863 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.326569+0000", 2024-04-01T19:42:02.863 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.013161882999999999 2024-04-01T19:42:02.864 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.864 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.864 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:02.864 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.326590+0000", 2024-04-01T19:42:02.864 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0951e-05 2024-04-01T19:42:02.864 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.864 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.864 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:02.864 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.415544+0000", 2024-04-01T19:42:02.864 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.088953448000000004 2024-04-01T19:42:02.864 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.864 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.864 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:02.864 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.415569+0000", 2024-04-01T19:42:02.865 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5511999999999999e-05 2024-04-01T19:42:02.865 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.865 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:02.865 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.865 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.865 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.865 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.10.0:30062 5.4 e402/364 5:260e8160:::benchmark_data_smithi188_119427_object110316:head v 402'11644, mlcod=402'11630)", 2024-04-01T19:42:02.865 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:51.317370+0000", 2024-04-01T19:42:02.865 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 71.502239012000004, 2024-04-01T19:42:02.865 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.098213634999999994, 2024-04-01T19:42:02.865 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:02.865 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:02.865 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:02.865 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:02.865 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.866 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:02.866 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.317370+0000", 2024-04-01T19:42:02.866 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.866 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.866 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.866 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:02.866 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.317370+0000", 2024-04-01T19:42:02.866 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.866 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.866 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.866 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:02.866 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.317372+0000", 2024-04-01T19:42:02.867 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3850000000000001e-06 2024-04-01T19:42:02.867 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.867 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.867 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:02.867 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.317380+0000", 2024-04-01T19:42:02.867 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2190000000000004e-06 2024-04-01T19:42:02.867 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.867 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.867 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:02.867 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.317392+0000", 2024-04-01T19:42:02.867 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1673e-05 2024-04-01T19:42:02.867 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.867 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.867 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:02.868 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.317399+0000", 2024-04-01T19:42:02.868 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3760000000000002e-06 2024-04-01T19:42:02.868 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.868 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.868 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:02.868 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.330993+0000", 2024-04-01T19:42:02.868 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.013593968 2024-04-01T19:42:02.868 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.868 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.868 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:02.868 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.331013+0000", 2024-04-01T19:42:02.868 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9570999999999999e-05 2024-04-01T19:42:02.868 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.869 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.869 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:02.869 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.415571+0000", 2024-04-01T19:42:02.869 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.084557985000000002 2024-04-01T19:42:02.869 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.869 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.869 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:02.869 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.415584+0000", 2024-04-01T19:42:02.869 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3458000000000001e-05 2024-04-01T19:42:02.869 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.869 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:02.869 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.869 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.869 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.870 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.10.0:30063 5.4 e402/364 5:260e8d45:::benchmark_data_smithi188_119427_object87180:head v 402'11645, mlcod=402'11630)", 2024-04-01T19:42:02.870 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:51.321292+0000", 2024-04-01T19:42:02.870 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 71.498316904000006, 2024-04-01T19:42:02.870 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.094304885000000005, 2024-04-01T19:42:02.870 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:02.870 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:02.870 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:02.870 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:02.870 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.870 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:02.870 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.321292+0000", 2024-04-01T19:42:02.870 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.870 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.871 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.871 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:02.871 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.321292+0000", 2024-04-01T19:42:02.871 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.871 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.871 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.871 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:02.871 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.321294+0000", 2024-04-01T19:42:02.871 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.372e-06 2024-04-01T19:42:02.871 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.871 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.871 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:02.871 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.321302+0000", 2024-04-01T19:42:02.871 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7940000000000003e-06 2024-04-01T19:42:02.872 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.872 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.872 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:02.872 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.321313+0000", 2024-04-01T19:42:02.872 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1277000000000001e-05 2024-04-01T19:42:02.872 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.872 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.872 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:02.872 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.321320+0000", 2024-04-01T19:42:02.872 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.827e-06 2024-04-01T19:42:02.872 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.872 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.872 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:02.872 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.335552+0000", 2024-04-01T19:42:02.873 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014232184 2024-04-01T19:42:02.873 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.873 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.873 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:02.873 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.335575+0000", 2024-04-01T19:42:02.873 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2898e-05 2024-04-01T19:42:02.873 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.873 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.873 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:02.873 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.415585+0000", 2024-04-01T19:42:02.873 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.080010326000000007 2024-04-01T19:42:02.873 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.873 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.873 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:02.873 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.415597+0000", 2024-04-01T19:42:02.873 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2207e-05 2024-04-01T19:42:02.874 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.874 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:02.874 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.874 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.874 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.874 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.10.0:30064 5.4 e402/364 5:260ed973:::benchmark_data_smithi188_119427_object7000:head v 402'11646, mlcod=402'11630)", 2024-04-01T19:42:02.874 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:51.334548+0000", 2024-04-01T19:42:02.874 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 71.485061625, 2024-04-01T19:42:02.874 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.081063407000000004, 2024-04-01T19:42:02.874 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:02.874 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:02.874 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:02.874 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:02.874 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.874 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:02.875 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.334548+0000", 2024-04-01T19:42:02.875 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.875 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.875 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.875 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:02.875 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.334548+0000", 2024-04-01T19:42:02.875 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.875 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.875 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.875 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:02.875 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.334550+0000", 2024-04-01T19:42:02.875 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4339999999999999e-06 2024-04-01T19:42:02.875 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.875 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.875 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:02.876 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.334561+0000", 2024-04-01T19:42:02.876 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.113e-05 2024-04-01T19:42:02.876 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.876 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.876 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:02.876 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.334573+0000", 2024-04-01T19:42:02.876 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1780000000000001e-05 2024-04-01T19:42:02.876 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.876 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.876 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:02.876 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.334582+0000", 2024-04-01T19:42:02.876 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.1160000000000005e-06 2024-04-01T19:42:02.876 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.876 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.877 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:02.877 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.340083+0000", 2024-04-01T19:42:02.877 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0055002979999999998 2024-04-01T19:42:02.877 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.877 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.877 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:02.877 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.340103+0000", 2024-04-01T19:42:02.877 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0316e-05 2024-04-01T19:42:02.877 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.877 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.877 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:02.877 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.415599+0000", 2024-04-01T19:42:02.877 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.075496026999999993 2024-04-01T19:42:02.877 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.877 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.877 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:02.878 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.415611+0000", 2024-04-01T19:42:02.878 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2306e-05 2024-04-01T19:42:02.878 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.878 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:02.878 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.878 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.878 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.878 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.10.0:30066 5.4 e402/364 5:260fe06a:::benchmark_data_smithi188_119427_object62848:head v 402'11647, mlcod=402'11630)", 2024-04-01T19:42:02.878 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:51.334598+0000", 2024-04-01T19:42:02.878 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 71.485011134999993, 2024-04-01T19:42:02.878 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.081029001000000003, 2024-04-01T19:42:02.878 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:02.878 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:02.879 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:02.879 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:02.879 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.879 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:02.879 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.334598+0000", 2024-04-01T19:42:02.879 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.879 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.879 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.879 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:02.879 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.334598+0000", 2024-04-01T19:42:02.879 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.879 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.879 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.879 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:02.879 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.334599+0000", 2024-04-01T19:42:02.879 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8400000000000005e-07 2024-04-01T19:42:02.879 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.880 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.880 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:02.880 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.334603+0000", 2024-04-01T19:42:02.880 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4360000000000004e-06 2024-04-01T19:42:02.880 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.880 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.880 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:02.880 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.334608+0000", 2024-04-01T19:42:02.880 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8590000000000004e-06 2024-04-01T19:42:02.880 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.880 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.880 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:02.880 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.334612+0000", 2024-04-01T19:42:02.880 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4100000000000001e-06 2024-04-01T19:42:02.880 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.881 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.881 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:02.881 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.345640+0000", 2024-04-01T19:42:02.881 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.011027627999999999 2024-04-01T19:42:02.881 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.881 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.881 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:02.881 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.345661+0000", 2024-04-01T19:42:02.881 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1308999999999999e-05 2024-04-01T19:42:02.881 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.881 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.881 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:02.881 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.415615+0000", 2024-04-01T19:42:02.881 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.069953400999999998 2024-04-01T19:42:02.881 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.881 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.882 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:02.882 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.415627+0000", 2024-04-01T19:42:02.882 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2473999999999999e-05 2024-04-01T19:42:02.882 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.882 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:02.882 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.882 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.882 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.882 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.10.0:30068 5.4 e402/364 5:26102d86:::benchmark_data_smithi188_119427_object55082:head v 402'11648, mlcod=402'11630)", 2024-04-01T19:42:02.882 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:51.334618+0000", 2024-04-01T19:42:02.882 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 71.484991449999995, 2024-04-01T19:42:02.882 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.081023223000000005, 2024-04-01T19:42:02.882 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:02.882 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:02.883 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:02.883 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:02.883 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.883 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:02.883 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.334618+0000", 2024-04-01T19:42:02.883 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.883 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.883 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.883 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:02.883 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.334618+0000", 2024-04-01T19:42:02.883 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.883 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.883 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.883 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:02.883 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.334618+0000", 2024-04-01T19:42:02.883 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.6699999999999999e-07 2024-04-01T19:42:02.884 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.884 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.884 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:02.884 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.334627+0000", 2024-04-01T19:42:02.884 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8899999999999996e-06 2024-04-01T19:42:02.884 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.884 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.884 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:02.884 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.334632+0000", 2024-04-01T19:42:02.884 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4730000000000002e-06 2024-04-01T19:42:02.884 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.884 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.884 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:02.884 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.334636+0000", 2024-04-01T19:42:02.884 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.228e-06 2024-04-01T19:42:02.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.885 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.885 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:02.885 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.349841+0000", 2024-04-01T19:42:02.885 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.015204693 2024-04-01T19:42:02.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.885 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.885 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:02.885 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.349860+0000", 2024-04-01T19:42:02.885 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9127000000000002e-05 2024-04-01T19:42:02.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.885 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.885 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:02.885 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.415629+0000", 2024-04-01T19:42:02.885 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.065768967999999997 2024-04-01T19:42:02.886 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.886 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.886 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:02.886 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.415641+0000", 2024-04-01T19:42:02.886 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2476999999999999e-05 2024-04-01T19:42:02.886 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.886 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:02.886 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.886 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.886 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.886 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.10.0:30069 5.4 e402/364 5:26115104:::benchmark_data_smithi188_119427_object90498:head v 402'11649, mlcod=402'11630)", 2024-04-01T19:42:02.886 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:51.335438+0000", 2024-04-01T19:42:02.886 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 71.484171869999997, 2024-04-01T19:42:02.886 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.080216979999999993, 2024-04-01T19:42:02.886 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:02.887 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:02.887 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:02.887 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:02.887 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.887 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:02.887 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.335438+0000", 2024-04-01T19:42:02.887 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.887 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.887 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:02.887 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.335438+0000", 2024-04-01T19:42:02.887 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.887 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.887 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:02.887 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.335439+0000", 2024-04-01T19:42:02.888 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.144e-06 2024-04-01T19:42:02.888 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.888 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.888 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:02.888 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.335445+0000", 2024-04-01T19:42:02.888 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5309999999999998e-06 2024-04-01T19:42:02.888 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.888 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.888 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:02.888 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.335454+0000", 2024-04-01T19:42:02.888 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8149999999999995e-06 2024-04-01T19:42:02.888 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.888 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.888 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:02.888 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.335461+0000", 2024-04-01T19:42:02.888 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0049999999999998e-06 2024-04-01T19:42:02.889 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.889 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.889 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:02.889 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.354149+0000", 2024-04-01T19:42:02.889 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.018688322 2024-04-01T19:42:02.889 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.889 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.889 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:02.889 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.354163+0000", 2024-04-01T19:42:02.889 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3862e-05 2024-04-01T19:42:02.889 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.889 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.889 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:02.889 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.415642+0000", 2024-04-01T19:42:02.889 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.061479134999999997 2024-04-01T19:42:02.890 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.890 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.890 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:02.890 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.415654+0000", 2024-04-01T19:42:02.890 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2166e-05 2024-04-01T19:42:02.890 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.890 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:02.890 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.890 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.890 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.890 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.10.0:30071 5.4 e402/364 5:26117b17:::benchmark_data_smithi188_119427_object53793:head v 402'11650, mlcod=402'11630)", 2024-04-01T19:42:02.890 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:51.340445+0000", 2024-04-01T19:42:02.890 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 71.479164710999996, 2024-04-01T19:42:02.890 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.075222984000000007, 2024-04-01T19:42:02.890 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:02.891 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:02.891 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:02.891 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:02.891 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.891 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:02.891 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.340445+0000", 2024-04-01T19:42:02.891 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.891 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.891 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.891 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:02.891 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.340445+0000", 2024-04-01T19:42:02.891 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.891 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.891 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.891 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:02.892 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.340447+0000", 2024-04-01T19:42:02.892 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9199999999999998e-06 2024-04-01T19:42:02.892 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.892 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.892 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:02.892 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.340456+0000", 2024-04-01T19:42:02.892 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.5959999999999993e-06 2024-04-01T19:42:02.892 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.892 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.892 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:02.892 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.340467+0000", 2024-04-01T19:42:02.892 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1143e-05 2024-04-01T19:42:02.892 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.892 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.892 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:02.892 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.340476+0000", 2024-04-01T19:42:02.893 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.7409999999999998e-06 2024-04-01T19:42:02.893 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.893 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.893 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:02.893 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.357653+0000", 2024-04-01T19:42:02.893 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.017177089999999999 2024-04-01T19:42:02.893 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.893 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.893 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:02.893 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.357673+0000", 2024-04-01T19:42:02.893 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.014e-05 2024-04-01T19:42:02.893 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.893 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.893 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:02.893 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.415656+0000", 2024-04-01T19:42:02.893 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.057982494000000002 2024-04-01T19:42:02.894 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.894 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.894 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:02.894 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.415668+0000", 2024-04-01T19:42:02.894 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.186e-05 2024-04-01T19:42:02.894 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.894 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:02.894 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.894 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.894 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.894 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.10.0:30072 5.4 e402/364 5:2611aee3:::benchmark_data_smithi188_119427_object31489:head v 402'11651, mlcod=402'11630)", 2024-04-01T19:42:02.894 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:51.345486+0000", 2024-04-01T19:42:02.894 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 71.474123187000004, 2024-04-01T19:42:02.895 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.070195199999999999, 2024-04-01T19:42:02.895 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:02.895 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:02.895 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:02.895 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:02.895 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.895 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:02.895 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.345486+0000", 2024-04-01T19:42:02.895 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.895 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.895 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.895 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:02.895 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.345486+0000", 2024-04-01T19:42:02.895 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.895 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.896 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.896 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:02.896 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.345488+0000", 2024-04-01T19:42:02.896 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.516e-06 2024-04-01T19:42:02.896 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.896 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.896 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:02.896 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.345495+0000", 2024-04-01T19:42:02.896 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7579999999999992e-06 2024-04-01T19:42:02.896 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.896 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.896 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:02.896 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.345516+0000", 2024-04-01T19:42:02.896 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0559000000000001e-05 2024-04-01T19:42:02.897 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.897 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.897 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:02.897 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.345527+0000", 2024-04-01T19:42:02.897 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0496000000000001e-05 2024-04-01T19:42:02.897 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.897 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.897 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:02.897 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.362241+0000", 2024-04-01T19:42:02.897 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.01671479 2024-04-01T19:42:02.897 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.897 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.897 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:02.897 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.362263+0000", 2024-04-01T19:42:02.898 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1563e-05 2024-04-01T19:42:02.898 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.898 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.898 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:02.898 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.415669+0000", 2024-04-01T19:42:02.898 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.053406560999999998 2024-04-01T19:42:02.898 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.898 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.898 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:02.898 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.415681+0000", 2024-04-01T19:42:02.898 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1956999999999999e-05 2024-04-01T19:42:02.898 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.898 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:02.899 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.899 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.899 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.899 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.10.0:30073 5.4 e402/364 5:26138d77:::benchmark_data_smithi188_119427_object53477:head v 402'11652, mlcod=402'11630)", 2024-04-01T19:42:02.899 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:51.345578+0000", 2024-04-01T19:42:02.899 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 71.474031702000005, 2024-04-01T19:42:02.899 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.070116792999999997, 2024-04-01T19:42:02.899 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:02.899 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:02.899 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:02.899 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:02.899 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.899 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:02.899 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.345578+0000", 2024-04-01T19:42:02.899 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.900 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.900 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.900 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:02.900 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.345578+0000", 2024-04-01T19:42:02.900 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.900 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.900 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.900 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:02.900 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.345578+0000", 2024-04-01T19:42:02.900 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5899999999999996e-07 2024-04-01T19:42:02.900 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.900 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.900 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:02.900 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.345583+0000", 2024-04-01T19:42:02.900 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.1449999999999999e-06 2024-04-01T19:42:02.901 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.901 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.901 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:02.901 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.345590+0000", 2024-04-01T19:42:02.901 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3829999999999997e-06 2024-04-01T19:42:02.901 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.901 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.901 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:02.901 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.345596+0000", 2024-04-01T19:42:02.901 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7729999999999996e-06 2024-04-01T19:42:02.901 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.901 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.901 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:02.901 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.366147+0000", 2024-04-01T19:42:02.901 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.020551898999999998 2024-04-01T19:42:02.902 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.902 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.902 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:02.902 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.366170+0000", 2024-04-01T19:42:02.902 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2659000000000001e-05 2024-04-01T19:42:02.902 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.902 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.902 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:02.902 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.415683+0000", 2024-04-01T19:42:02.902 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.049512475 2024-04-01T19:42:02.902 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.902 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.902 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:02.902 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:51.415694+0000", 2024-04-01T19:42:02.903 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.19e-05 2024-04-01T19:42:02.903 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.903 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:02.903 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.903 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.903 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.903 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:176963 5.6 5:655ced39:::benchmark_data_smithi188_119427_object12264:head [delete] snapc 0=[] ondisk+write+known_if_redirected e406)", 2024-04-01T19:42:02.903 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:41:15.035239+0000", 2024-04-01T19:42:02.903 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 47.784370365999997, 2024-04-01T19:42:02.903 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.073878737, 2024-04-01T19:42:02.903 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:02.903 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:02.903 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:02.903 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:42:02.904 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:42:02.904 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:42:02.904 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 176963 2024-04-01T19:42:02.904 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.904 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:02.904 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.904 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:02.904 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.035239+0000", 2024-04-01T19:42:02.904 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.904 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.904 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.904 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:02.904 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.035239+0000", 2024-04-01T19:42:02.904 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.905 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.905 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.905 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:02.905 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.035242+0000", 2024-04-01T19:42:02.905 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5339999999999998e-06 2024-04-01T19:42:02.905 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.905 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.905 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:02.905 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.035249+0000", 2024-04-01T19:42:02.905 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.43e-06 2024-04-01T19:42:02.905 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.905 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.905 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:02.905 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.035263+0000", 2024-04-01T19:42:02.905 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3631e-05 2024-04-01T19:42:02.905 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.906 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.906 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:02.906 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.035271+0000", 2024-04-01T19:42:02.906 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2819999999999996e-06 2024-04-01T19:42:02.906 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.906 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.906 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:02.906 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.048113+0000", 2024-04-01T19:42:02.906 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.012842006 2024-04-01T19:42:02.906 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.906 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.906 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:02.906 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.048244+0000", 2024-04-01T19:42:02.907 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000131178 2024-04-01T19:42:02.907 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.907 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.907 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:42:02.907 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.048372+0000", 2024-04-01T19:42:02.907 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012798700000000001 2024-04-01T19:42:02.907 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.907 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.907 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:42:02.907 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.063097+0000", 2024-04-01T19:42:02.907 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014724737 2024-04-01T19:42:02.907 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.907 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.908 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:42:02.908 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.108988+0000", 2024-04-01T19:42:02.908 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.045891063000000003 2024-04-01T19:42:02.908 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.908 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.908 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:02.908 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.109051+0000", 2024-04-01T19:42:02.908 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3479999999999995e-05 2024-04-01T19:42:02.908 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.908 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.908 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:02.908 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.109118+0000", 2024-04-01T19:42:02.909 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.6408999999999994e-05 2024-04-01T19:42:02.909 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.909 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:02.909 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.909 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.909 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.909 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:176965 5.6 5:6f756f5a:::benchmark_data_smithi188_119427_object12266:head [delete] snapc 0=[] ondisk+write+known_if_redirected e406)", 2024-04-01T19:42:02.909 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:41:15.041965+0000", 2024-04-01T19:42:02.909 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 47.777644844000001, 2024-04-01T19:42:02.909 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.071593545999999994, 2024-04-01T19:42:02.909 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:02.909 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:02.909 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:02.910 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:42:02.910 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:42:02.910 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:42:02.910 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 176965 2024-04-01T19:42:02.910 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.910 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:02.910 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.910 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:02.910 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.041965+0000", 2024-04-01T19:42:02.910 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.910 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.910 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.910 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:02.910 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.041965+0000", 2024-04-01T19:42:02.911 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:02.911 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.911 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.911 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:02.911 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.041967+0000", 2024-04-01T19:42:02.911 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.7499999999999999e-06 2024-04-01T19:42:02.911 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.911 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.911 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:02.911 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.041978+0000", 2024-04-01T19:42:02.911 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0453e-05 2024-04-01T19:42:02.911 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.911 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.911 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:02.911 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.041988+0000", 2024-04-01T19:42:02.911 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0547000000000001e-05 2024-04-01T19:42:02.912 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.912 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.912 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:02.912 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.041997+0000", 2024-04-01T19:42:02.912 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3289999999999994e-06 2024-04-01T19:42:02.912 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.912 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.912 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:02.912 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.053129+0000", 2024-04-01T19:42:02.912 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.01113192 2024-04-01T19:42:02.912 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.912 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.912 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:02.912 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.053266+0000", 2024-04-01T19:42:02.912 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000137222 2024-04-01T19:42:02.912 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.913 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.913 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:42:02.913 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.053401+0000", 2024-04-01T19:42:02.913 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013502800000000001 2024-04-01T19:42:02.913 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.913 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.913 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:42:02.913 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.067730+0000", 2024-04-01T19:42:02.913 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014329313999999999 2024-04-01T19:42:02.913 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.913 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.913 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:42:02.913 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.113464+0000", 2024-04-01T19:42:02.913 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.045733869000000003 2024-04-01T19:42:02.913 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.914 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.914 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:02.914 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.113501+0000", 2024-04-01T19:42:02.914 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7036999999999998e-05 2024-04-01T19:42:02.914 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:02.914 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:02.914 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:02.914 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:15.113558+0000", 2024-04-01T19:42:02.914 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7077000000000003e-05 2024-04-01T19:42:02.914 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.914 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:02.914 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.914 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:02.915 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:02.915 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:42:02.915 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:02.916 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:42:02.916 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:42:03.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:02 smithi062 ceph-mon[44211]: 5.a scrub starts 2024-04-01T19:42:03.017 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:42:03.088 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:02 smithi022 ceph-mon[39439]: 5.a scrub starts 2024-04-01T19:42:03.090 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:03.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:02 smithi188 ceph-mon[43939]: 5.a scrub starts 2024-04-01T19:42:03.412 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:42:03.663 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:42:03.673 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:03.674 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:42:03.727 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:03 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1321756200' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:42:03.727 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:03 smithi022 ceph-mon[39439]: from='client.36140 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:42:03.727 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:03 smithi022 ceph-mon[39439]: pgmap v1176: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.1 GiB data, 16 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:42:03.728 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_ops_in_flight 2024-04-01T19:42:03.737 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:42:03.774 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:42:03.802 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:03.840 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:42:03.843 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:03.843 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:42:03.944 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:42:03.979 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:03 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1321756200' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:42:03.979 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:03 smithi062 ceph-mon[44211]: from='client.36140 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:42:03.979 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:03 smithi062 ceph-mon[44211]: pgmap v1176: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.1 GiB data, 16 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:42:03.984 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:04.011 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:42:04.015 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:04.015 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:42:04.116 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:42:04.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:03 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1321756200' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:42:04.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:03 smithi188 ceph-mon[43939]: from='client.36140 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:42:04.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:03 smithi188 ceph-mon[43939]: pgmap v1176: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.1 GiB data, 16 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:42:04.149 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:04.173 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:42:04.177 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:04.177 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:42:04.278 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:42:04.306 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:04.444 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:42:04.450 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:04.450 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:42:04.542 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:42:04.551 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:42:04.581 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:04.606 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:42:04.609 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:04.609 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:42:04.610 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:42:04.705 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:04 smithi022 ceph-mon[39439]: 5.a scrub ok 2024-04-01T19:42:04.705 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:04 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:42:04.705 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:04 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:42:04.705 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:04 smithi022 ceph-mon[39439]: from='client.36140 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:42:04.705 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:04 smithi022 ceph-mon[39439]: osdmap e421: 12 total, 12 up, 11 in 2024-04-01T19:42:04.711 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:42:04.743 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:04.766 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:42:04.770 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:04.771 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:42:04.871 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:42:04.943 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:05.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:04 smithi062 ceph-mon[44211]: 5.a scrub ok 2024-04-01T19:42:05.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:04 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:42:05.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:04 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:42:05.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:04 smithi062 ceph-mon[44211]: from='client.36140 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:42:05.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:04 smithi062 ceph-mon[44211]: osdmap e421: 12 total, 12 up, 11 in 2024-04-01T19:42:05.040 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:42:05.051 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:05.052 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:42:05.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:04 smithi188 ceph-mon[43939]: 5.a scrub ok 2024-04-01T19:42:05.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:04 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:42:05.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:04 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:42:05.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:04 smithi188 ceph-mon[43939]: from='client.36140 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:42:05.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:04 smithi188 ceph-mon[43939]: osdmap e421: 12 total, 12 up, 11 in 2024-04-01T19:42:05.153 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:42:05.228 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:05.265 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:42:05.268 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:05.269 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:42:05.370 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:42:05.406 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:05.430 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:42:05.435 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:05.435 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:42:05.536 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:42:05.573 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:05.600 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:42:05.606 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:05.606 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:42:05.707 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:42:05.741 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:05.766 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:42:05.768 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:05.769 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:42:05.870 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:42:05.943 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:06.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:05 smithi062 ceph-mon[44211]: pgmap v1178: 17 pgs: 17 active+clean; 6.0 GiB data, 16 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 865 op/s 2024-04-01T19:42:06.032 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:42:06.044 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:06.045 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:42:06.045 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:05 smithi022 ceph-mon[39439]: pgmap v1178: 17 pgs: 17 active+clean; 6.0 GiB data, 16 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 865 op/s 2024-04-01T19:42:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:05 smithi188 ceph-mon[43939]: pgmap v1178: 17 pgs: 17 active+clean; 6.0 GiB data, 16 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 865 op/s 2024-04-01T19:42:06.145 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:42:06.218 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:06.288 INFO:tasks.thrashosds.thrasher:Recovered, killing an osd 2024-04-01T19:42:06.288 INFO:tasks.thrashosds.thrasher:Killing osd 6, live_osds are [0, 1, 2, 3, 4, 5, 7, 9, 10, 11, 8, 6] 2024-04-01T19:42:06.288 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-04-01T19:42:06.289 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.6 2024-04-01T19:42:06.388 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:42:06.395 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:06.396 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:42:06.497 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:42:06.504 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:42:06.525 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:06.549 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:42:06.553 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:06.554 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:42:06.654 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:42:06.684 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:42:06 smithi062 systemd[1]: Stopping Ceph osd.6 for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T19:42:06.705 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:06.724 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:06 smithi022 ceph-mon[39439]: osd.6 marked itself down and dead 2024-04-01T19:42:06.734 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:42:06.737 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:06.737 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:42:06.838 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:42:06.865 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:06.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:06 smithi188 ceph-mon[43939]: osd.6 marked itself down and dead 2024-04-01T19:42:06.917 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:42:06.919 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:06.920 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:42:07.008 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:42:07.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:06 smithi062 ceph-mon[44211]: osd.6 marked itself down and dead 2024-04-01T19:42:07.010 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:42:06 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[116025]: 2024-04-01T19:42:06.685+0000 7f1df0f98700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T19:42:07.010 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:42:06 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[116025]: 2024-04-01T19:42:06.685+0000 7f1df0f98700 -1 osd.6 421 *** Got signal Terminated *** 2024-04-01T19:42:07.010 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:42:06 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[116025]: 2024-04-01T19:42:06.685+0000 7f1df0f98700 -1 osd.6 421 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T19:42:07.021 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:42:07.049 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:07.247 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:42:07.251 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:07.251 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:42:07.352 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:42:07.381 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:07.400 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:42:07.403 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:07.403 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:42:07.504 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:42:07.532 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:07.551 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:42:07.553 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:07.553 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:42:07.654 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:42:07.673 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:42:07.673 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:42:07.673 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 0 2024-04-01T19:42:07.674 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:42:07.682 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:07.701 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:42:07.703 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:07.704 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:42:07.805 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:42:07.835 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:07.959 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:42:07.960 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:42:07 smithi062 bash[128215]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6 2024-04-01T19:42:07.961 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:07 smithi062 ceph-mon[44211]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-01T19:42:07.961 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:07 smithi062 ceph-mon[44211]: osdmap e422: 12 total, 11 up, 11 in 2024-04-01T19:42:07.961 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:07 smithi062 ceph-mon[44211]: pgmap v1180: 17 pgs: 1 stale+active+clean, 16 active+clean; 5.7 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 1.27k op/s 2024-04-01T19:42:07.961 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:07.962 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:42:08.063 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:42:08.088 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:07 smithi188 ceph-mon[43939]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-01T19:42:08.088 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:07 smithi188 ceph-mon[43939]: osdmap e422: 12 total, 11 up, 11 in 2024-04-01T19:42:08.088 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:07 smithi188 ceph-mon[43939]: pgmap v1180: 17 pgs: 1 stale+active+clean, 16 active+clean; 5.7 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 1.27k op/s 2024-04-01T19:42:08.090 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:08.109 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:42:08.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:07 smithi022 ceph-mon[39439]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-01T19:42:08.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:07 smithi022 ceph-mon[39439]: osdmap e422: 12 total, 11 up, 11 in 2024-04-01T19:42:08.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:07 smithi022 ceph-mon[39439]: pgmap v1180: 17 pgs: 1 stale+active+clean, 16 active+clean; 5.7 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 1.27k op/s 2024-04-01T19:42:08.111 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:08.112 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:42:08.212 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:42:08.238 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:08.257 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:42:08.259 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:08.260 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:42:08.361 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:42:08.392 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:08.841 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:42:08.846 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:08.847 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:42:08.948 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:42:08.979 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:09.000 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:42:09.003 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:08 smithi062 ceph-mon[44211]: osdmap e423: 12 total, 11 up, 11 in 2024-04-01T19:42:09.003 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:09.004 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:42:09.105 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:42:09.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:08 smithi022 ceph-mon[39439]: osdmap e423: 12 total, 11 up, 11 in 2024-04-01T19:42:09.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:08 smithi188 ceph-mon[43939]: osdmap e423: 12 total, 11 up, 11 in 2024-04-01T19:42:09.137 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:09.158 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:42:09.161 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:09.161 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:42:09.182 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_blocked_ops 2024-04-01T19:42:09.262 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:42:09.290 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:09.311 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:42:09.313 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:09.314 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:42:09.415 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:42:09.450 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:09.648 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.6.service' 2024-04-01T19:42:09.693 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T19:42:09.693 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-04-01T19:42:09.694 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd down 6 2024-04-01T19:42:10.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:09 smithi062 ceph-mon[44211]: pgmap v1182: 17 pgs: 1 undersized+degraded+peered, 1 stale+active+clean, 15 active+clean; 5.7 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 975 op/s; 5883/186558 objects degraded (3.153%) 2024-04-01T19:42:10.064 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:09 smithi022 ceph-mon[39439]: pgmap v1182: 17 pgs: 1 undersized+degraded+peered, 1 stale+active+clean, 15 active+clean; 5.7 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 975 op/s; 5883/186558 objects degraded (3.153%) 2024-04-01T19:42:10.090 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:42:10.099 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:42:10.102 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:10.103 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:42:10.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:09 smithi188 ceph-mon[43939]: pgmap v1182: 17 pgs: 1 undersized+degraded+peered, 1 stale+active+clean, 15 active+clean; 5.7 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 975 op/s; 5883/186558 objects degraded (3.153%) 2024-04-01T19:42:10.204 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:42:10.231 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:10.380 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:42:10.383 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:10.383 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:42:10.484 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:42:10.520 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:10.543 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:42:10.546 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:10.546 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:42:10.647 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:42:10.678 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:10.756 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:42:10.777 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:42:10.780 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:10.781 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:42:10.882 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:42:10.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:10 smithi022 ceph-mon[39439]: Health check failed: Degraded data redundancy: 5883/186558 objects degraded (3.153%), 1 pg degraded (PG_DEGRADED) 2024-04-01T19:42:10.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:10 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4182965147' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:42:10.911 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:11.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:10 smithi062 ceph-mon[44211]: Health check failed: Degraded data redundancy: 5883/186558 objects degraded (3.153%), 1 pg degraded (PG_DEGRADED) 2024-04-01T19:42:11.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:10 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4182965147' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:42:11.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:10 smithi188 ceph-mon[43939]: Health check failed: Degraded data redundancy: 5883/186558 objects degraded (3.153%), 1 pg degraded (PG_DEGRADED) 2024-04-01T19:42:11.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:10 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4182965147' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:42:11.159 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:42:11.161 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:11.162 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:42:11.263 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:42:11.294 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:11.315 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:42:11.318 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:11.318 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:42:11.419 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:42:11.453 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:11.476 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:42:11.478 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:11.479 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:42:11.580 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:42:11.611 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:11.632 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:42:11.635 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:11.635 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:42:11.736 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:42:11.770 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:11.792 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:42:11.795 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:11.795 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:42:11.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:11 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:42:11.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:11 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4182965147' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:42:11.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:11 smithi188 ceph-mon[43939]: osdmap e424: 12 total, 11 up, 11 in 2024-04-01T19:42:11.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:11 smithi188 ceph-mon[43939]: pgmap v1184: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 993 op/s; 17387/184892 objects degraded (9.404%) 2024-04-01T19:42:11.896 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:42:11.931 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:12.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:11 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:42:12.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:11 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4182965147' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:42:12.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:11 smithi062 ceph-mon[44211]: osdmap e424: 12 total, 11 up, 11 in 2024-04-01T19:42:12.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:11 smithi062 ceph-mon[44211]: pgmap v1184: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 993 op/s; 17387/184892 objects degraded (9.404%) 2024-04-01T19:42:12.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:11 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:42:12.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:11 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4182965147' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:42:12.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:11 smithi022 ceph-mon[39439]: osdmap e424: 12 total, 11 up, 11 in 2024-04-01T19:42:12.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:11 smithi022 ceph-mon[39439]: pgmap v1184: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 993 op/s; 17387/184892 objects degraded (9.404%) 2024-04-01T19:42:13.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:13 smithi022 ceph-mon[39439]: pgmap v1185: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 298 op/s; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:13.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:13 smithi188 ceph-mon[43939]: pgmap v1185: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 298 op/s; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:13.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:13 smithi062 ceph-mon[44211]: pgmap v1185: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 298 op/s; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:15.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:15 smithi022 ceph-mon[39439]: pgmap v1186: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 234 op/s; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:15.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:15 smithi188 ceph-mon[43939]: pgmap v1186: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 234 op/s; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:15.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:15 smithi062 ceph-mon[44211]: pgmap v1186: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 234 op/s; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:16.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:16 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 17387/184582 objects degraded (9.420%), 3 pgs degraded (PG_DEGRADED) 2024-04-01T19:42:16.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:16 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3000199434' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:42:16.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:16 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:16.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:16 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 17387/184582 objects degraded (9.420%), 3 pgs degraded (PG_DEGRADED) 2024-04-01T19:42:16.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:16 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3000199434' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:42:16.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:16 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:16.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:16 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 17387/184582 objects degraded (9.420%), 3 pgs degraded (PG_DEGRADED) 2024-04-01T19:42:16.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:16 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3000199434' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:42:16.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:16 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:17 smithi188 ceph-mon[43939]: pgmap v1187: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 132 op/s; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:17.461 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:42:17.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:17 smithi062 ceph-mon[44211]: pgmap v1187: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 132 op/s; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:17.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:17.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:17 smithi022 ceph-mon[39439]: pgmap v1187: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 132 op/s; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:19.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:19 smithi022 ceph-mon[39439]: pgmap v1188: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 98 op/s; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:19.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:19 smithi188 ceph-mon[43939]: pgmap v1188: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 98 op/s; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:19.421 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:42:19.427 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:19.427 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:42:19.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:19 smithi062 ceph-mon[44211]: pgmap v1188: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 98 op/s; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:19.528 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:42:19.563 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:19.974 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:42:19.974 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:42:19.974 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:42:19.974 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:42:19.974 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:42:19.974 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:42:19.974 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:42:19.974 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:42:19.974 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:42:19.974 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:42:19.974 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:42:19.975 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:42:19.975 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:42:19.975 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:42:19.975 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:42:19.975 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:42:19.975 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:42:19.975 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:42:19.975 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:42:19.975 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:42:19.975 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:42:19.975 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:42:19.975 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:42:20.415 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:42:20.419 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:20.419 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:42:20.520 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:42:20.554 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:21.091 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:42:21.091 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:42:21.105 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:42:21.108 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:21.109 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:42:21.209 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:42:21.232 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:42:21.241 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:21.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:21 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:42:21.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:21 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:42:21.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:21 smithi022 ceph-mon[39439]: osdmap e425: 12 total, 11 up, 11 in 2024-04-01T19:42:21.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:21 smithi022 ceph-mon[39439]: pgmap v1190: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 15 op/s; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:21.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:21 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:42:21.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:21 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:42:21.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:21 smithi188 ceph-mon[43939]: osdmap e425: 12 total, 11 up, 11 in 2024-04-01T19:42:21.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:21 smithi188 ceph-mon[43939]: pgmap v1190: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 15 op/s; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:21.443 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:42:21.446 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:21.447 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:42:21.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:21 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:42:21.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:21 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:42:21.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:21 smithi062 ceph-mon[44211]: osdmap e425: 12 total, 11 up, 11 in 2024-04-01T19:42:21.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:21 smithi062 ceph-mon[44211]: pgmap v1190: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 15 op/s; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:21.547 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:42:21.579 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:21.599 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:42:21.602 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:21.603 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:42:21.673 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:42:21.673 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:42:21.703 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:42:21.737 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:21.759 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:42:21.762 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:21.762 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:42:21.864 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:42:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:22.552 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6 is already down. 2024-04-01T19:42:22.845 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:42:22.847 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:22 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[39416]: 2024-04-01T19:42:22.550+0000 7fd025a9f700 -1 mon.a@0(leader).osd e425 definitely_dead 0 2024-04-01T19:42:22.847 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:22 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/643319338' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["6"]}]: dispatch 2024-04-01T19:42:22.848 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:22.848 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:42:22.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:22 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/643319338' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["6"]}]: dispatch 2024-04-01T19:42:22.949 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:42:22.980 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:22 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/643319338' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["6"]}]: dispatch 2024-04-01T19:42:22.982 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:23.004 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:42:23.007 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:23.007 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:42:23.010 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_historic_ops 2024-04-01T19:42:23.092 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:42:23.108 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:42:23.139 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:23.160 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:42:23.163 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:23.163 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:42:23.264 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:42:23.297 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:23.319 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:42:23.322 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:23.322 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:42:23.423 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:42:23.454 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:23.474 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:42:23.477 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:23.478 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:42:23.552 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:42:23.555 INFO:tasks.thrashosds.thrasher:Removing osd 6, in_osds are: [0, 1, 2, 3, 4, 5, 7, 9, 10, 11, 6] 2024-04-01T19:42:23.555 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd out 6 2024-04-01T19:42:23.579 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:42:23.631 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:23.838 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:23 smithi022 ceph-mon[39439]: pgmap v1191: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:23.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:23 smithi188 ceph-mon[43939]: pgmap v1191: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:23.880 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:42:23.883 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:23.883 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:42:23.984 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:42:24.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:23 smithi062 ceph-mon[44211]: pgmap v1191: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:24.015 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:24.036 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:42:24.039 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:24.039 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:42:24.140 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:42:24.171 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:24.191 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:42:24.194 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:24.194 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:42:24.295 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:42:24.314 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:42:24.315 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:42:24.333 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:24.617 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:42:24.620 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:24.620 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:42:24.721 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:42:24.753 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:24.774 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:42:24.777 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:24.778 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:42:24.879 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:42:24.907 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:24.927 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:42:24.929 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:24.930 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:42:25.031 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:42:25.058 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:25.077 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:42:25.079 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:25.080 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:42:25.181 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:42:25.208 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:25.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:25 smithi022 ceph-mon[39439]: pgmap v1192: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:25.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:25 smithi188 ceph-mon[43939]: pgmap v1192: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:25.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:25 smithi062 ceph-mon[44211]: pgmap v1192: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:25.657 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:42:25.660 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:25.661 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:42:25.762 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:42:25.795 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:25.817 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:42:25.820 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:25.820 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:42:25.921 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:42:25.950 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:26.578 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:42:26.581 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:26.581 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:42:26.682 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:42:26.715 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:26.737 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:42:26.740 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:26.740 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:42:26.841 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:42:26.875 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:27.287 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:42:27.306 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:42:27.325 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:42:27.345 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:42:27.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:27 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:42:27.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:27 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:42:27.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:27 smithi022 ceph-mon[39439]: osdmap e426: 12 total, 11 up, 11 in 2024-04-01T19:42:27.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:27 smithi022 ceph-mon[39439]: pgmap v1194: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:27.365 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:42:27.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:27 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:42:27.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:27 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:42:27.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:27 smithi188 ceph-mon[43939]: osdmap e426: 12 total, 11 up, 11 in 2024-04-01T19:42:27.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:27 smithi188 ceph-mon[43939]: pgmap v1194: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:27.386 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:42:27.407 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:42:27.427 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:42:27.447 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:42:27.467 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:42:27.487 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:42:27.488 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:42:27.488 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:42:27.488 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:42:27.488 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:42:27.488 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:42:27.488 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:42:27.488 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:42:27.488 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:42:27.488 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:42:27.488 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:42:27.488 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:42:27.488 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:42:27.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:27 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:42:27.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:27 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:42:27.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:27 smithi062 ceph-mon[44211]: osdmap e426: 12 total, 11 up, 11 in 2024-04-01T19:42:27.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:27 smithi062 ceph-mon[44211]: pgmap v1194: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:27.662 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:42:27.662 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 20, 2024-04-01T19:42:27.662 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 600, 2024-04-01T19:42:27.662 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:42:27.662 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.662 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:180651 5.1 e408/364 5:870825d8:::benchmark_data_smithi188_119427_object15952:head v 408'11380, mlcod=408'11377)", 2024-04-01T19:42:27.662 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:41:18.615963+0000", 2024-04-01T19:42:27.663 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 69.033704766, 2024-04-01T19:42:27.663 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.029946166999999999, 2024-04-01T19:42:27.663 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:27.663 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:27.663 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:27.663 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:27.663 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.663 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:27.663 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:18.615963+0000", 2024-04-01T19:42:27.663 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.663 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.663 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.663 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:27.663 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:18.615963+0000", 2024-04-01T19:42:27.664 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.664 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.664 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.664 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:27.664 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:18.615966+0000", 2024-04-01T19:42:27.664 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.8140000000000001e-06 2024-04-01T19:42:27.664 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.664 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.664 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:27.664 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:18.615980+0000", 2024-04-01T19:42:27.664 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3373000000000001e-05 2024-04-01T19:42:27.664 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.664 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.664 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:27.665 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:18.616000+0000", 2024-04-01T19:42:27.665 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0216000000000001e-05 2024-04-01T19:42:27.665 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.665 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.665 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:27.665 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:18.616010+0000", 2024-04-01T19:42:27.665 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.9899999999999992e-06 2024-04-01T19:42:27.665 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.665 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.665 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:27.665 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:18.616128+0000", 2024-04-01T19:42:27.665 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000117853 2024-04-01T19:42:27.665 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.666 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.666 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:27.666 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:18.616149+0000", 2024-04-01T19:42:27.666 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0959999999999999e-05 2024-04-01T19:42:27.666 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.666 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.666 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:27.666 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:18.645864+0000", 2024-04-01T19:42:27.666 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.029715001000000001 2024-04-01T19:42:27.666 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.666 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.667 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:27.667 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:18.645910+0000", 2024-04-01T19:42:27.667 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.596e-05 2024-04-01T19:42:27.667 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.667 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:27.667 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.667 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.667 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.667 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:180662 5.1 e408/364 5:88496058:::benchmark_data_smithi188_119427_object15963:head v 408'11382, mlcod=408'11377)", 2024-04-01T19:42:27.667 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:41:18.616053+0000", 2024-04-01T19:42:27.667 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 69.033615009000002, 2024-04-01T19:42:27.667 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.029909636, 2024-04-01T19:42:27.667 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:27.668 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:27.668 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:27.668 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:27.668 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.668 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:27.668 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:18.616053+0000", 2024-04-01T19:42:27.668 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.668 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.668 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.668 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:27.668 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:18.616053+0000", 2024-04-01T19:42:27.668 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.668 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.668 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.669 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:27.669 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:18.616054+0000", 2024-04-01T19:42:27.669 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5999999999999999e-07 2024-04-01T19:42:27.669 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.669 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.669 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:27.669 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:18.616061+0000", 2024-04-01T19:42:27.669 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3259999999999998e-06 2024-04-01T19:42:27.669 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.669 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.669 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:27.669 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:18.616065+0000", 2024-04-01T19:42:27.669 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4889999999999997e-06 2024-04-01T19:42:27.669 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.670 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.670 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:27.670 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:18.616069+0000", 2024-04-01T19:42:27.670 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9840000000000003e-06 2024-04-01T19:42:27.670 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.670 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.670 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:27.670 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:18.623076+0000", 2024-04-01T19:42:27.670 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0070065639999999998 2024-04-01T19:42:27.670 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.670 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.670 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:27.670 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:18.623106+0000", 2024-04-01T19:42:27.670 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.0099000000000001e-05 2024-04-01T19:42:27.670 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.670 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.671 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:27.671 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:18.645941+0000", 2024-04-01T19:42:27.671 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.022834651000000001 2024-04-01T19:42:27.671 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.671 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.671 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:27.671 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:18.645963+0000", 2024-04-01T19:42:27.671 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2163000000000001e-05 2024-04-01T19:42:27.671 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.671 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:27.671 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.671 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.671 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.671 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:183979 5.1 e408/364 5:8fa90bd0:::benchmark_data_smithi188_119427_object19280:head v 408'11605, mlcod=408'11601)", 2024-04-01T19:42:27.672 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:41:21.283311+0000", 2024-04-01T19:42:27.672 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 66.366357727999997, 2024-04-01T19:42:27.672 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.031189049, 2024-04-01T19:42:27.672 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:27.672 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:27.672 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:27.672 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:27.672 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.672 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:27.672 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.283311+0000", 2024-04-01T19:42:27.672 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.672 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.672 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.672 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:27.672 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.283311+0000", 2024-04-01T19:42:27.673 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.673 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.673 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.673 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:27.673 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.283312+0000", 2024-04-01T19:42:27.673 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8419999999999999e-06 2024-04-01T19:42:27.673 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.673 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.673 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:27.673 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.283325+0000", 2024-04-01T19:42:27.673 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2797e-05 2024-04-01T19:42:27.673 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.673 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.674 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:27.674 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.283339+0000", 2024-04-01T19:42:27.674 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3501e-05 2024-04-01T19:42:27.674 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.674 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.674 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:27.674 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.283348+0000", 2024-04-01T19:42:27.674 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.7410000000000004e-06 2024-04-01T19:42:27.674 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.674 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.674 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:27.674 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.283409+0000", 2024-04-01T19:42:27.674 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0458999999999998e-05 2024-04-01T19:42:27.674 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.674 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.675 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:27.675 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.283430+0000", 2024-04-01T19:42:27.675 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1086000000000001e-05 2024-04-01T19:42:27.675 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.675 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.675 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:27.675 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.314447+0000", 2024-04-01T19:42:27.675 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.031017419000000001 2024-04-01T19:42:27.675 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.675 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.675 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:27.675 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.314500+0000", 2024-04-01T19:42:27.675 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2203999999999997e-05 2024-04-01T19:42:27.675 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.675 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:27.675 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.676 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.676 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.676 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:184722 5.1 e408/364 5:8257c0b8:::benchmark_data_smithi188_119427_object20023:head v 408'11648, mlcod=408'11645)", 2024-04-01T19:42:27.676 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:41:21.929969+0000", 2024-04-01T19:42:27.676 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 65.719698898000004, 2024-04-01T19:42:27.676 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.032640808, 2024-04-01T19:42:27.676 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:27.676 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:27.676 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:27.676 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:27.676 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.676 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:27.676 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.929969+0000", 2024-04-01T19:42:27.676 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.677 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.677 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.677 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:27.677 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.929969+0000", 2024-04-01T19:42:27.677 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.677 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.677 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.677 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:27.677 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.929971+0000", 2024-04-01T19:42:27.677 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0200000000000001e-06 2024-04-01T19:42:27.677 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.677 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.677 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:27.677 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.929981+0000", 2024-04-01T19:42:27.678 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.8120000000000002e-06 2024-04-01T19:42:27.678 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.678 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.678 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:27.678 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.929993+0000", 2024-04-01T19:42:27.678 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1691999999999999e-05 2024-04-01T19:42:27.678 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.678 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.678 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:27.678 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.930002+0000", 2024-04-01T19:42:27.678 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6589999999999996e-06 2024-04-01T19:42:27.678 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.678 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.678 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:27.679 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.937979+0000", 2024-04-01T19:42:27.679 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0079773589999999998 2024-04-01T19:42:27.679 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.679 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.679 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:27.679 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.938000+0000", 2024-04-01T19:42:27.679 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1540999999999999e-05 2024-04-01T19:42:27.679 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.679 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.679 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:27.679 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.962557+0000", 2024-04-01T19:42:27.679 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.024556798000000001 2024-04-01T19:42:27.679 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.679 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.680 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:27.680 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.962610+0000", 2024-04-01T19:42:27.680 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2927000000000003e-05 2024-04-01T19:42:27.680 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.680 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:27.680 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.680 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.680 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.680 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:184762 5.1 e408/364 5:8fd564d3:::benchmark_data_smithi188_119427_object20063:head v 408'11650, mlcod=408'11648)", 2024-04-01T19:42:27.680 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:41:21.974451+0000", 2024-04-01T19:42:27.680 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 65.675216810999999, 2024-04-01T19:42:27.680 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.035384540999999999, 2024-04-01T19:42:27.680 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:27.680 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:27.680 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:27.681 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:27.681 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.681 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:27.681 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.974451+0000", 2024-04-01T19:42:27.681 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.681 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.681 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.681 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:27.681 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.974451+0000", 2024-04-01T19:42:27.681 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.681 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.681 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.682 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:27.682 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.974454+0000", 2024-04-01T19:42:27.682 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4660000000000002e-06 2024-04-01T19:42:27.682 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.682 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.682 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:27.682 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.974467+0000", 2024-04-01T19:42:27.682 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3263e-05 2024-04-01T19:42:27.682 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.682 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.682 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:27.682 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.974485+0000", 2024-04-01T19:42:27.682 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8221999999999999e-05 2024-04-01T19:42:27.682 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.683 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.683 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:27.683 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.974494+0000", 2024-04-01T19:42:27.683 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.9479999999999997e-06 2024-04-01T19:42:27.683 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.683 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.683 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:27.683 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.974581+0000", 2024-04-01T19:42:27.683 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6787999999999996e-05 2024-04-01T19:42:27.683 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.683 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.683 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:27.684 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.974605+0000", 2024-04-01T19:42:27.684 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3808e-05 2024-04-01T19:42:27.684 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.684 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.684 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:27.684 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:22.009806+0000", 2024-04-01T19:42:27.684 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.035201336 2024-04-01T19:42:27.684 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.684 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.684 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:27.684 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:22.009836+0000", 2024-04-01T19:42:27.684 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.9709999999999998e-05 2024-04-01T19:42:27.685 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.685 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:27.685 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.685 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.685 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.685 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:184765 5.1 e408/364 5:8a8079b6:::benchmark_data_smithi188_119427_object20066:head v 408'11651, mlcod=408'11648)", 2024-04-01T19:42:27.685 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:41:21.977098+0000", 2024-04-01T19:42:27.685 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 65.672569815000003, 2024-04-01T19:42:27.685 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.032762194000000001, 2024-04-01T19:42:27.685 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:27.685 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:27.685 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:27.685 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:27.685 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.686 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:27.686 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.977098+0000", 2024-04-01T19:42:27.686 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.686 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.686 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.686 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:27.686 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.977098+0000", 2024-04-01T19:42:27.686 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.686 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.686 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.686 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:27.686 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.977100+0000", 2024-04-01T19:42:27.687 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.759e-06 2024-04-01T19:42:27.687 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.687 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.687 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:27.687 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.977110+0000", 2024-04-01T19:42:27.687 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.7650000000000005e-06 2024-04-01T19:42:27.687 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.687 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.687 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:27.687 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.977124+0000", 2024-04-01T19:42:27.687 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4489e-05 2024-04-01T19:42:27.687 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.688 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.688 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:27.688 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.977131+0000", 2024-04-01T19:42:27.688 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8569999999999997e-06 2024-04-01T19:42:27.688 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.688 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.688 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:27.688 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.979178+0000", 2024-04-01T19:42:27.688 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0020470520000000002 2024-04-01T19:42:27.688 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.688 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.688 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:27.688 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:21.979197+0000", 2024-04-01T19:42:27.688 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8726999999999999e-05 2024-04-01T19:42:27.689 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.689 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.689 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:27.689 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:22.009840+0000", 2024-04-01T19:42:27.689 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.030642618999999999 2024-04-01T19:42:27.689 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.689 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.689 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:27.689 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:22.009861+0000", 2024-04-01T19:42:27.689 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0925999999999999e-05 2024-04-01T19:42:27.689 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.689 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:27.689 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.689 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.690 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.690 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:204450 5.1 e412/364 5:8b3763c7:::benchmark_data_smithi188_119427_object39751:head v 412'12898, mlcod=412'12896)", 2024-04-01T19:42:27.690 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:41:38.629089+0000", 2024-04-01T19:42:27.690 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 49.020579462000001, 2024-04-01T19:42:27.690 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.031398744999999999, 2024-04-01T19:42:27.690 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:27.690 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:27.690 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:27.690 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:27.690 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.690 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:27.690 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:38.629089+0000", 2024-04-01T19:42:27.690 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.691 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.691 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.691 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:27.691 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:38.629089+0000", 2024-04-01T19:42:27.691 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.691 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.691 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.691 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:27.691 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:38.629092+0000", 2024-04-01T19:42:27.691 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.1360000000000001e-06 2024-04-01T19:42:27.691 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.691 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.691 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:27.691 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:38.629104+0000", 2024-04-01T19:42:27.691 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2262999999999999e-05 2024-04-01T19:42:27.692 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.692 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.692 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:27.692 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:38.629123+0000", 2024-04-01T19:42:27.692 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8635e-05 2024-04-01T19:42:27.692 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.692 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.692 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:27.692 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:38.629132+0000", 2024-04-01T19:42:27.692 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.5740000000000002e-06 2024-04-01T19:42:27.692 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.692 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.692 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:27.692 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:38.629213+0000", 2024-04-01T19:42:27.693 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0718999999999997e-05 2024-04-01T19:42:27.693 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.693 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.693 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:27.693 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:38.629238+0000", 2024-04-01T19:42:27.693 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5011000000000002e-05 2024-04-01T19:42:27.693 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.693 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.693 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:27.693 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:38.660434+0000", 2024-04-01T19:42:27.693 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.031196389000000001 2024-04-01T19:42:27.693 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.693 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.694 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:27.694 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:38.660488+0000", 2024-04-01T19:42:27.694 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3018e-05 2024-04-01T19:42:27.694 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.694 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:27.694 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.694 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.694 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.694 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:228040 5.1 e420/364 5:8fd699a2:::benchmark_data_smithi188_119427_object63341:head v 420'14393, mlcod=420'14389)", 2024-04-01T19:42:27.694 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:41:58.959973+0000", 2024-04-01T19:42:27.694 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 28.689695145999998, 2024-04-01T19:42:27.694 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.027719537999999998, 2024-04-01T19:42:27.695 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:27.695 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:27.695 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:27.695 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:27.695 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.695 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:27.695 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:58.959973+0000", 2024-04-01T19:42:27.695 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.695 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.695 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.695 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:27.695 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:58.959973+0000", 2024-04-01T19:42:27.696 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.696 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.696 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.696 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:27.696 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:58.959975+0000", 2024-04-01T19:42:27.696 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8789999999999999e-06 2024-04-01T19:42:27.696 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.696 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.696 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:27.696 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:58.959986+0000", 2024-04-01T19:42:27.696 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0861e-05 2024-04-01T19:42:27.696 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.696 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.697 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:27.697 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:58.960002+0000", 2024-04-01T19:42:27.697 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6535e-05 2024-04-01T19:42:27.697 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.697 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.697 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:27.697 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:58.960012+0000", 2024-04-01T19:42:27.697 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.2329999999999995e-06 2024-04-01T19:42:27.697 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.697 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.697 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:27.697 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:58.969418+0000", 2024-04-01T19:42:27.697 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0094063700000000007 2024-04-01T19:42:27.698 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.698 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.698 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:27.698 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:58.969441+0000", 2024-04-01T19:42:27.698 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2659000000000001e-05 2024-04-01T19:42:27.698 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.698 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.698 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:27.698 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:58.987658+0000", 2024-04-01T19:42:27.698 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.018217811 2024-04-01T19:42:27.698 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.698 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.699 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:27.699 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:58.987693+0000", 2024-04-01T19:42:27.699 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.4190000000000003e-05 2024-04-01T19:42:27.699 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.699 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:27.699 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.699 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.699 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.699 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:228394 5.1 e420/364 5:8a6983b7:::benchmark_data_smithi188_119427_object63695:head v 420'14418, mlcod=420'14416)", 2024-04-01T19:42:27.699 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:41:59.295260+0000", 2024-04-01T19:42:27.699 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 28.354408297999999, 2024-04-01T19:42:27.699 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.022709383, 2024-04-01T19:42:27.699 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:27.699 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:27.700 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:27.700 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:27.700 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.700 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:27.700 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:59.295260+0000", 2024-04-01T19:42:27.700 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.700 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.700 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.700 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:27.700 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:59.295260+0000", 2024-04-01T19:42:27.700 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.700 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.700 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.700 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:27.700 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:59.295262+0000", 2024-04-01T19:42:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3360000000000002e-06 2024-04-01T19:42:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:59.295274+0000", 2024-04-01T19:42:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.152e-05 2024-04-01T19:42:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:59.295291+0000", 2024-04-01T19:42:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7421000000000001e-05 2024-04-01T19:42:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.701 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.702 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:27.702 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:59.295301+0000", 2024-04-01T19:42:27.702 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.2900000000000008e-06 2024-04-01T19:42:27.702 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.702 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.702 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:27.702 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:59.298034+0000", 2024-04-01T19:42:27.702 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0027338089999999998 2024-04-01T19:42:27.702 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.702 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.702 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:27.702 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:59.298051+0000", 2024-04-01T19:42:27.702 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6960999999999999e-05 2024-04-01T19:42:27.703 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.703 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.703 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:27.703 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:59.317913+0000", 2024-04-01T19:42:27.703 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.01986156 2024-04-01T19:42:27.703 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.703 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.703 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:27.703 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:41:59.317969+0000", 2024-04-01T19:42:27.703 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6486000000000001e-05 2024-04-01T19:42:27.703 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.703 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:27.703 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.703 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.704 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.704 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:230831 5.1 e420/364 5:8de24e9b:::benchmark_data_smithi188_119427_object66132:head v 420'14550, mlcod=420'14546)", 2024-04-01T19:42:27.704 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:01.294686+0000", 2024-04-01T19:42:27.704 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 26.354982518, 2024-04-01T19:42:27.704 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.032145618000000001, 2024-04-01T19:42:27.704 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:27.704 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:27.704 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:27.704 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:27.704 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.704 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:27.704 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.294686+0000", 2024-04-01T19:42:27.704 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.704 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.705 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.705 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:27.705 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.294686+0000", 2024-04-01T19:42:27.705 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.705 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.705 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.705 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:27.705 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.294687+0000", 2024-04-01T19:42:27.705 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.669e-06 2024-04-01T19:42:27.705 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.705 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.705 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:27.705 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.294696+0000", 2024-04-01T19:42:27.706 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4840000000000004e-06 2024-04-01T19:42:27.706 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.706 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.706 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:27.706 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.294707+0000", 2024-04-01T19:42:27.706 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1238e-05 2024-04-01T19:42:27.706 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.706 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.706 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:27.706 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.294713+0000", 2024-04-01T19:42:27.706 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0820000000000004e-06 2024-04-01T19:42:27.706 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.706 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.707 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:27.707 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.296966+0000", 2024-04-01T19:42:27.707 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0022531000000000001 2024-04-01T19:42:27.707 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.707 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.707 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:27.707 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.296980+0000", 2024-04-01T19:42:27.707 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3896e-05 2024-04-01T19:42:27.707 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.707 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.707 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:27.707 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.326785+0000", 2024-04-01T19:42:27.707 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.029804546000000001 2024-04-01T19:42:27.708 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.708 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.708 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:27.708 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.326831+0000", 2024-04-01T19:42:27.708 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6603000000000001e-05 2024-04-01T19:42:27.708 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.708 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:27.708 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.708 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.708 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.708 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:230835 5.1 e420/364 5:83b95037:::benchmark_data_smithi188_119427_object66136:head v 420'14551, mlcod=420'14547)", 2024-04-01T19:42:27.708 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:01.299062+0000", 2024-04-01T19:42:27.708 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 26.350606055, 2024-04-01T19:42:27.708 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.02779701, 2024-04-01T19:42:27.709 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:27.709 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:27.709 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:27.709 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:27.709 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.709 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:27.709 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.299062+0000", 2024-04-01T19:42:27.709 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.709 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.709 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.709 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:27.709 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.299062+0000", 2024-04-01T19:42:27.709 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.710 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.710 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.710 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:27.710 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.299064+0000", 2024-04-01T19:42:27.710 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5269999999999999e-06 2024-04-01T19:42:27.710 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.710 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.710 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:27.710 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.299072+0000", 2024-04-01T19:42:27.710 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.1659999999999994e-06 2024-04-01T19:42:27.710 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.710 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.710 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:27.711 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.299084+0000", 2024-04-01T19:42:27.711 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2394e-05 2024-04-01T19:42:27.711 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.711 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.711 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:27.711 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.299093+0000", 2024-04-01T19:42:27.711 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.456e-06 2024-04-01T19:42:27.711 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.711 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.711 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:27.711 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.300444+0000", 2024-04-01T19:42:27.711 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0013516579999999999 2024-04-01T19:42:27.711 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.711 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.711 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:27.712 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.300461+0000", 2024-04-01T19:42:27.712 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6399999999999999e-05 2024-04-01T19:42:27.712 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.712 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.712 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:27.712 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.326836+0000", 2024-04-01T19:42:27.712 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.026375176 2024-04-01T19:42:27.712 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.712 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.712 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:27.712 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.326859+0000", 2024-04-01T19:42:27.712 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3232999999999999e-05 2024-04-01T19:42:27.712 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.712 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:27.713 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.713 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.713 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.713 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:230841 5.1 e420/364 5:8349c7ca:::benchmark_data_smithi188_119427_object66142:head v 420'14552, mlcod=420'14548)", 2024-04-01T19:42:27.713 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:01.303921+0000", 2024-04-01T19:42:27.713 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 26.345747361000001, 2024-04-01T19:42:27.713 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.022967376000000001, 2024-04-01T19:42:27.713 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:27.713 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:27.713 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:27.713 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:27.713 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.713 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:27.714 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.303921+0000", 2024-04-01T19:42:27.714 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.714 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.714 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.714 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:27.714 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.303921+0000", 2024-04-01T19:42:27.714 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.714 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.714 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.714 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:27.714 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.303923+0000", 2024-04-01T19:42:27.714 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2800000000000002e-06 2024-04-01T19:42:27.714 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.714 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.715 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:27.715 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.303937+0000", 2024-04-01T19:42:27.715 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3973e-05 2024-04-01T19:42:27.715 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.715 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.715 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:27.715 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.303956+0000", 2024-04-01T19:42:27.715 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8955000000000001e-05 2024-04-01T19:42:27.715 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.715 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.715 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:27.715 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.303965+0000", 2024-04-01T19:42:27.715 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8899999999999996e-06 2024-04-01T19:42:27.715 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.716 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.716 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:27.716 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.304575+0000", 2024-04-01T19:42:27.716 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00061005200000000003 2024-04-01T19:42:27.716 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.716 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.716 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:27.716 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.304597+0000", 2024-04-01T19:42:27.716 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1963e-05 2024-04-01T19:42:27.716 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.716 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.716 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:27.716 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.326861+0000", 2024-04-01T19:42:27.716 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.022264259000000002 2024-04-01T19:42:27.717 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.717 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.717 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:27.717 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.326888+0000", 2024-04-01T19:42:27.717 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.7004000000000001e-05 2024-04-01T19:42:27.717 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.717 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:27.717 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.717 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.717 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.717 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:231076 5.1 e420/364 5:853dfb2c:::benchmark_data_smithi188_119427_object66377:head v 420'14577, mlcod=420'14569)", 2024-04-01T19:42:27.717 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:01.498632+0000", 2024-04-01T19:42:27.717 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 26.151036607000002, 2024-04-01T19:42:27.717 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.021686672000000001, 2024-04-01T19:42:27.718 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:27.718 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:27.718 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:27.718 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:27.718 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.718 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:27.718 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.498632+0000", 2024-04-01T19:42:27.718 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.718 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.718 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.718 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:27.718 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.498632+0000", 2024-04-01T19:42:27.719 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.719 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.719 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.719 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:27.719 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.498633+0000", 2024-04-01T19:42:27.719 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5260000000000001e-06 2024-04-01T19:42:27.719 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.719 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.719 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:27.719 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.498642+0000", 2024-04-01T19:42:27.719 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.0559999999999994e-06 2024-04-01T19:42:27.719 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.719 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.720 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:27.720 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.498657+0000", 2024-04-01T19:42:27.720 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.431e-05 2024-04-01T19:42:27.720 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.720 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.720 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:27.720 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.498663+0000", 2024-04-01T19:42:27.720 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5390000000000004e-06 2024-04-01T19:42:27.720 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.720 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.720 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:27.720 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.504392+0000", 2024-04-01T19:42:27.720 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.005729357 2024-04-01T19:42:27.721 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.721 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.721 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:27.721 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.504411+0000", 2024-04-01T19:42:27.721 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8138000000000002e-05 2024-04-01T19:42:27.721 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.721 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.721 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:27.721 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.520278+0000", 2024-04-01T19:42:27.721 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.015867793000000002 2024-04-01T19:42:27.721 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.721 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.722 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:27.722 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.520318+0000", 2024-04-01T19:42:27.722 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9953000000000002e-05 2024-04-01T19:42:27.722 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.722 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:27.722 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.722 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.722 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.722 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:231288 5.1 e420/364 5:82774cfe:::benchmark_data_smithi188_119427_object66589:head v 420'14593, mlcod=420'14590)", 2024-04-01T19:42:27.722 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:01.662062+0000", 2024-04-01T19:42:27.722 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 25.987606356000001, 2024-04-01T19:42:27.722 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.024186912000000001, 2024-04-01T19:42:27.722 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:27.723 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:27.723 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:27.723 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:27.723 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.723 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:27.723 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.662062+0000", 2024-04-01T19:42:27.723 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.723 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.723 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.723 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:27.723 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.662062+0000", 2024-04-01T19:42:27.723 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.723 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.723 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.724 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:27.724 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.662062+0000", 2024-04-01T19:42:27.724 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.51e-07 2024-04-01T19:42:27.724 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.724 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.724 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:27.724 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.662067+0000", 2024-04-01T19:42:27.724 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7890000000000002e-06 2024-04-01T19:42:27.724 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.724 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.724 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:27.724 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.662074+0000", 2024-04-01T19:42:27.724 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5679999999999996e-06 2024-04-01T19:42:27.724 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.725 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.725 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:27.725 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.662079+0000", 2024-04-01T19:42:27.725 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3689999999999998e-06 2024-04-01T19:42:27.725 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.725 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.725 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:27.725 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.666608+0000", 2024-04-01T19:42:27.725 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.004528659 2024-04-01T19:42:27.725 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.725 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.725 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:27.725 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.666627+0000", 2024-04-01T19:42:27.725 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9062000000000001e-05 2024-04-01T19:42:27.726 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.726 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.726 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:27.726 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.686200+0000", 2024-04-01T19:42:27.726 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.019573604000000001 2024-04-01T19:42:27.726 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.726 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.726 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:27.726 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.686249+0000", 2024-04-01T19:42:27.726 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8310000000000003e-05 2024-04-01T19:42:27.726 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.726 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:27.726 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.727 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.727 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.727 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:231301 5.1 e420/364 5:8238fedc:::benchmark_data_smithi188_119427_object66602:head v 420'14596, mlcod=420'14590)", 2024-04-01T19:42:27.727 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:01.673652+0000", 2024-04-01T19:42:27.727 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 25.976015878999998, 2024-04-01T19:42:27.727 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.025589187999999999, 2024-04-01T19:42:27.727 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:27.727 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:27.727 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:27.727 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:27.727 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.727 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:27.727 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.673652+0000", 2024-04-01T19:42:27.728 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.728 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.728 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.728 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:27.728 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.673652+0000", 2024-04-01T19:42:27.728 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.728 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.728 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.728 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:27.728 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.673655+0000", 2024-04-01T19:42:27.728 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.954e-06 2024-04-01T19:42:27.728 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.728 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.729 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:27.729 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.673666+0000", 2024-04-01T19:42:27.729 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0857e-05 2024-04-01T19:42:27.729 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.729 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.729 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:27.729 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.673686+0000", 2024-04-01T19:42:27.729 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0245e-05 2024-04-01T19:42:27.729 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.729 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.729 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:27.729 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.673697+0000", 2024-04-01T19:42:27.729 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0338e-05 2024-04-01T19:42:27.729 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.730 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.730 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:27.730 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.681743+0000", 2024-04-01T19:42:27.730 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0080460410000000003 2024-04-01T19:42:27.730 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.730 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.730 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:27.730 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.681767+0000", 2024-04-01T19:42:27.730 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4216e-05 2024-04-01T19:42:27.730 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.730 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.730 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:27.730 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.699182+0000", 2024-04-01T19:42:27.730 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.017414919000000001 2024-04-01T19:42:27.731 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.731 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.731 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:27.731 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:01.699242+0000", 2024-04-01T19:42:27.731 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9617999999999997e-05 2024-04-01T19:42:27.731 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.731 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:27.731 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.731 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.731 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.731 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:232748 5.1 e420/364 5:8c5b2422:::benchmark_data_smithi188_119427_object68049:head v 420'14682, mlcod=420'14679)", 2024-04-01T19:42:27.731 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:02.997921+0000", 2024-04-01T19:42:27.731 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 24.651747262000001, 2024-04-01T19:42:27.732 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.025659919999999999, 2024-04-01T19:42:27.732 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:27.732 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:27.732 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:27.732 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:27.732 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.732 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:27.732 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:02.997921+0000", 2024-04-01T19:42:27.732 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.732 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.732 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.732 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:27.732 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:02.997921+0000", 2024-04-01T19:42:27.732 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.732 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.733 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.733 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:27.733 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:02.997922+0000", 2024-04-01T19:42:27.733 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9599999999999999e-07 2024-04-01T19:42:27.733 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.733 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.733 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:27.733 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:02.997927+0000", 2024-04-01T19:42:27.733 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.1549999999999998e-06 2024-04-01T19:42:27.733 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.733 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.733 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:27.733 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:02.997932+0000", 2024-04-01T19:42:27.733 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4060000000000004e-06 2024-04-01T19:42:27.733 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.734 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.734 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:27.734 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:02.997937+0000", 2024-04-01T19:42:27.734 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6999999999999999e-06 2024-04-01T19:42:27.734 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.734 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.734 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:27.734 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.002218+0000", 2024-04-01T19:42:27.734 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0042813030000000002 2024-04-01T19:42:27.734 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.734 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.734 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:27.734 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.002239+0000", 2024-04-01T19:42:27.735 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0567000000000001e-05 2024-04-01T19:42:27.735 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.735 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.735 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:27.735 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.023530+0000", 2024-04-01T19:42:27.735 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.021291171000000001 2024-04-01T19:42:27.735 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.735 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.735 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:27.735 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.023581+0000", 2024-04-01T19:42:27.735 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0921999999999998e-05 2024-04-01T19:42:27.735 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.735 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:27.735 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.735 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.736 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.736 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:232751 5.1 e420/364 5:8bd4333f:::benchmark_data_smithi188_119427_object68052:head v 420'14683, mlcod=420'14679)", 2024-04-01T19:42:27.736 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:02.999146+0000", 2024-04-01T19:42:27.736 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 24.650522616, 2024-04-01T19:42:27.736 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.024462501000000001, 2024-04-01T19:42:27.736 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:27.736 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:27.736 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:27.736 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:27.736 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.736 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:27.736 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:02.999146+0000", 2024-04-01T19:42:27.736 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.736 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.737 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.737 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:27.737 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:02.999146+0000", 2024-04-01T19:42:27.737 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.737 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.737 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.737 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:27.737 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:02.999147+0000", 2024-04-01T19:42:27.737 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3710000000000001e-06 2024-04-01T19:42:27.737 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.737 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.737 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:27.737 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:02.999155+0000", 2024-04-01T19:42:27.737 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.571e-06 2024-04-01T19:42:27.738 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.738 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.738 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:27.738 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:02.999165+0000", 2024-04-01T19:42:27.738 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.9469999999999998e-06 2024-04-01T19:42:27.738 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.738 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.738 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:27.738 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:02.999172+0000", 2024-04-01T19:42:27.738 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9689999999999994e-06 2024-04-01T19:42:27.738 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.738 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.738 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:27.739 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.006644+0000", 2024-04-01T19:42:27.739 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0074710469999999998 2024-04-01T19:42:27.739 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.739 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.739 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:27.739 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.006664+0000", 2024-04-01T19:42:27.739 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0908999999999999e-05 2024-04-01T19:42:27.739 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.739 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.739 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:27.739 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.023585+0000", 2024-04-01T19:42:27.739 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.016920398999999999 2024-04-01T19:42:27.739 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.739 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.739 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:27.740 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.023608+0000", 2024-04-01T19:42:27.740 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3288000000000001e-05 2024-04-01T19:42:27.740 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.740 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:27.740 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.740 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.740 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.740 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:232851 5.1 e420/364 5:80faf992:::benchmark_data_smithi188_119427_object68152:head v 420'14691, mlcod=420'14688)", 2024-04-01T19:42:27.740 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:03.091353+0000", 2024-04-01T19:42:27.740 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 24.558315099000001, 2024-04-01T19:42:27.740 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.030341165999999999, 2024-04-01T19:42:27.740 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:27.740 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:27.740 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:27.741 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:27.741 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.741 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:27.741 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.091353+0000", 2024-04-01T19:42:27.741 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.741 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.741 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.741 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:27.741 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.091353+0000", 2024-04-01T19:42:27.741 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.741 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.741 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.741 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:27.741 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.091354+0000", 2024-04-01T19:42:27.742 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2699999999999999e-07 2024-04-01T19:42:27.742 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.742 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.742 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:27.742 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.091360+0000", 2024-04-01T19:42:27.742 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7339999999999996e-06 2024-04-01T19:42:27.742 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.742 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.742 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:27.742 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.091369+0000", 2024-04-01T19:42:27.742 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.6269999999999995e-06 2024-04-01T19:42:27.742 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.742 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.743 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:27.743 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.091374+0000", 2024-04-01T19:42:27.743 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.1970000000000004e-06 2024-04-01T19:42:27.743 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.743 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.743 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:27.743 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.102441+0000", 2024-04-01T19:42:27.743 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.011066905 2024-04-01T19:42:27.743 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.743 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.743 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:27.743 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.102464+0000", 2024-04-01T19:42:27.743 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2637e-05 2024-04-01T19:42:27.743 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.744 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.744 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:27.744 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.121631+0000", 2024-04-01T19:42:27.744 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.019167301000000001 2024-04-01T19:42:27.744 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.744 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.744 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:27.744 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.121694+0000", 2024-04-01T19:42:27.744 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3038000000000002e-05 2024-04-01T19:42:27.744 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.744 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:27.744 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.744 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.744 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.744 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:232860 5.1 e420/364 5:81701680:::benchmark_data_smithi188_119427_object68161:head v 420'14692, mlcod=420'14689)", 2024-04-01T19:42:27.744 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:03.102304+0000", 2024-04-01T19:42:27.745 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 24.547363847, 2024-04-01T19:42:27.745 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.023492868, 2024-04-01T19:42:27.745 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:27.745 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:27.745 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:27.745 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:27.745 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.745 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:27.745 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.102304+0000", 2024-04-01T19:42:27.745 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.745 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.745 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.745 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:27.745 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.102304+0000", 2024-04-01T19:42:27.746 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.746 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.746 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.746 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:27.746 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.102306+0000", 2024-04-01T19:42:27.746 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7260000000000001e-06 2024-04-01T19:42:27.746 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.746 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.746 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:27.746 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.102315+0000", 2024-04-01T19:42:27.746 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.1870000000000003e-06 2024-04-01T19:42:27.746 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.746 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.747 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:27.747 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.102334+0000", 2024-04-01T19:42:27.747 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8292e-05 2024-04-01T19:42:27.747 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.747 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.747 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:27.747 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.102343+0000", 2024-04-01T19:42:27.747 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.7499999999999998e-06 2024-04-01T19:42:27.747 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.747 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.747 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:27.747 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.107586+0000", 2024-04-01T19:42:27.747 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0052431580000000004 2024-04-01T19:42:27.747 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.747 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.748 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:27.748 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.107609+0000", 2024-04-01T19:42:27.748 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2028e-05 2024-04-01T19:42:27.748 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.748 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.748 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:27.748 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.125733+0000", 2024-04-01T19:42:27.748 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.018124030999999999 2024-04-01T19:42:27.748 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.748 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.748 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:27.748 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.125797+0000", 2024-04-01T19:42:27.748 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4696000000000005e-05 2024-04-01T19:42:27.749 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.749 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:27.749 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.749 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.749 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.749 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:233533 5.1 e420/364 5:8c09be53:::benchmark_data_smithi188_119427_object68834:head v 420'14738, mlcod=420'14736)", 2024-04-01T19:42:27.749 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:03.684686+0000", 2024-04-01T19:42:27.749 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 23.964982122999999, 2024-04-01T19:42:27.749 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.023560948000000002, 2024-04-01T19:42:27.749 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:42:27.749 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:42:27.749 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:42:27.749 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:42:27.749 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.750 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:42:27.750 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.684686+0000", 2024-04-01T19:42:27.750 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.750 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.750 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.750 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:42:27.750 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.684686+0000", 2024-04-01T19:42:27.750 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:42:27.750 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.750 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.750 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:42:27.750 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.684689+0000", 2024-04-01T19:42:27.750 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.0290000000000001e-06 2024-04-01T19:42:27.750 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.751 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.751 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:42:27.751 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.684704+0000", 2024-04-01T19:42:27.751 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4572999999999999e-05 2024-04-01T19:42:27.751 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.751 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.751 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:42:27.751 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.684725+0000", 2024-04-01T19:42:27.751 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1535999999999998e-05 2024-04-01T19:42:27.751 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.751 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.751 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:42:27.751 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.684738+0000", 2024-04-01T19:42:27.751 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2921999999999999e-05 2024-04-01T19:42:27.752 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.752 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.752 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:42:27.752 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.687758+0000", 2024-04-01T19:42:27.752 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0030197380000000001 2024-04-01T19:42:27.752 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.752 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.752 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:42:27.752 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.687783+0000", 2024-04-01T19:42:27.752 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4706e-05 2024-04-01T19:42:27.752 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.752 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.752 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:42:27.752 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.708196+0000", 2024-04-01T19:42:27.752 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.020413244000000001 2024-04-01T19:42:27.753 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:42:27.753 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:42:27.753 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:42:27.753 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:03.708247+0000", 2024-04-01T19:42:27.753 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.1199999999999998e-05 2024-04-01T19:42:27.753 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.753 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:27.753 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.753 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:42:27.753 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:42:27.753 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:42:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:28 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3273359167' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:42:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:28 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:28 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:28 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:28 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:28 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:28.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:28 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3273359167' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:42:28.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:28 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:28.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:28 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:28.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:28 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:28.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:28 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:28.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:28 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:28.607 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:28 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3273359167' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:42:28.607 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:28 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:28.607 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:28 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:28.607 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:28 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:28.607 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:28 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:28.607 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:28 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:28.639 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_ops_in_flight 2024-04-01T19:42:28.682 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:42:28.826 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:42:28.834 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:28.835 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:42:28.925 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:42:28.935 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:42:28.965 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:29.220 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:29.220 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:29.220 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:29.221 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:29.221 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:29.221 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:29.221 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:29 smithi022 ceph-mon[39439]: pgmap v1195: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:29.245 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:42:29.246 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:42:29.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:29.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:29.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:29.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:29.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:29.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:29.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:29 smithi188 ceph-mon[43939]: pgmap v1195: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:29.395 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:29.395 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:29.395 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:29.395 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:29.395 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:29.395 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:29.395 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:29 smithi062 ceph-mon[44211]: pgmap v1195: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:29.815 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:42:29.818 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:29.819 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:42:29.920 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:42:29.950 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:30.050 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:42:30.053 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:30.054 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:42:30.155 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:42:30.183 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:30.352 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:42:30.381 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:42:30.384 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:30.385 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:42:30.486 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:42:30.518 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:30.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:30 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1761493911' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:42:30.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:30 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1761493911' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:42:30.657 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:42:30.657 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:42:30.657 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 0 2024-04-01T19:42:30.657 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:42:30.667 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:30 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1761493911' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:42:31.247 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:42:31.322 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_blocked_ops 2024-04-01T19:42:31.582 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:31 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:42:31.582 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:31 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1761493911' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:42:31.582 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:31 smithi022 ceph-mon[39439]: osdmap e427: 12 total, 11 up, 11 in 2024-04-01T19:42:31.583 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:31 smithi022 ceph-mon[39439]: pgmap v1197: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:31.597 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:42:31.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:31 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:42:31.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:31 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1761493911' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:42:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:31 smithi188 ceph-mon[43939]: osdmap e427: 12 total, 11 up, 11 in 2024-04-01T19:42:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:31 smithi188 ceph-mon[43939]: pgmap v1197: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:31.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:31 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:42:31.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:31 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1761493911' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:42:31.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:31 smithi062 ceph-mon[44211]: osdmap e427: 12 total, 11 up, 11 in 2024-04-01T19:42:31.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:31 smithi062 ceph-mon[44211]: pgmap v1197: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:32.068 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:42:32.071 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:32.072 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:42:32.093 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:42:32.173 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:42:32.202 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:32.350 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:42:32.353 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:32.353 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:42:32.366 INFO:teuthology.orchestra.run.smithi022.stderr:marked out osd.6. 2024-04-01T19:42:32.454 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:42:32.480 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:32 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:42:32.480 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:32 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:42:32.480 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:32 smithi062 ceph-mon[44211]: osdmap e428: 12 total, 11 up, 11 in 2024-04-01T19:42:32.481 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:32 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1803702374' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["6"]}]: dispatch 2024-04-01T19:42:32.481 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:32 smithi062 ceph-mon[44211]: Client client.admin marked osd.6 out, after it was down for 25 seconds 2024-04-01T19:42:32.483 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:32.503 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:42:32.505 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:32.506 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:42:32.607 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:42:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:32 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[39416]: 2024-04-01T19:42:32.296+0000 7fd025a9f700 -1 mon.a@0(leader).osd e428 definitely_dead 0 2024-04-01T19:42:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:32 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:42:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:32 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:42:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:32 smithi022 ceph-mon[39439]: osdmap e428: 12 total, 11 up, 11 in 2024-04-01T19:42:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:32 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1803702374' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["6"]}]: dispatch 2024-04-01T19:42:32.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:32 smithi022 ceph-mon[39439]: Client client.admin marked osd.6 out, after it was down for 25 seconds 2024-04-01T19:42:32.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:32 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:42:32.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:32 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:42:32.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:32 smithi188 ceph-mon[43939]: osdmap e428: 12 total, 11 up, 11 in 2024-04-01T19:42:32.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:32 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1803702374' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["6"]}]: dispatch 2024-04-01T19:42:32.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:32 smithi188 ceph-mon[43939]: Client client.admin marked osd.6 out, after it was down for 25 seconds 2024-04-01T19:42:32.638 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:32.660 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:42:32.662 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:32.663 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:42:32.763 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:42:32.791 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:32.913 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:42:32.916 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:32.917 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:42:33.018 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:42:33.049 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:33.070 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:42:33.072 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:33.073 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:42:33.174 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:42:33.206 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:33.471 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:42:33.471 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:42:33.471 INFO:teuthology.orchestra.run.smithi062.stdout: "complaint_time": 30, 2024-04-01T19:42:33.471 INFO:teuthology.orchestra.run.smithi062.stdout: "num_blocked_ops": 0 2024-04-01T19:42:33.472 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:42:33.499 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-01T19:42:33.499 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1803702374' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["6"]}]': finished 2024-04-01T19:42:33.499 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: osdmap e429: 12 total, 11 up, 10 in 2024-04-01T19:42:33.500 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {auth=33,config=2,health=12,kv=53} crc {auth=2881818701,config=3313370793,health=4101701959,kv=2510584654}) 2024-04-01T19:42:33.500 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {kv=9,logm=91} crc {kv=244012656,logm=2564826573}) 2024-04-01T19:42:33.500 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3440233407}) 2024-04-01T19:42:33.500 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=351333118}) 2024-04-01T19:42:33.500 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=727880213}) 2024-04-01T19:42:33.500 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3285883357}) 2024-04-01T19:42:33.500 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2648446571}) 2024-04-01T19:42:33.500 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3692035053}) 2024-04-01T19:42:33.500 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2490260342}) 2024-04-01T19:42:33.500 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1013728602}) 2024-04-01T19:42:33.500 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=669471808}) 2024-04-01T19:42:33.500 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=615629254}) 2024-04-01T19:42:33.500 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3095405536}) 2024-04-01T19:42:33.500 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4280688666}) 2024-04-01T19:42:33.501 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2149481851}) 2024-04-01T19:42:33.501 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3111650397}) 2024-04-01T19:42:33.501 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4164524030}) 2024-04-01T19:42:33.501 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1829180754}) 2024-04-01T19:42:33.501 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1023954072}) 2024-04-01T19:42:33.501 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=824956301}) 2024-04-01T19:42:33.501 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=254664860}) 2024-04-01T19:42:33.501 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2237309954}) 2024-04-01T19:42:33.501 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1621609339}) 2024-04-01T19:42:33.501 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=23614284}) 2024-04-01T19:42:33.501 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3701476480}) 2024-04-01T19:42:33.501 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2581943311}) 2024-04-01T19:42:33.501 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1615176258}) 2024-04-01T19:42:33.501 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4275415908}) 2024-04-01T19:42:33.502 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=103861979}) 2024-04-01T19:42:33.502 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2654226772}) 2024-04-01T19:42:33.502 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4156160911}) 2024-04-01T19:42:33.502 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3868202875}) 2024-04-01T19:42:33.502 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3295377817}) 2024-04-01T19:42:33.502 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=217755264}) 2024-04-01T19:42:33.502 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3004485607}) 2024-04-01T19:42:33.502 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3863668910}) 2024-04-01T19:42:33.502 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3866735118}) 2024-04-01T19:42:33.502 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=891616496}) 2024-04-01T19:42:33.502 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1261390459}) 2024-04-01T19:42:33.502 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1221796453}) 2024-04-01T19:42:33.502 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2916142698}) 2024-04-01T19:42:33.503 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1772888743}) 2024-04-01T19:42:33.503 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=194435211}) 2024-04-01T19:42:33.503 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3836794773}) 2024-04-01T19:42:33.503 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1585015394}) 2024-04-01T19:42:33.503 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=787391839}) 2024-04-01T19:42:33.503 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2774203316}) 2024-04-01T19:42:33.503 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1251393486}) 2024-04-01T19:42:33.503 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4029142624}) 2024-04-01T19:42:33.503 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2960033035}) 2024-04-01T19:42:33.503 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=303123179}) 2024-04-01T19:42:33.503 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=734390103}) 2024-04-01T19:42:33.503 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1485436444}) 2024-04-01T19:42:33.503 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3027207616}) 2024-04-01T19:42:33.503 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2363319648}) 2024-04-01T19:42:33.504 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1951349550}) 2024-04-01T19:42:33.504 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1928437015}) 2024-04-01T19:42:33.504 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=76,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=2} crc {logm=3416535985,mdsmap=2840952586,mgr=1734247563,mgr_command_descs=4048473490,mgr_metadata=3075114321}) 2024-04-01T19:42:33.504 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=14,mon_config_key=86} crc {mgrstat=1332064622,mon_config_key=1480335847}) 2024-04-01T19:42:33.504 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=2208242845}) 2024-04-01T19:42:33.504 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=883201369}) 2024-04-01T19:42:33.504 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {monmap=5,osd_metadata=12,osd_pg_creating=1,osdmap=82} crc {monmap=3338646291,osd_metadata=2996393829,osd_pg_creating=2576437573,osdmap=153745361}) 2024-04-01T19:42:33.504 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=39} crc {osdmap=1419505330}) 2024-04-01T19:42:33.504 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:33 smithi062 ceph-mon[44211]: pgmap v1200: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:33.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-01T19:42:33.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1803702374' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["6"]}]': finished 2024-04-01T19:42:33.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: osdmap e429: 12 total, 11 up, 10 in 2024-04-01T19:42:33.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {auth=33,config=2,health=12,kv=53} crc {auth=2881818701,config=3313370793,health=4101701959,kv=2510584654}) 2024-04-01T19:42:33.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {kv=9,logm=91} crc {kv=244012656,logm=2564826573}) 2024-04-01T19:42:33.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3440233407}) 2024-04-01T19:42:33.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=351333118}) 2024-04-01T19:42:33.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=727880213}) 2024-04-01T19:42:33.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3285883357}) 2024-04-01T19:42:33.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2648446571}) 2024-04-01T19:42:33.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3692035053}) 2024-04-01T19:42:33.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2490260342}) 2024-04-01T19:42:33.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1013728602}) 2024-04-01T19:42:33.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=669471808}) 2024-04-01T19:42:33.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=615629254}) 2024-04-01T19:42:33.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3095405536}) 2024-04-01T19:42:33.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4280688666}) 2024-04-01T19:42:33.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2149481851}) 2024-04-01T19:42:33.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3111650397}) 2024-04-01T19:42:33.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4164524030}) 2024-04-01T19:42:33.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1829180754}) 2024-04-01T19:42:33.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1023954072}) 2024-04-01T19:42:33.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=824956301}) 2024-04-01T19:42:33.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=254664860}) 2024-04-01T19:42:33.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2237309954}) 2024-04-01T19:42:33.564 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1621609339}) 2024-04-01T19:42:33.564 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=23614284}) 2024-04-01T19:42:33.564 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3701476480}) 2024-04-01T19:42:33.564 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2581943311}) 2024-04-01T19:42:33.564 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1615176258}) 2024-04-01T19:42:33.564 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4275415908}) 2024-04-01T19:42:33.564 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=103861979}) 2024-04-01T19:42:33.564 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2654226772}) 2024-04-01T19:42:33.564 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4156160911}) 2024-04-01T19:42:33.564 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3868202875}) 2024-04-01T19:42:33.564 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3295377817}) 2024-04-01T19:42:33.564 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=217755264}) 2024-04-01T19:42:33.564 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3004485607}) 2024-04-01T19:42:33.564 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3863668910}) 2024-04-01T19:42:33.564 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3866735118}) 2024-04-01T19:42:33.564 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=891616496}) 2024-04-01T19:42:33.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1261390459}) 2024-04-01T19:42:33.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1221796453}) 2024-04-01T19:42:33.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2916142698}) 2024-04-01T19:42:33.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1772888743}) 2024-04-01T19:42:33.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=194435211}) 2024-04-01T19:42:33.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3836794773}) 2024-04-01T19:42:33.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1585015394}) 2024-04-01T19:42:33.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=787391839}) 2024-04-01T19:42:33.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2774203316}) 2024-04-01T19:42:33.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1251393486}) 2024-04-01T19:42:33.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4029142624}) 2024-04-01T19:42:33.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2960033035}) 2024-04-01T19:42:33.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=303123179}) 2024-04-01T19:42:33.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=734390103}) 2024-04-01T19:42:33.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1485436444}) 2024-04-01T19:42:33.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3027207616}) 2024-04-01T19:42:33.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2363319648}) 2024-04-01T19:42:33.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1951349550}) 2024-04-01T19:42:33.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1928437015}) 2024-04-01T19:42:33.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=76,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=2} crc {logm=3416535985,mdsmap=2840952586,mgr=1734247563,mgr_command_descs=4048473490,mgr_metadata=3075114321}) 2024-04-01T19:42:33.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=14,mon_config_key=86} crc {mgrstat=1332064622,mon_config_key=1480335847}) 2024-04-01T19:42:33.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=2208242845}) 2024-04-01T19:42:33.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=883201369}) 2024-04-01T19:42:33.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {monmap=5,osd_metadata=12,osd_pg_creating=1,osdmap=82} crc {monmap=3338646291,osd_metadata=2996393829,osd_pg_creating=2576437573,osdmap=153745361}) 2024-04-01T19:42:33.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=39} crc {osdmap=1419505330}) 2024-04-01T19:42:33.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:33 smithi022 ceph-mon[39439]: pgmap v1200: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:33.587 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.6 2024-04-01T19:42:33.587 INFO:tasks.thrashosds.thrasher:remote for osd 6 is ubuntu@smithi062.front.sepia.ceph.com 2024-04-01T19:42:33.587 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -n osd.6 --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-6 --journal-path /var/lib/ceph/osd/ceph-6/journal --op list-pgs 2024-04-01T19:42:33.616 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:42:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-01T19:42:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1803702374' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["6"]}]': finished 2024-04-01T19:42:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: osdmap e429: 12 total, 11 up, 10 in 2024-04-01T19:42:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {auth=33,config=2,health=12,kv=53} crc {auth=2881818701,config=3313370793,health=4101701959,kv=2510584654}) 2024-04-01T19:42:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {kv=9,logm=91} crc {kv=244012656,logm=2564826573}) 2024-04-01T19:42:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3440233407}) 2024-04-01T19:42:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=351333118}) 2024-04-01T19:42:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=727880213}) 2024-04-01T19:42:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3285883357}) 2024-04-01T19:42:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2648446571}) 2024-04-01T19:42:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3692035053}) 2024-04-01T19:42:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2490260342}) 2024-04-01T19:42:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1013728602}) 2024-04-01T19:42:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=669471808}) 2024-04-01T19:42:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=615629254}) 2024-04-01T19:42:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3095405536}) 2024-04-01T19:42:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4280688666}) 2024-04-01T19:42:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2149481851}) 2024-04-01T19:42:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3111650397}) 2024-04-01T19:42:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4164524030}) 2024-04-01T19:42:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1829180754}) 2024-04-01T19:42:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1023954072}) 2024-04-01T19:42:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=824956301}) 2024-04-01T19:42:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=254664860}) 2024-04-01T19:42:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2237309954}) 2024-04-01T19:42:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1621609339}) 2024-04-01T19:42:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=23614284}) 2024-04-01T19:42:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3701476480}) 2024-04-01T19:42:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2581943311}) 2024-04-01T19:42:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1615176258}) 2024-04-01T19:42:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4275415908}) 2024-04-01T19:42:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=103861979}) 2024-04-01T19:42:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2654226772}) 2024-04-01T19:42:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4156160911}) 2024-04-01T19:42:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3868202875}) 2024-04-01T19:42:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3295377817}) 2024-04-01T19:42:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=217755264}) 2024-04-01T19:42:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3004485607}) 2024-04-01T19:42:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3863668910}) 2024-04-01T19:42:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3866735118}) 2024-04-01T19:42:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=891616496}) 2024-04-01T19:42:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1261390459}) 2024-04-01T19:42:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1221796453}) 2024-04-01T19:42:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2916142698}) 2024-04-01T19:42:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1772888743}) 2024-04-01T19:42:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=194435211}) 2024-04-01T19:42:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3836794773}) 2024-04-01T19:42:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1585015394}) 2024-04-01T19:42:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=787391839}) 2024-04-01T19:42:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2774203316}) 2024-04-01T19:42:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1251393486}) 2024-04-01T19:42:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4029142624}) 2024-04-01T19:42:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2960033035}) 2024-04-01T19:42:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=303123179}) 2024-04-01T19:42:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=734390103}) 2024-04-01T19:42:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1485436444}) 2024-04-01T19:42:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3027207616}) 2024-04-01T19:42:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2363319648}) 2024-04-01T19:42:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1951349550}) 2024-04-01T19:42:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1928437015}) 2024-04-01T19:42:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=76,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=2} crc {logm=3416535985,mdsmap=2840952586,mgr=1734247563,mgr_command_descs=4048473490,mgr_metadata=3075114321}) 2024-04-01T19:42:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mgrstat=14,mon_config_key=86} crc {mgrstat=1332064622,mon_config_key=1480335847}) 2024-04-01T19:42:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=2208242845}) 2024-04-01T19:42:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=883201369}) 2024-04-01T19:42:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {monmap=5,osd_metadata=12,osd_pg_creating=1,osdmap=82} crc {monmap=3338646291,osd_metadata=2996393829,osd_pg_creating=2576437573,osdmap=153745361}) 2024-04-01T19:42:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=39} crc {osdmap=1419505330}) 2024-04-01T19:42:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:33 smithi188 ceph-mon[43939]: pgmap v1200: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 17387/184582 objects degraded (9.420%) 2024-04-01T19:42:33.858 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/osd.6/config 2024-04-01T19:42:34.056 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:42:34.059 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:34.059 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:42:34.085 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:42:34.160 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:42:34.191 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:34.212 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_historic_ops 2024-04-01T19:42:34.213 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:42:34.214 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:34.215 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:42:34.316 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:42:34.346 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:34.434 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:34 smithi062 ceph-mon[44211]: osdmap e430: 12 total, 11 up, 10 in 2024-04-01T19:42:34.595 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:42:34.598 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:34 smithi022 ceph-mon[39439]: osdmap e430: 12 total, 11 up, 10 in 2024-04-01T19:42:34.598 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:34.599 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:42:34.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:34 smithi188 ceph-mon[43939]: osdmap e430: 12 total, 11 up, 10 in 2024-04-01T19:42:34.699 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:42:34.734 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:34.747 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:42:34.769 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:42:34.790 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:42:34.810 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:42:34.834 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:42:34.835 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:42:34.836 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:34.837 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:42:34.863 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:42:34.895 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:42:34.918 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:42:34.938 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:42:34.944 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:42:34.969 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:42:34.970 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:34.993 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:42:34.993 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:42:34.993 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:42:34.993 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:42:34.993 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:42:34.993 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:42:34.993 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:42:34.993 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:42:34.993 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:42:34.993 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:42:34.993 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:42:34.994 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:42:34.994 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:42:35.005 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:42:35.008 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:35.009 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:42:35.110 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:42:35.138 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:35.159 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:42:35.161 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:35.162 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:42:35.263 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:42:35.293 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:35.494 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:42:35.497 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:35.497 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:42:35.526 INFO:teuthology.orchestra.run.smithi062.stderr:Creating an OSD daemon form without an OSD FSID value 2024-04-01T19:42:35.536 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:42:35.599 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:42:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:35 smithi188 ceph-mon[43939]: osdmap e431: 12 total, 11 up, 10 in 2024-04-01T19:42:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:35 smithi188 ceph-mon[43939]: 5.9 starting backfill to osd.11 from (0'0,0'0] MAX to 421'14803 2024-04-01T19:42:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:35 smithi188 ceph-mon[43939]: 5.3 starting backfill to osd.5 from (0'0,0'0] MAX to 421'14847 2024-04-01T19:42:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:35 smithi188 ceph-mon[43939]: 5.2 starting backfill to osd.10 from (0'0,0'0] MAX to 421'14879 2024-04-01T19:42:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:35 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1518365421' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:42:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:35.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:35.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:35.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:35 smithi188 ceph-mon[43939]: pgmap v1203: 17 pgs: 1 peering, 2 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 11504/184582 objects degraded (6.232%) 2024-04-01T19:42:35.627 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:35.647 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:42:35.650 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:35.650 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:42:35.711 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:35 smithi022 ceph-mon[39439]: osdmap e431: 12 total, 11 up, 10 in 2024-04-01T19:42:35.711 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:35 smithi022 ceph-mon[39439]: 5.9 starting backfill to osd.11 from (0'0,0'0] MAX to 421'14803 2024-04-01T19:42:35.711 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:35 smithi022 ceph-mon[39439]: 5.3 starting backfill to osd.5 from (0'0,0'0] MAX to 421'14847 2024-04-01T19:42:35.711 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:35 smithi022 ceph-mon[39439]: 5.2 starting backfill to osd.10 from (0'0,0'0] MAX to 421'14879 2024-04-01T19:42:35.711 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:35 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1518365421' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:42:35.712 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:35.712 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:35.712 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:35.712 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:35.712 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:35.712 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:35.712 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:35 smithi022 ceph-mon[39439]: pgmap v1203: 17 pgs: 1 peering, 2 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 11504/184582 objects degraded (6.232%) 2024-04-01T19:42:35.751 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:42:35.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:35 smithi062 ceph-mon[44211]: osdmap e431: 12 total, 11 up, 10 in 2024-04-01T19:42:35.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:35 smithi062 ceph-mon[44211]: 5.9 starting backfill to osd.11 from (0'0,0'0] MAX to 421'14803 2024-04-01T19:42:35.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:35 smithi062 ceph-mon[44211]: 5.3 starting backfill to osd.5 from (0'0,0'0] MAX to 421'14847 2024-04-01T19:42:35.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:35 smithi062 ceph-mon[44211]: 5.2 starting backfill to osd.10 from (0'0,0'0] MAX to 421'14879 2024-04-01T19:42:35.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:35 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1518365421' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:42:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:35 smithi062 ceph-mon[44211]: pgmap v1203: 17 pgs: 1 peering, 2 undersized+degraded+peered, 14 active+clean; 5.6 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 11504/184582 objects degraded (6.232%) 2024-04-01T19:42:35.783 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:35.807 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:42:35.810 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:35.811 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:42:35.912 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:42:35.946 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:36.073 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:42:36.077 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:36.077 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:42:36.179 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:42:36.194 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:42:36.194 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:42:36.211 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:36.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:36 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:36.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:36 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:36.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:36 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:36.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:36 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:36.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:36 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:36.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:36 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 11504/184582 objects degraded (6.232%), 2 pgs degraded (PG_DEGRADED) 2024-04-01T19:42:36.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:36 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:36.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:36 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:36.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:36 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:36.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:36 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:36.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:36 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:36.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:36 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 11504/184582 objects degraded (6.232%), 2 pgs degraded (PG_DEGRADED) 2024-04-01T19:42:36.764 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:42:36.767 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:36.767 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:42:36.868 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:42:36.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:36 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:36.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:36 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:36.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:36 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:36.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:36 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:36.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:36 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:36.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:36 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 11504/184582 objects degraded (6.232%), 2 pgs degraded (PG_DEGRADED) 2024-04-01T19:42:36.901 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:36.959 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:42:36.963 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:36.964 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:42:37.065 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:42:37.092 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:37.112 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:42:37.115 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:37.115 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:42:37.216 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:42:37.250 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:37.355 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:42:37.357 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:37.358 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:42:37.459 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:42:37.470 INFO:teuthology.orchestra.run.smithi062.stdout:5.9 2024-04-01T19:42:37.470 INFO:teuthology.orchestra.run.smithi062.stdout:5.2 2024-04-01T19:42:37.470 INFO:teuthology.orchestra.run.smithi062.stdout:5.3 2024-04-01T19:42:37.491 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:37.514 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:42:37.517 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:37.518 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:42:37.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:37 smithi022 ceph-mon[39439]: pgmap v1204: 17 pgs: 1 peering, 2 undersized+degraded+remapped+backfilling+peered, 14 active+clean; 5.6 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 10208/184582 objects degraded (5.530%); 14 MiB/s, 228 objects/s recovering 2024-04-01T19:42:37.618 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:42:37.650 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:37.651 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:37 smithi062 ceph-mon[44211]: pgmap v1204: 17 pgs: 1 peering, 2 undersized+degraded+remapped+backfilling+peered, 14 active+clean; 5.6 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 10208/184582 objects degraded (5.530%); 14 MiB/s, 228 objects/s recovering 2024-04-01T19:42:37.676 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:42:37.680 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:37.680 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:42:37.781 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:42:37.812 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:37.833 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:42:37.836 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:37.836 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:42:37.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:37 smithi188 ceph-mon[43939]: pgmap v1204: 17 pgs: 1 peering, 2 undersized+degraded+remapped+backfilling+peered, 14 active+clean; 5.6 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 10208/184582 objects degraded (5.530%); 14 MiB/s, 228 objects/s recovering 2024-04-01T19:42:37.937 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:42:37.968 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:37.976 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:42:37.976 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:42:37.990 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:42:37.992 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:37.993 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:42:38.094 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:42:38.122 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:38.142 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:42:38.144 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:38.144 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:42:38.195 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:42:38.245 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:42:38.276 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:38.299 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:42:38.301 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:38.302 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:42:38.398 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:42:38.403 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:42:38.439 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:38.481 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:42:38.484 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:38.484 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:42:38.585 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:42:38.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:38 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1165100758' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:42:38.613 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:38.634 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:42:38.636 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:38.637 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:42:38.738 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:42:38.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:38 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1165100758' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:42:38.771 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:38.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:38 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1165100758' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:42:39.026 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_ops_in_flight 2024-04-01T19:42:39.224 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:42:39.228 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:39.228 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:42:39.265 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:42:39.330 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:42:39.362 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:39.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:39 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:42:39.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:39 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1165100758' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:42:39.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:39 smithi022 ceph-mon[39439]: osdmap e432: 12 total, 11 up, 10 in 2024-04-01T19:42:39.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:39 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:42:39.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:39 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:42:39.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:39 smithi022 ceph-mon[39439]: pgmap v1206: 17 pgs: 3 undersized+degraded+remapped+backfilling+peered, 14 active+clean; 5.6 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 14167/184582 objects degraded (7.675%); 34 MiB/s, 537 objects/s recovering 2024-04-01T19:42:39.669 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:39 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:42:39.669 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:39 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1165100758' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:42:39.669 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:39 smithi062 ceph-mon[44211]: osdmap e432: 12 total, 11 up, 10 in 2024-04-01T19:42:39.669 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:39 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:42:39.669 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:39 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:42:39.670 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:39 smithi062 ceph-mon[44211]: pgmap v1206: 17 pgs: 3 undersized+degraded+remapped+backfilling+peered, 14 active+clean; 5.6 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 14167/184582 objects degraded (7.675%); 34 MiB/s, 537 objects/s recovering 2024-04-01T19:42:39.671 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -n osd.6 --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-6 --journal-path /var/lib/ceph/osd/ceph-6/journal --op export --pgid 5.2 --file /var/log/ceph/exp.5.2.6 2024-04-01T19:42:39.714 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:42:39.717 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:39.717 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:42:39.787 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:42:39.818 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:42:39.844 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:39 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:42:39.844 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:39 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1165100758' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:42:39.845 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:39 smithi188 ceph-mon[43939]: osdmap e432: 12 total, 11 up, 10 in 2024-04-01T19:42:39.845 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:39 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:42:39.845 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:39 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:42:39.845 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:39 smithi188 ceph-mon[43939]: pgmap v1206: 17 pgs: 3 undersized+degraded+remapped+backfilling+peered, 14 active+clean; 5.6 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 14167/184582 objects degraded (7.675%); 34 MiB/s, 537 objects/s recovering 2024-04-01T19:42:39.846 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:39.867 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:42:39.869 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:39.870 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:42:39.970 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:42:40.002 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:40.354 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:42:40.355 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:40.356 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:42:40.364 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/osd.6/config 2024-04-01T19:42:40.456 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:42:40.484 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:40.505 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:42:40.507 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:40.507 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:42:40.550 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:40 smithi062 ceph-mon[44211]: osdmap e433: 12 total, 11 up, 10 in 2024-04-01T19:42:40.608 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:42:40.639 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:40.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:40 smithi022 ceph-mon[39439]: osdmap e433: 12 total, 11 up, 10 in 2024-04-01T19:42:40.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:40 smithi188 ceph-mon[43939]: osdmap e433: 12 total, 11 up, 10 in 2024-04-01T19:42:40.989 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:42:40.995 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:40.996 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:42:41.096 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:42:41.124 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:41.145 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:42:41.148 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:41.148 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:42:41.249 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:42:41.251 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:42:41.276 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:41.297 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:42:41.300 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:41.300 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:42:41.401 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:42:41.435 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:41.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:41 smithi062 ceph-mon[44211]: pgmap v1208: 17 pgs: 3 undersized+degraded+remapped+backfilling+peered, 14 active+clean; 5.6 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 6669/184582 objects degraded (3.613%); 101 MiB/s, 1.61k objects/s recovering 2024-04-01T19:42:41.536 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:42:41.538 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:41.539 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:42:41.559 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:42:41.594 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:42:41.599 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:42:41.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:41 smithi022 ceph-mon[39439]: pgmap v1208: 17 pgs: 3 undersized+degraded+remapped+backfilling+peered, 14 active+clean; 5.6 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 6669/184582 objects degraded (3.613%); 101 MiB/s, 1.61k objects/s recovering 2024-04-01T19:42:41.626 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:42:41.639 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:42:41.659 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:42:41.671 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:41.681 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:42:41.707 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:42:41.735 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:42:41.761 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:42:41.789 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:42:41.816 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:42:41.850 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:42:41.850 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:42:41.851 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:42:41.851 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:42:41.851 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:42:41.851 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:42:41.851 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:42:41.851 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:42:41.851 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:42:41.851 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:42:41.851 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:42:41.851 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:42:41.851 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:42:41.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:41 smithi188 ceph-mon[43939]: pgmap v1208: 17 pgs: 3 undersized+degraded+remapped+backfilling+peered, 14 active+clean; 5.6 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 6669/184582 objects degraded (3.613%); 101 MiB/s, 1.61k objects/s recovering 2024-04-01T19:42:42.023 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:42:42.028 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:42.028 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:42:42.129 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:42:42.159 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:42.183 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:42:42.186 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:42.186 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:42:42.287 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:42:42.315 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:42.335 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:42:42.337 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:42.338 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:42:42.439 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:42:42.465 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:42.484 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:42:42.487 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:42.487 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:42:42.588 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:42:42.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:42 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 6669/184582 objects degraded (3.613%), 3 pgs degraded (PG_DEGRADED) 2024-04-01T19:42:42.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:42 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3223736805' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:42:42.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:42.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:42.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:42.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:42.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:42.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:42.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:42 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:42:42.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:42.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:42.614 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:42.633 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:42:42.636 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:42.636 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:42:42.707 INFO:teuthology.orchestra.run.smithi062.stderr:Creating an OSD daemon form without an OSD FSID value 2024-04-01T19:42:42.737 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:42:42.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:42 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 6669/184582 objects degraded (3.613%), 3 pgs degraded (PG_DEGRADED) 2024-04-01T19:42:42.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:42 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3223736805' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:42:42.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:42.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:42.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:42.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:42.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:42.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:42.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:42 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:42:42.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:42.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:42.767 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:42.788 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:42:42.793 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:42.793 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:42:42.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:42 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 6669/184582 objects degraded (3.613%), 3 pgs degraded (PG_DEGRADED) 2024-04-01T19:42:42.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:42 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3223736805' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:42:42.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:42.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:42.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:42.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:42.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:42.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:42.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:42 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:42:42.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:42.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:42.894 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:42:42.921 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:42.940 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:42:42.943 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:42.943 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:42:43.044 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:42:43.078 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:43.105 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:42:43.106 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:42:43.414 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:42:43.414 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:42:43.415 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 0 2024-04-01T19:42:43.415 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:42:43.528 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:42:43.531 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:43.531 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:42:43.632 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:42:43.659 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:43.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:43.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:43.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:43.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:43 smithi062 ceph-mon[44211]: osdmap e434: 12 total, 11 up, 10 in 2024-04-01T19:42:43.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:43 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:42:43.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:43 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:42:43.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:43 smithi062 ceph-mon[44211]: pgmap v1210: 17 pgs: 3 undersized+degraded+remapped+backfilling+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 880 GiB / 894 GiB avail; 6669/184582 objects degraded (3.613%); 98 MiB/s, 1.57k objects/s recovering 2024-04-01T19:42:43.826 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:43.826 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:43.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:43.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:43 smithi022 ceph-mon[39439]: osdmap e434: 12 total, 11 up, 10 in 2024-04-01T19:42:43.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:43 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:42:43.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:43 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:42:43.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:43 smithi022 ceph-mon[39439]: pgmap v1210: 17 pgs: 3 undersized+degraded+remapped+backfilling+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 880 GiB / 894 GiB avail; 6669/184582 objects degraded (3.613%); 98 MiB/s, 1.57k objects/s recovering 2024-04-01T19:42:43.858 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:42:43.861 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:43.861 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:42:43.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:43.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:43.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:43.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:43 smithi188 ceph-mon[43939]: osdmap e434: 12 total, 11 up, 10 in 2024-04-01T19:42:43.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:43 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:42:43.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:43 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:42:43.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:43 smithi188 ceph-mon[43939]: pgmap v1210: 17 pgs: 3 undersized+degraded+remapped+backfilling+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 880 GiB / 894 GiB avail; 6669/184582 objects degraded (3.613%); 98 MiB/s, 1.57k objects/s recovering 2024-04-01T19:42:43.962 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:42:43.988 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:44.007 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:42:44.010 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:44.010 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:42:44.080 INFO:teuthology.orchestra.run.smithi062.stderr:Exporting 5.2 info 5.2( v 421'14879 (381'4800,421'14879] local-lis/les=364/365 n=5767 ec=364/364 lis/c=364/364 les/c/f=365/365/0 sis=364) 2024-04-01T19:42:44.111 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:42:44.149 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:44.150 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40000bf4:::benchmark_data_smithi188_119427_object134090:head# 2024-04-01T19:42:44.150 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40009d9e:::benchmark_data_smithi188_119427_object113115:head# 2024-04-01T19:42:44.151 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4000f269:::benchmark_data_smithi188_119427_object106758:head# 2024-04-01T19:42:44.151 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4001477a:::benchmark_data_smithi188_119427_object134958:head# 2024-04-01T19:42:44.151 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:400237f4:::benchmark_data_smithi188_119427_object113763:head# 2024-04-01T19:42:44.152 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40039fae:::benchmark_data_smithi188_119427_object119685:head# 2024-04-01T19:42:44.152 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40041153:::benchmark_data_smithi188_119427_object94245:head# 2024-04-01T19:42:44.153 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4004b467:::benchmark_data_smithi188_119427_object88250:head# 2024-04-01T19:42:44.153 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40051804:::benchmark_data_smithi188_119427_object93824:head# 2024-04-01T19:42:44.154 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40057915:::benchmark_data_smithi188_119427_object93910:head# 2024-04-01T19:42:44.154 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4005be01:::benchmark_data_smithi188_119427_object103970:head# 2024-04-01T19:42:44.154 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40072648:::benchmark_data_smithi188_119427_object107378:head# 2024-04-01T19:42:44.155 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:400798f9:::benchmark_data_smithi188_119427_object95168:head# 2024-04-01T19:42:44.155 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40086103:::benchmark_data_smithi188_119427_object76769:head# 2024-04-01T19:42:44.156 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:400917e0:::benchmark_data_smithi188_119427_object92459:head# 2024-04-01T19:42:44.156 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40095b7b:::benchmark_data_smithi188_119427_object88110:head# 2024-04-01T19:42:44.157 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:400a7040:::benchmark_data_smithi188_119427_object101623:head# 2024-04-01T19:42:44.157 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:400b2a1c:::benchmark_data_smithi188_119427_object118608:head# 2024-04-01T19:42:44.158 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:400b4d10:::benchmark_data_smithi188_119427_object163737:head# 2024-04-01T19:42:44.158 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:400ce235:::benchmark_data_smithi188_119427_object137290:head# 2024-04-01T19:42:44.159 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:400d029e:::benchmark_data_smithi188_119427_object87397:head# 2024-04-01T19:42:44.159 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:400d9f1d:::benchmark_data_smithi188_119427_object98882:head# 2024-04-01T19:42:44.159 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:400dde81:::benchmark_data_smithi188_119427_object94373:head# 2024-04-01T19:42:44.160 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:400e1415:::benchmark_data_smithi188_119427_object91523:head# 2024-04-01T19:42:44.160 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:400e2779:::benchmark_data_smithi188_119427_object153173:head# 2024-04-01T19:42:44.160 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:400e3ddf:::benchmark_data_smithi188_119427_object87526:head# 2024-04-01T19:42:44.161 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:400eadd9:::benchmark_data_smithi188_119427_object118025:head# 2024-04-01T19:42:44.162 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:400f387c:::benchmark_data_smithi188_119427_object77278:head# 2024-04-01T19:42:44.162 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4011177c:::benchmark_data_smithi188_119427_object151776:head# 2024-04-01T19:42:44.162 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40111fb6:::benchmark_data_smithi188_119427_object133224:head# 2024-04-01T19:42:44.163 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:401269d9:::benchmark_data_smithi188_119427_object73343:head# 2024-04-01T19:42:44.163 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40133b8a:::benchmark_data_smithi188_119427_object78244:head# 2024-04-01T19:42:44.164 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4014696a:::benchmark_data_smithi188_119427_object87001:head# 2024-04-01T19:42:44.164 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40155994:::benchmark_data_smithi188_119427_object143854:head# 2024-04-01T19:42:44.165 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40162b70:::benchmark_data_smithi188_119427_object141478:head# 2024-04-01T19:42:44.165 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4016b9f7:::benchmark_data_smithi188_119427_object99245:head# 2024-04-01T19:42:44.166 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40180d14:::benchmark_data_smithi188_119427_object145630:head# 2024-04-01T19:42:44.166 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40188b6d:::benchmark_data_smithi188_119427_object144387:head# 2024-04-01T19:42:44.167 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40199e50:::benchmark_data_smithi188_119427_object111265:head# 2024-04-01T19:42:44.167 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:401b2dbd:::benchmark_data_smithi188_119427_object156375:head# 2024-04-01T19:42:44.168 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:401b8a02:::benchmark_data_smithi188_119427_object121064:head# 2024-04-01T19:42:44.168 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:401bb17a:::benchmark_data_smithi188_119427_object102025:head# 2024-04-01T19:42:44.169 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:401c3ba2:::benchmark_data_smithi188_119427_object100367:head# 2024-04-01T19:42:44.169 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:401c5fab:::benchmark_data_smithi188_119427_object115173:head# 2024-04-01T19:42:44.169 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:401ce2ff:::benchmark_data_smithi188_119427_object122367:head# 2024-04-01T19:42:44.170 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:401d465b:::benchmark_data_smithi188_119427_object98870:head# 2024-04-01T19:42:44.171 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:401d5915:::benchmark_data_smithi188_119427_object77044:head# 2024-04-01T19:42:44.171 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:401d898c:::benchmark_data_smithi188_119427_object120693:head# 2024-04-01T19:42:44.171 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:401e601d:::benchmark_data_smithi188_119427_object90542:head# 2024-04-01T19:42:44.172 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:401f4c35:::benchmark_data_smithi188_119427_object125343:head# 2024-04-01T19:42:44.172 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:401f4d04:::benchmark_data_smithi188_119427_object78651:head# 2024-04-01T19:42:44.172 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:42:44.173 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:401f9836:::benchmark_data_smithi188_119427_object137595:head# 2024-04-01T19:42:44.173 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:402050ab:::benchmark_data_smithi188_119427_object104007:head# 2024-04-01T19:42:44.173 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40234dea:::benchmark_data_smithi188_119427_object85761:head# 2024-04-01T19:42:44.178 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:44.178 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:402519e1:::benchmark_data_smithi188_119427_object100482:head# 2024-04-01T19:42:44.178 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40253ab4:::benchmark_data_smithi188_119427_object163508:head# 2024-04-01T19:42:44.178 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40253f67:::benchmark_data_smithi188_119427_object74516:head# 2024-04-01T19:42:44.178 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4025536b:::benchmark_data_smithi188_119427_object76954:head# 2024-04-01T19:42:44.178 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:402577aa:::benchmark_data_smithi188_119427_object117384:head# 2024-04-01T19:42:44.179 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40259b7b:::benchmark_data_smithi188_119427_object82333:head# 2024-04-01T19:42:44.179 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:42:44.180 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4025a174:::benchmark_data_smithi188_119427_object154003:head# 2024-04-01T19:42:44.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:402628a9:::benchmark_data_smithi188_119427_object145277:head# 2024-04-01T19:42:44.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4026a678:::benchmark_data_smithi188_119427_object74440:head# 2024-04-01T19:42:44.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40273666:::benchmark_data_smithi188_119427_object142607:head# 2024-04-01T19:42:44.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40274074:::benchmark_data_smithi188_119427_object146975:head# 2024-04-01T19:42:44.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40280c7d:::benchmark_data_smithi188_119427_object95662:head# 2024-04-01T19:42:44.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40287d37:::benchmark_data_smithi188_119427_object83073:head# 2024-04-01T19:42:44.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:402983c8:::benchmark_data_smithi188_119427_object95978:head# 2024-04-01T19:42:44.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:402a1fbb:::benchmark_data_smithi188_119427_object113539:head# 2024-04-01T19:42:44.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:402a6ccf:::benchmark_data_smithi188_119427_object104854:head# 2024-04-01T19:42:44.182 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:402a85b0:::benchmark_data_smithi188_119427_object74825:head# 2024-04-01T19:42:44.182 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:402a9894:::benchmark_data_smithi188_119427_object129617:head# 2024-04-01T19:42:44.182 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:402b0f39:::benchmark_data_smithi188_119427_object125489:head# 2024-04-01T19:42:44.182 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:402b2e85:::benchmark_data_smithi188_119427_object160789:head# 2024-04-01T19:42:44.183 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:402b50b6:::benchmark_data_smithi188_119427_object135642:head# 2024-04-01T19:42:44.183 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:402ba304:::benchmark_data_smithi188_119427_object77342:head# 2024-04-01T19:42:44.183 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:402bb517:::benchmark_data_smithi188_119427_object140960:head# 2024-04-01T19:42:44.184 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:402bf25d:::benchmark_data_smithi188_119427_object116642:head# 2024-04-01T19:42:44.184 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:402ce0f4:::benchmark_data_smithi188_119427_object117038:head# 2024-04-01T19:42:44.185 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:402d0998:::benchmark_data_smithi188_119427_object105241:head# 2024-04-01T19:42:44.185 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:402d2906:::benchmark_data_smithi188_119427_object110705:head# 2024-04-01T19:42:44.186 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:402d2c76:::benchmark_data_smithi188_119427_object114981:head# 2024-04-01T19:42:44.186 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:402fbd28:::benchmark_data_smithi188_119427_object158244:head# 2024-04-01T19:42:44.186 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4030544f:::benchmark_data_smithi188_119427_object104591:head# 2024-04-01T19:42:44.187 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40309bfc:::benchmark_data_smithi188_119427_object142699:head# 2024-04-01T19:42:44.187 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:403379a8:::benchmark_data_smithi188_119427_object111716:head# 2024-04-01T19:42:44.187 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:403407f2:::benchmark_data_smithi188_119427_object151179:head# 2024-04-01T19:42:44.188 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40348b79:::benchmark_data_smithi188_119427_object161313:head# 2024-04-01T19:42:44.189 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4034b1d3:::benchmark_data_smithi188_119427_object95315:head# 2024-04-01T19:42:44.189 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:403560b9:::benchmark_data_smithi188_119427_object114236:head# 2024-04-01T19:42:44.189 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40363815:::benchmark_data_smithi188_119427_object160300:head# 2024-04-01T19:42:44.190 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:403717a7:::benchmark_data_smithi188_119427_object136080:head# 2024-04-01T19:42:44.190 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40377f8f:::benchmark_data_smithi188_119427_object132589:head# 2024-04-01T19:42:44.191 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40393dbd:::benchmark_data_smithi188_119427_object106293:head# 2024-04-01T19:42:44.191 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4039e487:::benchmark_data_smithi188_119427_object157604:head# 2024-04-01T19:42:44.191 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:403a8883:::benchmark_data_smithi188_119427_object128277:head# 2024-04-01T19:42:44.192 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:403af1b6:::benchmark_data_smithi188_119427_object100222:head# 2024-04-01T19:42:44.192 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:403c216e:::benchmark_data_smithi188_119427_object151790:head# 2024-04-01T19:42:44.192 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:403c78c2:::benchmark_data_smithi188_119427_object159818:head# 2024-04-01T19:42:44.193 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:403cbfc3:::benchmark_data_smithi188_119427_object124793:head# 2024-04-01T19:42:44.193 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:403de18e:::benchmark_data_smithi188_119427_object152662:head# 2024-04-01T19:42:44.193 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:403e5e37:::benchmark_data_smithi188_119427_object117808:head# 2024-04-01T19:42:44.194 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:403ea4d1:::benchmark_data_smithi188_119427_object132979:head# 2024-04-01T19:42:44.195 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:403eff72:::benchmark_data_smithi188_119427_object135700:head# 2024-04-01T19:42:44.195 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:403f3345:::benchmark_data_smithi188_119427_object100199:head# 2024-04-01T19:42:44.196 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:403f3b5d:::benchmark_data_smithi188_119427_object123304:head# 2024-04-01T19:42:44.196 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40400921:::benchmark_data_smithi188_119427_object142223:head# 2024-04-01T19:42:44.197 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40412e1f:::benchmark_data_smithi188_119427_object156599:head# 2024-04-01T19:42:44.197 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40430516:::benchmark_data_smithi188_119427_object149892:head# 2024-04-01T19:42:44.197 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40433699:::benchmark_data_smithi188_119427_object146971:head# 2024-04-01T19:42:44.198 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40444ec2:::benchmark_data_smithi188_119427_object131525:head# 2024-04-01T19:42:44.198 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:404469e2:::benchmark_data_smithi188_119427_object132029:head# 2024-04-01T19:42:44.199 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40451fec:::benchmark_data_smithi188_119427_object75751:head# 2024-04-01T19:42:44.199 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40452754:::benchmark_data_smithi188_119427_object151535:head# 2024-04-01T19:42:44.200 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:404663f6:::benchmark_data_smithi188_119427_object79488:head# 2024-04-01T19:42:44.200 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40470ee5:::benchmark_data_smithi188_119427_object148783:head# 2024-04-01T19:42:44.201 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4047a32f:::benchmark_data_smithi188_119427_object115689:head# 2024-04-01T19:42:44.201 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4047b7f4:::benchmark_data_smithi188_119427_object131961:head# 2024-04-01T19:42:44.201 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4047bf4f:::benchmark_data_smithi188_119427_object117241:head# 2024-04-01T19:42:44.202 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:404817e8:::benchmark_data_smithi188_119427_object76150:head# 2024-04-01T19:42:44.202 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40492b83:::benchmark_data_smithi188_119427_object112146:head# 2024-04-01T19:42:44.203 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:404959d0:::benchmark_data_smithi188_119427_object135583:head# 2024-04-01T19:42:44.203 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:404b19ce:::benchmark_data_smithi188_119427_object113447:head# 2024-04-01T19:42:44.203 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:404b1e11:::benchmark_data_smithi188_119427_object99402:head# 2024-04-01T19:42:44.204 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:404b5c61:::benchmark_data_smithi188_119427_object79460:head# 2024-04-01T19:42:44.204 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:404b8928:::benchmark_data_smithi188_119427_object77125:head# 2024-04-01T19:42:44.205 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:404bcecd:::benchmark_data_smithi188_119427_object103369:head# 2024-04-01T19:42:44.205 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:404d2f83:::benchmark_data_smithi188_119427_object77145:head# 2024-04-01T19:42:44.206 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:404d74d5:::benchmark_data_smithi188_119427_object150289:head# 2024-04-01T19:42:44.206 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:404d8999:::benchmark_data_smithi188_119427_object75464:head# 2024-04-01T19:42:44.206 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:404d8a28:::benchmark_data_smithi188_119427_object116961:head# 2024-04-01T19:42:44.207 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:404e2104:::benchmark_data_smithi188_119427_object149233:head# 2024-04-01T19:42:44.207 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:404e2376:::benchmark_data_smithi188_119427_object146751:head# 2024-04-01T19:42:44.207 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:404f2045:::benchmark_data_smithi188_119427_object154677:head# 2024-04-01T19:42:44.208 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4050d1a9:::benchmark_data_smithi188_119427_object99217:head# 2024-04-01T19:42:44.208 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4051fadc:::benchmark_data_smithi188_119427_object159640:head# 2024-04-01T19:42:44.209 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40520d66:::benchmark_data_smithi188_119427_object155971:head# 2024-04-01T19:42:44.209 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40526df6:::benchmark_data_smithi188_119427_object107493:head# 2024-04-01T19:42:44.210 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4053c800:::benchmark_data_smithi188_119427_object127022:head# 2024-04-01T19:42:44.210 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40540e51:::benchmark_data_smithi188_119427_object127887:head# 2024-04-01T19:42:44.210 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4054ba99:::benchmark_data_smithi188_119427_object128745:head# 2024-04-01T19:42:44.211 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4054f8de:::benchmark_data_smithi188_119427_object111016:head# 2024-04-01T19:42:44.211 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4055ba15:::benchmark_data_smithi188_119427_object84783:head# 2024-04-01T19:42:44.212 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40564286:::benchmark_data_smithi188_119427_object117784:head# 2024-04-01T19:42:44.212 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40588a76:::benchmark_data_smithi188_119427_object136822:head# 2024-04-01T19:42:44.213 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:405a7e6e:::benchmark_data_smithi188_119427_object128702:head# 2024-04-01T19:42:44.213 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:405afd47:::benchmark_data_smithi188_119427_object138718:head# 2024-04-01T19:42:44.213 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:405b32c9:::benchmark_data_smithi188_119427_object95615:head# 2024-04-01T19:42:44.214 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:405b3f6f:::benchmark_data_smithi188_119427_object96249:head# 2024-04-01T19:42:44.214 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:405c013e:::benchmark_data_smithi188_119427_object148661:head# 2024-04-01T19:42:44.215 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:405f0604:::benchmark_data_smithi188_119427_object86550:head# 2024-04-01T19:42:44.215 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:405fab6d:::benchmark_data_smithi188_119427_object82211:head# 2024-04-01T19:42:44.215 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:405fc5c7:::benchmark_data_smithi188_119427_object96641:head# 2024-04-01T19:42:44.216 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:405fc6e3:::benchmark_data_smithi188_119427_object139410:head# 2024-04-01T19:42:44.216 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:405fd622:::benchmark_data_smithi188_119427_object89726:head# 2024-04-01T19:42:44.216 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4060ab1d:::benchmark_data_smithi188_119427_object139274:head# 2024-04-01T19:42:44.217 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4061375c:::benchmark_data_smithi188_119427_object132881:head# 2024-04-01T19:42:44.217 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4062900c:::benchmark_data_smithi188_119427_object133418:head# 2024-04-01T19:42:44.218 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4062c65c:::benchmark_data_smithi188_119427_object103600:head# 2024-04-01T19:42:44.218 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:406330d7:::benchmark_data_smithi188_119427_object140278:head# 2024-04-01T19:42:44.219 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4065a876:::benchmark_data_smithi188_119427_object77739:head# 2024-04-01T19:42:44.219 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:406603e6:::benchmark_data_smithi188_119427_object143968:head# 2024-04-01T19:42:44.219 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40661736:::benchmark_data_smithi188_119427_object156637:head# 2024-04-01T19:42:44.220 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4066357d:::benchmark_data_smithi188_119427_object121587:head# 2024-04-01T19:42:44.220 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40666811:::benchmark_data_smithi188_119427_object148816:head# 2024-04-01T19:42:44.221 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:406674d3:::benchmark_data_smithi188_119427_object98866:head# 2024-04-01T19:42:44.221 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4067c870:::benchmark_data_smithi188_119427_object82611:head# 2024-04-01T19:42:44.222 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40684803:::benchmark_data_smithi188_119427_object158792:head# 2024-04-01T19:42:44.222 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40687e37:::benchmark_data_smithi188_119427_object150565:head# 2024-04-01T19:42:44.222 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4069bbeb:::benchmark_data_smithi188_119427_object150500:head# 2024-04-01T19:42:44.224 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:406a0965:::benchmark_data_smithi188_119427_object143450:head# 2024-04-01T19:42:44.224 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:406a1ac7:::benchmark_data_smithi188_119427_object101185:head# 2024-04-01T19:42:44.224 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:406a3605:::benchmark_data_smithi188_119427_object86835:head# 2024-04-01T19:42:44.224 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:406ba978:::benchmark_data_smithi188_119427_object96769:head# 2024-04-01T19:42:44.225 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:406d758a:::benchmark_data_smithi188_119427_object162427:head# 2024-04-01T19:42:44.225 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:406e17d2:::benchmark_data_smithi188_119427_object88868:head# 2024-04-01T19:42:44.225 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:406ef6e0:::benchmark_data_smithi188_119427_object145585:head# 2024-04-01T19:42:44.226 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:406f05a5:::benchmark_data_smithi188_119427_object150328:head# 2024-04-01T19:42:44.226 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4070af97:::benchmark_data_smithi188_119427_object109007:head# 2024-04-01T19:42:44.227 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4070f82a:::benchmark_data_smithi188_119427_object127346:head# 2024-04-01T19:42:44.227 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4071105d:::benchmark_data_smithi188_119427_object105778:head# 2024-04-01T19:42:44.228 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40715990:::benchmark_data_smithi188_119427_object124300:head# 2024-04-01T19:42:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4071bee8:::benchmark_data_smithi188_119427_object158255:head# 2024-04-01T19:42:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40722f94:::benchmark_data_smithi188_119427_object163152:head# 2024-04-01T19:42:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4072b0b6:::benchmark_data_smithi188_119427_object93436:head# 2024-04-01T19:42:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4072d5fa:::benchmark_data_smithi188_119427_object147562:head# 2024-04-01T19:42:44.230 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:407392cb:::benchmark_data_smithi188_119427_object162815:head# 2024-04-01T19:42:44.230 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4073a321:::benchmark_data_smithi188_119427_object134777:head# 2024-04-01T19:42:44.231 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4073ca08:::benchmark_data_smithi188_119427_object149568:head# 2024-04-01T19:42:44.231 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4076b9ec:::benchmark_data_smithi188_119427_object121965:head# 2024-04-01T19:42:44.232 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:407720a7:::benchmark_data_smithi188_119427_object153414:head# 2024-04-01T19:42:44.232 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40788955:::benchmark_data_smithi188_119427_object90369:head# 2024-04-01T19:42:44.232 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40794b2c:::benchmark_data_smithi188_119427_object145899:head# 2024-04-01T19:42:44.233 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:407a96de:::benchmark_data_smithi188_119427_object146628:head# 2024-04-01T19:42:44.233 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:407aa954:::benchmark_data_smithi188_119427_object128755:head# 2024-04-01T19:42:44.234 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:407baab7:::benchmark_data_smithi188_119427_object160204:head# 2024-04-01T19:42:44.234 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:407c09ab:::benchmark_data_smithi188_119427_object136323:head# 2024-04-01T19:42:44.235 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:407caac1:::benchmark_data_smithi188_119427_object111596:head# 2024-04-01T19:42:44.236 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:407d0b9e:::benchmark_data_smithi188_119427_object76669:head# 2024-04-01T19:42:44.236 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:407db701:::benchmark_data_smithi188_119427_object147557:head# 2024-04-01T19:42:44.237 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:407ddbe0:::benchmark_data_smithi188_119427_object72533:head# 2024-04-01T19:42:44.237 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:407e661b:::benchmark_data_smithi188_119427_object91742:head# 2024-04-01T19:42:44.238 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4081548b:::benchmark_data_smithi188_119427_object72619:head# 2024-04-01T19:42:44.238 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4081d329:::benchmark_data_smithi188_119427_object128571:head# 2024-04-01T19:42:44.239 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4083a3de:::benchmark_data_smithi188_119427_object164448:head# 2024-04-01T19:42:44.239 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4083c65d:::benchmark_data_smithi188_119427_object131833:head# 2024-04-01T19:42:44.240 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4083f699:::benchmark_data_smithi188_119427_object79641:head# 2024-04-01T19:42:44.240 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40840404:::benchmark_data_smithi188_119427_object121342:head# 2024-04-01T19:42:44.241 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:408439ff:::benchmark_data_smithi188_119427_object143277:head# 2024-04-01T19:42:44.241 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4086c80c:::benchmark_data_smithi188_119427_object99649:head# 2024-04-01T19:42:44.242 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:408711db:::benchmark_data_smithi188_119427_object146916:head# 2024-04-01T19:42:44.242 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:408847b0:::benchmark_data_smithi188_119427_object109128:head# 2024-04-01T19:42:44.242 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40884ef2:::benchmark_data_smithi188_119427_object123271:head# 2024-04-01T19:42:44.243 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:408899cf:::benchmark_data_smithi188_119427_object91502:head# 2024-04-01T19:42:44.243 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:408953d2:::benchmark_data_smithi188_119427_object81014:head# 2024-04-01T19:42:44.243 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40899921:::benchmark_data_smithi188_119427_object132692:head# 2024-04-01T19:42:44.244 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4089c147:::benchmark_data_smithi188_119427_object104142:head# 2024-04-01T19:42:44.244 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:408a2fe4:::benchmark_data_smithi188_119427_object103256:head# 2024-04-01T19:42:44.245 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:408a6772:::benchmark_data_smithi188_119427_object117993:head# 2024-04-01T19:42:44.245 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:408c5783:::benchmark_data_smithi188_119427_object100365:head# 2024-04-01T19:42:44.245 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:408cf7f1:::benchmark_data_smithi188_119427_object99640:head# 2024-04-01T19:42:44.246 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:408d0fc9:::benchmark_data_smithi188_119427_object92251:head# 2024-04-01T19:42:44.246 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:408dcf60:::benchmark_data_smithi188_119427_object135517:head# 2024-04-01T19:42:44.247 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:408e69ca:::benchmark_data_smithi188_119427_object75673:head# 2024-04-01T19:42:44.247 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:408edb9f:::benchmark_data_smithi188_119427_object77063:head# 2024-04-01T19:42:44.247 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:408f88ea:::benchmark_data_smithi188_119427_object92665:head# 2024-04-01T19:42:44.248 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4090013f:::benchmark_data_smithi188_119427_object138837:head# 2024-04-01T19:42:44.248 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4090cafc:::benchmark_data_smithi188_119427_object114299:head# 2024-04-01T19:42:44.249 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40916c12:::benchmark_data_smithi188_119427_object92714:head# 2024-04-01T19:42:44.249 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4091f44d:::benchmark_data_smithi188_119427_object123364:head# 2024-04-01T19:42:44.249 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4094209c:::benchmark_data_smithi188_119427_object118502:head# 2024-04-01T19:42:44.250 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40942853:::benchmark_data_smithi188_119427_object114853:head# 2024-04-01T19:42:44.250 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40975ca5:::benchmark_data_smithi188_119427_object116732:head# 2024-04-01T19:42:44.251 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4098c34e:::benchmark_data_smithi188_119427_object147914:head# 2024-04-01T19:42:44.251 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:409b2336:::benchmark_data_smithi188_119427_object138271:head# 2024-04-01T19:42:44.251 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:409ba331:::benchmark_data_smithi188_119427_object120675:head# 2024-04-01T19:42:44.252 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:409c0863:::benchmark_data_smithi188_119427_object81029:head# 2024-04-01T19:42:44.252 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:409c6c03:::benchmark_data_smithi188_119427_object119150:head# 2024-04-01T19:42:44.253 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:409cd02a:::benchmark_data_smithi188_119427_object78993:head# 2024-04-01T19:42:44.253 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:409d679d:::benchmark_data_smithi188_119427_object73208:head# 2024-04-01T19:42:44.254 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:409e0492:::benchmark_data_smithi188_119427_object116493:head# 2024-04-01T19:42:44.254 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:409ed080:::benchmark_data_smithi188_119427_object132244:head# 2024-04-01T19:42:44.254 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:409f2a2a:::benchmark_data_smithi188_119427_object103912:head# 2024-04-01T19:42:44.255 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40a03841:::benchmark_data_smithi188_119427_object84372:head# 2024-04-01T19:42:44.255 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40a09aa1:::benchmark_data_smithi188_119427_object90101:head# 2024-04-01T19:42:44.256 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40a19818:::benchmark_data_smithi188_119427_object130904:head# 2024-04-01T19:42:44.256 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40a1bce0:::benchmark_data_smithi188_119427_object144377:head# 2024-04-01T19:42:44.257 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40a2e67b:::benchmark_data_smithi188_119427_object127814:head# 2024-04-01T19:42:44.258 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40a36261:::benchmark_data_smithi188_119427_object85423:head# 2024-04-01T19:42:44.258 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40a3d164:::benchmark_data_smithi188_119427_object99342:head# 2024-04-01T19:42:44.258 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40a4f880:::benchmark_data_smithi188_119427_object80561:head# 2024-04-01T19:42:44.259 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40a69119:::benchmark_data_smithi188_119427_object96497:head# 2024-04-01T19:42:44.259 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40a749e2:::benchmark_data_smithi188_119427_object137978:head# 2024-04-01T19:42:44.260 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40a7a4d0:::benchmark_data_smithi188_119427_object95941:head# 2024-04-01T19:42:44.261 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40a81d52:::benchmark_data_smithi188_119427_object74889:head# 2024-04-01T19:42:44.261 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40a9b1e2:::benchmark_data_smithi188_119427_object91598:head# 2024-04-01T19:42:44.261 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40ab9130:::benchmark_data_smithi188_119427_object103734:head# 2024-04-01T19:42:44.262 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40aba2bd:::benchmark_data_smithi188_119427_object135956:head# 2024-04-01T19:42:44.262 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40abdaaa:::benchmark_data_smithi188_119427_object131430:head# 2024-04-01T19:42:44.263 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40abe0ef:::benchmark_data_smithi188_119427_object142061:head# 2024-04-01T19:42:44.263 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40ada39b:::benchmark_data_smithi188_119427_object130867:head# 2024-04-01T19:42:44.263 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40ae1f65:::benchmark_data_smithi188_119427_object129944:head# 2024-04-01T19:42:44.264 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40b30353:::benchmark_data_smithi188_119427_object135188:head# 2024-04-01T19:42:44.264 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40b32ce7:::benchmark_data_smithi188_119427_object136304:head# 2024-04-01T19:42:44.265 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40b37b11:::benchmark_data_smithi188_119427_object131202:head# 2024-04-01T19:42:44.265 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40b3e688:::benchmark_data_smithi188_119427_object101457:head# 2024-04-01T19:42:44.266 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40b4660f:::benchmark_data_smithi188_119427_object74395:head# 2024-04-01T19:42:44.266 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40b47937:::benchmark_data_smithi188_119427_object163244:head# 2024-04-01T19:42:44.266 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40b57de1:::benchmark_data_smithi188_119427_object102055:head# 2024-04-01T19:42:44.267 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40b654d6:::benchmark_data_smithi188_119427_object117222:head# 2024-04-01T19:42:44.267 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40b69d82:::benchmark_data_smithi188_119427_object83143:head# 2024-04-01T19:42:44.268 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40b8158d:::benchmark_data_smithi188_119427_object131323:head# 2024-04-01T19:42:44.268 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40b8488e:::benchmark_data_smithi188_119427_object80196:head# 2024-04-01T19:42:44.269 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40b945eb:::benchmark_data_smithi188_119427_object128184:head# 2024-04-01T19:42:44.269 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40ba00e6:::benchmark_data_smithi188_119427_object113113:head# 2024-04-01T19:42:44.269 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40ba619b:::benchmark_data_smithi188_119427_object104208:head# 2024-04-01T19:42:44.270 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40bb2201:::benchmark_data_smithi188_119427_object109073:head# 2024-04-01T19:42:44.270 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40bc2f3c:::benchmark_data_smithi188_119427_object89524:head# 2024-04-01T19:42:44.271 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40bca323:::benchmark_data_smithi188_119427_object112697:head# 2024-04-01T19:42:44.271 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40bd8f4f:::benchmark_data_smithi188_119427_object87343:head# 2024-04-01T19:42:44.272 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40bde7c0:::benchmark_data_smithi188_119427_object94879:head# 2024-04-01T19:42:44.272 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40c15f9e:::benchmark_data_smithi188_119427_object111019:head# 2024-04-01T19:42:44.272 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40c1836b:::benchmark_data_smithi188_119427_object75000:head# 2024-04-01T19:42:44.273 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40c200d9:::benchmark_data_smithi188_119427_object128423:head# 2024-04-01T19:42:44.273 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40c262f5:::benchmark_data_smithi188_119427_object141431:head# 2024-04-01T19:42:44.274 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40c2d9d9:::benchmark_data_smithi188_119427_object78203:head# 2024-04-01T19:42:44.274 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40c4ae1d:::benchmark_data_smithi188_119427_object103762:head# 2024-04-01T19:42:44.275 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40c6380b:::benchmark_data_smithi188_119427_object109334:head# 2024-04-01T19:42:44.275 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40c6600a:::benchmark_data_smithi188_119427_object82502:head# 2024-04-01T19:42:44.275 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40c6d570:::benchmark_data_smithi188_119427_object86543:head# 2024-04-01T19:42:44.276 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40c78712:::benchmark_data_smithi188_119427_object121703:head# 2024-04-01T19:42:44.276 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40cb8b82:::benchmark_data_smithi188_119427_object139245:head# 2024-04-01T19:42:44.277 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40cc7543:::benchmark_data_smithi188_119427_object102467:head# 2024-04-01T19:42:44.277 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40cd5129:::benchmark_data_smithi188_119427_object144309:head# 2024-04-01T19:42:44.278 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40ceffaf:::benchmark_data_smithi188_119427_object107197:head# 2024-04-01T19:42:44.278 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40cf2953:::benchmark_data_smithi188_119427_object122718:head# 2024-04-01T19:42:44.279 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40d07cfb:::benchmark_data_smithi188_119427_object124045:head# 2024-04-01T19:42:44.279 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40d08a3c:::benchmark_data_smithi188_119427_object95109:head# 2024-04-01T19:42:44.280 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:42:44.281 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40d091c7:::benchmark_data_smithi188_119427_object104894:head# 2024-04-01T19:42:44.281 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40d0c96e:::benchmark_data_smithi188_119427_object137661:head# 2024-04-01T19:42:44.284 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40d16722:::benchmark_data_smithi188_119427_object163219:head# 2024-04-01T19:42:44.284 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40d17253:::benchmark_data_smithi188_119427_object107316:head# 2024-04-01T19:42:44.284 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40d272d6:::benchmark_data_smithi188_119427_object99226:head# 2024-04-01T19:42:44.284 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40d36187:::benchmark_data_smithi188_119427_object148666:head# 2024-04-01T19:42:44.284 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40d4f5c7:::benchmark_data_smithi188_119427_object107209:head# 2024-04-01T19:42:44.284 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40d5cbd2:::benchmark_data_smithi188_119427_object132624:head# 2024-04-01T19:42:44.285 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40d65967:::benchmark_data_smithi188_119427_object88644:head# 2024-04-01T19:42:44.285 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40d73a59:::benchmark_data_smithi188_119427_object122673:head# 2024-04-01T19:42:44.286 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40d86f8e:::benchmark_data_smithi188_119427_object86106:head# 2024-04-01T19:42:44.286 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40db5040:::benchmark_data_smithi188_119427_object124553:head# 2024-04-01T19:42:44.287 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40dc8af1:::benchmark_data_smithi188_119427_object140540:head# 2024-04-01T19:42:44.287 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40dce84c:::benchmark_data_smithi188_119427_object146407:head# 2024-04-01T19:42:44.287 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40dd7f5c:::benchmark_data_smithi188_119427_object104753:head# 2024-04-01T19:42:44.288 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40ddd12e:::benchmark_data_smithi188_119427_object140283:head# 2024-04-01T19:42:44.288 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40de0131:::benchmark_data_smithi188_119427_object87441:head# 2024-04-01T19:42:44.289 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40de2556:::benchmark_data_smithi188_119427_object114111:head# 2024-04-01T19:42:44.289 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40de4e77:::benchmark_data_smithi188_119427_object145023:head# 2024-04-01T19:42:44.290 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40debafe:::benchmark_data_smithi188_119427_object99812:head# 2024-04-01T19:42:44.290 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40dedf75:::benchmark_data_smithi188_119427_object86562:head# 2024-04-01T19:42:44.291 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40dfb03f:::benchmark_data_smithi188_119427_object91701:head# 2024-04-01T19:42:44.291 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40e2b69a:::benchmark_data_smithi188_119427_object94711:head# 2024-04-01T19:42:44.292 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40e30d27:::benchmark_data_smithi188_119427_object87858:head# 2024-04-01T19:42:44.292 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40e38425:::benchmark_data_smithi188_119427_object143324:head# 2024-04-01T19:42:44.293 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40e3e73a:::benchmark_data_smithi188_119427_object129642:head# 2024-04-01T19:42:44.293 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40e4b6cd:::benchmark_data_smithi188_119427_object120580:head# 2024-04-01T19:42:44.293 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40e5bce3:::benchmark_data_smithi188_119427_object141711:head# 2024-04-01T19:42:44.294 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40e67302:::benchmark_data_smithi188_119427_object141860:head# 2024-04-01T19:42:44.294 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40e68942:::benchmark_data_smithi188_119427_object96791:head# 2024-04-01T19:42:44.295 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40e81343:::benchmark_data_smithi188_119427_object91763:head# 2024-04-01T19:42:44.295 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40e92de8:::benchmark_data_smithi188_119427_object88929:head# 2024-04-01T19:42:44.296 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40e94a78:::benchmark_data_smithi188_119427_object85593:head# 2024-04-01T19:42:44.296 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40e94d40:::benchmark_data_smithi188_119427_object124702:head# 2024-04-01T19:42:44.297 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40e99604:::benchmark_data_smithi188_119427_object81044:head# 2024-04-01T19:42:44.297 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40e9ba79:::benchmark_data_smithi188_119427_object103944:head# 2024-04-01T19:42:44.298 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40ea5ed3:::benchmark_data_smithi188_119427_object120550:head# 2024-04-01T19:42:44.298 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40ed3883:::benchmark_data_smithi188_119427_object155963:head# 2024-04-01T19:42:44.299 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40edf2b2:::benchmark_data_smithi188_119427_object110340:head# 2024-04-01T19:42:44.299 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40edf783:::benchmark_data_smithi188_119427_object137372:head# 2024-04-01T19:42:44.300 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40ee8ba5:::benchmark_data_smithi188_119427_object89183:head# 2024-04-01T19:42:44.300 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40ef666a:::benchmark_data_smithi188_119427_object88616:head# 2024-04-01T19:42:44.301 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40f059d1:::benchmark_data_smithi188_119427_object78884:head# 2024-04-01T19:42:44.301 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40f0a17b:::benchmark_data_smithi188_119427_object84093:head# 2024-04-01T19:42:44.302 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40f65e03:::benchmark_data_smithi188_119427_object134662:head# 2024-04-01T19:42:44.302 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40f859ca:::benchmark_data_smithi188_119427_object155322:head# 2024-04-01T19:42:44.302 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40f87d30:::benchmark_data_smithi188_119427_object94977:head# 2024-04-01T19:42:44.303 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40f9949e:::benchmark_data_smithi188_119427_object151860:head# 2024-04-01T19:42:44.303 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40f9c418:::benchmark_data_smithi188_119427_object116481:head# 2024-04-01T19:42:44.304 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40fa254b:::benchmark_data_smithi188_119427_object106474:head# 2024-04-01T19:42:44.305 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40fa5196:::benchmark_data_smithi188_119427_object92446:head# 2024-04-01T19:42:44.305 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40fb0ac9:::benchmark_data_smithi188_119427_object106004:head# 2024-04-01T19:42:44.306 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40fb93a7:::benchmark_data_smithi188_119427_object73826:head# 2024-04-01T19:42:44.306 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40fc8aa9:::benchmark_data_smithi188_119427_object149757:head# 2024-04-01T19:42:44.307 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40fccebd:::benchmark_data_smithi188_119427_object160945:head# 2024-04-01T19:42:44.307 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40fce3de:::benchmark_data_smithi188_119427_object75255:head# 2024-04-01T19:42:44.308 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40fdb64f:::benchmark_data_smithi188_119427_object109963:head# 2024-04-01T19:42:44.308 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40fe19c9:::benchmark_data_smithi188_119427_object95139:head# 2024-04-01T19:42:44.308 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40fe5ad8:::benchmark_data_smithi188_119427_object158599:head# 2024-04-01T19:42:44.309 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:40ffb76f:::benchmark_data_smithi188_119427_object162862:head# 2024-04-01T19:42:44.309 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4100f039:::benchmark_data_smithi188_119427_object128666:head# 2024-04-01T19:42:44.310 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41028ea1:::benchmark_data_smithi188_119427_object148045:head# 2024-04-01T19:42:44.310 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4102e51b:::benchmark_data_smithi188_119427_object112003:head# 2024-04-01T19:42:44.311 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4102ed1f:::benchmark_data_smithi188_119427_object125665:head# 2024-04-01T19:42:44.311 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:410336f7:::benchmark_data_smithi188_119427_object113458:head# 2024-04-01T19:42:44.312 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4103aaf7:::benchmark_data_smithi188_119427_object98537:head# 2024-04-01T19:42:44.312 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4103e21c:::benchmark_data_smithi188_119427_object135401:head# 2024-04-01T19:42:44.313 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4103f0fc:::benchmark_data_smithi188_119427_object105442:head# 2024-04-01T19:42:44.313 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:410548e1:::benchmark_data_smithi188_119427_object101667:head# 2024-04-01T19:42:44.313 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:410553b1:::benchmark_data_smithi188_119427_object88272:head# 2024-04-01T19:42:44.314 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:410583e3:::benchmark_data_smithi188_119427_object81963:head# 2024-04-01T19:42:44.314 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4106836b:::benchmark_data_smithi188_119427_object129256:head# 2024-04-01T19:42:44.315 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:410723b6:::benchmark_data_smithi188_119427_object146394:head# 2024-04-01T19:42:44.315 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41076474:::benchmark_data_smithi188_119427_object103608:head# 2024-04-01T19:42:44.316 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:410776d5:::benchmark_data_smithi188_119427_object126254:head# 2024-04-01T19:42:44.316 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4108078d:::benchmark_data_smithi188_119427_object130842:head# 2024-04-01T19:42:44.316 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:44.317 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41082750:::benchmark_data_smithi188_119427_object120020:head# 2024-04-01T19:42:44.317 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4108514a:::benchmark_data_smithi188_119427_object75081:head# 2024-04-01T19:42:44.317 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4108c6a1:::benchmark_data_smithi188_119427_object101004:head# 2024-04-01T19:42:44.318 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:410a2c71:::benchmark_data_smithi188_119427_object157458:head# 2024-04-01T19:42:44.318 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:410aa2e2:::benchmark_data_smithi188_119427_object149606:head# 2024-04-01T19:42:44.319 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:410acb56:::benchmark_data_smithi188_119427_object148776:head# 2024-04-01T19:42:44.319 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:410adb8d:::benchmark_data_smithi188_119427_object128450:head# 2024-04-01T19:42:44.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:410b5cc2:::benchmark_data_smithi188_119427_object149964:head# 2024-04-01T19:42:44.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:410b92bc:::benchmark_data_smithi188_119427_object102946:head# 2024-04-01T19:42:44.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:410bbf9a:::benchmark_data_smithi188_119427_object160340:head# 2024-04-01T19:42:44.321 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:410c33bc:::benchmark_data_smithi188_119427_object154259:head# 2024-04-01T19:42:44.321 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:410cdd3f:::benchmark_data_smithi188_119427_object73148:head# 2024-04-01T19:42:44.322 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:410e113a:::benchmark_data_smithi188_119427_object162212:head# 2024-04-01T19:42:44.322 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:410f6630:::benchmark_data_smithi188_119427_object88393:head# 2024-04-01T19:42:44.323 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:410ff157:::benchmark_data_smithi188_119427_object110176:head# 2024-04-01T19:42:44.323 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41115ed1:::benchmark_data_smithi188_119427_object109547:head# 2024-04-01T19:42:44.323 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41117069:::benchmark_data_smithi188_119427_object96605:head# 2024-04-01T19:42:44.324 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4111a1fb:::benchmark_data_smithi188_119427_object103442:head# 2024-04-01T19:42:44.324 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4111c6d4:::benchmark_data_smithi188_119427_object104433:head# 2024-04-01T19:42:44.325 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4111de5f:::benchmark_data_smithi188_119427_object120158:head# 2024-04-01T19:42:44.325 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:411239e4:::benchmark_data_smithi188_119427_object115756:head# 2024-04-01T19:42:44.326 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4112575a:::benchmark_data_smithi188_119427_object93454:head# 2024-04-01T19:42:44.326 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41148038:::benchmark_data_smithi188_119427_object103677:head# 2024-04-01T19:42:44.326 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4114c5ad:::benchmark_data_smithi188_119427_object83032:head# 2024-04-01T19:42:44.327 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41175381:::benchmark_data_smithi188_119427_object110945:head# 2024-04-01T19:42:44.327 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4117bda0:::benchmark_data_smithi188_119427_object149499:head# 2024-04-01T19:42:44.328 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4117e835:::benchmark_data_smithi188_119427_object156191:head# 2024-04-01T19:42:44.328 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4118b842:::benchmark_data_smithi188_119427_object101272:head# 2024-04-01T19:42:44.328 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4118f6fc:::benchmark_data_smithi188_119427_object108639:head# 2024-04-01T19:42:44.329 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4118fa29:::benchmark_data_smithi188_119427_object162309:head# 2024-04-01T19:42:44.330 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:411a5976:::benchmark_data_smithi188_119427_object138293:head# 2024-04-01T19:42:44.330 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:411a63d6:::benchmark_data_smithi188_119427_object74511:head# 2024-04-01T19:42:44.330 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:411aaf80:::benchmark_data_smithi188_119427_object101454:head# 2024-04-01T19:42:44.331 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:411ab77c:::benchmark_data_smithi188_119427_object94320:head# 2024-04-01T19:42:44.331 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:411af104:::benchmark_data_smithi188_119427_object90390:head# 2024-04-01T19:42:44.332 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:411b0b5f:::benchmark_data_smithi188_119427_object106103:head# 2024-04-01T19:42:44.332 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:411b4b11:::benchmark_data_smithi188_119427_object97326:head# 2024-04-01T19:42:44.333 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:411b9a89:::benchmark_data_smithi188_119427_object146538:head# 2024-04-01T19:42:44.333 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:411c40b1:::benchmark_data_smithi188_119427_object81039:head# 2024-04-01T19:42:44.333 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:411daa4e:::benchmark_data_smithi188_119427_object87230:head# 2024-04-01T19:42:44.334 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:411df296:::benchmark_data_smithi188_119427_object148484:head# 2024-04-01T19:42:44.334 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:411ed2f7:::benchmark_data_smithi188_119427_object162472:head# 2024-04-01T19:42:44.335 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:411f8b27:::benchmark_data_smithi188_119427_object115820:head# 2024-04-01T19:42:44.335 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41218700:::benchmark_data_smithi188_119427_object89114:head# 2024-04-01T19:42:44.335 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:412212f8:::benchmark_data_smithi188_119427_object98256:head# 2024-04-01T19:42:44.336 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:412463ff:::benchmark_data_smithi188_119427_object115795:head# 2024-04-01T19:42:44.336 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41246c98:::benchmark_data_smithi188_119427_object105814:head# 2024-04-01T19:42:44.337 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41254026:::benchmark_data_smithi188_119427_object124193:head# 2024-04-01T19:42:44.337 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4126016d:::benchmark_data_smithi188_119427_object125566:head# 2024-04-01T19:42:44.338 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41264493:::benchmark_data_smithi188_119427_object110724:head# 2024-04-01T19:42:44.338 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41277d99:::benchmark_data_smithi188_119427_object95668:head# 2024-04-01T19:42:44.339 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4127844b:::benchmark_data_smithi188_119427_object90342:head# 2024-04-01T19:42:44.339 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41283b4b:::benchmark_data_smithi188_119427_object82064:head# 2024-04-01T19:42:44.339 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4128bd53:::benchmark_data_smithi188_119427_object120290:head# 2024-04-01T19:42:44.340 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:412938e2:::benchmark_data_smithi188_119427_object107268:head# 2024-04-01T19:42:44.340 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4129d353:::benchmark_data_smithi188_119427_object118722:head# 2024-04-01T19:42:44.341 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:412afa82:::benchmark_data_smithi188_119427_object124782:head# 2024-04-01T19:42:44.341 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:412b08be:::benchmark_data_smithi188_119427_object122077:head# 2024-04-01T19:42:44.342 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:412cc5cd:::benchmark_data_smithi188_119427_object118870:head# 2024-04-01T19:42:44.342 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:412d348e:::benchmark_data_smithi188_119427_object73072:head# 2024-04-01T19:42:44.342 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:412da66f:::benchmark_data_smithi188_119427_object116388:head# 2024-04-01T19:42:44.343 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:412dec55:::benchmark_data_smithi188_119427_object76519:head# 2024-04-01T19:42:44.343 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:412e7e14:::benchmark_data_smithi188_119427_object116138:head# 2024-04-01T19:42:44.344 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:412f02d1:::benchmark_data_smithi188_119427_object124706:head# 2024-04-01T19:42:44.344 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:412fded0:::benchmark_data_smithi188_119427_object139843:head# 2024-04-01T19:42:44.344 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41311034:::benchmark_data_smithi188_119427_object114715:head# 2024-04-01T19:42:44.345 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41319b4c:::benchmark_data_smithi188_119427_object139987:head# 2024-04-01T19:42:44.345 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4131c161:::benchmark_data_smithi188_119427_object142282:head# 2024-04-01T19:42:44.346 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41331fc7:::benchmark_data_smithi188_119427_object143748:head# 2024-04-01T19:42:44.346 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41335c93:::benchmark_data_smithi188_119427_object83593:head# 2024-04-01T19:42:44.347 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:413395ff:::benchmark_data_smithi188_119427_object116090:head# 2024-04-01T19:42:44.347 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4133e147:::benchmark_data_smithi188_119427_object164083:head# 2024-04-01T19:42:44.347 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41340546:::benchmark_data_smithi188_119427_object96189:head# 2024-04-01T19:42:44.348 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41343a4e:::benchmark_data_smithi188_119427_object100147:head# 2024-04-01T19:42:44.348 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41359635:::benchmark_data_smithi188_119427_object97973:head# 2024-04-01T19:42:44.350 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41385ac3:::benchmark_data_smithi188_119427_object158320:head# 2024-04-01T19:42:44.350 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4138f048:::benchmark_data_smithi188_119427_object139960:head# 2024-04-01T19:42:44.350 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:413a9179:::benchmark_data_smithi188_119427_object152407:head# 2024-04-01T19:42:44.351 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:413b639e:::benchmark_data_smithi188_119427_object117751:head# 2024-04-01T19:42:44.351 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:413b6ec2:::benchmark_data_smithi188_119427_object92632:head# 2024-04-01T19:42:44.351 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:413b9e86:::benchmark_data_smithi188_119427_object136172:head# 2024-04-01T19:42:44.351 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:413bfb5c:::benchmark_data_smithi188_119427_object154536:head# 2024-04-01T19:42:44.352 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:413bfe62:::benchmark_data_smithi188_119427_object131659:head# 2024-04-01T19:42:44.352 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:413ce19a:::benchmark_data_smithi188_119427_object100957:head# 2024-04-01T19:42:44.352 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:413ce37f:::benchmark_data_smithi188_119427_object78214:head# 2024-04-01T19:42:44.353 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:413e1d9b:::benchmark_data_smithi188_119427_object112336:head# 2024-04-01T19:42:44.353 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41401ce4:::benchmark_data_smithi188_119427_object80616:head# 2024-04-01T19:42:44.354 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4141739f:::benchmark_data_smithi188_119427_object100113:head# 2024-04-01T19:42:44.354 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41421a8c:::benchmark_data_smithi188_119427_object73994:head# 2024-04-01T19:42:44.355 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41424a62:::benchmark_data_smithi188_119427_object78238:head# 2024-04-01T19:42:44.355 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4144b70e:::benchmark_data_smithi188_119427_object98358:head# 2024-04-01T19:42:44.356 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4145341c:::benchmark_data_smithi188_119427_object114212:head# 2024-04-01T19:42:44.356 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:414839d4:::benchmark_data_smithi188_119427_object146845:head# 2024-04-01T19:42:44.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:414928dc:::benchmark_data_smithi188_119427_object129242:head# 2024-04-01T19:42:44.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4149356f:::benchmark_data_smithi188_119427_object79812:head# 2024-04-01T19:42:44.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:414a08d5:::benchmark_data_smithi188_119427_object93002:head# 2024-04-01T19:42:44.358 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:414a2270:::benchmark_data_smithi188_119427_object163035:head# 2024-04-01T19:42:44.358 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:414bdc15:::benchmark_data_smithi188_119427_object82016:head# 2024-04-01T19:42:44.359 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:414c2afa:::benchmark_data_smithi188_119427_object159451:head# 2024-04-01T19:42:44.359 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:414c5263:::benchmark_data_smithi188_119427_object119868:head# 2024-04-01T19:42:44.360 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:414c8fcc:::benchmark_data_smithi188_119427_object114829:head# 2024-04-01T19:42:44.360 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:414d6dea:::benchmark_data_smithi188_119427_object85824:head# 2024-04-01T19:42:44.361 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:414dc9ec:::benchmark_data_smithi188_119427_object98420:head# 2024-04-01T19:42:44.361 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:414e12af:::benchmark_data_smithi188_119427_object81900:head# 2024-04-01T19:42:44.362 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:414e6594:::benchmark_data_smithi188_119427_object160981:head# 2024-04-01T19:42:44.362 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:414f3fe3:::benchmark_data_smithi188_119427_object143629:head# 2024-04-01T19:42:44.363 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:414f4c86:::benchmark_data_smithi188_119427_object148802:head# 2024-04-01T19:42:44.363 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:414ff252:::benchmark_data_smithi188_119427_object112278:head# 2024-04-01T19:42:44.364 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:415052c3:::benchmark_data_smithi188_119427_object85449:head# 2024-04-01T19:42:44.364 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41525930:::benchmark_data_smithi188_119427_object116834:head# 2024-04-01T19:42:44.365 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4152e696:::benchmark_data_smithi188_119427_object109092:head# 2024-04-01T19:42:44.365 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41535b35:::benchmark_data_smithi188_119427_object110290:head# 2024-04-01T19:42:44.366 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41543cc9:::benchmark_data_smithi188_119427_object96569:head# 2024-04-01T19:42:44.366 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4156f4d8:::benchmark_data_smithi188_119427_object131856:head# 2024-04-01T19:42:44.367 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41572442:::benchmark_data_smithi188_119427_object73681:head# 2024-04-01T19:42:44.367 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41577c18:::benchmark_data_smithi188_119427_object154734:head# 2024-04-01T19:42:44.368 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:415bbe40:::benchmark_data_smithi188_119427_object152899:head# 2024-04-01T19:42:44.368 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:415bc362:::benchmark_data_smithi188_119427_object83093:head# 2024-04-01T19:42:44.369 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:415c0875:::benchmark_data_smithi188_119427_object164693:head# 2024-04-01T19:42:44.369 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:415c5771:::benchmark_data_smithi188_119427_object142346:head# 2024-04-01T19:42:44.369 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:415d9d7c:::benchmark_data_smithi188_119427_object155664:head# 2024-04-01T19:42:44.370 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:415dc37b:::benchmark_data_smithi188_119427_object147600:head# 2024-04-01T19:42:44.370 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:415f735d:::benchmark_data_smithi188_119427_object124287:head# 2024-04-01T19:42:44.371 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41601142:::benchmark_data_smithi188_119427_object95798:head# 2024-04-01T19:42:44.371 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4160900f:::benchmark_data_smithi188_119427_object146419:head# 2024-04-01T19:42:44.372 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4160ce9e:::benchmark_data_smithi188_119427_object79821:head# 2024-04-01T19:42:44.372 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4161aad0:::benchmark_data_smithi188_119427_object130952:head# 2024-04-01T19:42:44.372 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41630368:::benchmark_data_smithi188_119427_object123277:head# 2024-04-01T19:42:44.373 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4164c647:::benchmark_data_smithi188_119427_object76638:head# 2024-04-01T19:42:44.373 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4164d02b:::benchmark_data_smithi188_119427_object93079:head# 2024-04-01T19:42:44.373 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41650882:::benchmark_data_smithi188_119427_object73267:head# 2024-04-01T19:42:44.374 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4165ab50:::benchmark_data_smithi188_119427_object119748:head# 2024-04-01T19:42:44.374 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4165f533:::benchmark_data_smithi188_119427_object91413:head# 2024-04-01T19:42:44.375 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41666718:::benchmark_data_smithi188_119427_object131342:head# 2024-04-01T19:42:44.375 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41679f35:::benchmark_data_smithi188_119427_object113123:head# 2024-04-01T19:42:44.376 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:416c10c2:::benchmark_data_smithi188_119427_object112744:head# 2024-04-01T19:42:44.376 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:416c87f0:::benchmark_data_smithi188_119427_object99683:head# 2024-04-01T19:42:44.376 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:416d0d2e:::benchmark_data_smithi188_119427_object121837:head# 2024-04-01T19:42:44.377 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:416d9afc:::benchmark_data_smithi188_119427_object99008:head# 2024-04-01T19:42:44.377 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:416da3f9:::benchmark_data_smithi188_119427_object118605:head# 2024-04-01T19:42:44.378 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:416ecc75:::benchmark_data_smithi188_119427_object86962:head# 2024-04-01T19:42:44.378 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:416f0b41:::benchmark_data_smithi188_119427_object128084:head# 2024-04-01T19:42:44.383 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:416f829b:::benchmark_data_smithi188_119427_object159453:head# 2024-04-01T19:42:44.383 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:416ffa1a:::benchmark_data_smithi188_119427_object156327:head# 2024-04-01T19:42:44.383 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:417017df:::benchmark_data_smithi188_119427_object156920:head# 2024-04-01T19:42:44.383 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41729418:::benchmark_data_smithi188_119427_object76350:head# 2024-04-01T19:42:44.383 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4172964f:::benchmark_data_smithi188_119427_object91155:head# 2024-04-01T19:42:44.383 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4172a9c8:::benchmark_data_smithi188_119427_object72538:head# 2024-04-01T19:42:44.383 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:417390e7:::benchmark_data_smithi188_119427_object118468:head# 2024-04-01T19:42:44.383 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41744391:::benchmark_data_smithi188_119427_object82947:head# 2024-04-01T19:42:44.383 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41752169:::benchmark_data_smithi188_119427_object110702:head# 2024-04-01T19:42:44.383 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:417598a4:::benchmark_data_smithi188_119427_object72841:head# 2024-04-01T19:42:44.384 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41761b57:::benchmark_data_smithi188_119427_object129214:head# 2024-04-01T19:42:44.384 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4176b4d2:::benchmark_data_smithi188_119427_object98430:head# 2024-04-01T19:42:44.384 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4176d145:::benchmark_data_smithi188_119427_object158622:head# 2024-04-01T19:42:44.385 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41776739:::benchmark_data_smithi188_119427_object159811:head# 2024-04-01T19:42:44.385 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4177bde9:::benchmark_data_smithi188_119427_object99663:head# 2024-04-01T19:42:44.385 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:417b9b1a:::benchmark_data_smithi188_119427_object123884:head# 2024-04-01T19:42:44.386 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:417bdbdf:::benchmark_data_smithi188_119427_object148179:head# 2024-04-01T19:42:44.386 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:417ce12e:::benchmark_data_smithi188_119427_object87554:head# 2024-04-01T19:42:44.387 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:417d3f9a:::benchmark_data_smithi188_119427_object160395:head# 2024-04-01T19:42:44.387 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:417de161:::benchmark_data_smithi188_119427_object157691:head# 2024-04-01T19:42:44.388 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:417e8929:::benchmark_data_smithi188_119427_object99118:head# 2024-04-01T19:42:44.388 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:417fde53:::benchmark_data_smithi188_119427_object104554:head# 2024-04-01T19:42:44.388 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:418064c5:::benchmark_data_smithi188_119427_object161302:head# 2024-04-01T19:42:44.389 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41819359:::benchmark_data_smithi188_119427_object157589:head# 2024-04-01T19:42:44.389 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4181fc17:::benchmark_data_smithi188_119427_object110240:head# 2024-04-01T19:42:44.390 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41829564:::benchmark_data_smithi188_119427_object136769:head# 2024-04-01T19:42:44.390 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41841a1f:::benchmark_data_smithi188_119427_object78813:head# 2024-04-01T19:42:44.391 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41853988:::benchmark_data_smithi188_119427_object158197:head# 2024-04-01T19:42:44.391 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:418699f7:::benchmark_data_smithi188_119427_object158707:head# 2024-04-01T19:42:44.392 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4186c294:::benchmark_data_smithi188_119427_object127512:head# 2024-04-01T19:42:44.392 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4187038a:::benchmark_data_smithi188_119427_object153458:head# 2024-04-01T19:42:44.392 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4187f9f4:::benchmark_data_smithi188_119427_object127203:head# 2024-04-01T19:42:44.393 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:418902c7:::benchmark_data_smithi188_119427_object133239:head# 2024-04-01T19:42:44.393 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41892b24:::benchmark_data_smithi188_119427_object105718:head# 2024-04-01T19:42:44.394 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:418a7724:::benchmark_data_smithi188_119427_object153038:head# 2024-04-01T19:42:44.394 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:418b056f:::benchmark_data_smithi188_119427_object108559:head# 2024-04-01T19:42:44.395 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:418b4419:::benchmark_data_smithi188_119427_object155198:head# 2024-04-01T19:42:44.395 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:418c2ddb:::benchmark_data_smithi188_119427_object134979:head# 2024-04-01T19:42:44.395 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:418d20cd:::benchmark_data_smithi188_119427_object123109:head# 2024-04-01T19:42:44.396 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:418d602f:::benchmark_data_smithi188_119427_object111048:head# 2024-04-01T19:42:44.396 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:418f5b50:::benchmark_data_smithi188_119427_object95950:head# 2024-04-01T19:42:44.397 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:418f78ec:::benchmark_data_smithi188_119427_object145687:head# 2024-04-01T19:42:44.397 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41900c86:::benchmark_data_smithi188_119427_object121960:head# 2024-04-01T19:42:44.398 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4191f043:::benchmark_data_smithi188_119427_object102796:head# 2024-04-01T19:42:44.398 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41926fb3:::benchmark_data_smithi188_119427_object99336:head# 2024-04-01T19:42:44.399 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4192de0b:::benchmark_data_smithi188_119427_object78900:head# 2024-04-01T19:42:44.399 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4192e80d:::benchmark_data_smithi188_119427_object127225:head# 2024-04-01T19:42:44.400 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41937f33:::benchmark_data_smithi188_119427_object157312:head# 2024-04-01T19:42:44.400 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4193ba59:::benchmark_data_smithi188_119427_object139289:head# 2024-04-01T19:42:44.401 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4193bd98:::benchmark_data_smithi188_119427_object103735:head# 2024-04-01T19:42:44.401 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4194c4c3:::benchmark_data_smithi188_119427_object95842:head# 2024-04-01T19:42:44.401 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4194ecf2:::benchmark_data_smithi188_119427_object72769:head# 2024-04-01T19:42:44.402 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4195fbfa:::benchmark_data_smithi188_119427_object132997:head# 2024-04-01T19:42:44.402 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41969be2:::benchmark_data_smithi188_119427_object76138:head# 2024-04-01T19:42:44.404 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4196c4f2:::benchmark_data_smithi188_119427_object153786:head# 2024-04-01T19:42:44.404 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41972b64:::benchmark_data_smithi188_119427_object154372:head# 2024-04-01T19:42:44.404 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4197bade:::benchmark_data_smithi188_119427_object116659:head# 2024-04-01T19:42:44.404 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4198a358:::benchmark_data_smithi188_119427_object93064:head# 2024-04-01T19:42:44.405 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4198ec12:::benchmark_data_smithi188_119427_object111935:head# 2024-04-01T19:42:44.405 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41997290:::benchmark_data_smithi188_119427_object131326:head# 2024-04-01T19:42:44.406 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4199f78f:::benchmark_data_smithi188_119427_object107627:head# 2024-04-01T19:42:44.406 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:419a3919:::benchmark_data_smithi188_119427_object140429:head# 2024-04-01T19:42:44.406 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:419b08d7:::benchmark_data_smithi188_119427_object80504:head# 2024-04-01T19:42:44.407 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:419b1aa4:::benchmark_data_smithi188_119427_object162676:head# 2024-04-01T19:42:44.407 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:419b6cea:::benchmark_data_smithi188_119427_object92865:head# 2024-04-01T19:42:44.407 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:419c16e5:::benchmark_data_smithi188_119427_object123442:head# 2024-04-01T19:42:44.408 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:419cbd9e:::benchmark_data_smithi188_119427_object75511:head# 2024-04-01T19:42:44.408 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:419d2994:::benchmark_data_smithi188_119427_object135167:head# 2024-04-01T19:42:44.409 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:419d667a:::benchmark_data_smithi188_119427_object145965:head# 2024-04-01T19:42:44.409 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:419d833d:::benchmark_data_smithi188_119427_object142801:head# 2024-04-01T19:42:44.410 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:419d863d:::benchmark_data_smithi188_119427_object102681:head# 2024-04-01T19:42:44.410 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:419e31d1:::benchmark_data_smithi188_119427_object110193:head# 2024-04-01T19:42:44.411 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:419e683f:::benchmark_data_smithi188_119427_object78843:head# 2024-04-01T19:42:44.411 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:419f487b:::benchmark_data_smithi188_119427_object156169:head# 2024-04-01T19:42:44.412 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:419fb306:::benchmark_data_smithi188_119427_object87052:head# 2024-04-01T19:42:44.412 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41a1b3f5:::benchmark_data_smithi188_119427_object114388:head# 2024-04-01T19:42:44.412 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41a1c27c:::benchmark_data_smithi188_119427_object114421:head# 2024-04-01T19:42:44.413 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41a1d50f:::benchmark_data_smithi188_119427_object136535:head# 2024-04-01T19:42:44.413 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41a2e0e1:::benchmark_data_smithi188_119427_object105569:head# 2024-04-01T19:42:44.414 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41a3f844:::benchmark_data_smithi188_119427_object135548:head# 2024-04-01T19:42:44.414 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41a42a05:::benchmark_data_smithi188_119427_object161187:head# 2024-04-01T19:42:44.414 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41a44cfb:::benchmark_data_smithi188_119427_object106251:head# 2024-04-01T19:42:44.416 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41a45614:::benchmark_data_smithi188_119427_object107654:head# 2024-04-01T19:42:44.416 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41a45615:::benchmark_data_smithi188_119427_object146917:head# 2024-04-01T19:42:44.417 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41a47f04:::benchmark_data_smithi188_119427_object147794:head# 2024-04-01T19:42:44.417 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41a57842:::benchmark_data_smithi188_119427_object153254:head# 2024-04-01T19:42:44.418 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41a60a8e:::benchmark_data_smithi188_119427_object100848:head# 2024-04-01T19:42:44.418 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41a6ec6f:::benchmark_data_smithi188_119427_object153523:head# 2024-04-01T19:42:44.419 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41a7136a:::benchmark_data_smithi188_119427_object81983:head# 2024-04-01T19:42:44.419 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41a781ab:::benchmark_data_smithi188_119427_object81901:head# 2024-04-01T19:42:44.419 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41a7e5e5:::benchmark_data_smithi188_119427_object114830:head# 2024-04-01T19:42:44.420 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41a7e5ff:::benchmark_data_smithi188_119427_object123459:head# 2024-04-01T19:42:44.420 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41a9bc76:::benchmark_data_smithi188_119427_object105056:head# 2024-04-01T19:42:44.421 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41aadbad:::benchmark_data_smithi188_119427_object78834:head# 2024-04-01T19:42:44.421 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41ab0cef:::benchmark_data_smithi188_119427_object162709:head# 2024-04-01T19:42:44.422 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41ab1230:::benchmark_data_smithi188_119427_object82359:head# 2024-04-01T19:42:44.422 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41ab9abd:::benchmark_data_smithi188_119427_object101101:head# 2024-04-01T19:42:44.422 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41abb840:::benchmark_data_smithi188_119427_object153005:head# 2024-04-01T19:42:44.423 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41ad92cb:::benchmark_data_smithi188_119427_object94426:head# 2024-04-01T19:42:44.423 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41ae467d:::benchmark_data_smithi188_119427_object135374:head# 2024-04-01T19:42:44.424 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41ae8e8f:::benchmark_data_smithi188_119427_object154473:head# 2024-04-01T19:42:44.424 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41aff283:::benchmark_data_smithi188_119427_object134165:head# 2024-04-01T19:42:44.425 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41b08b2a:::benchmark_data_smithi188_119427_object124859:head# 2024-04-01T19:42:44.425 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41b0fb3b:::benchmark_data_smithi188_119427_object122045:head# 2024-04-01T19:42:44.426 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:42:44.426 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41b12dfd:::benchmark_data_smithi188_119427_object91579:head# 2024-04-01T19:42:44.426 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41b18c35:::benchmark_data_smithi188_119427_object137581:head# 2024-04-01T19:42:44.427 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41b224bc:::benchmark_data_smithi188_119427_object151834:head# 2024-04-01T19:42:44.427 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41b25634:::benchmark_data_smithi188_119427_object155279:head# 2024-04-01T19:42:44.428 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41b27ff0:::benchmark_data_smithi188_119427_object143726:head# 2024-04-01T19:42:44.429 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41b28867:::benchmark_data_smithi188_119427_object144077:head# 2024-04-01T19:42:44.431 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41b2b7c5:::benchmark_data_smithi188_119427_object94854:head# 2024-04-01T19:42:44.433 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41b2e881:::benchmark_data_smithi188_119427_object109602:head# 2024-04-01T19:42:44.434 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41b31c04:::benchmark_data_smithi188_119427_object112131:head# 2024-04-01T19:42:44.434 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41b380e9:::benchmark_data_smithi188_119427_object130374:head# 2024-04-01T19:42:44.435 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41b40e0d:::benchmark_data_smithi188_119427_object120544:head# 2024-04-01T19:42:44.435 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41b4c36c:::benchmark_data_smithi188_119427_object93688:head# 2024-04-01T19:42:44.435 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41b6e2d5:::benchmark_data_smithi188_119427_object122016:head# 2024-04-01T19:42:44.436 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41b812f1:::benchmark_data_smithi188_119427_object139022:head# 2024-04-01T19:42:44.436 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41b94b1d:::benchmark_data_smithi188_119427_object81936:head# 2024-04-01T19:42:44.437 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41b967e6:::benchmark_data_smithi188_119427_object153519:head# 2024-04-01T19:42:44.437 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41ba351d:::benchmark_data_smithi188_119427_object135798:head# 2024-04-01T19:42:44.438 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41bbb464:::benchmark_data_smithi188_119427_object147952:head# 2024-04-01T19:42:44.438 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41bcead8:::benchmark_data_smithi188_119427_object137737:head# 2024-04-01T19:42:44.439 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41bd8f0a:::benchmark_data_smithi188_119427_object116328:head# 2024-04-01T19:42:44.439 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41be1d5a:::benchmark_data_smithi188_119427_object79754:head# 2024-04-01T19:42:44.440 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41be4856:::benchmark_data_smithi188_119427_object152593:head# 2024-04-01T19:42:44.440 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41bf0161:::benchmark_data_smithi188_119427_object161124:head# 2024-04-01T19:42:44.440 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41bf3ef1:::benchmark_data_smithi188_119427_object116765:head# 2024-04-01T19:42:44.441 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41c08ecf:::benchmark_data_smithi188_119427_object159204:head# 2024-04-01T19:42:44.441 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41c0e1a8:::benchmark_data_smithi188_119427_object89399:head# 2024-04-01T19:42:44.442 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:42:44.442 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41c11767:::benchmark_data_smithi188_119427_object151087:head# 2024-04-01T19:42:44.442 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41c144ba:::benchmark_data_smithi188_119427_object80411:head# 2024-04-01T19:42:44.443 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41c166c0:::benchmark_data_smithi188_119427_object107090:head# 2024-04-01T19:42:44.443 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41c1791f:::benchmark_data_smithi188_119427_object88824:head# 2024-04-01T19:42:44.444 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41c1f4c1:::benchmark_data_smithi188_119427_object126379:head# 2024-04-01T19:42:44.444 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41c2f5b6:::benchmark_data_smithi188_119427_object77144:head# 2024-04-01T19:42:44.445 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41c32c59:::benchmark_data_smithi188_119427_object109045:head# 2024-04-01T19:42:44.445 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41c3eee3:::benchmark_data_smithi188_119427_object125258:head# 2024-04-01T19:42:44.446 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41c45bf9:::benchmark_data_smithi188_119427_object139776:head# 2024-04-01T19:42:44.446 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41c476b8:::benchmark_data_smithi188_119427_object134797:head# 2024-04-01T19:42:44.447 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41c50d79:::benchmark_data_smithi188_119427_object149154:head# 2024-04-01T19:42:44.447 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41c51085:::benchmark_data_smithi188_119427_object149783:head# 2024-04-01T19:42:44.448 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41c5b7b5:::benchmark_data_smithi188_119427_object123193:head# 2024-04-01T19:42:44.448 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41c5cdfa:::benchmark_data_smithi188_119427_object156056:head# 2024-04-01T19:42:44.448 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41c7078d:::benchmark_data_smithi188_119427_object96762:head# 2024-04-01T19:42:44.449 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41c709d0:::benchmark_data_smithi188_119427_object143325:head# 2024-04-01T19:42:44.449 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41c78677:::benchmark_data_smithi188_119427_object84352:head# 2024-04-01T19:42:44.450 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41c808c3:::benchmark_data_smithi188_119427_object129683:head# 2024-04-01T19:42:44.450 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41c89e7e:::benchmark_data_smithi188_119427_object160094:head# 2024-04-01T19:42:44.451 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41ca5d96:::benchmark_data_smithi188_119427_object139006:head# 2024-04-01T19:42:44.451 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41caa4af:::benchmark_data_smithi188_119427_object100519:head# 2024-04-01T19:42:44.452 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41cb35f1:::benchmark_data_smithi188_119427_object114390:head# 2024-04-01T19:42:44.452 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41cb933b:::benchmark_data_smithi188_119427_object148878:head# 2024-04-01T19:42:44.453 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41d011c0:::benchmark_data_smithi188_119427_object72625:head# 2024-04-01T19:42:44.453 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41d074df:::benchmark_data_smithi188_119427_object78298:head# 2024-04-01T19:42:44.453 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41d0b9c9:::benchmark_data_smithi188_119427_object149491:head# 2024-04-01T19:42:44.454 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41d15c76:::benchmark_data_smithi188_119427_object147017:head# 2024-04-01T19:42:44.454 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41d17f9b:::benchmark_data_smithi188_119427_object122864:head# 2024-04-01T19:42:44.455 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41d1833e:::benchmark_data_smithi188_119427_object93070:head# 2024-04-01T19:42:44.455 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41d1a604:::benchmark_data_smithi188_119427_object76379:head# 2024-04-01T19:42:44.455 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41d2c65f:::benchmark_data_smithi188_119427_object134201:head# 2024-04-01T19:42:44.456 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41d30537:::benchmark_data_smithi188_119427_object73209:head# 2024-04-01T19:42:44.456 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41d44d04:::benchmark_data_smithi188_119427_object153224:head# 2024-04-01T19:42:44.457 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41d45252:::benchmark_data_smithi188_119427_object106557:head# 2024-04-01T19:42:44.458 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41d5a8d0:::benchmark_data_smithi188_119427_object108239:head# 2024-04-01T19:42:44.458 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41d5bae1:::benchmark_data_smithi188_119427_object130886:head# 2024-04-01T19:42:44.458 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41d84c22:::benchmark_data_smithi188_119427_object115560:head# 2024-04-01T19:42:44.459 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41d8f0e4:::benchmark_data_smithi188_119427_object76053:head# 2024-04-01T19:42:44.459 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41d91228:::benchmark_data_smithi188_119427_object107474:head# 2024-04-01T19:42:44.460 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:44.460 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:42:44.461 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41d97cac:::benchmark_data_smithi188_119427_object84742:head# 2024-04-01T19:42:44.461 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41d9d1de:::benchmark_data_smithi188_119427_object108537:head# 2024-04-01T19:42:44.461 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41db0f01:::benchmark_data_smithi188_119427_object114404:head# 2024-04-01T19:42:44.461 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41db2ced:::benchmark_data_smithi188_119427_object144694:head# 2024-04-01T19:42:44.464 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41dc34f5:::benchmark_data_smithi188_119427_object94296:head# 2024-04-01T19:42:44.464 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41dc5978:::benchmark_data_smithi188_119427_object160054:head# 2024-04-01T19:42:44.465 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41dc692c:::benchmark_data_smithi188_119427_object160734:head# 2024-04-01T19:42:44.465 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41dd22fe:::benchmark_data_smithi188_119427_object157161:head# 2024-04-01T19:42:44.466 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41ddc3b4:::benchmark_data_smithi188_119427_object114165:head# 2024-04-01T19:42:44.466 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41dde1d0:::benchmark_data_smithi188_119427_object106769:head# 2024-04-01T19:42:44.467 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41e01514:::benchmark_data_smithi188_119427_object126686:head# 2024-04-01T19:42:44.469 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41e14199:::benchmark_data_smithi188_119427_object90608:head# 2024-04-01T19:42:44.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41e3a268:::benchmark_data_smithi188_119427_object88334:head# 2024-04-01T19:42:44.471 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41e3d29c:::benchmark_data_smithi188_119427_object159932:head# 2024-04-01T19:42:44.471 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41e69291:::benchmark_data_smithi188_119427_object137924:head# 2024-04-01T19:42:44.471 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41e69ea8:::benchmark_data_smithi188_119427_object81583:head# 2024-04-01T19:42:44.472 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41e732e3:::benchmark_data_smithi188_119427_object132311:head# 2024-04-01T19:42:44.472 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41e848e7:::benchmark_data_smithi188_119427_object89402:head# 2024-04-01T19:42:44.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41eb5b89:::benchmark_data_smithi188_119427_object142477:head# 2024-04-01T19:42:44.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41ebc390:::benchmark_data_smithi188_119427_object130866:head# 2024-04-01T19:42:44.476 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41ec219d:::benchmark_data_smithi188_119427_object134003:head# 2024-04-01T19:42:44.476 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41ecda1c:::benchmark_data_smithi188_119427_object73138:head# 2024-04-01T19:42:44.477 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41ed874f:::benchmark_data_smithi188_119427_object112652:head# 2024-04-01T19:42:44.477 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41efbf45:::benchmark_data_smithi188_119427_object128568:head# 2024-04-01T19:42:44.478 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41f15c3c:::benchmark_data_smithi188_119427_object92357:head# 2024-04-01T19:42:44.478 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41f183a0:::benchmark_data_smithi188_119427_object101365:head# 2024-04-01T19:42:44.479 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41f1b5c3:::benchmark_data_smithi188_119427_object143075:head# 2024-04-01T19:42:44.479 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41f24f87:::benchmark_data_smithi188_119427_object89368:head# 2024-04-01T19:42:44.480 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41f2c16e:::benchmark_data_smithi188_119427_object109256:head# 2024-04-01T19:42:44.480 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41f31036:::benchmark_data_smithi188_119427_object116363:head# 2024-04-01T19:42:44.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41f32f17:::benchmark_data_smithi188_119427_object127117:head# 2024-04-01T19:42:44.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41f33e8f:::benchmark_data_smithi188_119427_object119502:head# 2024-04-01T19:42:44.482 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41f3f6a1:::benchmark_data_smithi188_119427_object131782:head# 2024-04-01T19:42:44.482 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41f40838:::benchmark_data_smithi188_119427_object83974:head# 2024-04-01T19:42:44.483 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41f48b93:::benchmark_data_smithi188_119427_object112022:head# 2024-04-01T19:42:44.483 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41f505cf:::benchmark_data_smithi188_119427_object91538:head# 2024-04-01T19:42:44.484 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41f88285:::benchmark_data_smithi188_119427_object96609:head# 2024-04-01T19:42:44.484 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41fa72c4:::benchmark_data_smithi188_119427_object80732:head# 2024-04-01T19:42:44.485 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41faf678:::benchmark_data_smithi188_119427_object128102:head# 2024-04-01T19:42:44.485 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41fb4f1c:::benchmark_data_smithi188_119427_object118582:head# 2024-04-01T19:42:44.485 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41fbbe62:::benchmark_data_smithi188_119427_object119132:head# 2024-04-01T19:42:44.486 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41fbc070:::benchmark_data_smithi188_119427_object86313:head# 2024-04-01T19:42:44.486 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41fc7699:::benchmark_data_smithi188_119427_object126726:head# 2024-04-01T19:42:44.487 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41fe69fb:::benchmark_data_smithi188_119427_object79802:head# 2024-04-01T19:42:44.488 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:41ff0049:::benchmark_data_smithi188_119427_object139917:head# 2024-04-01T19:42:44.488 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42002cef:::benchmark_data_smithi188_119427_object154186:head# 2024-04-01T19:42:44.488 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4201d210:::benchmark_data_smithi188_119427_object120170:head# 2024-04-01T19:42:44.489 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4202f307:::benchmark_data_smithi188_119427_object103206:head# 2024-04-01T19:42:44.489 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42034590:::benchmark_data_smithi188_119427_object124959:head# 2024-04-01T19:42:44.490 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4203d9ef:::benchmark_data_smithi188_119427_object132765:head# 2024-04-01T19:42:44.490 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42064362:::benchmark_data_smithi188_119427_object102733:head# 2024-04-01T19:42:44.491 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4206742e:::benchmark_data_smithi188_119427_object124982:head# 2024-04-01T19:42:44.491 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:420708fc:::benchmark_data_smithi188_119427_object162547:head# 2024-04-01T19:42:44.492 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42071444:::benchmark_data_smithi188_119427_object150192:head# 2024-04-01T19:42:44.492 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42075807:::benchmark_data_smithi188_119427_object89044:head# 2024-04-01T19:42:44.492 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4207b22c:::benchmark_data_smithi188_119427_object158091:head# 2024-04-01T19:42:44.493 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:420999f1:::benchmark_data_smithi188_119427_object74422:head# 2024-04-01T19:42:44.493 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:420a3a36:::benchmark_data_smithi188_119427_object94046:head# 2024-04-01T19:42:44.494 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:420a51cc:::benchmark_data_smithi188_119427_object94825:head# 2024-04-01T19:42:44.494 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:420a5f1d:::benchmark_data_smithi188_119427_object138876:head# 2024-04-01T19:42:44.495 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:420ab8e2:::benchmark_data_smithi188_119427_object95708:head# 2024-04-01T19:42:44.496 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:420b73f0:::benchmark_data_smithi188_119427_object78533:head# 2024-04-01T19:42:44.496 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:420bef5c:::benchmark_data_smithi188_119427_object74697:head# 2024-04-01T19:42:44.497 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:420c21ad:::benchmark_data_smithi188_119427_object127739:head# 2024-04-01T19:42:44.497 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:420c559c:::benchmark_data_smithi188_119427_object139542:head# 2024-04-01T19:42:44.498 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:420cbb7a:::benchmark_data_smithi188_119427_object91873:head# 2024-04-01T19:42:44.498 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:420d3072:::benchmark_data_smithi188_119427_object103916:head# 2024-04-01T19:42:44.499 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:420ee197:::benchmark_data_smithi188_119427_object147988:head# 2024-04-01T19:42:44.499 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4210ba46:::benchmark_data_smithi188_119427_object128360:head# 2024-04-01T19:42:44.500 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42116a99:::benchmark_data_smithi188_119427_object154910:head# 2024-04-01T19:42:44.500 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:421181ef:::benchmark_data_smithi188_119427_object105329:head# 2024-04-01T19:42:44.501 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42118de1:::benchmark_data_smithi188_119427_object157479:head# 2024-04-01T19:42:44.501 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:421219ee:::benchmark_data_smithi188_119427_object120514:head# 2024-04-01T19:42:44.502 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4213ac5e:::benchmark_data_smithi188_119427_object77213:head# 2024-04-01T19:42:44.502 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4213e2bc:::benchmark_data_smithi188_119427_object104621:head# 2024-04-01T19:42:44.502 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4214406d:::benchmark_data_smithi188_119427_object119283:head# 2024-04-01T19:42:44.503 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42150d4c:::benchmark_data_smithi188_119427_object105099:head# 2024-04-01T19:42:44.503 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42158028:::benchmark_data_smithi188_119427_object155212:head# 2024-04-01T19:42:44.504 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4215964c:::benchmark_data_smithi188_119427_object134941:head# 2024-04-01T19:42:44.504 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4216122f:::benchmark_data_smithi188_119427_object74012:head# 2024-04-01T19:42:44.505 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42161896:::benchmark_data_smithi188_119427_object146075:head# 2024-04-01T19:42:44.505 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42164fc0:::benchmark_data_smithi188_119427_object118267:head# 2024-04-01T19:42:44.505 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42178683:::benchmark_data_smithi188_119427_object73221:head# 2024-04-01T19:42:44.506 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:421790ba:::benchmark_data_smithi188_119427_object133939:head# 2024-04-01T19:42:44.507 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4217f534:::benchmark_data_smithi188_119427_object146609:head# 2024-04-01T19:42:44.507 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42180e31:::benchmark_data_smithi188_119427_object87338:head# 2024-04-01T19:42:44.507 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:421852fa:::benchmark_data_smithi188_119427_object145145:head# 2024-04-01T19:42:44.508 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:421a051e:::benchmark_data_smithi188_119427_object119900:head# 2024-04-01T19:42:44.508 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:421a2653:::benchmark_data_smithi188_119427_object109911:head# 2024-04-01T19:42:44.509 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:421a61d4:::benchmark_data_smithi188_119427_object139147:head# 2024-04-01T19:42:44.509 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:421a7378:::benchmark_data_smithi188_119427_object129366:head# 2024-04-01T19:42:44.510 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:421acc17:::benchmark_data_smithi188_119427_object90242:head# 2024-04-01T19:42:44.510 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:421ad3ee:::benchmark_data_smithi188_119427_object80016:head# 2024-04-01T19:42:44.511 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:421af30b:::benchmark_data_smithi188_119427_object146278:head# 2024-04-01T19:42:44.511 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:421cac00:::benchmark_data_smithi188_119427_object137185:head# 2024-04-01T19:42:44.511 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:421d52ad:::benchmark_data_smithi188_119427_object108330:head# 2024-04-01T19:42:44.512 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:421df666:::benchmark_data_smithi188_119427_object96803:head# 2024-04-01T19:42:44.512 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:421e4a29:::benchmark_data_smithi188_119427_object121615:head# 2024-04-01T19:42:44.513 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:421e5f61:::benchmark_data_smithi188_119427_object82843:head# 2024-04-01T19:42:44.513 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:421eab30:::benchmark_data_smithi188_119427_object120183:head# 2024-04-01T19:42:44.514 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:421f1340:::benchmark_data_smithi188_119427_object161756:head# 2024-04-01T19:42:44.514 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:421fe3ee:::benchmark_data_smithi188_119427_object114256:head# 2024-04-01T19:42:44.514 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42207e4f:::benchmark_data_smithi188_119427_object87062:head# 2024-04-01T19:42:44.515 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:422176f6:::benchmark_data_smithi188_119427_object93764:head# 2024-04-01T19:42:44.515 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4221d1b5:::benchmark_data_smithi188_119427_object79693:head# 2024-04-01T19:42:44.516 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4222bd41:::benchmark_data_smithi188_119427_object99979:head# 2024-04-01T19:42:44.516 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42233798:::benchmark_data_smithi188_119427_object146783:head# 2024-04-01T19:42:44.517 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4224cc1c:::benchmark_data_smithi188_119427_object102840:head# 2024-04-01T19:42:44.517 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:422665e9:::benchmark_data_smithi188_119427_object132911:head# 2024-04-01T19:42:44.517 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4226dda2:::benchmark_data_smithi188_119427_object134481:head# 2024-04-01T19:42:44.518 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4226e646:::benchmark_data_smithi188_119427_object114790:head# 2024-04-01T19:42:44.518 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4227c564:::benchmark_data_smithi188_119427_object132514:head# 2024-04-01T19:42:44.519 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42284578:::benchmark_data_smithi188_119427_object85296:head# 2024-04-01T19:42:44.519 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42285dcc:::benchmark_data_smithi188_119427_object149229:head# 2024-04-01T19:42:44.521 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42289c07:::benchmark_data_smithi188_119427_object142972:head# 2024-04-01T19:42:44.521 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4228cfe1:::benchmark_data_smithi188_119427_object72502:head# 2024-04-01T19:42:44.522 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4228d8b8:::benchmark_data_smithi188_119427_object118839:head# 2024-04-01T19:42:44.522 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42296a79:::benchmark_data_smithi188_119427_object158052:head# 2024-04-01T19:42:44.522 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:422a15df:::benchmark_data_smithi188_119427_object112722:head# 2024-04-01T19:42:44.523 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:422abdfb:::benchmark_data_smithi188_119427_object75084:head# 2024-04-01T19:42:44.523 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:422c0d8c:::benchmark_data_smithi188_119427_object144620:head# 2024-04-01T19:42:44.524 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:422c3bea:::benchmark_data_smithi188_119427_object108277:head# 2024-04-01T19:42:44.524 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:422de2db:::benchmark_data_smithi188_119427_object81883:head# 2024-04-01T19:42:44.525 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:422e9601:::benchmark_data_smithi188_119427_object135153:head# 2024-04-01T19:42:44.525 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:422eaed8:::benchmark_data_smithi188_119427_object112330:head# 2024-04-01T19:42:44.526 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:422ee0fa:::benchmark_data_smithi188_119427_object93117:head# 2024-04-01T19:42:44.527 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:422fb1b1:::benchmark_data_smithi188_119427_object105429:head# 2024-04-01T19:42:44.528 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42317295:::benchmark_data_smithi188_119427_object125735:head# 2024-04-01T19:42:44.528 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4233a149:::benchmark_data_smithi188_119427_object138147:head# 2024-04-01T19:42:44.529 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4233ae20:::benchmark_data_smithi188_119427_object145789:head# 2024-04-01T19:42:44.529 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4233d1c2:::benchmark_data_smithi188_119427_object138631:head# 2024-04-01T19:42:44.529 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4233dab4:::benchmark_data_smithi188_119427_object105516:head# 2024-04-01T19:42:44.530 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42340a11:::benchmark_data_smithi188_119427_object120549:head# 2024-04-01T19:42:44.530 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42355366:::benchmark_data_smithi188_119427_object108688:head# 2024-04-01T19:42:44.531 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4235acbb:::benchmark_data_smithi188_119427_object90470:head# 2024-04-01T19:42:44.531 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4235c397:::benchmark_data_smithi188_119427_object74717:head# 2024-04-01T19:42:44.531 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4235e34f:::benchmark_data_smithi188_119427_object152148:head# 2024-04-01T19:42:44.533 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:423616e1:::benchmark_data_smithi188_119427_object155503:head# 2024-04-01T19:42:44.533 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42363395:::benchmark_data_smithi188_119427_object101895:head# 2024-04-01T19:42:44.533 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4236ad40:::benchmark_data_smithi188_119427_object72703:head# 2024-04-01T19:42:44.534 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4239612c:::benchmark_data_smithi188_119427_object128240:head# 2024-04-01T19:42:44.538 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4239e327:::benchmark_data_smithi188_119427_object148841:head# 2024-04-01T19:42:44.538 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:423aee3b:::benchmark_data_smithi188_119427_object108762:head# 2024-04-01T19:42:44.538 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:423daae6:::benchmark_data_smithi188_119427_object133971:head# 2024-04-01T19:42:44.538 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:423de6fe:::benchmark_data_smithi188_119427_object147873:head# 2024-04-01T19:42:44.538 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:423f2044:::benchmark_data_smithi188_119427_object84709:head# 2024-04-01T19:42:44.538 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:423fa993:::benchmark_data_smithi188_119427_object92527:head# 2024-04-01T19:42:44.539 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42408a2b:::benchmark_data_smithi188_119427_object85190:head# 2024-04-01T19:42:44.539 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42411c54:::benchmark_data_smithi188_119427_object149270:head# 2024-04-01T19:42:44.539 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42427e00:::benchmark_data_smithi188_119427_object102599:head# 2024-04-01T19:42:44.539 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4242ef24:::benchmark_data_smithi188_119427_object101837:head# 2024-04-01T19:42:44.541 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:424357a3:::benchmark_data_smithi188_119427_object80881:head# 2024-04-01T19:42:44.541 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4243d1a9:::benchmark_data_smithi188_119427_object79411:head# 2024-04-01T19:42:44.541 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42440e43:::benchmark_data_smithi188_119427_object100379:head# 2024-04-01T19:42:44.542 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42442f4d:::benchmark_data_smithi188_119427_object73333:head# 2024-04-01T19:42:44.542 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:424466d4:::benchmark_data_smithi188_119427_object161168:head# 2024-04-01T19:42:44.543 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42448f14:::benchmark_data_smithi188_119427_object105900:head# 2024-04-01T19:42:44.543 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4244b839:::benchmark_data_smithi188_119427_object93591:head# 2024-04-01T19:42:44.544 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:424561fe:::benchmark_data_smithi188_119427_object128833:head# 2024-04-01T19:42:44.544 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:424605ad:::benchmark_data_smithi188_119427_object133304:head# 2024-04-01T19:42:44.545 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42464474:::benchmark_data_smithi188_119427_object148931:head# 2024-04-01T19:42:44.545 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:424654d6:::benchmark_data_smithi188_119427_object147056:head# 2024-04-01T19:42:44.545 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4247d6b5:::benchmark_data_smithi188_119427_object161604:head# 2024-04-01T19:42:44.546 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42489d95:::benchmark_data_smithi188_119427_object89918:head# 2024-04-01T19:42:44.546 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:424979fd:::benchmark_data_smithi188_119427_object154500:head# 2024-04-01T19:42:44.547 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:424994f7:::benchmark_data_smithi188_119427_object138947:head# 2024-04-01T19:42:44.548 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4249c273:::benchmark_data_smithi188_119427_object161761:head# 2024-04-01T19:42:44.548 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:424a7f8e:::benchmark_data_smithi188_119427_object142080:head# 2024-04-01T19:42:44.549 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:424ab745:::benchmark_data_smithi188_119427_object96577:head# 2024-04-01T19:42:44.549 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:424ad024:::benchmark_data_smithi188_119427_object108308:head# 2024-04-01T19:42:44.550 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:424b7603:::benchmark_data_smithi188_119427_object135159:head# 2024-04-01T19:42:44.551 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:424b9f03:::benchmark_data_smithi188_119427_object130756:head# 2024-04-01T19:42:44.552 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:424ba5c9:::benchmark_data_smithi188_119427_object101073:head# 2024-04-01T19:42:44.552 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:424bcbe4:::benchmark_data_smithi188_119427_object96011:head# 2024-04-01T19:42:44.552 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:424bcf69:::benchmark_data_smithi188_119427_object139261:head# 2024-04-01T19:42:44.553 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:424ccbaa:::benchmark_data_smithi188_119427_object146540:head# 2024-04-01T19:42:44.553 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:424d7d49:::benchmark_data_smithi188_119427_object112860:head# 2024-04-01T19:42:44.554 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:424ee06a:::benchmark_data_smithi188_119427_object155646:head# 2024-04-01T19:42:44.555 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:424f63d4:::benchmark_data_smithi188_119427_object152505:head# 2024-04-01T19:42:44.555 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:424f6ded:::benchmark_data_smithi188_119427_object156042:head# 2024-04-01T19:42:44.556 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4250f902:::benchmark_data_smithi188_119427_object146353:head# 2024-04-01T19:42:44.556 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42510de5:::benchmark_data_smithi188_119427_object153591:head# 2024-04-01T19:42:44.556 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4251df78:::benchmark_data_smithi188_119427_object123209:head# 2024-04-01T19:42:44.557 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42527b16:::benchmark_data_smithi188_119427_object124858:head# 2024-04-01T19:42:44.557 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4253ef08:::benchmark_data_smithi188_119427_object145010:head# 2024-04-01T19:42:44.558 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4254cb93:::benchmark_data_smithi188_119427_object88224:head# 2024-04-01T19:42:44.558 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4254d860:::benchmark_data_smithi188_119427_object116342:head# 2024-04-01T19:42:44.559 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4256b138:::benchmark_data_smithi188_119427_object82464:head# 2024-04-01T19:42:44.559 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4256cd8f:::benchmark_data_smithi188_119427_object161652:head# 2024-04-01T19:42:44.559 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42581da3:::benchmark_data_smithi188_119427_object120319:head# 2024-04-01T19:42:44.560 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42585048:::benchmark_data_smithi188_119427_object101537:head# 2024-04-01T19:42:44.560 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:425a2c12:::benchmark_data_smithi188_119427_object145964:head# 2024-04-01T19:42:44.561 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:425a52f5:::benchmark_data_smithi188_119427_object111450:head# 2024-04-01T19:42:44.561 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:42:44.562 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:425cd39b:::benchmark_data_smithi188_119427_object155530:head# 2024-04-01T19:42:44.562 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:425ce207:::benchmark_data_smithi188_119427_object140646:head# 2024-04-01T19:42:44.562 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:425d38d6:::benchmark_data_smithi188_119427_object135104:head# 2024-04-01T19:42:44.563 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:425dd172:::benchmark_data_smithi188_119427_object146150:head# 2024-04-01T19:42:44.563 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:425e94fa:::benchmark_data_smithi188_119427_object143436:head# 2024-04-01T19:42:44.563 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:425e9e6c:::benchmark_data_smithi188_119427_object107753:head# 2024-04-01T19:42:44.564 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:425f03ac:::benchmark_data_smithi188_119427_object87340:head# 2024-04-01T19:42:44.565 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:425f7a06:::benchmark_data_smithi188_119427_object89529:head# 2024-04-01T19:42:44.565 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42605efb:::benchmark_data_smithi188_119427_object163708:head# 2024-04-01T19:42:44.565 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4263fa64:::benchmark_data_smithi188_119427_object164236:head# 2024-04-01T19:42:44.565 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42647698:::benchmark_data_smithi188_119427_object90540:head# 2024-04-01T19:42:44.566 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4267a8e6:::benchmark_data_smithi188_119427_object83158:head# 2024-04-01T19:42:44.566 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4267cb2b:::benchmark_data_smithi188_119427_object107031:head# 2024-04-01T19:42:44.567 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4268750b:::benchmark_data_smithi188_119427_object74313:head# 2024-04-01T19:42:44.567 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:426bda3d:::benchmark_data_smithi188_119427_object110622:head# 2024-04-01T19:42:44.568 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:426c0241:::benchmark_data_smithi188_119427_object134485:head# 2024-04-01T19:42:44.568 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:426d13c4:::benchmark_data_smithi188_119427_object147620:head# 2024-04-01T19:42:44.569 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:426d6d5b:::benchmark_data_smithi188_119427_object84470:head# 2024-04-01T19:42:44.569 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:426e644d:::benchmark_data_smithi188_119427_object162586:head# 2024-04-01T19:42:44.570 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:426e858f:::benchmark_data_smithi188_119427_object130166:head# 2024-04-01T19:42:44.571 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42700d70:::benchmark_data_smithi188_119427_object111947:head# 2024-04-01T19:42:44.572 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42701167:::benchmark_data_smithi188_119427_object114426:head# 2024-04-01T19:42:44.572 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42712cf1:::benchmark_data_smithi188_119427_object132594:head# 2024-04-01T19:42:44.572 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:427182fe:::benchmark_data_smithi188_119427_object105950:head# 2024-04-01T19:42:44.573 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42723523:::benchmark_data_smithi188_119427_object104041:head# 2024-04-01T19:42:44.573 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4272464c:::benchmark_data_smithi188_119427_object146012:head# 2024-04-01T19:42:44.574 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42725e1e:::benchmark_data_smithi188_119427_object109505:head# 2024-04-01T19:42:44.574 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42728915:::benchmark_data_smithi188_119427_object75543:head# 2024-04-01T19:42:44.575 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4272dcc2:::benchmark_data_smithi188_119427_object107604:head# 2024-04-01T19:42:44.575 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4272e9c8:::benchmark_data_smithi188_119427_object104458:head# 2024-04-01T19:42:44.576 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42735651:::benchmark_data_smithi188_119427_object114050:head# 2024-04-01T19:42:44.576 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4274493a:::benchmark_data_smithi188_119427_object146044:head# 2024-04-01T19:42:44.576 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4274d119:::benchmark_data_smithi188_119427_object151130:head# 2024-04-01T19:42:44.577 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4275167b:::benchmark_data_smithi188_119427_object115511:head# 2024-04-01T19:42:44.577 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4275ab73:::benchmark_data_smithi188_119427_object155508:head# 2024-04-01T19:42:44.578 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:427651f5:::benchmark_data_smithi188_119427_object164553:head# 2024-04-01T19:42:44.578 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4276abf6:::benchmark_data_smithi188_119427_object89907:head# 2024-04-01T19:42:44.579 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42783ca7:::benchmark_data_smithi188_119427_object116938:head# 2024-04-01T19:42:44.579 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42792b38:::benchmark_data_smithi188_119427_object160632:head# 2024-04-01T19:42:44.580 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4279dfe4:::benchmark_data_smithi188_119427_object131636:head# 2024-04-01T19:42:44.580 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4279f2fd:::benchmark_data_smithi188_119427_object121848:head# 2024-04-01T19:42:44.581 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:427ad979:::benchmark_data_smithi188_119427_object130675:head# 2024-04-01T19:42:44.581 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:427c4fc7:::benchmark_data_smithi188_119427_object118078:head# 2024-04-01T19:42:44.582 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:427d2cae:::benchmark_data_smithi188_119427_object121569:head# 2024-04-01T19:42:44.582 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:427e00dd:::benchmark_data_smithi188_119427_object135399:head# 2024-04-01T19:42:44.583 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:427e9e63:::benchmark_data_smithi188_119427_object117299:head# 2024-04-01T19:42:44.583 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4280015f:::benchmark_data_smithi188_119427_object151557:head# 2024-04-01T19:42:44.584 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42803ee3:::benchmark_data_smithi188_119427_object85580:head# 2024-04-01T19:42:44.584 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:428392fd:::benchmark_data_smithi188_119427_object138471:head# 2024-04-01T19:42:44.585 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4284dcae:::benchmark_data_smithi188_119427_object107712:head# 2024-04-01T19:42:44.585 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:428527f6:::benchmark_data_smithi188_119427_object87368:head# 2024-04-01T19:42:44.586 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4285ff5a:::benchmark_data_smithi188_119427_object157254:head# 2024-04-01T19:42:44.586 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4287087f:::benchmark_data_smithi188_119427_object144691:head# 2024-04-01T19:42:44.586 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42873c67:::benchmark_data_smithi188_119427_object108170:head# 2024-04-01T19:42:44.587 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4287b8d0:::benchmark_data_smithi188_119427_object91552:head# 2024-04-01T19:42:44.587 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42889ac7:::benchmark_data_smithi188_119427_object124621:head# 2024-04-01T19:42:44.588 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:428a5d5b:::benchmark_data_smithi188_119427_object161980:head# 2024-04-01T19:42:44.588 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:428ae763:::benchmark_data_smithi188_119427_object107248:head# 2024-04-01T19:42:44.589 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:428cc0ed:::benchmark_data_smithi188_119427_object83556:head# 2024-04-01T19:42:44.589 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:428d982d:::benchmark_data_smithi188_119427_object126741:head# 2024-04-01T19:42:44.590 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:428f4e2d:::benchmark_data_smithi188_119427_object148002:head# 2024-04-01T19:42:44.590 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:428f5228:::benchmark_data_smithi188_119427_object134630:head# 2024-04-01T19:42:44.590 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42902220:::benchmark_data_smithi188_119427_object76854:head# 2024-04-01T19:42:44.591 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42902e94:::benchmark_data_smithi188_119427_object163202:head# 2024-04-01T19:42:44.592 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42909419:::benchmark_data_smithi188_119427_object112668:head# 2024-04-01T19:42:44.592 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4290dca6:::benchmark_data_smithi188_119427_object139193:head# 2024-04-01T19:42:44.593 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4291f057:::benchmark_data_smithi188_119427_object125473:head# 2024-04-01T19:42:44.593 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42922966:::benchmark_data_smithi188_119427_object85305:head# 2024-04-01T19:42:44.593 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4293dc8c:::benchmark_data_smithi188_119427_object128949:head# 2024-04-01T19:42:44.594 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42940c35:::benchmark_data_smithi188_119427_object104601:head# 2024-04-01T19:42:44.595 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:44.595 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4294ea1e:::benchmark_data_smithi188_119427_object116374:head# 2024-04-01T19:42:44.595 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42957548:::benchmark_data_smithi188_119427_object81259:head# 2024-04-01T19:42:44.595 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42959637:::benchmark_data_smithi188_119427_object96944:head# 2024-04-01T19:42:44.596 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42970b45:::benchmark_data_smithi188_119427_object95721:head# 2024-04-01T19:42:44.596 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42973bc5:::benchmark_data_smithi188_119427_object95181:head# 2024-04-01T19:42:44.597 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42982bd3:::benchmark_data_smithi188_119427_object133425:head# 2024-04-01T19:42:44.597 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4299c459:::benchmark_data_smithi188_119427_object128784:head# 2024-04-01T19:42:44.597 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:429a212e:::benchmark_data_smithi188_119427_object135859:head# 2024-04-01T19:42:44.598 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:429a7e50:::benchmark_data_smithi188_119427_object95775:head# 2024-04-01T19:42:44.598 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:429ac12b:::benchmark_data_smithi188_119427_object78788:head# 2024-04-01T19:42:44.599 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:429b9af2:::benchmark_data_smithi188_119427_object122428:head# 2024-04-01T19:42:44.599 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:429c0bba:::benchmark_data_smithi188_119427_object103058:head# 2024-04-01T19:42:44.600 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:429c2331:::benchmark_data_smithi188_119427_object136948:head# 2024-04-01T19:42:44.600 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:429c5eab:::benchmark_data_smithi188_119427_object140240:head# 2024-04-01T19:42:44.600 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:429c8ee6:::benchmark_data_smithi188_119427_object91048:head# 2024-04-01T19:42:44.601 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:429d7a70:::benchmark_data_smithi188_119427_object111194:head# 2024-04-01T19:42:44.601 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:429da1e1:::benchmark_data_smithi188_119427_object118257:head# 2024-04-01T19:42:44.602 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:429e9f5b:::benchmark_data_smithi188_119427_object88688:head# 2024-04-01T19:42:44.602 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:429f8992:::benchmark_data_smithi188_119427_object121909:head# 2024-04-01T19:42:44.603 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42a090e3:::benchmark_data_smithi188_119427_object118817:head# 2024-04-01T19:42:44.603 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42a15d1f:::benchmark_data_smithi188_119427_object72510:head# 2024-04-01T19:42:44.604 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42a1f3fe:::benchmark_data_smithi188_119427_object130588:head# 2024-04-01T19:42:44.605 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42a40815:::benchmark_data_smithi188_119427_object116645:head# 2024-04-01T19:42:44.605 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42a45342:::benchmark_data_smithi188_119427_object136025:head# 2024-04-01T19:42:44.605 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42a487f3:::benchmark_data_smithi188_119427_object131580:head# 2024-04-01T19:42:44.605 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42a52f91:::benchmark_data_smithi188_119427_object76654:head# 2024-04-01T19:42:44.606 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42a5d5e1:::benchmark_data_smithi188_119427_object128080:head# 2024-04-01T19:42:44.606 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42a68af1:::benchmark_data_smithi188_119427_object99250:head# 2024-04-01T19:42:44.607 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42a70e72:::benchmark_data_smithi188_119427_object118039:head# 2024-04-01T19:42:44.607 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42a879b5:::benchmark_data_smithi188_119427_object163021:head# 2024-04-01T19:42:44.608 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42a946d5:::benchmark_data_smithi188_119427_object111163:head# 2024-04-01T19:42:44.608 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42ad0669:::benchmark_data_smithi188_119427_object116950:head# 2024-04-01T19:42:44.608 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42ad15f2:::benchmark_data_smithi188_119427_object162126:head# 2024-04-01T19:42:44.609 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42aea3c3:::benchmark_data_smithi188_119427_object92014:head# 2024-04-01T19:42:44.609 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42af7c91:::benchmark_data_smithi188_119427_object92700:head# 2024-04-01T19:42:44.610 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42b00e8b:::benchmark_data_smithi188_119427_object135024:head# 2024-04-01T19:42:44.610 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42b181e5:::benchmark_data_smithi188_119427_object151694:head# 2024-04-01T19:42:44.610 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42b2a227:::benchmark_data_smithi188_119427_object98227:head# 2024-04-01T19:42:44.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42b2a2cd:::benchmark_data_smithi188_119427_object125984:head# 2024-04-01T19:42:44.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42b3431c:::benchmark_data_smithi188_119427_object117386:head# 2024-04-01T19:42:44.612 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42b56a64:::benchmark_data_smithi188_119427_object133677:head# 2024-04-01T19:42:44.612 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42b589b0:::benchmark_data_smithi188_119427_object133278:head# 2024-04-01T19:42:44.613 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42b6690b:::benchmark_data_smithi188_119427_object139136:head# 2024-04-01T19:42:44.613 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42b691fe:::benchmark_data_smithi188_119427_object111460:head# 2024-04-01T19:42:44.613 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42b6e38b:::benchmark_data_smithi188_119427_object128857:head# 2024-04-01T19:42:44.614 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42b723b7:::benchmark_data_smithi188_119427_object131408:head# 2024-04-01T19:42:44.615 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42b75adc:::benchmark_data_smithi188_119427_object157446:head# 2024-04-01T19:42:44.615 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42b7d009:::benchmark_data_smithi188_119427_object161333:head# 2024-04-01T19:42:44.615 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42b91379:::benchmark_data_smithi188_119427_object136034:head# 2024-04-01T19:42:44.616 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42b96783:::benchmark_data_smithi188_119427_object105544:head# 2024-04-01T19:42:44.616 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42b98816:::benchmark_data_smithi188_119427_object99526:head# 2024-04-01T19:42:44.616 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42b9b880:::benchmark_data_smithi188_119427_object127980:head# 2024-04-01T19:42:44.617 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42baae26:::benchmark_data_smithi188_119427_object79483:head# 2024-04-01T19:42:44.617 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42bac9c0:::benchmark_data_smithi188_119427_object138571:head# 2024-04-01T19:42:44.618 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42bc8404:::benchmark_data_smithi188_119427_object120839:head# 2024-04-01T19:42:44.618 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42bcb1cb:::benchmark_data_smithi188_119427_object74167:head# 2024-04-01T19:42:44.619 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42bd973a:::benchmark_data_smithi188_119427_object155423:head# 2024-04-01T19:42:44.619 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42bdb5f7:::benchmark_data_smithi188_119427_object117741:head# 2024-04-01T19:42:44.619 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42be7779:::benchmark_data_smithi188_119427_object146479:head# 2024-04-01T19:42:44.620 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42bfd93c:::benchmark_data_smithi188_119427_object107236:head# 2024-04-01T19:42:44.621 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42c230e4:::benchmark_data_smithi188_119427_object104776:head# 2024-04-01T19:42:44.621 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42c35d6d:::benchmark_data_smithi188_119427_object93474:head# 2024-04-01T19:42:44.621 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42c38965:::benchmark_data_smithi188_119427_object153039:head# 2024-04-01T19:42:44.622 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42c3b1e8:::benchmark_data_smithi188_119427_object114951:head# 2024-04-01T19:42:44.622 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42c49297:::benchmark_data_smithi188_119427_object96750:head# 2024-04-01T19:42:44.623 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42c5ac05:::benchmark_data_smithi188_119427_object131296:head# 2024-04-01T19:42:44.623 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42c605c3:::benchmark_data_smithi188_119427_object138706:head# 2024-04-01T19:42:44.624 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42c64fb0:::benchmark_data_smithi188_119427_object154900:head# 2024-04-01T19:42:44.624 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42c7bf8f:::benchmark_data_smithi188_119427_object85555:head# 2024-04-01T19:42:44.624 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42c83268:::benchmark_data_smithi188_119427_object117928:head# 2024-04-01T19:42:44.625 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42c83bc0:::benchmark_data_smithi188_119427_object159810:head# 2024-04-01T19:42:44.625 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42c84524:::benchmark_data_smithi188_119427_object144370:head# 2024-04-01T19:42:44.626 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42c89145:::benchmark_data_smithi188_119427_object115140:head# 2024-04-01T19:42:44.626 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42c91cca:::benchmark_data_smithi188_119427_object145660:head# 2024-04-01T19:42:44.626 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42c94464:::benchmark_data_smithi188_119427_object102035:head# 2024-04-01T19:42:44.627 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42c97124:::benchmark_data_smithi188_119427_object131095:head# 2024-04-01T19:42:44.627 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42c9ebdd:::benchmark_data_smithi188_119427_object73010:head# 2024-04-01T19:42:44.628 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42cb4204:::benchmark_data_smithi188_119427_object102476:head# 2024-04-01T19:42:44.628 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42cbd271:::benchmark_data_smithi188_119427_object143009:head# 2024-04-01T19:42:44.629 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42cd0059:::benchmark_data_smithi188_119427_object128193:head# 2024-04-01T19:42:44.629 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42cf8e3d:::benchmark_data_smithi188_119427_object111757:head# 2024-04-01T19:42:44.630 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42d1c3c1:::benchmark_data_smithi188_119427_object75940:head# 2024-04-01T19:42:44.631 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42d1d6c4:::benchmark_data_smithi188_119427_object133062:head# 2024-04-01T19:42:44.631 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42d21cc6:::benchmark_data_smithi188_119427_object145781:head# 2024-04-01T19:42:44.632 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42d22065:::benchmark_data_smithi188_119427_object134338:head# 2024-04-01T19:42:44.632 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42d29ab1:::benchmark_data_smithi188_119427_object156359:head# 2024-04-01T19:42:44.633 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42d365b3:::benchmark_data_smithi188_119427_object156484:head# 2024-04-01T19:42:44.633 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42d57efc:::benchmark_data_smithi188_119427_object90966:head# 2024-04-01T19:42:44.633 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42d58926:::benchmark_data_smithi188_119427_object110064:head# 2024-04-01T19:42:44.634 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42d5a59e:::benchmark_data_smithi188_119427_object160301:head# 2024-04-01T19:42:44.634 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42d5b160:::benchmark_data_smithi188_119427_object148855:head# 2024-04-01T19:42:44.635 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42d616d0:::benchmark_data_smithi188_119427_object164484:head# 2024-04-01T19:42:44.635 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42d63c3a:::benchmark_data_smithi188_119427_object86847:head# 2024-04-01T19:42:44.636 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42d64888:::benchmark_data_smithi188_119427_object84204:head# 2024-04-01T19:42:44.636 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42d78caa:::benchmark_data_smithi188_119427_object133690:head# 2024-04-01T19:42:44.637 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42d7f940:::benchmark_data_smithi188_119427_object113971:head# 2024-04-01T19:42:44.637 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42d8d681:::benchmark_data_smithi188_119427_object116607:head# 2024-04-01T19:42:44.637 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42d9bbb9:::benchmark_data_smithi188_119427_object153680:head# 2024-04-01T19:42:44.638 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42daac61:::benchmark_data_smithi188_119427_object79392:head# 2024-04-01T19:42:44.638 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42dac0d9:::benchmark_data_smithi188_119427_object119384:head# 2024-04-01T19:42:44.639 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42daf73a:::benchmark_data_smithi188_119427_object77661:head# 2024-04-01T19:42:44.639 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42db9c3c:::benchmark_data_smithi188_119427_object132482:head# 2024-04-01T19:42:44.640 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42dbf75e:::benchmark_data_smithi188_119427_object147459:head# 2024-04-01T19:42:44.640 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42dd11d4:::benchmark_data_smithi188_119427_object146680:head# 2024-04-01T19:42:44.641 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42dd464f:::benchmark_data_smithi188_119427_object148599:head# 2024-04-01T19:42:44.641 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42dd49ad:::benchmark_data_smithi188_119427_object78284:head# 2024-04-01T19:42:44.641 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42dd8cd7:::benchmark_data_smithi188_119427_object135241:head# 2024-04-01T19:42:44.642 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42de6c4f:::benchmark_data_smithi188_119427_object155941:head# 2024-04-01T19:42:44.642 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42df31b2:::benchmark_data_smithi188_119427_object116494:head# 2024-04-01T19:42:44.643 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42e02b17:::benchmark_data_smithi188_119427_object144071:head# 2024-04-01T19:42:44.643 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42e0b8b1:::benchmark_data_smithi188_119427_object157922:head# 2024-04-01T19:42:44.644 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42e10453:::benchmark_data_smithi188_119427_object84440:head# 2024-04-01T19:42:44.644 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42e14b48:::benchmark_data_smithi188_119427_object137339:head# 2024-04-01T19:42:44.645 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42e180ea:::benchmark_data_smithi188_119427_object138521:head# 2024-04-01T19:42:44.645 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42e188b5:::benchmark_data_smithi188_119427_object141321:head# 2024-04-01T19:42:44.645 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42e1deac:::benchmark_data_smithi188_119427_object153232:head# 2024-04-01T19:42:44.646 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42e25fcc:::benchmark_data_smithi188_119427_object82349:head# 2024-04-01T19:42:44.646 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42e2aa18:::benchmark_data_smithi188_119427_object121783:head# 2024-04-01T19:42:44.647 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42e351b5:::benchmark_data_smithi188_119427_object127569:head# 2024-04-01T19:42:44.647 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42e36b44:::benchmark_data_smithi188_119427_object95961:head# 2024-04-01T19:42:44.648 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42e48618:::benchmark_data_smithi188_119427_object130507:head# 2024-04-01T19:42:44.648 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42ea6715:::benchmark_data_smithi188_119427_object84583:head# 2024-04-01T19:42:44.649 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42ea951a:::benchmark_data_smithi188_119427_object91612:head# 2024-04-01T19:42:44.649 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42ea962e:::benchmark_data_smithi188_119427_object153503:head# 2024-04-01T19:42:44.651 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42ec9314:::benchmark_data_smithi188_119427_object154574:head# 2024-04-01T19:42:44.652 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42ed56e7:::benchmark_data_smithi188_119427_object106452:head# 2024-04-01T19:42:44.652 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42ee23af:::benchmark_data_smithi188_119427_object136719:head# 2024-04-01T19:42:44.652 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42ee33ba:::benchmark_data_smithi188_119427_object119959:head# 2024-04-01T19:42:44.652 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42ee63c3:::benchmark_data_smithi188_119427_object140299:head# 2024-04-01T19:42:44.652 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42ef1600:::benchmark_data_smithi188_119427_object111466:head# 2024-04-01T19:42:44.653 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42f1a8dc:::benchmark_data_smithi188_119427_object80609:head# 2024-04-01T19:42:44.653 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42f37759:::benchmark_data_smithi188_119427_object138958:head# 2024-04-01T19:42:44.653 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42f4092f:::benchmark_data_smithi188_119427_object91124:head# 2024-04-01T19:42:44.654 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42f4cae0:::benchmark_data_smithi188_119427_object160666:head# 2024-04-01T19:42:44.654 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42f4e19f:::benchmark_data_smithi188_119427_object114807:head# 2024-04-01T19:42:44.654 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42f51f2b:::benchmark_data_smithi188_119427_object102764:head# 2024-04-01T19:42:44.655 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42f56453:::benchmark_data_smithi188_119427_object124626:head# 2024-04-01T19:42:44.655 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42f60baa:::benchmark_data_smithi188_119427_object133404:head# 2024-04-01T19:42:44.656 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42f676ee:::benchmark_data_smithi188_119427_object157911:head# 2024-04-01T19:42:44.656 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42f6db34:::benchmark_data_smithi188_119427_object84744:head# 2024-04-01T19:42:44.657 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42f78d48:::benchmark_data_smithi188_119427_object138297:head# 2024-04-01T19:42:44.657 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42f7de10:::benchmark_data_smithi188_119427_object145276:head# 2024-04-01T19:42:44.658 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42f8289b:::benchmark_data_smithi188_119427_object91200:head# 2024-04-01T19:42:44.658 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42f93564:::benchmark_data_smithi188_119427_object123309:head# 2024-04-01T19:42:44.659 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42f9d8d3:::benchmark_data_smithi188_119427_object163128:head# 2024-04-01T19:42:44.659 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42fa7ba3:::benchmark_data_smithi188_119427_object163236:head# 2024-04-01T19:42:44.659 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42fa806f:::benchmark_data_smithi188_119427_object105710:head# 2024-04-01T19:42:44.660 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42fabd45:::benchmark_data_smithi188_119427_object98719:head# 2024-04-01T19:42:44.660 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42fbffc0:::benchmark_data_smithi188_119427_object123201:head# 2024-04-01T19:42:44.661 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42fcc8d5:::benchmark_data_smithi188_119427_object137231:head# 2024-04-01T19:42:44.661 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42fd6cd8:::benchmark_data_smithi188_119427_object128033:head# 2024-04-01T19:42:44.662 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42fdc059:::benchmark_data_smithi188_119427_object98372:head# 2024-04-01T19:42:44.662 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42fe9387:::benchmark_data_smithi188_119427_object95678:head# 2024-04-01T19:42:44.663 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42fea735:::benchmark_data_smithi188_119427_object163715:head# 2024-04-01T19:42:44.663 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:42ff28b0:::benchmark_data_smithi188_119427_object161847:head# 2024-04-01T19:42:44.664 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4301394f:::benchmark_data_smithi188_119427_object134262:head# 2024-04-01T19:42:44.664 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4301cecd:::benchmark_data_smithi188_119427_object92281:head# 2024-04-01T19:42:44.665 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4301e096:::benchmark_data_smithi188_119427_object158175:head# 2024-04-01T19:42:44.666 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4301fea3:::benchmark_data_smithi188_119427_object101207:head# 2024-04-01T19:42:44.666 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:430274b3:::benchmark_data_smithi188_119427_object120051:head# 2024-04-01T19:42:44.667 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43051a36:::benchmark_data_smithi188_119427_object151077:head# 2024-04-01T19:42:44.667 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43067e9f:::benchmark_data_smithi188_119427_object124238:head# 2024-04-01T19:42:44.668 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43069165:::benchmark_data_smithi188_119427_object88927:head# 2024-04-01T19:42:44.668 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:430698b8:::benchmark_data_smithi188_119427_object163747:head# 2024-04-01T19:42:44.668 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43090069:::benchmark_data_smithi188_119427_object81212:head# 2024-04-01T19:42:44.668 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:430bb384:::benchmark_data_smithi188_119427_object90958:head# 2024-04-01T19:42:44.669 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:430cd50b:::benchmark_data_smithi188_119427_object160953:head# 2024-04-01T19:42:44.669 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:430d3a6a:::benchmark_data_smithi188_119427_object132983:head# 2024-04-01T19:42:44.670 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:430d79c4:::benchmark_data_smithi188_119427_object77152:head# 2024-04-01T19:42:44.670 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:430e501d:::benchmark_data_smithi188_119427_object138739:head# 2024-04-01T19:42:44.671 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:430ef0bc:::benchmark_data_smithi188_119427_object157986:head# 2024-04-01T19:42:44.671 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:430f803d:::benchmark_data_smithi188_119427_object78036:head# 2024-04-01T19:42:44.671 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43100038:::benchmark_data_smithi188_119427_object164302:head# 2024-04-01T19:42:44.672 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:431137d5:::benchmark_data_smithi188_119427_object91018:head# 2024-04-01T19:42:44.672 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43114368:::benchmark_data_smithi188_119427_object76589:head# 2024-04-01T19:42:44.673 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4311b2e1:::benchmark_data_smithi188_119427_object128862:head# 2024-04-01T19:42:44.673 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4311cc5f:::benchmark_data_smithi188_119427_object151387:head# 2024-04-01T19:42:44.673 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4311f29d:::benchmark_data_smithi188_119427_object152224:head# 2024-04-01T19:42:44.674 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43126c66:::benchmark_data_smithi188_119427_object91321:head# 2024-04-01T19:42:44.674 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:431314fe:::benchmark_data_smithi188_119427_object86990:head# 2024-04-01T19:42:44.675 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43138d8a:::benchmark_data_smithi188_119427_object132913:head# 2024-04-01T19:42:44.675 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4314157f:::benchmark_data_smithi188_119427_object125441:head# 2024-04-01T19:42:44.676 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43151930:::benchmark_data_smithi188_119427_object77233:head# 2024-04-01T19:42:44.676 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4315cc5d:::benchmark_data_smithi188_119427_object147966:head# 2024-04-01T19:42:44.677 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4315e0bf:::benchmark_data_smithi188_119427_object95151:head# 2024-04-01T19:42:44.677 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4315f540:::benchmark_data_smithi188_119427_object149670:head# 2024-04-01T19:42:44.678 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4316a0cd:::benchmark_data_smithi188_119427_object153509:head# 2024-04-01T19:42:44.678 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43177349:::benchmark_data_smithi188_119427_object75199:head# 2024-04-01T19:42:44.678 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4317accd:::benchmark_data_smithi188_119427_object102721:head# 2024-04-01T19:42:44.679 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4318df4f:::benchmark_data_smithi188_119427_object94076:head# 2024-04-01T19:42:44.679 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4319566c:::benchmark_data_smithi188_119427_object89262:head# 2024-04-01T19:42:44.680 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4319ab32:::benchmark_data_smithi188_119427_object147833:head# 2024-04-01T19:42:44.680 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:431a335d:::benchmark_data_smithi188_119427_object126397:head# 2024-04-01T19:42:44.681 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:431b0c26:::benchmark_data_smithi188_119427_object89945:head# 2024-04-01T19:42:44.681 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:431c15f8:::benchmark_data_smithi188_119427_object155565:head# 2024-04-01T19:42:44.681 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:431c2fad:::benchmark_data_smithi188_119427_object130018:head# 2024-04-01T19:42:44.682 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:431c3ed1:::benchmark_data_smithi188_119427_object119622:head# 2024-04-01T19:42:44.682 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:431d1e3b:::benchmark_data_smithi188_119427_object86114:head# 2024-04-01T19:42:44.683 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:431db2dc:::benchmark_data_smithi188_119427_object89361:head# 2024-04-01T19:42:44.683 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:431db35f:::benchmark_data_smithi188_119427_object149513:head# 2024-04-01T19:42:44.684 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:431e900a:::benchmark_data_smithi188_119427_object82702:head# 2024-04-01T19:42:44.684 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:431f8f90:::benchmark_data_smithi188_119427_object122708:head# 2024-04-01T19:42:44.684 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:431fa5e7:::benchmark_data_smithi188_119427_object76381:head# 2024-04-01T19:42:44.685 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43205d9f:::benchmark_data_smithi188_119427_object152599:head# 2024-04-01T19:42:44.685 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43222e77:::benchmark_data_smithi188_119427_object110630:head# 2024-04-01T19:42:44.686 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43232169:::benchmark_data_smithi188_119427_object162923:head# 2024-04-01T19:42:44.686 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:432527ef:::benchmark_data_smithi188_119427_object104393:head# 2024-04-01T19:42:44.686 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43252c73:::benchmark_data_smithi188_119427_object143876:head# 2024-04-01T19:42:44.687 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:432537e3:::benchmark_data_smithi188_119427_object160510:head# 2024-04-01T19:42:44.687 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4325a02d:::benchmark_data_smithi188_119427_object83390:head# 2024-04-01T19:42:44.688 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4326434d:::benchmark_data_smithi188_119427_object140658:head# 2024-04-01T19:42:44.688 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4326ae08:::benchmark_data_smithi188_119427_object149831:head# 2024-04-01T19:42:44.689 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4326ed18:::benchmark_data_smithi188_119427_object130075:head# 2024-04-01T19:42:44.689 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:432840cc:::benchmark_data_smithi188_119427_object74917:head# 2024-04-01T19:42:44.689 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:432879eb:::benchmark_data_smithi188_119427_object153123:head# 2024-04-01T19:42:44.690 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:432911fc:::benchmark_data_smithi188_119427_object110248:head# 2024-04-01T19:42:44.690 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:432ad582:::benchmark_data_smithi188_119427_object101940:head# 2024-04-01T19:42:44.691 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:432b2d67:::benchmark_data_smithi188_119427_object122370:head# 2024-04-01T19:42:44.691 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:432b4bd7:::benchmark_data_smithi188_119427_object132640:head# 2024-04-01T19:42:44.691 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:432bcfb8:::benchmark_data_smithi188_119427_object120099:head# 2024-04-01T19:42:44.692 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:432db32a:::benchmark_data_smithi188_119427_object105064:head# 2024-04-01T19:42:44.692 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:432f79fd:::benchmark_data_smithi188_119427_object104988:head# 2024-04-01T19:42:44.693 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:432f88bb:::benchmark_data_smithi188_119427_object133423:head# 2024-04-01T19:42:44.693 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:432f994e:::benchmark_data_smithi188_119427_object153751:head# 2024-04-01T19:42:44.694 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43301d17:::benchmark_data_smithi188_119427_object107318:head# 2024-04-01T19:42:44.694 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:433074dc:::benchmark_data_smithi188_119427_object160741:head# 2024-04-01T19:42:44.695 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4330e89e:::benchmark_data_smithi188_119427_object75022:head# 2024-04-01T19:42:44.695 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43327a5b:::benchmark_data_smithi188_119427_object131239:head# 2024-04-01T19:42:44.696 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43330494:::benchmark_data_smithi188_119427_object126895:head# 2024-04-01T19:42:44.696 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4334449e:::benchmark_data_smithi188_119427_object108479:head# 2024-04-01T19:42:44.697 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4334bdab:::benchmark_data_smithi188_119427_object78053:head# 2024-04-01T19:42:44.697 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43357c45:::benchmark_data_smithi188_119427_object143608:head# 2024-04-01T19:42:44.697 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43360298:::benchmark_data_smithi188_119427_object142540:head# 2024-04-01T19:42:44.698 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4336039a:::benchmark_data_smithi188_119427_object153095:head# 2024-04-01T19:42:44.698 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:433650d1:::benchmark_data_smithi188_119427_object105350:head# 2024-04-01T19:42:44.699 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:433754b3:::benchmark_data_smithi188_119427_object83840:head# 2024-04-01T19:42:44.699 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4337576f:::benchmark_data_smithi188_119427_object101084:head# 2024-04-01T19:42:44.700 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43376d7d:::benchmark_data_smithi188_119427_object127498:head# 2024-04-01T19:42:44.700 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4337bfd1:::benchmark_data_smithi188_119427_object143817:head# 2024-04-01T19:42:44.700 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4338586f:::benchmark_data_smithi188_119427_object98853:head# 2024-04-01T19:42:44.701 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4339c2d7:::benchmark_data_smithi188_119427_object148453:head# 2024-04-01T19:42:44.701 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:433a24d6:::benchmark_data_smithi188_119427_object111815:head# 2024-04-01T19:42:44.702 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:433a6395:::benchmark_data_smithi188_119427_object142894:head# 2024-04-01T19:42:44.702 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:433d1897:::benchmark_data_smithi188_119427_object148282:head# 2024-04-01T19:42:44.703 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:433dc06d:::benchmark_data_smithi188_119427_object127843:head# 2024-04-01T19:42:44.703 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:433e0b0d:::benchmark_data_smithi188_119427_object131843:head# 2024-04-01T19:42:44.703 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:433f16f6:::benchmark_data_smithi188_119427_object126538:head# 2024-04-01T19:42:44.704 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43418ad4:::benchmark_data_smithi188_119427_object139334:head# 2024-04-01T19:42:44.704 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4341b56a:::benchmark_data_smithi188_119427_object77132:head# 2024-04-01T19:42:44.705 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4341f6a0:::benchmark_data_smithi188_119427_object77091:head# 2024-04-01T19:42:44.706 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43427b53:::benchmark_data_smithi188_119427_object153326:head# 2024-04-01T19:42:44.706 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43428ee7:::benchmark_data_smithi188_119427_object103328:head# 2024-04-01T19:42:44.707 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43432de1:::benchmark_data_smithi188_119427_object82345:head# 2024-04-01T19:42:44.707 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:434346ce:::benchmark_data_smithi188_119427_object94934:head# 2024-04-01T19:42:44.708 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:434458ae:::benchmark_data_smithi188_119427_object112270:head# 2024-04-01T19:42:44.708 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43446747:::benchmark_data_smithi188_119427_object153301:head# 2024-04-01T19:42:44.709 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4344b027:::benchmark_data_smithi188_119427_object104008:head# 2024-04-01T19:42:44.709 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43453123:::benchmark_data_smithi188_119427_object102057:head# 2024-04-01T19:42:44.710 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4345c951:::benchmark_data_smithi188_119427_object131402:head# 2024-04-01T19:42:44.710 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43465853:::benchmark_data_smithi188_119427_object131235:head# 2024-04-01T19:42:44.710 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4348020b:::benchmark_data_smithi188_119427_object155133:head# 2024-04-01T19:42:44.711 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4348d363:::benchmark_data_smithi188_119427_object100003:head# 2024-04-01T19:42:44.711 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4349029b:::benchmark_data_smithi188_119427_object107796:head# 2024-04-01T19:42:44.712 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4349c8c1:::benchmark_data_smithi188_119427_object149844:head# 2024-04-01T19:42:44.712 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:434a3c83:::benchmark_data_smithi188_119427_object141020:head# 2024-04-01T19:42:44.713 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:434a78fb:::benchmark_data_smithi188_119427_object138158:head# 2024-04-01T19:42:44.713 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:434b7df3:::benchmark_data_smithi188_119427_object146974:head# 2024-04-01T19:42:44.714 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:434ba538:::benchmark_data_smithi188_119427_object158107:head# 2024-04-01T19:42:44.714 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:434c8f25:::benchmark_data_smithi188_119427_object149610:head# 2024-04-01T19:42:44.714 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:434cb212:::benchmark_data_smithi188_119427_object114628:head# 2024-04-01T19:42:44.715 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:434dbbc7:::benchmark_data_smithi188_119427_object164632:head# 2024-04-01T19:42:44.715 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:434e1b99:::benchmark_data_smithi188_119427_object81456:head# 2024-04-01T19:42:44.716 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:434e3e53:::benchmark_data_smithi188_119427_object126771:head# 2024-04-01T19:42:44.716 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:434f0a42:::benchmark_data_smithi188_119427_object145777:head# 2024-04-01T19:42:44.717 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:434f1966:::benchmark_data_smithi188_119427_object143447:head# 2024-04-01T19:42:44.717 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:434f67d6:::benchmark_data_smithi188_119427_object118616:head# 2024-04-01T19:42:44.717 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:434faee5:::benchmark_data_smithi188_119427_object73165:head# 2024-04-01T19:42:44.718 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:435005c3:::benchmark_data_smithi188_119427_object163265:head# 2024-04-01T19:42:44.718 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43500879:::benchmark_data_smithi188_119427_object124715:head# 2024-04-01T19:42:44.719 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43508de7:::benchmark_data_smithi188_119427_object106904:head# 2024-04-01T19:42:44.719 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43529c6f:::benchmark_data_smithi188_119427_object116292:head# 2024-04-01T19:42:44.720 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4352dc14:::benchmark_data_smithi188_119427_object94335:head# 2024-04-01T19:42:44.720 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43547aab:::benchmark_data_smithi188_119427_object82877:head# 2024-04-01T19:42:44.721 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4354ad2d:::benchmark_data_smithi188_119427_object135340:head# 2024-04-01T19:42:44.721 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4354fd3a:::benchmark_data_smithi188_119427_object123462:head# 2024-04-01T19:42:44.722 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43593bb1:::benchmark_data_smithi188_119427_object157398:head# 2024-04-01T19:42:44.723 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43597377:::benchmark_data_smithi188_119427_object109196:head# 2024-04-01T19:42:44.723 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:435b22cb:::benchmark_data_smithi188_119427_object160815:head# 2024-04-01T19:42:44.724 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:435b266f:::benchmark_data_smithi188_119427_object103959:head# 2024-04-01T19:42:44.724 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:435b4044:::benchmark_data_smithi188_119427_object125375:head# 2024-04-01T19:42:44.725 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:435bc240:::benchmark_data_smithi188_119427_object145222:head# 2024-04-01T19:42:44.725 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:435c2c5c:::benchmark_data_smithi188_119427_object141408:head# 2024-04-01T19:42:44.726 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:435c875c:::benchmark_data_smithi188_119427_object123461:head# 2024-04-01T19:42:44.726 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:435cdf6c:::benchmark_data_smithi188_119427_object96339:head# 2024-04-01T19:42:44.727 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:435dce77:::benchmark_data_smithi188_119427_object125994:head# 2024-04-01T19:42:44.727 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:435ddbf7:::benchmark_data_smithi188_119427_object155494:head# 2024-04-01T19:42:44.728 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:435deb16:::benchmark_data_smithi188_119427_object149787:head# 2024-04-01T19:42:44.728 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:435f8143:::benchmark_data_smithi188_119427_object85479:head# 2024-04-01T19:42:44.728 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4360529c:::benchmark_data_smithi188_119427_object156960:head# 2024-04-01T19:42:44.729 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4361bf5d:::benchmark_data_smithi188_119427_object119888:head# 2024-04-01T19:42:44.729 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:436378a3:::benchmark_data_smithi188_119427_object127981:head# 2024-04-01T19:42:44.730 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43649c32:::benchmark_data_smithi188_119427_object162831:head# 2024-04-01T19:42:44.730 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4364d1a3:::benchmark_data_smithi188_119427_object80404:head# 2024-04-01T19:42:44.731 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4365da2a:::benchmark_data_smithi188_119427_object118360:head# 2024-04-01T19:42:44.731 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4366acca:::benchmark_data_smithi188_119427_object161013:head# 2024-04-01T19:42:44.732 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4366f068:::benchmark_data_smithi188_119427_object139093:head# 2024-04-01T19:42:44.732 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4367545e:::benchmark_data_smithi188_119427_object134244:head# 2024-04-01T19:42:44.733 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4368d4c7:::benchmark_data_smithi188_119427_object85915:head# 2024-04-01T19:42:44.733 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:436a3c54:::benchmark_data_smithi188_119427_object118286:head# 2024-04-01T19:42:44.734 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:436ade76:::benchmark_data_smithi188_119427_object114955:head# 2024-04-01T19:42:44.734 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:436b1cd9:::benchmark_data_smithi188_119427_object97075:head# 2024-04-01T19:42:44.735 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:436b70a6:::benchmark_data_smithi188_119427_object142047:head# 2024-04-01T19:42:44.735 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:436ba8d7:::benchmark_data_smithi188_119427_object80704:head# 2024-04-01T19:42:44.735 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:436ca719:::benchmark_data_smithi188_119427_object115965:head# 2024-04-01T19:42:44.736 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:436dd1bb:::benchmark_data_smithi188_119427_object120688:head# 2024-04-01T19:42:44.736 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:436dee69:::benchmark_data_smithi188_119427_object123152:head# 2024-04-01T19:42:44.737 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:436e25ed:::benchmark_data_smithi188_119427_object82462:head# 2024-04-01T19:42:44.737 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:436ebe80:::benchmark_data_smithi188_119427_object75849:head# 2024-04-01T19:42:44.738 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4370a2aa:::benchmark_data_smithi188_119427_object78217:head# 2024-04-01T19:42:44.738 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4370c232:::benchmark_data_smithi188_119427_object75632:head# 2024-04-01T19:42:44.739 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4370c83b:::benchmark_data_smithi188_119427_object108579:head# 2024-04-01T19:42:44.739 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4370eb2f:::benchmark_data_smithi188_119427_object139021:head# 2024-04-01T19:42:44.739 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43710f4b:::benchmark_data_smithi188_119427_object155386:head# 2024-04-01T19:42:44.740 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43737f52:::benchmark_data_smithi188_119427_object148986:head# 2024-04-01T19:42:44.740 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4373d709:::benchmark_data_smithi188_119427_object94259:head# 2024-04-01T19:42:44.741 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4374cb11:::benchmark_data_smithi188_119427_object87115:head# 2024-04-01T19:42:44.741 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:437612fc:::benchmark_data_smithi188_119427_object87597:head# 2024-04-01T19:42:44.742 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4376e944:::benchmark_data_smithi188_119427_object153795:head# 2024-04-01T19:42:44.742 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43777055:::benchmark_data_smithi188_119427_object83149:head# 2024-04-01T19:42:44.742 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43788de3:::benchmark_data_smithi188_119427_object161452:head# 2024-04-01T19:42:44.743 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4378caa3:::benchmark_data_smithi188_119427_object76117:head# 2024-04-01T19:42:44.743 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:437965ce:::benchmark_data_smithi188_119427_object107287:head# 2024-04-01T19:42:44.744 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:437a6bb4:::benchmark_data_smithi188_119427_object96227:head# 2024-04-01T19:42:44.744 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:437c04eb:::benchmark_data_smithi188_119427_object100462:head# 2024-04-01T19:42:44.745 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:42:44.745 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:437cc833:::benchmark_data_smithi188_119427_object155515:head# 2024-04-01T19:42:44.745 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:437d2fd3:::benchmark_data_smithi188_119427_object106708:head# 2024-04-01T19:42:44.746 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:437da104:::benchmark_data_smithi188_119427_object154988:head# 2024-04-01T19:42:44.746 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:437dda0b:::benchmark_data_smithi188_119427_object141268:head# 2024-04-01T19:42:44.746 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:44 smithi022 ceph-mon[39439]: 5.0 scrub starts 2024-04-01T19:42:44.746 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:44 smithi022 ceph-mon[39439]: osdmap e435: 12 total, 11 up, 10 in 2024-04-01T19:42:44.747 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:44 smithi022 ceph-mon[39439]: 5.0 scrub ok 2024-04-01T19:42:44.747 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:44 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/942646564' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:42:44.748 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:44.748 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:437df359:::benchmark_data_smithi188_119427_object138168:head# 2024-04-01T19:42:44.748 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:437e3a69:::benchmark_data_smithi188_119427_object85846:head# 2024-04-01T19:42:44.748 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:437e445c:::benchmark_data_smithi188_119427_object100186:head# 2024-04-01T19:42:44.748 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:437eb02f:::benchmark_data_smithi188_119427_object125896:head# 2024-04-01T19:42:44.748 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:42:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:437ec781:::benchmark_data_smithi188_119427_object123710:head# 2024-04-01T19:42:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:437f08ec:::benchmark_data_smithi188_119427_object85786:head# 2024-04-01T19:42:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:437f8ed0:::benchmark_data_smithi188_119427_object136761:head# 2024-04-01T19:42:44.750 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:437fe56b:::benchmark_data_smithi188_119427_object80020:head# 2024-04-01T19:42:44.750 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43802863:::benchmark_data_smithi188_119427_object110792:head# 2024-04-01T19:42:44.750 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4380e9fc:::benchmark_data_smithi188_119427_object143057:head# 2024-04-01T19:42:44.751 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43821355:::benchmark_data_smithi188_119427_object107705:head# 2024-04-01T19:42:44.751 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4382cc54:::benchmark_data_smithi188_119427_object146758:head# 2024-04-01T19:42:44.752 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4382f9fe:::benchmark_data_smithi188_119427_object88328:head# 2024-04-01T19:42:44.752 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43843055:::benchmark_data_smithi188_119427_object160832:head# 2024-04-01T19:42:44.752 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43867d73:::benchmark_data_smithi188_119427_object85186:head# 2024-04-01T19:42:44.753 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4386bcd3:::benchmark_data_smithi188_119427_object131304:head# 2024-04-01T19:42:44.753 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:438827f4:::benchmark_data_smithi188_119427_object164042:head# 2024-04-01T19:42:44.754 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43883d55:::benchmark_data_smithi188_119427_object160413:head# 2024-04-01T19:42:44.754 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:438866a1:::benchmark_data_smithi188_119427_object163158:head# 2024-04-01T19:42:44.755 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4388803d:::benchmark_data_smithi188_119427_object102354:head# 2024-04-01T19:42:44.755 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4388b836:::benchmark_data_smithi188_119427_object163864:head# 2024-04-01T19:42:44.756 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43897393:::benchmark_data_smithi188_119427_object78433:head# 2024-04-01T19:42:44.756 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4389d01e:::benchmark_data_smithi188_119427_object159961:head# 2024-04-01T19:42:44.757 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:438a95d4:::benchmark_data_smithi188_119427_object122114:head# 2024-04-01T19:42:44.757 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:438ab0b3:::benchmark_data_smithi188_119427_object155829:head# 2024-04-01T19:42:44.757 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:438adf71:::benchmark_data_smithi188_119427_object86250:head# 2024-04-01T19:42:44.758 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:438b5181:::benchmark_data_smithi188_119427_object100487:head# 2024-04-01T19:42:44.758 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:438badd5:::benchmark_data_smithi188_119427_object144419:head# 2024-04-01T19:42:44.758 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:438bce00:::benchmark_data_smithi188_119427_object103646:head# 2024-04-01T19:42:44.759 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:438d37d4:::benchmark_data_smithi188_119427_object141828:head# 2024-04-01T19:42:44.759 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:438da4d9:::benchmark_data_smithi188_119427_object139857:head# 2024-04-01T19:42:44.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:44 smithi062 ceph-mon[44211]: 5.0 scrub starts 2024-04-01T19:42:44.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:44 smithi062 ceph-mon[44211]: osdmap e435: 12 total, 11 up, 10 in 2024-04-01T19:42:44.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:44 smithi062 ceph-mon[44211]: 5.0 scrub ok 2024-04-01T19:42:44.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:44 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/942646564' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:42:44.761 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:438e172c:::benchmark_data_smithi188_119427_object91764:head# 2024-04-01T19:42:44.761 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4392835e:::benchmark_data_smithi188_119427_object97962:head# 2024-04-01T19:42:44.761 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:439331ff:::benchmark_data_smithi188_119427_object155114:head# 2024-04-01T19:42:44.762 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:439346f8:::benchmark_data_smithi188_119427_object149119:head# 2024-04-01T19:42:44.762 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4394cf8e:::benchmark_data_smithi188_119427_object148363:head# 2024-04-01T19:42:44.762 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43988f69:::benchmark_data_smithi188_119427_object125379:head# 2024-04-01T19:42:44.763 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:439a2a6f:::benchmark_data_smithi188_119427_object104022:head# 2024-04-01T19:42:44.763 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:439aa50c:::benchmark_data_smithi188_119427_object93815:head# 2024-04-01T19:42:44.764 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:439af9cb:::benchmark_data_smithi188_119427_object105973:head# 2024-04-01T19:42:44.764 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:439ba92d:::benchmark_data_smithi188_119427_object85113:head# 2024-04-01T19:42:44.765 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:439bf38d:::benchmark_data_smithi188_119427_object88275:head# 2024-04-01T19:42:44.765 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:439bf98f:::benchmark_data_smithi188_119427_object143807:head# 2024-04-01T19:42:44.766 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:439c6625:::benchmark_data_smithi188_119427_object141812:head# 2024-04-01T19:42:44.766 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:439d6d28:::benchmark_data_smithi188_119427_object89341:head# 2024-04-01T19:42:44.766 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:439e2ab6:::benchmark_data_smithi188_119427_object78561:head# 2024-04-01T19:42:44.767 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:439e34f0:::benchmark_data_smithi188_119427_object143387:head# 2024-04-01T19:42:44.767 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:439f7c8b:::benchmark_data_smithi188_119427_object94555:head# 2024-04-01T19:42:44.768 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:439fee41:::benchmark_data_smithi188_119427_object163240:head# 2024-04-01T19:42:44.768 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43a03f54:::benchmark_data_smithi188_119427_object90995:head# 2024-04-01T19:42:44.769 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43a1264f:::benchmark_data_smithi188_119427_object156046:head# 2024-04-01T19:42:44.769 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43a2e33d:::benchmark_data_smithi188_119427_object105395:head# 2024-04-01T19:42:44.770 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43a3521d:::benchmark_data_smithi188_119427_object128770:head# 2024-04-01T19:42:44.770 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43a49f98:::benchmark_data_smithi188_119427_object117148:head# 2024-04-01T19:42:44.771 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43a52b2e:::benchmark_data_smithi188_119427_object77904:head# 2024-04-01T19:42:44.771 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43a569b3:::benchmark_data_smithi188_119427_object90719:head# 2024-04-01T19:42:44.771 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43a66791:::benchmark_data_smithi188_119427_object86938:head# 2024-04-01T19:42:44.772 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43a670ed:::benchmark_data_smithi188_119427_object157081:head# 2024-04-01T19:42:44.772 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43a68b55:::benchmark_data_smithi188_119427_object160920:head# 2024-04-01T19:42:44.773 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43a88169:::benchmark_data_smithi188_119427_object82002:head# 2024-04-01T19:42:44.773 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43a8b959:::benchmark_data_smithi188_119427_object138974:head# 2024-04-01T19:42:44.773 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43a92c0c:::benchmark_data_smithi188_119427_object96844:head# 2024-04-01T19:42:44.774 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43a93023:::benchmark_data_smithi188_119427_object93385:head# 2024-04-01T19:42:44.774 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43aa14fd:::benchmark_data_smithi188_119427_object146679:head# 2024-04-01T19:42:44.775 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43aa3644:::benchmark_data_smithi188_119427_object114461:head# 2024-04-01T19:42:44.775 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43ac987d:::benchmark_data_smithi188_119427_object123948:head# 2024-04-01T19:42:44.776 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43acb4b1:::benchmark_data_smithi188_119427_object156685:head# 2024-04-01T19:42:44.776 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43ae18cd:::benchmark_data_smithi188_119427_object77980:head# 2024-04-01T19:42:44.777 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43ae7d30:::benchmark_data_smithi188_119427_object107129:head# 2024-04-01T19:42:44.777 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43af9f9a:::benchmark_data_smithi188_119427_object150552:head# 2024-04-01T19:42:44.778 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43b0de9d:::benchmark_data_smithi188_119427_object147495:head# 2024-04-01T19:42:44.778 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43b11305:::benchmark_data_smithi188_119427_object149786:head# 2024-04-01T19:42:44.779 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43b13c05:::benchmark_data_smithi188_119427_object150050:head# 2024-04-01T19:42:44.779 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43b1b485:::benchmark_data_smithi188_119427_object135974:head# 2024-04-01T19:42:44.780 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43b1e1b2:::benchmark_data_smithi188_119427_object102543:head# 2024-04-01T19:42:44.780 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43b27020:::benchmark_data_smithi188_119427_object161508:head# 2024-04-01T19:42:44.781 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43b2ec13:::benchmark_data_smithi188_119427_object96701:head# 2024-04-01T19:42:44.781 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43b30a04:::benchmark_data_smithi188_119427_object129892:head# 2024-04-01T19:42:44.782 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43b3f32d:::benchmark_data_smithi188_119427_object149429:head# 2024-04-01T19:42:44.782 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43b47b68:::benchmark_data_smithi188_119427_object78840:head# 2024-04-01T19:42:44.782 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43b4e886:::benchmark_data_smithi188_119427_object101566:head# 2024-04-01T19:42:44.783 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43b878a4:::benchmark_data_smithi188_119427_object95729:head# 2024-04-01T19:42:44.783 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43b93785:::benchmark_data_smithi188_119427_object132914:head# 2024-04-01T19:42:44.784 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43b977f1:::benchmark_data_smithi188_119427_object113242:head# 2024-04-01T19:42:44.784 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43ba402b:::benchmark_data_smithi188_119427_object102750:head# 2024-04-01T19:42:44.785 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43bc728f:::benchmark_data_smithi188_119427_object140386:head# 2024-04-01T19:42:44.785 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43bcb2bf:::benchmark_data_smithi188_119427_object74927:head# 2024-04-01T19:42:44.786 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43bdbad4:::benchmark_data_smithi188_119427_object98061:head# 2024-04-01T19:42:44.786 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43be9b79:::benchmark_data_smithi188_119427_object73395:head# 2024-04-01T19:42:44.791 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43bf4e65:::benchmark_data_smithi188_119427_object74583:head# 2024-04-01T19:42:44.791 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43bfc3fa:::benchmark_data_smithi188_119427_object96843:head# 2024-04-01T19:42:44.792 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43bfd35b:::benchmark_data_smithi188_119427_object112870:head# 2024-04-01T19:42:44.792 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43c02836:::benchmark_data_smithi188_119427_object107071:head# 2024-04-01T19:42:44.792 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43c03433:::benchmark_data_smithi188_119427_object148531:head# 2024-04-01T19:42:44.792 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43c1407a:::benchmark_data_smithi188_119427_object137767:head# 2024-04-01T19:42:44.792 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43c17eb9:::benchmark_data_smithi188_119427_object96090:head# 2024-04-01T19:42:44.792 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43c1a217:::benchmark_data_smithi188_119427_object146684:head# 2024-04-01T19:42:44.792 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43c2459a:::benchmark_data_smithi188_119427_object79673:head# 2024-04-01T19:42:44.792 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43c30d30:::benchmark_data_smithi188_119427_object163308:head# 2024-04-01T19:42:44.792 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43c53b6a:::benchmark_data_smithi188_119427_object162954:head# 2024-04-01T19:42:44.792 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43c6796c:::benchmark_data_smithi188_119427_object72566:head# 2024-04-01T19:42:44.793 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43c683d7:::benchmark_data_smithi188_119427_object141279:head# 2024-04-01T19:42:44.793 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43c687c3:::benchmark_data_smithi188_119427_object82905:head# 2024-04-01T19:42:44.793 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43c68fbb:::benchmark_data_smithi188_119427_object134466:head# 2024-04-01T19:42:44.793 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43c75ab9:::benchmark_data_smithi188_119427_object91690:head# 2024-04-01T19:42:44.794 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43c82c96:::benchmark_data_smithi188_119427_object76401:head# 2024-04-01T19:42:44.794 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43c82ccb:::benchmark_data_smithi188_119427_object80327:head# 2024-04-01T19:42:44.795 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43ca24c4:::benchmark_data_smithi188_119427_object155640:head# 2024-04-01T19:42:44.795 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43caa5d8:::benchmark_data_smithi188_119427_object155771:head# 2024-04-01T19:42:44.795 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43caed4a:::benchmark_data_smithi188_119427_object142670:head# 2024-04-01T19:42:44.796 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43cb4330:::benchmark_data_smithi188_119427_object146268:head# 2024-04-01T19:42:44.796 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43cba522:::benchmark_data_smithi188_119427_object135369:head# 2024-04-01T19:42:44.797 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43cc0834:::benchmark_data_smithi188_119427_object92316:head# 2024-04-01T19:42:44.797 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43cd3118:::benchmark_data_smithi188_119427_object119504:head# 2024-04-01T19:42:44.797 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43cd9462:::benchmark_data_smithi188_119427_object117697:head# 2024-04-01T19:42:44.798 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43cd9816:::benchmark_data_smithi188_119427_object97199:head# 2024-04-01T19:42:44.798 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43cf32fe:::benchmark_data_smithi188_119427_object83457:head# 2024-04-01T19:42:44.799 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43d09fc6:::benchmark_data_smithi188_119427_object100385:head# 2024-04-01T19:42:44.799 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43d0ce10:::benchmark_data_smithi188_119427_object106044:head# 2024-04-01T19:42:44.800 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43d189b8:::benchmark_data_smithi188_119427_object90104:head# 2024-04-01T19:42:44.800 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43d1a5e1:::benchmark_data_smithi188_119427_object92863:head# 2024-04-01T19:42:44.801 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43d39762:::benchmark_data_smithi188_119427_object114072:head# 2024-04-01T19:42:44.801 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43d3c458:::benchmark_data_smithi188_119427_object163138:head# 2024-04-01T19:42:44.801 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43d41271:::benchmark_data_smithi188_119427_object144444:head# 2024-04-01T19:42:44.802 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43d47edf:::benchmark_data_smithi188_119427_object155840:head# 2024-04-01T19:42:44.802 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43d5bb96:::benchmark_data_smithi188_119427_object151672:head# 2024-04-01T19:42:44.803 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43d60d19:::benchmark_data_smithi188_119427_object158490:head# 2024-04-01T19:42:44.803 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43d6aa97:::benchmark_data_smithi188_119427_object130945:head# 2024-04-01T19:42:44.803 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43d801a2:::benchmark_data_smithi188_119427_object159918:head# 2024-04-01T19:42:44.804 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43d81c78:::benchmark_data_smithi188_119427_object89432:head# 2024-04-01T19:42:44.804 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43d845c9:::benchmark_data_smithi188_119427_object119969:head# 2024-04-01T19:42:44.805 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43d86046:::benchmark_data_smithi188_119427_object129296:head# 2024-04-01T19:42:44.805 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43d98380:::benchmark_data_smithi188_119427_object147345:head# 2024-04-01T19:42:44.806 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43d9afea:::benchmark_data_smithi188_119427_object113145:head# 2024-04-01T19:42:44.806 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43da8d74:::benchmark_data_smithi188_119427_object140518:head# 2024-04-01T19:42:44.807 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43dbf443:::benchmark_data_smithi188_119427_object156138:head# 2024-04-01T19:42:44.807 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43df0946:::benchmark_data_smithi188_119427_object129404:head# 2024-04-01T19:42:44.808 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43df601a:::benchmark_data_smithi188_119427_object104876:head# 2024-04-01T19:42:44.808 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43df970f:::benchmark_data_smithi188_119427_object72843:head# 2024-04-01T19:42:44.809 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43dfa239:::benchmark_data_smithi188_119427_object156848:head# 2024-04-01T19:42:44.809 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43dfb579:::benchmark_data_smithi188_119427_object140262:head# 2024-04-01T19:42:44.810 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43e0b828:::benchmark_data_smithi188_119427_object137401:head# 2024-04-01T19:42:44.810 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43e15244:::benchmark_data_smithi188_119427_object119119:head# 2024-04-01T19:42:44.810 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43e29357:::benchmark_data_smithi188_119427_object118096:head# 2024-04-01T19:42:44.811 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43e2c17a:::benchmark_data_smithi188_119427_object99418:head# 2024-04-01T19:42:44.812 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43e2c2b4:::benchmark_data_smithi188_119427_object113395:head# 2024-04-01T19:42:44.812 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43e362e5:::benchmark_data_smithi188_119427_object132227:head# 2024-04-01T19:42:44.813 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43e3debb:::benchmark_data_smithi188_119427_object73976:head# 2024-04-01T19:42:44.813 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43e3fae7:::benchmark_data_smithi188_119427_object78299:head# 2024-04-01T19:42:44.814 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43e46c26:::benchmark_data_smithi188_119427_object85778:head# 2024-04-01T19:42:44.814 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43e54acf:::benchmark_data_smithi188_119427_object153285:head# 2024-04-01T19:42:44.814 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43e5c5f9:::benchmark_data_smithi188_119427_object138192:head# 2024-04-01T19:42:44.815 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43e5e3c9:::benchmark_data_smithi188_119427_object104723:head# 2024-04-01T19:42:44.815 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43e6860b:::benchmark_data_smithi188_119427_object92512:head# 2024-04-01T19:42:44.816 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43e799f7:::benchmark_data_smithi188_119427_object79379:head# 2024-04-01T19:42:44.816 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43e7ce17:::benchmark_data_smithi188_119427_object98424:head# 2024-04-01T19:42:44.816 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43e85b50:::benchmark_data_smithi188_119427_object88446:head# 2024-04-01T19:42:44.817 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43e937a2:::benchmark_data_smithi188_119427_object123963:head# 2024-04-01T19:42:44.817 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43e9b33b:::benchmark_data_smithi188_119427_object107081:head# 2024-04-01T19:42:44.818 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43e9cef8:::benchmark_data_smithi188_119427_object156415:head# 2024-04-01T19:42:44.818 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43eae999:::benchmark_data_smithi188_119427_object157414:head# 2024-04-01T19:42:44.820 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_blocked_ops 2024-04-01T19:42:44.821 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43eb2fb4:::benchmark_data_smithi188_119427_object97856:head# 2024-04-01T19:42:44.821 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43eb544d:::benchmark_data_smithi188_119427_object103783:head# 2024-04-01T19:42:44.821 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43eb77fd:::benchmark_data_smithi188_119427_object77133:head# 2024-04-01T19:42:44.821 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43eb9c08:::benchmark_data_smithi188_119427_object147672:head# 2024-04-01T19:42:44.821 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43ec2446:::benchmark_data_smithi188_119427_object157349:head# 2024-04-01T19:42:44.821 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43eca20b:::benchmark_data_smithi188_119427_object110754:head# 2024-04-01T19:42:44.822 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43eca9b5:::benchmark_data_smithi188_119427_object146402:head# 2024-04-01T19:42:44.823 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43edd75e:::benchmark_data_smithi188_119427_object140549:head# 2024-04-01T19:42:44.823 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43ede4a5:::benchmark_data_smithi188_119427_object163277:head# 2024-04-01T19:42:44.823 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43eeb258:::benchmark_data_smithi188_119427_object93338:head# 2024-04-01T19:42:44.823 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43eec7a5:::benchmark_data_smithi188_119427_object86902:head# 2024-04-01T19:42:44.824 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43eeea84:::benchmark_data_smithi188_119427_object125766:head# 2024-04-01T19:42:44.824 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43ef2c1e:::benchmark_data_smithi188_119427_object145314:head# 2024-04-01T19:42:44.824 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43effbac:::benchmark_data_smithi188_119427_object141685:head# 2024-04-01T19:42:44.824 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43f026de:::benchmark_data_smithi188_119427_object130812:head# 2024-04-01T19:42:44.825 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43f0729a:::benchmark_data_smithi188_119427_object148712:head# 2024-04-01T19:42:44.825 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43f161db:::benchmark_data_smithi188_119427_object105240:head# 2024-04-01T19:42:44.825 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43f1935f:::benchmark_data_smithi188_119427_object99376:head# 2024-04-01T19:42:44.826 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43f2fa9b:::benchmark_data_smithi188_119427_object78115:head# 2024-04-01T19:42:44.826 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43f32a89:::benchmark_data_smithi188_119427_object132066:head# 2024-04-01T19:42:44.827 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43f48c6f:::benchmark_data_smithi188_119427_object159685:head# 2024-04-01T19:42:44.828 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43f4c2ab:::benchmark_data_smithi188_119427_object97481:head# 2024-04-01T19:42:44.828 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43f521b2:::benchmark_data_smithi188_119427_object148918:head# 2024-04-01T19:42:44.828 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43f58085:::benchmark_data_smithi188_119427_object100898:head# 2024-04-01T19:42:44.829 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43f5d83f:::benchmark_data_smithi188_119427_object156395:head# 2024-04-01T19:42:44.829 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43f6d8c7:::benchmark_data_smithi188_119427_object80311:head# 2024-04-01T19:42:44.830 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43f713b4:::benchmark_data_smithi188_119427_object153846:head# 2024-04-01T19:42:44.830 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43f814ac:::benchmark_data_smithi188_119427_object104986:head# 2024-04-01T19:42:44.831 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43f87ba9:::benchmark_data_smithi188_119427_object146572:head# 2024-04-01T19:42:44.831 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43f93de9:::benchmark_data_smithi188_119427_object72935:head# 2024-04-01T19:42:44.832 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43f9aacf:::benchmark_data_smithi188_119427_object133829:head# 2024-04-01T19:42:44.832 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43f9d003:::benchmark_data_smithi188_119427_object149381:head# 2024-04-01T19:42:44.832 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43fb19c4:::benchmark_data_smithi188_119427_object139439:head# 2024-04-01T19:42:44.833 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43fc2171:::benchmark_data_smithi188_119427_object164047:head# 2024-04-01T19:42:44.833 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43fc8339:::benchmark_data_smithi188_119427_object105152:head# 2024-04-01T19:42:44.834 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43fcdb90:::benchmark_data_smithi188_119427_object87188:head# 2024-04-01T19:42:44.834 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43fd5c57:::benchmark_data_smithi188_119427_object158092:head# 2024-04-01T19:42:44.834 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43fe3215:::benchmark_data_smithi188_119427_object131407:head# 2024-04-01T19:42:44.835 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43fe6697:::benchmark_data_smithi188_119427_object125596:head# 2024-04-01T19:42:44.835 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43fe68d4:::benchmark_data_smithi188_119427_object135568:head# 2024-04-01T19:42:44.836 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43ff19cb:::benchmark_data_smithi188_119427_object116918:head# 2024-04-01T19:42:44.836 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43ff477e:::benchmark_data_smithi188_119427_object88906:head# 2024-04-01T19:42:44.836 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:43ff953e:::benchmark_data_smithi188_119427_object133475:head# 2024-04-01T19:42:44.837 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4402d108:::benchmark_data_smithi188_119427_object120803:head# 2024-04-01T19:42:44.838 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4402e0ab:::benchmark_data_smithi188_119427_object108262:head# 2024-04-01T19:42:44.838 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4403615b:::benchmark_data_smithi188_119427_object158129:head# 2024-04-01T19:42:44.839 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4403df13:::benchmark_data_smithi188_119427_object92145:head# 2024-04-01T19:42:44.839 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4403edc7:::benchmark_data_smithi188_119427_object103625:head# 2024-04-01T19:42:44.840 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4404d5f5:::benchmark_data_smithi188_119427_object117853:head# 2024-04-01T19:42:44.840 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4405cce2:::benchmark_data_smithi188_119427_object104285:head# 2024-04-01T19:42:44.841 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:440b2d65:::benchmark_data_smithi188_119427_object84242:head# 2024-04-01T19:42:44.842 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:440bb147:::benchmark_data_smithi188_119427_object97528:head# 2024-04-01T19:42:44.843 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:440cd583:::benchmark_data_smithi188_119427_object154145:head# 2024-04-01T19:42:44.843 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:440d12a9:::benchmark_data_smithi188_119427_object101366:head# 2024-04-01T19:42:44.844 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:440d38ef:::benchmark_data_smithi188_119427_object118683:head# 2024-04-01T19:42:44.844 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:440e3480:::benchmark_data_smithi188_119427_object72519:head# 2024-04-01T19:42:44.845 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:440e51f2:::benchmark_data_smithi188_119427_object99590:head# 2024-04-01T19:42:44.845 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:440e887e:::benchmark_data_smithi188_119427_object73782:head# 2024-04-01T19:42:44.845 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:440e9c91:::benchmark_data_smithi188_119427_object125999:head# 2024-04-01T19:42:44.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:440fb644:::benchmark_data_smithi188_119427_object162718:head# 2024-04-01T19:42:44.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44106de9:::benchmark_data_smithi188_119427_object129352:head# 2024-04-01T19:42:44.847 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4411964a:::benchmark_data_smithi188_119427_object127441:head# 2024-04-01T19:42:44.847 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4411b66c:::benchmark_data_smithi188_119427_object124340:head# 2024-04-01T19:42:44.848 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44122008:::benchmark_data_smithi188_119427_object153231:head# 2024-04-01T19:42:44.849 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44131f0b:::benchmark_data_smithi188_119427_object90949:head# 2024-04-01T19:42:44.849 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44136d74:::benchmark_data_smithi188_119427_object158086:head# 2024-04-01T19:42:44.849 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:42:44.850 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4414a90c:::benchmark_data_smithi188_119427_object137099:head# 2024-04-01T19:42:44.850 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4414b8b8:::benchmark_data_smithi188_119427_object88848:head# 2024-04-01T19:42:44.851 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4414d5ca:::benchmark_data_smithi188_119427_object143237:head# 2024-04-01T19:42:44.851 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4414d795:::benchmark_data_smithi188_119427_object125672:head# 2024-04-01T19:42:44.851 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4415336f:::benchmark_data_smithi188_119427_object130729:head# 2024-04-01T19:42:44.852 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4415a6a9:::benchmark_data_smithi188_119427_object92105:head# 2024-04-01T19:42:44.852 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4415d9b8:::benchmark_data_smithi188_119427_object75023:head# 2024-04-01T19:42:44.852 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:441601fe:::benchmark_data_smithi188_119427_object158834:head# 2024-04-01T19:42:44.853 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44174b9f:::benchmark_data_smithi188_119427_object107497:head# 2024-04-01T19:42:44.853 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4417a9cb:::benchmark_data_smithi188_119427_object120441:head# 2024-04-01T19:42:44.853 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4417b140:::benchmark_data_smithi188_119427_object76794:head# 2024-04-01T19:42:44.854 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44196207:::benchmark_data_smithi188_119427_object104893:head# 2024-04-01T19:42:44.854 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:441d58a2:::benchmark_data_smithi188_119427_object138469:head# 2024-04-01T19:42:44.855 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:441d849f:::benchmark_data_smithi188_119427_object158804:head# 2024-04-01T19:42:44.855 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:441e30c6:::benchmark_data_smithi188_119427_object132052:head# 2024-04-01T19:42:44.856 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:441faaea:::benchmark_data_smithi188_119427_object150649:head# 2024-04-01T19:42:44.856 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44210261:::benchmark_data_smithi188_119427_object143658:head# 2024-04-01T19:42:44.856 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44218c3f:::benchmark_data_smithi188_119427_object131758:head# 2024-04-01T19:42:44.857 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4422e18c:::benchmark_data_smithi188_119427_object129863:head# 2024-04-01T19:42:44.857 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4423ae2b:::benchmark_data_smithi188_119427_object152973:head# 2024-04-01T19:42:44.858 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4423b0ed:::benchmark_data_smithi188_119427_object120324:head# 2024-04-01T19:42:44.858 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4423bd5c:::benchmark_data_smithi188_119427_object100040:head# 2024-04-01T19:42:44.858 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4424ee48:::benchmark_data_smithi188_119427_object130336:head# 2024-04-01T19:42:44.859 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44250e2f:::benchmark_data_smithi188_119427_object125309:head# 2024-04-01T19:42:44.859 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4427cd1e:::benchmark_data_smithi188_119427_object118454:head# 2024-04-01T19:42:44.860 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4427e59f:::benchmark_data_smithi188_119427_object116807:head# 2024-04-01T19:42:44.860 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44294923:::benchmark_data_smithi188_119427_object159982:head# 2024-04-01T19:42:44.860 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:442b3122:::benchmark_data_smithi188_119427_object78237:head# 2024-04-01T19:42:44.861 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:442df622:::benchmark_data_smithi188_119427_object79742:head# 2024-04-01T19:42:44.862 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:442f45eb:::benchmark_data_smithi188_119427_object125215:head# 2024-04-01T19:42:44.862 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:442f4b25:::benchmark_data_smithi188_119427_object95246:head# 2024-04-01T19:42:44.862 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:442f9486:::benchmark_data_smithi188_119427_object83643:head# 2024-04-01T19:42:44.863 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:442fbaf3:::benchmark_data_smithi188_119427_object137833:head# 2024-04-01T19:42:44.863 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:442fd68c:::benchmark_data_smithi188_119427_object154712:head# 2024-04-01T19:42:44.864 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44302179:::benchmark_data_smithi188_119427_object76415:head# 2024-04-01T19:42:44.864 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44304df3:::benchmark_data_smithi188_119427_object157705:head# 2024-04-01T19:42:44.864 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44309dbe:::benchmark_data_smithi188_119427_object92853:head# 2024-04-01T19:42:44.865 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4432bad3:::benchmark_data_smithi188_119427_object73247:head# 2024-04-01T19:42:44.865 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4432ffb2:::benchmark_data_smithi188_119427_object161235:head# 2024-04-01T19:42:44.866 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44333eda:::benchmark_data_smithi188_119427_object145628:head# 2024-04-01T19:42:44.866 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4434466b:::benchmark_data_smithi188_119427_object117475:head# 2024-04-01T19:42:44.867 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:443461f8:::benchmark_data_smithi188_119427_object140656:head# 2024-04-01T19:42:44.867 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4434b220:::benchmark_data_smithi188_119427_object105558:head# 2024-04-01T19:42:44.868 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4435cc8e:::benchmark_data_smithi188_119427_object102336:head# 2024-04-01T19:42:44.868 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4435cf11:::benchmark_data_smithi188_119427_object157196:head# 2024-04-01T19:42:44.868 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4436511b:::benchmark_data_smithi188_119427_object153755:head# 2024-04-01T19:42:44.869 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4436a236:::benchmark_data_smithi188_119427_object81975:head# 2024-04-01T19:42:44.869 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4436bf68:::benchmark_data_smithi188_119427_object162402:head# 2024-04-01T19:42:44.870 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44371f6c:::benchmark_data_smithi188_119427_object129026:head# 2024-04-01T19:42:44.870 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44378b01:::benchmark_data_smithi188_119427_object117087:head# 2024-04-01T19:42:44.871 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44387b1b:::benchmark_data_smithi188_119427_object123371:head# 2024-04-01T19:42:44.871 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:443ad50a:::benchmark_data_smithi188_119427_object89243:head# 2024-04-01T19:42:44.871 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:443bf935:::benchmark_data_smithi188_119427_object144524:head# 2024-04-01T19:42:44.872 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:443c7278:::benchmark_data_smithi188_119427_object73850:head# 2024-04-01T19:42:44.872 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:443ccd19:::benchmark_data_smithi188_119427_object160317:head# 2024-04-01T19:42:44.873 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:443d741a:::benchmark_data_smithi188_119427_object129607:head# 2024-04-01T19:42:44.873 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:443d84c3:::benchmark_data_smithi188_119427_object131389:head# 2024-04-01T19:42:44.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:44 smithi188 ceph-mon[43939]: 5.0 scrub starts 2024-04-01T19:42:44.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:44 smithi188 ceph-mon[43939]: osdmap e435: 12 total, 11 up, 10 in 2024-04-01T19:42:44.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:44 smithi188 ceph-mon[43939]: 5.0 scrub ok 2024-04-01T19:42:44.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:44 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/942646564' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:42:44.874 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:443d8ff1:::benchmark_data_smithi188_119427_object77183:head# 2024-04-01T19:42:44.874 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:443da853:::benchmark_data_smithi188_119427_object86294:head# 2024-04-01T19:42:44.875 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:443e6eba:::benchmark_data_smithi188_119427_object124409:head# 2024-04-01T19:42:44.875 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:443edce8:::benchmark_data_smithi188_119427_object124431:head# 2024-04-01T19:42:44.875 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:443f3861:::benchmark_data_smithi188_119427_object86089:head# 2024-04-01T19:42:44.876 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:443f46ff:::benchmark_data_smithi188_119427_object106599:head# 2024-04-01T19:42:44.876 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:443f7f05:::benchmark_data_smithi188_119427_object98499:head# 2024-04-01T19:42:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:44.877 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:443ffa3b:::benchmark_data_smithi188_119427_object130837:head# 2024-04-01T19:42:44.877 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44421753:::benchmark_data_smithi188_119427_object134315:head# 2024-04-01T19:42:44.877 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44425a76:::benchmark_data_smithi188_119427_object143014:head# 2024-04-01T19:42:44.878 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4442a19e:::benchmark_data_smithi188_119427_object85196:head# 2024-04-01T19:42:44.878 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4443f48a:::benchmark_data_smithi188_119427_object78137:head# 2024-04-01T19:42:44.879 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4444c77c:::benchmark_data_smithi188_119427_object99490:head# 2024-04-01T19:42:44.879 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:444713e9:::benchmark_data_smithi188_119427_object161813:head# 2024-04-01T19:42:44.880 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44479959:::benchmark_data_smithi188_119427_object94471:head# 2024-04-01T19:42:44.880 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44491156:::benchmark_data_smithi188_119427_object80684:head# 2024-04-01T19:42:44.880 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:444abd05:::benchmark_data_smithi188_119427_object119177:head# 2024-04-01T19:42:44.881 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:444ad067:::benchmark_data_smithi188_119427_object112669:head# 2024-04-01T19:42:44.881 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:444af2e4:::benchmark_data_smithi188_119427_object112732:head# 2024-04-01T19:42:44.882 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:444b1b0a:::benchmark_data_smithi188_119427_object128398:head# 2024-04-01T19:42:44.882 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:444b623a:::benchmark_data_smithi188_119427_object147203:head# 2024-04-01T19:42:44.883 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:444b638c:::benchmark_data_smithi188_119427_object88284:head# 2024-04-01T19:42:44.883 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:444d2b70:::benchmark_data_smithi188_119427_object164642:head# 2024-04-01T19:42:44.884 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:444d3eaf:::benchmark_data_smithi188_119427_object78193:head# 2024-04-01T19:42:44.884 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:444d7e97:::benchmark_data_smithi188_119427_object96681:head# 2024-04-01T19:42:44.884 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:444db1b6:::benchmark_data_smithi188_119427_object164624:head# 2024-04-01T19:42:44.885 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:444fece7:::benchmark_data_smithi188_119427_object101629:head# 2024-04-01T19:42:44.885 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44509641:::benchmark_data_smithi188_119427_object142905:head# 2024-04-01T19:42:44.886 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:445117db:::benchmark_data_smithi188_119427_object102664:head# 2024-04-01T19:42:44.886 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4451c524:::benchmark_data_smithi188_119427_object154509:head# 2024-04-01T19:42:44.887 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44528a2d:::benchmark_data_smithi188_119427_object111570:head# 2024-04-01T19:42:44.887 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4452fcf7:::benchmark_data_smithi188_119427_object111874:head# 2024-04-01T19:42:44.887 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4453a1cd:::benchmark_data_smithi188_119427_object123332:head# 2024-04-01T19:42:44.888 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4453c86a:::benchmark_data_smithi188_119427_object122862:head# 2024-04-01T19:42:44.888 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4454c476:::benchmark_data_smithi188_119427_object143519:head# 2024-04-01T19:42:44.888 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44552598:::benchmark_data_smithi188_119427_object163222:head# 2024-04-01T19:42:44.889 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4455c8c7:::benchmark_data_smithi188_119427_object152406:head# 2024-04-01T19:42:44.889 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4456593b:::benchmark_data_smithi188_119427_object130295:head# 2024-04-01T19:42:44.890 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44575752:::benchmark_data_smithi188_119427_object80386:head# 2024-04-01T19:42:44.890 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44595314:::benchmark_data_smithi188_119427_object116612:head# 2024-04-01T19:42:44.891 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44595824:::benchmark_data_smithi188_119427_object141153:head# 2024-04-01T19:42:44.891 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4459ed37:::benchmark_data_smithi188_119427_object131860:head# 2024-04-01T19:42:44.892 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:445a77c7:::benchmark_data_smithi188_119427_object124124:head# 2024-04-01T19:42:44.892 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:445c8d93:::benchmark_data_smithi188_119427_object87608:head# 2024-04-01T19:42:44.893 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:445e2777:::benchmark_data_smithi188_119427_object143597:head# 2024-04-01T19:42:44.893 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:445f0502:::benchmark_data_smithi188_119427_object128313:head# 2024-04-01T19:42:44.893 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44619e9a:::benchmark_data_smithi188_119427_object164144:head# 2024-04-01T19:42:44.894 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4461b4aa:::benchmark_data_smithi188_119427_object73439:head# 2024-04-01T19:42:44.894 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44629d39:::benchmark_data_smithi188_119427_object124805:head# 2024-04-01T19:42:44.895 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44649ace:::benchmark_data_smithi188_119427_object164128:head# 2024-04-01T19:42:44.895 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4465637b:::benchmark_data_smithi188_119427_object163877:head# 2024-04-01T19:42:44.896 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:446596c3:::benchmark_data_smithi188_119427_object82194:head# 2024-04-01T19:42:44.896 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4466c548:::benchmark_data_smithi188_119427_object74379:head# 2024-04-01T19:42:44.896 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4466cf39:::benchmark_data_smithi188_119427_object94660:head# 2024-04-01T19:42:44.897 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44673e6e:::benchmark_data_smithi188_119427_object146927:head# 2024-04-01T19:42:44.897 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44677d0f:::benchmark_data_smithi188_119427_object156805:head# 2024-04-01T19:42:44.897 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:446783c8:::benchmark_data_smithi188_119427_object121306:head# 2024-04-01T19:42:44.898 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4467f87f:::benchmark_data_smithi188_119427_object79293:head# 2024-04-01T19:42:44.898 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44683cc1:::benchmark_data_smithi188_119427_object87686:head# 2024-04-01T19:42:44.899 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4468ace4:::benchmark_data_smithi188_119427_object126167:head# 2024-04-01T19:42:44.899 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44692e3d:::benchmark_data_smithi188_119427_object120571:head# 2024-04-01T19:42:44.900 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44695923:::benchmark_data_smithi188_119427_object129634:head# 2024-04-01T19:42:44.900 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:446ae9b3:::benchmark_data_smithi188_119427_object161315:head# 2024-04-01T19:42:44.901 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:446b2647:::benchmark_data_smithi188_119427_object122767:head# 2024-04-01T19:42:44.901 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:446b27a9:::benchmark_data_smithi188_119427_object159767:head# 2024-04-01T19:42:44.901 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:446b717c:::benchmark_data_smithi188_119427_object136078:head# 2024-04-01T19:42:44.902 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:446c4510:::benchmark_data_smithi188_119427_object141394:head# 2024-04-01T19:42:44.902 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:446ca45c:::benchmark_data_smithi188_119427_object108391:head# 2024-04-01T19:42:44.903 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:446d05a5:::benchmark_data_smithi188_119427_object73587:head# 2024-04-01T19:42:44.903 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:446d4cb5:::benchmark_data_smithi188_119427_object137049:head# 2024-04-01T19:42:44.903 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:446e0c8c:::benchmark_data_smithi188_119427_object119184:head# 2024-04-01T19:42:44.904 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:446e4038:::benchmark_data_smithi188_119427_object74011:head# 2024-04-01T19:42:44.904 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:446eef32:::benchmark_data_smithi188_119427_object157956:head# 2024-04-01T19:42:44.905 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:446f4b9e:::benchmark_data_smithi188_119427_object155607:head# 2024-04-01T19:42:44.905 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:446f8882:::benchmark_data_smithi188_119427_object87432:head# 2024-04-01T19:42:44.905 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:446fd293:::benchmark_data_smithi188_119427_object137585:head# 2024-04-01T19:42:44.906 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:447032b9:::benchmark_data_smithi188_119427_object126764:head# 2024-04-01T19:42:44.906 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:447096a9:::benchmark_data_smithi188_119427_object98339:head# 2024-04-01T19:42:44.907 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4471ecdd:::benchmark_data_smithi188_119427_object149489:head# 2024-04-01T19:42:44.907 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44739ac0:::benchmark_data_smithi188_119427_object134475:head# 2024-04-01T19:42:44.908 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44752b41:::benchmark_data_smithi188_119427_object85454:head# 2024-04-01T19:42:44.908 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4475b9f0:::benchmark_data_smithi188_119427_object82618:head# 2024-04-01T19:42:44.908 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44766988:::benchmark_data_smithi188_119427_object128529:head# 2024-04-01T19:42:44.909 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4476933e:::benchmark_data_smithi188_119427_object108296:head# 2024-04-01T19:42:44.909 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4477a40b:::benchmark_data_smithi188_119427_object80036:head# 2024-04-01T19:42:44.910 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:447843b1:::benchmark_data_smithi188_119427_object98892:head# 2024-04-01T19:42:44.911 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44795f2c:::benchmark_data_smithi188_119427_object126118:head# 2024-04-01T19:42:44.911 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44798057:::benchmark_data_smithi188_119427_object153273:head# 2024-04-01T19:42:44.911 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:447b066d:::benchmark_data_smithi188_119427_object101925:head# 2024-04-01T19:42:44.911 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:447d1cf2:::benchmark_data_smithi188_119427_object87324:head# 2024-04-01T19:42:44.912 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:447d4be2:::benchmark_data_smithi188_119427_object115054:head# 2024-04-01T19:42:44.912 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:447d6627:::benchmark_data_smithi188_119427_object87631:head# 2024-04-01T19:42:44.913 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:447d8582:::benchmark_data_smithi188_119427_object101420:head# 2024-04-01T19:42:44.913 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:447dd93d:::benchmark_data_smithi188_119427_object78583:head# 2024-04-01T19:42:44.913 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:447e383d:::benchmark_data_smithi188_119427_object119652:head# 2024-04-01T19:42:44.914 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:447ebf4a:::benchmark_data_smithi188_119427_object77106:head# 2024-04-01T19:42:44.915 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:447f5d64:::benchmark_data_smithi188_119427_object158887:head# 2024-04-01T19:42:44.915 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44804e00:::benchmark_data_smithi188_119427_object101811:head# 2024-04-01T19:42:44.915 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4480a56f:::benchmark_data_smithi188_119427_object147174:head# 2024-04-01T19:42:44.916 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4480b538:::benchmark_data_smithi188_119427_object155916:head# 2024-04-01T19:42:44.916 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:448137c4:::benchmark_data_smithi188_119427_object129410:head# 2024-04-01T19:42:44.917 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44821bf1:::benchmark_data_smithi188_119427_object104318:head# 2024-04-01T19:42:44.917 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44833509:::benchmark_data_smithi188_119427_object80205:head# 2024-04-01T19:42:44.917 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4483c53e:::benchmark_data_smithi188_119427_object87833:head# 2024-04-01T19:42:44.918 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44845943:::benchmark_data_smithi188_119427_object150082:head# 2024-04-01T19:42:44.918 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4484a186:::benchmark_data_smithi188_119427_object139499:head# 2024-04-01T19:42:44.919 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4485cafd:::benchmark_data_smithi188_119427_object141285:head# 2024-04-01T19:42:44.919 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44864128:::benchmark_data_smithi188_119427_object109299:head# 2024-04-01T19:42:44.920 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4486d95a:::benchmark_data_smithi188_119427_object81670:head# 2024-04-01T19:42:44.920 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4486e978:::benchmark_data_smithi188_119427_object132863:head# 2024-04-01T19:42:44.921 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:448705d0:::benchmark_data_smithi188_119427_object124607:head# 2024-04-01T19:42:44.921 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:448726f3:::benchmark_data_smithi188_119427_object149691:head# 2024-04-01T19:42:44.921 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44874468:::benchmark_data_smithi188_119427_object111028:head# 2024-04-01T19:42:44.922 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:448755eb:::benchmark_data_smithi188_119427_object102579:head# 2024-04-01T19:42:44.922 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4487d14b:::benchmark_data_smithi188_119427_object157511:head# 2024-04-01T19:42:44.923 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4487fb62:::benchmark_data_smithi188_119427_object98024:head# 2024-04-01T19:42:44.923 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4488532e:::benchmark_data_smithi188_119427_object96368:head# 2024-04-01T19:42:44.923 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44887118:::benchmark_data_smithi188_119427_object74318:head# 2024-04-01T19:42:44.924 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4489f7de:::benchmark_data_smithi188_119427_object76263:head# 2024-04-01T19:42:44.924 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:448a519a:::benchmark_data_smithi188_119427_object134115:head# 2024-04-01T19:42:44.925 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:448c3c15:::benchmark_data_smithi188_119427_object146950:head# 2024-04-01T19:42:44.925 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:448c46ff:::benchmark_data_smithi188_119427_object115766:head# 2024-04-01T19:42:44.925 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:448c8e78:::benchmark_data_smithi188_119427_object81050:head# 2024-04-01T19:42:44.926 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:448cffd0:::benchmark_data_smithi188_119427_object77172:head# 2024-04-01T19:42:44.926 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:448eea3d:::benchmark_data_smithi188_119427_object164436:head# 2024-04-01T19:42:44.927 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:448f08b1:::benchmark_data_smithi188_119427_object163589:head# 2024-04-01T19:42:44.927 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44901106:::benchmark_data_smithi188_119427_object128647:head# 2024-04-01T19:42:44.928 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:449036fe:::benchmark_data_smithi188_119427_object89057:head# 2024-04-01T19:42:44.928 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4490a684:::benchmark_data_smithi188_119427_object136609:head# 2024-04-01T19:42:44.929 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4490adee:::benchmark_data_smithi188_119427_object76581:head# 2024-04-01T19:42:44.929 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4490aea0:::benchmark_data_smithi188_119427_object78705:head# 2024-04-01T19:42:44.930 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:449117a8:::benchmark_data_smithi188_119427_object159153:head# 2024-04-01T19:42:44.930 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:449127c0:::benchmark_data_smithi188_119427_object131841:head# 2024-04-01T19:42:44.930 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4491d797:::benchmark_data_smithi188_119427_object122115:head# 2024-04-01T19:42:44.931 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4491dd3f:::benchmark_data_smithi188_119427_object104545:head# 2024-04-01T19:42:44.931 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4493105a:::benchmark_data_smithi188_119427_object152552:head# 2024-04-01T19:42:44.932 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4493c6e0:::benchmark_data_smithi188_119427_object112499:head# 2024-04-01T19:42:44.932 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:449492ab:::benchmark_data_smithi188_119427_object97246:head# 2024-04-01T19:42:44.933 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44949a9c:::benchmark_data_smithi188_119427_object121869:head# 2024-04-01T19:42:44.933 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:449544d6:::benchmark_data_smithi188_119427_object123868:head# 2024-04-01T19:42:44.934 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44963aa5:::benchmark_data_smithi188_119427_object150553:head# 2024-04-01T19:42:44.934 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4496763b:::benchmark_data_smithi188_119427_object155860:head# 2024-04-01T19:42:44.935 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4498865e:::benchmark_data_smithi188_119427_object134526:head# 2024-04-01T19:42:44.935 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:449984e0:::benchmark_data_smithi188_119427_object99569:head# 2024-04-01T19:42:44.936 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4499dbb0:::benchmark_data_smithi188_119427_object138918:head# 2024-04-01T19:42:44.936 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:449a00f6:::benchmark_data_smithi188_119427_object140763:head# 2024-04-01T19:42:44.937 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:449b3a5d:::benchmark_data_smithi188_119427_object137271:head# 2024-04-01T19:42:44.937 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:449bf22f:::benchmark_data_smithi188_119427_object141156:head# 2024-04-01T19:42:44.937 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:449eca3d:::benchmark_data_smithi188_119427_object91749:head# 2024-04-01T19:42:44.938 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:449fb307:::benchmark_data_smithi188_119427_object118123:head# 2024-04-01T19:42:44.938 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44a07224:::benchmark_data_smithi188_119427_object116472:head# 2024-04-01T19:42:44.939 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44a20719:::benchmark_data_smithi188_119427_object137119:head# 2024-04-01T19:42:44.939 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44a20a83:::benchmark_data_smithi188_119427_object152462:head# 2024-04-01T19:42:44.939 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44a36fd3:::benchmark_data_smithi188_119427_object155134:head# 2024-04-01T19:42:44.940 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44a3a28a:::benchmark_data_smithi188_119427_object126268:head# 2024-04-01T19:42:44.940 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44a3ad4c:::benchmark_data_smithi188_119427_object160705:head# 2024-04-01T19:42:44.941 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44a55b34:::benchmark_data_smithi188_119427_object78047:head# 2024-04-01T19:42:44.941 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44a75e8c:::benchmark_data_smithi188_119427_object100666:head# 2024-04-01T19:42:44.942 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44a7be9c:::benchmark_data_smithi188_119427_object150146:head# 2024-04-01T19:42:44.942 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44a7fb9f:::benchmark_data_smithi188_119427_object128631:head# 2024-04-01T19:42:44.942 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44a950fd:::benchmark_data_smithi188_119427_object80367:head# 2024-04-01T19:42:44.943 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44a9d54b:::benchmark_data_smithi188_119427_object151871:head# 2024-04-01T19:42:44.943 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44aa88d5:::benchmark_data_smithi188_119427_object136112:head# 2024-04-01T19:42:44.944 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44aad910:::benchmark_data_smithi188_119427_object93167:head# 2024-04-01T19:42:44.944 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44ab55f6:::benchmark_data_smithi188_119427_object99996:head# 2024-04-01T19:42:44.945 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44acf8f4:::benchmark_data_smithi188_119427_object110659:head# 2024-04-01T19:42:44.945 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44adc955:::benchmark_data_smithi188_119427_object73824:head# 2024-04-01T19:42:44.946 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44adddb3:::benchmark_data_smithi188_119427_object84617:head# 2024-04-01T19:42:44.946 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44af8c5d:::benchmark_data_smithi188_119427_object95248:head# 2024-04-01T19:42:44.946 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44af9e11:::benchmark_data_smithi188_119427_object117280:head# 2024-04-01T19:42:44.947 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44b02b5e:::benchmark_data_smithi188_119427_object158097:head# 2024-04-01T19:42:44.947 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44b2458c:::benchmark_data_smithi188_119427_object126310:head# 2024-04-01T19:42:44.948 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44b290ee:::benchmark_data_smithi188_119427_object113019:head# 2024-04-01T19:42:44.948 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44b42831:::benchmark_data_smithi188_119427_object154421:head# 2024-04-01T19:42:44.949 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44b430ae:::benchmark_data_smithi188_119427_object99411:head# 2024-04-01T19:42:44.949 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44b4a581:::benchmark_data_smithi188_119427_object114531:head# 2024-04-01T19:42:44.949 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44b4f13b:::benchmark_data_smithi188_119427_object139404:head# 2024-04-01T19:42:44.950 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44b690de:::benchmark_data_smithi188_119427_object80824:head# 2024-04-01T19:42:44.950 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44b6c0eb:::benchmark_data_smithi188_119427_object100870:head# 2024-04-01T19:42:44.951 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44b93892:::benchmark_data_smithi188_119427_object84311:head# 2024-04-01T19:42:44.951 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44ba1cee:::benchmark_data_smithi188_119427_object149116:head# 2024-04-01T19:42:44.951 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44ba78f3:::benchmark_data_smithi188_119427_object94548:head# 2024-04-01T19:42:44.952 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44bba847:::benchmark_data_smithi188_119427_object163426:head# 2024-04-01T19:42:44.952 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44bbfa93:::benchmark_data_smithi188_119427_object88864:head# 2024-04-01T19:42:44.953 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44bc09c0:::benchmark_data_smithi188_119427_object84217:head# 2024-04-01T19:42:44.953 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44bc41a5:::benchmark_data_smithi188_119427_object128473:head# 2024-04-01T19:42:44.953 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44bc6279:::benchmark_data_smithi188_119427_object141001:head# 2024-04-01T19:42:44.954 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44bc9845:::benchmark_data_smithi188_119427_object140498:head# 2024-04-01T19:42:44.954 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44bcbff4:::benchmark_data_smithi188_119427_object141298:head# 2024-04-01T19:42:44.955 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44bd6fb9:::benchmark_data_smithi188_119427_object117302:head# 2024-04-01T19:42:44.955 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44becc70:::benchmark_data_smithi188_119427_object124844:head# 2024-04-01T19:42:44.956 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44befce9:::benchmark_data_smithi188_119427_object75389:head# 2024-04-01T19:42:44.956 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44bf1932:::benchmark_data_smithi188_119427_object135216:head# 2024-04-01T19:42:44.957 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44bf1b31:::benchmark_data_smithi188_119427_object107930:head# 2024-04-01T19:42:44.957 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44bf5caa:::benchmark_data_smithi188_119427_object127355:head# 2024-04-01T19:42:44.958 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44bf87d6:::benchmark_data_smithi188_119427_object95891:head# 2024-04-01T19:42:44.958 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44bf967e:::benchmark_data_smithi188_119427_object129602:head# 2024-04-01T19:42:44.958 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44bfa412:::benchmark_data_smithi188_119427_object164482:head# 2024-04-01T19:42:44.959 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44c0255b:::benchmark_data_smithi188_119427_object95103:head# 2024-04-01T19:42:44.959 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44c0b24c:::benchmark_data_smithi188_119427_object72856:head# 2024-04-01T19:42:44.960 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44c0f353:::benchmark_data_smithi188_119427_object153692:head# 2024-04-01T19:42:44.960 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44c32a18:::benchmark_data_smithi188_119427_object87146:head# 2024-04-01T19:42:44.961 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44c59243:::benchmark_data_smithi188_119427_object118098:head# 2024-04-01T19:42:44.961 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44c5988a:::benchmark_data_smithi188_119427_object123336:head# 2024-04-01T19:42:44.962 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44c68e3f:::benchmark_data_smithi188_119427_object110041:head# 2024-04-01T19:42:44.962 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44c68ffb:::benchmark_data_smithi188_119427_object75052:head# 2024-04-01T19:42:44.963 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44c6a507:::benchmark_data_smithi188_119427_object80827:head# 2024-04-01T19:42:44.963 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44c7acd3:::benchmark_data_smithi188_119427_object88222:head# 2024-04-01T19:42:44.963 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44c7de57:::benchmark_data_smithi188_119427_object148360:head# 2024-04-01T19:42:44.964 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44c96d80:::benchmark_data_smithi188_119427_object118990:head# 2024-04-01T19:42:44.964 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44c9e82e:::benchmark_data_smithi188_119427_object73095:head# 2024-04-01T19:42:44.965 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44ca12a3:::benchmark_data_smithi188_119427_object159429:head# 2024-04-01T19:42:44.965 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44ca6332:::benchmark_data_smithi188_119427_object85483:head# 2024-04-01T19:42:44.966 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44cbac92:::benchmark_data_smithi188_119427_object93284:head# 2024-04-01T19:42:44.966 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44cbec20:::benchmark_data_smithi188_119427_object156136:head# 2024-04-01T19:42:44.967 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44cc5a62:::benchmark_data_smithi188_119427_object118392:head# 2024-04-01T19:42:44.967 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44cd0900:::benchmark_data_smithi188_119427_object76880:head# 2024-04-01T19:42:44.967 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44ce20ac:::benchmark_data_smithi188_119427_object90890:head# 2024-04-01T19:42:44.968 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44cf3b16:::benchmark_data_smithi188_119427_object76701:head# 2024-04-01T19:42:44.968 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44cf5335:::benchmark_data_smithi188_119427_object102491:head# 2024-04-01T19:42:44.968 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44d096e8:::benchmark_data_smithi188_119427_object157726:head# 2024-04-01T19:42:44.969 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44d27ea9:::benchmark_data_smithi188_119427_object141223:head# 2024-04-01T19:42:44.969 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44d3a276:::benchmark_data_smithi188_119427_object161623:head# 2024-04-01T19:42:44.970 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44d3f855:::benchmark_data_smithi188_119427_object85432:head# 2024-04-01T19:42:44.970 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44d424f7:::benchmark_data_smithi188_119427_object146493:head# 2024-04-01T19:42:44.970 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44d47b04:::benchmark_data_smithi188_119427_object77866:head# 2024-04-01T19:42:44.971 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44d53172:::benchmark_data_smithi188_119427_object144150:head# 2024-04-01T19:42:44.971 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44d61663:::benchmark_data_smithi188_119427_object91711:head# 2024-04-01T19:42:44.973 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44d6fa0a:::benchmark_data_smithi188_119427_object86029:head# 2024-04-01T19:42:44.973 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44d76ccb:::benchmark_data_smithi188_119427_object126801:head# 2024-04-01T19:42:44.973 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44d770f3:::benchmark_data_smithi188_119427_object142812:head# 2024-04-01T19:42:44.974 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44d892e6:::benchmark_data_smithi188_119427_object141292:head# 2024-04-01T19:42:44.974 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44d8aaeb:::benchmark_data_smithi188_119427_object101036:head# 2024-04-01T19:42:44.975 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44d90959:::benchmark_data_smithi188_119427_object99579:head# 2024-04-01T19:42:44.975 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44da77a0:::benchmark_data_smithi188_119427_object131228:head# 2024-04-01T19:42:44.975 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44dad9b2:::benchmark_data_smithi188_119427_object143806:head# 2024-04-01T19:42:44.976 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44db24f6:::benchmark_data_smithi188_119427_object155373:head# 2024-04-01T19:42:44.976 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44dbb90e:::benchmark_data_smithi188_119427_object87691:head# 2024-04-01T19:42:44.977 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44dbf059:::benchmark_data_smithi188_119427_object99130:head# 2024-04-01T19:42:44.977 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44ddee39:::benchmark_data_smithi188_119427_object105724:head# 2024-04-01T19:42:44.978 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44de728d:::benchmark_data_smithi188_119427_object99745:head# 2024-04-01T19:42:44.978 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44de93ab:::benchmark_data_smithi188_119427_object102920:head# 2024-04-01T19:42:44.978 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44df1f34:::benchmark_data_smithi188_119427_object110594:head# 2024-04-01T19:42:44.979 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44df216c:::benchmark_data_smithi188_119427_object161433:head# 2024-04-01T19:42:44.979 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44df4450:::benchmark_data_smithi188_119427_object125721:head# 2024-04-01T19:42:44.980 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44df637c:::benchmark_data_smithi188_119427_object145592:head# 2024-04-01T19:42:44.980 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44dfb2ba:::benchmark_data_smithi188_119427_object121333:head# 2024-04-01T19:42:44.981 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44dfd3ec:::benchmark_data_smithi188_119427_object118427:head# 2024-04-01T19:42:44.981 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44e00147:::benchmark_data_smithi188_119427_object148352:head# 2024-04-01T19:42:44.982 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44e22304:::benchmark_data_smithi188_119427_object128417:head# 2024-04-01T19:42:44.983 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44e273e8:::benchmark_data_smithi188_119427_object149178:head# 2024-04-01T19:42:44.983 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44e36c1d:::benchmark_data_smithi188_119427_object91044:head# 2024-04-01T19:42:44.984 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44e3a9f1:::benchmark_data_smithi188_119427_object157445:head# 2024-04-01T19:42:44.984 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44e3c0e9:::benchmark_data_smithi188_119427_object144827:head# 2024-04-01T19:42:44.984 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44e4adf7:::benchmark_data_smithi188_119427_object108121:head# 2024-04-01T19:42:44.985 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44e4d784:::benchmark_data_smithi188_119427_object76640:head# 2024-04-01T19:42:44.985 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44e50d87:::benchmark_data_smithi188_119427_object117779:head# 2024-04-01T19:42:44.985 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44e6db6e:::benchmark_data_smithi188_119427_object156774:head# 2024-04-01T19:42:44.986 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44e78cae:::benchmark_data_smithi188_119427_object136506:head# 2024-04-01T19:42:44.986 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44e7af58:::benchmark_data_smithi188_119427_object132755:head# 2024-04-01T19:42:44.987 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44e7b417:::benchmark_data_smithi188_119427_object130094:head# 2024-04-01T19:42:44.987 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44e90e40:::benchmark_data_smithi188_119427_object157340:head# 2024-04-01T19:42:44.988 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44e9df09:::benchmark_data_smithi188_119427_object120384:head# 2024-04-01T19:42:44.988 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44eaa7bc:::benchmark_data_smithi188_119427_object136907:head# 2024-04-01T19:42:44.988 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44eb9195:::benchmark_data_smithi188_119427_object109325:head# 2024-04-01T19:42:44.989 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44ed706e:::benchmark_data_smithi188_119427_object150788:head# 2024-04-01T19:42:44.989 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44efa779:::benchmark_data_smithi188_119427_object103585:head# 2024-04-01T19:42:44.990 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44f0fafc:::benchmark_data_smithi188_119427_object97375:head# 2024-04-01T19:42:44.990 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44f3ac25:::benchmark_data_smithi188_119427_object97139:head# 2024-04-01T19:42:44.990 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44f46ea4:::benchmark_data_smithi188_119427_object162173:head# 2024-04-01T19:42:44.991 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44f47383:::benchmark_data_smithi188_119427_object116371:head# 2024-04-01T19:42:44.991 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44f62a30:::benchmark_data_smithi188_119427_object162994:head# 2024-04-01T19:42:44.992 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44f693ba:::benchmark_data_smithi188_119427_object159844:head# 2024-04-01T19:42:44.992 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44f89df7:::benchmark_data_smithi188_119427_object80890:head# 2024-04-01T19:42:44.993 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44f92ec4:::benchmark_data_smithi188_119427_object97847:head# 2024-04-01T19:42:44.993 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44fad67e:::benchmark_data_smithi188_119427_object103580:head# 2024-04-01T19:42:44.994 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44fca8a4:::benchmark_data_smithi188_119427_object119526:head# 2024-04-01T19:42:44.994 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44fdac2a:::benchmark_data_smithi188_119427_object80435:head# 2024-04-01T19:42:44.994 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44ffbb6f:::benchmark_data_smithi188_119427_object136122:head# 2024-04-01T19:42:44.995 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:44ffd9a8:::benchmark_data_smithi188_119427_object160170:head# 2024-04-01T19:42:44.995 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45002352:::benchmark_data_smithi188_119427_object129502:head# 2024-04-01T19:42:44.996 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45021b62:::benchmark_data_smithi188_119427_object95556:head# 2024-04-01T19:42:44.996 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4504a130:::benchmark_data_smithi188_119427_object133157:head# 2024-04-01T19:42:44.997 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4504ea79:::benchmark_data_smithi188_119427_object132742:head# 2024-04-01T19:42:44.997 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45065470:::benchmark_data_smithi188_119427_object89636:head# 2024-04-01T19:42:44.997 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4506dd07:::benchmark_data_smithi188_119427_object104310:head# 2024-04-01T19:42:44.998 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4507a66b:::benchmark_data_smithi188_119427_object98067:head# 2024-04-01T19:42:44.998 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4507dcc5:::benchmark_data_smithi188_119427_object144601:head# 2024-04-01T19:42:44.999 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4508d2e8:::benchmark_data_smithi188_119427_object138827:head# 2024-04-01T19:42:44.999 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45098ac5:::benchmark_data_smithi188_119427_object85860:head# 2024-04-01T19:42:45.000 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4509f17b:::benchmark_data_smithi188_119427_object136159:head# 2024-04-01T19:42:45.000 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:450a0c55:::benchmark_data_smithi188_119427_object143391:head# 2024-04-01T19:42:45.001 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:450a74f3:::benchmark_data_smithi188_119427_object91088:head# 2024-04-01T19:42:45.001 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:450ab431:::benchmark_data_smithi188_119427_object123489:head# 2024-04-01T19:42:45.001 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:450ada05:::benchmark_data_smithi188_119427_object101268:head# 2024-04-01T19:42:45.002 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:450b2b00:::benchmark_data_smithi188_119427_object79003:head# 2024-04-01T19:42:45.002 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:450b38f7:::benchmark_data_smithi188_119427_object98279:head# 2024-04-01T19:42:45.003 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:450b57de:::benchmark_data_smithi188_119427_object97884:head# 2024-04-01T19:42:45.003 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:450b6971:::benchmark_data_smithi188_119427_object134285:head# 2024-04-01T19:42:45.004 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:450bd6b2:::benchmark_data_smithi188_119427_object84128:head# 2024-04-01T19:42:45.004 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:450bdee0:::benchmark_data_smithi188_119427_object88270:head# 2024-04-01T19:42:45.005 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:450c0506:::benchmark_data_smithi188_119427_object123101:head# 2024-04-01T19:42:45.005 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:450c7a89:::benchmark_data_smithi188_119427_object117797:head# 2024-04-01T19:42:45.005 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:450cdfba:::benchmark_data_smithi188_119427_object141187:head# 2024-04-01T19:42:45.006 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:450d0b51:::benchmark_data_smithi188_119427_object148914:head# 2024-04-01T19:42:45.006 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:450f1fe5:::benchmark_data_smithi188_119427_object119430:head# 2024-04-01T19:42:45.007 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:450fb886:::benchmark_data_smithi188_119427_object81492:head# 2024-04-01T19:42:45.007 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:451035ac:::benchmark_data_smithi188_119427_object136209:head# 2024-04-01T19:42:45.008 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4511f679:::benchmark_data_smithi188_119427_object121186:head# 2024-04-01T19:42:45.008 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45121d4b:::benchmark_data_smithi188_119427_object117305:head# 2024-04-01T19:42:45.008 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4512813d:::benchmark_data_smithi188_119427_object149663:head# 2024-04-01T19:42:45.009 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:451305c3:::benchmark_data_smithi188_119427_object90905:head# 2024-04-01T19:42:45.009 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:451466ac:::benchmark_data_smithi188_119427_object115063:head# 2024-04-01T19:42:45.010 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45147f75:::benchmark_data_smithi188_119427_object164587:head# 2024-04-01T19:42:45.011 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4516a710:::benchmark_data_smithi188_119427_object88008:head# 2024-04-01T19:42:45.011 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4516dbd1:::benchmark_data_smithi188_119427_object85052:head# 2024-04-01T19:42:45.011 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4517257f:::benchmark_data_smithi188_119427_object90625:head# 2024-04-01T19:42:45.011 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45175908:::benchmark_data_smithi188_119427_object161265:head# 2024-04-01T19:42:45.012 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4518e65c:::benchmark_data_smithi188_119427_object144413:head# 2024-04-01T19:42:45.012 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4519675c:::benchmark_data_smithi188_119427_object161448:head# 2024-04-01T19:42:45.013 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:451a1f16:::benchmark_data_smithi188_119427_object147555:head# 2024-04-01T19:42:45.013 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:451a9d11:::benchmark_data_smithi188_119427_object93798:head# 2024-04-01T19:42:45.013 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:451b33de:::benchmark_data_smithi188_119427_object86474:head# 2024-04-01T19:42:45.014 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:451cf2d3:::benchmark_data_smithi188_119427_object75153:head# 2024-04-01T19:42:45.015 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:451e065d:::benchmark_data_smithi188_119427_object100086:head# 2024-04-01T19:42:45.015 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45209259:::benchmark_data_smithi188_119427_object121143:head# 2024-04-01T19:42:45.016 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4521062a:::benchmark_data_smithi188_119427_object100909:head# 2024-04-01T19:42:45.016 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:452245a4:::benchmark_data_smithi188_119427_object104562:head# 2024-04-01T19:42:45.016 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45225d18:::benchmark_data_smithi188_119427_object143252:head# 2024-04-01T19:42:45.017 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45231797:::benchmark_data_smithi188_119427_object126658:head# 2024-04-01T19:42:45.017 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45234a9d:::benchmark_data_smithi188_119427_object128561:head# 2024-04-01T19:42:45.018 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45241f60:::benchmark_data_smithi188_119427_object90634:head# 2024-04-01T19:42:45.018 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4524809e:::benchmark_data_smithi188_119427_object107467:head# 2024-04-01T19:42:45.019 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4524a640:::benchmark_data_smithi188_119427_object121603:head# 2024-04-01T19:42:45.019 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45250d5a:::benchmark_data_smithi188_119427_object77620:head# 2024-04-01T19:42:45.020 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4526a697:::benchmark_data_smithi188_119427_object130040:head# 2024-04-01T19:42:45.020 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45272e9b:::benchmark_data_smithi188_119427_object84444:head# 2024-04-01T19:42:45.021 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4527665b:::benchmark_data_smithi188_119427_object113281:head# 2024-04-01T19:42:45.021 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45277ed0:::benchmark_data_smithi188_119427_object145908:head# 2024-04-01T19:42:45.021 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45278642:::benchmark_data_smithi188_119427_object102080:head# 2024-04-01T19:42:45.022 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4527f97c:::benchmark_data_smithi188_119427_object77768:head# 2024-04-01T19:42:45.022 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:452b0dea:::benchmark_data_smithi188_119427_object96590:head# 2024-04-01T19:42:45.022 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:452b305b:::benchmark_data_smithi188_119427_object136587:head# 2024-04-01T19:42:45.023 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:452b7e36:::benchmark_data_smithi188_119427_object99033:head# 2024-04-01T19:42:45.023 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:452bb2fd:::benchmark_data_smithi188_119427_object82479:head# 2024-04-01T19:42:45.024 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:452c33d7:::benchmark_data_smithi188_119427_object131428:head# 2024-04-01T19:42:45.025 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:452c420a:::benchmark_data_smithi188_119427_object115074:head# 2024-04-01T19:42:45.025 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:452d1f3e:::benchmark_data_smithi188_119427_object80979:head# 2024-04-01T19:42:45.026 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:452d37b4:::benchmark_data_smithi188_119427_object123587:head# 2024-04-01T19:42:45.026 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:452d3c4b:::benchmark_data_smithi188_119427_object137798:head# 2024-04-01T19:42:45.026 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:452d4dc3:::benchmark_data_smithi188_119427_object108292:head# 2024-04-01T19:42:45.027 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:452e3839:::benchmark_data_smithi188_119427_object136511:head# 2024-04-01T19:42:45.027 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:452ee1a9:::benchmark_data_smithi188_119427_object103784:head# 2024-04-01T19:42:45.028 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45315c0c:::benchmark_data_smithi188_119427_object73536:head# 2024-04-01T19:42:45.028 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4532f586:::benchmark_data_smithi188_119427_object148735:head# 2024-04-01T19:42:45.029 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:453385c7:::benchmark_data_smithi188_119427_object122223:head# 2024-04-01T19:42:45.029 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:453422d2:::benchmark_data_smithi188_119427_object108536:head# 2024-04-01T19:42:45.029 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45350983:::benchmark_data_smithi188_119427_object98791:head# 2024-04-01T19:42:45.030 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4535b2d6:::benchmark_data_smithi188_119427_object154876:head# 2024-04-01T19:42:45.030 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45362a53:::benchmark_data_smithi188_119427_object87328:head# 2024-04-01T19:42:45.031 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45365069:::benchmark_data_smithi188_119427_object78482:head# 2024-04-01T19:42:45.031 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4536d47b:::benchmark_data_smithi188_119427_object130421:head# 2024-04-01T19:42:45.032 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45379c7b:::benchmark_data_smithi188_119427_object100952:head# 2024-04-01T19:42:45.032 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4537bdc1:::benchmark_data_smithi188_119427_object110712:head# 2024-04-01T19:42:45.033 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4537cf05:::benchmark_data_smithi188_119427_object107153:head# 2024-04-01T19:42:45.033 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4537d911:::benchmark_data_smithi188_119427_object89675:head# 2024-04-01T19:42:45.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45397cbc:::benchmark_data_smithi188_119427_object127432:head# 2024-04-01T19:42:45.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:453a3822:::benchmark_data_smithi188_119427_object110874:head# 2024-04-01T19:42:45.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:453af19b:::benchmark_data_smithi188_119427_object113591:head# 2024-04-01T19:42:45.035 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:453c0527:::benchmark_data_smithi188_119427_object143719:head# 2024-04-01T19:42:45.035 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:453c0c87:::benchmark_data_smithi188_119427_object154785:head# 2024-04-01T19:42:45.036 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:453d6c67:::benchmark_data_smithi188_119427_object148851:head# 2024-04-01T19:42:45.036 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:453dcc15:::benchmark_data_smithi188_119427_object133479:head# 2024-04-01T19:42:45.037 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:453e31e9:::benchmark_data_smithi188_119427_object95255:head# 2024-04-01T19:42:45.037 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:453e374d:::benchmark_data_smithi188_119427_object128338:head# 2024-04-01T19:42:45.038 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:453e5ea5:::benchmark_data_smithi188_119427_object163137:head# 2024-04-01T19:42:45.038 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:453ee4a7:::benchmark_data_smithi188_119427_object108551:head# 2024-04-01T19:42:45.039 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:453f931e:::benchmark_data_smithi188_119427_object126601:head# 2024-04-01T19:42:45.039 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:453fa41c:::benchmark_data_smithi188_119427_object89551:head# 2024-04-01T19:42:45.041 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:453fcc51:::benchmark_data_smithi188_119427_object112460:head# 2024-04-01T19:42:45.041 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:453ff3b0:::benchmark_data_smithi188_119427_object154244:head# 2024-04-01T19:42:45.041 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45421822:::benchmark_data_smithi188_119427_object140110:head# 2024-04-01T19:42:45.042 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4543f9b2:::benchmark_data_smithi188_119427_object139817:head# 2024-04-01T19:42:45.042 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45446b67:::benchmark_data_smithi188_119427_object76785:head# 2024-04-01T19:42:45.043 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4544d700:::benchmark_data_smithi188_119427_object101897:head# 2024-04-01T19:42:45.043 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45462363:::benchmark_data_smithi188_119427_object113211:head# 2024-04-01T19:42:45.044 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45480d0e:::benchmark_data_smithi188_119427_object77650:head# 2024-04-01T19:42:45.044 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4548de2f:::benchmark_data_smithi188_119427_object101083:head# 2024-04-01T19:42:45.045 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4549161e:::benchmark_data_smithi188_119427_object138136:head# 2024-04-01T19:42:45.045 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45499840:::benchmark_data_smithi188_119427_object89158:head# 2024-04-01T19:42:45.046 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:454a93d3:::benchmark_data_smithi188_119427_object89174:head# 2024-04-01T19:42:45.046 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:454b1783:::benchmark_data_smithi188_119427_object100035:head# 2024-04-01T19:42:45.046 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:454ba684:::benchmark_data_smithi188_119427_object109997:head# 2024-04-01T19:42:45.047 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:454c8e6b:::benchmark_data_smithi188_119427_object124410:head# 2024-04-01T19:42:45.047 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:454e41dd:::benchmark_data_smithi188_119427_object106898:head# 2024-04-01T19:42:45.048 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:454e70ae:::benchmark_data_smithi188_119427_object141438:head# 2024-04-01T19:42:45.048 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:454ec6b1:::benchmark_data_smithi188_119427_object101375:head# 2024-04-01T19:42:45.049 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45516934:::benchmark_data_smithi188_119427_object110322:head# 2024-04-01T19:42:45.049 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4552a10b:::benchmark_data_smithi188_119427_object86918:head# 2024-04-01T19:42:45.049 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4553aabd:::benchmark_data_smithi188_119427_object72917:head# 2024-04-01T19:42:45.050 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45559934:::benchmark_data_smithi188_119427_object129649:head# 2024-04-01T19:42:45.050 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4555e7d9:::benchmark_data_smithi188_119427_object90018:head# 2024-04-01T19:42:45.051 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:455664e4:::benchmark_data_smithi188_119427_object88981:head# 2024-04-01T19:42:45.051 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4556f153:::benchmark_data_smithi188_119427_object137838:head# 2024-04-01T19:42:45.052 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:455708f6:::benchmark_data_smithi188_119427_object127733:head# 2024-04-01T19:42:45.052 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45582df4:::benchmark_data_smithi188_119427_object91429:head# 2024-04-01T19:42:45.053 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45594c01:::benchmark_data_smithi188_119427_object123521:head# 2024-04-01T19:42:45.053 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:455a5bca:::benchmark_data_smithi188_119427_object130871:head# 2024-04-01T19:42:45.053 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:455b2fe1:::benchmark_data_smithi188_119427_object140222:head# 2024-04-01T19:42:45.054 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:455b79ea:::benchmark_data_smithi188_119427_object81200:head# 2024-04-01T19:42:45.054 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:455d7e7b:::benchmark_data_smithi188_119427_object141714:head# 2024-04-01T19:42:45.055 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:455d923e:::benchmark_data_smithi188_119427_object157891:head# 2024-04-01T19:42:45.055 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:455f1b38:::benchmark_data_smithi188_119427_object151366:head# 2024-04-01T19:42:45.055 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:455fe5fe:::benchmark_data_smithi188_119427_object103016:head# 2024-04-01T19:42:45.056 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45618db3:::benchmark_data_smithi188_119427_object127484:head# 2024-04-01T19:42:45.056 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4561d1b3:::benchmark_data_smithi188_119427_object145507:head# 2024-04-01T19:42:45.057 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4561f6d6:::benchmark_data_smithi188_119427_object88902:head# 2024-04-01T19:42:45.057 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4562af70:::benchmark_data_smithi188_119427_object117231:head# 2024-04-01T19:42:45.058 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45641cc4:::benchmark_data_smithi188_119427_object149383:head# 2024-04-01T19:42:45.058 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:456509f3:::benchmark_data_smithi188_119427_object77775:head# 2024-04-01T19:42:45.059 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45656010:::benchmark_data_smithi188_119427_object154239:head# 2024-04-01T19:42:45.059 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4565fba1:::benchmark_data_smithi188_119427_object150933:head# 2024-04-01T19:42:45.059 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45667b26:::benchmark_data_smithi188_119427_object85104:head# 2024-04-01T19:42:45.060 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4566fa53:::benchmark_data_smithi188_119427_object101712:head# 2024-04-01T19:42:45.060 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45679514:::benchmark_data_smithi188_119427_object80037:head# 2024-04-01T19:42:45.061 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45679906:::benchmark_data_smithi188_119427_object109743:head# 2024-04-01T19:42:45.061 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45686e2f:::benchmark_data_smithi188_119427_object134826:head# 2024-04-01T19:42:45.062 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4569d5fe:::benchmark_data_smithi188_119427_object118714:head# 2024-04-01T19:42:45.062 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:456a710b:::benchmark_data_smithi188_119427_object147737:head# 2024-04-01T19:42:45.062 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:456a9c47:::benchmark_data_smithi188_119427_object137317:head# 2024-04-01T19:42:45.063 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:456af43f:::benchmark_data_smithi188_119427_object125189:head# 2024-04-01T19:42:45.063 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:456b0279:::benchmark_data_smithi188_119427_object120784:head# 2024-04-01T19:42:45.064 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:456c23c1:::benchmark_data_smithi188_119427_object125902:head# 2024-04-01T19:42:45.064 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:456cdeb2:::benchmark_data_smithi188_119427_object152596:head# 2024-04-01T19:42:45.065 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:456dd4bd:::benchmark_data_smithi188_119427_object114242:head# 2024-04-01T19:42:45.065 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:456defb9:::benchmark_data_smithi188_119427_object120685:head# 2024-04-01T19:42:45.065 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:456df965:::benchmark_data_smithi188_119427_object107774:head# 2024-04-01T19:42:45.066 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:456ea9ca:::benchmark_data_smithi188_119427_object148078:head# 2024-04-01T19:42:45.066 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:456eee3f:::benchmark_data_smithi188_119427_object91500:head# 2024-04-01T19:42:45.070 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:456f5270:::benchmark_data_smithi188_119427_object115002:head# 2024-04-01T19:42:45.071 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:456f9a45:::benchmark_data_smithi188_119427_object82083:head# 2024-04-01T19:42:45.071 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:456fdcfe:::benchmark_data_smithi188_119427_object94411:head# 2024-04-01T19:42:45.071 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4570063f:::benchmark_data_smithi188_119427_object85851:head# 2024-04-01T19:42:45.071 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:457133d6:::benchmark_data_smithi188_119427_object106662:head# 2024-04-01T19:42:45.072 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4571e59a:::benchmark_data_smithi188_119427_object119444:head# 2024-04-01T19:42:45.072 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45726f8f:::benchmark_data_smithi188_119427_object117003:head# 2024-04-01T19:42:45.073 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4572c08d:::benchmark_data_smithi188_119427_object142625:head# 2024-04-01T19:42:45.073 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4572ecbb:::benchmark_data_smithi188_119427_object93487:head# 2024-04-01T19:42:45.074 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4573743a:::benchmark_data_smithi188_119427_object112843:head# 2024-04-01T19:42:45.074 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4573cee7:::benchmark_data_smithi188_119427_object152713:head# 2024-04-01T19:42:45.074 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45740604:::benchmark_data_smithi188_119427_object131133:head# 2024-04-01T19:42:45.075 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4575aaf4:::benchmark_data_smithi188_119427_object80656:head# 2024-04-01T19:42:45.075 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4576fade:::benchmark_data_smithi188_119427_object108075:head# 2024-04-01T19:42:45.076 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45778a75:::benchmark_data_smithi188_119427_object146166:head# 2024-04-01T19:42:45.076 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4578d281:::benchmark_data_smithi188_119427_object91637:head# 2024-04-01T19:42:45.077 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4578ff32:::benchmark_data_smithi188_119427_object139406:head# 2024-04-01T19:42:45.077 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4579036d:::benchmark_data_smithi188_119427_object148153:head# 2024-04-01T19:42:45.078 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:457a1012:::benchmark_data_smithi188_119427_object79963:head# 2024-04-01T19:42:45.078 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:457ada8c:::benchmark_data_smithi188_119427_object73080:head# 2024-04-01T19:42:45.078 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:457c1c3b:::benchmark_data_smithi188_119427_object142749:head# 2024-04-01T19:42:45.079 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:457c98b1:::benchmark_data_smithi188_119427_object75224:head# 2024-04-01T19:42:45.079 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:457d83d3:::benchmark_data_smithi188_119427_object139194:head# 2024-04-01T19:42:45.080 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:457ec28c:::benchmark_data_smithi188_119427_object120089:head# 2024-04-01T19:42:45.080 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:457fa127:::benchmark_data_smithi188_119427_object88094:head# 2024-04-01T19:42:45.081 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45804de7:::benchmark_data_smithi188_119427_object146895:head# 2024-04-01T19:42:45.082 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4580f39e:::benchmark_data_smithi188_119427_object98514:head# 2024-04-01T19:42:45.082 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:458131d3:::benchmark_data_smithi188_119427_object126070:head# 2024-04-01T19:42:45.082 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4581737d:::benchmark_data_smithi188_119427_object90334:head# 2024-04-01T19:42:45.083 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:458186a4:::benchmark_data_smithi188_119427_object104637:head# 2024-04-01T19:42:45.083 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45821473:::benchmark_data_smithi188_119427_object120222:head# 2024-04-01T19:42:45.084 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4582edb8:::benchmark_data_smithi188_119427_object163970:head# 2024-04-01T19:42:45.084 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:458350d3:::benchmark_data_smithi188_119427_object90548:head# 2024-04-01T19:42:45.085 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4583a182:::benchmark_data_smithi188_119427_object105823:head# 2024-04-01T19:42:45.085 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4584ba5d:::benchmark_data_smithi188_119427_object84135:head# 2024-04-01T19:42:45.086 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4584c265:::benchmark_data_smithi188_119427_object151433:head# 2024-04-01T19:42:45.086 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4585d41d:::benchmark_data_smithi188_119427_object148743:head# 2024-04-01T19:42:45.086 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45866316:::benchmark_data_smithi188_119427_object102329:head# 2024-04-01T19:42:45.087 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4589df1b:::benchmark_data_smithi188_119427_object107199:head# 2024-04-01T19:42:45.087 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:458b40ac:::benchmark_data_smithi188_119427_object144082:head# 2024-04-01T19:42:45.088 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:458c53e5:::benchmark_data_smithi188_119427_object91985:head# 2024-04-01T19:42:45.088 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:458ccdc0:::benchmark_data_smithi188_119427_object109795:head# 2024-04-01T19:42:45.089 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:458d2572:::benchmark_data_smithi188_119427_object91818:head# 2024-04-01T19:42:45.089 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:458e67ac:::benchmark_data_smithi188_119427_object104506:head# 2024-04-01T19:42:45.090 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:459021b2:::benchmark_data_smithi188_119427_object139899:head# 2024-04-01T19:42:45.090 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45905f2b:::benchmark_data_smithi188_119427_object87119:head# 2024-04-01T19:42:45.091 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45937f36:::benchmark_data_smithi188_119427_object79437:head# 2024-04-01T19:42:45.091 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4593fccd:::benchmark_data_smithi188_119427_object158355:head# 2024-04-01T19:42:45.092 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45943321:::benchmark_data_smithi188_119427_object115168:head# 2024-04-01T19:42:45.092 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:459733c0:::benchmark_data_smithi188_119427_object132685:head# 2024-04-01T19:42:45.093 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45973e48:::benchmark_data_smithi188_119427_object134394:head# 2024-04-01T19:42:45.093 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:459740fc:::benchmark_data_smithi188_119427_object160908:head# 2024-04-01T19:42:45.094 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45975032:::benchmark_data_smithi188_119427_object137331:head# 2024-04-01T19:42:45.094 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45999d18:::benchmark_data_smithi188_119427_object102630:head# 2024-04-01T19:42:45.095 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:459a007e:::benchmark_data_smithi188_119427_object134382:head# 2024-04-01T19:42:45.095 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:459a3f6f:::benchmark_data_smithi188_119427_object100882:head# 2024-04-01T19:42:45.096 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:459b25e7:::benchmark_data_smithi188_119427_object127757:head# 2024-04-01T19:42:45.096 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:459c2530:::benchmark_data_smithi188_119427_object108924:head# 2024-04-01T19:42:45.096 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:459d2604:::benchmark_data_smithi188_119427_object162549:head# 2024-04-01T19:42:45.097 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:459d9407:::benchmark_data_smithi188_119427_object73600:head# 2024-04-01T19:42:45.097 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:459e9f47:::benchmark_data_smithi188_119427_object126515:head# 2024-04-01T19:42:45.098 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:459f9feb:::benchmark_data_smithi188_119427_object115864:head# 2024-04-01T19:42:45.098 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:459fc477:::benchmark_data_smithi188_119427_object126029:head# 2024-04-01T19:42:45.099 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45a09212:::benchmark_data_smithi188_119427_object90869:head# 2024-04-01T19:42:45.099 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45a384de:::benchmark_data_smithi188_119427_object78366:head# 2024-04-01T19:42:45.100 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45a479d6:::benchmark_data_smithi188_119427_object106649:head# 2024-04-01T19:42:45.100 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45a4d81d:::benchmark_data_smithi188_119427_object151882:head# 2024-04-01T19:42:45.100 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45a63a7f:::benchmark_data_smithi188_119427_object77753:head# 2024-04-01T19:42:45.101 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45a686ba:::benchmark_data_smithi188_119427_object153004:head# 2024-04-01T19:42:45.101 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45a69831:::benchmark_data_smithi188_119427_object73640:head# 2024-04-01T19:42:45.102 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45a80348:::benchmark_data_smithi188_119427_object81423:head# 2024-04-01T19:42:45.102 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45a8c9b5:::benchmark_data_smithi188_119427_object105883:head# 2024-04-01T19:42:45.103 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45a97588:::benchmark_data_smithi188_119427_object101263:head# 2024-04-01T19:42:45.103 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45a9fd2a:::benchmark_data_smithi188_119427_object77095:head# 2024-04-01T19:42:45.104 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45ab90d7:::benchmark_data_smithi188_119427_object134395:head# 2024-04-01T19:42:45.105 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45ac2432:::benchmark_data_smithi188_119427_object141505:head# 2024-04-01T19:42:45.105 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45ace6f2:::benchmark_data_smithi188_119427_object93898:head# 2024-04-01T19:42:45.105 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45b13881:::benchmark_data_smithi188_119427_object125415:head# 2024-04-01T19:42:45.106 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45b1c037:::benchmark_data_smithi188_119427_object95110:head# 2024-04-01T19:42:45.106 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45b2bbc7:::benchmark_data_smithi188_119427_object122348:head# 2024-04-01T19:42:45.107 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:42:45.107 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45b32fe0:::benchmark_data_smithi188_119427_object159912:head# 2024-04-01T19:42:45.107 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45b4245b:::benchmark_data_smithi188_119427_object146506:head# 2024-04-01T19:42:45.108 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45b48556:::benchmark_data_smithi188_119427_object136482:head# 2024-04-01T19:42:45.108 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45b4c02f:::benchmark_data_smithi188_119427_object159759:head# 2024-04-01T19:42:45.109 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45b4d2c3:::benchmark_data_smithi188_119427_object93930:head# 2024-04-01T19:42:45.109 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45b4ef39:::benchmark_data_smithi188_119427_object89554:head# 2024-04-01T19:42:45.110 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45b666c9:::benchmark_data_smithi188_119427_object109149:head# 2024-04-01T19:42:45.110 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45b69d43:::benchmark_data_smithi188_119427_object146260:head# 2024-04-01T19:42:45.111 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45b735e6:::benchmark_data_smithi188_119427_object122819:head# 2024-04-01T19:42:45.112 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45b7f11a:::benchmark_data_smithi188_119427_object144815:head# 2024-04-01T19:42:45.113 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45b8ae74:::benchmark_data_smithi188_119427_object73754:head# 2024-04-01T19:42:45.113 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45b987f3:::benchmark_data_smithi188_119427_object140529:head# 2024-04-01T19:42:45.114 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45b9d35a:::benchmark_data_smithi188_119427_object99003:head# 2024-04-01T19:42:45.114 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45ba0b59:::benchmark_data_smithi188_119427_object112062:head# 2024-04-01T19:42:45.115 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45ba6fb8:::benchmark_data_smithi188_119427_object155071:head# 2024-04-01T19:42:45.115 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45baa3e4:::benchmark_data_smithi188_119427_object101442:head# 2024-04-01T19:42:45.116 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45bc2ac0:::benchmark_data_smithi188_119427_object157710:head# 2024-04-01T19:42:45.116 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45bd6cf0:::benchmark_data_smithi188_119427_object141582:head# 2024-04-01T19:42:45.117 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45bd7785:::benchmark_data_smithi188_119427_object126224:head# 2024-04-01T19:42:45.117 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45bf9523:::benchmark_data_smithi188_119427_object123246:head# 2024-04-01T19:42:45.118 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45c00c24:::benchmark_data_smithi188_119427_object108581:head# 2024-04-01T19:42:45.118 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45c1406d:::benchmark_data_smithi188_119427_object82010:head# 2024-04-01T19:42:45.118 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45c33bb3:::benchmark_data_smithi188_119427_object98089:head# 2024-04-01T19:42:45.119 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45c4f6e7:::benchmark_data_smithi188_119427_object148420:head# 2024-04-01T19:42:45.119 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45c4fbb8:::benchmark_data_smithi188_119427_object140810:head# 2024-04-01T19:42:45.120 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45c57228:::benchmark_data_smithi188_119427_object86978:head# 2024-04-01T19:42:45.120 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45c71059:::benchmark_data_smithi188_119427_object130899:head# 2024-04-01T19:42:45.121 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45c85c71:::benchmark_data_smithi188_119427_object79104:head# 2024-04-01T19:42:45.121 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45c870d7:::benchmark_data_smithi188_119427_object136093:head# 2024-04-01T19:42:45.122 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45c99fbc:::benchmark_data_smithi188_119427_object91158:head# 2024-04-01T19:42:45.122 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45c9c285:::benchmark_data_smithi188_119427_object140624:head# 2024-04-01T19:42:45.122 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45ca855a:::benchmark_data_smithi188_119427_object155296:head# 2024-04-01T19:42:45.123 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45cd029c:::benchmark_data_smithi188_119427_object76283:head# 2024-04-01T19:42:45.124 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45cdece0:::benchmark_data_smithi188_119427_object148021:head# 2024-04-01T19:42:45.124 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45cdf56b:::benchmark_data_smithi188_119427_object109663:head# 2024-04-01T19:42:45.125 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45ce47de:::benchmark_data_smithi188_119427_object79792:head# 2024-04-01T19:42:45.125 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45cea021:::benchmark_data_smithi188_119427_object114318:head# 2024-04-01T19:42:45.125 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45cea1f8:::benchmark_data_smithi188_119427_object136548:head# 2024-04-01T19:42:45.126 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45d0bcbb:::benchmark_data_smithi188_119427_object79706:head# 2024-04-01T19:42:45.126 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45d16bd7:::benchmark_data_smithi188_119427_object100711:head# 2024-04-01T19:42:45.127 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45d25985:::benchmark_data_smithi188_119427_object83896:head# 2024-04-01T19:42:45.127 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45d33e90:::benchmark_data_smithi188_119427_object81866:head# 2024-04-01T19:42:45.127 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45d3ef16:::benchmark_data_smithi188_119427_object137678:head# 2024-04-01T19:42:45.128 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45d43f9b:::benchmark_data_smithi188_119427_object159327:head# 2024-04-01T19:42:45.128 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45d4410d:::benchmark_data_smithi188_119427_object122518:head# 2024-04-01T19:42:45.129 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45d5ea8f:::benchmark_data_smithi188_119427_object120533:head# 2024-04-01T19:42:45.129 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45d73973:::benchmark_data_smithi188_119427_object81101:head# 2024-04-01T19:42:45.129 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45d841db:::benchmark_data_smithi188_119427_object142811:head# 2024-04-01T19:42:45.130 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45d8e661:::benchmark_data_smithi188_119427_object131085:head# 2024-04-01T19:42:45.130 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45d9a81a:::benchmark_data_smithi188_119427_object152100:head# 2024-04-01T19:42:45.130 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45d9da30:::benchmark_data_smithi188_119427_object85026:head# 2024-04-01T19:42:45.131 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45daa1ab:::benchmark_data_smithi188_119427_object154079:head# 2024-04-01T19:42:45.131 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45db58df:::benchmark_data_smithi188_119427_object159617:head# 2024-04-01T19:42:45.132 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45db7ca6:::benchmark_data_smithi188_119427_object140841:head# 2024-04-01T19:42:45.132 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45dc5683:::benchmark_data_smithi188_119427_object96654:head# 2024-04-01T19:42:45.133 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45dc79f5:::benchmark_data_smithi188_119427_object123270:head# 2024-04-01T19:42:45.133 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45dca468:::benchmark_data_smithi188_119427_object108823:head# 2024-04-01T19:42:45.133 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45dde9fa:::benchmark_data_smithi188_119427_object127481:head# 2024-04-01T19:42:45.134 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45ddf60f:::benchmark_data_smithi188_119427_object119345:head# 2024-04-01T19:42:45.134 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45de44af:::benchmark_data_smithi188_119427_object135038:head# 2024-04-01T19:42:45.135 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45de9e7c:::benchmark_data_smithi188_119427_object109160:head# 2024-04-01T19:42:45.135 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45df764b:::benchmark_data_smithi188_119427_object94813:head# 2024-04-01T19:42:45.136 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45df96b5:::benchmark_data_smithi188_119427_object103102:head# 2024-04-01T19:42:45.136 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45dff806:::benchmark_data_smithi188_119427_object85632:head# 2024-04-01T19:42:45.137 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45e06337:::benchmark_data_smithi188_119427_object97080:head# 2024-04-01T19:42:45.137 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45e0b748:::benchmark_data_smithi188_119427_object101160:head# 2024-04-01T19:42:45.138 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45e3a123:::benchmark_data_smithi188_119427_object92465:head# 2024-04-01T19:42:45.138 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45e3e343:::benchmark_data_smithi188_119427_object110790:head# 2024-04-01T19:42:45.139 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45e43929:::benchmark_data_smithi188_119427_object138485:head# 2024-04-01T19:42:45.140 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45e45b84:::benchmark_data_smithi188_119427_object77977:head# 2024-04-01T19:42:45.140 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45e4a37d:::benchmark_data_smithi188_119427_object89843:head# 2024-04-01T19:42:45.140 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45e4cbe3:::benchmark_data_smithi188_119427_object141648:head# 2024-04-01T19:42:45.140 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45e53242:::benchmark_data_smithi188_119427_object132498:head# 2024-04-01T19:42:45.141 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45e6acfc:::benchmark_data_smithi188_119427_object150104:head# 2024-04-01T19:42:45.142 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45e7452c:::benchmark_data_smithi188_119427_object140230:head# 2024-04-01T19:42:45.142 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45e7a019:::benchmark_data_smithi188_119427_object103242:head# 2024-04-01T19:42:45.142 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45e968e0:::benchmark_data_smithi188_119427_object124153:head# 2024-04-01T19:42:45.143 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45e9cd80:::benchmark_data_smithi188_119427_object75512:head# 2024-04-01T19:42:45.143 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45ea35e2:::benchmark_data_smithi188_119427_object110535:head# 2024-04-01T19:42:45.144 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45eab3e8:::benchmark_data_smithi188_119427_object105278:head# 2024-04-01T19:42:45.144 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45ead0f8:::benchmark_data_smithi188_119427_object153921:head# 2024-04-01T19:42:45.145 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45ec1981:::benchmark_data_smithi188_119427_object95606:head# 2024-04-01T19:42:45.145 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45ed52b3:::benchmark_data_smithi188_119427_object78835:head# 2024-04-01T19:42:45.146 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45ef7c9d:::benchmark_data_smithi188_119427_object146487:head# 2024-04-01T19:42:45.146 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45f06a81:::benchmark_data_smithi188_119427_object94173:head# 2024-04-01T19:42:45.147 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45f176e8:::benchmark_data_smithi188_119427_object150718:head# 2024-04-01T19:42:45.147 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45f2319c:::benchmark_data_smithi188_119427_object75907:head# 2024-04-01T19:42:45.148 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45f377c1:::benchmark_data_smithi188_119427_object88818:head# 2024-04-01T19:42:45.148 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45f39b41:::benchmark_data_smithi188_119427_object91440:head# 2024-04-01T19:42:45.148 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45f3fa31:::benchmark_data_smithi188_119427_object140356:head# 2024-04-01T19:42:45.149 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45f4458b:::benchmark_data_smithi188_119427_object103525:head# 2024-04-01T19:42:45.149 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45f632c5:::benchmark_data_smithi188_119427_object141666:head# 2024-04-01T19:42:45.150 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45f688d8:::benchmark_data_smithi188_119427_object114058:head# 2024-04-01T19:42:45.150 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45f6dfff:::benchmark_data_smithi188_119427_object93639:head# 2024-04-01T19:42:45.150 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45f757e1:::benchmark_data_smithi188_119427_object148356:head# 2024-04-01T19:42:45.151 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45f8c169:::benchmark_data_smithi188_119427_object143076:head# 2024-04-01T19:42:45.152 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45f95236:::benchmark_data_smithi188_119427_object92851:head# 2024-04-01T19:42:45.152 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45fb6928:::benchmark_data_smithi188_119427_object114961:head# 2024-04-01T19:42:45.152 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45fbb95e:::benchmark_data_smithi188_119427_object159634:head# 2024-04-01T19:42:45.153 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45fc40c0:::benchmark_data_smithi188_119427_object155183:head# 2024-04-01T19:42:45.153 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45fc811e:::benchmark_data_smithi188_119427_object153337:head# 2024-04-01T19:42:45.154 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45fd1260:::benchmark_data_smithi188_119427_object158213:head# 2024-04-01T19:42:45.154 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45fdff19:::benchmark_data_smithi188_119427_object138465:head# 2024-04-01T19:42:45.155 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45ff11c9:::benchmark_data_smithi188_119427_object134507:head# 2024-04-01T19:42:45.155 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45ff3a6a:::benchmark_data_smithi188_119427_object125371:head# 2024-04-01T19:42:45.155 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:45ff4f06:::benchmark_data_smithi188_119427_object140780:head# 2024-04-01T19:42:45.156 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46005a9f:::benchmark_data_smithi188_119427_object129985:head# 2024-04-01T19:42:45.157 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:460157d3:::benchmark_data_smithi188_119427_object159842:head# 2024-04-01T19:42:45.157 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4602ea76:::benchmark_data_smithi188_119427_object76467:head# 2024-04-01T19:42:45.158 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4603aff5:::benchmark_data_smithi188_119427_object110505:head# 2024-04-01T19:42:45.158 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46052052:::benchmark_data_smithi188_119427_object146350:head# 2024-04-01T19:42:45.159 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46053eb2:::benchmark_data_smithi188_119427_object138946:head# 2024-04-01T19:42:45.159 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46057667:::benchmark_data_smithi188_119427_object116331:head# 2024-04-01T19:42:45.160 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4605dfeb:::benchmark_data_smithi188_119427_object151460:head# 2024-04-01T19:42:45.160 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4606a024:::benchmark_data_smithi188_119427_object129674:head# 2024-04-01T19:42:45.160 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46076074:::benchmark_data_smithi188_119427_object161954:head# 2024-04-01T19:42:45.161 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46084e44:::benchmark_data_smithi188_119427_object101766:head# 2024-04-01T19:42:45.161 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46086fa6:::benchmark_data_smithi188_119427_object154606:head# 2024-04-01T19:42:45.162 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:460898f3:::benchmark_data_smithi188_119427_object122397:head# 2024-04-01T19:42:45.162 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:460926af:::benchmark_data_smithi188_119427_object137994:head# 2024-04-01T19:42:45.163 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:460a2801:::benchmark_data_smithi188_119427_object105655:head# 2024-04-01T19:42:45.163 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:460a9998:::benchmark_data_smithi188_119427_object99501:head# 2024-04-01T19:42:45.164 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:460b8bdc:::benchmark_data_smithi188_119427_object83757:head# 2024-04-01T19:42:45.164 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:460e716d:::benchmark_data_smithi188_119427_object158270:head# 2024-04-01T19:42:45.165 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:460fdeed:::benchmark_data_smithi188_119427_object114987:head# 2024-04-01T19:42:45.165 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4611c652:::benchmark_data_smithi188_119427_object76666:head# 2024-04-01T19:42:45.166 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4613ef79:::benchmark_data_smithi188_119427_object120983:head# 2024-04-01T19:42:45.166 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46140d32:::benchmark_data_smithi188_119427_object91165:head# 2024-04-01T19:42:45.166 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4614cf9d:::benchmark_data_smithi188_119427_object109192:head# 2024-04-01T19:42:45.167 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46150971:::benchmark_data_smithi188_119427_object128363:head# 2024-04-01T19:42:45.167 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:461615ce:::benchmark_data_smithi188_119427_object102293:head# 2024-04-01T19:42:45.168 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:461620e2:::benchmark_data_smithi188_119427_object100350:head# 2024-04-01T19:42:45.168 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4618eff1:::benchmark_data_smithi188_119427_object78118:head# 2024-04-01T19:42:45.169 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4619aff8:::benchmark_data_smithi188_119427_object112864:head# 2024-04-01T19:42:45.169 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:461a744a:::benchmark_data_smithi188_119427_object113059:head# 2024-04-01T19:42:45.170 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:461ac3b8:::benchmark_data_smithi188_119427_object137537:head# 2024-04-01T19:42:45.170 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:461c1a82:::benchmark_data_smithi188_119427_object126581:head# 2024-04-01T19:42:45.171 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:461d77d5:::benchmark_data_smithi188_119427_object95452:head# 2024-04-01T19:42:45.171 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:461d906d:::benchmark_data_smithi188_119427_object105407:head# 2024-04-01T19:42:45.171 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:461e5042:::benchmark_data_smithi188_119427_object78818:head# 2024-04-01T19:42:45.172 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:461e9500:::benchmark_data_smithi188_119427_object152535:head# 2024-04-01T19:42:45.172 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:461edc9d:::benchmark_data_smithi188_119427_object136003:head# 2024-04-01T19:42:45.173 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:461f4ec0:::benchmark_data_smithi188_119427_object79138:head# 2024-04-01T19:42:45.173 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:461f6684:::benchmark_data_smithi188_119427_object145461:head# 2024-04-01T19:42:45.174 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46209d8c:::benchmark_data_smithi188_119427_object118216:head# 2024-04-01T19:42:45.174 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4621b33c:::benchmark_data_smithi188_119427_object101451:head# 2024-04-01T19:42:45.174 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4623ed56:::benchmark_data_smithi188_119427_object72956:head# 2024-04-01T19:42:45.175 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4625bfef:::benchmark_data_smithi188_119427_object111774:head# 2024-04-01T19:42:45.175 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4625ec34:::benchmark_data_smithi188_119427_object147582:head# 2024-04-01T19:42:45.176 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4626158c:::benchmark_data_smithi188_119427_object112031:head# 2024-04-01T19:42:45.176 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4629d118:::benchmark_data_smithi188_119427_object75639:head# 2024-04-01T19:42:45.177 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:462bb946:::benchmark_data_smithi188_119427_object153336:head# 2024-04-01T19:42:45.177 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:462cb3b1:::benchmark_data_smithi188_119427_object129222:head# 2024-04-01T19:42:45.177 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:462cf68c:::benchmark_data_smithi188_119427_object111624:head# 2024-04-01T19:42:45.178 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:462f2be7:::benchmark_data_smithi188_119427_object135925:head# 2024-04-01T19:42:45.178 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4630668a:::benchmark_data_smithi188_119427_object101950:head# 2024-04-01T19:42:45.178 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4631d862:::benchmark_data_smithi188_119427_object102738:head# 2024-04-01T19:42:45.179 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46328a42:::benchmark_data_smithi188_119427_object134771:head# 2024-04-01T19:42:45.179 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4632a85b:::benchmark_data_smithi188_119427_object137860:head# 2024-04-01T19:42:45.180 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4633752d:::benchmark_data_smithi188_119427_object120090:head# 2024-04-01T19:42:45.180 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46338ff1:::benchmark_data_smithi188_119427_object127201:head# 2024-04-01T19:42:45.183 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46348fd1:::benchmark_data_smithi188_119427_object150784:head# 2024-04-01T19:42:45.186 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4634c9b4:::benchmark_data_smithi188_119427_object98702:head# 2024-04-01T19:42:45.186 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46351c67:::benchmark_data_smithi188_119427_object113106:head# 2024-04-01T19:42:45.187 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4635e8b0:::benchmark_data_smithi188_119427_object130095:head# 2024-04-01T19:42:45.187 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46370510:::benchmark_data_smithi188_119427_object151659:head# 2024-04-01T19:42:45.188 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4637d52b:::benchmark_data_smithi188_119427_object148713:head# 2024-04-01T19:42:45.188 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46385563:::benchmark_data_smithi188_119427_object84036:head# 2024-04-01T19:42:45.189 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46393c96:::benchmark_data_smithi188_119427_object93979:head# 2024-04-01T19:42:45.189 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4639861a:::benchmark_data_smithi188_119427_object121411:head# 2024-04-01T19:42:45.189 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4639af34:::benchmark_data_smithi188_119427_object92375:head# 2024-04-01T19:42:45.190 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4639c53c:::benchmark_data_smithi188_119427_object103420:head# 2024-04-01T19:42:45.191 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4639e33f:::benchmark_data_smithi188_119427_object95230:head# 2024-04-01T19:42:45.191 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:463a2230:::benchmark_data_smithi188_119427_object93132:head# 2024-04-01T19:42:45.191 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:463b11a1:::benchmark_data_smithi188_119427_object141596:head# 2024-04-01T19:42:45.192 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:463b4913:::benchmark_data_smithi188_119427_object156927:head# 2024-04-01T19:42:45.192 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:463b9586:::benchmark_data_smithi188_119427_object127473:head# 2024-04-01T19:42:45.193 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:463c5eaf:::benchmark_data_smithi188_119427_object160580:head# 2024-04-01T19:42:45.193 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:463dceb7:::benchmark_data_smithi188_119427_object142247:head# 2024-04-01T19:42:45.193 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:463de497:::benchmark_data_smithi188_119427_object160173:head# 2024-04-01T19:42:45.194 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:463f15fe:::benchmark_data_smithi188_119427_object132807:head# 2024-04-01T19:42:45.194 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:463f31da:::benchmark_data_smithi188_119427_object118215:head# 2024-04-01T19:42:45.195 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46405837:::benchmark_data_smithi188_119427_object131672:head# 2024-04-01T19:42:45.195 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46408cc8:::benchmark_data_smithi188_119427_object138030:head# 2024-04-01T19:42:45.196 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4640ee71:::benchmark_data_smithi188_119427_object112362:head# 2024-04-01T19:42:45.196 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46413d0f:::benchmark_data_smithi188_119427_object85878:head# 2024-04-01T19:42:45.197 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46418da4:::benchmark_data_smithi188_119427_object113410:head# 2024-04-01T19:42:45.197 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4641b026:::benchmark_data_smithi188_119427_object139090:head# 2024-04-01T19:42:45.198 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4641defe:::benchmark_data_smithi188_119427_object163545:head# 2024-04-01T19:42:45.198 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4641eb60:::benchmark_data_smithi188_119427_object104058:head# 2024-04-01T19:42:45.199 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46422f11:::benchmark_data_smithi188_119427_object129966:head# 2024-04-01T19:42:45.199 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4642e264:::benchmark_data_smithi188_119427_object73356:head# 2024-04-01T19:42:45.200 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46431e92:::benchmark_data_smithi188_119427_object86760:head# 2024-04-01T19:42:45.200 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46434568:::benchmark_data_smithi188_119427_object134127:head# 2024-04-01T19:42:45.200 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4643736b:::benchmark_data_smithi188_119427_object87235:head# 2024-04-01T19:42:45.201 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4643b16e:::benchmark_data_smithi188_119427_object155817:head# 2024-04-01T19:42:45.201 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4643b373:::benchmark_data_smithi188_119427_object124466:head# 2024-04-01T19:42:45.202 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:464410c5:::benchmark_data_smithi188_119427_object120751:head# 2024-04-01T19:42:45.202 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:464528f1:::benchmark_data_smithi188_119427_object108947:head# 2024-04-01T19:42:45.202 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4645ed42:::benchmark_data_smithi188_119427_object111260:head# 2024-04-01T19:42:45.203 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46477170:::benchmark_data_smithi188_119427_object75190:head# 2024-04-01T19:42:45.203 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4648c533:::benchmark_data_smithi188_119427_object128207:head# 2024-04-01T19:42:45.204 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:464b54d9:::benchmark_data_smithi188_119427_object136804:head# 2024-04-01T19:42:45.204 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:464bacae:::benchmark_data_smithi188_119427_object145346:head# 2024-04-01T19:42:45.205 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:464c4b27:::benchmark_data_smithi188_119427_object141563:head# 2024-04-01T19:42:45.205 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:464cf352:::benchmark_data_smithi188_119427_object73958:head# 2024-04-01T19:42:45.206 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:464d4ccf:::benchmark_data_smithi188_119427_object98784:head# 2024-04-01T19:42:45.206 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:464f2de7:::benchmark_data_smithi188_119427_object157621:head# 2024-04-01T19:42:45.207 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:464f392e:::benchmark_data_smithi188_119427_object141874:head# 2024-04-01T19:42:45.207 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:464fa428:::benchmark_data_smithi188_119427_object152939:head# 2024-04-01T19:42:45.208 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:464fb8a3:::benchmark_data_smithi188_119427_object132588:head# 2024-04-01T19:42:45.208 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:464ff507:::benchmark_data_smithi188_119427_object87863:head# 2024-04-01T19:42:45.208 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4650ec9d:::benchmark_data_smithi188_119427_object95968:head# 2024-04-01T19:42:45.209 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4650edea:::benchmark_data_smithi188_119427_object130776:head# 2024-04-01T19:42:45.209 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4651806e:::benchmark_data_smithi188_119427_object123051:head# 2024-04-01T19:42:45.210 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4651d628:::benchmark_data_smithi188_119427_object144741:head# 2024-04-01T19:42:45.210 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:465380f8:::benchmark_data_smithi188_119427_object110514:head# 2024-04-01T19:42:45.211 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4653a20a:::benchmark_data_smithi188_119427_object160126:head# 2024-04-01T19:42:45.211 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46554a66:::benchmark_data_smithi188_119427_object130496:head# 2024-04-01T19:42:45.212 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46557006:::benchmark_data_smithi188_119427_object75821:head# 2024-04-01T19:42:45.212 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4655d037:::benchmark_data_smithi188_119427_object86126:head# 2024-04-01T19:42:45.212 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46561e32:::benchmark_data_smithi188_119427_object128964:head# 2024-04-01T19:42:45.214 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46563660:::benchmark_data_smithi188_119427_object76601:head# 2024-04-01T19:42:45.214 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46566cd6:::benchmark_data_smithi188_119427_object87876:head# 2024-04-01T19:42:45.214 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4657536d:::benchmark_data_smithi188_119427_object143758:head# 2024-04-01T19:42:45.215 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4657ade8:::benchmark_data_smithi188_119427_object158908:head# 2024-04-01T19:42:45.215 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4657c6fc:::benchmark_data_smithi188_119427_object93008:head# 2024-04-01T19:42:45.215 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4657fed4:::benchmark_data_smithi188_119427_object143498:head# 2024-04-01T19:42:45.216 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4658134b:::benchmark_data_smithi188_119427_object80695:head# 2024-04-01T19:42:45.216 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46598b89:::benchmark_data_smithi188_119427_object103721:head# 2024-04-01T19:42:45.217 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46599429:::benchmark_data_smithi188_119427_object74016:head# 2024-04-01T19:42:45.217 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:465b0f51:::benchmark_data_smithi188_119427_object138610:head# 2024-04-01T19:42:45.218 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:465d3c3a:::benchmark_data_smithi188_119427_object108506:head# 2024-04-01T19:42:45.218 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:465d7cb6:::benchmark_data_smithi188_119427_object107337:head# 2024-04-01T19:42:45.218 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:465e1b74:::benchmark_data_smithi188_119427_object94516:head# 2024-04-01T19:42:45.219 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:465e793e:::benchmark_data_smithi188_119427_object151375:head# 2024-04-01T19:42:45.219 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:465ed24a:::benchmark_data_smithi188_119427_object157683:head# 2024-04-01T19:42:45.220 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:465f2114:::benchmark_data_smithi188_119427_object86732:head# 2024-04-01T19:42:45.220 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:465f3a70:::benchmark_data_smithi188_119427_object115223:head# 2024-04-01T19:42:45.221 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:465fa618:::benchmark_data_smithi188_119427_object106926:head# 2024-04-01T19:42:45.221 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:465fb10b:::benchmark_data_smithi188_119427_object83912:head# 2024-04-01T19:42:45.222 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46607dcf:::benchmark_data_smithi188_119427_object158962:head# 2024-04-01T19:42:45.222 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4660de04:::benchmark_data_smithi188_119427_object115448:head# 2024-04-01T19:42:45.222 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:466134a8:::benchmark_data_smithi188_119427_object123229:head# 2024-04-01T19:42:45.223 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46615933:::benchmark_data_smithi188_119427_object100489:head# 2024-04-01T19:42:45.223 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:466177d1:::benchmark_data_smithi188_119427_object132088:head# 2024-04-01T19:42:45.224 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46625413:::benchmark_data_smithi188_119427_object158424:head# 2024-04-01T19:42:45.224 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46626cc4:::benchmark_data_smithi188_119427_object120097:head# 2024-04-01T19:42:45.225 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46645931:::benchmark_data_smithi188_119427_object145352:head# 2024-04-01T19:42:45.225 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4664b006:::benchmark_data_smithi188_119427_object91483:head# 2024-04-01T19:42:45.226 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4664edf3:::benchmark_data_smithi188_119427_object96217:head# 2024-04-01T19:42:45.226 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46653271:::benchmark_data_smithi188_119427_object114757:head# 2024-04-01T19:42:45.227 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4667b24f:::benchmark_data_smithi188_119427_object106767:head# 2024-04-01T19:42:45.227 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:466821d2:::benchmark_data_smithi188_119427_object84057:head# 2024-04-01T19:42:45.227 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4669dafe:::benchmark_data_smithi188_119427_object113279:head# 2024-04-01T19:42:45.228 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:466a7f17:::benchmark_data_smithi188_119427_object153156:head# 2024-04-01T19:42:45.228 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:466b82a1:::benchmark_data_smithi188_119427_object104353:head# 2024-04-01T19:42:45.228 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:466cbf95:::benchmark_data_smithi188_119427_object93276:head# 2024-04-01T19:42:45.229 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:466d52e0:::benchmark_data_smithi188_119427_object84970:head# 2024-04-01T19:42:45.229 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:466fae9a:::benchmark_data_smithi188_119427_object113235:head# 2024-04-01T19:42:45.230 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4671e9f3:::benchmark_data_smithi188_119427_object79739:head# 2024-04-01T19:42:45.231 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4672680f:::benchmark_data_smithi188_119427_object77951:head# 2024-04-01T19:42:45.231 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4673c117:::benchmark_data_smithi188_119427_object84769:head# 2024-04-01T19:42:45.232 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4673d1cf:::benchmark_data_smithi188_119427_object135300:head# 2024-04-01T19:42:45.232 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4673f892:::benchmark_data_smithi188_119427_object139732:head# 2024-04-01T19:42:45.233 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46750dd5:::benchmark_data_smithi188_119427_object75994:head# 2024-04-01T19:42:45.233 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4675628e:::benchmark_data_smithi188_119427_object100163:head# 2024-04-01T19:42:45.234 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4676d5c0:::benchmark_data_smithi188_119427_object83009:head# 2024-04-01T19:42:45.234 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46773dc5:::benchmark_data_smithi188_119427_object84693:head# 2024-04-01T19:42:45.235 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4677a520:::benchmark_data_smithi188_119427_object133305:head# 2024-04-01T19:42:45.235 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46783fd5:::benchmark_data_smithi188_119427_object91085:head# 2024-04-01T19:42:45.235 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4678c41b:::benchmark_data_smithi188_119427_object136954:head# 2024-04-01T19:42:45.236 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46790f6e:::benchmark_data_smithi188_119427_object162955:head# 2024-04-01T19:42:45.236 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4679b915:::benchmark_data_smithi188_119427_object133789:head# 2024-04-01T19:42:45.237 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4679cce8:::benchmark_data_smithi188_119427_object82021:head# 2024-04-01T19:42:45.237 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:467a7c29:::benchmark_data_smithi188_119427_object108200:head# 2024-04-01T19:42:45.237 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:467ad4c5:::benchmark_data_smithi188_119427_object158730:head# 2024-04-01T19:42:45.238 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:467b68e1:::benchmark_data_smithi188_119427_object76337:head# 2024-04-01T19:42:45.238 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:467bcdad:::benchmark_data_smithi188_119427_object99836:head# 2024-04-01T19:42:45.239 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:467cc0c3:::benchmark_data_smithi188_119427_object155355:head# 2024-04-01T19:42:45.239 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:467dc03f:::benchmark_data_smithi188_119427_object86321:head# 2024-04-01T19:42:45.240 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:467e0160:::benchmark_data_smithi188_119427_object115472:head# 2024-04-01T19:42:45.240 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:467e1d55:::benchmark_data_smithi188_119427_object118992:head# 2024-04-01T19:42:45.241 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:467e9d7c:::benchmark_data_smithi188_119427_object88079:head# 2024-04-01T19:42:45.241 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:467fdb77:::benchmark_data_smithi188_119427_object140977:head# 2024-04-01T19:42:45.242 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46807619:::benchmark_data_smithi188_119427_object159040:head# 2024-04-01T19:42:45.242 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4681c591:::benchmark_data_smithi188_119427_object133325:head# 2024-04-01T19:42:45.242 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4681fc7a:::benchmark_data_smithi188_119427_object96490:head# 2024-04-01T19:42:45.243 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:468237fc:::benchmark_data_smithi188_119427_object123070:head# 2024-04-01T19:42:45.243 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46825ac1:::benchmark_data_smithi188_119427_object145778:head# 2024-04-01T19:42:45.244 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46830d92:::benchmark_data_smithi188_119427_object113690:head# 2024-04-01T19:42:45.244 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4683a000:::benchmark_data_smithi188_119427_object124359:head# 2024-04-01T19:42:45.245 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46868610:::benchmark_data_smithi188_119427_object145538:head# 2024-04-01T19:42:45.245 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4686a493:::benchmark_data_smithi188_119427_object116495:head# 2024-04-01T19:42:45.245 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4686d437:::benchmark_data_smithi188_119427_object132916:head# 2024-04-01T19:42:45.246 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46870c58:::benchmark_data_smithi188_119427_object155580:head# 2024-04-01T19:42:45.246 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4688752c:::benchmark_data_smithi188_119427_object109412:head# 2024-04-01T19:42:45.247 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4688f5e7:::benchmark_data_smithi188_119427_object105873:head# 2024-04-01T19:42:45.247 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46894bdb:::benchmark_data_smithi188_119427_object160207:head# 2024-04-01T19:42:45.248 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4689db00:::benchmark_data_smithi188_119427_object83727:head# 2024-04-01T19:42:45.248 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:468a8ef6:::benchmark_data_smithi188_119427_object99643:head# 2024-04-01T19:42:45.248 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:468c278f:::benchmark_data_smithi188_119427_object95390:head# 2024-04-01T19:42:45.249 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:468e67b6:::benchmark_data_smithi188_119427_object151897:head# 2024-04-01T19:42:45.249 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:468e7294:::benchmark_data_smithi188_119427_object160206:head# 2024-04-01T19:42:45.250 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:468f4063:::benchmark_data_smithi188_119427_object125406:head# 2024-04-01T19:42:45.250 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46903910:::benchmark_data_smithi188_119427_object151545:head# 2024-04-01T19:42:45.251 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:469059a4:::benchmark_data_smithi188_119427_object159332:head# 2024-04-01T19:42:45.251 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4690d1fb:::benchmark_data_smithi188_119427_object76176:head# 2024-04-01T19:42:45.251 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46952db4:::benchmark_data_smithi188_119427_object148136:head# 2024-04-01T19:42:45.253 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46956737:::benchmark_data_smithi188_119427_object153859:head# 2024-04-01T19:42:45.254 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46971c78:::benchmark_data_smithi188_119427_object122455:head# 2024-04-01T19:42:45.254 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:469b8a0b:::benchmark_data_smithi188_119427_object150252:head# 2024-04-01T19:42:45.255 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:469bcf6e:::benchmark_data_smithi188_119427_object107066:head# 2024-04-01T19:42:45.255 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:469c43e1:::benchmark_data_smithi188_119427_object76872:head# 2024-04-01T19:42:45.255 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:469d288b:::benchmark_data_smithi188_119427_object98710:head# 2024-04-01T19:42:45.256 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:469e2d30:::benchmark_data_smithi188_119427_object83770:head# 2024-04-01T19:42:45.256 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:469eb19e:::benchmark_data_smithi188_119427_object110760:head# 2024-04-01T19:42:45.256 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46a04349:::benchmark_data_smithi188_119427_object98576:head# 2024-04-01T19:42:45.257 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46a057fd:::benchmark_data_smithi188_119427_object125200:head# 2024-04-01T19:42:45.257 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46a06b4a:::benchmark_data_smithi188_119427_object146687:head# 2024-04-01T19:42:45.258 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46a07394:::benchmark_data_smithi188_119427_object164378:head# 2024-04-01T19:42:45.258 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46a11728:::benchmark_data_smithi188_119427_object139559:head# 2024-04-01T19:42:45.259 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46a1c268:::benchmark_data_smithi188_119427_object78149:head# 2024-04-01T19:42:45.259 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46a25c90:::benchmark_data_smithi188_119427_object76535:head# 2024-04-01T19:42:45.260 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46a29b70:::benchmark_data_smithi188_119427_object149903:head# 2024-04-01T19:42:45.260 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46a2e58a:::benchmark_data_smithi188_119427_object152310:head# 2024-04-01T19:42:45.261 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46a32e7d:::benchmark_data_smithi188_119427_object141758:head# 2024-04-01T19:42:45.261 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46a3ef27:::benchmark_data_smithi188_119427_object123723:head# 2024-04-01T19:42:45.261 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46a4a33b:::benchmark_data_smithi188_119427_object131774:head# 2024-04-01T19:42:45.262 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46a6ea8e:::benchmark_data_smithi188_119427_object80846:head# 2024-04-01T19:42:45.262 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46a7beb9:::benchmark_data_smithi188_119427_object123230:head# 2024-04-01T19:42:45.263 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46ab2cf3:::benchmark_data_smithi188_119427_object94858:head# 2024-04-01T19:42:45.263 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46ac58da:::benchmark_data_smithi188_119427_object93965:head# 2024-04-01T19:42:45.263 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46acd09f:::benchmark_data_smithi188_119427_object104326:head# 2024-04-01T19:42:45.264 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46adbf90:::benchmark_data_smithi188_119427_object116593:head# 2024-04-01T19:42:45.264 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46adf4d5:::benchmark_data_smithi188_119427_object137328:head# 2024-04-01T19:42:45.265 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46af3e19:::benchmark_data_smithi188_119427_object162359:head# 2024-04-01T19:42:45.265 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46b11c2a:::benchmark_data_smithi188_119427_object125291:head# 2024-04-01T19:42:45.266 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46b154fa:::benchmark_data_smithi188_119427_object105237:head# 2024-04-01T19:42:45.266 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46b2250b:::benchmark_data_smithi188_119427_object150804:head# 2024-04-01T19:42:45.266 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46b29ff4:::benchmark_data_smithi188_119427_object124196:head# 2024-04-01T19:42:45.267 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46b36ea3:::benchmark_data_smithi188_119427_object82155:head# 2024-04-01T19:42:45.267 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46b3c708:::benchmark_data_smithi188_119427_object128251:head# 2024-04-01T19:42:45.268 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46b3f2ea:::benchmark_data_smithi188_119427_object139236:head# 2024-04-01T19:42:45.268 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46b480fc:::benchmark_data_smithi188_119427_object111704:head# 2024-04-01T19:42:45.269 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46b4e48e:::benchmark_data_smithi188_119427_object128352:head# 2024-04-01T19:42:45.269 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46b678a6:::benchmark_data_smithi188_119427_object156747:head# 2024-04-01T19:42:45.269 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46b7b061:::benchmark_data_smithi188_119427_object116410:head# 2024-04-01T19:42:45.270 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46b845a8:::benchmark_data_smithi188_119427_object115783:head# 2024-04-01T19:42:45.270 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46b8ee88:::benchmark_data_smithi188_119427_object160391:head# 2024-04-01T19:42:45.271 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46b9e98a:::benchmark_data_smithi188_119427_object112950:head# 2024-04-01T19:42:45.271 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46b9ed5f:::benchmark_data_smithi188_119427_object153276:head# 2024-04-01T19:42:45.272 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46ba7c2e:::benchmark_data_smithi188_119427_object87325:head# 2024-04-01T19:42:45.272 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46ba929b:::benchmark_data_smithi188_119427_object124392:head# 2024-04-01T19:42:45.273 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46baa90e:::benchmark_data_smithi188_119427_object131179:head# 2024-04-01T19:42:45.273 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46bb82ba:::benchmark_data_smithi188_119427_object103495:head# 2024-04-01T19:42:45.274 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46bb8657:::benchmark_data_smithi188_119427_object120152:head# 2024-04-01T19:42:45.274 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46bb9fe3:::benchmark_data_smithi188_119427_object137199:head# 2024-04-01T19:42:45.275 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46bbcb98:::benchmark_data_smithi188_119427_object145258:head# 2024-04-01T19:42:45.275 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46bd2a6c:::benchmark_data_smithi188_119427_object88887:head# 2024-04-01T19:42:45.275 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46bd4368:::benchmark_data_smithi188_119427_object89767:head# 2024-04-01T19:42:45.276 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46bf179a:::benchmark_data_smithi188_119427_object102251:head# 2024-04-01T19:42:45.276 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46c02451:::benchmark_data_smithi188_119427_object72670:head# 2024-04-01T19:42:45.277 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46c14eed:::benchmark_data_smithi188_119427_object104719:head# 2024-04-01T19:42:45.277 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46c242ca:::benchmark_data_smithi188_119427_object100410:head# 2024-04-01T19:42:45.278 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46c56c32:::benchmark_data_smithi188_119427_object156221:head# 2024-04-01T19:42:45.278 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46c60624:::benchmark_data_smithi188_119427_object104048:head# 2024-04-01T19:42:45.279 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46c75b8d:::benchmark_data_smithi188_119427_object113835:head# 2024-04-01T19:42:45.279 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46c8af47:::benchmark_data_smithi188_119427_object140246:head# 2024-04-01T19:42:45.280 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46cbcae2:::benchmark_data_smithi188_119427_object107755:head# 2024-04-01T19:42:45.280 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46cc89ed:::benchmark_data_smithi188_119427_object96052:head# 2024-04-01T19:42:45.281 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46cf4461:::benchmark_data_smithi188_119427_object136476:head# 2024-04-01T19:42:45.281 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46d1771c:::benchmark_data_smithi188_119427_object162376:head# 2024-04-01T19:42:45.282 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46d18bdc:::benchmark_data_smithi188_119427_object97998:head# 2024-04-01T19:42:45.282 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46d1946d:::benchmark_data_smithi188_119427_object129608:head# 2024-04-01T19:42:45.282 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46d2c440:::benchmark_data_smithi188_119427_object98285:head# 2024-04-01T19:42:45.283 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46d2eaf8:::benchmark_data_smithi188_119427_object104394:head# 2024-04-01T19:42:45.283 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46d33214:::benchmark_data_smithi188_119427_object158883:head# 2024-04-01T19:42:45.284 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46d3c50a:::benchmark_data_smithi188_119427_object129140:head# 2024-04-01T19:42:45.284 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46d65d04:::benchmark_data_smithi188_119427_object106751:head# 2024-04-01T19:42:45.285 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46d65eb4:::benchmark_data_smithi188_119427_object127605:head# 2024-04-01T19:42:45.285 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46d668d4:::benchmark_data_smithi188_119427_object126651:head# 2024-04-01T19:42:45.286 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46d7f705:::benchmark_data_smithi188_119427_object108907:head# 2024-04-01T19:42:45.286 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46d85c18:::benchmark_data_smithi188_119427_object86878:head# 2024-04-01T19:42:45.287 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46d86c67:::benchmark_data_smithi188_119427_object137974:head# 2024-04-01T19:42:45.287 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46d946df:::benchmark_data_smithi188_119427_object114497:head# 2024-04-01T19:42:45.287 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46d9acee:::benchmark_data_smithi188_119427_object121613:head# 2024-04-01T19:42:45.288 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46da379b:::benchmark_data_smithi188_119427_object76343:head# 2024-04-01T19:42:45.288 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46da9fce:::benchmark_data_smithi188_119427_object137336:head# 2024-04-01T19:42:45.289 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46db249e:::benchmark_data_smithi188_119427_object78140:head# 2024-04-01T19:42:45.289 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46dbe4b5:::benchmark_data_smithi188_119427_object117334:head# 2024-04-01T19:42:45.290 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46df9154:::benchmark_data_smithi188_119427_object156313:head# 2024-04-01T19:42:45.290 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46e0e2b1:::benchmark_data_smithi188_119427_object93802:head# 2024-04-01T19:42:45.291 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46e17e2f:::benchmark_data_smithi188_119427_object152608:head# 2024-04-01T19:42:45.291 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46e17f3c:::benchmark_data_smithi188_119427_object150803:head# 2024-04-01T19:42:45.291 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46e1a6e1:::benchmark_data_smithi188_119427_object144909:head# 2024-04-01T19:42:45.292 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46e20695:::benchmark_data_smithi188_119427_object145685:head# 2024-04-01T19:42:45.292 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46e4f17a:::benchmark_data_smithi188_119427_object125661:head# 2024-04-01T19:42:45.293 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46e561cc:::benchmark_data_smithi188_119427_object89877:head# 2024-04-01T19:42:45.293 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46e5e125:::benchmark_data_smithi188_119427_object162816:head# 2024-04-01T19:42:45.293 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46e66dd5:::benchmark_data_smithi188_119427_object162566:head# 2024-04-01T19:42:45.294 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46e7adea:::benchmark_data_smithi188_119427_object81809:head# 2024-04-01T19:42:45.294 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46e8f704:::benchmark_data_smithi188_119427_object137880:head# 2024-04-01T19:42:45.295 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46e94769:::benchmark_data_smithi188_119427_object138156:head# 2024-04-01T19:42:45.295 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46e988ce:::benchmark_data_smithi188_119427_object88587:head# 2024-04-01T19:42:45.296 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46ea5cb9:::benchmark_data_smithi188_119427_object144105:head# 2024-04-01T19:42:45.296 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46eb74ce:::benchmark_data_smithi188_119427_object75436:head# 2024-04-01T19:42:45.297 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46ec63c3:::benchmark_data_smithi188_119427_object139197:head# 2024-04-01T19:42:45.297 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46ed41e4:::benchmark_data_smithi188_119427_object138894:head# 2024-04-01T19:42:45.298 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46ed5c60:::benchmark_data_smithi188_119427_object87360:head# 2024-04-01T19:42:45.298 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46eda9a7:::benchmark_data_smithi188_119427_object129422:head# 2024-04-01T19:42:45.299 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46eedb00:::benchmark_data_smithi188_119427_object106213:head# 2024-04-01T19:42:45.299 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46f0ed0e:::benchmark_data_smithi188_119427_object161526:head# 2024-04-01T19:42:45.300 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46f0f288:::benchmark_data_smithi188_119427_object116334:head# 2024-04-01T19:42:45.300 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46f119ae:::benchmark_data_smithi188_119427_object152555:head# 2024-04-01T19:42:45.300 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46f16413:::benchmark_data_smithi188_119427_object97275:head# 2024-04-01T19:42:45.301 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46f1d611:::benchmark_data_smithi188_119427_object88022:head# 2024-04-01T19:42:45.301 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46f1e0f5:::benchmark_data_smithi188_119427_object121567:head# 2024-04-01T19:42:45.302 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46f2c984:::benchmark_data_smithi188_119427_object140987:head# 2024-04-01T19:42:45.302 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46f2d234:::benchmark_data_smithi188_119427_object144383:head# 2024-04-01T19:42:45.303 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46f39c80:::benchmark_data_smithi188_119427_object106623:head# 2024-04-01T19:42:45.303 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46f443bf:::benchmark_data_smithi188_119427_object129616:head# 2024-04-01T19:42:45.304 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46f4ded2:::benchmark_data_smithi188_119427_object80885:head# 2024-04-01T19:42:45.304 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46f51b49:::benchmark_data_smithi188_119427_object108719:head# 2024-04-01T19:42:45.305 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46f5ab24:::benchmark_data_smithi188_119427_object74161:head# 2024-04-01T19:42:45.305 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46f7c433:::benchmark_data_smithi188_119427_object81447:head# 2024-04-01T19:42:45.306 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46f7ebb9:::benchmark_data_smithi188_119427_object159494:head# 2024-04-01T19:42:45.306 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46f8b05b:::benchmark_data_smithi188_119427_object111933:head# 2024-04-01T19:42:45.306 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46f8b770:::benchmark_data_smithi188_119427_object88724:head# 2024-04-01T19:42:45.307 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46fabe0a:::benchmark_data_smithi188_119427_object125543:head# 2024-04-01T19:42:45.308 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46fc6d20:::benchmark_data_smithi188_119427_object142123:head# 2024-04-01T19:42:45.308 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46fd1fd1:::benchmark_data_smithi188_119427_object117921:head# 2024-04-01T19:42:45.308 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46fd3992:::benchmark_data_smithi188_119427_object95083:head# 2024-04-01T19:42:45.309 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46fd3cb4:::benchmark_data_smithi188_119427_object86535:head# 2024-04-01T19:42:45.309 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46fdc310:::benchmark_data_smithi188_119427_object145587:head# 2024-04-01T19:42:45.310 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:46fe2319:::benchmark_data_smithi188_119427_object145772:head# 2024-04-01T19:42:45.310 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4700e44a:::benchmark_data_smithi188_119427_object134683:head# 2024-04-01T19:42:45.311 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4701f6f3:::benchmark_data_smithi188_119427_object112328:head# 2024-04-01T19:42:45.311 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47031c9f:::benchmark_data_smithi188_119427_object115110:head# 2024-04-01T19:42:45.312 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4704491e:::benchmark_data_smithi188_119427_object157542:head# 2024-04-01T19:42:45.312 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4704cd65:::benchmark_data_smithi188_119427_object126675:head# 2024-04-01T19:42:45.313 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4704cee6:::benchmark_data_smithi188_119427_object88097:head# 2024-04-01T19:42:45.313 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4705086f:::benchmark_data_smithi188_119427_object85368:head# 2024-04-01T19:42:45.313 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4705425e:::benchmark_data_smithi188_119427_object97697:head# 2024-04-01T19:42:45.314 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:470568b1:::benchmark_data_smithi188_119427_object122563:head# 2024-04-01T19:42:45.315 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47058311:::benchmark_data_smithi188_119427_object162502:head# 2024-04-01T19:42:45.315 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:470597fb:::benchmark_data_smithi188_119427_object131332:head# 2024-04-01T19:42:45.316 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:470646fd:::benchmark_data_smithi188_119427_object162086:head# 2024-04-01T19:42:45.316 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:470694c7:::benchmark_data_smithi188_119427_object85465:head# 2024-04-01T19:42:45.316 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47080b93:::benchmark_data_smithi188_119427_object96767:head# 2024-04-01T19:42:45.317 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4709fd2f:::benchmark_data_smithi188_119427_object161220:head# 2024-04-01T19:42:45.317 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:470aa69a:::benchmark_data_smithi188_119427_object151607:head# 2024-04-01T19:42:45.318 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:470c0889:::benchmark_data_smithi188_119427_object143569:head# 2024-04-01T19:42:45.318 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:470ca632:::benchmark_data_smithi188_119427_object146562:head# 2024-04-01T19:42:45.319 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:470da2a8:::benchmark_data_smithi188_119427_object149851:head# 2024-04-01T19:42:45.319 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:470df068:::benchmark_data_smithi188_119427_object151870:head# 2024-04-01T19:42:45.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:470eee2e:::benchmark_data_smithi188_119427_object115245:head# 2024-04-01T19:42:45.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:470f26ae:::benchmark_data_smithi188_119427_object109042:head# 2024-04-01T19:42:45.320 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:470fc0fc:::benchmark_data_smithi188_119427_object82805:head# 2024-04-01T19:42:45.321 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4710c323:::benchmark_data_smithi188_119427_object159869:head# 2024-04-01T19:42:45.322 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47125a05:::benchmark_data_smithi188_119427_object101511:head# 2024-04-01T19:42:45.322 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47127793:::benchmark_data_smithi188_119427_object123794:head# 2024-04-01T19:42:45.322 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47141a3b:::benchmark_data_smithi188_119427_object85487:head# 2024-04-01T19:42:45.323 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4716c80c:::benchmark_data_smithi188_119427_object92578:head# 2024-04-01T19:42:45.323 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4716fb12:::benchmark_data_smithi188_119427_object92514:head# 2024-04-01T19:42:45.324 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47184e29:::benchmark_data_smithi188_119427_object98788:head# 2024-04-01T19:42:45.324 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4719416d:::benchmark_data_smithi188_119427_object146403:head# 2024-04-01T19:42:45.324 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47195cea:::benchmark_data_smithi188_119427_object148173:head# 2024-04-01T19:42:45.325 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4719f949:::benchmark_data_smithi188_119427_object144307:head# 2024-04-01T19:42:45.325 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:471a6862:::benchmark_data_smithi188_119427_object134624:head# 2024-04-01T19:42:45.326 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:471a7f57:::benchmark_data_smithi188_119427_object154268:head# 2024-04-01T19:42:45.326 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:471b06bc:::benchmark_data_smithi188_119427_object77593:head# 2024-04-01T19:42:45.327 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:471cf5be:::benchmark_data_smithi188_119427_object96746:head# 2024-04-01T19:42:45.327 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:471d3eae:::benchmark_data_smithi188_119427_object104584:head# 2024-04-01T19:42:45.327 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:471d99bf:::benchmark_data_smithi188_119427_object162941:head# 2024-04-01T19:42:45.328 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:471ddb90:::benchmark_data_smithi188_119427_object127656:head# 2024-04-01T19:42:45.328 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:471ef0bb:::benchmark_data_smithi188_119427_object87581:head# 2024-04-01T19:42:45.329 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:471f53d8:::benchmark_data_smithi188_119427_object87161:head# 2024-04-01T19:42:45.330 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:471fb54b:::benchmark_data_smithi188_119427_object90003:head# 2024-04-01T19:42:45.330 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47208e07:::benchmark_data_smithi188_119427_object144680:head# 2024-04-01T19:42:45.331 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4720f224:::benchmark_data_smithi188_119427_object100047:head# 2024-04-01T19:42:45.331 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47215317:::benchmark_data_smithi188_119427_object123923:head# 2024-04-01T19:42:45.331 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47222da6:::benchmark_data_smithi188_119427_object87805:head# 2024-04-01T19:42:45.332 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4722d168:::benchmark_data_smithi188_119427_object143746:head# 2024-04-01T19:42:45.332 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4724288b:::benchmark_data_smithi188_119427_object120552:head# 2024-04-01T19:42:45.333 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47257242:::benchmark_data_smithi188_119427_object155193:head# 2024-04-01T19:42:45.333 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4725920a:::benchmark_data_smithi188_119427_object109683:head# 2024-04-01T19:42:45.334 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:472615e1:::benchmark_data_smithi188_119427_object132636:head# 2024-04-01T19:42:45.334 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4726af84:::benchmark_data_smithi188_119427_object85931:head# 2024-04-01T19:42:45.335 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4726d4fa:::benchmark_data_smithi188_119427_object118410:head# 2024-04-01T19:42:45.335 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4727003c:::benchmark_data_smithi188_119427_object78356:head# 2024-04-01T19:42:45.335 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:472727a3:::benchmark_data_smithi188_119427_object148047:head# 2024-04-01T19:42:45.336 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4728e5c7:::benchmark_data_smithi188_119427_object153192:head# 2024-04-01T19:42:45.336 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4728ee22:::benchmark_data_smithi188_119427_object74399:head# 2024-04-01T19:42:45.337 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:472a7ca6:::benchmark_data_smithi188_119427_object128368:head# 2024-04-01T19:42:45.337 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:472c64a1:::benchmark_data_smithi188_119427_object72718:head# 2024-04-01T19:42:45.338 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:472ce391:::benchmark_data_smithi188_119427_object155004:head# 2024-04-01T19:42:45.338 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:472d06ca:::benchmark_data_smithi188_119427_object91249:head# 2024-04-01T19:42:45.339 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:472e7cfc:::benchmark_data_smithi188_119427_object98338:head# 2024-04-01T19:42:45.339 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:472f0d28:::benchmark_data_smithi188_119427_object111742:head# 2024-04-01T19:42:45.340 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:472f95d5:::benchmark_data_smithi188_119427_object126308:head# 2024-04-01T19:42:45.340 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47302d2b:::benchmark_data_smithi188_119427_object117342:head# 2024-04-01T19:42:45.341 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:473099b7:::benchmark_data_smithi188_119427_object98098:head# 2024-04-01T19:42:45.341 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47319094:::benchmark_data_smithi188_119427_object156012:head# 2024-04-01T19:42:45.342 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:473302b2:::benchmark_data_smithi188_119427_object133713:head# 2024-04-01T19:42:45.342 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47340e34:::benchmark_data_smithi188_119427_object101716:head# 2024-04-01T19:42:45.343 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4736e0b1:::benchmark_data_smithi188_119427_object152389:head# 2024-04-01T19:42:45.343 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4737303f:::benchmark_data_smithi188_119427_object148820:head# 2024-04-01T19:42:45.344 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47373688:::benchmark_data_smithi188_119427_object132864:head# 2024-04-01T19:42:45.344 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4737a01d:::benchmark_data_smithi188_119427_object127669:head# 2024-04-01T19:42:45.345 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4738deda:::benchmark_data_smithi188_119427_object140023:head# 2024-04-01T19:42:45.345 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:473a8085:::benchmark_data_smithi188_119427_object123145:head# 2024-04-01T19:42:45.345 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:473a88ba:::benchmark_data_smithi188_119427_object96699:head# 2024-04-01T19:42:45.346 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:473b2741:::benchmark_data_smithi188_119427_object85721:head# 2024-04-01T19:42:45.346 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:473bc531:::benchmark_data_smithi188_119427_object132885:head# 2024-04-01T19:42:45.347 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:473bd0cb:::benchmark_data_smithi188_119427_object89637:head# 2024-04-01T19:42:45.347 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:473be3cb:::benchmark_data_smithi188_119427_object79649:head# 2024-04-01T19:42:45.347 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:473be435:::benchmark_data_smithi188_119427_object120672:head# 2024-04-01T19:42:45.348 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:473c8441:::benchmark_data_smithi188_119427_object123931:head# 2024-04-01T19:42:45.349 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:473cc2d5:::benchmark_data_smithi188_119427_object82883:head# 2024-04-01T19:42:45.349 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:473cdbdd:::benchmark_data_smithi188_119427_object113009:head# 2024-04-01T19:42:45.350 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:473e0cad:::benchmark_data_smithi188_119427_object121460:head# 2024-04-01T19:42:45.350 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:473e9034:::benchmark_data_smithi188_119427_object117264:head# 2024-04-01T19:42:45.350 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:473f5136:::benchmark_data_smithi188_119427_object131695:head# 2024-04-01T19:42:45.351 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47402cf6:::benchmark_data_smithi188_119427_object128785:head# 2024-04-01T19:42:45.352 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47406acd:::benchmark_data_smithi188_119427_object91029:head# 2024-04-01T19:42:45.352 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47417027:::benchmark_data_smithi188_119427_object164505:head# 2024-04-01T19:42:45.353 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4743890c:::benchmark_data_smithi188_119427_object112935:head# 2024-04-01T19:42:45.353 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4743a072:::benchmark_data_smithi188_119427_object86768:head# 2024-04-01T19:42:45.353 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4743e321:::benchmark_data_smithi188_119427_object86131:head# 2024-04-01T19:42:45.354 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47443738:::benchmark_data_smithi188_119427_object133794:head# 2024-04-01T19:42:45.354 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47457421:::benchmark_data_smithi188_119427_object130248:head# 2024-04-01T19:42:45.355 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4745b2eb:::benchmark_data_smithi188_119427_object128803:head# 2024-04-01T19:42:45.355 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4745e9bb:::benchmark_data_smithi188_119427_object151877:head# 2024-04-01T19:42:45.356 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4746db4b:::benchmark_data_smithi188_119427_object94768:head# 2024-04-01T19:42:45.356 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4746e1f0:::benchmark_data_smithi188_119427_object121815:head# 2024-04-01T19:42:45.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:474878f4:::benchmark_data_smithi188_119427_object109107:head# 2024-04-01T19:42:45.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:474986eb:::benchmark_data_smithi188_119427_object110206:head# 2024-04-01T19:42:45.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47499dd0:::benchmark_data_smithi188_119427_object93172:head# 2024-04-01T19:42:45.358 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4749bfc3:::benchmark_data_smithi188_119427_object125131:head# 2024-04-01T19:42:45.358 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4749ee44:::benchmark_data_smithi188_119427_object97730:head# 2024-04-01T19:42:45.359 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:474b95e0:::benchmark_data_smithi188_119427_object106747:head# 2024-04-01T19:42:45.359 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:474bffbc:::benchmark_data_smithi188_119427_object101842:head# 2024-04-01T19:42:45.360 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:474c0511:::benchmark_data_smithi188_119427_object121161:head# 2024-04-01T19:42:45.360 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:474dffef:::benchmark_data_smithi188_119427_object90168:head# 2024-04-01T19:42:45.361 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:474e8f9d:::benchmark_data_smithi188_119427_object83304:head# 2024-04-01T19:42:45.361 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47500739:::benchmark_data_smithi188_119427_object160947:head# 2024-04-01T19:42:45.361 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4751b248:::benchmark_data_smithi188_119427_object111992:head# 2024-04-01T19:42:45.362 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:475298d4:::benchmark_data_smithi188_119427_object99267:head# 2024-04-01T19:42:45.363 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4752e7f2:::benchmark_data_smithi188_119427_object102885:head# 2024-04-01T19:42:45.363 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47533b24:::benchmark_data_smithi188_119427_object98687:head# 2024-04-01T19:42:45.364 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47536414:::benchmark_data_smithi188_119427_object118364:head# 2024-04-01T19:42:45.364 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:475443b3:::benchmark_data_smithi188_119427_object129104:head# 2024-04-01T19:42:45.365 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4754f5e0:::benchmark_data_smithi188_119427_object95416:head# 2024-04-01T19:42:45.365 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4754fe5d:::benchmark_data_smithi188_119427_object73237:head# 2024-04-01T19:42:45.366 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4755981b:::benchmark_data_smithi188_119427_object94984:head# 2024-04-01T19:42:45.366 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4755c057:::benchmark_data_smithi188_119427_object99131:head# 2024-04-01T19:42:45.366 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47566be3:::benchmark_data_smithi188_119427_object158822:head# 2024-04-01T19:42:45.367 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4757abd0:::benchmark_data_smithi188_119427_object117599:head# 2024-04-01T19:42:45.368 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:475948f8:::benchmark_data_smithi188_119427_object84186:head# 2024-04-01T19:42:45.368 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4759aff4:::benchmark_data_smithi188_119427_object115638:head# 2024-04-01T19:42:45.368 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4759e6a6:::benchmark_data_smithi188_119427_object118858:head# 2024-04-01T19:42:45.369 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:475ac7f3:::benchmark_data_smithi188_119427_object137655:head# 2024-04-01T19:42:45.369 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:475b20fd:::benchmark_data_smithi188_119427_object102824:head# 2024-04-01T19:42:45.370 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:475b542f:::benchmark_data_smithi188_119427_object108297:head# 2024-04-01T19:42:45.370 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:475d3b25:::benchmark_data_smithi188_119427_object73284:head# 2024-04-01T19:42:45.370 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:475da2ed:::benchmark_data_smithi188_119427_object148489:head# 2024-04-01T19:42:45.371 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:475e879c:::benchmark_data_smithi188_119427_object157658:head# 2024-04-01T19:42:45.371 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:475f7068:::benchmark_data_smithi188_119427_object113288:head# 2024-04-01T19:42:45.372 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:475fd739:::benchmark_data_smithi188_119427_object84405:head# 2024-04-01T19:42:45.372 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47600e9a:::benchmark_data_smithi188_119427_object116704:head# 2024-04-01T19:42:45.373 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47604d9a:::benchmark_data_smithi188_119427_object153310:head# 2024-04-01T19:42:45.373 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47611436:::benchmark_data_smithi188_119427_object96688:head# 2024-04-01T19:42:45.374 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47612bdd:::benchmark_data_smithi188_119427_object139660:head# 2024-04-01T19:42:45.375 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:476150e0:::benchmark_data_smithi188_119427_object77401:head# 2024-04-01T19:42:45.375 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4761a2f0:::benchmark_data_smithi188_119427_object109490:head# 2024-04-01T19:42:45.376 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:476283ce:::benchmark_data_smithi188_119427_object121949:head# 2024-04-01T19:42:45.376 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47631e58:::benchmark_data_smithi188_119427_object161639:head# 2024-04-01T19:42:45.377 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4763f070:::benchmark_data_smithi188_119427_object149318:head# 2024-04-01T19:42:45.377 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47643d3e:::benchmark_data_smithi188_119427_object112545:head# 2024-04-01T19:42:45.377 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47649deb:::benchmark_data_smithi188_119427_object128289:head# 2024-04-01T19:42:45.378 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4764af53:::benchmark_data_smithi188_119427_object92382:head# 2024-04-01T19:42:45.379 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47650448:::benchmark_data_smithi188_119427_object133079:head# 2024-04-01T19:42:45.379 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47661a05:::benchmark_data_smithi188_119427_object136509:head# 2024-04-01T19:42:45.379 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47682f65:::benchmark_data_smithi188_119427_object144789:head# 2024-04-01T19:42:45.380 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4768667a:::benchmark_data_smithi188_119427_object99543:head# 2024-04-01T19:42:45.380 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47689fa3:::benchmark_data_smithi188_119427_object132129:head# 2024-04-01T19:42:45.381 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4768b091:::benchmark_data_smithi188_119427_object145803:head# 2024-04-01T19:42:45.381 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47693252:::benchmark_data_smithi188_119427_object163218:head# 2024-04-01T19:42:45.382 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47696511:::benchmark_data_smithi188_119427_object115067:head# 2024-04-01T19:42:45.382 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4769ed8e:::benchmark_data_smithi188_119427_object96513:head# 2024-04-01T19:42:45.383 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:476a44e3:::benchmark_data_smithi188_119427_object81598:head# 2024-04-01T19:42:45.383 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:476a8bc5:::benchmark_data_smithi188_119427_object100605:head# 2024-04-01T19:42:45.384 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:476b6883:::benchmark_data_smithi188_119427_object164217:head# 2024-04-01T19:42:45.385 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:476bcfde:::benchmark_data_smithi188_119427_object79772:head# 2024-04-01T19:42:45.385 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:476bf47b:::benchmark_data_smithi188_119427_object95697:head# 2024-04-01T19:42:45.386 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:476c61c2:::benchmark_data_smithi188_119427_object151488:head# 2024-04-01T19:42:45.386 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:476c8547:::benchmark_data_smithi188_119427_object90218:head# 2024-04-01T19:42:45.387 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:476dcec9:::benchmark_data_smithi188_119427_object142730:head# 2024-04-01T19:42:45.388 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:476def78:::benchmark_data_smithi188_119427_object154859:head# 2024-04-01T19:42:45.388 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:476e4923:::benchmark_data_smithi188_119427_object114939:head# 2024-04-01T19:42:45.388 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:476f35fb:::benchmark_data_smithi188_119427_object130533:head# 2024-04-01T19:42:45.389 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:476f6266:::benchmark_data_smithi188_119427_object86812:head# 2024-04-01T19:42:45.389 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:476faa36:::benchmark_data_smithi188_119427_object78751:head# 2024-04-01T19:42:45.390 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:476fdd99:::benchmark_data_smithi188_119427_object101565:head# 2024-04-01T19:42:45.390 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4770a536:::benchmark_data_smithi188_119427_object81047:head# 2024-04-01T19:42:45.391 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47710bf0:::benchmark_data_smithi188_119427_object124438:head# 2024-04-01T19:42:45.391 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4771a5cf:::benchmark_data_smithi188_119427_object124820:head# 2024-04-01T19:42:45.391 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4772d102:::benchmark_data_smithi188_119427_object131955:head# 2024-04-01T19:42:45.393 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4774fad2:::benchmark_data_smithi188_119427_object143128:head# 2024-04-01T19:42:45.393 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47756493:::benchmark_data_smithi188_119427_object73067:head# 2024-04-01T19:42:45.394 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:477592dd:::benchmark_data_smithi188_119427_object131340:head# 2024-04-01T19:42:45.394 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4775e821:::benchmark_data_smithi188_119427_object139112:head# 2024-04-01T19:42:45.395 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4775f5d2:::benchmark_data_smithi188_119427_object115299:head# 2024-04-01T19:42:45.402 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:477644c6:::benchmark_data_smithi188_119427_object100203:head# 2024-04-01T19:42:45.402 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47766b4b:::benchmark_data_smithi188_119427_object122830:head# 2024-04-01T19:42:45.402 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4777a858:::benchmark_data_smithi188_119427_object109669:head# 2024-04-01T19:42:45.403 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47780f38:::benchmark_data_smithi188_119427_object89783:head# 2024-04-01T19:42:45.403 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47781775:::benchmark_data_smithi188_119427_object86762:head# 2024-04-01T19:42:45.404 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:477949c5:::benchmark_data_smithi188_119427_object123672:head# 2024-04-01T19:42:45.404 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:477a8980:::benchmark_data_smithi188_119427_object117460:head# 2024-04-01T19:42:45.404 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:477c146a:::benchmark_data_smithi188_119427_object141224:head# 2024-04-01T19:42:45.405 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:477dca40:::benchmark_data_smithi188_119427_object107279:head# 2024-04-01T19:42:45.405 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:477e026b:::benchmark_data_smithi188_119427_object78734:head# 2024-04-01T19:42:45.406 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:477e9d8b:::benchmark_data_smithi188_119427_object104223:head# 2024-04-01T19:42:45.406 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:477eadd8:::benchmark_data_smithi188_119427_object76750:head# 2024-04-01T19:42:45.407 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:477f3a65:::benchmark_data_smithi188_119427_object119056:head# 2024-04-01T19:42:45.407 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:477f45ac:::benchmark_data_smithi188_119427_object134695:head# 2024-04-01T19:42:45.408 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4780d535:::benchmark_data_smithi188_119427_object146443:head# 2024-04-01T19:42:45.408 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4781572d:::benchmark_data_smithi188_119427_object109984:head# 2024-04-01T19:42:45.409 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47825247:::benchmark_data_smithi188_119427_object139889:head# 2024-04-01T19:42:45.409 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4783c891:::benchmark_data_smithi188_119427_object156528:head# 2024-04-01T19:42:45.410 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:478414c5:::benchmark_data_smithi188_119427_object92831:head# 2024-04-01T19:42:45.410 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47846525:::benchmark_data_smithi188_119427_object134955:head# 2024-04-01T19:42:45.411 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47848f56:::benchmark_data_smithi188_119427_object147163:head# 2024-04-01T19:42:45.411 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4784c292:::benchmark_data_smithi188_119427_object129773:head# 2024-04-01T19:42:45.411 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4785fa0f:::benchmark_data_smithi188_119427_object159460:head# 2024-04-01T19:42:45.412 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47868840:::benchmark_data_smithi188_119427_object125015:head# 2024-04-01T19:42:45.412 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4786d7f6:::benchmark_data_smithi188_119427_object77050:head# 2024-04-01T19:42:45.413 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4786dc9c:::benchmark_data_smithi188_119427_object80176:head# 2024-04-01T19:42:45.414 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47875a65:::benchmark_data_smithi188_119427_object127052:head# 2024-04-01T19:42:45.414 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4788e032:::benchmark_data_smithi188_119427_object114667:head# 2024-04-01T19:42:45.414 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4788fba8:::benchmark_data_smithi188_119427_object82486:head# 2024-04-01T19:42:45.415 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:478b7e50:::benchmark_data_smithi188_119427_object160704:head# 2024-04-01T19:42:45.415 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:478c1a89:::benchmark_data_smithi188_119427_object147038:head# 2024-04-01T19:42:45.416 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:478d0c4a:::benchmark_data_smithi188_119427_object101746:head# 2024-04-01T19:42:45.416 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:478d45a1:::benchmark_data_smithi188_119427_object162917:head# 2024-04-01T19:42:45.417 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:478d6f65:::benchmark_data_smithi188_119427_object110543:head# 2024-04-01T19:42:45.417 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:478d9ef5:::benchmark_data_smithi188_119427_object113047:head# 2024-04-01T19:42:45.417 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:478e5912:::benchmark_data_smithi188_119427_object123821:head# 2024-04-01T19:42:45.418 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:478ff185:::benchmark_data_smithi188_119427_object103129:head# 2024-04-01T19:42:45.418 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4791691b:::benchmark_data_smithi188_119427_object141214:head# 2024-04-01T19:42:45.419 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4792a10e:::benchmark_data_smithi188_119427_object80476:head# 2024-04-01T19:42:45.419 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47930e06:::benchmark_data_smithi188_119427_object115076:head# 2024-04-01T19:42:45.419 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4793f6b3:::benchmark_data_smithi188_119427_object134877:head# 2024-04-01T19:42:45.420 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47942576:::benchmark_data_smithi188_119427_object124387:head# 2024-04-01T19:42:45.420 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4795f0e2:::benchmark_data_smithi188_119427_object73570:head# 2024-04-01T19:42:45.421 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4796040e:::benchmark_data_smithi188_119427_object127767:head# 2024-04-01T19:42:45.422 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:479656aa:::benchmark_data_smithi188_119427_object91983:head# 2024-04-01T19:42:45.422 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4796ca84:::benchmark_data_smithi188_119427_object79613:head# 2024-04-01T19:42:45.422 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4797caca:::benchmark_data_smithi188_119427_object151238:head# 2024-04-01T19:42:45.423 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4797ec5e:::benchmark_data_smithi188_119427_object129295:head# 2024-04-01T19:42:45.424 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47983a22:::benchmark_data_smithi188_119427_object109257:head# 2024-04-01T19:42:45.424 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4799e21a:::benchmark_data_smithi188_119427_object120017:head# 2024-04-01T19:42:45.425 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:479a9933:::benchmark_data_smithi188_119427_object99367:head# 2024-04-01T19:42:45.425 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:42:45.426 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:479ba1f8:::benchmark_data_smithi188_119427_object140482:head# 2024-04-01T19:42:45.426 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:479bf55b:::benchmark_data_smithi188_119427_object86859:head# 2024-04-01T19:42:45.426 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:479bfd97:::benchmark_data_smithi188_119427_object95158:head# 2024-04-01T19:42:45.426 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:479d475b:::benchmark_data_smithi188_119427_object92528:head# 2024-04-01T19:42:45.427 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:479da22f:::benchmark_data_smithi188_119427_object124925:head# 2024-04-01T19:42:45.427 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:479e5735:::benchmark_data_smithi188_119427_object102848:head# 2024-04-01T19:42:45.428 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:479e5a6e:::benchmark_data_smithi188_119427_object96416:head# 2024-04-01T19:42:45.428 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:479f1334:::benchmark_data_smithi188_119427_object92526:head# 2024-04-01T19:42:45.429 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47a05a18:::benchmark_data_smithi188_119427_object84007:head# 2024-04-01T19:42:45.429 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:45.430 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:42:45.431 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47a09670:::benchmark_data_smithi188_119427_object98393:head# 2024-04-01T19:42:45.431 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47a0f8da:::benchmark_data_smithi188_119427_object96106:head# 2024-04-01T19:42:45.431 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47a15339:::benchmark_data_smithi188_119427_object74800:head# 2024-04-01T19:42:45.431 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47a2f1cb:::benchmark_data_smithi188_119427_object94042:head# 2024-04-01T19:42:45.431 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47a3b097:::benchmark_data_smithi188_119427_object95754:head# 2024-04-01T19:42:45.432 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47a61156:::benchmark_data_smithi188_119427_object114296:head# 2024-04-01T19:42:45.432 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47a62e7b:::benchmark_data_smithi188_119427_object115589:head# 2024-04-01T19:42:45.432 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47a6d132:::benchmark_data_smithi188_119427_object135000:head# 2024-04-01T19:42:45.433 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47a9b50b:::benchmark_data_smithi188_119427_object135497:head# 2024-04-01T19:42:45.433 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47a9cd06:::benchmark_data_smithi188_119427_object154312:head# 2024-04-01T19:42:45.434 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47aa5a24:::benchmark_data_smithi188_119427_object136395:head# 2024-04-01T19:42:45.434 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47aafdae:::benchmark_data_smithi188_119427_object134692:head# 2024-04-01T19:42:45.434 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47ac32b7:::benchmark_data_smithi188_119427_object85047:head# 2024-04-01T19:42:45.435 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47ac55fc:::benchmark_data_smithi188_119427_object160392:head# 2024-04-01T19:42:45.435 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47af449e:::benchmark_data_smithi188_119427_object150160:head# 2024-04-01T19:42:45.436 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47af9afb:::benchmark_data_smithi188_119427_object98921:head# 2024-04-01T19:42:45.436 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47afd866:::benchmark_data_smithi188_119427_object129746:head# 2024-04-01T19:42:45.437 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47b0e92f:::benchmark_data_smithi188_119427_object153758:head# 2024-04-01T19:42:45.437 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47b106de:::benchmark_data_smithi188_119427_object105365:head# 2024-04-01T19:42:45.438 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47b28d9b:::benchmark_data_smithi188_119427_object162213:head# 2024-04-01T19:42:45.438 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47b56b44:::benchmark_data_smithi188_119427_object135651:head# 2024-04-01T19:42:45.439 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47b6435f:::benchmark_data_smithi188_119427_object95476:head# 2024-04-01T19:42:45.439 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47b6fe18:::benchmark_data_smithi188_119427_object163769:head# 2024-04-01T19:42:45.440 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47b7a451:::benchmark_data_smithi188_119427_object105556:head# 2024-04-01T19:42:45.440 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47b9f08e:::benchmark_data_smithi188_119427_object100523:head# 2024-04-01T19:42:45.440 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47bac0e3:::benchmark_data_smithi188_119427_object92149:head# 2024-04-01T19:42:45.441 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47bae31c:::benchmark_data_smithi188_119427_object127212:head# 2024-04-01T19:42:45.441 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47bc9e09:::benchmark_data_smithi188_119427_object138668:head# 2024-04-01T19:42:45.443 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47bd4f7f:::benchmark_data_smithi188_119427_object147845:head# 2024-04-01T19:42:45.443 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47bd53a1:::benchmark_data_smithi188_119427_object98290:head# 2024-04-01T19:42:45.443 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47bd5832:::benchmark_data_smithi188_119427_object154962:head# 2024-04-01T19:42:45.444 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47bd59ae:::benchmark_data_smithi188_119427_object136380:head# 2024-04-01T19:42:45.444 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47be68c3:::benchmark_data_smithi188_119427_object100154:head# 2024-04-01T19:42:45.444 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47bee74b:::benchmark_data_smithi188_119427_object117945:head# 2024-04-01T19:42:45.445 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47bfd012:::benchmark_data_smithi188_119427_object78088:head# 2024-04-01T19:42:45.445 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47c08de9:::benchmark_data_smithi188_119427_object121347:head# 2024-04-01T19:42:45.445 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47c23a09:::benchmark_data_smithi188_119427_object85211:head# 2024-04-01T19:42:45.445 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47c2e477:::benchmark_data_smithi188_119427_object160605:head# 2024-04-01T19:42:45.446 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47c4d8bd:::benchmark_data_smithi188_119427_object152507:head# 2024-04-01T19:42:45.446 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47c511ef:::benchmark_data_smithi188_119427_object82835:head# 2024-04-01T19:42:45.447 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47c58946:::benchmark_data_smithi188_119427_object94918:head# 2024-04-01T19:42:45.447 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47c59d7d:::benchmark_data_smithi188_119427_object84799:head# 2024-04-01T19:42:45.447 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47c637e0:::benchmark_data_smithi188_119427_object105649:head# 2024-04-01T19:42:45.448 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47c6623c:::benchmark_data_smithi188_119427_object131549:head# 2024-04-01T19:42:45.448 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47c6792e:::benchmark_data_smithi188_119427_object130070:head# 2024-04-01T19:42:45.449 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47c6b348:::benchmark_data_smithi188_119427_object96126:head# 2024-04-01T19:42:45.450 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47c81e48:::benchmark_data_smithi188_119427_object115710:head# 2024-04-01T19:42:45.450 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47c83ddd:::benchmark_data_smithi188_119427_object161578:head# 2024-04-01T19:42:45.451 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47c85bc2:::benchmark_data_smithi188_119427_object146241:head# 2024-04-01T19:42:45.451 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47c86964:::benchmark_data_smithi188_119427_object76992:head# 2024-04-01T19:42:45.451 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47c8c74d:::benchmark_data_smithi188_119427_object92481:head# 2024-04-01T19:42:45.452 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47ca340c:::benchmark_data_smithi188_119427_object139552:head# 2024-04-01T19:42:45.452 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47ca815a:::benchmark_data_smithi188_119427_object73175:head# 2024-04-01T19:42:45.453 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47cadf3b:::benchmark_data_smithi188_119427_object131264:head# 2024-04-01T19:42:45.453 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47cb1a5e:::benchmark_data_smithi188_119427_object132231:head# 2024-04-01T19:42:45.453 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47cb6586:::benchmark_data_smithi188_119427_object96889:head# 2024-04-01T19:42:45.454 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47cc7e8a:::benchmark_data_smithi188_119427_object91492:head# 2024-04-01T19:42:45.454 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47cc88a1:::benchmark_data_smithi188_119427_object131832:head# 2024-04-01T19:42:45.455 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47cd5e8d:::benchmark_data_smithi188_119427_object117484:head# 2024-04-01T19:42:45.455 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47cee8a3:::benchmark_data_smithi188_119427_object151285:head# 2024-04-01T19:42:45.456 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47ceee34:::benchmark_data_smithi188_119427_object119780:head# 2024-04-01T19:42:45.457 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47d014f7:::benchmark_data_smithi188_119427_object117187:head# 2024-04-01T19:42:45.457 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47d15dd7:::benchmark_data_smithi188_119427_object129821:head# 2024-04-01T19:42:45.457 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47d19cf9:::benchmark_data_smithi188_119427_object124635:head# 2024-04-01T19:42:45.457 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47d1b384:::benchmark_data_smithi188_119427_object78188:head# 2024-04-01T19:42:45.458 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47d1bd40:::benchmark_data_smithi188_119427_object122880:head# 2024-04-01T19:42:45.459 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47d1e9ee:::benchmark_data_smithi188_119427_object100456:head# 2024-04-01T19:42:45.459 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47d2c9a8:::benchmark_data_smithi188_119427_object95463:head# 2024-04-01T19:42:45.459 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47d34ddd:::benchmark_data_smithi188_119427_object93428:head# 2024-04-01T19:42:45.460 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47d37267:::benchmark_data_smithi188_119427_object137562:head# 2024-04-01T19:42:45.460 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47d6744d:::benchmark_data_smithi188_119427_object78961:head# 2024-04-01T19:42:45.460 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47d760b1:::benchmark_data_smithi188_119427_object120243:head# 2024-04-01T19:42:45.461 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47d7700d:::benchmark_data_smithi188_119427_object122686:head# 2024-04-01T19:42:45.461 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47d8f231:::benchmark_data_smithi188_119427_object94998:head# 2024-04-01T19:42:45.462 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47d98671:::benchmark_data_smithi188_119427_object106441:head# 2024-04-01T19:42:45.462 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47db3978:::benchmark_data_smithi188_119427_object141237:head# 2024-04-01T19:42:45.462 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47db4f15:::benchmark_data_smithi188_119427_object96721:head# 2024-04-01T19:42:45.463 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47db64fd:::benchmark_data_smithi188_119427_object145313:head# 2024-04-01T19:42:45.463 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47db8202:::benchmark_data_smithi188_119427_object111975:head# 2024-04-01T19:42:45.464 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47dc507c:::benchmark_data_smithi188_119427_object152473:head# 2024-04-01T19:42:45.465 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47dd5142:::benchmark_data_smithi188_119427_object96591:head# 2024-04-01T19:42:45.465 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47dee38b:::benchmark_data_smithi188_119427_object124801:head# 2024-04-01T19:42:45.465 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47df417b:::benchmark_data_smithi188_119427_object161702:head# 2024-04-01T19:42:45.466 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47e03fcf:::benchmark_data_smithi188_119427_object90874:head# 2024-04-01T19:42:45.467 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47e0f406:::benchmark_data_smithi188_119427_object82591:head# 2024-04-01T19:42:45.467 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47e1113d:::benchmark_data_smithi188_119427_object137427:head# 2024-04-01T19:42:45.467 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47e4d816:::benchmark_data_smithi188_119427_object120995:head# 2024-04-01T19:42:45.468 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47e4d89a:::benchmark_data_smithi188_119427_object77390:head# 2024-04-01T19:42:45.468 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47e5a396:::benchmark_data_smithi188_119427_object147969:head# 2024-04-01T19:42:45.469 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47e6fbe4:::benchmark_data_smithi188_119427_object88111:head# 2024-04-01T19:42:45.469 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47e77fcb:::benchmark_data_smithi188_119427_object95135:head# 2024-04-01T19:42:45.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47e943cc:::benchmark_data_smithi188_119427_object82668:head# 2024-04-01T19:42:45.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47e969be:::benchmark_data_smithi188_119427_object131352:head# 2024-04-01T19:42:45.471 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47ec6a9e:::benchmark_data_smithi188_119427_object135003:head# 2024-04-01T19:42:45.471 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47eca39f:::benchmark_data_smithi188_119427_object90303:head# 2024-04-01T19:42:45.472 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47ecdee8:::benchmark_data_smithi188_119427_object76646:head# 2024-04-01T19:42:45.472 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47ee60f3:::benchmark_data_smithi188_119427_object120668:head# 2024-04-01T19:42:45.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47ee6c98:::benchmark_data_smithi188_119427_object149373:head# 2024-04-01T19:42:45.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47eeac82:::benchmark_data_smithi188_119427_object88789:head# 2024-04-01T19:42:45.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47eeed81:::benchmark_data_smithi188_119427_object84006:head# 2024-04-01T19:42:45.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47efbf88:::benchmark_data_smithi188_119427_object128459:head# 2024-04-01T19:42:45.475 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47f0de3c:::benchmark_data_smithi188_119427_object77417:head# 2024-04-01T19:42:45.475 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47f29584:::benchmark_data_smithi188_119427_object118190:head# 2024-04-01T19:42:45.476 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47f2cc7d:::benchmark_data_smithi188_119427_object105562:head# 2024-04-01T19:42:45.476 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47f34abd:::benchmark_data_smithi188_119427_object160782:head# 2024-04-01T19:42:45.477 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47f46734:::benchmark_data_smithi188_119427_object163492:head# 2024-04-01T19:42:45.477 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47f4c7e5:::benchmark_data_smithi188_119427_object133682:head# 2024-04-01T19:42:45.478 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47f586ef:::benchmark_data_smithi188_119427_object82909:head# 2024-04-01T19:42:45.478 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47f65743:::benchmark_data_smithi188_119427_object94784:head# 2024-04-01T19:42:45.479 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47f6bf16:::benchmark_data_smithi188_119427_object90135:head# 2024-04-01T19:42:45.479 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47f78f55:::benchmark_data_smithi188_119427_object90632:head# 2024-04-01T19:42:45.480 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47f8fdd5:::benchmark_data_smithi188_119427_object141361:head# 2024-04-01T19:42:45.480 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47f9e797:::benchmark_data_smithi188_119427_object119135:head# 2024-04-01T19:42:45.480 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47faaabc:::benchmark_data_smithi188_119427_object81442:head# 2024-04-01T19:42:45.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47fb7601:::benchmark_data_smithi188_119427_object154092:head# 2024-04-01T19:42:45.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47fc4638:::benchmark_data_smithi188_119427_object85394:head# 2024-04-01T19:42:45.482 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47fd33ec:::benchmark_data_smithi188_119427_object122953:head# 2024-04-01T19:42:45.482 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47fdbd2e:::benchmark_data_smithi188_119427_object160672:head# 2024-04-01T19:42:45.483 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47fe4c1f:::benchmark_data_smithi188_119427_object90980:head# 2024-04-01T19:42:45.483 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47ff3f33:::benchmark_data_smithi188_119427_object144195:head# 2024-04-01T19:42:45.483 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:47ffce18:::benchmark_data_smithi188_119427_object92833:head# 2024-04-01T19:42:45.484 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48006816:::benchmark_data_smithi188_119427_object103295:head# 2024-04-01T19:42:45.485 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4800cc8d:::benchmark_data_smithi188_119427_object136810:head# 2024-04-01T19:42:45.485 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4801bf61:::benchmark_data_smithi188_119427_object150632:head# 2024-04-01T19:42:45.486 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4803615a:::benchmark_data_smithi188_119427_object74830:head# 2024-04-01T19:42:45.486 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48051fc8:::benchmark_data_smithi188_119427_object163017:head# 2024-04-01T19:42:45.486 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48070be0:::benchmark_data_smithi188_119427_object106720:head# 2024-04-01T19:42:45.487 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4807b130:::benchmark_data_smithi188_119427_object105781:head# 2024-04-01T19:42:45.487 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4807c9c3:::benchmark_data_smithi188_119427_object118677:head# 2024-04-01T19:42:45.488 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48097606:::benchmark_data_smithi188_119427_object158696:head# 2024-04-01T19:42:45.488 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:480a92d6:::benchmark_data_smithi188_119427_object118446:head# 2024-04-01T19:42:45.489 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:480aaf52:::benchmark_data_smithi188_119427_object86849:head# 2024-04-01T19:42:45.489 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:480ae6a1:::benchmark_data_smithi188_119427_object78579:head# 2024-04-01T19:42:45.489 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:480b1073:::benchmark_data_smithi188_119427_object106928:head# 2024-04-01T19:42:45.490 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:480bb568:::benchmark_data_smithi188_119427_object154401:head# 2024-04-01T19:42:45.490 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:480bedb7:::benchmark_data_smithi188_119427_object91405:head# 2024-04-01T19:42:45.491 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:480c2bc3:::benchmark_data_smithi188_119427_object75046:head# 2024-04-01T19:42:45.491 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:480da7da:::benchmark_data_smithi188_119427_object128404:head# 2024-04-01T19:42:45.492 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:480f192c:::benchmark_data_smithi188_119427_object92026:head# 2024-04-01T19:42:45.492 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:480f3455:::benchmark_data_smithi188_119427_object105816:head# 2024-04-01T19:42:45.492 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:480fe0bc:::benchmark_data_smithi188_119427_object152803:head# 2024-04-01T19:42:45.493 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:481153bf:::benchmark_data_smithi188_119427_object108668:head# 2024-04-01T19:42:45.494 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48124828:::benchmark_data_smithi188_119427_object149530:head# 2024-04-01T19:42:45.494 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4813e10a:::benchmark_data_smithi188_119427_object123619:head# 2024-04-01T19:42:45.495 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:42:45.495 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48149220:::benchmark_data_smithi188_119427_object111347:head# 2024-04-01T19:42:45.495 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48156ed6:::benchmark_data_smithi188_119427_object134488:head# 2024-04-01T19:42:45.496 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4815b12e:::benchmark_data_smithi188_119427_object74813:head# 2024-04-01T19:42:45.496 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48172fce:::benchmark_data_smithi188_119427_object96894:head# 2024-04-01T19:42:45.497 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4817d5cd:::benchmark_data_smithi188_119427_object89172:head# 2024-04-01T19:42:45.497 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4819a4f0:::benchmark_data_smithi188_119427_object113331:head# 2024-04-01T19:42:45.498 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4819b235:::benchmark_data_smithi188_119427_object122389:head# 2024-04-01T19:42:45.498 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:481b9e76:::benchmark_data_smithi188_119427_object82863:head# 2024-04-01T19:42:45.498 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:481c8990:::benchmark_data_smithi188_119427_object135947:head# 2024-04-01T19:42:45.499 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:481cb308:::benchmark_data_smithi188_119427_object149189:head# 2024-04-01T19:42:45.499 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:481d5a1b:::benchmark_data_smithi188_119427_object114262:head# 2024-04-01T19:42:45.500 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:481e8bcf:::benchmark_data_smithi188_119427_object101865:head# 2024-04-01T19:42:45.501 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:481ecbe1:::benchmark_data_smithi188_119427_object115262:head# 2024-04-01T19:42:45.501 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:481f1dda:::benchmark_data_smithi188_119427_object127438:head# 2024-04-01T19:42:45.501 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:481feb6b:::benchmark_data_smithi188_119427_object99859:head# 2024-04-01T19:42:45.502 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:482086bd:::benchmark_data_smithi188_119427_object116769:head# 2024-04-01T19:42:45.502 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4821aba2:::benchmark_data_smithi188_119427_object114646:head# 2024-04-01T19:42:45.503 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48225f13:::benchmark_data_smithi188_119427_object124830:head# 2024-04-01T19:42:45.503 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4822a3a6:::benchmark_data_smithi188_119427_object156302:head# 2024-04-01T19:42:45.504 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4822cf7d:::benchmark_data_smithi188_119427_object138671:head# 2024-04-01T19:42:45.504 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4824a372:::benchmark_data_smithi188_119427_object82932:head# 2024-04-01T19:42:45.504 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:482557f5:::benchmark_data_smithi188_119427_object106369:head# 2024-04-01T19:42:45.505 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:482579e5:::benchmark_data_smithi188_119427_object84966:head# 2024-04-01T19:42:45.505 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4825de1e:::benchmark_data_smithi188_119427_object130825:head# 2024-04-01T19:42:45.506 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48263581:::benchmark_data_smithi188_119427_object152277:head# 2024-04-01T19:42:45.506 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48266112:::benchmark_data_smithi188_119427_object163151:head# 2024-04-01T19:42:45.507 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:482679ac:::benchmark_data_smithi188_119427_object162052:head# 2024-04-01T19:42:45.507 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4827f176:::benchmark_data_smithi188_119427_object86124:head# 2024-04-01T19:42:45.507 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4827f89a:::benchmark_data_smithi188_119427_object146772:head# 2024-04-01T19:42:45.508 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48290587:::benchmark_data_smithi188_119427_object121279:head# 2024-04-01T19:42:45.508 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48290737:::benchmark_data_smithi188_119427_object137402:head# 2024-04-01T19:42:45.509 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48294d92:::benchmark_data_smithi188_119427_object130476:head# 2024-04-01T19:42:45.509 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4829a9f7:::benchmark_data_smithi188_119427_object92429:head# 2024-04-01T19:42:45.510 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:482ae48b:::benchmark_data_smithi188_119427_object151933:head# 2024-04-01T19:42:45.510 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:482b98ae:::benchmark_data_smithi188_119427_object137011:head# 2024-04-01T19:42:45.511 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:482bf36e:::benchmark_data_smithi188_119427_object146582:head# 2024-04-01T19:42:45.511 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:482c76c0:::benchmark_data_smithi188_119427_object80990:head# 2024-04-01T19:42:45.512 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:482d792b:::benchmark_data_smithi188_119427_object108084:head# 2024-04-01T19:42:45.512 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:482ddadb:::benchmark_data_smithi188_119427_object104107:head# 2024-04-01T19:42:45.512 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:482efaac:::benchmark_data_smithi188_119427_object131760:head# 2024-04-01T19:42:45.513 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:482f2732:::benchmark_data_smithi188_119427_object139470:head# 2024-04-01T19:42:45.513 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48305665:::benchmark_data_smithi188_119427_object74143:head# 2024-04-01T19:42:45.514 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4830f1db:::benchmark_data_smithi188_119427_object105721:head# 2024-04-01T19:42:45.514 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48323d84:::benchmark_data_smithi188_119427_object126093:head# 2024-04-01T19:42:45.514 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48324518:::benchmark_data_smithi188_119427_object139117:head# 2024-04-01T19:42:45.515 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4833199f:::benchmark_data_smithi188_119427_object78185:head# 2024-04-01T19:42:45.515 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4833c531:::benchmark_data_smithi188_119427_object156181:head# 2024-04-01T19:42:45.516 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:483409aa:::benchmark_data_smithi188_119427_object106334:head# 2024-04-01T19:42:45.516 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4834abc0:::benchmark_data_smithi188_119427_object136481:head# 2024-04-01T19:42:45.517 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48353ddc:::benchmark_data_smithi188_119427_object159834:head# 2024-04-01T19:42:45.517 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4835977b:::benchmark_data_smithi188_119427_object98603:head# 2024-04-01T19:42:45.517 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:483681a9:::benchmark_data_smithi188_119427_object80451:head# 2024-04-01T19:42:45.518 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:483905d3:::benchmark_data_smithi188_119427_object158832:head# 2024-04-01T19:42:45.518 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48396a57:::benchmark_data_smithi188_119427_object102521:head# 2024-04-01T19:42:45.518 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:483b9da5:::benchmark_data_smithi188_119427_object145370:head# 2024-04-01T19:42:45.519 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:483c6fac:::benchmark_data_smithi188_119427_object145654:head# 2024-04-01T19:42:45.519 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:483cd522:::benchmark_data_smithi188_119427_object99474:head# 2024-04-01T19:42:45.520 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:483e756b:::benchmark_data_smithi188_119427_object127478:head# 2024-04-01T19:42:45.520 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:483fbd7e:::benchmark_data_smithi188_119427_object111524:head# 2024-04-01T19:42:45.521 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48402cc0:::benchmark_data_smithi188_119427_object106032:head# 2024-04-01T19:42:45.522 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4840cfc6:::benchmark_data_smithi188_119427_object137299:head# 2024-04-01T19:42:45.522 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48417426:::benchmark_data_smithi188_119427_object85163:head# 2024-04-01T19:42:45.522 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4841a1a8:::benchmark_data_smithi188_119427_object127415:head# 2024-04-01T19:42:45.523 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4841c4cc:::benchmark_data_smithi188_119427_object76951:head# 2024-04-01T19:42:45.523 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4842ba1a:::benchmark_data_smithi188_119427_object115246:head# 2024-04-01T19:42:45.523 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48440d3d:::benchmark_data_smithi188_119427_object143000:head# 2024-04-01T19:42:45.524 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4844ead0:::benchmark_data_smithi188_119427_object81488:head# 2024-04-01T19:42:45.524 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4845ef55:::benchmark_data_smithi188_119427_object101348:head# 2024-04-01T19:42:45.525 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4846ae04:::benchmark_data_smithi188_119427_object136406:head# 2024-04-01T19:42:45.525 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4846bbf8:::benchmark_data_smithi188_119427_object151379:head# 2024-04-01T19:42:45.525 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:484753af:::benchmark_data_smithi188_119427_object151454:head# 2024-04-01T19:42:45.526 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48475f15:::benchmark_data_smithi188_119427_object92484:head# 2024-04-01T19:42:45.526 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4847ca56:::benchmark_data_smithi188_119427_object98611:head# 2024-04-01T19:42:45.527 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4847d474:::benchmark_data_smithi188_119427_object134746:head# 2024-04-01T19:42:45.527 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48486615:::benchmark_data_smithi188_119427_object103691:head# 2024-04-01T19:42:45.528 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48497a88:::benchmark_data_smithi188_119427_object89888:head# 2024-04-01T19:42:45.528 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48498a3b:::benchmark_data_smithi188_119427_object100377:head# 2024-04-01T19:42:45.528 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4849c7eb:::benchmark_data_smithi188_119427_object81505:head# 2024-04-01T19:42:45.529 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:484a83f8:::benchmark_data_smithi188_119427_object156173:head# 2024-04-01T19:42:45.529 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:484aa841:::benchmark_data_smithi188_119427_object72793:head# 2024-04-01T19:42:45.530 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:484aabaa:::benchmark_data_smithi188_119427_object138921:head# 2024-04-01T19:42:45.530 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:484acb1d:::benchmark_data_smithi188_119427_object86304:head# 2024-04-01T19:42:45.530 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:42:45.531 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:484b0cf1:::benchmark_data_smithi188_119427_object152044:head# 2024-04-01T19:42:45.532 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:484b4037:::benchmark_data_smithi188_119427_object132224:head# 2024-04-01T19:42:45.532 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:484ca95c:::benchmark_data_smithi188_119427_object141410:head# 2024-04-01T19:42:45.532 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:484f3569:::benchmark_data_smithi188_119427_object101448:head# 2024-04-01T19:42:45.533 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:484f80fa:::benchmark_data_smithi188_119427_object112140:head# 2024-04-01T19:42:45.533 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:484fa083:::benchmark_data_smithi188_119427_object109117:head# 2024-04-01T19:42:45.534 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4850837d:::benchmark_data_smithi188_119427_object119016:head# 2024-04-01T19:42:45.534 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4850f96a:::benchmark_data_smithi188_119427_object127710:head# 2024-04-01T19:42:45.534 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48514aab:::benchmark_data_smithi188_119427_object155153:head# 2024-04-01T19:42:45.536 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:485150ac:::benchmark_data_smithi188_119427_object159260:head# 2024-04-01T19:42:45.536 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48527f27:::benchmark_data_smithi188_119427_object75017:head# 2024-04-01T19:42:45.537 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48536b8f:::benchmark_data_smithi188_119427_object91033:head# 2024-04-01T19:42:45.537 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48541350:::benchmark_data_smithi188_119427_object81136:head# 2024-04-01T19:42:45.537 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48555d96:::benchmark_data_smithi188_119427_object162216:head# 2024-04-01T19:42:45.538 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:485589af:::benchmark_data_smithi188_119427_object160858:head# 2024-04-01T19:42:45.538 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4855d4f1:::benchmark_data_smithi188_119427_object162805:head# 2024-04-01T19:42:45.539 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:485755ee:::benchmark_data_smithi188_119427_object124596:head# 2024-04-01T19:42:45.539 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48580518:::benchmark_data_smithi188_119427_object115047:head# 2024-04-01T19:42:45.540 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4858698f:::benchmark_data_smithi188_119427_object107723:head# 2024-04-01T19:42:45.540 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48595ad4:::benchmark_data_smithi188_119427_object92690:head# 2024-04-01T19:42:45.541 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48596b08:::benchmark_data_smithi188_119427_object120120:head# 2024-04-01T19:42:45.541 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48598f75:::benchmark_data_smithi188_119427_object125998:head# 2024-04-01T19:42:45.541 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:485991bf:::benchmark_data_smithi188_119427_object110940:head# 2024-04-01T19:42:45.542 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4859ff7d:::benchmark_data_smithi188_119427_object94370:head# 2024-04-01T19:42:45.542 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:485a12e6:::benchmark_data_smithi188_119427_object127075:head# 2024-04-01T19:42:45.543 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:485a15ae:::benchmark_data_smithi188_119427_object77243:head# 2024-04-01T19:42:45.543 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:485af0c2:::benchmark_data_smithi188_119427_object144223:head# 2024-04-01T19:42:45.543 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:485b1049:::benchmark_data_smithi188_119427_object126155:head# 2024-04-01T19:42:45.544 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:485d7b31:::benchmark_data_smithi188_119427_object124411:head# 2024-04-01T19:42:45.544 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:485da11c:::benchmark_data_smithi188_119427_object83207:head# 2024-04-01T19:42:45.544 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:485dcda3:::benchmark_data_smithi188_119427_object121467:head# 2024-04-01T19:42:45.545 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48603cec:::benchmark_data_smithi188_119427_object101157:head# 2024-04-01T19:42:45.545 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:486148c3:::benchmark_data_smithi188_119427_object134542:head# 2024-04-01T19:42:45.546 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4862ae98:::benchmark_data_smithi188_119427_object78213:head# 2024-04-01T19:42:45.546 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4863132b:::benchmark_data_smithi188_119427_object157815:head# 2024-04-01T19:42:45.547 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48656084:::benchmark_data_smithi188_119427_object110809:head# 2024-04-01T19:42:45.547 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48658f1a:::benchmark_data_smithi188_119427_object148207:head# 2024-04-01T19:42:45.548 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4866e24c:::benchmark_data_smithi188_119427_object103425:head# 2024-04-01T19:42:45.548 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48688dbb:::benchmark_data_smithi188_119427_object89596:head# 2024-04-01T19:42:45.548 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48690e13:::benchmark_data_smithi188_119427_object135936:head# 2024-04-01T19:42:45.549 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:486976d7:::benchmark_data_smithi188_119427_object146838:head# 2024-04-01T19:42:45.549 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48697e9a:::benchmark_data_smithi188_119427_object94533:head# 2024-04-01T19:42:45.550 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4869df24:::benchmark_data_smithi188_119427_object105834:head# 2024-04-01T19:42:45.550 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:486ade74:::benchmark_data_smithi188_119427_object90883:head# 2024-04-01T19:42:45.551 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:486b12fd:::benchmark_data_smithi188_119427_object153135:head# 2024-04-01T19:42:45.551 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:486b249f:::benchmark_data_smithi188_119427_object152770:head# 2024-04-01T19:42:45.552 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:486da861:::benchmark_data_smithi188_119427_object77690:head# 2024-04-01T19:42:45.552 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:486dac6e:::benchmark_data_smithi188_119427_object151616:head# 2024-04-01T19:42:45.552 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:486f40e0:::benchmark_data_smithi188_119427_object98923:head# 2024-04-01T19:42:45.553 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:486ff692:::benchmark_data_smithi188_119427_object119277:head# 2024-04-01T19:42:45.554 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4870c1f0:::benchmark_data_smithi188_119427_object145223:head# 2024-04-01T19:42:45.554 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4870fee9:::benchmark_data_smithi188_119427_object120575:head# 2024-04-01T19:42:45.554 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4871d15b:::benchmark_data_smithi188_119427_object108508:head# 2024-04-01T19:42:45.555 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4871eb49:::benchmark_data_smithi188_119427_object109248:head# 2024-04-01T19:42:45.555 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:487283d6:::benchmark_data_smithi188_119427_object104469:head# 2024-04-01T19:42:45.555 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4872cef9:::benchmark_data_smithi188_119427_object112267:head# 2024-04-01T19:42:45.556 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:487355c4:::benchmark_data_smithi188_119427_object152399:head# 2024-04-01T19:42:45.556 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:45.557 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48741eea:::benchmark_data_smithi188_119427_object109689:head# 2024-04-01T19:42:45.557 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4874ad8d:::benchmark_data_smithi188_119427_object82664:head# 2024-04-01T19:42:45.557 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48758f68:::benchmark_data_smithi188_119427_object158162:head# 2024-04-01T19:42:45.558 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4875a16b:::benchmark_data_smithi188_119427_object127136:head# 2024-04-01T19:42:45.558 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:487731f7:::benchmark_data_smithi188_119427_object97657:head# 2024-04-01T19:42:45.558 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4877d0da:::benchmark_data_smithi188_119427_object147974:head# 2024-04-01T19:42:45.559 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4877e5ea:::benchmark_data_smithi188_119427_object81965:head# 2024-04-01T19:42:45.559 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48780d80:::benchmark_data_smithi188_119427_object124961:head# 2024-04-01T19:42:45.559 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4878fbaa:::benchmark_data_smithi188_119427_object143315:head# 2024-04-01T19:42:45.560 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48794315:::benchmark_data_smithi188_119427_object121270:head# 2024-04-01T19:42:45.560 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:487a6ccf:::benchmark_data_smithi188_119427_object157902:head# 2024-04-01T19:42:45.561 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:487aa8d7:::benchmark_data_smithi188_119427_object81168:head# 2024-04-01T19:42:45.561 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:487cb7e3:::benchmark_data_smithi188_119427_object113237:head# 2024-04-01T19:42:45.561 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:487e5368:::benchmark_data_smithi188_119427_object88221:head# 2024-04-01T19:42:45.562 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:487e9220:::benchmark_data_smithi188_119427_object112887:head# 2024-04-01T19:42:45.562 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:487ea136:::benchmark_data_smithi188_119427_object83726:head# 2024-04-01T19:42:45.563 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:487f2296:::benchmark_data_smithi188_119427_object102882:head# 2024-04-01T19:42:45.563 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:487f89db:::benchmark_data_smithi188_119427_object114635:head# 2024-04-01T19:42:45.564 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48801675:::benchmark_data_smithi188_119427_object95789:head# 2024-04-01T19:42:45.564 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48803965:::benchmark_data_smithi188_119427_object123385:head# 2024-04-01T19:42:45.564 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4880b937:::benchmark_data_smithi188_119427_object119948:head# 2024-04-01T19:42:45.565 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:488243ba:::benchmark_data_smithi188_119427_object127046:head# 2024-04-01T19:42:45.565 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4882bf5e:::benchmark_data_smithi188_119427_object151780:head# 2024-04-01T19:42:45.566 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48838f8d:::benchmark_data_smithi188_119427_object78836:head# 2024-04-01T19:42:45.566 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4883acba:::benchmark_data_smithi188_119427_object153853:head# 2024-04-01T19:42:45.567 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48860623:::benchmark_data_smithi188_119427_object86926:head# 2024-04-01T19:42:45.567 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48865ca1:::benchmark_data_smithi188_119427_object83298:head# 2024-04-01T19:42:45.567 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4886c9be:::benchmark_data_smithi188_119427_object77013:head# 2024-04-01T19:42:45.568 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48876e77:::benchmark_data_smithi188_119427_object85374:head# 2024-04-01T19:42:45.568 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4888517a:::benchmark_data_smithi188_119427_object92229:head# 2024-04-01T19:42:45.569 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48886ed2:::benchmark_data_smithi188_119427_object84784:head# 2024-04-01T19:42:45.569 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:488981dc:::benchmark_data_smithi188_119427_object110184:head# 2024-04-01T19:42:45.570 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:488a69df:::benchmark_data_smithi188_119427_object123428:head# 2024-04-01T19:42:45.570 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:488bd8d9:::benchmark_data_smithi188_119427_object119824:head# 2024-04-01T19:42:45.570 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:488cce3c:::benchmark_data_smithi188_119427_object122436:head# 2024-04-01T19:42:45.571 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:488db3ea:::benchmark_data_smithi188_119427_object105594:head# 2024-04-01T19:42:45.571 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:488e818c:::benchmark_data_smithi188_119427_object99175:head# 2024-04-01T19:42:45.572 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48903a65:::benchmark_data_smithi188_119427_object119044:head# 2024-04-01T19:42:45.572 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4890cffb:::benchmark_data_smithi188_119427_object123155:head# 2024-04-01T19:42:45.572 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:489221c8:::benchmark_data_smithi188_119427_object116970:head# 2024-04-01T19:42:45.573 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4892584b:::benchmark_data_smithi188_119427_object141592:head# 2024-04-01T19:42:45.573 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4892dff7:::benchmark_data_smithi188_119427_object132994:head# 2024-04-01T19:42:45.574 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48936d16:::benchmark_data_smithi188_119427_object123368:head# 2024-04-01T19:42:45.574 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:42:45.574 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48938c4d:::benchmark_data_smithi188_119427_object164428:head# 2024-04-01T19:42:45.575 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4893d3b7:::benchmark_data_smithi188_119427_object85837:head# 2024-04-01T19:42:45.575 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4895904b:::benchmark_data_smithi188_119427_object96362:head# 2024-04-01T19:42:45.576 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4895b91d:::benchmark_data_smithi188_119427_object73879:head# 2024-04-01T19:42:45.576 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4895f8cc:::benchmark_data_smithi188_119427_object82315:head# 2024-04-01T19:42:45.577 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48963d71:::benchmark_data_smithi188_119427_object102355:head# 2024-04-01T19:42:45.577 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48964170:::benchmark_data_smithi188_119427_object131012:head# 2024-04-01T19:42:45.578 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4896eb2b:::benchmark_data_smithi188_119427_object155807:head# 2024-04-01T19:42:45.578 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:45.578 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:42:45.579 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48989bf5:::benchmark_data_smithi188_119427_object133969:head# 2024-04-01T19:42:45.579 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4898a768:::benchmark_data_smithi188_119427_object125227:head# 2024-04-01T19:42:45.579 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48999c69:::benchmark_data_smithi188_119427_object127000:head# 2024-04-01T19:42:45.579 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:489a152c:::benchmark_data_smithi188_119427_object94389:head# 2024-04-01T19:42:45.580 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:489a4e17:::benchmark_data_smithi188_119427_object92866:head# 2024-04-01T19:42:45.580 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:489afa91:::benchmark_data_smithi188_119427_object99524:head# 2024-04-01T19:42:45.580 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:489b04ac:::benchmark_data_smithi188_119427_object113246:head# 2024-04-01T19:42:45.581 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:489c8426:::benchmark_data_smithi188_119427_object151661:head# 2024-04-01T19:42:45.581 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:489d8824:::benchmark_data_smithi188_119427_object138703:head# 2024-04-01T19:42:45.581 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:489e54b4:::benchmark_data_smithi188_119427_object83486:head# 2024-04-01T19:42:45.582 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:489e8b4e:::benchmark_data_smithi188_119427_object72869:head# 2024-04-01T19:42:45.582 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:489fd435:::benchmark_data_smithi188_119427_object102851:head# 2024-04-01T19:42:45.583 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48a01301:::benchmark_data_smithi188_119427_object158259:head# 2024-04-01T19:42:45.583 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48a03fb5:::benchmark_data_smithi188_119427_object164138:head# 2024-04-01T19:42:45.584 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48a08455:::benchmark_data_smithi188_119427_object149688:head# 2024-04-01T19:42:45.584 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48a091c0:::benchmark_data_smithi188_119427_object133247:head# 2024-04-01T19:42:45.584 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48a0e80f:::benchmark_data_smithi188_119427_object128254:head# 2024-04-01T19:42:45.585 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48a134f5:::benchmark_data_smithi188_119427_object99510:head# 2024-04-01T19:42:45.586 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48a14873:::benchmark_data_smithi188_119427_object94687:head# 2024-04-01T19:42:45.586 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48a4bae4:::benchmark_data_smithi188_119427_object113664:head# 2024-04-01T19:42:45.586 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48a6292c:::benchmark_data_smithi188_119427_object137085:head# 2024-04-01T19:42:45.587 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48a76f09:::benchmark_data_smithi188_119427_object155799:head# 2024-04-01T19:42:45.587 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48a7c3a5:::benchmark_data_smithi188_119427_object107918:head# 2024-04-01T19:42:45.588 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48a7eaf9:::benchmark_data_smithi188_119427_object86003:head# 2024-04-01T19:42:45.588 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48a81c91:::benchmark_data_smithi188_119427_object129681:head# 2024-04-01T19:42:45.588 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48a8ffa5:::benchmark_data_smithi188_119427_object113215:head# 2024-04-01T19:42:45.589 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48aa200d:::benchmark_data_smithi188_119427_object142496:head# 2024-04-01T19:42:45.589 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48aa5006:::benchmark_data_smithi188_119427_object74123:head# 2024-04-01T19:42:45.590 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48aa7cf6:::benchmark_data_smithi188_119427_object76026:head# 2024-04-01T19:42:45.590 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48aaf1ca:::benchmark_data_smithi188_119427_object156256:head# 2024-04-01T19:42:45.590 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48ab08d6:::benchmark_data_smithi188_119427_object143978:head# 2024-04-01T19:42:45.591 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48ab8989:::benchmark_data_smithi188_119427_object157262:head# 2024-04-01T19:42:45.591 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48ad58a8:::benchmark_data_smithi188_119427_object78676:head# 2024-04-01T19:42:45.591 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48af28cf:::benchmark_data_smithi188_119427_object115631:head# 2024-04-01T19:42:45.592 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48b09261:::benchmark_data_smithi188_119427_object105578:head# 2024-04-01T19:42:45.592 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48b0d7f8:::benchmark_data_smithi188_119427_object127241:head# 2024-04-01T19:42:45.593 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48b11b02:::benchmark_data_smithi188_119427_object149047:head# 2024-04-01T19:42:45.593 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48b2c37a:::benchmark_data_smithi188_119427_object115767:head# 2024-04-01T19:42:45.594 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48b39534:::benchmark_data_smithi188_119427_object158880:head# 2024-04-01T19:42:45.594 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48b46959:::benchmark_data_smithi188_119427_object75367:head# 2024-04-01T19:42:45.594 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48b495c3:::benchmark_data_smithi188_119427_object147534:head# 2024-04-01T19:42:45.595 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48b4c993:::benchmark_data_smithi188_119427_object106403:head# 2024-04-01T19:42:45.595 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48b59c8c:::benchmark_data_smithi188_119427_object127310:head# 2024-04-01T19:42:45.596 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48b6e49f:::benchmark_data_smithi188_119427_object122409:head# 2024-04-01T19:42:45.596 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48b7bf06:::benchmark_data_smithi188_119427_object111684:head# 2024-04-01T19:42:45.596 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48b8f7af:::benchmark_data_smithi188_119427_object159475:head# 2024-04-01T19:42:45.597 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48b968d6:::benchmark_data_smithi188_119427_object110784:head# 2024-04-01T19:42:45.597 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48b9a0f3:::benchmark_data_smithi188_119427_object95524:head# 2024-04-01T19:42:45.598 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48bd27a8:::benchmark_data_smithi188_119427_object98145:head# 2024-04-01T19:42:45.598 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48bd5a86:::benchmark_data_smithi188_119427_object91473:head# 2024-04-01T19:42:45.599 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48be6da4:::benchmark_data_smithi188_119427_object151334:head# 2024-04-01T19:42:45.599 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48bfbe34:::benchmark_data_smithi188_119427_object119497:head# 2024-04-01T19:42:45.599 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48c1a3fd:::benchmark_data_smithi188_119427_object91243:head# 2024-04-01T19:42:45.600 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48c1e4f9:::benchmark_data_smithi188_119427_object148582:head# 2024-04-01T19:42:45.600 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48c202c9:::benchmark_data_smithi188_119427_object140782:head# 2024-04-01T19:42:45.601 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48c25a2e:::benchmark_data_smithi188_119427_object74573:head# 2024-04-01T19:42:45.601 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48c320a4:::benchmark_data_smithi188_119427_object157192:head# 2024-04-01T19:42:45.601 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48c3943a:::benchmark_data_smithi188_119427_object136980:head# 2024-04-01T19:42:45.602 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48c3fa8f:::benchmark_data_smithi188_119427_object89220:head# 2024-04-01T19:42:45.607 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48c45193:::benchmark_data_smithi188_119427_object75950:head# 2024-04-01T19:42:45.607 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48c4eacb:::benchmark_data_smithi188_119427_object78526:head# 2024-04-01T19:42:45.608 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48c55e66:::benchmark_data_smithi188_119427_object82328:head# 2024-04-01T19:42:45.608 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48c57e38:::benchmark_data_smithi188_119427_object134439:head# 2024-04-01T19:42:45.608 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48c607d2:::benchmark_data_smithi188_119427_object77589:head# 2024-04-01T19:42:45.608 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48c67e33:::benchmark_data_smithi188_119427_object144031:head# 2024-04-01T19:42:45.608 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48c6e240:::benchmark_data_smithi188_119427_object108135:head# 2024-04-01T19:42:45.608 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48c7e7de:::benchmark_data_smithi188_119427_object99845:head# 2024-04-01T19:42:45.608 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48c88e8a:::benchmark_data_smithi188_119427_object102789:head# 2024-04-01T19:42:45.608 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48c8e299:::benchmark_data_smithi188_119427_object85595:head# 2024-04-01T19:42:45.608 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48c965ac:::benchmark_data_smithi188_119427_object108913:head# 2024-04-01T19:42:45.608 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48c96e5f:::benchmark_data_smithi188_119427_object97271:head# 2024-04-01T19:42:45.609 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48ca9d47:::benchmark_data_smithi188_119427_object80058:head# 2024-04-01T19:42:45.609 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48cb5fe4:::benchmark_data_smithi188_119427_object102036:head# 2024-04-01T19:42:45.609 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48cc3cad:::benchmark_data_smithi188_119427_object158855:head# 2024-04-01T19:42:45.609 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48cca46e:::benchmark_data_smithi188_119427_object105517:head# 2024-04-01T19:42:45.610 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48cf881f:::benchmark_data_smithi188_119427_object100935:head# 2024-04-01T19:42:45.610 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48d0bb0a:::benchmark_data_smithi188_119427_object129597:head# 2024-04-01T19:42:45.610 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48d14ef6:::benchmark_data_smithi188_119427_object129778:head# 2024-04-01T19:42:45.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48d1cc93:::benchmark_data_smithi188_119427_object105601:head# 2024-04-01T19:42:45.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48d28106:::benchmark_data_smithi188_119427_object131980:head# 2024-04-01T19:42:45.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48d2e462:::benchmark_data_smithi188_119427_object157602:head# 2024-04-01T19:42:45.612 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48d42c80:::benchmark_data_smithi188_119427_object103308:head# 2024-04-01T19:42:45.612 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48d45e11:::benchmark_data_smithi188_119427_object95755:head# 2024-04-01T19:42:45.613 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48d4ec43:::benchmark_data_smithi188_119427_object146082:head# 2024-04-01T19:42:45.613 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48d51d0e:::benchmark_data_smithi188_119427_object104327:head# 2024-04-01T19:42:45.613 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48d59d52:::benchmark_data_smithi188_119427_object118725:head# 2024-04-01T19:42:45.614 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48d6d3a2:::benchmark_data_smithi188_119427_object92070:head# 2024-04-01T19:42:45.614 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48d7a2fc:::benchmark_data_smithi188_119427_object145776:head# 2024-04-01T19:42:45.614 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48d7c1ac:::benchmark_data_smithi188_119427_object103399:head# 2024-04-01T19:42:45.615 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48d83db3:::benchmark_data_smithi188_119427_object116553:head# 2024-04-01T19:42:45.615 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48d8a636:::benchmark_data_smithi188_119427_object150185:head# 2024-04-01T19:42:45.616 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48d9b6fe:::benchmark_data_smithi188_119427_object121789:head# 2024-04-01T19:42:45.616 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48da52ab:::benchmark_data_smithi188_119427_object128457:head# 2024-04-01T19:42:45.617 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48dabd31:::benchmark_data_smithi188_119427_object137450:head# 2024-04-01T19:42:45.617 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48db2eef:::benchmark_data_smithi188_119427_object151137:head# 2024-04-01T19:42:45.618 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48dcdb72:::benchmark_data_smithi188_119427_object101671:head# 2024-04-01T19:42:45.618 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48dd14aa:::benchmark_data_smithi188_119427_object92671:head# 2024-04-01T19:42:45.619 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48dd9138:::benchmark_data_smithi188_119427_object145205:head# 2024-04-01T19:42:45.619 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48de9db0:::benchmark_data_smithi188_119427_object116708:head# 2024-04-01T19:42:45.620 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48e17120:::benchmark_data_smithi188_119427_object102662:head# 2024-04-01T19:42:45.621 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48e18a43:::benchmark_data_smithi188_119427_object108234:head# 2024-04-01T19:42:45.621 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48e1bc62:::benchmark_data_smithi188_119427_object107819:head# 2024-04-01T19:42:45.621 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48e22d16:::benchmark_data_smithi188_119427_object151926:head# 2024-04-01T19:42:45.621 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48e38ed6:::benchmark_data_smithi188_119427_object103802:head# 2024-04-01T19:42:45.622 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48e3be5c:::benchmark_data_smithi188_119427_object131988:head# 2024-04-01T19:42:45.622 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48e52d51:::benchmark_data_smithi188_119427_object102200:head# 2024-04-01T19:42:45.623 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48e5bc19:::benchmark_data_smithi188_119427_object160722:head# 2024-04-01T19:42:45.623 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48e5e081:::benchmark_data_smithi188_119427_object130423:head# 2024-04-01T19:42:45.623 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48e5f97e:::benchmark_data_smithi188_119427_object105437:head# 2024-04-01T19:42:45.624 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48e69f82:::benchmark_data_smithi188_119427_object130349:head# 2024-04-01T19:42:45.624 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48e829d8:::benchmark_data_smithi188_119427_object97653:head# 2024-04-01T19:42:45.625 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48e862ac:::benchmark_data_smithi188_119427_object138188:head# 2024-04-01T19:42:45.625 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48e8b5bd:::benchmark_data_smithi188_119427_object144359:head# 2024-04-01T19:42:45.626 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48ecde7a:::benchmark_data_smithi188_119427_object74084:head# 2024-04-01T19:42:45.626 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48ecf605:::benchmark_data_smithi188_119427_object130584:head# 2024-04-01T19:42:45.627 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48ed5242:::benchmark_data_smithi188_119427_object140990:head# 2024-04-01T19:42:45.627 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48ed67c3:::benchmark_data_smithi188_119427_object135656:head# 2024-04-01T19:42:45.627 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48edfb02:::benchmark_data_smithi188_119427_object103669:head# 2024-04-01T19:42:45.628 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48ee44f2:::benchmark_data_smithi188_119427_object134036:head# 2024-04-01T19:42:45.628 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48ee9f42:::benchmark_data_smithi188_119427_object101273:head# 2024-04-01T19:42:45.629 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48eeeb32:::benchmark_data_smithi188_119427_object158195:head# 2024-04-01T19:42:45.629 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48f01506:::benchmark_data_smithi188_119427_object75449:head# 2024-04-01T19:42:45.630 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48f09f79:::benchmark_data_smithi188_119427_object158719:head# 2024-04-01T19:42:45.630 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48f0bcd0:::benchmark_data_smithi188_119427_object150012:head# 2024-04-01T19:42:45.631 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48f0f9fb:::benchmark_data_smithi188_119427_object119054:head# 2024-04-01T19:42:45.631 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48f13b08:::benchmark_data_smithi188_119427_object154846:head# 2024-04-01T19:42:45.631 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48f278cf:::benchmark_data_smithi188_119427_object149098:head# 2024-04-01T19:42:45.632 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48f2a994:::benchmark_data_smithi188_119427_object156008:head# 2024-04-01T19:42:45.632 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48f40ccf:::benchmark_data_smithi188_119427_object125387:head# 2024-04-01T19:42:45.633 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48f4ca49:::benchmark_data_smithi188_119427_object78758:head# 2024-04-01T19:42:45.633 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48f5517a:::benchmark_data_smithi188_119427_object99218:head# 2024-04-01T19:42:45.634 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48f55dcf:::benchmark_data_smithi188_119427_object112919:head# 2024-04-01T19:42:45.634 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48f64a8f:::benchmark_data_smithi188_119427_object73870:head# 2024-04-01T19:42:45.635 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48f687da:::benchmark_data_smithi188_119427_object116908:head# 2024-04-01T19:42:45.635 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48f73699:::benchmark_data_smithi188_119427_object159931:head# 2024-04-01T19:42:45.636 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48f74374:::benchmark_data_smithi188_119427_object75051:head# 2024-04-01T19:42:45.636 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48f819ed:::benchmark_data_smithi188_119427_object112406:head# 2024-04-01T19:42:45.637 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48f83e0f:::benchmark_data_smithi188_119427_object76306:head# 2024-04-01T19:42:45.637 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48f859e8:::benchmark_data_smithi188_119427_object76056:head# 2024-04-01T19:42:45.638 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48f8ecfc:::benchmark_data_smithi188_119427_object103065:head# 2024-04-01T19:42:45.638 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48fa9bb6:::benchmark_data_smithi188_119427_object72906:head# 2024-04-01T19:42:45.639 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48fc586a:::benchmark_data_smithi188_119427_object122644:head# 2024-04-01T19:42:45.639 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48fdd147:::benchmark_data_smithi188_119427_object138045:head# 2024-04-01T19:42:45.639 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48fe3fc1:::benchmark_data_smithi188_119427_object142165:head# 2024-04-01T19:42:45.640 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48fe9043:::benchmark_data_smithi188_119427_object81960:head# 2024-04-01T19:42:45.640 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48ff8eba:::benchmark_data_smithi188_119427_object154187:head# 2024-04-01T19:42:45.641 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48ffa356:::benchmark_data_smithi188_119427_object159411:head# 2024-04-01T19:42:45.641 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:48fff5bd:::benchmark_data_smithi188_119427_object140292:head# 2024-04-01T19:42:45.641 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:490361f8:::benchmark_data_smithi188_119427_object116177:head# 2024-04-01T19:42:45.642 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49044104:::benchmark_data_smithi188_119427_object144490:head# 2024-04-01T19:42:45.642 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4904ddd4:::benchmark_data_smithi188_119427_object160267:head# 2024-04-01T19:42:45.643 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4904fa9c:::benchmark_data_smithi188_119427_object88625:head# 2024-04-01T19:42:45.643 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4904fd8d:::benchmark_data_smithi188_119427_object151569:head# 2024-04-01T19:42:45.644 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49050bf3:::benchmark_data_smithi188_119427_object84407:head# 2024-04-01T19:42:45.644 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4907731d:::benchmark_data_smithi188_119427_object153089:head# 2024-04-01T19:42:45.644 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49078842:::benchmark_data_smithi188_119427_object155051:head# 2024-04-01T19:42:45.645 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4907af0c:::benchmark_data_smithi188_119427_object73573:head# 2024-04-01T19:42:45.645 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4907bb67:::benchmark_data_smithi188_119427_object103400:head# 2024-04-01T19:42:45.646 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4908174b:::benchmark_data_smithi188_119427_object149667:head# 2024-04-01T19:42:45.646 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49092647:::benchmark_data_smithi188_119427_object133897:head# 2024-04-01T19:42:45.646 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4909703f:::benchmark_data_smithi188_119427_object130049:head# 2024-04-01T19:42:45.647 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:490b00fa:::benchmark_data_smithi188_119427_object143874:head# 2024-04-01T19:42:45.648 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:490b0f3f:::benchmark_data_smithi188_119427_object119717:head# 2024-04-01T19:42:45.648 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:490c3a8f:::benchmark_data_smithi188_119427_object121382:head# 2024-04-01T19:42:45.648 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:490c8c4f:::benchmark_data_smithi188_119427_object95356:head# 2024-04-01T19:42:45.649 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:490c9504:::benchmark_data_smithi188_119427_object103349:head# 2024-04-01T19:42:45.649 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:490ecd82:::benchmark_data_smithi188_119427_object117703:head# 2024-04-01T19:42:45.649 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:490f25e4:::benchmark_data_smithi188_119427_object140173:head# 2024-04-01T19:42:45.650 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4910083b:::benchmark_data_smithi188_119427_object108533:head# 2024-04-01T19:42:45.650 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49101af2:::benchmark_data_smithi188_119427_object103152:head# 2024-04-01T19:42:45.651 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:491022fc:::benchmark_data_smithi188_119427_object159984:head# 2024-04-01T19:42:45.651 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49107d7f:::benchmark_data_smithi188_119427_object163599:head# 2024-04-01T19:42:45.652 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4911031d:::benchmark_data_smithi188_119427_object147446:head# 2024-04-01T19:42:45.652 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49118186:::benchmark_data_smithi188_119427_object105191:head# 2024-04-01T19:42:45.653 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4911d1a7:::benchmark_data_smithi188_119427_object91877:head# 2024-04-01T19:42:45.653 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4911f1c2:::benchmark_data_smithi188_119427_object104005:head# 2024-04-01T19:42:45.653 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4912802c:::benchmark_data_smithi188_119427_object109230:head# 2024-04-01T19:42:45.654 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4913c2fe:::benchmark_data_smithi188_119427_object111822:head# 2024-04-01T19:42:45.654 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4913d2e2:::benchmark_data_smithi188_119427_object88466:head# 2024-04-01T19:42:45.654 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49147090:::benchmark_data_smithi188_119427_object73291:head# 2024-04-01T19:42:45.655 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4919ba74:::benchmark_data_smithi188_119427_object115455:head# 2024-04-01T19:42:45.655 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:491a7925:::benchmark_data_smithi188_119427_object161402:head# 2024-04-01T19:42:45.656 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:491a7d08:::benchmark_data_smithi188_119427_object86956:head# 2024-04-01T19:42:45.656 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:491a855e:::benchmark_data_smithi188_119427_object111011:head# 2024-04-01T19:42:45.657 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:491ae81d:::benchmark_data_smithi188_119427_object86102:head# 2024-04-01T19:42:45.657 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:491b2e23:::benchmark_data_smithi188_119427_object133907:head# 2024-04-01T19:42:45.658 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:491d80e9:::benchmark_data_smithi188_119427_object144836:head# 2024-04-01T19:42:45.658 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:491dc4d2:::benchmark_data_smithi188_119427_object128684:head# 2024-04-01T19:42:45.659 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:491ed9dd:::benchmark_data_smithi188_119427_object112690:head# 2024-04-01T19:42:45.659 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:491f5cf0:::benchmark_data_smithi188_119427_object130631:head# 2024-04-01T19:42:45.660 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49214305:::benchmark_data_smithi188_119427_object148016:head# 2024-04-01T19:42:45.660 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49225b6b:::benchmark_data_smithi188_119427_object125586:head# 2024-04-01T19:42:45.660 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4922ad83:::benchmark_data_smithi188_119427_object113599:head# 2024-04-01T19:42:45.661 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4925fd1c:::benchmark_data_smithi188_119427_object111488:head# 2024-04-01T19:42:45.661 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4926487c:::benchmark_data_smithi188_119427_object158202:head# 2024-04-01T19:42:45.662 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:492674b1:::benchmark_data_smithi188_119427_object122134:head# 2024-04-01T19:42:45.662 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49275d1e:::benchmark_data_smithi188_119427_object86163:head# 2024-04-01T19:42:45.663 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49276691:::benchmark_data_smithi188_119427_object74950:head# 2024-04-01T19:42:45.663 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4929731c:::benchmark_data_smithi188_119427_object127535:head# 2024-04-01T19:42:45.664 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49298be5:::benchmark_data_smithi188_119427_object73821:head# 2024-04-01T19:42:45.664 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:492acfd7:::benchmark_data_smithi188_119427_object86118:head# 2024-04-01T19:42:45.666 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:492aeb05:::benchmark_data_smithi188_119427_object93226:head# 2024-04-01T19:42:45.667 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:492bd694:::benchmark_data_smithi188_119427_object142395:head# 2024-04-01T19:42:45.667 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:492bdd06:::benchmark_data_smithi188_119427_object105423:head# 2024-04-01T19:42:45.667 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:492e9ef9:::benchmark_data_smithi188_119427_object73143:head# 2024-04-01T19:42:45.668 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49308e6a:::benchmark_data_smithi188_119427_object157278:head# 2024-04-01T19:42:45.668 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49309bdc:::benchmark_data_smithi188_119427_object78499:head# 2024-04-01T19:42:45.669 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4933280b:::benchmark_data_smithi188_119427_object117125:head# 2024-04-01T19:42:45.669 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:493382c3:::benchmark_data_smithi188_119427_object94113:head# 2024-04-01T19:42:45.670 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49351ce9:::benchmark_data_smithi188_119427_object80882:head# 2024-04-01T19:42:45.670 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49355e75:::benchmark_data_smithi188_119427_object95002:head# 2024-04-01T19:42:45.670 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4936662c:::benchmark_data_smithi188_119427_object104922:head# 2024-04-01T19:42:45.671 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4936d005:::benchmark_data_smithi188_119427_object127110:head# 2024-04-01T19:42:45.671 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49371470:::benchmark_data_smithi188_119427_object84913:head# 2024-04-01T19:42:45.672 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4937a0e8:::benchmark_data_smithi188_119427_object145135:head# 2024-04-01T19:42:45.672 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4937e393:::benchmark_data_smithi188_119427_object128832:head# 2024-04-01T19:42:45.673 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:493a2e2c:::benchmark_data_smithi188_119427_object109215:head# 2024-04-01T19:42:45.673 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:493b7387:::benchmark_data_smithi188_119427_object129466:head# 2024-04-01T19:42:45.673 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:493b8a66:::benchmark_data_smithi188_119427_object123876:head# 2024-04-01T19:42:45.674 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:493bdfd9:::benchmark_data_smithi188_119427_object153007:head# 2024-04-01T19:42:45.674 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:493c0c89:::benchmark_data_smithi188_119427_object138564:head# 2024-04-01T19:42:45.675 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:493c7f69:::benchmark_data_smithi188_119427_object94092:head# 2024-04-01T19:42:45.675 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:493c8b1f:::benchmark_data_smithi188_119427_object73568:head# 2024-04-01T19:42:45.676 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:493d7d1b:::benchmark_data_smithi188_119427_object116761:head# 2024-04-01T19:42:45.676 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:493f9064:::benchmark_data_smithi188_119427_object82623:head# 2024-04-01T19:42:45.677 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:494071a8:::benchmark_data_smithi188_119427_object136941:head# 2024-04-01T19:42:45.677 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:494178d7:::benchmark_data_smithi188_119427_object136881:head# 2024-04-01T19:42:45.678 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49417fc0:::benchmark_data_smithi188_119427_object80128:head# 2024-04-01T19:42:45.678 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4941fd65:::benchmark_data_smithi188_119427_object152376:head# 2024-04-01T19:42:45.679 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:42:45.680 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4942a395:::benchmark_data_smithi188_119427_object140361:head# 2024-04-01T19:42:45.680 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49439e24:::benchmark_data_smithi188_119427_object77494:head# 2024-04-01T19:42:45.680 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:494458e1:::benchmark_data_smithi188_119427_object73225:head# 2024-04-01T19:42:45.681 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49449101:::benchmark_data_smithi188_119427_object162491:head# 2024-04-01T19:42:45.681 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4944b309:::benchmark_data_smithi188_119427_object83852:head# 2024-04-01T19:42:45.682 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4944caf5:::benchmark_data_smithi188_119427_object77255:head# 2024-04-01T19:42:45.682 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4945d280:::benchmark_data_smithi188_119427_object126961:head# 2024-04-01T19:42:45.682 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49464f20:::benchmark_data_smithi188_119427_object85307:head# 2024-04-01T19:42:45.683 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:494692aa:::benchmark_data_smithi188_119427_object93129:head# 2024-04-01T19:42:45.683 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4946a479:::benchmark_data_smithi188_119427_object162931:head# 2024-04-01T19:42:45.683 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49474890:::benchmark_data_smithi188_119427_object154963:head# 2024-04-01T19:42:45.684 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4947fb92:::benchmark_data_smithi188_119427_object92173:head# 2024-04-01T19:42:45.684 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:494901c7:::benchmark_data_smithi188_119427_object139298:head# 2024-04-01T19:42:45.685 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:494b552d:::benchmark_data_smithi188_119427_object81174:head# 2024-04-01T19:42:45.685 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:494be87b:::benchmark_data_smithi188_119427_object88327:head# 2024-04-01T19:42:45.686 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:494ce35c:::benchmark_data_smithi188_119427_object87333:head# 2024-04-01T19:42:45.686 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:494d43b9:::benchmark_data_smithi188_119427_object107422:head# 2024-04-01T19:42:45.687 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:494d4e66:::benchmark_data_smithi188_119427_object143951:head# 2024-04-01T19:42:45.687 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:494dcd3d:::benchmark_data_smithi188_119427_object147652:head# 2024-04-01T19:42:45.687 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:494f062f:::benchmark_data_smithi188_119427_object98807:head# 2024-04-01T19:42:45.688 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:494f1885:::benchmark_data_smithi188_119427_object121526:head# 2024-04-01T19:42:45.688 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49504984:::benchmark_data_smithi188_119427_object105484:head# 2024-04-01T19:42:45.689 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4950e9ac:::benchmark_data_smithi188_119427_object130516:head# 2024-04-01T19:42:45.689 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:495181c7:::benchmark_data_smithi188_119427_object113227:head# 2024-04-01T19:42:45.690 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4953ee73:::benchmark_data_smithi188_119427_object125666:head# 2024-04-01T19:42:45.691 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:495430ba:::benchmark_data_smithi188_119427_object157690:head# 2024-04-01T19:42:45.691 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49548a80:::benchmark_data_smithi188_119427_object79887:head# 2024-04-01T19:42:45.691 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49557178:::benchmark_data_smithi188_119427_object73921:head# 2024-04-01T19:42:45.691 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:495592bd:::benchmark_data_smithi188_119427_object74033:head# 2024-04-01T19:42:45.692 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4956853d:::benchmark_data_smithi188_119427_object81005:head# 2024-04-01T19:42:45.692 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:495698a4:::benchmark_data_smithi188_119427_object126173:head# 2024-04-01T19:42:45.693 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4956f4bd:::benchmark_data_smithi188_119427_object99007:head# 2024-04-01T19:42:45.693 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4957d74b:::benchmark_data_smithi188_119427_object130151:head# 2024-04-01T19:42:45.693 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49586992:::benchmark_data_smithi188_119427_object79185:head# 2024-04-01T19:42:45.694 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4958a400:::benchmark_data_smithi188_119427_object162072:head# 2024-04-01T19:42:45.694 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:495948bb:::benchmark_data_smithi188_119427_object151697:head# 2024-04-01T19:42:45.695 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:495a954a:::benchmark_data_smithi188_119427_object149406:head# 2024-04-01T19:42:45.695 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:495b9677:::benchmark_data_smithi188_119427_object91113:head# 2024-04-01T19:42:45.695 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:495cca3f:::benchmark_data_smithi188_119427_object112665:head# 2024-04-01T19:42:45.696 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:495e6aa5:::benchmark_data_smithi188_119427_object126390:head# 2024-04-01T19:42:45.696 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:495ee912:::benchmark_data_smithi188_119427_object108464:head# 2024-04-01T19:42:45.697 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:495f1797:::benchmark_data_smithi188_119427_object121287:head# 2024-04-01T19:42:45.697 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49615ed0:::benchmark_data_smithi188_119427_object129057:head# 2024-04-01T19:42:45.698 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4962258d:::benchmark_data_smithi188_119427_object131957:head# 2024-04-01T19:42:45.698 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49627fd8:::benchmark_data_smithi188_119427_object115937:head# 2024-04-01T19:42:45.699 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49630f85:::benchmark_data_smithi188_119427_object77622:head# 2024-04-01T19:42:45.699 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4963a3c2:::benchmark_data_smithi188_119427_object143350:head# 2024-04-01T19:42:45.700 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:496425ab:::benchmark_data_smithi188_119427_object117667:head# 2024-04-01T19:42:45.700 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49644917:::benchmark_data_smithi188_119427_object160067:head# 2024-04-01T19:42:45.700 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4964eac6:::benchmark_data_smithi188_119427_object81649:head# 2024-04-01T19:42:45.701 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4964eec3:::benchmark_data_smithi188_119427_object147049:head# 2024-04-01T19:42:45.701 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4966512a:::benchmark_data_smithi188_119427_object85152:head# 2024-04-01T19:42:45.702 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:496699f0:::benchmark_data_smithi188_119427_object128071:head# 2024-04-01T19:42:45.702 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4966b7d8:::benchmark_data_smithi188_119427_object148815:head# 2024-04-01T19:42:45.703 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4966c14f:::benchmark_data_smithi188_119427_object163807:head# 2024-04-01T19:42:45.703 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4967ba40:::benchmark_data_smithi188_119427_object80777:head# 2024-04-01T19:42:45.703 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49684c2d:::benchmark_data_smithi188_119427_object77424:head# 2024-04-01T19:42:45.704 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4968b1ab:::benchmark_data_smithi188_119427_object152121:head# 2024-04-01T19:42:45.704 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49691db6:::benchmark_data_smithi188_119427_object103188:head# 2024-04-01T19:42:45.705 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4969bca4:::benchmark_data_smithi188_119427_object73503:head# 2024-04-01T19:42:45.705 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:496a4afa:::benchmark_data_smithi188_119427_object113188:head# 2024-04-01T19:42:45.706 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:496a9c1e:::benchmark_data_smithi188_119427_object138679:head# 2024-04-01T19:42:45.706 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:496acccd:::benchmark_data_smithi188_119427_object84786:head# 2024-04-01T19:42:45.706 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:45 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:42:45.706 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:45 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/942646564' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:42:45.707 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:45 smithi062 ceph-mon[44211]: osdmap e436: 12 total, 11 up, 10 in 2024-04-01T19:42:45.707 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:45 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:42:45.707 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:45 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:42:45.707 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:45 smithi062 ceph-mon[44211]: pgmap v1213: 17 pgs: 3 undersized+degraded+remapped+backfilling+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 0 op/s; 3793/184574 objects degraded (2.055%); 115 MiB/s, 1.84k objects/s recovering 2024-04-01T19:42:45.707 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:45 smithi062 ceph-mon[44211]: osdmap e437: 12 total, 11 up, 10 in 2024-04-01T19:42:45.707 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:496b999c:::benchmark_data_smithi188_119427_object79763:head# 2024-04-01T19:42:45.707 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:496c7900:::benchmark_data_smithi188_119427_object151908:head# 2024-04-01T19:42:45.708 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:496cabe2:::benchmark_data_smithi188_119427_object124644:head# 2024-04-01T19:42:45.708 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:496d0bdf:::benchmark_data_smithi188_119427_object74365:head# 2024-04-01T19:42:45.708 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:496d51c5:::benchmark_data_smithi188_119427_object148410:head# 2024-04-01T19:42:45.709 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:496d70f9:::benchmark_data_smithi188_119427_object133659:head# 2024-04-01T19:42:45.709 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:45.709 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:496db72c:::benchmark_data_smithi188_119427_object117980:head# 2024-04-01T19:42:45.710 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:496de268:::benchmark_data_smithi188_119427_object126610:head# 2024-04-01T19:42:45.710 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:496e20ed:::benchmark_data_smithi188_119427_object97756:head# 2024-04-01T19:42:45.710 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:496f0dd0:::benchmark_data_smithi188_119427_object74419:head# 2024-04-01T19:42:45.711 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:496f34f8:::benchmark_data_smithi188_119427_object148592:head# 2024-04-01T19:42:45.711 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49701c9e:::benchmark_data_smithi188_119427_object163748:head# 2024-04-01T19:42:45.712 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49712793:::benchmark_data_smithi188_119427_object77434:head# 2024-04-01T19:42:45.712 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49714a06:::benchmark_data_smithi188_119427_object78430:head# 2024-04-01T19:42:45.713 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49720da1:::benchmark_data_smithi188_119427_object146019:head# 2024-04-01T19:42:45.713 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4972ca6c:::benchmark_data_smithi188_119427_object80068:head# 2024-04-01T19:42:45.713 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49731ea0:::benchmark_data_smithi188_119427_object119624:head# 2024-04-01T19:42:45.714 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4973462c:::benchmark_data_smithi188_119427_object75957:head# 2024-04-01T19:42:45.715 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49753cd7:::benchmark_data_smithi188_119427_object150728:head# 2024-04-01T19:42:45.715 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4975a96c:::benchmark_data_smithi188_119427_object136314:head# 2024-04-01T19:42:45.715 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49767c88:::benchmark_data_smithi188_119427_object144420:head# 2024-04-01T19:42:45.716 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49768590:::benchmark_data_smithi188_119427_object136892:head# 2024-04-01T19:42:45.716 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49774fe0:::benchmark_data_smithi188_119427_object128458:head# 2024-04-01T19:42:45.717 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4977e5b1:::benchmark_data_smithi188_119427_object84421:head# 2024-04-01T19:42:45.717 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49796d33:::benchmark_data_smithi188_119427_object135333:head# 2024-04-01T19:42:45.718 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:497a3013:::benchmark_data_smithi188_119427_object129565:head# 2024-04-01T19:42:45.718 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:497a8ac5:::benchmark_data_smithi188_119427_object88892:head# 2024-04-01T19:42:45.719 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:497b67c2:::benchmark_data_smithi188_119427_object138651:head# 2024-04-01T19:42:45.719 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:497d0f13:::benchmark_data_smithi188_119427_object127657:head# 2024-04-01T19:42:45.720 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:497d4033:::benchmark_data_smithi188_119427_object107948:head# 2024-04-01T19:42:45.720 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:497d6dc8:::benchmark_data_smithi188_119427_object137063:head# 2024-04-01T19:42:45.721 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:497eb733:::benchmark_data_smithi188_119427_object135454:head# 2024-04-01T19:42:45.721 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:497f79b5:::benchmark_data_smithi188_119427_object134441:head# 2024-04-01T19:42:45.721 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:498054f6:::benchmark_data_smithi188_119427_object143894:head# 2024-04-01T19:42:45.722 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:498128ed:::benchmark_data_smithi188_119427_object124015:head# 2024-04-01T19:42:45.723 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:498208b9:::benchmark_data_smithi188_119427_object162890:head# 2024-04-01T19:42:45.723 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4982cb44:::benchmark_data_smithi188_119427_object116498:head# 2024-04-01T19:42:45.723 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4984d501:::benchmark_data_smithi188_119427_object146457:head# 2024-04-01T19:42:45.724 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4985dc98:::benchmark_data_smithi188_119427_object132987:head# 2024-04-01T19:42:45.724 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:498617e4:::benchmark_data_smithi188_119427_object82491:head# 2024-04-01T19:42:45.767 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:45 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:42:45.767 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:45 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/942646564' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:42:45.767 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:45 smithi022 ceph-mon[39439]: osdmap e436: 12 total, 11 up, 10 in 2024-04-01T19:42:45.767 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:45 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:42:45.767 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:45 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:42:45.767 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:45 smithi022 ceph-mon[39439]: pgmap v1213: 17 pgs: 3 undersized+degraded+remapped+backfilling+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 0 op/s; 3793/184574 objects degraded (2.055%); 115 MiB/s, 1.84k objects/s recovering 2024-04-01T19:42:45.767 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:45 smithi022 ceph-mon[39439]: osdmap e437: 12 total, 11 up, 10 in 2024-04-01T19:42:45.786 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49863926:::benchmark_data_smithi188_119427_object153071:head# 2024-04-01T19:42:45.786 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4986a1a1:::benchmark_data_smithi188_119427_object94270:head# 2024-04-01T19:42:45.786 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4987f644:::benchmark_data_smithi188_119427_object119215:head# 2024-04-01T19:42:45.787 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:498cffac:::benchmark_data_smithi188_119427_object132756:head# 2024-04-01T19:42:45.787 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:498f66e1:::benchmark_data_smithi188_119427_object129801:head# 2024-04-01T19:42:45.788 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49916c0c:::benchmark_data_smithi188_119427_object132059:head# 2024-04-01T19:42:45.788 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49937aeb:::benchmark_data_smithi188_119427_object112710:head# 2024-04-01T19:42:45.788 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4993f477:::benchmark_data_smithi188_119427_object143743:head# 2024-04-01T19:42:45.789 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4994a4ad:::benchmark_data_smithi188_119427_object138008:head# 2024-04-01T19:42:45.789 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49956e75:::benchmark_data_smithi188_119427_object159323:head# 2024-04-01T19:42:45.790 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49978a7a:::benchmark_data_smithi188_119427_object117193:head# 2024-04-01T19:42:45.790 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49980a3d:::benchmark_data_smithi188_119427_object129915:head# 2024-04-01T19:42:45.790 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4998359f:::benchmark_data_smithi188_119427_object98470:head# 2024-04-01T19:42:45.791 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:499887f5:::benchmark_data_smithi188_119427_object91771:head# 2024-04-01T19:42:45.791 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4998ae19:::benchmark_data_smithi188_119427_object80810:head# 2024-04-01T19:42:45.792 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:499a6acb:::benchmark_data_smithi188_119427_object89295:head# 2024-04-01T19:42:45.792 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:499aabd0:::benchmark_data_smithi188_119427_object81761:head# 2024-04-01T19:42:45.792 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:499afdec:::benchmark_data_smithi188_119427_object120197:head# 2024-04-01T19:42:45.793 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:499b076b:::benchmark_data_smithi188_119427_object111738:head# 2024-04-01T19:42:45.793 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:499b61a2:::benchmark_data_smithi188_119427_object102781:head# 2024-04-01T19:42:45.793 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:499b987b:::benchmark_data_smithi188_119427_object90544:head# 2024-04-01T19:42:45.794 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:499c5073:::benchmark_data_smithi188_119427_object137453:head# 2024-04-01T19:42:45.794 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:499c70c5:::benchmark_data_smithi188_119427_object97171:head# 2024-04-01T19:42:45.795 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:499d5d29:::benchmark_data_smithi188_119427_object108245:head# 2024-04-01T19:42:45.795 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:499d8969:::benchmark_data_smithi188_119427_object101650:head# 2024-04-01T19:42:45.795 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:499e0b6e:::benchmark_data_smithi188_119427_object129741:head# 2024-04-01T19:42:45.796 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:499e1cf4:::benchmark_data_smithi188_119427_object102612:head# 2024-04-01T19:42:45.796 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:499ea1a8:::benchmark_data_smithi188_119427_object160791:head# 2024-04-01T19:42:45.797 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:499edfde:::benchmark_data_smithi188_119427_object138547:head# 2024-04-01T19:42:45.797 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:499ee754:::benchmark_data_smithi188_119427_object150542:head# 2024-04-01T19:42:45.797 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:499f37d2:::benchmark_data_smithi188_119427_object130425:head# 2024-04-01T19:42:45.798 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49a03732:::benchmark_data_smithi188_119427_object161810:head# 2024-04-01T19:42:45.798 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49a26f8f:::benchmark_data_smithi188_119427_object77266:head# 2024-04-01T19:42:45.799 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49a41a0a:::benchmark_data_smithi188_119427_object81924:head# 2024-04-01T19:42:45.799 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49a4b67a:::benchmark_data_smithi188_119427_object85298:head# 2024-04-01T19:42:45.800 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49a4d92c:::benchmark_data_smithi188_119427_object125060:head# 2024-04-01T19:42:45.800 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49a5418f:::benchmark_data_smithi188_119427_object134098:head# 2024-04-01T19:42:45.800 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49a57752:::benchmark_data_smithi188_119427_object127502:head# 2024-04-01T19:42:45.801 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49a5aea2:::benchmark_data_smithi188_119427_object88218:head# 2024-04-01T19:42:45.801 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49a643f9:::benchmark_data_smithi188_119427_object85065:head# 2024-04-01T19:42:45.802 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49a64a8a:::benchmark_data_smithi188_119427_object101385:head# 2024-04-01T19:42:45.802 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49a7f43d:::benchmark_data_smithi188_119427_object85379:head# 2024-04-01T19:42:45.802 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49a8237b:::benchmark_data_smithi188_119427_object96557:head# 2024-04-01T19:42:45.803 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49a84d00:::benchmark_data_smithi188_119427_object120148:head# 2024-04-01T19:42:45.803 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49a8a25a:::benchmark_data_smithi188_119427_object106433:head# 2024-04-01T19:42:45.804 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49a9374b:::benchmark_data_smithi188_119427_object116885:head# 2024-04-01T19:42:45.804 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49a9aada:::benchmark_data_smithi188_119427_object161999:head# 2024-04-01T19:42:45.805 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49ab4f1c:::benchmark_data_smithi188_119427_object112443:head# 2024-04-01T19:42:45.805 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49ab8090:::benchmark_data_smithi188_119427_object123600:head# 2024-04-01T19:42:45.805 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49ac25e4:::benchmark_data_smithi188_119427_object116699:head# 2024-04-01T19:42:45.806 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49ac5ab3:::benchmark_data_smithi188_119427_object97292:head# 2024-04-01T19:42:45.809 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49ad0ae2:::benchmark_data_smithi188_119427_object133987:head# 2024-04-01T19:42:45.811 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49adca6e:::benchmark_data_smithi188_119427_object163923:head# 2024-04-01T19:42:45.811 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49ae06ac:::benchmark_data_smithi188_119427_object75891:head# 2024-04-01T19:42:45.812 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49ae5d37:::benchmark_data_smithi188_119427_object81955:head# 2024-04-01T19:42:45.812 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49aeef12:::benchmark_data_smithi188_119427_object151344:head# 2024-04-01T19:42:45.812 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49afac13:::benchmark_data_smithi188_119427_object83177:head# 2024-04-01T19:42:45.812 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49b20399:::benchmark_data_smithi188_119427_object97268:head# 2024-04-01T19:42:45.812 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49b25dbb:::benchmark_data_smithi188_119427_object158364:head# 2024-04-01T19:42:45.812 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49b30eb3:::benchmark_data_smithi188_119427_object129231:head# 2024-04-01T19:42:45.812 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49b35e7f:::benchmark_data_smithi188_119427_object93709:head# 2024-04-01T19:42:45.812 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49b401cd:::benchmark_data_smithi188_119427_object110646:head# 2024-04-01T19:42:45.812 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49b4acfe:::benchmark_data_smithi188_119427_object93470:head# 2024-04-01T19:42:45.812 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49b4d726:::benchmark_data_smithi188_119427_object105529:head# 2024-04-01T19:42:45.812 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49b508de:::benchmark_data_smithi188_119427_object159925:head# 2024-04-01T19:42:45.813 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49b54f7e:::benchmark_data_smithi188_119427_object127974:head# 2024-04-01T19:42:45.813 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49b5c175:::benchmark_data_smithi188_119427_object72365:head# 2024-04-01T19:42:45.813 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49b640c6:::benchmark_data_smithi188_119427_object136164:head# 2024-04-01T19:42:45.813 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49b6b476:::benchmark_data_smithi188_119427_object163198:head# 2024-04-01T19:42:45.814 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49b6ef0a:::benchmark_data_smithi188_119427_object129321:head# 2024-04-01T19:42:45.814 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49b76716:::benchmark_data_smithi188_119427_object158094:head# 2024-04-01T19:42:45.814 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49b86e26:::benchmark_data_smithi188_119427_object90859:head# 2024-04-01T19:42:45.815 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49b87394:::benchmark_data_smithi188_119427_object122932:head# 2024-04-01T19:42:45.815 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49b8e077:::benchmark_data_smithi188_119427_object121505:head# 2024-04-01T19:42:45.815 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49bb685b:::benchmark_data_smithi188_119427_object117841:head# 2024-04-01T19:42:45.816 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49bdd229:::benchmark_data_smithi188_119427_object81419:head# 2024-04-01T19:42:45.816 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49bec475:::benchmark_data_smithi188_119427_object112536:head# 2024-04-01T19:42:45.817 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49c06b61:::benchmark_data_smithi188_119427_object161634:head# 2024-04-01T19:42:45.817 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49c1289e:::benchmark_data_smithi188_119427_object152524:head# 2024-04-01T19:42:45.818 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49c2a452:::benchmark_data_smithi188_119427_object153971:head# 2024-04-01T19:42:45.818 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49c2eedc:::benchmark_data_smithi188_119427_object72983:head# 2024-04-01T19:42:45.818 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49c45a1a:::benchmark_data_smithi188_119427_object138106:head# 2024-04-01T19:42:45.819 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49c47242:::benchmark_data_smithi188_119427_object142003:head# 2024-04-01T19:42:45.819 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49c4b1f7:::benchmark_data_smithi188_119427_object164282:head# 2024-04-01T19:42:45.820 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49c56b61:::benchmark_data_smithi188_119427_object140602:head# 2024-04-01T19:42:45.820 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49c58437:::benchmark_data_smithi188_119427_object103122:head# 2024-04-01T19:42:45.821 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49c592b1:::benchmark_data_smithi188_119427_object104205:head# 2024-04-01T19:42:45.821 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49c59837:::benchmark_data_smithi188_119427_object86353:head# 2024-04-01T19:42:45.822 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49c64c9b:::benchmark_data_smithi188_119427_object120054:head# 2024-04-01T19:42:45.822 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49c65811:::benchmark_data_smithi188_119427_object110737:head# 2024-04-01T19:42:45.823 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49c773f9:::benchmark_data_smithi188_119427_object140207:head# 2024-04-01T19:42:45.823 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49c7c583:::benchmark_data_smithi188_119427_object145841:head# 2024-04-01T19:42:45.823 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49c85490:::benchmark_data_smithi188_119427_object115109:head# 2024-04-01T19:42:45.824 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49c8577d:::benchmark_data_smithi188_119427_object95500:head# 2024-04-01T19:42:45.824 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49c94c04:::benchmark_data_smithi188_119427_object128483:head# 2024-04-01T19:42:45.825 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49c9ea1a:::benchmark_data_smithi188_119427_object104823:head# 2024-04-01T19:42:45.825 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49c9f7e6:::benchmark_data_smithi188_119427_object117528:head# 2024-04-01T19:42:45.825 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49cc48af:::benchmark_data_smithi188_119427_object135714:head# 2024-04-01T19:42:45.826 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49cc6fa2:::benchmark_data_smithi188_119427_object105229:head# 2024-04-01T19:42:45.826 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49cce247:::benchmark_data_smithi188_119427_object134635:head# 2024-04-01T19:42:45.826 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49cdf84f:::benchmark_data_smithi188_119427_object91254:head# 2024-04-01T19:42:45.827 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49cf3cec:::benchmark_data_smithi188_119427_object77007:head# 2024-04-01T19:42:45.827 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49d0ec6a:::benchmark_data_smithi188_119427_object120414:head# 2024-04-01T19:42:45.828 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49d14620:::benchmark_data_smithi188_119427_object84705:head# 2024-04-01T19:42:45.828 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49d23bdd:::benchmark_data_smithi188_119427_object128954:head# 2024-04-01T19:42:45.828 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49d34f50:::benchmark_data_smithi188_119427_object141641:head# 2024-04-01T19:42:45.829 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49d3618d:::benchmark_data_smithi188_119427_object134965:head# 2024-04-01T19:42:45.829 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49d408f3:::benchmark_data_smithi188_119427_object126749:head# 2024-04-01T19:42:45.829 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49d40be9:::benchmark_data_smithi188_119427_object96774:head# 2024-04-01T19:42:45.830 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49d417d3:::benchmark_data_smithi188_119427_object157545:head# 2024-04-01T19:42:45.830 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49d58e4e:::benchmark_data_smithi188_119427_object130789:head# 2024-04-01T19:42:45.831 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49d65006:::benchmark_data_smithi188_119427_object162504:head# 2024-04-01T19:42:45.831 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49d678a7:::benchmark_data_smithi188_119427_object127962:head# 2024-04-01T19:42:45.831 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49d6b8af:::benchmark_data_smithi188_119427_object109408:head# 2024-04-01T19:42:45.832 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49d6d94a:::benchmark_data_smithi188_119427_object134574:head# 2024-04-01T19:42:45.832 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49d76d44:::benchmark_data_smithi188_119427_object115309:head# 2024-04-01T19:42:45.832 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49d80799:::benchmark_data_smithi188_119427_object138758:head# 2024-04-01T19:42:45.833 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49d82699:::benchmark_data_smithi188_119427_object133043:head# 2024-04-01T19:42:45.833 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49d8306a:::benchmark_data_smithi188_119427_object108278:head# 2024-04-01T19:42:45.834 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49d8d20e:::benchmark_data_smithi188_119427_object156737:head# 2024-04-01T19:42:45.834 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49d9054a:::benchmark_data_smithi188_119427_object127427:head# 2024-04-01T19:42:45.834 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49d9299f:::benchmark_data_smithi188_119427_object78385:head# 2024-04-01T19:42:45.835 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49d96ed5:::benchmark_data_smithi188_119427_object78678:head# 2024-04-01T19:42:45.835 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49d98e85:::benchmark_data_smithi188_119427_object125527:head# 2024-04-01T19:42:45.836 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49d9e686:::benchmark_data_smithi188_119427_object156387:head# 2024-04-01T19:42:45.836 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49da358e:::benchmark_data_smithi188_119427_object159544:head# 2024-04-01T19:42:45.836 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49db09df:::benchmark_data_smithi188_119427_object77618:head# 2024-04-01T19:42:45.837 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49db0f0c:::benchmark_data_smithi188_119427_object99289:head# 2024-04-01T19:42:45.837 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49db5b4a:::benchmark_data_smithi188_119427_object94524:head# 2024-04-01T19:42:45.838 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49dde42f:::benchmark_data_smithi188_119427_object103304:head# 2024-04-01T19:42:45.838 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49ddee85:::benchmark_data_smithi188_119427_object110610:head# 2024-04-01T19:42:45.838 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49de055f:::benchmark_data_smithi188_119427_object162145:head# 2024-04-01T19:42:45.839 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49de37bb:::benchmark_data_smithi188_119427_object106448:head# 2024-04-01T19:42:45.839 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49df0ac6:::benchmark_data_smithi188_119427_object119459:head# 2024-04-01T19:42:45.840 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49df6524:::benchmark_data_smithi188_119427_object121975:head# 2024-04-01T19:42:45.840 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49df70d5:::benchmark_data_smithi188_119427_object83764:head# 2024-04-01T19:42:45.840 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49df77d9:::benchmark_data_smithi188_119427_object163765:head# 2024-04-01T19:42:45.841 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49dff108:::benchmark_data_smithi188_119427_object150318:head# 2024-04-01T19:42:45.841 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49e0654d:::benchmark_data_smithi188_119427_object86179:head# 2024-04-01T19:42:45.842 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49e0e78e:::benchmark_data_smithi188_119427_object133149:head# 2024-04-01T19:42:45.842 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49e102dd:::benchmark_data_smithi188_119427_object95484:head# 2024-04-01T19:42:45.842 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49e13d1f:::benchmark_data_smithi188_119427_object141119:head# 2024-04-01T19:42:45.843 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49e25ad5:::benchmark_data_smithi188_119427_object115005:head# 2024-04-01T19:42:45.843 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49e2e34c:::benchmark_data_smithi188_119427_object74682:head# 2024-04-01T19:42:45.843 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49e31a69:::benchmark_data_smithi188_119427_object162022:head# 2024-04-01T19:42:45.844 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49e38adf:::benchmark_data_smithi188_119427_object155321:head# 2024-04-01T19:42:45.844 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49e3f6ab:::benchmark_data_smithi188_119427_object106415:head# 2024-04-01T19:42:45.845 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49e41700:::benchmark_data_smithi188_119427_object73768:head# 2024-04-01T19:42:45.845 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49e5301f:::benchmark_data_smithi188_119427_object78973:head# 2024-04-01T19:42:45.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49e54e69:::benchmark_data_smithi188_119427_object132180:head# 2024-04-01T19:42:45.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49e5a04e:::benchmark_data_smithi188_119427_object81437:head# 2024-04-01T19:42:45.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49e66a6c:::benchmark_data_smithi188_119427_object86396:head# 2024-04-01T19:42:45.847 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49e8ea20:::benchmark_data_smithi188_119427_object140636:head# 2024-04-01T19:42:45.847 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49e9dac9:::benchmark_data_smithi188_119427_object148588:head# 2024-04-01T19:42:45.847 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49e9de7c:::benchmark_data_smithi188_119427_object92419:head# 2024-04-01T19:42:45.848 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49ea3ec2:::benchmark_data_smithi188_119427_object106367:head# 2024-04-01T19:42:45.848 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49ec2242:::benchmark_data_smithi188_119427_object156057:head# 2024-04-01T19:42:45.848 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49ec5b85:::benchmark_data_smithi188_119427_object130858:head# 2024-04-01T19:42:45.849 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49ec6c4f:::benchmark_data_smithi188_119427_object130720:head# 2024-04-01T19:42:45.849 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49ed1193:::benchmark_data_smithi188_119427_object96946:head# 2024-04-01T19:42:45.850 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49ed229f:::benchmark_data_smithi188_119427_object72386:head# 2024-04-01T19:42:45.850 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49ed31dc:::benchmark_data_smithi188_119427_object164643:head# 2024-04-01T19:42:45.850 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49ed4767:::benchmark_data_smithi188_119427_object116690:head# 2024-04-01T19:42:45.851 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49edb505:::benchmark_data_smithi188_119427_object131309:head# 2024-04-01T19:42:45.851 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49ede592:::benchmark_data_smithi188_119427_object73387:head# 2024-04-01T19:42:45.852 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49f07bad:::benchmark_data_smithi188_119427_object160706:head# 2024-04-01T19:42:45.852 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49f0c72c:::benchmark_data_smithi188_119427_object110125:head# 2024-04-01T19:42:45.853 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49f168fd:::benchmark_data_smithi188_119427_object85208:head# 2024-04-01T19:42:45.853 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49f1ce7a:::benchmark_data_smithi188_119427_object86740:head# 2024-04-01T19:42:45.855 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49f1d946:::benchmark_data_smithi188_119427_object119949:head# 2024-04-01T19:42:45.855 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49f1e93f:::benchmark_data_smithi188_119427_object121442:head# 2024-04-01T19:42:45.856 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49f210b3:::benchmark_data_smithi188_119427_object79267:head# 2024-04-01T19:42:45.856 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49f5e88f:::benchmark_data_smithi188_119427_object153112:head# 2024-04-01T19:42:45.857 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49f637bb:::benchmark_data_smithi188_119427_object100020:head# 2024-04-01T19:42:45.857 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49f6d59f:::benchmark_data_smithi188_119427_object157065:head# 2024-04-01T19:42:45.858 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49f8db7d:::benchmark_data_smithi188_119427_object78855:head# 2024-04-01T19:42:45.858 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49f97a30:::benchmark_data_smithi188_119427_object108814:head# 2024-04-01T19:42:45.859 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49f9e436:::benchmark_data_smithi188_119427_object148335:head# 2024-04-01T19:42:45.859 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49fa5371:::benchmark_data_smithi188_119427_object139536:head# 2024-04-01T19:42:45.860 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49fadccf:::benchmark_data_smithi188_119427_object79341:head# 2024-04-01T19:42:45.860 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49fb928c:::benchmark_data_smithi188_119427_object73288:head# 2024-04-01T19:42:45.860 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49fbe4d4:::benchmark_data_smithi188_119427_object153902:head# 2024-04-01T19:42:45.861 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49fd2f5a:::benchmark_data_smithi188_119427_object141249:head# 2024-04-01T19:42:45.861 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49fdc3cd:::benchmark_data_smithi188_119427_object148099:head# 2024-04-01T19:42:45.861 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49fe2fb6:::benchmark_data_smithi188_119427_object131875:head# 2024-04-01T19:42:45.862 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:49fe43fa:::benchmark_data_smithi188_119427_object104091:head# 2024-04-01T19:42:45.862 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a0114ba:::benchmark_data_smithi188_119427_object124051:head# 2024-04-01T19:42:45.863 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a014374:::benchmark_data_smithi188_119427_object164530:head# 2024-04-01T19:42:45.863 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a020f3e:::benchmark_data_smithi188_119427_object149195:head# 2024-04-01T19:42:45.864 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a038f52:::benchmark_data_smithi188_119427_object161887:head# 2024-04-01T19:42:45.864 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a040d84:::benchmark_data_smithi188_119427_object100924:head# 2024-04-01T19:42:45.865 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a0594b1:::benchmark_data_smithi188_119427_object83885:head# 2024-04-01T19:42:45.865 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a0796a5:::benchmark_data_smithi188_119427_object125457:head# 2024-04-01T19:42:45.865 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a0861d9:::benchmark_data_smithi188_119427_object111621:head# 2024-04-01T19:42:45.866 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a088f97:::benchmark_data_smithi188_119427_object73191:head# 2024-04-01T19:42:45.866 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a096229:::benchmark_data_smithi188_119427_object82692:head# 2024-04-01T19:42:45.866 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a09c51c:::benchmark_data_smithi188_119427_object87519:head# 2024-04-01T19:42:45.867 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a0b1fae:::benchmark_data_smithi188_119427_object132078:head# 2024-04-01T19:42:45.867 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a0b5854:::benchmark_data_smithi188_119427_object158013:head# 2024-04-01T19:42:45.867 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a0b9d93:::benchmark_data_smithi188_119427_object133213:head# 2024-04-01T19:42:45.868 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a0c3916:::benchmark_data_smithi188_119427_object111015:head# 2024-04-01T19:42:45.868 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a0c9b43:::benchmark_data_smithi188_119427_object130673:head# 2024-04-01T19:42:45.868 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a0d6f72:::benchmark_data_smithi188_119427_object144475:head# 2024-04-01T19:42:45.869 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a0d8816:::benchmark_data_smithi188_119427_object111430:head# 2024-04-01T19:42:45.869 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a0d9851:::benchmark_data_smithi188_119427_object86642:head# 2024-04-01T19:42:45.870 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a0fd722:::benchmark_data_smithi188_119427_object130252:head# 2024-04-01T19:42:45.870 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a108427:::benchmark_data_smithi188_119427_object76878:head# 2024-04-01T19:42:45.870 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a1144c7:::benchmark_data_smithi188_119427_object129373:head# 2024-04-01T19:42:45.871 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a114822:::benchmark_data_smithi188_119427_object144291:head# 2024-04-01T19:42:45.871 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a1159e7:::benchmark_data_smithi188_119427_object140036:head# 2024-04-01T19:42:45.872 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a129b2e:::benchmark_data_smithi188_119427_object79919:head# 2024-04-01T19:42:45.872 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a12aaf7:::benchmark_data_smithi188_119427_object98205:head# 2024-04-01T19:42:45.872 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a12c8e0:::benchmark_data_smithi188_119427_object162679:head# 2024-04-01T19:42:45.873 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a12dc8b:::benchmark_data_smithi188_119427_object92712:head# 2024-04-01T19:42:45.873 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a138caf:::benchmark_data_smithi188_119427_object123676:head# 2024-04-01T19:42:45.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:45 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:42:45.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:45 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/942646564' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:42:45.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:45 smithi188 ceph-mon[43939]: osdmap e436: 12 total, 11 up, 10 in 2024-04-01T19:42:45.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:45 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:42:45.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:45 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:42:45.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:45 smithi188 ceph-mon[43939]: pgmap v1213: 17 pgs: 3 undersized+degraded+remapped+backfilling+peered, 14 active+clean; 5.6 GiB data, 15 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 0 op/s; 3793/184574 objects degraded (2.055%); 115 MiB/s, 1.84k objects/s recovering 2024-04-01T19:42:45.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:45 smithi188 ceph-mon[43939]: osdmap e437: 12 total, 11 up, 10 in 2024-04-01T19:42:45.875 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a13a937:::benchmark_data_smithi188_119427_object92936:head# 2024-04-01T19:42:45.875 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a13f2bb:::benchmark_data_smithi188_119427_object157539:head# 2024-04-01T19:42:45.875 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a140db1:::benchmark_data_smithi188_119427_object90514:head# 2024-04-01T19:42:45.875 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a154e51:::benchmark_data_smithi188_119427_object114624:head# 2024-04-01T19:42:45.875 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a163a06:::benchmark_data_smithi188_119427_object111688:head# 2024-04-01T19:42:45.876 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a16a291:::benchmark_data_smithi188_119427_object129448:head# 2024-04-01T19:42:45.877 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a185051:::benchmark_data_smithi188_119427_object83061:head# 2024-04-01T19:42:45.877 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a188b87:::benchmark_data_smithi188_119427_object124816:head# 2024-04-01T19:42:45.877 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a1a20fa:::benchmark_data_smithi188_119427_object148948:head# 2024-04-01T19:42:45.878 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a1b714b:::benchmark_data_smithi188_119427_object87158:head# 2024-04-01T19:42:45.878 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a1c30c2:::benchmark_data_smithi188_119427_object127450:head# 2024-04-01T19:42:45.879 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a1ca94e:::benchmark_data_smithi188_119427_object149665:head# 2024-04-01T19:42:45.879 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a1cf883:::benchmark_data_smithi188_119427_object87013:head# 2024-04-01T19:42:45.880 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a1e39b9:::benchmark_data_smithi188_119427_object164262:head# 2024-04-01T19:42:45.880 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a1f07d5:::benchmark_data_smithi188_119427_object139944:head# 2024-04-01T19:42:45.880 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a20e973:::benchmark_data_smithi188_119427_object102341:head# 2024-04-01T19:42:45.881 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a20f834:::benchmark_data_smithi188_119427_object94532:head# 2024-04-01T19:42:45.881 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a221426:::benchmark_data_smithi188_119427_object146782:head# 2024-04-01T19:42:45.882 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a22456c:::benchmark_data_smithi188_119427_object120747:head# 2024-04-01T19:42:45.882 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a225cf5:::benchmark_data_smithi188_119427_object139065:head# 2024-04-01T19:42:45.883 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a22e235:::benchmark_data_smithi188_119427_object79445:head# 2024-04-01T19:42:45.883 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a23922e:::benchmark_data_smithi188_119427_object111831:head# 2024-04-01T19:42:45.884 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a249173:::benchmark_data_smithi188_119427_object132539:head# 2024-04-01T19:42:45.884 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a29baec:::benchmark_data_smithi188_119427_object100597:head# 2024-04-01T19:42:45.884 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a2a782f:::benchmark_data_smithi188_119427_object82869:head# 2024-04-01T19:42:45.885 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a2b2c01:::benchmark_data_smithi188_119427_object75968:head# 2024-04-01T19:42:45.885 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a2bb178:::benchmark_data_smithi188_119427_object80472:head# 2024-04-01T19:42:45.886 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a2d543b:::benchmark_data_smithi188_119427_object154333:head# 2024-04-01T19:42:45.886 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a2d67e0:::benchmark_data_smithi188_119427_object127628:head# 2024-04-01T19:42:45.887 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a2ddab1:::benchmark_data_smithi188_119427_object98857:head# 2024-04-01T19:42:45.887 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a2ea55e:::benchmark_data_smithi188_119427_object152371:head# 2024-04-01T19:42:45.888 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a2ed11c:::benchmark_data_smithi188_119427_object136920:head# 2024-04-01T19:42:45.888 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a2eff2f:::benchmark_data_smithi188_119427_object85794:head# 2024-04-01T19:42:45.889 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a2f04fb:::benchmark_data_smithi188_119427_object120515:head# 2024-04-01T19:42:45.889 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a2f5002:::benchmark_data_smithi188_119427_object162673:head# 2024-04-01T19:42:45.890 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a2f8001:::benchmark_data_smithi188_119427_object152194:head# 2024-04-01T19:42:45.890 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a2faf5e:::benchmark_data_smithi188_119427_object139392:head# 2024-04-01T19:42:45.891 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a2fb31e:::benchmark_data_smithi188_119427_object91926:head# 2024-04-01T19:42:45.891 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a2fb3af:::benchmark_data_smithi188_119427_object130330:head# 2024-04-01T19:42:45.891 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a315c55:::benchmark_data_smithi188_119427_object134520:head# 2024-04-01T19:42:45.892 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a31b724:::benchmark_data_smithi188_119427_object129521:head# 2024-04-01T19:42:45.892 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a33146a:::benchmark_data_smithi188_119427_object81739:head# 2024-04-01T19:42:45.893 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a339755:::benchmark_data_smithi188_119427_object108029:head# 2024-04-01T19:42:45.893 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a33b690:::benchmark_data_smithi188_119427_object111030:head# 2024-04-01T19:42:45.894 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a34028f:::benchmark_data_smithi188_119427_object117456:head# 2024-04-01T19:42:45.894 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a348959:::benchmark_data_smithi188_119427_object151306:head# 2024-04-01T19:42:45.894 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a34c011:::benchmark_data_smithi188_119427_object100953:head# 2024-04-01T19:42:45.895 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a350de5:::benchmark_data_smithi188_119427_object117645:head# 2024-04-01T19:42:45.895 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a351b42:::benchmark_data_smithi188_119427_object87449:head# 2024-04-01T19:42:45.896 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a352fb9:::benchmark_data_smithi188_119427_object143815:head# 2024-04-01T19:42:45.897 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a3613ca:::benchmark_data_smithi188_119427_object118295:head# 2024-04-01T19:42:45.897 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a3655fb:::benchmark_data_smithi188_119427_object122870:head# 2024-04-01T19:42:45.897 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a374a1b:::benchmark_data_smithi188_119427_object120597:head# 2024-04-01T19:42:45.897 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a3757d1:::benchmark_data_smithi188_119427_object91513:head# 2024-04-01T19:42:45.898 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a378bf6:::benchmark_data_smithi188_119427_object116984:head# 2024-04-01T19:42:45.898 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a3791f9:::benchmark_data_smithi188_119427_object77906:head# 2024-04-01T19:42:45.899 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a37c808:::benchmark_data_smithi188_119427_object84417:head# 2024-04-01T19:42:45.899 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a37e11e:::benchmark_data_smithi188_119427_object164185:head# 2024-04-01T19:42:45.900 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a382109:::benchmark_data_smithi188_119427_object92882:head# 2024-04-01T19:42:45.900 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a385487:::benchmark_data_smithi188_119427_object132237:head# 2024-04-01T19:42:45.901 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a395280:::benchmark_data_smithi188_119427_object94579:head# 2024-04-01T19:42:45.901 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a3b8499:::benchmark_data_smithi188_119427_object109586:head# 2024-04-01T19:42:45.902 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a3ca93d:::benchmark_data_smithi188_119427_object141357:head# 2024-04-01T19:42:45.902 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a3ceb79:::benchmark_data_smithi188_119427_object133869:head# 2024-04-01T19:42:45.902 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a3dd41d:::benchmark_data_smithi188_119427_object142687:head# 2024-04-01T19:42:45.903 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a3eb47a:::benchmark_data_smithi188_119427_object96273:head# 2024-04-01T19:42:45.903 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a3f8b96:::benchmark_data_smithi188_119427_object144453:head# 2024-04-01T19:42:45.904 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a3fb23f:::benchmark_data_smithi188_119427_object130214:head# 2024-04-01T19:42:45.904 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a3ffe13:::benchmark_data_smithi188_119427_object94069:head# 2024-04-01T19:42:45.904 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a40740c:::benchmark_data_smithi188_119427_object123713:head# 2024-04-01T19:42:45.905 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a4088d4:::benchmark_data_smithi188_119427_object113740:head# 2024-04-01T19:42:45.905 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a40d527:::benchmark_data_smithi188_119427_object157610:head# 2024-04-01T19:42:45.906 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a40dbdf:::benchmark_data_smithi188_119427_object88834:head# 2024-04-01T19:42:45.906 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a422985:::benchmark_data_smithi188_119427_object121929:head# 2024-04-01T19:42:45.906 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a424144:::benchmark_data_smithi188_119427_object151732:head# 2024-04-01T19:42:45.907 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a425904:::benchmark_data_smithi188_119427_object99980:head# 2024-04-01T19:42:45.907 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a42d282:::benchmark_data_smithi188_119427_object82873:head# 2024-04-01T19:42:45.908 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a453b53:::benchmark_data_smithi188_119427_object85610:head# 2024-04-01T19:42:45.908 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a45a47b:::benchmark_data_smithi188_119427_object73402:head# 2024-04-01T19:42:45.908 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a45d7d9:::benchmark_data_smithi188_119427_object111491:head# 2024-04-01T19:42:45.909 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a475ce7:::benchmark_data_smithi188_119427_object101619:head# 2024-04-01T19:42:45.909 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a476d1f:::benchmark_data_smithi188_119427_object86698:head# 2024-04-01T19:42:45.910 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a484bad:::benchmark_data_smithi188_119427_object83237:head# 2024-04-01T19:42:45.910 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a485a18:::benchmark_data_smithi188_119427_object154682:head# 2024-04-01T19:42:45.910 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a493f52:::benchmark_data_smithi188_119427_object116700:head# 2024-04-01T19:42:45.911 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a49ea23:::benchmark_data_smithi188_119427_object80230:head# 2024-04-01T19:42:45.911 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a4a56e1:::benchmark_data_smithi188_119427_object132520:head# 2024-04-01T19:42:45.912 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a4bbbef:::benchmark_data_smithi188_119427_object144054:head# 2024-04-01T19:42:45.912 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a4be12a:::benchmark_data_smithi188_119427_object139851:head# 2024-04-01T19:42:45.913 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a4c5d80:::benchmark_data_smithi188_119427_object101980:head# 2024-04-01T19:42:45.913 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a4cc4d2:::benchmark_data_smithi188_119427_object162284:head# 2024-04-01T19:42:45.913 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a4d9e9a:::benchmark_data_smithi188_119427_object87112:head# 2024-04-01T19:42:45.914 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a500a7b:::benchmark_data_smithi188_119427_object143728:head# 2024-04-01T19:42:45.914 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a5134c0:::benchmark_data_smithi188_119427_object121599:head# 2024-04-01T19:42:45.915 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a51ad74:::benchmark_data_smithi188_119427_object147020:head# 2024-04-01T19:42:45.915 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a51d267:::benchmark_data_smithi188_119427_object125578:head# 2024-04-01T19:42:45.916 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a51f7cc:::benchmark_data_smithi188_119427_object79403:head# 2024-04-01T19:42:45.916 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a542046:::benchmark_data_smithi188_119427_object159621:head# 2024-04-01T19:42:45.917 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a569d79:::benchmark_data_smithi188_119427_object112257:head# 2024-04-01T19:42:45.917 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a56aceb:::benchmark_data_smithi188_119427_object133559:head# 2024-04-01T19:42:45.917 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a57103b:::benchmark_data_smithi188_119427_object89891:head# 2024-04-01T19:42:45.918 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a57546e:::benchmark_data_smithi188_119427_object145229:head# 2024-04-01T19:42:45.918 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a576673:::benchmark_data_smithi188_119427_object113700:head# 2024-04-01T19:42:45.919 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a593455:::benchmark_data_smithi188_119427_object101473:head# 2024-04-01T19:42:45.919 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a59b382:::benchmark_data_smithi188_119427_object78938:head# 2024-04-01T19:42:45.920 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a59df71:::benchmark_data_smithi188_119427_object106910:head# 2024-04-01T19:42:45.920 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a5bc7e3:::benchmark_data_smithi188_119427_object135484:head# 2024-04-01T19:42:45.921 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a5d6f33:::benchmark_data_smithi188_119427_object145305:head# 2024-04-01T19:42:45.921 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a5db367:::benchmark_data_smithi188_119427_object117911:head# 2024-04-01T19:42:45.922 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a5dc81b:::benchmark_data_smithi188_119427_object146263:head# 2024-04-01T19:42:45.922 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a5eba6e:::benchmark_data_smithi188_119427_object156955:head# 2024-04-01T19:42:45.922 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a5fbda6:::benchmark_data_smithi188_119427_object78991:head# 2024-04-01T19:42:45.923 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a5fcd3a:::benchmark_data_smithi188_119427_object116597:head# 2024-04-01T19:42:45.923 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a5fd344:::benchmark_data_smithi188_119427_object79813:head# 2024-04-01T19:42:45.924 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a60697a:::benchmark_data_smithi188_119427_object122874:head# 2024-04-01T19:42:45.924 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a61e1cd:::benchmark_data_smithi188_119427_object125390:head# 2024-04-01T19:42:45.925 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a6234f3:::benchmark_data_smithi188_119427_object146181:head# 2024-04-01T19:42:45.925 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a62b1da:::benchmark_data_smithi188_119427_object87416:head# 2024-04-01T19:42:45.927 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a630b66:::benchmark_data_smithi188_119427_object75839:head# 2024-04-01T19:42:45.927 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a64b03f:::benchmark_data_smithi188_119427_object108846:head# 2024-04-01T19:42:45.928 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a655048:::benchmark_data_smithi188_119427_object162446:head# 2024-04-01T19:42:45.928 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a65b868:::benchmark_data_smithi188_119427_object84675:head# 2024-04-01T19:42:45.928 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a66504f:::benchmark_data_smithi188_119427_object134291:head# 2024-04-01T19:42:45.928 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a670fd8:::benchmark_data_smithi188_119427_object123024:head# 2024-04-01T19:42:45.928 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a6792fd:::benchmark_data_smithi188_119427_object123047:head# 2024-04-01T19:42:45.929 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a684f3f:::benchmark_data_smithi188_119427_object135915:head# 2024-04-01T19:42:45.929 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a6ac84a:::benchmark_data_smithi188_119427_object135604:head# 2024-04-01T19:42:45.930 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a6b02ea:::benchmark_data_smithi188_119427_object150051:head# 2024-04-01T19:42:45.930 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a6b8863:::benchmark_data_smithi188_119427_object79661:head# 2024-04-01T19:42:45.931 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a6c7be1:::benchmark_data_smithi188_119427_object133496:head# 2024-04-01T19:42:45.931 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a6d3caf:::benchmark_data_smithi188_119427_object129581:head# 2024-04-01T19:42:45.932 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a6f228f:::benchmark_data_smithi188_119427_object74030:head# 2024-04-01T19:42:45.932 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a6fb17d:::benchmark_data_smithi188_119427_object129097:head# 2024-04-01T19:42:45.933 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a6fb311:::benchmark_data_smithi188_119427_object85724:head# 2024-04-01T19:42:45.933 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a7013ea:::benchmark_data_smithi188_119427_object109288:head# 2024-04-01T19:42:45.933 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a71c352:::benchmark_data_smithi188_119427_object79068:head# 2024-04-01T19:42:45.934 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a726498:::benchmark_data_smithi188_119427_object108612:head# 2024-04-01T19:42:45.934 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a7324d1:::benchmark_data_smithi188_119427_object150993:head# 2024-04-01T19:42:45.935 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a73ad08:::benchmark_data_smithi188_119427_object113575:head# 2024-04-01T19:42:45.935 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a73c8ef:::benchmark_data_smithi188_119427_object84448:head# 2024-04-01T19:42:45.936 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a73cc92:::benchmark_data_smithi188_119427_object88120:head# 2024-04-01T19:42:45.936 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a73cd6a:::benchmark_data_smithi188_119427_object114059:head# 2024-04-01T19:42:45.937 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a75e348:::benchmark_data_smithi188_119427_object141110:head# 2024-04-01T19:42:45.937 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a77631e:::benchmark_data_smithi188_119427_object163817:head# 2024-04-01T19:42:45.938 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a77925e:::benchmark_data_smithi188_119427_object118157:head# 2024-04-01T19:42:45.938 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a77ad32:::benchmark_data_smithi188_119427_object101606:head# 2024-04-01T19:42:45.939 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a78c05c:::benchmark_data_smithi188_119427_object89281:head# 2024-04-01T19:42:45.939 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a78cdfa:::benchmark_data_smithi188_119427_object81813:head# 2024-04-01T19:42:45.939 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a78e7af:::benchmark_data_smithi188_119427_object94847:head# 2024-04-01T19:42:45.940 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a7bc258:::benchmark_data_smithi188_119427_object128986:head# 2024-04-01T19:42:45.940 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a7c9c9a:::benchmark_data_smithi188_119427_object102897:head# 2024-04-01T19:42:45.941 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a7d2d88:::benchmark_data_smithi188_119427_object72520:head# 2024-04-01T19:42:45.941 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a7e9229:::benchmark_data_smithi188_119427_object120136:head# 2024-04-01T19:42:45.942 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a803cdc:::benchmark_data_smithi188_119427_object84657:head# 2024-04-01T19:42:45.942 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a804393:::benchmark_data_smithi188_119427_object162482:head# 2024-04-01T19:42:45.942 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a8093fa:::benchmark_data_smithi188_119427_object102861:head# 2024-04-01T19:42:45.943 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a813ea1:::benchmark_data_smithi188_119427_object108576:head# 2024-04-01T19:42:45.943 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a818a69:::benchmark_data_smithi188_119427_object150080:head# 2024-04-01T19:42:45.944 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a8383da:::benchmark_data_smithi188_119427_object160187:head# 2024-04-01T19:42:45.944 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a8405d0:::benchmark_data_smithi188_119427_object114524:head# 2024-04-01T19:42:45.945 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a85180e:::benchmark_data_smithi188_119427_object120481:head# 2024-04-01T19:42:45.945 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a852212:::benchmark_data_smithi188_119427_object116434:head# 2024-04-01T19:42:45.946 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a860973:::benchmark_data_smithi188_119427_object106516:head# 2024-04-01T19:42:45.946 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a869d6f:::benchmark_data_smithi188_119427_object104969:head# 2024-04-01T19:42:45.946 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a86b711:::benchmark_data_smithi188_119427_object127102:head# 2024-04-01T19:42:45.947 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a87350c:::benchmark_data_smithi188_119427_object81771:head# 2024-04-01T19:42:45.947 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a8765fe:::benchmark_data_smithi188_119427_object158416:head# 2024-04-01T19:42:45.948 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a87a315:::benchmark_data_smithi188_119427_object156612:head# 2024-04-01T19:42:45.948 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a87fd78:::benchmark_data_smithi188_119427_object131027:head# 2024-04-01T19:42:45.949 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a895b27:::benchmark_data_smithi188_119427_object91677:head# 2024-04-01T19:42:45.949 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a895f07:::benchmark_data_smithi188_119427_object125601:head# 2024-04-01T19:42:45.950 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a8963db:::benchmark_data_smithi188_119427_object77927:head# 2024-04-01T19:42:45.950 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a89cf75:::benchmark_data_smithi188_119427_object75862:head# 2024-04-01T19:42:45.950 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a8a713d:::benchmark_data_smithi188_119427_object93258:head# 2024-04-01T19:42:45.951 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a8a7f34:::benchmark_data_smithi188_119427_object107520:head# 2024-04-01T19:42:45.953 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a8b3a53:::benchmark_data_smithi188_119427_object109609:head# 2024-04-01T19:42:45.953 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a8c0786:::benchmark_data_smithi188_119427_object112171:head# 2024-04-01T19:42:45.953 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a8c1d51:::benchmark_data_smithi188_119427_object138069:head# 2024-04-01T19:42:45.954 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a8c3893:::benchmark_data_smithi188_119427_object117424:head# 2024-04-01T19:42:45.954 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a8d88aa:::benchmark_data_smithi188_119427_object129355:head# 2024-04-01T19:42:45.954 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a8f6d6c:::benchmark_data_smithi188_119427_object104368:head# 2024-04-01T19:42:45.954 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a906cf1:::benchmark_data_smithi188_119427_object85281:head# 2024-04-01T19:42:45.955 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a912ece:::benchmark_data_smithi188_119427_object104098:head# 2024-04-01T19:42:45.955 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a9212f4:::benchmark_data_smithi188_119427_object128091:head# 2024-04-01T19:42:45.956 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a9224d1:::benchmark_data_smithi188_119427_object87189:head# 2024-04-01T19:42:45.956 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a925d1e:::benchmark_data_smithi188_119427_object98751:head# 2024-04-01T19:42:45.957 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a926b1e:::benchmark_data_smithi188_119427_object111409:head# 2024-04-01T19:42:45.957 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a9288b4:::benchmark_data_smithi188_119427_object138670:head# 2024-04-01T19:42:45.957 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a94392c:::benchmark_data_smithi188_119427_object90166:head# 2024-04-01T19:42:45.958 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a9440ed:::benchmark_data_smithi188_119427_object120554:head# 2024-04-01T19:42:45.959 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a95762e:::benchmark_data_smithi188_119427_object139955:head# 2024-04-01T19:42:45.959 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a95aa53:::benchmark_data_smithi188_119427_object125104:head# 2024-04-01T19:42:45.959 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a9794a3:::benchmark_data_smithi188_119427_object163837:head# 2024-04-01T19:42:45.960 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a992c6d:::benchmark_data_smithi188_119427_object143424:head# 2024-04-01T19:42:45.960 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a9a203e:::benchmark_data_smithi188_119427_object77935:head# 2024-04-01T19:42:45.960 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a9a7644:::benchmark_data_smithi188_119427_object90273:head# 2024-04-01T19:42:45.961 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a9c0169:::benchmark_data_smithi188_119427_object100881:head# 2024-04-01T19:42:45.961 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a9c1419:::benchmark_data_smithi188_119427_object146416:head# 2024-04-01T19:42:45.962 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a9ca45b:::benchmark_data_smithi188_119427_object77009:head# 2024-04-01T19:42:45.962 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a9caf73:::benchmark_data_smithi188_119427_object79239:head# 2024-04-01T19:42:45.963 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a9cd3f8:::benchmark_data_smithi188_119427_object88299:head# 2024-04-01T19:42:45.963 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a9e2bc3:::benchmark_data_smithi188_119427_object134249:head# 2024-04-01T19:42:45.964 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a9ec869:::benchmark_data_smithi188_119427_object118849:head# 2024-04-01T19:42:45.964 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a9f4d8e:::benchmark_data_smithi188_119427_object127737:head# 2024-04-01T19:42:45.965 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a9f82e8:::benchmark_data_smithi188_119427_object156060:head# 2024-04-01T19:42:45.965 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4a9f9473:::benchmark_data_smithi188_119427_object85373:head# 2024-04-01T19:42:45.965 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aa103d7:::benchmark_data_smithi188_119427_object153386:head# 2024-04-01T19:42:45.966 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aa264a0:::benchmark_data_smithi188_119427_object74341:head# 2024-04-01T19:42:45.966 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aa2c119:::benchmark_data_smithi188_119427_object134434:head# 2024-04-01T19:42:45.967 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aa3c2b1:::benchmark_data_smithi188_119427_object98704:head# 2024-04-01T19:42:45.967 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aa44c4b:::benchmark_data_smithi188_119427_object90237:head# 2024-04-01T19:42:45.968 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aa4e61c:::benchmark_data_smithi188_119427_object127705:head# 2024-04-01T19:42:46.033 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aa50569:::benchmark_data_smithi188_119427_object100403:head# 2024-04-01T19:42:46.033 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aa5d34f:::benchmark_data_smithi188_119427_object161175:head# 2024-04-01T19:42:46.033 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aa5dc8c:::benchmark_data_smithi188_119427_object131794:head# 2024-04-01T19:42:46.033 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aa62b0f:::benchmark_data_smithi188_119427_object82189:head# 2024-04-01T19:42:46.033 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aa73ad2:::benchmark_data_smithi188_119427_object153035:head# 2024-04-01T19:42:46.033 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aa7aa11:::benchmark_data_smithi188_119427_object148787:head# 2024-04-01T19:42:46.033 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aa889eb:::benchmark_data_smithi188_119427_object113773:head# 2024-04-01T19:42:46.033 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aa890e9:::benchmark_data_smithi188_119427_object146079:head# 2024-04-01T19:42:46.033 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aaa1dc0:::benchmark_data_smithi188_119427_object111327:head# 2024-04-01T19:42:46.033 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aab0f0e:::benchmark_data_smithi188_119427_object150478:head# 2024-04-01T19:42:46.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aab4084:::benchmark_data_smithi188_119427_object133701:head# 2024-04-01T19:42:46.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aace9ad:::benchmark_data_smithi188_119427_object107315:head# 2024-04-01T19:42:46.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aad639b:::benchmark_data_smithi188_119427_object113122:head# 2024-04-01T19:42:46.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aadc1c9:::benchmark_data_smithi188_119427_object117140:head# 2024-04-01T19:42:46.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aaddfd8:::benchmark_data_smithi188_119427_object87703:head# 2024-04-01T19:42:46.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aae7e31:::benchmark_data_smithi188_119427_object105477:head# 2024-04-01T19:42:46.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aaf98a1:::benchmark_data_smithi188_119427_object152933:head# 2024-04-01T19:42:46.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ab04d1b:::benchmark_data_smithi188_119427_object113073:head# 2024-04-01T19:42:46.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ab0d05c:::benchmark_data_smithi188_119427_object136827:head# 2024-04-01T19:42:46.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ab147ff:::benchmark_data_smithi188_119427_object108929:head# 2024-04-01T19:42:46.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ab16729:::benchmark_data_smithi188_119427_object118961:head# 2024-04-01T19:42:46.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ab21131:::benchmark_data_smithi188_119427_object129098:head# 2024-04-01T19:42:46.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ab39afc:::benchmark_data_smithi188_119427_object162818:head# 2024-04-01T19:42:46.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ab43a84:::benchmark_data_smithi188_119427_object73618:head# 2024-04-01T19:42:46.034 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ab57a0d:::benchmark_data_smithi188_119427_object91602:head# 2024-04-01T19:42:46.035 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ab611f9:::benchmark_data_smithi188_119427_object126255:head# 2024-04-01T19:42:46.035 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ab61bcb:::benchmark_data_smithi188_119427_object85111:head# 2024-04-01T19:42:46.035 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ab73370:::benchmark_data_smithi188_119427_object145954:head# 2024-04-01T19:42:46.036 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ab7c4bf:::benchmark_data_smithi188_119427_object161140:head# 2024-04-01T19:42:46.036 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ab80b95:::benchmark_data_smithi188_119427_object150755:head# 2024-04-01T19:42:46.036 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ab81dbd:::benchmark_data_smithi188_119427_object136141:head# 2024-04-01T19:42:46.036 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ab83a96:::benchmark_data_smithi188_119427_object89104:head# 2024-04-01T19:42:46.036 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ab90d7d:::benchmark_data_smithi188_119427_object80314:head# 2024-04-01T19:42:46.036 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ab96993:::benchmark_data_smithi188_119427_object134054:head# 2024-04-01T19:42:46.036 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ab98c03:::benchmark_data_smithi188_119427_object143908:head# 2024-04-01T19:42:46.036 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ab9e73c:::benchmark_data_smithi188_119427_object113845:head# 2024-04-01T19:42:46.037 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4abaca8c:::benchmark_data_smithi188_119427_object85961:head# 2024-04-01T19:42:46.037 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4abaea08:::benchmark_data_smithi188_119427_object157208:head# 2024-04-01T19:42:46.037 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4abb0aec:::benchmark_data_smithi188_119427_object102944:head# 2024-04-01T19:42:46.038 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4abb2d0f:::benchmark_data_smithi188_119427_object112676:head# 2024-04-01T19:42:46.038 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4abb2d34:::benchmark_data_smithi188_119427_object164353:head# 2024-04-01T19:42:46.038 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4abbaa58:::benchmark_data_smithi188_119427_object153365:head# 2024-04-01T19:42:46.040 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4abbc99e:::benchmark_data_smithi188_119427_object162732:head# 2024-04-01T19:42:46.040 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4abcab89:::benchmark_data_smithi188_119427_object134455:head# 2024-04-01T19:42:46.041 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4abe21a1:::benchmark_data_smithi188_119427_object161394:head# 2024-04-01T19:42:46.041 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ac02220:::benchmark_data_smithi188_119427_object157130:head# 2024-04-01T19:42:46.042 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ac044f1:::benchmark_data_smithi188_119427_object164685:head# 2024-04-01T19:42:46.042 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ac04da4:::benchmark_data_smithi188_119427_object80290:head# 2024-04-01T19:42:46.043 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ac0bbb9:::benchmark_data_smithi188_119427_object119385:head# 2024-04-01T19:42:46.043 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ac0d732:::benchmark_data_smithi188_119427_object116387:head# 2024-04-01T19:42:46.043 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ac1fd80:::benchmark_data_smithi188_119427_object132094:head# 2024-04-01T19:42:46.044 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ac27ff3:::benchmark_data_smithi188_119427_object114509:head# 2024-04-01T19:42:46.044 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ac3e32a:::benchmark_data_smithi188_119427_object111274:head# 2024-04-01T19:42:46.045 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ac53296:::benchmark_data_smithi188_119427_object85702:head# 2024-04-01T19:42:46.045 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ac69036:::benchmark_data_smithi188_119427_object108429:head# 2024-04-01T19:42:46.045 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ac741ec:::benchmark_data_smithi188_119427_object116049:head# 2024-04-01T19:42:46.046 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ac8f960:::benchmark_data_smithi188_119427_object84116:head# 2024-04-01T19:42:46.046 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ac99f35:::benchmark_data_smithi188_119427_object124254:head# 2024-04-01T19:42:46.047 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aca713f:::benchmark_data_smithi188_119427_object83719:head# 2024-04-01T19:42:46.047 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4acd7b8c:::benchmark_data_smithi188_119427_object93449:head# 2024-04-01T19:42:46.047 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4acdc701:::benchmark_data_smithi188_119427_object151242:head# 2024-04-01T19:42:46.048 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4acf1d7b:::benchmark_data_smithi188_119427_object122310:head# 2024-04-01T19:42:46.048 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4acfc364:::benchmark_data_smithi188_119427_object84383:head# 2024-04-01T19:42:46.049 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4acfdc0d:::benchmark_data_smithi188_119427_object149255:head# 2024-04-01T19:42:46.049 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ad1f236:::benchmark_data_smithi188_119427_object122183:head# 2024-04-01T19:42:46.050 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ad2085f:::benchmark_data_smithi188_119427_object157301:head# 2024-04-01T19:42:46.050 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ad241e9:::benchmark_data_smithi188_119427_object143177:head# 2024-04-01T19:42:46.051 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ad34e9b:::benchmark_data_smithi188_119427_object86683:head# 2024-04-01T19:42:46.051 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ad3b568:::benchmark_data_smithi188_119427_object90400:head# 2024-04-01T19:42:46.051 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ad3d3a1:::benchmark_data_smithi188_119427_object89901:head# 2024-04-01T19:42:46.052 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ad46908:::benchmark_data_smithi188_119427_object126299:head# 2024-04-01T19:42:46.053 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ad4bdb2:::benchmark_data_smithi188_119427_object153890:head# 2024-04-01T19:42:46.053 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ad4df09:::benchmark_data_smithi188_119427_object81590:head# 2024-04-01T19:42:46.053 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ad594a6:::benchmark_data_smithi188_119427_object132657:head# 2024-04-01T19:42:46.054 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ad7007c:::benchmark_data_smithi188_119427_object135825:head# 2024-04-01T19:42:46.054 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ad85b32:::benchmark_data_smithi188_119427_object158965:head# 2024-04-01T19:42:46.054 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ad87c67:::benchmark_data_smithi188_119427_object126479:head# 2024-04-01T19:42:46.055 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ad89f93:::benchmark_data_smithi188_119427_object122645:head# 2024-04-01T19:42:46.056 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ad8ed5e:::benchmark_data_smithi188_119427_object147611:head# 2024-04-01T19:42:46.056 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ad9092c:::benchmark_data_smithi188_119427_object162456:head# 2024-04-01T19:42:46.056 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ad92b49:::benchmark_data_smithi188_119427_object126682:head# 2024-04-01T19:42:46.057 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ad99dc9:::benchmark_data_smithi188_119427_object95861:head# 2024-04-01T19:42:46.057 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ad9c0dd:::benchmark_data_smithi188_119427_object136471:head# 2024-04-01T19:42:46.058 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ad9de5c:::benchmark_data_smithi188_119427_object79217:head# 2024-04-01T19:42:46.063 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ad9deac:::benchmark_data_smithi188_119427_object88083:head# 2024-04-01T19:42:46.063 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ad9f15e:::benchmark_data_smithi188_119427_object134063:head# 2024-04-01T19:42:46.063 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ada6dc4:::benchmark_data_smithi188_119427_object77461:head# 2024-04-01T19:42:46.064 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4adac373:::benchmark_data_smithi188_119427_object98357:head# 2024-04-01T19:42:46.064 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4add89d7:::benchmark_data_smithi188_119427_object97422:head# 2024-04-01T19:42:46.064 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4adec8ee:::benchmark_data_smithi188_119427_object122298:head# 2024-04-01T19:42:46.064 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4adf1f80:::benchmark_data_smithi188_119427_object136833:head# 2024-04-01T19:42:46.064 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4adf8a5a:::benchmark_data_smithi188_119427_object154897:head# 2024-04-01T19:42:46.064 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ae09480:::benchmark_data_smithi188_119427_object109003:head# 2024-04-01T19:42:46.064 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ae152e9:::benchmark_data_smithi188_119427_object74705:head# 2024-04-01T19:42:46.064 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ae253ef:::benchmark_data_smithi188_119427_object112557:head# 2024-04-01T19:42:46.064 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ae28aa6:::benchmark_data_smithi188_119427_object112598:head# 2024-04-01T19:42:46.065 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ae2dbf3:::benchmark_data_smithi188_119427_object131370:head# 2024-04-01T19:42:46.065 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ae38c3a:::benchmark_data_smithi188_119427_object128762:head# 2024-04-01T19:42:46.065 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ae39342:::benchmark_data_smithi188_119427_object104421:head# 2024-04-01T19:42:46.065 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ae41c2c:::benchmark_data_smithi188_119427_object114645:head# 2024-04-01T19:42:46.066 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ae487c8:::benchmark_data_smithi188_119427_object116924:head# 2024-04-01T19:42:46.066 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ae54223:::benchmark_data_smithi188_119427_object92010:head# 2024-04-01T19:42:46.066 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ae5e520:::benchmark_data_smithi188_119427_object138195:head# 2024-04-01T19:42:46.067 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ae6bd70:::benchmark_data_smithi188_119427_object92391:head# 2024-04-01T19:42:46.067 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ae6c548:::benchmark_data_smithi188_119427_object106919:head# 2024-04-01T19:42:46.068 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ae7854d:::benchmark_data_smithi188_119427_object79388:head# 2024-04-01T19:42:46.068 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ae7c795:::benchmark_data_smithi188_119427_object121740:head# 2024-04-01T19:42:46.069 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ae8a6b7:::benchmark_data_smithi188_119427_object102160:head# 2024-04-01T19:42:46.069 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aea34eb:::benchmark_data_smithi188_119427_object74820:head# 2024-04-01T19:42:46.069 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aea4aac:::benchmark_data_smithi188_119427_object139966:head# 2024-04-01T19:42:46.070 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aebb51f:::benchmark_data_smithi188_119427_object86617:head# 2024-04-01T19:42:46.070 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aed28a0:::benchmark_data_smithi188_119427_object101642:head# 2024-04-01T19:42:46.071 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aed47e2:::benchmark_data_smithi188_119427_object143046:head# 2024-04-01T19:42:46.071 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aeed853:::benchmark_data_smithi188_119427_object109157:head# 2024-04-01T19:42:46.072 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4aef3242:::benchmark_data_smithi188_119427_object150144:head# 2024-04-01T19:42:46.072 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4af01128:::benchmark_data_smithi188_119427_object85792:head# 2024-04-01T19:42:46.072 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4af014f6:::benchmark_data_smithi188_119427_object147249:head# 2024-04-01T19:42:46.073 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4af0957f:::benchmark_data_smithi188_119427_object133564:head# 2024-04-01T19:42:46.073 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4af2355c:::benchmark_data_smithi188_119427_object76724:head# 2024-04-01T19:42:46.074 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4af24af1:::benchmark_data_smithi188_119427_object79732:head# 2024-04-01T19:42:46.074 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4af61c55:::benchmark_data_smithi188_119427_object75648:head# 2024-04-01T19:42:46.075 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4af809c3:::benchmark_data_smithi188_119427_object112943:head# 2024-04-01T19:42:46.075 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4af8bc24:::benchmark_data_smithi188_119427_object96771:head# 2024-04-01T19:42:46.076 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4af94180:::benchmark_data_smithi188_119427_object81176:head# 2024-04-01T19:42:46.076 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4afac59a:::benchmark_data_smithi188_119427_object125710:head# 2024-04-01T19:42:46.077 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4afad4e4:::benchmark_data_smithi188_119427_object74151:head# 2024-04-01T19:42:46.077 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4afcc584:::benchmark_data_smithi188_119427_object145617:head# 2024-04-01T19:42:46.078 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4afd051c:::benchmark_data_smithi188_119427_object93203:head# 2024-04-01T19:42:46.078 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4afd9aa2:::benchmark_data_smithi188_119427_object73338:head# 2024-04-01T19:42:46.079 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4afe41b1:::benchmark_data_smithi188_119427_object121494:head# 2024-04-01T19:42:46.079 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4afe8520:::benchmark_data_smithi188_119427_object150908:head# 2024-04-01T19:42:46.079 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4afecd13:::benchmark_data_smithi188_119427_object73752:head# 2024-04-01T19:42:46.080 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b00290f:::benchmark_data_smithi188_119427_object93098:head# 2024-04-01T19:42:46.080 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b00d03d:::benchmark_data_smithi188_119427_object136347:head# 2024-04-01T19:42:46.081 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b02025a:::benchmark_data_smithi188_119427_object78921:head# 2024-04-01T19:42:46.081 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b023f0b:::benchmark_data_smithi188_119427_object111753:head# 2024-04-01T19:42:46.082 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b0247f6:::benchmark_data_smithi188_119427_object158520:head# 2024-04-01T19:42:46.082 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b02db11:::benchmark_data_smithi188_119427_object109513:head# 2024-04-01T19:42:46.082 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b035106:::benchmark_data_smithi188_119427_object133922:head# 2024-04-01T19:42:46.083 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b047423:::benchmark_data_smithi188_119427_object145819:head# 2024-04-01T19:42:46.083 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b04c4ae:::benchmark_data_smithi188_119427_object153025:head# 2024-04-01T19:42:46.084 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b05d4cb:::benchmark_data_smithi188_119427_object152931:head# 2024-04-01T19:42:46.084 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b05ddbf:::benchmark_data_smithi188_119427_object83346:head# 2024-04-01T19:42:46.085 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b06686e:::benchmark_data_smithi188_119427_object78062:head# 2024-04-01T19:42:46.085 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b06c5a5:::benchmark_data_smithi188_119427_object114931:head# 2024-04-01T19:42:46.086 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b0707d9:::benchmark_data_smithi188_119427_object132148:head# 2024-04-01T19:42:46.086 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b078ef0:::benchmark_data_smithi188_119427_object141664:head# 2024-04-01T19:42:46.087 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b07abd7:::benchmark_data_smithi188_119427_object108091:head# 2024-04-01T19:42:46.087 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b089b35:::benchmark_data_smithi188_119427_object128249:head# 2024-04-01T19:42:46.088 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b08cdbc:::benchmark_data_smithi188_119427_object127028:head# 2024-04-01T19:42:46.088 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b08d321:::benchmark_data_smithi188_119427_object134873:head# 2024-04-01T19:42:46.089 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b08f54e:::benchmark_data_smithi188_119427_object133647:head# 2024-04-01T19:42:46.089 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b09b47c:::benchmark_data_smithi188_119427_object74624:head# 2024-04-01T19:42:46.090 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b0a5c65:::benchmark_data_smithi188_119427_object100610:head# 2024-04-01T19:42:46.090 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b0a7aeb:::benchmark_data_smithi188_119427_object102026:head# 2024-04-01T19:42:46.090 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b0adcf0:::benchmark_data_smithi188_119427_object132035:head# 2024-04-01T19:42:46.091 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b0b7071:::benchmark_data_smithi188_119427_object154457:head# 2024-04-01T19:42:46.091 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b0b9ee8:::benchmark_data_smithi188_119427_object141577:head# 2024-04-01T19:42:46.092 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b0cb771:::benchmark_data_smithi188_119427_object89326:head# 2024-04-01T19:42:46.092 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b0d1d48:::benchmark_data_smithi188_119427_object128635:head# 2024-04-01T19:42:46.093 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b0d3115:::benchmark_data_smithi188_119427_object161166:head# 2024-04-01T19:42:46.093 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b0d39ac:::benchmark_data_smithi188_119427_object162008:head# 2024-04-01T19:42:46.094 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b0d690f:::benchmark_data_smithi188_119427_object157102:head# 2024-04-01T19:42:46.094 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b0d72aa:::benchmark_data_smithi188_119427_object136620:head# 2024-04-01T19:42:46.095 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b0e5048:::benchmark_data_smithi188_119427_object115484:head# 2024-04-01T19:42:46.095 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b0e521a:::benchmark_data_smithi188_119427_object126000:head# 2024-04-01T19:42:46.096 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b10e49d:::benchmark_data_smithi188_119427_object85245:head# 2024-04-01T19:42:46.096 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b1111d9:::benchmark_data_smithi188_119427_object156515:head# 2024-04-01T19:42:46.097 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b12c7fb:::benchmark_data_smithi188_119427_object76696:head# 2024-04-01T19:42:46.097 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b12d116:::benchmark_data_smithi188_119427_object129048:head# 2024-04-01T19:42:46.097 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b13d0d7:::benchmark_data_smithi188_119427_object116681:head# 2024-04-01T19:42:46.098 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b144d3a:::benchmark_data_smithi188_119427_object106046:head# 2024-04-01T19:42:46.098 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b149a97:::benchmark_data_smithi188_119427_object97829:head# 2024-04-01T19:42:46.099 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b152de1:::benchmark_data_smithi188_119427_object148348:head# 2024-04-01T19:42:46.099 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b1544c9:::benchmark_data_smithi188_119427_object103675:head# 2024-04-01T19:42:46.099 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b15a3b2:::benchmark_data_smithi188_119427_object114054:head# 2024-04-01T19:42:46.100 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b1692aa:::benchmark_data_smithi188_119427_object82606:head# 2024-04-01T19:42:46.100 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b16aba6:::benchmark_data_smithi188_119427_object161573:head# 2024-04-01T19:42:46.101 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b17a8da:::benchmark_data_smithi188_119427_object147616:head# 2024-04-01T19:42:46.101 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b196ddb:::benchmark_data_smithi188_119427_object122857:head# 2024-04-01T19:42:46.102 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b197e04:::benchmark_data_smithi188_119427_object106923:head# 2024-04-01T19:42:46.102 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b1a648d:::benchmark_data_smithi188_119427_object135098:head# 2024-04-01T19:42:46.103 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b1a7c63:::benchmark_data_smithi188_119427_object138161:head# 2024-04-01T19:42:46.103 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b1a8e5e:::benchmark_data_smithi188_119427_object140512:head# 2024-04-01T19:42:46.104 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b1abd48:::benchmark_data_smithi188_119427_object98873:head# 2024-04-01T19:42:46.104 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b1b5f42:::benchmark_data_smithi188_119427_object91868:head# 2024-04-01T19:42:46.104 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b1bc69e:::benchmark_data_smithi188_119427_object131854:head# 2024-04-01T19:42:46.105 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b1bc871:::benchmark_data_smithi188_119427_object137395:head# 2024-04-01T19:42:46.105 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b1da260:::benchmark_data_smithi188_119427_object91791:head# 2024-04-01T19:42:46.106 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b1df443:::benchmark_data_smithi188_119427_object143013:head# 2024-04-01T19:42:46.106 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b1e2986:::benchmark_data_smithi188_119427_object150347:head# 2024-04-01T19:42:46.107 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b1ec995:::benchmark_data_smithi188_119427_object93212:head# 2024-04-01T19:42:46.107 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b1f6ed3:::benchmark_data_smithi188_119427_object127088:head# 2024-04-01T19:42:46.108 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b208e95:::benchmark_data_smithi188_119427_object151124:head# 2024-04-01T19:42:46.108 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b234063:::benchmark_data_smithi188_119427_object143110:head# 2024-04-01T19:42:46.108 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b238a87:::benchmark_data_smithi188_119427_object151149:head# 2024-04-01T19:42:46.109 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b2549b9:::benchmark_data_smithi188_119427_object120941:head# 2024-04-01T19:42:46.109 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b26a3ab:::benchmark_data_smithi188_119427_object150358:head# 2024-04-01T19:42:46.110 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b2728fa:::benchmark_data_smithi188_119427_object84830:head# 2024-04-01T19:42:46.110 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b272be3:::benchmark_data_smithi188_119427_object132612:head# 2024-04-01T19:42:46.111 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b27daf9:::benchmark_data_smithi188_119427_object124288:head# 2024-04-01T19:42:46.111 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b29304f:::benchmark_data_smithi188_119427_object155716:head# 2024-04-01T19:42:46.111 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b2a39df:::benchmark_data_smithi188_119427_object108707:head# 2024-04-01T19:42:46.112 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b2ae45e:::benchmark_data_smithi188_119427_object72958:head# 2024-04-01T19:42:46.112 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b2bc4f7:::benchmark_data_smithi188_119427_object158902:head# 2024-04-01T19:42:46.113 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b2c0168:::benchmark_data_smithi188_119427_object118174:head# 2024-04-01T19:42:46.113 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b2ddf80:::benchmark_data_smithi188_119427_object100272:head# 2024-04-01T19:42:46.113 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b2de21a:::benchmark_data_smithi188_119427_object124000:head# 2024-04-01T19:42:46.114 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b2e12cf:::benchmark_data_smithi188_119427_object130563:head# 2024-04-01T19:42:46.114 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b2f0218:::benchmark_data_smithi188_119427_object120632:head# 2024-04-01T19:42:46.115 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b2ffe1b:::benchmark_data_smithi188_119427_object131594:head# 2024-04-01T19:42:46.115 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b301f3a:::benchmark_data_smithi188_119427_object98577:head# 2024-04-01T19:42:46.115 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b3043d5:::benchmark_data_smithi188_119427_object151748:head# 2024-04-01T19:42:46.116 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b30957a:::benchmark_data_smithi188_119427_object118126:head# 2024-04-01T19:42:46.116 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b3293f1:::benchmark_data_smithi188_119427_object79899:head# 2024-04-01T19:42:46.116 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b338e52:::benchmark_data_smithi188_119427_object72840:head# 2024-04-01T19:42:46.117 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b33ad2d:::benchmark_data_smithi188_119427_object90584:head# 2024-04-01T19:42:46.117 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b3463b9:::benchmark_data_smithi188_119427_object74227:head# 2024-04-01T19:42:46.118 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b34ff02:::benchmark_data_smithi188_119427_object94633:head# 2024-04-01T19:42:46.118 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b3574a3:::benchmark_data_smithi188_119427_object104292:head# 2024-04-01T19:42:46.118 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b369c80:::benchmark_data_smithi188_119427_object107624:head# 2024-04-01T19:42:46.119 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b378830:::benchmark_data_smithi188_119427_object163860:head# 2024-04-01T19:42:46.119 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b37fa3a:::benchmark_data_smithi188_119427_object127089:head# 2024-04-01T19:42:46.120 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b382161:::benchmark_data_smithi188_119427_object126938:head# 2024-04-01T19:42:46.120 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b38fdd4:::benchmark_data_smithi188_119427_object79100:head# 2024-04-01T19:42:46.120 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b394c0c:::benchmark_data_smithi188_119427_object87092:head# 2024-04-01T19:42:46.121 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b3a1239:::benchmark_data_smithi188_119427_object101345:head# 2024-04-01T19:42:46.121 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b3af7ee:::benchmark_data_smithi188_119427_object81528:head# 2024-04-01T19:42:46.122 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b3ba53a:::benchmark_data_smithi188_119427_object86222:head# 2024-04-01T19:42:46.122 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b3c8370:::benchmark_data_smithi188_119427_object147723:head# 2024-04-01T19:42:46.122 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b3c8f55:::benchmark_data_smithi188_119427_object87948:head# 2024-04-01T19:42:46.123 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b3d3232:::benchmark_data_smithi188_119427_object96019:head# 2024-04-01T19:42:46.123 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b3e9718:::benchmark_data_smithi188_119427_object117504:head# 2024-04-01T19:42:46.124 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b3fc034:::benchmark_data_smithi188_119427_object148391:head# 2024-04-01T19:42:46.124 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b405d5b:::benchmark_data_smithi188_119427_object99578:head# 2024-04-01T19:42:46.125 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b409555:::benchmark_data_smithi188_119427_object91571:head# 2024-04-01T19:42:46.125 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b4162fe:::benchmark_data_smithi188_119427_object105021:head# 2024-04-01T19:42:46.126 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b42ec7e:::benchmark_data_smithi188_119427_object139196:head# 2024-04-01T19:42:46.126 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b437cbc:::benchmark_data_smithi188_119427_object142993:head# 2024-04-01T19:42:46.126 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b443633:::benchmark_data_smithi188_119427_object95527:head# 2024-04-01T19:42:46.127 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b4460e3:::benchmark_data_smithi188_119427_object114643:head# 2024-04-01T19:42:46.127 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b44ac92:::benchmark_data_smithi188_119427_object103859:head# 2024-04-01T19:42:46.128 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b44b2cd:::benchmark_data_smithi188_119427_object109379:head# 2024-04-01T19:42:46.128 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b44bcd8:::benchmark_data_smithi188_119427_object146145:head# 2024-04-01T19:42:46.128 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b451fbb:::benchmark_data_smithi188_119427_object89047:head# 2024-04-01T19:42:46.129 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b45356d:::benchmark_data_smithi188_119427_object91698:head# 2024-04-01T19:42:46.129 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b466f8b:::benchmark_data_smithi188_119427_object73914:head# 2024-04-01T19:42:46.130 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b469edc:::benchmark_data_smithi188_119427_object84484:head# 2024-04-01T19:42:46.130 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b471da3:::benchmark_data_smithi188_119427_object131773:head# 2024-04-01T19:42:46.130 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b480fe4:::benchmark_data_smithi188_119427_object141728:head# 2024-04-01T19:42:46.131 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b49dda2:::benchmark_data_smithi188_119427_object84214:head# 2024-04-01T19:42:46.131 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b4a3d2b:::benchmark_data_smithi188_119427_object101833:head# 2024-04-01T19:42:46.132 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b4a79d1:::benchmark_data_smithi188_119427_object75117:head# 2024-04-01T19:42:46.133 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b4bab24:::benchmark_data_smithi188_119427_object118503:head# 2024-04-01T19:42:46.133 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b4cb9cf:::benchmark_data_smithi188_119427_object78145:head# 2024-04-01T19:42:46.133 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b4d0f44:::benchmark_data_smithi188_119427_object101034:head# 2024-04-01T19:42:46.133 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b4d7b56:::benchmark_data_smithi188_119427_object80340:head# 2024-04-01T19:42:46.134 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b4e92e5:::benchmark_data_smithi188_119427_object129555:head# 2024-04-01T19:42:46.134 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b4f0f2f:::benchmark_data_smithi188_119427_object77542:head# 2024-04-01T19:42:46.135 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b4f397f:::benchmark_data_smithi188_119427_object80693:head# 2024-04-01T19:42:46.135 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b507562:::benchmark_data_smithi188_119427_object75710:head# 2024-04-01T19:42:46.136 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b50837a:::benchmark_data_smithi188_119427_object108978:head# 2024-04-01T19:42:46.136 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b50dbbc:::benchmark_data_smithi188_119427_object162118:head# 2024-04-01T19:42:46.136 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b512e6d:::benchmark_data_smithi188_119427_object126391:head# 2024-04-01T19:42:46.137 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b528286:::benchmark_data_smithi188_119427_object154337:head# 2024-04-01T19:42:46.137 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b52b09b:::benchmark_data_smithi188_119427_object81464:head# 2024-04-01T19:42:46.138 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b537eea:::benchmark_data_smithi188_119427_object107415:head# 2024-04-01T19:42:46.138 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b53a6cf:::benchmark_data_smithi188_119427_object161900:head# 2024-04-01T19:42:46.138 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b5424e8:::benchmark_data_smithi188_119427_object121970:head# 2024-04-01T19:42:46.139 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b5557bf:::benchmark_data_smithi188_119427_object98042:head# 2024-04-01T19:42:46.139 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b568f01:::benchmark_data_smithi188_119427_object103995:head# 2024-04-01T19:42:46.140 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b569282:::benchmark_data_smithi188_119427_object116801:head# 2024-04-01T19:42:46.140 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b56e4d2:::benchmark_data_smithi188_119427_object159277:head# 2024-04-01T19:42:46.141 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b5784e1:::benchmark_data_smithi188_119427_object92009:head# 2024-04-01T19:42:46.141 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b58071a:::benchmark_data_smithi188_119427_object103138:head# 2024-04-01T19:42:46.141 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b58e15f:::benchmark_data_smithi188_119427_object122944:head# 2024-04-01T19:42:46.142 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b59aaad:::benchmark_data_smithi188_119427_object149454:head# 2024-04-01T19:42:46.142 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b59bf4d:::benchmark_data_smithi188_119427_object113611:head# 2024-04-01T19:42:46.143 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b59dc49:::benchmark_data_smithi188_119427_object91601:head# 2024-04-01T19:42:46.143 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b5a49bb:::benchmark_data_smithi188_119427_object88750:head# 2024-04-01T19:42:46.143 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b5a9bf6:::benchmark_data_smithi188_119427_object90983:head# 2024-04-01T19:42:46.144 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b5a9c94:::benchmark_data_smithi188_119427_object74153:head# 2024-04-01T19:42:46.144 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b5ab02c:::benchmark_data_smithi188_119427_object136977:head# 2024-04-01T19:42:46.144 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b5af640:::benchmark_data_smithi188_119427_object133616:head# 2024-04-01T19:42:46.145 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b5b7f18:::benchmark_data_smithi188_119427_object128646:head# 2024-04-01T19:42:46.145 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b5bffe3:::benchmark_data_smithi188_119427_object92308:head# 2024-04-01T19:42:46.146 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b5ca695:::benchmark_data_smithi188_119427_object92920:head# 2024-04-01T19:42:46.146 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b5cf7d5:::benchmark_data_smithi188_119427_object110005:head# 2024-04-01T19:42:46.147 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b5dc3c2:::benchmark_data_smithi188_119427_object138942:head# 2024-04-01T19:42:46.147 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b5ed36c:::benchmark_data_smithi188_119427_object141593:head# 2024-04-01T19:42:46.147 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b60a073:::benchmark_data_smithi188_119427_object78280:head# 2024-04-01T19:42:46.148 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b61839f:::benchmark_data_smithi188_119427_object84628:head# 2024-04-01T19:42:46.148 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b61aaa7:::benchmark_data_smithi188_119427_object128047:head# 2024-04-01T19:42:46.149 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b6235bf:::benchmark_data_smithi188_119427_object132058:head# 2024-04-01T19:42:46.149 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b62367f:::benchmark_data_smithi188_119427_object74338:head# 2024-04-01T19:42:46.150 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b64f059:::benchmark_data_smithi188_119427_object158630:head# 2024-04-01T19:42:46.150 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b64ffe1:::benchmark_data_smithi188_119427_object100288:head# 2024-04-01T19:42:46.150 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b65e540:::benchmark_data_smithi188_119427_object87363:head# 2024-04-01T19:42:46.151 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b67e1b2:::benchmark_data_smithi188_119427_object158513:head# 2024-04-01T19:42:46.151 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b681d75:::benchmark_data_smithi188_119427_object72748:head# 2024-04-01T19:42:46.152 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b68478e:::benchmark_data_smithi188_119427_object132776:head# 2024-04-01T19:42:46.152 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b688cac:::benchmark_data_smithi188_119427_object96377:head# 2024-04-01T19:42:46.153 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b690530:::benchmark_data_smithi188_119427_object103717:head# 2024-04-01T19:42:46.153 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b6a0487:::benchmark_data_smithi188_119427_object146548:head# 2024-04-01T19:42:46.153 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b6a7fbb:::benchmark_data_smithi188_119427_object106113:head# 2024-04-01T19:42:46.154 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b6ad0ce:::benchmark_data_smithi188_119427_object132995:head# 2024-04-01T19:42:46.154 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b6c9b2e:::benchmark_data_smithi188_119427_object97970:head# 2024-04-01T19:42:46.155 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b6d036c:::benchmark_data_smithi188_119427_object125503:head# 2024-04-01T19:42:46.155 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b6d04af:::benchmark_data_smithi188_119427_object162509:head# 2024-04-01T19:42:46.155 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b6d0ef2:::benchmark_data_smithi188_119427_object147645:head# 2024-04-01T19:42:46.157 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b6db78b:::benchmark_data_smithi188_119427_object76665:head# 2024-04-01T19:42:46.157 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b6e4108:::benchmark_data_smithi188_119427_object124939:head# 2024-04-01T19:42:46.157 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b6ef63d:::benchmark_data_smithi188_119427_object135680:head# 2024-04-01T19:42:46.157 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b6fa496:::benchmark_data_smithi188_119427_object107983:head# 2024-04-01T19:42:46.158 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b6fceaa:::benchmark_data_smithi188_119427_object125471:head# 2024-04-01T19:42:46.158 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b7082ba:::benchmark_data_smithi188_119427_object102656:head# 2024-04-01T19:42:46.158 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b70f900:::benchmark_data_smithi188_119427_object158263:head# 2024-04-01T19:42:46.159 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b71ab30:::benchmark_data_smithi188_119427_object113790:head# 2024-04-01T19:42:46.159 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b72d4a8:::benchmark_data_smithi188_119427_object151380:head# 2024-04-01T19:42:46.160 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b72e7d4:::benchmark_data_smithi188_119427_object127396:head# 2024-04-01T19:42:46.160 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b736585:::benchmark_data_smithi188_119427_object89416:head# 2024-04-01T19:42:46.160 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b744403:::benchmark_data_smithi188_119427_object156033:head# 2024-04-01T19:42:46.161 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b746a79:::benchmark_data_smithi188_119427_object138038:head# 2024-04-01T19:42:46.161 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b74b99b:::benchmark_data_smithi188_119427_object79259:head# 2024-04-01T19:42:46.162 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b75d90b:::benchmark_data_smithi188_119427_object80927:head# 2024-04-01T19:42:46.162 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b768a88:::benchmark_data_smithi188_119427_object147956:head# 2024-04-01T19:42:46.162 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b768fd7:::benchmark_data_smithi188_119427_object92610:head# 2024-04-01T19:42:46.163 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b77314a:::benchmark_data_smithi188_119427_object91269:head# 2024-04-01T19:42:46.163 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b78995a:::benchmark_data_smithi188_119427_object160195:head# 2024-04-01T19:42:46.164 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b78acb9:::benchmark_data_smithi188_119427_object135421:head# 2024-04-01T19:42:46.165 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b78fd2a:::benchmark_data_smithi188_119427_object111801:head# 2024-04-01T19:42:46.165 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b791621:::benchmark_data_smithi188_119427_object85014:head# 2024-04-01T19:42:46.165 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b796665:::benchmark_data_smithi188_119427_object153010:head# 2024-04-01T19:42:46.165 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b79be2f:::benchmark_data_smithi188_119427_object142179:head# 2024-04-01T19:42:46.166 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b7b15c8:::benchmark_data_smithi188_119427_object161955:head# 2024-04-01T19:42:46.166 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b7b47d5:::benchmark_data_smithi188_119427_object149419:head# 2024-04-01T19:42:46.167 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b7bce49:::benchmark_data_smithi188_119427_object106148:head# 2024-04-01T19:42:46.167 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b7be258:::benchmark_data_smithi188_119427_object140869:head# 2024-04-01T19:42:46.167 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b7bf46d:::benchmark_data_smithi188_119427_object151855:head# 2024-04-01T19:42:46.168 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b7d68ea:::benchmark_data_smithi188_119427_object110736:head# 2024-04-01T19:42:46.168 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b7db7b1:::benchmark_data_smithi188_119427_object145665:head# 2024-04-01T19:42:46.169 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b7e7b16:::benchmark_data_smithi188_119427_object118299:head# 2024-04-01T19:42:46.170 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b7f36ee:::benchmark_data_smithi188_119427_object102185:head# 2024-04-01T19:42:46.171 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b7fa4f0:::benchmark_data_smithi188_119427_object93147:head# 2024-04-01T19:42:46.171 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b8082b0:::benchmark_data_smithi188_119427_object121705:head# 2024-04-01T19:42:46.172 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b830941:::benchmark_data_smithi188_119427_object96584:head# 2024-04-01T19:42:46.172 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b841e6f:::benchmark_data_smithi188_119427_object114061:head# 2024-04-01T19:42:46.173 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b84a9a6:::benchmark_data_smithi188_119427_object106831:head# 2024-04-01T19:42:46.173 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b84c365:::benchmark_data_smithi188_119427_object124150:head# 2024-04-01T19:42:46.174 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b853ef1:::benchmark_data_smithi188_119427_object72731:head# 2024-04-01T19:42:46.180 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b8a7c3d:::benchmark_data_smithi188_119427_object161084:head# 2024-04-01T19:42:46.180 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b8bf2e2:::benchmark_data_smithi188_119427_object83947:head# 2024-04-01T19:42:46.180 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b8c6c21:::benchmark_data_smithi188_119427_object121532:head# 2024-04-01T19:42:46.180 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b8e5774:::benchmark_data_smithi188_119427_object117807:head# 2024-04-01T19:42:46.180 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b906a8e:::benchmark_data_smithi188_119427_object156945:head# 2024-04-01T19:42:46.180 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b914fef:::benchmark_data_smithi188_119427_object78607:head# 2024-04-01T19:42:46.180 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b917af0:::benchmark_data_smithi188_119427_object90051:head# 2024-04-01T19:42:46.180 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b922574:::benchmark_data_smithi188_119427_object102452:head# 2024-04-01T19:42:46.180 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b94b293:::benchmark_data_smithi188_119427_object102333:head# 2024-04-01T19:42:46.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b94bcc6:::benchmark_data_smithi188_119427_object82766:head# 2024-04-01T19:42:46.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b94c9de:::benchmark_data_smithi188_119427_object136676:head# 2024-04-01T19:42:46.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b95e77d:::benchmark_data_smithi188_119427_object99741:head# 2024-04-01T19:42:46.181 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b95ea3f:::benchmark_data_smithi188_119427_object86616:head# 2024-04-01T19:42:46.182 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b965724:::benchmark_data_smithi188_119427_object136882:head# 2024-04-01T19:42:46.182 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b96612e:::benchmark_data_smithi188_119427_object134293:head# 2024-04-01T19:42:46.182 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b976699:::benchmark_data_smithi188_119427_object142511:head# 2024-04-01T19:42:46.183 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b982418:::benchmark_data_smithi188_119427_object92708:head# 2024-04-01T19:42:46.183 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b991812:::benchmark_data_smithi188_119427_object141760:head# 2024-04-01T19:42:46.184 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b992b9f:::benchmark_data_smithi188_119427_object139061:head# 2024-04-01T19:42:46.184 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b9996e7:::benchmark_data_smithi188_119427_object154849:head# 2024-04-01T19:42:46.185 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b9aadb4:::benchmark_data_smithi188_119427_object81985:head# 2024-04-01T19:42:46.185 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b9c04ce:::benchmark_data_smithi188_119427_object146580:head# 2024-04-01T19:42:46.185 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b9c055a:::benchmark_data_smithi188_119427_object113329:head# 2024-04-01T19:42:46.186 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b9c10cf:::benchmark_data_smithi188_119427_object80964:head# 2024-04-01T19:42:46.186 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b9c892f:::benchmark_data_smithi188_119427_object101103:head# 2024-04-01T19:42:46.187 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b9cb266:::benchmark_data_smithi188_119427_object90560:head# 2024-04-01T19:42:46.187 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b9e05e4:::benchmark_data_smithi188_119427_object91020:head# 2024-04-01T19:42:46.188 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b9e560b:::benchmark_data_smithi188_119427_object150099:head# 2024-04-01T19:42:46.188 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b9f217d:::benchmark_data_smithi188_119427_object78892:head# 2024-04-01T19:42:46.189 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4b9f8eae:::benchmark_data_smithi188_119427_object89419:head# 2024-04-01T19:42:46.189 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ba08b77:::benchmark_data_smithi188_119427_object124740:head# 2024-04-01T19:42:46.189 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ba10b9a:::benchmark_data_smithi188_119427_object146539:head# 2024-04-01T19:42:46.190 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ba20af7:::benchmark_data_smithi188_119427_object95611:head# 2024-04-01T19:42:46.190 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ba37218:::benchmark_data_smithi188_119427_object148589:head# 2024-04-01T19:42:46.191 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ba3ceca:::benchmark_data_smithi188_119427_object86123:head# 2024-04-01T19:42:46.192 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ba4b6a1:::benchmark_data_smithi188_119427_object161370:head# 2024-04-01T19:42:46.192 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ba4b9c1:::benchmark_data_smithi188_119427_object88758:head# 2024-04-01T19:42:46.192 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ba4f986:::benchmark_data_smithi188_119427_object98906:head# 2024-04-01T19:42:46.193 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ba600db:::benchmark_data_smithi188_119427_object92405:head# 2024-04-01T19:42:46.193 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ba622db:::benchmark_data_smithi188_119427_object92728:head# 2024-04-01T19:42:46.194 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ba90161:::benchmark_data_smithi188_119427_object85108:head# 2024-04-01T19:42:46.194 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4baabe1c:::benchmark_data_smithi188_119427_object162172:head# 2024-04-01T19:42:46.195 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4baaf44d:::benchmark_data_smithi188_119427_object148736:head# 2024-04-01T19:42:46.195 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bab239f:::benchmark_data_smithi188_119427_object106084:head# 2024-04-01T19:42:46.196 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bad26cd:::benchmark_data_smithi188_119427_object135350:head# 2024-04-01T19:42:46.196 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bae1c93:::benchmark_data_smithi188_119427_object100333:head# 2024-04-01T19:42:46.197 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bae523e:::benchmark_data_smithi188_119427_object159423:head# 2024-04-01T19:42:46.197 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bae56f3:::benchmark_data_smithi188_119427_object152042:head# 2024-04-01T19:42:46.198 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bae8964:::benchmark_data_smithi188_119427_object118407:head# 2024-04-01T19:42:46.198 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4baea781:::benchmark_data_smithi188_119427_object142901:head# 2024-04-01T19:42:46.198 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4baf5ab6:::benchmark_data_smithi188_119427_object76924:head# 2024-04-01T19:42:46.198 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bb006eb:::benchmark_data_smithi188_119427_object80875:head# 2024-04-01T19:42:46.199 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bb03d81:::benchmark_data_smithi188_119427_object92107:head# 2024-04-01T19:42:46.199 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bb26022:::benchmark_data_smithi188_119427_object102134:head# 2024-04-01T19:42:46.200 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bb28f5c:::benchmark_data_smithi188_119427_object121736:head# 2024-04-01T19:42:46.200 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bb418ab:::benchmark_data_smithi188_119427_object138979:head# 2024-04-01T19:42:46.200 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bb4682e:::benchmark_data_smithi188_119427_object147504:head# 2024-04-01T19:42:46.201 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bb47822:::benchmark_data_smithi188_119427_object101329:head# 2024-04-01T19:42:46.201 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bb69d9a:::benchmark_data_smithi188_119427_object145396:head# 2024-04-01T19:42:46.201 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bb76c35:::benchmark_data_smithi188_119427_object104661:head# 2024-04-01T19:42:46.202 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bb81f4f:::benchmark_data_smithi188_119427_object117474:head# 2024-04-01T19:42:46.202 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bb9e9c7:::benchmark_data_smithi188_119427_object108430:head# 2024-04-01T19:42:46.203 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bbbee1f:::benchmark_data_smithi188_119427_object97031:head# 2024-04-01T19:42:46.203 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bbc56c8:::benchmark_data_smithi188_119427_object106249:head# 2024-04-01T19:42:46.204 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bbc74f7:::benchmark_data_smithi188_119427_object117013:head# 2024-04-01T19:42:46.204 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bbcdd56:::benchmark_data_smithi188_119427_object80198:head# 2024-04-01T19:42:46.204 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bbe6046:::benchmark_data_smithi188_119427_object103837:head# 2024-04-01T19:42:46.205 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bbe7bb3:::benchmark_data_smithi188_119427_object142962:head# 2024-04-01T19:42:46.205 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bbe93b7:::benchmark_data_smithi188_119427_object110068:head# 2024-04-01T19:42:46.206 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bbea8ec:::benchmark_data_smithi188_119427_object123990:head# 2024-04-01T19:42:46.206 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bbf7316:::benchmark_data_smithi188_119427_object143045:head# 2024-04-01T19:42:46.207 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bc02f20:::benchmark_data_smithi188_119427_object107949:head# 2024-04-01T19:42:46.207 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bc10f17:::benchmark_data_smithi188_119427_object129205:head# 2024-04-01T19:42:46.207 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bc1274b:::benchmark_data_smithi188_119427_object79484:head# 2024-04-01T19:42:46.207 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bc2e6ca:::benchmark_data_smithi188_119427_object141325:head# 2024-04-01T19:42:46.208 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bc30cdd:::benchmark_data_smithi188_119427_object96941:head# 2024-04-01T19:42:46.208 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bc351e8:::benchmark_data_smithi188_119427_object112231:head# 2024-04-01T19:42:46.209 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bc37769:::benchmark_data_smithi188_119427_object148906:head# 2024-04-01T19:42:46.209 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bc4c4ab:::benchmark_data_smithi188_119427_object143559:head# 2024-04-01T19:42:46.209 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bc5a533:::benchmark_data_smithi188_119427_object162353:head# 2024-04-01T19:42:46.210 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bc5b6f3:::benchmark_data_smithi188_119427_object152320:head# 2024-04-01T19:42:46.210 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bc6670d:::benchmark_data_smithi188_119427_object103732:head# 2024-04-01T19:42:46.211 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bc6997d:::benchmark_data_smithi188_119427_object155835:head# 2024-04-01T19:42:46.211 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bc6d01b:::benchmark_data_smithi188_119427_object159745:head# 2024-04-01T19:42:46.211 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bc7f363:::benchmark_data_smithi188_119427_object130648:head# 2024-04-01T19:42:46.212 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bc97120:::benchmark_data_smithi188_119427_object101402:head# 2024-04-01T19:42:46.212 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bcb10a9:::benchmark_data_smithi188_119427_object152618:head# 2024-04-01T19:42:46.213 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bcb619f:::benchmark_data_smithi188_119427_object90394:head# 2024-04-01T19:42:46.213 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bcc14fa:::benchmark_data_smithi188_119427_object113152:head# 2024-04-01T19:42:46.214 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bcd8535:::benchmark_data_smithi188_119427_object139157:head# 2024-04-01T19:42:46.214 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bcd8bc8:::benchmark_data_smithi188_119427_object155462:head# 2024-04-01T19:42:46.215 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bcd9156:::benchmark_data_smithi188_119427_object126257:head# 2024-04-01T19:42:46.215 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bcdd22b:::benchmark_data_smithi188_119427_object160625:head# 2024-04-01T19:42:46.216 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bce1d8e:::benchmark_data_smithi188_119427_object86147:head# 2024-04-01T19:42:46.217 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bcef85d:::benchmark_data_smithi188_119427_object156107:head# 2024-04-01T19:42:46.217 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bd0e5bd:::benchmark_data_smithi188_119427_object110581:head# 2024-04-01T19:42:46.217 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bd12209:::benchmark_data_smithi188_119427_object160974:head# 2024-04-01T19:42:46.218 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bd28b2c:::benchmark_data_smithi188_119427_object126551:head# 2024-04-01T19:42:46.218 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bd2ec3f:::benchmark_data_smithi188_119427_object152135:head# 2024-04-01T19:42:46.218 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bd32b1b:::benchmark_data_smithi188_119427_object118085:head# 2024-04-01T19:42:46.220 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bd40243:::benchmark_data_smithi188_119427_object72863:head# 2024-04-01T19:42:46.220 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bd40853:::benchmark_data_smithi188_119427_object137570:head# 2024-04-01T19:42:46.220 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bd4d6c5:::benchmark_data_smithi188_119427_object144397:head# 2024-04-01T19:42:46.220 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bd79fee:::benchmark_data_smithi188_119427_object81873:head# 2024-04-01T19:42:46.221 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bd87980:::benchmark_data_smithi188_119427_object126999:head# 2024-04-01T19:42:46.221 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bd9cdea:::benchmark_data_smithi188_119427_object128295:head# 2024-04-01T19:42:46.222 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bdac337:::benchmark_data_smithi188_119427_object108304:head# 2024-04-01T19:42:46.222 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bdacb06:::benchmark_data_smithi188_119427_object111752:head# 2024-04-01T19:42:46.222 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bdb7224:::benchmark_data_smithi188_119427_object78165:head# 2024-04-01T19:42:46.227 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bdd42d3:::benchmark_data_smithi188_119427_object102370:head# 2024-04-01T19:42:46.227 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bdf189b:::benchmark_data_smithi188_119427_object106485:head# 2024-04-01T19:42:46.227 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bdfbfe3:::benchmark_data_smithi188_119427_object113758:head# 2024-04-01T19:42:46.227 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4be07257:::benchmark_data_smithi188_119427_object129471:head# 2024-04-01T19:42:46.227 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4be25258:::benchmark_data_smithi188_119427_object117355:head# 2024-04-01T19:42:46.227 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4be53810:::benchmark_data_smithi188_119427_object139766:head# 2024-04-01T19:42:46.227 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4be6075f:::benchmark_data_smithi188_119427_object86479:head# 2024-04-01T19:42:46.228 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4be6650e:::benchmark_data_smithi188_119427_object125229:head# 2024-04-01T19:42:46.228 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4be66992:::benchmark_data_smithi188_119427_object160296:head# 2024-04-01T19:42:46.228 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4be790e8:::benchmark_data_smithi188_119427_object98583:head# 2024-04-01T19:42:46.228 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4be96795:::benchmark_data_smithi188_119427_object144992:head# 2024-04-01T19:42:46.228 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4be9a2e3:::benchmark_data_smithi188_119427_object87827:head# 2024-04-01T19:42:46.229 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4be9d42d:::benchmark_data_smithi188_119427_object147456:head# 2024-04-01T19:42:46.229 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4be9d974:::benchmark_data_smithi188_119427_object122656:head# 2024-04-01T19:42:46.229 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4beb3bb8:::benchmark_data_smithi188_119427_object119307:head# 2024-04-01T19:42:46.230 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bed25cc:::benchmark_data_smithi188_119427_object158638:head# 2024-04-01T19:42:46.231 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bed9932:::benchmark_data_smithi188_119427_object141879:head# 2024-04-01T19:42:46.231 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bedc62c:::benchmark_data_smithi188_119427_object109701:head# 2024-04-01T19:42:46.231 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bedf14d:::benchmark_data_smithi188_119427_object140265:head# 2024-04-01T19:42:46.232 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bee51ca:::benchmark_data_smithi188_119427_object82465:head# 2024-04-01T19:42:46.232 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bf092f4:::benchmark_data_smithi188_119427_object157881:head# 2024-04-01T19:42:46.232 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bf1a5d8:::benchmark_data_smithi188_119427_object94354:head# 2024-04-01T19:42:46.233 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bf28bf6:::benchmark_data_smithi188_119427_object75647:head# 2024-04-01T19:42:46.233 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bf28fdf:::benchmark_data_smithi188_119427_object130041:head# 2024-04-01T19:42:46.233 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bf2cd27:::benchmark_data_smithi188_119427_object161021:head# 2024-04-01T19:42:46.234 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bf2e7a7:::benchmark_data_smithi188_119427_object147077:head# 2024-04-01T19:42:46.234 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bf37595:::benchmark_data_smithi188_119427_object126662:head# 2024-04-01T19:42:46.235 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bf45c4e:::benchmark_data_smithi188_119427_object84982:head# 2024-04-01T19:42:46.235 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bf4bf56:::benchmark_data_smithi188_119427_object86371:head# 2024-04-01T19:42:46.236 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bf54bc2:::benchmark_data_smithi188_119427_object85691:head# 2024-04-01T19:42:46.236 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bf5afe5:::benchmark_data_smithi188_119427_object136633:head# 2024-04-01T19:42:46.237 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bf5ee40:::benchmark_data_smithi188_119427_object160641:head# 2024-04-01T19:42:46.238 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bf6e011:::benchmark_data_smithi188_119427_object157558:head# 2024-04-01T19:42:46.238 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bf7a28f:::benchmark_data_smithi188_119427_object75087:head# 2024-04-01T19:42:46.239 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bf7f227:::benchmark_data_smithi188_119427_object142770:head# 2024-04-01T19:42:46.239 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bf81b18:::benchmark_data_smithi188_119427_object119640:head# 2024-04-01T19:42:46.240 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bf9ac0b:::benchmark_data_smithi188_119427_object110757:head# 2024-04-01T19:42:46.240 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bf9f6c6:::benchmark_data_smithi188_119427_object101892:head# 2024-04-01T19:42:46.240 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bfa6915:::benchmark_data_smithi188_119427_object135709:head# 2024-04-01T19:42:46.241 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bfb1cf0:::benchmark_data_smithi188_119427_object126184:head# 2024-04-01T19:42:46.241 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bfc7d43:::benchmark_data_smithi188_119427_object95641:head# 2024-04-01T19:42:46.242 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4bfd351f:::benchmark_data_smithi188_119427_object116185:head# 2024-04-01T19:42:46.242 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c0037ef:::benchmark_data_smithi188_119427_object74992:head# 2024-04-01T19:42:46.242 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c01f093:::benchmark_data_smithi188_119427_object79849:head# 2024-04-01T19:42:46.243 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c02be1d:::benchmark_data_smithi188_119427_object157714:head# 2024-04-01T19:42:46.243 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c03635c:::benchmark_data_smithi188_119427_object122633:head# 2024-04-01T19:42:46.244 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c037478:::benchmark_data_smithi188_119427_object104925:head# 2024-04-01T19:42:46.244 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c045ddd:::benchmark_data_smithi188_119427_object85004:head# 2024-04-01T19:42:46.244 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c0500ed:::benchmark_data_smithi188_119427_object111798:head# 2024-04-01T19:42:46.245 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c0569fd:::benchmark_data_smithi188_119427_object124107:head# 2024-04-01T19:42:46.245 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c05d8f8:::benchmark_data_smithi188_119427_object143484:head# 2024-04-01T19:42:46.246 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c06642b:::benchmark_data_smithi188_119427_object151428:head# 2024-04-01T19:42:46.246 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c067ece:::benchmark_data_smithi188_119427_object163856:head# 2024-04-01T19:42:46.247 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c06a3a2:::benchmark_data_smithi188_119427_object80936:head# 2024-04-01T19:42:46.247 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c06ab42:::benchmark_data_smithi188_119427_object160068:head# 2024-04-01T19:42:46.247 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c078ca9:::benchmark_data_smithi188_119427_object91081:head# 2024-04-01T19:42:46.248 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c07ce4b:::benchmark_data_smithi188_119427_object123330:head# 2024-04-01T19:42:46.248 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c0828d1:::benchmark_data_smithi188_119427_object112472:head# 2024-04-01T19:42:46.249 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c08ee12:::benchmark_data_smithi188_119427_object126323:head# 2024-04-01T19:42:46.249 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c0b27a1:::benchmark_data_smithi188_119427_object86463:head# 2024-04-01T19:42:46.250 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c0b8d73:::benchmark_data_smithi188_119427_object81142:head# 2024-04-01T19:42:46.250 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c0bb7bd:::benchmark_data_smithi188_119427_object125448:head# 2024-04-01T19:42:46.251 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c0bc7f3:::benchmark_data_smithi188_119427_object104647:head# 2024-04-01T19:42:46.251 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c0d7ea7:::benchmark_data_smithi188_119427_object125777:head# 2024-04-01T19:42:46.251 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c0fde3e:::benchmark_data_smithi188_119427_object135014:head# 2024-04-01T19:42:46.252 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c10fa05:::benchmark_data_smithi188_119427_object93101:head# 2024-04-01T19:42:46.252 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c11f007:::benchmark_data_smithi188_119427_object77581:head# 2024-04-01T19:42:46.253 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c12a48c:::benchmark_data_smithi188_119427_object83879:head# 2024-04-01T19:42:46.253 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c12c7de:::benchmark_data_smithi188_119427_object122929:head# 2024-04-01T19:42:46.254 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c137fa8:::benchmark_data_smithi188_119427_object129632:head# 2024-04-01T19:42:46.255 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c143945:::benchmark_data_smithi188_119427_object84042:head# 2024-04-01T19:42:46.255 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c148d94:::benchmark_data_smithi188_119427_object74930:head# 2024-04-01T19:42:46.255 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c14ec36:::benchmark_data_smithi188_119427_object143514:head# 2024-04-01T19:42:46.256 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c150848:::benchmark_data_smithi188_119427_object101336:head# 2024-04-01T19:42:46.256 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c154a98:::benchmark_data_smithi188_119427_object98447:head# 2024-04-01T19:42:46.256 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c1566f2:::benchmark_data_smithi188_119427_object148734:head# 2024-04-01T19:42:46.257 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c1584a0:::benchmark_data_smithi188_119427_object164206:head# 2024-04-01T19:42:46.257 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c15b5c7:::benchmark_data_smithi188_119427_object74410:head# 2024-04-01T19:42:46.258 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c161bea:::benchmark_data_smithi188_119427_object115684:head# 2024-04-01T19:42:46.258 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c169fe9:::benchmark_data_smithi188_119427_object128933:head# 2024-04-01T19:42:46.259 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c16b6de:::benchmark_data_smithi188_119427_object140112:head# 2024-04-01T19:42:46.259 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c1721c8:::benchmark_data_smithi188_119427_object77437:head# 2024-04-01T19:42:46.261 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c17f161:::benchmark_data_smithi188_119427_object132576:head# 2024-04-01T19:42:46.261 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c18854e:::benchmark_data_smithi188_119427_object91208:head# 2024-04-01T19:42:46.261 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c18c345:::benchmark_data_smithi188_119427_object107722:head# 2024-04-01T19:42:46.261 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c19ebdc:::benchmark_data_smithi188_119427_object75671:head# 2024-04-01T19:42:46.262 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c1aaaa8:::benchmark_data_smithi188_119427_object138523:head# 2024-04-01T19:42:46.262 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c1cfabc:::benchmark_data_smithi188_119427_object150440:head# 2024-04-01T19:42:46.262 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c1d6d93:::benchmark_data_smithi188_119427_object109245:head# 2024-04-01T19:42:46.263 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c1f19d6:::benchmark_data_smithi188_119427_object133294:head# 2024-04-01T19:42:46.263 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c1fe9b5:::benchmark_data_smithi188_119427_object116694:head# 2024-04-01T19:42:46.264 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c1ffa7b:::benchmark_data_smithi188_119427_object83623:head# 2024-04-01T19:42:46.264 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c2131d2:::benchmark_data_smithi188_119427_object108178:head# 2024-04-01T19:42:46.265 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c221e18:::benchmark_data_smithi188_119427_object92216:head# 2024-04-01T19:42:46.265 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c22bc92:::benchmark_data_smithi188_119427_object115501:head# 2024-04-01T19:42:46.266 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c23ac23:::benchmark_data_smithi188_119427_object137622:head# 2024-04-01T19:42:46.266 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c2440e6:::benchmark_data_smithi188_119427_object96414:head# 2024-04-01T19:42:46.266 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c24708b:::benchmark_data_smithi188_119427_object146085:head# 2024-04-01T19:42:46.267 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c257da2:::benchmark_data_smithi188_119427_object129276:head# 2024-04-01T19:42:46.267 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c25e40d:::benchmark_data_smithi188_119427_object162179:head# 2024-04-01T19:42:46.267 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c26cb40:::benchmark_data_smithi188_119427_object100641:head# 2024-04-01T19:42:46.268 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c2735d4:::benchmark_data_smithi188_119427_object140430:head# 2024-04-01T19:42:46.269 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c274af4:::benchmark_data_smithi188_119427_object159131:head# 2024-04-01T19:42:46.269 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c291401:::benchmark_data_smithi188_119427_object132049:head# 2024-04-01T19:42:46.270 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c2988fe:::benchmark_data_smithi188_119427_object120480:head# 2024-04-01T19:42:46.270 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c2d7a3b:::benchmark_data_smithi188_119427_object149393:head# 2024-04-01T19:42:46.270 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c2d8aa4:::benchmark_data_smithi188_119427_object110544:head# 2024-04-01T19:42:46.271 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c2d8e9b:::benchmark_data_smithi188_119427_object89712:head# 2024-04-01T19:42:46.271 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c2dd503:::benchmark_data_smithi188_119427_object145870:head# 2024-04-01T19:42:46.272 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c2dda86:::benchmark_data_smithi188_119427_object97619:head# 2024-04-01T19:42:46.272 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c2ee844:::benchmark_data_smithi188_119427_object76024:head# 2024-04-01T19:42:46.272 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c307ce3:::benchmark_data_smithi188_119427_object143384:head# 2024-04-01T19:42:46.273 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c30d9c9:::benchmark_data_smithi188_119427_object86112:head# 2024-04-01T19:42:46.274 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c30e6ea:::benchmark_data_smithi188_119427_object150100:head# 2024-04-01T19:42:46.274 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c321054:::benchmark_data_smithi188_119427_object84064:head# 2024-04-01T19:42:46.274 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c339699:::benchmark_data_smithi188_119427_object116586:head# 2024-04-01T19:42:46.275 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c35cf07:::benchmark_data_smithi188_119427_object151358:head# 2024-04-01T19:42:46.275 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c3629b6:::benchmark_data_smithi188_119427_object112793:head# 2024-04-01T19:42:46.276 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c367fc9:::benchmark_data_smithi188_119427_object91853:head# 2024-04-01T19:42:46.276 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c370c21:::benchmark_data_smithi188_119427_object124603:head# 2024-04-01T19:42:46.279 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c38ce41:::benchmark_data_smithi188_119427_object87722:head# 2024-04-01T19:42:46.279 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c39676e:::benchmark_data_smithi188_119427_object120832:head# 2024-04-01T19:42:46.279 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c3ac99c:::benchmark_data_smithi188_119427_object115807:head# 2024-04-01T19:42:46.280 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c3b1c15:::benchmark_data_smithi188_119427_object150861:head# 2024-04-01T19:42:46.280 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c3b2ae9:::benchmark_data_smithi188_119427_object118797:head# 2024-04-01T19:42:46.280 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c3c0263:::benchmark_data_smithi188_119427_object128454:head# 2024-04-01T19:42:46.280 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c3cc889:::benchmark_data_smithi188_119427_object162101:head# 2024-04-01T19:42:46.280 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c3fbd96:::benchmark_data_smithi188_119427_object146798:head# 2024-04-01T19:42:46.281 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c40630f:::benchmark_data_smithi188_119427_object134541:head# 2024-04-01T19:42:46.281 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c408ef0:::benchmark_data_smithi188_119427_object74458:head# 2024-04-01T19:42:46.281 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c409e37:::benchmark_data_smithi188_119427_object110467:head# 2024-04-01T19:42:46.281 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c435ed9:::benchmark_data_smithi188_119427_object86095:head# 2024-04-01T19:42:46.282 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c442444:::benchmark_data_smithi188_119427_object75567:head# 2024-04-01T19:42:46.283 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c46583c:::benchmark_data_smithi188_119427_object96611:head# 2024-04-01T19:42:46.283 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c46e34e:::benchmark_data_smithi188_119427_object155873:head# 2024-04-01T19:42:46.283 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c470d71:::benchmark_data_smithi188_119427_object123635:head# 2024-04-01T19:42:46.284 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c4a6326:::benchmark_data_smithi188_119427_object85204:head# 2024-04-01T19:42:46.284 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c4b40a6:::benchmark_data_smithi188_119427_object82063:head# 2024-04-01T19:42:46.285 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c4b56e2:::benchmark_data_smithi188_119427_object105929:head# 2024-04-01T19:42:46.287 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c4ba346:::benchmark_data_smithi188_119427_object155332:head# 2024-04-01T19:42:46.294 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c4cb8d5:::benchmark_data_smithi188_119427_object86156:head# 2024-04-01T19:42:46.294 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c4ef667:::benchmark_data_smithi188_119427_object76829:head# 2024-04-01T19:42:46.294 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c5007a4:::benchmark_data_smithi188_119427_object124768:head# 2024-04-01T19:42:46.294 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c505659:::benchmark_data_smithi188_119427_object96239:head# 2024-04-01T19:42:46.294 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c5277b0:::benchmark_data_smithi188_119427_object121749:head# 2024-04-01T19:42:46.295 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c5375fd:::benchmark_data_smithi188_119427_object118083:head# 2024-04-01T19:42:46.295 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c539a5b:::benchmark_data_smithi188_119427_object133396:head# 2024-04-01T19:42:46.295 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c53d388:::benchmark_data_smithi188_119427_object157119:head# 2024-04-01T19:42:46.297 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c54f376:::benchmark_data_smithi188_119427_object105818:head# 2024-04-01T19:42:46.297 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c54fedf:::benchmark_data_smithi188_119427_object117136:head# 2024-04-01T19:42:46.298 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c5569d9:::benchmark_data_smithi188_119427_object142580:head# 2024-04-01T19:42:46.298 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c55e6b7:::benchmark_data_smithi188_119427_object146299:head# 2024-04-01T19:42:46.299 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c5613d0:::benchmark_data_smithi188_119427_object150924:head# 2024-04-01T19:42:46.299 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c5a52b7:::benchmark_data_smithi188_119427_object127285:head# 2024-04-01T19:42:46.300 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c5abebf:::benchmark_data_smithi188_119427_object141883:head# 2024-04-01T19:42:46.300 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c5b252c:::benchmark_data_smithi188_119427_object80155:head# 2024-04-01T19:42:46.301 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c5bd26b:::benchmark_data_smithi188_119427_object147871:head# 2024-04-01T19:42:46.301 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c5be317:::benchmark_data_smithi188_119427_object123524:head# 2024-04-01T19:42:46.302 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c5c2fe4:::benchmark_data_smithi188_119427_object96250:head# 2024-04-01T19:42:46.308 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c5cc72c:::benchmark_data_smithi188_119427_object91564:head# 2024-04-01T19:42:46.308 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c5ceaba:::benchmark_data_smithi188_119427_object119377:head# 2024-04-01T19:42:46.308 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c5d370f:::benchmark_data_smithi188_119427_object114493:head# 2024-04-01T19:42:46.308 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c5df994:::benchmark_data_smithi188_119427_object109078:head# 2024-04-01T19:42:46.308 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c5e33a0:::benchmark_data_smithi188_119427_object96480:head# 2024-04-01T19:42:46.308 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c5e43da:::benchmark_data_smithi188_119427_object138698:head# 2024-04-01T19:42:46.308 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c613b8c:::benchmark_data_smithi188_119427_object80551:head# 2024-04-01T19:42:46.309 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c62a0c7:::benchmark_data_smithi188_119427_object110013:head# 2024-04-01T19:42:46.309 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c62c6be:::benchmark_data_smithi188_119427_object77074:head# 2024-04-01T19:42:46.309 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c62cd5d:::benchmark_data_smithi188_119427_object78741:head# 2024-04-01T19:42:46.310 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c631a7c:::benchmark_data_smithi188_119427_object140692:head# 2024-04-01T19:42:46.311 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c632742:::benchmark_data_smithi188_119427_object84749:head# 2024-04-01T19:42:46.311 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c64281c:::benchmark_data_smithi188_119427_object82142:head# 2024-04-01T19:42:46.311 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c64c7c2:::benchmark_data_smithi188_119427_object116796:head# 2024-04-01T19:42:46.311 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c664ea6:::benchmark_data_smithi188_119427_object142966:head# 2024-04-01T19:42:46.311 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c668cc3:::benchmark_data_smithi188_119427_object142097:head# 2024-04-01T19:42:46.312 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c6768c2:::benchmark_data_smithi188_119427_object128317:head# 2024-04-01T19:42:46.312 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c67a825:::benchmark_data_smithi188_119427_object131639:head# 2024-04-01T19:42:46.316 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c67e089:::benchmark_data_smithi188_119427_object81790:head# 2024-04-01T19:42:46.317 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c6a1ed8:::benchmark_data_smithi188_119427_object162311:head# 2024-04-01T19:42:46.318 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c6b0bae:::benchmark_data_smithi188_119427_object92348:head# 2024-04-01T19:42:46.318 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c6b3f3f:::benchmark_data_smithi188_119427_object122963:head# 2024-04-01T19:42:46.318 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c6b6f53:::benchmark_data_smithi188_119427_object124794:head# 2024-04-01T19:42:46.319 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c6c4f19:::benchmark_data_smithi188_119427_object93526:head# 2024-04-01T19:42:46.323 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c6ca342:::benchmark_data_smithi188_119427_object159229:head# 2024-04-01T19:42:46.323 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c6cf971:::benchmark_data_smithi188_119427_object103139:head# 2024-04-01T19:42:46.323 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c6d293b:::benchmark_data_smithi188_119427_object115478:head# 2024-04-01T19:42:46.323 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c6def6d:::benchmark_data_smithi188_119427_object157509:head# 2024-04-01T19:42:46.323 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c6ed2b9:::benchmark_data_smithi188_119427_object77147:head# 2024-04-01T19:42:46.324 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c6f114c:::benchmark_data_smithi188_119427_object139233:head# 2024-04-01T19:42:46.324 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c6fd321:::benchmark_data_smithi188_119427_object163879:head# 2024-04-01T19:42:46.324 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c703f22:::benchmark_data_smithi188_119427_object148740:head# 2024-04-01T19:42:46.324 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c705bc3:::benchmark_data_smithi188_119427_object143355:head# 2024-04-01T19:42:46.325 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c717e26:::benchmark_data_smithi188_119427_object150464:head# 2024-04-01T19:42:46.326 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c71ae94:::benchmark_data_smithi188_119427_object94059:head# 2024-04-01T19:42:46.326 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c72ff29:::benchmark_data_smithi188_119427_object143204:head# 2024-04-01T19:42:46.327 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c736a0e:::benchmark_data_smithi188_119427_object141949:head# 2024-04-01T19:42:46.327 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c739666:::benchmark_data_smithi188_119427_object109058:head# 2024-04-01T19:42:46.328 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c73fb0c:::benchmark_data_smithi188_119427_object123777:head# 2024-04-01T19:42:46.328 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c753a09:::benchmark_data_smithi188_119427_object121086:head# 2024-04-01T19:42:46.337 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c75e501:::benchmark_data_smithi188_119427_object136498:head# 2024-04-01T19:42:46.337 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c760ac6:::benchmark_data_smithi188_119427_object136543:head# 2024-04-01T19:42:46.337 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c76c027:::benchmark_data_smithi188_119427_object122481:head# 2024-04-01T19:42:46.338 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c780902:::benchmark_data_smithi188_119427_object117245:head# 2024-04-01T19:42:46.338 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c786c54:::benchmark_data_smithi188_119427_object157101:head# 2024-04-01T19:42:46.341 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c79166d:::benchmark_data_smithi188_119427_object153314:head# 2024-04-01T19:42:46.341 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c7a6953:::benchmark_data_smithi188_119427_object100370:head# 2024-04-01T19:42:46.342 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c7c29f2:::benchmark_data_smithi188_119427_object142286:head# 2024-04-01T19:42:46.342 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c7cce21:::benchmark_data_smithi188_119427_object95483:head# 2024-04-01T19:42:46.342 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c7cecb6:::benchmark_data_smithi188_119427_object73483:head# 2024-04-01T19:42:46.347 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c7d12d0:::benchmark_data_smithi188_119427_object119185:head# 2024-04-01T19:42:46.348 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c7d7718:::benchmark_data_smithi188_119427_object140883:head# 2024-04-01T19:42:46.348 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c7d9862:::benchmark_data_smithi188_119427_object131495:head# 2024-04-01T19:42:46.348 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c7e1bc8:::benchmark_data_smithi188_119427_object94864:head# 2024-04-01T19:42:46.348 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c7eeb32:::benchmark_data_smithi188_119427_object72455:head# 2024-04-01T19:42:46.348 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c7f097f:::benchmark_data_smithi188_119427_object145390:head# 2024-04-01T19:42:46.349 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c7f201d:::benchmark_data_smithi188_119427_object130407:head# 2024-04-01T19:42:46.349 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c7f4ffe:::benchmark_data_smithi188_119427_object115685:head# 2024-04-01T19:42:46.349 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c7f51d2:::benchmark_data_smithi188_119427_object132816:head# 2024-04-01T19:42:46.350 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c807dba:::benchmark_data_smithi188_119427_object112593:head# 2024-04-01T19:42:46.350 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c81844d:::benchmark_data_smithi188_119427_object113337:head# 2024-04-01T19:42:46.351 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c8191ab:::benchmark_data_smithi188_119427_object87015:head# 2024-04-01T19:42:46.356 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c823a2d:::benchmark_data_smithi188_119427_object90315:head# 2024-04-01T19:42:46.356 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c841daa:::benchmark_data_smithi188_119427_object163161:head# 2024-04-01T19:42:46.356 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c8593b9:::benchmark_data_smithi188_119427_object99919:head# 2024-04-01T19:42:46.356 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c85ad4a:::benchmark_data_smithi188_119427_object95586:head# 2024-04-01T19:42:46.356 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c8a1956:::benchmark_data_smithi188_119427_object117550:head# 2024-04-01T19:42:46.356 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c8a3eb2:::benchmark_data_smithi188_119427_object117713:head# 2024-04-01T19:42:46.356 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c8c2359:::benchmark_data_smithi188_119427_object75329:head# 2024-04-01T19:42:46.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c8c7eaf:::benchmark_data_smithi188_119427_object78318:head# 2024-04-01T19:42:46.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c8ce14c:::benchmark_data_smithi188_119427_object114777:head# 2024-04-01T19:42:46.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c8e135d:::benchmark_data_smithi188_119427_object100846:head# 2024-04-01T19:42:46.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c8e39a5:::benchmark_data_smithi188_119427_object83518:head# 2024-04-01T19:42:46.357 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c8f5ca4:::benchmark_data_smithi188_119427_object74125:head# 2024-04-01T19:42:46.359 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c8f87e5:::benchmark_data_smithi188_119427_object152861:head# 2024-04-01T19:42:46.359 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c9100de:::benchmark_data_smithi188_119427_object95696:head# 2024-04-01T19:42:46.359 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c9132c4:::benchmark_data_smithi188_119427_object137791:head# 2024-04-01T19:42:46.359 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c93a3d0:::benchmark_data_smithi188_119427_object98444:head# 2024-04-01T19:42:46.360 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c93b42a:::benchmark_data_smithi188_119427_object95493:head# 2024-04-01T19:42:46.360 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c94fcc6:::benchmark_data_smithi188_119427_object147928:head# 2024-04-01T19:42:46.360 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c950692:::benchmark_data_smithi188_119427_object87220:head# 2024-04-01T19:42:46.361 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c955eb8:::benchmark_data_smithi188_119427_object160742:head# 2024-04-01T19:42:46.367 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c95718d:::benchmark_data_smithi188_119427_object87229:head# 2024-04-01T19:42:46.367 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c958f13:::benchmark_data_smithi188_119427_object120654:head# 2024-04-01T19:42:46.367 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c967939:::benchmark_data_smithi188_119427_object154790:head# 2024-04-01T19:42:46.367 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c970439:::benchmark_data_smithi188_119427_object110638:head# 2024-04-01T19:42:46.367 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c972662:::benchmark_data_smithi188_119427_object132750:head# 2024-04-01T19:42:46.367 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c98d6e2:::benchmark_data_smithi188_119427_object163551:head# 2024-04-01T19:42:46.367 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c9b6342:::benchmark_data_smithi188_119427_object96360:head# 2024-04-01T19:42:46.367 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c9be78a:::benchmark_data_smithi188_119427_object154939:head# 2024-04-01T19:42:46.369 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c9cb90c:::benchmark_data_smithi188_119427_object114815:head# 2024-04-01T19:42:46.370 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c9ce95b:::benchmark_data_smithi188_119427_object128055:head# 2024-04-01T19:42:46.370 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4c9e212b:::benchmark_data_smithi188_119427_object120816:head# 2024-04-01T19:42:46.371 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ca018a1:::benchmark_data_smithi188_119427_object111938:head# 2024-04-01T19:42:46.374 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ca1ee00:::benchmark_data_smithi188_119427_object150170:head# 2024-04-01T19:42:46.374 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ca2cafe:::benchmark_data_smithi188_119427_object118404:head# 2024-04-01T19:42:46.374 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ca3d3f3:::benchmark_data_smithi188_119427_object113216:head# 2024-04-01T19:42:46.374 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ca46a9b:::benchmark_data_smithi188_119427_object83028:head# 2024-04-01T19:42:46.375 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ca48ac4:::benchmark_data_smithi188_119427_object115585:head# 2024-04-01T19:42:46.375 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ca552d5:::benchmark_data_smithi188_119427_object149829:head# 2024-04-01T19:42:46.376 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ca5df70:::benchmark_data_smithi188_119427_object74856:head# 2024-04-01T19:42:46.376 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ca62c8b:::benchmark_data_smithi188_119427_object93572:head# 2024-04-01T19:42:46.377 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ca653a9:::benchmark_data_smithi188_119427_object85418:head# 2024-04-01T19:42:46.377 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ca75ea1:::benchmark_data_smithi188_119427_object85041:head# 2024-04-01T19:42:46.382 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ca7cc40:::benchmark_data_smithi188_119427_object160363:head# 2024-04-01T19:42:46.382 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ca8033f:::benchmark_data_smithi188_119427_object157439:head# 2024-04-01T19:42:46.382 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ca86efd:::benchmark_data_smithi188_119427_object99264:head# 2024-04-01T19:42:46.382 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ca8829a:::benchmark_data_smithi188_119427_object92090:head# 2024-04-01T19:42:46.382 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ca925f0:::benchmark_data_smithi188_119427_object120256:head# 2024-04-01T19:42:46.382 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cacdc2d:::benchmark_data_smithi188_119427_object114400:head# 2024-04-01T19:42:46.384 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cae894a:::benchmark_data_smithi188_119427_object125286:head# 2024-04-01T19:42:46.385 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4caebecb:::benchmark_data_smithi188_119427_object131997:head# 2024-04-01T19:42:46.385 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4caefd3c:::benchmark_data_smithi188_119427_object79642:head# 2024-04-01T19:42:46.385 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cafa201:::benchmark_data_smithi188_119427_object98956:head# 2024-04-01T19:42:46.387 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cafaf88:::benchmark_data_smithi188_119427_object150644:head# 2024-04-01T19:42:46.387 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cb0c590:::benchmark_data_smithi188_119427_object118006:head# 2024-04-01T19:42:46.388 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cb0fe28:::benchmark_data_smithi188_119427_object141842:head# 2024-04-01T19:42:46.388 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cb554e4:::benchmark_data_smithi188_119427_object95599:head# 2024-04-01T19:42:46.389 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cb580b6:::benchmark_data_smithi188_119427_object162193:head# 2024-04-01T19:42:46.389 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cb5b62d:::benchmark_data_smithi188_119427_object83186:head# 2024-04-01T19:42:46.390 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cb613a2:::benchmark_data_smithi188_119427_object82930:head# 2024-04-01T19:42:46.390 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cb7a381:::benchmark_data_smithi188_119427_object113642:head# 2024-04-01T19:42:46.391 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cb8adba:::benchmark_data_smithi188_119427_object114843:head# 2024-04-01T19:42:46.391 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cbb666f:::benchmark_data_smithi188_119427_object78633:head# 2024-04-01T19:42:46.391 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cbbd8ec:::benchmark_data_smithi188_119427_object148702:head# 2024-04-01T19:42:46.392 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cbbdea3:::benchmark_data_smithi188_119427_object137609:head# 2024-04-01T19:42:46.392 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cbce1b7:::benchmark_data_smithi188_119427_object77020:head# 2024-04-01T19:42:46.393 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cbda07a:::benchmark_data_smithi188_119427_object161899:head# 2024-04-01T19:42:46.393 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cbda296:::benchmark_data_smithi188_119427_object138742:head# 2024-04-01T19:42:46.393 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cbe01a3:::benchmark_data_smithi188_119427_object160721:head# 2024-04-01T19:42:46.394 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cbef8e7:::benchmark_data_smithi188_119427_object133700:head# 2024-04-01T19:42:46.394 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cbf2e3e:::benchmark_data_smithi188_119427_object144853:head# 2024-04-01T19:42:46.394 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cbfc8df:::benchmark_data_smithi188_119427_object137262:head# 2024-04-01T19:42:46.395 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cc2570f:::benchmark_data_smithi188_119427_object133408:head# 2024-04-01T19:42:46.395 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cc28886:::benchmark_data_smithi188_119427_object82208:head# 2024-04-01T19:42:46.396 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cc2fea9:::benchmark_data_smithi188_119427_object137685:head# 2024-04-01T19:42:46.396 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cc5dbcf:::benchmark_data_smithi188_119427_object87832:head# 2024-04-01T19:42:46.397 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cc6dcd3:::benchmark_data_smithi188_119427_object98775:head# 2024-04-01T19:42:46.397 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cc70170:::benchmark_data_smithi188_119427_object152743:head# 2024-04-01T19:42:46.398 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cc7f391:::benchmark_data_smithi188_119427_object82040:head# 2024-04-01T19:42:46.398 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cc8a145:::benchmark_data_smithi188_119427_object152513:head# 2024-04-01T19:42:46.402 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cc99b59:::benchmark_data_smithi188_119427_object141457:head# 2024-04-01T19:42:46.403 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cc9bdef:::benchmark_data_smithi188_119427_object95908:head# 2024-04-01T19:42:46.403 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ccc3606:::benchmark_data_smithi188_119427_object85523:head# 2024-04-01T19:42:46.403 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ccc88bd:::benchmark_data_smithi188_119427_object145197:head# 2024-04-01T19:42:46.403 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ccdf0b0:::benchmark_data_smithi188_119427_object145062:head# 2024-04-01T19:42:46.403 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cce13f1:::benchmark_data_smithi188_119427_object114109:head# 2024-04-01T19:42:46.404 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cce1c2b:::benchmark_data_smithi188_119427_object151315:head# 2024-04-01T19:42:46.404 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cce735e:::benchmark_data_smithi188_119427_object160982:head# 2024-04-01T19:42:46.407 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ccec1d7:::benchmark_data_smithi188_119427_object135630:head# 2024-04-01T19:42:46.407 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ccedea8:::benchmark_data_smithi188_119427_object94645:head# 2024-04-01T19:42:46.407 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ccf5fb5:::benchmark_data_smithi188_119427_object82416:head# 2024-04-01T19:42:46.408 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ccfb197:::benchmark_data_smithi188_119427_object89820:head# 2024-04-01T19:42:46.408 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cd13b20:::benchmark_data_smithi188_119427_object159660:head# 2024-04-01T19:42:46.409 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cd16f46:::benchmark_data_smithi188_119427_object90861:head# 2024-04-01T19:42:46.414 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cd18ed3:::benchmark_data_smithi188_119427_object105546:head# 2024-04-01T19:42:46.414 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cd1dc53:::benchmark_data_smithi188_119427_object157043:head# 2024-04-01T19:42:46.468 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cd1ee14:::benchmark_data_smithi188_119427_object151473:head# 2024-04-01T19:42:46.468 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cd27eec:::benchmark_data_smithi188_119427_object123895:head# 2024-04-01T19:42:46.468 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cd39cfb:::benchmark_data_smithi188_119427_object129711:head# 2024-04-01T19:42:46.468 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cd40752:::benchmark_data_smithi188_119427_object142867:head# 2024-04-01T19:42:46.468 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cd4c91a:::benchmark_data_smithi188_119427_object144078:head# 2024-04-01T19:42:46.468 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cd4f2bc:::benchmark_data_smithi188_119427_object144894:head# 2024-04-01T19:42:46.468 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cd62dd6:::benchmark_data_smithi188_119427_object121169:head# 2024-04-01T19:42:46.469 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cd64e02:::benchmark_data_smithi188_119427_object90160:head# 2024-04-01T19:42:46.469 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cd80c98:::benchmark_data_smithi188_119427_object149293:head# 2024-04-01T19:42:46.469 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cd8b5cf:::benchmark_data_smithi188_119427_object129171:head# 2024-04-01T19:42:46.469 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cd9c537:::benchmark_data_smithi188_119427_object87043:head# 2024-04-01T19:42:46.469 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cd9fcc0:::benchmark_data_smithi188_119427_object89348:head# 2024-04-01T19:42:46.469 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cdbc10d:::benchmark_data_smithi188_119427_object140888:head# 2024-04-01T19:42:46.469 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cdbca7a:::benchmark_data_smithi188_119427_object109656:head# 2024-04-01T19:42:46.469 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cdc465b:::benchmark_data_smithi188_119427_object117754:head# 2024-04-01T19:42:46.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cdcf8c7:::benchmark_data_smithi188_119427_object150127:head# 2024-04-01T19:42:46.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cdef233:::benchmark_data_smithi188_119427_object95510:head# 2024-04-01T19:42:46.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cdf6f5f:::benchmark_data_smithi188_119427_object109479:head# 2024-04-01T19:42:46.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cdf9b17:::benchmark_data_smithi188_119427_object96187:head# 2024-04-01T19:42:46.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ce0ade8:::benchmark_data_smithi188_119427_object107437:head# 2024-04-01T19:42:46.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ce10bd1:::benchmark_data_smithi188_119427_object159543:head# 2024-04-01T19:42:46.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ce270a8:::benchmark_data_smithi188_119427_object81921:head# 2024-04-01T19:42:46.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ce3d805:::benchmark_data_smithi188_119427_object113800:head# 2024-04-01T19:42:46.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ce3e697:::benchmark_data_smithi188_119427_object76717:head# 2024-04-01T19:42:46.470 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ce63e2b:::benchmark_data_smithi188_119427_object79133:head# 2024-04-01T19:42:46.471 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ce71bd3:::benchmark_data_smithi188_119427_object89557:head# 2024-04-01T19:42:46.471 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ce84444:::benchmark_data_smithi188_119427_object74602:head# 2024-04-01T19:42:46.471 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cea7429:::benchmark_data_smithi188_119427_object130270:head# 2024-04-01T19:42:46.471 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cebb266:::benchmark_data_smithi188_119427_object162274:head# 2024-04-01T19:42:46.471 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cec19f9:::benchmark_data_smithi188_119427_object101438:head# 2024-04-01T19:42:46.471 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ceccdd0:::benchmark_data_smithi188_119427_object79312:head# 2024-04-01T19:42:46.471 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cee8e69:::benchmark_data_smithi188_119427_object124558:head# 2024-04-01T19:42:46.471 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cee9522:::benchmark_data_smithi188_119427_object76384:head# 2024-04-01T19:42:46.471 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cf0451c:::benchmark_data_smithi188_119427_object117897:head# 2024-04-01T19:42:46.471 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cf0e2a6:::benchmark_data_smithi188_119427_object104522:head# 2024-04-01T19:42:46.471 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cf12efa:::benchmark_data_smithi188_119427_object158323:head# 2024-04-01T19:42:46.471 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cf30ad2:::benchmark_data_smithi188_119427_object143054:head# 2024-04-01T19:42:46.472 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cf31d67:::benchmark_data_smithi188_119427_object74599:head# 2024-04-01T19:42:46.472 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cf341ba:::benchmark_data_smithi188_119427_object127385:head# 2024-04-01T19:42:46.472 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cf51cf9:::benchmark_data_smithi188_119427_object75066:head# 2024-04-01T19:42:46.472 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cf5349e:::benchmark_data_smithi188_119427_object113475:head# 2024-04-01T19:42:46.472 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cf58401:::benchmark_data_smithi188_119427_object92268:head# 2024-04-01T19:42:46.472 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cf5f429:::benchmark_data_smithi188_119427_object103238:head# 2024-04-01T19:42:46.472 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cf70a19:::benchmark_data_smithi188_119427_object75432:head# 2024-04-01T19:42:46.472 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cf711f0:::benchmark_data_smithi188_119427_object155165:head# 2024-04-01T19:42:46.472 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cf73152:::benchmark_data_smithi188_119427_object111038:head# 2024-04-01T19:42:46.472 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cf7d024:::benchmark_data_smithi188_119427_object114570:head# 2024-04-01T19:42:46.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cf84f2b:::benchmark_data_smithi188_119427_object100574:head# 2024-04-01T19:42:46.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cfaef86:::benchmark_data_smithi188_119427_object109542:head# 2024-04-01T19:42:46.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cfb2805:::benchmark_data_smithi188_119427_object158698:head# 2024-04-01T19:42:46.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cfba1f2:::benchmark_data_smithi188_119427_object151294:head# 2024-04-01T19:42:46.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cfbe9a5:::benchmark_data_smithi188_119427_object109311:head# 2024-04-01T19:42:46.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cfbeca3:::benchmark_data_smithi188_119427_object80204:head# 2024-04-01T19:42:46.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cfd3855:::benchmark_data_smithi188_119427_object83013:head# 2024-04-01T19:42:46.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cfd4449:::benchmark_data_smithi188_119427_object104166:head# 2024-04-01T19:42:46.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4cfe5f3c:::benchmark_data_smithi188_119427_object133908:head# 2024-04-01T19:42:46.473 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d000010:::benchmark_data_smithi188_119427_object125144:head# 2024-04-01T19:42:46.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d008137:::benchmark_data_smithi188_119427_object130815:head# 2024-04-01T19:42:46.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d01ab3c:::benchmark_data_smithi188_119427_object103924:head# 2024-04-01T19:42:46.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d025cc1:::benchmark_data_smithi188_119427_object150821:head# 2024-04-01T19:42:46.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d0604c8:::benchmark_data_smithi188_119427_object135092:head# 2024-04-01T19:42:46.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d06635a:::benchmark_data_smithi188_119427_object150988:head# 2024-04-01T19:42:46.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d06adc0:::benchmark_data_smithi188_119427_object145788:head# 2024-04-01T19:42:46.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d08ba44:::benchmark_data_smithi188_119427_object137363:head# 2024-04-01T19:42:46.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d098730:::benchmark_data_smithi188_119427_object115463:head# 2024-04-01T19:42:46.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d0aad45:::benchmark_data_smithi188_119427_object103080:head# 2024-04-01T19:42:46.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d0b4af4:::benchmark_data_smithi188_119427_object98658:head# 2024-04-01T19:42:46.474 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d0b516e:::benchmark_data_smithi188_119427_object73534:head# 2024-04-01T19:42:46.475 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d0bb3ef:::benchmark_data_smithi188_119427_object100903:head# 2024-04-01T19:42:46.475 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d0bf2b4:::benchmark_data_smithi188_119427_object152306:head# 2024-04-01T19:42:46.475 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d0c44f1:::benchmark_data_smithi188_119427_object147627:head# 2024-04-01T19:42:46.475 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d0c4d8b:::benchmark_data_smithi188_119427_object158289:head# 2024-04-01T19:42:46.475 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d0c8be6:::benchmark_data_smithi188_119427_object142942:head# 2024-04-01T19:42:46.475 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d0d40c3:::benchmark_data_smithi188_119427_object160644:head# 2024-04-01T19:42:46.475 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d0ef722:::benchmark_data_smithi188_119427_object84701:head# 2024-04-01T19:42:46.475 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d0fcf7d:::benchmark_data_smithi188_119427_object143469:head# 2024-04-01T19:42:46.475 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d115c9e:::benchmark_data_smithi188_119427_object73765:head# 2024-04-01T19:42:46.475 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d11e74e:::benchmark_data_smithi188_119427_object112385:head# 2024-04-01T19:42:46.475 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d121bde:::benchmark_data_smithi188_119427_object121461:head# 2024-04-01T19:42:46.476 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d12e1d4:::benchmark_data_smithi188_119427_object95543:head# 2024-04-01T19:42:46.476 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d131c4c:::benchmark_data_smithi188_119427_object94624:head# 2024-04-01T19:42:46.476 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d137c02:::benchmark_data_smithi188_119427_object112589:head# 2024-04-01T19:42:46.476 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d145d23:::benchmark_data_smithi188_119427_object144026:head# 2024-04-01T19:42:46.476 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d15cb7d:::benchmark_data_smithi188_119427_object107598:head# 2024-04-01T19:42:46.476 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d15eec1:::benchmark_data_smithi188_119427_object139213:head# 2024-04-01T19:42:46.476 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d16bf91:::benchmark_data_smithi188_119427_object118046:head# 2024-04-01T19:42:46.476 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d171ad1:::benchmark_data_smithi188_119427_object142122:head# 2024-04-01T19:42:46.476 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d19d760:::benchmark_data_smithi188_119427_object76482:head# 2024-04-01T19:42:46.476 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d1a9173:::benchmark_data_smithi188_119427_object98512:head# 2024-04-01T19:42:46.477 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d1b081d:::benchmark_data_smithi188_119427_object96408:head# 2024-04-01T19:42:46.477 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d1bc19b:::benchmark_data_smithi188_119427_object143508:head# 2024-04-01T19:42:46.477 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d1bf9be:::benchmark_data_smithi188_119427_object85486:head# 2024-04-01T19:42:46.477 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d1ccd26:::benchmark_data_smithi188_119427_object79382:head# 2024-04-01T19:42:46.477 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d1cf484:::benchmark_data_smithi188_119427_object100077:head# 2024-04-01T19:42:46.477 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d1d0fee:::benchmark_data_smithi188_119427_object110338:head# 2024-04-01T19:42:46.477 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d1da1ba:::benchmark_data_smithi188_119427_object152962:head# 2024-04-01T19:42:46.477 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d1ed3ac:::benchmark_data_smithi188_119427_object101078:head# 2024-04-01T19:42:46.477 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d1f5163:::benchmark_data_smithi188_119427_object148925:head# 2024-04-01T19:42:46.477 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d212935:::benchmark_data_smithi188_119427_object111654:head# 2024-04-01T19:42:46.480 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d21913c:::benchmark_data_smithi188_119427_object106672:head# 2024-04-01T19:42:46.480 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d22dbbf:::benchmark_data_smithi188_119427_object93392:head# 2024-04-01T19:42:46.480 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d24242a:::benchmark_data_smithi188_119427_object136909:head# 2024-04-01T19:42:46.480 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d24a2ec:::benchmark_data_smithi188_119427_object160594:head# 2024-04-01T19:42:46.480 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d25674c:::benchmark_data_smithi188_119427_object126790:head# 2024-04-01T19:42:46.480 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d265b9e:::benchmark_data_smithi188_119427_object117925:head# 2024-04-01T19:42:46.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d2685a3:::benchmark_data_smithi188_119427_object147257:head# 2024-04-01T19:42:46.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d268ba5:::benchmark_data_smithi188_119427_object141909:head# 2024-04-01T19:42:46.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d26d7d9:::benchmark_data_smithi188_119427_object137120:head# 2024-04-01T19:42:46.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d272834:::benchmark_data_smithi188_119427_object98348:head# 2024-04-01T19:42:46.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d275c74:::benchmark_data_smithi188_119427_object146863:head# 2024-04-01T19:42:46.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d278796:::benchmark_data_smithi188_119427_object153974:head# 2024-04-01T19:42:46.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d27e5a4:::benchmark_data_smithi188_119427_object84085:head# 2024-04-01T19:42:46.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d28cdba:::benchmark_data_smithi188_119427_object128553:head# 2024-04-01T19:42:46.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d28de45:::benchmark_data_smithi188_119427_object77547:head# 2024-04-01T19:42:46.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d2a6fb5:::benchmark_data_smithi188_119427_object121711:head# 2024-04-01T19:42:46.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d2a8bd1:::benchmark_data_smithi188_119427_object122792:head# 2024-04-01T19:42:46.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d2b721b:::benchmark_data_smithi188_119427_object125755:head# 2024-04-01T19:42:46.481 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d2bab75:::benchmark_data_smithi188_119427_object150745:head# 2024-04-01T19:42:46.482 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d2d69d4:::benchmark_data_smithi188_119427_object89453:head# 2024-04-01T19:42:46.482 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d2df4f7:::benchmark_data_smithi188_119427_object153160:head# 2024-04-01T19:42:46.482 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d2e160d:::benchmark_data_smithi188_119427_object121495:head# 2024-04-01T19:42:46.482 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d301b34:::benchmark_data_smithi188_119427_object105663:head# 2024-04-01T19:42:46.483 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d31ebad:::benchmark_data_smithi188_119427_object101031:head# 2024-04-01T19:42:46.483 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d332cb6:::benchmark_data_smithi188_119427_object78351:head# 2024-04-01T19:42:46.483 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d335c97:::benchmark_data_smithi188_119427_object151704:head# 2024-04-01T19:42:46.483 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d337e09:::benchmark_data_smithi188_119427_object109002:head# 2024-04-01T19:42:46.484 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d33cda5:::benchmark_data_smithi188_119427_object133798:head# 2024-04-01T19:42:46.484 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d35481b:::benchmark_data_smithi188_119427_object164518:head# 2024-04-01T19:42:46.484 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d357fe0:::benchmark_data_smithi188_119427_object123052:head# 2024-04-01T19:42:46.485 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d37686d:::benchmark_data_smithi188_119427_object122274:head# 2024-04-01T19:42:46.485 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d379600:::benchmark_data_smithi188_119427_object135857:head# 2024-04-01T19:42:46.485 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d38402a:::benchmark_data_smithi188_119427_object100213:head# 2024-04-01T19:42:46.485 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d38534a:::benchmark_data_smithi188_119427_object102115:head# 2024-04-01T19:42:46.486 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d3a6183:::benchmark_data_smithi188_119427_object140219:head# 2024-04-01T19:42:46.486 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d3a90bb:::benchmark_data_smithi188_119427_object126566:head# 2024-04-01T19:42:46.487 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d3ac11a:::benchmark_data_smithi188_119427_object160954:head# 2024-04-01T19:42:46.487 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d3b9d53:::benchmark_data_smithi188_119427_object131381:head# 2024-04-01T19:42:46.488 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d3bd3ef:::benchmark_data_smithi188_119427_object101881:head# 2024-04-01T19:42:46.488 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d3c10a4:::benchmark_data_smithi188_119427_object118269:head# 2024-04-01T19:42:46.488 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d3cb53f:::benchmark_data_smithi188_119427_object97789:head# 2024-04-01T19:42:46.489 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d4023ba:::benchmark_data_smithi188_119427_object75482:head# 2024-04-01T19:42:46.489 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d40c030:::benchmark_data_smithi188_119427_object131725:head# 2024-04-01T19:42:46.490 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d40d96a:::benchmark_data_smithi188_119427_object104440:head# 2024-04-01T19:42:46.490 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d4748f2:::benchmark_data_smithi188_119427_object100768:head# 2024-04-01T19:42:46.490 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d47d73f:::benchmark_data_smithi188_119427_object155317:head# 2024-04-01T19:42:46.491 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d48b3f7:::benchmark_data_smithi188_119427_object123744:head# 2024-04-01T19:42:46.491 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d48c2e9:::benchmark_data_smithi188_119427_object102516:head# 2024-04-01T19:42:46.492 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d48ee26:::benchmark_data_smithi188_119427_object125111:head# 2024-04-01T19:42:46.492 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d494e90:::benchmark_data_smithi188_119427_object130658:head# 2024-04-01T19:42:46.493 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d49f757:::benchmark_data_smithi188_119427_object126795:head# 2024-04-01T19:42:46.493 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d4a5f5a:::benchmark_data_smithi188_119427_object116954:head# 2024-04-01T19:42:46.494 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d4cd7e5:::benchmark_data_smithi188_119427_object112383:head# 2024-04-01T19:42:46.494 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d4d53ce:::benchmark_data_smithi188_119427_object132625:head# 2024-04-01T19:42:46.494 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d4dee8d:::benchmark_data_smithi188_119427_object115504:head# 2024-04-01T19:42:46.495 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d5087a8:::benchmark_data_smithi188_119427_object158123:head# 2024-04-01T19:42:46.495 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d511c2c:::benchmark_data_smithi188_119427_object107095:head# 2024-04-01T19:42:46.496 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d513250:::benchmark_data_smithi188_119427_object162499:head# 2024-04-01T19:42:46.496 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d51c107:::benchmark_data_smithi188_119427_object114578:head# 2024-04-01T19:42:46.496 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d5250e1:::benchmark_data_smithi188_119427_object152301:head# 2024-04-01T19:42:46.497 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d5329ba:::benchmark_data_smithi188_119427_object114298:head# 2024-04-01T19:42:46.497 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d54120a:::benchmark_data_smithi188_119427_object151979:head# 2024-04-01T19:42:46.498 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d5424e3:::benchmark_data_smithi188_119427_object154806:head# 2024-04-01T19:42:46.498 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d54aa74:::benchmark_data_smithi188_119427_object85908:head# 2024-04-01T19:42:46.499 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d55e35e:::benchmark_data_smithi188_119427_object114687:head# 2024-04-01T19:42:46.499 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d5623e9:::benchmark_data_smithi188_119427_object127120:head# 2024-04-01T19:42:46.499 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d56d541:::benchmark_data_smithi188_119427_object105506:head# 2024-04-01T19:42:46.500 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d56eacc:::benchmark_data_smithi188_119427_object82203:head# 2024-04-01T19:42:46.501 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d574c90:::benchmark_data_smithi188_119427_object136231:head# 2024-04-01T19:42:46.502 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d5848db:::benchmark_data_smithi188_119427_object74921:head# 2024-04-01T19:42:46.502 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d59126a:::benchmark_data_smithi188_119427_object161953:head# 2024-04-01T19:42:46.502 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d594df7:::benchmark_data_smithi188_119427_object89305:head# 2024-04-01T19:42:46.503 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d5a2fff:::benchmark_data_smithi188_119427_object91731:head# 2024-04-01T19:42:46.503 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d5a3d29:::benchmark_data_smithi188_119427_object114283:head# 2024-04-01T19:42:46.504 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d5a9608:::benchmark_data_smithi188_119427_object129584:head# 2024-04-01T19:42:46.504 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d5aab37:::benchmark_data_smithi188_119427_object100746:head# 2024-04-01T19:42:46.505 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d5b91f1:::benchmark_data_smithi188_119427_object97658:head# 2024-04-01T19:42:46.505 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d5bacfc:::benchmark_data_smithi188_119427_object114436:head# 2024-04-01T19:42:46.505 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d5c1feb:::benchmark_data_smithi188_119427_object137947:head# 2024-04-01T19:42:46.506 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d5d23d0:::benchmark_data_smithi188_119427_object129271:head# 2024-04-01T19:42:46.506 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d5ebec8:::benchmark_data_smithi188_119427_object114970:head# 2024-04-01T19:42:46.507 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d5ef990:::benchmark_data_smithi188_119427_object108058:head# 2024-04-01T19:42:46.507 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d5f147c:::benchmark_data_smithi188_119427_object73674:head# 2024-04-01T19:42:46.508 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d5f93b3:::benchmark_data_smithi188_119427_object90357:head# 2024-04-01T19:42:46.508 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d6014f6:::benchmark_data_smithi188_119427_object161341:head# 2024-04-01T19:42:46.509 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d60c9ec:::benchmark_data_smithi188_119427_object125157:head# 2024-04-01T19:42:46.509 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d616f7a:::benchmark_data_smithi188_119427_object119067:head# 2024-04-01T19:42:46.510 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d624bd9:::benchmark_data_smithi188_119427_object73920:head# 2024-04-01T19:42:46.510 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d62b8ab:::benchmark_data_smithi188_119427_object95155:head# 2024-04-01T19:42:46.510 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d62c867:::benchmark_data_smithi188_119427_object156452:head# 2024-04-01T19:42:46.511 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d62e632:::benchmark_data_smithi188_119427_object109947:head# 2024-04-01T19:42:46.511 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d631f9f:::benchmark_data_smithi188_119427_object142651:head# 2024-04-01T19:42:46.512 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d63a54c:::benchmark_data_smithi188_119427_object145357:head# 2024-04-01T19:42:46.512 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d646ab6:::benchmark_data_smithi188_119427_object87335:head# 2024-04-01T19:42:46.513 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d647b2f:::benchmark_data_smithi188_119427_object139818:head# 2024-04-01T19:42:46.513 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d64de7f:::benchmark_data_smithi188_119427_object135096:head# 2024-04-01T19:42:46.516 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d656b37:::benchmark_data_smithi188_119427_object96176:head# 2024-04-01T19:42:46.516 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d657d4b:::benchmark_data_smithi188_119427_object94568:head# 2024-04-01T19:42:46.516 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d65cdfa:::benchmark_data_smithi188_119427_object152763:head# 2024-04-01T19:42:46.516 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d663779:::benchmark_data_smithi188_119427_object81890:head# 2024-04-01T19:42:46.516 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d66777c:::benchmark_data_smithi188_119427_object144379:head# 2024-04-01T19:42:46.517 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d678c1f:::benchmark_data_smithi188_119427_object103222:head# 2024-04-01T19:42:46.519 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d68450f:::benchmark_data_smithi188_119427_object164141:head# 2024-04-01T19:42:46.519 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d6950c7:::benchmark_data_smithi188_119427_object117748:head# 2024-04-01T19:42:46.519 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d69641e:::benchmark_data_smithi188_119427_object155665:head# 2024-04-01T19:42:46.519 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d6977e4:::benchmark_data_smithi188_119427_object94135:head# 2024-04-01T19:42:46.519 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d69ab7b:::benchmark_data_smithi188_119427_object86766:head# 2024-04-01T19:42:46.520 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d6a2174:::benchmark_data_smithi188_119427_object93879:head# 2024-04-01T19:42:46.520 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d6a713e:::benchmark_data_smithi188_119427_object103317:head# 2024-04-01T19:42:46.520 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d6ac99d:::benchmark_data_smithi188_119427_object108207:head# 2024-04-01T19:42:46.521 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d6ad097:::benchmark_data_smithi188_119427_object78902:head# 2024-04-01T19:42:46.525 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d6c0562:::benchmark_data_smithi188_119427_object119422:head# 2024-04-01T19:42:46.526 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d6c7aae:::benchmark_data_smithi188_119427_object94249:head# 2024-04-01T19:42:46.526 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d6d858c:::benchmark_data_smithi188_119427_object132878:head# 2024-04-01T19:42:46.526 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d6e11a3:::benchmark_data_smithi188_119427_object126216:head# 2024-04-01T19:42:46.529 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d6e84ba:::benchmark_data_smithi188_119427_object138381:head# 2024-04-01T19:42:46.530 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d6e8dcb:::benchmark_data_smithi188_119427_object148401:head# 2024-04-01T19:42:46.530 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d6e997c:::benchmark_data_smithi188_119427_object73264:head# 2024-04-01T19:42:46.530 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d6f5d3e:::benchmark_data_smithi188_119427_object78809:head# 2024-04-01T19:42:46.531 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d6fa0ed:::benchmark_data_smithi188_119427_object143415:head# 2024-04-01T19:42:46.531 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d6fa9a3:::benchmark_data_smithi188_119427_object72380:head# 2024-04-01T19:42:46.536 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d7002fe:::benchmark_data_smithi188_119427_object98521:head# 2024-04-01T19:42:46.537 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d729b4c:::benchmark_data_smithi188_119427_object142798:head# 2024-04-01T19:42:46.537 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d73d45a:::benchmark_data_smithi188_119427_object105988:head# 2024-04-01T19:42:46.537 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d73fb71:::benchmark_data_smithi188_119427_object113649:head# 2024-04-01T19:42:46.537 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d7441c5:::benchmark_data_smithi188_119427_object162334:head# 2024-04-01T19:42:46.537 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d74b75c:::benchmark_data_smithi188_119427_object115469:head# 2024-04-01T19:42:46.537 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d763189:::benchmark_data_smithi188_119427_object157667:head# 2024-04-01T19:42:46.537 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d76d97f:::benchmark_data_smithi188_119427_object75979:head# 2024-04-01T19:42:46.537 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d771947:::benchmark_data_smithi188_119427_object148238:head# 2024-04-01T19:42:46.537 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d776192:::benchmark_data_smithi188_119427_object132652:head# 2024-04-01T19:42:46.538 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d7adc81:::benchmark_data_smithi188_119427_object161977:head# 2024-04-01T19:42:46.538 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d7bb7a2:::benchmark_data_smithi188_119427_object130032:head# 2024-04-01T19:42:46.538 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d7bfa07:::benchmark_data_smithi188_119427_object129588:head# 2024-04-01T19:42:46.538 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d7df147:::benchmark_data_smithi188_119427_object149282:head# 2024-04-01T19:42:46.539 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d7e1706:::benchmark_data_smithi188_119427_object72941:head# 2024-04-01T19:42:46.539 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d7e2c77:::benchmark_data_smithi188_119427_object90222:head# 2024-04-01T19:42:46.539 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d7e7509:::benchmark_data_smithi188_119427_object97188:head# 2024-04-01T19:42:46.540 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d7eeb19:::benchmark_data_smithi188_119427_object97389:head# 2024-04-01T19:42:46.540 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d80702c:::benchmark_data_smithi188_119427_object154274:head# 2024-04-01T19:42:46.541 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d8390be:::benchmark_data_smithi188_119427_object148549:head# 2024-04-01T19:42:46.541 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d83ca53:::benchmark_data_smithi188_119427_object84790:head# 2024-04-01T19:42:46.542 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d85a2b1:::benchmark_data_smithi188_119427_object159057:head# 2024-04-01T19:42:46.542 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d8731e5:::benchmark_data_smithi188_119427_object95138:head# 2024-04-01T19:42:46.542 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d884964:::benchmark_data_smithi188_119427_object140592:head# 2024-04-01T19:42:46.543 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d88acc9:::benchmark_data_smithi188_119427_object156282:head# 2024-04-01T19:42:46.543 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d88cddd:::benchmark_data_smithi188_119427_object123620:head# 2024-04-01T19:42:46.544 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d8958ec:::benchmark_data_smithi188_119427_object121811:head# 2024-04-01T19:42:46.544 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d8abc66:::benchmark_data_smithi188_119427_object82689:head# 2024-04-01T19:42:46.545 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d8b02d8:::benchmark_data_smithi188_119427_object88287:head# 2024-04-01T19:42:46.545 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d8c0df8:::benchmark_data_smithi188_119427_object147208:head# 2024-04-01T19:42:46.546 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d8c2e7f:::benchmark_data_smithi188_119427_object163241:head# 2024-04-01T19:42:46.546 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d8d34da:::benchmark_data_smithi188_119427_object126743:head# 2024-04-01T19:42:46.546 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d8d8faa:::benchmark_data_smithi188_119427_object140435:head# 2024-04-01T19:42:46.547 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d8f1b2c:::benchmark_data_smithi188_119427_object113929:head# 2024-04-01T19:42:46.547 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d9046d8:::benchmark_data_smithi188_119427_object99630:head# 2024-04-01T19:42:46.548 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d907d83:::benchmark_data_smithi188_119427_object157644:head# 2024-04-01T19:42:46.548 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d90b51f:::benchmark_data_smithi188_119427_object142702:head# 2024-04-01T19:42:46.549 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d90b59e:::benchmark_data_smithi188_119427_object77098:head# 2024-04-01T19:42:46.549 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d910cba:::benchmark_data_smithi188_119427_object91421:head# 2024-04-01T19:42:46.549 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d920823:::benchmark_data_smithi188_119427_object160538:head# 2024-04-01T19:42:46.550 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d92489f:::benchmark_data_smithi188_119427_object162275:head# 2024-04-01T19:42:46.552 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d932ffe:::benchmark_data_smithi188_119427_object79256:head# 2024-04-01T19:42:46.553 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d93efce:::benchmark_data_smithi188_119427_object156692:head# 2024-04-01T19:42:46.554 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d954d4b:::benchmark_data_smithi188_119427_object93301:head# 2024-04-01T19:42:46.554 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d967afa:::benchmark_data_smithi188_119427_object120457:head# 2024-04-01T19:42:46.554 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d9731a8:::benchmark_data_smithi188_119427_object81889:head# 2024-04-01T19:42:46.555 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d985948:::benchmark_data_smithi188_119427_object104756:head# 2024-04-01T19:42:46.555 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d987013:::benchmark_data_smithi188_119427_object136421:head# 2024-04-01T19:42:46.556 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d994610:::benchmark_data_smithi188_119427_object163025:head# 2024-04-01T19:42:46.556 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d994ea8:::benchmark_data_smithi188_119427_object162888:head# 2024-04-01T19:42:46.557 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d9b9adc:::benchmark_data_smithi188_119427_object147949:head# 2024-04-01T19:42:46.557 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d9bc023:::benchmark_data_smithi188_119427_object128375:head# 2024-04-01T19:42:46.557 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d9bc9e4:::benchmark_data_smithi188_119427_object116569:head# 2024-04-01T19:42:46.558 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d9beea8:::benchmark_data_smithi188_119427_object133063:head# 2024-04-01T19:42:46.558 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d9cead8:::benchmark_data_smithi188_119427_object153061:head# 2024-04-01T19:42:46.559 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d9e2949:::benchmark_data_smithi188_119427_object141519:head# 2024-04-01T19:42:46.559 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d9eaf2e:::benchmark_data_smithi188_119427_object74415:head# 2024-04-01T19:42:46.560 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d9f3c35:::benchmark_data_smithi188_119427_object147242:head# 2024-04-01T19:42:46.560 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d9fe740:::benchmark_data_smithi188_119427_object72968:head# 2024-04-01T19:42:46.561 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4d9ff1be:::benchmark_data_smithi188_119427_object75947:head# 2024-04-01T19:42:46.561 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4da06899:::benchmark_data_smithi188_119427_object102530:head# 2024-04-01T19:42:46.561 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4da0fbde:::benchmark_data_smithi188_119427_object105519:head# 2024-04-01T19:42:46.562 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4da13677:::benchmark_data_smithi188_119427_object87880:head# 2024-04-01T19:42:46.562 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4da3c8a5:::benchmark_data_smithi188_119427_object164307:head# 2024-04-01T19:42:46.563 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4da43755:::benchmark_data_smithi188_119427_object159275:head# 2024-04-01T19:42:46.563 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4da55041:::benchmark_data_smithi188_119427_object151368:head# 2024-04-01T19:42:46.563 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4da6188e:::benchmark_data_smithi188_119427_object99766:head# 2024-04-01T19:42:46.564 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4da69f9c:::benchmark_data_smithi188_119427_object90885:head# 2024-04-01T19:42:46.564 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4da75ded:::benchmark_data_smithi188_119427_object123347:head# 2024-04-01T19:42:46.565 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4da8131d:::benchmark_data_smithi188_119427_object99816:head# 2024-04-01T19:42:46.565 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4da8ccc0:::benchmark_data_smithi188_119427_object152987:head# 2024-04-01T19:42:46.566 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4da8d314:::benchmark_data_smithi188_119427_object161513:head# 2024-04-01T19:42:46.566 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4da9005d:::benchmark_data_smithi188_119427_object92643:head# 2024-04-01T19:42:46.566 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4da94ed6:::benchmark_data_smithi188_119427_object163209:head# 2024-04-01T19:42:46.567 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4da969ce:::benchmark_data_smithi188_119427_object136694:head# 2024-04-01T19:42:46.567 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4daa9ad8:::benchmark_data_smithi188_119427_object127977:head# 2024-04-01T19:42:46.568 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4daabedc:::benchmark_data_smithi188_119427_object94530:head# 2024-04-01T19:42:46.568 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4daac879:::benchmark_data_smithi188_119427_object84644:head# 2024-04-01T19:42:46.569 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dab26a9:::benchmark_data_smithi188_119427_object75135:head# 2024-04-01T19:42:46.569 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dac6001:::benchmark_data_smithi188_119427_object120500:head# 2024-04-01T19:42:46.570 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dad313c:::benchmark_data_smithi188_119427_object100143:head# 2024-04-01T19:42:46.570 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dae7ee2:::benchmark_data_smithi188_119427_object93896:head# 2024-04-01T19:42:46.570 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4daf45dd:::benchmark_data_smithi188_119427_object127003:head# 2024-04-01T19:42:46.571 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4db0428b:::benchmark_data_smithi188_119427_object162953:head# 2024-04-01T19:42:46.571 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4db1aa92:::benchmark_data_smithi188_119427_object148833:head# 2024-04-01T19:42:46.572 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4db21843:::benchmark_data_smithi188_119427_object156229:head# 2024-04-01T19:42:46.572 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4db29660:::benchmark_data_smithi188_119427_object94874:head# 2024-04-01T19:42:46.573 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4db2b146:::benchmark_data_smithi188_119427_object111425:head# 2024-04-01T19:42:46.573 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4db4d06b:::benchmark_data_smithi188_119427_object90037:head# 2024-04-01T19:42:46.574 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4db84aea:::benchmark_data_smithi188_119427_object117107:head# 2024-04-01T19:42:46.574 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4db95bd8:::benchmark_data_smithi188_119427_object156274:head# 2024-04-01T19:42:46.575 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4db9b3e4:::benchmark_data_smithi188_119427_object100558:head# 2024-04-01T19:42:46.575 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dbb6bc0:::benchmark_data_smithi188_119427_object86689:head# 2024-04-01T19:42:46.575 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dbb81c9:::benchmark_data_smithi188_119427_object132732:head# 2024-04-01T19:42:46.576 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dbc1452:::benchmark_data_smithi188_119427_object128551:head# 2024-04-01T19:42:46.576 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dbc3284:::benchmark_data_smithi188_119427_object125656:head# 2024-04-01T19:42:46.579 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dbcc3f7:::benchmark_data_smithi188_119427_object93202:head# 2024-04-01T19:42:46.580 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dbd8fe2:::benchmark_data_smithi188_119427_object106210:head# 2024-04-01T19:42:46.580 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dbdea7e:::benchmark_data_smithi188_119427_object164112:head# 2024-04-01T19:42:46.581 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dbed5f0:::benchmark_data_smithi188_119427_object161413:head# 2024-04-01T19:42:46.581 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dbf3ff4:::benchmark_data_smithi188_119427_object153062:head# 2024-04-01T19:42:46.581 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dbfa32b:::benchmark_data_smithi188_119427_object91035:head# 2024-04-01T19:42:46.582 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dc22791:::benchmark_data_smithi188_119427_object86006:head# 2024-04-01T19:42:46.582 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dc22a51:::benchmark_data_smithi188_119427_object83422:head# 2024-04-01T19:42:46.583 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dc272cf:::benchmark_data_smithi188_119427_object162142:head# 2024-04-01T19:42:46.583 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dc2cc31:::benchmark_data_smithi188_119427_object124563:head# 2024-04-01T19:42:46.584 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dc35754:::benchmark_data_smithi188_119427_object133011:head# 2024-04-01T19:42:46.584 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dc3e920:::benchmark_data_smithi188_119427_object152853:head# 2024-04-01T19:42:46.585 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dc47755:::benchmark_data_smithi188_119427_object147346:head# 2024-04-01T19:42:46.585 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dc4f2fc:::benchmark_data_smithi188_119427_object142371:head# 2024-04-01T19:42:46.585 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dc6e67d:::benchmark_data_smithi188_119427_object84524:head# 2024-04-01T19:42:46.586 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dc7feb2:::benchmark_data_smithi188_119427_object152708:head# 2024-04-01T19:42:46.586 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dc97934:::benchmark_data_smithi188_119427_object144874:head# 2024-04-01T19:42:46.587 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dc98b4f:::benchmark_data_smithi188_119427_object108594:head# 2024-04-01T19:42:46.587 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dc9d275:::benchmark_data_smithi188_119427_object125732:head# 2024-04-01T19:42:46.588 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dca484f:::benchmark_data_smithi188_119427_object81817:head# 2024-04-01T19:42:46.588 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dcc8a8b:::benchmark_data_smithi188_119427_object77368:head# 2024-04-01T19:42:46.589 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dceee81:::benchmark_data_smithi188_119427_object81941:head# 2024-04-01T19:42:46.589 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dd06e5e:::benchmark_data_smithi188_119427_object159004:head# 2024-04-01T19:42:46.589 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dd08d27:::benchmark_data_smithi188_119427_object133437:head# 2024-04-01T19:42:46.590 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dd169c2:::benchmark_data_smithi188_119427_object142908:head# 2024-04-01T19:42:46.590 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dd30ee5:::benchmark_data_smithi188_119427_object122861:head# 2024-04-01T19:42:46.591 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dd3d00a:::benchmark_data_smithi188_119427_object161441:head# 2024-04-01T19:42:46.591 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dd3eecb:::benchmark_data_smithi188_119427_object146736:head# 2024-04-01T19:42:46.591 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dd47288:::benchmark_data_smithi188_119427_object109097:head# 2024-04-01T19:42:46.594 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dd5324f:::benchmark_data_smithi188_119427_object97579:head# 2024-04-01T19:42:46.594 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dd540f0:::benchmark_data_smithi188_119427_object90692:head# 2024-04-01T19:42:46.595 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dd6a494:::benchmark_data_smithi188_119427_object144262:head# 2024-04-01T19:42:46.595 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dd740e5:::benchmark_data_smithi188_119427_object110611:head# 2024-04-01T19:42:46.596 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dd76721:::benchmark_data_smithi188_119427_object134729:head# 2024-04-01T19:42:46.596 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dd89ca5:::benchmark_data_smithi188_119427_object86532:head# 2024-04-01T19:42:46.596 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dd91c98:::benchmark_data_smithi188_119427_object147457:head# 2024-04-01T19:42:46.597 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dda57b4:::benchmark_data_smithi188_119427_object149392:head# 2024-04-01T19:42:46.597 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dda75d0:::benchmark_data_smithi188_119427_object146121:head# 2024-04-01T19:42:46.598 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ddada12:::benchmark_data_smithi188_119427_object149830:head# 2024-04-01T19:42:46.598 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ddb9a19:::benchmark_data_smithi188_119427_object163203:head# 2024-04-01T19:42:46.598 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ddc639d:::benchmark_data_smithi188_119427_object159365:head# 2024-04-01T19:42:46.599 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ddcda9b:::benchmark_data_smithi188_119427_object156190:head# 2024-04-01T19:42:46.600 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ddd611b:::benchmark_data_smithi188_119427_object152379:head# 2024-04-01T19:42:46.600 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dddd65b:::benchmark_data_smithi188_119427_object159779:head# 2024-04-01T19:42:46.600 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dde1408:::benchmark_data_smithi188_119427_object159748:head# 2024-04-01T19:42:46.601 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4de225b5:::benchmark_data_smithi188_119427_object100090:head# 2024-04-01T19:42:46.601 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4de2401c:::benchmark_data_smithi188_119427_object129290:head# 2024-04-01T19:42:46.603 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4de24e2c:::benchmark_data_smithi188_119427_object158570:head# 2024-04-01T19:42:46.604 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4de2a91d:::benchmark_data_smithi188_119427_object97178:head# 2024-04-01T19:42:46.605 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4de2cf4a:::benchmark_data_smithi188_119427_object99190:head# 2024-04-01T19:42:46.605 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4de2eb81:::benchmark_data_smithi188_119427_object108960:head# 2024-04-01T19:42:46.606 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4de3f2f7:::benchmark_data_smithi188_119427_object92138:head# 2024-04-01T19:42:46.606 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4de454b3:::benchmark_data_smithi188_119427_object97454:head# 2024-04-01T19:42:46.607 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4de50264:::benchmark_data_smithi188_119427_object129849:head# 2024-04-01T19:42:46.607 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4de6298b:::benchmark_data_smithi188_119427_object87974:head# 2024-04-01T19:42:46.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4de68266:::benchmark_data_smithi188_119427_object144951:head# 2024-04-01T19:42:46.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4de75a0f:::benchmark_data_smithi188_119427_object126796:head# 2024-04-01T19:42:46.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4de82cc7:::benchmark_data_smithi188_119427_object138137:head# 2024-04-01T19:42:46.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4de89976:::benchmark_data_smithi188_119427_object117447:head# 2024-04-01T19:42:46.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4de8df34:::benchmark_data_smithi188_119427_object108475:head# 2024-04-01T19:42:46.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4de96bef:::benchmark_data_smithi188_119427_object90878:head# 2024-04-01T19:42:46.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4de99abf:::benchmark_data_smithi188_119427_object76444:head# 2024-04-01T19:42:46.611 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dea7f06:::benchmark_data_smithi188_119427_object157754:head# 2024-04-01T19:42:46.612 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4deae8a0:::benchmark_data_smithi188_119427_object114380:head# 2024-04-01T19:42:46.615 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4deaf0a9:::benchmark_data_smithi188_119427_object108600:head# 2024-04-01T19:42:46.615 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4deb05c4:::benchmark_data_smithi188_119427_object159711:head# 2024-04-01T19:42:46.615 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4debffa9:::benchmark_data_smithi188_119427_object104732:head# 2024-04-01T19:42:46.616 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dec44ac:::benchmark_data_smithi188_119427_object72715:head# 2024-04-01T19:42:46.616 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4decc289:::benchmark_data_smithi188_119427_object96630:head# 2024-04-01T19:42:46.617 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ded12cf:::benchmark_data_smithi188_119427_object100441:head# 2024-04-01T19:42:46.617 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dee7985:::benchmark_data_smithi188_119427_object123742:head# 2024-04-01T19:42:46.620 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4def2238:::benchmark_data_smithi188_119427_object116340:head# 2024-04-01T19:42:46.621 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4deffd87:::benchmark_data_smithi188_119427_object123769:head# 2024-04-01T19:42:46.621 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4df2559f:::benchmark_data_smithi188_119427_object78020:head# 2024-04-01T19:42:46.621 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4df27d74:::benchmark_data_smithi188_119427_object93774:head# 2024-04-01T19:42:46.622 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4df311da:::benchmark_data_smithi188_119427_object150829:head# 2024-04-01T19:42:46.622 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4df35d8b:::benchmark_data_smithi188_119427_object150215:head# 2024-04-01T19:42:46.623 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4df61613:::benchmark_data_smithi188_119427_object139630:head# 2024-04-01T19:42:46.623 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4df7c665:::benchmark_data_smithi188_119427_object151687:head# 2024-04-01T19:42:46.625 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4df8f4a3:::benchmark_data_smithi188_119427_object97070:head# 2024-04-01T19:42:46.626 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4df9b1e4:::benchmark_data_smithi188_119427_object121959:head# 2024-04-01T19:42:46.627 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dfa2f88:::benchmark_data_smithi188_119427_object126751:head# 2024-04-01T19:42:46.628 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dfa7d4c:::benchmark_data_smithi188_119427_object141180:head# 2024-04-01T19:42:46.629 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dfbc641:::benchmark_data_smithi188_119427_object104110:head# 2024-04-01T19:42:46.629 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dfc702c:::benchmark_data_smithi188_119427_object126161:head# 2024-04-01T19:42:46.630 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dfdf7ee:::benchmark_data_smithi188_119427_object161406:head# 2024-04-01T19:42:46.630 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dfe447d:::benchmark_data_smithi188_119427_object152628:head# 2024-04-01T19:42:46.630 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dfe4ab3:::benchmark_data_smithi188_119427_object153136:head# 2024-04-01T19:42:46.631 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dff4e7d:::benchmark_data_smithi188_119427_object154172:head# 2024-04-01T19:42:46.633 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dff7221:::benchmark_data_smithi188_119427_object116001:head# 2024-04-01T19:42:46.634 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dff7fc0:::benchmark_data_smithi188_119427_object116226:head# 2024-04-01T19:42:46.634 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dff8a8a:::benchmark_data_smithi188_119427_object124363:head# 2024-04-01T19:42:46.638 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dff93f3:::benchmark_data_smithi188_119427_object104476:head# 2024-04-01T19:42:46.639 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dfff73b:::benchmark_data_smithi188_119427_object85201:head# 2024-04-01T19:42:46.639 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4dfffea3:::benchmark_data_smithi188_119427_object86462:head# 2024-04-01T19:42:46.639 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e000c75:::benchmark_data_smithi188_119427_object75659:head# 2024-04-01T19:42:46.639 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e005b6d:::benchmark_data_smithi188_119427_object98408:head# 2024-04-01T19:42:46.639 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e00c475:::benchmark_data_smithi188_119427_object111747:head# 2024-04-01T19:42:46.639 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e00ed36:::benchmark_data_smithi188_119427_object147021:head# 2024-04-01T19:42:46.639 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e013163:::benchmark_data_smithi188_119427_object79679:head# 2024-04-01T19:42:46.639 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e0254ff:::benchmark_data_smithi188_119427_object154179:head# 2024-04-01T19:42:46.639 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e035e04:::benchmark_data_smithi188_119427_object77214:head# 2024-04-01T19:42:46.641 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e047646:::benchmark_data_smithi188_119427_object120175:head# 2024-04-01T19:42:46.641 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e04f17d:::benchmark_data_smithi188_119427_object73547:head# 2024-04-01T19:42:46.642 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e05a4ab:::benchmark_data_smithi188_119427_object107769:head# 2024-04-01T19:42:46.642 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e05a659:::benchmark_data_smithi188_119427_object82841:head# 2024-04-01T19:42:46.643 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e0801b9:::benchmark_data_smithi188_119427_object86468:head# 2024-04-01T19:42:46.643 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e081755:::benchmark_data_smithi188_119427_object145586:head# 2024-04-01T19:42:46.643 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e09d8a2:::benchmark_data_smithi188_119427_object103647:head# 2024-04-01T19:42:46.644 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e0a025b:::benchmark_data_smithi188_119427_object131835:head# 2024-04-01T19:42:46.644 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e0a3af2:::benchmark_data_smithi188_119427_object109705:head# 2024-04-01T19:42:46.644 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e0b99ce:::benchmark_data_smithi188_119427_object133147:head# 2024-04-01T19:42:46.645 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e0c9850:::benchmark_data_smithi188_119427_object74844:head# 2024-04-01T19:42:46.645 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e0d289c:::benchmark_data_smithi188_119427_object75055:head# 2024-04-01T19:42:46.646 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e0d6abe:::benchmark_data_smithi188_119427_object157944:head# 2024-04-01T19:42:46.651 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e0d6c3f:::benchmark_data_smithi188_119427_object154979:head# 2024-04-01T19:42:46.653 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e0e89f1:::benchmark_data_smithi188_119427_object97187:head# 2024-04-01T19:42:46.653 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e0fd276:::benchmark_data_smithi188_119427_object108777:head# 2024-04-01T19:42:46.653 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e10133e:::benchmark_data_smithi188_119427_object138615:head# 2024-04-01T19:42:46.654 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e10b626:::benchmark_data_smithi188_119427_object113506:head# 2024-04-01T19:42:46.654 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e12aa44:::benchmark_data_smithi188_119427_object80087:head# 2024-04-01T19:42:46.655 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e12f1de:::benchmark_data_smithi188_119427_object113411:head# 2024-04-01T19:42:46.655 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e134a3a:::benchmark_data_smithi188_119427_object97563:head# 2024-04-01T19:42:46.655 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e1394f6:::benchmark_data_smithi188_119427_object94007:head# 2024-04-01T19:42:46.656 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e16015d:::benchmark_data_smithi188_119427_object126460:head# 2024-04-01T19:42:46.656 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e163592:::benchmark_data_smithi188_119427_object91889:head# 2024-04-01T19:42:46.657 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e16c01e:::benchmark_data_smithi188_119427_object100834:head# 2024-04-01T19:42:46.657 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e173db4:::benchmark_data_smithi188_119427_object91091:head# 2024-04-01T19:42:46.658 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e195ff9:::benchmark_data_smithi188_119427_object115017:head# 2024-04-01T19:42:46.658 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e1aacf4:::benchmark_data_smithi188_119427_object160508:head# 2024-04-01T19:42:46.659 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e1adb6c:::benchmark_data_smithi188_119427_object153677:head# 2024-04-01T19:42:46.659 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e1c042d:::benchmark_data_smithi188_119427_object137695:head# 2024-04-01T19:42:46.660 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e1c4398:::benchmark_data_smithi188_119427_object153256:head# 2024-04-01T19:42:46.660 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e1c6308:::benchmark_data_smithi188_119427_object114894:head# 2024-04-01T19:42:46.661 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e1c8246:::benchmark_data_smithi188_119427_object99553:head# 2024-04-01T19:42:46.661 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e1db176:::benchmark_data_smithi188_119427_object72598:head# 2024-04-01T19:42:46.661 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e1e99ee:::benchmark_data_smithi188_119427_object122514:head# 2024-04-01T19:42:46.662 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e1eec6d:::benchmark_data_smithi188_119427_object97274:head# 2024-04-01T19:42:46.662 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e1ef39c:::benchmark_data_smithi188_119427_object76897:head# 2024-04-01T19:42:46.663 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e1ff6d5:::benchmark_data_smithi188_119427_object117228:head# 2024-04-01T19:42:46.663 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e208efe:::benchmark_data_smithi188_119427_object88841:head# 2024-04-01T19:42:46.664 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e212f03:::benchmark_data_smithi188_119427_object134050:head# 2024-04-01T19:42:46.664 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e228d1b:::benchmark_data_smithi188_119427_object86495:head# 2024-04-01T19:42:46.665 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e233877:::benchmark_data_smithi188_119427_object78702:head# 2024-04-01T19:42:46.665 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e23925f:::benchmark_data_smithi188_119427_object94793:head# 2024-04-01T19:42:46.666 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e23a6d1:::benchmark_data_smithi188_119427_object92817:head# 2024-04-01T19:42:46.666 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e23c831:::benchmark_data_smithi188_119427_object78709:head# 2024-04-01T19:42:46.667 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e23d32d:::benchmark_data_smithi188_119427_object133689:head# 2024-04-01T19:42:46.667 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e247d54:::benchmark_data_smithi188_119427_object72853:head# 2024-04-01T19:42:46.668 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e24b492:::benchmark_data_smithi188_119427_object129866:head# 2024-04-01T19:42:46.668 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e24e48e:::benchmark_data_smithi188_119427_object95170:head# 2024-04-01T19:42:46.670 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e275fdb:::benchmark_data_smithi188_119427_object146349:head# 2024-04-01T19:42:46.670 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e283f0b:::benchmark_data_smithi188_119427_object118869:head# 2024-04-01T19:42:46.671 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e2860ea:::benchmark_data_smithi188_119427_object122414:head# 2024-04-01T19:42:46.671 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e2869b2:::benchmark_data_smithi188_119427_object153492:head# 2024-04-01T19:42:46.671 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e286f94:::benchmark_data_smithi188_119427_object127633:head# 2024-04-01T19:42:46.672 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e289406:::benchmark_data_smithi188_119427_object131915:head# 2024-04-01T19:42:46.672 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e29211f:::benchmark_data_smithi188_119427_object160583:head# 2024-04-01T19:42:46.673 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e294504:::benchmark_data_smithi188_119427_object85729:head# 2024-04-01T19:42:46.673 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e29fc46:::benchmark_data_smithi188_119427_object134226:head# 2024-04-01T19:42:46.673 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e2a0e63:::benchmark_data_smithi188_119427_object154448:head# 2024-04-01T19:42:46.674 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e2ab1db:::benchmark_data_smithi188_119427_object129540:head# 2024-04-01T19:42:46.674 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e2ae06a:::benchmark_data_smithi188_119427_object159155:head# 2024-04-01T19:42:46.675 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e2bb4d1:::benchmark_data_smithi188_119427_object123852:head# 2024-04-01T19:42:46.675 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e2be1b4:::benchmark_data_smithi188_119427_object84175:head# 2024-04-01T19:42:46.675 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e2c351c:::benchmark_data_smithi188_119427_object125039:head# 2024-04-01T19:42:46.678 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e2c7b9e:::benchmark_data_smithi188_119427_object94128:head# 2024-04-01T19:42:46.679 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e2d9540:::benchmark_data_smithi188_119427_object111074:head# 2024-04-01T19:42:46.679 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e2f2ad6:::benchmark_data_smithi188_119427_object106976:head# 2024-04-01T19:42:46.680 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e2f8dd9:::benchmark_data_smithi188_119427_object74169:head# 2024-04-01T19:42:46.680 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e2ff05e:::benchmark_data_smithi188_119427_object97770:head# 2024-04-01T19:42:46.681 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e30420b:::benchmark_data_smithi188_119427_object149779:head# 2024-04-01T19:42:46.681 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e316065:::benchmark_data_smithi188_119427_object78826:head# 2024-04-01T19:42:46.682 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e31d214:::benchmark_data_smithi188_119427_object147487:head# 2024-04-01T19:42:46.682 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e31e1d5:::benchmark_data_smithi188_119427_object157191:head# 2024-04-01T19:42:46.682 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e32b279:::benchmark_data_smithi188_119427_object93627:head# 2024-04-01T19:42:46.683 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e3393ae:::benchmark_data_smithi188_119427_object154678:head# 2024-04-01T19:42:46.683 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e34101b:::benchmark_data_smithi188_119427_object161498:head# 2024-04-01T19:42:46.684 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e342d37:::benchmark_data_smithi188_119427_object159757:head# 2024-04-01T19:42:46.684 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e346541:::benchmark_data_smithi188_119427_object102965:head# 2024-04-01T19:42:46.685 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e34f93b:::benchmark_data_smithi188_119427_object73936:head# 2024-04-01T19:42:46.685 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e356723:::benchmark_data_smithi188_119427_object84436:head# 2024-04-01T19:42:46.686 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e35c4a0:::benchmark_data_smithi188_119427_object146541:head# 2024-04-01T19:42:46.686 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e377656:::benchmark_data_smithi188_119427_object159048:head# 2024-04-01T19:42:46.687 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e378a03:::benchmark_data_smithi188_119427_object94699:head# 2024-04-01T19:42:46.687 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e379392:::benchmark_data_smithi188_119427_object146557:head# 2024-04-01T19:42:46.688 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e37b322:::benchmark_data_smithi188_119427_object157529:head# 2024-04-01T19:42:46.688 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e3835be:::benchmark_data_smithi188_119427_object126600:head# 2024-04-01T19:42:46.688 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e3884ac:::benchmark_data_smithi188_119427_object159708:head# 2024-04-01T19:42:46.689 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e39c214:::benchmark_data_smithi188_119427_object99414:head# 2024-04-01T19:42:46.689 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e3a6957:::benchmark_data_smithi188_119427_object82978:head# 2024-04-01T19:42:46.690 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e3a7a1d:::benchmark_data_smithi188_119427_object84839:head# 2024-04-01T19:42:46.690 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e3aed7b:::benchmark_data_smithi188_119427_object149963:head# 2024-04-01T19:42:46.691 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e3b5696:::benchmark_data_smithi188_119427_object116532:head# 2024-04-01T19:42:46.691 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e3bca97:::benchmark_data_smithi188_119427_object109589:head# 2024-04-01T19:42:46.691 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e3d020b:::benchmark_data_smithi188_119427_object122741:head# 2024-04-01T19:42:46.692 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e3d20d0:::benchmark_data_smithi188_119427_object97411:head# 2024-04-01T19:42:46.692 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e3eac46:::benchmark_data_smithi188_119427_object127375:head# 2024-04-01T19:42:46.695 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e3eda49:::benchmark_data_smithi188_119427_object72998:head# 2024-04-01T19:42:46.695 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e3fadd1:::benchmark_data_smithi188_119427_object146570:head# 2024-04-01T19:42:46.696 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e3fe299:::benchmark_data_smithi188_119427_object139918:head# 2024-04-01T19:42:46.696 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e400840:::benchmark_data_smithi188_119427_object132135:head# 2024-04-01T19:42:46.696 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e406c31:::benchmark_data_smithi188_119427_object128242:head# 2024-04-01T19:42:46.696 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e41895c:::benchmark_data_smithi188_119427_object146412:head# 2024-04-01T19:42:46.696 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e41cedd:::benchmark_data_smithi188_119427_object93435:head# 2024-04-01T19:42:46.697 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e426dfd:::benchmark_data_smithi188_119427_object126606:head# 2024-04-01T19:42:46.697 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e42d01c:::benchmark_data_smithi188_119427_object163482:head# 2024-04-01T19:42:46.697 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e43a4fd:::benchmark_data_smithi188_119427_object156912:head# 2024-04-01T19:42:46.698 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e4506c6:::benchmark_data_smithi188_119427_object101784:head# 2024-04-01T19:42:46.698 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e475f25:::benchmark_data_smithi188_119427_object112355:head# 2024-04-01T19:42:46.698 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e478a7f:::benchmark_data_smithi188_119427_object90407:head# 2024-04-01T19:42:46.698 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e47f929:::benchmark_data_smithi188_119427_object140964:head# 2024-04-01T19:42:46.699 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e480811:::benchmark_data_smithi188_119427_object160022:head# 2024-04-01T19:42:46.700 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e496de9:::benchmark_data_smithi188_119427_object119206:head# 2024-04-01T19:42:46.700 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e49ddd1:::benchmark_data_smithi188_119427_object75653:head# 2024-04-01T19:42:46.700 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e4a49aa:::benchmark_data_smithi188_119427_object109679:head# 2024-04-01T19:42:46.701 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e4aba5d:::benchmark_data_smithi188_119427_object75703:head# 2024-04-01T19:42:46.701 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e4cccd1:::benchmark_data_smithi188_119427_object133623:head# 2024-04-01T19:42:46.701 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e4d17b5:::benchmark_data_smithi188_119427_object90052:head# 2024-04-01T19:42:46.702 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e4d6110:::benchmark_data_smithi188_119427_object115769:head# 2024-04-01T19:42:46.702 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e4d7304:::benchmark_data_smithi188_119427_object135234:head# 2024-04-01T19:42:46.703 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e4ec656:::benchmark_data_smithi188_119427_object127133:head# 2024-04-01T19:42:46.703 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e4fb943:::benchmark_data_smithi188_119427_object82674:head# 2024-04-01T19:42:46.704 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e4fce2b:::benchmark_data_smithi188_119427_object136558:head# 2024-04-01T19:42:46.704 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e50361f:::benchmark_data_smithi188_119427_object163832:head# 2024-04-01T19:42:46.704 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e511420:::benchmark_data_smithi188_119427_object146508:head# 2024-04-01T19:42:46.705 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e527198:::benchmark_data_smithi188_119427_object157875:head# 2024-04-01T19:42:46.706 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e54daf1:::benchmark_data_smithi188_119427_object92702:head# 2024-04-01T19:42:46.706 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e555398:::benchmark_data_smithi188_119427_object114844:head# 2024-04-01T19:42:46.706 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e557ba4:::benchmark_data_smithi188_119427_object77736:head# 2024-04-01T19:42:46.707 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e557cc3:::benchmark_data_smithi188_119427_object156752:head# 2024-04-01T19:42:46.707 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e565cdb:::benchmark_data_smithi188_119427_object83450:head# 2024-04-01T19:42:46.712 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e56ccd9:::benchmark_data_smithi188_119427_object104484:head# 2024-04-01T19:42:46.712 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e573a18:::benchmark_data_smithi188_119427_object138221:head# 2024-04-01T19:42:46.712 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e594adc:::benchmark_data_smithi188_119427_object99152:head# 2024-04-01T19:42:46.712 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e5959bb:::benchmark_data_smithi188_119427_object89796:head# 2024-04-01T19:42:46.712 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e5a6150:::benchmark_data_smithi188_119427_object109148:head# 2024-04-01T19:42:46.712 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e5b454d:::benchmark_data_smithi188_119427_object87046:head# 2024-04-01T19:42:46.712 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e5bb033:::benchmark_data_smithi188_119427_object148839:head# 2024-04-01T19:42:46.712 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e5bbc77:::benchmark_data_smithi188_119427_object78502:head# 2024-04-01T19:42:46.712 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e5bec87:::benchmark_data_smithi188_119427_object105648:head# 2024-04-01T19:42:46.714 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e5ca802:::benchmark_data_smithi188_119427_object75267:head# 2024-04-01T19:42:46.715 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e5eb5f8:::benchmark_data_smithi188_119427_object151961:head# 2024-04-01T19:42:46.715 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e5ec461:::benchmark_data_smithi188_119427_object149807:head# 2024-04-01T19:42:46.716 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e5edba2:::benchmark_data_smithi188_119427_object89307:head# 2024-04-01T19:42:46.716 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e5ee432:::benchmark_data_smithi188_119427_object106464:head# 2024-04-01T19:42:46.717 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e5ef1ef:::benchmark_data_smithi188_119427_object159464:head# 2024-04-01T19:42:46.717 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e5fe918:::benchmark_data_smithi188_119427_object102411:head# 2024-04-01T19:42:46.717 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e6016a7:::benchmark_data_smithi188_119427_object83353:head# 2024-04-01T19:42:46.718 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e60dd7c:::benchmark_data_smithi188_119427_object149280:head# 2024-04-01T19:42:46.718 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e61036d:::benchmark_data_smithi188_119427_object117348:head# 2024-04-01T19:42:46.719 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e61be13:::benchmark_data_smithi188_119427_object125491:head# 2024-04-01T19:42:46.719 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e62426f:::benchmark_data_smithi188_119427_object120691:head# 2024-04-01T19:42:46.720 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e6258d7:::benchmark_data_smithi188_119427_object161295:head# 2024-04-01T19:42:46.720 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e62bcfa:::benchmark_data_smithi188_119427_object144308:head# 2024-04-01T19:42:46.721 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e631add:::benchmark_data_smithi188_119427_object163577:head# 2024-04-01T19:42:46.721 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e64cdd3:::benchmark_data_smithi188_119427_object157484:head# 2024-04-01T19:42:46.721 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e66e1e9:::benchmark_data_smithi188_119427_object106608:head# 2024-04-01T19:42:46.722 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e695211:::benchmark_data_smithi188_119427_object143823:head# 2024-04-01T19:42:46.722 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e6983a1:::benchmark_data_smithi188_119427_object159521:head# 2024-04-01T19:42:46.723 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e6a1d2e:::benchmark_data_smithi188_119427_object146929:head# 2024-04-01T19:42:46.723 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e6a69cc:::benchmark_data_smithi188_119427_object162039:head# 2024-04-01T19:42:46.724 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e6b61fe:::benchmark_data_smithi188_119427_object142583:head# 2024-04-01T19:42:46.724 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e6c5053:::benchmark_data_smithi188_119427_object93894:head# 2024-04-01T19:42:46.725 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e6e9ce7:::benchmark_data_smithi188_119427_object161830:head# 2024-04-01T19:42:46.725 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e6f0b0f:::benchmark_data_smithi188_119427_object122232:head# 2024-04-01T19:42:46.725 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e6f2c10:::benchmark_data_smithi188_119427_object118428:head# 2024-04-01T19:42:46.726 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e6f9dd4:::benchmark_data_smithi188_119427_object148319:head# 2024-04-01T19:42:46.726 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e6ff88d:::benchmark_data_smithi188_119427_object148415:head# 2024-04-01T19:42:46.733 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e7164b1:::benchmark_data_smithi188_119427_object75642:head# 2024-04-01T19:42:46.733 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e724f1c:::benchmark_data_smithi188_119427_object135181:head# 2024-04-01T19:42:46.733 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e728978:::benchmark_data_smithi188_119427_object84035:head# 2024-04-01T19:42:46.733 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e73039a:::benchmark_data_smithi188_119427_object138152:head# 2024-04-01T19:42:46.733 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e738ff6:::benchmark_data_smithi188_119427_object76859:head# 2024-04-01T19:42:46.733 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e7421df:::benchmark_data_smithi188_119427_object142594:head# 2024-04-01T19:42:46.734 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e742a26:::benchmark_data_smithi188_119427_object113776:head# 2024-04-01T19:42:46.734 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e751278:::benchmark_data_smithi188_119427_object85329:head# 2024-04-01T19:42:46.734 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e753767:::benchmark_data_smithi188_119427_object140417:head# 2024-04-01T19:42:46.734 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e76753c:::benchmark_data_smithi188_119427_object141411:head# 2024-04-01T19:42:46.734 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e773c5e:::benchmark_data_smithi188_119427_object117028:head# 2024-04-01T19:42:46.735 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e77cbf8:::benchmark_data_smithi188_119427_object102540:head# 2024-04-01T19:42:46.735 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e78158d:::benchmark_data_smithi188_119427_object93811:head# 2024-04-01T19:42:46.736 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e7a7b38:::benchmark_data_smithi188_119427_object131062:head# 2024-04-01T19:42:46.736 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e7b8845:::benchmark_data_smithi188_119427_object121311:head# 2024-04-01T19:42:46.737 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e7c5cff:::benchmark_data_smithi188_119427_object76545:head# 2024-04-01T19:42:46.737 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e7d2136:::benchmark_data_smithi188_119427_object119635:head# 2024-04-01T19:42:46.738 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e7f33bb:::benchmark_data_smithi188_119427_object129219:head# 2024-04-01T19:42:46.738 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e7f5dad:::benchmark_data_smithi188_119427_object132918:head# 2024-04-01T19:42:46.739 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e806465:::benchmark_data_smithi188_119427_object163539:head# 2024-04-01T19:42:46.739 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e813885:::benchmark_data_smithi188_119427_object117033:head# 2024-04-01T19:42:46.739 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e833131:::benchmark_data_smithi188_119427_object87234:head# 2024-04-01T19:42:46.740 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e83db7a:::benchmark_data_smithi188_119427_object161338:head# 2024-04-01T19:42:46.740 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e844ff8:::benchmark_data_smithi188_119427_object105840:head# 2024-04-01T19:42:46.741 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e846954:::benchmark_data_smithi188_119427_object123641:head# 2024-04-01T19:42:46.741 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e846ad4:::benchmark_data_smithi188_119427_object99800:head# 2024-04-01T19:42:46.742 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e84c7be:::benchmark_data_smithi188_119427_object140457:head# 2024-04-01T19:42:46.742 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e85ac3e:::benchmark_data_smithi188_119427_object75802:head# 2024-04-01T19:42:46.743 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e868c1c:::benchmark_data_smithi188_119427_object80806:head# 2024-04-01T19:42:46.743 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e8690f3:::benchmark_data_smithi188_119427_object123660:head# 2024-04-01T19:42:46.744 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e86ddcc:::benchmark_data_smithi188_119427_object78191:head# 2024-04-01T19:42:46.744 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e87078d:::benchmark_data_smithi188_119427_object90898:head# 2024-04-01T19:42:46.744 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e8779fd:::benchmark_data_smithi188_119427_object157399:head# 2024-04-01T19:42:46.745 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e87d51d:::benchmark_data_smithi188_119427_object120813:head# 2024-04-01T19:42:46.745 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e887219:::benchmark_data_smithi188_119427_object86572:head# 2024-04-01T19:42:46.745 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e896d71:::benchmark_data_smithi188_119427_object115202:head# 2024-04-01T19:42:46.746 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e89d1fc:::benchmark_data_smithi188_119427_object145816:head# 2024-04-01T19:42:46.747 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e8a5834:::benchmark_data_smithi188_119427_object104886:head# 2024-04-01T19:42:46.748 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e8aa6a7:::benchmark_data_smithi188_119427_object83153:head# 2024-04-01T19:42:46.748 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e8ac215:::benchmark_data_smithi188_119427_object94382:head# 2024-04-01T19:42:46.752 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e8afcf9:::benchmark_data_smithi188_119427_object82483:head# 2024-04-01T19:42:46.753 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e8bfed0:::benchmark_data_smithi188_119427_object95029:head# 2024-04-01T19:42:46.753 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e8df275:::benchmark_data_smithi188_119427_object85759:head# 2024-04-01T19:42:46.753 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e8e8e6a:::benchmark_data_smithi188_119427_object125468:head# 2024-04-01T19:42:46.753 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e8ea4d3:::benchmark_data_smithi188_119427_object152726:head# 2024-04-01T19:42:46.753 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e8f2c95:::benchmark_data_smithi188_119427_object94266:head# 2024-04-01T19:42:46.753 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e900ce9:::benchmark_data_smithi188_119427_object108433:head# 2024-04-01T19:42:46.753 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e911bcc:::benchmark_data_smithi188_119427_object123756:head# 2024-04-01T19:42:46.753 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e925a96:::benchmark_data_smithi188_119427_object106301:head# 2024-04-01T19:42:46.753 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e92b4d2:::benchmark_data_smithi188_119427_object144855:head# 2024-04-01T19:42:46.754 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e92d4a6:::benchmark_data_smithi188_119427_object161546:head# 2024-04-01T19:42:46.755 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e9309c5:::benchmark_data_smithi188_119427_object135249:head# 2024-04-01T19:42:46.755 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e936d4e:::benchmark_data_smithi188_119427_object154445:head# 2024-04-01T19:42:46.755 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e936d85:::benchmark_data_smithi188_119427_object127027:head# 2024-04-01T19:42:46.755 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e938221:::benchmark_data_smithi188_119427_object92241:head# 2024-04-01T19:42:46.755 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e946303:::benchmark_data_smithi188_119427_object82434:head# 2024-04-01T19:42:46.756 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e946b70:::benchmark_data_smithi188_119427_object78819:head# 2024-04-01T19:42:46.756 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e94f1c3:::benchmark_data_smithi188_119427_object118315:head# 2024-04-01T19:42:46.756 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e95e2dc:::benchmark_data_smithi188_119427_object87578:head# 2024-04-01T19:42:46.757 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e95e885:::benchmark_data_smithi188_119427_object136072:head# 2024-04-01T19:42:46.757 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e975b4e:::benchmark_data_smithi188_119427_object111799:head# 2024-04-01T19:42:46.758 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e998af0:::benchmark_data_smithi188_119427_object103208:head# 2024-04-01T19:42:46.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:46 smithi062 ceph-mon[44211]: 5.4 scrub starts 2024-04-01T19:42:46.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:46 smithi062 ceph-mon[44211]: 5.1 scrub starts 2024-04-01T19:42:46.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:46 smithi062 ceph-mon[44211]: 5.7 scrub starts 2024-04-01T19:42:46.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:46 smithi062 ceph-mon[44211]: osdmap e438: 12 total, 11 up, 10 in 2024-04-01T19:42:46.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:46 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T19:42:46.766 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e99921e:::benchmark_data_smithi188_119427_object107505:head# 2024-04-01T19:42:46.766 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e9a4136:::benchmark_data_smithi188_119427_object162263:head# 2024-04-01T19:42:46.766 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e9a9337:::benchmark_data_smithi188_119427_object119984:head# 2024-04-01T19:42:46.766 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e9d1492:::benchmark_data_smithi188_119427_object119478:head# 2024-04-01T19:42:46.766 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e9ef4fa:::benchmark_data_smithi188_119427_object112910:head# 2024-04-01T19:42:46.767 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4e9f3c82:::benchmark_data_smithi188_119427_object76059:head# 2024-04-01T19:42:46.767 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ea01cd8:::benchmark_data_smithi188_119427_object123682:head# 2024-04-01T19:42:46.767 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ea0fc09:::benchmark_data_smithi188_119427_object124091:head# 2024-04-01T19:42:46.767 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ea20e7d:::benchmark_data_smithi188_119427_object108141:head# 2024-04-01T19:42:46.767 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ea45846:::benchmark_data_smithi188_119427_object161137:head# 2024-04-01T19:42:46.767 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ea54d8b:::benchmark_data_smithi188_119427_object75867:head# 2024-04-01T19:42:46.767 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ea55bde:::benchmark_data_smithi188_119427_object110772:head# 2024-04-01T19:42:46.768 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ea64a40:::benchmark_data_smithi188_119427_object102084:head# 2024-04-01T19:42:46.768 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ea6dcbb:::benchmark_data_smithi188_119427_object98137:head# 2024-04-01T19:42:46.768 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ea95f49:::benchmark_data_smithi188_119427_object135787:head# 2024-04-01T19:42:46.768 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:42:46.769 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eaa02e1:::benchmark_data_smithi188_119427_object152190:head# 2024-04-01T19:42:46.769 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eaa6da7:::benchmark_data_smithi188_119427_object121948:head# 2024-04-01T19:42:46.769 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eab5f64:::benchmark_data_smithi188_119427_object133434:head# 2024-04-01T19:42:46.769 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eac4416:::benchmark_data_smithi188_119427_object114882:head# 2024-04-01T19:42:46.773 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eac4e94:::benchmark_data_smithi188_119427_object152986:head# 2024-04-01T19:42:46.773 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eae8d60:::benchmark_data_smithi188_119427_object131962:head# 2024-04-01T19:42:46.773 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eb0afe7:::benchmark_data_smithi188_119427_object139511:head# 2024-04-01T19:42:46.773 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eb0c496:::benchmark_data_smithi188_119427_object148292:head# 2024-04-01T19:42:46.773 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eb16221:::benchmark_data_smithi188_119427_object77964:head# 2024-04-01T19:42:46.774 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eb2257d:::benchmark_data_smithi188_119427_object110488:head# 2024-04-01T19:42:46.774 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eb23e2e:::benchmark_data_smithi188_119427_object111062:head# 2024-04-01T19:42:46.774 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eb27f29:::benchmark_data_smithi188_119427_object90681:head# 2024-04-01T19:42:46.774 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eb28b61:::benchmark_data_smithi188_119427_object155276:head# 2024-04-01T19:42:46.775 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eb2e04e:::benchmark_data_smithi188_119427_object98379:head# 2024-04-01T19:42:46.775 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eb40624:::benchmark_data_smithi188_119427_object129015:head# 2024-04-01T19:42:46.775 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eb462e8:::benchmark_data_smithi188_119427_object138841:head# 2024-04-01T19:42:46.775 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eb48241:::benchmark_data_smithi188_119427_object119636:head# 2024-04-01T19:42:46.776 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eb49557:::benchmark_data_smithi188_119427_object116749:head# 2024-04-01T19:42:46.776 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eb564d5:::benchmark_data_smithi188_119427_object141510:head# 2024-04-01T19:42:46.776 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:46.777 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:42:46.777 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eb5ee11:::benchmark_data_smithi188_119427_object86471:head# 2024-04-01T19:42:46.777 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eb61443:::benchmark_data_smithi188_119427_object122007:head# 2024-04-01T19:42:46.781 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eb7031d:::benchmark_data_smithi188_119427_object122813:head# 2024-04-01T19:42:46.781 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eb70ed9:::benchmark_data_smithi188_119427_object78511:head# 2024-04-01T19:42:46.781 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eb8b67b:::benchmark_data_smithi188_119427_object90836:head# 2024-04-01T19:42:46.781 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ebb10dd:::benchmark_data_smithi188_119427_object131552:head# 2024-04-01T19:42:46.781 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ebb9f89:::benchmark_data_smithi188_119427_object152233:head# 2024-04-01T19:42:46.781 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ebbb8c0:::benchmark_data_smithi188_119427_object157675:head# 2024-04-01T19:42:46.781 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ebc3488:::benchmark_data_smithi188_119427_object107975:head# 2024-04-01T19:42:46.781 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ebd8514:::benchmark_data_smithi188_119427_object127629:head# 2024-04-01T19:42:46.782 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ebda638:::benchmark_data_smithi188_119427_object91317:head# 2024-04-01T19:42:46.782 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ebf5dcb:::benchmark_data_smithi188_119427_object77022:head# 2024-04-01T19:42:46.782 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ec0336c:::benchmark_data_smithi188_119427_object158958:head# 2024-04-01T19:42:46.782 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ec0428d:::benchmark_data_smithi188_119427_object114325:head# 2024-04-01T19:42:46.783 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ec0476b:::benchmark_data_smithi188_119427_object150496:head# 2024-04-01T19:42:46.783 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ec0bbcb:::benchmark_data_smithi188_119427_object95335:head# 2024-04-01T19:42:46.784 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ec1f532:::benchmark_data_smithi188_119427_object97824:head# 2024-04-01T19:42:46.784 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ec2a6a3:::benchmark_data_smithi188_119427_object102081:head# 2024-04-01T19:42:46.784 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ec38a19:::benchmark_data_smithi188_119427_object157409:head# 2024-04-01T19:42:46.785 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ec45aa6:::benchmark_data_smithi188_119427_object154633:head# 2024-04-01T19:42:46.785 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ec45f55:::benchmark_data_smithi188_119427_object156663:head# 2024-04-01T19:42:46.786 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ec542fb:::benchmark_data_smithi188_119427_object73840:head# 2024-04-01T19:42:46.786 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ec56e7c:::benchmark_data_smithi188_119427_object136564:head# 2024-04-01T19:42:46.787 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ec5f1df:::benchmark_data_smithi188_119427_object144407:head# 2024-04-01T19:42:46.787 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ec70752:::benchmark_data_smithi188_119427_object122312:head# 2024-04-01T19:42:46.788 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ec71f34:::benchmark_data_smithi188_119427_object114932:head# 2024-04-01T19:42:46.793 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ec7c1a9:::benchmark_data_smithi188_119427_object158347:head# 2024-04-01T19:42:46.793 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ec8a98e:::benchmark_data_smithi188_119427_object157563:head# 2024-04-01T19:42:46.793 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ec9fa5d:::benchmark_data_smithi188_119427_object111886:head# 2024-04-01T19:42:46.793 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ecde323:::benchmark_data_smithi188_119427_object154694:head# 2024-04-01T19:42:46.794 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ece8140:::benchmark_data_smithi188_119427_object146385:head# 2024-04-01T19:42:46.794 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ecfe8db:::benchmark_data_smithi188_119427_object158697:head# 2024-04-01T19:42:46.794 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ed07d65:::benchmark_data_smithi188_119427_object123721:head# 2024-04-01T19:42:46.795 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ed0b3bd:::benchmark_data_smithi188_119427_object122172:head# 2024-04-01T19:42:46.795 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ed29678:::benchmark_data_smithi188_119427_object161734:head# 2024-04-01T19:42:46.795 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ed33f09:::benchmark_data_smithi188_119427_object90617:head# 2024-04-01T19:42:46.796 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ed3e24c:::benchmark_data_smithi188_119427_object98874:head# 2024-04-01T19:42:46.796 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ed45180:::benchmark_data_smithi188_119427_object109131:head# 2024-04-01T19:42:46.797 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ed4e150:::benchmark_data_smithi188_119427_object136123:head# 2024-04-01T19:42:46.797 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ed620a9:::benchmark_data_smithi188_119427_object140860:head# 2024-04-01T19:42:46.799 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ed67e2d:::benchmark_data_smithi188_119427_object84233:head# 2024-04-01T19:42:46.800 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ed6b8e6:::benchmark_data_smithi188_119427_object161973:head# 2024-04-01T19:42:46.800 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ed6dd07:::benchmark_data_smithi188_119427_object134033:head# 2024-04-01T19:42:46.801 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ed72e30:::benchmark_data_smithi188_119427_object120376:head# 2024-04-01T19:42:46.801 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ed77530:::benchmark_data_smithi188_119427_object117783:head# 2024-04-01T19:42:46.802 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ed7e091:::benchmark_data_smithi188_119427_object135789:head# 2024-04-01T19:42:46.802 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4edabb2d:::benchmark_data_smithi188_119427_object144216:head# 2024-04-01T19:42:46.803 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4edb2959:::benchmark_data_smithi188_119427_object73621:head# 2024-04-01T19:42:46.803 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4edb7226:::benchmark_data_smithi188_119427_object94142:head# 2024-04-01T19:42:46.803 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4edb8123:::benchmark_data_smithi188_119427_object110839:head# 2024-04-01T19:42:46.804 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4edbb265:::benchmark_data_smithi188_119427_object94303:head# 2024-04-01T19:42:46.804 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4edc1d0a:::benchmark_data_smithi188_119427_object103712:head# 2024-04-01T19:42:46.805 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4edc5ac2:::benchmark_data_smithi188_119427_object106064:head# 2024-04-01T19:42:46.805 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4edcc1f0:::benchmark_data_smithi188_119427_object78918:head# 2024-04-01T19:42:46.809 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4edd5502:::benchmark_data_smithi188_119427_object110407:head# 2024-04-01T19:42:46.809 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4edd5b82:::benchmark_data_smithi188_119427_object143245:head# 2024-04-01T19:42:46.809 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ede4149:::benchmark_data_smithi188_119427_object76526:head# 2024-04-01T19:42:46.809 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4edf3dab:::benchmark_data_smithi188_119427_object161229:head# 2024-04-01T19:42:46.810 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4edf4537:::benchmark_data_smithi188_119427_object149906:head# 2024-04-01T19:42:46.810 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4edfe4e0:::benchmark_data_smithi188_119427_object102306:head# 2024-04-01T19:42:46.815 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ee02426:::benchmark_data_smithi188_119427_object91478:head# 2024-04-01T19:42:46.815 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ee124cc:::benchmark_data_smithi188_119427_object90272:head# 2024-04-01T19:42:46.815 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ee20042:::benchmark_data_smithi188_119427_object111386:head# 2024-04-01T19:42:46.815 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ee2420a:::benchmark_data_smithi188_119427_object84111:head# 2024-04-01T19:42:46.815 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ee4faa3:::benchmark_data_smithi188_119427_object140621:head# 2024-04-01T19:42:46.815 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ee58b27:::benchmark_data_smithi188_119427_object160930:head# 2024-04-01T19:42:46.816 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ee5a357:::benchmark_data_smithi188_119427_object132783:head# 2024-04-01T19:42:46.816 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ee5b7d8:::benchmark_data_smithi188_119427_object131676:head# 2024-04-01T19:42:46.816 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ee60471:::benchmark_data_smithi188_119427_object111643:head# 2024-04-01T19:42:46.816 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ee6f7fc:::benchmark_data_smithi188_119427_object103250:head# 2024-04-01T19:42:46.816 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ee8474c:::benchmark_data_smithi188_119427_object125539:head# 2024-04-01T19:42:46.816 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ee87c3e:::benchmark_data_smithi188_119427_object145740:head# 2024-04-01T19:42:46.816 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ee9b883:::benchmark_data_smithi188_119427_object162741:head# 2024-04-01T19:42:46.820 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eea0039:::benchmark_data_smithi188_119427_object145291:head# 2024-04-01T19:42:46.820 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eea2a79:::benchmark_data_smithi188_119427_object98211:head# 2024-04-01T19:42:46.820 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eea6b63:::benchmark_data_smithi188_119427_object118748:head# 2024-04-01T19:42:46.820 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eeb70bb:::benchmark_data_smithi188_119427_object90243:head# 2024-04-01T19:42:46.821 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eebde02:::benchmark_data_smithi188_119427_object92509:head# 2024-04-01T19:42:46.821 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eecf9d4:::benchmark_data_smithi188_119427_object160023:head# 2024-04-01T19:42:46.821 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eeddf75:::benchmark_data_smithi188_119427_object141035:head# 2024-04-01T19:42:46.823 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eee7e0a:::benchmark_data_smithi188_119427_object110624:head# 2024-04-01T19:42:46.823 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eeee8dc:::benchmark_data_smithi188_119427_object98839:head# 2024-04-01T19:42:46.830 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eef3101:::benchmark_data_smithi188_119427_object133893:head# 2024-04-01T19:42:46.830 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eef31af:::benchmark_data_smithi188_119427_object158868:head# 2024-04-01T19:42:46.830 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4eefa5c0:::benchmark_data_smithi188_119427_object89985:head# 2024-04-01T19:42:46.830 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ef1f5c6:::benchmark_data_smithi188_119427_object146351:head# 2024-04-01T19:42:46.838 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ef2570d:::benchmark_data_smithi188_119427_object156811:head# 2024-04-01T19:42:46.845 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ef2f468:::benchmark_data_smithi188_119427_object146767:head# 2024-04-01T19:42:46.845 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ef38ca8:::benchmark_data_smithi188_119427_object100310:head# 2024-04-01T19:42:46.845 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ef4a1c1:::benchmark_data_smithi188_119427_object140044:head# 2024-04-01T19:42:46.845 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ef4b1fb:::benchmark_data_smithi188_119427_object148782:head# 2024-04-01T19:42:46.845 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ef59a7d:::benchmark_data_smithi188_119427_object148796:head# 2024-04-01T19:42:46.845 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ef5fff5:::benchmark_data_smithi188_119427_object132855:head# 2024-04-01T19:42:46.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ef759c5:::benchmark_data_smithi188_119427_object111041:head# 2024-04-01T19:42:46.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4efa06fe:::benchmark_data_smithi188_119427_object163575:head# 2024-04-01T19:42:46.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4efa2af2:::benchmark_data_smithi188_119427_object84633:head# 2024-04-01T19:42:46.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4efb0863:::benchmark_data_smithi188_119427_object95876:head# 2024-04-01T19:42:46.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4efb13d7:::benchmark_data_smithi188_119427_object131527:head# 2024-04-01T19:42:46.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4efd4173:::benchmark_data_smithi188_119427_object131334:head# 2024-04-01T19:42:46.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4efd7806:::benchmark_data_smithi188_119427_object84838:head# 2024-04-01T19:42:46.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f009d58:::benchmark_data_smithi188_119427_object163888:head# 2024-04-01T19:42:46.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f013c8c:::benchmark_data_smithi188_119427_object121449:head# 2024-04-01T19:42:46.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f017d87:::benchmark_data_smithi188_119427_object153827:head# 2024-04-01T19:42:46.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f0180d1:::benchmark_data_smithi188_119427_object159418:head# 2024-04-01T19:42:46.846 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f01a440:::benchmark_data_smithi188_119427_object102855:head# 2024-04-01T19:42:46.847 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f028c4b:::benchmark_data_smithi188_119427_object98457:head# 2024-04-01T19:42:46.847 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f04a12e:::benchmark_data_smithi188_119427_object153430:head# 2024-04-01T19:42:46.851 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f04ea07:::benchmark_data_smithi188_119427_object106430:head# 2024-04-01T19:42:46.851 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f057f21:::benchmark_data_smithi188_119427_object130392:head# 2024-04-01T19:42:46.851 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f05b712:::benchmark_data_smithi188_119427_object84206:head# 2024-04-01T19:42:46.852 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f05db7e:::benchmark_data_smithi188_119427_object112101:head# 2024-04-01T19:42:46.852 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f05ea8a:::benchmark_data_smithi188_119427_object82277:head# 2024-04-01T19:42:46.852 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f063a51:::benchmark_data_smithi188_119427_object103447:head# 2024-04-01T19:42:46.852 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f076454:::benchmark_data_smithi188_119427_object120265:head# 2024-04-01T19:42:46.852 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f088ba2:::benchmark_data_smithi188_119427_object105180:head# 2024-04-01T19:42:46.852 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f08c66c:::benchmark_data_smithi188_119427_object73178:head# 2024-04-01T19:42:46.854 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f08e666:::benchmark_data_smithi188_119427_object156771:head# 2024-04-01T19:42:46.854 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f0941fe:::benchmark_data_smithi188_119427_object160994:head# 2024-04-01T19:42:46.854 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f0a996b:::benchmark_data_smithi188_119427_object88950:head# 2024-04-01T19:42:46.858 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f0abe5a:::benchmark_data_smithi188_119427_object94061:head# 2024-04-01T19:42:46.858 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f0aedd1:::benchmark_data_smithi188_119427_object98818:head# 2024-04-01T19:42:46.859 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f0b392f:::benchmark_data_smithi188_119427_object123913:head# 2024-04-01T19:42:46.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:46 smithi022 ceph-mon[39439]: 5.4 scrub starts 2024-04-01T19:42:46.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:46 smithi022 ceph-mon[39439]: 5.1 scrub starts 2024-04-01T19:42:46.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:46 smithi022 ceph-mon[39439]: 5.7 scrub starts 2024-04-01T19:42:46.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:46 smithi022 ceph-mon[39439]: osdmap e438: 12 total, 11 up, 10 in 2024-04-01T19:42:46.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:46 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T19:42:46.865 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f0b5c73:::benchmark_data_smithi188_119427_object137367:head# 2024-04-01T19:42:46.866 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f0c39f1:::benchmark_data_smithi188_119427_object96276:head# 2024-04-01T19:42:46.866 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f0ebbad:::benchmark_data_smithi188_119427_object84890:head# 2024-04-01T19:42:46.866 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f0eeb69:::benchmark_data_smithi188_119427_object109422:head# 2024-04-01T19:42:46.866 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f0f24bc:::benchmark_data_smithi188_119427_object157427:head# 2024-04-01T19:42:46.866 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f0ff7c1:::benchmark_data_smithi188_119427_object103560:head# 2024-04-01T19:42:46.866 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f114e60:::benchmark_data_smithi188_119427_object101299:head# 2024-04-01T19:42:46.867 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f1199ad:::benchmark_data_smithi188_119427_object162533:head# 2024-04-01T19:42:46.867 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f11dfa2:::benchmark_data_smithi188_119427_object110418:head# 2024-04-01T19:42:46.867 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f122653:::benchmark_data_smithi188_119427_object157642:head# 2024-04-01T19:42:46.867 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f13056e:::benchmark_data_smithi188_119427_object160226:head# 2024-04-01T19:42:46.867 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f1377f1:::benchmark_data_smithi188_119427_object104821:head# 2024-04-01T19:42:46.867 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f15ab8d:::benchmark_data_smithi188_119427_object148614:head# 2024-04-01T19:42:46.867 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f15b7af:::benchmark_data_smithi188_119427_object105891:head# 2024-04-01T19:42:46.868 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f162bc4:::benchmark_data_smithi188_119427_object158173:head# 2024-04-01T19:42:46.868 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f1737da:::benchmark_data_smithi188_119427_object162826:head# 2024-04-01T19:42:46.868 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f1748a2:::benchmark_data_smithi188_119427_object144351:head# 2024-04-01T19:42:46.869 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f1856b4:::benchmark_data_smithi188_119427_object107789:head# 2024-04-01T19:42:46.872 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f1881c3:::benchmark_data_smithi188_119427_object93061:head# 2024-04-01T19:42:46.872 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f1986a7:::benchmark_data_smithi188_119427_object92424:head# 2024-04-01T19:42:46.872 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f19dd17:::benchmark_data_smithi188_119427_object142606:head# 2024-04-01T19:42:46.873 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f1a2095:::benchmark_data_smithi188_119427_object106449:head# 2024-04-01T19:42:46.873 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f1c15d0:::benchmark_data_smithi188_119427_object127391:head# 2024-04-01T19:42:46.873 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f1d32bb:::benchmark_data_smithi188_119427_object115581:head# 2024-04-01T19:42:46.873 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f1d9e8f:::benchmark_data_smithi188_119427_object108138:head# 2024-04-01T19:42:46.874 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f1dfb6d:::benchmark_data_smithi188_119427_object83780:head# 2024-04-01T19:42:46.875 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f1e52ff:::benchmark_data_smithi188_119427_object117874:head# 2024-04-01T19:42:46.875 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f1f7cdd:::benchmark_data_smithi188_119427_object81297:head# 2024-04-01T19:42:46.875 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f203817:::benchmark_data_smithi188_119427_object73043:head# 2024-04-01T19:42:46.875 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f20dc4d:::benchmark_data_smithi188_119427_object123984:head# 2024-04-01T19:42:46.876 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f22b778:::benchmark_data_smithi188_119427_object132368:head# 2024-04-01T19:42:46.876 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f23bce1:::benchmark_data_smithi188_119427_object113884:head# 2024-04-01T19:42:46.876 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f243ec5:::benchmark_data_smithi188_119427_object87448:head# 2024-04-01T19:42:46.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:46 smithi188 ceph-mon[43939]: 5.4 scrub starts 2024-04-01T19:42:46.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:46 smithi188 ceph-mon[43939]: 5.1 scrub starts 2024-04-01T19:42:46.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:46 smithi188 ceph-mon[43939]: 5.7 scrub starts 2024-04-01T19:42:46.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:46 smithi188 ceph-mon[43939]: osdmap e438: 12 total, 11 up, 10 in 2024-04-01T19:42:46.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:46 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T19:42:46.878 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f24df32:::benchmark_data_smithi188_119427_object153067:head# 2024-04-01T19:42:46.879 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f257e8b:::benchmark_data_smithi188_119427_object160685:head# 2024-04-01T19:42:46.879 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f263976:::benchmark_data_smithi188_119427_object73360:head# 2024-04-01T19:42:46.879 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f263f5f:::benchmark_data_smithi188_119427_object138078:head# 2024-04-01T19:42:46.879 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f26cd62:::benchmark_data_smithi188_119427_object107945:head# 2024-04-01T19:42:46.879 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:42:46.880 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f26e04a:::benchmark_data_smithi188_119427_object72857:head# 2024-04-01T19:42:46.880 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f275328:::benchmark_data_smithi188_119427_object89503:head# 2024-04-01T19:42:46.883 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f288c16:::benchmark_data_smithi188_119427_object74938:head# 2024-04-01T19:42:46.883 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f29340e:::benchmark_data_smithi188_119427_object114472:head# 2024-04-01T19:42:46.883 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f29d31d:::benchmark_data_smithi188_119427_object145255:head# 2024-04-01T19:42:46.883 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f2a195f:::benchmark_data_smithi188_119427_object76458:head# 2024-04-01T19:42:46.883 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f2ae568:::benchmark_data_smithi188_119427_object126533:head# 2024-04-01T19:42:46.883 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f2b6b6f:::benchmark_data_smithi188_119427_object74249:head# 2024-04-01T19:42:46.883 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f2cc3b8:::benchmark_data_smithi188_119427_object90585:head# 2024-04-01T19:42:46.884 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f2fb911:::benchmark_data_smithi188_119427_object103990:head# 2024-04-01T19:42:46.884 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f31ab84:::benchmark_data_smithi188_119427_object97674:head# 2024-04-01T19:42:46.886 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f31d26c:::benchmark_data_smithi188_119427_object158282:head# 2024-04-01T19:42:46.886 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f31e808:::benchmark_data_smithi188_119427_object101306:head# 2024-04-01T19:42:46.886 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f3264f1:::benchmark_data_smithi188_119427_object126154:head# 2024-04-01T19:42:46.888 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f337aa2:::benchmark_data_smithi188_119427_object115981:head# 2024-04-01T19:42:46.888 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f341513:::benchmark_data_smithi188_119427_object163228:head# 2024-04-01T19:42:46.889 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f3604f5:::benchmark_data_smithi188_119427_object96520:head# 2024-04-01T19:42:46.889 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f3691f1:::benchmark_data_smithi188_119427_object103611:head# 2024-04-01T19:42:46.889 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f36f873:::benchmark_data_smithi188_119427_object126378:head# 2024-04-01T19:42:46.890 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f37ab78:::benchmark_data_smithi188_119427_object132749:head# 2024-04-01T19:42:46.892 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f38ea7e:::benchmark_data_smithi188_119427_object82893:head# 2024-04-01T19:42:46.893 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f39792d:::benchmark_data_smithi188_119427_object154938:head# 2024-04-01T19:42:46.893 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f3a34d3:::benchmark_data_smithi188_119427_object143950:head# 2024-04-01T19:42:46.893 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f3a753a:::benchmark_data_smithi188_119427_object115443:head# 2024-04-01T19:42:46.894 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f3acafd:::benchmark_data_smithi188_119427_object97470:head# 2024-04-01T19:42:46.894 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f3c4590:::benchmark_data_smithi188_119427_object95965:head# 2024-04-01T19:42:46.895 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f3e1a32:::benchmark_data_smithi188_119427_object72900:head# 2024-04-01T19:42:46.895 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f3e4bfa:::benchmark_data_smithi188_119427_object89634:head# 2024-04-01T19:42:46.896 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f3e6072:::benchmark_data_smithi188_119427_object154102:head# 2024-04-01T19:42:46.896 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f3f0756:::benchmark_data_smithi188_119427_object124437:head# 2024-04-01T19:42:46.897 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f3fcaa3:::benchmark_data_smithi188_119427_object72923:head# 2024-04-01T19:42:46.897 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f3ff1aa:::benchmark_data_smithi188_119427_object154190:head# 2024-04-01T19:42:46.898 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f401288:::benchmark_data_smithi188_119427_object109975:head# 2024-04-01T19:42:46.898 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f403a56:::benchmark_data_smithi188_119427_object85145:head# 2024-04-01T19:42:46.898 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f407abe:::benchmark_data_smithi188_119427_object146273:head# 2024-04-01T19:42:46.899 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f40bce3:::benchmark_data_smithi188_119427_object156230:head# 2024-04-01T19:42:46.906 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f411926:::benchmark_data_smithi188_119427_object116245:head# 2024-04-01T19:42:46.906 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f41444b:::benchmark_data_smithi188_119427_object98156:head# 2024-04-01T19:42:46.906 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f428601:::benchmark_data_smithi188_119427_object132280:head# 2024-04-01T19:42:46.906 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f434dcb:::benchmark_data_smithi188_119427_object157019:head# 2024-04-01T19:42:46.910 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:46.913 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f44259d:::benchmark_data_smithi188_119427_object93153:head# 2024-04-01T19:42:46.914 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f44ee48:::benchmark_data_smithi188_119427_object135049:head# 2024-04-01T19:42:46.914 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f45d2ca:::benchmark_data_smithi188_119427_object156303:head# 2024-04-01T19:42:46.914 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f45ec9c:::benchmark_data_smithi188_119427_object104004:head# 2024-04-01T19:42:46.914 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f47644a:::benchmark_data_smithi188_119427_object158833:head# 2024-04-01T19:42:46.914 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f479e2b:::benchmark_data_smithi188_119427_object129294:head# 2024-04-01T19:42:46.914 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f48bb8a:::benchmark_data_smithi188_119427_object102343:head# 2024-04-01T19:42:46.914 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f49952d:::benchmark_data_smithi188_119427_object121824:head# 2024-04-01T19:42:46.914 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f499e41:::benchmark_data_smithi188_119427_object88989:head# 2024-04-01T19:42:46.919 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f49acc6:::benchmark_data_smithi188_119427_object114806:head# 2024-04-01T19:42:46.919 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f4a243b:::benchmark_data_smithi188_119427_object127900:head# 2024-04-01T19:42:46.925 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f4a7385:::benchmark_data_smithi188_119427_object150400:head# 2024-04-01T19:42:46.925 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f4b7984:::benchmark_data_smithi188_119427_object109704:head# 2024-04-01T19:42:46.926 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:42:46.926 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f4cf4a6:::benchmark_data_smithi188_119427_object77648:head# 2024-04-01T19:42:46.926 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f4def18:::benchmark_data_smithi188_119427_object91196:head# 2024-04-01T19:42:46.927 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f4e03bf:::benchmark_data_smithi188_119427_object145044:head# 2024-04-01T19:42:46.927 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f5158d2:::benchmark_data_smithi188_119427_object99909:head# 2024-04-01T19:42:46.928 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f52068a:::benchmark_data_smithi188_119427_object118970:head# 2024-04-01T19:42:46.928 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f525512:::benchmark_data_smithi188_119427_object143084:head# 2024-04-01T19:42:46.931 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f52cab4:::benchmark_data_smithi188_119427_object79369:head# 2024-04-01T19:42:46.931 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f534e73:::benchmark_data_smithi188_119427_object161986:head# 2024-04-01T19:42:46.932 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f53500f:::benchmark_data_smithi188_119427_object87305:head# 2024-04-01T19:42:46.932 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f535f5d:::benchmark_data_smithi188_119427_object93483:head# 2024-04-01T19:42:46.933 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f55bcf2:::benchmark_data_smithi188_119427_object92770:head# 2024-04-01T19:42:46.933 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f55c1ea:::benchmark_data_smithi188_119427_object126728:head# 2024-04-01T19:42:46.937 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:42:46.940 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f57116f:::benchmark_data_smithi188_119427_object154379:head# 2024-04-01T19:42:46.940 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f5715f9:::benchmark_data_smithi188_119427_object110267:head# 2024-04-01T19:42:46.940 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f571cf6:::benchmark_data_smithi188_119427_object77229:head# 2024-04-01T19:42:46.940 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f57f627:::benchmark_data_smithi188_119427_object117272:head# 2024-04-01T19:42:46.940 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f580b3b:::benchmark_data_smithi188_119427_object123254:head# 2024-04-01T19:42:46.940 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f593cb9:::benchmark_data_smithi188_119427_object135280:head# 2024-04-01T19:42:46.940 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f5c4026:::benchmark_data_smithi188_119427_object87806:head# 2024-04-01T19:42:46.940 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f5cd924:::benchmark_data_smithi188_119427_object75104:head# 2024-04-01T19:42:46.940 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f5db3dc:::benchmark_data_smithi188_119427_object122728:head# 2024-04-01T19:42:46.940 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f5fcc94:::benchmark_data_smithi188_119427_object91955:head# 2024-04-01T19:42:46.940 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f650893:::benchmark_data_smithi188_119427_object132013:head# 2024-04-01T19:42:46.941 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f655b2c:::benchmark_data_smithi188_119427_object122040:head# 2024-04-01T19:42:46.941 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f65d1ac:::benchmark_data_smithi188_119427_object102000:head# 2024-04-01T19:42:46.941 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f665151:::benchmark_data_smithi188_119427_object87262:head# 2024-04-01T19:42:46.941 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f684130:::benchmark_data_smithi188_119427_object72616:head# 2024-04-01T19:42:46.941 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f6952ca:::benchmark_data_smithi188_119427_object130348:head# 2024-04-01T19:42:46.942 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:46.942 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:42:46.945 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f69a188:::benchmark_data_smithi188_119427_object75271:head# 2024-04-01T19:42:46.945 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f69f9cb:::benchmark_data_smithi188_119427_object154288:head# 2024-04-01T19:42:46.946 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f6ac6fe:::benchmark_data_smithi188_119427_object117680:head# 2024-04-01T19:42:46.946 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f6be6da:::benchmark_data_smithi188_119427_object122504:head# 2024-04-01T19:42:46.947 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f6d07fe:::benchmark_data_smithi188_119427_object88878:head# 2024-04-01T19:42:46.948 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f6d156b:::benchmark_data_smithi188_119427_object135794:head# 2024-04-01T19:42:46.950 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f6d6a94:::benchmark_data_smithi188_119427_object107078:head# 2024-04-01T19:42:46.950 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f6d8c97:::benchmark_data_smithi188_119427_object101639:head# 2024-04-01T19:42:46.950 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f6e2d42:::benchmark_data_smithi188_119427_object112192:head# 2024-04-01T19:42:46.950 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f6e416d:::benchmark_data_smithi188_119427_object156662:head# 2024-04-01T19:42:46.953 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f6ecb61:::benchmark_data_smithi188_119427_object138413:head# 2024-04-01T19:42:46.954 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f6f583f:::benchmark_data_smithi188_119427_object83410:head# 2024-04-01T19:42:46.954 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f70d3aa:::benchmark_data_smithi188_119427_object159641:head# 2024-04-01T19:42:46.954 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f70dff9:::benchmark_data_smithi188_119427_object82214:head# 2024-04-01T19:42:46.954 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f7136a5:::benchmark_data_smithi188_119427_object107143:head# 2024-04-01T19:42:46.954 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f71b8c1:::benchmark_data_smithi188_119427_object118402:head# 2024-04-01T19:42:46.954 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f742dea:::benchmark_data_smithi188_119427_object73619:head# 2024-04-01T19:42:46.954 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f75b901:::benchmark_data_smithi188_119427_object157202:head# 2024-04-01T19:42:46.955 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f75fd10:::benchmark_data_smithi188_119427_object102344:head# 2024-04-01T19:42:46.955 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f768bb7:::benchmark_data_smithi188_119427_object121794:head# 2024-04-01T19:42:46.955 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f77aa18:::benchmark_data_smithi188_119427_object143360:head# 2024-04-01T19:42:46.956 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f77e86f:::benchmark_data_smithi188_119427_object96536:head# 2024-04-01T19:42:46.956 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f78dda0:::benchmark_data_smithi188_119427_object76801:head# 2024-04-01T19:42:46.957 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f7948b1:::benchmark_data_smithi188_119427_object77754:head# 2024-04-01T19:42:46.957 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f79a3c9:::benchmark_data_smithi188_119427_object127292:head# 2024-04-01T19:42:46.957 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f7d3abb:::benchmark_data_smithi188_119427_object77165:head# 2024-04-01T19:42:46.958 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f7d49ed:::benchmark_data_smithi188_119427_object83458:head# 2024-04-01T19:42:46.958 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f7de27d:::benchmark_data_smithi188_119427_object138309:head# 2024-04-01T19:42:46.959 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f7f83db:::benchmark_data_smithi188_119427_object157384:head# 2024-04-01T19:42:46.959 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f812b74:::benchmark_data_smithi188_119427_object80352:head# 2024-04-01T19:42:46.959 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f82444c:::benchmark_data_smithi188_119427_object101835:head# 2024-04-01T19:42:46.960 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f83022b:::benchmark_data_smithi188_119427_object162616:head# 2024-04-01T19:42:46.960 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f8374cc:::benchmark_data_smithi188_119427_object116147:head# 2024-04-01T19:42:46.961 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f83dcc0:::benchmark_data_smithi188_119427_object105474:head# 2024-04-01T19:42:46.961 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f84471e:::benchmark_data_smithi188_119427_object156061:head# 2024-04-01T19:42:46.962 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f858340:::benchmark_data_smithi188_119427_object143620:head# 2024-04-01T19:42:46.962 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f858cb1:::benchmark_data_smithi188_119427_object131512:head# 2024-04-01T19:42:46.962 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f86a3a1:::benchmark_data_smithi188_119427_object108490:head# 2024-04-01T19:42:46.963 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f870d77:::benchmark_data_smithi188_119427_object154119:head# 2024-04-01T19:42:46.963 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f873a6c:::benchmark_data_smithi188_119427_object125348:head# 2024-04-01T19:42:46.964 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f885298:::benchmark_data_smithi188_119427_object112818:head# 2024-04-01T19:42:46.964 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f887b95:::benchmark_data_smithi188_119427_object112437:head# 2024-04-01T19:42:46.964 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f88a4a8:::benchmark_data_smithi188_119427_object99559:head# 2024-04-01T19:42:46.965 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f89a5cb:::benchmark_data_smithi188_119427_object161820:head# 2024-04-01T19:42:46.965 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f8a31f4:::benchmark_data_smithi188_119427_object99066:head# 2024-04-01T19:42:46.965 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f8c220f:::benchmark_data_smithi188_119427_object132110:head# 2024-04-01T19:42:46.966 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f8c9132:::benchmark_data_smithi188_119427_object102537:head# 2024-04-01T19:42:46.966 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f8d9fb4:::benchmark_data_smithi188_119427_object142961:head# 2024-04-01T19:42:46.967 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f8e50f2:::benchmark_data_smithi188_119427_object111104:head# 2024-04-01T19:42:46.969 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f8e77c6:::benchmark_data_smithi188_119427_object141169:head# 2024-04-01T19:42:46.969 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f8e7890:::benchmark_data_smithi188_119427_object144839:head# 2024-04-01T19:42:46.970 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f8f4173:::benchmark_data_smithi188_119427_object73673:head# 2024-04-01T19:42:46.970 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f8fa9d0:::benchmark_data_smithi188_119427_object113655:head# 2024-04-01T19:42:46.970 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f8fab05:::benchmark_data_smithi188_119427_object137522:head# 2024-04-01T19:42:46.970 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f90f05f:::benchmark_data_smithi188_119427_object82853:head# 2024-04-01T19:42:46.970 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f94a456:::benchmark_data_smithi188_119427_object144892:head# 2024-04-01T19:42:46.970 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f94e00e:::benchmark_data_smithi188_119427_object113307:head# 2024-04-01T19:42:46.971 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f950fb2:::benchmark_data_smithi188_119427_object73750:head# 2024-04-01T19:42:46.971 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f9548dc:::benchmark_data_smithi188_119427_object120942:head# 2024-04-01T19:42:46.971 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f95d3a1:::benchmark_data_smithi188_119427_object158620:head# 2024-04-01T19:42:46.972 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f95d54e:::benchmark_data_smithi188_119427_object164322:head# 2024-04-01T19:42:46.972 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f974e9f:::benchmark_data_smithi188_119427_object125314:head# 2024-04-01T19:42:46.973 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f9890e5:::benchmark_data_smithi188_119427_object73365:head# 2024-04-01T19:42:46.973 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f98a261:::benchmark_data_smithi188_119427_object93523:head# 2024-04-01T19:42:46.973 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f9a5f70:::benchmark_data_smithi188_119427_object104401:head# 2024-04-01T19:42:46.974 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f9c5fe9:::benchmark_data_smithi188_119427_object160861:head# 2024-04-01T19:42:46.975 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f9e0253:::benchmark_data_smithi188_119427_object125086:head# 2024-04-01T19:42:46.975 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f9e67f5:::benchmark_data_smithi188_119427_object132021:head# 2024-04-01T19:42:46.975 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f9edc27:::benchmark_data_smithi188_119427_object99552:head# 2024-04-01T19:42:46.976 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f9f5bd5:::benchmark_data_smithi188_119427_object129080:head# 2024-04-01T19:42:46.976 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4f9fa1e6:::benchmark_data_smithi188_119427_object104814:head# 2024-04-01T19:42:46.976 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fa0d28b:::benchmark_data_smithi188_119427_object100559:head# 2024-04-01T19:42:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fa16a0e:::benchmark_data_smithi188_119427_object154990:head# 2024-04-01T19:42:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fa1b26d:::benchmark_data_smithi188_119427_object119183:head# 2024-04-01T19:42:46.978 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fa21be2:::benchmark_data_smithi188_119427_object100142:head# 2024-04-01T19:42:46.978 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fa40087:::benchmark_data_smithi188_119427_object87038:head# 2024-04-01T19:42:46.979 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fa445fd:::benchmark_data_smithi188_119427_object76158:head# 2024-04-01T19:42:46.979 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fa4b065:::benchmark_data_smithi188_119427_object145813:head# 2024-04-01T19:42:46.980 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fa4cbbc:::benchmark_data_smithi188_119427_object120776:head# 2024-04-01T19:42:46.980 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fa78c44:::benchmark_data_smithi188_119427_object91826:head# 2024-04-01T19:42:46.981 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fa84ac5:::benchmark_data_smithi188_119427_object111989:head# 2024-04-01T19:42:46.981 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fa93eb8:::benchmark_data_smithi188_119427_object88678:head# 2024-04-01T19:42:46.982 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fa9685d:::benchmark_data_smithi188_119427_object116575:head# 2024-04-01T19:42:46.983 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fa9983a:::benchmark_data_smithi188_119427_object137407:head# 2024-04-01T19:42:46.983 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fa9e362:::benchmark_data_smithi188_119427_object96341:head# 2024-04-01T19:42:46.984 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4faa4592:::benchmark_data_smithi188_119427_object82908:head# 2024-04-01T19:42:46.984 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fabbf45:::benchmark_data_smithi188_119427_object161371:head# 2024-04-01T19:42:46.985 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fac1d11:::benchmark_data_smithi188_119427_object129102:head# 2024-04-01T19:42:46.990 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fac5269:::benchmark_data_smithi188_119427_object76965:head# 2024-04-01T19:42:46.990 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fac5cf4:::benchmark_data_smithi188_119427_object116859:head# 2024-04-01T19:42:46.990 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4facce4e:::benchmark_data_smithi188_119427_object127105:head# 2024-04-01T19:42:46.990 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fadf3ed:::benchmark_data_smithi188_119427_object123567:head# 2024-04-01T19:42:46.990 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fae9885:::benchmark_data_smithi188_119427_object141359:head# 2024-04-01T19:42:46.990 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4faf9c75:::benchmark_data_smithi188_119427_object83079:head# 2024-04-01T19:42:46.990 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fb06040:::benchmark_data_smithi188_119427_object100865:head# 2024-04-01T19:42:46.990 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fb10d48:::benchmark_data_smithi188_119427_object87033:head# 2024-04-01T19:42:46.990 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fb19b74:::benchmark_data_smithi188_119427_object125308:head# 2024-04-01T19:42:46.991 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fb1af72:::benchmark_data_smithi188_119427_object151354:head# 2024-04-01T19:42:46.991 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fb4b65a:::benchmark_data_smithi188_119427_object77820:head# 2024-04-01T19:42:46.992 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fb5bf70:::benchmark_data_smithi188_119427_object89615:head# 2024-04-01T19:42:46.992 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fb600b3:::benchmark_data_smithi188_119427_object150137:head# 2024-04-01T19:42:46.993 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fb61644:::benchmark_data_smithi188_119427_object155525:head# 2024-04-01T19:42:46.993 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fb6a2df:::benchmark_data_smithi188_119427_object74687:head# 2024-04-01T19:42:46.993 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fb6cfce:::benchmark_data_smithi188_119427_object104807:head# 2024-04-01T19:42:46.994 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fb70345:::benchmark_data_smithi188_119427_object159873:head# 2024-04-01T19:42:46.994 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fb9356a:::benchmark_data_smithi188_119427_object79764:head# 2024-04-01T19:42:46.995 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fb9e697:::benchmark_data_smithi188_119427_object134240:head# 2024-04-01T19:42:46.995 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fba3d81:::benchmark_data_smithi188_119427_object130681:head# 2024-04-01T19:42:46.996 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fba8aab:::benchmark_data_smithi188_119427_object97226:head# 2024-04-01T19:42:46.996 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fbb12e3:::benchmark_data_smithi188_119427_object162081:head# 2024-04-01T19:42:46.997 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fbbc678:::benchmark_data_smithi188_119427_object141750:head# 2024-04-01T19:42:46.997 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fbc685a:::benchmark_data_smithi188_119427_object139706:head# 2024-04-01T19:42:46.998 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fbccb29:::benchmark_data_smithi188_119427_object152536:head# 2024-04-01T19:42:46.998 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fbe33ed:::benchmark_data_smithi188_119427_object96299:head# 2024-04-01T19:42:46.998 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fbe68bd:::benchmark_data_smithi188_119427_object102104:head# 2024-04-01T19:42:46.999 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fbe9854:::benchmark_data_smithi188_119427_object125722:head# 2024-04-01T19:42:46.999 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fbf2aaa:::benchmark_data_smithi188_119427_object73456:head# 2024-04-01T19:42:47.000 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fbf51fd:::benchmark_data_smithi188_119427_object138109:head# 2024-04-01T19:42:47.005 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fc10b00:::benchmark_data_smithi188_119427_object158579:head# 2024-04-01T19:42:47.005 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fc22f28:::benchmark_data_smithi188_119427_object148396:head# 2024-04-01T19:42:47.006 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fc2491c:::benchmark_data_smithi188_119427_object164120:head# 2024-04-01T19:42:47.006 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fc25f6f:::benchmark_data_smithi188_119427_object163876:head# 2024-04-01T19:42:47.006 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fc326ee:::benchmark_data_smithi188_119427_object164442:head# 2024-04-01T19:42:47.007 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fc395b7:::benchmark_data_smithi188_119427_object102131:head# 2024-04-01T19:42:47.007 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fc3ec3f:::benchmark_data_smithi188_119427_object162021:head# 2024-04-01T19:42:47.007 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fc5736b:::benchmark_data_smithi188_119427_object121550:head# 2024-04-01T19:42:47.008 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fc5af7b:::benchmark_data_smithi188_119427_object119127:head# 2024-04-01T19:42:47.008 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fc6ade7:::benchmark_data_smithi188_119427_object132081:head# 2024-04-01T19:42:47.009 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fc6f938:::benchmark_data_smithi188_119427_object96258:head# 2024-04-01T19:42:47.009 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fc71df0:::benchmark_data_smithi188_119427_object107448:head# 2024-04-01T19:42:47.009 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fc7339f:::benchmark_data_smithi188_119427_object158348:head# 2024-04-01T19:42:47.010 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fc8d2cf:::benchmark_data_smithi188_119427_object163133:head# 2024-04-01T19:42:47.010 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fc9006b:::benchmark_data_smithi188_119427_object106331:head# 2024-04-01T19:42:47.011 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fc9b97f:::benchmark_data_smithi188_119427_object78182:head# 2024-04-01T19:42:47.011 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fca7adc:::benchmark_data_smithi188_119427_object90856:head# 2024-04-01T19:42:47.011 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fcbcbce:::benchmark_data_smithi188_119427_object154016:head# 2024-04-01T19:42:47.012 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fcbcd7d:::benchmark_data_smithi188_119427_object80434:head# 2024-04-01T19:42:47.012 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fcc0416:::benchmark_data_smithi188_119427_object141753:head# 2024-04-01T19:42:47.013 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fcc9a2d:::benchmark_data_smithi188_119427_object143085:head# 2024-04-01T19:42:47.013 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fcd4222:::benchmark_data_smithi188_119427_object151205:head# 2024-04-01T19:42:47.016 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fcf20a9:::benchmark_data_smithi188_119427_object117864:head# 2024-04-01T19:42:47.016 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fcfc49c:::benchmark_data_smithi188_119427_object111286:head# 2024-04-01T19:42:47.017 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fd0d094:::benchmark_data_smithi188_119427_object102756:head# 2024-04-01T19:42:47.017 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fd0f766:::benchmark_data_smithi188_119427_object103982:head# 2024-04-01T19:42:47.017 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fd11221:::benchmark_data_smithi188_119427_object81413:head# 2024-04-01T19:42:47.018 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fd1b24e:::benchmark_data_smithi188_119427_object120254:head# 2024-04-01T19:42:47.019 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fd1e9de:::benchmark_data_smithi188_119427_object80420:head# 2024-04-01T19:42:47.019 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fd20ad9:::benchmark_data_smithi188_119427_object141319:head# 2024-04-01T19:42:47.020 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fd245d7:::benchmark_data_smithi188_119427_object101820:head# 2024-04-01T19:42:47.020 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fd591b7:::benchmark_data_smithi188_119427_object108619:head# 2024-04-01T19:42:47.020 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fd66fdc:::benchmark_data_smithi188_119427_object129841:head# 2024-04-01T19:42:47.021 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fd68cc0:::benchmark_data_smithi188_119427_object115936:head# 2024-04-01T19:42:47.021 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fd93bc3:::benchmark_data_smithi188_119427_object140001:head# 2024-04-01T19:42:47.022 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fd95b96:::benchmark_data_smithi188_119427_object149969:head# 2024-04-01T19:42:47.022 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fd95c4f:::benchmark_data_smithi188_119427_object114430:head# 2024-04-01T19:42:47.022 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fd994fa:::benchmark_data_smithi188_119427_object128578:head# 2024-04-01T19:42:47.023 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fda78c9:::benchmark_data_smithi188_119427_object151188:head# 2024-04-01T19:42:47.023 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fda9a02:::benchmark_data_smithi188_119427_object158276:head# 2024-04-01T19:42:47.023 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fdb1f9c:::benchmark_data_smithi188_119427_object151737:head# 2024-04-01T19:42:47.024 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fdbce2a:::benchmark_data_smithi188_119427_object72545:head# 2024-04-01T19:42:47.024 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fdc2457:::benchmark_data_smithi188_119427_object94254:head# 2024-04-01T19:42:47.025 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fdd5770:::benchmark_data_smithi188_119427_object121108:head# 2024-04-01T19:42:47.025 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fdda1b9:::benchmark_data_smithi188_119427_object91890:head# 2024-04-01T19:42:47.026 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fdda451:::benchmark_data_smithi188_119427_object72452:head# 2024-04-01T19:42:47.026 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fddfcb4:::benchmark_data_smithi188_119427_object99738:head# 2024-04-01T19:42:47.027 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fe076bf:::benchmark_data_smithi188_119427_object147109:head# 2024-04-01T19:42:47.027 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fe08336:::benchmark_data_smithi188_119427_object149690:head# 2024-04-01T19:42:47.028 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fe114d6:::benchmark_data_smithi188_119427_object123153:head# 2024-04-01T19:42:47.033 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fe24e03:::benchmark_data_smithi188_119427_object72495:head# 2024-04-01T19:42:47.035 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fe35dd3:::benchmark_data_smithi188_119427_object121955:head# 2024-04-01T19:42:47.035 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fe39c4b:::benchmark_data_smithi188_119427_object128828:head# 2024-04-01T19:42:47.035 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fe521cc:::benchmark_data_smithi188_119427_object116829:head# 2024-04-01T19:42:47.035 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fe5545b:::benchmark_data_smithi188_119427_object93491:head# 2024-04-01T19:42:47.035 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fe57b44:::benchmark_data_smithi188_119427_object162519:head# 2024-04-01T19:42:47.035 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fe588a9:::benchmark_data_smithi188_119427_object107995:head# 2024-04-01T19:42:47.035 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fe5c9c9:::benchmark_data_smithi188_119427_object109667:head# 2024-04-01T19:42:47.036 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fe6180f:::benchmark_data_smithi188_119427_object134540:head# 2024-04-01T19:42:47.036 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fe76f8c:::benchmark_data_smithi188_119427_object145519:head# 2024-04-01T19:42:47.041 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fe78566:::benchmark_data_smithi188_119427_object121911:head# 2024-04-01T19:42:47.041 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fe97af5:::benchmark_data_smithi188_119427_object104176:head# 2024-04-01T19:42:47.041 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4feaa4b4:::benchmark_data_smithi188_119427_object74132:head# 2024-04-01T19:42:47.041 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fead14f:::benchmark_data_smithi188_119427_object74054:head# 2024-04-01T19:42:47.042 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fead3b0:::benchmark_data_smithi188_119427_object126207:head# 2024-04-01T19:42:47.042 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4feaf8f6:::benchmark_data_smithi188_119427_object114972:head# 2024-04-01T19:42:47.042 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fed9176:::benchmark_data_smithi188_119427_object97386:head# 2024-04-01T19:42:47.043 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:42:47.044 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fedc86a:::benchmark_data_smithi188_119427_object114684:head# 2024-04-01T19:42:47.045 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fee727b:::benchmark_data_smithi188_119427_object77483:head# 2024-04-01T19:42:47.046 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fef0e96:::benchmark_data_smithi188_119427_object155420:head# 2024-04-01T19:42:47.046 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ff0a015:::benchmark_data_smithi188_119427_object146851:head# 2024-04-01T19:42:47.047 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ff1213c:::benchmark_data_smithi188_119427_object131986:head# 2024-04-01T19:42:47.047 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ff2a912:::benchmark_data_smithi188_119427_object160163:head# 2024-04-01T19:42:47.048 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ff2cf7d:::benchmark_data_smithi188_119427_object135882:head# 2024-04-01T19:42:47.048 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ff418e8:::benchmark_data_smithi188_119427_object146973:head# 2024-04-01T19:42:47.048 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ff4aca9:::benchmark_data_smithi188_119427_object132836:head# 2024-04-01T19:42:47.049 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ff5336e:::benchmark_data_smithi188_119427_object123541:head# 2024-04-01T19:42:47.049 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ff63c77:::benchmark_data_smithi188_119427_object162605:head# 2024-04-01T19:42:47.050 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ff6a400:::benchmark_data_smithi188_119427_object131481:head# 2024-04-01T19:42:47.050 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ff708fb:::benchmark_data_smithi188_119427_object95310:head# 2024-04-01T19:42:47.051 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ff795a0:::benchmark_data_smithi188_119427_object148568:head# 2024-04-01T19:42:47.051 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ff7e30f:::benchmark_data_smithi188_119427_object137471:head# 2024-04-01T19:42:47.052 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ff877c9:::benchmark_data_smithi188_119427_object92929:head# 2024-04-01T19:42:47.052 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ff9b659:::benchmark_data_smithi188_119427_object98475:head# 2024-04-01T19:42:47.052 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ffaadef:::benchmark_data_smithi188_119427_object83063:head# 2024-04-01T19:42:47.053 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ffad4ad:::benchmark_data_smithi188_119427_object107761:head# 2024-04-01T19:42:47.053 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ffb1884:::benchmark_data_smithi188_119427_object125967:head# 2024-04-01T19:42:47.054 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ffb42cd:::benchmark_data_smithi188_119427_object112285:head# 2024-04-01T19:42:47.054 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ffba10d:::benchmark_data_smithi188_119427_object86400:head# 2024-04-01T19:42:47.055 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ffbdeb7:::benchmark_data_smithi188_119427_object120862:head# 2024-04-01T19:42:47.055 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ffcccee:::benchmark_data_smithi188_119427_object118875:head# 2024-04-01T19:42:47.055 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ffd7fd2:::benchmark_data_smithi188_119427_object135323:head# 2024-04-01T19:42:47.056 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ffe4bf5:::benchmark_data_smithi188_119427_object91802:head# 2024-04-01T19:42:47.057 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4ffe5a47:::benchmark_data_smithi188_119427_object84005:head# 2024-04-01T19:42:47.058 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fff5328:::benchmark_data_smithi188_119427_object151102:head# 2024-04-01T19:42:47.059 INFO:teuthology.orchestra.run.smithi062.stderr:Read #5:4fff9bbe:::benchmark_data_smithi188_119427_object140661:head# 2024-04-01T19:42:47.066 INFO:teuthology.orchestra.run.smithi062.stderr:Export successful 2024-04-01T19:42:47.089 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:42:47.252 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:47.252 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:42:47.353 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:42:47.386 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:47.444 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:42:47.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:47 smithi022 ceph-mon[39439]: 5.4 scrub ok 2024-04-01T19:42:47.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:47 smithi022 ceph-mon[39439]: 5.1 scrub ok 2024-04-01T19:42:47.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:47 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T19:42:47.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:47 smithi022 ceph-mon[39439]: 5.e deep-scrub starts 2024-04-01T19:42:47.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:47 smithi022 ceph-mon[39439]: 5.7 scrub ok 2024-04-01T19:42:47.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:47 smithi022 ceph-mon[39439]: 5.6 deep-scrub starts 2024-04-01T19:42:47.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:47 smithi022 ceph-mon[39439]: 5.3 scrub starts 2024-04-01T19:42:47.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:47 smithi022 ceph-mon[39439]: pgmap v1216: 17 pgs: 1 undersized+degraded+remapped+backfilling+peered, 16 active+clean; 5.6 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 47 op/s; 1083/184198 objects degraded (0.588%); 87 MiB/s, 1.40k objects/s recovering 2024-04-01T19:42:47.663 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:42:47.717 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:42:47.746 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:42:47.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:47 smithi062 ceph-mon[44211]: 5.4 scrub ok 2024-04-01T19:42:47.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:47 smithi062 ceph-mon[44211]: 5.1 scrub ok 2024-04-01T19:42:47.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:47 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T19:42:47.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:47 smithi062 ceph-mon[44211]: 5.e deep-scrub starts 2024-04-01T19:42:47.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:47 smithi062 ceph-mon[44211]: 5.7 scrub ok 2024-04-01T19:42:47.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:47 smithi062 ceph-mon[44211]: 5.6 deep-scrub starts 2024-04-01T19:42:47.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:47 smithi062 ceph-mon[44211]: 5.3 scrub starts 2024-04-01T19:42:47.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:47 smithi062 ceph-mon[44211]: pgmap v1216: 17 pgs: 1 undersized+degraded+remapped+backfilling+peered, 16 active+clean; 5.6 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 47 op/s; 1083/184198 objects degraded (0.588%); 87 MiB/s, 1.40k objects/s recovering 2024-04-01T19:42:47.781 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:42:47.812 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:42:47.841 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:42:47.864 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:42:47.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:47 smithi188 ceph-mon[43939]: 5.4 scrub ok 2024-04-01T19:42:47.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:47 smithi188 ceph-mon[43939]: 5.1 scrub ok 2024-04-01T19:42:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:47 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T19:42:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:47 smithi188 ceph-mon[43939]: 5.e deep-scrub starts 2024-04-01T19:42:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:47 smithi188 ceph-mon[43939]: 5.7 scrub ok 2024-04-01T19:42:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:47 smithi188 ceph-mon[43939]: 5.6 deep-scrub starts 2024-04-01T19:42:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:47 smithi188 ceph-mon[43939]: 5.3 scrub starts 2024-04-01T19:42:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:47 smithi188 ceph-mon[43939]: pgmap v1216: 17 pgs: 1 undersized+degraded+remapped+backfilling+peered, 16 active+clean; 5.6 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 47 op/s; 1083/184198 objects degraded (0.588%); 87 MiB/s, 1.40k objects/s recovering 2024-04-01T19:42:47.907 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:42:47.950 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:42:47.985 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:42:48.039 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:42:48.091 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:42:48.091 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:42:48.091 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:42:48.091 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:42:48.091 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:42:48.091 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:42:48.091 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:42:48.091 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:42:48.091 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:42:48.092 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:42:48.092 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:42:48.092 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:42:48.092 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:42:48.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:48 smithi022 ceph-mon[39439]: 5.d scrub starts 2024-04-01T19:42:48.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:48 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 1083/184198 objects degraded (0.588%), 1 pg degraded (PG_DEGRADED) 2024-04-01T19:42:48.451 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:48 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3131882430' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:42:48.451 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:48 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:48.451 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:48 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:48.451 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:48 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:48.451 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:48 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:48.451 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:48 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:48.451 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:48 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:48.451 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:48 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:48.451 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:48 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:48.451 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:48 smithi022 ceph-mon[39439]: 5.9 scrub starts 2024-04-01T19:42:48.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:48 smithi062 ceph-mon[44211]: 5.d scrub starts 2024-04-01T19:42:48.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:48 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 1083/184198 objects degraded (0.588%), 1 pg degraded (PG_DEGRADED) 2024-04-01T19:42:48.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:48 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3131882430' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:42:48.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:48 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:48.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:48 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:48.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:48 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:48.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:48 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:48.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:48 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:48.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:48 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:48.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:48 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:48.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:48 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:48.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:48 smithi062 ceph-mon[44211]: 5.9 scrub starts 2024-04-01T19:42:48.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:48 smithi188 ceph-mon[43939]: 5.d scrub starts 2024-04-01T19:42:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:48 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 1083/184198 objects degraded (0.588%), 1 pg degraded (PG_DEGRADED) 2024-04-01T19:42:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:48 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3131882430' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:42:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:48 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:48 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:48 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:48 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:48 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:48 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:48 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:48 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:48 smithi188 ceph-mon[43939]: 5.9 scrub starts 2024-04-01T19:42:49.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:49.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:49.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:49.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:49 smithi062 ceph-mon[44211]: 5.d scrub ok 2024-04-01T19:42:49.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:49 smithi062 ceph-mon[44211]: 5.3 scrub ok 2024-04-01T19:42:49.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:49 smithi062 ceph-mon[44211]: pgmap v1217: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.6 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 77 op/s; 42 MiB/s, 674 objects/s recovering 2024-04-01T19:42:49.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:49 smithi062 ceph-mon[44211]: 5.9 scrub ok 2024-04-01T19:42:49.544 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:42:49.549 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:49.550 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:42:49.650 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:42:49.737 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:49.737 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:49.737 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:49.737 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:49 smithi022 ceph-mon[39439]: 5.d scrub ok 2024-04-01T19:42:49.737 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:49 smithi022 ceph-mon[39439]: 5.3 scrub ok 2024-04-01T19:42:49.737 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:49 smithi022 ceph-mon[39439]: pgmap v1217: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.6 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 77 op/s; 42 MiB/s, 674 objects/s recovering 2024-04-01T19:42:49.737 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:49 smithi022 ceph-mon[39439]: 5.9 scrub ok 2024-04-01T19:42:49.738 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:49.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:49.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:49.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:49.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:49 smithi188 ceph-mon[43939]: 5.d scrub ok 2024-04-01T19:42:49.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:49 smithi188 ceph-mon[43939]: 5.3 scrub ok 2024-04-01T19:42:49.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:49 smithi188 ceph-mon[43939]: pgmap v1217: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.6 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 77 op/s; 42 MiB/s, 674 objects/s recovering 2024-04-01T19:42:49.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:49 smithi188 ceph-mon[43939]: 5.9 scrub ok 2024-04-01T19:42:50.249 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -n osd.6 --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-6 --journal-path /var/lib/ceph/osd/ceph-6/journal --force --op remove --pgid 5.2 2024-04-01T19:42:50.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:50 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:42:50.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:50 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:42:50.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:50 smithi062 ceph-mon[44211]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1083/184198 objects degraded (0.588%), 1 pg degraded) 2024-04-01T19:42:50.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:50 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:42:50.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:50 smithi062 ceph-mon[44211]: osdmap e439: 12 total, 11 up, 10 in 2024-04-01T19:42:50.867 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:50 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:42:50.868 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:50 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:42:50.868 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:50 smithi022 ceph-mon[39439]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1083/184198 objects degraded (0.588%), 1 pg degraded) 2024-04-01T19:42:50.868 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:50 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:42:50.868 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:50 smithi022 ceph-mon[39439]: osdmap e439: 12 total, 11 up, 10 in 2024-04-01T19:42:50.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:50 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:42:50.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:50 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:42:50.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:50 smithi188 ceph-mon[43939]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1083/184198 objects degraded (0.588%), 1 pg degraded) 2024-04-01T19:42:50.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:50 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:42:50.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:50 smithi188 ceph-mon[43939]: osdmap e439: 12 total, 11 up, 10 in 2024-04-01T19:42:50.989 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:42:51.000 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:51.000 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:42:51.026 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:42:51.027 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:42:51.035 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/osd.6/config 2024-04-01T19:42:51.102 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:42:51.129 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:51.149 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:42:51.154 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:51.154 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:42:51.255 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:42:51.319 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:51.597 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:51 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:42:51.597 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:51 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:42:51.597 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:51 smithi062 ceph-mon[44211]: pgmap v1219: 17 pgs: 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 15 active+clean; 5.5 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 355 op/s; 39 MiB/s, 631 objects/s recovering 2024-04-01T19:42:51.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:51 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:42:51.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:51 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:42:51.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:51 smithi022 ceph-mon[39439]: pgmap v1219: 17 pgs: 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 15 active+clean; 5.5 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 355 op/s; 39 MiB/s, 631 objects/s recovering 2024-04-01T19:42:51.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:51 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:42:51.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:51 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:42:51.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:51 smithi188 ceph-mon[43939]: pgmap v1219: 17 pgs: 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 15 active+clean; 5.5 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 355 op/s; 39 MiB/s, 631 objects/s recovering 2024-04-01T19:42:52.017 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:42:52.017 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:42:52.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:52 smithi062 ceph-mon[44211]: osdmap e440: 12 total, 11 up, 10 in 2024-04-01T19:42:52.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:52 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:42:52.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:52 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:42:52.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:52 smithi022 ceph-mon[39439]: osdmap e440: 12 total, 11 up, 10 in 2024-04-01T19:42:52.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:52 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:42:52.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:52 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:42:52.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:52 smithi188 ceph-mon[43939]: osdmap e440: 12 total, 11 up, 10 in 2024-04-01T19:42:52.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:52 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:42:52.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:52 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:42:53.027 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:42:53.101 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_historic_ops 2024-04-01T19:42:53.388 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:42:53.392 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:53.393 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:42:53.493 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:42:53.524 INFO:teuthology.orchestra.run.smithi062.stderr:Creating an OSD daemon form without an OSD FSID value 2024-04-01T19:42:53.557 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:42:53.558 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:53.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:53 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:42:53.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:53 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:42:53.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:53 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:42:53.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:53 smithi022 ceph-mon[39439]: pgmap v1221: 17 pgs: 2 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 14 active+clean; 5.4 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 558 op/s; 9.8 MiB/s, 157 objects/s recovering 2024-04-01T19:42:53.678 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:42:53.686 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:53.687 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:42:53.724 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:42:53.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:53 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:42:53.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:53 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:42:53.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:53 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:42:53.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:53 smithi062 ceph-mon[44211]: pgmap v1221: 17 pgs: 2 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 14 active+clean; 5.4 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 558 op/s; 9.8 MiB/s, 157 objects/s recovering 2024-04-01T19:42:53.788 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:42:53.812 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:53 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:42:53.812 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:53 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:42:53.813 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:53 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:42:53.813 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:53 smithi188 ceph-mon[43939]: pgmap v1221: 17 pgs: 2 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 14 active+clean; 5.4 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 558 op/s; 9.8 MiB/s, 157 objects/s recovering 2024-04-01T19:42:53.814 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:53.833 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:42:53.840 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:53.841 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:42:53.942 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:42:53.971 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:53.991 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:42:53.994 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:53.995 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:42:54.095 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:42:54.133 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:54.166 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:42:54.169 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:54.169 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:42:54.270 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:42:54.327 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:54.561 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:42:54.587 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:54 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/854059157' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:42:54.587 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:54 smithi022 ceph-mon[39439]: from='client.36209 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:42:54.689 INFO:teuthology.orchestra.run.smithi062.stdout: marking collection for removal 2024-04-01T19:42:54.689 INFO:teuthology.orchestra.run.smithi062.stdout:setting '_remove' omap key 2024-04-01T19:42:54.689 INFO:teuthology.orchestra.run.smithi062.stdout:finish_remove_pgs 5.2_head removing 5.2 2024-04-01T19:42:54.689 INFO:teuthology.orchestra.run.smithi062.stdout:Remove successful 2024-04-01T19:42:54.690 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:42:54.695 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:54.695 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:42:54.796 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:42:54.834 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:54 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/854059157' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:42:54.834 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:54 smithi062 ceph-mon[44211]: from='client.36209 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:42:54.840 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:54.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:54 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/854059157' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:42:54.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:54 smithi188 ceph-mon[43939]: from='client.36209 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:42:54.901 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:42:54.906 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:54.906 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:42:55.007 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:42:55.048 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:55.211 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:42:55.215 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:55.216 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:42:55.317 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:42:55.351 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:55.427 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:42:55.431 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:55.431 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:42:55.532 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:42:55.570 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:55.612 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:42:55.635 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:55.635 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:42:55.736 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:42:55.767 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:55.797 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:42:55.800 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:55.800 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:42:55.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:55 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:42:55.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:55 smithi022 ceph-mon[39439]: from='client.36209 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:42:55.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:55 smithi022 ceph-mon[39439]: osdmap e441: 12 total, 11 up, 10 in 2024-04-01T19:42:55.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:55 smithi022 ceph-mon[39439]: pgmap v1223: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.4 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 664 op/s 2024-04-01T19:42:55.863 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:55 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:42:55.863 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:55 smithi062 ceph-mon[44211]: from='client.36209 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:42:55.864 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:55 smithi062 ceph-mon[44211]: osdmap e441: 12 total, 11 up, 10 in 2024-04-01T19:42:55.864 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:55 smithi062 ceph-mon[44211]: pgmap v1223: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.4 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 664 op/s 2024-04-01T19:42:55.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:55 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:42:55.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:55 smithi188 ceph-mon[43939]: from='client.36209 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:42:55.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:55 smithi188 ceph-mon[43939]: osdmap e441: 12 total, 11 up, 10 in 2024-04-01T19:42:55.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:55 smithi188 ceph-mon[43939]: pgmap v1223: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.4 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 664 op/s 2024-04-01T19:42:55.897 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -n osd.6 --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-6 --journal-path /var/lib/ceph/osd/ceph-6/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.5.2.6 2024-04-01T19:42:55.901 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:42:55.962 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:56.010 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:42:56.018 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:56.019 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:42:56.120 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:42:56.161 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:56.171 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/osd.6/config 2024-04-01T19:42:56.198 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:42:56.204 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:56.204 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:42:56.305 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:42:56.340 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:56.365 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:42:56.371 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:56.371 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:42:56.472 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:42:56.502 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:56.524 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:42:56.529 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:56.529 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:42:56.630 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:42:56.658 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:56.682 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:42:56.684 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:56.684 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:42:56.719 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:42:56.720 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:42:56.754 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:42:56.775 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:56 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2030500913' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:42:56.785 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:42:56.786 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:42:56.814 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:56 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2030500913' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:42:56.817 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:56.825 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:42:56.853 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:42:56.887 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:42:56.916 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:42:56.954 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:42:56.987 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:42:57.022 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:42:57.054 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:42:57.085 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:42:57.085 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:42:57.085 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:42:57.085 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:42:57.085 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:42:57.085 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:42:57.085 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:42:57.085 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:42:57.086 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:42:57.086 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:42:57.086 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:42:57.086 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:42:57.086 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:42:57.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:56 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2030500913' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:42:57.421 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_ops_in_flight 2024-04-01T19:42:57.482 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:42:57.872 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:42:57.881 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:57.881 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:42:57.922 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:42:57.923 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:42:57.930 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:42:57.982 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:42:58.011 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:42:58.018 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:58.044 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:42:58.046 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.046 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.047 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.047 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.047 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.047 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.047 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.047 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.047 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.047 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:57 smithi188 ceph-mon[43939]: pgmap v1224: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.2 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 931 op/s 2024-04-01T19:42:58.048 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:58.048 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:42:58.071 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.071 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.071 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.071 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.071 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.071 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.071 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.071 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.071 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.072 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:57 smithi062 ceph-mon[44211]: pgmap v1224: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.2 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 931 op/s 2024-04-01T19:42:58.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:57 smithi022 ceph-mon[39439]: pgmap v1224: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.2 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 931 op/s 2024-04-01T19:42:58.148 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:42:58.231 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:58.313 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:42:58.315 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:58.316 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:42:58.417 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:42:58.446 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:58.469 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:42:58.471 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:58.472 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:42:58.521 INFO:teuthology.orchestra.run.smithi062.stderr:Creating an OSD daemon form without an OSD FSID value 2024-04-01T19:42:58.572 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:42:58.634 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:58.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:58.912 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:42:58.915 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:58.915 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:42:59.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:59.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:59.016 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:42:59.058 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:59.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:59.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:42:59.517 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:42:59.523 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:59.523 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:42:59.624 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:42:59.656 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:59.695 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:42:59.699 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:59.700 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:42:59.800 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:42:59.830 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:42:59.854 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:42:59.857 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:42:59.857 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:42:59.924 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:42:59.958 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:43:00.033 INFO:teuthology.orchestra.run.smithi062.stdout:get_pg_num_history pg_num_history pg_num_history(e421 pg_nums {1={14=1},5={364=16}} deleted_pools ) 2024-04-01T19:43:00.034 INFO:teuthology.orchestra.run.smithi062.stdout:Importing pgid 5.2 2024-04-01T19:43:00.045 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40000bf4:::benchmark_data_smithi188_119427_object134090:head# 2024-04-01T19:43:00.045 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.045 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40009d9e:::benchmark_data_smithi188_119427_object113115:head# 2024-04-01T19:43:00.045 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4000f269:::benchmark_data_smithi188_119427_object106758:head# 2024-04-01T19:43:00.046 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4001477a:::benchmark_data_smithi188_119427_object134958:head# 2024-04-01T19:43:00.046 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:400237f4:::benchmark_data_smithi188_119427_object113763:head# 2024-04-01T19:43:00.046 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.047 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40039fae:::benchmark_data_smithi188_119427_object119685:head# 2024-04-01T19:43:00.047 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.047 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40041153:::benchmark_data_smithi188_119427_object94245:head# 2024-04-01T19:43:00.047 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.047 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4004b467:::benchmark_data_smithi188_119427_object88250:head# 2024-04-01T19:43:00.047 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.047 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40051804:::benchmark_data_smithi188_119427_object93824:head# 2024-04-01T19:43:00.047 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.047 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40057915:::benchmark_data_smithi188_119427_object93910:head# 2024-04-01T19:43:00.047 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.048 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4005be01:::benchmark_data_smithi188_119427_object103970:head# 2024-04-01T19:43:00.049 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.049 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40072648:::benchmark_data_smithi188_119427_object107378:head# 2024-04-01T19:43:00.049 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.049 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:400798f9:::benchmark_data_smithi188_119427_object95168:head# 2024-04-01T19:43:00.049 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.049 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40086103:::benchmark_data_smithi188_119427_object76769:head# 2024-04-01T19:43:00.049 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.049 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:400917e0:::benchmark_data_smithi188_119427_object92459:head# 2024-04-01T19:43:00.049 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.049 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40095b7b:::benchmark_data_smithi188_119427_object88110:head# 2024-04-01T19:43:00.049 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.050 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:00.051 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:400a7040:::benchmark_data_smithi188_119427_object101623:head# 2024-04-01T19:43:00.051 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.051 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:400b2a1c:::benchmark_data_smithi188_119427_object118608:head# 2024-04-01T19:43:00.051 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.051 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:400b4d10:::benchmark_data_smithi188_119427_object163737:head# 2024-04-01T19:43:00.051 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.051 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:400ce235:::benchmark_data_smithi188_119427_object137290:head# 2024-04-01T19:43:00.051 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.051 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:400d029e:::benchmark_data_smithi188_119427_object87397:head# 2024-04-01T19:43:00.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:400d9f1d:::benchmark_data_smithi188_119427_object98882:head# 2024-04-01T19:43:00.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:400dde81:::benchmark_data_smithi188_119427_object94373:head# 2024-04-01T19:43:00.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:400e1415:::benchmark_data_smithi188_119427_object91523:head# 2024-04-01T19:43:00.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:400e2779:::benchmark_data_smithi188_119427_object153173:head# 2024-04-01T19:43:00.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.053 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:400e3ddf:::benchmark_data_smithi188_119427_object87526:head# 2024-04-01T19:43:00.054 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.054 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:400eadd9:::benchmark_data_smithi188_119427_object118025:head# 2024-04-01T19:43:00.054 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.054 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:400f387c:::benchmark_data_smithi188_119427_object77278:head# 2024-04-01T19:43:00.054 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.054 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4011177c:::benchmark_data_smithi188_119427_object151776:head# 2024-04-01T19:43:00.054 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.054 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40111fb6:::benchmark_data_smithi188_119427_object133224:head# 2024-04-01T19:43:00.054 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.054 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:401269d9:::benchmark_data_smithi188_119427_object73343:head# 2024-04-01T19:43:00.054 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.054 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40133b8a:::benchmark_data_smithi188_119427_object78244:head# 2024-04-01T19:43:00.054 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.054 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4014696a:::benchmark_data_smithi188_119427_object87001:head# 2024-04-01T19:43:00.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.055 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40155994:::benchmark_data_smithi188_119427_object143854:head# 2024-04-01T19:43:00.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.056 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40162b70:::benchmark_data_smithi188_119427_object141478:head# 2024-04-01T19:43:00.056 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.056 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4016b9f7:::benchmark_data_smithi188_119427_object99245:head# 2024-04-01T19:43:00.056 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.056 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40180d14:::benchmark_data_smithi188_119427_object145630:head# 2024-04-01T19:43:00.056 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.057 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40188b6d:::benchmark_data_smithi188_119427_object144387:head# 2024-04-01T19:43:00.057 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.057 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40199e50:::benchmark_data_smithi188_119427_object111265:head# 2024-04-01T19:43:00.057 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.057 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:401b2dbd:::benchmark_data_smithi188_119427_object156375:head# 2024-04-01T19:43:00.057 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.057 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:401b8a02:::benchmark_data_smithi188_119427_object121064:head# 2024-04-01T19:43:00.057 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.057 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:401bb17a:::benchmark_data_smithi188_119427_object102025:head# 2024-04-01T19:43:00.057 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.057 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:401c3ba2:::benchmark_data_smithi188_119427_object100367:head# 2024-04-01T19:43:00.057 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.058 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:401c5fab:::benchmark_data_smithi188_119427_object115173:head# 2024-04-01T19:43:00.058 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.058 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:401ce2ff:::benchmark_data_smithi188_119427_object122367:head# 2024-04-01T19:43:00.058 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:401d465b:::benchmark_data_smithi188_119427_object98870:head# 2024-04-01T19:43:00.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:401d5915:::benchmark_data_smithi188_119427_object77044:head# 2024-04-01T19:43:00.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:401d898c:::benchmark_data_smithi188_119427_object120693:head# 2024-04-01T19:43:00.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:401e601d:::benchmark_data_smithi188_119427_object90542:head# 2024-04-01T19:43:00.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:401f4c35:::benchmark_data_smithi188_119427_object125343:head# 2024-04-01T19:43:00.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:401f4d04:::benchmark_data_smithi188_119427_object78651:head# 2024-04-01T19:43:00.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:401f9836:::benchmark_data_smithi188_119427_object137595:head# 2024-04-01T19:43:00.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:402050ab:::benchmark_data_smithi188_119427_object104007:head# 2024-04-01T19:43:00.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40234dea:::benchmark_data_smithi188_119427_object85761:head# 2024-04-01T19:43:00.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:402519e1:::benchmark_data_smithi188_119427_object100482:head# 2024-04-01T19:43:00.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40253ab4:::benchmark_data_smithi188_119427_object163508:head# 2024-04-01T19:43:00.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.062 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40253f67:::benchmark_data_smithi188_119427_object74516:head# 2024-04-01T19:43:00.062 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.062 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4025536b:::benchmark_data_smithi188_119427_object76954:head# 2024-04-01T19:43:00.062 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.062 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:402577aa:::benchmark_data_smithi188_119427_object117384:head# 2024-04-01T19:43:00.062 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.062 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40259b7b:::benchmark_data_smithi188_119427_object82333:head# 2024-04-01T19:43:00.062 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.062 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4025a174:::benchmark_data_smithi188_119427_object154003:head# 2024-04-01T19:43:00.062 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.064 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:402628a9:::benchmark_data_smithi188_119427_object145277:head# 2024-04-01T19:43:00.064 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.064 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4026a678:::benchmark_data_smithi188_119427_object74440:head# 2024-04-01T19:43:00.064 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.064 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40273666:::benchmark_data_smithi188_119427_object142607:head# 2024-04-01T19:43:00.064 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.064 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40274074:::benchmark_data_smithi188_119427_object146975:head# 2024-04-01T19:43:00.064 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.064 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40280c7d:::benchmark_data_smithi188_119427_object95662:head# 2024-04-01T19:43:00.064 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.064 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40287d37:::benchmark_data_smithi188_119427_object83073:head# 2024-04-01T19:43:00.065 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.065 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:402983c8:::benchmark_data_smithi188_119427_object95978:head# 2024-04-01T19:43:00.065 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.065 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:402a1fbb:::benchmark_data_smithi188_119427_object113539:head# 2024-04-01T19:43:00.065 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.065 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:402a6ccf:::benchmark_data_smithi188_119427_object104854:head# 2024-04-01T19:43:00.065 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.065 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:402a85b0:::benchmark_data_smithi188_119427_object74825:head# 2024-04-01T19:43:00.065 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.065 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:402a9894:::benchmark_data_smithi188_119427_object129617:head# 2024-04-01T19:43:00.065 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.067 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:402b0f39:::benchmark_data_smithi188_119427_object125489:head# 2024-04-01T19:43:00.067 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.067 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:402b2e85:::benchmark_data_smithi188_119427_object160789:head# 2024-04-01T19:43:00.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:402b50b6:::benchmark_data_smithi188_119427_object135642:head# 2024-04-01T19:43:00.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:402ba304:::benchmark_data_smithi188_119427_object77342:head# 2024-04-01T19:43:00.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:402bb517:::benchmark_data_smithi188_119427_object140960:head# 2024-04-01T19:43:00.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:402bf25d:::benchmark_data_smithi188_119427_object116642:head# 2024-04-01T19:43:00.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:402ce0f4:::benchmark_data_smithi188_119427_object117038:head# 2024-04-01T19:43:00.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:402d0998:::benchmark_data_smithi188_119427_object105241:head# 2024-04-01T19:43:00.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:402d2906:::benchmark_data_smithi188_119427_object110705:head# 2024-04-01T19:43:00.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:402d2c76:::benchmark_data_smithi188_119427_object114981:head# 2024-04-01T19:43:00.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:402fbd28:::benchmark_data_smithi188_119427_object158244:head# 2024-04-01T19:43:00.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4030544f:::benchmark_data_smithi188_119427_object104591:head# 2024-04-01T19:43:00.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40309bfc:::benchmark_data_smithi188_119427_object142699:head# 2024-04-01T19:43:00.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:403379a8:::benchmark_data_smithi188_119427_object111716:head# 2024-04-01T19:43:00.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:403407f2:::benchmark_data_smithi188_119427_object151179:head# 2024-04-01T19:43:00.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40348b79:::benchmark_data_smithi188_119427_object161313:head# 2024-04-01T19:43:00.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4034b1d3:::benchmark_data_smithi188_119427_object95315:head# 2024-04-01T19:43:00.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:403560b9:::benchmark_data_smithi188_119427_object114236:head# 2024-04-01T19:43:00.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40363815:::benchmark_data_smithi188_119427_object160300:head# 2024-04-01T19:43:00.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:403717a7:::benchmark_data_smithi188_119427_object136080:head# 2024-04-01T19:43:00.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40377f8f:::benchmark_data_smithi188_119427_object132589:head# 2024-04-01T19:43:00.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40393dbd:::benchmark_data_smithi188_119427_object106293:head# 2024-04-01T19:43:00.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4039e487:::benchmark_data_smithi188_119427_object157604:head# 2024-04-01T19:43:00.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:403a8883:::benchmark_data_smithi188_119427_object128277:head# 2024-04-01T19:43:00.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:403af1b6:::benchmark_data_smithi188_119427_object100222:head# 2024-04-01T19:43:00.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:403c216e:::benchmark_data_smithi188_119427_object151790:head# 2024-04-01T19:43:00.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:403c78c2:::benchmark_data_smithi188_119427_object159818:head# 2024-04-01T19:43:00.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:403cbfc3:::benchmark_data_smithi188_119427_object124793:head# 2024-04-01T19:43:00.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:403de18e:::benchmark_data_smithi188_119427_object152662:head# 2024-04-01T19:43:00.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.075 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:403e5e37:::benchmark_data_smithi188_119427_object117808:head# 2024-04-01T19:43:00.075 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.075 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:403ea4d1:::benchmark_data_smithi188_119427_object132979:head# 2024-04-01T19:43:00.075 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.075 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:403eff72:::benchmark_data_smithi188_119427_object135700:head# 2024-04-01T19:43:00.075 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.075 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:403f3345:::benchmark_data_smithi188_119427_object100199:head# 2024-04-01T19:43:00.075 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.075 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:403f3b5d:::benchmark_data_smithi188_119427_object123304:head# 2024-04-01T19:43:00.075 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.075 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40400921:::benchmark_data_smithi188_119427_object142223:head# 2024-04-01T19:43:00.075 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.075 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40412e1f:::benchmark_data_smithi188_119427_object156599:head# 2024-04-01T19:43:00.075 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40430516:::benchmark_data_smithi188_119427_object149892:head# 2024-04-01T19:43:00.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40433699:::benchmark_data_smithi188_119427_object146971:head# 2024-04-01T19:43:00.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40444ec2:::benchmark_data_smithi188_119427_object131525:head# 2024-04-01T19:43:00.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:404469e2:::benchmark_data_smithi188_119427_object132029:head# 2024-04-01T19:43:00.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40451fec:::benchmark_data_smithi188_119427_object75751:head# 2024-04-01T19:43:00.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40452754:::benchmark_data_smithi188_119427_object151535:head# 2024-04-01T19:43:00.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.078 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:404663f6:::benchmark_data_smithi188_119427_object79488:head# 2024-04-01T19:43:00.078 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.080 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40470ee5:::benchmark_data_smithi188_119427_object148783:head# 2024-04-01T19:43:00.080 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.080 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4047a32f:::benchmark_data_smithi188_119427_object115689:head# 2024-04-01T19:43:00.080 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.080 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4047b7f4:::benchmark_data_smithi188_119427_object131961:head# 2024-04-01T19:43:00.080 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.080 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4047bf4f:::benchmark_data_smithi188_119427_object117241:head# 2024-04-01T19:43:00.080 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.080 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:404817e8:::benchmark_data_smithi188_119427_object76150:head# 2024-04-01T19:43:00.080 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40492b83:::benchmark_data_smithi188_119427_object112146:head# 2024-04-01T19:43:00.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:404959d0:::benchmark_data_smithi188_119427_object135583:head# 2024-04-01T19:43:00.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:404b19ce:::benchmark_data_smithi188_119427_object113447:head# 2024-04-01T19:43:00.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:404b1e11:::benchmark_data_smithi188_119427_object99402:head# 2024-04-01T19:43:00.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:404b5c61:::benchmark_data_smithi188_119427_object79460:head# 2024-04-01T19:43:00.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:404b8928:::benchmark_data_smithi188_119427_object77125:head# 2024-04-01T19:43:00.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:404bcecd:::benchmark_data_smithi188_119427_object103369:head# 2024-04-01T19:43:00.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:404d2f83:::benchmark_data_smithi188_119427_object77145:head# 2024-04-01T19:43:00.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:404d74d5:::benchmark_data_smithi188_119427_object150289:head# 2024-04-01T19:43:00.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:404d8999:::benchmark_data_smithi188_119427_object75464:head# 2024-04-01T19:43:00.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:404d8a28:::benchmark_data_smithi188_119427_object116961:head# 2024-04-01T19:43:00.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:404e2104:::benchmark_data_smithi188_119427_object149233:head# 2024-04-01T19:43:00.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:404e2376:::benchmark_data_smithi188_119427_object146751:head# 2024-04-01T19:43:00.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:404f2045:::benchmark_data_smithi188_119427_object154677:head# 2024-04-01T19:43:00.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.083 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4050d1a9:::benchmark_data_smithi188_119427_object99217:head# 2024-04-01T19:43:00.083 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.083 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4051fadc:::benchmark_data_smithi188_119427_object159640:head# 2024-04-01T19:43:00.083 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.083 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40520d66:::benchmark_data_smithi188_119427_object155971:head# 2024-04-01T19:43:00.083 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.083 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40526df6:::benchmark_data_smithi188_119427_object107493:head# 2024-04-01T19:43:00.083 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4053c800:::benchmark_data_smithi188_119427_object127022:head# 2024-04-01T19:43:00.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40540e51:::benchmark_data_smithi188_119427_object127887:head# 2024-04-01T19:43:00.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4054ba99:::benchmark_data_smithi188_119427_object128745:head# 2024-04-01T19:43:00.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4054f8de:::benchmark_data_smithi188_119427_object111016:head# 2024-04-01T19:43:00.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4055ba15:::benchmark_data_smithi188_119427_object84783:head# 2024-04-01T19:43:00.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40564286:::benchmark_data_smithi188_119427_object117784:head# 2024-04-01T19:43:00.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40588a76:::benchmark_data_smithi188_119427_object136822:head# 2024-04-01T19:43:00.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:405a7e6e:::benchmark_data_smithi188_119427_object128702:head# 2024-04-01T19:43:00.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:405afd47:::benchmark_data_smithi188_119427_object138718:head# 2024-04-01T19:43:00.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:405b32c9:::benchmark_data_smithi188_119427_object95615:head# 2024-04-01T19:43:00.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:405b3f6f:::benchmark_data_smithi188_119427_object96249:head# 2024-04-01T19:43:00.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:405c013e:::benchmark_data_smithi188_119427_object148661:head# 2024-04-01T19:43:00.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:405f0604:::benchmark_data_smithi188_119427_object86550:head# 2024-04-01T19:43:00.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.089 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:405fab6d:::benchmark_data_smithi188_119427_object82211:head# 2024-04-01T19:43:00.089 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.089 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:405fc5c7:::benchmark_data_smithi188_119427_object96641:head# 2024-04-01T19:43:00.089 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.089 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:405fc6e3:::benchmark_data_smithi188_119427_object139410:head# 2024-04-01T19:43:00.089 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.089 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:405fd622:::benchmark_data_smithi188_119427_object89726:head# 2024-04-01T19:43:00.089 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.089 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4060ab1d:::benchmark_data_smithi188_119427_object139274:head# 2024-04-01T19:43:00.089 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.089 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4061375c:::benchmark_data_smithi188_119427_object132881:head# 2024-04-01T19:43:00.089 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.089 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4062900c:::benchmark_data_smithi188_119427_object133418:head# 2024-04-01T19:43:00.089 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.090 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4062c65c:::benchmark_data_smithi188_119427_object103600:head# 2024-04-01T19:43:00.090 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.090 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:406330d7:::benchmark_data_smithi188_119427_object140278:head# 2024-04-01T19:43:00.090 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.090 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4065a876:::benchmark_data_smithi188_119427_object77739:head# 2024-04-01T19:43:00.090 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.090 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:406603e6:::benchmark_data_smithi188_119427_object143968:head# 2024-04-01T19:43:00.090 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.090 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40661736:::benchmark_data_smithi188_119427_object156637:head# 2024-04-01T19:43:00.090 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.090 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4066357d:::benchmark_data_smithi188_119427_object121587:head# 2024-04-01T19:43:00.090 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.090 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40666811:::benchmark_data_smithi188_119427_object148816:head# 2024-04-01T19:43:00.090 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.094 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:406674d3:::benchmark_data_smithi188_119427_object98866:head# 2024-04-01T19:43:00.094 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.094 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4067c870:::benchmark_data_smithi188_119427_object82611:head# 2024-04-01T19:43:00.094 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.094 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40684803:::benchmark_data_smithi188_119427_object158792:head# 2024-04-01T19:43:00.094 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.094 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40687e37:::benchmark_data_smithi188_119427_object150565:head# 2024-04-01T19:43:00.094 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.094 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4069bbeb:::benchmark_data_smithi188_119427_object150500:head# 2024-04-01T19:43:00.094 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.094 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:406a0965:::benchmark_data_smithi188_119427_object143450:head# 2024-04-01T19:43:00.094 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.094 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:406a1ac7:::benchmark_data_smithi188_119427_object101185:head# 2024-04-01T19:43:00.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:406a3605:::benchmark_data_smithi188_119427_object86835:head# 2024-04-01T19:43:00.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:406ba978:::benchmark_data_smithi188_119427_object96769:head# 2024-04-01T19:43:00.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:406d758a:::benchmark_data_smithi188_119427_object162427:head# 2024-04-01T19:43:00.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:406e17d2:::benchmark_data_smithi188_119427_object88868:head# 2024-04-01T19:43:00.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:406ef6e0:::benchmark_data_smithi188_119427_object145585:head# 2024-04-01T19:43:00.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:406f05a5:::benchmark_data_smithi188_119427_object150328:head# 2024-04-01T19:43:00.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4070af97:::benchmark_data_smithi188_119427_object109007:head# 2024-04-01T19:43:00.096 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.096 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4070f82a:::benchmark_data_smithi188_119427_object127346:head# 2024-04-01T19:43:00.096 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.096 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4071105d:::benchmark_data_smithi188_119427_object105778:head# 2024-04-01T19:43:00.096 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.096 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40715990:::benchmark_data_smithi188_119427_object124300:head# 2024-04-01T19:43:00.096 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.096 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4071bee8:::benchmark_data_smithi188_119427_object158255:head# 2024-04-01T19:43:00.096 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.096 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40722f94:::benchmark_data_smithi188_119427_object163152:head# 2024-04-01T19:43:00.096 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.096 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4072b0b6:::benchmark_data_smithi188_119427_object93436:head# 2024-04-01T19:43:00.096 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.096 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4072d5fa:::benchmark_data_smithi188_119427_object147562:head# 2024-04-01T19:43:00.096 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.097 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:407392cb:::benchmark_data_smithi188_119427_object162815:head# 2024-04-01T19:43:00.097 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.097 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4073a321:::benchmark_data_smithi188_119427_object134777:head# 2024-04-01T19:43:00.097 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.097 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4073ca08:::benchmark_data_smithi188_119427_object149568:head# 2024-04-01T19:43:00.097 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.097 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4076b9ec:::benchmark_data_smithi188_119427_object121965:head# 2024-04-01T19:43:00.097 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.100 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:407720a7:::benchmark_data_smithi188_119427_object153414:head# 2024-04-01T19:43:00.100 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.100 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40788955:::benchmark_data_smithi188_119427_object90369:head# 2024-04-01T19:43:00.100 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.100 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40794b2c:::benchmark_data_smithi188_119427_object145899:head# 2024-04-01T19:43:00.100 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.100 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:407a96de:::benchmark_data_smithi188_119427_object146628:head# 2024-04-01T19:43:00.100 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.100 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:407aa954:::benchmark_data_smithi188_119427_object128755:head# 2024-04-01T19:43:00.101 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.101 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:407baab7:::benchmark_data_smithi188_119427_object160204:head# 2024-04-01T19:43:00.101 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.101 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:407c09ab:::benchmark_data_smithi188_119427_object136323:head# 2024-04-01T19:43:00.101 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.101 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:407caac1:::benchmark_data_smithi188_119427_object111596:head# 2024-04-01T19:43:00.101 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.101 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:407d0b9e:::benchmark_data_smithi188_119427_object76669:head# 2024-04-01T19:43:00.101 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.101 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:407db701:::benchmark_data_smithi188_119427_object147557:head# 2024-04-01T19:43:00.101 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.101 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:407ddbe0:::benchmark_data_smithi188_119427_object72533:head# 2024-04-01T19:43:00.101 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.101 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:407e661b:::benchmark_data_smithi188_119427_object91742:head# 2024-04-01T19:43:00.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4081548b:::benchmark_data_smithi188_119427_object72619:head# 2024-04-01T19:43:00.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4081d329:::benchmark_data_smithi188_119427_object128571:head# 2024-04-01T19:43:00.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4083a3de:::benchmark_data_smithi188_119427_object164448:head# 2024-04-01T19:43:00.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4083c65d:::benchmark_data_smithi188_119427_object131833:head# 2024-04-01T19:43:00.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4083f699:::benchmark_data_smithi188_119427_object79641:head# 2024-04-01T19:43:00.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40840404:::benchmark_data_smithi188_119427_object121342:head# 2024-04-01T19:43:00.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:408439ff:::benchmark_data_smithi188_119427_object143277:head# 2024-04-01T19:43:00.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.103 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4086c80c:::benchmark_data_smithi188_119427_object99649:head# 2024-04-01T19:43:00.103 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.103 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:408711db:::benchmark_data_smithi188_119427_object146916:head# 2024-04-01T19:43:00.103 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.103 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:408847b0:::benchmark_data_smithi188_119427_object109128:head# 2024-04-01T19:43:00.103 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.103 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40884ef2:::benchmark_data_smithi188_119427_object123271:head# 2024-04-01T19:43:00.103 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.103 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:408899cf:::benchmark_data_smithi188_119427_object91502:head# 2024-04-01T19:43:00.103 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.106 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:408953d2:::benchmark_data_smithi188_119427_object81014:head# 2024-04-01T19:43:00.106 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.106 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40899921:::benchmark_data_smithi188_119427_object132692:head# 2024-04-01T19:43:00.106 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.106 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4089c147:::benchmark_data_smithi188_119427_object104142:head# 2024-04-01T19:43:00.106 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.106 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:408a2fe4:::benchmark_data_smithi188_119427_object103256:head# 2024-04-01T19:43:00.106 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.107 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:408a6772:::benchmark_data_smithi188_119427_object117993:head# 2024-04-01T19:43:00.107 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.107 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:408c5783:::benchmark_data_smithi188_119427_object100365:head# 2024-04-01T19:43:00.107 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.107 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:408cf7f1:::benchmark_data_smithi188_119427_object99640:head# 2024-04-01T19:43:00.107 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.107 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:408d0fc9:::benchmark_data_smithi188_119427_object92251:head# 2024-04-01T19:43:00.107 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.107 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:408dcf60:::benchmark_data_smithi188_119427_object135517:head# 2024-04-01T19:43:00.107 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.107 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:408e69ca:::benchmark_data_smithi188_119427_object75673:head# 2024-04-01T19:43:00.107 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.107 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:408edb9f:::benchmark_data_smithi188_119427_object77063:head# 2024-04-01T19:43:00.107 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.108 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:408f88ea:::benchmark_data_smithi188_119427_object92665:head# 2024-04-01T19:43:00.108 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.108 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4090013f:::benchmark_data_smithi188_119427_object138837:head# 2024-04-01T19:43:00.108 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.108 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4090cafc:::benchmark_data_smithi188_119427_object114299:head# 2024-04-01T19:43:00.108 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.108 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40916c12:::benchmark_data_smithi188_119427_object92714:head# 2024-04-01T19:43:00.108 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.108 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4091f44d:::benchmark_data_smithi188_119427_object123364:head# 2024-04-01T19:43:00.108 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.108 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4094209c:::benchmark_data_smithi188_119427_object118502:head# 2024-04-01T19:43:00.108 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.108 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40942853:::benchmark_data_smithi188_119427_object114853:head# 2024-04-01T19:43:00.108 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.109 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40975ca5:::benchmark_data_smithi188_119427_object116732:head# 2024-04-01T19:43:00.109 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.109 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4098c34e:::benchmark_data_smithi188_119427_object147914:head# 2024-04-01T19:43:00.109 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.109 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:409b2336:::benchmark_data_smithi188_119427_object138271:head# 2024-04-01T19:43:00.109 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.111 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:409ba331:::benchmark_data_smithi188_119427_object120675:head# 2024-04-01T19:43:00.111 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.112 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:409c0863:::benchmark_data_smithi188_119427_object81029:head# 2024-04-01T19:43:00.112 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.112 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:409c6c03:::benchmark_data_smithi188_119427_object119150:head# 2024-04-01T19:43:00.112 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.112 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:409cd02a:::benchmark_data_smithi188_119427_object78993:head# 2024-04-01T19:43:00.112 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.112 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:409d679d:::benchmark_data_smithi188_119427_object73208:head# 2024-04-01T19:43:00.112 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.112 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:409e0492:::benchmark_data_smithi188_119427_object116493:head# 2024-04-01T19:43:00.112 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.112 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:409ed080:::benchmark_data_smithi188_119427_object132244:head# 2024-04-01T19:43:00.112 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.112 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:409f2a2a:::benchmark_data_smithi188_119427_object103912:head# 2024-04-01T19:43:00.112 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.113 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40a03841:::benchmark_data_smithi188_119427_object84372:head# 2024-04-01T19:43:00.113 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.113 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40a09aa1:::benchmark_data_smithi188_119427_object90101:head# 2024-04-01T19:43:00.113 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.113 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40a19818:::benchmark_data_smithi188_119427_object130904:head# 2024-04-01T19:43:00.113 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.113 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40a1bce0:::benchmark_data_smithi188_119427_object144377:head# 2024-04-01T19:43:00.113 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.113 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40a2e67b:::benchmark_data_smithi188_119427_object127814:head# 2024-04-01T19:43:00.113 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.113 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40a36261:::benchmark_data_smithi188_119427_object85423:head# 2024-04-01T19:43:00.113 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.113 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40a3d164:::benchmark_data_smithi188_119427_object99342:head# 2024-04-01T19:43:00.113 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.114 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40a4f880:::benchmark_data_smithi188_119427_object80561:head# 2024-04-01T19:43:00.114 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.114 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40a69119:::benchmark_data_smithi188_119427_object96497:head# 2024-04-01T19:43:00.114 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.114 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40a749e2:::benchmark_data_smithi188_119427_object137978:head# 2024-04-01T19:43:00.114 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.114 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40a7a4d0:::benchmark_data_smithi188_119427_object95941:head# 2024-04-01T19:43:00.114 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.114 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40a81d52:::benchmark_data_smithi188_119427_object74889:head# 2024-04-01T19:43:00.114 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.117 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40a9b1e2:::benchmark_data_smithi188_119427_object91598:head# 2024-04-01T19:43:00.117 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.117 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40ab9130:::benchmark_data_smithi188_119427_object103734:head# 2024-04-01T19:43:00.117 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.117 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40aba2bd:::benchmark_data_smithi188_119427_object135956:head# 2024-04-01T19:43:00.117 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.117 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40abdaaa:::benchmark_data_smithi188_119427_object131430:head# 2024-04-01T19:43:00.117 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.117 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40abe0ef:::benchmark_data_smithi188_119427_object142061:head# 2024-04-01T19:43:00.118 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.118 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40ada39b:::benchmark_data_smithi188_119427_object130867:head# 2024-04-01T19:43:00.118 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.118 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40ae1f65:::benchmark_data_smithi188_119427_object129944:head# 2024-04-01T19:43:00.118 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.118 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40b30353:::benchmark_data_smithi188_119427_object135188:head# 2024-04-01T19:43:00.118 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.118 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40b32ce7:::benchmark_data_smithi188_119427_object136304:head# 2024-04-01T19:43:00.118 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.118 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40b37b11:::benchmark_data_smithi188_119427_object131202:head# 2024-04-01T19:43:00.118 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.118 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40b3e688:::benchmark_data_smithi188_119427_object101457:head# 2024-04-01T19:43:00.118 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.119 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40b4660f:::benchmark_data_smithi188_119427_object74395:head# 2024-04-01T19:43:00.119 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.119 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40b47937:::benchmark_data_smithi188_119427_object163244:head# 2024-04-01T19:43:00.119 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.119 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40b57de1:::benchmark_data_smithi188_119427_object102055:head# 2024-04-01T19:43:00.119 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.119 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40b654d6:::benchmark_data_smithi188_119427_object117222:head# 2024-04-01T19:43:00.119 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.119 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40b69d82:::benchmark_data_smithi188_119427_object83143:head# 2024-04-01T19:43:00.119 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.119 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40b8158d:::benchmark_data_smithi188_119427_object131323:head# 2024-04-01T19:43:00.119 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.119 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40b8488e:::benchmark_data_smithi188_119427_object80196:head# 2024-04-01T19:43:00.119 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.119 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40b945eb:::benchmark_data_smithi188_119427_object128184:head# 2024-04-01T19:43:00.120 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.120 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40ba00e6:::benchmark_data_smithi188_119427_object113113:head# 2024-04-01T19:43:00.120 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.120 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:42:59 smithi022 ceph-mon[39439]: pgmap v1225: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.1 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 763 op/s 2024-04-01T19:43:00.122 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40ba619b:::benchmark_data_smithi188_119427_object104208:head# 2024-04-01T19:43:00.122 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.122 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40bb2201:::benchmark_data_smithi188_119427_object109073:head# 2024-04-01T19:43:00.122 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.122 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40bc2f3c:::benchmark_data_smithi188_119427_object89524:head# 2024-04-01T19:43:00.122 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.122 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40bca323:::benchmark_data_smithi188_119427_object112697:head# 2024-04-01T19:43:00.123 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.123 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40bd8f4f:::benchmark_data_smithi188_119427_object87343:head# 2024-04-01T19:43:00.123 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.123 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40bde7c0:::benchmark_data_smithi188_119427_object94879:head# 2024-04-01T19:43:00.123 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.123 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40c15f9e:::benchmark_data_smithi188_119427_object111019:head# 2024-04-01T19:43:00.123 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.123 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40c1836b:::benchmark_data_smithi188_119427_object75000:head# 2024-04-01T19:43:00.123 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.123 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40c200d9:::benchmark_data_smithi188_119427_object128423:head# 2024-04-01T19:43:00.123 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.123 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40c262f5:::benchmark_data_smithi188_119427_object141431:head# 2024-04-01T19:43:00.123 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.123 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40c2d9d9:::benchmark_data_smithi188_119427_object78203:head# 2024-04-01T19:43:00.124 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.124 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40c4ae1d:::benchmark_data_smithi188_119427_object103762:head# 2024-04-01T19:43:00.124 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.124 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40c6380b:::benchmark_data_smithi188_119427_object109334:head# 2024-04-01T19:43:00.124 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.124 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40c6600a:::benchmark_data_smithi188_119427_object82502:head# 2024-04-01T19:43:00.124 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.124 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40c6d570:::benchmark_data_smithi188_119427_object86543:head# 2024-04-01T19:43:00.124 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.124 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40c78712:::benchmark_data_smithi188_119427_object121703:head# 2024-04-01T19:43:00.124 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.124 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40cb8b82:::benchmark_data_smithi188_119427_object139245:head# 2024-04-01T19:43:00.124 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.124 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40cc7543:::benchmark_data_smithi188_119427_object102467:head# 2024-04-01T19:43:00.124 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:42:59 smithi188 ceph-mon[43939]: pgmap v1225: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.1 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 763 op/s 2024-04-01T19:43:00.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40cd5129:::benchmark_data_smithi188_119427_object144309:head# 2024-04-01T19:43:00.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40ceffaf:::benchmark_data_smithi188_119427_object107197:head# 2024-04-01T19:43:00.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40cf2953:::benchmark_data_smithi188_119427_object122718:head# 2024-04-01T19:43:00.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40d07cfb:::benchmark_data_smithi188_119427_object124045:head# 2024-04-01T19:43:00.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40d08a3c:::benchmark_data_smithi188_119427_object95109:head# 2024-04-01T19:43:00.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40d091c7:::benchmark_data_smithi188_119427_object104894:head# 2024-04-01T19:43:00.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40d0c96e:::benchmark_data_smithi188_119427_object137661:head# 2024-04-01T19:43:00.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40d16722:::benchmark_data_smithi188_119427_object163219:head# 2024-04-01T19:43:00.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40d17253:::benchmark_data_smithi188_119427_object107316:head# 2024-04-01T19:43:00.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40d272d6:::benchmark_data_smithi188_119427_object99226:head# 2024-04-01T19:43:00.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40d36187:::benchmark_data_smithi188_119427_object148666:head# 2024-04-01T19:43:00.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40d4f5c7:::benchmark_data_smithi188_119427_object107209:head# 2024-04-01T19:43:00.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40d5cbd2:::benchmark_data_smithi188_119427_object132624:head# 2024-04-01T19:43:00.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40d65967:::benchmark_data_smithi188_119427_object88644:head# 2024-04-01T19:43:00.130 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.130 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40d73a59:::benchmark_data_smithi188_119427_object122673:head# 2024-04-01T19:43:00.130 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.130 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40d86f8e:::benchmark_data_smithi188_119427_object86106:head# 2024-04-01T19:43:00.130 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.130 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40db5040:::benchmark_data_smithi188_119427_object124553:head# 2024-04-01T19:43:00.130 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.130 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40dc8af1:::benchmark_data_smithi188_119427_object140540:head# 2024-04-01T19:43:00.130 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.130 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40dce84c:::benchmark_data_smithi188_119427_object146407:head# 2024-04-01T19:43:00.130 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.130 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40dd7f5c:::benchmark_data_smithi188_119427_object104753:head# 2024-04-01T19:43:00.130 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.134 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40ddd12e:::benchmark_data_smithi188_119427_object140283:head# 2024-04-01T19:43:00.134 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.134 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40de0131:::benchmark_data_smithi188_119427_object87441:head# 2024-04-01T19:43:00.134 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.134 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40de2556:::benchmark_data_smithi188_119427_object114111:head# 2024-04-01T19:43:00.134 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.134 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40de4e77:::benchmark_data_smithi188_119427_object145023:head# 2024-04-01T19:43:00.135 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.135 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40debafe:::benchmark_data_smithi188_119427_object99812:head# 2024-04-01T19:43:00.135 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.135 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40dedf75:::benchmark_data_smithi188_119427_object86562:head# 2024-04-01T19:43:00.135 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.135 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40dfb03f:::benchmark_data_smithi188_119427_object91701:head# 2024-04-01T19:43:00.135 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.135 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40e2b69a:::benchmark_data_smithi188_119427_object94711:head# 2024-04-01T19:43:00.135 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.135 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40e30d27:::benchmark_data_smithi188_119427_object87858:head# 2024-04-01T19:43:00.135 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.135 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40e38425:::benchmark_data_smithi188_119427_object143324:head# 2024-04-01T19:43:00.135 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.135 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40e3e73a:::benchmark_data_smithi188_119427_object129642:head# 2024-04-01T19:43:00.136 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.136 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40e4b6cd:::benchmark_data_smithi188_119427_object120580:head# 2024-04-01T19:43:00.136 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.136 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40e5bce3:::benchmark_data_smithi188_119427_object141711:head# 2024-04-01T19:43:00.136 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.136 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40e67302:::benchmark_data_smithi188_119427_object141860:head# 2024-04-01T19:43:00.136 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.136 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40e68942:::benchmark_data_smithi188_119427_object96791:head# 2024-04-01T19:43:00.136 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.136 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40e81343:::benchmark_data_smithi188_119427_object91763:head# 2024-04-01T19:43:00.136 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.136 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40e92de8:::benchmark_data_smithi188_119427_object88929:head# 2024-04-01T19:43:00.136 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.136 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40e94a78:::benchmark_data_smithi188_119427_object85593:head# 2024-04-01T19:43:00.137 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.137 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40e94d40:::benchmark_data_smithi188_119427_object124702:head# 2024-04-01T19:43:00.137 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.137 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40e99604:::benchmark_data_smithi188_119427_object81044:head# 2024-04-01T19:43:00.137 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.137 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40e9ba79:::benchmark_data_smithi188_119427_object103944:head# 2024-04-01T19:43:00.137 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.137 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40ea5ed3:::benchmark_data_smithi188_119427_object120550:head# 2024-04-01T19:43:00.137 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.137 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40ed3883:::benchmark_data_smithi188_119427_object155963:head# 2024-04-01T19:43:00.137 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.137 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40edf2b2:::benchmark_data_smithi188_119427_object110340:head# 2024-04-01T19:43:00.137 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.137 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40edf783:::benchmark_data_smithi188_119427_object137372:head# 2024-04-01T19:43:00.138 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.138 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40ee8ba5:::benchmark_data_smithi188_119427_object89183:head# 2024-04-01T19:43:00.138 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.140 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40ef666a:::benchmark_data_smithi188_119427_object88616:head# 2024-04-01T19:43:00.140 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.140 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40f059d1:::benchmark_data_smithi188_119427_object78884:head# 2024-04-01T19:43:00.140 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.140 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40f0a17b:::benchmark_data_smithi188_119427_object84093:head# 2024-04-01T19:43:00.140 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40f65e03:::benchmark_data_smithi188_119427_object134662:head# 2024-04-01T19:43:00.141 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40f859ca:::benchmark_data_smithi188_119427_object155322:head# 2024-04-01T19:43:00.141 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40f87d30:::benchmark_data_smithi188_119427_object94977:head# 2024-04-01T19:43:00.141 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40f9949e:::benchmark_data_smithi188_119427_object151860:head# 2024-04-01T19:43:00.141 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40f9c418:::benchmark_data_smithi188_119427_object116481:head# 2024-04-01T19:43:00.141 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40fa254b:::benchmark_data_smithi188_119427_object106474:head# 2024-04-01T19:43:00.141 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40fa5196:::benchmark_data_smithi188_119427_object92446:head# 2024-04-01T19:43:00.142 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.142 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40fb0ac9:::benchmark_data_smithi188_119427_object106004:head# 2024-04-01T19:43:00.142 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.142 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40fb93a7:::benchmark_data_smithi188_119427_object73826:head# 2024-04-01T19:43:00.142 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.142 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40fc8aa9:::benchmark_data_smithi188_119427_object149757:head# 2024-04-01T19:43:00.142 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.142 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40fccebd:::benchmark_data_smithi188_119427_object160945:head# 2024-04-01T19:43:00.142 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.142 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40fce3de:::benchmark_data_smithi188_119427_object75255:head# 2024-04-01T19:43:00.142 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.142 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40fdb64f:::benchmark_data_smithi188_119427_object109963:head# 2024-04-01T19:43:00.142 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.142 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40fe19c9:::benchmark_data_smithi188_119427_object95139:head# 2024-04-01T19:43:00.143 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.143 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40fe5ad8:::benchmark_data_smithi188_119427_object158599:head# 2024-04-01T19:43:00.143 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.143 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:40ffb76f:::benchmark_data_smithi188_119427_object162862:head# 2024-04-01T19:43:00.143 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.143 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4100f039:::benchmark_data_smithi188_119427_object128666:head# 2024-04-01T19:43:00.143 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.143 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41028ea1:::benchmark_data_smithi188_119427_object148045:head# 2024-04-01T19:43:00.143 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.143 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4102e51b:::benchmark_data_smithi188_119427_object112003:head# 2024-04-01T19:43:00.143 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.143 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4102ed1f:::benchmark_data_smithi188_119427_object125665:head# 2024-04-01T19:43:00.143 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.147 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:410336f7:::benchmark_data_smithi188_119427_object113458:head# 2024-04-01T19:43:00.147 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.147 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4103aaf7:::benchmark_data_smithi188_119427_object98537:head# 2024-04-01T19:43:00.147 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.147 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4103e21c:::benchmark_data_smithi188_119427_object135401:head# 2024-04-01T19:43:00.147 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.147 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4103f0fc:::benchmark_data_smithi188_119427_object105442:head# 2024-04-01T19:43:00.147 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.147 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:410548e1:::benchmark_data_smithi188_119427_object101667:head# 2024-04-01T19:43:00.148 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.148 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:410553b1:::benchmark_data_smithi188_119427_object88272:head# 2024-04-01T19:43:00.148 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.148 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:410583e3:::benchmark_data_smithi188_119427_object81963:head# 2024-04-01T19:43:00.148 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.148 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4106836b:::benchmark_data_smithi188_119427_object129256:head# 2024-04-01T19:43:00.148 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.148 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:410723b6:::benchmark_data_smithi188_119427_object146394:head# 2024-04-01T19:43:00.148 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.148 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41076474:::benchmark_data_smithi188_119427_object103608:head# 2024-04-01T19:43:00.148 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.148 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:410776d5:::benchmark_data_smithi188_119427_object126254:head# 2024-04-01T19:43:00.148 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.148 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4108078d:::benchmark_data_smithi188_119427_object130842:head# 2024-04-01T19:43:00.149 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.149 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41082750:::benchmark_data_smithi188_119427_object120020:head# 2024-04-01T19:43:00.149 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.149 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4108514a:::benchmark_data_smithi188_119427_object75081:head# 2024-04-01T19:43:00.149 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.149 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4108c6a1:::benchmark_data_smithi188_119427_object101004:head# 2024-04-01T19:43:00.149 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.149 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:410a2c71:::benchmark_data_smithi188_119427_object157458:head# 2024-04-01T19:43:00.149 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.149 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:410aa2e2:::benchmark_data_smithi188_119427_object149606:head# 2024-04-01T19:43:00.149 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.149 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:410acb56:::benchmark_data_smithi188_119427_object148776:head# 2024-04-01T19:43:00.149 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.149 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:410adb8d:::benchmark_data_smithi188_119427_object128450:head# 2024-04-01T19:43:00.150 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.150 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:410b5cc2:::benchmark_data_smithi188_119427_object149964:head# 2024-04-01T19:43:00.150 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.150 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:410b92bc:::benchmark_data_smithi188_119427_object102946:head# 2024-04-01T19:43:00.150 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.150 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:410bbf9a:::benchmark_data_smithi188_119427_object160340:head# 2024-04-01T19:43:00.150 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.150 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:410c33bc:::benchmark_data_smithi188_119427_object154259:head# 2024-04-01T19:43:00.150 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.150 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:410cdd3f:::benchmark_data_smithi188_119427_object73148:head# 2024-04-01T19:43:00.150 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.150 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:410e113a:::benchmark_data_smithi188_119427_object162212:head# 2024-04-01T19:43:00.150 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.150 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:410f6630:::benchmark_data_smithi188_119427_object88393:head# 2024-04-01T19:43:00.150 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.157 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:410ff157:::benchmark_data_smithi188_119427_object110176:head# 2024-04-01T19:43:00.157 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.158 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41115ed1:::benchmark_data_smithi188_119427_object109547:head# 2024-04-01T19:43:00.158 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.158 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41117069:::benchmark_data_smithi188_119427_object96605:head# 2024-04-01T19:43:00.158 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.158 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4111a1fb:::benchmark_data_smithi188_119427_object103442:head# 2024-04-01T19:43:00.158 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.158 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4111c6d4:::benchmark_data_smithi188_119427_object104433:head# 2024-04-01T19:43:00.158 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.158 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4111de5f:::benchmark_data_smithi188_119427_object120158:head# 2024-04-01T19:43:00.158 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.158 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:411239e4:::benchmark_data_smithi188_119427_object115756:head# 2024-04-01T19:43:00.158 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.158 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4112575a:::benchmark_data_smithi188_119427_object93454:head# 2024-04-01T19:43:00.159 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.159 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41148038:::benchmark_data_smithi188_119427_object103677:head# 2024-04-01T19:43:00.159 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.159 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4114c5ad:::benchmark_data_smithi188_119427_object83032:head# 2024-04-01T19:43:00.159 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.159 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41175381:::benchmark_data_smithi188_119427_object110945:head# 2024-04-01T19:43:00.159 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.159 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4117bda0:::benchmark_data_smithi188_119427_object149499:head# 2024-04-01T19:43:00.159 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.159 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4117e835:::benchmark_data_smithi188_119427_object156191:head# 2024-04-01T19:43:00.159 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.159 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4118b842:::benchmark_data_smithi188_119427_object101272:head# 2024-04-01T19:43:00.159 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.159 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4118f6fc:::benchmark_data_smithi188_119427_object108639:head# 2024-04-01T19:43:00.160 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.160 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4118fa29:::benchmark_data_smithi188_119427_object162309:head# 2024-04-01T19:43:00.160 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.160 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:411a5976:::benchmark_data_smithi188_119427_object138293:head# 2024-04-01T19:43:00.160 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.160 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:411a63d6:::benchmark_data_smithi188_119427_object74511:head# 2024-04-01T19:43:00.160 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.160 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:411aaf80:::benchmark_data_smithi188_119427_object101454:head# 2024-04-01T19:43:00.160 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.160 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:411ab77c:::benchmark_data_smithi188_119427_object94320:head# 2024-04-01T19:43:00.160 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.160 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:411af104:::benchmark_data_smithi188_119427_object90390:head# 2024-04-01T19:43:00.160 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.160 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:411b0b5f:::benchmark_data_smithi188_119427_object106103:head# 2024-04-01T19:43:00.161 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.161 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:411b4b11:::benchmark_data_smithi188_119427_object97326:head# 2024-04-01T19:43:00.161 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.161 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:411b9a89:::benchmark_data_smithi188_119427_object146538:head# 2024-04-01T19:43:00.161 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.161 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:411c40b1:::benchmark_data_smithi188_119427_object81039:head# 2024-04-01T19:43:00.161 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.161 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:411daa4e:::benchmark_data_smithi188_119427_object87230:head# 2024-04-01T19:43:00.161 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.161 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:411df296:::benchmark_data_smithi188_119427_object148484:head# 2024-04-01T19:43:00.161 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.161 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:411ed2f7:::benchmark_data_smithi188_119427_object162472:head# 2024-04-01T19:43:00.161 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.161 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:411f8b27:::benchmark_data_smithi188_119427_object115820:head# 2024-04-01T19:43:00.161 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.162 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41218700:::benchmark_data_smithi188_119427_object89114:head# 2024-04-01T19:43:00.162 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.162 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:412212f8:::benchmark_data_smithi188_119427_object98256:head# 2024-04-01T19:43:00.162 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.162 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:412463ff:::benchmark_data_smithi188_119427_object115795:head# 2024-04-01T19:43:00.162 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.162 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41246c98:::benchmark_data_smithi188_119427_object105814:head# 2024-04-01T19:43:00.162 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.162 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41254026:::benchmark_data_smithi188_119427_object124193:head# 2024-04-01T19:43:00.162 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.162 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4126016d:::benchmark_data_smithi188_119427_object125566:head# 2024-04-01T19:43:00.162 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.162 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41264493:::benchmark_data_smithi188_119427_object110724:head# 2024-04-01T19:43:00.162 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.163 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41277d99:::benchmark_data_smithi188_119427_object95668:head# 2024-04-01T19:43:00.163 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.163 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4127844b:::benchmark_data_smithi188_119427_object90342:head# 2024-04-01T19:43:00.163 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.163 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41283b4b:::benchmark_data_smithi188_119427_object82064:head# 2024-04-01T19:43:00.163 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.168 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4128bd53:::benchmark_data_smithi188_119427_object120290:head# 2024-04-01T19:43:00.168 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.168 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:412938e2:::benchmark_data_smithi188_119427_object107268:head# 2024-04-01T19:43:00.168 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.168 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4129d353:::benchmark_data_smithi188_119427_object118722:head# 2024-04-01T19:43:00.168 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.168 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:412afa82:::benchmark_data_smithi188_119427_object124782:head# 2024-04-01T19:43:00.168 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.168 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:412b08be:::benchmark_data_smithi188_119427_object122077:head# 2024-04-01T19:43:00.168 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.168 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:412cc5cd:::benchmark_data_smithi188_119427_object118870:head# 2024-04-01T19:43:00.168 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.168 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:412d348e:::benchmark_data_smithi188_119427_object73072:head# 2024-04-01T19:43:00.168 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.169 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:412da66f:::benchmark_data_smithi188_119427_object116388:head# 2024-04-01T19:43:00.169 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.169 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:412dec55:::benchmark_data_smithi188_119427_object76519:head# 2024-04-01T19:43:00.169 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.169 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:412e7e14:::benchmark_data_smithi188_119427_object116138:head# 2024-04-01T19:43:00.169 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.169 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:412f02d1:::benchmark_data_smithi188_119427_object124706:head# 2024-04-01T19:43:00.169 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.169 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:412fded0:::benchmark_data_smithi188_119427_object139843:head# 2024-04-01T19:43:00.169 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.169 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41311034:::benchmark_data_smithi188_119427_object114715:head# 2024-04-01T19:43:00.169 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.169 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41319b4c:::benchmark_data_smithi188_119427_object139987:head# 2024-04-01T19:43:00.169 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.170 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4131c161:::benchmark_data_smithi188_119427_object142282:head# 2024-04-01T19:43:00.170 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.170 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41331fc7:::benchmark_data_smithi188_119427_object143748:head# 2024-04-01T19:43:00.170 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.170 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41335c93:::benchmark_data_smithi188_119427_object83593:head# 2024-04-01T19:43:00.170 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.170 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:413395ff:::benchmark_data_smithi188_119427_object116090:head# 2024-04-01T19:43:00.170 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.170 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4133e147:::benchmark_data_smithi188_119427_object164083:head# 2024-04-01T19:43:00.170 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.170 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41340546:::benchmark_data_smithi188_119427_object96189:head# 2024-04-01T19:43:00.170 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.170 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41343a4e:::benchmark_data_smithi188_119427_object100147:head# 2024-04-01T19:43:00.170 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41359635:::benchmark_data_smithi188_119427_object97973:head# 2024-04-01T19:43:00.171 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41385ac3:::benchmark_data_smithi188_119427_object158320:head# 2024-04-01T19:43:00.171 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4138f048:::benchmark_data_smithi188_119427_object139960:head# 2024-04-01T19:43:00.171 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:413a9179:::benchmark_data_smithi188_119427_object152407:head# 2024-04-01T19:43:00.171 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:413b639e:::benchmark_data_smithi188_119427_object117751:head# 2024-04-01T19:43:00.171 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:413b6ec2:::benchmark_data_smithi188_119427_object92632:head# 2024-04-01T19:43:00.171 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:413b9e86:::benchmark_data_smithi188_119427_object136172:head# 2024-04-01T19:43:00.171 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:413bfb5c:::benchmark_data_smithi188_119427_object154536:head# 2024-04-01T19:43:00.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:413bfe62:::benchmark_data_smithi188_119427_object131659:head# 2024-04-01T19:43:00.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:413ce19a:::benchmark_data_smithi188_119427_object100957:head# 2024-04-01T19:43:00.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:413ce37f:::benchmark_data_smithi188_119427_object78214:head# 2024-04-01T19:43:00.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:413e1d9b:::benchmark_data_smithi188_119427_object112336:head# 2024-04-01T19:43:00.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41401ce4:::benchmark_data_smithi188_119427_object80616:head# 2024-04-01T19:43:00.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4141739f:::benchmark_data_smithi188_119427_object100113:head# 2024-04-01T19:43:00.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41421a8c:::benchmark_data_smithi188_119427_object73994:head# 2024-04-01T19:43:00.173 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.173 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41424a62:::benchmark_data_smithi188_119427_object78238:head# 2024-04-01T19:43:00.173 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.173 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4144b70e:::benchmark_data_smithi188_119427_object98358:head# 2024-04-01T19:43:00.173 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.173 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4145341c:::benchmark_data_smithi188_119427_object114212:head# 2024-04-01T19:43:00.173 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.173 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:414839d4:::benchmark_data_smithi188_119427_object146845:head# 2024-04-01T19:43:00.173 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.173 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:414928dc:::benchmark_data_smithi188_119427_object129242:head# 2024-04-01T19:43:00.173 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.173 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4149356f:::benchmark_data_smithi188_119427_object79812:head# 2024-04-01T19:43:00.173 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.177 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:414a08d5:::benchmark_data_smithi188_119427_object93002:head# 2024-04-01T19:43:00.177 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.177 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:414a2270:::benchmark_data_smithi188_119427_object163035:head# 2024-04-01T19:43:00.177 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.177 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:414bdc15:::benchmark_data_smithi188_119427_object82016:head# 2024-04-01T19:43:00.177 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.177 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:414c2afa:::benchmark_data_smithi188_119427_object159451:head# 2024-04-01T19:43:00.177 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.178 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:414c5263:::benchmark_data_smithi188_119427_object119868:head# 2024-04-01T19:43:00.178 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.178 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:414c8fcc:::benchmark_data_smithi188_119427_object114829:head# 2024-04-01T19:43:00.178 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.178 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:414d6dea:::benchmark_data_smithi188_119427_object85824:head# 2024-04-01T19:43:00.178 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.178 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:414dc9ec:::benchmark_data_smithi188_119427_object98420:head# 2024-04-01T19:43:00.178 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.178 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:414e12af:::benchmark_data_smithi188_119427_object81900:head# 2024-04-01T19:43:00.178 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.178 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:414e6594:::benchmark_data_smithi188_119427_object160981:head# 2024-04-01T19:43:00.178 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.178 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:414f3fe3:::benchmark_data_smithi188_119427_object143629:head# 2024-04-01T19:43:00.178 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.179 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:414f4c86:::benchmark_data_smithi188_119427_object148802:head# 2024-04-01T19:43:00.179 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.179 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:414ff252:::benchmark_data_smithi188_119427_object112278:head# 2024-04-01T19:43:00.179 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.179 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:415052c3:::benchmark_data_smithi188_119427_object85449:head# 2024-04-01T19:43:00.179 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.179 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41525930:::benchmark_data_smithi188_119427_object116834:head# 2024-04-01T19:43:00.179 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.179 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4152e696:::benchmark_data_smithi188_119427_object109092:head# 2024-04-01T19:43:00.179 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.179 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41535b35:::benchmark_data_smithi188_119427_object110290:head# 2024-04-01T19:43:00.179 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.179 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41543cc9:::benchmark_data_smithi188_119427_object96569:head# 2024-04-01T19:43:00.179 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.180 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4156f4d8:::benchmark_data_smithi188_119427_object131856:head# 2024-04-01T19:43:00.180 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.180 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41572442:::benchmark_data_smithi188_119427_object73681:head# 2024-04-01T19:43:00.180 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.180 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41577c18:::benchmark_data_smithi188_119427_object154734:head# 2024-04-01T19:43:00.180 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.180 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:415bbe40:::benchmark_data_smithi188_119427_object152899:head# 2024-04-01T19:43:00.180 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.180 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:415bc362:::benchmark_data_smithi188_119427_object83093:head# 2024-04-01T19:43:00.180 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.180 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:415c0875:::benchmark_data_smithi188_119427_object164693:head# 2024-04-01T19:43:00.180 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.180 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:415c5771:::benchmark_data_smithi188_119427_object142346:head# 2024-04-01T19:43:00.180 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.180 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:415d9d7c:::benchmark_data_smithi188_119427_object155664:head# 2024-04-01T19:43:00.181 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.181 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:415dc37b:::benchmark_data_smithi188_119427_object147600:head# 2024-04-01T19:43:00.181 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.181 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:415f735d:::benchmark_data_smithi188_119427_object124287:head# 2024-04-01T19:43:00.181 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.181 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41601142:::benchmark_data_smithi188_119427_object95798:head# 2024-04-01T19:43:00.181 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.181 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4160900f:::benchmark_data_smithi188_119427_object146419:head# 2024-04-01T19:43:00.181 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.181 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4160ce9e:::benchmark_data_smithi188_119427_object79821:head# 2024-04-01T19:43:00.181 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.181 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4161aad0:::benchmark_data_smithi188_119427_object130952:head# 2024-04-01T19:43:00.181 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.184 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41630368:::benchmark_data_smithi188_119427_object123277:head# 2024-04-01T19:43:00.184 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.184 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4164c647:::benchmark_data_smithi188_119427_object76638:head# 2024-04-01T19:43:00.184 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.184 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4164d02b:::benchmark_data_smithi188_119427_object93079:head# 2024-04-01T19:43:00.184 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.184 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41650882:::benchmark_data_smithi188_119427_object73267:head# 2024-04-01T19:43:00.184 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.184 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4165ab50:::benchmark_data_smithi188_119427_object119748:head# 2024-04-01T19:43:00.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.185 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4165f533:::benchmark_data_smithi188_119427_object91413:head# 2024-04-01T19:43:00.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.185 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41666718:::benchmark_data_smithi188_119427_object131342:head# 2024-04-01T19:43:00.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.185 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41679f35:::benchmark_data_smithi188_119427_object113123:head# 2024-04-01T19:43:00.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.185 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:416c10c2:::benchmark_data_smithi188_119427_object112744:head# 2024-04-01T19:43:00.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.185 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:416c87f0:::benchmark_data_smithi188_119427_object99683:head# 2024-04-01T19:43:00.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.185 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:416d0d2e:::benchmark_data_smithi188_119427_object121837:head# 2024-04-01T19:43:00.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.185 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:416d9afc:::benchmark_data_smithi188_119427_object99008:head# 2024-04-01T19:43:00.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.186 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:416da3f9:::benchmark_data_smithi188_119427_object118605:head# 2024-04-01T19:43:00.186 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.186 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:416ecc75:::benchmark_data_smithi188_119427_object86962:head# 2024-04-01T19:43:00.186 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.186 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:416f0b41:::benchmark_data_smithi188_119427_object128084:head# 2024-04-01T19:43:00.186 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.186 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:416f829b:::benchmark_data_smithi188_119427_object159453:head# 2024-04-01T19:43:00.186 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.186 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:416ffa1a:::benchmark_data_smithi188_119427_object156327:head# 2024-04-01T19:43:00.186 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.187 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:417017df:::benchmark_data_smithi188_119427_object156920:head# 2024-04-01T19:43:00.187 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.187 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41729418:::benchmark_data_smithi188_119427_object76350:head# 2024-04-01T19:43:00.187 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.187 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4172964f:::benchmark_data_smithi188_119427_object91155:head# 2024-04-01T19:43:00.187 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.189 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4172a9c8:::benchmark_data_smithi188_119427_object72538:head# 2024-04-01T19:43:00.189 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.189 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:43:00.190 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:417390e7:::benchmark_data_smithi188_119427_object118468:head# 2024-04-01T19:43:00.190 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.190 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41744391:::benchmark_data_smithi188_119427_object82947:head# 2024-04-01T19:43:00.190 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.190 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41752169:::benchmark_data_smithi188_119427_object110702:head# 2024-04-01T19:43:00.190 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.190 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:417598a4:::benchmark_data_smithi188_119427_object72841:head# 2024-04-01T19:43:00.190 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.191 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41761b57:::benchmark_data_smithi188_119427_object129214:head# 2024-04-01T19:43:00.191 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.191 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4176b4d2:::benchmark_data_smithi188_119427_object98430:head# 2024-04-01T19:43:00.191 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.192 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4176d145:::benchmark_data_smithi188_119427_object158622:head# 2024-04-01T19:43:00.192 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.192 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41776739:::benchmark_data_smithi188_119427_object159811:head# 2024-04-01T19:43:00.192 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.192 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4177bde9:::benchmark_data_smithi188_119427_object99663:head# 2024-04-01T19:43:00.192 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.192 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:417b9b1a:::benchmark_data_smithi188_119427_object123884:head# 2024-04-01T19:43:00.192 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.192 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:417bdbdf:::benchmark_data_smithi188_119427_object148179:head# 2024-04-01T19:43:00.193 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.193 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:417ce12e:::benchmark_data_smithi188_119427_object87554:head# 2024-04-01T19:43:00.193 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.193 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:00.194 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:43:00.195 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:417d3f9a:::benchmark_data_smithi188_119427_object160395:head# 2024-04-01T19:43:00.195 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.196 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:417de161:::benchmark_data_smithi188_119427_object157691:head# 2024-04-01T19:43:00.196 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.196 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:417e8929:::benchmark_data_smithi188_119427_object99118:head# 2024-04-01T19:43:00.196 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.196 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:417fde53:::benchmark_data_smithi188_119427_object104554:head# 2024-04-01T19:43:00.196 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.197 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:418064c5:::benchmark_data_smithi188_119427_object161302:head# 2024-04-01T19:43:00.197 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.197 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41819359:::benchmark_data_smithi188_119427_object157589:head# 2024-04-01T19:43:00.197 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.197 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4181fc17:::benchmark_data_smithi188_119427_object110240:head# 2024-04-01T19:43:00.197 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.198 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41829564:::benchmark_data_smithi188_119427_object136769:head# 2024-04-01T19:43:00.198 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.198 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41841a1f:::benchmark_data_smithi188_119427_object78813:head# 2024-04-01T19:43:00.198 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.198 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41853988:::benchmark_data_smithi188_119427_object158197:head# 2024-04-01T19:43:00.198 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.198 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:418699f7:::benchmark_data_smithi188_119427_object158707:head# 2024-04-01T19:43:00.198 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.199 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4186c294:::benchmark_data_smithi188_119427_object127512:head# 2024-04-01T19:43:00.199 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.199 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4187038a:::benchmark_data_smithi188_119427_object153458:head# 2024-04-01T19:43:00.199 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.199 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4187f9f4:::benchmark_data_smithi188_119427_object127203:head# 2024-04-01T19:43:00.200 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.200 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:418902c7:::benchmark_data_smithi188_119427_object133239:head# 2024-04-01T19:43:00.200 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.200 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41892b24:::benchmark_data_smithi188_119427_object105718:head# 2024-04-01T19:43:00.200 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.201 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:418a7724:::benchmark_data_smithi188_119427_object153038:head# 2024-04-01T19:43:00.201 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.201 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:418b056f:::benchmark_data_smithi188_119427_object108559:head# 2024-04-01T19:43:00.201 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.201 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:418b4419:::benchmark_data_smithi188_119427_object155198:head# 2024-04-01T19:43:00.201 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.201 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:418c2ddb:::benchmark_data_smithi188_119427_object134979:head# 2024-04-01T19:43:00.202 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.202 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:418d20cd:::benchmark_data_smithi188_119427_object123109:head# 2024-04-01T19:43:00.202 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.202 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:418d602f:::benchmark_data_smithi188_119427_object111048:head# 2024-04-01T19:43:00.202 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.202 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:418f5b50:::benchmark_data_smithi188_119427_object95950:head# 2024-04-01T19:43:00.202 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.203 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:418f78ec:::benchmark_data_smithi188_119427_object145687:head# 2024-04-01T19:43:00.203 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.203 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41900c86:::benchmark_data_smithi188_119427_object121960:head# 2024-04-01T19:43:00.203 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.203 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4191f043:::benchmark_data_smithi188_119427_object102796:head# 2024-04-01T19:43:00.204 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.204 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41926fb3:::benchmark_data_smithi188_119427_object99336:head# 2024-04-01T19:43:00.204 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.204 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4192de0b:::benchmark_data_smithi188_119427_object78900:head# 2024-04-01T19:43:00.204 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.204 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4192e80d:::benchmark_data_smithi188_119427_object127225:head# 2024-04-01T19:43:00.204 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.204 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41937f33:::benchmark_data_smithi188_119427_object157312:head# 2024-04-01T19:43:00.204 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.204 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4193ba59:::benchmark_data_smithi188_119427_object139289:head# 2024-04-01T19:43:00.204 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.206 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4193bd98:::benchmark_data_smithi188_119427_object103735:head# 2024-04-01T19:43:00.206 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.206 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4194c4c3:::benchmark_data_smithi188_119427_object95842:head# 2024-04-01T19:43:00.206 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.206 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4194ecf2:::benchmark_data_smithi188_119427_object72769:head# 2024-04-01T19:43:00.207 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.207 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4195fbfa:::benchmark_data_smithi188_119427_object132997:head# 2024-04-01T19:43:00.207 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.207 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41969be2:::benchmark_data_smithi188_119427_object76138:head# 2024-04-01T19:43:00.207 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.207 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4196c4f2:::benchmark_data_smithi188_119427_object153786:head# 2024-04-01T19:43:00.207 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.207 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41972b64:::benchmark_data_smithi188_119427_object154372:head# 2024-04-01T19:43:00.207 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.207 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4197bade:::benchmark_data_smithi188_119427_object116659:head# 2024-04-01T19:43:00.207 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.207 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4198a358:::benchmark_data_smithi188_119427_object93064:head# 2024-04-01T19:43:00.207 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.207 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4198ec12:::benchmark_data_smithi188_119427_object111935:head# 2024-04-01T19:43:00.208 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.208 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41997290:::benchmark_data_smithi188_119427_object131326:head# 2024-04-01T19:43:00.208 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.210 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4199f78f:::benchmark_data_smithi188_119427_object107627:head# 2024-04-01T19:43:00.210 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.210 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:419a3919:::benchmark_data_smithi188_119427_object140429:head# 2024-04-01T19:43:00.210 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.210 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:419b08d7:::benchmark_data_smithi188_119427_object80504:head# 2024-04-01T19:43:00.210 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.210 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:419b1aa4:::benchmark_data_smithi188_119427_object162676:head# 2024-04-01T19:43:00.210 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.210 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:419b6cea:::benchmark_data_smithi188_119427_object92865:head# 2024-04-01T19:43:00.210 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:419c16e5:::benchmark_data_smithi188_119427_object123442:head# 2024-04-01T19:43:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:419cbd9e:::benchmark_data_smithi188_119427_object75511:head# 2024-04-01T19:43:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:419d2994:::benchmark_data_smithi188_119427_object135167:head# 2024-04-01T19:43:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:419d667a:::benchmark_data_smithi188_119427_object145965:head# 2024-04-01T19:43:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:419d833d:::benchmark_data_smithi188_119427_object142801:head# 2024-04-01T19:43:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:419d863d:::benchmark_data_smithi188_119427_object102681:head# 2024-04-01T19:43:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:419e31d1:::benchmark_data_smithi188_119427_object110193:head# 2024-04-01T19:43:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.212 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:419e683f:::benchmark_data_smithi188_119427_object78843:head# 2024-04-01T19:43:00.212 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.212 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:419f487b:::benchmark_data_smithi188_119427_object156169:head# 2024-04-01T19:43:00.212 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.214 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:419fb306:::benchmark_data_smithi188_119427_object87052:head# 2024-04-01T19:43:00.214 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.214 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41a1b3f5:::benchmark_data_smithi188_119427_object114388:head# 2024-04-01T19:43:00.215 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.215 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41a1c27c:::benchmark_data_smithi188_119427_object114421:head# 2024-04-01T19:43:00.215 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.215 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41a1d50f:::benchmark_data_smithi188_119427_object136535:head# 2024-04-01T19:43:00.215 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.215 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41a2e0e1:::benchmark_data_smithi188_119427_object105569:head# 2024-04-01T19:43:00.215 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.215 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41a3f844:::benchmark_data_smithi188_119427_object135548:head# 2024-04-01T19:43:00.215 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.215 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41a42a05:::benchmark_data_smithi188_119427_object161187:head# 2024-04-01T19:43:00.215 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.215 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41a44cfb:::benchmark_data_smithi188_119427_object106251:head# 2024-04-01T19:43:00.215 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.215 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41a45614:::benchmark_data_smithi188_119427_object107654:head# 2024-04-01T19:43:00.216 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.216 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41a45615:::benchmark_data_smithi188_119427_object146917:head# 2024-04-01T19:43:00.216 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.216 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41a47f04:::benchmark_data_smithi188_119427_object147794:head# 2024-04-01T19:43:00.216 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.216 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41a57842:::benchmark_data_smithi188_119427_object153254:head# 2024-04-01T19:43:00.216 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.216 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41a60a8e:::benchmark_data_smithi188_119427_object100848:head# 2024-04-01T19:43:00.216 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.216 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41a6ec6f:::benchmark_data_smithi188_119427_object153523:head# 2024-04-01T19:43:00.216 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.216 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41a7136a:::benchmark_data_smithi188_119427_object81983:head# 2024-04-01T19:43:00.216 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.216 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41a781ab:::benchmark_data_smithi188_119427_object81901:head# 2024-04-01T19:43:00.217 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.217 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41a7e5e5:::benchmark_data_smithi188_119427_object114830:head# 2024-04-01T19:43:00.217 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.217 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41a7e5ff:::benchmark_data_smithi188_119427_object123459:head# 2024-04-01T19:43:00.217 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.219 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41a9bc76:::benchmark_data_smithi188_119427_object105056:head# 2024-04-01T19:43:00.220 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.220 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41aadbad:::benchmark_data_smithi188_119427_object78834:head# 2024-04-01T19:43:00.220 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.220 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41ab0cef:::benchmark_data_smithi188_119427_object162709:head# 2024-04-01T19:43:00.220 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.220 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41ab1230:::benchmark_data_smithi188_119427_object82359:head# 2024-04-01T19:43:00.220 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.220 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41ab9abd:::benchmark_data_smithi188_119427_object101101:head# 2024-04-01T19:43:00.220 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.220 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41abb840:::benchmark_data_smithi188_119427_object153005:head# 2024-04-01T19:43:00.220 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.220 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41ad92cb:::benchmark_data_smithi188_119427_object94426:head# 2024-04-01T19:43:00.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41ae467d:::benchmark_data_smithi188_119427_object135374:head# 2024-04-01T19:43:00.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41ae8e8f:::benchmark_data_smithi188_119427_object154473:head# 2024-04-01T19:43:00.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41aff283:::benchmark_data_smithi188_119427_object134165:head# 2024-04-01T19:43:00.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41b08b2a:::benchmark_data_smithi188_119427_object124859:head# 2024-04-01T19:43:00.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41b0fb3b:::benchmark_data_smithi188_119427_object122045:head# 2024-04-01T19:43:00.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41b12dfd:::benchmark_data_smithi188_119427_object91579:head# 2024-04-01T19:43:00.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41b18c35:::benchmark_data_smithi188_119427_object137581:head# 2024-04-01T19:43:00.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.222 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41b224bc:::benchmark_data_smithi188_119427_object151834:head# 2024-04-01T19:43:00.222 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.222 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41b25634:::benchmark_data_smithi188_119427_object155279:head# 2024-04-01T19:43:00.222 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.222 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41b27ff0:::benchmark_data_smithi188_119427_object143726:head# 2024-04-01T19:43:00.222 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.222 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41b28867:::benchmark_data_smithi188_119427_object144077:head# 2024-04-01T19:43:00.222 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.222 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41b2b7c5:::benchmark_data_smithi188_119427_object94854:head# 2024-04-01T19:43:00.222 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.226 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41b2e881:::benchmark_data_smithi188_119427_object109602:head# 2024-04-01T19:43:00.226 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41b31c04:::benchmark_data_smithi188_119427_object112131:head# 2024-04-01T19:43:00.227 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41b380e9:::benchmark_data_smithi188_119427_object130374:head# 2024-04-01T19:43:00.227 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41b40e0d:::benchmark_data_smithi188_119427_object120544:head# 2024-04-01T19:43:00.227 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41b4c36c:::benchmark_data_smithi188_119427_object93688:head# 2024-04-01T19:43:00.227 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41b6e2d5:::benchmark_data_smithi188_119427_object122016:head# 2024-04-01T19:43:00.227 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41b812f1:::benchmark_data_smithi188_119427_object139022:head# 2024-04-01T19:43:00.227 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.227 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41b94b1d:::benchmark_data_smithi188_119427_object81936:head# 2024-04-01T19:43:00.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.228 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41b967e6:::benchmark_data_smithi188_119427_object153519:head# 2024-04-01T19:43:00.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.228 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41ba351d:::benchmark_data_smithi188_119427_object135798:head# 2024-04-01T19:43:00.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.228 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41bbb464:::benchmark_data_smithi188_119427_object147952:head# 2024-04-01T19:43:00.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.228 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41bcead8:::benchmark_data_smithi188_119427_object137737:head# 2024-04-01T19:43:00.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.228 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41bd8f0a:::benchmark_data_smithi188_119427_object116328:head# 2024-04-01T19:43:00.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.228 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41be1d5a:::benchmark_data_smithi188_119427_object79754:head# 2024-04-01T19:43:00.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.228 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41be4856:::benchmark_data_smithi188_119427_object152593:head# 2024-04-01T19:43:00.229 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.229 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41bf0161:::benchmark_data_smithi188_119427_object161124:head# 2024-04-01T19:43:00.229 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.229 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41bf3ef1:::benchmark_data_smithi188_119427_object116765:head# 2024-04-01T19:43:00.229 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.229 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41c08ecf:::benchmark_data_smithi188_119427_object159204:head# 2024-04-01T19:43:00.229 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.229 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41c0e1a8:::benchmark_data_smithi188_119427_object89399:head# 2024-04-01T19:43:00.229 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.229 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41c11767:::benchmark_data_smithi188_119427_object151087:head# 2024-04-01T19:43:00.229 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.229 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41c144ba:::benchmark_data_smithi188_119427_object80411:head# 2024-04-01T19:43:00.229 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.229 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41c166c0:::benchmark_data_smithi188_119427_object107090:head# 2024-04-01T19:43:00.229 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.230 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41c1791f:::benchmark_data_smithi188_119427_object88824:head# 2024-04-01T19:43:00.230 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.230 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41c1f4c1:::benchmark_data_smithi188_119427_object126379:head# 2024-04-01T19:43:00.230 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.230 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41c2f5b6:::benchmark_data_smithi188_119427_object77144:head# 2024-04-01T19:43:00.230 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.230 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41c32c59:::benchmark_data_smithi188_119427_object109045:head# 2024-04-01T19:43:00.230 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.234 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41c3eee3:::benchmark_data_smithi188_119427_object125258:head# 2024-04-01T19:43:00.234 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.234 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41c45bf9:::benchmark_data_smithi188_119427_object139776:head# 2024-04-01T19:43:00.234 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.234 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41c476b8:::benchmark_data_smithi188_119427_object134797:head# 2024-04-01T19:43:00.234 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.234 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41c50d79:::benchmark_data_smithi188_119427_object149154:head# 2024-04-01T19:43:00.234 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41c51085:::benchmark_data_smithi188_119427_object149783:head# 2024-04-01T19:43:00.235 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41c5b7b5:::benchmark_data_smithi188_119427_object123193:head# 2024-04-01T19:43:00.235 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41c5cdfa:::benchmark_data_smithi188_119427_object156056:head# 2024-04-01T19:43:00.235 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41c7078d:::benchmark_data_smithi188_119427_object96762:head# 2024-04-01T19:43:00.235 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41c709d0:::benchmark_data_smithi188_119427_object143325:head# 2024-04-01T19:43:00.235 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41c78677:::benchmark_data_smithi188_119427_object84352:head# 2024-04-01T19:43:00.235 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41c808c3:::benchmark_data_smithi188_119427_object129683:head# 2024-04-01T19:43:00.235 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41c89e7e:::benchmark_data_smithi188_119427_object160094:head# 2024-04-01T19:43:00.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41ca5d96:::benchmark_data_smithi188_119427_object139006:head# 2024-04-01T19:43:00.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41caa4af:::benchmark_data_smithi188_119427_object100519:head# 2024-04-01T19:43:00.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41cb35f1:::benchmark_data_smithi188_119427_object114390:head# 2024-04-01T19:43:00.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41cb933b:::benchmark_data_smithi188_119427_object148878:head# 2024-04-01T19:43:00.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41d011c0:::benchmark_data_smithi188_119427_object72625:head# 2024-04-01T19:43:00.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41d074df:::benchmark_data_smithi188_119427_object78298:head# 2024-04-01T19:43:00.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.237 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41d0b9c9:::benchmark_data_smithi188_119427_object149491:head# 2024-04-01T19:43:00.237 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.237 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41d15c76:::benchmark_data_smithi188_119427_object147017:head# 2024-04-01T19:43:00.237 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.237 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41d17f9b:::benchmark_data_smithi188_119427_object122864:head# 2024-04-01T19:43:00.237 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.237 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41d1833e:::benchmark_data_smithi188_119427_object93070:head# 2024-04-01T19:43:00.237 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.237 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41d1a604:::benchmark_data_smithi188_119427_object76379:head# 2024-04-01T19:43:00.237 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.237 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41d2c65f:::benchmark_data_smithi188_119427_object134201:head# 2024-04-01T19:43:00.237 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.237 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41d30537:::benchmark_data_smithi188_119427_object73209:head# 2024-04-01T19:43:00.238 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.238 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41d44d04:::benchmark_data_smithi188_119427_object153224:head# 2024-04-01T19:43:00.238 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.238 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41d45252:::benchmark_data_smithi188_119427_object106557:head# 2024-04-01T19:43:00.238 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.238 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41d5a8d0:::benchmark_data_smithi188_119427_object108239:head# 2024-04-01T19:43:00.238 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.238 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41d5bae1:::benchmark_data_smithi188_119427_object130886:head# 2024-04-01T19:43:00.238 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.239 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41d84c22:::benchmark_data_smithi188_119427_object115560:head# 2024-04-01T19:43:00.239 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41d8f0e4:::benchmark_data_smithi188_119427_object76053:head# 2024-04-01T19:43:00.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41d91228:::benchmark_data_smithi188_119427_object107474:head# 2024-04-01T19:43:00.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41d97cac:::benchmark_data_smithi188_119427_object84742:head# 2024-04-01T19:43:00.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41d9d1de:::benchmark_data_smithi188_119427_object108537:head# 2024-04-01T19:43:00.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41db0f01:::benchmark_data_smithi188_119427_object114404:head# 2024-04-01T19:43:00.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41db2ced:::benchmark_data_smithi188_119427_object144694:head# 2024-04-01T19:43:00.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.242 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41dc34f5:::benchmark_data_smithi188_119427_object94296:head# 2024-04-01T19:43:00.242 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.242 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41dc5978:::benchmark_data_smithi188_119427_object160054:head# 2024-04-01T19:43:00.242 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.242 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41dc692c:::benchmark_data_smithi188_119427_object160734:head# 2024-04-01T19:43:00.242 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.242 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41dd22fe:::benchmark_data_smithi188_119427_object157161:head# 2024-04-01T19:43:00.242 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.242 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41ddc3b4:::benchmark_data_smithi188_119427_object114165:head# 2024-04-01T19:43:00.242 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.242 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41dde1d0:::benchmark_data_smithi188_119427_object106769:head# 2024-04-01T19:43:00.242 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.243 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41e01514:::benchmark_data_smithi188_119427_object126686:head# 2024-04-01T19:43:00.243 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.243 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41e14199:::benchmark_data_smithi188_119427_object90608:head# 2024-04-01T19:43:00.243 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.246 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41e3a268:::benchmark_data_smithi188_119427_object88334:head# 2024-04-01T19:43:00.246 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.246 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41e3d29c:::benchmark_data_smithi188_119427_object159932:head# 2024-04-01T19:43:00.246 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.246 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41e69291:::benchmark_data_smithi188_119427_object137924:head# 2024-04-01T19:43:00.246 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.246 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41e69ea8:::benchmark_data_smithi188_119427_object81583:head# 2024-04-01T19:43:00.246 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.247 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41e732e3:::benchmark_data_smithi188_119427_object132311:head# 2024-04-01T19:43:00.247 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.247 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41e848e7:::benchmark_data_smithi188_119427_object89402:head# 2024-04-01T19:43:00.247 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.247 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41eb5b89:::benchmark_data_smithi188_119427_object142477:head# 2024-04-01T19:43:00.247 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.247 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41ebc390:::benchmark_data_smithi188_119427_object130866:head# 2024-04-01T19:43:00.247 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.247 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41ec219d:::benchmark_data_smithi188_119427_object134003:head# 2024-04-01T19:43:00.247 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.247 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41ecda1c:::benchmark_data_smithi188_119427_object73138:head# 2024-04-01T19:43:00.247 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.247 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41ed874f:::benchmark_data_smithi188_119427_object112652:head# 2024-04-01T19:43:00.247 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.247 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41efbf45:::benchmark_data_smithi188_119427_object128568:head# 2024-04-01T19:43:00.248 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.248 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41f15c3c:::benchmark_data_smithi188_119427_object92357:head# 2024-04-01T19:43:00.248 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.248 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41f183a0:::benchmark_data_smithi188_119427_object101365:head# 2024-04-01T19:43:00.248 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.248 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41f1b5c3:::benchmark_data_smithi188_119427_object143075:head# 2024-04-01T19:43:00.248 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.248 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41f24f87:::benchmark_data_smithi188_119427_object89368:head# 2024-04-01T19:43:00.248 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.252 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41f2c16e:::benchmark_data_smithi188_119427_object109256:head# 2024-04-01T19:43:00.252 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.252 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41f31036:::benchmark_data_smithi188_119427_object116363:head# 2024-04-01T19:43:00.253 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.253 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41f32f17:::benchmark_data_smithi188_119427_object127117:head# 2024-04-01T19:43:00.253 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.253 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41f33e8f:::benchmark_data_smithi188_119427_object119502:head# 2024-04-01T19:43:00.253 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.253 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41f3f6a1:::benchmark_data_smithi188_119427_object131782:head# 2024-04-01T19:43:00.253 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.253 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41f40838:::benchmark_data_smithi188_119427_object83974:head# 2024-04-01T19:43:00.253 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.253 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41f48b93:::benchmark_data_smithi188_119427_object112022:head# 2024-04-01T19:43:00.253 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.253 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41f505cf:::benchmark_data_smithi188_119427_object91538:head# 2024-04-01T19:43:00.253 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.253 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41f88285:::benchmark_data_smithi188_119427_object96609:head# 2024-04-01T19:43:00.254 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.254 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41fa72c4:::benchmark_data_smithi188_119427_object80732:head# 2024-04-01T19:43:00.254 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.254 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41faf678:::benchmark_data_smithi188_119427_object128102:head# 2024-04-01T19:43:00.254 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.254 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41fb4f1c:::benchmark_data_smithi188_119427_object118582:head# 2024-04-01T19:43:00.254 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.254 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41fbbe62:::benchmark_data_smithi188_119427_object119132:head# 2024-04-01T19:43:00.254 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.254 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41fbc070:::benchmark_data_smithi188_119427_object86313:head# 2024-04-01T19:43:00.254 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.254 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41fc7699:::benchmark_data_smithi188_119427_object126726:head# 2024-04-01T19:43:00.254 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.255 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41fe69fb:::benchmark_data_smithi188_119427_object79802:head# 2024-04-01T19:43:00.255 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.255 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:41ff0049:::benchmark_data_smithi188_119427_object139917:head# 2024-04-01T19:43:00.255 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.255 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42002cef:::benchmark_data_smithi188_119427_object154186:head# 2024-04-01T19:43:00.255 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.255 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4201d210:::benchmark_data_smithi188_119427_object120170:head# 2024-04-01T19:43:00.255 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.255 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4202f307:::benchmark_data_smithi188_119427_object103206:head# 2024-04-01T19:43:00.255 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.255 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42034590:::benchmark_data_smithi188_119427_object124959:head# 2024-04-01T19:43:00.255 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.255 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4203d9ef:::benchmark_data_smithi188_119427_object132765:head# 2024-04-01T19:43:00.255 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.256 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42064362:::benchmark_data_smithi188_119427_object102733:head# 2024-04-01T19:43:00.256 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.256 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4206742e:::benchmark_data_smithi188_119427_object124982:head# 2024-04-01T19:43:00.256 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.256 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:420708fc:::benchmark_data_smithi188_119427_object162547:head# 2024-04-01T19:43:00.256 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.256 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42071444:::benchmark_data_smithi188_119427_object150192:head# 2024-04-01T19:43:00.256 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.260 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42075807:::benchmark_data_smithi188_119427_object89044:head# 2024-04-01T19:43:00.260 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.261 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4207b22c:::benchmark_data_smithi188_119427_object158091:head# 2024-04-01T19:43:00.261 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.261 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:420999f1:::benchmark_data_smithi188_119427_object74422:head# 2024-04-01T19:43:00.261 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.261 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:420a3a36:::benchmark_data_smithi188_119427_object94046:head# 2024-04-01T19:43:00.261 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.261 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:420a51cc:::benchmark_data_smithi188_119427_object94825:head# 2024-04-01T19:43:00.261 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.261 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:420a5f1d:::benchmark_data_smithi188_119427_object138876:head# 2024-04-01T19:43:00.261 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.261 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:420ab8e2:::benchmark_data_smithi188_119427_object95708:head# 2024-04-01T19:43:00.261 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.261 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:420b73f0:::benchmark_data_smithi188_119427_object78533:head# 2024-04-01T19:43:00.261 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.262 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:420bef5c:::benchmark_data_smithi188_119427_object74697:head# 2024-04-01T19:43:00.262 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.262 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:420c21ad:::benchmark_data_smithi188_119427_object127739:head# 2024-04-01T19:43:00.262 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.262 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:420c559c:::benchmark_data_smithi188_119427_object139542:head# 2024-04-01T19:43:00.262 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.262 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:420cbb7a:::benchmark_data_smithi188_119427_object91873:head# 2024-04-01T19:43:00.262 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.262 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:420d3072:::benchmark_data_smithi188_119427_object103916:head# 2024-04-01T19:43:00.262 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.262 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:420ee197:::benchmark_data_smithi188_119427_object147988:head# 2024-04-01T19:43:00.262 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.262 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4210ba46:::benchmark_data_smithi188_119427_object128360:head# 2024-04-01T19:43:00.263 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.263 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42116a99:::benchmark_data_smithi188_119427_object154910:head# 2024-04-01T19:43:00.263 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.263 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:421181ef:::benchmark_data_smithi188_119427_object105329:head# 2024-04-01T19:43:00.263 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.263 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42118de1:::benchmark_data_smithi188_119427_object157479:head# 2024-04-01T19:43:00.263 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.263 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:421219ee:::benchmark_data_smithi188_119427_object120514:head# 2024-04-01T19:43:00.263 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.263 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4213ac5e:::benchmark_data_smithi188_119427_object77213:head# 2024-04-01T19:43:00.263 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.263 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4213e2bc:::benchmark_data_smithi188_119427_object104621:head# 2024-04-01T19:43:00.263 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.263 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4214406d:::benchmark_data_smithi188_119427_object119283:head# 2024-04-01T19:43:00.264 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.264 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42150d4c:::benchmark_data_smithi188_119427_object105099:head# 2024-04-01T19:43:00.264 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.264 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42158028:::benchmark_data_smithi188_119427_object155212:head# 2024-04-01T19:43:00.264 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.264 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4215964c:::benchmark_data_smithi188_119427_object134941:head# 2024-04-01T19:43:00.264 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.264 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4216122f:::benchmark_data_smithi188_119427_object74012:head# 2024-04-01T19:43:00.264 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.264 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42161896:::benchmark_data_smithi188_119427_object146075:head# 2024-04-01T19:43:00.264 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.264 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42164fc0:::benchmark_data_smithi188_119427_object118267:head# 2024-04-01T19:43:00.264 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.264 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42178683:::benchmark_data_smithi188_119427_object73221:head# 2024-04-01T19:43:00.265 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.265 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:421790ba:::benchmark_data_smithi188_119427_object133939:head# 2024-04-01T19:43:00.265 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:42:59 smithi062 ceph-mon[44211]: pgmap v1225: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.1 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 763 op/s 2024-04-01T19:43:00.268 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4217f534:::benchmark_data_smithi188_119427_object146609:head# 2024-04-01T19:43:00.268 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.268 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42180e31:::benchmark_data_smithi188_119427_object87338:head# 2024-04-01T19:43:00.268 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.268 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:421852fa:::benchmark_data_smithi188_119427_object145145:head# 2024-04-01T19:43:00.268 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.268 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:421a051e:::benchmark_data_smithi188_119427_object119900:head# 2024-04-01T19:43:00.268 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.268 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:421a2653:::benchmark_data_smithi188_119427_object109911:head# 2024-04-01T19:43:00.268 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.269 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:421a61d4:::benchmark_data_smithi188_119427_object139147:head# 2024-04-01T19:43:00.269 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.269 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:421a7378:::benchmark_data_smithi188_119427_object129366:head# 2024-04-01T19:43:00.269 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.269 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:421acc17:::benchmark_data_smithi188_119427_object90242:head# 2024-04-01T19:43:00.269 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.269 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:421ad3ee:::benchmark_data_smithi188_119427_object80016:head# 2024-04-01T19:43:00.269 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.269 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:421af30b:::benchmark_data_smithi188_119427_object146278:head# 2024-04-01T19:43:00.269 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.269 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:421cac00:::benchmark_data_smithi188_119427_object137185:head# 2024-04-01T19:43:00.269 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.269 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:421d52ad:::benchmark_data_smithi188_119427_object108330:head# 2024-04-01T19:43:00.269 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.270 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:421df666:::benchmark_data_smithi188_119427_object96803:head# 2024-04-01T19:43:00.270 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.270 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:421e4a29:::benchmark_data_smithi188_119427_object121615:head# 2024-04-01T19:43:00.270 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.270 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:421e5f61:::benchmark_data_smithi188_119427_object82843:head# 2024-04-01T19:43:00.270 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.270 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:421eab30:::benchmark_data_smithi188_119427_object120183:head# 2024-04-01T19:43:00.270 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.270 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:421f1340:::benchmark_data_smithi188_119427_object161756:head# 2024-04-01T19:43:00.270 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.270 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:421fe3ee:::benchmark_data_smithi188_119427_object114256:head# 2024-04-01T19:43:00.270 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.270 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42207e4f:::benchmark_data_smithi188_119427_object87062:head# 2024-04-01T19:43:00.270 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.271 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:422176f6:::benchmark_data_smithi188_119427_object93764:head# 2024-04-01T19:43:00.271 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.271 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4221d1b5:::benchmark_data_smithi188_119427_object79693:head# 2024-04-01T19:43:00.271 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.273 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4222bd41:::benchmark_data_smithi188_119427_object99979:head# 2024-04-01T19:43:00.273 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.273 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42233798:::benchmark_data_smithi188_119427_object146783:head# 2024-04-01T19:43:00.273 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.274 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4224cc1c:::benchmark_data_smithi188_119427_object102840:head# 2024-04-01T19:43:00.274 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.274 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:422665e9:::benchmark_data_smithi188_119427_object132911:head# 2024-04-01T19:43:00.274 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.274 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4226dda2:::benchmark_data_smithi188_119427_object134481:head# 2024-04-01T19:43:00.274 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.274 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4226e646:::benchmark_data_smithi188_119427_object114790:head# 2024-04-01T19:43:00.274 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.274 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4227c564:::benchmark_data_smithi188_119427_object132514:head# 2024-04-01T19:43:00.274 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.274 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42284578:::benchmark_data_smithi188_119427_object85296:head# 2024-04-01T19:43:00.274 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.274 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42285dcc:::benchmark_data_smithi188_119427_object149229:head# 2024-04-01T19:43:00.275 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.275 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42289c07:::benchmark_data_smithi188_119427_object142972:head# 2024-04-01T19:43:00.275 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.275 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4228cfe1:::benchmark_data_smithi188_119427_object72502:head# 2024-04-01T19:43:00.275 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.275 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4228d8b8:::benchmark_data_smithi188_119427_object118839:head# 2024-04-01T19:43:00.275 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.275 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42296a79:::benchmark_data_smithi188_119427_object158052:head# 2024-04-01T19:43:00.275 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.275 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:422a15df:::benchmark_data_smithi188_119427_object112722:head# 2024-04-01T19:43:00.275 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.275 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:422abdfb:::benchmark_data_smithi188_119427_object75084:head# 2024-04-01T19:43:00.275 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.275 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:422c0d8c:::benchmark_data_smithi188_119427_object144620:head# 2024-04-01T19:43:00.275 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.276 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:422c3bea:::benchmark_data_smithi188_119427_object108277:head# 2024-04-01T19:43:00.276 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.276 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:422de2db:::benchmark_data_smithi188_119427_object81883:head# 2024-04-01T19:43:00.276 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.276 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:422e9601:::benchmark_data_smithi188_119427_object135153:head# 2024-04-01T19:43:00.276 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.280 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:422eaed8:::benchmark_data_smithi188_119427_object112330:head# 2024-04-01T19:43:00.281 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.281 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:422ee0fa:::benchmark_data_smithi188_119427_object93117:head# 2024-04-01T19:43:00.281 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.281 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:422fb1b1:::benchmark_data_smithi188_119427_object105429:head# 2024-04-01T19:43:00.281 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.281 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42317295:::benchmark_data_smithi188_119427_object125735:head# 2024-04-01T19:43:00.281 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.281 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4233a149:::benchmark_data_smithi188_119427_object138147:head# 2024-04-01T19:43:00.281 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.281 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4233ae20:::benchmark_data_smithi188_119427_object145789:head# 2024-04-01T19:43:00.281 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.281 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4233d1c2:::benchmark_data_smithi188_119427_object138631:head# 2024-04-01T19:43:00.281 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.282 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4233dab4:::benchmark_data_smithi188_119427_object105516:head# 2024-04-01T19:43:00.282 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.282 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42340a11:::benchmark_data_smithi188_119427_object120549:head# 2024-04-01T19:43:00.282 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.282 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42355366:::benchmark_data_smithi188_119427_object108688:head# 2024-04-01T19:43:00.282 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.282 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4235acbb:::benchmark_data_smithi188_119427_object90470:head# 2024-04-01T19:43:00.282 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.282 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4235c397:::benchmark_data_smithi188_119427_object74717:head# 2024-04-01T19:43:00.282 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.282 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4235e34f:::benchmark_data_smithi188_119427_object152148:head# 2024-04-01T19:43:00.282 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.282 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:423616e1:::benchmark_data_smithi188_119427_object155503:head# 2024-04-01T19:43:00.282 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.283 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42363395:::benchmark_data_smithi188_119427_object101895:head# 2024-04-01T19:43:00.283 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.283 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4236ad40:::benchmark_data_smithi188_119427_object72703:head# 2024-04-01T19:43:00.283 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.283 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4239612c:::benchmark_data_smithi188_119427_object128240:head# 2024-04-01T19:43:00.283 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.283 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4239e327:::benchmark_data_smithi188_119427_object148841:head# 2024-04-01T19:43:00.283 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.283 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:423aee3b:::benchmark_data_smithi188_119427_object108762:head# 2024-04-01T19:43:00.283 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.283 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:423daae6:::benchmark_data_smithi188_119427_object133971:head# 2024-04-01T19:43:00.283 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.283 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:423de6fe:::benchmark_data_smithi188_119427_object147873:head# 2024-04-01T19:43:00.283 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.284 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:423f2044:::benchmark_data_smithi188_119427_object84709:head# 2024-04-01T19:43:00.284 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.284 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:423fa993:::benchmark_data_smithi188_119427_object92527:head# 2024-04-01T19:43:00.284 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.284 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42408a2b:::benchmark_data_smithi188_119427_object85190:head# 2024-04-01T19:43:00.284 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.284 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42411c54:::benchmark_data_smithi188_119427_object149270:head# 2024-04-01T19:43:00.284 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.284 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42427e00:::benchmark_data_smithi188_119427_object102599:head# 2024-04-01T19:43:00.284 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.284 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4242ef24:::benchmark_data_smithi188_119427_object101837:head# 2024-04-01T19:43:00.284 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.284 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:424357a3:::benchmark_data_smithi188_119427_object80881:head# 2024-04-01T19:43:00.284 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.285 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4243d1a9:::benchmark_data_smithi188_119427_object79411:head# 2024-04-01T19:43:00.285 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.285 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42440e43:::benchmark_data_smithi188_119427_object100379:head# 2024-04-01T19:43:00.285 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.288 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42442f4d:::benchmark_data_smithi188_119427_object73333:head# 2024-04-01T19:43:00.288 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.288 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:424466d4:::benchmark_data_smithi188_119427_object161168:head# 2024-04-01T19:43:00.288 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.288 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42448f14:::benchmark_data_smithi188_119427_object105900:head# 2024-04-01T19:43:00.288 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.288 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4244b839:::benchmark_data_smithi188_119427_object93591:head# 2024-04-01T19:43:00.289 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.289 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:424561fe:::benchmark_data_smithi188_119427_object128833:head# 2024-04-01T19:43:00.289 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.289 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:424605ad:::benchmark_data_smithi188_119427_object133304:head# 2024-04-01T19:43:00.289 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.289 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42464474:::benchmark_data_smithi188_119427_object148931:head# 2024-04-01T19:43:00.289 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.289 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:424654d6:::benchmark_data_smithi188_119427_object147056:head# 2024-04-01T19:43:00.289 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.289 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4247d6b5:::benchmark_data_smithi188_119427_object161604:head# 2024-04-01T19:43:00.289 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.289 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42489d95:::benchmark_data_smithi188_119427_object89918:head# 2024-04-01T19:43:00.289 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.289 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:424979fd:::benchmark_data_smithi188_119427_object154500:head# 2024-04-01T19:43:00.289 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.290 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:424994f7:::benchmark_data_smithi188_119427_object138947:head# 2024-04-01T19:43:00.290 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.290 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4249c273:::benchmark_data_smithi188_119427_object161761:head# 2024-04-01T19:43:00.290 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.290 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:424a7f8e:::benchmark_data_smithi188_119427_object142080:head# 2024-04-01T19:43:00.290 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.290 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:424ab745:::benchmark_data_smithi188_119427_object96577:head# 2024-04-01T19:43:00.290 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.290 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:424ad024:::benchmark_data_smithi188_119427_object108308:head# 2024-04-01T19:43:00.290 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.290 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:424b7603:::benchmark_data_smithi188_119427_object135159:head# 2024-04-01T19:43:00.290 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:424b9f03:::benchmark_data_smithi188_119427_object130756:head# 2024-04-01T19:43:00.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:424ba5c9:::benchmark_data_smithi188_119427_object101073:head# 2024-04-01T19:43:00.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:424bcbe4:::benchmark_data_smithi188_119427_object96011:head# 2024-04-01T19:43:00.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:424bcf69:::benchmark_data_smithi188_119427_object139261:head# 2024-04-01T19:43:00.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:424ccbaa:::benchmark_data_smithi188_119427_object146540:head# 2024-04-01T19:43:00.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:424d7d49:::benchmark_data_smithi188_119427_object112860:head# 2024-04-01T19:43:00.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:424ee06a:::benchmark_data_smithi188_119427_object155646:head# 2024-04-01T19:43:00.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:424f63d4:::benchmark_data_smithi188_119427_object152505:head# 2024-04-01T19:43:00.292 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.292 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:424f6ded:::benchmark_data_smithi188_119427_object156042:head# 2024-04-01T19:43:00.292 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.292 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4250f902:::benchmark_data_smithi188_119427_object146353:head# 2024-04-01T19:43:00.292 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.292 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42510de5:::benchmark_data_smithi188_119427_object153591:head# 2024-04-01T19:43:00.292 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.292 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4251df78:::benchmark_data_smithi188_119427_object123209:head# 2024-04-01T19:43:00.292 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.292 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42527b16:::benchmark_data_smithi188_119427_object124858:head# 2024-04-01T19:43:00.292 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.292 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4253ef08:::benchmark_data_smithi188_119427_object145010:head# 2024-04-01T19:43:00.292 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.298 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4254cb93:::benchmark_data_smithi188_119427_object88224:head# 2024-04-01T19:43:00.298 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.298 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4254d860:::benchmark_data_smithi188_119427_object116342:head# 2024-04-01T19:43:00.298 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.299 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4256b138:::benchmark_data_smithi188_119427_object82464:head# 2024-04-01T19:43:00.299 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.299 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4256cd8f:::benchmark_data_smithi188_119427_object161652:head# 2024-04-01T19:43:00.299 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.299 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42581da3:::benchmark_data_smithi188_119427_object120319:head# 2024-04-01T19:43:00.299 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.299 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42585048:::benchmark_data_smithi188_119427_object101537:head# 2024-04-01T19:43:00.299 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.299 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:425a2c12:::benchmark_data_smithi188_119427_object145964:head# 2024-04-01T19:43:00.299 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.299 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:425a52f5:::benchmark_data_smithi188_119427_object111450:head# 2024-04-01T19:43:00.299 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.299 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:425cd39b:::benchmark_data_smithi188_119427_object155530:head# 2024-04-01T19:43:00.299 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.300 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:425ce207:::benchmark_data_smithi188_119427_object140646:head# 2024-04-01T19:43:00.300 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.300 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:425d38d6:::benchmark_data_smithi188_119427_object135104:head# 2024-04-01T19:43:00.300 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.300 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:425dd172:::benchmark_data_smithi188_119427_object146150:head# 2024-04-01T19:43:00.300 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.300 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:425e94fa:::benchmark_data_smithi188_119427_object143436:head# 2024-04-01T19:43:00.300 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.300 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:425e9e6c:::benchmark_data_smithi188_119427_object107753:head# 2024-04-01T19:43:00.300 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.300 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:425f03ac:::benchmark_data_smithi188_119427_object87340:head# 2024-04-01T19:43:00.300 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.300 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:425f7a06:::benchmark_data_smithi188_119427_object89529:head# 2024-04-01T19:43:00.300 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.300 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42605efb:::benchmark_data_smithi188_119427_object163708:head# 2024-04-01T19:43:00.301 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.301 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4263fa64:::benchmark_data_smithi188_119427_object164236:head# 2024-04-01T19:43:00.301 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.301 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42647698:::benchmark_data_smithi188_119427_object90540:head# 2024-04-01T19:43:00.301 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.301 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4267a8e6:::benchmark_data_smithi188_119427_object83158:head# 2024-04-01T19:43:00.301 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.301 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4267cb2b:::benchmark_data_smithi188_119427_object107031:head# 2024-04-01T19:43:00.301 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.301 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4268750b:::benchmark_data_smithi188_119427_object74313:head# 2024-04-01T19:43:00.301 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.301 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:426bda3d:::benchmark_data_smithi188_119427_object110622:head# 2024-04-01T19:43:00.301 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.301 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:426c0241:::benchmark_data_smithi188_119427_object134485:head# 2024-04-01T19:43:00.302 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.302 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:426d13c4:::benchmark_data_smithi188_119427_object147620:head# 2024-04-01T19:43:00.302 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.302 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:426d6d5b:::benchmark_data_smithi188_119427_object84470:head# 2024-04-01T19:43:00.302 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.302 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:426e644d:::benchmark_data_smithi188_119427_object162586:head# 2024-04-01T19:43:00.302 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.302 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:426e858f:::benchmark_data_smithi188_119427_object130166:head# 2024-04-01T19:43:00.302 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.302 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42700d70:::benchmark_data_smithi188_119427_object111947:head# 2024-04-01T19:43:00.302 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.302 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42701167:::benchmark_data_smithi188_119427_object114426:head# 2024-04-01T19:43:00.302 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.302 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42712cf1:::benchmark_data_smithi188_119427_object132594:head# 2024-04-01T19:43:00.303 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.303 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:427182fe:::benchmark_data_smithi188_119427_object105950:head# 2024-04-01T19:43:00.303 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.303 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42723523:::benchmark_data_smithi188_119427_object104041:head# 2024-04-01T19:43:00.303 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.303 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4272464c:::benchmark_data_smithi188_119427_object146012:head# 2024-04-01T19:43:00.303 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.303 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42725e1e:::benchmark_data_smithi188_119427_object109505:head# 2024-04-01T19:43:00.303 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.303 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42728915:::benchmark_data_smithi188_119427_object75543:head# 2024-04-01T19:43:00.303 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.303 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4272dcc2:::benchmark_data_smithi188_119427_object107604:head# 2024-04-01T19:43:00.303 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.303 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4272e9c8:::benchmark_data_smithi188_119427_object104458:head# 2024-04-01T19:43:00.304 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.304 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42735651:::benchmark_data_smithi188_119427_object114050:head# 2024-04-01T19:43:00.304 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.304 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:43:00.310 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4274493a:::benchmark_data_smithi188_119427_object146044:head# 2024-04-01T19:43:00.310 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.310 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4274d119:::benchmark_data_smithi188_119427_object151130:head# 2024-04-01T19:43:00.310 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.310 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4275167b:::benchmark_data_smithi188_119427_object115511:head# 2024-04-01T19:43:00.310 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.310 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4275ab73:::benchmark_data_smithi188_119427_object155508:head# 2024-04-01T19:43:00.311 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.311 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:427651f5:::benchmark_data_smithi188_119427_object164553:head# 2024-04-01T19:43:00.311 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.311 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4276abf6:::benchmark_data_smithi188_119427_object89907:head# 2024-04-01T19:43:00.311 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.311 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42783ca7:::benchmark_data_smithi188_119427_object116938:head# 2024-04-01T19:43:00.311 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.311 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42792b38:::benchmark_data_smithi188_119427_object160632:head# 2024-04-01T19:43:00.311 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.311 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4279dfe4:::benchmark_data_smithi188_119427_object131636:head# 2024-04-01T19:43:00.311 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.311 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4279f2fd:::benchmark_data_smithi188_119427_object121848:head# 2024-04-01T19:43:00.311 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.312 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:427ad979:::benchmark_data_smithi188_119427_object130675:head# 2024-04-01T19:43:00.312 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.312 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:427c4fc7:::benchmark_data_smithi188_119427_object118078:head# 2024-04-01T19:43:00.312 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.312 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:427d2cae:::benchmark_data_smithi188_119427_object121569:head# 2024-04-01T19:43:00.312 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.312 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:427e00dd:::benchmark_data_smithi188_119427_object135399:head# 2024-04-01T19:43:00.312 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.312 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:427e9e63:::benchmark_data_smithi188_119427_object117299:head# 2024-04-01T19:43:00.312 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.312 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4280015f:::benchmark_data_smithi188_119427_object151557:head# 2024-04-01T19:43:00.312 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.312 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42803ee3:::benchmark_data_smithi188_119427_object85580:head# 2024-04-01T19:43:00.313 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.313 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:428392fd:::benchmark_data_smithi188_119427_object138471:head# 2024-04-01T19:43:00.313 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.313 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4284dcae:::benchmark_data_smithi188_119427_object107712:head# 2024-04-01T19:43:00.313 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.313 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:428527f6:::benchmark_data_smithi188_119427_object87368:head# 2024-04-01T19:43:00.313 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.313 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4285ff5a:::benchmark_data_smithi188_119427_object157254:head# 2024-04-01T19:43:00.313 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.313 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4287087f:::benchmark_data_smithi188_119427_object144691:head# 2024-04-01T19:43:00.313 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.313 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42873c67:::benchmark_data_smithi188_119427_object108170:head# 2024-04-01T19:43:00.313 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.313 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4287b8d0:::benchmark_data_smithi188_119427_object91552:head# 2024-04-01T19:43:00.314 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.314 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42889ac7:::benchmark_data_smithi188_119427_object124621:head# 2024-04-01T19:43:00.314 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.314 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:428a5d5b:::benchmark_data_smithi188_119427_object161980:head# 2024-04-01T19:43:00.314 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.314 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:428ae763:::benchmark_data_smithi188_119427_object107248:head# 2024-04-01T19:43:00.314 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.314 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:428cc0ed:::benchmark_data_smithi188_119427_object83556:head# 2024-04-01T19:43:00.314 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.314 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:428d982d:::benchmark_data_smithi188_119427_object126741:head# 2024-04-01T19:43:00.314 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.314 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:428f4e2d:::benchmark_data_smithi188_119427_object148002:head# 2024-04-01T19:43:00.314 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.315 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:428f5228:::benchmark_data_smithi188_119427_object134630:head# 2024-04-01T19:43:00.315 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.315 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42902220:::benchmark_data_smithi188_119427_object76854:head# 2024-04-01T19:43:00.315 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.315 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42902e94:::benchmark_data_smithi188_119427_object163202:head# 2024-04-01T19:43:00.315 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.315 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42909419:::benchmark_data_smithi188_119427_object112668:head# 2024-04-01T19:43:00.315 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.315 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4290dca6:::benchmark_data_smithi188_119427_object139193:head# 2024-04-01T19:43:00.315 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.315 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4291f057:::benchmark_data_smithi188_119427_object125473:head# 2024-04-01T19:43:00.315 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.315 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42922966:::benchmark_data_smithi188_119427_object85305:head# 2024-04-01T19:43:00.315 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.316 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4293dc8c:::benchmark_data_smithi188_119427_object128949:head# 2024-04-01T19:43:00.316 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.316 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42940c35:::benchmark_data_smithi188_119427_object104601:head# 2024-04-01T19:43:00.316 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.319 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4294ea1e:::benchmark_data_smithi188_119427_object116374:head# 2024-04-01T19:43:00.319 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.319 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42957548:::benchmark_data_smithi188_119427_object81259:head# 2024-04-01T19:43:00.319 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.319 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42959637:::benchmark_data_smithi188_119427_object96944:head# 2024-04-01T19:43:00.320 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.320 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42970b45:::benchmark_data_smithi188_119427_object95721:head# 2024-04-01T19:43:00.320 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.320 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42973bc5:::benchmark_data_smithi188_119427_object95181:head# 2024-04-01T19:43:00.320 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.320 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42982bd3:::benchmark_data_smithi188_119427_object133425:head# 2024-04-01T19:43:00.320 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.320 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4299c459:::benchmark_data_smithi188_119427_object128784:head# 2024-04-01T19:43:00.320 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.320 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:429a212e:::benchmark_data_smithi188_119427_object135859:head# 2024-04-01T19:43:00.320 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.320 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:429a7e50:::benchmark_data_smithi188_119427_object95775:head# 2024-04-01T19:43:00.320 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.320 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:429ac12b:::benchmark_data_smithi188_119427_object78788:head# 2024-04-01T19:43:00.320 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.321 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:429b9af2:::benchmark_data_smithi188_119427_object122428:head# 2024-04-01T19:43:00.321 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.321 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:429c0bba:::benchmark_data_smithi188_119427_object103058:head# 2024-04-01T19:43:00.321 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.321 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:429c2331:::benchmark_data_smithi188_119427_object136948:head# 2024-04-01T19:43:00.321 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.321 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:429c5eab:::benchmark_data_smithi188_119427_object140240:head# 2024-04-01T19:43:00.321 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.321 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:429c8ee6:::benchmark_data_smithi188_119427_object91048:head# 2024-04-01T19:43:00.321 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.321 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:429d7a70:::benchmark_data_smithi188_119427_object111194:head# 2024-04-01T19:43:00.321 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.321 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:429da1e1:::benchmark_data_smithi188_119427_object118257:head# 2024-04-01T19:43:00.321 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.322 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:429e9f5b:::benchmark_data_smithi188_119427_object88688:head# 2024-04-01T19:43:00.322 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.322 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:429f8992:::benchmark_data_smithi188_119427_object121909:head# 2024-04-01T19:43:00.322 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.322 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42a090e3:::benchmark_data_smithi188_119427_object118817:head# 2024-04-01T19:43:00.322 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.322 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42a15d1f:::benchmark_data_smithi188_119427_object72510:head# 2024-04-01T19:43:00.322 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.322 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42a1f3fe:::benchmark_data_smithi188_119427_object130588:head# 2024-04-01T19:43:00.322 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.322 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42a40815:::benchmark_data_smithi188_119427_object116645:head# 2024-04-01T19:43:00.322 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.322 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42a45342:::benchmark_data_smithi188_119427_object136025:head# 2024-04-01T19:43:00.322 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.323 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42a487f3:::benchmark_data_smithi188_119427_object131580:head# 2024-04-01T19:43:00.323 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.323 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42a52f91:::benchmark_data_smithi188_119427_object76654:head# 2024-04-01T19:43:00.323 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.323 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42a5d5e1:::benchmark_data_smithi188_119427_object128080:head# 2024-04-01T19:43:00.323 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.323 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42a68af1:::benchmark_data_smithi188_119427_object99250:head# 2024-04-01T19:43:00.323 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.323 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42a70e72:::benchmark_data_smithi188_119427_object118039:head# 2024-04-01T19:43:00.323 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.325 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42a879b5:::benchmark_data_smithi188_119427_object163021:head# 2024-04-01T19:43:00.325 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.326 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42a946d5:::benchmark_data_smithi188_119427_object111163:head# 2024-04-01T19:43:00.326 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.326 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42ad0669:::benchmark_data_smithi188_119427_object116950:head# 2024-04-01T19:43:00.326 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.326 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42ad15f2:::benchmark_data_smithi188_119427_object162126:head# 2024-04-01T19:43:00.326 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.326 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42aea3c3:::benchmark_data_smithi188_119427_object92014:head# 2024-04-01T19:43:00.326 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.326 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42af7c91:::benchmark_data_smithi188_119427_object92700:head# 2024-04-01T19:43:00.326 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.326 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42b00e8b:::benchmark_data_smithi188_119427_object135024:head# 2024-04-01T19:43:00.326 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.327 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42b181e5:::benchmark_data_smithi188_119427_object151694:head# 2024-04-01T19:43:00.327 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.327 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42b2a227:::benchmark_data_smithi188_119427_object98227:head# 2024-04-01T19:43:00.327 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.327 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42b2a2cd:::benchmark_data_smithi188_119427_object125984:head# 2024-04-01T19:43:00.327 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.327 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42b3431c:::benchmark_data_smithi188_119427_object117386:head# 2024-04-01T19:43:00.327 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.327 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42b56a64:::benchmark_data_smithi188_119427_object133677:head# 2024-04-01T19:43:00.327 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.327 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42b589b0:::benchmark_data_smithi188_119427_object133278:head# 2024-04-01T19:43:00.327 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.327 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42b6690b:::benchmark_data_smithi188_119427_object139136:head# 2024-04-01T19:43:00.327 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.328 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42b691fe:::benchmark_data_smithi188_119427_object111460:head# 2024-04-01T19:43:00.328 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.328 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42b6e38b:::benchmark_data_smithi188_119427_object128857:head# 2024-04-01T19:43:00.328 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.328 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42b723b7:::benchmark_data_smithi188_119427_object131408:head# 2024-04-01T19:43:00.328 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.328 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42b75adc:::benchmark_data_smithi188_119427_object157446:head# 2024-04-01T19:43:00.328 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.328 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42b7d009:::benchmark_data_smithi188_119427_object161333:head# 2024-04-01T19:43:00.328 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.328 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42b91379:::benchmark_data_smithi188_119427_object136034:head# 2024-04-01T19:43:00.328 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.330 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42b96783:::benchmark_data_smithi188_119427_object105544:head# 2024-04-01T19:43:00.330 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.330 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42b98816:::benchmark_data_smithi188_119427_object99526:head# 2024-04-01T19:43:00.330 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.330 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42b9b880:::benchmark_data_smithi188_119427_object127980:head# 2024-04-01T19:43:00.330 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.331 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42baae26:::benchmark_data_smithi188_119427_object79483:head# 2024-04-01T19:43:00.331 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.331 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42bac9c0:::benchmark_data_smithi188_119427_object138571:head# 2024-04-01T19:43:00.331 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.331 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42bc8404:::benchmark_data_smithi188_119427_object120839:head# 2024-04-01T19:43:00.331 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.331 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42bcb1cb:::benchmark_data_smithi188_119427_object74167:head# 2024-04-01T19:43:00.331 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.331 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42bd973a:::benchmark_data_smithi188_119427_object155423:head# 2024-04-01T19:43:00.331 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.331 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42bdb5f7:::benchmark_data_smithi188_119427_object117741:head# 2024-04-01T19:43:00.331 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.331 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42be7779:::benchmark_data_smithi188_119427_object146479:head# 2024-04-01T19:43:00.331 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.332 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42bfd93c:::benchmark_data_smithi188_119427_object107236:head# 2024-04-01T19:43:00.332 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.332 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42c230e4:::benchmark_data_smithi188_119427_object104776:head# 2024-04-01T19:43:00.332 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.332 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42c35d6d:::benchmark_data_smithi188_119427_object93474:head# 2024-04-01T19:43:00.332 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.332 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42c38965:::benchmark_data_smithi188_119427_object153039:head# 2024-04-01T19:43:00.332 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.332 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42c3b1e8:::benchmark_data_smithi188_119427_object114951:head# 2024-04-01T19:43:00.332 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.332 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42c49297:::benchmark_data_smithi188_119427_object96750:head# 2024-04-01T19:43:00.332 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.332 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42c5ac05:::benchmark_data_smithi188_119427_object131296:head# 2024-04-01T19:43:00.332 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.334 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42c605c3:::benchmark_data_smithi188_119427_object138706:head# 2024-04-01T19:43:00.334 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.334 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42c64fb0:::benchmark_data_smithi188_119427_object154900:head# 2024-04-01T19:43:00.334 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.335 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42c7bf8f:::benchmark_data_smithi188_119427_object85555:head# 2024-04-01T19:43:00.335 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.335 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42c83268:::benchmark_data_smithi188_119427_object117928:head# 2024-04-01T19:43:00.335 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.335 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42c83bc0:::benchmark_data_smithi188_119427_object159810:head# 2024-04-01T19:43:00.335 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.335 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42c84524:::benchmark_data_smithi188_119427_object144370:head# 2024-04-01T19:43:00.335 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.335 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42c89145:::benchmark_data_smithi188_119427_object115140:head# 2024-04-01T19:43:00.335 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.335 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42c91cca:::benchmark_data_smithi188_119427_object145660:head# 2024-04-01T19:43:00.335 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.335 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42c94464:::benchmark_data_smithi188_119427_object102035:head# 2024-04-01T19:43:00.335 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.336 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42c97124:::benchmark_data_smithi188_119427_object131095:head# 2024-04-01T19:43:00.336 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.336 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42c9ebdd:::benchmark_data_smithi188_119427_object73010:head# 2024-04-01T19:43:00.336 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.336 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42cb4204:::benchmark_data_smithi188_119427_object102476:head# 2024-04-01T19:43:00.336 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.336 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42cbd271:::benchmark_data_smithi188_119427_object143009:head# 2024-04-01T19:43:00.336 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.338 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42cd0059:::benchmark_data_smithi188_119427_object128193:head# 2024-04-01T19:43:00.338 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.338 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42cf8e3d:::benchmark_data_smithi188_119427_object111757:head# 2024-04-01T19:43:00.338 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.338 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42d1c3c1:::benchmark_data_smithi188_119427_object75940:head# 2024-04-01T19:43:00.338 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.338 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42d1d6c4:::benchmark_data_smithi188_119427_object133062:head# 2024-04-01T19:43:00.339 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.339 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42d21cc6:::benchmark_data_smithi188_119427_object145781:head# 2024-04-01T19:43:00.339 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.339 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42d22065:::benchmark_data_smithi188_119427_object134338:head# 2024-04-01T19:43:00.339 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.339 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42d29ab1:::benchmark_data_smithi188_119427_object156359:head# 2024-04-01T19:43:00.339 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.339 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42d365b3:::benchmark_data_smithi188_119427_object156484:head# 2024-04-01T19:43:00.339 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.339 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42d57efc:::benchmark_data_smithi188_119427_object90966:head# 2024-04-01T19:43:00.339 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.339 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42d58926:::benchmark_data_smithi188_119427_object110064:head# 2024-04-01T19:43:00.339 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.340 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42d5a59e:::benchmark_data_smithi188_119427_object160301:head# 2024-04-01T19:43:00.340 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.340 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42d5b160:::benchmark_data_smithi188_119427_object148855:head# 2024-04-01T19:43:00.340 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.340 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42d616d0:::benchmark_data_smithi188_119427_object164484:head# 2024-04-01T19:43:00.340 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42d63c3a:::benchmark_data_smithi188_119427_object86847:head# 2024-04-01T19:43:00.342 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.342 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42d64888:::benchmark_data_smithi188_119427_object84204:head# 2024-04-01T19:43:00.342 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.342 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42d78caa:::benchmark_data_smithi188_119427_object133690:head# 2024-04-01T19:43:00.342 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.342 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42d7f940:::benchmark_data_smithi188_119427_object113971:head# 2024-04-01T19:43:00.342 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.342 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42d8d681:::benchmark_data_smithi188_119427_object116607:head# 2024-04-01T19:43:00.342 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.342 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42d9bbb9:::benchmark_data_smithi188_119427_object153680:head# 2024-04-01T19:43:00.342 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.342 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42daac61:::benchmark_data_smithi188_119427_object79392:head# 2024-04-01T19:43:00.343 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.343 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42dac0d9:::benchmark_data_smithi188_119427_object119384:head# 2024-04-01T19:43:00.343 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.343 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42daf73a:::benchmark_data_smithi188_119427_object77661:head# 2024-04-01T19:43:00.343 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.343 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42db9c3c:::benchmark_data_smithi188_119427_object132482:head# 2024-04-01T19:43:00.343 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.343 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42dbf75e:::benchmark_data_smithi188_119427_object147459:head# 2024-04-01T19:43:00.343 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.343 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42dd11d4:::benchmark_data_smithi188_119427_object146680:head# 2024-04-01T19:43:00.343 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.345 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42dd464f:::benchmark_data_smithi188_119427_object148599:head# 2024-04-01T19:43:00.345 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.345 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42dd49ad:::benchmark_data_smithi188_119427_object78284:head# 2024-04-01T19:43:00.345 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.345 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42dd8cd7:::benchmark_data_smithi188_119427_object135241:head# 2024-04-01T19:43:00.345 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.345 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42de6c4f:::benchmark_data_smithi188_119427_object155941:head# 2024-04-01T19:43:00.345 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.345 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42df31b2:::benchmark_data_smithi188_119427_object116494:head# 2024-04-01T19:43:00.345 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.345 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42e02b17:::benchmark_data_smithi188_119427_object144071:head# 2024-04-01T19:43:00.345 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.345 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42e0b8b1:::benchmark_data_smithi188_119427_object157922:head# 2024-04-01T19:43:00.346 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.346 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42e10453:::benchmark_data_smithi188_119427_object84440:head# 2024-04-01T19:43:00.346 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.346 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42e14b48:::benchmark_data_smithi188_119427_object137339:head# 2024-04-01T19:43:00.346 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.346 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42e180ea:::benchmark_data_smithi188_119427_object138521:head# 2024-04-01T19:43:00.346 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.347 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42e188b5:::benchmark_data_smithi188_119427_object141321:head# 2024-04-01T19:43:00.347 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.348 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:00.349 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42e1deac:::benchmark_data_smithi188_119427_object153232:head# 2024-04-01T19:43:00.349 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.349 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42e25fcc:::benchmark_data_smithi188_119427_object82349:head# 2024-04-01T19:43:00.349 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.350 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42e2aa18:::benchmark_data_smithi188_119427_object121783:head# 2024-04-01T19:43:00.350 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.350 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42e351b5:::benchmark_data_smithi188_119427_object127569:head# 2024-04-01T19:43:00.350 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.350 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42e36b44:::benchmark_data_smithi188_119427_object95961:head# 2024-04-01T19:43:00.351 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.351 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42e48618:::benchmark_data_smithi188_119427_object130507:head# 2024-04-01T19:43:00.351 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.351 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42ea6715:::benchmark_data_smithi188_119427_object84583:head# 2024-04-01T19:43:00.351 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.352 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42ea951a:::benchmark_data_smithi188_119427_object91612:head# 2024-04-01T19:43:00.352 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.352 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42ea962e:::benchmark_data_smithi188_119427_object153503:head# 2024-04-01T19:43:00.352 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.352 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42ec9314:::benchmark_data_smithi188_119427_object154574:head# 2024-04-01T19:43:00.352 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.353 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42ed56e7:::benchmark_data_smithi188_119427_object106452:head# 2024-04-01T19:43:00.353 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.353 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42ee23af:::benchmark_data_smithi188_119427_object136719:head# 2024-04-01T19:43:00.353 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.353 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42ee33ba:::benchmark_data_smithi188_119427_object119959:head# 2024-04-01T19:43:00.353 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.353 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42ee63c3:::benchmark_data_smithi188_119427_object140299:head# 2024-04-01T19:43:00.354 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.354 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42ef1600:::benchmark_data_smithi188_119427_object111466:head# 2024-04-01T19:43:00.354 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.354 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42f1a8dc:::benchmark_data_smithi188_119427_object80609:head# 2024-04-01T19:43:00.354 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.354 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42f37759:::benchmark_data_smithi188_119427_object138958:head# 2024-04-01T19:43:00.355 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.355 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42f4092f:::benchmark_data_smithi188_119427_object91124:head# 2024-04-01T19:43:00.355 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.360 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42f4cae0:::benchmark_data_smithi188_119427_object160666:head# 2024-04-01T19:43:00.360 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.360 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42f4e19f:::benchmark_data_smithi188_119427_object114807:head# 2024-04-01T19:43:00.360 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.361 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42f51f2b:::benchmark_data_smithi188_119427_object102764:head# 2024-04-01T19:43:00.361 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.361 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42f56453:::benchmark_data_smithi188_119427_object124626:head# 2024-04-01T19:43:00.361 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.362 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42f60baa:::benchmark_data_smithi188_119427_object133404:head# 2024-04-01T19:43:00.362 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.362 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42f676ee:::benchmark_data_smithi188_119427_object157911:head# 2024-04-01T19:43:00.362 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.366 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42f6db34:::benchmark_data_smithi188_119427_object84744:head# 2024-04-01T19:43:00.366 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.366 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42f78d48:::benchmark_data_smithi188_119427_object138297:head# 2024-04-01T19:43:00.366 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.366 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42f7de10:::benchmark_data_smithi188_119427_object145276:head# 2024-04-01T19:43:00.366 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.366 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42f8289b:::benchmark_data_smithi188_119427_object91200:head# 2024-04-01T19:43:00.366 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.366 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42f93564:::benchmark_data_smithi188_119427_object123309:head# 2024-04-01T19:43:00.366 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.367 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42f9d8d3:::benchmark_data_smithi188_119427_object163128:head# 2024-04-01T19:43:00.367 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.369 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42fa7ba3:::benchmark_data_smithi188_119427_object163236:head# 2024-04-01T19:43:00.369 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.370 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42fa806f:::benchmark_data_smithi188_119427_object105710:head# 2024-04-01T19:43:00.370 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.370 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42fabd45:::benchmark_data_smithi188_119427_object98719:head# 2024-04-01T19:43:00.370 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.370 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42fbffc0:::benchmark_data_smithi188_119427_object123201:head# 2024-04-01T19:43:00.370 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.370 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42fcc8d5:::benchmark_data_smithi188_119427_object137231:head# 2024-04-01T19:43:00.370 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.370 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42fd6cd8:::benchmark_data_smithi188_119427_object128033:head# 2024-04-01T19:43:00.370 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.370 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42fdc059:::benchmark_data_smithi188_119427_object98372:head# 2024-04-01T19:43:00.370 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.370 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42fe9387:::benchmark_data_smithi188_119427_object95678:head# 2024-04-01T19:43:00.370 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.371 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42fea735:::benchmark_data_smithi188_119427_object163715:head# 2024-04-01T19:43:00.371 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.371 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:42ff28b0:::benchmark_data_smithi188_119427_object161847:head# 2024-04-01T19:43:00.371 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.376 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:43:00.379 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:00.380 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:43:00.380 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4301394f:::benchmark_data_smithi188_119427_object134262:head# 2024-04-01T19:43:00.380 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.380 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4301cecd:::benchmark_data_smithi188_119427_object92281:head# 2024-04-01T19:43:00.380 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.380 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4301e096:::benchmark_data_smithi188_119427_object158175:head# 2024-04-01T19:43:00.380 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.380 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4301fea3:::benchmark_data_smithi188_119427_object101207:head# 2024-04-01T19:43:00.381 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.381 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:430274b3:::benchmark_data_smithi188_119427_object120051:head# 2024-04-01T19:43:00.381 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.381 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43051a36:::benchmark_data_smithi188_119427_object151077:head# 2024-04-01T19:43:00.381 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.381 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43067e9f:::benchmark_data_smithi188_119427_object124238:head# 2024-04-01T19:43:00.381 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.381 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43069165:::benchmark_data_smithi188_119427_object88927:head# 2024-04-01T19:43:00.381 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.381 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:430698b8:::benchmark_data_smithi188_119427_object163747:head# 2024-04-01T19:43:00.381 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.381 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43090069:::benchmark_data_smithi188_119427_object81212:head# 2024-04-01T19:43:00.381 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.381 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:430bb384:::benchmark_data_smithi188_119427_object90958:head# 2024-04-01T19:43:00.382 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.382 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:430cd50b:::benchmark_data_smithi188_119427_object160953:head# 2024-04-01T19:43:00.382 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.382 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:430d3a6a:::benchmark_data_smithi188_119427_object132983:head# 2024-04-01T19:43:00.382 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.382 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:430d79c4:::benchmark_data_smithi188_119427_object77152:head# 2024-04-01T19:43:00.382 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.382 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:430e501d:::benchmark_data_smithi188_119427_object138739:head# 2024-04-01T19:43:00.382 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.382 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:430ef0bc:::benchmark_data_smithi188_119427_object157986:head# 2024-04-01T19:43:00.382 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.382 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:430f803d:::benchmark_data_smithi188_119427_object78036:head# 2024-04-01T19:43:00.382 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.383 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43100038:::benchmark_data_smithi188_119427_object164302:head# 2024-04-01T19:43:00.383 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.384 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:431137d5:::benchmark_data_smithi188_119427_object91018:head# 2024-04-01T19:43:00.457 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.457 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43114368:::benchmark_data_smithi188_119427_object76589:head# 2024-04-01T19:43:00.457 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.457 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4311b2e1:::benchmark_data_smithi188_119427_object128862:head# 2024-04-01T19:43:00.457 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.457 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4311cc5f:::benchmark_data_smithi188_119427_object151387:head# 2024-04-01T19:43:00.457 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.458 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4311f29d:::benchmark_data_smithi188_119427_object152224:head# 2024-04-01T19:43:00.458 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.458 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43126c66:::benchmark_data_smithi188_119427_object91321:head# 2024-04-01T19:43:00.458 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.458 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:431314fe:::benchmark_data_smithi188_119427_object86990:head# 2024-04-01T19:43:00.458 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.458 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43138d8a:::benchmark_data_smithi188_119427_object132913:head# 2024-04-01T19:43:00.458 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.458 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4314157f:::benchmark_data_smithi188_119427_object125441:head# 2024-04-01T19:43:00.458 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.458 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43151930:::benchmark_data_smithi188_119427_object77233:head# 2024-04-01T19:43:00.458 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.458 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4315cc5d:::benchmark_data_smithi188_119427_object147966:head# 2024-04-01T19:43:00.459 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.459 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4315e0bf:::benchmark_data_smithi188_119427_object95151:head# 2024-04-01T19:43:00.459 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.459 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4315f540:::benchmark_data_smithi188_119427_object149670:head# 2024-04-01T19:43:00.459 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.459 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4316a0cd:::benchmark_data_smithi188_119427_object153509:head# 2024-04-01T19:43:00.459 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.459 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43177349:::benchmark_data_smithi188_119427_object75199:head# 2024-04-01T19:43:00.459 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.459 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4317accd:::benchmark_data_smithi188_119427_object102721:head# 2024-04-01T19:43:00.459 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.459 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4318df4f:::benchmark_data_smithi188_119427_object94076:head# 2024-04-01T19:43:00.459 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.459 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4319566c:::benchmark_data_smithi188_119427_object89262:head# 2024-04-01T19:43:00.459 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.460 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:43:00.486 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:43:00.490 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4319ab32:::benchmark_data_smithi188_119427_object147833:head# 2024-04-01T19:43:00.490 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.490 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:431a335d:::benchmark_data_smithi188_119427_object126397:head# 2024-04-01T19:43:00.490 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.490 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:431b0c26:::benchmark_data_smithi188_119427_object89945:head# 2024-04-01T19:43:00.491 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.491 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:431c15f8:::benchmark_data_smithi188_119427_object155565:head# 2024-04-01T19:43:00.491 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.491 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:431c2fad:::benchmark_data_smithi188_119427_object130018:head# 2024-04-01T19:43:00.491 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.491 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:431c3ed1:::benchmark_data_smithi188_119427_object119622:head# 2024-04-01T19:43:00.491 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.491 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:431d1e3b:::benchmark_data_smithi188_119427_object86114:head# 2024-04-01T19:43:00.491 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.491 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:431db2dc:::benchmark_data_smithi188_119427_object89361:head# 2024-04-01T19:43:00.491 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.491 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:431db35f:::benchmark_data_smithi188_119427_object149513:head# 2024-04-01T19:43:00.491 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.491 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:431e900a:::benchmark_data_smithi188_119427_object82702:head# 2024-04-01T19:43:00.492 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.492 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:431f8f90:::benchmark_data_smithi188_119427_object122708:head# 2024-04-01T19:43:00.492 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.492 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:431fa5e7:::benchmark_data_smithi188_119427_object76381:head# 2024-04-01T19:43:00.492 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.492 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43205d9f:::benchmark_data_smithi188_119427_object152599:head# 2024-04-01T19:43:00.492 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.492 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43222e77:::benchmark_data_smithi188_119427_object110630:head# 2024-04-01T19:43:00.492 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.492 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43232169:::benchmark_data_smithi188_119427_object162923:head# 2024-04-01T19:43:00.492 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.492 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:432527ef:::benchmark_data_smithi188_119427_object104393:head# 2024-04-01T19:43:00.492 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.493 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43252c73:::benchmark_data_smithi188_119427_object143876:head# 2024-04-01T19:43:00.493 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.493 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:432537e3:::benchmark_data_smithi188_119427_object160510:head# 2024-04-01T19:43:00.493 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.493 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4325a02d:::benchmark_data_smithi188_119427_object83390:head# 2024-04-01T19:43:00.493 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.493 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4326434d:::benchmark_data_smithi188_119427_object140658:head# 2024-04-01T19:43:00.493 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.493 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4326ae08:::benchmark_data_smithi188_119427_object149831:head# 2024-04-01T19:43:00.493 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.493 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4326ed18:::benchmark_data_smithi188_119427_object130075:head# 2024-04-01T19:43:00.493 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.493 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:432840cc:::benchmark_data_smithi188_119427_object74917:head# 2024-04-01T19:43:00.494 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.494 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:432879eb:::benchmark_data_smithi188_119427_object153123:head# 2024-04-01T19:43:00.494 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.494 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:432911fc:::benchmark_data_smithi188_119427_object110248:head# 2024-04-01T19:43:00.494 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.494 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:432ad582:::benchmark_data_smithi188_119427_object101940:head# 2024-04-01T19:43:00.494 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.494 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:432b2d67:::benchmark_data_smithi188_119427_object122370:head# 2024-04-01T19:43:00.494 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.494 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:432b4bd7:::benchmark_data_smithi188_119427_object132640:head# 2024-04-01T19:43:00.494 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.494 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:432bcfb8:::benchmark_data_smithi188_119427_object120099:head# 2024-04-01T19:43:00.494 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.495 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:432db32a:::benchmark_data_smithi188_119427_object105064:head# 2024-04-01T19:43:00.495 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.495 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:432f79fd:::benchmark_data_smithi188_119427_object104988:head# 2024-04-01T19:43:00.495 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.495 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:432f88bb:::benchmark_data_smithi188_119427_object133423:head# 2024-04-01T19:43:00.495 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.495 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:432f994e:::benchmark_data_smithi188_119427_object153751:head# 2024-04-01T19:43:00.495 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.495 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43301d17:::benchmark_data_smithi188_119427_object107318:head# 2024-04-01T19:43:00.495 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.495 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:433074dc:::benchmark_data_smithi188_119427_object160741:head# 2024-04-01T19:43:00.495 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.495 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4330e89e:::benchmark_data_smithi188_119427_object75022:head# 2024-04-01T19:43:00.495 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.496 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43327a5b:::benchmark_data_smithi188_119427_object131239:head# 2024-04-01T19:43:00.496 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.496 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43330494:::benchmark_data_smithi188_119427_object126895:head# 2024-04-01T19:43:00.496 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.496 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4334449e:::benchmark_data_smithi188_119427_object108479:head# 2024-04-01T19:43:00.496 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.496 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4334bdab:::benchmark_data_smithi188_119427_object78053:head# 2024-04-01T19:43:00.496 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.496 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43357c45:::benchmark_data_smithi188_119427_object143608:head# 2024-04-01T19:43:00.496 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.496 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43360298:::benchmark_data_smithi188_119427_object142540:head# 2024-04-01T19:43:00.496 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.496 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4336039a:::benchmark_data_smithi188_119427_object153095:head# 2024-04-01T19:43:00.497 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.497 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:433650d1:::benchmark_data_smithi188_119427_object105350:head# 2024-04-01T19:43:00.497 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.497 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:433754b3:::benchmark_data_smithi188_119427_object83840:head# 2024-04-01T19:43:00.497 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.497 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4337576f:::benchmark_data_smithi188_119427_object101084:head# 2024-04-01T19:43:00.497 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.497 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43376d7d:::benchmark_data_smithi188_119427_object127498:head# 2024-04-01T19:43:00.497 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.497 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4337bfd1:::benchmark_data_smithi188_119427_object143817:head# 2024-04-01T19:43:00.497 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.497 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4338586f:::benchmark_data_smithi188_119427_object98853:head# 2024-04-01T19:43:00.497 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.497 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4339c2d7:::benchmark_data_smithi188_119427_object148453:head# 2024-04-01T19:43:00.498 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.498 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:433a24d6:::benchmark_data_smithi188_119427_object111815:head# 2024-04-01T19:43:00.498 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.498 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:433a6395:::benchmark_data_smithi188_119427_object142894:head# 2024-04-01T19:43:00.498 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.498 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:433d1897:::benchmark_data_smithi188_119427_object148282:head# 2024-04-01T19:43:00.498 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.498 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:433dc06d:::benchmark_data_smithi188_119427_object127843:head# 2024-04-01T19:43:00.498 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.498 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:433e0b0d:::benchmark_data_smithi188_119427_object131843:head# 2024-04-01T19:43:00.498 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.498 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:433f16f6:::benchmark_data_smithi188_119427_object126538:head# 2024-04-01T19:43:00.498 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.499 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43418ad4:::benchmark_data_smithi188_119427_object139334:head# 2024-04-01T19:43:00.499 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.499 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4341b56a:::benchmark_data_smithi188_119427_object77132:head# 2024-04-01T19:43:00.499 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.499 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4341f6a0:::benchmark_data_smithi188_119427_object77091:head# 2024-04-01T19:43:00.499 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.499 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43427b53:::benchmark_data_smithi188_119427_object153326:head# 2024-04-01T19:43:00.499 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.499 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43428ee7:::benchmark_data_smithi188_119427_object103328:head# 2024-04-01T19:43:00.499 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.499 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43432de1:::benchmark_data_smithi188_119427_object82345:head# 2024-04-01T19:43:00.499 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.499 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:434346ce:::benchmark_data_smithi188_119427_object94934:head# 2024-04-01T19:43:00.499 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.500 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:434458ae:::benchmark_data_smithi188_119427_object112270:head# 2024-04-01T19:43:00.500 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.500 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43446747:::benchmark_data_smithi188_119427_object153301:head# 2024-04-01T19:43:00.500 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.500 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4344b027:::benchmark_data_smithi188_119427_object104008:head# 2024-04-01T19:43:00.500 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.500 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43453123:::benchmark_data_smithi188_119427_object102057:head# 2024-04-01T19:43:00.500 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.500 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4345c951:::benchmark_data_smithi188_119427_object131402:head# 2024-04-01T19:43:00.500 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.500 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43465853:::benchmark_data_smithi188_119427_object131235:head# 2024-04-01T19:43:00.500 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.500 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4348020b:::benchmark_data_smithi188_119427_object155133:head# 2024-04-01T19:43:00.500 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.500 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4348d363:::benchmark_data_smithi188_119427_object100003:head# 2024-04-01T19:43:00.501 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.501 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4349029b:::benchmark_data_smithi188_119427_object107796:head# 2024-04-01T19:43:00.501 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.501 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4349c8c1:::benchmark_data_smithi188_119427_object149844:head# 2024-04-01T19:43:00.501 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.501 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:434a3c83:::benchmark_data_smithi188_119427_object141020:head# 2024-04-01T19:43:00.501 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.501 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:434a78fb:::benchmark_data_smithi188_119427_object138158:head# 2024-04-01T19:43:00.501 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.501 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:434b7df3:::benchmark_data_smithi188_119427_object146974:head# 2024-04-01T19:43:00.501 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.501 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:434ba538:::benchmark_data_smithi188_119427_object158107:head# 2024-04-01T19:43:00.501 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.501 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:434c8f25:::benchmark_data_smithi188_119427_object149610:head# 2024-04-01T19:43:00.502 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.502 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:434cb212:::benchmark_data_smithi188_119427_object114628:head# 2024-04-01T19:43:00.502 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.502 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:434dbbc7:::benchmark_data_smithi188_119427_object164632:head# 2024-04-01T19:43:00.502 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.502 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:434e1b99:::benchmark_data_smithi188_119427_object81456:head# 2024-04-01T19:43:00.502 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.502 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:434e3e53:::benchmark_data_smithi188_119427_object126771:head# 2024-04-01T19:43:00.502 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.502 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:434f0a42:::benchmark_data_smithi188_119427_object145777:head# 2024-04-01T19:43:00.502 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.502 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:434f1966:::benchmark_data_smithi188_119427_object143447:head# 2024-04-01T19:43:00.502 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.502 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:434f67d6:::benchmark_data_smithi188_119427_object118616:head# 2024-04-01T19:43:00.502 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.503 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:434faee5:::benchmark_data_smithi188_119427_object73165:head# 2024-04-01T19:43:00.503 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.503 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:435005c3:::benchmark_data_smithi188_119427_object163265:head# 2024-04-01T19:43:00.503 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.503 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43500879:::benchmark_data_smithi188_119427_object124715:head# 2024-04-01T19:43:00.503 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.503 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43508de7:::benchmark_data_smithi188_119427_object106904:head# 2024-04-01T19:43:00.503 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.503 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43529c6f:::benchmark_data_smithi188_119427_object116292:head# 2024-04-01T19:43:00.503 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.503 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4352dc14:::benchmark_data_smithi188_119427_object94335:head# 2024-04-01T19:43:00.503 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.503 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43547aab:::benchmark_data_smithi188_119427_object82877:head# 2024-04-01T19:43:00.503 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.504 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4354ad2d:::benchmark_data_smithi188_119427_object135340:head# 2024-04-01T19:43:00.504 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.504 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4354fd3a:::benchmark_data_smithi188_119427_object123462:head# 2024-04-01T19:43:00.504 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.504 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43593bb1:::benchmark_data_smithi188_119427_object157398:head# 2024-04-01T19:43:00.504 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.504 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43597377:::benchmark_data_smithi188_119427_object109196:head# 2024-04-01T19:43:00.504 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.504 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:435b22cb:::benchmark_data_smithi188_119427_object160815:head# 2024-04-01T19:43:00.504 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.504 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:435b266f:::benchmark_data_smithi188_119427_object103959:head# 2024-04-01T19:43:00.504 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.504 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:435b4044:::benchmark_data_smithi188_119427_object125375:head# 2024-04-01T19:43:00.504 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.505 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:435bc240:::benchmark_data_smithi188_119427_object145222:head# 2024-04-01T19:43:00.505 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.505 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:435c2c5c:::benchmark_data_smithi188_119427_object141408:head# 2024-04-01T19:43:00.505 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.505 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:435c875c:::benchmark_data_smithi188_119427_object123461:head# 2024-04-01T19:43:00.505 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.505 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:435cdf6c:::benchmark_data_smithi188_119427_object96339:head# 2024-04-01T19:43:00.505 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.505 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:435dce77:::benchmark_data_smithi188_119427_object125994:head# 2024-04-01T19:43:00.505 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.505 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:435ddbf7:::benchmark_data_smithi188_119427_object155494:head# 2024-04-01T19:43:00.505 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.505 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:435deb16:::benchmark_data_smithi188_119427_object149787:head# 2024-04-01T19:43:00.505 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.506 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:435f8143:::benchmark_data_smithi188_119427_object85479:head# 2024-04-01T19:43:00.506 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.506 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4360529c:::benchmark_data_smithi188_119427_object156960:head# 2024-04-01T19:43:00.506 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.506 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4361bf5d:::benchmark_data_smithi188_119427_object119888:head# 2024-04-01T19:43:00.506 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.506 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:436378a3:::benchmark_data_smithi188_119427_object127981:head# 2024-04-01T19:43:00.506 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.506 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43649c32:::benchmark_data_smithi188_119427_object162831:head# 2024-04-01T19:43:00.506 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.506 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4364d1a3:::benchmark_data_smithi188_119427_object80404:head# 2024-04-01T19:43:00.506 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.506 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4365da2a:::benchmark_data_smithi188_119427_object118360:head# 2024-04-01T19:43:00.507 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.507 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4366acca:::benchmark_data_smithi188_119427_object161013:head# 2024-04-01T19:43:00.507 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.507 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4366f068:::benchmark_data_smithi188_119427_object139093:head# 2024-04-01T19:43:00.507 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.507 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4367545e:::benchmark_data_smithi188_119427_object134244:head# 2024-04-01T19:43:00.507 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.507 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4368d4c7:::benchmark_data_smithi188_119427_object85915:head# 2024-04-01T19:43:00.507 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.507 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:436a3c54:::benchmark_data_smithi188_119427_object118286:head# 2024-04-01T19:43:00.507 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.507 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:436ade76:::benchmark_data_smithi188_119427_object114955:head# 2024-04-01T19:43:00.507 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.508 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:436b1cd9:::benchmark_data_smithi188_119427_object97075:head# 2024-04-01T19:43:00.508 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.508 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:436b70a6:::benchmark_data_smithi188_119427_object142047:head# 2024-04-01T19:43:00.508 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.508 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:436ba8d7:::benchmark_data_smithi188_119427_object80704:head# 2024-04-01T19:43:00.508 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.508 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:436ca719:::benchmark_data_smithi188_119427_object115965:head# 2024-04-01T19:43:00.508 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.508 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:436dd1bb:::benchmark_data_smithi188_119427_object120688:head# 2024-04-01T19:43:00.508 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.508 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:436dee69:::benchmark_data_smithi188_119427_object123152:head# 2024-04-01T19:43:00.508 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.508 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:436e25ed:::benchmark_data_smithi188_119427_object82462:head# 2024-04-01T19:43:00.508 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:436ebe80:::benchmark_data_smithi188_119427_object75849:head# 2024-04-01T19:43:00.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4370a2aa:::benchmark_data_smithi188_119427_object78217:head# 2024-04-01T19:43:00.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4370c232:::benchmark_data_smithi188_119427_object75632:head# 2024-04-01T19:43:00.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4370c83b:::benchmark_data_smithi188_119427_object108579:head# 2024-04-01T19:43:00.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4370eb2f:::benchmark_data_smithi188_119427_object139021:head# 2024-04-01T19:43:00.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43710f4b:::benchmark_data_smithi188_119427_object155386:head# 2024-04-01T19:43:00.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43737f52:::benchmark_data_smithi188_119427_object148986:head# 2024-04-01T19:43:00.510 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.510 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4373d709:::benchmark_data_smithi188_119427_object94259:head# 2024-04-01T19:43:00.510 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.510 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4374cb11:::benchmark_data_smithi188_119427_object87115:head# 2024-04-01T19:43:00.510 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.510 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:437612fc:::benchmark_data_smithi188_119427_object87597:head# 2024-04-01T19:43:00.510 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.510 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4376e944:::benchmark_data_smithi188_119427_object153795:head# 2024-04-01T19:43:00.510 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.510 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43777055:::benchmark_data_smithi188_119427_object83149:head# 2024-04-01T19:43:00.510 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.510 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43788de3:::benchmark_data_smithi188_119427_object161452:head# 2024-04-01T19:43:00.510 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.511 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4378caa3:::benchmark_data_smithi188_119427_object76117:head# 2024-04-01T19:43:00.511 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.511 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:437965ce:::benchmark_data_smithi188_119427_object107287:head# 2024-04-01T19:43:00.511 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.511 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:437a6bb4:::benchmark_data_smithi188_119427_object96227:head# 2024-04-01T19:43:00.511 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.511 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:437c04eb:::benchmark_data_smithi188_119427_object100462:head# 2024-04-01T19:43:00.511 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.511 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:437cc833:::benchmark_data_smithi188_119427_object155515:head# 2024-04-01T19:43:00.511 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.511 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:437d2fd3:::benchmark_data_smithi188_119427_object106708:head# 2024-04-01T19:43:00.511 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.511 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:437da104:::benchmark_data_smithi188_119427_object154988:head# 2024-04-01T19:43:00.511 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.512 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:437dda0b:::benchmark_data_smithi188_119427_object141268:head# 2024-04-01T19:43:00.512 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.512 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:437df359:::benchmark_data_smithi188_119427_object138168:head# 2024-04-01T19:43:00.512 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.512 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:437e3a69:::benchmark_data_smithi188_119427_object85846:head# 2024-04-01T19:43:00.512 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.512 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:437e445c:::benchmark_data_smithi188_119427_object100186:head# 2024-04-01T19:43:00.512 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.512 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:437eb02f:::benchmark_data_smithi188_119427_object125896:head# 2024-04-01T19:43:00.512 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.512 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:437ec781:::benchmark_data_smithi188_119427_object123710:head# 2024-04-01T19:43:00.512 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.512 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:437f08ec:::benchmark_data_smithi188_119427_object85786:head# 2024-04-01T19:43:00.513 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.513 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:437f8ed0:::benchmark_data_smithi188_119427_object136761:head# 2024-04-01T19:43:00.513 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.513 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:437fe56b:::benchmark_data_smithi188_119427_object80020:head# 2024-04-01T19:43:00.513 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.513 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43802863:::benchmark_data_smithi188_119427_object110792:head# 2024-04-01T19:43:00.513 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.513 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4380e9fc:::benchmark_data_smithi188_119427_object143057:head# 2024-04-01T19:43:00.513 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.513 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43821355:::benchmark_data_smithi188_119427_object107705:head# 2024-04-01T19:43:00.513 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.513 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4382cc54:::benchmark_data_smithi188_119427_object146758:head# 2024-04-01T19:43:00.513 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.514 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4382f9fe:::benchmark_data_smithi188_119427_object88328:head# 2024-04-01T19:43:00.514 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.514 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43843055:::benchmark_data_smithi188_119427_object160832:head# 2024-04-01T19:43:00.514 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.514 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43867d73:::benchmark_data_smithi188_119427_object85186:head# 2024-04-01T19:43:00.514 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.514 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4386bcd3:::benchmark_data_smithi188_119427_object131304:head# 2024-04-01T19:43:00.514 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.514 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:438827f4:::benchmark_data_smithi188_119427_object164042:head# 2024-04-01T19:43:00.514 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.514 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43883d55:::benchmark_data_smithi188_119427_object160413:head# 2024-04-01T19:43:00.514 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.515 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:438866a1:::benchmark_data_smithi188_119427_object163158:head# 2024-04-01T19:43:00.515 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.515 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4388803d:::benchmark_data_smithi188_119427_object102354:head# 2024-04-01T19:43:00.515 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.515 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4388b836:::benchmark_data_smithi188_119427_object163864:head# 2024-04-01T19:43:00.515 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.515 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43897393:::benchmark_data_smithi188_119427_object78433:head# 2024-04-01T19:43:00.515 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.515 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4389d01e:::benchmark_data_smithi188_119427_object159961:head# 2024-04-01T19:43:00.515 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.515 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:438a95d4:::benchmark_data_smithi188_119427_object122114:head# 2024-04-01T19:43:00.515 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.515 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:438ab0b3:::benchmark_data_smithi188_119427_object155829:head# 2024-04-01T19:43:00.515 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.515 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:438adf71:::benchmark_data_smithi188_119427_object86250:head# 2024-04-01T19:43:00.516 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.516 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:438b5181:::benchmark_data_smithi188_119427_object100487:head# 2024-04-01T19:43:00.516 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.516 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:438badd5:::benchmark_data_smithi188_119427_object144419:head# 2024-04-01T19:43:00.516 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.516 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:438bce00:::benchmark_data_smithi188_119427_object103646:head# 2024-04-01T19:43:00.516 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.516 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:438d37d4:::benchmark_data_smithi188_119427_object141828:head# 2024-04-01T19:43:00.516 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.516 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:438da4d9:::benchmark_data_smithi188_119427_object139857:head# 2024-04-01T19:43:00.516 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.516 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:438e172c:::benchmark_data_smithi188_119427_object91764:head# 2024-04-01T19:43:00.516 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.516 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4392835e:::benchmark_data_smithi188_119427_object97962:head# 2024-04-01T19:43:00.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.517 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:439331ff:::benchmark_data_smithi188_119427_object155114:head# 2024-04-01T19:43:00.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.517 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:439346f8:::benchmark_data_smithi188_119427_object149119:head# 2024-04-01T19:43:00.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.517 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4394cf8e:::benchmark_data_smithi188_119427_object148363:head# 2024-04-01T19:43:00.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.517 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43988f69:::benchmark_data_smithi188_119427_object125379:head# 2024-04-01T19:43:00.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.517 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:439a2a6f:::benchmark_data_smithi188_119427_object104022:head# 2024-04-01T19:43:00.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.518 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:439aa50c:::benchmark_data_smithi188_119427_object93815:head# 2024-04-01T19:43:00.518 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.518 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:439af9cb:::benchmark_data_smithi188_119427_object105973:head# 2024-04-01T19:43:00.518 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.518 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:439ba92d:::benchmark_data_smithi188_119427_object85113:head# 2024-04-01T19:43:00.518 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.518 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:439bf38d:::benchmark_data_smithi188_119427_object88275:head# 2024-04-01T19:43:00.518 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.518 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:439bf98f:::benchmark_data_smithi188_119427_object143807:head# 2024-04-01T19:43:00.518 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.518 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:439c6625:::benchmark_data_smithi188_119427_object141812:head# 2024-04-01T19:43:00.518 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.518 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:439d6d28:::benchmark_data_smithi188_119427_object89341:head# 2024-04-01T19:43:00.519 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.519 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:439e2ab6:::benchmark_data_smithi188_119427_object78561:head# 2024-04-01T19:43:00.519 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.519 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:439e34f0:::benchmark_data_smithi188_119427_object143387:head# 2024-04-01T19:43:00.519 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.519 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:439f7c8b:::benchmark_data_smithi188_119427_object94555:head# 2024-04-01T19:43:00.519 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.519 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:439fee41:::benchmark_data_smithi188_119427_object163240:head# 2024-04-01T19:43:00.519 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.519 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43a03f54:::benchmark_data_smithi188_119427_object90995:head# 2024-04-01T19:43:00.519 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.519 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43a1264f:::benchmark_data_smithi188_119427_object156046:head# 2024-04-01T19:43:00.519 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.519 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43a2e33d:::benchmark_data_smithi188_119427_object105395:head# 2024-04-01T19:43:00.520 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.520 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43a3521d:::benchmark_data_smithi188_119427_object128770:head# 2024-04-01T19:43:00.520 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.520 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43a49f98:::benchmark_data_smithi188_119427_object117148:head# 2024-04-01T19:43:00.520 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.520 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43a52b2e:::benchmark_data_smithi188_119427_object77904:head# 2024-04-01T19:43:00.520 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.520 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43a569b3:::benchmark_data_smithi188_119427_object90719:head# 2024-04-01T19:43:00.520 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.520 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43a66791:::benchmark_data_smithi188_119427_object86938:head# 2024-04-01T19:43:00.520 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.520 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43a670ed:::benchmark_data_smithi188_119427_object157081:head# 2024-04-01T19:43:00.520 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.520 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43a68b55:::benchmark_data_smithi188_119427_object160920:head# 2024-04-01T19:43:00.521 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.521 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43a88169:::benchmark_data_smithi188_119427_object82002:head# 2024-04-01T19:43:00.521 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.521 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43a8b959:::benchmark_data_smithi188_119427_object138974:head# 2024-04-01T19:43:00.521 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.521 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43a92c0c:::benchmark_data_smithi188_119427_object96844:head# 2024-04-01T19:43:00.521 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.521 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43a93023:::benchmark_data_smithi188_119427_object93385:head# 2024-04-01T19:43:00.521 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.521 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43aa14fd:::benchmark_data_smithi188_119427_object146679:head# 2024-04-01T19:43:00.521 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.521 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43aa3644:::benchmark_data_smithi188_119427_object114461:head# 2024-04-01T19:43:00.521 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.521 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43ac987d:::benchmark_data_smithi188_119427_object123948:head# 2024-04-01T19:43:00.522 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.522 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43acb4b1:::benchmark_data_smithi188_119427_object156685:head# 2024-04-01T19:43:00.522 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.522 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43ae18cd:::benchmark_data_smithi188_119427_object77980:head# 2024-04-01T19:43:00.522 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.522 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43ae7d30:::benchmark_data_smithi188_119427_object107129:head# 2024-04-01T19:43:00.522 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.522 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43af9f9a:::benchmark_data_smithi188_119427_object150552:head# 2024-04-01T19:43:00.522 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.522 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43b0de9d:::benchmark_data_smithi188_119427_object147495:head# 2024-04-01T19:43:00.522 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.522 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43b11305:::benchmark_data_smithi188_119427_object149786:head# 2024-04-01T19:43:00.522 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.522 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43b13c05:::benchmark_data_smithi188_119427_object150050:head# 2024-04-01T19:43:00.523 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.523 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43b1b485:::benchmark_data_smithi188_119427_object135974:head# 2024-04-01T19:43:00.523 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.523 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43b1e1b2:::benchmark_data_smithi188_119427_object102543:head# 2024-04-01T19:43:00.523 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.523 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43b27020:::benchmark_data_smithi188_119427_object161508:head# 2024-04-01T19:43:00.523 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.523 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43b2ec13:::benchmark_data_smithi188_119427_object96701:head# 2024-04-01T19:43:00.523 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.523 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43b30a04:::benchmark_data_smithi188_119427_object129892:head# 2024-04-01T19:43:00.523 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.523 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43b3f32d:::benchmark_data_smithi188_119427_object149429:head# 2024-04-01T19:43:00.523 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.523 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43b47b68:::benchmark_data_smithi188_119427_object78840:head# 2024-04-01T19:43:00.523 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43b4e886:::benchmark_data_smithi188_119427_object101566:head# 2024-04-01T19:43:00.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43b878a4:::benchmark_data_smithi188_119427_object95729:head# 2024-04-01T19:43:00.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43b93785:::benchmark_data_smithi188_119427_object132914:head# 2024-04-01T19:43:00.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43b977f1:::benchmark_data_smithi188_119427_object113242:head# 2024-04-01T19:43:00.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43ba402b:::benchmark_data_smithi188_119427_object102750:head# 2024-04-01T19:43:00.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43bc728f:::benchmark_data_smithi188_119427_object140386:head# 2024-04-01T19:43:00.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43bcb2bf:::benchmark_data_smithi188_119427_object74927:head# 2024-04-01T19:43:00.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.525 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43bdbad4:::benchmark_data_smithi188_119427_object98061:head# 2024-04-01T19:43:00.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.525 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43be9b79:::benchmark_data_smithi188_119427_object73395:head# 2024-04-01T19:43:00.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.525 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43bf4e65:::benchmark_data_smithi188_119427_object74583:head# 2024-04-01T19:43:00.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.525 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43bfc3fa:::benchmark_data_smithi188_119427_object96843:head# 2024-04-01T19:43:00.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.525 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43bfd35b:::benchmark_data_smithi188_119427_object112870:head# 2024-04-01T19:43:00.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.525 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43c02836:::benchmark_data_smithi188_119427_object107071:head# 2024-04-01T19:43:00.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.525 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43c03433:::benchmark_data_smithi188_119427_object148531:head# 2024-04-01T19:43:00.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.526 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43c1407a:::benchmark_data_smithi188_119427_object137767:head# 2024-04-01T19:43:00.526 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.526 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43c17eb9:::benchmark_data_smithi188_119427_object96090:head# 2024-04-01T19:43:00.526 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.526 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43c1a217:::benchmark_data_smithi188_119427_object146684:head# 2024-04-01T19:43:00.526 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.526 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43c2459a:::benchmark_data_smithi188_119427_object79673:head# 2024-04-01T19:43:00.526 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.526 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43c30d30:::benchmark_data_smithi188_119427_object163308:head# 2024-04-01T19:43:00.526 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.526 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43c53b6a:::benchmark_data_smithi188_119427_object162954:head# 2024-04-01T19:43:00.526 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.526 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43c6796c:::benchmark_data_smithi188_119427_object72566:head# 2024-04-01T19:43:00.527 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.527 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43c683d7:::benchmark_data_smithi188_119427_object141279:head# 2024-04-01T19:43:00.527 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.527 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43c687c3:::benchmark_data_smithi188_119427_object82905:head# 2024-04-01T19:43:00.527 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.527 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43c68fbb:::benchmark_data_smithi188_119427_object134466:head# 2024-04-01T19:43:00.527 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.527 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43c75ab9:::benchmark_data_smithi188_119427_object91690:head# 2024-04-01T19:43:00.527 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.527 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43c82c96:::benchmark_data_smithi188_119427_object76401:head# 2024-04-01T19:43:00.527 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.527 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43c82ccb:::benchmark_data_smithi188_119427_object80327:head# 2024-04-01T19:43:00.527 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.527 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43ca24c4:::benchmark_data_smithi188_119427_object155640:head# 2024-04-01T19:43:00.527 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.528 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43caa5d8:::benchmark_data_smithi188_119427_object155771:head# 2024-04-01T19:43:00.528 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.528 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43caed4a:::benchmark_data_smithi188_119427_object142670:head# 2024-04-01T19:43:00.528 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.528 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43cb4330:::benchmark_data_smithi188_119427_object146268:head# 2024-04-01T19:43:00.528 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.528 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43cba522:::benchmark_data_smithi188_119427_object135369:head# 2024-04-01T19:43:00.528 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.528 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43cc0834:::benchmark_data_smithi188_119427_object92316:head# 2024-04-01T19:43:00.528 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.528 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43cd3118:::benchmark_data_smithi188_119427_object119504:head# 2024-04-01T19:43:00.528 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.528 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43cd9462:::benchmark_data_smithi188_119427_object117697:head# 2024-04-01T19:43:00.528 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.529 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43cd9816:::benchmark_data_smithi188_119427_object97199:head# 2024-04-01T19:43:00.529 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.529 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43cf32fe:::benchmark_data_smithi188_119427_object83457:head# 2024-04-01T19:43:00.529 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.529 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43d09fc6:::benchmark_data_smithi188_119427_object100385:head# 2024-04-01T19:43:00.529 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.529 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43d0ce10:::benchmark_data_smithi188_119427_object106044:head# 2024-04-01T19:43:00.529 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.529 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43d189b8:::benchmark_data_smithi188_119427_object90104:head# 2024-04-01T19:43:00.529 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.529 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43d1a5e1:::benchmark_data_smithi188_119427_object92863:head# 2024-04-01T19:43:00.529 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.529 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43d39762:::benchmark_data_smithi188_119427_object114072:head# 2024-04-01T19:43:00.529 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.530 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43d3c458:::benchmark_data_smithi188_119427_object163138:head# 2024-04-01T19:43:00.530 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.530 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43d41271:::benchmark_data_smithi188_119427_object144444:head# 2024-04-01T19:43:00.530 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.530 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43d47edf:::benchmark_data_smithi188_119427_object155840:head# 2024-04-01T19:43:00.530 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.530 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43d5bb96:::benchmark_data_smithi188_119427_object151672:head# 2024-04-01T19:43:00.530 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.530 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43d60d19:::benchmark_data_smithi188_119427_object158490:head# 2024-04-01T19:43:00.530 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.530 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43d6aa97:::benchmark_data_smithi188_119427_object130945:head# 2024-04-01T19:43:00.530 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.530 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43d801a2:::benchmark_data_smithi188_119427_object159918:head# 2024-04-01T19:43:00.530 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.531 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43d81c78:::benchmark_data_smithi188_119427_object89432:head# 2024-04-01T19:43:00.531 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.531 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43d845c9:::benchmark_data_smithi188_119427_object119969:head# 2024-04-01T19:43:00.531 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.531 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43d86046:::benchmark_data_smithi188_119427_object129296:head# 2024-04-01T19:43:00.531 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.531 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43d98380:::benchmark_data_smithi188_119427_object147345:head# 2024-04-01T19:43:00.531 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.531 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43d9afea:::benchmark_data_smithi188_119427_object113145:head# 2024-04-01T19:43:00.531 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.531 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43da8d74:::benchmark_data_smithi188_119427_object140518:head# 2024-04-01T19:43:00.531 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.531 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43dbf443:::benchmark_data_smithi188_119427_object156138:head# 2024-04-01T19:43:00.531 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.532 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43df0946:::benchmark_data_smithi188_119427_object129404:head# 2024-04-01T19:43:00.532 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.532 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43df601a:::benchmark_data_smithi188_119427_object104876:head# 2024-04-01T19:43:00.532 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.532 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43df970f:::benchmark_data_smithi188_119427_object72843:head# 2024-04-01T19:43:00.532 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.532 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43dfa239:::benchmark_data_smithi188_119427_object156848:head# 2024-04-01T19:43:00.532 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.532 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43dfb579:::benchmark_data_smithi188_119427_object140262:head# 2024-04-01T19:43:00.532 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.532 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43e0b828:::benchmark_data_smithi188_119427_object137401:head# 2024-04-01T19:43:00.532 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.532 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43e15244:::benchmark_data_smithi188_119427_object119119:head# 2024-04-01T19:43:00.533 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.533 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43e29357:::benchmark_data_smithi188_119427_object118096:head# 2024-04-01T19:43:00.533 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.533 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43e2c17a:::benchmark_data_smithi188_119427_object99418:head# 2024-04-01T19:43:00.533 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.533 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43e2c2b4:::benchmark_data_smithi188_119427_object113395:head# 2024-04-01T19:43:00.533 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.533 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43e362e5:::benchmark_data_smithi188_119427_object132227:head# 2024-04-01T19:43:00.533 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.533 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43e3debb:::benchmark_data_smithi188_119427_object73976:head# 2024-04-01T19:43:00.533 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.533 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43e3fae7:::benchmark_data_smithi188_119427_object78299:head# 2024-04-01T19:43:00.533 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.533 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43e46c26:::benchmark_data_smithi188_119427_object85778:head# 2024-04-01T19:43:00.534 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.534 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43e54acf:::benchmark_data_smithi188_119427_object153285:head# 2024-04-01T19:43:00.534 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.534 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43e5c5f9:::benchmark_data_smithi188_119427_object138192:head# 2024-04-01T19:43:00.534 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.534 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43e5e3c9:::benchmark_data_smithi188_119427_object104723:head# 2024-04-01T19:43:00.534 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.534 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43e6860b:::benchmark_data_smithi188_119427_object92512:head# 2024-04-01T19:43:00.534 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.534 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43e799f7:::benchmark_data_smithi188_119427_object79379:head# 2024-04-01T19:43:00.534 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.534 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43e7ce17:::benchmark_data_smithi188_119427_object98424:head# 2024-04-01T19:43:00.534 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.535 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43e85b50:::benchmark_data_smithi188_119427_object88446:head# 2024-04-01T19:43:00.535 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.535 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43e937a2:::benchmark_data_smithi188_119427_object123963:head# 2024-04-01T19:43:00.535 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.535 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43e9b33b:::benchmark_data_smithi188_119427_object107081:head# 2024-04-01T19:43:00.535 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.535 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43e9cef8:::benchmark_data_smithi188_119427_object156415:head# 2024-04-01T19:43:00.535 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.535 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43eae999:::benchmark_data_smithi188_119427_object157414:head# 2024-04-01T19:43:00.535 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.535 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43eb2fb4:::benchmark_data_smithi188_119427_object97856:head# 2024-04-01T19:43:00.535 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.535 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43eb544d:::benchmark_data_smithi188_119427_object103783:head# 2024-04-01T19:43:00.535 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.536 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43eb77fd:::benchmark_data_smithi188_119427_object77133:head# 2024-04-01T19:43:00.536 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.536 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43eb9c08:::benchmark_data_smithi188_119427_object147672:head# 2024-04-01T19:43:00.536 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.536 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43ec2446:::benchmark_data_smithi188_119427_object157349:head# 2024-04-01T19:43:00.536 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.536 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43eca20b:::benchmark_data_smithi188_119427_object110754:head# 2024-04-01T19:43:00.536 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.536 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43eca9b5:::benchmark_data_smithi188_119427_object146402:head# 2024-04-01T19:43:00.536 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.536 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43edd75e:::benchmark_data_smithi188_119427_object140549:head# 2024-04-01T19:43:00.536 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.536 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43ede4a5:::benchmark_data_smithi188_119427_object163277:head# 2024-04-01T19:43:00.536 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43eeb258:::benchmark_data_smithi188_119427_object93338:head# 2024-04-01T19:43:00.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43eec7a5:::benchmark_data_smithi188_119427_object86902:head# 2024-04-01T19:43:00.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43eeea84:::benchmark_data_smithi188_119427_object125766:head# 2024-04-01T19:43:00.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43ef2c1e:::benchmark_data_smithi188_119427_object145314:head# 2024-04-01T19:43:00.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43effbac:::benchmark_data_smithi188_119427_object141685:head# 2024-04-01T19:43:00.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43f026de:::benchmark_data_smithi188_119427_object130812:head# 2024-04-01T19:43:00.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43f0729a:::benchmark_data_smithi188_119427_object148712:head# 2024-04-01T19:43:00.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.538 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43f161db:::benchmark_data_smithi188_119427_object105240:head# 2024-04-01T19:43:00.538 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.548 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43f1935f:::benchmark_data_smithi188_119427_object99376:head# 2024-04-01T19:43:00.548 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.548 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43f2fa9b:::benchmark_data_smithi188_119427_object78115:head# 2024-04-01T19:43:00.548 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.548 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43f32a89:::benchmark_data_smithi188_119427_object132066:head# 2024-04-01T19:43:00.548 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.548 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43f48c6f:::benchmark_data_smithi188_119427_object159685:head# 2024-04-01T19:43:00.548 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.548 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43f4c2ab:::benchmark_data_smithi188_119427_object97481:head# 2024-04-01T19:43:00.549 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.549 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43f521b2:::benchmark_data_smithi188_119427_object148918:head# 2024-04-01T19:43:00.549 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.549 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43f58085:::benchmark_data_smithi188_119427_object100898:head# 2024-04-01T19:43:00.549 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.549 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43f5d83f:::benchmark_data_smithi188_119427_object156395:head# 2024-04-01T19:43:00.549 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.549 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43f6d8c7:::benchmark_data_smithi188_119427_object80311:head# 2024-04-01T19:43:00.549 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.549 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43f713b4:::benchmark_data_smithi188_119427_object153846:head# 2024-04-01T19:43:00.549 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.549 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43f814ac:::benchmark_data_smithi188_119427_object104986:head# 2024-04-01T19:43:00.549 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.550 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43f87ba9:::benchmark_data_smithi188_119427_object146572:head# 2024-04-01T19:43:00.550 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.550 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43f93de9:::benchmark_data_smithi188_119427_object72935:head# 2024-04-01T19:43:00.550 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.550 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43f9aacf:::benchmark_data_smithi188_119427_object133829:head# 2024-04-01T19:43:00.550 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.550 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43f9d003:::benchmark_data_smithi188_119427_object149381:head# 2024-04-01T19:43:00.550 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.550 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43fb19c4:::benchmark_data_smithi188_119427_object139439:head# 2024-04-01T19:43:00.550 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.550 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43fc2171:::benchmark_data_smithi188_119427_object164047:head# 2024-04-01T19:43:00.550 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.550 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43fc8339:::benchmark_data_smithi188_119427_object105152:head# 2024-04-01T19:43:00.551 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.551 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43fcdb90:::benchmark_data_smithi188_119427_object87188:head# 2024-04-01T19:43:00.551 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.551 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43fd5c57:::benchmark_data_smithi188_119427_object158092:head# 2024-04-01T19:43:00.551 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.551 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43fe3215:::benchmark_data_smithi188_119427_object131407:head# 2024-04-01T19:43:00.551 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.551 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43fe6697:::benchmark_data_smithi188_119427_object125596:head# 2024-04-01T19:43:00.551 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.551 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43fe68d4:::benchmark_data_smithi188_119427_object135568:head# 2024-04-01T19:43:00.551 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.551 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43ff19cb:::benchmark_data_smithi188_119427_object116918:head# 2024-04-01T19:43:00.551 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.551 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43ff477e:::benchmark_data_smithi188_119427_object88906:head# 2024-04-01T19:43:00.552 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.552 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:43ff953e:::benchmark_data_smithi188_119427_object133475:head# 2024-04-01T19:43:00.552 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.552 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4402d108:::benchmark_data_smithi188_119427_object120803:head# 2024-04-01T19:43:00.552 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.552 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4402e0ab:::benchmark_data_smithi188_119427_object108262:head# 2024-04-01T19:43:00.552 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.552 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4403615b:::benchmark_data_smithi188_119427_object158129:head# 2024-04-01T19:43:00.552 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.552 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4403df13:::benchmark_data_smithi188_119427_object92145:head# 2024-04-01T19:43:00.552 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.552 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4403edc7:::benchmark_data_smithi188_119427_object103625:head# 2024-04-01T19:43:00.552 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4404d5f5:::benchmark_data_smithi188_119427_object117853:head# 2024-04-01T19:43:00.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4405cce2:::benchmark_data_smithi188_119427_object104285:head# 2024-04-01T19:43:00.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:440b2d65:::benchmark_data_smithi188_119427_object84242:head# 2024-04-01T19:43:00.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:440bb147:::benchmark_data_smithi188_119427_object97528:head# 2024-04-01T19:43:00.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:440cd583:::benchmark_data_smithi188_119427_object154145:head# 2024-04-01T19:43:00.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:440d12a9:::benchmark_data_smithi188_119427_object101366:head# 2024-04-01T19:43:00.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:440d38ef:::benchmark_data_smithi188_119427_object118683:head# 2024-04-01T19:43:00.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.554 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:440e3480:::benchmark_data_smithi188_119427_object72519:head# 2024-04-01T19:43:00.554 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.554 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:440e51f2:::benchmark_data_smithi188_119427_object99590:head# 2024-04-01T19:43:00.554 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.554 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:440e887e:::benchmark_data_smithi188_119427_object73782:head# 2024-04-01T19:43:00.554 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.554 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:440e9c91:::benchmark_data_smithi188_119427_object125999:head# 2024-04-01T19:43:00.554 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.554 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:440fb644:::benchmark_data_smithi188_119427_object162718:head# 2024-04-01T19:43:00.554 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.554 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44106de9:::benchmark_data_smithi188_119427_object129352:head# 2024-04-01T19:43:00.554 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.554 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4411964a:::benchmark_data_smithi188_119427_object127441:head# 2024-04-01T19:43:00.555 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.555 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4411b66c:::benchmark_data_smithi188_119427_object124340:head# 2024-04-01T19:43:00.555 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.555 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44122008:::benchmark_data_smithi188_119427_object153231:head# 2024-04-01T19:43:00.555 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.555 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44131f0b:::benchmark_data_smithi188_119427_object90949:head# 2024-04-01T19:43:00.555 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.555 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44136d74:::benchmark_data_smithi188_119427_object158086:head# 2024-04-01T19:43:00.555 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.555 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4414a90c:::benchmark_data_smithi188_119427_object137099:head# 2024-04-01T19:43:00.555 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.555 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4414b8b8:::benchmark_data_smithi188_119427_object88848:head# 2024-04-01T19:43:00.555 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.555 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4414d5ca:::benchmark_data_smithi188_119427_object143237:head# 2024-04-01T19:43:00.556 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.556 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4414d795:::benchmark_data_smithi188_119427_object125672:head# 2024-04-01T19:43:00.556 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.556 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4415336f:::benchmark_data_smithi188_119427_object130729:head# 2024-04-01T19:43:00.556 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.556 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4415a6a9:::benchmark_data_smithi188_119427_object92105:head# 2024-04-01T19:43:00.556 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.556 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4415d9b8:::benchmark_data_smithi188_119427_object75023:head# 2024-04-01T19:43:00.556 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.556 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:441601fe:::benchmark_data_smithi188_119427_object158834:head# 2024-04-01T19:43:00.556 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.556 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44174b9f:::benchmark_data_smithi188_119427_object107497:head# 2024-04-01T19:43:00.556 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.556 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4417a9cb:::benchmark_data_smithi188_119427_object120441:head# 2024-04-01T19:43:00.557 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.557 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4417b140:::benchmark_data_smithi188_119427_object76794:head# 2024-04-01T19:43:00.557 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.557 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44196207:::benchmark_data_smithi188_119427_object104893:head# 2024-04-01T19:43:00.557 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.557 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:441d58a2:::benchmark_data_smithi188_119427_object138469:head# 2024-04-01T19:43:00.557 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.557 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:441d849f:::benchmark_data_smithi188_119427_object158804:head# 2024-04-01T19:43:00.557 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.557 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:441e30c6:::benchmark_data_smithi188_119427_object132052:head# 2024-04-01T19:43:00.557 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.557 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:441faaea:::benchmark_data_smithi188_119427_object150649:head# 2024-04-01T19:43:00.557 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.557 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44210261:::benchmark_data_smithi188_119427_object143658:head# 2024-04-01T19:43:00.558 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.558 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44218c3f:::benchmark_data_smithi188_119427_object131758:head# 2024-04-01T19:43:00.558 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.558 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4422e18c:::benchmark_data_smithi188_119427_object129863:head# 2024-04-01T19:43:00.558 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.558 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4423ae2b:::benchmark_data_smithi188_119427_object152973:head# 2024-04-01T19:43:00.558 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.558 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4423b0ed:::benchmark_data_smithi188_119427_object120324:head# 2024-04-01T19:43:00.558 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.558 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4423bd5c:::benchmark_data_smithi188_119427_object100040:head# 2024-04-01T19:43:00.558 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.558 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4424ee48:::benchmark_data_smithi188_119427_object130336:head# 2024-04-01T19:43:00.558 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.559 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44250e2f:::benchmark_data_smithi188_119427_object125309:head# 2024-04-01T19:43:00.559 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.559 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4427cd1e:::benchmark_data_smithi188_119427_object118454:head# 2024-04-01T19:43:00.559 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.559 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4427e59f:::benchmark_data_smithi188_119427_object116807:head# 2024-04-01T19:43:00.559 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.559 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44294923:::benchmark_data_smithi188_119427_object159982:head# 2024-04-01T19:43:00.559 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.559 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:442b3122:::benchmark_data_smithi188_119427_object78237:head# 2024-04-01T19:43:00.559 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.559 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:442df622:::benchmark_data_smithi188_119427_object79742:head# 2024-04-01T19:43:00.559 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.559 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:442f45eb:::benchmark_data_smithi188_119427_object125215:head# 2024-04-01T19:43:00.559 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.560 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:442f4b25:::benchmark_data_smithi188_119427_object95246:head# 2024-04-01T19:43:00.560 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.560 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:442f9486:::benchmark_data_smithi188_119427_object83643:head# 2024-04-01T19:43:00.560 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.560 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:442fbaf3:::benchmark_data_smithi188_119427_object137833:head# 2024-04-01T19:43:00.560 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.560 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:442fd68c:::benchmark_data_smithi188_119427_object154712:head# 2024-04-01T19:43:00.560 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.560 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44302179:::benchmark_data_smithi188_119427_object76415:head# 2024-04-01T19:43:00.560 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.560 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44304df3:::benchmark_data_smithi188_119427_object157705:head# 2024-04-01T19:43:00.560 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.560 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44309dbe:::benchmark_data_smithi188_119427_object92853:head# 2024-04-01T19:43:00.560 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.561 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4432bad3:::benchmark_data_smithi188_119427_object73247:head# 2024-04-01T19:43:00.561 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.561 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4432ffb2:::benchmark_data_smithi188_119427_object161235:head# 2024-04-01T19:43:00.561 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.561 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44333eda:::benchmark_data_smithi188_119427_object145628:head# 2024-04-01T19:43:00.561 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.561 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4434466b:::benchmark_data_smithi188_119427_object117475:head# 2024-04-01T19:43:00.561 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.561 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:443461f8:::benchmark_data_smithi188_119427_object140656:head# 2024-04-01T19:43:00.561 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.561 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4434b220:::benchmark_data_smithi188_119427_object105558:head# 2024-04-01T19:43:00.561 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.561 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4435cc8e:::benchmark_data_smithi188_119427_object102336:head# 2024-04-01T19:43:00.561 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.561 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4435cf11:::benchmark_data_smithi188_119427_object157196:head# 2024-04-01T19:43:00.562 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.562 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4436511b:::benchmark_data_smithi188_119427_object153755:head# 2024-04-01T19:43:00.562 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.562 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4436a236:::benchmark_data_smithi188_119427_object81975:head# 2024-04-01T19:43:00.562 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.562 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4436bf68:::benchmark_data_smithi188_119427_object162402:head# 2024-04-01T19:43:00.562 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.562 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44371f6c:::benchmark_data_smithi188_119427_object129026:head# 2024-04-01T19:43:00.562 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.562 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44378b01:::benchmark_data_smithi188_119427_object117087:head# 2024-04-01T19:43:00.562 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.562 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44387b1b:::benchmark_data_smithi188_119427_object123371:head# 2024-04-01T19:43:00.562 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.563 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:443ad50a:::benchmark_data_smithi188_119427_object89243:head# 2024-04-01T19:43:00.563 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.563 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:443bf935:::benchmark_data_smithi188_119427_object144524:head# 2024-04-01T19:43:00.563 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.563 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:443c7278:::benchmark_data_smithi188_119427_object73850:head# 2024-04-01T19:43:00.563 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.563 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:443ccd19:::benchmark_data_smithi188_119427_object160317:head# 2024-04-01T19:43:00.563 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.563 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:443d741a:::benchmark_data_smithi188_119427_object129607:head# 2024-04-01T19:43:00.563 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.563 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:443d84c3:::benchmark_data_smithi188_119427_object131389:head# 2024-04-01T19:43:00.563 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.563 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:443d8ff1:::benchmark_data_smithi188_119427_object77183:head# 2024-04-01T19:43:00.563 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:443da853:::benchmark_data_smithi188_119427_object86294:head# 2024-04-01T19:43:00.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:443e6eba:::benchmark_data_smithi188_119427_object124409:head# 2024-04-01T19:43:00.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:443edce8:::benchmark_data_smithi188_119427_object124431:head# 2024-04-01T19:43:00.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:443f3861:::benchmark_data_smithi188_119427_object86089:head# 2024-04-01T19:43:00.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:443f46ff:::benchmark_data_smithi188_119427_object106599:head# 2024-04-01T19:43:00.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:443f7f05:::benchmark_data_smithi188_119427_object98499:head# 2024-04-01T19:43:00.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:443ffa3b:::benchmark_data_smithi188_119427_object130837:head# 2024-04-01T19:43:00.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.565 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44421753:::benchmark_data_smithi188_119427_object134315:head# 2024-04-01T19:43:00.565 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.565 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44425a76:::benchmark_data_smithi188_119427_object143014:head# 2024-04-01T19:43:00.565 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.565 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4442a19e:::benchmark_data_smithi188_119427_object85196:head# 2024-04-01T19:43:00.565 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.565 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4443f48a:::benchmark_data_smithi188_119427_object78137:head# 2024-04-01T19:43:00.565 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.565 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4444c77c:::benchmark_data_smithi188_119427_object99490:head# 2024-04-01T19:43:00.565 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.565 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:444713e9:::benchmark_data_smithi188_119427_object161813:head# 2024-04-01T19:43:00.565 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.565 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44479959:::benchmark_data_smithi188_119427_object94471:head# 2024-04-01T19:43:00.565 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.565 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44491156:::benchmark_data_smithi188_119427_object80684:head# 2024-04-01T19:43:00.566 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.566 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:444abd05:::benchmark_data_smithi188_119427_object119177:head# 2024-04-01T19:43:00.566 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.566 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:444ad067:::benchmark_data_smithi188_119427_object112669:head# 2024-04-01T19:43:00.566 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.566 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:444af2e4:::benchmark_data_smithi188_119427_object112732:head# 2024-04-01T19:43:00.566 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.566 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:00.576 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:444b1b0a:::benchmark_data_smithi188_119427_object128398:head# 2024-04-01T19:43:00.576 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.576 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:444b623a:::benchmark_data_smithi188_119427_object147203:head# 2024-04-01T19:43:00.576 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.576 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:444b638c:::benchmark_data_smithi188_119427_object88284:head# 2024-04-01T19:43:00.576 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.576 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:444d2b70:::benchmark_data_smithi188_119427_object164642:head# 2024-04-01T19:43:00.576 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.576 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:444d3eaf:::benchmark_data_smithi188_119427_object78193:head# 2024-04-01T19:43:00.576 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.576 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:444d7e97:::benchmark_data_smithi188_119427_object96681:head# 2024-04-01T19:43:00.576 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.577 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:444db1b6:::benchmark_data_smithi188_119427_object164624:head# 2024-04-01T19:43:00.577 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.577 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:444fece7:::benchmark_data_smithi188_119427_object101629:head# 2024-04-01T19:43:00.577 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.577 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44509641:::benchmark_data_smithi188_119427_object142905:head# 2024-04-01T19:43:00.577 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.577 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:445117db:::benchmark_data_smithi188_119427_object102664:head# 2024-04-01T19:43:00.577 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.577 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4451c524:::benchmark_data_smithi188_119427_object154509:head# 2024-04-01T19:43:00.577 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.577 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44528a2d:::benchmark_data_smithi188_119427_object111570:head# 2024-04-01T19:43:00.577 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.577 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4452fcf7:::benchmark_data_smithi188_119427_object111874:head# 2024-04-01T19:43:00.577 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.578 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4453a1cd:::benchmark_data_smithi188_119427_object123332:head# 2024-04-01T19:43:00.578 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.578 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4453c86a:::benchmark_data_smithi188_119427_object122862:head# 2024-04-01T19:43:00.578 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.578 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4454c476:::benchmark_data_smithi188_119427_object143519:head# 2024-04-01T19:43:00.578 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.578 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44552598:::benchmark_data_smithi188_119427_object163222:head# 2024-04-01T19:43:00.578 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.578 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4455c8c7:::benchmark_data_smithi188_119427_object152406:head# 2024-04-01T19:43:00.578 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.578 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4456593b:::benchmark_data_smithi188_119427_object130295:head# 2024-04-01T19:43:00.578 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.578 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44575752:::benchmark_data_smithi188_119427_object80386:head# 2024-04-01T19:43:00.578 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.579 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44595314:::benchmark_data_smithi188_119427_object116612:head# 2024-04-01T19:43:00.579 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.579 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44595824:::benchmark_data_smithi188_119427_object141153:head# 2024-04-01T19:43:00.579 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.579 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4459ed37:::benchmark_data_smithi188_119427_object131860:head# 2024-04-01T19:43:00.579 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.579 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:445a77c7:::benchmark_data_smithi188_119427_object124124:head# 2024-04-01T19:43:00.579 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.579 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:445c8d93:::benchmark_data_smithi188_119427_object87608:head# 2024-04-01T19:43:00.579 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.579 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:445e2777:::benchmark_data_smithi188_119427_object143597:head# 2024-04-01T19:43:00.579 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.579 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:445f0502:::benchmark_data_smithi188_119427_object128313:head# 2024-04-01T19:43:00.579 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.579 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44619e9a:::benchmark_data_smithi188_119427_object164144:head# 2024-04-01T19:43:00.580 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.580 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4461b4aa:::benchmark_data_smithi188_119427_object73439:head# 2024-04-01T19:43:00.580 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.580 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44629d39:::benchmark_data_smithi188_119427_object124805:head# 2024-04-01T19:43:00.580 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.580 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44649ace:::benchmark_data_smithi188_119427_object164128:head# 2024-04-01T19:43:00.580 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.580 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4465637b:::benchmark_data_smithi188_119427_object163877:head# 2024-04-01T19:43:00.580 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.580 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:446596c3:::benchmark_data_smithi188_119427_object82194:head# 2024-04-01T19:43:00.580 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.580 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4466c548:::benchmark_data_smithi188_119427_object74379:head# 2024-04-01T19:43:00.580 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.580 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4466cf39:::benchmark_data_smithi188_119427_object94660:head# 2024-04-01T19:43:00.581 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.581 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44673e6e:::benchmark_data_smithi188_119427_object146927:head# 2024-04-01T19:43:00.581 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.581 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44677d0f:::benchmark_data_smithi188_119427_object156805:head# 2024-04-01T19:43:00.581 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.581 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:446783c8:::benchmark_data_smithi188_119427_object121306:head# 2024-04-01T19:43:00.581 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.581 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4467f87f:::benchmark_data_smithi188_119427_object79293:head# 2024-04-01T19:43:00.581 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.581 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44683cc1:::benchmark_data_smithi188_119427_object87686:head# 2024-04-01T19:43:00.581 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.581 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4468ace4:::benchmark_data_smithi188_119427_object126167:head# 2024-04-01T19:43:00.581 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.581 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44692e3d:::benchmark_data_smithi188_119427_object120571:head# 2024-04-01T19:43:00.582 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.582 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44695923:::benchmark_data_smithi188_119427_object129634:head# 2024-04-01T19:43:00.582 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.582 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:446ae9b3:::benchmark_data_smithi188_119427_object161315:head# 2024-04-01T19:43:00.582 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.582 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:446b2647:::benchmark_data_smithi188_119427_object122767:head# 2024-04-01T19:43:00.582 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.582 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:446b27a9:::benchmark_data_smithi188_119427_object159767:head# 2024-04-01T19:43:00.582 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.582 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:446b717c:::benchmark_data_smithi188_119427_object136078:head# 2024-04-01T19:43:00.582 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.582 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:446c4510:::benchmark_data_smithi188_119427_object141394:head# 2024-04-01T19:43:00.582 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:446ca45c:::benchmark_data_smithi188_119427_object108391:head# 2024-04-01T19:43:00.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:446d05a5:::benchmark_data_smithi188_119427_object73587:head# 2024-04-01T19:43:00.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:446d4cb5:::benchmark_data_smithi188_119427_object137049:head# 2024-04-01T19:43:00.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:446e0c8c:::benchmark_data_smithi188_119427_object119184:head# 2024-04-01T19:43:00.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:446e4038:::benchmark_data_smithi188_119427_object74011:head# 2024-04-01T19:43:00.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:446eef32:::benchmark_data_smithi188_119427_object157956:head# 2024-04-01T19:43:00.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:446f4b9e:::benchmark_data_smithi188_119427_object155607:head# 2024-04-01T19:43:00.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:446f8882:::benchmark_data_smithi188_119427_object87432:head# 2024-04-01T19:43:00.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:446fd293:::benchmark_data_smithi188_119427_object137585:head# 2024-04-01T19:43:00.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:447032b9:::benchmark_data_smithi188_119427_object126764:head# 2024-04-01T19:43:00.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:447096a9:::benchmark_data_smithi188_119427_object98339:head# 2024-04-01T19:43:00.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4471ecdd:::benchmark_data_smithi188_119427_object149489:head# 2024-04-01T19:43:00.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44739ac0:::benchmark_data_smithi188_119427_object134475:head# 2024-04-01T19:43:00.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44752b41:::benchmark_data_smithi188_119427_object85454:head# 2024-04-01T19:43:00.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.585 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4475b9f0:::benchmark_data_smithi188_119427_object82618:head# 2024-04-01T19:43:00.585 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.585 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44766988:::benchmark_data_smithi188_119427_object128529:head# 2024-04-01T19:43:00.585 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.585 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4476933e:::benchmark_data_smithi188_119427_object108296:head# 2024-04-01T19:43:00.585 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.585 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4477a40b:::benchmark_data_smithi188_119427_object80036:head# 2024-04-01T19:43:00.585 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.585 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:447843b1:::benchmark_data_smithi188_119427_object98892:head# 2024-04-01T19:43:00.585 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.585 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44795f2c:::benchmark_data_smithi188_119427_object126118:head# 2024-04-01T19:43:00.585 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.585 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44798057:::benchmark_data_smithi188_119427_object153273:head# 2024-04-01T19:43:00.585 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.586 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:447b066d:::benchmark_data_smithi188_119427_object101925:head# 2024-04-01T19:43:00.586 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.586 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:447d1cf2:::benchmark_data_smithi188_119427_object87324:head# 2024-04-01T19:43:00.586 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.586 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:447d4be2:::benchmark_data_smithi188_119427_object115054:head# 2024-04-01T19:43:00.586 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.586 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:447d6627:::benchmark_data_smithi188_119427_object87631:head# 2024-04-01T19:43:00.586 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.586 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:447d8582:::benchmark_data_smithi188_119427_object101420:head# 2024-04-01T19:43:00.586 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.586 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:447dd93d:::benchmark_data_smithi188_119427_object78583:head# 2024-04-01T19:43:00.586 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.586 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:447e383d:::benchmark_data_smithi188_119427_object119652:head# 2024-04-01T19:43:00.586 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:447ebf4a:::benchmark_data_smithi188_119427_object77106:head# 2024-04-01T19:43:00.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:447f5d64:::benchmark_data_smithi188_119427_object158887:head# 2024-04-01T19:43:00.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44804e00:::benchmark_data_smithi188_119427_object101811:head# 2024-04-01T19:43:00.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4480a56f:::benchmark_data_smithi188_119427_object147174:head# 2024-04-01T19:43:00.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4480b538:::benchmark_data_smithi188_119427_object155916:head# 2024-04-01T19:43:00.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:448137c4:::benchmark_data_smithi188_119427_object129410:head# 2024-04-01T19:43:00.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44821bf1:::benchmark_data_smithi188_119427_object104318:head# 2024-04-01T19:43:00.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44833509:::benchmark_data_smithi188_119427_object80205:head# 2024-04-01T19:43:00.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4483c53e:::benchmark_data_smithi188_119427_object87833:head# 2024-04-01T19:43:00.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44845943:::benchmark_data_smithi188_119427_object150082:head# 2024-04-01T19:43:00.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4484a186:::benchmark_data_smithi188_119427_object139499:head# 2024-04-01T19:43:00.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4485cafd:::benchmark_data_smithi188_119427_object141285:head# 2024-04-01T19:43:00.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44864128:::benchmark_data_smithi188_119427_object109299:head# 2024-04-01T19:43:00.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4486d95a:::benchmark_data_smithi188_119427_object81670:head# 2024-04-01T19:43:00.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4486e978:::benchmark_data_smithi188_119427_object132863:head# 2024-04-01T19:43:00.589 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.589 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:448705d0:::benchmark_data_smithi188_119427_object124607:head# 2024-04-01T19:43:00.589 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.589 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:448726f3:::benchmark_data_smithi188_119427_object149691:head# 2024-04-01T19:43:00.589 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.589 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44874468:::benchmark_data_smithi188_119427_object111028:head# 2024-04-01T19:43:00.589 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.589 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:448755eb:::benchmark_data_smithi188_119427_object102579:head# 2024-04-01T19:43:00.589 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.589 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4487d14b:::benchmark_data_smithi188_119427_object157511:head# 2024-04-01T19:43:00.589 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.589 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4487fb62:::benchmark_data_smithi188_119427_object98024:head# 2024-04-01T19:43:00.589 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.589 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4488532e:::benchmark_data_smithi188_119427_object96368:head# 2024-04-01T19:43:00.590 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.590 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44887118:::benchmark_data_smithi188_119427_object74318:head# 2024-04-01T19:43:00.590 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.590 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4489f7de:::benchmark_data_smithi188_119427_object76263:head# 2024-04-01T19:43:00.590 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.590 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:448a519a:::benchmark_data_smithi188_119427_object134115:head# 2024-04-01T19:43:00.590 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.597 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:448c3c15:::benchmark_data_smithi188_119427_object146950:head# 2024-04-01T19:43:00.597 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.597 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:448c46ff:::benchmark_data_smithi188_119427_object115766:head# 2024-04-01T19:43:00.597 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.597 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:448c8e78:::benchmark_data_smithi188_119427_object81050:head# 2024-04-01T19:43:00.597 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.597 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:448cffd0:::benchmark_data_smithi188_119427_object77172:head# 2024-04-01T19:43:00.597 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.597 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:448eea3d:::benchmark_data_smithi188_119427_object164436:head# 2024-04-01T19:43:00.597 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.597 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:448f08b1:::benchmark_data_smithi188_119427_object163589:head# 2024-04-01T19:43:00.597 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.597 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44901106:::benchmark_data_smithi188_119427_object128647:head# 2024-04-01T19:43:00.598 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.598 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:449036fe:::benchmark_data_smithi188_119427_object89057:head# 2024-04-01T19:43:00.598 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.598 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4490a684:::benchmark_data_smithi188_119427_object136609:head# 2024-04-01T19:43:00.598 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.598 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4490adee:::benchmark_data_smithi188_119427_object76581:head# 2024-04-01T19:43:00.598 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.598 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4490aea0:::benchmark_data_smithi188_119427_object78705:head# 2024-04-01T19:43:00.598 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.598 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:449117a8:::benchmark_data_smithi188_119427_object159153:head# 2024-04-01T19:43:00.598 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.598 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:449127c0:::benchmark_data_smithi188_119427_object131841:head# 2024-04-01T19:43:00.598 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.599 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4491d797:::benchmark_data_smithi188_119427_object122115:head# 2024-04-01T19:43:00.599 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.599 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4491dd3f:::benchmark_data_smithi188_119427_object104545:head# 2024-04-01T19:43:00.599 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.599 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4493105a:::benchmark_data_smithi188_119427_object152552:head# 2024-04-01T19:43:00.599 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.599 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4493c6e0:::benchmark_data_smithi188_119427_object112499:head# 2024-04-01T19:43:00.599 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.599 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:449492ab:::benchmark_data_smithi188_119427_object97246:head# 2024-04-01T19:43:00.599 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.599 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44949a9c:::benchmark_data_smithi188_119427_object121869:head# 2024-04-01T19:43:00.599 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.599 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:449544d6:::benchmark_data_smithi188_119427_object123868:head# 2024-04-01T19:43:00.600 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.600 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44963aa5:::benchmark_data_smithi188_119427_object150553:head# 2024-04-01T19:43:00.600 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.600 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4496763b:::benchmark_data_smithi188_119427_object155860:head# 2024-04-01T19:43:00.600 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.600 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4498865e:::benchmark_data_smithi188_119427_object134526:head# 2024-04-01T19:43:00.600 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.600 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:449984e0:::benchmark_data_smithi188_119427_object99569:head# 2024-04-01T19:43:00.600 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.600 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4499dbb0:::benchmark_data_smithi188_119427_object138918:head# 2024-04-01T19:43:00.600 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.600 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:449a00f6:::benchmark_data_smithi188_119427_object140763:head# 2024-04-01T19:43:00.600 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.600 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:449b3a5d:::benchmark_data_smithi188_119427_object137271:head# 2024-04-01T19:43:00.601 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.601 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:449bf22f:::benchmark_data_smithi188_119427_object141156:head# 2024-04-01T19:43:00.601 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.601 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:449eca3d:::benchmark_data_smithi188_119427_object91749:head# 2024-04-01T19:43:00.601 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.601 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:449fb307:::benchmark_data_smithi188_119427_object118123:head# 2024-04-01T19:43:00.601 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.601 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44a07224:::benchmark_data_smithi188_119427_object116472:head# 2024-04-01T19:43:00.601 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.601 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44a20719:::benchmark_data_smithi188_119427_object137119:head# 2024-04-01T19:43:00.601 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.601 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44a20a83:::benchmark_data_smithi188_119427_object152462:head# 2024-04-01T19:43:00.601 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.601 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44a36fd3:::benchmark_data_smithi188_119427_object155134:head# 2024-04-01T19:43:00.601 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.602 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44a3a28a:::benchmark_data_smithi188_119427_object126268:head# 2024-04-01T19:43:00.602 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.602 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44a3ad4c:::benchmark_data_smithi188_119427_object160705:head# 2024-04-01T19:43:00.602 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.602 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44a55b34:::benchmark_data_smithi188_119427_object78047:head# 2024-04-01T19:43:00.602 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.602 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44a75e8c:::benchmark_data_smithi188_119427_object100666:head# 2024-04-01T19:43:00.602 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.602 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44a7be9c:::benchmark_data_smithi188_119427_object150146:head# 2024-04-01T19:43:00.602 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.602 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44a7fb9f:::benchmark_data_smithi188_119427_object128631:head# 2024-04-01T19:43:00.602 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.602 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44a950fd:::benchmark_data_smithi188_119427_object80367:head# 2024-04-01T19:43:00.602 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.603 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44a9d54b:::benchmark_data_smithi188_119427_object151871:head# 2024-04-01T19:43:00.603 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.603 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44aa88d5:::benchmark_data_smithi188_119427_object136112:head# 2024-04-01T19:43:00.603 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.603 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44aad910:::benchmark_data_smithi188_119427_object93167:head# 2024-04-01T19:43:00.603 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.603 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44ab55f6:::benchmark_data_smithi188_119427_object99996:head# 2024-04-01T19:43:00.603 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.603 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44acf8f4:::benchmark_data_smithi188_119427_object110659:head# 2024-04-01T19:43:00.603 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.603 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44adc955:::benchmark_data_smithi188_119427_object73824:head# 2024-04-01T19:43:00.603 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.603 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44adddb3:::benchmark_data_smithi188_119427_object84617:head# 2024-04-01T19:43:00.603 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.609 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44af8c5d:::benchmark_data_smithi188_119427_object95248:head# 2024-04-01T19:43:00.610 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.610 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44af9e11:::benchmark_data_smithi188_119427_object117280:head# 2024-04-01T19:43:00.610 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.610 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44b02b5e:::benchmark_data_smithi188_119427_object158097:head# 2024-04-01T19:43:00.610 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.610 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44b2458c:::benchmark_data_smithi188_119427_object126310:head# 2024-04-01T19:43:00.610 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.610 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44b290ee:::benchmark_data_smithi188_119427_object113019:head# 2024-04-01T19:43:00.610 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.610 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44b42831:::benchmark_data_smithi188_119427_object154421:head# 2024-04-01T19:43:00.610 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.610 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44b430ae:::benchmark_data_smithi188_119427_object99411:head# 2024-04-01T19:43:00.611 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.611 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44b4a581:::benchmark_data_smithi188_119427_object114531:head# 2024-04-01T19:43:00.611 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.611 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44b4f13b:::benchmark_data_smithi188_119427_object139404:head# 2024-04-01T19:43:00.611 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.611 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44b690de:::benchmark_data_smithi188_119427_object80824:head# 2024-04-01T19:43:00.611 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.611 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44b6c0eb:::benchmark_data_smithi188_119427_object100870:head# 2024-04-01T19:43:00.611 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.611 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44b93892:::benchmark_data_smithi188_119427_object84311:head# 2024-04-01T19:43:00.611 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.611 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44ba1cee:::benchmark_data_smithi188_119427_object149116:head# 2024-04-01T19:43:00.611 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.611 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44ba78f3:::benchmark_data_smithi188_119427_object94548:head# 2024-04-01T19:43:00.612 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.612 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44bba847:::benchmark_data_smithi188_119427_object163426:head# 2024-04-01T19:43:00.612 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.612 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44bbfa93:::benchmark_data_smithi188_119427_object88864:head# 2024-04-01T19:43:00.612 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.612 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44bc09c0:::benchmark_data_smithi188_119427_object84217:head# 2024-04-01T19:43:00.612 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.612 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44bc41a5:::benchmark_data_smithi188_119427_object128473:head# 2024-04-01T19:43:00.612 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.612 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44bc6279:::benchmark_data_smithi188_119427_object141001:head# 2024-04-01T19:43:00.612 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.612 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44bc9845:::benchmark_data_smithi188_119427_object140498:head# 2024-04-01T19:43:00.612 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.612 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44bcbff4:::benchmark_data_smithi188_119427_object141298:head# 2024-04-01T19:43:00.613 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.613 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44bd6fb9:::benchmark_data_smithi188_119427_object117302:head# 2024-04-01T19:43:00.613 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.613 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44becc70:::benchmark_data_smithi188_119427_object124844:head# 2024-04-01T19:43:00.613 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.613 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44befce9:::benchmark_data_smithi188_119427_object75389:head# 2024-04-01T19:43:00.613 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.613 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44bf1932:::benchmark_data_smithi188_119427_object135216:head# 2024-04-01T19:43:00.613 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.613 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44bf1b31:::benchmark_data_smithi188_119427_object107930:head# 2024-04-01T19:43:00.613 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.613 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44bf5caa:::benchmark_data_smithi188_119427_object127355:head# 2024-04-01T19:43:00.613 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.613 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44bf87d6:::benchmark_data_smithi188_119427_object95891:head# 2024-04-01T19:43:00.613 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.614 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44bf967e:::benchmark_data_smithi188_119427_object129602:head# 2024-04-01T19:43:00.614 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.614 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44bfa412:::benchmark_data_smithi188_119427_object164482:head# 2024-04-01T19:43:00.614 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.614 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44c0255b:::benchmark_data_smithi188_119427_object95103:head# 2024-04-01T19:43:00.614 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.614 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44c0b24c:::benchmark_data_smithi188_119427_object72856:head# 2024-04-01T19:43:00.614 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.614 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44c0f353:::benchmark_data_smithi188_119427_object153692:head# 2024-04-01T19:43:00.614 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.614 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44c32a18:::benchmark_data_smithi188_119427_object87146:head# 2024-04-01T19:43:00.614 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.615 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44c59243:::benchmark_data_smithi188_119427_object118098:head# 2024-04-01T19:43:00.615 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.615 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44c5988a:::benchmark_data_smithi188_119427_object123336:head# 2024-04-01T19:43:00.615 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.615 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44c68e3f:::benchmark_data_smithi188_119427_object110041:head# 2024-04-01T19:43:00.615 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.615 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44c68ffb:::benchmark_data_smithi188_119427_object75052:head# 2024-04-01T19:43:00.615 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.615 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44c6a507:::benchmark_data_smithi188_119427_object80827:head# 2024-04-01T19:43:00.615 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.615 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44c7acd3:::benchmark_data_smithi188_119427_object88222:head# 2024-04-01T19:43:00.615 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.615 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44c7de57:::benchmark_data_smithi188_119427_object148360:head# 2024-04-01T19:43:00.615 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.615 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44c96d80:::benchmark_data_smithi188_119427_object118990:head# 2024-04-01T19:43:00.616 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.616 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44c9e82e:::benchmark_data_smithi188_119427_object73095:head# 2024-04-01T19:43:00.616 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.616 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44ca12a3:::benchmark_data_smithi188_119427_object159429:head# 2024-04-01T19:43:00.616 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.616 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44ca6332:::benchmark_data_smithi188_119427_object85483:head# 2024-04-01T19:43:00.616 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.616 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44cbac92:::benchmark_data_smithi188_119427_object93284:head# 2024-04-01T19:43:00.616 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.616 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44cbec20:::benchmark_data_smithi188_119427_object156136:head# 2024-04-01T19:43:00.616 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.616 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44cc5a62:::benchmark_data_smithi188_119427_object118392:head# 2024-04-01T19:43:00.616 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.616 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44cd0900:::benchmark_data_smithi188_119427_object76880:head# 2024-04-01T19:43:00.616 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.617 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44ce20ac:::benchmark_data_smithi188_119427_object90890:head# 2024-04-01T19:43:00.617 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.617 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44cf3b16:::benchmark_data_smithi188_119427_object76701:head# 2024-04-01T19:43:00.617 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.621 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44cf5335:::benchmark_data_smithi188_119427_object102491:head# 2024-04-01T19:43:00.621 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.621 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44d096e8:::benchmark_data_smithi188_119427_object157726:head# 2024-04-01T19:43:00.621 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.621 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44d27ea9:::benchmark_data_smithi188_119427_object141223:head# 2024-04-01T19:43:00.621 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.621 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44d3a276:::benchmark_data_smithi188_119427_object161623:head# 2024-04-01T19:43:00.621 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.621 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44d3f855:::benchmark_data_smithi188_119427_object85432:head# 2024-04-01T19:43:00.621 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.621 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44d424f7:::benchmark_data_smithi188_119427_object146493:head# 2024-04-01T19:43:00.621 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.621 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44d47b04:::benchmark_data_smithi188_119427_object77866:head# 2024-04-01T19:43:00.622 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.622 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44d53172:::benchmark_data_smithi188_119427_object144150:head# 2024-04-01T19:43:00.622 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.622 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44d61663:::benchmark_data_smithi188_119427_object91711:head# 2024-04-01T19:43:00.622 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.622 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44d6fa0a:::benchmark_data_smithi188_119427_object86029:head# 2024-04-01T19:43:00.622 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.622 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44d76ccb:::benchmark_data_smithi188_119427_object126801:head# 2024-04-01T19:43:00.622 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.622 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44d770f3:::benchmark_data_smithi188_119427_object142812:head# 2024-04-01T19:43:00.622 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.622 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44d892e6:::benchmark_data_smithi188_119427_object141292:head# 2024-04-01T19:43:00.622 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.622 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44d8aaeb:::benchmark_data_smithi188_119427_object101036:head# 2024-04-01T19:43:00.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44d90959:::benchmark_data_smithi188_119427_object99579:head# 2024-04-01T19:43:00.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44da77a0:::benchmark_data_smithi188_119427_object131228:head# 2024-04-01T19:43:00.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44dad9b2:::benchmark_data_smithi188_119427_object143806:head# 2024-04-01T19:43:00.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44db24f6:::benchmark_data_smithi188_119427_object155373:head# 2024-04-01T19:43:00.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44dbb90e:::benchmark_data_smithi188_119427_object87691:head# 2024-04-01T19:43:00.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44dbf059:::benchmark_data_smithi188_119427_object99130:head# 2024-04-01T19:43:00.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.624 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44ddee39:::benchmark_data_smithi188_119427_object105724:head# 2024-04-01T19:43:00.624 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.624 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44de728d:::benchmark_data_smithi188_119427_object99745:head# 2024-04-01T19:43:00.624 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.624 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44de93ab:::benchmark_data_smithi188_119427_object102920:head# 2024-04-01T19:43:00.624 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.624 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44df1f34:::benchmark_data_smithi188_119427_object110594:head# 2024-04-01T19:43:00.624 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.624 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44df216c:::benchmark_data_smithi188_119427_object161433:head# 2024-04-01T19:43:00.624 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.624 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44df4450:::benchmark_data_smithi188_119427_object125721:head# 2024-04-01T19:43:00.624 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.624 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44df637c:::benchmark_data_smithi188_119427_object145592:head# 2024-04-01T19:43:00.624 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.625 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44dfb2ba:::benchmark_data_smithi188_119427_object121333:head# 2024-04-01T19:43:00.625 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.625 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44dfd3ec:::benchmark_data_smithi188_119427_object118427:head# 2024-04-01T19:43:00.625 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.625 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44e00147:::benchmark_data_smithi188_119427_object148352:head# 2024-04-01T19:43:00.625 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.625 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44e22304:::benchmark_data_smithi188_119427_object128417:head# 2024-04-01T19:43:00.625 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.625 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44e273e8:::benchmark_data_smithi188_119427_object149178:head# 2024-04-01T19:43:00.625 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.625 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44e36c1d:::benchmark_data_smithi188_119427_object91044:head# 2024-04-01T19:43:00.625 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.625 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44e3a9f1:::benchmark_data_smithi188_119427_object157445:head# 2024-04-01T19:43:00.625 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.626 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44e3c0e9:::benchmark_data_smithi188_119427_object144827:head# 2024-04-01T19:43:00.626 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.626 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44e4adf7:::benchmark_data_smithi188_119427_object108121:head# 2024-04-01T19:43:00.626 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.626 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44e4d784:::benchmark_data_smithi188_119427_object76640:head# 2024-04-01T19:43:00.626 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.626 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44e50d87:::benchmark_data_smithi188_119427_object117779:head# 2024-04-01T19:43:00.626 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.626 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44e6db6e:::benchmark_data_smithi188_119427_object156774:head# 2024-04-01T19:43:00.626 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.626 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44e78cae:::benchmark_data_smithi188_119427_object136506:head# 2024-04-01T19:43:00.626 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.630 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44e7af58:::benchmark_data_smithi188_119427_object132755:head# 2024-04-01T19:43:00.630 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.631 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44e7b417:::benchmark_data_smithi188_119427_object130094:head# 2024-04-01T19:43:00.631 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.631 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44e90e40:::benchmark_data_smithi188_119427_object157340:head# 2024-04-01T19:43:00.631 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.631 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44e9df09:::benchmark_data_smithi188_119427_object120384:head# 2024-04-01T19:43:00.631 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.631 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44eaa7bc:::benchmark_data_smithi188_119427_object136907:head# 2024-04-01T19:43:00.631 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.631 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44eb9195:::benchmark_data_smithi188_119427_object109325:head# 2024-04-01T19:43:00.631 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.631 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44ed706e:::benchmark_data_smithi188_119427_object150788:head# 2024-04-01T19:43:00.631 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.631 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44efa779:::benchmark_data_smithi188_119427_object103585:head# 2024-04-01T19:43:00.631 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.631 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44f0fafc:::benchmark_data_smithi188_119427_object97375:head# 2024-04-01T19:43:00.632 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.632 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44f3ac25:::benchmark_data_smithi188_119427_object97139:head# 2024-04-01T19:43:00.632 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.632 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44f46ea4:::benchmark_data_smithi188_119427_object162173:head# 2024-04-01T19:43:00.632 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.632 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44f47383:::benchmark_data_smithi188_119427_object116371:head# 2024-04-01T19:43:00.632 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.632 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44f62a30:::benchmark_data_smithi188_119427_object162994:head# 2024-04-01T19:43:00.632 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.632 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44f693ba:::benchmark_data_smithi188_119427_object159844:head# 2024-04-01T19:43:00.632 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.632 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44f89df7:::benchmark_data_smithi188_119427_object80890:head# 2024-04-01T19:43:00.632 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.632 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44f92ec4:::benchmark_data_smithi188_119427_object97847:head# 2024-04-01T19:43:00.632 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.633 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44fad67e:::benchmark_data_smithi188_119427_object103580:head# 2024-04-01T19:43:00.633 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.633 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44fca8a4:::benchmark_data_smithi188_119427_object119526:head# 2024-04-01T19:43:00.633 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.633 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44fdac2a:::benchmark_data_smithi188_119427_object80435:head# 2024-04-01T19:43:00.633 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.633 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44ffbb6f:::benchmark_data_smithi188_119427_object136122:head# 2024-04-01T19:43:00.633 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.633 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:44ffd9a8:::benchmark_data_smithi188_119427_object160170:head# 2024-04-01T19:43:00.633 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.633 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45002352:::benchmark_data_smithi188_119427_object129502:head# 2024-04-01T19:43:00.633 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.633 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45021b62:::benchmark_data_smithi188_119427_object95556:head# 2024-04-01T19:43:00.633 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.634 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4504a130:::benchmark_data_smithi188_119427_object133157:head# 2024-04-01T19:43:00.634 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.634 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4504ea79:::benchmark_data_smithi188_119427_object132742:head# 2024-04-01T19:43:00.634 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.634 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45065470:::benchmark_data_smithi188_119427_object89636:head# 2024-04-01T19:43:00.634 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.634 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4506dd07:::benchmark_data_smithi188_119427_object104310:head# 2024-04-01T19:43:00.634 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.634 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4507a66b:::benchmark_data_smithi188_119427_object98067:head# 2024-04-01T19:43:00.634 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.634 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4507dcc5:::benchmark_data_smithi188_119427_object144601:head# 2024-04-01T19:43:00.634 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.634 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4508d2e8:::benchmark_data_smithi188_119427_object138827:head# 2024-04-01T19:43:00.634 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.635 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45098ac5:::benchmark_data_smithi188_119427_object85860:head# 2024-04-01T19:43:00.635 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.635 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4509f17b:::benchmark_data_smithi188_119427_object136159:head# 2024-04-01T19:43:00.635 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.635 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:450a0c55:::benchmark_data_smithi188_119427_object143391:head# 2024-04-01T19:43:00.635 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.635 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:450a74f3:::benchmark_data_smithi188_119427_object91088:head# 2024-04-01T19:43:00.635 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.638 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:450ab431:::benchmark_data_smithi188_119427_object123489:head# 2024-04-01T19:43:00.638 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:450ada05:::benchmark_data_smithi188_119427_object101268:head# 2024-04-01T19:43:00.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:450b2b00:::benchmark_data_smithi188_119427_object79003:head# 2024-04-01T19:43:00.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:450b38f7:::benchmark_data_smithi188_119427_object98279:head# 2024-04-01T19:43:00.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.640 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:450b57de:::benchmark_data_smithi188_119427_object97884:head# 2024-04-01T19:43:00.640 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.640 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:450b6971:::benchmark_data_smithi188_119427_object134285:head# 2024-04-01T19:43:00.640 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.640 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:450bd6b2:::benchmark_data_smithi188_119427_object84128:head# 2024-04-01T19:43:00.640 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.641 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:450bdee0:::benchmark_data_smithi188_119427_object88270:head# 2024-04-01T19:43:00.641 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.641 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:450c0506:::benchmark_data_smithi188_119427_object123101:head# 2024-04-01T19:43:00.641 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.641 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:450c7a89:::benchmark_data_smithi188_119427_object117797:head# 2024-04-01T19:43:00.641 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.641 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:450cdfba:::benchmark_data_smithi188_119427_object141187:head# 2024-04-01T19:43:00.642 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.644 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:450d0b51:::benchmark_data_smithi188_119427_object148914:head# 2024-04-01T19:43:00.644 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.645 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:450f1fe5:::benchmark_data_smithi188_119427_object119430:head# 2024-04-01T19:43:00.645 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.645 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:450fb886:::benchmark_data_smithi188_119427_object81492:head# 2024-04-01T19:43:00.645 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.646 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:451035ac:::benchmark_data_smithi188_119427_object136209:head# 2024-04-01T19:43:00.646 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.646 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4511f679:::benchmark_data_smithi188_119427_object121186:head# 2024-04-01T19:43:00.646 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.646 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45121d4b:::benchmark_data_smithi188_119427_object117305:head# 2024-04-01T19:43:00.646 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.647 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4512813d:::benchmark_data_smithi188_119427_object149663:head# 2024-04-01T19:43:00.647 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.647 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:451305c3:::benchmark_data_smithi188_119427_object90905:head# 2024-04-01T19:43:00.647 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.647 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:451466ac:::benchmark_data_smithi188_119427_object115063:head# 2024-04-01T19:43:00.647 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.647 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45147f75:::benchmark_data_smithi188_119427_object164587:head# 2024-04-01T19:43:00.647 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.648 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4516a710:::benchmark_data_smithi188_119427_object88008:head# 2024-04-01T19:43:00.648 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.648 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4516dbd1:::benchmark_data_smithi188_119427_object85052:head# 2024-04-01T19:43:00.648 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.648 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4517257f:::benchmark_data_smithi188_119427_object90625:head# 2024-04-01T19:43:00.648 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.649 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45175908:::benchmark_data_smithi188_119427_object161265:head# 2024-04-01T19:43:00.649 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.649 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4518e65c:::benchmark_data_smithi188_119427_object144413:head# 2024-04-01T19:43:00.649 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.650 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4519675c:::benchmark_data_smithi188_119427_object161448:head# 2024-04-01T19:43:00.650 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.650 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:451a1f16:::benchmark_data_smithi188_119427_object147555:head# 2024-04-01T19:43:00.650 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.650 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:451a9d11:::benchmark_data_smithi188_119427_object93798:head# 2024-04-01T19:43:00.650 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.650 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:451b33de:::benchmark_data_smithi188_119427_object86474:head# 2024-04-01T19:43:00.650 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.650 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:451cf2d3:::benchmark_data_smithi188_119427_object75153:head# 2024-04-01T19:43:00.650 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.650 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:451e065d:::benchmark_data_smithi188_119427_object100086:head# 2024-04-01T19:43:00.650 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.651 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45209259:::benchmark_data_smithi188_119427_object121143:head# 2024-04-01T19:43:00.651 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.652 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4521062a:::benchmark_data_smithi188_119427_object100909:head# 2024-04-01T19:43:00.652 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.652 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:452245a4:::benchmark_data_smithi188_119427_object104562:head# 2024-04-01T19:43:00.652 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.652 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45225d18:::benchmark_data_smithi188_119427_object143252:head# 2024-04-01T19:43:00.652 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.652 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45231797:::benchmark_data_smithi188_119427_object126658:head# 2024-04-01T19:43:00.652 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.652 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45234a9d:::benchmark_data_smithi188_119427_object128561:head# 2024-04-01T19:43:00.652 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.652 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45241f60:::benchmark_data_smithi188_119427_object90634:head# 2024-04-01T19:43:00.652 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.654 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4524809e:::benchmark_data_smithi188_119427_object107467:head# 2024-04-01T19:43:00.654 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.654 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4524a640:::benchmark_data_smithi188_119427_object121603:head# 2024-04-01T19:43:00.654 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.654 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45250d5a:::benchmark_data_smithi188_119427_object77620:head# 2024-04-01T19:43:00.654 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.655 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4526a697:::benchmark_data_smithi188_119427_object130040:head# 2024-04-01T19:43:00.655 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.655 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45272e9b:::benchmark_data_smithi188_119427_object84444:head# 2024-04-01T19:43:00.655 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.655 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4527665b:::benchmark_data_smithi188_119427_object113281:head# 2024-04-01T19:43:00.655 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.655 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45277ed0:::benchmark_data_smithi188_119427_object145908:head# 2024-04-01T19:43:00.655 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.655 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45278642:::benchmark_data_smithi188_119427_object102080:head# 2024-04-01T19:43:00.655 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.655 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4527f97c:::benchmark_data_smithi188_119427_object77768:head# 2024-04-01T19:43:00.655 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.655 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:452b0dea:::benchmark_data_smithi188_119427_object96590:head# 2024-04-01T19:43:00.655 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.655 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:452b305b:::benchmark_data_smithi188_119427_object136587:head# 2024-04-01T19:43:00.656 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.658 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:452b7e36:::benchmark_data_smithi188_119427_object99033:head# 2024-04-01T19:43:00.658 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.659 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:452bb2fd:::benchmark_data_smithi188_119427_object82479:head# 2024-04-01T19:43:00.659 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.659 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:452c33d7:::benchmark_data_smithi188_119427_object131428:head# 2024-04-01T19:43:00.659 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.659 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:452c420a:::benchmark_data_smithi188_119427_object115074:head# 2024-04-01T19:43:00.659 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.659 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:452d1f3e:::benchmark_data_smithi188_119427_object80979:head# 2024-04-01T19:43:00.659 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.659 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:452d37b4:::benchmark_data_smithi188_119427_object123587:head# 2024-04-01T19:43:00.659 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.659 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:452d3c4b:::benchmark_data_smithi188_119427_object137798:head# 2024-04-01T19:43:00.659 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.659 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:452d4dc3:::benchmark_data_smithi188_119427_object108292:head# 2024-04-01T19:43:00.659 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.659 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:452e3839:::benchmark_data_smithi188_119427_object136511:head# 2024-04-01T19:43:00.660 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.660 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:452ee1a9:::benchmark_data_smithi188_119427_object103784:head# 2024-04-01T19:43:00.660 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.660 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45315c0c:::benchmark_data_smithi188_119427_object73536:head# 2024-04-01T19:43:00.660 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.660 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4532f586:::benchmark_data_smithi188_119427_object148735:head# 2024-04-01T19:43:00.660 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.660 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:453385c7:::benchmark_data_smithi188_119427_object122223:head# 2024-04-01T19:43:00.660 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.660 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:453422d2:::benchmark_data_smithi188_119427_object108536:head# 2024-04-01T19:43:00.660 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.660 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45350983:::benchmark_data_smithi188_119427_object98791:head# 2024-04-01T19:43:00.660 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.660 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4535b2d6:::benchmark_data_smithi188_119427_object154876:head# 2024-04-01T19:43:00.661 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.661 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45362a53:::benchmark_data_smithi188_119427_object87328:head# 2024-04-01T19:43:00.661 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.662 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45365069:::benchmark_data_smithi188_119427_object78482:head# 2024-04-01T19:43:00.662 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.662 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4536d47b:::benchmark_data_smithi188_119427_object130421:head# 2024-04-01T19:43:00.663 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.663 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45379c7b:::benchmark_data_smithi188_119427_object100952:head# 2024-04-01T19:43:00.663 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.663 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4537bdc1:::benchmark_data_smithi188_119427_object110712:head# 2024-04-01T19:43:00.663 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.663 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4537cf05:::benchmark_data_smithi188_119427_object107153:head# 2024-04-01T19:43:00.663 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.663 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4537d911:::benchmark_data_smithi188_119427_object89675:head# 2024-04-01T19:43:00.663 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.663 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45397cbc:::benchmark_data_smithi188_119427_object127432:head# 2024-04-01T19:43:00.663 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.663 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:453a3822:::benchmark_data_smithi188_119427_object110874:head# 2024-04-01T19:43:00.663 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.663 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:453af19b:::benchmark_data_smithi188_119427_object113591:head# 2024-04-01T19:43:00.663 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.664 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:453c0527:::benchmark_data_smithi188_119427_object143719:head# 2024-04-01T19:43:00.664 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.666 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:453c0c87:::benchmark_data_smithi188_119427_object154785:head# 2024-04-01T19:43:00.666 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.666 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:453d6c67:::benchmark_data_smithi188_119427_object148851:head# 2024-04-01T19:43:00.666 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:453dcc15:::benchmark_data_smithi188_119427_object133479:head# 2024-04-01T19:43:00.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:453e31e9:::benchmark_data_smithi188_119427_object95255:head# 2024-04-01T19:43:00.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:453e374d:::benchmark_data_smithi188_119427_object128338:head# 2024-04-01T19:43:00.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:453e5ea5:::benchmark_data_smithi188_119427_object163137:head# 2024-04-01T19:43:00.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:453ee4a7:::benchmark_data_smithi188_119427_object108551:head# 2024-04-01T19:43:00.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:453f931e:::benchmark_data_smithi188_119427_object126601:head# 2024-04-01T19:43:00.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:453fa41c:::benchmark_data_smithi188_119427_object89551:head# 2024-04-01T19:43:00.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:453fcc51:::benchmark_data_smithi188_119427_object112460:head# 2024-04-01T19:43:00.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:453ff3b0:::benchmark_data_smithi188_119427_object154244:head# 2024-04-01T19:43:00.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45421822:::benchmark_data_smithi188_119427_object140110:head# 2024-04-01T19:43:00.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4543f9b2:::benchmark_data_smithi188_119427_object139817:head# 2024-04-01T19:43:00.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45446b67:::benchmark_data_smithi188_119427_object76785:head# 2024-04-01T19:43:00.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4544d700:::benchmark_data_smithi188_119427_object101897:head# 2024-04-01T19:43:00.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.672 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45462363:::benchmark_data_smithi188_119427_object113211:head# 2024-04-01T19:43:00.672 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.673 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45480d0e:::benchmark_data_smithi188_119427_object77650:head# 2024-04-01T19:43:00.673 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.673 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4548de2f:::benchmark_data_smithi188_119427_object101083:head# 2024-04-01T19:43:00.673 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.674 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4549161e:::benchmark_data_smithi188_119427_object138136:head# 2024-04-01T19:43:00.674 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.674 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45499840:::benchmark_data_smithi188_119427_object89158:head# 2024-04-01T19:43:00.674 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.674 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:454a93d3:::benchmark_data_smithi188_119427_object89174:head# 2024-04-01T19:43:00.674 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.675 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:454b1783:::benchmark_data_smithi188_119427_object100035:head# 2024-04-01T19:43:00.675 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.675 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:454ba684:::benchmark_data_smithi188_119427_object109997:head# 2024-04-01T19:43:00.676 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.676 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:454c8e6b:::benchmark_data_smithi188_119427_object124410:head# 2024-04-01T19:43:00.676 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.676 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:454e41dd:::benchmark_data_smithi188_119427_object106898:head# 2024-04-01T19:43:00.676 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.676 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:454e70ae:::benchmark_data_smithi188_119427_object141438:head# 2024-04-01T19:43:00.676 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.683 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:454ec6b1:::benchmark_data_smithi188_119427_object101375:head# 2024-04-01T19:43:00.683 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.688 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45516934:::benchmark_data_smithi188_119427_object110322:head# 2024-04-01T19:43:00.688 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.689 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4552a10b:::benchmark_data_smithi188_119427_object86918:head# 2024-04-01T19:43:00.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.689 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4553aabd:::benchmark_data_smithi188_119427_object72917:head# 2024-04-01T19:43:00.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.689 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45559934:::benchmark_data_smithi188_119427_object129649:head# 2024-04-01T19:43:00.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.689 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4555e7d9:::benchmark_data_smithi188_119427_object90018:head# 2024-04-01T19:43:00.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.689 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:455664e4:::benchmark_data_smithi188_119427_object88981:head# 2024-04-01T19:43:00.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.689 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4556f153:::benchmark_data_smithi188_119427_object137838:head# 2024-04-01T19:43:00.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.689 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:455708f6:::benchmark_data_smithi188_119427_object127733:head# 2024-04-01T19:43:00.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.690 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45582df4:::benchmark_data_smithi188_119427_object91429:head# 2024-04-01T19:43:00.690 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.690 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45594c01:::benchmark_data_smithi188_119427_object123521:head# 2024-04-01T19:43:00.690 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.690 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:455a5bca:::benchmark_data_smithi188_119427_object130871:head# 2024-04-01T19:43:00.690 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.690 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:43:00.691 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:455b2fe1:::benchmark_data_smithi188_119427_object140222:head# 2024-04-01T19:43:00.691 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.691 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:455b79ea:::benchmark_data_smithi188_119427_object81200:head# 2024-04-01T19:43:00.691 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.691 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:455d7e7b:::benchmark_data_smithi188_119427_object141714:head# 2024-04-01T19:43:00.691 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.692 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:455d923e:::benchmark_data_smithi188_119427_object157891:head# 2024-04-01T19:43:00.692 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.692 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:00.693 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:43:00.693 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:455f1b38:::benchmark_data_smithi188_119427_object151366:head# 2024-04-01T19:43:00.693 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.694 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:455fe5fe:::benchmark_data_smithi188_119427_object103016:head# 2024-04-01T19:43:00.694 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.694 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45618db3:::benchmark_data_smithi188_119427_object127484:head# 2024-04-01T19:43:00.694 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.694 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4561d1b3:::benchmark_data_smithi188_119427_object145507:head# 2024-04-01T19:43:00.694 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.696 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4561f6d6:::benchmark_data_smithi188_119427_object88902:head# 2024-04-01T19:43:00.696 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.696 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4562af70:::benchmark_data_smithi188_119427_object117231:head# 2024-04-01T19:43:00.696 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.696 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45641cc4:::benchmark_data_smithi188_119427_object149383:head# 2024-04-01T19:43:00.696 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.696 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:456509f3:::benchmark_data_smithi188_119427_object77775:head# 2024-04-01T19:43:00.696 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45656010:::benchmark_data_smithi188_119427_object154239:head# 2024-04-01T19:43:00.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4565fba1:::benchmark_data_smithi188_119427_object150933:head# 2024-04-01T19:43:00.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.700 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45667b26:::benchmark_data_smithi188_119427_object85104:head# 2024-04-01T19:43:00.700 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4566fa53:::benchmark_data_smithi188_119427_object101712:head# 2024-04-01T19:43:00.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45679514:::benchmark_data_smithi188_119427_object80037:head# 2024-04-01T19:43:00.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45679906:::benchmark_data_smithi188_119427_object109743:head# 2024-04-01T19:43:00.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45686e2f:::benchmark_data_smithi188_119427_object134826:head# 2024-04-01T19:43:00.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4569d5fe:::benchmark_data_smithi188_119427_object118714:head# 2024-04-01T19:43:00.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:456a710b:::benchmark_data_smithi188_119427_object147737:head# 2024-04-01T19:43:00.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:456a9c47:::benchmark_data_smithi188_119427_object137317:head# 2024-04-01T19:43:00.702 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.702 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:456af43f:::benchmark_data_smithi188_119427_object125189:head# 2024-04-01T19:43:00.702 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.702 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:456b0279:::benchmark_data_smithi188_119427_object120784:head# 2024-04-01T19:43:00.702 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.703 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:456c23c1:::benchmark_data_smithi188_119427_object125902:head# 2024-04-01T19:43:00.703 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.703 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:456cdeb2:::benchmark_data_smithi188_119427_object152596:head# 2024-04-01T19:43:00.703 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.703 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:456dd4bd:::benchmark_data_smithi188_119427_object114242:head# 2024-04-01T19:43:00.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:456defb9:::benchmark_data_smithi188_119427_object120685:head# 2024-04-01T19:43:00.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:456df965:::benchmark_data_smithi188_119427_object107774:head# 2024-04-01T19:43:00.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:456ea9ca:::benchmark_data_smithi188_119427_object148078:head# 2024-04-01T19:43:00.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:456eee3f:::benchmark_data_smithi188_119427_object91500:head# 2024-04-01T19:43:00.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:456f5270:::benchmark_data_smithi188_119427_object115002:head# 2024-04-01T19:43:00.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.704 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:456f9a45:::benchmark_data_smithi188_119427_object82083:head# 2024-04-01T19:43:00.704 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.705 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:456fdcfe:::benchmark_data_smithi188_119427_object94411:head# 2024-04-01T19:43:00.705 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.706 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4570063f:::benchmark_data_smithi188_119427_object85851:head# 2024-04-01T19:43:00.706 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.706 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:457133d6:::benchmark_data_smithi188_119427_object106662:head# 2024-04-01T19:43:00.706 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.706 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4571e59a:::benchmark_data_smithi188_119427_object119444:head# 2024-04-01T19:43:00.706 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.706 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45726f8f:::benchmark_data_smithi188_119427_object117003:head# 2024-04-01T19:43:00.706 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.707 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4572c08d:::benchmark_data_smithi188_119427_object142625:head# 2024-04-01T19:43:00.707 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.707 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4572ecbb:::benchmark_data_smithi188_119427_object93487:head# 2024-04-01T19:43:00.707 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.707 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4573743a:::benchmark_data_smithi188_119427_object112843:head# 2024-04-01T19:43:00.707 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.707 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4573cee7:::benchmark_data_smithi188_119427_object152713:head# 2024-04-01T19:43:00.707 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.707 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45740604:::benchmark_data_smithi188_119427_object131133:head# 2024-04-01T19:43:00.707 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.707 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4575aaf4:::benchmark_data_smithi188_119427_object80656:head# 2024-04-01T19:43:00.707 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.708 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4576fade:::benchmark_data_smithi188_119427_object108075:head# 2024-04-01T19:43:00.708 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45778a75:::benchmark_data_smithi188_119427_object146166:head# 2024-04-01T19:43:00.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4578d281:::benchmark_data_smithi188_119427_object91637:head# 2024-04-01T19:43:00.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4578ff32:::benchmark_data_smithi188_119427_object139406:head# 2024-04-01T19:43:00.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4579036d:::benchmark_data_smithi188_119427_object148153:head# 2024-04-01T19:43:00.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:457a1012:::benchmark_data_smithi188_119427_object79963:head# 2024-04-01T19:43:00.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:457ada8c:::benchmark_data_smithi188_119427_object73080:head# 2024-04-01T19:43:00.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:457c1c3b:::benchmark_data_smithi188_119427_object142749:head# 2024-04-01T19:43:00.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.711 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:457c98b1:::benchmark_data_smithi188_119427_object75224:head# 2024-04-01T19:43:00.711 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.711 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:457d83d3:::benchmark_data_smithi188_119427_object139194:head# 2024-04-01T19:43:00.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:457ec28c:::benchmark_data_smithi188_119427_object120089:head# 2024-04-01T19:43:00.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:457fa127:::benchmark_data_smithi188_119427_object88094:head# 2024-04-01T19:43:00.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45804de7:::benchmark_data_smithi188_119427_object146895:head# 2024-04-01T19:43:00.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4580f39e:::benchmark_data_smithi188_119427_object98514:head# 2024-04-01T19:43:00.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:458131d3:::benchmark_data_smithi188_119427_object126070:head# 2024-04-01T19:43:00.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4581737d:::benchmark_data_smithi188_119427_object90334:head# 2024-04-01T19:43:00.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:458186a4:::benchmark_data_smithi188_119427_object104637:head# 2024-04-01T19:43:00.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.713 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45821473:::benchmark_data_smithi188_119427_object120222:head# 2024-04-01T19:43:00.713 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.714 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4582edb8:::benchmark_data_smithi188_119427_object163970:head# 2024-04-01T19:43:00.714 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.714 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:458350d3:::benchmark_data_smithi188_119427_object90548:head# 2024-04-01T19:43:00.714 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.714 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4583a182:::benchmark_data_smithi188_119427_object105823:head# 2024-04-01T19:43:00.714 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.714 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4584ba5d:::benchmark_data_smithi188_119427_object84135:head# 2024-04-01T19:43:00.714 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.714 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4584c265:::benchmark_data_smithi188_119427_object151433:head# 2024-04-01T19:43:00.714 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4585d41d:::benchmark_data_smithi188_119427_object148743:head# 2024-04-01T19:43:00.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45866316:::benchmark_data_smithi188_119427_object102329:head# 2024-04-01T19:43:00.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4589df1b:::benchmark_data_smithi188_119427_object107199:head# 2024-04-01T19:43:00.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.715 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:458b40ac:::benchmark_data_smithi188_119427_object144082:head# 2024-04-01T19:43:00.715 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.716 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:458c53e5:::benchmark_data_smithi188_119427_object91985:head# 2024-04-01T19:43:00.716 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.716 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:458ccdc0:::benchmark_data_smithi188_119427_object109795:head# 2024-04-01T19:43:00.717 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.717 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:458d2572:::benchmark_data_smithi188_119427_object91818:head# 2024-04-01T19:43:00.717 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.717 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:458e67ac:::benchmark_data_smithi188_119427_object104506:head# 2024-04-01T19:43:00.717 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.717 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:459021b2:::benchmark_data_smithi188_119427_object139899:head# 2024-04-01T19:43:00.717 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.717 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45905f2b:::benchmark_data_smithi188_119427_object87119:head# 2024-04-01T19:43:00.717 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.717 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45937f36:::benchmark_data_smithi188_119427_object79437:head# 2024-04-01T19:43:00.717 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.717 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4593fccd:::benchmark_data_smithi188_119427_object158355:head# 2024-04-01T19:43:00.717 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.718 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45943321:::benchmark_data_smithi188_119427_object115168:head# 2024-04-01T19:43:00.718 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.718 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:459733c0:::benchmark_data_smithi188_119427_object132685:head# 2024-04-01T19:43:00.718 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.719 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45973e48:::benchmark_data_smithi188_119427_object134394:head# 2024-04-01T19:43:00.719 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.719 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:459740fc:::benchmark_data_smithi188_119427_object160908:head# 2024-04-01T19:43:00.719 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.719 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45975032:::benchmark_data_smithi188_119427_object137331:head# 2024-04-01T19:43:00.719 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45999d18:::benchmark_data_smithi188_119427_object102630:head# 2024-04-01T19:43:00.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:459a007e:::benchmark_data_smithi188_119427_object134382:head# 2024-04-01T19:43:00.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:459a3f6f:::benchmark_data_smithi188_119427_object100882:head# 2024-04-01T19:43:00.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:459b25e7:::benchmark_data_smithi188_119427_object127757:head# 2024-04-01T19:43:00.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:459c2530:::benchmark_data_smithi188_119427_object108924:head# 2024-04-01T19:43:00.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:459d2604:::benchmark_data_smithi188_119427_object162549:head# 2024-04-01T19:43:00.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:459d9407:::benchmark_data_smithi188_119427_object73600:head# 2024-04-01T19:43:00.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.721 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:459e9f47:::benchmark_data_smithi188_119427_object126515:head# 2024-04-01T19:43:00.721 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:459f9feb:::benchmark_data_smithi188_119427_object115864:head# 2024-04-01T19:43:00.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:459fc477:::benchmark_data_smithi188_119427_object126029:head# 2024-04-01T19:43:00.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45a09212:::benchmark_data_smithi188_119427_object90869:head# 2024-04-01T19:43:00.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45a384de:::benchmark_data_smithi188_119427_object78366:head# 2024-04-01T19:43:00.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45a479d6:::benchmark_data_smithi188_119427_object106649:head# 2024-04-01T19:43:00.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.723 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45a4d81d:::benchmark_data_smithi188_119427_object151882:head# 2024-04-01T19:43:00.723 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.723 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45a63a7f:::benchmark_data_smithi188_119427_object77753:head# 2024-04-01T19:43:00.723 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.723 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45a686ba:::benchmark_data_smithi188_119427_object153004:head# 2024-04-01T19:43:00.723 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.723 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45a69831:::benchmark_data_smithi188_119427_object73640:head# 2024-04-01T19:43:00.723 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.724 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45a80348:::benchmark_data_smithi188_119427_object81423:head# 2024-04-01T19:43:00.724 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.724 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45a8c9b5:::benchmark_data_smithi188_119427_object105883:head# 2024-04-01T19:43:00.724 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.724 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45a97588:::benchmark_data_smithi188_119427_object101263:head# 2024-04-01T19:43:00.724 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.724 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45a9fd2a:::benchmark_data_smithi188_119427_object77095:head# 2024-04-01T19:43:00.724 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.725 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45ab90d7:::benchmark_data_smithi188_119427_object134395:head# 2024-04-01T19:43:00.725 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.725 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45ac2432:::benchmark_data_smithi188_119427_object141505:head# 2024-04-01T19:43:00.725 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.725 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45ace6f2:::benchmark_data_smithi188_119427_object93898:head# 2024-04-01T19:43:00.725 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.725 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45b13881:::benchmark_data_smithi188_119427_object125415:head# 2024-04-01T19:43:00.725 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.726 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45b1c037:::benchmark_data_smithi188_119427_object95110:head# 2024-04-01T19:43:00.726 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.726 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45b2bbc7:::benchmark_data_smithi188_119427_object122348:head# 2024-04-01T19:43:00.726 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.726 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45b32fe0:::benchmark_data_smithi188_119427_object159912:head# 2024-04-01T19:43:00.727 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.727 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45b4245b:::benchmark_data_smithi188_119427_object146506:head# 2024-04-01T19:43:00.727 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.727 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45b48556:::benchmark_data_smithi188_119427_object136482:head# 2024-04-01T19:43:00.727 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.727 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45b4c02f:::benchmark_data_smithi188_119427_object159759:head# 2024-04-01T19:43:00.727 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.727 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45b4d2c3:::benchmark_data_smithi188_119427_object93930:head# 2024-04-01T19:43:00.727 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.727 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45b4ef39:::benchmark_data_smithi188_119427_object89554:head# 2024-04-01T19:43:00.727 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.727 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45b666c9:::benchmark_data_smithi188_119427_object109149:head# 2024-04-01T19:43:00.727 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.729 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45b69d43:::benchmark_data_smithi188_119427_object146260:head# 2024-04-01T19:43:00.729 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.729 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45b735e6:::benchmark_data_smithi188_119427_object122819:head# 2024-04-01T19:43:00.729 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.729 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45b7f11a:::benchmark_data_smithi188_119427_object144815:head# 2024-04-01T19:43:00.729 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.729 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45b8ae74:::benchmark_data_smithi188_119427_object73754:head# 2024-04-01T19:43:00.729 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.729 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45b987f3:::benchmark_data_smithi188_119427_object140529:head# 2024-04-01T19:43:00.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45b9d35a:::benchmark_data_smithi188_119427_object99003:head# 2024-04-01T19:43:00.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45ba0b59:::benchmark_data_smithi188_119427_object112062:head# 2024-04-01T19:43:00.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45ba6fb8:::benchmark_data_smithi188_119427_object155071:head# 2024-04-01T19:43:00.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45baa3e4:::benchmark_data_smithi188_119427_object101442:head# 2024-04-01T19:43:00.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45bc2ac0:::benchmark_data_smithi188_119427_object157710:head# 2024-04-01T19:43:00.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.732 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45bd6cf0:::benchmark_data_smithi188_119427_object141582:head# 2024-04-01T19:43:00.733 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.733 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45bd7785:::benchmark_data_smithi188_119427_object126224:head# 2024-04-01T19:43:00.733 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.733 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45bf9523:::benchmark_data_smithi188_119427_object123246:head# 2024-04-01T19:43:00.733 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.733 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45c00c24:::benchmark_data_smithi188_119427_object108581:head# 2024-04-01T19:43:00.733 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.733 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45c1406d:::benchmark_data_smithi188_119427_object82010:head# 2024-04-01T19:43:00.733 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.733 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45c33bb3:::benchmark_data_smithi188_119427_object98089:head# 2024-04-01T19:43:00.733 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.733 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45c4f6e7:::benchmark_data_smithi188_119427_object148420:head# 2024-04-01T19:43:00.733 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.733 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45c4fbb8:::benchmark_data_smithi188_119427_object140810:head# 2024-04-01T19:43:00.734 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.734 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45c57228:::benchmark_data_smithi188_119427_object86978:head# 2024-04-01T19:43:00.734 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.734 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45c71059:::benchmark_data_smithi188_119427_object130899:head# 2024-04-01T19:43:00.734 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.734 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45c85c71:::benchmark_data_smithi188_119427_object79104:head# 2024-04-01T19:43:00.734 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.734 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45c870d7:::benchmark_data_smithi188_119427_object136093:head# 2024-04-01T19:43:00.734 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.734 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45c99fbc:::benchmark_data_smithi188_119427_object91158:head# 2024-04-01T19:43:00.734 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.734 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45c9c285:::benchmark_data_smithi188_119427_object140624:head# 2024-04-01T19:43:00.734 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.737 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45ca855a:::benchmark_data_smithi188_119427_object155296:head# 2024-04-01T19:43:00.737 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.737 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45cd029c:::benchmark_data_smithi188_119427_object76283:head# 2024-04-01T19:43:00.737 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.737 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45cdece0:::benchmark_data_smithi188_119427_object148021:head# 2024-04-01T19:43:00.737 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.737 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45cdf56b:::benchmark_data_smithi188_119427_object109663:head# 2024-04-01T19:43:00.737 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.737 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45ce47de:::benchmark_data_smithi188_119427_object79792:head# 2024-04-01T19:43:00.737 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.737 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45cea021:::benchmark_data_smithi188_119427_object114318:head# 2024-04-01T19:43:00.737 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.737 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45cea1f8:::benchmark_data_smithi188_119427_object136548:head# 2024-04-01T19:43:00.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45d0bcbb:::benchmark_data_smithi188_119427_object79706:head# 2024-04-01T19:43:00.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45d16bd7:::benchmark_data_smithi188_119427_object100711:head# 2024-04-01T19:43:00.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45d25985:::benchmark_data_smithi188_119427_object83896:head# 2024-04-01T19:43:00.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45d33e90:::benchmark_data_smithi188_119427_object81866:head# 2024-04-01T19:43:00.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45d3ef16:::benchmark_data_smithi188_119427_object137678:head# 2024-04-01T19:43:00.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45d43f9b:::benchmark_data_smithi188_119427_object159327:head# 2024-04-01T19:43:00.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45d4410d:::benchmark_data_smithi188_119427_object122518:head# 2024-04-01T19:43:00.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45d5ea8f:::benchmark_data_smithi188_119427_object120533:head# 2024-04-01T19:43:00.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45d73973:::benchmark_data_smithi188_119427_object81101:head# 2024-04-01T19:43:00.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45d841db:::benchmark_data_smithi188_119427_object142811:head# 2024-04-01T19:43:00.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.742 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45d8e661:::benchmark_data_smithi188_119427_object131085:head# 2024-04-01T19:43:00.742 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.742 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45d9a81a:::benchmark_data_smithi188_119427_object152100:head# 2024-04-01T19:43:00.742 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.742 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45d9da30:::benchmark_data_smithi188_119427_object85026:head# 2024-04-01T19:43:00.743 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.743 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45daa1ab:::benchmark_data_smithi188_119427_object154079:head# 2024-04-01T19:43:00.743 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.743 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45db58df:::benchmark_data_smithi188_119427_object159617:head# 2024-04-01T19:43:00.743 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.743 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45db7ca6:::benchmark_data_smithi188_119427_object140841:head# 2024-04-01T19:43:00.743 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.743 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45dc5683:::benchmark_data_smithi188_119427_object96654:head# 2024-04-01T19:43:00.743 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.743 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45dc79f5:::benchmark_data_smithi188_119427_object123270:head# 2024-04-01T19:43:00.743 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.743 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45dca468:::benchmark_data_smithi188_119427_object108823:head# 2024-04-01T19:43:00.743 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.743 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45dde9fa:::benchmark_data_smithi188_119427_object127481:head# 2024-04-01T19:43:00.744 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.744 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45ddf60f:::benchmark_data_smithi188_119427_object119345:head# 2024-04-01T19:43:00.744 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.744 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45de44af:::benchmark_data_smithi188_119427_object135038:head# 2024-04-01T19:43:00.744 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.744 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45de9e7c:::benchmark_data_smithi188_119427_object109160:head# 2024-04-01T19:43:00.744 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.744 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45df764b:::benchmark_data_smithi188_119427_object94813:head# 2024-04-01T19:43:00.744 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.744 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45df96b5:::benchmark_data_smithi188_119427_object103102:head# 2024-04-01T19:43:00.744 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.744 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45dff806:::benchmark_data_smithi188_119427_object85632:head# 2024-04-01T19:43:00.744 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.744 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45e06337:::benchmark_data_smithi188_119427_object97080:head# 2024-04-01T19:43:00.744 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.745 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45e0b748:::benchmark_data_smithi188_119427_object101160:head# 2024-04-01T19:43:00.745 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.745 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45e3a123:::benchmark_data_smithi188_119427_object92465:head# 2024-04-01T19:43:00.745 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.745 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45e3e343:::benchmark_data_smithi188_119427_object110790:head# 2024-04-01T19:43:00.745 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.745 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45e43929:::benchmark_data_smithi188_119427_object138485:head# 2024-04-01T19:43:00.745 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.748 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45e45b84:::benchmark_data_smithi188_119427_object77977:head# 2024-04-01T19:43:00.748 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.748 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45e4a37d:::benchmark_data_smithi188_119427_object89843:head# 2024-04-01T19:43:00.748 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.748 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45e4cbe3:::benchmark_data_smithi188_119427_object141648:head# 2024-04-01T19:43:00.749 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.749 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45e53242:::benchmark_data_smithi188_119427_object132498:head# 2024-04-01T19:43:00.749 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.749 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45e6acfc:::benchmark_data_smithi188_119427_object150104:head# 2024-04-01T19:43:00.749 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.749 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45e7452c:::benchmark_data_smithi188_119427_object140230:head# 2024-04-01T19:43:00.749 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.749 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45e7a019:::benchmark_data_smithi188_119427_object103242:head# 2024-04-01T19:43:00.749 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.749 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45e968e0:::benchmark_data_smithi188_119427_object124153:head# 2024-04-01T19:43:00.749 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.749 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45e9cd80:::benchmark_data_smithi188_119427_object75512:head# 2024-04-01T19:43:00.749 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.750 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45ea35e2:::benchmark_data_smithi188_119427_object110535:head# 2024-04-01T19:43:00.750 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.750 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45eab3e8:::benchmark_data_smithi188_119427_object105278:head# 2024-04-01T19:43:00.750 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.750 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45ead0f8:::benchmark_data_smithi188_119427_object153921:head# 2024-04-01T19:43:00.750 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.750 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45ec1981:::benchmark_data_smithi188_119427_object95606:head# 2024-04-01T19:43:00.750 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.750 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45ed52b3:::benchmark_data_smithi188_119427_object78835:head# 2024-04-01T19:43:00.750 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.750 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45ef7c9d:::benchmark_data_smithi188_119427_object146487:head# 2024-04-01T19:43:00.750 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.750 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45f06a81:::benchmark_data_smithi188_119427_object94173:head# 2024-04-01T19:43:00.750 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.751 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45f176e8:::benchmark_data_smithi188_119427_object150718:head# 2024-04-01T19:43:00.751 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.751 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45f2319c:::benchmark_data_smithi188_119427_object75907:head# 2024-04-01T19:43:00.751 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.751 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45f377c1:::benchmark_data_smithi188_119427_object88818:head# 2024-04-01T19:43:00.751 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.751 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45f39b41:::benchmark_data_smithi188_119427_object91440:head# 2024-04-01T19:43:00.751 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.751 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45f3fa31:::benchmark_data_smithi188_119427_object140356:head# 2024-04-01T19:43:00.751 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.751 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45f4458b:::benchmark_data_smithi188_119427_object103525:head# 2024-04-01T19:43:00.751 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.751 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45f632c5:::benchmark_data_smithi188_119427_object141666:head# 2024-04-01T19:43:00.751 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.756 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45f688d8:::benchmark_data_smithi188_119427_object114058:head# 2024-04-01T19:43:00.756 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.756 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45f6dfff:::benchmark_data_smithi188_119427_object93639:head# 2024-04-01T19:43:00.756 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.756 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45f757e1:::benchmark_data_smithi188_119427_object148356:head# 2024-04-01T19:43:00.756 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.756 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45f8c169:::benchmark_data_smithi188_119427_object143076:head# 2024-04-01T19:43:00.756 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.756 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45f95236:::benchmark_data_smithi188_119427_object92851:head# 2024-04-01T19:43:00.756 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.756 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45fb6928:::benchmark_data_smithi188_119427_object114961:head# 2024-04-01T19:43:00.757 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.757 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45fbb95e:::benchmark_data_smithi188_119427_object159634:head# 2024-04-01T19:43:00.757 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.757 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45fc40c0:::benchmark_data_smithi188_119427_object155183:head# 2024-04-01T19:43:00.757 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.757 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45fc811e:::benchmark_data_smithi188_119427_object153337:head# 2024-04-01T19:43:00.757 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.757 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45fd1260:::benchmark_data_smithi188_119427_object158213:head# 2024-04-01T19:43:00.757 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.757 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45fdff19:::benchmark_data_smithi188_119427_object138465:head# 2024-04-01T19:43:00.757 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.757 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45ff11c9:::benchmark_data_smithi188_119427_object134507:head# 2024-04-01T19:43:00.757 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45ff3a6a:::benchmark_data_smithi188_119427_object125371:head# 2024-04-01T19:43:00.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:45ff4f06:::benchmark_data_smithi188_119427_object140780:head# 2024-04-01T19:43:00.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46005a9f:::benchmark_data_smithi188_119427_object129985:head# 2024-04-01T19:43:00.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:460157d3:::benchmark_data_smithi188_119427_object159842:head# 2024-04-01T19:43:00.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4602ea76:::benchmark_data_smithi188_119427_object76467:head# 2024-04-01T19:43:00.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4603aff5:::benchmark_data_smithi188_119427_object110505:head# 2024-04-01T19:43:00.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46052052:::benchmark_data_smithi188_119427_object146350:head# 2024-04-01T19:43:00.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.759 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46053eb2:::benchmark_data_smithi188_119427_object138946:head# 2024-04-01T19:43:00.759 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.759 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46057667:::benchmark_data_smithi188_119427_object116331:head# 2024-04-01T19:43:00.759 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.759 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4605dfeb:::benchmark_data_smithi188_119427_object151460:head# 2024-04-01T19:43:00.759 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.759 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4606a024:::benchmark_data_smithi188_119427_object129674:head# 2024-04-01T19:43:00.759 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.759 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46076074:::benchmark_data_smithi188_119427_object161954:head# 2024-04-01T19:43:00.759 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.759 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46084e44:::benchmark_data_smithi188_119427_object101766:head# 2024-04-01T19:43:00.759 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.759 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46086fa6:::benchmark_data_smithi188_119427_object154606:head# 2024-04-01T19:43:00.759 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.759 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:460898f3:::benchmark_data_smithi188_119427_object122397:head# 2024-04-01T19:43:00.760 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.760 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:460926af:::benchmark_data_smithi188_119427_object137994:head# 2024-04-01T19:43:00.760 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.760 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:460a2801:::benchmark_data_smithi188_119427_object105655:head# 2024-04-01T19:43:00.760 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.763 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:460a9998:::benchmark_data_smithi188_119427_object99501:head# 2024-04-01T19:43:00.763 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.763 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:460b8bdc:::benchmark_data_smithi188_119427_object83757:head# 2024-04-01T19:43:00.763 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.763 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:460e716d:::benchmark_data_smithi188_119427_object158270:head# 2024-04-01T19:43:00.763 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.763 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:460fdeed:::benchmark_data_smithi188_119427_object114987:head# 2024-04-01T19:43:00.763 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.763 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4611c652:::benchmark_data_smithi188_119427_object76666:head# 2024-04-01T19:43:00.764 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.764 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4613ef79:::benchmark_data_smithi188_119427_object120983:head# 2024-04-01T19:43:00.764 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.764 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46140d32:::benchmark_data_smithi188_119427_object91165:head# 2024-04-01T19:43:00.764 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.764 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4614cf9d:::benchmark_data_smithi188_119427_object109192:head# 2024-04-01T19:43:00.764 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.764 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46150971:::benchmark_data_smithi188_119427_object128363:head# 2024-04-01T19:43:00.764 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.764 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:461615ce:::benchmark_data_smithi188_119427_object102293:head# 2024-04-01T19:43:00.764 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.764 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:461620e2:::benchmark_data_smithi188_119427_object100350:head# 2024-04-01T19:43:00.764 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.764 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4618eff1:::benchmark_data_smithi188_119427_object78118:head# 2024-04-01T19:43:00.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4619aff8:::benchmark_data_smithi188_119427_object112864:head# 2024-04-01T19:43:00.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:461a744a:::benchmark_data_smithi188_119427_object113059:head# 2024-04-01T19:43:00.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:461ac3b8:::benchmark_data_smithi188_119427_object137537:head# 2024-04-01T19:43:00.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:461c1a82:::benchmark_data_smithi188_119427_object126581:head# 2024-04-01T19:43:00.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:461d77d5:::benchmark_data_smithi188_119427_object95452:head# 2024-04-01T19:43:00.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:461d906d:::benchmark_data_smithi188_119427_object105407:head# 2024-04-01T19:43:00.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:461e5042:::benchmark_data_smithi188_119427_object78818:head# 2024-04-01T19:43:00.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.766 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:461e9500:::benchmark_data_smithi188_119427_object152535:head# 2024-04-01T19:43:00.766 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.766 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:461edc9d:::benchmark_data_smithi188_119427_object136003:head# 2024-04-01T19:43:00.766 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.766 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:461f4ec0:::benchmark_data_smithi188_119427_object79138:head# 2024-04-01T19:43:00.766 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.768 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:461f6684:::benchmark_data_smithi188_119427_object145461:head# 2024-04-01T19:43:00.768 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.768 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46209d8c:::benchmark_data_smithi188_119427_object118216:head# 2024-04-01T19:43:00.768 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.768 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4621b33c:::benchmark_data_smithi188_119427_object101451:head# 2024-04-01T19:43:00.768 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.768 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4623ed56:::benchmark_data_smithi188_119427_object72956:head# 2024-04-01T19:43:00.768 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.768 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4625bfef:::benchmark_data_smithi188_119427_object111774:head# 2024-04-01T19:43:00.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4625ec34:::benchmark_data_smithi188_119427_object147582:head# 2024-04-01T19:43:00.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4626158c:::benchmark_data_smithi188_119427_object112031:head# 2024-04-01T19:43:00.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4629d118:::benchmark_data_smithi188_119427_object75639:head# 2024-04-01T19:43:00.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:462bb946:::benchmark_data_smithi188_119427_object153336:head# 2024-04-01T19:43:00.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:462cb3b1:::benchmark_data_smithi188_119427_object129222:head# 2024-04-01T19:43:00.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:462cf68c:::benchmark_data_smithi188_119427_object111624:head# 2024-04-01T19:43:00.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:462f2be7:::benchmark_data_smithi188_119427_object135925:head# 2024-04-01T19:43:00.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.770 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4630668a:::benchmark_data_smithi188_119427_object101950:head# 2024-04-01T19:43:00.770 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.770 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4631d862:::benchmark_data_smithi188_119427_object102738:head# 2024-04-01T19:43:00.770 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.770 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46328a42:::benchmark_data_smithi188_119427_object134771:head# 2024-04-01T19:43:00.770 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.770 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4632a85b:::benchmark_data_smithi188_119427_object137860:head# 2024-04-01T19:43:00.770 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.770 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4633752d:::benchmark_data_smithi188_119427_object120090:head# 2024-04-01T19:43:00.770 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.771 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46338ff1:::benchmark_data_smithi188_119427_object127201:head# 2024-04-01T19:43:00.771 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46348fd1:::benchmark_data_smithi188_119427_object150784:head# 2024-04-01T19:43:00.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4634c9b4:::benchmark_data_smithi188_119427_object98702:head# 2024-04-01T19:43:00.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46351c67:::benchmark_data_smithi188_119427_object113106:head# 2024-04-01T19:43:00.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4635e8b0:::benchmark_data_smithi188_119427_object130095:head# 2024-04-01T19:43:00.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46370510:::benchmark_data_smithi188_119427_object151659:head# 2024-04-01T19:43:00.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4637d52b:::benchmark_data_smithi188_119427_object148713:head# 2024-04-01T19:43:00.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46385563:::benchmark_data_smithi188_119427_object84036:head# 2024-04-01T19:43:00.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46393c96:::benchmark_data_smithi188_119427_object93979:head# 2024-04-01T19:43:00.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.774 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4639861a:::benchmark_data_smithi188_119427_object121411:head# 2024-04-01T19:43:00.774 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.775 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4639af34:::benchmark_data_smithi188_119427_object92375:head# 2024-04-01T19:43:00.775 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.775 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4639c53c:::benchmark_data_smithi188_119427_object103420:head# 2024-04-01T19:43:00.775 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.775 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4639e33f:::benchmark_data_smithi188_119427_object95230:head# 2024-04-01T19:43:00.776 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.776 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:463a2230:::benchmark_data_smithi188_119427_object93132:head# 2024-04-01T19:43:00.776 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.780 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:463b11a1:::benchmark_data_smithi188_119427_object141596:head# 2024-04-01T19:43:00.780 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.781 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:463b4913:::benchmark_data_smithi188_119427_object156927:head# 2024-04-01T19:43:00.781 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.781 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:463b9586:::benchmark_data_smithi188_119427_object127473:head# 2024-04-01T19:43:00.781 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.782 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:463c5eaf:::benchmark_data_smithi188_119427_object160580:head# 2024-04-01T19:43:00.782 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.782 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:463dceb7:::benchmark_data_smithi188_119427_object142247:head# 2024-04-01T19:43:00.782 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.782 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:463de497:::benchmark_data_smithi188_119427_object160173:head# 2024-04-01T19:43:00.782 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.782 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:463f15fe:::benchmark_data_smithi188_119427_object132807:head# 2024-04-01T19:43:00.782 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.784 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:463f31da:::benchmark_data_smithi188_119427_object118215:head# 2024-04-01T19:43:00.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.784 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46405837:::benchmark_data_smithi188_119427_object131672:head# 2024-04-01T19:43:00.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.784 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46408cc8:::benchmark_data_smithi188_119427_object138030:head# 2024-04-01T19:43:00.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.785 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4640ee71:::benchmark_data_smithi188_119427_object112362:head# 2024-04-01T19:43:00.785 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.785 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46413d0f:::benchmark_data_smithi188_119427_object85878:head# 2024-04-01T19:43:00.785 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.785 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46418da4:::benchmark_data_smithi188_119427_object113410:head# 2024-04-01T19:43:00.785 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.785 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4641b026:::benchmark_data_smithi188_119427_object139090:head# 2024-04-01T19:43:00.785 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.785 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4641defe:::benchmark_data_smithi188_119427_object163545:head# 2024-04-01T19:43:00.785 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4641eb60:::benchmark_data_smithi188_119427_object104058:head# 2024-04-01T19:43:00.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46422f11:::benchmark_data_smithi188_119427_object129966:head# 2024-04-01T19:43:00.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4642e264:::benchmark_data_smithi188_119427_object73356:head# 2024-04-01T19:43:00.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46431e92:::benchmark_data_smithi188_119427_object86760:head# 2024-04-01T19:43:00.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46434568:::benchmark_data_smithi188_119427_object134127:head# 2024-04-01T19:43:00.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4643736b:::benchmark_data_smithi188_119427_object87235:head# 2024-04-01T19:43:00.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4643b16e:::benchmark_data_smithi188_119427_object155817:head# 2024-04-01T19:43:00.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4643b373:::benchmark_data_smithi188_119427_object124466:head# 2024-04-01T19:43:00.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:464410c5:::benchmark_data_smithi188_119427_object120751:head# 2024-04-01T19:43:00.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.789 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:464528f1:::benchmark_data_smithi188_119427_object108947:head# 2024-04-01T19:43:00.789 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.789 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4645ed42:::benchmark_data_smithi188_119427_object111260:head# 2024-04-01T19:43:00.789 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.790 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46477170:::benchmark_data_smithi188_119427_object75190:head# 2024-04-01T19:43:00.790 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.790 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4648c533:::benchmark_data_smithi188_119427_object128207:head# 2024-04-01T19:43:00.790 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.790 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:464b54d9:::benchmark_data_smithi188_119427_object136804:head# 2024-04-01T19:43:00.790 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.790 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:464bacae:::benchmark_data_smithi188_119427_object145346:head# 2024-04-01T19:43:00.790 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.790 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:464c4b27:::benchmark_data_smithi188_119427_object141563:head# 2024-04-01T19:43:00.790 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.790 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:464cf352:::benchmark_data_smithi188_119427_object73958:head# 2024-04-01T19:43:00.790 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.793 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:464d4ccf:::benchmark_data_smithi188_119427_object98784:head# 2024-04-01T19:43:00.793 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.793 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:464f2de7:::benchmark_data_smithi188_119427_object157621:head# 2024-04-01T19:43:00.793 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.793 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:464f392e:::benchmark_data_smithi188_119427_object141874:head# 2024-04-01T19:43:00.793 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.793 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:464fa428:::benchmark_data_smithi188_119427_object152939:head# 2024-04-01T19:43:00.793 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.793 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:464fb8a3:::benchmark_data_smithi188_119427_object132588:head# 2024-04-01T19:43:00.793 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.793 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:464ff507:::benchmark_data_smithi188_119427_object87863:head# 2024-04-01T19:43:00.793 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.793 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4650ec9d:::benchmark_data_smithi188_119427_object95968:head# 2024-04-01T19:43:00.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4650edea:::benchmark_data_smithi188_119427_object130776:head# 2024-04-01T19:43:00.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4651806e:::benchmark_data_smithi188_119427_object123051:head# 2024-04-01T19:43:00.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4651d628:::benchmark_data_smithi188_119427_object144741:head# 2024-04-01T19:43:00.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:465380f8:::benchmark_data_smithi188_119427_object110514:head# 2024-04-01T19:43:00.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4653a20a:::benchmark_data_smithi188_119427_object160126:head# 2024-04-01T19:43:00.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46554a66:::benchmark_data_smithi188_119427_object130496:head# 2024-04-01T19:43:00.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.795 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:43:00.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46557006:::benchmark_data_smithi188_119427_object75821:head# 2024-04-01T19:43:00.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4655d037:::benchmark_data_smithi188_119427_object86126:head# 2024-04-01T19:43:00.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46561e32:::benchmark_data_smithi188_119427_object128964:head# 2024-04-01T19:43:00.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46563660:::benchmark_data_smithi188_119427_object76601:head# 2024-04-01T19:43:00.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46566cd6:::benchmark_data_smithi188_119427_object87876:head# 2024-04-01T19:43:00.797 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.797 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4657536d:::benchmark_data_smithi188_119427_object143758:head# 2024-04-01T19:43:00.797 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.799 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4657ade8:::benchmark_data_smithi188_119427_object158908:head# 2024-04-01T19:43:00.799 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.799 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4657c6fc:::benchmark_data_smithi188_119427_object93008:head# 2024-04-01T19:43:00.799 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.799 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4657fed4:::benchmark_data_smithi188_119427_object143498:head# 2024-04-01T19:43:00.799 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.799 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4658134b:::benchmark_data_smithi188_119427_object80695:head# 2024-04-01T19:43:00.799 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.799 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46598b89:::benchmark_data_smithi188_119427_object103721:head# 2024-04-01T19:43:00.800 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.800 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46599429:::benchmark_data_smithi188_119427_object74016:head# 2024-04-01T19:43:00.800 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.800 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:465b0f51:::benchmark_data_smithi188_119427_object138610:head# 2024-04-01T19:43:00.800 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.800 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:465d3c3a:::benchmark_data_smithi188_119427_object108506:head# 2024-04-01T19:43:00.800 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.800 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:465d7cb6:::benchmark_data_smithi188_119427_object107337:head# 2024-04-01T19:43:00.800 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.800 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:465e1b74:::benchmark_data_smithi188_119427_object94516:head# 2024-04-01T19:43:00.800 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.800 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:465e793e:::benchmark_data_smithi188_119427_object151375:head# 2024-04-01T19:43:00.800 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.800 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:465ed24a:::benchmark_data_smithi188_119427_object157683:head# 2024-04-01T19:43:00.800 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.801 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:465f2114:::benchmark_data_smithi188_119427_object86732:head# 2024-04-01T19:43:00.801 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.802 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:465f3a70:::benchmark_data_smithi188_119427_object115223:head# 2024-04-01T19:43:00.803 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.803 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:465fa618:::benchmark_data_smithi188_119427_object106926:head# 2024-04-01T19:43:00.803 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.803 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:465fb10b:::benchmark_data_smithi188_119427_object83912:head# 2024-04-01T19:43:00.804 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.804 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46607dcf:::benchmark_data_smithi188_119427_object158962:head# 2024-04-01T19:43:00.804 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.804 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4660de04:::benchmark_data_smithi188_119427_object115448:head# 2024-04-01T19:43:00.804 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.809 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:466134a8:::benchmark_data_smithi188_119427_object123229:head# 2024-04-01T19:43:00.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.809 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46615933:::benchmark_data_smithi188_119427_object100489:head# 2024-04-01T19:43:00.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.809 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:466177d1:::benchmark_data_smithi188_119427_object132088:head# 2024-04-01T19:43:00.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.809 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46625413:::benchmark_data_smithi188_119427_object158424:head# 2024-04-01T19:43:00.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.809 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46626cc4:::benchmark_data_smithi188_119427_object120097:head# 2024-04-01T19:43:00.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.810 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46645931:::benchmark_data_smithi188_119427_object145352:head# 2024-04-01T19:43:00.810 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.810 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4664b006:::benchmark_data_smithi188_119427_object91483:head# 2024-04-01T19:43:00.810 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.810 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4664edf3:::benchmark_data_smithi188_119427_object96217:head# 2024-04-01T19:43:00.810 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.810 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46653271:::benchmark_data_smithi188_119427_object114757:head# 2024-04-01T19:43:00.810 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.811 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4667b24f:::benchmark_data_smithi188_119427_object106767:head# 2024-04-01T19:43:00.811 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:466821d2:::benchmark_data_smithi188_119427_object84057:head# 2024-04-01T19:43:00.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4669dafe:::benchmark_data_smithi188_119427_object113279:head# 2024-04-01T19:43:00.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:466a7f17:::benchmark_data_smithi188_119427_object153156:head# 2024-04-01T19:43:00.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:466b82a1:::benchmark_data_smithi188_119427_object104353:head# 2024-04-01T19:43:00.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:466cbf95:::benchmark_data_smithi188_119427_object93276:head# 2024-04-01T19:43:00.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:466d52e0:::benchmark_data_smithi188_119427_object84970:head# 2024-04-01T19:43:00.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:466fae9a:::benchmark_data_smithi188_119427_object113235:head# 2024-04-01T19:43:00.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.813 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4671e9f3:::benchmark_data_smithi188_119427_object79739:head# 2024-04-01T19:43:00.813 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.813 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4672680f:::benchmark_data_smithi188_119427_object77951:head# 2024-04-01T19:43:00.814 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.814 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4673c117:::benchmark_data_smithi188_119427_object84769:head# 2024-04-01T19:43:00.814 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.814 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4673d1cf:::benchmark_data_smithi188_119427_object135300:head# 2024-04-01T19:43:00.814 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.814 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4673f892:::benchmark_data_smithi188_119427_object139732:head# 2024-04-01T19:43:00.814 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.814 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46750dd5:::benchmark_data_smithi188_119427_object75994:head# 2024-04-01T19:43:00.814 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.814 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4675628e:::benchmark_data_smithi188_119427_object100163:head# 2024-04-01T19:43:00.814 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.814 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4676d5c0:::benchmark_data_smithi188_119427_object83009:head# 2024-04-01T19:43:00.814 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.815 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46773dc5:::benchmark_data_smithi188_119427_object84693:head# 2024-04-01T19:43:00.815 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.815 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4677a520:::benchmark_data_smithi188_119427_object133305:head# 2024-04-01T19:43:00.816 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.816 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46783fd5:::benchmark_data_smithi188_119427_object91085:head# 2024-04-01T19:43:00.816 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.816 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4678c41b:::benchmark_data_smithi188_119427_object136954:head# 2024-04-01T19:43:00.816 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.816 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46790f6e:::benchmark_data_smithi188_119427_object162955:head# 2024-04-01T19:43:00.816 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.816 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4679b915:::benchmark_data_smithi188_119427_object133789:head# 2024-04-01T19:43:00.816 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.817 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4679cce8:::benchmark_data_smithi188_119427_object82021:head# 2024-04-01T19:43:00.817 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.817 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:467a7c29:::benchmark_data_smithi188_119427_object108200:head# 2024-04-01T19:43:00.817 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.817 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:467ad4c5:::benchmark_data_smithi188_119427_object158730:head# 2024-04-01T19:43:00.817 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:467b68e1:::benchmark_data_smithi188_119427_object76337:head# 2024-04-01T19:43:00.818 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:467bcdad:::benchmark_data_smithi188_119427_object99836:head# 2024-04-01T19:43:00.818 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:467cc0c3:::benchmark_data_smithi188_119427_object155355:head# 2024-04-01T19:43:00.818 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:467dc03f:::benchmark_data_smithi188_119427_object86321:head# 2024-04-01T19:43:00.818 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.819 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:467e0160:::benchmark_data_smithi188_119427_object115472:head# 2024-04-01T19:43:00.819 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.819 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:467e1d55:::benchmark_data_smithi188_119427_object118992:head# 2024-04-01T19:43:00.819 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.820 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:467e9d7c:::benchmark_data_smithi188_119427_object88079:head# 2024-04-01T19:43:00.820 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.821 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:467fdb77:::benchmark_data_smithi188_119427_object140977:head# 2024-04-01T19:43:00.821 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.821 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46807619:::benchmark_data_smithi188_119427_object159040:head# 2024-04-01T19:43:00.821 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.822 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4681c591:::benchmark_data_smithi188_119427_object133325:head# 2024-04-01T19:43:00.822 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.822 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4681fc7a:::benchmark_data_smithi188_119427_object96490:head# 2024-04-01T19:43:00.822 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.822 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:468237fc:::benchmark_data_smithi188_119427_object123070:head# 2024-04-01T19:43:00.823 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.823 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46825ac1:::benchmark_data_smithi188_119427_object145778:head# 2024-04-01T19:43:00.823 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.823 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46830d92:::benchmark_data_smithi188_119427_object113690:head# 2024-04-01T19:43:00.823 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.823 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4683a000:::benchmark_data_smithi188_119427_object124359:head# 2024-04-01T19:43:00.823 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.824 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46868610:::benchmark_data_smithi188_119427_object145538:head# 2024-04-01T19:43:00.824 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.826 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4686a493:::benchmark_data_smithi188_119427_object116495:head# 2024-04-01T19:43:00.826 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.826 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4686d437:::benchmark_data_smithi188_119427_object132916:head# 2024-04-01T19:43:00.826 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.827 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46870c58:::benchmark_data_smithi188_119427_object155580:head# 2024-04-01T19:43:00.827 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.827 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4688752c:::benchmark_data_smithi188_119427_object109412:head# 2024-04-01T19:43:00.827 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.827 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4688f5e7:::benchmark_data_smithi188_119427_object105873:head# 2024-04-01T19:43:00.827 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.827 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46894bdb:::benchmark_data_smithi188_119427_object160207:head# 2024-04-01T19:43:00.827 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.827 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4689db00:::benchmark_data_smithi188_119427_object83727:head# 2024-04-01T19:43:00.827 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.827 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:468a8ef6:::benchmark_data_smithi188_119427_object99643:head# 2024-04-01T19:43:00.827 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.827 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:468c278f:::benchmark_data_smithi188_119427_object95390:head# 2024-04-01T19:43:00.827 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.829 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:468e67b6:::benchmark_data_smithi188_119427_object151897:head# 2024-04-01T19:43:00.829 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.829 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:468e7294:::benchmark_data_smithi188_119427_object160206:head# 2024-04-01T19:43:00.829 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.829 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:468f4063:::benchmark_data_smithi188_119427_object125406:head# 2024-04-01T19:43:00.830 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.830 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46903910:::benchmark_data_smithi188_119427_object151545:head# 2024-04-01T19:43:00.830 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.830 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:469059a4:::benchmark_data_smithi188_119427_object159332:head# 2024-04-01T19:43:00.830 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.830 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4690d1fb:::benchmark_data_smithi188_119427_object76176:head# 2024-04-01T19:43:00.830 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.830 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46952db4:::benchmark_data_smithi188_119427_object148136:head# 2024-04-01T19:43:00.830 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.830 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46956737:::benchmark_data_smithi188_119427_object153859:head# 2024-04-01T19:43:00.830 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.830 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46971c78:::benchmark_data_smithi188_119427_object122455:head# 2024-04-01T19:43:00.830 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.830 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:469b8a0b:::benchmark_data_smithi188_119427_object150252:head# 2024-04-01T19:43:00.831 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.831 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:469bcf6e:::benchmark_data_smithi188_119427_object107066:head# 2024-04-01T19:43:00.831 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.833 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:469c43e1:::benchmark_data_smithi188_119427_object76872:head# 2024-04-01T19:43:00.833 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.833 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:469d288b:::benchmark_data_smithi188_119427_object98710:head# 2024-04-01T19:43:00.833 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.833 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:469e2d30:::benchmark_data_smithi188_119427_object83770:head# 2024-04-01T19:43:00.833 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.833 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:469eb19e:::benchmark_data_smithi188_119427_object110760:head# 2024-04-01T19:43:00.833 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.833 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46a04349:::benchmark_data_smithi188_119427_object98576:head# 2024-04-01T19:43:00.833 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.833 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46a057fd:::benchmark_data_smithi188_119427_object125200:head# 2024-04-01T19:43:00.833 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.833 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46a06b4a:::benchmark_data_smithi188_119427_object146687:head# 2024-04-01T19:43:00.833 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.834 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46a07394:::benchmark_data_smithi188_119427_object164378:head# 2024-04-01T19:43:00.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.834 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46a11728:::benchmark_data_smithi188_119427_object139559:head# 2024-04-01T19:43:00.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.834 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46a1c268:::benchmark_data_smithi188_119427_object78149:head# 2024-04-01T19:43:00.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.834 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46a25c90:::benchmark_data_smithi188_119427_object76535:head# 2024-04-01T19:43:00.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.834 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46a29b70:::benchmark_data_smithi188_119427_object149903:head# 2024-04-01T19:43:00.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.834 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46a2e58a:::benchmark_data_smithi188_119427_object152310:head# 2024-04-01T19:43:00.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.836 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46a32e7d:::benchmark_data_smithi188_119427_object141758:head# 2024-04-01T19:43:00.836 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.836 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46a3ef27:::benchmark_data_smithi188_119427_object123723:head# 2024-04-01T19:43:00.836 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.836 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46a4a33b:::benchmark_data_smithi188_119427_object131774:head# 2024-04-01T19:43:00.837 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.837 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46a6ea8e:::benchmark_data_smithi188_119427_object80846:head# 2024-04-01T19:43:00.837 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.837 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46a7beb9:::benchmark_data_smithi188_119427_object123230:head# 2024-04-01T19:43:00.837 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.837 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46ab2cf3:::benchmark_data_smithi188_119427_object94858:head# 2024-04-01T19:43:00.837 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.837 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46ac58da:::benchmark_data_smithi188_119427_object93965:head# 2024-04-01T19:43:00.837 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.837 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46acd09f:::benchmark_data_smithi188_119427_object104326:head# 2024-04-01T19:43:00.837 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.837 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46adbf90:::benchmark_data_smithi188_119427_object116593:head# 2024-04-01T19:43:00.837 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.837 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46adf4d5:::benchmark_data_smithi188_119427_object137328:head# 2024-04-01T19:43:00.837 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.838 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46af3e19:::benchmark_data_smithi188_119427_object162359:head# 2024-04-01T19:43:00.838 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.838 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46b11c2a:::benchmark_data_smithi188_119427_object125291:head# 2024-04-01T19:43:00.838 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.839 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46b154fa:::benchmark_data_smithi188_119427_object105237:head# 2024-04-01T19:43:00.839 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.839 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46b2250b:::benchmark_data_smithi188_119427_object150804:head# 2024-04-01T19:43:00.839 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.839 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46b29ff4:::benchmark_data_smithi188_119427_object124196:head# 2024-04-01T19:43:00.840 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.840 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46b36ea3:::benchmark_data_smithi188_119427_object82155:head# 2024-04-01T19:43:00.840 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.840 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46b3c708:::benchmark_data_smithi188_119427_object128251:head# 2024-04-01T19:43:00.840 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.840 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46b3f2ea:::benchmark_data_smithi188_119427_object139236:head# 2024-04-01T19:43:00.840 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.840 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46b480fc:::benchmark_data_smithi188_119427_object111704:head# 2024-04-01T19:43:00.840 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.840 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46b4e48e:::benchmark_data_smithi188_119427_object128352:head# 2024-04-01T19:43:00.840 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.840 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46b678a6:::benchmark_data_smithi188_119427_object156747:head# 2024-04-01T19:43:00.840 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.840 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46b7b061:::benchmark_data_smithi188_119427_object116410:head# 2024-04-01T19:43:00.840 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.842 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46b845a8:::benchmark_data_smithi188_119427_object115783:head# 2024-04-01T19:43:00.842 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.842 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46b8ee88:::benchmark_data_smithi188_119427_object160391:head# 2024-04-01T19:43:00.842 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.842 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46b9e98a:::benchmark_data_smithi188_119427_object112950:head# 2024-04-01T19:43:00.842 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.842 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46b9ed5f:::benchmark_data_smithi188_119427_object153276:head# 2024-04-01T19:43:00.842 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.842 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46ba7c2e:::benchmark_data_smithi188_119427_object87325:head# 2024-04-01T19:43:00.842 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.842 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46ba929b:::benchmark_data_smithi188_119427_object124392:head# 2024-04-01T19:43:00.842 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.843 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46baa90e:::benchmark_data_smithi188_119427_object131179:head# 2024-04-01T19:43:00.843 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.843 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46bb82ba:::benchmark_data_smithi188_119427_object103495:head# 2024-04-01T19:43:00.843 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.843 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:00.844 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46bb8657:::benchmark_data_smithi188_119427_object120152:head# 2024-04-01T19:43:00.844 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.845 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46bb9fe3:::benchmark_data_smithi188_119427_object137199:head# 2024-04-01T19:43:00.845 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.845 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46bbcb98:::benchmark_data_smithi188_119427_object145258:head# 2024-04-01T19:43:00.845 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.845 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46bd2a6c:::benchmark_data_smithi188_119427_object88887:head# 2024-04-01T19:43:00.845 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.845 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46bd4368:::benchmark_data_smithi188_119427_object89767:head# 2024-04-01T19:43:00.845 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.845 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46bf179a:::benchmark_data_smithi188_119427_object102251:head# 2024-04-01T19:43:00.845 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.845 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46c02451:::benchmark_data_smithi188_119427_object72670:head# 2024-04-01T19:43:00.845 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.845 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46c14eed:::benchmark_data_smithi188_119427_object104719:head# 2024-04-01T19:43:00.845 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.846 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46c242ca:::benchmark_data_smithi188_119427_object100410:head# 2024-04-01T19:43:00.846 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.846 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46c56c32:::benchmark_data_smithi188_119427_object156221:head# 2024-04-01T19:43:00.846 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.846 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46c60624:::benchmark_data_smithi188_119427_object104048:head# 2024-04-01T19:43:00.846 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.846 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46c75b8d:::benchmark_data_smithi188_119427_object113835:head# 2024-04-01T19:43:00.846 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.847 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46c8af47:::benchmark_data_smithi188_119427_object140246:head# 2024-04-01T19:43:00.847 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.847 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46cbcae2:::benchmark_data_smithi188_119427_object107755:head# 2024-04-01T19:43:00.848 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.848 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46cc89ed:::benchmark_data_smithi188_119427_object96052:head# 2024-04-01T19:43:00.848 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.848 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46cf4461:::benchmark_data_smithi188_119427_object136476:head# 2024-04-01T19:43:00.848 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.848 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46d1771c:::benchmark_data_smithi188_119427_object162376:head# 2024-04-01T19:43:00.848 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.848 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46d18bdc:::benchmark_data_smithi188_119427_object97998:head# 2024-04-01T19:43:00.848 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.848 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46d1946d:::benchmark_data_smithi188_119427_object129608:head# 2024-04-01T19:43:00.848 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.848 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46d2c440:::benchmark_data_smithi188_119427_object98285:head# 2024-04-01T19:43:00.848 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.848 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46d2eaf8:::benchmark_data_smithi188_119427_object104394:head# 2024-04-01T19:43:00.848 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.849 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46d33214:::benchmark_data_smithi188_119427_object158883:head# 2024-04-01T19:43:00.849 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.850 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46d3c50a:::benchmark_data_smithi188_119427_object129140:head# 2024-04-01T19:43:00.850 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.850 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46d65d04:::benchmark_data_smithi188_119427_object106751:head# 2024-04-01T19:43:00.850 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.850 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46d65eb4:::benchmark_data_smithi188_119427_object127605:head# 2024-04-01T19:43:00.850 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.850 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46d668d4:::benchmark_data_smithi188_119427_object126651:head# 2024-04-01T19:43:00.850 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.851 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46d7f705:::benchmark_data_smithi188_119427_object108907:head# 2024-04-01T19:43:00.851 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.851 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46d85c18:::benchmark_data_smithi188_119427_object86878:head# 2024-04-01T19:43:00.851 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.851 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46d86c67:::benchmark_data_smithi188_119427_object137974:head# 2024-04-01T19:43:00.851 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.851 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46d946df:::benchmark_data_smithi188_119427_object114497:head# 2024-04-01T19:43:00.851 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.851 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46d9acee:::benchmark_data_smithi188_119427_object121613:head# 2024-04-01T19:43:00.851 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.853 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46da379b:::benchmark_data_smithi188_119427_object76343:head# 2024-04-01T19:43:00.853 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.853 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46da9fce:::benchmark_data_smithi188_119427_object137336:head# 2024-04-01T19:43:00.853 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.853 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46db249e:::benchmark_data_smithi188_119427_object78140:head# 2024-04-01T19:43:00.853 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.854 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46dbe4b5:::benchmark_data_smithi188_119427_object117334:head# 2024-04-01T19:43:00.854 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.854 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46df9154:::benchmark_data_smithi188_119427_object156313:head# 2024-04-01T19:43:00.854 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.854 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46e0e2b1:::benchmark_data_smithi188_119427_object93802:head# 2024-04-01T19:43:00.854 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.854 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46e17e2f:::benchmark_data_smithi188_119427_object152608:head# 2024-04-01T19:43:00.854 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.854 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46e17f3c:::benchmark_data_smithi188_119427_object150803:head# 2024-04-01T19:43:00.854 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.854 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46e1a6e1:::benchmark_data_smithi188_119427_object144909:head# 2024-04-01T19:43:00.854 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.854 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46e20695:::benchmark_data_smithi188_119427_object145685:head# 2024-04-01T19:43:00.854 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.854 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46e4f17a:::benchmark_data_smithi188_119427_object125661:head# 2024-04-01T19:43:00.855 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.855 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46e561cc:::benchmark_data_smithi188_119427_object89877:head# 2024-04-01T19:43:00.855 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.856 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46e5e125:::benchmark_data_smithi188_119427_object162816:head# 2024-04-01T19:43:00.856 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.856 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46e66dd5:::benchmark_data_smithi188_119427_object162566:head# 2024-04-01T19:43:00.856 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.856 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46e7adea:::benchmark_data_smithi188_119427_object81809:head# 2024-04-01T19:43:00.857 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.857 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46e8f704:::benchmark_data_smithi188_119427_object137880:head# 2024-04-01T19:43:00.857 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.857 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46e94769:::benchmark_data_smithi188_119427_object138156:head# 2024-04-01T19:43:00.857 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.857 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46e988ce:::benchmark_data_smithi188_119427_object88587:head# 2024-04-01T19:43:00.857 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.857 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46ea5cb9:::benchmark_data_smithi188_119427_object144105:head# 2024-04-01T19:43:00.857 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.857 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46eb74ce:::benchmark_data_smithi188_119427_object75436:head# 2024-04-01T19:43:00.857 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.857 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46ec63c3:::benchmark_data_smithi188_119427_object139197:head# 2024-04-01T19:43:00.857 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.858 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46ed41e4:::benchmark_data_smithi188_119427_object138894:head# 2024-04-01T19:43:00.858 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.859 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46ed5c60:::benchmark_data_smithi188_119427_object87360:head# 2024-04-01T19:43:00.859 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.859 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46eda9a7:::benchmark_data_smithi188_119427_object129422:head# 2024-04-01T19:43:00.859 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.859 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46eedb00:::benchmark_data_smithi188_119427_object106213:head# 2024-04-01T19:43:00.859 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.859 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46f0ed0e:::benchmark_data_smithi188_119427_object161526:head# 2024-04-01T19:43:00.859 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.859 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46f0f288:::benchmark_data_smithi188_119427_object116334:head# 2024-04-01T19:43:00.859 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.859 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46f119ae:::benchmark_data_smithi188_119427_object152555:head# 2024-04-01T19:43:00.859 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.860 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46f16413:::benchmark_data_smithi188_119427_object97275:head# 2024-04-01T19:43:00.860 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.860 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46f1d611:::benchmark_data_smithi188_119427_object88022:head# 2024-04-01T19:43:00.860 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.860 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46f1e0f5:::benchmark_data_smithi188_119427_object121567:head# 2024-04-01T19:43:00.860 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.861 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46f2c984:::benchmark_data_smithi188_119427_object140987:head# 2024-04-01T19:43:00.861 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.863 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46f2d234:::benchmark_data_smithi188_119427_object144383:head# 2024-04-01T19:43:00.863 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.863 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46f39c80:::benchmark_data_smithi188_119427_object106623:head# 2024-04-01T19:43:00.863 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.863 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46f443bf:::benchmark_data_smithi188_119427_object129616:head# 2024-04-01T19:43:00.863 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.863 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46f4ded2:::benchmark_data_smithi188_119427_object80885:head# 2024-04-01T19:43:00.863 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.863 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46f51b49:::benchmark_data_smithi188_119427_object108719:head# 2024-04-01T19:43:00.863 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.863 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46f5ab24:::benchmark_data_smithi188_119427_object74161:head# 2024-04-01T19:43:00.864 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.864 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46f7c433:::benchmark_data_smithi188_119427_object81447:head# 2024-04-01T19:43:00.864 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.864 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46f7ebb9:::benchmark_data_smithi188_119427_object159494:head# 2024-04-01T19:43:00.864 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.864 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46f8b05b:::benchmark_data_smithi188_119427_object111933:head# 2024-04-01T19:43:00.864 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.864 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46f8b770:::benchmark_data_smithi188_119427_object88724:head# 2024-04-01T19:43:00.864 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.864 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46fabe0a:::benchmark_data_smithi188_119427_object125543:head# 2024-04-01T19:43:00.864 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.864 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46fc6d20:::benchmark_data_smithi188_119427_object142123:head# 2024-04-01T19:43:00.864 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.864 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46fd1fd1:::benchmark_data_smithi188_119427_object117921:head# 2024-04-01T19:43:00.864 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.865 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46fd3992:::benchmark_data_smithi188_119427_object95083:head# 2024-04-01T19:43:00.865 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.865 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46fd3cb4:::benchmark_data_smithi188_119427_object86535:head# 2024-04-01T19:43:00.865 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.867 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46fdc310:::benchmark_data_smithi188_119427_object145587:head# 2024-04-01T19:43:00.867 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.868 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:46fe2319:::benchmark_data_smithi188_119427_object145772:head# 2024-04-01T19:43:00.868 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.868 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4700e44a:::benchmark_data_smithi188_119427_object134683:head# 2024-04-01T19:43:00.869 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.869 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4701f6f3:::benchmark_data_smithi188_119427_object112328:head# 2024-04-01T19:43:00.869 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.869 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47031c9f:::benchmark_data_smithi188_119427_object115110:head# 2024-04-01T19:43:00.869 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.870 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4704491e:::benchmark_data_smithi188_119427_object157542:head# 2024-04-01T19:43:00.870 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.870 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4704cd65:::benchmark_data_smithi188_119427_object126675:head# 2024-04-01T19:43:00.870 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.870 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4704cee6:::benchmark_data_smithi188_119427_object88097:head# 2024-04-01T19:43:00.870 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.871 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4705086f:::benchmark_data_smithi188_119427_object85368:head# 2024-04-01T19:43:00.871 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.871 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4705425e:::benchmark_data_smithi188_119427_object97697:head# 2024-04-01T19:43:00.871 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.871 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:470568b1:::benchmark_data_smithi188_119427_object122563:head# 2024-04-01T19:43:00.871 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.875 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47058311:::benchmark_data_smithi188_119427_object162502:head# 2024-04-01T19:43:00.875 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.875 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:470597fb:::benchmark_data_smithi188_119427_object131332:head# 2024-04-01T19:43:00.875 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.879 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:470646fd:::benchmark_data_smithi188_119427_object162086:head# 2024-04-01T19:43:00.879 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.879 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:470694c7:::benchmark_data_smithi188_119427_object85465:head# 2024-04-01T19:43:00.879 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.879 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47080b93:::benchmark_data_smithi188_119427_object96767:head# 2024-04-01T19:43:00.879 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.879 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4709fd2f:::benchmark_data_smithi188_119427_object161220:head# 2024-04-01T19:43:00.879 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.879 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:470aa69a:::benchmark_data_smithi188_119427_object151607:head# 2024-04-01T19:43:00.880 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.880 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:470c0889:::benchmark_data_smithi188_119427_object143569:head# 2024-04-01T19:43:00.880 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.880 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:470ca632:::benchmark_data_smithi188_119427_object146562:head# 2024-04-01T19:43:00.880 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.880 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:470da2a8:::benchmark_data_smithi188_119427_object149851:head# 2024-04-01T19:43:00.880 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.880 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:470df068:::benchmark_data_smithi188_119427_object151870:head# 2024-04-01T19:43:00.880 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.880 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:470eee2e:::benchmark_data_smithi188_119427_object115245:head# 2024-04-01T19:43:00.880 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.880 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:470f26ae:::benchmark_data_smithi188_119427_object109042:head# 2024-04-01T19:43:00.880 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.880 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:470fc0fc:::benchmark_data_smithi188_119427_object82805:head# 2024-04-01T19:43:00.880 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.881 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4710c323:::benchmark_data_smithi188_119427_object159869:head# 2024-04-01T19:43:00.881 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.881 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47125a05:::benchmark_data_smithi188_119427_object101511:head# 2024-04-01T19:43:00.881 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.881 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47127793:::benchmark_data_smithi188_119427_object123794:head# 2024-04-01T19:43:00.881 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.884 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47141a3b:::benchmark_data_smithi188_119427_object85487:head# 2024-04-01T19:43:00.884 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.884 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4716c80c:::benchmark_data_smithi188_119427_object92578:head# 2024-04-01T19:43:00.884 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.884 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4716fb12:::benchmark_data_smithi188_119427_object92514:head# 2024-04-01T19:43:00.884 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.884 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47184e29:::benchmark_data_smithi188_119427_object98788:head# 2024-04-01T19:43:00.884 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.884 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4719416d:::benchmark_data_smithi188_119427_object146403:head# 2024-04-01T19:43:00.885 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.885 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47195cea:::benchmark_data_smithi188_119427_object148173:head# 2024-04-01T19:43:00.885 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.885 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4719f949:::benchmark_data_smithi188_119427_object144307:head# 2024-04-01T19:43:00.885 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.885 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:471a6862:::benchmark_data_smithi188_119427_object134624:head# 2024-04-01T19:43:00.885 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.885 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:471a7f57:::benchmark_data_smithi188_119427_object154268:head# 2024-04-01T19:43:00.885 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.885 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:471b06bc:::benchmark_data_smithi188_119427_object77593:head# 2024-04-01T19:43:00.885 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.885 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:471cf5be:::benchmark_data_smithi188_119427_object96746:head# 2024-04-01T19:43:00.885 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.885 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:471d3eae:::benchmark_data_smithi188_119427_object104584:head# 2024-04-01T19:43:00.885 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.886 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:471d99bf:::benchmark_data_smithi188_119427_object162941:head# 2024-04-01T19:43:00.886 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.886 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:471ddb90:::benchmark_data_smithi188_119427_object127656:head# 2024-04-01T19:43:00.886 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.886 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:471ef0bb:::benchmark_data_smithi188_119427_object87581:head# 2024-04-01T19:43:00.886 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.886 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:471f53d8:::benchmark_data_smithi188_119427_object87161:head# 2024-04-01T19:43:00.886 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.886 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:471fb54b:::benchmark_data_smithi188_119427_object90003:head# 2024-04-01T19:43:00.886 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.886 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47208e07:::benchmark_data_smithi188_119427_object144680:head# 2024-04-01T19:43:00.886 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.890 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4720f224:::benchmark_data_smithi188_119427_object100047:head# 2024-04-01T19:43:00.890 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.890 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47215317:::benchmark_data_smithi188_119427_object123923:head# 2024-04-01T19:43:00.890 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.891 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47222da6:::benchmark_data_smithi188_119427_object87805:head# 2024-04-01T19:43:00.891 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.891 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4722d168:::benchmark_data_smithi188_119427_object143746:head# 2024-04-01T19:43:00.891 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.891 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4724288b:::benchmark_data_smithi188_119427_object120552:head# 2024-04-01T19:43:00.891 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.891 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47257242:::benchmark_data_smithi188_119427_object155193:head# 2024-04-01T19:43:00.891 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.891 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4725920a:::benchmark_data_smithi188_119427_object109683:head# 2024-04-01T19:43:00.891 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.891 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:472615e1:::benchmark_data_smithi188_119427_object132636:head# 2024-04-01T19:43:00.891 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.891 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4726af84:::benchmark_data_smithi188_119427_object85931:head# 2024-04-01T19:43:00.892 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.892 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4726d4fa:::benchmark_data_smithi188_119427_object118410:head# 2024-04-01T19:43:00.892 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.892 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4727003c:::benchmark_data_smithi188_119427_object78356:head# 2024-04-01T19:43:00.892 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.892 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:472727a3:::benchmark_data_smithi188_119427_object148047:head# 2024-04-01T19:43:00.892 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.892 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4728e5c7:::benchmark_data_smithi188_119427_object153192:head# 2024-04-01T19:43:00.892 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.892 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4728ee22:::benchmark_data_smithi188_119427_object74399:head# 2024-04-01T19:43:00.892 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.892 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:472a7ca6:::benchmark_data_smithi188_119427_object128368:head# 2024-04-01T19:43:00.892 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.893 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:472c64a1:::benchmark_data_smithi188_119427_object72718:head# 2024-04-01T19:43:00.893 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.893 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:472ce391:::benchmark_data_smithi188_119427_object155004:head# 2024-04-01T19:43:00.893 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.893 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:472d06ca:::benchmark_data_smithi188_119427_object91249:head# 2024-04-01T19:43:00.893 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.893 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:472e7cfc:::benchmark_data_smithi188_119427_object98338:head# 2024-04-01T19:43:00.893 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.893 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:472f0d28:::benchmark_data_smithi188_119427_object111742:head# 2024-04-01T19:43:00.893 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.893 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:472f95d5:::benchmark_data_smithi188_119427_object126308:head# 2024-04-01T19:43:00.893 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.893 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47302d2b:::benchmark_data_smithi188_119427_object117342:head# 2024-04-01T19:43:00.893 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.893 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:473099b7:::benchmark_data_smithi188_119427_object98098:head# 2024-04-01T19:43:00.894 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.894 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47319094:::benchmark_data_smithi188_119427_object156012:head# 2024-04-01T19:43:00.894 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.894 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:473302b2:::benchmark_data_smithi188_119427_object133713:head# 2024-04-01T19:43:00.894 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.898 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47340e34:::benchmark_data_smithi188_119427_object101716:head# 2024-04-01T19:43:00.898 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.898 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4736e0b1:::benchmark_data_smithi188_119427_object152389:head# 2024-04-01T19:43:00.898 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.898 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4737303f:::benchmark_data_smithi188_119427_object148820:head# 2024-04-01T19:43:00.898 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.898 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47373688:::benchmark_data_smithi188_119427_object132864:head# 2024-04-01T19:43:00.898 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.898 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4737a01d:::benchmark_data_smithi188_119427_object127669:head# 2024-04-01T19:43:00.898 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.899 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4738deda:::benchmark_data_smithi188_119427_object140023:head# 2024-04-01T19:43:00.899 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.899 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:473a8085:::benchmark_data_smithi188_119427_object123145:head# 2024-04-01T19:43:00.899 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.899 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:473a88ba:::benchmark_data_smithi188_119427_object96699:head# 2024-04-01T19:43:00.899 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.899 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:473b2741:::benchmark_data_smithi188_119427_object85721:head# 2024-04-01T19:43:00.899 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.899 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:473bc531:::benchmark_data_smithi188_119427_object132885:head# 2024-04-01T19:43:00.899 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.899 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:473bd0cb:::benchmark_data_smithi188_119427_object89637:head# 2024-04-01T19:43:00.899 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.899 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:473be3cb:::benchmark_data_smithi188_119427_object79649:head# 2024-04-01T19:43:00.899 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.899 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:473be435:::benchmark_data_smithi188_119427_object120672:head# 2024-04-01T19:43:00.900 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.900 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:473c8441:::benchmark_data_smithi188_119427_object123931:head# 2024-04-01T19:43:00.900 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.900 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:473cc2d5:::benchmark_data_smithi188_119427_object82883:head# 2024-04-01T19:43:00.900 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.900 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:473cdbdd:::benchmark_data_smithi188_119427_object113009:head# 2024-04-01T19:43:00.900 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.900 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:473e0cad:::benchmark_data_smithi188_119427_object121460:head# 2024-04-01T19:43:00.900 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.900 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:473e9034:::benchmark_data_smithi188_119427_object117264:head# 2024-04-01T19:43:00.900 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.900 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:473f5136:::benchmark_data_smithi188_119427_object131695:head# 2024-04-01T19:43:00.900 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.900 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47402cf6:::benchmark_data_smithi188_119427_object128785:head# 2024-04-01T19:43:00.900 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.901 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47406acd:::benchmark_data_smithi188_119427_object91029:head# 2024-04-01T19:43:00.901 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.901 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47417027:::benchmark_data_smithi188_119427_object164505:head# 2024-04-01T19:43:00.901 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.901 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4743890c:::benchmark_data_smithi188_119427_object112935:head# 2024-04-01T19:43:00.901 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.901 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4743a072:::benchmark_data_smithi188_119427_object86768:head# 2024-04-01T19:43:00.901 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.901 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4743e321:::benchmark_data_smithi188_119427_object86131:head# 2024-04-01T19:43:00.901 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.901 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47443738:::benchmark_data_smithi188_119427_object133794:head# 2024-04-01T19:43:00.901 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.901 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47457421:::benchmark_data_smithi188_119427_object130248:head# 2024-04-01T19:43:00.901 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.904 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4745b2eb:::benchmark_data_smithi188_119427_object128803:head# 2024-04-01T19:43:00.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.904 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4745e9bb:::benchmark_data_smithi188_119427_object151877:head# 2024-04-01T19:43:00.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.904 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4746db4b:::benchmark_data_smithi188_119427_object94768:head# 2024-04-01T19:43:00.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.904 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4746e1f0:::benchmark_data_smithi188_119427_object121815:head# 2024-04-01T19:43:00.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.904 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:474878f4:::benchmark_data_smithi188_119427_object109107:head# 2024-04-01T19:43:00.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.904 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:474986eb:::benchmark_data_smithi188_119427_object110206:head# 2024-04-01T19:43:00.904 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.905 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47499dd0:::benchmark_data_smithi188_119427_object93172:head# 2024-04-01T19:43:00.905 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.905 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4749bfc3:::benchmark_data_smithi188_119427_object125131:head# 2024-04-01T19:43:00.905 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.905 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4749ee44:::benchmark_data_smithi188_119427_object97730:head# 2024-04-01T19:43:00.905 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.905 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:474b95e0:::benchmark_data_smithi188_119427_object106747:head# 2024-04-01T19:43:00.905 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.905 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:474bffbc:::benchmark_data_smithi188_119427_object101842:head# 2024-04-01T19:43:00.905 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.905 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:474c0511:::benchmark_data_smithi188_119427_object121161:head# 2024-04-01T19:43:00.905 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.905 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:474dffef:::benchmark_data_smithi188_119427_object90168:head# 2024-04-01T19:43:00.906 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.906 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:474e8f9d:::benchmark_data_smithi188_119427_object83304:head# 2024-04-01T19:43:00.906 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.906 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47500739:::benchmark_data_smithi188_119427_object160947:head# 2024-04-01T19:43:00.906 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.906 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4751b248:::benchmark_data_smithi188_119427_object111992:head# 2024-04-01T19:43:00.906 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.906 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:475298d4:::benchmark_data_smithi188_119427_object99267:head# 2024-04-01T19:43:00.906 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.906 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4752e7f2:::benchmark_data_smithi188_119427_object102885:head# 2024-04-01T19:43:00.906 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.907 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47533b24:::benchmark_data_smithi188_119427_object98687:head# 2024-04-01T19:43:00.907 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.907 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47536414:::benchmark_data_smithi188_119427_object118364:head# 2024-04-01T19:43:00.907 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.907 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:475443b3:::benchmark_data_smithi188_119427_object129104:head# 2024-04-01T19:43:00.907 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.908 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4754f5e0:::benchmark_data_smithi188_119427_object95416:head# 2024-04-01T19:43:00.908 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.908 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4754fe5d:::benchmark_data_smithi188_119427_object73237:head# 2024-04-01T19:43:00.908 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.908 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4755981b:::benchmark_data_smithi188_119427_object94984:head# 2024-04-01T19:43:00.908 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.908 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4755c057:::benchmark_data_smithi188_119427_object99131:head# 2024-04-01T19:43:00.908 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.909 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47566be3:::benchmark_data_smithi188_119427_object158822:head# 2024-04-01T19:43:00.909 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.910 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4757abd0:::benchmark_data_smithi188_119427_object117599:head# 2024-04-01T19:43:00.910 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.910 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:475948f8:::benchmark_data_smithi188_119427_object84186:head# 2024-04-01T19:43:00.910 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.911 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4759aff4:::benchmark_data_smithi188_119427_object115638:head# 2024-04-01T19:43:00.911 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.911 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4759e6a6:::benchmark_data_smithi188_119427_object118858:head# 2024-04-01T19:43:00.911 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.912 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:475ac7f3:::benchmark_data_smithi188_119427_object137655:head# 2024-04-01T19:43:00.912 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.912 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:475b20fd:::benchmark_data_smithi188_119427_object102824:head# 2024-04-01T19:43:00.912 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.912 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:475b542f:::benchmark_data_smithi188_119427_object108297:head# 2024-04-01T19:43:00.912 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.913 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:475d3b25:::benchmark_data_smithi188_119427_object73284:head# 2024-04-01T19:43:00.913 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.913 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:475da2ed:::benchmark_data_smithi188_119427_object148489:head# 2024-04-01T19:43:00.913 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.913 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:475e879c:::benchmark_data_smithi188_119427_object157658:head# 2024-04-01T19:43:00.913 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.913 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:475f7068:::benchmark_data_smithi188_119427_object113288:head# 2024-04-01T19:43:00.913 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.913 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:475fd739:::benchmark_data_smithi188_119427_object84405:head# 2024-04-01T19:43:00.913 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.914 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47600e9a:::benchmark_data_smithi188_119427_object116704:head# 2024-04-01T19:43:00.915 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.915 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47604d9a:::benchmark_data_smithi188_119427_object153310:head# 2024-04-01T19:43:00.915 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.915 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47611436:::benchmark_data_smithi188_119427_object96688:head# 2024-04-01T19:43:00.915 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.915 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47612bdd:::benchmark_data_smithi188_119427_object139660:head# 2024-04-01T19:43:00.915 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.915 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:476150e0:::benchmark_data_smithi188_119427_object77401:head# 2024-04-01T19:43:00.915 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.915 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4761a2f0:::benchmark_data_smithi188_119427_object109490:head# 2024-04-01T19:43:00.915 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.915 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:476283ce:::benchmark_data_smithi188_119427_object121949:head# 2024-04-01T19:43:00.915 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.916 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47631e58:::benchmark_data_smithi188_119427_object161639:head# 2024-04-01T19:43:00.916 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.917 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4763f070:::benchmark_data_smithi188_119427_object149318:head# 2024-04-01T19:43:00.917 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.917 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47643d3e:::benchmark_data_smithi188_119427_object112545:head# 2024-04-01T19:43:00.917 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.917 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47649deb:::benchmark_data_smithi188_119427_object128289:head# 2024-04-01T19:43:00.917 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.917 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4764af53:::benchmark_data_smithi188_119427_object92382:head# 2024-04-01T19:43:00.917 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.918 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47650448:::benchmark_data_smithi188_119427_object133079:head# 2024-04-01T19:43:00.918 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.918 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47661a05:::benchmark_data_smithi188_119427_object136509:head# 2024-04-01T19:43:00.918 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.918 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47682f65:::benchmark_data_smithi188_119427_object144789:head# 2024-04-01T19:43:00.918 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.918 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4768667a:::benchmark_data_smithi188_119427_object99543:head# 2024-04-01T19:43:00.918 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.918 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47689fa3:::benchmark_data_smithi188_119427_object132129:head# 2024-04-01T19:43:00.918 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.923 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4768b091:::benchmark_data_smithi188_119427_object145803:head# 2024-04-01T19:43:00.923 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.923 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47693252:::benchmark_data_smithi188_119427_object163218:head# 2024-04-01T19:43:00.923 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.923 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47696511:::benchmark_data_smithi188_119427_object115067:head# 2024-04-01T19:43:00.923 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4769ed8e:::benchmark_data_smithi188_119427_object96513:head# 2024-04-01T19:43:00.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:476a44e3:::benchmark_data_smithi188_119427_object81598:head# 2024-04-01T19:43:00.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:476a8bc5:::benchmark_data_smithi188_119427_object100605:head# 2024-04-01T19:43:00.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:476b6883:::benchmark_data_smithi188_119427_object164217:head# 2024-04-01T19:43:00.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:476bcfde:::benchmark_data_smithi188_119427_object79772:head# 2024-04-01T19:43:00.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:476bf47b:::benchmark_data_smithi188_119427_object95697:head# 2024-04-01T19:43:00.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:476c61c2:::benchmark_data_smithi188_119427_object151488:head# 2024-04-01T19:43:00.925 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.925 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:476c8547:::benchmark_data_smithi188_119427_object90218:head# 2024-04-01T19:43:00.925 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.930 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:476dcec9:::benchmark_data_smithi188_119427_object142730:head# 2024-04-01T19:43:00.930 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.930 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:476def78:::benchmark_data_smithi188_119427_object154859:head# 2024-04-01T19:43:00.930 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.930 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:476e4923:::benchmark_data_smithi188_119427_object114939:head# 2024-04-01T19:43:00.931 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.931 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:476f35fb:::benchmark_data_smithi188_119427_object130533:head# 2024-04-01T19:43:00.931 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.931 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:476f6266:::benchmark_data_smithi188_119427_object86812:head# 2024-04-01T19:43:00.931 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.931 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:476faa36:::benchmark_data_smithi188_119427_object78751:head# 2024-04-01T19:43:00.931 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.931 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:476fdd99:::benchmark_data_smithi188_119427_object101565:head# 2024-04-01T19:43:00.931 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.931 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4770a536:::benchmark_data_smithi188_119427_object81047:head# 2024-04-01T19:43:00.931 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.931 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47710bf0:::benchmark_data_smithi188_119427_object124438:head# 2024-04-01T19:43:00.931 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.932 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4771a5cf:::benchmark_data_smithi188_119427_object124820:head# 2024-04-01T19:43:00.932 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.932 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4772d102:::benchmark_data_smithi188_119427_object131955:head# 2024-04-01T19:43:00.932 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.932 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4774fad2:::benchmark_data_smithi188_119427_object143128:head# 2024-04-01T19:43:00.932 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.932 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47756493:::benchmark_data_smithi188_119427_object73067:head# 2024-04-01T19:43:00.932 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.932 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:477592dd:::benchmark_data_smithi188_119427_object131340:head# 2024-04-01T19:43:00.932 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4775e821:::benchmark_data_smithi188_119427_object139112:head# 2024-04-01T19:43:00.935 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4775f5d2:::benchmark_data_smithi188_119427_object115299:head# 2024-04-01T19:43:00.936 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.936 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:477644c6:::benchmark_data_smithi188_119427_object100203:head# 2024-04-01T19:43:00.936 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.936 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47766b4b:::benchmark_data_smithi188_119427_object122830:head# 2024-04-01T19:43:00.936 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.936 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4777a858:::benchmark_data_smithi188_119427_object109669:head# 2024-04-01T19:43:00.936 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.936 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47780f38:::benchmark_data_smithi188_119427_object89783:head# 2024-04-01T19:43:00.936 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.936 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47781775:::benchmark_data_smithi188_119427_object86762:head# 2024-04-01T19:43:00.936 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.936 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:477949c5:::benchmark_data_smithi188_119427_object123672:head# 2024-04-01T19:43:00.936 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.938 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:477a8980:::benchmark_data_smithi188_119427_object117460:head# 2024-04-01T19:43:00.938 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.938 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:477c146a:::benchmark_data_smithi188_119427_object141224:head# 2024-04-01T19:43:00.938 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.938 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:477dca40:::benchmark_data_smithi188_119427_object107279:head# 2024-04-01T19:43:00.938 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.938 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:477e026b:::benchmark_data_smithi188_119427_object78734:head# 2024-04-01T19:43:00.938 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.938 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:477e9d8b:::benchmark_data_smithi188_119427_object104223:head# 2024-04-01T19:43:00.939 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.939 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:477eadd8:::benchmark_data_smithi188_119427_object76750:head# 2024-04-01T19:43:00.939 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.939 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:477f3a65:::benchmark_data_smithi188_119427_object119056:head# 2024-04-01T19:43:00.939 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.939 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:477f45ac:::benchmark_data_smithi188_119427_object134695:head# 2024-04-01T19:43:00.939 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.940 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4780d535:::benchmark_data_smithi188_119427_object146443:head# 2024-04-01T19:43:00.940 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.940 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4781572d:::benchmark_data_smithi188_119427_object109984:head# 2024-04-01T19:43:00.940 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.940 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47825247:::benchmark_data_smithi188_119427_object139889:head# 2024-04-01T19:43:00.940 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.941 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4783c891:::benchmark_data_smithi188_119427_object156528:head# 2024-04-01T19:43:00.941 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.941 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:478414c5:::benchmark_data_smithi188_119427_object92831:head# 2024-04-01T19:43:00.941 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.941 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47846525:::benchmark_data_smithi188_119427_object134955:head# 2024-04-01T19:43:00.941 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.941 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47848f56:::benchmark_data_smithi188_119427_object147163:head# 2024-04-01T19:43:00.941 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.941 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4784c292:::benchmark_data_smithi188_119427_object129773:head# 2024-04-01T19:43:00.941 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.945 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4785fa0f:::benchmark_data_smithi188_119427_object159460:head# 2024-04-01T19:43:00.945 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.945 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47868840:::benchmark_data_smithi188_119427_object125015:head# 2024-04-01T19:43:00.945 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.945 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4786d7f6:::benchmark_data_smithi188_119427_object77050:head# 2024-04-01T19:43:00.945 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.945 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4786dc9c:::benchmark_data_smithi188_119427_object80176:head# 2024-04-01T19:43:00.945 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.945 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47875a65:::benchmark_data_smithi188_119427_object127052:head# 2024-04-01T19:43:00.945 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.945 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4788e032:::benchmark_data_smithi188_119427_object114667:head# 2024-04-01T19:43:00.946 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.946 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4788fba8:::benchmark_data_smithi188_119427_object82486:head# 2024-04-01T19:43:00.946 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.946 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:478b7e50:::benchmark_data_smithi188_119427_object160704:head# 2024-04-01T19:43:00.946 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.946 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:478c1a89:::benchmark_data_smithi188_119427_object147038:head# 2024-04-01T19:43:00.946 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.946 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:478d0c4a:::benchmark_data_smithi188_119427_object101746:head# 2024-04-01T19:43:00.946 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.946 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:478d45a1:::benchmark_data_smithi188_119427_object162917:head# 2024-04-01T19:43:00.946 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.946 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:478d6f65:::benchmark_data_smithi188_119427_object110543:head# 2024-04-01T19:43:00.946 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.947 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:478d9ef5:::benchmark_data_smithi188_119427_object113047:head# 2024-04-01T19:43:00.947 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.947 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:478e5912:::benchmark_data_smithi188_119427_object123821:head# 2024-04-01T19:43:00.947 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.947 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:478ff185:::benchmark_data_smithi188_119427_object103129:head# 2024-04-01T19:43:00.947 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.947 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4791691b:::benchmark_data_smithi188_119427_object141214:head# 2024-04-01T19:43:00.947 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.949 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4792a10e:::benchmark_data_smithi188_119427_object80476:head# 2024-04-01T19:43:00.949 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.949 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47930e06:::benchmark_data_smithi188_119427_object115076:head# 2024-04-01T19:43:00.949 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.949 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4793f6b3:::benchmark_data_smithi188_119427_object134877:head# 2024-04-01T19:43:00.950 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.950 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47942576:::benchmark_data_smithi188_119427_object124387:head# 2024-04-01T19:43:00.950 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.950 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4795f0e2:::benchmark_data_smithi188_119427_object73570:head# 2024-04-01T19:43:00.950 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.950 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4796040e:::benchmark_data_smithi188_119427_object127767:head# 2024-04-01T19:43:00.950 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.950 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:479656aa:::benchmark_data_smithi188_119427_object91983:head# 2024-04-01T19:43:00.950 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.950 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4796ca84:::benchmark_data_smithi188_119427_object79613:head# 2024-04-01T19:43:00.950 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.951 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4797caca:::benchmark_data_smithi188_119427_object151238:head# 2024-04-01T19:43:00.951 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.951 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4797ec5e:::benchmark_data_smithi188_119427_object129295:head# 2024-04-01T19:43:00.951 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.951 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47983a22:::benchmark_data_smithi188_119427_object109257:head# 2024-04-01T19:43:00.951 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.951 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4799e21a:::benchmark_data_smithi188_119427_object120017:head# 2024-04-01T19:43:00.951 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.951 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:479a9933:::benchmark_data_smithi188_119427_object99367:head# 2024-04-01T19:43:00.951 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.951 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:479ba1f8:::benchmark_data_smithi188_119427_object140482:head# 2024-04-01T19:43:00.951 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.951 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:479bf55b:::benchmark_data_smithi188_119427_object86859:head# 2024-04-01T19:43:00.951 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.952 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:479bfd97:::benchmark_data_smithi188_119427_object95158:head# 2024-04-01T19:43:00.952 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.952 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:479d475b:::benchmark_data_smithi188_119427_object92528:head# 2024-04-01T19:43:00.953 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.953 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:479da22f:::benchmark_data_smithi188_119427_object124925:head# 2024-04-01T19:43:00.953 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.953 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:479e5735:::benchmark_data_smithi188_119427_object102848:head# 2024-04-01T19:43:00.953 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.953 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:479e5a6e:::benchmark_data_smithi188_119427_object96416:head# 2024-04-01T19:43:00.953 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.953 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:479f1334:::benchmark_data_smithi188_119427_object92526:head# 2024-04-01T19:43:00.953 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.953 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47a05a18:::benchmark_data_smithi188_119427_object84007:head# 2024-04-01T19:43:00.954 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.954 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:43:00.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47a09670:::benchmark_data_smithi188_119427_object98393:head# 2024-04-01T19:43:00.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47a0f8da:::benchmark_data_smithi188_119427_object96106:head# 2024-04-01T19:43:00.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47a15339:::benchmark_data_smithi188_119427_object74800:head# 2024-04-01T19:43:00.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47a2f1cb:::benchmark_data_smithi188_119427_object94042:head# 2024-04-01T19:43:00.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47a3b097:::benchmark_data_smithi188_119427_object95754:head# 2024-04-01T19:43:00.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47a61156:::benchmark_data_smithi188_119427_object114296:head# 2024-04-01T19:43:00.956 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.957 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47a62e7b:::benchmark_data_smithi188_119427_object115589:head# 2024-04-01T19:43:00.957 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.957 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47a6d132:::benchmark_data_smithi188_119427_object135000:head# 2024-04-01T19:43:00.957 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.957 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47a9b50b:::benchmark_data_smithi188_119427_object135497:head# 2024-04-01T19:43:00.957 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.957 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47a9cd06:::benchmark_data_smithi188_119427_object154312:head# 2024-04-01T19:43:00.957 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.957 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47aa5a24:::benchmark_data_smithi188_119427_object136395:head# 2024-04-01T19:43:00.957 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.957 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47aafdae:::benchmark_data_smithi188_119427_object134692:head# 2024-04-01T19:43:00.957 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.958 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47ac32b7:::benchmark_data_smithi188_119427_object85047:head# 2024-04-01T19:43:00.958 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.958 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47ac55fc:::benchmark_data_smithi188_119427_object160392:head# 2024-04-01T19:43:00.958 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.961 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:00.961 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:43:00.962 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47af449e:::benchmark_data_smithi188_119427_object150160:head# 2024-04-01T19:43:00.962 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.962 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47af9afb:::benchmark_data_smithi188_119427_object98921:head# 2024-04-01T19:43:00.963 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.963 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47afd866:::benchmark_data_smithi188_119427_object129746:head# 2024-04-01T19:43:00.963 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.964 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47b0e92f:::benchmark_data_smithi188_119427_object153758:head# 2024-04-01T19:43:00.964 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.964 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47b106de:::benchmark_data_smithi188_119427_object105365:head# 2024-04-01T19:43:00.964 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.964 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47b28d9b:::benchmark_data_smithi188_119427_object162213:head# 2024-04-01T19:43:00.964 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.964 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47b56b44:::benchmark_data_smithi188_119427_object135651:head# 2024-04-01T19:43:00.964 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.964 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47b6435f:::benchmark_data_smithi188_119427_object95476:head# 2024-04-01T19:43:00.965 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.966 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47b6fe18:::benchmark_data_smithi188_119427_object163769:head# 2024-04-01T19:43:00.966 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.966 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47b7a451:::benchmark_data_smithi188_119427_object105556:head# 2024-04-01T19:43:00.966 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.966 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47b9f08e:::benchmark_data_smithi188_119427_object100523:head# 2024-04-01T19:43:00.966 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.966 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47bac0e3:::benchmark_data_smithi188_119427_object92149:head# 2024-04-01T19:43:00.966 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.967 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47bae31c:::benchmark_data_smithi188_119427_object127212:head# 2024-04-01T19:43:00.967 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.967 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47bc9e09:::benchmark_data_smithi188_119427_object138668:head# 2024-04-01T19:43:00.967 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.968 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47bd4f7f:::benchmark_data_smithi188_119427_object147845:head# 2024-04-01T19:43:00.968 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.969 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47bd53a1:::benchmark_data_smithi188_119427_object98290:head# 2024-04-01T19:43:00.969 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.969 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47bd5832:::benchmark_data_smithi188_119427_object154962:head# 2024-04-01T19:43:00.969 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.969 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47bd59ae:::benchmark_data_smithi188_119427_object136380:head# 2024-04-01T19:43:00.969 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.969 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47be68c3:::benchmark_data_smithi188_119427_object100154:head# 2024-04-01T19:43:00.969 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.969 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47bee74b:::benchmark_data_smithi188_119427_object117945:head# 2024-04-01T19:43:00.969 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.969 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47bfd012:::benchmark_data_smithi188_119427_object78088:head# 2024-04-01T19:43:00.969 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.969 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47c08de9:::benchmark_data_smithi188_119427_object121347:head# 2024-04-01T19:43:00.969 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.970 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47c23a09:::benchmark_data_smithi188_119427_object85211:head# 2024-04-01T19:43:00.970 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.971 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47c2e477:::benchmark_data_smithi188_119427_object160605:head# 2024-04-01T19:43:00.971 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.971 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47c4d8bd:::benchmark_data_smithi188_119427_object152507:head# 2024-04-01T19:43:00.971 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.971 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47c511ef:::benchmark_data_smithi188_119427_object82835:head# 2024-04-01T19:43:00.971 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.971 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47c58946:::benchmark_data_smithi188_119427_object94918:head# 2024-04-01T19:43:00.971 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.971 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47c59d7d:::benchmark_data_smithi188_119427_object84799:head# 2024-04-01T19:43:00.971 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47c637e0:::benchmark_data_smithi188_119427_object105649:head# 2024-04-01T19:43:00.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47c6623c:::benchmark_data_smithi188_119427_object131549:head# 2024-04-01T19:43:00.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47c6792e:::benchmark_data_smithi188_119427_object130070:head# 2024-04-01T19:43:00.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47c6b348:::benchmark_data_smithi188_119427_object96126:head# 2024-04-01T19:43:00.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.974 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47c81e48:::benchmark_data_smithi188_119427_object115710:head# 2024-04-01T19:43:00.974 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.974 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47c83ddd:::benchmark_data_smithi188_119427_object161578:head# 2024-04-01T19:43:00.974 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.974 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47c85bc2:::benchmark_data_smithi188_119427_object146241:head# 2024-04-01T19:43:00.974 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.974 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47c86964:::benchmark_data_smithi188_119427_object76992:head# 2024-04-01T19:43:00.975 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.975 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47c8c74d:::benchmark_data_smithi188_119427_object92481:head# 2024-04-01T19:43:00.975 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.975 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47ca340c:::benchmark_data_smithi188_119427_object139552:head# 2024-04-01T19:43:00.975 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.975 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47ca815a:::benchmark_data_smithi188_119427_object73175:head# 2024-04-01T19:43:00.975 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.975 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47cadf3b:::benchmark_data_smithi188_119427_object131264:head# 2024-04-01T19:43:00.975 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.975 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47cb1a5e:::benchmark_data_smithi188_119427_object132231:head# 2024-04-01T19:43:00.975 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.975 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47cb6586:::benchmark_data_smithi188_119427_object96889:head# 2024-04-01T19:43:00.975 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.975 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47cc7e8a:::benchmark_data_smithi188_119427_object91492:head# 2024-04-01T19:43:00.976 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.976 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47cc88a1:::benchmark_data_smithi188_119427_object131832:head# 2024-04-01T19:43:00.976 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.978 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47cd5e8d:::benchmark_data_smithi188_119427_object117484:head# 2024-04-01T19:43:00.978 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.978 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47cee8a3:::benchmark_data_smithi188_119427_object151285:head# 2024-04-01T19:43:00.978 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.978 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47ceee34:::benchmark_data_smithi188_119427_object119780:head# 2024-04-01T19:43:00.978 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.978 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47d014f7:::benchmark_data_smithi188_119427_object117187:head# 2024-04-01T19:43:00.978 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.979 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47d15dd7:::benchmark_data_smithi188_119427_object129821:head# 2024-04-01T19:43:00.979 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.979 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47d19cf9:::benchmark_data_smithi188_119427_object124635:head# 2024-04-01T19:43:00.979 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.979 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47d1b384:::benchmark_data_smithi188_119427_object78188:head# 2024-04-01T19:43:00.979 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.979 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47d1bd40:::benchmark_data_smithi188_119427_object122880:head# 2024-04-01T19:43:00.979 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.979 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47d1e9ee:::benchmark_data_smithi188_119427_object100456:head# 2024-04-01T19:43:00.979 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.979 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47d2c9a8:::benchmark_data_smithi188_119427_object95463:head# 2024-04-01T19:43:00.979 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.979 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47d34ddd:::benchmark_data_smithi188_119427_object93428:head# 2024-04-01T19:43:00.979 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.979 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47d37267:::benchmark_data_smithi188_119427_object137562:head# 2024-04-01T19:43:00.980 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.980 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47d6744d:::benchmark_data_smithi188_119427_object78961:head# 2024-04-01T19:43:00.980 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.980 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47d760b1:::benchmark_data_smithi188_119427_object120243:head# 2024-04-01T19:43:00.980 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.980 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47d7700d:::benchmark_data_smithi188_119427_object122686:head# 2024-04-01T19:43:00.980 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.984 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47d8f231:::benchmark_data_smithi188_119427_object94998:head# 2024-04-01T19:43:00.984 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.984 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47d98671:::benchmark_data_smithi188_119427_object106441:head# 2024-04-01T19:43:00.984 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.984 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47db3978:::benchmark_data_smithi188_119427_object141237:head# 2024-04-01T19:43:00.985 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.985 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47db4f15:::benchmark_data_smithi188_119427_object96721:head# 2024-04-01T19:43:00.985 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.985 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47db64fd:::benchmark_data_smithi188_119427_object145313:head# 2024-04-01T19:43:00.985 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.985 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47db8202:::benchmark_data_smithi188_119427_object111975:head# 2024-04-01T19:43:00.985 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.985 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47dc507c:::benchmark_data_smithi188_119427_object152473:head# 2024-04-01T19:43:00.985 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.985 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47dd5142:::benchmark_data_smithi188_119427_object96591:head# 2024-04-01T19:43:00.985 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47dee38b:::benchmark_data_smithi188_119427_object124801:head# 2024-04-01T19:43:00.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47df417b:::benchmark_data_smithi188_119427_object161702:head# 2024-04-01T19:43:00.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47e03fcf:::benchmark_data_smithi188_119427_object90874:head# 2024-04-01T19:43:00.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47e0f406:::benchmark_data_smithi188_119427_object82591:head# 2024-04-01T19:43:00.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47e1113d:::benchmark_data_smithi188_119427_object137427:head# 2024-04-01T19:43:00.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47e4d816:::benchmark_data_smithi188_119427_object120995:head# 2024-04-01T19:43:00.986 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47e4d89a:::benchmark_data_smithi188_119427_object77390:head# 2024-04-01T19:43:00.987 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.987 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47e5a396:::benchmark_data_smithi188_119427_object147969:head# 2024-04-01T19:43:00.987 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.987 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47e6fbe4:::benchmark_data_smithi188_119427_object88111:head# 2024-04-01T19:43:00.987 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.987 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47e77fcb:::benchmark_data_smithi188_119427_object95135:head# 2024-04-01T19:43:00.987 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.987 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47e943cc:::benchmark_data_smithi188_119427_object82668:head# 2024-04-01T19:43:00.987 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.989 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47e969be:::benchmark_data_smithi188_119427_object131352:head# 2024-04-01T19:43:00.989 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.989 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47ec6a9e:::benchmark_data_smithi188_119427_object135003:head# 2024-04-01T19:43:00.989 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.989 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47eca39f:::benchmark_data_smithi188_119427_object90303:head# 2024-04-01T19:43:00.989 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.989 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47ecdee8:::benchmark_data_smithi188_119427_object76646:head# 2024-04-01T19:43:00.989 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.990 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47ee60f3:::benchmark_data_smithi188_119427_object120668:head# 2024-04-01T19:43:00.990 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.990 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47ee6c98:::benchmark_data_smithi188_119427_object149373:head# 2024-04-01T19:43:00.990 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.990 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47eeac82:::benchmark_data_smithi188_119427_object88789:head# 2024-04-01T19:43:00.990 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.990 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47eeed81:::benchmark_data_smithi188_119427_object84006:head# 2024-04-01T19:43:00.990 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.990 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47efbf88:::benchmark_data_smithi188_119427_object128459:head# 2024-04-01T19:43:00.990 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.990 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47f0de3c:::benchmark_data_smithi188_119427_object77417:head# 2024-04-01T19:43:00.990 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.990 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47f29584:::benchmark_data_smithi188_119427_object118190:head# 2024-04-01T19:43:00.991 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.991 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47f2cc7d:::benchmark_data_smithi188_119427_object105562:head# 2024-04-01T19:43:00.991 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.991 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47f34abd:::benchmark_data_smithi188_119427_object160782:head# 2024-04-01T19:43:00.991 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.991 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47f46734:::benchmark_data_smithi188_119427_object163492:head# 2024-04-01T19:43:00.991 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.991 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47f4c7e5:::benchmark_data_smithi188_119427_object133682:head# 2024-04-01T19:43:00.991 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.991 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47f586ef:::benchmark_data_smithi188_119427_object82909:head# 2024-04-01T19:43:00.991 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.991 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47f65743:::benchmark_data_smithi188_119427_object94784:head# 2024-04-01T19:43:00.991 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.991 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47f6bf16:::benchmark_data_smithi188_119427_object90135:head# 2024-04-01T19:43:00.991 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.992 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47f78f55:::benchmark_data_smithi188_119427_object90632:head# 2024-04-01T19:43:00.992 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.992 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47f8fdd5:::benchmark_data_smithi188_119427_object141361:head# 2024-04-01T19:43:00.992 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.993 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47f9e797:::benchmark_data_smithi188_119427_object119135:head# 2024-04-01T19:43:00.993 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.994 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47faaabc:::benchmark_data_smithi188_119427_object81442:head# 2024-04-01T19:43:00.994 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.994 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47fb7601:::benchmark_data_smithi188_119427_object154092:head# 2024-04-01T19:43:00.994 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.995 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47fc4638:::benchmark_data_smithi188_119427_object85394:head# 2024-04-01T19:43:00.995 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.995 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47fd33ec:::benchmark_data_smithi188_119427_object122953:head# 2024-04-01T19:43:00.995 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.996 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47fdbd2e:::benchmark_data_smithi188_119427_object160672:head# 2024-04-01T19:43:00.996 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.996 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47fe4c1f:::benchmark_data_smithi188_119427_object90980:head# 2024-04-01T19:43:00.996 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.996 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47ff3f33:::benchmark_data_smithi188_119427_object144195:head# 2024-04-01T19:43:00.996 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.997 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:47ffce18:::benchmark_data_smithi188_119427_object92833:head# 2024-04-01T19:43:00.997 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.997 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48006816:::benchmark_data_smithi188_119427_object103295:head# 2024-04-01T19:43:00.997 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.997 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4800cc8d:::benchmark_data_smithi188_119427_object136810:head# 2024-04-01T19:43:00.997 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.998 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4801bf61:::benchmark_data_smithi188_119427_object150632:head# 2024-04-01T19:43:00.998 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.998 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4803615a:::benchmark_data_smithi188_119427_object74830:head# 2024-04-01T19:43:00.998 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.998 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48051fc8:::benchmark_data_smithi188_119427_object163017:head# 2024-04-01T19:43:00.998 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.998 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48070be0:::benchmark_data_smithi188_119427_object106720:head# 2024-04-01T19:43:00.998 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:00.999 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4807b130:::benchmark_data_smithi188_119427_object105781:head# 2024-04-01T19:43:01.000 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.000 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4807c9c3:::benchmark_data_smithi188_119427_object118677:head# 2024-04-01T19:43:01.000 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.000 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48097606:::benchmark_data_smithi188_119427_object158696:head# 2024-04-01T19:43:01.000 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.000 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:480a92d6:::benchmark_data_smithi188_119427_object118446:head# 2024-04-01T19:43:01.000 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.000 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:480aaf52:::benchmark_data_smithi188_119427_object86849:head# 2024-04-01T19:43:01.000 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.000 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:480ae6a1:::benchmark_data_smithi188_119427_object78579:head# 2024-04-01T19:43:01.000 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.001 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:480b1073:::benchmark_data_smithi188_119427_object106928:head# 2024-04-01T19:43:01.001 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.001 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:480bb568:::benchmark_data_smithi188_119427_object154401:head# 2024-04-01T19:43:01.001 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.001 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:480bedb7:::benchmark_data_smithi188_119427_object91405:head# 2024-04-01T19:43:01.002 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.002 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:480c2bc3:::benchmark_data_smithi188_119427_object75046:head# 2024-04-01T19:43:01.002 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.010 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:480da7da:::benchmark_data_smithi188_119427_object128404:head# 2024-04-01T19:43:01.010 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.010 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:480f192c:::benchmark_data_smithi188_119427_object92026:head# 2024-04-01T19:43:01.010 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.010 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:480f3455:::benchmark_data_smithi188_119427_object105816:head# 2024-04-01T19:43:01.010 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.010 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:480fe0bc:::benchmark_data_smithi188_119427_object152803:head# 2024-04-01T19:43:01.011 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.011 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:481153bf:::benchmark_data_smithi188_119427_object108668:head# 2024-04-01T19:43:01.011 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.011 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48124828:::benchmark_data_smithi188_119427_object149530:head# 2024-04-01T19:43:01.011 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.011 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4813e10a:::benchmark_data_smithi188_119427_object123619:head# 2024-04-01T19:43:01.011 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.011 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48149220:::benchmark_data_smithi188_119427_object111347:head# 2024-04-01T19:43:01.011 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.011 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48156ed6:::benchmark_data_smithi188_119427_object134488:head# 2024-04-01T19:43:01.011 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.011 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4815b12e:::benchmark_data_smithi188_119427_object74813:head# 2024-04-01T19:43:01.011 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.012 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48172fce:::benchmark_data_smithi188_119427_object96894:head# 2024-04-01T19:43:01.012 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.012 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4817d5cd:::benchmark_data_smithi188_119427_object89172:head# 2024-04-01T19:43:01.012 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.012 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4819a4f0:::benchmark_data_smithi188_119427_object113331:head# 2024-04-01T19:43:01.012 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.012 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4819b235:::benchmark_data_smithi188_119427_object122389:head# 2024-04-01T19:43:01.012 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.012 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:481b9e76:::benchmark_data_smithi188_119427_object82863:head# 2024-04-01T19:43:01.012 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.012 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:481c8990:::benchmark_data_smithi188_119427_object135947:head# 2024-04-01T19:43:01.012 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.012 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:481cb308:::benchmark_data_smithi188_119427_object149189:head# 2024-04-01T19:43:01.012 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.013 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:481d5a1b:::benchmark_data_smithi188_119427_object114262:head# 2024-04-01T19:43:01.013 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.013 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:481e8bcf:::benchmark_data_smithi188_119427_object101865:head# 2024-04-01T19:43:01.013 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.013 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:481ecbe1:::benchmark_data_smithi188_119427_object115262:head# 2024-04-01T19:43:01.013 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.013 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:481f1dda:::benchmark_data_smithi188_119427_object127438:head# 2024-04-01T19:43:01.013 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.015 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:481feb6b:::benchmark_data_smithi188_119427_object99859:head# 2024-04-01T19:43:01.015 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.015 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:482086bd:::benchmark_data_smithi188_119427_object116769:head# 2024-04-01T19:43:01.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4821aba2:::benchmark_data_smithi188_119427_object114646:head# 2024-04-01T19:43:01.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48225f13:::benchmark_data_smithi188_119427_object124830:head# 2024-04-01T19:43:01.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4822a3a6:::benchmark_data_smithi188_119427_object156302:head# 2024-04-01T19:43:01.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4822cf7d:::benchmark_data_smithi188_119427_object138671:head# 2024-04-01T19:43:01.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4824a372:::benchmark_data_smithi188_119427_object82932:head# 2024-04-01T19:43:01.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:482557f5:::benchmark_data_smithi188_119427_object106369:head# 2024-04-01T19:43:01.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:482579e5:::benchmark_data_smithi188_119427_object84966:head# 2024-04-01T19:43:01.017 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.017 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4825de1e:::benchmark_data_smithi188_119427_object130825:head# 2024-04-01T19:43:01.017 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.017 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48263581:::benchmark_data_smithi188_119427_object152277:head# 2024-04-01T19:43:01.017 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.017 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48266112:::benchmark_data_smithi188_119427_object163151:head# 2024-04-01T19:43:01.017 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.017 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:482679ac:::benchmark_data_smithi188_119427_object162052:head# 2024-04-01T19:43:01.017 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.017 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4827f176:::benchmark_data_smithi188_119427_object86124:head# 2024-04-01T19:43:01.017 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.017 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4827f89a:::benchmark_data_smithi188_119427_object146772:head# 2024-04-01T19:43:01.017 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.017 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48290587:::benchmark_data_smithi188_119427_object121279:head# 2024-04-01T19:43:01.018 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.018 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48290737:::benchmark_data_smithi188_119427_object137402:head# 2024-04-01T19:43:01.018 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.018 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48294d92:::benchmark_data_smithi188_119427_object130476:head# 2024-04-01T19:43:01.018 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.024 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4829a9f7:::benchmark_data_smithi188_119427_object92429:head# 2024-04-01T19:43:01.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:482ae48b:::benchmark_data_smithi188_119427_object151933:head# 2024-04-01T19:43:01.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:482b98ae:::benchmark_data_smithi188_119427_object137011:head# 2024-04-01T19:43:01.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:482bf36e:::benchmark_data_smithi188_119427_object146582:head# 2024-04-01T19:43:01.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:482c76c0:::benchmark_data_smithi188_119427_object80990:head# 2024-04-01T19:43:01.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:482d792b:::benchmark_data_smithi188_119427_object108084:head# 2024-04-01T19:43:01.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:482ddadb:::benchmark_data_smithi188_119427_object104107:head# 2024-04-01T19:43:01.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:482efaac:::benchmark_data_smithi188_119427_object131760:head# 2024-04-01T19:43:01.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:482f2732:::benchmark_data_smithi188_119427_object139470:head# 2024-04-01T19:43:01.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48305665:::benchmark_data_smithi188_119427_object74143:head# 2024-04-01T19:43:01.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4830f1db:::benchmark_data_smithi188_119427_object105721:head# 2024-04-01T19:43:01.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48323d84:::benchmark_data_smithi188_119427_object126093:head# 2024-04-01T19:43:01.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48324518:::benchmark_data_smithi188_119427_object139117:head# 2024-04-01T19:43:01.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4833199f:::benchmark_data_smithi188_119427_object78185:head# 2024-04-01T19:43:01.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4833c531:::benchmark_data_smithi188_119427_object156181:head# 2024-04-01T19:43:01.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:483409aa:::benchmark_data_smithi188_119427_object106334:head# 2024-04-01T19:43:01.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4834abc0:::benchmark_data_smithi188_119427_object136481:head# 2024-04-01T19:43:01.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48353ddc:::benchmark_data_smithi188_119427_object159834:head# 2024-04-01T19:43:01.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4835977b:::benchmark_data_smithi188_119427_object98603:head# 2024-04-01T19:43:01.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:483681a9:::benchmark_data_smithi188_119427_object80451:head# 2024-04-01T19:43:01.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:483905d3:::benchmark_data_smithi188_119427_object158832:head# 2024-04-01T19:43:01.028 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.028 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48396a57:::benchmark_data_smithi188_119427_object102521:head# 2024-04-01T19:43:01.028 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.028 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:483b9da5:::benchmark_data_smithi188_119427_object145370:head# 2024-04-01T19:43:01.028 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.028 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:483c6fac:::benchmark_data_smithi188_119427_object145654:head# 2024-04-01T19:43:01.028 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.028 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:483cd522:::benchmark_data_smithi188_119427_object99474:head# 2024-04-01T19:43:01.028 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.028 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:483e756b:::benchmark_data_smithi188_119427_object127478:head# 2024-04-01T19:43:01.028 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.028 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:483fbd7e:::benchmark_data_smithi188_119427_object111524:head# 2024-04-01T19:43:01.028 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.028 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48402cc0:::benchmark_data_smithi188_119427_object106032:head# 2024-04-01T19:43:01.028 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.029 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4840cfc6:::benchmark_data_smithi188_119427_object137299:head# 2024-04-01T19:43:01.029 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.029 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48417426:::benchmark_data_smithi188_119427_object85163:head# 2024-04-01T19:43:01.029 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.029 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4841a1a8:::benchmark_data_smithi188_119427_object127415:head# 2024-04-01T19:43:01.029 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.029 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4841c4cc:::benchmark_data_smithi188_119427_object76951:head# 2024-04-01T19:43:01.029 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.029 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4842ba1a:::benchmark_data_smithi188_119427_object115246:head# 2024-04-01T19:43:01.029 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.032 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48440d3d:::benchmark_data_smithi188_119427_object143000:head# 2024-04-01T19:43:01.032 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.032 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4844ead0:::benchmark_data_smithi188_119427_object81488:head# 2024-04-01T19:43:01.032 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.033 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4845ef55:::benchmark_data_smithi188_119427_object101348:head# 2024-04-01T19:43:01.033 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.033 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4846ae04:::benchmark_data_smithi188_119427_object136406:head# 2024-04-01T19:43:01.033 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.033 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4846bbf8:::benchmark_data_smithi188_119427_object151379:head# 2024-04-01T19:43:01.033 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.033 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:484753af:::benchmark_data_smithi188_119427_object151454:head# 2024-04-01T19:43:01.033 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.033 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48475f15:::benchmark_data_smithi188_119427_object92484:head# 2024-04-01T19:43:01.033 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.033 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4847ca56:::benchmark_data_smithi188_119427_object98611:head# 2024-04-01T19:43:01.033 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.033 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4847d474:::benchmark_data_smithi188_119427_object134746:head# 2024-04-01T19:43:01.033 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48486615:::benchmark_data_smithi188_119427_object103691:head# 2024-04-01T19:43:01.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48497a88:::benchmark_data_smithi188_119427_object89888:head# 2024-04-01T19:43:01.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48498a3b:::benchmark_data_smithi188_119427_object100377:head# 2024-04-01T19:43:01.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4849c7eb:::benchmark_data_smithi188_119427_object81505:head# 2024-04-01T19:43:01.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:484a83f8:::benchmark_data_smithi188_119427_object156173:head# 2024-04-01T19:43:01.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:484aa841:::benchmark_data_smithi188_119427_object72793:head# 2024-04-01T19:43:01.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:484aabaa:::benchmark_data_smithi188_119427_object138921:head# 2024-04-01T19:43:01.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.035 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:484acb1d:::benchmark_data_smithi188_119427_object86304:head# 2024-04-01T19:43:01.035 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.035 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:484b0cf1:::benchmark_data_smithi188_119427_object152044:head# 2024-04-01T19:43:01.035 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.035 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:484b4037:::benchmark_data_smithi188_119427_object132224:head# 2024-04-01T19:43:01.035 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.035 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:484ca95c:::benchmark_data_smithi188_119427_object141410:head# 2024-04-01T19:43:01.035 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.040 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:484f3569:::benchmark_data_smithi188_119427_object101448:head# 2024-04-01T19:43:01.040 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.040 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:484f80fa:::benchmark_data_smithi188_119427_object112140:head# 2024-04-01T19:43:01.040 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.040 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:484fa083:::benchmark_data_smithi188_119427_object109117:head# 2024-04-01T19:43:01.040 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.040 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4850837d:::benchmark_data_smithi188_119427_object119016:head# 2024-04-01T19:43:01.040 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.040 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4850f96a:::benchmark_data_smithi188_119427_object127710:head# 2024-04-01T19:43:01.040 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.040 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48514aab:::benchmark_data_smithi188_119427_object155153:head# 2024-04-01T19:43:01.040 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.040 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:485150ac:::benchmark_data_smithi188_119427_object159260:head# 2024-04-01T19:43:01.040 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.041 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48527f27:::benchmark_data_smithi188_119427_object75017:head# 2024-04-01T19:43:01.041 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.041 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48536b8f:::benchmark_data_smithi188_119427_object91033:head# 2024-04-01T19:43:01.041 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.042 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48541350:::benchmark_data_smithi188_119427_object81136:head# 2024-04-01T19:43:01.042 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.042 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48555d96:::benchmark_data_smithi188_119427_object162216:head# 2024-04-01T19:43:01.042 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.042 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:485589af:::benchmark_data_smithi188_119427_object160858:head# 2024-04-01T19:43:01.043 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.043 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4855d4f1:::benchmark_data_smithi188_119427_object162805:head# 2024-04-01T19:43:01.043 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.043 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:485755ee:::benchmark_data_smithi188_119427_object124596:head# 2024-04-01T19:43:01.043 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.043 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48580518:::benchmark_data_smithi188_119427_object115047:head# 2024-04-01T19:43:01.043 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.043 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4858698f:::benchmark_data_smithi188_119427_object107723:head# 2024-04-01T19:43:01.043 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.045 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:43:01.045 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:43:01.045 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 0 2024-04-01T19:43:01.045 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:43:01.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48595ad4:::benchmark_data_smithi188_119427_object92690:head# 2024-04-01T19:43:01.046 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48596b08:::benchmark_data_smithi188_119427_object120120:head# 2024-04-01T19:43:01.046 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.046 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48598f75:::benchmark_data_smithi188_119427_object125998:head# 2024-04-01T19:43:01.046 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.047 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:485991bf:::benchmark_data_smithi188_119427_object110940:head# 2024-04-01T19:43:01.047 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.047 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4859ff7d:::benchmark_data_smithi188_119427_object94370:head# 2024-04-01T19:43:01.048 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.048 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:485a12e6:::benchmark_data_smithi188_119427_object127075:head# 2024-04-01T19:43:01.048 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.048 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:485a15ae:::benchmark_data_smithi188_119427_object77243:head# 2024-04-01T19:43:01.048 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.049 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:485af0c2:::benchmark_data_smithi188_119427_object144223:head# 2024-04-01T19:43:01.049 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.049 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:485b1049:::benchmark_data_smithi188_119427_object126155:head# 2024-04-01T19:43:01.049 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.049 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:485d7b31:::benchmark_data_smithi188_119427_object124411:head# 2024-04-01T19:43:01.049 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.049 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:485da11c:::benchmark_data_smithi188_119427_object83207:head# 2024-04-01T19:43:01.049 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.049 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:485dcda3:::benchmark_data_smithi188_119427_object121467:head# 2024-04-01T19:43:01.050 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.051 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48603cec:::benchmark_data_smithi188_119427_object101157:head# 2024-04-01T19:43:01.051 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.051 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:486148c3:::benchmark_data_smithi188_119427_object134542:head# 2024-04-01T19:43:01.051 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.051 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4862ae98:::benchmark_data_smithi188_119427_object78213:head# 2024-04-01T19:43:01.051 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.051 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4863132b:::benchmark_data_smithi188_119427_object157815:head# 2024-04-01T19:43:01.051 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.051 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48656084:::benchmark_data_smithi188_119427_object110809:head# 2024-04-01T19:43:01.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48658f1a:::benchmark_data_smithi188_119427_object148207:head# 2024-04-01T19:43:01.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4866e24c:::benchmark_data_smithi188_119427_object103425:head# 2024-04-01T19:43:01.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48688dbb:::benchmark_data_smithi188_119427_object89596:head# 2024-04-01T19:43:01.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.053 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48690e13:::benchmark_data_smithi188_119427_object135936:head# 2024-04-01T19:43:01.053 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.053 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:486976d7:::benchmark_data_smithi188_119427_object146838:head# 2024-04-01T19:43:01.054 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.054 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48697e9a:::benchmark_data_smithi188_119427_object94533:head# 2024-04-01T19:43:01.054 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.054 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4869df24:::benchmark_data_smithi188_119427_object105834:head# 2024-04-01T19:43:01.054 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.054 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:486ade74:::benchmark_data_smithi188_119427_object90883:head# 2024-04-01T19:43:01.054 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.054 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:486b12fd:::benchmark_data_smithi188_119427_object153135:head# 2024-04-01T19:43:01.054 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.055 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:486b249f:::benchmark_data_smithi188_119427_object152770:head# 2024-04-01T19:43:01.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.055 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:486da861:::benchmark_data_smithi188_119427_object77690:head# 2024-04-01T19:43:01.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.055 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:486dac6e:::benchmark_data_smithi188_119427_object151616:head# 2024-04-01T19:43:01.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:486f40e0:::benchmark_data_smithi188_119427_object98923:head# 2024-04-01T19:43:01.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:486ff692:::benchmark_data_smithi188_119427_object119277:head# 2024-04-01T19:43:01.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4870c1f0:::benchmark_data_smithi188_119427_object145223:head# 2024-04-01T19:43:01.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4870fee9:::benchmark_data_smithi188_119427_object120575:head# 2024-04-01T19:43:01.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4871d15b:::benchmark_data_smithi188_119427_object108508:head# 2024-04-01T19:43:01.059 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4871eb49:::benchmark_data_smithi188_119427_object109248:head# 2024-04-01T19:43:01.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:487283d6:::benchmark_data_smithi188_119427_object104469:head# 2024-04-01T19:43:01.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4872cef9:::benchmark_data_smithi188_119427_object112267:head# 2024-04-01T19:43:01.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:487355c4:::benchmark_data_smithi188_119427_object152399:head# 2024-04-01T19:43:01.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48741eea:::benchmark_data_smithi188_119427_object109689:head# 2024-04-01T19:43:01.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4874ad8d:::benchmark_data_smithi188_119427_object82664:head# 2024-04-01T19:43:01.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48758f68:::benchmark_data_smithi188_119427_object158162:head# 2024-04-01T19:43:01.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4875a16b:::benchmark_data_smithi188_119427_object127136:head# 2024-04-01T19:43:01.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:487731f7:::benchmark_data_smithi188_119427_object97657:head# 2024-04-01T19:43:01.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4877d0da:::benchmark_data_smithi188_119427_object147974:head# 2024-04-01T19:43:01.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4877e5ea:::benchmark_data_smithi188_119427_object81965:head# 2024-04-01T19:43:01.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48780d80:::benchmark_data_smithi188_119427_object124961:head# 2024-04-01T19:43:01.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4878fbaa:::benchmark_data_smithi188_119427_object143315:head# 2024-04-01T19:43:01.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48794315:::benchmark_data_smithi188_119427_object121270:head# 2024-04-01T19:43:01.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:487a6ccf:::benchmark_data_smithi188_119427_object157902:head# 2024-04-01T19:43:01.062 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.062 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:487aa8d7:::benchmark_data_smithi188_119427_object81168:head# 2024-04-01T19:43:01.062 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.062 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:487cb7e3:::benchmark_data_smithi188_119427_object113237:head# 2024-04-01T19:43:01.062 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.062 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:43:01.065 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:487e5368:::benchmark_data_smithi188_119427_object88221:head# 2024-04-01T19:43:01.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:487e9220:::benchmark_data_smithi188_119427_object112887:head# 2024-04-01T19:43:01.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:487ea136:::benchmark_data_smithi188_119427_object83726:head# 2024-04-01T19:43:01.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:487f2296:::benchmark_data_smithi188_119427_object102882:head# 2024-04-01T19:43:01.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:487f89db:::benchmark_data_smithi188_119427_object114635:head# 2024-04-01T19:43:01.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48801675:::benchmark_data_smithi188_119427_object95789:head# 2024-04-01T19:43:01.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48803965:::benchmark_data_smithi188_119427_object123385:head# 2024-04-01T19:43:01.067 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.067 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4880b937:::benchmark_data_smithi188_119427_object119948:head# 2024-04-01T19:43:01.067 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.067 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:488243ba:::benchmark_data_smithi188_119427_object127046:head# 2024-04-01T19:43:01.067 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.067 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4882bf5e:::benchmark_data_smithi188_119427_object151780:head# 2024-04-01T19:43:01.067 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.067 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48838f8d:::benchmark_data_smithi188_119427_object78836:head# 2024-04-01T19:43:01.067 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.067 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4883acba:::benchmark_data_smithi188_119427_object153853:head# 2024-04-01T19:43:01.067 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.067 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48860623:::benchmark_data_smithi188_119427_object86926:head# 2024-04-01T19:43:01.067 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.067 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48865ca1:::benchmark_data_smithi188_119427_object83298:head# 2024-04-01T19:43:01.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4886c9be:::benchmark_data_smithi188_119427_object77013:head# 2024-04-01T19:43:01.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48876e77:::benchmark_data_smithi188_119427_object85374:head# 2024-04-01T19:43:01.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4888517a:::benchmark_data_smithi188_119427_object92229:head# 2024-04-01T19:43:01.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48886ed2:::benchmark_data_smithi188_119427_object84784:head# 2024-04-01T19:43:01.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:488981dc:::benchmark_data_smithi188_119427_object110184:head# 2024-04-01T19:43:01.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:488a69df:::benchmark_data_smithi188_119427_object123428:head# 2024-04-01T19:43:01.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:488bd8d9:::benchmark_data_smithi188_119427_object119824:head# 2024-04-01T19:43:01.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:488cce3c:::benchmark_data_smithi188_119427_object122436:head# 2024-04-01T19:43:01.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.070 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:488db3ea:::benchmark_data_smithi188_119427_object105594:head# 2024-04-01T19:43:01.070 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.070 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:488e818c:::benchmark_data_smithi188_119427_object99175:head# 2024-04-01T19:43:01.070 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.070 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48903a65:::benchmark_data_smithi188_119427_object119044:head# 2024-04-01T19:43:01.070 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4890cffb:::benchmark_data_smithi188_119427_object123155:head# 2024-04-01T19:43:01.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:489221c8:::benchmark_data_smithi188_119427_object116970:head# 2024-04-01T19:43:01.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4892584b:::benchmark_data_smithi188_119427_object141592:head# 2024-04-01T19:43:01.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4892dff7:::benchmark_data_smithi188_119427_object132994:head# 2024-04-01T19:43:01.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48936d16:::benchmark_data_smithi188_119427_object123368:head# 2024-04-01T19:43:01.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48938c4d:::benchmark_data_smithi188_119427_object164428:head# 2024-04-01T19:43:01.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4893d3b7:::benchmark_data_smithi188_119427_object85837:head# 2024-04-01T19:43:01.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4895904b:::benchmark_data_smithi188_119427_object96362:head# 2024-04-01T19:43:01.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4895b91d:::benchmark_data_smithi188_119427_object73879:head# 2024-04-01T19:43:01.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.075 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4895f8cc:::benchmark_data_smithi188_119427_object82315:head# 2024-04-01T19:43:01.075 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48963d71:::benchmark_data_smithi188_119427_object102355:head# 2024-04-01T19:43:01.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48964170:::benchmark_data_smithi188_119427_object131012:head# 2024-04-01T19:43:01.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4896eb2b:::benchmark_data_smithi188_119427_object155807:head# 2024-04-01T19:43:01.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48989bf5:::benchmark_data_smithi188_119427_object133969:head# 2024-04-01T19:43:01.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4898a768:::benchmark_data_smithi188_119427_object125227:head# 2024-04-01T19:43:01.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48999c69:::benchmark_data_smithi188_119427_object127000:head# 2024-04-01T19:43:01.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.078 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:489a152c:::benchmark_data_smithi188_119427_object94389:head# 2024-04-01T19:43:01.079 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.079 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:489a4e17:::benchmark_data_smithi188_119427_object92866:head# 2024-04-01T19:43:01.079 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.079 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:489afa91:::benchmark_data_smithi188_119427_object99524:head# 2024-04-01T19:43:01.079 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.079 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:489b04ac:::benchmark_data_smithi188_119427_object113246:head# 2024-04-01T19:43:01.079 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.079 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:489c8426:::benchmark_data_smithi188_119427_object151661:head# 2024-04-01T19:43:01.079 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.079 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:489d8824:::benchmark_data_smithi188_119427_object138703:head# 2024-04-01T19:43:01.079 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.079 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:489e54b4:::benchmark_data_smithi188_119427_object83486:head# 2024-04-01T19:43:01.079 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.080 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:489e8b4e:::benchmark_data_smithi188_119427_object72869:head# 2024-04-01T19:43:01.080 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.080 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:489fd435:::benchmark_data_smithi188_119427_object102851:head# 2024-04-01T19:43:01.080 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.080 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48a01301:::benchmark_data_smithi188_119427_object158259:head# 2024-04-01T19:43:01.080 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48a03fb5:::benchmark_data_smithi188_119427_object164138:head# 2024-04-01T19:43:01.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48a08455:::benchmark_data_smithi188_119427_object149688:head# 2024-04-01T19:43:01.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48a091c0:::benchmark_data_smithi188_119427_object133247:head# 2024-04-01T19:43:01.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48a0e80f:::benchmark_data_smithi188_119427_object128254:head# 2024-04-01T19:43:01.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48a134f5:::benchmark_data_smithi188_119427_object99510:head# 2024-04-01T19:43:01.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48a14873:::benchmark_data_smithi188_119427_object94687:head# 2024-04-01T19:43:01.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48a4bae4:::benchmark_data_smithi188_119427_object113664:head# 2024-04-01T19:43:01.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48a6292c:::benchmark_data_smithi188_119427_object137085:head# 2024-04-01T19:43:01.083 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.083 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48a76f09:::benchmark_data_smithi188_119427_object155799:head# 2024-04-01T19:43:01.083 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.083 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48a7c3a5:::benchmark_data_smithi188_119427_object107918:head# 2024-04-01T19:43:01.083 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.084 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48a7eaf9:::benchmark_data_smithi188_119427_object86003:head# 2024-04-01T19:43:01.084 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.084 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48a81c91:::benchmark_data_smithi188_119427_object129681:head# 2024-04-01T19:43:01.084 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.084 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48a8ffa5:::benchmark_data_smithi188_119427_object113215:head# 2024-04-01T19:43:01.084 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.084 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48aa200d:::benchmark_data_smithi188_119427_object142496:head# 2024-04-01T19:43:01.084 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.084 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48aa5006:::benchmark_data_smithi188_119427_object74123:head# 2024-04-01T19:43:01.084 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.085 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48aa7cf6:::benchmark_data_smithi188_119427_object76026:head# 2024-04-01T19:43:01.085 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.085 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48aaf1ca:::benchmark_data_smithi188_119427_object156256:head# 2024-04-01T19:43:01.085 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.086 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48ab08d6:::benchmark_data_smithi188_119427_object143978:head# 2024-04-01T19:43:01.086 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.086 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48ab8989:::benchmark_data_smithi188_119427_object157262:head# 2024-04-01T19:43:01.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.087 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48ad58a8:::benchmark_data_smithi188_119427_object78676:head# 2024-04-01T19:43:01.087 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48af28cf:::benchmark_data_smithi188_119427_object115631:head# 2024-04-01T19:43:01.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48b09261:::benchmark_data_smithi188_119427_object105578:head# 2024-04-01T19:43:01.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48b0d7f8:::benchmark_data_smithi188_119427_object127241:head# 2024-04-01T19:43:01.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.089 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48b11b02:::benchmark_data_smithi188_119427_object149047:head# 2024-04-01T19:43:01.089 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.089 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48b2c37a:::benchmark_data_smithi188_119427_object115767:head# 2024-04-01T19:43:01.090 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.090 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48b39534:::benchmark_data_smithi188_119427_object158880:head# 2024-04-01T19:43:01.090 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.090 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48b46959:::benchmark_data_smithi188_119427_object75367:head# 2024-04-01T19:43:01.090 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.090 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48b495c3:::benchmark_data_smithi188_119427_object147534:head# 2024-04-01T19:43:01.090 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.091 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48b4c993:::benchmark_data_smithi188_119427_object106403:head# 2024-04-01T19:43:01.091 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.091 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48b59c8c:::benchmark_data_smithi188_119427_object127310:head# 2024-04-01T19:43:01.091 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.091 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48b6e49f:::benchmark_data_smithi188_119427_object122409:head# 2024-04-01T19:43:01.091 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.091 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48b7bf06:::benchmark_data_smithi188_119427_object111684:head# 2024-04-01T19:43:01.091 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48b8f7af:::benchmark_data_smithi188_119427_object159475:head# 2024-04-01T19:43:01.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48b968d6:::benchmark_data_smithi188_119427_object110784:head# 2024-04-01T19:43:01.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.094 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48b9a0f3:::benchmark_data_smithi188_119427_object95524:head# 2024-04-01T19:43:01.094 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48bd27a8:::benchmark_data_smithi188_119427_object98145:head# 2024-04-01T19:43:01.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48bd5a86:::benchmark_data_smithi188_119427_object91473:head# 2024-04-01T19:43:01.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.096 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48be6da4:::benchmark_data_smithi188_119427_object151334:head# 2024-04-01T19:43:01.096 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.096 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48bfbe34:::benchmark_data_smithi188_119427_object119497:head# 2024-04-01T19:43:01.096 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.096 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48c1a3fd:::benchmark_data_smithi188_119427_object91243:head# 2024-04-01T19:43:01.097 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.097 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48c1e4f9:::benchmark_data_smithi188_119427_object148582:head# 2024-04-01T19:43:01.097 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.097 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48c202c9:::benchmark_data_smithi188_119427_object140782:head# 2024-04-01T19:43:01.097 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.098 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48c25a2e:::benchmark_data_smithi188_119427_object74573:head# 2024-04-01T19:43:01.098 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.098 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48c320a4:::benchmark_data_smithi188_119427_object157192:head# 2024-04-01T19:43:01.098 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.100 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:01.103 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48c3943a:::benchmark_data_smithi188_119427_object136980:head# 2024-04-01T19:43:01.103 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.104 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48c3fa8f:::benchmark_data_smithi188_119427_object89220:head# 2024-04-01T19:43:01.104 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.104 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48c45193:::benchmark_data_smithi188_119427_object75950:head# 2024-04-01T19:43:01.104 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.104 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48c4eacb:::benchmark_data_smithi188_119427_object78526:head# 2024-04-01T19:43:01.104 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.104 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48c55e66:::benchmark_data_smithi188_119427_object82328:head# 2024-04-01T19:43:01.104 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.104 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48c57e38:::benchmark_data_smithi188_119427_object134439:head# 2024-04-01T19:43:01.104 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.104 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48c607d2:::benchmark_data_smithi188_119427_object77589:head# 2024-04-01T19:43:01.104 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.104 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48c67e33:::benchmark_data_smithi188_119427_object144031:head# 2024-04-01T19:43:01.104 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.105 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48c6e240:::benchmark_data_smithi188_119427_object108135:head# 2024-04-01T19:43:01.105 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.105 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48c7e7de:::benchmark_data_smithi188_119427_object99845:head# 2024-04-01T19:43:01.105 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.105 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48c88e8a:::benchmark_data_smithi188_119427_object102789:head# 2024-04-01T19:43:01.105 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.105 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48c8e299:::benchmark_data_smithi188_119427_object85595:head# 2024-04-01T19:43:01.105 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.110 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48c965ac:::benchmark_data_smithi188_119427_object108913:head# 2024-04-01T19:43:01.110 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.110 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48c96e5f:::benchmark_data_smithi188_119427_object97271:head# 2024-04-01T19:43:01.110 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.110 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48ca9d47:::benchmark_data_smithi188_119427_object80058:head# 2024-04-01T19:43:01.111 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.111 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48cb5fe4:::benchmark_data_smithi188_119427_object102036:head# 2024-04-01T19:43:01.111 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.111 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48cc3cad:::benchmark_data_smithi188_119427_object158855:head# 2024-04-01T19:43:01.111 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.111 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48cca46e:::benchmark_data_smithi188_119427_object105517:head# 2024-04-01T19:43:01.111 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.111 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48cf881f:::benchmark_data_smithi188_119427_object100935:head# 2024-04-01T19:43:01.111 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.111 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48d0bb0a:::benchmark_data_smithi188_119427_object129597:head# 2024-04-01T19:43:01.111 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.113 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48d14ef6:::benchmark_data_smithi188_119427_object129778:head# 2024-04-01T19:43:01.113 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.113 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48d1cc93:::benchmark_data_smithi188_119427_object105601:head# 2024-04-01T19:43:01.113 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.114 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48d28106:::benchmark_data_smithi188_119427_object131980:head# 2024-04-01T19:43:01.114 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.114 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48d2e462:::benchmark_data_smithi188_119427_object157602:head# 2024-04-01T19:43:01.114 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.114 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48d42c80:::benchmark_data_smithi188_119427_object103308:head# 2024-04-01T19:43:01.114 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.114 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48d45e11:::benchmark_data_smithi188_119427_object95755:head# 2024-04-01T19:43:01.114 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.114 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48d4ec43:::benchmark_data_smithi188_119427_object146082:head# 2024-04-01T19:43:01.114 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.114 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48d51d0e:::benchmark_data_smithi188_119427_object104327:head# 2024-04-01T19:43:01.115 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.116 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48d59d52:::benchmark_data_smithi188_119427_object118725:head# 2024-04-01T19:43:01.116 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.116 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48d6d3a2:::benchmark_data_smithi188_119427_object92070:head# 2024-04-01T19:43:01.116 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.116 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48d7a2fc:::benchmark_data_smithi188_119427_object145776:head# 2024-04-01T19:43:01.116 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.116 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48d7c1ac:::benchmark_data_smithi188_119427_object103399:head# 2024-04-01T19:43:01.116 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.116 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48d83db3:::benchmark_data_smithi188_119427_object116553:head# 2024-04-01T19:43:01.116 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.116 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48d8a636:::benchmark_data_smithi188_119427_object150185:head# 2024-04-01T19:43:01.117 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.117 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48d9b6fe:::benchmark_data_smithi188_119427_object121789:head# 2024-04-01T19:43:01.117 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.118 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48da52ab:::benchmark_data_smithi188_119427_object128457:head# 2024-04-01T19:43:01.118 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.119 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48dabd31:::benchmark_data_smithi188_119427_object137450:head# 2024-04-01T19:43:01.119 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.119 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48db2eef:::benchmark_data_smithi188_119427_object151137:head# 2024-04-01T19:43:01.119 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.119 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48dcdb72:::benchmark_data_smithi188_119427_object101671:head# 2024-04-01T19:43:01.119 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.119 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48dd14aa:::benchmark_data_smithi188_119427_object92671:head# 2024-04-01T19:43:01.119 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.119 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48dd9138:::benchmark_data_smithi188_119427_object145205:head# 2024-04-01T19:43:01.119 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.119 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48de9db0:::benchmark_data_smithi188_119427_object116708:head# 2024-04-01T19:43:01.119 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.119 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48e17120:::benchmark_data_smithi188_119427_object102662:head# 2024-04-01T19:43:01.119 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.121 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48e18a43:::benchmark_data_smithi188_119427_object108234:head# 2024-04-01T19:43:01.121 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.121 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48e1bc62:::benchmark_data_smithi188_119427_object107819:head# 2024-04-01T19:43:01.121 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.121 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48e22d16:::benchmark_data_smithi188_119427_object151926:head# 2024-04-01T19:43:01.121 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.121 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48e38ed6:::benchmark_data_smithi188_119427_object103802:head# 2024-04-01T19:43:01.121 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.121 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48e3be5c:::benchmark_data_smithi188_119427_object131988:head# 2024-04-01T19:43:01.121 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.123 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48e52d51:::benchmark_data_smithi188_119427_object102200:head# 2024-04-01T19:43:01.123 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.123 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48e5bc19:::benchmark_data_smithi188_119427_object160722:head# 2024-04-01T19:43:01.123 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.123 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48e5e081:::benchmark_data_smithi188_119427_object130423:head# 2024-04-01T19:43:01.123 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.123 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48e5f97e:::benchmark_data_smithi188_119427_object105437:head# 2024-04-01T19:43:01.123 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.123 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48e69f82:::benchmark_data_smithi188_119427_object130349:head# 2024-04-01T19:43:01.123 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.123 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48e829d8:::benchmark_data_smithi188_119427_object97653:head# 2024-04-01T19:43:01.124 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.124 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48e862ac:::benchmark_data_smithi188_119427_object138188:head# 2024-04-01T19:43:01.124 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.124 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48e8b5bd:::benchmark_data_smithi188_119427_object144359:head# 2024-04-01T19:43:01.124 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48ecde7a:::benchmark_data_smithi188_119427_object74084:head# 2024-04-01T19:43:01.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48ecf605:::benchmark_data_smithi188_119427_object130584:head# 2024-04-01T19:43:01.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48ed5242:::benchmark_data_smithi188_119427_object140990:head# 2024-04-01T19:43:01.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48ed67c3:::benchmark_data_smithi188_119427_object135656:head# 2024-04-01T19:43:01.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48edfb02:::benchmark_data_smithi188_119427_object103669:head# 2024-04-01T19:43:01.128 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.128 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48ee44f2:::benchmark_data_smithi188_119427_object134036:head# 2024-04-01T19:43:01.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48ee9f42:::benchmark_data_smithi188_119427_object101273:head# 2024-04-01T19:43:01.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48eeeb32:::benchmark_data_smithi188_119427_object158195:head# 2024-04-01T19:43:01.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48f01506:::benchmark_data_smithi188_119427_object75449:head# 2024-04-01T19:43:01.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48f09f79:::benchmark_data_smithi188_119427_object158719:head# 2024-04-01T19:43:01.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48f0bcd0:::benchmark_data_smithi188_119427_object150012:head# 2024-04-01T19:43:01.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48f0f9fb:::benchmark_data_smithi188_119427_object119054:head# 2024-04-01T19:43:01.129 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.129 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48f13b08:::benchmark_data_smithi188_119427_object154846:head# 2024-04-01T19:43:01.130 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.130 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48f278cf:::benchmark_data_smithi188_119427_object149098:head# 2024-04-01T19:43:01.130 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.130 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48f2a994:::benchmark_data_smithi188_119427_object156008:head# 2024-04-01T19:43:01.130 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.132 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48f40ccf:::benchmark_data_smithi188_119427_object125387:head# 2024-04-01T19:43:01.132 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.132 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48f4ca49:::benchmark_data_smithi188_119427_object78758:head# 2024-04-01T19:43:01.133 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.133 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48f5517a:::benchmark_data_smithi188_119427_object99218:head# 2024-04-01T19:43:01.133 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.133 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48f55dcf:::benchmark_data_smithi188_119427_object112919:head# 2024-04-01T19:43:01.133 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.133 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48f64a8f:::benchmark_data_smithi188_119427_object73870:head# 2024-04-01T19:43:01.133 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.133 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48f687da:::benchmark_data_smithi188_119427_object116908:head# 2024-04-01T19:43:01.133 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.133 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48f73699:::benchmark_data_smithi188_119427_object159931:head# 2024-04-01T19:43:01.133 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.133 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48f74374:::benchmark_data_smithi188_119427_object75051:head# 2024-04-01T19:43:01.133 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.133 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48f819ed:::benchmark_data_smithi188_119427_object112406:head# 2024-04-01T19:43:01.134 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.134 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48f83e0f:::benchmark_data_smithi188_119427_object76306:head# 2024-04-01T19:43:01.134 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.134 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48f859e8:::benchmark_data_smithi188_119427_object76056:head# 2024-04-01T19:43:01.134 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.134 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48f8ecfc:::benchmark_data_smithi188_119427_object103065:head# 2024-04-01T19:43:01.134 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.134 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48fa9bb6:::benchmark_data_smithi188_119427_object72906:head# 2024-04-01T19:43:01.134 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.135 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48fc586a:::benchmark_data_smithi188_119427_object122644:head# 2024-04-01T19:43:01.136 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.136 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48fdd147:::benchmark_data_smithi188_119427_object138045:head# 2024-04-01T19:43:01.136 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.136 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48fe3fc1:::benchmark_data_smithi188_119427_object142165:head# 2024-04-01T19:43:01.136 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.136 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48fe9043:::benchmark_data_smithi188_119427_object81960:head# 2024-04-01T19:43:01.136 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.136 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48ff8eba:::benchmark_data_smithi188_119427_object154187:head# 2024-04-01T19:43:01.136 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.136 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48ffa356:::benchmark_data_smithi188_119427_object159411:head# 2024-04-01T19:43:01.136 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.136 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:48fff5bd:::benchmark_data_smithi188_119427_object140292:head# 2024-04-01T19:43:01.137 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.137 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:490361f8:::benchmark_data_smithi188_119427_object116177:head# 2024-04-01T19:43:01.137 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.137 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49044104:::benchmark_data_smithi188_119427_object144490:head# 2024-04-01T19:43:01.137 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.137 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4904ddd4:::benchmark_data_smithi188_119427_object160267:head# 2024-04-01T19:43:01.137 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.138 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4904fa9c:::benchmark_data_smithi188_119427_object88625:head# 2024-04-01T19:43:01.138 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.138 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4904fd8d:::benchmark_data_smithi188_119427_object151569:head# 2024-04-01T19:43:01.139 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.139 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49050bf3:::benchmark_data_smithi188_119427_object84407:head# 2024-04-01T19:43:01.139 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.139 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4907731d:::benchmark_data_smithi188_119427_object153089:head# 2024-04-01T19:43:01.139 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.139 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49078842:::benchmark_data_smithi188_119427_object155051:head# 2024-04-01T19:43:01.139 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.139 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4907af0c:::benchmark_data_smithi188_119427_object73573:head# 2024-04-01T19:43:01.139 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.139 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4907bb67:::benchmark_data_smithi188_119427_object103400:head# 2024-04-01T19:43:01.139 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.139 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4908174b:::benchmark_data_smithi188_119427_object149667:head# 2024-04-01T19:43:01.139 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.139 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49092647:::benchmark_data_smithi188_119427_object133897:head# 2024-04-01T19:43:01.140 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4909703f:::benchmark_data_smithi188_119427_object130049:head# 2024-04-01T19:43:01.141 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:490b00fa:::benchmark_data_smithi188_119427_object143874:head# 2024-04-01T19:43:01.141 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:490b0f3f:::benchmark_data_smithi188_119427_object119717:head# 2024-04-01T19:43:01.141 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:490c3a8f:::benchmark_data_smithi188_119427_object121382:head# 2024-04-01T19:43:01.141 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:490c8c4f:::benchmark_data_smithi188_119427_object95356:head# 2024-04-01T19:43:01.141 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.141 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:490c9504:::benchmark_data_smithi188_119427_object103349:head# 2024-04-01T19:43:01.142 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.142 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:490ecd82:::benchmark_data_smithi188_119427_object117703:head# 2024-04-01T19:43:01.142 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.142 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:490f25e4:::benchmark_data_smithi188_119427_object140173:head# 2024-04-01T19:43:01.142 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.142 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4910083b:::benchmark_data_smithi188_119427_object108533:head# 2024-04-01T19:43:01.142 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.143 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49101af2:::benchmark_data_smithi188_119427_object103152:head# 2024-04-01T19:43:01.143 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.144 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:491022fc:::benchmark_data_smithi188_119427_object159984:head# 2024-04-01T19:43:01.144 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.144 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49107d7f:::benchmark_data_smithi188_119427_object163599:head# 2024-04-01T19:43:01.144 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.144 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4911031d:::benchmark_data_smithi188_119427_object147446:head# 2024-04-01T19:43:01.144 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.144 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49118186:::benchmark_data_smithi188_119427_object105191:head# 2024-04-01T19:43:01.144 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.144 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4911d1a7:::benchmark_data_smithi188_119427_object91877:head# 2024-04-01T19:43:01.144 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.144 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4911f1c2:::benchmark_data_smithi188_119427_object104005:head# 2024-04-01T19:43:01.144 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.144 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4912802c:::benchmark_data_smithi188_119427_object109230:head# 2024-04-01T19:43:01.144 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.145 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4913c2fe:::benchmark_data_smithi188_119427_object111822:head# 2024-04-01T19:43:01.145 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.145 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4913d2e2:::benchmark_data_smithi188_119427_object88466:head# 2024-04-01T19:43:01.145 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.147 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49147090:::benchmark_data_smithi188_119427_object73291:head# 2024-04-01T19:43:01.147 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.147 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4919ba74:::benchmark_data_smithi188_119427_object115455:head# 2024-04-01T19:43:01.148 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.148 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:491a7925:::benchmark_data_smithi188_119427_object161402:head# 2024-04-01T19:43:01.148 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.148 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:491a7d08:::benchmark_data_smithi188_119427_object86956:head# 2024-04-01T19:43:01.148 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.148 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:491a855e:::benchmark_data_smithi188_119427_object111011:head# 2024-04-01T19:43:01.148 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.148 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:491ae81d:::benchmark_data_smithi188_119427_object86102:head# 2024-04-01T19:43:01.148 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.148 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:491b2e23:::benchmark_data_smithi188_119427_object133907:head# 2024-04-01T19:43:01.148 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.148 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:491d80e9:::benchmark_data_smithi188_119427_object144836:head# 2024-04-01T19:43:01.148 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.148 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:491dc4d2:::benchmark_data_smithi188_119427_object128684:head# 2024-04-01T19:43:01.149 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.149 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:491ed9dd:::benchmark_data_smithi188_119427_object112690:head# 2024-04-01T19:43:01.149 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.149 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:491f5cf0:::benchmark_data_smithi188_119427_object130631:head# 2024-04-01T19:43:01.149 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.149 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49214305:::benchmark_data_smithi188_119427_object148016:head# 2024-04-01T19:43:01.149 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.149 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49225b6b:::benchmark_data_smithi188_119427_object125586:head# 2024-04-01T19:43:01.149 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.149 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4922ad83:::benchmark_data_smithi188_119427_object113599:head# 2024-04-01T19:43:01.149 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.149 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4925fd1c:::benchmark_data_smithi188_119427_object111488:head# 2024-04-01T19:43:01.149 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.150 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4926487c:::benchmark_data_smithi188_119427_object158202:head# 2024-04-01T19:43:01.150 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.150 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:492674b1:::benchmark_data_smithi188_119427_object122134:head# 2024-04-01T19:43:01.150 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.152 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49275d1e:::benchmark_data_smithi188_119427_object86163:head# 2024-04-01T19:43:01.152 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.152 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49276691:::benchmark_data_smithi188_119427_object74950:head# 2024-04-01T19:43:01.152 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.152 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4929731c:::benchmark_data_smithi188_119427_object127535:head# 2024-04-01T19:43:01.152 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.152 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49298be5:::benchmark_data_smithi188_119427_object73821:head# 2024-04-01T19:43:01.152 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.153 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:492acfd7:::benchmark_data_smithi188_119427_object86118:head# 2024-04-01T19:43:01.153 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.153 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:492aeb05:::benchmark_data_smithi188_119427_object93226:head# 2024-04-01T19:43:01.153 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.153 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:492bd694:::benchmark_data_smithi188_119427_object142395:head# 2024-04-01T19:43:01.153 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.153 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:492bdd06:::benchmark_data_smithi188_119427_object105423:head# 2024-04-01T19:43:01.153 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.153 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:492e9ef9:::benchmark_data_smithi188_119427_object73143:head# 2024-04-01T19:43:01.153 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.153 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49308e6a:::benchmark_data_smithi188_119427_object157278:head# 2024-04-01T19:43:01.153 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.153 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49309bdc:::benchmark_data_smithi188_119427_object78499:head# 2024-04-01T19:43:01.153 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.154 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4933280b:::benchmark_data_smithi188_119427_object117125:head# 2024-04-01T19:43:01.154 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.154 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:493382c3:::benchmark_data_smithi188_119427_object94113:head# 2024-04-01T19:43:01.154 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.154 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49351ce9:::benchmark_data_smithi188_119427_object80882:head# 2024-04-01T19:43:01.154 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.154 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49355e75:::benchmark_data_smithi188_119427_object95002:head# 2024-04-01T19:43:01.154 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.154 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4936662c:::benchmark_data_smithi188_119427_object104922:head# 2024-04-01T19:43:01.154 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.154 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4936d005:::benchmark_data_smithi188_119427_object127110:head# 2024-04-01T19:43:01.154 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.154 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49371470:::benchmark_data_smithi188_119427_object84913:head# 2024-04-01T19:43:01.154 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.156 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4937a0e8:::benchmark_data_smithi188_119427_object145135:head# 2024-04-01T19:43:01.156 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.157 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4937e393:::benchmark_data_smithi188_119427_object128832:head# 2024-04-01T19:43:01.157 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.157 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:493a2e2c:::benchmark_data_smithi188_119427_object109215:head# 2024-04-01T19:43:01.157 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.157 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:493b7387:::benchmark_data_smithi188_119427_object129466:head# 2024-04-01T19:43:01.157 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.157 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:493b8a66:::benchmark_data_smithi188_119427_object123876:head# 2024-04-01T19:43:01.157 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.157 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:493bdfd9:::benchmark_data_smithi188_119427_object153007:head# 2024-04-01T19:43:01.157 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.157 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:493c0c89:::benchmark_data_smithi188_119427_object138564:head# 2024-04-01T19:43:01.157 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.157 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:493c7f69:::benchmark_data_smithi188_119427_object94092:head# 2024-04-01T19:43:01.158 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.158 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:493c8b1f:::benchmark_data_smithi188_119427_object73568:head# 2024-04-01T19:43:01.158 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.158 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:493d7d1b:::benchmark_data_smithi188_119427_object116761:head# 2024-04-01T19:43:01.158 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.158 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:493f9064:::benchmark_data_smithi188_119427_object82623:head# 2024-04-01T19:43:01.158 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.158 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:494071a8:::benchmark_data_smithi188_119427_object136941:head# 2024-04-01T19:43:01.158 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.158 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:494178d7:::benchmark_data_smithi188_119427_object136881:head# 2024-04-01T19:43:01.158 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.158 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49417fc0:::benchmark_data_smithi188_119427_object80128:head# 2024-04-01T19:43:01.158 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.158 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4941fd65:::benchmark_data_smithi188_119427_object152376:head# 2024-04-01T19:43:01.159 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.159 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4942a395:::benchmark_data_smithi188_119427_object140361:head# 2024-04-01T19:43:01.159 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.160 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49439e24:::benchmark_data_smithi188_119427_object77494:head# 2024-04-01T19:43:01.160 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.160 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:494458e1:::benchmark_data_smithi188_119427_object73225:head# 2024-04-01T19:43:01.160 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.160 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49449101:::benchmark_data_smithi188_119427_object162491:head# 2024-04-01T19:43:01.160 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.160 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4944b309:::benchmark_data_smithi188_119427_object83852:head# 2024-04-01T19:43:01.160 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.160 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4944caf5:::benchmark_data_smithi188_119427_object77255:head# 2024-04-01T19:43:01.160 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.161 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4945d280:::benchmark_data_smithi188_119427_object126961:head# 2024-04-01T19:43:01.161 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.161 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49464f20:::benchmark_data_smithi188_119427_object85307:head# 2024-04-01T19:43:01.161 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.162 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:494692aa:::benchmark_data_smithi188_119427_object93129:head# 2024-04-01T19:43:01.162 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.168 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4946a479:::benchmark_data_smithi188_119427_object162931:head# 2024-04-01T19:43:01.169 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.169 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49474890:::benchmark_data_smithi188_119427_object154963:head# 2024-04-01T19:43:01.169 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.169 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4947fb92:::benchmark_data_smithi188_119427_object92173:head# 2024-04-01T19:43:01.169 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.169 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:494901c7:::benchmark_data_smithi188_119427_object139298:head# 2024-04-01T19:43:01.169 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.169 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:494b552d:::benchmark_data_smithi188_119427_object81174:head# 2024-04-01T19:43:01.169 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.169 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:494be87b:::benchmark_data_smithi188_119427_object88327:head# 2024-04-01T19:43:01.169 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.169 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:494ce35c:::benchmark_data_smithi188_119427_object87333:head# 2024-04-01T19:43:01.170 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.170 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:494d43b9:::benchmark_data_smithi188_119427_object107422:head# 2024-04-01T19:43:01.170 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.170 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:494d4e66:::benchmark_data_smithi188_119427_object143951:head# 2024-04-01T19:43:01.170 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.170 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:494dcd3d:::benchmark_data_smithi188_119427_object147652:head# 2024-04-01T19:43:01.170 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.170 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:494f062f:::benchmark_data_smithi188_119427_object98807:head# 2024-04-01T19:43:01.170 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.170 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:494f1885:::benchmark_data_smithi188_119427_object121526:head# 2024-04-01T19:43:01.170 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.170 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49504984:::benchmark_data_smithi188_119427_object105484:head# 2024-04-01T19:43:01.170 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4950e9ac:::benchmark_data_smithi188_119427_object130516:head# 2024-04-01T19:43:01.171 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:495181c7:::benchmark_data_smithi188_119427_object113227:head# 2024-04-01T19:43:01.171 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4953ee73:::benchmark_data_smithi188_119427_object125666:head# 2024-04-01T19:43:01.171 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:495430ba:::benchmark_data_smithi188_119427_object157690:head# 2024-04-01T19:43:01.171 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49548a80:::benchmark_data_smithi188_119427_object79887:head# 2024-04-01T19:43:01.171 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49557178:::benchmark_data_smithi188_119427_object73921:head# 2024-04-01T19:43:01.171 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.171 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:495592bd:::benchmark_data_smithi188_119427_object74033:head# 2024-04-01T19:43:01.171 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4956853d:::benchmark_data_smithi188_119427_object81005:head# 2024-04-01T19:43:01.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:495698a4:::benchmark_data_smithi188_119427_object126173:head# 2024-04-01T19:43:01.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.172 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4956f4bd:::benchmark_data_smithi188_119427_object99007:head# 2024-04-01T19:43:01.172 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.175 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4957d74b:::benchmark_data_smithi188_119427_object130151:head# 2024-04-01T19:43:01.176 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.178 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49586992:::benchmark_data_smithi188_119427_object79185:head# 2024-04-01T19:43:01.178 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.179 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4958a400:::benchmark_data_smithi188_119427_object162072:head# 2024-04-01T19:43:01.179 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.182 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:495948bb:::benchmark_data_smithi188_119427_object151697:head# 2024-04-01T19:43:01.182 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.183 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:495a954a:::benchmark_data_smithi188_119427_object149406:head# 2024-04-01T19:43:01.183 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.184 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:495b9677:::benchmark_data_smithi188_119427_object91113:head# 2024-04-01T19:43:01.184 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.184 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:495cca3f:::benchmark_data_smithi188_119427_object112665:head# 2024-04-01T19:43:01.184 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.185 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:495e6aa5:::benchmark_data_smithi188_119427_object126390:head# 2024-04-01T19:43:01.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.185 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:495ee912:::benchmark_data_smithi188_119427_object108464:head# 2024-04-01T19:43:01.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.185 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:495f1797:::benchmark_data_smithi188_119427_object121287:head# 2024-04-01T19:43:01.185 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.186 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49615ed0:::benchmark_data_smithi188_119427_object129057:head# 2024-04-01T19:43:01.186 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.186 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4962258d:::benchmark_data_smithi188_119427_object131957:head# 2024-04-01T19:43:01.186 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.186 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49627fd8:::benchmark_data_smithi188_119427_object115937:head# 2024-04-01T19:43:01.186 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.186 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49630f85:::benchmark_data_smithi188_119427_object77622:head# 2024-04-01T19:43:01.186 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.187 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4963a3c2:::benchmark_data_smithi188_119427_object143350:head# 2024-04-01T19:43:01.187 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.187 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:496425ab:::benchmark_data_smithi188_119427_object117667:head# 2024-04-01T19:43:01.188 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.188 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49644917:::benchmark_data_smithi188_119427_object160067:head# 2024-04-01T19:43:01.188 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.188 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4964eac6:::benchmark_data_smithi188_119427_object81649:head# 2024-04-01T19:43:01.188 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.188 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4964eec3:::benchmark_data_smithi188_119427_object147049:head# 2024-04-01T19:43:01.188 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.188 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4966512a:::benchmark_data_smithi188_119427_object85152:head# 2024-04-01T19:43:01.188 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.189 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:496699f0:::benchmark_data_smithi188_119427_object128071:head# 2024-04-01T19:43:01.189 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.189 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4966b7d8:::benchmark_data_smithi188_119427_object148815:head# 2024-04-01T19:43:01.189 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.189 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4966c14f:::benchmark_data_smithi188_119427_object163807:head# 2024-04-01T19:43:01.189 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.190 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4967ba40:::benchmark_data_smithi188_119427_object80777:head# 2024-04-01T19:43:01.190 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.190 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49684c2d:::benchmark_data_smithi188_119427_object77424:head# 2024-04-01T19:43:01.190 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.190 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4968b1ab:::benchmark_data_smithi188_119427_object152121:head# 2024-04-01T19:43:01.190 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.191 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49691db6:::benchmark_data_smithi188_119427_object103188:head# 2024-04-01T19:43:01.191 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.191 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4969bca4:::benchmark_data_smithi188_119427_object73503:head# 2024-04-01T19:43:01.191 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.191 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:496a4afa:::benchmark_data_smithi188_119427_object113188:head# 2024-04-01T19:43:01.191 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.191 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:496a9c1e:::benchmark_data_smithi188_119427_object138679:head# 2024-04-01T19:43:01.191 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.191 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:496acccd:::benchmark_data_smithi188_119427_object84786:head# 2024-04-01T19:43:01.191 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.192 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:496b999c:::benchmark_data_smithi188_119427_object79763:head# 2024-04-01T19:43:01.192 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.192 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:496c7900:::benchmark_data_smithi188_119427_object151908:head# 2024-04-01T19:43:01.192 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.192 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:496cabe2:::benchmark_data_smithi188_119427_object124644:head# 2024-04-01T19:43:01.192 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.192 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:496d0bdf:::benchmark_data_smithi188_119427_object74365:head# 2024-04-01T19:43:01.192 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.193 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:496d51c5:::benchmark_data_smithi188_119427_object148410:head# 2024-04-01T19:43:01.194 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.194 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:496d70f9:::benchmark_data_smithi188_119427_object133659:head# 2024-04-01T19:43:01.194 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.194 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:496db72c:::benchmark_data_smithi188_119427_object117980:head# 2024-04-01T19:43:01.194 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.194 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:496de268:::benchmark_data_smithi188_119427_object126610:head# 2024-04-01T19:43:01.194 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.194 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:496e20ed:::benchmark_data_smithi188_119427_object97756:head# 2024-04-01T19:43:01.194 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.194 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:496f0dd0:::benchmark_data_smithi188_119427_object74419:head# 2024-04-01T19:43:01.195 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.195 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:496f34f8:::benchmark_data_smithi188_119427_object148592:head# 2024-04-01T19:43:01.195 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.195 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49701c9e:::benchmark_data_smithi188_119427_object163748:head# 2024-04-01T19:43:01.196 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.196 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49712793:::benchmark_data_smithi188_119427_object77434:head# 2024-04-01T19:43:01.196 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.196 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49714a06:::benchmark_data_smithi188_119427_object78430:head# 2024-04-01T19:43:01.196 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.196 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49720da1:::benchmark_data_smithi188_119427_object146019:head# 2024-04-01T19:43:01.196 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.196 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4972ca6c:::benchmark_data_smithi188_119427_object80068:head# 2024-04-01T19:43:01.196 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.197 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49731ea0:::benchmark_data_smithi188_119427_object119624:head# 2024-04-01T19:43:01.197 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.197 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4973462c:::benchmark_data_smithi188_119427_object75957:head# 2024-04-01T19:43:01.197 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.197 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49753cd7:::benchmark_data_smithi188_119427_object150728:head# 2024-04-01T19:43:01.197 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.202 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4975a96c:::benchmark_data_smithi188_119427_object136314:head# 2024-04-01T19:43:01.202 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.207 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49767c88:::benchmark_data_smithi188_119427_object144420:head# 2024-04-01T19:43:01.207 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.208 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49768590:::benchmark_data_smithi188_119427_object136892:head# 2024-04-01T19:43:01.208 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.208 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49774fe0:::benchmark_data_smithi188_119427_object128458:head# 2024-04-01T19:43:01.208 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.209 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4977e5b1:::benchmark_data_smithi188_119427_object84421:head# 2024-04-01T19:43:01.209 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.209 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49796d33:::benchmark_data_smithi188_119427_object135333:head# 2024-04-01T19:43:01.209 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.209 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:497a3013:::benchmark_data_smithi188_119427_object129565:head# 2024-04-01T19:43:01.209 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.213 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:43:01.214 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:497a8ac5:::benchmark_data_smithi188_119427_object88892:head# 2024-04-01T19:43:01.214 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.217 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:497b67c2:::benchmark_data_smithi188_119427_object138651:head# 2024-04-01T19:43:01.217 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.218 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:497d0f13:::benchmark_data_smithi188_119427_object127657:head# 2024-04-01T19:43:01.218 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.218 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:497d4033:::benchmark_data_smithi188_119427_object107948:head# 2024-04-01T19:43:01.218 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.218 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:497d6dc8:::benchmark_data_smithi188_119427_object137063:head# 2024-04-01T19:43:01.219 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.219 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:497eb733:::benchmark_data_smithi188_119427_object135454:head# 2024-04-01T19:43:01.219 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.219 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:497f79b5:::benchmark_data_smithi188_119427_object134441:head# 2024-04-01T19:43:01.220 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.220 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:498054f6:::benchmark_data_smithi188_119427_object143894:head# 2024-04-01T19:43:01.220 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.220 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:498128ed:::benchmark_data_smithi188_119427_object124015:head# 2024-04-01T19:43:01.220 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.220 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:498208b9:::benchmark_data_smithi188_119427_object162890:head# 2024-04-01T19:43:01.220 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4982cb44:::benchmark_data_smithi188_119427_object116498:head# 2024-04-01T19:43:01.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4984d501:::benchmark_data_smithi188_119427_object146457:head# 2024-04-01T19:43:01.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.221 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4985dc98:::benchmark_data_smithi188_119427_object132987:head# 2024-04-01T19:43:01.221 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.222 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:498617e4:::benchmark_data_smithi188_119427_object82491:head# 2024-04-01T19:43:01.222 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.222 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49863926:::benchmark_data_smithi188_119427_object153071:head# 2024-04-01T19:43:01.222 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.222 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4986a1a1:::benchmark_data_smithi188_119427_object94270:head# 2024-04-01T19:43:01.222 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.222 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4987f644:::benchmark_data_smithi188_119427_object119215:head# 2024-04-01T19:43:01.222 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.224 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:498cffac:::benchmark_data_smithi188_119427_object132756:head# 2024-04-01T19:43:01.224 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.224 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:498f66e1:::benchmark_data_smithi188_119427_object129801:head# 2024-04-01T19:43:01.224 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.224 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49916c0c:::benchmark_data_smithi188_119427_object132059:head# 2024-04-01T19:43:01.225 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.225 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49937aeb:::benchmark_data_smithi188_119427_object112710:head# 2024-04-01T19:43:01.225 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.225 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4993f477:::benchmark_data_smithi188_119427_object143743:head# 2024-04-01T19:43:01.225 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.225 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4994a4ad:::benchmark_data_smithi188_119427_object138008:head# 2024-04-01T19:43:01.225 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.225 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49956e75:::benchmark_data_smithi188_119427_object159323:head# 2024-04-01T19:43:01.225 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.225 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49978a7a:::benchmark_data_smithi188_119427_object117193:head# 2024-04-01T19:43:01.225 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.225 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49980a3d:::benchmark_data_smithi188_119427_object129915:head# 2024-04-01T19:43:01.225 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.225 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4998359f:::benchmark_data_smithi188_119427_object98470:head# 2024-04-01T19:43:01.226 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.226 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:499887f5:::benchmark_data_smithi188_119427_object91771:head# 2024-04-01T19:43:01.226 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.226 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4998ae19:::benchmark_data_smithi188_119427_object80810:head# 2024-04-01T19:43:01.226 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.228 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:499a6acb:::benchmark_data_smithi188_119427_object89295:head# 2024-04-01T19:43:01.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.228 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:499aabd0:::benchmark_data_smithi188_119427_object81761:head# 2024-04-01T19:43:01.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.228 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:499afdec:::benchmark_data_smithi188_119427_object120197:head# 2024-04-01T19:43:01.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.228 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:499b076b:::benchmark_data_smithi188_119427_object111738:head# 2024-04-01T19:43:01.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.228 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:499b61a2:::benchmark_data_smithi188_119427_object102781:head# 2024-04-01T19:43:01.228 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.229 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:499b987b:::benchmark_data_smithi188_119427_object90544:head# 2024-04-01T19:43:01.229 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.229 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:499c5073:::benchmark_data_smithi188_119427_object137453:head# 2024-04-01T19:43:01.229 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.229 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:499c70c5:::benchmark_data_smithi188_119427_object97171:head# 2024-04-01T19:43:01.229 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.229 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:499d5d29:::benchmark_data_smithi188_119427_object108245:head# 2024-04-01T19:43:01.229 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.229 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:499d8969:::benchmark_data_smithi188_119427_object101650:head# 2024-04-01T19:43:01.229 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.229 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:499e0b6e:::benchmark_data_smithi188_119427_object129741:head# 2024-04-01T19:43:01.229 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.229 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:499e1cf4:::benchmark_data_smithi188_119427_object102612:head# 2024-04-01T19:43:01.229 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.231 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:499ea1a8:::benchmark_data_smithi188_119427_object160791:head# 2024-04-01T19:43:01.231 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.231 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:499edfde:::benchmark_data_smithi188_119427_object138547:head# 2024-04-01T19:43:01.231 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.231 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:499ee754:::benchmark_data_smithi188_119427_object150542:head# 2024-04-01T19:43:01.231 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.231 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:499f37d2:::benchmark_data_smithi188_119427_object130425:head# 2024-04-01T19:43:01.231 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.231 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49a03732:::benchmark_data_smithi188_119427_object161810:head# 2024-04-01T19:43:01.231 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.231 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49a26f8f:::benchmark_data_smithi188_119427_object77266:head# 2024-04-01T19:43:01.231 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.231 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49a41a0a:::benchmark_data_smithi188_119427_object81924:head# 2024-04-01T19:43:01.232 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.232 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49a4b67a:::benchmark_data_smithi188_119427_object85298:head# 2024-04-01T19:43:01.232 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.232 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49a4d92c:::benchmark_data_smithi188_119427_object125060:head# 2024-04-01T19:43:01.232 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.232 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49a5418f:::benchmark_data_smithi188_119427_object134098:head# 2024-04-01T19:43:01.232 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.232 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49a57752:::benchmark_data_smithi188_119427_object127502:head# 2024-04-01T19:43:01.232 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.232 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49a5aea2:::benchmark_data_smithi188_119427_object88218:head# 2024-04-01T19:43:01.232 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49a643f9:::benchmark_data_smithi188_119427_object85065:head# 2024-04-01T19:43:01.235 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49a64a8a:::benchmark_data_smithi188_119427_object101385:head# 2024-04-01T19:43:01.235 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49a7f43d:::benchmark_data_smithi188_119427_object85379:head# 2024-04-01T19:43:01.235 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49a8237b:::benchmark_data_smithi188_119427_object96557:head# 2024-04-01T19:43:01.235 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49a84d00:::benchmark_data_smithi188_119427_object120148:head# 2024-04-01T19:43:01.235 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.235 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49a8a25a:::benchmark_data_smithi188_119427_object106433:head# 2024-04-01T19:43:01.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49a9374b:::benchmark_data_smithi188_119427_object116885:head# 2024-04-01T19:43:01.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49a9aada:::benchmark_data_smithi188_119427_object161999:head# 2024-04-01T19:43:01.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49ab4f1c:::benchmark_data_smithi188_119427_object112443:head# 2024-04-01T19:43:01.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49ab8090:::benchmark_data_smithi188_119427_object123600:head# 2024-04-01T19:43:01.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49ac25e4:::benchmark_data_smithi188_119427_object116699:head# 2024-04-01T19:43:01.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49ac5ab3:::benchmark_data_smithi188_119427_object97292:head# 2024-04-01T19:43:01.236 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.236 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49ad0ae2:::benchmark_data_smithi188_119427_object133987:head# 2024-04-01T19:43:01.237 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.237 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49adca6e:::benchmark_data_smithi188_119427_object163923:head# 2024-04-01T19:43:01.237 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.237 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49ae06ac:::benchmark_data_smithi188_119427_object75891:head# 2024-04-01T19:43:01.237 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.239 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49ae5d37:::benchmark_data_smithi188_119427_object81955:head# 2024-04-01T19:43:01.239 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.239 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49aeef12:::benchmark_data_smithi188_119427_object151344:head# 2024-04-01T19:43:01.239 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.239 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49afac13:::benchmark_data_smithi188_119427_object83177:head# 2024-04-01T19:43:01.239 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.239 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49b20399:::benchmark_data_smithi188_119427_object97268:head# 2024-04-01T19:43:01.239 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.239 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49b25dbb:::benchmark_data_smithi188_119427_object158364:head# 2024-04-01T19:43:01.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49b30eb3:::benchmark_data_smithi188_119427_object129231:head# 2024-04-01T19:43:01.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49b35e7f:::benchmark_data_smithi188_119427_object93709:head# 2024-04-01T19:43:01.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49b401cd:::benchmark_data_smithi188_119427_object110646:head# 2024-04-01T19:43:01.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49b4acfe:::benchmark_data_smithi188_119427_object93470:head# 2024-04-01T19:43:01.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49b4d726:::benchmark_data_smithi188_119427_object105529:head# 2024-04-01T19:43:01.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49b508de:::benchmark_data_smithi188_119427_object159925:head# 2024-04-01T19:43:01.240 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.240 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49b54f7e:::benchmark_data_smithi188_119427_object127974:head# 2024-04-01T19:43:01.241 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.241 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49b5c175:::benchmark_data_smithi188_119427_object72365:head# 2024-04-01T19:43:01.241 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.241 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49b640c6:::benchmark_data_smithi188_119427_object136164:head# 2024-04-01T19:43:01.241 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.241 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49b6b476:::benchmark_data_smithi188_119427_object163198:head# 2024-04-01T19:43:01.241 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.241 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49b6ef0a:::benchmark_data_smithi188_119427_object129321:head# 2024-04-01T19:43:01.244 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.244 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49b76716:::benchmark_data_smithi188_119427_object158094:head# 2024-04-01T19:43:01.244 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.244 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49b86e26:::benchmark_data_smithi188_119427_object90859:head# 2024-04-01T19:43:01.244 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.244 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49b87394:::benchmark_data_smithi188_119427_object122932:head# 2024-04-01T19:43:01.244 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.244 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49b8e077:::benchmark_data_smithi188_119427_object121505:head# 2024-04-01T19:43:01.245 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.245 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49bb685b:::benchmark_data_smithi188_119427_object117841:head# 2024-04-01T19:43:01.245 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.245 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49bdd229:::benchmark_data_smithi188_119427_object81419:head# 2024-04-01T19:43:01.245 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.245 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49bec475:::benchmark_data_smithi188_119427_object112536:head# 2024-04-01T19:43:01.245 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.245 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49c06b61:::benchmark_data_smithi188_119427_object161634:head# 2024-04-01T19:43:01.245 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.245 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49c1289e:::benchmark_data_smithi188_119427_object152524:head# 2024-04-01T19:43:01.245 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.245 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49c2a452:::benchmark_data_smithi188_119427_object153971:head# 2024-04-01T19:43:01.245 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.246 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49c2eedc:::benchmark_data_smithi188_119427_object72983:head# 2024-04-01T19:43:01.246 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.246 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49c45a1a:::benchmark_data_smithi188_119427_object138106:head# 2024-04-01T19:43:01.246 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.246 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49c47242:::benchmark_data_smithi188_119427_object142003:head# 2024-04-01T19:43:01.246 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.246 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49c4b1f7:::benchmark_data_smithi188_119427_object164282:head# 2024-04-01T19:43:01.246 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.249 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49c56b61:::benchmark_data_smithi188_119427_object140602:head# 2024-04-01T19:43:01.249 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.249 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49c58437:::benchmark_data_smithi188_119427_object103122:head# 2024-04-01T19:43:01.249 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.249 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49c592b1:::benchmark_data_smithi188_119427_object104205:head# 2024-04-01T19:43:01.249 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.249 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49c59837:::benchmark_data_smithi188_119427_object86353:head# 2024-04-01T19:43:01.249 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.249 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49c64c9b:::benchmark_data_smithi188_119427_object120054:head# 2024-04-01T19:43:01.249 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.249 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49c65811:::benchmark_data_smithi188_119427_object110737:head# 2024-04-01T19:43:01.250 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.250 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49c773f9:::benchmark_data_smithi188_119427_object140207:head# 2024-04-01T19:43:01.250 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.250 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49c7c583:::benchmark_data_smithi188_119427_object145841:head# 2024-04-01T19:43:01.250 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.250 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49c85490:::benchmark_data_smithi188_119427_object115109:head# 2024-04-01T19:43:01.250 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.250 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49c8577d:::benchmark_data_smithi188_119427_object95500:head# 2024-04-01T19:43:01.250 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.250 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49c94c04:::benchmark_data_smithi188_119427_object128483:head# 2024-04-01T19:43:01.250 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.250 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49c9ea1a:::benchmark_data_smithi188_119427_object104823:head# 2024-04-01T19:43:01.250 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.251 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49c9f7e6:::benchmark_data_smithi188_119427_object117528:head# 2024-04-01T19:43:01.251 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.251 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49cc48af:::benchmark_data_smithi188_119427_object135714:head# 2024-04-01T19:43:01.251 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.251 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49cc6fa2:::benchmark_data_smithi188_119427_object105229:head# 2024-04-01T19:43:01.251 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.251 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49cce247:::benchmark_data_smithi188_119427_object134635:head# 2024-04-01T19:43:01.251 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.251 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49cdf84f:::benchmark_data_smithi188_119427_object91254:head# 2024-04-01T19:43:01.251 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.251 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49cf3cec:::benchmark_data_smithi188_119427_object77007:head# 2024-04-01T19:43:01.251 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.253 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49d0ec6a:::benchmark_data_smithi188_119427_object120414:head# 2024-04-01T19:43:01.253 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.254 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49d14620:::benchmark_data_smithi188_119427_object84705:head# 2024-04-01T19:43:01.254 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.254 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49d23bdd:::benchmark_data_smithi188_119427_object128954:head# 2024-04-01T19:43:01.254 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.254 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49d34f50:::benchmark_data_smithi188_119427_object141641:head# 2024-04-01T19:43:01.254 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.254 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49d3618d:::benchmark_data_smithi188_119427_object134965:head# 2024-04-01T19:43:01.254 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.254 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49d408f3:::benchmark_data_smithi188_119427_object126749:head# 2024-04-01T19:43:01.254 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.254 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49d40be9:::benchmark_data_smithi188_119427_object96774:head# 2024-04-01T19:43:01.254 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.254 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49d417d3:::benchmark_data_smithi188_119427_object157545:head# 2024-04-01T19:43:01.254 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.255 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49d58e4e:::benchmark_data_smithi188_119427_object130789:head# 2024-04-01T19:43:01.255 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.255 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49d65006:::benchmark_data_smithi188_119427_object162504:head# 2024-04-01T19:43:01.255 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.255 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49d678a7:::benchmark_data_smithi188_119427_object127962:head# 2024-04-01T19:43:01.255 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.255 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49d6b8af:::benchmark_data_smithi188_119427_object109408:head# 2024-04-01T19:43:01.255 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.255 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49d6d94a:::benchmark_data_smithi188_119427_object134574:head# 2024-04-01T19:43:01.255 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.255 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49d76d44:::benchmark_data_smithi188_119427_object115309:head# 2024-04-01T19:43:01.255 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.255 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49d80799:::benchmark_data_smithi188_119427_object138758:head# 2024-04-01T19:43:01.255 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.256 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49d82699:::benchmark_data_smithi188_119427_object133043:head# 2024-04-01T19:43:01.256 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.258 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49d8306a:::benchmark_data_smithi188_119427_object108278:head# 2024-04-01T19:43:01.258 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.258 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49d8d20e:::benchmark_data_smithi188_119427_object156737:head# 2024-04-01T19:43:01.258 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.258 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49d9054a:::benchmark_data_smithi188_119427_object127427:head# 2024-04-01T19:43:01.258 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.258 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49d9299f:::benchmark_data_smithi188_119427_object78385:head# 2024-04-01T19:43:01.259 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.259 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49d96ed5:::benchmark_data_smithi188_119427_object78678:head# 2024-04-01T19:43:01.259 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.259 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49d98e85:::benchmark_data_smithi188_119427_object125527:head# 2024-04-01T19:43:01.259 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.259 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49d9e686:::benchmark_data_smithi188_119427_object156387:head# 2024-04-01T19:43:01.259 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.259 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49da358e:::benchmark_data_smithi188_119427_object159544:head# 2024-04-01T19:43:01.259 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.259 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49db09df:::benchmark_data_smithi188_119427_object77618:head# 2024-04-01T19:43:01.259 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.259 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49db0f0c:::benchmark_data_smithi188_119427_object99289:head# 2024-04-01T19:43:01.260 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.260 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49db5b4a:::benchmark_data_smithi188_119427_object94524:head# 2024-04-01T19:43:01.260 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.260 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49dde42f:::benchmark_data_smithi188_119427_object103304:head# 2024-04-01T19:43:01.260 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.260 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49ddee85:::benchmark_data_smithi188_119427_object110610:head# 2024-04-01T19:43:01.260 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.260 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49de055f:::benchmark_data_smithi188_119427_object162145:head# 2024-04-01T19:43:01.260 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.260 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49de37bb:::benchmark_data_smithi188_119427_object106448:head# 2024-04-01T19:43:01.260 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.260 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49df0ac6:::benchmark_data_smithi188_119427_object119459:head# 2024-04-01T19:43:01.260 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.260 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49df6524:::benchmark_data_smithi188_119427_object121975:head# 2024-04-01T19:43:01.261 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.261 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49df70d5:::benchmark_data_smithi188_119427_object83764:head# 2024-04-01T19:43:01.261 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.261 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49df77d9:::benchmark_data_smithi188_119427_object163765:head# 2024-04-01T19:43:01.261 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.261 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49dff108:::benchmark_data_smithi188_119427_object150318:head# 2024-04-01T19:43:01.261 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.262 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49e0654d:::benchmark_data_smithi188_119427_object86179:head# 2024-04-01T19:43:01.262 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.262 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49e0e78e:::benchmark_data_smithi188_119427_object133149:head# 2024-04-01T19:43:01.262 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.262 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49e102dd:::benchmark_data_smithi188_119427_object95484:head# 2024-04-01T19:43:01.263 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.263 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49e13d1f:::benchmark_data_smithi188_119427_object141119:head# 2024-04-01T19:43:01.263 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.263 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49e25ad5:::benchmark_data_smithi188_119427_object115005:head# 2024-04-01T19:43:01.263 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.263 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49e2e34c:::benchmark_data_smithi188_119427_object74682:head# 2024-04-01T19:43:01.263 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.263 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49e31a69:::benchmark_data_smithi188_119427_object162022:head# 2024-04-01T19:43:01.263 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:01 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3357618881' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:43:01.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:01 smithi062 ceph-mon[44211]: from='client.36224 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:43:01.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:01 smithi062 ceph-mon[44211]: pgmap v1226: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.0 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 796 op/s 2024-04-01T19:43:01.265 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49e38adf:::benchmark_data_smithi188_119427_object155321:head# 2024-04-01T19:43:01.265 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.265 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49e3f6ab:::benchmark_data_smithi188_119427_object106415:head# 2024-04-01T19:43:01.266 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.266 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49e41700:::benchmark_data_smithi188_119427_object73768:head# 2024-04-01T19:43:01.266 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.266 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49e5301f:::benchmark_data_smithi188_119427_object78973:head# 2024-04-01T19:43:01.266 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.266 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49e54e69:::benchmark_data_smithi188_119427_object132180:head# 2024-04-01T19:43:01.266 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.266 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49e5a04e:::benchmark_data_smithi188_119427_object81437:head# 2024-04-01T19:43:01.266 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.266 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49e66a6c:::benchmark_data_smithi188_119427_object86396:head# 2024-04-01T19:43:01.266 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.266 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49e8ea20:::benchmark_data_smithi188_119427_object140636:head# 2024-04-01T19:43:01.266 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.267 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49e9dac9:::benchmark_data_smithi188_119427_object148588:head# 2024-04-01T19:43:01.267 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.267 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49e9de7c:::benchmark_data_smithi188_119427_object92419:head# 2024-04-01T19:43:01.267 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.267 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49ea3ec2:::benchmark_data_smithi188_119427_object106367:head# 2024-04-01T19:43:01.267 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.267 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49ec2242:::benchmark_data_smithi188_119427_object156057:head# 2024-04-01T19:43:01.267 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.267 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49ec5b85:::benchmark_data_smithi188_119427_object130858:head# 2024-04-01T19:43:01.267 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.267 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49ec6c4f:::benchmark_data_smithi188_119427_object130720:head# 2024-04-01T19:43:01.267 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.267 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49ed1193:::benchmark_data_smithi188_119427_object96946:head# 2024-04-01T19:43:01.268 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.272 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49ed229f:::benchmark_data_smithi188_119427_object72386:head# 2024-04-01T19:43:01.272 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.272 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49ed31dc:::benchmark_data_smithi188_119427_object164643:head# 2024-04-01T19:43:01.272 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.272 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49ed4767:::benchmark_data_smithi188_119427_object116690:head# 2024-04-01T19:43:01.272 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.273 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49edb505:::benchmark_data_smithi188_119427_object131309:head# 2024-04-01T19:43:01.273 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.273 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49ede592:::benchmark_data_smithi188_119427_object73387:head# 2024-04-01T19:43:01.273 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.273 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49f07bad:::benchmark_data_smithi188_119427_object160706:head# 2024-04-01T19:43:01.273 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.273 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49f0c72c:::benchmark_data_smithi188_119427_object110125:head# 2024-04-01T19:43:01.273 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.273 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49f168fd:::benchmark_data_smithi188_119427_object85208:head# 2024-04-01T19:43:01.273 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.273 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49f1ce7a:::benchmark_data_smithi188_119427_object86740:head# 2024-04-01T19:43:01.273 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.273 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49f1d946:::benchmark_data_smithi188_119427_object119949:head# 2024-04-01T19:43:01.274 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.274 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49f1e93f:::benchmark_data_smithi188_119427_object121442:head# 2024-04-01T19:43:01.274 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.274 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49f210b3:::benchmark_data_smithi188_119427_object79267:head# 2024-04-01T19:43:01.274 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.274 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49f5e88f:::benchmark_data_smithi188_119427_object153112:head# 2024-04-01T19:43:01.274 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.274 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49f637bb:::benchmark_data_smithi188_119427_object100020:head# 2024-04-01T19:43:01.274 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.274 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49f6d59f:::benchmark_data_smithi188_119427_object157065:head# 2024-04-01T19:43:01.274 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.274 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49f8db7d:::benchmark_data_smithi188_119427_object78855:head# 2024-04-01T19:43:01.274 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.274 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49f97a30:::benchmark_data_smithi188_119427_object108814:head# 2024-04-01T19:43:01.275 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.275 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49f9e436:::benchmark_data_smithi188_119427_object148335:head# 2024-04-01T19:43:01.275 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.275 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49fa5371:::benchmark_data_smithi188_119427_object139536:head# 2024-04-01T19:43:01.275 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.275 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49fadccf:::benchmark_data_smithi188_119427_object79341:head# 2024-04-01T19:43:01.275 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.275 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49fb928c:::benchmark_data_smithi188_119427_object73288:head# 2024-04-01T19:43:01.275 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.275 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49fbe4d4:::benchmark_data_smithi188_119427_object153902:head# 2024-04-01T19:43:01.275 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.275 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49fd2f5a:::benchmark_data_smithi188_119427_object141249:head# 2024-04-01T19:43:01.275 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.276 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49fdc3cd:::benchmark_data_smithi188_119427_object148099:head# 2024-04-01T19:43:01.276 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.276 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49fe2fb6:::benchmark_data_smithi188_119427_object131875:head# 2024-04-01T19:43:01.276 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.276 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:49fe43fa:::benchmark_data_smithi188_119427_object104091:head# 2024-04-01T19:43:01.276 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.276 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a0114ba:::benchmark_data_smithi188_119427_object124051:head# 2024-04-01T19:43:01.276 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.276 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a014374:::benchmark_data_smithi188_119427_object164530:head# 2024-04-01T19:43:01.276 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.276 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a020f3e:::benchmark_data_smithi188_119427_object149195:head# 2024-04-01T19:43:01.276 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.276 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a038f52:::benchmark_data_smithi188_119427_object161887:head# 2024-04-01T19:43:01.276 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.277 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a040d84:::benchmark_data_smithi188_119427_object100924:head# 2024-04-01T19:43:01.277 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.279 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a0594b1:::benchmark_data_smithi188_119427_object83885:head# 2024-04-01T19:43:01.279 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.279 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a0796a5:::benchmark_data_smithi188_119427_object125457:head# 2024-04-01T19:43:01.279 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.279 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a0861d9:::benchmark_data_smithi188_119427_object111621:head# 2024-04-01T19:43:01.280 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.280 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a088f97:::benchmark_data_smithi188_119427_object73191:head# 2024-04-01T19:43:01.280 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.280 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a096229:::benchmark_data_smithi188_119427_object82692:head# 2024-04-01T19:43:01.280 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.280 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a09c51c:::benchmark_data_smithi188_119427_object87519:head# 2024-04-01T19:43:01.280 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.280 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a0b1fae:::benchmark_data_smithi188_119427_object132078:head# 2024-04-01T19:43:01.280 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.280 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a0b5854:::benchmark_data_smithi188_119427_object158013:head# 2024-04-01T19:43:01.280 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.280 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a0b9d93:::benchmark_data_smithi188_119427_object133213:head# 2024-04-01T19:43:01.280 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.280 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a0c3916:::benchmark_data_smithi188_119427_object111015:head# 2024-04-01T19:43:01.281 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.281 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a0c9b43:::benchmark_data_smithi188_119427_object130673:head# 2024-04-01T19:43:01.281 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.281 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a0d6f72:::benchmark_data_smithi188_119427_object144475:head# 2024-04-01T19:43:01.281 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.281 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a0d8816:::benchmark_data_smithi188_119427_object111430:head# 2024-04-01T19:43:01.281 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.281 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a0d9851:::benchmark_data_smithi188_119427_object86642:head# 2024-04-01T19:43:01.281 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.281 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a0fd722:::benchmark_data_smithi188_119427_object130252:head# 2024-04-01T19:43:01.281 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.281 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a108427:::benchmark_data_smithi188_119427_object76878:head# 2024-04-01T19:43:01.281 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.282 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a1144c7:::benchmark_data_smithi188_119427_object129373:head# 2024-04-01T19:43:01.282 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.282 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a114822:::benchmark_data_smithi188_119427_object144291:head# 2024-04-01T19:43:01.282 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.282 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a1159e7:::benchmark_data_smithi188_119427_object140036:head# 2024-04-01T19:43:01.282 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.282 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a129b2e:::benchmark_data_smithi188_119427_object79919:head# 2024-04-01T19:43:01.282 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.283 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a12aaf7:::benchmark_data_smithi188_119427_object98205:head# 2024-04-01T19:43:01.283 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.283 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a12c8e0:::benchmark_data_smithi188_119427_object162679:head# 2024-04-01T19:43:01.283 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.283 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a12dc8b:::benchmark_data_smithi188_119427_object92712:head# 2024-04-01T19:43:01.283 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.284 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a138caf:::benchmark_data_smithi188_119427_object123676:head# 2024-04-01T19:43:01.284 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.284 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a13a937:::benchmark_data_smithi188_119427_object92936:head# 2024-04-01T19:43:01.284 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.284 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a13f2bb:::benchmark_data_smithi188_119427_object157539:head# 2024-04-01T19:43:01.284 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.284 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a140db1:::benchmark_data_smithi188_119427_object90514:head# 2024-04-01T19:43:01.284 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.284 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a154e51:::benchmark_data_smithi188_119427_object114624:head# 2024-04-01T19:43:01.284 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.284 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a163a06:::benchmark_data_smithi188_119427_object111688:head# 2024-04-01T19:43:01.284 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.285 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a16a291:::benchmark_data_smithi188_119427_object129448:head# 2024-04-01T19:43:01.285 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.285 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a185051:::benchmark_data_smithi188_119427_object83061:head# 2024-04-01T19:43:01.285 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.285 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a188b87:::benchmark_data_smithi188_119427_object124816:head# 2024-04-01T19:43:01.285 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.286 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a1a20fa:::benchmark_data_smithi188_119427_object148948:head# 2024-04-01T19:43:01.286 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.290 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a1b714b:::benchmark_data_smithi188_119427_object87158:head# 2024-04-01T19:43:01.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a1c30c2:::benchmark_data_smithi188_119427_object127450:head# 2024-04-01T19:43:01.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a1ca94e:::benchmark_data_smithi188_119427_object149665:head# 2024-04-01T19:43:01.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a1cf883:::benchmark_data_smithi188_119427_object87013:head# 2024-04-01T19:43:01.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a1e39b9:::benchmark_data_smithi188_119427_object164262:head# 2024-04-01T19:43:01.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a1f07d5:::benchmark_data_smithi188_119427_object139944:head# 2024-04-01T19:43:01.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a20e973:::benchmark_data_smithi188_119427_object102341:head# 2024-04-01T19:43:01.291 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.291 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a20f834:::benchmark_data_smithi188_119427_object94532:head# 2024-04-01T19:43:01.292 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.292 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a221426:::benchmark_data_smithi188_119427_object146782:head# 2024-04-01T19:43:01.292 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.292 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a22456c:::benchmark_data_smithi188_119427_object120747:head# 2024-04-01T19:43:01.292 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.292 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a225cf5:::benchmark_data_smithi188_119427_object139065:head# 2024-04-01T19:43:01.292 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.292 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a22e235:::benchmark_data_smithi188_119427_object79445:head# 2024-04-01T19:43:01.292 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.293 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a23922e:::benchmark_data_smithi188_119427_object111831:head# 2024-04-01T19:43:01.293 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.293 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a249173:::benchmark_data_smithi188_119427_object132539:head# 2024-04-01T19:43:01.293 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.297 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a29baec:::benchmark_data_smithi188_119427_object100597:head# 2024-04-01T19:43:01.297 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.297 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a2a782f:::benchmark_data_smithi188_119427_object82869:head# 2024-04-01T19:43:01.297 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.297 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a2b2c01:::benchmark_data_smithi188_119427_object75968:head# 2024-04-01T19:43:01.297 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.297 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a2bb178:::benchmark_data_smithi188_119427_object80472:head# 2024-04-01T19:43:01.298 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.298 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a2d543b:::benchmark_data_smithi188_119427_object154333:head# 2024-04-01T19:43:01.298 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.298 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a2d67e0:::benchmark_data_smithi188_119427_object127628:head# 2024-04-01T19:43:01.298 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.298 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a2ddab1:::benchmark_data_smithi188_119427_object98857:head# 2024-04-01T19:43:01.298 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.299 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a2ea55e:::benchmark_data_smithi188_119427_object152371:head# 2024-04-01T19:43:01.299 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.299 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a2ed11c:::benchmark_data_smithi188_119427_object136920:head# 2024-04-01T19:43:01.299 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.300 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a2eff2f:::benchmark_data_smithi188_119427_object85794:head# 2024-04-01T19:43:01.300 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.300 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a2f04fb:::benchmark_data_smithi188_119427_object120515:head# 2024-04-01T19:43:01.300 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.300 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a2f5002:::benchmark_data_smithi188_119427_object162673:head# 2024-04-01T19:43:01.300 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.300 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a2f8001:::benchmark_data_smithi188_119427_object152194:head# 2024-04-01T19:43:01.300 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.300 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a2faf5e:::benchmark_data_smithi188_119427_object139392:head# 2024-04-01T19:43:01.300 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.300 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a2fb31e:::benchmark_data_smithi188_119427_object91926:head# 2024-04-01T19:43:01.300 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.301 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a2fb3af:::benchmark_data_smithi188_119427_object130330:head# 2024-04-01T19:43:01.301 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.301 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a315c55:::benchmark_data_smithi188_119427_object134520:head# 2024-04-01T19:43:01.301 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.301 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a31b724:::benchmark_data_smithi188_119427_object129521:head# 2024-04-01T19:43:01.302 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.302 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a33146a:::benchmark_data_smithi188_119427_object81739:head# 2024-04-01T19:43:01.302 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.305 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a339755:::benchmark_data_smithi188_119427_object108029:head# 2024-04-01T19:43:01.305 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.306 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a33b690:::benchmark_data_smithi188_119427_object111030:head# 2024-04-01T19:43:01.306 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.306 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a34028f:::benchmark_data_smithi188_119427_object117456:head# 2024-04-01T19:43:01.306 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.307 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a348959:::benchmark_data_smithi188_119427_object151306:head# 2024-04-01T19:43:01.307 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.307 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a34c011:::benchmark_data_smithi188_119427_object100953:head# 2024-04-01T19:43:01.307 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.307 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a350de5:::benchmark_data_smithi188_119427_object117645:head# 2024-04-01T19:43:01.307 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.308 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a351b42:::benchmark_data_smithi188_119427_object87449:head# 2024-04-01T19:43:01.308 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.308 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a352fb9:::benchmark_data_smithi188_119427_object143815:head# 2024-04-01T19:43:01.308 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.309 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a3613ca:::benchmark_data_smithi188_119427_object118295:head# 2024-04-01T19:43:01.309 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.309 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a3655fb:::benchmark_data_smithi188_119427_object122870:head# 2024-04-01T19:43:01.309 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.309 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a374a1b:::benchmark_data_smithi188_119427_object120597:head# 2024-04-01T19:43:01.309 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.310 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a3757d1:::benchmark_data_smithi188_119427_object91513:head# 2024-04-01T19:43:01.310 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.310 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a378bf6:::benchmark_data_smithi188_119427_object116984:head# 2024-04-01T19:43:01.310 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.310 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a3791f9:::benchmark_data_smithi188_119427_object77906:head# 2024-04-01T19:43:01.310 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.310 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a37c808:::benchmark_data_smithi188_119427_object84417:head# 2024-04-01T19:43:01.310 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.310 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a37e11e:::benchmark_data_smithi188_119427_object164185:head# 2024-04-01T19:43:01.310 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.312 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a382109:::benchmark_data_smithi188_119427_object92882:head# 2024-04-01T19:43:01.312 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.312 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a385487:::benchmark_data_smithi188_119427_object132237:head# 2024-04-01T19:43:01.312 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.312 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a395280:::benchmark_data_smithi188_119427_object94579:head# 2024-04-01T19:43:01.313 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.313 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a3b8499:::benchmark_data_smithi188_119427_object109586:head# 2024-04-01T19:43:01.313 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.313 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a3ca93d:::benchmark_data_smithi188_119427_object141357:head# 2024-04-01T19:43:01.313 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.313 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a3ceb79:::benchmark_data_smithi188_119427_object133869:head# 2024-04-01T19:43:01.313 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.313 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a3dd41d:::benchmark_data_smithi188_119427_object142687:head# 2024-04-01T19:43:01.313 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.313 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a3eb47a:::benchmark_data_smithi188_119427_object96273:head# 2024-04-01T19:43:01.313 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.313 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a3f8b96:::benchmark_data_smithi188_119427_object144453:head# 2024-04-01T19:43:01.313 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.315 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a3fb23f:::benchmark_data_smithi188_119427_object130214:head# 2024-04-01T19:43:01.315 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.315 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a3ffe13:::benchmark_data_smithi188_119427_object94069:head# 2024-04-01T19:43:01.315 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.315 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a40740c:::benchmark_data_smithi188_119427_object123713:head# 2024-04-01T19:43:01.315 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.316 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a4088d4:::benchmark_data_smithi188_119427_object113740:head# 2024-04-01T19:43:01.316 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.316 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a40d527:::benchmark_data_smithi188_119427_object157610:head# 2024-04-01T19:43:01.316 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.316 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a40dbdf:::benchmark_data_smithi188_119427_object88834:head# 2024-04-01T19:43:01.316 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.316 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a422985:::benchmark_data_smithi188_119427_object121929:head# 2024-04-01T19:43:01.316 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.316 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a424144:::benchmark_data_smithi188_119427_object151732:head# 2024-04-01T19:43:01.316 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.316 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a425904:::benchmark_data_smithi188_119427_object99980:head# 2024-04-01T19:43:01.316 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.316 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a42d282:::benchmark_data_smithi188_119427_object82873:head# 2024-04-01T19:43:01.317 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.317 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a453b53:::benchmark_data_smithi188_119427_object85610:head# 2024-04-01T19:43:01.317 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.317 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a45a47b:::benchmark_data_smithi188_119427_object73402:head# 2024-04-01T19:43:01.317 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.319 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a45d7d9:::benchmark_data_smithi188_119427_object111491:head# 2024-04-01T19:43:01.319 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.319 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a475ce7:::benchmark_data_smithi188_119427_object101619:head# 2024-04-01T19:43:01.319 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.319 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a476d1f:::benchmark_data_smithi188_119427_object86698:head# 2024-04-01T19:43:01.320 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.320 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a484bad:::benchmark_data_smithi188_119427_object83237:head# 2024-04-01T19:43:01.320 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.320 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a485a18:::benchmark_data_smithi188_119427_object154682:head# 2024-04-01T19:43:01.320 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.320 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a493f52:::benchmark_data_smithi188_119427_object116700:head# 2024-04-01T19:43:01.320 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.320 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a49ea23:::benchmark_data_smithi188_119427_object80230:head# 2024-04-01T19:43:01.320 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.320 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a4a56e1:::benchmark_data_smithi188_119427_object132520:head# 2024-04-01T19:43:01.320 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.320 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a4bbbef:::benchmark_data_smithi188_119427_object144054:head# 2024-04-01T19:43:01.320 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.320 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a4be12a:::benchmark_data_smithi188_119427_object139851:head# 2024-04-01T19:43:01.321 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.321 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a4c5d80:::benchmark_data_smithi188_119427_object101980:head# 2024-04-01T19:43:01.321 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.321 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a4cc4d2:::benchmark_data_smithi188_119427_object162284:head# 2024-04-01T19:43:01.321 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.321 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a4d9e9a:::benchmark_data_smithi188_119427_object87112:head# 2024-04-01T19:43:01.321 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.321 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a500a7b:::benchmark_data_smithi188_119427_object143728:head# 2024-04-01T19:43:01.321 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.321 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a5134c0:::benchmark_data_smithi188_119427_object121599:head# 2024-04-01T19:43:01.321 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.322 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a51ad74:::benchmark_data_smithi188_119427_object147020:head# 2024-04-01T19:43:01.322 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.322 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a51d267:::benchmark_data_smithi188_119427_object125578:head# 2024-04-01T19:43:01.322 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.322 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a51f7cc:::benchmark_data_smithi188_119427_object79403:head# 2024-04-01T19:43:01.322 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.322 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a542046:::benchmark_data_smithi188_119427_object159621:head# 2024-04-01T19:43:01.322 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.322 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a569d79:::benchmark_data_smithi188_119427_object112257:head# 2024-04-01T19:43:01.322 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.322 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a56aceb:::benchmark_data_smithi188_119427_object133559:head# 2024-04-01T19:43:01.323 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.323 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a57103b:::benchmark_data_smithi188_119427_object89891:head# 2024-04-01T19:43:01.323 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.323 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a57546e:::benchmark_data_smithi188_119427_object145229:head# 2024-04-01T19:43:01.323 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.323 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a576673:::benchmark_data_smithi188_119427_object113700:head# 2024-04-01T19:43:01.323 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.324 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a593455:::benchmark_data_smithi188_119427_object101473:head# 2024-04-01T19:43:01.325 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.325 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a59b382:::benchmark_data_smithi188_119427_object78938:head# 2024-04-01T19:43:01.325 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.325 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a59df71:::benchmark_data_smithi188_119427_object106910:head# 2024-04-01T19:43:01.325 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.325 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a5bc7e3:::benchmark_data_smithi188_119427_object135484:head# 2024-04-01T19:43:01.325 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.325 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a5d6f33:::benchmark_data_smithi188_119427_object145305:head# 2024-04-01T19:43:01.325 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.325 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a5db367:::benchmark_data_smithi188_119427_object117911:head# 2024-04-01T19:43:01.325 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.325 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a5dc81b:::benchmark_data_smithi188_119427_object146263:head# 2024-04-01T19:43:01.325 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.326 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a5eba6e:::benchmark_data_smithi188_119427_object156955:head# 2024-04-01T19:43:01.326 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.328 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a5fbda6:::benchmark_data_smithi188_119427_object78991:head# 2024-04-01T19:43:01.328 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.328 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a5fcd3a:::benchmark_data_smithi188_119427_object116597:head# 2024-04-01T19:43:01.328 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.328 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a5fd344:::benchmark_data_smithi188_119427_object79813:head# 2024-04-01T19:43:01.328 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.328 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a60697a:::benchmark_data_smithi188_119427_object122874:head# 2024-04-01T19:43:01.328 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.328 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a61e1cd:::benchmark_data_smithi188_119427_object125390:head# 2024-04-01T19:43:01.328 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.329 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a6234f3:::benchmark_data_smithi188_119427_object146181:head# 2024-04-01T19:43:01.329 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.329 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a62b1da:::benchmark_data_smithi188_119427_object87416:head# 2024-04-01T19:43:01.329 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.329 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a630b66:::benchmark_data_smithi188_119427_object75839:head# 2024-04-01T19:43:01.329 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.329 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a64b03f:::benchmark_data_smithi188_119427_object108846:head# 2024-04-01T19:43:01.329 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.329 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a655048:::benchmark_data_smithi188_119427_object162446:head# 2024-04-01T19:43:01.329 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.329 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a65b868:::benchmark_data_smithi188_119427_object84675:head# 2024-04-01T19:43:01.329 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.329 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a66504f:::benchmark_data_smithi188_119427_object134291:head# 2024-04-01T19:43:01.330 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.330 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a670fd8:::benchmark_data_smithi188_119427_object123024:head# 2024-04-01T19:43:01.330 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.330 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a6792fd:::benchmark_data_smithi188_119427_object123047:head# 2024-04-01T19:43:01.330 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.332 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a684f3f:::benchmark_data_smithi188_119427_object135915:head# 2024-04-01T19:43:01.332 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.332 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a6ac84a:::benchmark_data_smithi188_119427_object135604:head# 2024-04-01T19:43:01.333 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.333 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a6b02ea:::benchmark_data_smithi188_119427_object150051:head# 2024-04-01T19:43:01.333 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.333 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a6b8863:::benchmark_data_smithi188_119427_object79661:head# 2024-04-01T19:43:01.333 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.333 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a6c7be1:::benchmark_data_smithi188_119427_object133496:head# 2024-04-01T19:43:01.333 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.333 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a6d3caf:::benchmark_data_smithi188_119427_object129581:head# 2024-04-01T19:43:01.333 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.333 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a6f228f:::benchmark_data_smithi188_119427_object74030:head# 2024-04-01T19:43:01.333 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.333 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a6fb17d:::benchmark_data_smithi188_119427_object129097:head# 2024-04-01T19:43:01.333 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.334 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a6fb311:::benchmark_data_smithi188_119427_object85724:head# 2024-04-01T19:43:01.334 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.334 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a7013ea:::benchmark_data_smithi188_119427_object109288:head# 2024-04-01T19:43:01.334 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.334 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a71c352:::benchmark_data_smithi188_119427_object79068:head# 2024-04-01T19:43:01.334 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.334 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a726498:::benchmark_data_smithi188_119427_object108612:head# 2024-04-01T19:43:01.334 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.334 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a7324d1:::benchmark_data_smithi188_119427_object150993:head# 2024-04-01T19:43:01.334 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.334 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a73ad08:::benchmark_data_smithi188_119427_object113575:head# 2024-04-01T19:43:01.334 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.334 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a73c8ef:::benchmark_data_smithi188_119427_object84448:head# 2024-04-01T19:43:01.335 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.335 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a73cc92:::benchmark_data_smithi188_119427_object88120:head# 2024-04-01T19:43:01.335 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.335 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a73cd6a:::benchmark_data_smithi188_119427_object114059:head# 2024-04-01T19:43:01.335 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.337 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a75e348:::benchmark_data_smithi188_119427_object141110:head# 2024-04-01T19:43:01.337 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.337 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a77631e:::benchmark_data_smithi188_119427_object163817:head# 2024-04-01T19:43:01.337 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.337 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a77925e:::benchmark_data_smithi188_119427_object118157:head# 2024-04-01T19:43:01.337 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.337 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a77ad32:::benchmark_data_smithi188_119427_object101606:head# 2024-04-01T19:43:01.337 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.337 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a78c05c:::benchmark_data_smithi188_119427_object89281:head# 2024-04-01T19:43:01.338 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.338 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a78cdfa:::benchmark_data_smithi188_119427_object81813:head# 2024-04-01T19:43:01.338 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.338 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a78e7af:::benchmark_data_smithi188_119427_object94847:head# 2024-04-01T19:43:01.338 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.338 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a7bc258:::benchmark_data_smithi188_119427_object128986:head# 2024-04-01T19:43:01.338 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.338 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a7c9c9a:::benchmark_data_smithi188_119427_object102897:head# 2024-04-01T19:43:01.338 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.338 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a7d2d88:::benchmark_data_smithi188_119427_object72520:head# 2024-04-01T19:43:01.338 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.338 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a7e9229:::benchmark_data_smithi188_119427_object120136:head# 2024-04-01T19:43:01.338 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.339 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a803cdc:::benchmark_data_smithi188_119427_object84657:head# 2024-04-01T19:43:01.339 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.339 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a804393:::benchmark_data_smithi188_119427_object162482:head# 2024-04-01T19:43:01.339 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.339 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a8093fa:::benchmark_data_smithi188_119427_object102861:head# 2024-04-01T19:43:01.339 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.339 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a813ea1:::benchmark_data_smithi188_119427_object108576:head# 2024-04-01T19:43:01.339 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.339 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a818a69:::benchmark_data_smithi188_119427_object150080:head# 2024-04-01T19:43:01.339 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.339 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a8383da:::benchmark_data_smithi188_119427_object160187:head# 2024-04-01T19:43:01.339 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a8405d0:::benchmark_data_smithi188_119427_object114524:head# 2024-04-01T19:43:01.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a85180e:::benchmark_data_smithi188_119427_object120481:head# 2024-04-01T19:43:01.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a852212:::benchmark_data_smithi188_119427_object116434:head# 2024-04-01T19:43:01.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a860973:::benchmark_data_smithi188_119427_object106516:head# 2024-04-01T19:43:01.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a869d6f:::benchmark_data_smithi188_119427_object104969:head# 2024-04-01T19:43:01.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a86b711:::benchmark_data_smithi188_119427_object127102:head# 2024-04-01T19:43:01.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.341 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a87350c:::benchmark_data_smithi188_119427_object81771:head# 2024-04-01T19:43:01.341 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.342 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a8765fe:::benchmark_data_smithi188_119427_object158416:head# 2024-04-01T19:43:01.342 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.343 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a87a315:::benchmark_data_smithi188_119427_object156612:head# 2024-04-01T19:43:01.343 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.343 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a87fd78:::benchmark_data_smithi188_119427_object131027:head# 2024-04-01T19:43:01.343 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.343 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a895b27:::benchmark_data_smithi188_119427_object91677:head# 2024-04-01T19:43:01.343 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.344 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a895f07:::benchmark_data_smithi188_119427_object125601:head# 2024-04-01T19:43:01.344 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.344 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a8963db:::benchmark_data_smithi188_119427_object77927:head# 2024-04-01T19:43:01.344 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.344 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a89cf75:::benchmark_data_smithi188_119427_object75862:head# 2024-04-01T19:43:01.344 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.345 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a8a713d:::benchmark_data_smithi188_119427_object93258:head# 2024-04-01T19:43:01.345 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.346 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a8a7f34:::benchmark_data_smithi188_119427_object107520:head# 2024-04-01T19:43:01.346 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.346 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a8b3a53:::benchmark_data_smithi188_119427_object109609:head# 2024-04-01T19:43:01.346 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.346 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a8c0786:::benchmark_data_smithi188_119427_object112171:head# 2024-04-01T19:43:01.346 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.346 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a8c1d51:::benchmark_data_smithi188_119427_object138069:head# 2024-04-01T19:43:01.346 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.346 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a8c3893:::benchmark_data_smithi188_119427_object117424:head# 2024-04-01T19:43:01.347 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.347 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a8d88aa:::benchmark_data_smithi188_119427_object129355:head# 2024-04-01T19:43:01.347 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.347 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a8f6d6c:::benchmark_data_smithi188_119427_object104368:head# 2024-04-01T19:43:01.348 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.348 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a906cf1:::benchmark_data_smithi188_119427_object85281:head# 2024-04-01T19:43:01.348 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.348 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a912ece:::benchmark_data_smithi188_119427_object104098:head# 2024-04-01T19:43:01.348 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.348 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a9212f4:::benchmark_data_smithi188_119427_object128091:head# 2024-04-01T19:43:01.348 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.348 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a9224d1:::benchmark_data_smithi188_119427_object87189:head# 2024-04-01T19:43:01.348 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.351 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a925d1e:::benchmark_data_smithi188_119427_object98751:head# 2024-04-01T19:43:01.351 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.351 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a926b1e:::benchmark_data_smithi188_119427_object111409:head# 2024-04-01T19:43:01.352 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.352 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a9288b4:::benchmark_data_smithi188_119427_object138670:head# 2024-04-01T19:43:01.352 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.352 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a94392c:::benchmark_data_smithi188_119427_object90166:head# 2024-04-01T19:43:01.352 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.352 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a9440ed:::benchmark_data_smithi188_119427_object120554:head# 2024-04-01T19:43:01.352 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.352 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a95762e:::benchmark_data_smithi188_119427_object139955:head# 2024-04-01T19:43:01.352 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.352 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a95aa53:::benchmark_data_smithi188_119427_object125104:head# 2024-04-01T19:43:01.353 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.353 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a9794a3:::benchmark_data_smithi188_119427_object163837:head# 2024-04-01T19:43:01.353 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.353 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a992c6d:::benchmark_data_smithi188_119427_object143424:head# 2024-04-01T19:43:01.353 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.353 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a9a203e:::benchmark_data_smithi188_119427_object77935:head# 2024-04-01T19:43:01.353 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.357 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a9a7644:::benchmark_data_smithi188_119427_object90273:head# 2024-04-01T19:43:01.357 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.360 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a9c0169:::benchmark_data_smithi188_119427_object100881:head# 2024-04-01T19:43:01.360 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.360 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a9c1419:::benchmark_data_smithi188_119427_object146416:head# 2024-04-01T19:43:01.361 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.361 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a9ca45b:::benchmark_data_smithi188_119427_object77009:head# 2024-04-01T19:43:01.361 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.361 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a9caf73:::benchmark_data_smithi188_119427_object79239:head# 2024-04-01T19:43:01.361 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.361 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:43:01.364 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a9cd3f8:::benchmark_data_smithi188_119427_object88299:head# 2024-04-01T19:43:01.364 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.364 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a9e2bc3:::benchmark_data_smithi188_119427_object134249:head# 2024-04-01T19:43:01.364 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.365 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a9ec869:::benchmark_data_smithi188_119427_object118849:head# 2024-04-01T19:43:01.365 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.365 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a9f4d8e:::benchmark_data_smithi188_119427_object127737:head# 2024-04-01T19:43:01.365 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.365 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a9f82e8:::benchmark_data_smithi188_119427_object156060:head# 2024-04-01T19:43:01.365 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.366 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4a9f9473:::benchmark_data_smithi188_119427_object85373:head# 2024-04-01T19:43:01.366 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.367 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aa103d7:::benchmark_data_smithi188_119427_object153386:head# 2024-04-01T19:43:01.367 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.367 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aa264a0:::benchmark_data_smithi188_119427_object74341:head# 2024-04-01T19:43:01.367 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.367 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aa2c119:::benchmark_data_smithi188_119427_object134434:head# 2024-04-01T19:43:01.368 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.372 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aa3c2b1:::benchmark_data_smithi188_119427_object98704:head# 2024-04-01T19:43:01.372 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.373 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aa44c4b:::benchmark_data_smithi188_119427_object90237:head# 2024-04-01T19:43:01.373 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.373 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:01.374 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:43:01.374 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aa4e61c:::benchmark_data_smithi188_119427_object127705:head# 2024-04-01T19:43:01.374 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.375 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aa50569:::benchmark_data_smithi188_119427_object100403:head# 2024-04-01T19:43:01.375 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.375 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aa5d34f:::benchmark_data_smithi188_119427_object161175:head# 2024-04-01T19:43:01.375 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.382 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aa5dc8c:::benchmark_data_smithi188_119427_object131794:head# 2024-04-01T19:43:01.382 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.382 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aa62b0f:::benchmark_data_smithi188_119427_object82189:head# 2024-04-01T19:43:01.383 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.383 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aa73ad2:::benchmark_data_smithi188_119427_object153035:head# 2024-04-01T19:43:01.383 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.383 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aa7aa11:::benchmark_data_smithi188_119427_object148787:head# 2024-04-01T19:43:01.383 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.383 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aa889eb:::benchmark_data_smithi188_119427_object113773:head# 2024-04-01T19:43:01.383 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.383 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aa890e9:::benchmark_data_smithi188_119427_object146079:head# 2024-04-01T19:43:01.383 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.385 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aaa1dc0:::benchmark_data_smithi188_119427_object111327:head# 2024-04-01T19:43:01.385 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.393 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aab0f0e:::benchmark_data_smithi188_119427_object150478:head# 2024-04-01T19:43:01.394 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.394 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aab4084:::benchmark_data_smithi188_119427_object133701:head# 2024-04-01T19:43:01.394 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.394 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aace9ad:::benchmark_data_smithi188_119427_object107315:head# 2024-04-01T19:43:01.394 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.394 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aad639b:::benchmark_data_smithi188_119427_object113122:head# 2024-04-01T19:43:01.394 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.394 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aadc1c9:::benchmark_data_smithi188_119427_object117140:head# 2024-04-01T19:43:01.394 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.394 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aaddfd8:::benchmark_data_smithi188_119427_object87703:head# 2024-04-01T19:43:01.394 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.394 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aae7e31:::benchmark_data_smithi188_119427_object105477:head# 2024-04-01T19:43:01.395 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.395 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aaf98a1:::benchmark_data_smithi188_119427_object152933:head# 2024-04-01T19:43:01.395 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.398 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ab04d1b:::benchmark_data_smithi188_119427_object113073:head# 2024-04-01T19:43:01.398 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.398 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ab0d05c:::benchmark_data_smithi188_119427_object136827:head# 2024-04-01T19:43:01.398 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.398 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ab147ff:::benchmark_data_smithi188_119427_object108929:head# 2024-04-01T19:43:01.398 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.399 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ab16729:::benchmark_data_smithi188_119427_object118961:head# 2024-04-01T19:43:01.399 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.399 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ab21131:::benchmark_data_smithi188_119427_object129098:head# 2024-04-01T19:43:01.399 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.399 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ab39afc:::benchmark_data_smithi188_119427_object162818:head# 2024-04-01T19:43:01.399 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.399 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ab43a84:::benchmark_data_smithi188_119427_object73618:head# 2024-04-01T19:43:01.399 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.399 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ab57a0d:::benchmark_data_smithi188_119427_object91602:head# 2024-04-01T19:43:01.399 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.399 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ab611f9:::benchmark_data_smithi188_119427_object126255:head# 2024-04-01T19:43:01.399 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.399 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ab61bcb:::benchmark_data_smithi188_119427_object85111:head# 2024-04-01T19:43:01.399 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.400 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ab73370:::benchmark_data_smithi188_119427_object145954:head# 2024-04-01T19:43:01.400 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.400 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ab7c4bf:::benchmark_data_smithi188_119427_object161140:head# 2024-04-01T19:43:01.400 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.400 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ab80b95:::benchmark_data_smithi188_119427_object150755:head# 2024-04-01T19:43:01.400 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.400 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ab81dbd:::benchmark_data_smithi188_119427_object136141:head# 2024-04-01T19:43:01.400 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.400 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ab83a96:::benchmark_data_smithi188_119427_object89104:head# 2024-04-01T19:43:01.400 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.400 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ab90d7d:::benchmark_data_smithi188_119427_object80314:head# 2024-04-01T19:43:01.401 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.401 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ab96993:::benchmark_data_smithi188_119427_object134054:head# 2024-04-01T19:43:01.401 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.401 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ab98c03:::benchmark_data_smithi188_119427_object143908:head# 2024-04-01T19:43:01.401 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.401 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ab9e73c:::benchmark_data_smithi188_119427_object113845:head# 2024-04-01T19:43:01.401 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.401 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4abaca8c:::benchmark_data_smithi188_119427_object85961:head# 2024-04-01T19:43:01.401 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.406 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4abaea08:::benchmark_data_smithi188_119427_object157208:head# 2024-04-01T19:43:01.406 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.406 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4abb0aec:::benchmark_data_smithi188_119427_object102944:head# 2024-04-01T19:43:01.406 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.406 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4abb2d0f:::benchmark_data_smithi188_119427_object112676:head# 2024-04-01T19:43:01.407 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.407 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4abb2d34:::benchmark_data_smithi188_119427_object164353:head# 2024-04-01T19:43:01.407 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.407 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4abbaa58:::benchmark_data_smithi188_119427_object153365:head# 2024-04-01T19:43:01.407 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.407 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4abbc99e:::benchmark_data_smithi188_119427_object162732:head# 2024-04-01T19:43:01.407 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.407 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4abcab89:::benchmark_data_smithi188_119427_object134455:head# 2024-04-01T19:43:01.407 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.407 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4abe21a1:::benchmark_data_smithi188_119427_object161394:head# 2024-04-01T19:43:01.407 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.407 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ac02220:::benchmark_data_smithi188_119427_object157130:head# 2024-04-01T19:43:01.407 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.408 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ac044f1:::benchmark_data_smithi188_119427_object164685:head# 2024-04-01T19:43:01.408 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.408 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ac04da4:::benchmark_data_smithi188_119427_object80290:head# 2024-04-01T19:43:01.408 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.408 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ac0bbb9:::benchmark_data_smithi188_119427_object119385:head# 2024-04-01T19:43:01.408 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.408 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ac0d732:::benchmark_data_smithi188_119427_object116387:head# 2024-04-01T19:43:01.408 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.408 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ac1fd80:::benchmark_data_smithi188_119427_object132094:head# 2024-04-01T19:43:01.408 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.408 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ac27ff3:::benchmark_data_smithi188_119427_object114509:head# 2024-04-01T19:43:01.408 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.408 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ac3e32a:::benchmark_data_smithi188_119427_object111274:head# 2024-04-01T19:43:01.409 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.409 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ac53296:::benchmark_data_smithi188_119427_object85702:head# 2024-04-01T19:43:01.409 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.409 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ac69036:::benchmark_data_smithi188_119427_object108429:head# 2024-04-01T19:43:01.409 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.409 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ac741ec:::benchmark_data_smithi188_119427_object116049:head# 2024-04-01T19:43:01.409 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.409 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ac8f960:::benchmark_data_smithi188_119427_object84116:head# 2024-04-01T19:43:01.409 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.409 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ac99f35:::benchmark_data_smithi188_119427_object124254:head# 2024-04-01T19:43:01.409 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.409 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aca713f:::benchmark_data_smithi188_119427_object83719:head# 2024-04-01T19:43:01.409 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.409 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4acd7b8c:::benchmark_data_smithi188_119427_object93449:head# 2024-04-01T19:43:01.410 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.410 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4acdc701:::benchmark_data_smithi188_119427_object151242:head# 2024-04-01T19:43:01.410 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.410 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4acf1d7b:::benchmark_data_smithi188_119427_object122310:head# 2024-04-01T19:43:01.410 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.410 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4acfc364:::benchmark_data_smithi188_119427_object84383:head# 2024-04-01T19:43:01.410 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.410 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4acfdc0d:::benchmark_data_smithi188_119427_object149255:head# 2024-04-01T19:43:01.410 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.410 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ad1f236:::benchmark_data_smithi188_119427_object122183:head# 2024-04-01T19:43:01.410 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.410 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ad2085f:::benchmark_data_smithi188_119427_object157301:head# 2024-04-01T19:43:01.411 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.411 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ad241e9:::benchmark_data_smithi188_119427_object143177:head# 2024-04-01T19:43:01.411 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.412 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ad34e9b:::benchmark_data_smithi188_119427_object86683:head# 2024-04-01T19:43:01.413 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.413 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ad3b568:::benchmark_data_smithi188_119427_object90400:head# 2024-04-01T19:43:01.413 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.413 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ad3d3a1:::benchmark_data_smithi188_119427_object89901:head# 2024-04-01T19:43:01.413 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.413 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ad46908:::benchmark_data_smithi188_119427_object126299:head# 2024-04-01T19:43:01.413 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.413 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ad4bdb2:::benchmark_data_smithi188_119427_object153890:head# 2024-04-01T19:43:01.413 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.413 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ad4df09:::benchmark_data_smithi188_119427_object81590:head# 2024-04-01T19:43:01.413 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.413 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ad594a6:::benchmark_data_smithi188_119427_object132657:head# 2024-04-01T19:43:01.413 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.413 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ad7007c:::benchmark_data_smithi188_119427_object135825:head# 2024-04-01T19:43:01.414 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.414 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ad85b32:::benchmark_data_smithi188_119427_object158965:head# 2024-04-01T19:43:01.414 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.414 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ad87c67:::benchmark_data_smithi188_119427_object126479:head# 2024-04-01T19:43:01.414 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.414 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ad89f93:::benchmark_data_smithi188_119427_object122645:head# 2024-04-01T19:43:01.414 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.414 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ad8ed5e:::benchmark_data_smithi188_119427_object147611:head# 2024-04-01T19:43:01.414 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.414 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ad9092c:::benchmark_data_smithi188_119427_object162456:head# 2024-04-01T19:43:01.414 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.415 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ad92b49:::benchmark_data_smithi188_119427_object126682:head# 2024-04-01T19:43:01.415 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.415 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ad99dc9:::benchmark_data_smithi188_119427_object95861:head# 2024-04-01T19:43:01.415 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.415 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ad9c0dd:::benchmark_data_smithi188_119427_object136471:head# 2024-04-01T19:43:01.415 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.417 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ad9de5c:::benchmark_data_smithi188_119427_object79217:head# 2024-04-01T19:43:01.417 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.417 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ad9deac:::benchmark_data_smithi188_119427_object88083:head# 2024-04-01T19:43:01.417 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.417 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ad9f15e:::benchmark_data_smithi188_119427_object134063:head# 2024-04-01T19:43:01.417 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.417 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ada6dc4:::benchmark_data_smithi188_119427_object77461:head# 2024-04-01T19:43:01.417 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.417 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4adac373:::benchmark_data_smithi188_119427_object98357:head# 2024-04-01T19:43:01.417 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.417 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4add89d7:::benchmark_data_smithi188_119427_object97422:head# 2024-04-01T19:43:01.417 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.419 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4adec8ee:::benchmark_data_smithi188_119427_object122298:head# 2024-04-01T19:43:01.419 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.419 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4adf1f80:::benchmark_data_smithi188_119427_object136833:head# 2024-04-01T19:43:01.419 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.419 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4adf8a5a:::benchmark_data_smithi188_119427_object154897:head# 2024-04-01T19:43:01.419 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.419 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ae09480:::benchmark_data_smithi188_119427_object109003:head# 2024-04-01T19:43:01.420 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.420 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ae152e9:::benchmark_data_smithi188_119427_object74705:head# 2024-04-01T19:43:01.420 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.420 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ae253ef:::benchmark_data_smithi188_119427_object112557:head# 2024-04-01T19:43:01.420 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.420 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ae28aa6:::benchmark_data_smithi188_119427_object112598:head# 2024-04-01T19:43:01.420 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.420 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ae2dbf3:::benchmark_data_smithi188_119427_object131370:head# 2024-04-01T19:43:01.420 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.420 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ae38c3a:::benchmark_data_smithi188_119427_object128762:head# 2024-04-01T19:43:01.420 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.423 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ae39342:::benchmark_data_smithi188_119427_object104421:head# 2024-04-01T19:43:01.423 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.423 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ae41c2c:::benchmark_data_smithi188_119427_object114645:head# 2024-04-01T19:43:01.423 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.423 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ae487c8:::benchmark_data_smithi188_119427_object116924:head# 2024-04-01T19:43:01.423 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.423 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ae54223:::benchmark_data_smithi188_119427_object92010:head# 2024-04-01T19:43:01.423 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.423 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ae5e520:::benchmark_data_smithi188_119427_object138195:head# 2024-04-01T19:43:01.423 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.423 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ae6bd70:::benchmark_data_smithi188_119427_object92391:head# 2024-04-01T19:43:01.423 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.423 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ae6c548:::benchmark_data_smithi188_119427_object106919:head# 2024-04-01T19:43:01.423 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.424 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ae7854d:::benchmark_data_smithi188_119427_object79388:head# 2024-04-01T19:43:01.424 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.424 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ae7c795:::benchmark_data_smithi188_119427_object121740:head# 2024-04-01T19:43:01.424 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.424 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ae8a6b7:::benchmark_data_smithi188_119427_object102160:head# 2024-04-01T19:43:01.424 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.424 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aea34eb:::benchmark_data_smithi188_119427_object74820:head# 2024-04-01T19:43:01.424 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.424 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aea4aac:::benchmark_data_smithi188_119427_object139966:head# 2024-04-01T19:43:01.424 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.424 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aebb51f:::benchmark_data_smithi188_119427_object86617:head# 2024-04-01T19:43:01.424 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.427 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aed28a0:::benchmark_data_smithi188_119427_object101642:head# 2024-04-01T19:43:01.427 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.427 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aed47e2:::benchmark_data_smithi188_119427_object143046:head# 2024-04-01T19:43:01.428 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.428 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aeed853:::benchmark_data_smithi188_119427_object109157:head# 2024-04-01T19:43:01.428 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.428 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4aef3242:::benchmark_data_smithi188_119427_object150144:head# 2024-04-01T19:43:01.428 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.428 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4af01128:::benchmark_data_smithi188_119427_object85792:head# 2024-04-01T19:43:01.428 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.428 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4af014f6:::benchmark_data_smithi188_119427_object147249:head# 2024-04-01T19:43:01.428 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.428 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4af0957f:::benchmark_data_smithi188_119427_object133564:head# 2024-04-01T19:43:01.428 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.428 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4af2355c:::benchmark_data_smithi188_119427_object76724:head# 2024-04-01T19:43:01.428 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.428 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4af24af1:::benchmark_data_smithi188_119427_object79732:head# 2024-04-01T19:43:01.429 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.429 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4af61c55:::benchmark_data_smithi188_119427_object75648:head# 2024-04-01T19:43:01.429 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.429 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4af809c3:::benchmark_data_smithi188_119427_object112943:head# 2024-04-01T19:43:01.429 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.429 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4af8bc24:::benchmark_data_smithi188_119427_object96771:head# 2024-04-01T19:43:01.429 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.429 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4af94180:::benchmark_data_smithi188_119427_object81176:head# 2024-04-01T19:43:01.429 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.429 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4afac59a:::benchmark_data_smithi188_119427_object125710:head# 2024-04-01T19:43:01.429 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.429 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4afad4e4:::benchmark_data_smithi188_119427_object74151:head# 2024-04-01T19:43:01.429 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.429 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4afcc584:::benchmark_data_smithi188_119427_object145617:head# 2024-04-01T19:43:01.429 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.430 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4afd051c:::benchmark_data_smithi188_119427_object93203:head# 2024-04-01T19:43:01.430 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.430 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4afd9aa2:::benchmark_data_smithi188_119427_object73338:head# 2024-04-01T19:43:01.430 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.433 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4afe41b1:::benchmark_data_smithi188_119427_object121494:head# 2024-04-01T19:43:01.433 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.433 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4afe8520:::benchmark_data_smithi188_119427_object150908:head# 2024-04-01T19:43:01.433 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.433 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4afecd13:::benchmark_data_smithi188_119427_object73752:head# 2024-04-01T19:43:01.434 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.434 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b00290f:::benchmark_data_smithi188_119427_object93098:head# 2024-04-01T19:43:01.434 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.434 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b00d03d:::benchmark_data_smithi188_119427_object136347:head# 2024-04-01T19:43:01.434 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.434 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b02025a:::benchmark_data_smithi188_119427_object78921:head# 2024-04-01T19:43:01.434 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.434 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b023f0b:::benchmark_data_smithi188_119427_object111753:head# 2024-04-01T19:43:01.434 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.434 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b0247f6:::benchmark_data_smithi188_119427_object158520:head# 2024-04-01T19:43:01.434 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.434 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b02db11:::benchmark_data_smithi188_119427_object109513:head# 2024-04-01T19:43:01.434 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.435 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b035106:::benchmark_data_smithi188_119427_object133922:head# 2024-04-01T19:43:01.435 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.435 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b047423:::benchmark_data_smithi188_119427_object145819:head# 2024-04-01T19:43:01.435 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.435 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b04c4ae:::benchmark_data_smithi188_119427_object153025:head# 2024-04-01T19:43:01.435 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.435 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b05d4cb:::benchmark_data_smithi188_119427_object152931:head# 2024-04-01T19:43:01.435 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.435 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b05ddbf:::benchmark_data_smithi188_119427_object83346:head# 2024-04-01T19:43:01.435 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.435 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b06686e:::benchmark_data_smithi188_119427_object78062:head# 2024-04-01T19:43:01.435 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.435 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b06c5a5:::benchmark_data_smithi188_119427_object114931:head# 2024-04-01T19:43:01.435 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.435 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b0707d9:::benchmark_data_smithi188_119427_object132148:head# 2024-04-01T19:43:01.436 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.436 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b078ef0:::benchmark_data_smithi188_119427_object141664:head# 2024-04-01T19:43:01.436 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.436 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b07abd7:::benchmark_data_smithi188_119427_object108091:head# 2024-04-01T19:43:01.436 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.438 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b089b35:::benchmark_data_smithi188_119427_object128249:head# 2024-04-01T19:43:01.438 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.438 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b08cdbc:::benchmark_data_smithi188_119427_object127028:head# 2024-04-01T19:43:01.438 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.438 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b08d321:::benchmark_data_smithi188_119427_object134873:head# 2024-04-01T19:43:01.438 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.438 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b08f54e:::benchmark_data_smithi188_119427_object133647:head# 2024-04-01T19:43:01.438 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.439 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b09b47c:::benchmark_data_smithi188_119427_object74624:head# 2024-04-01T19:43:01.439 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.439 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b0a5c65:::benchmark_data_smithi188_119427_object100610:head# 2024-04-01T19:43:01.439 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.439 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b0a7aeb:::benchmark_data_smithi188_119427_object102026:head# 2024-04-01T19:43:01.439 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.439 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b0adcf0:::benchmark_data_smithi188_119427_object132035:head# 2024-04-01T19:43:01.439 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.439 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b0b7071:::benchmark_data_smithi188_119427_object154457:head# 2024-04-01T19:43:01.439 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.439 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b0b9ee8:::benchmark_data_smithi188_119427_object141577:head# 2024-04-01T19:43:01.439 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.439 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b0cb771:::benchmark_data_smithi188_119427_object89326:head# 2024-04-01T19:43:01.439 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.439 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b0d1d48:::benchmark_data_smithi188_119427_object128635:head# 2024-04-01T19:43:01.440 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.440 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b0d3115:::benchmark_data_smithi188_119427_object161166:head# 2024-04-01T19:43:01.440 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.440 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b0d39ac:::benchmark_data_smithi188_119427_object162008:head# 2024-04-01T19:43:01.440 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.440 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b0d690f:::benchmark_data_smithi188_119427_object157102:head# 2024-04-01T19:43:01.440 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.442 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b0d72aa:::benchmark_data_smithi188_119427_object136620:head# 2024-04-01T19:43:01.442 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.442 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b0e5048:::benchmark_data_smithi188_119427_object115484:head# 2024-04-01T19:43:01.442 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.442 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b0e521a:::benchmark_data_smithi188_119427_object126000:head# 2024-04-01T19:43:01.442 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.442 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b10e49d:::benchmark_data_smithi188_119427_object85245:head# 2024-04-01T19:43:01.442 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.442 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b1111d9:::benchmark_data_smithi188_119427_object156515:head# 2024-04-01T19:43:01.442 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.443 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b12c7fb:::benchmark_data_smithi188_119427_object76696:head# 2024-04-01T19:43:01.443 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.443 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b12d116:::benchmark_data_smithi188_119427_object129048:head# 2024-04-01T19:43:01.443 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.443 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b13d0d7:::benchmark_data_smithi188_119427_object116681:head# 2024-04-01T19:43:01.443 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.443 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b144d3a:::benchmark_data_smithi188_119427_object106046:head# 2024-04-01T19:43:01.443 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.443 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b149a97:::benchmark_data_smithi188_119427_object97829:head# 2024-04-01T19:43:01.443 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.443 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b152de1:::benchmark_data_smithi188_119427_object148348:head# 2024-04-01T19:43:01.443 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.443 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b1544c9:::benchmark_data_smithi188_119427_object103675:head# 2024-04-01T19:43:01.443 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.444 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b15a3b2:::benchmark_data_smithi188_119427_object114054:head# 2024-04-01T19:43:01.444 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.444 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b1692aa:::benchmark_data_smithi188_119427_object82606:head# 2024-04-01T19:43:01.444 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.444 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b16aba6:::benchmark_data_smithi188_119427_object161573:head# 2024-04-01T19:43:01.444 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.444 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b17a8da:::benchmark_data_smithi188_119427_object147616:head# 2024-04-01T19:43:01.444 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.444 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b196ddb:::benchmark_data_smithi188_119427_object122857:head# 2024-04-01T19:43:01.444 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.445 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b197e04:::benchmark_data_smithi188_119427_object106923:head# 2024-04-01T19:43:01.445 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.445 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b1a648d:::benchmark_data_smithi188_119427_object135098:head# 2024-04-01T19:43:01.446 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.446 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b1a7c63:::benchmark_data_smithi188_119427_object138161:head# 2024-04-01T19:43:01.446 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.446 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b1a8e5e:::benchmark_data_smithi188_119427_object140512:head# 2024-04-01T19:43:01.446 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.446 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b1abd48:::benchmark_data_smithi188_119427_object98873:head# 2024-04-01T19:43:01.447 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.447 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b1b5f42:::benchmark_data_smithi188_119427_object91868:head# 2024-04-01T19:43:01.447 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.447 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b1bc69e:::benchmark_data_smithi188_119427_object131854:head# 2024-04-01T19:43:01.447 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.447 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b1bc871:::benchmark_data_smithi188_119427_object137395:head# 2024-04-01T19:43:01.448 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.448 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b1da260:::benchmark_data_smithi188_119427_object91791:head# 2024-04-01T19:43:01.448 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.448 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b1df443:::benchmark_data_smithi188_119427_object143013:head# 2024-04-01T19:43:01.448 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.449 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b1e2986:::benchmark_data_smithi188_119427_object150347:head# 2024-04-01T19:43:01.449 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.449 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b1ec995:::benchmark_data_smithi188_119427_object93212:head# 2024-04-01T19:43:01.449 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.449 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b1f6ed3:::benchmark_data_smithi188_119427_object127088:head# 2024-04-01T19:43:01.449 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.450 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b208e95:::benchmark_data_smithi188_119427_object151124:head# 2024-04-01T19:43:01.451 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.451 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b234063:::benchmark_data_smithi188_119427_object143110:head# 2024-04-01T19:43:01.451 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.451 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b238a87:::benchmark_data_smithi188_119427_object151149:head# 2024-04-01T19:43:01.451 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.451 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b2549b9:::benchmark_data_smithi188_119427_object120941:head# 2024-04-01T19:43:01.451 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.451 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b26a3ab:::benchmark_data_smithi188_119427_object150358:head# 2024-04-01T19:43:01.451 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.451 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b2728fa:::benchmark_data_smithi188_119427_object84830:head# 2024-04-01T19:43:01.451 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.451 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b272be3:::benchmark_data_smithi188_119427_object132612:head# 2024-04-01T19:43:01.451 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.453 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b27daf9:::benchmark_data_smithi188_119427_object124288:head# 2024-04-01T19:43:01.453 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.453 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b29304f:::benchmark_data_smithi188_119427_object155716:head# 2024-04-01T19:43:01.453 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.453 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b2a39df:::benchmark_data_smithi188_119427_object108707:head# 2024-04-01T19:43:01.453 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.454 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b2ae45e:::benchmark_data_smithi188_119427_object72958:head# 2024-04-01T19:43:01.454 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.454 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b2bc4f7:::benchmark_data_smithi188_119427_object158902:head# 2024-04-01T19:43:01.454 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.454 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b2c0168:::benchmark_data_smithi188_119427_object118174:head# 2024-04-01T19:43:01.454 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.454 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b2ddf80:::benchmark_data_smithi188_119427_object100272:head# 2024-04-01T19:43:01.454 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.454 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b2de21a:::benchmark_data_smithi188_119427_object124000:head# 2024-04-01T19:43:01.454 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.454 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b2e12cf:::benchmark_data_smithi188_119427_object130563:head# 2024-04-01T19:43:01.454 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.454 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b2f0218:::benchmark_data_smithi188_119427_object120632:head# 2024-04-01T19:43:01.454 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.456 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b2ffe1b:::benchmark_data_smithi188_119427_object131594:head# 2024-04-01T19:43:01.457 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.457 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b301f3a:::benchmark_data_smithi188_119427_object98577:head# 2024-04-01T19:43:01.457 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.457 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b3043d5:::benchmark_data_smithi188_119427_object151748:head# 2024-04-01T19:43:01.457 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.457 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b30957a:::benchmark_data_smithi188_119427_object118126:head# 2024-04-01T19:43:01.457 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.457 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b3293f1:::benchmark_data_smithi188_119427_object79899:head# 2024-04-01T19:43:01.457 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.457 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b338e52:::benchmark_data_smithi188_119427_object72840:head# 2024-04-01T19:43:01.457 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.457 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b33ad2d:::benchmark_data_smithi188_119427_object90584:head# 2024-04-01T19:43:01.457 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.458 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b3463b9:::benchmark_data_smithi188_119427_object74227:head# 2024-04-01T19:43:01.458 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.458 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b34ff02:::benchmark_data_smithi188_119427_object94633:head# 2024-04-01T19:43:01.458 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.458 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b3574a3:::benchmark_data_smithi188_119427_object104292:head# 2024-04-01T19:43:01.458 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.458 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b369c80:::benchmark_data_smithi188_119427_object107624:head# 2024-04-01T19:43:01.458 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.458 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b378830:::benchmark_data_smithi188_119427_object163860:head# 2024-04-01T19:43:01.458 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.458 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b37fa3a:::benchmark_data_smithi188_119427_object127089:head# 2024-04-01T19:43:01.458 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.462 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b382161:::benchmark_data_smithi188_119427_object126938:head# 2024-04-01T19:43:01.462 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.462 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b38fdd4:::benchmark_data_smithi188_119427_object79100:head# 2024-04-01T19:43:01.462 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.462 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b394c0c:::benchmark_data_smithi188_119427_object87092:head# 2024-04-01T19:43:01.462 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.462 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b3a1239:::benchmark_data_smithi188_119427_object101345:head# 2024-04-01T19:43:01.462 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.462 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b3af7ee:::benchmark_data_smithi188_119427_object81528:head# 2024-04-01T19:43:01.462 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.462 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b3ba53a:::benchmark_data_smithi188_119427_object86222:head# 2024-04-01T19:43:01.463 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.463 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b3c8370:::benchmark_data_smithi188_119427_object147723:head# 2024-04-01T19:43:01.463 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.463 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b3c8f55:::benchmark_data_smithi188_119427_object87948:head# 2024-04-01T19:43:01.463 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.463 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b3d3232:::benchmark_data_smithi188_119427_object96019:head# 2024-04-01T19:43:01.463 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.463 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b3e9718:::benchmark_data_smithi188_119427_object117504:head# 2024-04-01T19:43:01.463 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.463 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b3fc034:::benchmark_data_smithi188_119427_object148391:head# 2024-04-01T19:43:01.463 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.463 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b405d5b:::benchmark_data_smithi188_119427_object99578:head# 2024-04-01T19:43:01.463 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.463 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b409555:::benchmark_data_smithi188_119427_object91571:head# 2024-04-01T19:43:01.463 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.464 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b4162fe:::benchmark_data_smithi188_119427_object105021:head# 2024-04-01T19:43:01.464 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.466 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b42ec7e:::benchmark_data_smithi188_119427_object139196:head# 2024-04-01T19:43:01.466 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.466 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b437cbc:::benchmark_data_smithi188_119427_object142993:head# 2024-04-01T19:43:01.467 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.467 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b443633:::benchmark_data_smithi188_119427_object95527:head# 2024-04-01T19:43:01.467 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.467 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b4460e3:::benchmark_data_smithi188_119427_object114643:head# 2024-04-01T19:43:01.467 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.467 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b44ac92:::benchmark_data_smithi188_119427_object103859:head# 2024-04-01T19:43:01.467 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.467 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b44b2cd:::benchmark_data_smithi188_119427_object109379:head# 2024-04-01T19:43:01.467 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.467 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b44bcd8:::benchmark_data_smithi188_119427_object146145:head# 2024-04-01T19:43:01.467 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.467 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b451fbb:::benchmark_data_smithi188_119427_object89047:head# 2024-04-01T19:43:01.467 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.468 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b45356d:::benchmark_data_smithi188_119427_object91698:head# 2024-04-01T19:43:01.468 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.468 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b466f8b:::benchmark_data_smithi188_119427_object73914:head# 2024-04-01T19:43:01.468 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.468 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b469edc:::benchmark_data_smithi188_119427_object84484:head# 2024-04-01T19:43:01.468 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.468 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b471da3:::benchmark_data_smithi188_119427_object131773:head# 2024-04-01T19:43:01.468 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.468 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b480fe4:::benchmark_data_smithi188_119427_object141728:head# 2024-04-01T19:43:01.468 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.469 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b49dda2:::benchmark_data_smithi188_119427_object84214:head# 2024-04-01T19:43:01.470 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.470 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b4a3d2b:::benchmark_data_smithi188_119427_object101833:head# 2024-04-01T19:43:01.470 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.470 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b4a79d1:::benchmark_data_smithi188_119427_object75117:head# 2024-04-01T19:43:01.470 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.470 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b4bab24:::benchmark_data_smithi188_119427_object118503:head# 2024-04-01T19:43:01.470 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.470 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b4cb9cf:::benchmark_data_smithi188_119427_object78145:head# 2024-04-01T19:43:01.470 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.470 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b4d0f44:::benchmark_data_smithi188_119427_object101034:head# 2024-04-01T19:43:01.470 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.470 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b4d7b56:::benchmark_data_smithi188_119427_object80340:head# 2024-04-01T19:43:01.470 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.471 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b4e92e5:::benchmark_data_smithi188_119427_object129555:head# 2024-04-01T19:43:01.471 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.471 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b4f0f2f:::benchmark_data_smithi188_119427_object77542:head# 2024-04-01T19:43:01.471 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.471 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b4f397f:::benchmark_data_smithi188_119427_object80693:head# 2024-04-01T19:43:01.471 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.471 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b507562:::benchmark_data_smithi188_119427_object75710:head# 2024-04-01T19:43:01.471 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.472 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b50837a:::benchmark_data_smithi188_119427_object108978:head# 2024-04-01T19:43:01.473 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.473 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b50dbbc:::benchmark_data_smithi188_119427_object162118:head# 2024-04-01T19:43:01.473 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.473 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b512e6d:::benchmark_data_smithi188_119427_object126391:head# 2024-04-01T19:43:01.473 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.473 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b528286:::benchmark_data_smithi188_119427_object154337:head# 2024-04-01T19:43:01.473 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.473 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b52b09b:::benchmark_data_smithi188_119427_object81464:head# 2024-04-01T19:43:01.473 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.473 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b537eea:::benchmark_data_smithi188_119427_object107415:head# 2024-04-01T19:43:01.473 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.473 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b53a6cf:::benchmark_data_smithi188_119427_object161900:head# 2024-04-01T19:43:01.473 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.474 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b5424e8:::benchmark_data_smithi188_119427_object121970:head# 2024-04-01T19:43:01.474 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.474 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b5557bf:::benchmark_data_smithi188_119427_object98042:head# 2024-04-01T19:43:01.474 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.474 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b568f01:::benchmark_data_smithi188_119427_object103995:head# 2024-04-01T19:43:01.474 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.475 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b569282:::benchmark_data_smithi188_119427_object116801:head# 2024-04-01T19:43:01.475 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.475 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b56e4d2:::benchmark_data_smithi188_119427_object159277:head# 2024-04-01T19:43:01.475 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.476 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b5784e1:::benchmark_data_smithi188_119427_object92009:head# 2024-04-01T19:43:01.476 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.476 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b58071a:::benchmark_data_smithi188_119427_object103138:head# 2024-04-01T19:43:01.476 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.476 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b58e15f:::benchmark_data_smithi188_119427_object122944:head# 2024-04-01T19:43:01.476 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.476 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b59aaad:::benchmark_data_smithi188_119427_object149454:head# 2024-04-01T19:43:01.476 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.476 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b59bf4d:::benchmark_data_smithi188_119427_object113611:head# 2024-04-01T19:43:01.476 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.476 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b59dc49:::benchmark_data_smithi188_119427_object91601:head# 2024-04-01T19:43:01.476 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.476 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b5a49bb:::benchmark_data_smithi188_119427_object88750:head# 2024-04-01T19:43:01.476 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.477 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:43:01.477 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b5a9bf6:::benchmark_data_smithi188_119427_object90983:head# 2024-04-01T19:43:01.477 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.478 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b5a9c94:::benchmark_data_smithi188_119427_object74153:head# 2024-04-01T19:43:01.478 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.479 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b5ab02c:::benchmark_data_smithi188_119427_object136977:head# 2024-04-01T19:43:01.479 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.479 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b5af640:::benchmark_data_smithi188_119427_object133616:head# 2024-04-01T19:43:01.479 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.479 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b5b7f18:::benchmark_data_smithi188_119427_object128646:head# 2024-04-01T19:43:01.479 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.480 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b5bffe3:::benchmark_data_smithi188_119427_object92308:head# 2024-04-01T19:43:01.480 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.480 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b5ca695:::benchmark_data_smithi188_119427_object92920:head# 2024-04-01T19:43:01.480 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.480 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b5cf7d5:::benchmark_data_smithi188_119427_object110005:head# 2024-04-01T19:43:01.480 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.482 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b5dc3c2:::benchmark_data_smithi188_119427_object138942:head# 2024-04-01T19:43:01.482 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.482 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b5ed36c:::benchmark_data_smithi188_119427_object141593:head# 2024-04-01T19:43:01.482 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.483 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b60a073:::benchmark_data_smithi188_119427_object78280:head# 2024-04-01T19:43:01.483 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.483 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b61839f:::benchmark_data_smithi188_119427_object84628:head# 2024-04-01T19:43:01.483 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.483 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b61aaa7:::benchmark_data_smithi188_119427_object128047:head# 2024-04-01T19:43:01.483 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.483 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b6235bf:::benchmark_data_smithi188_119427_object132058:head# 2024-04-01T19:43:01.483 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.483 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b62367f:::benchmark_data_smithi188_119427_object74338:head# 2024-04-01T19:43:01.483 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.483 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b64f059:::benchmark_data_smithi188_119427_object158630:head# 2024-04-01T19:43:01.483 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.484 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b64ffe1:::benchmark_data_smithi188_119427_object100288:head# 2024-04-01T19:43:01.484 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.484 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b65e540:::benchmark_data_smithi188_119427_object87363:head# 2024-04-01T19:43:01.484 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.484 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b67e1b2:::benchmark_data_smithi188_119427_object158513:head# 2024-04-01T19:43:01.484 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.484 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b681d75:::benchmark_data_smithi188_119427_object72748:head# 2024-04-01T19:43:01.484 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.487 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b68478e:::benchmark_data_smithi188_119427_object132776:head# 2024-04-01T19:43:01.487 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.487 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b688cac:::benchmark_data_smithi188_119427_object96377:head# 2024-04-01T19:43:01.487 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.487 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b690530:::benchmark_data_smithi188_119427_object103717:head# 2024-04-01T19:43:01.487 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.487 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b6a0487:::benchmark_data_smithi188_119427_object146548:head# 2024-04-01T19:43:01.487 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.487 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b6a7fbb:::benchmark_data_smithi188_119427_object106113:head# 2024-04-01T19:43:01.487 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.487 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b6ad0ce:::benchmark_data_smithi188_119427_object132995:head# 2024-04-01T19:43:01.487 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.487 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b6c9b2e:::benchmark_data_smithi188_119427_object97970:head# 2024-04-01T19:43:01.488 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.488 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b6d036c:::benchmark_data_smithi188_119427_object125503:head# 2024-04-01T19:43:01.488 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.488 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b6d04af:::benchmark_data_smithi188_119427_object162509:head# 2024-04-01T19:43:01.488 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.488 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b6d0ef2:::benchmark_data_smithi188_119427_object147645:head# 2024-04-01T19:43:01.488 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.488 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b6db78b:::benchmark_data_smithi188_119427_object76665:head# 2024-04-01T19:43:01.488 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.488 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b6e4108:::benchmark_data_smithi188_119427_object124939:head# 2024-04-01T19:43:01.488 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.488 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b6ef63d:::benchmark_data_smithi188_119427_object135680:head# 2024-04-01T19:43:01.488 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.489 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b6fa496:::benchmark_data_smithi188_119427_object107983:head# 2024-04-01T19:43:01.489 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.489 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b6fceaa:::benchmark_data_smithi188_119427_object125471:head# 2024-04-01T19:43:01.489 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.489 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b7082ba:::benchmark_data_smithi188_119427_object102656:head# 2024-04-01T19:43:01.489 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.489 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b70f900:::benchmark_data_smithi188_119427_object158263:head# 2024-04-01T19:43:01.489 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.490 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b71ab30:::benchmark_data_smithi188_119427_object113790:head# 2024-04-01T19:43:01.490 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.490 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b72d4a8:::benchmark_data_smithi188_119427_object151380:head# 2024-04-01T19:43:01.491 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.491 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b72e7d4:::benchmark_data_smithi188_119427_object127396:head# 2024-04-01T19:43:01.491 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.491 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b736585:::benchmark_data_smithi188_119427_object89416:head# 2024-04-01T19:43:01.491 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.491 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b744403:::benchmark_data_smithi188_119427_object156033:head# 2024-04-01T19:43:01.491 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.491 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b746a79:::benchmark_data_smithi188_119427_object138038:head# 2024-04-01T19:43:01.491 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.491 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b74b99b:::benchmark_data_smithi188_119427_object79259:head# 2024-04-01T19:43:01.491 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.491 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b75d90b:::benchmark_data_smithi188_119427_object80927:head# 2024-04-01T19:43:01.491 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.492 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b768a88:::benchmark_data_smithi188_119427_object147956:head# 2024-04-01T19:43:01.492 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.493 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b768fd7:::benchmark_data_smithi188_119427_object92610:head# 2024-04-01T19:43:01.493 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.493 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b77314a:::benchmark_data_smithi188_119427_object91269:head# 2024-04-01T19:43:01.493 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.493 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b78995a:::benchmark_data_smithi188_119427_object160195:head# 2024-04-01T19:43:01.493 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.495 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b78acb9:::benchmark_data_smithi188_119427_object135421:head# 2024-04-01T19:43:01.495 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.495 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b78fd2a:::benchmark_data_smithi188_119427_object111801:head# 2024-04-01T19:43:01.495 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.495 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b791621:::benchmark_data_smithi188_119427_object85014:head# 2024-04-01T19:43:01.495 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.495 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b796665:::benchmark_data_smithi188_119427_object153010:head# 2024-04-01T19:43:01.495 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.495 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b79be2f:::benchmark_data_smithi188_119427_object142179:head# 2024-04-01T19:43:01.495 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.496 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b7b15c8:::benchmark_data_smithi188_119427_object161955:head# 2024-04-01T19:43:01.496 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.496 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b7b47d5:::benchmark_data_smithi188_119427_object149419:head# 2024-04-01T19:43:01.496 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.496 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b7bce49:::benchmark_data_smithi188_119427_object106148:head# 2024-04-01T19:43:01.496 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.496 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b7be258:::benchmark_data_smithi188_119427_object140869:head# 2024-04-01T19:43:01.496 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.500 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b7bf46d:::benchmark_data_smithi188_119427_object151855:head# 2024-04-01T19:43:01.500 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.500 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b7d68ea:::benchmark_data_smithi188_119427_object110736:head# 2024-04-01T19:43:01.500 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.500 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b7db7b1:::benchmark_data_smithi188_119427_object145665:head# 2024-04-01T19:43:01.500 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.500 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b7e7b16:::benchmark_data_smithi188_119427_object118299:head# 2024-04-01T19:43:01.500 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.500 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b7f36ee:::benchmark_data_smithi188_119427_object102185:head# 2024-04-01T19:43:01.500 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.500 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b7fa4f0:::benchmark_data_smithi188_119427_object93147:head# 2024-04-01T19:43:01.500 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.501 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b8082b0:::benchmark_data_smithi188_119427_object121705:head# 2024-04-01T19:43:01.501 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.501 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b830941:::benchmark_data_smithi188_119427_object96584:head# 2024-04-01T19:43:01.501 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.501 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b841e6f:::benchmark_data_smithi188_119427_object114061:head# 2024-04-01T19:43:01.501 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.501 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b84a9a6:::benchmark_data_smithi188_119427_object106831:head# 2024-04-01T19:43:01.501 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.501 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b84c365:::benchmark_data_smithi188_119427_object124150:head# 2024-04-01T19:43:01.501 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.501 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b853ef1:::benchmark_data_smithi188_119427_object72731:head# 2024-04-01T19:43:01.501 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.501 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b8a7c3d:::benchmark_data_smithi188_119427_object161084:head# 2024-04-01T19:43:01.501 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.501 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b8bf2e2:::benchmark_data_smithi188_119427_object83947:head# 2024-04-01T19:43:01.502 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.502 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b8c6c21:::benchmark_data_smithi188_119427_object121532:head# 2024-04-01T19:43:01.502 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.502 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b8e5774:::benchmark_data_smithi188_119427_object117807:head# 2024-04-01T19:43:01.502 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.502 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b906a8e:::benchmark_data_smithi188_119427_object156945:head# 2024-04-01T19:43:01.502 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.502 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b914fef:::benchmark_data_smithi188_119427_object78607:head# 2024-04-01T19:43:01.502 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.502 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b917af0:::benchmark_data_smithi188_119427_object90051:head# 2024-04-01T19:43:01.502 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.502 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b922574:::benchmark_data_smithi188_119427_object102452:head# 2024-04-01T19:43:01.502 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.506 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b94b293:::benchmark_data_smithi188_119427_object102333:head# 2024-04-01T19:43:01.506 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.506 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b94bcc6:::benchmark_data_smithi188_119427_object82766:head# 2024-04-01T19:43:01.506 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.506 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b94c9de:::benchmark_data_smithi188_119427_object136676:head# 2024-04-01T19:43:01.506 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.506 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b95e77d:::benchmark_data_smithi188_119427_object99741:head# 2024-04-01T19:43:01.506 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.507 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b95ea3f:::benchmark_data_smithi188_119427_object86616:head# 2024-04-01T19:43:01.507 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.507 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b965724:::benchmark_data_smithi188_119427_object136882:head# 2024-04-01T19:43:01.507 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.507 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b96612e:::benchmark_data_smithi188_119427_object134293:head# 2024-04-01T19:43:01.507 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.507 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b976699:::benchmark_data_smithi188_119427_object142511:head# 2024-04-01T19:43:01.507 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.507 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b982418:::benchmark_data_smithi188_119427_object92708:head# 2024-04-01T19:43:01.507 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.507 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b991812:::benchmark_data_smithi188_119427_object141760:head# 2024-04-01T19:43:01.507 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.507 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b992b9f:::benchmark_data_smithi188_119427_object139061:head# 2024-04-01T19:43:01.508 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.508 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b9996e7:::benchmark_data_smithi188_119427_object154849:head# 2024-04-01T19:43:01.508 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.508 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b9aadb4:::benchmark_data_smithi188_119427_object81985:head# 2024-04-01T19:43:01.508 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.508 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b9c04ce:::benchmark_data_smithi188_119427_object146580:head# 2024-04-01T19:43:01.508 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.508 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b9c055a:::benchmark_data_smithi188_119427_object113329:head# 2024-04-01T19:43:01.508 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.508 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b9c10cf:::benchmark_data_smithi188_119427_object80964:head# 2024-04-01T19:43:01.508 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.508 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b9c892f:::benchmark_data_smithi188_119427_object101103:head# 2024-04-01T19:43:01.508 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.508 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b9cb266:::benchmark_data_smithi188_119427_object90560:head# 2024-04-01T19:43:01.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b9e05e4:::benchmark_data_smithi188_119427_object91020:head# 2024-04-01T19:43:01.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b9e560b:::benchmark_data_smithi188_119427_object150099:head# 2024-04-01T19:43:01.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b9f217d:::benchmark_data_smithi188_119427_object78892:head# 2024-04-01T19:43:01.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4b9f8eae:::benchmark_data_smithi188_119427_object89419:head# 2024-04-01T19:43:01.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ba08b77:::benchmark_data_smithi188_119427_object124740:head# 2024-04-01T19:43:01.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.509 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ba10b9a:::benchmark_data_smithi188_119427_object146539:head# 2024-04-01T19:43:01.509 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.511 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ba20af7:::benchmark_data_smithi188_119427_object95611:head# 2024-04-01T19:43:01.511 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.511 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ba37218:::benchmark_data_smithi188_119427_object148589:head# 2024-04-01T19:43:01.511 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.511 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ba3ceca:::benchmark_data_smithi188_119427_object86123:head# 2024-04-01T19:43:01.511 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.511 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ba4b6a1:::benchmark_data_smithi188_119427_object161370:head# 2024-04-01T19:43:01.512 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.512 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ba4b9c1:::benchmark_data_smithi188_119427_object88758:head# 2024-04-01T19:43:01.512 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.512 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ba4f986:::benchmark_data_smithi188_119427_object98906:head# 2024-04-01T19:43:01.512 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.512 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ba600db:::benchmark_data_smithi188_119427_object92405:head# 2024-04-01T19:43:01.512 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.512 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ba622db:::benchmark_data_smithi188_119427_object92728:head# 2024-04-01T19:43:01.512 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.512 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ba90161:::benchmark_data_smithi188_119427_object85108:head# 2024-04-01T19:43:01.512 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.512 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4baabe1c:::benchmark_data_smithi188_119427_object162172:head# 2024-04-01T19:43:01.512 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.512 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4baaf44d:::benchmark_data_smithi188_119427_object148736:head# 2024-04-01T19:43:01.513 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.513 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bab239f:::benchmark_data_smithi188_119427_object106084:head# 2024-04-01T19:43:01.513 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.513 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bad26cd:::benchmark_data_smithi188_119427_object135350:head# 2024-04-01T19:43:01.513 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.513 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bae1c93:::benchmark_data_smithi188_119427_object100333:head# 2024-04-01T19:43:01.513 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.513 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bae523e:::benchmark_data_smithi188_119427_object159423:head# 2024-04-01T19:43:01.513 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.513 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bae56f3:::benchmark_data_smithi188_119427_object152042:head# 2024-04-01T19:43:01.513 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.513 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bae8964:::benchmark_data_smithi188_119427_object118407:head# 2024-04-01T19:43:01.513 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.514 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4baea781:::benchmark_data_smithi188_119427_object142901:head# 2024-04-01T19:43:01.514 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.514 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4baf5ab6:::benchmark_data_smithi188_119427_object76924:head# 2024-04-01T19:43:01.514 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.516 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bb006eb:::benchmark_data_smithi188_119427_object80875:head# 2024-04-01T19:43:01.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.517 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bb03d81:::benchmark_data_smithi188_119427_object92107:head# 2024-04-01T19:43:01.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.517 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bb26022:::benchmark_data_smithi188_119427_object102134:head# 2024-04-01T19:43:01.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.517 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bb28f5c:::benchmark_data_smithi188_119427_object121736:head# 2024-04-01T19:43:01.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.517 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bb418ab:::benchmark_data_smithi188_119427_object138979:head# 2024-04-01T19:43:01.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.517 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bb4682e:::benchmark_data_smithi188_119427_object147504:head# 2024-04-01T19:43:01.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.517 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bb47822:::benchmark_data_smithi188_119427_object101329:head# 2024-04-01T19:43:01.517 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.518 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bb69d9a:::benchmark_data_smithi188_119427_object145396:head# 2024-04-01T19:43:01.518 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.518 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bb76c35:::benchmark_data_smithi188_119427_object104661:head# 2024-04-01T19:43:01.518 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.518 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bb81f4f:::benchmark_data_smithi188_119427_object117474:head# 2024-04-01T19:43:01.518 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.518 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bb9e9c7:::benchmark_data_smithi188_119427_object108430:head# 2024-04-01T19:43:01.518 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.518 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bbbee1f:::benchmark_data_smithi188_119427_object97031:head# 2024-04-01T19:43:01.518 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.518 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bbc56c8:::benchmark_data_smithi188_119427_object106249:head# 2024-04-01T19:43:01.518 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.518 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bbc74f7:::benchmark_data_smithi188_119427_object117013:head# 2024-04-01T19:43:01.519 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.519 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bbcdd56:::benchmark_data_smithi188_119427_object80198:head# 2024-04-01T19:43:01.519 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.519 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bbe6046:::benchmark_data_smithi188_119427_object103837:head# 2024-04-01T19:43:01.519 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.519 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bbe7bb3:::benchmark_data_smithi188_119427_object142962:head# 2024-04-01T19:43:01.519 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.519 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bbe93b7:::benchmark_data_smithi188_119427_object110068:head# 2024-04-01T19:43:01.519 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.519 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bbea8ec:::benchmark_data_smithi188_119427_object123990:head# 2024-04-01T19:43:01.519 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.519 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bbf7316:::benchmark_data_smithi188_119427_object143045:head# 2024-04-01T19:43:01.519 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bc02f20:::benchmark_data_smithi188_119427_object107949:head# 2024-04-01T19:43:01.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bc10f17:::benchmark_data_smithi188_119427_object129205:head# 2024-04-01T19:43:01.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bc1274b:::benchmark_data_smithi188_119427_object79484:head# 2024-04-01T19:43:01.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bc2e6ca:::benchmark_data_smithi188_119427_object141325:head# 2024-04-01T19:43:01.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bc30cdd:::benchmark_data_smithi188_119427_object96941:head# 2024-04-01T19:43:01.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bc351e8:::benchmark_data_smithi188_119427_object112231:head# 2024-04-01T19:43:01.524 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.524 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bc37769:::benchmark_data_smithi188_119427_object148906:head# 2024-04-01T19:43:01.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.525 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bc4c4ab:::benchmark_data_smithi188_119427_object143559:head# 2024-04-01T19:43:01.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.525 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bc5a533:::benchmark_data_smithi188_119427_object162353:head# 2024-04-01T19:43:01.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.525 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bc5b6f3:::benchmark_data_smithi188_119427_object152320:head# 2024-04-01T19:43:01.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.525 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bc6670d:::benchmark_data_smithi188_119427_object103732:head# 2024-04-01T19:43:01.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.525 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bc6997d:::benchmark_data_smithi188_119427_object155835:head# 2024-04-01T19:43:01.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.525 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bc6d01b:::benchmark_data_smithi188_119427_object159745:head# 2024-04-01T19:43:01.525 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.526 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bc7f363:::benchmark_data_smithi188_119427_object130648:head# 2024-04-01T19:43:01.526 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.526 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bc97120:::benchmark_data_smithi188_119427_object101402:head# 2024-04-01T19:43:01.526 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.526 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bcb10a9:::benchmark_data_smithi188_119427_object152618:head# 2024-04-01T19:43:01.526 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.526 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bcb619f:::benchmark_data_smithi188_119427_object90394:head# 2024-04-01T19:43:01.526 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.526 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bcc14fa:::benchmark_data_smithi188_119427_object113152:head# 2024-04-01T19:43:01.526 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.526 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bcd8535:::benchmark_data_smithi188_119427_object139157:head# 2024-04-01T19:43:01.526 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.526 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bcd8bc8:::benchmark_data_smithi188_119427_object155462:head# 2024-04-01T19:43:01.527 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.527 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bcd9156:::benchmark_data_smithi188_119427_object126257:head# 2024-04-01T19:43:01.527 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.527 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bcdd22b:::benchmark_data_smithi188_119427_object160625:head# 2024-04-01T19:43:01.527 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.527 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bce1d8e:::benchmark_data_smithi188_119427_object86147:head# 2024-04-01T19:43:01.527 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.527 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bcef85d:::benchmark_data_smithi188_119427_object156107:head# 2024-04-01T19:43:01.527 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.527 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bd0e5bd:::benchmark_data_smithi188_119427_object110581:head# 2024-04-01T19:43:01.527 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.527 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bd12209:::benchmark_data_smithi188_119427_object160974:head# 2024-04-01T19:43:01.527 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:01 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3357618881' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:43:01.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:01 smithi022 ceph-mon[39439]: from='client.36224 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:43:01.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:01 smithi022 ceph-mon[39439]: pgmap v1226: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.0 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 796 op/s 2024-04-01T19:43:01.528 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:01.534 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bd28b2c:::benchmark_data_smithi188_119427_object126551:head# 2024-04-01T19:43:01.534 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.534 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bd2ec3f:::benchmark_data_smithi188_119427_object152135:head# 2024-04-01T19:43:01.534 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.534 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bd32b1b:::benchmark_data_smithi188_119427_object118085:head# 2024-04-01T19:43:01.534 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.535 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bd40243:::benchmark_data_smithi188_119427_object72863:head# 2024-04-01T19:43:01.535 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.535 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bd40853:::benchmark_data_smithi188_119427_object137570:head# 2024-04-01T19:43:01.535 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.535 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bd4d6c5:::benchmark_data_smithi188_119427_object144397:head# 2024-04-01T19:43:01.535 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.535 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bd79fee:::benchmark_data_smithi188_119427_object81873:head# 2024-04-01T19:43:01.535 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.535 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bd87980:::benchmark_data_smithi188_119427_object126999:head# 2024-04-01T19:43:01.535 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.535 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bd9cdea:::benchmark_data_smithi188_119427_object128295:head# 2024-04-01T19:43:01.535 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.535 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bdac337:::benchmark_data_smithi188_119427_object108304:head# 2024-04-01T19:43:01.535 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.536 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bdacb06:::benchmark_data_smithi188_119427_object111752:head# 2024-04-01T19:43:01.536 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.536 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bdb7224:::benchmark_data_smithi188_119427_object78165:head# 2024-04-01T19:43:01.536 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.536 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bdd42d3:::benchmark_data_smithi188_119427_object102370:head# 2024-04-01T19:43:01.536 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.536 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bdf189b:::benchmark_data_smithi188_119427_object106485:head# 2024-04-01T19:43:01.536 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.536 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bdfbfe3:::benchmark_data_smithi188_119427_object113758:head# 2024-04-01T19:43:01.536 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.536 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4be07257:::benchmark_data_smithi188_119427_object129471:head# 2024-04-01T19:43:01.536 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.536 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4be25258:::benchmark_data_smithi188_119427_object117355:head# 2024-04-01T19:43:01.536 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4be53810:::benchmark_data_smithi188_119427_object139766:head# 2024-04-01T19:43:01.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4be6075f:::benchmark_data_smithi188_119427_object86479:head# 2024-04-01T19:43:01.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4be6650e:::benchmark_data_smithi188_119427_object125229:head# 2024-04-01T19:43:01.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4be66992:::benchmark_data_smithi188_119427_object160296:head# 2024-04-01T19:43:01.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4be790e8:::benchmark_data_smithi188_119427_object98583:head# 2024-04-01T19:43:01.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4be96795:::benchmark_data_smithi188_119427_object144992:head# 2024-04-01T19:43:01.537 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.537 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4be9a2e3:::benchmark_data_smithi188_119427_object87827:head# 2024-04-01T19:43:01.538 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.538 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4be9d42d:::benchmark_data_smithi188_119427_object147456:head# 2024-04-01T19:43:01.538 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.538 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4be9d974:::benchmark_data_smithi188_119427_object122656:head# 2024-04-01T19:43:01.538 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.538 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4beb3bb8:::benchmark_data_smithi188_119427_object119307:head# 2024-04-01T19:43:01.538 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.538 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bed25cc:::benchmark_data_smithi188_119427_object158638:head# 2024-04-01T19:43:01.538 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.538 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bed9932:::benchmark_data_smithi188_119427_object141879:head# 2024-04-01T19:43:01.538 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.538 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bedc62c:::benchmark_data_smithi188_119427_object109701:head# 2024-04-01T19:43:01.538 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.539 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bedf14d:::benchmark_data_smithi188_119427_object140265:head# 2024-04-01T19:43:01.539 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.539 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bee51ca:::benchmark_data_smithi188_119427_object82465:head# 2024-04-01T19:43:01.539 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.539 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bf092f4:::benchmark_data_smithi188_119427_object157881:head# 2024-04-01T19:43:01.539 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.539 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bf1a5d8:::benchmark_data_smithi188_119427_object94354:head# 2024-04-01T19:43:01.539 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.539 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bf28bf6:::benchmark_data_smithi188_119427_object75647:head# 2024-04-01T19:43:01.539 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.539 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bf28fdf:::benchmark_data_smithi188_119427_object130041:head# 2024-04-01T19:43:01.539 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.539 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bf2cd27:::benchmark_data_smithi188_119427_object161021:head# 2024-04-01T19:43:01.539 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.540 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bf2e7a7:::benchmark_data_smithi188_119427_object147077:head# 2024-04-01T19:43:01.540 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.540 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bf37595:::benchmark_data_smithi188_119427_object126662:head# 2024-04-01T19:43:01.540 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.540 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bf45c4e:::benchmark_data_smithi188_119427_object84982:head# 2024-04-01T19:43:01.540 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.543 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bf4bf56:::benchmark_data_smithi188_119427_object86371:head# 2024-04-01T19:43:01.543 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.543 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bf54bc2:::benchmark_data_smithi188_119427_object85691:head# 2024-04-01T19:43:01.544 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.544 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bf5afe5:::benchmark_data_smithi188_119427_object136633:head# 2024-04-01T19:43:01.544 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.544 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bf5ee40:::benchmark_data_smithi188_119427_object160641:head# 2024-04-01T19:43:01.544 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.544 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bf6e011:::benchmark_data_smithi188_119427_object157558:head# 2024-04-01T19:43:01.544 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.544 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bf7a28f:::benchmark_data_smithi188_119427_object75087:head# 2024-04-01T19:43:01.544 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.544 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bf7f227:::benchmark_data_smithi188_119427_object142770:head# 2024-04-01T19:43:01.544 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.544 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bf81b18:::benchmark_data_smithi188_119427_object119640:head# 2024-04-01T19:43:01.544 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.545 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bf9ac0b:::benchmark_data_smithi188_119427_object110757:head# 2024-04-01T19:43:01.545 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.545 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bf9f6c6:::benchmark_data_smithi188_119427_object101892:head# 2024-04-01T19:43:01.545 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.545 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bfa6915:::benchmark_data_smithi188_119427_object135709:head# 2024-04-01T19:43:01.545 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.545 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bfb1cf0:::benchmark_data_smithi188_119427_object126184:head# 2024-04-01T19:43:01.545 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.545 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bfc7d43:::benchmark_data_smithi188_119427_object95641:head# 2024-04-01T19:43:01.545 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.545 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4bfd351f:::benchmark_data_smithi188_119427_object116185:head# 2024-04-01T19:43:01.545 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.545 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c0037ef:::benchmark_data_smithi188_119427_object74992:head# 2024-04-01T19:43:01.545 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.545 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c01f093:::benchmark_data_smithi188_119427_object79849:head# 2024-04-01T19:43:01.546 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.546 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c02be1d:::benchmark_data_smithi188_119427_object157714:head# 2024-04-01T19:43:01.546 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.546 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c03635c:::benchmark_data_smithi188_119427_object122633:head# 2024-04-01T19:43:01.546 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.546 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c037478:::benchmark_data_smithi188_119427_object104925:head# 2024-04-01T19:43:01.546 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.546 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c045ddd:::benchmark_data_smithi188_119427_object85004:head# 2024-04-01T19:43:01.546 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.546 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c0500ed:::benchmark_data_smithi188_119427_object111798:head# 2024-04-01T19:43:01.546 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.546 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c0569fd:::benchmark_data_smithi188_119427_object124107:head# 2024-04-01T19:43:01.547 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.547 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c05d8f8:::benchmark_data_smithi188_119427_object143484:head# 2024-04-01T19:43:01.547 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.547 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c06642b:::benchmark_data_smithi188_119427_object151428:head# 2024-04-01T19:43:01.547 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.547 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c067ece:::benchmark_data_smithi188_119427_object163856:head# 2024-04-01T19:43:01.547 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.547 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c06a3a2:::benchmark_data_smithi188_119427_object80936:head# 2024-04-01T19:43:01.547 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.547 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c06ab42:::benchmark_data_smithi188_119427_object160068:head# 2024-04-01T19:43:01.547 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.547 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c078ca9:::benchmark_data_smithi188_119427_object91081:head# 2024-04-01T19:43:01.547 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.547 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c07ce4b:::benchmark_data_smithi188_119427_object123330:head# 2024-04-01T19:43:01.548 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.548 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c0828d1:::benchmark_data_smithi188_119427_object112472:head# 2024-04-01T19:43:01.548 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.548 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c08ee12:::benchmark_data_smithi188_119427_object126323:head# 2024-04-01T19:43:01.548 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.548 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c0b27a1:::benchmark_data_smithi188_119427_object86463:head# 2024-04-01T19:43:01.548 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.548 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c0b8d73:::benchmark_data_smithi188_119427_object81142:head# 2024-04-01T19:43:01.548 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.548 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c0bb7bd:::benchmark_data_smithi188_119427_object125448:head# 2024-04-01T19:43:01.548 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.552 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c0bc7f3:::benchmark_data_smithi188_119427_object104647:head# 2024-04-01T19:43:01.552 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.552 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c0d7ea7:::benchmark_data_smithi188_119427_object125777:head# 2024-04-01T19:43:01.552 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.552 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c0fde3e:::benchmark_data_smithi188_119427_object135014:head# 2024-04-01T19:43:01.552 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.552 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c10fa05:::benchmark_data_smithi188_119427_object93101:head# 2024-04-01T19:43:01.552 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.552 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c11f007:::benchmark_data_smithi188_119427_object77581:head# 2024-04-01T19:43:01.552 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c12a48c:::benchmark_data_smithi188_119427_object83879:head# 2024-04-01T19:43:01.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c12c7de:::benchmark_data_smithi188_119427_object122929:head# 2024-04-01T19:43:01.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c137fa8:::benchmark_data_smithi188_119427_object129632:head# 2024-04-01T19:43:01.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c143945:::benchmark_data_smithi188_119427_object84042:head# 2024-04-01T19:43:01.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c148d94:::benchmark_data_smithi188_119427_object74930:head# 2024-04-01T19:43:01.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c14ec36:::benchmark_data_smithi188_119427_object143514:head# 2024-04-01T19:43:01.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.553 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c150848:::benchmark_data_smithi188_119427_object101336:head# 2024-04-01T19:43:01.553 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.554 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c154a98:::benchmark_data_smithi188_119427_object98447:head# 2024-04-01T19:43:01.554 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.554 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c1566f2:::benchmark_data_smithi188_119427_object148734:head# 2024-04-01T19:43:01.554 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.554 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c1584a0:::benchmark_data_smithi188_119427_object164206:head# 2024-04-01T19:43:01.554 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.554 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c15b5c7:::benchmark_data_smithi188_119427_object74410:head# 2024-04-01T19:43:01.554 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.554 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c161bea:::benchmark_data_smithi188_119427_object115684:head# 2024-04-01T19:43:01.554 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.554 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c169fe9:::benchmark_data_smithi188_119427_object128933:head# 2024-04-01T19:43:01.554 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.554 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c16b6de:::benchmark_data_smithi188_119427_object140112:head# 2024-04-01T19:43:01.555 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.555 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c1721c8:::benchmark_data_smithi188_119427_object77437:head# 2024-04-01T19:43:01.555 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.555 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c17f161:::benchmark_data_smithi188_119427_object132576:head# 2024-04-01T19:43:01.555 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.555 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c18854e:::benchmark_data_smithi188_119427_object91208:head# 2024-04-01T19:43:01.555 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.555 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c18c345:::benchmark_data_smithi188_119427_object107722:head# 2024-04-01T19:43:01.555 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.555 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c19ebdc:::benchmark_data_smithi188_119427_object75671:head# 2024-04-01T19:43:01.555 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.555 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c1aaaa8:::benchmark_data_smithi188_119427_object138523:head# 2024-04-01T19:43:01.555 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.558 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c1cfabc:::benchmark_data_smithi188_119427_object150440:head# 2024-04-01T19:43:01.558 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.559 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c1d6d93:::benchmark_data_smithi188_119427_object109245:head# 2024-04-01T19:43:01.559 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.559 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c1f19d6:::benchmark_data_smithi188_119427_object133294:head# 2024-04-01T19:43:01.559 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.559 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c1fe9b5:::benchmark_data_smithi188_119427_object116694:head# 2024-04-01T19:43:01.559 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.559 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c1ffa7b:::benchmark_data_smithi188_119427_object83623:head# 2024-04-01T19:43:01.559 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.559 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c2131d2:::benchmark_data_smithi188_119427_object108178:head# 2024-04-01T19:43:01.559 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.559 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c221e18:::benchmark_data_smithi188_119427_object92216:head# 2024-04-01T19:43:01.559 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.559 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c22bc92:::benchmark_data_smithi188_119427_object115501:head# 2024-04-01T19:43:01.559 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.560 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c23ac23:::benchmark_data_smithi188_119427_object137622:head# 2024-04-01T19:43:01.560 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.560 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c2440e6:::benchmark_data_smithi188_119427_object96414:head# 2024-04-01T19:43:01.560 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.560 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c24708b:::benchmark_data_smithi188_119427_object146085:head# 2024-04-01T19:43:01.560 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.560 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c257da2:::benchmark_data_smithi188_119427_object129276:head# 2024-04-01T19:43:01.560 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.560 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c25e40d:::benchmark_data_smithi188_119427_object162179:head# 2024-04-01T19:43:01.560 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.560 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c26cb40:::benchmark_data_smithi188_119427_object100641:head# 2024-04-01T19:43:01.560 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.560 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c2735d4:::benchmark_data_smithi188_119427_object140430:head# 2024-04-01T19:43:01.560 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.561 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c274af4:::benchmark_data_smithi188_119427_object159131:head# 2024-04-01T19:43:01.561 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.561 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c291401:::benchmark_data_smithi188_119427_object132049:head# 2024-04-01T19:43:01.561 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.561 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c2988fe:::benchmark_data_smithi188_119427_object120480:head# 2024-04-01T19:43:01.561 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.561 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c2d7a3b:::benchmark_data_smithi188_119427_object149393:head# 2024-04-01T19:43:01.561 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.561 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c2d8aa4:::benchmark_data_smithi188_119427_object110544:head# 2024-04-01T19:43:01.561 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.561 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c2d8e9b:::benchmark_data_smithi188_119427_object89712:head# 2024-04-01T19:43:01.561 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.561 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c2dd503:::benchmark_data_smithi188_119427_object145870:head# 2024-04-01T19:43:01.561 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.562 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c2dda86:::benchmark_data_smithi188_119427_object97619:head# 2024-04-01T19:43:01.562 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.562 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c2ee844:::benchmark_data_smithi188_119427_object76024:head# 2024-04-01T19:43:01.562 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.563 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c307ce3:::benchmark_data_smithi188_119427_object143384:head# 2024-04-01T19:43:01.563 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.563 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c30d9c9:::benchmark_data_smithi188_119427_object86112:head# 2024-04-01T19:43:01.563 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.563 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c30e6ea:::benchmark_data_smithi188_119427_object150100:head# 2024-04-01T19:43:01.563 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.563 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c321054:::benchmark_data_smithi188_119427_object84064:head# 2024-04-01T19:43:01.563 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.563 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c339699:::benchmark_data_smithi188_119427_object116586:head# 2024-04-01T19:43:01.563 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c35cf07:::benchmark_data_smithi188_119427_object151358:head# 2024-04-01T19:43:01.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c3629b6:::benchmark_data_smithi188_119427_object112793:head# 2024-04-01T19:43:01.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c367fc9:::benchmark_data_smithi188_119427_object91853:head# 2024-04-01T19:43:01.564 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.564 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c370c21:::benchmark_data_smithi188_119427_object124603:head# 2024-04-01T19:43:01.565 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.565 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c38ce41:::benchmark_data_smithi188_119427_object87722:head# 2024-04-01T19:43:01.565 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.565 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c39676e:::benchmark_data_smithi188_119427_object120832:head# 2024-04-01T19:43:01.565 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.565 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c3ac99c:::benchmark_data_smithi188_119427_object115807:head# 2024-04-01T19:43:01.565 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.565 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c3b1c15:::benchmark_data_smithi188_119427_object150861:head# 2024-04-01T19:43:01.565 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.565 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c3b2ae9:::benchmark_data_smithi188_119427_object118797:head# 2024-04-01T19:43:01.565 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.565 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c3c0263:::benchmark_data_smithi188_119427_object128454:head# 2024-04-01T19:43:01.565 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.565 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c3cc889:::benchmark_data_smithi188_119427_object162101:head# 2024-04-01T19:43:01.566 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.566 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c3fbd96:::benchmark_data_smithi188_119427_object146798:head# 2024-04-01T19:43:01.566 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.567 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c40630f:::benchmark_data_smithi188_119427_object134541:head# 2024-04-01T19:43:01.567 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.567 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c408ef0:::benchmark_data_smithi188_119427_object74458:head# 2024-04-01T19:43:01.567 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.567 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c409e37:::benchmark_data_smithi188_119427_object110467:head# 2024-04-01T19:43:01.567 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.567 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c435ed9:::benchmark_data_smithi188_119427_object86095:head# 2024-04-01T19:43:01.567 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.567 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c442444:::benchmark_data_smithi188_119427_object75567:head# 2024-04-01T19:43:01.567 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.568 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c46583c:::benchmark_data_smithi188_119427_object96611:head# 2024-04-01T19:43:01.568 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.568 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c46e34e:::benchmark_data_smithi188_119427_object155873:head# 2024-04-01T19:43:01.568 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.569 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c470d71:::benchmark_data_smithi188_119427_object123635:head# 2024-04-01T19:43:01.569 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.569 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c4a6326:::benchmark_data_smithi188_119427_object85204:head# 2024-04-01T19:43:01.569 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.569 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c4b40a6:::benchmark_data_smithi188_119427_object82063:head# 2024-04-01T19:43:01.569 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.569 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c4b56e2:::benchmark_data_smithi188_119427_object105929:head# 2024-04-01T19:43:01.569 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.569 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c4ba346:::benchmark_data_smithi188_119427_object155332:head# 2024-04-01T19:43:01.569 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.569 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c4cb8d5:::benchmark_data_smithi188_119427_object86156:head# 2024-04-01T19:43:01.569 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.569 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c4ef667:::benchmark_data_smithi188_119427_object76829:head# 2024-04-01T19:43:01.570 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.573 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c5007a4:::benchmark_data_smithi188_119427_object124768:head# 2024-04-01T19:43:01.573 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.574 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c505659:::benchmark_data_smithi188_119427_object96239:head# 2024-04-01T19:43:01.574 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.574 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c5277b0:::benchmark_data_smithi188_119427_object121749:head# 2024-04-01T19:43:01.574 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.575 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c5375fd:::benchmark_data_smithi188_119427_object118083:head# 2024-04-01T19:43:01.575 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.575 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c539a5b:::benchmark_data_smithi188_119427_object133396:head# 2024-04-01T19:43:01.575 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.575 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c53d388:::benchmark_data_smithi188_119427_object157119:head# 2024-04-01T19:43:01.575 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.575 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c54f376:::benchmark_data_smithi188_119427_object105818:head# 2024-04-01T19:43:01.576 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.576 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c54fedf:::benchmark_data_smithi188_119427_object117136:head# 2024-04-01T19:43:01.576 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.576 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c5569d9:::benchmark_data_smithi188_119427_object142580:head# 2024-04-01T19:43:01.577 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.577 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c55e6b7:::benchmark_data_smithi188_119427_object146299:head# 2024-04-01T19:43:01.577 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.577 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c5613d0:::benchmark_data_smithi188_119427_object150924:head# 2024-04-01T19:43:01.577 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.577 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c5a52b7:::benchmark_data_smithi188_119427_object127285:head# 2024-04-01T19:43:01.577 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.577 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c5abebf:::benchmark_data_smithi188_119427_object141883:head# 2024-04-01T19:43:01.577 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.581 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c5b252c:::benchmark_data_smithi188_119427_object80155:head# 2024-04-01T19:43:01.581 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.582 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c5bd26b:::benchmark_data_smithi188_119427_object147871:head# 2024-04-01T19:43:01.582 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c5be317:::benchmark_data_smithi188_119427_object123524:head# 2024-04-01T19:43:01.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.583 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c5c2fe4:::benchmark_data_smithi188_119427_object96250:head# 2024-04-01T19:43:01.583 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c5cc72c:::benchmark_data_smithi188_119427_object91564:head# 2024-04-01T19:43:01.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c5ceaba:::benchmark_data_smithi188_119427_object119377:head# 2024-04-01T19:43:01.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c5d370f:::benchmark_data_smithi188_119427_object114493:head# 2024-04-01T19:43:01.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c5df994:::benchmark_data_smithi188_119427_object109078:head# 2024-04-01T19:43:01.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.584 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c5e33a0:::benchmark_data_smithi188_119427_object96480:head# 2024-04-01T19:43:01.584 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.586 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c5e43da:::benchmark_data_smithi188_119427_object138698:head# 2024-04-01T19:43:01.586 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.586 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c613b8c:::benchmark_data_smithi188_119427_object80551:head# 2024-04-01T19:43:01.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c62a0c7:::benchmark_data_smithi188_119427_object110013:head# 2024-04-01T19:43:01.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c62c6be:::benchmark_data_smithi188_119427_object77074:head# 2024-04-01T19:43:01.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c62cd5d:::benchmark_data_smithi188_119427_object78741:head# 2024-04-01T19:43:01.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c631a7c:::benchmark_data_smithi188_119427_object140692:head# 2024-04-01T19:43:01.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c632742:::benchmark_data_smithi188_119427_object84749:head# 2024-04-01T19:43:01.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.587 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c64281c:::benchmark_data_smithi188_119427_object82142:head# 2024-04-01T19:43:01.587 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c64c7c2:::benchmark_data_smithi188_119427_object116796:head# 2024-04-01T19:43:01.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c664ea6:::benchmark_data_smithi188_119427_object142966:head# 2024-04-01T19:43:01.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c668cc3:::benchmark_data_smithi188_119427_object142097:head# 2024-04-01T19:43:01.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.588 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c6768c2:::benchmark_data_smithi188_119427_object128317:head# 2024-04-01T19:43:01.588 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.589 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c67a825:::benchmark_data_smithi188_119427_object131639:head# 2024-04-01T19:43:01.590 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.590 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c67e089:::benchmark_data_smithi188_119427_object81790:head# 2024-04-01T19:43:01.590 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.590 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c6a1ed8:::benchmark_data_smithi188_119427_object162311:head# 2024-04-01T19:43:01.590 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.590 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c6b0bae:::benchmark_data_smithi188_119427_object92348:head# 2024-04-01T19:43:01.590 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.590 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c6b3f3f:::benchmark_data_smithi188_119427_object122963:head# 2024-04-01T19:43:01.590 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.590 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c6b6f53:::benchmark_data_smithi188_119427_object124794:head# 2024-04-01T19:43:01.590 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.590 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c6c4f19:::benchmark_data_smithi188_119427_object93526:head# 2024-04-01T19:43:01.590 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.591 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c6ca342:::benchmark_data_smithi188_119427_object159229:head# 2024-04-01T19:43:01.591 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.591 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c6cf971:::benchmark_data_smithi188_119427_object103139:head# 2024-04-01T19:43:01.591 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.591 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c6d293b:::benchmark_data_smithi188_119427_object115478:head# 2024-04-01T19:43:01.591 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.592 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c6def6d:::benchmark_data_smithi188_119427_object157509:head# 2024-04-01T19:43:01.592 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.592 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c6ed2b9:::benchmark_data_smithi188_119427_object77147:head# 2024-04-01T19:43:01.592 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.592 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c6f114c:::benchmark_data_smithi188_119427_object139233:head# 2024-04-01T19:43:01.592 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.592 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c6fd321:::benchmark_data_smithi188_119427_object163879:head# 2024-04-01T19:43:01.592 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.592 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c703f22:::benchmark_data_smithi188_119427_object148740:head# 2024-04-01T19:43:01.593 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.593 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c705bc3:::benchmark_data_smithi188_119427_object143355:head# 2024-04-01T19:43:01.593 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.597 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c717e26:::benchmark_data_smithi188_119427_object150464:head# 2024-04-01T19:43:01.597 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.597 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c71ae94:::benchmark_data_smithi188_119427_object94059:head# 2024-04-01T19:43:01.597 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.597 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c72ff29:::benchmark_data_smithi188_119427_object143204:head# 2024-04-01T19:43:01.597 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.598 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c736a0e:::benchmark_data_smithi188_119427_object141949:head# 2024-04-01T19:43:01.598 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.598 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c739666:::benchmark_data_smithi188_119427_object109058:head# 2024-04-01T19:43:01.598 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.598 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c73fb0c:::benchmark_data_smithi188_119427_object123777:head# 2024-04-01T19:43:01.599 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.603 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c753a09:::benchmark_data_smithi188_119427_object121086:head# 2024-04-01T19:43:01.603 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.604 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c75e501:::benchmark_data_smithi188_119427_object136498:head# 2024-04-01T19:43:01.604 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.607 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c760ac6:::benchmark_data_smithi188_119427_object136543:head# 2024-04-01T19:43:01.607 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.607 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c76c027:::benchmark_data_smithi188_119427_object122481:head# 2024-04-01T19:43:01.607 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.608 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c780902:::benchmark_data_smithi188_119427_object117245:head# 2024-04-01T19:43:01.608 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.608 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c786c54:::benchmark_data_smithi188_119427_object157101:head# 2024-04-01T19:43:01.608 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.608 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c79166d:::benchmark_data_smithi188_119427_object153314:head# 2024-04-01T19:43:01.608 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.608 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c7a6953:::benchmark_data_smithi188_119427_object100370:head# 2024-04-01T19:43:01.608 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.608 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c7c29f2:::benchmark_data_smithi188_119427_object142286:head# 2024-04-01T19:43:01.608 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.608 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c7cce21:::benchmark_data_smithi188_119427_object95483:head# 2024-04-01T19:43:01.608 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.608 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c7cecb6:::benchmark_data_smithi188_119427_object73483:head# 2024-04-01T19:43:01.609 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.609 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c7d12d0:::benchmark_data_smithi188_119427_object119185:head# 2024-04-01T19:43:01.609 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.609 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c7d7718:::benchmark_data_smithi188_119427_object140883:head# 2024-04-01T19:43:01.609 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.609 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c7d9862:::benchmark_data_smithi188_119427_object131495:head# 2024-04-01T19:43:01.609 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.610 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c7e1bc8:::benchmark_data_smithi188_119427_object94864:head# 2024-04-01T19:43:01.610 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.610 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c7eeb32:::benchmark_data_smithi188_119427_object72455:head# 2024-04-01T19:43:01.610 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.610 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c7f097f:::benchmark_data_smithi188_119427_object145390:head# 2024-04-01T19:43:01.610 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.611 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c7f201d:::benchmark_data_smithi188_119427_object130407:head# 2024-04-01T19:43:01.611 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.611 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c7f4ffe:::benchmark_data_smithi188_119427_object115685:head# 2024-04-01T19:43:01.611 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.611 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c7f51d2:::benchmark_data_smithi188_119427_object132816:head# 2024-04-01T19:43:01.611 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.611 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c807dba:::benchmark_data_smithi188_119427_object112593:head# 2024-04-01T19:43:01.611 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.611 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c81844d:::benchmark_data_smithi188_119427_object113337:head# 2024-04-01T19:43:01.611 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.612 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c8191ab:::benchmark_data_smithi188_119427_object87015:head# 2024-04-01T19:43:01.612 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.612 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c823a2d:::benchmark_data_smithi188_119427_object90315:head# 2024-04-01T19:43:01.613 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.613 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c841daa:::benchmark_data_smithi188_119427_object163161:head# 2024-04-01T19:43:01.613 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.613 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c8593b9:::benchmark_data_smithi188_119427_object99919:head# 2024-04-01T19:43:01.613 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.613 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c85ad4a:::benchmark_data_smithi188_119427_object95586:head# 2024-04-01T19:43:01.613 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.613 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c8a1956:::benchmark_data_smithi188_119427_object117550:head# 2024-04-01T19:43:01.613 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.613 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c8a3eb2:::benchmark_data_smithi188_119427_object117713:head# 2024-04-01T19:43:01.613 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.613 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c8c2359:::benchmark_data_smithi188_119427_object75329:head# 2024-04-01T19:43:01.613 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.614 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c8c7eaf:::benchmark_data_smithi188_119427_object78318:head# 2024-04-01T19:43:01.614 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.614 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c8ce14c:::benchmark_data_smithi188_119427_object114777:head# 2024-04-01T19:43:01.615 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.615 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c8e135d:::benchmark_data_smithi188_119427_object100846:head# 2024-04-01T19:43:01.615 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.615 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c8e39a5:::benchmark_data_smithi188_119427_object83518:head# 2024-04-01T19:43:01.615 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.618 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c8f5ca4:::benchmark_data_smithi188_119427_object74125:head# 2024-04-01T19:43:01.618 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.619 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c8f87e5:::benchmark_data_smithi188_119427_object152861:head# 2024-04-01T19:43:01.619 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.619 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c9100de:::benchmark_data_smithi188_119427_object95696:head# 2024-04-01T19:43:01.619 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.619 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c9132c4:::benchmark_data_smithi188_119427_object137791:head# 2024-04-01T19:43:01.619 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.619 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c93a3d0:::benchmark_data_smithi188_119427_object98444:head# 2024-04-01T19:43:01.619 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.619 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c93b42a:::benchmark_data_smithi188_119427_object95493:head# 2024-04-01T19:43:01.619 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.619 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c94fcc6:::benchmark_data_smithi188_119427_object147928:head# 2024-04-01T19:43:01.619 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.620 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c950692:::benchmark_data_smithi188_119427_object87220:head# 2024-04-01T19:43:01.620 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.620 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c955eb8:::benchmark_data_smithi188_119427_object160742:head# 2024-04-01T19:43:01.620 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.620 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c95718d:::benchmark_data_smithi188_119427_object87229:head# 2024-04-01T19:43:01.620 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.620 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c958f13:::benchmark_data_smithi188_119427_object120654:head# 2024-04-01T19:43:01.620 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.620 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c967939:::benchmark_data_smithi188_119427_object154790:head# 2024-04-01T19:43:01.620 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.620 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c970439:::benchmark_data_smithi188_119427_object110638:head# 2024-04-01T19:43:01.620 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.620 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c972662:::benchmark_data_smithi188_119427_object132750:head# 2024-04-01T19:43:01.621 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.621 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c98d6e2:::benchmark_data_smithi188_119427_object163551:head# 2024-04-01T19:43:01.621 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.621 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c9b6342:::benchmark_data_smithi188_119427_object96360:head# 2024-04-01T19:43:01.621 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c9be78a:::benchmark_data_smithi188_119427_object154939:head# 2024-04-01T19:43:01.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c9cb90c:::benchmark_data_smithi188_119427_object114815:head# 2024-04-01T19:43:01.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c9ce95b:::benchmark_data_smithi188_119427_object128055:head# 2024-04-01T19:43:01.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4c9e212b:::benchmark_data_smithi188_119427_object120816:head# 2024-04-01T19:43:01.623 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.623 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ca018a1:::benchmark_data_smithi188_119427_object111938:head# 2024-04-01T19:43:01.624 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.624 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ca1ee00:::benchmark_data_smithi188_119427_object150170:head# 2024-04-01T19:43:01.624 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.624 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ca2cafe:::benchmark_data_smithi188_119427_object118404:head# 2024-04-01T19:43:01.624 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.624 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ca3d3f3:::benchmark_data_smithi188_119427_object113216:head# 2024-04-01T19:43:01.624 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.624 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ca46a9b:::benchmark_data_smithi188_119427_object83028:head# 2024-04-01T19:43:01.624 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.624 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ca48ac4:::benchmark_data_smithi188_119427_object115585:head# 2024-04-01T19:43:01.624 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.624 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ca552d5:::benchmark_data_smithi188_119427_object149829:head# 2024-04-01T19:43:01.624 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.624 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ca5df70:::benchmark_data_smithi188_119427_object74856:head# 2024-04-01T19:43:01.625 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.625 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ca62c8b:::benchmark_data_smithi188_119427_object93572:head# 2024-04-01T19:43:01.625 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.625 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ca653a9:::benchmark_data_smithi188_119427_object85418:head# 2024-04-01T19:43:01.625 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.625 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ca75ea1:::benchmark_data_smithi188_119427_object85041:head# 2024-04-01T19:43:01.625 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:01 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3357618881' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:43:01.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:01 smithi188 ceph-mon[43939]: from='client.36224 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:43:01.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:01 smithi188 ceph-mon[43939]: pgmap v1226: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 5.0 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 796 op/s 2024-04-01T19:43:01.629 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ca7cc40:::benchmark_data_smithi188_119427_object160363:head# 2024-04-01T19:43:01.629 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.629 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ca8033f:::benchmark_data_smithi188_119427_object157439:head# 2024-04-01T19:43:01.629 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.629 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ca86efd:::benchmark_data_smithi188_119427_object99264:head# 2024-04-01T19:43:01.629 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.629 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ca8829a:::benchmark_data_smithi188_119427_object92090:head# 2024-04-01T19:43:01.629 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.629 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ca925f0:::benchmark_data_smithi188_119427_object120256:head# 2024-04-01T19:43:01.630 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.630 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cacdc2d:::benchmark_data_smithi188_119427_object114400:head# 2024-04-01T19:43:01.630 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.630 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cae894a:::benchmark_data_smithi188_119427_object125286:head# 2024-04-01T19:43:01.630 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.630 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4caebecb:::benchmark_data_smithi188_119427_object131997:head# 2024-04-01T19:43:01.630 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.630 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4caefd3c:::benchmark_data_smithi188_119427_object79642:head# 2024-04-01T19:43:01.630 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.630 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cafa201:::benchmark_data_smithi188_119427_object98956:head# 2024-04-01T19:43:01.630 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.630 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cafaf88:::benchmark_data_smithi188_119427_object150644:head# 2024-04-01T19:43:01.631 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.631 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cb0c590:::benchmark_data_smithi188_119427_object118006:head# 2024-04-01T19:43:01.631 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.631 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cb0fe28:::benchmark_data_smithi188_119427_object141842:head# 2024-04-01T19:43:01.631 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.631 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cb554e4:::benchmark_data_smithi188_119427_object95599:head# 2024-04-01T19:43:01.631 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.631 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cb580b6:::benchmark_data_smithi188_119427_object162193:head# 2024-04-01T19:43:01.631 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.631 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cb5b62d:::benchmark_data_smithi188_119427_object83186:head# 2024-04-01T19:43:01.631 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.631 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cb613a2:::benchmark_data_smithi188_119427_object82930:head# 2024-04-01T19:43:01.631 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.631 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cb7a381:::benchmark_data_smithi188_119427_object113642:head# 2024-04-01T19:43:01.632 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.632 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cb8adba:::benchmark_data_smithi188_119427_object114843:head# 2024-04-01T19:43:01.632 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.632 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cbb666f:::benchmark_data_smithi188_119427_object78633:head# 2024-04-01T19:43:01.632 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.632 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cbbd8ec:::benchmark_data_smithi188_119427_object148702:head# 2024-04-01T19:43:01.632 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.632 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cbbdea3:::benchmark_data_smithi188_119427_object137609:head# 2024-04-01T19:43:01.632 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.632 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cbce1b7:::benchmark_data_smithi188_119427_object77020:head# 2024-04-01T19:43:01.632 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.632 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cbda07a:::benchmark_data_smithi188_119427_object161899:head# 2024-04-01T19:43:01.632 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cbda296:::benchmark_data_smithi188_119427_object138742:head# 2024-04-01T19:43:01.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cbe01a3:::benchmark_data_smithi188_119427_object160721:head# 2024-04-01T19:43:01.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cbef8e7:::benchmark_data_smithi188_119427_object133700:head# 2024-04-01T19:43:01.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cbf2e3e:::benchmark_data_smithi188_119427_object144853:head# 2024-04-01T19:43:01.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.637 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cbfc8df:::benchmark_data_smithi188_119427_object137262:head# 2024-04-01T19:43:01.637 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.638 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cc2570f:::benchmark_data_smithi188_119427_object133408:head# 2024-04-01T19:43:01.638 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.638 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cc28886:::benchmark_data_smithi188_119427_object82208:head# 2024-04-01T19:43:01.638 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.638 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cc2fea9:::benchmark_data_smithi188_119427_object137685:head# 2024-04-01T19:43:01.638 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.638 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cc5dbcf:::benchmark_data_smithi188_119427_object87832:head# 2024-04-01T19:43:01.638 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.638 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cc6dcd3:::benchmark_data_smithi188_119427_object98775:head# 2024-04-01T19:43:01.638 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.638 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cc70170:::benchmark_data_smithi188_119427_object152743:head# 2024-04-01T19:43:01.638 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cc7f391:::benchmark_data_smithi188_119427_object82040:head# 2024-04-01T19:43:01.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cc8a145:::benchmark_data_smithi188_119427_object152513:head# 2024-04-01T19:43:01.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cc99b59:::benchmark_data_smithi188_119427_object141457:head# 2024-04-01T19:43:01.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cc9bdef:::benchmark_data_smithi188_119427_object95908:head# 2024-04-01T19:43:01.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ccc3606:::benchmark_data_smithi188_119427_object85523:head# 2024-04-01T19:43:01.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ccc88bd:::benchmark_data_smithi188_119427_object145197:head# 2024-04-01T19:43:01.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ccdf0b0:::benchmark_data_smithi188_119427_object145062:head# 2024-04-01T19:43:01.639 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.639 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cce13f1:::benchmark_data_smithi188_119427_object114109:head# 2024-04-01T19:43:01.640 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.640 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cce1c2b:::benchmark_data_smithi188_119427_object151315:head# 2024-04-01T19:43:01.640 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.640 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cce735e:::benchmark_data_smithi188_119427_object160982:head# 2024-04-01T19:43:01.640 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.640 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ccec1d7:::benchmark_data_smithi188_119427_object135630:head# 2024-04-01T19:43:01.640 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.640 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ccedea8:::benchmark_data_smithi188_119427_object94645:head# 2024-04-01T19:43:01.640 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.640 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ccf5fb5:::benchmark_data_smithi188_119427_object82416:head# 2024-04-01T19:43:01.640 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.640 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ccfb197:::benchmark_data_smithi188_119427_object89820:head# 2024-04-01T19:43:01.640 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.641 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cd13b20:::benchmark_data_smithi188_119427_object159660:head# 2024-04-01T19:43:01.641 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.641 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cd16f46:::benchmark_data_smithi188_119427_object90861:head# 2024-04-01T19:43:01.641 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.641 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cd18ed3:::benchmark_data_smithi188_119427_object105546:head# 2024-04-01T19:43:01.641 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.641 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cd1dc53:::benchmark_data_smithi188_119427_object157043:head# 2024-04-01T19:43:01.641 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.641 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cd1ee14:::benchmark_data_smithi188_119427_object151473:head# 2024-04-01T19:43:01.641 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.642 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cd27eec:::benchmark_data_smithi188_119427_object123895:head# 2024-04-01T19:43:01.642 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.642 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cd39cfb:::benchmark_data_smithi188_119427_object129711:head# 2024-04-01T19:43:01.642 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.643 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cd40752:::benchmark_data_smithi188_119427_object142867:head# 2024-04-01T19:43:01.643 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.643 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cd4c91a:::benchmark_data_smithi188_119427_object144078:head# 2024-04-01T19:43:01.644 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.644 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cd4f2bc:::benchmark_data_smithi188_119427_object144894:head# 2024-04-01T19:43:01.644 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.645 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cd62dd6:::benchmark_data_smithi188_119427_object121169:head# 2024-04-01T19:43:01.645 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.645 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cd64e02:::benchmark_data_smithi188_119427_object90160:head# 2024-04-01T19:43:01.645 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.645 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cd80c98:::benchmark_data_smithi188_119427_object149293:head# 2024-04-01T19:43:01.645 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.646 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cd8b5cf:::benchmark_data_smithi188_119427_object129171:head# 2024-04-01T19:43:01.646 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.646 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cd9c537:::benchmark_data_smithi188_119427_object87043:head# 2024-04-01T19:43:01.646 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.646 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cd9fcc0:::benchmark_data_smithi188_119427_object89348:head# 2024-04-01T19:43:01.646 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.646 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cdbc10d:::benchmark_data_smithi188_119427_object140888:head# 2024-04-01T19:43:01.646 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.647 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cdbca7a:::benchmark_data_smithi188_119427_object109656:head# 2024-04-01T19:43:01.647 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.647 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cdc465b:::benchmark_data_smithi188_119427_object117754:head# 2024-04-01T19:43:01.647 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.650 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cdcf8c7:::benchmark_data_smithi188_119427_object150127:head# 2024-04-01T19:43:01.650 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.651 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cdef233:::benchmark_data_smithi188_119427_object95510:head# 2024-04-01T19:43:01.651 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.651 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cdf6f5f:::benchmark_data_smithi188_119427_object109479:head# 2024-04-01T19:43:01.651 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.651 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cdf9b17:::benchmark_data_smithi188_119427_object96187:head# 2024-04-01T19:43:01.651 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.652 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ce0ade8:::benchmark_data_smithi188_119427_object107437:head# 2024-04-01T19:43:01.652 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.652 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ce10bd1:::benchmark_data_smithi188_119427_object159543:head# 2024-04-01T19:43:01.652 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.652 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ce270a8:::benchmark_data_smithi188_119427_object81921:head# 2024-04-01T19:43:01.652 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.653 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ce3d805:::benchmark_data_smithi188_119427_object113800:head# 2024-04-01T19:43:01.653 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.653 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ce3e697:::benchmark_data_smithi188_119427_object76717:head# 2024-04-01T19:43:01.653 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.654 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ce63e2b:::benchmark_data_smithi188_119427_object79133:head# 2024-04-01T19:43:01.654 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.654 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ce71bd3:::benchmark_data_smithi188_119427_object89557:head# 2024-04-01T19:43:01.654 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.654 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ce84444:::benchmark_data_smithi188_119427_object74602:head# 2024-04-01T19:43:01.654 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.655 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cea7429:::benchmark_data_smithi188_119427_object130270:head# 2024-04-01T19:43:01.655 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.655 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cebb266:::benchmark_data_smithi188_119427_object162274:head# 2024-04-01T19:43:01.655 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.656 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cec19f9:::benchmark_data_smithi188_119427_object101438:head# 2024-04-01T19:43:01.656 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.656 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ceccdd0:::benchmark_data_smithi188_119427_object79312:head# 2024-04-01T19:43:01.656 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.656 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cee8e69:::benchmark_data_smithi188_119427_object124558:head# 2024-04-01T19:43:01.656 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.656 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cee9522:::benchmark_data_smithi188_119427_object76384:head# 2024-04-01T19:43:01.656 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.656 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cf0451c:::benchmark_data_smithi188_119427_object117897:head# 2024-04-01T19:43:01.656 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.657 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cf0e2a6:::benchmark_data_smithi188_119427_object104522:head# 2024-04-01T19:43:01.657 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.657 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cf12efa:::benchmark_data_smithi188_119427_object158323:head# 2024-04-01T19:43:01.658 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.658 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cf30ad2:::benchmark_data_smithi188_119427_object143054:head# 2024-04-01T19:43:01.658 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.658 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cf31d67:::benchmark_data_smithi188_119427_object74599:head# 2024-04-01T19:43:01.658 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.658 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cf341ba:::benchmark_data_smithi188_119427_object127385:head# 2024-04-01T19:43:01.658 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.662 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cf51cf9:::benchmark_data_smithi188_119427_object75066:head# 2024-04-01T19:43:01.662 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.662 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cf5349e:::benchmark_data_smithi188_119427_object113475:head# 2024-04-01T19:43:01.662 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.662 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cf58401:::benchmark_data_smithi188_119427_object92268:head# 2024-04-01T19:43:01.662 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.662 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cf5f429:::benchmark_data_smithi188_119427_object103238:head# 2024-04-01T19:43:01.662 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.662 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cf70a19:::benchmark_data_smithi188_119427_object75432:head# 2024-04-01T19:43:01.662 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.663 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cf711f0:::benchmark_data_smithi188_119427_object155165:head# 2024-04-01T19:43:01.664 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.664 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cf73152:::benchmark_data_smithi188_119427_object111038:head# 2024-04-01T19:43:01.664 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.664 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cf7d024:::benchmark_data_smithi188_119427_object114570:head# 2024-04-01T19:43:01.664 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.664 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cf84f2b:::benchmark_data_smithi188_119427_object100574:head# 2024-04-01T19:43:01.664 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.664 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cfaef86:::benchmark_data_smithi188_119427_object109542:head# 2024-04-01T19:43:01.664 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.664 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cfb2805:::benchmark_data_smithi188_119427_object158698:head# 2024-04-01T19:43:01.664 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.666 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cfba1f2:::benchmark_data_smithi188_119427_object151294:head# 2024-04-01T19:43:01.666 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.666 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cfbe9a5:::benchmark_data_smithi188_119427_object109311:head# 2024-04-01T19:43:01.666 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.666 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cfbeca3:::benchmark_data_smithi188_119427_object80204:head# 2024-04-01T19:43:01.666 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cfd3855:::benchmark_data_smithi188_119427_object83013:head# 2024-04-01T19:43:01.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cfd4449:::benchmark_data_smithi188_119427_object104166:head# 2024-04-01T19:43:01.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4cfe5f3c:::benchmark_data_smithi188_119427_object133908:head# 2024-04-01T19:43:01.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d000010:::benchmark_data_smithi188_119427_object125144:head# 2024-04-01T19:43:01.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d008137:::benchmark_data_smithi188_119427_object130815:head# 2024-04-01T19:43:01.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.667 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d01ab3c:::benchmark_data_smithi188_119427_object103924:head# 2024-04-01T19:43:01.667 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d025cc1:::benchmark_data_smithi188_119427_object150821:head# 2024-04-01T19:43:01.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d0604c8:::benchmark_data_smithi188_119427_object135092:head# 2024-04-01T19:43:01.668 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.668 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d06635a:::benchmark_data_smithi188_119427_object150988:head# 2024-04-01T19:43:01.669 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.669 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d06adc0:::benchmark_data_smithi188_119427_object145788:head# 2024-04-01T19:43:01.669 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.671 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d08ba44:::benchmark_data_smithi188_119427_object137363:head# 2024-04-01T19:43:01.671 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.672 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d098730:::benchmark_data_smithi188_119427_object115463:head# 2024-04-01T19:43:01.672 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.672 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d0aad45:::benchmark_data_smithi188_119427_object103080:head# 2024-04-01T19:43:01.672 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.672 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d0b4af4:::benchmark_data_smithi188_119427_object98658:head# 2024-04-01T19:43:01.672 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.674 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d0b516e:::benchmark_data_smithi188_119427_object73534:head# 2024-04-01T19:43:01.674 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.674 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d0bb3ef:::benchmark_data_smithi188_119427_object100903:head# 2024-04-01T19:43:01.674 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.674 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d0bf2b4:::benchmark_data_smithi188_119427_object152306:head# 2024-04-01T19:43:01.674 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.674 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d0c44f1:::benchmark_data_smithi188_119427_object147627:head# 2024-04-01T19:43:01.674 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.674 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d0c4d8b:::benchmark_data_smithi188_119427_object158289:head# 2024-04-01T19:43:01.674 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.674 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d0c8be6:::benchmark_data_smithi188_119427_object142942:head# 2024-04-01T19:43:01.674 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.676 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d0d40c3:::benchmark_data_smithi188_119427_object160644:head# 2024-04-01T19:43:01.676 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.676 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d0ef722:::benchmark_data_smithi188_119427_object84701:head# 2024-04-01T19:43:01.676 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.676 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d0fcf7d:::benchmark_data_smithi188_119427_object143469:head# 2024-04-01T19:43:01.676 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.676 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d115c9e:::benchmark_data_smithi188_119427_object73765:head# 2024-04-01T19:43:01.676 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.676 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d11e74e:::benchmark_data_smithi188_119427_object112385:head# 2024-04-01T19:43:01.676 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.676 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d121bde:::benchmark_data_smithi188_119427_object121461:head# 2024-04-01T19:43:01.677 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.677 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d12e1d4:::benchmark_data_smithi188_119427_object95543:head# 2024-04-01T19:43:01.677 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.677 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d131c4c:::benchmark_data_smithi188_119427_object94624:head# 2024-04-01T19:43:01.677 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.678 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d137c02:::benchmark_data_smithi188_119427_object112589:head# 2024-04-01T19:43:01.678 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.678 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d145d23:::benchmark_data_smithi188_119427_object144026:head# 2024-04-01T19:43:01.678 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.678 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d15cb7d:::benchmark_data_smithi188_119427_object107598:head# 2024-04-01T19:43:01.678 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.678 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d15eec1:::benchmark_data_smithi188_119427_object139213:head# 2024-04-01T19:43:01.678 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.681 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d16bf91:::benchmark_data_smithi188_119427_object118046:head# 2024-04-01T19:43:01.682 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.682 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d171ad1:::benchmark_data_smithi188_119427_object142122:head# 2024-04-01T19:43:01.682 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.683 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d19d760:::benchmark_data_smithi188_119427_object76482:head# 2024-04-01T19:43:01.683 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.683 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d1a9173:::benchmark_data_smithi188_119427_object98512:head# 2024-04-01T19:43:01.683 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.684 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d1b081d:::benchmark_data_smithi188_119427_object96408:head# 2024-04-01T19:43:01.684 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.684 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d1bc19b:::benchmark_data_smithi188_119427_object143508:head# 2024-04-01T19:43:01.684 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.684 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d1bf9be:::benchmark_data_smithi188_119427_object85486:head# 2024-04-01T19:43:01.684 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.685 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d1ccd26:::benchmark_data_smithi188_119427_object79382:head# 2024-04-01T19:43:01.685 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.685 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d1cf484:::benchmark_data_smithi188_119427_object100077:head# 2024-04-01T19:43:01.685 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.686 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d1d0fee:::benchmark_data_smithi188_119427_object110338:head# 2024-04-01T19:43:01.686 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.686 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d1da1ba:::benchmark_data_smithi188_119427_object152962:head# 2024-04-01T19:43:01.686 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.687 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d1ed3ac:::benchmark_data_smithi188_119427_object101078:head# 2024-04-01T19:43:01.687 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.687 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d1f5163:::benchmark_data_smithi188_119427_object148925:head# 2024-04-01T19:43:01.687 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.687 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d212935:::benchmark_data_smithi188_119427_object111654:head# 2024-04-01T19:43:01.687 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.687 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d21913c:::benchmark_data_smithi188_119427_object106672:head# 2024-04-01T19:43:01.687 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.687 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d22dbbf:::benchmark_data_smithi188_119427_object93392:head# 2024-04-01T19:43:01.687 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.687 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d24242a:::benchmark_data_smithi188_119427_object136909:head# 2024-04-01T19:43:01.687 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.688 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d24a2ec:::benchmark_data_smithi188_119427_object160594:head# 2024-04-01T19:43:01.688 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.689 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d25674c:::benchmark_data_smithi188_119427_object126790:head# 2024-04-01T19:43:01.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.689 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d265b9e:::benchmark_data_smithi188_119427_object117925:head# 2024-04-01T19:43:01.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.689 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d2685a3:::benchmark_data_smithi188_119427_object147257:head# 2024-04-01T19:43:01.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.689 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d268ba5:::benchmark_data_smithi188_119427_object141909:head# 2024-04-01T19:43:01.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.689 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d26d7d9:::benchmark_data_smithi188_119427_object137120:head# 2024-04-01T19:43:01.689 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.690 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d272834:::benchmark_data_smithi188_119427_object98348:head# 2024-04-01T19:43:01.690 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.690 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d275c74:::benchmark_data_smithi188_119427_object146863:head# 2024-04-01T19:43:01.690 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.690 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d278796:::benchmark_data_smithi188_119427_object153974:head# 2024-04-01T19:43:01.690 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.691 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d27e5a4:::benchmark_data_smithi188_119427_object84085:head# 2024-04-01T19:43:01.691 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.691 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d28cdba:::benchmark_data_smithi188_119427_object128553:head# 2024-04-01T19:43:01.691 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.691 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d28de45:::benchmark_data_smithi188_119427_object77547:head# 2024-04-01T19:43:01.691 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.693 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d2a6fb5:::benchmark_data_smithi188_119427_object121711:head# 2024-04-01T19:43:01.693 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.693 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d2a8bd1:::benchmark_data_smithi188_119427_object122792:head# 2024-04-01T19:43:01.693 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.693 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d2b721b:::benchmark_data_smithi188_119427_object125755:head# 2024-04-01T19:43:01.693 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.693 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d2bab75:::benchmark_data_smithi188_119427_object150745:head# 2024-04-01T19:43:01.693 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.693 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d2d69d4:::benchmark_data_smithi188_119427_object89453:head# 2024-04-01T19:43:01.694 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.694 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d2df4f7:::benchmark_data_smithi188_119427_object153160:head# 2024-04-01T19:43:01.694 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.694 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d2e160d:::benchmark_data_smithi188_119427_object121495:head# 2024-04-01T19:43:01.694 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.694 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d301b34:::benchmark_data_smithi188_119427_object105663:head# 2024-04-01T19:43:01.694 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.694 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d31ebad:::benchmark_data_smithi188_119427_object101031:head# 2024-04-01T19:43:01.694 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.694 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d332cb6:::benchmark_data_smithi188_119427_object78351:head# 2024-04-01T19:43:01.694 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.696 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d335c97:::benchmark_data_smithi188_119427_object151704:head# 2024-04-01T19:43:01.696 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.696 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d337e09:::benchmark_data_smithi188_119427_object109002:head# 2024-04-01T19:43:01.696 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.696 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d33cda5:::benchmark_data_smithi188_119427_object133798:head# 2024-04-01T19:43:01.696 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.696 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d35481b:::benchmark_data_smithi188_119427_object164518:head# 2024-04-01T19:43:01.696 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d357fe0:::benchmark_data_smithi188_119427_object123052:head# 2024-04-01T19:43:01.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d37686d:::benchmark_data_smithi188_119427_object122274:head# 2024-04-01T19:43:01.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d379600:::benchmark_data_smithi188_119427_object135857:head# 2024-04-01T19:43:01.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d38402a:::benchmark_data_smithi188_119427_object100213:head# 2024-04-01T19:43:01.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d38534a:::benchmark_data_smithi188_119427_object102115:head# 2024-04-01T19:43:01.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d3a6183:::benchmark_data_smithi188_119427_object140219:head# 2024-04-01T19:43:01.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.697 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d3a90bb:::benchmark_data_smithi188_119427_object126566:head# 2024-04-01T19:43:01.697 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.698 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d3ac11a:::benchmark_data_smithi188_119427_object160954:head# 2024-04-01T19:43:01.698 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.698 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d3b9d53:::benchmark_data_smithi188_119427_object131381:head# 2024-04-01T19:43:01.698 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.700 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d3bd3ef:::benchmark_data_smithi188_119427_object101881:head# 2024-04-01T19:43:01.700 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.700 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d3c10a4:::benchmark_data_smithi188_119427_object118269:head# 2024-04-01T19:43:01.700 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.700 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d3cb53f:::benchmark_data_smithi188_119427_object97789:head# 2024-04-01T19:43:01.700 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.700 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d4023ba:::benchmark_data_smithi188_119427_object75482:head# 2024-04-01T19:43:01.700 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d40c030:::benchmark_data_smithi188_119427_object131725:head# 2024-04-01T19:43:01.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d40d96a:::benchmark_data_smithi188_119427_object104440:head# 2024-04-01T19:43:01.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d4748f2:::benchmark_data_smithi188_119427_object100768:head# 2024-04-01T19:43:01.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d47d73f:::benchmark_data_smithi188_119427_object155317:head# 2024-04-01T19:43:01.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d48b3f7:::benchmark_data_smithi188_119427_object123744:head# 2024-04-01T19:43:01.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d48c2e9:::benchmark_data_smithi188_119427_object102516:head# 2024-04-01T19:43:01.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.701 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d48ee26:::benchmark_data_smithi188_119427_object125111:head# 2024-04-01T19:43:01.701 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.702 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d494e90:::benchmark_data_smithi188_119427_object130658:head# 2024-04-01T19:43:01.702 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.702 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d49f757:::benchmark_data_smithi188_119427_object126795:head# 2024-04-01T19:43:01.702 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.702 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d4a5f5a:::benchmark_data_smithi188_119427_object116954:head# 2024-04-01T19:43:01.702 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.702 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d4cd7e5:::benchmark_data_smithi188_119427_object112383:head# 2024-04-01T19:43:01.702 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.705 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d4d53ce:::benchmark_data_smithi188_119427_object132625:head# 2024-04-01T19:43:01.705 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d4dee8d:::benchmark_data_smithi188_119427_object115504:head# 2024-04-01T19:43:01.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.709 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d5087a8:::benchmark_data_smithi188_119427_object158123:head# 2024-04-01T19:43:01.709 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.710 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d511c2c:::benchmark_data_smithi188_119427_object107095:head# 2024-04-01T19:43:01.710 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.711 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d513250:::benchmark_data_smithi188_119427_object162499:head# 2024-04-01T19:43:01.711 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.711 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d51c107:::benchmark_data_smithi188_119427_object114578:head# 2024-04-01T19:43:01.711 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.711 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d5250e1:::benchmark_data_smithi188_119427_object152301:head# 2024-04-01T19:43:01.711 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.711 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d5329ba:::benchmark_data_smithi188_119427_object114298:head# 2024-04-01T19:43:01.711 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d54120a:::benchmark_data_smithi188_119427_object151979:head# 2024-04-01T19:43:01.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d5424e3:::benchmark_data_smithi188_119427_object154806:head# 2024-04-01T19:43:01.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.712 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d54aa74:::benchmark_data_smithi188_119427_object85908:head# 2024-04-01T19:43:01.712 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.717 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d55e35e:::benchmark_data_smithi188_119427_object114687:head# 2024-04-01T19:43:01.717 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.717 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d5623e9:::benchmark_data_smithi188_119427_object127120:head# 2024-04-01T19:43:01.717 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.718 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d56d541:::benchmark_data_smithi188_119427_object105506:head# 2024-04-01T19:43:01.718 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.719 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d56eacc:::benchmark_data_smithi188_119427_object82203:head# 2024-04-01T19:43:01.719 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.719 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d574c90:::benchmark_data_smithi188_119427_object136231:head# 2024-04-01T19:43:01.719 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.719 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d5848db:::benchmark_data_smithi188_119427_object74921:head# 2024-04-01T19:43:01.719 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.719 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d59126a:::benchmark_data_smithi188_119427_object161953:head# 2024-04-01T19:43:01.719 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d594df7:::benchmark_data_smithi188_119427_object89305:head# 2024-04-01T19:43:01.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d5a2fff:::benchmark_data_smithi188_119427_object91731:head# 2024-04-01T19:43:01.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d5a3d29:::benchmark_data_smithi188_119427_object114283:head# 2024-04-01T19:43:01.720 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.720 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d5a9608:::benchmark_data_smithi188_119427_object129584:head# 2024-04-01T19:43:01.721 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.721 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d5aab37:::benchmark_data_smithi188_119427_object100746:head# 2024-04-01T19:43:01.721 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d5b91f1:::benchmark_data_smithi188_119427_object97658:head# 2024-04-01T19:43:01.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d5bacfc:::benchmark_data_smithi188_119427_object114436:head# 2024-04-01T19:43:01.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d5c1feb:::benchmark_data_smithi188_119427_object137947:head# 2024-04-01T19:43:01.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d5d23d0:::benchmark_data_smithi188_119427_object129271:head# 2024-04-01T19:43:01.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d5ebec8:::benchmark_data_smithi188_119427_object114970:head# 2024-04-01T19:43:01.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.722 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d5ef990:::benchmark_data_smithi188_119427_object108058:head# 2024-04-01T19:43:01.722 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.724 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d5f147c:::benchmark_data_smithi188_119427_object73674:head# 2024-04-01T19:43:01.724 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.724 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d5f93b3:::benchmark_data_smithi188_119427_object90357:head# 2024-04-01T19:43:01.724 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.724 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d6014f6:::benchmark_data_smithi188_119427_object161341:head# 2024-04-01T19:43:01.724 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.724 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d60c9ec:::benchmark_data_smithi188_119427_object125157:head# 2024-04-01T19:43:01.724 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.724 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d616f7a:::benchmark_data_smithi188_119427_object119067:head# 2024-04-01T19:43:01.724 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.729 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d624bd9:::benchmark_data_smithi188_119427_object73920:head# 2024-04-01T19:43:01.729 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d62b8ab:::benchmark_data_smithi188_119427_object95155:head# 2024-04-01T19:43:01.730 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.730 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d62c867:::benchmark_data_smithi188_119427_object156452:head# 2024-04-01T19:43:01.731 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.731 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d62e632:::benchmark_data_smithi188_119427_object109947:head# 2024-04-01T19:43:01.731 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.732 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d631f9f:::benchmark_data_smithi188_119427_object142651:head# 2024-04-01T19:43:01.732 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.732 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d63a54c:::benchmark_data_smithi188_119427_object145357:head# 2024-04-01T19:43:01.732 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.732 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d646ab6:::benchmark_data_smithi188_119427_object87335:head# 2024-04-01T19:43:01.732 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.732 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d647b2f:::benchmark_data_smithi188_119427_object139818:head# 2024-04-01T19:43:01.732 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.737 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d64de7f:::benchmark_data_smithi188_119427_object135096:head# 2024-04-01T19:43:01.737 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.737 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d656b37:::benchmark_data_smithi188_119427_object96176:head# 2024-04-01T19:43:01.737 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d657d4b:::benchmark_data_smithi188_119427_object94568:head# 2024-04-01T19:43:01.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d65cdfa:::benchmark_data_smithi188_119427_object152763:head# 2024-04-01T19:43:01.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d663779:::benchmark_data_smithi188_119427_object81890:head# 2024-04-01T19:43:01.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d66777c:::benchmark_data_smithi188_119427_object144379:head# 2024-04-01T19:43:01.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d678c1f:::benchmark_data_smithi188_119427_object103222:head# 2024-04-01T19:43:01.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d68450f:::benchmark_data_smithi188_119427_object164141:head# 2024-04-01T19:43:01.738 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.738 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d6950c7:::benchmark_data_smithi188_119427_object117748:head# 2024-04-01T19:43:01.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d69641e:::benchmark_data_smithi188_119427_object155665:head# 2024-04-01T19:43:01.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d6977e4:::benchmark_data_smithi188_119427_object94135:head# 2024-04-01T19:43:01.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d69ab7b:::benchmark_data_smithi188_119427_object86766:head# 2024-04-01T19:43:01.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d6a2174:::benchmark_data_smithi188_119427_object93879:head# 2024-04-01T19:43:01.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d6a713e:::benchmark_data_smithi188_119427_object103317:head# 2024-04-01T19:43:01.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d6ac99d:::benchmark_data_smithi188_119427_object108207:head# 2024-04-01T19:43:01.739 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.739 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d6ad097:::benchmark_data_smithi188_119427_object78902:head# 2024-04-01T19:43:01.740 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.740 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d6c0562:::benchmark_data_smithi188_119427_object119422:head# 2024-04-01T19:43:01.740 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.740 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d6c7aae:::benchmark_data_smithi188_119427_object94249:head# 2024-04-01T19:43:01.740 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.740 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d6d858c:::benchmark_data_smithi188_119427_object132878:head# 2024-04-01T19:43:01.740 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.740 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d6e11a3:::benchmark_data_smithi188_119427_object126216:head# 2024-04-01T19:43:01.741 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.741 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d6e84ba:::benchmark_data_smithi188_119427_object138381:head# 2024-04-01T19:43:01.741 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.743 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d6e8dcb:::benchmark_data_smithi188_119427_object148401:head# 2024-04-01T19:43:01.743 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.745 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d6e997c:::benchmark_data_smithi188_119427_object73264:head# 2024-04-01T19:43:01.745 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.745 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d6f5d3e:::benchmark_data_smithi188_119427_object78809:head# 2024-04-01T19:43:01.745 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.747 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d6fa0ed:::benchmark_data_smithi188_119427_object143415:head# 2024-04-01T19:43:01.747 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.747 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d6fa9a3:::benchmark_data_smithi188_119427_object72380:head# 2024-04-01T19:43:01.747 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.747 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d7002fe:::benchmark_data_smithi188_119427_object98521:head# 2024-04-01T19:43:01.747 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.747 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d729b4c:::benchmark_data_smithi188_119427_object142798:head# 2024-04-01T19:43:01.747 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.747 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d73d45a:::benchmark_data_smithi188_119427_object105988:head# 2024-04-01T19:43:01.747 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.747 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d73fb71:::benchmark_data_smithi188_119427_object113649:head# 2024-04-01T19:43:01.747 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.748 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d7441c5:::benchmark_data_smithi188_119427_object162334:head# 2024-04-01T19:43:01.748 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.748 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d74b75c:::benchmark_data_smithi188_119427_object115469:head# 2024-04-01T19:43:01.748 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.748 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d763189:::benchmark_data_smithi188_119427_object157667:head# 2024-04-01T19:43:01.748 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.748 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d76d97f:::benchmark_data_smithi188_119427_object75979:head# 2024-04-01T19:43:01.748 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.750 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d771947:::benchmark_data_smithi188_119427_object148238:head# 2024-04-01T19:43:01.750 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.750 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d776192:::benchmark_data_smithi188_119427_object132652:head# 2024-04-01T19:43:01.750 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.751 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d7adc81:::benchmark_data_smithi188_119427_object161977:head# 2024-04-01T19:43:01.751 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.751 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d7bb7a2:::benchmark_data_smithi188_119427_object130032:head# 2024-04-01T19:43:01.751 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.751 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d7bfa07:::benchmark_data_smithi188_119427_object129588:head# 2024-04-01T19:43:01.751 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.751 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d7df147:::benchmark_data_smithi188_119427_object149282:head# 2024-04-01T19:43:01.751 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.751 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d7e1706:::benchmark_data_smithi188_119427_object72941:head# 2024-04-01T19:43:01.751 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.751 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d7e2c77:::benchmark_data_smithi188_119427_object90222:head# 2024-04-01T19:43:01.751 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.751 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d7e7509:::benchmark_data_smithi188_119427_object97188:head# 2024-04-01T19:43:01.752 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.752 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d7eeb19:::benchmark_data_smithi188_119427_object97389:head# 2024-04-01T19:43:01.752 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.752 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d80702c:::benchmark_data_smithi188_119427_object154274:head# 2024-04-01T19:43:01.752 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.752 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d8390be:::benchmark_data_smithi188_119427_object148549:head# 2024-04-01T19:43:01.752 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.752 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d83ca53:::benchmark_data_smithi188_119427_object84790:head# 2024-04-01T19:43:01.752 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.753 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d85a2b1:::benchmark_data_smithi188_119427_object159057:head# 2024-04-01T19:43:01.754 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.754 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d8731e5:::benchmark_data_smithi188_119427_object95138:head# 2024-04-01T19:43:01.754 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.754 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d884964:::benchmark_data_smithi188_119427_object140592:head# 2024-04-01T19:43:01.754 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.754 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d88acc9:::benchmark_data_smithi188_119427_object156282:head# 2024-04-01T19:43:01.754 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.754 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d88cddd:::benchmark_data_smithi188_119427_object123620:head# 2024-04-01T19:43:01.754 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.754 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d8958ec:::benchmark_data_smithi188_119427_object121811:head# 2024-04-01T19:43:01.754 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.754 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d8abc66:::benchmark_data_smithi188_119427_object82689:head# 2024-04-01T19:43:01.755 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.755 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d8b02d8:::benchmark_data_smithi188_119427_object88287:head# 2024-04-01T19:43:01.755 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.755 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d8c0df8:::benchmark_data_smithi188_119427_object147208:head# 2024-04-01T19:43:01.755 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.755 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d8c2e7f:::benchmark_data_smithi188_119427_object163241:head# 2024-04-01T19:43:01.755 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.755 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d8d34da:::benchmark_data_smithi188_119427_object126743:head# 2024-04-01T19:43:01.755 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.756 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d8d8faa:::benchmark_data_smithi188_119427_object140435:head# 2024-04-01T19:43:01.756 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.756 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d8f1b2c:::benchmark_data_smithi188_119427_object113929:head# 2024-04-01T19:43:01.756 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.756 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d9046d8:::benchmark_data_smithi188_119427_object99630:head# 2024-04-01T19:43:01.756 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.757 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d907d83:::benchmark_data_smithi188_119427_object157644:head# 2024-04-01T19:43:01.757 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.757 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d90b51f:::benchmark_data_smithi188_119427_object142702:head# 2024-04-01T19:43:01.757 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.757 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d90b59e:::benchmark_data_smithi188_119427_object77098:head# 2024-04-01T19:43:01.757 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d910cba:::benchmark_data_smithi188_119427_object91421:head# 2024-04-01T19:43:01.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d920823:::benchmark_data_smithi188_119427_object160538:head# 2024-04-01T19:43:01.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.758 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d92489f:::benchmark_data_smithi188_119427_object162275:head# 2024-04-01T19:43:01.758 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.759 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d932ffe:::benchmark_data_smithi188_119427_object79256:head# 2024-04-01T19:43:01.759 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.759 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d93efce:::benchmark_data_smithi188_119427_object156692:head# 2024-04-01T19:43:01.759 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.759 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d954d4b:::benchmark_data_smithi188_119427_object93301:head# 2024-04-01T19:43:01.759 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.759 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d967afa:::benchmark_data_smithi188_119427_object120457:head# 2024-04-01T19:43:01.759 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.759 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d9731a8:::benchmark_data_smithi188_119427_object81889:head# 2024-04-01T19:43:01.759 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.760 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d985948:::benchmark_data_smithi188_119427_object104756:head# 2024-04-01T19:43:01.760 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.760 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d987013:::benchmark_data_smithi188_119427_object136421:head# 2024-04-01T19:43:01.760 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.760 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d994610:::benchmark_data_smithi188_119427_object163025:head# 2024-04-01T19:43:01.760 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.761 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d994ea8:::benchmark_data_smithi188_119427_object162888:head# 2024-04-01T19:43:01.761 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.761 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d9b9adc:::benchmark_data_smithi188_119427_object147949:head# 2024-04-01T19:43:01.761 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.761 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d9bc023:::benchmark_data_smithi188_119427_object128375:head# 2024-04-01T19:43:01.761 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.761 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d9bc9e4:::benchmark_data_smithi188_119427_object116569:head# 2024-04-01T19:43:01.761 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.762 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d9beea8:::benchmark_data_smithi188_119427_object133063:head# 2024-04-01T19:43:01.762 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.762 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d9cead8:::benchmark_data_smithi188_119427_object153061:head# 2024-04-01T19:43:01.762 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.764 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d9e2949:::benchmark_data_smithi188_119427_object141519:head# 2024-04-01T19:43:01.764 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.764 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d9eaf2e:::benchmark_data_smithi188_119427_object74415:head# 2024-04-01T19:43:01.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d9f3c35:::benchmark_data_smithi188_119427_object147242:head# 2024-04-01T19:43:01.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d9fe740:::benchmark_data_smithi188_119427_object72968:head# 2024-04-01T19:43:01.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4d9ff1be:::benchmark_data_smithi188_119427_object75947:head# 2024-04-01T19:43:01.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4da06899:::benchmark_data_smithi188_119427_object102530:head# 2024-04-01T19:43:01.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4da0fbde:::benchmark_data_smithi188_119427_object105519:head# 2024-04-01T19:43:01.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.765 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4da13677:::benchmark_data_smithi188_119427_object87880:head# 2024-04-01T19:43:01.765 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.766 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4da3c8a5:::benchmark_data_smithi188_119427_object164307:head# 2024-04-01T19:43:01.766 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.766 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4da43755:::benchmark_data_smithi188_119427_object159275:head# 2024-04-01T19:43:01.766 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.766 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4da55041:::benchmark_data_smithi188_119427_object151368:head# 2024-04-01T19:43:01.766 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.766 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4da6188e:::benchmark_data_smithi188_119427_object99766:head# 2024-04-01T19:43:01.766 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.766 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4da69f9c:::benchmark_data_smithi188_119427_object90885:head# 2024-04-01T19:43:01.766 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.768 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4da75ded:::benchmark_data_smithi188_119427_object123347:head# 2024-04-01T19:43:01.768 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.768 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4da8131d:::benchmark_data_smithi188_119427_object99816:head# 2024-04-01T19:43:01.768 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.768 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4da8ccc0:::benchmark_data_smithi188_119427_object152987:head# 2024-04-01T19:43:01.768 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.768 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4da8d314:::benchmark_data_smithi188_119427_object161513:head# 2024-04-01T19:43:01.768 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.768 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4da9005d:::benchmark_data_smithi188_119427_object92643:head# 2024-04-01T19:43:01.768 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.768 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4da94ed6:::benchmark_data_smithi188_119427_object163209:head# 2024-04-01T19:43:01.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4da969ce:::benchmark_data_smithi188_119427_object136694:head# 2024-04-01T19:43:01.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4daa9ad8:::benchmark_data_smithi188_119427_object127977:head# 2024-04-01T19:43:01.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4daabedc:::benchmark_data_smithi188_119427_object94530:head# 2024-04-01T19:43:01.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4daac879:::benchmark_data_smithi188_119427_object84644:head# 2024-04-01T19:43:01.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dab26a9:::benchmark_data_smithi188_119427_object75135:head# 2024-04-01T19:43:01.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.769 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dac6001:::benchmark_data_smithi188_119427_object120500:head# 2024-04-01T19:43:01.769 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dad313c:::benchmark_data_smithi188_119427_object100143:head# 2024-04-01T19:43:01.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dae7ee2:::benchmark_data_smithi188_119427_object93896:head# 2024-04-01T19:43:01.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4daf45dd:::benchmark_data_smithi188_119427_object127003:head# 2024-04-01T19:43:01.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.772 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4db0428b:::benchmark_data_smithi188_119427_object162953:head# 2024-04-01T19:43:01.772 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4db1aa92:::benchmark_data_smithi188_119427_object148833:head# 2024-04-01T19:43:01.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4db21843:::benchmark_data_smithi188_119427_object156229:head# 2024-04-01T19:43:01.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4db29660:::benchmark_data_smithi188_119427_object94874:head# 2024-04-01T19:43:01.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4db2b146:::benchmark_data_smithi188_119427_object111425:head# 2024-04-01T19:43:01.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4db4d06b:::benchmark_data_smithi188_119427_object90037:head# 2024-04-01T19:43:01.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4db84aea:::benchmark_data_smithi188_119427_object117107:head# 2024-04-01T19:43:01.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.773 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4db95bd8:::benchmark_data_smithi188_119427_object156274:head# 2024-04-01T19:43:01.773 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.774 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4db9b3e4:::benchmark_data_smithi188_119427_object100558:head# 2024-04-01T19:43:01.774 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.774 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dbb6bc0:::benchmark_data_smithi188_119427_object86689:head# 2024-04-01T19:43:01.774 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.774 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dbb81c9:::benchmark_data_smithi188_119427_object132732:head# 2024-04-01T19:43:01.774 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.774 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dbc1452:::benchmark_data_smithi188_119427_object128551:head# 2024-04-01T19:43:01.774 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.774 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dbc3284:::benchmark_data_smithi188_119427_object125656:head# 2024-04-01T19:43:01.774 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.774 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dbcc3f7:::benchmark_data_smithi188_119427_object93202:head# 2024-04-01T19:43:01.774 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.776 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dbd8fe2:::benchmark_data_smithi188_119427_object106210:head# 2024-04-01T19:43:01.776 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.776 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dbdea7e:::benchmark_data_smithi188_119427_object164112:head# 2024-04-01T19:43:01.776 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.776 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dbed5f0:::benchmark_data_smithi188_119427_object161413:head# 2024-04-01T19:43:01.776 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dbf3ff4:::benchmark_data_smithi188_119427_object153062:head# 2024-04-01T19:43:01.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dbfa32b:::benchmark_data_smithi188_119427_object91035:head# 2024-04-01T19:43:01.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dc22791:::benchmark_data_smithi188_119427_object86006:head# 2024-04-01T19:43:01.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dc22a51:::benchmark_data_smithi188_119427_object83422:head# 2024-04-01T19:43:01.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dc272cf:::benchmark_data_smithi188_119427_object162142:head# 2024-04-01T19:43:01.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dc2cc31:::benchmark_data_smithi188_119427_object124563:head# 2024-04-01T19:43:01.777 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.777 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dc35754:::benchmark_data_smithi188_119427_object133011:head# 2024-04-01T19:43:01.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dc3e920:::benchmark_data_smithi188_119427_object152853:head# 2024-04-01T19:43:01.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.778 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dc47755:::benchmark_data_smithi188_119427_object147346:head# 2024-04-01T19:43:01.778 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.779 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dc4f2fc:::benchmark_data_smithi188_119427_object142371:head# 2024-04-01T19:43:01.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.779 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dc6e67d:::benchmark_data_smithi188_119427_object84524:head# 2024-04-01T19:43:01.779 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.780 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dc7feb2:::benchmark_data_smithi188_119427_object152708:head# 2024-04-01T19:43:01.780 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.781 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dc97934:::benchmark_data_smithi188_119427_object144874:head# 2024-04-01T19:43:01.781 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.781 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dc98b4f:::benchmark_data_smithi188_119427_object108594:head# 2024-04-01T19:43:01.781 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.782 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dc9d275:::benchmark_data_smithi188_119427_object125732:head# 2024-04-01T19:43:01.782 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.782 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dca484f:::benchmark_data_smithi188_119427_object81817:head# 2024-04-01T19:43:01.782 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.782 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dcc8a8b:::benchmark_data_smithi188_119427_object77368:head# 2024-04-01T19:43:01.782 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.783 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dceee81:::benchmark_data_smithi188_119427_object81941:head# 2024-04-01T19:43:01.783 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.784 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dd06e5e:::benchmark_data_smithi188_119427_object159004:head# 2024-04-01T19:43:01.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.784 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dd08d27:::benchmark_data_smithi188_119427_object133437:head# 2024-04-01T19:43:01.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.784 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dd169c2:::benchmark_data_smithi188_119427_object142908:head# 2024-04-01T19:43:01.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.784 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dd30ee5:::benchmark_data_smithi188_119427_object122861:head# 2024-04-01T19:43:01.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.784 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dd3d00a:::benchmark_data_smithi188_119427_object161441:head# 2024-04-01T19:43:01.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.784 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dd3eecb:::benchmark_data_smithi188_119427_object146736:head# 2024-04-01T19:43:01.784 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.785 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dd47288:::benchmark_data_smithi188_119427_object109097:head# 2024-04-01T19:43:01.785 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dd5324f:::benchmark_data_smithi188_119427_object97579:head# 2024-04-01T19:43:01.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dd540f0:::benchmark_data_smithi188_119427_object90692:head# 2024-04-01T19:43:01.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dd6a494:::benchmark_data_smithi188_119427_object144262:head# 2024-04-01T19:43:01.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dd740e5:::benchmark_data_smithi188_119427_object110611:head# 2024-04-01T19:43:01.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dd76721:::benchmark_data_smithi188_119427_object134729:head# 2024-04-01T19:43:01.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.786 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dd89ca5:::benchmark_data_smithi188_119427_object86532:head# 2024-04-01T19:43:01.786 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.787 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dd91c98:::benchmark_data_smithi188_119427_object147457:head# 2024-04-01T19:43:01.787 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dda57b4:::benchmark_data_smithi188_119427_object149392:head# 2024-04-01T19:43:01.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dda75d0:::benchmark_data_smithi188_119427_object146121:head# 2024-04-01T19:43:01.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ddada12:::benchmark_data_smithi188_119427_object149830:head# 2024-04-01T19:43:01.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.788 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ddb9a19:::benchmark_data_smithi188_119427_object163203:head# 2024-04-01T19:43:01.788 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.789 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ddc639d:::benchmark_data_smithi188_119427_object159365:head# 2024-04-01T19:43:01.789 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.790 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ddcda9b:::benchmark_data_smithi188_119427_object156190:head# 2024-04-01T19:43:01.790 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.790 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ddd611b:::benchmark_data_smithi188_119427_object152379:head# 2024-04-01T19:43:01.790 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.791 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dddd65b:::benchmark_data_smithi188_119427_object159779:head# 2024-04-01T19:43:01.791 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.791 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dde1408:::benchmark_data_smithi188_119427_object159748:head# 2024-04-01T19:43:01.791 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.791 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4de225b5:::benchmark_data_smithi188_119427_object100090:head# 2024-04-01T19:43:01.791 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.793 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4de2401c:::benchmark_data_smithi188_119427_object129290:head# 2024-04-01T19:43:01.793 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4de24e2c:::benchmark_data_smithi188_119427_object158570:head# 2024-04-01T19:43:01.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.794 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4de2a91d:::benchmark_data_smithi188_119427_object97178:head# 2024-04-01T19:43:01.794 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.795 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4de2cf4a:::benchmark_data_smithi188_119427_object99190:head# 2024-04-01T19:43:01.795 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.795 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4de2eb81:::benchmark_data_smithi188_119427_object108960:head# 2024-04-01T19:43:01.795 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.795 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4de3f2f7:::benchmark_data_smithi188_119427_object92138:head# 2024-04-01T19:43:01.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4de454b3:::benchmark_data_smithi188_119427_object97454:head# 2024-04-01T19:43:01.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4de50264:::benchmark_data_smithi188_119427_object129849:head# 2024-04-01T19:43:01.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4de6298b:::benchmark_data_smithi188_119427_object87974:head# 2024-04-01T19:43:01.796 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.796 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4de68266:::benchmark_data_smithi188_119427_object144951:head# 2024-04-01T19:43:01.801 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.801 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4de75a0f:::benchmark_data_smithi188_119427_object126796:head# 2024-04-01T19:43:01.801 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.801 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4de82cc7:::benchmark_data_smithi188_119427_object138137:head# 2024-04-01T19:43:01.801 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.802 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4de89976:::benchmark_data_smithi188_119427_object117447:head# 2024-04-01T19:43:01.802 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.802 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4de8df34:::benchmark_data_smithi188_119427_object108475:head# 2024-04-01T19:43:01.802 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.802 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4de96bef:::benchmark_data_smithi188_119427_object90878:head# 2024-04-01T19:43:01.802 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.802 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4de99abf:::benchmark_data_smithi188_119427_object76444:head# 2024-04-01T19:43:01.802 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.802 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dea7f06:::benchmark_data_smithi188_119427_object157754:head# 2024-04-01T19:43:01.802 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.802 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4deae8a0:::benchmark_data_smithi188_119427_object114380:head# 2024-04-01T19:43:01.802 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.802 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4deaf0a9:::benchmark_data_smithi188_119427_object108600:head# 2024-04-01T19:43:01.802 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.803 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4deb05c4:::benchmark_data_smithi188_119427_object159711:head# 2024-04-01T19:43:01.803 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.803 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4debffa9:::benchmark_data_smithi188_119427_object104732:head# 2024-04-01T19:43:01.803 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.803 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dec44ac:::benchmark_data_smithi188_119427_object72715:head# 2024-04-01T19:43:01.803 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.803 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4decc289:::benchmark_data_smithi188_119427_object96630:head# 2024-04-01T19:43:01.803 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.803 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ded12cf:::benchmark_data_smithi188_119427_object100441:head# 2024-04-01T19:43:01.803 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.803 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dee7985:::benchmark_data_smithi188_119427_object123742:head# 2024-04-01T19:43:01.803 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.803 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4def2238:::benchmark_data_smithi188_119427_object116340:head# 2024-04-01T19:43:01.804 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.804 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4deffd87:::benchmark_data_smithi188_119427_object123769:head# 2024-04-01T19:43:01.804 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.804 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4df2559f:::benchmark_data_smithi188_119427_object78020:head# 2024-04-01T19:43:01.804 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.804 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4df27d74:::benchmark_data_smithi188_119427_object93774:head# 2024-04-01T19:43:01.804 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.806 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4df311da:::benchmark_data_smithi188_119427_object150829:head# 2024-04-01T19:43:01.806 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.806 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4df35d8b:::benchmark_data_smithi188_119427_object150215:head# 2024-04-01T19:43:01.806 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.807 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4df61613:::benchmark_data_smithi188_119427_object139630:head# 2024-04-01T19:43:01.807 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.807 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4df7c665:::benchmark_data_smithi188_119427_object151687:head# 2024-04-01T19:43:01.807 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.807 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4df8f4a3:::benchmark_data_smithi188_119427_object97070:head# 2024-04-01T19:43:01.807 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.807 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4df9b1e4:::benchmark_data_smithi188_119427_object121959:head# 2024-04-01T19:43:01.807 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.807 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dfa2f88:::benchmark_data_smithi188_119427_object126751:head# 2024-04-01T19:43:01.807 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.807 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dfa7d4c:::benchmark_data_smithi188_119427_object141180:head# 2024-04-01T19:43:01.807 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.807 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dfbc641:::benchmark_data_smithi188_119427_object104110:head# 2024-04-01T19:43:01.807 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.808 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dfc702c:::benchmark_data_smithi188_119427_object126161:head# 2024-04-01T19:43:01.808 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.808 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dfdf7ee:::benchmark_data_smithi188_119427_object161406:head# 2024-04-01T19:43:01.808 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.808 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dfe447d:::benchmark_data_smithi188_119427_object152628:head# 2024-04-01T19:43:01.808 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.808 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dfe4ab3:::benchmark_data_smithi188_119427_object153136:head# 2024-04-01T19:43:01.808 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.808 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dff4e7d:::benchmark_data_smithi188_119427_object154172:head# 2024-04-01T19:43:01.808 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.808 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dff7221:::benchmark_data_smithi188_119427_object116001:head# 2024-04-01T19:43:01.808 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.808 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dff7fc0:::benchmark_data_smithi188_119427_object116226:head# 2024-04-01T19:43:01.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.809 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dff8a8a:::benchmark_data_smithi188_119427_object124363:head# 2024-04-01T19:43:01.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.809 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dff93f3:::benchmark_data_smithi188_119427_object104476:head# 2024-04-01T19:43:01.809 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.811 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dfff73b:::benchmark_data_smithi188_119427_object85201:head# 2024-04-01T19:43:01.811 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.811 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4dfffea3:::benchmark_data_smithi188_119427_object86462:head# 2024-04-01T19:43:01.811 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e000c75:::benchmark_data_smithi188_119427_object75659:head# 2024-04-01T19:43:01.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e005b6d:::benchmark_data_smithi188_119427_object98408:head# 2024-04-01T19:43:01.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e00c475:::benchmark_data_smithi188_119427_object111747:head# 2024-04-01T19:43:01.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e00ed36:::benchmark_data_smithi188_119427_object147021:head# 2024-04-01T19:43:01.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e013163:::benchmark_data_smithi188_119427_object79679:head# 2024-04-01T19:43:01.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e0254ff:::benchmark_data_smithi188_119427_object154179:head# 2024-04-01T19:43:01.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.812 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e035e04:::benchmark_data_smithi188_119427_object77214:head# 2024-04-01T19:43:01.812 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.813 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e047646:::benchmark_data_smithi188_119427_object120175:head# 2024-04-01T19:43:01.813 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.813 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e04f17d:::benchmark_data_smithi188_119427_object73547:head# 2024-04-01T19:43:01.813 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.813 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e05a4ab:::benchmark_data_smithi188_119427_object107769:head# 2024-04-01T19:43:01.813 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.813 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e05a659:::benchmark_data_smithi188_119427_object82841:head# 2024-04-01T19:43:01.813 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.813 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e0801b9:::benchmark_data_smithi188_119427_object86468:head# 2024-04-01T19:43:01.813 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.813 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e081755:::benchmark_data_smithi188_119427_object145586:head# 2024-04-01T19:43:01.813 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.813 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e09d8a2:::benchmark_data_smithi188_119427_object103647:head# 2024-04-01T19:43:01.814 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.814 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e0a025b:::benchmark_data_smithi188_119427_object131835:head# 2024-04-01T19:43:01.814 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.814 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e0a3af2:::benchmark_data_smithi188_119427_object109705:head# 2024-04-01T19:43:01.814 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.814 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e0b99ce:::benchmark_data_smithi188_119427_object133147:head# 2024-04-01T19:43:01.814 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.817 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e0c9850:::benchmark_data_smithi188_119427_object74844:head# 2024-04-01T19:43:01.817 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.817 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e0d289c:::benchmark_data_smithi188_119427_object75055:head# 2024-04-01T19:43:01.817 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.817 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e0d6abe:::benchmark_data_smithi188_119427_object157944:head# 2024-04-01T19:43:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e0d6c3f:::benchmark_data_smithi188_119427_object154979:head# 2024-04-01T19:43:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e0e89f1:::benchmark_data_smithi188_119427_object97187:head# 2024-04-01T19:43:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e0fd276:::benchmark_data_smithi188_119427_object108777:head# 2024-04-01T19:43:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e10133e:::benchmark_data_smithi188_119427_object138615:head# 2024-04-01T19:43:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e10b626:::benchmark_data_smithi188_119427_object113506:head# 2024-04-01T19:43:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e12aa44:::benchmark_data_smithi188_119427_object80087:head# 2024-04-01T19:43:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e12f1de:::benchmark_data_smithi188_119427_object113411:head# 2024-04-01T19:43:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e134a3a:::benchmark_data_smithi188_119427_object97563:head# 2024-04-01T19:43:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e1394f6:::benchmark_data_smithi188_119427_object94007:head# 2024-04-01T19:43:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e16015d:::benchmark_data_smithi188_119427_object126460:head# 2024-04-01T19:43:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e163592:::benchmark_data_smithi188_119427_object91889:head# 2024-04-01T19:43:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e16c01e:::benchmark_data_smithi188_119427_object100834:head# 2024-04-01T19:43:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e173db4:::benchmark_data_smithi188_119427_object91091:head# 2024-04-01T19:43:01.820 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.820 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e195ff9:::benchmark_data_smithi188_119427_object115017:head# 2024-04-01T19:43:01.820 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.820 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e1aacf4:::benchmark_data_smithi188_119427_object160508:head# 2024-04-01T19:43:01.820 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.820 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e1adb6c:::benchmark_data_smithi188_119427_object153677:head# 2024-04-01T19:43:01.820 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.820 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e1c042d:::benchmark_data_smithi188_119427_object137695:head# 2024-04-01T19:43:01.820 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.820 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e1c4398:::benchmark_data_smithi188_119427_object153256:head# 2024-04-01T19:43:01.820 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.823 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e1c6308:::benchmark_data_smithi188_119427_object114894:head# 2024-04-01T19:43:01.823 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.823 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e1c8246:::benchmark_data_smithi188_119427_object99553:head# 2024-04-01T19:43:01.823 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.823 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e1db176:::benchmark_data_smithi188_119427_object72598:head# 2024-04-01T19:43:01.823 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.823 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e1e99ee:::benchmark_data_smithi188_119427_object122514:head# 2024-04-01T19:43:01.823 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.823 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e1eec6d:::benchmark_data_smithi188_119427_object97274:head# 2024-04-01T19:43:01.823 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.823 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e1ef39c:::benchmark_data_smithi188_119427_object76897:head# 2024-04-01T19:43:01.823 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.824 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e1ff6d5:::benchmark_data_smithi188_119427_object117228:head# 2024-04-01T19:43:01.824 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.824 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e208efe:::benchmark_data_smithi188_119427_object88841:head# 2024-04-01T19:43:01.824 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.824 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e212f03:::benchmark_data_smithi188_119427_object134050:head# 2024-04-01T19:43:01.824 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.824 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e228d1b:::benchmark_data_smithi188_119427_object86495:head# 2024-04-01T19:43:01.824 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.824 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e233877:::benchmark_data_smithi188_119427_object78702:head# 2024-04-01T19:43:01.824 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.824 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e23925f:::benchmark_data_smithi188_119427_object94793:head# 2024-04-01T19:43:01.824 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.824 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e23a6d1:::benchmark_data_smithi188_119427_object92817:head# 2024-04-01T19:43:01.824 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.825 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e23c831:::benchmark_data_smithi188_119427_object78709:head# 2024-04-01T19:43:01.825 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.827 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e23d32d:::benchmark_data_smithi188_119427_object133689:head# 2024-04-01T19:43:01.827 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.827 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e247d54:::benchmark_data_smithi188_119427_object72853:head# 2024-04-01T19:43:01.827 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.827 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e24b492:::benchmark_data_smithi188_119427_object129866:head# 2024-04-01T19:43:01.827 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.827 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e24e48e:::benchmark_data_smithi188_119427_object95170:head# 2024-04-01T19:43:01.827 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.827 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e275fdb:::benchmark_data_smithi188_119427_object146349:head# 2024-04-01T19:43:01.827 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.828 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e283f0b:::benchmark_data_smithi188_119427_object118869:head# 2024-04-01T19:43:01.828 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.828 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e2860ea:::benchmark_data_smithi188_119427_object122414:head# 2024-04-01T19:43:01.828 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.828 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e2869b2:::benchmark_data_smithi188_119427_object153492:head# 2024-04-01T19:43:01.828 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.828 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e286f94:::benchmark_data_smithi188_119427_object127633:head# 2024-04-01T19:43:01.828 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.828 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e289406:::benchmark_data_smithi188_119427_object131915:head# 2024-04-01T19:43:01.828 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.828 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e29211f:::benchmark_data_smithi188_119427_object160583:head# 2024-04-01T19:43:01.828 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.828 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e294504:::benchmark_data_smithi188_119427_object85729:head# 2024-04-01T19:43:01.829 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.829 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e29fc46:::benchmark_data_smithi188_119427_object134226:head# 2024-04-01T19:43:01.830 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.830 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e2a0e63:::benchmark_data_smithi188_119427_object154448:head# 2024-04-01T19:43:01.830 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.830 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e2ab1db:::benchmark_data_smithi188_119427_object129540:head# 2024-04-01T19:43:01.830 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.830 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e2ae06a:::benchmark_data_smithi188_119427_object159155:head# 2024-04-01T19:43:01.830 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.830 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e2bb4d1:::benchmark_data_smithi188_119427_object123852:head# 2024-04-01T19:43:01.830 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.830 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e2be1b4:::benchmark_data_smithi188_119427_object84175:head# 2024-04-01T19:43:01.830 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.830 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e2c351c:::benchmark_data_smithi188_119427_object125039:head# 2024-04-01T19:43:01.831 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.832 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e2c7b9e:::benchmark_data_smithi188_119427_object94128:head# 2024-04-01T19:43:01.832 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.832 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e2d9540:::benchmark_data_smithi188_119427_object111074:head# 2024-04-01T19:43:01.832 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.832 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e2f2ad6:::benchmark_data_smithi188_119427_object106976:head# 2024-04-01T19:43:01.832 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.832 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e2f8dd9:::benchmark_data_smithi188_119427_object74169:head# 2024-04-01T19:43:01.832 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.832 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e2ff05e:::benchmark_data_smithi188_119427_object97770:head# 2024-04-01T19:43:01.832 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.832 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e30420b:::benchmark_data_smithi188_119427_object149779:head# 2024-04-01T19:43:01.832 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.833 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e316065:::benchmark_data_smithi188_119427_object78826:head# 2024-04-01T19:43:01.833 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.833 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e31d214:::benchmark_data_smithi188_119427_object147487:head# 2024-04-01T19:43:01.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.834 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e31e1d5:::benchmark_data_smithi188_119427_object157191:head# 2024-04-01T19:43:01.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.834 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e32b279:::benchmark_data_smithi188_119427_object93627:head# 2024-04-01T19:43:01.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.834 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e3393ae:::benchmark_data_smithi188_119427_object154678:head# 2024-04-01T19:43:01.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.834 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e34101b:::benchmark_data_smithi188_119427_object161498:head# 2024-04-01T19:43:01.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.834 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e342d37:::benchmark_data_smithi188_119427_object159757:head# 2024-04-01T19:43:01.834 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.835 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e346541:::benchmark_data_smithi188_119427_object102965:head# 2024-04-01T19:43:01.835 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.835 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e34f93b:::benchmark_data_smithi188_119427_object73936:head# 2024-04-01T19:43:01.835 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.835 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e356723:::benchmark_data_smithi188_119427_object84436:head# 2024-04-01T19:43:01.835 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.839 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e35c4a0:::benchmark_data_smithi188_119427_object146541:head# 2024-04-01T19:43:01.839 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.839 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e377656:::benchmark_data_smithi188_119427_object159048:head# 2024-04-01T19:43:01.839 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.839 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e378a03:::benchmark_data_smithi188_119427_object94699:head# 2024-04-01T19:43:01.839 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.839 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e379392:::benchmark_data_smithi188_119427_object146557:head# 2024-04-01T19:43:01.839 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.840 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e37b322:::benchmark_data_smithi188_119427_object157529:head# 2024-04-01T19:43:01.840 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.840 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e3835be:::benchmark_data_smithi188_119427_object126600:head# 2024-04-01T19:43:01.840 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.840 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e3884ac:::benchmark_data_smithi188_119427_object159708:head# 2024-04-01T19:43:01.840 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.840 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e39c214:::benchmark_data_smithi188_119427_object99414:head# 2024-04-01T19:43:01.840 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.840 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e3a6957:::benchmark_data_smithi188_119427_object82978:head# 2024-04-01T19:43:01.840 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.840 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e3a7a1d:::benchmark_data_smithi188_119427_object84839:head# 2024-04-01T19:43:01.840 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.840 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e3aed7b:::benchmark_data_smithi188_119427_object149963:head# 2024-04-01T19:43:01.840 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.841 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e3b5696:::benchmark_data_smithi188_119427_object116532:head# 2024-04-01T19:43:01.841 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.841 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e3bca97:::benchmark_data_smithi188_119427_object109589:head# 2024-04-01T19:43:01.841 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.841 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e3d020b:::benchmark_data_smithi188_119427_object122741:head# 2024-04-01T19:43:01.841 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.841 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e3d20d0:::benchmark_data_smithi188_119427_object97411:head# 2024-04-01T19:43:01.841 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.841 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e3eac46:::benchmark_data_smithi188_119427_object127375:head# 2024-04-01T19:43:01.841 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.841 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e3eda49:::benchmark_data_smithi188_119427_object72998:head# 2024-04-01T19:43:01.841 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.842 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e3fadd1:::benchmark_data_smithi188_119427_object146570:head# 2024-04-01T19:43:01.842 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.842 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e3fe299:::benchmark_data_smithi188_119427_object139918:head# 2024-04-01T19:43:01.842 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.843 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e400840:::benchmark_data_smithi188_119427_object132135:head# 2024-04-01T19:43:01.843 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.843 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e406c31:::benchmark_data_smithi188_119427_object128242:head# 2024-04-01T19:43:01.843 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.843 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e41895c:::benchmark_data_smithi188_119427_object146412:head# 2024-04-01T19:43:01.843 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.843 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e41cedd:::benchmark_data_smithi188_119427_object93435:head# 2024-04-01T19:43:01.843 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.845 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e426dfd:::benchmark_data_smithi188_119427_object126606:head# 2024-04-01T19:43:01.845 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.847 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e42d01c:::benchmark_data_smithi188_119427_object163482:head# 2024-04-01T19:43:01.847 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.848 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e43a4fd:::benchmark_data_smithi188_119427_object156912:head# 2024-04-01T19:43:01.848 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.849 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e4506c6:::benchmark_data_smithi188_119427_object101784:head# 2024-04-01T19:43:01.849 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.849 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e475f25:::benchmark_data_smithi188_119427_object112355:head# 2024-04-01T19:43:01.849 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.849 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e478a7f:::benchmark_data_smithi188_119427_object90407:head# 2024-04-01T19:43:01.849 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.850 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e47f929:::benchmark_data_smithi188_119427_object140964:head# 2024-04-01T19:43:01.850 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.850 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e480811:::benchmark_data_smithi188_119427_object160022:head# 2024-04-01T19:43:01.850 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.850 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e496de9:::benchmark_data_smithi188_119427_object119206:head# 2024-04-01T19:43:01.850 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.853 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e49ddd1:::benchmark_data_smithi188_119427_object75653:head# 2024-04-01T19:43:01.853 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.853 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e4a49aa:::benchmark_data_smithi188_119427_object109679:head# 2024-04-01T19:43:01.853 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.853 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e4aba5d:::benchmark_data_smithi188_119427_object75703:head# 2024-04-01T19:43:01.854 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.854 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e4cccd1:::benchmark_data_smithi188_119427_object133623:head# 2024-04-01T19:43:01.854 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.854 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e4d17b5:::benchmark_data_smithi188_119427_object90052:head# 2024-04-01T19:43:01.854 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.855 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e4d6110:::benchmark_data_smithi188_119427_object115769:head# 2024-04-01T19:43:01.855 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.855 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e4d7304:::benchmark_data_smithi188_119427_object135234:head# 2024-04-01T19:43:01.855 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.855 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e4ec656:::benchmark_data_smithi188_119427_object127133:head# 2024-04-01T19:43:01.855 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.855 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e4fb943:::benchmark_data_smithi188_119427_object82674:head# 2024-04-01T19:43:01.855 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.855 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e4fce2b:::benchmark_data_smithi188_119427_object136558:head# 2024-04-01T19:43:01.855 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.856 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e50361f:::benchmark_data_smithi188_119427_object163832:head# 2024-04-01T19:43:01.857 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.857 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e511420:::benchmark_data_smithi188_119427_object146508:head# 2024-04-01T19:43:01.857 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.857 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e527198:::benchmark_data_smithi188_119427_object157875:head# 2024-04-01T19:43:01.857 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.857 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e54daf1:::benchmark_data_smithi188_119427_object92702:head# 2024-04-01T19:43:01.857 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.857 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e555398:::benchmark_data_smithi188_119427_object114844:head# 2024-04-01T19:43:01.857 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.857 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e557ba4:::benchmark_data_smithi188_119427_object77736:head# 2024-04-01T19:43:01.857 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.858 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e557cc3:::benchmark_data_smithi188_119427_object156752:head# 2024-04-01T19:43:01.858 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.858 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e565cdb:::benchmark_data_smithi188_119427_object83450:head# 2024-04-01T19:43:01.858 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.859 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e56ccd9:::benchmark_data_smithi188_119427_object104484:head# 2024-04-01T19:43:01.859 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.862 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e573a18:::benchmark_data_smithi188_119427_object138221:head# 2024-04-01T19:43:01.862 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.862 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e594adc:::benchmark_data_smithi188_119427_object99152:head# 2024-04-01T19:43:01.862 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.863 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e5959bb:::benchmark_data_smithi188_119427_object89796:head# 2024-04-01T19:43:01.863 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.863 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e5a6150:::benchmark_data_smithi188_119427_object109148:head# 2024-04-01T19:43:01.863 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.863 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e5b454d:::benchmark_data_smithi188_119427_object87046:head# 2024-04-01T19:43:01.863 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.864 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e5bb033:::benchmark_data_smithi188_119427_object148839:head# 2024-04-01T19:43:01.864 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.864 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e5bbc77:::benchmark_data_smithi188_119427_object78502:head# 2024-04-01T19:43:01.864 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.864 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e5bec87:::benchmark_data_smithi188_119427_object105648:head# 2024-04-01T19:43:01.864 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.865 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e5ca802:::benchmark_data_smithi188_119427_object75267:head# 2024-04-01T19:43:01.865 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.865 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e5eb5f8:::benchmark_data_smithi188_119427_object151961:head# 2024-04-01T19:43:01.865 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.865 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e5ec461:::benchmark_data_smithi188_119427_object149807:head# 2024-04-01T19:43:01.865 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.866 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e5edba2:::benchmark_data_smithi188_119427_object89307:head# 2024-04-01T19:43:01.866 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.866 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e5ee432:::benchmark_data_smithi188_119427_object106464:head# 2024-04-01T19:43:01.866 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.866 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e5ef1ef:::benchmark_data_smithi188_119427_object159464:head# 2024-04-01T19:43:01.867 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.867 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e5fe918:::benchmark_data_smithi188_119427_object102411:head# 2024-04-01T19:43:01.867 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.867 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e6016a7:::benchmark_data_smithi188_119427_object83353:head# 2024-04-01T19:43:01.867 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.867 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e60dd7c:::benchmark_data_smithi188_119427_object149280:head# 2024-04-01T19:43:01.867 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.872 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e61036d:::benchmark_data_smithi188_119427_object117348:head# 2024-04-01T19:43:01.872 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.872 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e61be13:::benchmark_data_smithi188_119427_object125491:head# 2024-04-01T19:43:01.872 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.872 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e62426f:::benchmark_data_smithi188_119427_object120691:head# 2024-04-01T19:43:01.872 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.872 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e6258d7:::benchmark_data_smithi188_119427_object161295:head# 2024-04-01T19:43:01.872 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.873 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e62bcfa:::benchmark_data_smithi188_119427_object144308:head# 2024-04-01T19:43:01.873 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.874 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e631add:::benchmark_data_smithi188_119427_object163577:head# 2024-04-01T19:43:01.874 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.875 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_blocked_ops 2024-04-01T19:43:01.876 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e64cdd3:::benchmark_data_smithi188_119427_object157484:head# 2024-04-01T19:43:01.877 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.877 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e66e1e9:::benchmark_data_smithi188_119427_object106608:head# 2024-04-01T19:43:01.877 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.877 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e695211:::benchmark_data_smithi188_119427_object143823:head# 2024-04-01T19:43:01.877 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.877 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e6983a1:::benchmark_data_smithi188_119427_object159521:head# 2024-04-01T19:43:01.877 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.877 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e6a1d2e:::benchmark_data_smithi188_119427_object146929:head# 2024-04-01T19:43:01.877 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.877 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e6a69cc:::benchmark_data_smithi188_119427_object162039:head# 2024-04-01T19:43:01.877 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.877 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e6b61fe:::benchmark_data_smithi188_119427_object142583:head# 2024-04-01T19:43:01.878 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.878 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e6c5053:::benchmark_data_smithi188_119427_object93894:head# 2024-04-01T19:43:01.878 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.881 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e6e9ce7:::benchmark_data_smithi188_119427_object161830:head# 2024-04-01T19:43:01.881 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.881 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e6f0b0f:::benchmark_data_smithi188_119427_object122232:head# 2024-04-01T19:43:01.881 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.887 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e6f2c10:::benchmark_data_smithi188_119427_object118428:head# 2024-04-01T19:43:01.887 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.888 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e6f9dd4:::benchmark_data_smithi188_119427_object148319:head# 2024-04-01T19:43:01.888 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.889 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e6ff88d:::benchmark_data_smithi188_119427_object148415:head# 2024-04-01T19:43:01.889 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.889 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e7164b1:::benchmark_data_smithi188_119427_object75642:head# 2024-04-01T19:43:01.889 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.889 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e724f1c:::benchmark_data_smithi188_119427_object135181:head# 2024-04-01T19:43:01.889 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.889 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e728978:::benchmark_data_smithi188_119427_object84035:head# 2024-04-01T19:43:01.890 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.890 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e73039a:::benchmark_data_smithi188_119427_object138152:head# 2024-04-01T19:43:01.890 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.894 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e738ff6:::benchmark_data_smithi188_119427_object76859:head# 2024-04-01T19:43:01.894 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.895 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e7421df:::benchmark_data_smithi188_119427_object142594:head# 2024-04-01T19:43:01.895 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.896 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e742a26:::benchmark_data_smithi188_119427_object113776:head# 2024-04-01T19:43:01.896 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.896 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e751278:::benchmark_data_smithi188_119427_object85329:head# 2024-04-01T19:43:01.896 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.896 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e753767:::benchmark_data_smithi188_119427_object140417:head# 2024-04-01T19:43:01.896 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.896 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e76753c:::benchmark_data_smithi188_119427_object141411:head# 2024-04-01T19:43:01.896 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.900 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e773c5e:::benchmark_data_smithi188_119427_object117028:head# 2024-04-01T19:43:01.900 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.901 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e77cbf8:::benchmark_data_smithi188_119427_object102540:head# 2024-04-01T19:43:01.901 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.901 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e78158d:::benchmark_data_smithi188_119427_object93811:head# 2024-04-01T19:43:01.901 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.901 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e7a7b38:::benchmark_data_smithi188_119427_object131062:head# 2024-04-01T19:43:01.901 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.902 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e7b8845:::benchmark_data_smithi188_119427_object121311:head# 2024-04-01T19:43:01.902 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.902 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e7c5cff:::benchmark_data_smithi188_119427_object76545:head# 2024-04-01T19:43:01.902 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.906 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e7d2136:::benchmark_data_smithi188_119427_object119635:head# 2024-04-01T19:43:01.906 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.907 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e7f33bb:::benchmark_data_smithi188_119427_object129219:head# 2024-04-01T19:43:01.907 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.907 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e7f5dad:::benchmark_data_smithi188_119427_object132918:head# 2024-04-01T19:43:01.907 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.907 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e806465:::benchmark_data_smithi188_119427_object163539:head# 2024-04-01T19:43:01.907 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.908 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e813885:::benchmark_data_smithi188_119427_object117033:head# 2024-04-01T19:43:01.908 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.908 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e833131:::benchmark_data_smithi188_119427_object87234:head# 2024-04-01T19:43:01.908 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.908 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e83db7a:::benchmark_data_smithi188_119427_object161338:head# 2024-04-01T19:43:01.909 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.909 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e844ff8:::benchmark_data_smithi188_119427_object105840:head# 2024-04-01T19:43:01.909 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.910 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e846954:::benchmark_data_smithi188_119427_object123641:head# 2024-04-01T19:43:01.910 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.910 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e846ad4:::benchmark_data_smithi188_119427_object99800:head# 2024-04-01T19:43:01.910 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.910 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e84c7be:::benchmark_data_smithi188_119427_object140457:head# 2024-04-01T19:43:01.910 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.910 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e85ac3e:::benchmark_data_smithi188_119427_object75802:head# 2024-04-01T19:43:01.910 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.910 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e868c1c:::benchmark_data_smithi188_119427_object80806:head# 2024-04-01T19:43:01.910 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.912 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e8690f3:::benchmark_data_smithi188_119427_object123660:head# 2024-04-01T19:43:01.912 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.912 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e86ddcc:::benchmark_data_smithi188_119427_object78191:head# 2024-04-01T19:43:01.912 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.912 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e87078d:::benchmark_data_smithi188_119427_object90898:head# 2024-04-01T19:43:01.912 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.912 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e8779fd:::benchmark_data_smithi188_119427_object157399:head# 2024-04-01T19:43:01.912 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.912 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e87d51d:::benchmark_data_smithi188_119427_object120813:head# 2024-04-01T19:43:01.912 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.912 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e887219:::benchmark_data_smithi188_119427_object86572:head# 2024-04-01T19:43:01.912 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.913 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e896d71:::benchmark_data_smithi188_119427_object115202:head# 2024-04-01T19:43:01.913 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.914 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e89d1fc:::benchmark_data_smithi188_119427_object145816:head# 2024-04-01T19:43:01.914 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.914 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e8a5834:::benchmark_data_smithi188_119427_object104886:head# 2024-04-01T19:43:01.914 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.914 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e8aa6a7:::benchmark_data_smithi188_119427_object83153:head# 2024-04-01T19:43:01.914 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.914 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e8ac215:::benchmark_data_smithi188_119427_object94382:head# 2024-04-01T19:43:01.914 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.914 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e8afcf9:::benchmark_data_smithi188_119427_object82483:head# 2024-04-01T19:43:01.914 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.914 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e8bfed0:::benchmark_data_smithi188_119427_object95029:head# 2024-04-01T19:43:01.915 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.915 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e8df275:::benchmark_data_smithi188_119427_object85759:head# 2024-04-01T19:43:01.915 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.915 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e8e8e6a:::benchmark_data_smithi188_119427_object125468:head# 2024-04-01T19:43:01.915 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.916 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e8ea4d3:::benchmark_data_smithi188_119427_object152726:head# 2024-04-01T19:43:01.916 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.916 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e8f2c95:::benchmark_data_smithi188_119427_object94266:head# 2024-04-01T19:43:01.916 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.916 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e900ce9:::benchmark_data_smithi188_119427_object108433:head# 2024-04-01T19:43:01.917 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.917 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e911bcc:::benchmark_data_smithi188_119427_object123756:head# 2024-04-01T19:43:01.917 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.917 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e925a96:::benchmark_data_smithi188_119427_object106301:head# 2024-04-01T19:43:01.917 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.917 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e92b4d2:::benchmark_data_smithi188_119427_object144855:head# 2024-04-01T19:43:01.917 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.917 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e92d4a6:::benchmark_data_smithi188_119427_object161546:head# 2024-04-01T19:43:01.917 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.917 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e9309c5:::benchmark_data_smithi188_119427_object135249:head# 2024-04-01T19:43:01.917 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.917 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e936d4e:::benchmark_data_smithi188_119427_object154445:head# 2024-04-01T19:43:01.917 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.919 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e936d85:::benchmark_data_smithi188_119427_object127027:head# 2024-04-01T19:43:01.919 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.919 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e938221:::benchmark_data_smithi188_119427_object92241:head# 2024-04-01T19:43:01.920 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.920 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e946303:::benchmark_data_smithi188_119427_object82434:head# 2024-04-01T19:43:01.920 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.920 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e946b70:::benchmark_data_smithi188_119427_object78819:head# 2024-04-01T19:43:01.920 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.920 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e94f1c3:::benchmark_data_smithi188_119427_object118315:head# 2024-04-01T19:43:01.920 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.920 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e95e2dc:::benchmark_data_smithi188_119427_object87578:head# 2024-04-01T19:43:01.920 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.920 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e95e885:::benchmark_data_smithi188_119427_object136072:head# 2024-04-01T19:43:01.920 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.920 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e975b4e:::benchmark_data_smithi188_119427_object111799:head# 2024-04-01T19:43:01.920 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.921 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e998af0:::benchmark_data_smithi188_119427_object103208:head# 2024-04-01T19:43:01.921 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.921 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e99921e:::benchmark_data_smithi188_119427_object107505:head# 2024-04-01T19:43:01.921 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.921 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e9a4136:::benchmark_data_smithi188_119427_object162263:head# 2024-04-01T19:43:01.921 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.923 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e9a9337:::benchmark_data_smithi188_119427_object119984:head# 2024-04-01T19:43:01.923 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.923 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e9d1492:::benchmark_data_smithi188_119427_object119478:head# 2024-04-01T19:43:01.923 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.923 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e9ef4fa:::benchmark_data_smithi188_119427_object112910:head# 2024-04-01T19:43:01.923 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.923 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4e9f3c82:::benchmark_data_smithi188_119427_object76059:head# 2024-04-01T19:43:01.923 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.923 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ea01cd8:::benchmark_data_smithi188_119427_object123682:head# 2024-04-01T19:43:01.923 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ea0fc09:::benchmark_data_smithi188_119427_object124091:head# 2024-04-01T19:43:01.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ea20e7d:::benchmark_data_smithi188_119427_object108141:head# 2024-04-01T19:43:01.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ea45846:::benchmark_data_smithi188_119427_object161137:head# 2024-04-01T19:43:01.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ea54d8b:::benchmark_data_smithi188_119427_object75867:head# 2024-04-01T19:43:01.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ea55bde:::benchmark_data_smithi188_119427_object110772:head# 2024-04-01T19:43:01.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ea64a40:::benchmark_data_smithi188_119427_object102084:head# 2024-04-01T19:43:01.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.924 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ea6dcbb:::benchmark_data_smithi188_119427_object98137:head# 2024-04-01T19:43:01.924 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.925 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ea95f49:::benchmark_data_smithi188_119427_object135787:head# 2024-04-01T19:43:01.925 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.925 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eaa02e1:::benchmark_data_smithi188_119427_object152190:head# 2024-04-01T19:43:01.926 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.926 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eaa6da7:::benchmark_data_smithi188_119427_object121948:head# 2024-04-01T19:43:01.926 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.926 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eab5f64:::benchmark_data_smithi188_119427_object133434:head# 2024-04-01T19:43:01.926 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.926 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eac4416:::benchmark_data_smithi188_119427_object114882:head# 2024-04-01T19:43:01.926 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.926 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eac4e94:::benchmark_data_smithi188_119427_object152986:head# 2024-04-01T19:43:01.926 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.926 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eae8d60:::benchmark_data_smithi188_119427_object131962:head# 2024-04-01T19:43:01.926 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.927 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eb0afe7:::benchmark_data_smithi188_119427_object139511:head# 2024-04-01T19:43:01.927 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.927 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eb0c496:::benchmark_data_smithi188_119427_object148292:head# 2024-04-01T19:43:01.927 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.927 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eb16221:::benchmark_data_smithi188_119427_object77964:head# 2024-04-01T19:43:01.928 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.928 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eb2257d:::benchmark_data_smithi188_119427_object110488:head# 2024-04-01T19:43:01.928 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.928 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eb23e2e:::benchmark_data_smithi188_119427_object111062:head# 2024-04-01T19:43:01.928 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.928 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eb27f29:::benchmark_data_smithi188_119427_object90681:head# 2024-04-01T19:43:01.928 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.928 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eb28b61:::benchmark_data_smithi188_119427_object155276:head# 2024-04-01T19:43:01.928 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.928 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eb2e04e:::benchmark_data_smithi188_119427_object98379:head# 2024-04-01T19:43:01.928 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.928 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eb40624:::benchmark_data_smithi188_119427_object129015:head# 2024-04-01T19:43:01.928 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.930 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eb462e8:::benchmark_data_smithi188_119427_object138841:head# 2024-04-01T19:43:01.930 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.930 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eb48241:::benchmark_data_smithi188_119427_object119636:head# 2024-04-01T19:43:01.930 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.931 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eb49557:::benchmark_data_smithi188_119427_object116749:head# 2024-04-01T19:43:01.931 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.931 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eb564d5:::benchmark_data_smithi188_119427_object141510:head# 2024-04-01T19:43:01.931 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.931 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eb5ee11:::benchmark_data_smithi188_119427_object86471:head# 2024-04-01T19:43:01.931 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.931 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eb61443:::benchmark_data_smithi188_119427_object122007:head# 2024-04-01T19:43:01.931 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.931 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eb7031d:::benchmark_data_smithi188_119427_object122813:head# 2024-04-01T19:43:01.931 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.931 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eb70ed9:::benchmark_data_smithi188_119427_object78511:head# 2024-04-01T19:43:01.931 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.931 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eb8b67b:::benchmark_data_smithi188_119427_object90836:head# 2024-04-01T19:43:01.931 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.932 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ebb10dd:::benchmark_data_smithi188_119427_object131552:head# 2024-04-01T19:43:01.932 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.932 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ebb9f89:::benchmark_data_smithi188_119427_object152233:head# 2024-04-01T19:43:01.932 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.932 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ebbb8c0:::benchmark_data_smithi188_119427_object157675:head# 2024-04-01T19:43:01.932 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.934 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ebc3488:::benchmark_data_smithi188_119427_object107975:head# 2024-04-01T19:43:01.934 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.934 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ebd8514:::benchmark_data_smithi188_119427_object127629:head# 2024-04-01T19:43:01.934 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.934 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ebda638:::benchmark_data_smithi188_119427_object91317:head# 2024-04-01T19:43:01.934 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.934 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ebf5dcb:::benchmark_data_smithi188_119427_object77022:head# 2024-04-01T19:43:01.934 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.934 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ec0336c:::benchmark_data_smithi188_119427_object158958:head# 2024-04-01T19:43:01.934 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.934 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ec0428d:::benchmark_data_smithi188_119427_object114325:head# 2024-04-01T19:43:01.934 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ec0476b:::benchmark_data_smithi188_119427_object150496:head# 2024-04-01T19:43:01.935 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ec0bbcb:::benchmark_data_smithi188_119427_object95335:head# 2024-04-01T19:43:01.935 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ec1f532:::benchmark_data_smithi188_119427_object97824:head# 2024-04-01T19:43:01.935 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ec2a6a3:::benchmark_data_smithi188_119427_object102081:head# 2024-04-01T19:43:01.935 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ec38a19:::benchmark_data_smithi188_119427_object157409:head# 2024-04-01T19:43:01.935 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ec45aa6:::benchmark_data_smithi188_119427_object154633:head# 2024-04-01T19:43:01.935 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.935 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ec45f55:::benchmark_data_smithi188_119427_object156663:head# 2024-04-01T19:43:01.935 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.937 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ec542fb:::benchmark_data_smithi188_119427_object73840:head# 2024-04-01T19:43:01.938 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.938 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ec56e7c:::benchmark_data_smithi188_119427_object136564:head# 2024-04-01T19:43:01.938 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.938 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ec5f1df:::benchmark_data_smithi188_119427_object144407:head# 2024-04-01T19:43:01.938 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.938 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ec70752:::benchmark_data_smithi188_119427_object122312:head# 2024-04-01T19:43:01.938 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.938 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ec71f34:::benchmark_data_smithi188_119427_object114932:head# 2024-04-01T19:43:01.938 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.938 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ec7c1a9:::benchmark_data_smithi188_119427_object158347:head# 2024-04-01T19:43:01.938 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.938 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ec8a98e:::benchmark_data_smithi188_119427_object157563:head# 2024-04-01T19:43:01.938 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.939 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ec9fa5d:::benchmark_data_smithi188_119427_object111886:head# 2024-04-01T19:43:01.939 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.939 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ecde323:::benchmark_data_smithi188_119427_object154694:head# 2024-04-01T19:43:01.939 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.939 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ece8140:::benchmark_data_smithi188_119427_object146385:head# 2024-04-01T19:43:01.939 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.939 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ecfe8db:::benchmark_data_smithi188_119427_object158697:head# 2024-04-01T19:43:01.939 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.939 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ed07d65:::benchmark_data_smithi188_119427_object123721:head# 2024-04-01T19:43:01.939 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.939 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ed0b3bd:::benchmark_data_smithi188_119427_object122172:head# 2024-04-01T19:43:01.939 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.939 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ed29678:::benchmark_data_smithi188_119427_object161734:head# 2024-04-01T19:43:01.939 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.940 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ed33f09:::benchmark_data_smithi188_119427_object90617:head# 2024-04-01T19:43:01.940 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.941 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ed3e24c:::benchmark_data_smithi188_119427_object98874:head# 2024-04-01T19:43:01.941 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.941 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ed45180:::benchmark_data_smithi188_119427_object109131:head# 2024-04-01T19:43:01.941 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.941 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ed4e150:::benchmark_data_smithi188_119427_object136123:head# 2024-04-01T19:43:01.941 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.941 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ed620a9:::benchmark_data_smithi188_119427_object140860:head# 2024-04-01T19:43:01.941 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.944 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ed67e2d:::benchmark_data_smithi188_119427_object84233:head# 2024-04-01T19:43:01.944 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.945 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ed6b8e6:::benchmark_data_smithi188_119427_object161973:head# 2024-04-01T19:43:01.945 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.948 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ed6dd07:::benchmark_data_smithi188_119427_object134033:head# 2024-04-01T19:43:01.948 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.948 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ed72e30:::benchmark_data_smithi188_119427_object120376:head# 2024-04-01T19:43:01.948 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.948 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ed77530:::benchmark_data_smithi188_119427_object117783:head# 2024-04-01T19:43:01.949 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.949 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ed7e091:::benchmark_data_smithi188_119427_object135789:head# 2024-04-01T19:43:01.949 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.949 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4edabb2d:::benchmark_data_smithi188_119427_object144216:head# 2024-04-01T19:43:01.949 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.949 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4edb2959:::benchmark_data_smithi188_119427_object73621:head# 2024-04-01T19:43:01.949 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.949 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4edb7226:::benchmark_data_smithi188_119427_object94142:head# 2024-04-01T19:43:01.949 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.949 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4edb8123:::benchmark_data_smithi188_119427_object110839:head# 2024-04-01T19:43:01.949 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.949 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4edbb265:::benchmark_data_smithi188_119427_object94303:head# 2024-04-01T19:43:01.949 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.950 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4edc1d0a:::benchmark_data_smithi188_119427_object103712:head# 2024-04-01T19:43:01.950 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.950 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4edc5ac2:::benchmark_data_smithi188_119427_object106064:head# 2024-04-01T19:43:01.950 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.950 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4edcc1f0:::benchmark_data_smithi188_119427_object78918:head# 2024-04-01T19:43:01.951 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.951 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4edd5502:::benchmark_data_smithi188_119427_object110407:head# 2024-04-01T19:43:01.951 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.951 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4edd5b82:::benchmark_data_smithi188_119427_object143245:head# 2024-04-01T19:43:01.951 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.954 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ede4149:::benchmark_data_smithi188_119427_object76526:head# 2024-04-01T19:43:01.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4edf3dab:::benchmark_data_smithi188_119427_object161229:head# 2024-04-01T19:43:01.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4edf4537:::benchmark_data_smithi188_119427_object149906:head# 2024-04-01T19:43:01.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4edfe4e0:::benchmark_data_smithi188_119427_object102306:head# 2024-04-01T19:43:01.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ee02426:::benchmark_data_smithi188_119427_object91478:head# 2024-04-01T19:43:01.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ee124cc:::benchmark_data_smithi188_119427_object90272:head# 2024-04-01T19:43:01.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.955 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ee20042:::benchmark_data_smithi188_119427_object111386:head# 2024-04-01T19:43:01.955 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.956 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ee2420a:::benchmark_data_smithi188_119427_object84111:head# 2024-04-01T19:43:01.956 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.956 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ee4faa3:::benchmark_data_smithi188_119427_object140621:head# 2024-04-01T19:43:01.956 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.956 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ee58b27:::benchmark_data_smithi188_119427_object160930:head# 2024-04-01T19:43:01.956 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.956 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ee5a357:::benchmark_data_smithi188_119427_object132783:head# 2024-04-01T19:43:01.956 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.956 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ee5b7d8:::benchmark_data_smithi188_119427_object131676:head# 2024-04-01T19:43:01.956 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.956 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ee60471:::benchmark_data_smithi188_119427_object111643:head# 2024-04-01T19:43:01.956 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.956 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ee6f7fc:::benchmark_data_smithi188_119427_object103250:head# 2024-04-01T19:43:01.957 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.957 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ee8474c:::benchmark_data_smithi188_119427_object125539:head# 2024-04-01T19:43:01.957 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.957 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ee87c3e:::benchmark_data_smithi188_119427_object145740:head# 2024-04-01T19:43:01.957 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.957 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ee9b883:::benchmark_data_smithi188_119427_object162741:head# 2024-04-01T19:43:01.957 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.957 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eea0039:::benchmark_data_smithi188_119427_object145291:head# 2024-04-01T19:43:01.957 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.959 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eea2a79:::benchmark_data_smithi188_119427_object98211:head# 2024-04-01T19:43:01.959 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.959 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eea6b63:::benchmark_data_smithi188_119427_object118748:head# 2024-04-01T19:43:01.959 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.959 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eeb70bb:::benchmark_data_smithi188_119427_object90243:head# 2024-04-01T19:43:01.959 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.959 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eebde02:::benchmark_data_smithi188_119427_object92509:head# 2024-04-01T19:43:01.959 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.959 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eecf9d4:::benchmark_data_smithi188_119427_object160023:head# 2024-04-01T19:43:01.959 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eeddf75:::benchmark_data_smithi188_119427_object141035:head# 2024-04-01T19:43:01.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eee7e0a:::benchmark_data_smithi188_119427_object110624:head# 2024-04-01T19:43:01.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eeee8dc:::benchmark_data_smithi188_119427_object98839:head# 2024-04-01T19:43:01.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eef3101:::benchmark_data_smithi188_119427_object133893:head# 2024-04-01T19:43:01.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eef31af:::benchmark_data_smithi188_119427_object158868:head# 2024-04-01T19:43:01.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.960 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4eefa5c0:::benchmark_data_smithi188_119427_object89985:head# 2024-04-01T19:43:01.960 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.962 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ef1f5c6:::benchmark_data_smithi188_119427_object146351:head# 2024-04-01T19:43:01.962 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.962 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ef2570d:::benchmark_data_smithi188_119427_object156811:head# 2024-04-01T19:43:01.962 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.962 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ef2f468:::benchmark_data_smithi188_119427_object146767:head# 2024-04-01T19:43:01.962 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.962 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ef38ca8:::benchmark_data_smithi188_119427_object100310:head# 2024-04-01T19:43:01.962 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.962 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ef4a1c1:::benchmark_data_smithi188_119427_object140044:head# 2024-04-01T19:43:01.962 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.962 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ef4b1fb:::benchmark_data_smithi188_119427_object148782:head# 2024-04-01T19:43:01.962 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.963 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ef59a7d:::benchmark_data_smithi188_119427_object148796:head# 2024-04-01T19:43:01.963 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.963 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ef5fff5:::benchmark_data_smithi188_119427_object132855:head# 2024-04-01T19:43:01.963 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.963 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ef759c5:::benchmark_data_smithi188_119427_object111041:head# 2024-04-01T19:43:01.963 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.964 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4efa06fe:::benchmark_data_smithi188_119427_object163575:head# 2024-04-01T19:43:01.964 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.964 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4efa2af2:::benchmark_data_smithi188_119427_object84633:head# 2024-04-01T19:43:01.964 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.964 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4efb0863:::benchmark_data_smithi188_119427_object95876:head# 2024-04-01T19:43:01.964 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.964 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4efb13d7:::benchmark_data_smithi188_119427_object131527:head# 2024-04-01T19:43:01.965 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.965 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4efd4173:::benchmark_data_smithi188_119427_object131334:head# 2024-04-01T19:43:01.965 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.965 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4efd7806:::benchmark_data_smithi188_119427_object84838:head# 2024-04-01T19:43:01.965 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.965 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f009d58:::benchmark_data_smithi188_119427_object163888:head# 2024-04-01T19:43:01.965 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.965 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f013c8c:::benchmark_data_smithi188_119427_object121449:head# 2024-04-01T19:43:01.965 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.966 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f017d87:::benchmark_data_smithi188_119427_object153827:head# 2024-04-01T19:43:01.966 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.966 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f0180d1:::benchmark_data_smithi188_119427_object159418:head# 2024-04-01T19:43:01.966 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.971 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f01a440:::benchmark_data_smithi188_119427_object102855:head# 2024-04-01T19:43:01.971 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.971 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f028c4b:::benchmark_data_smithi188_119427_object98457:head# 2024-04-01T19:43:01.971 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.971 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f04a12e:::benchmark_data_smithi188_119427_object153430:head# 2024-04-01T19:43:01.971 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.971 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f04ea07:::benchmark_data_smithi188_119427_object106430:head# 2024-04-01T19:43:01.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f057f21:::benchmark_data_smithi188_119427_object130392:head# 2024-04-01T19:43:01.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f05b712:::benchmark_data_smithi188_119427_object84206:head# 2024-04-01T19:43:01.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f05db7e:::benchmark_data_smithi188_119427_object112101:head# 2024-04-01T19:43:01.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f05ea8a:::benchmark_data_smithi188_119427_object82277:head# 2024-04-01T19:43:01.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f063a51:::benchmark_data_smithi188_119427_object103447:head# 2024-04-01T19:43:01.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f076454:::benchmark_data_smithi188_119427_object120265:head# 2024-04-01T19:43:01.972 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.972 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f088ba2:::benchmark_data_smithi188_119427_object105180:head# 2024-04-01T19:43:01.973 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.973 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f08c66c:::benchmark_data_smithi188_119427_object73178:head# 2024-04-01T19:43:01.973 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.973 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f08e666:::benchmark_data_smithi188_119427_object156771:head# 2024-04-01T19:43:01.973 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.973 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f0941fe:::benchmark_data_smithi188_119427_object160994:head# 2024-04-01T19:43:01.973 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.975 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f0a996b:::benchmark_data_smithi188_119427_object88950:head# 2024-04-01T19:43:01.975 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.975 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f0abe5a:::benchmark_data_smithi188_119427_object94061:head# 2024-04-01T19:43:01.975 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.976 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f0aedd1:::benchmark_data_smithi188_119427_object98818:head# 2024-04-01T19:43:01.976 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.976 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f0b392f:::benchmark_data_smithi188_119427_object123913:head# 2024-04-01T19:43:01.976 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.976 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f0b5c73:::benchmark_data_smithi188_119427_object137367:head# 2024-04-01T19:43:01.976 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.977 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f0c39f1:::benchmark_data_smithi188_119427_object96276:head# 2024-04-01T19:43:01.977 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.977 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f0ebbad:::benchmark_data_smithi188_119427_object84890:head# 2024-04-01T19:43:01.977 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.979 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f0eeb69:::benchmark_data_smithi188_119427_object109422:head# 2024-04-01T19:43:01.979 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.982 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f0f24bc:::benchmark_data_smithi188_119427_object157427:head# 2024-04-01T19:43:01.982 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.982 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f0ff7c1:::benchmark_data_smithi188_119427_object103560:head# 2024-04-01T19:43:01.982 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.983 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f114e60:::benchmark_data_smithi188_119427_object101299:head# 2024-04-01T19:43:01.983 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.983 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f1199ad:::benchmark_data_smithi188_119427_object162533:head# 2024-04-01T19:43:01.983 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.983 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f11dfa2:::benchmark_data_smithi188_119427_object110418:head# 2024-04-01T19:43:01.983 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.983 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f122653:::benchmark_data_smithi188_119427_object157642:head# 2024-04-01T19:43:01.984 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.986 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f13056e:::benchmark_data_smithi188_119427_object160226:head# 2024-04-01T19:43:01.987 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.987 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f1377f1:::benchmark_data_smithi188_119427_object104821:head# 2024-04-01T19:43:01.987 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.987 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f15ab8d:::benchmark_data_smithi188_119427_object148614:head# 2024-04-01T19:43:01.987 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.987 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f15b7af:::benchmark_data_smithi188_119427_object105891:head# 2024-04-01T19:43:01.987 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.987 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f162bc4:::benchmark_data_smithi188_119427_object158173:head# 2024-04-01T19:43:01.987 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.987 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f1737da:::benchmark_data_smithi188_119427_object162826:head# 2024-04-01T19:43:01.987 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.987 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f1748a2:::benchmark_data_smithi188_119427_object144351:head# 2024-04-01T19:43:01.988 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.988 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f1856b4:::benchmark_data_smithi188_119427_object107789:head# 2024-04-01T19:43:01.988 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.988 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f1881c3:::benchmark_data_smithi188_119427_object93061:head# 2024-04-01T19:43:01.988 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.988 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f1986a7:::benchmark_data_smithi188_119427_object92424:head# 2024-04-01T19:43:01.988 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.989 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f19dd17:::benchmark_data_smithi188_119427_object142606:head# 2024-04-01T19:43:01.989 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.989 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f1a2095:::benchmark_data_smithi188_119427_object106449:head# 2024-04-01T19:43:01.990 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.990 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f1c15d0:::benchmark_data_smithi188_119427_object127391:head# 2024-04-01T19:43:01.990 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.990 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f1d32bb:::benchmark_data_smithi188_119427_object115581:head# 2024-04-01T19:43:01.990 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.990 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f1d9e8f:::benchmark_data_smithi188_119427_object108138:head# 2024-04-01T19:43:01.990 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.990 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f1dfb6d:::benchmark_data_smithi188_119427_object83780:head# 2024-04-01T19:43:01.990 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.990 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f1e52ff:::benchmark_data_smithi188_119427_object117874:head# 2024-04-01T19:43:01.990 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.990 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f1f7cdd:::benchmark_data_smithi188_119427_object81297:head# 2024-04-01T19:43:01.990 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.991 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f203817:::benchmark_data_smithi188_119427_object73043:head# 2024-04-01T19:43:01.991 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.991 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f20dc4d:::benchmark_data_smithi188_119427_object123984:head# 2024-04-01T19:43:01.992 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.992 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f22b778:::benchmark_data_smithi188_119427_object132368:head# 2024-04-01T19:43:01.992 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.992 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f23bce1:::benchmark_data_smithi188_119427_object113884:head# 2024-04-01T19:43:01.992 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.992 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f243ec5:::benchmark_data_smithi188_119427_object87448:head# 2024-04-01T19:43:01.992 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.992 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f24df32:::benchmark_data_smithi188_119427_object153067:head# 2024-04-01T19:43:01.992 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.992 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f257e8b:::benchmark_data_smithi188_119427_object160685:head# 2024-04-01T19:43:01.992 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.992 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f263976:::benchmark_data_smithi188_119427_object73360:head# 2024-04-01T19:43:01.992 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.993 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f263f5f:::benchmark_data_smithi188_119427_object138078:head# 2024-04-01T19:43:01.993 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.993 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f26cd62:::benchmark_data_smithi188_119427_object107945:head# 2024-04-01T19:43:01.994 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.994 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f26e04a:::benchmark_data_smithi188_119427_object72857:head# 2024-04-01T19:43:01.994 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.994 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f275328:::benchmark_data_smithi188_119427_object89503:head# 2024-04-01T19:43:01.994 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.994 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f288c16:::benchmark_data_smithi188_119427_object74938:head# 2024-04-01T19:43:01.994 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.996 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f29340e:::benchmark_data_smithi188_119427_object114472:head# 2024-04-01T19:43:01.996 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.996 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f29d31d:::benchmark_data_smithi188_119427_object145255:head# 2024-04-01T19:43:01.996 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.996 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f2a195f:::benchmark_data_smithi188_119427_object76458:head# 2024-04-01T19:43:01.996 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.996 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f2ae568:::benchmark_data_smithi188_119427_object126533:head# 2024-04-01T19:43:01.996 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.996 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f2b6b6f:::benchmark_data_smithi188_119427_object74249:head# 2024-04-01T19:43:01.996 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.996 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f2cc3b8:::benchmark_data_smithi188_119427_object90585:head# 2024-04-01T19:43:01.996 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.996 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f2fb911:::benchmark_data_smithi188_119427_object103990:head# 2024-04-01T19:43:01.997 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.997 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f31ab84:::benchmark_data_smithi188_119427_object97674:head# 2024-04-01T19:43:01.997 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.997 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f31d26c:::benchmark_data_smithi188_119427_object158282:head# 2024-04-01T19:43:01.997 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.997 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f31e808:::benchmark_data_smithi188_119427_object101306:head# 2024-04-01T19:43:01.998 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.998 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f3264f1:::benchmark_data_smithi188_119427_object126154:head# 2024-04-01T19:43:01.998 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.998 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f337aa2:::benchmark_data_smithi188_119427_object115981:head# 2024-04-01T19:43:01.998 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.999 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f341513:::benchmark_data_smithi188_119427_object163228:head# 2024-04-01T19:43:01.999 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.999 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f3604f5:::benchmark_data_smithi188_119427_object96520:head# 2024-04-01T19:43:01.999 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.999 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f3691f1:::benchmark_data_smithi188_119427_object103611:head# 2024-04-01T19:43:01.999 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:01.999 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f36f873:::benchmark_data_smithi188_119427_object126378:head# 2024-04-01T19:43:01.999 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.000 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f37ab78:::benchmark_data_smithi188_119427_object132749:head# 2024-04-01T19:43:02.000 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.000 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f38ea7e:::benchmark_data_smithi188_119427_object82893:head# 2024-04-01T19:43:02.000 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.000 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f39792d:::benchmark_data_smithi188_119427_object154938:head# 2024-04-01T19:43:02.000 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.000 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f3a34d3:::benchmark_data_smithi188_119427_object143950:head# 2024-04-01T19:43:02.000 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.001 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f3a753a:::benchmark_data_smithi188_119427_object115443:head# 2024-04-01T19:43:02.001 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.001 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f3acafd:::benchmark_data_smithi188_119427_object97470:head# 2024-04-01T19:43:02.001 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.002 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f3c4590:::benchmark_data_smithi188_119427_object95965:head# 2024-04-01T19:43:02.002 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.002 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f3e1a32:::benchmark_data_smithi188_119427_object72900:head# 2024-04-01T19:43:02.002 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.003 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f3e4bfa:::benchmark_data_smithi188_119427_object89634:head# 2024-04-01T19:43:02.003 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.004 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f3e6072:::benchmark_data_smithi188_119427_object154102:head# 2024-04-01T19:43:02.004 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.004 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f3f0756:::benchmark_data_smithi188_119427_object124437:head# 2024-04-01T19:43:02.004 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.004 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f3fcaa3:::benchmark_data_smithi188_119427_object72923:head# 2024-04-01T19:43:02.004 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.006 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f3ff1aa:::benchmark_data_smithi188_119427_object154190:head# 2024-04-01T19:43:02.006 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.007 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f401288:::benchmark_data_smithi188_119427_object109975:head# 2024-04-01T19:43:02.007 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.007 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f403a56:::benchmark_data_smithi188_119427_object85145:head# 2024-04-01T19:43:02.007 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.008 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f407abe:::benchmark_data_smithi188_119427_object146273:head# 2024-04-01T19:43:02.008 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.008 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f40bce3:::benchmark_data_smithi188_119427_object156230:head# 2024-04-01T19:43:02.008 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.009 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f411926:::benchmark_data_smithi188_119427_object116245:head# 2024-04-01T19:43:02.009 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.009 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f41444b:::benchmark_data_smithi188_119427_object98156:head# 2024-04-01T19:43:02.009 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.009 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f428601:::benchmark_data_smithi188_119427_object132280:head# 2024-04-01T19:43:02.009 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.009 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f434dcb:::benchmark_data_smithi188_119427_object157019:head# 2024-04-01T19:43:02.009 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.009 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f44259d:::benchmark_data_smithi188_119427_object93153:head# 2024-04-01T19:43:02.009 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.009 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f44ee48:::benchmark_data_smithi188_119427_object135049:head# 2024-04-01T19:43:02.010 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.011 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f45d2ca:::benchmark_data_smithi188_119427_object156303:head# 2024-04-01T19:43:02.011 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.011 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f45ec9c:::benchmark_data_smithi188_119427_object104004:head# 2024-04-01T19:43:02.011 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.011 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f47644a:::benchmark_data_smithi188_119427_object158833:head# 2024-04-01T19:43:02.011 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.011 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f479e2b:::benchmark_data_smithi188_119427_object129294:head# 2024-04-01T19:43:02.011 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.011 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f48bb8a:::benchmark_data_smithi188_119427_object102343:head# 2024-04-01T19:43:02.011 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.011 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f49952d:::benchmark_data_smithi188_119427_object121824:head# 2024-04-01T19:43:02.012 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.012 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f499e41:::benchmark_data_smithi188_119427_object88989:head# 2024-04-01T19:43:02.012 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.012 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f49acc6:::benchmark_data_smithi188_119427_object114806:head# 2024-04-01T19:43:02.012 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.013 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f4a243b:::benchmark_data_smithi188_119427_object127900:head# 2024-04-01T19:43:02.013 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.014 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f4a7385:::benchmark_data_smithi188_119427_object150400:head# 2024-04-01T19:43:02.014 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.014 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f4b7984:::benchmark_data_smithi188_119427_object109704:head# 2024-04-01T19:43:02.014 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.015 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f4cf4a6:::benchmark_data_smithi188_119427_object77648:head# 2024-04-01T19:43:02.015 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.015 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f4def18:::benchmark_data_smithi188_119427_object91196:head# 2024-04-01T19:43:02.015 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.015 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f4e03bf:::benchmark_data_smithi188_119427_object145044:head# 2024-04-01T19:43:02.015 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.015 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f5158d2:::benchmark_data_smithi188_119427_object99909:head# 2024-04-01T19:43:02.015 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f52068a:::benchmark_data_smithi188_119427_object118970:head# 2024-04-01T19:43:02.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f525512:::benchmark_data_smithi188_119427_object143084:head# 2024-04-01T19:43:02.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.016 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f52cab4:::benchmark_data_smithi188_119427_object79369:head# 2024-04-01T19:43:02.016 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.017 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f534e73:::benchmark_data_smithi188_119427_object161986:head# 2024-04-01T19:43:02.017 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.017 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f53500f:::benchmark_data_smithi188_119427_object87305:head# 2024-04-01T19:43:02.017 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.021 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f535f5d:::benchmark_data_smithi188_119427_object93483:head# 2024-04-01T19:43:02.022 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.022 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f55bcf2:::benchmark_data_smithi188_119427_object92770:head# 2024-04-01T19:43:02.022 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.022 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f55c1ea:::benchmark_data_smithi188_119427_object126728:head# 2024-04-01T19:43:02.022 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.023 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f57116f:::benchmark_data_smithi188_119427_object154379:head# 2024-04-01T19:43:02.023 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.023 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f5715f9:::benchmark_data_smithi188_119427_object110267:head# 2024-04-01T19:43:02.023 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.023 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f571cf6:::benchmark_data_smithi188_119427_object77229:head# 2024-04-01T19:43:02.023 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.024 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f57f627:::benchmark_data_smithi188_119427_object117272:head# 2024-04-01T19:43:02.024 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.024 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f580b3b:::benchmark_data_smithi188_119427_object123254:head# 2024-04-01T19:43:02.024 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.024 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f593cb9:::benchmark_data_smithi188_119427_object135280:head# 2024-04-01T19:43:02.024 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f5c4026:::benchmark_data_smithi188_119427_object87806:head# 2024-04-01T19:43:02.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f5cd924:::benchmark_data_smithi188_119427_object75104:head# 2024-04-01T19:43:02.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.025 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f5db3dc:::benchmark_data_smithi188_119427_object122728:head# 2024-04-01T19:43:02.025 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f5fcc94:::benchmark_data_smithi188_119427_object91955:head# 2024-04-01T19:43:02.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f650893:::benchmark_data_smithi188_119427_object132013:head# 2024-04-01T19:43:02.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.026 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f655b2c:::benchmark_data_smithi188_119427_object122040:head# 2024-04-01T19:43:02.026 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f65d1ac:::benchmark_data_smithi188_119427_object102000:head# 2024-04-01T19:43:02.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f665151:::benchmark_data_smithi188_119427_object87262:head# 2024-04-01T19:43:02.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f684130:::benchmark_data_smithi188_119427_object72616:head# 2024-04-01T19:43:02.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.027 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f6952ca:::benchmark_data_smithi188_119427_object130348:head# 2024-04-01T19:43:02.027 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.028 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f69a188:::benchmark_data_smithi188_119427_object75271:head# 2024-04-01T19:43:02.028 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.028 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f69f9cb:::benchmark_data_smithi188_119427_object154288:head# 2024-04-01T19:43:02.028 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.029 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f6ac6fe:::benchmark_data_smithi188_119427_object117680:head# 2024-04-01T19:43:02.029 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.029 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f6be6da:::benchmark_data_smithi188_119427_object122504:head# 2024-04-01T19:43:02.029 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.029 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f6d07fe:::benchmark_data_smithi188_119427_object88878:head# 2024-04-01T19:43:02.029 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.031 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f6d156b:::benchmark_data_smithi188_119427_object135794:head# 2024-04-01T19:43:02.031 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.031 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f6d6a94:::benchmark_data_smithi188_119427_object107078:head# 2024-04-01T19:43:02.031 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.031 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f6d8c97:::benchmark_data_smithi188_119427_object101639:head# 2024-04-01T19:43:02.031 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.031 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f6e2d42:::benchmark_data_smithi188_119427_object112192:head# 2024-04-01T19:43:02.031 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.031 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f6e416d:::benchmark_data_smithi188_119427_object156662:head# 2024-04-01T19:43:02.031 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.032 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f6ecb61:::benchmark_data_smithi188_119427_object138413:head# 2024-04-01T19:43:02.032 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.032 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f6f583f:::benchmark_data_smithi188_119427_object83410:head# 2024-04-01T19:43:02.032 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.032 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f70d3aa:::benchmark_data_smithi188_119427_object159641:head# 2024-04-01T19:43:02.032 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f70dff9:::benchmark_data_smithi188_119427_object82214:head# 2024-04-01T19:43:02.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f7136a5:::benchmark_data_smithi188_119427_object107143:head# 2024-04-01T19:43:02.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f71b8c1:::benchmark_data_smithi188_119427_object118402:head# 2024-04-01T19:43:02.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f742dea:::benchmark_data_smithi188_119427_object73619:head# 2024-04-01T19:43:02.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f75b901:::benchmark_data_smithi188_119427_object157202:head# 2024-04-01T19:43:02.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.034 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f75fd10:::benchmark_data_smithi188_119427_object102344:head# 2024-04-01T19:43:02.034 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.035 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f768bb7:::benchmark_data_smithi188_119427_object121794:head# 2024-04-01T19:43:02.035 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.035 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f77aa18:::benchmark_data_smithi188_119427_object143360:head# 2024-04-01T19:43:02.035 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.038 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f77e86f:::benchmark_data_smithi188_119427_object96536:head# 2024-04-01T19:43:02.038 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.038 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f78dda0:::benchmark_data_smithi188_119427_object76801:head# 2024-04-01T19:43:02.038 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.038 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f7948b1:::benchmark_data_smithi188_119427_object77754:head# 2024-04-01T19:43:02.038 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.038 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f79a3c9:::benchmark_data_smithi188_119427_object127292:head# 2024-04-01T19:43:02.038 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.038 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f7d3abb:::benchmark_data_smithi188_119427_object77165:head# 2024-04-01T19:43:02.038 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.039 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f7d49ed:::benchmark_data_smithi188_119427_object83458:head# 2024-04-01T19:43:02.039 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.039 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f7de27d:::benchmark_data_smithi188_119427_object138309:head# 2024-04-01T19:43:02.039 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.039 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f7f83db:::benchmark_data_smithi188_119427_object157384:head# 2024-04-01T19:43:02.039 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.039 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f812b74:::benchmark_data_smithi188_119427_object80352:head# 2024-04-01T19:43:02.039 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.039 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f82444c:::benchmark_data_smithi188_119427_object101835:head# 2024-04-01T19:43:02.039 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.039 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f83022b:::benchmark_data_smithi188_119427_object162616:head# 2024-04-01T19:43:02.039 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.039 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f8374cc:::benchmark_data_smithi188_119427_object116147:head# 2024-04-01T19:43:02.039 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.040 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f83dcc0:::benchmark_data_smithi188_119427_object105474:head# 2024-04-01T19:43:02.040 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.043 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f84471e:::benchmark_data_smithi188_119427_object156061:head# 2024-04-01T19:43:02.043 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.047 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f858340:::benchmark_data_smithi188_119427_object143620:head# 2024-04-01T19:43:02.047 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.047 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f858cb1:::benchmark_data_smithi188_119427_object131512:head# 2024-04-01T19:43:02.047 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.047 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f86a3a1:::benchmark_data_smithi188_119427_object108490:head# 2024-04-01T19:43:02.047 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.047 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f870d77:::benchmark_data_smithi188_119427_object154119:head# 2024-04-01T19:43:02.047 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.048 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f873a6c:::benchmark_data_smithi188_119427_object125348:head# 2024-04-01T19:43:02.048 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.048 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f885298:::benchmark_data_smithi188_119427_object112818:head# 2024-04-01T19:43:02.048 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.048 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f887b95:::benchmark_data_smithi188_119427_object112437:head# 2024-04-01T19:43:02.048 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.048 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f88a4a8:::benchmark_data_smithi188_119427_object99559:head# 2024-04-01T19:43:02.048 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.048 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f89a5cb:::benchmark_data_smithi188_119427_object161820:head# 2024-04-01T19:43:02.048 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.050 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f8a31f4:::benchmark_data_smithi188_119427_object99066:head# 2024-04-01T19:43:02.050 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.050 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f8c220f:::benchmark_data_smithi188_119427_object132110:head# 2024-04-01T19:43:02.050 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.050 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f8c9132:::benchmark_data_smithi188_119427_object102537:head# 2024-04-01T19:43:02.050 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.050 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f8d9fb4:::benchmark_data_smithi188_119427_object142961:head# 2024-04-01T19:43:02.050 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.050 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f8e50f2:::benchmark_data_smithi188_119427_object111104:head# 2024-04-01T19:43:02.050 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.050 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f8e77c6:::benchmark_data_smithi188_119427_object141169:head# 2024-04-01T19:43:02.050 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.050 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f8e7890:::benchmark_data_smithi188_119427_object144839:head# 2024-04-01T19:43:02.051 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.051 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f8f4173:::benchmark_data_smithi188_119427_object73673:head# 2024-04-01T19:43:02.051 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f8fa9d0:::benchmark_data_smithi188_119427_object113655:head# 2024-04-01T19:43:02.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f8fab05:::benchmark_data_smithi188_119427_object137522:head# 2024-04-01T19:43:02.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f90f05f:::benchmark_data_smithi188_119427_object82853:head# 2024-04-01T19:43:02.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.052 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f94a456:::benchmark_data_smithi188_119427_object144892:head# 2024-04-01T19:43:02.052 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.053 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f94e00e:::benchmark_data_smithi188_119427_object113307:head# 2024-04-01T19:43:02.053 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.053 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f950fb2:::benchmark_data_smithi188_119427_object73750:head# 2024-04-01T19:43:02.053 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.053 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f9548dc:::benchmark_data_smithi188_119427_object120942:head# 2024-04-01T19:43:02.053 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.053 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f95d3a1:::benchmark_data_smithi188_119427_object158620:head# 2024-04-01T19:43:02.053 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.054 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f95d54e:::benchmark_data_smithi188_119427_object164322:head# 2024-04-01T19:43:02.054 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.054 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f974e9f:::benchmark_data_smithi188_119427_object125314:head# 2024-04-01T19:43:02.054 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.054 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f9890e5:::benchmark_data_smithi188_119427_object73365:head# 2024-04-01T19:43:02.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.055 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f98a261:::benchmark_data_smithi188_119427_object93523:head# 2024-04-01T19:43:02.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.055 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f9a5f70:::benchmark_data_smithi188_119427_object104401:head# 2024-04-01T19:43:02.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.055 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f9c5fe9:::benchmark_data_smithi188_119427_object160861:head# 2024-04-01T19:43:02.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.055 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f9e0253:::benchmark_data_smithi188_119427_object125086:head# 2024-04-01T19:43:02.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.055 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f9e67f5:::benchmark_data_smithi188_119427_object132021:head# 2024-04-01T19:43:02.055 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.056 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f9edc27:::benchmark_data_smithi188_119427_object99552:head# 2024-04-01T19:43:02.056 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.056 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f9f5bd5:::benchmark_data_smithi188_119427_object129080:head# 2024-04-01T19:43:02.057 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.057 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4f9fa1e6:::benchmark_data_smithi188_119427_object104814:head# 2024-04-01T19:43:02.057 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.057 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fa0d28b:::benchmark_data_smithi188_119427_object100559:head# 2024-04-01T19:43:02.057 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.057 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fa16a0e:::benchmark_data_smithi188_119427_object154990:head# 2024-04-01T19:43:02.057 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.057 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fa1b26d:::benchmark_data_smithi188_119427_object119183:head# 2024-04-01T19:43:02.057 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.057 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fa21be2:::benchmark_data_smithi188_119427_object100142:head# 2024-04-01T19:43:02.057 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.057 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fa40087:::benchmark_data_smithi188_119427_object87038:head# 2024-04-01T19:43:02.057 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.059 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fa445fd:::benchmark_data_smithi188_119427_object76158:head# 2024-04-01T19:43:02.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fa4b065:::benchmark_data_smithi188_119427_object145813:head# 2024-04-01T19:43:02.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fa4cbbc:::benchmark_data_smithi188_119427_object120776:head# 2024-04-01T19:43:02.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fa78c44:::benchmark_data_smithi188_119427_object91826:head# 2024-04-01T19:43:02.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fa84ac5:::benchmark_data_smithi188_119427_object111989:head# 2024-04-01T19:43:02.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fa93eb8:::benchmark_data_smithi188_119427_object88678:head# 2024-04-01T19:43:02.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fa9685d:::benchmark_data_smithi188_119427_object116575:head# 2024-04-01T19:43:02.060 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.060 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fa9983a:::benchmark_data_smithi188_119427_object137407:head# 2024-04-01T19:43:02.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fa9e362:::benchmark_data_smithi188_119427_object96341:head# 2024-04-01T19:43:02.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4faa4592:::benchmark_data_smithi188_119427_object82908:head# 2024-04-01T19:43:02.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.061 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fabbf45:::benchmark_data_smithi188_119427_object161371:head# 2024-04-01T19:43:02.061 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.062 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fac1d11:::benchmark_data_smithi188_119427_object129102:head# 2024-04-01T19:43:02.062 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.063 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fac5269:::benchmark_data_smithi188_119427_object76965:head# 2024-04-01T19:43:02.063 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.063 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fac5cf4:::benchmark_data_smithi188_119427_object116859:head# 2024-04-01T19:43:02.063 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.063 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4facce4e:::benchmark_data_smithi188_119427_object127105:head# 2024-04-01T19:43:02.063 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.063 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fadf3ed:::benchmark_data_smithi188_119427_object123567:head# 2024-04-01T19:43:02.063 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.063 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fae9885:::benchmark_data_smithi188_119427_object141359:head# 2024-04-01T19:43:02.063 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.063 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4faf9c75:::benchmark_data_smithi188_119427_object83079:head# 2024-04-01T19:43:02.063 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.063 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fb06040:::benchmark_data_smithi188_119427_object100865:head# 2024-04-01T19:43:02.063 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.064 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fb10d48:::benchmark_data_smithi188_119427_object87033:head# 2024-04-01T19:43:02.064 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.064 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fb19b74:::benchmark_data_smithi188_119427_object125308:head# 2024-04-01T19:43:02.065 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.065 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fb1af72:::benchmark_data_smithi188_119427_object151354:head# 2024-04-01T19:43:02.065 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.065 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fb4b65a:::benchmark_data_smithi188_119427_object77820:head# 2024-04-01T19:43:02.065 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.065 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fb5bf70:::benchmark_data_smithi188_119427_object89615:head# 2024-04-01T19:43:02.065 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fb600b3:::benchmark_data_smithi188_119427_object150137:head# 2024-04-01T19:43:02.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fb61644:::benchmark_data_smithi188_119427_object155525:head# 2024-04-01T19:43:02.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fb6a2df:::benchmark_data_smithi188_119427_object74687:head# 2024-04-01T19:43:02.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.066 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fb6cfce:::benchmark_data_smithi188_119427_object104807:head# 2024-04-01T19:43:02.066 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.067 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fb70345:::benchmark_data_smithi188_119427_object159873:head# 2024-04-01T19:43:02.067 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.067 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fb9356a:::benchmark_data_smithi188_119427_object79764:head# 2024-04-01T19:43:02.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fb9e697:::benchmark_data_smithi188_119427_object134240:head# 2024-04-01T19:43:02.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fba3d81:::benchmark_data_smithi188_119427_object130681:head# 2024-04-01T19:43:02.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fba8aab:::benchmark_data_smithi188_119427_object97226:head# 2024-04-01T19:43:02.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fbb12e3:::benchmark_data_smithi188_119427_object162081:head# 2024-04-01T19:43:02.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.068 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fbbc678:::benchmark_data_smithi188_119427_object141750:head# 2024-04-01T19:43:02.068 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.069 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fbc685a:::benchmark_data_smithi188_119427_object139706:head# 2024-04-01T19:43:02.069 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.070 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fbccb29:::benchmark_data_smithi188_119427_object152536:head# 2024-04-01T19:43:02.070 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.070 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fbe33ed:::benchmark_data_smithi188_119427_object96299:head# 2024-04-01T19:43:02.070 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.070 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fbe68bd:::benchmark_data_smithi188_119427_object102104:head# 2024-04-01T19:43:02.070 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.070 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fbe9854:::benchmark_data_smithi188_119427_object125722:head# 2024-04-01T19:43:02.070 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.070 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fbf2aaa:::benchmark_data_smithi188_119427_object73456:head# 2024-04-01T19:43:02.070 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.070 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fbf51fd:::benchmark_data_smithi188_119427_object138109:head# 2024-04-01T19:43:02.070 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.071 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fc10b00:::benchmark_data_smithi188_119427_object158579:head# 2024-04-01T19:43:02.071 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.071 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fc22f28:::benchmark_data_smithi188_119427_object148396:head# 2024-04-01T19:43:02.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fc2491c:::benchmark_data_smithi188_119427_object164120:head# 2024-04-01T19:43:02.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fc25f6f:::benchmark_data_smithi188_119427_object163876:head# 2024-04-01T19:43:02.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fc326ee:::benchmark_data_smithi188_119427_object164442:head# 2024-04-01T19:43:02.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fc395b7:::benchmark_data_smithi188_119427_object102131:head# 2024-04-01T19:43:02.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.072 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fc3ec3f:::benchmark_data_smithi188_119427_object162021:head# 2024-04-01T19:43:02.072 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.073 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fc5736b:::benchmark_data_smithi188_119427_object121550:head# 2024-04-01T19:43:02.073 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fc5af7b:::benchmark_data_smithi188_119427_object119127:head# 2024-04-01T19:43:02.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fc6ade7:::benchmark_data_smithi188_119427_object132081:head# 2024-04-01T19:43:02.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fc6f938:::benchmark_data_smithi188_119427_object96258:head# 2024-04-01T19:43:02.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fc71df0:::benchmark_data_smithi188_119427_object107448:head# 2024-04-01T19:43:02.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fc7339f:::benchmark_data_smithi188_119427_object158348:head# 2024-04-01T19:43:02.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.074 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fc8d2cf:::benchmark_data_smithi188_119427_object163133:head# 2024-04-01T19:43:02.074 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.075 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fc9006b:::benchmark_data_smithi188_119427_object106331:head# 2024-04-01T19:43:02.075 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.075 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fc9b97f:::benchmark_data_smithi188_119427_object78182:head# 2024-04-01T19:43:02.075 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fca7adc:::benchmark_data_smithi188_119427_object90856:head# 2024-04-01T19:43:02.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fcbcbce:::benchmark_data_smithi188_119427_object154016:head# 2024-04-01T19:43:02.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fcbcd7d:::benchmark_data_smithi188_119427_object80434:head# 2024-04-01T19:43:02.076 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.076 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fcc0416:::benchmark_data_smithi188_119427_object141753:head# 2024-04-01T19:43:02.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fcc9a2d:::benchmark_data_smithi188_119427_object143085:head# 2024-04-01T19:43:02.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fcd4222:::benchmark_data_smithi188_119427_object151205:head# 2024-04-01T19:43:02.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fcf20a9:::benchmark_data_smithi188_119427_object117864:head# 2024-04-01T19:43:02.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fcfc49c:::benchmark_data_smithi188_119427_object111286:head# 2024-04-01T19:43:02.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fd0d094:::benchmark_data_smithi188_119427_object102756:head# 2024-04-01T19:43:02.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.077 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fd0f766:::benchmark_data_smithi188_119427_object103982:head# 2024-04-01T19:43:02.077 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.080 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fd11221:::benchmark_data_smithi188_119427_object81413:head# 2024-04-01T19:43:02.080 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.080 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fd1b24e:::benchmark_data_smithi188_119427_object120254:head# 2024-04-01T19:43:02.080 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.080 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fd1e9de:::benchmark_data_smithi188_119427_object80420:head# 2024-04-01T19:43:02.080 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.080 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fd20ad9:::benchmark_data_smithi188_119427_object141319:head# 2024-04-01T19:43:02.080 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.080 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fd245d7:::benchmark_data_smithi188_119427_object101820:head# 2024-04-01T19:43:02.080 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fd591b7:::benchmark_data_smithi188_119427_object108619:head# 2024-04-01T19:43:02.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fd66fdc:::benchmark_data_smithi188_119427_object129841:head# 2024-04-01T19:43:02.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fd68cc0:::benchmark_data_smithi188_119427_object115936:head# 2024-04-01T19:43:02.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fd93bc3:::benchmark_data_smithi188_119427_object140001:head# 2024-04-01T19:43:02.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fd95b96:::benchmark_data_smithi188_119427_object149969:head# 2024-04-01T19:43:02.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fd95c4f:::benchmark_data_smithi188_119427_object114430:head# 2024-04-01T19:43:02.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.081 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fd994fa:::benchmark_data_smithi188_119427_object128578:head# 2024-04-01T19:43:02.081 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.082 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fda78c9:::benchmark_data_smithi188_119427_object151188:head# 2024-04-01T19:43:02.082 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.083 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fda9a02:::benchmark_data_smithi188_119427_object158276:head# 2024-04-01T19:43:02.083 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.083 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fdb1f9c:::benchmark_data_smithi188_119427_object151737:head# 2024-04-01T19:43:02.083 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.083 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fdbce2a:::benchmark_data_smithi188_119427_object72545:head# 2024-04-01T19:43:02.083 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.086 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fdc2457:::benchmark_data_smithi188_119427_object94254:head# 2024-04-01T19:43:02.086 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fdd5770:::benchmark_data_smithi188_119427_object121108:head# 2024-04-01T19:43:02.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.088 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fdda1b9:::benchmark_data_smithi188_119427_object91890:head# 2024-04-01T19:43:02.088 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.089 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fdda451:::benchmark_data_smithi188_119427_object72452:head# 2024-04-01T19:43:02.089 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.089 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fddfcb4:::benchmark_data_smithi188_119427_object99738:head# 2024-04-01T19:43:02.089 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.089 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fe076bf:::benchmark_data_smithi188_119427_object147109:head# 2024-04-01T19:43:02.089 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.090 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fe08336:::benchmark_data_smithi188_119427_object149690:head# 2024-04-01T19:43:02.090 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.091 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fe114d6:::benchmark_data_smithi188_119427_object123153:head# 2024-04-01T19:43:02.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fe24e03:::benchmark_data_smithi188_119427_object72495:head# 2024-04-01T19:43:02.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fe35dd3:::benchmark_data_smithi188_119427_object121955:head# 2024-04-01T19:43:02.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fe39c4b:::benchmark_data_smithi188_119427_object128828:head# 2024-04-01T19:43:02.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fe521cc:::benchmark_data_smithi188_119427_object116829:head# 2024-04-01T19:43:02.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.092 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fe5545b:::benchmark_data_smithi188_119427_object93491:head# 2024-04-01T19:43:02.092 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fe57b44:::benchmark_data_smithi188_119427_object162519:head# 2024-04-01T19:43:02.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fe588a9:::benchmark_data_smithi188_119427_object107995:head# 2024-04-01T19:43:02.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.093 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fe5c9c9:::benchmark_data_smithi188_119427_object109667:head# 2024-04-01T19:43:02.093 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fe6180f:::benchmark_data_smithi188_119427_object134540:head# 2024-04-01T19:43:02.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fe76f8c:::benchmark_data_smithi188_119427_object145519:head# 2024-04-01T19:43:02.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fe78566:::benchmark_data_smithi188_119427_object121911:head# 2024-04-01T19:43:02.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fe97af5:::benchmark_data_smithi188_119427_object104176:head# 2024-04-01T19:43:02.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4feaa4b4:::benchmark_data_smithi188_119427_object74132:head# 2024-04-01T19:43:02.095 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.095 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fead14f:::benchmark_data_smithi188_119427_object74054:head# 2024-04-01T19:43:02.096 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.096 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fead3b0:::benchmark_data_smithi188_119427_object126207:head# 2024-04-01T19:43:02.096 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.096 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4feaf8f6:::benchmark_data_smithi188_119427_object114972:head# 2024-04-01T19:43:02.096 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.096 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fed9176:::benchmark_data_smithi188_119427_object97386:head# 2024-04-01T19:43:02.096 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.096 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fedc86a:::benchmark_data_smithi188_119427_object114684:head# 2024-04-01T19:43:02.096 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.096 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fee727b:::benchmark_data_smithi188_119427_object77483:head# 2024-04-01T19:43:02.096 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.098 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fef0e96:::benchmark_data_smithi188_119427_object155420:head# 2024-04-01T19:43:02.098 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.098 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ff0a015:::benchmark_data_smithi188_119427_object146851:head# 2024-04-01T19:43:02.098 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.098 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ff1213c:::benchmark_data_smithi188_119427_object131986:head# 2024-04-01T19:43:02.098 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.098 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ff2a912:::benchmark_data_smithi188_119427_object160163:head# 2024-04-01T19:43:02.099 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.099 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ff2cf7d:::benchmark_data_smithi188_119427_object135882:head# 2024-04-01T19:43:02.099 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.099 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ff418e8:::benchmark_data_smithi188_119427_object146973:head# 2024-04-01T19:43:02.099 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.099 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ff4aca9:::benchmark_data_smithi188_119427_object132836:head# 2024-04-01T19:43:02.099 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.099 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ff5336e:::benchmark_data_smithi188_119427_object123541:head# 2024-04-01T19:43:02.099 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.099 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ff63c77:::benchmark_data_smithi188_119427_object162605:head# 2024-04-01T19:43:02.099 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.099 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ff6a400:::benchmark_data_smithi188_119427_object131481:head# 2024-04-01T19:43:02.099 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.100 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ff708fb:::benchmark_data_smithi188_119427_object95310:head# 2024-04-01T19:43:02.100 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.100 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ff795a0:::benchmark_data_smithi188_119427_object148568:head# 2024-04-01T19:43:02.100 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.101 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ff7e30f:::benchmark_data_smithi188_119427_object137471:head# 2024-04-01T19:43:02.101 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.101 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ff877c9:::benchmark_data_smithi188_119427_object92929:head# 2024-04-01T19:43:02.101 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.101 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ff9b659:::benchmark_data_smithi188_119427_object98475:head# 2024-04-01T19:43:02.101 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ffaadef:::benchmark_data_smithi188_119427_object83063:head# 2024-04-01T19:43:02.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ffad4ad:::benchmark_data_smithi188_119427_object107761:head# 2024-04-01T19:43:02.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ffb1884:::benchmark_data_smithi188_119427_object125967:head# 2024-04-01T19:43:02.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ffb42cd:::benchmark_data_smithi188_119427_object112285:head# 2024-04-01T19:43:02.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ffba10d:::benchmark_data_smithi188_119427_object86400:head# 2024-04-01T19:43:02.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.102 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ffbdeb7:::benchmark_data_smithi188_119427_object120862:head# 2024-04-01T19:43:02.102 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.103 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ffcccee:::benchmark_data_smithi188_119427_object118875:head# 2024-04-01T19:43:02.103 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.103 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ffd7fd2:::benchmark_data_smithi188_119427_object135323:head# 2024-04-01T19:43:02.103 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.103 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ffe4bf5:::benchmark_data_smithi188_119427_object91802:head# 2024-04-01T19:43:02.104 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.109 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4ffe5a47:::benchmark_data_smithi188_119427_object84005:head# 2024-04-01T19:43:02.109 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.110 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fff5328:::benchmark_data_smithi188_119427_object151102:head# 2024-04-01T19:43:02.110 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.110 INFO:teuthology.orchestra.run.smithi062.stdout:Write #5:4fff9bbe:::benchmark_data_smithi188_119427_object140661:head# 2024-04-01T19:43:02.110 INFO:teuthology.orchestra.run.smithi062.stdout:snapset 0=[]:{} 2024-04-01T19:43:02.121 INFO:teuthology.orchestra.run.smithi062.stdout:write_pg epoch 421 info 5.2( v 421'14879 (381'4800,421'14879] local-lis/les=364/365 n=5767 ec=364/364 lis/c=364/364 les/c/f=365/365/0 sis=364) 2024-04-01T19:43:02.199 INFO:teuthology.orchestra.run.smithi062.stdout:Import successful 2024-04-01T19:43:02.272 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:43:02.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:02 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:43:02.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:02 smithi022 ceph-mon[39439]: from='client.36224 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:43:02.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:02 smithi022 ceph-mon[39439]: osdmap e442: 12 total, 11 up, 10 in 2024-04-01T19:43:02.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:02 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:43:02.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:02 smithi062 ceph-mon[44211]: from='client.36224 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:43:02.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:02 smithi062 ceph-mon[44211]: osdmap e442: 12 total, 11 up, 10 in 2024-04-01T19:43:02.620 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:43:02.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:02 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:43:02.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:02 smithi188 ceph-mon[43939]: from='client.36224 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:43:02.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:02 smithi188 ceph-mon[43939]: osdmap e442: 12 total, 11 up, 10 in 2024-04-01T19:43:02.631 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:02.631 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:43:02.732 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:43:02.769 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:03.023 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:43:03.026 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:03.026 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:43:03.127 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:43:03.158 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:03.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:03 smithi022 ceph-mon[39439]: pgmap v1228: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 4.9 GiB data, 14 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 939 op/s 2024-04-01T19:43:03.376 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:43:03.412 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:43:03.453 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:03 smithi062 ceph-mon[44211]: pgmap v1228: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 4.9 GiB data, 14 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 939 op/s 2024-04-01T19:43:03.453 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:43:03.508 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:43:03.540 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:43:03.575 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:43:03.621 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:43:03.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:03 smithi188 ceph-mon[43939]: pgmap v1228: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 4.9 GiB data, 14 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 939 op/s 2024-04-01T19:43:03.658 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:43:03.700 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:43:03.741 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:43:03.776 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:43:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:43:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:43:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:43:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:43:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:43:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:43:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:43:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:43:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:43:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:43:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:43:03.778 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:43:03.812 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:43:03.818 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:03.819 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:43:03.920 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:43:03.976 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:04.047 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:43:04.056 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:04.056 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:43:04.092 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:43:04.157 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:43:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:04.341 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/exp.5.2.6 2024-04-01T19:43:04.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:04 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4017196569' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:43:04.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:04.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:04.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:04.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:04.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:04.439 INFO:tasks.thrashosds.thrasher:Waiting for clean again 2024-04-01T19:43:04.440 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-01T19:43:04.440 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:43:04.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:04 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4017196569' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:43:04.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:04.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:04.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:04.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:04.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:04.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:04 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4017196569' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:43:04.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:04.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:04.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:04.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:04.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:04.681 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:43:04.691 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:04.691 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:43:04.723 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:43:04.724 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:43:04.789 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:43:04.793 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:43:04.848 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:04.893 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:43:04.893 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:43:05.123 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:43:05.128 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:05.128 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:43:05.229 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:43:05.264 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:05.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:05.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:05.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:05.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:05.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:05.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:05.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:05 smithi022 ceph-mon[39439]: pgmap v1229: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 4.9 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 837 op/s 2024-04-01T19:43:05.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:05.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:05.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:05.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:05.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:05.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:05.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:05 smithi062 ceph-mon[44211]: pgmap v1229: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 4.9 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 837 op/s 2024-04-01T19:43:05.620 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:43:05.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:05.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:05.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:05.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:05.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:05.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:05.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:05 smithi188 ceph-mon[43939]: pgmap v1229: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 4.9 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 837 op/s 2024-04-01T19:43:05.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:05.628 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:43:05.664 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_historic_ops 2024-04-01T19:43:05.729 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:43:05.764 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:43:05.790 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:05.820 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:43:05.823 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:05.823 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:43:05.924 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:43:05.975 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:06.055 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:43:06.345 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:43:06.348 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:06.349 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:43:06.450 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:43:06.487 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:06.516 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:43:06.520 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:06.520 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:43:06.621 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:43:06.692 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:06.725 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:43:07.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:07 smithi022 ceph-mon[39439]: pgmap v1230: 17 pgs: 17 active+clean; 4.6 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 961 op/s 2024-04-01T19:43:07.501 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:07 smithi062 ceph-mon[44211]: pgmap v1230: 17 pgs: 17 active+clean; 4.6 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 961 op/s 2024-04-01T19:43:07.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:07 smithi188 ceph-mon[43939]: pgmap v1230: 17 pgs: 17 active+clean; 4.6 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 961 op/s 2024-04-01T19:43:08.015 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:43:08.022 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:08.023 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:43:08.124 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:43:08.185 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:43:08.185 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:43:08.185 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:08.193 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:43:08.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:08 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1348765460' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:43:08.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:08 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1348765460' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:43:08.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:08 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1348765460' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:43:08.690 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:43:08.700 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:08.701 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:43:08.801 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:43:08.839 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:08.877 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:43:08.881 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:08.882 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:43:08.889 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_ops_in_flight 2024-04-01T19:43:08.982 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:43:09.024 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:09.051 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:43:09.056 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:09.057 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:43:09.157 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:43:09.200 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:09 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:43:09.200 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:09 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1348765460' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:43:09.200 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:09 smithi188 ceph-mon[43939]: osdmap e443: 12 total, 11 up, 10 in 2024-04-01T19:43:09.200 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:09 smithi188 ceph-mon[43939]: pgmap v1232: 17 pgs: 17 active+clean; 4.5 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 989 op/s 2024-04-01T19:43:09.205 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:09.229 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:43:09.232 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:09.232 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:43:09.234 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:43:09.334 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:43:09.365 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:09.387 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:43:09.391 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:09.391 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:43:09.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:09 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:43:09.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:09 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1348765460' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:43:09.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:09 smithi022 ceph-mon[39439]: osdmap e443: 12 total, 11 up, 10 in 2024-04-01T19:43:09.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:09 smithi022 ceph-mon[39439]: pgmap v1232: 17 pgs: 17 active+clean; 4.5 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 989 op/s 2024-04-01T19:43:09.492 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:43:09.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:09 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:43:09.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:09 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1348765460' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:43:09.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:09 smithi062 ceph-mon[44211]: osdmap e443: 12 total, 11 up, 10 in 2024-04-01T19:43:09.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:09 smithi062 ceph-mon[44211]: pgmap v1232: 17 pgs: 17 active+clean; 4.5 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 989 op/s 2024-04-01T19:43:09.538 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:09.571 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:43:09.575 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:09.575 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:43:09.622 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:43:09.622 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:43:09.675 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:43:09.710 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:09.826 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:43:10.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:10 smithi062 ceph-mon[44211]: from='client.26149 v1:172.21.15.22:0/1874914942' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:43:10.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:10 smithi062 ceph-mon[44211]: 5.b scrub starts 2024-04-01T19:43:10.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:10 smithi022 ceph-mon[39439]: from='client.26149 v1:172.21.15.22:0/1874914942' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:43:10.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:10 smithi022 ceph-mon[39439]: 5.b scrub starts 2024-04-01T19:43:10.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:10 smithi188 ceph-mon[43939]: from='client.26149 v1:172.21.15.22:0/1874914942' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:43:10.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:10 smithi188 ceph-mon[43939]: 5.b scrub starts 2024-04-01T19:43:10.669 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:43:10.675 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:10.675 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:43:10.741 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":1232,"stamp":"2024-04-01T19:43:09.054575+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4855366200,"num_objects":74081,"num_object_clones":0,"num_object_copies":148162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74081,"num_whiteouts":0,"num_read":127,"num_read_kb":110,"num_write":255496,"num_write_kb":10543483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17395,"num_bytes_recovered":1141590144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160917,"ondisk_log_size":160917,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":10,"kb":937451520,"kb_used":13450320,"kb_used_data":9585536,"kb_used_omap":15,"kb_used_meta":3864304,"kb_avail":924001200,"statfs":{"total":959950356480,"available":946177228800,"internally_reserved":0,"allocated":9815588864,"data_stored":9812259796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15954,"internal_metadata":3957047726},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,6,4,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-519307264,"num_objects":-7924,"num_object_clones":0,"num_object_copies":-15848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7924,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7924,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.005480"},"pg_stats":[{"pgid":"5.f","version":"442'15916","reported_seq":16245,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-04-01T19:43:05.695155+0000","last_change":"2024-04-01T19:41:55.360222+0000","last_active":"2024-04-01T19:43:05.695155+0000","last_peered":"2024-04-01T19:43:05.695155+0000","last_clean":"2024-04-01T19:43:05.695155+0000","last_became_active":"2024-04-01T19:39:25.119689+0000","last_became_peered":"2024-04-01T19:39:25.119689+0000","last_unstale":"2024-04-01T19:43:05.695155+0000","last_undegraded":"2024-04-01T19:43:05.695155+0000","last_fullsized":"2024-04-01T19:43:05.695155+0000","mapping_epoch":364,"log_start":"385'5900","ondisk_log_start":"385'5900","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"419'14042","last_scrub_stamp":"2024-04-01T19:41:55.360059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:55.360059+0000","objects_scrubbed":6622,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:43:17.933747+0000","scrub_duration":1471,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":307888128,"num_objects":4698,"num_object_clones":0,"num_object_copies":9396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4698,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15916,"num_write_kb":659648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"442'18103","reported_seq":18468,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-04-01T19:43:05.163955+0000","last_change":"2024-04-01T19:43:01.236384+0000","last_active":"2024-04-01T19:43:05.163955+0000","last_peered":"2024-04-01T19:43:05.163955+0000","last_clean":"2024-04-01T19:43:05.163955+0000","last_became_active":"2024-04-01T19:39:25.125227+0000","last_became_peered":"2024-04-01T19:39:25.125227+0000","last_unstale":"2024-04-01T19:43:05.163955+0000","last_undegraded":"2024-04-01T19:43:05.163955+0000","last_fullsized":"2024-04-01T19:43:05.163955+0000","mapping_epoch":364,"log_start":"393'8101","ondisk_log_start":"393'8101","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"407'11199","last_scrub_stamp":"2024-04-01T19:41:17.580272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:17.580272+0000","objects_scrubbed":2286,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:43:06.208705+0000","scrub_duration":1907,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":308740096,"num_objects":4711,"num_object_clones":0,"num_object_copies":9422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4711,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15817,"num_write_kb":656896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.d","version":"442'16028","reported_seq":16361,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-04-01T19:43:06.096106+0000","last_change":"2024-04-01T19:42:48.239487+0000","last_active":"2024-04-01T19:43:06.096106+0000","last_peered":"2024-04-01T19:43:06.096106+0000","last_clean":"2024-04-01T19:43:06.096106+0000","last_became_active":"2024-04-01T19:39:25.121522+0000","last_became_peered":"2024-04-01T19:39:25.121522+0000","last_unstale":"2024-04-01T19:43:06.096106+0000","last_undegraded":"2024-04-01T19:43:06.096106+0000","last_fullsized":"2024-04-01T19:43:06.096106+0000","mapping_epoch":364,"log_start":"385'6000","ondisk_log_start":"385'6000","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"438'15000","last_scrub_stamp":"2024-04-01T19:42:48.239379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:42:48.239379+0000","objects_scrubbed":5609,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:44:17.368302+0000","scrub_duration":871,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299302936,"num_objects":4568,"num_object_clones":0,"num_object_copies":9136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":16028,"num_write_kb":659009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.c","version":"442'15597","reported_seq":15926,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-04-01T19:43:04.803496+0000","last_change":"2024-04-01T19:41:59.931762+0000","last_active":"2024-04-01T19:43:04.803496+0000","last_peered":"2024-04-01T19:43:04.803496+0000","last_clean":"2024-04-01T19:43:04.803496+0000","last_became_active":"2024-04-01T19:39:25.119799+0000","last_became_peered":"2024-04-01T19:39:25.119799+0000","last_unstale":"2024-04-01T19:43:04.803496+0000","last_undegraded":"2024-04-01T19:43:04.803496+0000","last_fullsized":"2024-04-01T19:43:04.803496+0000","mapping_epoch":364,"log_start":"384'5500","ondisk_log_start":"384'5500","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"420'14032","last_scrub_stamp":"2024-04-01T19:41:59.931582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:59.931582+0000","objects_scrubbed":6373,"log_size":10097,"log_dups_size":0,"ondisk_log_size":10097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:43:23.392172+0000","scrub_duration":1585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310575104,"num_objects":4739,"num_object_clones":0,"num_object_copies":9478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4739,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15597,"num_write_kb":650752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"442'15885","reported_seq":16209,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-04-01T19:43:05.174709+0000","last_change":"2024-04-01T19:41:59.159126+0000","last_active":"2024-04-01T19:43:05.174709+0000","last_peered":"2024-04-01T19:43:05.174709+0000","last_clean":"2024-04-01T19:43:05.174709+0000","last_became_active":"2024-04-01T19:39:25.125524+0000","last_became_peered":"2024-04-01T19:39:25.125524+0000","last_unstale":"2024-04-01T19:43:05.174709+0000","last_undegraded":"2024-04-01T19:43:05.174709+0000","last_fullsized":"2024-04-01T19:43:05.174709+0000","mapping_epoch":364,"log_start":"385'5800","ondisk_log_start":"385'5800","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"420'14238","last_scrub_stamp":"2024-04-01T19:41:59.158998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:59.158998+0000","objects_scrubbed":6315,"log_size":10085,"log_dups_size":0,"ondisk_log_size":10085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:43:09.494396+0000","scrub_duration":1429,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":303497216,"num_objects":4631,"num_object_clones":0,"num_object_copies":9262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4631,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15885,"num_write_kb":656512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.a","version":"442'16262","reported_seq":16586,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-04-01T19:43:06.781952+0000","last_change":"2024-04-01T19:42:03.463999+0000","last_active":"2024-04-01T19:43:06.781952+0000","last_peered":"2024-04-01T19:43:06.781952+0000","last_clean":"2024-04-01T19:43:06.781952+0000","last_became_active":"2024-04-01T19:39:25.124303+0000","last_became_peered":"2024-04-01T19:39:25.124303+0000","last_unstale":"2024-04-01T19:43:06.781952+0000","last_undegraded":"2024-04-01T19:43:06.781952+0000","last_fullsized":"2024-04-01T19:43:06.781952+0000","mapping_epoch":364,"log_start":"386'6200","ondisk_log_start":"386'6200","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"420'14765","last_scrub_stamp":"2024-04-01T19:42:03.463738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:42:03.463738+0000","objects_scrubbed":6116,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:43:11.379192+0000","scrub_duration":1314,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300679168,"num_objects":4588,"num_object_clones":0,"num_object_copies":9176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4588,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16262,"num_write_kb":667200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"443'16070","reported_seq":28184,"reported_epoch":443,"state":"active+clean","last_fresh":"2024-04-01T19:43:08.320446+0000","last_change":"2024-04-01T19:42:49.091239+0000","last_active":"2024-04-01T19:43:08.320446+0000","last_peered":"2024-04-01T19:43:08.320446+0000","last_clean":"2024-04-01T19:43:08.320446+0000","last_became_active":"2024-04-01T19:42:46.182201+0000","last_became_peered":"2024-04-01T19:42:46.182201+0000","last_unstale":"2024-04-01T19:43:08.320446+0000","last_undegraded":"2024-04-01T19:43:08.320446+0000","last_fullsized":"2024-04-01T19:43:08.320446+0000","mapping_epoch":437,"log_start":"386'6000","ondisk_log_start":"386'6000","created":364,"last_epoch_clean":438,"parent":"0.0","parent_split_bits":0,"last_scrub":"438'14954","last_scrub_stamp":"2024-04-01T19:42:49.091105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:42:49.091105+0000","objects_scrubbed":5753,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:43:57.573461+0000","scrub_duration":862,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302514176,"num_objects":4616,"num_object_clones":0,"num_object_copies":9232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4616,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16070,"num_write_kb":661952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5883,"num_bytes_recovered":385548288,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"442'16234","reported_seq":16563,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-04-01T19:43:06.103124+0000","last_change":"2024-04-01T19:41:57.739943+0000","last_active":"2024-04-01T19:43:06.103124+0000","last_peered":"2024-04-01T19:43:06.103124+0000","last_clean":"2024-04-01T19:43:06.103124+0000","last_became_active":"2024-04-01T19:39:25.125727+0000","last_became_peered":"2024-04-01T19:39:25.125727+0000","last_unstale":"2024-04-01T19:43:06.103124+0000","last_undegraded":"2024-04-01T19:43:06.103124+0000","last_fullsized":"2024-04-01T19:43:06.103124+0000","mapping_epoch":364,"log_start":"386'6200","ondisk_log_start":"386'6200","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"419'14442","last_scrub_stamp":"2024-04-01T19:41:57.739779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:57.739779+0000","objects_scrubbed":6517,"log_size":10034,"log_dups_size":0,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1419,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306577408,"num_objects":4678,"num_object_clones":0,"num_object_copies":9356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4678,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16234,"num_write_kb":669184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.7","version":"442'15762","reported_seq":16095,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-04-01T19:43:05.700562+0000","last_change":"2024-04-01T19:42:46.912840+0000","last_active":"2024-04-01T19:43:05.700562+0000","last_peered":"2024-04-01T19:43:05.700562+0000","last_clean":"2024-04-01T19:43:05.700562+0000","last_became_active":"2024-04-01T19:39:25.119054+0000","last_became_peered":"2024-04-01T19:39:25.119054+0000","last_unstale":"2024-04-01T19:43:05.700562+0000","last_undegraded":"2024-04-01T19:43:05.700562+0000","last_fullsized":"2024-04-01T19:43:05.700562+0000","mapping_epoch":364,"log_start":"385'5700","ondisk_log_start":"385'5700","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"438'14769","last_scrub_stamp":"2024-04-01T19:42:46.912664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:42:46.912664+0000","objects_scrubbed":5702,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:43:59.803284+0000","scrub_duration":1025,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306446336,"num_objects":4676,"num_object_clones":0,"num_object_copies":9352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4676,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15762,"num_write_kb":654016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"442'18159","reported_seq":18512,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-04-01T19:43:06.776681+0000","last_change":"2024-04-01T19:43:01.222386+0000","last_active":"2024-04-01T19:43:06.776681+0000","last_peered":"2024-04-01T19:43:06.776681+0000","last_clean":"2024-04-01T19:43:06.776681+0000","last_became_active":"2024-04-01T19:39:25.119237+0000","last_became_peered":"2024-04-01T19:39:25.119237+0000","last_unstale":"2024-04-01T19:43:06.776681+0000","last_undegraded":"2024-04-01T19:43:06.776681+0000","last_fullsized":"2024-04-01T19:43:06.776681+0000","mapping_epoch":364,"log_start":"393'8100","ondisk_log_start":"393'8100","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"406'11206","last_scrub_stamp":"2024-04-01T19:41:15.875080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:15.875080+0000","objects_scrubbed":1998,"log_size":10059,"log_dups_size":0,"ondisk_log_size":10059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"queued for scrub","scrub_duration":2214,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":303366144,"num_objects":4629,"num_object_clones":0,"num_object_copies":9258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4629,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16161,"num_write_kb":665280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"442'15701","reported_seq":16020,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-04-01T19:43:05.658713+0000","last_change":"2024-04-01T19:41:57.732768+0000","last_active":"2024-04-01T19:43:05.658713+0000","last_peered":"2024-04-01T19:43:05.658713+0000","last_clean":"2024-04-01T19:43:05.658713+0000","last_became_active":"2024-04-01T19:39:25.126777+0000","last_became_peered":"2024-04-01T19:39:25.126777+0000","last_unstale":"2024-04-01T19:43:05.658713+0000","last_undegraded":"2024-04-01T19:43:05.658713+0000","last_fullsized":"2024-04-01T19:43:05.658713+0000","mapping_epoch":364,"log_start":"385'5700","ondisk_log_start":"385'5700","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"419'13946","last_scrub_stamp":"2024-04-01T19:41:57.732538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:57.732538+0000","objects_scrubbed":6473,"log_size":10001,"log_dups_size":0,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:43:06.761411+0000","scrub_duration":1852,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":304676864,"num_objects":4649,"num_object_clones":0,"num_object_copies":9298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4649,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15701,"num_write_kb":651200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"442'15912","reported_seq":27728,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-04-01T19:43:05.662081+0000","last_change":"2024-04-01T19:42:48.307885+0000","last_active":"2024-04-01T19:43:05.662081+0000","last_peered":"2024-04-01T19:43:05.662081+0000","last_clean":"2024-04-01T19:43:05.662081+0000","last_became_active":"2024-04-01T19:42:44.431688+0000","last_became_peered":"2024-04-01T19:42:44.431688+0000","last_unstale":"2024-04-01T19:43:05.662081+0000","last_undegraded":"2024-04-01T19:43:05.662081+0000","last_fullsized":"2024-04-01T19:43:05.662081+0000","mapping_epoch":435,"log_start":"385'5900","ondisk_log_start":"385'5900","created":364,"last_epoch_clean":436,"parent":"0.0","parent_split_bits":0,"last_scrub":"438'14953","last_scrub_stamp":"2024-04-01T19:42:48.307685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:42:48.307685+0000","objects_scrubbed":5649,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:44:16.161025+0000","scrub_duration":1275,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306184192,"num_objects":4672,"num_object_clones":0,"num_object_copies":9344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4672,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15912,"num_write_kb":658688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5737,"num_bytes_recovered":375980032,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"442'15986","reported_seq":27855,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-04-01T19:43:05.667639+0000","last_change":"2024-04-01T19:42:43.457677+0000","last_active":"2024-04-01T19:43:05.667639+0000","last_peered":"2024-04-01T19:43:05.667639+0000","last_clean":"2024-04-01T19:43:05.667639+0000","last_became_active":"2024-04-01T19:42:43.429788+0000","last_became_peered":"2024-04-01T19:42:43.429788+0000","last_unstale":"2024-04-01T19:43:05.667639+0000","last_undegraded":"2024-04-01T19:43:05.667639+0000","last_fullsized":"2024-04-01T19:43:05.667639+0000","mapping_epoch":434,"log_start":"385'5900","ondisk_log_start":"385'5900","created":364,"last_epoch_clean":435,"parent":"0.0","parent_split_bits":0,"last_scrub":"419'14071","last_scrub_stamp":"2024-04-01T19:41:55.804349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:55.804349+0000","objects_scrubbed":6614,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:43:15.218837+0000","scrub_duration":1236,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":305397760,"num_objects":4660,"num_object_clones":0,"num_object_copies":9320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4660,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15986,"num_write_kb":660672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5767,"num_bytes_recovered":377946112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,10],"acting":[0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"442'16069","reported_seq":16397,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-04-01T19:43:06.598089+0000","last_change":"2024-04-01T19:42:46.200195+0000","last_active":"2024-04-01T19:43:06.598089+0000","last_peered":"2024-04-01T19:43:06.598089+0000","last_clean":"2024-04-01T19:43:06.598089+0000","last_became_active":"2024-04-01T19:39:25.185686+0000","last_became_peered":"2024-04-01T19:39:25.185686+0000","last_unstale":"2024-04-01T19:43:06.598089+0000","last_undegraded":"2024-04-01T19:43:06.598089+0000","last_fullsized":"2024-04-01T19:43:06.598089+0000","mapping_epoch":364,"log_start":"385'6000","ondisk_log_start":"385'6000","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"436'14967","last_scrub_stamp":"2024-04-01T19:42:46.200067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:42:46.200067+0000","objects_scrubbed":5717,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:44:14.342121+0000","scrub_duration":646,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302448640,"num_objects":4615,"num_object_clones":0,"num_object_copies":9230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4615,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16069,"num_write_kb":661888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"442'15947","reported_seq":16280,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-04-01T19:43:07.258974+0000","last_change":"2024-04-01T19:42:43.809427+0000","last_active":"2024-04-01T19:43:07.258974+0000","last_peered":"2024-04-01T19:43:07.258974+0000","last_clean":"2024-04-01T19:43:07.258974+0000","last_became_active":"2024-04-01T19:39:25.124672+0000","last_became_peered":"2024-04-01T19:39:25.124672+0000","last_unstale":"2024-04-01T19:43:07.258974+0000","last_undegraded":"2024-04-01T19:43:07.258974+0000","last_fullsized":"2024-04-01T19:43:07.258974+0000","mapping_epoch":364,"log_start":"385'5900","ondisk_log_start":"385'5900","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"435'14726","last_scrub_stamp":"2024-04-01T19:42:43.809275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:42:43.809275+0000","objects_scrubbed":5665,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:43:52.722195+0000","scrub_duration":498,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291176448,"num_objects":4443,"num_object_clones":0,"num_object_copies":8886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4443,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15947,"num_write_kb":652480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"5.4","version":"442'18448","reported_seq":18926,"reported_epoch":442,"state":"active+clean","last_fresh":"2024-04-01T19:43:07.256467+0000","last_change":"2024-04-01T19:42:45.822721+0000","last_active":"2024-04-01T19:43:07.256467+0000","last_peered":"2024-04-01T19:43:07.256467+0000","last_clean":"2024-04-01T19:43:07.256467+0000","last_became_active":"2024-04-01T19:39:25.125519+0000","last_became_peered":"2024-04-01T19:39:25.125519+0000","last_unstale":"2024-04-01T19:43:07.256467+0000","last_undegraded":"2024-04-01T19:43:07.256467+0000","last_fullsized":"2024-04-01T19:43:07.256467+0000","mapping_epoch":364,"log_start":"395'8400","ondisk_log_start":"395'8400","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"436'17273","last_scrub_stamp":"2024-04-01T19:42:45.822377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:42:45.822377+0000","objects_scrubbed":5681,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:44:11.516454+0000","scrub_duration":475,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295305216,"num_objects":4506,"num_object_clones":0,"num_object_copies":9012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4506,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15968,"num_write_kb":655168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":1134,"reported_epoch":443,"state":"active+clean","last_fresh":"2024-04-01T19:43:08.149299+0000","last_change":"2024-04-01T19:42:46.405008+0000","last_active":"2024-04-01T19:43:08.149299+0000","last_peered":"2024-04-01T19:43:08.149299+0000","last_clean":"2024-04-01T19:43:08.149299+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:43:08.149299+0000","last_undegraded":"2024-04-01T19:43:08.149299+0000","last_fullsized":"2024-04-01T19:43:08.149299+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:42:46.404889+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:42:46.404889+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:43:53.914351+0000","scrub_duration":118,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":4854775832,"num_objects":74079,"num_object_clones":0,"num_object_copies":148158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74079,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":255315,"num_write_kb":10540545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17387,"num_bytes_recovered":1139474432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10867712000,"data_stored":10867703856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160778,"ondisk_log_size":160778,"up":32,"acting":32,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220406,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1492248,"kb_used_data":897424,"kb_used_omap":1,"kb_used_meta":594814,"kb_avail":92252904,"statfs":{"total":95995035648,"available":94466973696,"internally_reserved":0,"allocated":918962176,"data_stored":918623154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":609089988},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":77,"seq":330712482042,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1529484,"kb_used_data":1173444,"kb_used_omap":1,"kb_used_meta":356030,"kb_avail":92215668,"statfs":{"total":95995035648,"available":94428844032,"internally_reserved":0,"allocated":1201606656,"data_stored":1201275258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":364575168},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678273,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":939980,"kb_used_data":601988,"kb_used_omap":1,"kb_used_meta":337982,"kb_avail":92805172,"statfs":{"total":95995035648,"available":95032496128,"internally_reserved":0,"allocated":616435712,"data_stored":616104334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":346094016},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":0,"seq":846108557470,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234252,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":660884,"kb_used_data":300684,"kb_used_omap":1,"kb_used_meta":360190,"kb_avail":93084268,"statfs":{"total":95995035648,"available":95318290432,"internally_reserved":0,"allocated":307900416,"data_stored":307565486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":368835018},"hb_peers":[0,1,2,3,4,5,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575144,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1743948,"kb_used_data":1217156,"kb_used_omap":1,"kb_used_meta":526782,"kb_avail":92001204,"statfs":{"total":95995035648,"available":94209232896,"internally_reserved":0,"allocated":1246367744,"data_stored":1246036366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":539425221},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738672,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2187724,"kb_used_data":1805124,"kb_used_omap":1,"kb_used_meta":382398,"kb_avail":91557428,"statfs":{"total":95995035648,"available":93754806272,"internally_reserved":0,"allocated":1848446976,"data_stored":1848115598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":391576005},"hb_peers":[1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,4,3,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346213,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1065228,"kb_used_data":889604,"kb_used_omap":1,"kb_used_meta":175550,"kb_avail":92679924,"statfs":{"total":95995035648,"available":94904242176,"internally_reserved":0,"allocated":910954496,"data_stored":910623118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179763653},"hb_peers":[0,1,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149983,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":673548,"kb_used_data":295172,"kb_used_omap":1,"kb_used_meta":378238,"kb_avail":93071604,"statfs":{"total":95995035648,"available":95305322496,"internally_reserved":0,"allocated":302256128,"data_stored":301924750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":387316167},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953753,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1293516,"kb_used_data":887492,"kb_used_omap":1,"kb_used_meta":406014,"kb_avail":92451636,"statfs":{"total":95995035648,"available":94670475264,"internally_reserved":0,"allocated":908791808,"data_stored":908460430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":415758789},"hb_peers":[0,1,2,3,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790229,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1863760,"kb_used_data":1517448,"kb_used_omap":1,"kb_used_meta":346302,"kb_avail":91881392,"statfs":{"total":95995035648,"available":94086545408,"internally_reserved":0,"allocated":1553866752,"data_stored":1553531302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":354613701},"hb_peers":[0,1,2,3,4,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1832321024,"data_stored":1832321024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1232797696,"data_stored":1232797696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":901447680,"data_stored":901447680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":297730048,"data_stored":297730048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":907935744,"data_stored":907935744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1530073088,"data_stored":1530069016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1151467520,"data_stored":1151467520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":302448640,"data_stored":302448640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":612171776,"data_stored":612171776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":1181745152,"data_stored":1181745152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":917573632,"data_stored":917569560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:43:10.743 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:43:10.776 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:43:10.878 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:10.914 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:43:10.926 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:10.926 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:43:11.027 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:43:11.060 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:11.358 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:43:11.358 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:43:11.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:11 smithi188 ceph-mon[43939]: 5.6 scrub starts 2024-04-01T19:43:11.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:11 smithi188 ceph-mon[43939]: 5.b scrub ok 2024-04-01T19:43:11.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:11 smithi188 ceph-mon[43939]: pgmap v1233: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.3 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:43:11.487 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:43:11.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:11 smithi062 ceph-mon[44211]: 5.6 scrub starts 2024-04-01T19:43:11.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:11 smithi062 ceph-mon[44211]: 5.b scrub ok 2024-04-01T19:43:11.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:11 smithi062 ceph-mon[44211]: pgmap v1233: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.3 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:43:11.530 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:11 smithi022 ceph-mon[39439]: 5.6 scrub starts 2024-04-01T19:43:11.530 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:11 smithi022 ceph-mon[39439]: 5.b scrub ok 2024-04-01T19:43:11.530 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:11 smithi022 ceph-mon[39439]: pgmap v1233: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.3 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:43:11.615 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:43:11.620 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:11.620 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:43:11.721 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:43:11.756 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:11.922 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:43:11.947 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:43:12.077 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_blocked_ops 2024-04-01T19:43:12.113 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:43:12.116 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:12.116 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:43:12.217 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:43:12.246 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:12.272 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:43:12.279 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:12.279 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:43:12.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:12 smithi188 ceph-mon[43939]: 5.6 scrub ok 2024-04-01T19:43:12.380 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:43:12.442 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:12 smithi022 ceph-mon[39439]: 5.6 scrub ok 2024-04-01T19:43:12.443 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:12.471 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:43:12.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:12 smithi062 ceph-mon[44211]: 5.6 scrub ok 2024-04-01T19:43:12.786 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:43:12.820 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:43:12.856 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:43:12.896 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:43:12.930 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:43:12.977 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:43:13.011 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:43:13.046 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:43:13.076 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:43:13.118 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:43:13.144 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:43:13.145 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:43:13.145 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:43:13.145 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:43:13.145 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:43:13.145 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:43:13.145 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:43:13.145 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:43:13.145 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:43:13.145 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:43:13.145 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:43:13.145 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:43:13.146 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:43:13.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:13 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2918084645' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:43:13.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:13 smithi188 ceph-mon[43939]: pgmap v1234: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.2 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:43:13.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:13 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2918084645' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:43:13.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:13 smithi062 ceph-mon[44211]: pgmap v1234: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.2 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:43:13.549 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:13 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2918084645' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:43:13.549 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:13 smithi022 ceph-mon[39439]: pgmap v1234: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.2 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:43:14.246 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:43:14.251 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:14.252 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:43:14.297 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:43:14.297 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:43:14.318 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.318 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.318 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.318 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.318 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.318 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.318 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.318 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.319 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.319 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.319 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.353 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:43:14.386 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:14.412 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:43:14.418 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:14.419 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:43:14.490 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.490 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.490 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.491 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.491 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.491 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.491 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.491 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.491 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.491 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.491 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:14.519 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:43:14.601 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:14.646 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:43:14.646 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:43:14.646 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-01T19:43:14.646 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-01T19:43:14.646 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:43:15.231 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:15 smithi022 ceph-mon[39439]: 5.5 scrub starts 2024-04-01T19:43:15.231 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:15 smithi022 ceph-mon[39439]: pgmap v1235: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.1 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:43:15.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:15 smithi188 ceph-mon[43939]: 5.5 scrub starts 2024-04-01T19:43:15.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:15 smithi188 ceph-mon[43939]: pgmap v1235: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.1 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:43:15.448 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_historic_ops 2024-04-01T19:43:15.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:15 smithi062 ceph-mon[44211]: 5.5 scrub starts 2024-04-01T19:43:15.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:15 smithi062 ceph-mon[44211]: pgmap v1235: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.1 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:43:15.788 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:43:16.298 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:43:16.325 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:16 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:43:16.325 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:16 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:43:16.325 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:16 smithi188 ceph-mon[43939]: osdmap e444: 12 total, 11 up, 10 in 2024-04-01T19:43:16.325 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:16 smithi188 ceph-mon[43939]: from='client.36245 v1:172.21.15.22:0/1877853823' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:43:16.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:16 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:43:16.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:16 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:43:16.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:16 smithi022 ceph-mon[39439]: osdmap e444: 12 total, 11 up, 10 in 2024-04-01T19:43:16.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:16 smithi022 ceph-mon[39439]: from='client.36245 v1:172.21.15.22:0/1877853823' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:43:16.393 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:43:16.402 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:16.403 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:43:16.504 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:43:16.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:16 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:43:16.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:16 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:43:16.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:16 smithi062 ceph-mon[44211]: osdmap e444: 12 total, 11 up, 10 in 2024-04-01T19:43:16.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:16 smithi062 ceph-mon[44211]: from='client.36245 v1:172.21.15.22:0/1877853823' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:43:16.520 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:43:16.520 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:43:16.535 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:16.560 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:43:16.562 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:16.563 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:43:16.664 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:43:16.701 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:17.162 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:43:17.165 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:17.166 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:43:17.237 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":1236,"stamp":"2024-04-01T19:43:15.232731+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4409197112,"num_objects":67273,"num_object_clones":0,"num_object_copies":134546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67273,"num_whiteouts":0,"num_read":127,"num_read_kb":110,"num_write":262304,"num_write_kb":10543483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17395,"num_bytes_recovered":1141590144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161025,"ondisk_log_size":161025,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":10,"kb":937451520,"kb_used":12597128,"kb_used_data":8710328,"kb_used_omap":15,"kb_used_meta":3886512,"kb_avail":924854392,"statfs":{"total":959950356480,"available":947050897408,"internally_reserved":0,"allocated":8919375872,"data_stored":8915986264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15954,"internal_metadata":3979788718},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-517996544,"num_objects":-7904,"num_object_clones":0,"num_object_copies":-15808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7904,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7904,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.178616"},"pg_stats":[{"pgid":"5.f","version":"443'16288","reported_seq":16619,"reported_epoch":443,"state":"active+clean","last_fresh":"2024-04-01T19:43:10.680501+0000","last_change":"2024-04-01T19:41:55.360222+0000","last_active":"2024-04-01T19:43:10.680501+0000","last_peered":"2024-04-01T19:43:10.680501+0000","last_clean":"2024-04-01T19:43:10.680501+0000","last_became_active":"2024-04-01T19:39:25.119689+0000","last_became_peered":"2024-04-01T19:39:25.119689+0000","last_unstale":"2024-04-01T19:43:10.680501+0000","last_undegraded":"2024-04-01T19:43:10.680501+0000","last_fullsized":"2024-04-01T19:43:10.680501+0000","mapping_epoch":364,"log_start":"386'6200","ondisk_log_start":"386'6200","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"419'14042","last_scrub_stamp":"2024-04-01T19:41:55.360059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:55.360059+0000","objects_scrubbed":6622,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:43:17.933747+0000","scrub_duration":1471,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":283508736,"num_objects":4326,"num_object_clones":0,"num_object_copies":8652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4326,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16288,"num_write_kb":659648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"443'18801","reported_seq":19168,"reported_epoch":443,"state":"active+clean","last_fresh":"2024-04-01T19:43:15.169875+0000","last_change":"2024-04-01T19:43:01.236384+0000","last_active":"2024-04-01T19:43:15.169875+0000","last_peered":"2024-04-01T19:43:15.169875+0000","last_clean":"2024-04-01T19:43:15.169875+0000","last_became_active":"2024-04-01T19:39:25.125227+0000","last_became_peered":"2024-04-01T19:39:25.125227+0000","last_unstale":"2024-04-01T19:43:15.169875+0000","last_undegraded":"2024-04-01T19:43:15.169875+0000","last_fullsized":"2024-04-01T19:43:15.169875+0000","mapping_epoch":364,"log_start":"399'8701","ondisk_log_start":"399'8701","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"407'11199","last_scrub_stamp":"2024-04-01T19:41:17.580272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:17.580272+0000","objects_scrubbed":2286,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1907,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262995968,"num_objects":4013,"num_object_clones":0,"num_object_copies":8026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4013,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16515,"num_write_kb":656896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.d","version":"443'16381","reported_seq":16715,"reported_epoch":443,"state":"active+clean","last_fresh":"2024-04-01T19:43:11.141950+0000","last_change":"2024-04-01T19:42:48.239487+0000","last_active":"2024-04-01T19:43:11.141950+0000","last_peered":"2024-04-01T19:43:11.141950+0000","last_clean":"2024-04-01T19:43:11.141950+0000","last_became_active":"2024-04-01T19:39:25.121522+0000","last_became_peered":"2024-04-01T19:39:25.121522+0000","last_unstale":"2024-04-01T19:43:11.141950+0000","last_undegraded":"2024-04-01T19:43:11.141950+0000","last_fullsized":"2024-04-01T19:43:11.141950+0000","mapping_epoch":364,"log_start":"386'6300","ondisk_log_start":"386'6300","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"438'15000","last_scrub_stamp":"2024-04-01T19:42:48.239379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:42:48.239379+0000","objects_scrubbed":5609,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:44:17.368302+0000","scrub_duration":871,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276168728,"num_objects":4215,"num_object_clones":0,"num_object_copies":8430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4215,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":16381,"num_write_kb":659009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.c","version":"443'16323","reported_seq":16654,"reported_epoch":443,"state":"active+clean","last_fresh":"2024-04-01T19:43:14.888465+0000","last_change":"2024-04-01T19:41:59.931762+0000","last_active":"2024-04-01T19:43:14.888465+0000","last_peered":"2024-04-01T19:43:14.888465+0000","last_clean":"2024-04-01T19:43:14.888465+0000","last_became_active":"2024-04-01T19:39:25.119799+0000","last_became_peered":"2024-04-01T19:39:25.119799+0000","last_unstale":"2024-04-01T19:43:14.888465+0000","last_undegraded":"2024-04-01T19:43:14.888465+0000","last_fullsized":"2024-04-01T19:43:14.888465+0000","mapping_epoch":364,"log_start":"387'6300","ondisk_log_start":"387'6300","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"420'14032","last_scrub_stamp":"2024-04-01T19:41:59.931582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:59.931582+0000","objects_scrubbed":6373,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:43:23.392172+0000","scrub_duration":1585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262995968,"num_objects":4013,"num_object_clones":0,"num_object_copies":8026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4013,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16323,"num_write_kb":650752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"443'16576","reported_seq":16954,"reported_epoch":443,"state":"active+clean","last_fresh":"2024-04-01T19:43:15.183064+0000","last_change":"2024-04-01T19:43:10.716596+0000","last_active":"2024-04-01T19:43:15.183064+0000","last_peered":"2024-04-01T19:43:15.183064+0000","last_clean":"2024-04-01T19:43:15.183064+0000","last_became_active":"2024-04-01T19:39:25.125524+0000","last_became_peered":"2024-04-01T19:39:25.125524+0000","last_unstale":"2024-04-01T19:43:15.183064+0000","last_undegraded":"2024-04-01T19:43:15.183064+0000","last_fullsized":"2024-04-01T19:43:15.183064+0000","mapping_epoch":364,"log_start":"387'6500","ondisk_log_start":"387'6500","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"443'16270","last_scrub_stamp":"2024-04-01T19:43:10.716485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:43:10.716485+0000","objects_scrubbed":4279,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:44:38.709328+0000","scrub_duration":931,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":258211840,"num_objects":3940,"num_object_clones":0,"num_object_copies":7880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3940,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16576,"num_write_kb":656512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.a","version":"443'16632","reported_seq":16956,"reported_epoch":443,"state":"active+clean","last_fresh":"2024-04-01T19:43:11.801418+0000","last_change":"2024-04-01T19:42:03.463999+0000","last_active":"2024-04-01T19:43:11.801418+0000","last_peered":"2024-04-01T19:43:11.801418+0000","last_clean":"2024-04-01T19:43:11.801418+0000","last_became_active":"2024-04-01T19:39:25.124303+0000","last_became_peered":"2024-04-01T19:39:25.124303+0000","last_unstale":"2024-04-01T19:43:11.801418+0000","last_undegraded":"2024-04-01T19:43:11.801418+0000","last_fullsized":"2024-04-01T19:43:11.801418+0000","mapping_epoch":364,"log_start":"386'6600","ondisk_log_start":"386'6600","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"420'14765","last_scrub_stamp":"2024-04-01T19:42:03.463738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:42:03.463738+0000","objects_scrubbed":6116,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1314,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276430848,"num_objects":4218,"num_object_clones":0,"num_object_copies":8436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4218,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16632,"num_write_kb":667200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"443'16435","reported_seq":28549,"reported_epoch":443,"state":"active+clean","last_fresh":"2024-04-01T19:43:13.353976+0000","last_change":"2024-04-01T19:42:49.091239+0000","last_active":"2024-04-01T19:43:13.353976+0000","last_peered":"2024-04-01T19:43:13.353976+0000","last_clean":"2024-04-01T19:43:13.353976+0000","last_became_active":"2024-04-01T19:42:46.182201+0000","last_became_peered":"2024-04-01T19:42:46.182201+0000","last_unstale":"2024-04-01T19:43:13.353976+0000","last_undegraded":"2024-04-01T19:43:13.353976+0000","last_fullsized":"2024-04-01T19:43:13.353976+0000","mapping_epoch":437,"log_start":"387'6400","ondisk_log_start":"387'6400","created":364,"last_epoch_clean":438,"parent":"0.0","parent_split_bits":0,"last_scrub":"438'14954","last_scrub_stamp":"2024-04-01T19:42:49.091105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:42:49.091105+0000","objects_scrubbed":5753,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:43:57.573461+0000","scrub_duration":862,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278593536,"num_objects":4251,"num_object_clones":0,"num_object_copies":8502,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4251,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16435,"num_write_kb":661952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5883,"num_bytes_recovered":385548288,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"443'16583","reported_seq":16915,"reported_epoch":443,"state":"active+clean","last_fresh":"2024-04-01T19:43:11.101729+0000","last_change":"2024-04-01T19:41:57.739943+0000","last_active":"2024-04-01T19:43:11.101729+0000","last_peered":"2024-04-01T19:43:11.101729+0000","last_clean":"2024-04-01T19:43:11.101729+0000","last_became_active":"2024-04-01T19:39:25.125727+0000","last_became_peered":"2024-04-01T19:39:25.125727+0000","last_unstale":"2024-04-01T19:43:11.101729+0000","last_undegraded":"2024-04-01T19:43:11.101729+0000","last_fullsized":"2024-04-01T19:43:11.101729+0000","mapping_epoch":364,"log_start":"386'6500","ondisk_log_start":"386'6500","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"419'14442","last_scrub_stamp":"2024-04-01T19:41:57.739779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:57.739779+0000","objects_scrubbed":6517,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:43:12.141718+0000","scrub_duration":1419,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":283705344,"num_objects":4329,"num_object_clones":0,"num_object_copies":8658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4329,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16583,"num_write_kb":669184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.7","version":"443'16115","reported_seq":16450,"reported_epoch":443,"state":"active+clean","last_fresh":"2024-04-01T19:43:10.668270+0000","last_change":"2024-04-01T19:42:46.912840+0000","last_active":"2024-04-01T19:43:10.668270+0000","last_peered":"2024-04-01T19:43:10.668270+0000","last_clean":"2024-04-01T19:43:10.668270+0000","last_became_active":"2024-04-01T19:39:25.119054+0000","last_became_peered":"2024-04-01T19:39:25.119054+0000","last_unstale":"2024-04-01T19:43:10.668270+0000","last_undegraded":"2024-04-01T19:43:10.668270+0000","last_fullsized":"2024-04-01T19:43:10.668270+0000","mapping_epoch":364,"log_start":"386'6100","ondisk_log_start":"386'6100","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"438'14769","last_scrub_stamp":"2024-04-01T19:42:46.912664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:42:46.912664+0000","objects_scrubbed":5702,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:43:59.803284+0000","scrub_duration":1025,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":283312128,"num_objects":4323,"num_object_clones":0,"num_object_copies":8646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4323,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16115,"num_write_kb":654016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"443'18520","reported_seq":18926,"reported_epoch":443,"state":"active+clean","last_fresh":"2024-04-01T19:43:11.771678+0000","last_change":"2024-04-01T19:43:10.311638+0000","last_active":"2024-04-01T19:43:11.771678+0000","last_peered":"2024-04-01T19:43:11.771678+0000","last_clean":"2024-04-01T19:43:11.771678+0000","last_became_active":"2024-04-01T19:39:25.119237+0000","last_became_peered":"2024-04-01T19:39:25.119237+0000","last_unstale":"2024-04-01T19:43:11.771678+0000","last_undegraded":"2024-04-01T19:43:11.771678+0000","last_fullsized":"2024-04-01T19:43:11.771678+0000","mapping_epoch":364,"log_start":"396'8500","ondisk_log_start":"396'8500","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"443'18431","last_scrub_stamp":"2024-04-01T19:43:10.311370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:43:10.311370+0000","objects_scrubbed":4394,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:44:35.584179+0000","scrub_duration":1024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279707648,"num_objects":4268,"num_object_clones":0,"num_object_copies":8536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4268,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16522,"num_write_kb":665280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"443'16069","reported_seq":16390,"reported_epoch":443,"state":"active+clean","last_fresh":"2024-04-01T19:43:10.651738+0000","last_change":"2024-04-01T19:41:57.732768+0000","last_active":"2024-04-01T19:43:10.651738+0000","last_peered":"2024-04-01T19:43:10.651738+0000","last_clean":"2024-04-01T19:43:10.651738+0000","last_became_active":"2024-04-01T19:39:25.126777+0000","last_became_peered":"2024-04-01T19:39:25.126777+0000","last_unstale":"2024-04-01T19:43:10.651738+0000","last_undegraded":"2024-04-01T19:43:10.651738+0000","last_fullsized":"2024-04-01T19:43:10.651738+0000","mapping_epoch":364,"log_start":"386'6000","ondisk_log_start":"386'6000","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"419'13946","last_scrub_stamp":"2024-04-01T19:41:57.732538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:57.732538+0000","objects_scrubbed":6473,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1852,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":280559616,"num_objects":4281,"num_object_clones":0,"num_object_copies":8562,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4281,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16069,"num_write_kb":651200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"443'16299","reported_seq":28117,"reported_epoch":443,"state":"active+clean","last_fresh":"2024-04-01T19:43:10.677079+0000","last_change":"2024-04-01T19:42:48.307885+0000","last_active":"2024-04-01T19:43:10.677079+0000","last_peered":"2024-04-01T19:43:10.677079+0000","last_clean":"2024-04-01T19:43:10.677079+0000","last_became_active":"2024-04-01T19:42:44.431688+0000","last_became_peered":"2024-04-01T19:42:44.431688+0000","last_unstale":"2024-04-01T19:43:10.677079+0000","last_undegraded":"2024-04-01T19:43:10.677079+0000","last_fullsized":"2024-04-01T19:43:10.677079+0000","mapping_epoch":435,"log_start":"386'6200","ondisk_log_start":"386'6200","created":364,"last_epoch_clean":436,"parent":"0.0","parent_split_bits":0,"last_scrub":"438'14953","last_scrub_stamp":"2024-04-01T19:42:48.307685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:42:48.307685+0000","objects_scrubbed":5649,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:44:16.161025+0000","scrub_duration":1275,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":280821760,"num_objects":4285,"num_object_clones":0,"num_object_copies":8570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4285,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16299,"num_write_kb":658688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5737,"num_bytes_recovered":375980032,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"443'16358","reported_seq":28229,"reported_epoch":443,"state":"active+clean","last_fresh":"2024-04-01T19:43:10.653001+0000","last_change":"2024-04-01T19:42:43.457677+0000","last_active":"2024-04-01T19:43:10.653001+0000","last_peered":"2024-04-01T19:43:10.653001+0000","last_clean":"2024-04-01T19:43:10.653001+0000","last_became_active":"2024-04-01T19:42:43.429788+0000","last_became_peered":"2024-04-01T19:42:43.429788+0000","last_unstale":"2024-04-01T19:43:10.653001+0000","last_undegraded":"2024-04-01T19:43:10.653001+0000","last_fullsized":"2024-04-01T19:43:10.653001+0000","mapping_epoch":434,"log_start":"386'6300","ondisk_log_start":"386'6300","created":364,"last_epoch_clean":435,"parent":"0.0","parent_split_bits":0,"last_scrub":"419'14071","last_scrub_stamp":"2024-04-01T19:41:55.804349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:41:55.804349+0000","objects_scrubbed":6614,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:43:15.218837+0000","scrub_duration":1236,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":4288,"num_object_clones":0,"num_object_copies":8576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4288,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16358,"num_write_kb":660672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5767,"num_bytes_recovered":377946112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,10],"acting":[0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"443'16422","reported_seq":16752,"reported_epoch":443,"state":"active+clean","last_fresh":"2024-04-01T19:43:11.587522+0000","last_change":"2024-04-01T19:42:46.200195+0000","last_active":"2024-04-01T19:43:11.587522+0000","last_peered":"2024-04-01T19:43:11.587522+0000","last_clean":"2024-04-01T19:43:11.587522+0000","last_became_active":"2024-04-01T19:39:25.185686+0000","last_became_peered":"2024-04-01T19:39:25.185686+0000","last_unstale":"2024-04-01T19:43:11.587522+0000","last_undegraded":"2024-04-01T19:43:11.587522+0000","last_fullsized":"2024-04-01T19:43:11.587522+0000","mapping_epoch":364,"log_start":"386'6400","ondisk_log_start":"386'6400","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"436'14967","last_scrub_stamp":"2024-04-01T19:42:46.200067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:42:46.200067+0000","objects_scrubbed":5717,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:44:14.342121+0000","scrub_duration":646,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279314432,"num_objects":4262,"num_object_clones":0,"num_object_copies":8524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4262,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16422,"num_write_kb":661888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"443'16309","reported_seq":16644,"reported_epoch":443,"state":"active+clean","last_fresh":"2024-04-01T19:43:12.288225+0000","last_change":"2024-04-01T19:42:43.809427+0000","last_active":"2024-04-01T19:43:12.288225+0000","last_peered":"2024-04-01T19:43:12.288225+0000","last_clean":"2024-04-01T19:43:12.288225+0000","last_became_active":"2024-04-01T19:39:25.124672+0000","last_became_peered":"2024-04-01T19:39:25.124672+0000","last_unstale":"2024-04-01T19:43:12.288225+0000","last_undegraded":"2024-04-01T19:43:12.288225+0000","last_fullsized":"2024-04-01T19:43:12.288225+0000","mapping_epoch":364,"log_start":"386'6300","ondisk_log_start":"386'6300","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"435'14726","last_scrub_stamp":"2024-04-01T19:42:43.809275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:42:43.809275+0000","objects_scrubbed":5665,"log_size":10009,"log_dups_size":0,"ondisk_log_size":10009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:43:52.722195+0000","scrub_duration":498,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":267452416,"num_objects":4081,"num_object_clones":0,"num_object_copies":8162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4081,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16309,"num_write_kb":652480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"5.4","version":"443'18776","reported_seq":19256,"reported_epoch":443,"state":"active+clean","last_fresh":"2024-04-01T19:43:12.236375+0000","last_change":"2024-04-01T19:42:45.822721+0000","last_active":"2024-04-01T19:43:12.236375+0000","last_peered":"2024-04-01T19:43:12.236375+0000","last_clean":"2024-04-01T19:43:12.236375+0000","last_became_active":"2024-04-01T19:39:25.125519+0000","last_became_peered":"2024-04-01T19:39:25.125519+0000","last_unstale":"2024-04-01T19:43:12.236375+0000","last_undegraded":"2024-04-01T19:43:12.236375+0000","last_fullsized":"2024-04-01T19:43:12.236375+0000","mapping_epoch":364,"log_start":"395'8700","ondisk_log_start":"395'8700","created":364,"last_epoch_clean":365,"parent":"0.0","parent_split_bits":0,"last_scrub":"436'17273","last_scrub_stamp":"2024-04-01T19:42:45.822377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:39:24.103420+0000","last_clean_scrub_stamp":"2024-04-01T19:42:45.822377+0000","objects_scrubbed":5681,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:44:11.516454+0000","scrub_duration":475,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273809408,"num_objects":4178,"num_object_clones":0,"num_object_copies":8356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4178,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16296,"num_write_kb":655168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":1134,"reported_epoch":443,"state":"active+clean","last_fresh":"2024-04-01T19:43:08.149299+0000","last_change":"2024-04-01T19:42:46.405008+0000","last_active":"2024-04-01T19:43:08.149299+0000","last_peered":"2024-04-01T19:43:08.149299+0000","last_clean":"2024-04-01T19:43:08.149299+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:43:08.149299+0000","last_undegraded":"2024-04-01T19:43:08.149299+0000","last_fullsized":"2024-04-01T19:43:08.149299+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:42:46.404889+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:42:46.404889+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:43:53.914351+0000","scrub_duration":118,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":4408606744,"num_objects":67271,"num_object_clones":0,"num_object_copies":134542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67271,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":262123,"num_write_kb":10540545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17387,"num_bytes_recovered":1139474432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9976422400,"data_stored":9976414256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160886,"ondisk_log_size":160886,"up":32,"acting":32,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220407,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1431460,"kb_used_data":832476,"kb_used_omap":1,"kb_used_meta":598974,"kb_avail":92313692,"statfs":{"total":95995035648,"available":94529220608,"internally_reserved":0,"allocated":852455424,"data_stored":852110348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":613349828},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":77,"seq":330712482043,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1445016,"kb_used_data":1080656,"kb_used_omap":1,"kb_used_meta":364350,"kb_avail":92300136,"statfs":{"total":95995035648,"available":94515339264,"internally_reserved":0,"allocated":1106591744,"data_stored":1106254292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":373094848},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678275,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":859864,"kb_used_data":513552,"kb_used_omap":1,"kb_used_meta":346302,"kb_avail":92885288,"statfs":{"total":95995035648,"available":95114534912,"internally_reserved":0,"allocated":525877248,"data_stored":525539816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":354613696},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":0,"seq":846108557472,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234253,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":638048,"kb_used_data":277848,"kb_used_omap":1,"kb_used_meta":360190,"kb_avail":93107104,"statfs":{"total":95995035648,"available":95341674496,"internally_reserved":0,"allocated":284516352,"data_stored":284175368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":368835018},"hb_peers":[0,1,2,3,4,5,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575146,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1553752,"kb_used_data":1035088,"kb_used_omap":1,"kb_used_meta":518462,"kb_avail":92191400,"statfs":{"total":95995035648,"available":94403993600,"internally_reserved":0,"allocated":1059930112,"data_stored":1059592680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":530905541},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738673,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2043288,"kb_used_data":1669200,"kb_used_omap":1,"kb_used_meta":374078,"kb_avail":91701864,"statfs":{"total":95995035648,"available":93902708736,"internally_reserved":0,"allocated":1709260800,"data_stored":1708923368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":383056325},"hb_peers":[1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346214,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1017048,"kb_used_data":819280,"kb_used_omap":1,"kb_used_meta":197758,"kb_avail":92728104,"statfs":{"total":95995035648,"available":94953578496,"internally_reserved":0,"allocated":838942720,"data_stored":838605288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":202504645},"hb_peers":[0,1,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149984,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":647000,"kb_used_data":268752,"kb_used_omap":1,"kb_used_meta":378238,"kb_avail":93098152,"statfs":{"total":95995035648,"available":95332507648,"internally_reserved":0,"allocated":275202048,"data_stored":274864616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":387316167},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953754,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1229016,"kb_used_data":818832,"kb_used_omap":1,"kb_used_meta":410174,"kb_avail":92516136,"statfs":{"total":95995035648,"available":94736523264,"internally_reserved":0,"allocated":838483968,"data_stored":838146536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":420018629},"hb_peers":[0,1,2,3,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790230,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1732636,"kb_used_data":1394644,"kb_used_omap":1,"kb_used_meta":337982,"kb_avail":92012516,"statfs":{"total":95995035648,"available":94220816384,"internally_reserved":0,"allocated":1428115456,"data_stored":1427773952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":346094021},"hb_peers":[0,1,2,3,4,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1690238976,"data_stored":1690238976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1042219008,"data_stored":1042219008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":831979520,"data_stored":831979520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":274464768,"data_stored":274464768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":837222400,"data_stored":837222400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1409617920,"data_stored":1409613848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1151467520,"data_stored":1151467520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":278528000,"data_stored":278528000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":521207808,"data_stored":521207808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":1089011712,"data_stored":1089011712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":850464768,"data_stored":850460696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:43:17.239 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-01T19:43:17.239 INFO:tasks.thrashosds.thrasher:Waiting for trim 2024-04-01T19:43:17.266 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:43:17.305 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:17.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:17 smithi188 ceph-mon[43939]: 5.5 scrub ok 2024-04-01T19:43:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:17 smithi188 ceph-mon[43939]: 5.a scrub starts 2024-04-01T19:43:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:17 smithi188 ceph-mon[43939]: 5.8 scrub starts 2024-04-01T19:43:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:17 smithi188 ceph-mon[43939]: pgmap v1237: 17 pgs: 17 active+clean; 3.9 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:43:17.497 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:17 smithi022 ceph-mon[39439]: 5.5 scrub ok 2024-04-01T19:43:17.497 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:17 smithi022 ceph-mon[39439]: 5.a scrub starts 2024-04-01T19:43:17.497 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:17 smithi022 ceph-mon[39439]: 5.8 scrub starts 2024-04-01T19:43:17.497 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:17 smithi022 ceph-mon[39439]: pgmap v1237: 17 pgs: 17 active+clean; 3.9 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:43:17.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:17 smithi062 ceph-mon[44211]: 5.5 scrub ok 2024-04-01T19:43:17.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:17 smithi062 ceph-mon[44211]: 5.a scrub starts 2024-04-01T19:43:17.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:17 smithi062 ceph-mon[44211]: 5.8 scrub starts 2024-04-01T19:43:17.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:17 smithi062 ceph-mon[44211]: pgmap v1237: 17 pgs: 17 active+clean; 3.9 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:43:17.528 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:43:17.535 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:17.536 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:43:17.636 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:43:17.671 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:17.805 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:43:17.810 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:17.810 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:43:17.823 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:43:17.847 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:43:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:43:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:43:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:43:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:181505 4.6 4:6a64cfa4:::benchmark_data_smithi188_104537_object9511:head [delete] snapc 0=[] ondisk+write+known_if_redirected e298)", 2024-04-01T19:43:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:35:43.031941+0000", 2024-04-01T19:43:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 454.814470062, 2024-04-01T19:43:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18799569099999999, 2024-04-01T19:43:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:17.847 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:43:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:43:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 181505 2024-04-01T19:43:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.031941+0000", 2024-04-01T19:43:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.031941+0000", 2024-04-01T19:43:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.031943+0000", 2024-04-01T19:43:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.216e-06 2024-04-01T19:43:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.031949+0000", 2024-04-01T19:43:17.849 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.254e-06 2024-04-01T19:43:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.031961+0000", 2024-04-01T19:43:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.239e-05 2024-04-01T19:43:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.031969+0000", 2024-04-01T19:43:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6090000000000003e-06 2024-04-01T19:43:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.850 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.032013+0000", 2024-04-01T19:43:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4455e-05 2024-04-01T19:43:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.032096+0000", 2024-04-01T19:43:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2977000000000002e-05 2024-04-01T19:43:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-01T19:43:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.032170+0000", 2024-04-01T19:43:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4066000000000005e-05 2024-04-01T19:43:17.851 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:17.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.035606+0000", 2024-04-01T19:43:17.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0034360340000000001 2024-04-01T19:43:17.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:17.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.219840+0000", 2024-04-01T19:43:17.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.184233911 2024-04-01T19:43:17.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.219892+0000", 2024-04-01T19:43:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1771999999999998e-05 2024-04-01T19:43:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.219937+0000", 2024-04-01T19:43:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5006999999999998e-05 2024-04-01T19:43:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.854 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:181508 4.6 4:65332a75:::benchmark_data_smithi188_104537_object9514:head [delete] snapc 0=[] ondisk+write+known_if_redirected e298)", 2024-04-01T19:43:17.854 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:35:43.037524+0000", 2024-04-01T19:43:17.854 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 454.80888684600001, 2024-04-01T19:43:17.854 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18254949300000001, 2024-04-01T19:43:17.854 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:17.854 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:17.854 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:17.854 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:17.854 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:43:17.854 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:43:17.854 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 181508 2024-04-01T19:43:17.854 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.855 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:17.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:17.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.037524+0000", 2024-04-01T19:43:17.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:17.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.037524+0000", 2024-04-01T19:43:17.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:17.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.037526+0000", 2024-04-01T19:43:17.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4479999999999999e-06 2024-04-01T19:43:17.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.856 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:17.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.037530+0000", 2024-04-01T19:43:17.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0380000000000001e-06 2024-04-01T19:43:17.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.856 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:17.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.037539+0000", 2024-04-01T19:43:17.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4099999999999997e-06 2024-04-01T19:43:17.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:17.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.037545+0000", 2024-04-01T19:43:17.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7699999999999998e-06 2024-04-01T19:43:17.857 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:17.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.037580+0000", 2024-04-01T19:43:17.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4861999999999999e-05 2024-04-01T19:43:17.857 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:17.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.037649+0000", 2024-04-01T19:43:17.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8843000000000005e-05 2024-04-01T19:43:17.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.858 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-01T19:43:17.858 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.037718+0000", 2024-04-01T19:43:17.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9461999999999993e-05 2024-04-01T19:43:17.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.858 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:17.858 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.040130+0000", 2024-04-01T19:43:17.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0024120930000000001 2024-04-01T19:43:17.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.858 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:17.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.219986+0000", 2024-04-01T19:43:17.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.179856039 2024-04-01T19:43:17.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:17.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.220036+0000", 2024-04-01T19:43:17.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9969999999999998e-05 2024-04-01T19:43:17.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:17.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:35:43.220074+0000", 2024-04-01T19:43:17.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7558000000000002e-05 2024-04-01T19:43:17.859 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.859 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:17.860 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.860 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:238019 5.e 5:750fdb7c:::benchmark_data_smithi188_119427_object73320:head [delete] snapc 0=[] ondisk+write+known_if_redirected e438)", 2024-04-01T19:43:17.860 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:46.928281+0000", 2024-04-01T19:43:17.860 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 30.918130309999999, 2024-04-01T19:43:17.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14729735199999999, 2024-04-01T19:43:17.860 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:17.860 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:17.860 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:17.860 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:17.860 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:17.860 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:17.860 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 238019 2024-04-01T19:43:17.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.861 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:17.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:17.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:46.928281+0000", 2024-04-01T19:43:17.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:17.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:46.928281+0000", 2024-04-01T19:43:17.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:17.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:46.928283+0000", 2024-04-01T19:43:17.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3350000000000001e-06 2024-04-01T19:43:17.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:17.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:46.928289+0000", 2024-04-01T19:43:17.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1140000000000002e-06 2024-04-01T19:43:17.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:17.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:46.928302+0000", 2024-04-01T19:43:17.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2072000000000001e-05 2024-04-01T19:43:17.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:17.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:46.928313+0000", 2024-04-01T19:43:17.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1289e-05 2024-04-01T19:43:17.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:17.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.026624+0000", 2024-04-01T19:43:17.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.098311401000000007 2024-04-01T19:43:17.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:17.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.026701+0000", 2024-04-01T19:43:17.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7068000000000001e-05 2024-04-01T19:43:17.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:43:17.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.026776+0000", 2024-04-01T19:43:17.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4688e-05 2024-04-01T19:43:17.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:17.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.045371+0000", 2024-04-01T19:43:17.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018594968 2024-04-01T19:43:17.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:17.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.075461+0000", 2024-04-01T19:43:17.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.030089714 2024-04-01T19:43:17.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:17.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.075521+0000", 2024-04-01T19:43:17.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9891e-05 2024-04-01T19:43:17.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:17.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.075578+0000", 2024-04-01T19:43:17.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7812000000000001e-05 2024-04-01T19:43:17.865 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.865 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:17.865 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.866 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:238163 5.e 5:7d64007c:::benchmark_data_smithi188_119427_object73464:head [delete] snapc 0=[] ondisk+write+known_if_redirected e438)", 2024-04-01T19:43:17.866 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:47.098524+0000", 2024-04-01T19:43:17.866 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 30.747887564999999, 2024-04-01T19:43:17.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.145365941, 2024-04-01T19:43:17.866 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:17.866 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:17.866 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:17.866 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:17.866 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:17.866 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:17.866 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 238163 2024-04-01T19:43:17.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.867 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:17.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:17.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.098524+0000", 2024-04-01T19:43:17.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:17.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.098524+0000", 2024-04-01T19:43:17.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:17.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.098526+0000", 2024-04-01T19:43:17.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.86e-06 2024-04-01T19:43:17.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:17.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.098531+0000", 2024-04-01T19:43:17.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8710000000000002e-06 2024-04-01T19:43:17.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:17.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.098544+0000", 2024-04-01T19:43:17.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2089000000000001e-05 2024-04-01T19:43:17.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:17.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.098552+0000", 2024-04-01T19:43:17.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3839999999999997e-06 2024-04-01T19:43:17.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:17.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.179915+0000", 2024-04-01T19:43:17.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.081363114 2024-04-01T19:43:17.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:17.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.180034+0000", 2024-04-01T19:43:17.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000118565 2024-04-01T19:43:17.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:43:17.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.180157+0000", 2024-04-01T19:43:17.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000123776 2024-04-01T19:43:17.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:17.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.185118+0000", 2024-04-01T19:43:17.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0049610610000000001 2024-04-01T19:43:17.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:17.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.243818+0000", 2024-04-01T19:43:17.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.058699220000000003 2024-04-01T19:43:17.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:17.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.243851+0000", 2024-04-01T19:43:17.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3481e-05 2024-04-01T19:43:17.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:17.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.243890+0000", 2024-04-01T19:43:17.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8519999999999997e-05 2024-04-01T19:43:17.871 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.871 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:17.871 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.872 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:238172 5.e 5:7b73ef97:::benchmark_data_smithi188_119427_object73473:head [delete] snapc 0=[] ondisk+write+known_if_redirected e438)", 2024-04-01T19:43:17.872 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:47.111601+0000", 2024-04-01T19:43:17.872 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 30.734810505999999, 2024-04-01T19:43:17.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.145813266, 2024-04-01T19:43:17.872 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:17.872 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:17.872 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:17.872 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:17.872 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:17.872 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:17.872 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 238172 2024-04-01T19:43:17.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.872 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:17.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:17.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.111601+0000", 2024-04-01T19:43:17.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:17.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.111601+0000", 2024-04-01T19:43:17.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:17.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.111603+0000", 2024-04-01T19:43:17.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.136e-06 2024-04-01T19:43:17.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:17.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.111608+0000", 2024-04-01T19:43:17.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8849999999999998e-06 2024-04-01T19:43:17.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:17.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.111618+0000", 2024-04-01T19:43:17.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0631999999999999e-05 2024-04-01T19:43:17.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:17.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.111625+0000", 2024-04-01T19:43:17.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5359999999999998e-06 2024-04-01T19:43:17.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:17.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.185777+0000", 2024-04-01T19:43:17.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.074151792999999994 2024-04-01T19:43:17.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:17.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.185862+0000", 2024-04-01T19:43:17.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4825000000000002e-05 2024-04-01T19:43:17.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:43:17.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.185938+0000", 2024-04-01T19:43:17.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6811999999999996e-05 2024-04-01T19:43:17.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:17.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.200215+0000", 2024-04-01T19:43:17.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014276987 2024-04-01T19:43:17.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:17.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.257294+0000", 2024-04-01T19:43:17.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057078126 2024-04-01T19:43:17.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:17.877 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.257353+0000", 2024-04-01T19:43:17.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9914000000000003e-05 2024-04-01T19:43:17.877 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.877 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.877 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:17.877 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.257414+0000", 2024-04-01T19:43:17.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0619999999999999e-05 2024-04-01T19:43:17.877 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.877 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:17.877 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.877 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.877 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.877 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:238173 5.e 5:7aa7ffa2:::benchmark_data_smithi188_119427_object73474:head [delete] snapc 0=[] ondisk+write+known_if_redirected e438)", 2024-04-01T19:43:17.878 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:47.112993+0000", 2024-04-01T19:43:17.878 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 30.733418498999999, 2024-04-01T19:43:17.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.144539944, 2024-04-01T19:43:17.878 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:17.878 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:17.878 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:17.878 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:17.878 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:17.878 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:17.878 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 238173 2024-04-01T19:43:17.878 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.878 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:17.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:17.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.112993+0000", 2024-04-01T19:43:17.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:17.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.112993+0000", 2024-04-01T19:43:17.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:17.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.112994+0000", 2024-04-01T19:43:17.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.31e-06 2024-04-01T19:43:17.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:17.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.112999+0000", 2024-04-01T19:43:17.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6990000000000002e-06 2024-04-01T19:43:17.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:17.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.113009+0000", 2024-04-01T19:43:17.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0083e-05 2024-04-01T19:43:17.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:17.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.113015+0000", 2024-04-01T19:43:17.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8300000000000001e-06 2024-04-01T19:43:17.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:17.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.189329+0000", 2024-04-01T19:43:17.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.076313952000000004 2024-04-01T19:43:17.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:17.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.189415+0000", 2024-04-01T19:43:17.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6170999999999999e-05 2024-04-01T19:43:17.882 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.882 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.882 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:43:17.882 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.189485+0000", 2024-04-01T19:43:17.882 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0061999999999994e-05 2024-04-01T19:43:17.882 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.882 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.882 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:17.882 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.200420+0000", 2024-04-01T19:43:17.882 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010935215 2024-04-01T19:43:17.882 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.882 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.882 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:17.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.257454+0000", 2024-04-01T19:43:17.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057033410999999999 2024-04-01T19:43:17.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:17.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.257487+0000", 2024-04-01T19:43:17.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3145000000000002e-05 2024-04-01T19:43:17.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:17.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.257533+0000", 2024-04-01T19:43:17.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6066000000000002e-05 2024-04-01T19:43:17.883 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.884 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:17.884 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.884 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:238519 5.e 5:766a0a9f:::benchmark_data_smithi188_119427_object73820:head [delete] snapc 0=[] ondisk+write+known_if_redirected e438)", 2024-04-01T19:43:17.884 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:47.666323+0000", 2024-04-01T19:43:17.884 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 30.180088694999998, 2024-04-01T19:43:17.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.15312003399999999, 2024-04-01T19:43:17.884 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:17.884 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:17.884 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:17.884 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:17.884 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:17.885 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:17.885 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 238519 2024-04-01T19:43:17.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.885 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:17.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.885 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:17.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.666323+0000", 2024-04-01T19:43:17.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.885 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:17.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.666323+0000", 2024-04-01T19:43:17.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:17.886 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.666324+0000", 2024-04-01T19:43:17.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.716e-06 2024-04-01T19:43:17.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:17.886 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.666330+0000", 2024-04-01T19:43:17.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8279999999999999e-06 2024-04-01T19:43:17.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:17.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.666349+0000", 2024-04-01T19:43:17.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8372999999999998e-05 2024-04-01T19:43:17.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:17.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.666357+0000", 2024-04-01T19:43:17.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1610000000000003e-06 2024-04-01T19:43:17.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:17.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.678782+0000", 2024-04-01T19:43:17.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012425805 2024-04-01T19:43:17.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:17.888 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.678855+0000", 2024-04-01T19:43:17.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2711000000000002e-05 2024-04-01T19:43:17.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:43:17.888 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.678926+0000", 2024-04-01T19:43:17.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0366999999999999e-05 2024-04-01T19:43:17.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:17.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.681905+0000", 2024-04-01T19:43:17.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0029797439999999999 2024-04-01T19:43:17.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:17.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.819312+0000", 2024-04-01T19:43:17.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.137407055 2024-04-01T19:43:17.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:17.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.819380+0000", 2024-04-01T19:43:17.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7310000000000004e-05 2024-04-01T19:43:17.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:17.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.819443+0000", 2024-04-01T19:43:17.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2964000000000002e-05 2024-04-01T19:43:17.890 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.890 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:17.890 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.890 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:238559 5.e 5:7e67e7e3:::benchmark_data_smithi188_119427_object73860:head [delete] snapc 0=[] ondisk+write+known_if_redirected e438)", 2024-04-01T19:43:17.890 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:47.736979+0000", 2024-04-01T19:43:17.891 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 30.10943207, 2024-04-01T19:43:17.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.141987692, 2024-04-01T19:43:17.891 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:17.891 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:17.891 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:17.891 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:17.891 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:17.891 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:17.891 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 238559 2024-04-01T19:43:17.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.891 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:17.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:17.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.736979+0000", 2024-04-01T19:43:17.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:17.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.736979+0000", 2024-04-01T19:43:17.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:17.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.736981+0000", 2024-04-01T19:43:17.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.99e-06 2024-04-01T19:43:17.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:17.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.736988+0000", 2024-04-01T19:43:17.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3720000000000001e-06 2024-04-01T19:43:17.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:17.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.737002+0000", 2024-04-01T19:43:17.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4704e-05 2024-04-01T19:43:17.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:17.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.737010+0000", 2024-04-01T19:43:17.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.824e-06 2024-04-01T19:43:17.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.894 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:17.894 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.821221+0000", 2024-04-01T19:43:17.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.084210454000000004 2024-04-01T19:43:17.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.894 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:17.894 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.821293+0000", 2024-04-01T19:43:17.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2070999999999995e-05 2024-04-01T19:43:17.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:43:17.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.821372+0000", 2024-04-01T19:43:17.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9518000000000007e-05 2024-04-01T19:43:17.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:17.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.829060+0000", 2024-04-01T19:43:17.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.007688266 2024-04-01T19:43:17.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:17.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.878853+0000", 2024-04-01T19:43:17.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.049792809 2024-04-01T19:43:17.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:17.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.878911+0000", 2024-04-01T19:43:17.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7299000000000001e-05 2024-04-01T19:43:17.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:17.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.878967+0000", 2024-04-01T19:43:17.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6385000000000003e-05 2024-04-01T19:43:17.896 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.896 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:17.897 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.897 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:246215 5.e 5:70d39fe3:::benchmark_data_smithi188_119427_object81516:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:43:17.897 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:57.222148+0000", 2024-04-01T19:43:17.897 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 20.624263289000002, 2024-04-01T19:43:17.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.150925477, 2024-04-01T19:43:17.897 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:17.897 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:17.897 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:17.897 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:17.897 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:17.897 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:17.898 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 246215 2024-04-01T19:43:17.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.898 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:17.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:17.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.222148+0000", 2024-04-01T19:43:17.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:17.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.222148+0000", 2024-04-01T19:43:17.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:17.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.222150+0000", 2024-04-01T19:43:17.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6819999999999999e-06 2024-04-01T19:43:17.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:17.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.222155+0000", 2024-04-01T19:43:17.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8470000000000003e-06 2024-04-01T19:43:17.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:17.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.222164+0000", 2024-04-01T19:43:17.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7229999999999999e-06 2024-04-01T19:43:17.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:17.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.222173+0000", 2024-04-01T19:43:17.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5990000000000002e-06 2024-04-01T19:43:17.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:17.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.262858+0000", 2024-04-01T19:43:17.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040685429000000002 2024-04-01T19:43:17.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:17.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.262972+0000", 2024-04-01T19:43:17.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011387099999999999 2024-04-01T19:43:17.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:43:17.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.263100+0000", 2024-04-01T19:43:17.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012828000000000001 2024-04-01T19:43:17.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:17.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.270033+0000", 2024-04-01T19:43:17.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00693298 2024-04-01T19:43:17.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:17.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.372953+0000", 2024-04-01T19:43:17.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.102919468 2024-04-01T19:43:17.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:17.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.373012+0000", 2024-04-01T19:43:17.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9497999999999999e-05 2024-04-01T19:43:17.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:17.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.373073+0000", 2024-04-01T19:43:17.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1099999999999994e-05 2024-04-01T19:43:17.903 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.903 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:17.903 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.903 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:246487 5.e 5:766cee34:::benchmark_data_smithi188_119427_object81788:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:43:17.903 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:57.583529+0000", 2024-04-01T19:43:17.903 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 20.262882528999999, 2024-04-01T19:43:17.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.143597589, 2024-04-01T19:43:17.903 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:17.904 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:17.904 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:17.904 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:17.904 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:17.904 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:17.904 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 246487 2024-04-01T19:43:17.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.904 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:17.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:17.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.583529+0000", 2024-04-01T19:43:17.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:17.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.583529+0000", 2024-04-01T19:43:17.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:17.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.583531+0000", 2024-04-01T19:43:17.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7969999999999999e-06 2024-04-01T19:43:17.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:17.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.583536+0000", 2024-04-01T19:43:17.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4029999999999998e-06 2024-04-01T19:43:17.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:17.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.583547+0000", 2024-04-01T19:43:17.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1131000000000001e-05 2024-04-01T19:43:17.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:17.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.583556+0000", 2024-04-01T19:43:17.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5960000000000004e-06 2024-04-01T19:43:17.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:17.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.669216+0000", 2024-04-01T19:43:17.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.085660293999999998 2024-04-01T19:43:17.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:17.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.669346+0000", 2024-04-01T19:43:17.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012951799999999999 2024-04-01T19:43:17.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:43:17.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.669467+0000", 2024-04-01T19:43:17.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012171 2024-04-01T19:43:17.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:17.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.673427+0000", 2024-04-01T19:43:17.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0039599769999999999 2024-04-01T19:43:17.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:17.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.727009+0000", 2024-04-01T19:43:17.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.053581393999999997 2024-04-01T19:43:17.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:17.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.727068+0000", 2024-04-01T19:43:17.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9231000000000003e-05 2024-04-01T19:43:17.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:17.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.727126+0000", 2024-04-01T19:43:17.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8538000000000001e-05 2024-04-01T19:43:17.909 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.909 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:17.909 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.909 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:246499 5.e 5:791b0087:::benchmark_data_smithi188_119427_object81800:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:43:17.910 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:57.593579+0000", 2024-04-01T19:43:17.910 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 20.252832675000001, 2024-04-01T19:43:17.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13367478099999999, 2024-04-01T19:43:17.910 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:17.910 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:17.910 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:17.910 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:17.910 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:17.910 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:17.910 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 246499 2024-04-01T19:43:17.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.910 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:17.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:17.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.593579+0000", 2024-04-01T19:43:17.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:17.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.593579+0000", 2024-04-01T19:43:17.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:17.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.593583+0000", 2024-04-01T19:43:17.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3989999999999997e-06 2024-04-01T19:43:17.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:17.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.593589+0000", 2024-04-01T19:43:17.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5899999999999998e-06 2024-04-01T19:43:17.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:17.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.593600+0000", 2024-04-01T19:43:17.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1314e-05 2024-04-01T19:43:17.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:17.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.593607+0000", 2024-04-01T19:43:17.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4869999999999996e-06 2024-04-01T19:43:17.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:17.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.674372+0000", 2024-04-01T19:43:17.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.080764781999999993 2024-04-01T19:43:17.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:17.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.674485+0000", 2024-04-01T19:43:17.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000112512 2024-04-01T19:43:17.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:43:17.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.674602+0000", 2024-04-01T19:43:17.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000116805 2024-04-01T19:43:17.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:17.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.682794+0000", 2024-04-01T19:43:17.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0081925360000000003 2024-04-01T19:43:17.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:17.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.727173+0000", 2024-04-01T19:43:17.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044378487000000001 2024-04-01T19:43:17.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:17.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.727205+0000", 2024-04-01T19:43:17.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2107999999999998e-05 2024-04-01T19:43:17.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:17.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.727253+0000", 2024-04-01T19:43:17.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8761000000000003e-05 2024-04-01T19:43:17.915 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.916 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:17.916 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.916 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:246632 5.e 5:7587dfb3:::benchmark_data_smithi188_119427_object81933:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:43:17.916 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:57.751990+0000", 2024-04-01T19:43:17.916 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 20.094421287999999, 2024-04-01T19:43:17.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16018565300000001, 2024-04-01T19:43:17.916 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:17.916 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:17.916 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:17.916 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:17.916 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:17.917 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:17.917 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 246632 2024-04-01T19:43:17.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.917 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:17.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:17.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.751990+0000", 2024-04-01T19:43:17.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:17.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.751990+0000", 2024-04-01T19:43:17.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:17.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.751992+0000", 2024-04-01T19:43:17.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.131e-06 2024-04-01T19:43:17.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:17.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.751997+0000", 2024-04-01T19:43:17.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8489999999999997e-06 2024-04-01T19:43:17.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:17.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.752007+0000", 2024-04-01T19:43:17.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8290000000000003e-06 2024-04-01T19:43:17.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:17.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.752014+0000", 2024-04-01T19:43:17.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9630000000000001e-06 2024-04-01T19:43:17.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:17.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.840140+0000", 2024-04-01T19:43:17.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.088125762999999996 2024-04-01T19:43:17.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:17.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.840225+0000", 2024-04-01T19:43:17.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4982999999999996e-05 2024-04-01T19:43:17.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:43:17.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.840304+0000", 2024-04-01T19:43:17.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9394000000000006e-05 2024-04-01T19:43:17.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:17.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.848758+0000", 2024-04-01T19:43:17.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0084542420000000007 2024-04-01T19:43:17.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:17.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.912087+0000", 2024-04-01T19:43:17.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.063328655999999997 2024-04-01T19:43:17.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:17.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.912119+0000", 2024-04-01T19:43:17.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1844999999999997e-05 2024-04-01T19:43:17.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:17.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.912176+0000", 2024-04-01T19:43:17.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6997999999999999e-05 2024-04-01T19:43:17.922 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.922 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:17.922 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.922 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:246802 5.e 5:7e9a5833:::benchmark_data_smithi188_119427_object82103:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:43:17.922 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:57.952003+0000", 2024-04-01T19:43:17.922 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 19.894408613, 2024-04-01T19:43:17.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.134434158, 2024-04-01T19:43:17.923 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:17.923 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:17.923 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:17.923 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:17.923 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:17.923 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:17.923 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 246802 2024-04-01T19:43:17.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.923 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:17.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:17.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.952003+0000", 2024-04-01T19:43:17.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:17.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.952003+0000", 2024-04-01T19:43:17.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:17.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.952005+0000", 2024-04-01T19:43:17.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.807e-06 2024-04-01T19:43:17.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:17.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.952010+0000", 2024-04-01T19:43:17.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.383e-06 2024-04-01T19:43:17.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:17.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.952022+0000", 2024-04-01T19:43:17.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1949e-05 2024-04-01T19:43:17.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:17.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.952030+0000", 2024-04-01T19:43:17.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1780000000000003e-06 2024-04-01T19:43:17.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:17.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.028287+0000", 2024-04-01T19:43:17.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.076257458 2024-04-01T19:43:17.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:17.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.028393+0000", 2024-04-01T19:43:17.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000105518 2024-04-01T19:43:17.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:43:17.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.028484+0000", 2024-04-01T19:43:17.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1087000000000004e-05 2024-04-01T19:43:17.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:17.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.037744+0000", 2024-04-01T19:43:17.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0092600930000000005 2024-04-01T19:43:17.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:17.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.086349+0000", 2024-04-01T19:43:17.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.048604895000000002 2024-04-01T19:43:17.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:17.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.086402+0000", 2024-04-01T19:43:17.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2729999999999998e-05 2024-04-01T19:43:17.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:17.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.086437+0000", 2024-04-01T19:43:17.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.506e-05 2024-04-01T19:43:17.928 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.928 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:17.928 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.928 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:246986 5.e 5:787e6bb3:::benchmark_data_smithi188_119427_object82287:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:43:17.928 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:58.138627+0000", 2024-04-01T19:43:17.928 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 19.707784276000002, 2024-04-01T19:43:17.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13521234300000001, 2024-04-01T19:43:17.928 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:17.929 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:17.929 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:17.929 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:17.929 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:17.929 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:17.929 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 246986 2024-04-01T19:43:17.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.929 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:17.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:17.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.138627+0000", 2024-04-01T19:43:17.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:17.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.138627+0000", 2024-04-01T19:43:17.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:17.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.138628+0000", 2024-04-01T19:43:17.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.375e-06 2024-04-01T19:43:17.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:17.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.138633+0000", 2024-04-01T19:43:17.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7620000000000003e-06 2024-04-01T19:43:17.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:17.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.138647+0000", 2024-04-01T19:43:17.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4042999999999999e-05 2024-04-01T19:43:17.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:17.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.138655+0000", 2024-04-01T19:43:17.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7009999999999996e-06 2024-04-01T19:43:17.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:17.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.208631+0000", 2024-04-01T19:43:17.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.069975869999999996 2024-04-01T19:43:17.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:17.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.208738+0000", 2024-04-01T19:43:17.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000107107 2024-04-01T19:43:17.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:43:17.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.208820+0000", 2024-04-01T19:43:17.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1889000000000002e-05 2024-04-01T19:43:17.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:17.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.224386+0000", 2024-04-01T19:43:17.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015566663999999999 2024-04-01T19:43:17.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:17.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.273768+0000", 2024-04-01T19:43:17.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.049381240999999999 2024-04-01T19:43:17.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:17.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.273801+0000", 2024-04-01T19:43:17.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3451000000000002e-05 2024-04-01T19:43:17.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:17.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.273839+0000", 2024-04-01T19:43:17.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.824e-05 2024-04-01T19:43:17.934 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.934 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:17.934 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.934 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:247253 5.e 5:786b3885:::benchmark_data_smithi188_119427_object82554:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:43:17.934 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:58.480980+0000", 2024-04-01T19:43:17.934 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 19.365431014999999, 2024-04-01T19:43:17.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16030156200000001, 2024-04-01T19:43:17.935 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:17.935 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:17.935 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:17.935 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:17.935 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:17.935 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:17.935 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 247253 2024-04-01T19:43:17.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.935 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:17.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:17.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.480980+0000", 2024-04-01T19:43:17.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:17.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.480980+0000", 2024-04-01T19:43:17.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:17.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.480982+0000", 2024-04-01T19:43:17.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.204e-06 2024-04-01T19:43:17.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:17.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.480988+0000", 2024-04-01T19:43:17.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.412e-06 2024-04-01T19:43:17.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:17.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.481000+0000", 2024-04-01T19:43:17.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1712000000000001e-05 2024-04-01T19:43:17.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:17.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.481006+0000", 2024-04-01T19:43:17.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1770000000000003e-06 2024-04-01T19:43:17.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:17.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.578568+0000", 2024-04-01T19:43:17.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.097561964000000001 2024-04-01T19:43:17.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:17.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.578646+0000", 2024-04-01T19:43:17.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8306999999999994e-05 2024-04-01T19:43:17.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:43:17.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.578716+0000", 2024-04-01T19:43:17.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0148000000000007e-05 2024-04-01T19:43:17.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:17.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.590688+0000", 2024-04-01T19:43:17.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011972175 2024-04-01T19:43:17.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:17.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.641213+0000", 2024-04-01T19:43:17.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.050525077000000002 2024-04-01T19:43:17.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:17.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.641246+0000", 2024-04-01T19:43:17.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2274999999999998e-05 2024-04-01T19:43:17.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:17.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.641282+0000", 2024-04-01T19:43:17.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6111e-05 2024-04-01T19:43:17.940 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.940 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:17.940 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.940 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:247397 5.e 5:732d2c78:::benchmark_data_smithi188_119427_object82698:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:43:17.941 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:58.655614+0000", 2024-04-01T19:43:17.941 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 19.190797582999998, 2024-04-01T19:43:17.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13616674000000001, 2024-04-01T19:43:17.941 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:17.941 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:17.941 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:17.941 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:17.941 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:17.941 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:17.941 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 247397 2024-04-01T19:43:17.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.941 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:17.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:17.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.655614+0000", 2024-04-01T19:43:17.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:17.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.655614+0000", 2024-04-01T19:43:17.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:17.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.655616+0000", 2024-04-01T19:43:17.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8109999999999999e-06 2024-04-01T19:43:17.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:17.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.655621+0000", 2024-04-01T19:43:17.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6799999999999998e-06 2024-04-01T19:43:17.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:17.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.655632+0000", 2024-04-01T19:43:17.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0464e-05 2024-04-01T19:43:17.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:17.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.655638+0000", 2024-04-01T19:43:17.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2639999999999997e-06 2024-04-01T19:43:17.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:17.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.740332+0000", 2024-04-01T19:43:17.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.084693972000000006 2024-04-01T19:43:17.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:17.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.740430+0000", 2024-04-01T19:43:17.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7707000000000005e-05 2024-04-01T19:43:17.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.945 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:43:17.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.740511+0000", 2024-04-01T19:43:17.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1216000000000003e-05 2024-04-01T19:43:17.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.945 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:17.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.743892+0000", 2024-04-01T19:43:17.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0033814449999999999 2024-04-01T19:43:17.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.945 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:17.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.791713+0000", 2024-04-01T19:43:17.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.047820254 2024-04-01T19:43:17.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:17.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.791743+0000", 2024-04-01T19:43:17.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0593999999999999e-05 2024-04-01T19:43:17.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:17.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.791780+0000", 2024-04-01T19:43:17.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7333000000000003e-05 2024-04-01T19:43:17.946 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.946 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:17.947 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.947 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:248550 5.e 5:7e0cfda9:::benchmark_data_smithi188_119427_object83851:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:43:17.947 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:43:00.030777+0000", 2024-04-01T19:43:17.947 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 17.815634473999999, 2024-04-01T19:43:17.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16407606899999999, 2024-04-01T19:43:17.947 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:17.947 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:17.947 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:17.947 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:17.947 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:17.947 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:17.947 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 248550 2024-04-01T19:43:17.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.948 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:17.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:17.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.030777+0000", 2024-04-01T19:43:17.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:17.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.030777+0000", 2024-04-01T19:43:17.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:17.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.030779+0000", 2024-04-01T19:43:17.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3769999999999999e-06 2024-04-01T19:43:17.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:17.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.030786+0000", 2024-04-01T19:43:17.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.404e-06 2024-04-01T19:43:17.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:17.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.030798+0000", 2024-04-01T19:43:17.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2852e-05 2024-04-01T19:43:17.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:17.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.030807+0000", 2024-04-01T19:43:17.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5580000000000001e-06 2024-04-01T19:43:17.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:17.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.049634+0000", 2024-04-01T19:43:17.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018827334000000001 2024-04-01T19:43:17.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:17.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.049748+0000", 2024-04-01T19:43:17.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000113241 2024-04-01T19:43:17.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:43:17.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.050301+0000", 2024-04-01T19:43:17.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00055343600000000003 2024-04-01T19:43:17.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:17.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.058890+0000", 2024-04-01T19:43:17.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085885749999999993 2024-04-01T19:43:17.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:17.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.194775+0000", 2024-04-01T19:43:17.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13588499100000001 2024-04-01T19:43:17.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:17.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.194810+0000", 2024-04-01T19:43:17.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5224e-05 2024-04-01T19:43:17.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:17.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.194853+0000", 2024-04-01T19:43:17.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3077000000000001e-05 2024-04-01T19:43:17.953 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.953 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:17.953 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.953 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:248556 5.e 5:77bbb544:::benchmark_data_smithi188_119427_object83857:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:43:17.953 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:43:00.042657+0000", 2024-04-01T19:43:17.953 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 17.803754644000001, 2024-04-01T19:43:17.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.152348768, 2024-04-01T19:43:17.953 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:17.953 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:17.953 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:17.954 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:17.954 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:17.954 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:17.954 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 248556 2024-04-01T19:43:17.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.954 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:17.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:17.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.042657+0000", 2024-04-01T19:43:17.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:17.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.042657+0000", 2024-04-01T19:43:17.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:17.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.042659+0000", 2024-04-01T19:43:17.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.057e-06 2024-04-01T19:43:17.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:17.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.042664+0000", 2024-04-01T19:43:17.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.792e-06 2024-04-01T19:43:17.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:17.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.042671+0000", 2024-04-01T19:43:17.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4780000000000002e-06 2024-04-01T19:43:17.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:17.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.042678+0000", 2024-04-01T19:43:17.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9589999999999998e-06 2024-04-01T19:43:17.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:17.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.054676+0000", 2024-04-01T19:43:17.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011997885999999999 2024-04-01T19:43:17.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:17.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.054796+0000", 2024-04-01T19:43:17.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000120449 2024-04-01T19:43:17.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:43:17.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.054920+0000", 2024-04-01T19:43:17.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012366699999999999 2024-04-01T19:43:17.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:17.958 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.059008+0000", 2024-04-01T19:43:17.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040880329999999996 2024-04-01T19:43:17.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:17.958 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.194900+0000", 2024-04-01T19:43:17.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13589177699999999 2024-04-01T19:43:17.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:17.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.194953+0000", 2024-04-01T19:43:17.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3508000000000003e-05 2024-04-01T19:43:17.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:17.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.195005+0000", 2024-04-01T19:43:17.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2162e-05 2024-04-01T19:43:17.959 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.959 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:17.959 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.959 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:248696 5.e 5:74f18be6:::benchmark_data_smithi188_119427_object83997:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:43:17.959 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:43:00.285722+0000", 2024-04-01T19:43:17.960 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 17.560689627999999, 2024-04-01T19:43:17.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.148233119, 2024-04-01T19:43:17.960 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:17.960 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:17.960 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:17.960 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:17.960 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:17.960 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:17.960 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 248696 2024-04-01T19:43:17.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.960 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:17.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:17.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.285722+0000", 2024-04-01T19:43:17.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:17.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.285722+0000", 2024-04-01T19:43:17.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:17.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.285723+0000", 2024-04-01T19:43:17.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.392e-06 2024-04-01T19:43:17.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:17.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.285728+0000", 2024-04-01T19:43:17.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6489999999999999e-06 2024-04-01T19:43:17.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:17.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.285738+0000", 2024-04-01T19:43:17.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0617e-05 2024-04-01T19:43:17.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:17.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.285745+0000", 2024-04-01T19:43:17.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1149999999999996e-06 2024-04-01T19:43:17.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.963 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:17.963 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.359063+0000", 2024-04-01T19:43:17.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.073318016999999999 2024-04-01T19:43:17.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.963 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:17.963 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.359191+0000", 2024-04-01T19:43:17.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000127556 2024-04-01T19:43:17.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.963 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:43:17.963 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.359327+0000", 2024-04-01T19:43:17.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013623300000000001 2024-04-01T19:43:17.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:17.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.362993+0000", 2024-04-01T19:43:17.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036660030000000001 2024-04-01T19:43:17.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:17.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.433823+0000", 2024-04-01T19:43:17.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.070829846000000002 2024-04-01T19:43:17.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:17.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.433898+0000", 2024-04-01T19:43:17.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5331000000000001e-05 2024-04-01T19:43:17.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.965 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:17.965 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.433955+0000", 2024-04-01T19:43:17.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6360000000000002e-05 2024-04-01T19:43:17.965 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.965 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:17.965 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.965 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:248702 5.e 5:7398d052:::benchmark_data_smithi188_119427_object84003:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:43:17.965 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:43:00.293713+0000", 2024-04-01T19:43:17.965 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 17.552698144000001, 2024-04-01T19:43:17.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14041481, 2024-04-01T19:43:17.965 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:17.965 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:17.966 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:17.966 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:17.966 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:17.966 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:17.966 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 248702 2024-04-01T19:43:17.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.966 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:17.966 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:17.966 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.293713+0000", 2024-04-01T19:43:17.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.967 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:17.967 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.293713+0000", 2024-04-01T19:43:17.967 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:17.967 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.967 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:17.967 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.293715+0000", 2024-04-01T19:43:17.967 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9259999999999999e-06 2024-04-01T19:43:17.967 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.967 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:17.967 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.293721+0000", 2024-04-01T19:43:17.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4140000000000002e-06 2024-04-01T19:43:17.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.968 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:17.968 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.293733+0000", 2024-04-01T19:43:17.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2160999999999999e-05 2024-04-01T19:43:17.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.968 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:17.968 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.293741+0000", 2024-04-01T19:43:17.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3149999999999992e-06 2024-04-01T19:43:17.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.969 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:17.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.363581+0000", 2024-04-01T19:43:17.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.069840134999999998 2024-04-01T19:43:17.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.969 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:17.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.363703+0000", 2024-04-01T19:43:17.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012218299999999999 2024-04-01T19:43:17.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.969 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:43:17.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.363835+0000", 2024-04-01T19:43:17.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000132182 2024-04-01T19:43:17.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:17.970 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.370504+0000", 2024-04-01T19:43:17.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0066690179999999996 2024-04-01T19:43:17.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:17.970 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.434031+0000", 2024-04-01T19:43:17.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.063526529999999998 2024-04-01T19:43:17.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.971 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:17.971 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.434070+0000", 2024-04-01T19:43:17.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8572999999999998e-05 2024-04-01T19:43:17.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:17.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:17.971 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:17.971 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.434128+0000", 2024-04-01T19:43:17.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8372999999999998e-05 2024-04-01T19:43:17.971 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.971 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:17.971 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.971 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:17.971 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:17.971 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:43:17.972 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:43:18.015 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:18.148 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:43:18.151 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:18.152 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:43:18.253 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:43:18.279 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:43:18.321 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:18.432 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:43:18.436 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:18.437 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:43:18.437 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:18 smithi022 ceph-mon[39439]: 5.a scrub ok 2024-04-01T19:43:18.437 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:18 smithi022 ceph-mon[39439]: 5.8 scrub ok 2024-04-01T19:43:18.437 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:18 smithi022 ceph-mon[39439]: 5.e scrub starts 2024-04-01T19:43:18.438 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:18 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3398895008' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:43:18.438 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:18 smithi022 ceph-mon[39439]: from='client.26158 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:43:18.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:18 smithi062 ceph-mon[44211]: 5.a scrub ok 2024-04-01T19:43:18.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:18 smithi062 ceph-mon[44211]: 5.8 scrub ok 2024-04-01T19:43:18.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:18 smithi062 ceph-mon[44211]: 5.e scrub starts 2024-04-01T19:43:18.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:18 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3398895008' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:43:18.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:18 smithi062 ceph-mon[44211]: from='client.26158 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:43:18.538 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:43:18.569 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:18.592 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:18 smithi188 ceph-mon[43939]: 5.a scrub ok 2024-04-01T19:43:18.592 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:18 smithi188 ceph-mon[43939]: 5.8 scrub ok 2024-04-01T19:43:18.592 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:18 smithi188 ceph-mon[43939]: 5.e scrub starts 2024-04-01T19:43:18.592 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:18 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3398895008' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:43:18.592 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:18 smithi188 ceph-mon[43939]: from='client.26158 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:43:18.594 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:43:18.597 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:18.597 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:43:18.632 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_ops_in_flight 2024-04-01T19:43:18.698 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:43:18.758 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:18.978 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:43:19.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:19 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:43:19.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:19 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:43:19.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:19 smithi022 ceph-mon[39439]: 5.2 scrub starts 2024-04-01T19:43:19.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:19 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:43:19.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:19 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:43:19.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:19 smithi022 ceph-mon[39439]: from='client.26158 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:43:19.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:19 smithi022 ceph-mon[39439]: osdmap e445: 12 total, 11 up, 10 in 2024-04-01T19:43:19.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:19 smithi022 ceph-mon[39439]: 5.e scrub ok 2024-04-01T19:43:19.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:19 smithi022 ceph-mon[39439]: 5.2 scrub ok 2024-04-01T19:43:19.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:19 smithi022 ceph-mon[39439]: pgmap v1239: 17 pgs: 17 active+clean; 3.8 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:43:19.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:19 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:43:19.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:19 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:43:19.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:19 smithi062 ceph-mon[44211]: 5.2 scrub starts 2024-04-01T19:43:19.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:19 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:43:19.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:19 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:43:19.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:19 smithi062 ceph-mon[44211]: from='client.26158 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:43:19.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:19 smithi062 ceph-mon[44211]: osdmap e445: 12 total, 11 up, 10 in 2024-04-01T19:43:19.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:19 smithi062 ceph-mon[44211]: 5.e scrub ok 2024-04-01T19:43:19.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:19 smithi062 ceph-mon[44211]: 5.2 scrub ok 2024-04-01T19:43:19.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:19 smithi062 ceph-mon[44211]: pgmap v1239: 17 pgs: 17 active+clean; 3.8 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:43:19.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:19 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:43:19.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:19 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:43:19.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:19 smithi188 ceph-mon[43939]: 5.2 scrub starts 2024-04-01T19:43:19.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:19 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:43:19.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:19 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:43:19.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:19 smithi188 ceph-mon[43939]: from='client.26158 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:43:19.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:19 smithi188 ceph-mon[43939]: osdmap e445: 12 total, 11 up, 10 in 2024-04-01T19:43:19.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:19 smithi188 ceph-mon[43939]: 5.e scrub ok 2024-04-01T19:43:19.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:19 smithi188 ceph-mon[43939]: 5.2 scrub ok 2024-04-01T19:43:19.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:19 smithi188 ceph-mon[43939]: pgmap v1239: 17 pgs: 17 active+clean; 3.8 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:43:19.767 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:43:19.769 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:19.769 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:43:19.870 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:43:19.903 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:21.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:21 smithi022 ceph-mon[39439]: 5.f scrub starts 2024-04-01T19:43:21.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:21 smithi022 ceph-mon[39439]: pgmap v1240: 17 pgs: 17 active+clean; 3.7 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 1.11k op/s 2024-04-01T19:43:21.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:21 smithi062 ceph-mon[44211]: 5.f scrub starts 2024-04-01T19:43:21.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:21 smithi062 ceph-mon[44211]: pgmap v1240: 17 pgs: 17 active+clean; 3.7 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 1.11k op/s 2024-04-01T19:43:21.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:21 smithi188 ceph-mon[43939]: 5.f scrub starts 2024-04-01T19:43:21.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:21 smithi188 ceph-mon[43939]: pgmap v1240: 17 pgs: 17 active+clean; 3.7 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 1.11k op/s 2024-04-01T19:43:21.761 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:43:21.763 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:21.764 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:43:21.865 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:43:21.894 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:22.248 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:43:22.253 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:22.253 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:43:22.354 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:43:22.408 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:22.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:22 smithi062 ceph-mon[44211]: 5.f scrub ok 2024-04-01T19:43:22.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:22 smithi188 ceph-mon[43939]: 5.f scrub ok 2024-04-01T19:43:22.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:22 smithi022 ceph-mon[39439]: 5.f scrub ok 2024-04-01T19:43:22.897 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:43:22.898 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:43:22.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:22.898 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:274525 5.4 5:284b4a3b:::benchmark_data_smithi188_119427_object109826:head [delete] snapc 0=[] ondisk+write+known_if_redirected e445)", 2024-04-01T19:43:22.898 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:43:22.889836+0000", 2024-04-01T19:43:22.898 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.010564932000000001, 2024-04-01T19:43:22.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010589810999999999, 2024-04-01T19:43:22.898 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:22.898 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:22.898 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:43:22.898 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:22.899 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:22.899 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:22.899 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 274525 2024-04-01T19:43:22.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:22.899 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:22.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:22.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:22.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:22.889836+0000", 2024-04-01T19:43:22.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:22.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:22.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:22.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:22.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:22.889836+0000", 2024-04-01T19:43:22.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:22.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:22.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:22.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:22.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:22.889837+0000", 2024-04-01T19:43:22.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.373e-06 2024-04-01T19:43:22.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:22.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:22.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:22.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:22.889842+0000", 2024-04-01T19:43:22.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3709999999999999e-06 2024-04-01T19:43:22.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:22.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:22.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:22.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:22.889852+0000", 2024-04-01T19:43:22.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2979999999999997e-06 2024-04-01T19:43:22.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:22.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:22.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:22.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:22.889859+0000", 2024-04-01T19:43:22.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3560000000000004e-06 2024-04-01T19:43:22.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:22.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:22.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:22.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:22.889931+0000", 2024-04-01T19:43:22.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2359000000000003e-05 2024-04-01T19:43:22.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:22.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:22.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:22.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:22.890037+0000", 2024-04-01T19:43:22.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000105701 2024-04-01T19:43:22.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:22.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:22.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:43:22.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:22.890146+0000", 2024-04-01T19:43:22.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108618 2024-04-01T19:43:22.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:22.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:22.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:22.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:22.898886+0000", 2024-04-01T19:43:22.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0087403689999999996 2024-04-01T19:43:22.903 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:22.903 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:22.903 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:22.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:22.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:22.903 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:274526 5.4 5:2013bce1:::benchmark_data_smithi188_119427_object109827:head [delete] snapc 0=[] ondisk+write+known_if_redirected e445)", 2024-04-01T19:43:22.903 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:43:22.890927+0000", 2024-04-01T19:43:22.903 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0094730579999999995, 2024-04-01T19:43:22.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0095529529999999994, 2024-04-01T19:43:22.903 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:22.903 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:22.904 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:43:22.904 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:22.904 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:22.904 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:22.904 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 274526 2024-04-01T19:43:22.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:22.904 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:22.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:22.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:22.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:22.890927+0000", 2024-04-01T19:43:22.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:22.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:22.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:22.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:22.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:22.890927+0000", 2024-04-01T19:43:22.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:22.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:22.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:22.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:22.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:22.890929+0000", 2024-04-01T19:43:22.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3999999999999999e-06 2024-04-01T19:43:22.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:22.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:22.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:22.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:22.890934+0000", 2024-04-01T19:43:22.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0599999999999998e-06 2024-04-01T19:43:22.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:22.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:22.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:22.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:22.890947+0000", 2024-04-01T19:43:22.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2745000000000001e-05 2024-04-01T19:43:22.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:22.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:22.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:22.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:22.890954+0000", 2024-04-01T19:43:22.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9920000000000001e-06 2024-04-01T19:43:22.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:22.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:22.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:22.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:22.894130+0000", 2024-04-01T19:43:22.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031767779999999999 2024-04-01T19:43:22.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:22.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:22.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:22.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:22.894275+0000", 2024-04-01T19:43:22.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000145026 2024-04-01T19:43:22.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:22.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:22.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:43:22.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:22.894425+0000", 2024-04-01T19:43:22.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014923200000000001 2024-04-01T19:43:22.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:22.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:22.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:22.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:22.899035+0000", 2024-04-01T19:43:22.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046097860000000003 2024-04-01T19:43:22.908 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:22.908 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:22.908 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:22.908 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:22.908 INFO:teuthology.orchestra.run.smithi188.stdout: ], 2024-04-01T19:43:22.908 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 2 2024-04-01T19:43:22.908 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:43:23.211 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:23 smithi188 ceph-mon[43939]: pgmap v1241: 17 pgs: 17 active+clean; 3.5 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 1.34k op/s 2024-04-01T19:43:23.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:23 smithi062 ceph-mon[44211]: pgmap v1241: 17 pgs: 17 active+clean; 3.5 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 1.34k op/s 2024-04-01T19:43:23.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:23 smithi022 ceph-mon[39439]: pgmap v1241: 17 pgs: 17 active+clean; 3.5 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 1.34k op/s 2024-04-01T19:43:23.621 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_blocked_ops 2024-04-01T19:43:23.971 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:43:25.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:25 smithi188 ceph-mon[43939]: pgmap v1242: 17 pgs: 17 active+clean; 3.4 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:43:25.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:25 smithi062 ceph-mon[44211]: pgmap v1242: 17 pgs: 17 active+clean; 3.4 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:43:25.608 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:25 smithi022 ceph-mon[39439]: pgmap v1242: 17 pgs: 17 active+clean; 3.4 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:43:25.619 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:43:25.694 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:25.694 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:43:25.795 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:43:25.826 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:26.081 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:43:26.081 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:43:26.081 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-01T19:43:26.081 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-01T19:43:26.082 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:43:26.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:26 smithi188 ceph-mon[43939]: 5.c scrub starts 2024-04-01T19:43:26.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:26 smithi062 ceph-mon[44211]: 5.c scrub starts 2024-04-01T19:43:26.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:26 smithi022 ceph-mon[39439]: 5.c scrub starts 2024-04-01T19:43:27.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:27 smithi062 ceph-mon[44211]: 5.c scrub ok 2024-04-01T19:43:27.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:27 smithi062 ceph-mon[44211]: pgmap v1243: 17 pgs: 17 active+clean; 3.2 GiB data, 10 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:43:27.595 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:27 smithi022 ceph-mon[39439]: 5.c scrub ok 2024-04-01T19:43:27.595 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:27 smithi022 ceph-mon[39439]: pgmap v1243: 17 pgs: 17 active+clean; 3.2 GiB data, 10 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:43:27.602 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:43:27.606 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:27.606 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:43:27.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:27 smithi188 ceph-mon[43939]: 5.c scrub ok 2024-04-01T19:43:27.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:27 smithi188 ceph-mon[43939]: pgmap v1243: 17 pgs: 17 active+clean; 3.2 GiB data, 10 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:43:27.647 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:43:27.707 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:43:27.741 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:28.031 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:43:28.076 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:43:28.108 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:43:28.144 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:43:28.162 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:43:28.211 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:43:28.241 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:43:28.278 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:43:28.313 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:43:28.346 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:43:28.386 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:43:28.426 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:43:28.426 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:43:28.427 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:43:28.427 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:43:28.427 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:43:28.427 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:43:28.427 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:43:28.427 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:43:28.427 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:43:28.427 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:43:28.427 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:43:28.427 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:43:28.427 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:43:28.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:28 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1876349770' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:43:28.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:28 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1876349770' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:43:28.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:28 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1876349770' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:43:29.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:29 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:43:29.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:29 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:43:29.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:29 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:43:29.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:29 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:43:29.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:29 smithi062 ceph-mon[44211]: osdmap e446: 12 total, 11 up, 10 in 2024-04-01T19:43:29.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:29 smithi062 ceph-mon[44211]: pgmap v1245: 17 pgs: 17 active+clean; 3.1 GiB data, 10 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:43:29.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:29 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:43:29.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:29 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:43:29.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:29 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:43:29.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:29 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:43:29.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:29 smithi022 ceph-mon[39439]: osdmap e446: 12 total, 11 up, 10 in 2024-04-01T19:43:29.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:29 smithi022 ceph-mon[39439]: pgmap v1245: 17 pgs: 17 active+clean; 3.1 GiB data, 10 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:43:29.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:29 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:43:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:29 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:43:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:29 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:43:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:29 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:43:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:29 smithi188 ceph-mon[43939]: osdmap e446: 12 total, 11 up, 10 in 2024-04-01T19:43:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:29.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:29 smithi188 ceph-mon[43939]: pgmap v1245: 17 pgs: 17 active+clean; 3.1 GiB data, 10 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:43:29.798 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:43:29.800 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:29.800 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:43:29.834 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_historic_ops 2024-04-01T19:43:29.902 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:43:29.936 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:29.962 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:43:29.965 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:29.965 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:43:30.066 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:43:30.118 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:30.197 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:43:30.339 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:43:30.343 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:30.344 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:43:30.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:30 smithi022 ceph-mon[39439]: osdmap e447: 12 total, 11 up, 10 in 2024-04-01T19:43:30.374 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:43:30.375 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:43:30.445 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:43:30.490 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:30.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:30 smithi062 ceph-mon[44211]: osdmap e447: 12 total, 11 up, 10 in 2024-04-01T19:43:30.523 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:30 smithi188 ceph-mon[43939]: osdmap e447: 12 total, 11 up, 10 in 2024-04-01T19:43:30.628 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:43:30.633 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:30.633 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:43:30.734 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:43:30.788 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:30.824 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:43:30.831 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:30.831 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:43:30.932 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:43:30.963 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:31.114 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:43:31.117 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:31.117 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:43:31.218 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:43:31.261 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:31.313 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:43:31.326 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:31.326 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:43:31.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:31 smithi188 ceph-mon[43939]: pgmap v1247: 17 pgs: 17 active+clean; 2.9 GiB data, 9.8 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:43:31.427 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:43:31.461 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:31.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:31 smithi022 ceph-mon[39439]: pgmap v1247: 17 pgs: 17 active+clean; 2.9 GiB data, 9.8 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:43:31.666 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:43:31.674 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:31.675 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:43:31.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:31 smithi062 ceph-mon[44211]: pgmap v1247: 17 pgs: 17 active+clean; 2.9 GiB data, 9.8 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:43:31.775 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:43:31.806 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:32.011 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:43:32.019 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:32.020 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:43:32.121 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:43:32.157 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:32.186 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:43:32.189 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:32.190 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:43:32.290 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:43:32.309 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:43:32.331 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:32.341 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:43:32.341 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:43:32.359 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:43:32.364 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:32.364 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:43:32.376 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:43:32.465 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:43:32.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:32 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2832931373' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:43:32.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:32 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2832931373' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:43:32.537 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:32.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:32 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2832931373' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:43:32.632 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:43:32.637 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:32.638 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:43:32.739 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:43:32.772 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:33.025 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:43:33.031 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:33.031 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:43:33.059 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_ops_in_flight 2024-04-01T19:43:33.132 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:43:33.175 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:33.198 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:43:33.203 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:33.203 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:43:33.287 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:33 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:43:33.287 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:33 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2832931373' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:43:33.287 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:33 smithi188 ceph-mon[43939]: osdmap e448: 12 total, 11 up, 10 in 2024-04-01T19:43:33.287 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:33 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:43:33.287 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:33 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:43:33.287 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:33 smithi188 ceph-mon[43939]: pgmap v1249: 17 pgs: 17 active+clean; 2.8 GiB data, 9.4 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:43:33.303 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:43:33.361 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:43:33.384 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:33.417 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:43:33.422 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:33.423 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:43:33.441 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:43:33.524 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:43:33.582 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:33 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:43:33.583 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:33 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2832931373' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:43:33.583 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:33 smithi022 ceph-mon[39439]: osdmap e448: 12 total, 11 up, 10 in 2024-04-01T19:43:33.583 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:33 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:43:33.583 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:33 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:43:33.583 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:33 smithi022 ceph-mon[39439]: pgmap v1249: 17 pgs: 17 active+clean; 2.8 GiB data, 9.4 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:43:33.587 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:33.719 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:43:33.725 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:33.725 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:43:33.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:33 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:43:33.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:33 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2832931373' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:43:33.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:33 smithi062 ceph-mon[44211]: osdmap e448: 12 total, 11 up, 10 in 2024-04-01T19:43:33.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:33 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:43:33.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:33 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:43:33.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:33 smithi062 ceph-mon[44211]: pgmap v1249: 17 pgs: 17 active+clean; 2.8 GiB data, 9.4 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:43:33.826 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:43:33.858 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:33.884 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:43:33.887 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:33.887 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:43:33.988 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:43:34.037 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:34.317 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:34 smithi022 ceph-mon[39439]: osdmap e449: 12 total, 11 up, 10 in 2024-04-01T19:43:34.402 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:43:34.409 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:34.409 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:43:34.510 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:43:34.549 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:34.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:34 smithi188 ceph-mon[43939]: osdmap e449: 12 total, 11 up, 10 in 2024-04-01T19:43:34.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:34 smithi062 ceph-mon[44211]: osdmap e449: 12 total, 11 up, 10 in 2024-04-01T19:43:34.914 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:43:34.917 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:34.918 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:43:35.019 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:43:35.049 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:35.225 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:43:35.252 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:43:35.258 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:35.258 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:43:35.359 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:43:35.389 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:35.412 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:43:35.416 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:35.417 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:43:35.518 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:43:35.548 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:35 smithi188 ceph-mon[43939]: pgmap v1251: 17 pgs: 17 active+clean; 2.7 GiB data, 9.3 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T19:43:35.551 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:35.574 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:43:35.580 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:35.580 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:43:35.583 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:43:35.584 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:43:35.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:35 smithi022 ceph-mon[39439]: pgmap v1251: 17 pgs: 17 active+clean; 2.7 GiB data, 9.3 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T19:43:35.681 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:43:35.711 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:35.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:35 smithi062 ceph-mon[44211]: pgmap v1251: 17 pgs: 17 active+clean; 2.7 GiB data, 9.3 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T19:43:35.808 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:43:35.816 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:43:35.857 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:43:35.895 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:43:35.912 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:43:35.915 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:35.915 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:43:35.923 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:43:35.962 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:43:36.002 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:43:36.016 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:43:36.038 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:43:36.048 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:36.085 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:43:36.122 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:43:36.164 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:43:36.193 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:43:36.194 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:43:36.194 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:43:36.194 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:43:36.194 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:43:36.194 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:43:36.194 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:43:36.194 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:43:36.194 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:43:36.194 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:43:36.194 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:43:36.194 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:43:36.195 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:43:36.400 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:43:36.403 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_blocked_ops 2024-04-01T19:43:36.404 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:36.405 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:43:36.506 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:43:36.552 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:36.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:36 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/288644813' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:43:36.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:36 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:36.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:36 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:36.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:36 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:36.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:36 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:36.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:36 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/288644813' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:43:36.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:36 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:36.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:36 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:36.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:36 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:36.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:36 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:36.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:36 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/288644813' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:43:36.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:36 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:36.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:36 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:36.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:36 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:36.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:36 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:36.806 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:43:36.924 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:43:36.934 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:36.935 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:43:37.036 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:43:37.088 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:37.128 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:43:37.143 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:37.143 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:43:37.244 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:43:37.308 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:37.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:37 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:37.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:37 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:37.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:37 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:37.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:37 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:37.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:37 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:37.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:37 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:37.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:37 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:37.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:37 smithi022 ceph-mon[39439]: pgmap v1252: 17 pgs: 17 active+clean; 2.5 GiB data, 8.9 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 1.35k op/s 2024-04-01T19:43:37.572 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:43:37.577 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:37.578 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:43:37.679 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:43:37.710 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:37 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:37.710 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:37 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:37.710 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:37 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:37.710 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:37 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:37.710 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:37 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:37.710 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:37 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:37.710 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:37 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:37.710 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:37 smithi188 ceph-mon[43939]: pgmap v1252: 17 pgs: 17 active+clean; 2.5 GiB data, 8.9 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 1.35k op/s 2024-04-01T19:43:37.713 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:37.736 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:43:37.738 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:37.738 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:43:37.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:37 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:37.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:37 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:37.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:37 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:37.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:37 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:37.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:37 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:37.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:37 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:37.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:37 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:37.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:37 smithi062 ceph-mon[44211]: pgmap v1252: 17 pgs: 17 active+clean; 2.5 GiB data, 8.9 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 1.35k op/s 2024-04-01T19:43:37.839 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:43:37.870 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:37.895 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:43:37.898 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:37.898 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:43:37.904 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:43:37.904 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:43:37.999 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:43:38.044 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:38.096 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:43:38.100 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:38.100 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:43:38.201 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:43:38.233 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:38.257 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:43:38.263 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:38.263 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:43:38.364 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:43:38.436 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:38.482 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:43:38.489 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:38.489 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:43:38.590 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:43:38.626 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:38.652 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:43:38.655 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:38.655 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:43:38.756 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:43:38.789 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:38.943 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:43:38.947 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:38.947 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:43:38.949 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:43:38.972 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:43:38.973 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:43:38.973 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-01T19:43:38.973 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-01T19:43:38.973 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:43:39.048 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:43:39.088 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:39.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:38 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4114831912' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:43:39.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:38 smithi062 ceph-mon[44211]: from='client.26179 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:43:39.316 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:38 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4114831912' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:43:39.316 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:38 smithi188 ceph-mon[43939]: from='client.26179 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:43:39.341 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:38 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4114831912' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:43:39.341 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:38 smithi022 ceph-mon[39439]: from='client.26179 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:43:39.723 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_historic_ops 2024-04-01T19:43:39.772 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:43:39.776 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:39.776 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:43:39.877 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:43:39.905 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:43:39.912 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:43:39.941 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:39.941 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:43:40.042 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:43:40.073 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:39 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:43:40.073 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:39 smithi188 ceph-mon[43939]: from='client.26179 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:43:40.073 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:39 smithi188 ceph-mon[43939]: osdmap e450: 12 total, 11 up, 10 in 2024-04-01T19:43:40.073 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:39 smithi188 ceph-mon[43939]: pgmap v1254: 17 pgs: 17 active+clean; 2.4 GiB data, 8.8 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 1.02k op/s 2024-04-01T19:43:40.076 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:40.107 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:43:40.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:39 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:43:40.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:39 smithi022 ceph-mon[39439]: from='client.26179 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:43:40.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:39 smithi022 ceph-mon[39439]: osdmap e450: 12 total, 11 up, 10 in 2024-04-01T19:43:40.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:39 smithi022 ceph-mon[39439]: pgmap v1254: 17 pgs: 17 active+clean; 2.4 GiB data, 8.8 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 1.02k op/s 2024-04-01T19:43:40.116 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:40.116 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:43:40.125 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:43:40.217 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:43:40.249 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:39 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:43:40.249 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:39 smithi062 ceph-mon[44211]: from='client.26179 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:43:40.249 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:39 smithi062 ceph-mon[44211]: osdmap e450: 12 total, 11 up, 10 in 2024-04-01T19:43:40.249 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:39 smithi062 ceph-mon[44211]: pgmap v1254: 17 pgs: 17 active+clean; 2.4 GiB data, 8.8 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 1.02k op/s 2024-04-01T19:43:40.252 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:40.275 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:43:40.279 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:40.279 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:43:40.348 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:43:40.380 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:43:40.410 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:40.434 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:43:40.436 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:40.437 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:43:40.537 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:43:40.568 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:40.591 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:43:40.594 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:40.594 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:43:40.695 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:43:40.728 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:41.083 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:43:41.092 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:41.092 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:43:41.193 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:43:41.223 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:41.228 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:41 smithi022 ceph-mon[39439]: pgmap v1255: 17 pgs: 17 active+clean; 2.2 GiB data, 8.4 GiB used, 886 GiB / 894 GiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:43:41.243 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:43:41.247 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:41.247 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:43:41.348 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:43:41.394 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:41 smithi188 ceph-mon[43939]: pgmap v1255: 17 pgs: 17 active+clean; 2.2 GiB data, 8.4 GiB used, 886 GiB / 894 GiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:43:41.428 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:41.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:41 smithi062 ceph-mon[44211]: pgmap v1255: 17 pgs: 17 active+clean; 2.2 GiB data, 8.4 GiB used, 886 GiB / 894 GiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:43:41.536 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:43:41.543 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:41.543 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:43:41.644 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:43:41.675 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:41.772 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:43:41.777 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:43:41.785 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:41.785 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:43:41.886 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:43:41.922 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:41.950 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:43:41.954 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:41.954 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:43:42.055 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:43:42.089 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:42.176 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:43:42.179 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:42.180 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:43:42.233 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:43:42.233 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:43:42.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:43:42.233 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:43:42.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.233 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:207666 4.1 4:8fd59321:::benchmark_data_smithi188_104537_object35672:head [delete] snapc 0=[] ondisk+write+known_if_redirected e319)", 2024-04-01T19:43:42.233 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:49.304960+0000", 2024-04-01T19:43:42.233 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 412.92743787799998, 2024-04-01T19:43:42.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18102294299999999, 2024-04-01T19:43:42.234 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:42.234 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:42.234 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:42.234 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:42.234 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:43:42.234 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:43:42.234 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 207666 2024-04-01T19:43:42.234 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.234 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:42.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.234 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:42.234 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.304960+0000", 2024-04-01T19:43:42.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:42.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.304960+0000", 2024-04-01T19:43:42.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:42.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.304961+0000", 2024-04-01T19:43:42.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3149999999999999e-06 2024-04-01T19:43:42.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:42.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.304966+0000", 2024-04-01T19:43:42.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2849999999999996e-06 2024-04-01T19:43:42.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:42.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.304974+0000", 2024-04-01T19:43:42.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3690000000000007e-06 2024-04-01T19:43:42.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:42.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.304982+0000", 2024-04-01T19:43:42.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6580000000000002e-06 2024-04-01T19:43:42.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:42.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.333648+0000", 2024-04-01T19:43:42.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028666476999999999 2024-04-01T19:43:42.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:42.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.333765+0000", 2024-04-01T19:43:42.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000116638 2024-04-01T19:43:42.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 5", 2024-04-01T19:43:42.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.333878+0000", 2024-04-01T19:43:42.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000113564 2024-04-01T19:43:42.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:42.238 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.339669+0000", 2024-04-01T19:43:42.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00579029 2024-04-01T19:43:42.238 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.238 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.238 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:42.238 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.485869+0000", 2024-04-01T19:43:42.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14619980399999999 2024-04-01T19:43:42.238 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.238 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.238 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:42.238 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.485909+0000", 2024-04-01T19:43:42.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0120000000000002e-05 2024-04-01T19:43:42.238 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.239 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.239 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:42.239 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.485983+0000", 2024-04-01T19:43:42.239 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4423000000000002e-05 2024-04-01T19:43:42.239 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.239 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:42.239 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.239 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.239 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.239 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:207766 4.1 4:8294c602:::benchmark_data_smithi188_104537_object35772:head [delete] snapc 0=[] ondisk+write+known_if_redirected e320)", 2024-04-01T19:43:42.239 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:49.522712+0000", 2024-04-01T19:43:42.239 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 412.70968572700002, 2024-04-01T19:43:42.239 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18247834199999999, 2024-04-01T19:43:42.240 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:42.240 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:42.240 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:42.240 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:42.240 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:43:42.240 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:43:42.240 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 207766 2024-04-01T19:43:42.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.240 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:42.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:42.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.522712+0000", 2024-04-01T19:43:42.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:42.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.522712+0000", 2024-04-01T19:43:42.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:42.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.522717+0000", 2024-04-01T19:43:42.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3490000000000002e-06 2024-04-01T19:43:42.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:42.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.522724+0000", 2024-04-01T19:43:42.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9349999999999997e-06 2024-04-01T19:43:42.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:42.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.522736+0000", 2024-04-01T19:43:42.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2381000000000001e-05 2024-04-01T19:43:42.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:42.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.522745+0000", 2024-04-01T19:43:42.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8769999999999999e-06 2024-04-01T19:43:42.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:42.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.525443+0000", 2024-04-01T19:43:42.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0026986639999999999 2024-04-01T19:43:42.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:42.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.525587+0000", 2024-04-01T19:43:42.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014398300000000001 2024-04-01T19:43:42.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 5", 2024-04-01T19:43:42.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.525730+0000", 2024-04-01T19:43:42.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014288699999999999 2024-04-01T19:43:42.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:42.244 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.531284+0000", 2024-04-01T19:43:42.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0055541399999999999 2024-04-01T19:43:42.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.244 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:42.244 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.705065+0000", 2024-04-01T19:43:42.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.173780979 2024-04-01T19:43:42.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.244 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:42.244 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.705122+0000", 2024-04-01T19:43:42.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6678000000000002e-05 2024-04-01T19:43:42.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.245 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:42.245 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:49.705191+0000", 2024-04-01T19:43:42.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8468999999999998e-05 2024-04-01T19:43:42.245 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.245 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:42.245 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.245 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:208038 4.1 4:8ba2b583:::benchmark_data_smithi188_104537_object36044:head [delete] snapc 0=[] ondisk+write+known_if_redirected e320)", 2024-04-01T19:43:42.245 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:50.042530+0000", 2024-04-01T19:43:42.245 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 412.18986775799999, 2024-04-01T19:43:42.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.27495873399999998, 2024-04-01T19:43:42.245 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:42.245 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:42.246 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:42.246 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:42.246 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:43:42.246 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:43:42.246 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 208038 2024-04-01T19:43:42.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.246 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:42.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:42.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.042530+0000", 2024-04-01T19:43:42.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:42.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.042530+0000", 2024-04-01T19:43:42.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:42.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.042532+0000", 2024-04-01T19:43:42.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.902e-06 2024-04-01T19:43:42.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:42.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.042537+0000", 2024-04-01T19:43:42.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4209999999999997e-06 2024-04-01T19:43:42.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:42.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.042546+0000", 2024-04-01T19:43:42.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9940000000000006e-06 2024-04-01T19:43:42.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:42.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.042551+0000", 2024-04-01T19:43:42.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6570000000000002e-06 2024-04-01T19:43:42.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:42.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.132615+0000", 2024-04-01T19:43:42.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.090064273 2024-04-01T19:43:42.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.249 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:42.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.132724+0000", 2024-04-01T19:43:42.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010902400000000001 2024-04-01T19:43:42.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.249 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 5", 2024-04-01T19:43:42.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.132850+0000", 2024-04-01T19:43:42.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012504000000000001 2024-04-01T19:43:42.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.249 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:42.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.155391+0000", 2024-04-01T19:43:42.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022541733000000001 2024-04-01T19:43:42.250 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.250 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.250 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:42.250 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.317365+0000", 2024-04-01T19:43:42.250 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16197342100000001 2024-04-01T19:43:42.250 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.250 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.250 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:42.250 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.317417+0000", 2024-04-01T19:43:42.250 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2123000000000002e-05 2024-04-01T19:43:42.250 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.250 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.250 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:42.250 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.317489+0000", 2024-04-01T19:43:42.250 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2145999999999997e-05 2024-04-01T19:43:42.250 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.251 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:42.251 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.251 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.251 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.251 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:208054 4.9 4:90244fc4:::benchmark_data_smithi188_104537_object36060:head [delete] snapc 0=[] ondisk+write+known_if_redirected e320)", 2024-04-01T19:43:42.251 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:50.125290+0000", 2024-04-01T19:43:42.251 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 412.107108047, 2024-04-01T19:43:42.251 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.19631580600000001, 2024-04-01T19:43:42.251 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:42.251 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:42.251 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:42.251 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:42.251 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:43:42.251 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:43:42.252 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 208054 2024-04-01T19:43:42.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.252 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:42.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:42.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.125290+0000", 2024-04-01T19:43:42.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:42.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.125290+0000", 2024-04-01T19:43:42.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:42.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.125292+0000", 2024-04-01T19:43:42.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8139999999999999e-06 2024-04-01T19:43:42.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:42.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.125297+0000", 2024-04-01T19:43:42.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5300000000000004e-06 2024-04-01T19:43:42.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:42.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.125307+0000", 2024-04-01T19:43:42.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0098000000000001e-05 2024-04-01T19:43:42.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:42.254 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.125316+0000", 2024-04-01T19:43:42.254 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8200000000000003e-06 2024-04-01T19:43:42.254 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.254 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.254 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:42.254 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.137943+0000", 2024-04-01T19:43:42.254 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012626686 2024-04-01T19:43:42.254 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.255 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.255 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:42.255 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.138073+0000", 2024-04-01T19:43:42.255 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000130214 2024-04-01T19:43:42.255 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.255 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.255 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-01T19:43:42.255 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.138187+0000", 2024-04-01T19:43:42.255 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000113402 2024-04-01T19:43:42.255 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.255 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.255 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:42.255 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.155424+0000", 2024-04-01T19:43:42.255 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017237676 2024-04-01T19:43:42.255 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.256 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:42.256 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.321508+0000", 2024-04-01T19:43:42.256 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16608384500000001 2024-04-01T19:43:42.256 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.256 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:42.256 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.321559+0000", 2024-04-01T19:43:42.256 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0809000000000001e-05 2024-04-01T19:43:42.256 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.256 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:42.256 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.321606+0000", 2024-04-01T19:43:42.256 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6912000000000001e-05 2024-04-01T19:43:42.256 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.256 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:42.257 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.257 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.257 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:208063 4.9 4:92b559b5:::benchmark_data_smithi188_104537_object36069:head [delete] snapc 0=[] ondisk+write+known_if_redirected e320)", 2024-04-01T19:43:42.257 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:50.141351+0000", 2024-04-01T19:43:42.257 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 412.09104740399999, 2024-04-01T19:43:42.257 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.190232871, 2024-04-01T19:43:42.257 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:42.257 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:42.257 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:42.257 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:42.257 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:43:42.257 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:43:42.257 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 208063 2024-04-01T19:43:42.258 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.258 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:42.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.258 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:42.258 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.141351+0000", 2024-04-01T19:43:42.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.258 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.258 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:42.258 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.141351+0000", 2024-04-01T19:43:42.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.258 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.259 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:42.259 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.141353+0000", 2024-04-01T19:43:42.259 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9369999999999998e-06 2024-04-01T19:43:42.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.259 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.259 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:42.259 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.141358+0000", 2024-04-01T19:43:42.259 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8610000000000003e-06 2024-04-01T19:43:42.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.259 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.259 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:42.259 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.141377+0000", 2024-04-01T19:43:42.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8383e-05 2024-04-01T19:43:42.260 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.260 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.260 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:42.260 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.141385+0000", 2024-04-01T19:43:42.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6500000000000002e-06 2024-04-01T19:43:42.260 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.260 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.260 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:42.260 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.155554+0000", 2024-04-01T19:43:42.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014168373 2024-04-01T19:43:42.260 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.260 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.260 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:42.260 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.155670+0000", 2024-04-01T19:43:42.261 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000116434 2024-04-01T19:43:42.261 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.261 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.261 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-01T19:43:42.261 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.155778+0000", 2024-04-01T19:43:42.261 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000107864 2024-04-01T19:43:42.261 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.261 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.261 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:42.261 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.316643+0000", 2024-04-01T19:43:42.261 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16086519599999999 2024-04-01T19:43:42.261 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.261 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.262 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:42.262 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.331485+0000", 2024-04-01T19:43:42.262 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014841462999999999 2024-04-01T19:43:42.262 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.262 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.262 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:42.262 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.331539+0000", 2024-04-01T19:43:42.262 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4240999999999998e-05 2024-04-01T19:43:42.262 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.262 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.262 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:42.262 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.331583+0000", 2024-04-01T19:43:42.262 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4468999999999997e-05 2024-04-01T19:43:42.262 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.262 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:42.262 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.263 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.263 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:208064 4.9 4:9afa93c5:::benchmark_data_smithi188_104537_object36070:head [delete] snapc 0=[] ondisk+write+known_if_redirected e320)", 2024-04-01T19:43:42.263 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:50.141398+0000", 2024-04-01T19:43:42.263 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 412.09099977, 2024-04-01T19:43:42.263 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.19027006599999999, 2024-04-01T19:43:42.263 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:42.263 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:42.263 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:42.263 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:42.263 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:43:42.263 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:43:42.263 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 208064 2024-04-01T19:43:42.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.263 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:42.263 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.264 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:42.264 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.141398+0000", 2024-04-01T19:43:42.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.264 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.264 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:42.264 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.141398+0000", 2024-04-01T19:43:42.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.264 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.264 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:42.264 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.141399+0000", 2024-04-01T19:43:42.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9299999999999997e-07 2024-04-01T19:43:42.264 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:42.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.141402+0000", 2024-04-01T19:43:42.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.942e-06 2024-04-01T19:43:42.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.265 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:42.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.141408+0000", 2024-04-01T19:43:42.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9050000000000002e-06 2024-04-01T19:43:42.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.265 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:42.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.141413+0000", 2024-04-01T19:43:42.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4539999999999998e-06 2024-04-01T19:43:42.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.265 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:42.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.160848+0000", 2024-04-01T19:43:42.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019434679999999999 2024-04-01T19:43:42.266 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.266 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.266 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:42.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.160943+0000", 2024-04-01T19:43:42.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4841999999999998e-05 2024-04-01T19:43:42.266 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.266 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.266 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-01T19:43:42.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.161034+0000", 2024-04-01T19:43:42.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1428999999999995e-05 2024-04-01T19:43:42.266 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.266 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.266 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:42.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.316680+0000", 2024-04-01T19:43:42.267 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.15564567300000001 2024-04-01T19:43:42.267 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.267 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.267 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:42.267 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.331593+0000", 2024-04-01T19:43:42.267 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014912965 2024-04-01T19:43:42.267 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.267 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.267 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:42.267 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.331634+0000", 2024-04-01T19:43:42.267 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1031000000000001e-05 2024-04-01T19:43:42.267 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.268 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.268 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:42.268 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.331668+0000", 2024-04-01T19:43:42.268 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4351999999999999e-05 2024-04-01T19:43:42.268 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.268 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:42.268 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.268 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.268 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.268 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:208317 4.9 4:9ac99b3b:::benchmark_data_smithi188_104537_object36323:head [delete] snapc 0=[] ondisk+write+known_if_redirected e320)", 2024-04-01T19:43:42.268 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:50.752624+0000", 2024-04-01T19:43:42.268 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 411.47977391500001, 2024-04-01T19:43:42.268 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.19514612200000001, 2024-04-01T19:43:42.268 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:42.268 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:42.269 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:42.269 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:42.269 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:43:42.269 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:43:42.269 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 208317 2024-04-01T19:43:42.269 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.269 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:42.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.269 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:42.269 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.752624+0000", 2024-04-01T19:43:42.269 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.269 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.269 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:42.269 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.752624+0000", 2024-04-01T19:43:42.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.270 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.270 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:42.270 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.752626+0000", 2024-04-01T19:43:42.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9199999999999998e-06 2024-04-01T19:43:42.270 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.270 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:42.270 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.752631+0000", 2024-04-01T19:43:42.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4790000000000004e-06 2024-04-01T19:43:42.270 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.270 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:42.270 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.752641+0000", 2024-04-01T19:43:42.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9879999999999999e-06 2024-04-01T19:43:42.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:42.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.752649+0000", 2024-04-01T19:43:42.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3309999999999998e-06 2024-04-01T19:43:42.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:42.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.793955+0000", 2024-04-01T19:43:42.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041306465000000001 2024-04-01T19:43:42.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:42.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.794053+0000", 2024-04-01T19:43:42.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7882999999999998e-05 2024-04-01T19:43:42.272 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.272 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.272 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-01T19:43:42.272 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.794162+0000", 2024-04-01T19:43:42.272 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010841900000000001 2024-04-01T19:43:42.272 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.272 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.272 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:42.272 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.804348+0000", 2024-04-01T19:43:42.272 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010186176999999999 2024-04-01T19:43:42.272 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.272 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.272 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:42.272 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.947666+0000", 2024-04-01T19:43:42.272 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14331859899999999 2024-04-01T19:43:42.273 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.273 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.273 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:42.273 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.947724+0000", 2024-04-01T19:43:42.273 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7732999999999998e-05 2024-04-01T19:43:42.273 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.273 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.273 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:42.273 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:50.947770+0000", 2024-04-01T19:43:42.273 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6128000000000003e-05 2024-04-01T19:43:42.273 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.273 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:42.273 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.273 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.273 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.273 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:209977 4.1 4:8ec9d9d5:::benchmark_data_smithi188_104537_object37983:head [delete] snapc 0=[] ondisk+write+known_if_redirected e322)", 2024-04-01T19:43:42.274 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:53.851277+0000", 2024-04-01T19:43:42.274 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 408.38112087399998, 2024-04-01T19:43:42.274 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.22157722299999999, 2024-04-01T19:43:42.274 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:42.274 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:42.274 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:42.274 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:42.274 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:43:42.274 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:43:42.274 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 209977 2024-04-01T19:43:42.274 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.274 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:42.274 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:42.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.851277+0000", 2024-04-01T19:43:42.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:42.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.851277+0000", 2024-04-01T19:43:42.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:42.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.851278+0000", 2024-04-01T19:43:42.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.203e-06 2024-04-01T19:43:42.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:42.276 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.851283+0000", 2024-04-01T19:43:42.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7010000000000004e-06 2024-04-01T19:43:42.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:42.276 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.851290+0000", 2024-04-01T19:43:42.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1849999999999998e-06 2024-04-01T19:43:42.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:42.276 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.851296+0000", 2024-04-01T19:43:42.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2190000000000001e-06 2024-04-01T19:43:42.277 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.277 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.277 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:42.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.874237+0000", 2024-04-01T19:43:42.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022940283999999998 2024-04-01T19:43:42.277 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.277 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.277 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:42.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.874349+0000", 2024-04-01T19:43:42.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000112525 2024-04-01T19:43:42.277 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.277 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.277 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 5", 2024-04-01T19:43:42.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.874457+0000", 2024-04-01T19:43:42.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000107589 2024-04-01T19:43:42.278 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.278 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.278 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:42.278 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.879544+0000", 2024-04-01T19:43:42.278 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0050869280000000001 2024-04-01T19:43:42.278 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.278 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.278 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:42.278 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:54.072733+0000", 2024-04-01T19:43:42.278 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.19318964399999999 2024-04-01T19:43:42.278 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.278 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.278 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:42.278 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:54.072789+0000", 2024-04-01T19:43:42.279 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5541000000000002e-05 2024-04-01T19:43:42.279 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.279 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.279 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:42.279 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:54.072854+0000", 2024-04-01T19:43:42.279 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5403999999999999e-05 2024-04-01T19:43:42.279 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.279 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:42.279 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.279 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.279 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.279 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:209993 4.1 4:8b3547f4:::benchmark_data_smithi188_104537_object37999:head [delete] snapc 0=[] ondisk+write+known_if_redirected e322)", 2024-04-01T19:43:42.279 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:53.873501+0000", 2024-04-01T19:43:42.279 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 408.35889660200002, 2024-04-01T19:43:42.279 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.199461623, 2024-04-01T19:43:42.279 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:42.280 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:42.280 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:42.280 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:42.280 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:43:42.280 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:43:42.280 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 209993 2024-04-01T19:43:42.280 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.280 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:42.280 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.280 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:42.280 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.873501+0000", 2024-04-01T19:43:42.280 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.280 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.280 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.280 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:42.280 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.873501+0000", 2024-04-01T19:43:42.281 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.281 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.281 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.281 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:42.281 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.873503+0000", 2024-04-01T19:43:42.281 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8020000000000001e-06 2024-04-01T19:43:42.281 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.281 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.281 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:42.281 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.873509+0000", 2024-04-01T19:43:42.281 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.173e-06 2024-04-01T19:43:42.281 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.281 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.281 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:42.281 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.873520+0000", 2024-04-01T19:43:42.281 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0674e-05 2024-04-01T19:43:42.282 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.282 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.282 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:42.282 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.873528+0000", 2024-04-01T19:43:42.282 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6720000000000004e-06 2024-04-01T19:43:42.282 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.282 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.282 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:42.282 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.879575+0000", 2024-04-01T19:43:42.282 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060471359999999998 2024-04-01T19:43:42.282 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.282 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.282 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:42.282 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.879694+0000", 2024-04-01T19:43:42.282 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011883300000000001 2024-04-01T19:43:42.283 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.283 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.283 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 5", 2024-04-01T19:43:42.283 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:53.879806+0000", 2024-04-01T19:43:42.283 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000112539 2024-04-01T19:43:42.283 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.283 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.283 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:42.283 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:54.026828+0000", 2024-04-01T19:43:42.283 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14702155 2024-04-01T19:43:42.283 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.283 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.283 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:42.283 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:54.072868+0000", 2024-04-01T19:43:42.283 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.046040191000000001 2024-04-01T19:43:42.283 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.284 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.284 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:42.284 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:54.072913+0000", 2024-04-01T19:43:42.284 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5053999999999999e-05 2024-04-01T19:43:42.284 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.284 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.284 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:42.284 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:54.072963+0000", 2024-04-01T19:43:42.284 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9999e-05 2024-04-01T19:43:42.284 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.284 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:42.284 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.284 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.284 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.284 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:212237 4.1 4:8bf49f99:::benchmark_data_smithi188_104537_object40243:head [delete] snapc 0=[] ondisk+write+known_if_redirected e323)", 2024-04-01T19:43:42.285 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:57.853545+0000", 2024-04-01T19:43:42.285 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 404.37885324899997, 2024-04-01T19:43:42.285 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.207956684, 2024-04-01T19:43:42.285 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:42.285 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:42.285 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:42.285 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:42.285 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:43:42.285 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:43:42.285 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 212237 2024-04-01T19:43:42.285 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.285 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:42.285 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.285 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:42.285 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.853545+0000", 2024-04-01T19:43:42.286 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.286 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.286 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.286 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:42.286 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.853545+0000", 2024-04-01T19:43:42.286 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.286 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.286 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.286 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:42.286 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.853547+0000", 2024-04-01T19:43:42.286 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9889999999999999e-06 2024-04-01T19:43:42.286 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.286 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.286 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:42.287 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.853553+0000", 2024-04-01T19:43:42.287 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6540000000000002e-06 2024-04-01T19:43:42.287 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.287 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.287 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:42.287 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.853566+0000", 2024-04-01T19:43:42.287 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2802e-05 2024-04-01T19:43:42.287 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.287 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.287 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:42.287 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.853574+0000", 2024-04-01T19:43:42.287 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7270000000000007e-06 2024-04-01T19:43:42.287 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.287 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.287 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:42.288 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.864382+0000", 2024-04-01T19:43:42.288 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010808135999999999 2024-04-01T19:43:42.288 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.288 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.288 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:42.288 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.864484+0000", 2024-04-01T19:43:42.288 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000102074 2024-04-01T19:43:42.288 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.288 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.288 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 5", 2024-04-01T19:43:42.288 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.864588+0000", 2024-04-01T19:43:42.288 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000103638 2024-04-01T19:43:42.288 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.288 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.288 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:42.289 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.873687+0000", 2024-04-01T19:43:42.289 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0090992009999999995 2024-04-01T19:43:42.289 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.289 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.289 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:42.289 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.061376+0000", 2024-04-01T19:43:42.289 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18768897500000001 2024-04-01T19:43:42.289 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.289 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.289 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:42.289 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.061432+0000", 2024-04-01T19:43:42.289 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6459999999999998e-05 2024-04-01T19:43:42.289 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.289 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.290 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:42.290 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.061501+0000", 2024-04-01T19:43:42.290 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9028000000000004e-05 2024-04-01T19:43:42.290 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.290 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:42.290 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.290 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.290 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.290 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:212250 4.1 4:8195daf0:::benchmark_data_smithi188_104537_object40256:head [delete] snapc 0=[] ondisk+write+known_if_redirected e323)", 2024-04-01T19:43:42.290 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:57.863122+0000", 2024-04-01T19:43:42.290 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 404.36927630299999, 2024-04-01T19:43:42.290 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.19870327199999999, 2024-04-01T19:43:42.290 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:42.290 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:42.290 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:42.291 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:42.291 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:43:42.291 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:43:42.291 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 212250 2024-04-01T19:43:42.291 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.291 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:42.291 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.291 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:42.291 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.863122+0000", 2024-04-01T19:43:42.291 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.291 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.291 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.291 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:42.291 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.863122+0000", 2024-04-01T19:43:42.291 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.292 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.292 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.292 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:42.292 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.863123+0000", 2024-04-01T19:43:42.292 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.449e-06 2024-04-01T19:43:42.292 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.292 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.292 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:42.292 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.863128+0000", 2024-04-01T19:43:42.292 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1739999999999999e-06 2024-04-01T19:43:42.292 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.292 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.292 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:42.292 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.863140+0000", 2024-04-01T19:43:42.292 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1853e-05 2024-04-01T19:43:42.292 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.293 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.293 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:42.293 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.863148+0000", 2024-04-01T19:43:42.293 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1729999999999995e-06 2024-04-01T19:43:42.293 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.293 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.293 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:42.293 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.869139+0000", 2024-04-01T19:43:42.293 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005990736 2024-04-01T19:43:42.293 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.293 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.293 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:42.293 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.869277+0000", 2024-04-01T19:43:42.293 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013777700000000001 2024-04-01T19:43:42.293 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.293 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.294 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 5", 2024-04-01T19:43:42.294 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.869422+0000", 2024-04-01T19:43:42.294 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014546700000000001 2024-04-01T19:43:42.294 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.294 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.294 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:42.294 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.873864+0000", 2024-04-01T19:43:42.294 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0044419050000000003 2024-04-01T19:43:42.294 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.294 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.294 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:42.294 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.061729+0000", 2024-04-01T19:43:42.294 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18786441000000001 2024-04-01T19:43:42.295 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.295 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.295 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:42.295 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.061772+0000", 2024-04-01T19:43:42.295 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3096000000000002e-05 2024-04-01T19:43:42.295 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.295 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.295 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:42.295 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.061825+0000", 2024-04-01T19:43:42.295 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3232000000000001e-05 2024-04-01T19:43:42.295 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.295 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:42.296 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.296 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.296 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.296 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:212271 4.1 4:88226390:::benchmark_data_smithi188_104537_object40277:head [delete] snapc 0=[] ondisk+write+known_if_redirected e323)", 2024-04-01T19:43:42.296 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:57.897413+0000", 2024-04-01T19:43:42.296 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 404.334985319, 2024-04-01T19:43:42.296 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18474895899999999, 2024-04-01T19:43:42.296 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:42.296 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:42.296 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:42.296 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:42.296 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:43:42.297 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:43:42.297 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 212271 2024-04-01T19:43:42.297 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.297 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:42.297 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.297 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:42.297 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.897413+0000", 2024-04-01T19:43:42.297 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.297 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.297 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.297 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:42.297 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.897413+0000", 2024-04-01T19:43:42.297 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.297 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.298 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.298 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:42.298 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.897416+0000", 2024-04-01T19:43:42.298 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1669999999999999e-06 2024-04-01T19:43:42.298 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.298 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.298 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:42.298 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.897423+0000", 2024-04-01T19:43:42.298 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2019999999999998e-06 2024-04-01T19:43:42.298 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.298 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.298 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:42.298 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.956948+0000", 2024-04-01T19:43:42.299 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.059524588000000003 2024-04-01T19:43:42.299 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.299 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.299 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:42.299 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:57.956973+0000", 2024-04-01T19:43:42.299 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4961e-05 2024-04-01T19:43:42.299 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.299 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.299 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:42.299 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.063870+0000", 2024-04-01T19:43:42.299 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.10689742000000001 2024-04-01T19:43:42.299 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.299 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.300 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:42.300 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.063945+0000", 2024-04-01T19:43:42.300 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5326000000000004e-05 2024-04-01T19:43:42.300 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.300 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.300 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 5", 2024-04-01T19:43:42.300 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.064010+0000", 2024-04-01T19:43:42.300 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4789999999999995e-05 2024-04-01T19:43:42.300 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.300 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.300 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:42.300 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.072579+0000", 2024-04-01T19:43:42.300 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085689700000000004 2024-04-01T19:43:42.300 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.300 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.301 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:42.301 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.082046+0000", 2024-04-01T19:43:42.301 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0094665679999999999 2024-04-01T19:43:42.301 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.301 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.301 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:42.301 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.082103+0000", 2024-04-01T19:43:42.301 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6847e-05 2024-04-01T19:43:42.301 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.301 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.301 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:42.301 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.082162+0000", 2024-04-01T19:43:42.301 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9120000000000003e-05 2024-04-01T19:43:42.302 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.302 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:42.302 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.302 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.302 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.302 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:212506 4.9 4:9160a4a0:::benchmark_data_smithi188_104537_object40512:head [delete] snapc 0=[] ondisk+write+known_if_redirected e323)", 2024-04-01T19:43:42.302 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:58.361086+0000", 2024-04-01T19:43:42.302 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 403.87131175799999, 2024-04-01T19:43:42.302 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18223913799999999, 2024-04-01T19:43:42.302 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:42.302 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:42.302 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:42.302 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:42.302 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:43:42.303 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:43:42.303 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 212506 2024-04-01T19:43:42.303 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.303 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:42.303 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.303 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:42.303 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.361086+0000", 2024-04-01T19:43:42.303 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.303 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.303 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.303 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:42.303 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.361086+0000", 2024-04-01T19:43:42.303 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.303 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.303 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.303 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:42.304 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.361087+0000", 2024-04-01T19:43:42.304 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9699999999999995e-07 2024-04-01T19:43:42.304 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.304 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.304 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:42.304 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.361091+0000", 2024-04-01T19:43:42.304 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6720000000000002e-06 2024-04-01T19:43:42.304 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.304 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.304 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:42.304 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.361097+0000", 2024-04-01T19:43:42.304 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3790000000000003e-06 2024-04-01T19:43:42.304 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.304 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.304 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:42.304 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.361103+0000", 2024-04-01T19:43:42.305 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.913e-06 2024-04-01T19:43:42.305 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.305 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.305 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:42.305 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.522861+0000", 2024-04-01T19:43:42.305 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16175811700000001 2024-04-01T19:43:42.305 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.305 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.305 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:42.305 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.522976+0000", 2024-04-01T19:43:42.305 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000114938 2024-04-01T19:43:42.305 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.305 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.305 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-01T19:43:42.305 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.523095+0000", 2024-04-01T19:43:42.305 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011924700000000001 2024-04-01T19:43:42.306 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.306 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.306 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:42.306 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.533252+0000", 2024-04-01T19:43:42.306 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010156992 2024-04-01T19:43:42.306 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.306 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.306 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:42.306 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.543224+0000", 2024-04-01T19:43:42.306 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.009971967 2024-04-01T19:43:42.306 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.306 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.306 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:42.306 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.543272+0000", 2024-04-01T19:43:42.307 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7488999999999999e-05 2024-04-01T19:43:42.307 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.307 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.307 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:42.307 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.543325+0000", 2024-04-01T19:43:42.307 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3627e-05 2024-04-01T19:43:42.307 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.307 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:42.307 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.307 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.307 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.307 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25465.0:212507 4.9 4:95df974f:::benchmark_data_smithi188_104537_object40513:head [delete] snapc 0=[] ondisk+write+known_if_redirected e323)", 2024-04-01T19:43:42.307 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:36:58.361110+0000", 2024-04-01T19:43:42.308 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 403.87128810899998, 2024-04-01T19:43:42.308 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18230745200000001, 2024-04-01T19:43:42.308 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:42.308 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:42.308 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:42.308 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:42.308 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25465", 2024-04-01T19:43:42.308 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:43:42.308 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 212507 2024-04-01T19:43:42.308 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.308 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:42.308 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.308 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:42.309 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.361110+0000", 2024-04-01T19:43:42.309 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.309 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.309 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.309 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:42.309 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.361110+0000", 2024-04-01T19:43:42.309 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.309 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.309 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.309 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:42.309 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.361110+0000", 2024-04-01T19:43:42.309 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.13e-07 2024-04-01T19:43:42.309 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.310 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.310 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:42.310 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.361113+0000", 2024-04-01T19:43:42.310 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5299999999999999e-06 2024-04-01T19:43:42.310 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.310 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.310 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:42.310 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.361118+0000", 2024-04-01T19:43:42.310 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1460000000000004e-06 2024-04-01T19:43:42.310 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.310 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.310 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:42.310 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.361124+0000", 2024-04-01T19:43:42.310 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5389999999999998e-06 2024-04-01T19:43:42.310 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.311 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.311 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:42.311 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.528103+0000", 2024-04-01T19:43:42.311 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16697953300000001 2024-04-01T19:43:42.311 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.311 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.311 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:42.311 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.528229+0000", 2024-04-01T19:43:42.311 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012565800000000001 2024-04-01T19:43:42.311 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.311 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.311 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-01T19:43:42.311 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.528357+0000", 2024-04-01T19:43:42.311 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000127677 2024-04-01T19:43:42.311 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.311 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.312 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:42.312 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.533298+0000", 2024-04-01T19:43:42.312 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0049418099999999996 2024-04-01T19:43:42.312 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.312 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.312 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:42.312 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.543332+0000", 2024-04-01T19:43:42.312 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010033858 2024-04-01T19:43:42.312 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.312 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.312 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:42.312 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.543382+0000", 2024-04-01T19:43:42.312 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9534999999999999e-05 2024-04-01T19:43:42.312 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.312 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.312 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:42.313 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:36:58.543417+0000", 2024-04-01T19:43:42.313 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5553000000000003e-05 2024-04-01T19:43:42.313 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.313 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:42.313 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.313 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.313 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.313 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:116729 5.8 5:1c4d4d2d:::benchmark_data_smithi188_119427_object116728:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e389)", 2024-04-01T19:43:42.313 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:40:23.819558+0000", 2024-04-01T19:43:42.313 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 198.41283962700001, 2024-04-01T19:43:42.313 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.10192927, 2024-04-01T19:43:42.313 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:42.313 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:42.313 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:42.313 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:42.313 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:42.314 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:42.314 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 116729 2024-04-01T19:43:42.314 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.314 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:42.314 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.314 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:42.314 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.819558+0000", 2024-04-01T19:43:42.314 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.314 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.314 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.314 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:42.314 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.819558+0000", 2024-04-01T19:43:42.314 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.314 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.314 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.315 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:42.315 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.819560+0000", 2024-04-01T19:43:42.315 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7829999999999999e-06 2024-04-01T19:43:42.315 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.315 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.315 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:42.315 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.819594+0000", 2024-04-01T19:43:42.315 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3389000000000002e-05 2024-04-01T19:43:42.315 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.315 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.315 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:42.315 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835009+0000", 2024-04-01T19:43:42.315 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015415263 2024-04-01T19:43:42.315 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.315 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.315 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:42.316 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835021+0000", 2024-04-01T19:43:42.316 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2184999999999999e-05 2024-04-01T19:43:42.316 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.316 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.316 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:42.316 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.838708+0000", 2024-04-01T19:43:42.316 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036866720000000002 2024-04-01T19:43:42.316 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.316 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.316 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:42.316 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.838836+0000", 2024-04-01T19:43:42.316 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012849399999999999 2024-04-01T19:43:42.316 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.316 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.317 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:43:42.317 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.838930+0000", 2024-04-01T19:43:42.317 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3524999999999996e-05 2024-04-01T19:43:42.317 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.317 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.317 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:42.317 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.853237+0000", 2024-04-01T19:43:42.317 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014307507000000001 2024-04-01T19:43:42.317 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.317 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.317 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:42.317 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.921392+0000", 2024-04-01T19:43:42.317 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.068154369000000006 2024-04-01T19:43:42.317 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.318 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.318 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:42.318 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.921444+0000", 2024-04-01T19:43:42.318 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2904e-05 2024-04-01T19:43:42.318 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.318 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.318 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:42.318 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.921488+0000", 2024-04-01T19:43:42.318 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3179000000000001e-05 2024-04-01T19:43:42.318 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.318 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:42.318 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.318 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.318 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.319 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:116747 5.8 5:1d80d94e:::benchmark_data_smithi188_119427_object116746:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e389)", 2024-04-01T19:43:42.319 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:40:23.835174+0000", 2024-04-01T19:43:42.319 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 198.39722370699999, 2024-04-01T19:43:42.319 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.090182354000000006, 2024-04-01T19:43:42.319 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:42.319 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:42.319 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:42.319 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:42.319 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:42.319 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:42.319 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 116747 2024-04-01T19:43:42.319 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.319 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:42.319 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.320 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:42.320 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835174+0000", 2024-04-01T19:43:42.320 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.320 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.320 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.320 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:42.320 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835174+0000", 2024-04-01T19:43:42.320 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.320 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.320 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.320 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:42.320 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835175+0000", 2024-04-01T19:43:42.320 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3200000000000004e-07 2024-04-01T19:43:42.321 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.321 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.321 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:42.321 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835198+0000", 2024-04-01T19:43:42.321 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2858e-05 2024-04-01T19:43:42.321 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.321 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.321 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:42.321 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835204+0000", 2024-04-01T19:43:42.321 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9009999999999999e-06 2024-04-01T19:43:42.321 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.321 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.321 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:42.321 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835209+0000", 2024-04-01T19:43:42.322 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0359999999999997e-06 2024-04-01T19:43:42.322 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.322 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.322 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:42.322 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.848849+0000", 2024-04-01T19:43:42.322 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013640462000000001 2024-04-01T19:43:42.322 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.322 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.322 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:42.322 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.848965+0000", 2024-04-01T19:43:42.322 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011550200000000001 2024-04-01T19:43:42.322 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.322 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.322 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:43:42.322 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.849058+0000", 2024-04-01T19:43:42.323 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3420999999999999e-05 2024-04-01T19:43:42.323 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.323 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.323 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:42.323 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.853248+0000", 2024-04-01T19:43:42.323 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0041897749999999997 2024-04-01T19:43:42.323 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.323 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.323 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:42.323 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.925253+0000", 2024-04-01T19:43:42.323 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.072004519000000003 2024-04-01T19:43:42.323 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.323 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.323 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:42.323 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.925309+0000", 2024-04-01T19:43:42.324 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6609e-05 2024-04-01T19:43:42.324 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.324 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.324 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:42.324 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.925357+0000", 2024-04-01T19:43:42.324 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7438999999999998e-05 2024-04-01T19:43:42.324 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.324 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:42.324 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.324 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.324 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.324 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:116748 5.8 5:1beff7ec:::benchmark_data_smithi188_119427_object116747:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e389)", 2024-04-01T19:43:42.324 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:40:23.835216+0000", 2024-04-01T19:43:42.324 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 198.39718221000001, 2024-04-01T19:43:42.324 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.090258440999999995, 2024-04-01T19:43:42.324 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:42.325 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:42.325 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:42.325 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:42.325 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:42.325 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:42.325 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 116748 2024-04-01T19:43:42.325 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.325 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:42.325 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.325 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:42.325 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835216+0000", 2024-04-01T19:43:42.325 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.325 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.325 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.325 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:42.325 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835216+0000", 2024-04-01T19:43:42.326 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.326 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.326 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.326 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:42.326 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835216+0000", 2024-04-01T19:43:42.326 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8400000000000004e-07 2024-04-01T19:43:42.326 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.326 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.326 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:42.326 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835241+0000", 2024-04-01T19:43:42.326 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4647999999999998e-05 2024-04-01T19:43:42.326 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.326 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.326 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:42.327 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835248+0000", 2024-04-01T19:43:42.327 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4989999999999999e-06 2024-04-01T19:43:42.327 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.327 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.327 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:42.327 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835253+0000", 2024-04-01T19:43:42.327 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6420000000000004e-06 2024-04-01T19:43:42.327 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.327 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.327 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:42.327 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.851232+0000", 2024-04-01T19:43:42.327 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015978414999999999 2024-04-01T19:43:42.327 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.327 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.328 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:42.328 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.851306+0000", 2024-04-01T19:43:42.328 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4301999999999994e-05 2024-04-01T19:43:42.328 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.328 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.328 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:43:42.328 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.851397+0000", 2024-04-01T19:43:42.328 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0879999999999997e-05 2024-04-01T19:43:42.328 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.328 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.328 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:42.328 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.855437+0000", 2024-04-01T19:43:42.328 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040398450000000002 2024-04-01T19:43:42.329 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.329 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.329 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:42.329 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.925395+0000", 2024-04-01T19:43:42.329 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.069958713000000006 2024-04-01T19:43:42.329 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.329 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.329 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:42.329 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.925436+0000", 2024-04-01T19:43:42.329 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1028000000000001e-05 2024-04-01T19:43:42.329 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.329 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.329 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:42.329 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.925474+0000", 2024-04-01T19:43:42.329 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7784999999999998e-05 2024-04-01T19:43:42.330 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.330 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:42.330 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.330 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.330 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.330 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:120827 5.8 5:1550fc16:::benchmark_data_smithi188_119427_object120826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e389)", 2024-04-01T19:43:42.330 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:40:26.691921+0000", 2024-04-01T19:43:42.330 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 195.54047695700001, 2024-04-01T19:43:42.330 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.087931033000000006, 2024-04-01T19:43:42.330 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:42.330 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:42.330 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:42.330 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:42.330 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:42.330 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:42.330 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 120827 2024-04-01T19:43:42.331 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.331 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:42.331 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.331 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:42.331 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.691921+0000", 2024-04-01T19:43:42.331 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.331 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.331 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.331 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:42.331 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.691921+0000", 2024-04-01T19:43:42.331 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.331 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.331 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.331 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:42.331 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.691922+0000", 2024-04-01T19:43:42.332 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3829999999999999e-06 2024-04-01T19:43:42.332 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.332 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.332 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:42.332 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.691946+0000", 2024-04-01T19:43:42.332 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3646999999999999e-05 2024-04-01T19:43:42.332 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.332 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.332 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:42.332 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.691961+0000", 2024-04-01T19:43:42.332 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4664999999999999e-05 2024-04-01T19:43:42.332 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.332 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.332 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:42.332 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.691967+0000", 2024-04-01T19:43:42.332 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3729999999999998e-06 2024-04-01T19:43:42.333 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.333 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.333 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:42.333 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.692025+0000", 2024-04-01T19:43:42.333 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8233999999999998e-05 2024-04-01T19:43:42.333 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.333 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.333 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:42.333 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.692153+0000", 2024-04-01T19:43:42.333 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012784499999999999 2024-04-01T19:43:42.333 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.333 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.333 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:43:42.333 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.692284+0000", 2024-04-01T19:43:42.333 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013041100000000001 2024-04-01T19:43:42.333 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.334 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.334 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:42.334 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.695616+0000", 2024-04-01T19:43:42.334 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0033320450000000001 2024-04-01T19:43:42.334 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.334 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.334 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:42.334 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.779778+0000", 2024-04-01T19:43:42.334 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.084162429999999996 2024-04-01T19:43:42.334 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.334 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.334 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:42.334 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.779810+0000", 2024-04-01T19:43:42.335 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2104000000000003e-05 2024-04-01T19:43:42.335 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.335 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.335 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:42.335 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.779852+0000", 2024-04-01T19:43:42.335 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1896e-05 2024-04-01T19:43:42.335 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.335 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:42.335 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.335 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.335 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.335 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:238402 5.d 5:b3830024:::benchmark_data_smithi188_119427_object73703:head [delete] snapc 0=[] ondisk+write+known_if_redirected e438)", 2024-04-01T19:43:42.335 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:47.431109+0000", 2024-04-01T19:43:42.335 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 54.801289314000002, 2024-04-01T19:43:42.336 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.10615174199999999, 2024-04-01T19:43:42.336 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:42.336 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:42.336 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:42.336 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:42.336 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:42.336 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:42.336 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 238402 2024-04-01T19:43:42.336 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.336 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:42.336 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.336 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:42.336 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431109+0000", 2024-04-01T19:43:42.336 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.336 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.336 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.337 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:42.337 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431109+0000", 2024-04-01T19:43:42.337 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.337 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.337 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.337 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:42.337 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431110+0000", 2024-04-01T19:43:42.337 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9800000000000002e-07 2024-04-01T19:43:42.337 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.337 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.337 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:42.337 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431113+0000", 2024-04-01T19:43:42.337 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.675e-06 2024-04-01T19:43:42.337 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.337 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.337 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:42.338 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431122+0000", 2024-04-01T19:43:42.338 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6540000000000005e-06 2024-04-01T19:43:42.338 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.338 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.338 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:42.338 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431128+0000", 2024-04-01T19:43:42.338 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7239999999999997e-06 2024-04-01T19:43:42.338 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.338 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.338 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:42.338 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431182+0000", 2024-04-01T19:43:42.338 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4440000000000001e-05 2024-04-01T19:43:42.338 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.338 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.339 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:42.339 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431312+0000", 2024-04-01T19:43:42.339 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013003900000000001 2024-04-01T19:43:42.339 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.339 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.339 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 5", 2024-04-01T19:43:42.339 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431448+0000", 2024-04-01T19:43:42.339 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000136203 2024-04-01T19:43:42.339 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.339 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.339 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:42.339 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.435486+0000", 2024-04-01T19:43:42.339 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040374959999999998 2024-04-01T19:43:42.339 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.340 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.340 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:42.340 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.537169+0000", 2024-04-01T19:43:42.340 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.101683517 2024-04-01T19:43:42.340 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.340 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.340 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:42.340 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.537205+0000", 2024-04-01T19:43:42.340 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5367999999999997e-05 2024-04-01T19:43:42.340 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.340 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.340 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:42.340 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.537260+0000", 2024-04-01T19:43:42.340 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5627999999999997e-05 2024-04-01T19:43:42.340 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.341 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:42.341 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.341 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.341 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.341 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:279781 5.8 5:1435bdde:::benchmark_data_smithi188_119427_object115082:head [delete] snapc 0=[] ondisk+write+known_if_redirected e445)", 2024-04-01T19:43:42.341 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:43:27.311434+0000", 2024-04-01T19:43:42.341 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 14.920964262, 2024-04-01T19:43:42.341 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.087482134000000003, 2024-04-01T19:43:42.341 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:43:42.341 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:43:42.341 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:43:42.341 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:43:42.341 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:43:42.341 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:42.341 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 279781 2024-04-01T19:43:42.342 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.342 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:43:42.342 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.342 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:43:42.342 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.311434+0000", 2024-04-01T19:43:42.342 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.342 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.342 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.342 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:43:42.342 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.311434+0000", 2024-04-01T19:43:42.342 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:43:42.342 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.342 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.342 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:43:42.342 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.311436+0000", 2024-04-01T19:43:42.343 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3240000000000001e-06 2024-04-01T19:43:42.343 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.343 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.343 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:43:42.343 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.311441+0000", 2024-04-01T19:43:42.343 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2000000000000002e-06 2024-04-01T19:43:42.343 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.343 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.343 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:43:42.343 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.311451+0000", 2024-04-01T19:43:42.343 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9000000000000001e-06 2024-04-01T19:43:42.343 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.343 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.343 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:43:42.343 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.311459+0000", 2024-04-01T19:43:42.344 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0919999999999998e-06 2024-04-01T19:43:42.344 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.344 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.344 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:43:42.344 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.311520+0000", 2024-04-01T19:43:42.344 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0652999999999997e-05 2024-04-01T19:43:42.344 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.344 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.344 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:43:42.344 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.311617+0000", 2024-04-01T19:43:42.344 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7138000000000004e-05 2024-04-01T19:43:42.344 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.344 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.344 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:43:42.344 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.312271+0000", 2024-04-01T19:43:42.344 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00065370999999999995 2024-04-01T19:43:42.345 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.345 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.345 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:43:42.345 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.319528+0000", 2024-04-01T19:43:42.345 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072574969999999999 2024-04-01T19:43:42.345 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.345 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.345 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:43:42.345 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.398857+0000", 2024-04-01T19:43:42.345 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.079329203000000001 2024-04-01T19:43:42.345 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.345 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.345 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:43:42.345 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.398889+0000", 2024-04-01T19:43:42.345 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1189000000000002e-05 2024-04-01T19:43:42.346 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:43:42.346 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:43:42.346 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:43:42.346 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.398916+0000", 2024-04-01T19:43:42.346 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7228000000000001e-05 2024-04-01T19:43:42.346 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.346 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:42.346 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.346 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:43:42.346 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:43:42.346 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:43:42.346 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:43:42.375 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:42.398 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:43:42.402 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:42.403 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:43:42.457 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:43:42.491 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:43:42.503 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:43:42.531 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:43:42.568 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:43:42.570 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:42.616 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:43:42.648 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:43:42.688 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:43:42.719 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:43:42.752 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:43:42.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:42 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/788925733' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:43:42.782 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:43:42.808 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:43:42.814 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:42.814 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:42 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/788925733' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:43:42.815 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:43:42.820 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:43:42.873 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:43:42.873 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:43:42.873 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:43:42.873 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:43:42.873 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:43:42.874 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:43:42.874 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:43:42.874 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:43:42.874 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:43:42.874 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:43:42.874 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:43:42.874 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:43:42.874 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:43:42.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:42 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/788925733' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:43:42.916 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:43:42.948 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:42.990 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:43:42.998 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:42.998 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:43:43.033 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_ops_in_flight 2024-04-01T19:43:43.099 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:43:43.131 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:43.154 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:43:43.159 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:43.159 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:43:43.260 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:43:43.306 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:43.327 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:43:43.331 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:43.332 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:43:43.419 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:43:43.433 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:43:43.476 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:43.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:43.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:43.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:43.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:43.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:43.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:43.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:43.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:43.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:43.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:43 smithi022 ceph-mon[39439]: pgmap v1256: 17 pgs: 17 active+clean; 2.1 GiB data, 8.1 GiB used, 886 GiB / 894 GiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:43:43.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:43.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:43.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:43.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:43.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:43.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:43.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:43.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:43.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:43.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:43 smithi188 ceph-mon[43939]: pgmap v1256: 17 pgs: 17 active+clean; 2.1 GiB data, 8.1 GiB used, 886 GiB / 894 GiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:43:43.733 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:43:43.741 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:43.742 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:43:43.843 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:43:43.909 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:44.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:44.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:44.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:44.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:44.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:44.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:44.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:44.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:44.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:44.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:43 smithi062 ceph-mon[44211]: pgmap v1256: 17 pgs: 17 active+clean; 2.1 GiB data, 8.1 GiB used, 886 GiB / 894 GiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:43:44.528 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:43:44.529 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:43:44.732 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:43:44.738 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:44.739 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:44 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:44.739 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:44 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:44.739 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:43:44.792 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:44 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:44.792 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:44 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:44.841 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:43:44.879 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:45.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:44 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:45.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:44 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:45.136 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:43:45.139 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:45.139 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:43:45.240 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:43:45.271 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:45.475 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:43:45.478 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:45.479 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:43:45.495 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:43:45.495 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:43:45.550 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:43:45.580 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:43:45.637 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:45.810 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:43:45.821 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:45.821 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:43:45.821 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:45 smithi022 ceph-mon[39439]: pgmap v1257: 17 pgs: 17 active+clean; 2.0 GiB data, 7.9 GiB used, 886 GiB / 894 GiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:43:45.822 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:45 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3776402724' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:43:45.822 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:45 smithi022 ceph-mon[39439]: from='client.26191 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:43:45.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:45 smithi188 ceph-mon[43939]: pgmap v1257: 17 pgs: 17 active+clean; 2.0 GiB data, 7.9 GiB used, 886 GiB / 894 GiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:43:45.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:45 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3776402724' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:43:45.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:45 smithi188 ceph-mon[43939]: from='client.26191 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:43:45.922 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:43:45.960 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:46.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:45 smithi062 ceph-mon[44211]: pgmap v1257: 17 pgs: 17 active+clean; 2.0 GiB data, 7.9 GiB used, 886 GiB / 894 GiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:43:46.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:45 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3776402724' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:43:46.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:45 smithi062 ceph-mon[44211]: from='client.26191 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:43:46.297 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:43:46.301 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:46.302 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:43:46.326 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_blocked_ops 2024-04-01T19:43:46.403 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:43:46.446 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:46.471 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:43:46.478 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:46.478 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:43:46.530 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:43:46.579 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:43:46.650 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:46.684 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:43:46.687 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:46.688 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:43:46.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:46 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:43:46.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:46 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:43:46.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:46 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:43:46.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:46 smithi022 ceph-mon[39439]: from='client.26191 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:43:46.691 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:46 smithi022 ceph-mon[39439]: osdmap e451: 12 total, 11 up, 10 in 2024-04-01T19:43:46.720 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:43:46.789 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:43:46.818 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:46 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:43:46.896 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:46 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:43:46.896 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:46 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:43:46.896 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:46 smithi188 ceph-mon[43939]: from='client.26191 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:43:46.896 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:46 smithi188 ceph-mon[43939]: osdmap e451: 12 total, 11 up, 10 in 2024-04-01T19:43:46.897 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:46.982 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:43:47.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:46 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:43:47.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:46 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:43:47.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:46 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:43:47.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:46 smithi062 ceph-mon[44211]: from='client.26191 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:43:47.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:46 smithi062 ceph-mon[44211]: osdmap e451: 12 total, 11 up, 10 in 2024-04-01T19:43:47.027 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:43:47.030 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:47.031 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:43:47.131 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:43:47.164 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:47.239 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:43:47.242 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:47.242 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:43:47.343 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:43:47.377 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:47.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:47 smithi022 ceph-mon[39439]: pgmap v1259: 17 pgs: 17 active+clean; 1.8 GiB data, 7.5 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 1.29k op/s 2024-04-01T19:43:47.635 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:43:47.645 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:47.646 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:43:47.746 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:43:47.780 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:47.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:47 smithi188 ceph-mon[43939]: pgmap v1259: 17 pgs: 17 active+clean; 1.8 GiB data, 7.5 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 1.29k op/s 2024-04-01T19:43:48.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:47 smithi062 ceph-mon[44211]: pgmap v1259: 17 pgs: 17 active+clean; 1.8 GiB data, 7.5 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 1.29k op/s 2024-04-01T19:43:48.141 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:43:48.146 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:48.147 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:43:48.247 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:43:48.307 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:48.437 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:43:48.665 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:43:48.679 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:48.679 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:43:48.780 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:43:48.813 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:48.842 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:43:48.845 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:48.845 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:43:48.848 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:43:48.848 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:43:48.946 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:43:48.986 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:49.009 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:43:49.012 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:49.012 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:43:49.113 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:43:49.145 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:49.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:49 smithi062 ceph-mon[44211]: pgmap v1260: 17 pgs: 17 active+clean; 1.7 GiB data, 7.3 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:43:49.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:49 smithi022 ceph-mon[39439]: pgmap v1260: 17 pgs: 17 active+clean; 1.7 GiB data, 7.3 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:43:49.489 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:43:49.505 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:43:49.543 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:43:49.581 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:49 smithi188 ceph-mon[43939]: pgmap v1260: 17 pgs: 17 active+clean; 1.7 GiB data, 7.3 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:43:49.592 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:43:49.605 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:43:49.609 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:49.610 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:43:49.620 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_historic_ops 2024-04-01T19:43:49.626 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:43:49.672 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:43:49.701 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:43:49.710 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:43:49.737 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:43:49.743 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:49.768 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:43:49.770 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:43:49.775 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:49.776 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:43:49.824 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:43:49.861 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:43:49.877 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:43:49.894 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:43:49.895 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:43:49.895 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:43:49.895 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:43:49.895 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:43:49.895 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:43:49.895 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:43:49.895 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:43:49.895 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:43:49.895 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:43:49.895 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:43:49.895 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:43:49.896 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:43:49.909 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:49.941 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:43:49.946 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:49.947 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:43:50.006 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:43:50.048 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:43:50.087 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:50.108 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:43:50.112 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:50.112 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:43:50.176 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:50 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/352722797' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:43:50.176 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:50.213 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:43:50.300 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:50.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:50 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/352722797' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:43:50.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:50.566 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:43:50.569 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:50.569 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:43:50.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:50 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/352722797' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:43:50.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:50.670 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:43:50.705 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:51 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:51 smithi188 ceph-mon[43939]: pgmap v1261: 17 pgs: 17 active+clean; 1.5 GiB data, 7.0 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:43:51.476 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:43:51.480 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:51.481 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:43:51.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:51 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:51 smithi062 ceph-mon[44211]: pgmap v1261: 17 pgs: 17 active+clean; 1.5 GiB data, 7.0 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:43:51.582 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:43:51.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:51 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:43:51.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:51 smithi022 ceph-mon[39439]: pgmap v1261: 17 pgs: 17 active+clean; 1.5 GiB data, 7.0 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:43:51.614 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:51.657 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:43:51.657 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:43:51.866 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:43:51.870 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:51.870 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:43:51.971 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:43:52.007 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:52.171 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:43:52.175 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:52.176 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:43:52.187 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:43:52.187 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:43:52.187 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:43:52.187 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [] 2024-04-01T19:43:52.188 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:43:52.276 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:43:52.351 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:52.386 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:43:52.393 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:52.394 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:43:52.495 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:43:52.529 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:52.591 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:43:52.600 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:52.600 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:43:52.645 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:43:52.701 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:43:52.770 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:52.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:52 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2055965121' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:43:52.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:52 smithi188 ceph-mon[43939]: from='client.26197 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:43:52.919 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:43:52.928 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:52.928 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:52 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2055965121' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:43:52.928 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:52 smithi022 ceph-mon[39439]: from='client.26197 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:43:52.929 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:43:53.006 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_ops_in_flight 2024-04-01T19:43:53.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:52 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2055965121' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:43:53.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:52 smithi062 ceph-mon[44211]: from='client.26197 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:43:53.029 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:43:53.123 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:53.658 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:43:54.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:53 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:43:54.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:53 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:43:54.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:53 smithi062 ceph-mon[44211]: from='client.26197 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:43:54.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:53 smithi062 ceph-mon[44211]: osdmap e452: 12 total, 11 up, 10 in 2024-04-01T19:43:54.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:53 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:43:54.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:53 smithi062 ceph-mon[44211]: pgmap v1263: 17 pgs: 17 active+clean; 1.4 GiB data, 6.7 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 1.36k op/s 2024-04-01T19:43:54.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:53 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:43:54.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:53 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:43:54.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:53 smithi022 ceph-mon[39439]: from='client.26197 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:43:54.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:53 smithi022 ceph-mon[39439]: osdmap e452: 12 total, 11 up, 10 in 2024-04-01T19:43:54.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:53 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:43:54.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:53 smithi022 ceph-mon[39439]: pgmap v1263: 17 pgs: 17 active+clean; 1.4 GiB data, 6.7 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 1.36k op/s 2024-04-01T19:43:54.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:53 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:43:54.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:53 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:43:54.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:53 smithi188 ceph-mon[43939]: from='client.26197 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:43:54.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:53 smithi188 ceph-mon[43939]: osdmap e452: 12 total, 11 up, 10 in 2024-04-01T19:43:54.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:53 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:43:54.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:53 smithi188 ceph-mon[43939]: pgmap v1263: 17 pgs: 17 active+clean; 1.4 GiB data, 6.7 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 1.36k op/s 2024-04-01T19:43:55.159 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:43:55.167 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:43:55.236 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:43:55.293 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:55.293 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:43:55.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:55 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:43:55.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:55 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:43:55.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:55 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:43:55.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:55 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:43:55.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:55 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:43:55.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:55 smithi022 ceph-mon[39439]: pgmap v1264: 17 pgs: 17 active+clean; 1.3 GiB data, 6.6 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:43:55.394 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:43:55.425 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:55.445 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:43:55.447 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:55.447 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:43:55.549 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:43:55.576 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:55 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:43:55.577 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:55 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:43:55.577 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:55 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:43:55.577 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:55 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:43:55.577 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:55 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:43:55.577 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:55 smithi188 ceph-mon[43939]: pgmap v1264: 17 pgs: 17 active+clean; 1.3 GiB data, 6.6 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:43:55.579 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:55.603 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:43:55.608 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:55.608 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:43:55.709 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:43:55.739 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:55.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:55 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:43:55.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:55 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:43:55.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:55 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:43:55.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:55 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:43:55.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:55 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:43:55.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:55 smithi062 ceph-mon[44211]: pgmap v1264: 17 pgs: 17 active+clean; 1.3 GiB data, 6.6 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:43:55.773 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:43:55.779 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:55.780 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:43:55.881 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:43:55.922 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:55.955 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:43:55.958 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:55.958 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:43:56.059 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:43:56.125 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:56.158 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:43:56.162 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:56.162 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:43:56.263 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:43:56.300 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:56.319 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:43:56.322 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:56.322 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:43:56.423 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:43:56.460 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:56 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T19:43:56.460 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:56 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T19:43:56.460 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:56 smithi022 ceph-mon[39439]: 5.0 scrub starts 2024-04-01T19:43:56.460 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:56 smithi022 ceph-mon[39439]: 5.0 scrub ok 2024-04-01T19:43:56.490 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:56.577 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:43:56.592 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:56.592 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:43:56.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:56 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T19:43:56.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:56 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T19:43:56.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:56 smithi188 ceph-mon[43939]: 5.0 scrub starts 2024-04-01T19:43:56.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:56 smithi188 ceph-mon[43939]: 5.0 scrub ok 2024-04-01T19:43:56.693 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:43:56.725 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:56.747 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:43:56.751 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:56.751 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:43:56.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:56 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T19:43:56.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:56 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T19:43:56.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:56 smithi062 ceph-mon[44211]: 5.0 scrub starts 2024-04-01T19:43:56.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:56 smithi062 ceph-mon[44211]: 5.0 scrub ok 2024-04-01T19:43:56.852 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:43:56.915 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:57.029 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:43:57.039 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:57.039 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:43:57.125 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:43:57.139 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:43:57.172 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:57.195 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:43:57.200 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:57.201 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:43:57.240 INFO:tasks.thrashosds.thrasher:Reviving osd 6 2024-04-01T19:43:57.240 INFO:tasks.cephadm.osd.6:Restarting osd.6 (starting--it wasn't running)... 2024-04-01T19:43:57.240 DEBUG:teuthology.orchestra.run.smithi062:osd.6> sudo journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.6.service 2024-04-01T19:43:57.242 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl start ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.6 2024-04-01T19:43:57.274 INFO:journalctl@ceph.osd.6.smithi062.stdout:-- Logs begin at Mon 2024-04-01 19:04:11 UTC. -- 2024-04-01T19:43:57.301 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:43:57.395 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:57.498 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:57 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:43:57.498 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:57 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:43:57.498 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:57 smithi022 ceph-mon[39439]: pgmap v1265: 17 pgs: 17 active+clean; 1.0 GiB data, 6.1 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:43:57.518 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:43:57.523 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:57.523 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:43:57.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:57 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:43:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:57 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:43:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:57 smithi188 ceph-mon[43939]: pgmap v1265: 17 pgs: 17 active+clean; 1.0 GiB data, 6.1 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:43:57.624 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:43:57.656 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:57.679 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:43:57.683 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:57.684 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:43:57.754 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:57 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:43:57.754 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:57 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:43:57.754 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:57 smithi062 ceph-mon[44211]: pgmap v1265: 17 pgs: 17 active+clean; 1.0 GiB data, 6.1 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:43:57.755 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:43:57 smithi062 systemd[1]: Starting Ceph osd.6 for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T19:43:57.784 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:43:57.817 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:57.887 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:43:57.894 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:57.895 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:43:57.996 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:43:58.023 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:58.057 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:43:58.062 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:58.062 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:43:58.163 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:43:58.213 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:58.246 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:43:58.252 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:58.253 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:43:58.354 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:43:58.382 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:58.405 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:43:58.410 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:58.411 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:43:58.440 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:58 smithi022 ceph-mon[39439]: osdmap e453: 12 total, 11 up, 10 in 2024-04-01T19:43:58.485 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:58 smithi062 ceph-mon[44211]: osdmap e453: 12 total, 11 up, 10 in 2024-04-01T19:43:58.511 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:43:58.560 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:58.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:58 smithi188 ceph-mon[43939]: osdmap e453: 12 total, 11 up, 10 in 2024-04-01T19:43:58.760 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:43:58 smithi062 bash[135361]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-01T19:43:58.760 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:43:58 smithi062 bash[135361]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-01T19:43:58.760 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:43:58 smithi062 bash[135361]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-01T19:43:58.760 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:43:58 smithi062 bash[135361]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-01T19:43:58.760 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:43:58 smithi062 bash[135361]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-04-01T19:43:58.761 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:43:58 smithi062 bash[135361]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-01T19:43:58.761 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:43:58 smithi062 bash[135361]: --> ceph-volume raw activate successful for osd ID: 6 2024-04-01T19:43:58.816 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:43:58.821 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:58.821 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:43:58.922 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:43:59.016 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:59.050 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:43:59.056 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:59.057 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:43:59.110 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:43:59.110 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:43:59.111 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.111 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:316582 5.b e453/364 5:dece3e71:::benchmark_data_smithi188_119427_object151883:head v 453'19731, mlcod=453'19729)", 2024-04-01T19:43:59.111 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:59.107886+0000", 2024-04-01T19:43:59.111 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0035841670000000001, 2024-04-01T19:43:59.111 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0036132009999999999, 2024-04-01T19:43:59.111 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:43:59.111 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:43:59.111 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:43:59.111 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:43:59.111 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.111 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:43:59.111 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.107886+0000", 2024-04-01T19:43:59.111 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:43:59.111 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.112 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.112 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:43:59.112 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.107886+0000", 2024-04-01T19:43:59.112 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:43:59.112 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.112 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.112 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:43:59.112 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.107887+0000", 2024-04-01T19:43:59.112 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2399999999999998e-07 2024-04-01T19:43:59.112 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.112 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.112 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:43:59.112 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.107891+0000", 2024-04-01T19:43:59.112 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4390000000000002e-06 2024-04-01T19:43:59.112 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.113 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.113 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:43:59.113 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.107897+0000", 2024-04-01T19:43:59.113 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0730000000000001e-06 2024-04-01T19:43:59.113 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.113 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.113 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:43:59.113 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.107902+0000", 2024-04-01T19:43:59.113 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6580000000000001e-06 2024-04-01T19:43:59.113 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.113 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.113 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:43:59.113 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.110629+0000", 2024-04-01T19:43:59.113 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0027270369999999999 2024-04-01T19:43:59.113 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.114 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.114 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:43:59.114 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.110647+0000", 2024-04-01T19:43:59.114 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8121000000000001e-05 2024-04-01T19:43:59.114 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:43:59.114 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:43:59.114 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:43:59.114 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.114 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.114 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:316584 5.5 5:ae500474:::benchmark_data_smithi188_119427_object151885:head [delete] snapc 0=[] ondisk+write+known_if_redirected e453)", 2024-04-01T19:43:59.114 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:59.108998+0000", 2024-04-01T19:43:59.114 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0024724759999999999, 2024-04-01T19:43:59.114 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00257924, 2024-04-01T19:43:59.114 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:43:59.115 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:43:59.115 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:43:59.115 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:43:59.115 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:43:59.115 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:59.115 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 316584 2024-04-01T19:43:59.115 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.115 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:43:59.115 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.115 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:43:59.115 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.108998+0000", 2024-04-01T19:43:59.115 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:43:59.115 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.115 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.115 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:43:59.116 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.108998+0000", 2024-04-01T19:43:59.116 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:43:59.116 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.116 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.116 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:43:59.116 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.109000+0000", 2024-04-01T19:43:59.116 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9690000000000001e-06 2024-04-01T19:43:59.116 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.116 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.116 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:43:59.116 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.109006+0000", 2024-04-01T19:43:59.116 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.083e-06 2024-04-01T19:43:59.116 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.117 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.117 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:43:59.117 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.109016+0000", 2024-04-01T19:43:59.117 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0468e-05 2024-04-01T19:43:59.117 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.117 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.117 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:43:59.117 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.109023+0000", 2024-04-01T19:43:59.117 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8390000000000001e-06 2024-04-01T19:43:59.117 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.117 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.117 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:43:59.117 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.111010+0000", 2024-04-01T19:43:59.117 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0019867169999999998 2024-04-01T19:43:59.118 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.118 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.118 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:43:59.118 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.111133+0000", 2024-04-01T19:43:59.118 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012311200000000001 2024-04-01T19:43:59.118 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.118 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.118 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 1", 2024-04-01T19:43:59.118 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.111253+0000", 2024-04-01T19:43:59.118 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000120004 2024-04-01T19:43:59.118 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:43:59.119 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:43:59.119 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:43:59.119 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.119 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.119 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:316569 5.2 5:470df068:::benchmark_data_smithi188_119427_object151870:head [delete] snapc 0=[] ondisk+write+known_if_redirected e453)", 2024-04-01T19:43:59.119 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:59.095546+0000", 2024-04-01T19:43:59.119 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.015923911999999998, 2024-04-01T19:43:59.119 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.016111164000000001, 2024-04-01T19:43:59.119 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:43:59.119 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:43:59.119 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:43:59.119 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:43:59.119 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:43:59.119 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:59.120 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 316569 2024-04-01T19:43:59.120 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.120 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:43:59.120 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.120 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:43:59.120 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.095546+0000", 2024-04-01T19:43:59.120 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:43:59.120 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.120 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.120 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:43:59.120 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.095546+0000", 2024-04-01T19:43:59.120 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:43:59.120 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.121 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.121 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:43:59.121 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.095549+0000", 2024-04-01T19:43:59.121 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.17e-06 2024-04-01T19:43:59.121 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.121 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.121 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:43:59.121 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.095554+0000", 2024-04-01T19:43:59.121 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6849999999999998e-06 2024-04-01T19:43:59.121 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.121 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.121 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:43:59.121 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.095569+0000", 2024-04-01T19:43:59.121 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5091e-05 2024-04-01T19:43:59.122 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.122 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.122 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:43:59.122 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.095579+0000", 2024-04-01T19:43:59.122 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.2669999999999995e-06 2024-04-01T19:43:59.122 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.122 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.122 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:43:59.122 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.095630+0000", 2024-04-01T19:43:59.122 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0943000000000003e-05 2024-04-01T19:43:59.122 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.122 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.123 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:43:59.123 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.095735+0000", 2024-04-01T19:43:59.123 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00010487 2024-04-01T19:43:59.123 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.123 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.123 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 10", 2024-04-01T19:43:59.123 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.095847+0000", 2024-04-01T19:43:59.123 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000112704 2024-04-01T19:43:59.123 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.123 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.123 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:43:59.123 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.105924+0000", 2024-04-01T19:43:59.123 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010076472 2024-04-01T19:43:59.124 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:43:59.124 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:43:59.124 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:43:59.124 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.124 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.124 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:316570 5.2 5:44a9d54b:::benchmark_data_smithi188_119427_object151871:head [delete] snapc 0=[] ondisk+write+known_if_redirected e453)", 2024-04-01T19:43:59.124 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:59.095596+0000", 2024-04-01T19:43:59.124 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.015874217999999999, 2024-04-01T19:43:59.124 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.016142659, 2024-04-01T19:43:59.124 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:43:59.124 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:43:59.124 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:43:59.124 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:43:59.125 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:43:59.125 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:59.125 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 316570 2024-04-01T19:43:59.125 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.125 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:43:59.125 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.125 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:43:59.125 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.095596+0000", 2024-04-01T19:43:59.125 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:43:59.125 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.125 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.125 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:43:59.125 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.095596+0000", 2024-04-01T19:43:59.126 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:43:59.126 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.126 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.126 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:43:59.126 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.095597+0000", 2024-04-01T19:43:59.126 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4399999999999999e-07 2024-04-01T19:43:59.126 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.126 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.126 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:43:59.126 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.095601+0000", 2024-04-01T19:43:59.126 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.2089999999999999e-06 2024-04-01T19:43:59.126 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.127 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.127 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:43:59.127 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.095608+0000", 2024-04-01T19:43:59.127 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0999999999999998e-06 2024-04-01T19:43:59.127 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.127 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.127 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:43:59.127 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.095615+0000", 2024-04-01T19:43:59.127 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1809999999999998e-06 2024-04-01T19:43:59.127 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.127 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.127 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:43:59.127 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.100664+0000", 2024-04-01T19:43:59.127 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0050493550000000002 2024-04-01T19:43:59.128 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.128 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.128 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:43:59.128 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.100795+0000", 2024-04-01T19:43:59.128 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000130956 2024-04-01T19:43:59.128 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.128 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.128 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 10", 2024-04-01T19:43:59.128 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.100927+0000", 2024-04-01T19:43:59.128 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000131836 2024-04-01T19:43:59.128 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.128 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.128 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:43:59.129 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.105930+0000", 2024-04-01T19:43:59.129 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0050031429999999998 2024-04-01T19:43:59.129 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:43:59.129 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:43:59.129 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:43:59.129 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.129 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.129 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:316576 5.2 5:4745e9bb:::benchmark_data_smithi188_119427_object151877:head [delete] snapc 0=[] ondisk+write+known_if_redirected e453)", 2024-04-01T19:43:59.129 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:59.104452+0000", 2024-04-01T19:43:59.129 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.007018285, 2024-04-01T19:43:59.129 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0073693580000000003, 2024-04-01T19:43:59.129 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:43:59.129 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:43:59.129 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:43:59.130 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:43:59.130 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:43:59.130 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:59.130 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 316576 2024-04-01T19:43:59.130 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.130 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:43:59.130 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.130 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:43:59.130 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.104452+0000", 2024-04-01T19:43:59.130 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:43:59.130 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.130 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.130 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:43:59.131 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.104452+0000", 2024-04-01T19:43:59.131 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:43:59.131 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.131 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.131 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:43:59.131 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.104454+0000", 2024-04-01T19:43:59.131 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5859999999999999e-06 2024-04-01T19:43:59.131 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.131 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.131 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:43:59.131 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.104459+0000", 2024-04-01T19:43:59.131 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.507e-06 2024-04-01T19:43:59.131 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.131 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.132 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:43:59.132 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.104470+0000", 2024-04-01T19:43:59.132 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0876999999999999e-05 2024-04-01T19:43:59.132 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.132 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.132 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:43:59.132 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.104479+0000", 2024-04-01T19:43:59.132 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4679999999999992e-06 2024-04-01T19:43:59.132 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.132 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.132 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:43:59.132 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.105960+0000", 2024-04-01T19:43:59.132 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.001481191 2024-04-01T19:43:59.132 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.133 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.133 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:43:59.133 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.106096+0000", 2024-04-01T19:43:59.133 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013579600000000001 2024-04-01T19:43:59.133 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.133 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.133 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 10", 2024-04-01T19:43:59.133 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.106230+0000", 2024-04-01T19:43:59.133 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013434100000000001 2024-04-01T19:43:59.133 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:43:59.133 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:43:59.133 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:43:59.133 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.134 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.134 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:316574 5.e e453/364 5:787ee45e:::benchmark_data_smithi188_119427_object151875:head v 453'21993, mlcod=453'21991)", 2024-04-01T19:43:59.134 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:59.105877+0000", 2024-04-01T19:43:59.134 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0055935539999999997, 2024-04-01T19:43:59.134 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0060186079999999999, 2024-04-01T19:43:59.134 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:43:59.134 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:43:59.134 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:43:59.134 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:43:59.134 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.134 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:43:59.134 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.105877+0000", 2024-04-01T19:43:59.134 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:43:59.135 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.135 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.135 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:43:59.135 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.105877+0000", 2024-04-01T19:43:59.135 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:43:59.135 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.135 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.135 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:43:59.135 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.105878+0000", 2024-04-01T19:43:59.135 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2999999999999999e-07 2024-04-01T19:43:59.135 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.135 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.135 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:43:59.136 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.105883+0000", 2024-04-01T19:43:59.136 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0089999999999998e-06 2024-04-01T19:43:59.136 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.136 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.136 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:43:59.136 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.105888+0000", 2024-04-01T19:43:59.136 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5670000000000002e-06 2024-04-01T19:43:59.136 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.136 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.136 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:43:59.136 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.105893+0000", 2024-04-01T19:43:59.136 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2179999999999998e-06 2024-04-01T19:43:59.136 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.137 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.137 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:43:59.137 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.105967+0000", 2024-04-01T19:43:59.137 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3349999999999994e-05 2024-04-01T19:43:59.137 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.137 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.137 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:43:59.137 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.105986+0000", 2024-04-01T19:43:59.137 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9415999999999998e-05 2024-04-01T19:43:59.137 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:43:59.137 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:43:59.137 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:43:59.137 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.137 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.137 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:316579 5.5 5:a6232886:::benchmark_data_smithi188_119427_object151880:head [delete] snapc 0=[] ondisk+write+known_if_redirected e453)", 2024-04-01T19:43:59.138 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:59.105893+0000", 2024-04-01T19:43:59.138 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0055770630000000002, 2024-04-01T19:43:59.138 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0060634520000000004, 2024-04-01T19:43:59.138 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:43:59.138 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:43:59.138 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:43:59.138 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:43:59.138 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:43:59.138 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:59.138 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 316579 2024-04-01T19:43:59.138 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.138 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:43:59.138 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.138 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:43:59.139 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.105893+0000", 2024-04-01T19:43:59.139 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:43:59.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.139 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.139 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:43:59.139 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.105893+0000", 2024-04-01T19:43:59.139 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:43:59.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.139 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.139 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:43:59.139 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.105895+0000", 2024-04-01T19:43:59.139 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.248e-06 2024-04-01T19:43:59.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.139 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.139 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:43:59.140 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.105899+0000", 2024-04-01T19:43:59.140 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.3059999999999999e-06 2024-04-01T19:43:59.140 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.140 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.140 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:43:59.140 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.105911+0000", 2024-04-01T19:43:59.140 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2166e-05 2024-04-01T19:43:59.140 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.140 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.140 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:43:59.140 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.105920+0000", 2024-04-01T19:43:59.140 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5089999999999993e-06 2024-04-01T19:43:59.140 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.140 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.141 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:43:59.141 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.106101+0000", 2024-04-01T19:43:59.141 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00018134 2024-04-01T19:43:59.141 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.141 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.141 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:43:59.141 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.106205+0000", 2024-04-01T19:43:59.141 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000103663 2024-04-01T19:43:59.141 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.141 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.141 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 1", 2024-04-01T19:43:59.141 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.106309+0000", 2024-04-01T19:43:59.141 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000104032 2024-04-01T19:43:59.141 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:43:59.141 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:43:59.142 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:43:59.142 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.142 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.142 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:316581 5.2 5:45a4d81d:::benchmark_data_smithi188_119427_object151882:head [delete] snapc 0=[] ondisk+write+known_if_redirected e453)", 2024-04-01T19:43:59.142 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:59.106252+0000", 2024-04-01T19:43:59.142 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0052181079999999999, 2024-04-01T19:43:59.142 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0057806940000000003, 2024-04-01T19:43:59.142 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:43:59.142 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:43:59.142 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:43:59.142 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:43:59.142 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:43:59.142 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:43:59.142 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 316581 2024-04-01T19:43:59.142 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.143 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:43:59.143 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.143 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:43:59.143 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.106252+0000", 2024-04-01T19:43:59.143 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:43:59.143 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.143 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.143 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:43:59.143 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.106252+0000", 2024-04-01T19:43:59.143 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:43:59.143 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.143 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.143 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:43:59.143 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.106253+0000", 2024-04-01T19:43:59.143 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.7499999999999998e-07 2024-04-01T19:43:59.143 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.144 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.144 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:43:59.144 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.106257+0000", 2024-04-01T19:43:59.144 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9060000000000004e-06 2024-04-01T19:43:59.144 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.144 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.144 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:43:59.144 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.106266+0000", 2024-04-01T19:43:59.144 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.371e-06 2024-04-01T19:43:59.144 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.144 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.144 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:43:59.144 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.106273+0000", 2024-04-01T19:43:59.144 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2110000000000001e-06 2024-04-01T19:43:59.144 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.145 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.145 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:43:59.145 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.111043+0000", 2024-04-01T19:43:59.145 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0047704050000000001 2024-04-01T19:43:59.145 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.145 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.145 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:43:59.145 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.111158+0000", 2024-04-01T19:43:59.145 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00011520599999999999 2024-04-01T19:43:59.145 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.145 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.145 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 10", 2024-04-01T19:43:59.145 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.111279+0000", 2024-04-01T19:43:59.146 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0001204 2024-04-01T19:43:59.146 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:43:59.146 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:43:59.146 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:43:59.146 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.146 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.146 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:316580 5.e e453/364 5:7989df1f:::benchmark_data_smithi188_119427_object151881:head v 453'21994, mlcod=453'21991)", 2024-04-01T19:43:59.146 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:59.107849+0000", 2024-04-01T19:43:59.146 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0036217530000000001, 2024-04-01T19:43:59.146 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0042577689999999998, 2024-04-01T19:43:59.146 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:43:59.146 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:43:59.146 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:43:59.147 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:43:59.147 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.147 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:43:59.147 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.107849+0000", 2024-04-01T19:43:59.147 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:43:59.147 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.147 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.147 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:43:59.147 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.107849+0000", 2024-04-01T19:43:59.147 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:43:59.147 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.147 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.147 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:43:59.148 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.107850+0000", 2024-04-01T19:43:59.148 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6000000000000002e-07 2024-04-01T19:43:59.148 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.148 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.148 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:43:59.148 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.107856+0000", 2024-04-01T19:43:59.148 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0360000000000003e-06 2024-04-01T19:43:59.148 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.148 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.148 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:43:59.148 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.107866+0000", 2024-04-01T19:43:59.148 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0125e-05 2024-04-01T19:43:59.148 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.148 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.149 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:43:59.149 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.107872+0000", 2024-04-01T19:43:59.149 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4200000000000004e-06 2024-04-01T19:43:59.149 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.149 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.149 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:43:59.149 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.110001+0000", 2024-04-01T19:43:59.149 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0021284659999999999 2024-04-01T19:43:59.149 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:43:59.149 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:43:59.149 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:43:59.149 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:59.110022+0000", 2024-04-01T19:43:59.149 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1260999999999999e-05 2024-04-01T19:43:59.149 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:43:59.150 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:43:59.150 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:43:59.150 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:43:59.150 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T19:43:59.150 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 9 2024-04-01T19:43:59.150 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:43:59.157 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:43:59.190 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:59.213 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:43:59.219 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:59.220 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:43:59.315 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:59 smithi022 ceph-mon[39439]: 5.9 scrub starts 2024-04-01T19:43:59.315 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:59 smithi022 ceph-mon[39439]: 5.9 scrub ok 2024-04-01T19:43:59.315 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:43:59 smithi022 ceph-mon[39439]: pgmap v1267: 17 pgs: 17 active+clean; 1006 MiB data, 5.9 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:43:59.321 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:43:59.363 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:59.393 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:43:59.398 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:59.398 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:43:59.499 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:43:59.532 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:59.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:59 smithi188 ceph-mon[43939]: 5.9 scrub starts 2024-04-01T19:43:59.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:59 smithi188 ceph-mon[43939]: 5.9 scrub ok 2024-04-01T19:43:59.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:43:59 smithi188 ceph-mon[43939]: pgmap v1267: 17 pgs: 17 active+clean; 1006 MiB data, 5.9 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:43:59.664 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:43:59.666 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:59 smithi062 ceph-mon[44211]: 5.9 scrub starts 2024-04-01T19:43:59.667 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:59 smithi062 ceph-mon[44211]: 5.9 scrub ok 2024-04-01T19:43:59.667 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:43:59 smithi062 ceph-mon[44211]: pgmap v1267: 17 pgs: 17 active+clean; 1006 MiB data, 5.9 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:43:59.667 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:59.668 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:43:59.769 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:43:59.789 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:43:59.802 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:59.826 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:43:59.830 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:59.830 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:43:59.866 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:43:59.907 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:43:59.931 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:43:59.952 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:43:59.959 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:43:59.976 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_ops_in_flight 2024-04-01T19:43:59.983 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:43:59.986 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:43:59.987 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:43:59.995 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:44:00.028 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:44:00.072 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:44:00.087 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:44:00.118 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:00.126 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:44:00.147 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:44:00.151 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:00.151 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:44:00.166 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:44:00.198 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:44:00.226 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:44:00.252 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:44:00.258 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:44:00.258 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:44:00.258 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:44:00.258 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:44:00.258 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:44:00.258 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:44:00.258 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:44:00.258 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-04-01T19:44:00.259 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:44:00.259 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:44:00.259 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:44:00.259 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:44:00.259 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:44:00.265 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:43:59 smithi062 bash[135760]: c1ec8d25bcd8a31f57f52c0d96bdb373aa21c38640a79c00a103ff3be04c1d55 2024-04-01T19:44:00.265 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:43:59 smithi062 systemd[1]: Started Ceph osd.6 for 09f6b846-f05c-11ee-b647-cb9ed24678a4. 2024-04-01T19:44:00.313 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:00.342 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:44:00.350 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:00.350 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:44:00.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:00 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3779793152' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:44:00.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:00.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:00.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:00.369 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:44:00.452 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:44:00.486 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:00.511 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:44:00.514 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:00.515 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:44:00.604 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_blocked_ops 2024-04-01T19:44:00.616 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:44:00.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:00 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3779793152' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:44:00.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:00.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:00.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:00.643 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:00.644 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:00 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3779793152' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:44:00.644 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:00.644 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:00.644 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:00.644 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:44:00 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T19:44:00.416+0000 7fee5b5b97c0 -1 Falling back to public interface 2024-04-01T19:44:00.664 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:44:00.667 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:00.667 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:44:00.768 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:44:00.803 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:00.885 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:44:00.891 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:00.891 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:44:00.992 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:44:01.050 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:01.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:01.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:01.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:01.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:01.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:01 smithi022 ceph-mon[39439]: 5.7 scrub starts 2024-04-01T19:44:01.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:01.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:01.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:01.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:01.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:01 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:44:01.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:01 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:44:01.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:01 smithi022 ceph-mon[39439]: pgmap v1268: 17 pgs: 17 active+clean; 829 MiB data, 5.6 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:44:01.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:01 smithi022 ceph-mon[39439]: osdmap e454: 12 total, 11 up, 10 in 2024-04-01T19:44:01.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:01.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:01.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:01.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:01.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:01 smithi188 ceph-mon[43939]: 5.7 scrub starts 2024-04-01T19:44:01.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:01.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:01.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:01.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:01.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:01 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:44:01.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:01 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:44:01.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:01 smithi188 ceph-mon[43939]: pgmap v1268: 17 pgs: 17 active+clean; 829 MiB data, 5.6 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:44:01.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:01 smithi188 ceph-mon[43939]: osdmap e454: 12 total, 11 up, 10 in 2024-04-01T19:44:01.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:01.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:01.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:01.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:01 smithi062 ceph-mon[44211]: 5.7 scrub starts 2024-04-01T19:44:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:01 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:44:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:01 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:44:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:01 smithi062 ceph-mon[44211]: pgmap v1268: 17 pgs: 17 active+clean; 829 MiB data, 5.6 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:44:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:01 smithi062 ceph-mon[44211]: osdmap e454: 12 total, 11 up, 10 in 2024-04-01T19:44:02.486 INFO:teuthology.orchestra.run.smithi062.stderr:no valid command found; 10 closest matches: 2024-04-01T19:44:02.486 INFO:teuthology.orchestra.run.smithi062.stderr:0 2024-04-01T19:44:02.486 INFO:teuthology.orchestra.run.smithi062.stderr:1 2024-04-01T19:44:02.486 INFO:teuthology.orchestra.run.smithi062.stderr:2 2024-04-01T19:44:02.486 INFO:teuthology.orchestra.run.smithi062.stderr:abort 2024-04-01T19:44:02.486 INFO:teuthology.orchestra.run.smithi062.stderr:assert 2024-04-01T19:44:02.486 INFO:teuthology.orchestra.run.smithi062.stderr:bluestore allocator dump block 2024-04-01T19:44:02.486 INFO:teuthology.orchestra.run.smithi062.stderr:bluestore allocator fragmentation block 2024-04-01T19:44:02.486 INFO:teuthology.orchestra.run.smithi062.stderr:bluestore allocator fragmentation histogram block [] [] 2024-04-01T19:44:02.486 INFO:teuthology.orchestra.run.smithi062.stderr:bluestore allocator score block 2024-04-01T19:44:02.486 INFO:teuthology.orchestra.run.smithi062.stderr:config diff 2024-04-01T19:44:02.487 INFO:teuthology.orchestra.run.smithi062.stderr:admin_socket: invalid command 2024-04-01T19:44:02.494 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:02 smithi062 ceph-mon[44211]: 5.7 scrub ok 2024-04-01T19:44:02.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:02 smithi022 ceph-mon[39439]: 5.7 scrub ok 2024-04-01T19:44:02.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:02 smithi188 ceph-mon[43939]: 5.7 scrub ok 2024-04-01T19:44:03.263 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:44:03.263 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:44:03.313 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-01T19:44:03.313 INFO:tasks.cephadm.ceph_manager.ceph:waiting on admin_socket for osd-6, ['dump_ops_in_flight'] 2024-04-01T19:44:03.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:03 smithi022 ceph-mon[39439]: pgmap v1270: 17 pgs: 17 active+clean; 674 MiB data, 5.2 GiB used, 889 GiB / 894 GiB avail; 0 B/s wr, 1.32k op/s 2024-04-01T19:44:03.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:03 smithi188 ceph-mon[43939]: pgmap v1270: 17 pgs: 17 active+clean; 674 MiB data, 5.2 GiB used, 889 GiB / 894 GiB avail; 0 B/s wr, 1.32k op/s 2024-04-01T19:44:03.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:03 smithi062 ceph-mon[44211]: pgmap v1270: 17 pgs: 17 active+clean; 674 MiB data, 5.2 GiB used, 889 GiB / 894 GiB avail; 0 B/s wr, 1.32k op/s 2024-04-01T19:44:03.760 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:44:03 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T19:44:03.484+0000 7fee5b5b97c0 -1 osd.6 421 log_to_monitors true 2024-04-01T19:44:03.855 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:44:03.860 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:03.860 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:44:03.898 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:44:03.961 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:44:04.063 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:04.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:04 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:44:04.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:04 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:44:04.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:04 smithi022 ceph-mon[39439]: osdmap e455: 12 total, 11 up, 10 in 2024-04-01T19:44:04.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:04 smithi022 ceph-mon[39439]: from='osd.6 v1:172.21.15.62:6808/2644974032' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-01T19:44:04.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:04 smithi022 ceph-mon[39439]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-01T19:44:04.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:04 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:44:04.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:04 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:44:04.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:04 smithi188 ceph-mon[43939]: osdmap e455: 12 total, 11 up, 10 in 2024-04-01T19:44:04.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:04 smithi188 ceph-mon[43939]: from='osd.6 v1:172.21.15.62:6808/2644974032' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-01T19:44:04.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:04 smithi188 ceph-mon[43939]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-01T19:44:04.745 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:44:04.750 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:04.751 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:44:04.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:04 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:44:04.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:04 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:44:04.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:04 smithi062 ceph-mon[44211]: osdmap e455: 12 total, 11 up, 10 in 2024-04-01T19:44:04.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:04 smithi062 ceph-mon[44211]: from='osd.6 v1:172.21.15.62:6808/2644974032' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-01T19:44:04.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:04 smithi062 ceph-mon[44211]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-01T19:44:04.851 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:44:04.883 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:04.911 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:44:04.916 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:04.917 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:44:05.018 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:44:05.049 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:05.076 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:44:05.079 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:05.080 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:44:05.181 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:44:05.237 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:05.260 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 19:44:04 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T19:44:04.861+0000 7fee48a09700 -1 osd.6 421 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T19:44:05.264 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:44:05.502 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:05 smithi022 ceph-mon[39439]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-01T19:44:05.502 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:05 smithi022 ceph-mon[39439]: osdmap e456: 12 total, 11 up, 10 in 2024-04-01T19:44:05.502 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:05 smithi022 ceph-mon[39439]: from='osd.6 v1:172.21.15.62:6808/2644974032' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:44:05.502 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:05 smithi022 ceph-mon[39439]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:44:05.502 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:05 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:44:05.502 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:05 smithi022 ceph-mon[39439]: from='osd.6 ' entity='osd.6' 2024-04-01T19:44:05.502 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:05 smithi022 ceph-mon[39439]: pgmap v1273: 17 pgs: 17 active+clean; 626 MiB data, 5.1 GiB used, 889 GiB / 894 GiB avail; 0 B/s wr, 1.01k op/s 2024-04-01T19:44:05.519 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:44:05.523 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:05.524 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:44:05.625 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:44:05.663 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:05 smithi062 ceph-mon[44211]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-01T19:44:05.664 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:05 smithi062 ceph-mon[44211]: osdmap e456: 12 total, 11 up, 10 in 2024-04-01T19:44:05.664 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:05 smithi062 ceph-mon[44211]: from='osd.6 v1:172.21.15.62:6808/2644974032' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:44:05.664 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:05 smithi062 ceph-mon[44211]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:44:05.664 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:05 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:44:05.664 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:05 smithi062 ceph-mon[44211]: from='osd.6 ' entity='osd.6' 2024-04-01T19:44:05.664 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:05 smithi062 ceph-mon[44211]: pgmap v1273: 17 pgs: 17 active+clean; 626 MiB data, 5.1 GiB used, 889 GiB / 894 GiB avail; 0 B/s wr, 1.01k op/s 2024-04-01T19:44:05.668 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:05.693 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:44:05.696 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:05.697 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:44:05.797 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:44:05.829 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:05 smithi188 ceph-mon[43939]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-01T19:44:05.829 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:05 smithi188 ceph-mon[43939]: osdmap e456: 12 total, 11 up, 10 in 2024-04-01T19:44:05.829 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:05 smithi188 ceph-mon[43939]: from='osd.6 v1:172.21.15.62:6808/2644974032' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:44:05.829 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:05 smithi188 ceph-mon[43939]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-04-01T19:44:05.829 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:05 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:44:05.829 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:05 smithi188 ceph-mon[43939]: from='osd.6 ' entity='osd.6' 2024-04-01T19:44:05.829 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:05 smithi188 ceph-mon[43939]: pgmap v1273: 17 pgs: 17 active+clean; 626 MiB data, 5.1 GiB used, 889 GiB / 894 GiB avail; 0 B/s wr, 1.01k op/s 2024-04-01T19:44:05.831 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:05.859 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:44:05.863 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:05.863 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:44:05.964 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:44:05.998 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:06.022 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:44:06.028 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:06.029 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:44:06.129 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:44:06.159 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:06.191 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:44:06.198 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:06.198 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:44:06.299 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:44:06.333 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:06.359 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:44:06.362 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:06.362 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:44:06.463 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:44:06.478 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:44:06.493 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:06.514 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:44:06.519 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:06.519 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:44:06.620 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:44:06.650 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:06 smithi062 ceph-mon[44211]: osd.6 v1:172.21.15.62:6808/2644974032 boot 2024-04-01T19:44:06.650 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:06 smithi062 ceph-mon[44211]: osdmap e457: 12 total, 12 up, 10 in 2024-04-01T19:44:06.650 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:06 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:44:06.653 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:06.673 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:44:06.676 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:06.677 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:44:06.778 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:44:06.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:06 smithi188 ceph-mon[43939]: osd.6 v1:172.21.15.62:6808/2644974032 boot 2024-04-01T19:44:06.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:06 smithi188 ceph-mon[43939]: osdmap e457: 12 total, 12 up, 10 in 2024-04-01T19:44:06.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:06 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:44:06.921 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:06 smithi022 ceph-mon[39439]: osd.6 v1:172.21.15.62:6808/2644974032 boot 2024-04-01T19:44:06.921 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:06 smithi022 ceph-mon[39439]: osdmap e457: 12 total, 12 up, 10 in 2024-04-01T19:44:06.921 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:06 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T19:44:07.469 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:44:07.717 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:07.717 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:07 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:44:07.718 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:07 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:44:07.718 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:07.718 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:07 smithi022 ceph-mon[39439]: osdmap e458: 12 total, 12 up, 10 in 2024-04-01T19:44:07.718 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:07 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3554876420' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:44:07.718 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:07 smithi022 ceph-mon[39439]: pgmap v1276: 17 pgs: 17 active+clean; 360 MiB data, 4.7 GiB used, 889 GiB / 894 GiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:44:07.726 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:07.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:07.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:07 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:44:07.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:07 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:44:07.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:07.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:07 smithi062 ceph-mon[44211]: osdmap e458: 12 total, 12 up, 10 in 2024-04-01T19:44:07.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:07 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3554876420' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:44:07.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:07 smithi062 ceph-mon[44211]: pgmap v1276: 17 pgs: 17 active+clean; 360 MiB data, 4.7 GiB used, 889 GiB / 894 GiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:44:07.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:07.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:07 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:44:07.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:07 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:44:07.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:07.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:07 smithi188 ceph-mon[43939]: osdmap e458: 12 total, 12 up, 10 in 2024-04-01T19:44:07.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:07 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3554876420' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:44:07.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:07 smithi188 ceph-mon[43939]: pgmap v1276: 17 pgs: 17 active+clean; 360 MiB data, 4.7 GiB used, 889 GiB / 894 GiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:44:08.293 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:44:08.301 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:08.302 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:44:08.314 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_ops_in_flight 2024-04-01T19:44:08.402 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:44:08.434 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:08.462 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:44:08.465 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:08.465 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:44:08.566 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:44:08.598 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:08.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:08 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:44:08.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:08 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3554876420' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:44:08.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:08 smithi022 ceph-mon[39439]: osdmap e459: 12 total, 12 up, 10 in 2024-04-01T19:44:08.625 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:44:08.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:08.628 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:44:08.672 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:44:08.729 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:44:08.754 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:08 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:44:08.754 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:08 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3554876420' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:44:08.755 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:08 smithi188 ceph-mon[43939]: osdmap e459: 12 total, 12 up, 10 in 2024-04-01T19:44:08.756 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:08.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:08 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:44:08.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:08 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3554876420' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:44:08.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:08 smithi062 ceph-mon[44211]: osdmap e459: 12 total, 12 up, 10 in 2024-04-01T19:44:08.784 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:44:08.788 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:08.788 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:44:08.889 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:44:08.926 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:08.969 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:44:08.972 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:08.973 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:44:09.074 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:44:09.159 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:09.679 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:44:09.680 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:44:09.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:09 smithi062 ceph-mon[44211]: pgmap v1278: 17 pgs: 17 active+clean; 293 MiB data, 4.5 GiB used, 889 GiB / 894 GiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:44:09.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:09 smithi022 ceph-mon[39439]: pgmap v1278: 17 pgs: 17 active+clean; 293 MiB data, 4.5 GiB used, 889 GiB / 894 GiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:44:09.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:09 smithi188 ceph-mon[43939]: pgmap v1278: 17 pgs: 17 active+clean; 293 MiB data, 4.5 GiB used, 889 GiB / 894 GiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:44:10.242 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:44:10.245 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:10.246 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:44:10.304 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Removed 164696 objects 2024-04-01T19:44:10.304 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Clean up completed and total clean up time :185.663 2024-04-01T19:44:10.347 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:44:10.378 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:10.577 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:44:10.579 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:10.580 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:44:10.618 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:44:10.618 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:44:10.618 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 0 2024-04-01T19:44:10.618 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:44:10.680 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:44:10.708 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:10.722 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_historic_ops 2024-04-01T19:44:10.906 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:44:10.909 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:10.909 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:44:11.010 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:44:11.039 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:11.059 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:44:11.062 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:11.062 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:44:11.163 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:44:11.192 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:11.213 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:44:11.216 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:11.216 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:44:11.317 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:44:11.343 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-01T19:44:11.343 INFO:tasks.thrashosds.thrasher:Adding osd 8 2024-04-01T19:44:11.344 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd in 8 2024-04-01T19:44:11.344 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:11 smithi188 ceph-mon[43939]: pgmap v1279: 17 pgs: 17 active+clean; 121 MiB data, 4.2 GiB used, 890 GiB / 894 GiB avail; 0 B/s wr, 1.34k op/s 2024-04-01T19:44:11.346 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:11.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:11 smithi022 ceph-mon[39439]: pgmap v1279: 17 pgs: 17 active+clean; 121 MiB data, 4.2 GiB used, 890 GiB / 894 GiB avail; 0 B/s wr, 1.34k op/s 2024-04-01T19:44:11.365 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:44:11.367 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:11.368 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:44:11.469 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:44:11.496 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:11.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:11 smithi062 ceph-mon[44211]: pgmap v1279: 17 pgs: 17 active+clean; 121 MiB data, 4.2 GiB used, 890 GiB / 894 GiB avail; 0 B/s wr, 1.34k op/s 2024-04-01T19:44:11.627 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:44:12.097 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:44:12.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:12 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:44:12.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:12 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:44:12.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:12 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:44:12.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:12 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:44:12.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:12 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:44:12.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:12 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:44:13.246 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:44:13.249 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:13.250 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:44:13.351 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:44:13.416 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:13.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:13 smithi062 ceph-mon[44211]: osdmap e460: 12 total, 12 up, 10 in 2024-04-01T19:44:13.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:13 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2615764164' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:44:13.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:13 smithi062 ceph-mon[44211]: pgmap v1281: 17 pgs: 17 active+clean; 10 MiB data, 4.0 GiB used, 890 GiB / 894 GiB avail; 0 B/s wr, 1.00k op/s 2024-04-01T19:44:13.529 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:13 smithi022 ceph-mon[39439]: osdmap e460: 12 total, 12 up, 10 in 2024-04-01T19:44:13.530 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:13 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2615764164' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:44:13.530 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:13 smithi022 ceph-mon[39439]: pgmap v1281: 17 pgs: 17 active+clean; 10 MiB data, 4.0 GiB used, 890 GiB / 894 GiB avail; 0 B/s wr, 1.00k op/s 2024-04-01T19:44:13.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:13 smithi188 ceph-mon[43939]: osdmap e460: 12 total, 12 up, 10 in 2024-04-01T19:44:13.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:13 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2615764164' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:44:13.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:13 smithi188 ceph-mon[43939]: pgmap v1281: 17 pgs: 17 active+clean; 10 MiB data, 4.0 GiB used, 890 GiB / 894 GiB avail; 0 B/s wr, 1.00k op/s 2024-04-01T19:44:13.865 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:44:13.868 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:13.868 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:44:13.969 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:44:14.004 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:14.026 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:44:14.029 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:14.029 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:44:14.130 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:44:14.158 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:14.177 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:44:14.178 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:44:14.178 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:44:14.178 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:44:14.178 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:44:14.178 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:44:14.178 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:44:14.178 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:44:14.178 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:44:14.178 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:44:14.178 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:44:14.178 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:44:14.179 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:44:14.179 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:44:14.179 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:44:14.179 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:44:14.179 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:44:14.179 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:44:14.179 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:44:14.179 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:44:14.179 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:44:14.179 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:44:14.179 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:44:14.179 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:44:14.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.335 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:44:14.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:14.709 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:44:14.712 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:14.713 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:44:14.814 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:44:14.846 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:14.867 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:44:14.870 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:14.871 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:44:14.972 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:44:15.005 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:44:15.008 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:15.009 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:44:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 20, 2024-04-01T19:44:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 600, 2024-04-01T19:44:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:44:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:181518 4.b 4:d653702f:::benchmark_data_smithi188_104537_object9524:head [delete] snapc 0=[] ondisk+write+known_if_redirected e298)", 2024-04-01T19:44:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:35:43.084338+0000", 2024-04-01T19:44:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 511.92433568400003, 2024-04-01T19:44:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.12701379400000001, 2024-04-01T19:44:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:44:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:44:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 181518 2024-04-01T19:44:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.084338+0000", 2024-04-01T19:44:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.084338+0000", 2024-04-01T19:44:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.084341+0000", 2024-04-01T19:44:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6410000000000002e-06 2024-04-01T19:44:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.084350+0000", 2024-04-01T19:44:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.7710000000000001e-06 2024-04-01T19:44:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.084367+0000", 2024-04-01T19:44:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7061000000000001e-05 2024-04-01T19:44:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.084375+0000", 2024-04-01T19:44:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3930000000000002e-06 2024-04-01T19:44:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.012 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.084444+0000", 2024-04-01T19:44:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8868999999999994e-05 2024-04-01T19:44:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.084593+0000", 2024-04-01T19:44:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000149665 2024-04-01T19:44:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 1", 2024-04-01T19:44:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.084731+0000", 2024-04-01T19:44:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000137782 2024-04-01T19:44:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.013 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:44:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.093178+0000", 2024-04-01T19:44:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0084469720000000005 2024-04-01T19:44:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.211221+0000", 2024-04-01T19:44:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.118043457 2024-04-01T19:44:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.211285+0000", 2024-04-01T19:44:15.014 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3126000000000005e-05 2024-04-01T19:44:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.211352+0000", 2024-04-01T19:44:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.7057000000000005e-05 2024-04-01T19:44:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:181525 4.b 4:d82f5fc8:::benchmark_data_smithi188_104537_object9531:head [delete] snapc 0=[] ondisk+write+known_if_redirected e298)", 2024-04-01T19:44:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:35:43.085676+0000", 2024-04-01T19:44:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 511.92299715899998, 2024-04-01T19:44:15.015 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13434543299999999, 2024-04-01T19:44:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:44:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:44:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 181525 2024-04-01T19:44:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.085676+0000", 2024-04-01T19:44:15.016 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.085676+0000", 2024-04-01T19:44:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.085678+0000", 2024-04-01T19:44:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.33e-06 2024-04-01T19:44:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.017 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.085682+0000", 2024-04-01T19:44:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5859999999999998e-06 2024-04-01T19:44:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.085693+0000", 2024-04-01T19:44:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0713999999999999e-05 2024-04-01T19:44:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.085699+0000", 2024-04-01T19:44:15.018 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8309999999999997e-06 2024-04-01T19:44:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.089415+0000", 2024-04-01T19:44:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0037160909999999999 2024-04-01T19:44:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.089564+0000", 2024-04-01T19:44:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014948699999999999 2024-04-01T19:44:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 1", 2024-04-01T19:44:15.019 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.089709+0000", 2024-04-01T19:44:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014458299999999999 2024-04-01T19:44:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:44:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.096171+0000", 2024-04-01T19:44:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0064624469999999996 2024-04-01T19:44:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.219933+0000", 2024-04-01T19:44:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.12376155599999999 2024-04-01T19:44:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.219971+0000", 2024-04-01T19:44:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.8056999999999998e-05 2024-04-01T19:44:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.220022+0000", 2024-04-01T19:44:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0751000000000002e-05 2024-04-01T19:44:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:181528 4.b 4:da993e2f:::benchmark_data_smithi188_104537_object9534:head [delete] snapc 0=[] ondisk+write+known_if_redirected e298)", 2024-04-01T19:44:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:35:43.088785+0000", 2024-04-01T19:44:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 511.919888818, 2024-04-01T19:44:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13138290799999999, 2024-04-01T19:44:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:44:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:44:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 181528 2024-04-01T19:44:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.088785+0000", 2024-04-01T19:44:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.088785+0000", 2024-04-01T19:44:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.088786+0000", 2024-04-01T19:44:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5579999999999999e-06 2024-04-01T19:44:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.023 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.088791+0000", 2024-04-01T19:44:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.1030000000000001e-06 2024-04-01T19:44:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.088801+0000", 2024-04-01T19:44:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.4849999999999998e-06 2024-04-01T19:44:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.088807+0000", 2024-04-01T19:44:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7899999999999996e-06 2024-04-01T19:44:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.024 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.093216+0000", 2024-04-01T19:44:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0044091620000000003 2024-04-01T19:44:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.093296+0000", 2024-04-01T19:44:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0211999999999997e-05 2024-04-01T19:44:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 1", 2024-04-01T19:44:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.093368+0000", 2024-04-01T19:44:15.025 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2003999999999997e-05 2024-04-01T19:44:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:44:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.096306+0000", 2024-04-01T19:44:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0029376290000000002 2024-04-01T19:44:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.220081+0000", 2024-04-01T19:44:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.123775581 2024-04-01T19:44:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:15.026 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.220141+0000", 2024-04-01T19:44:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9746e-05 2024-04-01T19:44:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:35:43.220168+0000", 2024-04-01T19:44:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6638000000000001e-05 2024-04-01T19:44:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:120813 5.3 5:cd34281e:::benchmark_data_smithi188_119427_object120812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e389)", 2024-04-01T19:44:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:26.683879+0000", 2024-04-01T19:44:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 228.32479445300001, 2024-04-01T19:44:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.093211688000000001, 2024-04-01T19:44:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:44:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:44:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 120813 2024-04-01T19:44:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:15.028 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.683879+0000", 2024-04-01T19:44:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.683879+0000", 2024-04-01T19:44:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.683881+0000", 2024-04-01T19:44:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.95e-06 2024-04-01T19:44:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:15.029 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.683919+0000", 2024-04-01T19:44:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7574999999999999e-05 2024-04-01T19:44:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.683930+0000", 2024-04-01T19:44:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0883999999999999e-05 2024-04-01T19:44:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.683937+0000", 2024-04-01T19:44:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4159999999999998e-06 2024-04-01T19:44:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.030 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.684016+0000", 2024-04-01T19:44:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.8749000000000001e-05 2024-04-01T19:44:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.684158+0000", 2024-04-01T19:44:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014234299999999999 2024-04-01T19:44:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6", 2024-04-01T19:44:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.684304+0000", 2024-04-01T19:44:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000146286 2024-04-01T19:44:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.031 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:44:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688270+0000", 2024-04-01T19:44:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0039653739999999998 2024-04-01T19:44:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.776977+0000", 2024-04-01T19:44:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.088706850000000004 2024-04-01T19:44:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.777036+0000", 2024-04-01T19:44:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9744999999999998e-05 2024-04-01T19:44:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.032 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.777091+0000", 2024-04-01T19:44:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4515999999999998e-05 2024-04-01T19:44:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:120808 5.b e389/364 5:d226b62b:::benchmark_data_smithi188_119427_object120807:head v 389'7507, mlcod=389'7505)", 2024-04-01T19:44:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:26.683964+0000", 2024-04-01T19:44:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 228.32470911799999, 2024-04-01T19:44:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.099583120999999997, 2024-04-01T19:44:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:15.033 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.683964+0000", 2024-04-01T19:44:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.683964+0000", 2024-04-01T19:44:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.034 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.683966+0000", 2024-04-01T19:44:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0229999999999999e-06 2024-04-01T19:44:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.684004+0000", 2024-04-01T19:44:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7276e-05 2024-04-01T19:44:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.684014+0000", 2024-04-01T19:44:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.7999999999999993e-06 2024-04-01T19:44:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.035 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.684020+0000", 2024-04-01T19:44:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4320000000000004e-06 2024-04-01T19:44:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688016+0000", 2024-04-01T19:44:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0039960029999999997 2024-04-01T19:44:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688036+0000", 2024-04-01T19:44:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0055e-05 2024-04-01T19:44:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.036 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.783490+0000", 2024-04-01T19:44:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.095454392999999998 2024-04-01T19:44:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.783548+0000", 2024-04-01T19:44:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7139000000000003e-05 2024-04-01T19:44:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:120818 5.b e389/364 5:d1ea8709:::benchmark_data_smithi188_119427_object120817:head v 389'7508, mlcod=389'7505)", 2024-04-01T19:44:15.037 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:26.688634+0000", 2024-04-01T19:44:15.038 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 228.32004004500001, 2024-04-01T19:44:15.038 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.102478002, 2024-04-01T19:44:15.038 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:15.038 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:15.038 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:15.038 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:15.038 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.038 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:15.038 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688634+0000", 2024-04-01T19:44:15.038 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.038 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.038 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.038 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:15.038 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688634+0000", 2024-04-01T19:44:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688634+0000", 2024-04-01T19:44:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1600000000000002e-07 2024-04-01T19:44:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688654+0000", 2024-04-01T19:44:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0519000000000001e-05 2024-04-01T19:44:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.039 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688659+0000", 2024-04-01T19:44:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1489999999999996e-06 2024-04-01T19:44:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.688662+0000", 2024-04-01T19:44:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.095e-06 2024-04-01T19:44:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.773545+0000", 2024-04-01T19:44:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.084883713999999999 2024-04-01T19:44:15.040 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.773571+0000", 2024-04-01T19:44:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6007999999999999e-05 2024-04-01T19:44:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.791065+0000", 2024-04-01T19:44:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.017493121 2024-04-01T19:44:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.791112+0000", 2024-04-01T19:44:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6980000000000001e-05 2024-04-01T19:44:15.041 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.25864.0:120819 5.b e389/364 5:d5df3617:::benchmark_data_smithi188_119427_object120818:head v 389'7509, mlcod=389'7505)", 2024-04-01T19:44:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:26.691278+0000", 2024-04-01T19:44:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 228.31739532700001, 2024-04-01T19:44:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.099984090999999997, 2024-04-01T19:44:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:15.042 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.691278+0000", 2024-04-01T19:44:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.691278+0000", 2024-04-01T19:44:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.691280+0000", 2024-04-01T19:44:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4410000000000001e-06 2024-04-01T19:44:15.043 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.691338+0000", 2024-04-01T19:44:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8788e-05 2024-04-01T19:44:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.772898+0000", 2024-04-01T19:44:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.081559650999999997 2024-04-01T19:44:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.772911+0000", 2024-04-01T19:44:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3169e-05 2024-04-01T19:44:15.044 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.777126+0000", 2024-04-01T19:44:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0042149910000000004 2024-04-01T19:44:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.777146+0000", 2024-04-01T19:44:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9269000000000001e-05 2024-04-01T19:44:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.791238+0000", 2024-04-01T19:44:15.045 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014092357 2024-04-01T19:44:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.791262+0000", 2024-04-01T19:44:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4425000000000001e-05 2024-04-01T19:44:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:120837 5.3 5:c9d23f1d:::benchmark_data_smithi188_119427_object120836:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e389)", 2024-04-01T19:44:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:40:26.701045+0000", 2024-04-01T19:44:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 228.30762852999999, 2024-04-01T19:44:15.046 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.090188949000000004, 2024-04-01T19:44:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:44:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:44:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 120837 2024-04-01T19:44:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.701045+0000", 2024-04-01T19:44:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.047 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.701045+0000", 2024-04-01T19:44:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.701053+0000", 2024-04-01T19:44:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6249999999999998e-06 2024-04-01T19:44:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.701085+0000", 2024-04-01T19:44:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.2638000000000002e-05 2024-04-01T19:44:15.048 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.772892+0000", 2024-04-01T19:44:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.071806439999999999 2024-04-01T19:44:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.772911+0000", 2024-04-01T19:44:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9415999999999998e-05 2024-04-01T19:44:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:15.049 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.772995+0000", 2024-04-01T19:44:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3421e-05 2024-04-01T19:44:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.773162+0000", 2024-04-01T19:44:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000167381 2024-04-01T19:44:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6", 2024-04-01T19:44:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.773326+0000", 2024-04-01T19:44:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00016415399999999999 2024-04-01T19:44:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.050 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.780918+0000", 2024-04-01T19:44:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0075921599999999997 2024-04-01T19:44:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:44:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.791134+0000", 2024-04-01T19:44:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010215771 2024-04-01T19:44:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.791180+0000", 2024-04-01T19:44:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6205999999999998e-05 2024-04-01T19:44:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.051 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:40:26.791234+0000", 2024-04-01T19:44:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3736999999999997e-05 2024-04-01T19:44:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:237068 5.3 5.e6c5d093 (undecoded) ondisk+retry+write+known_if_redirected e431)", 2024-04-01T19:44:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:34.410392+0000", 2024-04-01T19:44:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 100.59828126799999, 2024-04-01T19:44:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.15121214199999999, 2024-04-01T19:44:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:15.052 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "reached pg", 2024-04-01T19:44:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:44:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:44:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 237068 2024-04-01T19:44:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410392+0000", 2024-04-01T19:44:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:15.053 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410392+0000", 2024-04-01T19:44:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410393+0000", 2024-04-01T19:44:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.7700000000000003e-07 2024-04-01T19:44:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410397+0000", 2024-04-01T19:44:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.63e-06 2024-04-01T19:44:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.054 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410404+0000", 2024-04-01T19:44:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0709999999999997e-06 2024-04-01T19:44:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410411+0000", 2024-04-01T19:44:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2269999999999996e-06 2024-04-01T19:44:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410448+0000", 2024-04-01T19:44:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7123999999999999e-05 2024-04-01T19:44:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.055 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for peered", 2024-04-01T19:44:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410453+0000", 2024-04-01T19:44:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4499999999999997e-06 2024-04-01T19:44:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.561563+0000", 2024-04-01T19:44:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.15111068 2024-04-01T19:44:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.561604+0000", 2024-04-01T19:44:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1083e-05 2024-04-01T19:44:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:237094 5.3 5.1fb92613 (undecoded) ondisk+retry+write+known_if_redirected e431)", 2024-04-01T19:44:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:34.410431+0000", 2024-04-01T19:44:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 100.598242754, 2024-04-01T19:44:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.15129580100000001, 2024-04-01T19:44:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "reached pg", 2024-04-01T19:44:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:44:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:44:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 237094 2024-04-01T19:44:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410431+0000", 2024-04-01T19:44:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410431+0000", 2024-04-01T19:44:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.058 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410431+0000", 2024-04-01T19:44:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.6000000000000003e-07 2024-04-01T19:44:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410435+0000", 2024-04-01T19:44:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.106e-06 2024-04-01T19:44:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410441+0000", 2024-04-01T19:44:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4559999999999997e-06 2024-04-01T19:44:15.059 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.060 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.060 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:15.060 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410448+0000", 2024-04-01T19:44:15.060 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3039999999999999e-06 2024-04-01T19:44:15.060 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.060 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.060 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:15.060 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410473+0000", 2024-04-01T19:44:15.060 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4916999999999999e-05 2024-04-01T19:44:15.060 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.060 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.060 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for peered", 2024-04-01T19:44:15.060 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410477+0000", 2024-04-01T19:44:15.060 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.6229999999999999e-06 2024-04-01T19:44:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.561720+0000", 2024-04-01T19:44:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.151242669 2024-04-01T19:44:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.561727+0000", 2024-04-01T19:44:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0659999999999998e-06 2024-04-01T19:44:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.061 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:237104 5.3 5.3ce29143 (undecoded) ondisk+retry+write+known_if_redirected e431)", 2024-04-01T19:44:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:34.410458+0000", 2024-04-01T19:44:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 100.59821513999999, 2024-04-01T19:44:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.151308623, 2024-04-01T19:44:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "reached pg", 2024-04-01T19:44:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:44:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:44:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 237104 2024-04-01T19:44:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:15.062 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410458+0000", 2024-04-01T19:44:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410458+0000", 2024-04-01T19:44:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410459+0000", 2024-04-01T19:44:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4499999999999997e-07 2024-04-01T19:44:15.063 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410462+0000", 2024-04-01T19:44:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.7039999999999999e-06 2024-04-01T19:44:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410467+0000", 2024-04-01T19:44:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7209999999999999e-06 2024-04-01T19:44:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410473+0000", 2024-04-01T19:44:15.064 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2989999999999996e-06 2024-04-01T19:44:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410527+0000", 2024-04-01T19:44:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4228000000000003e-05 2024-04-01T19:44:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for peered", 2024-04-01T19:44:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410532+0000", 2024-04-01T19:44:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7400000000000004e-06 2024-04-01T19:44:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.065 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.561759+0000", 2024-04-01T19:44:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.15122697199999999 2024-04-01T19:44:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.561767+0000", 2024-04-01T19:44:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4139999999999994e-06 2024-04-01T19:44:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.066 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:237110 5.3 5.9a545a73 (undecoded) ondisk+retry+write+known_if_redirected e431)", 2024-04-01T19:44:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:34.410501+0000", 2024-04-01T19:44:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 100.598172758, 2024-04-01T19:44:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.15128334700000001, 2024-04-01T19:44:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "reached pg", 2024-04-01T19:44:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:44:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:44:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 237110 2024-04-01T19:44:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.067 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410501+0000", 2024-04-01T19:44:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410501+0000", 2024-04-01T19:44:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410501+0000", 2024-04-01T19:44:15.068 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5400000000000001e-07 2024-04-01T19:44:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410505+0000", 2024-04-01T19:44:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.4649999999999999e-06 2024-04-01T19:44:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410522+0000", 2024-04-01T19:44:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6687000000000001e-05 2024-04-01T19:44:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:15.069 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410528+0000", 2024-04-01T19:44:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.489e-06 2024-04-01T19:44:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410570+0000", 2024-04-01T19:44:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.2383999999999999e-05 2024-04-01T19:44:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for peered", 2024-04-01T19:44:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.410575+0000", 2024-04-01T19:44:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.758e-06 2024-04-01T19:44:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.070 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.561780+0000", 2024-04-01T19:44:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.15120440800000001 2024-04-01T19:44:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:34.561784+0000", 2024-04-01T19:44:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5020000000000003e-06 2024-04-01T19:44:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.9.0:104316 5.e e441/364 5:764f8a9d:::benchmark_data_smithi188_119427_object139754:head v 441'17650, mlcod=441'17634)", 2024-04-01T19:44:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:00.327050+0000", 2024-04-01T19:44:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 74.681623813000002, 2024-04-01T19:44:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.105229087, 2024-04-01T19:44:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.327050+0000", 2024-04-01T19:44:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:15.072 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.327050+0000", 2024-04-01T19:44:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.327052+0000", 2024-04-01T19:44:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3920000000000001e-06 2024-04-01T19:44:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.327063+0000", 2024-04-01T19:44:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0566e-05 2024-04-01T19:44:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:15.073 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.327078+0000", 2024-04-01T19:44:15.074 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4939e-05 2024-04-01T19:44:15.074 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.074 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.074 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:15.074 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.327088+0000", 2024-04-01T19:44:15.074 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.8679999999999994e-06 2024-04-01T19:44:15.074 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.074 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.074 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:15.074 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.355065+0000", 2024-04-01T19:44:15.074 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.027977269999999999 2024-04-01T19:44:15.074 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.074 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.075 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:15.075 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.355084+0000", 2024-04-01T19:44:15.075 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9406999999999999e-05 2024-04-01T19:44:15.075 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.075 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.075 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:15.075 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.432229+0000", 2024-04-01T19:44:15.075 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.077144698999999997 2024-04-01T19:44:15.075 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.075 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.075 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:15.075 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.432279+0000", 2024-04-01T19:44:15.075 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9945999999999999e-05 2024-04-01T19:44:15.075 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.075 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:15.076 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.076 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.076 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.076 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.9.0:104317 5.e e441/364 5:764fab96:::benchmark_data_smithi188_119427_object93654:head v 441'17651, mlcod=441'17634)", 2024-04-01T19:44:15.076 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:00.327106+0000", 2024-04-01T19:44:15.076 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 74.681567095999995, 2024-04-01T19:44:15.076 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.10520338799999999, 2024-04-01T19:44:15.076 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:15.076 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:15.076 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:15.076 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:15.076 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.076 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:15.076 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.327106+0000", 2024-04-01T19:44:15.077 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.077 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.077 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.077 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:15.077 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.327106+0000", 2024-04-01T19:44:15.077 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.077 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.077 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.077 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:15.077 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.327107+0000", 2024-04-01T19:44:15.077 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.1999999999999999e-07 2024-04-01T19:44:15.077 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.077 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.077 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:15.077 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.327113+0000", 2024-04-01T19:44:15.078 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8200000000000002e-06 2024-04-01T19:44:15.078 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.078 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.078 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:15.078 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.327120+0000", 2024-04-01T19:44:15.078 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5939999999999999e-06 2024-04-01T19:44:15.078 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.078 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.078 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:15.078 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.327128+0000", 2024-04-01T19:44:15.078 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0190000000000006e-06 2024-04-01T19:44:15.078 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.078 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.078 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:15.079 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.358694+0000", 2024-04-01T19:44:15.079 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.031566291000000003 2024-04-01T19:44:15.079 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.079 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.079 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:15.079 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.358709+0000", 2024-04-01T19:44:15.079 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4969e-05 2024-04-01T19:44:15.079 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.079 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.079 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:15.079 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.432283+0000", 2024-04-01T19:44:15.079 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.073573656000000001 2024-04-01T19:44:15.079 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.079 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.080 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:15.080 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.432310+0000", 2024-04-01T19:44:15.080 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.7319000000000001e-05 2024-04-01T19:44:15.080 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.080 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:15.080 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.080 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.080 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.080 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.9.0:104318 5.e e441/364 5:7651670a:::benchmark_data_smithi188_119427_object94738:head v 441'17652, mlcod=441'17634)", 2024-04-01T19:44:15.080 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:00.327507+0000", 2024-04-01T19:44:15.080 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 74.681166130999998, 2024-04-01T19:44:15.080 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.10482912699999999, 2024-04-01T19:44:15.080 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:15.080 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:15.081 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:15.081 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:15.081 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.081 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:15.081 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.327507+0000", 2024-04-01T19:44:15.081 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.081 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.081 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.081 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:15.081 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.327507+0000", 2024-04-01T19:44:15.081 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.081 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.081 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.081 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:15.082 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.327509+0000", 2024-04-01T19:44:15.082 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.13e-06 2024-04-01T19:44:15.082 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.082 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.082 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:15.082 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.327528+0000", 2024-04-01T19:44:15.082 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9831999999999999e-05 2024-04-01T19:44:15.082 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.082 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.082 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:15.082 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.327538+0000", 2024-04-01T19:44:15.082 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.3209999999999994e-06 2024-04-01T19:44:15.082 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.083 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.083 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:15.083 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.327545+0000", 2024-04-01T19:44:15.083 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.029e-06 2024-04-01T19:44:15.083 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.083 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.083 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:15.083 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.362220+0000", 2024-04-01T19:44:15.083 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.034674833000000002 2024-04-01T19:44:15.083 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.083 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.083 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:15.083 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.362240+0000", 2024-04-01T19:44:15.083 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0273999999999999e-05 2024-04-01T19:44:15.083 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.084 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.084 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:15.084 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.432312+0000", 2024-04-01T19:44:15.084 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.070072552999999996 2024-04-01T19:44:15.084 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.084 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.084 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:15.084 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.432337+0000", 2024-04-01T19:44:15.084 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4155000000000002e-05 2024-04-01T19:44:15.084 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.084 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:15.084 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.084 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.084 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.085 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.9.0:104319 5.e e441/364 5:7654a455:::benchmark_data_smithi188_119427_object147855:head v 441'17653, mlcod=441'17634)", 2024-04-01T19:44:15.085 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:00.329949+0000", 2024-04-01T19:44:15.085 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 74.678724493000004, 2024-04-01T19:44:15.085 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.102415086, 2024-04-01T19:44:15.085 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:15.085 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:15.085 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:15.085 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:15.085 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.085 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:15.085 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.329949+0000", 2024-04-01T19:44:15.085 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.085 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.085 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.086 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:15.086 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.329949+0000", 2024-04-01T19:44:15.086 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.086 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.086 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.086 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:15.086 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.329951+0000", 2024-04-01T19:44:15.086 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8640000000000001e-06 2024-04-01T19:44:15.086 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.086 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.086 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:15.086 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.329966+0000", 2024-04-01T19:44:15.086 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4619e-05 2024-04-01T19:44:15.086 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.087 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.087 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:15.087 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.329982+0000", 2024-04-01T19:44:15.087 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.609e-05 2024-04-01T19:44:15.087 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.087 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.087 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:15.087 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.329990+0000", 2024-04-01T19:44:15.087 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6629999999999999e-06 2024-04-01T19:44:15.087 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.087 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.087 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:15.087 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.366861+0000", 2024-04-01T19:44:15.087 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.036870356999999999 2024-04-01T19:44:15.088 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.088 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.088 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:15.088 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.366881+0000", 2024-04-01T19:44:15.088 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0310999999999999e-05 2024-04-01T19:44:15.088 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.088 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.088 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:15.088 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.432341+0000", 2024-04-01T19:44:15.088 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.065459916000000007 2024-04-01T19:44:15.088 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.088 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.088 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:15.088 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.432364+0000", 2024-04-01T19:44:15.088 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3266000000000001e-05 2024-04-01T19:44:15.089 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.089 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:15.089 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.089 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.089 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.089 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.9.0:104320 5.e e441/364 5:76551966:::benchmark_data_smithi188_119427_object132786:head v 441'17654, mlcod=441'17634)", 2024-04-01T19:44:15.089 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:00.332338+0000", 2024-04-01T19:44:15.089 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 74.676335471000002, 2024-04-01T19:44:15.089 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.100051166, 2024-04-01T19:44:15.089 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:15.089 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:15.089 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:15.089 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:15.090 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.090 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:15.090 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.332338+0000", 2024-04-01T19:44:15.090 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.090 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.090 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.090 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:15.090 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.332338+0000", 2024-04-01T19:44:15.090 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.090 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.090 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.090 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:15.090 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.332339+0000", 2024-04-01T19:44:15.090 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1960000000000001e-06 2024-04-01T19:44:15.091 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.091 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.091 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:15.091 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.332346+0000", 2024-04-01T19:44:15.091 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.533e-06 2024-04-01T19:44:15.091 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.091 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.091 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:15.091 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.332354+0000", 2024-04-01T19:44:15.091 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6200000000000005e-06 2024-04-01T19:44:15.091 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.091 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.091 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:15.091 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.332361+0000", 2024-04-01T19:44:15.092 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5799999999999997e-06 2024-04-01T19:44:15.092 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.092 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.092 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:15.092 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.370596+0000", 2024-04-01T19:44:15.092 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.038234536999999999 2024-04-01T19:44:15.092 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.092 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.092 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:15.092 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.370610+0000", 2024-04-01T19:44:15.092 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3954000000000001e-05 2024-04-01T19:44:15.092 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.092 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.092 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:15.093 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.432367+0000", 2024-04-01T19:44:15.093 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.061757102000000001 2024-04-01T19:44:15.093 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.093 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.093 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:15.093 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.432389+0000", 2024-04-01T19:44:15.093 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2643999999999999e-05 2024-04-01T19:44:15.093 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.093 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:15.093 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.093 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.093 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.093 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.9.0:104321 5.e e441/364 5:76552b74:::benchmark_data_smithi188_119427_object162546:head v 441'17655, mlcod=441'17634)", 2024-04-01T19:44:15.093 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:00.334840+0000", 2024-04-01T19:44:15.094 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 74.673833731000002, 2024-04-01T19:44:15.094 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.097575396999999994, 2024-04-01T19:44:15.094 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:15.094 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:15.094 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:15.094 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:15.094 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.094 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:15.094 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.334840+0000", 2024-04-01T19:44:15.094 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.094 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.094 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.094 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:15.094 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.334840+0000", 2024-04-01T19:44:15.095 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.095 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.095 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.095 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:15.095 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.334841+0000", 2024-04-01T19:44:15.095 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5799999999999999e-06 2024-04-01T19:44:15.095 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.095 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.095 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:15.095 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.334849+0000", 2024-04-01T19:44:15.095 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0620000000000001e-06 2024-04-01T19:44:15.095 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.095 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.095 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:15.096 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.334859+0000", 2024-04-01T19:44:15.096 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.7389999999999994e-06 2024-04-01T19:44:15.096 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.096 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.096 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:15.096 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.334866+0000", 2024-04-01T19:44:15.096 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.1570000000000003e-06 2024-04-01T19:44:15.096 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.096 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.096 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:15.096 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.373916+0000", 2024-04-01T19:44:15.096 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.039049934000000001 2024-04-01T19:44:15.096 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.096 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.096 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:15.097 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.373934+0000", 2024-04-01T19:44:15.097 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7719000000000001e-05 2024-04-01T19:44:15.097 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.097 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.097 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:15.097 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.432391+0000", 2024-04-01T19:44:15.097 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.058457132000000002 2024-04-01T19:44:15.097 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.097 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.097 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:15.097 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.432415+0000", 2024-04-01T19:44:15.097 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4074e-05 2024-04-01T19:44:15.097 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.097 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:15.098 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.098 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.098 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.098 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.9.0:104322 5.e e441/364 5:76557d76:::benchmark_data_smithi188_119427_object135653:head v 441'17656, mlcod=441'17634)", 2024-04-01T19:44:15.098 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:00.337614+0000", 2024-04-01T19:44:15.098 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 74.671059373999995, 2024-04-01T19:44:15.098 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.094825968999999996, 2024-04-01T19:44:15.098 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:15.098 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:15.098 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:15.098 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:15.098 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.098 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:15.098 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.337614+0000", 2024-04-01T19:44:15.099 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.099 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.099 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.099 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:15.099 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.337614+0000", 2024-04-01T19:44:15.099 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.099 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.099 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.099 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:15.099 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.337615+0000", 2024-04-01T19:44:15.099 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1429999999999999e-06 2024-04-01T19:44:15.099 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.099 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.099 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:15.099 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.337623+0000", 2024-04-01T19:44:15.100 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.1249999999999993e-06 2024-04-01T19:44:15.100 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.100 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.100 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:15.100 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.337632+0000", 2024-04-01T19:44:15.100 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.037e-06 2024-04-01T19:44:15.100 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.100 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.100 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:15.100 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.337639+0000", 2024-04-01T19:44:15.100 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4869999999999999e-06 2024-04-01T19:44:15.100 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.100 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.100 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:15.101 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.377556+0000", 2024-04-01T19:44:15.101 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.039917049000000003 2024-04-01T19:44:15.101 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.101 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.101 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:15.101 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.377575+0000", 2024-04-01T19:44:15.101 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8984e-05 2024-04-01T19:44:15.101 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.101 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.101 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:15.101 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.432417+0000", 2024-04-01T19:44:15.101 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.054842283999999998 2024-04-01T19:44:15.101 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.101 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.101 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:15.102 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.432440+0000", 2024-04-01T19:44:15.102 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2860000000000001e-05 2024-04-01T19:44:15.102 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.102 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:15.102 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.102 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.102 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.102 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(osd.9.0:104323 5.e e441/364 5:7655818d:::benchmark_data_smithi188_119427_object105664:head v 441'17657, mlcod=441'17634)", 2024-04-01T19:44:15.102 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:00.340852+0000", 2024-04-01T19:44:15.102 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 74.667821571999994, 2024-04-01T19:44:15.102 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.091612091000000007, 2024-04-01T19:44:15.102 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:15.102 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:15.103 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:15.103 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:15.103 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.103 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:15.103 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.340852+0000", 2024-04-01T19:44:15.103 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.103 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.103 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.103 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:15.103 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.340852+0000", 2024-04-01T19:44:15.103 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:15.103 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.103 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.104 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:15.104 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.340854+0000", 2024-04-01T19:44:15.104 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.525e-06 2024-04-01T19:44:15.104 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.104 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.104 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:15.104 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.340863+0000", 2024-04-01T19:44:15.104 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.1349999999999998e-06 2024-04-01T19:44:15.104 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.104 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.104 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:15.104 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.340875+0000", 2024-04-01T19:44:15.104 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.26e-05 2024-04-01T19:44:15.104 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.104 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.105 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:15.105 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.340883+0000", 2024-04-01T19:44:15.105 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3509999999999996e-06 2024-04-01T19:44:15.105 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.105 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.105 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:15.105 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.382139+0000", 2024-04-01T19:44:15.105 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.041255931000000003 2024-04-01T19:44:15.105 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.105 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.105 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:15.105 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.382160+0000", 2024-04-01T19:44:15.105 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1540999999999999e-05 2024-04-01T19:44:15.105 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.105 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.106 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:15.106 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.432442+0000", 2024-04-01T19:44:15.106 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.050282380000000002 2024-04-01T19:44:15.106 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:15.106 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:15.106 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:15.106 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.432464+0000", 2024-04-01T19:44:15.106 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1628e-05 2024-04-01T19:44:15.106 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.106 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:15.106 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.106 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:15.106 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:15.107 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:44:15.198 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_3 2024-04-01T19:44:15.199 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pool rm unique_pool_3 unique_pool_3 --yes-i-really-really-mean-it 2024-04-01T19:44:15.281 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:15 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:44:15.281 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:15 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:44:15.281 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:15 smithi022 ceph-mon[39439]: pgmap v1282: 17 pgs: 17 active+clean; 1.3 MiB data, 3.9 GiB used, 890 GiB / 894 GiB avail; 0 B/s wr, 717 op/s 2024-04-01T19:44:15.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:15 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:44:15.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:15 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:44:15.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:15 smithi062 ceph-mon[44211]: pgmap v1282: 17 pgs: 17 active+clean; 1.3 MiB data, 3.9 GiB used, 890 GiB / 894 GiB avail; 0 B/s wr, 717 op/s 2024-04-01T19:44:15.558 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:44:15.569 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:15.569 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:44:15.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:15 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:44:15.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:15 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:44:15.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:15 smithi188 ceph-mon[43939]: pgmap v1282: 17 pgs: 17 active+clean; 1.3 MiB data, 3.9 GiB used, 890 GiB / 894 GiB avail; 0 B/s wr, 717 op/s 2024-04-01T19:44:15.670 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:44:15.702 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:15.723 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:44:15.726 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:15.726 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:44:15.828 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:44:15.857 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:15.877 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:44:15.880 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:15.880 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:44:15.895 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_ops_in_flight 2024-04-01T19:44:15.980 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:44:16.009 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:16.259 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:44:16.262 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:16.262 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:44:16.363 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:44:16.391 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:16.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:16 smithi062 ceph-mon[44211]: osdmap e461: 12 total, 12 up, 10 in 2024-04-01T19:44:16.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:16 smithi022 ceph-mon[39439]: osdmap e461: 12 total, 12 up, 10 in 2024-04-01T19:44:16.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:16 smithi188 ceph-mon[43939]: osdmap e461: 12 total, 12 up, 10 in 2024-04-01T19:44:16.723 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:44:16.941 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:44:16.946 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:16.946 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:44:17.047 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:44:17.080 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:17.101 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:44:17.104 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:17.104 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:44:17.205 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:44:17.236 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:17.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:17 smithi062 ceph-mon[44211]: pgmap v1284: 17 pgs: 17 active+clean; 577 KiB data, 3.9 GiB used, 890 GiB / 894 GiB avail; 0 B/s wr, 585 op/s 2024-04-01T19:44:17.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:17 smithi022 ceph-mon[39439]: pgmap v1284: 17 pgs: 17 active+clean; 577 KiB data, 3.9 GiB used, 890 GiB / 894 GiB avail; 0 B/s wr, 585 op/s 2024-04-01T19:44:17.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:17 smithi188 ceph-mon[43939]: pgmap v1284: 17 pgs: 17 active+clean; 577 KiB data, 3.9 GiB used, 890 GiB / 894 GiB avail; 0 B/s wr, 585 op/s 2024-04-01T19:44:17.984 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:44:17.990 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:17.990 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:44:18.091 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:44:18.123 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:18.145 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:44:18.148 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:18.148 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:44:18.249 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:44:18.278 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:18.298 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:44:18.300 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:18.301 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:44:18.350 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:44:18.350 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:44:18.401 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:44:18.432 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:18.539 INFO:teuthology.orchestra.run.smithi022.stderr:marked in osd.8. 2024-04-01T19:44:18.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:18 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[39416]: 2024-04-01T19:44:18.484+0000 7fd025a9f700 -1 mon.a@0(leader).osd e461 definitely_dead 0 2024-04-01T19:44:18.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:18 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3983591561' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["8"]}]: dispatch 2024-04-01T19:44:18.811 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:44:18.815 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:18.816 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:44:18.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:18 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3983591561' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["8"]}]: dispatch 2024-04-01T19:44:18.916 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:44:18.948 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:18.969 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:44:18.972 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:18.973 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:44:19.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:18 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3983591561' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["8"]}]: dispatch 2024-04-01T19:44:19.074 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:44:19.104 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:19.252 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:44:19.254 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:19.255 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:44:19.356 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:44:19.388 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:19.409 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:44:19.412 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:19.412 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:44:19.466 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:44:19.513 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:44:19.547 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:19.570 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:44:19.572 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:19.573 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:44:19.674 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:44:19.703 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:19 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3983591561' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["8"]}]': finished 2024-04-01T19:44:19.703 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:19 smithi188 ceph-mon[43939]: osdmap e462: 12 total, 12 up, 11 in 2024-04-01T19:44:19.703 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:19 smithi188 ceph-mon[43939]: pgmap v1286: 17 pgs: 17 active+clean; 577 KiB data, 3.9 GiB used, 890 GiB / 894 GiB avail; 0 B/s wr, 83 op/s 2024-04-01T19:44:19.705 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:19.727 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:44:19.730 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:19.730 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:44:19.831 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:44:19.857 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:19 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3983591561' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["8"]}]': finished 2024-04-01T19:44:19.857 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:19 smithi022 ceph-mon[39439]: osdmap e462: 12 total, 12 up, 11 in 2024-04-01T19:44:19.857 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:19 smithi022 ceph-mon[39439]: pgmap v1286: 17 pgs: 17 active+clean; 577 KiB data, 3.9 GiB used, 890 GiB / 894 GiB avail; 0 B/s wr, 83 op/s 2024-04-01T19:44:19.860 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:20.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:19 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3983591561' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["8"]}]': finished 2024-04-01T19:44:20.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:19 smithi062 ceph-mon[44211]: osdmap e462: 12 total, 12 up, 11 in 2024-04-01T19:44:20.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:19 smithi062 ceph-mon[44211]: pgmap v1286: 17 pgs: 17 active+clean; 577 KiB data, 3.9 GiB used, 890 GiB / 894 GiB avail; 0 B/s wr, 83 op/s 2024-04-01T19:44:20.087 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:44:20.089 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:20.090 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:44:20.095 INFO:tasks.thrashosds.thrasher:Added osd 8 2024-04-01T19:44:20.191 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:44:20.219 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:20.368 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:44:20.371 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:20.371 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:44:20.472 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:44:20.503 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:20.524 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:44:20.527 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:20.527 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:44:20.555 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:20 smithi022 ceph-mon[39439]: osdmap e463: 12 total, 12 up, 11 in 2024-04-01T19:44:20.628 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:44:20.662 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:20.683 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:44:20.686 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:20.686 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:44:20.787 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:44:20.816 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:20 smithi062 ceph-mon[44211]: osdmap e463: 12 total, 12 up, 11 in 2024-04-01T19:44:20.819 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:20.839 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:44:20.841 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:20.842 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:44:20.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:20 smithi188 ceph-mon[43939]: osdmap e463: 12 total, 12 up, 11 in 2024-04-01T19:44:20.943 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:44:20.973 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:21.564 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:44:21.623 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:44:21.629 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:21.630 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:44:21.731 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:44:21.763 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:21.785 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:44:21.787 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:21.788 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:44:21.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:21 smithi022 ceph-mon[39439]: 5.a starting backfill to osd.8 from (0'0,0'0] MAX to 459'20850 2024-04-01T19:44:21.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:21 smithi022 ceph-mon[39439]: osdmap e464: 12 total, 12 up, 11 in 2024-04-01T19:44:21.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:21 smithi022 ceph-mon[39439]: 5.e starting backfill to osd.8 from (0'0,0'0] MAX to 459'22814 2024-04-01T19:44:21.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:21 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/39708264' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:44:21.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:21 smithi022 ceph-mon[39439]: pgmap v1289: 17 pgs: 1 remapped+peering, 16 active+clean; 577 KiB data, 4.0 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1 op/s 2024-04-01T19:44:21.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:21 smithi188 ceph-mon[43939]: 5.a starting backfill to osd.8 from (0'0,0'0] MAX to 459'20850 2024-04-01T19:44:21.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:21 smithi188 ceph-mon[43939]: osdmap e464: 12 total, 12 up, 11 in 2024-04-01T19:44:21.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:21 smithi188 ceph-mon[43939]: 5.e starting backfill to osd.8 from (0'0,0'0] MAX to 459'22814 2024-04-01T19:44:21.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:21 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/39708264' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:44:21.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:21 smithi188 ceph-mon[43939]: pgmap v1289: 17 pgs: 1 remapped+peering, 16 active+clean; 577 KiB data, 4.0 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1 op/s 2024-04-01T19:44:21.889 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:44:21.916 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:22.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:21 smithi062 ceph-mon[44211]: 5.a starting backfill to osd.8 from (0'0,0'0] MAX to 459'20850 2024-04-01T19:44:22.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:21 smithi062 ceph-mon[44211]: osdmap e464: 12 total, 12 up, 11 in 2024-04-01T19:44:22.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:21 smithi062 ceph-mon[44211]: 5.e starting backfill to osd.8 from (0'0,0'0] MAX to 459'22814 2024-04-01T19:44:22.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:21 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/39708264' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:44:22.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:21 smithi062 ceph-mon[44211]: pgmap v1289: 17 pgs: 1 remapped+peering, 16 active+clean; 577 KiB data, 4.0 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1 op/s 2024-04-01T19:44:22.812 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:22 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:44:22.812 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:22 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/39708264' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:44:22.812 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:22 smithi022 ceph-mon[39439]: osdmap e465: 12 total, 12 up, 11 in 2024-04-01T19:44:22.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:22 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:44:22.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:22 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/39708264' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:44:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:22 smithi188 ceph-mon[43939]: osdmap e465: 12 total, 12 up, 11 in 2024-04-01T19:44:23.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:22 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:44:23.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:22 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/39708264' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:44:23.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:22 smithi062 ceph-mon[44211]: osdmap e465: 12 total, 12 up, 11 in 2024-04-01T19:44:23.841 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:23 smithi022 ceph-mon[39439]: osdmap e466: 12 total, 12 up, 11 in 2024-04-01T19:44:23.841 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:23 smithi022 ceph-mon[39439]: pgmap v1292: 17 pgs: 1 peering, 1 remapped+peering, 15 active+clean; 577 KiB data, 4.0 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:44:23.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:23 smithi188 ceph-mon[43939]: osdmap e466: 12 total, 12 up, 11 in 2024-04-01T19:44:23.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:23 smithi188 ceph-mon[43939]: pgmap v1292: 17 pgs: 1 peering, 1 remapped+peering, 15 active+clean; 577 KiB data, 4.0 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:44:24.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:23 smithi062 ceph-mon[44211]: osdmap e466: 12 total, 12 up, 11 in 2024-04-01T19:44:24.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:23 smithi062 ceph-mon[44211]: pgmap v1292: 17 pgs: 1 peering, 1 remapped+peering, 15 active+clean; 577 KiB data, 4.0 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:44:24.067 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:44:24.071 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:24.071 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:44:24.172 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:44:24.205 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:44:24.229 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:24.230 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:44:24.331 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:44:24.362 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:24.396 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:44:24.396 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:44:24.396 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 0 2024-04-01T19:44:24.396 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:44:24.840 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:44:24.853 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'unique_pool_3' removed 2024-04-01T19:44:25.096 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 9, 10, 11, 8] out_osds: [6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 7, 9, 10, 11, 8, 6] 2024-04-01T19:44:25.096 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-01T19:44:25.097 INFO:tasks.thrashosds.thrasher:Adding osd 6 2024-04-01T19:44:25.097 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd in 6 2024-04-01T19:44:25.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:24 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3339864608' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:44:25.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:24 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3339864608' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:44:25.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:24 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3339864608' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:44:26.012 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:44:26.015 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:26.016 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:44:26.049 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_blocked_ops 2024-04-01T19:44:26.110 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:25 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3339864608' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T19:44:26.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:25 smithi022 ceph-mon[39439]: osdmap e467: 12 total, 12 up, 11 in 2024-04-01T19:44:26.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:25 smithi022 ceph-mon[39439]: pgmap v1294: 1 pgs: 1 active+clean; 577 KiB data, 4.0 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:44:26.117 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:44:26.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:25 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3339864608' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T19:44:26.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:25 smithi188 ceph-mon[43939]: osdmap e467: 12 total, 12 up, 11 in 2024-04-01T19:44:26.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:25 smithi188 ceph-mon[43939]: pgmap v1294: 1 pgs: 1 active+clean; 577 KiB data, 4.0 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:44:26.147 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:25 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3339864608' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T19:44:26.147 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:25 smithi062 ceph-mon[44211]: osdmap e467: 12 total, 12 up, 11 in 2024-04-01T19:44:26.147 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:25 smithi062 ceph-mon[44211]: pgmap v1294: 1 pgs: 1 active+clean; 577 KiB data, 4.0 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:44:26.150 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:26.172 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:44:26.174 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:26.175 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:44:26.276 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:44:26.308 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:26.329 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:44:26.331 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:26.332 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:44:26.433 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:44:26.461 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:26.499 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:44:26.501 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:26.502 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:44:26.603 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:44:26.633 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:26.654 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:44:26.657 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:26.657 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:44:26.758 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:44:26.791 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:26.814 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:44:26.816 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:26.817 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:44:26.889 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:44:26.917 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:44:26.929 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:44:26.933 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:44:26.945 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:44:26.949 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:26.967 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:44:26.971 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:44:26.973 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:26.973 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:44:26.986 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:44:27.005 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:44:27.027 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:44:27.047 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:44:27.069 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:44:27.075 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:44:27.090 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:44:27.106 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:27.110 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:44:27.128 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:44:27.131 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:44:27.132 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:27.132 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:44:27.152 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:44:27.172 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:44:27.173 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:44:27.174 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:44:27.174 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:44:27.174 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:44:27.174 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:44:27.174 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:44:27.174 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:44:27.174 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:44:27.174 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:44:27.174 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:44:27.174 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:44:27.217 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:26 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2223991704' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:44:27.232 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:44:27.259 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:26 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2223991704' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:44:27.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:26 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2223991704' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:44:27.261 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:27.280 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:44:27.283 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:27.283 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:44:27.384 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:44:27.412 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:27.431 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:44:27.433 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:27.434 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:44:27.534 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:44:27.566 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:28.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:27 smithi022 ceph-mon[39439]: pgmap v1295: 1 pgs: 1 active+clean; 577 KiB data, 4.0 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:44:28.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:27 smithi062 ceph-mon[44211]: pgmap v1295: 1 pgs: 1 active+clean; 577 KiB data, 4.0 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:44:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:27 smithi188 ceph-mon[43939]: pgmap v1295: 1 pgs: 1 active+clean; 577 KiB data, 4.0 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:44:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:28.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:29.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:28 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:29.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:28 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:29.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:28 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:29.817 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:44:29.820 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:29.821 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:44:29.922 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:44:29.955 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:29.978 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:44:29.981 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:29.981 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:44:30.061 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:29 smithi022 ceph-mon[39439]: pgmap v1296: 1 pgs: 1 active+clean; 577 KiB data, 4.0 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:44:30.082 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:44:30.114 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:30.134 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:44:30.137 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:30.138 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:44:30.239 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:44:30.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:29 smithi062 ceph-mon[44211]: pgmap v1296: 1 pgs: 1 active+clean; 577 KiB data, 4.0 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:44:30.266 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:29 smithi188 ceph-mon[43939]: pgmap v1296: 1 pgs: 1 active+clean; 577 KiB data, 4.0 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:44:30.268 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:30.288 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:44:30.291 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:30.291 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:44:30.392 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:44:30.420 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:30.439 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:44:30.441 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:30.442 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:44:30.543 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:44:30.578 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:30.599 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:44:30.602 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:30.605 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:44:30.632 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-04-01T19:44:30.633 INFO:tasks.radosbench:Beginning radosbench... 2024-04-01T19:44:30.633 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_4 2024-04-01T19:44:30.634 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pool create unique_pool_4 16 2024-04-01T19:44:30.706 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:44:30.739 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:30.762 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:44:30.765 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:30.765 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:44:30.866 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:44:30.898 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:30.919 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:44:30.921 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:30.922 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:44:31.022 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:44:31.053 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:31.073 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:44:31.076 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:31.076 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:44:31.177 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:44:31.206 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:31.210 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:44:31.210 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:44:31.229 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:44:31.231 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:31.231 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:44:31.332 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:44:31.358 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:31 smithi062 ceph-mon[44211]: pgmap v1297: 1 pgs: 1 active+clean; 577 KiB data, 4.0 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:44:31.361 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:31.380 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:44:31.382 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:31.383 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:44:31.484 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:44:31.488 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:31 smithi022 ceph-mon[39439]: pgmap v1297: 1 pgs: 1 active+clean; 577 KiB data, 4.0 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:44:31.512 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:31.531 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:44:31.534 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:31.534 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:44:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:31 smithi188 ceph-mon[43939]: pgmap v1297: 1 pgs: 1 active+clean; 577 KiB data, 4.0 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:44:31.635 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:44:31.667 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:31.687 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:44:31.690 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:31.691 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:44:31.791 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:44:31.821 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:31.841 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:44:31.844 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:31.844 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:44:31.945 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:44:31.974 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:31.993 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:44:31.996 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:31.996 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:44:32.097 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:44:32.128 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:32.276 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:44:32.280 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:32.280 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:44:32.381 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:44:32.409 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:32.759 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:44:32.762 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:32.763 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:44:32.774 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_historic_ops 2024-04-01T19:44:32.863 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:44:32.896 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:32.918 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:44:32.921 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:32.922 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:44:32.954 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:44:33.022 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:44:33.054 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:33.075 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:44:33.078 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:33.078 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:44:33.179 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:44:33.209 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:33.229 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:44:33.231 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:33.231 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:44:33.332 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:44:33.364 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:33.385 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:44:33.388 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:33.388 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:44:33.446 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:44:33.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:33 smithi022 ceph-mon[39439]: pgmap v1298: 1 pgs: 1 active+clean; 577 KiB data, 4.0 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:44:33.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:33 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[39416]: 2024-04-01T19:44:33.381+0000 7fd025a9f700 -1 mon.a@0(leader).osd e467 definitely_dead 0 2024-04-01T19:44:33.489 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:44:33.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:33 smithi062 ceph-mon[44211]: pgmap v1298: 1 pgs: 1 active+clean; 577 KiB data, 4.0 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:44:33.518 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:33.546 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:44:33.549 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:33.550 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:44:33.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:33 smithi188 ceph-mon[43939]: pgmap v1298: 1 pgs: 1 active+clean; 577 KiB data, 4.0 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:44:33.650 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:44:33.684 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:33.707 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:44:33.710 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:33.710 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:44:33.811 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:44:33.842 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:33.863 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:44:33.866 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:33.867 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:44:33.967 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:44:33.997 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:34.017 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:44:34.019 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:34.020 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:44:34.121 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:44:34.150 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:34.198 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:44:34.201 INFO:teuthology.orchestra.run.smithi022.stderr:marked in osd.6. 2024-04-01T19:44:34.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:34 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1328794928' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["6"]}]: dispatch 2024-04-01T19:44:34.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:34 smithi062 ceph-mon[44211]: from='client.36338 ' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["6"]}]: dispatch 2024-04-01T19:44:34.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:34 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3784194194' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:44:34.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:34 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1328794928' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["6"]}]: dispatch 2024-04-01T19:44:34.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:34 smithi022 ceph-mon[39439]: from='client.36338 ' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["6"]}]: dispatch 2024-04-01T19:44:34.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:34 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3784194194' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:44:34.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:34 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1328794928' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["6"]}]: dispatch 2024-04-01T19:44:34.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:34 smithi188 ceph-mon[43939]: from='client.36338 ' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["6"]}]: dispatch 2024-04-01T19:44:34.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:34 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3784194194' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:44:35.190 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:44:35.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:35 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:44:35.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:35 smithi062 ceph-mon[44211]: from='client.36338 ' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["6"]}]': finished 2024-04-01T19:44:35.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:35 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3784194194' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:44:35.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:35 smithi062 ceph-mon[44211]: osdmap e468: 12 total, 12 up, 12 in 2024-04-01T19:44:35.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:35 smithi062 ceph-mon[44211]: pgmap v1300: 1 pgs: 1 active+clean; 577 KiB data, 4.0 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:44:35.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:35 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:44:35.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:35 smithi022 ceph-mon[39439]: from='client.36338 ' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["6"]}]': finished 2024-04-01T19:44:35.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:35 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3784194194' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:44:35.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:35 smithi022 ceph-mon[39439]: osdmap e468: 12 total, 12 up, 12 in 2024-04-01T19:44:35.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:35 smithi022 ceph-mon[39439]: pgmap v1300: 1 pgs: 1 active+clean; 577 KiB data, 4.0 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:44:35.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:35 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:44:35.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:35 smithi188 ceph-mon[43939]: from='client.36338 ' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["6"]}]': finished 2024-04-01T19:44:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:35 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3784194194' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:44:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:35 smithi188 ceph-mon[43939]: osdmap e468: 12 total, 12 up, 12 in 2024-04-01T19:44:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:35 smithi188 ceph-mon[43939]: pgmap v1300: 1 pgs: 1 active+clean; 577 KiB data, 4.0 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:44:35.776 INFO:tasks.thrashosds.thrasher:Added osd 6 2024-04-01T19:44:37.186 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:44:37.331 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:44:37.333 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:37 smithi022 ceph-mon[39439]: pgmap v1301: 1 pgs: 1 active+clean; 577 KiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:44:37.334 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:37.335 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:44:37.435 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:44:37.466 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:37 smithi062 ceph-mon[44211]: pgmap v1301: 1 pgs: 1 active+clean; 577 KiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:44:37.469 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:37.491 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:44:37.493 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:37.494 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:44:37.595 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:44:37.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:37 smithi188 ceph-mon[43939]: pgmap v1301: 1 pgs: 1 active+clean; 577 KiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:44:37.626 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:37.647 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:44:37.650 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:37.650 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:44:37.680 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:44:37.751 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:44:37.783 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:37.804 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:44:37.807 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:37.807 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:44:37.908 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:44:37.939 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:37.959 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:44:37.962 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:37.962 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:44:38.063 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:44:38.096 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:38.118 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:44:38.121 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:38.122 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:44:38.223 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:44:38.254 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:38.275 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:44:38.278 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:38.278 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:44:38.379 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:44:38.409 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:38.428 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:44:38.431 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:38.432 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:44:38.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:38 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2329745186' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]: dispatch 2024-04-01T19:44:38.532 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:44:38.566 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:38.588 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:44:38.591 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:38.591 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:44:38.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:38 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2329745186' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]: dispatch 2024-04-01T19:44:38.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:38 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2329745186' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]: dispatch 2024-04-01T19:44:38.692 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:44:38.722 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:38.742 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:44:38.745 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:38.746 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:44:38.847 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:44:38.853 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:44:38.874 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:44:38.875 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:38.894 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:44:38.894 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:44:38.897 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:38.897 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:44:38.913 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:44:38.933 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:44:38.954 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:44:38.974 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:44:38.994 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:44:38.998 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:44:39.015 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:44:39.031 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:39.035 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:44:39.054 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:44:39.055 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:44:39.057 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:39.057 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:44:39.075 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:44:39.076 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:44:39.077 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:44:39.077 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:44:39.077 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:44:39.077 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:44:39.077 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:44:39.077 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:44:39.077 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:44:39.077 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:44:39.077 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:44:39.077 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:44:39.077 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:44:39.158 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:44:39.189 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:39.213 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:44:39.215 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:39.216 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:44:39.317 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:44:39.347 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:39.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:39 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2329745186' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]': finished 2024-04-01T19:44:39.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:39 smithi022 ceph-mon[39439]: osdmap e469: 12 total, 12 up, 12 in 2024-04-01T19:44:39.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:39 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/531941962' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:44:39.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:39.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:39 smithi022 ceph-mon[39439]: pgmap v1303: 17 pgs: 3 creating+peering, 1 active+clean, 13 unknown; 577 KiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:44:39.497 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:44:39.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:39 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2329745186' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]': finished 2024-04-01T19:44:39.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:39 smithi062 ceph-mon[44211]: osdmap e469: 12 total, 12 up, 12 in 2024-04-01T19:44:39.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:39 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/531941962' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:44:39.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:39.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:39 smithi062 ceph-mon[44211]: pgmap v1303: 17 pgs: 3 creating+peering, 1 active+clean, 13 unknown; 577 KiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:44:39.513 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:39.513 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:44:39.614 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:44:39.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:39 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2329745186' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]': finished 2024-04-01T19:44:39.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:39 smithi188 ceph-mon[43939]: osdmap e469: 12 total, 12 up, 12 in 2024-04-01T19:44:39.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:39 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/531941962' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:44:39.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:39.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:39 smithi188 ceph-mon[43939]: pgmap v1303: 17 pgs: 3 creating+peering, 1 active+clean, 13 unknown; 577 KiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:44:39.647 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:39.669 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:44:39.672 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:39.672 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:44:39.773 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:44:39.805 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:39.827 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:44:39.830 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:39.830 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:44:39.931 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:44:39.963 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'unique_pool_4' created 2024-04-01T19:44:39.963 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:39.983 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:44:39.986 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:39.986 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:44:40.087 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:44:40.119 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:40.140 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:44:40.142 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:40.143 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:44:40.244 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:44:40.273 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.273 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.273 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.273 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.273 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.273 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.273 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:40 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:44:40.273 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:40 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:44:40.273 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.273 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.274 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.274 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.274 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.274 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:40 smithi188 ceph-mon[43939]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T19:44:40.274 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:40 smithi188 ceph-mon[43939]: osdmap e470: 12 total, 12 up, 12 in 2024-04-01T19:44:40.275 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:40.296 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:44:40.299 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:40.299 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:44:40.376 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.377 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.377 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.377 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.377 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.377 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.377 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:40 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:44:40.377 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:40 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:44:40.377 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.377 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.377 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.377 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.377 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.377 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:40 smithi022 ceph-mon[39439]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T19:44:40.378 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:40 smithi022 ceph-mon[39439]: osdmap e470: 12 total, 12 up, 12 in 2024-04-01T19:44:40.400 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:44:40.433 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:40.455 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:44:40.458 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:40.458 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:44:40.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:40 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:44:40.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:40 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:44:40.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:40.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:40 smithi062 ceph-mon[44211]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T19:44:40.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:40 smithi062 ceph-mon[44211]: osdmap e470: 12 total, 12 up, 12 in 2024-04-01T19:44:40.559 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:44:40.591 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:40.612 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:44:40.614 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:40.614 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:44:40.715 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:44:40.732 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:44:40.732 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 20, 2024-04-01T19:44:40.732 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 600, 2024-04-01T19:44:40.732 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:44:40.732 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.732 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280259 4.a 4:5aaeadf0:::benchmark_data_smithi188_104537_object108265:head [delete] snapc 0=[] ondisk+write+known_if_redirected e341)", 2024-04-01T19:44:40.732 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:02.880407+0000", 2024-04-01T19:44:40.732 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 397.851878398, 2024-04-01T19:44:40.732 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.37092404699999998, 2024-04-01T19:44:40.732 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:40.732 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:40.733 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:40.733 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:40.733 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:44:40.733 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:44:40.733 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280259 2024-04-01T19:44:40.733 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.733 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:40.733 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.733 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:40.733 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.880407+0000", 2024-04-01T19:44:40.733 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.733 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.733 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.733 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:40.733 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.880407+0000", 2024-04-01T19:44:40.734 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.734 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.734 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.734 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:40.734 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.880408+0000", 2024-04-01T19:44:40.734 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.203e-06 2024-04-01T19:44:40.734 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.734 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.734 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:40.734 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.880412+0000", 2024-04-01T19:44:40.734 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.0439999999999997e-06 2024-04-01T19:44:40.734 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.734 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.734 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:40.735 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.880419+0000", 2024-04-01T19:44:40.735 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0570000000000004e-06 2024-04-01T19:44:40.735 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.735 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.735 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:40.735 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.880426+0000", 2024-04-01T19:44:40.735 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0949999999999998e-06 2024-04-01T19:44:40.735 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.735 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.735 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:40.735 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.043602+0000", 2024-04-01T19:44:40.735 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.16317563700000001 2024-04-01T19:44:40.735 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.735 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.736 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:40.736 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.043737+0000", 2024-04-01T19:44:40.736 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013481999999999999 2024-04-01T19:44:40.736 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.736 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.736 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:44:40.736 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.043823+0000", 2024-04-01T19:44:40.736 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6428000000000007e-05 2024-04-01T19:44:40.736 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.736 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.736 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:44:40.736 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.047945+0000", 2024-04-01T19:44:40.736 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0041217750000000003 2024-04-01T19:44:40.736 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.736 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.736 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.737 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.057853+0000", 2024-04-01T19:44:40.737 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0099078080000000006 2024-04-01T19:44:40.737 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.737 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.737 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.737 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.251133+0000", 2024-04-01T19:44:40.737 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.19328063300000001 2024-04-01T19:44:40.737 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.737 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.737 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:40.737 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.251197+0000", 2024-04-01T19:44:40.737 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3244999999999995e-05 2024-04-01T19:44:40.737 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.737 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.737 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:40.738 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.251331+0000", 2024-04-01T19:44:40.738 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013430199999999999 2024-04-01T19:44:40.738 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.738 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:40.738 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.738 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.738 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.738 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280279 4.a 4:5474afe5:::benchmark_data_smithi188_104537_object108285:head [delete] snapc 0=[] ondisk+write+known_if_redirected e341)", 2024-04-01T19:44:40.738 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:02.918543+0000", 2024-04-01T19:44:40.738 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 397.81374209400002, 2024-04-01T19:44:40.738 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.33306474000000003, 2024-04-01T19:44:40.738 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:40.738 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:40.739 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:40.739 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:40.739 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:44:40.739 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:44:40.739 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280279 2024-04-01T19:44:40.739 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.739 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:40.739 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.739 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:40.739 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.918543+0000", 2024-04-01T19:44:40.739 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.739 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.739 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.739 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:40.740 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.918543+0000", 2024-04-01T19:44:40.740 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.740 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.740 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.740 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:40.740 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.918545+0000", 2024-04-01T19:44:40.740 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6729999999999999e-06 2024-04-01T19:44:40.740 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.740 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.740 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:40.740 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.918550+0000", 2024-04-01T19:44:40.740 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3680000000000001e-06 2024-04-01T19:44:40.740 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.740 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.740 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:40.741 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.918561+0000", 2024-04-01T19:44:40.741 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0621e-05 2024-04-01T19:44:40.741 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.741 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.741 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:40.741 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.918567+0000", 2024-04-01T19:44:40.741 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2190000000000001e-06 2024-04-01T19:44:40.741 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.741 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.741 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:40.741 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.048050+0000", 2024-04-01T19:44:40.741 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.12948316300000001 2024-04-01T19:44:40.741 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.741 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.741 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:40.742 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.048134+0000", 2024-04-01T19:44:40.742 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3809999999999999e-05 2024-04-01T19:44:40.742 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.742 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.742 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:44:40.742 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.048249+0000", 2024-04-01T19:44:40.742 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000114777 2024-04-01T19:44:40.742 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.742 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.742 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:44:40.742 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.057218+0000", 2024-04-01T19:44:40.742 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0089692220000000007 2024-04-01T19:44:40.742 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.742 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.742 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.743 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.057903+0000", 2024-04-01T19:44:40.743 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00068458699999999996 2024-04-01T19:44:40.743 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.743 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.743 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.743 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.251396+0000", 2024-04-01T19:44:40.743 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.19349359399999999 2024-04-01T19:44:40.743 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.743 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.743 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:40.743 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.251465+0000", 2024-04-01T19:44:40.743 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8649e-05 2024-04-01T19:44:40.743 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.743 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.743 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:40.743 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.251608+0000", 2024-04-01T19:44:40.744 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014305700000000001 2024-04-01T19:44:40.744 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.744 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:40.744 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.744 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.744 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.744 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280289 4.a 4:507b84db:::benchmark_data_smithi188_104537_object108295:head [delete] snapc 0=[] ondisk+write+known_if_redirected e341)", 2024-04-01T19:44:40.744 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:02.936137+0000", 2024-04-01T19:44:40.744 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 397.79614793399998, 2024-04-01T19:44:40.744 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.315722528, 2024-04-01T19:44:40.744 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:40.744 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:40.744 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:40.744 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:40.744 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:44:40.744 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:44:40.744 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280289 2024-04-01T19:44:40.745 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.745 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:40.745 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.745 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:40.745 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.936137+0000", 2024-04-01T19:44:40.745 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.745 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.745 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.745 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:40.745 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.936137+0000", 2024-04-01T19:44:40.745 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.745 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.745 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.745 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:40.745 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.936139+0000", 2024-04-01T19:44:40.746 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5770000000000001e-06 2024-04-01T19:44:40.746 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.746 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.746 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:40.746 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.936144+0000", 2024-04-01T19:44:40.746 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7489999999999998e-06 2024-04-01T19:44:40.746 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.746 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.746 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:40.746 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.936154+0000", 2024-04-01T19:44:40.746 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0267e-05 2024-04-01T19:44:40.746 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.746 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.746 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:40.746 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:02.936162+0000", 2024-04-01T19:44:40.747 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3850000000000002e-06 2024-04-01T19:44:40.747 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.747 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.747 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:40.747 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.052037+0000", 2024-04-01T19:44:40.747 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.115874912 2024-04-01T19:44:40.747 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.747 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.747 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:40.747 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.052152+0000", 2024-04-01T19:44:40.747 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000115147 2024-04-01T19:44:40.747 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.747 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.747 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:44:40.747 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.052302+0000", 2024-04-01T19:44:40.747 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000149271 2024-04-01T19:44:40.748 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.748 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.748 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:44:40.748 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.057357+0000", 2024-04-01T19:44:40.748 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0050550300000000003 2024-04-01T19:44:40.748 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.748 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.748 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.748 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.057950+0000", 2024-04-01T19:44:40.748 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00059334399999999999 2024-04-01T19:44:40.748 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.748 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.748 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.748 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.251681+0000", 2024-04-01T19:44:40.748 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.193731178 2024-04-01T19:44:40.749 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.749 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.749 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:40.749 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.251743+0000", 2024-04-01T19:44:40.749 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1285999999999996e-05 2024-04-01T19:44:40.749 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.749 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.749 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:40.749 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.251860+0000", 2024-04-01T19:44:40.749 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000117382 2024-04-01T19:44:40.749 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.749 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:40.749 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.749 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.749 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.749 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280668 4.a 4:5f9d703f:::benchmark_data_smithi188_104537_object108674:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e342)", 2024-04-01T19:44:40.750 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.572593+0000", 2024-04-01T19:44:40.750 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 397.159692726, 2024-04-01T19:44:40.750 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.31502582299999998, 2024-04-01T19:44:40.750 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:40.750 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:40.750 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:40.750 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:40.750 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:44:40.750 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:44:40.750 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280668 2024-04-01T19:44:40.750 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.750 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:40.750 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.750 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:40.750 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572593+0000", 2024-04-01T19:44:40.751 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.751 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.751 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.751 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:40.751 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572593+0000", 2024-04-01T19:44:40.751 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.751 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.751 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.751 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:40.751 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572593+0000", 2024-04-01T19:44:40.751 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.82e-07 2024-04-01T19:44:40.751 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.751 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.751 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:40.751 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572595+0000", 2024-04-01T19:44:40.751 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.069e-06 2024-04-01T19:44:40.752 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.752 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.752 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:40.752 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572601+0000", 2024-04-01T19:44:40.752 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0680000000000002e-06 2024-04-01T19:44:40.752 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.752 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.752 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:40.752 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572607+0000", 2024-04-01T19:44:40.752 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8449999999999999e-06 2024-04-01T19:44:40.752 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.752 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.752 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:40.752 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.871983+0000", 2024-04-01T19:44:40.752 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.29937640399999998 2024-04-01T19:44:40.753 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.753 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.753 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:40.753 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.872076+0000", 2024-04-01T19:44:40.753 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.2752999999999998e-05 2024-04-01T19:44:40.753 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.753 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.753 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:44:40.753 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.872214+0000", 2024-04-01T19:44:40.753 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000138121 2024-04-01T19:44:40.753 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.753 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.753 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.753 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.881643+0000", 2024-04-01T19:44:40.754 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0094283549999999994 2024-04-01T19:44:40.754 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.754 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.754 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:44:40.754 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.881715+0000", 2024-04-01T19:44:40.754 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2582000000000004e-05 2024-04-01T19:44:40.754 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.754 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.754 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.754 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887484+0000", 2024-04-01T19:44:40.754 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0057684260000000001 2024-04-01T19:44:40.754 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.754 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.754 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:40.754 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887530+0000", 2024-04-01T19:44:40.754 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5859999999999998e-05 2024-04-01T19:44:40.755 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.755 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.755 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:40.755 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887618+0000", 2024-04-01T19:44:40.755 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8857999999999995e-05 2024-04-01T19:44:40.755 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.755 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:40.755 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.755 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.755 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.755 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280671 4.a 4:5678a52e:::benchmark_data_smithi188_104537_object108677:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e342)", 2024-04-01T19:44:40.755 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.572613+0000", 2024-04-01T19:44:40.755 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 397.15967219599997, 2024-04-01T19:44:40.755 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.31520125100000002, 2024-04-01T19:44:40.755 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:40.756 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:40.756 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:40.756 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:40.756 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:44:40.756 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:44:40.756 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280671 2024-04-01T19:44:40.756 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.756 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:40.756 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.756 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:40.756 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572613+0000", 2024-04-01T19:44:40.756 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.756 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.756 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.756 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:40.756 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572613+0000", 2024-04-01T19:44:40.757 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.757 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.757 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.757 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:40.757 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572614+0000", 2024-04-01T19:44:40.757 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1199999999999998e-07 2024-04-01T19:44:40.757 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.757 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.757 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:40.757 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572616+0000", 2024-04-01T19:44:40.757 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9700000000000002e-06 2024-04-01T19:44:40.757 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.757 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.757 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:40.758 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572621+0000", 2024-04-01T19:44:40.758 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7200000000000003e-06 2024-04-01T19:44:40.758 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.758 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.758 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:40.758 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572626+0000", 2024-04-01T19:44:40.758 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9810000000000003e-06 2024-04-01T19:44:40.758 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.758 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.758 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:40.758 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.877001+0000", 2024-04-01T19:44:40.758 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.30437526399999998 2024-04-01T19:44:40.758 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.758 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.759 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:40.759 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.877142+0000", 2024-04-01T19:44:40.759 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014064700000000001 2024-04-01T19:44:40.759 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.759 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.759 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:44:40.759 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.877247+0000", 2024-04-01T19:44:40.759 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00010501300000000001 2024-04-01T19:44:40.759 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.759 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.759 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.759 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.881701+0000", 2024-04-01T19:44:40.759 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0044534010000000001 2024-04-01T19:44:40.759 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.759 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.760 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.760 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887662+0000", 2024-04-01T19:44:40.760 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0059614719999999998 2024-04-01T19:44:40.760 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.760 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.760 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:44:40.760 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887709+0000", 2024-04-01T19:44:40.760 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6757e-05 2024-04-01T19:44:40.760 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.760 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.760 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:40.760 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887740+0000", 2024-04-01T19:44:40.760 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.0864000000000001e-05 2024-04-01T19:44:40.760 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.760 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.760 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:40.761 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887814+0000", 2024-04-01T19:44:40.761 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4750000000000001e-05 2024-04-01T19:44:40.761 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.761 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:40.761 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.761 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.761 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.761 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280680 4.a 4:52c07fa1:::benchmark_data_smithi188_104537_object108686:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e342)", 2024-04-01T19:44:40.761 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.572631+0000", 2024-04-01T19:44:40.761 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 397.15965444199998, 2024-04-01T19:44:40.761 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.32162606599999999, 2024-04-01T19:44:40.761 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:40.761 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:40.761 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:40.761 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:40.761 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:44:40.762 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:44:40.762 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280680 2024-04-01T19:44:40.762 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.762 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:40.762 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.762 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:40.762 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572631+0000", 2024-04-01T19:44:40.762 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.762 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.762 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.762 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:40.762 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572631+0000", 2024-04-01T19:44:40.762 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.762 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.763 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.763 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:40.763 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572631+0000", 2024-04-01T19:44:40.763 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9999999999999998e-07 2024-04-01T19:44:40.763 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.763 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.763 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:40.763 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572637+0000", 2024-04-01T19:44:40.763 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6359999999999999e-06 2024-04-01T19:44:40.763 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.763 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.763 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:40.763 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572643+0000", 2024-04-01T19:44:40.763 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1500000000000004e-06 2024-04-01T19:44:40.763 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.763 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.764 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:40.764 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572648+0000", 2024-04-01T19:44:40.764 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8420000000000004e-06 2024-04-01T19:44:40.764 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.764 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.764 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:40.764 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.881733+0000", 2024-04-01T19:44:40.764 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.30908518400000001 2024-04-01T19:44:40.764 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.764 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.764 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:40.764 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.881823+0000", 2024-04-01T19:44:40.764 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.9461000000000003e-05 2024-04-01T19:44:40.764 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.764 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.765 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:44:40.765 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.881906+0000", 2024-04-01T19:44:40.765 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3122999999999997e-05 2024-04-01T19:44:40.765 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.765 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.765 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.765 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887699+0000", 2024-04-01T19:44:40.765 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0057936979999999999 2024-04-01T19:44:40.765 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.765 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.765 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:44:40.765 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887821+0000", 2024-04-01T19:44:40.765 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012160200000000001 2024-04-01T19:44:40.765 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.765 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.765 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.766 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.894148+0000", 2024-04-01T19:44:40.766 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0063270569999999996 2024-04-01T19:44:40.766 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.766 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.766 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:40.766 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.894181+0000", 2024-04-01T19:44:40.766 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3297999999999999e-05 2024-04-01T19:44:40.766 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.766 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.766 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:40.766 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.894257+0000", 2024-04-01T19:44:40.766 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5615e-05 2024-04-01T19:44:40.766 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.767 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:40.767 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.767 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.767 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.767 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280682 4.a 4:5e31f9ed:::benchmark_data_smithi188_104537_object108688:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e342)", 2024-04-01T19:44:40.767 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.572654+0000", 2024-04-01T19:44:40.767 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 397.15963119100002, 2024-04-01T19:44:40.767 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.32646417599999999, 2024-04-01T19:44:40.767 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:40.767 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:40.767 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:40.767 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:40.767 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:44:40.767 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:44:40.768 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280682 2024-04-01T19:44:40.768 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.768 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:40.768 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.768 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:40.768 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572654+0000", 2024-04-01T19:44:40.768 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.768 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.768 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.768 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:40.768 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572654+0000", 2024-04-01T19:44:40.768 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.768 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.768 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.768 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:40.768 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572655+0000", 2024-04-01T19:44:40.769 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0399999999999996e-07 2024-04-01T19:44:40.769 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.769 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.769 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:40.769 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572657+0000", 2024-04-01T19:44:40.769 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.04e-06 2024-04-01T19:44:40.769 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.769 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.769 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:40.769 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572662+0000", 2024-04-01T19:44:40.769 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7350000000000001e-06 2024-04-01T19:44:40.769 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.769 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.769 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:40.769 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572667+0000", 2024-04-01T19:44:40.769 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7999999999999998e-06 2024-04-01T19:44:40.770 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.770 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.770 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:40.770 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.885081+0000", 2024-04-01T19:44:40.770 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.31241408599999998 2024-04-01T19:44:40.770 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.770 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.770 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:40.770 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.885168+0000", 2024-04-01T19:44:40.770 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6565999999999998e-05 2024-04-01T19:44:40.770 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.770 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.770 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:44:40.770 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.885257+0000", 2024-04-01T19:44:40.770 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.9629000000000005e-05 2024-04-01T19:44:40.770 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.771 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.771 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:44:40.771 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887825+0000", 2024-04-01T19:44:40.771 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0025676750000000002 2024-04-01T19:44:40.771 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.771 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.771 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.771 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887859+0000", 2024-04-01T19:44:40.771 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3898e-05 2024-04-01T19:44:40.771 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.771 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.771 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.771 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.899001+0000", 2024-04-01T19:44:40.771 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.011141977000000001 2024-04-01T19:44:40.771 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.772 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.772 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:40.772 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.899042+0000", 2024-04-01T19:44:40.772 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1326999999999999e-05 2024-04-01T19:44:40.772 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.772 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.772 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:40.772 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.899118+0000", 2024-04-01T19:44:40.772 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5939000000000006e-05 2024-04-01T19:44:40.772 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.772 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:40.772 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.772 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.772 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.772 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280688 4.a 4:5068fb67:::benchmark_data_smithi188_104537_object108694:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e342)", 2024-04-01T19:44:40.773 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.572673+0000", 2024-04-01T19:44:40.773 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 397.15961236800001, 2024-04-01T19:44:40.773 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.326602581, 2024-04-01T19:44:40.773 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:40.773 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:40.773 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:40.773 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:40.773 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:44:40.773 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:44:40.773 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280688 2024-04-01T19:44:40.773 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.773 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:40.773 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.773 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:40.773 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572673+0000", 2024-04-01T19:44:40.773 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.774 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.774 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.774 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:40.774 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572673+0000", 2024-04-01T19:44:40.774 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.774 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.774 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.774 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:40.774 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572673+0000", 2024-04-01T19:44:40.774 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.0600000000000001e-07 2024-04-01T19:44:40.774 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.774 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.774 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:40.774 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572675+0000", 2024-04-01T19:44:40.774 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1280000000000002e-06 2024-04-01T19:44:40.775 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.775 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.775 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:40.775 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572681+0000", 2024-04-01T19:44:40.775 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6189999999999999e-06 2024-04-01T19:44:40.775 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.775 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.775 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:40.775 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572688+0000", 2024-04-01T19:44:40.775 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4779999999999996e-06 2024-04-01T19:44:40.775 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.775 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.775 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:40.775 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887890+0000", 2024-04-01T19:44:40.776 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.31520266699999999 2024-04-01T19:44:40.776 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.776 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.776 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:40.776 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.887972+0000", 2024-04-01T19:44:40.776 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2123e-05 2024-04-01T19:44:40.776 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.776 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.776 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:44:40.776 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.888053+0000", 2024-04-01T19:44:40.776 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0934999999999997e-05 2024-04-01T19:44:40.776 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.776 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.776 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.776 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.894307+0000", 2024-04-01T19:44:40.777 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0062534399999999999 2024-04-01T19:44:40.777 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.777 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.777 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:44:40.777 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.896683+0000", 2024-04-01T19:44:40.777 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0023765739999999998 2024-04-01T19:44:40.777 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.777 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.777 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.777 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.899162+0000", 2024-04-01T19:44:40.777 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0024782440000000001 2024-04-01T19:44:40.777 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.777 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.777 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:40.777 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.899196+0000", 2024-04-01T19:44:40.778 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.4026999999999998e-05 2024-04-01T19:44:40.778 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.778 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.778 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:40.778 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.899276+0000", 2024-04-01T19:44:40.778 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9939999999999997e-05 2024-04-01T19:44:40.778 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.778 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:40.778 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.778 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.778 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.778 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280700 4.a 4:5f535780:::benchmark_data_smithi188_104537_object108706:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e342)", 2024-04-01T19:44:40.778 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.572692+0000", 2024-04-01T19:44:40.778 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 397.15959318300003, 2024-04-01T19:44:40.778 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.34045793499999999, 2024-04-01T19:44:40.779 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:40.779 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:40.779 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:40.779 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:40.779 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:44:40.779 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:44:40.779 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280700 2024-04-01T19:44:40.779 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.779 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:40.779 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.779 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:40.779 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572692+0000", 2024-04-01T19:44:40.779 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.779 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.779 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.780 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:40.780 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572692+0000", 2024-04-01T19:44:40.780 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.780 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.780 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.780 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:40.780 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572693+0000", 2024-04-01T19:44:40.780 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1899999999999998e-07 2024-04-01T19:44:40.780 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.780 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.780 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:40.780 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572694+0000", 2024-04-01T19:44:40.780 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9309999999999998e-06 2024-04-01T19:44:40.780 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.780 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.780 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:40.781 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572700+0000", 2024-04-01T19:44:40.781 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6280000000000002e-06 2024-04-01T19:44:40.781 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.781 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.781 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:40.781 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572705+0000", 2024-04-01T19:44:40.781 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3020000000000002e-06 2024-04-01T19:44:40.781 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.781 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.781 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:40.781 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.890646+0000", 2024-04-01T19:44:40.781 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.31794064999999999 2024-04-01T19:44:40.781 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.781 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.782 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:40.782 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.890772+0000", 2024-04-01T19:44:40.782 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012627999999999999 2024-04-01T19:44:40.782 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.782 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.782 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:44:40.782 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.890919+0000", 2024-04-01T19:44:40.782 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014695299999999999 2024-04-01T19:44:40.782 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.782 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.782 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.782 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.894348+0000", 2024-04-01T19:44:40.782 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0034283180000000001 2024-04-01T19:44:40.782 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.782 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.783 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:44:40.783 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.896687+0000", 2024-04-01T19:44:40.783 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.002339402 2024-04-01T19:44:40.783 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.783 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.783 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.783 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.912959+0000", 2024-04-01T19:44:40.783 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.016271601 2024-04-01T19:44:40.783 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.783 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.783 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:40.783 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.913025+0000", 2024-04-01T19:44:40.783 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.6524000000000002e-05 2024-04-01T19:44:40.783 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.783 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.784 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:40.784 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.913150+0000", 2024-04-01T19:44:40.784 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012492699999999999 2024-04-01T19:44:40.784 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.784 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:40.784 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.784 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.784 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.784 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280705 4.a 4:59717340:::benchmark_data_smithi188_104537_object108711:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e342)", 2024-04-01T19:44:40.784 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.572711+0000", 2024-04-01T19:44:40.784 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 397.15957413199999, 2024-04-01T19:44:40.784 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.34923071100000003, 2024-04-01T19:44:40.784 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:40.784 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:40.785 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:40.785 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:40.785 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:44:40.785 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:44:40.785 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280705 2024-04-01T19:44:40.785 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.785 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:40.785 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.785 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:40.785 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572711+0000", 2024-04-01T19:44:40.785 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.785 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.785 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.785 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:40.785 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572711+0000", 2024-04-01T19:44:40.786 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.786 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.786 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.786 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:40.786 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572712+0000", 2024-04-01T19:44:40.786 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9999999999999998e-07 2024-04-01T19:44:40.786 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.786 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.786 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:40.786 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572714+0000", 2024-04-01T19:44:40.786 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0870000000000001e-06 2024-04-01T19:44:40.786 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.786 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.786 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:40.787 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572719+0000", 2024-04-01T19:44:40.787 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2970000000000003e-06 2024-04-01T19:44:40.787 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.787 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.787 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:40.787 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572725+0000", 2024-04-01T19:44:40.787 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7849999999999997e-06 2024-04-01T19:44:40.787 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.787 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.787 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:40.787 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.894379+0000", 2024-04-01T19:44:40.787 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.321654104 2024-04-01T19:44:40.787 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.787 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.787 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:40.787 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.894465+0000", 2024-04-01T19:44:40.788 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6127999999999999e-05 2024-04-01T19:44:40.788 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.788 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.788 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:44:40.788 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.894559+0000", 2024-04-01T19:44:40.788 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.4486000000000003e-05 2024-04-01T19:44:40.788 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.788 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.788 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:44:40.788 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.899286+0000", 2024-04-01T19:44:40.788 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0047264830000000001 2024-04-01T19:44:40.788 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.788 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.788 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.788 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.905641+0000", 2024-04-01T19:44:40.789 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.006355449 2024-04-01T19:44:40.789 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.789 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.789 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.789 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.921834+0000", 2024-04-01T19:44:40.789 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.016192959999999999 2024-04-01T19:44:40.789 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.789 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.789 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:40.789 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.921877+0000", 2024-04-01T19:44:40.789 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.2576e-05 2024-04-01T19:44:40.789 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.789 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.789 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:40.789 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.921942+0000", 2024-04-01T19:44:40.790 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4956000000000006e-05 2024-04-01T19:44:40.790 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.790 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:40.790 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.790 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.790 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.790 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280708 4.a 4:58bafadf:::benchmark_data_smithi188_104537_object108714:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e342)", 2024-04-01T19:44:40.790 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.572729+0000", 2024-04-01T19:44:40.790 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 397.15955600400002, 2024-04-01T19:44:40.790 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.34934728500000001, 2024-04-01T19:44:40.790 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:40.790 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:40.790 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:40.790 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:40.791 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:44:40.791 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:44:40.791 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280708 2024-04-01T19:44:40.791 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.791 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:40.791 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.791 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:40.791 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572729+0000", 2024-04-01T19:44:40.791 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.791 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.791 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.791 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:40.791 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572729+0000", 2024-04-01T19:44:40.791 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.791 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.792 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.792 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:40.792 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572730+0000", 2024-04-01T19:44:40.792 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1600000000000002e-07 2024-04-01T19:44:40.792 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.792 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.792 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:40.792 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572732+0000", 2024-04-01T19:44:40.792 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9700000000000002e-06 2024-04-01T19:44:40.792 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.792 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.792 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:40.792 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572737+0000", 2024-04-01T19:44:40.792 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7710000000000003e-06 2024-04-01T19:44:40.792 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.793 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.793 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:40.793 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572744+0000", 2024-04-01T19:44:40.793 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.674e-06 2024-04-01T19:44:40.793 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.793 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.793 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:40.793 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.896705+0000", 2024-04-01T19:44:40.793 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.32396117800000002 2024-04-01T19:44:40.793 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.793 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.793 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:40.793 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.896783+0000", 2024-04-01T19:44:40.793 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7198000000000002e-05 2024-04-01T19:44:40.793 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.794 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.794 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:44:40.794 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.896860+0000", 2024-04-01T19:44:40.794 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7474999999999999e-05 2024-04-01T19:44:40.794 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.794 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.794 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.794 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.905701+0000", 2024-04-01T19:44:40.794 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0088405659999999994 2024-04-01T19:44:40.794 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.794 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.794 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:44:40.794 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.905717+0000", 2024-04-01T19:44:40.794 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6181e-05 2024-04-01T19:44:40.794 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.795 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.795 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.795 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.921981+0000", 2024-04-01T19:44:40.795 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.016264321000000002 2024-04-01T19:44:40.795 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.795 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.795 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:40.795 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.922018+0000", 2024-04-01T19:44:40.795 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.6616999999999999e-05 2024-04-01T19:44:40.795 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.795 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.795 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:40.795 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.922077+0000", 2024-04-01T19:44:40.795 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8918000000000001e-05 2024-04-01T19:44:40.795 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.796 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:40.796 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.796 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.796 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.796 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280716 4.a 4:565a1ebf:::benchmark_data_smithi188_104537_object108722:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e342)", 2024-04-01T19:44:40.796 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.572749+0000", 2024-04-01T19:44:40.796 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 397.15953663800002, 2024-04-01T19:44:40.796 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.34945212799999997, 2024-04-01T19:44:40.796 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:40.796 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:40.796 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:40.796 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:40.796 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:44:40.796 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:44:40.796 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280716 2024-04-01T19:44:40.796 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572749+0000", 2024-04-01T19:44:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572749+0000", 2024-04-01T19:44:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572749+0000", 2024-04-01T19:44:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1600000000000002e-07 2024-04-01T19:44:40.798 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.798 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.798 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:40.798 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572751+0000", 2024-04-01T19:44:40.798 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0449999999999999e-06 2024-04-01T19:44:40.798 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.798 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.798 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:40.798 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572757+0000", 2024-04-01T19:44:40.798 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5639999999999996e-06 2024-04-01T19:44:40.798 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.798 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.798 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:40.798 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.572762+0000", 2024-04-01T19:44:40.799 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2299999999999999e-06 2024-04-01T19:44:40.799 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.799 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.799 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:40.799 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.899313+0000", 2024-04-01T19:44:40.799 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.32655144699999999 2024-04-01T19:44:40.799 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.799 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.799 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:40.799 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.899397+0000", 2024-04-01T19:44:40.799 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3267000000000001e-05 2024-04-01T19:44:40.799 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.799 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.799 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:44:40.799 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.899474+0000", 2024-04-01T19:44:40.800 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7848000000000004e-05 2024-04-01T19:44:40.800 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.800 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.800 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.800 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.905743+0000", 2024-04-01T19:44:40.800 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0062688800000000001 2024-04-01T19:44:40.800 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.800 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.800 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:44:40.800 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.909147+0000", 2024-04-01T19:44:40.800 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0034036019999999999 2024-04-01T19:44:40.800 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.800 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.800 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.800 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.922113+0000", 2024-04-01T19:44:40.801 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.012966030999999999 2024-04-01T19:44:40.801 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.801 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.801 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:40.801 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.922145+0000", 2024-04-01T19:44:40.801 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.1701e-05 2024-04-01T19:44:40.801 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.801 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.801 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:40.801 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.922201+0000", 2024-04-01T19:44:40.801 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6097000000000002e-05 2024-04-01T19:44:40.801 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.801 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:40.801 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.801 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.801 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.802 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280721 4.a 4:58f19a78:::benchmark_data_smithi188_104537_object108727:head [delete] snapc 0=[] ondisk+write+known_if_redirected e342)", 2024-04-01T19:44:40.802 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.576436+0000", 2024-04-01T19:44:40.802 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 397.15584970899999, 2024-04-01T19:44:40.802 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.34588794, 2024-04-01T19:44:40.802 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:40.802 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:40.802 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:40.802 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:40.802 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:44:40.802 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:44:40.802 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280721 2024-04-01T19:44:40.802 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.802 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:40.803 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.803 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:40.803 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.576436+0000", 2024-04-01T19:44:40.803 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.803 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.803 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.803 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:40.803 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.576436+0000", 2024-04-01T19:44:40.803 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.803 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.803 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.803 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:40.803 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.576437+0000", 2024-04-01T19:44:40.803 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.514e-06 2024-04-01T19:44:40.803 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.803 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.804 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:40.804 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.576443+0000", 2024-04-01T19:44:40.804 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4009999999999996e-06 2024-04-01T19:44:40.804 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.804 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.804 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:40.804 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.576452+0000", 2024-04-01T19:44:40.804 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.8139999999999995e-06 2024-04-01T19:44:40.804 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.804 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.804 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:40.804 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.576460+0000", 2024-04-01T19:44:40.804 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2110000000000001e-06 2024-04-01T19:44:40.804 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.804 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.804 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:40.805 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.902499+0000", 2024-04-01T19:44:40.805 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.32603918999999998 2024-04-01T19:44:40.805 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.805 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.805 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:40.805 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.902605+0000", 2024-04-01T19:44:40.805 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000105884 2024-04-01T19:44:40.805 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.805 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.805 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:44:40.805 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.902689+0000", 2024-04-01T19:44:40.805 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4604000000000005e-05 2024-04-01T19:44:40.805 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.805 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.806 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.806 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.912818+0000", 2024-04-01T19:44:40.806 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010129098 2024-04-01T19:44:40.806 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.806 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.806 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:44:40.806 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.912837+0000", 2024-04-01T19:44:40.806 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8329e-05 2024-04-01T19:44:40.806 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.806 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.806 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.806 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.922236+0000", 2024-04-01T19:44:40.806 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0093993359999999995 2024-04-01T19:44:40.806 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.806 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.807 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:40.807 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.922267+0000", 2024-04-01T19:44:40.807 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.0855999999999997e-05 2024-04-01T19:44:40.807 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.807 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.807 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:40.807 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.922324+0000", 2024-04-01T19:44:40.807 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6703000000000002e-05 2024-04-01T19:44:40.807 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.807 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:40.807 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.807 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.807 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.807 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280728 4.a 4:573bba9f:::benchmark_data_smithi188_104537_object108734:head [delete] snapc 0=[] ondisk+write+known_if_redirected e342)", 2024-04-01T19:44:40.807 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.586751+0000", 2024-04-01T19:44:40.807 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 397.14553443699998, 2024-04-01T19:44:40.808 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.33572831400000003, 2024-04-01T19:44:40.808 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:40.808 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:40.808 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:40.808 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:40.808 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:44:40.808 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:44:40.808 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280728 2024-04-01T19:44:40.808 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.808 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:40.808 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.808 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:40.808 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.586751+0000", 2024-04-01T19:44:40.808 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.809 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.809 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.809 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:40.809 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.586751+0000", 2024-04-01T19:44:40.809 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.809 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.809 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.809 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:40.809 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.586752+0000", 2024-04-01T19:44:40.809 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5579999999999999e-06 2024-04-01T19:44:40.809 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.809 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.809 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:40.809 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.586756+0000", 2024-04-01T19:44:40.809 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9360000000000001e-06 2024-04-01T19:44:40.810 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.810 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.810 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:40.810 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.586765+0000", 2024-04-01T19:44:40.810 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.9050000000000003e-06 2024-04-01T19:44:40.810 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.810 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.810 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:40.810 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.586771+0000", 2024-04-01T19:44:40.810 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4179999999999996e-06 2024-04-01T19:44:40.810 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.810 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.811 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:40.811 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.905786+0000", 2024-04-01T19:44:40.811 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.31901577599999997 2024-04-01T19:44:40.811 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.811 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.811 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:40.811 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.905922+0000", 2024-04-01T19:44:40.811 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000135883 2024-04-01T19:44:40.811 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.811 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.811 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:44:40.811 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.906072+0000", 2024-04-01T19:44:40.811 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015011700000000001 2024-04-01T19:44:40.811 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.811 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.812 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.812 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.912898+0000", 2024-04-01T19:44:40.812 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0068258040000000004 2024-04-01T19:44:40.812 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.812 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.812 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:44:40.812 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.913165+0000", 2024-04-01T19:44:40.812 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00026646100000000001 2024-04-01T19:44:40.812 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.812 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.812 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.812 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.922364+0000", 2024-04-01T19:44:40.812 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0091992170000000009 2024-04-01T19:44:40.812 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.812 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.813 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:40.813 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.922399+0000", 2024-04-01T19:44:40.813 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.4736000000000001e-05 2024-04-01T19:44:40.813 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.813 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.813 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:40.813 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.922479+0000", 2024-04-01T19:44:40.813 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0502999999999998e-05 2024-04-01T19:44:40.813 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.813 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:40.813 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.813 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.813 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.813 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280753 4.a 4:57b6b593:::benchmark_data_smithi188_104537_object108759:head [delete] snapc 0=[] ondisk+write+known_if_redirected e342)", 2024-04-01T19:44:40.814 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.630968+0000", 2024-04-01T19:44:40.814 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 397.10131779, 2024-04-01T19:44:40.814 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.54604825899999998, 2024-04-01T19:44:40.814 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:40.814 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:40.814 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:40.814 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:40.814 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:44:40.814 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:44:40.814 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280753 2024-04-01T19:44:40.814 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.814 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:40.814 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.814 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:40.815 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.630968+0000", 2024-04-01T19:44:40.815 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.815 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.815 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.815 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:40.815 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.630968+0000", 2024-04-01T19:44:40.815 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.815 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.815 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.815 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:40.815 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.630969+0000", 2024-04-01T19:44:40.815 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.079e-06 2024-04-01T19:44:40.815 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.815 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.815 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:40.815 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.630972+0000", 2024-04-01T19:44:40.816 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3950000000000001e-06 2024-04-01T19:44:40.816 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.816 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.816 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:40.816 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.630981+0000", 2024-04-01T19:44:40.816 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8130000000000002e-06 2024-04-01T19:44:40.816 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.816 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.816 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:40.816 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.630986+0000", 2024-04-01T19:44:40.816 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.1039999999999998e-06 2024-04-01T19:44:40.816 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.816 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.816 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:40.816 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.909181+0000", 2024-04-01T19:44:40.816 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.278195103 2024-04-01T19:44:40.817 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.817 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.817 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:40.817 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.909323+0000", 2024-04-01T19:44:40.817 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014192799999999999 2024-04-01T19:44:40.817 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.817 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.817 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:44:40.817 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.909478+0000", 2024-04-01T19:44:40.817 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015519700000000001 2024-04-01T19:44:40.817 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.817 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.817 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.817 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.913220+0000", 2024-04-01T19:44:40.817 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0037419319999999999 2024-04-01T19:44:40.818 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.818 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.818 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:44:40.818 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.916829+0000", 2024-04-01T19:44:40.818 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.003609236 2024-04-01T19:44:40.818 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.818 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.818 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.818 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.176813+0000", 2024-04-01T19:44:40.818 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.25998363200000002 2024-04-01T19:44:40.818 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.818 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.818 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:40.818 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.176883+0000", 2024-04-01T19:44:40.819 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0119999999999999e-05 2024-04-01T19:44:40.819 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.819 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.819 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:40.819 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.177016+0000", 2024-04-01T19:44:40.819 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013271999999999999 2024-04-01T19:44:40.819 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.819 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:40.819 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.819 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.819 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.819 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280778 4.a 4:54697a84:::benchmark_data_smithi188_104537_object108784:head [delete] snapc 0=[] ondisk+write+known_if_redirected e342)", 2024-04-01T19:44:40.819 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.696916+0000", 2024-04-01T19:44:40.819 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 397.03536894600001, 2024-04-01T19:44:40.820 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.48040244799999998, 2024-04-01T19:44:40.820 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:40.820 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:40.820 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:40.820 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:40.820 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:44:40.820 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:44:40.820 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280778 2024-04-01T19:44:40.820 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.820 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:40.820 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.820 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:40.820 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.696916+0000", 2024-04-01T19:44:40.820 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.820 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.821 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.821 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:40.821 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.696916+0000", 2024-04-01T19:44:40.821 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.821 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.821 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.821 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:40.821 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.696917+0000", 2024-04-01T19:44:40.821 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.4200000000000004e-07 2024-04-01T19:44:40.821 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.821 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.821 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:40.821 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.696921+0000", 2024-04-01T19:44:40.821 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5080000000000001e-06 2024-04-01T19:44:40.821 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.821 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.822 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:40.822 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.696929+0000", 2024-04-01T19:44:40.822 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9519999999999994e-06 2024-04-01T19:44:40.822 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.822 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.822 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:40.822 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.696936+0000", 2024-04-01T19:44:40.822 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3379999999999999e-06 2024-04-01T19:44:40.822 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.822 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.822 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:40.822 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.913266+0000", 2024-04-01T19:44:40.822 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21632944800000001 2024-04-01T19:44:40.823 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.823 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.823 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:40.823 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.913408+0000", 2024-04-01T19:44:40.823 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014255299999999999 2024-04-01T19:44:40.823 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.823 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.823 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:44:40.823 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.913562+0000", 2024-04-01T19:44:40.823 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015434100000000001 2024-04-01T19:44:40.823 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.823 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.823 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.823 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.919210+0000", 2024-04-01T19:44:40.823 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.005647104 2024-04-01T19:44:40.824 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.824 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.824 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:44:40.824 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.919219+0000", 2024-04-01T19:44:40.824 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.9649999999999997e-06 2024-04-01T19:44:40.824 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.824 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.824 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.824 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.177141+0000", 2024-04-01T19:44:40.824 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.25792264199999998 2024-04-01T19:44:40.824 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.824 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.824 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:40.824 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.177204+0000", 2024-04-01T19:44:40.824 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2388e-05 2024-04-01T19:44:40.825 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.825 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.825 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:40.825 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.177319+0000", 2024-04-01T19:44:40.825 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00011526700000000001 2024-04-01T19:44:40.825 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.825 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:40.825 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.825 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.825 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.825 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:280780 4.a 4:5fb16d9f:::benchmark_data_smithi188_104537_object108786:head [delete] snapc 0=[] ondisk+write+known_if_redirected e342)", 2024-04-01T19:44:40.825 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:03.706847+0000", 2024-04-01T19:44:40.825 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 397.025438275, 2024-04-01T19:44:40.825 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.47077487200000001, 2024-04-01T19:44:40.825 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:40.826 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:40.826 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:40.826 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:40.826 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:44:40.826 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:44:40.826 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 280780 2024-04-01T19:44:40.826 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.826 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:40.826 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.826 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:40.826 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.706847+0000", 2024-04-01T19:44:40.826 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.826 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.827 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.827 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:40.827 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.706847+0000", 2024-04-01T19:44:40.827 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.827 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.827 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.827 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:40.827 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.706848+0000", 2024-04-01T19:44:40.827 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4279999999999999e-06 2024-04-01T19:44:40.827 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.827 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.827 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:40.827 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.706853+0000", 2024-04-01T19:44:40.827 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.2080000000000002e-06 2024-04-01T19:44:40.827 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.828 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.828 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:40.828 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.706862+0000", 2024-04-01T19:44:40.828 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.183e-06 2024-04-01T19:44:40.828 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.828 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.828 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:40.828 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.706870+0000", 2024-04-01T19:44:40.828 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2919999999999996e-06 2024-04-01T19:44:40.828 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.828 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.828 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:40.828 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.916850+0000", 2024-04-01T19:44:40.828 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.209980051 2024-04-01T19:44:40.828 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.828 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.829 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:40.829 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.916931+0000", 2024-04-01T19:44:40.829 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.1198000000000004e-05 2024-04-01T19:44:40.829 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.829 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.829 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:44:40.829 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.917009+0000", 2024-04-01T19:44:40.829 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7379000000000006e-05 2024-04-01T19:44:40.829 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.829 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.829 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.829 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.921774+0000", 2024-04-01T19:44:40.829 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0047650030000000003 2024-04-01T19:44:40.829 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.829 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.829 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:44:40.830 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:03.922209+0000", 2024-04-01T19:44:40.830 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00043543299999999999 2024-04-01T19:44:40.830 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.830 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.830 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.830 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.177445+0000", 2024-04-01T19:44:40.830 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.25523606199999999 2024-04-01T19:44:40.830 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.830 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.830 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:40.830 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.177507+0000", 2024-04-01T19:44:40.830 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2008000000000007e-05 2024-04-01T19:44:40.830 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.830 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.830 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:40.831 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.177622+0000", 2024-04-01T19:44:40.831 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000114627 2024-04-01T19:44:40.831 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.831 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:40.831 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.831 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.831 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.831 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:281241 4.a 4:56f95ea3:::benchmark_data_smithi188_104537_object109247:head [delete] snapc 0=[] ondisk+write+known_if_redirected e342)", 2024-04-01T19:44:40.831 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:04.502549+0000", 2024-04-01T19:44:40.831 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 396.22973614199998, 2024-04-01T19:44:40.831 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.32777840800000002, 2024-04-01T19:44:40.831 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:40.831 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:40.831 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:40.831 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:40.832 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:44:40.832 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:44:40.832 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 281241 2024-04-01T19:44:40.832 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.832 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:40.832 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.832 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:40.832 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.502549+0000", 2024-04-01T19:44:40.832 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.832 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.832 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.832 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:40.832 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.502549+0000", 2024-04-01T19:44:40.832 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.832 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.832 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.832 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:40.833 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.502551+0000", 2024-04-01T19:44:40.833 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2290000000000002e-06 2024-04-01T19:44:40.833 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.833 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.833 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:40.833 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.502559+0000", 2024-04-01T19:44:40.833 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3780000000000003e-06 2024-04-01T19:44:40.833 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.833 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.833 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:40.833 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.502570+0000", 2024-04-01T19:44:40.833 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1311999999999999e-05 2024-04-01T19:44:40.833 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.833 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.833 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:40.833 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.502577+0000", 2024-04-01T19:44:40.834 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4629999999999998e-06 2024-04-01T19:44:40.834 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.834 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.834 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:40.834 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.614393+0000", 2024-04-01T19:44:40.834 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.111816596 2024-04-01T19:44:40.834 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.834 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.834 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:40.834 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.614479+0000", 2024-04-01T19:44:40.834 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6218999999999996e-05 2024-04-01T19:44:40.834 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.834 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.835 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:44:40.835 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.614578+0000", 2024-04-01T19:44:40.835 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.9117999999999995e-05 2024-04-01T19:44:40.835 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.835 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.835 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.835 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.621913+0000", 2024-04-01T19:44:40.835 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.007334531 2024-04-01T19:44:40.835 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.835 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.835 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:44:40.835 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.621940+0000", 2024-04-01T19:44:40.835 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.7138e-05 2024-04-01T19:44:40.835 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.836 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.836 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.836 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.830200+0000", 2024-04-01T19:44:40.836 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.208260221 2024-04-01T19:44:40.836 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.836 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.836 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:40.836 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.830246+0000", 2024-04-01T19:44:40.836 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5719000000000001e-05 2024-04-01T19:44:40.836 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.836 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.836 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:40.836 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.830328+0000", 2024-04-01T19:44:40.836 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.1483999999999994e-05 2024-04-01T19:44:40.836 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.836 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:40.837 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.837 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.837 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.837 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:281242 4.a 4:5141e774:::benchmark_data_smithi188_104537_object109248:head [delete] snapc 0=[] ondisk+write+known_if_redirected e342)", 2024-04-01T19:44:40.837 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:04.502594+0000", 2024-04-01T19:44:40.837 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 396.22969090399999, 2024-04-01T19:44:40.837 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.327909334, 2024-04-01T19:44:40.837 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:40.837 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:40.837 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:40.837 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:40.837 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:44:40.837 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:44:40.837 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 281242 2024-04-01T19:44:40.838 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.838 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:40.838 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.838 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:40.838 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.502594+0000", 2024-04-01T19:44:40.838 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.838 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.838 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.838 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:40.838 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.502594+0000", 2024-04-01T19:44:40.838 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.838 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.838 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.838 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:40.839 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.502595+0000", 2024-04-01T19:44:40.839 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7899999999999998e-07 2024-04-01T19:44:40.839 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.839 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.839 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:40.839 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.502598+0000", 2024-04-01T19:44:40.839 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5399999999999998e-06 2024-04-01T19:44:40.839 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.839 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.839 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:40.839 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.502602+0000", 2024-04-01T19:44:40.839 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7929999999999997e-06 2024-04-01T19:44:40.839 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.839 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.839 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:40.840 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.502606+0000", 2024-04-01T19:44:40.840 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5090000000000002e-06 2024-04-01T19:44:40.840 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.840 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.840 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:40.840 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.617433+0000", 2024-04-01T19:44:40.840 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.11482761599999999 2024-04-01T19:44:40.840 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.840 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.840 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:40.840 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.617578+0000", 2024-04-01T19:44:40.840 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014499700000000001 2024-04-01T19:44:40.840 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.840 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.840 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:44:40.840 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.617716+0000", 2024-04-01T19:44:40.841 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013726799999999999 2024-04-01T19:44:40.841 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.841 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.841 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.841 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.621969+0000", 2024-04-01T19:44:40.841 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0042530500000000004 2024-04-01T19:44:40.841 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.841 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.841 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:44:40.841 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.625446+0000", 2024-04-01T19:44:40.841 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0034773030000000002 2024-04-01T19:44:40.841 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.841 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.841 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.841 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.830407+0000", 2024-04-01T19:44:40.841 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.20496082400000001 2024-04-01T19:44:40.841 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.842 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.842 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:40.842 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.830442+0000", 2024-04-01T19:44:40.842 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5488000000000003e-05 2024-04-01T19:44:40.842 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.842 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.842 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:40.842 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.830504+0000", 2024-04-01T19:44:40.842 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1366999999999997e-05 2024-04-01T19:44:40.842 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.842 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:40.842 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.842 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.842 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.843 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25465.0:281245 4.a 4:5f796c3c:::benchmark_data_smithi188_104537_object109251:head [delete] snapc 0=[] ondisk+write+known_if_redirected e342)", 2024-04-01T19:44:40.843 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:38:04.514287+0000", 2024-04-01T19:44:40.843 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 396.21799787499998, 2024-04-01T19:44:40.843 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.31636779300000001, 2024-04-01T19:44:40.843 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:44:40.843 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:44:40.843 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:44:40.843 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:44:40.843 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25465", 2024-04-01T19:44:40.843 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/88701479", 2024-04-01T19:44:40.843 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 281245 2024-04-01T19:44:40.843 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.843 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:44:40.843 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.843 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:44:40.843 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.514287+0000", 2024-04-01T19:44:40.844 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.844 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.844 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.844 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:44:40.844 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.514287+0000", 2024-04-01T19:44:40.844 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:44:40.844 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.844 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.844 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:44:40.844 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.514289+0000", 2024-04-01T19:44:40.844 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6479999999999999e-06 2024-04-01T19:44:40.844 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.844 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.844 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:44:40.844 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.514295+0000", 2024-04-01T19:44:40.844 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9100000000000002e-06 2024-04-01T19:44:40.844 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.845 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.845 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:44:40.845 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.514306+0000", 2024-04-01T19:44:40.845 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0872e-05 2024-04-01T19:44:40.845 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.845 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.845 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:44:40.845 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.514313+0000", 2024-04-01T19:44:40.845 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3730000000000004e-06 2024-04-01T19:44:40.845 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.845 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.845 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:44:40.845 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.622006+0000", 2024-04-01T19:44:40.845 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.107692344 2024-04-01T19:44:40.845 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.845 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.846 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:44:40.846 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.622127+0000", 2024-04-01T19:44:40.846 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000121712 2024-04-01T19:44:40.846 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.846 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.846 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6,10", 2024-04-01T19:44:40.846 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.622210+0000", 2024-04-01T19:44:40.846 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2909000000000002e-05 2024-04-01T19:44:40.846 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.846 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.846 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.846 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.629938+0000", 2024-04-01T19:44:40.846 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.007727958 2024-04-01T19:44:40.846 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.846 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.847 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:44:40.847 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.630016+0000", 2024-04-01T19:44:40.847 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.8009000000000005e-05 2024-04-01T19:44:40.847 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.847 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.847 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:44:40.847 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.830547+0000", 2024-04-01T19:44:40.847 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.20053106200000001 2024-04-01T19:44:40.847 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.847 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.847 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:44:40.847 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.830585+0000", 2024-04-01T19:44:40.847 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7360999999999997e-05 2024-04-01T19:44:40.847 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:44:40.847 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:44:40.847 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:44:40.848 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:38:04.830655+0000", 2024-04-01T19:44:40.848 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0635000000000004e-05 2024-04-01T19:44:40.848 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.848 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:40.848 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.848 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:44:40.848 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:44:40.848 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:44:40.848 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 9, 10, 11, 8, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 7, 9, 10, 11, 8, 6] 2024-04-01T19:44:40.848 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 0 1 2024-04-01T19:44:40.849 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:40.850 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:40.850 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:44:40.850 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:44:40.951 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:44:40.979 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:41.137 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pool application enable unique_pool_4 rados --yes-i-really-mean-it || true 2024-04-01T19:44:41.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:41 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:44:41.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:41 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:44:41.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:41 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:44:41.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:41 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:44:41.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:41 smithi022 ceph-mon[39439]: osdmap e471: 12 total, 12 up, 12 in 2024-04-01T19:44:41.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:41 smithi022 ceph-mon[39439]: pgmap v1306: 17 pgs: 3 creating+peering, 8 active+clean, 6 unknown; 577 KiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:44:41.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:41 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:44:41.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:41 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:44:41.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:41 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:44:41.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:41 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:44:41.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:41 smithi062 ceph-mon[44211]: osdmap e471: 12 total, 12 up, 12 in 2024-04-01T19:44:41.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:41 smithi062 ceph-mon[44211]: pgmap v1306: 17 pgs: 3 creating+peering, 8 active+clean, 6 unknown; 577 KiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:44:41.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:41 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:44:41.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:41 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:44:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:41 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:44:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:41 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:44:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:41 smithi188 ceph-mon[43939]: osdmap e471: 12 total, 12 up, 12 in 2024-04-01T19:44:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:41 smithi188 ceph-mon[43939]: pgmap v1306: 17 pgs: 3 creating+peering, 8 active+clean, 6 unknown; 577 KiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:44:41.843 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:44:41.880 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:44:41.884 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:44:41.890 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_ops_in_flight 2024-04-01T19:44:42.129 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:44:42.133 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:42.133 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:44:42.234 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:44:42.262 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:42.379 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:42 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:44:42.379 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:42 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:44:42.379 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:42 smithi022 ceph-mon[39439]: osdmap e472: 12 total, 12 up, 12 in 2024-04-01T19:44:42.469 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:44:42.472 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:42.472 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:44:42.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:42 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:44:42.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:42 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:44:42.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:42 smithi062 ceph-mon[44211]: osdmap e472: 12 total, 12 up, 12 in 2024-04-01T19:44:42.573 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:44:42.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:42 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:44:42.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:42 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:44:42.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:42 smithi188 ceph-mon[43939]: osdmap e472: 12 total, 12 up, 12 in 2024-04-01T19:44:42.605 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:42.626 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:44:42.629 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:42.629 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:44:42.730 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:44:42.761 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:42.780 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:44:42.783 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:42.783 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:44:42.884 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:44:42.920 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:43.021 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:44:43.024 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:43.024 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:44:43.125 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:44:43.155 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:43.175 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:44:43.178 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:43.179 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:44:43.279 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:44:43.313 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:43.334 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:44:43.337 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:43.338 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:44:43.346 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:44:43.438 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:44:43.466 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:43 smithi188 ceph-mon[43939]: pgmap v1308: 17 pgs: 3 creating+peering, 14 active+clean; 577 KiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:44:43.469 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:43.489 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:44:43.492 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:43.492 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:44:43.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:43 smithi062 ceph-mon[44211]: pgmap v1308: 17 pgs: 3 creating+peering, 14 active+clean; 577 KiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:44:43.559 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:43 smithi022 ceph-mon[39439]: pgmap v1308: 17 pgs: 3 creating+peering, 14 active+clean; 577 KiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:44:43.593 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:44:43.622 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:43.972 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:44:43.976 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:43.976 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:44:44.077 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:44:44.110 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:44.132 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:44:44.134 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:44.135 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:44:44.236 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:44:44.259 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:44:44.267 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:44.288 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:44:44.291 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:44.292 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:44:44.393 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:44:44.426 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:44.448 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:44:44.451 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:44.451 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:44:44.552 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:44:44.584 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:44.605 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:44:44.608 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:44.608 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:44:44.709 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:44:44.743 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:44.764 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:44:44.767 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:44.767 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:44:44.868 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:44:44.899 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:44.919 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:44:44.922 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:44.923 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:44:45.024 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:44:45.055 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:45.077 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:44:45.079 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:45.080 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:44:45.181 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:44:45.212 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:45 smithi022 ceph-mon[39439]: pgmap v1309: 17 pgs: 17 active+clean; 577 KiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:44:45.215 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:45.315 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:44:45.317 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:45.318 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:44:45.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:45 smithi188 ceph-mon[43939]: pgmap v1309: 17 pgs: 17 active+clean; 577 KiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:44:45.418 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:44:45.448 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:45 smithi062 ceph-mon[44211]: pgmap v1309: 17 pgs: 17 active+clean; 577 KiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:44:45.451 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:45.472 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:44:45.475 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:45.476 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:44:45.577 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:44:45.607 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:45.628 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:44:45.630 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:45.631 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:44:45.732 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:44:45.760 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:45.779 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:44:45.782 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:45.782 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:44:45.862 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:44:45.883 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:44:45.912 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:46.060 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:44:46.063 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:46.064 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:44:46.165 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:44:46.195 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:46.226 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:44:46.393 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:44:46.396 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:46.396 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:44:46.497 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:44:46.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:46 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2478817391' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:44:46.530 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:46.551 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:44:46.554 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:46.554 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:44:46.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:46 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2478817391' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:44:46.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:46 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2478817391' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:44:46.655 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:44:46.683 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:46.704 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:44:46.706 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:46.707 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:44:46.808 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:44:46.835 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:46.908 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:44:46.911 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:46.911 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:44:47.012 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:44:47.044 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:47.066 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:44:47.068 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:47.069 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:44:47.170 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:44:47.202 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:47.223 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:44:47.227 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.0 to 1 (10000) 2024-04-01T19:44:47.228 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:47.228 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:44:47.329 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:44:47.361 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:47 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:44:47.361 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:47 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2478817391' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:44:47.361 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:47 smithi188 ceph-mon[43939]: osdmap e473: 12 total, 12 up, 12 in 2024-04-01T19:44:47.361 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:47 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/674201700' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T19:44:47.361 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:47 smithi188 ceph-mon[43939]: pgmap v1311: 17 pgs: 17 active+clean; 577 KiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:44:47.365 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:47.385 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:44:47.388 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:47.388 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:44:47.449 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:47 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:44:47.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:47 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2478817391' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:44:47.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:47 smithi022 ceph-mon[39439]: osdmap e473: 12 total, 12 up, 12 in 2024-04-01T19:44:47.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:47 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/674201700' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T19:44:47.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:47 smithi022 ceph-mon[39439]: pgmap v1311: 17 pgs: 17 active+clean; 577 KiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:44:47.490 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:44:47.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:47 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:44:47.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:47 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2478817391' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:44:47.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:47 smithi062 ceph-mon[44211]: osdmap e473: 12 total, 12 up, 12 in 2024-04-01T19:44:47.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:47 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/674201700' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T19:44:47.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:47 smithi062 ceph-mon[44211]: pgmap v1311: 17 pgs: 17 active+clean; 577 KiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:44:47.519 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:47.539 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:44:47.542 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:47.542 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:44:47.643 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:44:47.676 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:47.698 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:44:47.700 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:47.701 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:44:47.802 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:44:47.833 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:47.854 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:44:47.857 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:47.857 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:44:47.958 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:44:47.988 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:48.008 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:44:48.010 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:48.011 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:44:48.112 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:44:48.141 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:48.375 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 1 1 2024-04-01T19:44:48.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:48 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/674201700' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-04-01T19:44:48.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:48 smithi062 ceph-mon[44211]: osdmap e474: 12 total, 12 up, 12 in 2024-04-01T19:44:48.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:48 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/674201700' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-04-01T19:44:48.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:48 smithi022 ceph-mon[39439]: osdmap e474: 12 total, 12 up, 12 in 2024-04-01T19:44:48.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:48 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/674201700' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-04-01T19:44:48.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:48 smithi188 ceph-mon[43939]: osdmap e474: 12 total, 12 up, 12 in 2024-04-01T19:44:48.870 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:44:48.873 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:48.873 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:44:48.974 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:44:49.003 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:49.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:49 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:44:49.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:49 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:44:49.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:49 smithi022 ceph-mon[39439]: pgmap v1313: 17 pgs: 17 active+clean; 577 KiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:44:49.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:49 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:44:49.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:49 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:44:49.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:49 smithi062 ceph-mon[44211]: pgmap v1313: 17 pgs: 17 active+clean; 577 KiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:44:49.553 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:44:49.556 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:49.556 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:44:49.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:49 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:44:49.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:49 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:44:49.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:49 smithi188 ceph-mon[43939]: pgmap v1313: 17 pgs: 17 active+clean; 577 KiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:44:49.657 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:44:49.687 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:50.239 INFO:teuthology.orchestra.run.smithi022.stderr:enabled application 'rados' on pool 'unique_pool_4' 2024-04-01T19:44:50.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:50 smithi062 ceph-mon[44211]: osdmap e475: 12 total, 12 up, 12 in 2024-04-01T19:44:50.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:50 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/183459488' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:44:50.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:50 smithi022 ceph-mon[39439]: osdmap e475: 12 total, 12 up, 12 in 2024-04-01T19:44:50.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:50 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/183459488' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:44:50.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:50 smithi188 ceph-mon[43939]: osdmap e475: 12 total, 12 up, 12 in 2024-04-01T19:44:50.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:50 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/183459488' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:44:50.677 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:44:50.736 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:44:50.739 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:50.739 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:44:50.840 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:44:50.867 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:50.895 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:44:50.909 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:50.909 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:44:51.010 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:44:51.042 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:51.063 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:44:51.066 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:51.067 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:44:51.168 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:44:51.196 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:51 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/183459488' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:44:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:51 smithi188 ceph-mon[43939]: osdmap e476: 12 total, 12 up, 12 in 2024-04-01T19:44:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:51 smithi188 ceph-mon[43939]: pgmap v1316: 17 pgs: 17 active+clean; 577 KiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:44:51.385 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:44:51.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:51 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/183459488' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:44:51.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:51 smithi062 ceph-mon[44211]: osdmap e476: 12 total, 12 up, 12 in 2024-04-01T19:44:51.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:51 smithi062 ceph-mon[44211]: pgmap v1316: 17 pgs: 17 active+clean; 577 KiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:44:51.583 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:51 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/183459488' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:44:51.583 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:51 smithi022 ceph-mon[39439]: osdmap e476: 12 total, 12 up, 12 in 2024-04-01T19:44:51.583 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:51 smithi022 ceph-mon[39439]: pgmap v1316: 17 pgs: 17 active+clean; 577 KiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T19:44:52.417 DEBUG:teuthology.orchestra.run.smithi188:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.2 -b 65536 --object-size 65536 -p unique_pool_4 bench 90 write' 2024-04-01T19:44:52.420 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-04-01T19:44:52.420 INFO:teuthology.orchestra.run:waiting for 3000 2024-04-01T19:44:52.445 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:44:52.447 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:52 smithi022 ceph-mon[39439]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T19:44:52.447 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:52 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:44:52.448 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:52.449 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:44:52.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:52 smithi062 ceph-mon[44211]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T19:44:52.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:52 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:44:52.516 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:hints = 1 2024-04-01T19:44:52.516 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-04-01T19:44:52.516 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Object prefix: benchmark_data_smithi188_134454 2024-04-01T19:44:52.516 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:44:52.517 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 0 0 0 0 0 0 - 0 2024-04-01T19:44:52.549 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:44:52.580 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:52 smithi188 ceph-mon[43939]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T19:44:52.580 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:52 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:44:52.583 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:52.608 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:44:52.611 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:52.612 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:44:52.712 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:44:52.772 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:53.130 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:44:53.141 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:53.141 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:44:53.241 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:44:53.241 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:44:53.241 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:44:53.241 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:44:53.241 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:44:53.241 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:44:53.241 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:44:53.241 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:44:53.241 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:44:53.242 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:44:53.273 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:44:53.300 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:53.311 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:44:53.347 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:44:53.352 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:44:53.352 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:44:53.352 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:44:53.352 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:44:53.352 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:44:53.352 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:44:53.352 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:44:53.352 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:44:53.352 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:44:53.352 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:44:53.352 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:44:53.352 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:44:53.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:53 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3998049946' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:44:53.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:53.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:53 smithi022 ceph-mon[39439]: pgmap v1317: 17 pgs: 17 active+clean; 13 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s wr, 33 op/s 2024-04-01T19:44:53.504 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:44:53.505 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:44:53.506 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:44:53.508 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:53.509 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:44:53.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:53 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3998049946' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:44:53.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:53.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:53 smithi062 ceph-mon[44211]: pgmap v1317: 17 pgs: 17 active+clean; 13 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s wr, 33 op/s 2024-04-01T19:44:53.516 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 1 16 4564 4548 284.251 284.25 0.00154022 0.00295261 2024-04-01T19:44:53.610 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:44:53.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:53 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3998049946' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:44:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:53 smithi188 ceph-mon[43939]: pgmap v1317: 17 pgs: 17 active+clean; 13 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s wr, 33 op/s 2024-04-01T19:44:53.643 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:53.665 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:44:53.668 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:53.668 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:44:53.769 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:44:53.814 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:53.955 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:44:53.958 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:53.959 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:44:54.059 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:44:54.104 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:54.131 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:44:54.134 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:54.134 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:44:54.235 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:44:54.279 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:54.305 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:44:54.309 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:54.309 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:44:54.410 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:44:54.441 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:54.463 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:44:54.467 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:54.468 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:44:54.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.517 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 2 16 9724 9708 303.364 322.5 0.003224 0.00329359 2024-04-01T19:44:54.568 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:44:54.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.614 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:54.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:44:54.641 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:44:54.644 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:54.644 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:44:54.745 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:44:54.777 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:54.799 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:44:54.803 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:54.803 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:44:54.904 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:44:54.951 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:54.984 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:44:54.988 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:54.988 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:44:55.089 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:44:55.130 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:55.153 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_blocked_ops 2024-04-01T19:44:55.158 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:44:55.161 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:55.162 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:44:55.263 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:44:55.300 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:55.330 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:44:55.333 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:55.333 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:44:55.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:55 smithi022 ceph-mon[39439]: pgmap v1318: 17 pgs: 17 active+clean; 141 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s wr, 285 op/s 2024-04-01T19:44:55.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:55 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:44:55.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:55 smithi022 ceph-mon[39439]: osdmap e477: 12 total, 12 up, 12 in 2024-04-01T19:44:55.434 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:44:55.478 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:55.507 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:44:55.511 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:55.511 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:44:55.517 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 3 16 13980 13964 290.903 266 0.00385033 0.00343378 2024-04-01T19:44:55.612 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:44:55.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:55 smithi188 ceph-mon[43939]: pgmap v1318: 17 pgs: 17 active+clean; 141 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s wr, 285 op/s 2024-04-01T19:44:55.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:55 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:44:55.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:55 smithi188 ceph-mon[43939]: osdmap e477: 12 total, 12 up, 12 in 2024-04-01T19:44:55.655 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:55 smithi062 ceph-mon[44211]: pgmap v1318: 17 pgs: 17 active+clean; 141 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s wr, 285 op/s 2024-04-01T19:44:55.655 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:55 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:44:55.655 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:55 smithi062 ceph-mon[44211]: osdmap e477: 12 total, 12 up, 12 in 2024-04-01T19:44:55.658 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:55.684 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:44:55.689 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:55.689 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:44:55.708 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:44:55.790 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:44:55.840 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:44:55.853 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:56.517 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 4 15 17493 17478 273.079 219.625 0.00231675 0.00365964 2024-04-01T19:44:56.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:56 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:44:56.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:56 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:44:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:56 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:44:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:56 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1534425745' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T19:44:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:56 smithi188 ceph-mon[43939]: from='client.26296 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T19:44:56.653 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:44:56.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:56 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:44:56.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:56 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:44:56.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:56 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:44:56.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:56 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1534425745' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T19:44:56.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:56 smithi062 ceph-mon[44211]: from='client.26296 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T19:44:56.777 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:56 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:44:56.777 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:56 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:44:56.777 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:56 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:44:56.777 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:56 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1534425745' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T19:44:56.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:56 smithi022 ceph-mon[39439]: from='client.26296 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T19:44:57.079 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.1 to 1 (10000) 2024-04-01T19:44:57.517 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 5 16 21639 21623 270.271 259.062 0.00255744 0.00369818 2024-04-01T19:44:57.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:57 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T19:44:57.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:57 smithi022 ceph-mon[39439]: from='client.26296 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-04-01T19:44:57.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:57 smithi022 ceph-mon[39439]: osdmap e478: 12 total, 12 up, 12 in 2024-04-01T19:44:57.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:57 smithi022 ceph-mon[39439]: pgmap v1321: 17 pgs: 17 active+clean; 648 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 94 MiB/s wr, 1.51k op/s 2024-04-01T19:44:57.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:57 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T19:44:57.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:57 smithi188 ceph-mon[43939]: from='client.26296 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-04-01T19:44:57.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:57 smithi188 ceph-mon[43939]: osdmap e478: 12 total, 12 up, 12 in 2024-04-01T19:44:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:57 smithi188 ceph-mon[43939]: pgmap v1321: 17 pgs: 17 active+clean; 648 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 94 MiB/s wr, 1.51k op/s 2024-04-01T19:44:57.752 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:44:57.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:57 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T19:44:57.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:57 smithi062 ceph-mon[44211]: from='client.26296 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-04-01T19:44:57.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:57 smithi062 ceph-mon[44211]: osdmap e478: 12 total, 12 up, 12 in 2024-04-01T19:44:57.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:57 smithi062 ceph-mon[44211]: pgmap v1321: 17 pgs: 17 active+clean; 648 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 94 MiB/s wr, 1.51k op/s 2024-04-01T19:44:57.917 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:57.917 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:44:58.018 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:44:58.120 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:58.517 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 6 16 25061 25045 260.869 213.875 0.00309997 0.00383062 2024-04-01T19:44:58.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:58 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T19:44:58.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:58 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T19:44:58.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:58 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T19:44:59.395 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:44:59.464 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:59.465 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:44:59.517 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 7 16 28710 28694 256.18 228.062 0.00624312 0.00390132 2024-04-01T19:44:59.565 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:44:59.605 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:44:59 smithi062 ceph-mon[44211]: pgmap v1322: 17 pgs: 17 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 142 MiB/s wr, 2.28k op/s 2024-04-01T19:44:59.608 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:59.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:44:59 smithi022 ceph-mon[39439]: pgmap v1322: 17 pgs: 17 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 142 MiB/s wr, 2.28k op/s 2024-04-01T19:44:59.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:44:59 smithi188 ceph-mon[43939]: pgmap v1322: 17 pgs: 17 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 142 MiB/s wr, 2.28k op/s 2024-04-01T19:44:59.640 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:44:59.644 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:59.645 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:44:59.745 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:44:59.787 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:59.821 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:44:59.826 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:59.827 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:44:59.928 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:44:59.958 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:44:59.980 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:44:59.983 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:44:59.983 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:45:00.084 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:45:00.135 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:00.176 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:45:00.179 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:00.180 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:45:00.281 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:45:00.321 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:00.351 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:45:00.354 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:00.354 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:45:00.455 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:45:00.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:00 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:45:00.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:00 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:45:00.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:00 smithi062 ceph-mon[44211]: osdmap e479: 12 total, 12 up, 12 in 2024-04-01T19:45:00.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:00 smithi062 ceph-mon[44211]: osdmap e480: 12 total, 12 up, 12 in 2024-04-01T19:45:00.517 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 8 15 32054 32039 250.288 209.062 0.00194823 0.00399265 2024-04-01T19:45:00.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:00 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:45:00.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:00 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:45:00.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:00 smithi022 ceph-mon[39439]: osdmap e479: 12 total, 12 up, 12 in 2024-04-01T19:45:00.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:00 smithi022 ceph-mon[39439]: osdmap e480: 12 total, 12 up, 12 in 2024-04-01T19:45:00.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:00 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:45:00.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:00 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:45:00.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:00 smithi188 ceph-mon[43939]: osdmap e479: 12 total, 12 up, 12 in 2024-04-01T19:45:00.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:00 smithi188 ceph-mon[43939]: osdmap e480: 12 total, 12 up, 12 in 2024-04-01T19:45:00.683 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:01.517 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 9 15 35289 35274 244.942 202.188 0.00409551 0.00408114 2024-04-01T19:45:01.545 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:45:01.547 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:01 smithi022 ceph-mon[39439]: pgmap v1325: 17 pgs: 17 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 255 MiB/s wr, 4.08k op/s 2024-04-01T19:45:01.548 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:01.548 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:45:01.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:01 smithi188 ceph-mon[43939]: pgmap v1325: 17 pgs: 17 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 255 MiB/s wr, 4.08k op/s 2024-04-01T19:45:01.649 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:45:01.697 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:01.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:01 smithi062 ceph-mon[44211]: pgmap v1325: 17 pgs: 17 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 255 MiB/s wr, 4.08k op/s 2024-04-01T19:45:02.517 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 10 16 38202 38186 238.646 182 0.00261196 0.0041886 2024-04-01T19:45:03.162 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:45:03.167 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:03.168 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:45:03.201 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 2 1 2024-04-01T19:45:03.269 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:45:03.297 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:03.320 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:45:03.323 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:03.323 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:45:03.424 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:45:03.454 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:03.477 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:45:03.479 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:03 smithi188 ceph-mon[43939]: pgmap v1326: 17 pgs: 17 active+clean; 2.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 231 MiB/s wr, 3.69k op/s 2024-04-01T19:45:03.479 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:03.479 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:45:03.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:03 smithi062 ceph-mon[44211]: pgmap v1326: 17 pgs: 17 active+clean; 2.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 231 MiB/s wr, 3.69k op/s 2024-04-01T19:45:03.517 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 11 16 40784 40768 231.62 161.375 0.00719414 0.00431618 2024-04-01T19:45:03.581 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:45:03.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:03 smithi022 ceph-mon[39439]: pgmap v1326: 17 pgs: 17 active+clean; 2.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 231 MiB/s wr, 3.69k op/s 2024-04-01T19:45:03.640 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:03.762 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:45:03.768 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:03.768 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:45:03.869 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:45:03.895 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:03.916 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:45:03.918 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:03.919 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:45:04.019 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:45:04.066 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:04.097 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:45:04.100 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:04.100 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:45:04.201 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:45:04.231 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:04.252 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:45:04.255 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:04.255 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:45:04.356 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:45:04.386 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:04.409 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:45:04.412 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:04.412 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:45:04.513 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:45:04.517 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 12 16 43423 43407 226.062 164.938 0.00439852 0.00442198 2024-04-01T19:45:04.561 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:45:04.599 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:04.599 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:45:04.701 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:45:04.743 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:04.744 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:45:04.752 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:45:04.769 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:45:04.773 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:04.773 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:45:04.874 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:45:04.920 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:04.953 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:45:04.958 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:04.958 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:45:05.059 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:45:05.089 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:05.110 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:45:05.112 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:05.113 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:45:05.204 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:05 smithi062 ceph-mon[44211]: pgmap v1327: 17 pgs: 17 active+clean; 2.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 211 MiB/s wr, 3.38k op/s 2024-04-01T19:45:05.214 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:45:05.266 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:05.298 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:45:05.301 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:05.301 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:45:05.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:05 smithi022 ceph-mon[39439]: pgmap v1327: 17 pgs: 17 active+clean; 2.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 211 MiB/s wr, 3.38k op/s 2024-04-01T19:45:05.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:05 smithi188 ceph-mon[43939]: pgmap v1327: 17 pgs: 17 active+clean; 2.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 211 MiB/s wr, 3.38k op/s 2024-04-01T19:45:05.402 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:45:05.451 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:05.484 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:45:05.491 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:05.492 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:45:05.517 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 13 16 46095 46079 221.518 167 0.00399619 0.00451261 2024-04-01T19:45:05.592 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:45:05.636 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:05.656 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:45:05.658 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:05.659 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:45:05.760 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:45:05.812 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:05.840 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:45:05.844 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:05.844 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:45:05.945 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:45:05.996 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:06.026 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:45:06.029 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:06.029 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:45:06.130 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:45:06.162 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:06.185 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:45:06.189 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:06.189 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:45:06.229 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:06 smithi062 ceph-mon[44211]: osdmap e481: 12 total, 12 up, 12 in 2024-04-01T19:45:06.289 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:45:06.316 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:06.335 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:45:06.337 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:06.338 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:45:06.438 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:45:06.481 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:06 smithi022 ceph-mon[39439]: osdmap e481: 12 total, 12 up, 12 in 2024-04-01T19:45:06.487 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:06.517 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 14 16 48420 48404 216.074 145.312 0.00644191 0.00462651 2024-04-01T19:45:06.533 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:45:06.537 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:06.539 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:45:06.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:06 smithi188 ceph-mon[43939]: osdmap e481: 12 total, 12 up, 12 in 2024-04-01T19:45:06.639 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:45:06.669 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:06.690 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:45:06.693 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:06.693 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:45:06.794 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:45:06.840 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:06.874 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:45:06.878 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:06.878 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:45:06.979 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:45:07.027 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:07.055 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:45:07.059 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:07.060 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:45:07.161 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:45:07.210 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:07.238 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:07 smithi062 ceph-mon[44211]: pgmap v1329: 17 pgs: 17 active+clean; 2.7 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 197 MiB/s wr, 3.15k op/s 2024-04-01T19:45:07.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:07 smithi022 ceph-mon[39439]: pgmap v1329: 17 pgs: 17 active+clean; 2.7 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 197 MiB/s wr, 3.15k op/s 2024-04-01T19:45:07.518 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 15 16 50979 50963 212.33 159.938 0.00516529 0.00470765 2024-04-01T19:45:07.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:07 smithi188 ceph-mon[43939]: pgmap v1329: 17 pgs: 17 active+clean; 2.7 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 197 MiB/s wr, 3.15k op/s 2024-04-01T19:45:08.286 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:08 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3185985681' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:45:08.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:08 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3185985681' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:45:08.518 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 16 16 53500 53484 208.906 157.562 0.00299016 0.00478564 2024-04-01T19:45:08.560 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:45:08.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:08 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3185985681' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:45:09.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:09 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:45:09.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:09 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3185985681' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:45:09.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:09 smithi062 ceph-mon[44211]: osdmap e482: 12 total, 12 up, 12 in 2024-04-01T19:45:09.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:09 smithi062 ceph-mon[44211]: pgmap v1331: 17 pgs: 17 active+clean; 3.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 177 MiB/s wr, 2.83k op/s 2024-04-01T19:45:09.518 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 17 16 56050 56034 205.992 159.375 0.0102732 0.00485297 2024-04-01T19:45:09.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:09 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:45:09.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:09 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3185985681' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:45:09.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:09 smithi022 ceph-mon[39439]: osdmap e482: 12 total, 12 up, 12 in 2024-04-01T19:45:09.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:09 smithi022 ceph-mon[39439]: pgmap v1331: 17 pgs: 17 active+clean; 3.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 177 MiB/s wr, 2.83k op/s 2024-04-01T19:45:09.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:09 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:45:09.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:09 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3185985681' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:45:09.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:09 smithi188 ceph-mon[43939]: osdmap e482: 12 total, 12 up, 12 in 2024-04-01T19:45:09.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:09 smithi188 ceph-mon[43939]: pgmap v1331: 17 pgs: 17 active+clean; 3.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 177 MiB/s wr, 2.83k op/s 2024-04-01T19:45:09.874 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:45:09.883 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:09.883 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:45:09.984 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:45:10.044 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:10.133 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:45:10.133 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:45:10.150 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:45:10.153 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:10.153 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:45:10.254 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:45:10.283 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:10.305 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:45:10.308 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:10.308 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:45:10.409 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:45:10.456 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:10.491 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:45:10.496 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:10.497 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:45:10.518 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 18 15 58405 58390 202.728 147.25 0.00531666 0.00493118 2024-04-01T19:45:10.597 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:45:10.650 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:10.839 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:45:10.844 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:10.844 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:45:10.892 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_historic_ops 2024-04-01T19:45:10.945 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:45:11.003 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:11.025 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:45:11.029 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:11.029 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:45:11.130 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:45:11.195 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:11.223 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:45:11.229 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:11.230 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:45:11.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:11 smithi062 ceph-mon[44211]: pgmap v1332: 17 pgs: 17 active+clean; 3.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 169 MiB/s wr, 2.71k op/s 2024-04-01T19:45:11.331 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:45:11.379 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:11.404 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:45:11.410 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:11.411 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:45:11.476 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:11 smithi022 ceph-mon[39439]: pgmap v1332: 17 pgs: 17 active+clean; 3.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 169 MiB/s wr, 2.71k op/s 2024-04-01T19:45:11.512 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:45:11.518 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 19 16 60678 60662 199.531 142 0.00855431 0.00501048 2024-04-01T19:45:11.537 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:11 smithi188 ceph-mon[43939]: pgmap v1332: 17 pgs: 17 active+clean; 3.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 169 MiB/s wr, 2.71k op/s 2024-04-01T19:45:11.540 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:11.561 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:45:11.564 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:11.564 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:45:11.665 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:45:11.692 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:11.715 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:45:11.717 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:11.718 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:45:11.819 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:45:11.866 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:11.976 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:45:11.987 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:11.987 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:45:12.088 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:45:12.131 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:12.518 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:45:12.521649 min lat: 0.000949379 max lat: 0.208931 avg lat: 0.00507981 2024-04-01T19:45:12.518 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:45:12.518 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 20 16 62995 62979 196.794 144.812 0.00286757 0.00507981 2024-04-01T19:45:13.481 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:13 smithi022 ceph-mon[39439]: pgmap v1333: 17 pgs: 17 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 167 MiB/s wr, 2.67k op/s 2024-04-01T19:45:13.497 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:45:13.502 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:13.502 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:45:13.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:13 smithi062 ceph-mon[44211]: pgmap v1333: 17 pgs: 17 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 167 MiB/s wr, 2.67k op/s 2024-04-01T19:45:13.518 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 21 16 64918 64902 193.146 120.188 0.0134182 0.00517589 2024-04-01T19:45:13.602 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:45:13.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:13 smithi188 ceph-mon[43939]: pgmap v1333: 17 pgs: 17 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 167 MiB/s wr, 2.67k op/s 2024-04-01T19:45:13.649 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:14.297 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:14 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2926549293' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:45:14.297 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:14.323 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:45:14.326 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:14.327 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:45:14.419 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:45:14.419 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:45:14.419 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:45:14.419 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:45:14.419 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:45:14.428 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:45:14.455 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:45:14.482 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:45:14.483 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:14.518 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 22 16 67035 67019 190.38 132.312 0.00634584 0.0052508 2024-04-01T19:45:14.519 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:45:14.524 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:14.524 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:45:14.526 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:45:14.560 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:45:14.605 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:45:14.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:14 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2926549293' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:45:14.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:14.625 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:45:14.649 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:45:14.676 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:45:14.696 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:45:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:45:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:45:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:45:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:45:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:45:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:45:14.711 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:45:14.711 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:45:14.711 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:45:14.711 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:45:14.711 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:45:14.711 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:45:14.711 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:14.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:14 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2926549293' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:45:14.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.335 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.2 to 1 (10000) 2024-04-01T19:45:15.518 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 23 16 69043 69027 187.559 125.5 0.00376042 0.00533026 2024-04-01T19:45:15.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:15 smithi022 ceph-mon[39439]: pgmap v1334: 17 pgs: 17 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 158 MiB/s wr, 2.53k op/s 2024-04-01T19:45:15.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:15 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1371761888' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:45:15.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:15 smithi022 ceph-mon[39439]: from='client.26311 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:45:15.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:15 smithi188 ceph-mon[43939]: pgmap v1334: 17 pgs: 17 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 158 MiB/s wr, 2.53k op/s 2024-04-01T19:45:15.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:15 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1371761888' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:45:15.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:15 smithi188 ceph-mon[43939]: from='client.26311 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:45:15.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:15.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:15 smithi062 ceph-mon[44211]: pgmap v1334: 17 pgs: 17 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 158 MiB/s wr, 2.53k op/s 2024-04-01T19:45:15.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:15 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1371761888' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:45:15.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:15 smithi062 ceph-mon[44211]: from='client.26311 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:45:15.968 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:45:15.983 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:45:15.989 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:15.990 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:45:16.090 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:45:16.120 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:16.140 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:45:16.143 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:16.143 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:45:16.244 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:45:16.309 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:16.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:16 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:16.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:16 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:16.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:16 smithi188 ceph-mon[43939]: from='client.26311 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-04-01T19:45:16.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:16 smithi188 ceph-mon[43939]: osdmap e483: 12 total, 12 up, 12 in 2024-04-01T19:45:16.518 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 24 16 71093 71077 185.082 128.125 0.00531249 0.00540086 2024-04-01T19:45:16.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:16 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:16.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:16 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:16.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:16 smithi022 ceph-mon[39439]: from='client.26311 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-04-01T19:45:16.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:16 smithi022 ceph-mon[39439]: osdmap e483: 12 total, 12 up, 12 in 2024-04-01T19:45:16.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:16 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:16.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:16 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:16.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:16 smithi062 ceph-mon[44211]: from='client.26311 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-04-01T19:45:16.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:16 smithi062 ceph-mon[44211]: osdmap e483: 12 total, 12 up, 12 in 2024-04-01T19:45:17.315 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:17 smithi022 ceph-mon[39439]: pgmap v1336: 17 pgs: 17 active+clean; 4.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 149 MiB/s wr, 2.38k op/s 2024-04-01T19:45:17.519 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 25 16 73198 73182 182.941 131.562 0.0076215 0.00546445 2024-04-01T19:45:17.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:17 smithi188 ceph-mon[43939]: pgmap v1336: 17 pgs: 17 active+clean; 4.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 149 MiB/s wr, 2.38k op/s 2024-04-01T19:45:17.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:17 smithi062 ceph-mon[44211]: pgmap v1336: 17 pgs: 17 active+clean; 4.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 149 MiB/s wr, 2.38k op/s 2024-04-01T19:45:18.107 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:45:18.111 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:18.111 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:45:18.212 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:45:18.239 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:18.261 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:45:18.264 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:18.265 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:45:18.365 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:45:18.412 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:18.518 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 26 16 75113 75097 180.508 119.688 0.00439299 0.00553836 2024-04-01T19:45:18.798 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 3 1 2024-04-01T19:45:19.172 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:45:19.183 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:45:19.188 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:19.188 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:45:19.289 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:45:19.341 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:19.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:19 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:45:19.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:19 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:45:19.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:19 smithi022 ceph-mon[39439]: osdmap e484: 12 total, 12 up, 12 in 2024-04-01T19:45:19.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:19 smithi022 ceph-mon[39439]: pgmap v1338: 17 pgs: 17 active+clean; 4.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 134 MiB/s wr, 2.14k op/s 2024-04-01T19:45:19.432 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:45:19.436 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:19.437 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:45:19.518 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 27 16 77054 77038 178.315 121.312 0.00909312 0.00560659 2024-04-01T19:45:19.538 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:45:19.588 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:19.623 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:45:19.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:19 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:45:19.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:19 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:45:19.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:19 smithi188 ceph-mon[43939]: osdmap e484: 12 total, 12 up, 12 in 2024-04-01T19:45:19.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:19 smithi188 ceph-mon[43939]: pgmap v1338: 17 pgs: 17 active+clean; 4.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 134 MiB/s wr, 2.14k op/s 2024-04-01T19:45:19.627 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:19 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:45:19.628 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:19 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:45:19.628 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:19 smithi062 ceph-mon[44211]: osdmap e484: 12 total, 12 up, 12 in 2024-04-01T19:45:19.628 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:19 smithi062 ceph-mon[44211]: pgmap v1338: 17 pgs: 17 active+clean; 4.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 134 MiB/s wr, 2.14k op/s 2024-04-01T19:45:19.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:19.629 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:45:19.730 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:45:19.759 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:19.781 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:45:19.784 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:19.784 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:45:19.885 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:45:19.947 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:19.955 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:45:19.974 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:45:19.978 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:19.978 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:45:20.035 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:45:20.035 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 20, 2024-04-01T19:45:20.035 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 600, 2024-04-01T19:45:20.035 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:45:20.035 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.035 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:234000 5.6 5:653ce61c:::benchmark_data_smithi188_119427_object69301:head [delete] snapc 0=[] ondisk+write+known_if_redirected e421)", 2024-04-01T19:45:20.035 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:04.099886+0000", 2024-04-01T19:45:20.035 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 195.93224991400001, 2024-04-01T19:45:20.035 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21627006900000001, 2024-04-01T19:45:20.035 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:20.036 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:20.036 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:20.036 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:20.036 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:45:20.036 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:45:20.036 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 234000 2024-04-01T19:45:20.036 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.036 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:20.036 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.036 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:20.036 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.099886+0000", 2024-04-01T19:45:20.036 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.036 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.036 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.037 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:20.037 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.099886+0000", 2024-04-01T19:45:20.037 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.037 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.037 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.037 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:20.037 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.099889+0000", 2024-04-01T19:45:20.037 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.2049999999999998e-06 2024-04-01T19:45:20.037 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.037 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.037 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:20.037 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.099899+0000", 2024-04-01T19:45:20.037 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0029e-05 2024-04-01T19:45:20.037 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.038 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.038 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:20.038 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.099921+0000", 2024-04-01T19:45:20.038 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2070999999999999e-05 2024-04-01T19:45:20.038 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.038 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.038 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:20.038 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.099933+0000", 2024-04-01T19:45:20.038 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1477999999999999e-05 2024-04-01T19:45:20.038 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.038 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.038 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:20.039 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.100862+0000", 2024-04-01T19:45:20.039 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00092963900000000001 2024-04-01T19:45:20.039 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.039 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.039 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:20.039 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.100985+0000", 2024-04-01T19:45:20.039 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012279200000000001 2024-04-01T19:45:20.039 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.039 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.039 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:45:20.039 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.101100+0000", 2024-04-01T19:45:20.039 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000114603 2024-04-01T19:45:20.039 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.040 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.040 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:20.040 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.120571+0000", 2024-04-01T19:45:20.040 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.019470945 2024-04-01T19:45:20.040 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.040 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.040 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:20.040 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.316037+0000", 2024-04-01T19:45:20.040 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.19546575699999999 2024-04-01T19:45:20.040 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.040 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.040 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:20.040 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.316100+0000", 2024-04-01T19:45:20.040 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3471000000000003e-05 2024-04-01T19:45:20.041 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.041 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.041 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:20.041 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.316156+0000", 2024-04-01T19:45:20.041 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6079000000000003e-05 2024-04-01T19:45:20.041 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.041 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:20.041 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.041 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.041 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.041 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:234001 5.6 5:6f3b55b8:::benchmark_data_smithi188_119427_object69302:head [delete] snapc 0=[] ondisk+write+known_if_redirected e421)", 2024-04-01T19:45:20.041 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:04.100635+0000", 2024-04-01T19:45:20.041 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 195.93150116300001, 2024-04-01T19:45:20.041 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.23405330299999999, 2024-04-01T19:45:20.042 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:20.042 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:20.042 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:20.042 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:20.042 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:45:20.042 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:45:20.042 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 234001 2024-04-01T19:45:20.042 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.042 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:20.042 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.042 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:20.042 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.100635+0000", 2024-04-01T19:45:20.042 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.043 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.043 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.043 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:20.043 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.100635+0000", 2024-04-01T19:45:20.043 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.043 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.043 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.043 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:20.043 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.100636+0000", 2024-04-01T19:45:20.043 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6029999999999999e-06 2024-04-01T19:45:20.043 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.043 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.043 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:20.043 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.100642+0000", 2024-04-01T19:45:20.043 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.874e-06 2024-04-01T19:45:20.044 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.044 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.044 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:20.044 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.100651+0000", 2024-04-01T19:45:20.044 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3380000000000005e-06 2024-04-01T19:45:20.044 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.044 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.044 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:20.044 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.100659+0000", 2024-04-01T19:45:20.044 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0669999999999992e-06 2024-04-01T19:45:20.044 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.044 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.044 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:20.044 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.106172+0000", 2024-04-01T19:45:20.044 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0055135360000000003 2024-04-01T19:45:20.045 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.045 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.045 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:20.045 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.106325+0000", 2024-04-01T19:45:20.045 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000153234 2024-04-01T19:45:20.045 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.045 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.045 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:45:20.045 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.106432+0000", 2024-04-01T19:45:20.045 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000106623 2024-04-01T19:45:20.045 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.045 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.045 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:20.045 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.120576+0000", 2024-04-01T19:45:20.045 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014144143 2024-04-01T19:45:20.045 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.046 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.046 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:20.046 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.334582+0000", 2024-04-01T19:45:20.046 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21400577400000001 2024-04-01T19:45:20.046 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.046 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.046 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:20.046 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.334636+0000", 2024-04-01T19:45:20.046 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3987999999999999e-05 2024-04-01T19:45:20.046 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.046 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.046 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:20.046 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.334688+0000", 2024-04-01T19:45:20.046 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2123000000000002e-05 2024-04-01T19:45:20.046 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.047 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:20.047 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.047 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.047 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.047 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:234006 5.6 5:6e1adcc3:::benchmark_data_smithi188_119427_object69307:head [delete] snapc 0=[] ondisk+write+known_if_redirected e421)", 2024-04-01T19:45:20.047 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:04.105552+0000", 2024-04-01T19:45:20.047 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 195.926583475, 2024-04-01T19:45:20.047 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.233585283, 2024-04-01T19:45:20.047 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:20.047 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:20.047 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:20.047 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:20.047 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:45:20.047 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:45:20.047 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 234006 2024-04-01T19:45:20.048 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.048 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:20.048 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.048 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:20.048 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.105552+0000", 2024-04-01T19:45:20.048 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.048 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.048 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.048 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:20.048 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.105552+0000", 2024-04-01T19:45:20.048 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.048 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.048 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.048 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:20.048 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.105556+0000", 2024-04-01T19:45:20.048 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5599999999999998e-06 2024-04-01T19:45:20.049 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.049 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.049 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:20.049 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.105570+0000", 2024-04-01T19:45:20.049 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3777e-05 2024-04-01T19:45:20.049 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.049 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.049 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:20.049 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.105591+0000", 2024-04-01T19:45:20.049 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1602000000000001e-05 2024-04-01T19:45:20.049 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.049 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.049 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:20.049 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.105604+0000", 2024-04-01T19:45:20.049 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2549e-05 2024-04-01T19:45:20.050 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.050 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.050 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:20.050 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.110275+0000", 2024-04-01T19:45:20.050 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0046712070000000001 2024-04-01T19:45:20.050 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.050 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.050 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:20.050 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.110414+0000", 2024-04-01T19:45:20.050 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013842100000000001 2024-04-01T19:45:20.050 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.050 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.050 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:45:20.050 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.110566+0000", 2024-04-01T19:45:20.051 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000152175 2024-04-01T19:45:20.051 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.051 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.051 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:20.051 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.120581+0000", 2024-04-01T19:45:20.051 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010015690000000001 2024-04-01T19:45:20.051 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.051 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.051 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:20.051 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339064+0000", 2024-04-01T19:45:20.051 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21848295500000001 2024-04-01T19:45:20.051 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.051 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.051 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:20.051 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339098+0000", 2024-04-01T19:45:20.052 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3524e-05 2024-04-01T19:45:20.052 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.052 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.052 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:20.052 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339138+0000", 2024-04-01T19:45:20.052 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9823000000000001e-05 2024-04-01T19:45:20.052 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.052 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:20.052 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.052 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.052 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.052 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:234008 5.6 5:65e99957:::benchmark_data_smithi188_119427_object69309:head [delete] snapc 0=[] ondisk+write+known_if_redirected e421)", 2024-04-01T19:45:20.052 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:04.105628+0000", 2024-04-01T19:45:20.052 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 195.926508039, 2024-04-01T19:45:20.052 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.23362691799999999, 2024-04-01T19:45:20.053 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:20.053 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:20.053 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:20.053 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:20.053 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:45:20.053 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:45:20.053 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 234008 2024-04-01T19:45:20.053 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.053 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:20.053 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.053 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:20.053 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.105628+0000", 2024-04-01T19:45:20.053 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.053 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.053 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.054 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:20.054 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.105628+0000", 2024-04-01T19:45:20.054 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.054 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.054 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.054 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:20.054 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.105629+0000", 2024-04-01T19:45:20.054 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.1399999999999995e-07 2024-04-01T19:45:20.054 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.054 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.054 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:20.054 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.105633+0000", 2024-04-01T19:45:20.054 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.653e-06 2024-04-01T19:45:20.054 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.055 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.055 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:20.055 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.105640+0000", 2024-04-01T19:45:20.055 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3139999999999998e-06 2024-04-01T19:45:20.055 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.055 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.055 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:20.055 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.105646+0000", 2024-04-01T19:45:20.055 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3520000000000003e-06 2024-04-01T19:45:20.055 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.055 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.055 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:20.055 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.114814+0000", 2024-04-01T19:45:20.055 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0091675569999999998 2024-04-01T19:45:20.055 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.055 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.056 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:20.056 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.114933+0000", 2024-04-01T19:45:20.056 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000119503 2024-04-01T19:45:20.056 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.056 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.056 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:45:20.056 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.115047+0000", 2024-04-01T19:45:20.056 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000114057 2024-04-01T19:45:20.056 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.056 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.056 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:20.056 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.121947+0000", 2024-04-01T19:45:20.056 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.006899334 2024-04-01T19:45:20.056 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.056 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.057 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:20.057 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339179+0000", 2024-04-01T19:45:20.057 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21723257800000001 2024-04-01T19:45:20.057 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.057 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.057 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:20.057 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339226+0000", 2024-04-01T19:45:20.057 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6853e-05 2024-04-01T19:45:20.057 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.057 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.057 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:20.057 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339255+0000", 2024-04-01T19:45:20.057 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.8802999999999998e-05 2024-04-01T19:45:20.057 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.057 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:20.057 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.058 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.058 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.058 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:234027 5.6 5:6d33a902:::benchmark_data_smithi188_119427_object69328:head [delete] snapc 0=[] ondisk+write+known_if_redirected e421)", 2024-04-01T19:45:20.058 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:04.125767+0000", 2024-04-01T19:45:20.058 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 195.906368703, 2024-04-01T19:45:20.058 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21357989499999999, 2024-04-01T19:45:20.058 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:20.058 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:20.058 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:20.058 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:20.058 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:45:20.058 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:45:20.058 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 234027 2024-04-01T19:45:20.058 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.058 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:20.059 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.059 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:20.059 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.125767+0000", 2024-04-01T19:45:20.059 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.059 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.059 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.059 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:20.059 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.125767+0000", 2024-04-01T19:45:20.059 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.059 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.059 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.059 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:20.059 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.125770+0000", 2024-04-01T19:45:20.059 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.959e-06 2024-04-01T19:45:20.059 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.059 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.060 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:20.060 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.125778+0000", 2024-04-01T19:45:20.060 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.8790000000000003e-06 2024-04-01T19:45:20.060 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.060 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.060 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:20.060 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.125794+0000", 2024-04-01T19:45:20.060 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6220999999999999e-05 2024-04-01T19:45:20.060 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.060 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.060 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:20.060 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.125802+0000", 2024-04-01T19:45:20.060 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7940000000000003e-06 2024-04-01T19:45:20.060 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.060 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.060 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:20.061 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.125863+0000", 2024-04-01T19:45:20.061 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0516000000000001e-05 2024-04-01T19:45:20.061 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.061 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.061 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:20.061 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.126009+0000", 2024-04-01T19:45:20.061 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014631999999999999 2024-04-01T19:45:20.061 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.061 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.061 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:45:20.061 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.126142+0000", 2024-04-01T19:45:20.061 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013285 2024-04-01T19:45:20.061 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.061 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.061 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:20.062 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.130784+0000", 2024-04-01T19:45:20.062 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0046422939999999999 2024-04-01T19:45:20.062 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.062 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.062 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:20.062 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339291+0000", 2024-04-01T19:45:20.062 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.208506996 2024-04-01T19:45:20.062 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.062 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.062 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:20.062 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339321+0000", 2024-04-01T19:45:20.062 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.9470000000000001e-05 2024-04-01T19:45:20.062 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.062 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.062 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:20.063 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339347+0000", 2024-04-01T19:45:20.063 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6596000000000001e-05 2024-04-01T19:45:20.063 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.063 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:20.063 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.063 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.063 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.063 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:234046 5.6 5:6ef3a5bf:::benchmark_data_smithi188_119427_object69347:head [delete] snapc 0=[] ondisk+write+known_if_redirected e421)", 2024-04-01T19:45:20.063 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:04.143469+0000", 2024-04-01T19:45:20.063 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 195.88866691300001, 2024-04-01T19:45:20.063 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.19596270900000001, 2024-04-01T19:45:20.063 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:20.063 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:20.063 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:20.064 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:20.064 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:45:20.064 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:45:20.064 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 234046 2024-04-01T19:45:20.064 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.064 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:20.064 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.064 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:20.064 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.143469+0000", 2024-04-01T19:45:20.064 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.064 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.064 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.064 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:20.064 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.143469+0000", 2024-04-01T19:45:20.064 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.065 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.065 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.065 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:20.065 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.143471+0000", 2024-04-01T19:45:20.065 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4729999999999999e-06 2024-04-01T19:45:20.065 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.065 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.065 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:20.065 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.143479+0000", 2024-04-01T19:45:20.065 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0830000000000004e-06 2024-04-01T19:45:20.065 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.065 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.065 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:20.065 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.143498+0000", 2024-04-01T19:45:20.065 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9386999999999999e-05 2024-04-01T19:45:20.066 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.066 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.066 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:20.066 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.143507+0000", 2024-04-01T19:45:20.066 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.7369999999999995e-06 2024-04-01T19:45:20.066 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.066 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.066 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:20.066 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.143562+0000", 2024-04-01T19:45:20.066 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5172e-05 2024-04-01T19:45:20.066 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.066 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.066 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:20.066 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.143665+0000", 2024-04-01T19:45:20.066 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000103482 2024-04-01T19:45:20.067 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.067 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.067 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:45:20.067 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.143745+0000", 2024-04-01T19:45:20.067 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9196999999999994e-05 2024-04-01T19:45:20.067 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.067 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.067 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:20.067 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.155281+0000", 2024-04-01T19:45:20.067 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.011536872 2024-04-01T19:45:20.067 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.067 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.067 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:20.067 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339384+0000", 2024-04-01T19:45:20.067 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.18410228200000001 2024-04-01T19:45:20.067 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.068 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.068 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:20.068 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339411+0000", 2024-04-01T19:45:20.068 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6948e-05 2024-04-01T19:45:20.068 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.068 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.068 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:20.068 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339432+0000", 2024-04-01T19:45:20.068 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1075999999999999e-05 2024-04-01T19:45:20.068 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.068 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:20.068 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.068 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.068 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.068 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:234053 5.6 5:6cc0da58:::benchmark_data_smithi188_119427_object69354:head [delete] snapc 0=[] ondisk+write+known_if_redirected e421)", 2024-04-01T19:45:20.069 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:04.148441+0000", 2024-04-01T19:45:20.069 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 195.88369478199999, 2024-04-01T19:45:20.069 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.191088385, 2024-04-01T19:45:20.069 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:20.069 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:20.069 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:20.069 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:20.069 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:45:20.069 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:45:20.069 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 234053 2024-04-01T19:45:20.069 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.069 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:20.069 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.069 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:20.069 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.148441+0000", 2024-04-01T19:45:20.069 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.070 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.070 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.070 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:20.070 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.148441+0000", 2024-04-01T19:45:20.070 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.070 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.070 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.070 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:20.070 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.148443+0000", 2024-04-01T19:45:20.070 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8390000000000001e-06 2024-04-01T19:45:20.070 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.070 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.070 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:20.070 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.148451+0000", 2024-04-01T19:45:20.070 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5039999999999996e-06 2024-04-01T19:45:20.071 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.071 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.071 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:20.071 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.148460+0000", 2024-04-01T19:45:20.071 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.5799999999999998e-06 2024-04-01T19:45:20.071 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.071 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.071 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:20.071 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.148467+0000", 2024-04-01T19:45:20.071 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4339999999999997e-06 2024-04-01T19:45:20.071 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.071 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.071 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:20.071 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.150571+0000", 2024-04-01T19:45:20.071 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0021041670000000001 2024-04-01T19:45:20.071 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.072 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.072 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:20.072 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.150670+0000", 2024-04-01T19:45:20.072 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.9010000000000002e-05 2024-04-01T19:45:20.072 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.072 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.072 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:45:20.072 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.150745+0000", 2024-04-01T19:45:20.072 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5408999999999996e-05 2024-04-01T19:45:20.072 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.072 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.072 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:20.072 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.155292+0000", 2024-04-01T19:45:20.072 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0045472580000000002 2024-04-01T19:45:20.072 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.072 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.073 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:20.073 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339468+0000", 2024-04-01T19:45:20.073 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.184176014 2024-04-01T19:45:20.073 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.073 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.073 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:20.073 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339495+0000", 2024-04-01T19:45:20.073 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6202000000000001e-05 2024-04-01T19:45:20.073 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.073 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.073 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:20.073 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339530+0000", 2024-04-01T19:45:20.073 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.4968000000000001e-05 2024-04-01T19:45:20.073 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.073 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:20.074 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.074 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.074 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.074 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:234085 5.6 5:6f83805f:::benchmark_data_smithi188_119427_object69386:head [delete] snapc 0=[] ondisk+write+known_if_redirected e421)", 2024-04-01T19:45:20.074 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:04.180393+0000", 2024-04-01T19:45:20.074 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 195.851742723, 2024-04-01T19:45:20.074 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.15924614100000001, 2024-04-01T19:45:20.074 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:20.074 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:20.074 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:20.074 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:20.074 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:45:20.074 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:45:20.074 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 234085 2024-04-01T19:45:20.075 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.075 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:20.075 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.075 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:20.075 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.180393+0000", 2024-04-01T19:45:20.075 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.075 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.075 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.075 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:20.075 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.180393+0000", 2024-04-01T19:45:20.075 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.075 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.075 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.075 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:20.075 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.180395+0000", 2024-04-01T19:45:20.075 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.857e-06 2024-04-01T19:45:20.076 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.076 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.076 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:20.076 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.180400+0000", 2024-04-01T19:45:20.076 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0649999999999998e-06 2024-04-01T19:45:20.076 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.076 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.076 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:20.076 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.180411+0000", 2024-04-01T19:45:20.076 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1250000000000001e-05 2024-04-01T19:45:20.076 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.076 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.076 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:20.076 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.180420+0000", 2024-04-01T19:45:20.076 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.7649999999999999e-06 2024-04-01T19:45:20.077 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.077 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.077 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:20.077 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.180483+0000", 2024-04-01T19:45:20.077 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2498999999999999e-05 2024-04-01T19:45:20.077 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.077 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.077 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:20.077 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.180594+0000", 2024-04-01T19:45:20.077 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000110955 2024-04-01T19:45:20.077 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.077 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.077 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:45:20.078 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.180666+0000", 2024-04-01T19:45:20.078 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2595000000000005e-05 2024-04-01T19:45:20.078 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.078 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.078 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:20.078 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.184488+0000", 2024-04-01T19:45:20.078 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00382132 2024-04-01T19:45:20.078 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.078 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.078 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:20.078 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339577+0000", 2024-04-01T19:45:20.078 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.155089642 2024-04-01T19:45:20.078 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.079 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.079 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:20.079 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339617+0000", 2024-04-01T19:45:20.079 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9483999999999997e-05 2024-04-01T19:45:20.079 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.079 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.079 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:20.079 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339639+0000", 2024-04-01T19:45:20.079 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2708999999999999e-05 2024-04-01T19:45:20.079 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.079 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:20.079 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.079 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.079 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.079 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:238358 5.6 5:60612565:::benchmark_data_smithi188_119427_object73659:head [delete] snapc 0=[] ondisk+write+known_if_redirected e438)", 2024-04-01T19:45:20.080 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:47.383622+0000", 2024-04-01T19:45:20.080 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 152.648513812, 2024-04-01T19:45:20.080 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.165141447, 2024-04-01T19:45:20.080 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:20.080 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:20.080 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:20.080 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:20.080 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:45:20.080 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:45:20.080 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 238358 2024-04-01T19:45:20.080 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.080 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:20.080 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.080 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:20.080 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.383622+0000", 2024-04-01T19:45:20.081 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.081 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.081 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.081 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:20.081 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.383622+0000", 2024-04-01T19:45:20.081 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.081 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.081 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.081 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:20.081 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.383624+0000", 2024-04-01T19:45:20.081 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4980000000000001e-06 2024-04-01T19:45:20.081 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.081 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.081 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:20.081 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.383628+0000", 2024-04-01T19:45:20.082 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.2420000000000002e-06 2024-04-01T19:45:20.082 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.082 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.082 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:20.082 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.383635+0000", 2024-04-01T19:45:20.082 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5279999999999998e-06 2024-04-01T19:45:20.082 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.082 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.082 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:20.082 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.383642+0000", 2024-04-01T19:45:20.082 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3910000000000003e-06 2024-04-01T19:45:20.082 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.082 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.082 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:20.083 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.412148+0000", 2024-04-01T19:45:20.083 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.028506299999999998 2024-04-01T19:45:20.083 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.083 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.083 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:20.083 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.412274+0000", 2024-04-01T19:45:20.083 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000125606 2024-04-01T19:45:20.083 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.083 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.083 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:45:20.083 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.412408+0000", 2024-04-01T19:45:20.083 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000134628 2024-04-01T19:45:20.083 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.083 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.083 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:20.083 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.434616+0000", 2024-04-01T19:45:20.084 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.022207962000000001 2024-04-01T19:45:20.084 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.084 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.084 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:20.084 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.548643+0000", 2024-04-01T19:45:20.084 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.114027014 2024-04-01T19:45:20.084 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.084 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.084 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:20.084 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.548705+0000", 2024-04-01T19:45:20.084 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2083999999999997e-05 2024-04-01T19:45:20.084 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.084 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.084 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:20.085 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.548764+0000", 2024-04-01T19:45:20.085 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8193999999999999e-05 2024-04-01T19:45:20.085 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.085 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:20.085 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.085 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.085 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.085 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:248293 5.6 5:63eca0a2:::benchmark_data_smithi188_119427_object83594:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:45:20.085 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:59.701539+0000", 2024-04-01T19:45:20.085 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 140.33059717500001, 2024-04-01T19:45:20.085 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.17981375199999999, 2024-04-01T19:45:20.085 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:20.085 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:20.085 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:20.086 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:20.086 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:45:20.086 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:45:20.086 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 248293 2024-04-01T19:45:20.086 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.086 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:20.086 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.086 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:20.086 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.701539+0000", 2024-04-01T19:45:20.086 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.086 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.086 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.086 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:20.086 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.701539+0000", 2024-04-01T19:45:20.086 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.087 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.087 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.087 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:20.087 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.701541+0000", 2024-04-01T19:45:20.087 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7489999999999999e-06 2024-04-01T19:45:20.087 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.087 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.088 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:20.088 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.701549+0000", 2024-04-01T19:45:20.088 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6850000000000007e-06 2024-04-01T19:45:20.088 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.088 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.088 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:20.089 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.701561+0000", 2024-04-01T19:45:20.089 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2244e-05 2024-04-01T19:45:20.089 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.089 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.089 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:20.089 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.701569+0000", 2024-04-01T19:45:20.089 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6210000000000004e-06 2024-04-01T19:45:20.089 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.089 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.089 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:20.089 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.741699+0000", 2024-04-01T19:45:20.089 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.040130381 2024-04-01T19:45:20.089 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.089 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.090 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:20.090 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.741846+0000", 2024-04-01T19:45:20.090 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014619000000000001 2024-04-01T19:45:20.090 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.090 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.090 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:45:20.090 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.741946+0000", 2024-04-01T19:45:20.090 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00010066299999999999 2024-04-01T19:45:20.090 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.090 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.090 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:20.090 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.750859+0000", 2024-04-01T19:45:20.091 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0089124449999999997 2024-04-01T19:45:20.091 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.091 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.091 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:20.091 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.881232+0000", 2024-04-01T19:45:20.091 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.130373512 2024-04-01T19:45:20.091 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.091 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.091 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:20.091 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.881287+0000", 2024-04-01T19:45:20.091 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4935999999999997e-05 2024-04-01T19:45:20.091 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.091 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.091 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:20.092 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.881353+0000", 2024-04-01T19:45:20.092 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5326000000000004e-05 2024-04-01T19:45:20.092 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.092 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:20.092 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.092 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.092 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.092 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:248483 5.6 5:65e8996c:::benchmark_data_smithi188_119427_object83784:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:45:20.092 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:59.938936+0000", 2024-04-01T19:45:20.092 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 140.09319999100001, 2024-04-01T19:45:20.092 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.16269599700000001, 2024-04-01T19:45:20.092 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:20.092 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:20.092 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:20.092 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:20.093 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:45:20.093 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:45:20.093 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 248483 2024-04-01T19:45:20.093 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.093 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:20.093 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.093 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:20.093 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.938936+0000", 2024-04-01T19:45:20.093 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.093 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.093 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.093 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:20.093 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.938936+0000", 2024-04-01T19:45:20.093 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.093 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.093 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.094 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:20.094 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.938937+0000", 2024-04-01T19:45:20.094 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1429999999999999e-06 2024-04-01T19:45:20.094 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.094 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.094 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:20.094 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.938941+0000", 2024-04-01T19:45:20.094 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1409999999999998e-06 2024-04-01T19:45:20.094 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.094 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.094 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:20.094 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.938949+0000", 2024-04-01T19:45:20.094 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0330000000000008e-06 2024-04-01T19:45:20.095 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.095 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.095 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:20.095 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.938957+0000", 2024-04-01T19:45:20.095 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2740000000000002e-06 2024-04-01T19:45:20.095 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.095 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.095 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:20.095 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.063357+0000", 2024-04-01T19:45:20.095 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.124400156 2024-04-01T19:45:20.095 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.095 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.095 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:20.095 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.063440+0000", 2024-04-01T19:45:20.095 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3752999999999996e-05 2024-04-01T19:45:20.096 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.096 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.096 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:45:20.096 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.063527+0000", 2024-04-01T19:45:20.096 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6494000000000002e-05 2024-04-01T19:45:20.096 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.096 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.096 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:20.096 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.070707+0000", 2024-04-01T19:45:20.096 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0071799150000000003 2024-04-01T19:45:20.096 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.096 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.096 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:20.096 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.101525+0000", 2024-04-01T19:45:20.097 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.030818453999999999 2024-04-01T19:45:20.097 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.097 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.097 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:20.097 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.101579+0000", 2024-04-01T19:45:20.097 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3582999999999998e-05 2024-04-01T19:45:20.097 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.097 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.097 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:20.097 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.101632+0000", 2024-04-01T19:45:20.097 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3050999999999997e-05 2024-04-01T19:45:20.097 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.097 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:20.097 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.098 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.098 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.098 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:248486 5.6 5:64aa845c:::benchmark_data_smithi188_119427_object83787:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:45:20.098 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:59.944037+0000", 2024-04-01T19:45:20.098 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 140.08809877100001, 2024-04-01T19:45:20.098 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.15769794500000001, 2024-04-01T19:45:20.098 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:20.098 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:20.098 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:20.098 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:20.099 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:45:20.099 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:45:20.099 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 248486 2024-04-01T19:45:20.099 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.099 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:20.099 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.099 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:20.099 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.944037+0000", 2024-04-01T19:45:20.100 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.100 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.100 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.100 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:20.100 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.944037+0000", 2024-04-01T19:45:20.100 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.100 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.100 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.100 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:20.100 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.944039+0000", 2024-04-01T19:45:20.100 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.511e-06 2024-04-01T19:45:20.100 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.100 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.100 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:20.100 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.944044+0000", 2024-04-01T19:45:20.101 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2240000000000003e-06 2024-04-01T19:45:20.101 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.101 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.101 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:20.101 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.944054+0000", 2024-04-01T19:45:20.101 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.8360000000000004e-06 2024-04-01T19:45:20.101 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.101 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.101 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:20.101 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.944062+0000", 2024-04-01T19:45:20.101 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9310000000000008e-06 2024-04-01T19:45:20.101 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.101 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.101 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:20.101 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.070737+0000", 2024-04-01T19:45:20.102 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.126674911 2024-04-01T19:45:20.102 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.102 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.102 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:20.102 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.070857+0000", 2024-04-01T19:45:20.102 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012086700000000001 2024-04-01T19:45:20.102 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.102 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.102 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:45:20.102 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.070981+0000", 2024-04-01T19:45:20.102 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012366499999999999 2024-04-01T19:45:20.102 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.102 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.102 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:20.103 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.091068+0000", 2024-04-01T19:45:20.103 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.020086485000000001 2024-04-01T19:45:20.103 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.103 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.103 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:20.103 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.101640+0000", 2024-04-01T19:45:20.103 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010572742 2024-04-01T19:45:20.103 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.103 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.103 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:20.103 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.101685+0000", 2024-04-01T19:45:20.103 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4233999999999997e-05 2024-04-01T19:45:20.103 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.103 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.103 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:20.103 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.101735+0000", 2024-04-01T19:45:20.104 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0538999999999998e-05 2024-04-01T19:45:20.104 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.104 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:20.104 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.104 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.104 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.104 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:248575 5.6 5:6a4ae077:::benchmark_data_smithi188_119427_object83876:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:45:20.104 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:00.077740+0000", 2024-04-01T19:45:20.104 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 139.95439566600001, 2024-04-01T19:45:20.104 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.210714239, 2024-04-01T19:45:20.104 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:20.104 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:20.104 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:20.104 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:20.104 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:45:20.105 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:45:20.105 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 248575 2024-04-01T19:45:20.105 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.105 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:20.105 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.105 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:20.105 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.077740+0000", 2024-04-01T19:45:20.105 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.105 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.105 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.105 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:20.105 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.077740+0000", 2024-04-01T19:45:20.105 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.105 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.105 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.106 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:20.106 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.077743+0000", 2024-04-01T19:45:20.106 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3e-06 2024-04-01T19:45:20.106 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.106 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.106 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:20.106 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.077749+0000", 2024-04-01T19:45:20.106 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4749999999999998e-06 2024-04-01T19:45:20.106 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.106 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.106 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:20.106 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.077765+0000", 2024-04-01T19:45:20.106 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5662999999999999e-05 2024-04-01T19:45:20.106 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.107 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.107 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:20.107 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.077775+0000", 2024-04-01T19:45:20.107 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.7920000000000004e-06 2024-04-01T19:45:20.107 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.107 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.107 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:20.107 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.102430+0000", 2024-04-01T19:45:20.107 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.024655439000000001 2024-04-01T19:45:20.107 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.107 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.107 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:20.108 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.102565+0000", 2024-04-01T19:45:20.108 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013540000000000001 2024-04-01T19:45:20.108 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.108 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.108 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:45:20.108 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.102683+0000", 2024-04-01T19:45:20.109 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00011737499999999999 2024-04-01T19:45:20.109 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.109 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.109 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:20.109 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.112803+0000", 2024-04-01T19:45:20.109 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010120183 2024-04-01T19:45:20.109 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.110 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.110 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:20.110 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.288329+0000", 2024-04-01T19:45:20.110 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.17552647599999999 2024-04-01T19:45:20.110 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.110 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.110 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:20.110 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.288389+0000", 2024-04-01T19:45:20.111 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9447000000000002e-05 2024-04-01T19:45:20.111 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.111 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.111 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:20.111 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.288455+0000", 2024-04-01T19:45:20.111 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5689000000000001e-05 2024-04-01T19:45:20.111 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.111 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:20.112 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.112 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.112 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.112 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:248605 5.6 5:6166de91:::benchmark_data_smithi188_119427_object83906:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:45:20.112 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:00.119282+0000", 2024-04-01T19:45:20.112 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 139.91285430799999, 2024-04-01T19:45:20.112 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.16933595500000001, 2024-04-01T19:45:20.112 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:20.112 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:20.112 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:20.112 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:20.112 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:45:20.112 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:45:20.112 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 248605 2024-04-01T19:45:20.113 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.113 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:20.113 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.113 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:20.113 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.119282+0000", 2024-04-01T19:45:20.113 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.113 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.113 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.113 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:20.113 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.119282+0000", 2024-04-01T19:45:20.113 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.113 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.113 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.113 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:20.113 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.119284+0000", 2024-04-01T19:45:20.114 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3300000000000001e-06 2024-04-01T19:45:20.114 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.114 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.114 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:20.114 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.119291+0000", 2024-04-01T19:45:20.114 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4850000000000003e-06 2024-04-01T19:45:20.114 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.114 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.114 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:20.114 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.119306+0000", 2024-04-01T19:45:20.114 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4586000000000001e-05 2024-04-01T19:45:20.114 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.114 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.115 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:20.115 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.119315+0000", 2024-04-01T19:45:20.115 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8810000000000002e-06 2024-04-01T19:45:20.115 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.115 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.115 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:20.115 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.157737+0000", 2024-04-01T19:45:20.115 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.038421689000000002 2024-04-01T19:45:20.115 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.115 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.115 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:20.115 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.157859+0000", 2024-04-01T19:45:20.115 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012243099999999999 2024-04-01T19:45:20.115 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.115 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.115 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:45:20.116 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.157990+0000", 2024-04-01T19:45:20.116 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013115300000000001 2024-04-01T19:45:20.116 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.116 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.116 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:20.116 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.172180+0000", 2024-04-01T19:45:20.116 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014190216 2024-04-01T19:45:20.116 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.116 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.116 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:20.116 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.288523+0000", 2024-04-01T19:45:20.116 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.116342945 2024-04-01T19:45:20.116 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.116 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.117 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:20.117 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.288565+0000", 2024-04-01T19:45:20.117 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1304999999999998e-05 2024-04-01T19:45:20.117 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.117 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.117 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:20.117 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.288618+0000", 2024-04-01T19:45:20.117 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2933999999999998e-05 2024-04-01T19:45:20.117 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.117 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:20.117 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.117 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.117 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.117 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:248608 5.6 5:69644306:::benchmark_data_smithi188_119427_object83909:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:45:20.117 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:00.121199+0000", 2024-04-01T19:45:20.117 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 139.91093670800001, 2024-04-01T19:45:20.118 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.167514938, 2024-04-01T19:45:20.118 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:20.118 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:20.118 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:20.118 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:20.118 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:45:20.118 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:45:20.118 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 248608 2024-04-01T19:45:20.118 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.118 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:20.118 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.118 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:20.118 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.121199+0000", 2024-04-01T19:45:20.118 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.119 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.119 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.119 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:20.119 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.121199+0000", 2024-04-01T19:45:20.119 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.119 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.119 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.119 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:20.119 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.121202+0000", 2024-04-01T19:45:20.119 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2919999999999998e-06 2024-04-01T19:45:20.119 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.119 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.119 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:20.119 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.121208+0000", 2024-04-01T19:45:20.120 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4989999999999999e-06 2024-04-01T19:45:20.120 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.120 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.120 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:20.120 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.121223+0000", 2024-04-01T19:45:20.120 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4628e-05 2024-04-01T19:45:20.120 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.120 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.120 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:20.120 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.121231+0000", 2024-04-01T19:45:20.120 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4079999999999998e-06 2024-04-01T19:45:20.120 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.120 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.120 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:20.120 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.162924+0000", 2024-04-01T19:45:20.121 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.041692847999999998 2024-04-01T19:45:20.121 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.121 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.121 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:20.121 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.163061+0000", 2024-04-01T19:45:20.121 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013659499999999999 2024-04-01T19:45:20.121 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.121 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.121 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:45:20.121 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.163190+0000", 2024-04-01T19:45:20.121 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012957299999999999 2024-04-01T19:45:20.121 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.121 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.121 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:20.121 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.172234+0000", 2024-04-01T19:45:20.122 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0090440260000000001 2024-04-01T19:45:20.122 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.122 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.122 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:20.122 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.288626+0000", 2024-04-01T19:45:20.122 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.116391812 2024-04-01T19:45:20.122 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.122 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.122 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:20.122 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.288668+0000", 2024-04-01T19:45:20.122 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1758999999999998e-05 2024-04-01T19:45:20.122 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.122 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.122 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:20.123 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.288714+0000", 2024-04-01T19:45:20.123 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6498000000000001e-05 2024-04-01T19:45:20.123 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.123 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:20.123 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.123 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.123 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.123 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:248736 5.6 5:6b1428e2:::benchmark_data_smithi188_119427_object84037:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:45:20.123 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:00.341246+0000", 2024-04-01T19:45:20.123 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 139.69088961700001, 2024-04-01T19:45:20.123 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.14984124500000001, 2024-04-01T19:45:20.123 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:20.123 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:20.123 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:20.123 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:20.124 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:45:20.124 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:45:20.124 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 248736 2024-04-01T19:45:20.124 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.124 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:20.124 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.124 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:20.124 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341246+0000", 2024-04-01T19:45:20.124 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.124 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.124 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.124 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:20.124 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341246+0000", 2024-04-01T19:45:20.124 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.124 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.125 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.125 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:20.125 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341251+0000", 2024-04-01T19:45:20.125 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9389999999999996e-06 2024-04-01T19:45:20.125 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.125 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.125 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:20.125 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341258+0000", 2024-04-01T19:45:20.125 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4840000000000001e-06 2024-04-01T19:45:20.125 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.125 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.125 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:20.125 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341269+0000", 2024-04-01T19:45:20.125 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.136e-05 2024-04-01T19:45:20.125 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.126 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.126 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:20.126 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341277+0000", 2024-04-01T19:45:20.126 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7540000000000006e-06 2024-04-01T19:45:20.126 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.126 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.126 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:20.126 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341396+0000", 2024-04-01T19:45:20.126 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000118743 2024-04-01T19:45:20.126 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.126 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.126 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:20.126 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341546+0000", 2024-04-01T19:45:20.126 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015085599999999999 2024-04-01T19:45:20.126 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.127 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.127 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:45:20.127 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341694+0000", 2024-04-01T19:45:20.127 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000147121 2024-04-01T19:45:20.127 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.127 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.127 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:20.127 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.490916+0000", 2024-04-01T19:45:20.127 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.14922216899999999 2024-04-01T19:45:20.127 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.127 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.127 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:20.127 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.490961+0000", 2024-04-01T19:45:20.127 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5062000000000003e-05 2024-04-01T19:45:20.127 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.128 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.128 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:20.128 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.491018+0000", 2024-04-01T19:45:20.128 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7371999999999999e-05 2024-04-01T19:45:20.128 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.128 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.128 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:20.128 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.491088+0000", 2024-04-01T19:45:20.128 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9385000000000001e-05 2024-04-01T19:45:20.128 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.128 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:20.128 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.128 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.128 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.129 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:248737 5.6 5:6db7406b:::benchmark_data_smithi188_119427_object84038:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:45:20.129 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:00.341296+0000", 2024-04-01T19:45:20.129 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 139.69084020599999, 2024-04-01T19:45:20.129 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.15003691299999999, 2024-04-01T19:45:20.129 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:20.129 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:20.129 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:20.129 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:20.129 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:45:20.129 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:45:20.129 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 248737 2024-04-01T19:45:20.129 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.129 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:20.129 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.129 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:20.130 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341296+0000", 2024-04-01T19:45:20.130 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.130 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.130 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.130 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:20.130 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341296+0000", 2024-04-01T19:45:20.130 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.130 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.130 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.130 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:20.130 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341297+0000", 2024-04-01T19:45:20.130 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.8599999999999997e-07 2024-04-01T19:45:20.130 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.130 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.131 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:20.131 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341300+0000", 2024-04-01T19:45:20.131 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.281e-06 2024-04-01T19:45:20.131 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.131 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.131 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:20.131 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341309+0000", 2024-04-01T19:45:20.131 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.7430000000000008e-06 2024-04-01T19:45:20.131 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.131 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.131 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:20.131 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341314+0000", 2024-04-01T19:45:20.131 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6710000000000004e-06 2024-04-01T19:45:20.131 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.132 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.132 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:20.132 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.346456+0000", 2024-04-01T19:45:20.132 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0051415590000000004 2024-04-01T19:45:20.132 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.132 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.132 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:20.132 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.346613+0000", 2024-04-01T19:45:20.132 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015681899999999999 2024-04-01T19:45:20.132 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.132 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.132 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:45:20.132 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.346744+0000", 2024-04-01T19:45:20.132 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013091399999999999 2024-04-01T19:45:20.132 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.133 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.133 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:20.133 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.491100+0000", 2024-04-01T19:45:20.133 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.14435634 2024-04-01T19:45:20.133 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.133 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.133 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:20.133 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.491245+0000", 2024-04-01T19:45:20.133 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014532999999999999 2024-04-01T19:45:20.133 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.133 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.133 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:20.133 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.491287+0000", 2024-04-01T19:45:20.133 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.2089000000000003e-05 2024-04-01T19:45:20.133 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.134 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.134 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:20.134 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.491333+0000", 2024-04-01T19:45:20.134 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5380999999999998e-05 2024-04-01T19:45:20.134 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.134 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:20.134 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.134 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.134 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.134 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:248871 5.6 5:697c9f81:::benchmark_data_smithi188_119427_object84172:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:45:20.134 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:00.518467+0000", 2024-04-01T19:45:20.134 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 139.51366900599999, 2024-04-01T19:45:20.134 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.16069191499999999, 2024-04-01T19:45:20.134 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:20.135 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:20.135 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:20.135 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:20.135 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:45:20.135 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:45:20.135 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 248871 2024-04-01T19:45:20.135 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.135 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:20.135 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.135 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:20.135 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.518467+0000", 2024-04-01T19:45:20.135 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.135 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.135 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.135 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:20.136 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.518467+0000", 2024-04-01T19:45:20.136 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.136 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.136 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.136 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:20.136 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.518468+0000", 2024-04-01T19:45:20.136 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.302e-06 2024-04-01T19:45:20.136 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.136 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.136 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:20.136 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.518475+0000", 2024-04-01T19:45:20.136 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9979999999999997e-06 2024-04-01T19:45:20.136 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.136 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.136 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:20.137 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.518487+0000", 2024-04-01T19:45:20.137 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1721e-05 2024-04-01T19:45:20.137 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.137 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.137 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:20.137 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.518494+0000", 2024-04-01T19:45:20.137 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4959999999999999e-06 2024-04-01T19:45:20.137 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.137 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.137 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:20.137 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.535349+0000", 2024-04-01T19:45:20.137 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.016854958999999999 2024-04-01T19:45:20.137 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.137 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.138 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:20.138 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.535462+0000", 2024-04-01T19:45:20.138 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00011226300000000001 2024-04-01T19:45:20.138 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.138 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.138 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:45:20.138 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.535584+0000", 2024-04-01T19:45:20.138 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012255499999999999 2024-04-01T19:45:20.138 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.138 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.138 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:20.138 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.549967+0000", 2024-04-01T19:45:20.138 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014382414 2024-04-01T19:45:20.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.139 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.139 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:20.139 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.679038+0000", 2024-04-01T19:45:20.139 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.12907093 2024-04-01T19:45:20.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.139 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.139 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:20.139 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.679098+0000", 2024-04-01T19:45:20.139 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0520999999999999e-05 2024-04-01T19:45:20.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.139 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.139 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:20.139 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.679159+0000", 2024-04-01T19:45:20.139 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0755999999999999e-05 2024-04-01T19:45:20.140 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.140 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:20.140 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.140 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.140 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.140 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:248876 5.6 5:673765d8:::benchmark_data_smithi188_119427_object84177:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:45:20.140 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:00.523945+0000", 2024-04-01T19:45:20.140 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 139.508190531, 2024-04-01T19:45:20.140 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.15537109800000001, 2024-04-01T19:45:20.140 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:20.140 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:20.140 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:20.140 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:20.140 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:45:20.140 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:45:20.141 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 248876 2024-04-01T19:45:20.141 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.141 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:20.141 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.141 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:20.141 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.523945+0000", 2024-04-01T19:45:20.141 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.141 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.141 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.141 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:20.141 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.523945+0000", 2024-04-01T19:45:20.141 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.141 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.141 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.141 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:20.142 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.523948+0000", 2024-04-01T19:45:20.142 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6560000000000001e-06 2024-04-01T19:45:20.142 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.142 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.142 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:20.142 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.523957+0000", 2024-04-01T19:45:20.142 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.1880000000000008e-06 2024-04-01T19:45:20.142 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.142 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.142 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:20.142 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.523986+0000", 2024-04-01T19:45:20.142 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.9207999999999999e-05 2024-04-01T19:45:20.142 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.143 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.143 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:20.143 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.523998+0000", 2024-04-01T19:45:20.143 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1421e-05 2024-04-01T19:45:20.143 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.143 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.143 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:20.143 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.540122+0000", 2024-04-01T19:45:20.143 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.016124057000000001 2024-04-01T19:45:20.143 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.143 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.143 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:20.143 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.540243+0000", 2024-04-01T19:45:20.143 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000120579 2024-04-01T19:45:20.143 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.143 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.144 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:45:20.144 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.540361+0000", 2024-04-01T19:45:20.144 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00011853000000000001 2024-04-01T19:45:20.144 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.144 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.144 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:20.144 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.678966+0000", 2024-04-01T19:45:20.144 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13860510600000001 2024-04-01T19:45:20.144 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.144 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.144 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:20.144 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.679223+0000", 2024-04-01T19:45:20.144 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00025673999999999998 2024-04-01T19:45:20.144 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.144 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.145 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:20.145 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.679272+0000", 2024-04-01T19:45:20.145 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8650999999999999e-05 2024-04-01T19:45:20.145 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.145 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.145 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:20.145 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.679317+0000", 2024-04-01T19:45:20.145 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4962000000000001e-05 2024-04-01T19:45:20.145 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.145 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:20.145 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.145 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.145 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.145 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:248884 5.6 5:662770f4:::benchmark_data_smithi188_119427_object84185:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:45:20.145 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:00.531411+0000", 2024-04-01T19:45:20.146 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 139.50072490400001, 2024-04-01T19:45:20.146 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.14816362399999999, 2024-04-01T19:45:20.146 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:20.146 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:20.146 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:20.146 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:20.146 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:45:20.146 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:45:20.146 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 248884 2024-04-01T19:45:20.146 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.146 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:20.146 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.146 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:20.146 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.531411+0000", 2024-04-01T19:45:20.147 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.147 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.147 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.147 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:20.147 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.531411+0000", 2024-04-01T19:45:20.147 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:20.147 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.147 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.147 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:20.147 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.531413+0000", 2024-04-01T19:45:20.147 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1610000000000001e-06 2024-04-01T19:45:20.147 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.147 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.147 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:20.147 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.531419+0000", 2024-04-01T19:45:20.148 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8189999999999997e-06 2024-04-01T19:45:20.148 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.148 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.148 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:20.148 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.531433+0000", 2024-04-01T19:45:20.148 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4112e-05 2024-04-01T19:45:20.148 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.148 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.148 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:20.148 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.531443+0000", 2024-04-01T19:45:20.148 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.3780000000000007e-06 2024-04-01T19:45:20.148 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.148 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.148 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:20.148 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.544642+0000", 2024-04-01T19:45:20.149 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.013199405000000001 2024-04-01T19:45:20.149 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.149 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.149 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:20.149 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.544797+0000", 2024-04-01T19:45:20.149 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015520700000000001 2024-04-01T19:45:20.149 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.149 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.149 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:45:20.149 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.544958+0000", 2024-04-01T19:45:20.149 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00016047500000000001 2024-04-01T19:45:20.149 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.149 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.149 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:20.149 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.678974+0000", 2024-04-01T19:45:20.150 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13401684999999999 2024-04-01T19:45:20.150 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.150 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.150 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:20.150 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.679461+0000", 2024-04-01T19:45:20.150 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00048656399999999999 2024-04-01T19:45:20.150 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.150 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.150 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:20.150 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.679522+0000", 2024-04-01T19:45:20.150 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1439999999999995e-05 2024-04-01T19:45:20.150 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:20.150 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:20.150 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:20.151 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.679575+0000", 2024-04-01T19:45:20.151 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2213000000000003e-05 2024-04-01T19:45:20.151 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.151 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:20.151 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.151 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:20.151 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:20.151 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:45:20.151 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:45:20.180 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:20.204 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:45:20.206 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:20.206 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:45:20.307 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:45:20.355 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:20.386 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:45:20.390 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:20.391 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:45:20.492 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:45:20.519 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 28 16 78983 78967 176.252 120.562 0.00306589 0.00567206 2024-04-01T19:45:20.535 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:21.164 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:45:21.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:21 smithi062 ceph-mon[44211]: pgmap v1339: 17 pgs: 17 active+clean; 4.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 132 MiB/s wr, 2.12k op/s 2024-04-01T19:45:21.519 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 29 16 80866 80850 174.232 117.688 0.00393164 0.0057369 2024-04-01T19:45:21.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:21 smithi022 ceph-mon[39439]: pgmap v1339: 17 pgs: 17 active+clean; 4.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 132 MiB/s wr, 2.12k op/s 2024-04-01T19:45:21.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:21 smithi188 ceph-mon[43939]: pgmap v1339: 17 pgs: 17 active+clean; 4.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 132 MiB/s wr, 2.12k op/s 2024-04-01T19:45:22.098 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:45:22.101 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:22.102 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:45:22.203 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:45:22.249 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:22.313 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:45:22.317 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:22.318 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:45:22.419 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:45:22.446 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:22.466 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:45:22.469 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:22.470 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:45:22.519 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 30 16 82830 82814 172.516 122.75 0.00762328 0.00579524 2024-04-01T19:45:22.570 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:45:22.598 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:22.619 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:45:22.621 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:22.621 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:45:22.722 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:45:22.790 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:22.820 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:45:22.829 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:22.830 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:45:22.837 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_ops_in_flight 2024-04-01T19:45:22.930 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:45:22.986 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:23.013 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:45:23.016 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:23.017 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:45:23.117 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:45:23.163 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:23.195 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:45:23.197 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:23.198 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:45:23.299 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:45:23.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:23 smithi022 ceph-mon[39439]: pgmap v1340: 17 pgs: 17 active+clean; 4.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 133 MiB/s wr, 2.13k op/s 2024-04-01T19:45:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:23.384 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:45:23.387 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:23.387 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:45:23.489 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:45:23.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:23 smithi062 ceph-mon[44211]: pgmap v1340: 17 pgs: 17 active+clean; 4.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 133 MiB/s wr, 2.13k op/s 2024-04-01T19:45:23.516 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:23 smithi188 ceph-mon[43939]: pgmap v1340: 17 pgs: 17 active+clean; 4.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 133 MiB/s wr, 2.13k op/s 2024-04-01T19:45:23.519 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 31 16 84590 84574 170.499 110 0.00823132 0.00586381 2024-04-01T19:45:23.519 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:23.539 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:45:23.542 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:23.543 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:45:23.643 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:45:23.671 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:23.695 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:45:23.697 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:23.698 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:45:23.799 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:45:23.838 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:24.519 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 32 16 86428 86412 168.761 114.875 0.0136549 0.00592375 2024-04-01T19:45:24.909 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:45:24.915 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:24.916 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:45:25.016 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:45:25.045 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:25.065 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:45:25.067 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:25.068 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:45:25.168 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:45:25.198 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:25.220 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:45:25.224 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:25.225 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:45:25.225 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:25 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:45:25.225 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:25 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:45:25.246 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:45:25.325 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:45:25.370 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:25.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:25 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:45:25.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:25 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:45:25.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:25 smithi188 ceph-mon[43939]: osdmap e485: 12 total, 12 up, 12 in 2024-04-01T19:45:25.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:25 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/384315333' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:45:25.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:25 smithi188 ceph-mon[43939]: from='client.36404 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:45:25.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:25 smithi188 ceph-mon[43939]: pgmap v1342: 17 pgs: 17 active+clean; 5.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 116 MiB/s wr, 1.85k op/s 2024-04-01T19:45:25.401 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:45:25.404 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:25.405 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:45:25.506 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:45:25.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:25 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:45:25.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:25 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:45:25.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:25 smithi062 ceph-mon[44211]: osdmap e485: 12 total, 12 up, 12 in 2024-04-01T19:45:25.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:25 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/384315333' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:45:25.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:25 smithi062 ceph-mon[44211]: from='client.36404 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:45:25.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:25 smithi062 ceph-mon[44211]: pgmap v1342: 17 pgs: 17 active+clean; 5.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 116 MiB/s wr, 1.85k op/s 2024-04-01T19:45:25.519 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 33 16 88241 88225 167.08 113.312 0.00319578 0.00598345 2024-04-01T19:45:25.552 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:25.581 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:45:25.585 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:25.586 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:45:25.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:25 smithi022 ceph-mon[39439]: osdmap e485: 12 total, 12 up, 12 in 2024-04-01T19:45:25.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:25 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/384315333' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:45:25.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:25 smithi022 ceph-mon[39439]: from='client.36404 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:45:25.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:25 smithi022 ceph-mon[39439]: pgmap v1342: 17 pgs: 17 active+clean; 5.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 116 MiB/s wr, 1.85k op/s 2024-04-01T19:45:25.686 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:45:25.728 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:25.763 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:45:25.767 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:25.768 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:45:25.868 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:45:25.897 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:25.918 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:45:25.922 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:25.923 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:45:26.023 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:45:26.075 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:26.102 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:45:26.106 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:45:26.110 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:26.111 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:45:26.172 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:45:26.211 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:45:26.232 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:26 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:45:26.232 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:26 smithi022 ceph-mon[39439]: from='client.36404 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:45:26.232 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:26 smithi022 ceph-mon[39439]: osdmap e486: 12 total, 12 up, 12 in 2024-04-01T19:45:26.261 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:26.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:26 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:45:26.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:26 smithi062 ceph-mon[44211]: from='client.36404 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:45:26.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:26 smithi062 ceph-mon[44211]: osdmap e486: 12 total, 12 up, 12 in 2024-04-01T19:45:26.519 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 34 16 89943 89927 165.294 106.375 0.0061988 0.00604838 2024-04-01T19:45:26.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:26 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:45:26.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:26 smithi188 ceph-mon[43939]: from='client.36404 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:45:26.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:26 smithi188 ceph-mon[43939]: osdmap e486: 12 total, 12 up, 12 in 2024-04-01T19:45:27.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:27 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:45:27.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:27 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:45:27.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:27 smithi062 ceph-mon[44211]: pgmap v1344: 17 pgs: 17 active+clean; 5.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 121 MiB/s wr, 1.93k op/s 2024-04-01T19:45:27.519 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 35 16 91653 91637 163.625 106.875 0.00891082 0.00610971 2024-04-01T19:45:27.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:27 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:45:27.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:27 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:45:27.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:27 smithi022 ceph-mon[39439]: pgmap v1344: 17 pgs: 17 active+clean; 5.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 121 MiB/s wr, 1.93k op/s 2024-04-01T19:45:27.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:27 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:45:27.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:27 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:45:27.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:27 smithi188 ceph-mon[43939]: pgmap v1344: 17 pgs: 17 active+clean; 5.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 121 MiB/s wr, 1.93k op/s 2024-04-01T19:45:27.987 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:45:28.290 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:28 smithi022 ceph-mon[39439]: osdmap e487: 12 total, 12 up, 12 in 2024-04-01T19:45:28.290 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:28 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1824646476' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:45:28.358 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.3 to 1 (10000) 2024-04-01T19:45:28.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:28 smithi062 ceph-mon[44211]: osdmap e487: 12 total, 12 up, 12 in 2024-04-01T19:45:28.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:28 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1824646476' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:45:28.519 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 36 15 93305 93290 161.949 103.312 0.0214411 0.00617308 2024-04-01T19:45:28.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:28 smithi188 ceph-mon[43939]: osdmap e487: 12 total, 12 up, 12 in 2024-04-01T19:45:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:28 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1824646476' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:45:28.640 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:45:28.649 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:28.650 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:45:28.751 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:45:28.801 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:28.871 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:45:28.879 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:28.880 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:45:28.981 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:45:29.011 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:29.031 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:45:29.036 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:29.036 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:45:29.137 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:45:29.182 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:29.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:29 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1824646476' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-04-01T19:45:29.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:29 smithi188 ceph-mon[43939]: osdmap e488: 12 total, 12 up, 12 in 2024-04-01T19:45:29.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:29 smithi188 ceph-mon[43939]: pgmap v1347: 17 pgs: 17 active+clean; 5.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 115 MiB/s wr, 1.84k op/s 2024-04-01T19:45:29.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:29 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1824646476' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-04-01T19:45:29.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:29 smithi062 ceph-mon[44211]: osdmap e488: 12 total, 12 up, 12 in 2024-04-01T19:45:29.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:29 smithi062 ceph-mon[44211]: pgmap v1347: 17 pgs: 17 active+clean; 5.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 115 MiB/s wr, 1.84k op/s 2024-04-01T19:45:29.519 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 37 15 95032 95017 160.489 107.938 0.00804001 0.00622964 2024-04-01T19:45:29.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:29 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1824646476' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-04-01T19:45:29.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:29 smithi022 ceph-mon[39439]: osdmap e488: 12 total, 12 up, 12 in 2024-04-01T19:45:29.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:29 smithi022 ceph-mon[39439]: pgmap v1347: 17 pgs: 17 active+clean; 5.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 115 MiB/s wr, 1.84k op/s 2024-04-01T19:45:29.954 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:45:29.958 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:29.959 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:45:30.060 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:45:30.113 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:30.150 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:45:30.154 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:30.155 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:45:30.256 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:45:30.300 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:30.519 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 38 16 96683 96667 158.98 103.125 0.00718922 0.00628909 2024-04-01T19:45:31.272 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:31 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:45:31.272 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:31 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:45:31.272 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:31 smithi022 ceph-mon[39439]: osdmap e489: 12 total, 12 up, 12 in 2024-04-01T19:45:31.272 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:31 smithi022 ceph-mon[39439]: pgmap v1349: 17 pgs: 17 active+clean; 5.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 122 MiB/s wr, 1.96k op/s 2024-04-01T19:45:31.395 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 4 1 2024-04-01T19:45:31.519 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 39 16 98349 98333 157.573 104.125 0.0120533 0.00634478 2024-04-01T19:45:31.569 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:45:31.575 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:31.576 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:45:31.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:31 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:45:31.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:31 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:45:31.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:31 smithi188 ceph-mon[43939]: osdmap e489: 12 total, 12 up, 12 in 2024-04-01T19:45:31.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:31 smithi188 ceph-mon[43939]: pgmap v1349: 17 pgs: 17 active+clean; 5.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 122 MiB/s wr, 1.96k op/s 2024-04-01T19:45:31.676 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:45:31.726 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:31 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:45:31.726 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:31 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:45:31.726 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:31 smithi062 ceph-mon[44211]: osdmap e489: 12 total, 12 up, 12 in 2024-04-01T19:45:31.726 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:31 smithi062 ceph-mon[44211]: pgmap v1349: 17 pgs: 17 active+clean; 5.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 122 MiB/s wr, 1.96k op/s 2024-04-01T19:45:31.729 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:31.759 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:45:31.766 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:31.766 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:45:31.867 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:45:31.894 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:31.915 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:45:31.917 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:31.918 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:45:32.019 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:45:32.056 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:32.093 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:45:32.097 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:32.098 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:45:32.199 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:45:32.262 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:32.324 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:45:32.325 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:45:32.325 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:32.325 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:99126 6.6 6:6df5f013:::benchmark_data_smithi188_134454_object99125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e489)", 2024-04-01T19:45:32.325 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:45:32.077163+0000", 2024-04-01T19:45:32.325 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0058273789999999997, 2024-04-01T19:45:32.325 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0058625739999999997, 2024-04-01T19:45:32.325 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:32.325 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:32.325 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:45:32.325 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:32.325 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:45:32.326 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:45:32.326 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 99126 2024-04-01T19:45:32.326 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:32.326 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:32.326 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:32.326 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:32.326 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:32.077163+0000", 2024-04-01T19:45:32.326 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:32.326 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:32.326 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:32.326 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:32.326 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:32.077163+0000", 2024-04-01T19:45:32.326 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:32.327 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:32.327 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:32.327 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:32.327 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:32.077165+0000", 2024-04-01T19:45:32.327 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5519999999999999e-06 2024-04-01T19:45:32.327 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:32.327 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:32.327 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:32.327 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:32.077238+0000", 2024-04-01T19:45:32.327 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2868999999999996e-05 2024-04-01T19:45:32.327 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:32.327 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:32.327 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:32.327 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:32.077250+0000", 2024-04-01T19:45:32.327 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1718e-05 2024-04-01T19:45:32.328 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:32.328 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:32.328 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:32.328 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:32.077259+0000", 2024-04-01T19:45:32.328 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.7199999999999995e-06 2024-04-01T19:45:32.328 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:32.328 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:32.328 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:32.328 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:32.079931+0000", 2024-04-01T19:45:32.328 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00267227 2024-04-01T19:45:32.328 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:32.328 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:32.329 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:32.329 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:32.080080+0000", 2024-04-01T19:45:32.329 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014872900000000001 2024-04-01T19:45:32.329 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:32.329 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:32.329 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 4", 2024-04-01T19:45:32.329 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:32.080244+0000", 2024-04-01T19:45:32.329 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00016447099999999999 2024-04-01T19:45:32.329 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:32.329 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:32.329 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:32.329 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:32.082829+0000", 2024-04-01T19:45:32.329 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0025848709999999999 2024-04-01T19:45:32.329 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:32.330 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:32.330 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:32.330 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:32.330 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:32.330 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:99128 6.b 6:da50afc3:::benchmark_data_smithi188_134454_object99127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e489)", 2024-04-01T19:45:32.330 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:45:32.080212+0000", 2024-04-01T19:45:32.330 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0027779979999999998, 2024-04-01T19:45:32.330 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0029058259999999998, 2024-04-01T19:45:32.330 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:32.330 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:32.330 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:45:32.330 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:32.330 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:45:32.331 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:45:32.331 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 99128 2024-04-01T19:45:32.331 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:32.331 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:32.331 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:32.331 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:32.331 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:32.080212+0000", 2024-04-01T19:45:32.331 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:32.331 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:32.331 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:32.331 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:32.331 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:32.080212+0000", 2024-04-01T19:45:32.331 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:32.331 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:32.332 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:32.332 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:32.332 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:32.080214+0000", 2024-04-01T19:45:32.332 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7069999999999999e-06 2024-04-01T19:45:32.332 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:32.332 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:32.332 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:32.332 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:32.080278+0000", 2024-04-01T19:45:32.332 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3887999999999995e-05 2024-04-01T19:45:32.332 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:32.332 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:32.332 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:32.332 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:32.080292+0000", 2024-04-01T19:45:32.332 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4158000000000001e-05 2024-04-01T19:45:32.333 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:32.333 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:32.333 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:32.333 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:32.080301+0000", 2024-04-01T19:45:32.333 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6920000000000008e-06 2024-04-01T19:45:32.333 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:32.333 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:32.333 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:32.333 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:32.080363+0000", 2024-04-01T19:45:32.333 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2191000000000001e-05 2024-04-01T19:45:32.333 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:32.333 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:32.333 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:32.333 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:32.080447+0000", 2024-04-01T19:45:32.334 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4002e-05 2024-04-01T19:45:32.334 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:32.334 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:32.334 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 7", 2024-04-01T19:45:32.334 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:32.080617+0000", 2024-04-01T19:45:32.334 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00016979399999999999 2024-04-01T19:45:32.334 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:32.334 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:32.334 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:32.334 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:32.082970+0000", 2024-04-01T19:45:32.334 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0023534150000000002 2024-04-01T19:45:32.334 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:32.334 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:32.335 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:32.335 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:32.335 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T19:45:32.335 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 2 2024-04-01T19:45:32.335 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:45:32.519 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:45:32.523137 min lat: 0.000949379 max lat: 0.208931 avg lat: 0.00640969 2024-04-01T19:45:32.520 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:45:32.520 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 40 16 99845 99829 155.971 93.5 0.0154618 0.00640969 2024-04-01T19:45:33.520 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 41 16 101512 101496 154.708 104.188 0.00959659 0.00646244 2024-04-01T19:45:34.050 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:33 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:45:34.051 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:33 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:45:34.051 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:33 smithi022 ceph-mon[39439]: osdmap e490: 12 total, 12 up, 12 in 2024-04-01T19:45:34.051 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:33 smithi022 ceph-mon[39439]: pgmap v1351: 17 pgs: 17 active+clean; 5.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 108 MiB/s wr, 1.72k op/s 2024-04-01T19:45:34.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:33 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:45:34.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:33 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:45:34.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:33 smithi188 ceph-mon[43939]: osdmap e490: 12 total, 12 up, 12 in 2024-04-01T19:45:34.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:33 smithi188 ceph-mon[43939]: pgmap v1351: 17 pgs: 17 active+clean; 5.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 108 MiB/s wr, 1.72k op/s 2024-04-01T19:45:34.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:33 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:45:34.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:33 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:45:34.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:33 smithi062 ceph-mon[44211]: osdmap e490: 12 total, 12 up, 12 in 2024-04-01T19:45:34.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:33 smithi062 ceph-mon[44211]: pgmap v1351: 17 pgs: 17 active+clean; 5.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 108 MiB/s wr, 1.72k op/s 2024-04-01T19:45:34.520 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 42 16 103143 103127 153.451 101.938 0.0146035 0.00651519 2024-04-01T19:45:34.555 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_blocked_ops 2024-04-01T19:45:34.636 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:45:34.642 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:34.643 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:45:34.741 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:45:34.744 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:45:34.771 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:34.793 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:45:34.795 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:34.795 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:45:34.856 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:45:34.890 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:45:34.896 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:45:34.934 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:45:34.952 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:34.968 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:45:34.978 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:45:34.981 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:34.981 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:45:34.999 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:45:35.030 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:45:35.058 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:45:35.074 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:45:35.082 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:45:35.105 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:34 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4210172044' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:45:35.107 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:35.113 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:45:35.128 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:45:35.130 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:34 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4210172044' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:45:35.131 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:35.131 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:45:35.147 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:45:35.180 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:45:35.217 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:45:35.232 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:45:35.245 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:45:35.253 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:45:35.253 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:45:35.253 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:45:35.253 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:45:35.253 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:45:35.253 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:45:35.253 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:45:35.253 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:45:35.253 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:45:35.253 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:45:35.253 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:45:35.253 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:45:35.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:34 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4210172044' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:45:35.294 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:35.381 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:45:35.388 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:35.390 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:45:35.491 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:45:35.520 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 43 16 104571 104555 151.958 89.25 0.00732997 0.00657923 2024-04-01T19:45:35.552 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:36.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:35 smithi062 ceph-mon[44211]: pgmap v1352: 17 pgs: 17 active+clean; 6.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 101 MiB/s wr, 1.61k op/s 2024-04-01T19:45:36.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:35 smithi022 ceph-mon[39439]: pgmap v1352: 17 pgs: 17 active+clean; 6.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 101 MiB/s wr, 1.61k op/s 2024-04-01T19:45:36.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:35 smithi188 ceph-mon[43939]: pgmap v1352: 17 pgs: 17 active+clean; 6.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 101 MiB/s wr, 1.61k op/s 2024-04-01T19:45:36.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:36.520 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 44 16 106173 106157 150.78 100.125 0.0118199 0.00663118 2024-04-01T19:45:37.260 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:36 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:37.260 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:36 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:37.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:36 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:37.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:36 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:37.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:36 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:37.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:36 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:37.520 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 45 16 107686 107670 149.53 94.5625 0.0105227 0.00668631 2024-04-01T19:45:38.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:37 smithi062 ceph-mon[44211]: pgmap v1353: 17 pgs: 17 active+clean; 6.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 104 MiB/s wr, 1.66k op/s 2024-04-01T19:45:38.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:37 smithi022 ceph-mon[39439]: pgmap v1353: 17 pgs: 17 active+clean; 6.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 104 MiB/s wr, 1.66k op/s 2024-04-01T19:45:38.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:37 smithi188 ceph-mon[43939]: pgmap v1353: 17 pgs: 17 active+clean; 6.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 104 MiB/s wr, 1.66k op/s 2024-04-01T19:45:38.520 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 46 16 109168 109152 148.293 92.625 0.00427409 0.00674203 2024-04-01T19:45:39.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:39 smithi022 ceph-mon[39439]: pgmap v1354: 17 pgs: 17 active+clean; 6.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 107 MiB/s wr, 1.71k op/s 2024-04-01T19:45:39.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:39 smithi062 ceph-mon[44211]: pgmap v1354: 17 pgs: 17 active+clean; 6.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 107 MiB/s wr, 1.71k op/s 2024-04-01T19:45:39.520 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 47 16 110705 110689 147.182 96.0625 0.0161737 0.00679278 2024-04-01T19:45:39.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:39 smithi188 ceph-mon[43939]: pgmap v1354: 17 pgs: 17 active+clean; 6.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 107 MiB/s wr, 1.71k op/s 2024-04-01T19:45:40.063 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:45:40.066 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:40.067 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:45:40.079 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:45:40.168 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:45:40.205 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:40.234 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:45:40.237 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:40.238 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:45:40.339 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:45:40.366 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:40.386 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:45:40.389 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:40.389 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:45:40.490 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:45:40.520 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 48 16 112120 112104 145.958 88.4375 0.015157 0.00684957 2024-04-01T19:45:40.556 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:40.590 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:45:40.597 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:40.598 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:45:40.699 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:45:40.743 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:45:40.786 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:40.786 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:45:40.887 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:45:40.929 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:41.252 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:45:41.276 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.4 to 1 (10000) 2024-04-01T19:45:41.391 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:45:41.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:41 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1287457768' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T19:45:41.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:41 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2662202585' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:45:41.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:41 smithi062 ceph-mon[44211]: pgmap v1355: 17 pgs: 17 active+clean; 6.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 99 MiB/s wr, 1.58k op/s 2024-04-01T19:45:41.520 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 49 16 113588 113572 144.851 91.75 0.00351803 0.00689997 2024-04-01T19:45:41.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:41 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1287457768' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T19:45:41.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:41 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2662202585' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:45:41.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:41 smithi022 ceph-mon[39439]: pgmap v1355: 17 pgs: 17 active+clean; 6.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 99 MiB/s wr, 1.58k op/s 2024-04-01T19:45:41.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:41 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1287457768' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T19:45:41.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:41 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2662202585' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:45:41.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:41 smithi188 ceph-mon[43939]: pgmap v1355: 17 pgs: 17 active+clean; 6.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 99 MiB/s wr, 1.58k op/s 2024-04-01T19:45:42.339 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:45:42.344 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:42.344 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:45:42.445 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:45:42.493 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:42.496 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:42 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:45:42.496 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:42 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1287457768' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-04-01T19:45:42.496 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:42 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2662202585' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:45:42.496 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:42 smithi062 ceph-mon[44211]: osdmap e491: 12 total, 12 up, 12 in 2024-04-01T19:45:42.520 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 50 16 115043 115027 143.773 90.9375 0.00348883 0.00695345 2024-04-01T19:45:42.524 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:45:42.526 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:42.527 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:45:42.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:42 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:45:42.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:42 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1287457768' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-04-01T19:45:42.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:42 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2662202585' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:45:42.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:42 smithi022 ceph-mon[39439]: osdmap e491: 12 total, 12 up, 12 in 2024-04-01T19:45:42.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:42 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:45:42.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:42 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1287457768' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-04-01T19:45:42.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:42 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2662202585' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:45:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:42 smithi188 ceph-mon[43939]: osdmap e491: 12 total, 12 up, 12 in 2024-04-01T19:45:42.628 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:45:42.655 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:42.676 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:45:42.678 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:42.679 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:45:42.780 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:45:42.807 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:42.828 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:45:42.832 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:42.832 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:45:42.933 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:45:42.968 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:43.437 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:45:43.441 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:43.442 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:45:43.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:43 smithi062 ceph-mon[44211]: pgmap v1357: 17 pgs: 17 active+clean; 6.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 97 MiB/s wr, 1.55k op/s 2024-04-01T19:45:43.521 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 51 16 116457 116441 142.686 88.375 0.0186944 0.00700671 2024-04-01T19:45:43.542 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:45:43.603 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:43 smithi022 ceph-mon[39439]: pgmap v1357: 17 pgs: 17 active+clean; 6.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 97 MiB/s wr, 1.55k op/s 2024-04-01T19:45:43.603 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:43.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:43 smithi188 ceph-mon[43939]: pgmap v1357: 17 pgs: 17 active+clean; 6.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 97 MiB/s wr, 1.55k op/s 2024-04-01T19:45:43.630 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:45:43.635 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:43.635 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:45:43.736 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:45:43.775 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:44.034 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:45:44.041 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:44.041 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:45:44.142 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:45:44.187 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:44.219 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:45:44.223 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:44.223 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:45:44.257 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:44 smithi022 ceph-mon[39439]: 6.a scrub starts 2024-04-01T19:45:44.324 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:45:44.355 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 5 1 2024-04-01T19:45:44.361 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:45:44.404 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:44.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:44 smithi062 ceph-mon[44211]: 6.a scrub starts 2024-04-01T19:45:44.520 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 52 16 117761 117745 141.509 81.5 0.0162697 0.00706528 2024-04-01T19:45:44.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:44 smithi188 ceph-mon[43939]: 6.a scrub starts 2024-04-01T19:45:44.873 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:45:44.884 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:44.885 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:45:44.986 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:45:45.015 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:45.035 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:45:45.038 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:45.038 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:45:45.139 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:45:45.181 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:45:45.181 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:45:45.187 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:45.220 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:45:45.223 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:45.223 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:45:45.324 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:45:45.351 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:45.372 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:45:45.374 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:45.375 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:45:45.476 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:45:45.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:45 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:45:45.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:45 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:45:45.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:45 smithi062 ceph-mon[44211]: pgmap v1358: 17 pgs: 17 active+clean; 7.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 MiB/s wr, 1.52k op/s 2024-04-01T19:45:45.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:45 smithi062 ceph-mon[44211]: osdmap e492: 12 total, 12 up, 12 in 2024-04-01T19:45:45.521 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 53 15 119139 119124 140.465 86.1875 0.0126014 0.00711804 2024-04-01T19:45:45.525 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:45 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:45:45.525 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:45 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:45:45.525 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:45 smithi022 ceph-mon[39439]: pgmap v1358: 17 pgs: 17 active+clean; 7.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 MiB/s wr, 1.52k op/s 2024-04-01T19:45:45.525 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:45 smithi022 ceph-mon[39439]: osdmap e492: 12 total, 12 up, 12 in 2024-04-01T19:45:45.531 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:45.574 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:45:45.577 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:45.577 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:45:45.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:45 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:45:45.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:45 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:45:45.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:45 smithi188 ceph-mon[43939]: pgmap v1358: 17 pgs: 17 active+clean; 7.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 MiB/s wr, 1.52k op/s 2024-04-01T19:45:45.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:45 smithi188 ceph-mon[43939]: osdmap e492: 12 total, 12 up, 12 in 2024-04-01T19:45:45.678 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:45:45.706 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:45.728 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:45:45.731 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:45.731 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:45:45.832 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:45:45.861 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:45.884 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:45:45.887 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:45.887 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:45:45.980 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:45:45.987 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:45:46.044 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:46.072 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:45:46.077 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:46.077 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:45:46.178 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:45:46.225 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:46.251 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:45:46.257 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:46.257 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:45:46.306 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:46 smithi022 ceph-mon[39439]: 6.a scrub ok 2024-04-01T19:45:46.358 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:45:46.384 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:46.404 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:45:46.406 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:46.407 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:45:46.508 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:45:46.521 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 54 16 120545 120529 139.49 87.8125 0.00939877 0.00716755 2024-04-01T19:45:46.537 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:46.557 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:45:46.559 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:46 smithi188 ceph-mon[43939]: 6.a scrub ok 2024-04-01T19:45:46.559 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:46.560 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:45:46.660 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:45:46.721 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:46.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:46 smithi062 ceph-mon[44211]: 6.a scrub ok 2024-04-01T19:45:47.521 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 55 16 121997 121981 138.604 90.75 0.00718218 0.00721311 2024-04-01T19:45:47.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:47 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:45:47.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:47 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:45:47.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:47 smithi022 ceph-mon[39439]: osdmap e493: 12 total, 12 up, 12 in 2024-04-01T19:45:47.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:47 smithi022 ceph-mon[39439]: pgmap v1361: 17 pgs: 17 active+clean; 7.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s wr, 1.41k op/s 2024-04-01T19:45:47.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:47 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:45:47.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:47 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:45:47.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:47 smithi188 ceph-mon[43939]: osdmap e493: 12 total, 12 up, 12 in 2024-04-01T19:45:47.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:47 smithi188 ceph-mon[43939]: pgmap v1361: 17 pgs: 17 active+clean; 7.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s wr, 1.41k op/s 2024-04-01T19:45:47.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:47 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:45:47.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:47 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:45:47.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:47 smithi062 ceph-mon[44211]: osdmap e493: 12 total, 12 up, 12 in 2024-04-01T19:45:47.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:47 smithi062 ceph-mon[44211]: pgmap v1361: 17 pgs: 17 active+clean; 7.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s wr, 1.41k op/s 2024-04-01T19:45:47.982 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:45:47.985 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:47.986 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:45:48.087 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:45:48.115 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:48.137 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:45:48.139 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:48.139 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:45:48.240 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:45:48.289 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:48.319 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:45:48.326 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:48.327 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:45:48.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:48 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:45:48.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:48 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:45:48.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:48 smithi188 ceph-mon[43939]: osdmap e494: 12 total, 12 up, 12 in 2024-04-01T19:45:48.430 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:45:48.445 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_historic_ops 2024-04-01T19:45:48.483 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:48.514 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:45:48.521 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 56 16 123396 123380 137.69 87.4375 0.00660059 0.0072615 2024-04-01T19:45:48.522 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:48.523 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:45:48.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:48 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:45:48.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:48 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:45:48.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:48 smithi022 ceph-mon[39439]: osdmap e494: 12 total, 12 up, 12 in 2024-04-01T19:45:48.623 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:45:48.654 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:48 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:45:48.654 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:48 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:45:48.654 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:48 smithi062 ceph-mon[44211]: osdmap e494: 12 total, 12 up, 12 in 2024-04-01T19:45:48.659 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:48.686 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:45:48.689 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:48.690 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:45:48.733 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:45:48.791 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:45:48.798 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:45:48.853 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:45:48.855 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:48.901 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:45:48.931 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:45:48.972 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:45:49.008 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:45:49.047 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:45:49.075 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:45:49.116 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:45:49.146 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:45:49.190 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:45:49.228 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:45:49.262 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:45:49.265 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:45:49.265 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:45:49.265 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:45:49.265 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:45:49.265 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:45:49.266 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:45:49.266 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:45:49.266 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:45:49.266 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:45:49.266 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:45:49.266 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:45:49.266 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:45:49.521 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 57 16 124640 124624 136.638 77.75 0.0179357 0.00731688 2024-04-01T19:45:49.564 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:49 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1881345969' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:45:49.564 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:49.564 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:49 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:45:49.564 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:49 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:45:49.564 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:49.564 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:49 smithi022 ceph-mon[39439]: pgmap v1363: 17 pgs: 17 active+clean; 7.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 MiB/s wr, 1.39k op/s 2024-04-01T19:45:49.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:49 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1881345969' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:45:49.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:49.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:49 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:45:49.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:49 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:45:49.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:49.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:49 smithi188 ceph-mon[43939]: pgmap v1363: 17 pgs: 17 active+clean; 7.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 MiB/s wr, 1.39k op/s 2024-04-01T19:45:49.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:49 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1881345969' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:45:49.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:49.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:49 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:45:49.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:49 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:45:49.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:49.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:49 smithi062 ceph-mon[44211]: pgmap v1363: 17 pgs: 17 active+clean; 7.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 MiB/s wr, 1.39k op/s 2024-04-01T19:45:50.313 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:45:50.318 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:50.319 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:45:50.420 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:45:50.447 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:50.468 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:45:50.470 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:50.470 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:45:50.521 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 58 16 125750 125734 135.479 69.375 0.0164857 0.00738018 2024-04-01T19:45:50.571 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:45:50.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:50 smithi022 ceph-mon[39439]: 6.d scrub starts 2024-04-01T19:45:50.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:50 smithi022 ceph-mon[39439]: 6.4 scrub starts 2024-04-01T19:45:50.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:50 smithi022 ceph-mon[39439]: osdmap e495: 12 total, 12 up, 12 in 2024-04-01T19:45:50.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:50 smithi022 ceph-mon[39439]: osdmap e496: 12 total, 12 up, 12 in 2024-04-01T19:45:50.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:50 smithi188 ceph-mon[43939]: 6.d scrub starts 2024-04-01T19:45:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:50 smithi188 ceph-mon[43939]: 6.4 scrub starts 2024-04-01T19:45:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:50 smithi188 ceph-mon[43939]: osdmap e495: 12 total, 12 up, 12 in 2024-04-01T19:45:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:50 smithi188 ceph-mon[43939]: osdmap e496: 12 total, 12 up, 12 in 2024-04-01T19:45:50.636 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:50.665 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:45:50.670 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:50.671 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:45:50.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:50 smithi062 ceph-mon[44211]: 6.d scrub starts 2024-04-01T19:45:50.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:50 smithi062 ceph-mon[44211]: 6.4 scrub starts 2024-04-01T19:45:50.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:45:50.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:50 smithi062 ceph-mon[44211]: osdmap e495: 12 total, 12 up, 12 in 2024-04-01T19:45:50.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:50 smithi062 ceph-mon[44211]: osdmap e496: 12 total, 12 up, 12 in 2024-04-01T19:45:50.771 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:45:50.799 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:50.818 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:45:50.820 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:50.821 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:45:50.922 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:45:50.977 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:51.356 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:45:51.360 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:51.361 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:45:51.462 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:45:51.521 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 59 16 126962 126946 134.466 75.75 0.0183559 0.00743516 2024-04-01T19:45:51.529 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:51.560 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:45:51.568 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:51.569 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:45:51.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:51 smithi022 ceph-mon[39439]: 6.7 scrub starts 2024-04-01T19:45:51.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:51 smithi022 ceph-mon[39439]: pgmap v1366: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 7.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s wr, 1.40k op/s 2024-04-01T19:45:51.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:51 smithi022 ceph-mon[39439]: 6.0 scrub starts 2024-04-01T19:45:51.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:51 smithi188 ceph-mon[43939]: 6.7 scrub starts 2024-04-01T19:45:51.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:51 smithi188 ceph-mon[43939]: pgmap v1366: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 7.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s wr, 1.40k op/s 2024-04-01T19:45:51.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:51 smithi188 ceph-mon[43939]: 6.0 scrub starts 2024-04-01T19:45:51.670 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:45:51.727 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:51.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:51 smithi062 ceph-mon[44211]: 6.7 scrub starts 2024-04-01T19:45:51.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:51 smithi062 ceph-mon[44211]: pgmap v1366: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 7.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s wr, 1.40k op/s 2024-04-01T19:45:51.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:51 smithi062 ceph-mon[44211]: 6.0 scrub starts 2024-04-01T19:45:51.796 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:45:51.811 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:51.811 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:45:51.912 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:45:51.961 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:51.990 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:45:51.994 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:51.994 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:45:52.095 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:45:52.173 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:52.268 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:45:52.277 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:52.277 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:45:52.307 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:45:52.378 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:45:52.407 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:52.427 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:45:52.431 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:52.431 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:45:52.521 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:45:52.524823 min lat: 0.000949379 max lat: 0.208931 avg lat: 0.0074874 2024-04-01T19:45:52.521 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:45:52.521 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 60 16 128217 128201 133.532 78.4375 0.0152637 0.0074874 2024-04-01T19:45:52.532 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:45:52.598 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:52 smithi022 ceph-mon[39439]: 6.d scrub ok 2024-04-01T19:45:52.598 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:52 smithi022 ceph-mon[39439]: 6.4 scrub ok 2024-04-01T19:45:52.602 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:52.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:52 smithi188 ceph-mon[43939]: 6.d scrub ok 2024-04-01T19:45:52.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:52 smithi188 ceph-mon[43939]: 6.4 scrub ok 2024-04-01T19:45:52.659 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:45:52.664 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:52.665 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:45:52.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:52 smithi062 ceph-mon[44211]: 6.d scrub ok 2024-04-01T19:45:52.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:52 smithi062 ceph-mon[44211]: 6.4 scrub ok 2024-04-01T19:45:52.766 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:45:52.826 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:52.856 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:45:52.860 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:52.860 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:45:52.961 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:45:52.987 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:53.012 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:45:53.014 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:53.015 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:45:53.116 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:45:53.170 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:53.209 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:45:53.217 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:53.217 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:45:53.318 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:45:53.347 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:53.368 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:45:53.372 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:53.373 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:45:53.474 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:45:53.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:53 smithi062 ceph-mon[44211]: 6.7 scrub ok 2024-04-01T19:45:53.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:53 smithi062 ceph-mon[44211]: 6.0 scrub ok 2024-04-01T19:45:53.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:53 smithi062 ceph-mon[44211]: pgmap v1367: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 7.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 MiB/s wr, 1.31k op/s 2024-04-01T19:45:53.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:53 smithi062 ceph-mon[44211]: 6.2 scrub starts 2024-04-01T19:45:53.521 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 61 16 129467 129451 132.624 78.125 0.0157468 0.00753835 2024-04-01T19:45:53.525 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:53.556 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:45:53.563 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:53.564 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:45:53.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:53 smithi188 ceph-mon[43939]: 6.7 scrub ok 2024-04-01T19:45:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:53 smithi188 ceph-mon[43939]: 6.0 scrub ok 2024-04-01T19:45:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:53 smithi188 ceph-mon[43939]: pgmap v1367: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 7.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 MiB/s wr, 1.31k op/s 2024-04-01T19:45:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:53 smithi188 ceph-mon[43939]: 6.2 scrub starts 2024-04-01T19:45:53.664 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:45:53.719 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:53.754 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:45:53.757 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:53.757 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:45:53.858 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:45:53.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:53 smithi022 ceph-mon[39439]: 6.7 scrub ok 2024-04-01T19:45:53.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:53 smithi022 ceph-mon[39439]: 6.0 scrub ok 2024-04-01T19:45:53.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:53 smithi022 ceph-mon[39439]: pgmap v1367: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 7.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 MiB/s wr, 1.31k op/s 2024-04-01T19:45:53.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:53 smithi022 ceph-mon[39439]: 6.2 scrub starts 2024-04-01T19:45:53.886 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:53.907 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:45:53.910 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:53.910 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:45:54.011 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:45:54.063 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:54.101 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:45:54.107 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:54.107 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:45:54.208 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:45:54.237 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:54.262 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:45:54.266 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:54.267 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:45:54.329 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:45:54.367 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:45:54.395 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:54.417 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.5 to 1 (10000) 2024-04-01T19:45:54.417 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:45:54.420 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:54.420 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:45:54.521 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:45:54.522 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 62 16 130676 130660 131.703 75.5625 0.0155358 0.00759168 2024-04-01T19:45:54.546 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:54 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1193433399' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T19:45:54.549 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:54.572 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:45:54.574 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:54.574 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:45:54.675 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:45:54.703 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:54.723 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:45:54.725 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:54.726 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:45:54.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:54 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1193433399' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T19:45:54.827 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:45:54.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:54 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1193433399' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T19:45:54.878 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:55.185 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:45:55.206 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:55.206 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:45:55.307 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:45:55.335 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:55.362 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:45:55.368 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:55.368 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:45:55.469 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:45:55.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:55 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1193433399' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-04-01T19:45:55.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:55 smithi022 ceph-mon[39439]: osdmap e497: 12 total, 12 up, 12 in 2024-04-01T19:45:55.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:55 smithi022 ceph-mon[39439]: 6.2 scrub ok 2024-04-01T19:45:55.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:55 smithi022 ceph-mon[39439]: pgmap v1369: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 7.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 MiB/s wr, 1.20k op/s 2024-04-01T19:45:55.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:55 smithi022 ceph-mon[39439]: osdmap e498: 12 total, 12 up, 12 in 2024-04-01T19:45:55.521 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 63 16 131944 131928 130.871 79.25 0.0142393 0.00763959 2024-04-01T19:45:55.527 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:55.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:55 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1193433399' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-04-01T19:45:55.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:55 smithi188 ceph-mon[43939]: osdmap e497: 12 total, 12 up, 12 in 2024-04-01T19:45:55.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:55 smithi188 ceph-mon[43939]: 6.2 scrub ok 2024-04-01T19:45:55.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:55 smithi188 ceph-mon[43939]: pgmap v1369: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 7.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 MiB/s wr, 1.20k op/s 2024-04-01T19:45:55.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:55 smithi188 ceph-mon[43939]: osdmap e498: 12 total, 12 up, 12 in 2024-04-01T19:45:55.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:55 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1193433399' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-04-01T19:45:55.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:55 smithi062 ceph-mon[44211]: osdmap e497: 12 total, 12 up, 12 in 2024-04-01T19:45:55.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:55 smithi062 ceph-mon[44211]: 6.2 scrub ok 2024-04-01T19:45:55.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:55 smithi062 ceph-mon[44211]: pgmap v1369: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 7.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 MiB/s wr, 1.20k op/s 2024-04-01T19:45:55.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:55 smithi062 ceph-mon[44211]: osdmap e498: 12 total, 12 up, 12 in 2024-04-01T19:45:56.388 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:45:56.392 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:56.393 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:45:56.494 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:45:56.522 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 64 16 133275 133259 130.126 83.1875 0.00738423 0.00768306 2024-04-01T19:45:56.544 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:56.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:56 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:45:56.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:56 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:45:56.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:56 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:45:56.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:56 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:45:56.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:56 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:45:56.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:56 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:45:56.959 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 7 1 2024-04-01T19:45:57.136 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:45:57.141 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:57.141 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:45:57.242 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:45:57.313 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:57.429 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:57 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:45:57.429 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:57 smithi022 ceph-mon[39439]: pgmap v1371: 17 pgs: 17 active+clean; 8.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 MiB/s wr, 1.36k op/s 2024-04-01T19:45:57.522 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 65 15 134412 134397 129.218 71.125 0.00689455 0.00773724 2024-04-01T19:45:57.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:57 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:45:57.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:57 smithi062 ceph-mon[44211]: pgmap v1371: 17 pgs: 17 active+clean; 8.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 MiB/s wr, 1.36k op/s 2024-04-01T19:45:57.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:57 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:45:57.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:57 smithi188 ceph-mon[43939]: pgmap v1371: 17 pgs: 17 active+clean; 8.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 MiB/s wr, 1.36k op/s 2024-04-01T19:45:57.886 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:45:57.886 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 20, 2024-04-01T19:45:57.886 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 600, 2024-04-01T19:45:57.887 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:45:57.887 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.887 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:92811 6.6 6:6e39e595:::benchmark_data_smithi188_134454_object92810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e487)", 2024-04-01T19:45:57.887 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:45:28.221348+0000", 2024-04-01T19:45:57.887 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 29.391523239000001, 2024-04-01T19:45:57.887 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.038048141000000001, 2024-04-01T19:45:57.887 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:57.887 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:57.887 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:57.887 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:57.887 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:45:57.887 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:45:57.887 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 92811 2024-04-01T19:45:57.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.888 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:57.888 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.888 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:57.888 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:28.221348+0000", 2024-04-01T19:45:57.888 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.888 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.888 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.888 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:57.888 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:28.221348+0000", 2024-04-01T19:45:57.888 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.888 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.888 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.888 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:57.888 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:28.221349+0000", 2024-04-01T19:45:57.888 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.336e-06 2024-04-01T19:45:57.889 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.889 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.889 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:57.889 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:28.221455+0000", 2024-04-01T19:45:57.889 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000106341 2024-04-01T19:45:57.889 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.889 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.889 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:57.889 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:28.221466+0000", 2024-04-01T19:45:57.889 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0837e-05 2024-04-01T19:45:57.889 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.889 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.889 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:57.890 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:28.221474+0000", 2024-04-01T19:45:57.890 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.1610000000000003e-06 2024-04-01T19:45:57.890 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.890 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.890 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:57.890 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:28.247257+0000", 2024-04-01T19:45:57.890 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.025783143000000001 2024-04-01T19:45:57.890 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.890 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.890 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:57.890 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:28.247404+0000", 2024-04-01T19:45:57.890 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014680800000000001 2024-04-01T19:45:57.891 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.891 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.891 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 4", 2024-04-01T19:45:57.891 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:28.247560+0000", 2024-04-01T19:45:57.891 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000155468 2024-04-01T19:45:57.891 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.891 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.891 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:57.891 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:28.259111+0000", 2024-04-01T19:45:57.891 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.011551699 2024-04-01T19:45:57.891 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.891 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.891 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:57.891 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:28.259303+0000", 2024-04-01T19:45:57.892 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00019183899999999999 2024-04-01T19:45:57.892 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.892 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.892 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:57.892 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:28.259359+0000", 2024-04-01T19:45:57.892 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6060999999999997e-05 2024-04-01T19:45:57.892 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.892 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.892 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:57.892 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:28.259396+0000", 2024-04-01T19:45:57.892 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.6448000000000001e-05 2024-04-01T19:45:57.892 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.892 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:57.892 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.892 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.893 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.893 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:96889 6.6 6:681d686a:::benchmark_data_smithi188_134454_object96888:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e489)", 2024-04-01T19:45:57.893 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:45:30.649140+0000", 2024-04-01T19:45:57.893 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 26.963731195000001, 2024-04-01T19:45:57.893 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.039407524999999999, 2024-04-01T19:45:57.893 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:57.893 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:57.893 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:57.893 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:57.893 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:45:57.893 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:45:57.893 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 96889 2024-04-01T19:45:57.893 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.893 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:57.894 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.894 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:57.894 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.649140+0000", 2024-04-01T19:45:57.894 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.894 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.894 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.894 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:57.894 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.649140+0000", 2024-04-01T19:45:57.894 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.894 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.894 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.894 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:57.894 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.649140+0000", 2024-04-01T19:45:57.894 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7999999999999995e-07 2024-04-01T19:45:57.894 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.895 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.895 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:57.895 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.649236+0000", 2024-04-01T19:45:57.895 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.5543000000000003e-05 2024-04-01T19:45:57.895 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.895 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.895 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:57.895 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.649246+0000", 2024-04-01T19:45:57.895 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.9699999999999994e-06 2024-04-01T19:45:57.895 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.895 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.895 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:57.895 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.649253+0000", 2024-04-01T19:45:57.895 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3379999999999999e-06 2024-04-01T19:45:57.895 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.896 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.896 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:57.896 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.649306+0000", 2024-04-01T19:45:57.896 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2763000000000003e-05 2024-04-01T19:45:57.896 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.896 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.896 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:57.896 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.649420+0000", 2024-04-01T19:45:57.896 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00011438900000000001 2024-04-01T19:45:57.896 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.896 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.896 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 4", 2024-04-01T19:45:57.896 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.649558+0000", 2024-04-01T19:45:57.896 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013783600000000001 2024-04-01T19:45:57.896 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.896 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.897 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:57.897 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.652019+0000", 2024-04-01T19:45:57.897 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0024613040000000001 2024-04-01T19:45:57.897 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.897 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.897 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:57.897 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.688435+0000", 2024-04-01T19:45:57.897 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.036415793000000002 2024-04-01T19:45:57.897 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.897 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.897 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:57.897 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.688495+0000", 2024-04-01T19:45:57.897 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9904000000000001e-05 2024-04-01T19:45:57.897 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.897 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.898 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:57.898 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.688547+0000", 2024-04-01T19:45:57.898 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2104999999999997e-05 2024-04-01T19:45:57.898 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.898 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:57.898 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.898 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.898 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.898 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:96916 6.6 6:678bf7bb:::benchmark_data_smithi188_134454_object96915:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e489)", 2024-04-01T19:45:57.898 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:45:30.665846+0000", 2024-04-01T19:45:57.898 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 26.947024720000002, 2024-04-01T19:45:57.898 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.044520544000000002, 2024-04-01T19:45:57.898 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:57.898 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:57.899 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:57.899 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:57.899 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:45:57.899 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:45:57.899 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 96916 2024-04-01T19:45:57.899 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.899 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:57.899 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.899 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:57.899 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.665846+0000", 2024-04-01T19:45:57.899 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.899 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.899 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.899 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:57.899 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.665846+0000", 2024-04-01T19:45:57.900 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.900 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.900 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.900 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:57.900 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.665847+0000", 2024-04-01T19:45:57.900 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3e-07 2024-04-01T19:45:57.900 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.900 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.900 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:57.900 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.665911+0000", 2024-04-01T19:45:57.900 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4153999999999996e-05 2024-04-01T19:45:57.900 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.900 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.901 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:57.901 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.687602+0000", 2024-04-01T19:45:57.901 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.021690900999999999 2024-04-01T19:45:57.901 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.901 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.901 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:57.901 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.687611+0000", 2024-04-01T19:45:57.901 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.5310000000000007e-06 2024-04-01T19:45:57.901 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.901 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.901 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:57.901 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.688701+0000", 2024-04-01T19:45:57.901 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.001089867 2024-04-01T19:45:57.901 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.901 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.901 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:57.902 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.688836+0000", 2024-04-01T19:45:57.902 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013420199999999999 2024-04-01T19:45:57.902 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.902 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.902 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 4", 2024-04-01T19:45:57.902 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.688956+0000", 2024-04-01T19:45:57.902 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000120776 2024-04-01T19:45:57.902 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.902 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.902 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:57.902 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.710223+0000", 2024-04-01T19:45:57.902 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.021266531000000002 2024-04-01T19:45:57.902 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.902 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.902 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:57.903 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.710274+0000", 2024-04-01T19:45:57.903 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.1184000000000003e-05 2024-04-01T19:45:57.903 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.903 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.903 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:57.903 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.710325+0000", 2024-04-01T19:45:57.903 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0487e-05 2024-04-01T19:45:57.903 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.903 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.903 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:57.903 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:30.710367+0000", 2024-04-01T19:45:57.903 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.2181000000000002e-05 2024-04-01T19:45:57.903 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.903 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:57.903 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.904 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.904 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.904 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.26287.0:127769 6.2 e496/469 6:4522aca7:::benchmark_data_smithi188_134454_object127768:head v 496'7938, mlcod=496'7936)", 2024-04-01T19:45:57.904 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:45:52.168172+0000", 2024-04-01T19:45:57.904 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 5.444699333, 2024-04-01T19:45:57.904 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.037092084999999997, 2024-04-01T19:45:57.904 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:57.904 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:57.904 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:57.904 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:57.904 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.904 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:57.904 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:52.168172+0000", 2024-04-01T19:45:57.904 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.904 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.904 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.905 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:57.905 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:52.168172+0000", 2024-04-01T19:45:57.905 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.905 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.905 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.905 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:57.905 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:52.168173+0000", 2024-04-01T19:45:57.905 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3650000000000001e-06 2024-04-01T19:45:57.905 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.905 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.905 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:57.905 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:52.168213+0000", 2024-04-01T19:45:57.905 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.0080000000000003e-05 2024-04-01T19:45:57.905 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.905 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.905 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:57.906 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:52.168224+0000", 2024-04-01T19:45:57.906 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1182000000000001e-05 2024-04-01T19:45:57.906 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.906 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.906 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:57.906 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:52.168231+0000", 2024-04-01T19:45:57.906 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.1670000000000002e-06 2024-04-01T19:45:57.906 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.906 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.906 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:57.906 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:52.168309+0000", 2024-04-01T19:45:57.906 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7887999999999997e-05 2024-04-01T19:45:57.906 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.906 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.906 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:57.907 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:52.168335+0000", 2024-04-01T19:45:57.907 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5825000000000001e-05 2024-04-01T19:45:57.907 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.907 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.907 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:57.907 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:52.205214+0000", 2024-04-01T19:45:57.907 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.036878739000000001 2024-04-01T19:45:57.907 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.907 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.907 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:57.907 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:52.205264+0000", 2024-04-01T19:45:57.907 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9839000000000002e-05 2024-04-01T19:45:57.907 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.907 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:57.908 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.908 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.908 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.908 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:129048 6.b 6:d54e240c:::benchmark_data_smithi188_134454_object129047:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e496)", 2024-04-01T19:45:57.908 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:45:53.187144+0000", 2024-04-01T19:45:57.908 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 4.4257267230000004, 2024-04-01T19:45:57.908 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.041788978999999997, 2024-04-01T19:45:57.908 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:57.908 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:57.908 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:57.908 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:57.908 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:45:57.908 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:45:57.908 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 129048 2024-04-01T19:45:57.909 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.909 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:57.909 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.909 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:57.909 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:53.187144+0000", 2024-04-01T19:45:57.909 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.909 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.909 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.909 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:57.909 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:53.187144+0000", 2024-04-01T19:45:57.909 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.909 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.909 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.910 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:57.910 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:53.187146+0000", 2024-04-01T19:45:57.910 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7889999999999999e-06 2024-04-01T19:45:57.910 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.910 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.910 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:57.910 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:53.187218+0000", 2024-04-01T19:45:57.910 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.1787999999999998e-05 2024-04-01T19:45:57.910 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.910 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.910 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:57.910 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:53.187231+0000", 2024-04-01T19:45:57.910 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3196e-05 2024-04-01T19:45:57.911 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.911 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.911 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:57.911 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:53.187240+0000", 2024-04-01T19:45:57.911 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.2939999999999994e-06 2024-04-01T19:45:57.911 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.911 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.911 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:57.911 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:53.187287+0000", 2024-04-01T19:45:57.911 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6442e-05 2024-04-01T19:45:57.911 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.911 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.911 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:57.911 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:53.187390+0000", 2024-04-01T19:45:57.911 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00010367200000000001 2024-04-01T19:45:57.911 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.912 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.912 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 7", 2024-04-01T19:45:57.912 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:53.187487+0000", 2024-04-01T19:45:57.912 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.6379000000000007e-05 2024-04-01T19:45:57.912 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.912 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.912 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:57.912 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:53.191022+0000", 2024-04-01T19:45:57.912 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.003535056 2024-04-01T19:45:57.912 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.912 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.912 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:57.912 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:53.228837+0000", 2024-04-01T19:45:57.912 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.037815544 2024-04-01T19:45:57.912 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.912 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.913 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:57.913 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:53.228889+0000", 2024-04-01T19:45:57.913 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2014e-05 2024-04-01T19:45:57.913 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.913 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.913 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:57.913 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:53.228933+0000", 2024-04-01T19:45:57.913 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.3804999999999998e-05 2024-04-01T19:45:57.913 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.913 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:57.913 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.913 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.913 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.914 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:130030 6.6 6:6106105a:::benchmark_data_smithi188_134454_object130029:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e496)", 2024-04-01T19:45:57.914 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:45:53.970297+0000", 2024-04-01T19:45:57.914 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 3.642573675, 2024-04-01T19:45:57.914 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.046503329000000003, 2024-04-01T19:45:57.914 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:57.914 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:57.914 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:57.914 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:57.914 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:45:57.914 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:45:57.914 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 130030 2024-04-01T19:45:57.914 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.914 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:57.914 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.915 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:57.915 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:53.970297+0000", 2024-04-01T19:45:57.915 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.915 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.915 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.915 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:57.915 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:53.970297+0000", 2024-04-01T19:45:57.915 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.915 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.915 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.915 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:57.915 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:53.970304+0000", 2024-04-01T19:45:57.915 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8199999999999999e-06 2024-04-01T19:45:57.915 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.916 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.916 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:57.916 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:53.970352+0000", 2024-04-01T19:45:57.916 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8021e-05 2024-04-01T19:45:57.916 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.916 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.916 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:57.916 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:53.970361+0000", 2024-04-01T19:45:57.916 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.986e-06 2024-04-01T19:45:57.916 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.916 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.916 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:57.916 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:53.970368+0000", 2024-04-01T19:45:57.916 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3030000000000002e-06 2024-04-01T19:45:57.917 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.917 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.917 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:57.917 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:53.989514+0000", 2024-04-01T19:45:57.917 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.019145549000000001 2024-04-01T19:45:57.917 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.917 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.917 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:57.917 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:53.989639+0000", 2024-04-01T19:45:57.917 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012526 2024-04-01T19:45:57.917 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.917 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.917 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 4", 2024-04-01T19:45:57.917 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:53.989778+0000", 2024-04-01T19:45:57.918 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000138811 2024-04-01T19:45:57.918 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.918 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.918 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:57.918 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:53.995564+0000", 2024-04-01T19:45:57.918 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0057858049999999998 2024-04-01T19:45:57.918 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.918 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.918 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:57.918 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.016689+0000", 2024-04-01T19:45:57.918 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.021125622 2024-04-01T19:45:57.918 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.918 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.919 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:57.919 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.016752+0000", 2024-04-01T19:45:57.919 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2398999999999997e-05 2024-04-01T19:45:57.919 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.919 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.919 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:57.919 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.016801+0000", 2024-04-01T19:45:57.919 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8752999999999999e-05 2024-04-01T19:45:57.919 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.919 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:57.919 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.919 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.919 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.919 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.26287.0:130270 6.0 e496/469 6:05d6ef20:::benchmark_data_smithi188_134454_object130269:head v 496'8061, mlcod=496'8059)", 2024-04-01T19:45:57.919 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:45:54.172909+0000", 2024-04-01T19:45:57.920 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 3.4399621439999999, 2024-04-01T19:45:57.920 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.044073475000000001, 2024-04-01T19:45:57.920 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:57.920 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:57.920 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:57.920 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:57.920 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.920 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:57.920 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.172909+0000", 2024-04-01T19:45:57.920 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.920 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.920 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.920 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:57.921 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.172909+0000", 2024-04-01T19:45:57.921 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.921 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.921 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.921 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:57.921 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.172910+0000", 2024-04-01T19:45:57.921 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5230000000000001e-06 2024-04-01T19:45:57.921 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.921 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.921 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:57.921 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.172937+0000", 2024-04-01T19:45:57.921 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6752000000000001e-05 2024-04-01T19:45:57.921 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.922 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.922 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:57.922 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.172946+0000", 2024-04-01T19:45:57.922 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.7029999999999995e-06 2024-04-01T19:45:57.922 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.922 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.922 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:57.922 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.172952+0000", 2024-04-01T19:45:57.922 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.545e-06 2024-04-01T19:45:57.922 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.922 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.922 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:57.922 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.173008+0000", 2024-04-01T19:45:57.923 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5983000000000003e-05 2024-04-01T19:45:57.923 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.923 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.923 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:57.923 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.173029+0000", 2024-04-01T19:45:57.923 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1197000000000001e-05 2024-04-01T19:45:57.923 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.923 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.923 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:57.923 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.216874+0000", 2024-04-01T19:45:57.923 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.043844432000000003 2024-04-01T19:45:57.923 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.923 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.923 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:57.923 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.216982+0000", 2024-04-01T19:45:57.924 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00010834 2024-04-01T19:45:57.924 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.924 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:57.924 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.924 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.924 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.924 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:130274 6.6 6:6ad42173:::benchmark_data_smithi188_134454_object130273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e496)", 2024-04-01T19:45:57.924 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:45:54.173562+0000", 2024-04-01T19:45:57.924 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 3.4393083880000002, 2024-04-01T19:45:57.924 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.059413606000000001, 2024-04-01T19:45:57.924 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:57.924 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:57.924 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:57.924 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:57.924 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:45:57.925 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:45:57.925 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 130274 2024-04-01T19:45:57.925 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.925 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:57.925 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.925 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:57.925 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.173562+0000", 2024-04-01T19:45:57.925 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.925 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.925 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.925 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:57.925 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.173562+0000", 2024-04-01T19:45:57.925 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.926 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.926 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.926 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:57.926 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.173564+0000", 2024-04-01T19:45:57.926 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.824e-06 2024-04-01T19:45:57.926 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.926 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.926 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:57.926 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.173623+0000", 2024-04-01T19:45:57.926 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8501000000000001e-05 2024-04-01T19:45:57.926 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.926 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.926 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:57.926 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.216885+0000", 2024-04-01T19:45:57.927 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.043261969999999997 2024-04-01T19:45:57.927 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.927 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.927 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:57.927 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.216909+0000", 2024-04-01T19:45:57.927 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3995999999999999e-05 2024-04-01T19:45:57.927 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.927 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.927 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:57.927 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.217120+0000", 2024-04-01T19:45:57.927 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00021138400000000001 2024-04-01T19:45:57.927 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.927 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.928 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:57.928 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.217291+0000", 2024-04-01T19:45:57.928 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00017110899999999999 2024-04-01T19:45:57.928 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.928 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.928 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 4", 2024-04-01T19:45:57.928 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.217436+0000", 2024-04-01T19:45:57.928 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014438100000000001 2024-04-01T19:45:57.928 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.928 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.928 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:57.928 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.225098+0000", 2024-04-01T19:45:57.928 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0076623940000000003 2024-04-01T19:45:57.928 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.928 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.929 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:57.929 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.232884+0000", 2024-04-01T19:45:57.929 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0077856210000000004 2024-04-01T19:45:57.929 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.929 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.929 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:57.929 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.232932+0000", 2024-04-01T19:45:57.929 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8000000000000001e-05 2024-04-01T19:45:57.929 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.929 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.929 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:57.929 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.232976+0000", 2024-04-01T19:45:57.929 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4425999999999998e-05 2024-04-01T19:45:57.929 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.929 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:57.929 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.930 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.930 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.930 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.26287.0:130281 6.7 e496/469 6:e25ed305:::benchmark_data_smithi188_134454_object130280:head v 496'8053, mlcod=496'8051)", 2024-04-01T19:45:57.930 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:45:54.178361+0000", 2024-04-01T19:45:57.930 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 3.434509856, 2024-04-01T19:45:57.930 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.049854296999999999, 2024-04-01T19:45:57.930 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:57.930 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:57.930 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:57.930 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:57.930 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.930 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:57.930 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.178361+0000", 2024-04-01T19:45:57.930 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.931 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.931 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.931 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:57.931 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.178361+0000", 2024-04-01T19:45:57.931 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.931 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.931 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.931 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:57.931 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.178363+0000", 2024-04-01T19:45:57.931 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.888e-06 2024-04-01T19:45:57.931 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.931 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.931 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:57.931 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.178446+0000", 2024-04-01T19:45:57.931 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2966999999999994e-05 2024-04-01T19:45:57.931 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.932 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.932 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:57.932 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.216876+0000", 2024-04-01T19:45:57.932 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.038430362000000003 2024-04-01T19:45:57.932 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.932 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.932 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:57.932 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.216907+0000", 2024-04-01T19:45:57.932 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.0775999999999998e-05 2024-04-01T19:45:57.932 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.932 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.932 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:57.932 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.217011+0000", 2024-04-01T19:45:57.932 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000103562 2024-04-01T19:45:57.932 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.932 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.933 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:57.933 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.217041+0000", 2024-04-01T19:45:57.933 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.0710000000000002e-05 2024-04-01T19:45:57.933 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.933 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.933 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:57.933 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.228169+0000", 2024-04-01T19:45:57.933 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.011127658 2024-04-01T19:45:57.933 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.933 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.933 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:57.933 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:54.228215+0000", 2024-04-01T19:45:57.933 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6374e-05 2024-04-01T19:45:57.933 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.933 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:57.934 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.934 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.934 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.934 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.26287.0:133285 6.2 e498/469 6:4a036b40:::benchmark_data_smithi188_134454_object133284:head v 498'8281, mlcod=498'8279)", 2024-04-01T19:45:57.934 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:45:56.536081+0000", 2024-04-01T19:45:57.934 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 1.076789384, 2024-04-01T19:45:57.934 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.038727795000000002, 2024-04-01T19:45:57.934 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:57.934 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:57.934 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:57.934 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:57.934 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.934 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:57.934 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.536081+0000", 2024-04-01T19:45:57.934 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.934 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.935 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.935 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:57.935 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.536081+0000", 2024-04-01T19:45:57.935 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.935 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.935 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.935 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:57.935 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.536083+0000", 2024-04-01T19:45:57.935 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.852e-06 2024-04-01T19:45:57.935 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.935 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.935 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:57.935 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.536130+0000", 2024-04-01T19:45:57.935 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6496999999999999e-05 2024-04-01T19:45:57.935 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.935 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.936 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:57.936 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.536148+0000", 2024-04-01T19:45:57.936 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8332999999999999e-05 2024-04-01T19:45:57.936 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.936 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.936 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:57.936 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.536158+0000", 2024-04-01T19:45:57.936 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.5550000000000008e-06 2024-04-01T19:45:57.936 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.936 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.936 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:57.936 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.536239+0000", 2024-04-01T19:45:57.936 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.1573e-05 2024-04-01T19:45:57.936 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.936 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.937 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:57.937 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.536265+0000", 2024-04-01T19:45:57.937 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5225e-05 2024-04-01T19:45:57.937 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.937 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.937 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:57.937 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.574716+0000", 2024-04-01T19:45:57.937 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.038451092999999999 2024-04-01T19:45:57.937 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.937 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.937 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:57.937 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.574809+0000", 2024-04-01T19:45:57.937 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.3666999999999996e-05 2024-04-01T19:45:57.937 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.937 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:57.937 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.938 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.938 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.938 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:133736 6.b 6:de6fffe9:::benchmark_data_smithi188_134454_object133735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e498)", 2024-04-01T19:45:57.938 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:45:56.926935+0000", 2024-04-01T19:45:57.938 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.68593637200000002, 2024-04-01T19:45:57.938 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.043992387000000001, 2024-04-01T19:45:57.938 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:57.938 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:57.938 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:57.938 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:57.938 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:45:57.938 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:45:57.938 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 133736 2024-04-01T19:45:57.938 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.938 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:57.938 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.939 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:57.939 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.926935+0000", 2024-04-01T19:45:57.939 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.939 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.939 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.939 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:57.939 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.926935+0000", 2024-04-01T19:45:57.939 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.939 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.939 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.939 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:57.939 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.926937+0000", 2024-04-01T19:45:57.939 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.897e-06 2024-04-01T19:45:57.939 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.940 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.940 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:57.940 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.926982+0000", 2024-04-01T19:45:57.940 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4758000000000001e-05 2024-04-01T19:45:57.940 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.940 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.940 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:57.940 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.927006+0000", 2024-04-01T19:45:57.940 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3955e-05 2024-04-01T19:45:57.940 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.940 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.940 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:57.940 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.927019+0000", 2024-04-01T19:45:57.940 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3196999999999999e-05 2024-04-01T19:45:57.940 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.940 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.941 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:57.941 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.930557+0000", 2024-04-01T19:45:57.941 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0035377830000000001 2024-04-01T19:45:57.941 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.941 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.941 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:57.941 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.930694+0000", 2024-04-01T19:45:57.941 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013661399999999999 2024-04-01T19:45:57.941 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.941 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.941 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 7", 2024-04-01T19:45:57.941 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.930822+0000", 2024-04-01T19:45:57.941 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012807399999999999 2024-04-01T19:45:57.941 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.941 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.942 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:57.942 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.962881+0000", 2024-04-01T19:45:57.942 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.032059020000000001 2024-04-01T19:45:57.942 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.942 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.942 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:57.942 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.970849+0000", 2024-04-01T19:45:57.942 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0079681849999999992 2024-04-01T19:45:57.942 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.942 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.942 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:57.942 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.970891+0000", 2024-04-01T19:45:57.942 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.2095000000000003e-05 2024-04-01T19:45:57.942 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.942 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.942 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:57.943 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.970927+0000", 2024-04-01T19:45:57.943 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5809000000000002e-05 2024-04-01T19:45:57.943 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.943 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:57.943 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.943 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.943 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.943 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:133737 6.b 6:dfc90f7b:::benchmark_data_smithi188_134454_object133736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e498)", 2024-04-01T19:45:57.943 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:45:56.927218+0000", 2024-04-01T19:45:57.943 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.68565287799999997, 2024-04-01T19:45:57.943 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.043762367000000003, 2024-04-01T19:45:57.943 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:57.943 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:57.943 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:57.944 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:57.944 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:45:57.944 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:45:57.944 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 133737 2024-04-01T19:45:57.944 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.944 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:57.944 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.944 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:57.944 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.927218+0000", 2024-04-01T19:45:57.944 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.944 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.944 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.944 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:57.944 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.927218+0000", 2024-04-01T19:45:57.944 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.945 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.945 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.945 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:57.945 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.927220+0000", 2024-04-01T19:45:57.945 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5519999999999999e-06 2024-04-01T19:45:57.945 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.945 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.945 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:57.945 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.927287+0000", 2024-04-01T19:45:57.945 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.7380999999999997e-05 2024-04-01T19:45:57.945 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.945 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.945 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:57.945 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.927300+0000", 2024-04-01T19:45:57.946 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2656999999999999e-05 2024-04-01T19:45:57.946 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.946 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.946 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:57.946 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.927307+0000", 2024-04-01T19:45:57.946 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5379999999999997e-06 2024-04-01T19:45:57.946 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.946 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.946 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:57.946 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.934855+0000", 2024-04-01T19:45:57.946 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0075478070000000001 2024-04-01T19:45:57.946 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.947 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.947 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:57.947 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.934975+0000", 2024-04-01T19:45:57.947 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000119608 2024-04-01T19:45:57.947 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.947 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.947 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 7", 2024-04-01T19:45:57.947 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.935091+0000", 2024-04-01T19:45:57.947 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000116261 2024-04-01T19:45:57.947 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.947 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.947 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:57.947 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.962921+0000", 2024-04-01T19:45:57.947 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.027830527000000001 2024-04-01T19:45:57.947 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.948 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.948 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:57.948 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.970938+0000", 2024-04-01T19:45:57.948 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0080163679999999994 2024-04-01T19:45:57.948 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.948 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.948 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:57.948 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.970961+0000", 2024-04-01T19:45:57.948 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3329999999999999e-05 2024-04-01T19:45:57.948 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.948 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.948 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:57.948 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.970980+0000", 2024-04-01T19:45:57.948 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9338e-05 2024-04-01T19:45:57.949 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.949 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:57.949 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.949 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.949 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.949 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:133740 6.b 6:d363163a:::benchmark_data_smithi188_134454_object133739:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e498)", 2024-04-01T19:45:57.949 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:45:56.929519+0000", 2024-04-01T19:45:57.949 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.68335137899999998, 2024-04-01T19:45:57.949 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.046336239000000001, 2024-04-01T19:45:57.949 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:57.949 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:57.949 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:57.949 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:57.949 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:45:57.949 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:45:57.950 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 133740 2024-04-01T19:45:57.950 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.950 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:57.950 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.950 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:57.950 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.929519+0000", 2024-04-01T19:45:57.950 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.950 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.950 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.950 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:57.950 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.929519+0000", 2024-04-01T19:45:57.950 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.950 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.951 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.951 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:57.951 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.929522+0000", 2024-04-01T19:45:57.951 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5629999999999999e-06 2024-04-01T19:45:57.951 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.951 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.951 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:57.951 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.929572+0000", 2024-04-01T19:45:57.951 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0423999999999997e-05 2024-04-01T19:45:57.951 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.951 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.951 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:57.951 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.929588+0000", 2024-04-01T19:45:57.951 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5509e-05 2024-04-01T19:45:57.952 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.952 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.952 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:57.952 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.929596+0000", 2024-04-01T19:45:57.952 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2169999999999994e-06 2024-04-01T19:45:57.952 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.952 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.952 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:57.952 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.958452+0000", 2024-04-01T19:45:57.952 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.028855868 2024-04-01T19:45:57.952 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.952 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.952 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:57.952 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.958605+0000", 2024-04-01T19:45:57.953 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000153022 2024-04-01T19:45:57.953 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.953 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.953 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 7", 2024-04-01T19:45:57.953 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.958763+0000", 2024-04-01T19:45:57.953 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000157813 2024-04-01T19:45:57.953 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.953 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.953 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:57.953 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.970992+0000", 2024-04-01T19:45:57.953 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.012229217000000001 2024-04-01T19:45:57.953 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.953 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.953 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:57.954 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.975734+0000", 2024-04-01T19:45:57.954 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0047422760000000001 2024-04-01T19:45:57.954 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.954 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.954 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:57.954 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.975791+0000", 2024-04-01T19:45:57.954 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6830999999999998e-05 2024-04-01T19:45:57.954 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.954 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.954 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:57.954 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.975856+0000", 2024-04-01T19:45:57.954 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4498999999999994e-05 2024-04-01T19:45:57.955 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.955 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:57.955 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.955 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.955 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.955 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:133749 6.b 6:d395b062:::benchmark_data_smithi188_134454_object133748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e498)", 2024-04-01T19:45:57.955 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:45:56.937659+0000", 2024-04-01T19:45:57.955 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.67521187400000005, 2024-04-01T19:45:57.955 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.038334610999999998, 2024-04-01T19:45:57.955 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:57.955 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:57.955 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:57.955 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:57.955 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:45:57.955 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:45:57.956 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 133749 2024-04-01T19:45:57.956 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.956 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:57.956 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.956 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:57.956 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.937659+0000", 2024-04-01T19:45:57.956 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.956 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.956 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.956 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:57.956 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.937659+0000", 2024-04-01T19:45:57.956 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.956 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.956 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.957 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:57.957 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.937661+0000", 2024-04-01T19:45:57.957 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9889999999999999e-06 2024-04-01T19:45:57.957 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.957 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.957 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:57.957 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.937723+0000", 2024-04-01T19:45:57.957 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2351e-05 2024-04-01T19:45:57.957 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.957 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.957 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:57.957 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.937740+0000", 2024-04-01T19:45:57.957 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7027000000000001e-05 2024-04-01T19:45:57.957 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.957 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.958 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:57.958 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.937750+0000", 2024-04-01T19:45:57.958 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.611e-06 2024-04-01T19:45:57.958 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.958 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.958 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:57.958 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.963004+0000", 2024-04-01T19:45:57.958 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.025254366 2024-04-01T19:45:57.958 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.958 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.958 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:57.958 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.963146+0000", 2024-04-01T19:45:57.959 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000141691 2024-04-01T19:45:57.959 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.959 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.959 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 7", 2024-04-01T19:45:57.959 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.963292+0000", 2024-04-01T19:45:57.959 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014631999999999999 2024-04-01T19:45:57.959 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.959 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.959 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:57.959 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.970999+0000", 2024-04-01T19:45:57.959 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.007706882 2024-04-01T19:45:57.959 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.959 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.959 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:57.960 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.975898+0000", 2024-04-01T19:45:57.960 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.004899123 2024-04-01T19:45:57.960 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.960 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.960 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:57.960 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.975958+0000", 2024-04-01T19:45:57.960 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9349999999999999e-05 2024-04-01T19:45:57.960 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.960 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.960 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:57.960 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.975994+0000", 2024-04-01T19:45:57.960 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5901000000000001e-05 2024-04-01T19:45:57.960 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.961 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:57.961 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.961 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.961 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.961 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:133784 6.b 6:ddd08f31:::benchmark_data_smithi188_134454_object133783:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e498)", 2024-04-01T19:45:57.961 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:45:56.985582+0000", 2024-04-01T19:45:57.961 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.62728886800000005, 2024-04-01T19:45:57.961 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.045941624, 2024-04-01T19:45:57.961 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:57.961 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:57.961 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:57.961 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:57.961 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:45:57.961 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:45:57.961 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 133784 2024-04-01T19:45:57.962 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.962 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:57.962 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.962 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:57.962 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.985582+0000", 2024-04-01T19:45:57.962 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.962 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.962 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.962 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:57.962 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.985582+0000", 2024-04-01T19:45:57.962 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.962 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.962 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.962 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:57.963 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.985585+0000", 2024-04-01T19:45:57.963 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5799999999999999e-06 2024-04-01T19:45:57.963 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.963 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.963 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:57.963 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.985627+0000", 2024-04-01T19:45:57.963 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.2545e-05 2024-04-01T19:45:57.963 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.963 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.963 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:57.963 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.985647+0000", 2024-04-01T19:45:57.963 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9741999999999998e-05 2024-04-01T19:45:57.963 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.963 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.963 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:57.964 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.985655+0000", 2024-04-01T19:45:57.964 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.337e-06 2024-04-01T19:45:57.964 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.964 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.964 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:57.964 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.993562+0000", 2024-04-01T19:45:57.964 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0079069050000000005 2024-04-01T19:45:57.964 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.964 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.964 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:57.964 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.993704+0000", 2024-04-01T19:45:57.964 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014152699999999999 2024-04-01T19:45:57.964 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.964 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.965 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 7", 2024-04-01T19:45:57.965 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.993853+0000", 2024-04-01T19:45:57.965 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014915999999999999 2024-04-01T19:45:57.965 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.965 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.965 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:57.965 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.000500+0000", 2024-04-01T19:45:57.965 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0066472450000000004 2024-04-01T19:45:57.965 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.965 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.965 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:57.965 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.031389+0000", 2024-04-01T19:45:57.965 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.030888674000000001 2024-04-01T19:45:57.965 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.965 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.965 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:57.966 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.031454+0000", 2024-04-01T19:45:57.966 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5708000000000002e-05 2024-04-01T19:45:57.966 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.966 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.966 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:57.966 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.031524+0000", 2024-04-01T19:45:57.966 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9201000000000004e-05 2024-04-01T19:45:57.966 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.966 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:57.966 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.966 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.966 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.966 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:133798 6.b 6:d65d401a:::benchmark_data_smithi188_134454_object133797:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e498)", 2024-04-01T19:45:57.966 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:45:56.990670+0000", 2024-04-01T19:45:57.967 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.62220116700000005, 2024-04-01T19:45:57.967 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.040982230000000001, 2024-04-01T19:45:57.967 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:57.967 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:57.967 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:57.967 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:57.967 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:45:57.967 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:45:57.967 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 133798 2024-04-01T19:45:57.967 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.967 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:57.967 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.967 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:57.967 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.990670+0000", 2024-04-01T19:45:57.968 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.968 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.968 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.968 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:57.968 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.990670+0000", 2024-04-01T19:45:57.968 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.968 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.968 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.968 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:57.968 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.990671+0000", 2024-04-01T19:45:57.968 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3200000000000004e-07 2024-04-01T19:45:57.968 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.968 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.968 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:57.968 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.990712+0000", 2024-04-01T19:45:57.969 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1236999999999998e-05 2024-04-01T19:45:57.969 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.969 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.969 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:57.969 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.990719+0000", 2024-04-01T19:45:57.969 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.1280000000000002e-06 2024-04-01T19:45:57.969 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.969 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.969 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:57.969 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.990725+0000", 2024-04-01T19:45:57.969 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6439999999999997e-06 2024-04-01T19:45:57.969 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.969 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.969 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:57.969 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.997267+0000", 2024-04-01T19:45:57.970 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0065423160000000003 2024-04-01T19:45:57.970 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.970 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.970 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:57.970 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.997394+0000", 2024-04-01T19:45:57.970 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012694900000000001 2024-04-01T19:45:57.970 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.970 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.970 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 7", 2024-04-01T19:45:57.970 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.997480+0000", 2024-04-01T19:45:57.970 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6489999999999994e-05 2024-04-01T19:45:57.970 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.970 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.971 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:57.971 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.004253+0000", 2024-04-01T19:45:57.971 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0067731880000000003 2024-04-01T19:45:57.971 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.971 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.971 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:57.971 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.031591+0000", 2024-04-01T19:45:57.971 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.027337203000000001 2024-04-01T19:45:57.971 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.971 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.971 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:57.971 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.031627+0000", 2024-04-01T19:45:57.971 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5803000000000003e-05 2024-04-01T19:45:57.971 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.972 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.972 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:57.972 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.031652+0000", 2024-04-01T19:45:57.972 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.544e-05 2024-04-01T19:45:57.972 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.972 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:57.972 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.972 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.972 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.972 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:133807 6.b 6:dcd7f748:::benchmark_data_smithi188_134454_object133806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e498)", 2024-04-01T19:45:57.972 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:45:56.994194+0000", 2024-04-01T19:45:57.972 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.61867684099999998, 2024-04-01T19:45:57.972 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.037574879999999998, 2024-04-01T19:45:57.972 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:57.973 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:57.973 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:57.973 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:57.973 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:45:57.973 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:45:57.973 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 133807 2024-04-01T19:45:57.973 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.973 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:57.973 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.973 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:57.973 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.994194+0000", 2024-04-01T19:45:57.973 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.973 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.973 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.973 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:57.974 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.994194+0000", 2024-04-01T19:45:57.974 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.974 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.974 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.974 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:57.974 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.994196+0000", 2024-04-01T19:45:57.974 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.967e-06 2024-04-01T19:45:57.974 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.974 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.974 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:57.974 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.994238+0000", 2024-04-01T19:45:57.974 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.2262999999999998e-05 2024-04-01T19:45:57.974 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.974 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.975 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:57.975 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.994253+0000", 2024-04-01T19:45:57.975 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4951e-05 2024-04-01T19:45:57.975 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.975 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.975 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:57.975 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:56.994262+0000", 2024-04-01T19:45:57.975 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6889999999999993e-06 2024-04-01T19:45:57.975 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.975 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.975 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:57.975 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.000555+0000", 2024-04-01T19:45:57.975 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0062931860000000001 2024-04-01T19:45:57.975 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.975 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.976 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:57.976 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.000670+0000", 2024-04-01T19:45:57.976 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000114578 2024-04-01T19:45:57.976 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.976 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.976 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 7", 2024-04-01T19:45:57.976 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.000760+0000", 2024-04-01T19:45:57.976 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.0797999999999994e-05 2024-04-01T19:45:57.976 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.976 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.976 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:57.976 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.007876+0000", 2024-04-01T19:45:57.976 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0071152769999999997 2024-04-01T19:45:57.976 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.977 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.977 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:57.977 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.031689+0000", 2024-04-01T19:45:57.977 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.023813147999999999 2024-04-01T19:45:57.977 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.977 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.977 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:57.977 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.031727+0000", 2024-04-01T19:45:57.977 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7806999999999999e-05 2024-04-01T19:45:57.977 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.977 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.977 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:57.977 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.031769+0000", 2024-04-01T19:45:57.977 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.2215999999999997e-05 2024-04-01T19:45:57.978 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.978 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:57.978 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.978 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.978 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.978 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:133817 6.b 6:d4d28ed5:::benchmark_data_smithi188_134454_object133816:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e498)", 2024-04-01T19:45:57.978 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:45:57.004229+0000", 2024-04-01T19:45:57.978 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.60864223299999998, 2024-04-01T19:45:57.978 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.037477991000000002, 2024-04-01T19:45:57.978 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:57.978 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:57.978 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:57.978 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:57.978 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:45:57.979 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:45:57.979 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 133817 2024-04-01T19:45:57.979 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.979 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:57.979 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.979 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:57.979 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.004229+0000", 2024-04-01T19:45:57.979 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.979 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.979 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.979 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:57.979 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.004229+0000", 2024-04-01T19:45:57.979 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.979 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.980 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.980 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:57.980 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.004236+0000", 2024-04-01T19:45:57.980 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5120000000000002e-06 2024-04-01T19:45:57.980 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.980 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.980 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:57.980 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.004301+0000", 2024-04-01T19:45:57.980 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5071000000000001e-05 2024-04-01T19:45:57.980 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.980 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.980 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:57.980 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.004314+0000", 2024-04-01T19:45:57.981 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2393e-05 2024-04-01T19:45:57.981 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.981 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.981 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:57.981 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.004322+0000", 2024-04-01T19:45:57.981 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4039999999999995e-06 2024-04-01T19:45:57.981 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.981 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.981 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:57.981 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.004364+0000", 2024-04-01T19:45:57.981 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.2410999999999998e-05 2024-04-01T19:45:57.981 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.981 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.981 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:57.981 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.004536+0000", 2024-04-01T19:45:57.982 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000171278 2024-04-01T19:45:57.982 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.982 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.982 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 7", 2024-04-01T19:45:57.982 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.004676+0000", 2024-04-01T19:45:57.982 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000140307 2024-04-01T19:45:57.982 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.982 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.982 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:57.982 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.008081+0000", 2024-04-01T19:45:57.982 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0034052510000000002 2024-04-01T19:45:57.982 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.982 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.983 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:57.983 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.041530+0000", 2024-04-01T19:45:57.983 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.033448964999999997 2024-04-01T19:45:57.983 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.983 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.983 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:57.983 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.041653+0000", 2024-04-01T19:45:57.983 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012302 2024-04-01T19:45:57.983 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.983 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.983 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:57.983 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.041707+0000", 2024-04-01T19:45:57.983 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3378999999999998e-05 2024-04-01T19:45:57.983 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.983 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:57.984 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.984 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.984 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.984 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.26287.0:134312 6.7 e498/469 6:e52041d5:::benchmark_data_smithi188_134454_object134311:head v 498'8315, mlcod=498'8309)", 2024-04-01T19:45:57.984 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:45:57.441054+0000", 2024-04-01T19:45:57.984 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.17181736, 2024-04-01T19:45:57.984 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.037228012999999997, 2024-04-01T19:45:57.984 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:57.984 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:57.984 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:57.984 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:57.984 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.984 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:57.984 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.441054+0000", 2024-04-01T19:45:57.985 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.985 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.985 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.985 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:57.985 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.441054+0000", 2024-04-01T19:45:57.985 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.985 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.985 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.985 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:57.985 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.441054+0000", 2024-04-01T19:45:57.985 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.9500000000000001e-07 2024-04-01T19:45:57.985 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.985 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.985 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:57.985 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.441077+0000", 2024-04-01T19:45:57.986 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2161999999999999e-05 2024-04-01T19:45:57.986 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.986 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.986 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:57.986 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.441084+0000", 2024-04-01T19:45:57.986 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0369999999999997e-06 2024-04-01T19:45:57.986 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.986 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.986 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:57.986 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.441087+0000", 2024-04-01T19:45:57.986 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5489999999999998e-06 2024-04-01T19:45:57.986 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.986 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.986 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:57.987 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.445463+0000", 2024-04-01T19:45:57.987 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0043757819999999999 2024-04-01T19:45:57.987 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.987 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.987 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:57.987 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.445482+0000", 2024-04-01T19:45:57.987 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8563000000000002e-05 2024-04-01T19:45:57.987 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.987 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.987 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:57.987 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.478218+0000", 2024-04-01T19:45:57.987 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.032736099999999997 2024-04-01T19:45:57.987 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.987 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.987 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:57.988 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.478282+0000", 2024-04-01T19:45:57.988 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3924999999999995e-05 2024-04-01T19:45:57.988 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.988 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:57.988 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.988 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.988 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.988 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:134445 6.b 6:ddd0896d:::benchmark_data_smithi188_134454_object134444:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e498)", 2024-04-01T19:45:57.988 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:45:57.547790+0000", 2024-04-01T19:45:57.988 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.065081110999999997, 2024-04-01T19:45:57.988 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.040500873999999999, 2024-04-01T19:45:57.988 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:45:57.988 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:45:57.988 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:45:57.988 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:45:57.989 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:45:57.989 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:45:57.989 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 134445 2024-04-01T19:45:57.989 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.989 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:45:57.989 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.989 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:45:57.989 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.547790+0000", 2024-04-01T19:45:57.989 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.989 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.989 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.989 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:45:57.989 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.547790+0000", 2024-04-01T19:45:57.989 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:45:57.989 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.990 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.990 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:45:57.990 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.547790+0000", 2024-04-01T19:45:57.990 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2900000000000003e-07 2024-04-01T19:45:57.990 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.990 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.990 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:45:57.990 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.547815+0000", 2024-04-01T19:45:57.990 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4365000000000001e-05 2024-04-01T19:45:57.990 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.990 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.990 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:45:57.990 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.547819+0000", 2024-04-01T19:45:57.990 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4950000000000002e-06 2024-04-01T19:45:57.991 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.991 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.991 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:45:57.991 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.547823+0000", 2024-04-01T19:45:57.991 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3720000000000001e-06 2024-04-01T19:45:57.991 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.991 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.991 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:45:57.991 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.558101+0000", 2024-04-01T19:45:57.991 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010278868 2024-04-01T19:45:57.991 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.991 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.991 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:45:57.991 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.558231+0000", 2024-04-01T19:45:57.991 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000129107 2024-04-01T19:45:57.991 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.992 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.992 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 7", 2024-04-01T19:45:57.992 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.558368+0000", 2024-04-01T19:45:57.992 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013697700000000001 2024-04-01T19:45:57.992 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.992 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.992 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:45:57.992 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.561794+0000", 2024-04-01T19:45:57.992 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0034262749999999999 2024-04-01T19:45:57.992 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.992 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.992 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:45:57.992 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.588184+0000", 2024-04-01T19:45:57.992 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.026389908 2024-04-01T19:45:57.992 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.993 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.993 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:45:57.993 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.588243+0000", 2024-04-01T19:45:57.993 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9370000000000002e-05 2024-04-01T19:45:57.993 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:45:57.993 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:45:57.993 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:45:57.993 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:45:57.588291+0000", 2024-04-01T19:45:57.993 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7508e-05 2024-04-01T19:45:57.993 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.993 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:57.993 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.993 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:45:57.993 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:45:57.993 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:45:58.522 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 66 16 135708 135692 128.486 80.9375 0.0146302 0.00778167 2024-04-01T19:45:58.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:58 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:45:58.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:58 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:45:58.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:58 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:45:58.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:58 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:45:58.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:58 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:45:58.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:58 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:45:58.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:58 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:45:58.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:58 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:45:58.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:58 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T19:45:59.289 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:45:59.292 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:59.293 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:45:59.394 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:45:59.445 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:45:59.522 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 67 16 137034 137018 127.805 82.875 0.00509453 0.00782316 2024-04-01T19:45:59.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:45:59 smithi022 ceph-mon[39439]: pgmap v1372: 17 pgs: 17 active+clean; 8.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s wr, 1.22k op/s 2024-04-01T19:45:59.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:45:59 smithi062 ceph-mon[44211]: pgmap v1372: 17 pgs: 17 active+clean; 8.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s wr, 1.22k op/s 2024-04-01T19:45:59.805 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:45:59.808 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:45:59.808 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:45:59.814 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:45:59.864 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_ops_in_flight 2024-04-01T19:45:59.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:45:59 smithi188 ceph-mon[43939]: pgmap v1372: 17 pgs: 17 active+clean; 8.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s wr, 1.22k op/s 2024-04-01T19:45:59.909 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:45:59.948 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:00.085 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:46:00.093 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:00.094 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:46:00.195 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:46:00.229 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:00.315 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:46:00.323 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:46:00.328 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:00.328 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:46:00.429 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:46:00.471 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:00.522 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 68 16 138195 138179 126.993 72.5625 0.0127449 0.00787314 2024-04-01T19:46:00.615 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:46:00.622 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:00.622 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:46:00.723 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:46:00.784 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:00.922 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:46:00.928 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:00.928 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:46:01.021 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:46:01.029 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:46:01.109 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:01.294 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:46:01.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:01 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1888545207' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:46:01.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:01 smithi022 ceph-mon[39439]: pgmap v1373: 17 pgs: 17 active+clean; 8.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 78 MiB/s wr, 1.25k op/s 2024-04-01T19:46:01.522 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 69 16 139380 139364 126.226 74.0625 0.00566941 0.00792106 2024-04-01T19:46:01.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:01 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1888545207' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:46:01.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:01 smithi188 ceph-mon[43939]: pgmap v1373: 17 pgs: 17 active+clean; 8.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 78 MiB/s wr, 1.25k op/s 2024-04-01T19:46:01.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:01 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1888545207' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:46:01.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:01 smithi062 ceph-mon[44211]: pgmap v1373: 17 pgs: 17 active+clean; 8.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 78 MiB/s wr, 1.25k op/s 2024-04-01T19:46:02.522 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 70 16 140564 140548 125.479 74 0.0128614 0.00796782 2024-04-01T19:46:02.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:02 smithi022 ceph-mon[39439]: 6.f scrub starts 2024-04-01T19:46:02.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:02 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:46:02.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:02 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:46:02.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:02 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1888545207' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:46:02.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:02 smithi022 ceph-mon[39439]: osdmap e499: 12 total, 12 up, 12 in 2024-04-01T19:46:02.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:02 smithi188 ceph-mon[43939]: 6.f scrub starts 2024-04-01T19:46:02.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:02 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:46:02.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:02 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:46:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:02 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1888545207' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:46:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:02 smithi188 ceph-mon[43939]: osdmap e499: 12 total, 12 up, 12 in 2024-04-01T19:46:02.739 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:46:02.739 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:46:02.739 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.739 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:140792 6.e 6:7d07fe27:::benchmark_data_smithi188_134454_object140791:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e499)", 2024-04-01T19:46:02.739 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:46:02.729786+0000", 2024-04-01T19:46:02.739 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.007940061, 2024-04-01T19:46:02.739 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0079664079999999995, 2024-04-01T19:46:02.739 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:02.739 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:02.739 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:46:02.739 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:02.739 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:46:02.739 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:46:02.740 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 140792 2024-04-01T19:46:02.740 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.740 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:02.740 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.740 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:02.740 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.729786+0000", 2024-04-01T19:46:02.740 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:02.740 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.740 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.740 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:02.740 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.729786+0000", 2024-04-01T19:46:02.740 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:02.740 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.740 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.740 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:02.741 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.729788+0000", 2024-04-01T19:46:02.741 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.6670000000000001e-06 2024-04-01T19:46:02.741 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.741 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.741 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:02.741 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.729811+0000", 2024-04-01T19:46:02.741 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3495000000000001e-05 2024-04-01T19:46:02.741 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.741 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.741 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:02.741 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.729820+0000", 2024-04-01T19:46:02.741 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.2369999999999998e-06 2024-04-01T19:46:02.741 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.741 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.741 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:02.742 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.729826+0000", 2024-04-01T19:46:02.742 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5269999999999998e-06 2024-04-01T19:46:02.742 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.742 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.742 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:02.742 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.729904+0000", 2024-04-01T19:46:02.742 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.8582000000000001e-05 2024-04-01T19:46:02.742 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.742 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.742 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:02.742 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.730061+0000", 2024-04-01T19:46:02.742 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000156496 2024-04-01T19:46:02.742 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.742 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.743 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:46:02.743 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.730212+0000", 2024-04-01T19:46:02.743 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00015075599999999999 2024-04-01T19:46:02.743 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.743 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.743 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:02.743 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.734235+0000", 2024-04-01T19:46:02.743 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.004023319 2024-04-01T19:46:02.743 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:02.743 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:02.743 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:02.743 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.743 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.744 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:140801 6.2 6:4c361ade:::benchmark_data_smithi188_134454_object140800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e499)", 2024-04-01T19:46:02.744 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:46:02.734753+0000", 2024-04-01T19:46:02.744 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.002973051, 2024-04-01T19:46:02.744 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0031210880000000002, 2024-04-01T19:46:02.744 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:02.744 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:02.744 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:46:02.744 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:02.744 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:46:02.744 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:46:02.744 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 140801 2024-04-01T19:46:02.744 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.744 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:02.744 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.744 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:02.745 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.734753+0000", 2024-04-01T19:46:02.745 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:02.745 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.745 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.745 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:02.745 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.734753+0000", 2024-04-01T19:46:02.745 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:02.745 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.745 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.745 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:02.745 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.734754+0000", 2024-04-01T19:46:02.745 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.373e-06 2024-04-01T19:46:02.745 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.745 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.746 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:02.746 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.734824+0000", 2024-04-01T19:46:02.746 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9919000000000006e-05 2024-04-01T19:46:02.746 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.746 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.746 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:02.746 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.734837+0000", 2024-04-01T19:46:02.746 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.278e-05 2024-04-01T19:46:02.746 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.746 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.746 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:02.746 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.734846+0000", 2024-04-01T19:46:02.746 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.7350000000000002e-06 2024-04-01T19:46:02.747 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.747 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.747 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:02.747 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.734901+0000", 2024-04-01T19:46:02.747 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.533e-05 2024-04-01T19:46:02.747 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.747 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.747 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:02.747 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.735038+0000", 2024-04-01T19:46:02.747 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013676000000000001 2024-04-01T19:46:02.747 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.747 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.747 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:46:02.747 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.735186+0000", 2024-04-01T19:46:02.747 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014823399999999999 2024-04-01T19:46:02.748 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:02.748 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:02.748 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:02.748 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.748 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.748 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.26287.0:140799 6.6 e499/469 6:637c5da6:::benchmark_data_smithi188_134454_object140798:head v 499'8906, mlcod=499'8904)", 2024-04-01T19:46:02.748 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:46:02.734975+0000", 2024-04-01T19:46:02.748 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0027512840000000001, 2024-04-01T19:46:02.748 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.002984741, 2024-04-01T19:46:02.748 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:02.748 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:02.748 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "started", 2024-04-01T19:46:02.748 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:02.748 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.749 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:02.749 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.734975+0000", 2024-04-01T19:46:02.749 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:02.749 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.749 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.749 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:02.749 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.734975+0000", 2024-04-01T19:46:02.749 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:02.749 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.749 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.749 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:02.749 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.734976+0000", 2024-04-01T19:46:02.749 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.229e-06 2024-04-01T19:46:02.749 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.750 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.750 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:02.750 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.735029+0000", 2024-04-01T19:46:02.750 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3508000000000003e-05 2024-04-01T19:46:02.750 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.750 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.750 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:02.750 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.735038+0000", 2024-04-01T19:46:02.750 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.6799999999999999e-06 2024-04-01T19:46:02.750 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.750 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.750 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:02.750 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.735044+0000", 2024-04-01T19:46:02.750 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3199999999999996e-06 2024-04-01T19:46:02.750 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.751 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.751 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:02.751 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.735089+0000", 2024-04-01T19:46:02.751 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.4381000000000001e-05 2024-04-01T19:46:02.751 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:02.751 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:02.751 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:02.751 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:02.735109+0000", 2024-04-01T19:46:02.751 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.0132999999999998e-05 2024-04-01T19:46:02.751 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:02.751 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:02.751 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:02.751 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:02.751 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-04-01T19:46:02.752 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 3 2024-04-01T19:46:02.752 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:46:02.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:02 smithi062 ceph-mon[44211]: 6.f scrub starts 2024-04-01T19:46:02.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:02 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:46:02.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:02 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:46:02.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:02 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1888545207' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:46:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:02 smithi062 ceph-mon[44211]: osdmap e499: 12 total, 12 up, 12 in 2024-04-01T19:46:03.522 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 71 16 141696 141680 124.708 70.75 0.015792 0.00801699 2024-04-01T19:46:03.590 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:03 smithi062 ceph-mon[44211]: 6.5 scrub starts 2024-04-01T19:46:03.590 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:03 smithi062 ceph-mon[44211]: pgmap v1375: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 MiB/s wr, 1.30k op/s 2024-04-01T19:46:03.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:03 smithi022 ceph-mon[39439]: 6.5 scrub starts 2024-04-01T19:46:03.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:03 smithi022 ceph-mon[39439]: pgmap v1375: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 MiB/s wr, 1.30k op/s 2024-04-01T19:46:03.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:03 smithi188 ceph-mon[43939]: 6.5 scrub starts 2024-04-01T19:46:03.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:03 smithi188 ceph-mon[43939]: pgmap v1375: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 MiB/s wr, 1.30k op/s 2024-04-01T19:46:03.643 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_blocked_ops 2024-04-01T19:46:04.124 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:46:04.294 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:04 smithi022 ceph-mon[39439]: 6.f scrub ok 2024-04-01T19:46:04.294 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:04 smithi022 ceph-mon[39439]: 6.1 scrub starts 2024-04-01T19:46:04.522 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 72 16 142806 142790 123.94 69.375 0.00380326 0.00806637 2024-04-01T19:46:04.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:04 smithi188 ceph-mon[43939]: 6.f scrub ok 2024-04-01T19:46:04.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:04 smithi188 ceph-mon[43939]: 6.1 scrub starts 2024-04-01T19:46:04.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:04 smithi062 ceph-mon[44211]: 6.f scrub ok 2024-04-01T19:46:04.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:04 smithi062 ceph-mon[44211]: 6.1 scrub starts 2024-04-01T19:46:05.307 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:05 smithi022 ceph-mon[39439]: 6.1 scrub ok 2024-04-01T19:46:05.307 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:05 smithi022 ceph-mon[39439]: 6.5 scrub ok 2024-04-01T19:46:05.307 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:05 smithi022 ceph-mon[39439]: pgmap v1376: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 78 MiB/s wr, 1.24k op/s 2024-04-01T19:46:05.522 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 73 15 144000 143985 123.265 74.6875 0.0210589 0.00811108 2024-04-01T19:46:05.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:05 smithi188 ceph-mon[43939]: 6.1 scrub ok 2024-04-01T19:46:05.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:05 smithi188 ceph-mon[43939]: 6.5 scrub ok 2024-04-01T19:46:05.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:05 smithi188 ceph-mon[43939]: pgmap v1376: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 78 MiB/s wr, 1.24k op/s 2024-04-01T19:46:05.692 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:46:05.701 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:05.702 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:46:05.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:05 smithi062 ceph-mon[44211]: 6.1 scrub ok 2024-04-01T19:46:05.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:05 smithi062 ceph-mon[44211]: 6.5 scrub ok 2024-04-01T19:46:05.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:05 smithi062 ceph-mon[44211]: pgmap v1376: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 78 MiB/s wr, 1.24k op/s 2024-04-01T19:46:05.802 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:46:05.859 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:06.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:06 smithi022 ceph-mon[39439]: 6.8 scrub starts 2024-04-01T19:46:06.523 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 74 15 145056 145041 122.491 66 0.0206406 0.00816205 2024-04-01T19:46:06.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:06 smithi188 ceph-mon[43939]: 6.8 scrub starts 2024-04-01T19:46:06.654 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:46:06.654 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:46:06.654 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:46:06.654 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:46:06.654 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:46:06.654 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:46:06.671 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:46:06.688 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:06 smithi062 ceph-mon[44211]: 6.8 scrub starts 2024-04-01T19:46:06.708 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:46:06.740 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:46:06.744 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:46:06.745 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:06.745 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:46:06.768 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:46:06.798 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:46:06.833 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:46:06.846 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:46:06.847 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:46:06.847 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:46:06.847 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:46:06.847 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:46:06.847 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:46:06.848 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:46:06.848 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:46:06.848 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:46:06.848 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:46:06.848 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:46:06.848 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:46:06.848 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:46:06.874 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:06.894 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:46:06.899 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:06.900 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:46:07.000 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:46:07.072 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:07.109 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:46:07.112 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:07.112 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:46:07.213 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:46:07.239 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:07.258 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:46:07.262 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:07.262 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:46:07.332 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.7 to 1 (10000) 2024-04-01T19:46:07.363 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:46:07.416 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:07.522 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 75 16 145946 145930 121.599 55.5625 0.00668992 0.00822155 2024-04-01T19:46:07.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:07 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3001014841' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:46:07.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:07.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:07.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:07.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:07.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:07 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:07.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:07 smithi022 ceph-mon[39439]: pgmap v1377: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s wr, 1.21k op/s 2024-04-01T19:46:07.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:07 smithi022 ceph-mon[39439]: 6.e deep-scrub starts 2024-04-01T19:46:07.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:07 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3085735982' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T19:46:07.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:07 smithi022 ceph-mon[39439]: from='client.36434 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T19:46:07.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:07 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3001014841' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:46:07.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:07.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:07.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:07.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:07.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:07 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:07.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:07 smithi188 ceph-mon[43939]: pgmap v1377: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s wr, 1.21k op/s 2024-04-01T19:46:07.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:07 smithi188 ceph-mon[43939]: 6.e deep-scrub starts 2024-04-01T19:46:07.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:07 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3085735982' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T19:46:07.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:07 smithi188 ceph-mon[43939]: from='client.36434 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T19:46:07.708 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:46:07.757 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:07 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3001014841' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:46:07.757 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:07.757 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:07.757 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:07.757 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:07.757 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:07 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:07.758 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:07 smithi062 ceph-mon[44211]: pgmap v1377: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s wr, 1.21k op/s 2024-04-01T19:46:07.758 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:07 smithi062 ceph-mon[44211]: 6.e deep-scrub starts 2024-04-01T19:46:07.758 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:07 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3085735982' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T19:46:07.758 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:07 smithi062 ceph-mon[44211]: from='client.36434 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T19:46:08.080 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:46:08.086 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:08.087 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:46:08.188 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:46:08.262 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:08.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:08.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:08.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:08 smithi022 ceph-mon[39439]: 6.c deep-scrub starts 2024-04-01T19:46:08.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:08.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:08.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:08.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:08.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:08.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:08 smithi022 ceph-mon[39439]: 6.8 scrub ok 2024-04-01T19:46:08.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:08 smithi022 ceph-mon[39439]: from='client.36434 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-04-01T19:46:08.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:08 smithi022 ceph-mon[39439]: osdmap e500: 12 total, 12 up, 12 in 2024-04-01T19:46:08.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:08 smithi022 ceph-mon[39439]: 6.9 scrub starts 2024-04-01T19:46:08.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:08 smithi062 ceph-mon[44211]: 6.c deep-scrub starts 2024-04-01T19:46:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:08 smithi062 ceph-mon[44211]: 6.8 scrub ok 2024-04-01T19:46:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:08 smithi062 ceph-mon[44211]: from='client.36434 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-04-01T19:46:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:08 smithi062 ceph-mon[44211]: osdmap e500: 12 total, 12 up, 12 in 2024-04-01T19:46:08.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:08 smithi062 ceph-mon[44211]: 6.9 scrub starts 2024-04-01T19:46:08.522 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 76 16 146656 146640 120.582 44.375 0.0198673 0.00829036 2024-04-01T19:46:08.528 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:46:08.542 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:08.542 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:46:08.595 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 9 1 2024-04-01T19:46:08.598 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:46:08.599 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:46:08.606 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:46:08.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:08.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:08.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:08 smithi188 ceph-mon[43939]: 6.c deep-scrub starts 2024-04-01T19:46:08.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:08.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:08.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:08.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:08.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:08.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:08 smithi188 ceph-mon[43939]: 6.8 scrub ok 2024-04-01T19:46:08.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:08 smithi188 ceph-mon[43939]: from='client.36434 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-04-01T19:46:08.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:08 smithi188 ceph-mon[43939]: osdmap e500: 12 total, 12 up, 12 in 2024-04-01T19:46:08.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:08 smithi188 ceph-mon[43939]: 6.9 scrub starts 2024-04-01T19:46:08.642 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:46:08.671 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:08.694 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:46:08.696 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:08.696 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:46:08.798 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:46:08.823 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:08.843 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:46:08.845 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:08.846 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:46:08.947 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:46:08.996 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:09.335 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_historic_ops 2024-04-01T19:46:09.358 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:46:09.363 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:09.363 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:46:09.464 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:46:09.490 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:09.511 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:46:09.513 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:09.514 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:46:09.523 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 77 16 147298 147282 119.537 40.125 0.00478902 0.00836281 2024-04-01T19:46:09.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:09 smithi022 ceph-mon[39439]: 6.3 scrub starts 2024-04-01T19:46:09.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:09 smithi022 ceph-mon[39439]: pgmap v1379: 17 pgs: 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 15 active+clean; 8.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 70 MiB/s wr, 1.12k op/s 2024-04-01T19:46:09.614 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:46:09.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:09 smithi188 ceph-mon[43939]: 6.3 scrub starts 2024-04-01T19:46:09.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:09 smithi188 ceph-mon[43939]: pgmap v1379: 17 pgs: 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 15 active+clean; 8.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 70 MiB/s wr, 1.12k op/s 2024-04-01T19:46:09.649 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:09.748 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:46:09.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:09 smithi062 ceph-mon[44211]: 6.3 scrub starts 2024-04-01T19:46:09.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:09 smithi062 ceph-mon[44211]: pgmap v1379: 17 pgs: 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 15 active+clean; 8.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 70 MiB/s wr, 1.12k op/s 2024-04-01T19:46:09.788 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:46:10.523 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 78 15 147975 147960 118.548 42.375 0.00904054 0.00843277 2024-04-01T19:46:10.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:10 smithi022 ceph-mon[39439]: 6.6 scrub starts 2024-04-01T19:46:10.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:10 smithi022 ceph-mon[39439]: 6.9 scrub ok 2024-04-01T19:46:10.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:10 smithi188 ceph-mon[43939]: 6.6 scrub starts 2024-04-01T19:46:10.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:10 smithi188 ceph-mon[43939]: 6.9 scrub ok 2024-04-01T19:46:10.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:10 smithi062 ceph-mon[44211]: 6.6 scrub starts 2024-04-01T19:46:10.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:10 smithi062 ceph-mon[44211]: 6.9 scrub ok 2024-04-01T19:46:11.409 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:46:11.412 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:11.413 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:46:11.464 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:46:11.473 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:11 smithi062 ceph-mon[44211]: 6.b scrub starts 2024-04-01T19:46:11.473 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:11 smithi062 ceph-mon[44211]: 6.3 scrub ok 2024-04-01T19:46:11.473 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:11 smithi062 ceph-mon[44211]: pgmap v1380: 17 pgs: 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 15 active+clean; 9.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 68 MiB/s wr, 1.09k op/s 2024-04-01T19:46:11.514 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:46:11.523 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 79 16 148693 148677 117.615 44.8125 0.0375958 0.00849985 2024-04-01T19:46:11.541 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:11.561 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:46:11.564 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:11.564 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:46:11.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:11 smithi022 ceph-mon[39439]: 6.b scrub starts 2024-04-01T19:46:11.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:11 smithi022 ceph-mon[39439]: 6.3 scrub ok 2024-04-01T19:46:11.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:11 smithi022 ceph-mon[39439]: pgmap v1380: 17 pgs: 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 15 active+clean; 9.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 68 MiB/s wr, 1.09k op/s 2024-04-01T19:46:11.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:11 smithi188 ceph-mon[43939]: 6.b scrub starts 2024-04-01T19:46:11.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:11 smithi188 ceph-mon[43939]: 6.3 scrub ok 2024-04-01T19:46:11.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:11 smithi188 ceph-mon[43939]: pgmap v1380: 17 pgs: 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 15 active+clean; 9.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 68 MiB/s wr, 1.09k op/s 2024-04-01T19:46:11.665 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:46:11.691 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:11.710 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:46:11.712 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:11.713 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:46:11.814 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:46:11.823 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:46:11.824 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:46:11.871 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:12.109 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:46:12.113 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:12.114 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:46:12.214 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:46:12.251 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:12.523 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:46:12.526498 min lat: 0.000949379 max lat: 0.208931 avg lat: 0.00856354 2024-04-01T19:46:12.523 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:46:12.523 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 80 16 149458 149442 116.742 47.8125 0.00455581 0.00856354 2024-04-01T19:46:12.595 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_ops_in_flight 2024-04-01T19:46:12.614 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:46:12.621 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:12.623 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:46:12.723 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:46:12.786 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:12.854 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:46:12.864 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:12.864 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:46:12.965 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:46:12.993 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:13.013 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:46:13.015 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:13.015 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:46:13.085 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:46:13.116 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:46:13.142 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:13.161 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:46:13.163 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:13.163 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:46:13.195 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:46:13.264 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:46:13.301 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:13.523 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 81 16 150201 150185 115.874 46.4375 0.00521578 0.00862815 2024-04-01T19:46:13.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:13 smithi022 ceph-mon[39439]: 6.b scrub ok 2024-04-01T19:46:13.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:13 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:46:13.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:13 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:46:13.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:13 smithi022 ceph-mon[39439]: osdmap e501: 12 total, 12 up, 12 in 2024-04-01T19:46:13.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:13 smithi022 ceph-mon[39439]: pgmap v1382: 17 pgs: 2 active+clean+scrubbing+deep, 2 active+clean+scrubbing, 13 active+clean; 9.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 62 MiB/s wr, 988 op/s 2024-04-01T19:46:13.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:13 smithi188 ceph-mon[43939]: 6.b scrub ok 2024-04-01T19:46:13.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:13 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:46:13.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:13 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:46:13.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:13 smithi188 ceph-mon[43939]: osdmap e501: 12 total, 12 up, 12 in 2024-04-01T19:46:13.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:13 smithi188 ceph-mon[43939]: pgmap v1382: 17 pgs: 2 active+clean+scrubbing+deep, 2 active+clean+scrubbing, 13 active+clean; 9.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 62 MiB/s wr, 988 op/s 2024-04-01T19:46:13.635 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:13 smithi062 ceph-mon[44211]: 6.b scrub ok 2024-04-01T19:46:13.635 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:13 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:46:13.635 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:13 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:46:13.635 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:13 smithi062 ceph-mon[44211]: osdmap e501: 12 total, 12 up, 12 in 2024-04-01T19:46:13.635 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:13 smithi062 ceph-mon[44211]: pgmap v1382: 17 pgs: 2 active+clean+scrubbing+deep, 2 active+clean+scrubbing, 13 active+clean; 9.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 62 MiB/s wr, 988 op/s 2024-04-01T19:46:13.965 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:46:13.968 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:13.969 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:46:14.069 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:46:14.115 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:14.229 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:46:14.231 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:14.231 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:46:14.332 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:46:14.391 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:14.429 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:46:14.431 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:14.431 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:46:14.523 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 82 16 150792 150776 114.912 36.9375 0.0187392 0.00869984 2024-04-01T19:46:14.532 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:46:14.584 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:14.946 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:46:14.953 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:46:14.958 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:14.959 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:46:15.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:14 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4095163758' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:46:15.060 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:46:15.086 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:15.105 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:46:15.107 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:15.108 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:46:15.124 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:46:15.124 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:46:15.199 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:14 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4095163758' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:46:15.208 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:46:15.247 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:15.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:14 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4095163758' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:46:15.523 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 83 16 151542 151526 114.092 46.875 0.00518956 0.00876311 2024-04-01T19:46:15.910 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:46:15.913 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:15.913 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:46:15.931 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_blocked_ops 2024-04-01T19:46:16.014 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:46:16.040 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:16.060 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:46:16.062 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:16.063 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:46:16.164 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:46:16.227 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:15 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:46:16.227 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:15 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4095163758' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:46:16.227 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:15 smithi062 ceph-mon[44211]: osdmap e502: 12 total, 12 up, 12 in 2024-04-01T19:46:16.227 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:15 smithi062 ceph-mon[44211]: pgmap v1384: 17 pgs: 2 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 14 active+clean; 9.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 49 MiB/s wr, 785 op/s 2024-04-01T19:46:16.238 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:16.272 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:46:16.275 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:16.275 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:46:16.337 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:15 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:46:16.337 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:15 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4095163758' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:46:16.337 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:15 smithi022 ceph-mon[39439]: osdmap e502: 12 total, 12 up, 12 in 2024-04-01T19:46:16.337 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:15 smithi022 ceph-mon[39439]: pgmap v1384: 17 pgs: 2 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 14 active+clean; 9.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 49 MiB/s wr, 785 op/s 2024-04-01T19:46:16.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:15 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:46:16.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:15 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4095163758' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:46:16.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:15 smithi188 ceph-mon[43939]: osdmap e502: 12 total, 12 up, 12 in 2024-04-01T19:46:16.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:15 smithi188 ceph-mon[43939]: pgmap v1384: 17 pgs: 2 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 14 active+clean; 9.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 49 MiB/s wr, 785 op/s 2024-04-01T19:46:16.376 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:46:16.381 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:46:16.402 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:16.423 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:46:16.425 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:16.426 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:46:16.523 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 84 16 152265 152249 113.271 45.1875 0.00887298 0.0088248 2024-04-01T19:46:16.526 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:46:16.553 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:16.572 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:46:16.574 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:16.574 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:46:16.675 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:46:16.727 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:16.812 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:46:16.818 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:16.818 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:46:16.919 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:46:16.954 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:17.412 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:46:17.421 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:17.422 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:46:17.523 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:46:17.524 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 85 16 152992 152976 112.473 45.4375 0.0327787 0.00888933 2024-04-01T19:46:17.549 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:17.570 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:46:17.577 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:17.578 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:46:17.679 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:46:17.725 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:17.777 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:46:17.782 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:17.782 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:46:17.883 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:46:17.949 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:18.094 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:46:18.095 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:46:18.105 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:18.105 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:46:18.149 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:46:18.192 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:46:18.205 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:18 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:46:18.205 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:18 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:46:18.205 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:18 smithi062 ceph-mon[44211]: osdmap e503: 12 total, 12 up, 12 in 2024-04-01T19:46:18.205 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:18 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:46:18.205 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:18 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:46:18.205 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:18 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:46:18.205 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:18 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:46:18.205 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:18 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:46:18.205 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:18 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:46:18.205 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:18 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:46:18.205 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:18 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4226413293' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:46:18.206 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:46:18.246 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:46:18.289 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:46:18.292 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:18 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:46:18.292 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:18 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:46:18.292 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:18 smithi022 ceph-mon[39439]: osdmap e503: 12 total, 12 up, 12 in 2024-04-01T19:46:18.293 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:18 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:46:18.293 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:18 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:46:18.293 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:18 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:46:18.293 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:18 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:46:18.293 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:18 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:46:18.293 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:18 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:46:18.293 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:18 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:46:18.293 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:18 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4226413293' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:46:18.294 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:18.329 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:46:18.332 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:18.332 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:46:18.332 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:46:18.367 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:46:18.370 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:46:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:18 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:46:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:18 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:46:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:18 smithi188 ceph-mon[43939]: osdmap e503: 12 total, 12 up, 12 in 2024-04-01T19:46:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:46:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:46:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:46:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:46:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:46:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:46:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:46:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:18 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4226413293' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:46:18.428 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:46:18.433 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:46:18.460 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:18.463 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:46:18.480 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:46:18.482 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:18.483 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:46:18.498 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:46:18.523 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 86 16 153711 153695 111.688 44.9375 0.0086966 0.00895192 2024-04-01T19:46:18.526 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:46:18.556 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:46:18.573 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:46:18.573 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:46:18.573 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:46:18.573 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:46:18.573 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:46:18.574 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:46:18.574 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:46:18.574 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:46:18.574 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:46:18.574 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:46:18.574 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:46:18.574 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:46:18.580 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:46:18.580 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:46:18.581 INFO:teuthology.orchestra.run.smithi062.stdout: "complaint_time": 30, 2024-04-01T19:46:18.581 INFO:teuthology.orchestra.run.smithi062.stdout: "num_blocked_ops": 0 2024-04-01T19:46:18.581 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:46:18.584 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:46:18.622 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:18.661 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:46:18.669 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:18.670 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:46:18.770 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:46:18.813 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:19.120 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.9 to 1 (10000) 2024-04-01T19:46:19.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:19 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/146683521' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T19:46:19.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:19 smithi022 ceph-mon[39439]: from='client.26368 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T19:46:19.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.364 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.364 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.364 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.364 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.364 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.364 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:19 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/146683521' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T19:46:19.364 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:19 smithi062 ceph-mon[44211]: from='client.26368 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T19:46:19.365 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.365 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.365 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.365 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.365 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.365 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:19 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/146683521' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T19:46:19.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:19 smithi188 ceph-mon[43939]: from='client.26368 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T19:46:19.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:19.411 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_historic_ops 2024-04-01T19:46:19.524 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 87 16 154471 154455 110.95 47.5 0.0150999 0.00901027 2024-04-01T19:46:19.858 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:46:20.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:20.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:20 smithi022 ceph-mon[39439]: from='client.26368 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]': finished 2024-04-01T19:46:20.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:20 smithi022 ceph-mon[39439]: osdmap e504: 12 total, 12 up, 12 in 2024-04-01T19:46:20.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:20 smithi022 ceph-mon[39439]: pgmap v1388: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 9.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 44 MiB/s wr, 706 op/s 2024-04-01T19:46:20.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:20.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:20 smithi188 ceph-mon[43939]: from='client.26368 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]': finished 2024-04-01T19:46:20.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:20 smithi188 ceph-mon[43939]: osdmap e504: 12 total, 12 up, 12 in 2024-04-01T19:46:20.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:20 smithi188 ceph-mon[43939]: pgmap v1388: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 9.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 44 MiB/s wr, 706 op/s 2024-04-01T19:46:20.452 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:20.452 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:20 smithi062 ceph-mon[44211]: from='client.26368 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]': finished 2024-04-01T19:46:20.452 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:20 smithi062 ceph-mon[44211]: osdmap e504: 12 total, 12 up, 12 in 2024-04-01T19:46:20.453 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:20 smithi062 ceph-mon[44211]: pgmap v1388: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 9.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 44 MiB/s wr, 706 op/s 2024-04-01T19:46:20.523 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 88 15 155252 155237 110.245 48.875 0.0306185 0.00906889 2024-04-01T19:46:20.681 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:46:20.685 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:20.685 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:46:20.786 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:46:20.812 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:20.833 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:46:20.836 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:20.836 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:46:20.937 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:46:20.976 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:21.238 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:21 smithi022 ceph-mon[39439]: pgmap v1389: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 9.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 50 MiB/s wr, 806 op/s 2024-04-01T19:46:21.445 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:46:21.488 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 10 1 2024-04-01T19:46:21.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:21 smithi062 ceph-mon[44211]: pgmap v1389: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 9.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 50 MiB/s wr, 806 op/s 2024-04-01T19:46:21.524 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 89 16 156007 155991 109.535 47.125 0.00596461 0.00912622 2024-04-01T19:46:21.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:21 smithi188 ceph-mon[43939]: pgmap v1389: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 9.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 50 MiB/s wr, 806 op/s 2024-04-01T19:46:21.830 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:46:21.836 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:21.836 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:46:21.937 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:46:22.016 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:22.047 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:46:22.050 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:22.050 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:46:22.070 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:46:22.070 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 20, 2024-04-01T19:46:22.070 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 600, 2024-04-01T19:46:22.070 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:46:22.070 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.070 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:120517 5.7 5:ef97052d:::benchmark_data_smithi188_119427_object120516:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e389)", 2024-04-01T19:46:22.070 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:40:26.421636+0000", 2024-04-01T19:46:22.070 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 355.64801450599998, 2024-04-01T19:46:22.071 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.079259860000000001, 2024-04-01T19:46:22.071 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:22.071 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:22.071 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:22.071 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:22.071 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:46:22.071 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:22.071 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 120517 2024-04-01T19:46:22.071 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.071 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:22.071 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.071 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:22.071 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.421636+0000", 2024-04-01T19:46:22.072 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.072 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.072 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.072 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:22.072 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.421636+0000", 2024-04-01T19:46:22.072 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.072 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.072 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.072 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:22.072 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.421637+0000", 2024-04-01T19:46:22.072 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8339999999999999e-06 2024-04-01T19:46:22.072 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.072 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.072 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:22.072 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.421694+0000", 2024-04-01T19:46:22.073 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6988999999999999e-05 2024-04-01T19:46:22.073 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.073 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.073 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:22.073 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.421705+0000", 2024-04-01T19:46:22.073 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0251999999999999e-05 2024-04-01T19:46:22.073 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.073 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.073 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:22.073 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.421712+0000", 2024-04-01T19:46:22.073 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9700000000000002e-06 2024-04-01T19:46:22.073 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.073 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.074 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:22.074 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.421770+0000", 2024-04-01T19:46:22.074 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8804999999999997e-05 2024-04-01T19:46:22.074 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.074 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.074 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:22.074 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.421860+0000", 2024-04-01T19:46:22.074 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.9697999999999994e-05 2024-04-01T19:46:22.074 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.074 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.074 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:46:22.074 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.421943+0000", 2024-04-01T19:46:22.074 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.2558999999999993e-05 2024-04-01T19:46:22.075 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.075 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.075 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:22.075 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.427815+0000", 2024-04-01T19:46:22.075 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0058719499999999999 2024-04-01T19:46:22.075 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.075 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.075 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:22.075 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.500789+0000", 2024-04-01T19:46:22.075 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.072973944999999998 2024-04-01T19:46:22.075 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.075 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.075 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:22.076 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.500847+0000", 2024-04-01T19:46:22.076 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8498999999999997e-05 2024-04-01T19:46:22.076 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.076 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.076 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:22.076 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.500895+0000", 2024-04-01T19:46:22.076 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8359000000000002e-05 2024-04-01T19:46:22.076 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.076 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:22.076 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.076 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.076 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.076 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:120518 5.7 5:e40dc134:::benchmark_data_smithi188_119427_object120517:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e389)", 2024-04-01T19:46:22.076 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:40:26.422449+0000", 2024-04-01T19:46:22.077 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 355.647201376, 2024-04-01T19:46:22.077 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.078557897000000002, 2024-04-01T19:46:22.077 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:22.077 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:22.077 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:22.077 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:22.077 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:46:22.077 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:22.077 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 120518 2024-04-01T19:46:22.077 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.077 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:22.077 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.077 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:22.077 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.422449+0000", 2024-04-01T19:46:22.077 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.078 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.078 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.078 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:22.078 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.422449+0000", 2024-04-01T19:46:22.078 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.078 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.078 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.078 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:22.078 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.422450+0000", 2024-04-01T19:46:22.078 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.195e-06 2024-04-01T19:46:22.078 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.078 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.078 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:22.079 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.422502+0000", 2024-04-01T19:46:22.079 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2491999999999998e-05 2024-04-01T19:46:22.079 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.079 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.079 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:22.079 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.422513+0000", 2024-04-01T19:46:22.079 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.03e-05 2024-04-01T19:46:22.079 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.079 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.079 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:22.079 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.422520+0000", 2024-04-01T19:46:22.079 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.973e-06 2024-04-01T19:46:22.079 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.079 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.080 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:22.080 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.424989+0000", 2024-04-01T19:46:22.080 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0024691790000000002 2024-04-01T19:46:22.080 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.080 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.080 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:22.080 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.425121+0000", 2024-04-01T19:46:22.080 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013183300000000001 2024-04-01T19:46:22.080 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.080 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.080 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:46:22.080 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.425210+0000", 2024-04-01T19:46:22.080 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.9760999999999997e-05 2024-04-01T19:46:22.080 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.081 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.081 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:22.081 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.427932+0000", 2024-04-01T19:46:22.081 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0027217109999999999 2024-04-01T19:46:22.081 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.081 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.081 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:22.081 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.500934+0000", 2024-04-01T19:46:22.081 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.073001939000000002 2024-04-01T19:46:22.081 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.081 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.081 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:22.081 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.500968+0000", 2024-04-01T19:46:22.081 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.3908999999999997e-05 2024-04-01T19:46:22.082 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.082 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.082 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:22.082 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.501007+0000", 2024-04-01T19:46:22.082 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8605000000000001e-05 2024-04-01T19:46:22.082 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.082 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:22.082 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.082 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.082 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.082 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.25864.0:238358 5.6 e438/364 5:60612565:::benchmark_data_smithi188_119427_object73659:head v 438'15093, mlcod=438'15090)", 2024-04-01T19:46:22.082 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:47.413911+0000", 2024-04-01T19:46:22.082 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 214.65573931099999, 2024-04-01T19:46:22.083 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.13093000299999999, 2024-04-01T19:46:22.083 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:22.083 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:22.083 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:22.083 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:22.083 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.083 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:22.083 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.413911+0000", 2024-04-01T19:46:22.083 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.083 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.083 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.083 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:22.083 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.413911+0000", 2024-04-01T19:46:22.083 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.083 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.084 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.084 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:22.084 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.413913+0000", 2024-04-01T19:46:22.084 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.852e-06 2024-04-01T19:46:22.084 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.084 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.084 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:22.084 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.413922+0000", 2024-04-01T19:46:22.084 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.8659999999999995e-06 2024-04-01T19:46:22.084 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.084 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.084 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:22.084 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467122+0000", 2024-04-01T19:46:22.085 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.053200787999999999 2024-04-01T19:46:22.085 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.085 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.085 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:22.085 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467138+0000", 2024-04-01T19:46:22.085 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.5279000000000001e-05 2024-04-01T19:46:22.085 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.085 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.085 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:22.085 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467585+0000", 2024-04-01T19:46:22.085 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00044708999999999998 2024-04-01T19:46:22.085 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.085 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.085 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:22.085 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467605+0000", 2024-04-01T19:46:22.086 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.0353999999999999e-05 2024-04-01T19:46:22.086 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.086 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.086 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:22.086 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.544808+0000", 2024-04-01T19:46:22.086 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.077202607000000006 2024-04-01T19:46:22.086 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.086 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.086 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:22.086 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.544841+0000", 2024-04-01T19:46:22.086 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.3167000000000003e-05 2024-04-01T19:46:22.086 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.086 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:22.087 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.087 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.087 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.087 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.25864.0:238387 5.6 e438/364 5:649b00d8:::benchmark_data_smithi188_119427_object73688:head v 438'15094, mlcod=438'15090)", 2024-04-01T19:46:22.087 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:47.467165+0000", 2024-04-01T19:46:22.087 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 214.60248469499999, 2024-04-01T19:46:22.087 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.077709005999999997, 2024-04-01T19:46:22.087 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:22.087 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:22.087 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:22.087 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:22.087 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.087 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:22.087 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467165+0000", 2024-04-01T19:46:22.088 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.088 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.088 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.088 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:22.088 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467165+0000", 2024-04-01T19:46:22.088 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.088 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.088 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.088 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:22.088 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467167+0000", 2024-04-01T19:46:22.088 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4810000000000001e-06 2024-04-01T19:46:22.088 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.088 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.088 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:22.088 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467178+0000", 2024-04-01T19:46:22.089 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1544e-05 2024-04-01T19:46:22.089 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.089 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.089 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:22.089 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467189+0000", 2024-04-01T19:46:22.089 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0249e-05 2024-04-01T19:46:22.089 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.089 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.089 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:22.089 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467195+0000", 2024-04-01T19:46:22.089 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8680000000000004e-06 2024-04-01T19:46:22.089 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.089 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.090 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:22.090 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.472561+0000", 2024-04-01T19:46:22.090 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0053665570000000001 2024-04-01T19:46:22.090 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.090 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.090 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:22.090 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.472580+0000", 2024-04-01T19:46:22.090 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.9096000000000001e-05 2024-04-01T19:46:22.090 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.090 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.090 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:22.090 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.544847+0000", 2024-04-01T19:46:22.090 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.072266833000000003 2024-04-01T19:46:22.090 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.091 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.091 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:22.091 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.544874+0000", 2024-04-01T19:46:22.091 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.7378000000000001e-05 2024-04-01T19:46:22.091 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.091 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:22.091 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.091 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.091 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.091 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.25864.0:238395 5.6 e438/364 5:61680e6d:::benchmark_data_smithi188_119427_object73696:head v 438'15095, mlcod=438'15090)", 2024-04-01T19:46:22.091 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:47.467234+0000", 2024-04-01T19:46:22.091 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 214.60241567, 2024-04-01T19:46:22.091 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.077683084999999999, 2024-04-01T19:46:22.091 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:22.092 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:22.092 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:22.092 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:22.092 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.092 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:22.092 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467234+0000", 2024-04-01T19:46:22.092 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.092 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.092 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.092 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:22.092 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467234+0000", 2024-04-01T19:46:22.092 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.092 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.092 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.093 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:22.093 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467235+0000", 2024-04-01T19:46:22.093 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.03e-07 2024-04-01T19:46:22.093 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.093 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.093 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:22.093 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467241+0000", 2024-04-01T19:46:22.093 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6860000000000003e-06 2024-04-01T19:46:22.093 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.093 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.093 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:22.093 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467246+0000", 2024-04-01T19:46:22.093 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1839999999999998e-06 2024-04-01T19:46:22.093 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.094 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.094 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:22.094 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467251+0000", 2024-04-01T19:46:22.094 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8600000000000001e-06 2024-04-01T19:46:22.094 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.094 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.094 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:22.094 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.476134+0000", 2024-04-01T19:46:22.094 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0088833990000000002 2024-04-01T19:46:22.094 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.094 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.094 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:22.094 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.476147+0000", 2024-04-01T19:46:22.095 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2660000000000001e-05 2024-04-01T19:46:22.095 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.095 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.095 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:22.095 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.544878+0000", 2024-04-01T19:46:22.095 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.068731617999999994 2024-04-01T19:46:22.095 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.095 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.095 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:22.095 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.544918+0000", 2024-04-01T19:46:22.095 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9274999999999999e-05 2024-04-01T19:46:22.095 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.095 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:22.095 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.096 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.096 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.096 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.25864.0:238414 5.6 e438/364 5:6a6fa109:::benchmark_data_smithi188_119427_object73715:head v 438'15096, mlcod=438'15090)", 2024-04-01T19:46:22.096 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:47.467258+0000", 2024-04-01T19:46:22.096 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 214.60239246800001, 2024-04-01T19:46:22.096 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.077686190000000002, 2024-04-01T19:46:22.096 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:22.096 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:22.096 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:22.096 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:22.096 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.096 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:22.096 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467258+0000", 2024-04-01T19:46:22.096 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.097 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.097 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.097 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:22.097 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467258+0000", 2024-04-01T19:46:22.097 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.097 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.097 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.097 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:22.097 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467258+0000", 2024-04-01T19:46:22.097 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8500000000000002e-07 2024-04-01T19:46:22.097 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.097 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.097 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:22.097 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467265+0000", 2024-04-01T19:46:22.098 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1570000000000003e-06 2024-04-01T19:46:22.098 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.098 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.098 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:22.098 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467270+0000", 2024-04-01T19:46:22.098 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.152e-06 2024-04-01T19:46:22.098 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.098 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.098 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:22.098 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467275+0000", 2024-04-01T19:46:22.098 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6500000000000004e-06 2024-04-01T19:46:22.098 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.099 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.099 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:22.099 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.536837+0000", 2024-04-01T19:46:22.099 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.069561548000000001 2024-04-01T19:46:22.099 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.099 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.099 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:22.099 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.536858+0000", 2024-04-01T19:46:22.099 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1401000000000001e-05 2024-04-01T19:46:22.099 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.099 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.099 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:22.099 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.544921+0000", 2024-04-01T19:46:22.100 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.008062909 2024-04-01T19:46:22.100 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.100 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.100 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:22.100 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.544944+0000", 2024-04-01T19:46:22.100 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.2988000000000001e-05 2024-04-01T19:46:22.100 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.100 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:22.100 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.100 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.100 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.100 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.25864.0:238416 5.6 e438/364 5:60d0857f:::benchmark_data_smithi188_119427_object73717:head v 438'15097, mlcod=438'15091)", 2024-04-01T19:46:22.100 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:47.469718+0000", 2024-04-01T19:46:22.100 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 214.59993214599999, 2024-04-01T19:46:22.101 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.075507342000000005, 2024-04-01T19:46:22.101 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:22.101 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:22.101 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:22.101 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:22.101 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.101 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:22.101 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.469718+0000", 2024-04-01T19:46:22.101 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.101 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.101 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.101 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:22.101 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.469718+0000", 2024-04-01T19:46:22.101 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.102 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.102 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.102 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:22.102 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.469719+0000", 2024-04-01T19:46:22.102 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3039999999999999e-06 2024-04-01T19:46:22.102 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.102 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.102 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:22.102 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.469725+0000", 2024-04-01T19:46:22.102 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6559999999999997e-06 2024-04-01T19:46:22.102 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.102 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.102 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:22.103 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.469732+0000", 2024-04-01T19:46:22.103 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6959999999999999e-06 2024-04-01T19:46:22.103 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.103 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.103 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:22.103 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.469737+0000", 2024-04-01T19:46:22.103 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2000000000000002e-06 2024-04-01T19:46:22.103 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.103 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.103 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:22.103 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.541197+0000", 2024-04-01T19:46:22.103 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.071460290999999995 2024-04-01T19:46:22.103 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.103 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.104 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:22.104 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.541210+0000", 2024-04-01T19:46:22.104 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.33e-05 2024-04-01T19:46:22.104 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.104 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.104 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:22.104 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.545203+0000", 2024-04-01T19:46:22.104 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0039923900000000002 2024-04-01T19:46:22.104 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.104 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.104 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:22.104 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.545225+0000", 2024-04-01T19:46:22.104 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.2504999999999999e-05 2024-04-01T19:46:22.104 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.104 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:22.105 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.105 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.105 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.105 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:311951 5.7 5:e3fab2b7:::benchmark_data_smithi188_119427_object147252:head [delete] snapc 0=[] ondisk+write+known_if_redirected e452)", 2024-04-01T19:46:22.105 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:43:55.040264+0000", 2024-04-01T19:46:22.105 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 147.02938638200001, 2024-04-01T19:46:22.105 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.080787656999999999, 2024-04-01T19:46:22.105 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:22.105 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:22.105 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:22.105 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:22.105 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:46:22.105 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:22.105 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 311951 2024-04-01T19:46:22.106 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.106 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:22.106 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.106 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:22.106 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.040264+0000", 2024-04-01T19:46:22.106 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.106 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.106 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.106 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:22.106 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.040264+0000", 2024-04-01T19:46:22.106 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.106 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.106 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.106 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:22.107 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.040265+0000", 2024-04-01T19:46:22.107 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4780000000000001e-06 2024-04-01T19:46:22.107 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.107 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.107 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:22.107 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.040270+0000", 2024-04-01T19:46:22.107 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.904e-06 2024-04-01T19:46:22.107 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.107 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.107 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:22.107 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.040280+0000", 2024-04-01T19:46:22.107 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.8840000000000006e-06 2024-04-01T19:46:22.107 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.107 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.108 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:22.108 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.040287+0000", 2024-04-01T19:46:22.108 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.2819999999999999e-06 2024-04-01T19:46:22.108 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.108 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.108 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:22.108 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.040338+0000", 2024-04-01T19:46:22.108 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0547999999999998e-05 2024-04-01T19:46:22.108 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.108 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.108 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:22.108 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.040439+0000", 2024-04-01T19:46:22.108 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000101202 2024-04-01T19:46:22.109 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.109 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.109 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:46:22.109 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.040510+0000", 2024-04-01T19:46:22.109 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1110000000000002e-05 2024-04-01T19:46:22.109 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.109 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.109 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:22.109 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.043839+0000", 2024-04-01T19:46:22.109 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.003329191 2024-04-01T19:46:22.109 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.109 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.109 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:22.109 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.120966+0000", 2024-04-01T19:46:22.110 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.077127128000000003 2024-04-01T19:46:22.110 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.110 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.110 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:22.110 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.121012+0000", 2024-04-01T19:46:22.110 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.5747000000000001e-05 2024-04-01T19:46:22.110 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.110 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.110 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:22.110 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.121051+0000", 2024-04-01T19:46:22.110 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9183000000000001e-05 2024-04-01T19:46:22.110 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.110 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:22.111 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.111 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.111 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.111 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:311954 5.7 5:e9622c0d:::benchmark_data_smithi188_119427_object147255:head [delete] snapc 0=[] ondisk+write+known_if_redirected e452)", 2024-04-01T19:46:22.113 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:43:55.043996+0000", 2024-04-01T19:46:22.113 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 147.025653791, 2024-04-01T19:46:22.113 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.078687093999999999, 2024-04-01T19:46:22.113 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:22.113 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:22.113 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:22.114 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:22.114 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:46:22.114 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:22.114 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 311954 2024-04-01T19:46:22.114 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.114 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:22.114 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.114 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:22.114 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.043996+0000", 2024-04-01T19:46:22.114 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.114 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.114 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.114 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:22.115 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.043996+0000", 2024-04-01T19:46:22.115 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.115 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.115 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.115 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:22.115 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.043998+0000", 2024-04-01T19:46:22.115 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.5510000000000001e-06 2024-04-01T19:46:22.115 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.115 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.116 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:22.116 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.044003+0000", 2024-04-01T19:46:22.116 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0340000000000004e-06 2024-04-01T19:46:22.116 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.116 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.116 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:22.116 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.044012+0000", 2024-04-01T19:46:22.116 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.2720000000000003e-06 2024-04-01T19:46:22.116 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.116 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.116 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:22.117 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.044020+0000", 2024-04-01T19:46:22.117 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.7980000000000006e-06 2024-04-01T19:46:22.117 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.117 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.117 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:22.117 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.044065+0000", 2024-04-01T19:46:22.117 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.5118999999999999e-05 2024-04-01T19:46:22.117 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.117 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.117 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:22.117 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.044141+0000", 2024-04-01T19:46:22.117 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.5661999999999995e-05 2024-04-01T19:46:22.117 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.118 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.118 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:46:22.118 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.044211+0000", 2024-04-01T19:46:22.118 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.0411000000000001e-05 2024-04-01T19:46:22.118 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.118 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.118 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:22.118 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.046957+0000", 2024-04-01T19:46:22.118 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.002745562 2024-04-01T19:46:22.118 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.118 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.118 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:22.118 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.122623+0000", 2024-04-01T19:46:22.118 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.075665925999999994 2024-04-01T19:46:22.119 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.119 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.119 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:22.119 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.122655+0000", 2024-04-01T19:46:22.119 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.2534999999999999e-05 2024-04-01T19:46:22.119 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.119 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.119 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:22.119 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.122683+0000", 2024-04-01T19:46:22.119 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8223999999999999e-05 2024-04-01T19:46:22.119 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.119 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:22.119 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.119 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.119 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.120 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:311962 5.7 5:ee9ae062:::benchmark_data_smithi188_119427_object147263:head [delete] snapc 0=[] ondisk+write+known_if_redirected e452)", 2024-04-01T19:46:22.120 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:43:55.052043+0000", 2024-04-01T19:46:22.120 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 147.01760687399999, 2024-04-01T19:46:22.120 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.075609932000000005, 2024-04-01T19:46:22.120 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:22.120 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:22.120 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:22.120 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:22.120 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:46:22.120 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:22.120 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 311962 2024-04-01T19:46:22.120 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.120 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:22.120 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.120 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:22.121 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.052043+0000", 2024-04-01T19:46:22.121 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.121 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.121 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.121 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:22.121 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.052043+0000", 2024-04-01T19:46:22.121 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.121 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.121 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.121 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:22.121 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.052044+0000", 2024-04-01T19:46:22.121 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.266e-06 2024-04-01T19:46:22.121 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.121 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.121 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:22.122 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.052049+0000", 2024-04-01T19:46:22.122 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3549999999999998e-06 2024-04-01T19:46:22.122 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.122 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.122 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:22.122 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.052059+0000", 2024-04-01T19:46:22.122 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.049e-05 2024-04-01T19:46:22.122 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.122 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.122 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:22.122 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.052068+0000", 2024-04-01T19:46:22.122 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.1629999999999996e-06 2024-04-01T19:46:22.122 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.122 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.123 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:22.123 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.052136+0000", 2024-04-01T19:46:22.123 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8083000000000005e-05 2024-04-01T19:46:22.123 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.123 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.123 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:22.123 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.052215+0000", 2024-04-01T19:46:22.123 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9781000000000001e-05 2024-04-01T19:46:22.123 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.123 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.123 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:46:22.123 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.052283+0000", 2024-04-01T19:46:22.123 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.7727999999999999e-05 2024-04-01T19:46:22.123 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.123 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.124 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:22.124 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.057376+0000", 2024-04-01T19:46:22.124 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0050930769999999997 2024-04-01T19:46:22.124 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.124 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.124 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:22.124 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.127592+0000", 2024-04-01T19:46:22.124 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.070215925999999998 2024-04-01T19:46:22.124 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.124 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.124 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:22.124 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.127624+0000", 2024-04-01T19:46:22.124 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.1733999999999998e-05 2024-04-01T19:46:22.124 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.125 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.125 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:22.125 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.127653+0000", 2024-04-01T19:46:22.125 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.9329e-05 2024-04-01T19:46:22.125 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.125 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:22.125 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.125 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.125 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.125 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:311965 5.7 5:e457cdf6:::benchmark_data_smithi188_119427_object147266:head [delete] snapc 0=[] ondisk+write+known_if_redirected e452)", 2024-04-01T19:46:22.125 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:43:55.052117+0000", 2024-04-01T19:46:22.125 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 147.01753348400001, 2024-04-01T19:46:22.125 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.075638596000000002, 2024-04-01T19:46:22.125 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:22.125 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:22.126 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:22.126 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:22.126 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:46:22.126 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:22.126 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 311965 2024-04-01T19:46:22.126 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.126 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:22.126 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.126 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:22.126 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.052117+0000", 2024-04-01T19:46:22.126 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.126 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.126 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.126 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:22.126 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.052117+0000", 2024-04-01T19:46:22.127 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.127 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.127 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.127 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:22.127 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.052118+0000", 2024-04-01T19:46:22.127 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.141e-06 2024-04-01T19:46:22.127 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.127 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.127 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:22.127 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.052121+0000", 2024-04-01T19:46:22.127 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.45e-06 2024-04-01T19:46:22.127 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.127 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.127 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:22.127 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.052138+0000", 2024-04-01T19:46:22.128 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.6796999999999999e-05 2024-04-01T19:46:22.128 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.128 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.128 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:22.128 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.052145+0000", 2024-04-01T19:46:22.128 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.2679999999999997e-06 2024-04-01T19:46:22.128 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.128 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.128 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:22.128 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.054528+0000", 2024-04-01T19:46:22.128 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0023822409999999998 2024-04-01T19:46:22.128 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.128 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.128 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:22.128 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.054599+0000", 2024-04-01T19:46:22.129 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1104000000000002e-05 2024-04-01T19:46:22.129 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.129 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.129 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:46:22.129 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.054669+0000", 2024-04-01T19:46:22.129 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.0438999999999994e-05 2024-04-01T19:46:22.129 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.129 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.129 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:22.129 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.057565+0000", 2024-04-01T19:46:22.129 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0028959300000000001 2024-04-01T19:46:22.129 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.129 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.129 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:22.129 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.127691+0000", 2024-04-01T19:46:22.130 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.070125582000000006 2024-04-01T19:46:22.130 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.130 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.130 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:22.130 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.127728+0000", 2024-04-01T19:46:22.130 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.7311000000000002e-05 2024-04-01T19:46:22.130 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.130 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.130 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:22.130 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.127755+0000", 2024-04-01T19:46:22.130 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.7333000000000001e-05 2024-04-01T19:46:22.130 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.130 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:22.130 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.131 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.131 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.131 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:311982 5.7 5:e782abfc:::benchmark_data_smithi188_119427_object147283:head [delete] snapc 0=[] ondisk+write+known_if_redirected e452)", 2024-04-01T19:46:22.131 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:43:55.075788+0000", 2024-04-01T19:46:22.131 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 146.993861608, 2024-04-01T19:46:22.131 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.052066544999999999, 2024-04-01T19:46:22.131 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:22.131 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:22.131 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:22.131 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:22.131 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:46:22.131 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:22.131 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 311982 2024-04-01T19:46:22.131 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.131 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:22.131 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.132 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:22.132 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.075788+0000", 2024-04-01T19:46:22.132 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.132 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.132 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.132 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:22.132 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.075788+0000", 2024-04-01T19:46:22.132 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.132 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.132 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.132 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:22.132 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.075791+0000", 2024-04-01T19:46:22.132 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.5409999999999999e-06 2024-04-01T19:46:22.132 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.132 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.133 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:22.133 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.075798+0000", 2024-04-01T19:46:22.133 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.562e-06 2024-04-01T19:46:22.133 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.133 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.133 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:22.133 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.075811+0000", 2024-04-01T19:46:22.133 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.348e-05 2024-04-01T19:46:22.133 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.133 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.133 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:22.133 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.075819+0000", 2024-04-01T19:46:22.133 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0800000000000006e-06 2024-04-01T19:46:22.133 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.133 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.133 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:22.134 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.075886+0000", 2024-04-01T19:46:22.134 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6987000000000001e-05 2024-04-01T19:46:22.134 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.134 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.134 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:22.134 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.076030+0000", 2024-04-01T19:46:22.134 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014374099999999999 2024-04-01T19:46:22.134 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.134 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.134 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:46:22.134 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.076164+0000", 2024-04-01T19:46:22.134 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013362199999999999 2024-04-01T19:46:22.134 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.134 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.135 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:22.135 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.080077+0000", 2024-04-01T19:46:22.135 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0039133520000000001 2024-04-01T19:46:22.135 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.135 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.135 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:22.135 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.127799+0000", 2024-04-01T19:46:22.135 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.047722104000000001 2024-04-01T19:46:22.135 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.135 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.135 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:22.135 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.127829+0000", 2024-04-01T19:46:22.135 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.0287999999999999e-05 2024-04-01T19:46:22.135 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.136 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.136 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:22.136 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.127855+0000", 2024-04-01T19:46:22.136 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.5788000000000001e-05 2024-04-01T19:46:22.136 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.136 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:22.136 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.136 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.136 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.136 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:98778 6.a 6:5e5371e3:::benchmark_data_smithi188_134454_object98777:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e489)", 2024-04-01T19:46:22.136 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:45:31.819859+0000", 2024-04-01T19:46:22.136 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 50.249791379000001, 2024-04-01T19:46:22.136 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.056931417999999998, 2024-04-01T19:46:22.136 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:22.136 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:22.136 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:22.137 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:22.137 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:46:22.137 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:46:22.137 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 98778 2024-04-01T19:46:22.137 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.137 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:22.137 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.137 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:22.137 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:31.819859+0000", 2024-04-01T19:46:22.137 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.137 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.137 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.137 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:22.137 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:31.819859+0000", 2024-04-01T19:46:22.137 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.137 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.138 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.138 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:22.138 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:31.819860+0000", 2024-04-01T19:46:22.138 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.5799999999999999e-06 2024-04-01T19:46:22.138 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.138 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.138 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:22.138 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:31.819915+0000", 2024-04-01T19:46:22.138 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5132e-05 2024-04-01T19:46:22.138 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.138 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.138 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:22.138 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:31.862398+0000", 2024-04-01T19:46:22.139 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.042482384999999998 2024-04-01T19:46:22.139 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.139 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.139 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:22.139 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:31.862441+0000", 2024-04-01T19:46:22.139 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3383000000000001e-05 2024-04-01T19:46:22.139 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.139 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.139 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:22.139 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:31.862863+0000", 2024-04-01T19:46:22.139 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00042133200000000001 2024-04-01T19:46:22.139 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.139 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.139 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:22.139 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:31.863005+0000", 2024-04-01T19:46:22.139 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0001429 2024-04-01T19:46:22.140 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.140 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.140 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 6", 2024-04-01T19:46:22.140 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:31.863141+0000", 2024-04-01T19:46:22.140 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000135227 2024-04-01T19:46:22.140 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.140 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.140 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:22.140 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:31.872427+0000", 2024-04-01T19:46:22.140 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0092862810000000004 2024-04-01T19:46:22.140 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.140 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.140 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:22.140 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:31.876679+0000", 2024-04-01T19:46:22.140 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0042517220000000003 2024-04-01T19:46:22.140 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.141 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.141 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:22.141 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:31.876735+0000", 2024-04-01T19:46:22.141 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5838000000000003e-05 2024-04-01T19:46:22.141 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.141 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.141 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:22.141 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:31.876790+0000", 2024-04-01T19:46:22.141 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5637999999999998e-05 2024-04-01T19:46:22.141 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.141 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:22.141 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.141 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.141 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.141 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:125127 6.d 6:b23c7065:::benchmark_data_smithi188_134454_object125126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e495)", 2024-04-01T19:46:22.142 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:45:49.911809+0000", 2024-04-01T19:46:22.142 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 32.157840833999998, 2024-04-01T19:46:22.142 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.115293847, 2024-04-01T19:46:22.142 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:22.142 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:22.142 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:22.142 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:22.142 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:46:22.142 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:46:22.142 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 125127 2024-04-01T19:46:22.142 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.142 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:22.142 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.143 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:22.143 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.911809+0000", 2024-04-01T19:46:22.143 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.143 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.143 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.143 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:22.143 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.911809+0000", 2024-04-01T19:46:22.143 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.143 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.143 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.143 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:22.143 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.911810+0000", 2024-04-01T19:46:22.143 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.052e-06 2024-04-01T19:46:22.143 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.143 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.143 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:22.144 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.911873+0000", 2024-04-01T19:46:22.144 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3079999999999999e-05 2024-04-01T19:46:22.144 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.144 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.144 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:22.144 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.911882+0000", 2024-04-01T19:46:22.144 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.2560000000000002e-06 2024-04-01T19:46:22.144 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.144 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.144 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:22.144 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.911888+0000", 2024-04-01T19:46:22.144 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3620000000000002e-06 2024-04-01T19:46:22.144 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.144 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.144 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:22.145 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.912407+0000", 2024-04-01T19:46:22.145 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00051866499999999997 2024-04-01T19:46:22.145 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.145 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.145 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:22.145 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.912527+0000", 2024-04-01T19:46:22.145 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000120356 2024-04-01T19:46:22.145 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.145 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.145 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:46:22.145 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.912671+0000", 2024-04-01T19:46:22.145 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014441000000000001 2024-04-01T19:46:22.145 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.145 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.145 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:22.145 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.919403+0000", 2024-04-01T19:46:22.146 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.006731725 2024-04-01T19:46:22.146 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.146 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.146 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:22.146 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:50.027006+0000", 2024-04-01T19:46:22.146 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.10760328 2024-04-01T19:46:22.146 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.146 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.146 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:22.146 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:50.027051+0000", 2024-04-01T19:46:22.146 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.4579000000000001e-05 2024-04-01T19:46:22.146 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.146 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.146 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:22.147 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:50.027103+0000", 2024-04-01T19:46:22.147 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2082e-05 2024-04-01T19:46:22.147 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.147 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:22.147 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.147 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.147 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.147 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:125172 6.d 6:ba0a2c8e:::benchmark_data_smithi188_134454_object125171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e495)", 2024-04-01T19:46:22.147 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:45:49.948279+0000", 2024-04-01T19:46:22.147 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 32.121371291000003, 2024-04-01T19:46:22.147 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.090519042999999993, 2024-04-01T19:46:22.147 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:22.147 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:22.147 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:22.147 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:22.148 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:46:22.148 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:46:22.148 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 125172 2024-04-01T19:46:22.148 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.148 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:22.148 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.148 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:22.148 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.948279+0000", 2024-04-01T19:46:22.148 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.148 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.148 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.148 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:22.148 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.948279+0000", 2024-04-01T19:46:22.148 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.148 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.148 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.149 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:22.149 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.948280+0000", 2024-04-01T19:46:22.149 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2419999999999999e-06 2024-04-01T19:46:22.149 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.149 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.149 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:22.149 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.948356+0000", 2024-04-01T19:46:22.149 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.6110000000000001e-05 2024-04-01T19:46:22.149 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.149 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.149 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:22.149 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.948365+0000", 2024-04-01T19:46:22.149 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.8049999999999996e-06 2024-04-01T19:46:22.149 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.149 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.150 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:22.150 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.948371+0000", 2024-04-01T19:46:22.150 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.9529999999999996e-06 2024-04-01T19:46:22.150 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.150 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.150 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:22.150 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.948424+0000", 2024-04-01T19:46:22.150 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3517000000000003e-05 2024-04-01T19:46:22.150 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.150 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.150 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:22.150 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.948547+0000", 2024-04-01T19:46:22.150 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012278300000000001 2024-04-01T19:46:22.150 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.150 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.151 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:46:22.151 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.948686+0000", 2024-04-01T19:46:22.151 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013873100000000001 2024-04-01T19:46:22.151 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.151 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.151 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:22.151 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.952358+0000", 2024-04-01T19:46:22.151 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0036716700000000001 2024-04-01T19:46:22.151 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.151 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.151 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:22.151 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:50.038645+0000", 2024-04-01T19:46:22.151 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.086287612999999999 2024-04-01T19:46:22.151 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.151 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.151 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:22.152 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:50.038706+0000", 2024-04-01T19:46:22.152 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.0739999999999998e-05 2024-04-01T19:46:22.152 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.152 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.152 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:22.152 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:50.038798+0000", 2024-04-01T19:46:22.152 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1879000000000006e-05 2024-04-01T19:46:22.152 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.152 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:22.152 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.152 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.152 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.152 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:125179 6.d 6:b6d52c40:::benchmark_data_smithi188_134454_object125178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e495)", 2024-04-01T19:46:22.152 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:45:49.955096+0000", 2024-04-01T19:46:22.152 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 32.114554431999998, 2024-04-01T19:46:22.152 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.083830537999999996, 2024-04-01T19:46:22.153 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:22.153 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:22.153 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:22.153 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:22.153 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:46:22.153 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:46:22.153 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 125179 2024-04-01T19:46:22.153 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.153 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:22.153 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.153 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:22.153 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.955096+0000", 2024-04-01T19:46:22.153 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.153 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.153 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.154 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:22.154 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.955096+0000", 2024-04-01T19:46:22.154 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.154 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.154 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.154 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:22.154 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.955097+0000", 2024-04-01T19:46:22.154 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.7460000000000001e-06 2024-04-01T19:46:22.154 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.154 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.154 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:22.154 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.955158+0000", 2024-04-01T19:46:22.154 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.0927000000000001e-05 2024-04-01T19:46:22.154 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.154 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.155 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:22.155 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.955169+0000", 2024-04-01T19:46:22.155 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0404000000000001e-05 2024-04-01T19:46:22.155 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.155 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.155 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:22.155 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.955177+0000", 2024-04-01T19:46:22.155 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.388e-06 2024-04-01T19:46:22.155 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.155 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.155 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:22.155 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.955222+0000", 2024-04-01T19:46:22.155 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.5113e-05 2024-04-01T19:46:22.155 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.155 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.156 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:22.156 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.955324+0000", 2024-04-01T19:46:22.156 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000101418 2024-04-01T19:46:22.156 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.156 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.156 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:46:22.156 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.955430+0000", 2024-04-01T19:46:22.156 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000106827 2024-04-01T19:46:22.156 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.156 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.156 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:22.156 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.958520+0000", 2024-04-01T19:46:22.156 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0030895789999999998 2024-04-01T19:46:22.156 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.156 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.157 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:22.157 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:50.038850+0000", 2024-04-01T19:46:22.157 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.080330029999999997 2024-04-01T19:46:22.157 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.157 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.157 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:22.157 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:50.038884+0000", 2024-04-01T19:46:22.157 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.4350000000000001e-05 2024-04-01T19:46:22.157 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.157 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.157 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:22.157 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:50.038926+0000", 2024-04-01T19:46:22.158 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.1755999999999998e-05 2024-04-01T19:46:22.158 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.158 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:22.158 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.158 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.158 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.158 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:125184 6.d 6:b312b029:::benchmark_data_smithi188_134454_object125183:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e495)", 2024-04-01T19:46:22.158 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:45:49.962697+0000", 2024-04-01T19:46:22.158 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 32.106953329, 2024-04-01T19:46:22.158 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.076376840000000001, 2024-04-01T19:46:22.158 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:22.158 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:22.158 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:22.159 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:22.159 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:46:22.159 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:46:22.159 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 125184 2024-04-01T19:46:22.159 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.159 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:22.159 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.159 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:22.159 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.962697+0000", 2024-04-01T19:46:22.159 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.159 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.159 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.159 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:22.159 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.962697+0000", 2024-04-01T19:46:22.159 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.160 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.160 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.160 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:22.160 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.962699+0000", 2024-04-01T19:46:22.160 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3949999999999999e-06 2024-04-01T19:46:22.160 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.160 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.160 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:22.160 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.962740+0000", 2024-04-01T19:46:22.160 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0611000000000001e-05 2024-04-01T19:46:22.160 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.160 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.160 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:22.160 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.962753+0000", 2024-04-01T19:46:22.160 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2801e-05 2024-04-01T19:46:22.161 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.161 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.161 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:22.161 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.962773+0000", 2024-04-01T19:46:22.161 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.0749000000000001e-05 2024-04-01T19:46:22.161 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.161 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.161 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:22.161 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.962820+0000", 2024-04-01T19:46:22.161 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6322000000000001e-05 2024-04-01T19:46:22.161 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.161 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.161 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:22.161 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.962937+0000", 2024-04-01T19:46:22.162 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00011704700000000001 2024-04-01T19:46:22.162 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.162 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.162 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:46:22.162 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.963044+0000", 2024-04-01T19:46:22.162 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000107518 2024-04-01T19:46:22.162 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.162 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.162 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:22.162 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.965990+0000", 2024-04-01T19:46:22.162 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0029456719999999999 2024-04-01T19:46:22.162 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.162 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.162 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:22.162 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:50.038969+0000", 2024-04-01T19:46:22.162 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.072979506 2024-04-01T19:46:22.163 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.163 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.163 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:22.163 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:50.039023+0000", 2024-04-01T19:46:22.163 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3825000000000001e-05 2024-04-01T19:46:22.163 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.163 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.163 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:22.163 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:50.039074+0000", 2024-04-01T19:46:22.163 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0393999999999999e-05 2024-04-01T19:46:22.163 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.163 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:22.163 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.163 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.163 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.163 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:130281 6.7 6:e25ed305:::benchmark_data_smithi188_134454_object130280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e496)", 2024-04-01T19:46:22.164 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:45:54.177856+0000", 2024-04-01T19:46:22.164 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 27.891793742000001, 2024-04-01T19:46:22.164 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.050587658000000001, 2024-04-01T19:46:22.164 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:22.164 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:22.164 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:22.164 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:22.164 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:46:22.164 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:46:22.164 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 130281 2024-04-01T19:46:22.164 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.164 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:22.164 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.164 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:22.164 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:54.177856+0000", 2024-04-01T19:46:22.164 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.165 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.165 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.165 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:22.165 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:54.177856+0000", 2024-04-01T19:46:22.165 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.165 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.165 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.165 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:22.165 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:54.177858+0000", 2024-04-01T19:46:22.165 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8500000000000001e-06 2024-04-01T19:46:22.165 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.165 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.165 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:22.165 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:54.177914+0000", 2024-04-01T19:46:22.165 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6124e-05 2024-04-01T19:46:22.165 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.166 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.166 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:22.166 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:54.177925+0000", 2024-04-01T19:46:22.166 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0217000000000001e-05 2024-04-01T19:46:22.166 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.166 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.166 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:22.166 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:54.177930+0000", 2024-04-01T19:46:22.166 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.9120000000000003e-06 2024-04-01T19:46:22.166 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.166 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.166 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:22.166 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:54.177984+0000", 2024-04-01T19:46:22.166 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3443000000000003e-05 2024-04-01T19:46:22.166 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.167 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.167 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:22.167 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:54.178127+0000", 2024-04-01T19:46:22.167 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000143275 2024-04-01T19:46:22.167 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.167 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.167 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:46:22.167 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:54.178262+0000", 2024-04-01T19:46:22.167 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013497800000000001 2024-04-01T19:46:22.167 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.167 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.167 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:22.167 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:54.182108+0000", 2024-04-01T19:46:22.167 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0038462700000000002 2024-04-01T19:46:22.167 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.168 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.168 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:22.168 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:54.228373+0000", 2024-04-01T19:46:22.168 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.046264767999999998 2024-04-01T19:46:22.168 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.168 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.168 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:22.168 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:54.228414+0000", 2024-04-01T19:46:22.168 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.1017999999999999e-05 2024-04-01T19:46:22.168 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.168 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.168 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:22.168 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:54.228444+0000", 2024-04-01T19:46:22.168 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.9802999999999999e-05 2024-04-01T19:46:22.168 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.168 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:22.169 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.169 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.169 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.169 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:134124 6.7 6:e3da2e0c:::benchmark_data_smithi188_134454_object134123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e498)", 2024-04-01T19:46:22.169 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:45:57.272418+0000", 2024-04-01T19:46:22.169 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 24.797231939, 2024-04-01T19:46:22.169 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.063803555999999997, 2024-04-01T19:46:22.169 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:22.169 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:22.169 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:22.169 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:22.169 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:46:22.169 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:46:22.169 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 134124 2024-04-01T19:46:22.169 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.169 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:22.170 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.170 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:22.170 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:57.272418+0000", 2024-04-01T19:46:22.170 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.170 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.170 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.170 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:22.170 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:57.272418+0000", 2024-04-01T19:46:22.170 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.170 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.170 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.170 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:22.170 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:57.272420+0000", 2024-04-01T19:46:22.170 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.437e-06 2024-04-01T19:46:22.170 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.171 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.171 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:22.171 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:57.272473+0000", 2024-04-01T19:46:22.171 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3845999999999999e-05 2024-04-01T19:46:22.171 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.171 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.171 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:22.171 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:57.272485+0000", 2024-04-01T19:46:22.171 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1491999999999999e-05 2024-04-01T19:46:22.171 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.171 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.171 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:22.171 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:57.272493+0000", 2024-04-01T19:46:22.171 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.7559999999999999e-06 2024-04-01T19:46:22.171 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.172 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.172 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:22.172 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:57.275330+0000", 2024-04-01T19:46:22.172 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0028372240000000002 2024-04-01T19:46:22.172 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.172 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.172 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:22.172 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:57.275455+0000", 2024-04-01T19:46:22.172 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012461699999999999 2024-04-01T19:46:22.172 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.172 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.172 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:46:22.172 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:57.275568+0000", 2024-04-01T19:46:22.172 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00011301100000000001 2024-04-01T19:46:22.172 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.172 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.173 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:22.173 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:57.280931+0000", 2024-04-01T19:46:22.173 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.005363011 2024-04-01T19:46:22.173 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.173 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.173 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:22.173 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:57.336133+0000", 2024-04-01T19:46:22.173 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.055202372 2024-04-01T19:46:22.173 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.173 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.173 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:22.173 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:57.336185+0000", 2024-04-01T19:46:22.173 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1745e-05 2024-04-01T19:46:22.173 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.173 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.173 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:22.174 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:57.336222+0000", 2024-04-01T19:46:22.174 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.7045000000000002e-05 2024-04-01T19:46:22.174 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.174 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:22.174 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.174 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.174 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.174 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:143126 6.d 6:bc5fa7ad:::benchmark_data_smithi188_134454_object143125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e499)", 2024-04-01T19:46:22.174 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:46:04.779157+0000", 2024-04-01T19:46:22.174 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 17.290492725, 2024-04-01T19:46:22.174 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.050537863000000002, 2024-04-01T19:46:22.174 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:22.174 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:22.174 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:22.174 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:22.175 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:46:22.175 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:46:22.175 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 143126 2024-04-01T19:46:22.175 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.175 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:22.175 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.175 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:22.175 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:04.779157+0000", 2024-04-01T19:46:22.175 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.175 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.175 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.175 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:22.175 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:04.779157+0000", 2024-04-01T19:46:22.175 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:22.175 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.176 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.176 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:22.176 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:04.779159+0000", 2024-04-01T19:46:22.176 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2750000000000001e-06 2024-04-01T19:46:22.176 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.176 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.176 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:22.176 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:04.779212+0000", 2024-04-01T19:46:22.176 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3350999999999998e-05 2024-04-01T19:46:22.176 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.176 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.176 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:22.176 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:04.779218+0000", 2024-04-01T19:46:22.176 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.37e-06 2024-04-01T19:46:22.176 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.176 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.177 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:22.177 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:04.779223+0000", 2024-04-01T19:46:22.177 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7090000000000001e-06 2024-04-01T19:46:22.177 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.177 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.177 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:22.177 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:04.779264+0000", 2024-04-01T19:46:22.177 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.1248000000000002e-05 2024-04-01T19:46:22.177 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.177 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.177 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:22.177 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:04.779385+0000", 2024-04-01T19:46:22.177 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012036000000000001 2024-04-01T19:46:22.177 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.177 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.177 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:46:22.177 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:04.779513+0000", 2024-04-01T19:46:22.178 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012839200000000001 2024-04-01T19:46:22.178 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.178 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.178 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:22.178 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:04.787959+0000", 2024-04-01T19:46:22.178 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0084462259999999994 2024-04-01T19:46:22.178 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.178 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.178 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:22.178 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:04.829614+0000", 2024-04-01T19:46:22.178 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.041654332000000002 2024-04-01T19:46:22.178 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.178 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.178 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:22.178 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:04.829656+0000", 2024-04-01T19:46:22.179 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.2533000000000001e-05 2024-04-01T19:46:22.179 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:22.179 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:22.179 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:22.179 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:04.829695+0000", 2024-04-01T19:46:22.179 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9066999999999997e-05 2024-04-01T19:46:22.179 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.179 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:22.179 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.179 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:22.179 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:22.179 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:46:22.179 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:46:22.206 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:22.225 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:46:22.227 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:22.228 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:46:22.328 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:46:22.373 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:22.435 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:46:22.524 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 90 15 156738 156723 108.827 45.75 0.00786939 0.0091867 2024-04-01T19:46:22.710 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:46:23.233 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:23 smithi022 ceph-mon[39439]: pgmap v1390: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 9.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 48 MiB/s wr, 762 op/s 2024-04-01T19:46:23.242 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:46:23.249 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:23.249 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:46:23.275 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_ops_in_flight 2024-04-01T19:46:23.350 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:46:23.388 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:23.414 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:46:23.419 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:23.419 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:46:23.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:23 smithi062 ceph-mon[44211]: pgmap v1390: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 9.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 48 MiB/s wr, 762 op/s 2024-04-01T19:46:23.520 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:46:23.524 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Total time run: 90.0733 2024-04-01T19:46:23.524 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Total writes made: 156738 2024-04-01T19:46:23.524 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Write size: 65536 2024-04-01T19:46:23.524 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Object size: 65536 2024-04-01T19:46:23.524 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Bandwidth (MB/sec): 108.757 2024-04-01T19:46:23.524 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Stddev Bandwidth: 58.0847 2024-04-01T19:46:23.524 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Max bandwidth (MB/sec): 322.5 2024-04-01T19:46:23.524 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Min bandwidth (MB/sec): 36.9375 2024-04-01T19:46:23.524 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Average IOPS: 1740 2024-04-01T19:46:23.524 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Stddev IOPS: 929.355 2024-04-01T19:46:23.525 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Max IOPS: 5160 2024-04-01T19:46:23.525 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Min IOPS: 591 2024-04-01T19:46:23.525 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Average Latency(s): 0.00919166 2024-04-01T19:46:23.525 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Stddev Latency(s): 0.0107254 2024-04-01T19:46:23.525 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Max latency(s): 0.371537 2024-04-01T19:46:23.525 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Min latency(s): 0.000949379 2024-04-01T19:46:23.531 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Cleaning up (deleting benchmark objects) 2024-04-01T19:46:23.572 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:23.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:23 smithi188 ceph-mon[43939]: pgmap v1390: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 9.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 48 MiB/s wr, 762 op/s 2024-04-01T19:46:23.703 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:46:23.727 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:46:23.733 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:23.733 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:46:23.834 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:46:23.880 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:24.019 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:46:24.024 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:24.025 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:46:24.126 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:46:24.174 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:24.292 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:46:24.294 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:24.294 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:46:24.395 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:46:24.436 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:24.904 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:46:24.909 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:24.909 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:46:25.010 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:46:25.056 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:25.221 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:46:25.230 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:25.230 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:46:25.236 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:46:25.331 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:46:25.378 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:25.472 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:46:25.481 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:25.481 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:25 smithi022 ceph-mon[39439]: pgmap v1391: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 9.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 MiB/s wr, 659 op/s 2024-04-01T19:46:25.482 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:46:25.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:25 smithi062 ceph-mon[44211]: pgmap v1391: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 9.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 MiB/s wr, 659 op/s 2024-04-01T19:46:25.583 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:46:25.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:25 smithi188 ceph-mon[43939]: pgmap v1391: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 9.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 MiB/s wr, 659 op/s 2024-04-01T19:46:25.630 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:25.916 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:46:25.916 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:46:25.916 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:25.916 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:158516 6.5 6:ae79f38f:::benchmark_data_smithi188_134454_object1775:head [delete] snapc 0=[] ondisk+write+known_if_redirected e504)", 2024-04-01T19:46:25.916 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:46:25.897598+0000", 2024-04-01T19:46:25.916 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0048985030000000002, 2024-04-01T19:46:25.916 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.004932858, 2024-04-01T19:46:25.916 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:25.916 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:25.917 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:46:25.917 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:25.917 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:46:25.917 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:46:25.917 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 158516 2024-04-01T19:46:25.917 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:25.917 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:25.917 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:25.917 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:25.917 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.897598+0000", 2024-04-01T19:46:25.917 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:25.917 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:25.917 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:25.917 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:25.917 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.897598+0000", 2024-04-01T19:46:25.918 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:25.918 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:25.918 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:25.918 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:25.918 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.897600+0000", 2024-04-01T19:46:25.918 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.6259999999999999e-06 2024-04-01T19:46:25.918 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:25.918 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:25.918 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:25.918 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.897609+0000", 2024-04-01T19:46:25.918 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.2150000000000001e-06 2024-04-01T19:46:25.918 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:25.918 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:25.918 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:25.918 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.897626+0000", 2024-04-01T19:46:25.919 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.7028999999999999e-05 2024-04-01T19:46:25.919 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:25.919 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:25.919 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:25.919 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.897637+0000", 2024-04-01T19:46:25.919 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.13e-05 2024-04-01T19:46:25.919 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:25.919 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:25.919 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:25.919 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.897705+0000", 2024-04-01T19:46:25.919 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8034000000000006e-05 2024-04-01T19:46:25.919 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:25.919 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:25.919 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:25.919 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.897865+0000", 2024-04-01T19:46:25.920 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00016022599999999999 2024-04-01T19:46:25.920 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:25.920 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:25.920 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 6", 2024-04-01T19:46:25.920 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.897994+0000", 2024-04-01T19:46:25.920 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012906699999999999 2024-04-01T19:46:25.920 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:25.920 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:25.920 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:25.920 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:25.920 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-04-01T19:46:25.920 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 1 2024-04-01T19:46:25.920 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:46:26.306 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:46:26.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:26 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:46:26.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:26 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:46:26.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:26 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3754570649' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:46:26.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:26 smithi022 ceph-mon[39439]: from='client.36452 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:46:26.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:26 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:46:26.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:26 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:46:26.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:26 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3754570649' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:46:26.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:26 smithi188 ceph-mon[43939]: from='client.36452 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:46:26.699 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:26 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:46:26.699 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:26 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:46:26.699 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:26 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3754570649' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:46:26.700 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:26 smithi062 ceph-mon[44211]: from='client.36452 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:46:26.726 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_blocked_ops 2024-04-01T19:46:27.000 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:46:27.004 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:27.005 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:46:27.106 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:46:27.142 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:27.182 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:46:27.500 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:46:27.505 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:27.505 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:46:27.606 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:46:27.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:27 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:46:27.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:27 smithi022 ceph-mon[39439]: from='client.36452 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:46:27.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:27 smithi022 ceph-mon[39439]: osdmap e505: 12 total, 12 up, 12 in 2024-04-01T19:46:27.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:27 smithi022 ceph-mon[39439]: pgmap v1393: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 9.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s rd, 34 MiB/s wr, 673 op/s 2024-04-01T19:46:27.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:27 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:46:27.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:27 smithi188 ceph-mon[43939]: from='client.36452 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:46:27.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:27 smithi188 ceph-mon[43939]: osdmap e505: 12 total, 12 up, 12 in 2024-04-01T19:46:27.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:27 smithi188 ceph-mon[43939]: pgmap v1393: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 9.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s rd, 34 MiB/s wr, 673 op/s 2024-04-01T19:46:27.652 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:27 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:46:27.652 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:27 smithi062 ceph-mon[44211]: from='client.36452 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:46:27.652 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:27 smithi062 ceph-mon[44211]: osdmap e505: 12 total, 12 up, 12 in 2024-04-01T19:46:27.652 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:27 smithi062 ceph-mon[44211]: pgmap v1393: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 9.5 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s rd, 34 MiB/s wr, 673 op/s 2024-04-01T19:46:27.658 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:27.751 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:46:27.756 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:27.756 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:46:27.857 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:46:27.901 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:28.132 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:46:28.147 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:28.147 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:46:28.248 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:46:28.339 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:28.350 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:46:28.378 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:46:28.385 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:28.385 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:46:28.390 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:46:28.432 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:46:28.477 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:46:28.486 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:46:28.521 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:46:28.535 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:28.563 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:46:28.592 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:46:28.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:28 smithi022 ceph-mon[39439]: from='client.26389 v1:172.21.15.22:0/3514655339' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:46:28.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:28 smithi188 ceph-mon[43939]: from='client.26389 v1:172.21.15.22:0/3514655339' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:46:28.628 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:46:28.669 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:46:28.700 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:46:28.739 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:46:28.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:28 smithi062 ceph-mon[44211]: from='client.26389 v1:172.21.15.22:0/3514655339' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:46:28.773 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:46:28.778 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:46:28.779 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:46:28.779 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:46:28.779 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:46:28.779 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:46:28.779 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:46:28.779 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:46:28.779 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:46:28.779 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:46:28.779 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:46:28.779 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:46:28.779 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:46:29.379 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.10 to 1 (10000) 2024-04-01T19:46:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:29 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2165241538' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T19:46:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:29 smithi062 ceph-mon[44211]: from='client.26383 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T19:46:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:29 smithi062 ceph-mon[44211]: pgmap v1394: 17 pgs: 17 active+clean; 9.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 102 B/s rd, 27 MiB/s wr, 693 op/s 2024-04-01T19:46:29.797 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:29.797 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:29.798 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:29.798 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:29 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2165241538' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T19:46:29.798 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:29 smithi022 ceph-mon[39439]: from='client.26383 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T19:46:29.798 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:29.798 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:29.798 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:29.798 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:29 smithi022 ceph-mon[39439]: pgmap v1394: 17 pgs: 17 active+clean; 9.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 102 B/s rd, 27 MiB/s wr, 693 op/s 2024-04-01T19:46:29.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:29 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2165241538' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T19:46:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:29 smithi188 ceph-mon[43939]: from='client.26383 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T19:46:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:29 smithi188 ceph-mon[43939]: pgmap v1394: 17 pgs: 17 active+clean; 9.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 102 B/s rd, 27 MiB/s wr, 693 op/s 2024-04-01T19:46:30.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:30.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:30.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:30.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:30.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:30.535 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:30.535 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:30 smithi022 ceph-mon[39439]: from='client.26383 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]': finished 2024-04-01T19:46:30.535 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:30 smithi022 ceph-mon[39439]: osdmap e506: 12 total, 12 up, 12 in 2024-04-01T19:46:30.576 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 11 1 2024-04-01T19:46:30.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:30.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:30.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:30.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:30.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:30.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:30 smithi062 ceph-mon[44211]: from='client.26383 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]': finished 2024-04-01T19:46:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:30 smithi062 ceph-mon[44211]: osdmap e506: 12 total, 12 up, 12 in 2024-04-01T19:46:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:30.885 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:30.885 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:30.885 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:30.886 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:30.886 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:30.886 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:30 smithi188 ceph-mon[43939]: from='client.26383 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]': finished 2024-04-01T19:46:30.886 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:30 smithi188 ceph-mon[43939]: osdmap e506: 12 total, 12 up, 12 in 2024-04-01T19:46:31.021 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:46:31.130 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:46:31.585 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:31 smithi022 ceph-mon[39439]: pgmap v1396: 17 pgs: 17 active+clean; 9.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s rd, 10 MiB/s wr, 783 op/s 2024-04-01T19:46:31.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:31 smithi062 ceph-mon[44211]: pgmap v1396: 17 pgs: 17 active+clean; 9.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s rd, 10 MiB/s wr, 783 op/s 2024-04-01T19:46:31.837 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:46:31.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:31 smithi188 ceph-mon[43939]: pgmap v1396: 17 pgs: 17 active+clean; 9.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s rd, 10 MiB/s wr, 783 op/s 2024-04-01T19:46:32.566 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:46:33.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:33 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:46:33.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:33 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:46:33.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:33 smithi188 ceph-mon[43939]: osdmap e507: 12 total, 12 up, 12 in 2024-04-01T19:46:33.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:33 smithi188 ceph-mon[43939]: pgmap v1398: 17 pgs: 17 active+clean; 9.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s wr, 952 op/s 2024-04-01T19:46:34.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:33 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:46:34.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:33 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:46:34.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:33 smithi062 ceph-mon[44211]: osdmap e507: 12 total, 12 up, 12 in 2024-04-01T19:46:34.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:33 smithi062 ceph-mon[44211]: pgmap v1398: 17 pgs: 17 active+clean; 9.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s wr, 952 op/s 2024-04-01T19:46:34.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:33 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:46:34.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:33 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:46:34.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:33 smithi022 ceph-mon[39439]: osdmap e507: 12 total, 12 up, 12 in 2024-04-01T19:46:34.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:33 smithi022 ceph-mon[39439]: pgmap v1398: 17 pgs: 17 active+clean; 9.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s wr, 952 op/s 2024-04-01T19:46:34.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:34 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:46:34.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:34 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:46:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:34 smithi188 ceph-mon[43939]: osdmap e508: 12 total, 12 up, 12 in 2024-04-01T19:46:35.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:34 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:46:35.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:34 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:46:35.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:34 smithi062 ceph-mon[44211]: osdmap e508: 12 total, 12 up, 12 in 2024-04-01T19:46:35.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:34 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:46:35.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:34 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:46:35.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:34 smithi022 ceph-mon[39439]: osdmap e508: 12 total, 12 up, 12 in 2024-04-01T19:46:35.882 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:46:35.886 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:35.887 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:46:35.887 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:35 smithi062 ceph-mon[44211]: pgmap v1400: 17 pgs: 17 active+clean; 9.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:46:35.887 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:35 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3826859980' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T19:46:35.945 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:35 smithi022 ceph-mon[39439]: pgmap v1400: 17 pgs: 17 active+clean; 9.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:46:35.945 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:35 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3826859980' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T19:46:35.987 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:46:36.065 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:46:36.069 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:36.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:35 smithi188 ceph-mon[43939]: pgmap v1400: 17 pgs: 17 active+clean; 9.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:46:36.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:35 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3826859980' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T19:46:36.277 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.11 to 1 (10000) 2024-04-01T19:46:36.290 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:46:36.298 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:36.298 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:46:36.399 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:46:36.445 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:37.284 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:46:37.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:37 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3826859980' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]': finished 2024-04-01T19:46:37.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:37 smithi022 ceph-mon[39439]: osdmap e509: 12 total, 12 up, 12 in 2024-04-01T19:46:37.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:37 smithi022 ceph-mon[39439]: pgmap v1402: 17 pgs: 17 active+clean; 8.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:46:37.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:37 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/780887521' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:46:37.508 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:46:37.515 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:37.516 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:46:37.544 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:37 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3826859980' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]': finished 2024-04-01T19:46:37.544 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:37 smithi062 ceph-mon[44211]: osdmap e509: 12 total, 12 up, 12 in 2024-04-01T19:46:37.544 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:37 smithi062 ceph-mon[44211]: pgmap v1402: 17 pgs: 17 active+clean; 8.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:46:37.544 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:37 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/780887521' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:46:37.617 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:46:37.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:37 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3826859980' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]': finished 2024-04-01T19:46:37.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:37 smithi188 ceph-mon[43939]: osdmap e509: 12 total, 12 up, 12 in 2024-04-01T19:46:37.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:37 smithi188 ceph-mon[43939]: pgmap v1402: 17 pgs: 17 active+clean; 8.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:46:37.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:37 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/780887521' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:46:37.664 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:37.733 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:46:37.738 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:37.738 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:46:37.839 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:46:37.889 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:37.912 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:46:37.913 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:46:38.095 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:46:38.099 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:38.099 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:46:38.200 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:46:38.237 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:38.538 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:38 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:46:38.539 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:38 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/780887521' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:46:38.539 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:38 smithi022 ceph-mon[39439]: osdmap e510: 12 total, 12 up, 12 in 2024-04-01T19:46:38.571 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 8 1 2024-04-01T19:46:38.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:38 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:46:38.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:38 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/780887521' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:46:38.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:38 smithi188 ceph-mon[43939]: osdmap e510: 12 total, 12 up, 12 in 2024-04-01T19:46:38.699 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:38 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:46:38.699 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:38 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/780887521' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:46:38.699 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:38 smithi062 ceph-mon[44211]: osdmap e510: 12 total, 12 up, 12 in 2024-04-01T19:46:38.739 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_historic_ops 2024-04-01T19:46:38.811 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:46:38.816 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:38.817 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:46:38.917 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:46:38.988 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:39.042 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:46:39.050 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:39.051 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:46:39.152 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:46:39.187 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:39.214 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:46:39.486 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:39 smithi022 ceph-mon[39439]: pgmap v1404: 17 pgs: 17 active+clean; 8.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.11k op/s 2024-04-01T19:46:39.577 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:39 smithi062 ceph-mon[44211]: pgmap v1404: 17 pgs: 17 active+clean; 8.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.11k op/s 2024-04-01T19:46:39.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:39 smithi188 ceph-mon[43939]: pgmap v1404: 17 pgs: 17 active+clean; 8.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.11k op/s 2024-04-01T19:46:39.935 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:46:39.940 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:46:39.945 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:39.946 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:46:40.047 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:46:40.110 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:40.199 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:46:40.202 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:40.203 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:46:40.304 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:46:40.332 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:40.352 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:46:40.355 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:40.355 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:46:40.456 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:46:40.460 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:40 smithi022 ceph-mon[39439]: 6.e scrub starts 2024-04-01T19:46:40.513 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:40.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:40 smithi062 ceph-mon[44211]: 6.e scrub starts 2024-04-01T19:46:40.602 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:46:40.611 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:40.611 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:46:40.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:40 smithi188 ceph-mon[43939]: 6.e scrub starts 2024-04-01T19:46:40.712 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:46:40.768 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:40.833 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:46:40.843 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:46:40.869 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:46:40.907 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:46:40.937 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:46:40.977 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:46:41.015 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:46:41.060 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:46:41.090 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:46:41.121 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:46:41.153 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:46:41.185 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:46:41.187 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:46:41.187 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:46:41.187 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:46:41.187 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:46:41.187 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:46:41.187 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:46:41.187 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:46:41.188 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:46:41.188 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:46:41.188 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:46:41.188 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:46:41.188 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:46:41.393 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:46:41.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:41 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:46:41.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:41 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:46:41.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:41 smithi062 ceph-mon[44211]: osdmap e511: 12 total, 12 up, 12 in 2024-04-01T19:46:41.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:41 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3629986459' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:46:41.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:41 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:41.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:41 smithi062 ceph-mon[44211]: 6.e scrub ok 2024-04-01T19:46:41.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:41 smithi062 ceph-mon[44211]: pgmap v1406: 17 pgs: 17 active+clean; 8.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:46:41.518 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:46:41.518 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 20, 2024-04-01T19:46:41.518 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 600, 2024-04-01T19:46:41.518 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:46:41.518 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.519 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237053 5.9 5.73e012a9 (undecoded) ondisk+retry+write+known_if_redirected e430)", 2024-04-01T19:46:41.519 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:34.398341+0000", 2024-04-01T19:46:41.519 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 247.10847804700001, 2024-04-01T19:46:41.519 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48063113499999999, 2024-04-01T19:46:41.519 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:41.519 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:41.519 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "reached pg", 2024-04-01T19:46:41.519 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:41.519 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:46:41.519 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:41.519 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237053 2024-04-01T19:46:41.519 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.519 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:41.519 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.520 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:41.520 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398341+0000", 2024-04-01T19:46:41.520 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.520 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.520 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.520 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:41.520 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398341+0000", 2024-04-01T19:46:41.520 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.520 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.520 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.520 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:41.520 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398344+0000", 2024-04-01T19:46:41.520 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.847e-06 2024-04-01T19:46:41.520 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.520 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.521 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:41.521 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398351+0000", 2024-04-01T19:46:41.521 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.4919999999999996e-06 2024-04-01T19:46:41.521 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.521 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.521 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:41.521 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398363+0000", 2024-04-01T19:46:41.521 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2e-05 2024-04-01T19:46:41.521 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.521 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.521 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:41.521 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398374+0000", 2024-04-01T19:46:41.521 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.111e-05 2024-04-01T19:46:41.521 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.522 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.522 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.522 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398525+0000", 2024-04-01T19:46:41.522 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00015002400000000001 2024-04-01T19:46:41.522 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.522 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.522 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for peered", 2024-04-01T19:46:41.522 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398538+0000", 2024-04-01T19:46:41.522 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3566e-05 2024-04-01T19:46:41.522 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.522 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.522 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.522 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.878945+0000", 2024-04-01T19:46:41.522 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48040738399999999 2024-04-01T19:46:41.523 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.523 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.523 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:41.523 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.878972+0000", 2024-04-01T19:46:41.523 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.6712000000000001e-05 2024-04-01T19:46:41.523 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.523 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:41.523 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.523 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.523 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.523 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237054 5.9 5.ef787e09 (undecoded) ondisk+retry+write+known_if_redirected e430)", 2024-04-01T19:46:41.523 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:34.398400+0000", 2024-04-01T19:46:41.523 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 247.108419172, 2024-04-01T19:46:41.523 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48072366700000002, 2024-04-01T19:46:41.523 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:41.524 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:41.524 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "reached pg", 2024-04-01T19:46:41.524 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:41.524 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:46:41.524 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:41.524 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237054 2024-04-01T19:46:41.524 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.524 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:41.524 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.524 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:41.524 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398400+0000", 2024-04-01T19:46:41.524 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.524 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.525 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.525 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:41.525 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398400+0000", 2024-04-01T19:46:41.525 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.525 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.525 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.525 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:41.525 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398401+0000", 2024-04-01T19:46:41.525 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.0400000000000005e-07 2024-04-01T19:46:41.525 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.525 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.525 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:41.525 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398405+0000", 2024-04-01T19:46:41.525 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8659999999999999e-06 2024-04-01T19:46:41.525 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.525 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.526 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:41.526 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398412+0000", 2024-04-01T19:46:41.526 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.7400000000000004e-06 2024-04-01T19:46:41.526 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.526 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.526 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:41.526 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398419+0000", 2024-04-01T19:46:41.526 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8090000000000004e-06 2024-04-01T19:46:41.526 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.526 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.526 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.526 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398573+0000", 2024-04-01T19:46:41.527 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00015426200000000001 2024-04-01T19:46:41.527 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.527 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.527 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for peered", 2024-04-01T19:46:41.527 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398578+0000", 2024-04-01T19:46:41.527 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9629999999999997e-06 2024-04-01T19:46:41.527 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.527 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.527 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.527 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879117+0000", 2024-04-01T19:46:41.527 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48053854400000001 2024-04-01T19:46:41.527 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.527 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.527 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:41.527 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879124+0000", 2024-04-01T19:46:41.528 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.579e-06 2024-04-01T19:46:41.528 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.528 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:41.528 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.528 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.528 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.528 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237056 5.9 5.8ada1de9 (undecoded) ondisk+retry+write+known_if_redirected e430)", 2024-04-01T19:46:41.528 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:34.398448+0000", 2024-04-01T19:46:41.528 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 247.108370753, 2024-04-01T19:46:41.528 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48070834099999998, 2024-04-01T19:46:41.528 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:41.528 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:41.528 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "reached pg", 2024-04-01T19:46:41.528 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:41.529 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:46:41.529 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:41.529 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237056 2024-04-01T19:46:41.529 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.529 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:41.529 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.529 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:41.529 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398448+0000", 2024-04-01T19:46:41.529 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.529 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.529 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.529 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:41.529 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398448+0000", 2024-04-01T19:46:41.529 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.529 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.530 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.530 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:41.530 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398449+0000", 2024-04-01T19:46:41.530 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.0100000000000003e-07 2024-04-01T19:46:41.530 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.530 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.530 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:41.530 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398453+0000", 2024-04-01T19:46:41.530 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.5209999999999998e-06 2024-04-01T19:46:41.530 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.530 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.530 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:41.530 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398461+0000", 2024-04-01T19:46:41.531 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.4989999999999994e-06 2024-04-01T19:46:41.531 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.531 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.531 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:41.531 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398468+0000", 2024-04-01T19:46:41.531 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3589999999999996e-06 2024-04-01T19:46:41.531 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.531 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.531 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.531 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398605+0000", 2024-04-01T19:46:41.531 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013783 2024-04-01T19:46:41.531 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.531 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.531 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for peered", 2024-04-01T19:46:41.531 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398612+0000", 2024-04-01T19:46:41.532 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.1510000000000001e-06 2024-04-01T19:46:41.532 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.532 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.532 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.532 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879151+0000", 2024-04-01T19:46:41.532 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48053952500000002 2024-04-01T19:46:41.532 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.532 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.532 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:41.532 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879157+0000", 2024-04-01T19:46:41.532 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5550000000000002e-06 2024-04-01T19:46:41.532 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.532 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:41.532 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.532 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.533 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.533 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237061 5.9 5.ea6b7559 (undecoded) ondisk+retry+write+known_if_redirected e430)", 2024-04-01T19:46:41.533 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:34.398482+0000", 2024-04-01T19:46:41.533 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 247.10833705799999, 2024-04-01T19:46:41.533 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48070495400000002, 2024-04-01T19:46:41.533 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:41.533 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:41.533 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "reached pg", 2024-04-01T19:46:41.533 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:41.533 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:46:41.533 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:41.533 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237061 2024-04-01T19:46:41.533 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.533 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:41.533 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.534 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:41.534 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398482+0000", 2024-04-01T19:46:41.534 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.534 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.534 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.534 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:41.534 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398482+0000", 2024-04-01T19:46:41.534 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.534 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.534 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.534 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:41.534 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398483+0000", 2024-04-01T19:46:41.534 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.2099999999999996e-07 2024-04-01T19:46:41.534 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.535 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.535 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:41.535 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398486+0000", 2024-04-01T19:46:41.535 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.2229999999999999e-06 2024-04-01T19:46:41.535 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.535 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.535 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:41.535 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398492+0000", 2024-04-01T19:46:41.535 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5250000000000002e-06 2024-04-01T19:46:41.535 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.535 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.535 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:41.535 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398498+0000", 2024-04-01T19:46:41.535 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6300000000000003e-06 2024-04-01T19:46:41.535 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.535 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.536 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.536 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398637+0000", 2024-04-01T19:46:41.536 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013912899999999999 2024-04-01T19:46:41.536 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.536 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.536 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for peered", 2024-04-01T19:46:41.536 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398641+0000", 2024-04-01T19:46:41.536 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.1640000000000003e-06 2024-04-01T19:46:41.536 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.536 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.536 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.536 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879182+0000", 2024-04-01T19:46:41.536 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48054052600000002 2024-04-01T19:46:41.536 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.536 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.536 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:41.537 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879187+0000", 2024-04-01T19:46:41.537 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0359999999999997e-06 2024-04-01T19:46:41.537 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.537 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:41.537 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.537 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.537 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.537 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237071 5.9 5.d8d35df9 (undecoded) ondisk+retry+write+known_if_redirected e430)", 2024-04-01T19:46:41.537 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:34.398509+0000", 2024-04-01T19:46:41.537 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 247.10830985999999, 2024-04-01T19:46:41.537 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48086784799999999, 2024-04-01T19:46:41.537 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:41.537 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:41.537 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "reached pg", 2024-04-01T19:46:41.538 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:41.538 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:46:41.538 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:41.538 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237071 2024-04-01T19:46:41.538 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.538 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:41.538 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.538 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:41.538 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398509+0000", 2024-04-01T19:46:41.538 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.538 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.538 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.538 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:41.538 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398509+0000", 2024-04-01T19:46:41.539 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.539 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.539 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.539 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:41.539 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398510+0000", 2024-04-01T19:46:41.539 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9999999999999998e-07 2024-04-01T19:46:41.539 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.539 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.539 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:41.539 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398513+0000", 2024-04-01T19:46:41.539 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.0599999999999999e-06 2024-04-01T19:46:41.539 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.539 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.539 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:41.539 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398517+0000", 2024-04-01T19:46:41.540 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.5990000000000004e-06 2024-04-01T19:46:41.540 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.540 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.540 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:41.540 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398521+0000", 2024-04-01T19:46:41.540 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.2509999999999999e-06 2024-04-01T19:46:41.540 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.540 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.540 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.540 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398668+0000", 2024-04-01T19:46:41.540 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014728000000000001 2024-04-01T19:46:41.540 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.540 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.540 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for peered", 2024-04-01T19:46:41.540 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398672+0000", 2024-04-01T19:46:41.541 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.1489999999999996e-06 2024-04-01T19:46:41.541 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.541 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.541 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.541 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879366+0000", 2024-04-01T19:46:41.541 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48069390400000001 2024-04-01T19:46:41.541 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.541 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.541 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:41.541 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879377+0000", 2024-04-01T19:46:41.541 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1205e-05 2024-04-01T19:46:41.541 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.541 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:41.541 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.542 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.542 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.542 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237097 5.9 5.14047049 (undecoded) ondisk+retry+write+known_if_redirected e430)", 2024-04-01T19:46:41.542 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:34.398526+0000", 2024-04-01T19:46:41.542 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 247.10829321700001, 2024-04-01T19:46:41.542 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48087400400000002, 2024-04-01T19:46:41.542 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:41.542 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:41.542 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "reached pg", 2024-04-01T19:46:41.542 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:41.542 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:46:41.542 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:41.542 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237097 2024-04-01T19:46:41.542 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.543 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:41.543 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.543 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:41.543 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398526+0000", 2024-04-01T19:46:41.543 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.543 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.543 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.543 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:41.543 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398526+0000", 2024-04-01T19:46:41.543 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.543 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.543 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.543 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:41.543 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398526+0000", 2024-04-01T19:46:41.543 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7899999999999999e-07 2024-04-01T19:46:41.543 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.544 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.544 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:41.544 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398529+0000", 2024-04-01T19:46:41.544 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3970000000000001e-06 2024-04-01T19:46:41.544 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.544 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.544 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:41.544 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398537+0000", 2024-04-01T19:46:41.544 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.3299999999999999e-06 2024-04-01T19:46:41.544 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.544 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.544 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:41.544 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398542+0000", 2024-04-01T19:46:41.544 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.843e-06 2024-04-01T19:46:41.545 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.545 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.545 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.545 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398699+0000", 2024-04-01T19:46:41.545 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000156608 2024-04-01T19:46:41.545 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.545 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.545 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for peered", 2024-04-01T19:46:41.545 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398703+0000", 2024-04-01T19:46:41.545 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0600000000000001e-06 2024-04-01T19:46:41.545 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.545 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.545 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.545 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879393+0000", 2024-04-01T19:46:41.545 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48069033 2024-04-01T19:46:41.545 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.546 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.546 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:41.546 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879400+0000", 2024-04-01T19:46:41.546 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9569999999999996e-06 2024-04-01T19:46:41.546 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.546 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:41.546 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.546 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.546 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.546 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237102 5.9 5.89469869 (undecoded) ondisk+retry+write+known_if_redirected e430)", 2024-04-01T19:46:41.546 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:34.398566+0000", 2024-04-01T19:46:41.546 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 247.108252604, 2024-04-01T19:46:41.546 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.480884537, 2024-04-01T19:46:41.546 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:41.546 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:41.547 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "reached pg", 2024-04-01T19:46:41.547 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:41.547 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:46:41.547 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:41.547 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237102 2024-04-01T19:46:41.547 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.547 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:41.547 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.547 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:41.547 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398566+0000", 2024-04-01T19:46:41.547 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.547 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.547 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.547 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:41.547 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398566+0000", 2024-04-01T19:46:41.548 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.548 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.548 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.548 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:41.548 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398567+0000", 2024-04-01T19:46:41.548 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.4099999999999999e-07 2024-04-01T19:46:41.548 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.548 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.548 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:41.548 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398569+0000", 2024-04-01T19:46:41.548 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.0789999999999999e-06 2024-04-01T19:46:41.548 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.548 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.549 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:41.549 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398574+0000", 2024-04-01T19:46:41.549 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1730000000000003e-06 2024-04-01T19:46:41.549 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.549 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.549 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:41.549 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398577+0000", 2024-04-01T19:46:41.549 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.129e-06 2024-04-01T19:46:41.549 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.549 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.549 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.549 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398730+0000", 2024-04-01T19:46:41.549 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00015233999999999999 2024-04-01T19:46:41.550 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.550 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.550 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for peered", 2024-04-01T19:46:41.550 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398734+0000", 2024-04-01T19:46:41.550 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9480000000000001e-06 2024-04-01T19:46:41.550 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.550 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.550 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.550 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879442+0000", 2024-04-01T19:46:41.550 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.480708107 2024-04-01T19:46:41.550 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.550 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.550 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:41.550 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879451+0000", 2024-04-01T19:46:41.551 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.3200000000000006e-06 2024-04-01T19:46:41.551 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.551 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:41.551 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.551 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.551 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.551 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237121 5.9 5.358aee19 (undecoded) ondisk+retry+write+known_if_redirected e430)", 2024-04-01T19:46:41.551 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:34.398583+0000", 2024-04-01T19:46:41.551 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 247.10823596500001, 2024-04-01T19:46:41.551 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48090728700000002, 2024-04-01T19:46:41.551 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:41.551 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:41.551 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "reached pg", 2024-04-01T19:46:41.551 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:41.551 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:46:41.552 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:41.552 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237121 2024-04-01T19:46:41.552 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.552 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:41.552 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.552 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:41.552 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398583+0000", 2024-04-01T19:46:41.552 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.552 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.552 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.552 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:41.552 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398583+0000", 2024-04-01T19:46:41.552 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.552 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.552 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.552 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:41.553 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398583+0000", 2024-04-01T19:46:41.553 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.4299999999999999e-07 2024-04-01T19:46:41.553 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.553 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.553 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:41.553 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398585+0000", 2024-04-01T19:46:41.553 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.5269999999999999e-06 2024-04-01T19:46:41.553 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.553 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.553 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:41.553 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398589+0000", 2024-04-01T19:46:41.553 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3470000000000001e-06 2024-04-01T19:46:41.553 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.553 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.553 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:41.553 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398594+0000", 2024-04-01T19:46:41.554 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.5639999999999998e-06 2024-04-01T19:46:41.554 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.554 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.554 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.554 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398751+0000", 2024-04-01T19:46:41.554 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00015691300000000001 2024-04-01T19:46:41.554 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.554 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.554 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for peered", 2024-04-01T19:46:41.554 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398755+0000", 2024-04-01T19:46:41.554 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9589999999999997e-06 2024-04-01T19:46:41.554 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.554 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.554 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.555 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879485+0000", 2024-04-01T19:46:41.555 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48072979199999999 2024-04-01T19:46:41.555 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.555 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.555 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:41.555 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879490+0000", 2024-04-01T19:46:41.555 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8420000000000001e-06 2024-04-01T19:46:41.555 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.555 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:41.555 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.555 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.555 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.556 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237123 5.9 5:99f33e71:::benchmark_data_smithi188_119427_object72424:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e437)", 2024-04-01T19:46:41.556 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:46.181932+0000", 2024-04-01T19:46:41.556 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 235.32488716099999, 2024-04-01T19:46:41.556 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.081236762000000004, 2024-04-01T19:46:41.556 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:41.556 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:41.556 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:41.556 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:41.556 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:46:41.556 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:41.556 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237123 2024-04-01T19:46:41.556 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.556 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:41.556 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.556 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:41.557 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181932+0000", 2024-04-01T19:46:41.557 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.557 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.557 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.557 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:41.557 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181932+0000", 2024-04-01T19:46:41.557 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.557 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.557 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.557 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:41.557 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181932+0000", 2024-04-01T19:46:41.557 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8099999999999999e-07 2024-04-01T19:46:41.557 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.557 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.557 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:41.557 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181933+0000", 2024-04-01T19:46:41.557 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.235e-06 2024-04-01T19:46:41.558 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.558 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.558 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:41.558 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181936+0000", 2024-04-01T19:46:41.558 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.6900000000000001e-06 2024-04-01T19:46:41.558 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.558 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.558 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:41.558 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181939+0000", 2024-04-01T19:46:41.558 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.7379999999999999e-06 2024-04-01T19:46:41.558 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.558 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.558 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.558 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.251243+0000", 2024-04-01T19:46:41.559 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.069303712000000003 2024-04-01T19:46:41.559 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.559 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.559 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:41.559 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.251374+0000", 2024-04-01T19:46:41.559 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013158199999999999 2024-04-01T19:46:41.559 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.559 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.559 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T19:46:41.559 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.251513+0000", 2024-04-01T19:46:41.559 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000138744 2024-04-01T19:46:41.559 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.559 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.559 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:41.559 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.255311+0000", 2024-04-01T19:46:41.559 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0037978339999999999 2024-04-01T19:46:41.560 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.560 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.560 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:41.560 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.263096+0000", 2024-04-01T19:46:41.560 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0077851880000000002 2024-04-01T19:46:41.560 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.560 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.560 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:41.560 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.263131+0000", 2024-04-01T19:46:41.560 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.4625000000000001e-05 2024-04-01T19:46:41.560 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.560 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.560 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:41.560 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.263169+0000", 2024-04-01T19:46:41.560 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8133000000000002e-05 2024-04-01T19:46:41.560 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.561 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:41.561 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.561 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.561 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.561 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237131 5.9 5:9efc6e35:::benchmark_data_smithi188_119427_object72432:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e437)", 2024-04-01T19:46:41.561 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:46.181942+0000", 2024-04-01T19:46:41.561 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 235.32487753000001, 2024-04-01T19:46:41.561 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.097945575000000007, 2024-04-01T19:46:41.561 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:41.561 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:41.561 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:41.561 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:41.561 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:46:41.561 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:41.561 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237131 2024-04-01T19:46:41.561 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.562 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:41.562 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.562 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:41.562 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181942+0000", 2024-04-01T19:46:41.562 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.562 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.562 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.562 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:41.562 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181942+0000", 2024-04-01T19:46:41.562 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.562 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.562 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.562 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:41.562 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181942+0000", 2024-04-01T19:46:41.562 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.7300000000000002e-07 2024-04-01T19:46:41.563 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.563 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.563 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:41.563 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181943+0000", 2024-04-01T19:46:41.563 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.252e-06 2024-04-01T19:46:41.563 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.563 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.563 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:41.563 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181946+0000", 2024-04-01T19:46:41.563 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.633e-06 2024-04-01T19:46:41.563 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.563 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.563 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:41.563 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181949+0000", 2024-04-01T19:46:41.563 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8310000000000001e-06 2024-04-01T19:46:41.564 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.564 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.564 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.564 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.255485+0000", 2024-04-01T19:46:41.564 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.073536199999999996 2024-04-01T19:46:41.564 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.564 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.564 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:41.564 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.255569+0000", 2024-04-01T19:46:41.564 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.4278999999999997e-05 2024-04-01T19:46:41.564 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.564 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.564 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T19:46:41.564 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.255643+0000", 2024-04-01T19:46:41.564 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.4444999999999996e-05 2024-04-01T19:46:41.564 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.565 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.565 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:41.565 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.271717+0000", 2024-04-01T19:46:41.565 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.016073686 2024-04-01T19:46:41.565 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.565 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.565 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:41.565 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.279777+0000", 2024-04-01T19:46:41.565 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0080601609999999997 2024-04-01T19:46:41.565 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.565 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.565 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:41.565 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.279840+0000", 2024-04-01T19:46:41.565 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2939000000000002e-05 2024-04-01T19:46:41.565 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.565 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.566 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:41.566 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.279887+0000", 2024-04-01T19:46:41.566 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6876000000000003e-05 2024-04-01T19:46:41.566 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.566 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:41.566 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.566 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.566 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.566 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237135 5.9 5:9acea934:::benchmark_data_smithi188_119427_object72436:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e437)", 2024-04-01T19:46:41.566 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:46.181951+0000", 2024-04-01T19:46:41.566 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 235.32486787900001, 2024-04-01T19:46:41.567 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.098134025, 2024-04-01T19:46:41.567 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:41.567 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:41.567 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:41.567 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:41.567 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:46:41.567 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:41.567 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237135 2024-04-01T19:46:41.567 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.567 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:41.567 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.568 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:41.568 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181951+0000", 2024-04-01T19:46:41.568 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.568 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.568 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.568 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:41.568 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181951+0000", 2024-04-01T19:46:41.568 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.568 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.568 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.568 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:41.568 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181951+0000", 2024-04-01T19:46:41.568 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.67e-07 2024-04-01T19:46:41.568 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.568 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.569 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:41.569 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181953+0000", 2024-04-01T19:46:41.569 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.235e-06 2024-04-01T19:46:41.569 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.569 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.569 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:41.569 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181955+0000", 2024-04-01T19:46:41.569 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.6989999999999999e-06 2024-04-01T19:46:41.569 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.569 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.569 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:41.569 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181958+0000", 2024-04-01T19:46:41.570 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.4710000000000001e-06 2024-04-01T19:46:41.570 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.570 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.570 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.570 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.259232+0000", 2024-04-01T19:46:41.570 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.077274514000000002 2024-04-01T19:46:41.570 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.570 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.570 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:41.571 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.259309+0000", 2024-04-01T19:46:41.571 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.6347000000000006e-05 2024-04-01T19:46:41.571 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.571 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.571 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T19:46:41.571 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.259380+0000", 2024-04-01T19:46:41.571 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1429999999999999e-05 2024-04-01T19:46:41.571 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.571 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.571 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:41.571 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.271740+0000", 2024-04-01T19:46:41.571 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.012359936 2024-04-01T19:46:41.571 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.571 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.571 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:41.572 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.280028+0000", 2024-04-01T19:46:41.572 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0082876410000000001 2024-04-01T19:46:41.572 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.572 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.572 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:41.572 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.280059+0000", 2024-04-01T19:46:41.572 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.0769000000000003e-05 2024-04-01T19:46:41.572 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.572 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.572 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:41.572 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.280085+0000", 2024-04-01T19:46:41.572 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.6716e-05 2024-04-01T19:46:41.572 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.572 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:41.572 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.573 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.573 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.573 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237172 5.9 5:9a209d38:::benchmark_data_smithi188_119427_object72473:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e437)", 2024-04-01T19:46:41.573 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:46.181961+0000", 2024-04-01T19:46:41.573 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 235.32485839200001, 2024-04-01T19:46:41.573 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.10301771699999999, 2024-04-01T19:46:41.573 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:41.573 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:41.573 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:41.573 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:41.573 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:46:41.573 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:41.573 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237172 2024-04-01T19:46:41.573 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.573 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:41.574 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.574 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:41.574 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181961+0000", 2024-04-01T19:46:41.574 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.574 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.574 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.574 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:41.574 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181961+0000", 2024-04-01T19:46:41.574 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.574 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.574 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.574 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:41.574 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181961+0000", 2024-04-01T19:46:41.574 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8700000000000002e-07 2024-04-01T19:46:41.574 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.574 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.575 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:41.575 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181963+0000", 2024-04-01T19:46:41.575 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.6080000000000001e-06 2024-04-01T19:46:41.575 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.575 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.575 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:41.575 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181965+0000", 2024-04-01T19:46:41.575 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.667e-06 2024-04-01T19:46:41.575 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.575 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.575 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:41.575 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181968+0000", 2024-04-01T19:46:41.575 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.6879999999999999e-06 2024-04-01T19:46:41.576 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.576 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.576 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.576 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.263204+0000", 2024-04-01T19:46:41.576 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.081236251999999995 2024-04-01T19:46:41.576 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.576 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.576 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:41.576 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.263311+0000", 2024-04-01T19:46:41.576 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00010711 2024-04-01T19:46:41.576 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.576 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.576 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T19:46:41.576 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.263379+0000", 2024-04-01T19:46:41.576 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.7855999999999995e-05 2024-04-01T19:46:41.577 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.577 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.577 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:41.577 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.271768+0000", 2024-04-01T19:46:41.577 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0083888299999999999 2024-04-01T19:46:41.577 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.577 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.577 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:41.577 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.284894+0000", 2024-04-01T19:46:41.577 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.013125596 2024-04-01T19:46:41.577 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.577 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.577 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:41.578 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.284931+0000", 2024-04-01T19:46:41.578 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.7704999999999999e-05 2024-04-01T19:46:41.578 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.578 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.578 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:41.578 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.284978+0000", 2024-04-01T19:46:41.578 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7117999999999998e-05 2024-04-01T19:46:41.578 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.578 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:41.578 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.578 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.578 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.578 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237212 5.9 5:943e20fe:::benchmark_data_smithi188_119427_object72513:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e437)", 2024-04-01T19:46:41.578 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:46.181971+0000", 2024-04-01T19:46:41.578 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 235.324848387, 2024-04-01T19:46:41.579 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.103078844, 2024-04-01T19:46:41.579 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:41.579 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:41.579 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:41.579 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:41.579 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:46:41.579 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:41.579 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237212 2024-04-01T19:46:41.579 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.579 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:41.579 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.579 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:41.579 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181971+0000", 2024-04-01T19:46:41.579 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.579 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.580 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.580 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:41.580 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181971+0000", 2024-04-01T19:46:41.580 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.580 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.580 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.580 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:41.580 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181971+0000", 2024-04-01T19:46:41.580 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.6100000000000002e-07 2024-04-01T19:46:41.580 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.580 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.580 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:41.580 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181976+0000", 2024-04-01T19:46:41.580 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7659999999999998e-06 2024-04-01T19:46:41.580 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.581 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.581 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:41.581 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181979+0000", 2024-04-01T19:46:41.581 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.084e-06 2024-04-01T19:46:41.581 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.581 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.581 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:41.581 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181981+0000", 2024-04-01T19:46:41.581 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.6809999999999998e-06 2024-04-01T19:46:41.581 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.581 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.581 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.581 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.267734+0000", 2024-04-01T19:46:41.581 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.085752223000000002 2024-04-01T19:46:41.581 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.582 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.582 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:41.582 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.267850+0000", 2024-04-01T19:46:41.582 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000116035 2024-04-01T19:46:41.582 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.582 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.582 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T19:46:41.582 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.267978+0000", 2024-04-01T19:46:41.582 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000128675 2024-04-01T19:46:41.582 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.582 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.582 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:41.582 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.271796+0000", 2024-04-01T19:46:41.582 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0038176490000000002 2024-04-01T19:46:41.583 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.583 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.583 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:41.583 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.284985+0000", 2024-04-01T19:46:41.583 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.013189429000000001 2024-04-01T19:46:41.583 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.583 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.583 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:41.583 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.285012+0000", 2024-04-01T19:46:41.583 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.6190000000000002e-05 2024-04-01T19:46:41.583 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.583 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.583 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:41.583 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.285050+0000", 2024-04-01T19:46:41.583 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.7851000000000001e-05 2024-04-01T19:46:41.584 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.584 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:41.584 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.584 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.584 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.584 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237246 5.9 5:9ab2d1d5:::benchmark_data_smithi188_119427_object72547:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e437)", 2024-04-01T19:46:41.584 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:46.181985+0000", 2024-04-01T19:46:41.584 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 235.324834579, 2024-04-01T19:46:41.584 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.10312982800000001, 2024-04-01T19:46:41.584 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:41.584 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:41.584 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:41.584 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:41.584 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:46:41.585 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:41.585 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237246 2024-04-01T19:46:41.585 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.585 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:41.585 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.585 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:41.585 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181985+0000", 2024-04-01T19:46:41.585 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.585 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.585 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.585 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:41.585 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181985+0000", 2024-04-01T19:46:41.585 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.586 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.586 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.586 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:41.586 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181985+0000", 2024-04-01T19:46:41.586 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.63e-07 2024-04-01T19:46:41.586 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.586 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.586 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:41.586 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181986+0000", 2024-04-01T19:46:41.586 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4789999999999999e-06 2024-04-01T19:46:41.586 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.586 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.586 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:41.586 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181989+0000", 2024-04-01T19:46:41.587 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.7920000000000001e-06 2024-04-01T19:46:41.587 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.587 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.587 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:41.587 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181992+0000", 2024-04-01T19:46:41.587 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.1729999999999999e-06 2024-04-01T19:46:41.587 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.587 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.587 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.587 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.271813+0000", 2024-04-01T19:46:41.588 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.089820752000000004 2024-04-01T19:46:41.588 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.588 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.588 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:41.588 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.271903+0000", 2024-04-01T19:46:41.588 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.9819000000000002e-05 2024-04-01T19:46:41.588 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.588 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.588 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T19:46:41.588 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.271982+0000", 2024-04-01T19:46:41.588 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9456000000000006e-05 2024-04-01T19:46:41.589 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.589 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.589 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:41.589 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.279960+0000", 2024-04-01T19:46:41.589 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0079773399999999994 2024-04-01T19:46:41.589 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.589 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.589 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:41.589 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.285055+0000", 2024-04-01T19:46:41.589 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0050951679999999997 2024-04-01T19:46:41.589 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.589 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.589 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:41.589 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.285080+0000", 2024-04-01T19:46:41.589 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.4851999999999999e-05 2024-04-01T19:46:41.589 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.590 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.590 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:41.590 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.285114+0000", 2024-04-01T19:46:41.590 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.4533999999999998e-05 2024-04-01T19:46:41.590 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.590 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:41.590 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.590 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.590 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.590 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237247 5.9 5:9c584c22:::benchmark_data_smithi188_119427_object72548:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e437)", 2024-04-01T19:46:41.590 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:46.181995+0000", 2024-04-01T19:46:41.590 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 235.324823791, 2024-04-01T19:46:41.590 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.107810507, 2024-04-01T19:46:41.590 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:41.590 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:41.591 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:41.591 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:41.591 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:46:41.591 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:41.591 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237247 2024-04-01T19:46:41.591 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.591 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:41.591 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.591 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:41.591 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181995+0000", 2024-04-01T19:46:41.591 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.591 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.591 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.591 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:41.591 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181995+0000", 2024-04-01T19:46:41.592 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.592 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.592 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.592 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:41.592 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181996+0000", 2024-04-01T19:46:41.592 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.79e-07 2024-04-01T19:46:41.592 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.592 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.592 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:41.592 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181997+0000", 2024-04-01T19:46:41.592 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4109999999999999e-06 2024-04-01T19:46:41.592 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.592 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.592 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:41.592 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.182000+0000", 2024-04-01T19:46:41.593 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.959e-06 2024-04-01T19:46:41.593 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.593 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.593 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:41.593 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.182005+0000", 2024-04-01T19:46:41.593 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.566e-06 2024-04-01T19:46:41.593 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.593 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.593 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.593 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.275750+0000", 2024-04-01T19:46:41.593 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.093745076999999996 2024-04-01T19:46:41.593 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.593 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.593 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:41.593 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.275891+0000", 2024-04-01T19:46:41.593 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000141557 2024-04-01T19:46:41.594 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.594 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.594 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T19:46:41.594 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.276026+0000", 2024-04-01T19:46:41.594 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000134554 2024-04-01T19:46:41.594 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.594 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.594 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:41.594 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.280019+0000", 2024-04-01T19:46:41.594 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0039932509999999997 2024-04-01T19:46:41.594 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.594 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.594 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:41.594 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.289704+0000", 2024-04-01T19:46:41.595 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0096849540000000008 2024-04-01T19:46:41.595 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.595 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.595 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:41.595 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.289754+0000", 2024-04-01T19:46:41.595 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0367000000000001e-05 2024-04-01T19:46:41.595 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.595 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.595 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:41.595 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.289806+0000", 2024-04-01T19:46:41.595 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1532000000000001e-05 2024-04-01T19:46:41.595 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.595 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:41.595 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.595 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.595 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.596 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:144278 6.8 6:1a8c23ef:::benchmark_data_smithi188_134454_object144277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e499)", 2024-04-01T19:46:41.596 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:46:05.754638+0000", 2024-04-01T19:46:41.596 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 35.752181174999997, 2024-04-01T19:46:41.596 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.083302345, 2024-04-01T19:46:41.596 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:41.596 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:41.596 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:41.596 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:41.596 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:46:41.596 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:46:41.596 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 144278 2024-04-01T19:46:41.596 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.596 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:41.596 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.597 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:41.597 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.754638+0000", 2024-04-01T19:46:41.597 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.597 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.597 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.597 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:41.597 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.754638+0000", 2024-04-01T19:46:41.597 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.597 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.597 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.598 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:41.598 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.754640+0000", 2024-04-01T19:46:41.598 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.2330000000000001e-06 2024-04-01T19:46:41.598 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.598 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.598 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:41.598 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.754677+0000", 2024-04-01T19:46:41.598 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.7199000000000001e-05 2024-04-01T19:46:41.598 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.598 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.598 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:41.598 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.754687+0000", 2024-04-01T19:46:41.598 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.5410000000000006e-06 2024-04-01T19:46:41.598 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.598 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.599 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:41.599 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.754694+0000", 2024-04-01T19:46:41.599 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.401e-06 2024-04-01T19:46:41.599 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.599 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.599 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.599 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.754867+0000", 2024-04-01T19:46:41.599 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00017223299999999999 2024-04-01T19:46:41.599 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.599 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.599 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:41.599 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.754978+0000", 2024-04-01T19:46:41.599 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000111143 2024-04-01T19:46:41.599 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.599 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.599 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T19:46:41.600 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.755081+0000", 2024-04-01T19:46:41.600 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000103628 2024-04-01T19:46:41.600 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.600 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.600 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:41.600 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.824178+0000", 2024-04-01T19:46:41.600 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.069097190000000003 2024-04-01T19:46:41.600 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.600 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.600 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:41.600 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.837821+0000", 2024-04-01T19:46:41.600 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.013642497 2024-04-01T19:46:41.600 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.600 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.600 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:41.600 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.837875+0000", 2024-04-01T19:46:41.601 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.4497999999999999e-05 2024-04-01T19:46:41.601 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.601 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.601 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:41.601 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.837940+0000", 2024-04-01T19:46:41.601 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.4782000000000004e-05 2024-04-01T19:46:41.601 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.601 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:41.601 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.601 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.601 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.601 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:144279 6.3 6:caa54ca4:::benchmark_data_smithi188_134454_object144278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e499)", 2024-04-01T19:46:41.602 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:46:05.754710+0000", 2024-04-01T19:46:41.602 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 35.752109157, 2024-04-01T19:46:41.602 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.081480502999999996, 2024-04-01T19:46:41.602 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:41.602 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:41.602 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:41.602 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:41.602 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:46:41.602 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:46:41.602 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 144279 2024-04-01T19:46:41.602 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.602 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:41.602 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.602 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:41.602 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.754710+0000", 2024-04-01T19:46:41.603 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.603 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.603 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.603 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:41.603 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.754710+0000", 2024-04-01T19:46:41.603 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.603 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.603 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.603 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:41.603 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.754711+0000", 2024-04-01T19:46:41.603 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.2200000000000003e-07 2024-04-01T19:46:41.603 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.603 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.604 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:41.604 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.754742+0000", 2024-04-01T19:46:41.604 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.1621000000000001e-05 2024-04-01T19:46:41.604 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.604 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.604 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:41.604 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.754749+0000", 2024-04-01T19:46:41.604 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5729999999999996e-06 2024-04-01T19:46:41.604 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.604 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.604 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:41.604 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.754755+0000", 2024-04-01T19:46:41.604 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7069999999999997e-06 2024-04-01T19:46:41.604 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.604 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.605 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.605 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.816629+0000", 2024-04-01T19:46:41.605 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.061874620999999998 2024-04-01T19:46:41.605 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.605 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.605 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:41.605 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.816812+0000", 2024-04-01T19:46:41.605 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00018310900000000001 2024-04-01T19:46:41.605 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.605 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.605 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 6", 2024-04-01T19:46:41.605 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.816980+0000", 2024-04-01T19:46:41.605 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000167355 2024-04-01T19:46:41.605 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.605 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.605 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:41.606 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.831170+0000", 2024-04-01T19:46:41.606 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.014189932000000001 2024-04-01T19:46:41.606 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.606 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.606 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:41.606 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.836088+0000", 2024-04-01T19:46:41.606 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0049185849999999996 2024-04-01T19:46:41.606 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.606 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.606 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:41.606 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.836136+0000", 2024-04-01T19:46:41.606 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8220000000000002e-05 2024-04-01T19:46:41.606 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.606 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.606 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:41.607 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.836190+0000", 2024-04-01T19:46:41.607 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3958000000000001e-05 2024-04-01T19:46:41.607 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.607 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:41.607 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.607 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.607 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.607 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:144283 6.3 6:c3267f71:::benchmark_data_smithi188_134454_object144282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e499)", 2024-04-01T19:46:41.607 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:46:05.755199+0000", 2024-04-01T19:46:41.607 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 35.751619622, 2024-04-01T19:46:41.607 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.081111350999999998, 2024-04-01T19:46:41.607 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:41.607 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:41.607 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:41.607 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:41.608 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:46:41.608 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:46:41.608 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 144283 2024-04-01T19:46:41.608 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.608 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:41.608 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.608 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:41.608 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.755199+0000", 2024-04-01T19:46:41.608 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.608 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.608 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.608 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:41.608 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.755199+0000", 2024-04-01T19:46:41.609 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.609 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.609 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.609 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:41.609 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.755207+0000", 2024-04-01T19:46:41.609 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1489999999999997e-06 2024-04-01T19:46:41.609 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.609 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.609 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:41.609 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.755240+0000", 2024-04-01T19:46:41.609 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.3673000000000001e-05 2024-04-01T19:46:41.609 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.609 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.609 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:41.609 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.755249+0000", 2024-04-01T19:46:41.610 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.2989999999999997e-06 2024-04-01T19:46:41.610 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.610 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.610 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:41.610 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.755255+0000", 2024-04-01T19:46:41.610 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8839999999999997e-06 2024-04-01T19:46:41.610 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.610 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.610 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.610 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.821690+0000", 2024-04-01T19:46:41.610 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.066434882000000001 2024-04-01T19:46:41.610 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.610 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.610 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:41.611 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.821824+0000", 2024-04-01T19:46:41.611 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013329800000000001 2024-04-01T19:46:41.611 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.611 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.611 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 6", 2024-04-01T19:46:41.611 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.821952+0000", 2024-04-01T19:46:41.611 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012838300000000001 2024-04-01T19:46:41.611 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.611 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.611 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:41.611 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.831209+0000", 2024-04-01T19:46:41.611 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0092571939999999998 2024-04-01T19:46:41.611 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.611 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.611 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:41.612 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.836232+0000", 2024-04-01T19:46:41.612 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0050225039999999997 2024-04-01T19:46:41.612 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.612 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.612 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:41.612 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.836275+0000", 2024-04-01T19:46:41.612 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.2868999999999999e-05 2024-04-01T19:46:41.612 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.612 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.612 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:41.612 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.836311+0000", 2024-04-01T19:46:41.612 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.6216e-05 2024-04-01T19:46:41.612 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.613 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:41.613 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.613 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.613 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.613 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:144287 6.8 6:18fc1daf:::benchmark_data_smithi188_134454_object144286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e499)", 2024-04-01T19:46:41.613 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:46:05.762789+0000", 2024-04-01T19:46:41.613 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 35.744030125000002, 2024-04-01T19:46:41.613 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.076907732000000006, 2024-04-01T19:46:41.613 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:41.613 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:41.613 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:41.613 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:41.613 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:46:41.614 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:46:41.614 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 144287 2024-04-01T19:46:41.614 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.614 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:41.614 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.614 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:41.614 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.762789+0000", 2024-04-01T19:46:41.614 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.614 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.614 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.614 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:41.614 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.762789+0000", 2024-04-01T19:46:41.614 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.615 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.615 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.615 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:41.615 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.762791+0000", 2024-04-01T19:46:41.615 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.491e-06 2024-04-01T19:46:41.615 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.615 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.615 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:41.615 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.762821+0000", 2024-04-01T19:46:41.615 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.9578999999999999e-05 2024-04-01T19:46:41.615 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.615 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.615 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:41.615 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.816586+0000", 2024-04-01T19:46:41.615 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.053765374999999997 2024-04-01T19:46:41.616 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.616 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.616 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:41.616 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.816603+0000", 2024-04-01T19:46:41.616 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.7067000000000001e-05 2024-04-01T19:46:41.616 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.616 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.616 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.616 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.824213+0000", 2024-04-01T19:46:41.616 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0076100150000000004 2024-04-01T19:46:41.616 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.616 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.616 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:41.616 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.824379+0000", 2024-04-01T19:46:41.616 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00016537999999999999 2024-04-01T19:46:41.616 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.617 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.617 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T19:46:41.617 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.824526+0000", 2024-04-01T19:46:41.617 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014726100000000001 2024-04-01T19:46:41.617 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.617 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.617 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:41.617 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.828878+0000", 2024-04-01T19:46:41.617 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0043522150000000004 2024-04-01T19:46:41.617 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.617 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.617 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:41.617 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.839590+0000", 2024-04-01T19:46:41.617 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.010711619 2024-04-01T19:46:41.617 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.617 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.618 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:41.618 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.839640+0000", 2024-04-01T19:46:41.618 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0259000000000001e-05 2024-04-01T19:46:41.618 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.618 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.618 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:41.618 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:05.839697+0000", 2024-04-01T19:46:41.618 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6471000000000002e-05 2024-04-01T19:46:41.618 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.618 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:41.618 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.618 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.618 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.618 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:144953 6.3 6:c7a22a0b:::benchmark_data_smithi188_134454_object144952:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e499)", 2024-04-01T19:46:41.619 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:46:06.406106+0000", 2024-04-01T19:46:41.619 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 35.100713388999999, 2024-04-01T19:46:41.619 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.078875956999999997, 2024-04-01T19:46:41.619 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:46:41.619 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:46:41.619 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:41.619 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:46:41.619 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:46:41.619 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:46:41.619 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 144953 2024-04-01T19:46:41.619 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.619 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:46:41.619 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.619 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:46:41.619 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:06.406106+0000", 2024-04-01T19:46:41.620 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.620 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.620 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.620 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:46:41.620 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:06.406106+0000", 2024-04-01T19:46:41.620 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:46:41.620 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.620 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.620 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:46:41.620 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:06.406108+0000", 2024-04-01T19:46:41.620 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.57e-06 2024-04-01T19:46:41.620 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.620 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.620 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:46:41.620 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:06.406157+0000", 2024-04-01T19:46:41.620 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8729000000000001e-05 2024-04-01T19:46:41.621 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.621 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.621 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:46:41.621 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:06.459306+0000", 2024-04-01T19:46:41.621 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.053149455999999998 2024-04-01T19:46:41.621 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.621 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.621 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:46:41.621 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:06.459317+0000", 2024-04-01T19:46:41.621 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1005999999999999e-05 2024-04-01T19:46:41.621 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.621 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.621 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:46:41.621 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:06.472064+0000", 2024-04-01T19:46:41.621 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.012746116 2024-04-01T19:46:41.622 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.622 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.622 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:46:41.622 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:06.472192+0000", 2024-04-01T19:46:41.622 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012888999999999999 2024-04-01T19:46:41.622 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.622 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.622 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 6", 2024-04-01T19:46:41.622 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:06.472325+0000", 2024-04-01T19:46:41.622 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000132965 2024-04-01T19:46:41.622 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.622 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.622 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:41.622 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:06.484868+0000", 2024-04-01T19:46:41.622 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.012542383000000001 2024-04-01T19:46:41.622 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.623 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.623 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:46:41.623 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:06.484888+0000", 2024-04-01T19:46:41.623 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.0562999999999999e-05 2024-04-01T19:46:41.623 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.623 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.623 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:46:41.623 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:06.484941+0000", 2024-04-01T19:46:41.623 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3105000000000001e-05 2024-04-01T19:46:41.623 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:46:41.623 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:46:41.623 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:46:41.623 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:06.484982+0000", 2024-04-01T19:46:41.623 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0173999999999999e-05 2024-04-01T19:46:41.623 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.623 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:41.623 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.624 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:46:41.624 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:46:41.624 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:46:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:41 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:46:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:41 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:46:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:41 smithi188 ceph-mon[43939]: osdmap e511: 12 total, 12 up, 12 in 2024-04-01T19:46:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:41 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3629986459' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:46:41.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:41 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:41.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:41 smithi188 ceph-mon[43939]: 6.e scrub ok 2024-04-01T19:46:41.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:41 smithi188 ceph-mon[43939]: pgmap v1406: 17 pgs: 17 active+clean; 8.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:46:41.625 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:41 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:46:41.625 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:41 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:46:41.625 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:41 smithi022 ceph-mon[39439]: osdmap e511: 12 total, 12 up, 12 in 2024-04-01T19:46:41.625 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:41 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3629986459' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:46:41.625 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:41 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:41.625 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:41 smithi022 ceph-mon[39439]: 6.e scrub ok 2024-04-01T19:46:41.625 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:41 smithi022 ceph-mon[39439]: pgmap v1406: 17 pgs: 17 active+clean; 8.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:46:41.948 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:46:41.957 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:41.957 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:46:42.058 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:46:42.104 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:42.333 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.333 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.333 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.334 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.334 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.334 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.334 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.334 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.334 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.334 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.334 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.338 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_ops_in_flight 2024-04-01T19:46:42.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.628 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:46:42.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:42.967 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:46:42.970 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:42.971 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:46:43.072 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:46:43.122 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:43.338 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:43 smithi188 ceph-mon[43939]: pgmap v1407: 17 pgs: 17 active+clean; 8.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:46:43.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:43 smithi022 ceph-mon[39439]: pgmap v1407: 17 pgs: 17 active+clean; 8.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:46:43.683 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:46:43.686 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:43.687 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:46:43.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:43 smithi062 ceph-mon[44211]: pgmap v1407: 17 pgs: 17 active+clean; 8.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:46:43.787 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:46:43.829 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:43.956 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:46:43.958 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:46:43.966 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:43.967 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:46:44.067 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:46:44.117 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:44.142 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:46:44.146 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:44.146 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:46:44.247 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:46:44.279 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:44.628 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:46:44.634 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:44.634 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:46:44.735 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:46:44.765 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:44.789 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:46:44.795 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:44.795 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:46:44.896 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:46:44.926 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:44.947 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:46:44.947 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:46:44.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:44.948 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:179308 6.1 e512/469 6:886e68da:::benchmark_data_smithi188_134454_object22567:head v 512'11302, mlcod=512'11299)", 2024-04-01T19:46:44.948 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:46:44.946886+0000", 2024-04-01T19:46:44.948 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0034375230000000001, 2024-04-01T19:46:44.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0034680179999999998, 2024-04-01T19:46:44.948 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:46:44.948 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:46:44.948 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-01T19:46:44.948 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:46:44.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:44.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:46:44.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:44.946886+0000", 2024-04-01T19:46:44.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:44.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:44.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:44.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:46:44.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:44.946886+0000", 2024-04-01T19:46:44.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:44.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:44.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:44.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:46:44.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:44.946887+0000", 2024-04-01T19:46:44.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.094e-06 2024-04-01T19:46:44.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:44.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:44.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:46:44.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:44.946895+0000", 2024-04-01T19:46:44.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8250000000000005e-06 2024-04-01T19:46:44.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:44.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:44.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:46:44.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:44.946905+0000", 2024-04-01T19:46:44.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7440000000000002e-06 2024-04-01T19:46:44.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:44.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:44.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:46:44.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:44.946911+0000", 2024-04-01T19:46:44.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8869999999999997e-06 2024-04-01T19:46:44.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:44.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:44.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:46:44.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:44.946961+0000", 2024-04-01T19:46:44.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0420999999999997e-05 2024-04-01T19:46:44.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:44.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:44.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:46:44.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:44.946984+0000", 2024-04-01T19:46:44.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3127999999999999e-05 2024-04-01T19:46:44.951 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:44.951 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:46:44.951 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:44.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:44.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:44.951 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:179312 6.9 e512/469 6:93849cf8:::benchmark_data_smithi188_134454_object22571:head v 512'11303, mlcod=512'11301)", 2024-04-01T19:46:44.951 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:46:44.948905+0000", 2024-04-01T19:46:44.951 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.001419207, 2024-04-01T19:46:44.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001490929, 2024-04-01T19:46:44.951 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:46:44.952 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:46:44.952 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-01T19:46:44.952 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:46:44.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:44.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:46:44.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:44.948905+0000", 2024-04-01T19:46:44.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:44.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:44.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:44.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:46:44.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:44.948905+0000", 2024-04-01T19:46:44.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:44.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:44.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:44.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:46:44.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:44.948906+0000", 2024-04-01T19:46:44.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5910000000000001e-06 2024-04-01T19:46:44.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:44.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:44.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:46:44.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:44.948916+0000", 2024-04-01T19:46:44.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4939999999999992e-06 2024-04-01T19:46:44.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:44.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:44.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:46:44.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:44.948931+0000", 2024-04-01T19:46:44.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4997999999999999e-05 2024-04-01T19:46:44.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:44.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:44.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:46:44.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:44.948939+0000", 2024-04-01T19:46:44.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4090000000000003e-06 2024-04-01T19:46:44.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:44.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:44.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:46:44.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:44.949277+0000", 2024-04-01T19:46:44.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033837800000000002 2024-04-01T19:46:44.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:44.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:44.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:46:44.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:44.949301+0000", 2024-04-01T19:46:44.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.313e-05 2024-04-01T19:46:44.955 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:44.955 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:46:44.955 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:44.955 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:44.955 INFO:teuthology.orchestra.run.smithi188.stdout: ], 2024-04-01T19:46:44.955 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 2 2024-04-01T19:46:44.955 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:46:44.956 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:44.956 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:46:44.956 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:46:45.057 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:46:45.086 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:45.336 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:46:45.341 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:45.342 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:46:45.388 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.8 to 1 (10000) 2024-04-01T19:46:45.442 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:46:45.504 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:45.531 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:46:45.537 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:45.537 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:46:45.566 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:46:45.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:45 smithi022 ceph-mon[39439]: 6.c scrub starts 2024-04-01T19:46:45.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:45 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:46:45.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:45 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:46:45.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:45 smithi022 ceph-mon[39439]: osdmap e512: 12 total, 12 up, 12 in 2024-04-01T19:46:45.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:45 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1310716381' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T19:46:45.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:45 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:46:45.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:45 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:46:45.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:45 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:46:45.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:45 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:46:45.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:45 smithi188 ceph-mon[43939]: 6.c scrub starts 2024-04-01T19:46:45.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:45 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:46:45.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:45 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:46:45.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:45 smithi188 ceph-mon[43939]: osdmap e512: 12 total, 12 up, 12 in 2024-04-01T19:46:45.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:45 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1310716381' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T19:46:45.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:45 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:46:45.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:45 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:46:45.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:45 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:46:45.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:45 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:46:45.638 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:46:45.664 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:45.686 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:46:45.689 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:45.689 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:46:45.721 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_blocked_ops 2024-04-01T19:46:45.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:45 smithi062 ceph-mon[44211]: 6.c scrub starts 2024-04-01T19:46:45.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:45 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:46:45.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:45 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:46:45.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:45 smithi062 ceph-mon[44211]: osdmap e512: 12 total, 12 up, 12 in 2024-04-01T19:46:45.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:45 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1310716381' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T19:46:45.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:45 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:46:45.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:45 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:46:45.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:45 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:46:45.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:45 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:46:45.790 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:46:45.832 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:45.856 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:46:45.861 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:45.861 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:46:45.962 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:46:46.011 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:46.057 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:46:46.064 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:46:46.071 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:46.072 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:46:46.173 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:46:46.238 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:46.271 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:46:46.284 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:46.285 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:46:46.386 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:46:46.437 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:46.466 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:46:46.469 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:46.470 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:46:46.570 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:46:46.596 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:46 smithi188 ceph-mon[43939]: 6.6 scrub starts 2024-04-01T19:46:46.596 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:46 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1310716381' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]': finished 2024-04-01T19:46:46.596 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:46 smithi188 ceph-mon[43939]: osdmap e513: 12 total, 12 up, 12 in 2024-04-01T19:46:46.598 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:46.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:46 smithi022 ceph-mon[39439]: 6.6 scrub starts 2024-04-01T19:46:46.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:46 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1310716381' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]': finished 2024-04-01T19:46:46.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:46 smithi022 ceph-mon[39439]: osdmap e513: 12 total, 12 up, 12 in 2024-04-01T19:46:46.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:46 smithi062 ceph-mon[44211]: 6.6 scrub starts 2024-04-01T19:46:46.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:46 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1310716381' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]': finished 2024-04-01T19:46:46.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:46 smithi062 ceph-mon[44211]: osdmap e513: 12 total, 12 up, 12 in 2024-04-01T19:46:47.454 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:46:47.455 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:47.456 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:46:47.557 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:46:47.588 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:47.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:47 smithi022 ceph-mon[39439]: 6.c scrub ok 2024-04-01T19:46:47.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:47 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:46:47.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:47 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:46:47.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:46:47.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:46:47.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:46:47.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:46:47.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:46:47.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:47 smithi022 ceph-mon[39439]: pgmap v1411: 17 pgs: 17 active+clean; 8.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.18k op/s 2024-04-01T19:46:47.754 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:47 smithi188 ceph-mon[43939]: 6.c scrub ok 2024-04-01T19:46:47.755 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:47 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:46:47.755 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:47 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:46:47.755 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:46:47.755 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:46:47.755 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:46:47.755 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:46:47.755 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:46:47.755 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:47 smithi188 ceph-mon[43939]: pgmap v1411: 17 pgs: 17 active+clean; 8.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.18k op/s 2024-04-01T19:46:47.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:47 smithi062 ceph-mon[44211]: 6.c scrub ok 2024-04-01T19:46:47.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:47 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:46:47.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:47 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:46:47.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:46:47.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:46:47.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:46:47.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:46:47.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:46:47.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:47 smithi062 ceph-mon[44211]: pgmap v1411: 17 pgs: 17 active+clean; 8.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.18k op/s 2024-04-01T19:46:47.792 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:46:47.795 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:47.796 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:46:47.897 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:46:47.986 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:48.061 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:46:48.061 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:46:48.061 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-01T19:46:48.061 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-01T19:46:48.061 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:46:48.111 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:46:48.114 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:46:48.120 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:48.120 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:46:48.171 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 6 1 2024-04-01T19:46:48.221 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:46:48.270 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:48.305 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:46:48.310 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:48.310 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:46:48.411 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:46:48.488 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:48.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:48 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T19:46:48.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:48 smithi062 ceph-mon[44211]: 6.6 scrub ok 2024-04-01T19:46:48.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:48 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T19:46:48.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:48 smithi062 ceph-mon[44211]: osdmap e514: 12 total, 12 up, 12 in 2024-04-01T19:46:48.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:48 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/920013704' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:46:48.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:48 smithi062 ceph-mon[44211]: from='client.26413 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:46:48.530 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:46:48.541 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:48.542 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:46:48.642 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:46:48.669 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:48 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T19:46:48.670 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:48 smithi188 ceph-mon[43939]: 6.6 scrub ok 2024-04-01T19:46:48.670 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:48 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T19:46:48.670 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:48 smithi188 ceph-mon[43939]: osdmap e514: 12 total, 12 up, 12 in 2024-04-01T19:46:48.670 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:48 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/920013704' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:46:48.670 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:48 smithi188 ceph-mon[43939]: from='client.26413 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:46:48.673 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:48.781 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:48 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T19:46:48.781 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:48 smithi022 ceph-mon[39439]: 6.6 scrub ok 2024-04-01T19:46:48.781 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:48 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T19:46:48.781 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:48 smithi022 ceph-mon[39439]: osdmap e514: 12 total, 12 up, 12 in 2024-04-01T19:46:48.781 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:48 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/920013704' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:46:48.781 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:48 smithi022 ceph-mon[39439]: from='client.26413 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:46:48.799 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:46:48.806 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:48.806 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:46:48.827 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_historic_ops 2024-04-01T19:46:48.907 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:46:48.953 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:48.980 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:46:49.003 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:46:49.007 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:49.008 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:46:49.109 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:46:49.163 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:49.164 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:46:49.210 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:46:49.214 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:49.214 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:46:49.315 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:46:49.346 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:49.421 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:46:49.427 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:49.427 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:46:49.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:49 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:46:49.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:49 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:46:49.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:49 smithi062 ceph-mon[44211]: from='client.26413 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:46:49.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:49 smithi062 ceph-mon[44211]: osdmap e515: 12 total, 12 up, 12 in 2024-04-01T19:46:49.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:49 smithi062 ceph-mon[44211]: pgmap v1414: 17 pgs: 17 active+clean; 8.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:46:49.528 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:46:49.570 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:49.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:49 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:46:49.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:49 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:46:49.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:49 smithi188 ceph-mon[43939]: from='client.26413 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:46:49.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:49 smithi188 ceph-mon[43939]: osdmap e515: 12 total, 12 up, 12 in 2024-04-01T19:46:49.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:49 smithi188 ceph-mon[43939]: pgmap v1414: 17 pgs: 17 active+clean; 8.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:46:49.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:49 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:46:49.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:49 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:46:49.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:49 smithi022 ceph-mon[39439]: from='client.26413 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:46:49.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:49 smithi022 ceph-mon[39439]: osdmap e515: 12 total, 12 up, 12 in 2024-04-01T19:46:49.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:49 smithi022 ceph-mon[39439]: pgmap v1414: 17 pgs: 17 active+clean; 8.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:46:49.940 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:46:49.948 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:49.948 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:46:50.050 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:46:50.095 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:50.137 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:46:50.141 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:50.141 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:46:50.242 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:46:50.274 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:50.449 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:46:50.476 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:46:50.481 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:50.481 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:46:50.582 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:46:50.631 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:50.683 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:46:50.688 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:50.688 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:46:50.789 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:46:50.820 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:50.842 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:46:50.845 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:50.845 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:46:50.946 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:46:50.976 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:50.997 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:46:50.999 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:51.000 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:46:51.100 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:46:51.133 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:51.156 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:46:51.159 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:46:51.159 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:46:51.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:46:51.159 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:46:51.159 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.159 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:238019 5.e 5:750fdb7c:::benchmark_data_smithi188_119427_object73320:head [delete] snapc 0=[] ondisk+write+known_if_redirected e438)", 2024-04-01T19:46:51.159 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:46.928281+0000", 2024-04-01T19:46:51.159 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 244.230766851, 2024-04-01T19:46:51.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14729735199999999, 2024-04-01T19:46:51.159 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:46:51.159 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:46:51.160 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:51.160 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:46:51.160 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:46:51.160 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:51.160 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 238019 2024-04-01T19:46:51.160 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.160 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:46:51.160 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.160 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:46:51.160 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:46.928281+0000", 2024-04-01T19:46:51.160 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.160 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.160 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.160 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:46:51.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:46.928281+0000", 2024-04-01T19:46:51.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:46:51.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:46.928283+0000", 2024-04-01T19:46:51.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3350000000000001e-06 2024-04-01T19:46:51.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:46:51.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:46.928289+0000", 2024-04-01T19:46:51.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1140000000000002e-06 2024-04-01T19:46:51.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.162 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.162 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:46:51.162 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:46.928302+0000", 2024-04-01T19:46:51.162 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2072000000000001e-05 2024-04-01T19:46:51.162 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.162 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.162 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:46:51.162 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:46.928313+0000", 2024-04-01T19:46:51.162 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1289e-05 2024-04-01T19:46:51.162 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.162 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.162 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:46:51.162 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.026624+0000", 2024-04-01T19:46:51.163 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.098311401000000007 2024-04-01T19:46:51.163 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.163 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.163 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:46:51.163 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.026701+0000", 2024-04-01T19:46:51.163 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7068000000000001e-05 2024-04-01T19:46:51.163 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.163 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.163 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:46:51.163 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.026776+0000", 2024-04-01T19:46:51.163 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4688e-05 2024-04-01T19:46:51.163 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.164 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.164 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:46:51.164 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.045371+0000", 2024-04-01T19:46:51.164 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018594968 2024-04-01T19:46:51.164 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.164 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.164 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:51.164 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.075461+0000", 2024-04-01T19:46:51.164 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.030089714 2024-04-01T19:46:51.164 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.164 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.164 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:46:51.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.075521+0000", 2024-04-01T19:46:51.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9891e-05 2024-04-01T19:46:51.165 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.165 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.165 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:46:51.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.075578+0000", 2024-04-01T19:46:51.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7812000000000001e-05 2024-04-01T19:46:51.165 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.165 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:46:51.165 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.165 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.165 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.165 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:238163 5.e 5:7d64007c:::benchmark_data_smithi188_119427_object73464:head [delete] snapc 0=[] ondisk+write+known_if_redirected e438)", 2024-04-01T19:46:51.166 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:47.098524+0000", 2024-04-01T19:46:51.166 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 244.060524106, 2024-04-01T19:46:51.166 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.145365941, 2024-04-01T19:46:51.166 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:46:51.166 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:46:51.166 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:51.166 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:46:51.166 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:46:51.166 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:51.166 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 238163 2024-04-01T19:46:51.166 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.167 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:46:51.167 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.167 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:46:51.167 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.098524+0000", 2024-04-01T19:46:51.167 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.167 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.167 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.167 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:46:51.167 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.098524+0000", 2024-04-01T19:46:51.167 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.167 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.167 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.167 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:46:51.168 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.098526+0000", 2024-04-01T19:46:51.168 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.86e-06 2024-04-01T19:46:51.168 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.168 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.168 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:46:51.168 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.098531+0000", 2024-04-01T19:46:51.168 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8710000000000002e-06 2024-04-01T19:46:51.168 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.168 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.168 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:46:51.168 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.098544+0000", 2024-04-01T19:46:51.168 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2089000000000001e-05 2024-04-01T19:46:51.169 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.169 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:46:51.169 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.098552+0000", 2024-04-01T19:46:51.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3839999999999997e-06 2024-04-01T19:46:51.169 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.169 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:46:51.169 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.179915+0000", 2024-04-01T19:46:51.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.081363114 2024-04-01T19:46:51.169 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.169 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:46:51.170 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.180034+0000", 2024-04-01T19:46:51.170 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000118565 2024-04-01T19:46:51.170 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.170 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.170 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:46:51.170 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.180157+0000", 2024-04-01T19:46:51.170 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000123776 2024-04-01T19:46:51.170 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.170 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.170 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:46:51.170 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.185118+0000", 2024-04-01T19:46:51.170 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0049610610000000001 2024-04-01T19:46:51.171 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:51.171 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.243818+0000", 2024-04-01T19:46:51.171 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.058699220000000003 2024-04-01T19:46:51.171 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:46:51.171 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.243851+0000", 2024-04-01T19:46:51.171 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3481e-05 2024-04-01T19:46:51.171 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:46:51.171 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.243890+0000", 2024-04-01T19:46:51.172 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8519999999999997e-05 2024-04-01T19:46:51.172 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.172 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:46:51.172 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.172 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.172 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.172 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:238172 5.e 5:7b73ef97:::benchmark_data_smithi188_119427_object73473:head [delete] snapc 0=[] ondisk+write+known_if_redirected e438)", 2024-04-01T19:46:51.172 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:47.111601+0000", 2024-04-01T19:46:51.172 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 244.04744704699999, 2024-04-01T19:46:51.172 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.145813266, 2024-04-01T19:46:51.172 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:46:51.172 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:46:51.172 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:51.172 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:46:51.173 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:46:51.173 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:51.173 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 238172 2024-04-01T19:46:51.173 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.173 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:46:51.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:46:51.173 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.111601+0000", 2024-04-01T19:46:51.173 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.173 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:46:51.173 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.111601+0000", 2024-04-01T19:46:51.173 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.174 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:46:51.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.111603+0000", 2024-04-01T19:46:51.174 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.136e-06 2024-04-01T19:46:51.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.174 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:46:51.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.111608+0000", 2024-04-01T19:46:51.174 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8849999999999998e-06 2024-04-01T19:46:51.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.174 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:46:51.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.111618+0000", 2024-04-01T19:46:51.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0631999999999999e-05 2024-04-01T19:46:51.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.175 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:46:51.175 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.111625+0000", 2024-04-01T19:46:51.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5359999999999998e-06 2024-04-01T19:46:51.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.175 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:46:51.175 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.185777+0000", 2024-04-01T19:46:51.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.074151792999999994 2024-04-01T19:46:51.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.175 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:46:51.176 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.185862+0000", 2024-04-01T19:46:51.176 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4825000000000002e-05 2024-04-01T19:46:51.176 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.176 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:46:51.176 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.185938+0000", 2024-04-01T19:46:51.176 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6811999999999996e-05 2024-04-01T19:46:51.176 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.176 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:46:51.176 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.200215+0000", 2024-04-01T19:46:51.176 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014276987 2024-04-01T19:46:51.176 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.177 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.177 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:51.177 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.257294+0000", 2024-04-01T19:46:51.177 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057078126 2024-04-01T19:46:51.177 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.177 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.177 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:46:51.177 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.257353+0000", 2024-04-01T19:46:51.177 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9914000000000003e-05 2024-04-01T19:46:51.177 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.177 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.177 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:46:51.177 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.257414+0000", 2024-04-01T19:46:51.178 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0619999999999999e-05 2024-04-01T19:46:51.178 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.178 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:46:51.178 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.178 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.178 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.178 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:238173 5.e 5:7aa7ffa2:::benchmark_data_smithi188_119427_object73474:head [delete] snapc 0=[] ondisk+write+known_if_redirected e438)", 2024-04-01T19:46:51.178 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:47.112993+0000", 2024-04-01T19:46:51.178 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 244.04605504, 2024-04-01T19:46:51.178 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.144539944, 2024-04-01T19:46:51.178 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:46:51.178 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:46:51.178 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:51.179 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:46:51.179 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:46:51.179 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:51.179 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 238173 2024-04-01T19:46:51.179 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.179 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:46:51.179 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.179 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:46:51.179 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.112993+0000", 2024-04-01T19:46:51.179 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.179 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.179 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.179 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:46:51.179 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.112993+0000", 2024-04-01T19:46:51.179 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.180 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.180 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.180 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:46:51.180 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.112994+0000", 2024-04-01T19:46:51.180 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.31e-06 2024-04-01T19:46:51.180 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.180 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.180 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:46:51.180 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.112999+0000", 2024-04-01T19:46:51.180 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6990000000000002e-06 2024-04-01T19:46:51.180 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.180 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.180 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:46:51.180 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.113009+0000", 2024-04-01T19:46:51.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0083e-05 2024-04-01T19:46:51.181 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.181 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.181 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:46:51.181 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.113015+0000", 2024-04-01T19:46:51.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8300000000000001e-06 2024-04-01T19:46:51.181 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.181 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.181 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:46:51.181 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.189329+0000", 2024-04-01T19:46:51.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.076313952000000004 2024-04-01T19:46:51.181 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.181 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.182 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:46:51.182 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.189415+0000", 2024-04-01T19:46:51.182 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6170999999999999e-05 2024-04-01T19:46:51.182 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.182 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.182 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:46:51.182 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.189485+0000", 2024-04-01T19:46:51.182 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0061999999999994e-05 2024-04-01T19:46:51.182 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.182 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.182 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:46:51.182 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.200420+0000", 2024-04-01T19:46:51.182 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010935215 2024-04-01T19:46:51.182 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:51.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.257454+0000", 2024-04-01T19:46:51.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057033410999999999 2024-04-01T19:46:51.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:46:51.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.257487+0000", 2024-04-01T19:46:51.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3145000000000002e-05 2024-04-01T19:46:51.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:46:51.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.257533+0000", 2024-04-01T19:46:51.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6066000000000002e-05 2024-04-01T19:46:51.184 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.184 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:46:51.184 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.184 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.184 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.184 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:238519 5.e 5:766a0a9f:::benchmark_data_smithi188_119427_object73820:head [delete] snapc 0=[] ondisk+write+known_if_redirected e438)", 2024-04-01T19:46:51.184 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:47.666323+0000", 2024-04-01T19:46:51.184 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 243.49272523600001, 2024-04-01T19:46:51.184 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.15312003399999999, 2024-04-01T19:46:51.184 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:46:51.184 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:46:51.184 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:51.184 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:46:51.184 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:46:51.185 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:51.185 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 238519 2024-04-01T19:46:51.185 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.185 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:46:51.185 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.185 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:46:51.185 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.666323+0000", 2024-04-01T19:46:51.185 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.185 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.185 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.185 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:46:51.185 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.666323+0000", 2024-04-01T19:46:51.185 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.185 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.186 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.186 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:46:51.186 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.666324+0000", 2024-04-01T19:46:51.186 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.716e-06 2024-04-01T19:46:51.186 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.186 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.186 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:46:51.186 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.666330+0000", 2024-04-01T19:46:51.186 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8279999999999999e-06 2024-04-01T19:46:51.186 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.186 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.186 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:46:51.186 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.666349+0000", 2024-04-01T19:46:51.186 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8372999999999998e-05 2024-04-01T19:46:51.187 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.187 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.187 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:46:51.187 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.666357+0000", 2024-04-01T19:46:51.187 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1610000000000003e-06 2024-04-01T19:46:51.187 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.187 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.187 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:46:51.187 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.678782+0000", 2024-04-01T19:46:51.187 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012425805 2024-04-01T19:46:51.187 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.187 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.187 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:46:51.187 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.678855+0000", 2024-04-01T19:46:51.188 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2711000000000002e-05 2024-04-01T19:46:51.188 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.188 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.188 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:46:51.188 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.678926+0000", 2024-04-01T19:46:51.188 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0366999999999999e-05 2024-04-01T19:46:51.188 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.188 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.188 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:46:51.188 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.681905+0000", 2024-04-01T19:46:51.188 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0029797439999999999 2024-04-01T19:46:51.188 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.188 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.188 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:51.189 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.819312+0000", 2024-04-01T19:46:51.189 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.137407055 2024-04-01T19:46:51.189 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.189 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.189 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:46:51.189 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.819380+0000", 2024-04-01T19:46:51.189 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7310000000000004e-05 2024-04-01T19:46:51.189 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.189 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.189 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:46:51.189 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.819443+0000", 2024-04-01T19:46:51.189 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2964000000000002e-05 2024-04-01T19:46:51.189 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.189 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:46:51.190 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.190 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.190 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.190 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:238559 5.e 5:7e67e7e3:::benchmark_data_smithi188_119427_object73860:head [delete] snapc 0=[] ondisk+write+known_if_redirected e438)", 2024-04-01T19:46:51.190 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:47.736979+0000", 2024-04-01T19:46:51.190 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 243.42206861099999, 2024-04-01T19:46:51.190 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.141987692, 2024-04-01T19:46:51.190 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:46:51.190 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:46:51.190 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:51.190 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:46:51.190 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:46:51.190 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:51.191 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 238559 2024-04-01T19:46:51.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.191 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:46:51.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:46:51.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.736979+0000", 2024-04-01T19:46:51.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:46:51.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.736979+0000", 2024-04-01T19:46:51.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.192 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:46:51.192 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.736981+0000", 2024-04-01T19:46:51.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.99e-06 2024-04-01T19:46:51.192 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.192 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:46:51.192 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.736988+0000", 2024-04-01T19:46:51.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3720000000000001e-06 2024-04-01T19:46:51.192 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.192 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:46:51.192 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.737002+0000", 2024-04-01T19:46:51.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4704e-05 2024-04-01T19:46:51.192 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.193 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.193 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:46:51.193 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.737010+0000", 2024-04-01T19:46:51.193 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.824e-06 2024-04-01T19:46:51.193 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.193 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.193 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:46:51.193 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.821221+0000", 2024-04-01T19:46:51.193 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.084210454000000004 2024-04-01T19:46:51.193 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.193 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.193 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:46:51.193 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.821293+0000", 2024-04-01T19:46:51.193 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2070999999999995e-05 2024-04-01T19:46:51.194 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.194 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.194 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:46:51.194 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.821372+0000", 2024-04-01T19:46:51.194 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9518000000000007e-05 2024-04-01T19:46:51.194 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.194 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.194 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:46:51.194 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.829060+0000", 2024-04-01T19:46:51.194 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.007688266 2024-04-01T19:46:51.194 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.194 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.194 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:51.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.878853+0000", 2024-04-01T19:46:51.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.049792809 2024-04-01T19:46:51.195 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.195 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:46:51.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.878911+0000", 2024-04-01T19:46:51.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7299000000000001e-05 2024-04-01T19:46:51.195 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.195 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:46:51.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.878967+0000", 2024-04-01T19:46:51.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6385000000000003e-05 2024-04-01T19:46:51.195 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.196 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:46:51.196 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.196 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.196 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:246215 5.e 5:70d39fe3:::benchmark_data_smithi188_119427_object81516:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:46:51.196 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:57.222148+0000", 2024-04-01T19:46:51.196 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 233.93689982999999, 2024-04-01T19:46:51.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.150925477, 2024-04-01T19:46:51.196 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:46:51.196 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:46:51.196 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:51.196 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:46:51.196 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:46:51.196 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:51.196 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 246215 2024-04-01T19:46:51.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.197 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:46:51.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.197 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:46:51.197 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.222148+0000", 2024-04-01T19:46:51.197 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.197 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:46:51.197 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.222148+0000", 2024-04-01T19:46:51.197 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.198 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:46:51.198 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.222150+0000", 2024-04-01T19:46:51.198 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6819999999999999e-06 2024-04-01T19:46:51.198 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.198 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.198 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:46:51.198 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.222155+0000", 2024-04-01T19:46:51.198 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8470000000000003e-06 2024-04-01T19:46:51.198 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.198 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.198 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:46:51.198 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.222164+0000", 2024-04-01T19:46:51.198 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7229999999999999e-06 2024-04-01T19:46:51.199 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.199 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.199 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:46:51.199 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.222173+0000", 2024-04-01T19:46:51.199 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5990000000000002e-06 2024-04-01T19:46:51.199 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.199 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.199 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:46:51.199 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.262858+0000", 2024-04-01T19:46:51.199 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040685429000000002 2024-04-01T19:46:51.199 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.199 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.199 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:46:51.199 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.262972+0000", 2024-04-01T19:46:51.200 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011387099999999999 2024-04-01T19:46:51.200 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.200 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:46:51.200 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.263100+0000", 2024-04-01T19:46:51.200 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012828000000000001 2024-04-01T19:46:51.200 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.200 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:46:51.200 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.270033+0000", 2024-04-01T19:46:51.200 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00693298 2024-04-01T19:46:51.200 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.200 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:51.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.372953+0000", 2024-04-01T19:46:51.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.102919468 2024-04-01T19:46:51.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:46:51.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.373012+0000", 2024-04-01T19:46:51.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9497999999999999e-05 2024-04-01T19:46:51.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:46:51.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.373073+0000", 2024-04-01T19:46:51.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1099999999999994e-05 2024-04-01T19:46:51.201 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.201 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:46:51.202 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.202 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:246487 5.e 5:766cee34:::benchmark_data_smithi188_119427_object81788:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:46:51.202 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:57.583529+0000", 2024-04-01T19:46:51.202 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 233.57551907000001, 2024-04-01T19:46:51.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.143597589, 2024-04-01T19:46:51.202 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:46:51.202 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:46:51.202 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:51.202 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:46:51.202 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:46:51.202 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:51.203 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 246487 2024-04-01T19:46:51.203 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.203 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:46:51.203 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.203 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:46:51.203 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.583529+0000", 2024-04-01T19:46:51.203 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.203 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.203 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.203 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:46:51.203 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.583529+0000", 2024-04-01T19:46:51.203 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.203 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.203 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:46:51.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.583531+0000", 2024-04-01T19:46:51.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7969999999999999e-06 2024-04-01T19:46:51.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:46:51.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.583536+0000", 2024-04-01T19:46:51.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4029999999999998e-06 2024-04-01T19:46:51.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:46:51.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.583547+0000", 2024-04-01T19:46:51.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1131000000000001e-05 2024-04-01T19:46:51.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.205 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.205 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:46:51.205 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.583556+0000", 2024-04-01T19:46:51.205 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5960000000000004e-06 2024-04-01T19:46:51.205 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.205 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.205 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:46:51.205 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.669216+0000", 2024-04-01T19:46:51.205 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.085660293999999998 2024-04-01T19:46:51.205 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.205 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.205 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:46:51.205 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.669346+0000", 2024-04-01T19:46:51.205 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012951799999999999 2024-04-01T19:46:51.206 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.206 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.206 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:46:51.206 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.669467+0000", 2024-04-01T19:46:51.206 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012171 2024-04-01T19:46:51.206 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.206 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.206 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:46:51.206 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.673427+0000", 2024-04-01T19:46:51.206 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0039599769999999999 2024-04-01T19:46:51.206 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.206 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.206 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:51.207 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.727009+0000", 2024-04-01T19:46:51.207 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.053581393999999997 2024-04-01T19:46:51.207 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.207 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.207 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:46:51.207 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.727068+0000", 2024-04-01T19:46:51.207 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9231000000000003e-05 2024-04-01T19:46:51.207 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.207 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.207 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:46:51.207 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.727126+0000", 2024-04-01T19:46:51.207 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8538000000000001e-05 2024-04-01T19:46:51.207 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.207 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:46:51.208 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.208 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.208 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.208 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:246499 5.e 5:791b0087:::benchmark_data_smithi188_119427_object81800:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:46:51.208 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:57.593579+0000", 2024-04-01T19:46:51.208 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 233.565469216, 2024-04-01T19:46:51.208 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13367478099999999, 2024-04-01T19:46:51.208 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:46:51.208 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:46:51.208 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:51.208 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:46:51.208 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:46:51.208 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:51.209 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 246499 2024-04-01T19:46:51.209 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.209 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:46:51.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.209 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:46:51.209 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.593579+0000", 2024-04-01T19:46:51.209 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.209 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.209 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:46:51.209 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.593579+0000", 2024-04-01T19:46:51.209 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.209 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.210 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:46:51.210 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.593583+0000", 2024-04-01T19:46:51.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3989999999999997e-06 2024-04-01T19:46:51.210 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.210 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.210 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:46:51.210 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.593589+0000", 2024-04-01T19:46:51.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5899999999999998e-06 2024-04-01T19:46:51.210 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.210 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.210 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:46:51.210 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.593600+0000", 2024-04-01T19:46:51.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1314e-05 2024-04-01T19:46:51.210 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.211 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.211 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:46:51.211 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.593607+0000", 2024-04-01T19:46:51.211 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4869999999999996e-06 2024-04-01T19:46:51.211 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.211 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.211 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:46:51.211 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.674372+0000", 2024-04-01T19:46:51.211 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.080764781999999993 2024-04-01T19:46:51.211 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.211 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.211 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:46:51.211 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.674485+0000", 2024-04-01T19:46:51.212 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000112512 2024-04-01T19:46:51.212 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.212 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.212 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:46:51.212 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.674602+0000", 2024-04-01T19:46:51.212 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000116805 2024-04-01T19:46:51.212 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.212 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.212 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:46:51.212 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.682794+0000", 2024-04-01T19:46:51.212 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0081925360000000003 2024-04-01T19:46:51.212 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.212 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.212 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:51.212 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.727173+0000", 2024-04-01T19:46:51.213 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044378487000000001 2024-04-01T19:46:51.213 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.213 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.213 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:46:51.213 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.727205+0000", 2024-04-01T19:46:51.213 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2107999999999998e-05 2024-04-01T19:46:51.213 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.213 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.213 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:46:51.213 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.727253+0000", 2024-04-01T19:46:51.213 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8761000000000003e-05 2024-04-01T19:46:51.213 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.213 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:46:51.214 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.214 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.214 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.214 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:246632 5.e 5:7587dfb3:::benchmark_data_smithi188_119427_object81933:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:46:51.214 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:57.751990+0000", 2024-04-01T19:46:51.214 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 233.407057829, 2024-04-01T19:46:51.214 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16018565300000001, 2024-04-01T19:46:51.214 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:46:51.214 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:46:51.214 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:51.214 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:46:51.214 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:46:51.214 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:51.215 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 246632 2024-04-01T19:46:51.215 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.215 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:46:51.215 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.215 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:46:51.215 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.751990+0000", 2024-04-01T19:46:51.215 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.215 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.215 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.215 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:46:51.215 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.751990+0000", 2024-04-01T19:46:51.215 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.215 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.215 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:46:51.216 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.751992+0000", 2024-04-01T19:46:51.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.131e-06 2024-04-01T19:46:51.216 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:46:51.216 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.751997+0000", 2024-04-01T19:46:51.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8489999999999997e-06 2024-04-01T19:46:51.216 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:46:51.216 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.752007+0000", 2024-04-01T19:46:51.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8290000000000003e-06 2024-04-01T19:46:51.216 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.217 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.217 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:46:51.217 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.752014+0000", 2024-04-01T19:46:51.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9630000000000001e-06 2024-04-01T19:46:51.217 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.217 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.217 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:46:51.217 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.840140+0000", 2024-04-01T19:46:51.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.088125762999999996 2024-04-01T19:46:51.217 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.217 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.217 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:46:51.217 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.840225+0000", 2024-04-01T19:46:51.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4982999999999996e-05 2024-04-01T19:46:51.218 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.218 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.218 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:46:51.218 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.840304+0000", 2024-04-01T19:46:51.218 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9394000000000006e-05 2024-04-01T19:46:51.218 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.218 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.218 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:46:51.218 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.848758+0000", 2024-04-01T19:46:51.218 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0084542420000000007 2024-04-01T19:46:51.218 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.218 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.218 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:51.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.912087+0000", 2024-04-01T19:46:51.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.063328655999999997 2024-04-01T19:46:51.219 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:46:51.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.912119+0000", 2024-04-01T19:46:51.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1844999999999997e-05 2024-04-01T19:46:51.219 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:46:51.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.912176+0000", 2024-04-01T19:46:51.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6997999999999999e-05 2024-04-01T19:46:51.219 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.219 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:46:51.220 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.220 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.220 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:246802 5.e 5:7e9a5833:::benchmark_data_smithi188_119427_object82103:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:46:51.220 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:57.952003+0000", 2024-04-01T19:46:51.220 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 233.20704515400001, 2024-04-01T19:46:51.220 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.134434158, 2024-04-01T19:46:51.220 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:46:51.220 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:46:51.220 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:51.220 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:46:51.220 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:46:51.220 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:51.220 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 246802 2024-04-01T19:46:51.221 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.221 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:46:51.221 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.221 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:46:51.221 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.952003+0000", 2024-04-01T19:46:51.221 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.221 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.221 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.221 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:46:51.221 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.952003+0000", 2024-04-01T19:46:51.221 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.221 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.221 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.221 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:46:51.222 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.952005+0000", 2024-04-01T19:46:51.222 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.807e-06 2024-04-01T19:46:51.222 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.222 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.222 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:46:51.222 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.952010+0000", 2024-04-01T19:46:51.222 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.383e-06 2024-04-01T19:46:51.222 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.222 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.222 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:46:51.222 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.952022+0000", 2024-04-01T19:46:51.222 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1949e-05 2024-04-01T19:46:51.223 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.223 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.223 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:46:51.223 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.952030+0000", 2024-04-01T19:46:51.223 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1780000000000003e-06 2024-04-01T19:46:51.223 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.223 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.223 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:46:51.223 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.028287+0000", 2024-04-01T19:46:51.223 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.076257458 2024-04-01T19:46:51.223 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.223 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.223 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:46:51.224 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.028393+0000", 2024-04-01T19:46:51.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000105518 2024-04-01T19:46:51.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:46:51.224 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.028484+0000", 2024-04-01T19:46:51.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1087000000000004e-05 2024-04-01T19:46:51.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:46:51.224 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.037744+0000", 2024-04-01T19:46:51.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0092600930000000005 2024-04-01T19:46:51.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:51.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.086349+0000", 2024-04-01T19:46:51.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.048604895000000002 2024-04-01T19:46:51.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:46:51.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.086402+0000", 2024-04-01T19:46:51.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2729999999999998e-05 2024-04-01T19:46:51.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:46:51.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.086437+0000", 2024-04-01T19:46:51.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.506e-05 2024-04-01T19:46:51.226 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.226 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:46:51.226 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.226 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.226 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:246986 5.e 5:787e6bb3:::benchmark_data_smithi188_119427_object82287:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:46:51.226 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:58.138627+0000", 2024-04-01T19:46:51.226 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 233.020420817, 2024-04-01T19:46:51.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13521234300000001, 2024-04-01T19:46:51.226 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:46:51.227 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:46:51.227 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:51.227 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:46:51.227 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:46:51.227 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:51.227 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 246986 2024-04-01T19:46:51.227 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.227 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:46:51.227 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.227 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:46:51.227 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.138627+0000", 2024-04-01T19:46:51.227 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.227 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.227 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.228 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:46:51.228 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.138627+0000", 2024-04-01T19:46:51.228 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.228 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.228 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:46:51.228 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.138628+0000", 2024-04-01T19:46:51.228 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.375e-06 2024-04-01T19:46:51.228 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.228 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:46:51.228 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.138633+0000", 2024-04-01T19:46:51.228 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7620000000000003e-06 2024-04-01T19:46:51.228 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:46:51.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.138647+0000", 2024-04-01T19:46:51.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4042999999999999e-05 2024-04-01T19:46:51.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:46:51.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.138655+0000", 2024-04-01T19:46:51.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7009999999999996e-06 2024-04-01T19:46:51.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:46:51.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.208631+0000", 2024-04-01T19:46:51.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.069975869999999996 2024-04-01T19:46:51.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:46:51.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.208738+0000", 2024-04-01T19:46:51.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000107107 2024-04-01T19:46:51.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:46:51.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.208820+0000", 2024-04-01T19:46:51.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1889000000000002e-05 2024-04-01T19:46:51.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:46:51.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.224386+0000", 2024-04-01T19:46:51.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015566663999999999 2024-04-01T19:46:51.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:51.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.273768+0000", 2024-04-01T19:46:51.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.049381240999999999 2024-04-01T19:46:51.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:46:51.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.273801+0000", 2024-04-01T19:46:51.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3451000000000002e-05 2024-04-01T19:46:51.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:46:51.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.273839+0000", 2024-04-01T19:46:51.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.824e-05 2024-04-01T19:46:51.232 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.232 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:46:51.232 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.232 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.232 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:247253 5.e 5:786b3885:::benchmark_data_smithi188_119427_object82554:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:46:51.232 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:58.480980+0000", 2024-04-01T19:46:51.232 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 232.678067556, 2024-04-01T19:46:51.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16030156200000001, 2024-04-01T19:46:51.232 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:46:51.232 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:46:51.232 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:51.233 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:46:51.233 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:46:51.233 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:51.233 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 247253 2024-04-01T19:46:51.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.233 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:46:51.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.233 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:46:51.233 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.480980+0000", 2024-04-01T19:46:51.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.233 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:46:51.233 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.480980+0000", 2024-04-01T19:46:51.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.234 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:46:51.234 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.480982+0000", 2024-04-01T19:46:51.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.204e-06 2024-04-01T19:46:51.234 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.234 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:46:51.234 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.480988+0000", 2024-04-01T19:46:51.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.412e-06 2024-04-01T19:46:51.234 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.234 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:46:51.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.481000+0000", 2024-04-01T19:46:51.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1712000000000001e-05 2024-04-01T19:46:51.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:46:51.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.481006+0000", 2024-04-01T19:46:51.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1770000000000003e-06 2024-04-01T19:46:51.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:46:51.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.578568+0000", 2024-04-01T19:46:51.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.097561964000000001 2024-04-01T19:46:51.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:46:51.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.578646+0000", 2024-04-01T19:46:51.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8306999999999994e-05 2024-04-01T19:46:51.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:46:51.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.578716+0000", 2024-04-01T19:46:51.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0148000000000007e-05 2024-04-01T19:46:51.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:46:51.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.590688+0000", 2024-04-01T19:46:51.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011972175 2024-04-01T19:46:51.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:51.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.641213+0000", 2024-04-01T19:46:51.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.050525077000000002 2024-04-01T19:46:51.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:46:51.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.641246+0000", 2024-04-01T19:46:51.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2274999999999998e-05 2024-04-01T19:46:51.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:46:51.238 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.641282+0000", 2024-04-01T19:46:51.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6111e-05 2024-04-01T19:46:51.238 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.238 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:46:51.238 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.238 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.238 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.238 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:247397 5.e 5:732d2c78:::benchmark_data_smithi188_119427_object82698:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:46:51.238 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:58.655614+0000", 2024-04-01T19:46:51.238 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 232.50343412399999, 2024-04-01T19:46:51.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13616674000000001, 2024-04-01T19:46:51.238 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:46:51.238 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:46:51.239 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:51.239 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:46:51.239 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:46:51.239 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:51.239 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 247397 2024-04-01T19:46:51.239 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.239 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:46:51.239 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.239 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:46:51.239 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.655614+0000", 2024-04-01T19:46:51.239 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.239 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.239 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.239 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:46:51.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.655614+0000", 2024-04-01T19:46:51.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:46:51.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.655616+0000", 2024-04-01T19:46:51.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8109999999999999e-06 2024-04-01T19:46:51.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:46:51.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.655621+0000", 2024-04-01T19:46:51.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6799999999999998e-06 2024-04-01T19:46:51.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:46:51.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.655632+0000", 2024-04-01T19:46:51.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0464e-05 2024-04-01T19:46:51.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:46:51.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.655638+0000", 2024-04-01T19:46:51.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2639999999999997e-06 2024-04-01T19:46:51.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:46:51.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.740332+0000", 2024-04-01T19:46:51.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.084693972000000006 2024-04-01T19:46:51.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:46:51.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.740430+0000", 2024-04-01T19:46:51.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7707000000000005e-05 2024-04-01T19:46:51.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:46:51.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.740511+0000", 2024-04-01T19:46:51.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1216000000000003e-05 2024-04-01T19:46:51.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:46:51.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.743892+0000", 2024-04-01T19:46:51.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0033814449999999999 2024-04-01T19:46:51.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:51.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.791713+0000", 2024-04-01T19:46:51.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.047820254 2024-04-01T19:46:51.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:46:51.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.791743+0000", 2024-04-01T19:46:51.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0593999999999999e-05 2024-04-01T19:46:51.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:46:51.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.791780+0000", 2024-04-01T19:46:51.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7333000000000003e-05 2024-04-01T19:46:51.244 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.244 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:46:51.244 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.244 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:248550 5.e 5:7e0cfda9:::benchmark_data_smithi188_119427_object83851:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:46:51.244 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:43:00.030777+0000", 2024-04-01T19:46:51.244 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 231.128271015, 2024-04-01T19:46:51.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16407606899999999, 2024-04-01T19:46:51.244 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:46:51.244 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:46:51.244 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:51.244 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:46:51.245 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:46:51.245 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:51.245 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 248550 2024-04-01T19:46:51.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.245 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:46:51.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.245 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:46:51.245 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.030777+0000", 2024-04-01T19:46:51.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.245 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:46:51.245 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.030777+0000", 2024-04-01T19:46:51.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:46:51.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.030779+0000", 2024-04-01T19:46:51.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3769999999999999e-06 2024-04-01T19:46:51.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:46:51.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.030786+0000", 2024-04-01T19:46:51.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.404e-06 2024-04-01T19:46:51.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:46:51.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.030798+0000", 2024-04-01T19:46:51.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2852e-05 2024-04-01T19:46:51.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:46:51.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.030807+0000", 2024-04-01T19:46:51.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5580000000000001e-06 2024-04-01T19:46:51.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:46:51.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.049634+0000", 2024-04-01T19:46:51.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018827334000000001 2024-04-01T19:46:51.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:46:51.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.049748+0000", 2024-04-01T19:46:51.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000113241 2024-04-01T19:46:51.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:46:51.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.050301+0000", 2024-04-01T19:46:51.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00055343600000000003 2024-04-01T19:46:51.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:46:51.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.058890+0000", 2024-04-01T19:46:51.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085885749999999993 2024-04-01T19:46:51.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.249 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:51.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.194775+0000", 2024-04-01T19:46:51.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13588499100000001 2024-04-01T19:46:51.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.249 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:46:51.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.194810+0000", 2024-04-01T19:46:51.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5224e-05 2024-04-01T19:46:51.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.249 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:46:51.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.194853+0000", 2024-04-01T19:46:51.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3077000000000001e-05 2024-04-01T19:46:51.249 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.249 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:46:51.250 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.250 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.250 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.250 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:248556 5.e 5:77bbb544:::benchmark_data_smithi188_119427_object83857:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:46:51.250 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:43:00.042657+0000", 2024-04-01T19:46:51.250 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 231.116391185, 2024-04-01T19:46:51.250 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.152348768, 2024-04-01T19:46:51.250 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:46:51.250 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:46:51.250 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:51.250 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:46:51.250 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:46:51.250 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:51.250 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 248556 2024-04-01T19:46:51.251 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.251 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:46:51.251 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.251 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:46:51.251 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.042657+0000", 2024-04-01T19:46:51.251 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.251 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.251 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.251 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:46:51.251 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.042657+0000", 2024-04-01T19:46:51.251 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.251 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.251 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.251 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:46:51.251 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.042659+0000", 2024-04-01T19:46:51.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.057e-06 2024-04-01T19:46:51.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:46:51.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.042664+0000", 2024-04-01T19:46:51.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.792e-06 2024-04-01T19:46:51.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:46:51.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.042671+0000", 2024-04-01T19:46:51.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4780000000000002e-06 2024-04-01T19:46:51.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:46:51.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.042678+0000", 2024-04-01T19:46:51.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9589999999999998e-06 2024-04-01T19:46:51.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:46:51.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.054676+0000", 2024-04-01T19:46:51.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011997885999999999 2024-04-01T19:46:51.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:46:51.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.054796+0000", 2024-04-01T19:46:51.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000120449 2024-04-01T19:46:51.254 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.254 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.254 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:46:51.254 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.054920+0000", 2024-04-01T19:46:51.254 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012366699999999999 2024-04-01T19:46:51.254 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.254 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.254 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:46:51.254 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.059008+0000", 2024-04-01T19:46:51.254 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040880329999999996 2024-04-01T19:46:51.254 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.254 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.254 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:51.255 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.194900+0000", 2024-04-01T19:46:51.255 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13589177699999999 2024-04-01T19:46:51.255 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.255 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.255 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:46:51.255 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.194953+0000", 2024-04-01T19:46:51.255 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3508000000000003e-05 2024-04-01T19:46:51.255 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.255 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.255 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:46:51.255 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.195005+0000", 2024-04-01T19:46:51.255 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2162e-05 2024-04-01T19:46:51.255 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.255 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:46:51.256 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.256 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.256 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:248696 5.e 5:74f18be6:::benchmark_data_smithi188_119427_object83997:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:46:51.256 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:43:00.285722+0000", 2024-04-01T19:46:51.256 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 230.87332616899999, 2024-04-01T19:46:51.256 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.148233119, 2024-04-01T19:46:51.256 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:46:51.256 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:46:51.256 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:51.256 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:46:51.256 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:46:51.257 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:51.257 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 248696 2024-04-01T19:46:51.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.257 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:46:51.257 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.257 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:46:51.257 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.285722+0000", 2024-04-01T19:46:51.257 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.257 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.257 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:46:51.257 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.285722+0000", 2024-04-01T19:46:51.257 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.258 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:46:51.258 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.285723+0000", 2024-04-01T19:46:51.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.392e-06 2024-04-01T19:46:51.258 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.258 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:46:51.258 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.285728+0000", 2024-04-01T19:46:51.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6489999999999999e-06 2024-04-01T19:46:51.258 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.258 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:46:51.259 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.285738+0000", 2024-04-01T19:46:51.259 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0617e-05 2024-04-01T19:46:51.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.259 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.259 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:46:51.259 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.285745+0000", 2024-04-01T19:46:51.259 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1149999999999996e-06 2024-04-01T19:46:51.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.259 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.259 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:46:51.259 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.359063+0000", 2024-04-01T19:46:51.259 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.073318016999999999 2024-04-01T19:46:51.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.259 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.259 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:46:51.260 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.359191+0000", 2024-04-01T19:46:51.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000127556 2024-04-01T19:46:51.260 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.260 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.260 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:46:51.260 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.359327+0000", 2024-04-01T19:46:51.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013623300000000001 2024-04-01T19:46:51.260 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.260 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.260 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:46:51.260 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.362993+0000", 2024-04-01T19:46:51.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036660030000000001 2024-04-01T19:46:51.260 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.261 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.261 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:51.261 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.433823+0000", 2024-04-01T19:46:51.261 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.070829846000000002 2024-04-01T19:46:51.261 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.261 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.261 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:46:51.261 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.433898+0000", 2024-04-01T19:46:51.261 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5331000000000001e-05 2024-04-01T19:46:51.261 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.261 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.261 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:46:51.261 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.433955+0000", 2024-04-01T19:46:51.261 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6360000000000002e-05 2024-04-01T19:46:51.261 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.262 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:46:51.262 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.262 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.262 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.262 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:248702 5.e 5:7398d052:::benchmark_data_smithi188_119427_object84003:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:46:51.262 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:43:00.293713+0000", 2024-04-01T19:46:51.262 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 230.86533468499999, 2024-04-01T19:46:51.262 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14041481, 2024-04-01T19:46:51.262 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:46:51.262 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:46:51.262 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:51.262 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:46:51.262 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:46:51.263 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:46:51.263 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 248702 2024-04-01T19:46:51.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.263 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:46:51.263 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.263 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:46:51.263 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.293713+0000", 2024-04-01T19:46:51.263 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.263 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.263 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:46:51.263 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.293713+0000", 2024-04-01T19:46:51.263 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.264 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:46:51.264 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.293715+0000", 2024-04-01T19:46:51.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9259999999999999e-06 2024-04-01T19:46:51.264 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.264 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:46:51.264 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.293721+0000", 2024-04-01T19:46:51.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4140000000000002e-06 2024-04-01T19:46:51.264 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.264 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:46:51.264 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.293733+0000", 2024-04-01T19:46:51.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2160999999999999e-05 2024-04-01T19:46:51.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.265 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:46:51.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.293741+0000", 2024-04-01T19:46:51.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3149999999999992e-06 2024-04-01T19:46:51.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.265 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:46:51.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.363581+0000", 2024-04-01T19:46:51.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.069840134999999998 2024-04-01T19:46:51.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.265 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:46:51.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.363703+0000", 2024-04-01T19:46:51.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012218299999999999 2024-04-01T19:46:51.266 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.266 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.266 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:46:51.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.363835+0000", 2024-04-01T19:46:51.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000132182 2024-04-01T19:46:51.266 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.266 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.266 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:46:51.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.370504+0000", 2024-04-01T19:46:51.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0066690179999999996 2024-04-01T19:46:51.267 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.267 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.267 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:46:51.267 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.434031+0000", 2024-04-01T19:46:51.267 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.063526529999999998 2024-04-01T19:46:51.267 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.267 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.267 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:46:51.267 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.434070+0000", 2024-04-01T19:46:51.267 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8572999999999998e-05 2024-04-01T19:46:51.267 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.267 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.268 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:46:51.268 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.434128+0000", 2024-04-01T19:46:51.268 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8372999999999998e-05 2024-04-01T19:46:51.268 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.268 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:46:51.268 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.268 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.268 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.268 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:130321 6.9 e496/469 6:95e0e05a:::benchmark_data_smithi188_134454_object130320:head v 496'8136, mlcod=496'8132)", 2024-04-01T19:46:51.268 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:45:54.235273+0000", 2024-04-01T19:46:51.268 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 56.923774846999997, 2024-04-01T19:46:51.268 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022977069999999999, 2024-04-01T19:46:51.268 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:46:51.269 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:46:51.269 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:51.269 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:46:51.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.269 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:46:51.269 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.235273+0000", 2024-04-01T19:46:51.269 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.269 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.269 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:46:51.269 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.235273+0000", 2024-04-01T19:46:51.269 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.269 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:46:51.270 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.235275+0000", 2024-04-01T19:46:51.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.61e-06 2024-04-01T19:46:51.270 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.270 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:46:51.270 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.235370+0000", 2024-04-01T19:46:51.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5107999999999998e-05 2024-04-01T19:46:51.270 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.270 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:46:51.270 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.235382+0000", 2024-04-01T19:46:51.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2106000000000001e-05 2024-04-01T19:46:51.270 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:46:51.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.235390+0000", 2024-04-01T19:46:51.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7970000000000001e-06 2024-04-01T19:46:51.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:46:51.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.235443+0000", 2024-04-01T19:46:51.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3604999999999999e-05 2024-04-01T19:46:51.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:46:51.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.235466+0000", 2024-04-01T19:46:51.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2833999999999999e-05 2024-04-01T19:46:51.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.272 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.272 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:46:51.272 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.258215+0000", 2024-04-01T19:46:51.272 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022748963000000001 2024-04-01T19:46:51.272 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.272 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.272 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:46:51.272 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.258250+0000", 2024-04-01T19:46:51.272 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5046999999999998e-05 2024-04-01T19:46:51.272 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.272 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:46:51.272 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.272 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.272 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.272 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:184058 6.9 e515/469 6:98e8d452:::benchmark_data_smithi188_134454_object27317:head v 515'11592, mlcod=515'11589)", 2024-04-01T19:46:51.273 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:46:49.307946+0000", 2024-04-01T19:46:51.273 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 1.851101428, 2024-04-01T19:46:51.273 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.024475815000000001, 2024-04-01T19:46:51.273 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:46:51.273 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:46:51.273 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:46:51.273 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:46:51.273 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.273 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:46:51.273 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:49.307946+0000", 2024-04-01T19:46:51.273 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.273 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.273 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.273 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:46:51.273 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:49.307946+0000", 2024-04-01T19:46:51.274 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:46:51.274 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.274 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.274 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:46:51.274 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:49.307948+0000", 2024-04-01T19:46:51.274 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1620000000000001e-06 2024-04-01T19:46:51.274 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.274 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.274 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:46:51.274 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:49.307954+0000", 2024-04-01T19:46:51.274 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8390000000000001e-06 2024-04-01T19:46:51.274 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.274 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.274 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:46:51.274 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:49.307966+0000", 2024-04-01T19:46:51.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1404e-05 2024-04-01T19:46:51.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:46:51.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:49.307973+0000", 2024-04-01T19:46:51.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2540000000000003e-06 2024-04-01T19:46:51.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:46:51.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:49.308102+0000", 2024-04-01T19:46:51.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012919900000000001 2024-04-01T19:46:51.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:46:51.276 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:49.308118+0000", 2024-04-01T19:46:51.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5617e-05 2024-04-01T19:46:51.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:46:51.276 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:49.332383+0000", 2024-04-01T19:46:51.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.024264902000000001 2024-04-01T19:46:51.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:46:51.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:46:51.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:46:51.276 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:49.332422+0000", 2024-04-01T19:46:51.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9437999999999997e-05 2024-04-01T19:46:51.277 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.277 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:46:51.277 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.277 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:46:51.277 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:46:51.277 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:46:51.278 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:51.278 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:46:51.309 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:51 smithi022 ceph-mon[39439]: pgmap v1415: 17 pgs: 17 active+clean; 7.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:46:51.379 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:46:51.422 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:51.478 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:46:51.484 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:51.484 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:46:51.529 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:51 smithi188 ceph-mon[43939]: pgmap v1415: 17 pgs: 17 active+clean; 7.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:46:51.586 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:46:51.616 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:51.686 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:46:51.686 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:46:51.686 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:46:51.686 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:46:51.686 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:46:51.686 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:46:51.686 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:46:51.696 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:46:51.724 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:46:51.751 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:46:51.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:51 smithi062 ceph-mon[44211]: pgmap v1415: 17 pgs: 17 active+clean; 7.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.20k op/s 2024-04-01T19:46:51.792 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:46:51.825 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:46:51.853 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:46:51.853 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:46:51.853 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:46:51.853 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:46:51.853 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:46:51.853 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:46:51.853 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:46:51.853 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:46:51.853 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:46:51.854 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:46:51.854 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:46:51.854 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:46:51.969 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:46:51.972 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:51.972 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:46:51.973 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_ops_in_flight 2024-04-01T19:46:51.976 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:46:52.073 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:46:52.126 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:52.151 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:46:52.160 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:52.161 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:46:52.262 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:46:52.293 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:52.312 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:46:52.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:52 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/652153980' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:46:52.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:52.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:52.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:52.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:52.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:52.317 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:46:52.323 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:52.323 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:46:52.424 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:46:52.464 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:52.520 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:52 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/652153980' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:46:52.520 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:52.520 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:52.520 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:52.520 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:52.520 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:52.567 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:52 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/652153980' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:46:52.567 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:52.567 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:52.567 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:52.567 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:52.567 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:53.166 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:46:53.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:53.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:53.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:53.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:53.464 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:53.464 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:53.464 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:53.464 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:53 smithi022 ceph-mon[39439]: pgmap v1416: 17 pgs: 17 active+clean; 7.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:46:53.527 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:53.527 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:53.527 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:53.527 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:53.527 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:53.527 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:53.527 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:53.527 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:53 smithi188 ceph-mon[43939]: pgmap v1416: 17 pgs: 17 active+clean; 7.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:46:53.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:53.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:53.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:53.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:53.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:53.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:53.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:46:53.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:53 smithi062 ceph-mon[44211]: pgmap v1416: 17 pgs: 17 active+clean; 7.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:46:54.170 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:46:54.170 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:46:54.734 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:46:54.737 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:54.737 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:46:54.839 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:46:54.898 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_blocked_ops 2024-04-01T19:46:54.900 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:55.192 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:46:55.197 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:46:55.227 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:46:55.233 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:55.234 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:46:55.334 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:46:55.380 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:55.404 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:46:55.408 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:55.408 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:46:55.509 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:46:55.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:55 smithi062 ceph-mon[44211]: pgmap v1417: 17 pgs: 17 active+clean; 7.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T19:46:55.529 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:55 smithi188 ceph-mon[43939]: pgmap v1417: 17 pgs: 17 active+clean; 7.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T19:46:55.570 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:55.608 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:46:55.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:55 smithi022 ceph-mon[39439]: pgmap v1417: 17 pgs: 17 active+clean; 7.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T19:46:55.614 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:55.614 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:46:55.715 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:46:55.746 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:55.766 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:46:55.769 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:55.770 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:46:55.871 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:46:55.898 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:55.902 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:46:56.047 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:46:56.052 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:56.052 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:46:56.153 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:46:56.190 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:56.308 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.6 to 1 (10000) 2024-04-01T19:46:56.309 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:46:56.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:56 smithi188 ceph-mon[43939]: 6.a scrub starts 2024-04-01T19:46:56.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:56 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/612999830' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T19:46:56.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:56 smithi188 ceph-mon[43939]: from='client.26425 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T19:46:56.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:56 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1352993467' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:46:56.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:56 smithi188 ceph-mon[43939]: from='client.26431 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:46:56.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:56 smithi022 ceph-mon[39439]: 6.a scrub starts 2024-04-01T19:46:56.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:56 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/612999830' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T19:46:56.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:56 smithi022 ceph-mon[39439]: from='client.26425 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T19:46:56.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:56 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1352993467' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:46:56.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:56 smithi022 ceph-mon[39439]: from='client.26431 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:46:56.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:56 smithi062 ceph-mon[44211]: 6.a scrub starts 2024-04-01T19:46:56.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:56 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/612999830' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T19:46:56.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:56 smithi062 ceph-mon[44211]: from='client.26425 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T19:46:56.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:56 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1352993467' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:46:56.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:56 smithi062 ceph-mon[44211]: from='client.26431 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:46:57.250 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:46:57.250 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:46:57.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:57 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:46:57.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:57 smithi022 ceph-mon[39439]: from='client.26425 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-04-01T19:46:57.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:57 smithi022 ceph-mon[39439]: from='client.26431 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:46:57.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:57 smithi022 ceph-mon[39439]: osdmap e516: 12 total, 12 up, 12 in 2024-04-01T19:46:57.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:57 smithi022 ceph-mon[39439]: pgmap v1419: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 7.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:46:57.618 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:57 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:46:57.618 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:57 smithi188 ceph-mon[43939]: from='client.26425 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-04-01T19:46:57.618 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:57 smithi188 ceph-mon[43939]: from='client.26431 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:46:57.619 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:57 smithi188 ceph-mon[43939]: osdmap e516: 12 total, 12 up, 12 in 2024-04-01T19:46:57.619 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:57 smithi188 ceph-mon[43939]: pgmap v1419: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 7.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:46:57.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:57 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:46:57.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:57 smithi062 ceph-mon[44211]: from='client.26425 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-04-01T19:46:57.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:57 smithi062 ceph-mon[44211]: from='client.26431 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:46:57.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:57 smithi062 ceph-mon[44211]: osdmap e516: 12 total, 12 up, 12 in 2024-04-01T19:46:57.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:57 smithi062 ceph-mon[44211]: pgmap v1419: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 7.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:46:58.031 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_historic_ops 2024-04-01T19:46:58.331 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:46:58.372 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:46:58.375 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:58.376 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:46:58.477 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:46:58.528 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:58.560 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:46:58.574 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:58.575 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:46:58.676 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:46:58.734 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:59.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:46:59 smithi062 ceph-mon[44211]: pgmap v1420: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 7.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:46:59.607 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:46:59.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:46:59 smithi022 ceph-mon[39439]: pgmap v1420: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 7.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:46:59.613 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:59.614 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:46:59.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:46:59 smithi188 ceph-mon[43939]: pgmap v1420: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 7.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:46:59.715 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:46:59.747 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:46:59.977 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:46:59.981 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:46:59.981 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:47:00.082 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:47:00.144 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:00.172 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:47:00.176 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:00.177 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:47:00.274 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:47:00.274 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:47:00.276 INFO:tasks.thrashosds.thrasher:test_map_discontinuity 2024-04-01T19:47:00.277 INFO:tasks.thrashosds.thrasher:Waiting for recovery 2024-04-01T19:47:00.277 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-01T19:47:00.277 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-04-01T19:47:00.277 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:47:00.315 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:00.348 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:47:00.353 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:00.353 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:47:00.454 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:47:00.517 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:00.562 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:47:00.565 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:00.565 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:47:00.666 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:47:00.696 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:00.954 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:47:00.954 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:47:00.989 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:47:01.019 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_ops_in_flight 2024-04-01T19:47:01.026 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:47:01.045 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:47:01.047 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:01.047 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:47:01.057 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:47:01.090 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:47:01.121 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:47:01.148 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:47:01.158 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:47:01.198 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:01.203 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:47:01.238 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:47:01.256 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:47:01.259 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:01 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:47:01.259 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:01 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:47:01.259 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:01 smithi188 ceph-mon[43939]: osdmap e517: 12 total, 12 up, 12 in 2024-04-01T19:47:01.259 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:01 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1562354988' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:47:01.259 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:01 smithi188 ceph-mon[43939]: pgmap v1422: 17 pgs: 17 active+clean; 7.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:47:01.261 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:01.261 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:47:01.270 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:47:01.289 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:47:01.300 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:47:01.343 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:47:01.355 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:47:01.362 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:47:01.363 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:47:01.363 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:47:01.363 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:47:01.363 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:47:01.363 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:47:01.363 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:47:01.363 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:47:01.363 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:47:01.363 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:47:01.363 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:47:01.363 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:47:01.364 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:47:01.390 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:01.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:01 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:47:01.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:01 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:47:01.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:01 smithi062 ceph-mon[44211]: osdmap e517: 12 total, 12 up, 12 in 2024-04-01T19:47:01.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:01 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1562354988' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:47:01.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:01 smithi062 ceph-mon[44211]: pgmap v1422: 17 pgs: 17 active+clean; 7.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:47:01.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:01 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:47:01.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:01 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:47:01.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:01 smithi022 ceph-mon[39439]: osdmap e517: 12 total, 12 up, 12 in 2024-04-01T19:47:01.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:01 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1562354988' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:47:01.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:01 smithi022 ceph-mon[39439]: pgmap v1422: 17 pgs: 17 active+clean; 7.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:47:01.641 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:47:01.645 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:01.645 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:47:01.746 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:47:01.782 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:02.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:02.855 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:47:02.859 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:02.859 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:47:02.960 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:47:03.017 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:03.069 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:47:03.075 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:03.075 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:47:03.176 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:47:03.222 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:03.275 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:47:03.276 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:47:03.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:03.276 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:200124 6.8 e517/469 6:1081282d:::benchmark_data_smithi188_134454_object43383:head v 517'12509, mlcod=517'12506)", 2024-04-01T19:47:03.276 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:03.270843+0000", 2024-04-01T19:47:03.276 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0075710739999999997, 2024-04-01T19:47:03.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076004799999999997, 2024-04-01T19:47:03.276 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:47:03.276 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:47:03.276 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-01T19:47:03.276 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:47:03.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:03.277 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:47:03.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.270843+0000", 2024-04-01T19:47:03.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:03.277 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:03.277 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:03.277 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:47:03.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.270843+0000", 2024-04-01T19:47:03.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:03.277 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:03.277 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:03.277 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:47:03.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.270846+0000", 2024-04-01T19:47:03.278 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6309999999999999e-06 2024-04-01T19:47:03.278 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:03.278 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:03.278 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:47:03.278 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.270859+0000", 2024-04-01T19:47:03.278 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3451999999999999e-05 2024-04-01T19:47:03.278 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:03.278 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:03.278 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:47:03.278 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.270877+0000", 2024-04-01T19:47:03.278 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.753e-05 2024-04-01T19:47:03.279 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:03.279 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:03.279 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:47:03.279 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.270888+0000", 2024-04-01T19:47:03.279 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1391e-05 2024-04-01T19:47:03.279 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:03.279 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:03.279 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:47:03.279 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.270953+0000", 2024-04-01T19:47:03.279 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5108000000000001e-05 2024-04-01T19:47:03.279 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:03.279 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:03.280 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:47:03.280 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.270978+0000", 2024-04-01T19:47:03.280 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4334000000000001e-05 2024-04-01T19:47:03.280 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:03.280 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:47:03.280 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:03.280 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:03.280 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:03.280 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:200126 6.8 e517/469 6:1596a47f:::benchmark_data_smithi188_134454_object43385:head v 517'12510, mlcod=517'12506)", 2024-04-01T19:47:03.280 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:03.273922+0000", 2024-04-01T19:47:03.280 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0044920960000000001, 2024-04-01T19:47:03.280 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0045890389999999996, 2024-04-01T19:47:03.280 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:47:03.280 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:47:03.281 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-01T19:47:03.281 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:47:03.281 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:03.281 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:47:03.281 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.273922+0000", 2024-04-01T19:47:03.281 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:03.281 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:03.281 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:03.281 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:47:03.281 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.273922+0000", 2024-04-01T19:47:03.281 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:03.281 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:03.281 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:03.282 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:47:03.282 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.273924+0000", 2024-04-01T19:47:03.282 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9829999999999999e-06 2024-04-01T19:47:03.282 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:03.282 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:03.282 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:47:03.282 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.273933+0000", 2024-04-01T19:47:03.282 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3969999999999994e-06 2024-04-01T19:47:03.282 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:03.282 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:03.282 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:47:03.283 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.273945+0000", 2024-04-01T19:47:03.283 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.219e-05 2024-04-01T19:47:03.283 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:03.283 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:03.283 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:47:03.283 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.273953+0000", 2024-04-01T19:47:03.283 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0909999999999993e-06 2024-04-01T19:47:03.283 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:03.283 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:03.283 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:47:03.283 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.275562+0000", 2024-04-01T19:47:03.283 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0016088389999999999 2024-04-01T19:47:03.284 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:03.284 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:03.284 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:47:03.284 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.275585+0000", 2024-04-01T19:47:03.284 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3019000000000001e-05 2024-04-01T19:47:03.284 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:03.284 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:47:03.284 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:03.284 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:03.284 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:03.284 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:200143 6.8 e517/469)", 2024-04-01T19:47:03.284 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:03.277494+0000", 2024-04-01T19:47:03.284 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.00092034899999999999, 2024-04-01T19:47:03.285 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001075098, 2024-04-01T19:47:03.285 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:47:03.285 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:47:03.285 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "queued for pg", 2024-04-01T19:47:03.285 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:47:03.285 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:03.285 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:47:03.285 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.277494+0000", 2024-04-01T19:47:03.285 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:03.285 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:03.285 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:03.285 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:47:03.285 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.277494+0000", 2024-04-01T19:47:03.285 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:03.286 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:03.286 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:03.286 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:47:03.286 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.277496+0000", 2024-04-01T19:47:03.286 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.609e-06 2024-04-01T19:47:03.286 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:03.286 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:03.286 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:47:03.286 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.277504+0000", 2024-04-01T19:47:03.286 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3550000000000005e-06 2024-04-01T19:47:03.286 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:03.286 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:03.287 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:47:03.287 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.277516+0000", 2024-04-01T19:47:03.287 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1600000000000001e-05 2024-04-01T19:47:03.287 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:03.287 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:03.287 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:47:03.287 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.277523+0000", 2024-04-01T19:47:03.287 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8699999999999992e-06 2024-04-01T19:47:03.287 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:03.287 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:47:03.287 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:03.287 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:03.287 INFO:teuthology.orchestra.run.smithi188.stdout: ], 2024-04-01T19:47:03.288 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 3 2024-04-01T19:47:03.288 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:47:03.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:03 smithi062 ceph-mon[44211]: pgmap v1423: 17 pgs: 17 active+clean; 7.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:47:03.621 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:03 smithi022 ceph-mon[39439]: pgmap v1423: 17 pgs: 17 active+clean; 7.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:47:03.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:03 smithi188 ceph-mon[43939]: pgmap v1423: 17 pgs: 17 active+clean; 7.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:47:03.682 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:47:03.701 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:03.701 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:47:03.802 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:47:03.853 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:03.884 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:47:03.889 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:03.889 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:47:03.990 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:47:04.025 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:04.047 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:47:04.056 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:04.056 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:47:04.083 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_blocked_ops 2024-04-01T19:47:04.157 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:47:04.195 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:04.220 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:47:04.223 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:04.223 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:47:04.324 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:47:04.354 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:04.379 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:47:04.383 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:04.383 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:47:04.433 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:47:04.484 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:47:04.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:04 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:47:04.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:04 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:47:04.535 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:04.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:04 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:47:04.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:04 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:47:04.737 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:47:04.751 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:47:04.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:04 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:47:04.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:04 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:47:04.761 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:04.761 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:47:04.862 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:47:04.912 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:05.006 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:47:05.011 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:05.011 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:47:05.112 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:47:05.140 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:05.213 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:47:05.216 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:05.216 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:47:05.317 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:47:05.347 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:05.446 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:47:05.448 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:05 smithi188 ceph-mon[43939]: osdmap e518: 12 total, 12 up, 12 in 2024-04-01T19:47:05.448 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:05 smithi188 ceph-mon[43939]: pgmap v1425: 17 pgs: 17 active+clean; 7.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:47:05.449 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:05.449 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:47:05.550 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:47:05.603 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:05 smithi062 ceph-mon[44211]: osdmap e518: 12 total, 12 up, 12 in 2024-04-01T19:47:05.603 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:05 smithi062 ceph-mon[44211]: pgmap v1425: 17 pgs: 17 active+clean; 7.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:47:05.610 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:05.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:05 smithi022 ceph-mon[39439]: osdmap e518: 12 total, 12 up, 12 in 2024-04-01T19:47:05.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:05 smithi022 ceph-mon[39439]: pgmap v1425: 17 pgs: 17 active+clean; 7.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:47:05.639 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:47:05.649 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:05.650 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:47:05.751 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:47:05.799 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:05.833 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:47:05.839 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:05.840 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:47:05.941 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:47:05.999 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:06.006 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:47:06.007 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":518,"fsid":"09f6b846-f05c-11ee-b647-cb9ed24678a4","created":"2024-04-01T19:15:34.344221+0000","modified":"2024-04-01T19:47:04.267911+0000","last_up_change":"2024-04-01T19:44:05.375978+0000","last_in_change":"2024-04-01T19:44:34.192789+0000","flags":"noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5801984,"flags_set":["noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":30,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T19:18:34.605751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"unique_pool_4","create_time":"2024-04-01T19:44:37.670659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"476","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfd4aa7e-a933-42e2-aac8-f93a3d9fcc3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":469,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":1419201649}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":1419201649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":1419201649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":1419201649}]},"public_addr":"172.21.15.22:6801/1419201649","cluster_addr":"172.21.15.22:6802/1419201649","heartbeat_back_addr":"172.21.15.22:6804/1419201649","heartbeat_front_addr":"172.21.15.22:6803/1419201649","state":["exists","up"]},{"osd":1,"uuid":"6ddadf19-2b4e-4c01-8918-9d51c323925b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":469,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":2579227110}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":2579227110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6808","nonce":2579227110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":2579227110}]},"public_addr":"172.21.15.22:6805/2579227110","cluster_addr":"172.21.15.22:6806/2579227110","heartbeat_back_addr":"172.21.15.22:6808/2579227110","heartbeat_front_addr":"172.21.15.22:6807/2579227110","state":["exists","up"]},{"osd":2,"uuid":"4af1f44c-f47c-4ce6-87ba-1aeec3960969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":469,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":835455757}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":835455757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":835455757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":835455757}]},"public_addr":"172.21.15.22:6809/835455757","cluster_addr":"172.21.15.22:6810/835455757","heartbeat_back_addr":"172.21.15.22:6812/835455757","heartbeat_front_addr":"172.21.15.22:6811/835455757","state":["exists","up"]},{"osd":3,"uuid":"c399f336-23c7-414a-822e-63793daf85c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":469,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":90988887}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":90988887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":90988887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":90988887}]},"public_addr":"172.21.15.22:6813/90988887","cluster_addr":"172.21.15.22:6814/90988887","heartbeat_back_addr":"172.21.15.22:6816/90988887","heartbeat_front_addr":"172.21.15.22:6815/90988887","state":["exists","up"]},{"osd":4,"uuid":"0a2690dc-e5b6-4d29-b517-980018519d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":469,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6800","nonce":2408168690}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6801","nonce":2408168690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6803","nonce":2408168690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6802","nonce":2408168690}]},"public_addr":"172.21.15.62:6800/2408168690","cluster_addr":"172.21.15.62:6801/2408168690","heartbeat_back_addr":"172.21.15.62:6803/2408168690","heartbeat_front_addr":"172.21.15.62:6802/2408168690","state":["exists","up"]},{"osd":5,"uuid":"c6830412-959a-4f1e-8c3d-f4b2d88673e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":469,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6804","nonce":386874616}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6805","nonce":386874616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6807","nonce":386874616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6806","nonce":386874616}]},"public_addr":"172.21.15.62:6804/386874616","cluster_addr":"172.21.15.62:6805/386874616","heartbeat_back_addr":"172.21.15.62:6807/386874616","heartbeat_front_addr":"172.21.15.62:6806/386874616","state":["exists","up"]},{"osd":6,"uuid":"f646310b-91a4-4259-a51f-6a0e92b7cba8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":335,"last_clean_end":421,"up_from":457,"up_thru":364,"down_at":422,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6808","nonce":2644974032}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6809","nonce":2644974032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6811","nonce":2644974032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6810","nonce":2644974032}]},"public_addr":"172.21.15.62:6808/2644974032","cluster_addr":"172.21.15.62:6809/2644974032","heartbeat_back_addr":"172.21.15.62:6811/2644974032","heartbeat_front_addr":"172.21.15.62:6810/2644974032","state":["exists","up"]},{"osd":7,"uuid":"afe5f371-c892-43e9-b82e-c2d911354e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":469,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6812","nonce":2055487337}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6813","nonce":2055487337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6815","nonce":2055487337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6814","nonce":2055487337}]},"public_addr":"172.21.15.62:6812/2055487337","cluster_addr":"172.21.15.62:6813/2055487337","heartbeat_back_addr":"172.21.15.62:6815/2055487337","heartbeat_front_addr":"172.21.15.62:6814/2055487337","state":["exists","up"]},{"osd":8,"uuid":"b7eb6461-f6fa-4a12-864c-6e6748e6337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":63,"last_clean_end":159,"up_from":197,"up_thru":469,"down_at":160,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6800","nonce":1873408265}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6801","nonce":1873408265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6803","nonce":1873408265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6802","nonce":1873408265}]},"public_addr":"172.21.15.188:6800/1873408265","cluster_addr":"172.21.15.188:6801/1873408265","heartbeat_back_addr":"172.21.15.188:6803/1873408265","heartbeat_front_addr":"172.21.15.188:6802/1873408265","state":["exists","up"]},{"osd":9,"uuid":"7d496ad5-46bf-485a-81d9-2b9da2a59882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":465,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6804","nonce":1755990887}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6805","nonce":1755990887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6807","nonce":1755990887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6806","nonce":1755990887}]},"public_addr":"172.21.15.188:6804/1755990887","cluster_addr":"172.21.15.188:6805/1755990887","heartbeat_back_addr":"172.21.15.188:6807/1755990887","heartbeat_front_addr":"172.21.15.188:6806/1755990887","state":["exists","up"]},{"osd":10,"uuid":"6cbb80ce-37f7-48df-9090-09a6068e4490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":364,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6808","nonce":3777340429}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6809","nonce":3777340429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6811","nonce":3777340429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6810","nonce":3777340429}]},"public_addr":"172.21.15.188:6808/3777340429","cluster_addr":"172.21.15.188:6809/3777340429","heartbeat_back_addr":"172.21.15.188:6811/3777340429","heartbeat_front_addr":"172.21.15.188:6810/3777340429","state":["exists","up"]},{"osd":11,"uuid":"c03517c4-fdb0-4587-96c1-b959041c4344","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":364,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6812","nonce":3987199514}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6813","nonce":3987199514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6815","nonce":3987199514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6814","nonce":3987199514}]},"public_addr":"172.21.15.188:6812/3987199514","cluster_addr":"172.21.15.188:6813/3987199514","heartbeat_back_addr":"172.21.15.188:6815/3987199514","heartbeat_front_addr":"172.21.15.188:6814/3987199514","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:47:03.334622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:46:17.021604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:45:54.760664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:46:32.560346+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:46:12.292326+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:46:39.857521+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:46:25.493633+0000","dead_epoch":421},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:46:44.256685+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:45:47.161212+0000","dead_epoch":159},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:46:46.534072+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:47:00.184705+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:46:33.497382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/3735983556":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/3575578250":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/2493529775":"2024-04-02T19:16:02.302343+0000","172.21.15.22:6800/2678666836":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/2389537847":"2024-04-02T19:16:02.302343+0000","172.21.15.22:0/798807675":"2024-04-02T19:16:02.302343+0000","172.21.15.22:6800/1090179981":"2024-04-02T19:16:02.302343+0000","172.21.15.22:0/51907384":"2024-04-02T19:16:30.513384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T19:47:06.040 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:47:06.053 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:06.054 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:47:06.155 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:47:06.198 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:06.218 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:47:06.225 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:47:06.228 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:06.229 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:47:06.330 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:47:06.358 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:06.379 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:47:06.382 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:06.383 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:47:06.484 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:47:06.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:06 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1215486575' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T19:47:06.513 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:06.551 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:47:06.554 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:06.555 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:47:06.555 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:06 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1215486575' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T19:47:06.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:06 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1215486575' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T19:47:06.656 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:47:06.705 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:06.758 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:47:06.768 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:06.769 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:47:06.869 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:47:06.902 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:06.976 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:47:06.979 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:06.979 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:47:06.990 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:47:06.990 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:47:06.990 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-01T19:47:06.990 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-01T19:47:06.990 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:47:07.081 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:47:07.138 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:07.186 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:47:07.190 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:07.191 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:47:07.291 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:47:07.322 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:07.329 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:07 smithi022 ceph-mon[39439]: pgmap v1426: 17 pgs: 17 active+clean; 6.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:47:07.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:07 smithi062 ceph-mon[44211]: pgmap v1426: 17 pgs: 17 active+clean; 6.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:47:07.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:07 smithi188 ceph-mon[43939]: pgmap v1426: 17 pgs: 17 active+clean; 6.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T19:47:07.822 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_historic_ops 2024-04-01T19:47:07.874 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:47:07.877 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:07.877 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:47:07.978 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:47:08.055 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:08.098 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:47:08.100 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:08.101 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:47:08.152 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:47:08.202 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:47:08.229 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:08.433 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:47:08.438 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:08.439 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:47:08.462 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-01T19:47:08.539 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:47:08.569 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:08.695 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:47:09.019 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:47:09.022 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:09.023 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:47:09.124 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:47:09.171 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:09.196 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:47:09.203 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:09.204 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:47:09.305 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:47:09.366 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:09.570 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:47:09.805 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:09 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:47:09.805 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:09 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:47:09.805 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:09 smithi188 ceph-mon[43939]: osdmap e519: 12 total, 12 up, 12 in 2024-04-01T19:47:09.805 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:09 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2770587533' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:47:09.805 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:09 smithi188 ceph-mon[43939]: from='client.26449 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:47:09.805 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:09 smithi188 ceph-mon[43939]: pgmap v1428: 17 pgs: 17 active+clean; 6.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:47:09.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:09 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:47:09.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:09 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:47:09.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:09 smithi022 ceph-mon[39439]: osdmap e519: 12 total, 12 up, 12 in 2024-04-01T19:47:09.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:09 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2770587533' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:47:09.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:09 smithi022 ceph-mon[39439]: from='client.26449 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:47:09.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:09 smithi022 ceph-mon[39439]: pgmap v1428: 17 pgs: 17 active+clean; 6.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:47:10.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:09 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:47:10.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:09 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:47:10.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:09 smithi062 ceph-mon[44211]: osdmap e519: 12 total, 12 up, 12 in 2024-04-01T19:47:10.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:09 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2770587533' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:47:10.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:09 smithi062 ceph-mon[44211]: from='client.26449 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:47:10.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:09 smithi062 ceph-mon[44211]: pgmap v1428: 17 pgs: 17 active+clean; 6.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:47:10.107 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:47:10.107 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:47:10.107 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:47:10.107 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:47:10.107 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.107 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:116729 5.8 5:1c4d4d2d:::benchmark_data_smithi188_119427_object116728:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e389)", 2024-04-01T19:47:10.107 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:40:23.819558+0000", 2024-04-01T19:47:10.107 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 406.28793125599998, 2024-04-01T19:47:10.107 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.10192927, 2024-04-01T19:47:10.107 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:47:10.108 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:47:10.108 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:47:10.108 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:47:10.108 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:47:10.108 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:47:10.108 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 116729 2024-04-01T19:47:10.108 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.108 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:47:10.108 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.108 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:47:10.108 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.819558+0000", 2024-04-01T19:47:10.108 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.108 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.108 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.109 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:47:10.109 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.819558+0000", 2024-04-01T19:47:10.109 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.109 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.109 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.109 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:47:10.109 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.819560+0000", 2024-04-01T19:47:10.109 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7829999999999999e-06 2024-04-01T19:47:10.109 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.109 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.109 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:47:10.109 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.819594+0000", 2024-04-01T19:47:10.109 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3389000000000002e-05 2024-04-01T19:47:10.110 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.110 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.110 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:47:10.110 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835009+0000", 2024-04-01T19:47:10.110 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015415263 2024-04-01T19:47:10.110 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.110 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.110 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:47:10.110 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835021+0000", 2024-04-01T19:47:10.110 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2184999999999999e-05 2024-04-01T19:47:10.110 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.110 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.111 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:47:10.111 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.838708+0000", 2024-04-01T19:47:10.111 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036866720000000002 2024-04-01T19:47:10.111 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.111 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.111 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:47:10.111 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.838836+0000", 2024-04-01T19:47:10.111 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012849399999999999 2024-04-01T19:47:10.111 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.111 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.111 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:47:10.111 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.838930+0000", 2024-04-01T19:47:10.111 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3524999999999996e-05 2024-04-01T19:47:10.111 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.112 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.112 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:47:10.112 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.853237+0000", 2024-04-01T19:47:10.112 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014307507000000001 2024-04-01T19:47:10.112 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.112 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.112 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:47:10.112 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.921392+0000", 2024-04-01T19:47:10.112 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.068154369000000006 2024-04-01T19:47:10.112 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.112 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.112 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:47:10.112 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.921444+0000", 2024-04-01T19:47:10.112 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2904e-05 2024-04-01T19:47:10.113 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.113 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.113 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:47:10.113 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.921488+0000", 2024-04-01T19:47:10.113 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3179000000000001e-05 2024-04-01T19:47:10.113 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.113 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:47:10.113 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.113 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.113 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.113 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:116747 5.8 5:1d80d94e:::benchmark_data_smithi188_119427_object116746:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e389)", 2024-04-01T19:47:10.113 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:40:23.835174+0000", 2024-04-01T19:47:10.113 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 406.27231533600002, 2024-04-01T19:47:10.113 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.090182354000000006, 2024-04-01T19:47:10.114 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:47:10.114 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:47:10.114 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:47:10.114 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:47:10.114 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:47:10.114 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:47:10.114 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 116747 2024-04-01T19:47:10.114 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.114 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:47:10.114 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.114 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:47:10.114 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835174+0000", 2024-04-01T19:47:10.114 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.115 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.115 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.115 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:47:10.115 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835174+0000", 2024-04-01T19:47:10.115 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.115 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.115 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.115 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:47:10.115 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835175+0000", 2024-04-01T19:47:10.115 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3200000000000004e-07 2024-04-01T19:47:10.115 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.115 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.115 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:47:10.115 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835198+0000", 2024-04-01T19:47:10.115 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2858e-05 2024-04-01T19:47:10.116 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.116 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.116 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:47:10.116 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835204+0000", 2024-04-01T19:47:10.116 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9009999999999999e-06 2024-04-01T19:47:10.116 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.116 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.116 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:47:10.116 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835209+0000", 2024-04-01T19:47:10.116 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0359999999999997e-06 2024-04-01T19:47:10.116 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.116 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.116 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:47:10.116 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.848849+0000", 2024-04-01T19:47:10.117 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013640462000000001 2024-04-01T19:47:10.117 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.117 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.117 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:47:10.117 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.848965+0000", 2024-04-01T19:47:10.117 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011550200000000001 2024-04-01T19:47:10.117 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.117 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.117 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:47:10.117 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.849058+0000", 2024-04-01T19:47:10.117 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3420999999999999e-05 2024-04-01T19:47:10.117 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.117 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.117 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:47:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.853248+0000", 2024-04-01T19:47:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0041897749999999997 2024-04-01T19:47:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:47:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.925253+0000", 2024-04-01T19:47:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.072004519000000003 2024-04-01T19:47:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:47:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.925309+0000", 2024-04-01T19:47:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6609e-05 2024-04-01T19:47:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.119 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:47:10.119 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.925357+0000", 2024-04-01T19:47:10.119 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7438999999999998e-05 2024-04-01T19:47:10.119 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.119 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:47:10.119 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.119 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.119 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.119 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:116748 5.8 5:1beff7ec:::benchmark_data_smithi188_119427_object116747:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e389)", 2024-04-01T19:47:10.119 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:40:23.835216+0000", 2024-04-01T19:47:10.119 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 406.27227383899998, 2024-04-01T19:47:10.119 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.090258440999999995, 2024-04-01T19:47:10.119 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:47:10.119 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:47:10.119 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:47:10.120 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:47:10.120 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:47:10.120 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:47:10.120 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 116748 2024-04-01T19:47:10.120 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.120 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:47:10.120 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.120 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:47:10.120 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835216+0000", 2024-04-01T19:47:10.120 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.120 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.120 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.120 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:47:10.120 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835216+0000", 2024-04-01T19:47:10.121 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.121 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.121 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.121 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:47:10.121 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835216+0000", 2024-04-01T19:47:10.121 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8400000000000004e-07 2024-04-01T19:47:10.121 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.121 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.121 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:47:10.121 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835241+0000", 2024-04-01T19:47:10.121 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4647999999999998e-05 2024-04-01T19:47:10.121 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.121 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.121 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:47:10.121 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835248+0000", 2024-04-01T19:47:10.122 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4989999999999999e-06 2024-04-01T19:47:10.122 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.122 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.122 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:47:10.122 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835253+0000", 2024-04-01T19:47:10.122 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6420000000000004e-06 2024-04-01T19:47:10.122 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.122 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.122 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:47:10.122 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.851232+0000", 2024-04-01T19:47:10.122 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015978414999999999 2024-04-01T19:47:10.122 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.122 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.122 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:47:10.123 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.851306+0000", 2024-04-01T19:47:10.123 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4301999999999994e-05 2024-04-01T19:47:10.123 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.123 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.123 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:47:10.123 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.851397+0000", 2024-04-01T19:47:10.123 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0879999999999997e-05 2024-04-01T19:47:10.123 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.123 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.123 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:47:10.123 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.855437+0000", 2024-04-01T19:47:10.123 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040398450000000002 2024-04-01T19:47:10.123 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.123 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.124 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:47:10.124 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.925395+0000", 2024-04-01T19:47:10.124 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.069958713000000006 2024-04-01T19:47:10.124 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.124 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.124 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:47:10.124 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.925436+0000", 2024-04-01T19:47:10.124 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1028000000000001e-05 2024-04-01T19:47:10.124 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.124 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.124 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:47:10.124 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.925474+0000", 2024-04-01T19:47:10.124 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7784999999999998e-05 2024-04-01T19:47:10.124 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.124 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:47:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:120827 5.8 5:1550fc16:::benchmark_data_smithi188_119427_object120826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e389)", 2024-04-01T19:47:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:40:26.691921+0000", 2024-04-01T19:47:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 403.41556858600001, 2024-04-01T19:47:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.087931033000000006, 2024-04-01T19:47:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:47:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:47:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:47:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:47:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:47:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:47:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 120827 2024-04-01T19:47:10.126 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.126 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:47:10.126 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.126 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:47:10.126 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.691921+0000", 2024-04-01T19:47:10.126 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.126 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.126 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.126 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:47:10.126 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.691921+0000", 2024-04-01T19:47:10.126 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.126 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.126 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.127 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:47:10.127 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.691922+0000", 2024-04-01T19:47:10.127 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3829999999999999e-06 2024-04-01T19:47:10.127 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.127 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.127 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:47:10.127 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.691946+0000", 2024-04-01T19:47:10.127 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3646999999999999e-05 2024-04-01T19:47:10.127 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.127 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.127 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:47:10.127 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.691961+0000", 2024-04-01T19:47:10.127 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4664999999999999e-05 2024-04-01T19:47:10.128 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.128 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.128 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:47:10.128 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.691967+0000", 2024-04-01T19:47:10.128 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3729999999999998e-06 2024-04-01T19:47:10.128 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.128 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.128 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:47:10.128 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.692025+0000", 2024-04-01T19:47:10.128 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8233999999999998e-05 2024-04-01T19:47:10.128 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.128 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.128 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:47:10.128 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.692153+0000", 2024-04-01T19:47:10.129 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012784499999999999 2024-04-01T19:47:10.129 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.129 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.129 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:47:10.129 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.692284+0000", 2024-04-01T19:47:10.129 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013041100000000001 2024-04-01T19:47:10.129 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.129 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.129 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:47:10.129 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.695616+0000", 2024-04-01T19:47:10.129 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0033320450000000001 2024-04-01T19:47:10.129 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.129 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.129 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:47:10.130 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.779778+0000", 2024-04-01T19:47:10.130 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.084162429999999996 2024-04-01T19:47:10.130 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.130 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.130 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:47:10.130 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.779810+0000", 2024-04-01T19:47:10.130 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2104000000000003e-05 2024-04-01T19:47:10.130 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.130 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.130 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:47:10.130 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.779852+0000", 2024-04-01T19:47:10.130 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1896e-05 2024-04-01T19:47:10.130 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.130 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:47:10.130 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.131 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.131 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.131 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:238402 5.d 5:b3830024:::benchmark_data_smithi188_119427_object73703:head [delete] snapc 0=[] ondisk+write+known_if_redirected e438)", 2024-04-01T19:47:10.131 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:47.431109+0000", 2024-04-01T19:47:10.131 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 262.67638094300003, 2024-04-01T19:47:10.131 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.10615174199999999, 2024-04-01T19:47:10.131 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:47:10.131 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:47:10.131 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:47:10.131 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:47:10.131 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:47:10.131 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:47:10.131 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 238402 2024-04-01T19:47:10.131 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.131 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:47:10.131 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.132 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:47:10.132 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431109+0000", 2024-04-01T19:47:10.132 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.132 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.132 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.132 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:47:10.132 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431109+0000", 2024-04-01T19:47:10.132 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.132 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.132 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.132 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:47:10.132 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431110+0000", 2024-04-01T19:47:10.132 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9800000000000002e-07 2024-04-01T19:47:10.132 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.132 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.133 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:47:10.133 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431113+0000", 2024-04-01T19:47:10.133 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.675e-06 2024-04-01T19:47:10.133 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.133 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.133 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:47:10.133 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431122+0000", 2024-04-01T19:47:10.133 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6540000000000005e-06 2024-04-01T19:47:10.133 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.133 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.133 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:47:10.133 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431128+0000", 2024-04-01T19:47:10.133 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7239999999999997e-06 2024-04-01T19:47:10.133 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.134 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.134 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:47:10.134 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431182+0000", 2024-04-01T19:47:10.134 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4440000000000001e-05 2024-04-01T19:47:10.134 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.134 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.134 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:47:10.134 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431312+0000", 2024-04-01T19:47:10.134 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013003900000000001 2024-04-01T19:47:10.134 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.134 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.134 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 5", 2024-04-01T19:47:10.134 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431448+0000", 2024-04-01T19:47:10.135 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000136203 2024-04-01T19:47:10.135 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.135 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.135 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:47:10.135 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.435486+0000", 2024-04-01T19:47:10.135 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040374959999999998 2024-04-01T19:47:10.135 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.135 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.135 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:47:10.135 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.537169+0000", 2024-04-01T19:47:10.135 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.101683517 2024-04-01T19:47:10.135 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.135 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.135 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:47:10.135 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.537205+0000", 2024-04-01T19:47:10.136 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5367999999999997e-05 2024-04-01T19:47:10.136 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.136 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.136 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:47:10.136 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.537260+0000", 2024-04-01T19:47:10.136 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5627999999999997e-05 2024-04-01T19:47:10.136 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.136 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:47:10.136 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.136 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.136 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.136 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:279781 5.8 5:1435bdde:::benchmark_data_smithi188_119427_object115082:head [delete] snapc 0=[] ondisk+write+known_if_redirected e445)", 2024-04-01T19:47:10.136 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:43:27.311434+0000", 2024-04-01T19:47:10.136 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 222.79605589100001, 2024-04-01T19:47:10.136 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.087482134000000003, 2024-04-01T19:47:10.137 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:47:10.137 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:47:10.137 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:47:10.137 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:47:10.137 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:47:10.137 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:47:10.137 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 279781 2024-04-01T19:47:10.137 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.137 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:47:10.137 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.137 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:47:10.137 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.311434+0000", 2024-04-01T19:47:10.137 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.137 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.138 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.138 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:47:10.138 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.311434+0000", 2024-04-01T19:47:10.138 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.138 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.138 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.138 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:47:10.138 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.311436+0000", 2024-04-01T19:47:10.138 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3240000000000001e-06 2024-04-01T19:47:10.138 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.138 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.138 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:47:10.139 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.311441+0000", 2024-04-01T19:47:10.139 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2000000000000002e-06 2024-04-01T19:47:10.139 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.139 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.139 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:47:10.139 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.311451+0000", 2024-04-01T19:47:10.139 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9000000000000001e-06 2024-04-01T19:47:10.139 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.139 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.139 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:47:10.139 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.311459+0000", 2024-04-01T19:47:10.139 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0919999999999998e-06 2024-04-01T19:47:10.139 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.139 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.139 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:47:10.140 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.311520+0000", 2024-04-01T19:47:10.140 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0652999999999997e-05 2024-04-01T19:47:10.140 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.140 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.140 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:47:10.140 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.311617+0000", 2024-04-01T19:47:10.140 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7138000000000004e-05 2024-04-01T19:47:10.140 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.140 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.140 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:47:10.140 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.312271+0000", 2024-04-01T19:47:10.140 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00065370999999999995 2024-04-01T19:47:10.140 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.140 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.141 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:47:10.141 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.319528+0000", 2024-04-01T19:47:10.141 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072574969999999999 2024-04-01T19:47:10.141 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.141 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.141 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:47:10.141 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.398857+0000", 2024-04-01T19:47:10.141 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.079329203000000001 2024-04-01T19:47:10.141 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.141 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.141 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:47:10.141 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.398889+0000", 2024-04-01T19:47:10.141 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1189000000000002e-05 2024-04-01T19:47:10.141 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.141 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.142 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:47:10.142 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.398916+0000", 2024-04-01T19:47:10.142 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7228000000000001e-05 2024-04-01T19:47:10.142 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.142 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:47:10.142 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.142 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.142 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.142 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:200020 6.8 e517/469 6:1ac22188:::benchmark_data_smithi188_134454_object43279:head v 517'12496, mlcod=517'12494)", 2024-04-01T19:47:10.142 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:03.179577+0000", 2024-04-01T19:47:10.142 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 6.9279126959999999, 2024-04-01T19:47:10.142 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012428727000000001, 2024-04-01T19:47:10.142 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:47:10.142 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:47:10.143 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:47:10.143 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:47:10.143 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.143 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:47:10.143 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.179577+0000", 2024-04-01T19:47:10.143 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.143 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.143 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.143 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:47:10.143 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.179577+0000", 2024-04-01T19:47:10.143 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.143 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.143 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.143 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:47:10.143 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.179579+0000", 2024-04-01T19:47:10.144 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.159e-06 2024-04-01T19:47:10.144 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.144 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.144 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:47:10.144 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.179590+0000", 2024-04-01T19:47:10.144 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0821e-05 2024-04-01T19:47:10.144 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.144 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.144 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:47:10.144 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.179606+0000", 2024-04-01T19:47:10.144 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.605e-05 2024-04-01T19:47:10.144 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.144 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.144 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:47:10.144 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.179616+0000", 2024-04-01T19:47:10.145 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7899999999999994e-06 2024-04-01T19:47:10.145 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.145 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.145 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:47:10.145 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.179670+0000", 2024-04-01T19:47:10.145 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4758e-05 2024-04-01T19:47:10.145 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.145 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.145 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:47:10.145 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.179687+0000", 2024-04-01T19:47:10.145 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6716000000000001e-05 2024-04-01T19:47:10.145 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.145 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.145 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:47:10.145 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.191974+0000", 2024-04-01T19:47:10.146 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012286327999999999 2024-04-01T19:47:10.146 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.146 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.146 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:47:10.146 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.192006+0000", 2024-04-01T19:47:10.146 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2104999999999998e-05 2024-04-01T19:47:10.146 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.146 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:47:10.146 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.146 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.146 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.146 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:200021 6.8 e517/469 6:1a7e4eec:::benchmark_data_smithi188_134454_object43280:head v 517'12497, mlcod=517'12494)", 2024-04-01T19:47:10.146 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:03.179849+0000", 2024-04-01T19:47:10.146 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 6.9276409909999996, 2024-04-01T19:47:10.147 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.01217498, 2024-04-01T19:47:10.147 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:47:10.147 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:47:10.147 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:47:10.147 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:47:10.147 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.147 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:47:10.147 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.179849+0000", 2024-04-01T19:47:10.147 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.147 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.147 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.147 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:47:10.147 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.179849+0000", 2024-04-01T19:47:10.147 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.148 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.148 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.148 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:47:10.148 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.179849+0000", 2024-04-01T19:47:10.148 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2699999999999999e-07 2024-04-01T19:47:10.148 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.148 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.148 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:47:10.148 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.179854+0000", 2024-04-01T19:47:10.148 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8239999999999999e-06 2024-04-01T19:47:10.148 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.148 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.148 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:47:10.148 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.179862+0000", 2024-04-01T19:47:10.149 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4549999999999998e-06 2024-04-01T19:47:10.149 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.149 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.149 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:47:10.149 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.179867+0000", 2024-04-01T19:47:10.149 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1919999999999996e-06 2024-04-01T19:47:10.149 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.149 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.149 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:47:10.149 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.183532+0000", 2024-04-01T19:47:10.149 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036646959999999998 2024-04-01T19:47:10.149 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.149 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.149 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:47:10.149 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.183557+0000", 2024-04-01T19:47:10.150 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5409e-05 2024-04-01T19:47:10.150 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.150 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.150 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:47:10.150 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.192010+0000", 2024-04-01T19:47:10.150 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0084526540000000004 2024-04-01T19:47:10.150 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.150 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.150 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:47:10.150 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.192024+0000", 2024-04-01T19:47:10.150 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4022999999999999e-05 2024-04-01T19:47:10.150 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.150 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:47:10.150 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.150 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.151 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.151 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:200026 6.8 e517/469 6:1aaa3a00:::benchmark_data_smithi188_134454_object43285:head v 517'12498, mlcod=517'12494)", 2024-04-01T19:47:10.151 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:03.183478+0000", 2024-04-01T19:47:10.151 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 6.9240113560000003, 2024-04-01T19:47:10.151 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012041090000000001, 2024-04-01T19:47:10.151 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:47:10.151 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:47:10.151 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:47:10.151 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:47:10.151 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.151 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:47:10.151 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.183478+0000", 2024-04-01T19:47:10.151 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.152 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.152 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.152 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:47:10.152 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.183478+0000", 2024-04-01T19:47:10.152 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.152 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.152 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.152 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:47:10.152 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.183480+0000", 2024-04-01T19:47:10.152 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5999999999999999e-06 2024-04-01T19:47:10.152 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.152 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.152 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:47:10.152 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.183488+0000", 2024-04-01T19:47:10.153 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1640000000000001e-06 2024-04-01T19:47:10.153 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.153 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.153 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:47:10.153 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.183498+0000", 2024-04-01T19:47:10.153 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0438000000000001e-05 2024-04-01T19:47:10.153 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.153 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.153 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:47:10.153 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.183506+0000", 2024-04-01T19:47:10.153 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.542e-06 2024-04-01T19:47:10.153 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.153 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.153 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:47:10.154 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.188266+0000", 2024-04-01T19:47:10.154 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0047600120000000001 2024-04-01T19:47:10.154 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.154 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.154 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:47:10.154 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.188289+0000", 2024-04-01T19:47:10.154 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3482e-05 2024-04-01T19:47:10.154 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.154 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.154 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:47:10.154 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.195478+0000", 2024-04-01T19:47:10.154 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071884419999999997 2024-04-01T19:47:10.154 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.154 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.155 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:47:10.155 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.195519+0000", 2024-04-01T19:47:10.155 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1409999999999998e-05 2024-04-01T19:47:10.155 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.155 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:47:10.155 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.155 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.155 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.155 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:200642 6.8 e517/469 6:1d85e8f5:::benchmark_data_smithi188_134454_object43901:head v 517'12540, mlcod=517'12538)", 2024-04-01T19:47:10.155 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:03.694991+0000", 2024-04-01T19:47:10.155 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 6.412498759, 2024-04-01T19:47:10.155 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014044119000000001, 2024-04-01T19:47:10.155 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:47:10.155 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:47:10.156 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:47:10.156 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:47:10.156 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.156 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:47:10.156 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.694991+0000", 2024-04-01T19:47:10.156 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.156 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.156 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.156 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:47:10.156 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.694991+0000", 2024-04-01T19:47:10.156 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.156 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.156 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.156 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:47:10.157 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.694993+0000", 2024-04-01T19:47:10.157 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0499999999999999e-06 2024-04-01T19:47:10.157 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.157 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.157 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:47:10.157 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.695004+0000", 2024-04-01T19:47:10.157 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1413000000000001e-05 2024-04-01T19:47:10.157 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.157 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.157 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:47:10.157 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.695021+0000", 2024-04-01T19:47:10.157 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6809000000000001e-05 2024-04-01T19:47:10.157 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.157 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.158 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:47:10.158 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.695031+0000", 2024-04-01T19:47:10.158 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7000000000000003e-06 2024-04-01T19:47:10.158 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.158 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.158 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:47:10.158 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.695094+0000", 2024-04-01T19:47:10.158 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3538000000000001e-05 2024-04-01T19:47:10.158 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.158 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.158 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:47:10.158 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.695118+0000", 2024-04-01T19:47:10.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3847999999999999e-05 2024-04-01T19:47:10.159 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.159 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.159 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:47:10.159 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.708993+0000", 2024-04-01T19:47:10.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013874552 2024-04-01T19:47:10.159 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.159 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.159 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:47:10.159 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.709035+0000", 2024-04-01T19:47:10.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2209000000000002e-05 2024-04-01T19:47:10.159 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.159 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:47:10.159 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.160 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.160 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.160 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:200643 6.8 e517/469 6:17d11974:::benchmark_data_smithi188_134454_object43902:head v 517'12541, mlcod=517'12538)", 2024-04-01T19:47:10.160 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:03.695580+0000", 2024-04-01T19:47:10.160 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 6.4119094959999998, 2024-04-01T19:47:10.160 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013494406, 2024-04-01T19:47:10.160 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:47:10.160 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:47:10.160 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:47:10.160 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:47:10.160 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.160 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:47:10.160 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.695580+0000", 2024-04-01T19:47:10.160 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.160 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:47:10.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.695580+0000", 2024-04-01T19:47:10.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:47:10.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.695581+0000", 2024-04-01T19:47:10.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.206e-06 2024-04-01T19:47:10.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:47:10.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.695588+0000", 2024-04-01T19:47:10.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8329999999999996e-06 2024-04-01T19:47:10.162 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.162 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.162 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:47:10.162 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.695599+0000", 2024-04-01T19:47:10.162 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0949e-05 2024-04-01T19:47:10.162 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.162 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.162 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:47:10.162 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.695606+0000", 2024-04-01T19:47:10.162 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9999999999999999e-06 2024-04-01T19:47:10.162 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.162 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.162 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:47:10.162 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.699787+0000", 2024-04-01T19:47:10.162 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0041810409999999999 2024-04-01T19:47:10.163 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.163 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.163 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:47:10.163 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.699812+0000", 2024-04-01T19:47:10.163 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4719000000000002e-05 2024-04-01T19:47:10.163 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.163 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.163 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:47:10.163 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.709044+0000", 2024-04-01T19:47:10.163 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0092318899999999995 2024-04-01T19:47:10.163 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.163 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.163 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:47:10.163 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.709075+0000", 2024-04-01T19:47:10.164 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0768000000000001e-05 2024-04-01T19:47:10.164 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.164 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:47:10.164 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.164 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.164 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.164 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:201532 6.8 e518/469 6:172af265:::benchmark_data_smithi188_134454_object44791:head v 518'12593, mlcod=518'12590)", 2024-04-01T19:47:10.164 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:04.440536+0000", 2024-04-01T19:47:10.164 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 5.6669536599999999, 2024-04-01T19:47:10.164 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012724764, 2024-04-01T19:47:10.164 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:47:10.164 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:47:10.164 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:47:10.164 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:47:10.165 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.165 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:47:10.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.440536+0000", 2024-04-01T19:47:10.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.165 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.165 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.165 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:47:10.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.440536+0000", 2024-04-01T19:47:10.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.165 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.165 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.165 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:47:10.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.440538+0000", 2024-04-01T19:47:10.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.933e-06 2024-04-01T19:47:10.166 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.166 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.166 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:47:10.166 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.440549+0000", 2024-04-01T19:47:10.166 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1080000000000001e-05 2024-04-01T19:47:10.166 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.166 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.166 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:47:10.166 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.440563+0000", 2024-04-01T19:47:10.166 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4516e-05 2024-04-01T19:47:10.166 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.166 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.166 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:47:10.166 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.440573+0000", 2024-04-01T19:47:10.166 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9350000000000006e-06 2024-04-01T19:47:10.167 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.167 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.167 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:47:10.167 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.443361+0000", 2024-04-01T19:47:10.167 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00278737 2024-04-01T19:47:10.167 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.167 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.167 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:47:10.167 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.443382+0000", 2024-04-01T19:47:10.167 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0934999999999999e-05 2024-04-01T19:47:10.167 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.167 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.167 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:47:10.167 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.453222+0000", 2024-04-01T19:47:10.168 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0098403239999999993 2024-04-01T19:47:10.168 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.168 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.168 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:47:10.168 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.453261+0000", 2024-04-01T19:47:10.168 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8671000000000003e-05 2024-04-01T19:47:10.168 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.168 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:47:10.168 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.168 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.168 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.168 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:202014 6.8 e518/469 6:10d6765f:::benchmark_data_smithi188_134454_object45273:head v 518'12633, mlcod=518'12630)", 2024-04-01T19:47:10.168 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:04.867555+0000", 2024-04-01T19:47:10.168 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 5.2399348029999997, 2024-04-01T19:47:10.168 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010720810000000001, 2024-04-01T19:47:10.169 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:47:10.169 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:47:10.169 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:47:10.169 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:47:10.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.169 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:47:10.169 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.867555+0000", 2024-04-01T19:47:10.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.169 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.169 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:47:10.169 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.867555+0000", 2024-04-01T19:47:10.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.169 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.170 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:47:10.170 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.867555+0000", 2024-04-01T19:47:10.170 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5299999999999999e-07 2024-04-01T19:47:10.170 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.170 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.170 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:47:10.170 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.867560+0000", 2024-04-01T19:47:10.170 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7530000000000001e-06 2024-04-01T19:47:10.170 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.170 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.170 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:47:10.170 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.867565+0000", 2024-04-01T19:47:10.170 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1569999999999999e-06 2024-04-01T19:47:10.171 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:47:10.171 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.867570+0000", 2024-04-01T19:47:10.171 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5210000000000004e-06 2024-04-01T19:47:10.171 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:47:10.171 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.871246+0000", 2024-04-01T19:47:10.171 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036765449999999998 2024-04-01T19:47:10.171 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:47:10.172 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.871268+0000", 2024-04-01T19:47:10.172 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2064000000000001e-05 2024-04-01T19:47:10.172 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.172 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.172 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:47:10.172 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.878229+0000", 2024-04-01T19:47:10.172 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006960964 2024-04-01T19:47:10.172 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.172 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.172 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:47:10.172 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.878276+0000", 2024-04-01T19:47:10.172 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6353000000000002e-05 2024-04-01T19:47:10.172 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.172 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:47:10.172 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.173 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.173 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:202276 6.8 e518/469 6:1b23be74:::benchmark_data_smithi188_134454_object45535:head v 518'12652, mlcod=518'12649)", 2024-04-01T19:47:10.173 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:05.093173+0000", 2024-04-01T19:47:10.173 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 5.0143166890000002, 2024-04-01T19:47:10.173 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012695409, 2024-04-01T19:47:10.173 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:47:10.173 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:47:10.173 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:47:10.173 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:47:10.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:47:10.173 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:05.093173+0000", 2024-04-01T19:47:10.173 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.173 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.174 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:47:10.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:05.093173+0000", 2024-04-01T19:47:10.174 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.174 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:47:10.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:05.093175+0000", 2024-04-01T19:47:10.174 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9819999999999998e-06 2024-04-01T19:47:10.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.174 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:47:10.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:05.093183+0000", 2024-04-01T19:47:10.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9170000000000006e-06 2024-04-01T19:47:10.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.175 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:47:10.175 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:05.093193+0000", 2024-04-01T19:47:10.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0532e-05 2024-04-01T19:47:10.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.175 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:47:10.175 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:05.093201+0000", 2024-04-01T19:47:10.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7430000000000002e-06 2024-04-01T19:47:10.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.175 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:47:10.176 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:05.093277+0000", 2024-04-01T19:47:10.176 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5401999999999994e-05 2024-04-01T19:47:10.176 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.176 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:47:10.176 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:05.093291+0000", 2024-04-01T19:47:10.176 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4572e-05 2024-04-01T19:47:10.176 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.176 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:47:10.176 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:05.105823+0000", 2024-04-01T19:47:10.176 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012531825999999999 2024-04-01T19:47:10.176 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.176 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:47:10.177 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:05.105868+0000", 2024-04-01T19:47:10.177 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5435000000000001e-05 2024-04-01T19:47:10.177 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.177 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:47:10.177 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.177 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.177 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.177 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:202278 6.8 e518/469 6:14f75558:::benchmark_data_smithi188_134454_object45537:head v 518'12653, mlcod=518'12649)", 2024-04-01T19:47:10.177 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:05.093218+0000", 2024-04-01T19:47:10.177 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 5.0142716700000003, 2024-04-01T19:47:10.177 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012685236000000001, 2024-04-01T19:47:10.177 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:47:10.177 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:47:10.177 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:47:10.177 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:47:10.178 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.178 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:47:10.178 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:05.093218+0000", 2024-04-01T19:47:10.178 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.178 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.178 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.178 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:47:10.178 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:05.093218+0000", 2024-04-01T19:47:10.178 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.178 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.178 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.178 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:47:10.178 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:05.093218+0000", 2024-04-01T19:47:10.178 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.37e-07 2024-04-01T19:47:10.179 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.179 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.179 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:47:10.179 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:05.093240+0000", 2024-04-01T19:47:10.179 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1713e-05 2024-04-01T19:47:10.179 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.179 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.179 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:47:10.179 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:05.093247+0000", 2024-04-01T19:47:10.179 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.348e-06 2024-04-01T19:47:10.179 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.179 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.179 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:47:10.179 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:05.093252+0000", 2024-04-01T19:47:10.180 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3349999999999997e-06 2024-04-01T19:47:10.180 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.180 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.180 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:47:10.180 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:05.097096+0000", 2024-04-01T19:47:10.180 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.003844025 2024-04-01T19:47:10.180 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.180 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.180 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:47:10.180 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:05.097117+0000", 2024-04-01T19:47:10.180 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0891999999999999e-05 2024-04-01T19:47:10.180 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.180 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.180 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:47:10.180 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:05.105872+0000", 2024-04-01T19:47:10.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0087548899999999995 2024-04-01T19:47:10.181 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.181 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.181 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:47:10.181 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:05.105903+0000", 2024-04-01T19:47:10.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1495999999999998e-05 2024-04-01T19:47:10.181 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.181 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:47:10.181 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.181 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.181 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.181 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:204766 6.8 e518/469 6:13fbf2d5:::benchmark_data_smithi188_134454_object48025:head v 518'12792, mlcod=518'12788)", 2024-04-01T19:47:10.181 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:07.294085+0000", 2024-04-01T19:47:10.181 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 2.813404792, 2024-04-01T19:47:10.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011313627999999999, 2024-04-01T19:47:10.182 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:47:10.182 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:47:10.182 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:47:10.182 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:47:10.182 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.182 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:47:10.182 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:07.294085+0000", 2024-04-01T19:47:10.182 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.182 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.182 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.182 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:47:10.182 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:07.294085+0000", 2024-04-01T19:47:10.182 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.182 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:47:10.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:07.294086+0000", 2024-04-01T19:47:10.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9299999999999997e-07 2024-04-01T19:47:10.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:47:10.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:07.294091+0000", 2024-04-01T19:47:10.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0420000000000002e-06 2024-04-01T19:47:10.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:47:10.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:07.294098+0000", 2024-04-01T19:47:10.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8700000000000003e-06 2024-04-01T19:47:10.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.184 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:47:10.184 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:07.294102+0000", 2024-04-01T19:47:10.184 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0049999999999998e-06 2024-04-01T19:47:10.184 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.184 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.184 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:47:10.184 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:07.297730+0000", 2024-04-01T19:47:10.184 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036287210000000001 2024-04-01T19:47:10.184 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.184 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.184 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:47:10.184 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:07.297753+0000", 2024-04-01T19:47:10.184 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2733000000000001e-05 2024-04-01T19:47:10.184 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.184 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.185 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:47:10.185 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:07.305367+0000", 2024-04-01T19:47:10.185 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076139620000000002 2024-04-01T19:47:10.185 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.185 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.185 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:47:10.185 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:07.305398+0000", 2024-04-01T19:47:10.185 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1501999999999998e-05 2024-04-01T19:47:10.185 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.185 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:47:10.185 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.185 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.185 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.185 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:204926 6.8 e518/469 6:1c639d40:::benchmark_data_smithi188_134454_object48185:head v 518'12804, mlcod=518'12800)", 2024-04-01T19:47:10.186 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:07.425058+0000", 2024-04-01T19:47:10.186 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 2.6824318890000001, 2024-04-01T19:47:10.186 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012611498, 2024-04-01T19:47:10.186 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:47:10.186 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:47:10.186 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:47:10.186 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:47:10.186 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.186 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:47:10.186 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:07.425058+0000", 2024-04-01T19:47:10.186 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.186 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.186 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.186 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:47:10.187 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:07.425058+0000", 2024-04-01T19:47:10.187 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.187 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.187 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.187 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:47:10.187 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:07.425059+0000", 2024-04-01T19:47:10.187 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7599999999999996e-07 2024-04-01T19:47:10.187 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.187 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.187 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:47:10.187 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:07.425065+0000", 2024-04-01T19:47:10.187 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9839999999999998e-06 2024-04-01T19:47:10.187 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.187 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.187 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:47:10.188 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:07.425073+0000", 2024-04-01T19:47:10.188 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6570000000000003e-06 2024-04-01T19:47:10.188 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.188 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.188 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:47:10.188 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:07.425079+0000", 2024-04-01T19:47:10.188 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1500000000000004e-06 2024-04-01T19:47:10.188 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.188 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.188 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:47:10.188 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:07.429633+0000", 2024-04-01T19:47:10.188 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0045535430000000002 2024-04-01T19:47:10.188 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.188 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.189 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:47:10.189 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:07.429658+0000", 2024-04-01T19:47:10.189 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.548e-05 2024-04-01T19:47:10.189 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.189 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.189 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:47:10.189 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:07.437637+0000", 2024-04-01T19:47:10.189 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0079788159999999997 2024-04-01T19:47:10.189 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.189 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.189 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:47:10.189 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:07.437669+0000", 2024-04-01T19:47:10.189 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1992000000000001e-05 2024-04-01T19:47:10.189 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.189 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:47:10.190 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.190 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.190 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.190 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:206595 6.8 e519/469 6:1a20c8e5:::benchmark_data_smithi188_134454_object49854:head v 519'12909, mlcod=519'12905)", 2024-04-01T19:47:10.190 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:08.875938+0000", 2024-04-01T19:47:10.190 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 1.2315511649999999, 2024-04-01T19:47:10.190 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011992007000000001, 2024-04-01T19:47:10.190 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:47:10.190 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:47:10.190 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:47:10.190 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:47:10.190 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.190 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:47:10.190 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:08.875938+0000", 2024-04-01T19:47:10.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:47:10.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:08.875938+0000", 2024-04-01T19:47:10.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:47:10.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:08.875939+0000", 2024-04-01T19:47:10.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0999999999999999e-07 2024-04-01T19:47:10.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:47:10.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:08.875943+0000", 2024-04-01T19:47:10.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0579999999999999e-06 2024-04-01T19:47:10.192 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.192 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:47:10.192 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:08.875949+0000", 2024-04-01T19:47:10.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6350000000000003e-06 2024-04-01T19:47:10.192 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.192 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:47:10.192 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:08.875953+0000", 2024-04-01T19:47:10.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4780000000000002e-06 2024-04-01T19:47:10.192 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.193 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:47:10.193 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:08.879821+0000", 2024-04-01T19:47:10.193 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0038677519999999999 2024-04-01T19:47:10.193 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.193 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.193 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:47:10.193 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:08.879843+0000", 2024-04-01T19:47:10.193 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1776999999999998e-05 2024-04-01T19:47:10.193 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.193 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.193 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:47:10.193 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:08.887895+0000", 2024-04-01T19:47:10.193 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080520669999999996 2024-04-01T19:47:10.193 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.193 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.194 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:47:10.194 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:08.887930+0000", 2024-04-01T19:47:10.194 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5729999999999998e-05 2024-04-01T19:47:10.194 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.194 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:47:10.194 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.194 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.194 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.194 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:207287 6.8 e519/469 6:110384e5:::benchmark_data_smithi188_134454_object50546:head v 519'12960, mlcod=519'12956)", 2024-04-01T19:47:10.194 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:09.506662+0000", 2024-04-01T19:47:10.194 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.60082719699999998, 2024-04-01T19:47:10.194 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.01083783, 2024-04-01T19:47:10.194 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:47:10.195 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:47:10.195 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:47:10.195 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:47:10.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.195 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:47:10.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:09.506662+0000", 2024-04-01T19:47:10.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.195 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.195 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:47:10.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:09.506662+0000", 2024-04-01T19:47:10.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.195 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.196 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:47:10.196 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:09.506664+0000", 2024-04-01T19:47:10.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8059999999999999e-06 2024-04-01T19:47:10.196 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.196 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:47:10.196 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:09.506673+0000", 2024-04-01T19:47:10.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3399999999999998e-06 2024-04-01T19:47:10.196 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.196 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:47:10.196 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:09.506685+0000", 2024-04-01T19:47:10.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2351000000000001e-05 2024-04-01T19:47:10.196 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.197 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:47:10.197 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:09.506692+0000", 2024-04-01T19:47:10.197 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7009999999999999e-06 2024-04-01T19:47:10.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.197 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:47:10.197 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:09.506748+0000", 2024-04-01T19:47:10.197 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5889e-05 2024-04-01T19:47:10.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.197 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:47:10.197 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:09.506764+0000", 2024-04-01T19:47:10.197 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6718000000000002e-05 2024-04-01T19:47:10.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.198 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.198 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:47:10.198 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:09.517462+0000", 2024-04-01T19:47:10.198 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010697597999999999 2024-04-01T19:47:10.198 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.198 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.198 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:47:10.198 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:09.517500+0000", 2024-04-01T19:47:10.198 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8427000000000003e-05 2024-04-01T19:47:10.198 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.198 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:47:10.198 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.198 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.199 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.199 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:207292 6.8 e519/469 6:12ffcf51:::benchmark_data_smithi188_134454_object50551:head v 519'12961, mlcod=519'12956)", 2024-04-01T19:47:10.199 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:09.506706+0000", 2024-04-01T19:47:10.199 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.60078326199999998, 2024-04-01T19:47:10.199 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010820886, 2024-04-01T19:47:10.199 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:47:10.199 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:47:10.199 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:47:10.199 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:47:10.199 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.199 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:47:10.199 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:09.506706+0000", 2024-04-01T19:47:10.199 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.199 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.199 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.200 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:47:10.200 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:09.506706+0000", 2024-04-01T19:47:10.200 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:47:10.200 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.200 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:47:10.200 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:09.506707+0000", 2024-04-01T19:47:10.200 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2699999999999999e-07 2024-04-01T19:47:10.200 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.200 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:47:10.200 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:09.506711+0000", 2024-04-01T19:47:10.200 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5850000000000001e-06 2024-04-01T19:47:10.200 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:47:10.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:09.506722+0000", 2024-04-01T19:47:10.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0577000000000001e-05 2024-04-01T19:47:10.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:47:10.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:09.506727+0000", 2024-04-01T19:47:10.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1630000000000004e-06 2024-04-01T19:47:10.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:47:10.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:09.510443+0000", 2024-04-01T19:47:10.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0037157599999999998 2024-04-01T19:47:10.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.202 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:47:10.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:09.510468+0000", 2024-04-01T19:47:10.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5296e-05 2024-04-01T19:47:10.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.202 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:47:10.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:09.517503+0000", 2024-04-01T19:47:10.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070346109999999996 2024-04-01T19:47:10.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:47:10.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:47:10.202 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:47:10.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:09.517527+0000", 2024-04-01T19:47:10.203 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4366999999999999e-05 2024-04-01T19:47:10.203 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.203 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:47:10.203 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.203 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:47:10.203 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:47:10.203 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:47:10.430 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:47:10.434 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:10.434 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:47:10.535 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:47:10.595 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:10.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:10 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:47:10.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:10 smithi022 ceph-mon[39439]: from='client.26449 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:47:10.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:10 smithi022 ceph-mon[39439]: osdmap e520: 12 total, 12 up, 12 in 2024-04-01T19:47:10.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:10 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:47:10.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:10 smithi188 ceph-mon[43939]: from='client.26449 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:47:10.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:10 smithi188 ceph-mon[43939]: osdmap e520: 12 total, 12 up, 12 in 2024-04-01T19:47:11.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:10 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:47:11.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:10 smithi062 ceph-mon[44211]: from='client.26449 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:47:11.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:10 smithi062 ceph-mon[44211]: osdmap e520: 12 total, 12 up, 12 in 2024-04-01T19:47:11.048 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:47:11.051 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:11.052 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:47:11.153 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:47:11.185 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:11.311 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:47:11.318 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:11.318 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:47:11.336 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_ops_in_flight 2024-04-01T19:47:11.419 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:47:11.449 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:11.471 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:47:11.474 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:11.474 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:47:11.575 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:47:11.606 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:11.630 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:47:11.634 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:11.634 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:47:11.686 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:47:11.735 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:47:11.800 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:11.851 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:47:11.859 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:11.860 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:47:11.860 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:11 smithi022 ceph-mon[39439]: pgmap v1430: 17 pgs: 17 active+clean; 6.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:47:11.864 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:11 smithi062 ceph-mon[44211]: pgmap v1430: 17 pgs: 17 active+clean; 6.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:47:11.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:11 smithi188 ceph-mon[43939]: pgmap v1430: 17 pgs: 17 active+clean; 6.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:47:11.961 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:47:11.993 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:12.014 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:47:12.018 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:12.018 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:47:12.119 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:47:12.159 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:12.194 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:47:12.201 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:12.202 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:47:12.302 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:47:12.331 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:12.338 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:47:12.368 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:47:12.409 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:47:12.452 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:47:12.476 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:47:12.518 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:47:12.533 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:47:12.535 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:12.535 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:47:12.550 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:47:12.585 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:47:12.612 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:47:12.636 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:47:12.644 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:47:12.671 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:12.673 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:47:12.700 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:47:12.707 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:12.708 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:47:12.708 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:47:12.709 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:47:12.709 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:47:12.709 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:47:12.709 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:47:12.709 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:47:12.709 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:47:12.709 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:47:12.709 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:47:12.709 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:47:12.710 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:47:12.710 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:47:12.710 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:47:12.808 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:47:12.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:12 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:47:12.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:12 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:47:12.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:12 smithi022 ceph-mon[39439]: osdmap e521: 12 total, 12 up, 12 in 2024-04-01T19:47:12.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:12 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3200621800' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:47:12.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:12.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:12.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:12.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:12.867 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:12 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:47:12.867 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:12 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:47:12.867 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:12 smithi062 ceph-mon[44211]: osdmap e521: 12 total, 12 up, 12 in 2024-04-01T19:47:12.867 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:12 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3200621800' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:47:12.868 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:12.868 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:12.868 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:12.868 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:12.868 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:12.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:12 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:47:12.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:12 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:47:12.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:12 smithi188 ceph-mon[43939]: osdmap e521: 12 total, 12 up, 12 in 2024-04-01T19:47:12.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:12 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3200621800' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:47:12.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:12.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:12.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:12.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:12.912 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:47:12.921 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:12.922 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:47:13.023 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:47:13.050 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:13.072 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:47:13.073 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:47:13.076 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:13.076 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:47:13.177 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:47:13.232 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:13.456 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:47:13.467 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:13.467 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:47:13.568 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:47:13.581 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:47:13.635 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:13.727 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:47:13.727 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:47:13.740 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:47:13.745 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:13.745 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:13.745 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:13.745 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:13.745 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:13.746 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:13.746 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:13.746 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:13.746 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:13 smithi022 ceph-mon[39439]: pgmap v1432: 17 pgs: 17 active+clean; 6.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:47:13.746 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:13.747 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:47:13.749 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:13.749 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:13.750 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:13.750 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:13.750 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:13.750 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:13.750 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:13.750 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:13.750 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:13 smithi188 ceph-mon[43939]: pgmap v1432: 17 pgs: 17 active+clean; 6.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:47:13.848 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:47:13.885 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:13.925 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:47:13.930 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:13.931 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:47:14.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:14.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:14.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:14.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:14.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:14.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:14.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:14.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:14.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:13 smithi062 ceph-mon[44211]: pgmap v1432: 17 pgs: 17 active+clean; 6.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:47:14.031 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:47:14.073 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:14.125 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:47:14.129 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:14.129 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:47:14.230 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:47:14.280 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:14.446 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:47:14.453 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:14.453 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:47:14.509 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_blocked_ops 2024-04-01T19:47:14.554 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:47:14.591 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:14.637 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:47:14.642 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:14.642 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:47:14.743 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:47:14.811 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:14.812 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:47:14.851 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:47:14.861 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:14.862 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:47:14.962 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:47:15.022 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:15.052 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:47:15.057 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:15.057 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:47:15.158 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:47:15.195 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:15.338 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:47:15.348 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:15.349 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:47:15.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:15 smithi188 ceph-mon[43939]: pgmap v1433: 17 pgs: 17 active+clean; 6.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:47:15.449 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:47:15.496 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:47:15.504 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:15.536 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:47:15.544 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:15 smithi062 ceph-mon[44211]: pgmap v1433: 17 pgs: 17 active+clean; 6.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:47:15.545 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:15.545 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:47:15.548 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:15 smithi022 ceph-mon[39439]: pgmap v1433: 17 pgs: 17 active+clean; 6.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:47:15.646 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:47:15.721 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:15.820 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:47:15.823 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:15.824 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:47:15.924 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:47:15.932 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:47:15.973 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:16.013 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:47:16.017 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:16.017 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:47:16.118 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:47:16.157 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:16.274 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:47:16.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:16 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1706036986' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:47:16.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:16 smithi022 ceph-mon[39439]: from='client.26458 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:47:16.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:16 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1706036986' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:47:16.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:16 smithi188 ceph-mon[43939]: from='client.26458 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:47:16.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:16 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1706036986' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:47:16.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:16 smithi062 ceph-mon[44211]: from='client.26458 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:47:17.126 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:47:17.129 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:17.130 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:47:17.231 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:47:17.299 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:17.331 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:47:17.336 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:17.337 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:47:17.342 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:47:17.342 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:47:17.437 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:47:17.470 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:17.526 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:17 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:47:17.526 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:17 smithi022 ceph-mon[39439]: from='client.26458 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:47:17.526 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:17 smithi022 ceph-mon[39439]: osdmap e522: 12 total, 12 up, 12 in 2024-04-01T19:47:17.526 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:17 smithi022 ceph-mon[39439]: pgmap v1435: 17 pgs: 17 active+clean; 6.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.18k op/s 2024-04-01T19:47:17.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:17 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:47:17.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:17 smithi188 ceph-mon[43939]: from='client.26458 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:47:17.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:17 smithi188 ceph-mon[43939]: osdmap e522: 12 total, 12 up, 12 in 2024-04-01T19:47:17.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:17 smithi188 ceph-mon[43939]: pgmap v1435: 17 pgs: 17 active+clean; 6.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.18k op/s 2024-04-01T19:47:17.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:17 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:47:17.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:17 smithi062 ceph-mon[44211]: from='client.26458 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:47:17.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:17 smithi062 ceph-mon[44211]: osdmap e522: 12 total, 12 up, 12 in 2024-04-01T19:47:17.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:17 smithi062 ceph-mon[44211]: pgmap v1435: 17 pgs: 17 active+clean; 6.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.18k op/s 2024-04-01T19:47:18.120 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:47:18.125 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:18.125 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:47:18.156 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_historic_ops 2024-04-01T19:47:18.226 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:47:18.269 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:18.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:18 smithi188 ceph-mon[43939]: 6.5 scrub starts 2024-04-01T19:47:18.481 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:47:18.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:18 smithi022 ceph-mon[39439]: 6.5 scrub starts 2024-04-01T19:47:18.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:18 smithi062 ceph-mon[44211]: 6.5 scrub starts 2024-04-01T19:47:19.572 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:47:19.577 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:19.577 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:47:19.578 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:19 smithi022 ceph-mon[39439]: 6.2 scrub starts 2024-04-01T19:47:19.578 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:19 smithi022 ceph-mon[39439]: 6.a scrub starts 2024-04-01T19:47:19.578 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:19 smithi022 ceph-mon[39439]: 6.f scrub starts 2024-04-01T19:47:19.578 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:19 smithi022 ceph-mon[39439]: 6.b scrub starts 2024-04-01T19:47:19.578 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:19 smithi022 ceph-mon[39439]: pgmap v1436: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:47:19.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:19 smithi188 ceph-mon[43939]: 6.2 scrub starts 2024-04-01T19:47:19.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:19 smithi188 ceph-mon[43939]: 6.a scrub starts 2024-04-01T19:47:19.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:19 smithi188 ceph-mon[43939]: 6.f scrub starts 2024-04-01T19:47:19.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:19 smithi188 ceph-mon[43939]: 6.b scrub starts 2024-04-01T19:47:19.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:19 smithi188 ceph-mon[43939]: pgmap v1436: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:47:19.678 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:47:19.708 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:19.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:19 smithi062 ceph-mon[44211]: 6.2 scrub starts 2024-04-01T19:47:19.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:19 smithi062 ceph-mon[44211]: 6.a scrub starts 2024-04-01T19:47:19.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:19 smithi062 ceph-mon[44211]: 6.f scrub starts 2024-04-01T19:47:19.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:19 smithi062 ceph-mon[44211]: 6.b scrub starts 2024-04-01T19:47:19.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:19 smithi062 ceph-mon[44211]: pgmap v1436: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:47:19.808 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:47:19.810 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:19.811 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:47:19.912 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:47:20.077 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:20.129 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:47:20.132 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:20.133 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:47:20.234 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:47:20.321 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:20.458 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:47:20.458 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:47:20.482 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:20 smithi188 ceph-mon[43939]: 6.5 scrub ok 2024-04-01T19:47:20.482 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:20 smithi188 ceph-mon[43939]: 6.f scrub ok 2024-04-01T19:47:20.482 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:20 smithi188 ceph-mon[43939]: 6.2 scrub ok 2024-04-01T19:47:20.482 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:20 smithi188 ceph-mon[43939]: 6.d scrub starts 2024-04-01T19:47:20.482 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:20 smithi188 ceph-mon[43939]: 6.4 scrub starts 2024-04-01T19:47:20.482 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:20 smithi188 ceph-mon[43939]: 6.a scrub ok 2024-04-01T19:47:20.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:20 smithi062 ceph-mon[44211]: 6.5 scrub ok 2024-04-01T19:47:20.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:20 smithi062 ceph-mon[44211]: 6.f scrub ok 2024-04-01T19:47:20.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:20 smithi062 ceph-mon[44211]: 6.2 scrub ok 2024-04-01T19:47:20.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:20 smithi062 ceph-mon[44211]: 6.d scrub starts 2024-04-01T19:47:20.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:20 smithi062 ceph-mon[44211]: 6.4 scrub starts 2024-04-01T19:47:20.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:20 smithi062 ceph-mon[44211]: 6.a scrub ok 2024-04-01T19:47:20.538 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:47:20.543 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:20.543 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:20 smithi022 ceph-mon[39439]: 6.5 scrub ok 2024-04-01T19:47:20.543 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:20 smithi022 ceph-mon[39439]: 6.f scrub ok 2024-04-01T19:47:20.543 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:20 smithi022 ceph-mon[39439]: 6.2 scrub ok 2024-04-01T19:47:20.543 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:20 smithi022 ceph-mon[39439]: 6.d scrub starts 2024-04-01T19:47:20.544 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:20 smithi022 ceph-mon[39439]: 6.4 scrub starts 2024-04-01T19:47:20.544 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:20 smithi022 ceph-mon[39439]: 6.a scrub ok 2024-04-01T19:47:20.544 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:47:20.645 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:47:20.687 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:20.818 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:47:20.828 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:20.829 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:47:20.930 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:47:21.070 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:21.108 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:47:21.112 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:21.112 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:47:21.207 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_ops_in_flight 2024-04-01T19:47:21.213 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:47:21.242 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:21.265 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:47:21.268 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:21.268 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:47:21.312 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:47:21.338 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:21 smithi062 ceph-mon[44211]: 6.b scrub ok 2024-04-01T19:47:21.339 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:21 smithi062 ceph-mon[44211]: 6.0 scrub starts 2024-04-01T19:47:21.339 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:21 smithi062 ceph-mon[44211]: 6.d scrub ok 2024-04-01T19:47:21.339 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:21 smithi062 ceph-mon[44211]: pgmap v1437: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 5.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:47:21.339 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:21 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4258447356' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:47:21.340 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:47:21.369 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:47:21.375 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:47:21.397 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:21.408 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:47:21.418 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:47:21.421 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:21.421 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:47:21.453 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:47:21.495 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:47:21.522 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:47:21.522 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:47:21.543 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:47:21.570 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:47:21.582 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:21.604 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:47:21.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:21 smithi022 ceph-mon[39439]: 6.b scrub ok 2024-04-01T19:47:21.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:21 smithi022 ceph-mon[39439]: 6.0 scrub starts 2024-04-01T19:47:21.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:21 smithi022 ceph-mon[39439]: 6.d scrub ok 2024-04-01T19:47:21.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:21 smithi022 ceph-mon[39439]: pgmap v1437: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 5.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:47:21.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:21 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4258447356' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:47:21.616 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:47:21.622 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:21.623 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:47:21.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:21 smithi188 ceph-mon[43939]: 6.b scrub ok 2024-04-01T19:47:21.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:21 smithi188 ceph-mon[43939]: 6.0 scrub starts 2024-04-01T19:47:21.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:21 smithi188 ceph-mon[43939]: 6.d scrub ok 2024-04-01T19:47:21.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:21 smithi188 ceph-mon[43939]: pgmap v1437: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 5.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.16k op/s 2024-04-01T19:47:21.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:21 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4258447356' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:47:21.633 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:47:21.658 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:47:21.682 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:47:21.688 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:47:21.688 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:47:21.688 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:47:21.688 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:47:21.688 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:47:21.688 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:47:21.688 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:47:21.688 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:47:21.688 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:47:21.688 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:47:21.688 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:47:21.689 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:47:21.724 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:47:21.776 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:21.791 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:47:21.814 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:47:21.832 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:21.833 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:47:21.934 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:47:21.991 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:22.021 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:47:22.348 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:22 smithi022 ceph-mon[39439]: 6.4 scrub ok 2024-04-01T19:47:22.348 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:22 smithi022 ceph-mon[39439]: 6.7 scrub starts 2024-04-01T19:47:22.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:22 smithi022 ceph-mon[39439]: 6.0 scrub ok 2024-04-01T19:47:22.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:22 smithi062 ceph-mon[44211]: 6.4 scrub ok 2024-04-01T19:47:22.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:22 smithi062 ceph-mon[44211]: 6.7 scrub starts 2024-04-01T19:47:22.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:22 smithi062 ceph-mon[44211]: 6.0 scrub ok 2024-04-01T19:47:22.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:22 smithi188 ceph-mon[43939]: 6.4 scrub ok 2024-04-01T19:47:22.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:22 smithi188 ceph-mon[43939]: 6.7 scrub starts 2024-04-01T19:47:22.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:22 smithi188 ceph-mon[43939]: 6.0 scrub ok 2024-04-01T19:47:22.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:22.774 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:47:22.782 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:22.783 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:47:22.883 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:47:22.911 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:22.931 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:47:22.933 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:22.934 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:47:23.034 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:47:23.107 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:23.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:23.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:23.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:23 smithi022 ceph-mon[39439]: pgmap v1438: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 5.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:47:23.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:23.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:23.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:23 smithi188 ceph-mon[43939]: pgmap v1438: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 5.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:47:23.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:23.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:23.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:23 smithi062 ceph-mon[44211]: pgmap v1438: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 5.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:47:24.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:24 smithi022 ceph-mon[39439]: 6.7 scrub ok 2024-04-01T19:47:24.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:24 smithi022 ceph-mon[39439]: 6.3 scrub starts 2024-04-01T19:47:24.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:24 smithi188 ceph-mon[43939]: 6.7 scrub ok 2024-04-01T19:47:24.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:24 smithi188 ceph-mon[43939]: 6.3 scrub starts 2024-04-01T19:47:25.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:24 smithi062 ceph-mon[44211]: 6.7 scrub ok 2024-04-01T19:47:25.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:24 smithi062 ceph-mon[44211]: 6.3 scrub starts 2024-04-01T19:47:25.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:25 smithi022 ceph-mon[39439]: 6.8 scrub starts 2024-04-01T19:47:25.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:25 smithi022 ceph-mon[39439]: pgmap v1439: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 5.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T19:47:25.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:25 smithi062 ceph-mon[44211]: 6.8 scrub starts 2024-04-01T19:47:25.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:25 smithi062 ceph-mon[44211]: pgmap v1439: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 5.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T19:47:25.800 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:47:25.862 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:47:25.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:25 smithi188 ceph-mon[43939]: 6.8 scrub starts 2024-04-01T19:47:25.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:25 smithi188 ceph-mon[43939]: pgmap v1439: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 5.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T19:47:26.026 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:26.027 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:47:26.127 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:47:26.167 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:26.219 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:47:26.223 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:26.224 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:47:26.278 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:47:26.324 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:47:26.405 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:47:26.428 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:26 smithi022 ceph-mon[39439]: 6.3 scrub ok 2024-04-01T19:47:26.428 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:26 smithi022 ceph-mon[39439]: 6.8 scrub ok 2024-04-01T19:47:26.428 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:26 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2942024917' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:47:26.428 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:26 smithi022 ceph-mon[39439]: from='client.36512 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:47:26.685 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:26.688 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:26 smithi062 ceph-mon[44211]: 6.3 scrub ok 2024-04-01T19:47:26.688 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:26 smithi062 ceph-mon[44211]: 6.8 scrub ok 2024-04-01T19:47:26.688 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:26 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2942024917' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:47:26.688 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:26 smithi062 ceph-mon[44211]: from='client.36512 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:47:26.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:26 smithi188 ceph-mon[43939]: 6.3 scrub ok 2024-04-01T19:47:26.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:26 smithi188 ceph-mon[43939]: 6.8 scrub ok 2024-04-01T19:47:26.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:26 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2942024917' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:47:26.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:26 smithi188 ceph-mon[43939]: from='client.36512 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:47:27.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:27 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:47:27.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:27 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:47:27.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:27 smithi022 ceph-mon[39439]: from='client.36512 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:47:27.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:27 smithi022 ceph-mon[39439]: osdmap e523: 12 total, 12 up, 12 in 2024-04-01T19:47:27.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:27 smithi022 ceph-mon[39439]: pgmap v1441: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:47:27.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:27 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:47:27.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:27 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:47:27.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:27 smithi062 ceph-mon[44211]: from='client.36512 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:47:27.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:27 smithi062 ceph-mon[44211]: osdmap e523: 12 total, 12 up, 12 in 2024-04-01T19:47:27.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:27 smithi062 ceph-mon[44211]: pgmap v1441: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:47:27.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:27 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:47:27.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:27 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:47:27.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:27 smithi188 ceph-mon[43939]: from='client.36512 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:47:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:27 smithi188 ceph-mon[43939]: osdmap e523: 12 total, 12 up, 12 in 2024-04-01T19:47:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:27 smithi188 ceph-mon[43939]: pgmap v1441: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:47:28.463 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-01T19:47:28.463 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:47:28.478 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:47:28.484 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:28.485 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:47:28.586 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:47:28.628 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:28.738 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:47:28.742 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:28.743 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:47:28.844 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:47:28.871 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:28.892 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:47:28.898 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:28.898 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:47:28.999 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:47:29.026 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:29.045 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:47:29.047 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:29.048 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:47:29.146 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:47:29.146 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:47:29.146 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.146 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.26287.0:228493 6.3 e523/469 6:c49d5f15:::benchmark_data_smithi188_134454_object71752:head v 523'14602, mlcod=523'14598)", 2024-04-01T19:47:29.146 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:47:29.127951+0000", 2024-04-01T19:47:29.146 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.015345704, 2024-04-01T19:47:29.146 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.015376422000000001, 2024-04-01T19:47:29.146 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:47:29.146 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:47:29.147 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "started", 2024-04-01T19:47:29.147 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:47:29.147 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.147 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:47:29.147 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.127951+0000", 2024-04-01T19:47:29.147 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:47:29.147 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.147 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.147 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:47:29.147 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.127951+0000", 2024-04-01T19:47:29.147 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:47:29.147 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.147 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.148 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:47:29.148 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.127952+0000", 2024-04-01T19:47:29.148 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2249999999999999e-06 2024-04-01T19:47:29.148 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.148 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.148 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:47:29.148 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.127959+0000", 2024-04-01T19:47:29.148 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2450000000000003e-06 2024-04-01T19:47:29.148 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.148 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.148 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:47:29.148 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.127966+0000", 2024-04-01T19:47:29.148 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1380000000000001e-06 2024-04-01T19:47:29.148 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.149 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.149 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:47:29.149 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.127971+0000", 2024-04-01T19:47:29.149 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.887e-06 2024-04-01T19:47:29.149 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.149 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.149 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:47:29.149 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.132991+0000", 2024-04-01T19:47:29.149 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0050207159999999997 2024-04-01T19:47:29.149 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.149 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.149 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:47:29.149 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.133025+0000", 2024-04-01T19:47:29.150 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.3964999999999998e-05 2024-04-01T19:47:29.150 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:47:29.150 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:47:29.150 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:47:29.150 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.150 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.150 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.26287.0:228505 6.5 e523/469 6:a519dbc9:::benchmark_data_smithi188_134454_object71764:head v 523'14286, mlcod=523'14282)", 2024-04-01T19:47:29.150 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:47:29.138045+0000", 2024-04-01T19:47:29.150 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0052520860000000004, 2024-04-01T19:47:29.150 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.005357672, 2024-04-01T19:47:29.150 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:47:29.150 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:47:29.151 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "started", 2024-04-01T19:47:29.151 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:47:29.151 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.151 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:47:29.151 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.138045+0000", 2024-04-01T19:47:29.151 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:47:29.151 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.151 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.151 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:47:29.151 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.138045+0000", 2024-04-01T19:47:29.151 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:47:29.151 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.151 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.151 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:47:29.151 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.138046+0000", 2024-04-01T19:47:29.152 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.6610000000000001e-06 2024-04-01T19:47:29.152 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.152 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.152 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:47:29.152 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.138054+0000", 2024-04-01T19:47:29.152 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9580000000000007e-06 2024-04-01T19:47:29.152 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.152 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.152 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:47:29.152 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.138067+0000", 2024-04-01T19:47:29.152 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3144e-05 2024-04-01T19:47:29.152 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.152 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.152 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:47:29.153 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.138075+0000", 2024-04-01T19:47:29.153 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0129999999999993e-06 2024-04-01T19:47:29.153 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.153 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.153 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:47:29.153 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.138223+0000", 2024-04-01T19:47:29.153 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000147331 2024-04-01T19:47:29.153 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.153 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.153 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:47:29.153 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.138244+0000", 2024-04-01T19:47:29.153 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1491000000000001e-05 2024-04-01T19:47:29.153 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:47:29.153 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:47:29.153 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:47:29.154 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.154 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.154 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.26287.0:228504 6.3 e523/469 6:c7ccee6e:::benchmark_data_smithi188_134454_object71763:head v 523'14603, mlcod=523'14599)", 2024-04-01T19:47:29.154 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:47:29.138098+0000", 2024-04-01T19:47:29.154 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0051991579999999997, 2024-04-01T19:47:29.154 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0053668739999999998, 2024-04-01T19:47:29.154 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:47:29.154 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:47:29.154 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "started", 2024-04-01T19:47:29.154 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:47:29.154 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.154 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:47:29.154 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.138098+0000", 2024-04-01T19:47:29.155 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:47:29.155 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.155 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.155 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:47:29.155 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.138098+0000", 2024-04-01T19:47:29.155 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:47:29.155 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.155 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.155 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:47:29.155 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.138098+0000", 2024-04-01T19:47:29.155 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3799999999999997e-07 2024-04-01T19:47:29.155 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.155 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.155 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:47:29.155 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.138104+0000", 2024-04-01T19:47:29.156 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5620000000000003e-06 2024-04-01T19:47:29.156 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.156 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.156 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:47:29.156 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.138112+0000", 2024-04-01T19:47:29.156 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.2239999999999995e-06 2024-04-01T19:47:29.156 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.156 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.156 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:47:29.156 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.138118+0000", 2024-04-01T19:47:29.156 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7289999999999997e-06 2024-04-01T19:47:29.156 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.156 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.156 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:47:29.156 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.139626+0000", 2024-04-01T19:47:29.156 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.001508517 2024-04-01T19:47:29.157 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.157 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.157 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:47:29.157 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.139651+0000", 2024-04-01T19:47:29.157 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.5171e-05 2024-04-01T19:47:29.157 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:47:29.157 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:47:29.157 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:47:29.157 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.157 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.157 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.26287.0:228512 6.5 e523/469 6:a8e2577e:::benchmark_data_smithi188_134454_object71771:head v 523'14287, mlcod=523'14284)", 2024-04-01T19:47:29.157 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:47:29.142870+0000", 2024-04-01T19:47:29.157 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.000426255, 2024-04-01T19:47:29.157 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00065563299999999998, 2024-04-01T19:47:29.157 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:47:29.158 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:47:29.158 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "started", 2024-04-01T19:47:29.158 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:47:29.158 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.158 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:47:29.158 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.142870+0000", 2024-04-01T19:47:29.158 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:47:29.158 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.158 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.158 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:47:29.158 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.142870+0000", 2024-04-01T19:47:29.158 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:47:29.158 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.158 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.159 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:47:29.159 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.142872+0000", 2024-04-01T19:47:29.159 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.6500000000000001e-06 2024-04-01T19:47:29.159 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.159 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.159 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:47:29.159 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.142883+0000", 2024-04-01T19:47:29.159 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0738e-05 2024-04-01T19:47:29.159 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.159 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.159 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:47:29.159 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.142900+0000", 2024-04-01T19:47:29.159 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.6663999999999998e-05 2024-04-01T19:47:29.159 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.159 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.160 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:47:29.160 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.142908+0000", 2024-04-01T19:47:29.160 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.7679999999999997e-06 2024-04-01T19:47:29.160 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.160 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.160 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:47:29.160 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.142955+0000", 2024-04-01T19:47:29.160 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6854000000000002e-05 2024-04-01T19:47:29.160 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:47:29.160 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:47:29.160 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:47:29.160 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:29.142976+0000", 2024-04-01T19:47:29.160 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1143000000000001e-05 2024-04-01T19:47:29.160 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:47:29.161 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:47:29.161 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:47:29.161 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:47:29.161 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-04-01T19:47:29.161 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 4 2024-04-01T19:47:29.161 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:47:29.161 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:47:29.190 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:29.210 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:47:29.212 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:29.212 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:47:29.313 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:47:29.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:29 smithi022 ceph-mon[39439]: pgmap v1442: 17 pgs: 17 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.02k op/s 2024-04-01T19:47:29.370 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:47:29.390 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:29.428 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:47:29.435 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:29.435 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:47:29.435 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:47:29.472 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:47:29.505 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:47:29.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:29 smithi062 ceph-mon[44211]: pgmap v1442: 17 pgs: 17 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.02k op/s 2024-04-01T19:47:29.536 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:47:29.541 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:47:29.561 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:29 smithi188 ceph-mon[43939]: pgmap v1442: 17 pgs: 17 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.02k op/s 2024-04-01T19:47:29.563 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:29.585 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:47:29.586 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:47:29.589 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:29.589 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:47:29.620 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:47:29.647 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:47:29.679 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:47:29.689 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:47:29.716 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:29.716 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:47:29.736 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:47:29.739 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:29.739 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:47:29.754 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:47:29.796 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:47:29.834 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:47:29.838 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:47:29.838 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:47:29.838 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:47:29.838 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:47:29.838 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:47:29.839 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:47:29.839 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:47:29.839 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:47:29.839 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:47:29.839 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:47:29.839 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:47:29.839 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:47:29.839 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:47:29.910 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:30.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:30 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1315738218' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:47:30.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:30.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:30.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:30.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:30.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:30 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1315738218' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:47:30.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:30.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:30.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:30.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:30.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:30 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1315738218' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:47:30.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:30.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:30.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:30.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:30.772 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:47:31.260 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_blocked_ops 2024-04-01T19:47:31.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:31.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:31.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:31.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:31.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:31.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:31.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:31.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:31.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:31 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:47:31.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:31 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:47:31.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:31 smithi062 ceph-mon[44211]: pgmap v1443: 17 pgs: 17 active+clean; 5.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:47:31.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:31.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:31.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:31.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:31.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:31.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:31.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:31.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:31.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:31 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:47:31.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:31 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:47:31.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:31 smithi022 ceph-mon[39439]: pgmap v1443: 17 pgs: 17 active+clean; 5.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:47:31.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:31.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:31.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:31 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:47:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:31 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:47:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:31 smithi188 ceph-mon[43939]: pgmap v1443: 17 pgs: 17 active+clean; 5.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:47:31.878 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:47:32.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:32 smithi062 ceph-mon[44211]: osdmap e524: 12 total, 12 up, 12 in 2024-04-01T19:47:32.527 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:47:32.532 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:32.533 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:47:32.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:32 smithi022 ceph-mon[39439]: osdmap e524: 12 total, 12 up, 12 in 2024-04-01T19:47:32.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:32 smithi188 ceph-mon[43939]: osdmap e524: 12 total, 12 up, 12 in 2024-04-01T19:47:32.633 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:47:32.670 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:32.803 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:47:32.806 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:32.806 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:47:32.907 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:47:32.984 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:33.147 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:47:33.495 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:47:33.499 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:47:33.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:47:33.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:47:33.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: osdmap e525: 12 total, 12 up, 12 in 2024-04-01T19:47:33.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {auth=34,config=2,health=12,kv=52} crc {auth=3928251880,config=2353167246,health=861809967,kv=2587865062}) 2024-04-01T19:47:33.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {kv=1,logm=99} crc {kv=455886305,logm=2992566976}) 2024-04-01T19:47:33.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=693931337}) 2024-04-01T19:47:33.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3005270540}) 2024-04-01T19:47:33.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=620362996}) 2024-04-01T19:47:33.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=976562147}) 2024-04-01T19:47:33.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2080665460}) 2024-04-01T19:47:33.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1245843492}) 2024-04-01T19:47:33.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=453572352}) 2024-04-01T19:47:33.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4018028547}) 2024-04-01T19:47:33.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=362316047}) 2024-04-01T19:47:33.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3228874038}) 2024-04-01T19:47:33.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3921148962}) 2024-04-01T19:47:33.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1994985154}) 2024-04-01T19:47:33.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=301853848}) 2024-04-01T19:47:33.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2562746009}) 2024-04-01T19:47:33.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3773858262}) 2024-04-01T19:47:33.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=593313402}) 2024-04-01T19:47:33.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=387686254}) 2024-04-01T19:47:33.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=958708638}) 2024-04-01T19:47:33.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3024044086}) 2024-04-01T19:47:33.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2196767629}) 2024-04-01T19:47:33.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2700906878}) 2024-04-01T19:47:33.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3793970125}) 2024-04-01T19:47:33.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=290188245}) 2024-04-01T19:47:33.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2867417017}) 2024-04-01T19:47:33.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2680105654}) 2024-04-01T19:47:33.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1108162864}) 2024-04-01T19:47:33.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4099797199}) 2024-04-01T19:47:33.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2092871009}) 2024-04-01T19:47:33.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2905684444}) 2024-04-01T19:47:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=663458676}) 2024-04-01T19:47:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1115939706}) 2024-04-01T19:47:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2481237750}) 2024-04-01T19:47:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3276736380}) 2024-04-01T19:47:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1161367289}) 2024-04-01T19:47:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3966976428}) 2024-04-01T19:47:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=824287610}) 2024-04-01T19:47:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2410448037}) 2024-04-01T19:47:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2780635599}) 2024-04-01T19:47:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3372740693}) 2024-04-01T19:47:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=879867765}) 2024-04-01T19:47:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=387841342}) 2024-04-01T19:47:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3015284678}) 2024-04-01T19:47:33.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2372146430}) 2024-04-01T19:47:33.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1090672452}) 2024-04-01T19:47:33.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1941319724}) 2024-04-01T19:47:33.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1269087429}) 2024-04-01T19:47:33.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2910923552}) 2024-04-01T19:47:33.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1605874828}) 2024-04-01T19:47:33.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=495395249}) 2024-04-01T19:47:33.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3128883136}) 2024-04-01T19:47:33.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2605163888}) 2024-04-01T19:47:33.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2617612392}) 2024-04-01T19:47:33.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=447025307}) 2024-04-01T19:47:33.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=570210030}) 2024-04-01T19:47:33.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1523605791}) 2024-04-01T19:47:33.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2074469093}) 2024-04-01T19:47:33.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1917031996}) 2024-04-01T19:47:33.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1295133287}) 2024-04-01T19:47:33.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2459082625}) 2024-04-01T19:47:33.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3950755485}) 2024-04-01T19:47:33.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=899333355}) 2024-04-01T19:47:33.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2001387970}) 2024-04-01T19:47:33.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1554588139}) 2024-04-01T19:47:33.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1595653794}) 2024-04-01T19:47:33.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1804534917}) 2024-04-01T19:47:33.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2654822647}) 2024-04-01T19:47:33.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=11,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=2,mgrstat=9,mon_config_key=56} crc {logm=915316945,mdsmap=2840952586,mgr=1734247563,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=1563885975,mon_config_key=453014614}) 2024-04-01T19:47:33.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1425286914}) 2024-04-01T19:47:33.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=3603148367}) 2024-04-01T19:47:33.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=33,monmap=5,osd_metadata=12,osd_pg_creating=1,osdmap=49} crc {mon_config_key=2036621963,monmap=3338646291,osd_metadata=1567599116,osd_pg_creating=1343249931,osdmap=3217362422}) 2024-04-01T19:47:33.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=70} crc {osdmap=3320125526}) 2024-04-01T19:47:33.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:33 smithi022 ceph-mon[39439]: pgmap v1446: 17 pgs: 17 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:47:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:47:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:47:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: osdmap e525: 12 total, 12 up, 12 in 2024-04-01T19:47:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {auth=34,config=2,health=12,kv=52} crc {auth=3928251880,config=2353167246,health=861809967,kv=2587865062}) 2024-04-01T19:47:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {kv=1,logm=99} crc {kv=455886305,logm=2992566976}) 2024-04-01T19:47:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=693931337}) 2024-04-01T19:47:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3005270540}) 2024-04-01T19:47:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=620362996}) 2024-04-01T19:47:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=976562147}) 2024-04-01T19:47:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2080665460}) 2024-04-01T19:47:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1245843492}) 2024-04-01T19:47:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=453572352}) 2024-04-01T19:47:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4018028547}) 2024-04-01T19:47:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=362316047}) 2024-04-01T19:47:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3228874038}) 2024-04-01T19:47:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3921148962}) 2024-04-01T19:47:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1994985154}) 2024-04-01T19:47:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=301853848}) 2024-04-01T19:47:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2562746009}) 2024-04-01T19:47:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3773858262}) 2024-04-01T19:47:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=593313402}) 2024-04-01T19:47:33.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=387686254}) 2024-04-01T19:47:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=958708638}) 2024-04-01T19:47:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3024044086}) 2024-04-01T19:47:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2196767629}) 2024-04-01T19:47:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2700906878}) 2024-04-01T19:47:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3793970125}) 2024-04-01T19:47:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=290188245}) 2024-04-01T19:47:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2867417017}) 2024-04-01T19:47:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2680105654}) 2024-04-01T19:47:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1108162864}) 2024-04-01T19:47:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4099797199}) 2024-04-01T19:47:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2092871009}) 2024-04-01T19:47:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2905684444}) 2024-04-01T19:47:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=663458676}) 2024-04-01T19:47:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1115939706}) 2024-04-01T19:47:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2481237750}) 2024-04-01T19:47:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3276736380}) 2024-04-01T19:47:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1161367289}) 2024-04-01T19:47:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3966976428}) 2024-04-01T19:47:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=824287610}) 2024-04-01T19:47:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2410448037}) 2024-04-01T19:47:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2780635599}) 2024-04-01T19:47:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3372740693}) 2024-04-01T19:47:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=879867765}) 2024-04-01T19:47:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=387841342}) 2024-04-01T19:47:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3015284678}) 2024-04-01T19:47:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2372146430}) 2024-04-01T19:47:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1090672452}) 2024-04-01T19:47:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1941319724}) 2024-04-01T19:47:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1269087429}) 2024-04-01T19:47:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2910923552}) 2024-04-01T19:47:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1605874828}) 2024-04-01T19:47:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=495395249}) 2024-04-01T19:47:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3128883136}) 2024-04-01T19:47:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2605163888}) 2024-04-01T19:47:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2617612392}) 2024-04-01T19:47:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=447025307}) 2024-04-01T19:47:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=570210030}) 2024-04-01T19:47:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1523605791}) 2024-04-01T19:47:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2074469093}) 2024-04-01T19:47:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1917031996}) 2024-04-01T19:47:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1295133287}) 2024-04-01T19:47:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2459082625}) 2024-04-01T19:47:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3950755485}) 2024-04-01T19:47:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=899333355}) 2024-04-01T19:47:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2001387970}) 2024-04-01T19:47:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1554588139}) 2024-04-01T19:47:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1595653794}) 2024-04-01T19:47:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1804534917}) 2024-04-01T19:47:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2654822647}) 2024-04-01T19:47:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=11,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=2,mgrstat=9,mon_config_key=56} crc {logm=915316945,mdsmap=2840952586,mgr=1734247563,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=1563885975,mon_config_key=453014614}) 2024-04-01T19:47:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1425286914}) 2024-04-01T19:47:33.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=3603148367}) 2024-04-01T19:47:33.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=33,monmap=5,osd_metadata=12,osd_pg_creating=1,osdmap=49} crc {mon_config_key=2036621963,monmap=3338646291,osd_metadata=1567599116,osd_pg_creating=1343249931,osdmap=3217362422}) 2024-04-01T19:47:33.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=70} crc {osdmap=3320125526}) 2024-04-01T19:47:33.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:33 smithi188 ceph-mon[43939]: pgmap v1446: 17 pgs: 17 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:47:33.644 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:47:33.654 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:47:33.654 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:47:33.654 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: osdmap e525: 12 total, 12 up, 12 in 2024-04-01T19:47:33.654 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {auth=34,config=2,health=12,kv=52} crc {auth=3928251880,config=2353167246,health=861809967,kv=2587865062}) 2024-04-01T19:47:33.655 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {kv=1,logm=99} crc {kv=455886305,logm=2992566976}) 2024-04-01T19:47:33.655 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=693931337}) 2024-04-01T19:47:33.655 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3005270540}) 2024-04-01T19:47:33.655 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=620362996}) 2024-04-01T19:47:33.655 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=976562147}) 2024-04-01T19:47:33.655 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2080665460}) 2024-04-01T19:47:33.655 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1245843492}) 2024-04-01T19:47:33.655 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=453572352}) 2024-04-01T19:47:33.655 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4018028547}) 2024-04-01T19:47:33.655 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=362316047}) 2024-04-01T19:47:33.655 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3228874038}) 2024-04-01T19:47:33.655 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3921148962}) 2024-04-01T19:47:33.655 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1994985154}) 2024-04-01T19:47:33.656 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=301853848}) 2024-04-01T19:47:33.656 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2562746009}) 2024-04-01T19:47:33.656 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3773858262}) 2024-04-01T19:47:33.656 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=593313402}) 2024-04-01T19:47:33.656 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=387686254}) 2024-04-01T19:47:33.656 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=958708638}) 2024-04-01T19:47:33.656 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3024044086}) 2024-04-01T19:47:33.656 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2196767629}) 2024-04-01T19:47:33.656 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2700906878}) 2024-04-01T19:47:33.656 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3793970125}) 2024-04-01T19:47:33.656 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=290188245}) 2024-04-01T19:47:33.656 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2867417017}) 2024-04-01T19:47:33.656 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2680105654}) 2024-04-01T19:47:33.657 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1108162864}) 2024-04-01T19:47:33.657 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4099797199}) 2024-04-01T19:47:33.657 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2092871009}) 2024-04-01T19:47:33.657 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2905684444}) 2024-04-01T19:47:33.657 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=663458676}) 2024-04-01T19:47:33.657 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1115939706}) 2024-04-01T19:47:33.657 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2481237750}) 2024-04-01T19:47:33.657 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3276736380}) 2024-04-01T19:47:33.657 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1161367289}) 2024-04-01T19:47:33.657 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3966976428}) 2024-04-01T19:47:33.657 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=824287610}) 2024-04-01T19:47:33.657 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2410448037}) 2024-04-01T19:47:33.657 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2780635599}) 2024-04-01T19:47:33.658 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3372740693}) 2024-04-01T19:47:33.658 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=879867765}) 2024-04-01T19:47:33.658 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=387841342}) 2024-04-01T19:47:33.658 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3015284678}) 2024-04-01T19:47:33.658 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2372146430}) 2024-04-01T19:47:33.658 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1090672452}) 2024-04-01T19:47:33.658 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1941319724}) 2024-04-01T19:47:33.658 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1269087429}) 2024-04-01T19:47:33.658 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2910923552}) 2024-04-01T19:47:33.658 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1605874828}) 2024-04-01T19:47:33.658 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=495395249}) 2024-04-01T19:47:33.658 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3128883136}) 2024-04-01T19:47:33.658 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2605163888}) 2024-04-01T19:47:33.659 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2617612392}) 2024-04-01T19:47:33.659 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=447025307}) 2024-04-01T19:47:33.659 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=570210030}) 2024-04-01T19:47:33.659 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1523605791}) 2024-04-01T19:47:33.659 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2074469093}) 2024-04-01T19:47:33.659 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1917031996}) 2024-04-01T19:47:33.659 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1295133287}) 2024-04-01T19:47:33.659 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2459082625}) 2024-04-01T19:47:33.659 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3950755485}) 2024-04-01T19:47:33.659 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=899333355}) 2024-04-01T19:47:33.659 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2001387970}) 2024-04-01T19:47:33.659 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1554588139}) 2024-04-01T19:47:33.659 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1595653794}) 2024-04-01T19:47:33.660 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1804534917}) 2024-04-01T19:47:33.660 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2654822647}) 2024-04-01T19:47:33.660 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=11,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=2,mgrstat=9,mon_config_key=56} crc {logm=915316945,mdsmap=2840952586,mgr=1734247563,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=1563885975,mon_config_key=453014614}) 2024-04-01T19:47:33.660 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1425286914}) 2024-04-01T19:47:33.660 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=3603148367}) 2024-04-01T19:47:33.660 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=33,monmap=5,osd_metadata=12,osd_pg_creating=1,osdmap=49} crc {mon_config_key=2036621963,monmap=3338646291,osd_metadata=1567599116,osd_pg_creating=1343249931,osdmap=3217362422}) 2024-04-01T19:47:33.660 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=70} crc {osdmap=3320125526}) 2024-04-01T19:47:33.660 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:33 smithi062 ceph-mon[44211]: pgmap v1446: 17 pgs: 17 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:47:33.661 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:33.661 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:47:33.762 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:47:33.812 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:33.923 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:47:33.928 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:33.928 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:47:34.029 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:47:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:34.297 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:47:34.301 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:34.301 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:47:34.371 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":1446,"stamp":"2024-04-01T19:47:33.163289+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5437915704,"num_objects":82970,"num_object_clones":0,"num_object_copies":165940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82970,"num_whiteouts":0,"num_read":127,"num_read_kb":110,"num_write":230691,"num_write_kb":10034171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160983,"ondisk_log_size":160983,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":15694096,"kb_used_data":10698908,"kb_used_omap":892,"kb_used_meta":4993859,"kb_avail":1109247728,"statfs":{"total":1151940427776,"available":1135869673472,"internally_reserved":0,"allocated":10955681792,"data_stored":10951336376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":913534,"internal_metadata":5113712514},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,4,4,5],"upper_bound":32},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-490602496,"num_objects":-7486,"num_object_clones":0,"num_object_copies":-14972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7486,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7486,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.778962"},"pg_stats":[{"pgid":"6.f","version":"524'14457","reported_seq":14739,"reported_epoch":524,"state":"active+clean","last_fresh":"2024-04-01T19:47:31.896609+0000","last_change":"2024-04-01T19:47:18.849561+0000","last_active":"2024-04-01T19:47:31.896609+0000","last_peered":"2024-04-01T19:47:31.896609+0000","last_clean":"2024-04-01T19:47:31.896609+0000","last_became_active":"2024-04-01T19:44:40.026862+0000","last_became_peered":"2024-04-01T19:44:40.026862+0000","last_unstale":"2024-04-01T19:47:31.896609+0000","last_undegraded":"2024-04-01T19:47:31.896609+0000","last_fullsized":"2024-04-01T19:47:31.896609+0000","mapping_epoch":469,"log_start":"483'4400","ondisk_log_start":"483'4400","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"522'13591","last_scrub_stamp":"2024-04-01T19:47:18.849364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:47:18.849364+0000","objects_scrubbed":5848,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:48:40.533498+0000","scrub_duration":864,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325255168,"num_objects":4963,"num_object_clones":0,"num_object_copies":9926,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4963,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14457,"num_write_kb":621440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"524'17105","reported_seq":17453,"reported_epoch":524,"state":"active+clean","last_fresh":"2024-04-01T19:47:31.850515+0000","last_change":"2024-04-01T19:46:41.015313+0000","last_active":"2024-04-01T19:47:31.850515+0000","last_peered":"2024-04-01T19:47:31.850515+0000","last_clean":"2024-04-01T19:47:31.850515+0000","last_became_active":"2024-04-01T19:44:39.212105+0000","last_became_peered":"2024-04-01T19:44:39.212105+0000","last_unstale":"2024-04-01T19:47:31.850515+0000","last_undegraded":"2024-04-01T19:47:31.850515+0000","last_fullsized":"2024-04-01T19:47:31.850515+0000","mapping_epoch":469,"log_start":"490'7101","ondisk_log_start":"490'7101","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"511'13542","last_scrub_stamp":"2024-04-01T19:46:41.015113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:46:41.015113+0000","objects_scrubbed":8842,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:47:46.847564+0000","scrub_duration":2355,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340721664,"num_objects":5199,"num_object_clones":0,"num_object_copies":10398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14559,"num_write_kb":632256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"523'14089","reported_seq":14358,"reported_epoch":523,"state":"active+clean","last_fresh":"2024-04-01T19:47:30.902840+0000","last_change":"2024-04-01T19:47:20.231254+0000","last_active":"2024-04-01T19:47:30.902840+0000","last_peered":"2024-04-01T19:47:30.902840+0000","last_clean":"2024-04-01T19:47:30.902840+0000","last_became_active":"2024-04-01T19:44:39.211055+0000","last_became_peered":"2024-04-01T19:44:39.211055+0000","last_unstale":"2024-04-01T19:47:30.902840+0000","last_undegraded":"2024-04-01T19:47:30.902840+0000","last_fullsized":"2024-04-01T19:47:30.902840+0000","mapping_epoch":469,"log_start":"482'4000","ondisk_log_start":"482'4000","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"522'13389","last_scrub_stamp":"2024-04-01T19:47:20.231145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:47:20.231145+0000","objects_scrubbed":5794,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:48:26.414428+0000","scrub_duration":1267,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331481112,"num_objects":5059,"num_object_clones":0,"num_object_copies":10118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5059,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14089,"num_write_kb":612673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"525'17462","reported_seq":17828,"reported_epoch":525,"state":"active+clean","last_fresh":"2024-04-01T19:47:33.084079+0000","last_change":"2024-04-01T19:46:45.906978+0000","last_active":"2024-04-01T19:47:33.084079+0000","last_peered":"2024-04-01T19:47:33.084079+0000","last_clean":"2024-04-01T19:47:33.084079+0000","last_became_active":"2024-04-01T19:44:39.537984+0000","last_became_peered":"2024-04-01T19:44:39.537984+0000","last_unstale":"2024-04-01T19:47:33.084079+0000","last_undegraded":"2024-04-01T19:47:33.084079+0000","last_fullsized":"2024-04-01T19:47:33.084079+0000","mapping_epoch":469,"log_start":"492'7400","ondisk_log_start":"492'7400","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"513'14175","last_scrub_stamp":"2024-04-01T19:46:45.906760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:46:45.906760+0000","objects_scrubbed":8390,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:47:47.442256+0000","scrub_duration":2103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329318400,"num_objects":5025,"num_object_clones":0,"num_object_copies":10050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5025,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14573,"num_write_kb":627136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"525'14449","reported_seq":14738,"reported_epoch":525,"state":"active+clean","last_fresh":"2024-04-01T19:47:33.096656+0000","last_change":"2024-04-01T19:47:19.551131+0000","last_active":"2024-04-01T19:47:33.096656+0000","last_peered":"2024-04-01T19:47:33.096656+0000","last_clean":"2024-04-01T19:47:33.096656+0000","last_became_active":"2024-04-01T19:44:39.211801+0000","last_became_peered":"2024-04-01T19:44:39.211801+0000","last_unstale":"2024-04-01T19:47:33.096656+0000","last_undegraded":"2024-04-01T19:47:33.096656+0000","last_fullsized":"2024-04-01T19:47:33.096656+0000","mapping_epoch":469,"log_start":"483'4400","ondisk_log_start":"483'4400","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"522'13531","last_scrub_stamp":"2024-04-01T19:47:19.551007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:47:19.551007+0000","objects_scrubbed":5936,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:48:26.914116+0000","scrub_duration":1356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":326303744,"num_objects":4979,"num_object_clones":0,"num_object_copies":9958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4979,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14449,"num_write_kb":621696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"523'14409","reported_seq":14748,"reported_epoch":523,"state":"active+clean","last_fresh":"2024-04-01T19:47:30.890651+0000","last_change":"2024-04-01T19:47:19.437874+0000","last_active":"2024-04-01T19:47:30.890651+0000","last_peered":"2024-04-01T19:47:30.890651+0000","last_clean":"2024-04-01T19:47:30.890651+0000","last_became_active":"2024-04-01T19:44:39.537660+0000","last_became_peered":"2024-04-01T19:44:39.537660+0000","last_unstale":"2024-04-01T19:47:30.890651+0000","last_undegraded":"2024-04-01T19:47:30.890651+0000","last_fullsized":"2024-04-01T19:47:30.890651+0000","mapping_epoch":469,"log_start":"483'4400","ondisk_log_start":"483'4400","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"522'13607","last_scrub_stamp":"2024-04-01T19:47:19.437737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:47:19.437737+0000","objects_scrubbed":6001,"log_size":10009,"log_dups_size":0,"ondisk_log_size":10009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:48:23.616160+0000","scrub_duration":1481,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":338231296,"num_objects":5161,"num_object_clones":0,"num_object_copies":10322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5161,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14409,"num_write_kb":626240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"523'14464","reported_seq":14682,"reported_epoch":523,"state":"active+clean","last_fresh":"2024-04-01T19:47:30.863103+0000","last_change":"2024-04-01T19:46:09.387122+0000","last_active":"2024-04-01T19:47:30.863103+0000","last_peered":"2024-04-01T19:47:30.863103+0000","last_clean":"2024-04-01T19:47:30.863103+0000","last_became_active":"2024-04-01T19:44:39.207250+0000","last_became_peered":"2024-04-01T19:44:39.207250+0000","last_unstale":"2024-04-01T19:47:30.863103+0000","last_undegraded":"2024-04-01T19:47:30.863103+0000","last_fullsized":"2024-04-01T19:47:30.863103+0000","mapping_epoch":469,"log_start":"483'4400","ondisk_log_start":"483'4400","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"500'9238","last_scrub_stamp":"2024-04-01T19:46:09.386939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:46:09.386939+0000","objects_scrubbed":9211,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:47:35.538190+0000","scrub_duration":1376,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":346685440,"num_objects":5290,"num_object_clones":0,"num_object_copies":10580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5290,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14464,"num_write_kb":632128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"523'14188","reported_seq":14468,"reported_epoch":523,"state":"active+clean","last_fresh":"2024-04-01T19:47:28.646262+0000","last_change":"2024-04-01T19:47:25.439900+0000","last_active":"2024-04-01T19:47:28.646262+0000","last_peered":"2024-04-01T19:47:28.646262+0000","last_clean":"2024-04-01T19:47:28.646262+0000","last_became_active":"2024-04-01T19:44:39.957810+0000","last_became_peered":"2024-04-01T19:44:39.957810+0000","last_unstale":"2024-04-01T19:47:28.646262+0000","last_undegraded":"2024-04-01T19:47:28.646262+0000","last_fullsized":"2024-04-01T19:47:28.646262+0000","mapping_epoch":469,"log_start":"482'4100","ondisk_log_start":"482'4100","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"522'13990","last_scrub_stamp":"2024-04-01T19:47:25.439703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:47:25.439703+0000","objects_scrubbed":5656,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:48:30.833065+0000","scrub_duration":1178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":355467264,"num_objects":5424,"num_object_clones":0,"num_object_copies":10848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5424,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14188,"num_write_kb":627584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"525'14619","reported_seq":14900,"reported_epoch":525,"state":"active+clean","last_fresh":"2024-04-01T19:47:33.123305+0000","last_change":"2024-04-01T19:46:47.203626+0000","last_active":"2024-04-01T19:47:33.123305+0000","last_peered":"2024-04-01T19:47:33.123305+0000","last_clean":"2024-04-01T19:47:33.123305+0000","last_became_active":"2024-04-01T19:44:39.209430+0000","last_became_peered":"2024-04-01T19:44:39.209430+0000","last_unstale":"2024-04-01T19:47:33.123305+0000","last_undegraded":"2024-04-01T19:47:33.123305+0000","last_fullsized":"2024-04-01T19:47:33.123305+0000","mapping_epoch":469,"log_start":"483'4600","ondisk_log_start":"483'4600","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"513'11397","last_scrub_stamp":"2024-04-01T19:46:47.203472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:46:47.203472+0000","objects_scrubbed":8404,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:47:51.824010+0000","scrub_duration":2374,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335085568,"num_objects":5113,"num_object_clones":0,"num_object_copies":10226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14619,"num_write_kb":631424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"523'14249","reported_seq":14534,"reported_epoch":523,"state":"active+clean","last_fresh":"2024-04-01T19:47:28.623457+0000","last_change":"2024-04-01T19:47:18.748627+0000","last_active":"2024-04-01T19:47:28.623457+0000","last_peered":"2024-04-01T19:47:28.623457+0000","last_clean":"2024-04-01T19:47:28.623457+0000","last_became_active":"2024-04-01T19:44:39.537793+0000","last_became_peered":"2024-04-01T19:44:39.537793+0000","last_unstale":"2024-04-01T19:47:28.623457+0000","last_undegraded":"2024-04-01T19:47:28.623457+0000","last_fullsized":"2024-04-01T19:47:28.623457+0000","mapping_epoch":469,"log_start":"482'4200","ondisk_log_start":"482'4200","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"522'13606","last_scrub_stamp":"2024-04-01T19:47:18.748507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:47:18.748507+0000","objects_scrubbed":6025,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:48:36.151586+0000","scrub_duration":1605,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":349110272,"num_objects":5327,"num_object_clones":0,"num_object_copies":10654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5327,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14249,"num_write_kb":626432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"523'14460","reported_seq":14732,"reported_epoch":523,"state":"active+clean","last_fresh":"2024-04-01T19:47:30.120331+0000","last_change":"2024-04-01T19:47:20.755355+0000","last_active":"2024-04-01T19:47:30.120331+0000","last_peered":"2024-04-01T19:47:30.120331+0000","last_clean":"2024-04-01T19:47:30.120331+0000","last_became_active":"2024-04-01T19:44:39.212169+0000","last_became_peered":"2024-04-01T19:44:39.212169+0000","last_unstale":"2024-04-01T19:47:30.120331+0000","last_undegraded":"2024-04-01T19:47:30.120331+0000","last_fullsized":"2024-04-01T19:47:30.120331+0000","mapping_epoch":469,"log_start":"483'4400","ondisk_log_start":"483'4400","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"522'13810","last_scrub_stamp":"2024-04-01T19:47:20.755075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:47:20.755075+0000","objects_scrubbed":5900,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:48:31.250450+0000","scrub_duration":1335,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":341442560,"num_objects":5210,"num_object_clones":0,"num_object_copies":10420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5210,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14460,"num_write_kb":629440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"523'14566","reported_seq":14851,"reported_epoch":523,"state":"active+clean","last_fresh":"2024-04-01T19:47:28.629597+0000","last_change":"2024-04-01T19:47:25.220810+0000","last_active":"2024-04-01T19:47:28.629597+0000","last_peered":"2024-04-01T19:47:28.629597+0000","last_clean":"2024-04-01T19:47:28.629597+0000","last_became_active":"2024-04-01T19:44:39.537390+0000","last_became_peered":"2024-04-01T19:44:39.537390+0000","last_unstale":"2024-04-01T19:47:28.629597+0000","last_undegraded":"2024-04-01T19:47:28.629597+0000","last_fullsized":"2024-04-01T19:47:28.629597+0000","mapping_epoch":469,"log_start":"483'4500","ondisk_log_start":"483'4500","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"522'14359","last_scrub_stamp":"2024-04-01T19:47:25.220566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:47:25.220566+0000","objects_scrubbed":5724,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:48:50.186414+0000","scrub_duration":1992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356384768,"num_objects":5438,"num_object_clones":0,"num_object_copies":10876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5438,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14566,"num_write_kb":640128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"524'14453","reported_seq":14731,"reported_epoch":524,"state":"active+clean","last_fresh":"2024-04-01T19:47:31.867053+0000","last_change":"2024-04-01T19:47:18.977595+0000","last_active":"2024-04-01T19:47:31.867053+0000","last_peered":"2024-04-01T19:47:31.867053+0000","last_clean":"2024-04-01T19:47:31.867053+0000","last_became_active":"2024-04-01T19:44:39.208942+0000","last_became_peered":"2024-04-01T19:44:39.208942+0000","last_unstale":"2024-04-01T19:47:31.867053+0000","last_undegraded":"2024-04-01T19:47:31.867053+0000","last_fullsized":"2024-04-01T19:47:31.867053+0000","mapping_epoch":469,"log_start":"483'4400","ondisk_log_start":"483'4400","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"522'13610","last_scrub_stamp":"2024-04-01T19:47:18.977413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:47:18.977413+0000","objects_scrubbed":5938,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:48:35.326640+0000","scrub_duration":1372,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331546624,"num_objects":5059,"num_object_clones":0,"num_object_copies":10118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5059,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14453,"num_write_kb":624384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"523'14370","reported_seq":14584,"reported_epoch":523,"state":"active+clean","last_fresh":"2024-04-01T19:47:29.252502+0000","last_change":"2024-04-01T19:46:04.218201+0000","last_active":"2024-04-01T19:47:29.252502+0000","last_peered":"2024-04-01T19:47:29.252502+0000","last_clean":"2024-04-01T19:47:29.252502+0000","last_became_active":"2024-04-01T19:44:39.206178+0000","last_became_peered":"2024-04-01T19:44:39.206178+0000","last_unstale":"2024-04-01T19:47:29.252502+0000","last_undegraded":"2024-04-01T19:47:29.252502+0000","last_fullsized":"2024-04-01T19:47:29.252502+0000","mapping_epoch":469,"log_start":"483'4300","ondisk_log_start":"483'4300","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"499'8983","last_scrub_stamp":"2024-04-01T19:46:04.218081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:46:04.218081+0000","objects_scrubbed":8934,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:47:32.518912+0000","scrub_duration":1109,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353763328,"num_objects":5398,"num_object_clones":0,"num_object_copies":10796,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5398,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14370,"num_write_kb":632576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"6.0","version":"523'14343","reported_seq":14615,"reported_epoch":523,"state":"active+clean","last_fresh":"2024-04-01T19:47:30.863024+0000","last_change":"2024-04-01T19:47:21.171191+0000","last_active":"2024-04-01T19:47:30.863024+0000","last_peered":"2024-04-01T19:47:30.863024+0000","last_clean":"2024-04-01T19:47:30.863024+0000","last_became_active":"2024-04-01T19:44:39.208719+0000","last_became_peered":"2024-04-01T19:44:39.208719+0000","last_unstale":"2024-04-01T19:47:30.863024+0000","last_undegraded":"2024-04-01T19:47:30.863024+0000","last_fullsized":"2024-04-01T19:47:30.863024+0000","mapping_epoch":469,"log_start":"483'4300","ondisk_log_start":"483'4300","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"522'13683","last_scrub_stamp":"2024-04-01T19:47:21.170887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:47:21.170887+0000","objects_scrubbed":5898,"log_size":10043,"log_dups_size":0,"ondisk_log_size":10043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:48:23.277755+0000","scrub_duration":1350,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340721664,"num_objects":5199,"num_object_clones":0,"num_object_copies":10398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14343,"num_write_kb":625344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"523'14262","reported_seq":14532,"reported_epoch":523,"state":"active+clean","last_fresh":"2024-04-01T19:47:30.853930+0000","last_change":"2024-04-01T19:47:22.515130+0000","last_active":"2024-04-01T19:47:30.853930+0000","last_peered":"2024-04-01T19:47:30.853930+0000","last_clean":"2024-04-01T19:47:30.853930+0000","last_became_active":"2024-04-01T19:44:39.211865+0000","last_became_peered":"2024-04-01T19:44:39.211865+0000","last_unstale":"2024-04-01T19:47:30.853930+0000","last_undegraded":"2024-04-01T19:47:30.853930+0000","last_fullsized":"2024-04-01T19:47:30.853930+0000","mapping_epoch":469,"log_start":"482'4200","ondisk_log_start":"482'4200","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"522'13672","last_scrub_stamp":"2024-04-01T19:47:22.515018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:47:22.515018+0000","objects_scrubbed":5775,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:48:26.697712+0000","scrub_duration":1547,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335806464,"num_objects":5124,"num_object_clones":0,"num_object_copies":10248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14262,"num_write_kb":620352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":1320,"reported_epoch":523,"state":"active+clean","last_fresh":"2024-04-01T19:47:26.395557+0000","last_change":"2024-04-01T19:46:47.289120+0000","last_active":"2024-04-01T19:47:26.395557+0000","last_peered":"2024-04-01T19:47:26.395557+0000","last_clean":"2024-04-01T19:47:26.395557+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:47:26.395557+0000","last_undegraded":"2024-04-01T19:47:26.395557+0000","last_fullsized":"2024-04-01T19:47:26.395557+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:46:47.288986+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:46:47.288986+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:48:10.011300+0000","scrub_duration":128,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":5437325336,"num_objects":82968,"num_object_clones":0,"num_object_copies":165936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82968,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":230510,"num_write_kb":10031233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10866794496,"data_stored":10866786352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160844,"ondisk_log_size":160844,"up":32,"acting":32,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220459,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":970632,"kb_used_data":339712,"kb_used_omap":1,"kb_used_meta":630910,"kb_avail":92774520,"statfs":{"total":95995035648,"available":95001108480,"internally_reserved":0,"allocated":347865088,"data_stored":347502173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":646052292},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":77,"seq":330712482095,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":745168,"kb_used_data":316932,"kb_used_omap":1,"kb_used_meta":428222,"kb_avail":92999984,"statfs":{"total":95995035648,"available":95231983616,"internally_reserved":0,"allocated":324538368,"data_stored":324173001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":438499776},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678326,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1087040,"kb_used_data":686584,"kb_used_omap":1,"kb_used_meta":400446,"kb_avail":92658112,"statfs":{"total":95995035648,"available":94881906688,"internally_reserved":0,"allocated":703062016,"data_stored":702702673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":410057152},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557523,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":472516,"kb_used_data":350200,"kb_used_omap":132,"kb_used_meta":122171,"kb_avail":93272636,"statfs":{"total":95995035648,"available":95511179264,"internally_reserved":0,"allocated":358604800,"data_stored":358245457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":125103847},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234304,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1810828,"kb_used_data":1382592,"kb_used_omap":1,"kb_used_meta":428222,"kb_avail":91934324,"statfs":{"total":95995035648,"available":94140747776,"internally_reserved":0,"allocated":1415774208,"data_stored":1415411313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":438499786},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,2,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":457,"seq":1962800054315,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1459904,"kb_used_data":1341688,"kb_used_omap":744,"kb_used_meta":117463,"kb_avail":92285248,"statfs":{"total":95995035648,"available":94500093952,"internally_reserved":0,"allocated":1373888512,"data_stored":1373529169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":762131,"internal_metadata":120282861},"hb_peers":[0,1,2,3,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575197,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1580612,"kb_used_data":1011964,"kb_used_omap":1,"kb_used_meta":568446,"kb_avail":92164540,"statfs":{"total":95995035648,"available":94376488960,"internally_reserved":0,"allocated":1036251136,"data_stored":1035887721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":582089157},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738725,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1150720,"kb_used_data":672504,"kb_used_omap":1,"kb_used_meta":478206,"kb_avail":92594432,"statfs":{"total":95995035648,"available":94816698368,"internally_reserved":0,"allocated":688644096,"data_stored":688284753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":489683397},"hb_peers":[1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346266,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":615232,"kb_used_data":323000,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":93129920,"statfs":{"total":95995035648,"available":95365038080,"internally_reserved":0,"allocated":330752000,"data_stored":330392657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":299170245},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669150036,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2508368,"kb_used_data":1949636,"kb_used_omap":1,"kb_used_meta":558718,"kb_avail":91236784,"statfs":{"total":95995035648,"available":93426466816,"internally_reserved":0,"allocated":1996427264,"data_stored":1996061917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":572127687},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,2,4],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953806,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1498512,"kb_used_data":993860,"kb_used_omap":1,"kb_used_meta":504574,"kb_avail":92246640,"statfs":{"total":95995035648,"available":94460559360,"internally_reserved":0,"allocated":1017712640,"data_stored":1017347293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":516684229},"hb_peers":[0,1,2,3,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790282,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1794564,"kb_used_data":1330236,"kb_used_omap":1,"kb_used_meta":464318,"kb_avail":91950588,"statfs":{"total":95995035648,"available":94157402112,"internally_reserved":0,"allocated":1362161664,"data_stored":1361798249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":475462085},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":687341568,"data_stored":687341568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1026035712,"data_stored":1026031640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":325255168,"data_stored":325255168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1974075392,"data_stored":1974075392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1012465664,"data_stored":1012465664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1342902272,"data_stored":1342898200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1369899008,"data_stored":1369899008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1409220608,"data_stored":1409220608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":353763328,"data_stored":353763328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":698875904,"data_stored":698875904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":323551232,"data_stored":323551232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":343408640,"data_stored":343408640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:47:34.372 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:47:34.402 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:47:34.430 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:34.450 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:47:34.452 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:34.453 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:47:34.528 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:47:34.554 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:47:34.582 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:34.593 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:34 smithi022 ceph-mon[39439]: 6.1 scrub starts 2024-04-01T19:47:34.593 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:34 smithi022 ceph-mon[39439]: from='client.26479 v1:172.21.15.22:0/2583522310' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:47:34.602 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:47:34.605 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:34.605 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:47:34.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:34 smithi188 ceph-mon[43939]: 6.1 scrub starts 2024-04-01T19:47:34.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:34 smithi188 ceph-mon[43939]: from='client.26479 v1:172.21.15.22:0/2583522310' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:47:34.635 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:34 smithi062 ceph-mon[44211]: 6.1 scrub starts 2024-04-01T19:47:34.636 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:34 smithi062 ceph-mon[44211]: from='client.26479 v1:172.21.15.22:0/2583522310' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:47:34.706 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:47:34.733 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:34.756 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:47:34.758 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:34.758 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:47:34.859 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:47:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:35.037 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:47:35.037 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:47:35.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:35 smithi062 ceph-mon[44211]: 6.1 scrub ok 2024-04-01T19:47:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:35 smithi062 ceph-mon[44211]: pgmap v1447: 17 pgs: 17 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T19:47:35.860 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:35 smithi022 ceph-mon[39439]: 6.1 scrub ok 2024-04-01T19:47:35.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:35 smithi022 ceph-mon[39439]: pgmap v1447: 17 pgs: 17 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T19:47:35.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:35 smithi188 ceph-mon[43939]: 6.1 scrub ok 2024-04-01T19:47:35.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:35 smithi188 ceph-mon[43939]: pgmap v1447: 17 pgs: 17 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T19:47:36.071 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:47:36.076 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:36.076 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:47:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:47:36.177 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:47:36.204 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:36.225 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:47:36.228 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:36.229 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:47:36.330 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:47:36.379 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:36.488 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:47:36.493 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:36.493 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:47:36.531 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_historic_ops 2024-04-01T19:47:36.594 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:47:36.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:36 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:47:36.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:36 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:47:36.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:36 smithi188 ceph-mon[43939]: osdmap e526: 12 total, 12 up, 12 in 2024-04-01T19:47:36.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:36 smithi188 ceph-mon[43939]: 6.9 scrub starts 2024-04-01T19:47:36.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:36 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:47:36.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:36 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:47:36.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:36 smithi022 ceph-mon[39439]: osdmap e526: 12 total, 12 up, 12 in 2024-04-01T19:47:36.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:36 smithi022 ceph-mon[39439]: 6.9 scrub starts 2024-04-01T19:47:36.670 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:36 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:47:36.671 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:36 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:47:36.671 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:36 smithi062 ceph-mon[44211]: osdmap e526: 12 total, 12 up, 12 in 2024-04-01T19:47:36.671 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:36 smithi062 ceph-mon[44211]: 6.9 scrub starts 2024-04-01T19:47:36.682 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:36.714 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:36.715 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:47:36.715 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:47:36.816 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:47:36.868 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:36.906 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:47:36.912 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:36.913 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:47:37.013 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:47:37.067 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:37.094 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:47:37.100 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:37.101 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:47:37.130 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:47:37.202 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:47:37.267 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:37.403 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:37 smithi062 ceph-mon[44211]: 6.9 scrub ok 2024-04-01T19:47:37.404 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:37 smithi062 ceph-mon[44211]: pgmap v1449: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:47:37.404 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:37 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:47:37.404 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:37 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:47:37.422 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:47:37.430 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:37.431 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:47:37.532 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:47:37.580 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:37.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:37 smithi022 ceph-mon[39439]: 6.9 scrub ok 2024-04-01T19:47:37.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:37 smithi022 ceph-mon[39439]: pgmap v1449: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:47:37.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:37 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:47:37.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:37 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:47:37.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:37 smithi188 ceph-mon[43939]: 6.9 scrub ok 2024-04-01T19:47:37.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:37 smithi188 ceph-mon[43939]: pgmap v1449: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:47:37.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:37 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:47:37.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:37 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:47:38.615 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:47:38.756 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:38 smithi062 ceph-mon[44211]: osdmap e527: 12 total, 12 up, 12 in 2024-04-01T19:47:38.756 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:38 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/265759286' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:47:38.757 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:38 smithi062 ceph-mon[44211]: from='client.26485 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:47:38.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:38 smithi022 ceph-mon[39439]: osdmap e527: 12 total, 12 up, 12 in 2024-04-01T19:47:38.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:38 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/265759286' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:47:38.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:38 smithi022 ceph-mon[39439]: from='client.26485 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:47:38.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:38 smithi188 ceph-mon[43939]: osdmap e527: 12 total, 12 up, 12 in 2024-04-01T19:47:38.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:38 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/265759286' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:47:38.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:38 smithi188 ceph-mon[43939]: from='client.26485 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:47:38.941 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:47:38.942 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:47:38.955 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:38.955 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:47:39.056 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:47:39.113 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:39.218 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:47:39.225 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:39.226 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:47:39.327 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:47:39.388 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:39.488 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:47:39.490 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:39.491 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:47:39.491 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:39 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:47:39.491 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:39 smithi022 ceph-mon[39439]: from='client.26485 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:47:39.491 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:39 smithi022 ceph-mon[39439]: osdmap e528: 12 total, 12 up, 12 in 2024-04-01T19:47:39.492 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:39 smithi022 ceph-mon[39439]: pgmap v1452: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:47:39.591 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:47:39.630 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:39.650 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:39 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:47:39.650 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:39 smithi062 ceph-mon[44211]: from='client.26485 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:47:39.650 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:39 smithi062 ceph-mon[44211]: osdmap e528: 12 total, 12 up, 12 in 2024-04-01T19:47:39.651 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:39 smithi062 ceph-mon[44211]: pgmap v1452: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:47:39.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:39 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:47:39.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:39 smithi188 ceph-mon[43939]: from='client.26485 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:47:39.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:39 smithi188 ceph-mon[43939]: osdmap e528: 12 total, 12 up, 12 in 2024-04-01T19:47:39.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:39 smithi188 ceph-mon[43939]: pgmap v1452: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:47:39.991 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:47:39.996 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:39.997 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:47:40.043 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:47:40.043 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:47:40.097 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:47:40.177 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:41.059 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:47:41.067 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:41.068 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:47:41.139 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:47:41.148 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:47:41.168 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:47:41.236 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:41.291 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:47:41.312 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:41.312 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:47:41.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:41 smithi022 ceph-mon[39439]: from='client.16506 v1:172.21.15.22:0/1291370194' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:47:41.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:41 smithi022 ceph-mon[39439]: pgmap v1453: 17 pgs: 17 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:47:41.413 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:47:41.479 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:41.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:41 smithi062 ceph-mon[44211]: from='client.16506 v1:172.21.15.22:0/1291370194' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:47:41.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:41 smithi062 ceph-mon[44211]: pgmap v1453: 17 pgs: 17 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:47:41.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:41 smithi188 ceph-mon[43939]: from='client.16506 v1:172.21.15.22:0/1291370194' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:47:41.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:41 smithi188 ceph-mon[43939]: pgmap v1453: 17 pgs: 17 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:47:41.783 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_ops_in_flight 2024-04-01T19:47:42.011 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:47:43.168 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:47:43.183 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:43.184 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:47:43.213 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":1452,"stamp":"2024-04-01T19:47:39.164490+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5009244728,"num_objects":76429,"num_object_clones":0,"num_object_copies":152858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76429,"num_whiteouts":0,"num_read":127,"num_read_kb":110,"num_write":237232,"num_write_kb":10034171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160924,"ondisk_log_size":160924,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":14928236,"kb_used_data":9899960,"kb_used_omap":892,"kb_used_meta":5027139,"kb_avail":1110013588,"statfs":{"total":1151940427776,"available":1136653914112,"internally_reserved":0,"allocated":10137559040,"data_stored":10133039508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":913534,"internal_metadata":5147791234},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-428670976,"num_objects":-6541,"num_object_clones":0,"num_object_copies":-13082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-6541,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6541,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001200"},"pg_stats":[{"pgid":"6.f","version":"526'14782","reported_seq":15068,"reported_epoch":526,"state":"active+clean","last_fresh":"2024-04-01T19:47:36.881930+0000","last_change":"2024-04-01T19:47:18.849561+0000","last_active":"2024-04-01T19:47:36.881930+0000","last_peered":"2024-04-01T19:47:36.881930+0000","last_clean":"2024-04-01T19:47:36.881930+0000","last_became_active":"2024-04-01T19:44:40.026862+0000","last_became_peered":"2024-04-01T19:44:40.026862+0000","last_unstale":"2024-04-01T19:47:36.881930+0000","last_undegraded":"2024-04-01T19:47:36.881930+0000","last_fullsized":"2024-04-01T19:47:36.881930+0000","mapping_epoch":469,"log_start":"483'4700","ondisk_log_start":"483'4700","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"522'13591","last_scrub_stamp":"2024-04-01T19:47:18.849364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:47:18.849364+0000","objects_scrubbed":5848,"log_size":10082,"log_dups_size":0,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:48:40.533498+0000","scrub_duration":864,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":303955968,"num_objects":4638,"num_object_clones":0,"num_object_copies":9276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4638,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14782,"num_write_kb":621440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"526'17468","reported_seq":17823,"reported_epoch":526,"state":"active+clean","last_fresh":"2024-04-01T19:47:36.866355+0000","last_change":"2024-04-01T19:46:41.015313+0000","last_active":"2024-04-01T19:47:36.866355+0000","last_peered":"2024-04-01T19:47:36.866355+0000","last_clean":"2024-04-01T19:47:36.866355+0000","last_became_active":"2024-04-01T19:44:39.212105+0000","last_became_peered":"2024-04-01T19:44:39.212105+0000","last_unstale":"2024-04-01T19:47:36.866355+0000","last_undegraded":"2024-04-01T19:47:36.866355+0000","last_fullsized":"2024-04-01T19:47:36.866355+0000","mapping_epoch":469,"log_start":"491'7401","ondisk_log_start":"491'7401","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"511'13542","last_scrub_stamp":"2024-04-01T19:46:41.015113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:46:41.015113+0000","objects_scrubbed":8842,"log_size":10067,"log_dups_size":0,"ondisk_log_size":10067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:47:46.847564+0000","scrub_duration":2355,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":316932096,"num_objects":4836,"num_object_clones":0,"num_object_copies":9672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4836,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14922,"num_write_kb":632256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"526'14425","reported_seq":14699,"reported_epoch":526,"state":"active+clean","last_fresh":"2024-04-01T19:47:35.902956+0000","last_change":"2024-04-01T19:47:20.231254+0000","last_active":"2024-04-01T19:47:35.902956+0000","last_peered":"2024-04-01T19:47:35.902956+0000","last_clean":"2024-04-01T19:47:35.902956+0000","last_became_active":"2024-04-01T19:44:39.211055+0000","last_became_peered":"2024-04-01T19:44:39.211055+0000","last_unstale":"2024-04-01T19:47:35.902956+0000","last_undegraded":"2024-04-01T19:47:35.902956+0000","last_fullsized":"2024-04-01T19:47:35.902956+0000","mapping_epoch":469,"log_start":"483'4400","ondisk_log_start":"483'4400","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"522'13389","last_scrub_stamp":"2024-04-01T19:47:20.231145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:47:20.231145+0000","objects_scrubbed":5794,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:48:26.414428+0000","scrub_duration":1267,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":309461016,"num_objects":4723,"num_object_clones":0,"num_object_copies":9446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4723,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14425,"num_write_kb":612673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"527'17812","reported_seq":18182,"reported_epoch":527,"state":"active+clean","last_fresh":"2024-04-01T19:47:38.091295+0000","last_change":"2024-04-01T19:46:45.906978+0000","last_active":"2024-04-01T19:47:38.091295+0000","last_peered":"2024-04-01T19:47:38.091295+0000","last_clean":"2024-04-01T19:47:38.091295+0000","last_became_active":"2024-04-01T19:44:39.537984+0000","last_became_peered":"2024-04-01T19:44:39.537984+0000","last_unstale":"2024-04-01T19:47:38.091295+0000","last_undegraded":"2024-04-01T19:47:38.091295+0000","last_fullsized":"2024-04-01T19:47:38.091295+0000","mapping_epoch":469,"log_start":"495'7800","ondisk_log_start":"495'7800","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"513'14175","last_scrub_stamp":"2024-04-01T19:46:45.906760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:46:45.906760+0000","objects_scrubbed":8390,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:47:47.442256+0000","scrub_duration":2103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306380800,"num_objects":4675,"num_object_clones":0,"num_object_copies":9350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4675,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14923,"num_write_kb":627136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"527'14772","reported_seq":15065,"reported_epoch":527,"state":"active+clean","last_fresh":"2024-04-01T19:47:38.109285+0000","last_change":"2024-04-01T19:47:19.551131+0000","last_active":"2024-04-01T19:47:38.109285+0000","last_peered":"2024-04-01T19:47:38.109285+0000","last_clean":"2024-04-01T19:47:38.109285+0000","last_became_active":"2024-04-01T19:44:39.211801+0000","last_became_peered":"2024-04-01T19:44:39.211801+0000","last_unstale":"2024-04-01T19:47:38.109285+0000","last_undegraded":"2024-04-01T19:47:38.109285+0000","last_fullsized":"2024-04-01T19:47:38.109285+0000","mapping_epoch":469,"log_start":"484'4700","ondisk_log_start":"484'4700","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"522'13531","last_scrub_stamp":"2024-04-01T19:47:19.551007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:47:19.551007+0000","objects_scrubbed":5936,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:48:26.914116+0000","scrub_duration":1356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":305135616,"num_objects":4656,"num_object_clones":0,"num_object_copies":9312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4656,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14772,"num_write_kb":621696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"526'14719","reported_seq":15064,"reported_epoch":526,"state":"active+clean","last_fresh":"2024-04-01T19:47:35.902961+0000","last_change":"2024-04-01T19:47:19.437874+0000","last_active":"2024-04-01T19:47:35.902961+0000","last_peered":"2024-04-01T19:47:35.902961+0000","last_clean":"2024-04-01T19:47:35.902961+0000","last_became_active":"2024-04-01T19:44:39.537660+0000","last_became_peered":"2024-04-01T19:44:39.537660+0000","last_unstale":"2024-04-01T19:47:35.902961+0000","last_undegraded":"2024-04-01T19:47:35.902961+0000","last_fullsized":"2024-04-01T19:47:35.902961+0000","mapping_epoch":469,"log_start":"484'4700","ondisk_log_start":"484'4700","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"522'13607","last_scrub_stamp":"2024-04-01T19:47:19.437737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:47:19.437737+0000","objects_scrubbed":6001,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:48:23.616160+0000","scrub_duration":1481,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":317915136,"num_objects":4851,"num_object_clones":0,"num_object_copies":9702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4851,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14719,"num_write_kb":626240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"526'14840","reported_seq":15072,"reported_epoch":526,"state":"active+clean+scrubbing","last_fresh":"2024-04-01T19:47:35.872452+0000","last_change":"2024-04-01T19:47:35.775705+0000","last_active":"2024-04-01T19:47:35.872452+0000","last_peered":"2024-04-01T19:47:35.872452+0000","last_clean":"2024-04-01T19:47:35.872452+0000","last_became_active":"2024-04-01T19:44:39.207250+0000","last_became_peered":"2024-04-01T19:44:39.207250+0000","last_unstale":"2024-04-01T19:47:35.872452+0000","last_undegraded":"2024-04-01T19:47:35.872452+0000","last_fullsized":"2024-04-01T19:47:35.872452+0000","mapping_epoch":469,"log_start":"484'4800","ondisk_log_start":"484'4800","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"500'9238","last_scrub_stamp":"2024-04-01T19:46:09.386939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:46:09.386939+0000","objects_scrubbed":399,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"scrubbing for 0s","scrub_duration":1376,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322043904,"num_objects":4914,"num_object_clones":0,"num_object_copies":9828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4914,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14840,"num_write_kb":632128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"528'14875","reported_seq":15165,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-04-01T19:47:38.649534+0000","last_change":"2024-04-01T19:47:25.439900+0000","last_active":"2024-04-01T19:47:38.649534+0000","last_peered":"2024-04-01T19:47:38.649534+0000","last_clean":"2024-04-01T19:47:38.649534+0000","last_became_active":"2024-04-01T19:44:39.957810+0000","last_became_peered":"2024-04-01T19:44:39.957810+0000","last_unstale":"2024-04-01T19:47:38.649534+0000","last_undegraded":"2024-04-01T19:47:38.649534+0000","last_fullsized":"2024-04-01T19:47:38.649534+0000","mapping_epoch":469,"log_start":"484'4800","ondisk_log_start":"484'4800","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"522'13990","last_scrub_stamp":"2024-04-01T19:47:25.439703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:47:25.439703+0000","objects_scrubbed":5656,"log_size":10075,"log_dups_size":0,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:48:30.833065+0000","scrub_duration":1178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310444032,"num_objects":4737,"num_object_clones":0,"num_object_copies":9474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4737,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14875,"num_write_kb":627584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"527'14959","reported_seq":15243,"reported_epoch":527,"state":"active+clean","last_fresh":"2024-04-01T19:47:38.100575+0000","last_change":"2024-04-01T19:46:47.203626+0000","last_active":"2024-04-01T19:47:38.100575+0000","last_peered":"2024-04-01T19:47:38.100575+0000","last_clean":"2024-04-01T19:47:38.100575+0000","last_became_active":"2024-04-01T19:44:39.209430+0000","last_became_peered":"2024-04-01T19:44:39.209430+0000","last_unstale":"2024-04-01T19:47:38.100575+0000","last_undegraded":"2024-04-01T19:47:38.100575+0000","last_fullsized":"2024-04-01T19:47:38.100575+0000","mapping_epoch":469,"log_start":"484'4900","ondisk_log_start":"484'4900","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"513'11397","last_scrub_stamp":"2024-04-01T19:46:47.203472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:46:47.203472+0000","objects_scrubbed":8404,"log_size":10059,"log_dups_size":0,"ondisk_log_size":10059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:47:51.824010+0000","scrub_duration":2374,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":312803328,"num_objects":4773,"num_object_clones":0,"num_object_copies":9546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4773,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14959,"num_write_kb":631424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"528'14966","reported_seq":15261,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-04-01T19:47:38.646010+0000","last_change":"2024-04-01T19:47:18.748627+0000","last_active":"2024-04-01T19:47:38.646010+0000","last_peered":"2024-04-01T19:47:38.646010+0000","last_clean":"2024-04-01T19:47:38.646010+0000","last_became_active":"2024-04-01T19:44:39.537793+0000","last_became_peered":"2024-04-01T19:44:39.537793+0000","last_unstale":"2024-04-01T19:47:38.646010+0000","last_undegraded":"2024-04-01T19:47:38.646010+0000","last_fullsized":"2024-04-01T19:47:38.646010+0000","mapping_epoch":469,"log_start":"484'4900","ondisk_log_start":"484'4900","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"522'13606","last_scrub_stamp":"2024-04-01T19:47:18.748507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:47:18.748507+0000","objects_scrubbed":6025,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:48:36.151586+0000","scrub_duration":1605,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302120960,"num_objects":4610,"num_object_clones":0,"num_object_copies":9220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4610,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14966,"num_write_kb":626432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"525'14837","reported_seq":15113,"reported_epoch":525,"state":"active+clean","last_fresh":"2024-04-01T19:47:35.069852+0000","last_change":"2024-04-01T19:47:20.755355+0000","last_active":"2024-04-01T19:47:35.069852+0000","last_peered":"2024-04-01T19:47:35.069852+0000","last_clean":"2024-04-01T19:47:35.069852+0000","last_became_active":"2024-04-01T19:44:39.212169+0000","last_became_peered":"2024-04-01T19:44:39.212169+0000","last_unstale":"2024-04-01T19:47:35.069852+0000","last_undegraded":"2024-04-01T19:47:35.069852+0000","last_fullsized":"2024-04-01T19:47:35.069852+0000","mapping_epoch":469,"log_start":"484'4800","ondisk_log_start":"484'4800","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"522'13810","last_scrub_stamp":"2024-04-01T19:47:20.755075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:47:20.755075+0000","objects_scrubbed":5900,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:48:31.250450+0000","scrub_duration":1335,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":316735488,"num_objects":4833,"num_object_clones":0,"num_object_copies":9666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4833,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14837,"num_write_kb":629440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"528'15258","reported_seq":15553,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-04-01T19:47:38.636344+0000","last_change":"2024-04-01T19:47:25.220810+0000","last_active":"2024-04-01T19:47:38.636344+0000","last_peered":"2024-04-01T19:47:38.636344+0000","last_clean":"2024-04-01T19:47:38.636344+0000","last_became_active":"2024-04-01T19:44:39.537390+0000","last_became_peered":"2024-04-01T19:44:39.537390+0000","last_unstale":"2024-04-01T19:47:38.636344+0000","last_undegraded":"2024-04-01T19:47:38.636344+0000","last_fullsized":"2024-04-01T19:47:38.636344+0000","mapping_epoch":469,"log_start":"484'5200","ondisk_log_start":"484'5200","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"522'14359","last_scrub_stamp":"2024-04-01T19:47:25.220566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:47:25.220566+0000","objects_scrubbed":5724,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:48:50.186414+0000","scrub_duration":1992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311033856,"num_objects":4746,"num_object_clones":0,"num_object_copies":9492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4746,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15258,"num_write_kb":640128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"526'14794","reported_seq":15075,"reported_epoch":526,"state":"active+clean","last_fresh":"2024-04-01T19:47:36.873386+0000","last_change":"2024-04-01T19:47:18.977595+0000","last_active":"2024-04-01T19:47:36.873386+0000","last_peered":"2024-04-01T19:47:36.873386+0000","last_clean":"2024-04-01T19:47:36.873386+0000","last_became_active":"2024-04-01T19:44:39.208942+0000","last_became_peered":"2024-04-01T19:44:39.208942+0000","last_unstale":"2024-04-01T19:47:36.873386+0000","last_undegraded":"2024-04-01T19:47:36.873386+0000","last_fullsized":"2024-04-01T19:47:36.873386+0000","mapping_epoch":469,"log_start":"484'4700","ondisk_log_start":"484'4700","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"522'13610","last_scrub_stamp":"2024-04-01T19:47:18.977413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:47:18.977413+0000","objects_scrubbed":5938,"log_size":10094,"log_dups_size":0,"ondisk_log_size":10094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:48:35.326640+0000","scrub_duration":1372,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":309198848,"num_objects":4718,"num_object_clones":0,"num_object_copies":9436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14794,"num_write_kb":624384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"525'14716","reported_seq":14993,"reported_epoch":525,"state":"active+clean","last_fresh":"2024-04-01T19:47:34.215754+0000","last_change":"2024-04-01T19:47:34.016175+0000","last_active":"2024-04-01T19:47:34.215754+0000","last_peered":"2024-04-01T19:47:34.215754+0000","last_clean":"2024-04-01T19:47:34.215754+0000","last_became_active":"2024-04-01T19:44:39.206178+0000","last_became_peered":"2024-04-01T19:44:39.206178+0000","last_unstale":"2024-04-01T19:47:34.215754+0000","last_undegraded":"2024-04-01T19:47:34.215754+0000","last_fullsized":"2024-04-01T19:47:34.215754+0000","mapping_epoch":469,"log_start":"484'4700","ondisk_log_start":"484'4700","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"525'14696","last_scrub_stamp":"2024-04-01T19:47:34.016096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:47:34.016096+0000","objects_scrubbed":5101,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:49:01.941765+0000","scrub_duration":690,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331087872,"num_objects":5052,"num_object_clones":0,"num_object_copies":10104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5052,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14716,"num_write_kb":632576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"6.0","version":"526'14660","reported_seq":14938,"reported_epoch":526,"state":"active+clean","last_fresh":"2024-04-01T19:47:35.853895+0000","last_change":"2024-04-01T19:47:21.171191+0000","last_active":"2024-04-01T19:47:35.853895+0000","last_peered":"2024-04-01T19:47:35.853895+0000","last_clean":"2024-04-01T19:47:35.853895+0000","last_became_active":"2024-04-01T19:44:39.208719+0000","last_became_peered":"2024-04-01T19:44:39.208719+0000","last_unstale":"2024-04-01T19:47:35.853895+0000","last_undegraded":"2024-04-01T19:47:35.853895+0000","last_fullsized":"2024-04-01T19:47:35.853895+0000","mapping_epoch":469,"log_start":"483'4600","ondisk_log_start":"483'4600","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"522'13683","last_scrub_stamp":"2024-04-01T19:47:21.170887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:47:21.170887+0000","objects_scrubbed":5898,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:48:23.277755+0000","scrub_duration":1350,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":319946752,"num_objects":4882,"num_object_clones":0,"num_object_copies":9764,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4882,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14660,"num_write_kb":625344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"526'14603","reported_seq":14879,"reported_epoch":526,"state":"active+clean","last_fresh":"2024-04-01T19:47:35.853024+0000","last_change":"2024-04-01T19:47:22.515130+0000","last_active":"2024-04-01T19:47:35.853024+0000","last_peered":"2024-04-01T19:47:35.853024+0000","last_clean":"2024-04-01T19:47:35.853024+0000","last_became_active":"2024-04-01T19:44:39.211865+0000","last_became_peered":"2024-04-01T19:44:39.211865+0000","last_unstale":"2024-04-01T19:47:35.853024+0000","last_undegraded":"2024-04-01T19:47:35.853024+0000","last_fullsized":"2024-04-01T19:47:35.853024+0000","mapping_epoch":469,"log_start":"483'4600","ondisk_log_start":"483'4600","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"522'13672","last_scrub_stamp":"2024-04-01T19:47:22.515018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:47:22.515018+0000","objects_scrubbed":5775,"log_size":10003,"log_dups_size":0,"ondisk_log_size":10003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:48:26.697712+0000","scrub_duration":1547,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313458688,"num_objects":4783,"num_object_clones":0,"num_object_copies":9566,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4783,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14603,"num_write_kb":620352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":1330,"reported_epoch":528,"state":"active+clean","last_fresh":"2024-04-01T19:47:38.423614+0000","last_change":"2024-04-01T19:46:47.289120+0000","last_active":"2024-04-01T19:47:38.423614+0000","last_peered":"2024-04-01T19:47:38.423614+0000","last_clean":"2024-04-01T19:47:38.423614+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:47:38.423614+0000","last_undegraded":"2024-04-01T19:47:38.423614+0000","last_fullsized":"2024-04-01T19:47:38.423614+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:46:47.288986+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:46:47.288986+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:48:10.011300+0000","scrub_duration":128,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":5008654360,"num_objects":76427,"num_object_clones":0,"num_object_copies":152854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76427,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":237051,"num_write_kb":10031233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10051067904,"data_stored":10051059760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160785,"ondisk_log_size":160785,"up":32,"acting":32,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220460,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":948272,"kb_used_data":317348,"kb_used_omap":1,"kb_used_meta":630910,"kb_avail":92796880,"statfs":{"total":95995035648,"available":95024005120,"internally_reserved":0,"allocated":324964352,"data_stored":324583425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":646052292},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":77,"seq":330712482096,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":728036,"kb_used_data":295644,"kb_used_omap":1,"kb_used_meta":432382,"kb_avail":93017116,"statfs":{"total":95995035648,"available":95249526784,"internally_reserved":0,"allocated":302739456,"data_stored":302362081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":442759616},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678327,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1041560,"kb_used_data":636944,"kb_used_omap":1,"kb_used_meta":404606,"kb_avail":92703592,"statfs":{"total":95995035648,"available":94928478208,"internally_reserved":0,"allocated":652230656,"data_stored":651859305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":414316992},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557524,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":451036,"kb_used_data":328720,"kb_used_omap":132,"kb_used_meta":122171,"kb_avail":93294116,"statfs":{"total":95995035648,"available":95533174784,"internally_reserved":0,"allocated":336609280,"data_stored":336237929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":125103847},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234306,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1640636,"kb_used_data":1204016,"kb_used_omap":1,"kb_used_meta":436542,"kb_avail":92104516,"statfs":{"total":95995035648,"available":94315024384,"internally_reserved":0,"allocated":1232912384,"data_stored":1232525473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":447019466},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":457,"seq":1962800054316,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1374872,"kb_used_data":1252496,"kb_used_omap":744,"kb_used_meta":121623,"kb_avail":92370280,"statfs":{"total":95995035648,"available":94587166720,"internally_reserved":0,"allocated":1282555904,"data_stored":1282184553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":762131,"internal_metadata":124542701},"hb_peers":[0,1,2,3,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575198,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1516700,"kb_used_data":944084,"kb_used_omap":1,"kb_used_meta":572606,"kb_avail":92228452,"statfs":{"total":95995035648,"available":94441934848,"internally_reserved":0,"allocated":966742016,"data_stored":966366593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":586348997},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738726,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1111140,"kb_used_data":628764,"kb_used_omap":1,"kb_used_meta":482366,"kb_avail":92634012,"statfs":{"total":95995035648,"available":94857228288,"internally_reserved":0,"allocated":643854336,"data_stored":643476981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":493943237},"hb_peers":[1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346267,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":581352,"kb_used_data":301660,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":93163800,"statfs":{"total":95995035648,"available":95399731200,"internally_reserved":0,"allocated":308899840,"data_stored":308522485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669150037,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2386280,"kb_used_data":1823388,"kb_used_omap":1,"kb_used_meta":562878,"kb_avail":91358872,"statfs":{"total":95995035648,"available":93551484928,"internally_reserved":0,"allocated":1867149312,"data_stored":1866771957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":576387527},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953807,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1436132,"kb_used_data":927388,"kb_used_omap":1,"kb_used_meta":508734,"kb_avail":92309020,"statfs":{"total":95995035648,"available":94524436480,"internally_reserved":0,"allocated":949645312,"data_stored":949267957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":520944069},"hb_peers":[0,1,2,3,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790283,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1712220,"kb_used_data":1239508,"kb_used_omap":1,"kb_used_meta":472638,"kb_avail":92032932,"statfs":{"total":95995035648,"available":94241722368,"internally_reserved":0,"allocated":1269256192,"data_stored":1268880769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":483981765},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":641990656,"data_stored":641990656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":954273792,"data_stored":954269720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":303955968,"data_stored":303955968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1843134464,"data_stored":1843134464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":944242688,"data_stored":944242688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1254297600,"data_stored":1254293528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1279131648,"data_stored":1279131648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1225916416,"data_stored":1225916416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":331087872,"data_stored":331087872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":650117120,"data_stored":650117120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":301662208,"data_stored":301662208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":321257472,"data_stored":321257472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:47:43.214 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-01T19:47:43.273 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:43 smithi022 ceph-mon[39439]: pgmap v1454: 17 pgs: 17 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:47:43.285 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:47:43.313 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:43.333 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:47:43.335 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:43.336 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:47:43.436 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:47:43.501 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:43.535 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:47:43.544 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:47:43.547 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:47:43.557 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:43.558 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:47:43.600 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:47:43.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:43 smithi188 ceph-mon[43939]: pgmap v1454: 17 pgs: 17 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:47:43.645 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:47:43.658 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:47:43.675 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:47:43.705 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:47:43.705 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:43 smithi062 ceph-mon[44211]: pgmap v1454: 17 pgs: 17 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.19k op/s 2024-04-01T19:47:43.708 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:43.742 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:47:43.746 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:47:43.757 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:43.757 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:47:43.768 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:47:43.792 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:47:43.821 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:47:43.840 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:47:43.858 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:47:43.858 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:47:43.900 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:47:43.917 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:43.938 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:47:43.940 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:47:43.941 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:47:43.941 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:47:43.941 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:47:43.941 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:47:43.941 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:47:43.941 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:47:43.941 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:47:43.941 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:47:43.941 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:47:43.941 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:47:43.941 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:47:44.093 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:47:44.099 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:44.100 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:47:44.201 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:47:44.230 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:44.252 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:47:44.255 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:44.255 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:47:44.356 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:47:44.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:44 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2925644460' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:47:44.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:44 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:44.394 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:44.447 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:47:44.451 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:44.452 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:47:44.553 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:47:44.610 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:44 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2925644460' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:47:44.610 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:44 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:44.610 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:44.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:44 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2925644460' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:47:44.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:44 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:44.635 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:47:44.642 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:44.642 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:47:44.743 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:47:44.790 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:44.838 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:47:44.845 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:44.846 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:47:44.946 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:47:44.973 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:44.994 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:47:44.996 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:44.997 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:47:45.098 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:47:45.153 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:45.199 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:47:45.205 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:45.206 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:47:45.307 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:47:45.366 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:45.402 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:47:45.407 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:45.407 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:47:45.408 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:45 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.408 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:45 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.408 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:45 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.408 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:45 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.408 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:45 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.408 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:45 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.408 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:45 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.408 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:45 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.408 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:45 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.408 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:45 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.408 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:45 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.409 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:45 smithi062 ceph-mon[44211]: pgmap v1455: 17 pgs: 17 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:47:45.508 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:47:45.536 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:45.555 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:47:45.557 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:45 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.557 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:45 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.557 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:45 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.557 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:45 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.557 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:45 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.557 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:45 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.557 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:45 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.557 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:45 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.558 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:45 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.558 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:45 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.558 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:45 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.558 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:45 smithi188 ceph-mon[43939]: pgmap v1455: 17 pgs: 17 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:47:45.558 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:45.559 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:47:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:45 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:45 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:45 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:45 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:45 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:45 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:45 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:45 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:45 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:45 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:45 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:45 smithi022 ceph-mon[39439]: pgmap v1455: 17 pgs: 17 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:47:45.659 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:47:45.718 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:45.750 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:47:45.754 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:45.754 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:47:45.855 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:47:45.882 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:45.902 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:47:45.904 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:45.905 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:47:46.006 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:47:46.067 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:46.092 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:47:46.096 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:46.097 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:47:46.198 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:47:46.246 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:46.294 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:47:46.301 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:46.301 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:47:46.402 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:47:46.447 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:47.430 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:47:47.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:47:47.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:47:48.208 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:47:48.217 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:48.218 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:47:48.319 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:47:48.347 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:48.371 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:47:48.374 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:48.374 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:47:48.475 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:47:48.499 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:48 smithi188 ceph-mon[43939]: pgmap v1456: 17 pgs: 17 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:47:48.499 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:48 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:47:48.499 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:48 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:47:48.499 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:48 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:48.499 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:48 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:48.499 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:48 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:48.499 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:48 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:48.500 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:48 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:48.500 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:48 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:48.501 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:48.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:48 smithi062 ceph-mon[44211]: pgmap v1456: 17 pgs: 17 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:47:48.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:48 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:47:48.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:48 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:47:48.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:48 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:48.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:48 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:48.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:48 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:48.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:48 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:48.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:48 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:48.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:48 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:48.520 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:47:48.523 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:48.523 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:47:48.594 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:48 smithi022 ceph-mon[39439]: pgmap v1456: 17 pgs: 17 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:47:48.594 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:48 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:47:48.594 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:48 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:47:48.594 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:48 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:48.594 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:48 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:48.594 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:48 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:48.594 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:48 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:48.594 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:48 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:48.594 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:48 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:48.624 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:47:48.675 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:48.706 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:47:48.715 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:48.715 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:47:48.816 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:47:48.890 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:48.943 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:47:48.947 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:48.947 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:47:49.028 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:47:49.028 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:47:49.028 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 0 2024-04-01T19:47:49.028 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:47:49.049 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:47:49.076 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:49.095 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:47:49.098 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:49.099 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:47:49.199 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:47:49.237 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:49 smithi022 ceph-mon[39439]: osdmap e529: 12 total, 12 up, 12 in 2024-04-01T19:47:49.238 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:49 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:49.238 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:49 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:49.238 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:49 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2808499060' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:47:49.238 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:49 smithi022 ceph-mon[39439]: from='client.26503 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:47:49.238 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:49 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:49.238 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:49 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:49.238 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:49 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:47:49.238 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:49 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:47:49.238 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:49 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:49.238 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:49 smithi022 ceph-mon[39439]: pgmap v1458: 17 pgs: 17 active+clean; 4.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:47:49.251 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:49.292 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:47:49.295 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:49.296 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:47:49.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:49 smithi188 ceph-mon[43939]: osdmap e529: 12 total, 12 up, 12 in 2024-04-01T19:47:49.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:49 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:49.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:49 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:49.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:49 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2808499060' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:47:49.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:49 smithi188 ceph-mon[43939]: from='client.26503 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:47:49.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:49 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:49.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:49 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:49.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:49 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:47:49.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:49 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:47:49.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:49 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:49.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:49 smithi188 ceph-mon[43939]: pgmap v1458: 17 pgs: 17 active+clean; 4.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:47:49.396 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:47:49.441 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:49.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:49 smithi062 ceph-mon[44211]: osdmap e529: 12 total, 12 up, 12 in 2024-04-01T19:47:49.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:49 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:49.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:49 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:49.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:49 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2808499060' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:47:49.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:49 smithi062 ceph-mon[44211]: from='client.26503 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:47:49.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:49 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:49.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:49 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:49.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:49 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:47:49.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:49 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:47:49.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:49 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:47:49.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:49 smithi062 ceph-mon[44211]: pgmap v1458: 17 pgs: 17 active+clean; 4.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:47:49.533 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:47:49.860 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_blocked_ops 2024-04-01T19:47:49.959 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:47:50.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:50 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:47:50.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:50 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:47:50.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:50 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:47:50.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:50 smithi062 ceph-mon[44211]: from='client.26503 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:47:50.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:50 smithi062 ceph-mon[44211]: osdmap e530: 12 total, 12 up, 12 in 2024-04-01T19:47:50.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:50 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:47:50.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:50 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:47:50.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:50 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:47:50.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:50 smithi022 ceph-mon[39439]: from='client.26503 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:47:50.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:50 smithi022 ceph-mon[39439]: osdmap e530: 12 total, 12 up, 12 in 2024-04-01T19:47:50.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:50 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:47:50.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:50 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:47:50.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:50 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:47:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:50 smithi188 ceph-mon[43939]: from='client.26503 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:47:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:50 smithi188 ceph-mon[43939]: osdmap e530: 12 total, 12 up, 12 in 2024-04-01T19:47:51.311 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:47:51.318 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:51.318 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:47:51.366 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:47:51.372 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:47:51.419 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:47:51.446 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:51.466 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:47:51.468 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:51.469 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:47:51.570 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:47:51.608 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:51.649 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:47:51.651 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:51.652 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:47:51.752 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:47:51.777 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:51 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:47:51.777 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:51 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:47:51.777 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:51 smithi188 ceph-mon[43939]: osdmap e531: 12 total, 12 up, 12 in 2024-04-01T19:47:51.777 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:51 smithi188 ceph-mon[43939]: pgmap v1461: 17 pgs: 17 active+clean; 3.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:47:51.780 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:51.802 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:47:51.805 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:51.806 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:47:51.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:51 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:47:51.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:51 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:47:51.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:51 smithi022 ceph-mon[39439]: osdmap e531: 12 total, 12 up, 12 in 2024-04-01T19:47:51.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:51 smithi022 ceph-mon[39439]: pgmap v1461: 17 pgs: 17 active+clean; 3.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:47:51.907 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:47:51.972 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:51 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:47:51.973 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:51 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:47:51.973 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:51 smithi062 ceph-mon[44211]: osdmap e531: 12 total, 12 up, 12 in 2024-04-01T19:47:51.973 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:51 smithi062 ceph-mon[44211]: pgmap v1461: 17 pgs: 17 active+clean; 3.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:47:51.984 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:52.011 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:47:52.018 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:52.018 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:47:52.119 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:47:52.174 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:52.215 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:47:52.226 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:52.226 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:47:52.327 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:47:52.379 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:52.746 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:47:52.752 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:52.753 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:47:52.853 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:47:52.881 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:52.902 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:47:52.906 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:52.906 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:47:53.007 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:47:53.035 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:53.056 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:47:53.058 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:53.059 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:47:53.159 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:47:53.214 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:53.243 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:47:53.253 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:53.253 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:47:53.274 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:47:53.354 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:47:53.382 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:53.403 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:47:53.405 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:53.405 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:47:53.506 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:47:53.562 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:53.597 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:47:53.600 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:53.601 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:47:53.702 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:47:53.764 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:53.798 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:47:53.801 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:53.801 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:47:53.902 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:47:53.955 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:54.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:54 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:47:54.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:54 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:47:54.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:54 smithi022 ceph-mon[39439]: pgmap v1462: 17 pgs: 17 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:47:54.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:54 smithi022 ceph-mon[39439]: osdmap e532: 12 total, 12 up, 12 in 2024-04-01T19:47:54.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:54 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:47:54.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:54 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:47:54.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:54 smithi062 ceph-mon[44211]: pgmap v1462: 17 pgs: 17 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:47:54.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:54 smithi062 ceph-mon[44211]: osdmap e532: 12 total, 12 up, 12 in 2024-04-01T19:47:54.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:54 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:47:54.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:54 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:47:54.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:54 smithi188 ceph-mon[43939]: pgmap v1462: 17 pgs: 17 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:47:54.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:54 smithi188 ceph-mon[43939]: osdmap e532: 12 total, 12 up, 12 in 2024-04-01T19:47:54.923 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:47:54.927 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:54.927 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:47:55.028 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:47:55.055 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:55.081 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:47:55.083 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:55.084 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:47:55.185 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:47:55.212 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:55.232 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:47:55.234 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:55.234 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:47:55.335 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:47:55.381 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:55.423 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:47:55.441 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:55.442 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:47:55.543 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:47:55.570 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:55.591 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:47:55.593 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:55.594 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:47:55.695 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:47:55.739 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:55.769 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:47:55.772 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:55.772 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:47:55.866 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:47:55.866 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:47:55.866 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:47:55.866 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:47:55.866 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:47:55.866 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:47:55.866 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:47:55.866 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:47:55.866 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:47:55.866 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:47:55.866 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:47:55.867 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:47:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:47:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:47:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:47:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:47:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:47:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:47:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:47:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:47:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:47:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:47:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:47:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:47:55.873 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:47:55.937 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:55.973 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:47:55.977 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:55.978 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:47:56.079 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:47:56.129 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:56.265 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:47:56.270 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:56.270 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:47:56.363 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:47:56.371 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:47:56.430 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:56 smithi022 ceph-mon[39439]: pgmap v1464: 17 pgs: 17 active+clean; 3.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T19:47:56.430 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:56 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1037716561' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:47:56.430 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:56 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.430 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:56 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:56 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:56 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:56 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:56 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:56 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:56 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:56 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:56 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:56 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.431 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:56.449 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:47:56.449 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:47:56.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:56 smithi062 ceph-mon[44211]: pgmap v1464: 17 pgs: 17 active+clean; 3.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T19:47:56.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:56 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1037716561' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:47:56.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:56 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:56 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:56 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:56 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:56 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:56 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:56 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:56 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:56 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:56 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:56 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:56 smithi188 ceph-mon[43939]: pgmap v1464: 17 pgs: 17 active+clean; 3.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T19:47:56.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:56 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1037716561' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:47:56.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:56 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:56 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:56 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:56 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:56 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:56 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:56 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:56 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:56 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:56 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:56 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:57.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:57.514 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:47:57.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:57.522 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:57.522 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:47:57.623 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:47:57.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:47:57.648 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:57.668 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:47:57.671 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:57.671 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:47:57.772 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:47:57.822 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:58.032 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:47:58.041 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:58.041 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:47:58.142 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:47:58.199 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:58.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:47:58 smithi022 ceph-mon[39439]: pgmap v1465: 17 pgs: 17 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:47:58.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:47:58 smithi062 ceph-mon[44211]: pgmap v1465: 17 pgs: 17 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:47:58.565 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:47:58.572 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:58.572 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:47:58.573 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_historic_ops 2024-04-01T19:47:58.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:47:58 smithi188 ceph-mon[43939]: pgmap v1465: 17 pgs: 17 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:47:58.673 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:47:58.731 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:58.901 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:47:58.908 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:58.908 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:47:59.009 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:47:59.075 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:59.103 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:47:59.107 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:59.107 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:47:59.208 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:47:59.270 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:59.315 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:47:59.326 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:59.326 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:47:59.427 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:47:59.501 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:47:59.550 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:47:59.962 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:47:59.973 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:47:59.973 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:47:59.979 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:48:00.075 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:48:00.161 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:00.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:00 smithi062 ceph-mon[44211]: pgmap v1466: 17 pgs: 17 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:48:00.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:00 smithi022 ceph-mon[39439]: pgmap v1466: 17 pgs: 17 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:48:00.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:00 smithi188 ceph-mon[43939]: pgmap v1466: 17 pgs: 17 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:48:01.033 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:48:01.037 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:01.038 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:48:01.139 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:48:01.185 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:01.262 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:48:01.294 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:01 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/499285307' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:48:01.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:01 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/499285307' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:48:01.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:01 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/499285307' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:48:01.861 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:48:02.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:02 smithi062 ceph-mon[44211]: pgmap v1467: 17 pgs: 17 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:48:02.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:02 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:48:02.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:02 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/499285307' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:48:02.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:02 smithi062 ceph-mon[44211]: osdmap e533: 12 total, 12 up, 12 in 2024-04-01T19:48:02.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:02 smithi022 ceph-mon[39439]: pgmap v1467: 17 pgs: 17 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:48:02.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:02 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:48:02.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:02 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/499285307' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:48:02.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:02 smithi022 ceph-mon[39439]: osdmap e533: 12 total, 12 up, 12 in 2024-04-01T19:48:02.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:02 smithi188 ceph-mon[43939]: pgmap v1467: 17 pgs: 17 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.12k op/s 2024-04-01T19:48:02.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:02 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:48:02.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:02 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/499285307' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:48:02.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:02 smithi188 ceph-mon[43939]: osdmap e533: 12 total, 12 up, 12 in 2024-04-01T19:48:03.215 INFO:tasks.thrashosds.thrasher:Recovered, killing an osd 2024-04-01T19:48:03.215 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [0, 1, 2, 3, 4, 5, 7, 9, 10, 11, 8, 6] 2024-04-01T19:48:03.215 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-01T19:48:03.215 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.1 2024-04-01T19:48:03.384 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:48:03.388 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:03.388 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:48:03.489 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:48:03.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:03 smithi062 ceph-mon[44211]: 6.c scrub starts 2024-04-01T19:48:03.523 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:48:03 smithi022 systemd[1]: Stopping Ceph osd.1 for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T19:48:03.523 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:03 smithi022 ceph-mon[39439]: 6.c scrub starts 2024-04-01T19:48:03.528 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:03.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:03 smithi188 ceph-mon[43939]: 6.c scrub starts 2024-04-01T19:48:03.641 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:48:03.649 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:03.650 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:48:03.751 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:48:03.816 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:04.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:04 smithi062 ceph-mon[44211]: 6.c scrub ok 2024-04-01T19:48:04.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:04 smithi062 ceph-mon[44211]: pgmap v1469: 17 pgs: 17 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.02k op/s 2024-04-01T19:48:04.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:04 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:48:04.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:04 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:48:04.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:04 smithi022 ceph-mon[39439]: 6.c scrub ok 2024-04-01T19:48:04.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:04 smithi022 ceph-mon[39439]: pgmap v1469: 17 pgs: 17 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.02k op/s 2024-04-01T19:48:04.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:04 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:48:04.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:04 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:48:04.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:04 smithi188 ceph-mon[43939]: 6.c scrub ok 2024-04-01T19:48:04.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:04 smithi188 ceph-mon[43939]: pgmap v1469: 17 pgs: 17 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.02k op/s 2024-04-01T19:48:04.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:04 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:48:04.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:04 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:48:04.795 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:48:04.801 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:04.802 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:48:04.903 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:48:04.929 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:04.950 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:48:04.952 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:04.953 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:48:04.978 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:48:04.978 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:48:05.053 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:48:05.081 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:05.103 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:48:05.106 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:05.106 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:48:05.207 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:48:05.247 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:05.281 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:48:05.289 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:05.289 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:48:05.360 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:05 smithi022 ceph-mon[39439]: 6.6 scrub starts 2024-04-01T19:48:05.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:05 smithi022 ceph-mon[39439]: osdmap e534: 12 total, 12 up, 12 in 2024-04-01T19:48:05.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:05 smithi022 ceph-mon[39439]: pgmap v1471: 17 pgs: 17 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:48:05.389 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:48:05.435 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:05.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:05 smithi062 ceph-mon[44211]: 6.6 scrub starts 2024-04-01T19:48:05.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:05 smithi062 ceph-mon[44211]: osdmap e534: 12 total, 12 up, 12 in 2024-04-01T19:48:05.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:05 smithi062 ceph-mon[44211]: pgmap v1471: 17 pgs: 17 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:48:05.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:05 smithi188 ceph-mon[43939]: 6.6 scrub starts 2024-04-01T19:48:05.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:05 smithi188 ceph-mon[43939]: osdmap e534: 12 total, 12 up, 12 in 2024-04-01T19:48:05.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:05 smithi188 ceph-mon[43939]: pgmap v1471: 17 pgs: 17 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:48:06.100 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:48:06.108 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:06.108 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:48:06.209 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:48:06.237 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:06.258 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:48:06.261 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:06.261 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:48:06.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:06 smithi022 ceph-mon[39439]: 6.6 scrub ok 2024-04-01T19:48:06.362 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:48:06.389 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:06.410 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:48:06.412 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:06.413 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:48:06.513 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:48:06.540 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:06 smithi188 ceph-mon[43939]: 6.6 scrub ok 2024-04-01T19:48:06.542 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:06.562 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:48:06.565 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:06.565 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:48:06.666 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:48:06.693 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:06.713 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:48:06.716 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:06.716 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:48:06.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:06 smithi062 ceph-mon[44211]: 6.6 scrub ok 2024-04-01T19:48:06.817 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:48:06.844 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:06.864 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:48:06.866 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:06.867 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:48:06.968 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:48:06.996 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:07.016 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:48:07.019 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:07.019 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:48:07.120 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:48:07.122 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_ops_in_flight 2024-04-01T19:48:07.175 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:07.218 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:48:07.222 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:07.222 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:48:07.323 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:48:07.345 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:07 smithi022 ceph-mon[39439]: pgmap v1472: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:48:07.359 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:07.386 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:48:07.386 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:07.386 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:48:07.487 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:48:07.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:07 smithi062 ceph-mon[44211]: pgmap v1472: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:48:07.538 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:07.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:07 smithi188 ceph-mon[43939]: pgmap v1472: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:48:07.640 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:48:07.645 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:07.646 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:48:07.747 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:48:07.786 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:07.796 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:48:07.796 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:48:07.797 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:48:07.814 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:48:07.815 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:48:07.818 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:07.818 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:48:07.849 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:48:07.852 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:48:07.884 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:48:07.919 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:48:07.924 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:48:07.952 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:07.959 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:48:07.986 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:48:07.987 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:48:07.990 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:07.990 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:48:08.014 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:48:08.048 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:48:08.079 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:48:08.091 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:48:08.103 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:48:08.103 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:48:08.103 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:48:08.103 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:48:08.103 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:48:08.103 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:48:08.103 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:48:08.103 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:48:08.103 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:48:08.103 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:48:08.104 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:48:08.104 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:48:08.111 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:48:07 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-1[65900]: 2024-04-01T19:48:07.631+0000 7f3fadaab700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T19:48:08.111 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:48:07 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-1[65900]: 2024-04-01T19:48:07.631+0000 7f3fadaab700 -1 osd.1 534 *** Got signal Terminated *** 2024-04-01T19:48:08.111 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:48:07 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-1[65900]: 2024-04-01T19:48:07.631+0000 7f3fadaab700 -1 osd.1 534 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T19:48:08.162 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:08.190 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:08.191 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:48:08.191 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:48:08.292 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:48:08.318 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:08.337 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:48:08.340 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:08.340 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:48:08.441 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:48:08.466 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:08 smithi062 ceph-mon[44211]: 6.e scrub starts 2024-04-01T19:48:08.466 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:08 smithi062 ceph-mon[44211]: 6.e scrub ok 2024-04-01T19:48:08.466 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:08 smithi062 ceph-mon[44211]: osd.1 marked itself down and dead 2024-04-01T19:48:08.466 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:08 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1303354941' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:48:08.466 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:08 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:08.468 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:08.487 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:48:08.490 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:08.490 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:48:08.491 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:08 smithi022 ceph-mon[39439]: 6.e scrub starts 2024-04-01T19:48:08.491 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:08 smithi022 ceph-mon[39439]: 6.e scrub ok 2024-04-01T19:48:08.491 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:08 smithi022 ceph-mon[39439]: osd.1 marked itself down and dead 2024-04-01T19:48:08.491 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:08 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1303354941' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:48:08.491 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:08 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:08.590 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:48:08.615 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:08 smithi188 ceph-mon[43939]: 6.e scrub starts 2024-04-01T19:48:08.615 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:08 smithi188 ceph-mon[43939]: 6.e scrub ok 2024-04-01T19:48:08.615 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:08 smithi188 ceph-mon[43939]: osd.1 marked itself down and dead 2024-04-01T19:48:08.615 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:08 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1303354941' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:48:08.615 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:08 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:08.617 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:08.635 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:48:08.637 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:08.637 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:48:08.738 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:48:08.756 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:48:08.770 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:09.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:09 smithi022 ceph-mon[39439]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-01T19:48:09.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:09 smithi022 ceph-mon[39439]: osdmap e535: 12 total, 11 up, 12 in 2024-04-01T19:48:09.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:09 smithi022 ceph-mon[39439]: pgmap v1474: 17 pgs: 1 stale+active+clean, 1 active+clean+scrubbing, 15 active+clean; 2.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:48:09.421 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:48:09.423 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:09.424 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:48:09.525 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:48:09.554 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.554 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.555 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.555 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.555 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.555 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.555 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.555 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.555 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.555 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.555 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.555 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:09 smithi062 ceph-mon[44211]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-01T19:48:09.555 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:09 smithi062 ceph-mon[44211]: osdmap e535: 12 total, 11 up, 12 in 2024-04-01T19:48:09.555 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:09 smithi062 ceph-mon[44211]: pgmap v1474: 17 pgs: 1 stale+active+clean, 1 active+clean+scrubbing, 15 active+clean; 2.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:48:09.556 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:09.577 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:48:09.580 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:09.580 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:48:09.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:09.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:09 smithi188 ceph-mon[43939]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-01T19:48:09.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:09 smithi188 ceph-mon[43939]: osdmap e535: 12 total, 11 up, 12 in 2024-04-01T19:48:09.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:09 smithi188 ceph-mon[43939]: pgmap v1474: 17 pgs: 1 stale+active+clean, 1 active+clean+scrubbing, 15 active+clean; 2.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:48:09.680 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:48:09 smithi022 bash[230763]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-1 2024-04-01T19:48:09.681 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:48:09.713 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:09.735 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:48:09.737 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:09.738 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:48:09.838 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:48:09.868 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:09.889 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:48:09.891 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:09.892 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:48:09.993 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:48:10.026 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:10.047 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:48:10.050 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:10.051 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:48:10.152 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:48:10.183 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:10.204 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:48:10.206 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:10.207 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:48:10.308 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:48:10.339 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:10.359 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:48:10.362 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:10.362 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:48:10.413 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:48:10.463 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:48:10.493 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:10.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:10 smithi022 ceph-mon[39439]: osdmap e536: 12 total, 11 up, 12 in 2024-04-01T19:48:10.616 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:48:10.619 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:10.619 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:48:10.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:10 smithi188 ceph-mon[43939]: osdmap e536: 12 total, 11 up, 12 in 2024-04-01T19:48:10.720 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:48:10.752 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:10.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:10 smithi062 ceph-mon[44211]: osdmap e536: 12 total, 11 up, 12 in 2024-04-01T19:48:10.773 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:48:10.776 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:10.776 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:48:10.877 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:48:10.912 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:11.447 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:48:11.467 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:11.468 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:48:11.569 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:48:11.596 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:11 smithi062 ceph-mon[44211]: pgmap v1476: 17 pgs: 2 undersized+degraded+peered, 1 active+clean+scrubbing, 14 active+clean; 2.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 985 op/s; 5064/83242 objects degraded (6.083%) 2024-04-01T19:48:11.598 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:11.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:11 smithi022 ceph-mon[39439]: pgmap v1476: 17 pgs: 2 undersized+degraded+peered, 1 active+clean+scrubbing, 14 active+clean; 2.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 985 op/s; 5064/83242 objects degraded (6.083%) 2024-04-01T19:48:11.617 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:48:11.620 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:11.620 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:48:11.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:11 smithi188 ceph-mon[43939]: pgmap v1476: 17 pgs: 2 undersized+degraded+peered, 1 active+clean+scrubbing, 14 active+clean; 2.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 985 op/s; 5064/83242 objects degraded (6.083%) 2024-04-01T19:48:11.709 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:48:11.721 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:48:11.749 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:11.769 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:48:11.771 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:11.771 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:48:11.872 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:48:11.899 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:11.918 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:48:11.920 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:11.921 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:48:12.022 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:48:12.049 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:12.068 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:48:12.070 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:12.071 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:48:12.172 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:48:12.204 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:12.220 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:48:12.225 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:48:12.227 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:12.227 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:48:12.233 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:48:12.233 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:48:12.233 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 0 2024-04-01T19:48:12.234 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:48:12.328 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:48:12.362 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:12.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:12 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:48:12.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:12 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:48:12.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:12 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:48:12.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:12 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:48:12.522 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:12 smithi022 ceph-mon[39439]: Health check failed: Degraded data redundancy: 5064/83242 objects degraded (6.083%), 2 pgs degraded (PG_DEGRADED) 2024-04-01T19:48:12.522 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:12 smithi022 ceph-mon[39439]: osdmap e537: 12 total, 11 up, 12 in 2024-04-01T19:48:12.522 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:12 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T19:48:12.522 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:12 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T19:48:12.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:12 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:48:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:12 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:48:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:12 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:48:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:12 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:48:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:12 smithi188 ceph-mon[43939]: Health check failed: Degraded data redundancy: 5064/83242 objects degraded (6.083%), 2 pgs degraded (PG_DEGRADED) 2024-04-01T19:48:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:12 smithi188 ceph-mon[43939]: osdmap e537: 12 total, 11 up, 12 in 2024-04-01T19:48:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:12 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T19:48:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:12 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T19:48:12.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:12 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:48:12.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:12 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:48:12.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:12 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:48:12.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:12 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:48:12.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:12 smithi062 ceph-mon[44211]: Health check failed: Degraded data redundancy: 5064/83242 objects degraded (6.083%), 2 pgs degraded (PG_DEGRADED) 2024-04-01T19:48:12.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:12 smithi062 ceph-mon[44211]: osdmap e537: 12 total, 11 up, 12 in 2024-04-01T19:48:12.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:12 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T19:48:12.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:12 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T19:48:13.313 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:48:13.319 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:13.319 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:48:13.420 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:48:13.452 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:13.473 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:48:13.476 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:13.476 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:48:13.577 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:48:13.607 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:13 smithi022 ceph-mon[39439]: pgmap v1478: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 592 op/s; 7665/82724 objects degraded (9.266%) 2024-04-01T19:48:13.610 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:13.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:13 smithi188 ceph-mon[43939]: pgmap v1478: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 592 op/s; 7665/82724 objects degraded (9.266%) 2024-04-01T19:48:13.685 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:48:13.688 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:13.689 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:48:13.709 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_blocked_ops 2024-04-01T19:48:13.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:13 smithi062 ceph-mon[44211]: pgmap v1478: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 592 op/s; 7665/82724 objects degraded (9.266%) 2024-04-01T19:48:13.790 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:48:13.823 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:13.845 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:48:13.848 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:13.849 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:48:13.949 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:48:13.977 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:14.014 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:48:14.033 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:14.033 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:48:14.134 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:48:14.167 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:14.188 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:48:14.191 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:14.191 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:48:14.292 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:48:14.324 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:14.346 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:48:14.348 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:14.349 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:48:14.450 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:48:14.474 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.1.service' 2024-04-01T19:48:14.479 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:14.499 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:48:14.502 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:14.502 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:48:14.547 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T19:48:14.547 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-01T19:48:14.547 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd down 1 2024-04-01T19:48:14.591 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:48:14.603 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:48:14.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:14 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/171835173' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:48:14.632 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:14.651 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:48:14.653 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:14.654 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:48:14.755 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:48:14.782 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:14.802 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:48:14.804 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:14.805 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:48:14.830 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:14 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/171835173' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:48:14.906 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:48:14.934 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:15.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:14 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/171835173' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:48:15.287 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:48:15.289 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:15.289 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:48:15.391 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:48:15.419 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:15.439 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:48:15.441 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:15.442 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:48:15.543 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:48:15.573 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:15.593 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:48:15.595 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:15.596 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:48:15.697 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:48:15.725 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:15.744 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:48:15.747 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:15.747 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:48:15.764 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:48:15.769 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:48:15.847 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:48:15.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:15 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:48:15.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:15 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/171835173' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:48:15.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:15 smithi022 ceph-mon[39439]: osdmap e538: 12 total, 11 up, 12 in 2024-04-01T19:48:15.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:15 smithi022 ceph-mon[39439]: pgmap v1480: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 265 op/s; 7665/82654 objects degraded (9.274%) 2024-04-01T19:48:15.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:15 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:48:15.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:15 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/171835173' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:48:15.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:15 smithi188 ceph-mon[43939]: osdmap e538: 12 total, 11 up, 12 in 2024-04-01T19:48:15.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:15 smithi188 ceph-mon[43939]: pgmap v1480: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 265 op/s; 7665/82654 objects degraded (9.274%) 2024-04-01T19:48:15.875 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:15.999 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:48:16.002 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:16.002 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:48:16.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:15 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:48:16.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:15 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/171835173' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:48:16.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:15 smithi062 ceph-mon[44211]: osdmap e538: 12 total, 11 up, 12 in 2024-04-01T19:48:16.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:15 smithi062 ceph-mon[44211]: pgmap v1480: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 265 op/s; 7665/82654 objects degraded (9.274%) 2024-04-01T19:48:16.103 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:48:16.131 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:48:16.281 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:16.282 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:48:16.383 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:48:16.416 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:16.439 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:48:16.441 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:16.442 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:48:16.543 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:48:16.578 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:16.599 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:48:16.601 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:16.602 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:48:16.703 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:48:16.734 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:16.756 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:48:16.759 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:16.759 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:48:16.860 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:48:16.888 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:17.137 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:48:17.140 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:17.140 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:48:17.241 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:48:17.275 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:17.294 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:48:17.297 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:48:17.299 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:17.299 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:48:17.400 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:48:17.431 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:17.452 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:48:17.454 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:17.455 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:48:17.555 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:48:17.586 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:17.606 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:48:17.608 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:17.609 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:48:17.709 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:48:17.739 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:17.760 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:48:17.763 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:17.763 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:48:17.864 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:48:17.896 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:17.917 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:48:17.920 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:17.920 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:48:18.021 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:48:18.052 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:18.073 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:48:18.076 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:18.076 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:48:18.177 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:48:18.206 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:18.225 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:48:18.228 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:18.228 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:48:18.329 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:48:18.355 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:18 smithi062 ceph-mon[44211]: pgmap v1481: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 165 op/s; 7665/82654 objects degraded (9.274%) 2024-04-01T19:48:18.357 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:18.377 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:48:18.379 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:18.379 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:48:18.480 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:48:18.508 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:18.527 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:48:18.530 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:18.530 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:48:18.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:18 smithi022 ceph-mon[39439]: pgmap v1481: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 165 op/s; 7665/82654 objects degraded (9.274%) 2024-04-01T19:48:18.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:18 smithi188 ceph-mon[43939]: pgmap v1481: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 165 op/s; 7665/82654 objects degraded (9.274%) 2024-04-01T19:48:18.631 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:48:18.662 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:18.683 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:48:18.685 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:18.686 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:48:18.744 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:48:18.786 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:48:18.816 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:18.835 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:48:18.838 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:18.838 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:48:18.940 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:48:18.970 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:18.991 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:48:18.993 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:18.994 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:48:19.095 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:48:19.123 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:19.144 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:48:19.147 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:19.147 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:48:19.248 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:48:19.278 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:19.299 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:48:19.302 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:19.302 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:48:19.403 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:48:19.436 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:20.119 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:48:20.119 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:48:20.119 INFO:teuthology.orchestra.run.smithi022.stdout: "complaint_time": 30, 2024-04-01T19:48:20.119 INFO:teuthology.orchestra.run.smithi022.stdout: "num_blocked_ops": 0 2024-04-01T19:48:20.119 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:48:20.240 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1 is already down. 2024-04-01T19:48:20.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:20 smithi062 ceph-mon[44211]: pgmap v1482: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 36 op/s; 7665/82654 objects degraded (9.274%) 2024-04-01T19:48:20.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:20 smithi022 ceph-mon[39439]: pgmap v1482: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 36 op/s; 7665/82654 objects degraded (9.274%) 2024-04-01T19:48:20.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:20 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[39416]: 2024-04-01T19:48:20.238+0000 7fd025a9f700 -1 mon.a@0(leader).osd e538 definitely_dead 0 2024-04-01T19:48:20.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:20 smithi188 ceph-mon[43939]: pgmap v1482: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 36 op/s; 7665/82654 objects degraded (9.274%) 2024-04-01T19:48:20.969 INFO:tasks.thrashosds.thrasher:Removing osd 1, in_osds are: [0, 1, 2, 3, 4, 5, 7, 9, 10, 11, 8, 6] 2024-04-01T19:48:20.969 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd out 1 2024-04-01T19:48:21.456 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:21 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3348317413' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["1"]}]: dispatch 2024-04-01T19:48:21.456 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:21 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 7665/82654 objects degraded (9.274%), 3 pgs degraded (PG_DEGRADED) 2024-04-01T19:48:21.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:21 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3348317413' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["1"]}]: dispatch 2024-04-01T19:48:21.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:21 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 7665/82654 objects degraded (9.274%), 3 pgs degraded (PG_DEGRADED) 2024-04-01T19:48:21.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:21 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3348317413' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["1"]}]: dispatch 2024-04-01T19:48:21.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:21 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 7665/82654 objects degraded (9.274%), 3 pgs degraded (PG_DEGRADED) 2024-04-01T19:48:22.478 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_historic_ops 2024-04-01T19:48:22.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:22 smithi022 ceph-mon[39439]: pgmap v1483: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 29 op/s; 7665/82654 objects degraded (9.274%) 2024-04-01T19:48:22.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:22 smithi062 ceph-mon[44211]: pgmap v1483: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 29 op/s; 7665/82654 objects degraded (9.274%) 2024-04-01T19:48:22.619 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:48:22.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:22 smithi188 ceph-mon[43939]: pgmap v1483: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 29 op/s; 7665/82654 objects degraded (9.274%) 2024-04-01T19:48:22.669 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:48:22.689 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:48:22.711 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:48:22.732 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:48:22.752 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:48:22.772 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:48:22.796 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:48:22.816 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:48:22.836 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:48:22.857 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:48:22.878 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:48:22.878 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:48:22.878 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-01T19:48:22.878 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:48:22.878 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:48:22.878 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:48:22.879 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:48:22.879 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:48:22.879 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:48:22.879 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:48:22.879 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:48:22.879 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:48:22.879 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:48:22.889 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:48:22.896 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:22.897 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:48:22.998 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:48:23.031 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:23.052 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:48:23.055 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:23.055 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:48:23.156 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:48:23.188 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:23.208 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:48:23.211 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:23.211 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:48:23.245 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:48:23.312 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:48:23.341 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:23.361 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:48:23.363 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:23.363 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:48:23.464 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:48:23.490 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:23 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1855547664' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:48:23.490 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:23 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/974311206' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:48:23.490 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:23.490 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:23.490 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:23 smithi188 ceph-mon[43939]: pgmap v1484: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 3 op/s; 7665/82654 objects degraded (9.274%) 2024-04-01T19:48:23.492 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:23.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:23 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1855547664' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:48:23.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:23 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/974311206' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:48:23.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:23.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:23.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:23 smithi062 ceph-mon[44211]: pgmap v1484: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 3 op/s; 7665/82654 objects degraded (9.274%) 2024-04-01T19:48:23.511 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:48:23.513 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:23.513 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:48:23.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:23 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1855547664' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:48:23.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:23 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/974311206' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:48:23.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:23.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:23.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:23 smithi022 ceph-mon[39439]: pgmap v1484: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 3 op/s; 7665/82654 objects degraded (9.274%) 2024-04-01T19:48:23.615 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:48:23.645 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:23.721 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:48:23.734 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:23.734 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:48:23.835 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:48:23.869 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:23.891 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:48:23.894 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:23.894 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:48:23.995 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:48:24.024 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:24.078 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:48:24.081 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:24.082 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:48:24.102 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:48:24.103 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:48:24.182 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:48:24.210 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:24.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:24 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:48:24.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:24 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1855547664' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:48:24.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:24 smithi022 ceph-mon[39439]: osdmap e539: 12 total, 11 up, 12 in 2024-04-01T19:48:24.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:24 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:48:24.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:24 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1855547664' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:48:24.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:24 smithi062 ceph-mon[44211]: osdmap e539: 12 total, 11 up, 12 in 2024-04-01T19:48:24.558 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:48:24.563 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:24.563 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:48:24.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:24.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:24 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:48:24.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:24 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1855547664' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:48:24.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:24 smithi188 ceph-mon[43939]: osdmap e539: 12 total, 11 up, 12 in 2024-04-01T19:48:24.664 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:48:24.695 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:24.716 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:48:24.719 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:24.719 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:48:24.820 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:48:24.854 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:24.876 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:48:24.878 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:24.879 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:48:24.980 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:48:25.011 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:25.032 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:48:25.035 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:25.035 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:48:25.136 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:48:25.168 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:25.189 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:48:25.191 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:25.191 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:48:25.292 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:48:25.323 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:25.343 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:48:25.345 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:25.346 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:48:25.447 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:48:25.469 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:48:25.481 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:25.504 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:48:25.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:25 smithi022 ceph-mon[39439]: pgmap v1486: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7665/82654 objects degraded (9.274%) 2024-04-01T19:48:25.507 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:25 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[39416]: 2024-04-01T19:48:25.360+0000 7fd025a9f700 -1 mon.a@0(leader).osd e539 definitely_dead 0 2024-04-01T19:48:25.507 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:25.508 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:48:25.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:25 smithi062 ceph-mon[44211]: pgmap v1486: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7665/82654 objects degraded (9.274%) 2024-04-01T19:48:25.609 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:48:25.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:25 smithi188 ceph-mon[43939]: pgmap v1486: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7665/82654 objects degraded (9.274%) 2024-04-01T19:48:25.637 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:25.736 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:48:25.739 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:25.740 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:48:25.841 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:48:25.868 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:25.966 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:48:25.969 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:25.969 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:48:26.070 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:48:26.099 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:26.104 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:48:26.299 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:48:26.302 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:26.302 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:48:26.316 INFO:teuthology.orchestra.run.smithi022.stderr:marked out osd.1. 2024-04-01T19:48:26.403 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:48:26.429 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:26 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1015893984' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["1"]}]: dispatch 2024-04-01T19:48:26.429 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:26 smithi022 ceph-mon[39439]: Client client.admin marked osd.1 out, after it was down for 17 seconds 2024-04-01T19:48:26.431 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:26.504 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:48:26.506 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:26.506 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:48:26.607 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:48:26.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:26 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1015893984' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["1"]}]: dispatch 2024-04-01T19:48:26.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:26 smithi188 ceph-mon[43939]: Client client.admin marked osd.1 out, after it was down for 17 seconds 2024-04-01T19:48:26.639 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:26.661 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:48:26.663 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:26.664 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:48:26.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:26 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1015893984' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["1"]}]: dispatch 2024-04-01T19:48:26.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:26 smithi062 ceph-mon[44211]: Client client.admin marked osd.1 out, after it was down for 17 seconds 2024-04-01T19:48:26.765 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:48:26.794 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:26.814 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:48:26.817 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:26.817 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:48:26.899 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:48:26.908 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.1 2024-04-01T19:48:26.908 INFO:tasks.thrashosds.thrasher:remote for osd 1 is ubuntu@smithi022.front.sepia.ceph.com 2024-04-01T19:48:26.909 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -n osd.1 --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --op list-pgs 2024-04-01T19:48:26.918 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:48:26.951 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:26.972 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:48:26.975 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:26.976 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:48:27.077 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:48:27.108 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:27.129 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:48:27.132 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:27.132 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:48:27.233 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:48:27.260 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:27.353 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/osd.1/config 2024-04-01T19:48:27.358 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:48:27.362 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:27.362 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:48:27.463 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:48:27.496 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:27.509 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:48:27.518 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:48:27.521 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:27.521 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:48:27.535 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:27 smithi022 ceph-mon[39439]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-01T19:48:27.535 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:27 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1015893984' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["1"]}]': finished 2024-04-01T19:48:27.535 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:27 smithi022 ceph-mon[39439]: osdmap e540: 12 total, 11 up, 11 in 2024-04-01T19:48:27.535 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:27 smithi022 ceph-mon[39439]: pgmap v1488: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 8.9 GiB used, 975 GiB / 983 GiB avail; 7665/82654 objects degraded (9.274%) 2024-04-01T19:48:27.621 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:48:27.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:27 smithi188 ceph-mon[43939]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-01T19:48:27.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:27 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1015893984' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["1"]}]': finished 2024-04-01T19:48:27.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:27 smithi188 ceph-mon[43939]: osdmap e540: 12 total, 11 up, 11 in 2024-04-01T19:48:27.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:27 smithi188 ceph-mon[43939]: pgmap v1488: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 8.9 GiB used, 975 GiB / 983 GiB avail; 7665/82654 objects degraded (9.274%) 2024-04-01T19:48:27.649 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:27.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:27 smithi062 ceph-mon[44211]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-01T19:48:27.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:27 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1015893984' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["1"]}]': finished 2024-04-01T19:48:27.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:27 smithi062 ceph-mon[44211]: osdmap e540: 12 total, 11 up, 11 in 2024-04-01T19:48:27.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:27 smithi062 ceph-mon[44211]: pgmap v1488: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 8.9 GiB used, 975 GiB / 983 GiB avail; 7665/82654 objects degraded (9.274%) 2024-04-01T19:48:28.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:28 smithi022 ceph-mon[39439]: osdmap e541: 12 total, 11 up, 11 in 2024-04-01T19:48:28.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:28 smithi188 ceph-mon[43939]: osdmap e541: 12 total, 11 up, 11 in 2024-04-01T19:48:28.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:28 smithi062 ceph-mon[44211]: osdmap e541: 12 total, 11 up, 11 in 2024-04-01T19:48:28.783 INFO:teuthology.orchestra.run.smithi022.stderr:Creating an OSD daemon form without an OSD FSID value 2024-04-01T19:48:28.798 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:48:28.802 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:28.802 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:48:28.903 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:48:28.932 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:29.554 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:29 smithi022 ceph-mon[39439]: 6.4 starting backfill to osd.3 from (0'0,0'0] MAX to 534'17162 2024-04-01T19:48:29.554 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:29 smithi022 ceph-mon[39439]: 6.d starting backfill to osd.10 from (0'0,0'0] MAX to 534'16592 2024-04-01T19:48:29.555 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:29 smithi022 ceph-mon[39439]: osdmap e542: 12 total, 11 up, 11 in 2024-04-01T19:48:29.555 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:29 smithi022 ceph-mon[39439]: pgmap v1491: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 8.9 GiB used, 975 GiB / 983 GiB avail; 7665/82654 objects degraded (9.274%) 2024-04-01T19:48:29.555 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:29 smithi022 ceph-mon[39439]: osdmap e543: 12 total, 11 up, 11 in 2024-04-01T19:48:29.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:29 smithi188 ceph-mon[43939]: 6.4 starting backfill to osd.3 from (0'0,0'0] MAX to 534'17162 2024-04-01T19:48:29.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:29 smithi188 ceph-mon[43939]: 6.d starting backfill to osd.10 from (0'0,0'0] MAX to 534'16592 2024-04-01T19:48:29.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:29 smithi188 ceph-mon[43939]: osdmap e542: 12 total, 11 up, 11 in 2024-04-01T19:48:29.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:29 smithi188 ceph-mon[43939]: pgmap v1491: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 8.9 GiB used, 975 GiB / 983 GiB avail; 7665/82654 objects degraded (9.274%) 2024-04-01T19:48:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:29 smithi188 ceph-mon[43939]: osdmap e543: 12 total, 11 up, 11 in 2024-04-01T19:48:29.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:29 smithi062 ceph-mon[44211]: 6.4 starting backfill to osd.3 from (0'0,0'0] MAX to 534'17162 2024-04-01T19:48:29.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:29 smithi062 ceph-mon[44211]: 6.d starting backfill to osd.10 from (0'0,0'0] MAX to 534'16592 2024-04-01T19:48:29.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:29 smithi062 ceph-mon[44211]: osdmap e542: 12 total, 11 up, 11 in 2024-04-01T19:48:29.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:29 smithi062 ceph-mon[44211]: pgmap v1491: 17 pgs: 3 undersized+degraded+peered, 14 active+clean; 2.5 GiB data, 8.9 GiB used, 975 GiB / 983 GiB avail; 7665/82654 objects degraded (9.274%) 2024-04-01T19:48:29.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:29 smithi062 ceph-mon[44211]: osdmap e543: 12 total, 11 up, 11 in 2024-04-01T19:48:29.781 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:48:29.784 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:29.784 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:48:29.885 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:48:29.918 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:29.942 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:48:29.945 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:29.945 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:48:30.046 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:48:30.079 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:30.103 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:48:30.106 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:30.106 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:48:30.207 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:48:30.240 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:30.296 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:48:30.299 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:30.300 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:48:30.400 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:48:30.434 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:30.536 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:48:30.541 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:30.541 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:48:30.566 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:48:30.590 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:48:30.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:30 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:48:30.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:30 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:48:30.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:30 smithi022 ceph-mon[39439]: 6.e starting backfill to osd.2 from (0'0,0'0] MAX to 534'19703 2024-04-01T19:48:30.613 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:48:30.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:30 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:48:30.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:30 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:48:30.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:30 smithi188 ceph-mon[43939]: 6.e starting backfill to osd.2 from (0'0,0'0] MAX to 534'19703 2024-04-01T19:48:30.637 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:48:30.642 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:48:30.662 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:48:30.672 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:30 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:48:30.672 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:30 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:48:30.672 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:30 smithi062 ceph-mon[44211]: 6.e starting backfill to osd.2 from (0'0,0'0] MAX to 534'19703 2024-04-01T19:48:30.675 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:30.687 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:48:30.698 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:48:30.701 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:30.701 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:48:30.711 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:48:30.736 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:48:30.761 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:48:30.786 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:48:30.802 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:48:30.815 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:48:30.815 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:48:30.815 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-01T19:48:30.816 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:48:30.816 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:48:30.816 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:48:30.816 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:48:30.816 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:48:30.816 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:48:30.816 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:48:30.816 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:48:30.816 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:48:30.816 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:48:30.839 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:30.901 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:48:30.905 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:30.905 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:48:31.006 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:48:31.039 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:31.064 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:48:31.064 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 20, 2024-04-01T19:48:31.064 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 600, 2024-04-01T19:48:31.064 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:48:31.064 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.065 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:234000 5.6 5:653ce61c:::benchmark_data_smithi188_119427_object69301:head [delete] snapc 0=[] ondisk+write+known_if_redirected e421)", 2024-04-01T19:48:31.065 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:04.099886+0000", 2024-04-01T19:48:31.065 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 386.96438619600002, 2024-04-01T19:48:31.065 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21627006900000001, 2024-04-01T19:48:31.065 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:31.065 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:31.065 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:31.065 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:31.065 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:48:31.065 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:48:31.065 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 234000 2024-04-01T19:48:31.065 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.065 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:31.065 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.066 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:31.066 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.099886+0000", 2024-04-01T19:48:31.066 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.066 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.066 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.066 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:31.066 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.099886+0000", 2024-04-01T19:48:31.066 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.066 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.066 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.066 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:31.066 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.099889+0000", 2024-04-01T19:48:31.066 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.2049999999999998e-06 2024-04-01T19:48:31.066 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.066 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.067 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:31.067 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.099899+0000", 2024-04-01T19:48:31.067 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0029e-05 2024-04-01T19:48:31.067 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.067 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.067 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:31.067 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.099921+0000", 2024-04-01T19:48:31.067 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2070999999999999e-05 2024-04-01T19:48:31.067 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.067 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.067 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:31.067 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.099933+0000", 2024-04-01T19:48:31.067 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1477999999999999e-05 2024-04-01T19:48:31.067 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.068 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.068 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:31.068 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.100862+0000", 2024-04-01T19:48:31.068 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00092963900000000001 2024-04-01T19:48:31.068 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.068 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.068 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:31.068 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.100985+0000", 2024-04-01T19:48:31.068 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012279200000000001 2024-04-01T19:48:31.068 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.068 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.068 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:48:31.068 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.101100+0000", 2024-04-01T19:48:31.068 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000114603 2024-04-01T19:48:31.069 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.069 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.069 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:31.069 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.120571+0000", 2024-04-01T19:48:31.069 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.019470945 2024-04-01T19:48:31.069 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.069 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.069 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:31.069 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.316037+0000", 2024-04-01T19:48:31.069 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.19546575699999999 2024-04-01T19:48:31.069 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.069 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.069 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:31.069 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.316100+0000", 2024-04-01T19:48:31.070 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3471000000000003e-05 2024-04-01T19:48:31.070 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.070 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.070 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:31.070 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.316156+0000", 2024-04-01T19:48:31.070 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6079000000000003e-05 2024-04-01T19:48:31.070 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.070 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:31.070 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.070 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.070 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.070 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:234001 5.6 5:6f3b55b8:::benchmark_data_smithi188_119427_object69302:head [delete] snapc 0=[] ondisk+write+known_if_redirected e421)", 2024-04-01T19:48:31.070 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:04.100635+0000", 2024-04-01T19:48:31.070 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 386.96363744500002, 2024-04-01T19:48:31.071 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.23405330299999999, 2024-04-01T19:48:31.071 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:31.071 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:31.071 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:31.071 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:31.071 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:48:31.071 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:48:31.071 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 234001 2024-04-01T19:48:31.071 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.071 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:31.071 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.071 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:31.071 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.100635+0000", 2024-04-01T19:48:31.071 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.072 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.072 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.072 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:31.072 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.100635+0000", 2024-04-01T19:48:31.072 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.072 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.072 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.072 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:31.072 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.100636+0000", 2024-04-01T19:48:31.072 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6029999999999999e-06 2024-04-01T19:48:31.072 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.072 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.072 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:31.072 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.100642+0000", 2024-04-01T19:48:31.072 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.874e-06 2024-04-01T19:48:31.073 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.073 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.073 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:31.073 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.100651+0000", 2024-04-01T19:48:31.073 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3380000000000005e-06 2024-04-01T19:48:31.073 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.073 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.073 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:31.073 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.100659+0000", 2024-04-01T19:48:31.073 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0669999999999992e-06 2024-04-01T19:48:31.073 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.073 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.073 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:31.073 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.106172+0000", 2024-04-01T19:48:31.074 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0055135360000000003 2024-04-01T19:48:31.074 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.074 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.074 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:31.074 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.106325+0000", 2024-04-01T19:48:31.074 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000153234 2024-04-01T19:48:31.074 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.074 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.074 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:48:31.074 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.106432+0000", 2024-04-01T19:48:31.074 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000106623 2024-04-01T19:48:31.075 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.075 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.075 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:31.075 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.120576+0000", 2024-04-01T19:48:31.075 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014144143 2024-04-01T19:48:31.075 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.075 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.075 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:31.075 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.334582+0000", 2024-04-01T19:48:31.075 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21400577400000001 2024-04-01T19:48:31.075 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.075 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.076 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:31.076 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.334636+0000", 2024-04-01T19:48:31.076 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3987999999999999e-05 2024-04-01T19:48:31.076 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.076 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.076 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:31.076 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.334688+0000", 2024-04-01T19:48:31.076 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2123000000000002e-05 2024-04-01T19:48:31.076 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.076 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:31.076 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.076 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.076 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.076 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:234006 5.6 5:6e1adcc3:::benchmark_data_smithi188_119427_object69307:head [delete] snapc 0=[] ondisk+write+known_if_redirected e421)", 2024-04-01T19:48:31.077 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:04.105552+0000", 2024-04-01T19:48:31.077 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 386.95871975699998, 2024-04-01T19:48:31.077 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.233585283, 2024-04-01T19:48:31.077 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:31.077 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:31.077 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:31.077 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:31.077 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:48:31.077 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:48:31.077 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 234006 2024-04-01T19:48:31.077 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.077 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:31.077 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.077 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:31.077 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.105552+0000", 2024-04-01T19:48:31.077 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.078 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.078 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.078 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:31.078 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.105552+0000", 2024-04-01T19:48:31.078 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.078 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.078 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.078 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:31.078 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.105556+0000", 2024-04-01T19:48:31.078 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5599999999999998e-06 2024-04-01T19:48:31.078 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.078 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.078 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:31.078 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.105570+0000", 2024-04-01T19:48:31.079 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3777e-05 2024-04-01T19:48:31.079 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.079 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.079 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:31.079 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.105591+0000", 2024-04-01T19:48:31.079 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1602000000000001e-05 2024-04-01T19:48:31.079 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.079 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.079 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:31.079 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.105604+0000", 2024-04-01T19:48:31.079 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2549e-05 2024-04-01T19:48:31.079 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.079 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.079 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:31.079 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.110275+0000", 2024-04-01T19:48:31.079 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0046712070000000001 2024-04-01T19:48:31.080 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.080 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.080 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:31.080 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.110414+0000", 2024-04-01T19:48:31.080 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013842100000000001 2024-04-01T19:48:31.080 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.080 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.080 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:48:31.080 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.110566+0000", 2024-04-01T19:48:31.080 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000152175 2024-04-01T19:48:31.080 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.080 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.080 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:31.080 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.120581+0000", 2024-04-01T19:48:31.081 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010015690000000001 2024-04-01T19:48:31.081 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.081 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.081 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:31.081 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339064+0000", 2024-04-01T19:48:31.081 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21848295500000001 2024-04-01T19:48:31.081 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.081 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.081 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:31.081 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339098+0000", 2024-04-01T19:48:31.081 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3524e-05 2024-04-01T19:48:31.081 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.081 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.081 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:31.081 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339138+0000", 2024-04-01T19:48:31.081 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9823000000000001e-05 2024-04-01T19:48:31.082 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.082 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:31.082 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.082 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.082 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.082 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:234008 5.6 5:65e99957:::benchmark_data_smithi188_119427_object69309:head [delete] snapc 0=[] ondisk+write+known_if_redirected e421)", 2024-04-01T19:48:31.082 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:04.105628+0000", 2024-04-01T19:48:31.082 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 386.95864432100001, 2024-04-01T19:48:31.082 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.23362691799999999, 2024-04-01T19:48:31.082 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:31.082 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:31.082 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:31.082 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:31.082 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:48:31.082 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:48:31.083 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 234008 2024-04-01T19:48:31.083 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.083 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:31.083 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.083 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:31.083 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.105628+0000", 2024-04-01T19:48:31.083 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.083 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.083 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.083 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:31.083 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.105628+0000", 2024-04-01T19:48:31.083 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.083 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.083 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.083 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:31.083 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.105629+0000", 2024-04-01T19:48:31.084 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.1399999999999995e-07 2024-04-01T19:48:31.084 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.084 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.084 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:31.084 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.105633+0000", 2024-04-01T19:48:31.084 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.653e-06 2024-04-01T19:48:31.084 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.084 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.084 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:31.084 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.105640+0000", 2024-04-01T19:48:31.084 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3139999999999998e-06 2024-04-01T19:48:31.084 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.084 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.084 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:31.084 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.105646+0000", 2024-04-01T19:48:31.084 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3520000000000003e-06 2024-04-01T19:48:31.085 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.085 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.085 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:31.085 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.114814+0000", 2024-04-01T19:48:31.085 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0091675569999999998 2024-04-01T19:48:31.085 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.085 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.085 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:31.085 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.114933+0000", 2024-04-01T19:48:31.085 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000119503 2024-04-01T19:48:31.085 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.085 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.085 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:48:31.085 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.115047+0000", 2024-04-01T19:48:31.085 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000114057 2024-04-01T19:48:31.085 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.086 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.086 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:31.086 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.121947+0000", 2024-04-01T19:48:31.086 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.006899334 2024-04-01T19:48:31.086 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.086 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.086 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:31.086 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339179+0000", 2024-04-01T19:48:31.086 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21723257800000001 2024-04-01T19:48:31.086 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.086 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.086 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:31.086 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339226+0000", 2024-04-01T19:48:31.086 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6853e-05 2024-04-01T19:48:31.087 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.087 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.087 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:31.087 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339255+0000", 2024-04-01T19:48:31.087 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.8802999999999998e-05 2024-04-01T19:48:31.087 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.087 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:31.087 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.087 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.087 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.087 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:234027 5.6 5:6d33a902:::benchmark_data_smithi188_119427_object69328:head [delete] snapc 0=[] ondisk+write+known_if_redirected e421)", 2024-04-01T19:48:31.087 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:04.125767+0000", 2024-04-01T19:48:31.087 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 386.93850498500001, 2024-04-01T19:48:31.087 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21357989499999999, 2024-04-01T19:48:31.087 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:31.087 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:31.088 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:31.088 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:31.088 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:48:31.088 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:48:31.088 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 234027 2024-04-01T19:48:31.088 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.088 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:31.088 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.088 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:31.088 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.125767+0000", 2024-04-01T19:48:31.088 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.088 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.088 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.088 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:31.089 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.125767+0000", 2024-04-01T19:48:31.089 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.089 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.089 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.089 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:31.089 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.125770+0000", 2024-04-01T19:48:31.089 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.959e-06 2024-04-01T19:48:31.089 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.089 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.089 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:31.089 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.125778+0000", 2024-04-01T19:48:31.089 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.8790000000000003e-06 2024-04-01T19:48:31.089 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.089 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.089 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:31.089 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.125794+0000", 2024-04-01T19:48:31.090 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6220999999999999e-05 2024-04-01T19:48:31.090 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.090 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.090 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:31.090 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.125802+0000", 2024-04-01T19:48:31.090 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7940000000000003e-06 2024-04-01T19:48:31.090 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.090 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.090 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:31.090 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.125863+0000", 2024-04-01T19:48:31.090 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0516000000000001e-05 2024-04-01T19:48:31.090 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.090 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.090 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:31.090 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.126009+0000", 2024-04-01T19:48:31.091 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014631999999999999 2024-04-01T19:48:31.091 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.091 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.091 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:48:31.091 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.126142+0000", 2024-04-01T19:48:31.091 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013285 2024-04-01T19:48:31.091 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.091 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.091 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:31.091 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.130784+0000", 2024-04-01T19:48:31.091 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0046422939999999999 2024-04-01T19:48:31.091 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.091 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.092 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:31.092 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339291+0000", 2024-04-01T19:48:31.092 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.208506996 2024-04-01T19:48:31.092 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.092 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.092 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:31.092 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339321+0000", 2024-04-01T19:48:31.092 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.9470000000000001e-05 2024-04-01T19:48:31.092 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.092 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.092 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:31.092 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339347+0000", 2024-04-01T19:48:31.092 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6596000000000001e-05 2024-04-01T19:48:31.092 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.092 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:31.093 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.093 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.093 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.093 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:234046 5.6 5:6ef3a5bf:::benchmark_data_smithi188_119427_object69347:head [delete] snapc 0=[] ondisk+write+known_if_redirected e421)", 2024-04-01T19:48:31.093 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:04.143469+0000", 2024-04-01T19:48:31.093 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 386.92080319500002, 2024-04-01T19:48:31.093 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.19596270900000001, 2024-04-01T19:48:31.093 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:31.093 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:31.093 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:31.093 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:31.093 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:48:31.093 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:48:31.093 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 234046 2024-04-01T19:48:31.093 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.094 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:31.094 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.094 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:31.094 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.143469+0000", 2024-04-01T19:48:31.094 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.094 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.094 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.094 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:31.094 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.143469+0000", 2024-04-01T19:48:31.094 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.094 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.094 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.094 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:31.094 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.143471+0000", 2024-04-01T19:48:31.095 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4729999999999999e-06 2024-04-01T19:48:31.095 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.095 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.095 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:31.095 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.143479+0000", 2024-04-01T19:48:31.095 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0830000000000004e-06 2024-04-01T19:48:31.095 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.095 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.095 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:31.095 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.143498+0000", 2024-04-01T19:48:31.095 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9386999999999999e-05 2024-04-01T19:48:31.095 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.095 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.095 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:31.095 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.143507+0000", 2024-04-01T19:48:31.095 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.7369999999999995e-06 2024-04-01T19:48:31.096 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.096 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.096 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:31.096 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.143562+0000", 2024-04-01T19:48:31.096 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5172e-05 2024-04-01T19:48:31.096 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.096 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.096 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:31.096 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.143665+0000", 2024-04-01T19:48:31.096 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000103482 2024-04-01T19:48:31.096 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.096 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.096 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:48:31.096 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.143745+0000", 2024-04-01T19:48:31.096 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9196999999999994e-05 2024-04-01T19:48:31.096 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.097 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.097 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:31.097 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.155281+0000", 2024-04-01T19:48:31.097 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.011536872 2024-04-01T19:48:31.097 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.097 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.097 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:31.097 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339384+0000", 2024-04-01T19:48:31.097 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.18410228200000001 2024-04-01T19:48:31.097 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.097 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.097 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:31.097 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339411+0000", 2024-04-01T19:48:31.097 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6948e-05 2024-04-01T19:48:31.097 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.098 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.098 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:31.098 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339432+0000", 2024-04-01T19:48:31.098 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1075999999999999e-05 2024-04-01T19:48:31.098 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.098 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:31.098 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.098 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.098 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.098 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:234053 5.6 5:6cc0da58:::benchmark_data_smithi188_119427_object69354:head [delete] snapc 0=[] ondisk+write+known_if_redirected e421)", 2024-04-01T19:48:31.098 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:04.148441+0000", 2024-04-01T19:48:31.098 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 386.91583106399997, 2024-04-01T19:48:31.098 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.191088385, 2024-04-01T19:48:31.098 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:31.099 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:31.099 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:31.099 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:31.099 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:48:31.099 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:48:31.099 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 234053 2024-04-01T19:48:31.099 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.099 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:31.099 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.099 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:31.099 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.148441+0000", 2024-04-01T19:48:31.099 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.099 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.099 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.100 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:31.100 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.148441+0000", 2024-04-01T19:48:31.100 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.100 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.100 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.100 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:31.100 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.148443+0000", 2024-04-01T19:48:31.100 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8390000000000001e-06 2024-04-01T19:48:31.100 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.100 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.100 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:31.100 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.148451+0000", 2024-04-01T19:48:31.100 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5039999999999996e-06 2024-04-01T19:48:31.101 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.101 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.101 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:31.101 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.148460+0000", 2024-04-01T19:48:31.101 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.5799999999999998e-06 2024-04-01T19:48:31.101 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.101 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.101 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:31.101 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.148467+0000", 2024-04-01T19:48:31.101 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4339999999999997e-06 2024-04-01T19:48:31.101 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.101 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.101 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:31.102 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.150571+0000", 2024-04-01T19:48:31.102 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0021041670000000001 2024-04-01T19:48:31.102 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.102 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.102 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:31.102 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.150670+0000", 2024-04-01T19:48:31.102 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.9010000000000002e-05 2024-04-01T19:48:31.102 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.102 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.102 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:48:31.102 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.150745+0000", 2024-04-01T19:48:31.102 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5408999999999996e-05 2024-04-01T19:48:31.102 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.102 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.102 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:31.103 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.155292+0000", 2024-04-01T19:48:31.103 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0045472580000000002 2024-04-01T19:48:31.103 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.103 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.103 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:31.103 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339468+0000", 2024-04-01T19:48:31.103 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.184176014 2024-04-01T19:48:31.103 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.103 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.103 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:31.103 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339495+0000", 2024-04-01T19:48:31.103 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6202000000000001e-05 2024-04-01T19:48:31.103 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.103 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.103 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:31.103 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339530+0000", 2024-04-01T19:48:31.104 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.4968000000000001e-05 2024-04-01T19:48:31.104 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.104 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:31.104 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.104 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.104 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.104 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:234085 5.6 5:6f83805f:::benchmark_data_smithi188_119427_object69386:head [delete] snapc 0=[] ondisk+write+known_if_redirected e421)", 2024-04-01T19:48:31.104 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:04.180393+0000", 2024-04-01T19:48:31.104 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 386.88387900499998, 2024-04-01T19:48:31.104 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.15924614100000001, 2024-04-01T19:48:31.104 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:31.104 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:31.104 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:31.104 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:31.104 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:48:31.105 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:48:31.105 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 234085 2024-04-01T19:48:31.105 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.105 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:31.105 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.105 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:31.105 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.180393+0000", 2024-04-01T19:48:31.105 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.105 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.105 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.105 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:31.105 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.180393+0000", 2024-04-01T19:48:31.105 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.105 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.105 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.105 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:31.106 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.180395+0000", 2024-04-01T19:48:31.106 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.857e-06 2024-04-01T19:48:31.106 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.106 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.106 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:31.106 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.180400+0000", 2024-04-01T19:48:31.106 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0649999999999998e-06 2024-04-01T19:48:31.106 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.106 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.106 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:31.106 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.180411+0000", 2024-04-01T19:48:31.106 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1250000000000001e-05 2024-04-01T19:48:31.106 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.107 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.107 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:31.107 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.180420+0000", 2024-04-01T19:48:31.107 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.7649999999999999e-06 2024-04-01T19:48:31.107 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.107 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.107 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:31.107 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.180483+0000", 2024-04-01T19:48:31.107 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2498999999999999e-05 2024-04-01T19:48:31.107 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.107 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.107 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:31.107 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.180594+0000", 2024-04-01T19:48:31.107 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000110955 2024-04-01T19:48:31.108 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.108 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.108 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:48:31.108 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.180666+0000", 2024-04-01T19:48:31.108 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2595000000000005e-05 2024-04-01T19:48:31.108 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.108 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.108 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:31.108 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.184488+0000", 2024-04-01T19:48:31.108 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00382132 2024-04-01T19:48:31.108 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.108 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.108 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:31.108 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339577+0000", 2024-04-01T19:48:31.108 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.155089642 2024-04-01T19:48:31.109 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.109 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.109 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:31.109 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339617+0000", 2024-04-01T19:48:31.109 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9483999999999997e-05 2024-04-01T19:48:31.109 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.109 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.109 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:31.109 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:04.339639+0000", 2024-04-01T19:48:31.109 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2708999999999999e-05 2024-04-01T19:48:31.109 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.109 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:31.109 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.109 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.110 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.110 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:238358 5.6 5:60612565:::benchmark_data_smithi188_119427_object73659:head [delete] snapc 0=[] ondisk+write+known_if_redirected e438)", 2024-04-01T19:48:31.110 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:47.383622+0000", 2024-04-01T19:48:31.110 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 343.68065009399999, 2024-04-01T19:48:31.110 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.165141447, 2024-04-01T19:48:31.110 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:31.110 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:31.110 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:31.110 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:31.110 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:48:31.110 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:48:31.110 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 238358 2024-04-01T19:48:31.110 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.110 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:31.111 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.111 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:31.111 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.383622+0000", 2024-04-01T19:48:31.111 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.111 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.111 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.111 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:31.111 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.383622+0000", 2024-04-01T19:48:31.111 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.111 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.111 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.111 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:31.111 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.383624+0000", 2024-04-01T19:48:31.111 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4980000000000001e-06 2024-04-01T19:48:31.112 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.112 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.112 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:31.112 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.383628+0000", 2024-04-01T19:48:31.112 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.2420000000000002e-06 2024-04-01T19:48:31.112 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.112 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.112 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:31.112 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.383635+0000", 2024-04-01T19:48:31.112 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5279999999999998e-06 2024-04-01T19:48:31.112 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.112 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.112 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:31.113 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.383642+0000", 2024-04-01T19:48:31.113 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3910000000000003e-06 2024-04-01T19:48:31.113 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.113 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.113 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:31.113 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.412148+0000", 2024-04-01T19:48:31.113 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.028506299999999998 2024-04-01T19:48:31.113 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.113 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.113 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:31.113 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.412274+0000", 2024-04-01T19:48:31.113 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000125606 2024-04-01T19:48:31.113 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.114 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.114 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:48:31.114 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.412408+0000", 2024-04-01T19:48:31.114 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000134628 2024-04-01T19:48:31.114 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.114 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.114 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:31.114 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.434616+0000", 2024-04-01T19:48:31.114 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.022207962000000001 2024-04-01T19:48:31.114 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.114 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.114 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:31.114 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.548643+0000", 2024-04-01T19:48:31.115 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.114027014 2024-04-01T19:48:31.115 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.115 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.115 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:31.115 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.548705+0000", 2024-04-01T19:48:31.115 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2083999999999997e-05 2024-04-01T19:48:31.115 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.115 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.115 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:31.115 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:47.548764+0000", 2024-04-01T19:48:31.115 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8193999999999999e-05 2024-04-01T19:48:31.115 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.115 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:31.115 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.115 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.115 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.116 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:248293 5.6 5:63eca0a2:::benchmark_data_smithi188_119427_object83594:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:48:31.116 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:59.701539+0000", 2024-04-01T19:48:31.116 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 331.36273345699999, 2024-04-01T19:48:31.116 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.17981375199999999, 2024-04-01T19:48:31.116 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:31.116 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:31.116 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:31.116 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:31.116 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:48:31.116 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:48:31.116 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 248293 2024-04-01T19:48:31.116 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.116 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:31.116 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.116 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:31.116 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.701539+0000", 2024-04-01T19:48:31.117 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.117 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.117 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.117 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:31.117 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.701539+0000", 2024-04-01T19:48:31.117 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.117 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.117 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.117 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:31.117 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.701541+0000", 2024-04-01T19:48:31.117 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7489999999999999e-06 2024-04-01T19:48:31.117 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.117 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.117 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:31.117 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.701549+0000", 2024-04-01T19:48:31.117 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6850000000000007e-06 2024-04-01T19:48:31.118 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.118 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.118 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:31.118 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.701561+0000", 2024-04-01T19:48:31.118 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2244e-05 2024-04-01T19:48:31.118 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.118 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.118 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:31.118 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.701569+0000", 2024-04-01T19:48:31.118 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6210000000000004e-06 2024-04-01T19:48:31.118 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.118 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.118 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:31.118 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.741699+0000", 2024-04-01T19:48:31.118 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.040130381 2024-04-01T19:48:31.119 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.119 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.119 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:31.119 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.741846+0000", 2024-04-01T19:48:31.119 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014619000000000001 2024-04-01T19:48:31.119 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.119 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.119 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:48:31.119 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.741946+0000", 2024-04-01T19:48:31.119 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00010066299999999999 2024-04-01T19:48:31.119 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.119 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.119 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:31.119 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.750859+0000", 2024-04-01T19:48:31.119 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0089124449999999997 2024-04-01T19:48:31.119 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.120 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.120 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:31.120 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.881232+0000", 2024-04-01T19:48:31.120 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.130373512 2024-04-01T19:48:31.120 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.120 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.120 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:31.120 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.881287+0000", 2024-04-01T19:48:31.120 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4935999999999997e-05 2024-04-01T19:48:31.120 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.120 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.120 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:31.120 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.881353+0000", 2024-04-01T19:48:31.120 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5326000000000004e-05 2024-04-01T19:48:31.120 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.121 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:31.121 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.121 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.121 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.121 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:248483 5.6 5:65e8996c:::benchmark_data_smithi188_119427_object83784:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:48:31.121 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:59.938936+0000", 2024-04-01T19:48:31.121 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 331.12533627300002, 2024-04-01T19:48:31.121 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.16269599700000001, 2024-04-01T19:48:31.121 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:31.121 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:31.121 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:31.121 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:31.121 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:48:31.121 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:48:31.121 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 248483 2024-04-01T19:48:31.121 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.122 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:31.122 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.122 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:31.122 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.938936+0000", 2024-04-01T19:48:31.122 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.122 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.122 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.122 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:31.122 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.938936+0000", 2024-04-01T19:48:31.122 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.122 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.122 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.122 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:31.122 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.938937+0000", 2024-04-01T19:48:31.123 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1429999999999999e-06 2024-04-01T19:48:31.123 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.123 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.123 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:31.123 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.938941+0000", 2024-04-01T19:48:31.123 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1409999999999998e-06 2024-04-01T19:48:31.123 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.123 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.123 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:31.123 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.938949+0000", 2024-04-01T19:48:31.123 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0330000000000008e-06 2024-04-01T19:48:31.123 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.123 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.123 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:31.124 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.938957+0000", 2024-04-01T19:48:31.124 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2740000000000002e-06 2024-04-01T19:48:31.124 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.124 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.124 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:31.124 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.063357+0000", 2024-04-01T19:48:31.124 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.124400156 2024-04-01T19:48:31.124 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.124 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.124 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:31.124 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.063440+0000", 2024-04-01T19:48:31.124 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3752999999999996e-05 2024-04-01T19:48:31.124 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.124 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.124 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:48:31.124 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.063527+0000", 2024-04-01T19:48:31.125 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6494000000000002e-05 2024-04-01T19:48:31.125 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.125 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.125 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:31.125 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.070707+0000", 2024-04-01T19:48:31.125 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0071799150000000003 2024-04-01T19:48:31.125 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.125 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.125 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:31.125 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.101525+0000", 2024-04-01T19:48:31.125 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.030818453999999999 2024-04-01T19:48:31.125 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.125 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.125 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:31.125 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.101579+0000", 2024-04-01T19:48:31.125 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3582999999999998e-05 2024-04-01T19:48:31.126 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.126 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.126 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:31.126 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.101632+0000", 2024-04-01T19:48:31.126 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3050999999999997e-05 2024-04-01T19:48:31.126 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.126 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:31.126 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.126 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.126 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.126 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:248486 5.6 5:64aa845c:::benchmark_data_smithi188_119427_object83787:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:48:31.126 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:42:59.944037+0000", 2024-04-01T19:48:31.126 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 331.12023505299999, 2024-04-01T19:48:31.126 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.15769794500000001, 2024-04-01T19:48:31.127 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:31.127 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:31.127 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:31.127 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:31.127 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:48:31.127 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:48:31.127 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 248486 2024-04-01T19:48:31.127 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.127 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:31.127 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.127 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:31.127 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.944037+0000", 2024-04-01T19:48:31.127 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.127 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.128 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.128 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:31.128 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.944037+0000", 2024-04-01T19:48:31.128 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.128 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.128 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.128 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:31.128 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.944039+0000", 2024-04-01T19:48:31.128 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.511e-06 2024-04-01T19:48:31.128 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.128 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.128 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:31.128 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.944044+0000", 2024-04-01T19:48:31.128 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2240000000000003e-06 2024-04-01T19:48:31.128 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.129 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.129 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:31.129 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.944054+0000", 2024-04-01T19:48:31.129 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.8360000000000004e-06 2024-04-01T19:48:31.129 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.129 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.129 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:31.129 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:42:59.944062+0000", 2024-04-01T19:48:31.129 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9310000000000008e-06 2024-04-01T19:48:31.129 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.129 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.129 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:31.129 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.070737+0000", 2024-04-01T19:48:31.129 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.126674911 2024-04-01T19:48:31.130 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.130 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.130 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:31.130 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.070857+0000", 2024-04-01T19:48:31.130 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012086700000000001 2024-04-01T19:48:31.130 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.130 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.130 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:48:31.130 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.070981+0000", 2024-04-01T19:48:31.130 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012366499999999999 2024-04-01T19:48:31.130 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.130 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.130 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:31.131 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.091068+0000", 2024-04-01T19:48:31.131 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.020086485000000001 2024-04-01T19:48:31.131 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.131 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.131 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:31.131 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.101640+0000", 2024-04-01T19:48:31.131 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010572742 2024-04-01T19:48:31.131 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.131 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.131 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:31.131 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.101685+0000", 2024-04-01T19:48:31.131 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4233999999999997e-05 2024-04-01T19:48:31.131 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.132 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.132 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:31.132 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.101735+0000", 2024-04-01T19:48:31.132 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0538999999999998e-05 2024-04-01T19:48:31.132 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.132 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:31.132 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.132 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.132 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.132 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:248575 5.6 5:6a4ae077:::benchmark_data_smithi188_119427_object83876:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:48:31.132 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:00.077740+0000", 2024-04-01T19:48:31.132 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 330.98653194799999, 2024-04-01T19:48:31.132 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.210714239, 2024-04-01T19:48:31.132 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:31.132 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:31.133 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:31.133 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:31.133 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:48:31.133 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:48:31.133 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 248575 2024-04-01T19:48:31.133 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.133 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:31.133 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.133 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:31.133 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.077740+0000", 2024-04-01T19:48:31.133 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.133 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.133 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.133 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:31.133 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.077740+0000", 2024-04-01T19:48:31.134 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.134 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.134 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.134 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:31.134 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.077743+0000", 2024-04-01T19:48:31.134 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3e-06 2024-04-01T19:48:31.134 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.134 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.134 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:31.134 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.077749+0000", 2024-04-01T19:48:31.134 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4749999999999998e-06 2024-04-01T19:48:31.134 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.134 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.135 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:31.135 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.077765+0000", 2024-04-01T19:48:31.135 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5662999999999999e-05 2024-04-01T19:48:31.135 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.135 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.135 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:31.135 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.077775+0000", 2024-04-01T19:48:31.135 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.7920000000000004e-06 2024-04-01T19:48:31.135 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.135 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.135 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:31.135 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.102430+0000", 2024-04-01T19:48:31.135 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.024655439000000001 2024-04-01T19:48:31.135 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.136 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.136 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:31.136 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.102565+0000", 2024-04-01T19:48:31.136 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013540000000000001 2024-04-01T19:48:31.136 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.136 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.136 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:48:31.136 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.102683+0000", 2024-04-01T19:48:31.136 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00011737499999999999 2024-04-01T19:48:31.136 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.136 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.136 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:31.136 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.112803+0000", 2024-04-01T19:48:31.136 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010120183 2024-04-01T19:48:31.137 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.137 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.137 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:31.137 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.288329+0000", 2024-04-01T19:48:31.137 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.17552647599999999 2024-04-01T19:48:31.137 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.137 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.137 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:31.137 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.288389+0000", 2024-04-01T19:48:31.137 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9447000000000002e-05 2024-04-01T19:48:31.137 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.137 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.137 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:31.137 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.288455+0000", 2024-04-01T19:48:31.137 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5689000000000001e-05 2024-04-01T19:48:31.138 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.138 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:31.138 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.138 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.138 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.138 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:248605 5.6 5:6166de91:::benchmark_data_smithi188_119427_object83906:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:48:31.138 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:00.119282+0000", 2024-04-01T19:48:31.138 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 330.94499058999997, 2024-04-01T19:48:31.138 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.16933595500000001, 2024-04-01T19:48:31.138 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:31.138 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:31.138 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:31.138 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:31.139 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:48:31.139 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:48:31.139 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 248605 2024-04-01T19:48:31.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.139 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:31.139 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.139 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:31.139 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.119282+0000", 2024-04-01T19:48:31.139 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.139 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.139 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:31.139 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.119282+0000", 2024-04-01T19:48:31.139 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.140 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.140 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:31.140 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.119284+0000", 2024-04-01T19:48:31.140 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3300000000000001e-06 2024-04-01T19:48:31.140 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.140 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.140 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:31.140 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.119291+0000", 2024-04-01T19:48:31.140 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4850000000000003e-06 2024-04-01T19:48:31.140 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.140 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.140 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:31.140 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.119306+0000", 2024-04-01T19:48:31.140 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4586000000000001e-05 2024-04-01T19:48:31.141 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.141 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.141 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:31.141 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.119315+0000", 2024-04-01T19:48:31.141 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8810000000000002e-06 2024-04-01T19:48:31.141 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.141 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.141 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:31.141 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.157737+0000", 2024-04-01T19:48:31.141 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.038421689000000002 2024-04-01T19:48:31.141 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.141 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.141 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:31.141 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.157859+0000", 2024-04-01T19:48:31.142 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012243099999999999 2024-04-01T19:48:31.142 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.142 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.142 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:48:31.142 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.157990+0000", 2024-04-01T19:48:31.142 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013115300000000001 2024-04-01T19:48:31.142 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.142 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.142 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:31.142 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.172180+0000", 2024-04-01T19:48:31.142 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014190216 2024-04-01T19:48:31.142 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.142 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.143 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:31.143 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.288523+0000", 2024-04-01T19:48:31.143 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.116342945 2024-04-01T19:48:31.143 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.143 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.143 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:31.143 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.288565+0000", 2024-04-01T19:48:31.143 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1304999999999998e-05 2024-04-01T19:48:31.143 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.143 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.143 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:31.143 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.288618+0000", 2024-04-01T19:48:31.143 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2933999999999998e-05 2024-04-01T19:48:31.143 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.143 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:31.144 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.144 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.144 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.144 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:248608 5.6 5:69644306:::benchmark_data_smithi188_119427_object83909:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:48:31.144 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:00.121199+0000", 2024-04-01T19:48:31.144 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 330.94307299000002, 2024-04-01T19:48:31.144 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.167514938, 2024-04-01T19:48:31.144 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:31.144 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:31.144 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:31.144 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:31.144 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:48:31.144 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:48:31.144 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 248608 2024-04-01T19:48:31.145 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.145 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:31.145 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.145 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:31.145 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.121199+0000", 2024-04-01T19:48:31.145 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.145 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.145 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.145 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:31.145 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.121199+0000", 2024-04-01T19:48:31.145 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.145 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.145 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.145 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:31.145 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.121202+0000", 2024-04-01T19:48:31.145 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2919999999999998e-06 2024-04-01T19:48:31.146 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.146 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.146 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:31.146 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.121208+0000", 2024-04-01T19:48:31.146 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4989999999999999e-06 2024-04-01T19:48:31.146 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.146 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.146 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:31.146 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.121223+0000", 2024-04-01T19:48:31.146 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4628e-05 2024-04-01T19:48:31.146 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.146 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.146 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:31.147 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.121231+0000", 2024-04-01T19:48:31.147 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4079999999999998e-06 2024-04-01T19:48:31.147 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.147 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.147 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:31.147 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.162924+0000", 2024-04-01T19:48:31.147 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.041692847999999998 2024-04-01T19:48:31.147 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.147 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.147 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:31.147 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.163061+0000", 2024-04-01T19:48:31.147 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013659499999999999 2024-04-01T19:48:31.147 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:48:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.163190+0000", 2024-04-01T19:48:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012957299999999999 2024-04-01T19:48:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.172234+0000", 2024-04-01T19:48:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0090440260000000001 2024-04-01T19:48:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.288626+0000", 2024-04-01T19:48:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.116391812 2024-04-01T19:48:31.149 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.149 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.149 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:31.149 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.288668+0000", 2024-04-01T19:48:31.149 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1758999999999998e-05 2024-04-01T19:48:31.149 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.149 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.149 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:31.149 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.288714+0000", 2024-04-01T19:48:31.149 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6498000000000001e-05 2024-04-01T19:48:31.149 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.149 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:31.149 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:248736 5.6 5:6b1428e2:::benchmark_data_smithi188_119427_object84037:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:48:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:00.341246+0000", 2024-04-01T19:48:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 330.72302589899999, 2024-04-01T19:48:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.14984124500000001, 2024-04-01T19:48:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:48:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:48:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 248736 2024-04-01T19:48:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341246+0000", 2024-04-01T19:48:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341246+0000", 2024-04-01T19:48:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341251+0000", 2024-04-01T19:48:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9389999999999996e-06 2024-04-01T19:48:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341258+0000", 2024-04-01T19:48:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4840000000000001e-06 2024-04-01T19:48:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341269+0000", 2024-04-01T19:48:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.136e-05 2024-04-01T19:48:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341277+0000", 2024-04-01T19:48:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7540000000000006e-06 2024-04-01T19:48:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341396+0000", 2024-04-01T19:48:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000118743 2024-04-01T19:48:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341546+0000", 2024-04-01T19:48:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015085599999999999 2024-04-01T19:48:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:48:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341694+0000", 2024-04-01T19:48:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000147121 2024-04-01T19:48:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.490916+0000", 2024-04-01T19:48:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.14922216899999999 2024-04-01T19:48:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.490961+0000", 2024-04-01T19:48:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5062000000000003e-05 2024-04-01T19:48:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.491018+0000", 2024-04-01T19:48:31.155 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7371999999999999e-05 2024-04-01T19:48:31.155 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.155 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.155 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:31.155 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.491088+0000", 2024-04-01T19:48:31.155 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9385000000000001e-05 2024-04-01T19:48:31.155 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.155 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:31.155 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.155 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.155 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.155 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:248737 5.6 5:6db7406b:::benchmark_data_smithi188_119427_object84038:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:48:31.155 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:00.341296+0000", 2024-04-01T19:48:31.156 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 330.72297648799997, 2024-04-01T19:48:31.156 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.15003691299999999, 2024-04-01T19:48:31.156 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:31.156 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:31.156 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:31.156 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:31.156 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:48:31.156 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:48:31.156 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 248737 2024-04-01T19:48:31.156 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.156 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:31.156 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.156 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341296+0000", 2024-04-01T19:48:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341296+0000", 2024-04-01T19:48:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341297+0000", 2024-04-01T19:48:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.8599999999999997e-07 2024-04-01T19:48:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.158 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:31.158 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341300+0000", 2024-04-01T19:48:31.158 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.281e-06 2024-04-01T19:48:31.158 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.158 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.158 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:31.158 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341309+0000", 2024-04-01T19:48:31.158 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.7430000000000008e-06 2024-04-01T19:48:31.158 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.158 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.158 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:31.158 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.341314+0000", 2024-04-01T19:48:31.158 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6710000000000004e-06 2024-04-01T19:48:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.346456+0000", 2024-04-01T19:48:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0051415590000000004 2024-04-01T19:48:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.346613+0000", 2024-04-01T19:48:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015681899999999999 2024-04-01T19:48:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:48:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.346744+0000", 2024-04-01T19:48:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013091399999999999 2024-04-01T19:48:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.491100+0000", 2024-04-01T19:48:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.14435634 2024-04-01T19:48:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.491245+0000", 2024-04-01T19:48:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00014532999999999999 2024-04-01T19:48:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.491287+0000", 2024-04-01T19:48:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.2089000000000003e-05 2024-04-01T19:48:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.491333+0000", 2024-04-01T19:48:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5380999999999998e-05 2024-04-01T19:48:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:248871 5.6 5:697c9f81:::benchmark_data_smithi188_119427_object84172:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:48:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:00.518467+0000", 2024-04-01T19:48:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 330.545805288, 2024-04-01T19:48:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.16069191499999999, 2024-04-01T19:48:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:48:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:48:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 248871 2024-04-01T19:48:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.518467+0000", 2024-04-01T19:48:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.518467+0000", 2024-04-01T19:48:31.163 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.163 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.163 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.163 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:31.163 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.518468+0000", 2024-04-01T19:48:31.163 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.302e-06 2024-04-01T19:48:31.163 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.163 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.163 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:31.163 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.518475+0000", 2024-04-01T19:48:31.163 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9979999999999997e-06 2024-04-01T19:48:31.163 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.163 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.518487+0000", 2024-04-01T19:48:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1721e-05 2024-04-01T19:48:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.518494+0000", 2024-04-01T19:48:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4959999999999999e-06 2024-04-01T19:48:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.535349+0000", 2024-04-01T19:48:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.016854958999999999 2024-04-01T19:48:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.535462+0000", 2024-04-01T19:48:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00011226300000000001 2024-04-01T19:48:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:48:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.535584+0000", 2024-04-01T19:48:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012255499999999999 2024-04-01T19:48:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.549967+0000", 2024-04-01T19:48:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014382414 2024-04-01T19:48:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:31.166 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.679038+0000", 2024-04-01T19:48:31.166 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.12907093 2024-04-01T19:48:31.166 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.166 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.166 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:31.166 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.679098+0000", 2024-04-01T19:48:31.166 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0520999999999999e-05 2024-04-01T19:48:31.166 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.166 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.166 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:31.166 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.679159+0000", 2024-04-01T19:48:31.166 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0755999999999999e-05 2024-04-01T19:48:31.166 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.166 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:31.167 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.167 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.167 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.167 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:248876 5.6 5:673765d8:::benchmark_data_smithi188_119427_object84177:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:48:31.167 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:00.523945+0000", 2024-04-01T19:48:31.167 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 330.54032681299998, 2024-04-01T19:48:31.167 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.15537109800000001, 2024-04-01T19:48:31.167 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:31.167 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:31.167 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:31.167 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:31.167 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:48:31.167 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:48:31.167 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 248876 2024-04-01T19:48:31.168 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.168 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:31.168 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.168 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:31.168 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.523945+0000", 2024-04-01T19:48:31.168 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.168 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.168 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.168 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:31.168 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.523945+0000", 2024-04-01T19:48:31.168 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.168 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.168 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.168 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:31.169 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.523948+0000", 2024-04-01T19:48:31.169 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6560000000000001e-06 2024-04-01T19:48:31.169 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.169 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.169 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:31.169 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.523957+0000", 2024-04-01T19:48:31.169 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.1880000000000008e-06 2024-04-01T19:48:31.169 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.169 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.169 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:31.169 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.523986+0000", 2024-04-01T19:48:31.169 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.9207999999999999e-05 2024-04-01T19:48:31.169 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.169 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.170 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:31.170 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.523998+0000", 2024-04-01T19:48:31.170 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1421e-05 2024-04-01T19:48:31.170 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.170 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.170 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:31.170 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.540122+0000", 2024-04-01T19:48:31.170 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.016124057000000001 2024-04-01T19:48:31.170 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.170 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.170 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:31.170 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.540243+0000", 2024-04-01T19:48:31.170 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000120579 2024-04-01T19:48:31.171 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.171 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.171 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:48:31.171 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.540361+0000", 2024-04-01T19:48:31.171 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00011853000000000001 2024-04-01T19:48:31.171 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.171 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.171 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:31.171 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.678966+0000", 2024-04-01T19:48:31.171 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13860510600000001 2024-04-01T19:48:31.171 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.171 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.171 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:31.171 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.679223+0000", 2024-04-01T19:48:31.171 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00025673999999999998 2024-04-01T19:48:31.172 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.172 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.172 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:31.172 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.679272+0000", 2024-04-01T19:48:31.172 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8650999999999999e-05 2024-04-01T19:48:31.172 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.172 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.172 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:31.172 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.679317+0000", 2024-04-01T19:48:31.172 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4962000000000001e-05 2024-04-01T19:48:31.172 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.172 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:31.172 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.172 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.172 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.173 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.25864.0:248884 5.6 5:662770f4:::benchmark_data_smithi188_119427_object84185:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:48:31.173 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:43:00.531411+0000", 2024-04-01T19:48:31.173 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 330.53286118599999, 2024-04-01T19:48:31.173 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.14816362399999999, 2024-04-01T19:48:31.173 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:31.173 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:31.173 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:31.173 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:31.173 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.25864", 2024-04-01T19:48:31.173 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:48:31.173 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 248884 2024-04-01T19:48:31.173 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.173 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:31.173 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.173 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:31.174 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.531411+0000", 2024-04-01T19:48:31.174 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.174 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.174 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.174 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:31.174 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.531411+0000", 2024-04-01T19:48:31.174 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:31.174 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.174 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.174 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:31.174 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.531413+0000", 2024-04-01T19:48:31.174 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1610000000000001e-06 2024-04-01T19:48:31.174 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.174 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.174 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:31.175 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.531419+0000", 2024-04-01T19:48:31.175 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8189999999999997e-06 2024-04-01T19:48:31.175 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.175 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.175 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:31.175 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.531433+0000", 2024-04-01T19:48:31.175 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4112e-05 2024-04-01T19:48:31.175 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.175 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.175 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:31.175 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.531443+0000", 2024-04-01T19:48:31.175 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.3780000000000007e-06 2024-04-01T19:48:31.175 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.175 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.175 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:31.176 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.544642+0000", 2024-04-01T19:48:31.176 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.013199405000000001 2024-04-01T19:48:31.176 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.176 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.176 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:31.176 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.544797+0000", 2024-04-01T19:48:31.176 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015520700000000001 2024-04-01T19:48:31.176 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.176 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.176 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 5", 2024-04-01T19:48:31.176 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.544958+0000", 2024-04-01T19:48:31.176 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00016047500000000001 2024-04-01T19:48:31.176 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.176 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.176 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:31.176 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.678974+0000", 2024-04-01T19:48:31.177 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13401684999999999 2024-04-01T19:48:31.177 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.177 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.177 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:31.177 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.679461+0000", 2024-04-01T19:48:31.177 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00048656399999999999 2024-04-01T19:48:31.177 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.177 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.177 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:31.177 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.679522+0000", 2024-04-01T19:48:31.177 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1439999999999995e-05 2024-04-01T19:48:31.177 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:31.177 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:31.177 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:31.177 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:43:00.679575+0000", 2024-04-01T19:48:31.178 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2213000000000003e-05 2024-04-01T19:48:31.178 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.178 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:31.178 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.178 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:31.178 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:31.178 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:48:31.179 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:31.179 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:48:31.179 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:48:31.281 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:48:31.314 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:31.337 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:48:31.340 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:31.340 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:48:31.360 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:31 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/480304399' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:48:31.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:31.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:31.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:31.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:31 smithi022 ceph-mon[39439]: pgmap v1493: 17 pgs: 1 undersized+degraded+peered, 2 undersized+degraded+remapped+backfilling+peered, 14 active+clean; 2.5 GiB data, 8.9 GiB used, 975 GiB / 983 GiB avail; 5223/82654 objects degraded (6.319%); 31 MiB/s, 502 objects/s recovering 2024-04-01T19:48:31.428 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:48:31.441 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:48:31.477 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:31.555 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:48:31.564 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:31.565 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:48:31.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:31 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/480304399' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:48:31.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:31.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:31 smithi188 ceph-mon[43939]: pgmap v1493: 17 pgs: 1 undersized+degraded+peered, 2 undersized+degraded+remapped+backfilling+peered, 14 active+clean; 2.5 GiB data, 8.9 GiB used, 975 GiB / 983 GiB avail; 5223/82654 objects degraded (6.319%); 31 MiB/s, 502 objects/s recovering 2024-04-01T19:48:31.665 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:48:31.692 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:31.712 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:48:31.714 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:31.714 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:48:31.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:31 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/480304399' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:48:31.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:31.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:31.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:31.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:31 smithi062 ceph-mon[44211]: pgmap v1493: 17 pgs: 1 undersized+degraded+peered, 2 undersized+degraded+remapped+backfilling+peered, 14 active+clean; 2.5 GiB data, 8.9 GiB used, 975 GiB / 983 GiB avail; 5223/82654 objects degraded (6.319%); 31 MiB/s, 502 objects/s recovering 2024-04-01T19:48:31.815 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:48:31.847 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:31.871 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:48:31.875 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:31.875 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:48:31.929 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_ops_in_flight 2024-04-01T19:48:31.976 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:48:32.009 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:32 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 5223/82654 objects degraded (6.319%), 3 pgs degraded (PG_DEGRADED) 2024-04-01T19:48:32.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:32.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:32.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:32.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:32.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:32.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:32.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:32.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:32.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:32 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 5223/82654 objects degraded (6.319%), 3 pgs degraded (PG_DEGRADED) 2024-04-01T19:48:32.729 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:48:32.729 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:48:32.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:32.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:32.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:32.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:32.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:32 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 5223/82654 objects degraded (6.319%), 3 pgs degraded (PG_DEGRADED) 2024-04-01T19:48:33.592 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:33 smithi022 ceph-mon[39439]: pgmap v1494: 17 pgs: 3 undersized+degraded+remapped+backfilling+peered, 14 active+clean; 2.5 GiB data, 9.0 GiB used, 974 GiB / 983 GiB avail; 3968/82654 objects degraded (4.801%); 39 MiB/s, 616 objects/s recovering 2024-04-01T19:48:33.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:33 smithi188 ceph-mon[43939]: pgmap v1494: 17 pgs: 3 undersized+degraded+remapped+backfilling+peered, 14 active+clean; 2.5 GiB data, 9.0 GiB used, 974 GiB / 983 GiB avail; 3968/82654 objects degraded (4.801%); 39 MiB/s, 616 objects/s recovering 2024-04-01T19:48:33.668 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:48:33.675 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:33.675 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:48:33.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:33 smithi062 ceph-mon[44211]: pgmap v1494: 17 pgs: 3 undersized+degraded+remapped+backfilling+peered, 14 active+clean; 2.5 GiB data, 9.0 GiB used, 974 GiB / 983 GiB avail; 3968/82654 objects degraded (4.801%); 39 MiB/s, 616 objects/s recovering 2024-04-01T19:48:33.776 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:48:33.820 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:33.840 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:48:33.843 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:33.844 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:48:33.929 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:48:33.945 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:48:33.976 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:33.998 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:48:34.000 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:34.001 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:48:34.102 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:48:34.129 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:34.147 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:48:34.150 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:34.150 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:48:34.251 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:48:34.283 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:34.321 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:48:34.324 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:34.324 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:48:34.425 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:48:34.453 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:34 smithi022 ceph-mon[39439]: osdmap e544: 12 total, 11 up, 11 in 2024-04-01T19:48:34.455 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:34.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:34 smithi062 ceph-mon[44211]: osdmap e544: 12 total, 11 up, 11 in 2024-04-01T19:48:34.530 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:48:34.534 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:34.535 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:48:34.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:34 smithi188 ceph-mon[43939]: osdmap e544: 12 total, 11 up, 11 in 2024-04-01T19:48:34.636 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:48:34.666 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:34.687 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:48:34.689 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:34.690 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:48:34.730 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:48:34.790 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:48:34.819 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:34.839 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:48:34.841 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:34.842 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:48:34.943 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:48:34.971 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:34.989 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:48:34.992 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:34.992 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:48:35.093 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:48:35.121 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:35.348 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:48:35.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:35 smithi022 ceph-mon[39439]: osdmap e545: 12 total, 11 up, 11 in 2024-04-01T19:48:35.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:35 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2027787784' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:48:35.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:35 smithi022 ceph-mon[39439]: from='client.36575 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:48:35.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:35 smithi022 ceph-mon[39439]: pgmap v1497: 17 pgs: 3 undersized+degraded+remapped+backfilling+peered, 14 active+clean; 2.5 GiB data, 9.2 GiB used, 974 GiB / 983 GiB avail; 3968/82654 objects degraded (4.801%); 39 MiB/s, 616 objects/s recovering 2024-04-01T19:48:35.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:35 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:48:35.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:35 smithi022 ceph-mon[39439]: from='client.36575 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:48:35.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:35 smithi022 ceph-mon[39439]: osdmap e546: 12 total, 11 up, 11 in 2024-04-01T19:48:35.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:35 smithi188 ceph-mon[43939]: osdmap e545: 12 total, 11 up, 11 in 2024-04-01T19:48:35.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:35 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2027787784' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:48:35.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:35 smithi188 ceph-mon[43939]: from='client.36575 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:48:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:35 smithi188 ceph-mon[43939]: pgmap v1497: 17 pgs: 3 undersized+degraded+remapped+backfilling+peered, 14 active+clean; 2.5 GiB data, 9.2 GiB used, 974 GiB / 983 GiB avail; 3968/82654 objects degraded (4.801%); 39 MiB/s, 616 objects/s recovering 2024-04-01T19:48:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:35 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:48:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:35 smithi188 ceph-mon[43939]: from='client.36575 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:48:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:35 smithi188 ceph-mon[43939]: osdmap e546: 12 total, 11 up, 11 in 2024-04-01T19:48:35.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:35 smithi062 ceph-mon[44211]: osdmap e545: 12 total, 11 up, 11 in 2024-04-01T19:48:35.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:35 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2027787784' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:48:35.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:35 smithi062 ceph-mon[44211]: from='client.36575 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:48:35.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:35 smithi062 ceph-mon[44211]: pgmap v1497: 17 pgs: 3 undersized+degraded+remapped+backfilling+peered, 14 active+clean; 2.5 GiB data, 9.2 GiB used, 974 GiB / 983 GiB avail; 3968/82654 objects degraded (4.801%); 39 MiB/s, 616 objects/s recovering 2024-04-01T19:48:35.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:35 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:48:35.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:35 smithi062 ceph-mon[44211]: from='client.36575 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:48:35.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:35 smithi062 ceph-mon[44211]: osdmap e546: 12 total, 11 up, 11 in 2024-04-01T19:48:36.176 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:48:36.184 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:36.184 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:48:36.285 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:48:36.333 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:36.373 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:48:36.384 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:36.385 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:48:36.476 INFO:teuthology.orchestra.run.smithi022.stdout:6.e 2024-04-01T19:48:36.476 INFO:teuthology.orchestra.run.smithi022.stdout:6.4 2024-04-01T19:48:36.476 INFO:teuthology.orchestra.run.smithi022.stdout:6.d 2024-04-01T19:48:36.486 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:48:36.500 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:48:36.524 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:36.559 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:48:36.564 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:36.565 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:48:36.666 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:48:36.692 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:36.711 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:48:36.714 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:36.714 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:48:36.815 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:48:36.866 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:36.900 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:48:36.906 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:36.906 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:48:37.007 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:48:37.092 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:37.127 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:48:37.131 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:37.132 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:48:37.233 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:48:37.283 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:37.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:37 smithi062 ceph-mon[44211]: pgmap v1499: 17 pgs: 17 active+clean; 2.5 GiB data, 9.2 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 92 op/s; 54 MiB/s, 869 objects/s recovering 2024-04-01T19:48:37.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:37 smithi062 ceph-mon[44211]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3968/82654 objects degraded (4.801%), 3 pgs degraded) 2024-04-01T19:48:37.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:37 smithi022 ceph-mon[39439]: pgmap v1499: 17 pgs: 17 active+clean; 2.5 GiB data, 9.2 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 92 op/s; 54 MiB/s, 869 objects/s recovering 2024-04-01T19:48:37.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:37 smithi022 ceph-mon[39439]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3968/82654 objects degraded (4.801%), 3 pgs degraded) 2024-04-01T19:48:37.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:37 smithi188 ceph-mon[43939]: pgmap v1499: 17 pgs: 17 active+clean; 2.5 GiB data, 9.2 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 92 op/s; 54 MiB/s, 869 objects/s recovering 2024-04-01T19:48:37.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:37 smithi188 ceph-mon[43939]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3968/82654 objects degraded (4.801%), 3 pgs degraded) 2024-04-01T19:48:37.920 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:48:37.921 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:48:37.921 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:37.921 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:273769 6.b 6:d3467d6f:::benchmark_data_smithi188_134454_object117028:head [delete] snapc 0=[] ondisk+write+known_if_redirected e546)", 2024-04-01T19:48:37.921 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:48:36.799125+0000", 2024-04-01T19:48:37.921 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0072042729999999998, 2024-04-01T19:48:37.921 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0072266040000000002, 2024-04-01T19:48:37.921 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:37.921 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:37.921 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:48:37.921 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:37.921 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:48:37.921 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:48:37.921 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 273769 2024-04-01T19:48:37.922 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:37.922 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:37.922 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:37.922 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:37.922 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:48:36.799125+0000", 2024-04-01T19:48:37.922 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:37.922 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:37.922 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:37.922 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:37.922 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:48:36.799125+0000", 2024-04-01T19:48:37.922 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:37.922 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:37.922 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:37.923 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:37.923 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:48:36.799127+0000", 2024-04-01T19:48:37.923 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0710000000000002e-06 2024-04-01T19:48:37.923 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:37.923 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:37.923 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:37.923 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:48:36.799133+0000", 2024-04-01T19:48:37.923 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1659999999999999e-06 2024-04-01T19:48:37.923 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:37.923 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:37.923 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:37.923 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:48:36.799146+0000", 2024-04-01T19:48:37.923 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3574000000000001e-05 2024-04-01T19:48:37.923 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:37.924 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:37.924 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:37.924 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:48:36.799157+0000", 2024-04-01T19:48:37.924 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0542e-05 2024-04-01T19:48:37.924 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:37.924 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:37.924 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:37.924 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:48:36.799201+0000", 2024-04-01T19:48:37.924 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4437000000000002e-05 2024-04-01T19:48:37.924 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:37.924 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:37.924 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:37.924 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:48:36.799300+0000", 2024-04-01T19:48:37.924 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.8403e-05 2024-04-01T19:48:37.925 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:37.925 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:37.925 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 7", 2024-04-01T19:48:37.925 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:48:36.799376+0000", 2024-04-01T19:48:37.925 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6293999999999998e-05 2024-04-01T19:48:37.925 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:37.925 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:37.925 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:37.925 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:48:36.802970+0000", 2024-04-01T19:48:37.925 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.003594103 2024-04-01T19:48:37.925 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:37.925 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:37.925 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:37.925 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:37.925 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T19:48:37.925 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 1 2024-04-01T19:48:37.926 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:48:38.217 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:48:39.360 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:48:39.361 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:39.361 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:48:39.462 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:48:39.490 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:39.511 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:48:39.515 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:39.516 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:48:39.617 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:48:39.652 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:39.793 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:48:39.799 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:39.800 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:48:39.901 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:48:39.931 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:39.950 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:48:39.953 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:39.953 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:48:40.054 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:48:40.081 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:40.102 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:48:40.104 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:40.104 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:48:40.205 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:48:40.233 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:40.254 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:48:40.257 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:40.257 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:48:40.349 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -n osd.1 --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --op export --pgid 6.e --file /var/log/ceph/exp.6.e.1 2024-04-01T19:48:40.358 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:48:40.386 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:40.406 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:48:40.408 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:40.408 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:48:40.509 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:48:40.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:40 smithi062 ceph-mon[44211]: pgmap v1500: 17 pgs: 17 active+clean; 2.4 GiB data, 9.2 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 318 op/s; 41 MiB/s, 660 objects/s recovering 2024-04-01T19:48:40.535 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:40 smithi188 ceph-mon[43939]: pgmap v1500: 17 pgs: 17 active+clean; 2.4 GiB data, 9.2 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 318 op/s; 41 MiB/s, 660 objects/s recovering 2024-04-01T19:48:40.537 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:40.560 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:48:40.562 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:40.562 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:48:40.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:40 smithi022 ceph-mon[39439]: pgmap v1500: 17 pgs: 17 active+clean; 2.4 GiB data, 9.2 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 318 op/s; 41 MiB/s, 660 objects/s recovering 2024-04-01T19:48:40.663 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:48:40.705 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:40.776 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:48:40.782 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:40.783 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:48:40.785 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/osd.1/config 2024-04-01T19:48:40.885 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:48:40.941 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:40.974 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:48:40.981 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:40.981 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:48:41.082 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:48:41.153 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:41.191 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:48:41.195 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:41.196 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:48:41.239 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_blocked_ops 2024-04-01T19:48:41.297 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:48:41.325 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:41.346 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:48:41.349 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:41.349 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:48:41.450 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:48:41.472 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:41 smithi022 ceph-mon[39439]: pgmap v1501: 17 pgs: 17 active+clean; 2.3 GiB data, 8.9 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 561 op/s; 32 MiB/s, 505 objects/s recovering 2024-04-01T19:48:41.478 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:41.498 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:48:41.501 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:41.501 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:48:41.602 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:48:41.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:41 smithi188 ceph-mon[43939]: pgmap v1501: 17 pgs: 17 active+clean; 2.3 GiB data, 8.9 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 561 op/s; 32 MiB/s, 505 objects/s recovering 2024-04-01T19:48:41.658 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:41 smithi062 ceph-mon[44211]: pgmap v1501: 17 pgs: 17 active+clean; 2.3 GiB data, 8.9 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 561 op/s; 32 MiB/s, 505 objects/s recovering 2024-04-01T19:48:41.660 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:41.694 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:48:41.697 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:41.698 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:48:41.799 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:48:41.868 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:42.098 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:48:42.098 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:48:42.098 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:48:42.120 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:48:42.159 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:48:42.182 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:48:42.212 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:48:42.238 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:48:42.272 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:48:42.303 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:48:42.314 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:42 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4129958825' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:48:42.337 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:48:42.337 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:48:42.337 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-01T19:48:42.337 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:48:42.337 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:48:42.338 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:48:42.338 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:48:42.338 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:48:42.338 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:48:42.338 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:48:42.338 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:48:42.338 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:48:42.338 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:48:42.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:42 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4129958825' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:48:42.756 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:48:42.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:42 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4129958825' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:48:42.767 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:42.767 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:48:42.868 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:48:42.935 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:42.959 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:48:42.967 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:42.967 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:48:43.068 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:48:43.096 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:43.115 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:48:43.118 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:43.118 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:48:43.151 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:48:43.168 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:48:43.168 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:48:43.206 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:48:43.219 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:48:43.261 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:43.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:43 smithi188 ceph-mon[43939]: pgmap v1502: 17 pgs: 17 active+clean; 2.2 GiB data, 8.8 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 622 op/s; 28 MiB/s, 448 objects/s recovering 2024-04-01T19:48:43.451 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:48:43.461 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:43.462 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:48:43.464 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.464 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.464 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.464 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.464 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.464 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.464 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.464 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.465 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.465 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.465 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.465 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:43 smithi022 ceph-mon[39439]: pgmap v1502: 17 pgs: 17 active+clean; 2.2 GiB data, 8.8 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 622 op/s; 28 MiB/s, 448 objects/s recovering 2024-04-01T19:48:43.563 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:48:43.590 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:43.610 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:48:43.613 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:43.613 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:48:43.714 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:48:43.758 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:43.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:43.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:43 smithi062 ceph-mon[44211]: pgmap v1502: 17 pgs: 17 active+clean; 2.2 GiB data, 8.8 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 622 op/s; 28 MiB/s, 448 objects/s recovering 2024-04-01T19:48:43.787 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:48:43.794 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:43.795 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:48:43.896 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:48:43.925 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:43.949 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:48:43.953 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:43.954 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:48:44.055 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:48:44.090 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:44.255 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:48:44.258 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:44.258 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:48:44.309 INFO:teuthology.orchestra.run.smithi022.stderr:Creating an OSD daemon form without an OSD FSID value 2024-04-01T19:48:44.361 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:48:44.407 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:44.433 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:48:44.441 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:44.441 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:48:44.542 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:48:44.570 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:44.592 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:48:44.596 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:44.596 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:48:44.697 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:48:44.750 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:44.837 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:48:44.843 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:44.843 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:48:44.944 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:48:44.973 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:44.991 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:48:44.994 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:44.994 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:48:45.095 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:48:45.122 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:45.141 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:48:45.143 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:45.144 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:48:45.170 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:48:45.244 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:48:45.298 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:45.326 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:48:45.329 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:45.329 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:48:45.430 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:48:45.486 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:45.510 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:48:45.513 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:45.513 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:48:45.614 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:48:45.641 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:45.662 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:48:45.664 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:45.665 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:48:45.766 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:48:45.815 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:46.192 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:48:46.195 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:46.196 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:48:46.297 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:48:46.342 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:46.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:46 smithi022 ceph-mon[39439]: pgmap v1503: 17 pgs: 17 active+clean; 2.0 GiB data, 8.5 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 806 op/s; 25 MiB/s, 396 objects/s recovering 2024-04-01T19:48:46.369 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:48:46.377 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:46.377 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:48:46.478 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:48:46.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:46 smithi062 ceph-mon[44211]: pgmap v1503: 17 pgs: 17 active+clean; 2.0 GiB data, 8.5 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 806 op/s; 25 MiB/s, 396 objects/s recovering 2024-04-01T19:48:46.550 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:46.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:46 smithi188 ceph-mon[43939]: pgmap v1503: 17 pgs: 17 active+clean; 2.0 GiB data, 8.5 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 806 op/s; 25 MiB/s, 396 objects/s recovering 2024-04-01T19:48:46.641 INFO:teuthology.orchestra.run.smithi022.stderr:Exporting 6.e info 6.e( v 534'19703 (500'9701,534'19703] local-lis/les=469/470 n=2601 ec=469/469 lis/c=469/469 les/c/f=470/470/0 sis=469) 2024-04-01T19:48:46.731 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7002d6f1:::benchmark_data_smithi188_134454_object123033:head# 2024-04-01T19:48:46.733 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7004526a:::benchmark_data_smithi188_134454_object130652:head# 2024-04-01T19:48:46.734 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:700852c4:::benchmark_data_smithi188_134454_object143684:head# 2024-04-01T19:48:46.734 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7011d1d0:::benchmark_data_smithi188_134454_object147241:head# 2024-04-01T19:48:46.734 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70151375:::benchmark_data_smithi188_134454_object129677:head# 2024-04-01T19:48:46.735 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70163c1b:::benchmark_data_smithi188_134454_object119937:head# 2024-04-01T19:48:46.735 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70170f1c:::benchmark_data_smithi188_134454_object145544:head# 2024-04-01T19:48:46.735 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70187cfa:::benchmark_data_smithi188_134454_object117230:head# 2024-04-01T19:48:46.736 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70199567:::benchmark_data_smithi188_134454_object126540:head# 2024-04-01T19:48:46.736 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:701ca92e:::benchmark_data_smithi188_134454_object120733:head# 2024-04-01T19:48:46.736 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70236c3d:::benchmark_data_smithi188_134454_object135895:head# 2024-04-01T19:48:46.746 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7023775d:::benchmark_data_smithi188_134454_object131082:head# 2024-04-01T19:48:46.746 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:702422be:::benchmark_data_smithi188_134454_object142132:head# 2024-04-01T19:48:46.750 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:702888c6:::benchmark_data_smithi188_134454_object135292:head# 2024-04-01T19:48:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7029b246:::benchmark_data_smithi188_134454_object125501:head# 2024-04-01T19:48:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7029b5aa:::benchmark_data_smithi188_134454_object124477:head# 2024-04-01T19:48:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:702e9b07:::benchmark_data_smithi188_134454_object140037:head# 2024-04-01T19:48:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70310ccd:::benchmark_data_smithi188_134454_object131551:head# 2024-04-01T19:48:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7032a416:::benchmark_data_smithi188_134454_object140583:head# 2024-04-01T19:48:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70362fa5:::benchmark_data_smithi188_134454_object130188:head# 2024-04-01T19:48:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7037d59b:::benchmark_data_smithi188_134454_object149639:head# 2024-04-01T19:48:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7037e03d:::benchmark_data_smithi188_134454_object123647:head# 2024-04-01T19:48:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:703a0a1c:::benchmark_data_smithi188_134454_object154406:head# 2024-04-01T19:48:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:703b442f:::benchmark_data_smithi188_134454_object134155:head# 2024-04-01T19:48:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:703f7761:::benchmark_data_smithi188_134454_object151238:head# 2024-04-01T19:48:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70422c22:::benchmark_data_smithi188_134454_object123079:head# 2024-04-01T19:48:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70422d2a:::benchmark_data_smithi188_134454_object154340:head# 2024-04-01T19:48:46.752 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7042ef4e:::benchmark_data_smithi188_134454_object137220:head# 2024-04-01T19:48:46.752 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7042f310:::benchmark_data_smithi188_134454_object145900:head# 2024-04-01T19:48:46.752 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:704429c0:::benchmark_data_smithi188_134454_object139363:head# 2024-04-01T19:48:46.752 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70465aaa:::benchmark_data_smithi188_134454_object148216:head# 2024-04-01T19:48:46.753 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7046a9e6:::benchmark_data_smithi188_134454_object136992:head# 2024-04-01T19:48:46.754 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7046e8b2:::benchmark_data_smithi188_134454_object118401:head# 2024-04-01T19:48:46.754 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7048b128:::benchmark_data_smithi188_134454_object135413:head# 2024-04-01T19:48:46.754 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7049d664:::benchmark_data_smithi188_134454_object141732:head# 2024-04-01T19:48:46.754 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:704a25dd:::benchmark_data_smithi188_134454_object144907:head# 2024-04-01T19:48:46.754 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:704cf55f:::benchmark_data_smithi188_134454_object118020:head# 2024-04-01T19:48:46.754 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:704d26e1:::benchmark_data_smithi188_134454_object138128:head# 2024-04-01T19:48:46.754 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:704f18bc:::benchmark_data_smithi188_134454_object135842:head# 2024-04-01T19:48:46.754 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:704fbce9:::benchmark_data_smithi188_134454_object137966:head# 2024-04-01T19:48:46.754 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:705012e3:::benchmark_data_smithi188_134454_object134228:head# 2024-04-01T19:48:46.754 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70517349:::benchmark_data_smithi188_134454_object116083:head# 2024-04-01T19:48:46.759 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70518ffa:::benchmark_data_smithi188_134454_object138988:head# 2024-04-01T19:48:46.759 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7051a332:::benchmark_data_smithi188_134454_object127737:head# 2024-04-01T19:48:46.759 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7052b41a:::benchmark_data_smithi188_134454_object125780:head# 2024-04-01T19:48:46.759 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70534dd5:::benchmark_data_smithi188_134454_object150810:head# 2024-04-01T19:48:46.760 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70542e05:::benchmark_data_smithi188_134454_object133725:head# 2024-04-01T19:48:46.760 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7055b322:::benchmark_data_smithi188_134454_object148338:head# 2024-04-01T19:48:46.760 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70569086:::benchmark_data_smithi188_134454_object152443:head# 2024-04-01T19:48:46.760 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7057b0d4:::benchmark_data_smithi188_134454_object155987:head# 2024-04-01T19:48:46.761 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70587ffd:::benchmark_data_smithi188_134454_object121348:head# 2024-04-01T19:48:46.761 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:705b40cb:::benchmark_data_smithi188_134454_object119166:head# 2024-04-01T19:48:46.761 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:705d662f:::benchmark_data_smithi188_134454_object134108:head# 2024-04-01T19:48:46.761 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:705e9b0e:::benchmark_data_smithi188_134454_object141063:head# 2024-04-01T19:48:46.762 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7060816c:::benchmark_data_smithi188_134454_object117468:head# 2024-04-01T19:48:46.762 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70617b0f:::benchmark_data_smithi188_134454_object122780:head# 2024-04-01T19:48:46.763 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7062c9ac:::benchmark_data_smithi188_134454_object131064:head# 2024-04-01T19:48:46.763 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70643860:::benchmark_data_smithi188_134454_object147566:head# 2024-04-01T19:48:46.763 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7064f065:::benchmark_data_smithi188_134454_object144979:head# 2024-04-01T19:48:46.763 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:706600ec:::benchmark_data_smithi188_134454_object134923:head# 2024-04-01T19:48:46.763 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70661ba5:::benchmark_data_smithi188_134454_object152165:head# 2024-04-01T19:48:46.766 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7067e889:::benchmark_data_smithi188_134454_object122336:head# 2024-04-01T19:48:46.766 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:706829d0:::benchmark_data_smithi188_134454_object118735:head# 2024-04-01T19:48:46.766 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:706a5a6f:::benchmark_data_smithi188_134454_object146262:head# 2024-04-01T19:48:46.766 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:706aec8c:::benchmark_data_smithi188_134454_object151971:head# 2024-04-01T19:48:46.766 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:706cd6aa:::benchmark_data_smithi188_134454_object154995:head# 2024-04-01T19:48:46.766 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:706e1edd:::benchmark_data_smithi188_134454_object128177:head# 2024-04-01T19:48:46.767 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:706e9d9d:::benchmark_data_smithi188_134454_object122489:head# 2024-04-01T19:48:46.767 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70702cdd:::benchmark_data_smithi188_134454_object143289:head# 2024-04-01T19:48:46.767 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70706e1d:::benchmark_data_smithi188_134454_object125847:head# 2024-04-01T19:48:46.767 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7071e55f:::benchmark_data_smithi188_134454_object151649:head# 2024-04-01T19:48:46.767 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7072e542:::benchmark_data_smithi188_134454_object131541:head# 2024-04-01T19:48:46.767 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70736272:::benchmark_data_smithi188_134454_object123752:head# 2024-04-01T19:48:46.767 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:707412af:::benchmark_data_smithi188_134454_object132548:head# 2024-04-01T19:48:46.768 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7074d826:::benchmark_data_smithi188_134454_object151954:head# 2024-04-01T19:48:46.768 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70753daa:::benchmark_data_smithi188_134454_object124971:head# 2024-04-01T19:48:46.769 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7076cf93:::benchmark_data_smithi188_134454_object154633:head# 2024-04-01T19:48:46.769 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7076d8fc:::benchmark_data_smithi188_134454_object143896:head# 2024-04-01T19:48:46.769 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7077da1a:::benchmark_data_smithi188_134454_object121112:head# 2024-04-01T19:48:46.769 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:707b836d:::benchmark_data_smithi188_134454_object152788:head# 2024-04-01T19:48:46.769 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:707bf7e2:::benchmark_data_smithi188_134454_object130036:head# 2024-04-01T19:48:46.769 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:707c1f12:::benchmark_data_smithi188_134454_object140507:head# 2024-04-01T19:48:46.769 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:707ee695:::benchmark_data_smithi188_134454_object126922:head# 2024-04-01T19:48:46.769 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:707f448f:::benchmark_data_smithi188_134454_object136154:head# 2024-04-01T19:48:46.770 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70806cd6:::benchmark_data_smithi188_134454_object140773:head# 2024-04-01T19:48:46.770 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70811a81:::benchmark_data_smithi188_134454_object128782:head# 2024-04-01T19:48:46.770 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7081abd3:::benchmark_data_smithi188_134454_object123497:head# 2024-04-01T19:48:46.770 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7082c750:::benchmark_data_smithi188_134454_object131573:head# 2024-04-01T19:48:46.770 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70839c06:::benchmark_data_smithi188_134454_object116194:head# 2024-04-01T19:48:46.770 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70842556:::benchmark_data_smithi188_134454_object144532:head# 2024-04-01T19:48:46.772 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7085ecd2:::benchmark_data_smithi188_134454_object122947:head# 2024-04-01T19:48:46.772 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70872d09:::benchmark_data_smithi188_134454_object116021:head# 2024-04-01T19:48:46.772 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7087463c:::benchmark_data_smithi188_134454_object133827:head# 2024-04-01T19:48:46.772 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:708b2d3f:::benchmark_data_smithi188_134454_object129081:head# 2024-04-01T19:48:46.772 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:708bf064:::benchmark_data_smithi188_134454_object130582:head# 2024-04-01T19:48:46.772 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70902c96:::benchmark_data_smithi188_134454_object132455:head# 2024-04-01T19:48:46.772 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70955a22:::benchmark_data_smithi188_134454_object130051:head# 2024-04-01T19:48:46.772 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7097b301:::benchmark_data_smithi188_134454_object123735:head# 2024-04-01T19:48:46.772 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7097eca0:::benchmark_data_smithi188_134454_object128413:head# 2024-04-01T19:48:46.772 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70982fa5:::benchmark_data_smithi188_134454_object139784:head# 2024-04-01T19:48:46.772 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:709cb1f0:::benchmark_data_smithi188_134454_object141000:head# 2024-04-01T19:48:46.773 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:709db753:::benchmark_data_smithi188_134454_object118354:head# 2024-04-01T19:48:46.773 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:709dbdb9:::benchmark_data_smithi188_134454_object140000:head# 2024-04-01T19:48:46.776 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:709f4820:::benchmark_data_smithi188_134454_object145919:head# 2024-04-01T19:48:46.776 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70a19eb5:::benchmark_data_smithi188_134454_object135484:head# 2024-04-01T19:48:46.776 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70a1ca29:::benchmark_data_smithi188_134454_object132312:head# 2024-04-01T19:48:46.776 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70a34433:::benchmark_data_smithi188_134454_object122678:head# 2024-04-01T19:48:46.776 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70a51e34:::benchmark_data_smithi188_134454_object153611:head# 2024-04-01T19:48:46.776 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70a60149:::benchmark_data_smithi188_134454_object151310:head# 2024-04-01T19:48:46.776 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70a68941:::benchmark_data_smithi188_134454_object123181:head# 2024-04-01T19:48:46.776 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70a69054:::benchmark_data_smithi188_134454_object116716:head# 2024-04-01T19:48:46.776 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70a8c7c3:::benchmark_data_smithi188_134454_object129704:head# 2024-04-01T19:48:46.776 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70abf163:::benchmark_data_smithi188_134454_object127196:head# 2024-04-01T19:48:46.776 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70ad86e8:::benchmark_data_smithi188_134454_object134728:head# 2024-04-01T19:48:46.776 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70b06a62:::benchmark_data_smithi188_134454_object115744:head# 2024-04-01T19:48:46.778 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70b2781d:::benchmark_data_smithi188_134454_object142820:head# 2024-04-01T19:48:46.778 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70b5a9a5:::benchmark_data_smithi188_134454_object137726:head# 2024-04-01T19:48:46.779 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70b64ba1:::benchmark_data_smithi188_134454_object115617:head# 2024-04-01T19:48:46.779 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70b650e6:::benchmark_data_smithi188_134454_object136837:head# 2024-04-01T19:48:46.779 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70b793b5:::benchmark_data_smithi188_134454_object129895:head# 2024-04-01T19:48:46.779 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70b88682:::benchmark_data_smithi188_134454_object133775:head# 2024-04-01T19:48:46.779 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70b962a2:::benchmark_data_smithi188_134454_object148282:head# 2024-04-01T19:48:46.779 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70ba0a98:::benchmark_data_smithi188_134454_object130880:head# 2024-04-01T19:48:46.779 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70bb2aaa:::benchmark_data_smithi188_134454_object149134:head# 2024-04-01T19:48:46.779 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70bb5e3a:::benchmark_data_smithi188_134454_object135418:head# 2024-04-01T19:48:46.779 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70bc821f:::benchmark_data_smithi188_134454_object152836:head# 2024-04-01T19:48:46.781 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70bd06c7:::benchmark_data_smithi188_134454_object134180:head# 2024-04-01T19:48:46.782 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70bd40c9:::benchmark_data_smithi188_134454_object151963:head# 2024-04-01T19:48:46.782 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70c10439:::benchmark_data_smithi188_134454_object130600:head# 2024-04-01T19:48:46.782 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70c1aa3c:::benchmark_data_smithi188_134454_object116847:head# 2024-04-01T19:48:46.782 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70c37c79:::benchmark_data_smithi188_134454_object139910:head# 2024-04-01T19:48:46.782 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70c38d51:::benchmark_data_smithi188_134454_object115584:head# 2024-04-01T19:48:46.782 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70c491d6:::benchmark_data_smithi188_134454_object143003:head# 2024-04-01T19:48:46.782 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70c5f4e1:::benchmark_data_smithi188_134454_object126976:head# 2024-04-01T19:48:46.782 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70c60be5:::benchmark_data_smithi188_134454_object129875:head# 2024-04-01T19:48:46.782 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70c657bf:::benchmark_data_smithi188_134454_object133208:head# 2024-04-01T19:48:46.782 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70c6830f:::benchmark_data_smithi188_134454_object124386:head# 2024-04-01T19:48:46.782 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70c6cff8:::benchmark_data_smithi188_134454_object130101:head# 2024-04-01T19:48:46.782 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70c7071b:::benchmark_data_smithi188_134454_object155495:head# 2024-04-01T19:48:46.784 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70c719d3:::benchmark_data_smithi188_134454_object123416:head# 2024-04-01T19:48:46.784 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70c87717:::benchmark_data_smithi188_134454_object148444:head# 2024-04-01T19:48:46.784 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70c9919c:::benchmark_data_smithi188_134454_object136934:head# 2024-04-01T19:48:46.784 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70cb687a:::benchmark_data_smithi188_134454_object147464:head# 2024-04-01T19:48:46.784 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70ccb349:::benchmark_data_smithi188_134454_object139842:head# 2024-04-01T19:48:46.784 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70ccf52c:::benchmark_data_smithi188_134454_object148001:head# 2024-04-01T19:48:46.784 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70cffc9f:::benchmark_data_smithi188_134454_object149662:head# 2024-04-01T19:48:46.784 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70d0c012:::benchmark_data_smithi188_134454_object135150:head# 2024-04-01T19:48:46.784 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70d1159d:::benchmark_data_smithi188_134454_object153049:head# 2024-04-01T19:48:46.787 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70d23b03:::benchmark_data_smithi188_134454_object129166:head# 2024-04-01T19:48:46.787 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70d3c00a:::benchmark_data_smithi188_134454_object145134:head# 2024-04-01T19:48:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70d67455:::benchmark_data_smithi188_134454_object156570:head# 2024-04-01T19:48:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70d6747a:::benchmark_data_smithi188_134454_object146398:head# 2024-04-01T19:48:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70d67c76:::benchmark_data_smithi188_134454_object150675:head# 2024-04-01T19:48:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70d71dde:::benchmark_data_smithi188_134454_object155232:head# 2024-04-01T19:48:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70d89d72:::benchmark_data_smithi188_134454_object141610:head# 2024-04-01T19:48:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70dc3f09:::benchmark_data_smithi188_134454_object136478:head# 2024-04-01T19:48:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70decdf2:::benchmark_data_smithi188_134454_object141885:head# 2024-04-01T19:48:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70dfc6ce:::benchmark_data_smithi188_134454_object150398:head# 2024-04-01T19:48:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70e005ad:::benchmark_data_smithi188_134454_object126935:head# 2024-04-01T19:48:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70e16418:::benchmark_data_smithi188_134454_object126573:head# 2024-04-01T19:48:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70e256c7:::benchmark_data_smithi188_134454_object128217:head# 2024-04-01T19:48:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70e25a44:::benchmark_data_smithi188_134454_object130001:head# 2024-04-01T19:48:46.789 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70e49f08:::benchmark_data_smithi188_134454_object126758:head# 2024-04-01T19:48:46.789 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70e67c62:::benchmark_data_smithi188_134454_object129714:head# 2024-04-01T19:48:46.789 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70e6dea3:::benchmark_data_smithi188_134454_object129330:head# 2024-04-01T19:48:46.789 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70e7238e:::benchmark_data_smithi188_134454_object143085:head# 2024-04-01T19:48:46.789 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70e8df0a:::benchmark_data_smithi188_134454_object149206:head# 2024-04-01T19:48:46.789 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70e8fbbb:::benchmark_data_smithi188_134454_object156680:head# 2024-04-01T19:48:46.790 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70e989bd:::benchmark_data_smithi188_134454_object119843:head# 2024-04-01T19:48:46.790 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70eb2cc9:::benchmark_data_smithi188_134454_object123557:head# 2024-04-01T19:48:46.791 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70ecb044:::benchmark_data_smithi188_134454_object146086:head# 2024-04-01T19:48:46.792 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70edc17b:::benchmark_data_smithi188_134454_object132538:head# 2024-04-01T19:48:46.792 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70ef6ad9:::benchmark_data_smithi188_134454_object121951:head# 2024-04-01T19:48:46.792 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70f0c6d5:::benchmark_data_smithi188_134454_object154609:head# 2024-04-01T19:48:46.792 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70f2ba79:::benchmark_data_smithi188_134454_object133550:head# 2024-04-01T19:48:46.792 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70f3264e:::benchmark_data_smithi188_134454_object120970:head# 2024-04-01T19:48:46.792 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70f426b4:::benchmark_data_smithi188_134454_object136354:head# 2024-04-01T19:48:46.792 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70f59df2:::benchmark_data_smithi188_134454_object155382:head# 2024-04-01T19:48:46.792 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70f6fbd4:::benchmark_data_smithi188_134454_object148631:head# 2024-04-01T19:48:46.792 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70f910fd:::benchmark_data_smithi188_134454_object127347:head# 2024-04-01T19:48:46.797 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70f942b3:::benchmark_data_smithi188_134454_object149953:head# 2024-04-01T19:48:46.797 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70fa0449:::benchmark_data_smithi188_134454_object142596:head# 2024-04-01T19:48:46.797 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70fb573d:::benchmark_data_smithi188_134454_object137148:head# 2024-04-01T19:48:46.797 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70fc3d9f:::benchmark_data_smithi188_134454_object154727:head# 2024-04-01T19:48:46.797 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70fd5e3c:::benchmark_data_smithi188_134454_object156326:head# 2024-04-01T19:48:46.797 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:70ff6bda:::benchmark_data_smithi188_134454_object124396:head# 2024-04-01T19:48:46.797 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7101fd39:::benchmark_data_smithi188_134454_object138198:head# 2024-04-01T19:48:46.797 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7103b144:::benchmark_data_smithi188_134454_object125214:head# 2024-04-01T19:48:46.797 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7104c07b:::benchmark_data_smithi188_134454_object142196:head# 2024-04-01T19:48:46.797 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7104f755:::benchmark_data_smithi188_134454_object128067:head# 2024-04-01T19:48:46.797 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71054339:::benchmark_data_smithi188_134454_object134452:head# 2024-04-01T19:48:46.798 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7105afea:::benchmark_data_smithi188_134454_object131343:head# 2024-04-01T19:48:46.798 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7106eacc:::benchmark_data_smithi188_134454_object135185:head# 2024-04-01T19:48:46.798 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:710a9ba6:::benchmark_data_smithi188_134454_object141228:head# 2024-04-01T19:48:46.798 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:710b6667:::benchmark_data_smithi188_134454_object129873:head# 2024-04-01T19:48:46.798 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:710e01ac:::benchmark_data_smithi188_134454_object129779:head# 2024-04-01T19:48:46.798 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7110774e:::benchmark_data_smithi188_134454_object125270:head# 2024-04-01T19:48:46.798 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71115699:::benchmark_data_smithi188_134454_object144255:head# 2024-04-01T19:48:46.798 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7111ba11:::benchmark_data_smithi188_134454_object122288:head# 2024-04-01T19:48:46.798 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7113bc32:::benchmark_data_smithi188_134454_object138996:head# 2024-04-01T19:48:46.799 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71159d7a:::benchmark_data_smithi188_134454_object148754:head# 2024-04-01T19:48:46.799 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71164a85:::benchmark_data_smithi188_134454_object125344:head# 2024-04-01T19:48:46.799 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7116ba33:::benchmark_data_smithi188_134454_object122928:head# 2024-04-01T19:48:46.799 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:711a51e9:::benchmark_data_smithi188_134454_object119023:head# 2024-04-01T19:48:46.799 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:711a8613:::benchmark_data_smithi188_134454_object126988:head# 2024-04-01T19:48:46.800 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:711b534d:::benchmark_data_smithi188_134454_object154672:head# 2024-04-01T19:48:46.800 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:711c59ec:::benchmark_data_smithi188_134454_object137766:head# 2024-04-01T19:48:46.800 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:711d7961:::benchmark_data_smithi188_134454_object153680:head# 2024-04-01T19:48:46.800 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:711e589b:::benchmark_data_smithi188_134454_object145977:head# 2024-04-01T19:48:46.800 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:712007fd:::benchmark_data_smithi188_134454_object123818:head# 2024-04-01T19:48:46.800 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71207904:::benchmark_data_smithi188_134454_object138916:head# 2024-04-01T19:48:46.801 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7120acaf:::benchmark_data_smithi188_134454_object131889:head# 2024-04-01T19:48:46.801 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7121b4ce:::benchmark_data_smithi188_134454_object149155:head# 2024-04-01T19:48:46.801 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:712399a3:::benchmark_data_smithi188_134454_object121528:head# 2024-04-01T19:48:46.801 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:712410e4:::benchmark_data_smithi188_134454_object136242:head# 2024-04-01T19:48:46.801 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7126355d:::benchmark_data_smithi188_134454_object115539:head# 2024-04-01T19:48:46.802 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7126668c:::benchmark_data_smithi188_134454_object138459:head# 2024-04-01T19:48:46.802 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71292aff:::benchmark_data_smithi188_134454_object147507:head# 2024-04-01T19:48:46.802 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71299e1c:::benchmark_data_smithi188_134454_object127871:head# 2024-04-01T19:48:46.802 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7129bf58:::benchmark_data_smithi188_134454_object145946:head# 2024-04-01T19:48:46.803 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7129cc1d:::benchmark_data_smithi188_134454_object123413:head# 2024-04-01T19:48:46.803 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:712a0a30:::benchmark_data_smithi188_134454_object128720:head# 2024-04-01T19:48:46.803 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:712ac069:::benchmark_data_smithi188_134454_object126654:head# 2024-04-01T19:48:46.803 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:712baa92:::benchmark_data_smithi188_134454_object139135:head# 2024-04-01T19:48:46.803 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:712c0a2b:::benchmark_data_smithi188_134454_object141685:head# 2024-04-01T19:48:46.803 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:712d31bb:::benchmark_data_smithi188_134454_object120769:head# 2024-04-01T19:48:46.803 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:712d950b:::benchmark_data_smithi188_134454_object138248:head# 2024-04-01T19:48:46.804 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:712dcc50:::benchmark_data_smithi188_134454_object130480:head# 2024-04-01T19:48:46.804 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71304f45:::benchmark_data_smithi188_134454_object129301:head# 2024-04-01T19:48:46.804 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7134853a:::benchmark_data_smithi188_134454_object155860:head# 2024-04-01T19:48:46.804 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71351758:::benchmark_data_smithi188_134454_object133010:head# 2024-04-01T19:48:46.804 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7138e769:::benchmark_data_smithi188_134454_object155236:head# 2024-04-01T19:48:46.805 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:713beef8:::benchmark_data_smithi188_134454_object135331:head# 2024-04-01T19:48:46.805 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:713df7f5:::benchmark_data_smithi188_134454_object153341:head# 2024-04-01T19:48:46.805 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:713e5b21:::benchmark_data_smithi188_134454_object129885:head# 2024-04-01T19:48:46.808 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:713eca36:::benchmark_data_smithi188_134454_object131922:head# 2024-04-01T19:48:46.808 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7146ca0c:::benchmark_data_smithi188_134454_object148229:head# 2024-04-01T19:48:46.809 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7148d9ee:::benchmark_data_smithi188_134454_object156127:head# 2024-04-01T19:48:46.809 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:714a40fc:::benchmark_data_smithi188_134454_object156250:head# 2024-04-01T19:48:46.809 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:714afb56:::benchmark_data_smithi188_134454_object152612:head# 2024-04-01T19:48:46.809 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:714b289d:::benchmark_data_smithi188_134454_object143128:head# 2024-04-01T19:48:46.809 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:714b797f:::benchmark_data_smithi188_134454_object142869:head# 2024-04-01T19:48:46.809 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:714ff66f:::benchmark_data_smithi188_134454_object134996:head# 2024-04-01T19:48:46.809 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71543feb:::benchmark_data_smithi188_134454_object127475:head# 2024-04-01T19:48:46.809 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:715644b1:::benchmark_data_smithi188_134454_object127868:head# 2024-04-01T19:48:46.809 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7157cd68:::benchmark_data_smithi188_134454_object154088:head# 2024-04-01T19:48:46.809 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:715b46ab:::benchmark_data_smithi188_134454_object124105:head# 2024-04-01T19:48:46.809 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:715d9f97:::benchmark_data_smithi188_134454_object146862:head# 2024-04-01T19:48:46.809 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:715dc946:::benchmark_data_smithi188_134454_object131397:head# 2024-04-01T19:48:46.809 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:715e65bb:::benchmark_data_smithi188_134454_object129963:head# 2024-04-01T19:48:46.810 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:715ecb1c:::benchmark_data_smithi188_134454_object137718:head# 2024-04-01T19:48:46.814 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71611909:::benchmark_data_smithi188_134454_object153948:head# 2024-04-01T19:48:46.814 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71634c5a:::benchmark_data_smithi188_134454_object125396:head# 2024-04-01T19:48:46.814 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71657cca:::benchmark_data_smithi188_134454_object115588:head# 2024-04-01T19:48:46.814 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7169af16:::benchmark_data_smithi188_134454_object151359:head# 2024-04-01T19:48:46.814 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:716ad216:::benchmark_data_smithi188_134454_object122842:head# 2024-04-01T19:48:46.814 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:716fe6f4:::benchmark_data_smithi188_134454_object143260:head# 2024-04-01T19:48:46.814 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7171585b:::benchmark_data_smithi188_134454_object143770:head# 2024-04-01T19:48:46.814 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71730b31:::benchmark_data_smithi188_134454_object136408:head# 2024-04-01T19:48:46.814 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:717363ce:::benchmark_data_smithi188_134454_object146992:head# 2024-04-01T19:48:46.815 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7174d00f:::benchmark_data_smithi188_134454_object130383:head# 2024-04-01T19:48:46.815 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71787f88:::benchmark_data_smithi188_134454_object127619:head# 2024-04-01T19:48:46.815 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7179094b:::benchmark_data_smithi188_134454_object138189:head# 2024-04-01T19:48:46.815 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:717af566:::benchmark_data_smithi188_134454_object143167:head# 2024-04-01T19:48:46.815 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:717c9a79:::benchmark_data_smithi188_134454_object135679:head# 2024-04-01T19:48:46.815 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:717cd6e1:::benchmark_data_smithi188_134454_object154429:head# 2024-04-01T19:48:46.815 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:717d63bd:::benchmark_data_smithi188_134454_object148441:head# 2024-04-01T19:48:46.815 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:717f3706:::benchmark_data_smithi188_134454_object127097:head# 2024-04-01T19:48:46.815 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:717fa6cf:::benchmark_data_smithi188_134454_object139815:head# 2024-04-01T19:48:46.815 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:718137c7:::benchmark_data_smithi188_134454_object125391:head# 2024-04-01T19:48:46.815 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7182dfe1:::benchmark_data_smithi188_134454_object120010:head# 2024-04-01T19:48:46.815 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7183cff2:::benchmark_data_smithi188_134454_object120992:head# 2024-04-01T19:48:46.815 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7187a4eb:::benchmark_data_smithi188_134454_object146196:head# 2024-04-01T19:48:46.815 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7189c447:::benchmark_data_smithi188_134454_object154746:head# 2024-04-01T19:48:46.816 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:718d70d1:::benchmark_data_smithi188_134454_object128673:head# 2024-04-01T19:48:46.816 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7190762f:::benchmark_data_smithi188_134454_object117003:head# 2024-04-01T19:48:46.816 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71914a16:::benchmark_data_smithi188_134454_object129200:head# 2024-04-01T19:48:46.817 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7191b120:::benchmark_data_smithi188_134454_object155474:head# 2024-04-01T19:48:46.817 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71933cf6:::benchmark_data_smithi188_134454_object156720:head# 2024-04-01T19:48:46.817 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7197bffb:::benchmark_data_smithi188_134454_object116743:head# 2024-04-01T19:48:46.817 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71991a3a:::benchmark_data_smithi188_134454_object146820:head# 2024-04-01T19:48:46.821 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:719b097b:::benchmark_data_smithi188_134454_object127108:head# 2024-04-01T19:48:46.821 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71a1e0ba:::benchmark_data_smithi188_134454_object128268:head# 2024-04-01T19:48:46.821 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71a3d1ef:::benchmark_data_smithi188_134454_object154905:head# 2024-04-01T19:48:46.821 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71a5a8b8:::benchmark_data_smithi188_134454_object124534:head# 2024-04-01T19:48:46.821 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71a693e0:::benchmark_data_smithi188_134454_object131480:head# 2024-04-01T19:48:46.821 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71a79faa:::benchmark_data_smithi188_134454_object135517:head# 2024-04-01T19:48:46.821 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71a865ac:::benchmark_data_smithi188_134454_object116841:head# 2024-04-01T19:48:46.821 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71a96477:::benchmark_data_smithi188_134454_object127584:head# 2024-04-01T19:48:46.821 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71a9b802:::benchmark_data_smithi188_134454_object132067:head# 2024-04-01T19:48:46.821 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71ade3f6:::benchmark_data_smithi188_134454_object141538:head# 2024-04-01T19:48:46.821 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71b1a6a9:::benchmark_data_smithi188_134454_object142077:head# 2024-04-01T19:48:46.821 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71b2d7fd:::benchmark_data_smithi188_134454_object131684:head# 2024-04-01T19:48:46.821 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71b546b6:::benchmark_data_smithi188_134454_object142355:head# 2024-04-01T19:48:46.822 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71bb5ffe:::benchmark_data_smithi188_134454_object121942:head# 2024-04-01T19:48:46.822 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71bbe8c8:::benchmark_data_smithi188_134454_object127056:head# 2024-04-01T19:48:46.822 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71bdbf51:::benchmark_data_smithi188_134454_object119183:head# 2024-04-01T19:48:46.823 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71bf5f93:::benchmark_data_smithi188_134454_object134813:head# 2024-04-01T19:48:46.827 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71bfcd86:::benchmark_data_smithi188_134454_object152750:head# 2024-04-01T19:48:46.828 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71c16e8e:::benchmark_data_smithi188_134454_object145231:head# 2024-04-01T19:48:46.828 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71c184c3:::benchmark_data_smithi188_134454_object142912:head# 2024-04-01T19:48:46.828 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71c1fcfb:::benchmark_data_smithi188_134454_object144166:head# 2024-04-01T19:48:46.828 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71c2d46b:::benchmark_data_smithi188_134454_object134616:head# 2024-04-01T19:48:46.829 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71c54ae2:::benchmark_data_smithi188_134454_object145963:head# 2024-04-01T19:48:46.829 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71c79f4c:::benchmark_data_smithi188_134454_object141267:head# 2024-04-01T19:48:46.829 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71c80133:::benchmark_data_smithi188_134454_object124470:head# 2024-04-01T19:48:46.829 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71c88b7d:::benchmark_data_smithi188_134454_object142238:head# 2024-04-01T19:48:46.830 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71cc6e55:::benchmark_data_smithi188_134454_object115382:head# 2024-04-01T19:48:46.830 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71cdae5a:::benchmark_data_smithi188_134454_object142998:head# 2024-04-01T19:48:46.830 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71d1c06a:::benchmark_data_smithi188_134454_object148315:head# 2024-04-01T19:48:46.830 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71d5067e:::benchmark_data_smithi188_134454_object116175:head# 2024-04-01T19:48:46.831 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71d5d4d4:::benchmark_data_smithi188_134454_object126878:head# 2024-04-01T19:48:46.831 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71d6136a:::benchmark_data_smithi188_134454_object122185:head# 2024-04-01T19:48:46.831 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71d61b08:::benchmark_data_smithi188_134454_object115861:head# 2024-04-01T19:48:46.831 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71d70e67:::benchmark_data_smithi188_134454_object127589:head# 2024-04-01T19:48:46.832 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71da25ce:::benchmark_data_smithi188_134454_object155339:head# 2024-04-01T19:48:46.832 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71dac46d:::benchmark_data_smithi188_134454_object128576:head# 2024-04-01T19:48:46.832 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71dad1d6:::benchmark_data_smithi188_134454_object126653:head# 2024-04-01T19:48:46.832 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71dc4eeb:::benchmark_data_smithi188_134454_object155746:head# 2024-04-01T19:48:46.832 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71ddf769:::benchmark_data_smithi188_134454_object148932:head# 2024-04-01T19:48:46.833 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71de8cee:::benchmark_data_smithi188_134454_object122464:head# 2024-04-01T19:48:46.833 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71e09cdb:::benchmark_data_smithi188_134454_object127685:head# 2024-04-01T19:48:46.833 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71e269b0:::benchmark_data_smithi188_134454_object150227:head# 2024-04-01T19:48:46.834 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71e64cae:::benchmark_data_smithi188_134454_object131045:head# 2024-04-01T19:48:46.834 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71e8fdec:::benchmark_data_smithi188_134454_object139138:head# 2024-04-01T19:48:46.834 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71e9289b:::benchmark_data_smithi188_134454_object149527:head# 2024-04-01T19:48:46.834 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71e9c326:::benchmark_data_smithi188_134454_object124813:head# 2024-04-01T19:48:46.834 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71eeb3a9:::benchmark_data_smithi188_134454_object115911:head# 2024-04-01T19:48:46.835 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71efa094:::benchmark_data_smithi188_134454_object150177:head# 2024-04-01T19:48:46.840 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71f00b03:::benchmark_data_smithi188_134454_object137015:head# 2024-04-01T19:48:46.840 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71f3f3d3:::benchmark_data_smithi188_134454_object146351:head# 2024-04-01T19:48:46.840 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71f42d3e:::benchmark_data_smithi188_134454_object145931:head# 2024-04-01T19:48:46.840 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71f5b1e2:::benchmark_data_smithi188_134454_object136137:head# 2024-04-01T19:48:46.840 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71f71ce1:::benchmark_data_smithi188_134454_object139853:head# 2024-04-01T19:48:46.840 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71f8091f:::benchmark_data_smithi188_134454_object121570:head# 2024-04-01T19:48:46.840 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71f8684a:::benchmark_data_smithi188_134454_object125182:head# 2024-04-01T19:48:46.840 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71f8ab94:::benchmark_data_smithi188_134454_object146741:head# 2024-04-01T19:48:46.841 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71f9844d:::benchmark_data_smithi188_134454_object116849:head# 2024-04-01T19:48:46.841 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71fc2f58:::benchmark_data_smithi188_134454_object153371:head# 2024-04-01T19:48:46.841 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:71fe06b1:::benchmark_data_smithi188_134454_object156393:head# 2024-04-01T19:48:46.841 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72024912:::benchmark_data_smithi188_134454_object123196:head# 2024-04-01T19:48:46.841 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7202968e:::benchmark_data_smithi188_134454_object150895:head# 2024-04-01T19:48:46.841 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7202a439:::benchmark_data_smithi188_134454_object151070:head# 2024-04-01T19:48:46.841 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7204a34f:::benchmark_data_smithi188_134454_object146645:head# 2024-04-01T19:48:46.841 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72066bcc:::benchmark_data_smithi188_134454_object145154:head# 2024-04-01T19:48:46.841 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:720906fa:::benchmark_data_smithi188_134454_object150665:head# 2024-04-01T19:48:46.841 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:720b423a:::benchmark_data_smithi188_134454_object115834:head# 2024-04-01T19:48:46.841 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:720e139b:::benchmark_data_smithi188_134454_object155815:head# 2024-04-01T19:48:46.841 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:720e51b0:::benchmark_data_smithi188_134454_object151346:head# 2024-04-01T19:48:46.841 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72107065:::benchmark_data_smithi188_134454_object133496:head# 2024-04-01T19:48:46.841 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7211dafd:::benchmark_data_smithi188_134454_object153099:head# 2024-04-01T19:48:46.842 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:721251fa:::benchmark_data_smithi188_134454_object125813:head# 2024-04-01T19:48:46.842 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72162f85:::benchmark_data_smithi188_134454_object125337:head# 2024-04-01T19:48:46.842 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7216aaa0:::benchmark_data_smithi188_134454_object136305:head# 2024-04-01T19:48:46.847 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7217023c:::benchmark_data_smithi188_134454_object136724:head# 2024-04-01T19:48:46.847 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:721715b8:::benchmark_data_smithi188_134454_object145527:head# 2024-04-01T19:48:46.847 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7218ff7b:::benchmark_data_smithi188_134454_object150517:head# 2024-04-01T19:48:46.847 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72197971:::benchmark_data_smithi188_134454_object122390:head# 2024-04-01T19:48:46.847 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:721b82e6:::benchmark_data_smithi188_134454_object153411:head# 2024-04-01T19:48:46.848 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:721c163f:::benchmark_data_smithi188_134454_object128927:head# 2024-04-01T19:48:46.848 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:721e64d5:::benchmark_data_smithi188_134454_object124359:head# 2024-04-01T19:48:46.848 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72217da2:::benchmark_data_smithi188_134454_object121897:head# 2024-04-01T19:48:46.848 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7222a285:::benchmark_data_smithi188_134454_object117074:head# 2024-04-01T19:48:46.848 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7222a5e6:::benchmark_data_smithi188_134454_object137715:head# 2024-04-01T19:48:46.848 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72245c21:::benchmark_data_smithi188_134454_object146007:head# 2024-04-01T19:48:46.848 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7227d692:::benchmark_data_smithi188_134454_object149619:head# 2024-04-01T19:48:46.848 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7229d0e9:::benchmark_data_smithi188_134454_object156236:head# 2024-04-01T19:48:46.848 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:722dfbe7:::benchmark_data_smithi188_134454_object144444:head# 2024-04-01T19:48:46.848 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:722ef12d:::benchmark_data_smithi188_134454_object129052:head# 2024-04-01T19:48:46.849 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:722f2ba6:::benchmark_data_smithi188_134454_object148696:head# 2024-04-01T19:48:46.849 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:722f8b3e:::benchmark_data_smithi188_134454_object145663:head# 2024-04-01T19:48:46.849 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7231fa5d:::benchmark_data_smithi188_134454_object120816:head# 2024-04-01T19:48:46.849 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72325ba2:::benchmark_data_smithi188_134454_object126276:head# 2024-04-01T19:48:46.850 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72332114:::benchmark_data_smithi188_134454_object129852:head# 2024-04-01T19:48:46.850 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72343e3a:::benchmark_data_smithi188_134454_object141979:head# 2024-04-01T19:48:46.850 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7235e291:::benchmark_data_smithi188_134454_object131372:head# 2024-04-01T19:48:46.854 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7237ae89:::benchmark_data_smithi188_134454_object140838:head# 2024-04-01T19:48:46.855 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7238da7b:::benchmark_data_smithi188_134454_object151528:head# 2024-04-01T19:48:46.870 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72399fd6:::benchmark_data_smithi188_134454_object119776:head# 2024-04-01T19:48:46.870 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7239a154:::benchmark_data_smithi188_134454_object145503:head# 2024-04-01T19:48:46.870 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7239e462:::benchmark_data_smithi188_134454_object152866:head# 2024-04-01T19:48:46.870 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:723b50ce:::benchmark_data_smithi188_134454_object115587:head# 2024-04-01T19:48:46.870 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:723b99bd:::benchmark_data_smithi188_134454_object133317:head# 2024-04-01T19:48:46.871 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:723c0aa0:::benchmark_data_smithi188_134454_object135305:head# 2024-04-01T19:48:46.871 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:723eaee9:::benchmark_data_smithi188_134454_object122444:head# 2024-04-01T19:48:46.871 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7241c502:::benchmark_data_smithi188_134454_object145750:head# 2024-04-01T19:48:46.871 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7242ce7d:::benchmark_data_smithi188_134454_object150179:head# 2024-04-01T19:48:46.871 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7245908a:::benchmark_data_smithi188_134454_object117315:head# 2024-04-01T19:48:46.871 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7249d174:::benchmark_data_smithi188_134454_object125901:head# 2024-04-01T19:48:46.871 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:724a737a:::benchmark_data_smithi188_134454_object151428:head# 2024-04-01T19:48:46.871 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:724ab67a:::benchmark_data_smithi188_134454_object154710:head# 2024-04-01T19:48:46.871 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:724b0a4a:::benchmark_data_smithi188_134454_object146249:head# 2024-04-01T19:48:46.871 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:724c1dff:::benchmark_data_smithi188_134454_object135776:head# 2024-04-01T19:48:46.871 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:724ed102:::benchmark_data_smithi188_134454_object117653:head# 2024-04-01T19:48:46.871 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:724f2d6b:::benchmark_data_smithi188_134454_object126972:head# 2024-04-01T19:48:46.871 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:724f68cd:::benchmark_data_smithi188_134454_object132732:head# 2024-04-01T19:48:46.871 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:724fb762:::benchmark_data_smithi188_134454_object136291:head# 2024-04-01T19:48:46.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72503fec:::benchmark_data_smithi188_134454_object126340:head# 2024-04-01T19:48:46.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:725135a6:::benchmark_data_smithi188_134454_object148563:head# 2024-04-01T19:48:46.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72528968:::benchmark_data_smithi188_134454_object148407:head# 2024-04-01T19:48:46.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7253ca32:::benchmark_data_smithi188_134454_object117148:head# 2024-04-01T19:48:46.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72594c51:::benchmark_data_smithi188_134454_object143215:head# 2024-04-01T19:48:46.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:725c62fa:::benchmark_data_smithi188_134454_object142129:head# 2024-04-01T19:48:46.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:725d1a28:::benchmark_data_smithi188_134454_object144925:head# 2024-04-01T19:48:46.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:725f53b1:::benchmark_data_smithi188_134454_object137672:head# 2024-04-01T19:48:46.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:725f5a1f:::benchmark_data_smithi188_134454_object115487:head# 2024-04-01T19:48:46.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72608818:::benchmark_data_smithi188_134454_object147189:head# 2024-04-01T19:48:46.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72608a5a:::benchmark_data_smithi188_134454_object155074:head# 2024-04-01T19:48:46.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:726186e5:::benchmark_data_smithi188_134454_object150613:head# 2024-04-01T19:48:46.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72629331:::benchmark_data_smithi188_134454_object136856:head# 2024-04-01T19:48:46.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7262e9ef:::benchmark_data_smithi188_134454_object125460:head# 2024-04-01T19:48:46.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7262ff32:::benchmark_data_smithi188_134454_object128762:head# 2024-04-01T19:48:46.873 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72636022:::benchmark_data_smithi188_134454_object152958:head# 2024-04-01T19:48:46.873 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7264f412:::benchmark_data_smithi188_134454_object116312:head# 2024-04-01T19:48:46.873 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:726862da:::benchmark_data_smithi188_134454_object140601:head# 2024-04-01T19:48:46.873 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:726d2f67:::benchmark_data_smithi188_134454_object118448:head# 2024-04-01T19:48:46.873 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:726e188b:::benchmark_data_smithi188_134454_object125387:head# 2024-04-01T19:48:46.874 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:726f04fb:::benchmark_data_smithi188_134454_object151660:head# 2024-04-01T19:48:46.874 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:727470d0:::benchmark_data_smithi188_134454_object133127:head# 2024-04-01T19:48:46.874 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:727485d1:::benchmark_data_smithi188_134454_object119762:head# 2024-04-01T19:48:46.875 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7275b3f5:::benchmark_data_smithi188_134454_object141624:head# 2024-04-01T19:48:46.875 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7278f921:::benchmark_data_smithi188_134454_object138972:head# 2024-04-01T19:48:46.875 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:727ae325:::benchmark_data_smithi188_134454_object124336:head# 2024-04-01T19:48:46.875 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:727b16b4:::benchmark_data_smithi188_134454_object120189:head# 2024-04-01T19:48:46.875 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:727dc58d:::benchmark_data_smithi188_134454_object134868:head# 2024-04-01T19:48:46.875 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:727e687e:::benchmark_data_smithi188_134454_object155069:head# 2024-04-01T19:48:46.875 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72806981:::benchmark_data_smithi188_134454_object139001:head# 2024-04-01T19:48:46.875 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7284d261:::benchmark_data_smithi188_134454_object142221:head# 2024-04-01T19:48:46.875 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7285e428:::benchmark_data_smithi188_134454_object128096:head# 2024-04-01T19:48:46.875 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7286594a:::benchmark_data_smithi188_134454_object132738:head# 2024-04-01T19:48:46.875 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7287ebc7:::benchmark_data_smithi188_134454_object120272:head# 2024-04-01T19:48:46.879 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72888b02:::benchmark_data_smithi188_134454_object141846:head# 2024-04-01T19:48:46.879 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:728b3f7e:::benchmark_data_smithi188_134454_object140968:head# 2024-04-01T19:48:46.879 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:728c5d97:::benchmark_data_smithi188_134454_object151506:head# 2024-04-01T19:48:46.879 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:728d195d:::benchmark_data_smithi188_134454_object132609:head# 2024-04-01T19:48:46.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:728d78a8:::benchmark_data_smithi188_134454_object127660:head# 2024-04-01T19:48:46.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:728e8f7c:::benchmark_data_smithi188_134454_object153114:head# 2024-04-01T19:48:46.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:728f402f:::benchmark_data_smithi188_134454_object139971:head# 2024-04-01T19:48:46.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:728fabe5:::benchmark_data_smithi188_134454_object122239:head# 2024-04-01T19:48:46.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:728fae35:::benchmark_data_smithi188_134454_object136808:head# 2024-04-01T19:48:46.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72910035:::benchmark_data_smithi188_134454_object123122:head# 2024-04-01T19:48:46.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7293a02b:::benchmark_data_smithi188_134454_object151241:head# 2024-04-01T19:48:46.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7295ce7c:::benchmark_data_smithi188_134454_object116585:head# 2024-04-01T19:48:46.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7297a1e0:::benchmark_data_smithi188_134454_object139375:head# 2024-04-01T19:48:46.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:729ba3fb:::benchmark_data_smithi188_134454_object128255:head# 2024-04-01T19:48:46.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:729bad83:::benchmark_data_smithi188_134454_object151891:head# 2024-04-01T19:48:46.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:729c1c0e:::benchmark_data_smithi188_134454_object141284:head# 2024-04-01T19:48:46.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:729c89e7:::benchmark_data_smithi188_134454_object152689:head# 2024-04-01T19:48:46.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:729cb7e8:::benchmark_data_smithi188_134454_object139311:head# 2024-04-01T19:48:46.881 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:729d1add:::benchmark_data_smithi188_134454_object127967:head# 2024-04-01T19:48:46.881 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:729dc587:::benchmark_data_smithi188_134454_object144175:head# 2024-04-01T19:48:46.881 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:729ea3aa:::benchmark_data_smithi188_134454_object147558:head# 2024-04-01T19:48:46.881 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:729fcf29:::benchmark_data_smithi188_134454_object140416:head# 2024-04-01T19:48:46.881 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72a25600:::benchmark_data_smithi188_134454_object149106:head# 2024-04-01T19:48:46.881 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72a2f11b:::benchmark_data_smithi188_134454_object140055:head# 2024-04-01T19:48:46.881 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72a3f979:::benchmark_data_smithi188_134454_object120342:head# 2024-04-01T19:48:46.881 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72a483c7:::benchmark_data_smithi188_134454_object134911:head# 2024-04-01T19:48:46.882 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72a831bd:::benchmark_data_smithi188_134454_object128588:head# 2024-04-01T19:48:46.882 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72aa0766:::benchmark_data_smithi188_134454_object135441:head# 2024-04-01T19:48:46.882 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72aaf4e8:::benchmark_data_smithi188_134454_object134263:head# 2024-04-01T19:48:46.882 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72ab1f06:::benchmark_data_smithi188_134454_object134644:head# 2024-04-01T19:48:46.884 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72ab6aca:::benchmark_data_smithi188_134454_object128154:head# 2024-04-01T19:48:46.884 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72ac0aa8:::benchmark_data_smithi188_134454_object154879:head# 2024-04-01T19:48:46.884 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72ada9e7:::benchmark_data_smithi188_134454_object142418:head# 2024-04-01T19:48:46.884 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72ae576d:::benchmark_data_smithi188_134454_object126133:head# 2024-04-01T19:48:46.884 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72b0b327:::benchmark_data_smithi188_134454_object139680:head# 2024-04-01T19:48:46.884 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72b1138c:::benchmark_data_smithi188_134454_object146384:head# 2024-04-01T19:48:46.884 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72b1994a:::benchmark_data_smithi188_134454_object152632:head# 2024-04-01T19:48:46.884 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72b53db0:::benchmark_data_smithi188_134454_object128681:head# 2024-04-01T19:48:46.884 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72b5c15f:::benchmark_data_smithi188_134454_object146582:head# 2024-04-01T19:48:46.886 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72b6a85e:::benchmark_data_smithi188_134454_object139434:head# 2024-04-01T19:48:46.886 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72b7673f:::benchmark_data_smithi188_134454_object124966:head# 2024-04-01T19:48:46.886 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72b956e4:::benchmark_data_smithi188_134454_object133217:head# 2024-04-01T19:48:46.886 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72ba27ca:::benchmark_data_smithi188_134454_object141152:head# 2024-04-01T19:48:46.886 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72bb6c95:::benchmark_data_smithi188_134454_object139002:head# 2024-04-01T19:48:46.887 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72bc0866:::benchmark_data_smithi188_134454_object151277:head# 2024-04-01T19:48:46.887 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72bd7e54:::benchmark_data_smithi188_134454_object121430:head# 2024-04-01T19:48:46.887 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72bd962d:::benchmark_data_smithi188_134454_object122193:head# 2024-04-01T19:48:46.889 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72c830fa:::benchmark_data_smithi188_134454_object135268:head# 2024-04-01T19:48:46.889 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72c8674d:::benchmark_data_smithi188_134454_object152156:head# 2024-04-01T19:48:46.889 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72c8cb16:::benchmark_data_smithi188_134454_object127642:head# 2024-04-01T19:48:46.889 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72c9dd53:::benchmark_data_smithi188_134454_object155056:head# 2024-04-01T19:48:46.890 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72cc09a9:::benchmark_data_smithi188_134454_object125298:head# 2024-04-01T19:48:46.890 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72cc5c9b:::benchmark_data_smithi188_134454_object116293:head# 2024-04-01T19:48:46.890 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72ccbd02:::benchmark_data_smithi188_134454_object122147:head# 2024-04-01T19:48:46.890 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72cd4684:::benchmark_data_smithi188_134454_object152298:head# 2024-04-01T19:48:46.890 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72d07997:::benchmark_data_smithi188_134454_object131047:head# 2024-04-01T19:48:46.890 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72d0f6e8:::benchmark_data_smithi188_134454_object126036:head# 2024-04-01T19:48:46.890 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72d17a33:::benchmark_data_smithi188_134454_object143609:head# 2024-04-01T19:48:46.890 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72d194b5:::benchmark_data_smithi188_134454_object122344:head# 2024-04-01T19:48:46.890 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72d1fca2:::benchmark_data_smithi188_134454_object138091:head# 2024-04-01T19:48:46.890 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72d65da5:::benchmark_data_smithi188_134454_object131952:head# 2024-04-01T19:48:46.891 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72db37aa:::benchmark_data_smithi188_134454_object124274:head# 2024-04-01T19:48:46.891 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72df6e3c:::benchmark_data_smithi188_134454_object147428:head# 2024-04-01T19:48:46.892 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72dfaafd:::benchmark_data_smithi188_134454_object115733:head# 2024-04-01T19:48:46.892 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72e00e03:::benchmark_data_smithi188_134454_object115400:head# 2024-04-01T19:48:46.892 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72e0e27a:::benchmark_data_smithi188_134454_object145398:head# 2024-04-01T19:48:46.892 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72e369b2:::benchmark_data_smithi188_134454_object119639:head# 2024-04-01T19:48:46.892 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72e5d417:::benchmark_data_smithi188_134454_object140881:head# 2024-04-01T19:48:46.893 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72e6acce:::benchmark_data_smithi188_134454_object154880:head# 2024-04-01T19:48:46.893 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72e74983:::benchmark_data_smithi188_134454_object119067:head# 2024-04-01T19:48:46.893 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72e7921c:::benchmark_data_smithi188_134454_object133082:head# 2024-04-01T19:48:46.893 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72e81949:::benchmark_data_smithi188_134454_object120909:head# 2024-04-01T19:48:46.894 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72ebaa01:::benchmark_data_smithi188_134454_object118529:head# 2024-04-01T19:48:46.894 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72ebba53:::benchmark_data_smithi188_134454_object130572:head# 2024-04-01T19:48:46.895 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72ed2fa0:::benchmark_data_smithi188_134454_object151796:head# 2024-04-01T19:48:46.895 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72ed5263:::benchmark_data_smithi188_134454_object116047:head# 2024-04-01T19:48:46.895 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72ef69cc:::benchmark_data_smithi188_134454_object147605:head# 2024-04-01T19:48:46.895 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72f0ee5f:::benchmark_data_smithi188_134454_object144003:head# 2024-04-01T19:48:46.895 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72f1577d:::benchmark_data_smithi188_134454_object148129:head# 2024-04-01T19:48:46.895 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72f2540b:::benchmark_data_smithi188_134454_object133372:head# 2024-04-01T19:48:46.896 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72f25d79:::benchmark_data_smithi188_134454_object136081:head# 2024-04-01T19:48:46.896 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72f37d41:::benchmark_data_smithi188_134454_object140939:head# 2024-04-01T19:48:46.896 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72f864e0:::benchmark_data_smithi188_134454_object122124:head# 2024-04-01T19:48:46.896 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72f8f9ee:::benchmark_data_smithi188_134454_object136010:head# 2024-04-01T19:48:46.896 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72fa3fcc:::benchmark_data_smithi188_134454_object143957:head# 2024-04-01T19:48:46.897 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72fb1d6a:::benchmark_data_smithi188_134454_object120742:head# 2024-04-01T19:48:46.897 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:72fe6fc1:::benchmark_data_smithi188_134454_object138783:head# 2024-04-01T19:48:46.897 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7300cfd6:::benchmark_data_smithi188_134454_object124765:head# 2024-04-01T19:48:46.897 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73027644:::benchmark_data_smithi188_134454_object135073:head# 2024-04-01T19:48:46.898 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:730373fd:::benchmark_data_smithi188_134454_object146912:head# 2024-04-01T19:48:46.898 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:730396f7:::benchmark_data_smithi188_134454_object132096:head# 2024-04-01T19:48:46.898 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7303becb:::benchmark_data_smithi188_134454_object145682:head# 2024-04-01T19:48:46.898 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73042844:::benchmark_data_smithi188_134454_object119861:head# 2024-04-01T19:48:46.898 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7304b10a:::benchmark_data_smithi188_134454_object143935:head# 2024-04-01T19:48:46.899 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7306524f:::benchmark_data_smithi188_134454_object134468:head# 2024-04-01T19:48:46.900 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:730a2243:::benchmark_data_smithi188_134454_object147070:head# 2024-04-01T19:48:46.900 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:730d92ee:::benchmark_data_smithi188_134454_object129250:head# 2024-04-01T19:48:46.900 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7310aee8:::benchmark_data_smithi188_134454_object126303:head# 2024-04-01T19:48:46.900 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73131b7b:::benchmark_data_smithi188_134454_object134122:head# 2024-04-01T19:48:46.900 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:731368d6:::benchmark_data_smithi188_134454_object126747:head# 2024-04-01T19:48:46.900 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:731369fd:::benchmark_data_smithi188_134454_object138757:head# 2024-04-01T19:48:46.900 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7314d070:::benchmark_data_smithi188_134454_object152121:head# 2024-04-01T19:48:46.901 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73173e79:::benchmark_data_smithi188_134454_object135148:head# 2024-04-01T19:48:46.901 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:731820fc:::benchmark_data_smithi188_134454_object128310:head# 2024-04-01T19:48:46.901 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:731c023f:::benchmark_data_smithi188_134454_object148591:head# 2024-04-01T19:48:46.901 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:731c68bb:::benchmark_data_smithi188_134454_object136911:head# 2024-04-01T19:48:46.906 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:731cce15:::benchmark_data_smithi188_134454_object121668:head# 2024-04-01T19:48:46.906 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:731df4b8:::benchmark_data_smithi188_134454_object131453:head# 2024-04-01T19:48:46.906 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:731f0f42:::benchmark_data_smithi188_134454_object139393:head# 2024-04-01T19:48:46.907 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:731fb084:::benchmark_data_smithi188_134454_object128740:head# 2024-04-01T19:48:46.907 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:731fc8e8:::benchmark_data_smithi188_134454_object123179:head# 2024-04-01T19:48:46.907 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7324c513:::benchmark_data_smithi188_134454_object124102:head# 2024-04-01T19:48:46.907 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7324cbf2:::benchmark_data_smithi188_134454_object118812:head# 2024-04-01T19:48:46.907 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73274c37:::benchmark_data_smithi188_134454_object134453:head# 2024-04-01T19:48:46.907 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73275926:::benchmark_data_smithi188_134454_object120459:head# 2024-04-01T19:48:46.907 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:732fd552:::benchmark_data_smithi188_134454_object121421:head# 2024-04-01T19:48:46.907 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7333a114:::benchmark_data_smithi188_134454_object123508:head# 2024-04-01T19:48:46.907 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73341553:::benchmark_data_smithi188_134454_object139408:head# 2024-04-01T19:48:46.907 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73342601:::benchmark_data_smithi188_134454_object136802:head# 2024-04-01T19:48:46.907 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7334d00c:::benchmark_data_smithi188_134454_object155515:head# 2024-04-01T19:48:46.907 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:733a7966:::benchmark_data_smithi188_134454_object145798:head# 2024-04-01T19:48:46.907 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:733a7fad:::benchmark_data_smithi188_134454_object154891:head# 2024-04-01T19:48:46.907 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:733bc459:::benchmark_data_smithi188_134454_object124899:head# 2024-04-01T19:48:46.908 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:733ced4a:::benchmark_data_smithi188_134454_object134961:head# 2024-04-01T19:48:46.908 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:733e0e55:::benchmark_data_smithi188_134454_object145030:head# 2024-04-01T19:48:46.908 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:733f83a5:::benchmark_data_smithi188_134454_object135397:head# 2024-04-01T19:48:46.908 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7342112a:::benchmark_data_smithi188_134454_object121641:head# 2024-04-01T19:48:46.908 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73428bed:::benchmark_data_smithi188_134454_object138989:head# 2024-04-01T19:48:46.908 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7345fbc1:::benchmark_data_smithi188_134454_object132308:head# 2024-04-01T19:48:46.908 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7346b3f7:::benchmark_data_smithi188_134454_object149378:head# 2024-04-01T19:48:46.908 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:734a9686:::benchmark_data_smithi188_134454_object118082:head# 2024-04-01T19:48:46.908 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:734cba67:::benchmark_data_smithi188_134454_object127152:head# 2024-04-01T19:48:46.908 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73503dc3:::benchmark_data_smithi188_134454_object130268:head# 2024-04-01T19:48:46.908 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73566a1d:::benchmark_data_smithi188_134454_object154291:head# 2024-04-01T19:48:46.912 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7357054d:::benchmark_data_smithi188_134454_object143404:head# 2024-04-01T19:48:46.912 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7357d383:::benchmark_data_smithi188_134454_object115576:head# 2024-04-01T19:48:46.912 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73593d5d:::benchmark_data_smithi188_134454_object133635:head# 2024-04-01T19:48:46.912 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:735a955f:::benchmark_data_smithi188_134454_object126885:head# 2024-04-01T19:48:46.912 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:735adaab:::benchmark_data_smithi188_134454_object116666:head# 2024-04-01T19:48:46.913 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:735c016a:::benchmark_data_smithi188_134454_object153951:head# 2024-04-01T19:48:46.913 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:735eb4ec:::benchmark_data_smithi188_134454_object133720:head# 2024-04-01T19:48:46.913 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:735f5d68:::benchmark_data_smithi188_134454_object147437:head# 2024-04-01T19:48:46.913 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7360ed72:::benchmark_data_smithi188_134454_object121759:head# 2024-04-01T19:48:46.913 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7362c393:::benchmark_data_smithi188_134454_object155650:head# 2024-04-01T19:48:46.913 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7362dd57:::benchmark_data_smithi188_134454_object129476:head# 2024-04-01T19:48:46.913 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:736406ad:::benchmark_data_smithi188_134454_object127454:head# 2024-04-01T19:48:46.913 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7366f97b:::benchmark_data_smithi188_134454_object146147:head# 2024-04-01T19:48:46.913 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7368adf2:::benchmark_data_smithi188_134454_object154068:head# 2024-04-01T19:48:46.913 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:736c0201:::benchmark_data_smithi188_134454_object138115:head# 2024-04-01T19:48:46.913 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:736e0ac0:::benchmark_data_smithi188_134454_object125318:head# 2024-04-01T19:48:46.913 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:736e5c19:::benchmark_data_smithi188_134454_object139569:head# 2024-04-01T19:48:46.913 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:736fa617:::benchmark_data_smithi188_134454_object135527:head# 2024-04-01T19:48:46.913 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73709da0:::benchmark_data_smithi188_134454_object141872:head# 2024-04-01T19:48:46.914 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:737349ff:::benchmark_data_smithi188_134454_object130127:head# 2024-04-01T19:48:46.914 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73764c20:::benchmark_data_smithi188_134454_object129233:head# 2024-04-01T19:48:46.914 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73805f9d:::benchmark_data_smithi188_134454_object143813:head# 2024-04-01T19:48:46.914 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73809267:::benchmark_data_smithi188_134454_object155984:head# 2024-04-01T19:48:46.914 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7383091c:::benchmark_data_smithi188_134454_object145854:head# 2024-04-01T19:48:46.914 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:738ba84b:::benchmark_data_smithi188_134454_object154222:head# 2024-04-01T19:48:46.914 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:738c5a68:::benchmark_data_smithi188_134454_object136407:head# 2024-04-01T19:48:46.914 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:738cd0a6:::benchmark_data_smithi188_134454_object150547:head# 2024-04-01T19:48:46.914 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:738ec42a:::benchmark_data_smithi188_134454_object120483:head# 2024-04-01T19:48:46.914 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:738f07fd:::benchmark_data_smithi188_134454_object151433:head# 2024-04-01T19:48:46.915 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:738f0966:::benchmark_data_smithi188_134454_object144242:head# 2024-04-01T19:48:46.915 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7390fed8:::benchmark_data_smithi188_134454_object122596:head# 2024-04-01T19:48:46.915 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7392a915:::benchmark_data_smithi188_134454_object140100:head# 2024-04-01T19:48:46.915 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73950177:::benchmark_data_smithi188_134454_object118528:head# 2024-04-01T19:48:46.915 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7395bf8b:::benchmark_data_smithi188_134454_object149058:head# 2024-04-01T19:48:46.916 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7397452c:::benchmark_data_smithi188_134454_object134672:head# 2024-04-01T19:48:46.916 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7397b7c5:::benchmark_data_smithi188_134454_object135909:head# 2024-04-01T19:48:46.916 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7397e30c:::benchmark_data_smithi188_134454_object155165:head# 2024-04-01T19:48:46.916 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:739a1c2d:::benchmark_data_smithi188_134454_object130246:head# 2024-04-01T19:48:46.916 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:739e5c9e:::benchmark_data_smithi188_134454_object147394:head# 2024-04-01T19:48:46.916 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:739f927c:::benchmark_data_smithi188_134454_object134143:head# 2024-04-01T19:48:46.917 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73a03fae:::benchmark_data_smithi188_134454_object134387:head# 2024-04-01T19:48:46.917 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73a083cb:::benchmark_data_smithi188_134454_object130294:head# 2024-04-01T19:48:46.917 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73a0f163:::benchmark_data_smithi188_134454_object124530:head# 2024-04-01T19:48:46.918 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73a1eacc:::benchmark_data_smithi188_134454_object121295:head# 2024-04-01T19:48:46.919 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73a21e28:::benchmark_data_smithi188_134454_object129015:head# 2024-04-01T19:48:46.919 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73a2fd6e:::benchmark_data_smithi188_134454_object123667:head# 2024-04-01T19:48:46.919 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73a53dad:::benchmark_data_smithi188_134454_object137089:head# 2024-04-01T19:48:46.919 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73aae790:::benchmark_data_smithi188_134454_object148106:head# 2024-04-01T19:48:46.919 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73adfc76:::benchmark_data_smithi188_134454_object125692:head# 2024-04-01T19:48:46.920 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73af14ca:::benchmark_data_smithi188_134454_object133357:head# 2024-04-01T19:48:46.920 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73af92f4:::benchmark_data_smithi188_134454_object126024:head# 2024-04-01T19:48:46.920 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73afef61:::benchmark_data_smithi188_134454_object138191:head# 2024-04-01T19:48:46.921 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73b02f16:::benchmark_data_smithi188_134454_object144485:head# 2024-04-01T19:48:46.921 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73b36f23:::benchmark_data_smithi188_134454_object140941:head# 2024-04-01T19:48:46.921 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73b3707d:::benchmark_data_smithi188_134454_object126283:head# 2024-04-01T19:48:46.921 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73b43b90:::benchmark_data_smithi188_134454_object140432:head# 2024-04-01T19:48:46.921 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73b6e09c:::benchmark_data_smithi188_134454_object125562:head# 2024-04-01T19:48:46.921 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73b984b6:::benchmark_data_smithi188_134454_object131483:head# 2024-04-01T19:48:46.922 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73ba0083:::benchmark_data_smithi188_134454_object132447:head# 2024-04-01T19:48:46.922 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73bb582d:::benchmark_data_smithi188_134454_object137389:head# 2024-04-01T19:48:46.922 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73bbdd85:::benchmark_data_smithi188_134454_object147302:head# 2024-04-01T19:48:46.922 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73bcd088:::benchmark_data_smithi188_134454_object121023:head# 2024-04-01T19:48:46.924 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73bd7c46:::benchmark_data_smithi188_134454_object153521:head# 2024-04-01T19:48:46.924 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73bf2b23:::benchmark_data_smithi188_134454_object153939:head# 2024-04-01T19:48:46.924 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73bf8996:::benchmark_data_smithi188_134454_object138090:head# 2024-04-01T19:48:46.924 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73c1513a:::benchmark_data_smithi188_134454_object122050:head# 2024-04-01T19:48:46.924 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73c317c4:::benchmark_data_smithi188_134454_object146740:head# 2024-04-01T19:48:46.924 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73c3c4e6:::benchmark_data_smithi188_134454_object138305:head# 2024-04-01T19:48:46.924 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73c61502:::benchmark_data_smithi188_134454_object134140:head# 2024-04-01T19:48:46.924 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73c6fe28:::benchmark_data_smithi188_134454_object135574:head# 2024-04-01T19:48:46.925 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73c714d0:::benchmark_data_smithi188_134454_object123741:head# 2024-04-01T19:48:46.926 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73c797df:::benchmark_data_smithi188_134454_object144304:head# 2024-04-01T19:48:46.926 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73c7f00f:::benchmark_data_smithi188_134454_object137186:head# 2024-04-01T19:48:46.927 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73c9f2ce:::benchmark_data_smithi188_134454_object147095:head# 2024-04-01T19:48:46.927 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73ca8528:::benchmark_data_smithi188_134454_object140787:head# 2024-04-01T19:48:46.927 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73cd7bf7:::benchmark_data_smithi188_134454_object134077:head# 2024-04-01T19:48:46.927 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73d22c59:::benchmark_data_smithi188_134454_object137328:head# 2024-04-01T19:48:46.927 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73d2740c:::benchmark_data_smithi188_134454_object123972:head# 2024-04-01T19:48:46.927 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73d4efb3:::benchmark_data_smithi188_134454_object126235:head# 2024-04-01T19:48:46.927 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73d587e9:::benchmark_data_smithi188_134454_object152032:head# 2024-04-01T19:48:46.927 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73d7a2c4:::benchmark_data_smithi188_134454_object147870:head# 2024-04-01T19:48:46.927 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73d8b140:::benchmark_data_smithi188_134454_object123532:head# 2024-04-01T19:48:46.927 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73db23f3:::benchmark_data_smithi188_134454_object134171:head# 2024-04-01T19:48:46.928 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73db73b7:::benchmark_data_smithi188_134454_object124039:head# 2024-04-01T19:48:46.928 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73e1d0fa:::benchmark_data_smithi188_134454_object125482:head# 2024-04-01T19:48:46.936 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73e3f4f0:::benchmark_data_smithi188_134454_object131595:head# 2024-04-01T19:48:46.936 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73e403f9:::benchmark_data_smithi188_134454_object146481:head# 2024-04-01T19:48:46.936 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73e536d1:::benchmark_data_smithi188_134454_object126589:head# 2024-04-01T19:48:46.936 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73e701a6:::benchmark_data_smithi188_134454_object138755:head# 2024-04-01T19:48:46.936 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73e854b1:::benchmark_data_smithi188_134454_object155393:head# 2024-04-01T19:48:46.936 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73e8942f:::benchmark_data_smithi188_134454_object137515:head# 2024-04-01T19:48:46.936 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73ea4ed2:::benchmark_data_smithi188_134454_object116132:head# 2024-04-01T19:48:46.936 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73ea5e55:::benchmark_data_smithi188_134454_object128889:head# 2024-04-01T19:48:46.936 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73eb7fc3:::benchmark_data_smithi188_134454_object130631:head# 2024-04-01T19:48:46.936 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73ec7a8d:::benchmark_data_smithi188_134454_object132505:head# 2024-04-01T19:48:46.936 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73f07705:::benchmark_data_smithi188_134454_object137898:head# 2024-04-01T19:48:46.936 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73f5450d:::benchmark_data_smithi188_134454_object144341:head# 2024-04-01T19:48:46.937 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73f65cc4:::benchmark_data_smithi188_134454_object121888:head# 2024-04-01T19:48:46.937 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73fa7613:::benchmark_data_smithi188_134454_object128747:head# 2024-04-01T19:48:46.937 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73faf29d:::benchmark_data_smithi188_134454_object145899:head# 2024-04-01T19:48:46.937 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73fb37f5:::benchmark_data_smithi188_134454_object115825:head# 2024-04-01T19:48:46.937 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73fd2e86:::benchmark_data_smithi188_134454_object136401:head# 2024-04-01T19:48:46.937 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73fd4d2c:::benchmark_data_smithi188_134454_object124926:head# 2024-04-01T19:48:46.937 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:73ff670d:::benchmark_data_smithi188_134454_object133288:head# 2024-04-01T19:48:46.937 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7400b085:::benchmark_data_smithi188_134454_object127400:head# 2024-04-01T19:48:46.937 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7401d86f:::benchmark_data_smithi188_134454_object139461:head# 2024-04-01T19:48:46.937 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7402e9fc:::benchmark_data_smithi188_134454_object153302:head# 2024-04-01T19:48:46.937 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7405e0ad:::benchmark_data_smithi188_134454_object134489:head# 2024-04-01T19:48:46.937 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:740c2b43:::benchmark_data_smithi188_134454_object144324:head# 2024-04-01T19:48:46.937 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:740cb7fd:::benchmark_data_smithi188_134454_object125536:head# 2024-04-01T19:48:46.937 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74104f48:::benchmark_data_smithi188_134454_object118369:head# 2024-04-01T19:48:46.938 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:741065ba:::benchmark_data_smithi188_134454_object154709:head# 2024-04-01T19:48:46.938 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7410a662:::benchmark_data_smithi188_134454_object134704:head# 2024-04-01T19:48:46.938 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7410de70:::benchmark_data_smithi188_134454_object127846:head# 2024-04-01T19:48:46.938 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7411d9c8:::benchmark_data_smithi188_134454_object152668:head# 2024-04-01T19:48:46.938 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7411da33:::benchmark_data_smithi188_134454_object138641:head# 2024-04-01T19:48:46.938 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:741221ae:::benchmark_data_smithi188_134454_object122651:head# 2024-04-01T19:48:46.938 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74138f2e:::benchmark_data_smithi188_134454_object155171:head# 2024-04-01T19:48:46.938 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7417dc19:::benchmark_data_smithi188_134454_object148316:head# 2024-04-01T19:48:46.938 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:741abe5b:::benchmark_data_smithi188_134454_object122940:head# 2024-04-01T19:48:46.938 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:741ff417:::benchmark_data_smithi188_134454_object115599:head# 2024-04-01T19:48:46.938 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74251c17:::benchmark_data_smithi188_134454_object154791:head# 2024-04-01T19:48:46.938 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7426a7c6:::benchmark_data_smithi188_134454_object141890:head# 2024-04-01T19:48:46.938 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:742897c1:::benchmark_data_smithi188_134454_object124234:head# 2024-04-01T19:48:46.939 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7428f43a:::benchmark_data_smithi188_134454_object125029:head# 2024-04-01T19:48:46.939 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:742a4411:::benchmark_data_smithi188_134454_object155548:head# 2024-04-01T19:48:46.939 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:742a5322:::benchmark_data_smithi188_134454_object147727:head# 2024-04-01T19:48:46.939 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:742bd1d3:::benchmark_data_smithi188_134454_object156210:head# 2024-04-01T19:48:46.939 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:742c560c:::benchmark_data_smithi188_134454_object154852:head# 2024-04-01T19:48:46.939 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:742c935c:::benchmark_data_smithi188_134454_object150848:head# 2024-04-01T19:48:46.939 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:742e854f:::benchmark_data_smithi188_134454_object130772:head# 2024-04-01T19:48:46.939 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:742f20f9:::benchmark_data_smithi188_134454_object130397:head# 2024-04-01T19:48:46.939 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74321cf8:::benchmark_data_smithi188_134454_object144933:head# 2024-04-01T19:48:46.941 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7432bf34:::benchmark_data_smithi188_134454_object123803:head# 2024-04-01T19:48:46.941 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74334502:::benchmark_data_smithi188_134454_object116286:head# 2024-04-01T19:48:46.941 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7433e28c:::benchmark_data_smithi188_134454_object117137:head# 2024-04-01T19:48:46.941 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7438ee3e:::benchmark_data_smithi188_134454_object125769:head# 2024-04-01T19:48:46.941 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7439c8b5:::benchmark_data_smithi188_134454_object139987:head# 2024-04-01T19:48:46.941 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:743a00a8:::benchmark_data_smithi188_134454_object153299:head# 2024-04-01T19:48:46.941 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:743a6b62:::benchmark_data_smithi188_134454_object143129:head# 2024-04-01T19:48:46.941 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:743c257b:::benchmark_data_smithi188_134454_object143605:head# 2024-04-01T19:48:46.941 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:743c99bb:::benchmark_data_smithi188_134454_object142959:head# 2024-04-01T19:48:46.941 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:743e2529:::benchmark_data_smithi188_134454_object118698:head# 2024-04-01T19:48:46.941 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:743ee378:::benchmark_data_smithi188_134454_object133820:head# 2024-04-01T19:48:46.941 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:743ef459:::benchmark_data_smithi188_134454_object116764:head# 2024-04-01T19:48:46.941 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:743fdba7:::benchmark_data_smithi188_134454_object148882:head# 2024-04-01T19:48:46.942 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:743ff3dc:::benchmark_data_smithi188_134454_object125366:head# 2024-04-01T19:48:46.942 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7444c53e:::benchmark_data_smithi188_134454_object144618:head# 2024-04-01T19:48:46.942 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7446d495:::benchmark_data_smithi188_134454_object135509:head# 2024-04-01T19:48:46.942 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74482dc0:::benchmark_data_smithi188_134454_object137040:head# 2024-04-01T19:48:46.946 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:744b4f40:::benchmark_data_smithi188_134454_object132110:head# 2024-04-01T19:48:46.946 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:744bae1e:::benchmark_data_smithi188_134454_object133726:head# 2024-04-01T19:48:46.946 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:744daa5c:::benchmark_data_smithi188_134454_object125521:head# 2024-04-01T19:48:46.946 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:744ec62b:::benchmark_data_smithi188_134454_object133564:head# 2024-04-01T19:48:46.946 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74500ba5:::benchmark_data_smithi188_134454_object133507:head# 2024-04-01T19:48:46.946 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7451214a:::benchmark_data_smithi188_134454_object133306:head# 2024-04-01T19:48:46.946 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7451af82:::benchmark_data_smithi188_134454_object127442:head# 2024-04-01T19:48:46.946 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74572f8e:::benchmark_data_smithi188_134454_object137223:head# 2024-04-01T19:48:46.947 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74573a0d:::benchmark_data_smithi188_134454_object154452:head# 2024-04-01T19:48:46.947 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74584f64:::benchmark_data_smithi188_134454_object128972:head# 2024-04-01T19:48:46.947 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:745884e8:::benchmark_data_smithi188_134454_object116755:head# 2024-04-01T19:48:46.947 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:745939db:::benchmark_data_smithi188_134454_object150982:head# 2024-04-01T19:48:46.947 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:745a3ae3:::benchmark_data_smithi188_134454_object124317:head# 2024-04-01T19:48:46.947 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:745b9083:::benchmark_data_smithi188_134454_object122763:head# 2024-04-01T19:48:46.947 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:745c3c04:::benchmark_data_smithi188_134454_object148909:head# 2024-04-01T19:48:46.947 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:745c6098:::benchmark_data_smithi188_134454_object150331:head# 2024-04-01T19:48:46.947 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74618e54:::benchmark_data_smithi188_134454_object139218:head# 2024-04-01T19:48:46.947 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7461df99:::benchmark_data_smithi188_134454_object136025:head# 2024-04-01T19:48:46.947 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7461fb1f:::benchmark_data_smithi188_134454_object121910:head# 2024-04-01T19:48:46.947 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74625952:::benchmark_data_smithi188_134454_object139258:head# 2024-04-01T19:48:46.947 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74625cce:::benchmark_data_smithi188_134454_object122800:head# 2024-04-01T19:48:46.947 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74633ac8:::benchmark_data_smithi188_134454_object117500:head# 2024-04-01T19:48:46.948 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74637256:::benchmark_data_smithi188_134454_object139045:head# 2024-04-01T19:48:46.948 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7463f5bd:::benchmark_data_smithi188_134454_object146586:head# 2024-04-01T19:48:46.948 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74640963:::benchmark_data_smithi188_134454_object121403:head# 2024-04-01T19:48:46.948 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:746417b4:::benchmark_data_smithi188_134454_object140893:head# 2024-04-01T19:48:46.948 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74687caa:::benchmark_data_smithi188_134454_object123678:head# 2024-04-01T19:48:46.949 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7469e95e:::benchmark_data_smithi188_134454_object133928:head# 2024-04-01T19:48:46.949 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:746d2187:::benchmark_data_smithi188_134454_object146930:head# 2024-04-01T19:48:46.949 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:746d222a:::benchmark_data_smithi188_134454_object123134:head# 2024-04-01T19:48:46.949 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:746fb3c9:::benchmark_data_smithi188_134454_object145151:head# 2024-04-01T19:48:46.949 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:746fbcf8:::benchmark_data_smithi188_134454_object126490:head# 2024-04-01T19:48:46.949 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74719391:::benchmark_data_smithi188_134454_object127953:head# 2024-04-01T19:48:46.949 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7471f152:::benchmark_data_smithi188_134454_object148487:head# 2024-04-01T19:48:46.950 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7474ce8a:::benchmark_data_smithi188_134454_object122421:head# 2024-04-01T19:48:46.950 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7475c57c:::benchmark_data_smithi188_134454_object120465:head# 2024-04-01T19:48:46.950 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74767720:::benchmark_data_smithi188_134454_object116061:head# 2024-04-01T19:48:46.950 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7478473d:::benchmark_data_smithi188_134454_object151442:head# 2024-04-01T19:48:46.950 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7479f4c4:::benchmark_data_smithi188_134454_object146557:head# 2024-04-01T19:48:46.950 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:747b0ffd:::benchmark_data_smithi188_134454_object140632:head# 2024-04-01T19:48:46.950 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:747d2b9f:::benchmark_data_smithi188_134454_object152255:head# 2024-04-01T19:48:46.951 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:747e17f0:::benchmark_data_smithi188_134454_object130527:head# 2024-04-01T19:48:46.951 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:747f53a0:::benchmark_data_smithi188_134454_object126629:head# 2024-04-01T19:48:46.951 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:747fb8f9:::benchmark_data_smithi188_134454_object145964:head# 2024-04-01T19:48:46.951 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:747fdcfe:::benchmark_data_smithi188_134454_object129934:head# 2024-04-01T19:48:46.952 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7481a59c:::benchmark_data_smithi188_134454_object149801:head# 2024-04-01T19:48:46.952 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7485631d:::benchmark_data_smithi188_134454_object145194:head# 2024-04-01T19:48:46.952 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7486d278:::benchmark_data_smithi188_134454_object127914:head# 2024-04-01T19:48:46.954 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7488b49f:::benchmark_data_smithi188_134454_object141425:head# 2024-04-01T19:48:46.955 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74898648:::benchmark_data_smithi188_134454_object117793:head# 2024-04-01T19:48:46.955 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7489db5f:::benchmark_data_smithi188_134454_object116380:head# 2024-04-01T19:48:46.955 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:748ac234:::benchmark_data_smithi188_134454_object142741:head# 2024-04-01T19:48:46.956 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:748c534e:::benchmark_data_smithi188_134454_object132500:head# 2024-04-01T19:48:46.956 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:748cb60a:::benchmark_data_smithi188_134454_object131754:head# 2024-04-01T19:48:46.956 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:748d15eb:::benchmark_data_smithi188_134454_object140014:head# 2024-04-01T19:48:46.956 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:748f6115:::benchmark_data_smithi188_134454_object152049:head# 2024-04-01T19:48:46.956 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7490b764:::benchmark_data_smithi188_134454_object132374:head# 2024-04-01T19:48:46.957 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7492edd2:::benchmark_data_smithi188_134454_object133296:head# 2024-04-01T19:48:46.957 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74933ad5:::benchmark_data_smithi188_134454_object154776:head# 2024-04-01T19:48:46.958 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74939abb:::benchmark_data_smithi188_134454_object140114:head# 2024-04-01T19:48:46.958 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7494db75:::benchmark_data_smithi188_134454_object116458:head# 2024-04-01T19:48:46.958 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7496e945:::benchmark_data_smithi188_134454_object130725:head# 2024-04-01T19:48:46.958 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7498f5ea:::benchmark_data_smithi188_134454_object139156:head# 2024-04-01T19:48:46.959 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7499cad5:::benchmark_data_smithi188_134454_object141945:head# 2024-04-01T19:48:46.959 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:749a5cd9:::benchmark_data_smithi188_134454_object119229:head# 2024-04-01T19:48:46.959 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:749aacbb:::benchmark_data_smithi188_134454_object148454:head# 2024-04-01T19:48:46.959 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:749ad2dc:::benchmark_data_smithi188_134454_object135412:head# 2024-04-01T19:48:46.959 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:749b2e2d:::benchmark_data_smithi188_134454_object116927:head# 2024-04-01T19:48:46.959 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:749cfaae:::benchmark_data_smithi188_134454_object144675:head# 2024-04-01T19:48:46.960 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:749e3e03:::benchmark_data_smithi188_134454_object134346:head# 2024-04-01T19:48:46.960 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74a125a7:::benchmark_data_smithi188_134454_object137240:head# 2024-04-01T19:48:46.960 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74a20e57:::benchmark_data_smithi188_134454_object119817:head# 2024-04-01T19:48:46.960 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74a3c5fc:::benchmark_data_smithi188_134454_object145269:head# 2024-04-01T19:48:46.960 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74a3e1dd:::benchmark_data_smithi188_134454_object129142:head# 2024-04-01T19:48:46.961 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74a47002:::benchmark_data_smithi188_134454_object145215:head# 2024-04-01T19:48:46.961 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74a474d8:::benchmark_data_smithi188_134454_object135166:head# 2024-04-01T19:48:46.961 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74a4a3db:::benchmark_data_smithi188_134454_object135600:head# 2024-04-01T19:48:46.961 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74a6377c:::benchmark_data_smithi188_134454_object147264:head# 2024-04-01T19:48:46.962 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74a6adfe:::benchmark_data_smithi188_134454_object134237:head# 2024-04-01T19:48:46.962 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74a7a4b8:::benchmark_data_smithi188_134454_object135655:head# 2024-04-01T19:48:46.963 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74a8e937:::benchmark_data_smithi188_134454_object146882:head# 2024-04-01T19:48:46.963 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74ad1161:::benchmark_data_smithi188_134454_object155587:head# 2024-04-01T19:48:46.963 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74aeb8fb:::benchmark_data_smithi188_134454_object117065:head# 2024-04-01T19:48:46.963 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74aec900:::benchmark_data_smithi188_134454_object116475:head# 2024-04-01T19:48:46.963 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74b33686:::benchmark_data_smithi188_134454_object154243:head# 2024-04-01T19:48:46.964 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74b7e25d:::benchmark_data_smithi188_134454_object146031:head# 2024-04-01T19:48:46.964 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74bae9ba:::benchmark_data_smithi188_134454_object135644:head# 2024-04-01T19:48:46.964 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74bcaf6f:::benchmark_data_smithi188_134454_object124074:head# 2024-04-01T19:48:46.964 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74be6c2b:::benchmark_data_smithi188_134454_object142134:head# 2024-04-01T19:48:46.964 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74bee9f0:::benchmark_data_smithi188_134454_object124457:head# 2024-04-01T19:48:46.965 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74bf8b36:::benchmark_data_smithi188_134454_object139846:head# 2024-04-01T19:48:46.965 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74c04625:::benchmark_data_smithi188_134454_object115506:head# 2024-04-01T19:48:46.965 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74c0ab5f:::benchmark_data_smithi188_134454_object156267:head# 2024-04-01T19:48:46.965 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74c1ef95:::benchmark_data_smithi188_134454_object137397:head# 2024-04-01T19:48:46.965 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74c29aa9:::benchmark_data_smithi188_134454_object129707:head# 2024-04-01T19:48:46.965 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74c8a9eb:::benchmark_data_smithi188_134454_object122954:head# 2024-04-01T19:48:46.965 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74ca23e6:::benchmark_data_smithi188_134454_object135025:head# 2024-04-01T19:48:46.965 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74cbe6f0:::benchmark_data_smithi188_134454_object128130:head# 2024-04-01T19:48:46.966 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74ccd31f:::benchmark_data_smithi188_134454_object127369:head# 2024-04-01T19:48:46.967 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74cd2302:::benchmark_data_smithi188_134454_object126840:head# 2024-04-01T19:48:46.967 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74cd7301:::benchmark_data_smithi188_134454_object151150:head# 2024-04-01T19:48:46.967 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74d1ff67:::benchmark_data_smithi188_134454_object141941:head# 2024-04-01T19:48:46.967 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74d42a6e:::benchmark_data_smithi188_134454_object128682:head# 2024-04-01T19:48:46.967 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74d480ab:::benchmark_data_smithi188_134454_object154101:head# 2024-04-01T19:48:46.967 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74d69fbc:::benchmark_data_smithi188_134454_object127748:head# 2024-04-01T19:48:46.967 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74d76cd8:::benchmark_data_smithi188_134454_object130823:head# 2024-04-01T19:48:46.967 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74d8ff32:::benchmark_data_smithi188_134454_object139911:head# 2024-04-01T19:48:46.968 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74da8bc8:::benchmark_data_smithi188_134454_object122666:head# 2024-04-01T19:48:46.968 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74da99e1:::benchmark_data_smithi188_134454_object120782:head# 2024-04-01T19:48:46.968 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74dab5ac:::benchmark_data_smithi188_134454_object153971:head# 2024-04-01T19:48:46.969 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74db8ce3:::benchmark_data_smithi188_134454_object153086:head# 2024-04-01T19:48:46.969 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74dcc251:::benchmark_data_smithi188_134454_object148406:head# 2024-04-01T19:48:46.969 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74dd97e6:::benchmark_data_smithi188_134454_object122435:head# 2024-04-01T19:48:46.969 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74dfbaec:::benchmark_data_smithi188_134454_object132853:head# 2024-04-01T19:48:46.969 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74e11715:::benchmark_data_smithi188_134454_object116048:head# 2024-04-01T19:48:46.970 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74e1798d:::benchmark_data_smithi188_134454_object127275:head# 2024-04-01T19:48:46.970 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74e3ace2:::benchmark_data_smithi188_134454_object155726:head# 2024-04-01T19:48:46.970 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74e68447:::benchmark_data_smithi188_134454_object150415:head# 2024-04-01T19:48:46.970 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74e6fbc0:::benchmark_data_smithi188_134454_object121791:head# 2024-04-01T19:48:46.970 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74e80cc9:::benchmark_data_smithi188_134454_object127035:head# 2024-04-01T19:48:46.970 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74e8965e:::benchmark_data_smithi188_134454_object143825:head# 2024-04-01T19:48:46.970 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74e96a65:::benchmark_data_smithi188_134454_object147657:head# 2024-04-01T19:48:46.971 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74ec3c0b:::benchmark_data_smithi188_134454_object139088:head# 2024-04-01T19:48:46.971 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74eccc63:::benchmark_data_smithi188_134454_object140891:head# 2024-04-01T19:48:46.972 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74ecdb59:::benchmark_data_smithi188_134454_object140244:head# 2024-04-01T19:48:46.972 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74ece279:::benchmark_data_smithi188_134454_object122134:head# 2024-04-01T19:48:46.972 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74ef22ef:::benchmark_data_smithi188_134454_object136414:head# 2024-04-01T19:48:46.972 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74f03cfa:::benchmark_data_smithi188_134454_object124542:head# 2024-04-01T19:48:46.972 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74f06c44:::benchmark_data_smithi188_134454_object142944:head# 2024-04-01T19:48:46.973 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74f09c8a:::benchmark_data_smithi188_134454_object126759:head# 2024-04-01T19:48:46.973 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74f28f56:::benchmark_data_smithi188_134454_object154417:head# 2024-04-01T19:48:46.973 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74f36533:::benchmark_data_smithi188_134454_object143033:head# 2024-04-01T19:48:46.973 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74f3ba0f:::benchmark_data_smithi188_134454_object130134:head# 2024-04-01T19:48:46.973 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74f600aa:::benchmark_data_smithi188_134454_object150634:head# 2024-04-01T19:48:46.973 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74f66178:::benchmark_data_smithi188_134454_object155012:head# 2024-04-01T19:48:46.976 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74f66b45:::benchmark_data_smithi188_134454_object152941:head# 2024-04-01T19:48:46.976 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74f88389:::benchmark_data_smithi188_134454_object121157:head# 2024-04-01T19:48:46.976 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74fbd969:::benchmark_data_smithi188_134454_object143363:head# 2024-04-01T19:48:46.976 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74fc50e3:::benchmark_data_smithi188_134454_object129350:head# 2024-04-01T19:48:46.976 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74fc7fc8:::benchmark_data_smithi188_134454_object125557:head# 2024-04-01T19:48:46.976 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74fcfa7f:::benchmark_data_smithi188_134454_object147365:head# 2024-04-01T19:48:46.976 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:74fe1ec0:::benchmark_data_smithi188_134454_object123107:head# 2024-04-01T19:48:46.976 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75020540:::benchmark_data_smithi188_134454_object124278:head# 2024-04-01T19:48:46.976 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75030ea3:::benchmark_data_smithi188_134454_object123155:head# 2024-04-01T19:48:46.976 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7503f285:::benchmark_data_smithi188_134454_object135625:head# 2024-04-01T19:48:46.976 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75040240:::benchmark_data_smithi188_134454_object130466:head# 2024-04-01T19:48:46.976 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7504795b:::benchmark_data_smithi188_134454_object118787:head# 2024-04-01T19:48:46.976 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7505be3a:::benchmark_data_smithi188_134454_object154856:head# 2024-04-01T19:48:46.977 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7506c0d5:::benchmark_data_smithi188_134454_object122958:head# 2024-04-01T19:48:46.979 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:750764c4:::benchmark_data_smithi188_134454_object136951:head# 2024-04-01T19:48:46.979 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75090482:::benchmark_data_smithi188_134454_object137987:head# 2024-04-01T19:48:46.979 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7509a121:::benchmark_data_smithi188_134454_object116053:head# 2024-04-01T19:48:46.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:750a3240:::benchmark_data_smithi188_134454_object139565:head# 2024-04-01T19:48:46.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:750d40e3:::benchmark_data_smithi188_134454_object117591:head# 2024-04-01T19:48:46.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:750daca1:::benchmark_data_smithi188_134454_object137071:head# 2024-04-01T19:48:46.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:750dd02d:::benchmark_data_smithi188_134454_object130869:head# 2024-04-01T19:48:46.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75127411:::benchmark_data_smithi188_134454_object136239:head# 2024-04-01T19:48:46.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75155761:::benchmark_data_smithi188_134454_object125776:head# 2024-04-01T19:48:46.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7516f206:::benchmark_data_smithi188_134454_object115934:head# 2024-04-01T19:48:46.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75191e1a:::benchmark_data_smithi188_134454_object124898:head# 2024-04-01T19:48:46.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7519ae89:::benchmark_data_smithi188_134454_object154731:head# 2024-04-01T19:48:46.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:751a19f2:::benchmark_data_smithi188_134454_object115570:head# 2024-04-01T19:48:46.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:751a3bfb:::benchmark_data_smithi188_134454_object131884:head# 2024-04-01T19:48:46.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:751a49af:::benchmark_data_smithi188_134454_object154048:head# 2024-04-01T19:48:46.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:751a9229:::benchmark_data_smithi188_134454_object138019:head# 2024-04-01T19:48:46.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:751ebb87:::benchmark_data_smithi188_134454_object155179:head# 2024-04-01T19:48:46.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:751fa640:::benchmark_data_smithi188_134454_object154712:head# 2024-04-01T19:48:46.981 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7522c993:::benchmark_data_smithi188_134454_object120678:head# 2024-04-01T19:48:46.981 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75232e01:::benchmark_data_smithi188_134454_object133149:head# 2024-04-01T19:48:46.981 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75240fcd:::benchmark_data_smithi188_134454_object119149:head# 2024-04-01T19:48:46.985 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75253549:::benchmark_data_smithi188_134454_object125946:head# 2024-04-01T19:48:46.986 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:752aa82f:::benchmark_data_smithi188_134454_object123520:head# 2024-04-01T19:48:46.987 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:752f5066:::benchmark_data_smithi188_134454_object144037:head# 2024-04-01T19:48:46.987 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:752f79b2:::benchmark_data_smithi188_134454_object126911:head# 2024-04-01T19:48:46.987 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7530e39e:::benchmark_data_smithi188_134454_object125451:head# 2024-04-01T19:48:46.987 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7532069a:::benchmark_data_smithi188_134454_object123908:head# 2024-04-01T19:48:46.987 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75345ddb:::benchmark_data_smithi188_134454_object149038:head# 2024-04-01T19:48:46.988 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7536a7d2:::benchmark_data_smithi188_134454_object118693:head# 2024-04-01T19:48:46.988 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75371ed5:::benchmark_data_smithi188_134454_object134165:head# 2024-04-01T19:48:46.988 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7537de1c:::benchmark_data_smithi188_134454_object150348:head# 2024-04-01T19:48:46.988 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7537e6e9:::benchmark_data_smithi188_134454_object136264:head# 2024-04-01T19:48:46.988 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7537e752:::benchmark_data_smithi188_134454_object126002:head# 2024-04-01T19:48:46.989 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75380f3c:::benchmark_data_smithi188_134454_object115656:head# 2024-04-01T19:48:46.989 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:753b7bcc:::benchmark_data_smithi188_134454_object118138:head# 2024-04-01T19:48:46.989 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:753dc20e:::benchmark_data_smithi188_134454_object117978:head# 2024-04-01T19:48:46.990 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:753dd5ee:::benchmark_data_smithi188_134454_object134906:head# 2024-04-01T19:48:46.990 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:753f9e2c:::benchmark_data_smithi188_134454_object127614:head# 2024-04-01T19:48:46.990 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7540eb37:::benchmark_data_smithi188_134454_object156053:head# 2024-04-01T19:48:46.990 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7544e2db:::benchmark_data_smithi188_134454_object154854:head# 2024-04-01T19:48:46.991 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:754653fa:::benchmark_data_smithi188_134454_object115497:head# 2024-04-01T19:48:46.991 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:754658ba:::benchmark_data_smithi188_134454_object121847:head# 2024-04-01T19:48:46.991 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7546ee8b:::benchmark_data_smithi188_134454_object139641:head# 2024-04-01T19:48:46.991 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:754ea719:::benchmark_data_smithi188_134454_object144580:head# 2024-04-01T19:48:46.991 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75502d53:::benchmark_data_smithi188_134454_object133401:head# 2024-04-01T19:48:46.993 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7552ecea:::benchmark_data_smithi188_134454_object144872:head# 2024-04-01T19:48:46.993 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:755a7a2d:::benchmark_data_smithi188_134454_object131674:head# 2024-04-01T19:48:46.993 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:755b79db:::benchmark_data_smithi188_134454_object138874:head# 2024-04-01T19:48:46.993 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:755b7d5c:::benchmark_data_smithi188_134454_object138932:head# 2024-04-01T19:48:46.993 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:755cdde0:::benchmark_data_smithi188_134454_object129710:head# 2024-04-01T19:48:46.993 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:755f80e3:::benchmark_data_smithi188_134454_object132580:head# 2024-04-01T19:48:46.993 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75617953:::benchmark_data_smithi188_134454_object145714:head# 2024-04-01T19:48:46.993 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7561853a:::benchmark_data_smithi188_134454_object115774:head# 2024-04-01T19:48:46.994 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7562da6b:::benchmark_data_smithi188_134454_object136474:head# 2024-04-01T19:48:46.995 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:756353b7:::benchmark_data_smithi188_134454_object144024:head# 2024-04-01T19:48:46.995 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75663ca3:::benchmark_data_smithi188_134454_object145988:head# 2024-04-01T19:48:46.995 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7567bca1:::benchmark_data_smithi188_134454_object125891:head# 2024-04-01T19:48:46.995 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:756804a6:::benchmark_data_smithi188_134454_object124568:head# 2024-04-01T19:48:46.995 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:756817b0:::benchmark_data_smithi188_134454_object146188:head# 2024-04-01T19:48:46.995 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:756b36cc:::benchmark_data_smithi188_134454_object155081:head# 2024-04-01T19:48:46.996 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:756b3f8a:::benchmark_data_smithi188_134454_object125067:head# 2024-04-01T19:48:46.996 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:756c5d98:::benchmark_data_smithi188_134454_object154103:head# 2024-04-01T19:48:46.996 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:756c7ab9:::benchmark_data_smithi188_134454_object129018:head# 2024-04-01T19:48:46.996 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:756de1eb:::benchmark_data_smithi188_134454_object118544:head# 2024-04-01T19:48:46.996 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:756f5ca9:::benchmark_data_smithi188_134454_object124589:head# 2024-04-01T19:48:46.997 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:757005b5:::benchmark_data_smithi188_134454_object119757:head# 2024-04-01T19:48:46.997 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75735383:::benchmark_data_smithi188_134454_object147105:head# 2024-04-01T19:48:46.997 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7578aa42:::benchmark_data_smithi188_134454_object142607:head# 2024-04-01T19:48:46.997 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75798211:::benchmark_data_smithi188_134454_object152959:head# 2024-04-01T19:48:46.997 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:757993fa:::benchmark_data_smithi188_134454_object153422:head# 2024-04-01T19:48:47.001 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7579dae0:::benchmark_data_smithi188_134454_object133868:head# 2024-04-01T19:48:47.001 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:757b7a4a:::benchmark_data_smithi188_134454_object132752:head# 2024-04-01T19:48:47.002 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:757df468:::benchmark_data_smithi188_134454_object132272:head# 2024-04-01T19:48:47.002 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:757e95d0:::benchmark_data_smithi188_134454_object121204:head# 2024-04-01T19:48:47.002 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:757feaf5:::benchmark_data_smithi188_134454_object135662:head# 2024-04-01T19:48:47.002 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75844c01:::benchmark_data_smithi188_134454_object139932:head# 2024-04-01T19:48:47.003 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7588f9ab:::benchmark_data_smithi188_134454_object144410:head# 2024-04-01T19:48:47.003 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:758adb30:::benchmark_data_smithi188_134454_object119725:head# 2024-04-01T19:48:47.003 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:758aef46:::benchmark_data_smithi188_134454_object132115:head# 2024-04-01T19:48:47.003 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:758c2d18:::benchmark_data_smithi188_134454_object156585:head# 2024-04-01T19:48:47.004 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:758e89c7:::benchmark_data_smithi188_134454_object117822:head# 2024-04-01T19:48:47.004 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:758fec82:::benchmark_data_smithi188_134454_object125227:head# 2024-04-01T19:48:47.004 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75906724:::benchmark_data_smithi188_134454_object147467:head# 2024-04-01T19:48:47.004 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:759150bf:::benchmark_data_smithi188_134454_object123808:head# 2024-04-01T19:48:47.004 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7591c8fc:::benchmark_data_smithi188_134454_object125148:head# 2024-04-01T19:48:47.005 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:759421e1:::benchmark_data_smithi188_134454_object153797:head# 2024-04-01T19:48:47.005 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7597a7c4:::benchmark_data_smithi188_134454_object149566:head# 2024-04-01T19:48:47.006 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:759d2ee2:::benchmark_data_smithi188_134454_object135193:head# 2024-04-01T19:48:47.009 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:759d658c:::benchmark_data_smithi188_134454_object120450:head# 2024-04-01T19:48:47.009 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:759ded60:::benchmark_data_smithi188_134454_object131012:head# 2024-04-01T19:48:47.009 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:759e6154:::benchmark_data_smithi188_134454_object140016:head# 2024-04-01T19:48:47.009 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:759fe164:::benchmark_data_smithi188_134454_object151805:head# 2024-04-01T19:48:47.009 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75a1adf8:::benchmark_data_smithi188_134454_object116652:head# 2024-04-01T19:48:47.009 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75a520a0:::benchmark_data_smithi188_134454_object154543:head# 2024-04-01T19:48:47.009 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75a5f1c9:::benchmark_data_smithi188_134454_object128774:head# 2024-04-01T19:48:47.009 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75ab1955:::benchmark_data_smithi188_134454_object134766:head# 2024-04-01T19:48:47.009 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75ab8faa:::benchmark_data_smithi188_134454_object125592:head# 2024-04-01T19:48:47.009 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75acae49:::benchmark_data_smithi188_134454_object156702:head# 2024-04-01T19:48:47.009 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75ae34d7:::benchmark_data_smithi188_134454_object118909:head# 2024-04-01T19:48:47.010 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75af7579:::benchmark_data_smithi188_134454_object142630:head# 2024-04-01T19:48:47.010 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75b21db3:::benchmark_data_smithi188_134454_object126688:head# 2024-04-01T19:48:47.011 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75b41be4:::benchmark_data_smithi188_134454_object130297:head# 2024-04-01T19:48:47.011 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75b4b106:::benchmark_data_smithi188_134454_object117883:head# 2024-04-01T19:48:47.011 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75b63760:::benchmark_data_smithi188_134454_object128876:head# 2024-04-01T19:48:47.011 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75bae730:::benchmark_data_smithi188_134454_object122163:head# 2024-04-01T19:48:47.011 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75bb7510:::benchmark_data_smithi188_134454_object150402:head# 2024-04-01T19:48:47.011 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75c064fa:::benchmark_data_smithi188_134454_object142380:head# 2024-04-01T19:48:47.011 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75c3441e:::benchmark_data_smithi188_134454_object116177:head# 2024-04-01T19:48:47.011 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75c39ab4:::benchmark_data_smithi188_134454_object120475:head# 2024-04-01T19:48:47.013 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75c60906:::benchmark_data_smithi188_134454_object156628:head# 2024-04-01T19:48:47.013 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75c62684:::benchmark_data_smithi188_134454_object122862:head# 2024-04-01T19:48:47.013 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75c7462f:::benchmark_data_smithi188_134454_object148863:head# 2024-04-01T19:48:47.013 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75c828d1:::benchmark_data_smithi188_134454_object123119:head# 2024-04-01T19:48:47.013 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75c9dbe2:::benchmark_data_smithi188_134454_object115802:head# 2024-04-01T19:48:47.013 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75ca3e11:::benchmark_data_smithi188_134454_object125781:head# 2024-04-01T19:48:47.013 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75ceac87:::benchmark_data_smithi188_134454_object138976:head# 2024-04-01T19:48:47.013 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75d1662c:::benchmark_data_smithi188_134454_object122075:head# 2024-04-01T19:48:47.014 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75d2a2b5:::benchmark_data_smithi188_134454_object142245:head# 2024-04-01T19:48:47.014 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75d3662d:::benchmark_data_smithi188_134454_object137246:head# 2024-04-01T19:48:47.015 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75d3c1b2:::benchmark_data_smithi188_134454_object149483:head# 2024-04-01T19:48:47.015 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75d690a8:::benchmark_data_smithi188_134454_object138323:head# 2024-04-01T19:48:47.015 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75d9bcef:::benchmark_data_smithi188_134454_object142393:head# 2024-04-01T19:48:47.015 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75da8b37:::benchmark_data_smithi188_134454_object120857:head# 2024-04-01T19:48:47.015 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75dbdacc:::benchmark_data_smithi188_134454_object119649:head# 2024-04-01T19:48:47.015 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75de0708:::benchmark_data_smithi188_134454_object152815:head# 2024-04-01T19:48:47.015 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75de778f:::benchmark_data_smithi188_134454_object144645:head# 2024-04-01T19:48:47.016 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75e1390f:::benchmark_data_smithi188_134454_object133030:head# 2024-04-01T19:48:47.016 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75e59bfe:::benchmark_data_smithi188_134454_object124604:head# 2024-04-01T19:48:47.017 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75e5c07d:::benchmark_data_smithi188_134454_object129501:head# 2024-04-01T19:48:47.017 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75e6cbb2:::benchmark_data_smithi188_134454_object125710:head# 2024-04-01T19:48:47.017 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75ec0890:::benchmark_data_smithi188_134454_object118588:head# 2024-04-01T19:48:47.018 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75ed70c8:::benchmark_data_smithi188_134454_object129521:head# 2024-04-01T19:48:47.018 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75eef6ae:::benchmark_data_smithi188_134454_object147585:head# 2024-04-01T19:48:47.018 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75efa1f2:::benchmark_data_smithi188_134454_object138995:head# 2024-04-01T19:48:47.018 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75f65bd7:::benchmark_data_smithi188_134454_object125321:head# 2024-04-01T19:48:47.018 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75f69bb8:::benchmark_data_smithi188_134454_object128219:head# 2024-04-01T19:48:47.018 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75f6c0e0:::benchmark_data_smithi188_134454_object144938:head# 2024-04-01T19:48:47.018 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75f6f112:::benchmark_data_smithi188_134454_object122986:head# 2024-04-01T19:48:47.018 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75f8c598:::benchmark_data_smithi188_134454_object140724:head# 2024-04-01T19:48:47.020 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75f8f536:::benchmark_data_smithi188_134454_object135767:head# 2024-04-01T19:48:47.020 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75f993f3:::benchmark_data_smithi188_134454_object118662:head# 2024-04-01T19:48:47.020 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75fa396d:::benchmark_data_smithi188_134454_object116423:head# 2024-04-01T19:48:47.020 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75fc427d:::benchmark_data_smithi188_134454_object151767:head# 2024-04-01T19:48:47.020 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75fd4d46:::benchmark_data_smithi188_134454_object148698:head# 2024-04-01T19:48:47.020 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75fd89d2:::benchmark_data_smithi188_134454_object119884:head# 2024-04-01T19:48:47.020 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75ff38a5:::benchmark_data_smithi188_134454_object139756:head# 2024-04-01T19:48:47.020 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:75ff66af:::benchmark_data_smithi188_134454_object146433:head# 2024-04-01T19:48:47.020 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76054dfe:::benchmark_data_smithi188_134454_object137243:head# 2024-04-01T19:48:47.020 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7605bf55:::benchmark_data_smithi188_134454_object133360:head# 2024-04-01T19:48:47.020 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76065fcb:::benchmark_data_smithi188_134454_object152290:head# 2024-04-01T19:48:47.021 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76066db6:::benchmark_data_smithi188_134454_object118180:head# 2024-04-01T19:48:47.022 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76074cfb:::benchmark_data_smithi188_134454_object135140:head# 2024-04-01T19:48:47.022 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:760817e8:::benchmark_data_smithi188_134454_object129123:head# 2024-04-01T19:48:47.022 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76089036:::benchmark_data_smithi188_134454_object147287:head# 2024-04-01T19:48:47.022 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:760922e5:::benchmark_data_smithi188_134454_object118780:head# 2024-04-01T19:48:47.022 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:760b6809:::benchmark_data_smithi188_134454_object140744:head# 2024-04-01T19:48:47.022 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:760c53e0:::benchmark_data_smithi188_134454_object124527:head# 2024-04-01T19:48:47.022 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:760d48de:::benchmark_data_smithi188_134454_object138211:head# 2024-04-01T19:48:47.023 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:760df997:::benchmark_data_smithi188_134454_object150048:head# 2024-04-01T19:48:47.023 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7610503f:::benchmark_data_smithi188_134454_object150905:head# 2024-04-01T19:48:47.023 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76108256:::benchmark_data_smithi188_134454_object131650:head# 2024-04-01T19:48:47.023 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76127234:::benchmark_data_smithi188_134454_object137177:head# 2024-04-01T19:48:47.027 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76132150:::benchmark_data_smithi188_134454_object145938:head# 2024-04-01T19:48:47.027 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76147122:::benchmark_data_smithi188_134454_object131178:head# 2024-04-01T19:48:47.027 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7616d65f:::benchmark_data_smithi188_134454_object127003:head# 2024-04-01T19:48:47.028 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7616e1e0:::benchmark_data_smithi188_134454_object143792:head# 2024-04-01T19:48:47.028 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76178c7e:::benchmark_data_smithi188_134454_object131229:head# 2024-04-01T19:48:47.028 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7617e4c8:::benchmark_data_smithi188_134454_object142724:head# 2024-04-01T19:48:47.028 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76198df9:::benchmark_data_smithi188_134454_object128605:head# 2024-04-01T19:48:47.028 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:761a61c9:::benchmark_data_smithi188_134454_object116826:head# 2024-04-01T19:48:47.028 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76226443:::benchmark_data_smithi188_134454_object153057:head# 2024-04-01T19:48:47.028 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76227b74:::benchmark_data_smithi188_134454_object118722:head# 2024-04-01T19:48:47.028 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7622e608:::benchmark_data_smithi188_134454_object149524:head# 2024-04-01T19:48:47.028 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76237f05:::benchmark_data_smithi188_134454_object126495:head# 2024-04-01T19:48:47.028 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76248d5e:::benchmark_data_smithi188_134454_object118233:head# 2024-04-01T19:48:47.028 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7624e351:::benchmark_data_smithi188_134454_object148059:head# 2024-04-01T19:48:47.030 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:762924c6:::benchmark_data_smithi188_134454_object136292:head# 2024-04-01T19:48:47.030 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7629564d:::benchmark_data_smithi188_134454_object117525:head# 2024-04-01T19:48:47.031 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:762a95fc:::benchmark_data_smithi188_134454_object116358:head# 2024-04-01T19:48:47.031 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:762b1a89:::benchmark_data_smithi188_134454_object119713:head# 2024-04-01T19:48:47.031 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:762c9ecc:::benchmark_data_smithi188_134454_object155807:head# 2024-04-01T19:48:47.031 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:762db681:::benchmark_data_smithi188_134454_object149031:head# 2024-04-01T19:48:47.031 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:762e6f3d:::benchmark_data_smithi188_134454_object147355:head# 2024-04-01T19:48:47.032 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:762eda6b:::benchmark_data_smithi188_134454_object116025:head# 2024-04-01T19:48:47.032 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:762f1101:::benchmark_data_smithi188_134454_object126830:head# 2024-04-01T19:48:47.032 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76310212:::benchmark_data_smithi188_134454_object145233:head# 2024-04-01T19:48:47.032 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7633dcea:::benchmark_data_smithi188_134454_object131321:head# 2024-04-01T19:48:47.034 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76343cb4:::benchmark_data_smithi188_134454_object142963:head# 2024-04-01T19:48:47.034 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7634a245:::benchmark_data_smithi188_134454_object154714:head# 2024-04-01T19:48:47.034 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7635a529:::benchmark_data_smithi188_134454_object145612:head# 2024-04-01T19:48:47.034 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7637760a:::benchmark_data_smithi188_134454_object130200:head# 2024-04-01T19:48:47.034 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76378ff3:::benchmark_data_smithi188_134454_object125481:head# 2024-04-01T19:48:47.034 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:763a3893:::benchmark_data_smithi188_134454_object137699:head# 2024-04-01T19:48:47.034 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:763a7a71:::benchmark_data_smithi188_134454_object140489:head# 2024-04-01T19:48:47.036 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:763b1ad0:::benchmark_data_smithi188_134454_object119934:head# 2024-04-01T19:48:47.038 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:763c430c:::benchmark_data_smithi188_134454_object155480:head# 2024-04-01T19:48:47.038 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:763d6e2b:::benchmark_data_smithi188_134454_object142685:head# 2024-04-01T19:48:47.039 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:763dad94:::benchmark_data_smithi188_134454_object137692:head# 2024-04-01T19:48:47.039 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:763dd634:::benchmark_data_smithi188_134454_object121574:head# 2024-04-01T19:48:47.039 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:763df741:::benchmark_data_smithi188_134454_object147332:head# 2024-04-01T19:48:47.039 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76406f88:::benchmark_data_smithi188_134454_object148054:head# 2024-04-01T19:48:47.040 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7643793f:::benchmark_data_smithi188_134454_object134949:head# 2024-04-01T19:48:47.040 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7643f1b6:::benchmark_data_smithi188_134454_object140247:head# 2024-04-01T19:48:47.040 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7644fa1d:::benchmark_data_smithi188_134454_object131963:head# 2024-04-01T19:48:47.040 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:764653e1:::benchmark_data_smithi188_134454_object115520:head# 2024-04-01T19:48:47.041 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76466006:::benchmark_data_smithi188_134454_object150719:head# 2024-04-01T19:48:47.041 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7646c60d:::benchmark_data_smithi188_134454_object139065:head# 2024-04-01T19:48:47.041 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76492d59:::benchmark_data_smithi188_134454_object143743:head# 2024-04-01T19:48:47.041 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:764a9476:::benchmark_data_smithi188_134454_object137667:head# 2024-04-01T19:48:47.041 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:764b0bb2:::benchmark_data_smithi188_134454_object140399:head# 2024-04-01T19:48:47.042 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:764b548f:::benchmark_data_smithi188_134454_object141048:head# 2024-04-01T19:48:47.043 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:764c9211:::benchmark_data_smithi188_134454_object150254:head# 2024-04-01T19:48:47.043 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:764ca32e:::benchmark_data_smithi188_134454_object139033:head# 2024-04-01T19:48:47.043 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:764fa6e2:::benchmark_data_smithi188_134454_object116395:head# 2024-04-01T19:48:47.043 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:765086b8:::benchmark_data_smithi188_134454_object147734:head# 2024-04-01T19:48:47.043 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76515622:::benchmark_data_smithi188_134454_object127264:head# 2024-04-01T19:48:47.043 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7651d25e:::benchmark_data_smithi188_134454_object136095:head# 2024-04-01T19:48:47.043 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7652cc10:::benchmark_data_smithi188_134454_object119656:head# 2024-04-01T19:48:47.044 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7655ea52:::benchmark_data_smithi188_134454_object137551:head# 2024-04-01T19:48:47.044 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:765bf2cd:::benchmark_data_smithi188_134454_object130175:head# 2024-04-01T19:48:47.044 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:765d0254:::benchmark_data_smithi188_134454_object149395:head# 2024-04-01T19:48:47.045 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:765ef7ae:::benchmark_data_smithi188_134454_object130252:head# 2024-04-01T19:48:47.045 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:765f3fc6:::benchmark_data_smithi188_134454_object118865:head# 2024-04-01T19:48:47.045 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:765fd09c:::benchmark_data_smithi188_134454_object126973:head# 2024-04-01T19:48:47.045 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76625d8b:::benchmark_data_smithi188_134454_object147120:head# 2024-04-01T19:48:47.046 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76633182:::benchmark_data_smithi188_134454_object129342:head# 2024-04-01T19:48:47.046 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:766538ee:::benchmark_data_smithi188_134454_object123161:head# 2024-04-01T19:48:47.046 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76665c31:::benchmark_data_smithi188_134454_object115972:head# 2024-04-01T19:48:47.046 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76666679:::benchmark_data_smithi188_134454_object147654:head# 2024-04-01T19:48:47.046 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7666cd23:::benchmark_data_smithi188_134454_object145777:head# 2024-04-01T19:48:47.050 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7666d1bd:::benchmark_data_smithi188_134454_object149168:head# 2024-04-01T19:48:47.050 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7666e995:::benchmark_data_smithi188_134454_object117346:head# 2024-04-01T19:48:47.051 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76676871:::benchmark_data_smithi188_134454_object152914:head# 2024-04-01T19:48:47.051 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7667d08f:::benchmark_data_smithi188_134454_object133452:head# 2024-04-01T19:48:47.051 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76681f55:::benchmark_data_smithi188_134454_object138802:head# 2024-04-01T19:48:47.051 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:766a4695:::benchmark_data_smithi188_134454_object145526:head# 2024-04-01T19:48:47.052 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:766c18e4:::benchmark_data_smithi188_134454_object150043:head# 2024-04-01T19:48:47.052 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:766e6029:::benchmark_data_smithi188_134454_object139672:head# 2024-04-01T19:48:47.052 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:766e62be:::benchmark_data_smithi188_134454_object141531:head# 2024-04-01T19:48:47.053 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:766f1ccf:::benchmark_data_smithi188_134454_object147301:head# 2024-04-01T19:48:47.053 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76717088:::benchmark_data_smithi188_134454_object149529:head# 2024-04-01T19:48:47.053 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76727c5c:::benchmark_data_smithi188_134454_object122309:head# 2024-04-01T19:48:47.054 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7673ecbe:::benchmark_data_smithi188_134454_object152749:head# 2024-04-01T19:48:47.054 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76740051:::benchmark_data_smithi188_134454_object125849:head# 2024-04-01T19:48:47.054 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7674045a:::benchmark_data_smithi188_134454_object146601:head# 2024-04-01T19:48:47.054 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7678eff0:::benchmark_data_smithi188_134454_object142643:head# 2024-04-01T19:48:47.054 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7679114d:::benchmark_data_smithi188_134454_object122824:head# 2024-04-01T19:48:47.054 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76798efe:::benchmark_data_smithi188_134454_object136299:head# 2024-04-01T19:48:47.056 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:767aa68d:::benchmark_data_smithi188_134454_object117031:head# 2024-04-01T19:48:47.056 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:767aea5b:::benchmark_data_smithi188_134454_object119953:head# 2024-04-01T19:48:47.056 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:767f0996:::benchmark_data_smithi188_134454_object119338:head# 2024-04-01T19:48:47.056 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:767f578f:::benchmark_data_smithi188_134454_object129758:head# 2024-04-01T19:48:47.056 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76852849:::benchmark_data_smithi188_134454_object125121:head# 2024-04-01T19:48:47.056 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76859078:::benchmark_data_smithi188_134454_object140299:head# 2024-04-01T19:48:47.056 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76865a1d:::benchmark_data_smithi188_134454_object122854:head# 2024-04-01T19:48:47.056 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7687ea9c:::benchmark_data_smithi188_134454_object120309:head# 2024-04-01T19:48:47.056 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7687fba6:::benchmark_data_smithi188_134454_object140566:head# 2024-04-01T19:48:47.056 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76882be1:::benchmark_data_smithi188_134454_object128381:head# 2024-04-01T19:48:47.057 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:768d5750:::benchmark_data_smithi188_134454_object137464:head# 2024-04-01T19:48:47.058 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7692544c:::benchmark_data_smithi188_134454_object130862:head# 2024-04-01T19:48:47.058 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7693088e:::benchmark_data_smithi188_134454_object136033:head# 2024-04-01T19:48:47.058 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76945600:::benchmark_data_smithi188_134454_object138244:head# 2024-04-01T19:48:47.058 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7694ac17:::benchmark_data_smithi188_134454_object121201:head# 2024-04-01T19:48:47.058 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76968a41:::benchmark_data_smithi188_134454_object146160:head# 2024-04-01T19:48:47.058 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76973c4b:::benchmark_data_smithi188_134454_object119339:head# 2024-04-01T19:48:47.058 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76981dde:::benchmark_data_smithi188_134454_object148430:head# 2024-04-01T19:48:47.062 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:769930dd:::benchmark_data_smithi188_134454_object149738:head# 2024-04-01T19:48:47.062 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:769a6b89:::benchmark_data_smithi188_134454_object133101:head# 2024-04-01T19:48:47.062 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:769b39ac:::benchmark_data_smithi188_134454_object142723:head# 2024-04-01T19:48:47.062 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:769b6974:::benchmark_data_smithi188_134454_object123854:head# 2024-04-01T19:48:47.062 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:769c64d7:::benchmark_data_smithi188_134454_object155370:head# 2024-04-01T19:48:47.062 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:769cc4bc:::benchmark_data_smithi188_134454_object132669:head# 2024-04-01T19:48:47.062 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:769db433:::benchmark_data_smithi188_134454_object144595:head# 2024-04-01T19:48:47.062 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76a1bb5f:::benchmark_data_smithi188_134454_object129892:head# 2024-04-01T19:48:47.062 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76a89c83:::benchmark_data_smithi188_134454_object153042:head# 2024-04-01T19:48:47.062 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76aa4605:::benchmark_data_smithi188_134454_object148238:head# 2024-04-01T19:48:47.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76b0a420:::benchmark_data_smithi188_134454_object119330:head# 2024-04-01T19:48:47.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76b0c630:::benchmark_data_smithi188_134454_object116332:head# 2024-04-01T19:48:47.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76b14a39:::benchmark_data_smithi188_134454_object116456:head# 2024-04-01T19:48:47.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76b14a7a:::benchmark_data_smithi188_134454_object156248:head# 2024-04-01T19:48:47.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76b3261f:::benchmark_data_smithi188_134454_object138528:head# 2024-04-01T19:48:47.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76b37dff:::benchmark_data_smithi188_134454_object155912:head# 2024-04-01T19:48:47.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76b9bcaf:::benchmark_data_smithi188_134454_object135287:head# 2024-04-01T19:48:47.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76bc0ce2:::benchmark_data_smithi188_134454_object147554:head# 2024-04-01T19:48:47.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76bc5e28:::benchmark_data_smithi188_134454_object152867:head# 2024-04-01T19:48:47.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76bd53e7:::benchmark_data_smithi188_134454_object149382:head# 2024-04-01T19:48:47.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76bdd8b6:::benchmark_data_smithi188_134454_object147337:head# 2024-04-01T19:48:47.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76c3d2ef:::benchmark_data_smithi188_134454_object133430:head# 2024-04-01T19:48:47.064 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76c526b8:::benchmark_data_smithi188_134454_object155106:head# 2024-04-01T19:48:47.064 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76c561c4:::benchmark_data_smithi188_134454_object132762:head# 2024-04-01T19:48:47.064 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76c61e25:::benchmark_data_smithi188_134454_object116506:head# 2024-04-01T19:48:47.064 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76c73860:::benchmark_data_smithi188_134454_object115860:head# 2024-04-01T19:48:47.064 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76c8bbf2:::benchmark_data_smithi188_134454_object147899:head# 2024-04-01T19:48:47.065 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76c8d2df:::benchmark_data_smithi188_134454_object127393:head# 2024-04-01T19:48:47.065 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76c9e15b:::benchmark_data_smithi188_134454_object150044:head# 2024-04-01T19:48:47.065 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76caa3dc:::benchmark_data_smithi188_134454_object136238:head# 2024-04-01T19:48:47.065 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76cc53c0:::benchmark_data_smithi188_134454_object119139:head# 2024-04-01T19:48:47.065 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76cc6571:::benchmark_data_smithi188_134454_object137673:head# 2024-04-01T19:48:47.065 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76cc85fb:::benchmark_data_smithi188_134454_object136069:head# 2024-04-01T19:48:47.066 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76cf7931:::benchmark_data_smithi188_134454_object144107:head# 2024-04-01T19:48:47.066 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76d3f4c9:::benchmark_data_smithi188_134454_object119510:head# 2024-04-01T19:48:47.067 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76d6f87d:::benchmark_data_smithi188_134454_object140935:head# 2024-04-01T19:48:47.067 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76d7e785:::benchmark_data_smithi188_134454_object128885:head# 2024-04-01T19:48:47.067 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76d9177b:::benchmark_data_smithi188_134454_object146611:head# 2024-04-01T19:48:47.067 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76d9bf03:::benchmark_data_smithi188_134454_object124682:head# 2024-04-01T19:48:47.067 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76da07d6:::benchmark_data_smithi188_134454_object152138:head# 2024-04-01T19:48:47.067 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76dbb4e4:::benchmark_data_smithi188_134454_object141373:head# 2024-04-01T19:48:47.067 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76dfa730:::benchmark_data_smithi188_134454_object147509:head# 2024-04-01T19:48:47.067 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76e0ed9e:::benchmark_data_smithi188_134454_object122672:head# 2024-04-01T19:48:47.067 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76e184f1:::benchmark_data_smithi188_134454_object140245:head# 2024-04-01T19:48:47.069 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76e76031:::benchmark_data_smithi188_134454_object123899:head# 2024-04-01T19:48:47.069 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76e82aa9:::benchmark_data_smithi188_134454_object140832:head# 2024-04-01T19:48:47.069 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76eb097e:::benchmark_data_smithi188_134454_object149966:head# 2024-04-01T19:48:47.069 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76ebc338:::benchmark_data_smithi188_134454_object152601:head# 2024-04-01T19:48:47.069 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76ec3fc3:::benchmark_data_smithi188_134454_object127190:head# 2024-04-01T19:48:47.069 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76ec89c8:::benchmark_data_smithi188_134454_object127763:head# 2024-04-01T19:48:47.069 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76ecb16e:::benchmark_data_smithi188_134454_object142866:head# 2024-04-01T19:48:47.069 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76ed1f9a:::benchmark_data_smithi188_134454_object133361:head# 2024-04-01T19:48:47.069 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76edb71f:::benchmark_data_smithi188_134454_object146022:head# 2024-04-01T19:48:47.070 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76ef63e6:::benchmark_data_smithi188_134454_object120118:head# 2024-04-01T19:48:47.070 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76f168ce:::benchmark_data_smithi188_134454_object153858:head# 2024-04-01T19:48:47.070 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76f20639:::benchmark_data_smithi188_134454_object115935:head# 2024-04-01T19:48:47.071 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76f4ebc3:::benchmark_data_smithi188_134454_object131208:head# 2024-04-01T19:48:47.071 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76f7e081:::benchmark_data_smithi188_134454_object126198:head# 2024-04-01T19:48:47.071 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76f8fa7f:::benchmark_data_smithi188_134454_object144139:head# 2024-04-01T19:48:47.072 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76faa846:::benchmark_data_smithi188_134454_object131670:head# 2024-04-01T19:48:47.072 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:76fabb9c:::benchmark_data_smithi188_134454_object145439:head# 2024-04-01T19:48:47.072 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7700ce9a:::benchmark_data_smithi188_134454_object152098:head# 2024-04-01T19:48:47.076 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:770914e0:::benchmark_data_smithi188_134454_object149001:head# 2024-04-01T19:48:47.076 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:770cef9a:::benchmark_data_smithi188_134454_object139855:head# 2024-04-01T19:48:47.076 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:770f2983:::benchmark_data_smithi188_134454_object119914:head# 2024-04-01T19:48:47.076 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7712392e:::benchmark_data_smithi188_134454_object118349:head# 2024-04-01T19:48:47.076 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7712f3b6:::benchmark_data_smithi188_134454_object121258:head# 2024-04-01T19:48:47.076 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:771366dc:::benchmark_data_smithi188_134454_object116150:head# 2024-04-01T19:48:47.076 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7713707c:::benchmark_data_smithi188_134454_object145932:head# 2024-04-01T19:48:47.077 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7713a537:::benchmark_data_smithi188_134454_object135237:head# 2024-04-01T19:48:47.077 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7713fbd5:::benchmark_data_smithi188_134454_object118427:head# 2024-04-01T19:48:47.077 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7715a4f7:::benchmark_data_smithi188_134454_object130708:head# 2024-04-01T19:48:47.077 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77179d28:::benchmark_data_smithi188_134454_object137808:head# 2024-04-01T19:48:47.077 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7717bac2:::benchmark_data_smithi188_134454_object131578:head# 2024-04-01T19:48:47.078 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7719cee0:::benchmark_data_smithi188_134454_object130058:head# 2024-04-01T19:48:47.078 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:771bd25e:::benchmark_data_smithi188_134454_object124839:head# 2024-04-01T19:48:47.078 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:771c373d:::benchmark_data_smithi188_134454_object149986:head# 2024-04-01T19:48:47.078 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:771cb85a:::benchmark_data_smithi188_134454_object155436:head# 2024-04-01T19:48:47.078 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:771dcb78:::benchmark_data_smithi188_134454_object148788:head# 2024-04-01T19:48:47.083 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:771fdf8a:::benchmark_data_smithi188_134454_object142444:head# 2024-04-01T19:48:47.083 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77205c36:::benchmark_data_smithi188_134454_object140065:head# 2024-04-01T19:48:47.084 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:772258fb:::benchmark_data_smithi188_134454_object131538:head# 2024-04-01T19:48:47.084 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7723ff7d:::benchmark_data_smithi188_134454_object129746:head# 2024-04-01T19:48:47.084 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7727ee56:::benchmark_data_smithi188_134454_object148960:head# 2024-04-01T19:48:47.085 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:772897e2:::benchmark_data_smithi188_134454_object149233:head# 2024-04-01T19:48:47.085 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:772c5999:::benchmark_data_smithi188_134454_object132423:head# 2024-04-01T19:48:47.089 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:772d85dc:::benchmark_data_smithi188_134454_object126595:head# 2024-04-01T19:48:47.089 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7730a5ef:::benchmark_data_smithi188_134454_object125351:head# 2024-04-01T19:48:47.090 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7730c854:::benchmark_data_smithi188_134454_object122980:head# 2024-04-01T19:48:47.090 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7730ff63:::benchmark_data_smithi188_134454_object138361:head# 2024-04-01T19:48:47.090 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:773128f7:::benchmark_data_smithi188_134454_object151258:head# 2024-04-01T19:48:47.090 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77334771:::benchmark_data_smithi188_134454_object153479:head# 2024-04-01T19:48:47.090 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:773437f5:::benchmark_data_smithi188_134454_object119840:head# 2024-04-01T19:48:47.090 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7735b3fb:::benchmark_data_smithi188_134454_object145463:head# 2024-04-01T19:48:47.090 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7737b09d:::benchmark_data_smithi188_134454_object141337:head# 2024-04-01T19:48:47.090 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7738d3e4:::benchmark_data_smithi188_134454_object122314:head# 2024-04-01T19:48:47.090 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:773925ec:::benchmark_data_smithi188_134454_object134097:head# 2024-04-01T19:48:47.090 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:773ae222:::benchmark_data_smithi188_134454_object150849:head# 2024-04-01T19:48:47.090 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:773aef1d:::benchmark_data_smithi188_134454_object120131:head# 2024-04-01T19:48:47.090 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77407d33:::benchmark_data_smithi188_134454_object135365:head# 2024-04-01T19:48:47.091 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7743decf:::benchmark_data_smithi188_134454_object124553:head# 2024-04-01T19:48:47.091 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:774552a1:::benchmark_data_smithi188_134454_object151445:head# 2024-04-01T19:48:47.091 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7745a1a0:::benchmark_data_smithi188_134454_object154690:head# 2024-04-01T19:48:47.091 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:774601f2:::benchmark_data_smithi188_134454_object153557:head# 2024-04-01T19:48:47.091 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77464554:::benchmark_data_smithi188_134454_object141254:head# 2024-04-01T19:48:47.092 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7746bf75:::benchmark_data_smithi188_134454_object141772:head# 2024-04-01T19:48:47.092 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:774a76cc:::benchmark_data_smithi188_134454_object148605:head# 2024-04-01T19:48:47.092 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:774a7fe1:::benchmark_data_smithi188_134454_object142310:head# 2024-04-01T19:48:47.102 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:774dc112:::benchmark_data_smithi188_134454_object131695:head# 2024-04-01T19:48:47.109 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:774e7a53:::benchmark_data_smithi188_134454_object148325:head# 2024-04-01T19:48:47.112 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:774fc6ad:::benchmark_data_smithi188_134454_object142253:head# 2024-04-01T19:48:47.112 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77510db0:::benchmark_data_smithi188_134454_object138215:head# 2024-04-01T19:48:47.112 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7757ffa4:::benchmark_data_smithi188_134454_object138308:head# 2024-04-01T19:48:47.112 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:775a6a94:::benchmark_data_smithi188_134454_object151825:head# 2024-04-01T19:48:47.112 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:775c95cf:::benchmark_data_smithi188_134454_object141449:head# 2024-04-01T19:48:47.113 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:775d85a9:::benchmark_data_smithi188_134454_object134874:head# 2024-04-01T19:48:47.113 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:775da53a:::benchmark_data_smithi188_134454_object130669:head# 2024-04-01T19:48:47.113 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:775f6079:::benchmark_data_smithi188_134454_object137992:head# 2024-04-01T19:48:47.113 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:775f7d0b:::benchmark_data_smithi188_134454_object119936:head# 2024-04-01T19:48:47.113 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77633627:::benchmark_data_smithi188_134454_object154316:head# 2024-04-01T19:48:47.113 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7764457d:::benchmark_data_smithi188_134454_object143707:head# 2024-04-01T19:48:47.113 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7764e472:::benchmark_data_smithi188_134454_object149509:head# 2024-04-01T19:48:47.113 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7765cb7c:::benchmark_data_smithi188_134454_object117928:head# 2024-04-01T19:48:47.113 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77665414:::benchmark_data_smithi188_134454_object130620:head# 2024-04-01T19:48:47.113 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7766fbab:::benchmark_data_smithi188_134454_object122694:head# 2024-04-01T19:48:47.114 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7767e58f:::benchmark_data_smithi188_134454_object119855:head# 2024-04-01T19:48:47.114 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77685d2c:::benchmark_data_smithi188_134454_object136824:head# 2024-04-01T19:48:47.115 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:776943cf:::benchmark_data_smithi188_134454_object124655:head# 2024-04-01T19:48:47.115 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7769a5da:::benchmark_data_smithi188_134454_object134972:head# 2024-04-01T19:48:47.115 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:776d3d40:::benchmark_data_smithi188_134454_object120738:head# 2024-04-01T19:48:47.115 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:777178cf:::benchmark_data_smithi188_134454_object149862:head# 2024-04-01T19:48:47.115 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7773b295:::benchmark_data_smithi188_134454_object147730:head# 2024-04-01T19:48:47.116 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7776e359:::benchmark_data_smithi188_134454_object152960:head# 2024-04-01T19:48:47.116 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77774493:::benchmark_data_smithi188_134454_object140200:head# 2024-04-01T19:48:47.116 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:777af774:::benchmark_data_smithi188_134454_object131566:head# 2024-04-01T19:48:47.116 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:777c84be:::benchmark_data_smithi188_134454_object124771:head# 2024-04-01T19:48:47.116 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:777d8310:::benchmark_data_smithi188_134454_object137104:head# 2024-04-01T19:48:47.116 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:777de855:::benchmark_data_smithi188_134454_object143001:head# 2024-04-01T19:48:47.120 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:777eb9f9:::benchmark_data_smithi188_134454_object140041:head# 2024-04-01T19:48:47.120 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:777f4dac:::benchmark_data_smithi188_134454_object120150:head# 2024-04-01T19:48:47.120 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:777f8d0e:::benchmark_data_smithi188_134454_object129543:head# 2024-04-01T19:48:47.120 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77801bc1:::benchmark_data_smithi188_134454_object145954:head# 2024-04-01T19:48:47.120 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:778038a6:::benchmark_data_smithi188_134454_object133815:head# 2024-04-01T19:48:47.120 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:778776bb:::benchmark_data_smithi188_134454_object137201:head# 2024-04-01T19:48:47.120 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7788e196:::benchmark_data_smithi188_134454_object133715:head# 2024-04-01T19:48:47.120 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7789c861:::benchmark_data_smithi188_134454_object144704:head# 2024-04-01T19:48:47.120 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:778a9819:::benchmark_data_smithi188_134454_object151164:head# 2024-04-01T19:48:47.120 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:778ba8b9:::benchmark_data_smithi188_134454_object131520:head# 2024-04-01T19:48:47.120 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:778c3de5:::benchmark_data_smithi188_134454_object121239:head# 2024-04-01T19:48:47.120 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:778e9de6:::benchmark_data_smithi188_134454_object154867:head# 2024-04-01T19:48:47.121 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:778fa0fc:::benchmark_data_smithi188_134454_object151700:head# 2024-04-01T19:48:47.121 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:779107d9:::benchmark_data_smithi188_134454_object131638:head# 2024-04-01T19:48:47.121 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:779382f3:::benchmark_data_smithi188_134454_object129459:head# 2024-04-01T19:48:47.121 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77940eff:::benchmark_data_smithi188_134454_object124116:head# 2024-04-01T19:48:47.121 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77951c69:::benchmark_data_smithi188_134454_object115698:head# 2024-04-01T19:48:47.121 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7795a651:::benchmark_data_smithi188_134454_object122679:head# 2024-04-01T19:48:47.121 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:48:47.122 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:47.122 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77964891:::benchmark_data_smithi188_134454_object119033:head# 2024-04-01T19:48:47.122 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77977dd2:::benchmark_data_smithi188_134454_object152122:head# 2024-04-01T19:48:47.122 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77981dc8:::benchmark_data_smithi188_134454_object143499:head# 2024-04-01T19:48:47.123 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:779cd713:::benchmark_data_smithi188_134454_object156047:head# 2024-04-01T19:48:47.123 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:779ff35d:::benchmark_data_smithi188_134454_object125831:head# 2024-04-01T19:48:47.123 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77a084a8:::benchmark_data_smithi188_134454_object148210:head# 2024-04-01T19:48:47.123 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77a30a03:::benchmark_data_smithi188_134454_object132684:head# 2024-04-01T19:48:47.123 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77a3598c:::benchmark_data_smithi188_134454_object152271:head# 2024-04-01T19:48:47.123 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77a4d0c8:::benchmark_data_smithi188_134454_object151058:head# 2024-04-01T19:48:47.123 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77a7dfdf:::benchmark_data_smithi188_134454_object126867:head# 2024-04-01T19:48:47.123 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77ab1e15:::benchmark_data_smithi188_134454_object119778:head# 2024-04-01T19:48:47.123 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77ab9ffd:::benchmark_data_smithi188_134454_object119720:head# 2024-04-01T19:48:47.124 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:48:47.124 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77abcc78:::benchmark_data_smithi188_134454_object138034:head# 2024-04-01T19:48:47.124 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77ac531c:::benchmark_data_smithi188_134454_object150248:head# 2024-04-01T19:48:47.126 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77ac7083:::benchmark_data_smithi188_134454_object123141:head# 2024-04-01T19:48:47.126 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77aedb5c:::benchmark_data_smithi188_134454_object133476:head# 2024-04-01T19:48:47.126 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77af0b91:::benchmark_data_smithi188_134454_object141752:head# 2024-04-01T19:48:47.126 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77afe39a:::benchmark_data_smithi188_134454_object116961:head# 2024-04-01T19:48:47.126 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77b02b25:::benchmark_data_smithi188_134454_object156721:head# 2024-04-01T19:48:47.126 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77b1e11e:::benchmark_data_smithi188_134454_object119230:head# 2024-04-01T19:48:47.126 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77b2a3a9:::benchmark_data_smithi188_134454_object156220:head# 2024-04-01T19:48:47.127 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77b5a01f:::benchmark_data_smithi188_134454_object146485:head# 2024-04-01T19:48:47.127 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77b6b86f:::benchmark_data_smithi188_134454_object129448:head# 2024-04-01T19:48:47.127 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77ba10b9:::benchmark_data_smithi188_134454_object132520:head# 2024-04-01T19:48:47.127 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77ba5c0e:::benchmark_data_smithi188_134454_object140508:head# 2024-04-01T19:48:47.127 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77bcd6e4:::benchmark_data_smithi188_134454_object141056:head# 2024-04-01T19:48:47.127 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77be41e8:::benchmark_data_smithi188_134454_object116407:head# 2024-04-01T19:48:47.127 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77bea8cd:::benchmark_data_smithi188_134454_object115435:head# 2024-04-01T19:48:47.128 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77c0893e:::benchmark_data_smithi188_134454_object134822:head# 2024-04-01T19:48:47.128 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77c1bc94:::benchmark_data_smithi188_134454_object151082:head# 2024-04-01T19:48:47.128 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77c415e3:::benchmark_data_smithi188_134454_object131444:head# 2024-04-01T19:48:47.128 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77c4df8a:::benchmark_data_smithi188_134454_object145293:head# 2024-04-01T19:48:47.128 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77c7ad38:::benchmark_data_smithi188_134454_object143288:head# 2024-04-01T19:48:47.129 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77ca803a:::benchmark_data_smithi188_134454_object151282:head# 2024-04-01T19:48:47.129 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77cb2ea7:::benchmark_data_smithi188_134454_object121249:head# 2024-04-01T19:48:47.129 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77cfb7f4:::benchmark_data_smithi188_134454_object136581:head# 2024-04-01T19:48:47.129 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77d05774:::benchmark_data_smithi188_134454_object148009:head# 2024-04-01T19:48:47.129 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77d085db:::benchmark_data_smithi188_134454_object147030:head# 2024-04-01T19:48:47.130 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77d2a782:::benchmark_data_smithi188_134454_object152699:head# 2024-04-01T19:48:47.130 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77d4908e:::benchmark_data_smithi188_134454_object119196:head# 2024-04-01T19:48:47.130 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77d51c49:::benchmark_data_smithi188_134454_object134662:head# 2024-04-01T19:48:47.130 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77d5ea28:::benchmark_data_smithi188_134454_object134038:head# 2024-04-01T19:48:47.131 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77d6910a:::benchmark_data_smithi188_134454_object130740:head# 2024-04-01T19:48:47.131 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77d6b6ce:::benchmark_data_smithi188_134454_object138580:head# 2024-04-01T19:48:47.131 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77d828ef:::benchmark_data_smithi188_134454_object156274:head# 2024-04-01T19:48:47.131 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77d9a2bb:::benchmark_data_smithi188_134454_object153300:head# 2024-04-01T19:48:47.131 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77de7141:::benchmark_data_smithi188_134454_object122181:head# 2024-04-01T19:48:47.132 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77de9116:::benchmark_data_smithi188_134454_object116059:head# 2024-04-01T19:48:47.132 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77de992c:::benchmark_data_smithi188_134454_object122527:head# 2024-04-01T19:48:47.132 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77e0ddd6:::benchmark_data_smithi188_134454_object147261:head# 2024-04-01T19:48:47.132 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77e27995:::benchmark_data_smithi188_134454_object136716:head# 2024-04-01T19:48:47.132 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77e44b78:::benchmark_data_smithi188_134454_object148868:head# 2024-04-01T19:48:47.132 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77e49f3c:::benchmark_data_smithi188_134454_object135879:head# 2024-04-01T19:48:47.132 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77e4e260:::benchmark_data_smithi188_134454_object127893:head# 2024-04-01T19:48:47.132 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77e55e53:::benchmark_data_smithi188_134454_object117204:head# 2024-04-01T19:48:47.133 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77e567dc:::benchmark_data_smithi188_134454_object116405:head# 2024-04-01T19:48:47.133 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77e57357:::benchmark_data_smithi188_134454_object125571:head# 2024-04-01T19:48:47.134 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77e7e9f4:::benchmark_data_smithi188_134454_object121770:head# 2024-04-01T19:48:47.134 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77e91f1f:::benchmark_data_smithi188_134454_object131329:head# 2024-04-01T19:48:47.134 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77ea4140:::benchmark_data_smithi188_134454_object150450:head# 2024-04-01T19:48:47.134 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77efb322:::benchmark_data_smithi188_134454_object121028:head# 2024-04-01T19:48:47.134 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77f29c65:::benchmark_data_smithi188_134454_object143646:head# 2024-04-01T19:48:47.135 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77f46bc7:::benchmark_data_smithi188_134454_object134638:head# 2024-04-01T19:48:47.135 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77f50293:::benchmark_data_smithi188_134454_object123633:head# 2024-04-01T19:48:47.135 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77f65363:::benchmark_data_smithi188_134454_object137254:head# 2024-04-01T19:48:47.135 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77f89138:::benchmark_data_smithi188_134454_object116394:head# 2024-04-01T19:48:47.135 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77f985f3:::benchmark_data_smithi188_134454_object132075:head# 2024-04-01T19:48:47.135 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77ff3f6a:::benchmark_data_smithi188_134454_object127659:head# 2024-04-01T19:48:47.135 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:77ff5e31:::benchmark_data_smithi188_134454_object132742:head# 2024-04-01T19:48:47.136 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78000c35:::benchmark_data_smithi188_134454_object139004:head# 2024-04-01T19:48:47.137 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7804ffdf:::benchmark_data_smithi188_134454_object144574:head# 2024-04-01T19:48:47.137 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78050207:::benchmark_data_smithi188_134454_object135873:head# 2024-04-01T19:48:47.137 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78068ded:::benchmark_data_smithi188_134454_object147304:head# 2024-04-01T19:48:47.137 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:780ac651:::benchmark_data_smithi188_134454_object149055:head# 2024-04-01T19:48:47.137 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:780bd2eb:::benchmark_data_smithi188_134454_object136246:head# 2024-04-01T19:48:47.137 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78135865:::benchmark_data_smithi188_134454_object136198:head# 2024-04-01T19:48:47.137 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7818931e:::benchmark_data_smithi188_134454_object137978:head# 2024-04-01T19:48:47.137 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:781b93b0:::benchmark_data_smithi188_134454_object127467:head# 2024-04-01T19:48:47.137 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:781be61d:::benchmark_data_smithi188_134454_object124133:head# 2024-04-01T19:48:47.138 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:781d0dbb:::benchmark_data_smithi188_134454_object133384:head# 2024-04-01T19:48:47.139 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:781e5543:::benchmark_data_smithi188_134454_object141547:head# 2024-04-01T19:48:47.139 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:781e78d8:::benchmark_data_smithi188_134454_object154277:head# 2024-04-01T19:48:47.139 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:781e835a:::benchmark_data_smithi188_134454_object156557:head# 2024-04-01T19:48:47.139 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7826f4dc:::benchmark_data_smithi188_134454_object117430:head# 2024-04-01T19:48:47.139 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78281dd7:::benchmark_data_smithi188_134454_object155120:head# 2024-04-01T19:48:47.139 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:782942da:::benchmark_data_smithi188_134454_object127288:head# 2024-04-01T19:48:47.139 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:782c9816:::benchmark_data_smithi188_134454_object150495:head# 2024-04-01T19:48:47.142 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:782d37e7:::benchmark_data_smithi188_134454_object123473:head# 2024-04-01T19:48:47.142 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:782edbe4:::benchmark_data_smithi188_134454_object134676:head# 2024-04-01T19:48:47.142 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78304d3e:::benchmark_data_smithi188_134454_object137023:head# 2024-04-01T19:48:47.142 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78335ed4:::benchmark_data_smithi188_134454_object154955:head# 2024-04-01T19:48:47.142 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:783369e6:::benchmark_data_smithi188_134454_object150494:head# 2024-04-01T19:48:47.142 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:783397dc:::benchmark_data_smithi188_134454_object153326:head# 2024-04-01T19:48:47.142 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:783401c4:::benchmark_data_smithi188_134454_object128226:head# 2024-04-01T19:48:47.142 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7834c304:::benchmark_data_smithi188_134454_object132524:head# 2024-04-01T19:48:47.142 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:783ae252:::benchmark_data_smithi188_134454_object152966:head# 2024-04-01T19:48:47.143 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:783f8794:::benchmark_data_smithi188_134454_object115667:head# 2024-04-01T19:48:47.143 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:784039db:::benchmark_data_smithi188_134454_object146079:head# 2024-04-01T19:48:47.143 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7845bc57:::benchmark_data_smithi188_134454_object136286:head# 2024-04-01T19:48:47.143 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7847eec6:::benchmark_data_smithi188_134454_object124423:head# 2024-04-01T19:48:47.145 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:784a6bf2:::benchmark_data_smithi188_134454_object142592:head# 2024-04-01T19:48:47.145 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:784a9ace:::benchmark_data_smithi188_134454_object141513:head# 2024-04-01T19:48:47.145 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78536eaf:::benchmark_data_smithi188_134454_object140698:head# 2024-04-01T19:48:47.145 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7853cff7:::benchmark_data_smithi188_134454_object141059:head# 2024-04-01T19:48:47.145 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7855fa0c:::benchmark_data_smithi188_134454_object123747:head# 2024-04-01T19:48:47.146 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7858b18c:::benchmark_data_smithi188_134454_object150702:head# 2024-04-01T19:48:47.146 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:785be554:::benchmark_data_smithi188_134454_object119683:head# 2024-04-01T19:48:47.146 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:785bfa72:::benchmark_data_smithi188_134454_object121104:head# 2024-04-01T19:48:47.146 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:785d2a55:::benchmark_data_smithi188_134454_object124834:head# 2024-04-01T19:48:47.146 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:785f34bb:::benchmark_data_smithi188_134454_object152204:head# 2024-04-01T19:48:47.146 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7861db72:::benchmark_data_smithi188_134454_object148108:head# 2024-04-01T19:48:47.146 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7862785e:::benchmark_data_smithi188_134454_object148480:head# 2024-04-01T19:48:47.146 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:786493c8:::benchmark_data_smithi188_134454_object138524:head# 2024-04-01T19:48:47.146 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7864aa7b:::benchmark_data_smithi188_134454_object117002:head# 2024-04-01T19:48:47.146 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7866aa0e:::benchmark_data_smithi188_134454_object154254:head# 2024-04-01T19:48:47.148 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78695667:::benchmark_data_smithi188_134454_object128152:head# 2024-04-01T19:48:47.148 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:786b0ba7:::benchmark_data_smithi188_134454_object152840:head# 2024-04-01T19:48:47.148 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78717096:::benchmark_data_smithi188_134454_object140770:head# 2024-04-01T19:48:47.148 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:787374b9:::benchmark_data_smithi188_134454_object142035:head# 2024-04-01T19:48:47.148 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78799643:::benchmark_data_smithi188_134454_object135733:head# 2024-04-01T19:48:47.148 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:787b7b82:::benchmark_data_smithi188_134454_object134567:head# 2024-04-01T19:48:47.148 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:787bb804:::benchmark_data_smithi188_134454_object139817:head# 2024-04-01T19:48:47.148 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:787bc6b2:::benchmark_data_smithi188_134454_object145267:head# 2024-04-01T19:48:47.148 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:787c18ad:::benchmark_data_smithi188_134454_object140336:head# 2024-04-01T19:48:47.148 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:787d3c2e:::benchmark_data_smithi188_134454_object155225:head# 2024-04-01T19:48:47.148 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:787d7e05:::benchmark_data_smithi188_134454_object137259:head# 2024-04-01T19:48:47.149 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:787e3eb2:::benchmark_data_smithi188_134454_object124374:head# 2024-04-01T19:48:47.149 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78801854:::benchmark_data_smithi188_134454_object149189:head# 2024-04-01T19:48:47.149 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7881055d:::benchmark_data_smithi188_134454_object139076:head# 2024-04-01T19:48:47.149 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78816659:::benchmark_data_smithi188_134454_object131782:head# 2024-04-01T19:48:47.149 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78819268:::benchmark_data_smithi188_134454_object148998:head# 2024-04-01T19:48:47.150 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78841cd6:::benchmark_data_smithi188_134454_object156133:head# 2024-04-01T19:48:47.150 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7884667e:::benchmark_data_smithi188_134454_object142691:head# 2024-04-01T19:48:47.150 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:788496f3:::benchmark_data_smithi188_134454_object139364:head# 2024-04-01T19:48:47.150 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78856cac:::benchmark_data_smithi188_134454_object152309:head# 2024-04-01T19:48:47.151 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78859cef:::benchmark_data_smithi188_134454_object119332:head# 2024-04-01T19:48:47.151 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78859e69:::benchmark_data_smithi188_134454_object151307:head# 2024-04-01T19:48:47.151 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78874057:::benchmark_data_smithi188_134454_object120372:head# 2024-04-01T19:48:47.151 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:788a4c49:::benchmark_data_smithi188_134454_object121565:head# 2024-04-01T19:48:47.151 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:788ad94d:::benchmark_data_smithi188_134454_object129454:head# 2024-04-01T19:48:47.152 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:788b7cbb:::benchmark_data_smithi188_134454_object154076:head# 2024-04-01T19:48:47.152 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:789095b8:::benchmark_data_smithi188_134454_object154565:head# 2024-04-01T19:48:47.152 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7891223f:::benchmark_data_smithi188_134454_object147591:head# 2024-04-01T19:48:47.152 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78928a9e:::benchmark_data_smithi188_134454_object121604:head# 2024-04-01T19:48:47.152 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78937250:::benchmark_data_smithi188_134454_object142552:head# 2024-04-01T19:48:47.153 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:789da4a0:::benchmark_data_smithi188_134454_object142733:head# 2024-04-01T19:48:47.153 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:789dacd7:::benchmark_data_smithi188_134454_object156370:head# 2024-04-01T19:48:47.153 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78a23983:::benchmark_data_smithi188_134454_object121242:head# 2024-04-01T19:48:47.153 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78a4067d:::benchmark_data_smithi188_134454_object118696:head# 2024-04-01T19:48:47.153 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78a45540:::benchmark_data_smithi188_134454_object146471:head# 2024-04-01T19:48:47.154 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78a52fb4:::benchmark_data_smithi188_134454_object125985:head# 2024-04-01T19:48:47.154 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78a64c4f:::benchmark_data_smithi188_134454_object120956:head# 2024-04-01T19:48:47.154 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78a744b7:::benchmark_data_smithi188_134454_object120960:head# 2024-04-01T19:48:47.154 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78a85cf5:::benchmark_data_smithi188_134454_object147451:head# 2024-04-01T19:48:47.155 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78a8ae6a:::benchmark_data_smithi188_134454_object145172:head# 2024-04-01T19:48:47.158 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78a95cb8:::benchmark_data_smithi188_134454_object120983:head# 2024-04-01T19:48:47.158 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78aca042:::benchmark_data_smithi188_134454_object121875:head# 2024-04-01T19:48:47.158 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78ad1560:::benchmark_data_smithi188_134454_object129734:head# 2024-04-01T19:48:47.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78ae99a0:::benchmark_data_smithi188_134454_object129587:head# 2024-04-01T19:48:47.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78af3343:::benchmark_data_smithi188_134454_object152187:head# 2024-04-01T19:48:47.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78b02c8c:::benchmark_data_smithi188_134454_object119851:head# 2024-04-01T19:48:47.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78b13ac1:::benchmark_data_smithi188_134454_object136592:head# 2024-04-01T19:48:47.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78b2b33a:::benchmark_data_smithi188_134454_object147221:head# 2024-04-01T19:48:47.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78b3e870:::benchmark_data_smithi188_134454_object153544:head# 2024-04-01T19:48:47.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78b44767:::benchmark_data_smithi188_134454_object132744:head# 2024-04-01T19:48:47.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78b4f2d2:::benchmark_data_smithi188_134454_object142564:head# 2024-04-01T19:48:47.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78b68c52:::benchmark_data_smithi188_134454_object117195:head# 2024-04-01T19:48:47.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78b72109:::benchmark_data_smithi188_134454_object116329:head# 2024-04-01T19:48:47.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78b87273:::benchmark_data_smithi188_134454_object151603:head# 2024-04-01T19:48:47.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78b8dc32:::benchmark_data_smithi188_134454_object130942:head# 2024-04-01T19:48:47.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78b97708:::benchmark_data_smithi188_134454_object130642:head# 2024-04-01T19:48:47.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78bb0e67:::benchmark_data_smithi188_134454_object122063:head# 2024-04-01T19:48:47.161 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78c252cb:::benchmark_data_smithi188_134454_object135113:head# 2024-04-01T19:48:47.161 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78c2de23:::benchmark_data_smithi188_134454_object145105:head# 2024-04-01T19:48:47.161 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78c3258c:::benchmark_data_smithi188_134454_object145192:head# 2024-04-01T19:48:47.161 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78c354db:::benchmark_data_smithi188_134454_object118293:head# 2024-04-01T19:48:47.162 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:48:47.163 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78c8861e:::benchmark_data_smithi188_134454_object146046:head# 2024-04-01T19:48:47.164 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78c89d82:::benchmark_data_smithi188_134454_object149127:head# 2024-04-01T19:48:47.164 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78cc3ad4:::benchmark_data_smithi188_134454_object147099:head# 2024-04-01T19:48:47.164 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78cfe310:::benchmark_data_smithi188_134454_object116480:head# 2024-04-01T19:48:47.164 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78d24b7d:::benchmark_data_smithi188_134454_object141238:head# 2024-04-01T19:48:47.164 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78d681fe:::benchmark_data_smithi188_134454_object146425:head# 2024-04-01T19:48:47.164 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78d9e735:::benchmark_data_smithi188_134454_object150036:head# 2024-04-01T19:48:47.164 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78db4de9:::benchmark_data_smithi188_134454_object145560:head# 2024-04-01T19:48:47.164 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78dbf0d9:::benchmark_data_smithi188_134454_object151483:head# 2024-04-01T19:48:47.164 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78e0d122:::benchmark_data_smithi188_134454_object119438:head# 2024-04-01T19:48:47.164 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78e35960:::benchmark_data_smithi188_134454_object150541:head# 2024-04-01T19:48:47.164 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78e3832c:::benchmark_data_smithi188_134454_object120670:head# 2024-04-01T19:48:47.164 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78e67159:::benchmark_data_smithi188_134454_object121589:head# 2024-04-01T19:48:47.164 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78ea7e8b:::benchmark_data_smithi188_134454_object131122:head# 2024-04-01T19:48:47.164 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78ec9596:::benchmark_data_smithi188_134454_object123623:head# 2024-04-01T19:48:47.165 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78ed1423:::benchmark_data_smithi188_134454_object132696:head# 2024-04-01T19:48:47.165 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78ed16b8:::benchmark_data_smithi188_134454_object118974:head# 2024-04-01T19:48:47.166 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78eecc19:::benchmark_data_smithi188_134454_object137007:head# 2024-04-01T19:48:47.166 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78f1410f:::benchmark_data_smithi188_134454_object123195:head# 2024-04-01T19:48:47.166 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78f23f8f:::benchmark_data_smithi188_134454_object116068:head# 2024-04-01T19:48:47.166 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78f48baf:::benchmark_data_smithi188_134454_object122504:head# 2024-04-01T19:48:47.166 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78f6099f:::benchmark_data_smithi188_134454_object126147:head# 2024-04-01T19:48:47.166 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78f7da02:::benchmark_data_smithi188_134454_object137628:head# 2024-04-01T19:48:47.166 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78f9da64:::benchmark_data_smithi188_134454_object126539:head# 2024-04-01T19:48:47.167 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78fb0c02:::benchmark_data_smithi188_134454_object117758:head# 2024-04-01T19:48:47.167 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78fbb824:::benchmark_data_smithi188_134454_object149225:head# 2024-04-01T19:48:47.167 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78fd7f94:::benchmark_data_smithi188_134454_object149336:head# 2024-04-01T19:48:47.167 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78feeacb:::benchmark_data_smithi188_134454_object126936:head# 2024-04-01T19:48:47.168 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:78ffb449:::benchmark_data_smithi188_134454_object152938:head# 2024-04-01T19:48:47.168 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79061395:::benchmark_data_smithi188_134454_object123257:head# 2024-04-01T19:48:47.168 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79062269:::benchmark_data_smithi188_134454_object125678:head# 2024-04-01T19:48:47.169 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79067137:::benchmark_data_smithi188_134454_object139845:head# 2024-04-01T19:48:47.169 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7909da5b:::benchmark_data_smithi188_134454_object133076:head# 2024-04-01T19:48:47.169 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:790b777c:::benchmark_data_smithi188_134454_object131389:head# 2024-04-01T19:48:47.169 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:790c0da5:::benchmark_data_smithi188_134454_object136397:head# 2024-04-01T19:48:47.169 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:790d8d6e:::benchmark_data_smithi188_134454_object122778:head# 2024-04-01T19:48:47.169 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:790f9d96:::benchmark_data_smithi188_134454_object120444:head# 2024-04-01T19:48:47.171 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7911672f:::benchmark_data_smithi188_134454_object139606:head# 2024-04-01T19:48:47.171 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79154a3e:::benchmark_data_smithi188_134454_object127055:head# 2024-04-01T19:48:47.171 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7917d7ac:::benchmark_data_smithi188_134454_object141542:head# 2024-04-01T19:48:47.171 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:791a3761:::benchmark_data_smithi188_134454_object152238:head# 2024-04-01T19:48:47.172 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:791b3e38:::benchmark_data_smithi188_134454_object152615:head# 2024-04-01T19:48:47.172 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:791c3f06:::benchmark_data_smithi188_134454_object120771:head# 2024-04-01T19:48:47.172 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:791f8639:::benchmark_data_smithi188_134454_object122756:head# 2024-04-01T19:48:47.173 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79216d24:::benchmark_data_smithi188_134454_object118158:head# 2024-04-01T19:48:47.173 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79231c21:::benchmark_data_smithi188_134454_object129125:head# 2024-04-01T19:48:47.173 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79236a41:::benchmark_data_smithi188_134454_object132235:head# 2024-04-01T19:48:47.173 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79237f5f:::benchmark_data_smithi188_134454_object137948:head# 2024-04-01T19:48:47.174 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7923a54f:::benchmark_data_smithi188_134454_object119893:head# 2024-04-01T19:48:47.174 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7924dfc9:::benchmark_data_smithi188_134454_object126183:head# 2024-04-01T19:48:47.174 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79266423:::benchmark_data_smithi188_134454_object123035:head# 2024-04-01T19:48:47.175 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7928e102:::benchmark_data_smithi188_134454_object135387:head# 2024-04-01T19:48:47.175 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79298abc:::benchmark_data_smithi188_134454_object119905:head# 2024-04-01T19:48:47.175 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:792c3c2a:::benchmark_data_smithi188_134454_object133142:head# 2024-04-01T19:48:47.175 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:792d5f86:::benchmark_data_smithi188_134454_object126501:head# 2024-04-01T19:48:47.175 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:792f0ad1:::benchmark_data_smithi188_134454_object142488:head# 2024-04-01T19:48:47.176 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:793161b3:::benchmark_data_smithi188_134454_object121077:head# 2024-04-01T19:48:47.176 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79316ae6:::benchmark_data_smithi188_134454_object136962:head# 2024-04-01T19:48:47.176 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79335b5c:::benchmark_data_smithi188_134454_object141455:head# 2024-04-01T19:48:47.177 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:793598d5:::benchmark_data_smithi188_134454_object131584:head# 2024-04-01T19:48:47.177 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7935e0ad:::benchmark_data_smithi188_134454_object124904:head# 2024-04-01T19:48:47.177 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:793907fd:::benchmark_data_smithi188_134454_object118273:head# 2024-04-01T19:48:47.178 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79391f02:::benchmark_data_smithi188_134454_object135085:head# 2024-04-01T19:48:47.178 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:793ae69c:::benchmark_data_smithi188_134454_object129240:head# 2024-04-01T19:48:47.178 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:793b984d:::benchmark_data_smithi188_134454_object151011:head# 2024-04-01T19:48:47.178 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:793cafc3:::benchmark_data_smithi188_134454_object147872:head# 2024-04-01T19:48:47.179 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:793d2c0e:::benchmark_data_smithi188_134454_object149633:head# 2024-04-01T19:48:47.179 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:793f0306:::benchmark_data_smithi188_134454_object133934:head# 2024-04-01T19:48:47.179 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79401548:::benchmark_data_smithi188_134454_object142113:head# 2024-04-01T19:48:47.179 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:794152c5:::benchmark_data_smithi188_134454_object130455:head# 2024-04-01T19:48:47.179 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7942dc3e:::benchmark_data_smithi188_134454_object120123:head# 2024-04-01T19:48:47.180 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7943bb26:::benchmark_data_smithi188_134454_object130193:head# 2024-04-01T19:48:47.180 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7944638a:::benchmark_data_smithi188_134454_object143062:head# 2024-04-01T19:48:47.180 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7945161d:::benchmark_data_smithi188_134454_object152441:head# 2024-04-01T19:48:47.187 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7945a15a:::benchmark_data_smithi188_134454_object122711:head# 2024-04-01T19:48:47.187 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:794656ed:::benchmark_data_smithi188_134454_object131377:head# 2024-04-01T19:48:47.187 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79472242:::benchmark_data_smithi188_134454_object141607:head# 2024-04-01T19:48:47.187 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7949332e:::benchmark_data_smithi188_134454_object150438:head# 2024-04-01T19:48:47.187 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:794c1841:::benchmark_data_smithi188_134454_object135687:head# 2024-04-01T19:48:47.187 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:794cace4:::benchmark_data_smithi188_134454_object119014:head# 2024-04-01T19:48:47.187 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:794f3698:::benchmark_data_smithi188_134454_object117382:head# 2024-04-01T19:48:47.187 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:794f85fc:::benchmark_data_smithi188_134454_object128840:head# 2024-04-01T19:48:47.188 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7951743a:::benchmark_data_smithi188_134454_object144509:head# 2024-04-01T19:48:47.188 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79526bf4:::benchmark_data_smithi188_134454_object115562:head# 2024-04-01T19:48:47.188 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:795329b6:::benchmark_data_smithi188_134454_object118672:head# 2024-04-01T19:48:47.188 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79554115:::benchmark_data_smithi188_134454_object129074:head# 2024-04-01T19:48:47.188 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:795641e3:::benchmark_data_smithi188_134454_object122280:head# 2024-04-01T19:48:47.188 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79574fb9:::benchmark_data_smithi188_134454_object118487:head# 2024-04-01T19:48:47.188 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79575458:::benchmark_data_smithi188_134454_object144611:head# 2024-04-01T19:48:47.188 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79586e6a:::benchmark_data_smithi188_134454_object123185:head# 2024-04-01T19:48:47.188 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7959278a:::benchmark_data_smithi188_134454_object142424:head# 2024-04-01T19:48:47.188 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:795bd239:::benchmark_data_smithi188_134454_object128081:head# 2024-04-01T19:48:47.188 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:795f901a:::benchmark_data_smithi188_134454_object142469:head# 2024-04-01T19:48:47.188 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7960708c:::benchmark_data_smithi188_134454_object145036:head# 2024-04-01T19:48:47.188 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7960cbc5:::benchmark_data_smithi188_134454_object137964:head# 2024-04-01T19:48:47.188 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79625656:::benchmark_data_smithi188_134454_object122032:head# 2024-04-01T19:48:47.189 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7962bac1:::benchmark_data_smithi188_134454_object152086:head# 2024-04-01T19:48:47.189 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79671c98:::benchmark_data_smithi188_134454_object134574:head# 2024-04-01T19:48:47.189 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79697e8f:::benchmark_data_smithi188_134454_object139438:head# 2024-04-01T19:48:47.189 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7969b284:::benchmark_data_smithi188_134454_object155227:head# 2024-04-01T19:48:47.189 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:796a0910:::benchmark_data_smithi188_134454_object151650:head# 2024-04-01T19:48:47.190 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:796ba60a:::benchmark_data_smithi188_134454_object128213:head# 2024-04-01T19:48:47.190 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:796c2c9b:::benchmark_data_smithi188_134454_object140095:head# 2024-04-01T19:48:47.190 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79725fa1:::benchmark_data_smithi188_134454_object145568:head# 2024-04-01T19:48:47.190 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7973857e:::benchmark_data_smithi188_134454_object132325:head# 2024-04-01T19:48:47.190 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7973e750:::benchmark_data_smithi188_134454_object133915:head# 2024-04-01T19:48:47.190 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79753fd2:::benchmark_data_smithi188_134454_object133804:head# 2024-04-01T19:48:47.190 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7976a0ae:::benchmark_data_smithi188_134454_object128635:head# 2024-04-01T19:48:47.190 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7977f364:::benchmark_data_smithi188_134454_object131374:head# 2024-04-01T19:48:47.191 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7977fa81:::benchmark_data_smithi188_134454_object125893:head# 2024-04-01T19:48:47.191 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7980c1d6:::benchmark_data_smithi188_134454_object142370:head# 2024-04-01T19:48:47.191 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7981c36b:::benchmark_data_smithi188_134454_object135570:head# 2024-04-01T19:48:47.191 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7982f2fc:::benchmark_data_smithi188_134454_object153525:head# 2024-04-01T19:48:47.191 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79833f14:::benchmark_data_smithi188_134454_object143522:head# 2024-04-01T19:48:47.191 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7986b7be:::benchmark_data_smithi188_134454_object136796:head# 2024-04-01T19:48:47.191 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7989d636:::benchmark_data_smithi188_134454_object137160:head# 2024-04-01T19:48:47.192 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:798e28b1:::benchmark_data_smithi188_134454_object148384:head# 2024-04-01T19:48:47.192 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:798fd032:::benchmark_data_smithi188_134454_object124521:head# 2024-04-01T19:48:47.192 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:798feb3f:::benchmark_data_smithi188_134454_object117501:head# 2024-04-01T19:48:47.192 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79904720:::benchmark_data_smithi188_134454_object123218:head# 2024-04-01T19:48:47.192 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79905666:::benchmark_data_smithi188_134454_object150731:head# 2024-04-01T19:48:47.192 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79909c13:::benchmark_data_smithi188_134454_object120403:head# 2024-04-01T19:48:47.192 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7990b103:::benchmark_data_smithi188_134454_object143381:head# 2024-04-01T19:48:47.192 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79933aff:::benchmark_data_smithi188_134454_object124414:head# 2024-04-01T19:48:47.193 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:799877a3:::benchmark_data_smithi188_134454_object143615:head# 2024-04-01T19:48:47.193 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:799c1f69:::benchmark_data_smithi188_134454_object123282:head# 2024-04-01T19:48:47.193 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:799ed21d:::benchmark_data_smithi188_134454_object149793:head# 2024-04-01T19:48:47.193 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79a1f0bb:::benchmark_data_smithi188_134454_object128440:head# 2024-04-01T19:48:47.196 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79a2ca84:::benchmark_data_smithi188_134454_object135051:head# 2024-04-01T19:48:47.196 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79a47def:::benchmark_data_smithi188_134454_object129106:head# 2024-04-01T19:48:47.196 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79a655a3:::benchmark_data_smithi188_134454_object144877:head# 2024-04-01T19:48:47.196 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79a6c902:::benchmark_data_smithi188_134454_object129202:head# 2024-04-01T19:48:47.196 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79a733e7:::benchmark_data_smithi188_134454_object145360:head# 2024-04-01T19:48:47.196 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79ac7460:::benchmark_data_smithi188_134454_object121870:head# 2024-04-01T19:48:47.196 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79ae3dcd:::benchmark_data_smithi188_134454_object145112:head# 2024-04-01T19:48:47.196 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79aeccfc:::benchmark_data_smithi188_134454_object147842:head# 2024-04-01T19:48:47.197 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79b0f2c4:::benchmark_data_smithi188_134454_object143817:head# 2024-04-01T19:48:47.197 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79b141c2:::benchmark_data_smithi188_134454_object154688:head# 2024-04-01T19:48:47.197 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79b19c08:::benchmark_data_smithi188_134454_object154601:head# 2024-04-01T19:48:47.197 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79b29bf3:::benchmark_data_smithi188_134454_object140109:head# 2024-04-01T19:48:47.197 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79b343de:::benchmark_data_smithi188_134454_object145697:head# 2024-04-01T19:48:47.197 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79b38918:::benchmark_data_smithi188_134454_object118145:head# 2024-04-01T19:48:47.198 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79b5e2c3:::benchmark_data_smithi188_134454_object145831:head# 2024-04-01T19:48:47.198 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79b7c2fb:::benchmark_data_smithi188_134454_object136140:head# 2024-04-01T19:48:47.199 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79b8c47e:::benchmark_data_smithi188_134454_object150127:head# 2024-04-01T19:48:47.199 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79b9629f:::benchmark_data_smithi188_134454_object128595:head# 2024-04-01T19:48:47.199 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79b98af5:::benchmark_data_smithi188_134454_object122111:head# 2024-04-01T19:48:47.199 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79ba423c:::benchmark_data_smithi188_134454_object136899:head# 2024-04-01T19:48:47.199 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79ba8275:::benchmark_data_smithi188_134454_object115749:head# 2024-04-01T19:48:47.199 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79bcccc4:::benchmark_data_smithi188_134454_object135197:head# 2024-04-01T19:48:47.199 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79bd95ac:::benchmark_data_smithi188_134454_object141937:head# 2024-04-01T19:48:47.199 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79bdf3d7:::benchmark_data_smithi188_134454_object118817:head# 2024-04-01T19:48:47.199 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79be6f98:::benchmark_data_smithi188_134454_object116258:head# 2024-04-01T19:48:47.200 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79bebd73:::benchmark_data_smithi188_134454_object135416:head# 2024-04-01T19:48:47.200 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79c07035:::benchmark_data_smithi188_134454_object119881:head# 2024-04-01T19:48:47.200 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79c2c8ff:::benchmark_data_smithi188_134454_object142191:head# 2024-04-01T19:48:47.200 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79c536ea:::benchmark_data_smithi188_134454_object117287:head# 2024-04-01T19:48:47.200 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79c6338d:::benchmark_data_smithi188_134454_object125066:head# 2024-04-01T19:48:47.200 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79c653b0:::benchmark_data_smithi188_134454_object118398:head# 2024-04-01T19:48:47.200 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79c69e6e:::benchmark_data_smithi188_134454_object152851:head# 2024-04-01T19:48:47.201 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79c94411:::benchmark_data_smithi188_134454_object138229:head# 2024-04-01T19:48:47.201 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79c974b3:::benchmark_data_smithi188_134454_object136245:head# 2024-04-01T19:48:47.202 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79c9d536:::benchmark_data_smithi188_134454_object136767:head# 2024-04-01T19:48:47.202 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79ca5873:::benchmark_data_smithi188_134454_object122823:head# 2024-04-01T19:48:47.202 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79cdca11:::benchmark_data_smithi188_134454_object139838:head# 2024-04-01T19:48:47.202 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79ce5604:::benchmark_data_smithi188_134454_object132806:head# 2024-04-01T19:48:47.202 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79d27ae5:::benchmark_data_smithi188_134454_object130586:head# 2024-04-01T19:48:47.202 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79d4ae4c:::benchmark_data_smithi188_134454_object135396:head# 2024-04-01T19:48:47.203 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79d4b03e:::benchmark_data_smithi188_134454_object133693:head# 2024-04-01T19:48:47.203 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79d7e10f:::benchmark_data_smithi188_134454_object151654:head# 2024-04-01T19:48:47.203 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79d85f39:::benchmark_data_smithi188_134454_object121036:head# 2024-04-01T19:48:47.203 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79d8c739:::benchmark_data_smithi188_134454_object126186:head# 2024-04-01T19:48:47.203 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79d8de9e:::benchmark_data_smithi188_134454_object124610:head# 2024-04-01T19:48:47.203 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79dbc68d:::benchmark_data_smithi188_134454_object148201:head# 2024-04-01T19:48:47.204 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79dcaf52:::benchmark_data_smithi188_134454_object130849:head# 2024-04-01T19:48:47.204 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79dd26a1:::benchmark_data_smithi188_134454_object116838:head# 2024-04-01T19:48:47.204 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79deb3e2:::benchmark_data_smithi188_134454_object118304:head# 2024-04-01T19:48:47.204 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79e22d8a:::benchmark_data_smithi188_134454_object130831:head# 2024-04-01T19:48:47.205 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79e61324:::benchmark_data_smithi188_134454_object144885:head# 2024-04-01T19:48:47.205 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79e6454f:::benchmark_data_smithi188_134454_object130657:head# 2024-04-01T19:48:47.205 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79ee1f10:::benchmark_data_smithi188_134454_object147111:head# 2024-04-01T19:48:47.205 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79ee91cb:::benchmark_data_smithi188_134454_object148846:head# 2024-04-01T19:48:47.206 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79f30c64:::benchmark_data_smithi188_134454_object148436:head# 2024-04-01T19:48:47.206 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79f350e7:::benchmark_data_smithi188_134454_object144916:head# 2024-04-01T19:48:47.206 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79f44dc5:::benchmark_data_smithi188_134454_object134321:head# 2024-04-01T19:48:47.206 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79f73ce4:::benchmark_data_smithi188_134454_object121819:head# 2024-04-01T19:48:47.206 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79f7ea18:::benchmark_data_smithi188_134454_object118041:head# 2024-04-01T19:48:47.207 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79f8532c:::benchmark_data_smithi188_134454_object117668:head# 2024-04-01T19:48:47.207 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79f866c4:::benchmark_data_smithi188_134454_object117454:head# 2024-04-01T19:48:47.207 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79fcaae3:::benchmark_data_smithi188_134454_object134128:head# 2024-04-01T19:48:47.207 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79fd4655:::benchmark_data_smithi188_134454_object143067:head# 2024-04-01T19:48:47.208 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79fe876f:::benchmark_data_smithi188_134454_object141342:head# 2024-04-01T19:48:47.208 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79fe893a:::benchmark_data_smithi188_134454_object138466:head# 2024-04-01T19:48:47.208 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79fee26b:::benchmark_data_smithi188_134454_object116375:head# 2024-04-01T19:48:47.208 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79fefd09:::benchmark_data_smithi188_134454_object127778:head# 2024-04-01T19:48:47.209 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79ff9372:::benchmark_data_smithi188_134454_object146288:head# 2024-04-01T19:48:47.209 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:79ffcf0f:::benchmark_data_smithi188_134454_object123386:head# 2024-04-01T19:48:47.209 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a047037:::benchmark_data_smithi188_134454_object136642:head# 2024-04-01T19:48:47.209 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a07baf4:::benchmark_data_smithi188_134454_object143068:head# 2024-04-01T19:48:47.210 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a07e664:::benchmark_data_smithi188_134454_object118048:head# 2024-04-01T19:48:47.210 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a08cf60:::benchmark_data_smithi188_134454_object136038:head# 2024-04-01T19:48:47.210 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a093b7e:::benchmark_data_smithi188_134454_object125735:head# 2024-04-01T19:48:47.211 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a0a31e4:::benchmark_data_smithi188_134454_object150811:head# 2024-04-01T19:48:47.211 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a0d1a2b:::benchmark_data_smithi188_134454_object137404:head# 2024-04-01T19:48:47.211 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a110f50:::benchmark_data_smithi188_134454_object147208:head# 2024-04-01T19:48:47.211 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a111ca1:::benchmark_data_smithi188_134454_object117888:head# 2024-04-01T19:48:47.212 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a120834:::benchmark_data_smithi188_134454_object142419:head# 2024-04-01T19:48:47.212 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a131414:::benchmark_data_smithi188_134454_object128895:head# 2024-04-01T19:48:47.212 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a170f74:::benchmark_data_smithi188_134454_object117722:head# 2024-04-01T19:48:47.212 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a17c696:::benchmark_data_smithi188_134454_object141699:head# 2024-04-01T19:48:47.212 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a19db96:::benchmark_data_smithi188_134454_object134962:head# 2024-04-01T19:48:47.212 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a2294af:::benchmark_data_smithi188_134454_object117924:head# 2024-04-01T19:48:47.213 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a250597:::benchmark_data_smithi188_134454_object135267:head# 2024-04-01T19:48:47.213 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a2940c9:::benchmark_data_smithi188_134454_object156494:head# 2024-04-01T19:48:47.213 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a2a1012:::benchmark_data_smithi188_134454_object155343:head# 2024-04-01T19:48:47.214 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a2aeb50:::benchmark_data_smithi188_134454_object133171:head# 2024-04-01T19:48:47.214 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a2b9105:::benchmark_data_smithi188_134454_object144209:head# 2024-04-01T19:48:47.214 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a2d3a40:::benchmark_data_smithi188_134454_object143286:head# 2024-04-01T19:48:47.214 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a2fb440:::benchmark_data_smithi188_134454_object153612:head# 2024-04-01T19:48:47.214 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a304f8c:::benchmark_data_smithi188_134454_object126950:head# 2024-04-01T19:48:47.219 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a352760:::benchmark_data_smithi188_134454_object141046:head# 2024-04-01T19:48:47.219 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a362c97:::benchmark_data_smithi188_134454_object156624:head# 2024-04-01T19:48:47.219 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a3a4921:::benchmark_data_smithi188_134454_object146678:head# 2024-04-01T19:48:47.219 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a3aebe4:::benchmark_data_smithi188_134454_object140382:head# 2024-04-01T19:48:47.219 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a3e752f:::benchmark_data_smithi188_134454_object141460:head# 2024-04-01T19:48:47.219 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a3fe382:::benchmark_data_smithi188_134454_object148042:head# 2024-04-01T19:48:47.219 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a41d170:::benchmark_data_smithi188_134454_object125737:head# 2024-04-01T19:48:47.219 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a427c66:::benchmark_data_smithi188_134454_object154974:head# 2024-04-01T19:48:47.220 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a43802b:::benchmark_data_smithi188_134454_object116069:head# 2024-04-01T19:48:47.220 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a478a93:::benchmark_data_smithi188_134454_object130785:head# 2024-04-01T19:48:47.220 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a4d5078:::benchmark_data_smithi188_134454_object138608:head# 2024-04-01T19:48:47.220 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a4fc78e:::benchmark_data_smithi188_134454_object148700:head# 2024-04-01T19:48:47.220 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a53c12b:::benchmark_data_smithi188_134454_object122387:head# 2024-04-01T19:48:47.220 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a554ef2:::benchmark_data_smithi188_134454_object125108:head# 2024-04-01T19:48:47.220 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a5864f6:::benchmark_data_smithi188_134454_object128781:head# 2024-04-01T19:48:47.220 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a5badc9:::benchmark_data_smithi188_134454_object141494:head# 2024-04-01T19:48:47.220 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a5db9be:::benchmark_data_smithi188_134454_object137454:head# 2024-04-01T19:48:47.220 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a5ed326:::benchmark_data_smithi188_134454_object145506:head# 2024-04-01T19:48:47.220 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a64832e:::benchmark_data_smithi188_134454_object128448:head# 2024-04-01T19:48:47.220 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a655d94:::benchmark_data_smithi188_134454_object123639:head# 2024-04-01T19:48:47.220 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a681701:::benchmark_data_smithi188_134454_object127552:head# 2024-04-01T19:48:47.220 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a694c92:::benchmark_data_smithi188_134454_object145915:head# 2024-04-01T19:48:47.221 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a6adb47:::benchmark_data_smithi188_134454_object144135:head# 2024-04-01T19:48:47.221 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a6b1bab:::benchmark_data_smithi188_134454_object141549:head# 2024-04-01T19:48:47.221 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a6dbae3:::benchmark_data_smithi188_134454_object143370:head# 2024-04-01T19:48:47.222 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a701f4f:::benchmark_data_smithi188_134454_object119261:head# 2024-04-01T19:48:47.222 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a725c6f:::benchmark_data_smithi188_134454_object121504:head# 2024-04-01T19:48:47.222 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a73bad6:::benchmark_data_smithi188_134454_object138805:head# 2024-04-01T19:48:47.222 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a7a4346:::benchmark_data_smithi188_134454_object128866:head# 2024-04-01T19:48:47.222 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a7b2f55:::benchmark_data_smithi188_134454_object124193:head# 2024-04-01T19:48:47.222 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a7c0ac4:::benchmark_data_smithi188_134454_object136296:head# 2024-04-01T19:48:47.222 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a7c16ba:::benchmark_data_smithi188_134454_object138113:head# 2024-04-01T19:48:47.222 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a80e1d1:::benchmark_data_smithi188_134454_object120359:head# 2024-04-01T19:48:47.222 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a80e4df:::benchmark_data_smithi188_134454_object117311:head# 2024-04-01T19:48:47.223 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a80f1f7:::benchmark_data_smithi188_134454_object145039:head# 2024-04-01T19:48:47.223 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a816843:::benchmark_data_smithi188_134454_object145795:head# 2024-04-01T19:48:47.225 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:48:47.234 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a82c34b:::benchmark_data_smithi188_134454_object139283:head# 2024-04-01T19:48:47.234 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a82ef1f:::benchmark_data_smithi188_134454_object148954:head# 2024-04-01T19:48:47.234 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a8494e0:::benchmark_data_smithi188_134454_object142808:head# 2024-04-01T19:48:47.234 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a88e7d5:::benchmark_data_smithi188_134454_object128302:head# 2024-04-01T19:48:47.234 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a8a316d:::benchmark_data_smithi188_134454_object133789:head# 2024-04-01T19:48:47.234 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a8b2b98:::benchmark_data_smithi188_134454_object120915:head# 2024-04-01T19:48:47.234 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a8ddb9b:::benchmark_data_smithi188_134454_object117958:head# 2024-04-01T19:48:47.234 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a8e56d7:::benchmark_data_smithi188_134454_object128807:head# 2024-04-01T19:48:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a8eacf5:::benchmark_data_smithi188_134454_object122675:head# 2024-04-01T19:48:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a8f7c3b:::benchmark_data_smithi188_134454_object139350:head# 2024-04-01T19:48:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a91ea8f:::benchmark_data_smithi188_134454_object128952:head# 2024-04-01T19:48:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a925d42:::benchmark_data_smithi188_134454_object121919:head# 2024-04-01T19:48:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a94e781:::benchmark_data_smithi188_134454_object133066:head# 2024-04-01T19:48:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a95d780:::benchmark_data_smithi188_134454_object149492:head# 2024-04-01T19:48:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a977779:::benchmark_data_smithi188_134454_object134055:head# 2024-04-01T19:48:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a987d92:::benchmark_data_smithi188_134454_object133291:head# 2024-04-01T19:48:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a9b0970:::benchmark_data_smithi188_134454_object128467:head# 2024-04-01T19:48:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a9beb80:::benchmark_data_smithi188_134454_object131529:head# 2024-04-01T19:48:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a9cfad2:::benchmark_data_smithi188_134454_object126904:head# 2024-04-01T19:48:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a9dfab9:::benchmark_data_smithi188_134454_object130774:head# 2024-04-01T19:48:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7a9e36c5:::benchmark_data_smithi188_134454_object115987:head# 2024-04-01T19:48:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7aa24580:::benchmark_data_smithi188_134454_object124766:head# 2024-04-01T19:48:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7aa544fa:::benchmark_data_smithi188_134454_object129073:head# 2024-04-01T19:48:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7aa86722:::benchmark_data_smithi188_134454_object137182:head# 2024-04-01T19:48:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7aac9179:::benchmark_data_smithi188_134454_object128940:head# 2024-04-01T19:48:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7aad0693:::benchmark_data_smithi188_134454_object121868:head# 2024-04-01T19:48:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7aaf016f:::benchmark_data_smithi188_134454_object115476:head# 2024-04-01T19:48:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7aaff669:::benchmark_data_smithi188_134454_object148041:head# 2024-04-01T19:48:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ab0dee4:::benchmark_data_smithi188_134454_object134218:head# 2024-04-01T19:48:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ab38bae:::benchmark_data_smithi188_134454_object131470:head# 2024-04-01T19:48:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ab5c931:::benchmark_data_smithi188_134454_object137773:head# 2024-04-01T19:48:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ab68fb1:::benchmark_data_smithi188_134454_object153282:head# 2024-04-01T19:48:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ab95888:::benchmark_data_smithi188_134454_object149937:head# 2024-04-01T19:48:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ab9c16b:::benchmark_data_smithi188_134454_object121486:head# 2024-04-01T19:48:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7aba7350:::benchmark_data_smithi188_134454_object138104:head# 2024-04-01T19:48:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7abac128:::benchmark_data_smithi188_134454_object152728:head# 2024-04-01T19:48:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7abac372:::benchmark_data_smithi188_134454_object126069:head# 2024-04-01T19:48:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7abb44c6:::benchmark_data_smithi188_134454_object151087:head# 2024-04-01T19:48:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7abc2c53:::benchmark_data_smithi188_134454_object149363:head# 2024-04-01T19:48:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7abd2380:::benchmark_data_smithi188_134454_object151213:head# 2024-04-01T19:48:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7abd6d85:::benchmark_data_smithi188_134454_object137823:head# 2024-04-01T19:48:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ac25e2d:::benchmark_data_smithi188_134454_object136254:head# 2024-04-01T19:48:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ac7782d:::benchmark_data_smithi188_134454_object132945:head# 2024-04-01T19:48:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7aca506f:::benchmark_data_smithi188_134454_object126657:head# 2024-04-01T19:48:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7acaa92f:::benchmark_data_smithi188_134454_object120622:head# 2024-04-01T19:48:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7acb76fd:::benchmark_data_smithi188_134454_object130446:head# 2024-04-01T19:48:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7acc29d7:::benchmark_data_smithi188_134454_object124230:head# 2024-04-01T19:48:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7acd898c:::benchmark_data_smithi188_134454_object139703:head# 2024-04-01T19:48:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ace8a2d:::benchmark_data_smithi188_134454_object130259:head# 2024-04-01T19:48:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ad0682c:::benchmark_data_smithi188_134454_object125595:head# 2024-04-01T19:48:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ad0c260:::benchmark_data_smithi188_134454_object125499:head# 2024-04-01T19:48:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ad1fee0:::benchmark_data_smithi188_134454_object156605:head# 2024-04-01T19:48:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ad21c02:::benchmark_data_smithi188_134454_object124276:head# 2024-04-01T19:48:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ad31bee:::benchmark_data_smithi188_134454_object149998:head# 2024-04-01T19:48:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ad53f09:::benchmark_data_smithi188_134454_object146280:head# 2024-04-01T19:48:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ad544dd:::benchmark_data_smithi188_134454_object151479:head# 2024-04-01T19:48:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ad67b75:::benchmark_data_smithi188_134454_object118275:head# 2024-04-01T19:48:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ad833dc:::benchmark_data_smithi188_134454_object121840:head# 2024-04-01T19:48:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7adb7658:::benchmark_data_smithi188_134454_object121261:head# 2024-04-01T19:48:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7add5929:::benchmark_data_smithi188_134454_object144926:head# 2024-04-01T19:48:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ae38e65:::benchmark_data_smithi188_134454_object154096:head# 2024-04-01T19:48:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ae491ff:::benchmark_data_smithi188_134454_object125500:head# 2024-04-01T19:48:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ae7f00f:::benchmark_data_smithi188_134454_object148471:head# 2024-04-01T19:48:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ae89212:::benchmark_data_smithi188_134454_object142745:head# 2024-04-01T19:48:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7aec2eab:::benchmark_data_smithi188_134454_object119512:head# 2024-04-01T19:48:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7aedb4b0:::benchmark_data_smithi188_134454_object134937:head# 2024-04-01T19:48:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7aedcfe9:::benchmark_data_smithi188_134454_object136659:head# 2024-04-01T19:48:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7aee3f2a:::benchmark_data_smithi188_134454_object116007:head# 2024-04-01T19:48:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7aee5fc9:::benchmark_data_smithi188_134454_object150302:head# 2024-04-01T19:48:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7aeeafa2:::benchmark_data_smithi188_134454_object148089:head# 2024-04-01T19:48:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7af1af0b:::benchmark_data_smithi188_134454_object119963:head# 2024-04-01T19:48:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7af416d6:::benchmark_data_smithi188_134454_object132815:head# 2024-04-01T19:48:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7af512b9:::benchmark_data_smithi188_134454_object116350:head# 2024-04-01T19:48:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7af5acfe:::benchmark_data_smithi188_134454_object126204:head# 2024-04-01T19:48:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7afa3752:::benchmark_data_smithi188_134454_object115779:head# 2024-04-01T19:48:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7afbcab0:::benchmark_data_smithi188_134454_object119822:head# 2024-04-01T19:48:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7afe5b57:::benchmark_data_smithi188_134454_object143052:head# 2024-04-01T19:48:47.241 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7aff87e6:::benchmark_data_smithi188_134454_object137045:head# 2024-04-01T19:48:47.241 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b018658:::benchmark_data_smithi188_134454_object120469:head# 2024-04-01T19:48:47.241 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b02e914:::benchmark_data_smithi188_134454_object131459:head# 2024-04-01T19:48:47.241 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b037353:::benchmark_data_smithi188_134454_object128043:head# 2024-04-01T19:48:47.241 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b0374bb:::benchmark_data_smithi188_134454_object146166:head# 2024-04-01T19:48:47.242 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b03cd71:::benchmark_data_smithi188_134454_object121390:head# 2024-04-01T19:48:47.242 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b08fda1:::benchmark_data_smithi188_134454_object133721:head# 2024-04-01T19:48:47.242 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b0c34f6:::benchmark_data_smithi188_134454_object148247:head# 2024-04-01T19:48:47.246 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b0d3dca:::benchmark_data_smithi188_134454_object116553:head# 2024-04-01T19:48:47.246 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b127378:::benchmark_data_smithi188_134454_object133275:head# 2024-04-01T19:48:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b1297f7:::benchmark_data_smithi188_134454_object121843:head# 2024-04-01T19:48:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b12ab3c:::benchmark_data_smithi188_134454_object127920:head# 2024-04-01T19:48:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b135095:::benchmark_data_smithi188_134454_object155194:head# 2024-04-01T19:48:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b160dce:::benchmark_data_smithi188_134454_object126307:head# 2024-04-01T19:48:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b162d15:::benchmark_data_smithi188_134454_object154839:head# 2024-04-01T19:48:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b191bb1:::benchmark_data_smithi188_134454_object134255:head# 2024-04-01T19:48:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b1a9752:::benchmark_data_smithi188_134454_object125002:head# 2024-04-01T19:48:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b1ab877:::benchmark_data_smithi188_134454_object124935:head# 2024-04-01T19:48:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b1cd429:::benchmark_data_smithi188_134454_object129461:head# 2024-04-01T19:48:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b1dc566:::benchmark_data_smithi188_134454_object135054:head# 2024-04-01T19:48:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b1e1ccb:::benchmark_data_smithi188_134454_object153962:head# 2024-04-01T19:48:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b1e2e4b:::benchmark_data_smithi188_134454_object150263:head# 2024-04-01T19:48:47.248 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b1f2594:::benchmark_data_smithi188_134454_object136946:head# 2024-04-01T19:48:47.248 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b262915:::benchmark_data_smithi188_134454_object156001:head# 2024-04-01T19:48:47.248 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b294d78:::benchmark_data_smithi188_134454_object131770:head# 2024-04-01T19:48:47.248 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b299588:::benchmark_data_smithi188_134454_object138530:head# 2024-04-01T19:48:47.248 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b2c8328:::benchmark_data_smithi188_134454_object151888:head# 2024-04-01T19:48:47.248 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b2cf3a4:::benchmark_data_smithi188_134454_object156477:head# 2024-04-01T19:48:47.249 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b2e187f:::benchmark_data_smithi188_134454_object126783:head# 2024-04-01T19:48:47.249 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b2eb39b:::benchmark_data_smithi188_134454_object146413:head# 2024-04-01T19:48:47.249 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b33c26a:::benchmark_data_smithi188_134454_object127000:head# 2024-04-01T19:48:47.249 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b34056a:::benchmark_data_smithi188_134454_object140527:head# 2024-04-01T19:48:47.249 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b34da3c:::benchmark_data_smithi188_134454_object118235:head# 2024-04-01T19:48:47.250 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b3b5e14:::benchmark_data_smithi188_134454_object124835:head# 2024-04-01T19:48:47.250 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b3cbb38:::benchmark_data_smithi188_134454_object117109:head# 2024-04-01T19:48:47.250 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b3e8483:::benchmark_data_smithi188_134454_object117496:head# 2024-04-01T19:48:47.250 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b4098d2:::benchmark_data_smithi188_134454_object136583:head# 2024-04-01T19:48:47.250 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b4127f7:::benchmark_data_smithi188_134454_object146825:head# 2024-04-01T19:48:47.250 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b426e60:::benchmark_data_smithi188_134454_object149182:head# 2024-04-01T19:48:47.250 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b427651:::benchmark_data_smithi188_134454_object150992:head# 2024-04-01T19:48:47.251 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b42e5a4:::benchmark_data_smithi188_134454_object118551:head# 2024-04-01T19:48:47.251 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b42f4b4:::benchmark_data_smithi188_134454_object137260:head# 2024-04-01T19:48:47.251 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b479e1a:::benchmark_data_smithi188_134454_object116946:head# 2024-04-01T19:48:47.251 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b47fd5e:::benchmark_data_smithi188_134454_object147766:head# 2024-04-01T19:48:47.251 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b4974f3:::benchmark_data_smithi188_134454_object151970:head# 2024-04-01T19:48:47.251 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b4c44ae:::benchmark_data_smithi188_134454_object139181:head# 2024-04-01T19:48:47.252 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:47.252 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b4c7779:::benchmark_data_smithi188_134454_object129613:head# 2024-04-01T19:48:47.252 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b4dea07:::benchmark_data_smithi188_134454_object140970:head# 2024-04-01T19:48:47.252 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b4e60f9:::benchmark_data_smithi188_134454_object125336:head# 2024-04-01T19:48:47.252 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b4f9174:::benchmark_data_smithi188_134454_object132333:head# 2024-04-01T19:48:47.252 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b53a83a:::benchmark_data_smithi188_134454_object146075:head# 2024-04-01T19:48:47.253 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b54224b:::benchmark_data_smithi188_134454_object143070:head# 2024-04-01T19:48:47.253 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b561284:::benchmark_data_smithi188_134454_object155197:head# 2024-04-01T19:48:47.257 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b58265d:::benchmark_data_smithi188_134454_object123989:head# 2024-04-01T19:48:47.257 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b597c0c:::benchmark_data_smithi188_134454_object140284:head# 2024-04-01T19:48:47.257 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b5a54d8:::benchmark_data_smithi188_134454_object122399:head# 2024-04-01T19:48:47.257 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b5c29fe:::benchmark_data_smithi188_134454_object148875:head# 2024-04-01T19:48:47.257 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b5cb8ed:::benchmark_data_smithi188_134454_object119925:head# 2024-04-01T19:48:47.257 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b5d0850:::benchmark_data_smithi188_134454_object142991:head# 2024-04-01T19:48:47.257 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b620854:::benchmark_data_smithi188_134454_object126794:head# 2024-04-01T19:48:47.257 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b641e46:::benchmark_data_smithi188_134454_object128954:head# 2024-04-01T19:48:47.258 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b64f85b:::benchmark_data_smithi188_134454_object138346:head# 2024-04-01T19:48:47.258 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b67bd83:::benchmark_data_smithi188_134454_object119930:head# 2024-04-01T19:48:47.258 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b699ee4:::benchmark_data_smithi188_134454_object156526:head# 2024-04-01T19:48:47.258 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b6be71b:::benchmark_data_smithi188_134454_object131288:head# 2024-04-01T19:48:47.258 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b6c434d:::benchmark_data_smithi188_134454_object151021:head# 2024-04-01T19:48:47.258 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b6d9fc7:::benchmark_data_smithi188_134454_object146387:head# 2024-04-01T19:48:47.258 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b6e22c6:::benchmark_data_smithi188_134454_object153347:head# 2024-04-01T19:48:47.258 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b6ec0f7:::benchmark_data_smithi188_134454_object115772:head# 2024-04-01T19:48:47.258 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b781674:::benchmark_data_smithi188_134454_object130365:head# 2024-04-01T19:48:47.258 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b7a5294:::benchmark_data_smithi188_134454_object151759:head# 2024-04-01T19:48:47.258 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b7c06c7:::benchmark_data_smithi188_134454_object148768:head# 2024-04-01T19:48:47.259 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b7c6576:::benchmark_data_smithi188_134454_object148975:head# 2024-04-01T19:48:47.259 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b7e53ef:::benchmark_data_smithi188_134454_object146292:head# 2024-04-01T19:48:47.259 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b7f7a23:::benchmark_data_smithi188_134454_object153425:head# 2024-04-01T19:48:47.259 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b81a645:::benchmark_data_smithi188_134454_object130689:head# 2024-04-01T19:48:47.260 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b85887b:::benchmark_data_smithi188_134454_object128046:head# 2024-04-01T19:48:47.260 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b87aadb:::benchmark_data_smithi188_134454_object134371:head# 2024-04-01T19:48:47.260 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b87baea:::benchmark_data_smithi188_134454_object123629:head# 2024-04-01T19:48:47.260 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b87e04a:::benchmark_data_smithi188_134454_object126717:head# 2024-04-01T19:48:47.268 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b89bc68:::benchmark_data_smithi188_134454_object144020:head# 2024-04-01T19:48:47.268 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b8a89ec:::benchmark_data_smithi188_134454_object127195:head# 2024-04-01T19:48:47.268 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b91b9ce:::benchmark_data_smithi188_134454_object145500:head# 2024-04-01T19:48:47.268 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b9222bd:::benchmark_data_smithi188_134454_object132258:head# 2024-04-01T19:48:47.268 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b93fd1c:::benchmark_data_smithi188_134454_object144352:head# 2024-04-01T19:48:47.268 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b9413d3:::benchmark_data_smithi188_134454_object117087:head# 2024-04-01T19:48:47.268 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b9478b6:::benchmark_data_smithi188_134454_object127736:head# 2024-04-01T19:48:47.269 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b9731dd:::benchmark_data_smithi188_134454_object148476:head# 2024-04-01T19:48:47.269 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b99a3c1:::benchmark_data_smithi188_134454_object141756:head# 2024-04-01T19:48:47.269 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b9b0e07:::benchmark_data_smithi188_134454_object133745:head# 2024-04-01T19:48:47.269 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b9b196d:::benchmark_data_smithi188_134454_object137656:head# 2024-04-01T19:48:47.269 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b9be094:::benchmark_data_smithi188_134454_object156340:head# 2024-04-01T19:48:47.269 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b9e5f90:::benchmark_data_smithi188_134454_object123701:head# 2024-04-01T19:48:47.269 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7b9f490e:::benchmark_data_smithi188_134454_object124916:head# 2024-04-01T19:48:47.269 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ba04c6d:::benchmark_data_smithi188_134454_object127771:head# 2024-04-01T19:48:47.269 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ba1ee79:::benchmark_data_smithi188_134454_object126071:head# 2024-04-01T19:48:47.269 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ba3bdd9:::benchmark_data_smithi188_134454_object125497:head# 2024-04-01T19:48:47.269 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ba4e384:::benchmark_data_smithi188_134454_object123024:head# 2024-04-01T19:48:47.269 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ba62936:::benchmark_data_smithi188_134454_object116543:head# 2024-04-01T19:48:47.269 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bac16d1:::benchmark_data_smithi188_134454_object117263:head# 2024-04-01T19:48:47.270 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bb0581a:::benchmark_data_smithi188_134454_object115447:head# 2024-04-01T19:48:47.270 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bb0ae16:::benchmark_data_smithi188_134454_object117488:head# 2024-04-01T19:48:47.270 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bb359d8:::benchmark_data_smithi188_134454_object139730:head# 2024-04-01T19:48:47.270 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bb3d438:::benchmark_data_smithi188_134454_object132692:head# 2024-04-01T19:48:47.270 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bb6c373:::benchmark_data_smithi188_134454_object128572:head# 2024-04-01T19:48:47.270 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bb7822e:::benchmark_data_smithi188_134454_object125062:head# 2024-04-01T19:48:47.270 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bba47cb:::benchmark_data_smithi188_134454_object144759:head# 2024-04-01T19:48:47.270 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bba59bd:::benchmark_data_smithi188_134454_object147796:head# 2024-04-01T19:48:47.270 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bbb2569:::benchmark_data_smithi188_134454_object127959:head# 2024-04-01T19:48:47.270 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bbb5ca9:::benchmark_data_smithi188_134454_object140218:head# 2024-04-01T19:48:47.270 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bbf583c:::benchmark_data_smithi188_134454_object127804:head# 2024-04-01T19:48:47.270 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bc06f40:::benchmark_data_smithi188_134454_object154882:head# 2024-04-01T19:48:47.270 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bc19a72:::benchmark_data_smithi188_134454_object127005:head# 2024-04-01T19:48:47.271 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bc1baaa:::benchmark_data_smithi188_134454_object119076:head# 2024-04-01T19:48:47.271 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bc2fa25:::benchmark_data_smithi188_134454_object134747:head# 2024-04-01T19:48:47.271 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bc5ceea:::benchmark_data_smithi188_134454_object121139:head# 2024-04-01T19:48:47.271 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bc5e6bd:::benchmark_data_smithi188_134454_object146119:head# 2024-04-01T19:48:47.271 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bc6c2ee:::benchmark_data_smithi188_134454_object129363:head# 2024-04-01T19:48:47.271 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bc72790:::benchmark_data_smithi188_134454_object149915:head# 2024-04-01T19:48:47.271 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bc87c2a:::benchmark_data_smithi188_134454_object120423:head# 2024-04-01T19:48:47.271 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bc87c89:::benchmark_data_smithi188_134454_object151376:head# 2024-04-01T19:48:47.271 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bc9113c:::benchmark_data_smithi188_134454_object141123:head# 2024-04-01T19:48:47.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bc9346d:::benchmark_data_smithi188_134454_object154735:head# 2024-04-01T19:48:47.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bc9b328:::benchmark_data_smithi188_134454_object139098:head# 2024-04-01T19:48:47.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bca0c45:::benchmark_data_smithi188_134454_object154510:head# 2024-04-01T19:48:47.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bcb3553:::benchmark_data_smithi188_134454_object123387:head# 2024-04-01T19:48:47.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bcce52d:::benchmark_data_smithi188_134454_object149784:head# 2024-04-01T19:48:47.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bce28ae:::benchmark_data_smithi188_134454_object148495:head# 2024-04-01T19:48:47.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bce7c37:::benchmark_data_smithi188_134454_object119845:head# 2024-04-01T19:48:47.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bcef3ed:::benchmark_data_smithi188_134454_object119144:head# 2024-04-01T19:48:47.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bcf38f1:::benchmark_data_smithi188_134454_object151558:head# 2024-04-01T19:48:47.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bcfcdaf:::benchmark_data_smithi188_134454_object153758:head# 2024-04-01T19:48:47.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bd1711b:::benchmark_data_smithi188_134454_object139806:head# 2024-04-01T19:48:47.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bd439db:::benchmark_data_smithi188_134454_object139751:head# 2024-04-01T19:48:47.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bd4d01e:::benchmark_data_smithi188_134454_object149674:head# 2024-04-01T19:48:47.274 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bd94642:::benchmark_data_smithi188_134454_object132667:head# 2024-04-01T19:48:47.274 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bd98a72:::benchmark_data_smithi188_134454_object116739:head# 2024-04-01T19:48:47.274 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bdb8c85:::benchmark_data_smithi188_134454_object121039:head# 2024-04-01T19:48:47.274 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:48:47.275 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:47.276 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:48:47.277 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bdc4a86:::benchmark_data_smithi188_134454_object140380:head# 2024-04-01T19:48:47.277 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bdf2f34:::benchmark_data_smithi188_134454_object140587:head# 2024-04-01T19:48:47.277 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bdfc839:::benchmark_data_smithi188_134454_object155359:head# 2024-04-01T19:48:47.277 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7be4aa46:::benchmark_data_smithi188_134454_object154055:head# 2024-04-01T19:48:47.277 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7be6ef03:::benchmark_data_smithi188_134454_object156145:head# 2024-04-01T19:48:47.277 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7be83762:::benchmark_data_smithi188_134454_object117999:head# 2024-04-01T19:48:47.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bea1149:::benchmark_data_smithi188_134454_object153956:head# 2024-04-01T19:48:47.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7beb1e4b:::benchmark_data_smithi188_134454_object141737:head# 2024-04-01T19:48:47.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bec102d:::benchmark_data_smithi188_134454_object151051:head# 2024-04-01T19:48:47.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7becafb7:::benchmark_data_smithi188_134454_object146278:head# 2024-04-01T19:48:47.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bee470f:::benchmark_data_smithi188_134454_object152725:head# 2024-04-01T19:48:47.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7beeb97d:::benchmark_data_smithi188_134454_object126674:head# 2024-04-01T19:48:47.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bef6db4:::benchmark_data_smithi188_134454_object122269:head# 2024-04-01T19:48:47.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7befb8b1:::benchmark_data_smithi188_134454_object127666:head# 2024-04-01T19:48:47.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bf1aa7b:::benchmark_data_smithi188_134454_object147603:head# 2024-04-01T19:48:47.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bf2aa86:::benchmark_data_smithi188_134454_object152984:head# 2024-04-01T19:48:47.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bf4065b:::benchmark_data_smithi188_134454_object134201:head# 2024-04-01T19:48:47.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bf422e5:::benchmark_data_smithi188_134454_object127429:head# 2024-04-01T19:48:47.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bf521f6:::benchmark_data_smithi188_134454_object142765:head# 2024-04-01T19:48:47.279 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bfaf74e:::benchmark_data_smithi188_134454_object146675:head# 2024-04-01T19:48:47.279 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bfb9395:::benchmark_data_smithi188_134454_object119684:head# 2024-04-01T19:48:47.279 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bfb99a0:::benchmark_data_smithi188_134454_object126877:head# 2024-04-01T19:48:47.280 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bfd4caf:::benchmark_data_smithi188_134454_object150867:head# 2024-04-01T19:48:47.280 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7bfe899c:::benchmark_data_smithi188_134454_object135623:head# 2024-04-01T19:48:47.280 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c03ce3a:::benchmark_data_smithi188_134454_object122772:head# 2024-04-01T19:48:47.280 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c0acfb6:::benchmark_data_smithi188_134454_object142065:head# 2024-04-01T19:48:47.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c0b3b1b:::benchmark_data_smithi188_134454_object117548:head# 2024-04-01T19:48:47.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c0cb075:::benchmark_data_smithi188_134454_object156373:head# 2024-04-01T19:48:47.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c0ddeca:::benchmark_data_smithi188_134454_object117744:head# 2024-04-01T19:48:47.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c10db01:::benchmark_data_smithi188_134454_object153697:head# 2024-04-01T19:48:47.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c1118a0:::benchmark_data_smithi188_134454_object127478:head# 2024-04-01T19:48:47.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c113c41:::benchmark_data_smithi188_134454_object120521:head# 2024-04-01T19:48:47.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c11c08e:::benchmark_data_smithi188_134454_object142160:head# 2024-04-01T19:48:47.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c1200de:::benchmark_data_smithi188_134454_object123236:head# 2024-04-01T19:48:47.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c123902:::benchmark_data_smithi188_134454_object135386:head# 2024-04-01T19:48:47.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c156af3:::benchmark_data_smithi188_134454_object156686:head# 2024-04-01T19:48:47.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c196913:::benchmark_data_smithi188_134454_object149484:head# 2024-04-01T19:48:47.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c19a808:::benchmark_data_smithi188_134454_object121894:head# 2024-04-01T19:48:47.283 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c1ac9df:::benchmark_data_smithi188_134454_object145264:head# 2024-04-01T19:48:47.283 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c1b04e3:::benchmark_data_smithi188_134454_object127279:head# 2024-04-01T19:48:47.283 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c1b3531:::benchmark_data_smithi188_134454_object143599:head# 2024-04-01T19:48:47.283 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c1de816:::benchmark_data_smithi188_134454_object123160:head# 2024-04-01T19:48:47.284 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c217e48:::benchmark_data_smithi188_134454_object156428:head# 2024-04-01T19:48:47.284 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c24e97d:::benchmark_data_smithi188_134454_object126672:head# 2024-04-01T19:48:47.284 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c25f879:::benchmark_data_smithi188_134454_object124497:head# 2024-04-01T19:48:47.284 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c29bd26:::benchmark_data_smithi188_134454_object129990:head# 2024-04-01T19:48:47.284 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c2aee55:::benchmark_data_smithi188_134454_object135887:head# 2024-04-01T19:48:47.284 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c2ca24b:::benchmark_data_smithi188_134454_object121828:head# 2024-04-01T19:48:47.284 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c2d0a04:::benchmark_data_smithi188_134454_object120870:head# 2024-04-01T19:48:47.284 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c305d43:::benchmark_data_smithi188_134454_object118874:head# 2024-04-01T19:48:47.284 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c329cf8:::benchmark_data_smithi188_134454_object154421:head# 2024-04-01T19:48:47.285 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c338fe2:::benchmark_data_smithi188_134454_object141608:head# 2024-04-01T19:48:47.285 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c34011f:::benchmark_data_smithi188_134454_object123796:head# 2024-04-01T19:48:47.285 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c34cbc8:::benchmark_data_smithi188_134454_object126292:head# 2024-04-01T19:48:47.288 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c388189:::benchmark_data_smithi188_134454_object148840:head# 2024-04-01T19:48:47.288 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c391a41:::benchmark_data_smithi188_134454_object130917:head# 2024-04-01T19:48:47.288 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c39d900:::benchmark_data_smithi188_134454_object143427:head# 2024-04-01T19:48:47.288 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c3b49f6:::benchmark_data_smithi188_134454_object120207:head# 2024-04-01T19:48:47.288 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c3b6d0c:::benchmark_data_smithi188_134454_object139417:head# 2024-04-01T19:48:47.288 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c3c193d:::benchmark_data_smithi188_134454_object138148:head# 2024-04-01T19:48:47.288 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c3e6b4f:::benchmark_data_smithi188_134454_object147367:head# 2024-04-01T19:48:47.289 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c3f3a34:::benchmark_data_smithi188_134454_object140384:head# 2024-04-01T19:48:47.289 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c406186:::benchmark_data_smithi188_134454_object144830:head# 2024-04-01T19:48:47.289 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c42d921:::benchmark_data_smithi188_134454_object140068:head# 2024-04-01T19:48:47.289 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c481a58:::benchmark_data_smithi188_134454_object142847:head# 2024-04-01T19:48:47.290 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c488f88:::benchmark_data_smithi188_134454_object148790:head# 2024-04-01T19:48:47.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c4916c4:::benchmark_data_smithi188_134454_object151705:head# 2024-04-01T19:48:47.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c4b3827:::benchmark_data_smithi188_134454_object151821:head# 2024-04-01T19:48:47.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c4e7704:::benchmark_data_smithi188_134454_object137560:head# 2024-04-01T19:48:47.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c4e8b1b:::benchmark_data_smithi188_134454_object145511:head# 2024-04-01T19:48:47.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c4f2450:::benchmark_data_smithi188_134454_object143547:head# 2024-04-01T19:48:47.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c4fc394:::benchmark_data_smithi188_134454_object125835:head# 2024-04-01T19:48:47.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c4ff3f0:::benchmark_data_smithi188_134454_object123094:head# 2024-04-01T19:48:47.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c514f44:::benchmark_data_smithi188_134454_object119996:head# 2024-04-01T19:48:47.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c518e56:::benchmark_data_smithi188_134454_object130978:head# 2024-04-01T19:48:47.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c53a6a1:::benchmark_data_smithi188_134454_object125995:head# 2024-04-01T19:48:47.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c53f2e7:::benchmark_data_smithi188_134454_object127351:head# 2024-04-01T19:48:47.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c55db27:::benchmark_data_smithi188_134454_object156451:head# 2024-04-01T19:48:47.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c56564f:::benchmark_data_smithi188_134454_object140504:head# 2024-04-01T19:48:47.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c58373c:::benchmark_data_smithi188_134454_object149586:head# 2024-04-01T19:48:47.292 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c5930fa:::benchmark_data_smithi188_134454_object136030:head# 2024-04-01T19:48:47.292 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c5a4144:::benchmark_data_smithi188_134454_object124668:head# 2024-04-01T19:48:47.292 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c5bc1ed:::benchmark_data_smithi188_134454_object144194:head# 2024-04-01T19:48:47.297 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c5bee21:::benchmark_data_smithi188_134454_object154841:head# 2024-04-01T19:48:47.297 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c5c7ae2:::benchmark_data_smithi188_134454_object139390:head# 2024-04-01T19:48:47.297 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c5f30cf:::benchmark_data_smithi188_134454_object142852:head# 2024-04-01T19:48:47.297 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c62ff7b:::benchmark_data_smithi188_134454_object136244:head# 2024-04-01T19:48:47.297 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c633b55:::benchmark_data_smithi188_134454_object124300:head# 2024-04-01T19:48:47.297 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c64cfe1:::benchmark_data_smithi188_134454_object134650:head# 2024-04-01T19:48:47.297 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c67ce36:::benchmark_data_smithi188_134454_object152962:head# 2024-04-01T19:48:47.297 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c6d97f2:::benchmark_data_smithi188_134454_object139409:head# 2024-04-01T19:48:47.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c6e1c84:::benchmark_data_smithi188_134454_object121862:head# 2024-04-01T19:48:47.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c6e4456:::benchmark_data_smithi188_134454_object120684:head# 2024-04-01T19:48:47.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c719dc3:::benchmark_data_smithi188_134454_object123050:head# 2024-04-01T19:48:47.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c7279be:::benchmark_data_smithi188_134454_object132707:head# 2024-04-01T19:48:47.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c763e21:::benchmark_data_smithi188_134454_object141735:head# 2024-04-01T19:48:47.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c76d7ea:::benchmark_data_smithi188_134454_object134016:head# 2024-04-01T19:48:47.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c77ed06:::benchmark_data_smithi188_134454_object146253:head# 2024-04-01T19:48:47.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c793ca7:::benchmark_data_smithi188_134454_object127317:head# 2024-04-01T19:48:47.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c7c3839:::benchmark_data_smithi188_134454_object139583:head# 2024-04-01T19:48:47.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c7c9d88:::benchmark_data_smithi188_134454_object151513:head# 2024-04-01T19:48:47.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c7e311b:::benchmark_data_smithi188_134454_object120831:head# 2024-04-01T19:48:47.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c80cb31:::benchmark_data_smithi188_134454_object133605:head# 2024-04-01T19:48:47.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c8190d8:::benchmark_data_smithi188_134454_object147161:head# 2024-04-01T19:48:47.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c81fe6f:::benchmark_data_smithi188_134454_object123284:head# 2024-04-01T19:48:47.299 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c835f1e:::benchmark_data_smithi188_134454_object143780:head# 2024-04-01T19:48:47.299 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c8399a9:::benchmark_data_smithi188_134454_object122631:head# 2024-04-01T19:48:47.299 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c8590a4:::benchmark_data_smithi188_134454_object148340:head# 2024-04-01T19:48:47.299 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c85d696:::benchmark_data_smithi188_134454_object119352:head# 2024-04-01T19:48:47.299 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c864907:::benchmark_data_smithi188_134454_object126343:head# 2024-04-01T19:48:47.299 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c866d6b:::benchmark_data_smithi188_134454_object128061:head# 2024-04-01T19:48:47.299 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c886f46:::benchmark_data_smithi188_134454_object131115:head# 2024-04-01T19:48:47.300 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c89f7b0:::benchmark_data_smithi188_134454_object125582:head# 2024-04-01T19:48:47.300 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c8a5e02:::benchmark_data_smithi188_134454_object124572:head# 2024-04-01T19:48:47.300 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c8c9b6f:::benchmark_data_smithi188_134454_object147798:head# 2024-04-01T19:48:47.300 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c8ce0d2:::benchmark_data_smithi188_134454_object152620:head# 2024-04-01T19:48:47.300 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c8d120d:::benchmark_data_smithi188_134454_object151340:head# 2024-04-01T19:48:47.300 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c8d51ad:::benchmark_data_smithi188_134454_object141591:head# 2024-04-01T19:48:47.300 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c8d7417:::benchmark_data_smithi188_134454_object139753:head# 2024-04-01T19:48:47.300 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c8f4911:::benchmark_data_smithi188_134454_object121585:head# 2024-04-01T19:48:47.300 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c9399b0:::benchmark_data_smithi188_134454_object124192:head# 2024-04-01T19:48:47.301 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:48:47.301 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c95415a:::benchmark_data_smithi188_134454_object126886:head# 2024-04-01T19:48:47.302 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c96622e:::benchmark_data_smithi188_134454_object134932:head# 2024-04-01T19:48:47.302 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c969e5b:::benchmark_data_smithi188_134454_object152794:head# 2024-04-01T19:48:47.302 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c97ae8f:::benchmark_data_smithi188_134454_object136159:head# 2024-04-01T19:48:47.302 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c9ae82e:::benchmark_data_smithi188_134454_object155512:head# 2024-04-01T19:48:47.302 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c9cc8dc:::benchmark_data_smithi188_134454_object151300:head# 2024-04-01T19:48:47.306 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c9d668e:::benchmark_data_smithi188_134454_object143692:head# 2024-04-01T19:48:47.306 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c9e8d61:::benchmark_data_smithi188_134454_object134522:head# 2024-04-01T19:48:47.307 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7c9f4d52:::benchmark_data_smithi188_134454_object122285:head# 2024-04-01T19:48:47.307 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ca3cc89:::benchmark_data_smithi188_134454_object133976:head# 2024-04-01T19:48:47.307 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ca50bdb:::benchmark_data_smithi188_134454_object122275:head# 2024-04-01T19:48:47.307 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ca7301d:::benchmark_data_smithi188_134454_object122089:head# 2024-04-01T19:48:47.307 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ca78b0a:::benchmark_data_smithi188_134454_object153295:head# 2024-04-01T19:48:47.310 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7caa642a:::benchmark_data_smithi188_134454_object139717:head# 2024-04-01T19:48:47.310 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cab7f56:::benchmark_data_smithi188_134454_object151612:head# 2024-04-01T19:48:47.310 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cac098a:::benchmark_data_smithi188_134454_object120006:head# 2024-04-01T19:48:47.310 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cac7107:::benchmark_data_smithi188_134454_object125343:head# 2024-04-01T19:48:47.310 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cad6bb1:::benchmark_data_smithi188_134454_object144378:head# 2024-04-01T19:48:47.310 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cb5dc1c:::benchmark_data_smithi188_134454_object146415:head# 2024-04-01T19:48:47.310 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cb6f277:::benchmark_data_smithi188_134454_object133813:head# 2024-04-01T19:48:47.311 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cb72784:::benchmark_data_smithi188_134454_object145658:head# 2024-04-01T19:48:47.311 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cb7d0d4:::benchmark_data_smithi188_134454_object120057:head# 2024-04-01T19:48:47.311 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cba570d:::benchmark_data_smithi188_134454_object125132:head# 2024-04-01T19:48:47.312 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cba8f4c:::benchmark_data_smithi188_134454_object127976:head# 2024-04-01T19:48:47.312 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cbb545c:::benchmark_data_smithi188_134454_object146947:head# 2024-04-01T19:48:47.312 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cbf3ab1:::benchmark_data_smithi188_134454_object142219:head# 2024-04-01T19:48:47.313 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cc5c57c:::benchmark_data_smithi188_134454_object135822:head# 2024-04-01T19:48:47.313 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cc5d692:::benchmark_data_smithi188_134454_object136206:head# 2024-04-01T19:48:47.313 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ccadc39:::benchmark_data_smithi188_134454_object137222:head# 2024-04-01T19:48:47.313 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ccb9d58:::benchmark_data_smithi188_134454_object149851:head# 2024-04-01T19:48:47.314 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cccd356:::benchmark_data_smithi188_134454_object123821:head# 2024-04-01T19:48:47.314 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ccec4e4:::benchmark_data_smithi188_134454_object129810:head# 2024-04-01T19:48:47.314 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ccfd05a:::benchmark_data_smithi188_134454_object137697:head# 2024-04-01T19:48:47.314 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cd1deb5:::benchmark_data_smithi188_134454_object138714:head# 2024-04-01T19:48:47.315 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cd24676:::benchmark_data_smithi188_134454_object153229:head# 2024-04-01T19:48:47.315 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cd30319:::benchmark_data_smithi188_134454_object137742:head# 2024-04-01T19:48:47.315 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cd33206:::benchmark_data_smithi188_134454_object152921:head# 2024-04-01T19:48:47.315 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cd37591:::benchmark_data_smithi188_134454_object126883:head# 2024-04-01T19:48:47.315 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cd59dc5:::benchmark_data_smithi188_134454_object151188:head# 2024-04-01T19:48:47.316 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cd7cac0:::benchmark_data_smithi188_134454_object150614:head# 2024-04-01T19:48:47.316 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cd80880:::benchmark_data_smithi188_134454_object147889:head# 2024-04-01T19:48:47.316 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cda4097:::benchmark_data_smithi188_134454_object139235:head# 2024-04-01T19:48:47.316 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cda8add:::benchmark_data_smithi188_134454_object146158:head# 2024-04-01T19:48:47.316 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cdf7493:::benchmark_data_smithi188_134454_object140010:head# 2024-04-01T19:48:47.316 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ce0405d:::benchmark_data_smithi188_134454_object149835:head# 2024-04-01T19:48:47.318 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ce0d70b:::benchmark_data_smithi188_134454_object146579:head# 2024-04-01T19:48:47.318 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ce0dd05:::benchmark_data_smithi188_134454_object143850:head# 2024-04-01T19:48:47.318 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ce16554:::benchmark_data_smithi188_134454_object135703:head# 2024-04-01T19:48:47.318 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ce1be56:::benchmark_data_smithi188_134454_object128331:head# 2024-04-01T19:48:47.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ce1c196:::benchmark_data_smithi188_134454_object148224:head# 2024-04-01T19:48:47.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ce210fa:::benchmark_data_smithi188_134454_object152455:head# 2024-04-01T19:48:47.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ce234b7:::benchmark_data_smithi188_134454_object129341:head# 2024-04-01T19:48:47.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ce2d9ea:::benchmark_data_smithi188_134454_object143904:head# 2024-04-01T19:48:47.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ce61434:::benchmark_data_smithi188_134454_object129483:head# 2024-04-01T19:48:47.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ce75ab7:::benchmark_data_smithi188_134454_object139264:head# 2024-04-01T19:48:47.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ce7c220:::benchmark_data_smithi188_134454_object143054:head# 2024-04-01T19:48:47.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ce8268f:::benchmark_data_smithi188_134454_object129324:head# 2024-04-01T19:48:47.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ce8ba56:::benchmark_data_smithi188_134454_object130658:head# 2024-04-01T19:48:47.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ceb3472:::benchmark_data_smithi188_134454_object147752:head# 2024-04-01T19:48:47.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cedad24:::benchmark_data_smithi188_134454_object147799:head# 2024-04-01T19:48:47.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cef122c:::benchmark_data_smithi188_134454_object127235:head# 2024-04-01T19:48:47.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cf00dee:::benchmark_data_smithi188_134454_object155075:head# 2024-04-01T19:48:47.323 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cf36b9e:::benchmark_data_smithi188_134454_object121672:head# 2024-04-01T19:48:47.323 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cf3d72f:::benchmark_data_smithi188_134454_object131548:head# 2024-04-01T19:48:47.323 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cf4108d:::benchmark_data_smithi188_134454_object118461:head# 2024-04-01T19:48:47.323 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cf63d0d:::benchmark_data_smithi188_134454_object116881:head# 2024-04-01T19:48:47.323 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cf8d023:::benchmark_data_smithi188_134454_object128190:head# 2024-04-01T19:48:47.323 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cf97dfc:::benchmark_data_smithi188_134454_object153112:head# 2024-04-01T19:48:47.323 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cf9da1f:::benchmark_data_smithi188_134454_object145157:head# 2024-04-01T19:48:47.323 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cfad59b:::benchmark_data_smithi188_134454_object135111:head# 2024-04-01T19:48:47.323 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cfade86:::benchmark_data_smithi188_134454_object146532:head# 2024-04-01T19:48:47.324 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cfaed26:::benchmark_data_smithi188_134454_object125144:head# 2024-04-01T19:48:47.324 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cfb3db2:::benchmark_data_smithi188_134454_object123522:head# 2024-04-01T19:48:47.325 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7cff1ff4:::benchmark_data_smithi188_134454_object147598:head# 2024-04-01T19:48:47.325 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d019f7c:::benchmark_data_smithi188_134454_object124983:head# 2024-04-01T19:48:47.325 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d02073a:::benchmark_data_smithi188_134454_object118223:head# 2024-04-01T19:48:47.325 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d023bbb:::benchmark_data_smithi188_134454_object135201:head# 2024-04-01T19:48:47.325 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d034763:::benchmark_data_smithi188_134454_object153875:head# 2024-04-01T19:48:47.325 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d07fe27:::benchmark_data_smithi188_134454_object140791:head# 2024-04-01T19:48:47.325 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d08828d:::benchmark_data_smithi188_134454_object131536:head# 2024-04-01T19:48:47.325 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d09b746:::benchmark_data_smithi188_134454_object146012:head# 2024-04-01T19:48:47.326 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d0a8061:::benchmark_data_smithi188_134454_object124159:head# 2024-04-01T19:48:47.326 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d0b0826:::benchmark_data_smithi188_134454_object145037:head# 2024-04-01T19:48:47.327 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d0cb430:::benchmark_data_smithi188_134454_object121489:head# 2024-04-01T19:48:47.327 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d0f47ca:::benchmark_data_smithi188_134454_object116994:head# 2024-04-01T19:48:47.327 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d1024c7:::benchmark_data_smithi188_134454_object131516:head# 2024-04-01T19:48:47.327 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d104dbf:::benchmark_data_smithi188_134454_object133048:head# 2024-04-01T19:48:47.327 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d10bf46:::benchmark_data_smithi188_134454_object151218:head# 2024-04-01T19:48:47.327 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d111800:::benchmark_data_smithi188_134454_object138119:head# 2024-04-01T19:48:47.328 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d1299d7:::benchmark_data_smithi188_134454_object145928:head# 2024-04-01T19:48:47.328 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d13e291:::benchmark_data_smithi188_134454_object146426:head# 2024-04-01T19:48:47.328 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d13f755:::benchmark_data_smithi188_134454_object152593:head# 2024-04-01T19:48:47.328 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d177aba:::benchmark_data_smithi188_134454_object124866:head# 2024-04-01T19:48:47.328 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d18c678:::benchmark_data_smithi188_134454_object141096:head# 2024-04-01T19:48:47.328 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d19a180:::benchmark_data_smithi188_134454_object151186:head# 2024-04-01T19:48:47.329 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d1d8972:::benchmark_data_smithi188_134454_object129491:head# 2024-04-01T19:48:47.329 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d1e03cc:::benchmark_data_smithi188_134454_object153756:head# 2024-04-01T19:48:47.329 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d1e60a5:::benchmark_data_smithi188_134454_object127650:head# 2024-04-01T19:48:47.330 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d20fa21:::benchmark_data_smithi188_134454_object129630:head# 2024-04-01T19:48:47.330 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d23e7d3:::benchmark_data_smithi188_134454_object123872:head# 2024-04-01T19:48:47.330 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d28377f:::benchmark_data_smithi188_134454_object128169:head# 2024-04-01T19:48:47.331 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d2a93dd:::benchmark_data_smithi188_134454_object119105:head# 2024-04-01T19:48:47.331 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:47 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1421132479' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:48:47.331 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:47 smithi022 ceph-mon[39439]: pgmap v1504: 17 pgs: 17 active+clean; 1.8 GiB data, 8.1 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 952 op/s; 21 MiB/s, 334 objects/s recovering 2024-04-01T19:48:47.331 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d3024cd:::benchmark_data_smithi188_134454_object121046:head# 2024-04-01T19:48:47.336 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d341a6a:::benchmark_data_smithi188_134454_object130703:head# 2024-04-01T19:48:47.336 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d39dd2e:::benchmark_data_smithi188_134454_object138801:head# 2024-04-01T19:48:47.336 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d3addab:::benchmark_data_smithi188_134454_object148531:head# 2024-04-01T19:48:47.337 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d3aeb06:::benchmark_data_smithi188_134454_object129869:head# 2024-04-01T19:48:47.337 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d3d26aa:::benchmark_data_smithi188_134454_object121804:head# 2024-04-01T19:48:47.337 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d3e0173:::benchmark_data_smithi188_134454_object151611:head# 2024-04-01T19:48:47.337 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d4071ab:::benchmark_data_smithi188_134454_object137326:head# 2024-04-01T19:48:47.337 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d41252b:::benchmark_data_smithi188_134454_object146510:head# 2024-04-01T19:48:47.337 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d430c02:::benchmark_data_smithi188_134454_object145335:head# 2024-04-01T19:48:47.337 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d455c3c:::benchmark_data_smithi188_134454_object142943:head# 2024-04-01T19:48:47.337 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d4887bc:::benchmark_data_smithi188_134454_object156176:head# 2024-04-01T19:48:47.337 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d4b5621:::benchmark_data_smithi188_134454_object135786:head# 2024-04-01T19:48:47.337 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d4e3255:::benchmark_data_smithi188_134454_object120031:head# 2024-04-01T19:48:47.337 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d4ffebd:::benchmark_data_smithi188_134454_object115473:head# 2024-04-01T19:48:47.337 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d513af1:::benchmark_data_smithi188_134454_object129086:head# 2024-04-01T19:48:47.337 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d518db8:::benchmark_data_smithi188_134454_object122481:head# 2024-04-01T19:48:47.338 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d5481a2:::benchmark_data_smithi188_134454_object144104:head# 2024-04-01T19:48:47.338 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d5560e2:::benchmark_data_smithi188_134454_object115605:head# 2024-04-01T19:48:47.338 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d56d324:::benchmark_data_smithi188_134454_object149077:head# 2024-04-01T19:48:47.338 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d58954d:::benchmark_data_smithi188_134454_object128971:head# 2024-04-01T19:48:47.338 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d58cc21:::benchmark_data_smithi188_134454_object119583:head# 2024-04-01T19:48:47.338 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d59ae93:::benchmark_data_smithi188_134454_object128943:head# 2024-04-01T19:48:47.338 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d5a9fbf:::benchmark_data_smithi188_134454_object121404:head# 2024-04-01T19:48:47.338 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d5d6fec:::benchmark_data_smithi188_134454_object131880:head# 2024-04-01T19:48:47.338 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d5ed18f:::benchmark_data_smithi188_134454_object129138:head# 2024-04-01T19:48:47.338 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d5f76fc:::benchmark_data_smithi188_134454_object117085:head# 2024-04-01T19:48:47.339 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d6012e8:::benchmark_data_smithi188_134454_object155988:head# 2024-04-01T19:48:47.339 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d606223:::benchmark_data_smithi188_134454_object115980:head# 2024-04-01T19:48:47.339 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d6186ec:::benchmark_data_smithi188_134454_object156270:head# 2024-04-01T19:48:47.339 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d6619e8:::benchmark_data_smithi188_134454_object123641:head# 2024-04-01T19:48:47.339 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d699d05:::benchmark_data_smithi188_134454_object132587:head# 2024-04-01T19:48:47.339 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d6fbc84:::benchmark_data_smithi188_134454_object117694:head# 2024-04-01T19:48:47.340 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d717e2b:::benchmark_data_smithi188_134454_object131701:head# 2024-04-01T19:48:47.340 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d72ee68:::benchmark_data_smithi188_134454_object144516:head# 2024-04-01T19:48:47.340 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d74b249:::benchmark_data_smithi188_134454_object141457:head# 2024-04-01T19:48:47.340 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d775357:::benchmark_data_smithi188_134454_object136453:head# 2024-04-01T19:48:47.341 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d77676d:::benchmark_data_smithi188_134454_object123348:head# 2024-04-01T19:48:47.341 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d78a42d:::benchmark_data_smithi188_134454_object135220:head# 2024-04-01T19:48:47.341 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d78ee2a:::benchmark_data_smithi188_134454_object122641:head# 2024-04-01T19:48:47.341 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d7924f0:::benchmark_data_smithi188_134454_object126457:head# 2024-04-01T19:48:47.341 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d7950e3:::benchmark_data_smithi188_134454_object132268:head# 2024-04-01T19:48:47.341 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d7a4228:::benchmark_data_smithi188_134454_object147934:head# 2024-04-01T19:48:47.342 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d7e0ddf:::benchmark_data_smithi188_134454_object146772:head# 2024-04-01T19:48:47.342 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d7f3c11:::benchmark_data_smithi188_134454_object127197:head# 2024-04-01T19:48:47.342 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d81a3a7:::benchmark_data_smithi188_134454_object146519:head# 2024-04-01T19:48:47.342 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d8519ac:::benchmark_data_smithi188_134454_object141868:head# 2024-04-01T19:48:47.342 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d856668:::benchmark_data_smithi188_134454_object152042:head# 2024-04-01T19:48:47.342 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d861e7f:::benchmark_data_smithi188_134454_object143200:head# 2024-04-01T19:48:47.342 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d875f28:::benchmark_data_smithi188_134454_object144671:head# 2024-04-01T19:48:47.343 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d88aed6:::benchmark_data_smithi188_134454_object152910:head# 2024-04-01T19:48:47.343 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d8919e8:::benchmark_data_smithi188_134454_object122448:head# 2024-04-01T19:48:47.344 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d8ae4ce:::benchmark_data_smithi188_134454_object153952:head# 2024-04-01T19:48:47.344 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d8c416f:::benchmark_data_smithi188_134454_object141029:head# 2024-04-01T19:48:47.344 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d8ccb6b:::benchmark_data_smithi188_134454_object148071:head# 2024-04-01T19:48:47.344 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d8d3d0e:::benchmark_data_smithi188_134454_object150996:head# 2024-04-01T19:48:47.348 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d8d83e9:::benchmark_data_smithi188_134454_object115417:head# 2024-04-01T19:48:47.349 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d8dd345:::benchmark_data_smithi188_134454_object154721:head# 2024-04-01T19:48:47.350 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d8ec4fa:::benchmark_data_smithi188_134454_object137988:head# 2024-04-01T19:48:47.350 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d9036d8:::benchmark_data_smithi188_134454_object153623:head# 2024-04-01T19:48:47.350 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d9048ba:::benchmark_data_smithi188_134454_object127268:head# 2024-04-01T19:48:47.351 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d90671e:::benchmark_data_smithi188_134454_object152709:head# 2024-04-01T19:48:47.351 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d91469a:::benchmark_data_smithi188_134454_object134222:head# 2024-04-01T19:48:47.351 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d91bce3:::benchmark_data_smithi188_134454_object139723:head# 2024-04-01T19:48:47.351 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d91d187:::benchmark_data_smithi188_134454_object123711:head# 2024-04-01T19:48:47.351 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d95c3dd:::benchmark_data_smithi188_134454_object131652:head# 2024-04-01T19:48:47.351 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d95fbe5:::benchmark_data_smithi188_134454_object127555:head# 2024-04-01T19:48:47.352 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d984055:::benchmark_data_smithi188_134454_object150269:head# 2024-04-01T19:48:47.352 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d989c34:::benchmark_data_smithi188_134454_object124788:head# 2024-04-01T19:48:47.352 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d98b328:::benchmark_data_smithi188_134454_object120409:head# 2024-04-01T19:48:47.356 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d99ca6e:::benchmark_data_smithi188_134454_object127009:head# 2024-04-01T19:48:47.356 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d9af6ca:::benchmark_data_smithi188_134454_object126588:head# 2024-04-01T19:48:47.356 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d9cb61c:::benchmark_data_smithi188_134454_object122453:head# 2024-04-01T19:48:47.356 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7d9eaf42:::benchmark_data_smithi188_134454_object155475:head# 2024-04-01T19:48:47.356 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7da32873:::benchmark_data_smithi188_134454_object120616:head# 2024-04-01T19:48:47.356 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7da45bed:::benchmark_data_smithi188_134454_object155939:head# 2024-04-01T19:48:47.356 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7da701b9:::benchmark_data_smithi188_134454_object124342:head# 2024-04-01T19:48:47.357 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7da7ff94:::benchmark_data_smithi188_134454_object141543:head# 2024-04-01T19:48:47.357 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7da8cfe7:::benchmark_data_smithi188_134454_object149133:head# 2024-04-01T19:48:47.357 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7dabd6d1:::benchmark_data_smithi188_134454_object125673:head# 2024-04-01T19:48:47.357 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7dac768d:::benchmark_data_smithi188_134454_object152426:head# 2024-04-01T19:48:47.357 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7db5067b:::benchmark_data_smithi188_134454_object145147:head# 2024-04-01T19:48:47.357 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7db63167:::benchmark_data_smithi188_134454_object154216:head# 2024-04-01T19:48:47.357 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7db81bfb:::benchmark_data_smithi188_134454_object137594:head# 2024-04-01T19:48:47.357 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7dba5f33:::benchmark_data_smithi188_134454_object137065:head# 2024-04-01T19:48:47.357 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7dba60cf:::benchmark_data_smithi188_134454_object148999:head# 2024-04-01T19:48:47.357 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7dba63fe:::benchmark_data_smithi188_134454_object126651:head# 2024-04-01T19:48:47.358 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7dc118f8:::benchmark_data_smithi188_134454_object141709:head# 2024-04-01T19:48:47.358 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7dc1b106:::benchmark_data_smithi188_134454_object156465:head# 2024-04-01T19:48:47.359 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7dc3ff71:::benchmark_data_smithi188_134454_object128543:head# 2024-04-01T19:48:47.359 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7dc6e670:::benchmark_data_smithi188_134454_object121537:head# 2024-04-01T19:48:47.359 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7dcc457f:::benchmark_data_smithi188_134454_object141952:head# 2024-04-01T19:48:47.359 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7dcca3d0:::benchmark_data_smithi188_134454_object129204:head# 2024-04-01T19:48:47.359 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7dccb193:::benchmark_data_smithi188_134454_object154989:head# 2024-04-01T19:48:47.359 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7dd1851a:::benchmark_data_smithi188_134454_object122874:head# 2024-04-01T19:48:47.360 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7dd4aae2:::benchmark_data_smithi188_134454_object123123:head# 2024-04-01T19:48:47.360 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7dd531a7:::benchmark_data_smithi188_134454_object145085:head# 2024-04-01T19:48:47.360 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7dd7bdc5:::benchmark_data_smithi188_134454_object152188:head# 2024-04-01T19:48:47.360 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7dda42b0:::benchmark_data_smithi188_134454_object151136:head# 2024-04-01T19:48:47.360 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7dddf6fa:::benchmark_data_smithi188_134454_object132758:head# 2024-04-01T19:48:47.360 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ddfed0f:::benchmark_data_smithi188_134454_object125434:head# 2024-04-01T19:48:47.361 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7de11d4e:::benchmark_data_smithi188_134454_object155729:head# 2024-04-01T19:48:47.361 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7de1ea4d:::benchmark_data_smithi188_134454_object117836:head# 2024-04-01T19:48:47.361 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7de5da0b:::benchmark_data_smithi188_134454_object132438:head# 2024-04-01T19:48:47.367 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7de61c67:::benchmark_data_smithi188_134454_object135638:head# 2024-04-01T19:48:47.367 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7de668a4:::benchmark_data_smithi188_134454_object149609:head# 2024-04-01T19:48:47.367 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7de87fd8:::benchmark_data_smithi188_134454_object144189:head# 2024-04-01T19:48:47.367 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7debdd62:::benchmark_data_smithi188_134454_object132750:head# 2024-04-01T19:48:47.367 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7dec0643:::benchmark_data_smithi188_134454_object117379:head# 2024-04-01T19:48:47.367 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7def477a:::benchmark_data_smithi188_134454_object128613:head# 2024-04-01T19:48:47.367 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7df064cc:::benchmark_data_smithi188_134454_object142267:head# 2024-04-01T19:48:47.368 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7df0bd62:::benchmark_data_smithi188_134454_object152569:head# 2024-04-01T19:48:47.368 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7df1c514:::benchmark_data_smithi188_134454_object131816:head# 2024-04-01T19:48:47.368 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7df54d1e:::benchmark_data_smithi188_134454_object150357:head# 2024-04-01T19:48:47.368 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7df76dfe:::benchmark_data_smithi188_134454_object132612:head# 2024-04-01T19:48:47.368 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7dfb4bd3:::benchmark_data_smithi188_134454_object117798:head# 2024-04-01T19:48:47.368 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7dfcb45a:::benchmark_data_smithi188_134454_object130697:head# 2024-04-01T19:48:47.368 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7dffb97f:::benchmark_data_smithi188_134454_object123945:head# 2024-04-01T19:48:47.368 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e0000b8:::benchmark_data_smithi188_134454_object133933:head# 2024-04-01T19:48:47.368 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e00905a:::benchmark_data_smithi188_134454_object140199:head# 2024-04-01T19:48:47.368 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e01d969:::benchmark_data_smithi188_134454_object131519:head# 2024-04-01T19:48:47.368 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e0638dc:::benchmark_data_smithi188_134454_object120240:head# 2024-04-01T19:48:47.368 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e06b8da:::benchmark_data_smithi188_134454_object138093:head# 2024-04-01T19:48:47.368 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e06d7f0:::benchmark_data_smithi188_134454_object146815:head# 2024-04-01T19:48:47.368 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e091d76:::benchmark_data_smithi188_134454_object134834:head# 2024-04-01T19:48:47.369 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e0d0faa:::benchmark_data_smithi188_134454_object115933:head# 2024-04-01T19:48:47.369 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e103ea9:::benchmark_data_smithi188_134454_object118457:head# 2024-04-01T19:48:47.369 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e1325ed:::benchmark_data_smithi188_134454_object148304:head# 2024-04-01T19:48:47.370 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e151b8c:::benchmark_data_smithi188_134454_object128285:head# 2024-04-01T19:48:47.370 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e199021:::benchmark_data_smithi188_134454_object150874:head# 2024-04-01T19:48:47.370 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e1b25ff:::benchmark_data_smithi188_134454_object147149:head# 2024-04-01T19:48:47.370 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e1c7ca6:::benchmark_data_smithi188_134454_object155760:head# 2024-04-01T19:48:47.370 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e1c9360:::benchmark_data_smithi188_134454_object134483:head# 2024-04-01T19:48:47.370 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e1cb856:::benchmark_data_smithi188_134454_object132650:head# 2024-04-01T19:48:47.371 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e1ef0c8:::benchmark_data_smithi188_134454_object130837:head# 2024-04-01T19:48:47.371 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e218592:::benchmark_data_smithi188_134454_object134389:head# 2024-04-01T19:48:47.377 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:48:47.382 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e24436b:::benchmark_data_smithi188_134454_object139849:head# 2024-04-01T19:48:47.382 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e297e6d:::benchmark_data_smithi188_134454_object119089:head# 2024-04-01T19:48:47.382 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e2b08f1:::benchmark_data_smithi188_134454_object149246:head# 2024-04-01T19:48:47.383 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e2b31e6:::benchmark_data_smithi188_134454_object128433:head# 2024-04-01T19:48:47.383 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e2d7d8a:::benchmark_data_smithi188_134454_object117616:head# 2024-04-01T19:48:47.383 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e310a6a:::benchmark_data_smithi188_134454_object155041:head# 2024-04-01T19:48:47.384 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e3116eb:::benchmark_data_smithi188_134454_object151975:head# 2024-04-01T19:48:47.384 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e32e0bb:::benchmark_data_smithi188_134454_object128301:head# 2024-04-01T19:48:47.384 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e3542e4:::benchmark_data_smithi188_134454_object155345:head# 2024-04-01T19:48:47.384 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e370c9a:::benchmark_data_smithi188_134454_object125716:head# 2024-04-01T19:48:47.384 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e38cd68:::benchmark_data_smithi188_134454_object155331:head# 2024-04-01T19:48:47.384 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e39fda1:::benchmark_data_smithi188_134454_object128048:head# 2024-04-01T19:48:47.396 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e3ae4ac:::benchmark_data_smithi188_134454_object118439:head# 2024-04-01T19:48:47.401 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e3b32b8:::benchmark_data_smithi188_134454_object117610:head# 2024-04-01T19:48:47.401 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e3bd8fe:::benchmark_data_smithi188_134454_object145863:head# 2024-04-01T19:48:47.401 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e3be85a:::benchmark_data_smithi188_134454_object141044:head# 2024-04-01T19:48:47.407 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e3d7d18:::benchmark_data_smithi188_134454_object155546:head# 2024-04-01T19:48:47.407 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e3ea416:::benchmark_data_smithi188_134454_object146018:head# 2024-04-01T19:48:47.408 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e3eac19:::benchmark_data_smithi188_134454_object146035:head# 2024-04-01T19:48:47.408 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e3ec3b5:::benchmark_data_smithi188_134454_object152623:head# 2024-04-01T19:48:47.408 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e40a7f1:::benchmark_data_smithi188_134454_object154466:head# 2024-04-01T19:48:47.408 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e43e620:::benchmark_data_smithi188_134454_object154980:head# 2024-04-01T19:48:47.409 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e449174:::benchmark_data_smithi188_134454_object126901:head# 2024-04-01T19:48:47.409 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e461d31:::benchmark_data_smithi188_134454_object150233:head# 2024-04-01T19:48:47.410 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e46f1f0:::benchmark_data_smithi188_134454_object147494:head# 2024-04-01T19:48:47.410 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e4731d2:::benchmark_data_smithi188_134454_object148949:head# 2024-04-01T19:48:47.410 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e4741cc:::benchmark_data_smithi188_134454_object150306:head# 2024-04-01T19:48:47.410 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e47b4a0:::benchmark_data_smithi188_134454_object138097:head# 2024-04-01T19:48:47.412 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e482c16:::benchmark_data_smithi188_134454_object141050:head# 2024-04-01T19:48:47.414 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e4ad158:::benchmark_data_smithi188_134454_object145100:head# 2024-04-01T19:48:47.414 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e4aec16:::benchmark_data_smithi188_134454_object142905:head# 2024-04-01T19:48:47.414 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e4b6245:::benchmark_data_smithi188_134454_object148017:head# 2024-04-01T19:48:47.415 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e4be8fc:::benchmark_data_smithi188_134454_object144895:head# 2024-04-01T19:48:47.415 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e4cf296:::benchmark_data_smithi188_134454_object124934:head# 2024-04-01T19:48:47.416 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:47.416 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e4dc5b2:::benchmark_data_smithi188_134454_object152333:head# 2024-04-01T19:48:47.416 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e4fb0e0:::benchmark_data_smithi188_134454_object119203:head# 2024-04-01T19:48:47.416 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e4fd61f:::benchmark_data_smithi188_134454_object120649:head# 2024-04-01T19:48:47.416 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e50b5c2:::benchmark_data_smithi188_134454_object148492:head# 2024-04-01T19:48:47.416 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e560c9f:::benchmark_data_smithi188_134454_object127378:head# 2024-04-01T19:48:47.417 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e565a30:::benchmark_data_smithi188_134454_object137269:head# 2024-04-01T19:48:47.417 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e566ec8:::benchmark_data_smithi188_134454_object120660:head# 2024-04-01T19:48:47.417 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e5751c2:::benchmark_data_smithi188_134454_object124435:head# 2024-04-01T19:48:47.417 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e598c7a:::benchmark_data_smithi188_134454_object127970:head# 2024-04-01T19:48:47.418 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e5a28c0:::benchmark_data_smithi188_134454_object121182:head# 2024-04-01T19:48:47.418 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e5a8583:::benchmark_data_smithi188_134454_object154912:head# 2024-04-01T19:48:47.418 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e5b7566:::benchmark_data_smithi188_134454_object117966:head# 2024-04-01T19:48:47.419 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e5e7ffd:::benchmark_data_smithi188_134454_object122461:head# 2024-04-01T19:48:47.419 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e610010:::benchmark_data_smithi188_134454_object119651:head# 2024-04-01T19:48:47.419 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e6357c0:::benchmark_data_smithi188_134454_object150837:head# 2024-04-01T19:48:47.419 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e63c479:::benchmark_data_smithi188_134454_object134896:head# 2024-04-01T19:48:47.419 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e64022e:::benchmark_data_smithi188_134454_object156225:head# 2024-04-01T19:48:47.422 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e65894d:::benchmark_data_smithi188_134454_object134251:head# 2024-04-01T19:48:47.422 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e672cd8:::benchmark_data_smithi188_134454_object147045:head# 2024-04-01T19:48:47.423 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e67d329:::benchmark_data_smithi188_134454_object129443:head# 2024-04-01T19:48:47.423 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e692527:::benchmark_data_smithi188_134454_object147985:head# 2024-04-01T19:48:47.423 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e698cf9:::benchmark_data_smithi188_134454_object134060:head# 2024-04-01T19:48:47.423 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e6ab4a8:::benchmark_data_smithi188_134454_object128176:head# 2024-04-01T19:48:47.423 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e6be05b:::benchmark_data_smithi188_134454_object144806:head# 2024-04-01T19:48:47.423 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e6df70b:::benchmark_data_smithi188_134454_object116463:head# 2024-04-01T19:48:47.423 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e6e7f33:::benchmark_data_smithi188_134454_object152768:head# 2024-04-01T19:48:47.423 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e6f8038:::benchmark_data_smithi188_134454_object145214:head# 2024-04-01T19:48:47.423 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e6fd688:::benchmark_data_smithi188_134454_object118617:head# 2024-04-01T19:48:47.423 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e717275:::benchmark_data_smithi188_134454_object151623:head# 2024-04-01T19:48:47.424 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e75a26c:::benchmark_data_smithi188_134454_object126211:head# 2024-04-01T19:48:47.424 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e766f00:::benchmark_data_smithi188_134454_object148623:head# 2024-04-01T19:48:47.424 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e7678a6:::benchmark_data_smithi188_134454_object134025:head# 2024-04-01T19:48:47.424 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e7a90ae:::benchmark_data_smithi188_134454_object130553:head# 2024-04-01T19:48:47.425 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e7b6e02:::benchmark_data_smithi188_134454_object118653:head# 2024-04-01T19:48:47.425 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e7bc6de:::benchmark_data_smithi188_134454_object129986:head# 2024-04-01T19:48:47.425 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e80ec3f:::benchmark_data_smithi188_134454_object118942:head# 2024-04-01T19:48:47.425 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e81c45f:::benchmark_data_smithi188_134454_object127296:head# 2024-04-01T19:48:47.425 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e834c0a:::benchmark_data_smithi188_134454_object122255:head# 2024-04-01T19:48:47.426 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e84ab00:::benchmark_data_smithi188_134454_object139044:head# 2024-04-01T19:48:47.426 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e8599ce:::benchmark_data_smithi188_134454_object138412:head# 2024-04-01T19:48:47.426 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e863cac:::benchmark_data_smithi188_134454_object135357:head# 2024-04-01T19:48:47.426 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e866576:::benchmark_data_smithi188_134454_object135149:head# 2024-04-01T19:48:47.426 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e877e0e:::benchmark_data_smithi188_134454_object155118:head# 2024-04-01T19:48:47.427 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e8a81d7:::benchmark_data_smithi188_134454_object120963:head# 2024-04-01T19:48:47.427 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e8bf71f:::benchmark_data_smithi188_134454_object122914:head# 2024-04-01T19:48:47.427 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e8d56a5:::benchmark_data_smithi188_134454_object129568:head# 2024-04-01T19:48:47.427 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e90652e:::benchmark_data_smithi188_134454_object125299:head# 2024-04-01T19:48:47.427 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e909903:::benchmark_data_smithi188_134454_object151097:head# 2024-04-01T19:48:47.427 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e933c87:::benchmark_data_smithi188_134454_object137976:head# 2024-04-01T19:48:47.427 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e952d46:::benchmark_data_smithi188_134454_object130670:head# 2024-04-01T19:48:47.427 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e95a70c:::benchmark_data_smithi188_134454_object122684:head# 2024-04-01T19:48:47.428 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e9a6c78:::benchmark_data_smithi188_134454_object139693:head# 2024-04-01T19:48:47.429 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e9eaa9a:::benchmark_data_smithi188_134454_object133608:head# 2024-04-01T19:48:47.429 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7e9fc857:::benchmark_data_smithi188_134454_object150856:head# 2024-04-01T19:48:47.429 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ea15ebe:::benchmark_data_smithi188_134454_object135097:head# 2024-04-01T19:48:47.429 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ea1e025:::benchmark_data_smithi188_134454_object127428:head# 2024-04-01T19:48:47.429 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ea228b0:::benchmark_data_smithi188_134454_object152803:head# 2024-04-01T19:48:47.429 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ea2a2e6:::benchmark_data_smithi188_134454_object139808:head# 2024-04-01T19:48:47.430 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ea2cc94:::benchmark_data_smithi188_134454_object155340:head# 2024-04-01T19:48:47.430 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ea57555:::benchmark_data_smithi188_134454_object120706:head# 2024-04-01T19:48:47.430 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ea5cf43:::benchmark_data_smithi188_134454_object137350:head# 2024-04-01T19:48:47.430 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ea782b5:::benchmark_data_smithi188_134454_object141883:head# 2024-04-01T19:48:47.430 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ea80340:::benchmark_data_smithi188_134454_object129060:head# 2024-04-01T19:48:47.430 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ea9d2f2:::benchmark_data_smithi188_134454_object148411:head# 2024-04-01T19:48:47.430 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7eaa66d4:::benchmark_data_smithi188_134454_object135390:head# 2024-04-01T19:48:47.431 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7eab5eea:::benchmark_data_smithi188_134454_object144010:head# 2024-04-01T19:48:47.431 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7eac6551:::benchmark_data_smithi188_134454_object145490:head# 2024-04-01T19:48:47.433 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7eaf1172:::benchmark_data_smithi188_134454_object156582:head# 2024-04-01T19:48:47.433 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7eaf7843:::benchmark_data_smithi188_134454_object126917:head# 2024-04-01T19:48:47.433 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7eb01f0b:::benchmark_data_smithi188_134454_object155026:head# 2024-04-01T19:48:47.433 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7eb03453:::benchmark_data_smithi188_134454_object153307:head# 2024-04-01T19:48:47.433 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7eb2b5e3:::benchmark_data_smithi188_134454_object141314:head# 2024-04-01T19:48:47.433 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7eb362a3:::benchmark_data_smithi188_134454_object127896:head# 2024-04-01T19:48:47.433 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7eb3cb5b:::benchmark_data_smithi188_134454_object125431:head# 2024-04-01T19:48:47.438 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7eb484cc:::benchmark_data_smithi188_134454_object136199:head# 2024-04-01T19:48:47.439 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7eb4a4d4:::benchmark_data_smithi188_134454_object123008:head# 2024-04-01T19:48:47.439 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7eb6796e:::benchmark_data_smithi188_134454_object144535:head# 2024-04-01T19:48:47.439 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7eb86fe4:::benchmark_data_smithi188_134454_object135711:head# 2024-04-01T19:48:47.439 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ebc6598:::benchmark_data_smithi188_134454_object116571:head# 2024-04-01T19:48:47.439 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ebc7af2:::benchmark_data_smithi188_134454_object121079:head# 2024-04-01T19:48:47.439 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ebd600d:::benchmark_data_smithi188_134454_object120817:head# 2024-04-01T19:48:47.439 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ec402fd:::benchmark_data_smithi188_134454_object138665:head# 2024-04-01T19:48:47.439 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ec46ba4:::benchmark_data_smithi188_134454_object123944:head# 2024-04-01T19:48:47.439 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ec5509b:::benchmark_data_smithi188_134454_object131764:head# 2024-04-01T19:48:47.439 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ecc792e:::benchmark_data_smithi188_134454_object144224:head# 2024-04-01T19:48:47.439 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ecf45db:::benchmark_data_smithi188_134454_object129510:head# 2024-04-01T19:48:47.439 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ed287c6:::benchmark_data_smithi188_134454_object142027:head# 2024-04-01T19:48:47.439 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ed39ad6:::benchmark_data_smithi188_134454_object115811:head# 2024-04-01T19:48:47.439 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ed457c4:::benchmark_data_smithi188_134454_object133694:head# 2024-04-01T19:48:47.440 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ed5ae9a:::benchmark_data_smithi188_134454_object130106:head# 2024-04-01T19:48:47.440 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ed7a7e5:::benchmark_data_smithi188_134454_object147978:head# 2024-04-01T19:48:47.440 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7edd7cc5:::benchmark_data_smithi188_134454_object142464:head# 2024-04-01T19:48:47.440 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ee401c2:::benchmark_data_smithi188_134454_object136109:head# 2024-04-01T19:48:47.440 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ee4f939:::benchmark_data_smithi188_134454_object115590:head# 2024-04-01T19:48:47.440 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:48:47.441 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ee69729:::benchmark_data_smithi188_134454_object144705:head# 2024-04-01T19:48:47.441 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ee8035f:::benchmark_data_smithi188_134454_object134414:head# 2024-04-01T19:48:47.441 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ee9ba76:::benchmark_data_smithi188_134454_object144365:head# 2024-04-01T19:48:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7eea8a1f:::benchmark_data_smithi188_134454_object122260:head# 2024-04-01T19:48:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7eec8b04:::benchmark_data_smithi188_134454_object126376:head# 2024-04-01T19:48:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7eed5afc:::benchmark_data_smithi188_134454_object143261:head# 2024-04-01T19:48:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7eef2384:::benchmark_data_smithi188_134454_object125822:head# 2024-04-01T19:48:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ef003ae:::benchmark_data_smithi188_134454_object115869:head# 2024-04-01T19:48:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ef024d2:::benchmark_data_smithi188_134454_object143191:head# 2024-04-01T19:48:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ef06b90:::benchmark_data_smithi188_134454_object154317:head# 2024-04-01T19:48:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ef0f393:::benchmark_data_smithi188_134454_object143155:head# 2024-04-01T19:48:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ef17661:::benchmark_data_smithi188_134454_object128036:head# 2024-04-01T19:48:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ef3a998:::benchmark_data_smithi188_134454_object134166:head# 2024-04-01T19:48:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ef3f676:::benchmark_data_smithi188_134454_object121114:head# 2024-04-01T19:48:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ef76ec2:::benchmark_data_smithi188_134454_object125142:head# 2024-04-01T19:48:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ef8175e:::benchmark_data_smithi188_134454_object119072:head# 2024-04-01T19:48:47.443 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7efac890:::benchmark_data_smithi188_134454_object137375:head# 2024-04-01T19:48:47.443 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7efb02a9:::benchmark_data_smithi188_134454_object139341:head# 2024-04-01T19:48:47.444 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7efb5e38:::benchmark_data_smithi188_134454_object152947:head# 2024-04-01T19:48:47.444 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7efbc5b5:::benchmark_data_smithi188_134454_object140918:head# 2024-04-01T19:48:47.444 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7efd4460:::benchmark_data_smithi188_134454_object130110:head# 2024-04-01T19:48:47.444 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7efe028a:::benchmark_data_smithi188_134454_object142305:head# 2024-04-01T19:48:47.444 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7efe59dc:::benchmark_data_smithi188_134454_object125000:head# 2024-04-01T19:48:47.444 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f00badb:::benchmark_data_smithi188_134454_object149578:head# 2024-04-01T19:48:47.444 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f017d6c:::benchmark_data_smithi188_134454_object120796:head# 2024-04-01T19:48:47.444 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f040282:::benchmark_data_smithi188_134454_object137732:head# 2024-04-01T19:48:47.445 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f060b72:::benchmark_data_smithi188_134454_object122714:head# 2024-04-01T19:48:47.445 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f067a0e:::benchmark_data_smithi188_134454_object138199:head# 2024-04-01T19:48:47.445 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:47.446 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:48:47.453 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f06fb80:::benchmark_data_smithi188_134454_object126932:head# 2024-04-01T19:48:47.454 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f07696f:::benchmark_data_smithi188_134454_object115392:head# 2024-04-01T19:48:47.454 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f09989f:::benchmark_data_smithi188_134454_object131542:head# 2024-04-01T19:48:47.454 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f0a6bda:::benchmark_data_smithi188_134454_object150747:head# 2024-04-01T19:48:47.454 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f0ab2df:::benchmark_data_smithi188_134454_object130349:head# 2024-04-01T19:48:47.454 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f0c738b:::benchmark_data_smithi188_134454_object119641:head# 2024-04-01T19:48:47.454 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f0ca4af:::benchmark_data_smithi188_134454_object149972:head# 2024-04-01T19:48:47.454 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f0cd16d:::benchmark_data_smithi188_134454_object134700:head# 2024-04-01T19:48:47.454 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f0cd67e:::benchmark_data_smithi188_134454_object135526:head# 2024-04-01T19:48:47.454 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f0dd32c:::benchmark_data_smithi188_134454_object153089:head# 2024-04-01T19:48:47.454 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f0e6c44:::benchmark_data_smithi188_134454_object152207:head# 2024-04-01T19:48:47.454 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f0e8db0:::benchmark_data_smithi188_134454_object138469:head# 2024-04-01T19:48:47.455 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f0ee12e:::benchmark_data_smithi188_134454_object133574:head# 2024-04-01T19:48:47.455 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f0fd023:::benchmark_data_smithi188_134454_object135195:head# 2024-04-01T19:48:47.455 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f10e66a:::benchmark_data_smithi188_134454_object126162:head# 2024-04-01T19:48:47.455 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f134c2b:::benchmark_data_smithi188_134454_object118641:head# 2024-04-01T19:48:47.455 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f135536:::benchmark_data_smithi188_134454_object156285:head# 2024-04-01T19:48:47.455 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f13bebf:::benchmark_data_smithi188_134454_object134653:head# 2024-04-01T19:48:47.455 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f13cd35:::benchmark_data_smithi188_134454_object124717:head# 2024-04-01T19:48:47.455 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f148f12:::benchmark_data_smithi188_134454_object142366:head# 2024-04-01T19:48:47.455 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f14a5ba:::benchmark_data_smithi188_134454_object117364:head# 2024-04-01T19:48:47.455 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f17a961:::benchmark_data_smithi188_134454_object148019:head# 2024-04-01T19:48:47.455 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f198744:::benchmark_data_smithi188_134454_object117844:head# 2024-04-01T19:48:47.456 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f1adccd:::benchmark_data_smithi188_134454_object141258:head# 2024-04-01T19:48:47.456 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f1c88a4:::benchmark_data_smithi188_134454_object142671:head# 2024-04-01T19:48:47.456 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f1f2d04:::benchmark_data_smithi188_134454_object136437:head# 2024-04-01T19:48:47.456 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f1facce:::benchmark_data_smithi188_134454_object133344:head# 2024-04-01T19:48:47.456 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f20994e:::benchmark_data_smithi188_134454_object119026:head# 2024-04-01T19:48:47.456 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f25e372:::benchmark_data_smithi188_134454_object142610:head# 2024-04-01T19:48:47.456 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f2787be:::benchmark_data_smithi188_134454_object150133:head# 2024-04-01T19:48:47.456 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f29a4f0:::benchmark_data_smithi188_134454_object142576:head# 2024-04-01T19:48:47.456 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f29e8e6:::benchmark_data_smithi188_134454_object116255:head# 2024-04-01T19:48:47.457 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f2cb0d9:::benchmark_data_smithi188_134454_object139981:head# 2024-04-01T19:48:47.457 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f2f0fa5:::benchmark_data_smithi188_134454_object146318:head# 2024-04-01T19:48:47.457 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f2f226e:::benchmark_data_smithi188_134454_object149292:head# 2024-04-01T19:48:47.457 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f2f819f:::benchmark_data_smithi188_134454_object118190:head# 2024-04-01T19:48:47.457 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f361818:::benchmark_data_smithi188_134454_object156390:head# 2024-04-01T19:48:47.457 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f37d380:::benchmark_data_smithi188_134454_object118455:head# 2024-04-01T19:48:47.457 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f38b942:::benchmark_data_smithi188_134454_object156441:head# 2024-04-01T19:48:47.457 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f3ab82a:::benchmark_data_smithi188_134454_object129522:head# 2024-04-01T19:48:47.457 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f3b16a0:::benchmark_data_smithi188_134454_object155063:head# 2024-04-01T19:48:47.457 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f3b407d:::benchmark_data_smithi188_134454_object147178:head# 2024-04-01T19:48:47.458 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f3ec106:::benchmark_data_smithi188_134454_object125271:head# 2024-04-01T19:48:47.458 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f3faa0f:::benchmark_data_smithi188_134454_object120547:head# 2024-04-01T19:48:47.458 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f41103d:::benchmark_data_smithi188_134454_object148195:head# 2024-04-01T19:48:47.459 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f42f149:::benchmark_data_smithi188_134454_object115787:head# 2024-04-01T19:48:47.459 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f433d47:::benchmark_data_smithi188_134454_object120330:head# 2024-04-01T19:48:47.459 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f44a744:::benchmark_data_smithi188_134454_object146768:head# 2024-04-01T19:48:47.459 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f453cc0:::benchmark_data_smithi188_134454_object126318:head# 2024-04-01T19:48:47.459 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f461444:::benchmark_data_smithi188_134454_object150106:head# 2024-04-01T19:48:47.459 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f47168c:::benchmark_data_smithi188_134454_object138456:head# 2024-04-01T19:48:47.459 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f49e044:::benchmark_data_smithi188_134454_object130702:head# 2024-04-01T19:48:47.459 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f4c8c7f:::benchmark_data_smithi188_134454_object149229:head# 2024-04-01T19:48:47.459 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f4d3688:::benchmark_data_smithi188_134454_object149350:head# 2024-04-01T19:48:47.459 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f4f543c:::benchmark_data_smithi188_134454_object129819:head# 2024-04-01T19:48:47.459 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f5157fb:::benchmark_data_smithi188_134454_object139440:head# 2024-04-01T19:48:47.459 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f541212:::benchmark_data_smithi188_134454_object124794:head# 2024-04-01T19:48:47.462 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f571585:::benchmark_data_smithi188_134454_object149284:head# 2024-04-01T19:48:47.463 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f57c1f5:::benchmark_data_smithi188_134454_object120632:head# 2024-04-01T19:48:47.463 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f58f75c:::benchmark_data_smithi188_134454_object145673:head# 2024-04-01T19:48:47.463 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f598edb:::benchmark_data_smithi188_134454_object147556:head# 2024-04-01T19:48:47.463 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f5a4bcb:::benchmark_data_smithi188_134454_object134673:head# 2024-04-01T19:48:47.463 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f5da794:::benchmark_data_smithi188_134454_object118884:head# 2024-04-01T19:48:47.463 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f5ddf03:::benchmark_data_smithi188_134454_object146867:head# 2024-04-01T19:48:47.464 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f5ec0ee:::benchmark_data_smithi188_134454_object119625:head# 2024-04-01T19:48:47.464 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f63752e:::benchmark_data_smithi188_134454_object133598:head# 2024-04-01T19:48:47.464 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f6415ae:::benchmark_data_smithi188_134454_object125138:head# 2024-04-01T19:48:47.464 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f6515f4:::benchmark_data_smithi188_134454_object141100:head# 2024-04-01T19:48:47.464 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f67dc9b:::benchmark_data_smithi188_134454_object124930:head# 2024-04-01T19:48:47.464 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f69ad5e:::benchmark_data_smithi188_134454_object118080:head# 2024-04-01T19:48:47.464 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f6a4c07:::benchmark_data_smithi188_134454_object131625:head# 2024-04-01T19:48:47.464 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f6bb01e:::benchmark_data_smithi188_134454_object121197:head# 2024-04-01T19:48:47.464 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f6c0b98:::benchmark_data_smithi188_134454_object141214:head# 2024-04-01T19:48:47.464 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f6d6f6a:::benchmark_data_smithi188_134454_object130865:head# 2024-04-01T19:48:47.464 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f6d967c:::benchmark_data_smithi188_134454_object138313:head# 2024-04-01T19:48:47.464 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f6de3c1:::benchmark_data_smithi188_134454_object135419:head# 2024-04-01T19:48:47.464 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f6debb4:::benchmark_data_smithi188_134454_object129305:head# 2024-04-01T19:48:47.465 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f7521ce:::benchmark_data_smithi188_134454_object145224:head# 2024-04-01T19:48:47.465 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f7639b0:::benchmark_data_smithi188_134454_object132407:head# 2024-04-01T19:48:47.465 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f787535:::benchmark_data_smithi188_134454_object144627:head# 2024-04-01T19:48:47.465 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f7b9514:::benchmark_data_smithi188_134454_object127159:head# 2024-04-01T19:48:47.465 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f7ca7e7:::benchmark_data_smithi188_134454_object134223:head# 2024-04-01T19:48:47.465 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f7ececf:::benchmark_data_smithi188_134454_object148620:head# 2024-04-01T19:48:47.465 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f7fc940:::benchmark_data_smithi188_134454_object153569:head# 2024-04-01T19:48:47.466 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f7fedca:::benchmark_data_smithi188_134454_object123352:head# 2024-04-01T19:48:47.466 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f8125e4:::benchmark_data_smithi188_134454_object133445:head# 2024-04-01T19:48:47.466 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f81bc65:::benchmark_data_smithi188_134454_object153705:head# 2024-04-01T19:48:47.466 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f81c2f9:::benchmark_data_smithi188_134454_object119929:head# 2024-04-01T19:48:47.466 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f854d8b:::benchmark_data_smithi188_134454_object131509:head# 2024-04-01T19:48:47.467 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f867900:::benchmark_data_smithi188_134454_object129275:head# 2024-04-01T19:48:47.467 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f8729ea:::benchmark_data_smithi188_134454_object141378:head# 2024-04-01T19:48:47.467 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f87890c:::benchmark_data_smithi188_134454_object134480:head# 2024-04-01T19:48:47.467 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f8831d3:::benchmark_data_smithi188_134454_object141198:head# 2024-04-01T19:48:47.467 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f88e96a:::benchmark_data_smithi188_134454_object140435:head# 2024-04-01T19:48:47.467 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f8df97d:::benchmark_data_smithi188_134454_object137788:head# 2024-04-01T19:48:47.471 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f8e427c:::benchmark_data_smithi188_134454_object124705:head# 2024-04-01T19:48:47.471 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f900558:::benchmark_data_smithi188_134454_object139407:head# 2024-04-01T19:48:47.471 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f9724ef:::benchmark_data_smithi188_134454_object131223:head# 2024-04-01T19:48:47.471 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f9b05c4:::benchmark_data_smithi188_134454_object148422:head# 2024-04-01T19:48:47.471 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f9d7cad:::benchmark_data_smithi188_134454_object139694:head# 2024-04-01T19:48:47.472 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f9dc025:::benchmark_data_smithi188_134454_object139711:head# 2024-04-01T19:48:47.472 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7f9f568c:::benchmark_data_smithi188_134454_object131882:head# 2024-04-01T19:48:47.472 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fa1b397:::benchmark_data_smithi188_134454_object142984:head# 2024-04-01T19:48:47.472 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fa1f3b8:::benchmark_data_smithi188_134454_object125538:head# 2024-04-01T19:48:47.472 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fa6396b:::benchmark_data_smithi188_134454_object144993:head# 2024-04-01T19:48:47.472 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fab0258:::benchmark_data_smithi188_134454_object118976:head# 2024-04-01T19:48:47.474 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7faf5d43:::benchmark_data_smithi188_134454_object131631:head# 2024-04-01T19:48:47.474 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fb0f8df:::benchmark_data_smithi188_134454_object156555:head# 2024-04-01T19:48:47.475 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fb37691:::benchmark_data_smithi188_134454_object144876:head# 2024-04-01T19:48:47.475 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fb4f70c:::benchmark_data_smithi188_134454_object121684:head# 2024-04-01T19:48:47.475 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fb8a526:::benchmark_data_smithi188_134454_object122502:head# 2024-04-01T19:48:47.475 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fbb99a9:::benchmark_data_smithi188_134454_object141077:head# 2024-04-01T19:48:47.475 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fbf979c:::benchmark_data_smithi188_134454_object129494:head# 2024-04-01T19:48:47.475 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fc07e35:::benchmark_data_smithi188_134454_object151276:head# 2024-04-01T19:48:47.475 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fc16f75:::benchmark_data_smithi188_134454_object117498:head# 2024-04-01T19:48:47.475 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fc1ddd8:::benchmark_data_smithi188_134454_object126168:head# 2024-04-01T19:48:47.475 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fc2bf86:::benchmark_data_smithi188_134454_object120762:head# 2024-04-01T19:48:47.475 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fc56a7f:::benchmark_data_smithi188_134454_object117449:head# 2024-04-01T19:48:47.475 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fc57f32:::benchmark_data_smithi188_134454_object145458:head# 2024-04-01T19:48:47.475 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fc5ba5f:::benchmark_data_smithi188_134454_object127927:head# 2024-04-01T19:48:47.476 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fc75b38:::benchmark_data_smithi188_134454_object153022:head# 2024-04-01T19:48:47.476 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fc7e649:::benchmark_data_smithi188_134454_object148427:head# 2024-04-01T19:48:47.476 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fca4fa1:::benchmark_data_smithi188_134454_object124798:head# 2024-04-01T19:48:47.476 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fcb7d86:::benchmark_data_smithi188_134454_object141419:head# 2024-04-01T19:48:47.476 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fcc81d9:::benchmark_data_smithi188_134454_object150156:head# 2024-04-01T19:48:47.477 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fccc896:::benchmark_data_smithi188_134454_object143577:head# 2024-04-01T19:48:47.477 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fcd81fd:::benchmark_data_smithi188_134454_object131265:head# 2024-04-01T19:48:47.477 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fcef4e6:::benchmark_data_smithi188_134454_object141302:head# 2024-04-01T19:48:47.477 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fcfae5e:::benchmark_data_smithi188_134454_object144610:head# 2024-04-01T19:48:47.477 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fd1f35c:::benchmark_data_smithi188_134454_object119901:head# 2024-04-01T19:48:47.477 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fd25c13:::benchmark_data_smithi188_134454_object124395:head# 2024-04-01T19:48:47.477 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fd2dd5f:::benchmark_data_smithi188_134454_object143373:head# 2024-04-01T19:48:47.477 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fda136d:::benchmark_data_smithi188_134454_object144577:head# 2024-04-01T19:48:47.478 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fdcd24f:::benchmark_data_smithi188_134454_object125543:head# 2024-04-01T19:48:47.478 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fde6dd6:::benchmark_data_smithi188_134454_object133646:head# 2024-04-01T19:48:47.478 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fe135db:::benchmark_data_smithi188_134454_object137775:head# 2024-04-01T19:48:47.478 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fe21b0f:::benchmark_data_smithi188_134454_object144382:head# 2024-04-01T19:48:47.478 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fe31c9f:::benchmark_data_smithi188_134454_object141659:head# 2024-04-01T19:48:47.478 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fe3275c:::benchmark_data_smithi188_134454_object124563:head# 2024-04-01T19:48:47.479 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fe37e2b:::benchmark_data_smithi188_134454_object130940:head# 2024-04-01T19:48:47.479 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fe448ae:::benchmark_data_smithi188_134454_object122733:head# 2024-04-01T19:48:47.479 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fe666ad:::benchmark_data_smithi188_134454_object137167:head# 2024-04-01T19:48:47.479 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fe78f4c:::benchmark_data_smithi188_134454_object128976:head# 2024-04-01T19:48:47.480 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fed3e3a:::benchmark_data_smithi188_134454_object152380:head# 2024-04-01T19:48:47.480 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fed5ab6:::benchmark_data_smithi188_134454_object156303:head# 2024-04-01T19:48:47.480 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ff05caa:::benchmark_data_smithi188_134454_object127016:head# 2024-04-01T19:48:47.480 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ff482e7:::benchmark_data_smithi188_134454_object119282:head# 2024-04-01T19:48:47.480 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ff51291:::benchmark_data_smithi188_134454_object149501:head# 2024-04-01T19:48:47.480 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ff85faa:::benchmark_data_smithi188_134454_object119826:head# 2024-04-01T19:48:47.480 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ff90e9a:::benchmark_data_smithi188_134454_object147595:head# 2024-04-01T19:48:47.480 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ffa96a5:::benchmark_data_smithi188_134454_object119377:head# 2024-04-01T19:48:47.481 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7ffecd27:::benchmark_data_smithi188_134454_object153903:head# 2024-04-01T19:48:47.484 INFO:teuthology.orchestra.run.smithi022.stderr:Read #6:7fff4fa5:::benchmark_data_smithi188_134454_object123100:head# 2024-04-01T19:48:47.485 INFO:teuthology.orchestra.run.smithi022.stderr:Export successful 2024-04-01T19:48:47.546 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:48:47.596 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:47 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1421132479' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:48:47.596 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:47 smithi062 ceph-mon[44211]: pgmap v1504: 17 pgs: 17 active+clean; 1.8 GiB data, 8.1 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 952 op/s; 21 MiB/s, 334 objects/s recovering 2024-04-01T19:48:47.602 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:47.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:47 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1421132479' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:48:47.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:47 smithi188 ceph-mon[43939]: pgmap v1504: 17 pgs: 17 active+clean; 1.8 GiB data, 8.1 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 952 op/s; 21 MiB/s, 334 objects/s recovering 2024-04-01T19:48:47.640 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:48:47.644 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:47.645 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:48:47.746 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:48:47.792 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:47.825 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:48:47.829 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:47.829 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:48:47.930 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:48:47.957 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:47.980 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:48:47.982 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:47.983 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:48:48.084 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:48:48.114 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:48.136 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:48:48.138 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:48.139 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:48:48.240 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:48:48.291 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:48.295 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:48 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:48:48.296 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:48 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1421132479' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:48:48.296 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:48 smithi022 ceph-mon[39439]: osdmap e547: 12 total, 11 up, 11 in 2024-04-01T19:48:48.296 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:48 smithi022 ceph-mon[39439]: 6.f scrub starts 2024-04-01T19:48:48.317 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:48:48.320 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:48.321 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:48:48.422 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:48:48.516 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:48.551 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:48:48.561 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:48.562 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:48:48.562 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:48 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:48:48.562 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:48 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1421132479' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:48:48.562 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:48 smithi062 ceph-mon[44211]: osdmap e547: 12 total, 11 up, 11 in 2024-04-01T19:48:48.562 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:48 smithi062 ceph-mon[44211]: 6.f scrub starts 2024-04-01T19:48:48.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:48 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:48:48.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:48 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1421132479' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:48:48.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:48 smithi188 ceph-mon[43939]: osdmap e547: 12 total, 11 up, 11 in 2024-04-01T19:48:48.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:48 smithi188 ceph-mon[43939]: 6.f scrub starts 2024-04-01T19:48:48.663 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:48:48.707 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:48.733 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:48:48.741 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:48.741 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:48:48.842 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:48:48.901 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:48.936 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:48:48.939 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:48.939 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:48:49.040 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:48:49.107 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:49.144 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:48:49.147 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:49.147 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:48:49.249 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:48:49.293 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:49.346 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:48:49.346 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:48:49.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:49 smithi062 ceph-mon[44211]: 6.f scrub ok 2024-04-01T19:48:49.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:49 smithi062 ceph-mon[44211]: pgmap v1506: 17 pgs: 17 active+clean; 1.7 GiB data, 7.8 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:48:49.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:49 smithi022 ceph-mon[39439]: 6.f scrub ok 2024-04-01T19:48:49.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:49 smithi022 ceph-mon[39439]: pgmap v1506: 17 pgs: 17 active+clean; 1.7 GiB data, 7.8 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:48:49.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:49 smithi188 ceph-mon[43939]: 6.f scrub ok 2024-04-01T19:48:49.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:49 smithi188 ceph-mon[43939]: pgmap v1506: 17 pgs: 17 active+clean; 1.7 GiB data, 7.8 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:48:49.768 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:48:49.774 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:49.775 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:48:49.875 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:48:49.990 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:50.044 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:48:50.051 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:50.051 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:48:50.152 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:48:50.220 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:50.257 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:48:50.260 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:50.261 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:48:50.362 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:48:50.389 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:50.411 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:48:50.413 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:50.414 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:48:50.515 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:48:50.542 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:50.561 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:48:50.565 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:50 smithi188 ceph-mon[43939]: 6.d scrub starts 2024-04-01T19:48:50.565 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:50 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:48:50.565 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:50 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:48:50.565 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:50 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:48:50.565 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:50 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:48:50.566 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:50.566 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:48:50.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:50 smithi022 ceph-mon[39439]: 6.d scrub starts 2024-04-01T19:48:50.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:50 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:48:50.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:50 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:48:50.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:50 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:48:50.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:50 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:48:50.667 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:48:50.693 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:50.713 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:48:50.714 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:50.715 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:48:50.745 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -n osd.1 --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --force --op remove --pgid 6.e 2024-04-01T19:48:50.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:50 smithi062 ceph-mon[44211]: 6.d scrub starts 2024-04-01T19:48:50.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:50 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:48:50.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:50 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:48:50.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:50 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:48:50.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:50 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:48:50.816 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:48:50.875 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:50.912 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:48:50.915 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:50.915 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:48:51.017 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:48:51.045 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:51.047 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_historic_ops 2024-04-01T19:48:51.057 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/osd.1/config 2024-04-01T19:48:51.067 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:48:51.069 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:51.070 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:48:51.171 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:48:51.198 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:51.218 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:48:51.221 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:51.221 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:48:51.322 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:48:51.342 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:51 smithi188 ceph-mon[43939]: 6.d scrub ok 2024-04-01T19:48:51.342 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:51 smithi188 ceph-mon[43939]: 6.8 scrub starts 2024-04-01T19:48:51.342 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:51 smithi188 ceph-mon[43939]: 6.8 scrub ok 2024-04-01T19:48:51.342 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:51 smithi188 ceph-mon[43939]: pgmap v1507: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 1.6 GiB data, 7.6 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:48:51.369 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:51.404 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:48:51.413 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:51.413 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:48:51.514 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:48:51.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:51 smithi022 ceph-mon[39439]: 6.d scrub ok 2024-04-01T19:48:51.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:51 smithi022 ceph-mon[39439]: 6.8 scrub starts 2024-04-01T19:48:51.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:51 smithi022 ceph-mon[39439]: 6.8 scrub ok 2024-04-01T19:48:51.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:51 smithi022 ceph-mon[39439]: pgmap v1507: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 1.6 GiB data, 7.6 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:48:51.574 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:51.736 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:48:51.740 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:51.741 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:48:51.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:51 smithi062 ceph-mon[44211]: 6.d scrub ok 2024-04-01T19:48:51.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:51 smithi062 ceph-mon[44211]: 6.8 scrub starts 2024-04-01T19:48:51.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:51 smithi062 ceph-mon[44211]: 6.8 scrub ok 2024-04-01T19:48:51.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:51 smithi062 ceph-mon[44211]: pgmap v1507: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 1.6 GiB data, 7.6 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:48:51.810 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:48:51.833 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:48:51.842 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:48:51.874 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:48:51.885 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:51.899 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:48:51.945 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:48:51.973 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:48:51.995 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:48:52.020 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:48:52.053 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:48:52.083 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:48:52.106 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:48:52.139 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:48:52.140 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:48:52.140 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-01T19:48:52.140 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:48:52.140 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:48:52.140 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:48:52.140 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:48:52.140 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:48:52.140 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:48:52.140 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:48:52.140 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:48:52.140 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:48:52.140 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:48:52.498 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:52 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:48:52.498 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:52 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:48:52.498 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:52 smithi022 ceph-mon[39439]: 6.0 scrub starts 2024-04-01T19:48:52.498 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:52 smithi022 ceph-mon[39439]: 6.0 scrub ok 2024-04-01T19:48:52.499 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:52 smithi022 ceph-mon[39439]: osdmap e548: 12 total, 11 up, 11 in 2024-04-01T19:48:52.499 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:52 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/267093262' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:48:52.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:52 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:48:52.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:52 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:48:52.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:52 smithi188 ceph-mon[43939]: 6.0 scrub starts 2024-04-01T19:48:52.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:52 smithi188 ceph-mon[43939]: 6.0 scrub ok 2024-04-01T19:48:52.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:52 smithi188 ceph-mon[43939]: osdmap e548: 12 total, 11 up, 11 in 2024-04-01T19:48:52.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:52 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/267093262' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:48:52.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:52 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:48:52.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:52 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:48:52.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:52 smithi062 ceph-mon[44211]: 6.0 scrub starts 2024-04-01T19:48:52.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:52 smithi062 ceph-mon[44211]: 6.0 scrub ok 2024-04-01T19:48:52.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:52 smithi062 ceph-mon[44211]: osdmap e548: 12 total, 11 up, 11 in 2024-04-01T19:48:52.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:52 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/267093262' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:48:52.950 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:48:52.956 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:52.956 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:48:52.975 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:48:52.975 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:48:53.057 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:48:53.085 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:53.108 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:48:53.110 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:53.110 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:48:53.211 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:48:53.258 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:53.293 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:48:53.299 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:53.299 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:48:53.400 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:48:53.438 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:53.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:53 smithi062 ceph-mon[44211]: 6.5 scrub starts 2024-04-01T19:48:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:53 smithi062 ceph-mon[44211]: 6.5 scrub ok 2024-04-01T19:48:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:53 smithi062 ceph-mon[44211]: pgmap v1509: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 1.5 GiB data, 7.4 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:48:53.557 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:48:53.562 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:53.562 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:48:53.604 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:48:53.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:53 smithi022 ceph-mon[39439]: 6.5 scrub starts 2024-04-01T19:48:53.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:53 smithi022 ceph-mon[39439]: 6.5 scrub ok 2024-04-01T19:48:53.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:53 smithi022 ceph-mon[39439]: pgmap v1509: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 1.5 GiB data, 7.4 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:48:53.620 INFO:teuthology.orchestra.run.smithi022.stderr:Creating an OSD daemon form without an OSD FSID value 2024-04-01T19:48:53.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:53 smithi188 ceph-mon[43939]: 6.5 scrub starts 2024-04-01T19:48:53.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:53 smithi188 ceph-mon[43939]: 6.5 scrub ok 2024-04-01T19:48:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:48:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:53 smithi188 ceph-mon[43939]: pgmap v1509: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 1.5 GiB data, 7.4 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:48:53.664 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:48:53.679 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:48:53.692 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:53.719 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:48:53.722 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:53.722 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:48:53.823 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:48:53.851 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:53.871 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:48:53.875 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:53.875 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:48:53.976 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:48:54.003 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:54.029 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:48:54.031 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:54.032 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:48:54.133 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:48:54.161 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:54.182 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:48:54.239 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:54.239 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:48:54.340 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:48:54.413 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:54.469 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:48:54.474 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:54.475 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:48:54.549 INFO:teuthology.orchestra.run.smithi022.stdout: marking collection for removal 2024-04-01T19:48:54.549 INFO:teuthology.orchestra.run.smithi022.stdout:setting '_remove' omap key 2024-04-01T19:48:54.550 INFO:teuthology.orchestra.run.smithi022.stdout:finish_remove_pgs 6.e_head removing 6.e 2024-04-01T19:48:54.576 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:48:54.603 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:54.612 INFO:teuthology.orchestra.run.smithi022.stdout:Remove successful 2024-04-01T19:48:54.624 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:48:54.627 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:54.628 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:48:54.729 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:48:54.770 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:54.977 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:48:56.246 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:56 smithi022 ceph-mon[39439]: 6.3 scrub starts 2024-04-01T19:48:56.246 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:56 smithi022 ceph-mon[39439]: 6.3 scrub ok 2024-04-01T19:48:56.246 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:56 smithi022 ceph-mon[39439]: pgmap v1510: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 1.4 GiB data, 7.2 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 975 op/s 2024-04-01T19:48:56.363 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -n osd.1 --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.6.e.1 2024-04-01T19:48:56.443 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:48:56.452 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:56.452 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:48:56.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:56 smithi062 ceph-mon[44211]: 6.3 scrub starts 2024-04-01T19:48:56.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:56 smithi062 ceph-mon[44211]: 6.3 scrub ok 2024-04-01T19:48:56.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:56 smithi062 ceph-mon[44211]: pgmap v1510: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 1.4 GiB data, 7.2 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 975 op/s 2024-04-01T19:48:56.553 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:48:56.579 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:56 smithi188 ceph-mon[43939]: 6.3 scrub starts 2024-04-01T19:48:56.579 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:56 smithi188 ceph-mon[43939]: 6.3 scrub ok 2024-04-01T19:48:56.579 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:56 smithi188 ceph-mon[43939]: pgmap v1510: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 1.4 GiB data, 7.2 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 975 op/s 2024-04-01T19:48:56.581 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:56.602 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:48:56.604 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:56.605 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:48:56.705 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:48:56.737 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:56.760 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:48:56.763 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:56.763 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:48:56.770 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/osd.1/config 2024-04-01T19:48:56.864 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:48:56.894 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:56.915 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:48:56.917 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:56.917 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:48:57.018 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:48:57.049 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:57.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:57 smithi022 ceph-mon[39439]: pgmap v1511: 17 pgs: 17 active+clean; 1.2 GiB data, 6.8 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:48:57.381 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:48:57.389 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:57.389 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:48:57.490 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:48:57.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:57 smithi062 ceph-mon[44211]: pgmap v1511: 17 pgs: 17 active+clean; 1.2 GiB data, 6.8 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:48:57.518 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:57 smithi188 ceph-mon[43939]: pgmap v1511: 17 pgs: 17 active+clean; 1.2 GiB data, 6.8 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:48:57.520 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:57.539 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:48:57.543 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:57.543 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:48:57.644 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:48:57.699 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:58.267 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:48:58.277 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:58.277 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:48:58.314 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:48:58.314 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 20, 2024-04-01T19:48:58.314 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 600, 2024-04-01T19:48:58.314 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:48:58.314 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.314 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:156330 6.6 6:62f786ba:::benchmark_data_smithi188_134454_object156329:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e504)", 2024-04-01T19:48:58.314 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:46:21.966066+0000", 2024-04-01T19:48:58.314 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 156.34697363199999, 2024-04-01T19:48:58.314 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.13775979799999999, 2024-04-01T19:48:58.314 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:58.314 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:58.314 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:58.314 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:58.314 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:48:58.315 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:48:58.315 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 156330 2024-04-01T19:48:58.315 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.315 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:58.315 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.315 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:58.315 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:21.966066+0000", 2024-04-01T19:48:58.315 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.315 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.315 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.315 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:58.315 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:21.966066+0000", 2024-04-01T19:48:58.315 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.315 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.315 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.316 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:58.316 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:21.966068+0000", 2024-04-01T19:48:58.316 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8640000000000001e-06 2024-04-01T19:48:58.316 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.316 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.316 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:58.316 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:21.966117+0000", 2024-04-01T19:48:58.316 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9193999999999997e-05 2024-04-01T19:48:58.316 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.316 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.316 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:58.316 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:21.966128+0000", 2024-04-01T19:48:58.316 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0411000000000001e-05 2024-04-01T19:48:58.316 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.317 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.317 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:58.317 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:21.966134+0000", 2024-04-01T19:48:58.317 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5919999999999997e-06 2024-04-01T19:48:58.317 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.317 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.317 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:58.317 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:21.966190+0000", 2024-04-01T19:48:58.317 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5816999999999998e-05 2024-04-01T19:48:58.317 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.317 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.317 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:58.317 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:21.966337+0000", 2024-04-01T19:48:58.317 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000146902 2024-04-01T19:48:58.318 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.318 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.318 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 4", 2024-04-01T19:48:58.318 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:21.966489+0000", 2024-04-01T19:48:58.318 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015252700000000001 2024-04-01T19:48:58.318 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.318 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.318 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:58.318 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:21.975243+0000", 2024-04-01T19:48:58.318 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0087537629999999995 2024-04-01T19:48:58.318 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.318 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.319 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:58.319 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:22.103724+0000", 2024-04-01T19:48:58.319 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.12848108599999999 2024-04-01T19:48:58.319 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.319 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.319 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:58.319 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:22.103786+0000", 2024-04-01T19:48:58.319 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1480000000000001e-05 2024-04-01T19:48:58.319 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.319 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.319 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:58.319 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:22.103826+0000", 2024-04-01T19:48:58.319 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.0161999999999999e-05 2024-04-01T19:48:58.319 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.320 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:58.320 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.320 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.320 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.320 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:157504 6.c 6:3c61044c:::benchmark_data_smithi188_134454_object763:head [delete] snapc 0=[] ondisk+write+known_if_redirected e504)", 2024-04-01T19:48:58.320 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:46:24.552020+0000", 2024-04-01T19:48:58.320 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 153.76101971400001, 2024-04-01T19:48:58.320 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.14184583100000001, 2024-04-01T19:48:58.320 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:58.320 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:58.320 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:58.320 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:58.320 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:48:58.320 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:48:58.320 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 157504 2024-04-01T19:48:58.320 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.321 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:58.321 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.321 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:58.321 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.552020+0000", 2024-04-01T19:48:58.321 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.321 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.321 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.321 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:58.321 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.552020+0000", 2024-04-01T19:48:58.321 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.321 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.321 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.321 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:58.321 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.552023+0000", 2024-04-01T19:48:58.321 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.8159999999999998e-06 2024-04-01T19:48:58.321 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.322 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.322 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:58.322 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.552029+0000", 2024-04-01T19:48:58.322 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2859999999999996e-06 2024-04-01T19:48:58.322 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.322 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.322 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:58.322 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.552041+0000", 2024-04-01T19:48:58.322 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1795e-05 2024-04-01T19:48:58.322 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.322 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.322 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:58.322 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.552049+0000", 2024-04-01T19:48:58.322 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7600000000000002e-06 2024-04-01T19:48:58.322 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.322 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.323 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:58.323 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.589025+0000", 2024-04-01T19:48:58.323 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.036976289000000002 2024-04-01T19:48:58.323 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.323 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.323 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:58.323 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.589145+0000", 2024-04-01T19:48:58.323 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012003800000000001 2024-04-01T19:48:58.323 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.323 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.323 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6", 2024-04-01T19:48:58.323 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.589261+0000", 2024-04-01T19:48:58.323 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000115627 2024-04-01T19:48:58.323 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.323 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.324 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:58.324 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.593770+0000", 2024-04-01T19:48:58.324 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.004509519 2024-04-01T19:48:58.324 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.324 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.324 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:58.324 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.693784+0000", 2024-04-01T19:48:58.324 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.100013591 2024-04-01T19:48:58.324 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.324 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.324 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:58.324 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.693822+0000", 2024-04-01T19:48:58.324 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.8179999999999997e-05 2024-04-01T19:48:58.324 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.324 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.324 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:58.325 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.693866+0000", 2024-04-01T19:48:58.325 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.3930000000000001e-05 2024-04-01T19:48:58.325 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.325 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:58.325 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.325 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.325 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.325 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:157682 6.c 6:3cfd472b:::benchmark_data_smithi188_134454_object941:head [delete] snapc 0=[] ondisk+write+known_if_redirected e504)", 2024-04-01T19:48:58.325 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:46:24.774604+0000", 2024-04-01T19:48:58.325 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 153.53843570800001, 2024-04-01T19:48:58.325 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.144987265, 2024-04-01T19:48:58.325 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:58.325 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:58.325 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:58.326 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:58.326 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:48:58.326 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:48:58.326 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 157682 2024-04-01T19:48:58.326 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.326 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:58.326 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.326 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:58.326 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.774604+0000", 2024-04-01T19:48:58.326 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.326 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.326 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.326 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:58.327 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.774604+0000", 2024-04-01T19:48:58.327 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.327 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.327 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.327 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:58.327 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.774605+0000", 2024-04-01T19:48:58.327 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.61e-07 2024-04-01T19:48:58.327 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.327 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.327 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:58.327 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.774607+0000", 2024-04-01T19:48:58.327 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5270000000000001e-06 2024-04-01T19:48:58.327 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.328 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.328 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:58.328 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.774611+0000", 2024-04-01T19:48:58.328 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9230000000000004e-06 2024-04-01T19:48:58.328 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.328 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.328 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:58.328 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.774614+0000", 2024-04-01T19:48:58.328 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.1599999999999998e-06 2024-04-01T19:48:58.328 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.328 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.328 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:58.328 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.811126+0000", 2024-04-01T19:48:58.328 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.036511582000000001 2024-04-01T19:48:58.329 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.329 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.329 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:58.329 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.811204+0000", 2024-04-01T19:48:58.329 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.8584000000000005e-05 2024-04-01T19:48:58.329 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.329 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.329 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6", 2024-04-01T19:48:58.329 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.811276+0000", 2024-04-01T19:48:58.329 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.1995000000000004e-05 2024-04-01T19:48:58.329 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.329 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.329 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:58.329 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.815334+0000", 2024-04-01T19:48:58.330 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0040580529999999998 2024-04-01T19:48:58.330 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.330 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.330 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:58.330 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.919435+0000", 2024-04-01T19:48:58.330 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.104100841 2024-04-01T19:48:58.330 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.330 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.330 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:58.330 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.919506+0000", 2024-04-01T19:48:58.330 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0747000000000006e-05 2024-04-01T19:48:58.330 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.330 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.330 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:58.331 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:24.919591+0000", 2024-04-01T19:48:58.331 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5191999999999993e-05 2024-04-01T19:48:58.331 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.331 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:58.331 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.331 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.331 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.331 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:158510 6.6 6:6e02efc0:::benchmark_data_smithi188_134454_object1769:head [delete] snapc 0=[] ondisk+write+known_if_redirected e504)", 2024-04-01T19:48:58.331 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:46:25.892517+0000", 2024-04-01T19:48:58.331 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 152.42052268500001, 2024-04-01T19:48:58.331 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.26250451299999999, 2024-04-01T19:48:58.331 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:58.331 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:58.331 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:58.331 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:58.332 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:48:58.332 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:48:58.332 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 158510 2024-04-01T19:48:58.332 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.332 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:58.332 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.332 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:58.332 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.892517+0000", 2024-04-01T19:48:58.332 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.332 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.332 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.332 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:58.332 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.892517+0000", 2024-04-01T19:48:58.332 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.332 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.333 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.333 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:58.333 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.892519+0000", 2024-04-01T19:48:58.333 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.841e-06 2024-04-01T19:48:58.333 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.333 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.333 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:58.333 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.892523+0000", 2024-04-01T19:48:58.333 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.233e-06 2024-04-01T19:48:58.333 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.333 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.333 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:58.333 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.892534+0000", 2024-04-01T19:48:58.333 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1094000000000001e-05 2024-04-01T19:48:58.334 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.334 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.334 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:58.334 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.892540+0000", 2024-04-01T19:48:58.334 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0730000000000001e-06 2024-04-01T19:48:58.334 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.334 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.334 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:58.334 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.892598+0000", 2024-04-01T19:48:58.334 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7703e-05 2024-04-01T19:48:58.334 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.334 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.334 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:58.334 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.892738+0000", 2024-04-01T19:48:58.334 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000140156 2024-04-01T19:48:58.335 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.335 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.335 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 4", 2024-04-01T19:48:58.335 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.892804+0000", 2024-04-01T19:48:58.335 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5681999999999999e-05 2024-04-01T19:48:58.335 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.335 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.335 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:58.335 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.896528+0000", 2024-04-01T19:48:58.335 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0037242249999999998 2024-04-01T19:48:58.335 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.335 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.335 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:58.335 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.154908+0000", 2024-04-01T19:48:58.336 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.25838013199999998 2024-04-01T19:48:58.336 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.336 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.336 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:58.336 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.154968+0000", 2024-04-01T19:48:58.336 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9849999999999998e-05 2024-04-01T19:48:58.336 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.336 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.336 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:58.336 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.155022+0000", 2024-04-01T19:48:58.336 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3523999999999998e-05 2024-04-01T19:48:58.336 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.336 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:58.336 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.336 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.337 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.337 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:158515 6.6 6:64407436:::benchmark_data_smithi188_134454_object1774:head [delete] snapc 0=[] ondisk+write+known_if_redirected e504)", 2024-04-01T19:48:58.337 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:46:25.897564+0000", 2024-04-01T19:48:58.337 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 152.415475679, 2024-04-01T19:48:58.337 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.25763424099999999, 2024-04-01T19:48:58.337 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:58.337 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:58.337 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:58.337 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:58.337 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:48:58.337 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:48:58.337 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 158515 2024-04-01T19:48:58.337 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.337 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:58.338 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.338 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:58.338 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.897564+0000", 2024-04-01T19:48:58.338 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.338 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.338 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.338 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:58.338 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.897564+0000", 2024-04-01T19:48:58.338 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.338 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.338 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.338 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:58.338 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.897567+0000", 2024-04-01T19:48:58.339 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5909999999999998e-06 2024-04-01T19:48:58.339 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.339 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.339 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:58.339 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.897573+0000", 2024-04-01T19:48:58.339 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.285e-06 2024-04-01T19:48:58.339 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.339 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.339 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:58.339 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.897588+0000", 2024-04-01T19:48:58.339 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4656e-05 2024-04-01T19:48:58.339 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.339 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.339 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:58.340 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.897596+0000", 2024-04-01T19:48:58.340 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5730000000000008e-06 2024-04-01T19:48:58.340 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.340 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.340 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:58.340 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.897644+0000", 2024-04-01T19:48:58.340 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8087000000000002e-05 2024-04-01T19:48:58.340 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.340 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.340 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:58.340 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.897777+0000", 2024-04-01T19:48:58.340 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013244299999999999 2024-04-01T19:48:58.340 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.340 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.341 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 4", 2024-04-01T19:48:58.341 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.897902+0000", 2024-04-01T19:48:58.341 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012532400000000001 2024-04-01T19:48:58.341 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.341 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.341 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:58.341 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.902110+0000", 2024-04-01T19:48:58.341 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0042075080000000004 2024-04-01T19:48:58.341 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.341 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.341 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:58.341 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.155087+0000", 2024-04-01T19:48:58.341 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.25297767999999998 2024-04-01T19:48:58.341 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.341 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.342 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:58.342 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.155138+0000", 2024-04-01T19:48:58.342 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0754999999999998e-05 2024-04-01T19:48:58.342 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.342 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.342 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:58.342 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.155198+0000", 2024-04-01T19:48:58.342 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0338999999999999e-05 2024-04-01T19:48:58.342 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.342 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:58.342 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.342 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.342 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.343 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:158527 6.6 6:69833953:::benchmark_data_smithi188_134454_object1786:head [delete] snapc 0=[] ondisk+write+known_if_redirected e504)", 2024-04-01T19:48:58.343 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:46:25.922592+0000", 2024-04-01T19:48:58.343 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 152.390447843, 2024-04-01T19:48:58.343 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.23275526599999999, 2024-04-01T19:48:58.343 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:58.343 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:58.343 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:58.343 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:58.343 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:48:58.343 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:48:58.343 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 158527 2024-04-01T19:48:58.343 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.343 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:58.343 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.344 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:58.344 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.922592+0000", 2024-04-01T19:48:58.344 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.344 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.344 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.344 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:58.344 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.922592+0000", 2024-04-01T19:48:58.344 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.344 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.344 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.344 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:58.344 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.922594+0000", 2024-04-01T19:48:58.344 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.08e-06 2024-04-01T19:48:58.344 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.344 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.345 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:58.345 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.922601+0000", 2024-04-01T19:48:58.345 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.7399999999999998e-06 2024-04-01T19:48:58.345 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.345 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.345 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:58.345 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.922615+0000", 2024-04-01T19:48:58.345 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3922e-05 2024-04-01T19:48:58.345 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.345 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.345 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:58.345 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.922624+0000", 2024-04-01T19:48:58.345 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.2869999999999993e-06 2024-04-01T19:48:58.345 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.345 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.346 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:58.346 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.922671+0000", 2024-04-01T19:48:58.346 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7265999999999998e-05 2024-04-01T19:48:58.346 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.346 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.346 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:58.346 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.922749+0000", 2024-04-01T19:48:58.346 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7787999999999995e-05 2024-04-01T19:48:58.346 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.346 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.346 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 4", 2024-04-01T19:48:58.346 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.922819+0000", 2024-04-01T19:48:58.346 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0285999999999998e-05 2024-04-01T19:48:58.347 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.347 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.347 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:58.347 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.930186+0000", 2024-04-01T19:48:58.347 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0073662700000000003 2024-04-01T19:48:58.347 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.347 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.347 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:58.347 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.155251+0000", 2024-04-01T19:48:58.347 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.22506568900000001 2024-04-01T19:48:58.347 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.347 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.347 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:58.347 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.155306+0000", 2024-04-01T19:48:58.348 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4706000000000001e-05 2024-04-01T19:48:58.348 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.348 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.348 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:58.348 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.155347+0000", 2024-04-01T19:48:58.348 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1232000000000001e-05 2024-04-01T19:48:58.348 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.348 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:58.348 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.348 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.348 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.348 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:158529 6.6 6:641e4a08:::benchmark_data_smithi188_134454_object1788:head [delete] snapc 0=[] ondisk+write+known_if_redirected e504)", 2024-04-01T19:48:58.348 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:46:25.923401+0000", 2024-04-01T19:48:58.348 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 152.38963852800001, 2024-04-01T19:48:58.349 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.232067299, 2024-04-01T19:48:58.349 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:58.349 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:58.349 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:58.349 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:58.349 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:48:58.349 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:48:58.349 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 158529 2024-04-01T19:48:58.349 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.349 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:58.349 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.349 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:58.349 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.923401+0000", 2024-04-01T19:48:58.349 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.349 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.349 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.350 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:58.350 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.923401+0000", 2024-04-01T19:48:58.350 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.350 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.350 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.350 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:58.350 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.923402+0000", 2024-04-01T19:48:58.350 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.305e-06 2024-04-01T19:48:58.350 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.350 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.350 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:58.350 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.923407+0000", 2024-04-01T19:48:58.350 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.87e-06 2024-04-01T19:48:58.350 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.350 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.351 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:58.351 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.923421+0000", 2024-04-01T19:48:58.351 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3882e-05 2024-04-01T19:48:58.351 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.351 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.351 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:58.351 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.923429+0000", 2024-04-01T19:48:58.351 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.8080000000000005e-06 2024-04-01T19:48:58.351 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.351 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.351 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:58.351 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.926612+0000", 2024-04-01T19:48:58.351 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.003182566 2024-04-01T19:48:58.351 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.351 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.351 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:58.352 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.926703+0000", 2024-04-01T19:48:58.352 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.1409999999999994e-05 2024-04-01T19:48:58.352 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.352 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.352 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 4", 2024-04-01T19:48:58.352 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.926765+0000", 2024-04-01T19:48:58.352 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1573000000000002e-05 2024-04-01T19:48:58.352 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.352 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.352 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:58.352 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.930308+0000", 2024-04-01T19:48:58.352 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0035431550000000001 2024-04-01T19:48:58.352 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.352 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.352 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:58.352 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.155389+0000", 2024-04-01T19:48:58.353 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.22508139899999999 2024-04-01T19:48:58.353 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.353 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.353 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:58.353 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.155433+0000", 2024-04-01T19:48:58.353 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.4195e-05 2024-04-01T19:48:58.353 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.353 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.353 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:58.353 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.155468+0000", 2024-04-01T19:48:58.353 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.5135999999999997e-05 2024-04-01T19:48:58.353 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.353 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:58.353 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.353 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.354 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.354 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:158532 6.c 6:3bf31366:::benchmark_data_smithi188_134454_object1791:head [delete] snapc 0=[] ondisk+write+known_if_redirected e504)", 2024-04-01T19:48:58.354 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:46:25.928206+0000", 2024-04-01T19:48:58.354 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 152.38483408499999, 2024-04-01T19:48:58.354 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.222143591, 2024-04-01T19:48:58.354 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:58.354 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:58.354 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:58.354 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:58.354 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:48:58.354 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:48:58.354 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 158532 2024-04-01T19:48:58.354 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.354 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:58.355 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.355 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:58.355 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.928206+0000", 2024-04-01T19:48:58.355 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.355 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.355 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.355 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:58.355 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.928206+0000", 2024-04-01T19:48:58.355 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.355 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.355 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.355 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:58.355 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.928207+0000", 2024-04-01T19:48:58.355 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7349999999999999e-06 2024-04-01T19:48:58.355 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.355 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.356 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:58.356 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.928212+0000", 2024-04-01T19:48:58.356 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0860000000000001e-06 2024-04-01T19:48:58.356 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.356 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.356 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:58.356 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.928222+0000", 2024-04-01T19:48:58.356 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.4069999999999999e-06 2024-04-01T19:48:58.356 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.356 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.356 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:58.356 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.928229+0000", 2024-04-01T19:48:58.356 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0870000000000001e-06 2024-04-01T19:48:58.356 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.356 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.356 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:58.357 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.944102+0000", 2024-04-01T19:48:58.357 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.015873211000000002 2024-04-01T19:48:58.357 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.357 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.357 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:58.357 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.944189+0000", 2024-04-01T19:48:58.357 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.7205000000000003e-05 2024-04-01T19:48:58.357 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.357 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.357 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6", 2024-04-01T19:48:58.357 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.944256+0000", 2024-04-01T19:48:58.357 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.6748000000000005e-05 2024-04-01T19:48:58.357 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.357 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.358 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:58.358 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.952635+0000", 2024-04-01T19:48:58.358 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0083786869999999992 2024-04-01T19:48:58.358 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.358 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.358 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:58.358 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.956808+0000", 2024-04-01T19:48:58.358 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0041727639999999998 2024-04-01T19:48:58.358 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.358 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.358 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:58.358 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.150276+0000", 2024-04-01T19:48:58.358 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.193468846 2024-04-01T19:48:58.359 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.359 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.359 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:58.359 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.150349+0000", 2024-04-01T19:48:58.359 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2815e-05 2024-04-01T19:48:58.359 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.359 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:58.359 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.359 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.359 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.359 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:158537 6.c 6:3e49fb2d:::benchmark_data_smithi188_134454_object1796:head [delete] snapc 0=[] ondisk+write+known_if_redirected e504)", 2024-04-01T19:48:58.359 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:46:25.933525+0000", 2024-04-01T19:48:58.359 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 152.37951514400001, 2024-04-01T19:48:58.359 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21704569200000001, 2024-04-01T19:48:58.359 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:58.360 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:58.360 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:58.360 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:58.360 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:48:58.360 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:48:58.360 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 158537 2024-04-01T19:48:58.360 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.360 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:58.360 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.360 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:58.360 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.933525+0000", 2024-04-01T19:48:58.360 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.360 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.360 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.360 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:58.361 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.933525+0000", 2024-04-01T19:48:58.361 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.361 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.361 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.361 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:58.361 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.933527+0000", 2024-04-01T19:48:58.361 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3530000000000002e-06 2024-04-01T19:48:58.361 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.361 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.361 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:58.361 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.933533+0000", 2024-04-01T19:48:58.361 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8449999999999999e-06 2024-04-01T19:48:58.361 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.361 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.362 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:58.362 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.933543+0000", 2024-04-01T19:48:58.362 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0582e-05 2024-04-01T19:48:58.362 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.362 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.362 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:58.362 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.933551+0000", 2024-04-01T19:48:58.362 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.1539999999999996e-06 2024-04-01T19:48:58.362 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.362 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.362 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:58.362 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.948879+0000", 2024-04-01T19:48:58.362 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.015328509000000001 2024-04-01T19:48:58.362 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.362 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.363 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:58.363 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.948959+0000", 2024-04-01T19:48:58.363 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9515e-05 2024-04-01T19:48:58.363 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.363 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.363 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6", 2024-04-01T19:48:58.363 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.949043+0000", 2024-04-01T19:48:58.363 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4531999999999996e-05 2024-04-01T19:48:58.363 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.363 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.363 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:58.363 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.952780+0000", 2024-04-01T19:48:58.363 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0037374090000000001 2024-04-01T19:48:58.363 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.363 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.364 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:58.364 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.150459+0000", 2024-04-01T19:48:58.364 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.197678613 2024-04-01T19:48:58.364 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.364 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.364 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:58.364 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.150517+0000", 2024-04-01T19:48:58.364 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8180000000000002e-05 2024-04-01T19:48:58.364 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.364 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.364 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:58.364 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.150570+0000", 2024-04-01T19:48:58.364 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3000000000000001e-05 2024-04-01T19:48:58.364 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.364 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:58.364 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.365 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.365 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.365 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:158541 6.c 6:3436c130:::benchmark_data_smithi188_134454_object1800:head [delete] snapc 0=[] ondisk+write+known_if_redirected e504)", 2024-04-01T19:48:58.365 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:46:25.938553+0000", 2024-04-01T19:48:58.365 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 152.37448714600001, 2024-04-01T19:48:58.365 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.22258192099999999, 2024-04-01T19:48:58.365 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:58.365 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:58.365 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:58.365 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:58.365 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:48:58.365 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:48:58.365 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 158541 2024-04-01T19:48:58.365 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.365 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:58.366 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.366 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:58.366 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.938553+0000", 2024-04-01T19:48:58.366 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.366 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.366 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.366 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:58.366 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.938553+0000", 2024-04-01T19:48:58.366 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.366 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.366 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.366 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:58.366 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.938555+0000", 2024-04-01T19:48:58.367 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.464e-06 2024-04-01T19:48:58.367 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.367 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.367 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:58.367 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.938564+0000", 2024-04-01T19:48:58.367 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.8149999999999995e-06 2024-04-01T19:48:58.367 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.367 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.367 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:58.367 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.938577+0000", 2024-04-01T19:48:58.367 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3155e-05 2024-04-01T19:48:58.367 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.367 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.367 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:58.368 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.938586+0000", 2024-04-01T19:48:58.368 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.3850000000000008e-06 2024-04-01T19:48:58.368 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.368 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.368 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:58.368 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.952813+0000", 2024-04-01T19:48:58.368 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.01422667 2024-04-01T19:48:58.368 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.368 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.368 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:58.368 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.952898+0000", 2024-04-01T19:48:58.368 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5154000000000005e-05 2024-04-01T19:48:58.368 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.368 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.368 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6", 2024-04-01T19:48:58.368 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.952976+0000", 2024-04-01T19:48:58.369 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7644000000000004e-05 2024-04-01T19:48:58.369 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.369 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.369 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:58.369 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.150616+0000", 2024-04-01T19:48:58.369 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.19764061399999999 2024-04-01T19:48:58.369 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.369 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.369 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:58.369 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.161031+0000", 2024-04-01T19:48:58.369 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010414446000000001 2024-04-01T19:48:58.369 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.369 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.369 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:58.369 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.161063+0000", 2024-04-01T19:48:58.370 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.2462999999999997e-05 2024-04-01T19:48:58.370 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.370 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.370 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:58.370 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.161134+0000", 2024-04-01T19:48:58.370 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.1111000000000004e-05 2024-04-01T19:48:58.370 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.370 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:58.370 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.370 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.370 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.370 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:158548 6.6 6:64b8ea88:::benchmark_data_smithi188_134454_object1807:head [delete] snapc 0=[] ondisk+write+known_if_redirected e504)", 2024-04-01T19:48:58.370 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:46:25.949709+0000", 2024-04-01T19:48:58.371 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 152.36333099399999, 2024-04-01T19:48:58.371 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.20591062600000001, 2024-04-01T19:48:58.371 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:58.371 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:58.371 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:58.371 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:58.371 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:48:58.371 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:48:58.371 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 158548 2024-04-01T19:48:58.371 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.371 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:58.371 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.371 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:58.371 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.949709+0000", 2024-04-01T19:48:58.372 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.372 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.372 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.372 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:58.372 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.949709+0000", 2024-04-01T19:48:58.372 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.372 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.372 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.372 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:58.372 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.949711+0000", 2024-04-01T19:48:58.372 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0169999999999999e-06 2024-04-01T19:48:58.372 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.372 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.372 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:58.372 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.949716+0000", 2024-04-01T19:48:58.372 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5099999999999998e-06 2024-04-01T19:48:58.373 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.373 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.373 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:58.373 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.949727+0000", 2024-04-01T19:48:58.373 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0506000000000001e-05 2024-04-01T19:48:58.373 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.373 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.373 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:58.373 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.949734+0000", 2024-04-01T19:48:58.373 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4830000000000002e-06 2024-04-01T19:48:58.373 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.373 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.373 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:58.373 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.949786+0000", 2024-04-01T19:48:58.373 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2144000000000001e-05 2024-04-01T19:48:58.373 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.374 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.374 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:58.375 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.949894+0000", 2024-04-01T19:48:58.375 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000107786 2024-04-01T19:48:58.375 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.375 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.375 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 4", 2024-04-01T19:48:58.375 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.949991+0000", 2024-04-01T19:48:58.375 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.6719999999999996e-05 2024-04-01T19:48:58.375 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.375 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.375 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:58.375 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.150276+0000", 2024-04-01T19:48:58.375 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.200285196 2024-04-01T19:48:58.376 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.376 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.376 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:58.376 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.155531+0000", 2024-04-01T19:48:58.376 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0052550849999999996 2024-04-01T19:48:58.376 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.376 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.376 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:58.377 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.155581+0000", 2024-04-01T19:48:58.377 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0297999999999999e-05 2024-04-01T19:48:58.377 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.377 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.377 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:58.377 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.155619+0000", 2024-04-01T19:48:58.377 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7880999999999999e-05 2024-04-01T19:48:58.377 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.377 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:58.377 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.377 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.378 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.378 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:158549 6.b 6:d6a08801:::benchmark_data_smithi188_134454_object1808:head [delete] snapc 0=[] ondisk+write+known_if_redirected e504)", 2024-04-01T19:48:58.378 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:46:25.949789+0000", 2024-04-01T19:48:58.378 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 152.363250373, 2024-04-01T19:48:58.378 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.200627217, 2024-04-01T19:48:58.378 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:58.378 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:58.378 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:58.378 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:58.378 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:48:58.379 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:48:58.379 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 158549 2024-04-01T19:48:58.379 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.379 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:58.379 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.379 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:58.379 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.949789+0000", 2024-04-01T19:48:58.379 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.379 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.379 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.379 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:58.379 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.949789+0000", 2024-04-01T19:48:58.380 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.380 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.380 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.380 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:58.380 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.949790+0000", 2024-04-01T19:48:58.380 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.4099999999999997e-07 2024-04-01T19:48:58.380 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.380 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.380 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:58.380 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.949797+0000", 2024-04-01T19:48:58.381 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.55e-06 2024-04-01T19:48:58.381 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.381 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.381 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:58.382 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.949805+0000", 2024-04-01T19:48:58.382 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4440000000000008e-06 2024-04-01T19:48:58.382 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.382 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.382 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:58.382 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.949811+0000", 2024-04-01T19:48:58.382 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.772e-06 2024-04-01T19:48:58.382 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.382 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.382 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:58.382 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.952464+0000", 2024-04-01T19:48:58.383 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.002653295 2024-04-01T19:48:58.383 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.383 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.383 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:58.383 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.952590+0000", 2024-04-01T19:48:58.383 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000125346 2024-04-01T19:48:58.383 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.383 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.383 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 7", 2024-04-01T19:48:58.383 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.952698+0000", 2024-04-01T19:48:58.383 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00010798099999999999 2024-04-01T19:48:58.384 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.384 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.384 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:58.384 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.150312+0000", 2024-04-01T19:48:58.384 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.19761447200000001 2024-04-01T19:48:58.384 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.384 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.384 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:58.384 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.150334+0000", 2024-04-01T19:48:58.384 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2189999999999999e-05 2024-04-01T19:48:58.384 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.385 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.385 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:58.385 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.150377+0000", 2024-04-01T19:48:58.385 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.3081999999999998e-05 2024-04-01T19:48:58.385 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.385 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.385 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:58.385 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.150417+0000", 2024-04-01T19:48:58.385 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9144000000000003e-05 2024-04-01T19:48:58.385 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.385 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:58.386 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.386 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.386 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.386 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:158554 6.6 6:68a608a9:::benchmark_data_smithi188_134454_object1813:head [delete] snapc 0=[] ondisk+write+known_if_redirected e504)", 2024-04-01T19:48:58.386 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:46:25.953680+0000", 2024-04-01T19:48:58.386 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 152.35935951499999, 2024-04-01T19:48:58.386 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.20206570300000001, 2024-04-01T19:48:58.386 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:58.386 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:58.386 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:58.386 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:58.386 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:48:58.387 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:48:58.387 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 158554 2024-04-01T19:48:58.387 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.387 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:58.387 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.387 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:58.387 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.953680+0000", 2024-04-01T19:48:58.387 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.387 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.387 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.387 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:58.388 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.953680+0000", 2024-04-01T19:48:58.388 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.388 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.388 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.388 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:58.388 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.953682+0000", 2024-04-01T19:48:58.388 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0729999999999999e-06 2024-04-01T19:48:58.388 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.388 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.388 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:58.388 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.953688+0000", 2024-04-01T19:48:58.389 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4530000000000001e-06 2024-04-01T19:48:58.389 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.389 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.389 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:58.389 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.953698+0000", 2024-04-01T19:48:58.389 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0327e-05 2024-04-01T19:48:58.389 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.389 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.389 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:58.389 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.953706+0000", 2024-04-01T19:48:58.389 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9459999999999998e-06 2024-04-01T19:48:58.389 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.389 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.390 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:58.390 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.954309+0000", 2024-04-01T19:48:58.390 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00060333200000000004 2024-04-01T19:48:58.390 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.390 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.390 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:58.390 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.954423+0000", 2024-04-01T19:48:58.390 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00011357399999999999 2024-04-01T19:48:58.390 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.390 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.390 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 4", 2024-04-01T19:48:58.391 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.954529+0000", 2024-04-01T19:48:58.391 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000106469 2024-04-01T19:48:58.391 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.391 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.391 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:58.391 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.150283+0000", 2024-04-01T19:48:58.391 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.19575332300000001 2024-04-01T19:48:58.391 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.391 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.392 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:58.392 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.155664+0000", 2024-04-01T19:48:58.392 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0053812390000000003 2024-04-01T19:48:58.392 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.392 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.392 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:58.392 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.155710+0000", 2024-04-01T19:48:58.392 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5729999999999998e-05 2024-04-01T19:48:58.392 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.392 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.392 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:58.392 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.155746+0000", 2024-04-01T19:48:58.393 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.6236999999999999e-05 2024-04-01T19:48:58.393 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.393 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:58.393 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.393 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.393 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.393 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop_reply(client.26287.0:158532 6.c e504/469 ondisk, result = 0)", 2024-04-01T19:48:58.393 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:46:25.953759+0000", 2024-04-01T19:48:58.393 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 152.35928084099999, 2024-04-01T19:48:58.393 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.19660245200000001, 2024-04-01T19:48:58.393 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:58.394 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:58.394 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:48:58.394 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:58.394 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.394 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:58.394 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.953759+0000", 2024-04-01T19:48:58.394 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.394 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.394 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.395 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:58.395 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.953759+0000", 2024-04-01T19:48:58.395 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.395 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.395 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.395 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:58.395 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.953760+0000", 2024-04-01T19:48:58.395 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.561e-06 2024-04-01T19:48:58.395 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.395 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.395 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:58.396 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.953765+0000", 2024-04-01T19:48:58.396 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8679999999999998e-06 2024-04-01T19:48:58.396 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.396 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.396 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:58.396 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.953775+0000", 2024-04-01T19:48:58.396 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.4560000000000006e-06 2024-04-01T19:48:58.396 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.396 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.396 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:58.396 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.953782+0000", 2024-04-01T19:48:58.397 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9539999999999998e-06 2024-04-01T19:48:58.397 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.397 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.397 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:58.397 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.956797+0000", 2024-04-01T19:48:58.397 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0030156580000000001 2024-04-01T19:48:58.397 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.397 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.397 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:58.397 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.956804+0000", 2024-04-01T19:48:58.397 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1700000000000002e-06 2024-04-01T19:48:58.398 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.398 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.398 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:58.398 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.150361+0000", 2024-04-01T19:48:58.398 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.19355778500000001 2024-04-01T19:48:58.398 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.398 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:58.398 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.398 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.399 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.399 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop_reply(client.26287.0:158549 6.b e504/469 ondisk, result = 0)", 2024-04-01T19:48:58.399 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:46:25.957178+0000", 2024-04-01T19:48:58.399 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 152.35586207899999, 2024-04-01T19:48:58.399 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.19314774500000001, 2024-04-01T19:48:58.399 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:58.399 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:58.399 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:48:58.399 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:58.399 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.400 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:58.400 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.957178+0000", 2024-04-01T19:48:58.400 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.400 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.400 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.400 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:58.400 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.957178+0000", 2024-04-01T19:48:58.400 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.400 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.400 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.400 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:58.400 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.957179+0000", 2024-04-01T19:48:58.400 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.72e-06 2024-04-01T19:48:58.401 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.401 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.401 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:58.401 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.957186+0000", 2024-04-01T19:48:58.401 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2199999999999997e-06 2024-04-01T19:48:58.401 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.401 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.401 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:58.401 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.150236+0000", 2024-04-01T19:48:58.401 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.19305019800000001 2024-04-01T19:48:58.401 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.401 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.401 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:58.402 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.150246+0000", 2024-04-01T19:48:58.402 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0403e-05 2024-04-01T19:48:58.402 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.402 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.402 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:58.402 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.150296+0000", 2024-04-01T19:48:58.402 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9438999999999999e-05 2024-04-01T19:48:58.402 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.402 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.402 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:58.402 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.150306+0000", 2024-04-01T19:48:58.402 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0026e-05 2024-04-01T19:48:58.403 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.403 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.403 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:58.403 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.150325+0000", 2024-04-01T19:48:58.403 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9738999999999999e-05 2024-04-01T19:48:58.403 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.403 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:58.404 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.404 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.404 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.404 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:158555 6.c 6:36a081f1:::benchmark_data_smithi188_134454_object1814:head [delete] snapc 0=[] ondisk+write+known_if_redirected e504)", 2024-04-01T19:48:58.404 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:46:25.961790+0000", 2024-04-01T19:48:58.404 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 152.351249999, 2024-04-01T19:48:58.404 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.19945426799999999, 2024-04-01T19:48:58.404 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:58.404 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:58.404 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:58.404 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:58.405 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:48:58.405 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:48:58.405 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 158555 2024-04-01T19:48:58.405 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.405 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:58.405 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.405 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:58.405 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.961790+0000", 2024-04-01T19:48:58.405 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.405 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.406 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.406 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:58.406 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.961790+0000", 2024-04-01T19:48:58.406 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.406 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.406 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.406 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:58.406 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.961792+0000", 2024-04-01T19:48:58.406 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.821e-06 2024-04-01T19:48:58.406 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.407 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.407 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:58.407 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:25.961801+0000", 2024-04-01T19:48:58.407 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.1919999999999994e-06 2024-04-01T19:48:58.407 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.407 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.407 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:58.407 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.150232+0000", 2024-04-01T19:48:58.407 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.18843152199999999 2024-04-01T19:48:58.407 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.408 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.408 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:58.408 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.150248+0000", 2024-04-01T19:48:58.408 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5379999999999998e-05 2024-04-01T19:48:58.408 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.408 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.408 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:58.408 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.150649+0000", 2024-04-01T19:48:58.408 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00040140199999999998 2024-04-01T19:48:58.408 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.408 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.409 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:58.409 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.150739+0000", 2024-04-01T19:48:58.409 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.0074000000000005e-05 2024-04-01T19:48:58.409 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.409 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.409 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6", 2024-04-01T19:48:58.409 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.150808+0000", 2024-04-01T19:48:58.409 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9346999999999999e-05 2024-04-01T19:48:58.409 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.410 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.410 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:58.410 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.160777+0000", 2024-04-01T19:48:58.410 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0099683830000000008 2024-04-01T19:48:58.410 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.410 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.410 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:58.410 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.161149+0000", 2024-04-01T19:48:58.410 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00037215600000000001 2024-04-01T19:48:58.410 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.410 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.411 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:58.411 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.161189+0000", 2024-04-01T19:48:58.411 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.0141000000000001e-05 2024-04-01T19:48:58.411 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.411 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.411 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:58.411 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:46:26.161244+0000", 2024-04-01T19:48:58.411 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4849999999999998e-05 2024-04-01T19:48:58.411 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.411 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:58.411 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.411 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.411 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.412 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:226527 6.c 6:3dd63080:::benchmark_data_smithi188_134454_object69786:head [delete] snapc 0=[] ondisk+write+known_if_redirected e523)", 2024-04-01T19:48:58.412 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:47:27.355330+0000", 2024-04-01T19:48:58.412 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 90.957709483000002, 2024-04-01T19:48:58.412 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21468983699999999, 2024-04-01T19:48:58.412 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:58.412 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:58.412 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:58.412 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:58.412 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:48:58.412 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:48:58.412 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 226527 2024-04-01T19:48:58.412 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.413 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:58.413 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.413 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:58.413 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.355330+0000", 2024-04-01T19:48:58.413 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.413 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.413 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.413 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:58.413 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.355330+0000", 2024-04-01T19:48:58.413 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.413 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.414 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.414 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:58.414 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.355332+0000", 2024-04-01T19:48:58.414 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.181e-06 2024-04-01T19:48:58.414 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.414 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.414 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:58.414 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.355339+0000", 2024-04-01T19:48:58.414 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4150000000000004e-06 2024-04-01T19:48:58.414 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.415 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.415 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:58.415 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.355350+0000", 2024-04-01T19:48:58.415 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1653e-05 2024-04-01T19:48:58.415 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.415 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.415 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:58.415 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.355359+0000", 2024-04-01T19:48:58.415 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3499999999999997e-06 2024-04-01T19:48:58.415 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.415 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.416 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:58.416 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.355452+0000", 2024-04-01T19:48:58.416 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.3645000000000002e-05 2024-04-01T19:48:58.416 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.416 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.416 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:58.416 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.355617+0000", 2024-04-01T19:48:58.416 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00016462099999999999 2024-04-01T19:48:58.416 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.416 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.416 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6", 2024-04-01T19:48:58.416 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.355755+0000", 2024-04-01T19:48:58.417 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013756599999999999 2024-04-01T19:48:58.417 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.417 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.417 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:58.417 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.364310+0000", 2024-04-01T19:48:58.417 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0085555189999999993 2024-04-01T19:48:58.417 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.417 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.417 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:58.417 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.569964+0000", 2024-04-01T19:48:58.418 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.205653743 2024-04-01T19:48:58.418 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.418 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.418 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:58.418 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.569995+0000", 2024-04-01T19:48:58.418 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.1109999999999999e-05 2024-04-01T19:48:58.418 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.418 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.418 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:58.418 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.570020+0000", 2024-04-01T19:48:58.418 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5034000000000001e-05 2024-04-01T19:48:58.418 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.419 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:58.419 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.419 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.419 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.419 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:226528 6.c 6:34f5461e:::benchmark_data_smithi188_134454_object69787:head [delete] snapc 0=[] ondisk+write+known_if_redirected e523)", 2024-04-01T19:48:58.419 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:47:27.355385+0000", 2024-04-01T19:48:58.419 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 90.957654797999993, 2024-04-01T19:48:58.419 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21841987099999999, 2024-04-01T19:48:58.419 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:58.420 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:58.420 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:58.420 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:58.420 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:48:58.420 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:48:58.420 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 226528 2024-04-01T19:48:58.420 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.420 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:58.420 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.420 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:58.420 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.355385+0000", 2024-04-01T19:48:58.421 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.421 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.421 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.421 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:58.421 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.355385+0000", 2024-04-01T19:48:58.421 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.421 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.421 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.421 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:58.421 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.355386+0000", 2024-04-01T19:48:58.421 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2900000000000003e-07 2024-04-01T19:48:58.422 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.422 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.422 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:58.422 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.355389+0000", 2024-04-01T19:48:58.422 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.0199999999999999e-06 2024-04-01T19:48:58.422 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.422 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.422 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:58.422 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.355397+0000", 2024-04-01T19:48:58.422 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.405e-06 2024-04-01T19:48:58.423 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.423 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.423 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:58.423 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.355403+0000", 2024-04-01T19:48:58.423 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1550000000000004e-06 2024-04-01T19:48:58.423 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.423 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.423 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:58.423 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.360331+0000", 2024-04-01T19:48:58.423 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0049276160000000001 2024-04-01T19:48:58.423 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.424 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.424 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:58.424 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.360455+0000", 2024-04-01T19:48:58.424 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012392800000000001 2024-04-01T19:48:58.424 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.424 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.424 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6", 2024-04-01T19:48:58.424 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.360593+0000", 2024-04-01T19:48:58.424 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000138424 2024-04-01T19:48:58.424 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.424 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.425 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:58.425 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.371560+0000", 2024-04-01T19:48:58.425 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.01096633 2024-04-01T19:48:58.425 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.425 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.425 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:58.425 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.573691+0000", 2024-04-01T19:48:58.425 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.20213133899999999 2024-04-01T19:48:58.425 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.425 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.425 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:58.425 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.573754+0000", 2024-04-01T19:48:58.426 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3590999999999995e-05 2024-04-01T19:48:58.426 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.426 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.426 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:58.426 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.573805+0000", 2024-04-01T19:48:58.426 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0334000000000003e-05 2024-04-01T19:48:58.426 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.426 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:58.426 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.426 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.426 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.427 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:226534 6.c 6:39a2e65a:::benchmark_data_smithi188_134454_object69793:head [delete] snapc 0=[] ondisk+write+known_if_redirected e523)", 2024-04-01T19:48:58.427 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:47:27.364351+0000", 2024-04-01T19:48:58.427 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 90.948688239999996, 2024-04-01T19:48:58.427 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21741871800000001, 2024-04-01T19:48:58.427 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:58.427 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:58.427 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:58.427 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:58.427 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:48:58.427 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:48:58.427 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 226534 2024-04-01T19:48:58.428 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.428 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:58.428 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.428 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:58.428 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.364351+0000", 2024-04-01T19:48:58.428 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.428 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.428 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.428 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:58.428 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.364351+0000", 2024-04-01T19:48:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.364354+0000", 2024-04-01T19:48:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.424e-06 2024-04-01T19:48:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.364361+0000", 2024-04-01T19:48:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9489999999999999e-06 2024-04-01T19:48:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.430 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:58.430 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.364375+0000", 2024-04-01T19:48:58.430 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.396e-05 2024-04-01T19:48:58.430 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.430 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.430 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:58.430 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.364383+0000", 2024-04-01T19:48:58.430 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.4829999999999999e-06 2024-04-01T19:48:58.430 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.430 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.364443+0000", 2024-04-01T19:48:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9735999999999999e-05 2024-04-01T19:48:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.364578+0000", 2024-04-01T19:48:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000134652 2024-04-01T19:48:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6", 2024-04-01T19:48:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.364691+0000", 2024-04-01T19:48:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00011301799999999999 2024-04-01T19:48:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.371568+0000", 2024-04-01T19:48:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0068776519999999997 2024-04-01T19:48:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.581666+0000", 2024-04-01T19:48:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.21009772199999999 2024-04-01T19:48:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.433 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:58.433 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.581722+0000", 2024-04-01T19:48:58.433 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6282000000000001e-05 2024-04-01T19:48:58.433 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.433 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.433 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:58.433 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.581770+0000", 2024-04-01T19:48:58.433 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7840000000000003e-05 2024-04-01T19:48:58.433 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.433 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:58.433 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.433 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.434 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.434 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.26287.0:226611 6.c 6:37560f79:::benchmark_data_smithi188_134454_object69870:head [delete] snapc 0=[] ondisk+write+known_if_redirected e523)", 2024-04-01T19:48:58.434 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:47:27.435436+0000", 2024-04-01T19:48:58.434 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 90.877603989999997, 2024-04-01T19:48:58.434 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.14668182900000001, 2024-04-01T19:48:58.434 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:48:58.434 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:48:58.434 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:48:58.434 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T19:48:58.434 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.26287", 2024-04-01T19:48:58.434 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:48:58.434 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 226611 2024-04-01T19:48:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:48:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:48:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.435436+0000", 2024-04-01T19:48:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:48:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.435436+0000", 2024-04-01T19:48:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:48:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.436 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.436 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:48:58.436 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.435438+0000", 2024-04-01T19:48:58.436 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8640000000000001e-06 2024-04-01T19:48:58.436 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.436 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.436 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:48:58.436 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.435444+0000", 2024-04-01T19:48:58.436 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5989999999999998e-06 2024-04-01T19:48:58.436 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.436 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.437 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:48:58.437 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.435457+0000", 2024-04-01T19:48:58.437 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2455e-05 2024-04-01T19:48:58.437 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.437 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.437 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:48:58.437 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.435465+0000", 2024-04-01T19:48:58.437 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3559999999999993e-06 2024-04-01T19:48:58.437 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.437 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.437 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:48:58.437 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.435537+0000", 2024-04-01T19:48:58.437 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.1549000000000002e-05 2024-04-01T19:48:58.438 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.438 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.438 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:48:58.438 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.435667+0000", 2024-04-01T19:48:58.438 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000130708 2024-04-01T19:48:58.438 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.438 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.438 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 6", 2024-04-01T19:48:58.438 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.435794+0000", 2024-04-01T19:48:58.438 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012684 2024-04-01T19:48:58.438 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.439 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.439 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T19:48:58.439 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.439407+0000", 2024-04-01T19:48:58.439 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0036131179999999998 2024-04-01T19:48:58.439 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.439 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.439 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:48:58.439 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.582019+0000", 2024-04-01T19:48:58.439 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.14261148200000001 2024-04-01T19:48:58.439 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.439 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.439 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:48:58.439 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.582074+0000", 2024-04-01T19:48:58.440 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4808000000000001e-05 2024-04-01T19:48:58.440 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:48:58.440 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:48:58.440 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:48:58.440 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:47:27.582118+0000", 2024-04-01T19:48:58.440 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.405e-05 2024-04-01T19:48:58.440 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.440 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:58.440 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.440 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:48:58.440 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:48:58.440 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:48:58.441 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:48:58.467 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:58.489 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:48:58.493 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:58.493 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:48:58.592 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:48:58.594 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:48:58.621 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:58.641 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:48:58.644 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:58.644 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:48:58.745 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:48:58.788 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:58.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:58 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2512132797' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:48:58.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:58 smithi022 ceph-mon[39439]: from='client.26578 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:48:58.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:58 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2512132797' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:48:58.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:58 smithi188 ceph-mon[43939]: from='client.26578 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:48:59.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:58 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2512132797' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:48:59.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:58 smithi062 ceph-mon[44211]: from='client.26578 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:48:59.050 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:48:59.056 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:59.056 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:48:59.157 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:48:59.212 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:59.245 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:48:59.252 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:59.252 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:48:59.353 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:48:59.380 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:59.402 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:48:59.406 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:59.406 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:48:59.508 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:48:59.573 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:59.613 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:48:59.620 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:59.621 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:48:59.722 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:48:59.771 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:48:59.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:59 smithi022 ceph-mon[39439]: 6.2 scrub starts 2024-04-01T19:48:59.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:59 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:48:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:59 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:48:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:59 smithi022 ceph-mon[39439]: from='client.26578 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:48:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:59 smithi022 ceph-mon[39439]: osdmap e549: 12 total, 11 up, 11 in 2024-04-01T19:48:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:59 smithi022 ceph-mon[39439]: 6.2 scrub ok 2024-04-01T19:48:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:59 smithi022 ceph-mon[39439]: pgmap v1513: 17 pgs: 17 active+clean; 1.0 GiB data, 6.5 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:48:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:59 smithi022 ceph-mon[39439]: 6.a scrub starts 2024-04-01T19:48:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:48:59 smithi022 ceph-mon[39439]: 6.a scrub ok 2024-04-01T19:48:59.864 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:48:59.872 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:48:59.872 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:48:59.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:59 smithi188 ceph-mon[43939]: 6.2 scrub starts 2024-04-01T19:48:59.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:59 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:48:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:59 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:48:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:59 smithi188 ceph-mon[43939]: from='client.26578 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:48:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:59 smithi188 ceph-mon[43939]: osdmap e549: 12 total, 11 up, 11 in 2024-04-01T19:48:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:59 smithi188 ceph-mon[43939]: 6.2 scrub ok 2024-04-01T19:48:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:59 smithi188 ceph-mon[43939]: pgmap v1513: 17 pgs: 17 active+clean; 1.0 GiB data, 6.5 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:48:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:59 smithi188 ceph-mon[43939]: 6.a scrub starts 2024-04-01T19:48:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:48:59 smithi188 ceph-mon[43939]: 6.a scrub ok 2024-04-01T19:48:59.897 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_ops_in_flight 2024-04-01T19:48:59.938 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:59 smithi062 ceph-mon[44211]: 6.2 scrub starts 2024-04-01T19:48:59.939 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:59 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:48:59.939 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:59 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:48:59.939 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:59 smithi062 ceph-mon[44211]: from='client.26578 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:48:59.939 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:59 smithi062 ceph-mon[44211]: osdmap e549: 12 total, 11 up, 11 in 2024-04-01T19:48:59.939 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:59 smithi062 ceph-mon[44211]: 6.2 scrub ok 2024-04-01T19:48:59.939 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:59 smithi062 ceph-mon[44211]: pgmap v1513: 17 pgs: 17 active+clean; 1.0 GiB data, 6.5 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:48:59.939 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:59 smithi062 ceph-mon[44211]: 6.a scrub starts 2024-04-01T19:48:59.939 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:48:59 smithi062 ceph-mon[44211]: 6.a scrub ok 2024-04-01T19:48:59.973 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:49:00.000 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:00.022 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:49:00.024 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:00.025 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:49:00.126 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:49:00.154 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:00.173 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:49:00.178 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:00.178 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:49:00.279 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:49:00.317 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:00.366 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:49:00.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:00 smithi022 ceph-mon[39439]: 6.9 scrub starts 2024-04-01T19:49:00.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:00 smithi022 ceph-mon[39439]: 6.9 scrub ok 2024-04-01T19:49:00.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:00 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:49:00.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:00 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:49:00.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:00 smithi188 ceph-mon[43939]: 6.9 scrub starts 2024-04-01T19:49:00.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:00 smithi188 ceph-mon[43939]: 6.9 scrub ok 2024-04-01T19:49:00.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:00 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:49:00.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:00 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:49:00.881 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:49:00.885 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:49:00.888 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:00.889 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:49:00.990 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:49:01.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:00 smithi062 ceph-mon[44211]: 6.9 scrub starts 2024-04-01T19:49:01.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:00 smithi062 ceph-mon[44211]: 6.9 scrub ok 2024-04-01T19:49:01.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:00 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:49:01.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:00 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:49:01.050 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:01.389 INFO:teuthology.orchestra.run.smithi022.stderr:Creating an OSD daemon form without an OSD FSID value 2024-04-01T19:49:01.813 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:49:01.819 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:01.820 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:49:01.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:01 smithi022 ceph-mon[39439]: osdmap e550: 12 total, 11 up, 11 in 2024-04-01T19:49:01.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:01 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:49:01.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:01 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:49:01.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:01 smithi022 ceph-mon[39439]: pgmap v1515: 17 pgs: 17 active+clean; 902 MiB data, 6.2 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.26k op/s 2024-04-01T19:49:01.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:01 smithi188 ceph-mon[43939]: osdmap e550: 12 total, 11 up, 11 in 2024-04-01T19:49:01.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:01 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:49:01.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:01 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:49:01.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:01 smithi188 ceph-mon[43939]: pgmap v1515: 17 pgs: 17 active+clean; 902 MiB data, 6.2 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.26k op/s 2024-04-01T19:49:01.903 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:01 smithi062 ceph-mon[44211]: osdmap e550: 12 total, 11 up, 11 in 2024-04-01T19:49:01.903 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:01 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:49:01.903 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:01 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:49:01.904 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:01 smithi062 ceph-mon[44211]: pgmap v1515: 17 pgs: 17 active+clean; 902 MiB data, 6.2 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.26k op/s 2024-04-01T19:49:01.921 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:49:01.988 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:02.581 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:49:02.593 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:02.593 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:49:02.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:02 smithi022 ceph-mon[39439]: osdmap e551: 12 total, 11 up, 11 in 2024-04-01T19:49:02.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:02 smithi022 ceph-mon[39439]: 6.7 scrub starts 2024-04-01T19:49:02.694 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:49:02.721 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:02.742 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:49:02.746 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:02.747 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:49:02.848 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:49:02.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:02 smithi188 ceph-mon[43939]: osdmap e551: 12 total, 11 up, 11 in 2024-04-01T19:49:02.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:02 smithi188 ceph-mon[43939]: 6.7 scrub starts 2024-04-01T19:49:02.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:02 smithi188 ceph-mon[43939]: 6.7 scrub ok 2024-04-01T19:49:02.877 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:02 smithi022 ceph-mon[39439]: 6.7 scrub ok 2024-04-01T19:49:02.880 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:02 smithi062 ceph-mon[44211]: osdmap e551: 12 total, 11 up, 11 in 2024-04-01T19:49:02.880 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:02 smithi062 ceph-mon[44211]: 6.7 scrub starts 2024-04-01T19:49:02.880 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:02 smithi062 ceph-mon[44211]: 6.7 scrub ok 2024-04-01T19:49:02.886 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:02.923 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:49:03.157 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:49:03.165 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:03.165 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:49:03.266 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:49:03.322 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:03.488 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:49:03.501 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:03.501 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:49:03.523 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:49:03.558 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:49:03.594 INFO:teuthology.orchestra.run.smithi022.stdout:get_pg_num_history pg_num_history pg_num_history(e534 pg_nums {1={14=1},6={469=16}} deleted_pools ) 2024-04-01T19:49:03.594 INFO:teuthology.orchestra.run.smithi022.stdout:Importing pgid 6.e 2024-04-01T19:49:03.601 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7002d6f1:::benchmark_data_smithi188_134454_object123033:head# 2024-04-01T19:49:03.601 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.601 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7004526a:::benchmark_data_smithi188_134454_object130652:head# 2024-04-01T19:49:03.601 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.602 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:700852c4:::benchmark_data_smithi188_134454_object143684:head# 2024-04-01T19:49:03.602 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.602 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:49:03.603 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7011d1d0:::benchmark_data_smithi188_134454_object147241:head# 2024-04-01T19:49:03.603 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.603 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70151375:::benchmark_data_smithi188_134454_object129677:head# 2024-04-01T19:49:03.603 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.612 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70163c1b:::benchmark_data_smithi188_134454_object119937:head# 2024-04-01T19:49:03.612 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.613 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70170f1c:::benchmark_data_smithi188_134454_object145544:head# 2024-04-01T19:49:03.613 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.613 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70187cfa:::benchmark_data_smithi188_134454_object117230:head# 2024-04-01T19:49:03.613 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.613 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70199567:::benchmark_data_smithi188_134454_object126540:head# 2024-04-01T19:49:03.613 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.613 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:701ca92e:::benchmark_data_smithi188_134454_object120733:head# 2024-04-01T19:49:03.613 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.613 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70236c3d:::benchmark_data_smithi188_134454_object135895:head# 2024-04-01T19:49:03.613 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.613 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7023775d:::benchmark_data_smithi188_134454_object131082:head# 2024-04-01T19:49:03.613 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.613 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:702422be:::benchmark_data_smithi188_134454_object142132:head# 2024-04-01T19:49:03.613 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.614 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:702888c6:::benchmark_data_smithi188_134454_object135292:head# 2024-04-01T19:49:03.614 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.614 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7029b246:::benchmark_data_smithi188_134454_object125501:head# 2024-04-01T19:49:03.614 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.614 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7029b5aa:::benchmark_data_smithi188_134454_object124477:head# 2024-04-01T19:49:03.614 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.614 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:702e9b07:::benchmark_data_smithi188_134454_object140037:head# 2024-04-01T19:49:03.614 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.614 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70310ccd:::benchmark_data_smithi188_134454_object131551:head# 2024-04-01T19:49:03.614 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.614 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7032a416:::benchmark_data_smithi188_134454_object140583:head# 2024-04-01T19:49:03.614 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.614 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70362fa5:::benchmark_data_smithi188_134454_object130188:head# 2024-04-01T19:49:03.615 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.615 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7037d59b:::benchmark_data_smithi188_134454_object149639:head# 2024-04-01T19:49:03.615 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.615 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7037e03d:::benchmark_data_smithi188_134454_object123647:head# 2024-04-01T19:49:03.615 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.615 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:703a0a1c:::benchmark_data_smithi188_134454_object154406:head# 2024-04-01T19:49:03.615 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.615 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:703b442f:::benchmark_data_smithi188_134454_object134155:head# 2024-04-01T19:49:03.615 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.615 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:703f7761:::benchmark_data_smithi188_134454_object151238:head# 2024-04-01T19:49:03.615 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.615 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70422c22:::benchmark_data_smithi188_134454_object123079:head# 2024-04-01T19:49:03.615 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.615 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70422d2a:::benchmark_data_smithi188_134454_object154340:head# 2024-04-01T19:49:03.616 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.616 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7042ef4e:::benchmark_data_smithi188_134454_object137220:head# 2024-04-01T19:49:03.616 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.616 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7042f310:::benchmark_data_smithi188_134454_object145900:head# 2024-04-01T19:49:03.616 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.616 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:704429c0:::benchmark_data_smithi188_134454_object139363:head# 2024-04-01T19:49:03.616 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.616 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70465aaa:::benchmark_data_smithi188_134454_object148216:head# 2024-04-01T19:49:03.616 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.616 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:49:03.617 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7046a9e6:::benchmark_data_smithi188_134454_object136992:head# 2024-04-01T19:49:03.617 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.622 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7046e8b2:::benchmark_data_smithi188_134454_object118401:head# 2024-04-01T19:49:03.622 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.623 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7048b128:::benchmark_data_smithi188_134454_object135413:head# 2024-04-01T19:49:03.623 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.623 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7049d664:::benchmark_data_smithi188_134454_object141732:head# 2024-04-01T19:49:03.623 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.623 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:704a25dd:::benchmark_data_smithi188_134454_object144907:head# 2024-04-01T19:49:03.623 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.623 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:704cf55f:::benchmark_data_smithi188_134454_object118020:head# 2024-04-01T19:49:03.623 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.623 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:704d26e1:::benchmark_data_smithi188_134454_object138128:head# 2024-04-01T19:49:03.623 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.623 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:704f18bc:::benchmark_data_smithi188_134454_object135842:head# 2024-04-01T19:49:03.623 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.623 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:704fbce9:::benchmark_data_smithi188_134454_object137966:head# 2024-04-01T19:49:03.624 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.624 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:705012e3:::benchmark_data_smithi188_134454_object134228:head# 2024-04-01T19:49:03.624 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.624 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70517349:::benchmark_data_smithi188_134454_object116083:head# 2024-04-01T19:49:03.624 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.624 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70518ffa:::benchmark_data_smithi188_134454_object138988:head# 2024-04-01T19:49:03.624 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.624 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7051a332:::benchmark_data_smithi188_134454_object127737:head# 2024-04-01T19:49:03.624 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.624 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7052b41a:::benchmark_data_smithi188_134454_object125780:head# 2024-04-01T19:49:03.624 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.624 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70534dd5:::benchmark_data_smithi188_134454_object150810:head# 2024-04-01T19:49:03.624 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.624 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70542e05:::benchmark_data_smithi188_134454_object133725:head# 2024-04-01T19:49:03.624 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.625 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7055b322:::benchmark_data_smithi188_134454_object148338:head# 2024-04-01T19:49:03.625 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.625 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70569086:::benchmark_data_smithi188_134454_object152443:head# 2024-04-01T19:49:03.625 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.625 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7057b0d4:::benchmark_data_smithi188_134454_object155987:head# 2024-04-01T19:49:03.625 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.625 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70587ffd:::benchmark_data_smithi188_134454_object121348:head# 2024-04-01T19:49:03.625 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.625 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:705b40cb:::benchmark_data_smithi188_134454_object119166:head# 2024-04-01T19:49:03.625 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.625 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:705d662f:::benchmark_data_smithi188_134454_object134108:head# 2024-04-01T19:49:03.625 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.625 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:705e9b0e:::benchmark_data_smithi188_134454_object141063:head# 2024-04-01T19:49:03.625 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.625 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7060816c:::benchmark_data_smithi188_134454_object117468:head# 2024-04-01T19:49:03.626 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.626 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70617b0f:::benchmark_data_smithi188_134454_object122780:head# 2024-04-01T19:49:03.626 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.626 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7062c9ac:::benchmark_data_smithi188_134454_object131064:head# 2024-04-01T19:49:03.626 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.626 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:49:03.630 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:03.632 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70643860:::benchmark_data_smithi188_134454_object147566:head# 2024-04-01T19:49:03.632 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.634 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7064f065:::benchmark_data_smithi188_134454_object144979:head# 2024-04-01T19:49:03.634 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.634 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:706600ec:::benchmark_data_smithi188_134454_object134923:head# 2024-04-01T19:49:03.634 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.634 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70661ba5:::benchmark_data_smithi188_134454_object152165:head# 2024-04-01T19:49:03.634 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.634 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7067e889:::benchmark_data_smithi188_134454_object122336:head# 2024-04-01T19:49:03.634 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.634 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:706829d0:::benchmark_data_smithi188_134454_object118735:head# 2024-04-01T19:49:03.634 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.634 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:706a5a6f:::benchmark_data_smithi188_134454_object146262:head# 2024-04-01T19:49:03.635 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.635 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:706aec8c:::benchmark_data_smithi188_134454_object151971:head# 2024-04-01T19:49:03.635 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.636 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:706cd6aa:::benchmark_data_smithi188_134454_object154995:head# 2024-04-01T19:49:03.636 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.636 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:706e1edd:::benchmark_data_smithi188_134454_object128177:head# 2024-04-01T19:49:03.636 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.636 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:706e9d9d:::benchmark_data_smithi188_134454_object122489:head# 2024-04-01T19:49:03.636 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.636 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70702cdd:::benchmark_data_smithi188_134454_object143289:head# 2024-04-01T19:49:03.636 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.636 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70706e1d:::benchmark_data_smithi188_134454_object125847:head# 2024-04-01T19:49:03.636 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.637 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7071e55f:::benchmark_data_smithi188_134454_object151649:head# 2024-04-01T19:49:03.637 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.637 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7072e542:::benchmark_data_smithi188_134454_object131541:head# 2024-04-01T19:49:03.637 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.637 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70736272:::benchmark_data_smithi188_134454_object123752:head# 2024-04-01T19:49:03.637 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.638 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:707412af:::benchmark_data_smithi188_134454_object132548:head# 2024-04-01T19:49:03.638 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.638 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7074d826:::benchmark_data_smithi188_134454_object151954:head# 2024-04-01T19:49:03.638 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.638 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70753daa:::benchmark_data_smithi188_134454_object124971:head# 2024-04-01T19:49:03.638 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.639 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7076cf93:::benchmark_data_smithi188_134454_object154633:head# 2024-04-01T19:49:03.639 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.639 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7076d8fc:::benchmark_data_smithi188_134454_object143896:head# 2024-04-01T19:49:03.639 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.639 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7077da1a:::benchmark_data_smithi188_134454_object121112:head# 2024-04-01T19:49:03.639 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.639 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:707b836d:::benchmark_data_smithi188_134454_object152788:head# 2024-04-01T19:49:03.639 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.642 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:707bf7e2:::benchmark_data_smithi188_134454_object130036:head# 2024-04-01T19:49:03.642 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.642 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:707c1f12:::benchmark_data_smithi188_134454_object140507:head# 2024-04-01T19:49:03.642 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.642 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:707ee695:::benchmark_data_smithi188_134454_object126922:head# 2024-04-01T19:49:03.642 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.642 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:707f448f:::benchmark_data_smithi188_134454_object136154:head# 2024-04-01T19:49:03.642 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.642 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70806cd6:::benchmark_data_smithi188_134454_object140773:head# 2024-04-01T19:49:03.642 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.642 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70811a81:::benchmark_data_smithi188_134454_object128782:head# 2024-04-01T19:49:03.642 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.643 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7081abd3:::benchmark_data_smithi188_134454_object123497:head# 2024-04-01T19:49:03.643 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.643 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7082c750:::benchmark_data_smithi188_134454_object131573:head# 2024-04-01T19:49:03.643 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.643 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70839c06:::benchmark_data_smithi188_134454_object116194:head# 2024-04-01T19:49:03.643 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.643 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70842556:::benchmark_data_smithi188_134454_object144532:head# 2024-04-01T19:49:03.643 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.643 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7085ecd2:::benchmark_data_smithi188_134454_object122947:head# 2024-04-01T19:49:03.643 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.643 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70872d09:::benchmark_data_smithi188_134454_object116021:head# 2024-04-01T19:49:03.643 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.650 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7087463c:::benchmark_data_smithi188_134454_object133827:head# 2024-04-01T19:49:03.650 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.650 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:708b2d3f:::benchmark_data_smithi188_134454_object129081:head# 2024-04-01T19:49:03.650 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.650 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:708bf064:::benchmark_data_smithi188_134454_object130582:head# 2024-04-01T19:49:03.650 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.650 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70902c96:::benchmark_data_smithi188_134454_object132455:head# 2024-04-01T19:49:03.650 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.651 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70955a22:::benchmark_data_smithi188_134454_object130051:head# 2024-04-01T19:49:03.651 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.651 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7097b301:::benchmark_data_smithi188_134454_object123735:head# 2024-04-01T19:49:03.651 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.651 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7097eca0:::benchmark_data_smithi188_134454_object128413:head# 2024-04-01T19:49:03.651 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.651 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70982fa5:::benchmark_data_smithi188_134454_object139784:head# 2024-04-01T19:49:03.651 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.651 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:709cb1f0:::benchmark_data_smithi188_134454_object141000:head# 2024-04-01T19:49:03.651 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.651 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:709db753:::benchmark_data_smithi188_134454_object118354:head# 2024-04-01T19:49:03.651 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.651 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:709dbdb9:::benchmark_data_smithi188_134454_object140000:head# 2024-04-01T19:49:03.651 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.652 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:709f4820:::benchmark_data_smithi188_134454_object145919:head# 2024-04-01T19:49:03.652 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.652 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70a19eb5:::benchmark_data_smithi188_134454_object135484:head# 2024-04-01T19:49:03.652 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.652 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70a1ca29:::benchmark_data_smithi188_134454_object132312:head# 2024-04-01T19:49:03.652 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.652 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70a34433:::benchmark_data_smithi188_134454_object122678:head# 2024-04-01T19:49:03.652 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.652 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70a51e34:::benchmark_data_smithi188_134454_object153611:head# 2024-04-01T19:49:03.652 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.652 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70a60149:::benchmark_data_smithi188_134454_object151310:head# 2024-04-01T19:49:03.652 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.652 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70a68941:::benchmark_data_smithi188_134454_object123181:head# 2024-04-01T19:49:03.652 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.653 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70a69054:::benchmark_data_smithi188_134454_object116716:head# 2024-04-01T19:49:03.653 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.653 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70a8c7c3:::benchmark_data_smithi188_134454_object129704:head# 2024-04-01T19:49:03.653 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.653 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70abf163:::benchmark_data_smithi188_134454_object127196:head# 2024-04-01T19:49:03.653 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.653 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70ad86e8:::benchmark_data_smithi188_134454_object134728:head# 2024-04-01T19:49:03.653 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.653 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70b06a62:::benchmark_data_smithi188_134454_object115744:head# 2024-04-01T19:49:03.653 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.653 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70b2781d:::benchmark_data_smithi188_134454_object142820:head# 2024-04-01T19:49:03.653 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.653 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70b5a9a5:::benchmark_data_smithi188_134454_object137726:head# 2024-04-01T19:49:03.653 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.654 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70b64ba1:::benchmark_data_smithi188_134454_object115617:head# 2024-04-01T19:49:03.654 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.654 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70b650e6:::benchmark_data_smithi188_134454_object136837:head# 2024-04-01T19:49:03.654 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.654 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70b793b5:::benchmark_data_smithi188_134454_object129895:head# 2024-04-01T19:49:03.654 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.654 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:49:03.657 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:03.658 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70b88682:::benchmark_data_smithi188_134454_object133775:head# 2024-04-01T19:49:03.658 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.658 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70b962a2:::benchmark_data_smithi188_134454_object148282:head# 2024-04-01T19:49:03.658 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.658 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70ba0a98:::benchmark_data_smithi188_134454_object130880:head# 2024-04-01T19:49:03.658 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.658 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70bb2aaa:::benchmark_data_smithi188_134454_object149134:head# 2024-04-01T19:49:03.659 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.659 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70bb5e3a:::benchmark_data_smithi188_134454_object135418:head# 2024-04-01T19:49:03.659 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.659 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70bc821f:::benchmark_data_smithi188_134454_object152836:head# 2024-04-01T19:49:03.659 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.659 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70bd06c7:::benchmark_data_smithi188_134454_object134180:head# 2024-04-01T19:49:03.659 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.659 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70bd40c9:::benchmark_data_smithi188_134454_object151963:head# 2024-04-01T19:49:03.659 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.659 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70c10439:::benchmark_data_smithi188_134454_object130600:head# 2024-04-01T19:49:03.659 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.659 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70c1aa3c:::benchmark_data_smithi188_134454_object116847:head# 2024-04-01T19:49:03.659 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.659 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70c37c79:::benchmark_data_smithi188_134454_object139910:head# 2024-04-01T19:49:03.659 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.660 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70c38d51:::benchmark_data_smithi188_134454_object115584:head# 2024-04-01T19:49:03.660 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.660 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70c491d6:::benchmark_data_smithi188_134454_object143003:head# 2024-04-01T19:49:03.660 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.660 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70c5f4e1:::benchmark_data_smithi188_134454_object126976:head# 2024-04-01T19:49:03.660 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.660 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70c60be5:::benchmark_data_smithi188_134454_object129875:head# 2024-04-01T19:49:03.660 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.660 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70c657bf:::benchmark_data_smithi188_134454_object133208:head# 2024-04-01T19:49:03.660 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.660 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70c6830f:::benchmark_data_smithi188_134454_object124386:head# 2024-04-01T19:49:03.660 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.660 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70c6cff8:::benchmark_data_smithi188_134454_object130101:head# 2024-04-01T19:49:03.660 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.660 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70c7071b:::benchmark_data_smithi188_134454_object155495:head# 2024-04-01T19:49:03.661 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.661 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70c719d3:::benchmark_data_smithi188_134454_object123416:head# 2024-04-01T19:49:03.661 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.661 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70c87717:::benchmark_data_smithi188_134454_object148444:head# 2024-04-01T19:49:03.661 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.661 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70c9919c:::benchmark_data_smithi188_134454_object136934:head# 2024-04-01T19:49:03.661 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.661 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70cb687a:::benchmark_data_smithi188_134454_object147464:head# 2024-04-01T19:49:03.661 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.661 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70ccb349:::benchmark_data_smithi188_134454_object139842:head# 2024-04-01T19:49:03.661 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.661 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70ccf52c:::benchmark_data_smithi188_134454_object148001:head# 2024-04-01T19:49:03.661 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.661 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70cffc9f:::benchmark_data_smithi188_134454_object149662:head# 2024-04-01T19:49:03.661 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.662 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70d0c012:::benchmark_data_smithi188_134454_object135150:head# 2024-04-01T19:49:03.662 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.662 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70d1159d:::benchmark_data_smithi188_134454_object153049:head# 2024-04-01T19:49:03.662 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.662 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:49:03.662 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:49:03.664 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70d23b03:::benchmark_data_smithi188_134454_object129166:head# 2024-04-01T19:49:03.664 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.664 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70d3c00a:::benchmark_data_smithi188_134454_object145134:head# 2024-04-01T19:49:03.664 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.665 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70d67455:::benchmark_data_smithi188_134454_object156570:head# 2024-04-01T19:49:03.665 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.665 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70d6747a:::benchmark_data_smithi188_134454_object146398:head# 2024-04-01T19:49:03.665 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.665 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70d67c76:::benchmark_data_smithi188_134454_object150675:head# 2024-04-01T19:49:03.665 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.665 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70d71dde:::benchmark_data_smithi188_134454_object155232:head# 2024-04-01T19:49:03.665 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.665 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70d89d72:::benchmark_data_smithi188_134454_object141610:head# 2024-04-01T19:49:03.665 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.665 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70dc3f09:::benchmark_data_smithi188_134454_object136478:head# 2024-04-01T19:49:03.665 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.666 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70decdf2:::benchmark_data_smithi188_134454_object141885:head# 2024-04-01T19:49:03.666 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.666 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70dfc6ce:::benchmark_data_smithi188_134454_object150398:head# 2024-04-01T19:49:03.666 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.666 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70e005ad:::benchmark_data_smithi188_134454_object126935:head# 2024-04-01T19:49:03.666 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.666 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70e16418:::benchmark_data_smithi188_134454_object126573:head# 2024-04-01T19:49:03.666 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.666 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70e256c7:::benchmark_data_smithi188_134454_object128217:head# 2024-04-01T19:49:03.666 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.666 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70e25a44:::benchmark_data_smithi188_134454_object130001:head# 2024-04-01T19:49:03.666 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.666 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70e49f08:::benchmark_data_smithi188_134454_object126758:head# 2024-04-01T19:49:03.667 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.667 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70e67c62:::benchmark_data_smithi188_134454_object129714:head# 2024-04-01T19:49:03.667 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.667 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70e6dea3:::benchmark_data_smithi188_134454_object129330:head# 2024-04-01T19:49:03.667 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.667 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70e7238e:::benchmark_data_smithi188_134454_object143085:head# 2024-04-01T19:49:03.667 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.667 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70e8df0a:::benchmark_data_smithi188_134454_object149206:head# 2024-04-01T19:49:03.667 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.667 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70e8fbbb:::benchmark_data_smithi188_134454_object156680:head# 2024-04-01T19:49:03.667 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.667 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70e989bd:::benchmark_data_smithi188_134454_object119843:head# 2024-04-01T19:49:03.667 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.667 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70eb2cc9:::benchmark_data_smithi188_134454_object123557:head# 2024-04-01T19:49:03.668 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.669 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70ecb044:::benchmark_data_smithi188_134454_object146086:head# 2024-04-01T19:49:03.670 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.670 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70edc17b:::benchmark_data_smithi188_134454_object132538:head# 2024-04-01T19:49:03.670 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.670 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70ef6ad9:::benchmark_data_smithi188_134454_object121951:head# 2024-04-01T19:49:03.670 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.670 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70f0c6d5:::benchmark_data_smithi188_134454_object154609:head# 2024-04-01T19:49:03.670 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.670 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70f2ba79:::benchmark_data_smithi188_134454_object133550:head# 2024-04-01T19:49:03.670 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.670 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70f3264e:::benchmark_data_smithi188_134454_object120970:head# 2024-04-01T19:49:03.670 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.670 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70f426b4:::benchmark_data_smithi188_134454_object136354:head# 2024-04-01T19:49:03.670 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.671 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70f59df2:::benchmark_data_smithi188_134454_object155382:head# 2024-04-01T19:49:03.671 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.671 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70f6fbd4:::benchmark_data_smithi188_134454_object148631:head# 2024-04-01T19:49:03.671 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.671 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70f910fd:::benchmark_data_smithi188_134454_object127347:head# 2024-04-01T19:49:03.671 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.671 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70f942b3:::benchmark_data_smithi188_134454_object149953:head# 2024-04-01T19:49:03.671 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.671 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70fa0449:::benchmark_data_smithi188_134454_object142596:head# 2024-04-01T19:49:03.671 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.671 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70fb573d:::benchmark_data_smithi188_134454_object137148:head# 2024-04-01T19:49:03.671 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.671 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70fc3d9f:::benchmark_data_smithi188_134454_object154727:head# 2024-04-01T19:49:03.671 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.672 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70fd5e3c:::benchmark_data_smithi188_134454_object156326:head# 2024-04-01T19:49:03.672 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.672 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:70ff6bda:::benchmark_data_smithi188_134454_object124396:head# 2024-04-01T19:49:03.672 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.672 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7101fd39:::benchmark_data_smithi188_134454_object138198:head# 2024-04-01T19:49:03.672 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.673 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7103b144:::benchmark_data_smithi188_134454_object125214:head# 2024-04-01T19:49:03.673 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.673 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7104c07b:::benchmark_data_smithi188_134454_object142196:head# 2024-04-01T19:49:03.674 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.674 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7104f755:::benchmark_data_smithi188_134454_object128067:head# 2024-04-01T19:49:03.674 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.674 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71054339:::benchmark_data_smithi188_134454_object134452:head# 2024-04-01T19:49:03.674 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.674 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7105afea:::benchmark_data_smithi188_134454_object131343:head# 2024-04-01T19:49:03.674 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.674 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7106eacc:::benchmark_data_smithi188_134454_object135185:head# 2024-04-01T19:49:03.674 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.674 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:710a9ba6:::benchmark_data_smithi188_134454_object141228:head# 2024-04-01T19:49:03.674 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.674 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:710b6667:::benchmark_data_smithi188_134454_object129873:head# 2024-04-01T19:49:03.674 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.675 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:710e01ac:::benchmark_data_smithi188_134454_object129779:head# 2024-04-01T19:49:03.675 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.675 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7110774e:::benchmark_data_smithi188_134454_object125270:head# 2024-04-01T19:49:03.675 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.675 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71115699:::benchmark_data_smithi188_134454_object144255:head# 2024-04-01T19:49:03.675 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.675 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7111ba11:::benchmark_data_smithi188_134454_object122288:head# 2024-04-01T19:49:03.675 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.675 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7113bc32:::benchmark_data_smithi188_134454_object138996:head# 2024-04-01T19:49:03.675 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.675 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71159d7a:::benchmark_data_smithi188_134454_object148754:head# 2024-04-01T19:49:03.675 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.675 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71164a85:::benchmark_data_smithi188_134454_object125344:head# 2024-04-01T19:49:03.675 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.675 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7116ba33:::benchmark_data_smithi188_134454_object122928:head# 2024-04-01T19:49:03.675 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.676 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:711a51e9:::benchmark_data_smithi188_134454_object119023:head# 2024-04-01T19:49:03.676 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.677 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:711a8613:::benchmark_data_smithi188_134454_object126988:head# 2024-04-01T19:49:03.677 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.677 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:711b534d:::benchmark_data_smithi188_134454_object154672:head# 2024-04-01T19:49:03.677 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.677 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:711c59ec:::benchmark_data_smithi188_134454_object137766:head# 2024-04-01T19:49:03.677 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.677 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:711d7961:::benchmark_data_smithi188_134454_object153680:head# 2024-04-01T19:49:03.677 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.677 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:711e589b:::benchmark_data_smithi188_134454_object145977:head# 2024-04-01T19:49:03.677 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.677 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:712007fd:::benchmark_data_smithi188_134454_object123818:head# 2024-04-01T19:49:03.677 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.678 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71207904:::benchmark_data_smithi188_134454_object138916:head# 2024-04-01T19:49:03.678 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.678 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7120acaf:::benchmark_data_smithi188_134454_object131889:head# 2024-04-01T19:49:03.678 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.678 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7121b4ce:::benchmark_data_smithi188_134454_object149155:head# 2024-04-01T19:49:03.678 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.678 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:712399a3:::benchmark_data_smithi188_134454_object121528:head# 2024-04-01T19:49:03.678 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.681 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:712410e4:::benchmark_data_smithi188_134454_object136242:head# 2024-04-01T19:49:03.681 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.681 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7126355d:::benchmark_data_smithi188_134454_object115539:head# 2024-04-01T19:49:03.681 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.681 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7126668c:::benchmark_data_smithi188_134454_object138459:head# 2024-04-01T19:49:03.682 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.682 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71292aff:::benchmark_data_smithi188_134454_object147507:head# 2024-04-01T19:49:03.682 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.682 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71299e1c:::benchmark_data_smithi188_134454_object127871:head# 2024-04-01T19:49:03.682 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.682 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7129bf58:::benchmark_data_smithi188_134454_object145946:head# 2024-04-01T19:49:03.682 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.682 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7129cc1d:::benchmark_data_smithi188_134454_object123413:head# 2024-04-01T19:49:03.682 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.682 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:712a0a30:::benchmark_data_smithi188_134454_object128720:head# 2024-04-01T19:49:03.682 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.682 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:712ac069:::benchmark_data_smithi188_134454_object126654:head# 2024-04-01T19:49:03.682 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.682 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:712baa92:::benchmark_data_smithi188_134454_object139135:head# 2024-04-01T19:49:03.683 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.683 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:712c0a2b:::benchmark_data_smithi188_134454_object141685:head# 2024-04-01T19:49:03.683 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.683 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:712d31bb:::benchmark_data_smithi188_134454_object120769:head# 2024-04-01T19:49:03.683 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.683 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:712d950b:::benchmark_data_smithi188_134454_object138248:head# 2024-04-01T19:49:03.683 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.683 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:712dcc50:::benchmark_data_smithi188_134454_object130480:head# 2024-04-01T19:49:03.683 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.683 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71304f45:::benchmark_data_smithi188_134454_object129301:head# 2024-04-01T19:49:03.683 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.684 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7134853a:::benchmark_data_smithi188_134454_object155860:head# 2024-04-01T19:49:03.684 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.684 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71351758:::benchmark_data_smithi188_134454_object133010:head# 2024-04-01T19:49:03.684 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.684 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7138e769:::benchmark_data_smithi188_134454_object155236:head# 2024-04-01T19:49:03.684 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.684 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:713beef8:::benchmark_data_smithi188_134454_object135331:head# 2024-04-01T19:49:03.685 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.685 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:713df7f5:::benchmark_data_smithi188_134454_object153341:head# 2024-04-01T19:49:03.685 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.685 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:713e5b21:::benchmark_data_smithi188_134454_object129885:head# 2024-04-01T19:49:03.685 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.685 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:713eca36:::benchmark_data_smithi188_134454_object131922:head# 2024-04-01T19:49:03.685 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.685 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7146ca0c:::benchmark_data_smithi188_134454_object148229:head# 2024-04-01T19:49:03.685 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.685 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7148d9ee:::benchmark_data_smithi188_134454_object156127:head# 2024-04-01T19:49:03.685 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.686 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:714a40fc:::benchmark_data_smithi188_134454_object156250:head# 2024-04-01T19:49:03.686 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.686 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:714afb56:::benchmark_data_smithi188_134454_object152612:head# 2024-04-01T19:49:03.686 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.686 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:714b289d:::benchmark_data_smithi188_134454_object143128:head# 2024-04-01T19:49:03.686 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.686 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:714b797f:::benchmark_data_smithi188_134454_object142869:head# 2024-04-01T19:49:03.686 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.686 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:714ff66f:::benchmark_data_smithi188_134454_object134996:head# 2024-04-01T19:49:03.686 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.687 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71543feb:::benchmark_data_smithi188_134454_object127475:head# 2024-04-01T19:49:03.687 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.690 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:715644b1:::benchmark_data_smithi188_134454_object127868:head# 2024-04-01T19:49:03.690 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.690 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7157cd68:::benchmark_data_smithi188_134454_object154088:head# 2024-04-01T19:49:03.690 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.691 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:715b46ab:::benchmark_data_smithi188_134454_object124105:head# 2024-04-01T19:49:03.691 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.693 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:49:03.694 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:715d9f97:::benchmark_data_smithi188_134454_object146862:head# 2024-04-01T19:49:03.694 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.694 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:715dc946:::benchmark_data_smithi188_134454_object131397:head# 2024-04-01T19:49:03.694 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.694 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:715e65bb:::benchmark_data_smithi188_134454_object129963:head# 2024-04-01T19:49:03.694 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.694 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:715ecb1c:::benchmark_data_smithi188_134454_object137718:head# 2024-04-01T19:49:03.694 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.694 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71611909:::benchmark_data_smithi188_134454_object153948:head# 2024-04-01T19:49:03.694 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.694 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71634c5a:::benchmark_data_smithi188_134454_object125396:head# 2024-04-01T19:49:03.695 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.695 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71657cca:::benchmark_data_smithi188_134454_object115588:head# 2024-04-01T19:49:03.695 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.695 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7169af16:::benchmark_data_smithi188_134454_object151359:head# 2024-04-01T19:49:03.695 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.695 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:716ad216:::benchmark_data_smithi188_134454_object122842:head# 2024-04-01T19:49:03.695 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.695 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:716fe6f4:::benchmark_data_smithi188_134454_object143260:head# 2024-04-01T19:49:03.695 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.697 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7171585b:::benchmark_data_smithi188_134454_object143770:head# 2024-04-01T19:49:03.697 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.697 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71730b31:::benchmark_data_smithi188_134454_object136408:head# 2024-04-01T19:49:03.697 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.697 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:717363ce:::benchmark_data_smithi188_134454_object146992:head# 2024-04-01T19:49:03.697 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.697 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7174d00f:::benchmark_data_smithi188_134454_object130383:head# 2024-04-01T19:49:03.697 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.697 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71787f88:::benchmark_data_smithi188_134454_object127619:head# 2024-04-01T19:49:03.697 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.697 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7179094b:::benchmark_data_smithi188_134454_object138189:head# 2024-04-01T19:49:03.697 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.698 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:717af566:::benchmark_data_smithi188_134454_object143167:head# 2024-04-01T19:49:03.698 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.698 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:717c9a79:::benchmark_data_smithi188_134454_object135679:head# 2024-04-01T19:49:03.698 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.698 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:717cd6e1:::benchmark_data_smithi188_134454_object154429:head# 2024-04-01T19:49:03.698 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.698 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:717d63bd:::benchmark_data_smithi188_134454_object148441:head# 2024-04-01T19:49:03.698 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.698 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:717f3706:::benchmark_data_smithi188_134454_object127097:head# 2024-04-01T19:49:03.698 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.700 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:717fa6cf:::benchmark_data_smithi188_134454_object139815:head# 2024-04-01T19:49:03.700 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.700 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:718137c7:::benchmark_data_smithi188_134454_object125391:head# 2024-04-01T19:49:03.700 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.700 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7182dfe1:::benchmark_data_smithi188_134454_object120010:head# 2024-04-01T19:49:03.700 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.700 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7183cff2:::benchmark_data_smithi188_134454_object120992:head# 2024-04-01T19:49:03.700 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.701 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7187a4eb:::benchmark_data_smithi188_134454_object146196:head# 2024-04-01T19:49:03.701 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.701 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7189c447:::benchmark_data_smithi188_134454_object154746:head# 2024-04-01T19:49:03.701 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.701 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:718d70d1:::benchmark_data_smithi188_134454_object128673:head# 2024-04-01T19:49:03.701 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.701 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7190762f:::benchmark_data_smithi188_134454_object117003:head# 2024-04-01T19:49:03.701 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.701 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71914a16:::benchmark_data_smithi188_134454_object129200:head# 2024-04-01T19:49:03.701 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.701 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7191b120:::benchmark_data_smithi188_134454_object155474:head# 2024-04-01T19:49:03.701 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.701 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71933cf6:::benchmark_data_smithi188_134454_object156720:head# 2024-04-01T19:49:03.701 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.702 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7197bffb:::benchmark_data_smithi188_134454_object116743:head# 2024-04-01T19:49:03.702 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.703 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71991a3a:::benchmark_data_smithi188_134454_object146820:head# 2024-04-01T19:49:03.703 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.703 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:719b097b:::benchmark_data_smithi188_134454_object127108:head# 2024-04-01T19:49:03.703 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.703 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71a1e0ba:::benchmark_data_smithi188_134454_object128268:head# 2024-04-01T19:49:03.703 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.703 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71a3d1ef:::benchmark_data_smithi188_134454_object154905:head# 2024-04-01T19:49:03.703 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.704 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71a5a8b8:::benchmark_data_smithi188_134454_object124534:head# 2024-04-01T19:49:03.704 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.704 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71a693e0:::benchmark_data_smithi188_134454_object131480:head# 2024-04-01T19:49:03.704 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.704 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71a79faa:::benchmark_data_smithi188_134454_object135517:head# 2024-04-01T19:49:03.704 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.707 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71a865ac:::benchmark_data_smithi188_134454_object116841:head# 2024-04-01T19:49:03.707 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.707 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71a96477:::benchmark_data_smithi188_134454_object127584:head# 2024-04-01T19:49:03.707 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.707 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71a9b802:::benchmark_data_smithi188_134454_object132067:head# 2024-04-01T19:49:03.707 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.707 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71ade3f6:::benchmark_data_smithi188_134454_object141538:head# 2024-04-01T19:49:03.707 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.707 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71b1a6a9:::benchmark_data_smithi188_134454_object142077:head# 2024-04-01T19:49:03.707 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.708 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71b2d7fd:::benchmark_data_smithi188_134454_object131684:head# 2024-04-01T19:49:03.708 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.708 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71b546b6:::benchmark_data_smithi188_134454_object142355:head# 2024-04-01T19:49:03.708 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.709 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71bb5ffe:::benchmark_data_smithi188_134454_object121942:head# 2024-04-01T19:49:03.709 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.709 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71bbe8c8:::benchmark_data_smithi188_134454_object127056:head# 2024-04-01T19:49:03.709 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.709 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71bdbf51:::benchmark_data_smithi188_134454_object119183:head# 2024-04-01T19:49:03.709 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.709 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71bf5f93:::benchmark_data_smithi188_134454_object134813:head# 2024-04-01T19:49:03.709 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.709 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71bfcd86:::benchmark_data_smithi188_134454_object152750:head# 2024-04-01T19:49:03.709 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.710 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71c16e8e:::benchmark_data_smithi188_134454_object145231:head# 2024-04-01T19:49:03.710 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.710 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71c184c3:::benchmark_data_smithi188_134454_object142912:head# 2024-04-01T19:49:03.710 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.711 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71c1fcfb:::benchmark_data_smithi188_134454_object144166:head# 2024-04-01T19:49:03.711 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.711 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71c2d46b:::benchmark_data_smithi188_134454_object134616:head# 2024-04-01T19:49:03.711 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.711 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71c54ae2:::benchmark_data_smithi188_134454_object145963:head# 2024-04-01T19:49:03.711 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.711 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71c79f4c:::benchmark_data_smithi188_134454_object141267:head# 2024-04-01T19:49:03.711 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.711 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71c80133:::benchmark_data_smithi188_134454_object124470:head# 2024-04-01T19:49:03.711 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.711 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71c88b7d:::benchmark_data_smithi188_134454_object142238:head# 2024-04-01T19:49:03.712 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.712 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71cc6e55:::benchmark_data_smithi188_134454_object115382:head# 2024-04-01T19:49:03.712 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.712 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71cdae5a:::benchmark_data_smithi188_134454_object142998:head# 2024-04-01T19:49:03.713 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.716 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71d1c06a:::benchmark_data_smithi188_134454_object148315:head# 2024-04-01T19:49:03.716 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.717 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71d5067e:::benchmark_data_smithi188_134454_object116175:head# 2024-04-01T19:49:03.717 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.717 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71d5d4d4:::benchmark_data_smithi188_134454_object126878:head# 2024-04-01T19:49:03.717 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.717 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71d6136a:::benchmark_data_smithi188_134454_object122185:head# 2024-04-01T19:49:03.717 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.718 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71d61b08:::benchmark_data_smithi188_134454_object115861:head# 2024-04-01T19:49:03.718 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.718 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71d70e67:::benchmark_data_smithi188_134454_object127589:head# 2024-04-01T19:49:03.718 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.718 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71da25ce:::benchmark_data_smithi188_134454_object155339:head# 2024-04-01T19:49:03.718 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.718 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71dac46d:::benchmark_data_smithi188_134454_object128576:head# 2024-04-01T19:49:03.718 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.719 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71dad1d6:::benchmark_data_smithi188_134454_object126653:head# 2024-04-01T19:49:03.719 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.719 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71dc4eeb:::benchmark_data_smithi188_134454_object155746:head# 2024-04-01T19:49:03.720 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.720 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71ddf769:::benchmark_data_smithi188_134454_object148932:head# 2024-04-01T19:49:03.720 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.720 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71de8cee:::benchmark_data_smithi188_134454_object122464:head# 2024-04-01T19:49:03.720 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.724 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71e09cdb:::benchmark_data_smithi188_134454_object127685:head# 2024-04-01T19:49:03.724 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.724 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71e269b0:::benchmark_data_smithi188_134454_object150227:head# 2024-04-01T19:49:03.724 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.725 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71e64cae:::benchmark_data_smithi188_134454_object131045:head# 2024-04-01T19:49:03.725 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.725 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71e8fdec:::benchmark_data_smithi188_134454_object139138:head# 2024-04-01T19:49:03.725 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.725 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71e9289b:::benchmark_data_smithi188_134454_object149527:head# 2024-04-01T19:49:03.726 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.726 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71e9c326:::benchmark_data_smithi188_134454_object124813:head# 2024-04-01T19:49:03.726 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.726 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71eeb3a9:::benchmark_data_smithi188_134454_object115911:head# 2024-04-01T19:49:03.727 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.727 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71efa094:::benchmark_data_smithi188_134454_object150177:head# 2024-04-01T19:49:03.727 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.727 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71f00b03:::benchmark_data_smithi188_134454_object137015:head# 2024-04-01T19:49:03.727 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.727 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71f3f3d3:::benchmark_data_smithi188_134454_object146351:head# 2024-04-01T19:49:03.727 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.728 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71f42d3e:::benchmark_data_smithi188_134454_object145931:head# 2024-04-01T19:49:03.728 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.728 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71f5b1e2:::benchmark_data_smithi188_134454_object136137:head# 2024-04-01T19:49:03.728 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.729 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71f71ce1:::benchmark_data_smithi188_134454_object139853:head# 2024-04-01T19:49:03.729 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.729 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71f8091f:::benchmark_data_smithi188_134454_object121570:head# 2024-04-01T19:49:03.729 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.729 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71f8684a:::benchmark_data_smithi188_134454_object125182:head# 2024-04-01T19:49:03.729 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.729 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71f8ab94:::benchmark_data_smithi188_134454_object146741:head# 2024-04-01T19:49:03.729 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.731 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71f9844d:::benchmark_data_smithi188_134454_object116849:head# 2024-04-01T19:49:03.731 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.731 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71fc2f58:::benchmark_data_smithi188_134454_object153371:head# 2024-04-01T19:49:03.731 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.731 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:71fe06b1:::benchmark_data_smithi188_134454_object156393:head# 2024-04-01T19:49:03.731 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.731 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72024912:::benchmark_data_smithi188_134454_object123196:head# 2024-04-01T19:49:03.732 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.732 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7202968e:::benchmark_data_smithi188_134454_object150895:head# 2024-04-01T19:49:03.732 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.732 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7202a439:::benchmark_data_smithi188_134454_object151070:head# 2024-04-01T19:49:03.732 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.732 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7204a34f:::benchmark_data_smithi188_134454_object146645:head# 2024-04-01T19:49:03.732 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.732 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72066bcc:::benchmark_data_smithi188_134454_object145154:head# 2024-04-01T19:49:03.732 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.732 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:720906fa:::benchmark_data_smithi188_134454_object150665:head# 2024-04-01T19:49:03.732 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.732 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:720b423a:::benchmark_data_smithi188_134454_object115834:head# 2024-04-01T19:49:03.732 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.733 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:720e139b:::benchmark_data_smithi188_134454_object155815:head# 2024-04-01T19:49:03.734 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.734 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:720e51b0:::benchmark_data_smithi188_134454_object151346:head# 2024-04-01T19:49:03.734 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.734 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72107065:::benchmark_data_smithi188_134454_object133496:head# 2024-04-01T19:49:03.734 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.734 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7211dafd:::benchmark_data_smithi188_134454_object153099:head# 2024-04-01T19:49:03.734 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.734 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:721251fa:::benchmark_data_smithi188_134454_object125813:head# 2024-04-01T19:49:03.734 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.734 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:49:03.736 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72162f85:::benchmark_data_smithi188_134454_object125337:head# 2024-04-01T19:49:03.736 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.736 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7216aaa0:::benchmark_data_smithi188_134454_object136305:head# 2024-04-01T19:49:03.736 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.736 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7217023c:::benchmark_data_smithi188_134454_object136724:head# 2024-04-01T19:49:03.736 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.736 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:721715b8:::benchmark_data_smithi188_134454_object145527:head# 2024-04-01T19:49:03.736 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.736 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7218ff7b:::benchmark_data_smithi188_134454_object150517:head# 2024-04-01T19:49:03.737 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.737 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72197971:::benchmark_data_smithi188_134454_object122390:head# 2024-04-01T19:49:03.737 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.737 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:721b82e6:::benchmark_data_smithi188_134454_object153411:head# 2024-04-01T19:49:03.737 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.737 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:721c163f:::benchmark_data_smithi188_134454_object128927:head# 2024-04-01T19:49:03.737 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.737 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:721e64d5:::benchmark_data_smithi188_134454_object124359:head# 2024-04-01T19:49:03.737 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.737 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72217da2:::benchmark_data_smithi188_134454_object121897:head# 2024-04-01T19:49:03.737 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.738 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7222a285:::benchmark_data_smithi188_134454_object117074:head# 2024-04-01T19:49:03.738 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.738 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7222a5e6:::benchmark_data_smithi188_134454_object137715:head# 2024-04-01T19:49:03.738 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.744 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72245c21:::benchmark_data_smithi188_134454_object146007:head# 2024-04-01T19:49:03.744 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.744 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7227d692:::benchmark_data_smithi188_134454_object149619:head# 2024-04-01T19:49:03.744 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.744 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7229d0e9:::benchmark_data_smithi188_134454_object156236:head# 2024-04-01T19:49:03.744 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.744 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:722dfbe7:::benchmark_data_smithi188_134454_object144444:head# 2024-04-01T19:49:03.744 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.744 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:722ef12d:::benchmark_data_smithi188_134454_object129052:head# 2024-04-01T19:49:03.744 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.744 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:722f2ba6:::benchmark_data_smithi188_134454_object148696:head# 2024-04-01T19:49:03.744 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.745 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:722f8b3e:::benchmark_data_smithi188_134454_object145663:head# 2024-04-01T19:49:03.745 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.745 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7231fa5d:::benchmark_data_smithi188_134454_object120816:head# 2024-04-01T19:49:03.745 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.745 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72325ba2:::benchmark_data_smithi188_134454_object126276:head# 2024-04-01T19:49:03.745 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.745 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72332114:::benchmark_data_smithi188_134454_object129852:head# 2024-04-01T19:49:03.745 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.745 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72343e3a:::benchmark_data_smithi188_134454_object141979:head# 2024-04-01T19:49:03.745 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.745 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7235e291:::benchmark_data_smithi188_134454_object131372:head# 2024-04-01T19:49:03.745 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.745 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7237ae89:::benchmark_data_smithi188_134454_object140838:head# 2024-04-01T19:49:03.745 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.746 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7238da7b:::benchmark_data_smithi188_134454_object151528:head# 2024-04-01T19:49:03.747 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.747 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72399fd6:::benchmark_data_smithi188_134454_object119776:head# 2024-04-01T19:49:03.747 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.747 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7239a154:::benchmark_data_smithi188_134454_object145503:head# 2024-04-01T19:49:03.747 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.747 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7239e462:::benchmark_data_smithi188_134454_object152866:head# 2024-04-01T19:49:03.747 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.747 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:723b50ce:::benchmark_data_smithi188_134454_object115587:head# 2024-04-01T19:49:03.747 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.747 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:723b99bd:::benchmark_data_smithi188_134454_object133317:head# 2024-04-01T19:49:03.747 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.748 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:723c0aa0:::benchmark_data_smithi188_134454_object135305:head# 2024-04-01T19:49:03.748 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.748 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:723eaee9:::benchmark_data_smithi188_134454_object122444:head# 2024-04-01T19:49:03.748 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.748 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7241c502:::benchmark_data_smithi188_134454_object145750:head# 2024-04-01T19:49:03.748 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.748 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7242ce7d:::benchmark_data_smithi188_134454_object150179:head# 2024-04-01T19:49:03.748 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.750 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7245908a:::benchmark_data_smithi188_134454_object117315:head# 2024-04-01T19:49:03.750 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.750 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7249d174:::benchmark_data_smithi188_134454_object125901:head# 2024-04-01T19:49:03.750 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.751 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:724a737a:::benchmark_data_smithi188_134454_object151428:head# 2024-04-01T19:49:03.751 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.755 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:724ab67a:::benchmark_data_smithi188_134454_object154710:head# 2024-04-01T19:49:03.755 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.755 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:724b0a4a:::benchmark_data_smithi188_134454_object146249:head# 2024-04-01T19:49:03.755 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.756 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:724c1dff:::benchmark_data_smithi188_134454_object135776:head# 2024-04-01T19:49:03.756 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.756 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:724ed102:::benchmark_data_smithi188_134454_object117653:head# 2024-04-01T19:49:03.756 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.756 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:724f2d6b:::benchmark_data_smithi188_134454_object126972:head# 2024-04-01T19:49:03.757 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.759 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:724f68cd:::benchmark_data_smithi188_134454_object132732:head# 2024-04-01T19:49:03.759 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.759 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:724fb762:::benchmark_data_smithi188_134454_object136291:head# 2024-04-01T19:49:03.759 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.759 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72503fec:::benchmark_data_smithi188_134454_object126340:head# 2024-04-01T19:49:03.759 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.759 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:725135a6:::benchmark_data_smithi188_134454_object148563:head# 2024-04-01T19:49:03.759 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.760 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72528968:::benchmark_data_smithi188_134454_object148407:head# 2024-04-01T19:49:03.760 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.760 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7253ca32:::benchmark_data_smithi188_134454_object117148:head# 2024-04-01T19:49:03.760 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.760 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72594c51:::benchmark_data_smithi188_134454_object143215:head# 2024-04-01T19:49:03.760 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.760 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:725c62fa:::benchmark_data_smithi188_134454_object142129:head# 2024-04-01T19:49:03.760 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.760 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:725d1a28:::benchmark_data_smithi188_134454_object144925:head# 2024-04-01T19:49:03.760 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.760 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:725f53b1:::benchmark_data_smithi188_134454_object137672:head# 2024-04-01T19:49:03.760 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.760 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:725f5a1f:::benchmark_data_smithi188_134454_object115487:head# 2024-04-01T19:49:03.760 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.763 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72608818:::benchmark_data_smithi188_134454_object147189:head# 2024-04-01T19:49:03.763 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.763 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72608a5a:::benchmark_data_smithi188_134454_object155074:head# 2024-04-01T19:49:03.763 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.763 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:726186e5:::benchmark_data_smithi188_134454_object150613:head# 2024-04-01T19:49:03.763 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.763 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72629331:::benchmark_data_smithi188_134454_object136856:head# 2024-04-01T19:49:03.763 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.764 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7262e9ef:::benchmark_data_smithi188_134454_object125460:head# 2024-04-01T19:49:03.764 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.764 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7262ff32:::benchmark_data_smithi188_134454_object128762:head# 2024-04-01T19:49:03.764 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.764 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72636022:::benchmark_data_smithi188_134454_object152958:head# 2024-04-01T19:49:03.764 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.764 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7264f412:::benchmark_data_smithi188_134454_object116312:head# 2024-04-01T19:49:03.764 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.764 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:726862da:::benchmark_data_smithi188_134454_object140601:head# 2024-04-01T19:49:03.764 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.764 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:726d2f67:::benchmark_data_smithi188_134454_object118448:head# 2024-04-01T19:49:03.764 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.764 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:726e188b:::benchmark_data_smithi188_134454_object125387:head# 2024-04-01T19:49:03.764 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.765 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:726f04fb:::benchmark_data_smithi188_134454_object151660:head# 2024-04-01T19:49:03.765 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.765 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:727470d0:::benchmark_data_smithi188_134454_object133127:head# 2024-04-01T19:49:03.765 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.765 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:727485d1:::benchmark_data_smithi188_134454_object119762:head# 2024-04-01T19:49:03.765 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.765 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7275b3f5:::benchmark_data_smithi188_134454_object141624:head# 2024-04-01T19:49:03.765 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.765 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:49:03.767 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7278f921:::benchmark_data_smithi188_134454_object138972:head# 2024-04-01T19:49:03.768 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.768 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:727ae325:::benchmark_data_smithi188_134454_object124336:head# 2024-04-01T19:49:03.768 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.768 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:727b16b4:::benchmark_data_smithi188_134454_object120189:head# 2024-04-01T19:49:03.768 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.768 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:727dc58d:::benchmark_data_smithi188_134454_object134868:head# 2024-04-01T19:49:03.768 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.768 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:727e687e:::benchmark_data_smithi188_134454_object155069:head# 2024-04-01T19:49:03.768 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.768 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72806981:::benchmark_data_smithi188_134454_object139001:head# 2024-04-01T19:49:03.768 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.768 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7284d261:::benchmark_data_smithi188_134454_object142221:head# 2024-04-01T19:49:03.768 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.768 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7285e428:::benchmark_data_smithi188_134454_object128096:head# 2024-04-01T19:49:03.769 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.769 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7286594a:::benchmark_data_smithi188_134454_object132738:head# 2024-04-01T19:49:03.769 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.769 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7287ebc7:::benchmark_data_smithi188_134454_object120272:head# 2024-04-01T19:49:03.769 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.769 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72888b02:::benchmark_data_smithi188_134454_object141846:head# 2024-04-01T19:49:03.769 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.769 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:728b3f7e:::benchmark_data_smithi188_134454_object140968:head# 2024-04-01T19:49:03.769 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.769 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:728c5d97:::benchmark_data_smithi188_134454_object151506:head# 2024-04-01T19:49:03.769 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.769 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:728d195d:::benchmark_data_smithi188_134454_object132609:head# 2024-04-01T19:49:03.769 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.769 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:728d78a8:::benchmark_data_smithi188_134454_object127660:head# 2024-04-01T19:49:03.770 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.770 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:728e8f7c:::benchmark_data_smithi188_134454_object153114:head# 2024-04-01T19:49:03.770 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.770 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:728f402f:::benchmark_data_smithi188_134454_object139971:head# 2024-04-01T19:49:03.770 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.770 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:728fabe5:::benchmark_data_smithi188_134454_object122239:head# 2024-04-01T19:49:03.770 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.771 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:03 smithi062 ceph-mon[44211]: pgmap v1517: 17 pgs: 17 active+clean; 839 MiB data, 6.0 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 958 op/s 2024-04-01T19:49:03.771 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:03 smithi062 ceph-mon[44211]: 6.b scrub starts 2024-04-01T19:49:03.771 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:03 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/440528876' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:49:03.773 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:728fae35:::benchmark_data_smithi188_134454_object136808:head# 2024-04-01T19:49:03.773 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.773 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72910035:::benchmark_data_smithi188_134454_object123122:head# 2024-04-01T19:49:03.773 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.773 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7293a02b:::benchmark_data_smithi188_134454_object151241:head# 2024-04-01T19:49:03.773 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.773 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7295ce7c:::benchmark_data_smithi188_134454_object116585:head# 2024-04-01T19:49:03.773 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.773 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7297a1e0:::benchmark_data_smithi188_134454_object139375:head# 2024-04-01T19:49:03.773 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.773 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:729ba3fb:::benchmark_data_smithi188_134454_object128255:head# 2024-04-01T19:49:03.774 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.774 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:729bad83:::benchmark_data_smithi188_134454_object151891:head# 2024-04-01T19:49:03.774 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.774 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:729c1c0e:::benchmark_data_smithi188_134454_object141284:head# 2024-04-01T19:49:03.774 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.774 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:729c89e7:::benchmark_data_smithi188_134454_object152689:head# 2024-04-01T19:49:03.774 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.774 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:729cb7e8:::benchmark_data_smithi188_134454_object139311:head# 2024-04-01T19:49:03.774 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.774 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:729d1add:::benchmark_data_smithi188_134454_object127967:head# 2024-04-01T19:49:03.774 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.774 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:729dc587:::benchmark_data_smithi188_134454_object144175:head# 2024-04-01T19:49:03.774 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.774 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:729ea3aa:::benchmark_data_smithi188_134454_object147558:head# 2024-04-01T19:49:03.775 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.775 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:729fcf29:::benchmark_data_smithi188_134454_object140416:head# 2024-04-01T19:49:03.775 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.775 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72a25600:::benchmark_data_smithi188_134454_object149106:head# 2024-04-01T19:49:03.775 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.775 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72a2f11b:::benchmark_data_smithi188_134454_object140055:head# 2024-04-01T19:49:03.775 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.775 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72a3f979:::benchmark_data_smithi188_134454_object120342:head# 2024-04-01T19:49:03.775 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.776 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72a483c7:::benchmark_data_smithi188_134454_object134911:head# 2024-04-01T19:49:03.776 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.776 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72a831bd:::benchmark_data_smithi188_134454_object128588:head# 2024-04-01T19:49:03.776 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.776 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72aa0766:::benchmark_data_smithi188_134454_object135441:head# 2024-04-01T19:49:03.776 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.776 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72aaf4e8:::benchmark_data_smithi188_134454_object134263:head# 2024-04-01T19:49:03.776 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.776 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72ab1f06:::benchmark_data_smithi188_134454_object134644:head# 2024-04-01T19:49:03.776 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.776 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72ab6aca:::benchmark_data_smithi188_134454_object128154:head# 2024-04-01T19:49:03.776 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.777 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:49:03.777 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72ac0aa8:::benchmark_data_smithi188_134454_object154879:head# 2024-04-01T19:49:03.777 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.779 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72ada9e7:::benchmark_data_smithi188_134454_object142418:head# 2024-04-01T19:49:03.779 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.779 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72ae576d:::benchmark_data_smithi188_134454_object126133:head# 2024-04-01T19:49:03.779 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.780 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72b0b327:::benchmark_data_smithi188_134454_object139680:head# 2024-04-01T19:49:03.780 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.780 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72b1138c:::benchmark_data_smithi188_134454_object146384:head# 2024-04-01T19:49:03.780 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.780 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72b1994a:::benchmark_data_smithi188_134454_object152632:head# 2024-04-01T19:49:03.780 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.781 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72b53db0:::benchmark_data_smithi188_134454_object128681:head# 2024-04-01T19:49:03.781 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.781 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72b5c15f:::benchmark_data_smithi188_134454_object146582:head# 2024-04-01T19:49:03.781 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.781 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72b6a85e:::benchmark_data_smithi188_134454_object139434:head# 2024-04-01T19:49:03.781 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.782 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72b7673f:::benchmark_data_smithi188_134454_object124966:head# 2024-04-01T19:49:03.782 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.783 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72b956e4:::benchmark_data_smithi188_134454_object133217:head# 2024-04-01T19:49:03.783 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.783 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72ba27ca:::benchmark_data_smithi188_134454_object141152:head# 2024-04-01T19:49:03.783 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.783 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72bb6c95:::benchmark_data_smithi188_134454_object139002:head# 2024-04-01T19:49:03.783 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.783 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72bc0866:::benchmark_data_smithi188_134454_object151277:head# 2024-04-01T19:49:03.784 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.784 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72bd7e54:::benchmark_data_smithi188_134454_object121430:head# 2024-04-01T19:49:03.784 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.784 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72bd962d:::benchmark_data_smithi188_134454_object122193:head# 2024-04-01T19:49:03.784 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.784 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72c830fa:::benchmark_data_smithi188_134454_object135268:head# 2024-04-01T19:49:03.784 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.785 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72c8674d:::benchmark_data_smithi188_134454_object152156:head# 2024-04-01T19:49:03.785 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.785 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72c8cb16:::benchmark_data_smithi188_134454_object127642:head# 2024-04-01T19:49:03.785 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.785 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72c9dd53:::benchmark_data_smithi188_134454_object155056:head# 2024-04-01T19:49:03.785 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.785 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72cc09a9:::benchmark_data_smithi188_134454_object125298:head# 2024-04-01T19:49:03.785 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.785 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72cc5c9b:::benchmark_data_smithi188_134454_object116293:head# 2024-04-01T19:49:03.785 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.785 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72ccbd02:::benchmark_data_smithi188_134454_object122147:head# 2024-04-01T19:49:03.786 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.787 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72cd4684:::benchmark_data_smithi188_134454_object152298:head# 2024-04-01T19:49:03.787 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.787 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72d07997:::benchmark_data_smithi188_134454_object131047:head# 2024-04-01T19:49:03.787 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.787 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72d0f6e8:::benchmark_data_smithi188_134454_object126036:head# 2024-04-01T19:49:03.787 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.787 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72d17a33:::benchmark_data_smithi188_134454_object143609:head# 2024-04-01T19:49:03.787 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.787 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72d194b5:::benchmark_data_smithi188_134454_object122344:head# 2024-04-01T19:49:03.787 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.787 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72d1fca2:::benchmark_data_smithi188_134454_object138091:head# 2024-04-01T19:49:03.788 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.788 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72d65da5:::benchmark_data_smithi188_134454_object131952:head# 2024-04-01T19:49:03.788 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.789 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72db37aa:::benchmark_data_smithi188_134454_object124274:head# 2024-04-01T19:49:03.789 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.789 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72df6e3c:::benchmark_data_smithi188_134454_object147428:head# 2024-04-01T19:49:03.789 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.789 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72dfaafd:::benchmark_data_smithi188_134454_object115733:head# 2024-04-01T19:49:03.789 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.789 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72e00e03:::benchmark_data_smithi188_134454_object115400:head# 2024-04-01T19:49:03.789 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.789 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72e0e27a:::benchmark_data_smithi188_134454_object145398:head# 2024-04-01T19:49:03.789 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.789 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72e369b2:::benchmark_data_smithi188_134454_object119639:head# 2024-04-01T19:49:03.789 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.790 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72e5d417:::benchmark_data_smithi188_134454_object140881:head# 2024-04-01T19:49:03.790 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.790 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72e6acce:::benchmark_data_smithi188_134454_object154880:head# 2024-04-01T19:49:03.790 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.800 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72e74983:::benchmark_data_smithi188_134454_object119067:head# 2024-04-01T19:49:03.800 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.805 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:49:03.811 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72e7921c:::benchmark_data_smithi188_134454_object133082:head# 2024-04-01T19:49:03.811 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.816 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72e81949:::benchmark_data_smithi188_134454_object120909:head# 2024-04-01T19:49:03.817 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.817 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72ebaa01:::benchmark_data_smithi188_134454_object118529:head# 2024-04-01T19:49:03.817 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.817 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72ebba53:::benchmark_data_smithi188_134454_object130572:head# 2024-04-01T19:49:03.817 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.818 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:03.821 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72ed2fa0:::benchmark_data_smithi188_134454_object151796:head# 2024-04-01T19:49:03.821 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.821 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72ed5263:::benchmark_data_smithi188_134454_object116047:head# 2024-04-01T19:49:03.821 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.821 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72ef69cc:::benchmark_data_smithi188_134454_object147605:head# 2024-04-01T19:49:03.821 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.821 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72f0ee5f:::benchmark_data_smithi188_134454_object144003:head# 2024-04-01T19:49:03.821 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.821 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72f1577d:::benchmark_data_smithi188_134454_object148129:head# 2024-04-01T19:49:03.821 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.821 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72f2540b:::benchmark_data_smithi188_134454_object133372:head# 2024-04-01T19:49:03.822 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.822 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72f25d79:::benchmark_data_smithi188_134454_object136081:head# 2024-04-01T19:49:03.822 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.822 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72f37d41:::benchmark_data_smithi188_134454_object140939:head# 2024-04-01T19:49:03.822 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.822 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72f864e0:::benchmark_data_smithi188_134454_object122124:head# 2024-04-01T19:49:03.822 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.822 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72f8f9ee:::benchmark_data_smithi188_134454_object136010:head# 2024-04-01T19:49:03.822 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.822 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72fa3fcc:::benchmark_data_smithi188_134454_object143957:head# 2024-04-01T19:49:03.822 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.824 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72fb1d6a:::benchmark_data_smithi188_134454_object120742:head# 2024-04-01T19:49:03.824 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.824 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:72fe6fc1:::benchmark_data_smithi188_134454_object138783:head# 2024-04-01T19:49:03.824 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.825 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7300cfd6:::benchmark_data_smithi188_134454_object124765:head# 2024-04-01T19:49:03.825 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.825 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73027644:::benchmark_data_smithi188_134454_object135073:head# 2024-04-01T19:49:03.825 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.825 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:730373fd:::benchmark_data_smithi188_134454_object146912:head# 2024-04-01T19:49:03.825 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.825 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:730396f7:::benchmark_data_smithi188_134454_object132096:head# 2024-04-01T19:49:03.826 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.827 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7303becb:::benchmark_data_smithi188_134454_object145682:head# 2024-04-01T19:49:03.827 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.827 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73042844:::benchmark_data_smithi188_134454_object119861:head# 2024-04-01T19:49:03.827 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.827 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7304b10a:::benchmark_data_smithi188_134454_object143935:head# 2024-04-01T19:49:03.827 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.827 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7306524f:::benchmark_data_smithi188_134454_object134468:head# 2024-04-01T19:49:03.827 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.827 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:730a2243:::benchmark_data_smithi188_134454_object147070:head# 2024-04-01T19:49:03.828 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.828 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:730d92ee:::benchmark_data_smithi188_134454_object129250:head# 2024-04-01T19:49:03.828 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.828 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7310aee8:::benchmark_data_smithi188_134454_object126303:head# 2024-04-01T19:49:03.828 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.829 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73131b7b:::benchmark_data_smithi188_134454_object134122:head# 2024-04-01T19:49:03.829 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.829 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:731368d6:::benchmark_data_smithi188_134454_object126747:head# 2024-04-01T19:49:03.829 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.829 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:731369fd:::benchmark_data_smithi188_134454_object138757:head# 2024-04-01T19:49:03.829 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.829 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7314d070:::benchmark_data_smithi188_134454_object152121:head# 2024-04-01T19:49:03.829 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.830 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73173e79:::benchmark_data_smithi188_134454_object135148:head# 2024-04-01T19:49:03.830 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.830 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:731820fc:::benchmark_data_smithi188_134454_object128310:head# 2024-04-01T19:49:03.830 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.830 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:731c023f:::benchmark_data_smithi188_134454_object148591:head# 2024-04-01T19:49:03.830 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.830 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:731c68bb:::benchmark_data_smithi188_134454_object136911:head# 2024-04-01T19:49:03.830 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.831 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:731cce15:::benchmark_data_smithi188_134454_object121668:head# 2024-04-01T19:49:03.831 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.831 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:731df4b8:::benchmark_data_smithi188_134454_object131453:head# 2024-04-01T19:49:03.831 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.831 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:731f0f42:::benchmark_data_smithi188_134454_object139393:head# 2024-04-01T19:49:03.832 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.832 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:731fb084:::benchmark_data_smithi188_134454_object128740:head# 2024-04-01T19:49:03.832 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.832 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:731fc8e8:::benchmark_data_smithi188_134454_object123179:head# 2024-04-01T19:49:03.832 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.832 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7324c513:::benchmark_data_smithi188_134454_object124102:head# 2024-04-01T19:49:03.832 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.832 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7324cbf2:::benchmark_data_smithi188_134454_object118812:head# 2024-04-01T19:49:03.832 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.832 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73274c37:::benchmark_data_smithi188_134454_object134453:head# 2024-04-01T19:49:03.832 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.833 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73275926:::benchmark_data_smithi188_134454_object120459:head# 2024-04-01T19:49:03.833 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.834 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:732fd552:::benchmark_data_smithi188_134454_object121421:head# 2024-04-01T19:49:03.834 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.834 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7333a114:::benchmark_data_smithi188_134454_object123508:head# 2024-04-01T19:49:03.834 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.834 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73341553:::benchmark_data_smithi188_134454_object139408:head# 2024-04-01T19:49:03.834 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.834 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73342601:::benchmark_data_smithi188_134454_object136802:head# 2024-04-01T19:49:03.834 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.834 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7334d00c:::benchmark_data_smithi188_134454_object155515:head# 2024-04-01T19:49:03.834 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.834 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:733a7966:::benchmark_data_smithi188_134454_object145798:head# 2024-04-01T19:49:03.834 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.834 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:733a7fad:::benchmark_data_smithi188_134454_object154891:head# 2024-04-01T19:49:03.834 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.835 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:733bc459:::benchmark_data_smithi188_134454_object124899:head# 2024-04-01T19:49:03.835 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.835 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:733ced4a:::benchmark_data_smithi188_134454_object134961:head# 2024-04-01T19:49:03.835 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.835 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:733e0e55:::benchmark_data_smithi188_134454_object145030:head# 2024-04-01T19:49:03.835 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.835 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:733f83a5:::benchmark_data_smithi188_134454_object135397:head# 2024-04-01T19:49:03.836 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.836 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:49:03.837 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7342112a:::benchmark_data_smithi188_134454_object121641:head# 2024-04-01T19:49:03.837 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.837 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73428bed:::benchmark_data_smithi188_134454_object138989:head# 2024-04-01T19:49:03.837 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.837 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7345fbc1:::benchmark_data_smithi188_134454_object132308:head# 2024-04-01T19:49:03.837 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.838 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7346b3f7:::benchmark_data_smithi188_134454_object149378:head# 2024-04-01T19:49:03.838 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.838 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:734a9686:::benchmark_data_smithi188_134454_object118082:head# 2024-04-01T19:49:03.838 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.838 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:734cba67:::benchmark_data_smithi188_134454_object127152:head# 2024-04-01T19:49:03.838 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.838 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73503dc3:::benchmark_data_smithi188_134454_object130268:head# 2024-04-01T19:49:03.838 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.838 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73566a1d:::benchmark_data_smithi188_134454_object154291:head# 2024-04-01T19:49:03.838 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.838 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7357054d:::benchmark_data_smithi188_134454_object143404:head# 2024-04-01T19:49:03.838 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.838 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7357d383:::benchmark_data_smithi188_134454_object115576:head# 2024-04-01T19:49:03.838 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.840 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73593d5d:::benchmark_data_smithi188_134454_object133635:head# 2024-04-01T19:49:03.840 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.840 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:735a955f:::benchmark_data_smithi188_134454_object126885:head# 2024-04-01T19:49:03.841 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.841 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:735adaab:::benchmark_data_smithi188_134454_object116666:head# 2024-04-01T19:49:03.841 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.841 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:735c016a:::benchmark_data_smithi188_134454_object153951:head# 2024-04-01T19:49:03.841 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.841 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:735eb4ec:::benchmark_data_smithi188_134454_object133720:head# 2024-04-01T19:49:03.841 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.841 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:735f5d68:::benchmark_data_smithi188_134454_object147437:head# 2024-04-01T19:49:03.841 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.841 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7360ed72:::benchmark_data_smithi188_134454_object121759:head# 2024-04-01T19:49:03.841 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.841 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7362c393:::benchmark_data_smithi188_134454_object155650:head# 2024-04-01T19:49:03.841 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.841 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7362dd57:::benchmark_data_smithi188_134454_object129476:head# 2024-04-01T19:49:03.841 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.842 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:736406ad:::benchmark_data_smithi188_134454_object127454:head# 2024-04-01T19:49:03.842 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.842 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7366f97b:::benchmark_data_smithi188_134454_object146147:head# 2024-04-01T19:49:03.842 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.842 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7368adf2:::benchmark_data_smithi188_134454_object154068:head# 2024-04-01T19:49:03.842 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.844 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:736c0201:::benchmark_data_smithi188_134454_object138115:head# 2024-04-01T19:49:03.844 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.844 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:736e0ac0:::benchmark_data_smithi188_134454_object125318:head# 2024-04-01T19:49:03.844 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.844 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:736e5c19:::benchmark_data_smithi188_134454_object139569:head# 2024-04-01T19:49:03.844 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.844 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:736fa617:::benchmark_data_smithi188_134454_object135527:head# 2024-04-01T19:49:03.844 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.844 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73709da0:::benchmark_data_smithi188_134454_object141872:head# 2024-04-01T19:49:03.844 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.844 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:737349ff:::benchmark_data_smithi188_134454_object130127:head# 2024-04-01T19:49:03.844 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.844 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73764c20:::benchmark_data_smithi188_134454_object129233:head# 2024-04-01T19:49:03.845 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.845 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73805f9d:::benchmark_data_smithi188_134454_object143813:head# 2024-04-01T19:49:03.845 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.845 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73809267:::benchmark_data_smithi188_134454_object155984:head# 2024-04-01T19:49:03.845 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.845 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7383091c:::benchmark_data_smithi188_134454_object145854:head# 2024-04-01T19:49:03.845 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.845 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:738ba84b:::benchmark_data_smithi188_134454_object154222:head# 2024-04-01T19:49:03.845 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.845 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:738c5a68:::benchmark_data_smithi188_134454_object136407:head# 2024-04-01T19:49:03.845 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.847 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:738cd0a6:::benchmark_data_smithi188_134454_object150547:head# 2024-04-01T19:49:03.847 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.847 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:738ec42a:::benchmark_data_smithi188_134454_object120483:head# 2024-04-01T19:49:03.847 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.847 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:738f07fd:::benchmark_data_smithi188_134454_object151433:head# 2024-04-01T19:49:03.847 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.847 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:738f0966:::benchmark_data_smithi188_134454_object144242:head# 2024-04-01T19:49:03.848 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.848 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7390fed8:::benchmark_data_smithi188_134454_object122596:head# 2024-04-01T19:49:03.848 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.848 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7392a915:::benchmark_data_smithi188_134454_object140100:head# 2024-04-01T19:49:03.848 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.848 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73950177:::benchmark_data_smithi188_134454_object118528:head# 2024-04-01T19:49:03.848 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.848 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7395bf8b:::benchmark_data_smithi188_134454_object149058:head# 2024-04-01T19:49:03.848 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.848 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7397452c:::benchmark_data_smithi188_134454_object134672:head# 2024-04-01T19:49:03.848 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.848 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7397b7c5:::benchmark_data_smithi188_134454_object135909:head# 2024-04-01T19:49:03.848 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.850 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7397e30c:::benchmark_data_smithi188_134454_object155165:head# 2024-04-01T19:49:03.850 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.850 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:739a1c2d:::benchmark_data_smithi188_134454_object130246:head# 2024-04-01T19:49:03.850 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.850 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:739e5c9e:::benchmark_data_smithi188_134454_object147394:head# 2024-04-01T19:49:03.850 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.850 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:739f927c:::benchmark_data_smithi188_134454_object134143:head# 2024-04-01T19:49:03.851 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.851 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73a03fae:::benchmark_data_smithi188_134454_object134387:head# 2024-04-01T19:49:03.851 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.851 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73a083cb:::benchmark_data_smithi188_134454_object130294:head# 2024-04-01T19:49:03.851 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.851 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73a0f163:::benchmark_data_smithi188_134454_object124530:head# 2024-04-01T19:49:03.851 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.851 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73a1eacc:::benchmark_data_smithi188_134454_object121295:head# 2024-04-01T19:49:03.851 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.851 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73a21e28:::benchmark_data_smithi188_134454_object129015:head# 2024-04-01T19:49:03.851 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.851 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73a2fd6e:::benchmark_data_smithi188_134454_object123667:head# 2024-04-01T19:49:03.851 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.851 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73a53dad:::benchmark_data_smithi188_134454_object137089:head# 2024-04-01T19:49:03.852 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.852 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73aae790:::benchmark_data_smithi188_134454_object148106:head# 2024-04-01T19:49:03.852 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.852 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73adfc76:::benchmark_data_smithi188_134454_object125692:head# 2024-04-01T19:49:03.852 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.852 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73af14ca:::benchmark_data_smithi188_134454_object133357:head# 2024-04-01T19:49:03.852 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.852 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73af92f4:::benchmark_data_smithi188_134454_object126024:head# 2024-04-01T19:49:03.852 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.854 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73afef61:::benchmark_data_smithi188_134454_object138191:head# 2024-04-01T19:49:03.854 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.854 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73b02f16:::benchmark_data_smithi188_134454_object144485:head# 2024-04-01T19:49:03.854 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.854 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73b36f23:::benchmark_data_smithi188_134454_object140941:head# 2024-04-01T19:49:03.854 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.854 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73b3707d:::benchmark_data_smithi188_134454_object126283:head# 2024-04-01T19:49:03.854 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.855 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73b43b90:::benchmark_data_smithi188_134454_object140432:head# 2024-04-01T19:49:03.855 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.855 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73b6e09c:::benchmark_data_smithi188_134454_object125562:head# 2024-04-01T19:49:03.855 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.855 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73b984b6:::benchmark_data_smithi188_134454_object131483:head# 2024-04-01T19:49:03.855 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.855 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73ba0083:::benchmark_data_smithi188_134454_object132447:head# 2024-04-01T19:49:03.855 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.855 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73bb582d:::benchmark_data_smithi188_134454_object137389:head# 2024-04-01T19:49:03.855 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.855 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73bbdd85:::benchmark_data_smithi188_134454_object147302:head# 2024-04-01T19:49:03.855 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.855 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73bcd088:::benchmark_data_smithi188_134454_object121023:head# 2024-04-01T19:49:03.855 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.856 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73bd7c46:::benchmark_data_smithi188_134454_object153521:head# 2024-04-01T19:49:03.856 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.856 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73bf2b23:::benchmark_data_smithi188_134454_object153939:head# 2024-04-01T19:49:03.856 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.856 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73bf8996:::benchmark_data_smithi188_134454_object138090:head# 2024-04-01T19:49:03.856 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.856 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:49:03.859 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73c1513a:::benchmark_data_smithi188_134454_object122050:head# 2024-04-01T19:49:03.859 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.859 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73c317c4:::benchmark_data_smithi188_134454_object146740:head# 2024-04-01T19:49:03.859 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.859 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73c3c4e6:::benchmark_data_smithi188_134454_object138305:head# 2024-04-01T19:49:03.859 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.859 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73c61502:::benchmark_data_smithi188_134454_object134140:head# 2024-04-01T19:49:03.859 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.859 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73c6fe28:::benchmark_data_smithi188_134454_object135574:head# 2024-04-01T19:49:03.859 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.859 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73c714d0:::benchmark_data_smithi188_134454_object123741:head# 2024-04-01T19:49:03.860 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.860 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73c797df:::benchmark_data_smithi188_134454_object144304:head# 2024-04-01T19:49:03.860 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.860 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73c7f00f:::benchmark_data_smithi188_134454_object137186:head# 2024-04-01T19:49:03.860 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.860 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73c9f2ce:::benchmark_data_smithi188_134454_object147095:head# 2024-04-01T19:49:03.860 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.860 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73ca8528:::benchmark_data_smithi188_134454_object140787:head# 2024-04-01T19:49:03.860 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.860 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73cd7bf7:::benchmark_data_smithi188_134454_object134077:head# 2024-04-01T19:49:03.860 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.861 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:03.862 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:49:03.863 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73d22c59:::benchmark_data_smithi188_134454_object137328:head# 2024-04-01T19:49:03.863 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.863 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73d2740c:::benchmark_data_smithi188_134454_object123972:head# 2024-04-01T19:49:03.863 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.863 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73d4efb3:::benchmark_data_smithi188_134454_object126235:head# 2024-04-01T19:49:03.863 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.863 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73d587e9:::benchmark_data_smithi188_134454_object152032:head# 2024-04-01T19:49:03.863 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.863 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73d7a2c4:::benchmark_data_smithi188_134454_object147870:head# 2024-04-01T19:49:03.863 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.864 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73d8b140:::benchmark_data_smithi188_134454_object123532:head# 2024-04-01T19:49:03.864 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.864 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73db23f3:::benchmark_data_smithi188_134454_object134171:head# 2024-04-01T19:49:03.864 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.864 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73db73b7:::benchmark_data_smithi188_134454_object124039:head# 2024-04-01T19:49:03.864 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.864 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73e1d0fa:::benchmark_data_smithi188_134454_object125482:head# 2024-04-01T19:49:03.864 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.864 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73e3f4f0:::benchmark_data_smithi188_134454_object131595:head# 2024-04-01T19:49:03.864 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.864 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73e403f9:::benchmark_data_smithi188_134454_object146481:head# 2024-04-01T19:49:03.864 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.864 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:49:03.867 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73e536d1:::benchmark_data_smithi188_134454_object126589:head# 2024-04-01T19:49:03.867 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.867 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73e701a6:::benchmark_data_smithi188_134454_object138755:head# 2024-04-01T19:49:03.867 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.867 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73e854b1:::benchmark_data_smithi188_134454_object155393:head# 2024-04-01T19:49:03.867 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.867 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73e8942f:::benchmark_data_smithi188_134454_object137515:head# 2024-04-01T19:49:03.867 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.867 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73ea4ed2:::benchmark_data_smithi188_134454_object116132:head# 2024-04-01T19:49:03.868 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.868 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73ea5e55:::benchmark_data_smithi188_134454_object128889:head# 2024-04-01T19:49:03.868 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.868 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73eb7fc3:::benchmark_data_smithi188_134454_object130631:head# 2024-04-01T19:49:03.868 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.868 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73ec7a8d:::benchmark_data_smithi188_134454_object132505:head# 2024-04-01T19:49:03.868 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.868 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73f07705:::benchmark_data_smithi188_134454_object137898:head# 2024-04-01T19:49:03.868 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.868 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73f5450d:::benchmark_data_smithi188_134454_object144341:head# 2024-04-01T19:49:03.868 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.868 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73f65cc4:::benchmark_data_smithi188_134454_object121888:head# 2024-04-01T19:49:03.868 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.868 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73fa7613:::benchmark_data_smithi188_134454_object128747:head# 2024-04-01T19:49:03.869 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.869 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73faf29d:::benchmark_data_smithi188_134454_object145899:head# 2024-04-01T19:49:03.869 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.869 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73fb37f5:::benchmark_data_smithi188_134454_object115825:head# 2024-04-01T19:49:03.869 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.869 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73fd2e86:::benchmark_data_smithi188_134454_object136401:head# 2024-04-01T19:49:03.869 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.869 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73fd4d2c:::benchmark_data_smithi188_134454_object124926:head# 2024-04-01T19:49:03.869 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.869 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:73ff670d:::benchmark_data_smithi188_134454_object133288:head# 2024-04-01T19:49:03.869 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.869 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7400b085:::benchmark_data_smithi188_134454_object127400:head# 2024-04-01T19:49:03.869 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.869 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7401d86f:::benchmark_data_smithi188_134454_object139461:head# 2024-04-01T19:49:03.869 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.870 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7402e9fc:::benchmark_data_smithi188_134454_object153302:head# 2024-04-01T19:49:03.870 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.870 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7405e0ad:::benchmark_data_smithi188_134454_object134489:head# 2024-04-01T19:49:03.870 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.870 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:49:03.870 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:49:03.871 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:740c2b43:::benchmark_data_smithi188_134454_object144324:head# 2024-04-01T19:49:03.871 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.871 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:740cb7fd:::benchmark_data_smithi188_134454_object125536:head# 2024-04-01T19:49:03.871 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.871 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74104f48:::benchmark_data_smithi188_134454_object118369:head# 2024-04-01T19:49:03.871 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.875 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:741065ba:::benchmark_data_smithi188_134454_object154709:head# 2024-04-01T19:49:03.875 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.875 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7410a662:::benchmark_data_smithi188_134454_object134704:head# 2024-04-01T19:49:03.875 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.876 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7410de70:::benchmark_data_smithi188_134454_object127846:head# 2024-04-01T19:49:03.876 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.876 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7411d9c8:::benchmark_data_smithi188_134454_object152668:head# 2024-04-01T19:49:03.876 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.876 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7411da33:::benchmark_data_smithi188_134454_object138641:head# 2024-04-01T19:49:03.876 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.876 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:741221ae:::benchmark_data_smithi188_134454_object122651:head# 2024-04-01T19:49:03.876 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.876 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74138f2e:::benchmark_data_smithi188_134454_object155171:head# 2024-04-01T19:49:03.876 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.876 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7417dc19:::benchmark_data_smithi188_134454_object148316:head# 2024-04-01T19:49:03.876 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.878 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:741abe5b:::benchmark_data_smithi188_134454_object122940:head# 2024-04-01T19:49:03.878 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.878 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:741ff417:::benchmark_data_smithi188_134454_object115599:head# 2024-04-01T19:49:03.878 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.878 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74251c17:::benchmark_data_smithi188_134454_object154791:head# 2024-04-01T19:49:03.878 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.878 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7426a7c6:::benchmark_data_smithi188_134454_object141890:head# 2024-04-01T19:49:03.878 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.878 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:742897c1:::benchmark_data_smithi188_134454_object124234:head# 2024-04-01T19:49:03.878 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.878 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7428f43a:::benchmark_data_smithi188_134454_object125029:head# 2024-04-01T19:49:03.879 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.879 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:742a4411:::benchmark_data_smithi188_134454_object155548:head# 2024-04-01T19:49:03.879 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.879 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:742a5322:::benchmark_data_smithi188_134454_object147727:head# 2024-04-01T19:49:03.879 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.879 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:742bd1d3:::benchmark_data_smithi188_134454_object156210:head# 2024-04-01T19:49:03.879 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.879 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:742c560c:::benchmark_data_smithi188_134454_object154852:head# 2024-04-01T19:49:03.879 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.881 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:742c935c:::benchmark_data_smithi188_134454_object150848:head# 2024-04-01T19:49:03.881 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.883 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:742e854f:::benchmark_data_smithi188_134454_object130772:head# 2024-04-01T19:49:03.883 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.884 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:742f20f9:::benchmark_data_smithi188_134454_object130397:head# 2024-04-01T19:49:03.884 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.884 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74321cf8:::benchmark_data_smithi188_134454_object144933:head# 2024-04-01T19:49:03.884 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.884 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7432bf34:::benchmark_data_smithi188_134454_object123803:head# 2024-04-01T19:49:03.884 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.884 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74334502:::benchmark_data_smithi188_134454_object116286:head# 2024-04-01T19:49:03.885 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.885 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7433e28c:::benchmark_data_smithi188_134454_object117137:head# 2024-04-01T19:49:03.885 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.885 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7438ee3e:::benchmark_data_smithi188_134454_object125769:head# 2024-04-01T19:49:03.885 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.886 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7439c8b5:::benchmark_data_smithi188_134454_object139987:head# 2024-04-01T19:49:03.886 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.886 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:743a00a8:::benchmark_data_smithi188_134454_object153299:head# 2024-04-01T19:49:03.886 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.886 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:743a6b62:::benchmark_data_smithi188_134454_object143129:head# 2024-04-01T19:49:03.886 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.887 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:743c257b:::benchmark_data_smithi188_134454_object143605:head# 2024-04-01T19:49:03.887 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.887 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:743c99bb:::benchmark_data_smithi188_134454_object142959:head# 2024-04-01T19:49:03.887 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.887 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:743e2529:::benchmark_data_smithi188_134454_object118698:head# 2024-04-01T19:49:03.887 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.887 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:743ee378:::benchmark_data_smithi188_134454_object133820:head# 2024-04-01T19:49:03.887 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.887 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:743ef459:::benchmark_data_smithi188_134454_object116764:head# 2024-04-01T19:49:03.887 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.888 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:743fdba7:::benchmark_data_smithi188_134454_object148882:head# 2024-04-01T19:49:03.888 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.888 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:743ff3dc:::benchmark_data_smithi188_134454_object125366:head# 2024-04-01T19:49:03.888 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.889 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7444c53e:::benchmark_data_smithi188_134454_object144618:head# 2024-04-01T19:49:03.889 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.889 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7446d495:::benchmark_data_smithi188_134454_object135509:head# 2024-04-01T19:49:03.889 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.889 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74482dc0:::benchmark_data_smithi188_134454_object137040:head# 2024-04-01T19:49:03.889 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.890 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:744b4f40:::benchmark_data_smithi188_134454_object132110:head# 2024-04-01T19:49:03.890 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.890 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:744bae1e:::benchmark_data_smithi188_134454_object133726:head# 2024-04-01T19:49:03.890 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.890 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:744daa5c:::benchmark_data_smithi188_134454_object125521:head# 2024-04-01T19:49:03.890 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.890 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:744ec62b:::benchmark_data_smithi188_134454_object133564:head# 2024-04-01T19:49:03.890 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.890 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74500ba5:::benchmark_data_smithi188_134454_object133507:head# 2024-04-01T19:49:03.890 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.891 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7451214a:::benchmark_data_smithi188_134454_object133306:head# 2024-04-01T19:49:03.892 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.892 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7451af82:::benchmark_data_smithi188_134454_object127442:head# 2024-04-01T19:49:03.892 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.892 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74572f8e:::benchmark_data_smithi188_134454_object137223:head# 2024-04-01T19:49:03.892 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.892 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74573a0d:::benchmark_data_smithi188_134454_object154452:head# 2024-04-01T19:49:03.892 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.892 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74584f64:::benchmark_data_smithi188_134454_object128972:head# 2024-04-01T19:49:03.892 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.892 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:745884e8:::benchmark_data_smithi188_134454_object116755:head# 2024-04-01T19:49:03.892 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.892 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:745939db:::benchmark_data_smithi188_134454_object150982:head# 2024-04-01T19:49:03.892 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.894 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:745a3ae3:::benchmark_data_smithi188_134454_object124317:head# 2024-04-01T19:49:03.894 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.894 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:745b9083:::benchmark_data_smithi188_134454_object122763:head# 2024-04-01T19:49:03.894 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.898 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:745c3c04:::benchmark_data_smithi188_134454_object148909:head# 2024-04-01T19:49:03.898 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.898 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:745c6098:::benchmark_data_smithi188_134454_object150331:head# 2024-04-01T19:49:03.898 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.898 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74618e54:::benchmark_data_smithi188_134454_object139218:head# 2024-04-01T19:49:03.898 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.898 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7461df99:::benchmark_data_smithi188_134454_object136025:head# 2024-04-01T19:49:03.898 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.898 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7461fb1f:::benchmark_data_smithi188_134454_object121910:head# 2024-04-01T19:49:03.899 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.899 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74625952:::benchmark_data_smithi188_134454_object139258:head# 2024-04-01T19:49:03.899 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.899 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74625cce:::benchmark_data_smithi188_134454_object122800:head# 2024-04-01T19:49:03.899 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.899 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74633ac8:::benchmark_data_smithi188_134454_object117500:head# 2024-04-01T19:49:03.899 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.899 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:49:03.899 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:49:03.900 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-01T19:49:03.900 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:49:03.900 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:49:03.900 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:49:03.900 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:49:03.900 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:49:03.900 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:49:03.900 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:49:03.900 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:49:03.900 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:49:03.900 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:49:03.902 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74637256:::benchmark_data_smithi188_134454_object139045:head# 2024-04-01T19:49:03.902 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.902 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7463f5bd:::benchmark_data_smithi188_134454_object146586:head# 2024-04-01T19:49:03.902 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.902 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74640963:::benchmark_data_smithi188_134454_object121403:head# 2024-04-01T19:49:03.902 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.902 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:746417b4:::benchmark_data_smithi188_134454_object140893:head# 2024-04-01T19:49:03.902 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.903 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74687caa:::benchmark_data_smithi188_134454_object123678:head# 2024-04-01T19:49:03.903 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.903 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7469e95e:::benchmark_data_smithi188_134454_object133928:head# 2024-04-01T19:49:03.903 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.903 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:746d2187:::benchmark_data_smithi188_134454_object146930:head# 2024-04-01T19:49:03.903 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.903 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:746d222a:::benchmark_data_smithi188_134454_object123134:head# 2024-04-01T19:49:03.903 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.903 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:746fb3c9:::benchmark_data_smithi188_134454_object145151:head# 2024-04-01T19:49:03.903 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.903 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:746fbcf8:::benchmark_data_smithi188_134454_object126490:head# 2024-04-01T19:49:03.903 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.903 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74719391:::benchmark_data_smithi188_134454_object127953:head# 2024-04-01T19:49:03.903 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.903 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7471f152:::benchmark_data_smithi188_134454_object148487:head# 2024-04-01T19:49:03.904 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.904 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7474ce8a:::benchmark_data_smithi188_134454_object122421:head# 2024-04-01T19:49:03.904 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.904 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7475c57c:::benchmark_data_smithi188_134454_object120465:head# 2024-04-01T19:49:03.904 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.904 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74767720:::benchmark_data_smithi188_134454_object116061:head# 2024-04-01T19:49:03.904 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.905 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7478473d:::benchmark_data_smithi188_134454_object151442:head# 2024-04-01T19:49:03.905 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.905 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7479f4c4:::benchmark_data_smithi188_134454_object146557:head# 2024-04-01T19:49:03.905 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.905 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:747b0ffd:::benchmark_data_smithi188_134454_object140632:head# 2024-04-01T19:49:03.905 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.905 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:747d2b9f:::benchmark_data_smithi188_134454_object152255:head# 2024-04-01T19:49:03.905 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.905 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:747e17f0:::benchmark_data_smithi188_134454_object130527:head# 2024-04-01T19:49:03.905 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.906 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:747f53a0:::benchmark_data_smithi188_134454_object126629:head# 2024-04-01T19:49:03.906 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.909 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:747fb8f9:::benchmark_data_smithi188_134454_object145964:head# 2024-04-01T19:49:03.909 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.909 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:747fdcfe:::benchmark_data_smithi188_134454_object129934:head# 2024-04-01T19:49:03.909 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.909 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7481a59c:::benchmark_data_smithi188_134454_object149801:head# 2024-04-01T19:49:03.909 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.909 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7485631d:::benchmark_data_smithi188_134454_object145194:head# 2024-04-01T19:49:03.909 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.909 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7486d278:::benchmark_data_smithi188_134454_object127914:head# 2024-04-01T19:49:03.910 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.910 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7488b49f:::benchmark_data_smithi188_134454_object141425:head# 2024-04-01T19:49:03.910 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.910 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74898648:::benchmark_data_smithi188_134454_object117793:head# 2024-04-01T19:49:03.910 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.910 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7489db5f:::benchmark_data_smithi188_134454_object116380:head# 2024-04-01T19:49:03.910 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.910 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:748ac234:::benchmark_data_smithi188_134454_object142741:head# 2024-04-01T19:49:03.910 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.910 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:748c534e:::benchmark_data_smithi188_134454_object132500:head# 2024-04-01T19:49:03.910 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.910 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:748cb60a:::benchmark_data_smithi188_134454_object131754:head# 2024-04-01T19:49:03.911 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.911 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:748d15eb:::benchmark_data_smithi188_134454_object140014:head# 2024-04-01T19:49:03.911 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.912 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:748f6115:::benchmark_data_smithi188_134454_object152049:head# 2024-04-01T19:49:03.912 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:03 smithi022 ceph-mon[39439]: pgmap v1517: 17 pgs: 17 active+clean; 839 MiB data, 6.0 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 958 op/s 2024-04-01T19:49:03.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:03 smithi022 ceph-mon[39439]: 6.b scrub starts 2024-04-01T19:49:03.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:03 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/440528876' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:49:03.915 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7490b764:::benchmark_data_smithi188_134454_object132374:head# 2024-04-01T19:49:03.915 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.915 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7492edd2:::benchmark_data_smithi188_134454_object133296:head# 2024-04-01T19:49:03.915 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.916 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74933ad5:::benchmark_data_smithi188_134454_object154776:head# 2024-04-01T19:49:03.916 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.916 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74939abb:::benchmark_data_smithi188_134454_object140114:head# 2024-04-01T19:49:03.916 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.917 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7494db75:::benchmark_data_smithi188_134454_object116458:head# 2024-04-01T19:49:03.917 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.917 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7496e945:::benchmark_data_smithi188_134454_object130725:head# 2024-04-01T19:49:03.917 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.917 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7498f5ea:::benchmark_data_smithi188_134454_object139156:head# 2024-04-01T19:49:03.917 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.918 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7499cad5:::benchmark_data_smithi188_134454_object141945:head# 2024-04-01T19:49:03.918 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.918 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:749a5cd9:::benchmark_data_smithi188_134454_object119229:head# 2024-04-01T19:49:03.918 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.918 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:749aacbb:::benchmark_data_smithi188_134454_object148454:head# 2024-04-01T19:49:03.918 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.918 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:749ad2dc:::benchmark_data_smithi188_134454_object135412:head# 2024-04-01T19:49:03.918 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.919 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:749b2e2d:::benchmark_data_smithi188_134454_object116927:head# 2024-04-01T19:49:03.919 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.919 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:749cfaae:::benchmark_data_smithi188_134454_object144675:head# 2024-04-01T19:49:03.919 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.919 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:749e3e03:::benchmark_data_smithi188_134454_object134346:head# 2024-04-01T19:49:03.920 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.920 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74a125a7:::benchmark_data_smithi188_134454_object137240:head# 2024-04-01T19:49:03.920 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.920 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74a20e57:::benchmark_data_smithi188_134454_object119817:head# 2024-04-01T19:49:03.920 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.920 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74a3c5fc:::benchmark_data_smithi188_134454_object145269:head# 2024-04-01T19:49:03.920 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.921 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74a3e1dd:::benchmark_data_smithi188_134454_object129142:head# 2024-04-01T19:49:03.921 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.921 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74a47002:::benchmark_data_smithi188_134454_object145215:head# 2024-04-01T19:49:03.921 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.921 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74a474d8:::benchmark_data_smithi188_134454_object135166:head# 2024-04-01T19:49:03.921 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.921 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74a4a3db:::benchmark_data_smithi188_134454_object135600:head# 2024-04-01T19:49:03.921 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.921 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74a6377c:::benchmark_data_smithi188_134454_object147264:head# 2024-04-01T19:49:03.922 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.922 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74a6adfe:::benchmark_data_smithi188_134454_object134237:head# 2024-04-01T19:49:03.922 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.923 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74a7a4b8:::benchmark_data_smithi188_134454_object135655:head# 2024-04-01T19:49:03.923 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.923 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74a8e937:::benchmark_data_smithi188_134454_object146882:head# 2024-04-01T19:49:03.923 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.923 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74ad1161:::benchmark_data_smithi188_134454_object155587:head# 2024-04-01T19:49:03.923 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.923 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74aeb8fb:::benchmark_data_smithi188_134454_object117065:head# 2024-04-01T19:49:03.923 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.924 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74aec900:::benchmark_data_smithi188_134454_object116475:head# 2024-04-01T19:49:03.924 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.924 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74b33686:::benchmark_data_smithi188_134454_object154243:head# 2024-04-01T19:49:03.924 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.924 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74b7e25d:::benchmark_data_smithi188_134454_object146031:head# 2024-04-01T19:49:03.924 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.925 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74bae9ba:::benchmark_data_smithi188_134454_object135644:head# 2024-04-01T19:49:03.925 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.925 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74bcaf6f:::benchmark_data_smithi188_134454_object124074:head# 2024-04-01T19:49:03.925 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.925 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74be6c2b:::benchmark_data_smithi188_134454_object142134:head# 2024-04-01T19:49:03.925 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.925 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74bee9f0:::benchmark_data_smithi188_134454_object124457:head# 2024-04-01T19:49:03.925 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.925 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74bf8b36:::benchmark_data_smithi188_134454_object139846:head# 2024-04-01T19:49:03.925 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.926 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74c04625:::benchmark_data_smithi188_134454_object115506:head# 2024-04-01T19:49:03.926 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.926 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74c0ab5f:::benchmark_data_smithi188_134454_object156267:head# 2024-04-01T19:49:03.926 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.926 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74c1ef95:::benchmark_data_smithi188_134454_object137397:head# 2024-04-01T19:49:03.926 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.932 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74c29aa9:::benchmark_data_smithi188_134454_object129707:head# 2024-04-01T19:49:03.932 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.932 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74c8a9eb:::benchmark_data_smithi188_134454_object122954:head# 2024-04-01T19:49:03.932 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.933 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74ca23e6:::benchmark_data_smithi188_134454_object135025:head# 2024-04-01T19:49:03.933 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.933 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74cbe6f0:::benchmark_data_smithi188_134454_object128130:head# 2024-04-01T19:49:03.933 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.934 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74ccd31f:::benchmark_data_smithi188_134454_object127369:head# 2024-04-01T19:49:03.934 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.936 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74cd2302:::benchmark_data_smithi188_134454_object126840:head# 2024-04-01T19:49:03.936 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.936 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74cd7301:::benchmark_data_smithi188_134454_object151150:head# 2024-04-01T19:49:03.936 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.936 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74d1ff67:::benchmark_data_smithi188_134454_object141941:head# 2024-04-01T19:49:03.936 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.936 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74d42a6e:::benchmark_data_smithi188_134454_object128682:head# 2024-04-01T19:49:03.936 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.936 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74d480ab:::benchmark_data_smithi188_134454_object154101:head# 2024-04-01T19:49:03.937 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.937 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74d69fbc:::benchmark_data_smithi188_134454_object127748:head# 2024-04-01T19:49:03.937 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.937 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74d76cd8:::benchmark_data_smithi188_134454_object130823:head# 2024-04-01T19:49:03.937 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.938 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74d8ff32:::benchmark_data_smithi188_134454_object139911:head# 2024-04-01T19:49:03.938 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.938 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74da8bc8:::benchmark_data_smithi188_134454_object122666:head# 2024-04-01T19:49:03.938 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.938 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74da99e1:::benchmark_data_smithi188_134454_object120782:head# 2024-04-01T19:49:03.938 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.939 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74dab5ac:::benchmark_data_smithi188_134454_object153971:head# 2024-04-01T19:49:03.939 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.939 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74db8ce3:::benchmark_data_smithi188_134454_object153086:head# 2024-04-01T19:49:03.939 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.939 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74dcc251:::benchmark_data_smithi188_134454_object148406:head# 2024-04-01T19:49:03.939 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.939 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74dd97e6:::benchmark_data_smithi188_134454_object122435:head# 2024-04-01T19:49:03.939 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.939 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74dfbaec:::benchmark_data_smithi188_134454_object132853:head# 2024-04-01T19:49:03.939 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.939 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74e11715:::benchmark_data_smithi188_134454_object116048:head# 2024-04-01T19:49:03.939 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.940 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74e1798d:::benchmark_data_smithi188_134454_object127275:head# 2024-04-01T19:49:03.940 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.943 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74e3ace2:::benchmark_data_smithi188_134454_object155726:head# 2024-04-01T19:49:03.943 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.943 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74e68447:::benchmark_data_smithi188_134454_object150415:head# 2024-04-01T19:49:03.943 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.943 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74e6fbc0:::benchmark_data_smithi188_134454_object121791:head# 2024-04-01T19:49:03.944 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.944 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74e80cc9:::benchmark_data_smithi188_134454_object127035:head# 2024-04-01T19:49:03.944 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.944 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74e8965e:::benchmark_data_smithi188_134454_object143825:head# 2024-04-01T19:49:03.944 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.944 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74e96a65:::benchmark_data_smithi188_134454_object147657:head# 2024-04-01T19:49:03.944 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.944 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74ec3c0b:::benchmark_data_smithi188_134454_object139088:head# 2024-04-01T19:49:03.944 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.944 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74eccc63:::benchmark_data_smithi188_134454_object140891:head# 2024-04-01T19:49:03.944 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.944 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74ecdb59:::benchmark_data_smithi188_134454_object140244:head# 2024-04-01T19:49:03.944 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.944 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74ece279:::benchmark_data_smithi188_134454_object122134:head# 2024-04-01T19:49:03.944 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.945 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74ef22ef:::benchmark_data_smithi188_134454_object136414:head# 2024-04-01T19:49:03.945 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.945 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74f03cfa:::benchmark_data_smithi188_134454_object124542:head# 2024-04-01T19:49:03.945 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.945 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74f06c44:::benchmark_data_smithi188_134454_object142944:head# 2024-04-01T19:49:03.945 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.945 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74f09c8a:::benchmark_data_smithi188_134454_object126759:head# 2024-04-01T19:49:03.945 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.945 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74f28f56:::benchmark_data_smithi188_134454_object154417:head# 2024-04-01T19:49:03.945 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.945 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74f36533:::benchmark_data_smithi188_134454_object143033:head# 2024-04-01T19:49:03.945 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.945 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74f3ba0f:::benchmark_data_smithi188_134454_object130134:head# 2024-04-01T19:49:03.945 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.946 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74f600aa:::benchmark_data_smithi188_134454_object150634:head# 2024-04-01T19:49:03.946 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.946 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74f66178:::benchmark_data_smithi188_134454_object155012:head# 2024-04-01T19:49:03.946 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.946 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74f66b45:::benchmark_data_smithi188_134454_object152941:head# 2024-04-01T19:49:03.946 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.947 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74f88389:::benchmark_data_smithi188_134454_object121157:head# 2024-04-01T19:49:03.947 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.947 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74fbd969:::benchmark_data_smithi188_134454_object143363:head# 2024-04-01T19:49:03.947 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.949 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74fc50e3:::benchmark_data_smithi188_134454_object129350:head# 2024-04-01T19:49:03.949 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.949 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74fc7fc8:::benchmark_data_smithi188_134454_object125557:head# 2024-04-01T19:49:03.950 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.950 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74fcfa7f:::benchmark_data_smithi188_134454_object147365:head# 2024-04-01T19:49:03.950 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.950 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:74fe1ec0:::benchmark_data_smithi188_134454_object123107:head# 2024-04-01T19:49:03.950 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.955 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75020540:::benchmark_data_smithi188_134454_object124278:head# 2024-04-01T19:49:03.955 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.955 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75030ea3:::benchmark_data_smithi188_134454_object123155:head# 2024-04-01T19:49:03.955 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.955 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7503f285:::benchmark_data_smithi188_134454_object135625:head# 2024-04-01T19:49:03.955 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.955 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75040240:::benchmark_data_smithi188_134454_object130466:head# 2024-04-01T19:49:03.955 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.955 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7504795b:::benchmark_data_smithi188_134454_object118787:head# 2024-04-01T19:49:03.955 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.955 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7505be3a:::benchmark_data_smithi188_134454_object154856:head# 2024-04-01T19:49:03.956 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.956 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7506c0d5:::benchmark_data_smithi188_134454_object122958:head# 2024-04-01T19:49:03.956 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.957 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:750764c4:::benchmark_data_smithi188_134454_object136951:head# 2024-04-01T19:49:03.957 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.957 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75090482:::benchmark_data_smithi188_134454_object137987:head# 2024-04-01T19:49:03.957 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.957 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7509a121:::benchmark_data_smithi188_134454_object116053:head# 2024-04-01T19:49:03.957 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.957 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:750a3240:::benchmark_data_smithi188_134454_object139565:head# 2024-04-01T19:49:03.957 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.957 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:750d40e3:::benchmark_data_smithi188_134454_object117591:head# 2024-04-01T19:49:03.957 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.958 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:750daca1:::benchmark_data_smithi188_134454_object137071:head# 2024-04-01T19:49:03.958 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.958 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:750dd02d:::benchmark_data_smithi188_134454_object130869:head# 2024-04-01T19:49:03.958 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.958 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75127411:::benchmark_data_smithi188_134454_object136239:head# 2024-04-01T19:49:03.958 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.959 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75155761:::benchmark_data_smithi188_134454_object125776:head# 2024-04-01T19:49:03.959 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.959 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7516f206:::benchmark_data_smithi188_134454_object115934:head# 2024-04-01T19:49:03.959 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.959 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75191e1a:::benchmark_data_smithi188_134454_object124898:head# 2024-04-01T19:49:03.959 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.959 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7519ae89:::benchmark_data_smithi188_134454_object154731:head# 2024-04-01T19:49:03.959 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.962 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:49:03.963 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:751a19f2:::benchmark_data_smithi188_134454_object115570:head# 2024-04-01T19:49:03.963 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.963 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:751a3bfb:::benchmark_data_smithi188_134454_object131884:head# 2024-04-01T19:49:03.963 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.963 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:751a49af:::benchmark_data_smithi188_134454_object154048:head# 2024-04-01T19:49:03.963 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.963 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:751a9229:::benchmark_data_smithi188_134454_object138019:head# 2024-04-01T19:49:03.963 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.964 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:751ebb87:::benchmark_data_smithi188_134454_object155179:head# 2024-04-01T19:49:03.964 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.964 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:751fa640:::benchmark_data_smithi188_134454_object154712:head# 2024-04-01T19:49:03.964 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.964 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7522c993:::benchmark_data_smithi188_134454_object120678:head# 2024-04-01T19:49:03.964 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.964 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75232e01:::benchmark_data_smithi188_134454_object133149:head# 2024-04-01T19:49:03.964 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.964 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75240fcd:::benchmark_data_smithi188_134454_object119149:head# 2024-04-01T19:49:03.964 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.964 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75253549:::benchmark_data_smithi188_134454_object125946:head# 2024-04-01T19:49:03.964 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.964 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:752aa82f:::benchmark_data_smithi188_134454_object123520:head# 2024-04-01T19:49:03.964 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.964 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:752f5066:::benchmark_data_smithi188_134454_object144037:head# 2024-04-01T19:49:03.965 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.965 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:752f79b2:::benchmark_data_smithi188_134454_object126911:head# 2024-04-01T19:49:03.965 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.965 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7530e39e:::benchmark_data_smithi188_134454_object125451:head# 2024-04-01T19:49:03.965 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.965 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7532069a:::benchmark_data_smithi188_134454_object123908:head# 2024-04-01T19:49:03.965 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.965 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75345ddb:::benchmark_data_smithi188_134454_object149038:head# 2024-04-01T19:49:03.965 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.968 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7536a7d2:::benchmark_data_smithi188_134454_object118693:head# 2024-04-01T19:49:03.968 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.968 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75371ed5:::benchmark_data_smithi188_134454_object134165:head# 2024-04-01T19:49:03.968 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.968 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7537de1c:::benchmark_data_smithi188_134454_object150348:head# 2024-04-01T19:49:03.968 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.968 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7537e6e9:::benchmark_data_smithi188_134454_object136264:head# 2024-04-01T19:49:03.968 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.968 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7537e752:::benchmark_data_smithi188_134454_object126002:head# 2024-04-01T19:49:03.969 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.969 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75380f3c:::benchmark_data_smithi188_134454_object115656:head# 2024-04-01T19:49:03.969 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.969 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:753b7bcc:::benchmark_data_smithi188_134454_object118138:head# 2024-04-01T19:49:03.969 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.969 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:753dc20e:::benchmark_data_smithi188_134454_object117978:head# 2024-04-01T19:49:03.969 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.969 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:753dd5ee:::benchmark_data_smithi188_134454_object134906:head# 2024-04-01T19:49:03.969 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.969 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:753f9e2c:::benchmark_data_smithi188_134454_object127614:head# 2024-04-01T19:49:03.969 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.969 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7540eb37:::benchmark_data_smithi188_134454_object156053:head# 2024-04-01T19:49:03.969 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.969 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7544e2db:::benchmark_data_smithi188_134454_object154854:head# 2024-04-01T19:49:03.969 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.970 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:754653fa:::benchmark_data_smithi188_134454_object115497:head# 2024-04-01T19:49:03.970 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.970 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:754658ba:::benchmark_data_smithi188_134454_object121847:head# 2024-04-01T19:49:03.970 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.970 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7546ee8b:::benchmark_data_smithi188_134454_object139641:head# 2024-04-01T19:49:03.970 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.970 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:754ea719:::benchmark_data_smithi188_134454_object144580:head# 2024-04-01T19:49:03.970 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.970 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75502d53:::benchmark_data_smithi188_134454_object133401:head# 2024-04-01T19:49:03.970 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.970 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7552ecea:::benchmark_data_smithi188_134454_object144872:head# 2024-04-01T19:49:03.970 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.972 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:755a7a2d:::benchmark_data_smithi188_134454_object131674:head# 2024-04-01T19:49:03.972 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.972 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:755b79db:::benchmark_data_smithi188_134454_object138874:head# 2024-04-01T19:49:03.972 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.972 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:755b7d5c:::benchmark_data_smithi188_134454_object138932:head# 2024-04-01T19:49:03.972 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.972 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:755cdde0:::benchmark_data_smithi188_134454_object129710:head# 2024-04-01T19:49:03.972 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.972 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:755f80e3:::benchmark_data_smithi188_134454_object132580:head# 2024-04-01T19:49:03.972 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.972 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75617953:::benchmark_data_smithi188_134454_object145714:head# 2024-04-01T19:49:03.973 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.973 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7561853a:::benchmark_data_smithi188_134454_object115774:head# 2024-04-01T19:49:03.973 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.973 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7562da6b:::benchmark_data_smithi188_134454_object136474:head# 2024-04-01T19:49:03.973 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.973 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:756353b7:::benchmark_data_smithi188_134454_object144024:head# 2024-04-01T19:49:03.973 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.973 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75663ca3:::benchmark_data_smithi188_134454_object145988:head# 2024-04-01T19:49:03.973 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.973 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7567bca1:::benchmark_data_smithi188_134454_object125891:head# 2024-04-01T19:49:03.973 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.973 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:756804a6:::benchmark_data_smithi188_134454_object124568:head# 2024-04-01T19:49:03.973 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.973 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:756817b0:::benchmark_data_smithi188_134454_object146188:head# 2024-04-01T19:49:03.973 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.974 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:756b36cc:::benchmark_data_smithi188_134454_object155081:head# 2024-04-01T19:49:03.974 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.974 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:756b3f8a:::benchmark_data_smithi188_134454_object125067:head# 2024-04-01T19:49:03.974 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.975 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:756c5d98:::benchmark_data_smithi188_134454_object154103:head# 2024-04-01T19:49:03.975 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.975 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:756c7ab9:::benchmark_data_smithi188_134454_object129018:head# 2024-04-01T19:49:03.975 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.975 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:756de1eb:::benchmark_data_smithi188_134454_object118544:head# 2024-04-01T19:49:03.975 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.975 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:756f5ca9:::benchmark_data_smithi188_134454_object124589:head# 2024-04-01T19:49:03.975 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.975 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:757005b5:::benchmark_data_smithi188_134454_object119757:head# 2024-04-01T19:49:03.975 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.984 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75735383:::benchmark_data_smithi188_134454_object147105:head# 2024-04-01T19:49:03.984 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.984 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7578aa42:::benchmark_data_smithi188_134454_object142607:head# 2024-04-01T19:49:03.984 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.984 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75798211:::benchmark_data_smithi188_134454_object152959:head# 2024-04-01T19:49:03.984 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.984 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:757993fa:::benchmark_data_smithi188_134454_object153422:head# 2024-04-01T19:49:03.984 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.985 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7579dae0:::benchmark_data_smithi188_134454_object133868:head# 2024-04-01T19:49:03.985 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.985 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:757b7a4a:::benchmark_data_smithi188_134454_object132752:head# 2024-04-01T19:49:03.985 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.985 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:757df468:::benchmark_data_smithi188_134454_object132272:head# 2024-04-01T19:49:03.985 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.985 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:757e95d0:::benchmark_data_smithi188_134454_object121204:head# 2024-04-01T19:49:03.985 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.985 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:757feaf5:::benchmark_data_smithi188_134454_object135662:head# 2024-04-01T19:49:03.985 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.985 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75844c01:::benchmark_data_smithi188_134454_object139932:head# 2024-04-01T19:49:03.985 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.985 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7588f9ab:::benchmark_data_smithi188_134454_object144410:head# 2024-04-01T19:49:03.985 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.985 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:758adb30:::benchmark_data_smithi188_134454_object119725:head# 2024-04-01T19:49:03.986 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.986 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:758aef46:::benchmark_data_smithi188_134454_object132115:head# 2024-04-01T19:49:03.986 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.986 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:758c2d18:::benchmark_data_smithi188_134454_object156585:head# 2024-04-01T19:49:03.986 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.986 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:758e89c7:::benchmark_data_smithi188_134454_object117822:head# 2024-04-01T19:49:03.986 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.986 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:758fec82:::benchmark_data_smithi188_134454_object125227:head# 2024-04-01T19:49:03.986 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.986 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75906724:::benchmark_data_smithi188_134454_object147467:head# 2024-04-01T19:49:03.986 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.986 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:759150bf:::benchmark_data_smithi188_134454_object123808:head# 2024-04-01T19:49:03.987 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.987 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7591c8fc:::benchmark_data_smithi188_134454_object125148:head# 2024-04-01T19:49:03.987 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.987 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:759421e1:::benchmark_data_smithi188_134454_object153797:head# 2024-04-01T19:49:03.987 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.987 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7597a7c4:::benchmark_data_smithi188_134454_object149566:head# 2024-04-01T19:49:03.987 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.987 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:759d2ee2:::benchmark_data_smithi188_134454_object135193:head# 2024-04-01T19:49:03.987 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.987 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:759d658c:::benchmark_data_smithi188_134454_object120450:head# 2024-04-01T19:49:03.987 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.987 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:759ded60:::benchmark_data_smithi188_134454_object131012:head# 2024-04-01T19:49:03.987 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.987 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:759e6154:::benchmark_data_smithi188_134454_object140016:head# 2024-04-01T19:49:03.987 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.988 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:759fe164:::benchmark_data_smithi188_134454_object151805:head# 2024-04-01T19:49:03.988 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.988 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75a1adf8:::benchmark_data_smithi188_134454_object116652:head# 2024-04-01T19:49:03.988 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.988 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75a520a0:::benchmark_data_smithi188_134454_object154543:head# 2024-04-01T19:49:03.988 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.988 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75a5f1c9:::benchmark_data_smithi188_134454_object128774:head# 2024-04-01T19:49:03.988 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.988 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75ab1955:::benchmark_data_smithi188_134454_object134766:head# 2024-04-01T19:49:03.988 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.988 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75ab8faa:::benchmark_data_smithi188_134454_object125592:head# 2024-04-01T19:49:03.988 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.988 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75acae49:::benchmark_data_smithi188_134454_object156702:head# 2024-04-01T19:49:03.988 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.989 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75ae34d7:::benchmark_data_smithi188_134454_object118909:head# 2024-04-01T19:49:03.989 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.989 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75af7579:::benchmark_data_smithi188_134454_object142630:head# 2024-04-01T19:49:03.989 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.989 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75b21db3:::benchmark_data_smithi188_134454_object126688:head# 2024-04-01T19:49:03.989 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.989 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75b41be4:::benchmark_data_smithi188_134454_object130297:head# 2024-04-01T19:49:03.989 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.989 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75b4b106:::benchmark_data_smithi188_134454_object117883:head# 2024-04-01T19:49:03.989 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.989 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75b63760:::benchmark_data_smithi188_134454_object128876:head# 2024-04-01T19:49:03.989 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.990 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75bae730:::benchmark_data_smithi188_134454_object122163:head# 2024-04-01T19:49:03.990 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.990 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75bb7510:::benchmark_data_smithi188_134454_object150402:head# 2024-04-01T19:49:03.991 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.991 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75c064fa:::benchmark_data_smithi188_134454_object142380:head# 2024-04-01T19:49:03.991 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.991 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75c3441e:::benchmark_data_smithi188_134454_object116177:head# 2024-04-01T19:49:03.991 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.991 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75c39ab4:::benchmark_data_smithi188_134454_object120475:head# 2024-04-01T19:49:03.991 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.991 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75c60906:::benchmark_data_smithi188_134454_object156628:head# 2024-04-01T19:49:03.991 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.991 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75c62684:::benchmark_data_smithi188_134454_object122862:head# 2024-04-01T19:49:03.991 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.991 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75c7462f:::benchmark_data_smithi188_134454_object148863:head# 2024-04-01T19:49:03.991 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.991 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75c828d1:::benchmark_data_smithi188_134454_object123119:head# 2024-04-01T19:49:03.992 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.992 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75c9dbe2:::benchmark_data_smithi188_134454_object115802:head# 2024-04-01T19:49:03.992 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.992 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75ca3e11:::benchmark_data_smithi188_134454_object125781:head# 2024-04-01T19:49:03.992 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.992 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75ceac87:::benchmark_data_smithi188_134454_object138976:head# 2024-04-01T19:49:03.992 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.992 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75d1662c:::benchmark_data_smithi188_134454_object122075:head# 2024-04-01T19:49:03.992 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.992 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75d2a2b5:::benchmark_data_smithi188_134454_object142245:head# 2024-04-01T19:49:03.992 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.992 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75d3662d:::benchmark_data_smithi188_134454_object137246:head# 2024-04-01T19:49:03.992 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.992 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75d3c1b2:::benchmark_data_smithi188_134454_object149483:head# 2024-04-01T19:49:03.992 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.994 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75d690a8:::benchmark_data_smithi188_134454_object138323:head# 2024-04-01T19:49:03.994 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.994 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75d9bcef:::benchmark_data_smithi188_134454_object142393:head# 2024-04-01T19:49:03.994 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.994 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75da8b37:::benchmark_data_smithi188_134454_object120857:head# 2024-04-01T19:49:03.994 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.994 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75dbdacc:::benchmark_data_smithi188_134454_object119649:head# 2024-04-01T19:49:03.994 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.994 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75de0708:::benchmark_data_smithi188_134454_object152815:head# 2024-04-01T19:49:03.995 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.995 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75de778f:::benchmark_data_smithi188_134454_object144645:head# 2024-04-01T19:49:03.995 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.995 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75e1390f:::benchmark_data_smithi188_134454_object133030:head# 2024-04-01T19:49:03.995 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.995 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75e59bfe:::benchmark_data_smithi188_134454_object124604:head# 2024-04-01T19:49:03.995 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.995 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75e5c07d:::benchmark_data_smithi188_134454_object129501:head# 2024-04-01T19:49:03.995 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.995 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75e6cbb2:::benchmark_data_smithi188_134454_object125710:head# 2024-04-01T19:49:03.995 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.995 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75ec0890:::benchmark_data_smithi188_134454_object118588:head# 2024-04-01T19:49:03.995 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.996 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75ed70c8:::benchmark_data_smithi188_134454_object129521:head# 2024-04-01T19:49:03.996 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.996 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75eef6ae:::benchmark_data_smithi188_134454_object147585:head# 2024-04-01T19:49:03.996 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.996 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75efa1f2:::benchmark_data_smithi188_134454_object138995:head# 2024-04-01T19:49:03.996 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.996 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75f65bd7:::benchmark_data_smithi188_134454_object125321:head# 2024-04-01T19:49:03.996 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.996 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75f69bb8:::benchmark_data_smithi188_134454_object128219:head# 2024-04-01T19:49:03.996 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.996 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75f6c0e0:::benchmark_data_smithi188_134454_object144938:head# 2024-04-01T19:49:03.996 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.996 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75f6f112:::benchmark_data_smithi188_134454_object122986:head# 2024-04-01T19:49:03.996 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.997 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75f8c598:::benchmark_data_smithi188_134454_object140724:head# 2024-04-01T19:49:03.997 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.997 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75f8f536:::benchmark_data_smithi188_134454_object135767:head# 2024-04-01T19:49:03.997 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.997 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75f993f3:::benchmark_data_smithi188_134454_object118662:head# 2024-04-01T19:49:03.997 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.998 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75fa396d:::benchmark_data_smithi188_134454_object116423:head# 2024-04-01T19:49:03.998 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.998 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75fc427d:::benchmark_data_smithi188_134454_object151767:head# 2024-04-01T19:49:03.998 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.998 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75fd4d46:::benchmark_data_smithi188_134454_object148698:head# 2024-04-01T19:49:03.998 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.999 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75fd89d2:::benchmark_data_smithi188_134454_object119884:head# 2024-04-01T19:49:03.999 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:03.999 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75ff38a5:::benchmark_data_smithi188_134454_object139756:head# 2024-04-01T19:49:04.000 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.000 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:75ff66af:::benchmark_data_smithi188_134454_object146433:head# 2024-04-01T19:49:04.000 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.000 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76054dfe:::benchmark_data_smithi188_134454_object137243:head# 2024-04-01T19:49:04.000 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.001 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7605bf55:::benchmark_data_smithi188_134454_object133360:head# 2024-04-01T19:49:04.001 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.001 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76065fcb:::benchmark_data_smithi188_134454_object152290:head# 2024-04-01T19:49:04.001 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.001 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76066db6:::benchmark_data_smithi188_134454_object118180:head# 2024-04-01T19:49:04.001 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.001 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76074cfb:::benchmark_data_smithi188_134454_object135140:head# 2024-04-01T19:49:04.001 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.002 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:760817e8:::benchmark_data_smithi188_134454_object129123:head# 2024-04-01T19:49:04.002 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.007 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76089036:::benchmark_data_smithi188_134454_object147287:head# 2024-04-01T19:49:04.007 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.008 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:760922e5:::benchmark_data_smithi188_134454_object118780:head# 2024-04-01T19:49:04.008 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.008 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:760b6809:::benchmark_data_smithi188_134454_object140744:head# 2024-04-01T19:49:04.008 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.009 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:760c53e0:::benchmark_data_smithi188_134454_object124527:head# 2024-04-01T19:49:04.009 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.009 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:760d48de:::benchmark_data_smithi188_134454_object138211:head# 2024-04-01T19:49:04.009 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.009 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:760df997:::benchmark_data_smithi188_134454_object150048:head# 2024-04-01T19:49:04.009 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.010 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7610503f:::benchmark_data_smithi188_134454_object150905:head# 2024-04-01T19:49:04.010 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.010 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76108256:::benchmark_data_smithi188_134454_object131650:head# 2024-04-01T19:49:04.010 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.010 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76127234:::benchmark_data_smithi188_134454_object137177:head# 2024-04-01T19:49:04.010 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.013 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:04.014 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76132150:::benchmark_data_smithi188_134454_object145938:head# 2024-04-01T19:49:04.014 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.015 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76147122:::benchmark_data_smithi188_134454_object131178:head# 2024-04-01T19:49:04.015 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.016 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7616d65f:::benchmark_data_smithi188_134454_object127003:head# 2024-04-01T19:49:04.016 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.016 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7616e1e0:::benchmark_data_smithi188_134454_object143792:head# 2024-04-01T19:49:04.016 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.019 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76178c7e:::benchmark_data_smithi188_134454_object131229:head# 2024-04-01T19:49:04.019 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.019 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7617e4c8:::benchmark_data_smithi188_134454_object142724:head# 2024-04-01T19:49:04.019 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.019 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76198df9:::benchmark_data_smithi188_134454_object128605:head# 2024-04-01T19:49:04.019 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.019 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:761a61c9:::benchmark_data_smithi188_134454_object116826:head# 2024-04-01T19:49:04.019 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.019 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76226443:::benchmark_data_smithi188_134454_object153057:head# 2024-04-01T19:49:04.019 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.019 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76227b74:::benchmark_data_smithi188_134454_object118722:head# 2024-04-01T19:49:04.019 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.020 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7622e608:::benchmark_data_smithi188_134454_object149524:head# 2024-04-01T19:49:04.020 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.020 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76237f05:::benchmark_data_smithi188_134454_object126495:head# 2024-04-01T19:49:04.020 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.020 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76248d5e:::benchmark_data_smithi188_134454_object118233:head# 2024-04-01T19:49:04.020 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.020 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7624e351:::benchmark_data_smithi188_134454_object148059:head# 2024-04-01T19:49:04.020 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.020 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:762924c6:::benchmark_data_smithi188_134454_object136292:head# 2024-04-01T19:49:04.020 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.021 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7629564d:::benchmark_data_smithi188_134454_object117525:head# 2024-04-01T19:49:04.021 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.021 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:762a95fc:::benchmark_data_smithi188_134454_object116358:head# 2024-04-01T19:49:04.021 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.021 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:762b1a89:::benchmark_data_smithi188_134454_object119713:head# 2024-04-01T19:49:04.021 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.021 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:762c9ecc:::benchmark_data_smithi188_134454_object155807:head# 2024-04-01T19:49:04.022 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.022 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:762db681:::benchmark_data_smithi188_134454_object149031:head# 2024-04-01T19:49:04.022 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.022 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:762e6f3d:::benchmark_data_smithi188_134454_object147355:head# 2024-04-01T19:49:04.022 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.022 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:762eda6b:::benchmark_data_smithi188_134454_object116025:head# 2024-04-01T19:49:04.022 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.022 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:762f1101:::benchmark_data_smithi188_134454_object126830:head# 2024-04-01T19:49:04.025 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.025 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76310212:::benchmark_data_smithi188_134454_object145233:head# 2024-04-01T19:49:04.025 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.026 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7633dcea:::benchmark_data_smithi188_134454_object131321:head# 2024-04-01T19:49:04.026 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.026 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76343cb4:::benchmark_data_smithi188_134454_object142963:head# 2024-04-01T19:49:04.027 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.027 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7634a245:::benchmark_data_smithi188_134454_object154714:head# 2024-04-01T19:49:04.027 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.027 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7635a529:::benchmark_data_smithi188_134454_object145612:head# 2024-04-01T19:49:04.027 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.027 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7637760a:::benchmark_data_smithi188_134454_object130200:head# 2024-04-01T19:49:04.027 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.027 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76378ff3:::benchmark_data_smithi188_134454_object125481:head# 2024-04-01T19:49:04.027 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.027 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:763a3893:::benchmark_data_smithi188_134454_object137699:head# 2024-04-01T19:49:04.027 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.027 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:763a7a71:::benchmark_data_smithi188_134454_object140489:head# 2024-04-01T19:49:04.027 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.028 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:763b1ad0:::benchmark_data_smithi188_134454_object119934:head# 2024-04-01T19:49:04.028 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.028 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:763c430c:::benchmark_data_smithi188_134454_object155480:head# 2024-04-01T19:49:04.028 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.028 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:763d6e2b:::benchmark_data_smithi188_134454_object142685:head# 2024-04-01T19:49:04.028 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.028 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:763dad94:::benchmark_data_smithi188_134454_object137692:head# 2024-04-01T19:49:04.028 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.028 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:763dd634:::benchmark_data_smithi188_134454_object121574:head# 2024-04-01T19:49:04.028 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.028 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:763df741:::benchmark_data_smithi188_134454_object147332:head# 2024-04-01T19:49:04.028 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.029 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76406f88:::benchmark_data_smithi188_134454_object148054:head# 2024-04-01T19:49:04.029 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.029 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7643793f:::benchmark_data_smithi188_134454_object134949:head# 2024-04-01T19:49:04.029 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.029 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7643f1b6:::benchmark_data_smithi188_134454_object140247:head# 2024-04-01T19:49:04.029 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.029 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7644fa1d:::benchmark_data_smithi188_134454_object131963:head# 2024-04-01T19:49:04.029 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.029 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:764653e1:::benchmark_data_smithi188_134454_object115520:head# 2024-04-01T19:49:04.029 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.030 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76466006:::benchmark_data_smithi188_134454_object150719:head# 2024-04-01T19:49:04.030 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.033 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7646c60d:::benchmark_data_smithi188_134454_object139065:head# 2024-04-01T19:49:04.033 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.034 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76492d59:::benchmark_data_smithi188_134454_object143743:head# 2024-04-01T19:49:04.034 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.034 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:764a9476:::benchmark_data_smithi188_134454_object137667:head# 2024-04-01T19:49:04.034 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.034 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:764b0bb2:::benchmark_data_smithi188_134454_object140399:head# 2024-04-01T19:49:04.034 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.034 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:764b548f:::benchmark_data_smithi188_134454_object141048:head# 2024-04-01T19:49:04.034 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.034 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:764c9211:::benchmark_data_smithi188_134454_object150254:head# 2024-04-01T19:49:04.034 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.034 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:764ca32e:::benchmark_data_smithi188_134454_object139033:head# 2024-04-01T19:49:04.034 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.034 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:764fa6e2:::benchmark_data_smithi188_134454_object116395:head# 2024-04-01T19:49:04.035 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.035 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:765086b8:::benchmark_data_smithi188_134454_object147734:head# 2024-04-01T19:49:04.035 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.035 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76515622:::benchmark_data_smithi188_134454_object127264:head# 2024-04-01T19:49:04.035 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.035 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7651d25e:::benchmark_data_smithi188_134454_object136095:head# 2024-04-01T19:49:04.035 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.035 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7652cc10:::benchmark_data_smithi188_134454_object119656:head# 2024-04-01T19:49:04.035 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.035 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7655ea52:::benchmark_data_smithi188_134454_object137551:head# 2024-04-01T19:49:04.035 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.035 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:765bf2cd:::benchmark_data_smithi188_134454_object130175:head# 2024-04-01T19:49:04.035 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.035 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:765d0254:::benchmark_data_smithi188_134454_object149395:head# 2024-04-01T19:49:04.035 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.036 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:765ef7ae:::benchmark_data_smithi188_134454_object130252:head# 2024-04-01T19:49:04.036 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.036 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:765f3fc6:::benchmark_data_smithi188_134454_object118865:head# 2024-04-01T19:49:04.036 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.036 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:765fd09c:::benchmark_data_smithi188_134454_object126973:head# 2024-04-01T19:49:04.036 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.036 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76625d8b:::benchmark_data_smithi188_134454_object147120:head# 2024-04-01T19:49:04.036 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.036 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76633182:::benchmark_data_smithi188_134454_object129342:head# 2024-04-01T19:49:04.036 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.036 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:766538ee:::benchmark_data_smithi188_134454_object123161:head# 2024-04-01T19:49:04.036 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.037 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76665c31:::benchmark_data_smithi188_134454_object115972:head# 2024-04-01T19:49:04.037 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.039 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76666679:::benchmark_data_smithi188_134454_object147654:head# 2024-04-01T19:49:04.039 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.039 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7666cd23:::benchmark_data_smithi188_134454_object145777:head# 2024-04-01T19:49:04.039 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.039 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7666d1bd:::benchmark_data_smithi188_134454_object149168:head# 2024-04-01T19:49:04.039 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.039 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7666e995:::benchmark_data_smithi188_134454_object117346:head# 2024-04-01T19:49:04.040 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.040 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76676871:::benchmark_data_smithi188_134454_object152914:head# 2024-04-01T19:49:04.040 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.040 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7667d08f:::benchmark_data_smithi188_134454_object133452:head# 2024-04-01T19:49:04.040 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.040 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76681f55:::benchmark_data_smithi188_134454_object138802:head# 2024-04-01T19:49:04.040 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.040 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:766a4695:::benchmark_data_smithi188_134454_object145526:head# 2024-04-01T19:49:04.040 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.040 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:766c18e4:::benchmark_data_smithi188_134454_object150043:head# 2024-04-01T19:49:04.040 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.040 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:766e6029:::benchmark_data_smithi188_134454_object139672:head# 2024-04-01T19:49:04.040 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.041 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:766e62be:::benchmark_data_smithi188_134454_object141531:head# 2024-04-01T19:49:04.041 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.041 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:766f1ccf:::benchmark_data_smithi188_134454_object147301:head# 2024-04-01T19:49:04.041 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.041 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76717088:::benchmark_data_smithi188_134454_object149529:head# 2024-04-01T19:49:04.041 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.041 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76727c5c:::benchmark_data_smithi188_134454_object122309:head# 2024-04-01T19:49:04.041 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.041 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7673ecbe:::benchmark_data_smithi188_134454_object152749:head# 2024-04-01T19:49:04.041 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.041 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76740051:::benchmark_data_smithi188_134454_object125849:head# 2024-04-01T19:49:04.041 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.041 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7674045a:::benchmark_data_smithi188_134454_object146601:head# 2024-04-01T19:49:04.041 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.042 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7678eff0:::benchmark_data_smithi188_134454_object142643:head# 2024-04-01T19:49:04.042 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.051 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7679114d:::benchmark_data_smithi188_134454_object122824:head# 2024-04-01T19:49:04.051 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.051 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76798efe:::benchmark_data_smithi188_134454_object136299:head# 2024-04-01T19:49:04.051 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.051 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:767aa68d:::benchmark_data_smithi188_134454_object117031:head# 2024-04-01T19:49:04.051 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.051 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:767aea5b:::benchmark_data_smithi188_134454_object119953:head# 2024-04-01T19:49:04.051 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.051 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:767f0996:::benchmark_data_smithi188_134454_object119338:head# 2024-04-01T19:49:04.052 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.052 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:767f578f:::benchmark_data_smithi188_134454_object129758:head# 2024-04-01T19:49:04.052 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.052 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76852849:::benchmark_data_smithi188_134454_object125121:head# 2024-04-01T19:49:04.052 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.052 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76859078:::benchmark_data_smithi188_134454_object140299:head# 2024-04-01T19:49:04.052 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.052 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76865a1d:::benchmark_data_smithi188_134454_object122854:head# 2024-04-01T19:49:04.052 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.052 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7687ea9c:::benchmark_data_smithi188_134454_object120309:head# 2024-04-01T19:49:04.052 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.052 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7687fba6:::benchmark_data_smithi188_134454_object140566:head# 2024-04-01T19:49:04.052 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.053 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76882be1:::benchmark_data_smithi188_134454_object128381:head# 2024-04-01T19:49:04.053 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.053 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:768d5750:::benchmark_data_smithi188_134454_object137464:head# 2024-04-01T19:49:04.053 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.053 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7692544c:::benchmark_data_smithi188_134454_object130862:head# 2024-04-01T19:49:04.053 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.054 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7693088e:::benchmark_data_smithi188_134454_object136033:head# 2024-04-01T19:49:04.054 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.055 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76945600:::benchmark_data_smithi188_134454_object138244:head# 2024-04-01T19:49:04.055 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.059 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7694ac17:::benchmark_data_smithi188_134454_object121201:head# 2024-04-01T19:49:04.059 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.059 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76968a41:::benchmark_data_smithi188_134454_object146160:head# 2024-04-01T19:49:04.059 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.059 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76973c4b:::benchmark_data_smithi188_134454_object119339:head# 2024-04-01T19:49:04.059 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.059 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76981dde:::benchmark_data_smithi188_134454_object148430:head# 2024-04-01T19:49:04.059 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.059 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:769930dd:::benchmark_data_smithi188_134454_object149738:head# 2024-04-01T19:49:04.060 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.060 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:769a6b89:::benchmark_data_smithi188_134454_object133101:head# 2024-04-01T19:49:04.060 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.060 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:769b39ac:::benchmark_data_smithi188_134454_object142723:head# 2024-04-01T19:49:04.060 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.060 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:769b6974:::benchmark_data_smithi188_134454_object123854:head# 2024-04-01T19:49:04.060 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.060 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:769c64d7:::benchmark_data_smithi188_134454_object155370:head# 2024-04-01T19:49:04.060 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.060 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:769cc4bc:::benchmark_data_smithi188_134454_object132669:head# 2024-04-01T19:49:04.060 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.060 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:769db433:::benchmark_data_smithi188_134454_object144595:head# 2024-04-01T19:49:04.060 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.060 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76a1bb5f:::benchmark_data_smithi188_134454_object129892:head# 2024-04-01T19:49:04.061 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.061 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76a89c83:::benchmark_data_smithi188_134454_object153042:head# 2024-04-01T19:49:04.061 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.061 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76aa4605:::benchmark_data_smithi188_134454_object148238:head# 2024-04-01T19:49:04.061 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.061 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76b0a420:::benchmark_data_smithi188_134454_object119330:head# 2024-04-01T19:49:04.061 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.062 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76b0c630:::benchmark_data_smithi188_134454_object116332:head# 2024-04-01T19:49:04.062 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.062 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76b14a39:::benchmark_data_smithi188_134454_object116456:head# 2024-04-01T19:49:04.062 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.063 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76b14a7a:::benchmark_data_smithi188_134454_object156248:head# 2024-04-01T19:49:04.063 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.063 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76b3261f:::benchmark_data_smithi188_134454_object138528:head# 2024-04-01T19:49:04.063 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.063 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76b37dff:::benchmark_data_smithi188_134454_object155912:head# 2024-04-01T19:49:04.064 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.064 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76b9bcaf:::benchmark_data_smithi188_134454_object135287:head# 2024-04-01T19:49:04.064 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.064 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76bc0ce2:::benchmark_data_smithi188_134454_object147554:head# 2024-04-01T19:49:04.064 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.065 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76bc5e28:::benchmark_data_smithi188_134454_object152867:head# 2024-04-01T19:49:04.065 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.070 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76bd53e7:::benchmark_data_smithi188_134454_object149382:head# 2024-04-01T19:49:04.070 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.070 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76bdd8b6:::benchmark_data_smithi188_134454_object147337:head# 2024-04-01T19:49:04.070 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.070 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76c3d2ef:::benchmark_data_smithi188_134454_object133430:head# 2024-04-01T19:49:04.070 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.071 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76c526b8:::benchmark_data_smithi188_134454_object155106:head# 2024-04-01T19:49:04.071 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.071 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76c561c4:::benchmark_data_smithi188_134454_object132762:head# 2024-04-01T19:49:04.071 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.071 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76c61e25:::benchmark_data_smithi188_134454_object116506:head# 2024-04-01T19:49:04.071 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.071 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76c73860:::benchmark_data_smithi188_134454_object115860:head# 2024-04-01T19:49:04.071 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.071 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76c8bbf2:::benchmark_data_smithi188_134454_object147899:head# 2024-04-01T19:49:04.071 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.071 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76c8d2df:::benchmark_data_smithi188_134454_object127393:head# 2024-04-01T19:49:04.071 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.072 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76c9e15b:::benchmark_data_smithi188_134454_object150044:head# 2024-04-01T19:49:04.072 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.072 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76caa3dc:::benchmark_data_smithi188_134454_object136238:head# 2024-04-01T19:49:04.072 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.072 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76cc53c0:::benchmark_data_smithi188_134454_object119139:head# 2024-04-01T19:49:04.072 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.072 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76cc6571:::benchmark_data_smithi188_134454_object137673:head# 2024-04-01T19:49:04.072 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.072 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76cc85fb:::benchmark_data_smithi188_134454_object136069:head# 2024-04-01T19:49:04.072 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.073 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76cf7931:::benchmark_data_smithi188_134454_object144107:head# 2024-04-01T19:49:04.073 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.073 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76d3f4c9:::benchmark_data_smithi188_134454_object119510:head# 2024-04-01T19:49:04.073 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.074 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76d6f87d:::benchmark_data_smithi188_134454_object140935:head# 2024-04-01T19:49:04.074 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.074 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76d7e785:::benchmark_data_smithi188_134454_object128885:head# 2024-04-01T19:49:04.075 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.075 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76d9177b:::benchmark_data_smithi188_134454_object146611:head# 2024-04-01T19:49:04.075 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.075 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76d9bf03:::benchmark_data_smithi188_134454_object124682:head# 2024-04-01T19:49:04.075 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.076 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76da07d6:::benchmark_data_smithi188_134454_object152138:head# 2024-04-01T19:49:04.076 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.076 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76dbb4e4:::benchmark_data_smithi188_134454_object141373:head# 2024-04-01T19:49:04.076 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76dfa730:::benchmark_data_smithi188_134454_object147509:head# 2024-04-01T19:49:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76e0ed9e:::benchmark_data_smithi188_134454_object122672:head# 2024-04-01T19:49:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76e184f1:::benchmark_data_smithi188_134454_object140245:head# 2024-04-01T19:49:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76e76031:::benchmark_data_smithi188_134454_object123899:head# 2024-04-01T19:49:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76e82aa9:::benchmark_data_smithi188_134454_object140832:head# 2024-04-01T19:49:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76eb097e:::benchmark_data_smithi188_134454_object149966:head# 2024-04-01T19:49:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.080 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76ebc338:::benchmark_data_smithi188_134454_object152601:head# 2024-04-01T19:49:04.080 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.080 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76ec3fc3:::benchmark_data_smithi188_134454_object127190:head# 2024-04-01T19:49:04.080 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.080 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76ec89c8:::benchmark_data_smithi188_134454_object127763:head# 2024-04-01T19:49:04.080 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.080 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76ecb16e:::benchmark_data_smithi188_134454_object142866:head# 2024-04-01T19:49:04.080 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.080 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76ed1f9a:::benchmark_data_smithi188_134454_object133361:head# 2024-04-01T19:49:04.081 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.081 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76edb71f:::benchmark_data_smithi188_134454_object146022:head# 2024-04-01T19:49:04.081 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.081 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76ef63e6:::benchmark_data_smithi188_134454_object120118:head# 2024-04-01T19:49:04.081 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.081 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76f168ce:::benchmark_data_smithi188_134454_object153858:head# 2024-04-01T19:49:04.081 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.081 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76f20639:::benchmark_data_smithi188_134454_object115935:head# 2024-04-01T19:49:04.081 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.081 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76f4ebc3:::benchmark_data_smithi188_134454_object131208:head# 2024-04-01T19:49:04.081 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.081 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76f7e081:::benchmark_data_smithi188_134454_object126198:head# 2024-04-01T19:49:04.081 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.081 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76f8fa7f:::benchmark_data_smithi188_134454_object144139:head# 2024-04-01T19:49:04.082 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.082 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76faa846:::benchmark_data_smithi188_134454_object131670:head# 2024-04-01T19:49:04.082 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.082 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:76fabb9c:::benchmark_data_smithi188_134454_object145439:head# 2024-04-01T19:49:04.082 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.082 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7700ce9a:::benchmark_data_smithi188_134454_object152098:head# 2024-04-01T19:49:04.083 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.083 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:770914e0:::benchmark_data_smithi188_134454_object149001:head# 2024-04-01T19:49:04.083 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.086 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:770cef9a:::benchmark_data_smithi188_134454_object139855:head# 2024-04-01T19:49:04.086 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.086 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:770f2983:::benchmark_data_smithi188_134454_object119914:head# 2024-04-01T19:49:04.086 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.086 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7712392e:::benchmark_data_smithi188_134454_object118349:head# 2024-04-01T19:49:04.087 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.087 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7712f3b6:::benchmark_data_smithi188_134454_object121258:head# 2024-04-01T19:49:04.087 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.087 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:771366dc:::benchmark_data_smithi188_134454_object116150:head# 2024-04-01T19:49:04.087 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.087 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7713707c:::benchmark_data_smithi188_134454_object145932:head# 2024-04-01T19:49:04.087 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.087 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7713a537:::benchmark_data_smithi188_134454_object135237:head# 2024-04-01T19:49:04.087 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.087 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7713fbd5:::benchmark_data_smithi188_134454_object118427:head# 2024-04-01T19:49:04.087 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.087 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7715a4f7:::benchmark_data_smithi188_134454_object130708:head# 2024-04-01T19:49:04.087 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.087 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77179d28:::benchmark_data_smithi188_134454_object137808:head# 2024-04-01T19:49:04.087 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.088 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7717bac2:::benchmark_data_smithi188_134454_object131578:head# 2024-04-01T19:49:04.088 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.088 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7719cee0:::benchmark_data_smithi188_134454_object130058:head# 2024-04-01T19:49:04.088 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.088 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:771bd25e:::benchmark_data_smithi188_134454_object124839:head# 2024-04-01T19:49:04.088 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.088 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:771c373d:::benchmark_data_smithi188_134454_object149986:head# 2024-04-01T19:49:04.088 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.088 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:771cb85a:::benchmark_data_smithi188_134454_object155436:head# 2024-04-01T19:49:04.088 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.090 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:771dcb78:::benchmark_data_smithi188_134454_object148788:head# 2024-04-01T19:49:04.090 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.090 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:771fdf8a:::benchmark_data_smithi188_134454_object142444:head# 2024-04-01T19:49:04.090 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.090 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77205c36:::benchmark_data_smithi188_134454_object140065:head# 2024-04-01T19:49:04.090 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.090 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:772258fb:::benchmark_data_smithi188_134454_object131538:head# 2024-04-01T19:49:04.090 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.090 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7723ff7d:::benchmark_data_smithi188_134454_object129746:head# 2024-04-01T19:49:04.090 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.091 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7727ee56:::benchmark_data_smithi188_134454_object148960:head# 2024-04-01T19:49:04.091 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.091 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:772897e2:::benchmark_data_smithi188_134454_object149233:head# 2024-04-01T19:49:04.091 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.091 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:772c5999:::benchmark_data_smithi188_134454_object132423:head# 2024-04-01T19:49:04.091 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.091 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:772d85dc:::benchmark_data_smithi188_134454_object126595:head# 2024-04-01T19:49:04.091 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.091 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7730a5ef:::benchmark_data_smithi188_134454_object125351:head# 2024-04-01T19:49:04.091 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.091 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7730c854:::benchmark_data_smithi188_134454_object122980:head# 2024-04-01T19:49:04.091 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.091 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7730ff63:::benchmark_data_smithi188_134454_object138361:head# 2024-04-01T19:49:04.091 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.093 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:773128f7:::benchmark_data_smithi188_134454_object151258:head# 2024-04-01T19:49:04.093 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.093 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77334771:::benchmark_data_smithi188_134454_object153479:head# 2024-04-01T19:49:04.093 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.093 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:773437f5:::benchmark_data_smithi188_134454_object119840:head# 2024-04-01T19:49:04.093 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.093 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7735b3fb:::benchmark_data_smithi188_134454_object145463:head# 2024-04-01T19:49:04.093 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.094 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7737b09d:::benchmark_data_smithi188_134454_object141337:head# 2024-04-01T19:49:04.094 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.094 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7738d3e4:::benchmark_data_smithi188_134454_object122314:head# 2024-04-01T19:49:04.094 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.094 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:773925ec:::benchmark_data_smithi188_134454_object134097:head# 2024-04-01T19:49:04.094 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.094 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:773ae222:::benchmark_data_smithi188_134454_object150849:head# 2024-04-01T19:49:04.094 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.094 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:773aef1d:::benchmark_data_smithi188_134454_object120131:head# 2024-04-01T19:49:04.094 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.094 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77407d33:::benchmark_data_smithi188_134454_object135365:head# 2024-04-01T19:49:04.094 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.095 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7743decf:::benchmark_data_smithi188_134454_object124553:head# 2024-04-01T19:49:04.095 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.095 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:774552a1:::benchmark_data_smithi188_134454_object151445:head# 2024-04-01T19:49:04.095 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.097 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7745a1a0:::benchmark_data_smithi188_134454_object154690:head# 2024-04-01T19:49:04.097 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.097 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:774601f2:::benchmark_data_smithi188_134454_object153557:head# 2024-04-01T19:49:04.098 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.098 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77464554:::benchmark_data_smithi188_134454_object141254:head# 2024-04-01T19:49:04.098 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.098 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7746bf75:::benchmark_data_smithi188_134454_object141772:head# 2024-04-01T19:49:04.098 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.098 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:774a76cc:::benchmark_data_smithi188_134454_object148605:head# 2024-04-01T19:49:04.098 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.098 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:774a7fe1:::benchmark_data_smithi188_134454_object142310:head# 2024-04-01T19:49:04.098 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.098 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:774dc112:::benchmark_data_smithi188_134454_object131695:head# 2024-04-01T19:49:04.098 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.098 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:774e7a53:::benchmark_data_smithi188_134454_object148325:head# 2024-04-01T19:49:04.099 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.099 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:774fc6ad:::benchmark_data_smithi188_134454_object142253:head# 2024-04-01T19:49:04.099 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.099 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77510db0:::benchmark_data_smithi188_134454_object138215:head# 2024-04-01T19:49:04.099 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.099 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7757ffa4:::benchmark_data_smithi188_134454_object138308:head# 2024-04-01T19:49:04.099 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.099 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:775a6a94:::benchmark_data_smithi188_134454_object151825:head# 2024-04-01T19:49:04.099 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.099 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:775c95cf:::benchmark_data_smithi188_134454_object141449:head# 2024-04-01T19:49:04.099 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.099 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:775d85a9:::benchmark_data_smithi188_134454_object134874:head# 2024-04-01T19:49:04.099 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.099 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:775da53a:::benchmark_data_smithi188_134454_object130669:head# 2024-04-01T19:49:04.100 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.100 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:775f6079:::benchmark_data_smithi188_134454_object137992:head# 2024-04-01T19:49:04.100 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.104 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:775f7d0b:::benchmark_data_smithi188_134454_object119936:head# 2024-04-01T19:49:04.104 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.104 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77633627:::benchmark_data_smithi188_134454_object154316:head# 2024-04-01T19:49:04.104 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.104 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7764457d:::benchmark_data_smithi188_134454_object143707:head# 2024-04-01T19:49:04.104 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.104 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7764e472:::benchmark_data_smithi188_134454_object149509:head# 2024-04-01T19:49:04.104 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.104 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7765cb7c:::benchmark_data_smithi188_134454_object117928:head# 2024-04-01T19:49:04.104 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.105 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77665414:::benchmark_data_smithi188_134454_object130620:head# 2024-04-01T19:49:04.105 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.105 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7766fbab:::benchmark_data_smithi188_134454_object122694:head# 2024-04-01T19:49:04.105 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.105 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7767e58f:::benchmark_data_smithi188_134454_object119855:head# 2024-04-01T19:49:04.105 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.105 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77685d2c:::benchmark_data_smithi188_134454_object136824:head# 2024-04-01T19:49:04.105 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.105 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:776943cf:::benchmark_data_smithi188_134454_object124655:head# 2024-04-01T19:49:04.105 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.105 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7769a5da:::benchmark_data_smithi188_134454_object134972:head# 2024-04-01T19:49:04.105 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.105 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:776d3d40:::benchmark_data_smithi188_134454_object120738:head# 2024-04-01T19:49:04.105 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.106 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:777178cf:::benchmark_data_smithi188_134454_object149862:head# 2024-04-01T19:49:04.106 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.106 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7773b295:::benchmark_data_smithi188_134454_object147730:head# 2024-04-01T19:49:04.106 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.106 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7776e359:::benchmark_data_smithi188_134454_object152960:head# 2024-04-01T19:49:04.106 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.106 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77774493:::benchmark_data_smithi188_134454_object140200:head# 2024-04-01T19:49:04.106 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.106 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:777af774:::benchmark_data_smithi188_134454_object131566:head# 2024-04-01T19:49:04.106 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.106 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:777c84be:::benchmark_data_smithi188_134454_object124771:head# 2024-04-01T19:49:04.106 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.106 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:777d8310:::benchmark_data_smithi188_134454_object137104:head# 2024-04-01T19:49:04.107 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.107 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:777de855:::benchmark_data_smithi188_134454_object143001:head# 2024-04-01T19:49:04.107 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.107 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:777eb9f9:::benchmark_data_smithi188_134454_object140041:head# 2024-04-01T19:49:04.107 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.107 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:777f4dac:::benchmark_data_smithi188_134454_object120150:head# 2024-04-01T19:49:04.107 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.107 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:777f8d0e:::benchmark_data_smithi188_134454_object129543:head# 2024-04-01T19:49:04.107 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.107 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77801bc1:::benchmark_data_smithi188_134454_object145954:head# 2024-04-01T19:49:04.107 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.110 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:778038a6:::benchmark_data_smithi188_134454_object133815:head# 2024-04-01T19:49:04.110 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.110 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:778776bb:::benchmark_data_smithi188_134454_object137201:head# 2024-04-01T19:49:04.110 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.110 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7788e196:::benchmark_data_smithi188_134454_object133715:head# 2024-04-01T19:49:04.110 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.111 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7789c861:::benchmark_data_smithi188_134454_object144704:head# 2024-04-01T19:49:04.111 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.111 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:778a9819:::benchmark_data_smithi188_134454_object151164:head# 2024-04-01T19:49:04.111 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.111 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:778ba8b9:::benchmark_data_smithi188_134454_object131520:head# 2024-04-01T19:49:04.111 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.111 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:778c3de5:::benchmark_data_smithi188_134454_object121239:head# 2024-04-01T19:49:04.111 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.111 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:778e9de6:::benchmark_data_smithi188_134454_object154867:head# 2024-04-01T19:49:04.111 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.111 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:778fa0fc:::benchmark_data_smithi188_134454_object151700:head# 2024-04-01T19:49:04.111 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.111 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:779107d9:::benchmark_data_smithi188_134454_object131638:head# 2024-04-01T19:49:04.111 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.112 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:779382f3:::benchmark_data_smithi188_134454_object129459:head# 2024-04-01T19:49:04.112 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.112 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77940eff:::benchmark_data_smithi188_134454_object124116:head# 2024-04-01T19:49:04.112 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.112 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77951c69:::benchmark_data_smithi188_134454_object115698:head# 2024-04-01T19:49:04.112 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.112 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7795a651:::benchmark_data_smithi188_134454_object122679:head# 2024-04-01T19:49:04.112 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.112 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77964891:::benchmark_data_smithi188_134454_object119033:head# 2024-04-01T19:49:04.112 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.112 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77977dd2:::benchmark_data_smithi188_134454_object152122:head# 2024-04-01T19:49:04.112 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.112 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77981dc8:::benchmark_data_smithi188_134454_object143499:head# 2024-04-01T19:49:04.113 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.113 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:779cd713:::benchmark_data_smithi188_134454_object156047:head# 2024-04-01T19:49:04.113 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.113 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:779ff35d:::benchmark_data_smithi188_134454_object125831:head# 2024-04-01T19:49:04.113 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.113 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77a084a8:::benchmark_data_smithi188_134454_object148210:head# 2024-04-01T19:49:04.113 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.113 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77a30a03:::benchmark_data_smithi188_134454_object132684:head# 2024-04-01T19:49:04.113 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.113 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77a3598c:::benchmark_data_smithi188_134454_object152271:head# 2024-04-01T19:49:04.113 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.113 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77a4d0c8:::benchmark_data_smithi188_134454_object151058:head# 2024-04-01T19:49:04.113 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.113 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77a7dfdf:::benchmark_data_smithi188_134454_object126867:head# 2024-04-01T19:49:04.114 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.116 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77ab1e15:::benchmark_data_smithi188_134454_object119778:head# 2024-04-01T19:49:04.116 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.116 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77ab9ffd:::benchmark_data_smithi188_134454_object119720:head# 2024-04-01T19:49:04.116 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.116 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77abcc78:::benchmark_data_smithi188_134454_object138034:head# 2024-04-01T19:49:04.116 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.116 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77ac531c:::benchmark_data_smithi188_134454_object150248:head# 2024-04-01T19:49:04.116 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.116 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77ac7083:::benchmark_data_smithi188_134454_object123141:head# 2024-04-01T19:49:04.117 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.117 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77aedb5c:::benchmark_data_smithi188_134454_object133476:head# 2024-04-01T19:49:04.117 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.117 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77af0b91:::benchmark_data_smithi188_134454_object141752:head# 2024-04-01T19:49:04.117 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.117 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77afe39a:::benchmark_data_smithi188_134454_object116961:head# 2024-04-01T19:49:04.117 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.117 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77b02b25:::benchmark_data_smithi188_134454_object156721:head# 2024-04-01T19:49:04.117 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.117 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77b1e11e:::benchmark_data_smithi188_134454_object119230:head# 2024-04-01T19:49:04.117 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.117 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77b2a3a9:::benchmark_data_smithi188_134454_object156220:head# 2024-04-01T19:49:04.117 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.117 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77b5a01f:::benchmark_data_smithi188_134454_object146485:head# 2024-04-01T19:49:04.118 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.118 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77b6b86f:::benchmark_data_smithi188_134454_object129448:head# 2024-04-01T19:49:04.118 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.118 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77ba10b9:::benchmark_data_smithi188_134454_object132520:head# 2024-04-01T19:49:04.118 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.118 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77ba5c0e:::benchmark_data_smithi188_134454_object140508:head# 2024-04-01T19:49:04.118 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.118 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77bcd6e4:::benchmark_data_smithi188_134454_object141056:head# 2024-04-01T19:49:04.118 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.118 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77be41e8:::benchmark_data_smithi188_134454_object116407:head# 2024-04-01T19:49:04.118 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.118 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77bea8cd:::benchmark_data_smithi188_134454_object115435:head# 2024-04-01T19:49:04.119 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.119 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77c0893e:::benchmark_data_smithi188_134454_object134822:head# 2024-04-01T19:49:04.119 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.119 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77c1bc94:::benchmark_data_smithi188_134454_object151082:head# 2024-04-01T19:49:04.119 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.119 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77c415e3:::benchmark_data_smithi188_134454_object131444:head# 2024-04-01T19:49:04.120 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.120 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77c4df8a:::benchmark_data_smithi188_134454_object145293:head# 2024-04-01T19:49:04.120 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.120 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77c7ad38:::benchmark_data_smithi188_134454_object143288:head# 2024-04-01T19:49:04.120 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.120 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77ca803a:::benchmark_data_smithi188_134454_object151282:head# 2024-04-01T19:49:04.120 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.121 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77cb2ea7:::benchmark_data_smithi188_134454_object121249:head# 2024-04-01T19:49:04.121 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.122 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77cfb7f4:::benchmark_data_smithi188_134454_object136581:head# 2024-04-01T19:49:04.122 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.122 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77d05774:::benchmark_data_smithi188_134454_object148009:head# 2024-04-01T19:49:04.122 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:03 smithi188 ceph-mon[43939]: pgmap v1517: 17 pgs: 17 active+clean; 839 MiB data, 6.0 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 958 op/s 2024-04-01T19:49:04.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:03 smithi188 ceph-mon[43939]: 6.b scrub starts 2024-04-01T19:49:04.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:03 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/440528876' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:49:04.128 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77d085db:::benchmark_data_smithi188_134454_object147030:head# 2024-04-01T19:49:04.128 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.128 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77d2a782:::benchmark_data_smithi188_134454_object152699:head# 2024-04-01T19:49:04.128 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.133 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77d4908e:::benchmark_data_smithi188_134454_object119196:head# 2024-04-01T19:49:04.133 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.136 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77d51c49:::benchmark_data_smithi188_134454_object134662:head# 2024-04-01T19:49:04.136 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.136 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77d5ea28:::benchmark_data_smithi188_134454_object134038:head# 2024-04-01T19:49:04.136 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.138 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77d6910a:::benchmark_data_smithi188_134454_object130740:head# 2024-04-01T19:49:04.138 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.138 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77d6b6ce:::benchmark_data_smithi188_134454_object138580:head# 2024-04-01T19:49:04.138 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.138 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77d828ef:::benchmark_data_smithi188_134454_object156274:head# 2024-04-01T19:49:04.138 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.138 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77d9a2bb:::benchmark_data_smithi188_134454_object153300:head# 2024-04-01T19:49:04.138 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.138 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77de7141:::benchmark_data_smithi188_134454_object122181:head# 2024-04-01T19:49:04.138 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.138 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77de9116:::benchmark_data_smithi188_134454_object116059:head# 2024-04-01T19:49:04.139 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.139 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77de992c:::benchmark_data_smithi188_134454_object122527:head# 2024-04-01T19:49:04.139 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.139 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77e0ddd6:::benchmark_data_smithi188_134454_object147261:head# 2024-04-01T19:49:04.140 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.140 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77e27995:::benchmark_data_smithi188_134454_object136716:head# 2024-04-01T19:49:04.140 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.140 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77e44b78:::benchmark_data_smithi188_134454_object148868:head# 2024-04-01T19:49:04.140 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.143 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77e49f3c:::benchmark_data_smithi188_134454_object135879:head# 2024-04-01T19:49:04.143 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.144 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77e4e260:::benchmark_data_smithi188_134454_object127893:head# 2024-04-01T19:49:04.144 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.144 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77e55e53:::benchmark_data_smithi188_134454_object117204:head# 2024-04-01T19:49:04.144 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.144 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77e567dc:::benchmark_data_smithi188_134454_object116405:head# 2024-04-01T19:49:04.144 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.144 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77e57357:::benchmark_data_smithi188_134454_object125571:head# 2024-04-01T19:49:04.144 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.148 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77e7e9f4:::benchmark_data_smithi188_134454_object121770:head# 2024-04-01T19:49:04.148 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.149 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77e91f1f:::benchmark_data_smithi188_134454_object131329:head# 2024-04-01T19:49:04.149 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.149 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77ea4140:::benchmark_data_smithi188_134454_object150450:head# 2024-04-01T19:49:04.149 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.150 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77efb322:::benchmark_data_smithi188_134454_object121028:head# 2024-04-01T19:49:04.150 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.150 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77f29c65:::benchmark_data_smithi188_134454_object143646:head# 2024-04-01T19:49:04.150 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.150 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77f46bc7:::benchmark_data_smithi188_134454_object134638:head# 2024-04-01T19:49:04.151 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.151 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77f50293:::benchmark_data_smithi188_134454_object123633:head# 2024-04-01T19:49:04.151 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.151 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77f65363:::benchmark_data_smithi188_134454_object137254:head# 2024-04-01T19:49:04.151 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.151 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77f89138:::benchmark_data_smithi188_134454_object116394:head# 2024-04-01T19:49:04.151 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.152 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77f985f3:::benchmark_data_smithi188_134454_object132075:head# 2024-04-01T19:49:04.152 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.152 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77ff3f6a:::benchmark_data_smithi188_134454_object127659:head# 2024-04-01T19:49:04.152 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.152 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:77ff5e31:::benchmark_data_smithi188_134454_object132742:head# 2024-04-01T19:49:04.152 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.152 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78000c35:::benchmark_data_smithi188_134454_object139004:head# 2024-04-01T19:49:04.153 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.153 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7804ffdf:::benchmark_data_smithi188_134454_object144574:head# 2024-04-01T19:49:04.153 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.154 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78050207:::benchmark_data_smithi188_134454_object135873:head# 2024-04-01T19:49:04.154 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.154 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78068ded:::benchmark_data_smithi188_134454_object147304:head# 2024-04-01T19:49:04.154 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.154 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:780ac651:::benchmark_data_smithi188_134454_object149055:head# 2024-04-01T19:49:04.154 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.154 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:780bd2eb:::benchmark_data_smithi188_134454_object136246:head# 2024-04-01T19:49:04.154 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.154 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78135865:::benchmark_data_smithi188_134454_object136198:head# 2024-04-01T19:49:04.154 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.155 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7818931e:::benchmark_data_smithi188_134454_object137978:head# 2024-04-01T19:49:04.155 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.158 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:781b93b0:::benchmark_data_smithi188_134454_object127467:head# 2024-04-01T19:49:04.158 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.158 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:781be61d:::benchmark_data_smithi188_134454_object124133:head# 2024-04-01T19:49:04.159 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.159 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:781d0dbb:::benchmark_data_smithi188_134454_object133384:head# 2024-04-01T19:49:04.159 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.160 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:781e5543:::benchmark_data_smithi188_134454_object141547:head# 2024-04-01T19:49:04.160 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.160 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:781e78d8:::benchmark_data_smithi188_134454_object154277:head# 2024-04-01T19:49:04.160 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.160 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:781e835a:::benchmark_data_smithi188_134454_object156557:head# 2024-04-01T19:49:04.160 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.161 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7826f4dc:::benchmark_data_smithi188_134454_object117430:head# 2024-04-01T19:49:04.161 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.161 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78281dd7:::benchmark_data_smithi188_134454_object155120:head# 2024-04-01T19:49:04.161 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.161 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:782942da:::benchmark_data_smithi188_134454_object127288:head# 2024-04-01T19:49:04.161 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.163 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:782c9816:::benchmark_data_smithi188_134454_object150495:head# 2024-04-01T19:49:04.163 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.163 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:782d37e7:::benchmark_data_smithi188_134454_object123473:head# 2024-04-01T19:49:04.163 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.163 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:782edbe4:::benchmark_data_smithi188_134454_object134676:head# 2024-04-01T19:49:04.163 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.163 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78304d3e:::benchmark_data_smithi188_134454_object137023:head# 2024-04-01T19:49:04.163 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.163 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78335ed4:::benchmark_data_smithi188_134454_object154955:head# 2024-04-01T19:49:04.163 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.163 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:783369e6:::benchmark_data_smithi188_134454_object150494:head# 2024-04-01T19:49:04.163 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.164 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:783397dc:::benchmark_data_smithi188_134454_object153326:head# 2024-04-01T19:49:04.164 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.164 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:783401c4:::benchmark_data_smithi188_134454_object128226:head# 2024-04-01T19:49:04.164 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.164 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7834c304:::benchmark_data_smithi188_134454_object132524:head# 2024-04-01T19:49:04.164 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.164 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:783ae252:::benchmark_data_smithi188_134454_object152966:head# 2024-04-01T19:49:04.164 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.165 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:783f8794:::benchmark_data_smithi188_134454_object115667:head# 2024-04-01T19:49:04.165 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.165 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:784039db:::benchmark_data_smithi188_134454_object146079:head# 2024-04-01T19:49:04.165 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.166 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7845bc57:::benchmark_data_smithi188_134454_object136286:head# 2024-04-01T19:49:04.166 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.166 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7847eec6:::benchmark_data_smithi188_134454_object124423:head# 2024-04-01T19:49:04.166 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.166 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:784a6bf2:::benchmark_data_smithi188_134454_object142592:head# 2024-04-01T19:49:04.166 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.166 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:784a9ace:::benchmark_data_smithi188_134454_object141513:head# 2024-04-01T19:49:04.166 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.166 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78536eaf:::benchmark_data_smithi188_134454_object140698:head# 2024-04-01T19:49:04.166 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.166 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7853cff7:::benchmark_data_smithi188_134454_object141059:head# 2024-04-01T19:49:04.166 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.166 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7855fa0c:::benchmark_data_smithi188_134454_object123747:head# 2024-04-01T19:49:04.166 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.168 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7858b18c:::benchmark_data_smithi188_134454_object150702:head# 2024-04-01T19:49:04.168 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.168 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:785be554:::benchmark_data_smithi188_134454_object119683:head# 2024-04-01T19:49:04.168 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.168 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:785bfa72:::benchmark_data_smithi188_134454_object121104:head# 2024-04-01T19:49:04.168 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.168 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:785d2a55:::benchmark_data_smithi188_134454_object124834:head# 2024-04-01T19:49:04.168 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.168 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:785f34bb:::benchmark_data_smithi188_134454_object152204:head# 2024-04-01T19:49:04.168 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.168 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7861db72:::benchmark_data_smithi188_134454_object148108:head# 2024-04-01T19:49:04.168 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.169 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7862785e:::benchmark_data_smithi188_134454_object148480:head# 2024-04-01T19:49:04.169 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.169 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:786493c8:::benchmark_data_smithi188_134454_object138524:head# 2024-04-01T19:49:04.169 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.170 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7864aa7b:::benchmark_data_smithi188_134454_object117002:head# 2024-04-01T19:49:04.170 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.170 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7866aa0e:::benchmark_data_smithi188_134454_object154254:head# 2024-04-01T19:49:04.170 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.170 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78695667:::benchmark_data_smithi188_134454_object128152:head# 2024-04-01T19:49:04.170 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.170 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:786b0ba7:::benchmark_data_smithi188_134454_object152840:head# 2024-04-01T19:49:04.170 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.170 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78717096:::benchmark_data_smithi188_134454_object140770:head# 2024-04-01T19:49:04.170 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.171 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:787374b9:::benchmark_data_smithi188_134454_object142035:head# 2024-04-01T19:49:04.171 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.171 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78799643:::benchmark_data_smithi188_134454_object135733:head# 2024-04-01T19:49:04.171 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.171 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:787b7b82:::benchmark_data_smithi188_134454_object134567:head# 2024-04-01T19:49:04.171 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.172 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:787bb804:::benchmark_data_smithi188_134454_object139817:head# 2024-04-01T19:49:04.172 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.172 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:787bc6b2:::benchmark_data_smithi188_134454_object145267:head# 2024-04-01T19:49:04.172 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.172 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:787c18ad:::benchmark_data_smithi188_134454_object140336:head# 2024-04-01T19:49:04.172 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.173 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:787d3c2e:::benchmark_data_smithi188_134454_object155225:head# 2024-04-01T19:49:04.173 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.173 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:787d7e05:::benchmark_data_smithi188_134454_object137259:head# 2024-04-01T19:49:04.173 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.173 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:787e3eb2:::benchmark_data_smithi188_134454_object124374:head# 2024-04-01T19:49:04.173 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.173 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78801854:::benchmark_data_smithi188_134454_object149189:head# 2024-04-01T19:49:04.173 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.173 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7881055d:::benchmark_data_smithi188_134454_object139076:head# 2024-04-01T19:49:04.173 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.173 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78816659:::benchmark_data_smithi188_134454_object131782:head# 2024-04-01T19:49:04.173 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.174 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78819268:::benchmark_data_smithi188_134454_object148998:head# 2024-04-01T19:49:04.174 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.198 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78841cd6:::benchmark_data_smithi188_134454_object156133:head# 2024-04-01T19:49:04.199 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.199 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7884667e:::benchmark_data_smithi188_134454_object142691:head# 2024-04-01T19:49:04.199 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.199 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:788496f3:::benchmark_data_smithi188_134454_object139364:head# 2024-04-01T19:49:04.199 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.199 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78856cac:::benchmark_data_smithi188_134454_object152309:head# 2024-04-01T19:49:04.199 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.199 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78859cef:::benchmark_data_smithi188_134454_object119332:head# 2024-04-01T19:49:04.199 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.199 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78859e69:::benchmark_data_smithi188_134454_object151307:head# 2024-04-01T19:49:04.199 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.199 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78874057:::benchmark_data_smithi188_134454_object120372:head# 2024-04-01T19:49:04.199 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.200 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:788a4c49:::benchmark_data_smithi188_134454_object121565:head# 2024-04-01T19:49:04.200 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.200 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:788ad94d:::benchmark_data_smithi188_134454_object129454:head# 2024-04-01T19:49:04.200 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.200 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:788b7cbb:::benchmark_data_smithi188_134454_object154076:head# 2024-04-01T19:49:04.200 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.200 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:789095b8:::benchmark_data_smithi188_134454_object154565:head# 2024-04-01T19:49:04.200 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.200 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7891223f:::benchmark_data_smithi188_134454_object147591:head# 2024-04-01T19:49:04.200 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.200 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78928a9e:::benchmark_data_smithi188_134454_object121604:head# 2024-04-01T19:49:04.200 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.200 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78937250:::benchmark_data_smithi188_134454_object142552:head# 2024-04-01T19:49:04.200 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.201 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:789da4a0:::benchmark_data_smithi188_134454_object142733:head# 2024-04-01T19:49:04.201 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.201 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:789dacd7:::benchmark_data_smithi188_134454_object156370:head# 2024-04-01T19:49:04.201 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.201 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78a23983:::benchmark_data_smithi188_134454_object121242:head# 2024-04-01T19:49:04.201 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.201 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78a4067d:::benchmark_data_smithi188_134454_object118696:head# 2024-04-01T19:49:04.201 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.201 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78a45540:::benchmark_data_smithi188_134454_object146471:head# 2024-04-01T19:49:04.201 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.201 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78a52fb4:::benchmark_data_smithi188_134454_object125985:head# 2024-04-01T19:49:04.201 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.201 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78a64c4f:::benchmark_data_smithi188_134454_object120956:head# 2024-04-01T19:49:04.201 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.201 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78a744b7:::benchmark_data_smithi188_134454_object120960:head# 2024-04-01T19:49:04.202 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.202 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78a85cf5:::benchmark_data_smithi188_134454_object147451:head# 2024-04-01T19:49:04.202 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.202 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78a8ae6a:::benchmark_data_smithi188_134454_object145172:head# 2024-04-01T19:49:04.202 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.202 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78a95cb8:::benchmark_data_smithi188_134454_object120983:head# 2024-04-01T19:49:04.202 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.202 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78aca042:::benchmark_data_smithi188_134454_object121875:head# 2024-04-01T19:49:04.202 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.205 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78ad1560:::benchmark_data_smithi188_134454_object129734:head# 2024-04-01T19:49:04.205 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.205 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78ae99a0:::benchmark_data_smithi188_134454_object129587:head# 2024-04-01T19:49:04.205 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.205 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78af3343:::benchmark_data_smithi188_134454_object152187:head# 2024-04-01T19:49:04.206 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.206 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78b02c8c:::benchmark_data_smithi188_134454_object119851:head# 2024-04-01T19:49:04.206 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.206 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78b13ac1:::benchmark_data_smithi188_134454_object136592:head# 2024-04-01T19:49:04.206 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.206 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78b2b33a:::benchmark_data_smithi188_134454_object147221:head# 2024-04-01T19:49:04.206 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.206 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78b3e870:::benchmark_data_smithi188_134454_object153544:head# 2024-04-01T19:49:04.206 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.206 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78b44767:::benchmark_data_smithi188_134454_object132744:head# 2024-04-01T19:49:04.206 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.206 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78b4f2d2:::benchmark_data_smithi188_134454_object142564:head# 2024-04-01T19:49:04.207 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.207 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78b68c52:::benchmark_data_smithi188_134454_object117195:head# 2024-04-01T19:49:04.207 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.207 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78b72109:::benchmark_data_smithi188_134454_object116329:head# 2024-04-01T19:49:04.207 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.207 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78b87273:::benchmark_data_smithi188_134454_object151603:head# 2024-04-01T19:49:04.207 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.207 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78b8dc32:::benchmark_data_smithi188_134454_object130942:head# 2024-04-01T19:49:04.207 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.207 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78b97708:::benchmark_data_smithi188_134454_object130642:head# 2024-04-01T19:49:04.207 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.207 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78bb0e67:::benchmark_data_smithi188_134454_object122063:head# 2024-04-01T19:49:04.207 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.208 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78c252cb:::benchmark_data_smithi188_134454_object135113:head# 2024-04-01T19:49:04.208 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.208 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78c2de23:::benchmark_data_smithi188_134454_object145105:head# 2024-04-01T19:49:04.208 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.208 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78c3258c:::benchmark_data_smithi188_134454_object145192:head# 2024-04-01T19:49:04.208 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.208 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78c354db:::benchmark_data_smithi188_134454_object118293:head# 2024-04-01T19:49:04.208 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.208 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78c8861e:::benchmark_data_smithi188_134454_object146046:head# 2024-04-01T19:49:04.208 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.209 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78c89d82:::benchmark_data_smithi188_134454_object149127:head# 2024-04-01T19:49:04.209 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.210 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78cc3ad4:::benchmark_data_smithi188_134454_object147099:head# 2024-04-01T19:49:04.210 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.210 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78cfe310:::benchmark_data_smithi188_134454_object116480:head# 2024-04-01T19:49:04.210 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.210 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78d24b7d:::benchmark_data_smithi188_134454_object141238:head# 2024-04-01T19:49:04.210 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.210 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78d681fe:::benchmark_data_smithi188_134454_object146425:head# 2024-04-01T19:49:04.210 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.210 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78d9e735:::benchmark_data_smithi188_134454_object150036:head# 2024-04-01T19:49:04.210 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.210 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78db4de9:::benchmark_data_smithi188_134454_object145560:head# 2024-04-01T19:49:04.210 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.211 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78dbf0d9:::benchmark_data_smithi188_134454_object151483:head# 2024-04-01T19:49:04.211 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.213 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78e0d122:::benchmark_data_smithi188_134454_object119438:head# 2024-04-01T19:49:04.213 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.213 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78e35960:::benchmark_data_smithi188_134454_object150541:head# 2024-04-01T19:49:04.213 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.213 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78e3832c:::benchmark_data_smithi188_134454_object120670:head# 2024-04-01T19:49:04.213 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.213 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78e67159:::benchmark_data_smithi188_134454_object121589:head# 2024-04-01T19:49:04.213 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.213 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78ea7e8b:::benchmark_data_smithi188_134454_object131122:head# 2024-04-01T19:49:04.213 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.214 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78ec9596:::benchmark_data_smithi188_134454_object123623:head# 2024-04-01T19:49:04.214 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.214 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78ed1423:::benchmark_data_smithi188_134454_object132696:head# 2024-04-01T19:49:04.214 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.214 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78ed16b8:::benchmark_data_smithi188_134454_object118974:head# 2024-04-01T19:49:04.214 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.214 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78eecc19:::benchmark_data_smithi188_134454_object137007:head# 2024-04-01T19:49:04.214 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.214 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78f1410f:::benchmark_data_smithi188_134454_object123195:head# 2024-04-01T19:49:04.214 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.214 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78f23f8f:::benchmark_data_smithi188_134454_object116068:head# 2024-04-01T19:49:04.214 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.215 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78f48baf:::benchmark_data_smithi188_134454_object122504:head# 2024-04-01T19:49:04.215 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.215 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78f6099f:::benchmark_data_smithi188_134454_object126147:head# 2024-04-01T19:49:04.215 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.215 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78f7da02:::benchmark_data_smithi188_134454_object137628:head# 2024-04-01T19:49:04.215 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.215 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78f9da64:::benchmark_data_smithi188_134454_object126539:head# 2024-04-01T19:49:04.215 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.215 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78fb0c02:::benchmark_data_smithi188_134454_object117758:head# 2024-04-01T19:49:04.215 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.215 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78fbb824:::benchmark_data_smithi188_134454_object149225:head# 2024-04-01T19:49:04.215 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.215 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78fd7f94:::benchmark_data_smithi188_134454_object149336:head# 2024-04-01T19:49:04.215 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.216 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78feeacb:::benchmark_data_smithi188_134454_object126936:head# 2024-04-01T19:49:04.216 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.216 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:78ffb449:::benchmark_data_smithi188_134454_object152938:head# 2024-04-01T19:49:04.216 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.216 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79061395:::benchmark_data_smithi188_134454_object123257:head# 2024-04-01T19:49:04.216 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.216 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79062269:::benchmark_data_smithi188_134454_object125678:head# 2024-04-01T19:49:04.216 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.216 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79067137:::benchmark_data_smithi188_134454_object139845:head# 2024-04-01T19:49:04.217 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.217 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7909da5b:::benchmark_data_smithi188_134454_object133076:head# 2024-04-01T19:49:04.217 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.217 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:790b777c:::benchmark_data_smithi188_134454_object131389:head# 2024-04-01T19:49:04.217 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.218 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:790c0da5:::benchmark_data_smithi188_134454_object136397:head# 2024-04-01T19:49:04.218 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.218 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:790d8d6e:::benchmark_data_smithi188_134454_object122778:head# 2024-04-01T19:49:04.218 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.218 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:790f9d96:::benchmark_data_smithi188_134454_object120444:head# 2024-04-01T19:49:04.218 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.218 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7911672f:::benchmark_data_smithi188_134454_object139606:head# 2024-04-01T19:49:04.218 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.218 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79154a3e:::benchmark_data_smithi188_134454_object127055:head# 2024-04-01T19:49:04.218 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.218 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7917d7ac:::benchmark_data_smithi188_134454_object141542:head# 2024-04-01T19:49:04.218 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.219 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:791a3761:::benchmark_data_smithi188_134454_object152238:head# 2024-04-01T19:49:04.219 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.219 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:791b3e38:::benchmark_data_smithi188_134454_object152615:head# 2024-04-01T19:49:04.219 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.220 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:791c3f06:::benchmark_data_smithi188_134454_object120771:head# 2024-04-01T19:49:04.220 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.220 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:791f8639:::benchmark_data_smithi188_134454_object122756:head# 2024-04-01T19:49:04.221 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.221 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79216d24:::benchmark_data_smithi188_134454_object118158:head# 2024-04-01T19:49:04.221 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.221 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79231c21:::benchmark_data_smithi188_134454_object129125:head# 2024-04-01T19:49:04.221 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.221 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79236a41:::benchmark_data_smithi188_134454_object132235:head# 2024-04-01T19:49:04.221 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.221 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79237f5f:::benchmark_data_smithi188_134454_object137948:head# 2024-04-01T19:49:04.221 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.221 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7923a54f:::benchmark_data_smithi188_134454_object119893:head# 2024-04-01T19:49:04.221 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.221 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7924dfc9:::benchmark_data_smithi188_134454_object126183:head# 2024-04-01T19:49:04.221 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.221 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79266423:::benchmark_data_smithi188_134454_object123035:head# 2024-04-01T19:49:04.222 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.222 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7928e102:::benchmark_data_smithi188_134454_object135387:head# 2024-04-01T19:49:04.222 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.222 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79298abc:::benchmark_data_smithi188_134454_object119905:head# 2024-04-01T19:49:04.223 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.223 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:792c3c2a:::benchmark_data_smithi188_134454_object133142:head# 2024-04-01T19:49:04.223 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.223 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:792d5f86:::benchmark_data_smithi188_134454_object126501:head# 2024-04-01T19:49:04.223 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.223 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:792f0ad1:::benchmark_data_smithi188_134454_object142488:head# 2024-04-01T19:49:04.223 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.224 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:793161b3:::benchmark_data_smithi188_134454_object121077:head# 2024-04-01T19:49:04.224 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.224 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79316ae6:::benchmark_data_smithi188_134454_object136962:head# 2024-04-01T19:49:04.224 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.224 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79335b5c:::benchmark_data_smithi188_134454_object141455:head# 2024-04-01T19:49:04.224 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.225 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:793598d5:::benchmark_data_smithi188_134454_object131584:head# 2024-04-01T19:49:04.225 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.225 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7935e0ad:::benchmark_data_smithi188_134454_object124904:head# 2024-04-01T19:49:04.225 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.225 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:793907fd:::benchmark_data_smithi188_134454_object118273:head# 2024-04-01T19:49:04.225 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.225 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79391f02:::benchmark_data_smithi188_134454_object135085:head# 2024-04-01T19:49:04.225 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.225 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:793ae69c:::benchmark_data_smithi188_134454_object129240:head# 2024-04-01T19:49:04.225 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.225 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:793b984d:::benchmark_data_smithi188_134454_object151011:head# 2024-04-01T19:49:04.225 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.227 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:793cafc3:::benchmark_data_smithi188_134454_object147872:head# 2024-04-01T19:49:04.227 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.227 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:793d2c0e:::benchmark_data_smithi188_134454_object149633:head# 2024-04-01T19:49:04.228 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.228 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:793f0306:::benchmark_data_smithi188_134454_object133934:head# 2024-04-01T19:49:04.228 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.228 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79401548:::benchmark_data_smithi188_134454_object142113:head# 2024-04-01T19:49:04.228 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.228 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:794152c5:::benchmark_data_smithi188_134454_object130455:head# 2024-04-01T19:49:04.228 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.228 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7942dc3e:::benchmark_data_smithi188_134454_object120123:head# 2024-04-01T19:49:04.228 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.228 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7943bb26:::benchmark_data_smithi188_134454_object130193:head# 2024-04-01T19:49:04.228 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.228 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7944638a:::benchmark_data_smithi188_134454_object143062:head# 2024-04-01T19:49:04.228 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.229 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7945161d:::benchmark_data_smithi188_134454_object152441:head# 2024-04-01T19:49:04.229 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.229 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7945a15a:::benchmark_data_smithi188_134454_object122711:head# 2024-04-01T19:49:04.229 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.229 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:794656ed:::benchmark_data_smithi188_134454_object131377:head# 2024-04-01T19:49:04.229 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.229 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79472242:::benchmark_data_smithi188_134454_object141607:head# 2024-04-01T19:49:04.229 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.230 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7949332e:::benchmark_data_smithi188_134454_object150438:head# 2024-04-01T19:49:04.230 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.230 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:794c1841:::benchmark_data_smithi188_134454_object135687:head# 2024-04-01T19:49:04.230 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.230 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:794cace4:::benchmark_data_smithi188_134454_object119014:head# 2024-04-01T19:49:04.231 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.231 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:794f3698:::benchmark_data_smithi188_134454_object117382:head# 2024-04-01T19:49:04.231 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.231 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:794f85fc:::benchmark_data_smithi188_134454_object128840:head# 2024-04-01T19:49:04.231 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.231 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7951743a:::benchmark_data_smithi188_134454_object144509:head# 2024-04-01T19:49:04.231 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.231 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79526bf4:::benchmark_data_smithi188_134454_object115562:head# 2024-04-01T19:49:04.231 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.231 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:795329b6:::benchmark_data_smithi188_134454_object118672:head# 2024-04-01T19:49:04.231 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.231 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79554115:::benchmark_data_smithi188_134454_object129074:head# 2024-04-01T19:49:04.231 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.232 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:795641e3:::benchmark_data_smithi188_134454_object122280:head# 2024-04-01T19:49:04.232 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.232 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79574fb9:::benchmark_data_smithi188_134454_object118487:head# 2024-04-01T19:49:04.233 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.233 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79575458:::benchmark_data_smithi188_134454_object144611:head# 2024-04-01T19:49:04.233 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.233 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79586e6a:::benchmark_data_smithi188_134454_object123185:head# 2024-04-01T19:49:04.233 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.233 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7959278a:::benchmark_data_smithi188_134454_object142424:head# 2024-04-01T19:49:04.233 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.233 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:795bd239:::benchmark_data_smithi188_134454_object128081:head# 2024-04-01T19:49:04.233 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.233 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:795f901a:::benchmark_data_smithi188_134454_object142469:head# 2024-04-01T19:49:04.233 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.234 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7960708c:::benchmark_data_smithi188_134454_object145036:head# 2024-04-01T19:49:04.234 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.234 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7960cbc5:::benchmark_data_smithi188_134454_object137964:head# 2024-04-01T19:49:04.234 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.234 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79625656:::benchmark_data_smithi188_134454_object122032:head# 2024-04-01T19:49:04.235 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.235 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7962bac1:::benchmark_data_smithi188_134454_object152086:head# 2024-04-01T19:49:04.235 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.235 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79671c98:::benchmark_data_smithi188_134454_object134574:head# 2024-04-01T19:49:04.235 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.235 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79697e8f:::benchmark_data_smithi188_134454_object139438:head# 2024-04-01T19:49:04.235 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.239 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7969b284:::benchmark_data_smithi188_134454_object155227:head# 2024-04-01T19:49:04.239 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.240 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:796a0910:::benchmark_data_smithi188_134454_object151650:head# 2024-04-01T19:49:04.240 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.240 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:796ba60a:::benchmark_data_smithi188_134454_object128213:head# 2024-04-01T19:49:04.240 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.240 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:796c2c9b:::benchmark_data_smithi188_134454_object140095:head# 2024-04-01T19:49:04.240 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.240 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79725fa1:::benchmark_data_smithi188_134454_object145568:head# 2024-04-01T19:49:04.240 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.240 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7973857e:::benchmark_data_smithi188_134454_object132325:head# 2024-04-01T19:49:04.240 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.240 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7973e750:::benchmark_data_smithi188_134454_object133915:head# 2024-04-01T19:49:04.240 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.240 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79753fd2:::benchmark_data_smithi188_134454_object133804:head# 2024-04-01T19:49:04.241 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.241 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7976a0ae:::benchmark_data_smithi188_134454_object128635:head# 2024-04-01T19:49:04.241 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.241 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7977f364:::benchmark_data_smithi188_134454_object131374:head# 2024-04-01T19:49:04.241 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.241 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7977fa81:::benchmark_data_smithi188_134454_object125893:head# 2024-04-01T19:49:04.241 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.241 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7980c1d6:::benchmark_data_smithi188_134454_object142370:head# 2024-04-01T19:49:04.241 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.241 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7981c36b:::benchmark_data_smithi188_134454_object135570:head# 2024-04-01T19:49:04.241 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.241 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7982f2fc:::benchmark_data_smithi188_134454_object153525:head# 2024-04-01T19:49:04.241 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.241 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79833f14:::benchmark_data_smithi188_134454_object143522:head# 2024-04-01T19:49:04.242 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.242 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7986b7be:::benchmark_data_smithi188_134454_object136796:head# 2024-04-01T19:49:04.242 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.242 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7989d636:::benchmark_data_smithi188_134454_object137160:head# 2024-04-01T19:49:04.242 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.242 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:798e28b1:::benchmark_data_smithi188_134454_object148384:head# 2024-04-01T19:49:04.242 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.242 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:798fd032:::benchmark_data_smithi188_134454_object124521:head# 2024-04-01T19:49:04.242 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.242 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:798feb3f:::benchmark_data_smithi188_134454_object117501:head# 2024-04-01T19:49:04.242 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.242 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79904720:::benchmark_data_smithi188_134454_object123218:head# 2024-04-01T19:49:04.242 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.242 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79905666:::benchmark_data_smithi188_134454_object150731:head# 2024-04-01T19:49:04.243 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.246 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79909c13:::benchmark_data_smithi188_134454_object120403:head# 2024-04-01T19:49:04.247 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.247 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7990b103:::benchmark_data_smithi188_134454_object143381:head# 2024-04-01T19:49:04.247 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.247 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79933aff:::benchmark_data_smithi188_134454_object124414:head# 2024-04-01T19:49:04.247 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.247 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:799877a3:::benchmark_data_smithi188_134454_object143615:head# 2024-04-01T19:49:04.247 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.247 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:799c1f69:::benchmark_data_smithi188_134454_object123282:head# 2024-04-01T19:49:04.247 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.247 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:799ed21d:::benchmark_data_smithi188_134454_object149793:head# 2024-04-01T19:49:04.247 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.247 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79a1f0bb:::benchmark_data_smithi188_134454_object128440:head# 2024-04-01T19:49:04.247 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.248 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79a2ca84:::benchmark_data_smithi188_134454_object135051:head# 2024-04-01T19:49:04.248 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.248 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79a47def:::benchmark_data_smithi188_134454_object129106:head# 2024-04-01T19:49:04.248 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.248 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79a655a3:::benchmark_data_smithi188_134454_object144877:head# 2024-04-01T19:49:04.248 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.248 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79a6c902:::benchmark_data_smithi188_134454_object129202:head# 2024-04-01T19:49:04.248 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.248 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79a733e7:::benchmark_data_smithi188_134454_object145360:head# 2024-04-01T19:49:04.248 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.248 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79ac7460:::benchmark_data_smithi188_134454_object121870:head# 2024-04-01T19:49:04.248 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.248 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79ae3dcd:::benchmark_data_smithi188_134454_object145112:head# 2024-04-01T19:49:04.249 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.249 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79aeccfc:::benchmark_data_smithi188_134454_object147842:head# 2024-04-01T19:49:04.249 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.249 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79b0f2c4:::benchmark_data_smithi188_134454_object143817:head# 2024-04-01T19:49:04.249 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.249 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79b141c2:::benchmark_data_smithi188_134454_object154688:head# 2024-04-01T19:49:04.249 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.249 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79b19c08:::benchmark_data_smithi188_134454_object154601:head# 2024-04-01T19:49:04.249 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.249 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79b29bf3:::benchmark_data_smithi188_134454_object140109:head# 2024-04-01T19:49:04.249 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.249 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79b343de:::benchmark_data_smithi188_134454_object145697:head# 2024-04-01T19:49:04.249 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.249 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79b38918:::benchmark_data_smithi188_134454_object118145:head# 2024-04-01T19:49:04.250 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.250 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79b5e2c3:::benchmark_data_smithi188_134454_object145831:head# 2024-04-01T19:49:04.250 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.250 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79b7c2fb:::benchmark_data_smithi188_134454_object136140:head# 2024-04-01T19:49:04.250 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.250 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79b8c47e:::benchmark_data_smithi188_134454_object150127:head# 2024-04-01T19:49:04.250 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.250 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79b9629f:::benchmark_data_smithi188_134454_object128595:head# 2024-04-01T19:49:04.250 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.250 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79b98af5:::benchmark_data_smithi188_134454_object122111:head# 2024-04-01T19:49:04.250 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.250 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79ba423c:::benchmark_data_smithi188_134454_object136899:head# 2024-04-01T19:49:04.250 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.257 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79ba8275:::benchmark_data_smithi188_134454_object115749:head# 2024-04-01T19:49:04.257 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.257 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79bcccc4:::benchmark_data_smithi188_134454_object135197:head# 2024-04-01T19:49:04.257 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.257 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79bd95ac:::benchmark_data_smithi188_134454_object141937:head# 2024-04-01T19:49:04.257 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.258 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79bdf3d7:::benchmark_data_smithi188_134454_object118817:head# 2024-04-01T19:49:04.258 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.258 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79be6f98:::benchmark_data_smithi188_134454_object116258:head# 2024-04-01T19:49:04.258 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.258 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79bebd73:::benchmark_data_smithi188_134454_object135416:head# 2024-04-01T19:49:04.258 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.258 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79c07035:::benchmark_data_smithi188_134454_object119881:head# 2024-04-01T19:49:04.258 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.258 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79c2c8ff:::benchmark_data_smithi188_134454_object142191:head# 2024-04-01T19:49:04.258 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.258 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79c536ea:::benchmark_data_smithi188_134454_object117287:head# 2024-04-01T19:49:04.258 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.259 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79c6338d:::benchmark_data_smithi188_134454_object125066:head# 2024-04-01T19:49:04.259 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.259 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79c653b0:::benchmark_data_smithi188_134454_object118398:head# 2024-04-01T19:49:04.259 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.259 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79c69e6e:::benchmark_data_smithi188_134454_object152851:head# 2024-04-01T19:49:04.259 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.259 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79c94411:::benchmark_data_smithi188_134454_object138229:head# 2024-04-01T19:49:04.259 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.259 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79c974b3:::benchmark_data_smithi188_134454_object136245:head# 2024-04-01T19:49:04.259 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.259 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79c9d536:::benchmark_data_smithi188_134454_object136767:head# 2024-04-01T19:49:04.259 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.259 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79ca5873:::benchmark_data_smithi188_134454_object122823:head# 2024-04-01T19:49:04.259 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.260 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79cdca11:::benchmark_data_smithi188_134454_object139838:head# 2024-04-01T19:49:04.260 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.260 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79ce5604:::benchmark_data_smithi188_134454_object132806:head# 2024-04-01T19:49:04.260 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.260 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79d27ae5:::benchmark_data_smithi188_134454_object130586:head# 2024-04-01T19:49:04.260 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.260 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79d4ae4c:::benchmark_data_smithi188_134454_object135396:head# 2024-04-01T19:49:04.260 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.260 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79d4b03e:::benchmark_data_smithi188_134454_object133693:head# 2024-04-01T19:49:04.260 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.260 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79d7e10f:::benchmark_data_smithi188_134454_object151654:head# 2024-04-01T19:49:04.260 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.260 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79d85f39:::benchmark_data_smithi188_134454_object121036:head# 2024-04-01T19:49:04.261 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.261 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79d8c739:::benchmark_data_smithi188_134454_object126186:head# 2024-04-01T19:49:04.261 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.261 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79d8de9e:::benchmark_data_smithi188_134454_object124610:head# 2024-04-01T19:49:04.261 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.261 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79dbc68d:::benchmark_data_smithi188_134454_object148201:head# 2024-04-01T19:49:04.261 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.261 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79dcaf52:::benchmark_data_smithi188_134454_object130849:head# 2024-04-01T19:49:04.261 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.261 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79dd26a1:::benchmark_data_smithi188_134454_object116838:head# 2024-04-01T19:49:04.261 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.261 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79deb3e2:::benchmark_data_smithi188_134454_object118304:head# 2024-04-01T19:49:04.261 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.261 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79e22d8a:::benchmark_data_smithi188_134454_object130831:head# 2024-04-01T19:49:04.262 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.262 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79e61324:::benchmark_data_smithi188_134454_object144885:head# 2024-04-01T19:49:04.262 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.262 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79e6454f:::benchmark_data_smithi188_134454_object130657:head# 2024-04-01T19:49:04.262 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.262 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79ee1f10:::benchmark_data_smithi188_134454_object147111:head# 2024-04-01T19:49:04.262 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.262 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79ee91cb:::benchmark_data_smithi188_134454_object148846:head# 2024-04-01T19:49:04.262 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.262 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79f30c64:::benchmark_data_smithi188_134454_object148436:head# 2024-04-01T19:49:04.262 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.262 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79f350e7:::benchmark_data_smithi188_134454_object144916:head# 2024-04-01T19:49:04.262 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.262 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79f44dc5:::benchmark_data_smithi188_134454_object134321:head# 2024-04-01T19:49:04.263 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.263 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79f73ce4:::benchmark_data_smithi188_134454_object121819:head# 2024-04-01T19:49:04.263 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.263 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79f7ea18:::benchmark_data_smithi188_134454_object118041:head# 2024-04-01T19:49:04.263 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.263 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79f8532c:::benchmark_data_smithi188_134454_object117668:head# 2024-04-01T19:49:04.263 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.264 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79f866c4:::benchmark_data_smithi188_134454_object117454:head# 2024-04-01T19:49:04.264 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.264 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79fcaae3:::benchmark_data_smithi188_134454_object134128:head# 2024-04-01T19:49:04.264 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.265 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79fd4655:::benchmark_data_smithi188_134454_object143067:head# 2024-04-01T19:49:04.265 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.265 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79fe876f:::benchmark_data_smithi188_134454_object141342:head# 2024-04-01T19:49:04.265 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.265 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79fe893a:::benchmark_data_smithi188_134454_object138466:head# 2024-04-01T19:49:04.265 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.265 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79fee26b:::benchmark_data_smithi188_134454_object116375:head# 2024-04-01T19:49:04.265 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.268 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79fefd09:::benchmark_data_smithi188_134454_object127778:head# 2024-04-01T19:49:04.268 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.268 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79ff9372:::benchmark_data_smithi188_134454_object146288:head# 2024-04-01T19:49:04.268 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.269 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:79ffcf0f:::benchmark_data_smithi188_134454_object123386:head# 2024-04-01T19:49:04.269 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.269 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a047037:::benchmark_data_smithi188_134454_object136642:head# 2024-04-01T19:49:04.269 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.269 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a07baf4:::benchmark_data_smithi188_134454_object143068:head# 2024-04-01T19:49:04.269 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.269 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a07e664:::benchmark_data_smithi188_134454_object118048:head# 2024-04-01T19:49:04.269 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.269 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a08cf60:::benchmark_data_smithi188_134454_object136038:head# 2024-04-01T19:49:04.269 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.270 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a093b7e:::benchmark_data_smithi188_134454_object125735:head# 2024-04-01T19:49:04.270 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.270 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a0a31e4:::benchmark_data_smithi188_134454_object150811:head# 2024-04-01T19:49:04.271 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.271 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a0d1a2b:::benchmark_data_smithi188_134454_object137404:head# 2024-04-01T19:49:04.271 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.271 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a110f50:::benchmark_data_smithi188_134454_object147208:head# 2024-04-01T19:49:04.271 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.272 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a111ca1:::benchmark_data_smithi188_134454_object117888:head# 2024-04-01T19:49:04.272 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.272 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a120834:::benchmark_data_smithi188_134454_object142419:head# 2024-04-01T19:49:04.272 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.274 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a131414:::benchmark_data_smithi188_134454_object128895:head# 2024-04-01T19:49:04.274 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.274 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a170f74:::benchmark_data_smithi188_134454_object117722:head# 2024-04-01T19:49:04.274 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.275 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a17c696:::benchmark_data_smithi188_134454_object141699:head# 2024-04-01T19:49:04.275 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.275 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a19db96:::benchmark_data_smithi188_134454_object134962:head# 2024-04-01T19:49:04.275 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.275 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a2294af:::benchmark_data_smithi188_134454_object117924:head# 2024-04-01T19:49:04.275 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.275 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a250597:::benchmark_data_smithi188_134454_object135267:head# 2024-04-01T19:49:04.275 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.275 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a2940c9:::benchmark_data_smithi188_134454_object156494:head# 2024-04-01T19:49:04.275 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.275 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a2a1012:::benchmark_data_smithi188_134454_object155343:head# 2024-04-01T19:49:04.275 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.275 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a2aeb50:::benchmark_data_smithi188_134454_object133171:head# 2024-04-01T19:49:04.275 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.275 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a2b9105:::benchmark_data_smithi188_134454_object144209:head# 2024-04-01T19:49:04.276 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.276 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a2d3a40:::benchmark_data_smithi188_134454_object143286:head# 2024-04-01T19:49:04.276 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.277 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a2fb440:::benchmark_data_smithi188_134454_object153612:head# 2024-04-01T19:49:04.277 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.278 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a304f8c:::benchmark_data_smithi188_134454_object126950:head# 2024-04-01T19:49:04.278 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.278 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a352760:::benchmark_data_smithi188_134454_object141046:head# 2024-04-01T19:49:04.278 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.278 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a362c97:::benchmark_data_smithi188_134454_object156624:head# 2024-04-01T19:49:04.278 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.278 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a3a4921:::benchmark_data_smithi188_134454_object146678:head# 2024-04-01T19:49:04.278 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.278 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a3aebe4:::benchmark_data_smithi188_134454_object140382:head# 2024-04-01T19:49:04.278 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.278 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a3e752f:::benchmark_data_smithi188_134454_object141460:head# 2024-04-01T19:49:04.278 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.278 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a3fe382:::benchmark_data_smithi188_134454_object148042:head# 2024-04-01T19:49:04.279 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.279 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a41d170:::benchmark_data_smithi188_134454_object125737:head# 2024-04-01T19:49:04.279 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.279 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a427c66:::benchmark_data_smithi188_134454_object154974:head# 2024-04-01T19:49:04.279 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.279 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a43802b:::benchmark_data_smithi188_134454_object116069:head# 2024-04-01T19:49:04.279 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.279 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a478a93:::benchmark_data_smithi188_134454_object130785:head# 2024-04-01T19:49:04.279 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.279 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a4d5078:::benchmark_data_smithi188_134454_object138608:head# 2024-04-01T19:49:04.279 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.282 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a4fc78e:::benchmark_data_smithi188_134454_object148700:head# 2024-04-01T19:49:04.282 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.283 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a53c12b:::benchmark_data_smithi188_134454_object122387:head# 2024-04-01T19:49:04.283 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.283 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a554ef2:::benchmark_data_smithi188_134454_object125108:head# 2024-04-01T19:49:04.283 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.283 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a5864f6:::benchmark_data_smithi188_134454_object128781:head# 2024-04-01T19:49:04.283 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.283 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a5badc9:::benchmark_data_smithi188_134454_object141494:head# 2024-04-01T19:49:04.283 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.283 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a5db9be:::benchmark_data_smithi188_134454_object137454:head# 2024-04-01T19:49:04.283 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.283 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a5ed326:::benchmark_data_smithi188_134454_object145506:head# 2024-04-01T19:49:04.283 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.283 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a64832e:::benchmark_data_smithi188_134454_object128448:head# 2024-04-01T19:49:04.283 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.283 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a655d94:::benchmark_data_smithi188_134454_object123639:head# 2024-04-01T19:49:04.284 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.284 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a681701:::benchmark_data_smithi188_134454_object127552:head# 2024-04-01T19:49:04.284 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.284 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a694c92:::benchmark_data_smithi188_134454_object145915:head# 2024-04-01T19:49:04.284 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.284 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a6adb47:::benchmark_data_smithi188_134454_object144135:head# 2024-04-01T19:49:04.284 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.284 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a6b1bab:::benchmark_data_smithi188_134454_object141549:head# 2024-04-01T19:49:04.284 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.284 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a6dbae3:::benchmark_data_smithi188_134454_object143370:head# 2024-04-01T19:49:04.284 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.284 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a701f4f:::benchmark_data_smithi188_134454_object119261:head# 2024-04-01T19:49:04.284 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.284 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a725c6f:::benchmark_data_smithi188_134454_object121504:head# 2024-04-01T19:49:04.284 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.285 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a73bad6:::benchmark_data_smithi188_134454_object138805:head# 2024-04-01T19:49:04.285 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.285 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a7a4346:::benchmark_data_smithi188_134454_object128866:head# 2024-04-01T19:49:04.285 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.285 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a7b2f55:::benchmark_data_smithi188_134454_object124193:head# 2024-04-01T19:49:04.285 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.287 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a7c0ac4:::benchmark_data_smithi188_134454_object136296:head# 2024-04-01T19:49:04.287 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.287 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a7c16ba:::benchmark_data_smithi188_134454_object138113:head# 2024-04-01T19:49:04.287 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.287 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a80e1d1:::benchmark_data_smithi188_134454_object120359:head# 2024-04-01T19:49:04.288 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.288 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a80e4df:::benchmark_data_smithi188_134454_object117311:head# 2024-04-01T19:49:04.288 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.288 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a80f1f7:::benchmark_data_smithi188_134454_object145039:head# 2024-04-01T19:49:04.288 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.288 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a816843:::benchmark_data_smithi188_134454_object145795:head# 2024-04-01T19:49:04.288 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.288 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a82c34b:::benchmark_data_smithi188_134454_object139283:head# 2024-04-01T19:49:04.288 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.288 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a82ef1f:::benchmark_data_smithi188_134454_object148954:head# 2024-04-01T19:49:04.288 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.288 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a8494e0:::benchmark_data_smithi188_134454_object142808:head# 2024-04-01T19:49:04.288 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.288 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a88e7d5:::benchmark_data_smithi188_134454_object128302:head# 2024-04-01T19:49:04.289 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.289 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a8a316d:::benchmark_data_smithi188_134454_object133789:head# 2024-04-01T19:49:04.289 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.289 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a8b2b98:::benchmark_data_smithi188_134454_object120915:head# 2024-04-01T19:49:04.289 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.289 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a8ddb9b:::benchmark_data_smithi188_134454_object117958:head# 2024-04-01T19:49:04.289 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.289 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a8e56d7:::benchmark_data_smithi188_134454_object128807:head# 2024-04-01T19:49:04.289 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.289 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a8eacf5:::benchmark_data_smithi188_134454_object122675:head# 2024-04-01T19:49:04.289 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.289 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a8f7c3b:::benchmark_data_smithi188_134454_object139350:head# 2024-04-01T19:49:04.289 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.289 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a91ea8f:::benchmark_data_smithi188_134454_object128952:head# 2024-04-01T19:49:04.290 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.290 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a925d42:::benchmark_data_smithi188_134454_object121919:head# 2024-04-01T19:49:04.290 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.290 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a94e781:::benchmark_data_smithi188_134454_object133066:head# 2024-04-01T19:49:04.290 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.291 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a95d780:::benchmark_data_smithi188_134454_object149492:head# 2024-04-01T19:49:04.291 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.293 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a977779:::benchmark_data_smithi188_134454_object134055:head# 2024-04-01T19:49:04.293 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.294 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a987d92:::benchmark_data_smithi188_134454_object133291:head# 2024-04-01T19:49:04.294 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.294 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a9b0970:::benchmark_data_smithi188_134454_object128467:head# 2024-04-01T19:49:04.294 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.295 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a9beb80:::benchmark_data_smithi188_134454_object131529:head# 2024-04-01T19:49:04.295 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.295 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a9cfad2:::benchmark_data_smithi188_134454_object126904:head# 2024-04-01T19:49:04.295 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.299 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a9dfab9:::benchmark_data_smithi188_134454_object130774:head# 2024-04-01T19:49:04.299 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.299 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7a9e36c5:::benchmark_data_smithi188_134454_object115987:head# 2024-04-01T19:49:04.299 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.299 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7aa24580:::benchmark_data_smithi188_134454_object124766:head# 2024-04-01T19:49:04.299 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.300 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7aa544fa:::benchmark_data_smithi188_134454_object129073:head# 2024-04-01T19:49:04.300 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.300 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7aa86722:::benchmark_data_smithi188_134454_object137182:head# 2024-04-01T19:49:04.300 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.300 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7aac9179:::benchmark_data_smithi188_134454_object128940:head# 2024-04-01T19:49:04.300 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.300 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7aad0693:::benchmark_data_smithi188_134454_object121868:head# 2024-04-01T19:49:04.300 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.300 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7aaf016f:::benchmark_data_smithi188_134454_object115476:head# 2024-04-01T19:49:04.300 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.300 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7aaff669:::benchmark_data_smithi188_134454_object148041:head# 2024-04-01T19:49:04.300 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.300 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ab0dee4:::benchmark_data_smithi188_134454_object134218:head# 2024-04-01T19:49:04.300 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.301 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ab38bae:::benchmark_data_smithi188_134454_object131470:head# 2024-04-01T19:49:04.301 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.301 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ab5c931:::benchmark_data_smithi188_134454_object137773:head# 2024-04-01T19:49:04.301 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.301 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ab68fb1:::benchmark_data_smithi188_134454_object153282:head# 2024-04-01T19:49:04.301 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.304 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ab95888:::benchmark_data_smithi188_134454_object149937:head# 2024-04-01T19:49:04.305 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.305 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ab9c16b:::benchmark_data_smithi188_134454_object121486:head# 2024-04-01T19:49:04.305 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.305 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7aba7350:::benchmark_data_smithi188_134454_object138104:head# 2024-04-01T19:49:04.305 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.307 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7abac128:::benchmark_data_smithi188_134454_object152728:head# 2024-04-01T19:49:04.307 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.307 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7abac372:::benchmark_data_smithi188_134454_object126069:head# 2024-04-01T19:49:04.307 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.307 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7abb44c6:::benchmark_data_smithi188_134454_object151087:head# 2024-04-01T19:49:04.308 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.308 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7abc2c53:::benchmark_data_smithi188_134454_object149363:head# 2024-04-01T19:49:04.308 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.308 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7abd2380:::benchmark_data_smithi188_134454_object151213:head# 2024-04-01T19:49:04.308 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.308 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7abd6d85:::benchmark_data_smithi188_134454_object137823:head# 2024-04-01T19:49:04.308 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.308 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ac25e2d:::benchmark_data_smithi188_134454_object136254:head# 2024-04-01T19:49:04.308 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.308 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ac7782d:::benchmark_data_smithi188_134454_object132945:head# 2024-04-01T19:49:04.308 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.309 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7aca506f:::benchmark_data_smithi188_134454_object126657:head# 2024-04-01T19:49:04.309 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.309 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7acaa92f:::benchmark_data_smithi188_134454_object120622:head# 2024-04-01T19:49:04.309 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.309 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7acb76fd:::benchmark_data_smithi188_134454_object130446:head# 2024-04-01T19:49:04.309 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.310 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7acc29d7:::benchmark_data_smithi188_134454_object124230:head# 2024-04-01T19:49:04.310 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.321 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7acd898c:::benchmark_data_smithi188_134454_object139703:head# 2024-04-01T19:49:04.321 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.321 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ace8a2d:::benchmark_data_smithi188_134454_object130259:head# 2024-04-01T19:49:04.321 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.321 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ad0682c:::benchmark_data_smithi188_134454_object125595:head# 2024-04-01T19:49:04.321 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.321 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ad0c260:::benchmark_data_smithi188_134454_object125499:head# 2024-04-01T19:49:04.321 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.322 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ad1fee0:::benchmark_data_smithi188_134454_object156605:head# 2024-04-01T19:49:04.322 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.322 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ad21c02:::benchmark_data_smithi188_134454_object124276:head# 2024-04-01T19:49:04.322 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.322 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ad31bee:::benchmark_data_smithi188_134454_object149998:head# 2024-04-01T19:49:04.322 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.322 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ad53f09:::benchmark_data_smithi188_134454_object146280:head# 2024-04-01T19:49:04.322 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.322 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ad544dd:::benchmark_data_smithi188_134454_object151479:head# 2024-04-01T19:49:04.322 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.322 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ad67b75:::benchmark_data_smithi188_134454_object118275:head# 2024-04-01T19:49:04.322 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.322 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ad833dc:::benchmark_data_smithi188_134454_object121840:head# 2024-04-01T19:49:04.322 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.323 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7adb7658:::benchmark_data_smithi188_134454_object121261:head# 2024-04-01T19:49:04.323 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.323 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7add5929:::benchmark_data_smithi188_134454_object144926:head# 2024-04-01T19:49:04.323 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.323 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ae38e65:::benchmark_data_smithi188_134454_object154096:head# 2024-04-01T19:49:04.324 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.324 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ae491ff:::benchmark_data_smithi188_134454_object125500:head# 2024-04-01T19:49:04.324 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.324 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ae7f00f:::benchmark_data_smithi188_134454_object148471:head# 2024-04-01T19:49:04.324 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.324 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ae89212:::benchmark_data_smithi188_134454_object142745:head# 2024-04-01T19:49:04.325 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.325 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7aec2eab:::benchmark_data_smithi188_134454_object119512:head# 2024-04-01T19:49:04.325 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.326 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7aedb4b0:::benchmark_data_smithi188_134454_object134937:head# 2024-04-01T19:49:04.326 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.328 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7aedcfe9:::benchmark_data_smithi188_134454_object136659:head# 2024-04-01T19:49:04.328 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.329 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7aee3f2a:::benchmark_data_smithi188_134454_object116007:head# 2024-04-01T19:49:04.330 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.335 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7aee5fc9:::benchmark_data_smithi188_134454_object150302:head# 2024-04-01T19:49:04.335 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.335 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7aeeafa2:::benchmark_data_smithi188_134454_object148089:head# 2024-04-01T19:49:04.335 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.335 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7af1af0b:::benchmark_data_smithi188_134454_object119963:head# 2024-04-01T19:49:04.335 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.335 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7af416d6:::benchmark_data_smithi188_134454_object132815:head# 2024-04-01T19:49:04.335 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.335 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7af512b9:::benchmark_data_smithi188_134454_object116350:head# 2024-04-01T19:49:04.336 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.336 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7af5acfe:::benchmark_data_smithi188_134454_object126204:head# 2024-04-01T19:49:04.336 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.336 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7afa3752:::benchmark_data_smithi188_134454_object115779:head# 2024-04-01T19:49:04.336 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.336 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7afbcab0:::benchmark_data_smithi188_134454_object119822:head# 2024-04-01T19:49:04.336 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.336 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7afe5b57:::benchmark_data_smithi188_134454_object143052:head# 2024-04-01T19:49:04.336 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.336 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7aff87e6:::benchmark_data_smithi188_134454_object137045:head# 2024-04-01T19:49:04.336 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.336 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b018658:::benchmark_data_smithi188_134454_object120469:head# 2024-04-01T19:49:04.336 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.337 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b02e914:::benchmark_data_smithi188_134454_object131459:head# 2024-04-01T19:49:04.337 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.337 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b037353:::benchmark_data_smithi188_134454_object128043:head# 2024-04-01T19:49:04.337 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.339 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b0374bb:::benchmark_data_smithi188_134454_object146166:head# 2024-04-01T19:49:04.339 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.340 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b03cd71:::benchmark_data_smithi188_134454_object121390:head# 2024-04-01T19:49:04.340 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.340 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b08fda1:::benchmark_data_smithi188_134454_object133721:head# 2024-04-01T19:49:04.340 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.340 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b0c34f6:::benchmark_data_smithi188_134454_object148247:head# 2024-04-01T19:49:04.340 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.340 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b0d3dca:::benchmark_data_smithi188_134454_object116553:head# 2024-04-01T19:49:04.341 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.341 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b127378:::benchmark_data_smithi188_134454_object133275:head# 2024-04-01T19:49:04.341 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.341 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b1297f7:::benchmark_data_smithi188_134454_object121843:head# 2024-04-01T19:49:04.341 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.346 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b12ab3c:::benchmark_data_smithi188_134454_object127920:head# 2024-04-01T19:49:04.346 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.346 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b135095:::benchmark_data_smithi188_134454_object155194:head# 2024-04-01T19:49:04.346 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.347 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b160dce:::benchmark_data_smithi188_134454_object126307:head# 2024-04-01T19:49:04.347 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.347 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b162d15:::benchmark_data_smithi188_134454_object154839:head# 2024-04-01T19:49:04.347 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.348 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b191bb1:::benchmark_data_smithi188_134454_object134255:head# 2024-04-01T19:49:04.348 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.348 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b1a9752:::benchmark_data_smithi188_134454_object125002:head# 2024-04-01T19:49:04.348 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.348 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b1ab877:::benchmark_data_smithi188_134454_object124935:head# 2024-04-01T19:49:04.348 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.348 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b1cd429:::benchmark_data_smithi188_134454_object129461:head# 2024-04-01T19:49:04.348 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.348 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b1dc566:::benchmark_data_smithi188_134454_object135054:head# 2024-04-01T19:49:04.348 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.350 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b1e1ccb:::benchmark_data_smithi188_134454_object153962:head# 2024-04-01T19:49:04.350 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.350 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b1e2e4b:::benchmark_data_smithi188_134454_object150263:head# 2024-04-01T19:49:04.350 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.350 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b1f2594:::benchmark_data_smithi188_134454_object136946:head# 2024-04-01T19:49:04.350 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.350 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b262915:::benchmark_data_smithi188_134454_object156001:head# 2024-04-01T19:49:04.351 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.351 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b294d78:::benchmark_data_smithi188_134454_object131770:head# 2024-04-01T19:49:04.351 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.351 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b299588:::benchmark_data_smithi188_134454_object138530:head# 2024-04-01T19:49:04.351 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.351 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b2c8328:::benchmark_data_smithi188_134454_object151888:head# 2024-04-01T19:49:04.351 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.351 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b2cf3a4:::benchmark_data_smithi188_134454_object156477:head# 2024-04-01T19:49:04.351 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.351 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b2e187f:::benchmark_data_smithi188_134454_object126783:head# 2024-04-01T19:49:04.351 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.354 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b2eb39b:::benchmark_data_smithi188_134454_object146413:head# 2024-04-01T19:49:04.355 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.355 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b33c26a:::benchmark_data_smithi188_134454_object127000:head# 2024-04-01T19:49:04.355 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.355 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b34056a:::benchmark_data_smithi188_134454_object140527:head# 2024-04-01T19:49:04.355 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.355 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b34da3c:::benchmark_data_smithi188_134454_object118235:head# 2024-04-01T19:49:04.355 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.355 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b3b5e14:::benchmark_data_smithi188_134454_object124835:head# 2024-04-01T19:49:04.355 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.355 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b3cbb38:::benchmark_data_smithi188_134454_object117109:head# 2024-04-01T19:49:04.355 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.355 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b3e8483:::benchmark_data_smithi188_134454_object117496:head# 2024-04-01T19:49:04.355 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.355 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b4098d2:::benchmark_data_smithi188_134454_object136583:head# 2024-04-01T19:49:04.355 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.356 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b4127f7:::benchmark_data_smithi188_134454_object146825:head# 2024-04-01T19:49:04.356 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.356 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b426e60:::benchmark_data_smithi188_134454_object149182:head# 2024-04-01T19:49:04.356 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.356 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b427651:::benchmark_data_smithi188_134454_object150992:head# 2024-04-01T19:49:04.356 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.356 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b42e5a4:::benchmark_data_smithi188_134454_object118551:head# 2024-04-01T19:49:04.356 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.356 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b42f4b4:::benchmark_data_smithi188_134454_object137260:head# 2024-04-01T19:49:04.356 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.356 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b479e1a:::benchmark_data_smithi188_134454_object116946:head# 2024-04-01T19:49:04.356 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.356 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b47fd5e:::benchmark_data_smithi188_134454_object147766:head# 2024-04-01T19:49:04.356 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.356 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b4974f3:::benchmark_data_smithi188_134454_object151970:head# 2024-04-01T19:49:04.357 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.357 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b4c44ae:::benchmark_data_smithi188_134454_object139181:head# 2024-04-01T19:49:04.357 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.357 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b4c7779:::benchmark_data_smithi188_134454_object129613:head# 2024-04-01T19:49:04.357 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.358 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b4dea07:::benchmark_data_smithi188_134454_object140970:head# 2024-04-01T19:49:04.358 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.358 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b4e60f9:::benchmark_data_smithi188_134454_object125336:head# 2024-04-01T19:49:04.358 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.359 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b4f9174:::benchmark_data_smithi188_134454_object132333:head# 2024-04-01T19:49:04.359 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.359 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b53a83a:::benchmark_data_smithi188_134454_object146075:head# 2024-04-01T19:49:04.359 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.359 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b54224b:::benchmark_data_smithi188_134454_object143070:head# 2024-04-01T19:49:04.359 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.359 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b561284:::benchmark_data_smithi188_134454_object155197:head# 2024-04-01T19:49:04.359 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.359 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b58265d:::benchmark_data_smithi188_134454_object123989:head# 2024-04-01T19:49:04.359 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.359 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b597c0c:::benchmark_data_smithi188_134454_object140284:head# 2024-04-01T19:49:04.359 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.359 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b5a54d8:::benchmark_data_smithi188_134454_object122399:head# 2024-04-01T19:49:04.359 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.360 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b5c29fe:::benchmark_data_smithi188_134454_object148875:head# 2024-04-01T19:49:04.360 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.360 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b5cb8ed:::benchmark_data_smithi188_134454_object119925:head# 2024-04-01T19:49:04.360 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.360 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b5d0850:::benchmark_data_smithi188_134454_object142991:head# 2024-04-01T19:49:04.360 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.360 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b620854:::benchmark_data_smithi188_134454_object126794:head# 2024-04-01T19:49:04.360 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.360 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b641e46:::benchmark_data_smithi188_134454_object128954:head# 2024-04-01T19:49:04.360 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.360 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b64f85b:::benchmark_data_smithi188_134454_object138346:head# 2024-04-01T19:49:04.360 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.360 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b67bd83:::benchmark_data_smithi188_134454_object119930:head# 2024-04-01T19:49:04.360 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.362 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b699ee4:::benchmark_data_smithi188_134454_object156526:head# 2024-04-01T19:49:04.362 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.362 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b6be71b:::benchmark_data_smithi188_134454_object131288:head# 2024-04-01T19:49:04.362 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.362 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b6c434d:::benchmark_data_smithi188_134454_object151021:head# 2024-04-01T19:49:04.362 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.362 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b6d9fc7:::benchmark_data_smithi188_134454_object146387:head# 2024-04-01T19:49:04.362 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.363 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b6e22c6:::benchmark_data_smithi188_134454_object153347:head# 2024-04-01T19:49:04.363 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.363 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b6ec0f7:::benchmark_data_smithi188_134454_object115772:head# 2024-04-01T19:49:04.363 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.363 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b781674:::benchmark_data_smithi188_134454_object130365:head# 2024-04-01T19:49:04.363 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.363 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b7a5294:::benchmark_data_smithi188_134454_object151759:head# 2024-04-01T19:49:04.363 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.363 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b7c06c7:::benchmark_data_smithi188_134454_object148768:head# 2024-04-01T19:49:04.363 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.363 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b7c6576:::benchmark_data_smithi188_134454_object148975:head# 2024-04-01T19:49:04.363 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.363 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b7e53ef:::benchmark_data_smithi188_134454_object146292:head# 2024-04-01T19:49:04.363 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.364 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b7f7a23:::benchmark_data_smithi188_134454_object153425:head# 2024-04-01T19:49:04.365 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.365 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b81a645:::benchmark_data_smithi188_134454_object130689:head# 2024-04-01T19:49:04.365 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.365 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b85887b:::benchmark_data_smithi188_134454_object128046:head# 2024-04-01T19:49:04.365 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.365 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b87aadb:::benchmark_data_smithi188_134454_object134371:head# 2024-04-01T19:49:04.365 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.365 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b87baea:::benchmark_data_smithi188_134454_object123629:head# 2024-04-01T19:49:04.365 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.365 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b87e04a:::benchmark_data_smithi188_134454_object126717:head# 2024-04-01T19:49:04.365 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.365 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b89bc68:::benchmark_data_smithi188_134454_object144020:head# 2024-04-01T19:49:04.365 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.365 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b8a89ec:::benchmark_data_smithi188_134454_object127195:head# 2024-04-01T19:49:04.366 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.366 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b91b9ce:::benchmark_data_smithi188_134454_object145500:head# 2024-04-01T19:49:04.366 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.366 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b9222bd:::benchmark_data_smithi188_134454_object132258:head# 2024-04-01T19:49:04.366 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.366 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b93fd1c:::benchmark_data_smithi188_134454_object144352:head# 2024-04-01T19:49:04.366 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.366 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b9413d3:::benchmark_data_smithi188_134454_object117087:head# 2024-04-01T19:49:04.367 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.370 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b9478b6:::benchmark_data_smithi188_134454_object127736:head# 2024-04-01T19:49:04.370 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.371 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b9731dd:::benchmark_data_smithi188_134454_object148476:head# 2024-04-01T19:49:04.371 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.371 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b99a3c1:::benchmark_data_smithi188_134454_object141756:head# 2024-04-01T19:49:04.372 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.372 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b9b0e07:::benchmark_data_smithi188_134454_object133745:head# 2024-04-01T19:49:04.372 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.372 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b9b196d:::benchmark_data_smithi188_134454_object137656:head# 2024-04-01T19:49:04.373 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.373 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b9be094:::benchmark_data_smithi188_134454_object156340:head# 2024-04-01T19:49:04.373 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.373 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b9e5f90:::benchmark_data_smithi188_134454_object123701:head# 2024-04-01T19:49:04.373 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.374 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7b9f490e:::benchmark_data_smithi188_134454_object124916:head# 2024-04-01T19:49:04.374 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.374 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ba04c6d:::benchmark_data_smithi188_134454_object127771:head# 2024-04-01T19:49:04.374 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.374 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ba1ee79:::benchmark_data_smithi188_134454_object126071:head# 2024-04-01T19:49:04.374 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.374 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ba3bdd9:::benchmark_data_smithi188_134454_object125497:head# 2024-04-01T19:49:04.374 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.375 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ba4e384:::benchmark_data_smithi188_134454_object123024:head# 2024-04-01T19:49:04.375 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.375 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ba62936:::benchmark_data_smithi188_134454_object116543:head# 2024-04-01T19:49:04.375 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.375 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bac16d1:::benchmark_data_smithi188_134454_object117263:head# 2024-04-01T19:49:04.376 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.376 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bb0581a:::benchmark_data_smithi188_134454_object115447:head# 2024-04-01T19:49:04.376 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.376 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bb0ae16:::benchmark_data_smithi188_134454_object117488:head# 2024-04-01T19:49:04.376 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.376 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bb359d8:::benchmark_data_smithi188_134454_object139730:head# 2024-04-01T19:49:04.376 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.376 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bb3d438:::benchmark_data_smithi188_134454_object132692:head# 2024-04-01T19:49:04.376 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.377 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bb6c373:::benchmark_data_smithi188_134454_object128572:head# 2024-04-01T19:49:04.377 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.377 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bb7822e:::benchmark_data_smithi188_134454_object125062:head# 2024-04-01T19:49:04.377 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.377 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bba47cb:::benchmark_data_smithi188_134454_object144759:head# 2024-04-01T19:49:04.377 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.377 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bba59bd:::benchmark_data_smithi188_134454_object147796:head# 2024-04-01T19:49:04.377 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.378 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bbb2569:::benchmark_data_smithi188_134454_object127959:head# 2024-04-01T19:49:04.378 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.378 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bbb5ca9:::benchmark_data_smithi188_134454_object140218:head# 2024-04-01T19:49:04.378 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.378 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bbf583c:::benchmark_data_smithi188_134454_object127804:head# 2024-04-01T19:49:04.378 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.378 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bc06f40:::benchmark_data_smithi188_134454_object154882:head# 2024-04-01T19:49:04.378 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.379 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bc19a72:::benchmark_data_smithi188_134454_object127005:head# 2024-04-01T19:49:04.379 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.379 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bc1baaa:::benchmark_data_smithi188_134454_object119076:head# 2024-04-01T19:49:04.379 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.380 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bc2fa25:::benchmark_data_smithi188_134454_object134747:head# 2024-04-01T19:49:04.380 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.380 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bc5ceea:::benchmark_data_smithi188_134454_object121139:head# 2024-04-01T19:49:04.380 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.384 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bc5e6bd:::benchmark_data_smithi188_134454_object146119:head# 2024-04-01T19:49:04.384 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.384 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bc6c2ee:::benchmark_data_smithi188_134454_object129363:head# 2024-04-01T19:49:04.384 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.384 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bc72790:::benchmark_data_smithi188_134454_object149915:head# 2024-04-01T19:49:04.384 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.384 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bc87c2a:::benchmark_data_smithi188_134454_object120423:head# 2024-04-01T19:49:04.385 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.388 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bc87c89:::benchmark_data_smithi188_134454_object151376:head# 2024-04-01T19:49:04.388 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.388 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bc9113c:::benchmark_data_smithi188_134454_object141123:head# 2024-04-01T19:49:04.388 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.388 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bc9346d:::benchmark_data_smithi188_134454_object154735:head# 2024-04-01T19:49:04.389 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.389 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bc9b328:::benchmark_data_smithi188_134454_object139098:head# 2024-04-01T19:49:04.389 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.389 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bca0c45:::benchmark_data_smithi188_134454_object154510:head# 2024-04-01T19:49:04.389 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.389 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bcb3553:::benchmark_data_smithi188_134454_object123387:head# 2024-04-01T19:49:04.389 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.390 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bcce52d:::benchmark_data_smithi188_134454_object149784:head# 2024-04-01T19:49:04.390 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.390 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bce28ae:::benchmark_data_smithi188_134454_object148495:head# 2024-04-01T19:49:04.390 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.390 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bce7c37:::benchmark_data_smithi188_134454_object119845:head# 2024-04-01T19:49:04.391 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.391 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bcef3ed:::benchmark_data_smithi188_134454_object119144:head# 2024-04-01T19:49:04.391 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.391 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bcf38f1:::benchmark_data_smithi188_134454_object151558:head# 2024-04-01T19:49:04.391 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.392 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bcfcdaf:::benchmark_data_smithi188_134454_object153758:head# 2024-04-01T19:49:04.392 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.392 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bd1711b:::benchmark_data_smithi188_134454_object139806:head# 2024-04-01T19:49:04.392 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.392 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bd439db:::benchmark_data_smithi188_134454_object139751:head# 2024-04-01T19:49:04.392 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.393 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bd4d01e:::benchmark_data_smithi188_134454_object149674:head# 2024-04-01T19:49:04.393 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.393 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bd94642:::benchmark_data_smithi188_134454_object132667:head# 2024-04-01T19:49:04.393 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.393 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bd98a72:::benchmark_data_smithi188_134454_object116739:head# 2024-04-01T19:49:04.393 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.393 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bdb8c85:::benchmark_data_smithi188_134454_object121039:head# 2024-04-01T19:49:04.394 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.394 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bdc4a86:::benchmark_data_smithi188_134454_object140380:head# 2024-04-01T19:49:04.394 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.395 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bdf2f34:::benchmark_data_smithi188_134454_object140587:head# 2024-04-01T19:49:04.395 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.395 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bdfc839:::benchmark_data_smithi188_134454_object155359:head# 2024-04-01T19:49:04.395 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.396 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7be4aa46:::benchmark_data_smithi188_134454_object154055:head# 2024-04-01T19:49:04.396 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.396 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7be6ef03:::benchmark_data_smithi188_134454_object156145:head# 2024-04-01T19:49:04.396 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.397 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7be83762:::benchmark_data_smithi188_134454_object117999:head# 2024-04-01T19:49:04.397 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.397 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bea1149:::benchmark_data_smithi188_134454_object153956:head# 2024-04-01T19:49:04.397 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.397 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7beb1e4b:::benchmark_data_smithi188_134454_object141737:head# 2024-04-01T19:49:04.397 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.397 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bec102d:::benchmark_data_smithi188_134454_object151051:head# 2024-04-01T19:49:04.397 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.398 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7becafb7:::benchmark_data_smithi188_134454_object146278:head# 2024-04-01T19:49:04.398 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.398 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bee470f:::benchmark_data_smithi188_134454_object152725:head# 2024-04-01T19:49:04.398 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.398 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7beeb97d:::benchmark_data_smithi188_134454_object126674:head# 2024-04-01T19:49:04.398 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.402 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bef6db4:::benchmark_data_smithi188_134454_object122269:head# 2024-04-01T19:49:04.402 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.405 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7befb8b1:::benchmark_data_smithi188_134454_object127666:head# 2024-04-01T19:49:04.405 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.405 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bf1aa7b:::benchmark_data_smithi188_134454_object147603:head# 2024-04-01T19:49:04.405 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.409 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bf2aa86:::benchmark_data_smithi188_134454_object152984:head# 2024-04-01T19:49:04.409 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.409 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bf4065b:::benchmark_data_smithi188_134454_object134201:head# 2024-04-01T19:49:04.409 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.409 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bf422e5:::benchmark_data_smithi188_134454_object127429:head# 2024-04-01T19:49:04.409 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.409 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bf521f6:::benchmark_data_smithi188_134454_object142765:head# 2024-04-01T19:49:04.409 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.411 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bfaf74e:::benchmark_data_smithi188_134454_object146675:head# 2024-04-01T19:49:04.411 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.411 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bfb9395:::benchmark_data_smithi188_134454_object119684:head# 2024-04-01T19:49:04.411 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.411 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bfb99a0:::benchmark_data_smithi188_134454_object126877:head# 2024-04-01T19:49:04.411 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.411 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bfd4caf:::benchmark_data_smithi188_134454_object150867:head# 2024-04-01T19:49:04.411 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.411 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7bfe899c:::benchmark_data_smithi188_134454_object135623:head# 2024-04-01T19:49:04.411 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.412 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c03ce3a:::benchmark_data_smithi188_134454_object122772:head# 2024-04-01T19:49:04.412 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.413 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c0acfb6:::benchmark_data_smithi188_134454_object142065:head# 2024-04-01T19:49:04.413 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.413 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c0b3b1b:::benchmark_data_smithi188_134454_object117548:head# 2024-04-01T19:49:04.413 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.413 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c0cb075:::benchmark_data_smithi188_134454_object156373:head# 2024-04-01T19:49:04.413 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.413 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c0ddeca:::benchmark_data_smithi188_134454_object117744:head# 2024-04-01T19:49:04.413 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.413 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c10db01:::benchmark_data_smithi188_134454_object153697:head# 2024-04-01T19:49:04.413 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.415 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c1118a0:::benchmark_data_smithi188_134454_object127478:head# 2024-04-01T19:49:04.415 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.415 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c113c41:::benchmark_data_smithi188_134454_object120521:head# 2024-04-01T19:49:04.415 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.415 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c11c08e:::benchmark_data_smithi188_134454_object142160:head# 2024-04-01T19:49:04.415 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.415 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c1200de:::benchmark_data_smithi188_134454_object123236:head# 2024-04-01T19:49:04.415 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.415 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c123902:::benchmark_data_smithi188_134454_object135386:head# 2024-04-01T19:49:04.415 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.415 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c156af3:::benchmark_data_smithi188_134454_object156686:head# 2024-04-01T19:49:04.415 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.416 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c196913:::benchmark_data_smithi188_134454_object149484:head# 2024-04-01T19:49:04.416 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.416 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c19a808:::benchmark_data_smithi188_134454_object121894:head# 2024-04-01T19:49:04.416 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.416 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c1ac9df:::benchmark_data_smithi188_134454_object145264:head# 2024-04-01T19:49:04.416 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.416 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c1b04e3:::benchmark_data_smithi188_134454_object127279:head# 2024-04-01T19:49:04.416 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.420 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c1b3531:::benchmark_data_smithi188_134454_object143599:head# 2024-04-01T19:49:04.420 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.420 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c1de816:::benchmark_data_smithi188_134454_object123160:head# 2024-04-01T19:49:04.420 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.421 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c217e48:::benchmark_data_smithi188_134454_object156428:head# 2024-04-01T19:49:04.421 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.421 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c24e97d:::benchmark_data_smithi188_134454_object126672:head# 2024-04-01T19:49:04.421 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.421 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c25f879:::benchmark_data_smithi188_134454_object124497:head# 2024-04-01T19:49:04.421 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.421 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c29bd26:::benchmark_data_smithi188_134454_object129990:head# 2024-04-01T19:49:04.421 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.421 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c2aee55:::benchmark_data_smithi188_134454_object135887:head# 2024-04-01T19:49:04.421 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.421 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c2ca24b:::benchmark_data_smithi188_134454_object121828:head# 2024-04-01T19:49:04.421 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.421 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c2d0a04:::benchmark_data_smithi188_134454_object120870:head# 2024-04-01T19:49:04.421 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.422 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c305d43:::benchmark_data_smithi188_134454_object118874:head# 2024-04-01T19:49:04.422 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.422 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c329cf8:::benchmark_data_smithi188_134454_object154421:head# 2024-04-01T19:49:04.422 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.422 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c338fe2:::benchmark_data_smithi188_134454_object141608:head# 2024-04-01T19:49:04.422 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.422 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c34011f:::benchmark_data_smithi188_134454_object123796:head# 2024-04-01T19:49:04.422 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.422 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c34cbc8:::benchmark_data_smithi188_134454_object126292:head# 2024-04-01T19:49:04.422 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.422 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c388189:::benchmark_data_smithi188_134454_object148840:head# 2024-04-01T19:49:04.422 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.422 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c391a41:::benchmark_data_smithi188_134454_object130917:head# 2024-04-01T19:49:04.422 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.423 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c39d900:::benchmark_data_smithi188_134454_object143427:head# 2024-04-01T19:49:04.423 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.424 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c3b49f6:::benchmark_data_smithi188_134454_object120207:head# 2024-04-01T19:49:04.424 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.424 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c3b6d0c:::benchmark_data_smithi188_134454_object139417:head# 2024-04-01T19:49:04.424 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.424 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c3c193d:::benchmark_data_smithi188_134454_object138148:head# 2024-04-01T19:49:04.424 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.424 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c3e6b4f:::benchmark_data_smithi188_134454_object147367:head# 2024-04-01T19:49:04.424 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.424 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c3f3a34:::benchmark_data_smithi188_134454_object140384:head# 2024-04-01T19:49:04.424 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.424 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c406186:::benchmark_data_smithi188_134454_object144830:head# 2024-04-01T19:49:04.424 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.424 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c42d921:::benchmark_data_smithi188_134454_object140068:head# 2024-04-01T19:49:04.425 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.425 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c481a58:::benchmark_data_smithi188_134454_object142847:head# 2024-04-01T19:49:04.425 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.425 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c488f88:::benchmark_data_smithi188_134454_object148790:head# 2024-04-01T19:49:04.425 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.425 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c4916c4:::benchmark_data_smithi188_134454_object151705:head# 2024-04-01T19:49:04.425 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.426 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c4b3827:::benchmark_data_smithi188_134454_object151821:head# 2024-04-01T19:49:04.426 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.427 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c4e7704:::benchmark_data_smithi188_134454_object137560:head# 2024-04-01T19:49:04.427 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.427 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c4e8b1b:::benchmark_data_smithi188_134454_object145511:head# 2024-04-01T19:49:04.427 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.427 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c4f2450:::benchmark_data_smithi188_134454_object143547:head# 2024-04-01T19:49:04.427 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.428 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c4fc394:::benchmark_data_smithi188_134454_object125835:head# 2024-04-01T19:49:04.428 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.428 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c4ff3f0:::benchmark_data_smithi188_134454_object123094:head# 2024-04-01T19:49:04.428 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.428 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c514f44:::benchmark_data_smithi188_134454_object119996:head# 2024-04-01T19:49:04.428 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.429 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c518e56:::benchmark_data_smithi188_134454_object130978:head# 2024-04-01T19:49:04.429 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.429 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c53a6a1:::benchmark_data_smithi188_134454_object125995:head# 2024-04-01T19:49:04.429 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.430 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c53f2e7:::benchmark_data_smithi188_134454_object127351:head# 2024-04-01T19:49:04.430 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.430 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c55db27:::benchmark_data_smithi188_134454_object156451:head# 2024-04-01T19:49:04.430 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.430 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c56564f:::benchmark_data_smithi188_134454_object140504:head# 2024-04-01T19:49:04.430 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.430 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c58373c:::benchmark_data_smithi188_134454_object149586:head# 2024-04-01T19:49:04.430 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.430 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c5930fa:::benchmark_data_smithi188_134454_object136030:head# 2024-04-01T19:49:04.431 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.431 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c5a4144:::benchmark_data_smithi188_134454_object124668:head# 2024-04-01T19:49:04.431 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.431 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c5bc1ed:::benchmark_data_smithi188_134454_object144194:head# 2024-04-01T19:49:04.431 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.431 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c5bee21:::benchmark_data_smithi188_134454_object154841:head# 2024-04-01T19:49:04.432 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.432 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c5c7ae2:::benchmark_data_smithi188_134454_object139390:head# 2024-04-01T19:49:04.432 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.432 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c5f30cf:::benchmark_data_smithi188_134454_object142852:head# 2024-04-01T19:49:04.432 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.432 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c62ff7b:::benchmark_data_smithi188_134454_object136244:head# 2024-04-01T19:49:04.432 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.435 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c633b55:::benchmark_data_smithi188_134454_object124300:head# 2024-04-01T19:49:04.435 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.435 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c64cfe1:::benchmark_data_smithi188_134454_object134650:head# 2024-04-01T19:49:04.435 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.435 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c67ce36:::benchmark_data_smithi188_134454_object152962:head# 2024-04-01T19:49:04.435 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.435 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c6d97f2:::benchmark_data_smithi188_134454_object139409:head# 2024-04-01T19:49:04.435 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.435 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c6e1c84:::benchmark_data_smithi188_134454_object121862:head# 2024-04-01T19:49:04.435 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.436 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c6e4456:::benchmark_data_smithi188_134454_object120684:head# 2024-04-01T19:49:04.436 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.436 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c719dc3:::benchmark_data_smithi188_134454_object123050:head# 2024-04-01T19:49:04.436 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.436 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c7279be:::benchmark_data_smithi188_134454_object132707:head# 2024-04-01T19:49:04.436 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.436 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c763e21:::benchmark_data_smithi188_134454_object141735:head# 2024-04-01T19:49:04.436 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.436 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c76d7ea:::benchmark_data_smithi188_134454_object134016:head# 2024-04-01T19:49:04.436 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.436 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c77ed06:::benchmark_data_smithi188_134454_object146253:head# 2024-04-01T19:49:04.436 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.436 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c793ca7:::benchmark_data_smithi188_134454_object127317:head# 2024-04-01T19:49:04.436 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.437 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c7c3839:::benchmark_data_smithi188_134454_object139583:head# 2024-04-01T19:49:04.437 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.437 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c7c9d88:::benchmark_data_smithi188_134454_object151513:head# 2024-04-01T19:49:04.437 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.438 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c7e311b:::benchmark_data_smithi188_134454_object120831:head# 2024-04-01T19:49:04.438 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.439 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c80cb31:::benchmark_data_smithi188_134454_object133605:head# 2024-04-01T19:49:04.439 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.439 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c8190d8:::benchmark_data_smithi188_134454_object147161:head# 2024-04-01T19:49:04.439 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.439 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c81fe6f:::benchmark_data_smithi188_134454_object123284:head# 2024-04-01T19:49:04.439 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.439 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c835f1e:::benchmark_data_smithi188_134454_object143780:head# 2024-04-01T19:49:04.439 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.439 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c8399a9:::benchmark_data_smithi188_134454_object122631:head# 2024-04-01T19:49:04.439 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.439 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c8590a4:::benchmark_data_smithi188_134454_object148340:head# 2024-04-01T19:49:04.439 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.439 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c85d696:::benchmark_data_smithi188_134454_object119352:head# 2024-04-01T19:49:04.439 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.440 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c864907:::benchmark_data_smithi188_134454_object126343:head# 2024-04-01T19:49:04.440 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.441 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c866d6b:::benchmark_data_smithi188_134454_object128061:head# 2024-04-01T19:49:04.441 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.451 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c886f46:::benchmark_data_smithi188_134454_object131115:head# 2024-04-01T19:49:04.451 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.451 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c89f7b0:::benchmark_data_smithi188_134454_object125582:head# 2024-04-01T19:49:04.451 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.451 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c8a5e02:::benchmark_data_smithi188_134454_object124572:head# 2024-04-01T19:49:04.451 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.451 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c8c9b6f:::benchmark_data_smithi188_134454_object147798:head# 2024-04-01T19:49:04.452 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.452 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c8ce0d2:::benchmark_data_smithi188_134454_object152620:head# 2024-04-01T19:49:04.452 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.452 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c8d120d:::benchmark_data_smithi188_134454_object151340:head# 2024-04-01T19:49:04.452 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.452 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c8d51ad:::benchmark_data_smithi188_134454_object141591:head# 2024-04-01T19:49:04.452 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.452 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c8d7417:::benchmark_data_smithi188_134454_object139753:head# 2024-04-01T19:49:04.452 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.452 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c8f4911:::benchmark_data_smithi188_134454_object121585:head# 2024-04-01T19:49:04.452 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.452 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c9399b0:::benchmark_data_smithi188_134454_object124192:head# 2024-04-01T19:49:04.452 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.452 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c95415a:::benchmark_data_smithi188_134454_object126886:head# 2024-04-01T19:49:04.453 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.453 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c96622e:::benchmark_data_smithi188_134454_object134932:head# 2024-04-01T19:49:04.453 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.453 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c969e5b:::benchmark_data_smithi188_134454_object152794:head# 2024-04-01T19:49:04.453 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.453 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c97ae8f:::benchmark_data_smithi188_134454_object136159:head# 2024-04-01T19:49:04.453 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.453 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c9ae82e:::benchmark_data_smithi188_134454_object155512:head# 2024-04-01T19:49:04.453 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.453 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c9cc8dc:::benchmark_data_smithi188_134454_object151300:head# 2024-04-01T19:49:04.453 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.453 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c9d668e:::benchmark_data_smithi188_134454_object143692:head# 2024-04-01T19:49:04.453 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.453 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c9e8d61:::benchmark_data_smithi188_134454_object134522:head# 2024-04-01T19:49:04.454 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.454 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7c9f4d52:::benchmark_data_smithi188_134454_object122285:head# 2024-04-01T19:49:04.454 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.454 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ca3cc89:::benchmark_data_smithi188_134454_object133976:head# 2024-04-01T19:49:04.454 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.454 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ca50bdb:::benchmark_data_smithi188_134454_object122275:head# 2024-04-01T19:49:04.454 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.454 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ca7301d:::benchmark_data_smithi188_134454_object122089:head# 2024-04-01T19:49:04.454 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.454 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ca78b0a:::benchmark_data_smithi188_134454_object153295:head# 2024-04-01T19:49:04.454 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.454 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7caa642a:::benchmark_data_smithi188_134454_object139717:head# 2024-04-01T19:49:04.454 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.456 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cab7f56:::benchmark_data_smithi188_134454_object151612:head# 2024-04-01T19:49:04.456 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.456 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cac098a:::benchmark_data_smithi188_134454_object120006:head# 2024-04-01T19:49:04.456 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.456 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cac7107:::benchmark_data_smithi188_134454_object125343:head# 2024-04-01T19:49:04.456 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.456 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cad6bb1:::benchmark_data_smithi188_134454_object144378:head# 2024-04-01T19:49:04.456 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.457 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cb5dc1c:::benchmark_data_smithi188_134454_object146415:head# 2024-04-01T19:49:04.457 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.457 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cb6f277:::benchmark_data_smithi188_134454_object133813:head# 2024-04-01T19:49:04.457 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.457 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cb72784:::benchmark_data_smithi188_134454_object145658:head# 2024-04-01T19:49:04.457 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.457 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cb7d0d4:::benchmark_data_smithi188_134454_object120057:head# 2024-04-01T19:49:04.457 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.457 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cba570d:::benchmark_data_smithi188_134454_object125132:head# 2024-04-01T19:49:04.457 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.457 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cba8f4c:::benchmark_data_smithi188_134454_object127976:head# 2024-04-01T19:49:04.457 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.457 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cbb545c:::benchmark_data_smithi188_134454_object146947:head# 2024-04-01T19:49:04.458 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.458 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cbf3ab1:::benchmark_data_smithi188_134454_object142219:head# 2024-04-01T19:49:04.458 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.458 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cc5c57c:::benchmark_data_smithi188_134454_object135822:head# 2024-04-01T19:49:04.458 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.458 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cc5d692:::benchmark_data_smithi188_134454_object136206:head# 2024-04-01T19:49:04.458 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.458 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ccadc39:::benchmark_data_smithi188_134454_object137222:head# 2024-04-01T19:49:04.458 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.458 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ccb9d58:::benchmark_data_smithi188_134454_object149851:head# 2024-04-01T19:49:04.458 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.458 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cccd356:::benchmark_data_smithi188_134454_object123821:head# 2024-04-01T19:49:04.459 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.459 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ccec4e4:::benchmark_data_smithi188_134454_object129810:head# 2024-04-01T19:49:04.459 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.459 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ccfd05a:::benchmark_data_smithi188_134454_object137697:head# 2024-04-01T19:49:04.459 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.461 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cd1deb5:::benchmark_data_smithi188_134454_object138714:head# 2024-04-01T19:49:04.461 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.461 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cd24676:::benchmark_data_smithi188_134454_object153229:head# 2024-04-01T19:49:04.461 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.461 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cd30319:::benchmark_data_smithi188_134454_object137742:head# 2024-04-01T19:49:04.461 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.461 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cd33206:::benchmark_data_smithi188_134454_object152921:head# 2024-04-01T19:49:04.461 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.461 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cd37591:::benchmark_data_smithi188_134454_object126883:head# 2024-04-01T19:49:04.461 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.461 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cd59dc5:::benchmark_data_smithi188_134454_object151188:head# 2024-04-01T19:49:04.461 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.461 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cd7cac0:::benchmark_data_smithi188_134454_object150614:head# 2024-04-01T19:49:04.462 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.462 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cd80880:::benchmark_data_smithi188_134454_object147889:head# 2024-04-01T19:49:04.462 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.462 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cda4097:::benchmark_data_smithi188_134454_object139235:head# 2024-04-01T19:49:04.462 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.462 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cda8add:::benchmark_data_smithi188_134454_object146158:head# 2024-04-01T19:49:04.462 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.462 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cdf7493:::benchmark_data_smithi188_134454_object140010:head# 2024-04-01T19:49:04.462 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.462 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ce0405d:::benchmark_data_smithi188_134454_object149835:head# 2024-04-01T19:49:04.462 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.462 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ce0d70b:::benchmark_data_smithi188_134454_object146579:head# 2024-04-01T19:49:04.462 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.463 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ce0dd05:::benchmark_data_smithi188_134454_object143850:head# 2024-04-01T19:49:04.463 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.467 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ce16554:::benchmark_data_smithi188_134454_object135703:head# 2024-04-01T19:49:04.467 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.467 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ce1be56:::benchmark_data_smithi188_134454_object128331:head# 2024-04-01T19:49:04.467 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.467 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ce1c196:::benchmark_data_smithi188_134454_object148224:head# 2024-04-01T19:49:04.467 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.467 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ce210fa:::benchmark_data_smithi188_134454_object152455:head# 2024-04-01T19:49:04.467 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.467 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ce234b7:::benchmark_data_smithi188_134454_object129341:head# 2024-04-01T19:49:04.467 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.468 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ce2d9ea:::benchmark_data_smithi188_134454_object143904:head# 2024-04-01T19:49:04.468 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.468 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ce61434:::benchmark_data_smithi188_134454_object129483:head# 2024-04-01T19:49:04.468 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.468 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ce75ab7:::benchmark_data_smithi188_134454_object139264:head# 2024-04-01T19:49:04.468 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.468 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ce7c220:::benchmark_data_smithi188_134454_object143054:head# 2024-04-01T19:49:04.468 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.468 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ce8268f:::benchmark_data_smithi188_134454_object129324:head# 2024-04-01T19:49:04.468 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.468 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ce8ba56:::benchmark_data_smithi188_134454_object130658:head# 2024-04-01T19:49:04.468 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.470 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ceb3472:::benchmark_data_smithi188_134454_object147752:head# 2024-04-01T19:49:04.471 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.471 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cedad24:::benchmark_data_smithi188_134454_object147799:head# 2024-04-01T19:49:04.471 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.471 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cef122c:::benchmark_data_smithi188_134454_object127235:head# 2024-04-01T19:49:04.471 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.471 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cf00dee:::benchmark_data_smithi188_134454_object155075:head# 2024-04-01T19:49:04.471 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.471 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cf36b9e:::benchmark_data_smithi188_134454_object121672:head# 2024-04-01T19:49:04.471 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.471 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cf3d72f:::benchmark_data_smithi188_134454_object131548:head# 2024-04-01T19:49:04.471 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.471 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cf4108d:::benchmark_data_smithi188_134454_object118461:head# 2024-04-01T19:49:04.471 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.472 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cf63d0d:::benchmark_data_smithi188_134454_object116881:head# 2024-04-01T19:49:04.472 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.472 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cf8d023:::benchmark_data_smithi188_134454_object128190:head# 2024-04-01T19:49:04.472 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.472 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cf97dfc:::benchmark_data_smithi188_134454_object153112:head# 2024-04-01T19:49:04.472 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.472 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cf9da1f:::benchmark_data_smithi188_134454_object145157:head# 2024-04-01T19:49:04.472 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.472 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cfad59b:::benchmark_data_smithi188_134454_object135111:head# 2024-04-01T19:49:04.472 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.472 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cfade86:::benchmark_data_smithi188_134454_object146532:head# 2024-04-01T19:49:04.472 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.472 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cfaed26:::benchmark_data_smithi188_134454_object125144:head# 2024-04-01T19:49:04.472 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.474 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cfb3db2:::benchmark_data_smithi188_134454_object123522:head# 2024-04-01T19:49:04.474 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.474 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7cff1ff4:::benchmark_data_smithi188_134454_object147598:head# 2024-04-01T19:49:04.474 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.474 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d019f7c:::benchmark_data_smithi188_134454_object124983:head# 2024-04-01T19:49:04.474 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.474 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d02073a:::benchmark_data_smithi188_134454_object118223:head# 2024-04-01T19:49:04.475 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.475 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d023bbb:::benchmark_data_smithi188_134454_object135201:head# 2024-04-01T19:49:04.475 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.475 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d034763:::benchmark_data_smithi188_134454_object153875:head# 2024-04-01T19:49:04.475 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.475 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d07fe27:::benchmark_data_smithi188_134454_object140791:head# 2024-04-01T19:49:04.475 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.475 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d08828d:::benchmark_data_smithi188_134454_object131536:head# 2024-04-01T19:49:04.475 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.475 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d09b746:::benchmark_data_smithi188_134454_object146012:head# 2024-04-01T19:49:04.475 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.475 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d0a8061:::benchmark_data_smithi188_134454_object124159:head# 2024-04-01T19:49:04.475 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.479 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d0b0826:::benchmark_data_smithi188_134454_object145037:head# 2024-04-01T19:49:04.479 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.479 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d0cb430:::benchmark_data_smithi188_134454_object121489:head# 2024-04-01T19:49:04.479 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.479 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d0f47ca:::benchmark_data_smithi188_134454_object116994:head# 2024-04-01T19:49:04.479 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.480 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d1024c7:::benchmark_data_smithi188_134454_object131516:head# 2024-04-01T19:49:04.480 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.480 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d104dbf:::benchmark_data_smithi188_134454_object133048:head# 2024-04-01T19:49:04.480 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.480 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d10bf46:::benchmark_data_smithi188_134454_object151218:head# 2024-04-01T19:49:04.480 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.480 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d111800:::benchmark_data_smithi188_134454_object138119:head# 2024-04-01T19:49:04.480 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.481 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d1299d7:::benchmark_data_smithi188_134454_object145928:head# 2024-04-01T19:49:04.481 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.481 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d13e291:::benchmark_data_smithi188_134454_object146426:head# 2024-04-01T19:49:04.481 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.481 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d13f755:::benchmark_data_smithi188_134454_object152593:head# 2024-04-01T19:49:04.481 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.481 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d177aba:::benchmark_data_smithi188_134454_object124866:head# 2024-04-01T19:49:04.482 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.482 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:49:04.483 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d18c678:::benchmark_data_smithi188_134454_object141096:head# 2024-04-01T19:49:04.483 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.483 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d19a180:::benchmark_data_smithi188_134454_object151186:head# 2024-04-01T19:49:04.483 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.483 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d1d8972:::benchmark_data_smithi188_134454_object129491:head# 2024-04-01T19:49:04.483 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.483 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d1e03cc:::benchmark_data_smithi188_134454_object153756:head# 2024-04-01T19:49:04.484 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.486 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d1e60a5:::benchmark_data_smithi188_134454_object127650:head# 2024-04-01T19:49:04.486 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.486 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d20fa21:::benchmark_data_smithi188_134454_object129630:head# 2024-04-01T19:49:04.486 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.486 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d23e7d3:::benchmark_data_smithi188_134454_object123872:head# 2024-04-01T19:49:04.486 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.486 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d28377f:::benchmark_data_smithi188_134454_object128169:head# 2024-04-01T19:49:04.486 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.486 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d2a93dd:::benchmark_data_smithi188_134454_object119105:head# 2024-04-01T19:49:04.487 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.487 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d3024cd:::benchmark_data_smithi188_134454_object121046:head# 2024-04-01T19:49:04.487 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.487 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d341a6a:::benchmark_data_smithi188_134454_object130703:head# 2024-04-01T19:49:04.487 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.487 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d39dd2e:::benchmark_data_smithi188_134454_object138801:head# 2024-04-01T19:49:04.487 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.487 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d3addab:::benchmark_data_smithi188_134454_object148531:head# 2024-04-01T19:49:04.487 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.489 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d3aeb06:::benchmark_data_smithi188_134454_object129869:head# 2024-04-01T19:49:04.489 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.489 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d3d26aa:::benchmark_data_smithi188_134454_object121804:head# 2024-04-01T19:49:04.489 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.489 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d3e0173:::benchmark_data_smithi188_134454_object151611:head# 2024-04-01T19:49:04.489 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.489 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d4071ab:::benchmark_data_smithi188_134454_object137326:head# 2024-04-01T19:49:04.489 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.490 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d41252b:::benchmark_data_smithi188_134454_object146510:head# 2024-04-01T19:49:04.490 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.490 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d430c02:::benchmark_data_smithi188_134454_object145335:head# 2024-04-01T19:49:04.490 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.490 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d455c3c:::benchmark_data_smithi188_134454_object142943:head# 2024-04-01T19:49:04.490 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.490 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d4887bc:::benchmark_data_smithi188_134454_object156176:head# 2024-04-01T19:49:04.490 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.490 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d4b5621:::benchmark_data_smithi188_134454_object135786:head# 2024-04-01T19:49:04.490 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.490 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d4e3255:::benchmark_data_smithi188_134454_object120031:head# 2024-04-01T19:49:04.490 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.491 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:04.492 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:49:04.493 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d4ffebd:::benchmark_data_smithi188_134454_object115473:head# 2024-04-01T19:49:04.493 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.493 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d513af1:::benchmark_data_smithi188_134454_object129086:head# 2024-04-01T19:49:04.493 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.493 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d518db8:::benchmark_data_smithi188_134454_object122481:head# 2024-04-01T19:49:04.493 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.494 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d5481a2:::benchmark_data_smithi188_134454_object144104:head# 2024-04-01T19:49:04.494 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.494 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d5560e2:::benchmark_data_smithi188_134454_object115605:head# 2024-04-01T19:49:04.494 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.494 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d56d324:::benchmark_data_smithi188_134454_object149077:head# 2024-04-01T19:49:04.494 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.494 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d58954d:::benchmark_data_smithi188_134454_object128971:head# 2024-04-01T19:49:04.494 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.494 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d58cc21:::benchmark_data_smithi188_134454_object119583:head# 2024-04-01T19:49:04.494 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.494 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d59ae93:::benchmark_data_smithi188_134454_object128943:head# 2024-04-01T19:49:04.494 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.494 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d5a9fbf:::benchmark_data_smithi188_134454_object121404:head# 2024-04-01T19:49:04.495 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.495 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d5d6fec:::benchmark_data_smithi188_134454_object131880:head# 2024-04-01T19:49:04.495 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.495 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d5ed18f:::benchmark_data_smithi188_134454_object129138:head# 2024-04-01T19:49:04.495 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.495 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d5f76fc:::benchmark_data_smithi188_134454_object117085:head# 2024-04-01T19:49:04.495 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.498 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d6012e8:::benchmark_data_smithi188_134454_object155988:head# 2024-04-01T19:49:04.498 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.498 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d606223:::benchmark_data_smithi188_134454_object115980:head# 2024-04-01T19:49:04.498 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.499 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d6186ec:::benchmark_data_smithi188_134454_object156270:head# 2024-04-01T19:49:04.499 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.499 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d6619e8:::benchmark_data_smithi188_134454_object123641:head# 2024-04-01T19:49:04.499 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.499 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d699d05:::benchmark_data_smithi188_134454_object132587:head# 2024-04-01T19:49:04.499 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.499 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d6fbc84:::benchmark_data_smithi188_134454_object117694:head# 2024-04-01T19:49:04.499 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.499 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d717e2b:::benchmark_data_smithi188_134454_object131701:head# 2024-04-01T19:49:04.499 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.499 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d72ee68:::benchmark_data_smithi188_134454_object144516:head# 2024-04-01T19:49:04.499 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.499 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d74b249:::benchmark_data_smithi188_134454_object141457:head# 2024-04-01T19:49:04.499 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.500 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d775357:::benchmark_data_smithi188_134454_object136453:head# 2024-04-01T19:49:04.500 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.500 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d77676d:::benchmark_data_smithi188_134454_object123348:head# 2024-04-01T19:49:04.500 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.500 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d78a42d:::benchmark_data_smithi188_134454_object135220:head# 2024-04-01T19:49:04.500 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.500 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d78ee2a:::benchmark_data_smithi188_134454_object122641:head# 2024-04-01T19:49:04.500 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.500 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d7924f0:::benchmark_data_smithi188_134454_object126457:head# 2024-04-01T19:49:04.500 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.500 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d7950e3:::benchmark_data_smithi188_134454_object132268:head# 2024-04-01T19:49:04.500 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.500 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d7a4228:::benchmark_data_smithi188_134454_object147934:head# 2024-04-01T19:49:04.500 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.500 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d7e0ddf:::benchmark_data_smithi188_134454_object146772:head# 2024-04-01T19:49:04.501 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.501 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d7f3c11:::benchmark_data_smithi188_134454_object127197:head# 2024-04-01T19:49:04.501 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.501 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d81a3a7:::benchmark_data_smithi188_134454_object146519:head# 2024-04-01T19:49:04.501 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.502 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d8519ac:::benchmark_data_smithi188_134454_object141868:head# 2024-04-01T19:49:04.502 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.502 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d856668:::benchmark_data_smithi188_134454_object152042:head# 2024-04-01T19:49:04.502 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.502 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d861e7f:::benchmark_data_smithi188_134454_object143200:head# 2024-04-01T19:49:04.502 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.502 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d875f28:::benchmark_data_smithi188_134454_object144671:head# 2024-04-01T19:49:04.503 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.503 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d88aed6:::benchmark_data_smithi188_134454_object152910:head# 2024-04-01T19:49:04.503 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.503 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d8919e8:::benchmark_data_smithi188_134454_object122448:head# 2024-04-01T19:49:04.503 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.503 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d8ae4ce:::benchmark_data_smithi188_134454_object153952:head# 2024-04-01T19:49:04.503 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.503 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d8c416f:::benchmark_data_smithi188_134454_object141029:head# 2024-04-01T19:49:04.504 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.504 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d8ccb6b:::benchmark_data_smithi188_134454_object148071:head# 2024-04-01T19:49:04.504 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.504 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d8d3d0e:::benchmark_data_smithi188_134454_object150996:head# 2024-04-01T19:49:04.504 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.505 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d8d83e9:::benchmark_data_smithi188_134454_object115417:head# 2024-04-01T19:49:04.505 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.505 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d8dd345:::benchmark_data_smithi188_134454_object154721:head# 2024-04-01T19:49:04.505 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.506 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d8ec4fa:::benchmark_data_smithi188_134454_object137988:head# 2024-04-01T19:49:04.506 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.506 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d9036d8:::benchmark_data_smithi188_134454_object153623:head# 2024-04-01T19:49:04.507 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.507 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d9048ba:::benchmark_data_smithi188_134454_object127268:head# 2024-04-01T19:49:04.507 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.507 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d90671e:::benchmark_data_smithi188_134454_object152709:head# 2024-04-01T19:49:04.507 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.507 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d91469a:::benchmark_data_smithi188_134454_object134222:head# 2024-04-01T19:49:04.507 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.507 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d91bce3:::benchmark_data_smithi188_134454_object139723:head# 2024-04-01T19:49:04.507 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.507 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d91d187:::benchmark_data_smithi188_134454_object123711:head# 2024-04-01T19:49:04.507 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.509 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d95c3dd:::benchmark_data_smithi188_134454_object131652:head# 2024-04-01T19:49:04.509 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.509 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d95fbe5:::benchmark_data_smithi188_134454_object127555:head# 2024-04-01T19:49:04.509 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.509 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d984055:::benchmark_data_smithi188_134454_object150269:head# 2024-04-01T19:49:04.509 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.509 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d989c34:::benchmark_data_smithi188_134454_object124788:head# 2024-04-01T19:49:04.509 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.509 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d98b328:::benchmark_data_smithi188_134454_object120409:head# 2024-04-01T19:49:04.509 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.509 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d99ca6e:::benchmark_data_smithi188_134454_object127009:head# 2024-04-01T19:49:04.510 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.510 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d9af6ca:::benchmark_data_smithi188_134454_object126588:head# 2024-04-01T19:49:04.510 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.510 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d9cb61c:::benchmark_data_smithi188_134454_object122453:head# 2024-04-01T19:49:04.510 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.510 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7d9eaf42:::benchmark_data_smithi188_134454_object155475:head# 2024-04-01T19:49:04.510 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.512 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7da32873:::benchmark_data_smithi188_134454_object120616:head# 2024-04-01T19:49:04.512 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.512 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7da45bed:::benchmark_data_smithi188_134454_object155939:head# 2024-04-01T19:49:04.512 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.512 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7da701b9:::benchmark_data_smithi188_134454_object124342:head# 2024-04-01T19:49:04.512 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.512 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7da7ff94:::benchmark_data_smithi188_134454_object141543:head# 2024-04-01T19:49:04.512 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.512 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7da8cfe7:::benchmark_data_smithi188_134454_object149133:head# 2024-04-01T19:49:04.512 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.513 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7dabd6d1:::benchmark_data_smithi188_134454_object125673:head# 2024-04-01T19:49:04.513 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.513 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7dac768d:::benchmark_data_smithi188_134454_object152426:head# 2024-04-01T19:49:04.513 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.513 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7db5067b:::benchmark_data_smithi188_134454_object145147:head# 2024-04-01T19:49:04.513 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.513 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7db63167:::benchmark_data_smithi188_134454_object154216:head# 2024-04-01T19:49:04.513 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.513 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7db81bfb:::benchmark_data_smithi188_134454_object137594:head# 2024-04-01T19:49:04.513 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.513 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7dba5f33:::benchmark_data_smithi188_134454_object137065:head# 2024-04-01T19:49:04.513 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.513 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7dba60cf:::benchmark_data_smithi188_134454_object148999:head# 2024-04-01T19:49:04.513 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.514 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7dba63fe:::benchmark_data_smithi188_134454_object126651:head# 2024-04-01T19:49:04.514 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.516 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7dc118f8:::benchmark_data_smithi188_134454_object141709:head# 2024-04-01T19:49:04.516 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.516 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7dc1b106:::benchmark_data_smithi188_134454_object156465:head# 2024-04-01T19:49:04.516 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.516 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7dc3ff71:::benchmark_data_smithi188_134454_object128543:head# 2024-04-01T19:49:04.516 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.516 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7dc6e670:::benchmark_data_smithi188_134454_object121537:head# 2024-04-01T19:49:04.516 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.516 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7dcc457f:::benchmark_data_smithi188_134454_object141952:head# 2024-04-01T19:49:04.517 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.517 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7dcca3d0:::benchmark_data_smithi188_134454_object129204:head# 2024-04-01T19:49:04.517 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.517 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7dccb193:::benchmark_data_smithi188_134454_object154989:head# 2024-04-01T19:49:04.517 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.517 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7dd1851a:::benchmark_data_smithi188_134454_object122874:head# 2024-04-01T19:49:04.517 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.517 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7dd4aae2:::benchmark_data_smithi188_134454_object123123:head# 2024-04-01T19:49:04.517 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.517 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7dd531a7:::benchmark_data_smithi188_134454_object145085:head# 2024-04-01T19:49:04.517 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.517 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7dd7bdc5:::benchmark_data_smithi188_134454_object152188:head# 2024-04-01T19:49:04.517 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.517 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7dda42b0:::benchmark_data_smithi188_134454_object151136:head# 2024-04-01T19:49:04.517 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.518 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7dddf6fa:::benchmark_data_smithi188_134454_object132758:head# 2024-04-01T19:49:04.518 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.518 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ddfed0f:::benchmark_data_smithi188_134454_object125434:head# 2024-04-01T19:49:04.518 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.518 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7de11d4e:::benchmark_data_smithi188_134454_object155729:head# 2024-04-01T19:49:04.518 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.518 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7de1ea4d:::benchmark_data_smithi188_134454_object117836:head# 2024-04-01T19:49:04.518 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.518 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7de5da0b:::benchmark_data_smithi188_134454_object132438:head# 2024-04-01T19:49:04.518 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.521 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7de61c67:::benchmark_data_smithi188_134454_object135638:head# 2024-04-01T19:49:04.521 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.521 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7de668a4:::benchmark_data_smithi188_134454_object149609:head# 2024-04-01T19:49:04.521 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.522 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7de87fd8:::benchmark_data_smithi188_134454_object144189:head# 2024-04-01T19:49:04.522 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.522 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7debdd62:::benchmark_data_smithi188_134454_object132750:head# 2024-04-01T19:49:04.522 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.522 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7dec0643:::benchmark_data_smithi188_134454_object117379:head# 2024-04-01T19:49:04.522 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.522 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7def477a:::benchmark_data_smithi188_134454_object128613:head# 2024-04-01T19:49:04.522 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.522 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7df064cc:::benchmark_data_smithi188_134454_object142267:head# 2024-04-01T19:49:04.522 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.522 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7df0bd62:::benchmark_data_smithi188_134454_object152569:head# 2024-04-01T19:49:04.522 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.522 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7df1c514:::benchmark_data_smithi188_134454_object131816:head# 2024-04-01T19:49:04.523 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.523 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7df54d1e:::benchmark_data_smithi188_134454_object150357:head# 2024-04-01T19:49:04.523 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.523 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7df76dfe:::benchmark_data_smithi188_134454_object132612:head# 2024-04-01T19:49:04.523 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.523 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7dfb4bd3:::benchmark_data_smithi188_134454_object117798:head# 2024-04-01T19:49:04.523 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.523 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7dfcb45a:::benchmark_data_smithi188_134454_object130697:head# 2024-04-01T19:49:04.523 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.523 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7dffb97f:::benchmark_data_smithi188_134454_object123945:head# 2024-04-01T19:49:04.523 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.523 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e0000b8:::benchmark_data_smithi188_134454_object133933:head# 2024-04-01T19:49:04.523 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.523 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e00905a:::benchmark_data_smithi188_134454_object140199:head# 2024-04-01T19:49:04.524 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.524 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e01d969:::benchmark_data_smithi188_134454_object131519:head# 2024-04-01T19:49:04.524 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.524 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e0638dc:::benchmark_data_smithi188_134454_object120240:head# 2024-04-01T19:49:04.524 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.524 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e06b8da:::benchmark_data_smithi188_134454_object138093:head# 2024-04-01T19:49:04.524 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.524 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e06d7f0:::benchmark_data_smithi188_134454_object146815:head# 2024-04-01T19:49:04.524 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.527 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e091d76:::benchmark_data_smithi188_134454_object134834:head# 2024-04-01T19:49:04.527 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.527 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e0d0faa:::benchmark_data_smithi188_134454_object115933:head# 2024-04-01T19:49:04.527 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.527 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e103ea9:::benchmark_data_smithi188_134454_object118457:head# 2024-04-01T19:49:04.527 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.527 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e1325ed:::benchmark_data_smithi188_134454_object148304:head# 2024-04-01T19:49:04.527 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.528 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e151b8c:::benchmark_data_smithi188_134454_object128285:head# 2024-04-01T19:49:04.528 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.528 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e199021:::benchmark_data_smithi188_134454_object150874:head# 2024-04-01T19:49:04.528 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.528 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e1b25ff:::benchmark_data_smithi188_134454_object147149:head# 2024-04-01T19:49:04.528 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.528 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e1c7ca6:::benchmark_data_smithi188_134454_object155760:head# 2024-04-01T19:49:04.528 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.528 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e1c9360:::benchmark_data_smithi188_134454_object134483:head# 2024-04-01T19:49:04.528 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.528 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e1cb856:::benchmark_data_smithi188_134454_object132650:head# 2024-04-01T19:49:04.528 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.528 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e1ef0c8:::benchmark_data_smithi188_134454_object130837:head# 2024-04-01T19:49:04.529 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.529 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e218592:::benchmark_data_smithi188_134454_object134389:head# 2024-04-01T19:49:04.529 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.529 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e24436b:::benchmark_data_smithi188_134454_object139849:head# 2024-04-01T19:49:04.529 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.529 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e297e6d:::benchmark_data_smithi188_134454_object119089:head# 2024-04-01T19:49:04.529 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.529 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e2b08f1:::benchmark_data_smithi188_134454_object149246:head# 2024-04-01T19:49:04.529 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.529 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e2b31e6:::benchmark_data_smithi188_134454_object128433:head# 2024-04-01T19:49:04.529 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.529 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e2d7d8a:::benchmark_data_smithi188_134454_object117616:head# 2024-04-01T19:49:04.529 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.529 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e310a6a:::benchmark_data_smithi188_134454_object155041:head# 2024-04-01T19:49:04.530 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.530 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e3116eb:::benchmark_data_smithi188_134454_object151975:head# 2024-04-01T19:49:04.530 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.531 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e32e0bb:::benchmark_data_smithi188_134454_object128301:head# 2024-04-01T19:49:04.531 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.531 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e3542e4:::benchmark_data_smithi188_134454_object155345:head# 2024-04-01T19:49:04.531 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.532 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e370c9a:::benchmark_data_smithi188_134454_object125716:head# 2024-04-01T19:49:04.532 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.532 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e38cd68:::benchmark_data_smithi188_134454_object155331:head# 2024-04-01T19:49:04.532 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.533 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e39fda1:::benchmark_data_smithi188_134454_object128048:head# 2024-04-01T19:49:04.533 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.533 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e3ae4ac:::benchmark_data_smithi188_134454_object118439:head# 2024-04-01T19:49:04.533 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.534 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e3b32b8:::benchmark_data_smithi188_134454_object117610:head# 2024-04-01T19:49:04.534 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.534 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e3bd8fe:::benchmark_data_smithi188_134454_object145863:head# 2024-04-01T19:49:04.534 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.534 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e3be85a:::benchmark_data_smithi188_134454_object141044:head# 2024-04-01T19:49:04.534 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.535 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e3d7d18:::benchmark_data_smithi188_134454_object155546:head# 2024-04-01T19:49:04.535 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.535 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e3ea416:::benchmark_data_smithi188_134454_object146018:head# 2024-04-01T19:49:04.535 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.535 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e3eac19:::benchmark_data_smithi188_134454_object146035:head# 2024-04-01T19:49:04.535 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.536 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e3ec3b5:::benchmark_data_smithi188_134454_object152623:head# 2024-04-01T19:49:04.536 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.536 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e40a7f1:::benchmark_data_smithi188_134454_object154466:head# 2024-04-01T19:49:04.536 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.537 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e43e620:::benchmark_data_smithi188_134454_object154980:head# 2024-04-01T19:49:04.537 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.537 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e449174:::benchmark_data_smithi188_134454_object126901:head# 2024-04-01T19:49:04.537 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.537 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e461d31:::benchmark_data_smithi188_134454_object150233:head# 2024-04-01T19:49:04.537 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.537 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e46f1f0:::benchmark_data_smithi188_134454_object147494:head# 2024-04-01T19:49:04.537 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.537 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e4731d2:::benchmark_data_smithi188_134454_object148949:head# 2024-04-01T19:49:04.537 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.537 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e4741cc:::benchmark_data_smithi188_134454_object150306:head# 2024-04-01T19:49:04.537 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.538 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e47b4a0:::benchmark_data_smithi188_134454_object138097:head# 2024-04-01T19:49:04.539 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.539 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e482c16:::benchmark_data_smithi188_134454_object141050:head# 2024-04-01T19:49:04.539 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.539 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e4ad158:::benchmark_data_smithi188_134454_object145100:head# 2024-04-01T19:49:04.539 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.539 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e4aec16:::benchmark_data_smithi188_134454_object142905:head# 2024-04-01T19:49:04.539 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.539 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e4b6245:::benchmark_data_smithi188_134454_object148017:head# 2024-04-01T19:49:04.539 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.539 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e4be8fc:::benchmark_data_smithi188_134454_object144895:head# 2024-04-01T19:49:04.539 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.539 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e4cf296:::benchmark_data_smithi188_134454_object124934:head# 2024-04-01T19:49:04.539 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.541 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e4dc5b2:::benchmark_data_smithi188_134454_object152333:head# 2024-04-01T19:49:04.541 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.541 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e4fb0e0:::benchmark_data_smithi188_134454_object119203:head# 2024-04-01T19:49:04.541 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.541 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e4fd61f:::benchmark_data_smithi188_134454_object120649:head# 2024-04-01T19:49:04.541 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.541 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e50b5c2:::benchmark_data_smithi188_134454_object148492:head# 2024-04-01T19:49:04.542 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.542 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e560c9f:::benchmark_data_smithi188_134454_object127378:head# 2024-04-01T19:49:04.542 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.542 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e565a30:::benchmark_data_smithi188_134454_object137269:head# 2024-04-01T19:49:04.542 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.542 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e566ec8:::benchmark_data_smithi188_134454_object120660:head# 2024-04-01T19:49:04.542 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.542 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e5751c2:::benchmark_data_smithi188_134454_object124435:head# 2024-04-01T19:49:04.542 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.542 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e598c7a:::benchmark_data_smithi188_134454_object127970:head# 2024-04-01T19:49:04.542 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.545 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e5a28c0:::benchmark_data_smithi188_134454_object121182:head# 2024-04-01T19:49:04.545 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.545 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e5a8583:::benchmark_data_smithi188_134454_object154912:head# 2024-04-01T19:49:04.545 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.545 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e5b7566:::benchmark_data_smithi188_134454_object117966:head# 2024-04-01T19:49:04.545 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.545 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e5e7ffd:::benchmark_data_smithi188_134454_object122461:head# 2024-04-01T19:49:04.545 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.545 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e610010:::benchmark_data_smithi188_134454_object119651:head# 2024-04-01T19:49:04.545 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.545 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e6357c0:::benchmark_data_smithi188_134454_object150837:head# 2024-04-01T19:49:04.545 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.545 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e63c479:::benchmark_data_smithi188_134454_object134896:head# 2024-04-01T19:49:04.546 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.546 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e64022e:::benchmark_data_smithi188_134454_object156225:head# 2024-04-01T19:49:04.546 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.546 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e65894d:::benchmark_data_smithi188_134454_object134251:head# 2024-04-01T19:49:04.546 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.546 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e672cd8:::benchmark_data_smithi188_134454_object147045:head# 2024-04-01T19:49:04.546 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.546 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e67d329:::benchmark_data_smithi188_134454_object129443:head# 2024-04-01T19:49:04.546 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.546 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e692527:::benchmark_data_smithi188_134454_object147985:head# 2024-04-01T19:49:04.546 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.546 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e698cf9:::benchmark_data_smithi188_134454_object134060:head# 2024-04-01T19:49:04.546 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.547 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e6ab4a8:::benchmark_data_smithi188_134454_object128176:head# 2024-04-01T19:49:04.547 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.547 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e6be05b:::benchmark_data_smithi188_134454_object144806:head# 2024-04-01T19:49:04.547 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.547 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e6df70b:::benchmark_data_smithi188_134454_object116463:head# 2024-04-01T19:49:04.547 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.548 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e6e7f33:::benchmark_data_smithi188_134454_object152768:head# 2024-04-01T19:49:04.548 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.548 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e6f8038:::benchmark_data_smithi188_134454_object145214:head# 2024-04-01T19:49:04.548 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.548 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e6fd688:::benchmark_data_smithi188_134454_object118617:head# 2024-04-01T19:49:04.548 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.549 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e717275:::benchmark_data_smithi188_134454_object151623:head# 2024-04-01T19:49:04.549 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.549 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e75a26c:::benchmark_data_smithi188_134454_object126211:head# 2024-04-01T19:49:04.549 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.549 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e766f00:::benchmark_data_smithi188_134454_object148623:head# 2024-04-01T19:49:04.549 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.549 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e7678a6:::benchmark_data_smithi188_134454_object134025:head# 2024-04-01T19:49:04.549 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.549 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e7a90ae:::benchmark_data_smithi188_134454_object130553:head# 2024-04-01T19:49:04.549 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.549 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e7b6e02:::benchmark_data_smithi188_134454_object118653:head# 2024-04-01T19:49:04.549 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.551 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e7bc6de:::benchmark_data_smithi188_134454_object129986:head# 2024-04-01T19:49:04.551 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.551 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e80ec3f:::benchmark_data_smithi188_134454_object118942:head# 2024-04-01T19:49:04.551 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.551 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e81c45f:::benchmark_data_smithi188_134454_object127296:head# 2024-04-01T19:49:04.552 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.552 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e834c0a:::benchmark_data_smithi188_134454_object122255:head# 2024-04-01T19:49:04.552 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.552 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e84ab00:::benchmark_data_smithi188_134454_object139044:head# 2024-04-01T19:49:04.552 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.552 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e8599ce:::benchmark_data_smithi188_134454_object138412:head# 2024-04-01T19:49:04.552 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.552 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e863cac:::benchmark_data_smithi188_134454_object135357:head# 2024-04-01T19:49:04.552 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.552 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e866576:::benchmark_data_smithi188_134454_object135149:head# 2024-04-01T19:49:04.552 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.552 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e877e0e:::benchmark_data_smithi188_134454_object155118:head# 2024-04-01T19:49:04.552 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.554 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e8a81d7:::benchmark_data_smithi188_134454_object120963:head# 2024-04-01T19:49:04.554 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.554 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e8bf71f:::benchmark_data_smithi188_134454_object122914:head# 2024-04-01T19:49:04.554 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.554 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e8d56a5:::benchmark_data_smithi188_134454_object129568:head# 2024-04-01T19:49:04.554 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.554 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e90652e:::benchmark_data_smithi188_134454_object125299:head# 2024-04-01T19:49:04.554 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.554 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e909903:::benchmark_data_smithi188_134454_object151097:head# 2024-04-01T19:49:04.554 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.554 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e933c87:::benchmark_data_smithi188_134454_object137976:head# 2024-04-01T19:49:04.555 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.555 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e952d46:::benchmark_data_smithi188_134454_object130670:head# 2024-04-01T19:49:04.555 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.555 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e95a70c:::benchmark_data_smithi188_134454_object122684:head# 2024-04-01T19:49:04.555 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.555 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e9a6c78:::benchmark_data_smithi188_134454_object139693:head# 2024-04-01T19:49:04.555 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.555 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e9eaa9a:::benchmark_data_smithi188_134454_object133608:head# 2024-04-01T19:49:04.555 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.556 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7e9fc857:::benchmark_data_smithi188_134454_object150856:head# 2024-04-01T19:49:04.556 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.556 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ea15ebe:::benchmark_data_smithi188_134454_object135097:head# 2024-04-01T19:49:04.556 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.556 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ea1e025:::benchmark_data_smithi188_134454_object127428:head# 2024-04-01T19:49:04.556 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.556 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ea228b0:::benchmark_data_smithi188_134454_object152803:head# 2024-04-01T19:49:04.556 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.556 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ea2a2e6:::benchmark_data_smithi188_134454_object139808:head# 2024-04-01T19:49:04.557 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.558 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ea2cc94:::benchmark_data_smithi188_134454_object155340:head# 2024-04-01T19:49:04.558 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.558 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ea57555:::benchmark_data_smithi188_134454_object120706:head# 2024-04-01T19:49:04.559 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.559 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ea5cf43:::benchmark_data_smithi188_134454_object137350:head# 2024-04-01T19:49:04.559 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.560 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ea782b5:::benchmark_data_smithi188_134454_object141883:head# 2024-04-01T19:49:04.560 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.560 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ea80340:::benchmark_data_smithi188_134454_object129060:head# 2024-04-01T19:49:04.560 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.560 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ea9d2f2:::benchmark_data_smithi188_134454_object148411:head# 2024-04-01T19:49:04.560 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.560 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7eaa66d4:::benchmark_data_smithi188_134454_object135390:head# 2024-04-01T19:49:04.560 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.560 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7eab5eea:::benchmark_data_smithi188_134454_object144010:head# 2024-04-01T19:49:04.560 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.562 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7eac6551:::benchmark_data_smithi188_134454_object145490:head# 2024-04-01T19:49:04.562 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.562 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7eaf1172:::benchmark_data_smithi188_134454_object156582:head# 2024-04-01T19:49:04.562 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.562 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7eaf7843:::benchmark_data_smithi188_134454_object126917:head# 2024-04-01T19:49:04.562 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.562 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7eb01f0b:::benchmark_data_smithi188_134454_object155026:head# 2024-04-01T19:49:04.562 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.562 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7eb03453:::benchmark_data_smithi188_134454_object153307:head# 2024-04-01T19:49:04.562 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.562 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7eb2b5e3:::benchmark_data_smithi188_134454_object141314:head# 2024-04-01T19:49:04.563 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.563 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7eb362a3:::benchmark_data_smithi188_134454_object127896:head# 2024-04-01T19:49:04.563 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.564 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7eb3cb5b:::benchmark_data_smithi188_134454_object125431:head# 2024-04-01T19:49:04.564 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.564 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7eb484cc:::benchmark_data_smithi188_134454_object136199:head# 2024-04-01T19:49:04.564 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.564 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7eb4a4d4:::benchmark_data_smithi188_134454_object123008:head# 2024-04-01T19:49:04.564 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.564 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7eb6796e:::benchmark_data_smithi188_134454_object144535:head# 2024-04-01T19:49:04.564 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.564 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7eb86fe4:::benchmark_data_smithi188_134454_object135711:head# 2024-04-01T19:49:04.564 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.564 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ebc6598:::benchmark_data_smithi188_134454_object116571:head# 2024-04-01T19:49:04.564 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.565 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ebc7af2:::benchmark_data_smithi188_134454_object121079:head# 2024-04-01T19:49:04.565 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.565 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ebd600d:::benchmark_data_smithi188_134454_object120817:head# 2024-04-01T19:49:04.565 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.565 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ec402fd:::benchmark_data_smithi188_134454_object138665:head# 2024-04-01T19:49:04.566 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.566 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ec46ba4:::benchmark_data_smithi188_134454_object123944:head# 2024-04-01T19:49:04.566 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.566 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ec5509b:::benchmark_data_smithi188_134454_object131764:head# 2024-04-01T19:49:04.566 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.566 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ecc792e:::benchmark_data_smithi188_134454_object144224:head# 2024-04-01T19:49:04.566 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.566 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ecf45db:::benchmark_data_smithi188_134454_object129510:head# 2024-04-01T19:49:04.566 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.566 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ed287c6:::benchmark_data_smithi188_134454_object142027:head# 2024-04-01T19:49:04.566 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.567 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ed39ad6:::benchmark_data_smithi188_134454_object115811:head# 2024-04-01T19:49:04.567 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.567 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ed457c4:::benchmark_data_smithi188_134454_object133694:head# 2024-04-01T19:49:04.567 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.568 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ed5ae9a:::benchmark_data_smithi188_134454_object130106:head# 2024-04-01T19:49:04.568 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.568 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ed7a7e5:::benchmark_data_smithi188_134454_object147978:head# 2024-04-01T19:49:04.568 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.568 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7edd7cc5:::benchmark_data_smithi188_134454_object142464:head# 2024-04-01T19:49:04.568 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.568 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ee401c2:::benchmark_data_smithi188_134454_object136109:head# 2024-04-01T19:49:04.568 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.572 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ee4f939:::benchmark_data_smithi188_134454_object115590:head# 2024-04-01T19:49:04.572 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.572 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ee69729:::benchmark_data_smithi188_134454_object144705:head# 2024-04-01T19:49:04.572 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.572 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ee8035f:::benchmark_data_smithi188_134454_object134414:head# 2024-04-01T19:49:04.572 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.572 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ee9ba76:::benchmark_data_smithi188_134454_object144365:head# 2024-04-01T19:49:04.572 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.572 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7eea8a1f:::benchmark_data_smithi188_134454_object122260:head# 2024-04-01T19:49:04.572 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.572 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7eec8b04:::benchmark_data_smithi188_134454_object126376:head# 2024-04-01T19:49:04.573 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.573 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7eed5afc:::benchmark_data_smithi188_134454_object143261:head# 2024-04-01T19:49:04.573 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.573 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7eef2384:::benchmark_data_smithi188_134454_object125822:head# 2024-04-01T19:49:04.573 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.573 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ef003ae:::benchmark_data_smithi188_134454_object115869:head# 2024-04-01T19:49:04.573 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.573 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ef024d2:::benchmark_data_smithi188_134454_object143191:head# 2024-04-01T19:49:04.573 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.573 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ef06b90:::benchmark_data_smithi188_134454_object154317:head# 2024-04-01T19:49:04.573 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.573 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ef0f393:::benchmark_data_smithi188_134454_object143155:head# 2024-04-01T19:49:04.573 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.573 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ef17661:::benchmark_data_smithi188_134454_object128036:head# 2024-04-01T19:49:04.573 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.574 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ef3a998:::benchmark_data_smithi188_134454_object134166:head# 2024-04-01T19:49:04.574 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.577 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ef3f676:::benchmark_data_smithi188_134454_object121114:head# 2024-04-01T19:49:04.577 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.577 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ef76ec2:::benchmark_data_smithi188_134454_object125142:head# 2024-04-01T19:49:04.577 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.578 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ef8175e:::benchmark_data_smithi188_134454_object119072:head# 2024-04-01T19:49:04.578 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.578 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7efac890:::benchmark_data_smithi188_134454_object137375:head# 2024-04-01T19:49:04.579 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.579 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7efb02a9:::benchmark_data_smithi188_134454_object139341:head# 2024-04-01T19:49:04.579 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.579 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7efb5e38:::benchmark_data_smithi188_134454_object152947:head# 2024-04-01T19:49:04.579 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.579 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7efbc5b5:::benchmark_data_smithi188_134454_object140918:head# 2024-04-01T19:49:04.579 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.580 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7efd4460:::benchmark_data_smithi188_134454_object130110:head# 2024-04-01T19:49:04.580 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.580 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7efe028a:::benchmark_data_smithi188_134454_object142305:head# 2024-04-01T19:49:04.580 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.581 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7efe59dc:::benchmark_data_smithi188_134454_object125000:head# 2024-04-01T19:49:04.581 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.581 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f00badb:::benchmark_data_smithi188_134454_object149578:head# 2024-04-01T19:49:04.581 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.582 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f017d6c:::benchmark_data_smithi188_134454_object120796:head# 2024-04-01T19:49:04.582 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.582 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f040282:::benchmark_data_smithi188_134454_object137732:head# 2024-04-01T19:49:04.582 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.582 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f060b72:::benchmark_data_smithi188_134454_object122714:head# 2024-04-01T19:49:04.582 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.582 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f067a0e:::benchmark_data_smithi188_134454_object138199:head# 2024-04-01T19:49:04.582 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.583 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f06fb80:::benchmark_data_smithi188_134454_object126932:head# 2024-04-01T19:49:04.583 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.583 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f07696f:::benchmark_data_smithi188_134454_object115392:head# 2024-04-01T19:49:04.583 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.583 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f09989f:::benchmark_data_smithi188_134454_object131542:head# 2024-04-01T19:49:04.583 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.587 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f0a6bda:::benchmark_data_smithi188_134454_object150747:head# 2024-04-01T19:49:04.587 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.587 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f0ab2df:::benchmark_data_smithi188_134454_object130349:head# 2024-04-01T19:49:04.587 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.588 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f0c738b:::benchmark_data_smithi188_134454_object119641:head# 2024-04-01T19:49:04.588 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.588 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f0ca4af:::benchmark_data_smithi188_134454_object149972:head# 2024-04-01T19:49:04.588 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.588 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f0cd16d:::benchmark_data_smithi188_134454_object134700:head# 2024-04-01T19:49:04.588 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.589 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f0cd67e:::benchmark_data_smithi188_134454_object135526:head# 2024-04-01T19:49:04.589 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.589 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f0dd32c:::benchmark_data_smithi188_134454_object153089:head# 2024-04-01T19:49:04.590 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.590 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f0e6c44:::benchmark_data_smithi188_134454_object152207:head# 2024-04-01T19:49:04.590 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.590 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f0e8db0:::benchmark_data_smithi188_134454_object138469:head# 2024-04-01T19:49:04.590 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.590 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f0ee12e:::benchmark_data_smithi188_134454_object133574:head# 2024-04-01T19:49:04.590 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.590 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f0fd023:::benchmark_data_smithi188_134454_object135195:head# 2024-04-01T19:49:04.590 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.591 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f10e66a:::benchmark_data_smithi188_134454_object126162:head# 2024-04-01T19:49:04.591 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.591 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f134c2b:::benchmark_data_smithi188_134454_object118641:head# 2024-04-01T19:49:04.592 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.592 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f135536:::benchmark_data_smithi188_134454_object156285:head# 2024-04-01T19:49:04.592 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.592 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f13bebf:::benchmark_data_smithi188_134454_object134653:head# 2024-04-01T19:49:04.592 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.592 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f13cd35:::benchmark_data_smithi188_134454_object124717:head# 2024-04-01T19:49:04.592 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.592 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f148f12:::benchmark_data_smithi188_134454_object142366:head# 2024-04-01T19:49:04.592 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.592 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f14a5ba:::benchmark_data_smithi188_134454_object117364:head# 2024-04-01T19:49:04.593 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.593 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f17a961:::benchmark_data_smithi188_134454_object148019:head# 2024-04-01T19:49:04.593 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.593 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:49:04.595 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f198744:::benchmark_data_smithi188_134454_object117844:head# 2024-04-01T19:49:04.595 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.596 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f1adccd:::benchmark_data_smithi188_134454_object141258:head# 2024-04-01T19:49:04.596 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.596 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f1c88a4:::benchmark_data_smithi188_134454_object142671:head# 2024-04-01T19:49:04.596 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.596 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f1f2d04:::benchmark_data_smithi188_134454_object136437:head# 2024-04-01T19:49:04.596 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.596 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f1facce:::benchmark_data_smithi188_134454_object133344:head# 2024-04-01T19:49:04.596 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.596 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f20994e:::benchmark_data_smithi188_134454_object119026:head# 2024-04-01T19:49:04.596 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.596 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f25e372:::benchmark_data_smithi188_134454_object142610:head# 2024-04-01T19:49:04.597 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.597 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f2787be:::benchmark_data_smithi188_134454_object150133:head# 2024-04-01T19:49:04.597 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.597 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f29a4f0:::benchmark_data_smithi188_134454_object142576:head# 2024-04-01T19:49:04.597 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.597 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f29e8e6:::benchmark_data_smithi188_134454_object116255:head# 2024-04-01T19:49:04.597 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.597 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f2cb0d9:::benchmark_data_smithi188_134454_object139981:head# 2024-04-01T19:49:04.597 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.597 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f2f0fa5:::benchmark_data_smithi188_134454_object146318:head# 2024-04-01T19:49:04.597 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.597 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f2f226e:::benchmark_data_smithi188_134454_object149292:head# 2024-04-01T19:49:04.598 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.598 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f2f819f:::benchmark_data_smithi188_134454_object118190:head# 2024-04-01T19:49:04.598 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.598 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f361818:::benchmark_data_smithi188_134454_object156390:head# 2024-04-01T19:49:04.598 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.598 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f37d380:::benchmark_data_smithi188_134454_object118455:head# 2024-04-01T19:49:04.598 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.600 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f38b942:::benchmark_data_smithi188_134454_object156441:head# 2024-04-01T19:49:04.600 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.600 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f3ab82a:::benchmark_data_smithi188_134454_object129522:head# 2024-04-01T19:49:04.600 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.600 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f3b16a0:::benchmark_data_smithi188_134454_object155063:head# 2024-04-01T19:49:04.600 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.600 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f3b407d:::benchmark_data_smithi188_134454_object147178:head# 2024-04-01T19:49:04.600 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.600 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f3ec106:::benchmark_data_smithi188_134454_object125271:head# 2024-04-01T19:49:04.600 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.600 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f3faa0f:::benchmark_data_smithi188_134454_object120547:head# 2024-04-01T19:49:04.600 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.600 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f41103d:::benchmark_data_smithi188_134454_object148195:head# 2024-04-01T19:49:04.601 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.602 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f42f149:::benchmark_data_smithi188_134454_object115787:head# 2024-04-01T19:49:04.603 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.603 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f433d47:::benchmark_data_smithi188_134454_object120330:head# 2024-04-01T19:49:04.603 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.603 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f44a744:::benchmark_data_smithi188_134454_object146768:head# 2024-04-01T19:49:04.603 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.604 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f453cc0:::benchmark_data_smithi188_134454_object126318:head# 2024-04-01T19:49:04.604 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.604 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f461444:::benchmark_data_smithi188_134454_object150106:head# 2024-04-01T19:49:04.604 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.605 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f47168c:::benchmark_data_smithi188_134454_object138456:head# 2024-04-01T19:49:04.605 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.605 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f49e044:::benchmark_data_smithi188_134454_object130702:head# 2024-04-01T19:49:04.605 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.605 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f4c8c7f:::benchmark_data_smithi188_134454_object149229:head# 2024-04-01T19:49:04.605 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.605 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f4d3688:::benchmark_data_smithi188_134454_object149350:head# 2024-04-01T19:49:04.605 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.606 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f4f543c:::benchmark_data_smithi188_134454_object129819:head# 2024-04-01T19:49:04.606 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.606 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f5157fb:::benchmark_data_smithi188_134454_object139440:head# 2024-04-01T19:49:04.606 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.606 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f541212:::benchmark_data_smithi188_134454_object124794:head# 2024-04-01T19:49:04.606 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.606 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f571585:::benchmark_data_smithi188_134454_object149284:head# 2024-04-01T19:49:04.606 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.607 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f57c1f5:::benchmark_data_smithi188_134454_object120632:head# 2024-04-01T19:49:04.607 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.607 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f58f75c:::benchmark_data_smithi188_134454_object145673:head# 2024-04-01T19:49:04.607 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.607 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f598edb:::benchmark_data_smithi188_134454_object147556:head# 2024-04-01T19:49:04.607 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.607 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f5a4bcb:::benchmark_data_smithi188_134454_object134673:head# 2024-04-01T19:49:04.607 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.608 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f5da794:::benchmark_data_smithi188_134454_object118884:head# 2024-04-01T19:49:04.609 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.609 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f5ddf03:::benchmark_data_smithi188_134454_object146867:head# 2024-04-01T19:49:04.609 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.609 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f5ec0ee:::benchmark_data_smithi188_134454_object119625:head# 2024-04-01T19:49:04.609 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.609 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f63752e:::benchmark_data_smithi188_134454_object133598:head# 2024-04-01T19:49:04.609 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.609 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f6415ae:::benchmark_data_smithi188_134454_object125138:head# 2024-04-01T19:49:04.609 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.611 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f6515f4:::benchmark_data_smithi188_134454_object141100:head# 2024-04-01T19:49:04.611 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.611 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f67dc9b:::benchmark_data_smithi188_134454_object124930:head# 2024-04-01T19:49:04.611 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.611 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f69ad5e:::benchmark_data_smithi188_134454_object118080:head# 2024-04-01T19:49:04.611 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.611 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f6a4c07:::benchmark_data_smithi188_134454_object131625:head# 2024-04-01T19:49:04.611 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.612 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f6bb01e:::benchmark_data_smithi188_134454_object121197:head# 2024-04-01T19:49:04.612 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.612 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f6c0b98:::benchmark_data_smithi188_134454_object141214:head# 2024-04-01T19:49:04.612 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.612 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f6d6f6a:::benchmark_data_smithi188_134454_object130865:head# 2024-04-01T19:49:04.612 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.612 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f6d967c:::benchmark_data_smithi188_134454_object138313:head# 2024-04-01T19:49:04.612 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.612 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f6de3c1:::benchmark_data_smithi188_134454_object135419:head# 2024-04-01T19:49:04.612 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.612 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f6debb4:::benchmark_data_smithi188_134454_object129305:head# 2024-04-01T19:49:04.612 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.612 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f7521ce:::benchmark_data_smithi188_134454_object145224:head# 2024-04-01T19:49:04.612 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.614 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f7639b0:::benchmark_data_smithi188_134454_object132407:head# 2024-04-01T19:49:04.614 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.614 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f787535:::benchmark_data_smithi188_134454_object144627:head# 2024-04-01T19:49:04.614 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.614 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f7b9514:::benchmark_data_smithi188_134454_object127159:head# 2024-04-01T19:49:04.614 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.614 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f7ca7e7:::benchmark_data_smithi188_134454_object134223:head# 2024-04-01T19:49:04.614 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.614 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f7ececf:::benchmark_data_smithi188_134454_object148620:head# 2024-04-01T19:49:04.615 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.615 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f7fc940:::benchmark_data_smithi188_134454_object153569:head# 2024-04-01T19:49:04.615 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.615 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f7fedca:::benchmark_data_smithi188_134454_object123352:head# 2024-04-01T19:49:04.615 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.615 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f8125e4:::benchmark_data_smithi188_134454_object133445:head# 2024-04-01T19:49:04.615 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.617 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f81bc65:::benchmark_data_smithi188_134454_object153705:head# 2024-04-01T19:49:04.617 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.617 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f81c2f9:::benchmark_data_smithi188_134454_object119929:head# 2024-04-01T19:49:04.617 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.617 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f854d8b:::benchmark_data_smithi188_134454_object131509:head# 2024-04-01T19:49:04.617 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.617 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f867900:::benchmark_data_smithi188_134454_object129275:head# 2024-04-01T19:49:04.617 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.618 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f8729ea:::benchmark_data_smithi188_134454_object141378:head# 2024-04-01T19:49:04.618 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.618 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f87890c:::benchmark_data_smithi188_134454_object134480:head# 2024-04-01T19:49:04.618 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.618 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f8831d3:::benchmark_data_smithi188_134454_object141198:head# 2024-04-01T19:49:04.618 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.618 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f88e96a:::benchmark_data_smithi188_134454_object140435:head# 2024-04-01T19:49:04.618 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.618 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f8df97d:::benchmark_data_smithi188_134454_object137788:head# 2024-04-01T19:49:04.618 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.618 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f8e427c:::benchmark_data_smithi188_134454_object124705:head# 2024-04-01T19:49:04.618 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.618 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f900558:::benchmark_data_smithi188_134454_object139407:head# 2024-04-01T19:49:04.619 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.619 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f9724ef:::benchmark_data_smithi188_134454_object131223:head# 2024-04-01T19:49:04.619 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.619 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f9b05c4:::benchmark_data_smithi188_134454_object148422:head# 2024-04-01T19:49:04.619 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.619 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f9d7cad:::benchmark_data_smithi188_134454_object139694:head# 2024-04-01T19:49:04.619 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.620 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f9dc025:::benchmark_data_smithi188_134454_object139711:head# 2024-04-01T19:49:04.620 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.620 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7f9f568c:::benchmark_data_smithi188_134454_object131882:head# 2024-04-01T19:49:04.620 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.620 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fa1b397:::benchmark_data_smithi188_134454_object142984:head# 2024-04-01T19:49:04.620 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.620 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fa1f3b8:::benchmark_data_smithi188_134454_object125538:head# 2024-04-01T19:49:04.621 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.621 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fa6396b:::benchmark_data_smithi188_134454_object144993:head# 2024-04-01T19:49:04.621 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.621 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fab0258:::benchmark_data_smithi188_134454_object118976:head# 2024-04-01T19:49:04.621 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.621 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7faf5d43:::benchmark_data_smithi188_134454_object131631:head# 2024-04-01T19:49:04.621 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.621 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fb0f8df:::benchmark_data_smithi188_134454_object156555:head# 2024-04-01T19:49:04.621 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.621 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fb37691:::benchmark_data_smithi188_134454_object144876:head# 2024-04-01T19:49:04.621 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.621 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fb4f70c:::benchmark_data_smithi188_134454_object121684:head# 2024-04-01T19:49:04.621 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.623 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fb8a526:::benchmark_data_smithi188_134454_object122502:head# 2024-04-01T19:49:04.623 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.623 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fbb99a9:::benchmark_data_smithi188_134454_object141077:head# 2024-04-01T19:49:04.623 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.623 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fbf979c:::benchmark_data_smithi188_134454_object129494:head# 2024-04-01T19:49:04.623 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.623 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fc07e35:::benchmark_data_smithi188_134454_object151276:head# 2024-04-01T19:49:04.623 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.623 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fc16f75:::benchmark_data_smithi188_134454_object117498:head# 2024-04-01T19:49:04.623 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.623 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fc1ddd8:::benchmark_data_smithi188_134454_object126168:head# 2024-04-01T19:49:04.623 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.623 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fc2bf86:::benchmark_data_smithi188_134454_object120762:head# 2024-04-01T19:49:04.624 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.624 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fc56a7f:::benchmark_data_smithi188_134454_object117449:head# 2024-04-01T19:49:04.624 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.624 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fc57f32:::benchmark_data_smithi188_134454_object145458:head# 2024-04-01T19:49:04.624 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.625 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fc5ba5f:::benchmark_data_smithi188_134454_object127927:head# 2024-04-01T19:49:04.625 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.625 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fc75b38:::benchmark_data_smithi188_134454_object153022:head# 2024-04-01T19:49:04.625 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.626 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fc7e649:::benchmark_data_smithi188_134454_object148427:head# 2024-04-01T19:49:04.626 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.626 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fca4fa1:::benchmark_data_smithi188_134454_object124798:head# 2024-04-01T19:49:04.626 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.626 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:04.627 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fcb7d86:::benchmark_data_smithi188_134454_object141419:head# 2024-04-01T19:49:04.627 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.627 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fcc81d9:::benchmark_data_smithi188_134454_object150156:head# 2024-04-01T19:49:04.627 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.628 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fccc896:::benchmark_data_smithi188_134454_object143577:head# 2024-04-01T19:49:04.628 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.628 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fcd81fd:::benchmark_data_smithi188_134454_object131265:head# 2024-04-01T19:49:04.628 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.628 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fcef4e6:::benchmark_data_smithi188_134454_object141302:head# 2024-04-01T19:49:04.628 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.628 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fcfae5e:::benchmark_data_smithi188_134454_object144610:head# 2024-04-01T19:49:04.628 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.628 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fd1f35c:::benchmark_data_smithi188_134454_object119901:head# 2024-04-01T19:49:04.629 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.631 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fd25c13:::benchmark_data_smithi188_134454_object124395:head# 2024-04-01T19:49:04.631 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.631 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fd2dd5f:::benchmark_data_smithi188_134454_object143373:head# 2024-04-01T19:49:04.631 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.631 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fda136d:::benchmark_data_smithi188_134454_object144577:head# 2024-04-01T19:49:04.632 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.632 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fdcd24f:::benchmark_data_smithi188_134454_object125543:head# 2024-04-01T19:49:04.632 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.632 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fde6dd6:::benchmark_data_smithi188_134454_object133646:head# 2024-04-01T19:49:04.632 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.632 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fe135db:::benchmark_data_smithi188_134454_object137775:head# 2024-04-01T19:49:04.632 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.632 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fe21b0f:::benchmark_data_smithi188_134454_object144382:head# 2024-04-01T19:49:04.632 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.632 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fe31c9f:::benchmark_data_smithi188_134454_object141659:head# 2024-04-01T19:49:04.632 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.632 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fe3275c:::benchmark_data_smithi188_134454_object124563:head# 2024-04-01T19:49:04.632 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.632 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fe37e2b:::benchmark_data_smithi188_134454_object130940:head# 2024-04-01T19:49:04.633 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.633 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fe448ae:::benchmark_data_smithi188_134454_object122733:head# 2024-04-01T19:49:04.633 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.633 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fe666ad:::benchmark_data_smithi188_134454_object137167:head# 2024-04-01T19:49:04.633 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.633 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fe78f4c:::benchmark_data_smithi188_134454_object128976:head# 2024-04-01T19:49:04.633 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.634 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fed3e3a:::benchmark_data_smithi188_134454_object152380:head# 2024-04-01T19:49:04.635 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.635 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fed5ab6:::benchmark_data_smithi188_134454_object156303:head# 2024-04-01T19:49:04.635 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.635 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ff05caa:::benchmark_data_smithi188_134454_object127016:head# 2024-04-01T19:49:04.635 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.635 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ff482e7:::benchmark_data_smithi188_134454_object119282:head# 2024-04-01T19:49:04.635 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.635 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ff51291:::benchmark_data_smithi188_134454_object149501:head# 2024-04-01T19:49:04.635 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.635 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ff85faa:::benchmark_data_smithi188_134454_object119826:head# 2024-04-01T19:49:04.635 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.635 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ff90e9a:::benchmark_data_smithi188_134454_object147595:head# 2024-04-01T19:49:04.635 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.637 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ffa96a5:::benchmark_data_smithi188_134454_object119377:head# 2024-04-01T19:49:04.637 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.637 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7ffecd27:::benchmark_data_smithi188_134454_object153903:head# 2024-04-01T19:49:04.638 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.638 INFO:teuthology.orchestra.run.smithi022.stdout:Write #6:7fff4fa5:::benchmark_data_smithi188_134454_object123100:head# 2024-04-01T19:49:04.638 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T19:49:04.645 INFO:teuthology.orchestra.run.smithi022.stdout:write_pg epoch 534 info 6.e( v 534'19703 (500'9701,534'19703] local-lis/les=469/470 n=2601 ec=469/469 lis/c=469/469 les/c/f=470/470/0 sis=469) 2024-04-01T19:49:04.649 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:49:04.651 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:04.652 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:49:04.722 INFO:teuthology.orchestra.run.smithi022.stdout:Import successful 2024-04-01T19:49:04.753 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:49:04.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:04 smithi062 ceph-mon[44211]: 6.b scrub ok 2024-04-01T19:49:04.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:04.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:04.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:04.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:04.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:04.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:04.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:04.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:04.785 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:04.806 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:49:04.810 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:04.810 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:49:04.911 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:49:04.986 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:05.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:04 smithi022 ceph-mon[39439]: 6.b scrub ok 2024-04-01T19:49:05.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:05.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:05.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:05.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:05.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:05.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:05.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:05.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:05.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:04 smithi188 ceph-mon[43939]: 6.b scrub ok 2024-04-01T19:49:05.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:05.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:05.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:05.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:05.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:05.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:05.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:05.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:05.201 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:49:05.214 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:05.214 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:49:05.241 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_blocked_ops 2024-04-01T19:49:05.315 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:49:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:05.732 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:49:05.997 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:05.997 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:05.997 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:05.997 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:05 smithi062 ceph-mon[44211]: 6.1 scrub starts 2024-04-01T19:49:05.998 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:05 smithi062 ceph-mon[44211]: 6.1 scrub ok 2024-04-01T19:49:05.998 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:05 smithi062 ceph-mon[44211]: 6.4 scrub starts 2024-04-01T19:49:05.998 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:05 smithi062 ceph-mon[44211]: pgmap v1518: 17 pgs: 17 active+clean; 685 MiB data, 5.8 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:49:05.998 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:05 smithi062 ceph-mon[44211]: 6.4 scrub ok 2024-04-01T19:49:06.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:06.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:06.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:06.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:05 smithi022 ceph-mon[39439]: 6.1 scrub starts 2024-04-01T19:49:06.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:05 smithi022 ceph-mon[39439]: 6.1 scrub ok 2024-04-01T19:49:06.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:05 smithi022 ceph-mon[39439]: 6.4 scrub starts 2024-04-01T19:49:06.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:05 smithi022 ceph-mon[39439]: pgmap v1518: 17 pgs: 17 active+clean; 685 MiB data, 5.8 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:49:06.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:05 smithi022 ceph-mon[39439]: 6.4 scrub ok 2024-04-01T19:49:06.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:05 smithi188 ceph-mon[43939]: 6.1 scrub starts 2024-04-01T19:49:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:05 smithi188 ceph-mon[43939]: 6.1 scrub ok 2024-04-01T19:49:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:05 smithi188 ceph-mon[43939]: 6.4 scrub starts 2024-04-01T19:49:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:05 smithi188 ceph-mon[43939]: pgmap v1518: 17 pgs: 17 active+clean; 685 MiB data, 5.8 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:49:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:05 smithi188 ceph-mon[43939]: 6.4 scrub ok 2024-04-01T19:49:06.651 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:06 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:49:06.651 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:06 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:49:07.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:06 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:49:07.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:06 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:49:07.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:06 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:49:07.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:06 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:49:07.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:07 smithi062 ceph-mon[44211]: osdmap e552: 12 total, 11 up, 11 in 2024-04-01T19:49:07.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:07 smithi062 ceph-mon[44211]: pgmap v1520: 17 pgs: 17 active+clean; 497 MiB data, 5.4 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.32k op/s 2024-04-01T19:49:07.824 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:49:07.827 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:07.828 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:49:07.929 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:49:07.991 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:08.018 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:49:08.022 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:08.023 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:49:08.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:07 smithi022 ceph-mon[39439]: osdmap e552: 12 total, 11 up, 11 in 2024-04-01T19:49:08.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:07 smithi022 ceph-mon[39439]: pgmap v1520: 17 pgs: 17 active+clean; 497 MiB data, 5.4 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.32k op/s 2024-04-01T19:49:08.123 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:49:08.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:07 smithi188 ceph-mon[43939]: osdmap e552: 12 total, 11 up, 11 in 2024-04-01T19:49:08.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:07 smithi188 ceph-mon[43939]: pgmap v1520: 17 pgs: 17 active+clean; 497 MiB data, 5.4 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.32k op/s 2024-04-01T19:49:08.160 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:08.685 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:49:08.685 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:49:10.254 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_historic_ops 2024-04-01T19:49:10.358 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:49:10.362 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:10.363 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:49:10.464 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:49:10.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:10 smithi062 ceph-mon[44211]: pgmap v1521: 17 pgs: 17 active+clean; 371 MiB data, 5.2 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T19:49:10.530 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:10.562 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:49:10.567 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:10.568 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:49:10.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:10 smithi022 ceph-mon[39439]: pgmap v1521: 17 pgs: 17 active+clean; 371 MiB data, 5.2 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T19:49:10.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:10 smithi188 ceph-mon[43939]: pgmap v1521: 17 pgs: 17 active+clean; 371 MiB data, 5.2 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T19:49:10.669 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:49:10.698 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:10.718 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:49:10.720 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:10.721 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:49:10.733 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:49:10.822 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:49:10.849 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:10.870 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:49:10.873 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:10.873 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:49:10.974 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:49:11.029 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:11.088 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:49:11.093 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:11.093 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:49:11.194 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:49:11.221 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:11.245 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:49:11.247 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:11.248 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:49:11.343 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:11 smithi062 ceph-mon[44211]: pgmap v1522: 17 pgs: 17 active+clean; 223 MiB data, 4.9 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:49:11.348 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:49:11.418 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/exp.6.e.1 2024-04-01T19:49:11.425 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:11.498 INFO:tasks.thrashosds.thrasher:Waiting for clean again 2024-04-01T19:49:11.498 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-01T19:49:11.499 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:49:11.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:11 smithi022 ceph-mon[39439]: pgmap v1522: 17 pgs: 17 active+clean; 223 MiB data, 4.9 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:49:11.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:11 smithi188 ceph-mon[43939]: pgmap v1522: 17 pgs: 17 active+clean; 223 MiB data, 4.9 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.10k op/s 2024-04-01T19:49:11.794 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:49:11.802 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:11.802 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:49:11.903 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:49:11.940 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:11.978 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:49:11.979 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:49:12.232 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:49:12.237 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:12.237 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:49:12.338 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:49:12.374 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:12 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:49:12.375 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:12 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:49:12.375 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:12 smithi062 ceph-mon[44211]: osdmap e553: 12 total, 11 up, 11 in 2024-04-01T19:49:12.384 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:12.425 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Removed 156738 objects 2024-04-01T19:49:12.425 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Clean up completed and total clean up time :168.894 2024-04-01T19:49:12.487 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:49:12.517 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:49:12.520 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:12.521 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:49:12.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:12 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:49:12.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:12 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:49:12.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:12 smithi022 ceph-mon[39439]: osdmap e553: 12 total, 11 up, 11 in 2024-04-01T19:49:12.621 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:49:12.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:12 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:49:12.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:12 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:49:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:12 smithi188 ceph-mon[43939]: osdmap e553: 12 total, 11 up, 11 in 2024-04-01T19:49:12.650 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:12.848 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:49:12.850 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:12.850 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:49:12.951 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:49:12.983 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:13.004 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:49:13.006 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:13.007 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:49:13.108 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:49:13.126 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:49:13.126 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:49:13.138 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:13.157 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:49:13.160 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:13.160 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:49:13.261 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:49:13.289 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:13.349 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:49:13.362 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:49:13.365 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:13.365 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:49:13.465 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:13 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1230870254' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:49:13.465 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:13 smithi062 ceph-mon[44211]: from='client.36599 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:49:13.466 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:13 smithi062 ceph-mon[44211]: pgmap v1524: 17 pgs: 17 active+clean; 163 MiB data, 4.8 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:49:13.466 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:49:13.493 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:13.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:13 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1230870254' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:49:13.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:13 smithi022 ceph-mon[39439]: from='client.36599 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:49:13.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:13 smithi022 ceph-mon[39439]: pgmap v1524: 17 pgs: 17 active+clean; 163 MiB data, 4.8 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:49:13.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:13 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1230870254' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:49:13.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:13 smithi188 ceph-mon[43939]: from='client.36599 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:49:13.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:13 smithi188 ceph-mon[43939]: pgmap v1524: 17 pgs: 17 active+clean; 163 MiB data, 4.8 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 1.04k op/s 2024-04-01T19:49:13.821 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_ops_in_flight 2024-04-01T19:49:13.842 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:49:13.845 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:13.845 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:49:13.946 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:49:13.979 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:13.980 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:49:14.000 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:49:14.002 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:14.003 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:49:14.104 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:49:14.118 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:49:14.134 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:14.154 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:49:14.157 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:14.158 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:49:14.259 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:49:14.287 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:49:14.317 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:14.318 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:49:14.419 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:49:14.448 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:14.537 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:14 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:49:14.537 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:14 smithi022 ceph-mon[39439]: from='client.36599 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:49:14.537 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:14 smithi022 ceph-mon[39439]: osdmap e554: 12 total, 11 up, 11 in 2024-04-01T19:49:14.538 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:14 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T19:49:14.550 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:49:14.552 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:14 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:49:14.552 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:14 smithi062 ceph-mon[44211]: from='client.36599 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:49:14.552 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:14 smithi062 ceph-mon[44211]: osdmap e554: 12 total, 11 up, 11 in 2024-04-01T19:49:14.552 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:14 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T19:49:14.553 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:14.553 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:49:14.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:14 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:49:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:14 smithi188 ceph-mon[43939]: from='client.36599 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:49:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:14 smithi188 ceph-mon[43939]: osdmap e554: 12 total, 11 up, 11 in 2024-04-01T19:49:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:14 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T19:49:14.654 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:49:14.684 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:14.780 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_4 2024-04-01T19:49:14.780 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pool rm unique_pool_4 unique_pool_4 --yes-i-really-really-mean-it 2024-04-01T19:49:14.883 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:49:14.886 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:14.886 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:49:14.987 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:49:15.016 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:15.137 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:49:15.181 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:49:15.265 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:49:15.267 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:15.268 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:49:15.364 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:49:15.366 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:49:15.369 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:49:15.401 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:15.422 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:49:15.424 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:15.425 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:49:15.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:15 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T19:49:15.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:15 smithi062 ceph-mon[44211]: pgmap v1526: 17 pgs: 17 active+clean; 46 MiB data, 4.5 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 901 op/s 2024-04-01T19:49:15.525 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:49:15.556 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:15.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:15 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T19:49:15.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:15 smithi022 ceph-mon[39439]: pgmap v1526: 17 pgs: 17 active+clean; 46 MiB data, 4.5 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 901 op/s 2024-04-01T19:49:15.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:15 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T19:49:15.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:15 smithi188 ceph-mon[43939]: pgmap v1526: 17 pgs: 17 active+clean; 46 MiB data, 4.5 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 901 op/s 2024-04-01T19:49:15.793 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:49:15.793 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:49:16.148 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":1526,"stamp":"2024-04-01T19:49:15.187770+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":48103992,"num_objects":728,"num_object_clones":0,"num_object_copies":1456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":728,"num_whiteouts":0,"num_read":127,"num_read_kb":110,"num_write":312933,"num_write_kb":10034171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7673,"num_bytes_recovered":504383640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161025,"ondisk_log_size":161025,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":11,"num_per_pool_osds":11,"num_per_pool_omap_osds":11,"kb":1031196672,"kb_used":4761060,"kb_used_data":177528,"kb_used_omap":890,"kb_used_meta":4582277,"kb_avail":1026435612,"statfs":{"total":1055945392128,"available":1051070066688,"internally_reserved":0,"allocated":181788672,"data_stored":177856877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":911939,"internal_metadata":4692252093},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-472907776,"num_objects":-7216,"num_object_clones":0,"num_object_copies":-14432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7216,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7216,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001465"},"pg_stats":[{"pgid":"6.f","version":"552'19339","reported_seq":19702,"reported_epoch":552,"state":"active+clean","last_fresh":"2024-04-01T19:49:11.179727+0000","last_change":"2024-04-01T19:48:47.675272+0000","last_active":"2024-04-01T19:49:11.179727+0000","last_peered":"2024-04-01T19:49:11.179727+0000","last_clean":"2024-04-01T19:49:11.179727+0000","last_became_active":"2024-04-01T19:44:40.026862+0000","last_became_peered":"2024-04-01T19:44:40.026862+0000","last_unstale":"2024-04-01T19:49:11.179727+0000","last_undegraded":"2024-04-01T19:49:11.179727+0000","last_fullsized":"2024-04-01T19:49:11.179727+0000","mapping_epoch":469,"log_start":"501'9300","ondisk_log_start":"501'9300","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"547'17760","last_scrub_stamp":"2024-04-01T19:48:47.675085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:48:47.675085+0000","objects_scrubbed":1673,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:50:10.754295+0000","scrub_duration":313,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19339,"num_write_kb":621440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"553'22273","reported_seq":27933,"reported_epoch":553,"state":"active+clean","last_fresh":"2024-04-01T19:49:12.001147+0000","last_change":"2024-04-01T19:48:35.411397+0000","last_active":"2024-04-01T19:49:12.001147+0000","last_peered":"2024-04-01T19:49:12.001147+0000","last_clean":"2024-04-01T19:49:12.001147+0000","last_became_active":"2024-04-01T19:48:35.348263+0000","last_became_peered":"2024-04-01T19:48:35.348263+0000","last_unstale":"2024-04-01T19:49:12.001147+0000","last_undegraded":"2024-04-01T19:49:12.001147+0000","last_fullsized":"2024-04-01T19:49:12.001147+0000","mapping_epoch":545,"log_start":"504'12201","ondisk_log_start":"504'12201","created":469,"last_epoch_clean":546,"parent":"0.0","parent_split_bits":0,"last_scrub":"534'19632","last_scrub_stamp":"2024-04-01T19:48:07.169331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:48:07.169331+0000","objects_scrubbed":2694,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:49:17.178123+0000","scrub_duration":800,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19727,"num_write_kb":632256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2601,"num_bytes_recovered":170459136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"552'19065","reported_seq":24542,"reported_epoch":552,"state":"active+clean","last_fresh":"2024-04-01T19:49:10.986855+0000","last_change":"2024-04-01T19:48:49.533563+0000","last_active":"2024-04-01T19:49:10.986855+0000","last_peered":"2024-04-01T19:49:10.986855+0000","last_clean":"2024-04-01T19:49:10.986855+0000","last_became_active":"2024-04-01T19:48:34.347917+0000","last_became_peered":"2024-04-01T19:48:34.347917+0000","last_unstale":"2024-04-01T19:49:10.986855+0000","last_undegraded":"2024-04-01T19:49:10.986855+0000","last_fullsized":"2024-04-01T19:49:10.986855+0000","mapping_epoch":544,"log_start":"500'9000","ondisk_log_start":"500'9000","created":469,"last_epoch_clean":545,"parent":"0.0","parent_split_bits":0,"last_scrub":"547'17626","last_scrub_stamp":"2024-04-01T19:48:49.528273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:48:49.528273+0000","objects_scrubbed":1533,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:50:09.266826+0000","scrub_duration":378,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373976,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":19065,"num_write_kb":612673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2556,"num_bytes_recovered":167444504,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"553'22487","reported_seq":22950,"reported_epoch":553,"state":"active+clean","last_fresh":"2024-04-01T19:49:12.339731+0000","last_change":"2024-04-01T19:48:03.034785+0000","last_active":"2024-04-01T19:49:12.339731+0000","last_peered":"2024-04-01T19:49:12.339731+0000","last_clean":"2024-04-01T19:49:12.339731+0000","last_became_active":"2024-04-01T19:44:39.537984+0000","last_became_peered":"2024-04-01T19:44:39.537984+0000","last_unstale":"2024-04-01T19:49:12.339731+0000","last_undegraded":"2024-04-01T19:49:12.339731+0000","last_fullsized":"2024-04-01T19:49:12.339731+0000","mapping_epoch":469,"log_start":"504'12400","ondisk_log_start":"504'12400","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"533'19526","last_scrub_stamp":"2024-04-01T19:48:03.034673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:48:03.034673+0000","objects_scrubbed":2991,"log_size":10087,"log_dups_size":0,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:49:25.880511+0000","scrub_duration":911,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19598,"num_write_kb":627136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"553'19428","reported_seq":19789,"reported_epoch":553,"state":"active+clean","last_fresh":"2024-04-01T19:49:12.403551+0000","last_change":"2024-04-01T19:49:03.513111+0000","last_active":"2024-04-01T19:49:12.403551+0000","last_peered":"2024-04-01T19:49:12.403551+0000","last_clean":"2024-04-01T19:49:12.403551+0000","last_became_active":"2024-04-01T19:44:39.211801+0000","last_became_peered":"2024-04-01T19:44:39.211801+0000","last_unstale":"2024-04-01T19:49:12.403551+0000","last_undegraded":"2024-04-01T19:49:12.403551+0000","last_fullsized":"2024-04-01T19:49:12.403551+0000","mapping_epoch":469,"log_start":"502'9400","ondisk_log_start":"502'9400","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"551'18791","last_scrub_stamp":"2024-04-01T19:49:03.513007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:49:03.513007+0000","objects_scrubbed":640,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:50:04.613280+0000","scrub_duration":195,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19428,"num_write_kb":621696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"552'19489","reported_seq":19904,"reported_epoch":552,"state":"active+clean","last_fresh":"2024-04-01T19:49:10.994139+0000","last_change":"2024-04-01T19:48:59.469487+0000","last_active":"2024-04-01T19:49:10.994139+0000","last_peered":"2024-04-01T19:49:10.994139+0000","last_clean":"2024-04-01T19:49:10.994139+0000","last_became_active":"2024-04-01T19:44:39.537660+0000","last_became_peered":"2024-04-01T19:44:39.537660+0000","last_unstale":"2024-04-01T19:49:10.994139+0000","last_undegraded":"2024-04-01T19:49:10.994139+0000","last_fullsized":"2024-04-01T19:49:10.994139+0000","mapping_epoch":469,"log_start":"501'9400","ondisk_log_start":"501'9400","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"549'18720","last_scrub_stamp":"2024-04-01T19:48:59.469397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:48:59.469397+0000","objects_scrubbed":860,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:50:16.697520+0000","scrub_duration":227,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19489,"num_write_kb":626240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"552'19631","reported_seq":19981,"reported_epoch":552,"state":"active+clean","last_fresh":"2024-04-01T19:49:10.915663+0000","last_change":"2024-04-01T19:48:59.813058+0000","last_active":"2024-04-01T19:49:10.915663+0000","last_peered":"2024-04-01T19:49:10.915663+0000","last_clean":"2024-04-01T19:49:10.915663+0000","last_became_active":"2024-04-01T19:44:39.207250+0000","last_became_peered":"2024-04-01T19:44:39.207250+0000","last_unstale":"2024-04-01T19:49:10.915663+0000","last_undegraded":"2024-04-01T19:49:10.915663+0000","last_fullsized":"2024-04-01T19:49:10.915663+0000","mapping_epoch":469,"log_start":"503'9600","ondisk_log_start":"503'9600","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"549'18847","last_scrub_stamp":"2024-04-01T19:48:59.812814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:48:59.812814+0000","objects_scrubbed":909,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:50:02.914895+0000","scrub_duration":154,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19631,"num_write_kb":632128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"553'19612","reported_seq":19977,"reported_epoch":553,"state":"active+clean","last_fresh":"2024-04-01T19:49:12.391141+0000","last_change":"2024-04-01T19:48:50.407707+0000","last_active":"2024-04-01T19:49:12.391141+0000","last_peered":"2024-04-01T19:49:12.391141+0000","last_clean":"2024-04-01T19:49:12.391141+0000","last_became_active":"2024-04-01T19:44:39.957810+0000","last_became_peered":"2024-04-01T19:44:39.957810+0000","last_unstale":"2024-04-01T19:49:12.391141+0000","last_undegraded":"2024-04-01T19:49:12.391141+0000","last_fullsized":"2024-04-01T19:49:12.391141+0000","mapping_epoch":469,"log_start":"503'9600","ondisk_log_start":"503'9600","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"547'18021","last_scrub_stamp":"2024-04-01T19:48:50.407569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:48:50.407569+0000","objects_scrubbed":1611,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:49:58.633234+0000","scrub_duration":502,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19612,"num_write_kb":627584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"553'19732","reported_seq":20107,"reported_epoch":553,"state":"active+clean","last_fresh":"2024-04-01T19:49:12.415142+0000","last_change":"2024-04-01T19:48:04.914773+0000","last_active":"2024-04-01T19:49:12.415142+0000","last_peered":"2024-04-01T19:49:12.415142+0000","last_clean":"2024-04-01T19:49:12.415142+0000","last_became_active":"2024-04-01T19:44:39.209430+0000","last_became_peered":"2024-04-01T19:44:39.209430+0000","last_unstale":"2024-04-01T19:49:12.415142+0000","last_undegraded":"2024-04-01T19:49:12.415142+0000","last_fullsized":"2024-04-01T19:49:12.415142+0000","mapping_epoch":469,"log_start":"503'9700","ondisk_log_start":"503'9700","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"534'16863","last_scrub_stamp":"2024-04-01T19:48:04.914432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:48:04.914432+0000","objects_scrubbed":2898,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:49:25.779527+0000","scrub_duration":842,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19732,"num_write_kb":631424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"553'19576","reported_seq":19942,"reported_epoch":553,"state":"active+clean","last_fresh":"2024-04-01T19:49:12.399465+0000","last_change":"2024-04-01T19:48:52.054683+0000","last_active":"2024-04-01T19:49:12.399465+0000","last_peered":"2024-04-01T19:49:12.399465+0000","last_clean":"2024-04-01T19:49:12.399465+0000","last_became_active":"2024-04-01T19:44:39.537793+0000","last_became_peered":"2024-04-01T19:44:39.537793+0000","last_unstale":"2024-04-01T19:49:12.399465+0000","last_undegraded":"2024-04-01T19:49:12.399465+0000","last_fullsized":"2024-04-01T19:49:12.399465+0000","mapping_epoch":469,"log_start":"502'9500","ondisk_log_start":"502'9500","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"548'18213","last_scrub_stamp":"2024-04-01T19:48:52.054448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:48:52.054448+0000","objects_scrubbed":1371,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:50:20.207903+0000","scrub_duration":208,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19576,"num_write_kb":626432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"552'19565","reported_seq":24932,"reported_epoch":552,"state":"active+clean","last_fresh":"2024-04-01T19:49:10.963499+0000","last_change":"2024-04-01T19:49:05.268496+0000","last_active":"2024-04-01T19:49:10.963499+0000","last_peered":"2024-04-01T19:49:10.963499+0000","last_clean":"2024-04-01T19:49:10.963499+0000","last_became_active":"2024-04-01T19:48:35.350380+0000","last_became_peered":"2024-04-01T19:48:35.350380+0000","last_unstale":"2024-04-01T19:49:10.963499+0000","last_undegraded":"2024-04-01T19:49:10.963499+0000","last_fullsized":"2024-04-01T19:49:10.963499+0000","mapping_epoch":545,"log_start":"502'9500","ondisk_log_start":"502'9500","created":469,"last_epoch_clean":546,"parent":"0.0","parent_split_bits":0,"last_scrub":"551'19179","last_scrub_stamp":"2024-04-01T19:49:05.268245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:49:05.268245+0000","objects_scrubbed":495,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:50:22.218852+0000","scrub_duration":120,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19565,"num_write_kb":629440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2508,"num_bytes_recovered":164364288,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3","version":"553'20004","reported_seq":20369,"reported_epoch":553,"state":"active+clean","last_fresh":"2024-04-01T19:49:12.419661+0000","last_change":"2024-04-01T19:48:55.146505+0000","last_active":"2024-04-01T19:49:12.419661+0000","last_peered":"2024-04-01T19:49:12.419661+0000","last_clean":"2024-04-01T19:49:12.419661+0000","last_became_active":"2024-04-01T19:44:39.537390+0000","last_became_peered":"2024-04-01T19:44:39.537390+0000","last_unstale":"2024-04-01T19:49:12.419661+0000","last_undegraded":"2024-04-01T19:49:12.419661+0000","last_fullsized":"2024-04-01T19:49:12.419661+0000","mapping_epoch":469,"log_start":"504'10000","ondisk_log_start":"504'10000","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"548'18778","last_scrub_stamp":"2024-04-01T19:48:55.146244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:48:55.146244+0000","objects_scrubbed":1235,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:49:59.343659+0000","scrub_duration":309,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20004,"num_write_kb":640128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"553'19491","reported_seq":19846,"reported_epoch":553,"state":"active+clean","last_fresh":"2024-04-01T19:49:11.995923+0000","last_change":"2024-04-01T19:48:58.681958+0000","last_active":"2024-04-01T19:49:11.995923+0000","last_peered":"2024-04-01T19:49:11.995923+0000","last_clean":"2024-04-01T19:49:11.995923+0000","last_became_active":"2024-04-01T19:44:39.208942+0000","last_became_peered":"2024-04-01T19:44:39.208942+0000","last_unstale":"2024-04-01T19:49:11.995923+0000","last_undegraded":"2024-04-01T19:49:11.995923+0000","last_fullsized":"2024-04-01T19:49:11.995923+0000","mapping_epoch":469,"log_start":"502'9400","ondisk_log_start":"502'9400","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"549'18557","last_scrub_stamp":"2024-04-01T19:48:58.681870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:48:58.681870+0000","objects_scrubbed":964,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:50:13.923409+0000","scrub_duration":297,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19491,"num_write_kb":624384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"553'19768","reported_seq":20115,"reported_epoch":553,"state":"active+clean","last_fresh":"2024-04-01T19:49:12.405368+0000","last_change":"2024-04-01T19:49:04.414794+0000","last_active":"2024-04-01T19:49:12.405368+0000","last_peered":"2024-04-01T19:49:12.405368+0000","last_clean":"2024-04-01T19:49:12.405368+0000","last_became_active":"2024-04-01T19:44:39.206178+0000","last_became_peered":"2024-04-01T19:44:39.206178+0000","last_unstale":"2024-04-01T19:49:12.405368+0000","last_undegraded":"2024-04-01T19:49:12.405368+0000","last_fullsized":"2024-04-01T19:49:12.405368+0000","mapping_epoch":469,"log_start":"503'9700","ondisk_log_start":"503'9700","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"551'19248","last_scrub_stamp":"2024-04-01T19:49:04.414684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:49:04.414684+0000","objects_scrubbed":523,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:50:08.864360+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19768,"num_write_kb":632576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"6.0","version":"552'19433","reported_seq":19787,"reported_epoch":552,"state":"active+clean","last_fresh":"2024-04-01T19:49:10.876643+0000","last_change":"2024-04-01T19:48:50.988485+0000","last_active":"2024-04-01T19:49:10.876643+0000","last_peered":"2024-04-01T19:49:10.876643+0000","last_clean":"2024-04-01T19:49:10.876643+0000","last_became_active":"2024-04-01T19:44:39.208719+0000","last_became_peered":"2024-04-01T19:44:39.208719+0000","last_unstale":"2024-04-01T19:49:10.876643+0000","last_undegraded":"2024-04-01T19:49:10.876643+0000","last_fullsized":"2024-04-01T19:49:10.876643+0000","mapping_epoch":469,"log_start":"501'9400","ondisk_log_start":"501'9400","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"547'18011","last_scrub_stamp":"2024-04-01T19:48:50.988270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:48:50.988270+0000","objects_scrubbed":1540,"log_size":10033,"log_dups_size":0,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:49:53.294089+0000","scrub_duration":279,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19433,"num_write_kb":625344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"552'19294","reported_seq":19638,"reported_epoch":552,"state":"active+clean","last_fresh":"2024-04-01T19:49:10.935844+0000","last_change":"2024-04-01T19:49:02.397127+0000","last_active":"2024-04-01T19:49:10.935844+0000","last_peered":"2024-04-01T19:49:10.935844+0000","last_clean":"2024-04-01T19:49:10.935844+0000","last_became_active":"2024-04-01T19:44:39.211865+0000","last_became_peered":"2024-04-01T19:44:39.211865+0000","last_unstale":"2024-04-01T19:49:10.935844+0000","last_undegraded":"2024-04-01T19:49:10.935844+0000","last_fullsized":"2024-04-01T19:49:10.935844+0000","mapping_epoch":469,"log_start":"500'9200","ondisk_log_start":"500'9200","created":469,"last_epoch_clean":470,"parent":"0.0","parent_split_bits":0,"last_scrub":"551'18725","last_scrub_stamp":"2024-04-01T19:49:02.396866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:44:38.193125+0000","last_clean_scrub_stamp":"2024-04-01T19:49:02.396866+0000","objects_scrubbed":666,"log_size":10094,"log_dups_size":0,"ondisk_log_size":10094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:50:30.614660+0000","scrub_duration":168,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19294,"num_write_kb":620352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":1397,"reported_epoch":553,"state":"active+clean","last_fresh":"2024-04-01T19:49:13.674133+0000","last_change":"2024-04-01T19:49:13.674189+0000","last_active":"2024-04-01T19:49:13.674133+0000","last_peered":"2024-04-01T19:49:13.674133+0000","last_clean":"2024-04-01T19:49:13.674133+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:49:13.674133+0000","last_undegraded":"2024-04-01T19:49:13.674133+0000","last_fullsized":"2024-04-01T19:49:13.674133+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:49:13.674044+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:49:13.674044+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:50:30.700477+0000","scrub_duration":121,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":47513624,"num_objects":726,"num_object_clones":0,"num_object_copies":1452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":726,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":312752,"num_write_kb":10031233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7665,"num_bytes_recovered":502267928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":657731584,"data_stored":657719368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160886,"ondisk_log_size":160886,"up":32,"acting":32,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220479,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":643004,"kb_used_data":7924,"kb_used_omap":1,"kb_used_meta":635070,"kb_avail":93102148,"statfs":{"total":95995035648,"available":95336599552,"internally_reserved":0,"allocated":8114176,"data_stored":7757287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":650312132},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":77,"seq":330712482115,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":436552,"kb_used_data":8316,"kb_used_omap":1,"kb_used_meta":428222,"kb_avail":93308600,"statfs":{"total":95995035648,"available":95548006400,"internally_reserved":0,"allocated":8515584,"data_stored":8152171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":438499776},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678346,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":437556,"kb_used_data":27372,"kb_used_omap":1,"kb_used_meta":410174,"kb_avail":93307596,"statfs":{"total":95995035648,"available":95546978304,"internally_reserved":0,"allocated":28028928,"data_stored":27675611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":420018624},"hb_peers":[0,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557544,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":110532,"kb_used_data":696,"kb_used_omap":132,"kb_used_meta":109691,"kb_avail":93634620,"statfs":{"total":95995035648,"available":95881850880,"internally_reserved":0,"allocated":712704,"data_stored":353383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":112324327},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234325,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":455820,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":454590,"kb_avail":93289332,"statfs":{"total":95995035648,"available":95528275968,"internally_reserved":0,"allocated":1245184,"data_stored":882311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":465500618},"hb_peers":[0,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":457,"seq":1962800054335,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":170484,"kb_used_data":43948,"kb_used_omap":744,"kb_used_meta":125783,"kb_avail":93574668,"statfs":{"total":95995035648,"available":95820460032,"internally_reserved":0,"allocated":45002752,"data_stored":44649435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":762131,"internal_metadata":128802541},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738745,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":524084,"kb_used_data":19500,"kb_used_omap":1,"kb_used_meta":504574,"kb_avail":93221068,"statfs":{"total":95995035648,"available":95458373632,"internally_reserved":0,"allocated":19968000,"data_stored":19614683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":516684229},"hb_peers":[2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346286,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":311220,"kb_used_data":19052,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":93433932,"statfs":{"total":95995035648,"available":95676346368,"internally_reserved":0,"allocated":19509248,"data_stored":19155931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":299170245},"hb_peers":[0,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669150056,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":582916,"kb_used_data":1912,"kb_used_omap":1,"kb_used_meta":580926,"kb_avail":93162236,"statfs":{"total":95995035648,"available":95398129664,"internally_reserved":0,"allocated":1957888,"data_stored":1598567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":594868679},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953826,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":524228,"kb_used_data":9848,"kb_used_omap":1,"kb_used_meta":514302,"kb_avail":93220924,"statfs":{"total":95995035648,"available":95458226176,"internally_reserved":0,"allocated":10084352,"data_stored":9725031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":526645701},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790302,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":564664,"kb_used_data":37744,"kb_used_omap":1,"kb_used_meta":526782,"kb_avail":93180488,"statfs":{"total":95995035648,"available":95416819712,"internally_reserved":0,"allocated":38649856,"data_stored":38292467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":539425221},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15204352,"data_stored":15204352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":545591296,"data_stored":545587224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9699328,"data_stored":9699328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4980736,"data_stored":4980736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":23334912,"data_stored":23330840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33226752,"data_stored":33226752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":19857408,"data_stored":19857408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":5439488,"data_stored":5439488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:49:16.149 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:49:16.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:16 smithi062 ceph-mon[44211]: from='client.36605 v1:172.21.15.22:0/3990047615' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:49:16.563 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:49:16.575 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_blocked_ops 2024-04-01T19:49:16.589 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:16 smithi022 ceph-mon[39439]: from='client.36605 v1:172.21.15.22:0/3990047615' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:49:16.605 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:49:16.611 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:16.611 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:49:16.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:16 smithi188 ceph-mon[43939]: from='client.36605 v1:172.21.15.22:0/3990047615' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:49:16.712 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:49:16.740 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:16.853 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:49:17.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:17 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:49:17.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:17 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:49:17.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:17 smithi022 ceph-mon[39439]: pgmap v1527: 17 pgs: 17 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 740 op/s 2024-04-01T19:49:17.389 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:49:17.392 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:17.393 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:49:17.494 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:49:17.524 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:17.544 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:49:17.547 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:17.548 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:49:17.605 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:17 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:49:17.605 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:17 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:49:17.605 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:17 smithi062 ceph-mon[44211]: pgmap v1527: 17 pgs: 17 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 740 op/s 2024-04-01T19:49:17.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:17 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:49:17.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:17 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:49:17.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:17 smithi188 ceph-mon[43939]: pgmap v1527: 17 pgs: 17 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 740 op/s 2024-04-01T19:49:17.649 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:49:17.676 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:17.926 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:49:17.929 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:17.929 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:49:18.025 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:49:18.030 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:49:18.063 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:18.082 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:49:18.085 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:18.085 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:49:18.186 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:49:18.217 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:18.451 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:49:18.451 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:49:18.454 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:18 smithi062 ceph-mon[44211]: osdmap e555: 12 total, 11 up, 11 in 2024-04-01T19:49:18.454 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:18 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:49:18.454 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:18 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:49:18.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:18 smithi022 ceph-mon[39439]: osdmap e555: 12 total, 11 up, 11 in 2024-04-01T19:49:18.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:18 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:49:18.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:18 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:49:18.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:18 smithi188 ceph-mon[43939]: osdmap e555: 12 total, 11 up, 11 in 2024-04-01T19:49:18.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:18 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:49:18.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:18 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:49:19.096 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_historic_ops 2024-04-01T19:49:19.371 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:49:19.551 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:49:19.554 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:19 smithi022 ceph-mon[39439]: osdmap e556: 12 total, 11 up, 11 in 2024-04-01T19:49:19.554 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:19 smithi022 ceph-mon[39439]: pgmap v1530: 17 pgs: 17 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 432 op/s 2024-04-01T19:49:19.555 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:19.555 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:49:19.656 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:49:19.686 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:19 smithi188 ceph-mon[43939]: osdmap e556: 12 total, 11 up, 11 in 2024-04-01T19:49:19.686 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:19 smithi188 ceph-mon[43939]: pgmap v1530: 17 pgs: 17 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 432 op/s 2024-04-01T19:49:19.687 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:19 smithi062 ceph-mon[44211]: osdmap e556: 12 total, 11 up, 11 in 2024-04-01T19:49:19.687 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:19 smithi062 ceph-mon[44211]: pgmap v1530: 17 pgs: 17 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail; 0 B/s wr, 432 op/s 2024-04-01T19:49:19.688 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:19.709 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:49:19.712 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:19.712 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:49:19.813 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:49:19.842 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:19.862 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:49:19.865 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:19.865 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:49:19.966 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:49:19.995 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:20.244 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:49:20.246 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:20.247 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:49:20.348 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:49:20.376 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:20.427 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'unique_pool_4' removed 2024-04-01T19:49:20.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:20 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1815213100' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:49:20.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:20.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:20.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:20.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:20.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:20.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:20.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:20 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:49:20.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:20 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:49:20.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:20 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3696039759' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:49:20.729 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:49:20.731 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:20.731 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:49:20.832 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:49:20.859 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:20 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1815213100' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:49:20.859 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:20.859 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:20.860 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:20.860 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:20.860 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:20.860 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:20.860 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:20 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:49:20.860 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:20 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:49:20.860 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:20 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3696039759' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:49:20.860 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:20 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1815213100' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:49:20.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:20.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:20.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:20.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:20.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:20.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:20.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:20 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:49:20.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:20 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:49:20.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:20 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3696039759' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:49:20.862 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:20.881 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:49:20.884 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:20.884 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:49:20.899 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:49:20.899 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:49:20.899 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:49:20.900 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:49:20.900 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:49:20.900 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:49:20.900 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:49:20.900 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:49:20.900 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:49:20.900 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:49:20.900 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:49:20.900 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:49:20.900 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-01T19:49:20.900 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:49:20.900 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:49:20.901 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:49:20.901 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:49:20.901 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:49:20.901 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:49:20.901 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:49:20.901 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:49:20.901 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:49:20.901 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:49:20.985 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:49:21.016 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:21.230 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:49:21.230 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 20, 2024-04-01T19:49:21.230 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 600, 2024-04-01T19:49:21.230 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:49:21.231 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.231 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:120517 5.7 5:ef97052d:::benchmark_data_smithi188_119427_object120516:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e389)", 2024-04-01T19:49:21.231 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:40:26.421636+0000", 2024-04-01T19:49:21.231 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 534.80928917100005, 2024-04-01T19:49:21.231 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.079259860000000001, 2024-04-01T19:49:21.231 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:21.231 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:21.231 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:21.231 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:21.231 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:49:21.231 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:21.231 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 120517 2024-04-01T19:49:21.231 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.231 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:21.231 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.232 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:21.232 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.421636+0000", 2024-04-01T19:49:21.232 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.232 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.232 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.232 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:21.232 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.421636+0000", 2024-04-01T19:49:21.232 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.232 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.232 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.232 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:21.232 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.421637+0000", 2024-04-01T19:49:21.232 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8339999999999999e-06 2024-04-01T19:49:21.232 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.233 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.233 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:21.233 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.421694+0000", 2024-04-01T19:49:21.233 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6988999999999999e-05 2024-04-01T19:49:21.233 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.233 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.233 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:21.233 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.421705+0000", 2024-04-01T19:49:21.233 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0251999999999999e-05 2024-04-01T19:49:21.233 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.233 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.233 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:21.233 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.421712+0000", 2024-04-01T19:49:21.233 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9700000000000002e-06 2024-04-01T19:49:21.233 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.233 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.234 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:21.234 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.421770+0000", 2024-04-01T19:49:21.234 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8804999999999997e-05 2024-04-01T19:49:21.234 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.234 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.234 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:21.234 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.421860+0000", 2024-04-01T19:49:21.234 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.9697999999999994e-05 2024-04-01T19:49:21.234 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.234 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.234 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:49:21.234 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.421943+0000", 2024-04-01T19:49:21.234 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.2558999999999993e-05 2024-04-01T19:49:21.235 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.235 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.235 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:21.235 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.427815+0000", 2024-04-01T19:49:21.235 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0058719499999999999 2024-04-01T19:49:21.235 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.235 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.235 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:21.235 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.500789+0000", 2024-04-01T19:49:21.235 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.072973944999999998 2024-04-01T19:49:21.235 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.235 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.235 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:21.236 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.500847+0000", 2024-04-01T19:49:21.236 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8498999999999997e-05 2024-04-01T19:49:21.236 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.236 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.236 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:21.236 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.500895+0000", 2024-04-01T19:49:21.236 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8359000000000002e-05 2024-04-01T19:49:21.236 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.236 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:21.236 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.236 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.236 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.236 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:120518 5.7 5:e40dc134:::benchmark_data_smithi188_119427_object120517:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e389)", 2024-04-01T19:49:21.237 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:40:26.422449+0000", 2024-04-01T19:49:21.237 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 534.80847604099995, 2024-04-01T19:49:21.237 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.078557897000000002, 2024-04-01T19:49:21.237 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:21.237 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:21.237 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:21.237 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:21.237 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:49:21.237 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:21.237 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 120518 2024-04-01T19:49:21.237 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.237 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:21.237 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.238 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:21.238 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.422449+0000", 2024-04-01T19:49:21.238 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.238 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.238 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.238 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:21.238 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.422449+0000", 2024-04-01T19:49:21.238 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.238 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.238 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.238 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:21.238 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.422450+0000", 2024-04-01T19:49:21.238 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.195e-06 2024-04-01T19:49:21.239 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.239 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.239 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:21.239 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.422502+0000", 2024-04-01T19:49:21.239 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2491999999999998e-05 2024-04-01T19:49:21.239 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.239 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.239 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:21.239 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.422513+0000", 2024-04-01T19:49:21.239 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.03e-05 2024-04-01T19:49:21.239 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.239 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.239 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:21.239 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.422520+0000", 2024-04-01T19:49:21.240 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.973e-06 2024-04-01T19:49:21.240 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.240 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.240 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:21.240 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.424989+0000", 2024-04-01T19:49:21.240 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0024691790000000002 2024-04-01T19:49:21.240 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.240 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.240 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:21.240 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.425121+0000", 2024-04-01T19:49:21.240 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013183300000000001 2024-04-01T19:49:21.240 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.241 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.241 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:49:21.241 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.425210+0000", 2024-04-01T19:49:21.241 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.9760999999999997e-05 2024-04-01T19:49:21.241 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.241 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.241 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:21.241 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.427932+0000", 2024-04-01T19:49:21.241 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0027217109999999999 2024-04-01T19:49:21.241 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.241 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.242 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:21.242 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.500934+0000", 2024-04-01T19:49:21.242 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.073001939000000002 2024-04-01T19:49:21.242 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.242 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.242 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:21.242 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.500968+0000", 2024-04-01T19:49:21.242 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.3908999999999997e-05 2024-04-01T19:49:21.242 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.242 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.243 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:21.243 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:40:26.501007+0000", 2024-04-01T19:49:21.243 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8605000000000001e-05 2024-04-01T19:49:21.243 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.243 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:21.243 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.243 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.243 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.243 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.25864.0:238358 5.6 e438/364 5:60612565:::benchmark_data_smithi188_119427_object73659:head v 438'15093, mlcod=438'15090)", 2024-04-01T19:49:21.243 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:47.413911+0000", 2024-04-01T19:49:21.243 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 393.817013976, 2024-04-01T19:49:21.243 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.13093000299999999, 2024-04-01T19:49:21.243 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:21.244 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:21.244 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:21.244 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:21.244 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.244 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:21.244 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.413911+0000", 2024-04-01T19:49:21.244 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.244 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.244 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.244 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:21.244 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.413911+0000", 2024-04-01T19:49:21.244 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.244 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.244 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.244 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:21.245 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.413913+0000", 2024-04-01T19:49:21.245 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.852e-06 2024-04-01T19:49:21.245 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.245 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.245 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:21.245 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.413922+0000", 2024-04-01T19:49:21.245 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.8659999999999995e-06 2024-04-01T19:49:21.245 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.245 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.245 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:21.245 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467122+0000", 2024-04-01T19:49:21.245 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.053200787999999999 2024-04-01T19:49:21.245 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.245 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.246 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:21.246 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467138+0000", 2024-04-01T19:49:21.246 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.5279000000000001e-05 2024-04-01T19:49:21.246 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.246 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.246 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:21.246 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467585+0000", 2024-04-01T19:49:21.246 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00044708999999999998 2024-04-01T19:49:21.246 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.246 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.246 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:21.246 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467605+0000", 2024-04-01T19:49:21.246 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.0353999999999999e-05 2024-04-01T19:49:21.247 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.247 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.247 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:21.247 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.544808+0000", 2024-04-01T19:49:21.247 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.077202607000000006 2024-04-01T19:49:21.247 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.247 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.247 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:21.247 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.544841+0000", 2024-04-01T19:49:21.247 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.3167000000000003e-05 2024-04-01T19:49:21.247 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.247 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:21.247 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.247 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.248 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.248 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.25864.0:238387 5.6 e438/364 5:649b00d8:::benchmark_data_smithi188_119427_object73688:head v 438'15094, mlcod=438'15090)", 2024-04-01T19:49:21.248 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:47.467165+0000", 2024-04-01T19:49:21.248 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 393.76375935999999, 2024-04-01T19:49:21.248 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.077709005999999997, 2024-04-01T19:49:21.248 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:21.248 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:21.248 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:21.248 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:21.248 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.248 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:21.248 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467165+0000", 2024-04-01T19:49:21.248 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.248 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.249 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.249 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:21.249 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467165+0000", 2024-04-01T19:49:21.249 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.249 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.249 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.249 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:21.249 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467167+0000", 2024-04-01T19:49:21.249 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4810000000000001e-06 2024-04-01T19:49:21.249 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.249 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.249 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:21.249 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467178+0000", 2024-04-01T19:49:21.249 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1544e-05 2024-04-01T19:49:21.250 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.250 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.250 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:21.250 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467189+0000", 2024-04-01T19:49:21.250 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0249e-05 2024-04-01T19:49:21.250 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.250 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.250 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:21.250 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467195+0000", 2024-04-01T19:49:21.250 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8680000000000004e-06 2024-04-01T19:49:21.250 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.250 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.250 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:21.251 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.472561+0000", 2024-04-01T19:49:21.251 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0053665570000000001 2024-04-01T19:49:21.251 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.251 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.251 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:21.251 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.472580+0000", 2024-04-01T19:49:21.251 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.9096000000000001e-05 2024-04-01T19:49:21.251 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.251 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.251 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:21.251 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.544847+0000", 2024-04-01T19:49:21.251 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.072266833000000003 2024-04-01T19:49:21.251 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.252 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.252 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:21.252 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.544874+0000", 2024-04-01T19:49:21.252 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.7378000000000001e-05 2024-04-01T19:49:21.252 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.252 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:21.252 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.252 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.252 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.252 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.25864.0:238395 5.6 e438/364 5:61680e6d:::benchmark_data_smithi188_119427_object73696:head v 438'15095, mlcod=438'15090)", 2024-04-01T19:49:21.252 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:47.467234+0000", 2024-04-01T19:49:21.252 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 393.76369033499998, 2024-04-01T19:49:21.252 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.077683084999999999, 2024-04-01T19:49:21.252 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:21.252 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:21.253 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:21.253 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:21.253 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.253 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:21.253 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467234+0000", 2024-04-01T19:49:21.253 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.253 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.253 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.253 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:21.253 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467234+0000", 2024-04-01T19:49:21.253 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.253 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.253 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.253 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:21.254 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467235+0000", 2024-04-01T19:49:21.254 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.03e-07 2024-04-01T19:49:21.254 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.254 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.254 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:21.254 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467241+0000", 2024-04-01T19:49:21.254 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6860000000000003e-06 2024-04-01T19:49:21.254 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.254 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.254 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:21.254 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467246+0000", 2024-04-01T19:49:21.254 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1839999999999998e-06 2024-04-01T19:49:21.254 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.254 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.255 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:21.255 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467251+0000", 2024-04-01T19:49:21.255 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8600000000000001e-06 2024-04-01T19:49:21.255 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.255 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.255 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:21.255 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.476134+0000", 2024-04-01T19:49:21.255 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0088833990000000002 2024-04-01T19:49:21.255 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.255 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.255 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:21.255 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.476147+0000", 2024-04-01T19:49:21.255 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2660000000000001e-05 2024-04-01T19:49:21.256 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.256 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.256 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:21.256 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.544878+0000", 2024-04-01T19:49:21.256 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.068731617999999994 2024-04-01T19:49:21.256 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.256 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.256 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:21.256 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.544918+0000", 2024-04-01T19:49:21.256 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9274999999999999e-05 2024-04-01T19:49:21.256 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.256 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:21.256 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.256 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.257 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.257 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.25864.0:238414 5.6 e438/364 5:6a6fa109:::benchmark_data_smithi188_119427_object73715:head v 438'15096, mlcod=438'15090)", 2024-04-01T19:49:21.257 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:47.467258+0000", 2024-04-01T19:49:21.257 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 393.76366713300001, 2024-04-01T19:49:21.257 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.077686190000000002, 2024-04-01T19:49:21.257 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:21.257 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:21.257 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:21.257 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:21.257 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.257 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:21.257 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467258+0000", 2024-04-01T19:49:21.257 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.257 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.258 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.258 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:21.258 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467258+0000", 2024-04-01T19:49:21.258 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.258 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.258 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.258 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:21.258 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467258+0000", 2024-04-01T19:49:21.258 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8500000000000002e-07 2024-04-01T19:49:21.258 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.258 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.258 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:21.258 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467265+0000", 2024-04-01T19:49:21.258 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1570000000000003e-06 2024-04-01T19:49:21.259 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.259 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.259 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:21.259 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467270+0000", 2024-04-01T19:49:21.259 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.152e-06 2024-04-01T19:49:21.259 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.259 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.259 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:21.259 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.467275+0000", 2024-04-01T19:49:21.259 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6500000000000004e-06 2024-04-01T19:49:21.259 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.259 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.259 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:21.259 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.536837+0000", 2024-04-01T19:49:21.260 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.069561548000000001 2024-04-01T19:49:21.260 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.260 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.260 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:21.260 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.536858+0000", 2024-04-01T19:49:21.260 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1401000000000001e-05 2024-04-01T19:49:21.260 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.260 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.260 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:21.260 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.544921+0000", 2024-04-01T19:49:21.260 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.008062909 2024-04-01T19:49:21.260 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.260 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.260 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:21.261 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:47.544944+0000", 2024-04-01T19:49:21.261 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.2988000000000001e-05 2024-04-01T19:49:21.261 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.261 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:21.261 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.261 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.261 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.261 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:311951 5.7 5:e3fab2b7:::benchmark_data_smithi188_119427_object147252:head [delete] snapc 0=[] ondisk+write+known_if_redirected e452)", 2024-04-01T19:49:21.261 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:43:55.040264+0000", 2024-04-01T19:49:21.261 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 326.19066104699999, 2024-04-01T19:49:21.261 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.080787656999999999, 2024-04-01T19:49:21.261 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:21.261 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:21.261 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:21.262 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:21.262 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:49:21.262 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:21.262 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 311951 2024-04-01T19:49:21.262 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.262 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:21.262 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.262 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:21.262 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.040264+0000", 2024-04-01T19:49:21.262 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.262 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.262 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.262 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:21.262 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.040264+0000", 2024-04-01T19:49:21.263 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.263 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.263 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.263 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:21.263 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.040265+0000", 2024-04-01T19:49:21.263 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4780000000000001e-06 2024-04-01T19:49:21.263 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.263 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.263 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:21.263 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.040270+0000", 2024-04-01T19:49:21.263 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.904e-06 2024-04-01T19:49:21.263 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.263 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.263 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:21.264 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.040280+0000", 2024-04-01T19:49:21.264 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.8840000000000006e-06 2024-04-01T19:49:21.264 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.264 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.264 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:21.264 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.040287+0000", 2024-04-01T19:49:21.264 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.2819999999999999e-06 2024-04-01T19:49:21.264 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.264 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.264 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:21.264 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.040338+0000", 2024-04-01T19:49:21.264 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0547999999999998e-05 2024-04-01T19:49:21.264 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.264 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.265 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:21.265 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.040439+0000", 2024-04-01T19:49:21.265 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000101202 2024-04-01T19:49:21.265 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.265 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.265 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:49:21.265 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.040510+0000", 2024-04-01T19:49:21.265 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1110000000000002e-05 2024-04-01T19:49:21.265 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.265 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.265 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:21.265 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.043839+0000", 2024-04-01T19:49:21.265 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.003329191 2024-04-01T19:49:21.265 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.266 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.266 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:21.266 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.120966+0000", 2024-04-01T19:49:21.266 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.077127128000000003 2024-04-01T19:49:21.266 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.266 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.266 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:21.266 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.121012+0000", 2024-04-01T19:49:21.266 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.5747000000000001e-05 2024-04-01T19:49:21.266 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.266 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.266 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:21.266 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.121051+0000", 2024-04-01T19:49:21.266 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9183000000000001e-05 2024-04-01T19:49:21.266 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.267 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:21.267 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.267 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.267 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.267 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:311954 5.7 5:e9622c0d:::benchmark_data_smithi188_119427_object147255:head [delete] snapc 0=[] ondisk+write+known_if_redirected e452)", 2024-04-01T19:49:21.267 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:43:55.043996+0000", 2024-04-01T19:49:21.267 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 326.18692845599998, 2024-04-01T19:49:21.267 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.078687093999999999, 2024-04-01T19:49:21.267 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:21.267 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:21.267 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:21.267 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:21.267 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:49:21.267 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:21.268 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 311954 2024-04-01T19:49:21.268 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.268 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:21.268 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.268 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:21.268 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.043996+0000", 2024-04-01T19:49:21.268 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.268 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.268 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.268 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:21.268 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.043996+0000", 2024-04-01T19:49:21.268 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.268 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.268 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.268 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:21.269 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.043998+0000", 2024-04-01T19:49:21.269 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.5510000000000001e-06 2024-04-01T19:49:21.269 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.269 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.269 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:21.269 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.044003+0000", 2024-04-01T19:49:21.269 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0340000000000004e-06 2024-04-01T19:49:21.269 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.269 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.269 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:21.269 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.044012+0000", 2024-04-01T19:49:21.269 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.2720000000000003e-06 2024-04-01T19:49:21.269 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.269 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.270 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:21.270 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.044020+0000", 2024-04-01T19:49:21.270 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.7980000000000006e-06 2024-04-01T19:49:21.270 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.270 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.270 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:21.270 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.044065+0000", 2024-04-01T19:49:21.270 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.5118999999999999e-05 2024-04-01T19:49:21.270 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.270 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.270 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:21.270 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.044141+0000", 2024-04-01T19:49:21.270 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.5661999999999995e-05 2024-04-01T19:49:21.270 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.271 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.271 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:49:21.271 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.044211+0000", 2024-04-01T19:49:21.271 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.0411000000000001e-05 2024-04-01T19:49:21.271 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.271 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.271 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:21.271 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.046957+0000", 2024-04-01T19:49:21.271 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.002745562 2024-04-01T19:49:21.271 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.271 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.271 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:21.271 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.122623+0000", 2024-04-01T19:49:21.271 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.075665925999999994 2024-04-01T19:49:21.272 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.272 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.272 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:21.272 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.122655+0000", 2024-04-01T19:49:21.272 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.2534999999999999e-05 2024-04-01T19:49:21.272 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.272 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.272 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:21.272 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:43:55.122683+0000", 2024-04-01T19:49:21.272 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8223999999999999e-05 2024-04-01T19:49:21.272 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.272 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:21.272 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.272 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.273 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.273 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:125127 6.d 6:b23c7065:::benchmark_data_smithi188_134454_object125126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e495)", 2024-04-01T19:49:21.273 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:45:49.911809+0000", 2024-04-01T19:49:21.273 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 211.31911549899999, 2024-04-01T19:49:21.273 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.115293847, 2024-04-01T19:49:21.273 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:21.273 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:21.273 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:21.273 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:21.273 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:49:21.273 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:49:21.273 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 125127 2024-04-01T19:49:21.273 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.273 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:21.273 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.274 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:21.274 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.911809+0000", 2024-04-01T19:49:21.274 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.274 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.274 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.274 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:21.274 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.911809+0000", 2024-04-01T19:49:21.274 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.274 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.274 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.274 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:21.274 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.911810+0000", 2024-04-01T19:49:21.274 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.052e-06 2024-04-01T19:49:21.275 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.275 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.275 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:21.275 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.911873+0000", 2024-04-01T19:49:21.275 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3079999999999999e-05 2024-04-01T19:49:21.275 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.275 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.275 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:21.275 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.911882+0000", 2024-04-01T19:49:21.275 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.2560000000000002e-06 2024-04-01T19:49:21.275 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.275 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.275 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:21.275 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.911888+0000", 2024-04-01T19:49:21.276 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3620000000000002e-06 2024-04-01T19:49:21.276 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.276 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.276 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:21.276 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.912407+0000", 2024-04-01T19:49:21.276 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00051866499999999997 2024-04-01T19:49:21.276 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.276 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.276 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:21.276 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.912527+0000", 2024-04-01T19:49:21.276 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000120356 2024-04-01T19:49:21.276 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.276 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.276 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:49:21.276 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.912671+0000", 2024-04-01T19:49:21.277 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014441000000000001 2024-04-01T19:49:21.277 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.277 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.277 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:21.277 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.919403+0000", 2024-04-01T19:49:21.277 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.006731725 2024-04-01T19:49:21.277 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.277 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.277 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:21.277 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:50.027006+0000", 2024-04-01T19:49:21.277 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.10760328 2024-04-01T19:49:21.277 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.277 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.278 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:21.278 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:50.027051+0000", 2024-04-01T19:49:21.278 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.4579000000000001e-05 2024-04-01T19:49:21.278 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.278 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.278 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:21.278 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:50.027103+0000", 2024-04-01T19:49:21.278 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2082e-05 2024-04-01T19:49:21.278 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.278 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:21.278 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.278 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.278 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.278 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:125172 6.d 6:ba0a2c8e:::benchmark_data_smithi188_134454_object125171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e495)", 2024-04-01T19:49:21.279 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:45:49.948279+0000", 2024-04-01T19:49:21.279 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 211.28264595600001, 2024-04-01T19:49:21.279 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.090519042999999993, 2024-04-01T19:49:21.279 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:21.279 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:21.279 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:21.279 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:21.279 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:49:21.279 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:49:21.279 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 125172 2024-04-01T19:49:21.279 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.279 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:21.279 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.279 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:21.280 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.948279+0000", 2024-04-01T19:49:21.280 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.280 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.280 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.280 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:21.280 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.948279+0000", 2024-04-01T19:49:21.280 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.280 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.280 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.280 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:21.280 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.948280+0000", 2024-04-01T19:49:21.280 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2419999999999999e-06 2024-04-01T19:49:21.280 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.280 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.280 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:21.281 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.948356+0000", 2024-04-01T19:49:21.281 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.6110000000000001e-05 2024-04-01T19:49:21.281 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.281 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.281 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:21.281 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.948365+0000", 2024-04-01T19:49:21.281 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.8049999999999996e-06 2024-04-01T19:49:21.281 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.281 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.281 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:21.281 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.948371+0000", 2024-04-01T19:49:21.281 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.9529999999999996e-06 2024-04-01T19:49:21.281 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.281 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.281 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:21.282 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.948424+0000", 2024-04-01T19:49:21.282 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3517000000000003e-05 2024-04-01T19:49:21.282 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.282 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.282 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:21.282 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.948547+0000", 2024-04-01T19:49:21.282 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012278300000000001 2024-04-01T19:49:21.282 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.282 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.282 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:49:21.282 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.948686+0000", 2024-04-01T19:49:21.282 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013873100000000001 2024-04-01T19:49:21.282 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.283 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.283 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:21.283 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.952358+0000", 2024-04-01T19:49:21.283 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0036716700000000001 2024-04-01T19:49:21.283 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.283 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.283 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:21.283 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:50.038645+0000", 2024-04-01T19:49:21.283 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.086287612999999999 2024-04-01T19:49:21.283 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.283 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.283 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:21.283 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:50.038706+0000", 2024-04-01T19:49:21.283 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.0739999999999998e-05 2024-04-01T19:49:21.284 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.284 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.284 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:21.284 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:50.038798+0000", 2024-04-01T19:49:21.284 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1879000000000006e-05 2024-04-01T19:49:21.284 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.284 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:21.284 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.284 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.284 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.284 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:125179 6.d 6:b6d52c40:::benchmark_data_smithi188_134454_object125178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e495)", 2024-04-01T19:49:21.284 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:45:49.955096+0000", 2024-04-01T19:49:21.284 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 211.27582909700001, 2024-04-01T19:49:21.284 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.083830537999999996, 2024-04-01T19:49:21.285 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:21.285 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:21.285 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:21.285 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:21.285 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:49:21.285 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:49:21.285 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 125179 2024-04-01T19:49:21.285 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.285 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:21.285 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.285 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:21.285 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.955096+0000", 2024-04-01T19:49:21.285 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.285 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.285 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.286 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:21.286 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.955096+0000", 2024-04-01T19:49:21.286 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.286 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.286 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.286 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:21.286 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.955097+0000", 2024-04-01T19:49:21.286 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.7460000000000001e-06 2024-04-01T19:49:21.286 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.286 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.286 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:21.286 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.955158+0000", 2024-04-01T19:49:21.286 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.0927000000000001e-05 2024-04-01T19:49:21.287 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.287 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.287 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:21.287 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.955169+0000", 2024-04-01T19:49:21.287 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0404000000000001e-05 2024-04-01T19:49:21.287 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.287 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.287 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:21.287 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.955177+0000", 2024-04-01T19:49:21.287 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.388e-06 2024-04-01T19:49:21.287 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.287 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.287 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:21.287 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.955222+0000", 2024-04-01T19:49:21.288 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.5113e-05 2024-04-01T19:49:21.288 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.288 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.288 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:21.288 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.955324+0000", 2024-04-01T19:49:21.288 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000101418 2024-04-01T19:49:21.288 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.288 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.288 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 1", 2024-04-01T19:49:21.288 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.955430+0000", 2024-04-01T19:49:21.288 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000106827 2024-04-01T19:49:21.288 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.288 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.288 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:21.289 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:49.958520+0000", 2024-04-01T19:49:21.289 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0030895789999999998 2024-04-01T19:49:21.289 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.289 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.289 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:21.289 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:50.038850+0000", 2024-04-01T19:49:21.289 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.080330029999999997 2024-04-01T19:49:21.289 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.289 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.289 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:21.289 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:50.038884+0000", 2024-04-01T19:49:21.289 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.4350000000000001e-05 2024-04-01T19:49:21.289 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.290 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.290 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:21.290 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:45:50.038926+0000", 2024-04-01T19:49:21.290 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.1755999999999998e-05 2024-04-01T19:49:21.290 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.290 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:21.290 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.290 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.290 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.290 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:158558 6.7 6:ea98794f:::benchmark_data_smithi188_134454_object1817:head [delete] snapc 0=[] ondisk+write+known_if_redirected e504)", 2024-04-01T19:49:21.290 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:46:25.962806+0000", 2024-04-01T19:49:21.290 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 175.26811858400001, 2024-04-01T19:49:21.290 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.197842501, 2024-04-01T19:49:21.291 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:21.291 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:21.291 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:21.291 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:21.291 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:49:21.291 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:49:21.291 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 158558 2024-04-01T19:49:21.291 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.291 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:21.291 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.291 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:21.291 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.962806+0000", 2024-04-01T19:49:21.291 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.291 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.291 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.291 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:21.292 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.962806+0000", 2024-04-01T19:49:21.292 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.292 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.292 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.292 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:21.292 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.962809+0000", 2024-04-01T19:49:21.292 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.6790000000000001e-06 2024-04-01T19:49:21.292 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.292 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.292 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:21.292 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.962818+0000", 2024-04-01T19:49:21.292 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.7010000000000002e-06 2024-04-01T19:49:21.292 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.292 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.293 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:21.293 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.962836+0000", 2024-04-01T19:49:21.293 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8910999999999999e-05 2024-04-01T19:49:21.293 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.293 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.293 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:21.293 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.962847+0000", 2024-04-01T19:49:21.293 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0266e-05 2024-04-01T19:49:21.293 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.293 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.293 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:21.293 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.962909+0000", 2024-04-01T19:49:21.293 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.1798999999999996e-05 2024-04-01T19:49:21.293 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.293 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.293 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:21.293 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.962993+0000", 2024-04-01T19:49:21.294 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.4600999999999999e-05 2024-04-01T19:49:21.294 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.294 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.294 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:49:21.294 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.963074+0000", 2024-04-01T19:49:21.294 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0420000000000006e-05 2024-04-01T19:49:21.294 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.294 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.294 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:21.294 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.967085+0000", 2024-04-01T19:49:21.294 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0040115250000000002 2024-04-01T19:49:21.294 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.294 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.295 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:21.295 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:26.160549+0000", 2024-04-01T19:49:21.295 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.19346429400000001 2024-04-01T19:49:21.295 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.295 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.295 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:21.295 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:26.160603+0000", 2024-04-01T19:49:21.295 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3795000000000002e-05 2024-04-01T19:49:21.295 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.295 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.295 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:21.295 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:26.160649+0000", 2024-04-01T19:49:21.295 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.5510000000000003e-05 2024-04-01T19:49:21.295 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.295 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:21.296 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.296 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.296 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.296 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:158566 6.7 6:e3365a0f:::benchmark_data_smithi188_134454_object1825:head [delete] snapc 0=[] ondisk+write+known_if_redirected e504)", 2024-04-01T19:49:21.296 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:46:25.981449+0000", 2024-04-01T19:49:21.296 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 175.24947610500001, 2024-04-01T19:49:21.296 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.18005980299999999, 2024-04-01T19:49:21.296 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:21.296 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:21.296 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:21.296 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:21.296 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:49:21.296 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:49:21.296 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 158566 2024-04-01T19:49:21.296 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.296 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:21.297 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.297 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:21.297 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.981449+0000", 2024-04-01T19:49:21.297 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.297 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.297 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.297 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:21.297 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.981449+0000", 2024-04-01T19:49:21.297 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.297 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.297 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.297 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:21.297 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.981451+0000", 2024-04-01T19:49:21.297 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.4940000000000002e-06 2024-04-01T19:49:21.298 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.298 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.298 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:21.298 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.981460+0000", 2024-04-01T19:49:21.298 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.3869999999999995e-06 2024-04-01T19:49:21.298 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.298 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.298 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:21.298 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.981475+0000", 2024-04-01T19:49:21.298 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.5922000000000001e-05 2024-04-01T19:49:21.298 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.298 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.298 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:21.299 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.981484+0000", 2024-04-01T19:49:21.299 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.7020000000000007e-06 2024-04-01T19:49:21.299 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.299 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.299 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:21.299 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.981552+0000", 2024-04-01T19:49:21.299 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.7787000000000007e-05 2024-04-01T19:49:21.299 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.299 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.299 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:21.299 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.981682+0000", 2024-04-01T19:49:21.299 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000130295 2024-04-01T19:49:21.299 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.299 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.300 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:49:21.300 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.981809+0000", 2024-04-01T19:49:21.300 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012649300000000001 2024-04-01T19:49:21.300 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.300 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.300 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:21.300 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:25.985793+0000", 2024-04-01T19:49:21.300 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.003984179 2024-04-01T19:49:21.300 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.300 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.300 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:21.300 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:26.161415+0000", 2024-04-01T19:49:21.300 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.17562197199999999 2024-04-01T19:49:21.300 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.301 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.301 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:21.301 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:26.161465+0000", 2024-04-01T19:49:21.301 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9971e-05 2024-04-01T19:49:21.301 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.301 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.301 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:21.301 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:26.161508+0000", 2024-04-01T19:49:21.301 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3600999999999998e-05 2024-04-01T19:49:21.301 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.301 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:21.301 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.301 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.301 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.302 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:176724 6.7 6:ee6ec43a:::benchmark_data_smithi188_134454_object19983:head [delete] snapc 0=[] ondisk+write+known_if_redirected e511)", 2024-04-01T19:49:21.302 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:46:42.580841+0000", 2024-04-01T19:49:21.302 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 158.650083819, 2024-04-01T19:49:21.302 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.12596052699999999, 2024-04-01T19:49:21.302 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:21.302 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:21.302 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:21.302 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:21.302 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:49:21.302 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:49:21.302 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 176724 2024-04-01T19:49:21.302 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.303 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:21.303 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.303 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:21.303 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.580841+0000", 2024-04-01T19:49:21.303 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.303 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.303 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.303 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:21.303 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.580841+0000", 2024-04-01T19:49:21.303 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.303 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.303 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.303 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:21.303 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.580842+0000", 2024-04-01T19:49:21.304 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1399999999999996e-07 2024-04-01T19:49:21.304 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.304 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.304 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:21.304 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.580845+0000", 2024-04-01T19:49:21.304 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.9699999999999999e-06 2024-04-01T19:49:21.304 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.304 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.304 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:21.304 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.580850+0000", 2024-04-01T19:49:21.304 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7810000000000002e-06 2024-04-01T19:49:21.304 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.304 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.304 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:21.305 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.580856+0000", 2024-04-01T19:49:21.305 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.4360000000000001e-06 2024-04-01T19:49:21.305 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.305 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.305 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:21.305 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.585147+0000", 2024-04-01T19:49:21.305 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0042907290000000001 2024-04-01T19:49:21.305 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.305 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.305 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:21.305 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.585267+0000", 2024-04-01T19:49:21.305 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012077499999999999 2024-04-01T19:49:21.305 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.305 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.305 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:49:21.306 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.585384+0000", 2024-04-01T19:49:21.306 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000117026 2024-04-01T19:49:21.306 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.306 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.306 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:21.306 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.597594+0000", 2024-04-01T19:49:21.306 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.012209784 2024-04-01T19:49:21.306 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.306 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.306 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:21.306 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.706686+0000", 2024-04-01T19:49:21.306 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.109092156 2024-04-01T19:49:21.306 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.307 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.307 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:21.307 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.706745+0000", 2024-04-01T19:49:21.307 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8423e-05 2024-04-01T19:49:21.307 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.307 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.307 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:21.307 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.706801+0000", 2024-04-01T19:49:21.307 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6733e-05 2024-04-01T19:49:21.307 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.307 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:21.307 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.307 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.307 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.308 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:176728 6.7 6:e03841ca:::benchmark_data_smithi188_134454_object19987:head [delete] snapc 0=[] ondisk+write+known_if_redirected e511)", 2024-04-01T19:49:21.308 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:46:42.586128+0000", 2024-04-01T19:49:21.308 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 158.644796442, 2024-04-01T19:49:21.308 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.120796052, 2024-04-01T19:49:21.308 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:21.308 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:21.308 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:21.308 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:21.308 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:49:21.308 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:49:21.308 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 176728 2024-04-01T19:49:21.308 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.308 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:21.308 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.309 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:21.309 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.586128+0000", 2024-04-01T19:49:21.309 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.309 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.309 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.309 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:21.309 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.586128+0000", 2024-04-01T19:49:21.309 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.309 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.309 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.309 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:21.309 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.586130+0000", 2024-04-01T19:49:21.309 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4789999999999999e-06 2024-04-01T19:49:21.309 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.310 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.310 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:21.310 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.586135+0000", 2024-04-01T19:49:21.310 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3109999999999996e-06 2024-04-01T19:49:21.310 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.310 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.310 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:21.310 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.586144+0000", 2024-04-01T19:49:21.310 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.8389999999999996e-06 2024-04-01T19:49:21.310 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.310 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.310 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:21.310 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.586150+0000", 2024-04-01T19:49:21.311 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.9669999999999998e-06 2024-04-01T19:49:21.311 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.311 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.311 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:21.311 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.590110+0000", 2024-04-01T19:49:21.311 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0039596479999999996 2024-04-01T19:49:21.311 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.311 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.311 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:21.311 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.590195+0000", 2024-04-01T19:49:21.311 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.5766000000000005e-05 2024-04-01T19:49:21.311 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.311 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.311 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:49:21.311 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.590266+0000", 2024-04-01T19:49:21.312 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.0347999999999998e-05 2024-04-01T19:49:21.312 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.312 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.312 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:21.312 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.597601+0000", 2024-04-01T19:49:21.312 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.007334859 2024-04-01T19:49:21.312 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.312 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.312 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:21.312 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.706840+0000", 2024-04-01T19:49:21.312 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.109238972 2024-04-01T19:49:21.312 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.312 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.313 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:21.313 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.706889+0000", 2024-04-01T19:49:21.313 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9069000000000001e-05 2024-04-01T19:49:21.313 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.313 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.313 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:21.313 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.706924+0000", 2024-04-01T19:49:21.313 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.5794000000000003e-05 2024-04-01T19:49:21.313 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.313 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:21.313 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.313 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.313 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.314 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:176733 6.7 6:ec1cf91c:::benchmark_data_smithi188_134454_object19992:head [delete] snapc 0=[] ondisk+write+known_if_redirected e511)", 2024-04-01T19:49:21.314 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:46:42.591622+0000", 2024-04-01T19:49:21.314 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 158.63930302200001, 2024-04-01T19:49:21.314 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.115414395, 2024-04-01T19:49:21.314 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:21.314 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:21.314 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:21.314 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:21.314 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:49:21.314 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:49:21.314 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 176733 2024-04-01T19:49:21.314 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.314 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:21.315 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.315 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:21.315 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.591622+0000", 2024-04-01T19:49:21.315 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.315 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.315 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.315 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:21.315 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.591622+0000", 2024-04-01T19:49:21.315 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.315 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.315 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.315 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:21.315 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.591624+0000", 2024-04-01T19:49:21.316 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.5229999999999998e-06 2024-04-01T19:49:21.316 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.316 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.316 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:21.316 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.591630+0000", 2024-04-01T19:49:21.316 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3210000000000004e-06 2024-04-01T19:49:21.316 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.316 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.316 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:21.316 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.591640+0000", 2024-04-01T19:49:21.316 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.9380000000000004e-06 2024-04-01T19:49:21.316 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.316 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.316 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:21.317 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.591646+0000", 2024-04-01T19:49:21.317 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6560000000000003e-06 2024-04-01T19:49:21.317 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.317 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.317 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:21.317 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.593902+0000", 2024-04-01T19:49:21.317 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0022562289999999998 2024-04-01T19:49:21.317 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.317 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.317 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:21.317 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.593986+0000", 2024-04-01T19:49:21.317 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.3573999999999996e-05 2024-04-01T19:49:21.317 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.317 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.318 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:49:21.318 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.594054+0000", 2024-04-01T19:49:21.318 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8044000000000001e-05 2024-04-01T19:49:21.318 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.318 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.318 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:21.318 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.598002+0000", 2024-04-01T19:49:21.318 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0039482450000000004 2024-04-01T19:49:21.318 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.318 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.318 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:21.318 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.706962+0000", 2024-04-01T19:49:21.319 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.10895949100000001 2024-04-01T19:49:21.319 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.319 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.319 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:21.319 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.707003+0000", 2024-04-01T19:49:21.319 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0868000000000002e-05 2024-04-01T19:49:21.319 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.319 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.319 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:21.319 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.707036+0000", 2024-04-01T19:49:21.319 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.3506000000000001e-05 2024-04-01T19:49:21.319 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.319 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:21.319 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.320 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.320 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.320 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:176753 6.7 6:e573512b:::benchmark_data_smithi188_134454_object20012:head [delete] snapc 0=[] ondisk+write+known_if_redirected e511)", 2024-04-01T19:49:21.320 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:46:42.615549+0000", 2024-04-01T19:49:21.320 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 158.615375664, 2024-04-01T19:49:21.320 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.097330704000000004, 2024-04-01T19:49:21.320 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:21.320 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:21.320 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:21.320 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:21.320 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:49:21.320 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:49:21.320 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 176753 2024-04-01T19:49:21.320 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.321 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:21.321 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.321 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:21.321 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.615549+0000", 2024-04-01T19:49:21.321 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.321 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.321 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.321 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:21.321 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.615549+0000", 2024-04-01T19:49:21.321 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.321 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.321 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.321 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:21.321 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.615551+0000", 2024-04-01T19:49:21.322 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.933e-06 2024-04-01T19:49:21.322 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.322 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.322 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:21.322 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.615557+0000", 2024-04-01T19:49:21.322 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7370000000000003e-06 2024-04-01T19:49:21.322 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.322 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.322 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:21.322 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.615568+0000", 2024-04-01T19:49:21.322 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0864e-05 2024-04-01T19:49:21.322 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.322 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.323 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:21.323 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.615574+0000", 2024-04-01T19:49:21.323 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6490000000000002e-06 2024-04-01T19:49:21.323 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.323 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.323 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:21.323 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.615632+0000", 2024-04-01T19:49:21.323 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7433999999999999e-05 2024-04-01T19:49:21.323 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.323 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.323 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:21.323 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.615786+0000", 2024-04-01T19:49:21.323 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00015462000000000001 2024-04-01T19:49:21.323 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.324 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.324 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:49:21.324 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.615925+0000", 2024-04-01T19:49:21.324 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013888600000000001 2024-04-01T19:49:21.324 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.324 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.324 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:21.324 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.619611+0000", 2024-04-01T19:49:21.324 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0036855799999999999 2024-04-01T19:49:21.324 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.324 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.324 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:21.324 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.712818+0000", 2024-04-01T19:49:21.325 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.093207096000000003 2024-04-01T19:49:21.325 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.325 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.325 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:21.325 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.712851+0000", 2024-04-01T19:49:21.325 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.3491999999999997e-05 2024-04-01T19:49:21.325 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.325 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.325 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:21.325 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:42.712880+0000", 2024-04-01T19:49:21.325 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8413000000000001e-05 2024-04-01T19:49:21.325 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.325 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:21.325 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.326 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.326 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.326 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:179953 6.7 6:eb4f1c00:::benchmark_data_smithi188_134454_object23212:head [delete] snapc 0=[] ondisk+write+known_if_redirected e513)", 2024-04-01T19:49:21.326 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:46:45.582681+0000", 2024-04-01T19:49:21.326 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 155.64824348499999, 2024-04-01T19:49:21.326 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.085607287000000004, 2024-04-01T19:49:21.326 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:21.326 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:21.326 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:21.326 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:21.326 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:49:21.326 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:49:21.326 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 179953 2024-04-01T19:49:21.326 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.327 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:21.327 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.327 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:21.327 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.582681+0000", 2024-04-01T19:49:21.327 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.327 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.327 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.327 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:21.327 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.582681+0000", 2024-04-01T19:49:21.327 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.327 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.327 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.327 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:21.328 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.582683+0000", 2024-04-01T19:49:21.328 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.26e-06 2024-04-01T19:49:21.328 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.328 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.328 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:21.328 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.582688+0000", 2024-04-01T19:49:21.328 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0220000000000004e-06 2024-04-01T19:49:21.328 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.328 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.328 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:21.328 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.582699+0000", 2024-04-01T19:49:21.328 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1107000000000001e-05 2024-04-01T19:49:21.328 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.328 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.329 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:21.329 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.582706+0000", 2024-04-01T19:49:21.329 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.2729999999999997e-06 2024-04-01T19:49:21.329 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.329 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.329 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:21.329 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.582806+0000", 2024-04-01T19:49:21.329 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000100146 2024-04-01T19:49:21.329 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.329 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.329 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:21.329 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.582919+0000", 2024-04-01T19:49:21.329 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00011261500000000001 2024-04-01T19:49:21.329 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.329 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.330 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:49:21.330 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.583043+0000", 2024-04-01T19:49:21.330 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000124583 2024-04-01T19:49:21.330 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.330 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.330 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:21.330 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.587778+0000", 2024-04-01T19:49:21.330 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.004734622 2024-04-01T19:49:21.330 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.330 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.330 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:21.330 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.667962+0000", 2024-04-01T19:49:21.331 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.080184018999999995 2024-04-01T19:49:21.331 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.331 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.331 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:21.331 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.668008+0000", 2024-04-01T19:49:21.331 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6144999999999999e-05 2024-04-01T19:49:21.331 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.331 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.331 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:21.331 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.668289+0000", 2024-04-01T19:49:21.331 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00028049500000000002 2024-04-01T19:49:21.331 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.331 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:21.331 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.332 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.332 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.332 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:179959 6.7 6:e3091b49:::benchmark_data_smithi188_134454_object23218:head [delete] snapc 0=[] ondisk+write+known_if_redirected e513)", 2024-04-01T19:49:21.332 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:46:45.588379+0000", 2024-04-01T19:49:21.332 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 155.64254613400001, 2024-04-01T19:49:21.332 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.080007049999999996, 2024-04-01T19:49:21.332 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:21.332 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:21.332 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:21.332 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:21.332 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:49:21.332 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:49:21.332 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 179959 2024-04-01T19:49:21.332 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.332 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:21.333 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.333 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:21.333 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.588379+0000", 2024-04-01T19:49:21.333 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.333 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.333 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.333 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:21.333 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.588379+0000", 2024-04-01T19:49:21.333 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.333 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.333 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.333 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:21.333 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.588380+0000", 2024-04-01T19:49:21.333 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.327e-06 2024-04-01T19:49:21.333 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.333 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.334 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:21.334 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.588385+0000", 2024-04-01T19:49:21.334 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6190000000000002e-06 2024-04-01T19:49:21.334 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.334 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.334 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:21.334 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.588395+0000", 2024-04-01T19:49:21.334 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0225e-05 2024-04-01T19:49:21.334 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.334 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.334 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:21.334 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.588401+0000", 2024-04-01T19:49:21.334 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6490000000000002e-06 2024-04-01T19:49:21.334 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.334 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.335 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:21.335 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.588456+0000", 2024-04-01T19:49:21.335 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.4410999999999998e-05 2024-04-01T19:49:21.335 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.335 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.335 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:21.335 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.588584+0000", 2024-04-01T19:49:21.335 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012802399999999999 2024-04-01T19:49:21.335 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.335 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.335 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:49:21.335 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.588720+0000", 2024-04-01T19:49:21.335 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013644899999999999 2024-04-01T19:49:21.335 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.335 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.335 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:21.336 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.596973+0000", 2024-04-01T19:49:21.336 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0082530569999999994 2024-04-01T19:49:21.336 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.336 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.336 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:21.336 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.668332+0000", 2024-04-01T19:49:21.336 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.071358828999999999 2024-04-01T19:49:21.336 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.336 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.336 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:21.336 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.668362+0000", 2024-04-01T19:49:21.336 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.9768e-05 2024-04-01T19:49:21.336 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.336 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.336 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:21.336 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.668386+0000", 2024-04-01T19:49:21.337 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3691999999999999e-05 2024-04-01T19:49:21.337 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.337 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:21.337 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.337 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.337 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.337 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:179961 6.7 6:e6c902a5:::benchmark_data_smithi188_134454_object23220:head [delete] snapc 0=[] ondisk+write+known_if_redirected e513)", 2024-04-01T19:49:21.337 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:46:45.588741+0000", 2024-04-01T19:49:21.337 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 155.64218411799999, 2024-04-01T19:49:21.337 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.079743815999999995, 2024-04-01T19:49:21.337 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:21.337 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:21.337 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:21.337 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:21.337 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:49:21.337 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:49:21.338 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 179961 2024-04-01T19:49:21.338 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.338 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:21.338 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.338 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:21.338 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.588741+0000", 2024-04-01T19:49:21.338 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.338 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.338 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.338 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:21.338 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.588741+0000", 2024-04-01T19:49:21.338 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:21.338 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.338 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.339 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:21.339 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.588742+0000", 2024-04-01T19:49:21.339 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.136e-06 2024-04-01T19:49:21.339 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.339 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.339 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:21.339 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.588746+0000", 2024-04-01T19:49:21.339 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.4290000000000003e-06 2024-04-01T19:49:21.339 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.339 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.339 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:21.339 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.588758+0000", 2024-04-01T19:49:21.339 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1745e-05 2024-04-01T19:49:21.339 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.339 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.340 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:21.340 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.588774+0000", 2024-04-01T19:49:21.340 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.5908000000000001e-05 2024-04-01T19:49:21.340 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.340 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.340 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:21.340 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.592445+0000", 2024-04-01T19:49:21.340 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0036713589999999999 2024-04-01T19:49:21.340 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.340 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.340 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:21.340 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.592581+0000", 2024-04-01T19:49:21.340 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000135969 2024-04-01T19:49:21.341 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.341 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.341 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:49:21.341 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.592697+0000", 2024-04-01T19:49:21.341 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000116249 2024-04-01T19:49:21.341 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.341 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.341 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:21.341 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.597128+0000", 2024-04-01T19:49:21.341 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0044304990000000001 2024-04-01T19:49:21.341 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.341 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.341 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:21.341 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.668420+0000", 2024-04-01T19:49:21.342 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.071292478000000006 2024-04-01T19:49:21.342 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.342 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.342 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:21.342 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.668448+0000", 2024-04-01T19:49:21.342 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.7611e-05 2024-04-01T19:49:21.342 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:21.342 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:21.342 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:21.342 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:46:45.668484+0000", 2024-04-01T19:49:21.342 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.6433000000000002e-05 2024-04-01T19:49:21.342 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.342 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:21.343 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.343 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:21.343 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:21.343 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:49:21.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:21.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:21.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:21.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:21.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:21.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:21 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3696039759' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T19:49:21.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:21 smithi062 ceph-mon[44211]: osdmap e557: 12 total, 11 up, 11 in 2024-04-01T19:49:21.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:21 smithi062 ceph-mon[44211]: pgmap v1532: 1 pgs: 1 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:21.667 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:49:21.667 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:49:21.672 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:21.673 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:49:21.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:21.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:21.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:21.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:21.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:21.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:21 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3696039759' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T19:49:21.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:21 smithi022 ceph-mon[39439]: osdmap e557: 12 total, 11 up, 11 in 2024-04-01T19:49:21.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:21 smithi022 ceph-mon[39439]: pgmap v1532: 1 pgs: 1 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:21.774 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:49:21.804 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:21.804 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:21.804 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:21.804 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:21.804 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:21.804 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:21 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3696039759' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T19:49:21.804 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:21 smithi188 ceph-mon[43939]: osdmap e557: 12 total, 11 up, 11 in 2024-04-01T19:49:21.804 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:21 smithi188 ceph-mon[43939]: pgmap v1532: 1 pgs: 1 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:21.806 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:21.827 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:49:21.830 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:21.830 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:49:21.932 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:49:21.961 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:21.963 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_ops_in_flight 2024-04-01T19:49:21.981 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:49:21.984 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:21.984 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:49:22.085 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:49:22.114 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:22.140 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:49:22.143 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:22.143 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:49:22.232 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:49:22.233 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:49:22.244 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:49:22.249 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:49:22.273 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:22.523 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:49:22.526 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:22.526 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:49:22.627 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:49:22.659 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:22.682 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:49:22.685 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:22.685 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:49:22.786 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:49:22.814 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:22.834 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-04-01T19:49:22.834 INFO:tasks.radosbench:Beginning radosbench... 2024-04-01T19:49:22.835 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_5 2024-04-01T19:49:22.835 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pool create unique_pool_5 16 2024-04-01T19:49:23.013 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:49:23.016 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:23.016 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:49:23.117 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:49:23.145 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:23.230 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:49:23.233 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:49:23.494 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:49:23.496 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:23.497 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:49:23.598 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:49:23.630 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:23.652 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:49:23.654 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:23.657 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:49:23.758 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:49:23.788 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:23.886 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:49:23.889 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:23.889 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:49:23.990 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:49:24.015 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:49:24.015 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:49:24.015 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 0 2024-04-01T19:49:24.015 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:49:24.020 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:24.040 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:49:24.042 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:24.043 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:49:24.108 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":1533,"stamp":"2024-04-01T19:49:23.189393+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":11,"num_per_pool_osds":11,"num_per_pool_omap_osds":6,"kb":1031196672,"kb_used":4596572,"kb_used_data":9096,"kb_used_omap":890,"kb_used_meta":4586437,"kb_avail":1026600100,"statfs":{"total":1055945392128,"available":1051238502400,"internally_reserved":0,"allocated":9314304,"data_stored":5145599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":911939,"internal_metadata":4696511933},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-313478,"num_write_kb":-10031233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-7665,"num_bytes_recovered":-502267928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001231"},"pg_stats":[{"pgid":"1.0","version":"156'139","reported_seq":1401,"reported_epoch":555,"state":"active+clean","last_fresh":"2024-04-01T19:49:17.461841+0000","last_change":"2024-04-01T19:49:13.674189+0000","last_active":"2024-04-01T19:49:17.461841+0000","last_peered":"2024-04-01T19:49:17.461841+0000","last_clean":"2024-04-01T19:49:17.461841+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:49:17.461841+0000","last_undegraded":"2024-04-01T19:49:17.461841+0000","last_fullsized":"2024-04-01T19:49:17.461841+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:49:13.674044+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:49:13.674044+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:50:30.700477+0000","scrub_duration":121,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220481,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":636352,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":635070,"kb_avail":93108800,"statfs":{"total":95995035648,"available":95343411200,"internally_reserved":0,"allocated":1298432,"data_stored":907385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":650312132},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":10,"up_from":77,"seq":330712482117,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":428984,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":428222,"kb_avail":93316168,"statfs":{"total":95995035648,"available":95555756032,"internally_reserved":0,"allocated":765952,"data_stored":378457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":438499776},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678348,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":410912,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":410174,"kb_avail":93334240,"statfs":{"total":95995035648,"available":95574261760,"internally_reserved":0,"allocated":737280,"data_stored":365901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":420018624},"hb_peers":[0,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557545,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":110572,"kb_used_data":732,"kb_used_omap":132,"kb_used_meta":109691,"kb_avail":93634580,"statfs":{"total":95995035648,"available":95881809920,"internally_reserved":0,"allocated":749568,"data_stored":372185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":112324327},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234326,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":455844,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":454590,"kb_avail":93289308,"statfs":{"total":95995035648,"available":95528251392,"internally_reserved":0,"allocated":1269760,"data_stored":894829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":465500618},"hb_peers":[0,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":457,"seq":1962800054337,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":127272,"kb_used_data":732,"kb_used_omap":744,"kb_used_meta":125783,"kb_avail":93617880,"statfs":{"total":95995035648,"available":95864709120,"internally_reserved":0,"allocated":749568,"data_stored":372185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":762131,"internal_metadata":128802541},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738747,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":505340,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":504574,"kb_avail":93239812,"statfs":{"total":95995035648,"available":95477567488,"internally_reserved":0,"allocated":765952,"data_stored":378477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":516684229},"hb_peers":[2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346288,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297052,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":296318,"kb_avail":93448100,"statfs":{"total":95995035648,"available":95690854400,"internally_reserved":0,"allocated":737280,"data_stored":365901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":303430085},"hb_peers":[0,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669150057,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":581652,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":580926,"kb_avail":93163500,"statfs":{"total":95995035648,"available":95399424000,"internally_reserved":0,"allocated":724992,"data_stored":359617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":594868679},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953828,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":515064,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":514302,"kb_avail":93230088,"statfs":{"total":95995035648,"available":95467610112,"internally_reserved":0,"allocated":765952,"data_stored":378477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":526645701},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790304,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":527528,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":526782,"kb_avail":93217624,"statfs":{"total":95995035648,"available":95454846976,"internally_reserved":0,"allocated":749568,"data_stored":372185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":539425221},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:49:24.108 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-01T19:49:24.109 INFO:tasks.thrashosds.thrasher:Waiting for trim 2024-04-01T19:49:24.144 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:49:24.173 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:24.235 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:49:24.296 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:49:24.298 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:24 smithi062 ceph-mon[44211]: pgmap v1533: 1 pgs: 1 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:24.298 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:24 smithi062 ceph-mon[44211]: from='client.16623 v1:172.21.15.22:0/3669082964' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:49:24.299 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:24.299 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:49:24.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:24 smithi022 ceph-mon[39439]: pgmap v1533: 1 pgs: 1 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:24.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:24 smithi022 ceph-mon[39439]: from='client.16623 v1:172.21.15.22:0/3669082964' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:49:24.400 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:49:24.432 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:24.453 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:49:24.456 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:24.456 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:49:24.557 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:49:24.585 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:24 smithi188 ceph-mon[43939]: pgmap v1533: 1 pgs: 1 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:24.585 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:24 smithi188 ceph-mon[43939]: from='client.16623 v1:172.21.15.22:0/3669082964' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:49:24.587 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:24.607 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:49:24.609 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:24.610 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:49:24.711 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:49:24.717 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_blocked_ops 2024-04-01T19:49:24.738 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:24.758 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:49:24.760 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:24.761 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:49:24.862 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:49:24.888 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:24.907 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:49:24.909 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:24.910 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:49:24.986 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:49:25.010 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:49:25.021 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:49:25.036 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:25.054 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:49:25.056 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:25.057 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:49:25.158 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:49:25.185 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:25.206 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:49:25.208 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:25.208 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:49:25.310 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:49:25.342 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:25.858 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:49:25.893 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:49:25.895 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:25.896 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:49:25.997 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:49:26.028 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:26.127 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:49:26.130 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:26.132 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:49:26.233 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:49:26.263 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:26.291 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:49:26.293 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:26.293 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:49:26.388 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:26 smithi062 ceph-mon[44211]: pgmap v1534: 1 pgs: 1 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:26.388 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:26 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:49:26.388 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:26 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:49:26.388 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:26 smithi062 ceph-mon[44211]: osdmap e558: 12 total, 11 up, 11 in 2024-04-01T19:49:26.394 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:49:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:26.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:26 smithi022 ceph-mon[39439]: pgmap v1534: 1 pgs: 1 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:26.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:26 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:49:26.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:26 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:49:26.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:26 smithi022 ceph-mon[39439]: osdmap e558: 12 total, 11 up, 11 in 2024-04-01T19:49:26.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:26 smithi188 ceph-mon[43939]: pgmap v1534: 1 pgs: 1 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:26.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:26 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:49:26.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:26 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:49:26.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:26 smithi188 ceph-mon[43939]: osdmap e558: 12 total, 11 up, 11 in 2024-04-01T19:49:26.624 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:49:26.627 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:26.627 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:49:26.644 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:49:26.644 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:49:26.644 INFO:teuthology.orchestra.run.smithi062.stdout: "complaint_time": 30, 2024-04-01T19:49:26.644 INFO:teuthology.orchestra.run.smithi062.stdout: "num_blocked_ops": 0 2024-04-01T19:49:26.645 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:49:26.729 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:49:26.759 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:26.908 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:49:26.911 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:26.911 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:49:27.012 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:49:27.041 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:27.257 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:49:27.381 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:27 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3472983578' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:49:27.391 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:49:27.393 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:27.394 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:49:27.409 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_historic_ops 2024-04-01T19:49:27.495 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:49:27.523 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:27 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3472983578' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:49:27.525 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:27.545 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:49:27.547 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:27.548 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:49:27.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:27 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3472983578' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:49:27.649 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:49:27.677 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:27.721 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:49:28.126 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:49:28.128 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:28.129 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:49:28.230 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:49:28.260 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:28.459 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:49:28.461 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:28.462 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:49:28.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:28 smithi062 ceph-mon[44211]: pgmap v1536: 1 pgs: 1 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:28.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:28 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:49:28.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:28 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3472983578' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:49:28.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:28 smithi062 ceph-mon[44211]: osdmap e559: 12 total, 11 up, 11 in 2024-04-01T19:49:28.562 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:49:28.589 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:28 smithi022 ceph-mon[39439]: pgmap v1536: 1 pgs: 1 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:28.589 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:28 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:49:28.589 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:28 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3472983578' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:49:28.589 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:28 smithi022 ceph-mon[39439]: osdmap e559: 12 total, 11 up, 11 in 2024-04-01T19:49:28.597 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:28.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:28 smithi188 ceph-mon[43939]: pgmap v1536: 1 pgs: 1 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:28.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:28 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:49:28.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:28 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3472983578' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:49:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:28 smithi188 ceph-mon[43939]: osdmap e559: 12 total, 11 up, 11 in 2024-04-01T19:49:28.848 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:49:28.852 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:28.852 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:49:28.953 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:49:28.983 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:29.083 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:49:29.085 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:29.086 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:49:29.187 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:49:29.218 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:29.240 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:49:29.242 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:29.243 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:49:29.344 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:49:29.374 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:29.412 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:49:29.415 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:29.415 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:49:29.516 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:49:29.543 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:49:29.543 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 20, 2024-04-01T19:49:29.543 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 600, 2024-04-01T19:49:29.543 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:49:29.543 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.543 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237053 5.9 5.73e012a9 (undecoded) ondisk+retry+write+known_if_redirected e430)", 2024-04-01T19:49:29.543 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:34.398341+0000", 2024-04-01T19:49:29.543 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 415.14506705100001, 2024-04-01T19:49:29.543 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48063113499999999, 2024-04-01T19:49:29.543 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:29.543 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:29.543 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "reached pg", 2024-04-01T19:49:29.543 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:29.544 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:49:29.544 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:29.544 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237053 2024-04-01T19:49:29.544 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.544 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:29.544 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.544 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:29.544 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398341+0000", 2024-04-01T19:49:29.544 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.544 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.544 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.544 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:29.544 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398341+0000", 2024-04-01T19:49:29.544 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.545 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.545 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.545 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:29.545 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398344+0000", 2024-04-01T19:49:29.545 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.847e-06 2024-04-01T19:49:29.545 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.545 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.545 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:29.545 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398351+0000", 2024-04-01T19:49:29.545 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.4919999999999996e-06 2024-04-01T19:49:29.545 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.545 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.545 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:29.545 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398363+0000", 2024-04-01T19:49:29.546 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2e-05 2024-04-01T19:49:29.546 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.546 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.546 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:29.546 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398374+0000", 2024-04-01T19:49:29.546 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.111e-05 2024-04-01T19:49:29.546 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.546 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.546 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.546 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398525+0000", 2024-04-01T19:49:29.546 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00015002400000000001 2024-04-01T19:49:29.546 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.546 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.547 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for peered", 2024-04-01T19:49:29.547 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398538+0000", 2024-04-01T19:49:29.547 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3566e-05 2024-04-01T19:49:29.547 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.547 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.547 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.547 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.878945+0000", 2024-04-01T19:49:29.547 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48040738399999999 2024-04-01T19:49:29.547 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.547 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.547 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:29.547 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.878972+0000", 2024-04-01T19:49:29.547 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.6712000000000001e-05 2024-04-01T19:49:29.547 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.548 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:29.548 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.548 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.548 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.548 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237054 5.9 5.ef787e09 (undecoded) ondisk+retry+write+known_if_redirected e430)", 2024-04-01T19:49:29.548 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:34.398400+0000", 2024-04-01T19:49:29.548 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 415.14500817599998, 2024-04-01T19:49:29.548 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48072366700000002, 2024-04-01T19:49:29.548 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:29.548 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:29.548 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "reached pg", 2024-04-01T19:49:29.548 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:29.548 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:49:29.548 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:29.548 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237054 2024-04-01T19:49:29.549 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.549 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:29.549 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.549 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:29.549 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398400+0000", 2024-04-01T19:49:29.549 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.549 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.549 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.549 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:29.549 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398400+0000", 2024-04-01T19:49:29.549 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.549 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.549 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.549 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:29.550 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398401+0000", 2024-04-01T19:49:29.550 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.0400000000000005e-07 2024-04-01T19:49:29.550 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.550 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.550 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:29.550 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398405+0000", 2024-04-01T19:49:29.550 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8659999999999999e-06 2024-04-01T19:49:29.550 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.550 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.550 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:29.550 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398412+0000", 2024-04-01T19:49:29.550 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.7400000000000004e-06 2024-04-01T19:49:29.550 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.551 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.551 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:29.551 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398419+0000", 2024-04-01T19:49:29.551 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8090000000000004e-06 2024-04-01T19:49:29.551 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.551 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.551 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.551 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398573+0000", 2024-04-01T19:49:29.551 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00015426200000000001 2024-04-01T19:49:29.551 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.551 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.551 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for peered", 2024-04-01T19:49:29.551 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398578+0000", 2024-04-01T19:49:29.551 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9629999999999997e-06 2024-04-01T19:49:29.552 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.552 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.552 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.552 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879117+0000", 2024-04-01T19:49:29.552 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48053854400000001 2024-04-01T19:49:29.552 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.552 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.552 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:29.552 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879124+0000", 2024-04-01T19:49:29.552 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.579e-06 2024-04-01T19:49:29.552 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.552 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:29.552 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.552 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.553 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.553 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237056 5.9 5.8ada1de9 (undecoded) ondisk+retry+write+known_if_redirected e430)", 2024-04-01T19:49:29.553 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:34.398448+0000", 2024-04-01T19:49:29.553 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 415.14495975699998, 2024-04-01T19:49:29.553 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48070834099999998, 2024-04-01T19:49:29.553 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:29.553 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:29.553 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "reached pg", 2024-04-01T19:49:29.553 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:29.553 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:49:29.553 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:29.553 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237056 2024-04-01T19:49:29.553 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.553 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:29.554 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.554 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:29.554 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398448+0000", 2024-04-01T19:49:29.554 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.554 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.554 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.554 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:29.554 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398448+0000", 2024-04-01T19:49:29.554 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.554 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.554 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.554 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:29.554 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398449+0000", 2024-04-01T19:49:29.555 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.0100000000000003e-07 2024-04-01T19:49:29.555 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.555 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.555 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:29.555 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398453+0000", 2024-04-01T19:49:29.555 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.5209999999999998e-06 2024-04-01T19:49:29.555 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.555 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.555 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:29.555 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398461+0000", 2024-04-01T19:49:29.555 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.4989999999999994e-06 2024-04-01T19:49:29.555 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.556 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.556 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:29.556 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398468+0000", 2024-04-01T19:49:29.556 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3589999999999996e-06 2024-04-01T19:49:29.556 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.556 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.556 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.556 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398605+0000", 2024-04-01T19:49:29.556 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013783 2024-04-01T19:49:29.556 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.556 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.556 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for peered", 2024-04-01T19:49:29.556 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398612+0000", 2024-04-01T19:49:29.556 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.1510000000000001e-06 2024-04-01T19:49:29.556 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.557 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.557 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.557 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879151+0000", 2024-04-01T19:49:29.557 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48053952500000002 2024-04-01T19:49:29.557 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.557 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.557 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:29.557 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879157+0000", 2024-04-01T19:49:29.557 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5550000000000002e-06 2024-04-01T19:49:29.557 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.557 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:29.557 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.557 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.558 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.558 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237061 5.9 5.ea6b7559 (undecoded) ondisk+retry+write+known_if_redirected e430)", 2024-04-01T19:49:29.558 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:34.398482+0000", 2024-04-01T19:49:29.558 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 415.14492606200002, 2024-04-01T19:49:29.558 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48070495400000002, 2024-04-01T19:49:29.558 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:29.558 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:29.558 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "reached pg", 2024-04-01T19:49:29.558 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:29.558 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:49:29.558 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:29.558 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237061 2024-04-01T19:49:29.558 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.559 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:29.559 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.559 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:29.559 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398482+0000", 2024-04-01T19:49:29.559 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.559 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.559 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.559 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:29.559 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398482+0000", 2024-04-01T19:49:29.559 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.559 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.559 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.559 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:29.559 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398483+0000", 2024-04-01T19:49:29.560 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.2099999999999996e-07 2024-04-01T19:49:29.560 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.560 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.560 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:29.560 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398486+0000", 2024-04-01T19:49:29.560 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.2229999999999999e-06 2024-04-01T19:49:29.560 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.560 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.560 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:29.560 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398492+0000", 2024-04-01T19:49:29.560 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5250000000000002e-06 2024-04-01T19:49:29.560 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.560 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.560 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:29.560 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398498+0000", 2024-04-01T19:49:29.560 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6300000000000003e-06 2024-04-01T19:49:29.561 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.561 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.561 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.561 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398637+0000", 2024-04-01T19:49:29.561 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013912899999999999 2024-04-01T19:49:29.561 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.561 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.561 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for peered", 2024-04-01T19:49:29.561 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398641+0000", 2024-04-01T19:49:29.561 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.1640000000000003e-06 2024-04-01T19:49:29.561 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.561 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.561 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.561 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879182+0000", 2024-04-01T19:49:29.561 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48054052600000002 2024-04-01T19:49:29.562 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.562 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.562 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:29.562 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879187+0000", 2024-04-01T19:49:29.562 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0359999999999997e-06 2024-04-01T19:49:29.562 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.562 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:29.562 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.562 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.562 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.562 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237071 5.9 5.d8d35df9 (undecoded) ondisk+retry+write+known_if_redirected e430)", 2024-04-01T19:49:29.562 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:34.398509+0000", 2024-04-01T19:49:29.562 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 415.14489886400003, 2024-04-01T19:49:29.563 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48086784799999999, 2024-04-01T19:49:29.563 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:29.563 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:29.563 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "reached pg", 2024-04-01T19:49:29.563 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:29.563 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:49:29.563 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:29.563 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237071 2024-04-01T19:49:29.563 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.563 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:29.563 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.563 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:29.563 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398509+0000", 2024-04-01T19:49:29.563 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.564 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.564 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.564 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:29.564 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398509+0000", 2024-04-01T19:49:29.564 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.564 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.564 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.564 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:29.564 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398510+0000", 2024-04-01T19:49:29.564 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9999999999999998e-07 2024-04-01T19:49:29.564 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.564 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.564 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:29.564 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398513+0000", 2024-04-01T19:49:29.564 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.0599999999999999e-06 2024-04-01T19:49:29.565 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.565 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.565 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:29.565 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398517+0000", 2024-04-01T19:49:29.565 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.5990000000000004e-06 2024-04-01T19:49:29.565 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.565 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.565 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:29.565 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398521+0000", 2024-04-01T19:49:29.565 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.2509999999999999e-06 2024-04-01T19:49:29.565 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.565 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.565 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.565 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398668+0000", 2024-04-01T19:49:29.566 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014728000000000001 2024-04-01T19:49:29.566 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.566 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.566 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for peered", 2024-04-01T19:49:29.566 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398672+0000", 2024-04-01T19:49:29.566 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.1489999999999996e-06 2024-04-01T19:49:29.566 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.566 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.566 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.566 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879366+0000", 2024-04-01T19:49:29.566 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48069390400000001 2024-04-01T19:49:29.566 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.566 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.566 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:29.567 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879377+0000", 2024-04-01T19:49:29.567 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1205e-05 2024-04-01T19:49:29.567 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.567 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:29.567 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.567 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.567 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.567 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237097 5.9 5.14047049 (undecoded) ondisk+retry+write+known_if_redirected e430)", 2024-04-01T19:49:29.567 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:34.398526+0000", 2024-04-01T19:49:29.567 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 415.14488222099999, 2024-04-01T19:49:29.567 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48087400400000002, 2024-04-01T19:49:29.567 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:29.567 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:29.567 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "reached pg", 2024-04-01T19:49:29.568 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:29.568 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:49:29.568 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:29.568 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237097 2024-04-01T19:49:29.568 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.568 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:29.568 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.568 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:29.568 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398526+0000", 2024-04-01T19:49:29.568 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.568 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.568 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.568 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:29.568 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398526+0000", 2024-04-01T19:49:29.569 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.569 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.569 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.569 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:29.569 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398526+0000", 2024-04-01T19:49:29.569 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7899999999999999e-07 2024-04-01T19:49:29.569 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.569 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.569 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:29.569 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398529+0000", 2024-04-01T19:49:29.569 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3970000000000001e-06 2024-04-01T19:49:29.569 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.569 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.569 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:29.569 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398537+0000", 2024-04-01T19:49:29.570 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.3299999999999999e-06 2024-04-01T19:49:29.570 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.570 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.570 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:29.570 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398542+0000", 2024-04-01T19:49:29.570 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.843e-06 2024-04-01T19:49:29.570 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.570 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.570 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.570 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398699+0000", 2024-04-01T19:49:29.570 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000156608 2024-04-01T19:49:29.570 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.570 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.570 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for peered", 2024-04-01T19:49:29.571 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398703+0000", 2024-04-01T19:49:29.571 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0600000000000001e-06 2024-04-01T19:49:29.571 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.571 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.571 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.571 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879393+0000", 2024-04-01T19:49:29.571 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48069033 2024-04-01T19:49:29.571 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.571 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.571 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:29.571 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879400+0000", 2024-04-01T19:49:29.571 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9569999999999996e-06 2024-04-01T19:49:29.571 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.571 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:29.572 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.572 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.572 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.572 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237102 5.9 5.89469869 (undecoded) ondisk+retry+write+known_if_redirected e430)", 2024-04-01T19:49:29.572 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:34.398566+0000", 2024-04-01T19:49:29.572 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 415.14484160799998, 2024-04-01T19:49:29.572 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.480884537, 2024-04-01T19:49:29.572 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:29.572 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:29.572 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "reached pg", 2024-04-01T19:49:29.572 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:29.572 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:49:29.572 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:29.572 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237102 2024-04-01T19:49:29.572 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.573 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:29.573 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.573 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:29.573 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398566+0000", 2024-04-01T19:49:29.573 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.573 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.573 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.573 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:29.573 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398566+0000", 2024-04-01T19:49:29.573 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.573 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.573 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.573 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:29.573 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398567+0000", 2024-04-01T19:49:29.574 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.4099999999999999e-07 2024-04-01T19:49:29.574 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.574 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.574 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:29.574 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398569+0000", 2024-04-01T19:49:29.574 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.0789999999999999e-06 2024-04-01T19:49:29.574 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.574 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.574 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:29.574 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398574+0000", 2024-04-01T19:49:29.574 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1730000000000003e-06 2024-04-01T19:49:29.574 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.575 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.575 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:29.575 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398577+0000", 2024-04-01T19:49:29.575 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.129e-06 2024-04-01T19:49:29.575 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.575 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.575 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.575 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398730+0000", 2024-04-01T19:49:29.575 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00015233999999999999 2024-04-01T19:49:29.575 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.575 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.575 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for peered", 2024-04-01T19:49:29.575 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398734+0000", 2024-04-01T19:49:29.575 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9480000000000001e-06 2024-04-01T19:49:29.576 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.576 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.576 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.576 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879442+0000", 2024-04-01T19:49:29.576 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.480708107 2024-04-01T19:49:29.576 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.576 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.576 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:29.576 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879451+0000", 2024-04-01T19:49:29.576 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.3200000000000006e-06 2024-04-01T19:49:29.576 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.576 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:29.576 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.576 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.577 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.577 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237121 5.9 5.358aee19 (undecoded) ondisk+retry+write+known_if_redirected e430)", 2024-04-01T19:49:29.577 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:34.398583+0000", 2024-04-01T19:49:29.577 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 415.14482496900001, 2024-04-01T19:49:29.577 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48090728700000002, 2024-04-01T19:49:29.577 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:29.577 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:29.577 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "reached pg", 2024-04-01T19:49:29.577 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:29.577 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:49:29.577 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:29.577 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237121 2024-04-01T19:49:29.577 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.577 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:29.578 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.578 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:29.578 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398583+0000", 2024-04-01T19:49:29.578 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.578 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.578 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.578 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:29.578 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398583+0000", 2024-04-01T19:49:29.578 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.578 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.578 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.578 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:29.578 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398583+0000", 2024-04-01T19:49:29.579 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.4299999999999999e-07 2024-04-01T19:49:29.579 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.579 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.579 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:29.579 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398585+0000", 2024-04-01T19:49:29.579 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.5269999999999999e-06 2024-04-01T19:49:29.579 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.579 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.579 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:29.579 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398589+0000", 2024-04-01T19:49:29.579 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3470000000000001e-06 2024-04-01T19:49:29.579 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.579 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.580 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:29.580 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398594+0000", 2024-04-01T19:49:29.580 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.5639999999999998e-06 2024-04-01T19:49:29.580 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.580 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.580 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.580 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398751+0000", 2024-04-01T19:49:29.580 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00015691300000000001 2024-04-01T19:49:29.580 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.580 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.580 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for peered", 2024-04-01T19:49:29.580 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.398755+0000", 2024-04-01T19:49:29.580 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9589999999999997e-06 2024-04-01T19:49:29.580 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.581 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.581 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.581 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879485+0000", 2024-04-01T19:49:29.581 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.48072979199999999 2024-04-01T19:49:29.581 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.581 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.581 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:29.581 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:34.879490+0000", 2024-04-01T19:49:29.581 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8420000000000001e-06 2024-04-01T19:49:29.581 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.581 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:29.581 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.581 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.581 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.582 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237131 5.9 5:9efc6e35:::benchmark_data_smithi188_119427_object72432:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e437)", 2024-04-01T19:49:29.582 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:46.181942+0000", 2024-04-01T19:49:29.582 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 403.36146653399999, 2024-04-01T19:49:29.582 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.097945575000000007, 2024-04-01T19:49:29.582 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:29.582 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:29.582 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:29.582 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:29.582 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:49:29.582 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:29.582 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237131 2024-04-01T19:49:29.582 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.582 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:29.582 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.582 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:29.583 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181942+0000", 2024-04-01T19:49:29.583 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.583 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.583 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.583 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:29.583 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181942+0000", 2024-04-01T19:49:29.583 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.583 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.583 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.583 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:29.583 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181942+0000", 2024-04-01T19:49:29.583 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.7300000000000002e-07 2024-04-01T19:49:29.583 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.583 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.583 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:29.584 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181943+0000", 2024-04-01T19:49:29.584 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.252e-06 2024-04-01T19:49:29.584 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.584 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.584 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:29.584 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181946+0000", 2024-04-01T19:49:29.584 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.633e-06 2024-04-01T19:49:29.584 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.584 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.584 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:29.584 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181949+0000", 2024-04-01T19:49:29.584 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8310000000000001e-06 2024-04-01T19:49:29.584 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.584 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.584 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.584 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.255485+0000", 2024-04-01T19:49:29.585 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.073536199999999996 2024-04-01T19:49:29.585 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.585 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.585 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:29.585 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.255569+0000", 2024-04-01T19:49:29.585 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.4278999999999997e-05 2024-04-01T19:49:29.585 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.585 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.585 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T19:49:29.585 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.255643+0000", 2024-04-01T19:49:29.585 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.4444999999999996e-05 2024-04-01T19:49:29.585 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.585 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.585 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:29.585 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.271717+0000", 2024-04-01T19:49:29.586 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.016073686 2024-04-01T19:49:29.586 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.586 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.586 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:29.586 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.279777+0000", 2024-04-01T19:49:29.586 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0080601609999999997 2024-04-01T19:49:29.586 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.586 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.586 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:29.586 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.279840+0000", 2024-04-01T19:49:29.586 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2939000000000002e-05 2024-04-01T19:49:29.586 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.587 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.587 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:29.587 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.279887+0000", 2024-04-01T19:49:29.587 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6876000000000003e-05 2024-04-01T19:49:29.587 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.587 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:29.587 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.587 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.587 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.587 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237135 5.9 5:9acea934:::benchmark_data_smithi188_119427_object72436:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e437)", 2024-04-01T19:49:29.587 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:46.181951+0000", 2024-04-01T19:49:29.587 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 403.36145688300002, 2024-04-01T19:49:29.587 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.098134025, 2024-04-01T19:49:29.587 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:29.588 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:29.588 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:29.588 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:29.588 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:49:29.588 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:29.588 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237135 2024-04-01T19:49:29.588 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.588 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:29.588 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.588 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:29.588 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181951+0000", 2024-04-01T19:49:29.588 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.588 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.588 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.589 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:29.589 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181951+0000", 2024-04-01T19:49:29.589 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.589 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.589 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.589 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:29.589 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181951+0000", 2024-04-01T19:49:29.589 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.67e-07 2024-04-01T19:49:29.589 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.589 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.589 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:29.589 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181953+0000", 2024-04-01T19:49:29.589 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.235e-06 2024-04-01T19:49:29.590 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.590 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.590 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:29.590 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181955+0000", 2024-04-01T19:49:29.590 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.6989999999999999e-06 2024-04-01T19:49:29.590 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.590 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.590 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:29.590 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181958+0000", 2024-04-01T19:49:29.590 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.4710000000000001e-06 2024-04-01T19:49:29.590 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.590 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.590 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.591 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.259232+0000", 2024-04-01T19:49:29.591 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.077274514000000002 2024-04-01T19:49:29.591 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.591 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.591 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:29.591 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.259309+0000", 2024-04-01T19:49:29.591 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.6347000000000006e-05 2024-04-01T19:49:29.591 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.591 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.591 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T19:49:29.591 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.259380+0000", 2024-04-01T19:49:29.591 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1429999999999999e-05 2024-04-01T19:49:29.591 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.591 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.271740+0000", 2024-04-01T19:49:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.012359936 2024-04-01T19:49:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.280028+0000", 2024-04-01T19:49:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0082876410000000001 2024-04-01T19:49:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.280059+0000", 2024-04-01T19:49:29.592 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.0769000000000003e-05 2024-04-01T19:49:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.280085+0000", 2024-04-01T19:49:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.6716e-05 2024-04-01T19:49:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237172 5.9 5:9a209d38:::benchmark_data_smithi188_119427_object72473:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e437)", 2024-04-01T19:49:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:46.181961+0000", 2024-04-01T19:49:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 403.36144739600002, 2024-04-01T19:49:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.10301771699999999, 2024-04-01T19:49:29.593 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:49:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237172 2024-04-01T19:49:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181961+0000", 2024-04-01T19:49:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.594 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181961+0000", 2024-04-01T19:49:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181961+0000", 2024-04-01T19:49:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8700000000000002e-07 2024-04-01T19:49:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181963+0000", 2024-04-01T19:49:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.6080000000000001e-06 2024-04-01T19:49:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181965+0000", 2024-04-01T19:49:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.667e-06 2024-04-01T19:49:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181968+0000", 2024-04-01T19:49:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.6879999999999999e-06 2024-04-01T19:49:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.263204+0000", 2024-04-01T19:49:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.081236251999999995 2024-04-01T19:49:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.596 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.263311+0000", 2024-04-01T19:49:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00010711 2024-04-01T19:49:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T19:49:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.263379+0000", 2024-04-01T19:49:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.7855999999999995e-05 2024-04-01T19:49:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.271768+0000", 2024-04-01T19:49:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0083888299999999999 2024-04-01T19:49:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.597 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.284894+0000", 2024-04-01T19:49:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.013125596 2024-04-01T19:49:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.284931+0000", 2024-04-01T19:49:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.7704999999999999e-05 2024-04-01T19:49:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.284978+0000", 2024-04-01T19:49:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7117999999999998e-05 2024-04-01T19:49:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.598 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:29.599 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.599 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.599 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.599 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237212 5.9 5:943e20fe:::benchmark_data_smithi188_119427_object72513:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e437)", 2024-04-01T19:49:29.599 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:46.181971+0000", 2024-04-01T19:49:29.599 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 403.36143739099998, 2024-04-01T19:49:29.599 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.103078844, 2024-04-01T19:49:29.599 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:29.599 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:29.599 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:29.601 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:29.601 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:49:29.601 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:29.601 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237212 2024-04-01T19:49:29.601 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.601 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:29.601 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.601 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:29.601 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181971+0000", 2024-04-01T19:49:29.601 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.601 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.601 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.601 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:29.602 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181971+0000", 2024-04-01T19:49:29.602 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.602 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.602 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.602 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:29.602 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181971+0000", 2024-04-01T19:49:29.602 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.6100000000000002e-07 2024-04-01T19:49:29.602 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.602 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.602 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:29.602 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181976+0000", 2024-04-01T19:49:29.602 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7659999999999998e-06 2024-04-01T19:49:29.602 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.603 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.603 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:29.603 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181979+0000", 2024-04-01T19:49:29.603 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.084e-06 2024-04-01T19:49:29.603 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.603 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.603 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:29.603 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181981+0000", 2024-04-01T19:49:29.603 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.6809999999999998e-06 2024-04-01T19:49:29.603 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.603 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.603 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.603 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.267734+0000", 2024-04-01T19:49:29.604 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.085752223000000002 2024-04-01T19:49:29.604 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.604 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.604 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:29.604 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.267850+0000", 2024-04-01T19:49:29.604 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000116035 2024-04-01T19:49:29.604 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.604 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.604 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T19:49:29.604 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.267978+0000", 2024-04-01T19:49:29.604 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000128675 2024-04-01T19:49:29.604 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.604 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.605 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:29.605 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.271796+0000", 2024-04-01T19:49:29.605 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0038176490000000002 2024-04-01T19:49:29.605 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.605 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.605 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:29.605 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.284985+0000", 2024-04-01T19:49:29.605 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.013189429000000001 2024-04-01T19:49:29.605 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.605 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.605 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:29.605 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.285012+0000", 2024-04-01T19:49:29.605 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.6190000000000002e-05 2024-04-01T19:49:29.605 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.606 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.606 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:29.606 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.285050+0000", 2024-04-01T19:49:29.606 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.7851000000000001e-05 2024-04-01T19:49:29.606 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.606 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:29.606 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.606 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.606 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.606 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237246 5.9 5:9ab2d1d5:::benchmark_data_smithi188_119427_object72547:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e437)", 2024-04-01T19:49:29.606 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:46.181985+0000", 2024-04-01T19:49:29.606 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 403.36142358299998, 2024-04-01T19:49:29.606 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.10312982800000001, 2024-04-01T19:49:29.607 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:29.607 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:29.607 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:29.607 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:29.607 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:49:29.607 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:29.607 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237246 2024-04-01T19:49:29.607 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.607 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:29.607 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.607 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:29.607 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181985+0000", 2024-04-01T19:49:29.607 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.607 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.608 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.608 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:29.608 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181985+0000", 2024-04-01T19:49:29.608 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.608 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.608 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.608 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:29.608 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181985+0000", 2024-04-01T19:49:29.608 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.63e-07 2024-04-01T19:49:29.608 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.608 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.608 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:29.608 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181986+0000", 2024-04-01T19:49:29.608 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4789999999999999e-06 2024-04-01T19:49:29.609 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.609 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.609 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:29.609 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181989+0000", 2024-04-01T19:49:29.609 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.7920000000000001e-06 2024-04-01T19:49:29.609 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.609 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.609 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:29.609 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181992+0000", 2024-04-01T19:49:29.609 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.1729999999999999e-06 2024-04-01T19:49:29.609 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.609 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.609 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.610 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.271813+0000", 2024-04-01T19:49:29.610 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.089820752000000004 2024-04-01T19:49:29.610 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.610 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.610 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:29.610 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.271903+0000", 2024-04-01T19:49:29.610 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.9819000000000002e-05 2024-04-01T19:49:29.610 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.610 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.610 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T19:49:29.610 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.271982+0000", 2024-04-01T19:49:29.610 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9456000000000006e-05 2024-04-01T19:49:29.610 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.611 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.611 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:29.611 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.279960+0000", 2024-04-01T19:49:29.611 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0079773399999999994 2024-04-01T19:49:29.611 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.611 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.611 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:29.611 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.285055+0000", 2024-04-01T19:49:29.611 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0050951679999999997 2024-04-01T19:49:29.611 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.611 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.611 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:29.611 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.285080+0000", 2024-04-01T19:49:29.611 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.4851999999999999e-05 2024-04-01T19:49:29.611 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.612 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.612 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:29.612 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.285114+0000", 2024-04-01T19:49:29.612 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.4533999999999998e-05 2024-04-01T19:49:29.612 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.612 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:29.612 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.612 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.612 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.612 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.25864.0:237247 5.9 5:9c584c22:::benchmark_data_smithi188_119427_object72548:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e437)", 2024-04-01T19:49:29.612 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:42:46.181995+0000", 2024-04-01T19:49:29.612 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 403.36141279499998, 2024-04-01T19:49:29.612 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.107810507, 2024-04-01T19:49:29.612 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:29.613 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:29.613 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:29.613 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:29.613 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.25864", 2024-04-01T19:49:29.613 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:29.613 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 237247 2024-04-01T19:49:29.613 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.613 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:29.613 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.613 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:29.613 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181995+0000", 2024-04-01T19:49:29.613 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.613 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.613 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.613 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:29.614 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181995+0000", 2024-04-01T19:49:29.614 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.614 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.614 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.614 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:29.614 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181996+0000", 2024-04-01T19:49:29.614 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.79e-07 2024-04-01T19:49:29.614 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.614 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.614 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:29.614 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.181997+0000", 2024-04-01T19:49:29.614 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4109999999999999e-06 2024-04-01T19:49:29.614 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.615 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.615 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:29.615 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.182000+0000", 2024-04-01T19:49:29.615 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.959e-06 2024-04-01T19:49:29.615 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.615 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.615 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:29.615 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.182005+0000", 2024-04-01T19:49:29.615 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.566e-06 2024-04-01T19:49:29.615 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.615 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.615 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.615 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.275750+0000", 2024-04-01T19:49:29.615 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.093745076999999996 2024-04-01T19:49:29.616 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.616 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.616 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:29.616 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.275891+0000", 2024-04-01T19:49:29.616 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000141557 2024-04-01T19:49:29.616 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.616 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.616 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T19:49:29.616 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.276026+0000", 2024-04-01T19:49:29.616 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000134554 2024-04-01T19:49:29.616 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.616 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.616 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:29.616 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.280019+0000", 2024-04-01T19:49:29.616 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0039932509999999997 2024-04-01T19:49:29.617 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.617 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.617 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:29.617 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.289704+0000", 2024-04-01T19:49:29.617 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0096849540000000008 2024-04-01T19:49:29.617 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.617 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.617 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:29.617 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.289754+0000", 2024-04-01T19:49:29.617 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0367000000000001e-05 2024-04-01T19:49:29.617 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.617 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.617 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:29.617 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:42:46.289806+0000", 2024-04-01T19:49:29.617 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1532000000000001e-05 2024-04-01T19:49:29.618 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.618 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:29.618 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.618 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.618 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.618 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:222722 6.3 6:c873d116:::benchmark_data_smithi188_134454_object65981:head [delete] snapc 0=[] ondisk+write+known_if_redirected e522)", 2024-04-01T19:49:29.618 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:47:23.726021+0000", 2024-04-01T19:49:29.618 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 125.81738690500001, 2024-04-01T19:49:29.618 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.10164761999999999, 2024-04-01T19:49:29.618 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:29.618 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:29.618 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:29.618 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:29.619 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:49:29.619 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:49:29.619 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 222722 2024-04-01T19:49:29.619 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.619 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:29.619 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.619 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:29.619 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.726021+0000", 2024-04-01T19:49:29.619 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.619 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.619 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.619 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:29.619 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.726021+0000", 2024-04-01T19:49:29.619 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.620 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.620 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.620 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:29.620 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.726023+0000", 2024-04-01T19:49:29.620 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.389e-06 2024-04-01T19:49:29.620 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.620 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.620 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:29.620 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.726027+0000", 2024-04-01T19:49:29.620 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6990000000000002e-06 2024-04-01T19:49:29.620 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.620 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.620 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:29.620 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.726035+0000", 2024-04-01T19:49:29.621 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9659999999999996e-06 2024-04-01T19:49:29.621 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.621 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.621 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:29.621 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.726043+0000", 2024-04-01T19:49:29.621 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.2899999999999997e-06 2024-04-01T19:49:29.621 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.621 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.621 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.621 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.735110+0000", 2024-04-01T19:49:29.621 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0090677229999999998 2024-04-01T19:49:29.621 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.621 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.621 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:29.621 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.735223+0000", 2024-04-01T19:49:29.621 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000112629 2024-04-01T19:49:29.622 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.622 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.622 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 6", 2024-04-01T19:49:29.622 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.735333+0000", 2024-04-01T19:49:29.622 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000110302 2024-04-01T19:49:29.622 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.622 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.622 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:29.622 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.808821+0000", 2024-04-01T19:49:29.622 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.073487989000000004 2024-04-01T19:49:29.622 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.622 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.622 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:29.623 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.827553+0000", 2024-04-01T19:49:29.623 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.018731379999999999 2024-04-01T19:49:29.623 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.623 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.623 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:29.623 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.827604+0000", 2024-04-01T19:49:29.623 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1873999999999998e-05 2024-04-01T19:49:29.623 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.623 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.623 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:29.623 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.827669+0000", 2024-04-01T19:49:29.623 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.4379000000000001e-05 2024-04-01T19:49:29.623 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.623 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:29.623 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.624 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.624 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.624 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.26287.0:222723 6.b e522/469 6:dbb8954d:::benchmark_data_smithi188_134454_object65982:head v 522'13803, mlcod=522'13800)", 2024-04-01T19:49:29.624 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:47:23.732813+0000", 2024-04-01T19:49:29.624 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 125.81059494599999, 2024-04-01T19:49:29.624 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.087701936999999994, 2024-04-01T19:49:29.624 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:29.624 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:29.624 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:29.624 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:29.624 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.624 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:29.624 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.732813+0000", 2024-04-01T19:49:29.624 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.624 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.625 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.625 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:29.625 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.732813+0000", 2024-04-01T19:49:29.625 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.625 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.625 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.625 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:29.625 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.732815+0000", 2024-04-01T19:49:29.625 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.5409999999999999e-06 2024-04-01T19:49:29.625 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.625 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.625 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:29.625 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.732824+0000", 2024-04-01T19:49:29.625 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.4550000000000001e-06 2024-04-01T19:49:29.625 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.626 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.626 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:29.626 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.732836+0000", 2024-04-01T19:49:29.626 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1925e-05 2024-04-01T19:49:29.626 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.626 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.626 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:29.626 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.732842+0000", 2024-04-01T19:49:29.626 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5659999999999997e-06 2024-04-01T19:49:29.626 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.626 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.626 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.626 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.735124+0000", 2024-04-01T19:49:29.627 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0022823800000000001 2024-04-01T19:49:29.627 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.627 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.627 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:29.627 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.735144+0000", 2024-04-01T19:49:29.627 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.0129e-05 2024-04-01T19:49:29.627 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.627 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.627 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:29.627 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.820474+0000", 2024-04-01T19:49:29.627 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.085329505 2024-04-01T19:49:29.627 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.627 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.627 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:29.628 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.820515+0000", 2024-04-01T19:49:29.628 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.1436000000000001e-05 2024-04-01T19:49:29.628 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.628 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:29.628 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.628 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.628 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.628 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:222729 6.3 6:c106bad3:::benchmark_data_smithi188_134454_object65988:head [delete] snapc 0=[] ondisk+write+known_if_redirected e522)", 2024-04-01T19:49:29.628 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:47:23.732865+0000", 2024-04-01T19:49:29.628 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 125.81054302, 2024-04-01T19:49:29.628 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.099954187, 2024-04-01T19:49:29.628 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:29.628 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:29.629 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:29.629 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:29.629 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:49:29.629 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:49:29.629 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 222729 2024-04-01T19:49:29.629 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.629 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:29.629 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.629 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:29.629 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.732865+0000", 2024-04-01T19:49:29.629 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.629 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.629 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.629 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:29.630 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.732865+0000", 2024-04-01T19:49:29.630 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.630 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.630 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.630 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:29.630 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.732867+0000", 2024-04-01T19:49:29.630 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8509999999999999e-06 2024-04-01T19:49:29.630 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.630 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.630 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:29.630 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.732873+0000", 2024-04-01T19:49:29.630 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6829999999999996e-06 2024-04-01T19:49:29.630 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.631 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.631 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:29.631 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.732881+0000", 2024-04-01T19:49:29.631 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9160000000000001e-06 2024-04-01T19:49:29.631 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.631 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.631 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:29.631 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.732886+0000", 2024-04-01T19:49:29.631 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0030000000000002e-06 2024-04-01T19:49:29.631 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.631 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.631 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.631 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.740496+0000", 2024-04-01T19:49:29.631 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0076100530000000003 2024-04-01T19:49:29.631 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.631 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.632 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:29.632 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.740598+0000", 2024-04-01T19:49:29.632 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00010225699999999999 2024-04-01T19:49:29.632 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.632 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.632 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 6", 2024-04-01T19:49:29.632 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.740712+0000", 2024-04-01T19:49:29.632 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000113851 2024-04-01T19:49:29.632 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.632 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.632 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:29.632 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.809131+0000", 2024-04-01T19:49:29.632 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.068418988 2024-04-01T19:49:29.632 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.633 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.633 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:29.633 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.832693+0000", 2024-04-01T19:49:29.633 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.023562118 2024-04-01T19:49:29.633 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.633 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.633 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:29.633 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.832746+0000", 2024-04-01T19:49:29.633 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3251999999999998e-05 2024-04-01T19:49:29.633 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.633 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.633 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:29.633 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.832819+0000", 2024-04-01T19:49:29.634 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.3214999999999996e-05 2024-04-01T19:49:29.634 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.634 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:29.634 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.634 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.634 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.634 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.26287.0:222741 6.b e522/469 6:d9737e32:::benchmark_data_smithi188_134454_object66000:head v 522'13804, mlcod=522'13800)", 2024-04-01T19:49:29.634 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:47:23.745491+0000", 2024-04-01T19:49:29.634 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 125.79791717400001, 2024-04-01T19:49:29.634 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.087368582, 2024-04-01T19:49:29.634 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:29.634 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:29.634 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:29.635 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:29.635 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.635 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:29.635 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.745491+0000", 2024-04-01T19:49:29.635 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.635 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.635 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.635 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:29.635 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.745491+0000", 2024-04-01T19:49:29.635 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.635 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.635 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.635 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:29.635 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.745492+0000", 2024-04-01T19:49:29.636 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1699999999999997e-07 2024-04-01T19:49:29.636 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.636 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.636 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:29.636 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.745499+0000", 2024-04-01T19:49:29.636 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9210000000000003e-06 2024-04-01T19:49:29.636 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.636 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.636 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:29.636 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.745508+0000", 2024-04-01T19:49:29.636 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1020000000000003e-06 2024-04-01T19:49:29.636 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.636 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.636 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:29.636 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.745513+0000", 2024-04-01T19:49:29.637 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.626e-06 2024-04-01T19:49:29.637 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.637 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.637 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.637 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.808850+0000", 2024-04-01T19:49:29.637 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.063337122999999995 2024-04-01T19:49:29.637 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.637 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.637 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:29.637 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.808869+0000", 2024-04-01T19:49:29.637 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8899999999999999e-05 2024-04-01T19:49:29.637 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.637 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.637 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:29.638 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.832828+0000", 2024-04-01T19:49:29.638 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.023958765999999999 2024-04-01T19:49:29.638 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.638 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.638 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:29.638 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.832859+0000", 2024-04-01T19:49:29.638 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.1427000000000003e-05 2024-04-01T19:49:29.638 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.638 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:29.638 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.638 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.638 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.638 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:222742 6.3 6:c95d6b5e:::benchmark_data_smithi188_134454_object66001:head [delete] snapc 0=[] ondisk+write+known_if_redirected e522)", 2024-04-01T19:49:29.639 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:47:23.745588+0000", 2024-04-01T19:49:29.639 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 125.797819789, 2024-04-01T19:49:29.639 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.093380164000000002, 2024-04-01T19:49:29.639 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:29.639 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:29.639 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:29.639 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:29.639 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:49:29.639 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:49:29.639 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 222742 2024-04-01T19:49:29.639 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.639 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:29.639 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.639 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:29.640 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.745588+0000", 2024-04-01T19:49:29.640 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.640 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.640 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.640 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:29.640 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.745588+0000", 2024-04-01T19:49:29.640 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.640 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.640 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.640 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:29.640 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.745590+0000", 2024-04-01T19:49:29.640 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.9429999999999999e-06 2024-04-01T19:49:29.640 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.640 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.640 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:29.641 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.745595+0000", 2024-04-01T19:49:29.641 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7809999999999996e-06 2024-04-01T19:49:29.641 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.641 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.641 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:29.641 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.745604+0000", 2024-04-01T19:49:29.641 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1460000000000002e-06 2024-04-01T19:49:29.641 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.641 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.641 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:29.641 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.745611+0000", 2024-04-01T19:49:29.641 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.08e-06 2024-04-01T19:49:29.641 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.641 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.642 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.642 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.818199+0000", 2024-04-01T19:49:29.642 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.072587873999999997 2024-04-01T19:49:29.642 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.642 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.642 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:29.642 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.818316+0000", 2024-04-01T19:49:29.642 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000116966 2024-04-01T19:49:29.642 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.642 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.642 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 6", 2024-04-01T19:49:29.642 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.818436+0000", 2024-04-01T19:49:29.642 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000120066 2024-04-01T19:49:29.643 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.643 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.643 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:29.643 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.832909+0000", 2024-04-01T19:49:29.643 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.014472483 2024-04-01T19:49:29.643 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.643 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.643 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:29.643 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.838833+0000", 2024-04-01T19:49:29.643 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0059241169999999996 2024-04-01T19:49:29.643 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.643 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.643 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:29.643 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.838900+0000", 2024-04-01T19:49:29.643 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.7434999999999994e-05 2024-04-01T19:49:29.644 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.644 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.644 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:29.644 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.838968+0000", 2024-04-01T19:49:29.644 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8273000000000002e-05 2024-04-01T19:49:29.644 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.644 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:29.644 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.644 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.644 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.644 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:225477 6.3 6:c55f12d7:::benchmark_data_smithi188_134454_object68736:head [delete] snapc 0=[] ondisk+write+known_if_redirected e523)", 2024-04-01T19:49:29.644 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:47:26.389218+0000", 2024-04-01T19:49:29.644 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 123.154189899, 2024-04-01T19:49:29.644 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.099156575999999996, 2024-04-01T19:49:29.644 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:49:29.645 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:49:29.645 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:29.645 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:49:29.645 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:49:29.645 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:49:29.645 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 225477 2024-04-01T19:49:29.645 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.645 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:49:29.645 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.645 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:49:29.645 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.389218+0000", 2024-04-01T19:49:29.645 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.645 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.645 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.646 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:49:29.646 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.389218+0000", 2024-04-01T19:49:29.646 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:49:29.646 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.646 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.646 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:49:29.646 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.389222+0000", 2024-04-01T19:49:29.646 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3050000000000003e-06 2024-04-01T19:49:29.646 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.646 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.646 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:49:29.646 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.389227+0000", 2024-04-01T19:49:29.646 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0110000000000002e-06 2024-04-01T19:49:29.646 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.647 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.647 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:49:29.647 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.389235+0000", 2024-04-01T19:49:29.647 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0830000000000004e-06 2024-04-01T19:49:29.647 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.647 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.647 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:49:29.647 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.389244+0000", 2024-04-01T19:49:29.647 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1859999999999998e-06 2024-04-01T19:49:29.647 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.647 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.647 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.647 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.389335+0000", 2024-04-01T19:49:29.647 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1570000000000006e-05 2024-04-01T19:49:29.647 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.648 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.648 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting_for_map not empty", 2024-04-01T19:49:29.648 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.389341+0000", 2024-04-01T19:49:29.648 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.322e-06 2024-04-01T19:49:29.648 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.648 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.648 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:49:29.648 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.462724+0000", 2024-04-01T19:49:29.648 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.073383637000000002 2024-04-01T19:49:29.648 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.648 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.648 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:49:29.648 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.462838+0000", 2024-04-01T19:49:29.648 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000113626 2024-04-01T19:49:29.649 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.649 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.649 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 6", 2024-04-01T19:49:29.649 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.462943+0000", 2024-04-01T19:49:29.649 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00010527300000000001 2024-04-01T19:49:29.649 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.649 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.649 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:29.649 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.474886+0000", 2024-04-01T19:49:29.649 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.011943103 2024-04-01T19:49:29.649 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.649 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.649 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:49:29.649 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.488279+0000", 2024-04-01T19:49:29.649 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.013393149999999999 2024-04-01T19:49:29.650 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.650 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.650 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:49:29.650 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.488329+0000", 2024-04-01T19:49:29.650 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0022999999999999e-05 2024-04-01T19:49:29.650 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:49:29.650 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:49:29.650 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:49:29.650 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.488375+0000", 2024-04-01T19:49:29.650 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.5287000000000002e-05 2024-04-01T19:49:29.650 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.650 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:29.650 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.650 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:49:29.651 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:49:29.651 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:49:29.652 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:29.652 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:49:29.652 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:49:29.652 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:49:29.653 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:29.653 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:49:29.653 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:49:29.663 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:49:29.682 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:49:29.702 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:49:29.722 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:49:29.742 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:49:29.754 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:49:29.762 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:49:29.783 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:49:29.784 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:29.803 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:49:29.803 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:49:29.803 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-01T19:49:29.803 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:49:29.803 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:49:29.803 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:49:29.804 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:49:29.804 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:49:29.804 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:49:29.804 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:49:29.804 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:49:29.804 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:49:29.804 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:49:29.805 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:49:29.808 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:29.808 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:49:29.909 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:49:29.939 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:30.037 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:49:30.039 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:30.039 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:49:30.140 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:49:30.141 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:49:30.171 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:30.193 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:49:30.196 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:30.196 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:49:30.215 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_ops_in_flight 2024-04-01T19:49:30.262 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'unique_pool_5' created 2024-04-01T19:49:30.297 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:49:30.325 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:30.345 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:49:30.348 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:30.348 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:49:30.449 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:49:30.478 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:30.497 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:49:30.498 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:49:30.500 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:30 smithi188 ceph-mon[43939]: pgmap v1538: 1 pgs: 1 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:30.500 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:30 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3768846436' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_5", "pg_num": 16}]: dispatch 2024-04-01T19:49:30.500 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:30 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1306071557' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:49:30.500 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:30.500 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:30.500 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:30.501 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:30.502 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:49:30.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:30 smithi062 ceph-mon[44211]: pgmap v1538: 1 pgs: 1 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:30.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:30 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3768846436' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_5", "pg_num": 16}]: dispatch 2024-04-01T19:49:30.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:30 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1306071557' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:49:30.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:30.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:30.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:30.516 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:30 smithi022 ceph-mon[39439]: pgmap v1538: 1 pgs: 1 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:30.516 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:30 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3768846436' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_5", "pg_num": 16}]: dispatch 2024-04-01T19:49:30.516 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:30 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1306071557' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:49:30.516 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:30.516 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:30.516 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:30.541 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:49:30.542 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:49:30.603 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:49:30.632 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:30.756 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:49:30.758 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:30.758 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:49:30.859 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:49:30.887 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:31.259 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:31.259 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:31.259 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:31.260 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:31.260 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:31.400 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pool application enable unique_pool_5 rados --yes-i-really-mean-it || true 2024-04-01T19:49:31.401 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:49:31.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:31.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:31.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:31.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:31.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:31.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:31.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:31.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:31.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:31 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:49:31.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:31 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:49:31.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:31 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3768846436' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_5", "pg_num": 16}]': finished 2024-04-01T19:49:31.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:31 smithi062 ceph-mon[44211]: osdmap e560: 12 total, 11 up, 11 in 2024-04-01T19:49:31.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:31 smithi062 ceph-mon[44211]: pgmap v1540: 17 pgs: 10 creating+peering, 6 unknown, 1 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:31.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:31.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:31.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:31.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:31 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:49:31.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:31 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:49:31.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:31 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3768846436' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_5", "pg_num": 16}]': finished 2024-04-01T19:49:31.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:31 smithi022 ceph-mon[39439]: osdmap e560: 12 total, 11 up, 11 in 2024-04-01T19:49:31.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:31 smithi022 ceph-mon[39439]: pgmap v1540: 17 pgs: 10 creating+peering, 6 unknown, 1 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:31.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:31 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:49:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:31 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:49:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:31 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3768846436' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_5", "pg_num": 16}]': finished 2024-04-01T19:49:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:31 smithi188 ceph-mon[43939]: osdmap e560: 12 total, 11 up, 11 in 2024-04-01T19:49:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:31 smithi188 ceph-mon[43939]: pgmap v1540: 17 pgs: 10 creating+peering, 6 unknown, 1 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:31.736 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:49:31.738 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:31.739 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:49:31.840 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:49:31.872 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:31.892 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:49:31.894 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:31.894 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:49:31.995 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:49:32.024 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:32.171 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:49:32.173 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:32.174 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:49:32.275 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:49:32.302 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:32.400 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:49:32.402 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:32.403 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:49:32.456 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:49:32.456 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:49:32.478 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:32 smithi188 ceph-mon[43939]: osdmap e561: 12 total, 11 up, 11 in 2024-04-01T19:49:32.478 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:32 smithi188 ceph-mon[43939]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T19:49:32.504 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:49:32.536 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:32 smithi062 ceph-mon[44211]: osdmap e561: 12 total, 11 up, 11 in 2024-04-01T19:49:32.537 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:32 smithi062 ceph-mon[44211]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T19:49:32.539 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:32.543 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:49:32.562 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:49:32.564 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:32.565 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:49:32.570 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:32 smithi022 ceph-mon[39439]: osdmap e561: 12 total, 11 up, 11 in 2024-04-01T19:49:32.570 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:32 smithi022 ceph-mon[39439]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T19:49:32.625 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:49:32.666 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:49:32.694 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:32.894 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:49:32.900 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:32.900 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:49:33.001 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:49:33.035 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:33.058 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:49:33.060 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:33.061 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:49:33.162 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:49:33.190 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:33.228 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:49:33.231 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:33.231 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:49:33.248 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_blocked_ops 2024-04-01T19:49:33.332 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:49:33.358 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:33.380 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:49:33.383 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:33.384 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:49:33.485 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:49:33.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:33 smithi062 ceph-mon[44211]: osdmap e562: 12 total, 11 up, 11 in 2024-04-01T19:49:33.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:33 smithi062 ceph-mon[44211]: pgmap v1543: 17 pgs: 13 creating+peering, 2 unknown, 2 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:33.519 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:33.540 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:49:33.544 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:33.544 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:49:33.555 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:49:33.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:33 smithi022 ceph-mon[39439]: osdmap e562: 12 total, 11 up, 11 in 2024-04-01T19:49:33.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:33 smithi022 ceph-mon[39439]: pgmap v1543: 17 pgs: 13 creating+peering, 2 unknown, 2 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:33.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:33 smithi188 ceph-mon[43939]: osdmap e562: 12 total, 11 up, 11 in 2024-04-01T19:49:33.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:33 smithi188 ceph-mon[43939]: pgmap v1543: 17 pgs: 13 creating+peering, 2 unknown, 2 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:33.645 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:49:33.677 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:33.698 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:49:33.701 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:33.702 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:49:33.757 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:49:33.802 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:49:33.831 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:33.850 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:49:33.853 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:33.853 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:49:33.954 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:49:33.990 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:34.011 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:49:34.014 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:34.014 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:49:34.115 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:49:34.149 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:34.171 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:49:34.174 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:34.175 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:49:34.276 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:49:34.284 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:49:34.307 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:34.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:34 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1288647210' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:49:34.597 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:34 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1288647210' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:49:34.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:34 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1288647210' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:49:34.857 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:49:34.859 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:34.860 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:49:34.961 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:49:34.994 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:35.016 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:49:35.019 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:35.019 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:49:35.120 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:49:35.151 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:35.172 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:49:35.174 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:35.175 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:49:35.276 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:49:35.305 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:35.326 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:49:35.328 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:35.329 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:49:35.430 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:49:35.459 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:35 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:49:35.459 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:35 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1288647210' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:49:35.459 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:35 smithi022 ceph-mon[39439]: osdmap e563: 12 total, 11 up, 11 in 2024-04-01T19:49:35.459 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:35 smithi022 ceph-mon[39439]: pgmap v1545: 17 pgs: 13 creating+peering, 4 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:35.462 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:35.542 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:49:35.542 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:49:35.563 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:35 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:49:35.563 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:35 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1288647210' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:49:35.563 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:35 smithi188 ceph-mon[43939]: osdmap e563: 12 total, 11 up, 11 in 2024-04-01T19:49:35.563 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:35 smithi188 ceph-mon[43939]: pgmap v1545: 17 pgs: 13 creating+peering, 4 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:35.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:35 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:49:35.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:35 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1288647210' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:49:35.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:35 smithi062 ceph-mon[44211]: osdmap e563: 12 total, 11 up, 11 in 2024-04-01T19:49:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:35 smithi062 ceph-mon[44211]: pgmap v1545: 17 pgs: 13 creating+peering, 4 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:36.294 INFO:teuthology.orchestra.run.smithi022.stderr:enabled application 'rados' on pool 'unique_pool_5' 2024-04-01T19:49:36.313 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_historic_ops 2024-04-01T19:49:36.317 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:36 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4005045305' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_5", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:49:36.512 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:49:36.517 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:36.517 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:49:36.574 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:49:36.619 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:49:36.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:36 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4005045305' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_5", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:49:36.648 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:36.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:36 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4005045305' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_5", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:49:36.772 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:49:36.775 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:36.775 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:49:36.876 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:49:36.905 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:36.926 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:49:36.928 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:36.929 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:49:37.030 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:49:37.063 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:37.084 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:49:37.087 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:37.088 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:49:37.189 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:49:37.216 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:37.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:37 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4005045305' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_5", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:49:37.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:37 smithi022 ceph-mon[39439]: osdmap e564: 12 total, 11 up, 11 in 2024-04-01T19:49:37.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:37 smithi022 ceph-mon[39439]: pgmap v1547: 17 pgs: 17 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:37.464 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:49:37.465 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:37 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4005045305' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_5", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:49:37.465 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:37 smithi188 ceph-mon[43939]: osdmap e564: 12 total, 11 up, 11 in 2024-04-01T19:49:37.465 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:37 smithi188 ceph-mon[43939]: pgmap v1547: 17 pgs: 17 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:37.466 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:37.466 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:49:37.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:37 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4005045305' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_5", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:49:37.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:37 smithi062 ceph-mon[44211]: osdmap e564: 12 total, 11 up, 11 in 2024-04-01T19:49:37.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:37 smithi062 ceph-mon[44211]: pgmap v1547: 17 pgs: 17 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:37.567 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:49:37.595 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:37.659 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:49:37.679 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:49:37.698 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:49:37.719 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:49:37.739 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:49:37.759 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:49:37.780 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:49:37.800 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:49:37.819 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:49:37.839 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:49:37.860 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:49:37.860 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:49:37.860 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-01T19:49:37.860 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:49:37.860 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:49:37.860 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:49:37.860 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:49:37.860 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:49:37.860 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:49:37.860 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:49:37.861 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:49:37.861 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:49:37.861 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:49:37.942 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:49:37.945 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:37.945 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:49:38.046 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:49:38.074 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:38.171 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:49:38.173 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:38.174 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:49:38.275 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:49:38.303 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:38.376 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:49:38.378 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:38.379 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:49:38.437 DEBUG:teuthology.orchestra.run.smithi188:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.2 -b 65536 --object-size 65536 -p unique_pool_5 bench 90 write' 2024-04-01T19:49:38.440 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-04-01T19:49:38.440 INFO:teuthology.orchestra.run:waiting for 3000 2024-04-01T19:49:38.479 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:49:38.506 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:49:38.506 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:49:38.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:49:38.506 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:49:38.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.506 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:238019 5.e 5:750fdb7c:::benchmark_data_smithi188_119427_object73320:head [delete] snapc 0=[] ondisk+write+known_if_redirected e438)", 2024-04-01T19:49:38.506 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:46.928281+0000", 2024-04-01T19:49:38.506 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 411.57842247999997, 2024-04-01T19:49:38.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14729735199999999, 2024-04-01T19:49:38.507 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:38.507 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:38.507 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:38.507 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:49:38.507 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:49:38.507 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:38.507 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 238019 2024-04-01T19:49:38.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.507 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:38.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:38.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:46.928281+0000", 2024-04-01T19:49:38.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:38.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:46.928281+0000", 2024-04-01T19:49:38.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:38.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:46.928283+0000", 2024-04-01T19:49:38.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3350000000000001e-06 2024-04-01T19:49:38.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:38.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:46.928289+0000", 2024-04-01T19:49:38.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1140000000000002e-06 2024-04-01T19:49:38.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:38.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:46.928302+0000", 2024-04-01T19:49:38.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2072000000000001e-05 2024-04-01T19:49:38.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:38.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:46.928313+0000", 2024-04-01T19:49:38.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1289e-05 2024-04-01T19:49:38.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.510 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:38.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.026624+0000", 2024-04-01T19:49:38.510 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.098311401000000007 2024-04-01T19:49:38.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:38.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.026701+0000", 2024-04-01T19:49:38.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7068000000000001e-05 2024-04-01T19:49:38.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:49:38.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.026776+0000", 2024-04-01T19:49:38.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4688e-05 2024-04-01T19:49:38.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:49:38.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.045371+0000", 2024-04-01T19:49:38.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018594968 2024-04-01T19:49:38.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:38.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.075461+0000", 2024-04-01T19:49:38.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.030089714 2024-04-01T19:49:38.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:38.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.075521+0000", 2024-04-01T19:49:38.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9891e-05 2024-04-01T19:49:38.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:38.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.075578+0000", 2024-04-01T19:49:38.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7812000000000001e-05 2024-04-01T19:49:38.513 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.513 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:38.513 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.513 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:238163 5.e 5:7d64007c:::benchmark_data_smithi188_119427_object73464:head [delete] snapc 0=[] ondisk+write+known_if_redirected e438)", 2024-04-01T19:49:38.513 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:47.098524+0000", 2024-04-01T19:49:38.513 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 411.40817973499998, 2024-04-01T19:49:38.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.145365941, 2024-04-01T19:49:38.514 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:38.514 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:38.514 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:38.514 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:49:38.514 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:49:38.514 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:38.514 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 238163 2024-04-01T19:49:38.514 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.514 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:38.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:38.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.098524+0000", 2024-04-01T19:49:38.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:38.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.098524+0000", 2024-04-01T19:49:38.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:38.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.098526+0000", 2024-04-01T19:49:38.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.86e-06 2024-04-01T19:49:38.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:38.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.098531+0000", 2024-04-01T19:49:38.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8710000000000002e-06 2024-04-01T19:49:38.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:38.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.098544+0000", 2024-04-01T19:49:38.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2089000000000001e-05 2024-04-01T19:49:38.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:38.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.098552+0000", 2024-04-01T19:49:38.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3839999999999997e-06 2024-04-01T19:49:38.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:38.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.179915+0000", 2024-04-01T19:49:38.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.081363114 2024-04-01T19:49:38.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:38.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.180034+0000", 2024-04-01T19:49:38.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000118565 2024-04-01T19:49:38.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:49:38.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.180157+0000", 2024-04-01T19:49:38.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000123776 2024-04-01T19:49:38.518 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.518 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:49:38.518 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.185118+0000", 2024-04-01T19:49:38.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0049610610000000001 2024-04-01T19:49:38.518 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.518 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:38.518 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.243818+0000", 2024-04-01T19:49:38.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.058699220000000003 2024-04-01T19:49:38.518 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.518 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:38.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.243851+0000", 2024-04-01T19:49:38.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3481e-05 2024-04-01T19:49:38.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:38.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.243890+0000", 2024-04-01T19:49:38.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8519999999999997e-05 2024-04-01T19:49:38.519 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.519 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:38.519 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.519 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:238172 5.e 5:7b73ef97:::benchmark_data_smithi188_119427_object73473:head [delete] snapc 0=[] ondisk+write+known_if_redirected e438)", 2024-04-01T19:49:38.520 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:47.111601+0000", 2024-04-01T19:49:38.520 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 411.39510267600002, 2024-04-01T19:49:38.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.145813266, 2024-04-01T19:49:38.520 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:38.520 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:38.520 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:38.520 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:49:38.520 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:49:38.520 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:38.520 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 238172 2024-04-01T19:49:38.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.520 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:38.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:38.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.111601+0000", 2024-04-01T19:49:38.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:38.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.111601+0000", 2024-04-01T19:49:38.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:38.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.111603+0000", 2024-04-01T19:49:38.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.136e-06 2024-04-01T19:49:38.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.522 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:38.522 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.111608+0000", 2024-04-01T19:49:38.522 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8849999999999998e-06 2024-04-01T19:49:38.522 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.522 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:38.522 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.111618+0000", 2024-04-01T19:49:38.522 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0631999999999999e-05 2024-04-01T19:49:38.522 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.522 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:38.522 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.111625+0000", 2024-04-01T19:49:38.522 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5359999999999998e-06 2024-04-01T19:49:38.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:38.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.185777+0000", 2024-04-01T19:49:38.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.074151792999999994 2024-04-01T19:49:38.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:38.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.185862+0000", 2024-04-01T19:49:38.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4825000000000002e-05 2024-04-01T19:49:38.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:49:38.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.185938+0000", 2024-04-01T19:49:38.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6811999999999996e-05 2024-04-01T19:49:38.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:49:38.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.200215+0000", 2024-04-01T19:49:38.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014276987 2024-04-01T19:49:38.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:38.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.257294+0000", 2024-04-01T19:49:38.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057078126 2024-04-01T19:49:38.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.525 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:38.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.257353+0000", 2024-04-01T19:49:38.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9914000000000003e-05 2024-04-01T19:49:38.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.525 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:38.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.257414+0000", 2024-04-01T19:49:38.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0619999999999999e-05 2024-04-01T19:49:38.525 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.525 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:38.525 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.526 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:238173 5.e 5:7aa7ffa2:::benchmark_data_smithi188_119427_object73474:head [delete] snapc 0=[] ondisk+write+known_if_redirected e438)", 2024-04-01T19:49:38.526 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:47.112993+0000", 2024-04-01T19:49:38.526 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 411.39371066899997, 2024-04-01T19:49:38.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.144539944, 2024-04-01T19:49:38.526 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:38.526 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:38.526 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:38.526 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:49:38.526 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:49:38.526 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:38.526 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 238173 2024-04-01T19:49:38.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.526 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:38.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:38.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.112993+0000", 2024-04-01T19:49:38.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:38.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.112993+0000", 2024-04-01T19:49:38.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:38.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.112994+0000", 2024-04-01T19:49:38.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.31e-06 2024-04-01T19:49:38.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:38.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.112999+0000", 2024-04-01T19:49:38.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6990000000000002e-06 2024-04-01T19:49:38.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:38.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.113009+0000", 2024-04-01T19:49:38.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0083e-05 2024-04-01T19:49:38.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:38.529 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.113015+0000", 2024-04-01T19:49:38.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8300000000000001e-06 2024-04-01T19:49:38.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.529 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:38.529 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.189329+0000", 2024-04-01T19:49:38.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.076313952000000004 2024-04-01T19:49:38.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.529 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:38.529 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.189415+0000", 2024-04-01T19:49:38.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6170999999999999e-05 2024-04-01T19:49:38.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.530 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:49:38.530 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.189485+0000", 2024-04-01T19:49:38.530 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0061999999999994e-05 2024-04-01T19:49:38.530 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.530 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:49:38.530 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.200420+0000", 2024-04-01T19:49:38.530 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010935215 2024-04-01T19:49:38.530 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.530 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:38.530 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.257454+0000", 2024-04-01T19:49:38.530 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057033410999999999 2024-04-01T19:49:38.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.531 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:38.531 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.257487+0000", 2024-04-01T19:49:38.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3145000000000002e-05 2024-04-01T19:49:38.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.531 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:38.531 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.257533+0000", 2024-04-01T19:49:38.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6066000000000002e-05 2024-04-01T19:49:38.531 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.531 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:38.531 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.532 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:238519 5.e 5:766a0a9f:::benchmark_data_smithi188_119427_object73820:head [delete] snapc 0=[] ondisk+write+known_if_redirected e438)", 2024-04-01T19:49:38.532 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:47.666323+0000", 2024-04-01T19:49:38.532 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 410.84038086499999, 2024-04-01T19:49:38.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.15312003399999999, 2024-04-01T19:49:38.532 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:38.532 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:38.532 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:38.532 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:49:38.532 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:49:38.532 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:38.532 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 238519 2024-04-01T19:49:38.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.533 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:38.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:38.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.666323+0000", 2024-04-01T19:49:38.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:38.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.666323+0000", 2024-04-01T19:49:38.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:38.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.666324+0000", 2024-04-01T19:49:38.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.716e-06 2024-04-01T19:49:38.535 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.535 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:38.535 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.666330+0000", 2024-04-01T19:49:38.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8279999999999999e-06 2024-04-01T19:49:38.535 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.535 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:38.535 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.666349+0000", 2024-04-01T19:49:38.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8372999999999998e-05 2024-04-01T19:49:38.535 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:38.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.666357+0000", 2024-04-01T19:49:38.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1610000000000003e-06 2024-04-01T19:49:38.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:38.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.678782+0000", 2024-04-01T19:49:38.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012425805 2024-04-01T19:49:38.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:38.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.678855+0000", 2024-04-01T19:49:38.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2711000000000002e-05 2024-04-01T19:49:38.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:49:38.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.678926+0000", 2024-04-01T19:49:38.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0366999999999999e-05 2024-04-01T19:49:38.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:49:38.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.681905+0000", 2024-04-01T19:49:38.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0029797439999999999 2024-04-01T19:49:38.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:38.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.819312+0000", 2024-04-01T19:49:38.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.137407055 2024-04-01T19:49:38.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:38.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.819380+0000", 2024-04-01T19:49:38.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7310000000000004e-05 2024-04-01T19:49:38.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:38.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.819443+0000", 2024-04-01T19:49:38.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2964000000000002e-05 2024-04-01T19:49:38.538 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.539 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:38.539 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.539 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:238559 5.e 5:7e67e7e3:::benchmark_data_smithi188_119427_object73860:head [delete] snapc 0=[] ondisk+write+known_if_redirected e438)", 2024-04-01T19:49:38.539 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:47.736979+0000", 2024-04-01T19:49:38.539 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 410.76972424000002, 2024-04-01T19:49:38.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.141987692, 2024-04-01T19:49:38.539 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:38.539 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:38.539 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:38.539 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:49:38.539 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:49:38.539 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:38.540 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 238559 2024-04-01T19:49:38.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.540 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:38.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:38.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.736979+0000", 2024-04-01T19:49:38.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:38.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.736979+0000", 2024-04-01T19:49:38.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:38.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.736981+0000", 2024-04-01T19:49:38.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.99e-06 2024-04-01T19:49:38.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:38.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.736988+0000", 2024-04-01T19:49:38.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3720000000000001e-06 2024-04-01T19:49:38.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:38.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.737002+0000", 2024-04-01T19:49:38.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4704e-05 2024-04-01T19:49:38.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:38.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.737010+0000", 2024-04-01T19:49:38.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.824e-06 2024-04-01T19:49:38.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:38.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.821221+0000", 2024-04-01T19:49:38.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.084210454000000004 2024-04-01T19:49:38.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:38.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.821293+0000", 2024-04-01T19:49:38.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2070999999999995e-05 2024-04-01T19:49:38.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:49:38.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.821372+0000", 2024-04-01T19:49:38.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9518000000000007e-05 2024-04-01T19:49:38.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:49:38.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.829060+0000", 2024-04-01T19:49:38.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.007688266 2024-04-01T19:49:38.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:38.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.878853+0000", 2024-04-01T19:49:38.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.049792809 2024-04-01T19:49:38.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:38.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.878911+0000", 2024-04-01T19:49:38.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7299000000000001e-05 2024-04-01T19:49:38.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:38.545 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.878967+0000", 2024-04-01T19:49:38.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6385000000000003e-05 2024-04-01T19:49:38.545 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.545 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:38.545 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.545 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.545 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:246215 5.e 5:70d39fe3:::benchmark_data_smithi188_119427_object81516:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:49:38.545 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:57.222148+0000", 2024-04-01T19:49:38.545 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 401.28455545899999, 2024-04-01T19:49:38.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.150925477, 2024-04-01T19:49:38.545 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:38.545 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:38.545 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:38.546 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:49:38.546 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:49:38.546 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:38.546 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 246215 2024-04-01T19:49:38.546 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.546 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:38.546 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.546 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:38.546 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.222148+0000", 2024-04-01T19:49:38.546 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.546 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.546 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.546 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:38.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.222148+0000", 2024-04-01T19:49:38.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.547 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:38.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.222150+0000", 2024-04-01T19:49:38.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6819999999999999e-06 2024-04-01T19:49:38.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.547 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:38.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.222155+0000", 2024-04-01T19:49:38.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8470000000000003e-06 2024-04-01T19:49:38.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:38.548 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.222164+0000", 2024-04-01T19:49:38.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7229999999999999e-06 2024-04-01T19:49:38.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:38.548 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.222173+0000", 2024-04-01T19:49:38.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5990000000000002e-06 2024-04-01T19:49:38.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:38.548 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.262858+0000", 2024-04-01T19:49:38.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040685429000000002 2024-04-01T19:49:38.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.549 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:38.549 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.262972+0000", 2024-04-01T19:49:38.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011387099999999999 2024-04-01T19:49:38.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.549 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:49:38.549 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.263100+0000", 2024-04-01T19:49:38.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012828000000000001 2024-04-01T19:49:38.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.549 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:49:38.549 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.270033+0000", 2024-04-01T19:49:38.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00693298 2024-04-01T19:49:38.550 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.550 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.550 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:38.550 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.372953+0000", 2024-04-01T19:49:38.550 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.102919468 2024-04-01T19:49:38.550 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.550 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.550 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:38.550 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.373012+0000", 2024-04-01T19:49:38.550 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9497999999999999e-05 2024-04-01T19:49:38.550 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.550 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:38.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.373073+0000", 2024-04-01T19:49:38.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1099999999999994e-05 2024-04-01T19:49:38.551 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.551 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:38.551 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.551 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.551 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:246487 5.e 5:766cee34:::benchmark_data_smithi188_119427_object81788:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:49:38.551 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:57.583529+0000", 2024-04-01T19:49:38.551 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 400.92317469900001, 2024-04-01T19:49:38.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.143597589, 2024-04-01T19:49:38.551 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:38.552 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:38.552 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:38.552 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:49:38.552 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:49:38.552 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:38.552 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 246487 2024-04-01T19:49:38.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.552 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:38.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:38.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.583529+0000", 2024-04-01T19:49:38.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:38.553 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.583529+0000", 2024-04-01T19:49:38.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:38.553 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.583531+0000", 2024-04-01T19:49:38.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7969999999999999e-06 2024-04-01T19:49:38.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:38.553 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.583536+0000", 2024-04-01T19:49:38.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4029999999999998e-06 2024-04-01T19:49:38.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:38.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.583547+0000", 2024-04-01T19:49:38.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1131000000000001e-05 2024-04-01T19:49:38.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:38.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.583556+0000", 2024-04-01T19:49:38.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5960000000000004e-06 2024-04-01T19:49:38.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:38.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.669216+0000", 2024-04-01T19:49:38.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.085660293999999998 2024-04-01T19:49:38.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.555 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:38.555 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.669346+0000", 2024-04-01T19:49:38.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012951799999999999 2024-04-01T19:49:38.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.555 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:49:38.555 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.669467+0000", 2024-04-01T19:49:38.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012171 2024-04-01T19:49:38.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.555 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:49:38.555 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.673427+0000", 2024-04-01T19:49:38.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0039599769999999999 2024-04-01T19:49:38.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:38.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.727009+0000", 2024-04-01T19:49:38.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.053581393999999997 2024-04-01T19:49:38.556 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:38.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.727068+0000", 2024-04-01T19:49:38.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9231000000000003e-05 2024-04-01T19:49:38.556 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:38.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.727126+0000", 2024-04-01T19:49:38.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8538000000000001e-05 2024-04-01T19:49:38.556 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.557 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:38.557 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.557 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.557 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:246499 5.e 5:791b0087:::benchmark_data_smithi188_119427_object81800:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:49:38.557 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:57.593579+0000", 2024-04-01T19:49:38.557 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 400.91312484500003, 2024-04-01T19:49:38.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13367478099999999, 2024-04-01T19:49:38.557 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:38.557 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:38.557 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:38.557 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:49:38.557 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:49:38.557 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:38.558 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 246499 2024-04-01T19:49:38.558 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.558 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:38.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.558 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:38.558 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.593579+0000", 2024-04-01T19:49:38.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.558 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.558 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:38.558 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.593579+0000", 2024-04-01T19:49:38.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.558 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:38.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.593583+0000", 2024-04-01T19:49:38.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3989999999999997e-06 2024-04-01T19:49:38.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:38.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.593589+0000", 2024-04-01T19:49:38.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5899999999999998e-06 2024-04-01T19:49:38.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:38.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.593600+0000", 2024-04-01T19:49:38.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1314e-05 2024-04-01T19:49:38.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:38.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.593607+0000", 2024-04-01T19:49:38.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4869999999999996e-06 2024-04-01T19:49:38.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:38.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.674372+0000", 2024-04-01T19:49:38.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.080764781999999993 2024-04-01T19:49:38.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:38.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.674485+0000", 2024-04-01T19:49:38.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000112512 2024-04-01T19:49:38.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:49:38.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.674602+0000", 2024-04-01T19:49:38.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000116805 2024-04-01T19:49:38.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:49:38.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.682794+0000", 2024-04-01T19:49:38.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0081925360000000003 2024-04-01T19:49:38.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:38.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.727173+0000", 2024-04-01T19:49:38.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044378487000000001 2024-04-01T19:49:38.562 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.562 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.562 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:38.562 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.727205+0000", 2024-04-01T19:49:38.562 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2107999999999998e-05 2024-04-01T19:49:38.562 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.562 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.562 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:38.562 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.727253+0000", 2024-04-01T19:49:38.562 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8761000000000003e-05 2024-04-01T19:49:38.562 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.562 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:38.562 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.563 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:246632 5.e 5:7587dfb3:::benchmark_data_smithi188_119427_object81933:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:49:38.563 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:57.751990+0000", 2024-04-01T19:49:38.563 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 400.75471345800003, 2024-04-01T19:49:38.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16018565300000001, 2024-04-01T19:49:38.563 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:38.563 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:38.563 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:38.563 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:49:38.563 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:49:38.563 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:38.563 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 246632 2024-04-01T19:49:38.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.564 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:38.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:38.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.751990+0000", 2024-04-01T19:49:38.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:38.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.751990+0000", 2024-04-01T19:49:38.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:38.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.751992+0000", 2024-04-01T19:49:38.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.131e-06 2024-04-01T19:49:38.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:38.565 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.751997+0000", 2024-04-01T19:49:38.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8489999999999997e-06 2024-04-01T19:49:38.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:38.565 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.752007+0000", 2024-04-01T19:49:38.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8290000000000003e-06 2024-04-01T19:49:38.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:38.566 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.752014+0000", 2024-04-01T19:49:38.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9630000000000001e-06 2024-04-01T19:49:38.566 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.566 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.566 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:38.566 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.840140+0000", 2024-04-01T19:49:38.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.088125762999999996 2024-04-01T19:49:38.566 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.566 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.566 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:38.566 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.840225+0000", 2024-04-01T19:49:38.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4982999999999996e-05 2024-04-01T19:49:38.566 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:49:38.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.840304+0000", 2024-04-01T19:49:38.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9394000000000006e-05 2024-04-01T19:49:38.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:49:38.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.848758+0000", 2024-04-01T19:49:38.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0084542420000000007 2024-04-01T19:49:38.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:38.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.912087+0000", 2024-04-01T19:49:38.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.063328655999999997 2024-04-01T19:49:38.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:38.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.912119+0000", 2024-04-01T19:49:38.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1844999999999997e-05 2024-04-01T19:49:38.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:38.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.912176+0000", 2024-04-01T19:49:38.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6997999999999999e-05 2024-04-01T19:49:38.568 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.568 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:38.568 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.569 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:246802 5.e 5:7e9a5833:::benchmark_data_smithi188_119427_object82103:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:49:38.569 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:57.952003+0000", 2024-04-01T19:49:38.569 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 400.55470078299999, 2024-04-01T19:49:38.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.134434158, 2024-04-01T19:49:38.569 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:38.569 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:38.569 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:38.569 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:49:38.569 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:49:38.569 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:38.569 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 246802 2024-04-01T19:49:38.570 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.570 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:38.570 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.570 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:38.570 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.952003+0000", 2024-04-01T19:49:38.570 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.570 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.570 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.570 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:38.570 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.952003+0000", 2024-04-01T19:49:38.570 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.570 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.570 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.570 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:38.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.952005+0000", 2024-04-01T19:49:38.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.807e-06 2024-04-01T19:49:38.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:38.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.952010+0000", 2024-04-01T19:49:38.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.383e-06 2024-04-01T19:49:38.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:38.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.952022+0000", 2024-04-01T19:49:38.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1949e-05 2024-04-01T19:49:38.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:38.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:57.952030+0000", 2024-04-01T19:49:38.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1780000000000003e-06 2024-04-01T19:49:38.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:38.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.028287+0000", 2024-04-01T19:49:38.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.076257458 2024-04-01T19:49:38.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:38.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.028393+0000", 2024-04-01T19:49:38.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000105518 2024-04-01T19:49:38.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:49:38.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.028484+0000", 2024-04-01T19:49:38.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1087000000000004e-05 2024-04-01T19:49:38.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:49:38.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.037744+0000", 2024-04-01T19:49:38.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0092600930000000005 2024-04-01T19:49:38.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:38.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.086349+0000", 2024-04-01T19:49:38.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.048604895000000002 2024-04-01T19:49:38.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:38.574 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.086402+0000", 2024-04-01T19:49:38.574 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2729999999999998e-05 2024-04-01T19:49:38.574 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.574 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.574 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:38.574 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.086437+0000", 2024-04-01T19:49:38.574 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.506e-05 2024-04-01T19:49:38.574 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.574 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:38.574 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.574 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.574 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.574 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:246986 5.e 5:787e6bb3:::benchmark_data_smithi188_119427_object82287:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:49:38.574 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:58.138627+0000", 2024-04-01T19:49:38.575 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 400.36807644599998, 2024-04-01T19:49:38.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13521234300000001, 2024-04-01T19:49:38.575 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:38.575 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:38.575 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:38.575 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:49:38.575 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:49:38.575 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:38.575 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 246986 2024-04-01T19:49:38.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.575 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:38.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:38.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.138627+0000", 2024-04-01T19:49:38.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:38.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.138627+0000", 2024-04-01T19:49:38.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:38.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.138628+0000", 2024-04-01T19:49:38.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.375e-06 2024-04-01T19:49:38.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:38.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.138633+0000", 2024-04-01T19:49:38.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7620000000000003e-06 2024-04-01T19:49:38.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:38.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.138647+0000", 2024-04-01T19:49:38.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4042999999999999e-05 2024-04-01T19:49:38.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:38.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.138655+0000", 2024-04-01T19:49:38.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7009999999999996e-06 2024-04-01T19:49:38.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:38.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.208631+0000", 2024-04-01T19:49:38.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.069975869999999996 2024-04-01T19:49:38.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:38.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.208738+0000", 2024-04-01T19:49:38.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000107107 2024-04-01T19:49:38.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:49:38.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.208820+0000", 2024-04-01T19:49:38.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1889000000000002e-05 2024-04-01T19:49:38.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.579 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:49:38.579 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.224386+0000", 2024-04-01T19:49:38.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015566663999999999 2024-04-01T19:49:38.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.579 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:38.579 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.273768+0000", 2024-04-01T19:49:38.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.049381240999999999 2024-04-01T19:49:38.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:38.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.273801+0000", 2024-04-01T19:49:38.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3451000000000002e-05 2024-04-01T19:49:38.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:38.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.273839+0000", 2024-04-01T19:49:38.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.824e-05 2024-04-01T19:49:38.580 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.580 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:38.580 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.581 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:247253 5.e 5:786b3885:::benchmark_data_smithi188_119427_object82554:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:49:38.581 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:58.480980+0000", 2024-04-01T19:49:38.581 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 400.025723185, 2024-04-01T19:49:38.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16030156200000001, 2024-04-01T19:49:38.581 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:38.581 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:38.581 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:38.581 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:49:38.581 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:49:38.581 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:38.581 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 247253 2024-04-01T19:49:38.581 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.582 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:38.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.582 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:38.582 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.480980+0000", 2024-04-01T19:49:38.582 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.582 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.582 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:38.582 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.480980+0000", 2024-04-01T19:49:38.582 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.582 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.582 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:38.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.480982+0000", 2024-04-01T19:49:38.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.204e-06 2024-04-01T19:49:38.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:38.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.480988+0000", 2024-04-01T19:49:38.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.412e-06 2024-04-01T19:49:38.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:38.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.481000+0000", 2024-04-01T19:49:38.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1712000000000001e-05 2024-04-01T19:49:38.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:38.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.481006+0000", 2024-04-01T19:49:38.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1770000000000003e-06 2024-04-01T19:49:38.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:38.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.578568+0000", 2024-04-01T19:49:38.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.097561964000000001 2024-04-01T19:49:38.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:38.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.578646+0000", 2024-04-01T19:49:38.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8306999999999994e-05 2024-04-01T19:49:38.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.585 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.585 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:49:38.585 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.578716+0000", 2024-04-01T19:49:38.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0148000000000007e-05 2024-04-01T19:49:38.585 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.585 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.585 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:49:38.585 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.590688+0000", 2024-04-01T19:49:38.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011972175 2024-04-01T19:49:38.585 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.585 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.585 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:38.585 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.641213+0000", 2024-04-01T19:49:38.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.050525077000000002 2024-04-01T19:49:38.586 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.586 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.586 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:38.586 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.641246+0000", 2024-04-01T19:49:38.586 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2274999999999998e-05 2024-04-01T19:49:38.586 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.586 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.586 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:38.586 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.641282+0000", 2024-04-01T19:49:38.586 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6111e-05 2024-04-01T19:49:38.586 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.586 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:38.586 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.587 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:247397 5.e 5:732d2c78:::benchmark_data_smithi188_119427_object82698:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:49:38.587 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:58.655614+0000", 2024-04-01T19:49:38.587 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 399.851089753, 2024-04-01T19:49:38.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13616674000000001, 2024-04-01T19:49:38.587 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:38.587 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:38.587 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:38.587 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:49:38.587 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:49:38.587 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:38.587 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 247397 2024-04-01T19:49:38.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.588 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:38.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:38.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.655614+0000", 2024-04-01T19:49:38.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:38.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.655614+0000", 2024-04-01T19:49:38.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:38.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.655616+0000", 2024-04-01T19:49:38.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8109999999999999e-06 2024-04-01T19:49:38.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:38.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.655621+0000", 2024-04-01T19:49:38.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6799999999999998e-06 2024-04-01T19:49:38.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:38.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.655632+0000", 2024-04-01T19:49:38.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0464e-05 2024-04-01T19:49:38.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.590 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.590 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:38.590 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.655638+0000", 2024-04-01T19:49:38.590 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2639999999999997e-06 2024-04-01T19:49:38.590 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.590 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.590 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:38.590 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.740332+0000", 2024-04-01T19:49:38.590 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.084693972000000006 2024-04-01T19:49:38.590 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.590 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.590 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:38.591 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.740430+0000", 2024-04-01T19:49:38.591 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7707000000000005e-05 2024-04-01T19:49:38.591 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.591 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.591 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:49:38.591 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.740511+0000", 2024-04-01T19:49:38.591 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1216000000000003e-05 2024-04-01T19:49:38.591 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.591 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.591 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:49:38.591 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.743892+0000", 2024-04-01T19:49:38.591 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0033814449999999999 2024-04-01T19:49:38.591 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.591 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.592 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:38.592 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.791713+0000", 2024-04-01T19:49:38.592 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.047820254 2024-04-01T19:49:38.592 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.592 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.592 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:38.592 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.791743+0000", 2024-04-01T19:49:38.592 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0593999999999999e-05 2024-04-01T19:49:38.592 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.592 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.592 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:38.592 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:58.791780+0000", 2024-04-01T19:49:38.592 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7333000000000003e-05 2024-04-01T19:49:38.592 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.593 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:38.593 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.593 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.593 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.593 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:248550 5.e 5:7e0cfda9:::benchmark_data_smithi188_119427_object83851:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:49:38.593 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:43:00.030777+0000", 2024-04-01T19:49:38.593 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 398.47592664400003, 2024-04-01T19:49:38.593 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16407606899999999, 2024-04-01T19:49:38.593 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:38.593 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:38.593 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:38.593 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:49:38.593 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:49:38.594 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:38.594 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 248550 2024-04-01T19:49:38.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.594 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:38.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.594 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:38.594 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.030777+0000", 2024-04-01T19:49:38.594 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.594 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:38.594 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.030777+0000", 2024-04-01T19:49:38.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:38.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.030779+0000", 2024-04-01T19:49:38.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3769999999999999e-06 2024-04-01T19:49:38.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:38.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.030786+0000", 2024-04-01T19:49:38.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.404e-06 2024-04-01T19:49:38.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:38.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.030798+0000", 2024-04-01T19:49:38.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2852e-05 2024-04-01T19:49:38.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.596 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:38.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.030807+0000", 2024-04-01T19:49:38.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5580000000000001e-06 2024-04-01T19:49:38.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.596 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:38.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.049634+0000", 2024-04-01T19:49:38.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018827334000000001 2024-04-01T19:49:38.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:38.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.049748+0000", 2024-04-01T19:49:38.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000113241 2024-04-01T19:49:38.597 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:49:38.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.050301+0000", 2024-04-01T19:49:38.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00055343600000000003 2024-04-01T19:49:38.597 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:49:38.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.058890+0000", 2024-04-01T19:49:38.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085885749999999993 2024-04-01T19:49:38.598 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.598 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:38.598 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.194775+0000", 2024-04-01T19:49:38.598 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13588499100000001 2024-04-01T19:49:38.598 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.598 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:38.598 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.194810+0000", 2024-04-01T19:49:38.598 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5224e-05 2024-04-01T19:49:38.598 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:38.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.194853+0000", 2024-04-01T19:49:38.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3077000000000001e-05 2024-04-01T19:49:38.599 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.599 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:38.599 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.599 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:248556 5.e 5:77bbb544:::benchmark_data_smithi188_119427_object83857:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:49:38.599 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:43:00.042657+0000", 2024-04-01T19:49:38.599 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 398.46404681400003, 2024-04-01T19:49:38.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.152348768, 2024-04-01T19:49:38.599 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:38.599 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:38.600 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:38.600 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:49:38.600 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:49:38.600 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:38.600 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 248556 2024-04-01T19:49:38.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.600 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:38.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.600 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:38.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.042657+0000", 2024-04-01T19:49:38.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:38.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.042657+0000", 2024-04-01T19:49:38.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.601 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.601 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:38.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.042659+0000", 2024-04-01T19:49:38.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.057e-06 2024-04-01T19:49:38.601 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.601 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:38.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.042664+0000", 2024-04-01T19:49:38.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.792e-06 2024-04-01T19:49:38.601 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.602 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.602 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:38.602 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.042671+0000", 2024-04-01T19:49:38.602 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4780000000000002e-06 2024-04-01T19:49:38.602 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.602 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.602 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:38.602 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.042678+0000", 2024-04-01T19:49:38.602 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9589999999999998e-06 2024-04-01T19:49:38.602 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.602 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.602 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:38.602 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.054676+0000", 2024-04-01T19:49:38.603 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011997885999999999 2024-04-01T19:49:38.603 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.603 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.603 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:38.603 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.054796+0000", 2024-04-01T19:49:38.603 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000120449 2024-04-01T19:49:38.603 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.603 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.603 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:49:38.603 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.054920+0000", 2024-04-01T19:49:38.603 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012366699999999999 2024-04-01T19:49:38.603 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.603 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.603 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:49:38.604 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.059008+0000", 2024-04-01T19:49:38.604 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040880329999999996 2024-04-01T19:49:38.604 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.604 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.604 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:38.604 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.194900+0000", 2024-04-01T19:49:38.604 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13589177699999999 2024-04-01T19:49:38.604 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.604 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.604 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:38.604 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.194953+0000", 2024-04-01T19:49:38.604 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3508000000000003e-05 2024-04-01T19:49:38.604 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.604 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.605 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:38.605 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.195005+0000", 2024-04-01T19:49:38.605 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2162e-05 2024-04-01T19:49:38.605 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.605 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:38.605 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.605 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.605 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.605 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:248696 5.e 5:74f18be6:::benchmark_data_smithi188_119427_object83997:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:49:38.605 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:43:00.285722+0000", 2024-04-01T19:49:38.605 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 398.22098179800003, 2024-04-01T19:49:38.605 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.148233119, 2024-04-01T19:49:38.605 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:38.605 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:38.606 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:38.606 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:49:38.606 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:49:38.606 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:38.606 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 248696 2024-04-01T19:49:38.606 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.606 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:38.606 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.606 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:38.606 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.285722+0000", 2024-04-01T19:49:38.606 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.606 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.606 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.606 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:38.607 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.285722+0000", 2024-04-01T19:49:38.607 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.607 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.607 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.607 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:38.607 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.285723+0000", 2024-04-01T19:49:38.607 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.392e-06 2024-04-01T19:49:38.607 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.607 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.607 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:38.607 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.285728+0000", 2024-04-01T19:49:38.607 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6489999999999999e-06 2024-04-01T19:49:38.607 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.608 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:38.608 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.285738+0000", 2024-04-01T19:49:38.608 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0617e-05 2024-04-01T19:49:38.608 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.608 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:38.608 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.285745+0000", 2024-04-01T19:49:38.608 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1149999999999996e-06 2024-04-01T19:49:38.608 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.608 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:38.608 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.359063+0000", 2024-04-01T19:49:38.608 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.073318016999999999 2024-04-01T19:49:38.609 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.609 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.609 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:38.609 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.359191+0000", 2024-04-01T19:49:38.609 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000127556 2024-04-01T19:49:38.609 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.609 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.609 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:49:38.609 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.359327+0000", 2024-04-01T19:49:38.609 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013623300000000001 2024-04-01T19:49:38.609 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.609 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.609 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:49:38.610 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.362993+0000", 2024-04-01T19:49:38.610 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036660030000000001 2024-04-01T19:49:38.610 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.610 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.610 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:38.610 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.433823+0000", 2024-04-01T19:49:38.610 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.070829846000000002 2024-04-01T19:49:38.610 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.610 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.610 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:38.610 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.433898+0000", 2024-04-01T19:49:38.610 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5331000000000001e-05 2024-04-01T19:49:38.610 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.611 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.611 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:38.611 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.433955+0000", 2024-04-01T19:49:38.611 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6360000000000002e-05 2024-04-01T19:49:38.611 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.611 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:38.611 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.611 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.611 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.611 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:248702 5.e 5:7398d052:::benchmark_data_smithi188_119427_object84003:head [delete] snapc 0=[] ondisk+write+known_if_redirected e441)", 2024-04-01T19:49:38.611 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:43:00.293713+0000", 2024-04-01T19:49:38.611 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 398.21299031400002, 2024-04-01T19:49:38.611 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.14041481, 2024-04-01T19:49:38.611 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:38.612 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:38.612 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:38.612 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:49:38.612 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:49:38.612 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:49:38.612 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 248702 2024-04-01T19:49:38.612 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.612 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:38.612 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.612 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:38.612 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.293713+0000", 2024-04-01T19:49:38.612 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.612 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.612 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.613 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:38.613 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.293713+0000", 2024-04-01T19:49:38.613 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.613 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.613 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.613 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:38.613 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.293715+0000", 2024-04-01T19:49:38.613 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9259999999999999e-06 2024-04-01T19:49:38.613 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.613 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.613 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:38.613 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.293721+0000", 2024-04-01T19:49:38.613 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4140000000000002e-06 2024-04-01T19:49:38.614 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.614 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.614 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:38.614 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.293733+0000", 2024-04-01T19:49:38.614 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2160999999999999e-05 2024-04-01T19:49:38.614 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.614 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.614 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:38.614 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.293741+0000", 2024-04-01T19:49:38.614 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3149999999999992e-06 2024-04-01T19:49:38.614 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.614 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.614 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:38.614 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.363581+0000", 2024-04-01T19:49:38.615 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.069840134999999998 2024-04-01T19:49:38.615 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.615 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.615 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:38.615 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.363703+0000", 2024-04-01T19:49:38.615 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012218299999999999 2024-04-01T19:49:38.615 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.615 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.615 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:49:38.615 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.363835+0000", 2024-04-01T19:49:38.615 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000132182 2024-04-01T19:49:38.615 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.615 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.615 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:49:38.616 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.370504+0000", 2024-04-01T19:49:38.616 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0066690179999999996 2024-04-01T19:49:38.616 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.616 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.616 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:49:38.616 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.434031+0000", 2024-04-01T19:49:38.616 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.063526529999999998 2024-04-01T19:49:38.616 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.616 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.616 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:38.616 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.434070+0000", 2024-04-01T19:49:38.616 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8572999999999998e-05 2024-04-01T19:49:38.616 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:00.434128+0000", 2024-04-01T19:49:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8372999999999998e-05 2024-04-01T19:49:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:184058 6.9 e515/469 6:98e8d452:::benchmark_data_smithi188_134454_object27317:head v 515'11592, mlcod=515'11589)", 2024-04-01T19:49:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:46:49.307946+0000", 2024-04-01T19:49:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 169.19875705699999, 2024-04-01T19:49:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.024475815000000001, 2024-04-01T19:49:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:49.307946+0000", 2024-04-01T19:49:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:49.307946+0000", 2024-04-01T19:49:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:49.307948+0000", 2024-04-01T19:49:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1620000000000001e-06 2024-04-01T19:49:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:49.307954+0000", 2024-04-01T19:49:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8390000000000001e-06 2024-04-01T19:49:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:49.307966+0000", 2024-04-01T19:49:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1404e-05 2024-04-01T19:49:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:49.307973+0000", 2024-04-01T19:49:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2540000000000003e-06 2024-04-01T19:49:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:49.308102+0000", 2024-04-01T19:49:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012919900000000001 2024-04-01T19:49:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:49.308118+0000", 2024-04-01T19:49:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5617e-05 2024-04-01T19:49:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:49.332383+0000", 2024-04-01T19:49:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.024264902000000001 2024-04-01T19:49:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:49.332422+0000", 2024-04-01T19:49:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9437999999999997e-05 2024-04-01T19:49:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:249486 6.9 e528/469 6:927632d1:::benchmark_data_smithi188_134454_object92745:head v 528'15727, mlcod=528'15721)", 2024-04-01T19:49:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:47.962969+0000", 2024-04-01T19:49:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 110.54373476000001, 2024-04-01T19:49:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027511873999999999, 2024-04-01T19:49:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.962969+0000", 2024-04-01T19:49:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.962969+0000", 2024-04-01T19:49:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.962970+0000", 2024-04-01T19:49:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.398e-06 2024-04-01T19:49:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.962977+0000", 2024-04-01T19:49:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7669999999999998e-06 2024-04-01T19:49:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.962987+0000", 2024-04-01T19:49:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0559e-05 2024-04-01T19:49:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.962994+0000", 2024-04-01T19:49:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0369999999999997e-06 2024-04-01T19:49:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.966354+0000", 2024-04-01T19:49:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.003359693 2024-04-01T19:49:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.966379+0000", 2024-04-01T19:49:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4643000000000001e-05 2024-04-01T19:49:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.990421+0000", 2024-04-01T19:49:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.024042237000000001 2024-04-01T19:49:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:38.626 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:38.626 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:38.626 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.990481+0000", 2024-04-01T19:49:38.626 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9540000000000003e-05 2024-04-01T19:49:38.626 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.626 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:38.626 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.626 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:38.626 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:38.626 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:49:38.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:38 smithi188 ceph-mon[43939]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T19:49:38.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:38 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1647415428' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:49:38.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:38.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:38.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:38.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:38.628 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:38.628 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:49:38.628 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:49:38.629 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:hints = 1 2024-04-01T19:49:38.629 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-04-01T19:49:38.629 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Object prefix: benchmark_data_smithi188_147022 2024-04-01T19:49:38.629 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:49:38.629 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 0 0 0 0 0 0 - 0 2024-04-01T19:49:38.630 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:49:38.631 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:38 smithi022 ceph-mon[39439]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T19:49:38.631 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:38 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1647415428' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:49:38.631 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:38.631 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:38.631 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:38.730 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:49:38.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:38 smithi062 ceph-mon[44211]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T19:49:38.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:38 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1647415428' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:49:38.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:38.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:38.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:38.768 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:38.769 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:49:38.770 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:49:38.798 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:49:38.802 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:38.802 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:49:38.903 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:49:38.944 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:39.090 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:49:39.393 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_ops_in_flight 2024-04-01T19:49:39.398 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:49:39.401 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:39.402 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:49:39.503 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:49:39.533 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 1 16 5580 5564 347.63 347.75 0.00275824 0.00287096 2024-04-01T19:49:39.542 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:39.568 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:49:39.571 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:39.571 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:39.571 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:39.571 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:39.571 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:39.571 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:39.571 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:39.572 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:39.572 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:39 smithi062 ceph-mon[44211]: pgmap v1548: 17 pgs: 17 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:39.572 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:39.573 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:49:39.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:39.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:39.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:39.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:39.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:39.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:39.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:39.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:39.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:39 smithi022 ceph-mon[39439]: pgmap v1548: 17 pgs: 17 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:39.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:39.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:39.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:39.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:39.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:39.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:39.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:39.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:39.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:39 smithi188 ceph-mon[43939]: pgmap v1548: 17 pgs: 17 active+clean; 577 KiB data, 4.4 GiB used, 979 GiB / 983 GiB avail 2024-04-01T19:49:39.673 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:49:39.713 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:39.738 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:49:39.741 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:39.741 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:49:39.821 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:49:39.842 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:49:39.884 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:40.094 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:49:40.098 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:40.099 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:49:40.200 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:49:40.246 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:40.533 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 2 16 10717 10701 334.333 321.062 0.00169257 0.00298609 2024-04-01T19:49:40.609 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:49:40.615 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:40.616 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:49:40.717 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:49:40.756 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:40.771 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:49:40.786 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:49:40.791 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:40.791 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:49:40.893 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:49:40.929 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:40.953 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:49:40.956 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:40.957 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:49:41.058 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:49:41.098 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:41.123 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:49:41.126 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:41.127 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:49:41.227 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:49:41.262 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:41.288 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:49:41.292 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:41.292 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:49:41.302 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:49:41.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:41 smithi022 ceph-mon[39439]: pgmap v1549: 17 pgs: 17 active+clean; 465 MiB data, 4.8 GiB used, 979 GiB / 983 GiB avail; 58 MiB/s wr, 928 op/s 2024-04-01T19:49:41.393 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:49:41.437 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:41.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:41 smithi062 ceph-mon[44211]: pgmap v1549: 17 pgs: 17 active+clean; 465 MiB data, 4.8 GiB used, 979 GiB / 983 GiB avail; 58 MiB/s wr, 928 op/s 2024-04-01T19:49:41.533 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 3 16 15125 15109 314.717 275.5 0.00287998 0.00317533 2024-04-01T19:49:41.586 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:49:41.588 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:41 smithi188 ceph-mon[43939]: pgmap v1549: 17 pgs: 17 active+clean; 465 MiB data, 4.8 GiB used, 979 GiB / 983 GiB avail; 58 MiB/s wr, 928 op/s 2024-04-01T19:49:41.589 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:41.590 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:49:41.691 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:49:41.732 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:41.969 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:49:41.972 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:41.973 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:49:42.049 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:49:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:49:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:17268 7.2 e564/560 7:46c4de5c:::benchmark_data_smithi188_147022_object17267:head v 564'1054, mlcod=564'1052)", 2024-04-01T19:49:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:49:42.048907+0000", 2024-04-01T19:49:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0019893319999999999, 2024-04-01T19:49:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0020198960000000002, 2024-04-01T19:49:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-01T19:49:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:42.048907+0000", 2024-04-01T19:49:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:42.048907+0000", 2024-04-01T19:49:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:42.048909+0000", 2024-04-01T19:49:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2699999999999999e-06 2024-04-01T19:49:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:42.048981+0000", 2024-04-01T19:49:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2473999999999998e-05 2024-04-01T19:49:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:42.048992+0000", 2024-04-01T19:49:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0954999999999999e-05 2024-04-01T19:49:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:42.048999+0000", 2024-04-01T19:49:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4080000000000003e-06 2024-04-01T19:49:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:42.049050+0000", 2024-04-01T19:49:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1839999999999998e-05 2024-04-01T19:49:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:42.049069+0000", 2024-04-01T19:49:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8655e-05 2024-04-01T19:49:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:17285 7.1 e564/560 7:8843fcf4:::benchmark_data_smithi188_147022_object17284:head v 564'1114, mlcod=564'1112)", 2024-04-01T19:49:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:49:42.050281+0000", 2024-04-01T19:49:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.00061536800000000003, 2024-04-01T19:49:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00072444199999999995, 2024-04-01T19:49:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-01T19:49:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:42.050281+0000", 2024-04-01T19:49:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:42.050281+0000", 2024-04-01T19:49:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:42.050282+0000", 2024-04-01T19:49:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0979999999999999e-06 2024-04-01T19:49:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:42.050334+0000", 2024-04-01T19:49:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1505999999999998e-05 2024-04-01T19:49:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:42.050352+0000", 2024-04-01T19:49:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7618e-05 2024-04-01T19:49:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:42.056 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:42.050357+0000", 2024-04-01T19:49:42.056 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2290000000000002e-06 2024-04-01T19:49:42.056 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:42.056 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:42.056 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:42.056 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:42.050406+0000", 2024-04-01T19:49:42.056 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9591e-05 2024-04-01T19:49:42.056 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:42.056 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:42.056 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:42.057 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:42.050422+0000", 2024-04-01T19:49:42.057 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5259000000000001e-05 2024-04-01T19:49:42.057 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:42.057 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:42.057 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:42.057 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:42.057 INFO:teuthology.orchestra.run.smithi188.stdout: ], 2024-04-01T19:49:42.057 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 2 2024-04-01T19:49:42.057 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:49:42.074 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:49:42.113 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:42.354 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:49:42.379 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:49:42.383 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:42.383 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:49:42.484 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:49:42.528 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:42.533 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 4 16 19413 19397 303.034 268 0.00411745 0.00329713 2024-04-01T19:49:42.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:42 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3717892122' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:49:42.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:42 smithi022 ceph-mon[39439]: from='client.26665 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:49:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:42 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3717892122' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:49:42.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:42 smithi188 ceph-mon[43939]: from='client.26665 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:49:42.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:42 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3717892122' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:49:42.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:42 smithi062 ceph-mon[44211]: from='client.26665 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:49:42.985 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:49:42.988 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:42.989 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:49:42.999 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_blocked_ops 2024-04-01T19:49:43.090 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:49:43.134 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:43.167 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:49:43.170 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:43.171 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:49:43.272 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:49:43.308 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:43.348 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:49:43.353 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:43 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:49:43.353 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:43 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:49:43.353 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:43 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:49:43.353 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:43 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:49:43.353 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:43 smithi188 ceph-mon[43939]: from='client.26665 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:49:43.354 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:43 smithi188 ceph-mon[43939]: osdmap e565: 12 total, 11 up, 11 in 2024-04-01T19:49:43.354 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:43 smithi188 ceph-mon[43939]: pgmap v1551: 17 pgs: 17 active+clean; 691 MiB data, 5.5 GiB used, 978 GiB / 983 GiB avail; 86 MiB/s wr, 1.38k op/s 2024-04-01T19:49:43.367 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:43.368 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:49:43.432 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:49:43.468 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:49:43.516 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:43.534 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 5 16 23342 23326 291.536 245.562 0.00401388 0.00342789 2024-04-01T19:49:43.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:43 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:49:43.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:43 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:49:43.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:43 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:49:43.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:43 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:49:43.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:43 smithi022 ceph-mon[39439]: from='client.26665 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:49:43.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:43 smithi022 ceph-mon[39439]: osdmap e565: 12 total, 11 up, 11 in 2024-04-01T19:49:43.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:43 smithi022 ceph-mon[39439]: pgmap v1551: 17 pgs: 17 active+clean; 691 MiB data, 5.5 GiB used, 978 GiB / 983 GiB avail; 86 MiB/s wr, 1.38k op/s 2024-04-01T19:49:43.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:43 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:49:43.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:43 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:49:43.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:43 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:49:43.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:43 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:49:43.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:43 smithi062 ceph-mon[44211]: from='client.26665 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:49:43.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:43 smithi062 ceph-mon[44211]: osdmap e565: 12 total, 11 up, 11 in 2024-04-01T19:49:43.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:43 smithi062 ceph-mon[44211]: pgmap v1551: 17 pgs: 17 active+clean; 691 MiB data, 5.5 GiB used, 978 GiB / 983 GiB avail; 86 MiB/s wr, 1.38k op/s 2024-04-01T19:49:44.534 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 6 16 26948 26932 280.507 225.375 0.00335894 0.00356284 2024-04-01T19:49:45.534 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 7 16 30023 30007 267.887 192.188 0.00210419 0.00371673 2024-04-01T19:49:45.669 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:49:45.669 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:49:45.669 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-01T19:49:45.669 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-01T19:49:45.669 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:49:46.287 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:49:46.290 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:46.291 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:49:46.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:46 smithi188 ceph-mon[43939]: pgmap v1552: 17 pgs: 17 active+clean; 865 MiB data, 6.1 GiB used, 977 GiB / 983 GiB avail; 97 MiB/s wr, 1.55k op/s 2024-04-01T19:49:46.392 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:49:46.440 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:46.471 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:49:46.480 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:46.481 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:49:46.496 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_historic_ops 2024-04-01T19:49:46.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:46 smithi062 ceph-mon[44211]: pgmap v1552: 17 pgs: 17 active+clean; 865 MiB data, 6.1 GiB used, 977 GiB / 983 GiB avail; 97 MiB/s wr, 1.55k op/s 2024-04-01T19:49:46.534 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 8 16 33040 33024 257.97 188.562 0.00202933 0.00387002 2024-04-01T19:49:46.581 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:49:46.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:46 smithi022 ceph-mon[39439]: pgmap v1552: 17 pgs: 17 active+clean; 865 MiB data, 6.1 GiB used, 977 GiB / 983 GiB avail; 97 MiB/s wr, 1.55k op/s 2024-04-01T19:49:46.618 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:46.647 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:49:46.652 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:46.653 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:49:46.754 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:49:46.797 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:46.825 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:49:46.829 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:46.829 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:49:46.899 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:49:46.930 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:49:46.972 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:47.328 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:49:47.333 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:47.333 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:49:47.434 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:49:47.476 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:47.506 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:49:47.508 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:47.509 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:49:47.534 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 9 16 36114 36098 250.652 192.125 0.0026333 0.00398787 2024-04-01T19:49:47.609 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:49:47.658 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:48.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:48 smithi062 ceph-mon[44211]: pgmap v1553: 17 pgs: 17 active+clean; 1.8 GiB data, 7.8 GiB used, 976 GiB / 983 GiB avail; 189 MiB/s wr, 3.02k op/s 2024-04-01T19:49:48.534 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 10 16 38942 38926 243.261 176.75 0.00303169 0.00410865 2024-04-01T19:49:48.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:48 smithi022 ceph-mon[39439]: pgmap v1553: 17 pgs: 17 active+clean; 1.8 GiB data, 7.8 GiB used, 976 GiB / 983 GiB avail; 189 MiB/s wr, 3.02k op/s 2024-04-01T19:49:48.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:48 smithi188 ceph-mon[43939]: pgmap v1553: 17 pgs: 17 active+clean; 1.8 GiB data, 7.8 GiB used, 976 GiB / 983 GiB avail; 189 MiB/s wr, 3.02k op/s 2024-04-01T19:49:48.927 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:49:48.935 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:48.935 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:49:49.036 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:49:49.076 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:49.085 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:49:49.085 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:49:49.086 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:49:49.086 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:49:49.086 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.086 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:176010 6.f e511/469 6:fb5facb0:::benchmark_data_smithi188_134454_object19269:head v 511'10939, mlcod=511'10934)", 2024-04-01T19:49:49.086 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:46:41.986694+0000", 2024-04-01T19:49:49.086 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 187.09914478600001, 2024-04-01T19:49:49.086 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013791994, 2024-04-01T19:49:49.086 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:49.086 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:49.086 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:49.086 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:49.087 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.087 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:49.087 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.986694+0000", 2024-04-01T19:49:49.087 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.087 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.087 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.087 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:49.087 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.986694+0000", 2024-04-01T19:49:49.087 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.087 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.087 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.087 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:49.087 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.986695+0000", 2024-04-01T19:49:49.087 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2589999999999999e-06 2024-04-01T19:49:49.088 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.088 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.088 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:49.088 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.986702+0000", 2024-04-01T19:49:49.088 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.438e-06 2024-04-01T19:49:49.088 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.088 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.088 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:49.088 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.986711+0000", 2024-04-01T19:49:49.088 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4339999999999998e-06 2024-04-01T19:49:49.088 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.088 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.088 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:49.089 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.986716+0000", 2024-04-01T19:49:49.089 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3639999999999998e-06 2024-04-01T19:49:49.089 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.089 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.089 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:49.089 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.986785+0000", 2024-04-01T19:49:49.089 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8225999999999994e-05 2024-04-01T19:49:49.089 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.089 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.089 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:49.089 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.986804+0000", 2024-04-01T19:49:49.089 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9524000000000001e-05 2024-04-01T19:49:49.089 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.090 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.090 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:49.090 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:42.000458+0000", 2024-04-01T19:49:49.090 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013654123000000001 2024-04-01T19:49:49.090 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.090 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.090 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:49.090 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:42.000486+0000", 2024-04-01T19:49:49.090 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7625999999999999e-05 2024-04-01T19:49:49.090 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.090 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:49.090 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.090 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.091 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.091 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:176015 6.f e511/469 6:f1a7e11b:::benchmark_data_smithi188_134454_object19274:head v 511'10940, mlcod=511'10935)", 2024-04-01T19:49:49.091 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:46:41.986746+0000", 2024-04-01T19:49:49.091 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 187.099092676, 2024-04-01T19:49:49.091 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018574749000000002, 2024-04-01T19:49:49.091 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:49.091 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:49.091 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:49.091 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:49.091 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.091 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:49.091 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.986746+0000", 2024-04-01T19:49:49.091 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.092 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.092 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.092 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:49.092 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.986746+0000", 2024-04-01T19:49:49.092 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.092 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.092 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.092 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:49.092 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.986746+0000", 2024-04-01T19:49:49.092 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4299999999999999e-07 2024-04-01T19:49:49.092 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.092 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.093 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:49.093 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.986749+0000", 2024-04-01T19:49:49.093 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8849999999999999e-06 2024-04-01T19:49:49.093 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.093 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.093 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:49.093 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.986752+0000", 2024-04-01T19:49:49.093 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2090000000000001e-06 2024-04-01T19:49:49.093 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.093 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.093 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:49.093 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.986756+0000", 2024-04-01T19:49:49.093 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.455e-06 2024-04-01T19:49:49.093 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.094 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.094 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:49.094 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.991067+0000", 2024-04-01T19:49:49.094 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.004311095 2024-04-01T19:49:49.094 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.094 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.094 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:49.094 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.991089+0000", 2024-04-01T19:49:49.094 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2138999999999999e-05 2024-04-01T19:49:49.094 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.094 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.094 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:49.094 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:42.005283+0000", 2024-04-01T19:49:49.094 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014194109 2024-04-01T19:49:49.095 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.095 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.095 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:49.095 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:42.005321+0000", 2024-04-01T19:49:49.095 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7514e-05 2024-04-01T19:49:49.095 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.095 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:49.095 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.095 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.095 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.095 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:176017 6.f e511/469 6:f096e1a0:::benchmark_data_smithi188_134454_object19276:head v 511'10941, mlcod=511'10935)", 2024-04-01T19:49:49.095 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:46:41.987653+0000", 2024-04-01T19:49:49.095 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 187.09818570499999, 2024-04-01T19:49:49.095 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017708307999999999, 2024-04-01T19:49:49.096 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:49.096 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:49.096 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:49.096 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:49.096 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.096 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:49.096 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.987653+0000", 2024-04-01T19:49:49.096 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.096 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.096 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.097 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:49.097 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.987653+0000", 2024-04-01T19:49:49.097 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.097 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.097 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.097 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:49.097 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.987654+0000", 2024-04-01T19:49:49.097 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1319999999999999e-06 2024-04-01T19:49:49.097 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.097 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.097 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:49.097 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.987660+0000", 2024-04-01T19:49:49.097 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8429999999999998e-06 2024-04-01T19:49:49.097 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.098 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.098 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:49.098 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.987669+0000", 2024-04-01T19:49:49.098 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1169999999999993e-06 2024-04-01T19:49:49.098 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.098 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.098 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:49.098 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.987675+0000", 2024-04-01T19:49:49.098 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5779999999999998e-06 2024-04-01T19:49:49.098 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.098 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.098 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:49.099 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.994445+0000", 2024-04-01T19:49:49.099 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067699229999999997 2024-04-01T19:49:49.099 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.099 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.099 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:49.099 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.994460+0000", 2024-04-01T19:49:49.099 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5078e-05 2024-04-01T19:49:49.099 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.099 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.099 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:49.099 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:42.005325+0000", 2024-04-01T19:49:49.099 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010865207 2024-04-01T19:49:49.099 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.099 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.100 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:49.100 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:42.005361+0000", 2024-04-01T19:49:49.100 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6430000000000002e-05 2024-04-01T19:49:49.100 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.100 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:49.100 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.100 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.100 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.100 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:176022 6.f e511/469 6:f02d643b:::benchmark_data_smithi188_134454_object19281:head v 511'10942, mlcod=511'10937)", 2024-04-01T19:49:49.100 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:46:41.991584+0000", 2024-04-01T19:49:49.100 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 187.09425508199999, 2024-04-01T19:49:49.100 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013807201, 2024-04-01T19:49:49.100 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:49.100 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:49.101 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:49.101 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:49.101 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.101 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:49.102 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.991584+0000", 2024-04-01T19:49:49.102 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.102 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.102 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.102 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:49.102 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.991584+0000", 2024-04-01T19:49:49.103 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.103 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.103 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.103 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:49.103 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.991585+0000", 2024-04-01T19:49:49.103 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3740000000000001e-06 2024-04-01T19:49:49.103 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.103 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.103 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:49.103 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.991592+0000", 2024-04-01T19:49:49.104 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7900000000000002e-06 2024-04-01T19:49:49.104 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.104 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.104 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:49.104 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.991601+0000", 2024-04-01T19:49:49.104 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0499999999999997e-06 2024-04-01T19:49:49.104 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.104 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.104 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:49.104 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.991606+0000", 2024-04-01T19:49:49.104 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2449999999999998e-06 2024-04-01T19:49:49.105 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.105 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.105 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:49.105 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.997563+0000", 2024-04-01T19:49:49.105 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059568889999999999 2024-04-01T19:49:49.105 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.105 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.105 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:49.105 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:41.997586+0000", 2024-04-01T19:49:49.106 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3099999999999999e-05 2024-04-01T19:49:49.106 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.106 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.106 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:49.106 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:42.005366+0000", 2024-04-01T19:49:49.106 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.007780024 2024-04-01T19:49:49.106 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.106 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.106 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:49.107 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:42.005391+0000", 2024-04-01T19:49:49.107 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4729e-05 2024-04-01T19:49:49.107 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.107 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:49.107 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.107 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.107 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.108 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:183315 6.f e514/469 6:f0171092:::benchmark_data_smithi188_134454_object26574:head v 514'11386, mlcod=514'11380)", 2024-04-01T19:49:49.108 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:46:48.684977+0000", 2024-04-01T19:49:49.108 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 180.400861679, 2024-04-01T19:49:49.108 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014271169, 2024-04-01T19:49:49.108 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:49.108 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:49.108 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:49.108 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:49.108 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.108 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:49.109 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:48.684977+0000", 2024-04-01T19:49:49.109 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.109 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.109 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.109 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:49.109 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:48.684977+0000", 2024-04-01T19:49:49.109 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.109 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.109 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.109 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:49.109 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:48.684978+0000", 2024-04-01T19:49:49.110 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5199999999999995e-07 2024-04-01T19:49:49.110 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.110 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.110 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:49.110 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:48.684983+0000", 2024-04-01T19:49:49.110 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1610000000000002e-06 2024-04-01T19:49:49.110 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.110 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.110 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:49.111 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:48.684990+0000", 2024-04-01T19:49:49.111 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9990000000000002e-06 2024-04-01T19:49:49.111 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.111 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.111 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:49.111 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:48.684995+0000", 2024-04-01T19:49:49.111 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0610000000000003e-06 2024-04-01T19:49:49.111 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.111 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.111 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:49.112 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:48.688627+0000", 2024-04-01T19:49:49.112 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036322139999999999 2024-04-01T19:49:49.112 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.112 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.112 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:49.112 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:48.688654+0000", 2024-04-01T19:49:49.112 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6959999999999999e-05 2024-04-01T19:49:49.113 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.113 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.113 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:49.113 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:48.699195+0000", 2024-04-01T19:49:49.113 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010540915 2024-04-01T19:49:49.113 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.113 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.113 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:49.113 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:48.699248+0000", 2024-04-01T19:49:49.113 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3007000000000003e-05 2024-04-01T19:49:49.113 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.114 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:49.114 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.114 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.114 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.114 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:201389 6.f e518/469 6:feeb3988:::benchmark_data_smithi188_134454_object44648:head v 518'12542, mlcod=518'12539)", 2024-04-01T19:49:49.114 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:04.329104+0000", 2024-04-01T19:49:49.114 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 164.75673486400001, 2024-04-01T19:49:49.114 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013496108999999999, 2024-04-01T19:49:49.114 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:49.114 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:49.114 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:49.115 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:49.115 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.115 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:49.115 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.329104+0000", 2024-04-01T19:49:49.115 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.115 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.115 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.115 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:49.115 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.329104+0000", 2024-04-01T19:49:49.115 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.115 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.116 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.116 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:49.116 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.329105+0000", 2024-04-01T19:49:49.116 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1489999999999999e-06 2024-04-01T19:49:49.116 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.116 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.116 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:49.116 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.329112+0000", 2024-04-01T19:49:49.116 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7279999999999998e-06 2024-04-01T19:49:49.116 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.116 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.117 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:49.117 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.329120+0000", 2024-04-01T19:49:49.117 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7940000000000003e-06 2024-04-01T19:49:49.117 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.117 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.117 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:49.117 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.329125+0000", 2024-04-01T19:49:49.117 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8780000000000003e-06 2024-04-01T19:49:49.117 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.117 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.117 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:49.117 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.331663+0000", 2024-04-01T19:49:49.118 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025375689999999999 2024-04-01T19:49:49.118 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.118 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.118 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:49.118 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.331689+0000", 2024-04-01T19:49:49.118 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5867000000000002e-05 2024-04-01T19:49:49.118 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.118 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.118 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:49.119 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.342532+0000", 2024-04-01T19:49:49.119 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010842816999999999 2024-04-01T19:49:49.119 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.119 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.119 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:49.119 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:04.342600+0000", 2024-04-01T19:49:49.119 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8306999999999995e-05 2024-04-01T19:49:49.119 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.119 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:49.119 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.119 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.119 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.120 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:204398 6.f e518/469 6:fab4694c:::benchmark_data_smithi188_134454_object47657:head v 518'12743, mlcod=518'12741)", 2024-04-01T19:49:49.120 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:06.964208+0000", 2024-04-01T19:49:49.120 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 162.121631119, 2024-04-01T19:49:49.120 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013660553000000001, 2024-04-01T19:49:49.120 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:49.120 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:49.120 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:49.120 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:49.120 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.120 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:49.120 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:06.964208+0000", 2024-04-01T19:49:49.121 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.121 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.121 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.121 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:49.121 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:06.964208+0000", 2024-04-01T19:49:49.121 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.121 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.121 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.121 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:49.121 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:06.964209+0000", 2024-04-01T19:49:49.121 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.815e-06 2024-04-01T19:49:49.121 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.122 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.122 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:49.122 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:06.964218+0000", 2024-04-01T19:49:49.122 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4579999999999993e-06 2024-04-01T19:49:49.122 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.122 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.122 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:49.123 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:06.964232+0000", 2024-04-01T19:49:49.123 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3723999999999999e-05 2024-04-01T19:49:49.123 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.123 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.123 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:49.123 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:06.964239+0000", 2024-04-01T19:49:49.123 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4390000000000003e-06 2024-04-01T19:49:49.123 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.123 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.124 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:49.124 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:06.964297+0000", 2024-04-01T19:49:49.124 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7528999999999998e-05 2024-04-01T19:49:49.124 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.124 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.124 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:49.124 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:06.964318+0000", 2024-04-01T19:49:49.124 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.179e-05 2024-04-01T19:49:49.124 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.124 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.124 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:49.125 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:06.977824+0000", 2024-04-01T19:49:49.125 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013505425999999999 2024-04-01T19:49:49.125 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.125 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.125 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:49.125 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:06.977868+0000", 2024-04-01T19:49:49.125 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4372000000000001e-05 2024-04-01T19:49:49.125 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.125 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:49.125 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.125 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.125 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.126 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:210607 6.f e521/469 6:faaf29c9:::benchmark_data_smithi188_134454_object53866:head v 521'13174, mlcod=521'13171)", 2024-04-01T19:49:49.126 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:12.339944+0000", 2024-04-01T19:49:49.126 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 156.74589506699999, 2024-04-01T19:49:49.126 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016142285999999999, 2024-04-01T19:49:49.126 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:49.126 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:49.126 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:49.126 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:49.126 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.126 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:49.127 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.339944+0000", 2024-04-01T19:49:49.127 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.127 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.127 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.127 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:49.127 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.339944+0000", 2024-04-01T19:49:49.127 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.127 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.127 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.127 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:49.127 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.339944+0000", 2024-04-01T19:49:49.128 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2500000000000005e-07 2024-04-01T19:49:49.128 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.128 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.128 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:49.128 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.339949+0000", 2024-04-01T19:49:49.128 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.634e-06 2024-04-01T19:49:49.128 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.128 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.128 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:49.128 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.339955+0000", 2024-04-01T19:49:49.128 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6350000000000003e-06 2024-04-01T19:49:49.129 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.129 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.129 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:49.129 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.339959+0000", 2024-04-01T19:49:49.129 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8450000000000002e-06 2024-04-01T19:49:49.129 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.129 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.129 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:49.129 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.343554+0000", 2024-04-01T19:49:49.129 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0035945719999999999 2024-04-01T19:49:49.129 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.130 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.130 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:49.130 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.343580+0000", 2024-04-01T19:49:49.130 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6050999999999998e-05 2024-04-01T19:49:49.130 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.130 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.130 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:49.130 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.356040+0000", 2024-04-01T19:49:49.130 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012460087 2024-04-01T19:49:49.130 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.130 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.130 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:49.130 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.356086+0000", 2024-04-01T19:49:49.131 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5837000000000002e-05 2024-04-01T19:49:49.131 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.131 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:49.131 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.131 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.131 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.131 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:210615 6.f e521/469 6:ff1661d9:::benchmark_data_smithi188_134454_object53874:head v 521'13175, mlcod=521'13171)", 2024-04-01T19:49:49.131 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:12.342379+0000", 2024-04-01T19:49:49.131 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 156.74345922500001, 2024-04-01T19:49:49.131 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019875133, 2024-04-01T19:49:49.131 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:49.131 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:49.131 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:49.131 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:49.131 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.132 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:49.132 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.342379+0000", 2024-04-01T19:49:49.132 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.132 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.132 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.132 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:49.132 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.342379+0000", 2024-04-01T19:49:49.132 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.132 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.132 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.132 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:49.132 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.342381+0000", 2024-04-01T19:49:49.132 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2580000000000001e-06 2024-04-01T19:49:49.132 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.132 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.133 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:49.133 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.342387+0000", 2024-04-01T19:49:49.133 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6019999999999996e-06 2024-04-01T19:49:49.133 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.133 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.133 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:49.133 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.342398+0000", 2024-04-01T19:49:49.133 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0579e-05 2024-04-01T19:49:49.133 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.133 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.133 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:49.133 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.342403+0000", 2024-04-01T19:49:49.133 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2920000000000003e-06 2024-04-01T19:49:49.133 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.133 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.134 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:49.134 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.347739+0000", 2024-04-01T19:49:49.134 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0053360739999999997 2024-04-01T19:49:49.134 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.134 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.134 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:49.134 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.347764+0000", 2024-04-01T19:49:49.134 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4318e-05 2024-04-01T19:49:49.134 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.134 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.134 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:49.134 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.362226+0000", 2024-04-01T19:49:49.134 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014462872 2024-04-01T19:49:49.135 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.135 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.135 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:49.135 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.362255+0000", 2024-04-01T19:49:49.135 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8138000000000001e-05 2024-04-01T19:49:49.135 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.135 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:49.135 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.135 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.135 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.135 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:210618 6.f e521/469 6:f7bfd0cd:::benchmark_data_smithi188_134454_object53877:head v 521'13176, mlcod=521'13171)", 2024-04-01T19:49:49.135 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:12.347227+0000", 2024-04-01T19:49:49.135 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 156.738611752, 2024-04-01T19:49:49.135 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015061768, 2024-04-01T19:49:49.135 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:49.136 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:49.136 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:49.136 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:49.136 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.136 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:49.136 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.347227+0000", 2024-04-01T19:49:49.136 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.136 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.136 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.136 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:49.136 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.347227+0000", 2024-04-01T19:49:49.136 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.136 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.136 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.136 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:49.137 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.347229+0000", 2024-04-01T19:49:49.137 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2579999999999998e-06 2024-04-01T19:49:49.137 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.137 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.137 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:49.137 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.347242+0000", 2024-04-01T19:49:49.137 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2486999999999999e-05 2024-04-01T19:49:49.137 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.137 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.137 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:49.137 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.347260+0000", 2024-04-01T19:49:49.137 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8508e-05 2024-04-01T19:49:49.137 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.137 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.137 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:49.138 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.347270+0000", 2024-04-01T19:49:49.138 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0006999999999999e-05 2024-04-01T19:49:49.138 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.138 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.138 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:49.138 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.351786+0000", 2024-04-01T19:49:49.138 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0045155830000000001 2024-04-01T19:49:49.138 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.138 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.138 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:49.138 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.351808+0000", 2024-04-01T19:49:49.138 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2487999999999999e-05 2024-04-01T19:49:49.138 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.139 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.139 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:49.139 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.362259+0000", 2024-04-01T19:49:49.139 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010450462000000001 2024-04-01T19:49:49.139 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.139 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.139 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:49.139 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:12.362289+0000", 2024-04-01T19:49:49.139 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9975e-05 2024-04-01T19:49:49.139 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.139 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:49.139 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.139 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.139 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.140 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:248730 6.f e528/469 6:faaab97c:::benchmark_data_smithi188_134454_object91989:head v 528'15482, mlcod=528'15478)", 2024-04-01T19:49:49.140 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:47.219122+0000", 2024-04-01T19:49:49.140 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 121.866716416, 2024-04-01T19:49:49.140 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014000551999999999, 2024-04-01T19:49:49.140 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:49.140 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:49.140 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:49.140 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:49.140 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.140 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:49.140 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.219122+0000", 2024-04-01T19:49:49.140 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.140 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.140 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.141 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:49.141 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.219122+0000", 2024-04-01T19:49:49.141 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.141 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.141 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.141 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:49.141 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.219125+0000", 2024-04-01T19:49:49.141 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.232e-06 2024-04-01T19:49:49.141 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.141 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.141 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:49.141 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.219134+0000", 2024-04-01T19:49:49.141 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4499999999999993e-06 2024-04-01T19:49:49.141 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.141 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.142 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:49.142 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.219145+0000", 2024-04-01T19:49:49.142 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1386000000000001e-05 2024-04-01T19:49:49.142 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.142 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.142 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:49.142 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.219155+0000", 2024-04-01T19:49:49.142 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0030000000000001e-05 2024-04-01T19:49:49.142 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.142 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.142 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:49.142 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.221223+0000", 2024-04-01T19:49:49.143 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0020680479999999998 2024-04-01T19:49:49.143 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.143 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.143 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:49.143 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.221239+0000", 2024-04-01T19:49:49.143 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6032000000000002e-05 2024-04-01T19:49:49.143 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.143 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.143 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:49.143 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.233059+0000", 2024-04-01T19:49:49.143 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011819628 2024-04-01T19:49:49.143 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.143 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.144 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:49.144 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.233123+0000", 2024-04-01T19:49:49.144 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3745999999999996e-05 2024-04-01T19:49:49.144 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.144 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:49.144 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.144 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.144 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.144 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:272683 6.f e546/469 6:fc6fb613:::benchmark_data_smithi188_134454_object115942:head v 546'16935, mlcod=546'16931)", 2024-04-01T19:49:49.144 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:48:35.848620+0000", 2024-04-01T19:49:49.144 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 73.237219112000005, 2024-04-01T19:49:49.144 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0097912759999999998, 2024-04-01T19:49:49.144 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:49.144 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:49.145 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:49.145 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:49.145 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.145 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:49.145 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:35.848620+0000", 2024-04-01T19:49:49.145 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.145 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.145 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.145 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:49.145 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:35.848620+0000", 2024-04-01T19:49:49.145 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.145 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.145 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.145 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:49.146 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:35.848621+0000", 2024-04-01T19:49:49.146 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.204e-06 2024-04-01T19:49:49.146 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.146 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.146 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:49.146 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:35.848628+0000", 2024-04-01T19:49:49.146 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2110000000000001e-06 2024-04-01T19:49:49.146 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.146 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.146 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:49.146 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:35.848639+0000", 2024-04-01T19:49:49.146 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.077e-05 2024-04-01T19:49:49.147 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.147 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.147 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:49.147 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:35.848646+0000", 2024-04-01T19:49:49.147 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7299999999999999e-06 2024-04-01T19:49:49.147 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.147 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.147 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:49.147 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:35.850984+0000", 2024-04-01T19:49:49.147 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0023389610000000001 2024-04-01T19:49:49.147 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.147 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.147 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:49.147 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:35.850999+0000", 2024-04-01T19:49:49.148 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4531e-05 2024-04-01T19:49:49.148 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.148 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.148 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:49.148 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:35.858378+0000", 2024-04-01T19:49:49.148 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073794330000000003 2024-04-01T19:49:49.148 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.148 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.148 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:49.148 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:35.858411+0000", 2024-04-01T19:49:49.148 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2435999999999999e-05 2024-04-01T19:49:49.148 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.148 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:49.148 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.148 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.149 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.149 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:273904 6.f e546/469 6:fccbc40e:::benchmark_data_smithi188_134454_object117163:head v 546'17007, mlcod=546'17004)", 2024-04-01T19:49:49.149 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:48:36.938175+0000", 2024-04-01T19:49:49.149 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.147663293999997, 2024-04-01T19:49:49.149 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010683656999999999, 2024-04-01T19:49:49.149 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:49.149 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:49.149 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:49.149 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:49.149 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.149 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:49.149 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.938175+0000", 2024-04-01T19:49:49.149 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.150 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.150 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.150 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:49.150 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.938175+0000", 2024-04-01T19:49:49.150 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.150 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.150 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.150 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:49.150 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.938176+0000", 2024-04-01T19:49:49.150 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5799999999999999e-07 2024-04-01T19:49:49.150 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.150 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.150 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:49.151 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.938180+0000", 2024-04-01T19:49:49.151 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2390000000000004e-06 2024-04-01T19:49:49.151 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.151 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.151 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:49.151 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.938186+0000", 2024-04-01T19:49:49.151 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7579999999999998e-06 2024-04-01T19:49:49.151 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.151 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.151 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:49.151 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.938191+0000", 2024-04-01T19:49:49.151 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9760000000000003e-06 2024-04-01T19:49:49.151 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.152 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.152 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:49.152 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.942286+0000", 2024-04-01T19:49:49.152 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040951169999999997 2024-04-01T19:49:49.152 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.152 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.152 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:49.152 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.942300+0000", 2024-04-01T19:49:49.152 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3675e-05 2024-04-01T19:49:49.152 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.152 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.152 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:49.152 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.948826+0000", 2024-04-01T19:49:49.153 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0065264549999999996 2024-04-01T19:49:49.153 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.153 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.153 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:49.153 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.948859+0000", 2024-04-01T19:49:49.153 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2879000000000001e-05 2024-04-01T19:49:49.153 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.153 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:49.153 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.153 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.153 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.153 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:274016 6.f e546/469 6:f7e60f75:::benchmark_data_smithi188_134454_object117275:head v 546'17013, mlcod=546'17009)", 2024-04-01T19:49:49.153 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:48:37.027723+0000", 2024-04-01T19:49:49.153 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.058115685000004, 2024-04-01T19:49:49.154 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0097705450000000003, 2024-04-01T19:49:49.154 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:49.154 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:49.154 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:49.154 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:49.154 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.154 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:49.154 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:37.027723+0000", 2024-04-01T19:49:49.154 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.154 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.154 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.154 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:49.154 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:37.027723+0000", 2024-04-01T19:49:49.155 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.155 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.155 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.155 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:49.155 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:37.027724+0000", 2024-04-01T19:49:49.155 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7e-07 2024-04-01T19:49:49.155 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.155 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.155 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:49.155 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:37.027727+0000", 2024-04-01T19:49:49.155 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1070000000000001e-06 2024-04-01T19:49:49.155 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.155 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.155 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:49.155 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:37.027731+0000", 2024-04-01T19:49:49.156 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8080000000000004e-06 2024-04-01T19:49:49.156 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.156 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.156 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:49.156 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:37.027735+0000", 2024-04-01T19:49:49.156 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2480000000000001e-06 2024-04-01T19:49:49.156 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.156 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.156 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:49.156 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:37.031234+0000", 2024-04-01T19:49:49.156 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0034993049999999999 2024-04-01T19:49:49.156 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.156 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.156 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:49.157 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:37.031255+0000", 2024-04-01T19:49:49.157 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0852999999999998e-05 2024-04-01T19:49:49.157 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.157 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.157 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:49.157 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:37.037459+0000", 2024-04-01T19:49:49.157 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062046649999999998 2024-04-01T19:49:49.157 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.157 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.157 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:49.157 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:37.037494+0000", 2024-04-01T19:49:49.157 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4088999999999998e-05 2024-04-01T19:49:49.157 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.158 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:49.158 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.158 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.158 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.158 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:277179 6.f e546/469 6:fb70e3a7:::benchmark_data_smithi188_134454_object120438:head v 546'17205, mlcod=546'17200)", 2024-04-01T19:49:49.158 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:48:39.684319+0000", 2024-04-01T19:49:49.158 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 69.401520001999998, 2024-04-01T19:49:49.158 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011617191000000001, 2024-04-01T19:49:49.158 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:49.158 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:49.158 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:49.158 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:49.158 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.159 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:49.159 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:39.684319+0000", 2024-04-01T19:49:49.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.159 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.159 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.159 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:49.159 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:39.684319+0000", 2024-04-01T19:49:49.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.159 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.159 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.159 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:49.159 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:39.684320+0000", 2024-04-01T19:49:49.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.16e-07 2024-04-01T19:49:49.159 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.160 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.160 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:49.160 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:39.684324+0000", 2024-04-01T19:49:49.160 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7709999999999997e-06 2024-04-01T19:49:49.160 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.160 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.160 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:49.160 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:39.684331+0000", 2024-04-01T19:49:49.160 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3010000000000003e-06 2024-04-01T19:49:49.160 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.160 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:49.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:39.684335+0000", 2024-04-01T19:49:49.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.002e-06 2024-04-01T19:49:49.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:49.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:39.688113+0000", 2024-04-01T19:49:49.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0037783259999999998 2024-04-01T19:49:49.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:49.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:39.688135+0000", 2024-04-01T19:49:49.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2353000000000001e-05 2024-04-01T19:49:49.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.162 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:49.162 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:39.695906+0000", 2024-04-01T19:49:49.162 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077703690000000001 2024-04-01T19:49:49.162 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.162 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.162 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:49.162 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:39.695936+0000", 2024-04-01T19:49:49.162 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0253e-05 2024-04-01T19:49:49.162 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.162 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:49.162 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.162 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.162 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.163 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:279391 6.f e546/469 6:f59f20bf:::benchmark_data_smithi188_134454_object122650:head v 546'17343, mlcod=546'17340)", 2024-04-01T19:49:49.163 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:48:41.604123+0000", 2024-04-01T19:49:49.163 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 67.481715554999994, 2024-04-01T19:49:49.163 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010897593000000001, 2024-04-01T19:49:49.163 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:49.163 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:49.163 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:49.163 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:49.163 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.163 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:49.163 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:41.604123+0000", 2024-04-01T19:49:49.163 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.163 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.163 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.163 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:49.164 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:41.604123+0000", 2024-04-01T19:49:49.164 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.164 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.164 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.164 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:49.164 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:41.604124+0000", 2024-04-01T19:49:49.164 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7800000000000001e-07 2024-04-01T19:49:49.164 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.164 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.164 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:49.164 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:41.604128+0000", 2024-04-01T19:49:49.164 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7780000000000001e-06 2024-04-01T19:49:49.164 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.164 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.164 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:49.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:41.604132+0000", 2024-04-01T19:49:49.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6879999999999998e-06 2024-04-01T19:49:49.165 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.165 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.165 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:49.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:41.604136+0000", 2024-04-01T19:49:49.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5420000000000001e-06 2024-04-01T19:49:49.165 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.165 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.165 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:49.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:41.607669+0000", 2024-04-01T19:49:49.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0035332929999999999 2024-04-01T19:49:49.165 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.165 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.166 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:49.166 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:41.607691+0000", 2024-04-01T19:49:49.166 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1520999999999999e-05 2024-04-01T19:49:49.166 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.166 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.166 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:49.166 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:41.614998+0000", 2024-04-01T19:49:49.166 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073074730000000001 2024-04-01T19:49:49.166 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.166 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.166 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:49.166 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:41.615021+0000", 2024-04-01T19:49:49.166 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2719999999999999e-05 2024-04-01T19:49:49.167 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.167 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:49.167 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.167 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.167 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.167 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:279394 6.f e546/469 6:ff640a3a:::benchmark_data_smithi188_134454_object122653:head v 546'17344, mlcod=546'17340)", 2024-04-01T19:49:49.167 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:48:41.607808+0000", 2024-04-01T19:49:49.167 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 67.478030735999994, 2024-04-01T19:49:49.167 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010505550000000001, 2024-04-01T19:49:49.167 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:49.167 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:49.167 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:49.167 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:49.167 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.168 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:49.168 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:41.607808+0000", 2024-04-01T19:49:49.168 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.168 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.168 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.168 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:49.168 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:41.607808+0000", 2024-04-01T19:49:49.168 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.168 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.168 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.168 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:49.168 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:41.607809+0000", 2024-04-01T19:49:49.168 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0610000000000001e-06 2024-04-01T19:49:49.168 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.169 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:49.169 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:41.607815+0000", 2024-04-01T19:49:49.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2260000000000002e-06 2024-04-01T19:49:49.169 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.169 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:49.169 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:41.607825+0000", 2024-04-01T19:49:49.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3219999999999999e-06 2024-04-01T19:49:49.169 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.169 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:49.169 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:41.607830+0000", 2024-04-01T19:49:49.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.857e-06 2024-04-01T19:49:49.170 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.170 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.170 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:49.170 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:41.611230+0000", 2024-04-01T19:49:49.170 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.003399324 2024-04-01T19:49:49.170 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.170 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.170 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:49.170 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:41.611252+0000", 2024-04-01T19:49:49.170 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1832999999999999e-05 2024-04-01T19:49:49.170 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:49.171 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:41.618280+0000", 2024-04-01T19:49:49.171 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070288460000000001 2024-04-01T19:49:49.171 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:49.171 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:41.618314+0000", 2024-04-01T19:49:49.171 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3080999999999997e-05 2024-04-01T19:49:49.171 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.171 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:49.171 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.171 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.172 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:292848 6.d e548/544 6:bd3880bd:::benchmark_data_smithi188_134454_object136107:head v 548'17902, mlcod=548'17899)", 2024-04-01T19:49:49.172 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:48:53.838477+0000", 2024-04-01T19:49:49.172 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 55.247361327, 2024-04-01T19:49:49.172 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0097757720000000003, 2024-04-01T19:49:49.172 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:49.172 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:49.172 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:49.172 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:49.172 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.172 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:49.172 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:53.838477+0000", 2024-04-01T19:49:49.172 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.172 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.172 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.172 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:49.173 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:53.838477+0000", 2024-04-01T19:49:49.173 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.173 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:49.173 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:53.838478+0000", 2024-04-01T19:49:49.173 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.78e-07 2024-04-01T19:49:49.173 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:49.173 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:53.838484+0000", 2024-04-01T19:49:49.173 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.784e-06 2024-04-01T19:49:49.173 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:49.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:53.838491+0000", 2024-04-01T19:49:49.174 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4150000000000002e-06 2024-04-01T19:49:49.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.174 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:49.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:53.838499+0000", 2024-04-01T19:49:49.174 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2849999999999997e-06 2024-04-01T19:49:49.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.174 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:49.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:53.841345+0000", 2024-04-01T19:49:49.174 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0028460489999999998 2024-04-01T19:49:49.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.175 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:49.175 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:53.841360+0000", 2024-04-01T19:49:49.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5410999999999999e-05 2024-04-01T19:49:49.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.175 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:49.175 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:53.848217+0000", 2024-04-01T19:49:49.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006856661 2024-04-01T19:49:49.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.175 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:49.175 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:53.848253+0000", 2024-04-01T19:49:49.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6288999999999998e-05 2024-04-01T19:49:49.175 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.176 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:49.176 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.176 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.176 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:301534 6.f e550/469 6:f6eaf498:::benchmark_data_smithi188_134454_object144793:head v 550'18708, mlcod=550'18705)", 2024-04-01T19:49:49.176 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:49:01.411068+0000", 2024-04-01T19:49:49.176 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 47.674770838000001, 2024-04-01T19:49:49.176 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010818026999999999, 2024-04-01T19:49:49.176 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:49.176 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:49.176 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:49.176 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:49.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.176 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:49.176 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:01.411068+0000", 2024-04-01T19:49:49.176 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.177 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.177 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.177 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:49.177 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:01.411068+0000", 2024-04-01T19:49:49.177 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.177 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.177 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.177 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:49.177 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:01.411068+0000", 2024-04-01T19:49:49.177 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0100000000000005e-07 2024-04-01T19:49:49.177 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.177 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.177 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:49.177 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:01.411073+0000", 2024-04-01T19:49:49.177 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1819999999999999e-06 2024-04-01T19:49:49.178 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.178 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.178 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:49.178 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:01.411085+0000", 2024-04-01T19:49:49.178 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1973999999999999e-05 2024-04-01T19:49:49.178 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.178 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.178 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:49.178 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:01.411089+0000", 2024-04-01T19:49:49.178 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8239999999999999e-06 2024-04-01T19:49:49.178 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.178 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.178 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:49.179 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:01.414813+0000", 2024-04-01T19:49:49.179 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0037233349999999999 2024-04-01T19:49:49.179 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.179 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.179 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:49.179 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:01.414835+0000", 2024-04-01T19:49:49.179 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1886e-05 2024-04-01T19:49:49.179 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.179 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.179 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:49.179 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:01.421841+0000", 2024-04-01T19:49:49.179 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070061089999999999 2024-04-01T19:49:49.179 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.179 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.180 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:49.180 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:01.421886+0000", 2024-04-01T19:49:49.180 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5216000000000002e-05 2024-04-01T19:49:49.180 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.180 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:49.180 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.180 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.180 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.180 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:32770 7.2 e565/560 7:4a2dbc9a:::benchmark_data_smithi188_147022_object32769:head v 565'2046, mlcod=565'2043)", 2024-04-01T19:49:49.180 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:49:46.444024+0000", 2024-04-01T19:49:49.180 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 2.6418147579999998, 2024-04-01T19:49:49.180 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011592519000000001, 2024-04-01T19:49:49.180 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:49:49.180 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:49:49.180 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:49:49.181 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:49:49.181 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.181 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:49:49.181 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:46.444024+0000", 2024-04-01T19:49:49.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.181 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.181 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.181 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:49:49.181 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:46.444024+0000", 2024-04-01T19:49:49.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:49:49.181 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.181 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.181 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:49:49.181 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:46.444025+0000", 2024-04-01T19:49:49.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9999999999999997e-07 2024-04-01T19:49:49.182 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.182 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.182 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:49:49.182 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:46.444057+0000", 2024-04-01T19:49:49.182 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2619000000000001e-05 2024-04-01T19:49:49.182 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.182 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.182 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:49:49.182 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:46.444065+0000", 2024-04-01T19:49:49.182 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1130000000000001e-06 2024-04-01T19:49:49.182 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.182 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.182 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:49:49.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:46.444071+0000", 2024-04-01T19:49:49.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9159999999999998e-06 2024-04-01T19:49:49.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:49:49.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:46.445375+0000", 2024-04-01T19:49:49.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013035449999999999 2024-04-01T19:49:49.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:49:49.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:46.445393+0000", 2024-04-01T19:49:49.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8173999999999999e-05 2024-04-01T19:49:49.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:49:49.184 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:46.455562+0000", 2024-04-01T19:49:49.184 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010169186 2024-04-01T19:49:49.184 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:49:49.184 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:49:49.184 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:49:49.184 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:46.455616+0000", 2024-04-01T19:49:49.184 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4265999999999998e-05 2024-04-01T19:49:49.184 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.184 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:49.184 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.184 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:49:49.184 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:49:49.184 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:49:49.185 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:49.186 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:49:49.186 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:49:49.256 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:49:49.263 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:49 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3053326176' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:49:49.287 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:49:49.290 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:49:49.322 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:49:49.336 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:49.356 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:49:49.364 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:49:49.369 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:49 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3053326176' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:49:49.371 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:49.371 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:49:49.385 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:49:49.420 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:49:49.457 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:49:49.472 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:49:49.490 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:49:49.507 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:49 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3053326176' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:49:49.510 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:49.528 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:49:49.534 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 11 16 41960 41944 238.293 188.625 0.00266982 0.00419457 2024-04-01T19:49:49.540 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:49:49.544 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:49.544 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:49:49.563 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:49:49.595 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:49:49.595 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:49:49.595 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-01T19:49:49.595 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:49:49.595 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:49:49.595 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:49:49.595 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:49:49.595 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:49:49.596 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:49:49.596 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:49:49.596 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:49:49.596 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:49:49.596 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:49:49.646 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:49:49.685 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:49.893 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:49:49.897 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:49.898 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:49:49.903 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_ops_in_flight 2024-04-01T19:49:49.998 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:49:50.043 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:50.317 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:49:50.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:50 smithi022 ceph-mon[39439]: pgmap v1554: 17 pgs: 17 active+clean; 2.0 GiB data, 8.3 GiB used, 975 GiB / 983 GiB avail; 201 MiB/s wr, 3.22k op/s 2024-04-01T19:49:50.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.534 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 12 16 44856 44840 233.517 181 0.0055983 0.00428074 2024-04-01T19:49:50.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:50 smithi188 ceph-mon[43939]: pgmap v1554: 17 pgs: 17 active+clean; 2.0 GiB data, 8.3 GiB used, 975 GiB / 983 GiB avail; 201 MiB/s wr, 3.22k op/s 2024-04-01T19:49:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.705 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:49:50.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:50 smithi062 ceph-mon[44211]: pgmap v1554: 17 pgs: 17 active+clean; 2.0 GiB data, 8.3 GiB used, 975 GiB / 983 GiB avail; 201 MiB/s wr, 3.22k op/s 2024-04-01T19:49:50.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:49:50.915 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:49:51.048 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:51.049 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:49:51.150 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:49:51.191 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:51.341 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:51 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:49:51.341 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:51 smithi022 ceph-mon[39439]: pgmap v1555: 17 pgs: 17 active+clean; 2.6 GiB data, 9.3 GiB used, 974 GiB / 983 GiB avail; 216 MiB/s wr, 3.46k op/s 2024-04-01T19:49:51.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:51 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:49:51.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:51 smithi188 ceph-mon[43939]: pgmap v1555: 17 pgs: 17 active+clean; 2.6 GiB data, 9.3 GiB used, 974 GiB / 983 GiB avail; 216 MiB/s wr, 3.46k op/s 2024-04-01T19:49:51.466 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:49:51.476 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:51.476 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:49:51.514 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:49:51.515 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:49:51.534 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 13 16 47197 47181 226.809 146.312 0.00387483 0.00440639 2024-04-01T19:49:51.550 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:49:51.578 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:49:51.652 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:51.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:51 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:49:51.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:51 smithi062 ceph-mon[44211]: pgmap v1555: 17 pgs: 17 active+clean; 2.6 GiB data, 9.3 GiB used, 974 GiB / 983 GiB avail; 216 MiB/s wr, 3.46k op/s 2024-04-01T19:49:51.828 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:49:51.842 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:51.843 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:49:51.944 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:49:51.989 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:52.135 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:49:52.138 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:52.139 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:49:52.239 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:49:52.284 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:52.534 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 14 16 49846 49830 222.433 165.562 0.00401495 0.00449394 2024-04-01T19:49:52.537 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:49:52.544 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:52.545 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:49:52.646 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:49:52.683 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:52.713 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:49:52.716 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:52.717 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:49:52.818 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:49:52.865 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:52.900 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:49:52.900 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:49:53.226 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:49:53.229 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:53.229 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:49:53.330 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:49:53.378 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:53.436 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:49:53.443 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:53.444 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:49:53.516 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:49:53.534 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 15 16 52455 52439 218.474 163.062 0.00326277 0.00457448 2024-04-01T19:49:53.545 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:49:53.579 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:53.606 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:49:53.611 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:53.611 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:49:53.698 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_blocked_ops 2024-04-01T19:49:53.712 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:49:53.744 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:53.772 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:49:53.776 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:53.776 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:49:53.877 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:49:53.913 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:53.940 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:49:53.946 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:53.947 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:49:54.048 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:49:54.076 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:49:54.093 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:54.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:54 smithi022 ceph-mon[39439]: pgmap v1556: 17 pgs: 17 active+clean; 2.7 GiB data, 9.8 GiB used, 974 GiB / 983 GiB avail; 194 MiB/s wr, 3.10k op/s 2024-04-01T19:49:54.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:54 smithi062 ceph-mon[44211]: pgmap v1556: 17 pgs: 17 active+clean; 2.7 GiB data, 9.8 GiB used, 974 GiB / 983 GiB avail; 194 MiB/s wr, 3.10k op/s 2024-04-01T19:49:54.534 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 16 16 54935 54919 214.507 155 0.00777347 0.00466031 2024-04-01T19:49:54.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:54 smithi188 ceph-mon[43939]: pgmap v1556: 17 pgs: 17 active+clean; 2.7 GiB data, 9.8 GiB used, 974 GiB / 983 GiB avail; 194 MiB/s wr, 3.10k op/s 2024-04-01T19:49:55.100 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:49:55.102 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:55.102 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:49:55.203 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:49:55.249 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:55.284 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:49:55.287 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:49:55.294 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:55.295 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:49:55.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:55 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3713751976' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:49:55.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:55 smithi022 ceph-mon[39439]: from='client.36686 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:49:55.396 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:49:55.434 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:55.459 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:49:55.464 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:55.464 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:49:55.520 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:55 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3713751976' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:49:55.520 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:55 smithi188 ceph-mon[43939]: from='client.36686 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:49:55.534 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 17 16 57385 57369 210.895 153.125 0.00251116 0.00473886 2024-04-01T19:49:55.565 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:49:55.610 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:55.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:55 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3713751976' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:49:55.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:55 smithi062 ceph-mon[44211]: from='client.36686 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:49:55.881 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:49:55.888 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:55.888 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:49:55.989 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:49:56.030 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:56.060 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:49:56.063 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:56.064 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:49:56.165 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:49:56.194 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:56.216 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:49:56.220 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:56.220 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:49:56.321 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:49:56.367 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:56.435 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:49:56.435 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:49:56.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:56 smithi062 ceph-mon[44211]: pgmap v1557: 17 pgs: 17 active+clean; 2.8 GiB data, 10 GiB used, 973 GiB / 983 GiB avail; 184 MiB/s wr, 2.95k op/s 2024-04-01T19:49:56.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:56 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:49:56.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:56 smithi062 ceph-mon[44211]: from='client.36686 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:49:56.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:56 smithi062 ceph-mon[44211]: osdmap e566: 12 total, 11 up, 11 in 2024-04-01T19:49:56.534 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 18 16 59548 59532 206.689 135.188 0.00560389 0.00483649 2024-04-01T19:49:56.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:56 smithi022 ceph-mon[39439]: pgmap v1557: 17 pgs: 17 active+clean; 2.8 GiB data, 10 GiB used, 973 GiB / 983 GiB avail; 184 MiB/s wr, 2.95k op/s 2024-04-01T19:49:56.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:56 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:49:56.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:56 smithi022 ceph-mon[39439]: from='client.36686 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:49:56.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:56 smithi022 ceph-mon[39439]: osdmap e566: 12 total, 11 up, 11 in 2024-04-01T19:49:56.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:56 smithi188 ceph-mon[43939]: pgmap v1557: 17 pgs: 17 active+clean; 2.8 GiB data, 10 GiB used, 973 GiB / 983 GiB avail; 184 MiB/s wr, 2.95k op/s 2024-04-01T19:49:56.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:56 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:49:56.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:56 smithi188 ceph-mon[43939]: from='client.36686 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:49:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:56 smithi188 ceph-mon[43939]: osdmap e566: 12 total, 11 up, 11 in 2024-04-01T19:49:57.235 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:49:57.240 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:57.240 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:49:57.241 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:49:57.342 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:49:57.383 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:57.536 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 19 16 61915 61899 203.585 147.938 0.00320689 0.00490986 2024-04-01T19:49:57.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:49:57 smithi022 ceph-mon[39439]: pgmap v1559: 17 pgs: 17 active+clean; 3.5 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 170 MiB/s wr, 2.71k op/s 2024-04-01T19:49:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:49:57 smithi188 ceph-mon[43939]: pgmap v1559: 17 pgs: 17 active+clean; 3.5 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 170 MiB/s wr, 2.71k op/s 2024-04-01T19:49:57.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:49:57 smithi062 ceph-mon[44211]: pgmap v1559: 17 pgs: 17 active+clean; 3.5 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 170 MiB/s wr, 2.71k op/s 2024-04-01T19:49:58.536 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:49:58.539442 min lat: 0.00105017 max lat: 0.205704 avg lat: 0.00497671 2024-04-01T19:49:58.536 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:49:58.536 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 20 16 64303 64287 200.868 149.25 0.00523126 0.00497671 2024-04-01T19:49:58.742 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:49:58.744 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:58.745 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:49:58.846 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:49:58.885 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:58.922 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:49:58.928 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:58.928 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:49:59.029 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:49:59.070 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:59.204 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:49:59.207 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:59.207 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:49:59.237 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_historic_ops 2024-04-01T19:49:59.308 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:49:59.347 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:59.373 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:49:59.378 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:59.378 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:49:59.479 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:49:59.522 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:59.536 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 21 16 66220 66204 197.008 119.812 0.00552923 0.00507435 2024-04-01T19:49:59.555 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:49:59.558 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:59.559 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:49:59.660 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:49:59.667 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:49:59.695 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:59.722 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:49:59.726 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:59.726 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:49:59.819 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:49:59.827 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:49:59.861 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:49:59.889 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:49:59.892 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:49:59.893 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:49:59.994 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:50:00.030 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:00.064 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:50:00.068 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:00.069 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:50:00.170 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:50:00.205 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:00.214 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:50:00.227 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:50:00.231 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:00.231 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:50:00.275 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:50:00.301 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:50:00.312 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:50:00.332 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:50:00.346 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:50:00.367 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:00.382 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:50:00.407 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:50:00.442 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:50:00.483 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:50:00.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:00 smithi062 ceph-mon[44211]: pgmap v1560: 17 pgs: 17 active+clean; 3.6 GiB data, 12 GiB used, 972 GiB / 983 GiB avail; 167 MiB/s wr, 2.67k op/s 2024-04-01T19:50:00.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:00 smithi062 ceph-mon[44211]: overall HEALTH_WARN noscrub flag(s) set 2024-04-01T19:50:00.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:00 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4017609847' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:50:00.517 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:50:00.536 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 22 16 68141 68125 193.51 120.062 0.00737144 0.00516591 2024-04-01T19:50:00.553 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:50:00.596 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:50:00.596 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:50:00.596 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-01T19:50:00.596 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:50:00.596 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:50:00.596 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:50:00.596 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:50:00.596 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:50:00.596 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:50:00.597 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:50:00.597 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:50:00.597 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:50:00.597 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:50:00.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:00 smithi022 ceph-mon[39439]: pgmap v1560: 17 pgs: 17 active+clean; 3.6 GiB data, 12 GiB used, 972 GiB / 983 GiB avail; 167 MiB/s wr, 2.67k op/s 2024-04-01T19:50:00.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:00 smithi022 ceph-mon[39439]: overall HEALTH_WARN noscrub flag(s) set 2024-04-01T19:50:00.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:00 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4017609847' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:50:00.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:00 smithi188 ceph-mon[43939]: pgmap v1560: 17 pgs: 17 active+clean; 3.6 GiB data, 12 GiB used, 972 GiB / 983 GiB avail; 167 MiB/s wr, 2.67k op/s 2024-04-01T19:50:00.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:00 smithi188 ceph-mon[43939]: overall HEALTH_WARN noscrub flag(s) set 2024-04-01T19:50:00.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:00 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4017609847' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:50:00.625 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:50:00.631 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:00.631 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:50:00.732 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:50:00.774 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:01.129 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:50:01.131 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:01.131 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:50:01.232 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:50:01.264 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:01.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.536 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 23 15 70231 70216 190.778 130.688 0.00518562 0.00524023 2024-04-01T19:50:01.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:01.734 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:50:01.740 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:01.740 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:50:01.842 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:50:01.887 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:01.906 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:50:01.906 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:50:01.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:50:01.906 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:50:01.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.906 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:116729 5.8 5:1c4d4d2d:::benchmark_data_smithi188_119427_object116728:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e389)", 2024-04-01T19:50:01.906 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:40:23.819558+0000", 2024-04-01T19:50:01.906 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 578.08599338600004, 2024-04-01T19:50:01.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.10192927, 2024-04-01T19:50:01.907 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:01.907 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:01.907 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:01.907 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:01.907 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:50:01.907 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:50:01.907 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 116729 2024-04-01T19:50:01.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.907 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:01.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:01.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.819558+0000", 2024-04-01T19:50:01.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:01.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.819558+0000", 2024-04-01T19:50:01.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:01.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.819560+0000", 2024-04-01T19:50:01.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7829999999999999e-06 2024-04-01T19:50:01.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:01.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.819594+0000", 2024-04-01T19:50:01.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3389000000000002e-05 2024-04-01T19:50:01.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:01.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835009+0000", 2024-04-01T19:50:01.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015415263 2024-04-01T19:50:01.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:01.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835021+0000", 2024-04-01T19:50:01.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2184999999999999e-05 2024-04-01T19:50:01.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:01.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.838708+0000", 2024-04-01T19:50:01.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036866720000000002 2024-04-01T19:50:01.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:01.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.838836+0000", 2024-04-01T19:50:01.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012849399999999999 2024-04-01T19:50:01.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:50:01.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.838930+0000", 2024-04-01T19:50:01.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3524999999999996e-05 2024-04-01T19:50:01.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:01.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.853237+0000", 2024-04-01T19:50:01.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014307507000000001 2024-04-01T19:50:01.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:01.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.921392+0000", 2024-04-01T19:50:01.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.068154369000000006 2024-04-01T19:50:01.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:01.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.921444+0000", 2024-04-01T19:50:01.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2904e-05 2024-04-01T19:50:01.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:01.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.921488+0000", 2024-04-01T19:50:01.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3179000000000001e-05 2024-04-01T19:50:01.912 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.912 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:01.912 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.912 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:116747 5.8 5:1d80d94e:::benchmark_data_smithi188_119427_object116746:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e389)", 2024-04-01T19:50:01.912 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:40:23.835174+0000", 2024-04-01T19:50:01.913 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 578.07037746599997, 2024-04-01T19:50:01.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.090182354000000006, 2024-04-01T19:50:01.913 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:01.913 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:01.913 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:01.913 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:01.913 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:50:01.913 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:50:01.913 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 116747 2024-04-01T19:50:01.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.913 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:01.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:01.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835174+0000", 2024-04-01T19:50:01.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:01.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835174+0000", 2024-04-01T19:50:01.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:01.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835175+0000", 2024-04-01T19:50:01.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3200000000000004e-07 2024-04-01T19:50:01.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:01.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835198+0000", 2024-04-01T19:50:01.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2858e-05 2024-04-01T19:50:01.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:01.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835204+0000", 2024-04-01T19:50:01.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9009999999999999e-06 2024-04-01T19:50:01.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:01.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835209+0000", 2024-04-01T19:50:01.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0359999999999997e-06 2024-04-01T19:50:01.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:01.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.848849+0000", 2024-04-01T19:50:01.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013640462000000001 2024-04-01T19:50:01.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:01.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.848965+0000", 2024-04-01T19:50:01.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011550200000000001 2024-04-01T19:50:01.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:50:01.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.849058+0000", 2024-04-01T19:50:01.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3420999999999999e-05 2024-04-01T19:50:01.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:01.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.853248+0000", 2024-04-01T19:50:01.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0041897749999999997 2024-04-01T19:50:01.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:01.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.925253+0000", 2024-04-01T19:50:01.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.072004519000000003 2024-04-01T19:50:01.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:01.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.925309+0000", 2024-04-01T19:50:01.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6609e-05 2024-04-01T19:50:01.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:01.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.925357+0000", 2024-04-01T19:50:01.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7438999999999998e-05 2024-04-01T19:50:01.918 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.918 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:01.918 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.918 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:116748 5.8 5:1beff7ec:::benchmark_data_smithi188_119427_object116747:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e389)", 2024-04-01T19:50:01.918 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:40:23.835216+0000", 2024-04-01T19:50:01.918 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 578.07033596899998, 2024-04-01T19:50:01.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.090258440999999995, 2024-04-01T19:50:01.919 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:01.919 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:01.919 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:01.919 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:01.919 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:50:01.919 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:50:01.919 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 116748 2024-04-01T19:50:01.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.919 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:01.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:01.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835216+0000", 2024-04-01T19:50:01.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:01.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835216+0000", 2024-04-01T19:50:01.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:01.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835216+0000", 2024-04-01T19:50:01.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8400000000000004e-07 2024-04-01T19:50:01.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:01.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835241+0000", 2024-04-01T19:50:01.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4647999999999998e-05 2024-04-01T19:50:01.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:01.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835248+0000", 2024-04-01T19:50:01.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4989999999999999e-06 2024-04-01T19:50:01.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:01.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.835253+0000", 2024-04-01T19:50:01.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6420000000000004e-06 2024-04-01T19:50:01.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:01.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.851232+0000", 2024-04-01T19:50:01.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015978414999999999 2024-04-01T19:50:01.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:01.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.851306+0000", 2024-04-01T19:50:01.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4301999999999994e-05 2024-04-01T19:50:01.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:50:01.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.851397+0000", 2024-04-01T19:50:01.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0879999999999997e-05 2024-04-01T19:50:01.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:01.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.855437+0000", 2024-04-01T19:50:01.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040398450000000002 2024-04-01T19:50:01.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:01.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.925395+0000", 2024-04-01T19:50:01.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.069958713000000006 2024-04-01T19:50:01.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:01.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.925436+0000", 2024-04-01T19:50:01.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1028000000000001e-05 2024-04-01T19:50:01.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:01.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:23.925474+0000", 2024-04-01T19:50:01.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7784999999999998e-05 2024-04-01T19:50:01.924 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.924 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:01.924 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.924 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:120827 5.8 5:1550fc16:::benchmark_data_smithi188_119427_object120826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e389)", 2024-04-01T19:50:01.924 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:40:26.691921+0000", 2024-04-01T19:50:01.925 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 575.21363071600001, 2024-04-01T19:50:01.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.087931033000000006, 2024-04-01T19:50:01.925 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:01.925 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:01.925 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:01.925 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:01.925 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:50:01.925 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:50:01.925 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 120827 2024-04-01T19:50:01.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.925 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:01.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:01.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.691921+0000", 2024-04-01T19:50:01.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:01.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.691921+0000", 2024-04-01T19:50:01.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:01.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.691922+0000", 2024-04-01T19:50:01.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3829999999999999e-06 2024-04-01T19:50:01.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:01.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.691946+0000", 2024-04-01T19:50:01.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3646999999999999e-05 2024-04-01T19:50:01.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:01.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.691961+0000", 2024-04-01T19:50:01.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4664999999999999e-05 2024-04-01T19:50:01.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:01.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.691967+0000", 2024-04-01T19:50:01.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3729999999999998e-06 2024-04-01T19:50:01.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:01.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.692025+0000", 2024-04-01T19:50:01.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8233999999999998e-05 2024-04-01T19:50:01.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:01.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.692153+0000", 2024-04-01T19:50:01.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012784499999999999 2024-04-01T19:50:01.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:50:01.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.692284+0000", 2024-04-01T19:50:01.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013041100000000001 2024-04-01T19:50:01.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:01.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.695616+0000", 2024-04-01T19:50:01.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0033320450000000001 2024-04-01T19:50:01.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:01.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.779778+0000", 2024-04-01T19:50:01.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.084162429999999996 2024-04-01T19:50:01.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:01.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.779810+0000", 2024-04-01T19:50:01.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2104000000000003e-05 2024-04-01T19:50:01.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:01.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:40:26.779852+0000", 2024-04-01T19:50:01.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1896e-05 2024-04-01T19:50:01.930 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.930 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:01.930 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.930 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:238402 5.d 5:b3830024:::benchmark_data_smithi188_119427_object73703:head [delete] snapc 0=[] ondisk+write+known_if_redirected e438)", 2024-04-01T19:50:01.930 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:42:47.431109+0000", 2024-04-01T19:50:01.930 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 434.47444307299997, 2024-04-01T19:50:01.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.10615174199999999, 2024-04-01T19:50:01.931 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:01.931 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:01.931 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:01.931 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:01.931 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:50:01.931 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:50:01.931 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 238402 2024-04-01T19:50:01.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.931 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:01.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:01.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431109+0000", 2024-04-01T19:50:01.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:01.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431109+0000", 2024-04-01T19:50:01.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:01.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431110+0000", 2024-04-01T19:50:01.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9800000000000002e-07 2024-04-01T19:50:01.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:01.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431113+0000", 2024-04-01T19:50:01.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.675e-06 2024-04-01T19:50:01.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:01.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431122+0000", 2024-04-01T19:50:01.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6540000000000005e-06 2024-04-01T19:50:01.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:01.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431128+0000", 2024-04-01T19:50:01.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7239999999999997e-06 2024-04-01T19:50:01.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:01.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431182+0000", 2024-04-01T19:50:01.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4440000000000001e-05 2024-04-01T19:50:01.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:01.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431312+0000", 2024-04-01T19:50:01.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013003900000000001 2024-04-01T19:50:01.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 5", 2024-04-01T19:50:01.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.431448+0000", 2024-04-01T19:50:01.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000136203 2024-04-01T19:50:01.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:01.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.435486+0000", 2024-04-01T19:50:01.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040374959999999998 2024-04-01T19:50:01.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:01.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.537169+0000", 2024-04-01T19:50:01.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.101683517 2024-04-01T19:50:01.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:01.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.537205+0000", 2024-04-01T19:50:01.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5367999999999997e-05 2024-04-01T19:50:01.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:01.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:42:47.537260+0000", 2024-04-01T19:50:01.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5627999999999997e-05 2024-04-01T19:50:01.936 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.936 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:01.936 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.936 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.25864.0:279781 5.8 5:1435bdde:::benchmark_data_smithi188_119427_object115082:head [delete] snapc 0=[] ondisk+write+known_if_redirected e445)", 2024-04-01T19:50:01.936 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:43:27.311434+0000", 2024-04-01T19:50:01.936 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 394.59411802099999, 2024-04-01T19:50:01.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.087482134000000003, 2024-04-01T19:50:01.937 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:01.937 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:01.937 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:01.937 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:01.937 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.25864", 2024-04-01T19:50:01.937 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/729428660", 2024-04-01T19:50:01.937 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 279781 2024-04-01T19:50:01.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.937 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:01.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:01.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.311434+0000", 2024-04-01T19:50:01.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:01.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.311434+0000", 2024-04-01T19:50:01.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:01.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.311436+0000", 2024-04-01T19:50:01.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3240000000000001e-06 2024-04-01T19:50:01.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:01.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.311441+0000", 2024-04-01T19:50:01.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2000000000000002e-06 2024-04-01T19:50:01.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:01.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.311451+0000", 2024-04-01T19:50:01.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9000000000000001e-06 2024-04-01T19:50:01.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:01.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.311459+0000", 2024-04-01T19:50:01.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0919999999999998e-06 2024-04-01T19:50:01.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:01.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.311520+0000", 2024-04-01T19:50:01.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0652999999999997e-05 2024-04-01T19:50:01.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:01.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.311617+0000", 2024-04-01T19:50:01.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7138000000000004e-05 2024-04-01T19:50:01.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-01T19:50:01.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.312271+0000", 2024-04-01T19:50:01.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00065370999999999995 2024-04-01T19:50:01.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:01.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.319528+0000", 2024-04-01T19:50:01.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072574969999999999 2024-04-01T19:50:01.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:01.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.398857+0000", 2024-04-01T19:50:01.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.079329203000000001 2024-04-01T19:50:01.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:01.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.398889+0000", 2024-04-01T19:50:01.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1189000000000002e-05 2024-04-01T19:50:01.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:01.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:43:27.398916+0000", 2024-04-01T19:50:01.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7228000000000001e-05 2024-04-01T19:50:01.942 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.942 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:01.942 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.942 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:200642 6.8 e517/469 6:1d85e8f5:::benchmark_data_smithi188_134454_object43901:head v 517'12540, mlcod=517'12538)", 2024-04-01T19:50:01.942 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:03.694991+0000", 2024-04-01T19:50:01.943 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 178.21056088899999, 2024-04-01T19:50:01.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014044119000000001, 2024-04-01T19:50:01.943 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:01.943 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:01.943 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:01.943 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:01.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:01.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.694991+0000", 2024-04-01T19:50:01.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:01.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.694991+0000", 2024-04-01T19:50:01.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:01.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.694993+0000", 2024-04-01T19:50:01.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0499999999999999e-06 2024-04-01T19:50:01.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:01.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.695004+0000", 2024-04-01T19:50:01.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1413000000000001e-05 2024-04-01T19:50:01.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:01.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.695021+0000", 2024-04-01T19:50:01.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6809000000000001e-05 2024-04-01T19:50:01.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.945 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:01.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.695031+0000", 2024-04-01T19:50:01.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7000000000000003e-06 2024-04-01T19:50:01.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.945 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:01.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.695094+0000", 2024-04-01T19:50:01.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3538000000000001e-05 2024-04-01T19:50:01.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:01.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.695118+0000", 2024-04-01T19:50:01.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3847999999999999e-05 2024-04-01T19:50:01.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:01.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.708993+0000", 2024-04-01T19:50:01.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013874552 2024-04-01T19:50:01.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:01.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.709035+0000", 2024-04-01T19:50:01.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2209000000000002e-05 2024-04-01T19:50:01.946 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.947 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:01.947 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.947 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:200643 6.8 e517/469 6:17d11974:::benchmark_data_smithi188_134454_object43902:head v 517'12541, mlcod=517'12538)", 2024-04-01T19:50:01.947 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:03.695580+0000", 2024-04-01T19:50:01.947 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 178.209971626, 2024-04-01T19:50:01.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013494406, 2024-04-01T19:50:01.947 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:01.947 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:01.947 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:01.947 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:01.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:01.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.695580+0000", 2024-04-01T19:50:01.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:01.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.695580+0000", 2024-04-01T19:50:01.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:01.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.695581+0000", 2024-04-01T19:50:01.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.206e-06 2024-04-01T19:50:01.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:01.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.695588+0000", 2024-04-01T19:50:01.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8329999999999996e-06 2024-04-01T19:50:01.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:01.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.695599+0000", 2024-04-01T19:50:01.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0949e-05 2024-04-01T19:50:01.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:01.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.695606+0000", 2024-04-01T19:50:01.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9999999999999999e-06 2024-04-01T19:50:01.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:01.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.699787+0000", 2024-04-01T19:50:01.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0041810409999999999 2024-04-01T19:50:01.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:01.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.699812+0000", 2024-04-01T19:50:01.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4719000000000002e-05 2024-04-01T19:50:01.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:01.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.709044+0000", 2024-04-01T19:50:01.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0092318899999999995 2024-04-01T19:50:01.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:01.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.709075+0000", 2024-04-01T19:50:01.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0768000000000001e-05 2024-04-01T19:50:01.951 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.951 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:01.951 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.952 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:222140 6.8 e522/469 6:1ba18fd3:::benchmark_data_smithi188_134454_object65399:head v 522'13852, mlcod=522'13849)", 2024-04-01T19:50:01.952 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:23.213104+0000", 2024-04-01T19:50:01.952 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 158.69244790499999, 2024-04-01T19:50:01.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015606114000000001, 2024-04-01T19:50:01.952 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:01.952 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:01.952 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:01.952 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:01.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:01.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.213104+0000", 2024-04-01T19:50:01.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:01.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.213104+0000", 2024-04-01T19:50:01.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:01.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.213105+0000", 2024-04-01T19:50:01.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6360000000000001e-06 2024-04-01T19:50:01.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:01.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.213113+0000", 2024-04-01T19:50:01.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2609999999999996e-06 2024-04-01T19:50:01.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:01.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.213123+0000", 2024-04-01T19:50:01.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0716e-05 2024-04-01T19:50:01.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:01.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.213130+0000", 2024-04-01T19:50:01.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2759999999999997e-06 2024-04-01T19:50:01.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:01.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.213212+0000", 2024-04-01T19:50:01.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2633000000000007e-05 2024-04-01T19:50:01.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:01.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.213232+0000", 2024-04-01T19:50:01.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9474e-05 2024-04-01T19:50:01.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:01.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.228671+0000", 2024-04-01T19:50:01.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015439279 2024-04-01T19:50:01.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:01.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.228710+0000", 2024-04-01T19:50:01.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8838999999999999e-05 2024-04-01T19:50:01.956 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.956 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:01.956 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.956 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:222145 6.8 e522/469 6:1b9abc86:::benchmark_data_smithi188_134454_object65404:head v 522'13853, mlcod=522'13849)", 2024-04-01T19:50:01.956 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:23.213147+0000", 2024-04-01T19:50:01.956 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 158.692405049, 2024-04-01T19:50:01.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.01558553, 2024-04-01T19:50:01.956 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:01.957 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:01.957 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:01.957 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:01.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:01.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.213147+0000", 2024-04-01T19:50:01.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:01.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.213147+0000", 2024-04-01T19:50:01.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:01.958 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.213147+0000", 2024-04-01T19:50:01.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.82e-07 2024-04-01T19:50:01.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:01.958 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.213152+0000", 2024-04-01T19:50:01.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.673e-06 2024-04-01T19:50:01.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:01.958 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.213180+0000", 2024-04-01T19:50:01.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8384000000000001e-05 2024-04-01T19:50:01.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:01.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.213187+0000", 2024-04-01T19:50:01.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2040000000000002e-06 2024-04-01T19:50:01.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:01.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.216712+0000", 2024-04-01T19:50:01.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.003525144 2024-04-01T19:50:01.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:01.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.216723+0000", 2024-04-01T19:50:01.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1489e-05 2024-04-01T19:50:01.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:01.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.228712+0000", 2024-04-01T19:50:01.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011989313999999999 2024-04-01T19:50:01.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:01.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.228732+0000", 2024-04-01T19:50:01.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9740000000000001e-05 2024-04-01T19:50:01.960 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.960 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:01.960 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.961 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:222147 6.8 e522/469 6:131c6e1e:::benchmark_data_smithi188_134454_object65406:head v 522'13854, mlcod=522'13850)", 2024-04-01T19:50:01.961 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:23.213420+0000", 2024-04-01T19:50:01.961 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 158.69213154299999, 2024-04-01T19:50:01.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015328982, 2024-04-01T19:50:01.961 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:01.961 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:01.961 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:01.961 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:01.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:01.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.213420+0000", 2024-04-01T19:50:01.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:01.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.213420+0000", 2024-04-01T19:50:01.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:01.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.213421+0000", 2024-04-01T19:50:01.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8400000000000004e-07 2024-04-01T19:50:01.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:01.963 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.213424+0000", 2024-04-01T19:50:01.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.551e-06 2024-04-01T19:50:01.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.963 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:01.963 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.213431+0000", 2024-04-01T19:50:01.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8240000000000002e-06 2024-04-01T19:50:01.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.963 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:01.963 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.213435+0000", 2024-04-01T19:50:01.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6569999999999999e-06 2024-04-01T19:50:01.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:01.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.219831+0000", 2024-04-01T19:50:01.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063962130000000004 2024-04-01T19:50:01.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:01.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.219853+0000", 2024-04-01T19:50:01.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2002e-05 2024-04-01T19:50:01.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:01.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.228735+0000", 2024-04-01T19:50:01.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0088821079999999997 2024-04-01T19:50:01.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.965 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:01.965 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:23.228749+0000", 2024-04-01T19:50:01.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4042999999999999e-05 2024-04-01T19:50:01.965 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.965 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:01.965 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.965 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:272995 6.8 e546/469 6:1aae8259:::benchmark_data_smithi188_134454_object116254:head v 546'17025, mlcod=546'17023)", 2024-04-01T19:50:01.965 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:48:36.117499+0000", 2024-04-01T19:50:01.965 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.788052445999995, 2024-04-01T19:50:01.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014953147, 2024-04-01T19:50:01.965 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:01.966 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:01.966 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:01.966 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:01.966 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:01.966 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.117499+0000", 2024-04-01T19:50:01.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.966 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:01.966 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.117499+0000", 2024-04-01T19:50:01.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.967 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:01.967 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.117502+0000", 2024-04-01T19:50:01.967 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2330000000000001e-06 2024-04-01T19:50:01.967 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.967 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:01.967 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.117512+0000", 2024-04-01T19:50:01.967 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0302000000000001e-05 2024-04-01T19:50:01.967 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.967 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:01.967 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.117525+0000", 2024-04-01T19:50:01.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3298999999999999e-05 2024-04-01T19:50:01.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.968 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:01.968 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.117533+0000", 2024-04-01T19:50:01.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5549999999999997e-06 2024-04-01T19:50:01.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.968 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:01.968 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.117591+0000", 2024-04-01T19:50:01.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8201000000000001e-05 2024-04-01T19:50:01.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.968 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:01.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.117613+0000", 2024-04-01T19:50:01.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1758000000000001e-05 2024-04-01T19:50:01.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.969 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:01.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.132424+0000", 2024-04-01T19:50:01.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014810858 2024-04-01T19:50:01.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.969 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:01.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.132452+0000", 2024-04-01T19:50:01.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8941e-05 2024-04-01T19:50:01.969 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.969 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:01.970 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.970 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:273003 6.8 e546/469 6:15c44ea8:::benchmark_data_smithi188_134454_object116262:head v 546'17026, mlcod=546'17023)", 2024-04-01T19:50:01.970 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:48:36.118813+0000", 2024-04-01T19:50:01.970 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.786738995999997, 2024-04-01T19:50:01.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013671744, 2024-04-01T19:50:01.970 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:01.970 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:01.970 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:01.970 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:01.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:01.971 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.118813+0000", 2024-04-01T19:50:01.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.971 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:01.971 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.118813+0000", 2024-04-01T19:50:01.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.971 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:01.971 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.118814+0000", 2024-04-01T19:50:01.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8000000000000004e-07 2024-04-01T19:50:01.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:01.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.118819+0000", 2024-04-01T19:50:01.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3709999999999999e-06 2024-04-01T19:50:01.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.972 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:01.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.118827+0000", 2024-04-01T19:50:01.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7340000000000008e-06 2024-04-01T19:50:01.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.972 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:01.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.118831+0000", 2024-04-01T19:50:01.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5029999999999999e-06 2024-04-01T19:50:01.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.973 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.973 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:01.973 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.122005+0000", 2024-04-01T19:50:01.973 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031740480000000001 2024-04-01T19:50:01.973 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.973 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.973 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:01.973 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.122030+0000", 2024-04-01T19:50:01.973 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4445000000000001e-05 2024-04-01T19:50:01.973 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.973 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.973 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:01.973 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.132455+0000", 2024-04-01T19:50:01.973 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010425459 2024-04-01T19:50:01.973 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.974 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.974 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:01.974 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:36.132484+0000", 2024-04-01T19:50:01.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9303999999999999e-05 2024-04-01T19:50:01.974 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.974 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:01.974 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.974 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.974 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.974 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26287.0:299982 6.8 e549/469 6:13d7fc8e:::benchmark_data_smithi188_134454_object143241:head v 549'18754, mlcod=549'18751)", 2024-04-01T19:50:01.974 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:49:00.010890+0000", 2024-04-01T19:50:01.974 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 61.894661939999999, 2024-04-01T19:50:01.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013574035999999999, 2024-04-01T19:50:01.974 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:01.975 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:01.975 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:01.975 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:01.975 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.975 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:01.975 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:00.010890+0000", 2024-04-01T19:50:01.975 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.975 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.975 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.975 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:01.975 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:00.010890+0000", 2024-04-01T19:50:01.975 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.975 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.975 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.975 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:01.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:00.010892+0000", 2024-04-01T19:50:01.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5720000000000001e-06 2024-04-01T19:50:01.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.976 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:01.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:00.010905+0000", 2024-04-01T19:50:01.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2666999999999999e-05 2024-04-01T19:50:01.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.976 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:01.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:00.010924+0000", 2024-04-01T19:50:01.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9148e-05 2024-04-01T19:50:01.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:01.977 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:00.010934+0000", 2024-04-01T19:50:01.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.6889999999999999e-06 2024-04-01T19:50:01.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:01.977 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:00.012191+0000", 2024-04-01T19:50:01.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001257333 2024-04-01T19:50:01.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:01.977 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:00.012214+0000", 2024-04-01T19:50:01.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.27e-05 2024-04-01T19:50:01.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.978 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.978 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:01.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:00.024422+0000", 2024-04-01T19:50:01.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012207661999999999 2024-04-01T19:50:01.978 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.978 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.978 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:01.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:00.024464+0000", 2024-04-01T19:50:01.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2265000000000003e-05 2024-04-01T19:50:01.978 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.978 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:01.978 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.978 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.979 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.979 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:35554 7.5 7:a3d44901:::benchmark_data_smithi188_147022_object35553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:50:01.979 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:49:47.369197+0000", 2024-04-01T19:50:01.979 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 14.536354843, 2024-04-01T19:50:01.979 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013400359000000001, 2024-04-01T19:50:01.979 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:01.979 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:01.979 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:01.979 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:01.979 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:50:01.979 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:01.979 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 35554 2024-04-01T19:50:01.979 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.980 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:01.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:01.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:47.369197+0000", 2024-04-01T19:50:01.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:01.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:47.369197+0000", 2024-04-01T19:50:01.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:01.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:47.369198+0000", 2024-04-01T19:50:01.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2020000000000001e-06 2024-04-01T19:50:01.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:01.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:47.369243+0000", 2024-04-01T19:50:01.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5232999999999999e-05 2024-04-01T19:50:01.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:01.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:47.369253+0000", 2024-04-01T19:50:01.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7659999999999993e-06 2024-04-01T19:50:01.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.982 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.982 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:01.982 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:47.369260+0000", 2024-04-01T19:50:01.982 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9759999999999998e-06 2024-04-01T19:50:01.982 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.982 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.982 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:01.982 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:47.370884+0000", 2024-04-01T19:50:01.982 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0016243970000000001 2024-04-01T19:50:01.982 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.982 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.982 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:01.982 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:47.370999+0000", 2024-04-01T19:50:01.983 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000114826 2024-04-01T19:50:01.983 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.983 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:01.983 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:47.371167+0000", 2024-04-01T19:50:01.983 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016765899999999999 2024-04-01T19:50:01.983 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.983 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:01.983 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:47.373913+0000", 2024-04-01T19:50:01.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0027462049999999998 2024-04-01T19:50:01.984 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.984 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.984 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:01.984 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:47.382501+0000", 2024-04-01T19:50:01.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085879900000000002 2024-04-01T19:50:01.984 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.984 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.984 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:01.984 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:47.382553+0000", 2024-04-01T19:50:01.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1863999999999997e-05 2024-04-01T19:50:01.984 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.984 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.985 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:01.985 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:49:47.382597+0000", 2024-04-01T19:50:01.985 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4240999999999999e-05 2024-04-01T19:50:01.985 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.985 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:01.985 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.985 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.985 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.985 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:68748 7.5 7:ac739b57:::benchmark_data_smithi188_147022_object68747:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e566)", 2024-04-01T19:50:01.985 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:50:00.820676+0000", 2024-04-01T19:50:01.985 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 1.084875426, 2024-04-01T19:50:01.985 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020451638000000001, 2024-04-01T19:50:01.985 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:01.985 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:01.986 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:01.986 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:01.986 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:50:01.986 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:01.986 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 68748 2024-04-01T19:50:01.986 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.986 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:01.986 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.986 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:01.986 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.820676+0000", 2024-04-01T19:50:01.986 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.986 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.986 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.986 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:01.987 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.820676+0000", 2024-04-01T19:50:01.987 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.987 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.987 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.987 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:01.987 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.820677+0000", 2024-04-01T19:50:01.987 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9700000000000005e-07 2024-04-01T19:50:01.987 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.987 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.987 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:01.987 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.820700+0000", 2024-04-01T19:50:01.987 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2580999999999999e-05 2024-04-01T19:50:01.987 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.987 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.988 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:01.988 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.820708+0000", 2024-04-01T19:50:01.988 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8839999999999994e-06 2024-04-01T19:50:01.988 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.988 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.988 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:01.988 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.820714+0000", 2024-04-01T19:50:01.988 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3470000000000004e-06 2024-04-01T19:50:01.988 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.988 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.988 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:01.988 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.824715+0000", 2024-04-01T19:50:01.988 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040013469999999997 2024-04-01T19:50:01.988 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.989 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.989 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:01.989 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.824853+0000", 2024-04-01T19:50:01.989 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000138009 2024-04-01T19:50:01.989 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.989 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.989 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:01.989 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.825000+0000", 2024-04-01T19:50:01.989 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014697500000000001 2024-04-01T19:50:01.989 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.989 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.989 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:01.989 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.829231+0000", 2024-04-01T19:50:01.989 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0042310159999999998 2024-04-01T19:50:01.989 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.990 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:01.990 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.841028+0000", 2024-04-01T19:50:01.990 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011796279999999999 2024-04-01T19:50:01.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.990 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:01.990 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.841083+0000", 2024-04-01T19:50:01.990 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5201000000000002e-05 2024-04-01T19:50:01.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.990 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:01.990 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.841128+0000", 2024-04-01T19:50:01.990 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5101000000000001e-05 2024-04-01T19:50:01.991 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.991 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:01.991 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.991 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:68754 7.5 7:a2a32a07:::benchmark_data_smithi188_147022_object68753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e566)", 2024-04-01T19:50:01.991 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:50:00.825124+0000", 2024-04-01T19:50:01.991 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 1.0804279489999999, 2024-04-01T19:50:01.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016119469000000001, 2024-04-01T19:50:01.991 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:01.991 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:01.991 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:01.991 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:01.991 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:50:01.992 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:01.992 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 68754 2024-04-01T19:50:01.992 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.992 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:01.992 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.992 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:01.992 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.825124+0000", 2024-04-01T19:50:01.992 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.992 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.992 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.992 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:01.992 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.825124+0000", 2024-04-01T19:50:01.992 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.992 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.993 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:01.993 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.825126+0000", 2024-04-01T19:50:01.993 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0779999999999998e-06 2024-04-01T19:50:01.993 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.993 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:01.993 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.825152+0000", 2024-04-01T19:50:01.993 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6248999999999999e-05 2024-04-01T19:50:01.993 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.994 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:01.994 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.825164+0000", 2024-04-01T19:50:01.994 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1691e-05 2024-04-01T19:50:01.994 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.994 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.994 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:01.994 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.825170+0000", 2024-04-01T19:50:01.994 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4219999999999997e-06 2024-04-01T19:50:01.994 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.994 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.994 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:01.994 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.826737+0000", 2024-04-01T19:50:01.994 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001567047 2024-04-01T19:50:01.995 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.995 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.995 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:01.995 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.826870+0000", 2024-04-01T19:50:01.995 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000132745 2024-04-01T19:50:01.995 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.995 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.995 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:01.995 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.827014+0000", 2024-04-01T19:50:01.995 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000143998 2024-04-01T19:50:01.995 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.995 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.995 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:01.996 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.829238+0000", 2024-04-01T19:50:01.996 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022239930000000001 2024-04-01T19:50:01.996 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.996 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.996 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:01.996 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.841166+0000", 2024-04-01T19:50:01.996 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011927656999999999 2024-04-01T19:50:01.996 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.996 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.996 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:01.996 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.841212+0000", 2024-04-01T19:50:01.996 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6625000000000002e-05 2024-04-01T19:50:01.996 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.997 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.997 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:01.997 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:00.841243+0000", 2024-04-01T19:50:01.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0963999999999997e-05 2024-04-01T19:50:01.997 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.997 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:01.997 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:01.997 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.997 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.997 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:69566 7.5 7:ae01a44d:::benchmark_data_smithi188_147022_object69565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e566)", 2024-04-01T19:50:01.997 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:50:01.176756+0000", 2024-04-01T19:50:01.997 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.72879585199999997, 2024-04-01T19:50:01.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013845664000000001, 2024-04-01T19:50:01.997 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:01.998 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:01.998 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:01.998 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:01.998 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:50:01.998 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:01.998 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 69566 2024-04-01T19:50:01.998 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.998 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:01.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.998 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:01.998 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.176756+0000", 2024-04-01T19:50:01.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:01.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.176756+0000", 2024-04-01T19:50:01.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:01.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:01.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.176758+0000", 2024-04-01T19:50:01.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3800000000000001e-06 2024-04-01T19:50:01.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:01.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:01.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:01.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.176799+0000", 2024-04-01T19:50:02.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1161000000000001e-05 2024-04-01T19:50:02.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.000 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.000 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:02.000 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.176809+0000", 2024-04-01T19:50:02.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4790000000000002e-06 2024-04-01T19:50:02.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.000 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.000 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:02.000 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.176815+0000", 2024-04-01T19:50:02.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5979999999999996e-06 2024-04-01T19:50:02.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.000 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.000 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:02.001 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.176866+0000", 2024-04-01T19:50:02.001 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1099e-05 2024-04-01T19:50:02.001 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.001 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:02.001 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.177036+0000", 2024-04-01T19:50:02.001 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017013799999999999 2024-04-01T19:50:02.001 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.001 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:02.001 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.177206+0000", 2024-04-01T19:50:02.001 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000169839 2024-04-01T19:50:02.001 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.002 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:02.002 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.187757+0000", 2024-04-01T19:50:02.002 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010551338 2024-04-01T19:50:02.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.002 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.002 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:02.002 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.190499+0000", 2024-04-01T19:50:02.002 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002742534 2024-04-01T19:50:02.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.002 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.002 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:02.002 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.190555+0000", 2024-04-01T19:50:02.002 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5300999999999998e-05 2024-04-01T19:50:02.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.003 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.003 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:02.003 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.190602+0000", 2024-04-01T19:50:02.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6796999999999999e-05 2024-04-01T19:50:02.003 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:02.003 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:02.003 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:02.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.003 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.003 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:69570 7.5 7:ad0d0c5f:::benchmark_data_smithi188_147022_object69569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e566)", 2024-04-01T19:50:02.003 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:50:01.179754+0000", 2024-04-01T19:50:02.003 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.72579805100000006, 2024-04-01T19:50:02.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013667874, 2024-04-01T19:50:02.003 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:02.004 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:02.004 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:02.004 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:02.004 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:50:02.004 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:02.004 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 69570 2024-04-01T19:50:02.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.004 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:02.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.004 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:02.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.179754+0000", 2024-04-01T19:50:02.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:02.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:02.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.179754+0000", 2024-04-01T19:50:02.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:02.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:02.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.179756+0000", 2024-04-01T19:50:02.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2359999999999999e-06 2024-04-01T19:50:02.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:02.006 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.179804+0000", 2024-04-01T19:50:02.006 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8032999999999999e-05 2024-04-01T19:50:02.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.006 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.006 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:02.006 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.179814+0000", 2024-04-01T19:50:02.006 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0266e-05 2024-04-01T19:50:02.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.006 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.006 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:02.006 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.179821+0000", 2024-04-01T19:50:02.006 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8530000000000003e-06 2024-04-01T19:50:02.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.007 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.007 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:02.007 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.182296+0000", 2024-04-01T19:50:02.007 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00247482 2024-04-01T19:50:02.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.007 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.007 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:02.007 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.182477+0000", 2024-04-01T19:50:02.007 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018132000000000001 2024-04-01T19:50:02.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.007 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.007 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:02.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.182591+0000", 2024-04-01T19:50:02.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000113553 2024-04-01T19:50:02.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.008 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:02.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.190767+0000", 2024-04-01T19:50:02.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0081758009999999999 2024-04-01T19:50:02.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.008 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:02.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.193349+0000", 2024-04-01T19:50:02.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025827459999999999 2024-04-01T19:50:02.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.009 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:02.009 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.193386+0000", 2024-04-01T19:50:02.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6380000000000001e-05 2024-04-01T19:50:02.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.009 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:02.009 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.193422+0000", 2024-04-01T19:50:02.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5865999999999998e-05 2024-04-01T19:50:02.009 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:02.009 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:02.009 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:02.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.010 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:69573 7.5 7:a2354857:::benchmark_data_smithi188_147022_object69572:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e566)", 2024-04-01T19:50:02.010 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:50:01.180409+0000", 2024-04-01T19:50:02.010 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.72514276099999997, 2024-04-01T19:50:02.010 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014517317, 2024-04-01T19:50:02.010 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:02.010 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:02.010 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:02.010 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:02.010 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:50:02.010 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:02.010 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 69573 2024-04-01T19:50:02.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.010 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:02.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.011 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:02.011 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.180409+0000", 2024-04-01T19:50:02.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:02.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.011 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:02.011 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.180409+0000", 2024-04-01T19:50:02.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:02.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.011 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:02.011 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.180410+0000", 2024-04-01T19:50:02.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4249999999999999e-06 2024-04-01T19:50:02.012 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.012 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.012 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:02.012 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.180455+0000", 2024-04-01T19:50:02.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4722999999999999e-05 2024-04-01T19:50:02.012 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.012 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.012 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:02.012 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.180468+0000", 2024-04-01T19:50:02.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.274e-05 2024-04-01T19:50:02.012 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.012 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.012 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:02.012 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.180476+0000", 2024-04-01T19:50:02.013 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7479999999999993e-06 2024-04-01T19:50:02.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.013 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.013 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:02.013 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.185087+0000", 2024-04-01T19:50:02.013 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046111650000000004 2024-04-01T19:50:02.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.013 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.013 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:02.013 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.185249+0000", 2024-04-01T19:50:02.013 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016178899999999999 2024-04-01T19:50:02.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.013 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.014 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:02.014 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.185419+0000", 2024-04-01T19:50:02.014 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017048399999999999 2024-04-01T19:50:02.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.014 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.014 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:02.014 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.193429+0000", 2024-04-01T19:50:02.014 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080100510000000007 2024-04-01T19:50:02.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.014 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.014 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:02.014 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.194847+0000", 2024-04-01T19:50:02.014 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014178369999999999 2024-04-01T19:50:02.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.015 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.015 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:02.015 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.194881+0000", 2024-04-01T19:50:02.015 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4109999999999997e-05 2024-04-01T19:50:02.015 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:02.015 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:02.015 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:02.015 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:01.194926+0000", 2024-04-01T19:50:02.015 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5244999999999998e-05 2024-04-01T19:50:02.015 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:02.015 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:02.015 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:02.015 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:02.015 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:02.016 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:50:02.259 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:02 smithi188 ceph-mon[43939]: pgmap v1561: 17 pgs: 17 active+clean; 4.0 GiB data, 12 GiB used, 971 GiB / 983 GiB avail; 152 MiB/s wr, 2.42k op/s 2024-04-01T19:50:02.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:02 smithi062 ceph-mon[44211]: pgmap v1561: 17 pgs: 17 active+clean; 4.0 GiB data, 12 GiB used, 971 GiB / 983 GiB avail; 152 MiB/s wr, 2.42k op/s 2024-04-01T19:50:02.536 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 24 16 72412 72396 188.506 136.25 0.00406059 0.00530391 2024-04-01T19:50:02.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:02 smithi022 ceph-mon[39439]: pgmap v1561: 17 pgs: 17 active+clean; 4.0 GiB data, 12 GiB used, 971 GiB / 983 GiB avail; 152 MiB/s wr, 2.42k op/s 2024-04-01T19:50:02.723 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_ops_in_flight 2024-04-01T19:50:03.114 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:50:03.536 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 25 16 74534 74518 186.27 132.625 0.00294833 0.00536557 2024-04-01T19:50:04.110 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2024-04-01T19:50:04.110 INFO:tasks.cephadm.osd.1:Restarting osd.1 (starting--it wasn't running)... 2024-04-01T19:50:04.110 DEBUG:teuthology.orchestra.run.smithi022:osd.1> sudo journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.1.service 2024-04-01T19:50:04.113 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl start ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.1 2024-04-01T19:50:04.162 INFO:journalctl@ceph.osd.1.smithi022.stdout:-- Logs begin at Mon 2024-04-01 19:04:04 UTC. -- 2024-04-01T19:50:04.364 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:50:04 smithi022 systemd[1]: Starting Ceph osd.1 for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T19:50:04.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:04 smithi022 ceph-mon[39439]: pgmap v1562: 17 pgs: 17 active+clean; 4.2 GiB data, 13 GiB used, 971 GiB / 983 GiB avail; 148 MiB/s wr, 2.36k op/s 2024-04-01T19:50:04.536 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 26 16 76652 76636 184.197 132.375 0.00301125 0.0054273 2024-04-01T19:50:04.620 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:04 smithi188 ceph-mon[43939]: pgmap v1562: 17 pgs: 17 active+clean; 4.2 GiB data, 13 GiB used, 971 GiB / 983 GiB avail; 148 MiB/s wr, 2.36k op/s 2024-04-01T19:50:04.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:04 smithi062 ceph-mon[44211]: pgmap v1562: 17 pgs: 17 active+clean; 4.2 GiB data, 13 GiB used, 971 GiB / 983 GiB avail; 148 MiB/s wr, 2.36k op/s 2024-04-01T19:50:04.765 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:50:04.766 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:50:05.359 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:50:05.362 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:50:05.362 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:50:05.362 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:05.363 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:78310 7.7 e566/560 7:e8b49d5e:::benchmark_data_smithi188_147022_object78309:head v 566'4988, mlcod=566'4986)", 2024-04-01T19:50:05.363 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:50:05.363839+0000", 2024-04-01T19:50:05.363 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.001384227, 2024-04-01T19:50:05.363 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001411813, 2024-04-01T19:50:05.363 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:05.363 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:05.363 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-01T19:50:05.363 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:05.363 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:05.363 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:05.363 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:05.363839+0000", 2024-04-01T19:50:05.363 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:05.363 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:05.364 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:05.364 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:05.364 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:05.363839+0000", 2024-04-01T19:50:05.364 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:05.364 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:05.364 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:05.364 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:05.364 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:05.363840+0000", 2024-04-01T19:50:05.364 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1069999999999999e-06 2024-04-01T19:50:05.364 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:05.364 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:05.364 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:05.364 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:05.363895+0000", 2024-04-01T19:50:05.364 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4412e-05 2024-04-01T19:50:05.365 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:05.365 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:05.365 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:05.365 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:05.363903+0000", 2024-04-01T19:50:05.365 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7309999999999999e-06 2024-04-01T19:50:05.365 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:05.365 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:05.365 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:05.365 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:05.363908+0000", 2024-04-01T19:50:05.365 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.091e-06 2024-04-01T19:50:05.365 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:05.365 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:05.365 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:05.365 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:05.363956+0000", 2024-04-01T19:50:05.365 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7883000000000002e-05 2024-04-01T19:50:05.366 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:05.366 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:05.366 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:05.366 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:05.363977+0000", 2024-04-01T19:50:05.366 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0279999999999999e-05 2024-04-01T19:50:05.366 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:05.366 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:05.366 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:05.366 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:05.366 INFO:teuthology.orchestra.run.smithi188.stdout: ], 2024-04-01T19:50:05.366 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 1 2024-04-01T19:50:05.366 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:50:05.367 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:05.367 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:50:05.468 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:50:05.515 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:05.537 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 27 16 78620 78604 181.93 123 0.0133194 0.00549476 2024-04-01T19:50:05.890 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:50:05.894 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:05.894 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:50:05.995 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:50:06.029 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:06.054 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:50:06.057 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:06.058 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:50:06.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:05 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:50:06.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:05 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:50:06.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:05 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:50:06.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:05 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:50:06.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:05 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:50:06.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:05 smithi022 ceph-mon[39439]: pgmap v1563: 17 pgs: 17 active+clean; 4.3 GiB data, 13 GiB used, 970 GiB / 983 GiB avail; 145 MiB/s wr, 2.32k op/s 2024-04-01T19:50:06.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:05 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:50:06.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:05 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:50:06.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:05 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:50:06.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:05 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:50:06.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:05 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:50:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:05 smithi188 ceph-mon[43939]: pgmap v1563: 17 pgs: 17 active+clean; 4.3 GiB data, 13 GiB used, 970 GiB / 983 GiB avail; 145 MiB/s wr, 2.32k op/s 2024-04-01T19:50:06.158 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:50:06.190 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:06.200 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_blocked_ops 2024-04-01T19:50:06.216 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:50:06.219 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:06.219 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:50:06.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:05 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:50:06.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:05 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:50:06.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:05 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:50:06.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:05 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:50:06.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:05 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:50:06.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:05 smithi062 ceph-mon[44211]: pgmap v1563: 17 pgs: 17 active+clean; 4.3 GiB data, 13 GiB used, 970 GiB / 983 GiB avail; 145 MiB/s wr, 2.32k op/s 2024-04-01T19:50:06.320 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:50:06.355 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:06.381 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:50:06.384 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:06.385 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:50:06.486 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:50:06.525 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:06.536 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 28 16 80561 80545 179.765 121.312 0.00963565 0.00556102 2024-04-01T19:50:06.550 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:50:06.554 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:06.555 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:50:06.596 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:50:06.656 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:50:06.692 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:06.768 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:50:06.875 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:50:06.878 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:06.879 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:50:06.979 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:50:07.012 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:50:06 smithi022 bash[247618]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-01T19:50:07.013 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:50:06 smithi022 bash[247618]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-01T19:50:07.013 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:50:06 smithi022 bash[247618]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-01T19:50:07.013 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:50:06 smithi022 bash[247618]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-01T19:50:07.013 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:50:06 smithi022 bash[247618]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-01T19:50:07.013 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:50:06 smithi022 bash[247618]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-01T19:50:07.014 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:50:06 smithi022 bash[247618]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-01T19:50:07.014 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:07.038 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:50:07.041 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:07.042 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:50:07.044 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:50:07.143 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:50:07.175 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:07 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/848526703' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:50:07.184 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:07.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:07 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/848526703' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:50:07.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:07 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/848526703' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:50:07.441 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:50:07.444 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:07.444 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:50:07.537 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 29 16 82402 82386 177.534 115.062 0.00641956 0.00563123 2024-04-01T19:50:07.545 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:50:07.580 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:07.604 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:50:07.608 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:07.608 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:50:07.709 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:50:07.746 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:07.950 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:50:07.956 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:07.957 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:50:08.019 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:08 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:50:08.019 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:08 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/848526703' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:50:08.019 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:08 smithi188 ceph-mon[43939]: osdmap e567: 12 total, 11 up, 11 in 2024-04-01T19:50:08.019 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:08 smithi188 ceph-mon[43939]: pgmap v1565: 17 pgs: 17 active+clean; 4.8 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 134 MiB/s wr, 2.14k op/s 2024-04-01T19:50:08.058 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:50:08.100 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:08.129 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:50:08.136 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:08.137 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:50:08.238 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:50:08.276 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:08 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:50:08.276 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:08 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/848526703' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:50:08.277 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:08 smithi022 ceph-mon[39439]: osdmap e567: 12 total, 11 up, 11 in 2024-04-01T19:50:08.277 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:08 smithi022 ceph-mon[39439]: pgmap v1565: 17 pgs: 17 active+clean; 4.8 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 134 MiB/s wr, 2.14k op/s 2024-04-01T19:50:08.290 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:08.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:08 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:50:08.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:08 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/848526703' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:50:08.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:08 smithi062 ceph-mon[44211]: osdmap e567: 12 total, 11 up, 11 in 2024-04-01T19:50:08.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:08 smithi062 ceph-mon[44211]: pgmap v1565: 17 pgs: 17 active+clean; 4.8 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 134 MiB/s wr, 2.14k op/s 2024-04-01T19:50:08.537 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 30 16 84429 84413 175.839 126.688 0.00549918 0.00568562 2024-04-01T19:50:08.672 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:50:08.672 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:50:08.673 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-01T19:50:08.673 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-01T19:50:08.673 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:50:08.850 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:50:08.857 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:08.858 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:50:08.959 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:50:09.010 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:09.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:09 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:50:09.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:09 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:50:09.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:09 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:50:09.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:09 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:50:09.420 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_historic_ops 2024-04-01T19:50:09.471 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:50:09.474 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:09.475 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:50:09.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:09 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:50:09.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:09 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:50:09.537 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 31 15 86357 86342 174.055 120.562 0.0126512 0.00574312 2024-04-01T19:50:09.576 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:50:09.611 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:09.639 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:50:09.645 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:09.645 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:50:09.746 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:50:09.799 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:09.805 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:50:09.815 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:50:09.833 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:50:09.840 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:09.841 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:50:09.942 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:50:09.978 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:10.060 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:10 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:50:10.060 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:10 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:50:10.060 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:10 smithi022 ceph-mon[39439]: osdmap e568: 12 total, 11 up, 11 in 2024-04-01T19:50:10.060 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:10 smithi022 ceph-mon[39439]: pgmap v1567: 17 pgs: 17 active+clean; 4.9 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 107 MiB/s wr, 1.71k op/s 2024-04-01T19:50:10.140 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:50:10.142 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:10.143 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:50:10.244 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:50:10.283 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:10.307 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:50:10.311 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:10 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:50:10.311 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:10 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:50:10.311 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:10 smithi062 ceph-mon[44211]: osdmap e568: 12 total, 11 up, 11 in 2024-04-01T19:50:10.311 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:10 smithi062 ceph-mon[44211]: pgmap v1567: 17 pgs: 17 active+clean; 4.9 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 107 MiB/s wr, 1.71k op/s 2024-04-01T19:50:10.311 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:10.312 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:50:10.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:10 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:50:10.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:10 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:50:10.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:10 smithi188 ceph-mon[43939]: osdmap e568: 12 total, 11 up, 11 in 2024-04-01T19:50:10.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:10 smithi188 ceph-mon[43939]: pgmap v1567: 17 pgs: 17 active+clean; 4.9 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 107 MiB/s wr, 1.71k op/s 2024-04-01T19:50:10.413 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:50:10.448 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:10.476 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:50:10.481 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:10.481 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:50:10.537 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 32 16 88149 88133 172.114 111.938 0.00350642 0.00580894 2024-04-01T19:50:10.582 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:50:10.615 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:10.642 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:50:10.646 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:10.646 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:50:10.747 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:50:10.784 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:10.808 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:50:10.812 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:10.813 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:50:10.914 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:50:10.951 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:10.978 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:50:10.982 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:10.982 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:50:11.083 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:50:11.146 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:11.513 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:50:11.519 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:11.519 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:50:11.537 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 33 16 90068 90052 170.533 119.938 0.00681953 0.00586239 2024-04-01T19:50:11.594 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:11 smithi188 ceph-mon[43939]: pgmap v1568: 17 pgs: 17 active+clean; 5.3 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 142 MiB/s wr, 2.27k op/s 2024-04-01T19:50:11.620 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:50:11.650 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:11 smithi062 ceph-mon[44211]: pgmap v1568: 17 pgs: 17 active+clean; 5.3 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 142 MiB/s wr, 2.27k op/s 2024-04-01T19:50:11.652 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:11.679 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:50:11.685 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:11.686 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:50:11.787 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:50:11.788 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:11 smithi022 ceph-mon[39439]: pgmap v1568: 17 pgs: 17 active+clean; 5.3 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 142 MiB/s wr, 2.27k op/s 2024-04-01T19:50:11.796 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_ops_in_flight 2024-04-01T19:50:11.819 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:11.843 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:50:11.846 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:11.846 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:50:11.848 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:50:11.947 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:50:11.953 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:50:11.953 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:50:11.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:50:11.953 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:50:11.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.953 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:130320 6.1 6:89556383:::benchmark_data_smithi188_134454_object130319:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e496)", 2024-04-01T19:50:11.953 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:45:54.229053+0000", 2024-04-01T19:50:11.953 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 257.72165085, 2024-04-01T19:50:11.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.02577318, 2024-04-01T19:50:11.953 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:11.954 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:11.954 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:11.954 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:11.954 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:50:11.954 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:50:11.954 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 130320 2024-04-01T19:50:11.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.954 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:11.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:11.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.229053+0000", 2024-04-01T19:50:11.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:11.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:11.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.229053+0000", 2024-04-01T19:50:11.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:11.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:11.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.229055+0000", 2024-04-01T19:50:11.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6360000000000001e-06 2024-04-01T19:50:11.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:11.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.229085+0000", 2024-04-01T19:50:11.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0471e-05 2024-04-01T19:50:11.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:11.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.229098+0000", 2024-04-01T19:50:11.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2396e-05 2024-04-01T19:50:11.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:11.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.229115+0000", 2024-04-01T19:50:11.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7147e-05 2024-04-01T19:50:11.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:11.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.232070+0000", 2024-04-01T19:50:11.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0029547850000000001 2024-04-01T19:50:11.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:11.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.232219+0000", 2024-04-01T19:50:11.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014880199999999999 2024-04-01T19:50:11.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:11.958 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.232368+0000", 2024-04-01T19:50:11.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014961600000000001 2024-04-01T19:50:11.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:11.958 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.239672+0000", 2024-04-01T19:50:11.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073036790000000004 2024-04-01T19:50:11.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:11.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.254711+0000", 2024-04-01T19:50:11.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015039545 2024-04-01T19:50:11.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:11.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.254772+0000", 2024-04-01T19:50:11.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0956999999999999e-05 2024-04-01T19:50:11.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:11.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.254827+0000", 2024-04-01T19:50:11.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4146e-05 2024-04-01T19:50:11.960 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:11.960 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:11.960 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:11.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.960 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:130324 6.1 6:88f15966:::benchmark_data_smithi188_134454_object130323:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e496)", 2024-04-01T19:50:11.960 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:45:54.233129+0000", 2024-04-01T19:50:11.960 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 257.717575388, 2024-04-01T19:50:11.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.025362123, 2024-04-01T19:50:11.961 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:11.961 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:11.961 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:11.961 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:11.961 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:50:11.961 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:50:11.961 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 130324 2024-04-01T19:50:11.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.962 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:11.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:11.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.233129+0000", 2024-04-01T19:50:11.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:11.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:11.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.233129+0000", 2024-04-01T19:50:11.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:11.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.963 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:11.963 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.233130+0000", 2024-04-01T19:50:11.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6300000000000001e-06 2024-04-01T19:50:11.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.963 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:11.963 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.233154+0000", 2024-04-01T19:50:11.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3098000000000001e-05 2024-04-01T19:50:11.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.963 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:11.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.233165+0000", 2024-04-01T19:50:11.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1001e-05 2024-04-01T19:50:11.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:11.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.233174+0000", 2024-04-01T19:50:11.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9709999999999993e-06 2024-04-01T19:50:11.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:11.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.235582+0000", 2024-04-01T19:50:11.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0024081860000000001 2024-04-01T19:50:11.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.965 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:11.965 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.235762+0000", 2024-04-01T19:50:11.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017979899999999999 2024-04-01T19:50:11.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.965 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:11.965 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.235913+0000", 2024-04-01T19:50:11.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015143200000000001 2024-04-01T19:50:11.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.965 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:11.965 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.243249+0000", 2024-04-01T19:50:11.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.007336146 2024-04-01T19:50:11.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:11.966 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.258411+0000", 2024-04-01T19:50:11.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015161755000000001 2024-04-01T19:50:11.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.966 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:11.966 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.258449+0000", 2024-04-01T19:50:11.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8173999999999997e-05 2024-04-01T19:50:11.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.966 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:11.966 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.258491+0000", 2024-04-01T19:50:11.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1931000000000002e-05 2024-04-01T19:50:11.966 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:11.967 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:11.967 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:11.967 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.967 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:130325 6.1 6:8d8d76a0:::benchmark_data_smithi188_134454_object130324:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e496)", 2024-04-01T19:50:11.967 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:45:54.233292+0000", 2024-04-01T19:50:11.967 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 257.71741252100003, 2024-04-01T19:50:11.967 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.025384777000000001, 2024-04-01T19:50:11.967 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:11.967 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:11.967 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:11.967 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:11.967 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:50:11.968 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:50:11.968 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 130325 2024-04-01T19:50:11.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.968 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:11.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.968 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:11.968 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.233292+0000", 2024-04-01T19:50:11.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:11.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.968 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:11.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.233292+0000", 2024-04-01T19:50:11.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:11.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.969 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:11.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.233292+0000", 2024-04-01T19:50:11.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5899999999999995e-07 2024-04-01T19:50:11.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.969 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:11.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.233313+0000", 2024-04-01T19:50:11.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0593000000000001e-05 2024-04-01T19:50:11.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:11.970 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.233323+0000", 2024-04-01T19:50:11.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5000000000000005e-06 2024-04-01T19:50:11.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:11.970 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.233330+0000", 2024-04-01T19:50:11.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2590000000000003e-06 2024-04-01T19:50:11.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:11.970 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.239744+0000", 2024-04-01T19:50:11.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0064140040000000001 2024-04-01T19:50:11.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.971 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:11.971 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.239896+0000", 2024-04-01T19:50:11.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015226500000000001 2024-04-01T19:50:11.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.971 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:11.971 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.240014+0000", 2024-04-01T19:50:11.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000118152 2024-04-01T19:50:11.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.971 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:11.971 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.246593+0000", 2024-04-01T19:50:11.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0065783100000000004 2024-04-01T19:50:11.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.972 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:11.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.258580+0000", 2024-04-01T19:50:11.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011987192000000001 2024-04-01T19:50:11.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.972 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:11.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.258635+0000", 2024-04-01T19:50:11.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5733999999999999e-05 2024-04-01T19:50:11.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.972 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:11.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:45:54.258676+0000", 2024-04-01T19:50:11.973 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1009e-05 2024-04-01T19:50:11.973 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:11.973 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:11.973 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:11.973 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.973 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.973 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:142633 6.1 6:89dfe583:::benchmark_data_smithi188_134454_object142632:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e499)", 2024-04-01T19:50:11.973 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:46:04.384166+0000", 2024-04-01T19:50:11.973 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 247.56653786999999, 2024-04-01T19:50:11.973 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.024680389, 2024-04-01T19:50:11.973 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:11.973 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:11.973 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:11.973 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:11.973 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:50:11.974 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:50:11.974 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 142633 2024-04-01T19:50:11.974 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.974 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:11.974 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.974 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:11.974 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:04.384166+0000", 2024-04-01T19:50:11.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:11.974 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.974 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.974 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:11.974 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:04.384166+0000", 2024-04-01T19:50:11.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:11.975 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.975 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.975 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:11.975 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:04.384169+0000", 2024-04-01T19:50:11.975 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2019999999999998e-06 2024-04-01T19:50:11.975 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.975 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.975 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:11.975 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:04.384202+0000", 2024-04-01T19:50:11.975 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3318000000000002e-05 2024-04-01T19:50:11.975 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.975 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.975 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:11.975 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:04.384213+0000", 2024-04-01T19:50:11.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1489e-05 2024-04-01T19:50:11.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.976 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:11.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:04.384222+0000", 2024-04-01T19:50:11.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0710000000000001e-06 2024-04-01T19:50:11.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.976 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:11.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:04.387382+0000", 2024-04-01T19:50:11.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031591810000000001 2024-04-01T19:50:11.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.976 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:11.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:04.387483+0000", 2024-04-01T19:50:11.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010137900000000001 2024-04-01T19:50:11.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:11.977 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:04.387627+0000", 2024-04-01T19:50:11.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014436900000000001 2024-04-01T19:50:11.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:11.977 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:04.390787+0000", 2024-04-01T19:50:11.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031592370000000001 2024-04-01T19:50:11.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:11.977 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:04.408776+0000", 2024-04-01T19:50:11.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017989068 2024-04-01T19:50:11.978 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.978 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.978 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:11.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:04.408812+0000", 2024-04-01T19:50:11.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6427999999999997e-05 2024-04-01T19:50:11.978 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.978 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.978 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:11.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:04.408847+0000", 2024-04-01T19:50:11.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4647000000000002e-05 2024-04-01T19:50:11.978 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:11.978 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:11.979 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:11.979 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.979 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.979 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:185471 6.1 6:88b25c3d:::benchmark_data_smithi188_134454_object28730:head [delete] snapc 0=[] ondisk+write+known_if_redirected e515)", 2024-04-01T19:50:11.979 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:46:50.511843+0000", 2024-04-01T19:50:11.979 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 201.43886098999999, 2024-04-01T19:50:11.979 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028214843, 2024-04-01T19:50:11.979 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:11.979 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:11.979 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:11.979 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:11.979 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:50:11.979 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:50:11.979 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 185471 2024-04-01T19:50:11.979 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.980 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:11.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:11.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.511843+0000", 2024-04-01T19:50:11.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:11.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:11.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.511843+0000", 2024-04-01T19:50:11.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:11.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:11.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.511844+0000", 2024-04-01T19:50:11.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1200000000000001e-07 2024-04-01T19:50:11.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:11.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.511848+0000", 2024-04-01T19:50:11.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3699999999999999e-06 2024-04-01T19:50:11.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:11.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.511855+0000", 2024-04-01T19:50:11.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3089999999999998e-06 2024-04-01T19:50:11.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:11.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.511860+0000", 2024-04-01T19:50:11.982 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3199999999999999e-06 2024-04-01T19:50:11.982 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.982 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.982 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:11.982 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.523528+0000", 2024-04-01T19:50:11.982 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011667790000000001 2024-04-01T19:50:11.982 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.982 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.982 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:11.982 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.523629+0000", 2024-04-01T19:50:11.982 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010143499999999999 2024-04-01T19:50:11.982 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.982 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.983 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:11.983 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.523718+0000", 2024-04-01T19:50:11.983 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8968000000000006e-05 2024-04-01T19:50:11.983 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.983 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:11.983 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.536018+0000", 2024-04-01T19:50:11.983 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012299879 2024-04-01T19:50:11.983 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.983 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:11.983 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.539982+0000", 2024-04-01T19:50:11.983 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0039634370000000002 2024-04-01T19:50:11.983 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.983 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:11.984 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.540017+0000", 2024-04-01T19:50:11.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5413999999999997e-05 2024-04-01T19:50:11.984 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.984 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.984 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:11.984 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.540058+0000", 2024-04-01T19:50:11.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1009e-05 2024-04-01T19:50:11.984 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:11.984 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:11.984 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:11.984 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.984 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.984 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:186138 6.1 6:83d9fc42:::benchmark_data_smithi188_134454_object29397:head [delete] snapc 0=[] ondisk+write+known_if_redirected e515)", 2024-04-01T19:50:11.984 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:46:51.110487+0000", 2024-04-01T19:50:11.984 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 200.840216876, 2024-04-01T19:50:11.985 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.025536704, 2024-04-01T19:50:11.985 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:11.985 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:11.985 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:11.985 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:11.985 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:50:11.985 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:50:11.985 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 186138 2024-04-01T19:50:11.985 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.985 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:11.985 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.985 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:11.985 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:51.110487+0000", 2024-04-01T19:50:11.985 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:11.985 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.985 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.986 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:11.986 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:51.110487+0000", 2024-04-01T19:50:11.986 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:11.986 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.986 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.986 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:11.986 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:51.110489+0000", 2024-04-01T19:50:11.986 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.494e-06 2024-04-01T19:50:11.986 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.986 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.986 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:11.986 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:51.110495+0000", 2024-04-01T19:50:11.986 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7960000000000001e-06 2024-04-01T19:50:11.987 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.987 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.987 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:11.987 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:51.110505+0000", 2024-04-01T19:50:11.987 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0642000000000001e-05 2024-04-01T19:50:11.987 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.987 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.987 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:11.987 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:51.110512+0000", 2024-04-01T19:50:11.987 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1539999999999996e-06 2024-04-01T19:50:11.987 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.987 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.987 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:11.987 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:51.114186+0000", 2024-04-01T19:50:11.987 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036740570000000001 2024-04-01T19:50:11.987 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.988 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.988 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:11.988 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:51.114323+0000", 2024-04-01T19:50:11.988 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013635000000000001 2024-04-01T19:50:11.988 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.988 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.988 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:11.988 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:51.114460+0000", 2024-04-01T19:50:11.988 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013726299999999999 2024-04-01T19:50:11.988 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.988 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.988 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:11.988 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:51.128418+0000", 2024-04-01T19:50:11.988 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013957618 2024-04-01T19:50:11.988 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.988 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.989 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:11.989 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:51.135911+0000", 2024-04-01T19:50:11.989 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.007493535 2024-04-01T19:50:11.989 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.989 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.989 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:11.989 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:51.135973+0000", 2024-04-01T19:50:11.989 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1477999999999997e-05 2024-04-01T19:50:11.989 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.989 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.989 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:11.989 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:51.136024+0000", 2024-04-01T19:50:11.989 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1316999999999997e-05 2024-04-01T19:50:11.989 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:11.990 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:11.990 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:11.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.990 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:200045 6.1 6:83f2cd81:::benchmark_data_smithi188_134454_object43304:head [delete] snapc 0=[] ondisk+write+known_if_redirected e517)", 2024-04-01T19:50:11.990 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:03.195976+0000", 2024-04-01T19:50:11.990 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 188.754727777, 2024-04-01T19:50:11.990 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.024256645, 2024-04-01T19:50:11.990 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:11.990 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:11.990 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:11.990 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:11.990 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:50:11.991 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:50:11.991 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 200045 2024-04-01T19:50:11.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.991 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:11.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:11.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.195976+0000", 2024-04-01T19:50:11.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:11.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:11.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.195976+0000", 2024-04-01T19:50:11.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:11.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.992 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.992 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:11.992 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.195977+0000", 2024-04-01T19:50:11.992 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7300000000000005e-07 2024-04-01T19:50:11.992 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.992 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.992 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:11.992 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.195981+0000", 2024-04-01T19:50:11.992 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7720000000000001e-06 2024-04-01T19:50:11.992 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.992 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.992 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:11.992 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.195988+0000", 2024-04-01T19:50:11.992 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9e-06 2024-04-01T19:50:11.993 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.993 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:11.993 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.195994+0000", 2024-04-01T19:50:11.993 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.426e-06 2024-04-01T19:50:11.993 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.993 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:11.993 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.206083+0000", 2024-04-01T19:50:11.993 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010088585000000001 2024-04-01T19:50:11.993 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.993 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:11.994 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.206221+0000", 2024-04-01T19:50:11.994 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000138369 2024-04-01T19:50:11.994 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.994 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.994 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:11.994 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.206367+0000", 2024-04-01T19:50:11.994 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014592500000000001 2024-04-01T19:50:11.994 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.994 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.994 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:11.994 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.215053+0000", 2024-04-01T19:50:11.994 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0086859799999999994 2024-04-01T19:50:11.994 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.995 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.995 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:11.995 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.220130+0000", 2024-04-01T19:50:11.995 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0050767249999999998 2024-04-01T19:50:11.995 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.995 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.995 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:11.995 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.220184+0000", 2024-04-01T19:50:11.995 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4012999999999999e-05 2024-04-01T19:50:11.995 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.995 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.995 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:11.995 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.220233+0000", 2024-04-01T19:50:11.995 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9076999999999998e-05 2024-04-01T19:50:11.996 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:11.996 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:11.996 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:11.996 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.996 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.996 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:200049 6.1 6:8e0eda95:::benchmark_data_smithi188_134454_object43308:head [delete] snapc 0=[] ondisk+write+known_if_redirected e517)", 2024-04-01T19:50:11.996 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:03.197534+0000", 2024-04-01T19:50:11.996 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 188.75316974099999, 2024-04-01T19:50:11.996 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026571332999999999, 2024-04-01T19:50:11.996 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:11.996 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:11.996 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:11.996 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:11.996 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:50:11.996 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:50:11.997 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 200049 2024-04-01T19:50:11.997 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.997 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:11.997 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.997 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:11.997 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.197534+0000", 2024-04-01T19:50:11.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:11.997 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.997 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.997 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:11.997 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.197534+0000", 2024-04-01T19:50:11.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:11.997 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.998 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:11.998 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.197536+0000", 2024-04-01T19:50:11.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3230000000000001e-06 2024-04-01T19:50:11.998 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.998 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:11.998 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.197541+0000", 2024-04-01T19:50:11.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8400000000000002e-06 2024-04-01T19:50:11.998 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.998 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:11.998 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.197552+0000", 2024-04-01T19:50:11.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0865e-05 2024-04-01T19:50:11.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:11.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.197559+0000", 2024-04-01T19:50:11.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6159999999999996e-06 2024-04-01T19:50:11.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:11.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.211159+0000", 2024-04-01T19:50:11.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013599464 2024-04-01T19:50:11.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:11.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:11.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:11.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.211261+0000", 2024-04-01T19:50:12.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000102687 2024-04-01T19:50:12.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.000 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.000 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:12.000 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.211351+0000", 2024-04-01T19:50:12.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9952999999999997e-05 2024-04-01T19:50:12.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.000 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.000 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:12.000 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.220242+0000", 2024-04-01T19:50:12.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0088905809999999998 2024-04-01T19:50:12.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.000 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.000 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:12.000 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.224002+0000", 2024-04-01T19:50:12.001 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.003760228 2024-04-01T19:50:12.001 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.001 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:12.001 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.224060+0000", 2024-04-01T19:50:12.001 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8458999999999997e-05 2024-04-01T19:50:12.001 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.001 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:12.001 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.224106+0000", 2024-04-01T19:50:12.001 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5317e-05 2024-04-01T19:50:12.001 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.001 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:12.001 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.001 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.002 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:200061 6.1 6:82483b9c:::benchmark_data_smithi188_134454_object43320:head [delete] snapc 0=[] ondisk+write+known_if_redirected e517)", 2024-04-01T19:50:12.002 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:03.206575+0000", 2024-04-01T19:50:12.002 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 188.74412954799999, 2024-04-01T19:50:12.002 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026513873, 2024-04-01T19:50:12.002 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:12.002 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:12.002 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:12.002 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:12.002 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:50:12.002 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:50:12.002 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 200061 2024-04-01T19:50:12.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.002 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:12.002 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.002 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:12.003 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.206575+0000", 2024-04-01T19:50:12.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:12.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.003 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.003 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:12.003 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.206575+0000", 2024-04-01T19:50:12.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:12.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.003 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.003 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:12.003 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.206576+0000", 2024-04-01T19:50:12.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.19e-06 2024-04-01T19:50:12.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.003 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.003 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:12.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.206580+0000", 2024-04-01T19:50:12.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9129999999999996e-06 2024-04-01T19:50:12.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.004 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:12.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.206589+0000", 2024-04-01T19:50:12.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9160000000000007e-06 2024-04-01T19:50:12.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.004 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:12.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.206594+0000", 2024-04-01T19:50:12.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3580000000000002e-06 2024-04-01T19:50:12.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.004 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:12.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.220284+0000", 2024-04-01T19:50:12.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013689698 2024-04-01T19:50:12.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:12.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.220387+0000", 2024-04-01T19:50:12.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000103516 2024-04-01T19:50:12.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:12.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.220468+0000", 2024-04-01T19:50:12.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0289000000000003e-05 2024-04-01T19:50:12.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:12.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.232910+0000", 2024-04-01T19:50:12.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012442501 2024-04-01T19:50:12.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.006 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.006 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:12.006 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.232972+0000", 2024-04-01T19:50:12.006 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2347999999999993e-05 2024-04-01T19:50:12.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.006 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.006 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:12.006 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.233036+0000", 2024-04-01T19:50:12.006 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3471000000000003e-05 2024-04-01T19:50:12.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.006 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.006 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:12.006 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.233089+0000", 2024-04-01T19:50:12.007 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2673000000000002e-05 2024-04-01T19:50:12.007 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.007 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:12.007 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.007 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.007 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:200073 6.1 6:84f8150d:::benchmark_data_smithi188_134454_object43332:head [delete] snapc 0=[] ondisk+write+known_if_redirected e517)", 2024-04-01T19:50:12.007 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:03.216314+0000", 2024-04-01T19:50:12.007 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 188.73439007799999, 2024-04-01T19:50:12.007 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028583273999999999, 2024-04-01T19:50:12.007 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:12.007 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:12.007 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:12.007 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:12.007 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:50:12.007 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:50:12.008 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 200073 2024-04-01T19:50:12.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.008 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:12.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.008 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:12.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.216314+0000", 2024-04-01T19:50:12.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:12.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.008 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:12.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.216314+0000", 2024-04-01T19:50:12.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:12.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.009 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:12.009 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.216315+0000", 2024-04-01T19:50:12.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2720000000000001e-06 2024-04-01T19:50:12.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.009 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:12.009 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.216320+0000", 2024-04-01T19:50:12.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6759999999999998e-06 2024-04-01T19:50:12.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.009 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:12.009 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.216330+0000", 2024-04-01T19:50:12.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7650000000000005e-06 2024-04-01T19:50:12.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:12.010 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.216337+0000", 2024-04-01T19:50:12.010 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1489999999999997e-06 2024-04-01T19:50:12.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:12.010 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.229233+0000", 2024-04-01T19:50:12.010 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012895514 2024-04-01T19:50:12.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:12.010 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.229379+0000", 2024-04-01T19:50:12.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014660000000000001 2024-04-01T19:50:12.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.011 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:12.011 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.229514+0000", 2024-04-01T19:50:12.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013490600000000001 2024-04-01T19:50:12.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.011 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:12.011 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.239782+0000", 2024-04-01T19:50:12.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010268121999999999 2024-04-01T19:50:12.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.012 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:12.012 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.244792+0000", 2024-04-01T19:50:12.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0050102990000000002 2024-04-01T19:50:12.012 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.012 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.012 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:12.012 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.244848+0000", 2024-04-01T19:50:12.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5429000000000001e-05 2024-04-01T19:50:12.012 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.012 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.012 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:12.012 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.244897+0000", 2024-04-01T19:50:12.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9542000000000001e-05 2024-04-01T19:50:12.012 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.013 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:12.013 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.013 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.013 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:248847 6.1 6:8f528a26:::benchmark_data_smithi188_134454_object92106:head [delete] snapc 0=[] ondisk+write+known_if_redirected e528)", 2024-04-01T19:50:12.013 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:47.322259+0000", 2024-04-01T19:50:12.013 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 144.62844532899999, 2024-04-01T19:50:12.013 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023958469, 2024-04-01T19:50:12.013 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:12.013 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:12.013 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:12.013 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:12.013 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:50:12.014 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:50:12.014 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 248847 2024-04-01T19:50:12.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.014 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:12.014 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.014 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:12.014 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.322259+0000", 2024-04-01T19:50:12.014 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:12.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.014 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.014 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:12.014 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.322259+0000", 2024-04-01T19:50:12.014 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:12.015 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.015 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.015 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:12.015 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.322261+0000", 2024-04-01T19:50:12.015 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6199999999999999e-06 2024-04-01T19:50:12.015 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.015 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.015 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:12.015 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.322266+0000", 2024-04-01T19:50:12.015 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.344e-06 2024-04-01T19:50:12.015 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.015 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.015 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:12.015 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.322277+0000", 2024-04-01T19:50:12.016 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0711e-05 2024-04-01T19:50:12.016 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.016 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.016 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:12.016 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.322286+0000", 2024-04-01T19:50:12.016 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1470000000000007e-06 2024-04-01T19:50:12.016 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.016 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.016 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:12.016 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.325852+0000", 2024-04-01T19:50:12.016 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0035663100000000001 2024-04-01T19:50:12.016 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.016 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.016 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:12.017 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.325942+0000", 2024-04-01T19:50:12.017 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9596000000000001e-05 2024-04-01T19:50:12.017 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.017 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.017 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:12.017 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.326031+0000", 2024-04-01T19:50:12.017 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9344000000000004e-05 2024-04-01T19:50:12.017 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.017 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.017 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:12.017 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.338087+0000", 2024-04-01T19:50:12.017 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012056001 2024-04-01T19:50:12.017 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.017 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.018 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:12.018 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.346107+0000", 2024-04-01T19:50:12.018 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080199720000000002 2024-04-01T19:50:12.018 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.018 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.018 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:12.018 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.346162+0000", 2024-04-01T19:50:12.018 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4892999999999998e-05 2024-04-01T19:50:12.018 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.018 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.018 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:12.018 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.346217+0000", 2024-04-01T19:50:12.018 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5531000000000001e-05 2024-04-01T19:50:12.019 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.019 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:12.019 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.019 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.019 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.019 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:248850 6.1 6:8d46b51f:::benchmark_data_smithi188_134454_object92109:head [delete] snapc 0=[] ondisk+write+known_if_redirected e528)", 2024-04-01T19:50:12.019 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:47.324547+0000", 2024-04-01T19:50:12.019 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 144.62615725200001, 2024-04-01T19:50:12.019 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.025090899999999999, 2024-04-01T19:50:12.019 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:12.019 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:12.019 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:12.019 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:12.019 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:50:12.019 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:50:12.020 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 248850 2024-04-01T19:50:12.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.020 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:12.020 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.020 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:12.020 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.324547+0000", 2024-04-01T19:50:12.020 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:12.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.020 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.020 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:12.020 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.324547+0000", 2024-04-01T19:50:12.020 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:12.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.020 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.020 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:12.021 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.324549+0000", 2024-04-01T19:50:12.021 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0509999999999999e-06 2024-04-01T19:50:12.021 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.021 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.021 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:12.021 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.324555+0000", 2024-04-01T19:50:12.021 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4740000000000002e-06 2024-04-01T19:50:12.021 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.021 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.021 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:12.021 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.324570+0000", 2024-04-01T19:50:12.021 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4521e-05 2024-04-01T19:50:12.021 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.021 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.021 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:12.021 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.324579+0000", 2024-04-01T19:50:12.022 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1330000000000005e-06 2024-04-01T19:50:12.022 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.022 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.022 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:12.022 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.329609+0000", 2024-04-01T19:50:12.022 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0050301670000000003 2024-04-01T19:50:12.022 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.022 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.022 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:12.022 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.329746+0000", 2024-04-01T19:50:12.022 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000136873 2024-04-01T19:50:12.022 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.022 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.023 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:12.023 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.329876+0000", 2024-04-01T19:50:12.023 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000130061 2024-04-01T19:50:12.023 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.023 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.023 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:12.023 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.338090+0000", 2024-04-01T19:50:12.023 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082137189999999995 2024-04-01T19:50:12.023 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.023 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.023 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:12.023 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.349521+0000", 2024-04-01T19:50:12.023 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.01143096 2024-04-01T19:50:12.023 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.023 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.023 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:12.024 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.349586+0000", 2024-04-01T19:50:12.024 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4626000000000001e-05 2024-04-01T19:50:12.024 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.024 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.024 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:12.024 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.349638+0000", 2024-04-01T19:50:12.024 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2315000000000003e-05 2024-04-01T19:50:12.024 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.024 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:12.024 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.024 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.024 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.024 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:249495 6.1 6:8ccf7b8d:::benchmark_data_smithi188_134454_object92754:head [delete] snapc 0=[] ondisk+write+known_if_redirected e528)", 2024-04-01T19:50:12.024 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:47.962502+0000", 2024-04-01T19:50:12.025 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 143.98820212499999, 2024-04-01T19:50:12.025 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028306492999999999, 2024-04-01T19:50:12.025 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:12.025 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:12.025 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:12.025 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:12.025 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:50:12.025 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:50:12.025 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 249495 2024-04-01T19:50:12.025 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.025 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:12.025 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.025 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:12.025 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.962502+0000", 2024-04-01T19:50:12.025 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:12.026 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.026 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.026 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:12.026 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.962502+0000", 2024-04-01T19:50:12.026 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:12.026 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.026 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.026 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:12.026 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.962503+0000", 2024-04-01T19:50:12.026 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8000000000000005e-07 2024-04-01T19:50:12.026 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.026 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.026 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:12.027 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.962506+0000", 2024-04-01T19:50:12.027 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9809999999999999e-06 2024-04-01T19:50:12.027 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.027 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.027 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:12.027 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.962512+0000", 2024-04-01T19:50:12.027 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0979999999999999e-06 2024-04-01T19:50:12.027 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.027 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.027 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:12.027 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.962516+0000", 2024-04-01T19:50:12.027 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2130000000000002e-06 2024-04-01T19:50:12.027 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.027 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.028 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:12.028 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.966338+0000", 2024-04-01T19:50:12.028 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0038218729999999999 2024-04-01T19:50:12.028 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.028 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.028 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:12.028 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.966521+0000", 2024-04-01T19:50:12.028 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018342900000000001 2024-04-01T19:50:12.028 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.028 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.028 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:12.028 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.966658+0000", 2024-04-01T19:50:12.028 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013661500000000001 2024-04-01T19:50:12.028 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.028 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.029 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:12.029 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.982441+0000", 2024-04-01T19:50:12.029 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015783367 2024-04-01T19:50:12.029 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.029 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.029 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:12.029 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.990689+0000", 2024-04-01T19:50:12.029 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082475910000000003 2024-04-01T19:50:12.029 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.029 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.029 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:12.029 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.990751+0000", 2024-04-01T19:50:12.029 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2020000000000006e-05 2024-04-01T19:50:12.029 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.029 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.030 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:12.030 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.990809+0000", 2024-04-01T19:50:12.030 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7525999999999998e-05 2024-04-01T19:50:12.030 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.030 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:12.030 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.030 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.030 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.030 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:251315 6.1 6:8b8ef441:::benchmark_data_smithi188_134454_object94574:head [delete] snapc 0=[] ondisk+write+known_if_redirected e530)", 2024-04-01T19:50:12.030 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:49.700951+0000", 2024-04-01T19:50:12.030 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 142.249753193, 2024-04-01T19:50:12.030 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023495263999999998, 2024-04-01T19:50:12.030 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:12.031 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:12.031 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:12.031 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:12.031 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:50:12.031 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:50:12.031 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 251315 2024-04-01T19:50:12.031 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.031 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:12.031 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.031 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:12.031 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:49.700951+0000", 2024-04-01T19:50:12.031 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:12.031 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.031 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.032 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:12.032 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:49.700951+0000", 2024-04-01T19:50:12.032 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:12.032 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.032 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.032 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:12.032 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:49.700953+0000", 2024-04-01T19:50:12.032 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.671e-06 2024-04-01T19:50:12.032 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.032 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.032 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:12.032 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:49.700958+0000", 2024-04-01T19:50:12.032 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1229999999999999e-06 2024-04-01T19:50:12.032 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.033 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.033 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:12.033 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:49.700969+0000", 2024-04-01T19:50:12.033 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1635e-05 2024-04-01T19:50:12.033 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.033 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.033 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:12.033 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:49.700977+0000", 2024-04-01T19:50:12.033 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9799999999999998e-06 2024-04-01T19:50:12.033 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.033 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.033 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:12.033 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:49.709323+0000", 2024-04-01T19:50:12.033 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0083452149999999996 2024-04-01T19:50:12.034 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.034 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.034 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:12.034 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:49.709407+0000", 2024-04-01T19:50:12.034 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4659000000000004e-05 2024-04-01T19:50:12.034 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.034 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.034 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:12.034 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:49.709485+0000", 2024-04-01T19:50:12.034 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8089000000000004e-05 2024-04-01T19:50:12.034 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.034 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.034 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:12.034 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:49.720446+0000", 2024-04-01T19:50:12.035 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010960297000000001 2024-04-01T19:50:12.035 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.035 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.035 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:12.035 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:49.724378+0000", 2024-04-01T19:50:12.035 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0039327570000000003 2024-04-01T19:50:12.035 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.035 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.035 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:12.035 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:49.724415+0000", 2024-04-01T19:50:12.035 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6677999999999997e-05 2024-04-01T19:50:12.035 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.035 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.035 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:12.036 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:49.724446+0000", 2024-04-01T19:50:12.036 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.116e-05 2024-04-01T19:50:12.036 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.036 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:12.036 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.036 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.036 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.036 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:299363 6.1 6:8ce05f23:::benchmark_data_smithi188_134454_object142622:head [delete] snapc 0=[] ondisk+write+known_if_redirected e549)", 2024-04-01T19:50:12.036 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:48:59.455183+0000", 2024-04-01T19:50:12.036 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.495521448000005, 2024-04-01T19:50:12.036 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.032178037999999999, 2024-04-01T19:50:12.036 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:12.036 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:12.036 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:12.037 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:12.037 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:50:12.037 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:50:12.037 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 299363 2024-04-01T19:50:12.037 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.037 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:12.037 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.037 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:12.037 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.455183+0000", 2024-04-01T19:50:12.037 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:12.037 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.037 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.037 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:12.038 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.455183+0000", 2024-04-01T19:50:12.038 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:12.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.038 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.038 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:12.038 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.455184+0000", 2024-04-01T19:50:12.038 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.127e-06 2024-04-01T19:50:12.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.038 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.038 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:12.038 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.455188+0000", 2024-04-01T19:50:12.038 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1359999999999999e-06 2024-04-01T19:50:12.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.038 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.039 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:12.039 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.455194+0000", 2024-04-01T19:50:12.039 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7209999999999999e-06 2024-04-01T19:50:12.039 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.039 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.039 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:12.039 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.455198+0000", 2024-04-01T19:50:12.039 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5990000000000004e-06 2024-04-01T19:50:12.039 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.039 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.039 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:12.039 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.463314+0000", 2024-04-01T19:50:12.039 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0081152470000000008 2024-04-01T19:50:12.039 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.040 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.040 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:12.040 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.463446+0000", 2024-04-01T19:50:12.040 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013226899999999999 2024-04-01T19:50:12.040 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.040 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.040 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:12.040 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.463568+0000", 2024-04-01T19:50:12.040 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012256499999999999 2024-04-01T19:50:12.040 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.040 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.040 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:12.040 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.471669+0000", 2024-04-01T19:50:12.041 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.008101057 2024-04-01T19:50:12.041 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.041 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.041 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:12.041 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.487250+0000", 2024-04-01T19:50:12.041 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015580586 2024-04-01T19:50:12.041 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.041 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.041 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:12.041 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.487306+0000", 2024-04-01T19:50:12.041 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6320999999999998e-05 2024-04-01T19:50:12.041 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.041 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.041 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:12.042 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.487361+0000", 2024-04-01T19:50:12.042 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4410000000000003e-05 2024-04-01T19:50:12.042 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.042 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:12.042 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.042 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.042 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.042 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:299373 6.1 6:89dfe583:::benchmark_data_smithi188_134454_object142632:head [delete] snapc 0=[] ondisk+write+known_if_redirected e549)", 2024-04-01T19:50:12.042 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:48:59.461712+0000", 2024-04-01T19:50:12.042 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.488992718999995, 2024-04-01T19:50:12.042 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.025772093999999999, 2024-04-01T19:50:12.042 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:12.042 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:12.043 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:12.043 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:12.043 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:50:12.043 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:50:12.043 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 299373 2024-04-01T19:50:12.043 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.043 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:12.043 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.043 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:12.043 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.461712+0000", 2024-04-01T19:50:12.043 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:12.043 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.043 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.043 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:12.043 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.461712+0000", 2024-04-01T19:50:12.044 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:12.044 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.044 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.044 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:12.044 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.461714+0000", 2024-04-01T19:50:12.044 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1160000000000002e-06 2024-04-01T19:50:12.044 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.044 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.044 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:12.044 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.461721+0000", 2024-04-01T19:50:12.044 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0380000000000002e-06 2024-04-01T19:50:12.044 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.044 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.044 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:12.044 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.461734+0000", 2024-04-01T19:50:12.045 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3244000000000001e-05 2024-04-01T19:50:12.045 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.045 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.045 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:12.045 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.461743+0000", 2024-04-01T19:50:12.045 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7630000000000006e-06 2024-04-01T19:50:12.045 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.045 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.045 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:12.045 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.466916+0000", 2024-04-01T19:50:12.045 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0051733609999999996 2024-04-01T19:50:12.045 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.045 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.045 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:12.046 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.467038+0000", 2024-04-01T19:50:12.046 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012247199999999999 2024-04-01T19:50:12.046 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.046 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.046 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:12.046 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.467162+0000", 2024-04-01T19:50:12.046 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000123981 2024-04-01T19:50:12.046 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.046 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.046 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:12.046 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.471676+0000", 2024-04-01T19:50:12.046 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0045139330000000004 2024-04-01T19:50:12.046 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.047 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.047 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:12.047 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.487409+0000", 2024-04-01T19:50:12.047 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015732752999999999 2024-04-01T19:50:12.047 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.047 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.047 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:12.047 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.487442+0000", 2024-04-01T19:50:12.047 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2597e-05 2024-04-01T19:50:12.047 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.047 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.047 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:12.047 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.487484+0000", 2024-04-01T19:50:12.047 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1835999999999997e-05 2024-04-01T19:50:12.048 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.048 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:12.048 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.048 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.048 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.048 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:299383 6.1 6:8cdd007b:::benchmark_data_smithi188_134454_object142642:head [delete] snapc 0=[] ondisk+write+known_if_redirected e549)", 2024-04-01T19:50:12.048 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:48:59.471656+0000", 2024-04-01T19:50:12.048 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.479048703999993, 2024-04-01T19:50:12.048 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027654287999999999, 2024-04-01T19:50:12.048 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:12.048 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:12.048 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:12.048 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:12.048 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:50:12.049 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:50:12.049 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 299383 2024-04-01T19:50:12.049 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.049 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:12.049 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.049 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:12.049 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.471656+0000", 2024-04-01T19:50:12.049 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:12.049 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.049 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.049 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:12.049 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.471656+0000", 2024-04-01T19:50:12.049 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:12.049 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.049 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.050 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:12.050 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.471657+0000", 2024-04-01T19:50:12.050 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6390000000000001e-06 2024-04-01T19:50:12.050 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.050 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.050 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:12.050 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.471662+0000", 2024-04-01T19:50:12.050 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7090000000000001e-06 2024-04-01T19:50:12.050 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.050 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.050 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:12.050 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.471671+0000", 2024-04-01T19:50:12.050 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0690000000000008e-06 2024-04-01T19:50:12.051 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.051 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.051 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:12.051 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.471679+0000", 2024-04-01T19:50:12.051 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7540000000000006e-06 2024-04-01T19:50:12.051 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.051 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.051 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:12.051 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.471726+0000", 2024-04-01T19:50:12.051 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6958e-05 2024-04-01T19:50:12.051 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.051 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.051 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:12.051 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.471843+0000", 2024-04-01T19:50:12.052 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011765999999999999 2024-04-01T19:50:12.052 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.052 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.052 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:12.052 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.471964+0000", 2024-04-01T19:50:12.052 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000120717 2024-04-01T19:50:12.052 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.052 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.052 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:12.052 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.487191+0000", 2024-04-01T19:50:12.052 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015226630999999999 2024-04-01T19:50:12.052 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.052 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.052 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:12.052 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.499202+0000", 2024-04-01T19:50:12.053 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012011292 2024-04-01T19:50:12.053 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.053 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.053 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:12.053 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.499259+0000", 2024-04-01T19:50:12.053 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7133999999999999e-05 2024-04-01T19:50:12.053 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.053 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.053 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:12.053 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.499310+0000", 2024-04-01T19:50:12.053 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0725e-05 2024-04-01T19:50:12.053 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.053 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:12.053 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.054 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.054 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.054 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:299390 6.1 6:8eff5333:::benchmark_data_smithi188_134454_object142649:head [delete] snapc 0=[] ondisk+write+known_if_redirected e549)", 2024-04-01T19:50:12.054 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:48:59.477881+0000", 2024-04-01T19:50:12.054 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.472823453999993, 2024-04-01T19:50:12.054 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026169668, 2024-04-01T19:50:12.054 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:12.054 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:12.054 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:12.054 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:12.054 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:50:12.054 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:50:12.054 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 299390 2024-04-01T19:50:12.055 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.055 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:12.055 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.055 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:12.055 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.477881+0000", 2024-04-01T19:50:12.055 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:12.055 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.055 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.055 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:12.055 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.477881+0000", 2024-04-01T19:50:12.055 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:12.055 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.055 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.055 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:12.056 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.477882+0000", 2024-04-01T19:50:12.056 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.446e-06 2024-04-01T19:50:12.056 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.056 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.056 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:12.056 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.477888+0000", 2024-04-01T19:50:12.056 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6130000000000003e-06 2024-04-01T19:50:12.056 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.056 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.056 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:12.056 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.477900+0000", 2024-04-01T19:50:12.056 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1928e-05 2024-04-01T19:50:12.056 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.056 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.057 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:12.057 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.477907+0000", 2024-04-01T19:50:12.057 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6340000000000001e-06 2024-04-01T19:50:12.057 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.057 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.057 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:12.057 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.479903+0000", 2024-04-01T19:50:12.057 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0019953060000000001 2024-04-01T19:50:12.057 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.057 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.057 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:12.057 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.480023+0000", 2024-04-01T19:50:12.057 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000120748 2024-04-01T19:50:12.057 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.058 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.058 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:12.058 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.480144+0000", 2024-04-01T19:50:12.058 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012008899999999999 2024-04-01T19:50:12.058 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.058 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.058 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:12.058 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.487503+0000", 2024-04-01T19:50:12.058 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073594369999999999 2024-04-01T19:50:12.058 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.058 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.058 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:12.058 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.503975+0000", 2024-04-01T19:50:12.059 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016472383 2024-04-01T19:50:12.059 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.059 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.059 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:12.059 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.504008+0000", 2024-04-01T19:50:12.059 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2370999999999999e-05 2024-04-01T19:50:12.059 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.059 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.059 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:12.059 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.504050+0000", 2024-04-01T19:50:12.059 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2713000000000003e-05 2024-04-01T19:50:12.059 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.059 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:12.059 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.059 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.060 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.060 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:299391 6.1 6:89a164a9:::benchmark_data_smithi188_134454_object142650:head [delete] snapc 0=[] ondisk+write+known_if_redirected e549)", 2024-04-01T19:50:12.060 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:48:59.479482+0000", 2024-04-01T19:50:12.060 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.471222314000002, 2024-04-01T19:50:12.060 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.025297400000000001, 2024-04-01T19:50:12.060 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:12.060 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:12.060 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:12.060 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:12.060 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:50:12.060 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:50:12.060 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 299391 2024-04-01T19:50:12.060 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.060 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:12.061 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.061 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:12.061 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.479482+0000", 2024-04-01T19:50:12.061 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:12.061 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.061 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.061 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:12.061 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.479482+0000", 2024-04-01T19:50:12.061 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:12.061 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.061 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.061 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:12.061 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.479483+0000", 2024-04-01T19:50:12.061 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.426e-06 2024-04-01T19:50:12.061 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.062 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.062 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:12.062 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.479489+0000", 2024-04-01T19:50:12.062 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9730000000000002e-06 2024-04-01T19:50:12.062 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.062 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.062 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:12.062 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.479499+0000", 2024-04-01T19:50:12.062 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0071999999999999e-05 2024-04-01T19:50:12.062 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.062 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.062 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:12.063 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.479507+0000", 2024-04-01T19:50:12.063 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3189999999999997e-06 2024-04-01T19:50:12.063 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.063 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.063 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:12.063 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.483631+0000", 2024-04-01T19:50:12.063 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0041245350000000004 2024-04-01T19:50:12.063 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.063 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.063 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:12.063 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.483718+0000", 2024-04-01T19:50:12.063 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6451000000000003e-05 2024-04-01T19:50:12.063 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.063 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.064 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:12.064 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.483797+0000", 2024-04-01T19:50:12.064 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9254999999999999e-05 2024-04-01T19:50:12.064 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.064 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.064 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:12.064 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.495202+0000", 2024-04-01T19:50:12.064 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011405436 2024-04-01T19:50:12.064 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.064 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.064 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:12.064 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.504683+0000", 2024-04-01T19:50:12.064 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0094803830000000002 2024-04-01T19:50:12.064 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.064 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.065 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:12.065 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.504732+0000", 2024-04-01T19:50:12.065 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9623000000000002e-05 2024-04-01T19:50:12.065 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.065 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.065 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:12.065 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.504779+0000", 2024-04-01T19:50:12.065 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6927e-05 2024-04-01T19:50:12.065 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.065 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:12.065 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.065 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.065 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.065 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:299392 6.1 6:84e62ee0:::benchmark_data_smithi188_134454_object142651:head [delete] snapc 0=[] ondisk+write+known_if_redirected e549)", 2024-04-01T19:50:12.066 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:48:59.479520+0000", 2024-04-01T19:50:12.066 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.471184405000002, 2024-04-01T19:50:12.066 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029430510999999999, 2024-04-01T19:50:12.066 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:50:12.066 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:50:12.066 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:12.066 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:50:12.066 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:50:12.066 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:50:12.066 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 299392 2024-04-01T19:50:12.066 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.066 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:50:12.066 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.067 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:50:12.067 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.479520+0000", 2024-04-01T19:50:12.067 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:12.067 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.067 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.067 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:50:12.067 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.479520+0000", 2024-04-01T19:50:12.067 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:50:12.067 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.067 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.067 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:50:12.067 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.479520+0000", 2024-04-01T19:50:12.067 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4499999999999997e-07 2024-04-01T19:50:12.067 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.068 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.068 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:50:12.068 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.479523+0000", 2024-04-01T19:50:12.068 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4779999999999998e-06 2024-04-01T19:50:12.068 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.068 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.068 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:50:12.068 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.479528+0000", 2024-04-01T19:50:12.068 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1800000000000004e-06 2024-04-01T19:50:12.068 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.068 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.068 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:50:12.068 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.479533+0000", 2024-04-01T19:50:12.068 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9180000000000002e-06 2024-04-01T19:50:12.068 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.069 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.069 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:50:12.069 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.487544+0000", 2024-04-01T19:50:12.069 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080105000000000003 2024-04-01T19:50:12.069 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.069 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.069 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:50:12.069 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.487668+0000", 2024-04-01T19:50:12.069 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012440699999999999 2024-04-01T19:50:12.069 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.069 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.069 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:50:12.069 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.487791+0000", 2024-04-01T19:50:12.070 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012268199999999999 2024-04-01T19:50:12.070 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.070 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.070 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:50:12.070 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.499143+0000", 2024-04-01T19:50:12.070 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.01135243 2024-04-01T19:50:12.070 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.070 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.070 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:12.070 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.508889+0000", 2024-04-01T19:50:12.070 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0097456550000000006 2024-04-01T19:50:12.070 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.070 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.070 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:50:12.071 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.508922+0000", 2024-04-01T19:50:12.071 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3141e-05 2024-04-01T19:50:12.071 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:50:12.071 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:50:12.071 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:50:12.071 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.508950+0000", 2024-04-01T19:50:12.071 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8475000000000001e-05 2024-04-01T19:50:12.071 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.071 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:12.071 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.071 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:50:12.071 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:50:12.071 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:50:12.072 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:50:11 smithi022 bash[248118]: 509bbf02d7dd8f5b7e85ec374363b23dd098ea12486ec676a17ae9bc892f6835 2024-04-01T19:50:12.072 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:50:11 smithi022 systemd[1]: Started Ceph osd.1 for 09f6b846-f05c-11ee-b647-cb9ed24678a4. 2024-04-01T19:50:12.072 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:12.176 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:50:12.188 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:12.189 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:50:12.289 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:50:12.311 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:50:12 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-1[248149]: 2024-04-01T19:50:12.259+0000 7fad819f07c0 -1 Falling back to public interface 2024-04-01T19:50:12.334 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:12.370 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:50:12.373 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:12.374 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:50:12.475 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:50:12.517 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:12.537 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 34 16 91716 91700 168.546 103 0.012151 0.00593125 2024-04-01T19:50:12.541 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:50:12.544 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:12.544 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:50:12.645 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:50:12.692 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:12.766 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_ops_in_flight 2024-04-01T19:50:12.858 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:12.859 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:50:12.859 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:50:12.906 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:50:12.910 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:50:12.947 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:50:12.960 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:50:12.961 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:12 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3373259623' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:50:12.993 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:50:12.996 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:13.020 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:50:13.027 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:50:13.029 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:13.029 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:50:13.071 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:50:13.097 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:50:13.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:12 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3373259623' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:50:13.130 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:50:13.140 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:50:13.181 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:50:13.184 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:13.224 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:50:13.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:12 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3373259623' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:50:13.261 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:50:13.280 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:50:13.305 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:50:13.332 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:50:13.333 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:50:13.333 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-01T19:50:13.333 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:50:13.333 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:50:13.333 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:50:13.333 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:50:13.333 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:50:13.333 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:50:13.333 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:50:13.333 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:50:13.333 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:50:13.333 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:50:13.537 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 35 16 93395 93379 166.729 104.938 0.0102711 0.0059963 2024-04-01T19:50:14.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:13 smithi062 ceph-mon[44211]: pgmap v1569: 17 pgs: 17 active+clean; 5.4 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 145 MiB/s wr, 2.33k op/s 2024-04-01T19:50:14.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:13 smithi022 ceph-mon[39439]: pgmap v1569: 17 pgs: 17 active+clean; 5.4 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 145 MiB/s wr, 2.33k op/s 2024-04-01T19:50:14.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:13 smithi188 ceph-mon[43939]: pgmap v1569: 17 pgs: 17 active+clean; 5.4 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 145 MiB/s wr, 2.33k op/s 2024-04-01T19:50:14.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:14.537 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 36 16 95204 95188 165.238 113.062 0.00391993 0.00605032 2024-04-01T19:50:15.238 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:15.238 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:14 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:50:15.238 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:14 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:50:15.238 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:14 smithi062 ceph-mon[44211]: osdmap e569: 12 total, 11 up, 11 in 2024-04-01T19:50:15.361 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:50:15 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-1[248149]: 2024-04-01T19:50:15.038+0000 7fad819f07c0 -1 osd.1 534 log_to_monitors true 2024-04-01T19:50:15.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:15.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:14 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:50:15.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:14 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:50:15.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:14 smithi022 ceph-mon[39439]: osdmap e569: 12 total, 11 up, 11 in 2024-04-01T19:50:15.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:15.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:14 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:50:15.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:14 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:50:15.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:14 smithi188 ceph-mon[43939]: osdmap e569: 12 total, 11 up, 11 in 2024-04-01T19:50:15.379 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:50:15.384 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:15.384 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:50:15.485 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:50:15.526 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:15.537 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 37 16 96945 96929 163.713 108.812 0.00569009 0.00610673 2024-04-01T19:50:15.553 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:50:15.558 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:15.559 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:50:15.660 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:50:15.706 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:15.732 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:50:15.736 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:15.737 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:50:15.838 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:50:15.880 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:15.970 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:50:15.974 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:15.974 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:50:16.042 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:15 smithi022 ceph-mon[39439]: from='osd.1 v1:172.21.15.22:6805/3304599570' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-01T19:50:16.042 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:15 smithi022 ceph-mon[39439]: pgmap v1571: 17 pgs: 17 active+clean; 5.5 GiB data, 16 GiB used, 968 GiB / 983 GiB avail; 83 MiB/s wr, 1.32k op/s 2024-04-01T19:50:16.076 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:50:16.115 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:16.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:15 smithi062 ceph-mon[44211]: from='osd.1 v1:172.21.15.22:6805/3304599570' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-01T19:50:16.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:15 smithi062 ceph-mon[44211]: pgmap v1571: 17 pgs: 17 active+clean; 5.5 GiB data, 16 GiB used, 968 GiB / 983 GiB avail; 83 MiB/s wr, 1.32k op/s 2024-04-01T19:50:16.300 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 19:50:16 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-1[248149]: 2024-04-01T19:50:16.043+0000 7fad72e48700 -1 osd.1 570 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T19:50:16.320 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:50:16.324 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:16.324 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:50:16.331 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:50:16.332 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:50:16.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:15 smithi188 ceph-mon[43939]: from='osd.1 v1:172.21.15.22:6805/3304599570' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-01T19:50:16.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:15 smithi188 ceph-mon[43939]: pgmap v1571: 17 pgs: 17 active+clean; 5.5 GiB data, 16 GiB used, 968 GiB / 983 GiB avail; 83 MiB/s wr, 1.32k op/s 2024-04-01T19:50:16.425 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:50:16.465 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:16.491 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:50:16.495 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:16.496 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:50:16.537 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 38 16 98724 98708 162.33 111.188 0.0147053 0.00615818 2024-04-01T19:50:16.597 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:50:16.646 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:16.670 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:50:16.676 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:16.677 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:50:16.712 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:50:16.712 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:50:16.778 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:50:16.827 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:17.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:17 smithi022 ceph-mon[39439]: from='osd.1 v1:172.21.15.22:6805/3304599570' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-01T19:50:17.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:17 smithi022 ceph-mon[39439]: osdmap e570: 12 total, 11 up, 11 in 2024-04-01T19:50:17.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:17 smithi022 ceph-mon[39439]: from='osd.1 v1:172.21.15.22:6805/3304599570' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-04-01T19:50:17.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:17 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T19:50:17.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:17 smithi062 ceph-mon[44211]: from='osd.1 v1:172.21.15.22:6805/3304599570' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-01T19:50:17.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:17 smithi062 ceph-mon[44211]: osdmap e570: 12 total, 11 up, 11 in 2024-04-01T19:50:17.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:17 smithi062 ceph-mon[44211]: from='osd.1 v1:172.21.15.22:6805/3304599570' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-04-01T19:50:17.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:17 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T19:50:17.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:17 smithi188 ceph-mon[43939]: from='osd.1 v1:172.21.15.22:6805/3304599570' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-01T19:50:17.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:17 smithi188 ceph-mon[43939]: osdmap e570: 12 total, 11 up, 11 in 2024-04-01T19:50:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:17 smithi188 ceph-mon[43939]: from='osd.1 v1:172.21.15.22:6805/3304599570' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-04-01T19:50:17.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:17 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T19:50:17.474 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_blocked_ops 2024-04-01T19:50:17.537 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 39 15 100347 100332 160.77 101.5 0.00437965 0.00621873 2024-04-01T19:50:17.583 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:50:17.590 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:17.591 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:50:17.692 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:50:17.739 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:17.876 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:50:18.333 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:50:18.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:18 smithi022 ceph-mon[39439]: osd.1 v1:172.21.15.22:6805/3304599570 boot 2024-04-01T19:50:18.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:18 smithi022 ceph-mon[39439]: osdmap e571: 12 total, 12 up, 11 in 2024-04-01T19:50:18.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:18 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T19:50:18.370 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:18 smithi022 ceph-mon[39439]: pgmap v1574: 17 pgs: 17 active+clean; 5.9 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 107 MiB/s wr, 1.72k op/s 2024-04-01T19:50:18.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:18 smithi188 ceph-mon[43939]: osd.1 v1:172.21.15.22:6805/3304599570 boot 2024-04-01T19:50:18.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:18 smithi188 ceph-mon[43939]: osdmap e571: 12 total, 12 up, 11 in 2024-04-01T19:50:18.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:18 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T19:50:18.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:18 smithi188 ceph-mon[43939]: pgmap v1574: 17 pgs: 17 active+clean; 5.9 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 107 MiB/s wr, 1.72k op/s 2024-04-01T19:50:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:18 smithi062 ceph-mon[44211]: osd.1 v1:172.21.15.22:6805/3304599570 boot 2024-04-01T19:50:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:18 smithi062 ceph-mon[44211]: osdmap e571: 12 total, 12 up, 11 in 2024-04-01T19:50:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:18 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T19:50:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:18 smithi062 ceph-mon[44211]: pgmap v1574: 17 pgs: 17 active+clean; 5.9 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 107 MiB/s wr, 1.72k op/s 2024-04-01T19:50:18.537 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:50:18.541083 min lat: 0.00105017 max lat: 0.212434 avg lat: 0.00627892 2024-04-01T19:50:18.537 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:50:18.538 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 40 16 101921 101905 159.209 98.3125 0.00567865 0.00627892 2024-04-01T19:50:18.608 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:50:18.615 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:18.615 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:50:18.716 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:50:18.756 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:19.049 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:50:19.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:19.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:19 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:50:19.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:19 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:50:19.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:19 smithi022 ceph-mon[39439]: osdmap e572: 12 total, 12 up, 11 in 2024-04-01T19:50:19.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:19 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4132929501' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:50:19.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:19 smithi022 ceph-mon[39439]: from='client.36710 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:50:19.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:19.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:19 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:50:19.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:19 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:50:19.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:19 smithi188 ceph-mon[43939]: osdmap e572: 12 total, 12 up, 11 in 2024-04-01T19:50:19.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:19 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4132929501' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:50:19.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:19 smithi188 ceph-mon[43939]: from='client.36710 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:50:19.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:19.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:19 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:50:19.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:19 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:50:19.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:19 smithi062 ceph-mon[44211]: osdmap e572: 12 total, 12 up, 11 in 2024-04-01T19:50:19.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:19 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4132929501' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:50:19.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:19 smithi062 ceph-mon[44211]: from='client.36710 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:50:19.537 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 41 16 103452 103436 157.659 95.6875 0.0117896 0.00634137 2024-04-01T19:50:19.612 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:50:19.617 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:19.617 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:50:19.718 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:50:19.729 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:50:19.729 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:50:19.729 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 0 2024-04-01T19:50:19.729 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:50:19.758 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:19.779 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:50:19.784 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:19.785 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:50:19.885 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:50:19.924 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:20.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:20 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:50:20.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:20 smithi062 ceph-mon[44211]: from='client.36710 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:50:20.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:20 smithi062 ceph-mon[44211]: osdmap e573: 12 total, 12 up, 11 in 2024-04-01T19:50:20.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:20 smithi062 ceph-mon[44211]: pgmap v1577: 17 pgs: 17 active+clean; 6.0 GiB data, 17 GiB used, 967 GiB / 983 GiB avail; 135 MiB/s wr, 2.16k op/s 2024-04-01T19:50:20.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:20 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:50:20.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:20 smithi022 ceph-mon[39439]: from='client.36710 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:50:20.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:20 smithi022 ceph-mon[39439]: osdmap e573: 12 total, 12 up, 11 in 2024-04-01T19:50:20.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:20 smithi022 ceph-mon[39439]: pgmap v1577: 17 pgs: 17 active+clean; 6.0 GiB data, 17 GiB used, 967 GiB / 983 GiB avail; 135 MiB/s wr, 2.16k op/s 2024-04-01T19:50:20.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:20 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:50:20.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:20 smithi188 ceph-mon[43939]: from='client.36710 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:50:20.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:20 smithi188 ceph-mon[43939]: osdmap e573: 12 total, 12 up, 11 in 2024-04-01T19:50:20.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:20 smithi188 ceph-mon[43939]: pgmap v1577: 17 pgs: 17 active+clean; 6.0 GiB data, 17 GiB used, 967 GiB / 983 GiB avail; 135 MiB/s wr, 2.16k op/s 2024-04-01T19:50:20.538 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 42 16 105233 105217 156.555 111.312 0.00467047 0.00638615 2024-04-01T19:50:20.987 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:50:20.989 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:20.989 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:50:21.054 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:21 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:50:21.054 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:21 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:50:21.054 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:21 smithi022 ceph-mon[39439]: osdmap e574: 12 total, 12 up, 11 in 2024-04-01T19:50:21.054 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:21 smithi022 ceph-mon[39439]: osdmap e575: 12 total, 12 up, 11 in 2024-04-01T19:50:21.090 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:50:21.130 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:21.158 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:50:21.162 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:21.163 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:50:21.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:21 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:50:21.276 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:21 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:50:21.277 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:21 smithi062 ceph-mon[44211]: osdmap e574: 12 total, 12 up, 11 in 2024-04-01T19:50:21.277 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:21 smithi062 ceph-mon[44211]: osdmap e575: 12 total, 12 up, 11 in 2024-04-01T19:50:21.277 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:50:21.307 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:21 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:50:21.307 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:21 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:50:21.307 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:21 smithi188 ceph-mon[43939]: osdmap e574: 12 total, 12 up, 11 in 2024-04-01T19:50:21.307 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:21 smithi188 ceph-mon[43939]: osdmap e575: 12 total, 12 up, 11 in 2024-04-01T19:50:21.309 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:21.338 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:50:21.344 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:21.345 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:50:21.408 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-01T19:50:21.408 INFO:tasks.thrashosds.thrasher:inject_pause on osd.9 2024-04-01T19:50:21.408 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-01T19:50:21.408 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-01T19:50:21.408 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 config set filestore_inject_stall 3 2024-04-01T19:50:21.446 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:50:21.480 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:21.538 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 43 16 106899 106883 155.336 104.125 0.00535223 0.00643632 2024-04-01T19:50:21.587 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:50:21.595 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:21.595 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:50:21.696 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:50:21.742 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:21.776 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:50:21.785 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:21.785 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:50:21.792 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:50:21.886 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:50:21.922 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:21.931 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:50:22.217 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:22 smithi022 ceph-mon[39439]: pgmap v1580: 17 pgs: 17 active+clean; 6.3 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 107 MiB/s wr, 1.71k op/s 2024-04-01T19:50:22.224 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:22 smithi062 ceph-mon[44211]: pgmap v1580: 17 pgs: 17 active+clean; 6.3 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 107 MiB/s wr, 1.71k op/s 2024-04-01T19:50:22.277 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:50:22.282 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:22.282 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:50:22.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:22 smithi188 ceph-mon[43939]: pgmap v1580: 17 pgs: 17 active+clean; 6.3 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 107 MiB/s wr, 1.71k op/s 2024-04-01T19:50:22.383 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:50:22.428 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:22.538 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 44 16 108482 108466 154.054 98.9375 0.0173871 0.00648978 2024-04-01T19:50:22.542 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:50:22.546 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:22.546 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:50:22.595 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:50:22.595 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:50:22.647 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:50:22.684 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:23.176 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:50:23.185 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:23.185 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:50:23.286 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:50:23.352 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:23.362 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_historic_ops 2024-04-01T19:50:23.391 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:50:23.396 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:23.397 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:50:23.498 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:50:23.534 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:23.538 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 45 16 110111 110095 152.893 101.812 0.0183947 0.00653916 2024-04-01T19:50:23.566 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:50:23.570 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:23.570 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:50:23.671 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:50:23.708 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:23.726 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:50:23.751 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:50:23.759 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:23.760 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:50:23.861 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:50:23.922 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:50:23.923 INFO:teuthology.orchestra.run.smithi188.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-01T19:50:23.923 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:50:23.927 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:23.937 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:50:23.957 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:50:23.960 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:23.961 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:50:24.063 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:50:24.142 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:24.173 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:50:24.201 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:50:24.205 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:24.205 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:50:24.215 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:50:24.261 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:50:24.273 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:24 smithi022 ceph-mon[39439]: pgmap v1581: 17 pgs: 17 active+clean; 6.4 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 101 MiB/s wr, 1.61k op/s 2024-04-01T19:50:24.274 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:24 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1143500021' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:50:24.301 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:50:24.306 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:50:24.337 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:50:24.376 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:50:24.406 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:24.416 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:50:24.454 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:50:24.458 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:24.459 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:50:24.459 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:50:24.469 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:50:24.498 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:50:24.537 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:50:24.538 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 46 15 111479 111464 151.429 85.5625 0.0106991 0.00660274 2024-04-01T19:50:24.560 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:50:24.567 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:50:24.592 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:24 smithi062 ceph-mon[44211]: pgmap v1581: 17 pgs: 17 active+clean; 6.4 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 101 MiB/s wr, 1.61k op/s 2024-04-01T19:50:24.592 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:24 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1143500021' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:50:24.596 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:24.613 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:50:24.616 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:50:24.616 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:50:24.616 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:50:24.616 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:50:24.616 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:50:24.616 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:50:24.617 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:50:24.617 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:50:24.617 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:50:24.617 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:50:24.617 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:50:24.617 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:50:24.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:24 smithi188 ceph-mon[43939]: pgmap v1581: 17 pgs: 17 active+clean; 6.4 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 101 MiB/s wr, 1.61k op/s 2024-04-01T19:50:24.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:24 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1143500021' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:50:24.885 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:50:24.890 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:24.890 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:50:24.991 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:50:25.026 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:25.073 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:50:25.080 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:25.081 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:50:25.182 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:50:25.227 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:25.255 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:50:25.258 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:25.259 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:50:25.360 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:50:25.404 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:25.541 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 47 16 113108 113092 150.372 101.75 0.00660563 0.00664899 2024-04-01T19:50:25.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.663 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.663 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.664 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.664 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.664 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.664 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.664 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.664 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.664 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.664 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.664 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.664 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:25.665 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:50:25.674 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:25.675 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:50:25.776 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:50:25.808 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:26.164 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:50:26.176 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:26.177 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:50:26.278 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:50:26.323 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:26.380 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:50:26.387 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:26.388 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:50:26.489 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:50:26.500 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:26 smithi062 ceph-mon[44211]: pgmap v1582: 17 pgs: 17 active+clean; 6.5 GiB data, 18 GiB used, 966 GiB / 983 GiB avail; 83 MiB/s wr, 1.32k op/s 2024-04-01T19:50:26.500 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:26 smithi062 ceph-mon[44211]: osdmap e576: 12 total, 12 up, 11 in 2024-04-01T19:50:26.530 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:26.538 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 48 16 114695 114679 149.306 99.1875 0.0167231 0.00669612 2024-04-01T19:50:26.558 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:50:26.561 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:26.561 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:50:26.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:26 smithi022 ceph-mon[39439]: pgmap v1582: 17 pgs: 17 active+clean; 6.5 GiB data, 18 GiB used, 966 GiB / 983 GiB avail; 83 MiB/s wr, 1.32k op/s 2024-04-01T19:50:26.571 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:26 smithi022 ceph-mon[39439]: osdmap e576: 12 total, 12 up, 11 in 2024-04-01T19:50:26.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:26 smithi188 ceph-mon[43939]: pgmap v1582: 17 pgs: 17 active+clean; 6.5 GiB data, 18 GiB used, 966 GiB / 983 GiB avail; 83 MiB/s wr, 1.32k op/s 2024-04-01T19:50:26.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:26 smithi188 ceph-mon[43939]: osdmap e576: 12 total, 12 up, 11 in 2024-04-01T19:50:26.662 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:50:26.709 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:26.875 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:50:26.883 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:26.884 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:50:26.921 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:50:26.921 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 20, 2024-04-01T19:50:26.921 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 600, 2024-04-01T19:50:26.921 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:50:26.921 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.921 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:27450 7.d 7:b14f78ef:::benchmark_data_smithi188_147022_object27449:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:50:26.921 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:44.659107+0000", 2024-04-01T19:50:26.921 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 42.260432981000001, 2024-04-01T19:50:26.922 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.115606341, 2024-04-01T19:50:26.922 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:50:26.922 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:50:26.922 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:26.922 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:50:26.922 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:50:26.922 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:26.922 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 27450 2024-04-01T19:50:26.922 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.922 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:50:26.922 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.922 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:50:26.922 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.659107+0000", 2024-04-01T19:50:26.923 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:26.923 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.923 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.923 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:50:26.923 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.659107+0000", 2024-04-01T19:50:26.923 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:26.923 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.923 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.923 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:50:26.923 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.659109+0000", 2024-04-01T19:50:26.923 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.203e-06 2024-04-01T19:50:26.923 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.924 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.924 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:50:26.924 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.659135+0000", 2024-04-01T19:50:26.924 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.5962999999999999e-05 2024-04-01T19:50:26.924 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.924 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.924 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:50:26.924 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.659142+0000", 2024-04-01T19:50:26.924 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.824e-06 2024-04-01T19:50:26.924 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.924 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.924 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:50:26.924 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.659149+0000", 2024-04-01T19:50:26.924 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8290000000000002e-06 2024-04-01T19:50:26.925 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.925 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.925 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:50:26.925 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.659206+0000", 2024-04-01T19:50:26.925 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7145999999999998e-05 2024-04-01T19:50:26.925 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.925 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.925 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:50:26.925 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.659349+0000", 2024-04-01T19:50:26.925 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000142762 2024-04-01T19:50:26.925 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.925 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.925 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 0", 2024-04-01T19:50:26.926 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.659491+0000", 2024-04-01T19:50:26.926 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014194399999999999 2024-04-01T19:50:26.926 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.926 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.926 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:50:26.926 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.660579+0000", 2024-04-01T19:50:26.926 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.001088126 2024-04-01T19:50:26.926 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.926 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.926 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:26.927 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.774649+0000", 2024-04-01T19:50:26.927 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.11407028600000001 2024-04-01T19:50:26.927 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.927 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.927 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:50:26.927 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.774685+0000", 2024-04-01T19:50:26.927 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.5581999999999999e-05 2024-04-01T19:50:26.927 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.927 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.927 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:50:26.927 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.774714+0000", 2024-04-01T19:50:26.927 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8676000000000001e-05 2024-04-01T19:50:26.927 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:26.927 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:50:26.928 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:26.928 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.928 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.928 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:27466 7.c 7:35e362a9:::benchmark_data_smithi188_147022_object27465:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:50:26.928 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:44.664444+0000", 2024-04-01T19:50:26.928 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 42.255096006000002, 2024-04-01T19:50:26.928 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.1116292, 2024-04-01T19:50:26.928 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:50:26.928 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:50:26.928 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:26.928 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:50:26.929 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:50:26.929 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:26.929 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 27466 2024-04-01T19:50:26.929 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.929 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:50:26.929 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.929 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:50:26.929 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.664444+0000", 2024-04-01T19:50:26.929 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:26.929 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.929 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.929 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:50:26.929 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.664444+0000", 2024-04-01T19:50:26.930 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:26.930 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.930 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.930 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:50:26.930 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.664445+0000", 2024-04-01T19:50:26.930 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.85e-07 2024-04-01T19:50:26.930 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.930 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.930 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:50:26.931 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.664575+0000", 2024-04-01T19:50:26.931 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012935 2024-04-01T19:50:26.931 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.931 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.931 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:50:26.931 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.664582+0000", 2024-04-01T19:50:26.931 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.3590000000000002e-06 2024-04-01T19:50:26.931 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.931 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.931 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:50:26.931 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.664586+0000", 2024-04-01T19:50:26.931 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.2490000000000003e-06 2024-04-01T19:50:26.931 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.931 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.931 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:50:26.932 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.664620+0000", 2024-04-01T19:50:26.932 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.3512e-05 2024-04-01T19:50:26.932 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.932 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.932 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:50:26.932 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.664697+0000", 2024-04-01T19:50:26.932 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.7070000000000006e-05 2024-04-01T19:50:26.932 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.932 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.932 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:50:26.932 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.664793+0000", 2024-04-01T19:50:26.932 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.5906e-05 2024-04-01T19:50:26.932 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.932 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.933 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:50:26.933 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.665547+0000", 2024-04-01T19:50:26.933 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00075396399999999998 2024-04-01T19:50:26.933 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.933 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.933 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:26.933 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.775981+0000", 2024-04-01T19:50:26.933 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.110434133 2024-04-01T19:50:26.933 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.933 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.933 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:50:26.933 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.776046+0000", 2024-04-01T19:50:26.933 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.4741999999999998e-05 2024-04-01T19:50:26.933 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.934 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.934 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:50:26.934 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:44.776074+0000", 2024-04-01T19:50:26.934 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8030000000000001e-05 2024-04-01T19:50:26.934 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:26.934 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:50:26.934 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:26.934 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.934 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.934 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:31454 7.7 7:e549ac6c:::benchmark_data_smithi188_147022_object31453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:50:26.934 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:45.948019+0000", 2024-04-01T19:50:26.934 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.971521627999998, 2024-04-01T19:50:26.934 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.20546144499999999, 2024-04-01T19:50:26.935 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:50:26.935 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:50:26.935 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:26.935 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:50:26.935 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:50:26.935 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:26.935 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 31454 2024-04-01T19:50:26.935 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.935 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:50:26.935 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.935 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:50:26.935 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.948019+0000", 2024-04-01T19:50:26.936 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:26.936 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.936 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.936 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:50:26.936 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.948019+0000", 2024-04-01T19:50:26.936 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:26.936 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.936 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.936 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:50:26.936 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.948020+0000", 2024-04-01T19:50:26.936 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.124e-06 2024-04-01T19:50:26.937 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.937 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.937 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:50:26.937 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.948089+0000", 2024-04-01T19:50:26.937 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9233999999999995e-05 2024-04-01T19:50:26.937 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.937 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.937 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:50:26.937 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.948102+0000", 2024-04-01T19:50:26.937 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2887e-05 2024-04-01T19:50:26.938 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.938 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.938 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:50:26.938 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.948110+0000", 2024-04-01T19:50:26.938 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.2630000000000003e-06 2024-04-01T19:50:26.938 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.938 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.938 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:50:26.939 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.948181+0000", 2024-04-01T19:50:26.939 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.0549999999999994e-05 2024-04-01T19:50:26.939 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.939 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.939 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:50:26.939 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.948308+0000", 2024-04-01T19:50:26.939 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012682399999999999 2024-04-01T19:50:26.939 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.939 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.939 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T19:50:26.939 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.948454+0000", 2024-04-01T19:50:26.939 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014685800000000001 2024-04-01T19:50:26.939 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.940 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.940 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:50:26.940 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.949548+0000", 2024-04-01T19:50:26.940 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.001093388 2024-04-01T19:50:26.940 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.940 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.940 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:26.940 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.153411+0000", 2024-04-01T19:50:26.940 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.20386356 2024-04-01T19:50:26.940 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.940 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.940 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:50:26.941 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.153450+0000", 2024-04-01T19:50:26.941 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8760000000000002e-05 2024-04-01T19:50:26.941 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.941 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.941 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:50:26.941 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.153480+0000", 2024-04-01T19:50:26.941 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.9997000000000001e-05 2024-04-01T19:50:26.941 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:26.941 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:50:26.941 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:26.941 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.941 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.941 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:31485 7.7 7:eb292cd5:::benchmark_data_smithi188_147022_object31484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:50:26.941 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:45.957753+0000", 2024-04-01T19:50:26.941 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.961787207, 2024-04-01T19:50:26.941 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.196695432, 2024-04-01T19:50:26.942 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:50:26.942 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:50:26.942 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:26.942 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:50:26.942 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:50:26.942 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:26.942 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 31485 2024-04-01T19:50:26.942 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.942 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:50:26.942 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.942 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:50:26.942 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.957753+0000", 2024-04-01T19:50:26.943 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:26.943 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.943 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.943 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:50:26.943 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.957753+0000", 2024-04-01T19:50:26.943 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:26.943 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.943 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.943 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:50:26.943 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.957755+0000", 2024-04-01T19:50:26.943 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4780000000000001e-06 2024-04-01T19:50:26.943 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.943 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.943 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:50:26.943 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.957856+0000", 2024-04-01T19:50:26.944 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000101314 2024-04-01T19:50:26.944 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.944 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.944 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:50:26.944 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.957866+0000", 2024-04-01T19:50:26.944 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0087e-05 2024-04-01T19:50:26.944 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.944 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.944 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:50:26.944 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.957872+0000", 2024-04-01T19:50:26.944 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.4729999999999999e-06 2024-04-01T19:50:26.944 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.944 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.945 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:50:26.945 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.957928+0000", 2024-04-01T19:50:26.945 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6716999999999999e-05 2024-04-01T19:50:26.945 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.945 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.945 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:50:26.945 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.958061+0000", 2024-04-01T19:50:26.945 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000132559 2024-04-01T19:50:26.945 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.945 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.945 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T19:50:26.945 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.958210+0000", 2024-04-01T19:50:26.945 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000149698 2024-04-01T19:50:26.945 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.946 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.946 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:50:26.946 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.960306+0000", 2024-04-01T19:50:26.946 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0020952179999999998 2024-04-01T19:50:26.946 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.946 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.946 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:26.946 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.154374+0000", 2024-04-01T19:50:26.946 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.194068713 2024-04-01T19:50:26.946 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.946 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.946 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:50:26.946 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.154409+0000", 2024-04-01T19:50:26.947 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.4995e-05 2024-04-01T19:50:26.947 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.947 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.947 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:50:26.947 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.154449+0000", 2024-04-01T19:50:26.947 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9180000000000001e-05 2024-04-01T19:50:26.947 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:26.947 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:50:26.947 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:26.947 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.947 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.947 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:31488 7.7 7:eb7e4340:::benchmark_data_smithi188_147022_object31487:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:50:26.947 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:45.957937+0000", 2024-04-01T19:50:26.947 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.961603805999999, 2024-04-01T19:50:26.947 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.19660248599999999, 2024-04-01T19:50:26.948 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:50:26.948 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:50:26.948 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:26.948 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:50:26.948 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:50:26.948 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:26.948 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 31488 2024-04-01T19:50:26.948 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.948 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:50:26.949 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.949 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:50:26.949 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.957937+0000", 2024-04-01T19:50:26.949 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:26.949 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.949 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.949 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:50:26.949 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.957937+0000", 2024-04-01T19:50:26.949 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:26.949 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.949 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.949 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:50:26.949 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.957941+0000", 2024-04-01T19:50:26.949 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0169999999999998e-06 2024-04-01T19:50:26.950 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.950 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.950 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:50:26.950 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.957998+0000", 2024-04-01T19:50:26.950 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7416000000000001e-05 2024-04-01T19:50:26.950 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.950 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.950 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:50:26.950 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.958009+0000", 2024-04-01T19:50:26.950 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1147e-05 2024-04-01T19:50:26.950 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.950 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.950 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:50:26.950 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.958013+0000", 2024-04-01T19:50:26.951 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0960000000000003e-06 2024-04-01T19:50:26.951 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.951 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.951 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:50:26.951 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.959281+0000", 2024-04-01T19:50:26.951 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0012678660000000001 2024-04-01T19:50:26.951 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.951 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.951 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:50:26.951 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.959399+0000", 2024-04-01T19:50:26.951 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000118014 2024-04-01T19:50:26.951 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.951 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.951 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T19:50:26.952 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.959524+0000", 2024-04-01T19:50:26.952 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012448099999999999 2024-04-01T19:50:26.952 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.952 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.952 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:50:26.952 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.960426+0000", 2024-04-01T19:50:26.952 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00090252799999999999 2024-04-01T19:50:26.952 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.952 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.952 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:26.952 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.154484+0000", 2024-04-01T19:50:26.952 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.19405744999999999 2024-04-01T19:50:26.952 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.952 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.953 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:50:26.953 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.154516+0000", 2024-04-01T19:50:26.953 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.2778999999999999e-05 2024-04-01T19:50:26.953 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.953 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.953 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:50:26.953 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.154539+0000", 2024-04-01T19:50:26.953 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.2691999999999999e-05 2024-04-01T19:50:26.953 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:26.953 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:50:26.953 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:26.953 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.954 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.954 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:31536 7.7 7:e6abc489:::benchmark_data_smithi188_147022_object31535:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:50:26.954 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:45.970575+0000", 2024-04-01T19:50:26.954 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.948965743000002, 2024-04-01T19:50:26.954 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.18439016699999999, 2024-04-01T19:50:26.954 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:50:26.954 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:50:26.954 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:26.954 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:50:26.954 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:50:26.954 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:26.954 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 31536 2024-04-01T19:50:26.954 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.955 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:50:26.955 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.955 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:50:26.955 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.970575+0000", 2024-04-01T19:50:26.955 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:26.955 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.955 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.955 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:50:26.955 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.970575+0000", 2024-04-01T19:50:26.955 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:26.955 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.955 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.955 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:50:26.956 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.970576+0000", 2024-04-01T19:50:26.956 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.8199999999999998e-07 2024-04-01T19:50:26.956 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.956 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.956 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:50:26.956 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.970651+0000", 2024-04-01T19:50:26.956 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.5970000000000006e-05 2024-04-01T19:50:26.956 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.956 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.956 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:50:26.956 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.970663+0000", 2024-04-01T19:50:26.957 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1704e-05 2024-04-01T19:50:26.957 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.957 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.957 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:50:26.957 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.970677+0000", 2024-04-01T19:50:26.957 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3720000000000001e-05 2024-04-01T19:50:26.957 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.957 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.957 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:50:26.957 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.970734+0000", 2024-04-01T19:50:26.957 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6851000000000002e-05 2024-04-01T19:50:26.957 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.957 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.958 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:50:26.958 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.970815+0000", 2024-04-01T19:50:26.958 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.1201999999999999e-05 2024-04-01T19:50:26.958 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.958 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.958 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T19:50:26.958 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.970907+0000", 2024-04-01T19:50:26.958 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1936999999999997e-05 2024-04-01T19:50:26.958 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.958 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.958 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:50:26.958 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.973109+0000", 2024-04-01T19:50:26.958 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0022020780000000001 2024-04-01T19:50:26.958 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.959 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.959 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:26.959 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.154867+0000", 2024-04-01T19:50:26.959 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.18175835900000001 2024-04-01T19:50:26.959 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.959 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.959 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:50:26.959 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.154925+0000", 2024-04-01T19:50:26.959 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7853999999999999e-05 2024-04-01T19:50:26.959 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.959 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.959 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:50:26.959 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.154965+0000", 2024-04-01T19:50:26.959 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9610000000000002e-05 2024-04-01T19:50:26.959 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:26.960 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:50:26.960 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:26.960 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.960 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.960 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:31541 7.7 7:e6e3d096:::benchmark_data_smithi188_147022_object31540:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:50:26.960 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:45.971577+0000", 2024-04-01T19:50:26.960 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.947963064, 2024-04-01T19:50:26.960 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.18458508600000001, 2024-04-01T19:50:26.960 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:50:26.960 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:50:26.960 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:26.960 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:50:26.960 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:50:26.960 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:26.960 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 31541 2024-04-01T19:50:26.961 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.961 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:50:26.961 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.961 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:50:26.961 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.971577+0000", 2024-04-01T19:50:26.961 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:26.961 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.961 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.961 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:50:26.961 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.971577+0000", 2024-04-01T19:50:26.961 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:26.961 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.961 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.962 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:50:26.962 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.971578+0000", 2024-04-01T19:50:26.962 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0780000000000001e-06 2024-04-01T19:50:26.962 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.962 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.962 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:50:26.962 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.971641+0000", 2024-04-01T19:50:26.962 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2241000000000003e-05 2024-04-01T19:50:26.962 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.962 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.963 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:50:26.963 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.971651+0000", 2024-04-01T19:50:26.963 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.012e-05 2024-04-01T19:50:26.963 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.963 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.963 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:50:26.963 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.971656+0000", 2024-04-01T19:50:26.963 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8350000000000003e-06 2024-04-01T19:50:26.963 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.963 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.963 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:50:26.963 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.971943+0000", 2024-04-01T19:50:26.963 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00028743099999999999 2024-04-01T19:50:26.963 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.964 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.964 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:50:26.964 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.972076+0000", 2024-04-01T19:50:26.964 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013280799999999999 2024-04-01T19:50:26.964 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.964 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.964 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T19:50:26.964 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.972205+0000", 2024-04-01T19:50:26.964 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000129252 2024-04-01T19:50:26.964 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.964 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.964 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:50:26.964 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.973232+0000", 2024-04-01T19:50:26.964 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.001027427 2024-04-01T19:50:26.965 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.965 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.965 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:26.965 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.156072+0000", 2024-04-01T19:50:26.965 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.18283970899999999 2024-04-01T19:50:26.965 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.965 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.965 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:50:26.965 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.156125+0000", 2024-04-01T19:50:26.965 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2497999999999998e-05 2024-04-01T19:50:26.965 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.965 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.965 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:50:26.965 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.156162+0000", 2024-04-01T19:50:26.966 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.7687e-05 2024-04-01T19:50:26.966 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:26.966 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:50:26.966 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:26.966 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.966 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.966 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:31550 7.7 7:eeca41cf:::benchmark_data_smithi188_147022_object31549:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:50:26.966 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:45.973923+0000", 2024-04-01T19:50:26.966 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.945617189000004, 2024-04-01T19:50:26.966 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.18235397, 2024-04-01T19:50:26.966 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:50:26.966 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:50:26.966 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:26.967 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:50:26.967 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:50:26.967 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:26.967 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 31550 2024-04-01T19:50:26.967 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.967 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:50:26.967 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.967 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:50:26.967 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.973923+0000", 2024-04-01T19:50:26.967 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:26.967 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.968 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.968 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:50:26.968 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.973923+0000", 2024-04-01T19:50:26.968 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:26.968 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.968 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.968 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:50:26.968 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.973925+0000", 2024-04-01T19:50:26.968 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.6610000000000001e-06 2024-04-01T19:50:26.968 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.968 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.968 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:50:26.968 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.974030+0000", 2024-04-01T19:50:26.969 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00010470499999999999 2024-04-01T19:50:26.969 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.969 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.969 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:50:26.969 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.974042+0000", 2024-04-01T19:50:26.969 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2035000000000001e-05 2024-04-01T19:50:26.969 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.969 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.969 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:50:26.969 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.974050+0000", 2024-04-01T19:50:26.969 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.5750000000000001e-06 2024-04-01T19:50:26.969 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.969 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.970 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:50:26.970 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.974111+0000", 2024-04-01T19:50:26.970 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.0569999999999998e-05 2024-04-01T19:50:26.970 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.970 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.970 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:50:26.970 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.974221+0000", 2024-04-01T19:50:26.970 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000110485 2024-04-01T19:50:26.970 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.970 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.970 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T19:50:26.970 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.974348+0000", 2024-04-01T19:50:26.970 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012690800000000001 2024-04-01T19:50:26.971 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.971 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.971 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:50:26.971 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.975312+0000", 2024-04-01T19:50:26.971 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00096376399999999998 2024-04-01T19:50:26.971 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.971 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.971 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:26.971 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.156206+0000", 2024-04-01T19:50:26.971 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.18089391899999999 2024-04-01T19:50:26.971 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.971 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.971 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:50:26.971 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.156238+0000", 2024-04-01T19:50:26.972 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.2379000000000003e-05 2024-04-01T19:50:26.972 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.972 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.972 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:50:26.972 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.156277+0000", 2024-04-01T19:50:26.972 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8968999999999999e-05 2024-04-01T19:50:26.972 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:26.972 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:50:26.972 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:26.972 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.972 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.972 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:31572 7.7 7:e6e2beb1:::benchmark_data_smithi188_147022_object31571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:50:26.972 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:45.981256+0000", 2024-04-01T19:50:26.972 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.938284564, 2024-04-01T19:50:26.972 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.17591066299999999, 2024-04-01T19:50:26.973 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:50:26.973 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:50:26.973 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:26.973 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:50:26.973 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:50:26.973 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:26.973 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 31572 2024-04-01T19:50:26.973 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.973 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:50:26.973 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.973 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:50:26.973 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.981256+0000", 2024-04-01T19:50:26.973 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:26.973 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.973 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.974 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:50:26.974 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.981256+0000", 2024-04-01T19:50:26.974 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:26.974 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.974 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.974 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:50:26.974 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.981258+0000", 2024-04-01T19:50:26.974 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.4059999999999999e-06 2024-04-01T19:50:26.974 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.974 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.974 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:50:26.974 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.981322+0000", 2024-04-01T19:50:26.974 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.4028000000000004e-05 2024-04-01T19:50:26.975 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.975 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.975 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:50:26.975 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.981337+0000", 2024-04-01T19:50:26.975 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4518999999999999e-05 2024-04-01T19:50:26.975 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.975 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.975 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:50:26.975 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.981346+0000", 2024-04-01T19:50:26.975 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.7170000000000003e-06 2024-04-01T19:50:26.975 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.975 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.976 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:50:26.976 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.981394+0000", 2024-04-01T19:50:26.976 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7902999999999999e-05 2024-04-01T19:50:26.976 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.976 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.976 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:50:26.976 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.981523+0000", 2024-04-01T19:50:26.976 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000128658 2024-04-01T19:50:26.976 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.976 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.976 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T19:50:26.976 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.981685+0000", 2024-04-01T19:50:26.976 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00016220199999999999 2024-04-01T19:50:26.976 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.977 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.977 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:50:26.977 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.982734+0000", 2024-04-01T19:50:26.977 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0010491070000000001 2024-04-01T19:50:26.977 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.977 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.977 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:26.977 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.157109+0000", 2024-04-01T19:50:26.977 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.17437504100000001 2024-04-01T19:50:26.977 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.977 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.977 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:50:26.977 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.157143+0000", 2024-04-01T19:50:26.978 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.3319999999999999e-05 2024-04-01T19:50:26.978 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.978 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.978 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:50:26.978 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.157166+0000", 2024-04-01T19:50:26.978 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3762000000000001e-05 2024-04-01T19:50:26.978 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:26.978 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:50:26.978 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:26.978 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.978 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.978 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:31589 7.7 7:ece83e20:::benchmark_data_smithi188_147022_object31588:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:50:26.979 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:45.986038+0000", 2024-04-01T19:50:26.979 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.933502451000003, 2024-04-01T19:50:26.979 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.171304445, 2024-04-01T19:50:26.979 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:50:26.979 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:50:26.979 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:26.979 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:50:26.979 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:50:26.979 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:26.979 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 31589 2024-04-01T19:50:26.979 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.979 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:50:26.979 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.980 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:50:26.980 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.986038+0000", 2024-04-01T19:50:26.980 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:26.980 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.980 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.980 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:50:26.980 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.986038+0000", 2024-04-01T19:50:26.980 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:26.980 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.980 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.980 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:50:26.980 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.986039+0000", 2024-04-01T19:50:26.980 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1930000000000001e-06 2024-04-01T19:50:26.981 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.981 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.981 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:50:26.981 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.986139+0000", 2024-04-01T19:50:26.981 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.9622000000000003e-05 2024-04-01T19:50:26.981 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.981 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.981 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:50:26.981 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.986147+0000", 2024-04-01T19:50:26.981 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.7849999999999992e-06 2024-04-01T19:50:26.982 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.983 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.983 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:50:26.983 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.986151+0000", 2024-04-01T19:50:26.983 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7849999999999999e-06 2024-04-01T19:50:26.983 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.983 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.983 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:50:26.983 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.986192+0000", 2024-04-01T19:50:26.983 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0917000000000001e-05 2024-04-01T19:50:26.983 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.983 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.984 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:50:26.984 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.986275+0000", 2024-04-01T19:50:26.984 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.3058000000000003e-05 2024-04-01T19:50:26.984 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.984 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.984 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T19:50:26.984 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.986371+0000", 2024-04-01T19:50:26.984 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.5489999999999995e-05 2024-04-01T19:50:26.984 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.984 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.984 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:50:26.984 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.987564+0000", 2024-04-01T19:50:26.984 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0011932119999999999 2024-04-01T19:50:26.985 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.985 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.985 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:26.985 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.157268+0000", 2024-04-01T19:50:26.985 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.169704366 2024-04-01T19:50:26.985 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.985 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.985 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:50:26.985 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.157301+0000", 2024-04-01T19:50:26.985 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.2382999999999998e-05 2024-04-01T19:50:26.985 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.985 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.985 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:50:26.986 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.157342+0000", 2024-04-01T19:50:26.986 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.1634000000000002e-05 2024-04-01T19:50:26.986 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:26.986 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:50:26.986 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:26.986 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.986 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.986 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:31610 7.7 7:e554de32:::benchmark_data_smithi188_147022_object31609:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:50:26.986 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:45.992592+0000", 2024-04-01T19:50:26.986 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.926948762000002, 2024-04-01T19:50:26.986 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.16563830700000001, 2024-04-01T19:50:26.986 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:50:26.987 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:50:26.987 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:26.987 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:50:26.987 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:50:26.987 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:26.987 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 31610 2024-04-01T19:50:26.987 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.987 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:50:26.987 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.987 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:50:26.987 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.992592+0000", 2024-04-01T19:50:26.987 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:26.987 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.987 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.988 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:50:26.988 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.992592+0000", 2024-04-01T19:50:26.988 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:26.988 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.988 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.988 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:50:26.988 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.992593+0000", 2024-04-01T19:50:26.988 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2529999999999999e-06 2024-04-01T19:50:26.988 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.988 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.988 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:50:26.988 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.992662+0000", 2024-04-01T19:50:26.988 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9632e-05 2024-04-01T19:50:26.989 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.989 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.989 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:50:26.989 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.992671+0000", 2024-04-01T19:50:26.989 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.9129999999999992e-06 2024-04-01T19:50:26.989 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.989 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.989 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:50:26.989 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.992678+0000", 2024-04-01T19:50:26.989 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9949999999999999e-06 2024-04-01T19:50:26.989 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.989 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.989 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:50:26.989 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.992736+0000", 2024-04-01T19:50:26.990 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7519999999999998e-05 2024-04-01T19:50:26.990 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.990 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.990 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:50:26.990 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.992819+0000", 2024-04-01T19:50:26.990 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.2910000000000004e-05 2024-04-01T19:50:26.990 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.990 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.990 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T19:50:26.990 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.992953+0000", 2024-04-01T19:50:26.990 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000134115 2024-04-01T19:50:26.990 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.990 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.990 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:50:26.991 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.994107+0000", 2024-04-01T19:50:26.991 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.001154356 2024-04-01T19:50:26.991 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.991 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.991 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:26.991 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.158159+0000", 2024-04-01T19:50:26.991 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.16405176099999999 2024-04-01T19:50:26.991 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.991 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.991 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:50:26.991 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.158195+0000", 2024-04-01T19:50:26.991 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.6072000000000003e-05 2024-04-01T19:50:26.991 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.991 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.992 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:50:26.992 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.158230+0000", 2024-04-01T19:50:26.992 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.4780000000000002e-05 2024-04-01T19:50:26.992 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:26.992 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:50:26.992 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:26.992 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.992 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.992 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:31618 7.7 7:e1fe5ce6:::benchmark_data_smithi188_147022_object31617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:50:26.992 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:45.995948+0000", 2024-04-01T19:50:26.992 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.923592747999997, 2024-04-01T19:50:26.992 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.16236858000000001, 2024-04-01T19:50:26.992 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:50:26.993 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:50:26.993 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:26.993 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:50:26.993 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:50:26.993 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:26.993 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 31618 2024-04-01T19:50:26.993 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.993 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:50:26.993 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.993 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:50:26.993 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.995948+0000", 2024-04-01T19:50:26.993 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:26.993 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.993 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.994 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:50:26.994 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.995948+0000", 2024-04-01T19:50:26.994 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:26.994 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.994 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.994 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:50:26.994 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.995949+0000", 2024-04-01T19:50:26.994 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.046e-06 2024-04-01T19:50:26.994 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.994 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.994 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:50:26.994 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.996008+0000", 2024-04-01T19:50:26.994 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.9218000000000001e-05 2024-04-01T19:50:26.994 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.995 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.995 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:50:26.995 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.996018+0000", 2024-04-01T19:50:26.995 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0524e-05 2024-04-01T19:50:26.995 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.995 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.995 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:50:26.995 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.996026+0000", 2024-04-01T19:50:26.995 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.695e-06 2024-04-01T19:50:26.995 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.995 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.995 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:50:26.995 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.996076+0000", 2024-04-01T19:50:26.996 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0398000000000001e-05 2024-04-01T19:50:26.996 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.996 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.996 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:50:26.996 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.996189+0000", 2024-04-01T19:50:26.996 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000112718 2024-04-01T19:50:26.996 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.996 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.996 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T19:50:26.996 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.996338+0000", 2024-04-01T19:50:26.996 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000149278 2024-04-01T19:50:26.996 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.996 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.996 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:50:26.997 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.997096+0000", 2024-04-01T19:50:26.997 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00075754700000000002 2024-04-01T19:50:26.997 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.997 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.997 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:26.997 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.158258+0000", 2024-04-01T19:50:26.997 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.16116202199999999 2024-04-01T19:50:26.997 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.997 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.997 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:50:26.997 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.158290+0000", 2024-04-01T19:50:26.997 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.2289000000000002e-05 2024-04-01T19:50:26.997 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.997 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.998 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:50:26.998 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.158316+0000", 2024-04-01T19:50:26.998 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.5845000000000001e-05 2024-04-01T19:50:26.998 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:26.998 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:50:26.998 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:26.998 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.998 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.998 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:31631 7.7 7:e3b9302a:::benchmark_data_smithi188_147022_object31630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:50:26.998 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:46.000354+0000", 2024-04-01T19:50:26.998 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.919186287999999, 2024-04-01T19:50:26.998 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.159149977, 2024-04-01T19:50:26.998 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:50:26.999 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:50:26.999 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:26.999 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:50:26.999 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:50:26.999 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:26.999 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 31631 2024-04-01T19:50:26.999 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.999 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:50:26.999 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:26.999 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:50:26.999 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.000354+0000", 2024-04-01T19:50:26.999 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:26.999 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:26.999 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.000 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:50:27.000 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.000354+0000", 2024-04-01T19:50:27.000 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:27.000 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.000 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.000 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:50:27.000 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.000355+0000", 2024-04-01T19:50:27.000 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.108e-06 2024-04-01T19:50:27.000 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.000 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.000 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:50:27.000 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.000440+0000", 2024-04-01T19:50:27.000 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.5296000000000005e-05 2024-04-01T19:50:27.000 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.001 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.001 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:50:27.001 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.000450+0000", 2024-04-01T19:50:27.001 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.7240000000000004e-06 2024-04-01T19:50:27.001 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.001 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.001 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:50:27.001 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.000456+0000", 2024-04-01T19:50:27.001 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8289999999999996e-06 2024-04-01T19:50:27.001 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.001 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.001 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:50:27.001 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.000502+0000", 2024-04-01T19:50:27.001 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.5836e-05 2024-04-01T19:50:27.002 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.002 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.002 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:50:27.002 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.000580+0000", 2024-04-01T19:50:27.002 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.7764999999999998e-05 2024-04-01T19:50:27.002 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.002 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.002 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T19:50:27.002 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.000673+0000", 2024-04-01T19:50:27.002 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.2910000000000003e-05 2024-04-01T19:50:27.002 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.002 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.002 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:50:27.003 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.002265+0000", 2024-04-01T19:50:27.003 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0015920839999999999 2024-04-01T19:50:27.003 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.003 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.003 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:27.003 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.159403+0000", 2024-04-01T19:50:27.003 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.15713809400000001 2024-04-01T19:50:27.003 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.003 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.003 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:50:27.003 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.159462+0000", 2024-04-01T19:50:27.003 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.9243000000000002e-05 2024-04-01T19:50:27.003 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.003 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.004 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:50:27.004 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.159504+0000", 2024-04-01T19:50:27.004 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.2088000000000001e-05 2024-04-01T19:50:27.004 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:27.004 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:50:27.004 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:27.004 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.004 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.004 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:31632 7.7 7:ef30a6a2:::benchmark_data_smithi188_147022_object31631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:50:27.004 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:46.000606+0000", 2024-04-01T19:50:27.004 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.918934587000003, 2024-04-01T19:50:27.004 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.159030853, 2024-04-01T19:50:27.004 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:50:27.004 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:50:27.005 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:27.005 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:50:27.005 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:50:27.005 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:27.005 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 31632 2024-04-01T19:50:27.005 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.005 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:50:27.005 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.005 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:50:27.005 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.000606+0000", 2024-04-01T19:50:27.005 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:27.005 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.005 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.005 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:50:27.005 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.000606+0000", 2024-04-01T19:50:27.006 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:27.006 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.006 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.006 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:50:27.006 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.000607+0000", 2024-04-01T19:50:27.006 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.7700000000000003e-07 2024-04-01T19:50:27.006 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.006 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.006 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:50:27.006 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.000694+0000", 2024-04-01T19:50:27.006 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.6932e-05 2024-04-01T19:50:27.006 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.007 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.007 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:50:27.007 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.000699+0000", 2024-04-01T19:50:27.007 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7780000000000004e-06 2024-04-01T19:50:27.007 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.007 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.007 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:50:27.007 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.000706+0000", 2024-04-01T19:50:27.007 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.0180000000000004e-06 2024-04-01T19:50:27.007 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.007 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.008 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:50:27.008 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.001530+0000", 2024-04-01T19:50:27.008 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00082342699999999995 2024-04-01T19:50:27.008 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.008 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.008 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:50:27.008 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.001603+0000", 2024-04-01T19:50:27.008 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.3038000000000001e-05 2024-04-01T19:50:27.008 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.008 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.008 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T19:50:27.008 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.001685+0000", 2024-04-01T19:50:27.008 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.1693000000000005e-05 2024-04-01T19:50:27.009 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.009 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.009 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:50:27.009 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.002379+0000", 2024-04-01T19:50:27.009 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000694299 2024-04-01T19:50:27.009 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.009 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.009 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:27.009 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.159548+0000", 2024-04-01T19:50:27.009 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.157169473 2024-04-01T19:50:27.009 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.009 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.009 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:50:27.010 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.159599+0000", 2024-04-01T19:50:27.010 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0766000000000001e-05 2024-04-01T19:50:27.010 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.010 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.010 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:50:27.010 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.159637+0000", 2024-04-01T19:50:27.010 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.7552000000000002e-05 2024-04-01T19:50:27.010 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:27.010 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:50:27.010 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:27.010 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.010 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.011 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:31640 7.7 7:e4211284:::benchmark_data_smithi188_147022_object31639:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:50:27.011 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:46.004338+0000", 2024-04-01T19:50:27.011 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.915202333000003, 2024-04-01T19:50:27.011 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.156514193, 2024-04-01T19:50:27.011 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:50:27.011 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:50:27.011 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:27.011 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:50:27.011 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:50:27.011 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:27.011 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 31640 2024-04-01T19:50:27.011 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.011 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:50:27.011 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.012 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:50:27.012 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.004338+0000", 2024-04-01T19:50:27.012 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:27.012 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.012 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.012 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:50:27.012 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.004338+0000", 2024-04-01T19:50:27.012 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:27.012 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.012 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.012 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:50:27.012 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.004339+0000", 2024-04-01T19:50:27.012 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1489999999999999e-06 2024-04-01T19:50:27.012 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.013 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.013 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:50:27.013 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.004367+0000", 2024-04-01T19:50:27.013 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.7538999999999998e-05 2024-04-01T19:50:27.013 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.013 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.013 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:50:27.013 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.004376+0000", 2024-04-01T19:50:27.013 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.8389999999999996e-06 2024-04-01T19:50:27.013 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.013 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.013 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:50:27.013 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.004381+0000", 2024-04-01T19:50:27.013 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7440000000000004e-06 2024-04-01T19:50:27.013 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.014 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.014 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:50:27.014 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.004418+0000", 2024-04-01T19:50:27.014 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.6822000000000001e-05 2024-04-01T19:50:27.014 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.014 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.014 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:50:27.014 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.004493+0000", 2024-04-01T19:50:27.014 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.4849000000000001e-05 2024-04-01T19:50:27.014 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.014 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.014 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T19:50:27.014 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.004580+0000", 2024-04-01T19:50:27.015 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.7045000000000004e-05 2024-04-01T19:50:27.015 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.015 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.015 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:50:27.015 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.005172+0000", 2024-04-01T19:50:27.015 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00059232499999999999 2024-04-01T19:50:27.015 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.015 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.015 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:27.015 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.160773+0000", 2024-04-01T19:50:27.015 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.15560080100000001 2024-04-01T19:50:27.015 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.015 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.016 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:50:27.016 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.160812+0000", 2024-04-01T19:50:27.016 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8726999999999997e-05 2024-04-01T19:50:27.016 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.016 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.016 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:50:27.016 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.160852+0000", 2024-04-01T19:50:27.016 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0352999999999998e-05 2024-04-01T19:50:27.016 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:27.016 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:50:27.016 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:27.016 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.016 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.016 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:31660 7.7 7:effdb1a0:::benchmark_data_smithi188_147022_object31659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:50:27.017 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:46.016943+0000", 2024-04-01T19:50:27.017 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.902597849000003, 2024-04-01T19:50:27.017 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.144044704, 2024-04-01T19:50:27.017 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:50:27.017 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:50:27.017 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:27.017 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:50:27.017 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:50:27.017 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:27.017 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 31660 2024-04-01T19:50:27.017 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.017 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:50:27.017 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.018 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:50:27.018 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.016943+0000", 2024-04-01T19:50:27.018 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:27.018 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.018 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.018 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:50:27.018 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.016943+0000", 2024-04-01T19:50:27.018 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:27.018 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.018 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.018 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:50:27.018 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.016944+0000", 2024-04-01T19:50:27.019 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2240000000000001e-06 2024-04-01T19:50:27.019 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.019 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.019 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:50:27.019 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.017013+0000", 2024-04-01T19:50:27.019 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8836000000000003e-05 2024-04-01T19:50:27.019 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.019 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.019 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:50:27.019 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.017020+0000", 2024-04-01T19:50:27.019 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.8900000000000007e-06 2024-04-01T19:50:27.019 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.019 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.019 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:50:27.020 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.017026+0000", 2024-04-01T19:50:27.020 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1730000000000003e-06 2024-04-01T19:50:27.020 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.020 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.020 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:50:27.020 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.017073+0000", 2024-04-01T19:50:27.020 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7734000000000001e-05 2024-04-01T19:50:27.020 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.020 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.020 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:50:27.020 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.017154+0000", 2024-04-01T19:50:27.020 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0532999999999996e-05 2024-04-01T19:50:27.020 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.020 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.021 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T19:50:27.021 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.017257+0000", 2024-04-01T19:50:27.021 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00010302999999999999 2024-04-01T19:50:27.021 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.021 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.021 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:50:27.021 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.018191+0000", 2024-04-01T19:50:27.021 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00093436500000000004 2024-04-01T19:50:27.021 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.021 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.021 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:27.021 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.160897+0000", 2024-04-01T19:50:27.021 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.14270618500000001 2024-04-01T19:50:27.022 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.022 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.022 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:50:27.022 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.160950+0000", 2024-04-01T19:50:27.022 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2675e-05 2024-04-01T19:50:27.022 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.022 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.022 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:50:27.022 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.160987+0000", 2024-04-01T19:50:27.022 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.7058999999999999e-05 2024-04-01T19:50:27.022 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:27.022 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:50:27.022 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:27.022 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.023 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.023 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:31678 7.7 7:e078cdd0:::benchmark_data_smithi188_147022_object31677:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:50:27.023 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:46.033097+0000", 2024-04-01T19:50:27.023 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.886443217, 2024-04-01T19:50:27.023 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.129368922, 2024-04-01T19:50:27.023 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:50:27.023 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:50:27.023 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:27.023 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:50:27.023 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:50:27.023 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:27.023 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 31678 2024-04-01T19:50:27.023 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.024 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:50:27.024 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.024 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:50:27.024 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.033097+0000", 2024-04-01T19:50:27.024 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:27.024 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.024 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.024 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:50:27.024 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.033097+0000", 2024-04-01T19:50:27.024 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:27.024 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.024 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.024 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:50:27.024 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.033099+0000", 2024-04-01T19:50:27.025 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.013e-06 2024-04-01T19:50:27.025 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.025 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.025 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:50:27.025 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.033155+0000", 2024-04-01T19:50:27.025 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6320000000000003e-05 2024-04-01T19:50:27.025 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.025 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.025 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:50:27.025 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.033169+0000", 2024-04-01T19:50:27.025 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3203e-05 2024-04-01T19:50:27.025 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.025 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.025 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:50:27.026 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.033175+0000", 2024-04-01T19:50:27.026 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.9569999999999999e-06 2024-04-01T19:50:27.026 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.026 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.026 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:50:27.026 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.033222+0000", 2024-04-01T19:50:27.026 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7295e-05 2024-04-01T19:50:27.026 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.026 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.026 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:50:27.026 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.033357+0000", 2024-04-01T19:50:27.026 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000135458 2024-04-01T19:50:27.026 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.026 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.027 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T19:50:27.027 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.033515+0000", 2024-04-01T19:50:27.027 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00015722500000000001 2024-04-01T19:50:27.027 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.027 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.027 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:50:27.027 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.034526+0000", 2024-04-01T19:50:27.027 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0010113590000000001 2024-04-01T19:50:27.027 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.027 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.027 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:27.027 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.162367+0000", 2024-04-01T19:50:27.027 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.127841437 2024-04-01T19:50:27.028 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.028 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.028 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:50:27.028 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.162425+0000", 2024-04-01T19:50:27.028 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7917000000000001e-05 2024-04-01T19:50:27.028 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.028 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.028 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:50:27.028 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.162466+0000", 2024-04-01T19:50:27.028 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0738000000000002e-05 2024-04-01T19:50:27.028 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:27.028 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:50:27.028 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:27.029 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.029 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.029 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:31706 7.7 7:e83e14b3:::benchmark_data_smithi188_147022_object31705:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:50:27.029 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:46.086356+0000", 2024-04-01T19:50:27.029 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.833184746999997, 2024-04-01T19:50:27.029 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.076219467999999999, 2024-04-01T19:50:27.029 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:50:27.029 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:50:27.029 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:27.029 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:50:27.029 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:50:27.029 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:27.029 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 31706 2024-04-01T19:50:27.029 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.030 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:50:27.030 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.030 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:50:27.030 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.086356+0000", 2024-04-01T19:50:27.030 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:27.030 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.030 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.030 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:50:27.030 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.086356+0000", 2024-04-01T19:50:27.030 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:27.030 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.030 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.030 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:50:27.031 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.086357+0000", 2024-04-01T19:50:27.031 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.531e-06 2024-04-01T19:50:27.031 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.031 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.031 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:50:27.031 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.086380+0000", 2024-04-01T19:50:27.031 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.2476e-05 2024-04-01T19:50:27.031 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.031 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.031 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:50:27.031 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.086390+0000", 2024-04-01T19:50:27.031 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0077e-05 2024-04-01T19:50:27.031 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.032 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.032 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:50:27.032 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.086396+0000", 2024-04-01T19:50:27.032 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.0050000000000001e-06 2024-04-01T19:50:27.032 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.032 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.032 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:50:27.032 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.086439+0000", 2024-04-01T19:50:27.032 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3655999999999997e-05 2024-04-01T19:50:27.032 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.032 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.032 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:50:27.032 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.086535+0000", 2024-04-01T19:50:27.032 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.5964000000000005e-05 2024-04-01T19:50:27.033 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.033 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.033 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T19:50:27.033 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.086627+0000", 2024-04-01T19:50:27.033 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1352000000000002e-05 2024-04-01T19:50:27.033 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.033 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.033 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:50:27.033 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.087814+0000", 2024-04-01T19:50:27.033 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.001186971 2024-04-01T19:50:27.033 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.033 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.033 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:27.033 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.162502+0000", 2024-04-01T19:50:27.034 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.074688118999999997 2024-04-01T19:50:27.034 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.034 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.034 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:50:27.034 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.162536+0000", 2024-04-01T19:50:27.034 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.3869999999999999e-05 2024-04-01T19:50:27.034 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.034 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.034 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:50:27.034 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.162575+0000", 2024-04-01T19:50:27.034 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9446999999999997e-05 2024-04-01T19:50:27.034 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:27.034 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:50:27.034 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:27.035 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.035 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.035 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:38030 7.d 7:b53df03b:::benchmark_data_smithi188_147022_object38029:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:50:27.035 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:48.122510+0000", 2024-04-01T19:50:27.035 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 38.797030442999997, 2024-04-01T19:50:27.035 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.117010141, 2024-04-01T19:50:27.035 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:50:27.035 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:50:27.035 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:27.035 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:50:27.035 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:50:27.035 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:27.035 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 38030 2024-04-01T19:50:27.036 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.036 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:50:27.036 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.036 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:50:27.036 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.122510+0000", 2024-04-01T19:50:27.036 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:27.036 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.036 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.036 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:50:27.036 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.122510+0000", 2024-04-01T19:50:27.036 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:27.036 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.036 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.036 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:50:27.037 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.122511+0000", 2024-04-01T19:50:27.037 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3069999999999999e-06 2024-04-01T19:50:27.037 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.037 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.037 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:50:27.037 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.122564+0000", 2024-04-01T19:50:27.037 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2404000000000002e-05 2024-04-01T19:50:27.037 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.037 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.037 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:50:27.037 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.122573+0000", 2024-04-01T19:50:27.037 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1679999999999993e-06 2024-04-01T19:50:27.037 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.037 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.038 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:50:27.038 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.122578+0000", 2024-04-01T19:50:27.038 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5269999999999998e-06 2024-04-01T19:50:27.038 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.038 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.038 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:50:27.038 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.122646+0000", 2024-04-01T19:50:27.038 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.7742000000000003e-05 2024-04-01T19:50:27.038 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.038 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.038 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:50:27.038 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.122768+0000", 2024-04-01T19:50:27.038 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000121526 2024-04-01T19:50:27.039 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.039 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.039 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 0", 2024-04-01T19:50:27.039 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.122899+0000", 2024-04-01T19:50:27.039 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000131204 2024-04-01T19:50:27.039 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.039 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.039 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:50:27.039 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.124143+0000", 2024-04-01T19:50:27.039 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.001244347 2024-04-01T19:50:27.039 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.039 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.039 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:27.039 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.239404+0000", 2024-04-01T19:50:27.040 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.11526080700000001 2024-04-01T19:50:27.040 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.040 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.040 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:50:27.040 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.239473+0000", 2024-04-01T19:50:27.040 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9157000000000002e-05 2024-04-01T19:50:27.040 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.040 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.040 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:50:27.040 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.239520+0000", 2024-04-01T19:50:27.040 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6952e-05 2024-04-01T19:50:27.040 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:27.040 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:50:27.040 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:27.041 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.041 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.041 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:38049 7.d 7:bf177337:::benchmark_data_smithi188_147022_object38048:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:50:27.041 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:48.129885+0000", 2024-04-01T19:50:27.041 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 38.789655566, 2024-04-01T19:50:27.041 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.110355275, 2024-04-01T19:50:27.041 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:50:27.041 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:50:27.041 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:50:27.041 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:50:27.041 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:50:27.041 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:50:27.041 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 38049 2024-04-01T19:50:27.041 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.042 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:50:27.042 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.042 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:50:27.042 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.129885+0000", 2024-04-01T19:50:27.042 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:27.042 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.042 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.042 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:50:27.042 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.129885+0000", 2024-04-01T19:50:27.042 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:50:27.042 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.042 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.042 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:50:27.043 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.129886+0000", 2024-04-01T19:50:27.043 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3120000000000001e-06 2024-04-01T19:50:27.043 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.043 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.043 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:50:27.043 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.129949+0000", 2024-04-01T19:50:27.043 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3207000000000007e-05 2024-04-01T19:50:27.043 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.043 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.043 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:50:27.043 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.129959+0000", 2024-04-01T19:50:27.043 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.6509999999999996e-06 2024-04-01T19:50:27.044 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.044 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.044 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:50:27.044 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.129965+0000", 2024-04-01T19:50:27.044 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5400000000000003e-06 2024-04-01T19:50:27.044 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.044 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.044 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:50:27.044 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.130009+0000", 2024-04-01T19:50:27.044 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.4879999999999997e-05 2024-04-01T19:50:27.044 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.044 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.044 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:50:27.045 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.130092+0000", 2024-04-01T19:50:27.045 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.2896000000000001e-05 2024-04-01T19:50:27.045 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.045 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.045 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 0", 2024-04-01T19:50:27.045 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.130279+0000", 2024-04-01T19:50:27.045 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000186331 2024-04-01T19:50:27.045 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.045 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.045 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:50:27.045 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.131367+0000", 2024-04-01T19:50:27.045 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0010886209999999999 2024-04-01T19:50:27.045 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.045 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.045 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:50:27.046 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.240139+0000", 2024-04-01T19:50:27.046 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.108772043 2024-04-01T19:50:27.046 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.046 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.046 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:50:27.046 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.240198+0000", 2024-04-01T19:50:27.046 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8740999999999999e-05 2024-04-01T19:50:27.046 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:50:27.046 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:50:27.046 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:50:27.046 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:48.240240+0000", 2024-04-01T19:50:27.046 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.2052999999999999e-05 2024-04-01T19:50:27.046 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:27.046 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:50:27.047 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:27.047 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:50:27.047 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:50:27.047 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:50:27.047 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:50:27.089 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:27.196 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:50:27.199 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:27.200 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:50:27.301 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:50:27.355 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:27.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:27 smithi062 ceph-mon[44211]: pgmap v1584: 17 pgs: 17 active+clean; 6.9 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 132 MiB/s wr, 2.11k op/s 2024-04-01T19:50:27.538 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 49 16 116284 116268 148.285 99.3125 0.00490382 0.00674253 2024-04-01T19:50:27.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:27 smithi022 ceph-mon[39439]: pgmap v1584: 17 pgs: 17 active+clean; 6.9 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 132 MiB/s wr, 2.11k op/s 2024-04-01T19:50:27.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:27 smithi188 ceph-mon[43939]: pgmap v1584: 17 pgs: 17 active+clean; 6.9 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 132 MiB/s wr, 2.11k op/s 2024-04-01T19:50:27.626 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:50:27.632 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:27.632 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:50:27.733 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:50:27.773 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:28.146 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:50:28.151 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:28.152 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:50:28.165 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_ops_in_flight 2024-04-01T19:50:28.253 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:50:28.286 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:28.321 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:50:28.324 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:28.324 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:50:28.392 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:50:28.425 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:50:28.425 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:50:28.456 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:28 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/532803407' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:50:28.456 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:28 smithi062 ceph-mon[44211]: from='client.26692 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:50:28.457 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:28.480 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:50:28.482 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:28 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/532803407' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:50:28.482 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:28 smithi022 ceph-mon[39439]: from='client.26692 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:50:28.485 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:28.486 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:50:28.538 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 50 16 117740 117724 147.139 91 0.00394428 0.0067948 2024-04-01T19:50:28.586 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:50:28.614 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:28 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/532803407' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:50:28.615 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:28 smithi188 ceph-mon[43939]: from='client.26692 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:50:28.616 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:28.639 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:50:28.642 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:28.642 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:50:28.670 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:50:28.742 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:50:28.784 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:28.800 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:50:28.804 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:28.805 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:50:28.906 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:50:28.939 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:28.971 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:50:28.974 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:28.975 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:50:29.075 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:50:29.120 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:29.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:29 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:50:29.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:29 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:50:29.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:29 smithi022 ceph-mon[39439]: from='client.26692 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:50:29.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:29 smithi022 ceph-mon[39439]: osdmap e577: 12 total, 12 up, 11 in 2024-04-01T19:50:29.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:29 smithi022 ceph-mon[39439]: pgmap v1586: 17 pgs: 17 active+clean; 7.0 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 81 MiB/s wr, 1.29k op/s 2024-04-01T19:50:29.538 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 51 15 119193 119178 146.036 90.875 0.00745992 0.00684619 2024-04-01T19:50:29.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:29 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:50:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:29 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:50:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:29 smithi188 ceph-mon[43939]: from='client.26692 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:50:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:29 smithi188 ceph-mon[43939]: osdmap e577: 12 total, 12 up, 11 in 2024-04-01T19:50:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:29 smithi188 ceph-mon[43939]: pgmap v1586: 17 pgs: 17 active+clean; 7.0 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 81 MiB/s wr, 1.29k op/s 2024-04-01T19:50:29.676 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 7, 9, 10, 11, 8, 6] out_osds: [1] dead_osds: [] live_osds: [0, 2, 3, 4, 5, 7, 9, 10, 11, 8, 6, 1] 2024-04-01T19:50:29.676 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-01T19:50:29.677 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-04-01T19:50:29.677 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.0 reset_purged_snaps_last 2024-04-01T19:50:29.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:29 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:50:29.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:29 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:50:29.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:29 smithi062 ceph-mon[44211]: from='client.26692 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:50:29.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:29 smithi062 ceph-mon[44211]: osdmap e577: 12 total, 12 up, 11 in 2024-04-01T19:50:29.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:29 smithi062 ceph-mon[44211]: pgmap v1586: 17 pgs: 17 active+clean; 7.0 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 81 MiB/s wr, 1.29k op/s 2024-04-01T19:50:30.538 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 52 16 120678 120662 145.011 92.75 0.00616079 0.0068951 2024-04-01T19:50:30.630 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:50:30.632 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:30.633 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:50:30.733 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:50:30.775 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:30.802 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:50:30.807 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:30.807 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:50:30.908 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:50:30.964 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:31.143 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:50:31.149 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:31.150 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:50:31.251 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:50:31.290 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:31.330 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:31.331 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:50:31.331 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:50:31.432 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:50:31.464 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:31.487 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:50:31.490 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:31.491 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:50:31.538 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 53 16 122161 122145 144.024 92.6875 0.0101086 0.00694177 2024-04-01T19:50:31.591 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:50:31.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:31 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:50:31.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:31 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:50:31.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:31 smithi022 ceph-mon[39439]: osdmap e578: 12 total, 12 up, 11 in 2024-04-01T19:50:31.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:31 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:50:31.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:31 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:50:31.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:31 smithi022 ceph-mon[39439]: pgmap v1588: 17 pgs: 17 active+clean; 7.3 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 136 MiB/s wr, 2.17k op/s 2024-04-01T19:50:31.620 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:31 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:50:31.621 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:31 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:50:31.621 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:31 smithi188 ceph-mon[43939]: osdmap e578: 12 total, 12 up, 11 in 2024-04-01T19:50:31.621 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:31 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:50:31.621 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:31 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:50:31.621 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:31 smithi188 ceph-mon[43939]: pgmap v1588: 17 pgs: 17 active+clean; 7.3 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 136 MiB/s wr, 2.17k op/s 2024-04-01T19:50:31.623 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:31.632 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:50:31.649 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:50:31.654 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:31.655 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:50:31.707 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:50:31.755 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:50:31.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:31 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:50:31.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:31 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:50:31.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:31 smithi062 ceph-mon[44211]: osdmap e578: 12 total, 12 up, 11 in 2024-04-01T19:50:31.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:31 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:50:31.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:31 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:50:31.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:31 smithi062 ceph-mon[44211]: pgmap v1588: 17 pgs: 17 active+clean; 7.3 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 136 MiB/s wr, 2.17k op/s 2024-04-01T19:50:31.794 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:31.940 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:50:31.946 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:31.947 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:50:32.048 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:50:32.084 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:32.112 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:50:32.120 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:32.120 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:50:32.221 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:50:32.290 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:32.365 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:32 smithi062 ceph-mon[44211]: osdmap e579: 12 total, 12 up, 11 in 2024-04-01T19:50:32.365 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:50:32.365 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:50:32.365 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:50:32.365 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:50:32.365 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:50:32.365 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:50:32.365 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:50:32.539 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 54 16 123538 123522 142.95 86.0625 0.00517549 0.00699406 2024-04-01T19:50:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:32 smithi022 ceph-mon[39439]: osdmap e579: 12 total, 12 up, 11 in 2024-04-01T19:50:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:50:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:50:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:50:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:50:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:50:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:50:32.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:50:32.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:32 smithi188 ceph-mon[43939]: osdmap e579: 12 total, 12 up, 11 in 2024-04-01T19:50:32.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:50:32.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:50:32.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:50:32.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:50:32.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:50:32.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:50:32.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:50:32.673 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:50:33.539 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 55 16 124963 124947 141.97 89.0625 0.0121748 0.00704247 2024-04-01T19:50:33.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:33 smithi188 ceph-mon[43939]: 7.4 scrub starts 2024-04-01T19:50:33.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:33 smithi188 ceph-mon[43939]: pgmap v1590: 17 pgs: 17 active+clean; 7.4 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 79 MiB/s wr, 1.26k op/s 2024-04-01T19:50:33.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:33 smithi062 ceph-mon[44211]: 7.4 scrub starts 2024-04-01T19:50:33.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:33 smithi062 ceph-mon[44211]: pgmap v1590: 17 pgs: 17 active+clean; 7.4 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 79 MiB/s wr, 1.26k op/s 2024-04-01T19:50:33.844 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:33 smithi022 ceph-mon[39439]: 7.4 scrub starts 2024-04-01T19:50:33.844 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:33 smithi022 ceph-mon[39439]: pgmap v1590: 17 pgs: 17 active+clean; 7.4 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 79 MiB/s wr, 1.26k op/s 2024-04-01T19:50:34.117 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:50:34.121 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:34.121 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:50:34.223 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:50:34.257 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:34.285 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:50:34.288 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:34.288 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:50:34.389 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:50:34.434 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:34.462 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:50:34.474 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:34.474 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:50:34.489 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:34 smithi022 ceph-mon[39439]: 7.4 scrub ok 2024-04-01T19:50:34.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:34 smithi062 ceph-mon[44211]: 7.4 scrub ok 2024-04-01T19:50:34.539 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 56 16 126417 126401 141.058 90.875 0.00600301 0.00708783 2024-04-01T19:50:34.575 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:50:34.622 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:34.652 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:50:34.659 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:34.659 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:50:34.760 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:50:34.798 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:34.822 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:50:34.828 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:34.829 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:50:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:34 smithi188 ceph-mon[43939]: 7.4 scrub ok 2024-04-01T19:50:34.929 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:50:34.976 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:34.999 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:50:35.004 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:35.005 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:50:35.106 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:50:35.139 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:35.168 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:50:35.174 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:35.175 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:50:35.276 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:50:35.315 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:35.340 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:50:35.347 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:35.347 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:50:35.448 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:50:35.489 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:50:35.489 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:50:35.489 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 0 2024-04-01T19:50:35.489 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:50:35.520 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:35.539 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 57 16 127780 127764 140.078 85.1875 0.0203471 0.00713761 2024-04-01T19:50:35.553 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:50:35.557 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:35.558 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:50:35.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:35 smithi188 ceph-mon[43939]: 7.c scrub starts 2024-04-01T19:50:35.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:35 smithi188 ceph-mon[43939]: pgmap v1591: 17 pgs: 17 active+clean; 7.4 GiB data, 20 GiB used, 964 GiB / 983 GiB avail; 68 MiB/s wr, 1.09k op/s 2024-04-01T19:50:35.658 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:50:35.702 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:35.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:35 smithi022 ceph-mon[39439]: 7.c scrub starts 2024-04-01T19:50:35.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:35 smithi022 ceph-mon[39439]: pgmap v1591: 17 pgs: 17 active+clean; 7.4 GiB data, 20 GiB used, 964 GiB / 983 GiB avail; 68 MiB/s wr, 1.09k op/s 2024-04-01T19:50:35.975 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:50:35.989 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:35.990 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:50:36.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:35 smithi062 ceph-mon[44211]: 7.c scrub starts 2024-04-01T19:50:36.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:35 smithi062 ceph-mon[44211]: pgmap v1591: 17 pgs: 17 active+clean; 7.4 GiB data, 20 GiB used, 964 GiB / 983 GiB avail; 68 MiB/s wr, 1.09k op/s 2024-04-01T19:50:36.091 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:50:36.136 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:36.174 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:50:36.181 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:36.182 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:50:36.283 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:50:36.316 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:36.454 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:50:36.460 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:36.460 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:50:36.539 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 58 16 129203 129187 139.196 88.9375 0.00689554 0.00718301 2024-04-01T19:50:36.561 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:50:36.599 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:36.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:36 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T19:50:36.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:36 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T19:50:36.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:36 smithi022 ceph-mon[39439]: 7.c scrub ok 2024-04-01T19:50:36.625 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:50:36.627 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:36.628 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:50:36.729 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:50:36.789 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:36.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:36 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T19:50:36.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:36 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T19:50:36.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:36 smithi188 ceph-mon[43939]: 7.c scrub ok 2024-04-01T19:50:37.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:36 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T19:50:37.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:36 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T19:50:37.015 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:36 smithi062 ceph-mon[44211]: 7.c scrub ok 2024-04-01T19:50:37.031 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:50:37.069 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:50:37.118 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:50:37.165 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:50:37.199 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:50:37.228 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:50:37.269 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:50:37.301 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:50:37.336 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:50:37.364 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:50:37.392 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:50:37.420 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:50:37.438 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:50:37.438 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:50:37.438 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:50:37.438 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:50:37.438 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:50:37.438 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:50:37.438 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:50:37.438 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:50:37.438 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:50:37.438 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:50:37.438 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:50:37.439 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:50:37.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:37 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1195513632' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:50:37.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:37 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:37.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:37 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:37.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:37 smithi022 ceph-mon[39439]: pgmap v1592: 17 pgs: 17 active+clean; 7.8 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 107 MiB/s wr, 1.71k op/s 2024-04-01T19:50:37.539 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 59 16 130560 130544 138.274 84.8125 0.00916492 0.00723056 2024-04-01T19:50:37.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:37 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1195513632' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:50:37.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:37 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:37.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:37 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:37.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:37 smithi188 ceph-mon[43939]: pgmap v1592: 17 pgs: 17 active+clean; 7.8 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 107 MiB/s wr, 1.71k op/s 2024-04-01T19:50:38.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:37 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1195513632' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:50:38.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:37 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:38.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:37 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:37 smithi062 ceph-mon[44211]: pgmap v1592: 17 pgs: 17 active+clean; 7.8 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 107 MiB/s wr, 1.71k op/s 2024-04-01T19:50:38.539 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:50:38.542730 min lat: 0.00105017 max lat: 0.212434 avg lat: 0.00727127 2024-04-01T19:50:38.539 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:50:38.539 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 60 15 132033 132018 137.505 92.125 0.00513287 0.00727127 2024-04-01T19:50:38.670 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:50:38.674 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:38.674 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:50:38.776 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:50:38.822 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:38 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:50:38.822 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:38 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:50:38.822 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:38.822 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:38.823 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:38.823 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:38.823 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:38.823 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:38.823 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:38.823 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:38.823 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:38.823 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:38.823 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:38 smithi022 ceph-mon[39439]: osdmap e580: 12 total, 12 up, 11 in 2024-04-01T19:50:38.828 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:38.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:38 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:50:38.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:38 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:50:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:38 smithi188 ceph-mon[43939]: osdmap e580: 12 total, 12 up, 11 in 2024-04-01T19:50:39.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:38 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:50:39.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:38 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:50:39.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:39.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:39.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:39.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:39.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:39.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:39.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:39.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:39.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:39.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:39.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:38 smithi062 ceph-mon[44211]: osdmap e580: 12 total, 12 up, 11 in 2024-04-01T19:50:39.293 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:50:39.301 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:39.301 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:50:39.341 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.2 reset_purged_snaps_last 2024-04-01T19:50:39.402 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:50:39.439 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:39.468 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:50:39.474 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:39.475 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:50:39.539 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 61 16 133457 133441 136.708 88.9375 0.0256208 0.00731321 2024-04-01T19:50:39.576 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:50:39.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:39 smithi022 ceph-mon[39439]: pgmap v1594: 17 pgs: 17 active+clean; 7.8 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 73 MiB/s wr, 1.17k op/s 2024-04-01T19:50:39.618 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:39.647 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:50:39.657 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:39.658 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:50:39.760 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:50:39.799 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:50:39.813 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:39.848 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_blocked_ops 2024-04-01T19:50:39.863 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:50:39.871 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:39.872 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:50:39.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:39 smithi188 ceph-mon[43939]: pgmap v1594: 17 pgs: 17 active+clean; 7.8 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 73 MiB/s wr, 1.17k op/s 2024-04-01T19:50:39.972 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:50:40.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:39 smithi062 ceph-mon[44211]: pgmap v1594: 17 pgs: 17 active+clean; 7.8 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 73 MiB/s wr, 1.17k op/s 2024-04-01T19:50:40.031 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:40.118 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:50:40.126 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:40.127 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:50:40.228 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:50:40.261 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:40.539 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 62 16 134738 134722 135.795 80.0625 0.0232403 0.00736319 2024-04-01T19:50:40.619 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:50:40.623 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:40.623 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:50:40.725 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:50:40.768 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:40.793 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:50:40.796 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:40.796 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:50:40.799 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:40 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:50:40.799 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:40 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:50:40.800 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:40 smithi022 ceph-mon[39439]: 7.0 scrub starts 2024-04-01T19:50:40.800 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:40 smithi022 ceph-mon[39439]: osdmap e581: 12 total, 12 up, 11 in 2024-04-01T19:50:40.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:40 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:50:40.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:40 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:50:40.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:40 smithi188 ceph-mon[43939]: 7.0 scrub starts 2024-04-01T19:50:40.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:40 smithi188 ceph-mon[43939]: osdmap e581: 12 total, 12 up, 11 in 2024-04-01T19:50:40.897 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:50:40.934 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:41.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:40 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:50:41.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:40 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:50:41.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:40 smithi062 ceph-mon[44211]: 7.0 scrub starts 2024-04-01T19:50:41.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:40 smithi062 ceph-mon[44211]: osdmap e581: 12 total, 12 up, 11 in 2024-04-01T19:50:41.147 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:50:41.152 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:50:41.154 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:41.155 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:50:41.221 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:50:41.256 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:50:41.302 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:41.471 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:50:41.475 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:41.476 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:50:41.542 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 63 16 136059 136043 134.945 82.5625 0.0102589 0.00740847 2024-04-01T19:50:41.576 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:50:41.641 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:41.666 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:50:41.671 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:41.672 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:50:41.773 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:50:41.818 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:41 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:50:41.818 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:41 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:50:41.819 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:41 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:50:41.819 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:41 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:50:41.819 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:41.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:41 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:50:41.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:41 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:50:41.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:41 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:50:41.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:41 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:50:42.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:41 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:50:42.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:41 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:50:42.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:41 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:50:42.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:41 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:50:42.542 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 64 16 137372 137356 134.118 82.0625 0.00485158 0.00745483 2024-04-01T19:50:42.636 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:50:42.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:42 smithi022 ceph-mon[39439]: 7.0 scrub ok 2024-04-01T19:50:42.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:42 smithi022 ceph-mon[39439]: 7.5 scrub starts 2024-04-01T19:50:42.887 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:42 smithi188 ceph-mon[43939]: 7.0 scrub ok 2024-04-01T19:50:42.887 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:42 smithi188 ceph-mon[43939]: 7.5 scrub starts 2024-04-01T19:50:43.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:42 smithi062 ceph-mon[44211]: 7.0 scrub ok 2024-04-01T19:50:43.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:42 smithi062 ceph-mon[44211]: 7.5 scrub starts 2024-04-01T19:50:43.395 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:50:43.399 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:43.400 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:50:43.501 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:50:43.542 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 65 16 138591 138575 133.227 76.1875 0.00958005 0.00750432 2024-04-01T19:50:43.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:43 smithi022 ceph-mon[39439]: pgmap v1597: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.2 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 103 MiB/s wr, 1.65k op/s 2024-04-01T19:50:43.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:43 smithi188 ceph-mon[43939]: pgmap v1597: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.2 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 103 MiB/s wr, 1.65k op/s 2024-04-01T19:50:44.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:43 smithi062 ceph-mon[44211]: pgmap v1597: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.2 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 103 MiB/s wr, 1.65k op/s 2024-04-01T19:50:44.542 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 66 16 139964 139948 132.508 85.8125 0.00582383 0.00754524 2024-04-01T19:50:44.595 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:44 smithi022 ceph-mon[39439]: 7.5 scrub ok 2024-04-01T19:50:44.652 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:44.804 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:50:44.862 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:44 smithi188 ceph-mon[43939]: 7.5 scrub ok 2024-04-01T19:50:44.863 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:44.863 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:50:44.965 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:50:45.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:44 smithi062 ceph-mon[44211]: 7.5 scrub ok 2024-04-01T19:50:45.024 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:45.487 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:50:45.504 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:45.505 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:50:45.542 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 67 16 141333 141317 131.807 85.5625 0.010111 0.00758558 2024-04-01T19:50:45.606 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:50:45.643 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:45.669 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:50:45.674 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:45.675 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:50:45.776 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:50:45.826 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:45 smithi022 ceph-mon[39439]: pgmap v1598: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.3 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 61 MiB/s wr, 973 op/s 2024-04-01T19:50:45.831 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:45.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:45 smithi188 ceph-mon[43939]: pgmap v1598: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.3 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 61 MiB/s wr, 973 op/s 2024-04-01T19:50:45.893 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:50:45.897 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:45.897 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:50:45.998 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:50:46.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:45 smithi062 ceph-mon[44211]: pgmap v1598: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.3 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 61 MiB/s wr, 973 op/s 2024-04-01T19:50:46.030 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:46.055 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:50:46.057 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:46.057 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:50:46.124 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:50:46.158 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:50:46.217 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:46.252 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:50:46.256 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:46.256 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:50:46.358 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:50:46.389 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:46.415 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:50:46.418 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:46.418 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:50:46.519 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:50:46.542 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 68 16 142584 142568 131.019 78.1875 0.0189932 0.00763073 2024-04-01T19:50:46.554 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:46.580 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:50:46.586 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:46.586 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:50:46.637 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:50:46.687 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:50:46.756 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:46.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:46 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3412353718' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:50:46.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:46 smithi022 ceph-mon[39439]: from='client.36740 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:50:46.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:46 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3412353718' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:50:46.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:46 smithi188 ceph-mon[43939]: from='client.36740 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:50:47.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:46 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3412353718' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:50:47.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:46 smithi062 ceph-mon[44211]: from='client.36740 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:50:47.542 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 69 16 143895 143879 130.307 81.9375 0.0106404 0.00767237 2024-04-01T19:50:47.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:47 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:50:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:47 smithi188 ceph-mon[43939]: from='client.36740 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:50:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:47 smithi188 ceph-mon[43939]: osdmap e582: 12 total, 12 up, 11 in 2024-04-01T19:50:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:47 smithi188 ceph-mon[43939]: pgmap v1600: 17 pgs: 17 active+clean; 8.6 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 99 MiB/s wr, 1.59k op/s 2024-04-01T19:50:48.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:47 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:50:48.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:47 smithi062 ceph-mon[44211]: from='client.36740 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:50:48.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:47 smithi062 ceph-mon[44211]: osdmap e582: 12 total, 12 up, 11 in 2024-04-01T19:50:48.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:47 smithi062 ceph-mon[44211]: pgmap v1600: 17 pgs: 17 active+clean; 8.6 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 99 MiB/s wr, 1.59k op/s 2024-04-01T19:50:48.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:47 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:50:48.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:47 smithi022 ceph-mon[39439]: from='client.36740 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:50:48.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:47 smithi022 ceph-mon[39439]: osdmap e582: 12 total, 12 up, 11 in 2024-04-01T19:50:48.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:47 smithi022 ceph-mon[39439]: pgmap v1600: 17 pgs: 17 active+clean; 8.6 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 99 MiB/s wr, 1.59k op/s 2024-04-01T19:50:48.542 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 70 16 145153 145137 129.569 78.625 0.0139373 0.00771626 2024-04-01T19:50:48.604 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:50:48.607 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:48.608 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:50:48.709 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:50:48.741 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:48.766 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:50:48.769 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:48.769 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:50:48.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:48 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:50:48.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:48 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:50:48.870 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:50:48.913 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:48 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:50:48.914 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:48 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:50:48.918 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:48.942 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:50:48.945 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:48.945 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:50:49.046 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:50:49.104 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:49.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:48 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:50:49.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:48 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:50:49.331 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.3 reset_purged_snaps_last 2024-04-01T19:50:49.542 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 71 16 146497 146481 128.927 84 0.00911407 0.0077546 2024-04-01T19:50:49.954 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:49 smithi022 ceph-mon[39439]: osdmap e583: 12 total, 12 up, 11 in 2024-04-01T19:50:49.954 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:49 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:50:49.954 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:49 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:50:49.955 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:49 smithi022 ceph-mon[39439]: pgmap v1602: 17 pgs: 17 active+clean; 8.7 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 68 MiB/s wr, 1.09k op/s 2024-04-01T19:50:50.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:49 smithi062 ceph-mon[44211]: osdmap e583: 12 total, 12 up, 11 in 2024-04-01T19:50:50.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:49 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:50:50.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:49 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:50:50.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:49 smithi062 ceph-mon[44211]: pgmap v1602: 17 pgs: 17 active+clean; 8.7 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 68 MiB/s wr, 1.09k op/s 2024-04-01T19:50:50.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:49 smithi188 ceph-mon[43939]: osdmap e583: 12 total, 12 up, 11 in 2024-04-01T19:50:50.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:49 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:50:50.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:49 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:50:50.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:49 smithi188 ceph-mon[43939]: pgmap v1602: 17 pgs: 17 active+clean; 8.7 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 68 MiB/s wr, 1.09k op/s 2024-04-01T19:50:50.203 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:50:50.206 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:50.207 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:50:50.309 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:50:50.346 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:50.369 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:50:50.375 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:50.376 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:50:50.477 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:50:50.524 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:50.542 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 72 16 147838 147822 128.301 83.8125 0.00797792 0.00779243 2024-04-01T19:50:50.546 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:50:50.554 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:50.555 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:50:50.656 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:50:50.691 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:50.729 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:50:50.732 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:50.733 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:50:50.834 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:50:50.901 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:51.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:50 smithi062 ceph-mon[44211]: osdmap e584: 12 total, 12 up, 11 in 2024-04-01T19:50:51.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:50 smithi062 ceph-mon[44211]: osdmap e585: 12 total, 12 up, 11 in 2024-04-01T19:50:51.063 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:50 smithi022 ceph-mon[39439]: osdmap e584: 12 total, 12 up, 11 in 2024-04-01T19:50:51.063 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:50 smithi022 ceph-mon[39439]: osdmap e585: 12 total, 12 up, 11 in 2024-04-01T19:50:51.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:50 smithi188 ceph-mon[43939]: osdmap e584: 12 total, 12 up, 11 in 2024-04-01T19:50:51.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:50 smithi188 ceph-mon[43939]: osdmap e585: 12 total, 12 up, 11 in 2024-04-01T19:50:51.543 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 73 16 149113 149097 127.634 79.6875 0.00566835 0.00783342 2024-04-01T19:50:51.782 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:50:51.789 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:51.790 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:50:51.887 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:50:51.887 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:50:51.887 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:50:51.887 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:50:51.887 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:50:51.887 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:50:51.887 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:50:51.891 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:50:51.900 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:50:51.914 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:50:51.925 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:51 smithi062 ceph-mon[44211]: pgmap v1605: 17 pgs: 17 active+clean; 8.9 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 72 MiB/s wr, 1.15k op/s 2024-04-01T19:50:51.925 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:51 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4070177248' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:50:51.926 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:51.937 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:50:51.957 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:50:52.006 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:50:52.006 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:52.007 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:50:52.007 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:50:52.039 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:50:52.046 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:50:52.046 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:50:52.046 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:50:52.046 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:50:52.046 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:50:52.046 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:50:52.046 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:50:52.047 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:50:52.047 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:50:52.047 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:50:52.047 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:50:52.047 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:50:52.072 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:51 smithi022 ceph-mon[39439]: pgmap v1605: 17 pgs: 17 active+clean; 8.9 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 72 MiB/s wr, 1.15k op/s 2024-04-01T19:50:52.072 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:51 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4070177248' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:50:52.107 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:50:52.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:51 smithi188 ceph-mon[43939]: pgmap v1605: 17 pgs: 17 active+clean; 8.9 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 72 MiB/s wr, 1.15k op/s 2024-04-01T19:50:52.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:51 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4070177248' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:50:52.138 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:52.166 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:50:52.171 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:52.171 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:50:52.272 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:50:52.304 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:52.329 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:50:52.334 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:52.334 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:50:52.435 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:50:52.500 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:52.543 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 74 16 150331 150315 126.938 76.125 0.00628582 0.00787604 2024-04-01T19:50:52.598 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:50:52.611 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:52.611 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:50:52.699 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:50:52.713 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:50:52.733 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:50:52.734 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:50:52.734 INFO:teuthology.orchestra.run.smithi022.stdout: "complaint_time": 30, 2024-04-01T19:50:52.734 INFO:teuthology.orchestra.run.smithi022.stdout: "num_blocked_ops": 0 2024-04-01T19:50:52.734 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:50:52.745 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:52.748 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:52.748 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:52.748 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:52.748 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:52.748 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:52.748 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:52.748 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:52.749 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:52.749 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:52.772 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:50:52.779 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:52.779 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:50:52.880 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:50:52.918 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:52.941 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:50:52.946 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:52.946 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:52.946 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:52.946 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:52.946 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:52.947 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:52.947 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:52.947 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:52.947 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:52.947 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:52.948 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:50:53.049 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:50:53.090 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:53.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:53.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:53.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:53.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:53.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:53.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:53.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:53.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:53.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:53.543 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 75 16 151595 151579 126.299 79 0.0144968 0.00791654 2024-04-01T19:50:54.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:54.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:54.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:54.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:53 smithi062 ceph-mon[44211]: pgmap v1606: 17 pgs: 17 active+clean; 9.0 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 68 MiB/s wr, 1.09k op/s 2024-04-01T19:50:54.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:54.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:54.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:54.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:53 smithi022 ceph-mon[39439]: pgmap v1606: 17 pgs: 17 active+clean; 9.0 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 68 MiB/s wr, 1.09k op/s 2024-04-01T19:50:54.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:54.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:54.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:50:54.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:53 smithi188 ceph-mon[43939]: pgmap v1606: 17 pgs: 17 active+clean; 9.0 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 68 MiB/s wr, 1.09k op/s 2024-04-01T19:50:54.483 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:50:54.491 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:54.492 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:50:54.543 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 76 16 152909 152893 125.718 82.125 0.00455207 0.00795252 2024-04-01T19:50:54.592 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:50:54.631 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:54.713 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:50:54.719 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:54.719 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:50:54.820 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:50:54.920 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:54.943 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:50:54.947 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:54.947 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:50:55.049 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:50:55.080 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:55.112 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:50:55.115 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:55.115 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:50:55.216 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:50:55.249 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:55.275 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:50:55.280 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:55.281 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:50:55.382 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:50:55.393 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_historic_ops 2024-04-01T19:50:55.419 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:55.443 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:50:55.446 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:55.447 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:50:55.543 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 77 16 154057 154041 125.017 71.75 0.0125327 0.00799757 2024-04-01T19:50:55.547 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:50:55.581 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:55.607 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:50:55.612 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:55.613 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:50:55.714 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:50:55.743 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:55.768 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:50:55.773 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:55.773 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:50:55.874 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:50:55.908 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:55.934 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:50:55.938 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:55.939 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:50:56.040 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:50:56.086 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:56.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:55 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:50:56.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:55 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:50:56.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:55 smithi062 ceph-mon[44211]: pgmap v1607: 17 pgs: 17 active+clean; 9.1 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 62 MiB/s wr, 989 op/s 2024-04-01T19:50:56.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:55 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:50:56.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:55 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:50:56.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:55 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:50:56.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:55 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:50:56.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:55 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:50:56.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:55 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:50:56.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:55 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:50:56.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:55 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:50:56.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:55 smithi022 ceph-mon[39439]: pgmap v1607: 17 pgs: 17 active+clean; 9.1 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 62 MiB/s wr, 989 op/s 2024-04-01T19:50:56.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:55 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:50:56.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:55 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:50:56.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:55 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:50:56.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:55 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:50:56.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:55 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:50:56.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:55 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:50:56.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:55 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:50:56.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:55 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:50:56.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:55 smithi188 ceph-mon[43939]: pgmap v1607: 17 pgs: 17 active+clean; 9.1 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 62 MiB/s wr, 989 op/s 2024-04-01T19:50:56.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:55 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:50:56.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:55 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:50:56.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:55 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:50:56.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:55 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:50:56.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:55 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:50:56.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:55 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:50:56.468 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:50:56.472 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:50:56.473 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:56.473 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:50:56.479 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:50:56.559 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 78 16 155180 155164 124.314 70.1875 0.0119032 0.00804252 2024-04-01T19:50:56.574 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:50:56.663 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:56.803 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:50:56.812 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:56.812 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:50:56.913 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:50:56.946 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:56.975 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:50:56.980 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:56.981 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:50:57.082 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:50:57.136 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:57.240 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:50:57.249 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:57.250 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:50:57.253 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:50:57.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:57 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:50:57.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:57 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:50:57.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:57 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:50:57.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:57 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:50:57.351 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:50:57.357 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:57 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:50:57.357 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:57 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:50:57.357 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:57 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:50:57.357 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:57 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:50:57.373 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:57 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:50:57.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:57 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:50:57.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:57 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:50:57.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:57 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:50:57.398 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:57.425 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:50:57.433 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:57.433 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:50:57.534 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:50:57.559 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 79 16 156304 156288 123.605 70.25 0.00618827 0.00808883 2024-04-01T19:50:57.603 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:58.019 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:50:58 smithi022 ceph-mon[39439]: pgmap v1608: 17 pgs: 17 active+clean; 9.4 GiB data, 24 GiB used, 960 GiB / 983 GiB avail; 93 MiB/s wr, 1.49k op/s 2024-04-01T19:50:58.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:50:58 smithi188 ceph-mon[43939]: pgmap v1608: 17 pgs: 17 active+clean; 9.4 GiB data, 24 GiB used, 960 GiB / 983 GiB avail; 93 MiB/s wr, 1.49k op/s 2024-04-01T19:50:58.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:50:58 smithi062 ceph-mon[44211]: pgmap v1608: 17 pgs: 17 active+clean; 9.4 GiB data, 24 GiB used, 960 GiB / 983 GiB avail; 93 MiB/s wr, 1.49k op/s 2024-04-01T19:50:58.559 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:50:58.562841 min lat: 0.00105017 max lat: 0.212434 avg lat: 0.00812479 2024-04-01T19:50:58.559 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:50:58.559 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 80 16 157583 157567 123.059 79.9375 0.0228256 0.00812479 2024-04-01T19:50:59.394 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.4 reset_purged_snaps_last 2024-04-01T19:50:59.559 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 81 16 158799 158783 122.478 76 0.0107815 0.00816308 2024-04-01T19:50:59.682 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:50:59.688 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:59.688 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:50:59.790 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:50:59.830 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:50:59.853 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:50:59.860 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:50:59.861 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:50:59.962 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:51:00.019 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:00.154 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:51:00.162 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:00.163 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:51:00.172 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:51:00.264 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:51:00.286 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:00 smithi022 ceph-mon[39439]: pgmap v1609: 17 pgs: 17 active+clean; 9.4 GiB data, 24 GiB used, 960 GiB / 983 GiB avail; 83 MiB/s wr, 1.32k op/s 2024-04-01T19:51:00.329 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:00.424 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:51:00.435 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:00.435 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:51:00.536 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:51:00.559 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 82 16 159999 159983 121.899 75 0.0214701 0.00820231 2024-04-01T19:51:00.572 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:00 smithi062 ceph-mon[44211]: pgmap v1609: 17 pgs: 17 active+clean; 9.4 GiB data, 24 GiB used, 960 GiB / 983 GiB avail; 83 MiB/s wr, 1.32k op/s 2024-04-01T19:51:00.575 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:00.601 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:51:00.604 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:00.604 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:51:00.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:00 smithi188 ceph-mon[43939]: pgmap v1609: 17 pgs: 17 active+clean; 9.4 GiB data, 24 GiB used, 960 GiB / 983 GiB avail; 83 MiB/s wr, 1.32k op/s 2024-04-01T19:51:00.705 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:51:00.737 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:00.761 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:51:00.767 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:00.768 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:51:00.869 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:51:00.905 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:00.941 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:51:00.947 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:00.947 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:51:01.048 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:51:01.087 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:51:01.119 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:51:01.125 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:01.126 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:51:01.229 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:51:01.264 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:01.297 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:51:01.302 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:01.303 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:51:01.404 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:51:01.517 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:01.555 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:51:01.559 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 83 16 161219 161203 121.349 76.25 0.00502897 0.0082391 2024-04-01T19:51:01.561 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:01.561 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:51:01.662 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:51:01.704 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:01.725 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:51:01.727 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:01.728 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:51:01.829 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:51:01.865 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:01.891 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:51:01.896 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:01.896 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:51:01.997 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:51:02.040 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:02.070 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:51:02.075 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:02.076 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:51:02.177 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:51:02.228 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:02.263 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:51:02.269 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:02.270 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:51:02.371 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:51:02.411 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:02.437 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:51:02.446 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:02.446 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:51:02.507 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:02 smithi022 ceph-mon[39439]: pgmap v1610: 17 pgs: 17 active+clean; 9.7 GiB data, 24 GiB used, 959 GiB / 983 GiB avail; 96 MiB/s wr, 1.54k op/s 2024-04-01T19:51:02.547 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:51:02.559 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 84 16 162448 162432 120.819 76.8125 0.0124698 0.00827537 2024-04-01T19:51:02.582 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:02 smithi188 ceph-mon[43939]: pgmap v1610: 17 pgs: 17 active+clean; 9.7 GiB data, 24 GiB used, 959 GiB / 983 GiB avail; 96 MiB/s wr, 1.54k op/s 2024-04-01T19:51:02.585 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:02.613 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:51:02.619 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:02.619 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:51:02.720 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:51:02.759 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:02.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:02 smithi062 ceph-mon[44211]: pgmap v1610: 17 pgs: 17 active+clean; 9.7 GiB data, 24 GiB used, 959 GiB / 983 GiB avail; 96 MiB/s wr, 1.54k op/s 2024-04-01T19:51:03.127 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:51:03.129 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:03.130 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:51:03.231 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:51:03.282 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:03.328 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:51:03.333 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:03.334 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:51:03.370 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:03 smithi022 ceph-mon[39439]: pgmap v1611: 17 pgs: 17 active+clean; 9.8 GiB data, 24 GiB used, 959 GiB / 983 GiB avail; 70 MiB/s wr, 1.11k op/s 2024-04-01T19:51:03.435 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:51:03.531 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:03.560 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 85 16 163684 163668 120.306 77.25 0.00565998 0.00831069 2024-04-01T19:51:03.572 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:51:03.574 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:03 smithi062 ceph-mon[44211]: pgmap v1611: 17 pgs: 17 active+clean; 9.8 GiB data, 24 GiB used, 959 GiB / 983 GiB avail; 70 MiB/s wr, 1.11k op/s 2024-04-01T19:51:03.575 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:03.576 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:51:03.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:03 smithi188 ceph-mon[43939]: pgmap v1611: 17 pgs: 17 active+clean; 9.8 GiB data, 24 GiB used, 959 GiB / 983 GiB avail; 70 MiB/s wr, 1.11k op/s 2024-04-01T19:51:03.676 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:51:03.763 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:04.346 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:51:04.510 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:51:04.545 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:51:04.560 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 86 16 164808 164792 119.724 70.25 0.0125741 0.00835128 2024-04-01T19:51:04.584 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:51:04.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:04 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3346530468' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:51:04.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:04 smithi022 ceph-mon[39439]: from='client.26725 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:51:04.619 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:51:04.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:04 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3346530468' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:51:04.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:04 smithi188 ceph-mon[43939]: from='client.26725 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:51:04.658 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:51:04.660 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:51:04.660 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:04.661 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:51:04.692 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:51:04.729 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:51:04.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:04 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3346530468' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:51:04.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:04 smithi062 ceph-mon[44211]: from='client.26725 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:51:04.762 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:51:04.763 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:51:04.798 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:04.798 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:51:04.828 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:51:04.831 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:04.832 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:51:04.832 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:51:04.878 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:51:04.921 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:51:04.928 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:51:04.928 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:51:04.928 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:51:04.928 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:51:04.928 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:51:04.928 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:51:04.928 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:51:04.928 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:51:04.928 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:51:04.928 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:51:04.928 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:51:04.929 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:51:04.933 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:51:04.966 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:04.988 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:51:04.992 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:04.992 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:51:05.093 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:51:05.167 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:05.288 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:51:05.297 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:05.297 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:51:05.399 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:51:05.451 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:05.486 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:51:05.491 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:05.491 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:51:05.560 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 87 16 165985 165969 119.194 73.5625 0.00503664 0.00838793 2024-04-01T19:51:05.592 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:51:05.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:05 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:51:05.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:05 smithi022 ceph-mon[39439]: from='client.26725 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:51:05.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:05 smithi022 ceph-mon[39439]: osdmap e586: 12 total, 12 up, 11 in 2024-04-01T19:51:05.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:05 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4126904940' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:51:05.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:05.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:05.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:05.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:05 smithi022 ceph-mon[39439]: pgmap v1613: 17 pgs: 17 active+clean; 9.8 GiB data, 25 GiB used, 959 GiB / 983 GiB avail; 75 MiB/s wr, 1.21k op/s 2024-04-01T19:51:05.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:05 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:51:05.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:05 smithi188 ceph-mon[43939]: from='client.26725 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:51:05.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:05 smithi188 ceph-mon[43939]: osdmap e586: 12 total, 12 up, 11 in 2024-04-01T19:51:05.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:05 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4126904940' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:51:05.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:05.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:05.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:05.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:05 smithi188 ceph-mon[43939]: pgmap v1613: 17 pgs: 17 active+clean; 9.8 GiB data, 25 GiB used, 959 GiB / 983 GiB avail; 75 MiB/s wr, 1.21k op/s 2024-04-01T19:51:05.643 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:05.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:05 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:51:05.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:05 smithi062 ceph-mon[44211]: from='client.26725 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:51:05.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:05 smithi062 ceph-mon[44211]: osdmap e586: 12 total, 12 up, 11 in 2024-04-01T19:51:05.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:05 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4126904940' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:51:05.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:05.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:05.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:05.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:05 smithi062 ceph-mon[44211]: pgmap v1613: 17 pgs: 17 active+clean; 9.8 GiB data, 25 GiB used, 959 GiB / 983 GiB avail; 75 MiB/s wr, 1.21k op/s 2024-04-01T19:51:05.794 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:51:05.797 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:05.797 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:51:05.898 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:51:05.939 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:05.964 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:51:05.970 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:05.971 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:51:06.072 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:51:06.118 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:06.146 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:51:06.150 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:06.155 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:51:06.256 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:51:06.263 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:51:06.264 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:51:06.296 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:06.446 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:51:06.454 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:06.454 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.454 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.456 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:51:06.558 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:51:06.560 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 88 16 167203 167187 118.704 76.125 0.00546698 0.00842292 2024-04-01T19:51:06.591 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:06.613 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:51:06.617 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:06.618 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:51:06.719 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:51:06.756 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.756 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.756 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.756 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.757 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.757 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.757 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.757 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.757 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.759 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:06.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:06.794 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:51:06.796 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:06.797 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:51:06.898 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:51:06.951 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:07.560 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 89 16 168461 168445 118.254 78.625 0.00995091 0.00845476 2024-04-01T19:51:07.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:07 smithi022 ceph-mon[39439]: pgmap v1614: 17 pgs: 17 active+clean; 10 GiB data, 25 GiB used, 958 GiB / 983 GiB avail; 75 MiB/s wr, 1.19k op/s 2024-04-01T19:51:07.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:07 smithi062 ceph-mon[44211]: pgmap v1614: 17 pgs: 17 active+clean; 10 GiB data, 25 GiB used, 958 GiB / 983 GiB avail; 75 MiB/s wr, 1.19k op/s 2024-04-01T19:51:07.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:07 smithi188 ceph-mon[43939]: pgmap v1614: 17 pgs: 17 active+clean; 10 GiB data, 25 GiB used, 958 GiB / 983 GiB avail; 75 MiB/s wr, 1.19k op/s 2024-04-01T19:51:08.023 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_ops_in_flight 2024-04-01T19:51:08.126 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:51:08.129 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:08.129 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:51:08.230 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:51:08.259 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:08.285 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:51:08.290 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:08.290 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:51:08.391 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:51:08.428 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:08.470 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:51:08.483 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:08.483 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:51:08.560 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Total time run: 90.0089 2024-04-01T19:51:08.560 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Total writes made: 169641 2024-04-01T19:51:08.560 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Write size: 65536 2024-04-01T19:51:08.560 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Object size: 65536 2024-04-01T19:51:08.561 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Bandwidth (MB/sec): 117.795 2024-04-01T19:51:08.561 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Stddev Bandwidth: 55.1818 2024-04-01T19:51:08.561 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Max bandwidth (MB/sec): 347.75 2024-04-01T19:51:08.561 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Min bandwidth (MB/sec): 70.1875 2024-04-01T19:51:08.561 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Average IOPS: 1884 2024-04-01T19:51:08.561 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Stddev IOPS: 882.909 2024-04-01T19:51:08.561 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Max IOPS: 5564 2024-04-01T19:51:08.561 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Min IOPS: 1123 2024-04-01T19:51:08.561 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Average Latency(s): 0.00848864 2024-04-01T19:51:08.561 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Stddev Latency(s): 0.00668069 2024-04-01T19:51:08.561 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Max latency(s): 0.212434 2024-04-01T19:51:08.561 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Min latency(s): 0.00105017 2024-04-01T19:51:08.567 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Cleaning up (deleting benchmark objects) 2024-04-01T19:51:08.584 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:51:08.621 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:08.644 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:51:08.648 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:08.649 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:51:08.750 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:51:08.829 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:51:08.840 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:09.231 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:51:09.320 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:51:09.327 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:09.327 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:51:09.429 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:51:09.463 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:09.487 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:51:09.491 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:09.491 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:51:09.592 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:51:09.649 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:10.090 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.5 reset_purged_snaps_last 2024-04-01T19:51:10.180 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:51:10.304 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:10 smithi022 ceph-mon[39439]: pgmap v1615: 17 pgs: 17 active+clean; 10 GiB data, 25 GiB used, 958 GiB / 983 GiB avail; 75 MiB/s wr, 1.19k op/s 2024-04-01T19:51:10.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:10 smithi188 ceph-mon[43939]: pgmap v1615: 17 pgs: 17 active+clean; 10 GiB data, 25 GiB used, 958 GiB / 983 GiB avail; 75 MiB/s wr, 1.19k op/s 2024-04-01T19:51:10.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:10 smithi062 ceph-mon[44211]: pgmap v1615: 17 pgs: 17 active+clean; 10 GiB data, 25 GiB used, 958 GiB / 983 GiB avail; 75 MiB/s wr, 1.19k op/s 2024-04-01T19:51:11.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:11 smithi022 ceph-mon[39439]: pgmap v1616: 17 pgs: 17 active+clean; 10 GiB data, 25 GiB used, 958 GiB / 983 GiB avail; 102 B/s rd, 64 MiB/s wr, 1.21k op/s 2024-04-01T19:51:11.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:11 smithi188 ceph-mon[43939]: pgmap v1616: 17 pgs: 17 active+clean; 10 GiB data, 25 GiB used, 958 GiB / 983 GiB avail; 102 B/s rd, 64 MiB/s wr, 1.21k op/s 2024-04-01T19:51:11.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:11 smithi062 ceph-mon[44211]: pgmap v1616: 17 pgs: 17 active+clean; 10 GiB data, 25 GiB used, 958 GiB / 983 GiB avail; 102 B/s rd, 64 MiB/s wr, 1.21k op/s 2024-04-01T19:51:12.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:12 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:51:12.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:12 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:51:12.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:12 smithi188 ceph-mon[43939]: osdmap e587: 12 total, 12 up, 11 in 2024-04-01T19:51:12.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:12 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:51:12.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:12 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:51:12.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:12 smithi062 ceph-mon[44211]: osdmap e587: 12 total, 12 up, 11 in 2024-04-01T19:51:12.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:12 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:51:12.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:12 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:51:12.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:12 smithi022 ceph-mon[39439]: osdmap e587: 12 total, 12 up, 11 in 2024-04-01T19:51:13.231 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:51:13.243 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:13.243 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:51:13.342 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:51:13.344 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:51:13.348 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:51:13.358 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:51:13.373 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:13.410 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:51:13.418 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:13.418 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:51:13.519 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:51:13.552 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:13.585 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:51:13.588 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:13.589 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:51:13.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:13 smithi022 ceph-mon[39439]: pgmap v1618: 17 pgs: 17 active+clean; 10 GiB data, 25 GiB used, 958 GiB / 983 GiB avail; 115 B/s rd, 62 MiB/s wr, 1.28k op/s 2024-04-01T19:51:13.690 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:51:13.720 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:13 smithi062 ceph-mon[44211]: pgmap v1618: 17 pgs: 17 active+clean; 10 GiB data, 25 GiB used, 958 GiB / 983 GiB avail; 115 B/s rd, 62 MiB/s wr, 1.28k op/s 2024-04-01T19:51:13.723 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:13.749 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:51:13.755 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:13.755 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:51:13.857 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:51:13.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:13 smithi188 ceph-mon[43939]: pgmap v1618: 17 pgs: 17 active+clean; 10 GiB data, 25 GiB used, 958 GiB / 983 GiB avail; 115 B/s rd, 62 MiB/s wr, 1.28k op/s 2024-04-01T19:51:13.887 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:13.909 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:51:13.914 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:13.915 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:51:14.016 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:51:14.053 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:14.086 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:51:14.091 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:14.091 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:51:14.192 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:51:14.224 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:14.252 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:51:14.260 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:14.261 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:51:14.362 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:51:14.405 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:14.452 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:51:14.460 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:14.461 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:51:14.562 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:51:14.609 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:15.806 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:51:15.810 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:15.810 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:51:15.912 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:51:15.953 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:16.215 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:51:16.215 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:51:16.294 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:16 smithi022 ceph-mon[39439]: pgmap v1619: 17 pgs: 17 active+clean; 10 GiB data, 25 GiB used, 958 GiB / 983 GiB avail; 102 B/s rd, 56 MiB/s wr, 1.22k op/s 2024-04-01T19:51:16.424 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:51:16.428 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:16.428 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:51:16.529 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:51:16.579 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:16.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:16 smithi188 ceph-mon[43939]: pgmap v1619: 17 pgs: 17 active+clean; 10 GiB data, 25 GiB used, 958 GiB / 983 GiB avail; 102 B/s rd, 56 MiB/s wr, 1.22k op/s 2024-04-01T19:51:16.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:16 smithi062 ceph-mon[44211]: pgmap v1619: 17 pgs: 17 active+clean; 10 GiB data, 25 GiB used, 958 GiB / 983 GiB avail; 102 B/s rd, 56 MiB/s wr, 1.22k op/s 2024-04-01T19:51:17.031 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_blocked_ops 2024-04-01T19:51:17.044 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:51:17.050 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:17.052 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:51:17.154 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:51:17.186 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:17.211 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:51:17.217 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:17.217 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:51:17.318 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:51:17.362 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:17.391 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:51:17.399 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:17.400 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:51:17.501 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:51:17.537 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:17.580 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:17.581 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:51:17.581 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:51:17.682 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:51:17.714 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:17.738 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:51:17.741 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:17.742 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:51:17.842 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:51:17.891 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:18.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:18 smithi022 ceph-mon[39439]: pgmap v1620: 17 pgs: 17 active+clean; 9.8 GiB data, 25 GiB used, 959 GiB / 983 GiB avail; 102 B/s rd, 23 MiB/s wr, 1.23k op/s 2024-04-01T19:51:18.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:18 smithi188 ceph-mon[43939]: pgmap v1620: 17 pgs: 17 active+clean; 9.8 GiB data, 25 GiB used, 959 GiB / 983 GiB avail; 102 B/s rd, 23 MiB/s wr, 1.23k op/s 2024-04-01T19:51:18.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:18 smithi062 ceph-mon[44211]: pgmap v1620: 17 pgs: 17 active+clean; 9.8 GiB data, 25 GiB used, 959 GiB / 983 GiB avail; 102 B/s rd, 23 MiB/s wr, 1.23k op/s 2024-04-01T19:51:18.981 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:51:18.988 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:18.988 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:51:19.089 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:51:19.119 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:19.144 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:51:19.146 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:19.147 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:51:19.248 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:51:19.297 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:19.320 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:51:19.323 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:19.323 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:51:19.425 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:51:19.469 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:20.305 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:20 smithi022 ceph-mon[39439]: pgmap v1621: 17 pgs: 17 active+clean; 9.8 GiB data, 25 GiB used, 959 GiB / 983 GiB avail; 102 B/s rd, 18 MiB/s wr, 1.23k op/s 2024-04-01T19:51:20.305 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:20 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1541472323' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:51:20.305 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:20.305 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:20.305 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:20.305 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:20.305 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:20.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:20 smithi188 ceph-mon[43939]: pgmap v1621: 17 pgs: 17 active+clean; 9.8 GiB data, 25 GiB used, 959 GiB / 983 GiB avail; 102 B/s rd, 18 MiB/s wr, 1.23k op/s 2024-04-01T19:51:20.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:20 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1541472323' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:51:20.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:20.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:20.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:20.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:20.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:20.690 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:51:20.691 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:51:20.691 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:51:20.691 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:51:20.691 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:51:20.691 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:51:20.691 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:51:20.691 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:51:20.691 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:51:20.691 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:51:20.691 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:51:20.691 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:51:20.692 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:51:20.692 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:51:20.692 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:51:20.692 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:51:20.692 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:51:20.692 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:51:20.692 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:51:20.692 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:51:20.692 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:51:20.692 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:51:20.692 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:51:20.692 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:51:20.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:20 smithi062 ceph-mon[44211]: pgmap v1621: 17 pgs: 17 active+clean; 9.8 GiB data, 25 GiB used, 959 GiB / 983 GiB avail; 102 B/s rd, 18 MiB/s wr, 1.23k op/s 2024-04-01T19:51:20.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:20 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1541472323' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:51:20.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:20.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:20.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:20.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:20.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:21.086 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:51:21.297 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:51:21.307 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:21.307 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:51:21.408 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:51:21.443 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:21.469 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:51:21.477 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:21.477 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:51:21.578 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:51:21.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:21.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:21.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:21.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:21.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:21.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:21.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:21.625 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:21.625 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:21.625 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:21.625 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:21.625 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:21.625 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:21.625 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:21.633 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:21.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:21.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:22.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:22 smithi022 ceph-mon[39439]: pgmap v1622: 17 pgs: 17 active+clean; 9.5 GiB data, 24 GiB used, 959 GiB / 983 GiB avail; 3.1 MiB/s wr, 1.25k op/s 2024-04-01T19:51:22.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:22 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2964809512' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:51:22.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:22 smithi022 ceph-mon[39439]: from='client.36776 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:51:22.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:22 smithi188 ceph-mon[43939]: pgmap v1622: 17 pgs: 17 active+clean; 9.5 GiB data, 24 GiB used, 959 GiB / 983 GiB avail; 3.1 MiB/s wr, 1.25k op/s 2024-04-01T19:51:22.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:22 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2964809512' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:51:22.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:22 smithi188 ceph-mon[43939]: from='client.36776 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:51:22.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:22 smithi062 ceph-mon[44211]: pgmap v1622: 17 pgs: 17 active+clean; 9.5 GiB data, 24 GiB used, 959 GiB / 983 GiB avail; 3.1 MiB/s wr, 1.25k op/s 2024-04-01T19:51:22.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:22 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2964809512' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:51:22.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:22 smithi062 ceph-mon[44211]: from='client.36776 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:51:23.255 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:51:23.261 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:23.262 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:51:23.363 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:51:23.394 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:23.415 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:51:23.418 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:23.418 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:51:23.519 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:51:23.548 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:23.579 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:51:23.584 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:23.585 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:23 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:51:23.585 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:23 smithi062 ceph-mon[44211]: from='client.36776 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:51:23.585 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:23 smithi062 ceph-mon[44211]: osdmap e588: 12 total, 12 up, 11 in 2024-04-01T19:51:23.586 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:51:23.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:23 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:51:23.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:23 smithi022 ceph-mon[39439]: from='client.36776 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:51:23.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:23 smithi022 ceph-mon[39439]: osdmap e588: 12 total, 12 up, 11 in 2024-04-01T19:51:23.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:23 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:51:23.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:23 smithi188 ceph-mon[43939]: from='client.36776 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:51:23.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:23 smithi188 ceph-mon[43939]: osdmap e588: 12 total, 12 up, 11 in 2024-04-01T19:51:23.687 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:51:23.733 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:23.760 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:51:23.765 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:23.765 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:51:23.866 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:51:23.925 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:23.970 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:51:24.295 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:51:24.305 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:24.306 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:51:24.407 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:51:24.485 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:24.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:24 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:51:24.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:24 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:51:24.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:24 smithi022 ceph-mon[39439]: pgmap v1624: 17 pgs: 17 active+clean; 9.4 GiB data, 24 GiB used, 959 GiB / 983 GiB avail; 166 KiB/s wr, 1.25k op/s 2024-04-01T19:51:24.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:24 smithi022 ceph-mon[39439]: osdmap e589: 12 total, 12 up, 11 in 2024-04-01T19:51:24.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:24 smithi022 ceph-mon[39439]: 7.a scrub starts 2024-04-01T19:51:24.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:24 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:51:24.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:24 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:51:24.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:24 smithi188 ceph-mon[43939]: pgmap v1624: 17 pgs: 17 active+clean; 9.4 GiB data, 24 GiB used, 959 GiB / 983 GiB avail; 166 KiB/s wr, 1.25k op/s 2024-04-01T19:51:24.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:24 smithi188 ceph-mon[43939]: osdmap e589: 12 total, 12 up, 11 in 2024-04-01T19:51:24.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:24 smithi188 ceph-mon[43939]: 7.a scrub starts 2024-04-01T19:51:24.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:24 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:51:24.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:24 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:51:24.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:24 smithi062 ceph-mon[44211]: pgmap v1624: 17 pgs: 17 active+clean; 9.4 GiB data, 24 GiB used, 959 GiB / 983 GiB avail; 166 KiB/s wr, 1.25k op/s 2024-04-01T19:51:24.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:24 smithi062 ceph-mon[44211]: osdmap e589: 12 total, 12 up, 11 in 2024-04-01T19:51:24.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:24 smithi062 ceph-mon[44211]: 7.a scrub starts 2024-04-01T19:51:25.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:25 smithi022 ceph-mon[39439]: 7.8 scrub starts 2024-04-01T19:51:25.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:25 smithi022 ceph-mon[39439]: 7.6 scrub starts 2024-04-01T19:51:25.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:25 smithi022 ceph-mon[39439]: pgmap v1626: 17 pgs: 17 active+clean; 9.4 GiB data, 24 GiB used, 960 GiB / 983 GiB avail; 0 B/s wr, 892 op/s 2024-04-01T19:51:25.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:25 smithi188 ceph-mon[43939]: 7.8 scrub starts 2024-04-01T19:51:25.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:25 smithi188 ceph-mon[43939]: 7.6 scrub starts 2024-04-01T19:51:25.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:25 smithi188 ceph-mon[43939]: pgmap v1626: 17 pgs: 17 active+clean; 9.4 GiB data, 24 GiB used, 960 GiB / 983 GiB avail; 0 B/s wr, 892 op/s 2024-04-01T19:51:25.750 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.7 reset_purged_snaps_last 2024-04-01T19:51:25.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:25 smithi062 ceph-mon[44211]: 7.8 scrub starts 2024-04-01T19:51:25.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:25 smithi062 ceph-mon[44211]: 7.6 scrub starts 2024-04-01T19:51:25.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:25 smithi062 ceph-mon[44211]: pgmap v1626: 17 pgs: 17 active+clean; 9.4 GiB data, 24 GiB used, 960 GiB / 983 GiB avail; 0 B/s wr, 892 op/s 2024-04-01T19:51:26.175 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:51:26.176 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:26.177 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:51:26.278 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:51:26.398 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:26.577 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:51:26.583 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:26 smithi022 ceph-mon[39439]: 7.e scrub starts 2024-04-01T19:51:26.583 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:26 smithi022 ceph-mon[39439]: 7.9 scrub starts 2024-04-01T19:51:26.583 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:26 smithi022 ceph-mon[39439]: 7.a scrub ok 2024-04-01T19:51:26.583 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:26.584 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:51:26.685 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:51:26.753 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:26.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:26 smithi062 ceph-mon[44211]: 7.e scrub starts 2024-04-01T19:51:26.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:26 smithi062 ceph-mon[44211]: 7.9 scrub starts 2024-04-01T19:51:26.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:26 smithi062 ceph-mon[44211]: 7.a scrub ok 2024-04-01T19:51:26.789 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:51:26.793 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:26.793 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:51:26.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:26 smithi188 ceph-mon[43939]: 7.e scrub starts 2024-04-01T19:51:26.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:26 smithi188 ceph-mon[43939]: 7.9 scrub starts 2024-04-01T19:51:26.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:26 smithi188 ceph-mon[43939]: 7.a scrub ok 2024-04-01T19:51:26.890 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:51:26.894 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:51:26.923 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:51:26.932 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:26.956 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:51:26.962 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:26.963 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:51:27.003 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:51:27.003 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:51:27.003 INFO:teuthology.orchestra.run.smithi022.stdout: "complaint_time": 30, 2024-04-01T19:51:27.003 INFO:teuthology.orchestra.run.smithi022.stdout: "num_blocked_ops": 0 2024-04-01T19:51:27.003 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:51:27.064 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:51:27.168 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:27.265 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:51:27.282 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:27.283 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:51:27.327 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:51:27.384 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:51:27.460 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:27.594 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:51:27.606 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:27.607 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:51:27.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:27 smithi022 ceph-mon[39439]: 7.b scrub starts 2024-04-01T19:51:27.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:27 smithi022 ceph-mon[39439]: 7.8 scrub ok 2024-04-01T19:51:27.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:27 smithi022 ceph-mon[39439]: 7.d scrub starts 2024-04-01T19:51:27.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:27 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:51:27.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:27 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:51:27.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:27 smithi022 ceph-mon[39439]: osdmap e590: 12 total, 12 up, 11 in 2024-04-01T19:51:27.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:27 smithi022 ceph-mon[39439]: pgmap v1628: 17 pgs: 4 active+clean+scrubbing, 13 active+clean; 9.1 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:51:27.707 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:51:27.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:27 smithi062 ceph-mon[44211]: 7.b scrub starts 2024-04-01T19:51:27.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:27 smithi062 ceph-mon[44211]: 7.8 scrub ok 2024-04-01T19:51:27.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:27 smithi062 ceph-mon[44211]: 7.d scrub starts 2024-04-01T19:51:27.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:27 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:51:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:27 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:51:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:27 smithi062 ceph-mon[44211]: osdmap e590: 12 total, 12 up, 11 in 2024-04-01T19:51:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:27 smithi062 ceph-mon[44211]: pgmap v1628: 17 pgs: 4 active+clean+scrubbing, 13 active+clean; 9.1 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:51:27.776 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:27.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:27 smithi188 ceph-mon[43939]: 7.b scrub starts 2024-04-01T19:51:27.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:27 smithi188 ceph-mon[43939]: 7.8 scrub ok 2024-04-01T19:51:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:27 smithi188 ceph-mon[43939]: 7.d scrub starts 2024-04-01T19:51:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:27 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:51:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:27 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:51:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:27 smithi188 ceph-mon[43939]: osdmap e590: 12 total, 12 up, 11 in 2024-04-01T19:51:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:27 smithi188 ceph-mon[43939]: pgmap v1628: 17 pgs: 4 active+clean+scrubbing, 13 active+clean; 9.1 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T19:51:28.609 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:28 smithi022 ceph-mon[39439]: 7.6 scrub ok 2024-04-01T19:51:28.609 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:28 smithi022 ceph-mon[39439]: 7.2 scrub starts 2024-04-01T19:51:28.609 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:28 smithi022 ceph-mon[39439]: 7.b scrub ok 2024-04-01T19:51:28.609 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:28 smithi022 ceph-mon[39439]: 7.e scrub ok 2024-04-01T19:51:28.609 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:28 smithi022 ceph-mon[39439]: 7.f scrub starts 2024-04-01T19:51:28.609 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:28 smithi022 ceph-mon[39439]: 7.1 scrub starts 2024-04-01T19:51:28.656 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:51:28.661 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:28.662 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:51:28.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:28 smithi062 ceph-mon[44211]: 7.6 scrub ok 2024-04-01T19:51:28.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:28 smithi062 ceph-mon[44211]: 7.2 scrub starts 2024-04-01T19:51:28.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:28 smithi062 ceph-mon[44211]: 7.b scrub ok 2024-04-01T19:51:28.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:28 smithi062 ceph-mon[44211]: 7.e scrub ok 2024-04-01T19:51:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:28 smithi062 ceph-mon[44211]: 7.f scrub starts 2024-04-01T19:51:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:28 smithi062 ceph-mon[44211]: 7.1 scrub starts 2024-04-01T19:51:28.763 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:51:28.801 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:28.836 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:51:28.845 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:28.845 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:51:28.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:28 smithi188 ceph-mon[43939]: 7.6 scrub ok 2024-04-01T19:51:28.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:28 smithi188 ceph-mon[43939]: 7.2 scrub starts 2024-04-01T19:51:28.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:28 smithi188 ceph-mon[43939]: 7.b scrub ok 2024-04-01T19:51:28.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:28 smithi188 ceph-mon[43939]: 7.e scrub ok 2024-04-01T19:51:28.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:28 smithi188 ceph-mon[43939]: 7.f scrub starts 2024-04-01T19:51:28.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:28 smithi188 ceph-mon[43939]: 7.1 scrub starts 2024-04-01T19:51:28.946 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:51:28.985 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:29.135 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:51:29.140 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:29.141 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:51:29.192 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_historic_ops 2024-04-01T19:51:29.242 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:51:29.280 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:29.312 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:51:29.316 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:29.316 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:51:29.390 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:51:29.402 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:51:29.417 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:51:29.453 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:29.478 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:51:29.480 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:29.481 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:51:29.542 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:29 smithi022 ceph-mon[39439]: 7.d scrub ok 2024-04-01T19:51:29.542 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:29 smithi022 ceph-mon[39439]: 7.9 scrub ok 2024-04-01T19:51:29.542 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:29 smithi022 ceph-mon[39439]: 7.1 scrub ok 2024-04-01T19:51:29.542 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:29 smithi022 ceph-mon[39439]: pgmap v1629: 17 pgs: 5 active+clean+scrubbing, 12 active+clean; 9.1 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 0 B/s wr, 902 op/s 2024-04-01T19:51:29.581 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:51:29.622 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:29.648 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:51:29.654 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:29.655 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:51:29.756 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:51:29.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:29 smithi062 ceph-mon[44211]: 7.d scrub ok 2024-04-01T19:51:29.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:29 smithi062 ceph-mon[44211]: 7.9 scrub ok 2024-04-01T19:51:29.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:29 smithi062 ceph-mon[44211]: 7.1 scrub ok 2024-04-01T19:51:29.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:29 smithi062 ceph-mon[44211]: pgmap v1629: 17 pgs: 5 active+clean+scrubbing, 12 active+clean; 9.1 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 0 B/s wr, 902 op/s 2024-04-01T19:51:29.809 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:29.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:29 smithi188 ceph-mon[43939]: 7.d scrub ok 2024-04-01T19:51:29.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:29 smithi188 ceph-mon[43939]: 7.9 scrub ok 2024-04-01T19:51:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:29 smithi188 ceph-mon[43939]: 7.1 scrub ok 2024-04-01T19:51:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:29 smithi188 ceph-mon[43939]: pgmap v1629: 17 pgs: 5 active+clean+scrubbing, 12 active+clean; 9.1 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 0 B/s wr, 902 op/s 2024-04-01T19:51:30.428 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:30 smithi022 ceph-mon[39439]: 7.7 scrub starts 2024-04-01T19:51:30.428 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:30 smithi022 ceph-mon[39439]: 7.2 scrub ok 2024-04-01T19:51:30.429 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:30 smithi022 ceph-mon[39439]: 7.2 scrub starts 2024-04-01T19:51:30.429 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:30 smithi022 ceph-mon[39439]: 7.f scrub ok 2024-04-01T19:51:30.591 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:51:30.594 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:30.595 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:51:30.696 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:51:30.724 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:30 smithi062 ceph-mon[44211]: 7.7 scrub starts 2024-04-01T19:51:30.724 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:30 smithi062 ceph-mon[44211]: 7.2 scrub ok 2024-04-01T19:51:30.724 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:30 smithi062 ceph-mon[44211]: 7.2 scrub starts 2024-04-01T19:51:30.724 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:30 smithi062 ceph-mon[44211]: 7.f scrub ok 2024-04-01T19:51:30.726 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:30.765 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:51:30.769 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:30.770 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:51:30.871 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:51:30.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:30 smithi188 ceph-mon[43939]: 7.7 scrub starts 2024-04-01T19:51:30.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:30 smithi188 ceph-mon[43939]: 7.2 scrub ok 2024-04-01T19:51:30.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:30 smithi188 ceph-mon[43939]: 7.2 scrub starts 2024-04-01T19:51:30.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:30 smithi188 ceph-mon[43939]: 7.f scrub ok 2024-04-01T19:51:30.927 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:31.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:31 smithi022 ceph-mon[39439]: 7.7 scrub ok 2024-04-01T19:51:31.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:31 smithi022 ceph-mon[39439]: pgmap v1630: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.8 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:51:31.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:31 smithi062 ceph-mon[44211]: 7.7 scrub ok 2024-04-01T19:51:31.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:31 smithi062 ceph-mon[44211]: pgmap v1630: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.8 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:51:31.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:31 smithi188 ceph-mon[43939]: 7.7 scrub ok 2024-04-01T19:51:31.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:31 smithi188 ceph-mon[43939]: pgmap v1630: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.8 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:51:31.911 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:51:31.917 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:31.918 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:51:32.019 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:51:32.054 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:32.089 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:51:32.092 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:32.093 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:51:32.194 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:51:32.256 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:32.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:32 smithi022 ceph-mon[39439]: 7.3 scrub starts 2024-04-01T19:51:32.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:32 smithi022 ceph-mon[39439]: 7.2 scrub ok 2024-04-01T19:51:32.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:32 smithi062 ceph-mon[44211]: 7.3 scrub starts 2024-04-01T19:51:32.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:32 smithi062 ceph-mon[44211]: 7.2 scrub ok 2024-04-01T19:51:32.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:32 smithi188 ceph-mon[43939]: 7.3 scrub starts 2024-04-01T19:51:32.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:32 smithi188 ceph-mon[43939]: 7.2 scrub ok 2024-04-01T19:51:33.449 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:33 smithi022 ceph-mon[39439]: pgmap v1631: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.8 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:51:33.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:33 smithi062 ceph-mon[44211]: pgmap v1631: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.8 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:51:33.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:33 smithi188 ceph-mon[43939]: pgmap v1631: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.8 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T19:51:34.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:34 smithi062 ceph-mon[44211]: 7.3 scrub ok 2024-04-01T19:51:34.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:34 smithi022 ceph-mon[39439]: 7.3 scrub ok 2024-04-01T19:51:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:34 smithi188 ceph-mon[43939]: 7.3 scrub ok 2024-04-01T19:51:35.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:35 smithi062 ceph-mon[44211]: pgmap v1632: 17 pgs: 17 active+clean; 8.7 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:51:35.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:35 smithi022 ceph-mon[39439]: pgmap v1632: 17 pgs: 17 active+clean; 8.7 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:51:35.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:35 smithi188 ceph-mon[43939]: pgmap v1632: 17 pgs: 17 active+clean; 8.7 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T19:51:36.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:36 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:51:36.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:36 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:51:36.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:36 smithi062 ceph-mon[44211]: osdmap e591: 12 total, 12 up, 11 in 2024-04-01T19:51:36.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:36 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:51:36.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:36 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:51:36.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:36 smithi022 ceph-mon[39439]: osdmap e591: 12 total, 12 up, 11 in 2024-04-01T19:51:36.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:36 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:51:36.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:36 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:51:36.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:36 smithi188 ceph-mon[43939]: osdmap e591: 12 total, 12 up, 11 in 2024-04-01T19:51:37.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:37 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:51:37.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:37 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:51:37.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:37 smithi062 ceph-mon[44211]: osdmap e592: 12 total, 12 up, 11 in 2024-04-01T19:51:37.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:37 smithi062 ceph-mon[44211]: pgmap v1635: 17 pgs: 17 active+clean; 8.4 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 1.35k op/s 2024-04-01T19:51:37.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:37 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:51:37.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:37 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:51:37.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:37 smithi022 ceph-mon[39439]: osdmap e592: 12 total, 12 up, 11 in 2024-04-01T19:51:37.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:37 smithi022 ceph-mon[39439]: pgmap v1635: 17 pgs: 17 active+clean; 8.4 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 1.35k op/s 2024-04-01T19:51:37.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:37 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:51:37.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:37 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:51:37.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:37 smithi188 ceph-mon[43939]: osdmap e592: 12 total, 12 up, 11 in 2024-04-01T19:51:37.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:37 smithi188 ceph-mon[43939]: pgmap v1635: 17 pgs: 17 active+clean; 8.4 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 0 B/s wr, 1.35k op/s 2024-04-01T19:51:38.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:38 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:51:38.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:38 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:51:38.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:38 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:51:38.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:38 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:51:38.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:38 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1285956826' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:51:38.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:38 smithi062 ceph-mon[44211]: from='client.26758 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:51:38.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:38 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:51:38.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:38 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:51:38.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:38 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:51:38.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:38 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:51:38.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:38 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1285956826' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:51:38.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:38 smithi022 ceph-mon[39439]: from='client.26758 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:51:38.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:38 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:51:38.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:38 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:51:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:38 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:51:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:38 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:51:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:38 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1285956826' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:51:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:38 smithi188 ceph-mon[43939]: from='client.26758 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:51:39.668 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:51:39.678 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:39.678 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:51:39.708 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.9 reset_purged_snaps_last 2024-04-01T19:51:39.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:39 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:51:39.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:39 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:51:39.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:39 smithi062 ceph-mon[44211]: from='client.26758 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:51:39.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:39 smithi062 ceph-mon[44211]: osdmap e593: 12 total, 12 up, 11 in 2024-04-01T19:51:39.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:39 smithi062 ceph-mon[44211]: pgmap v1637: 17 pgs: 17 active+clean; 8.3 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 1.18k op/s 2024-04-01T19:51:39.780 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:51:39.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:39 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:51:39.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:39 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:51:39.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:39 smithi022 ceph-mon[39439]: from='client.26758 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:51:39.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:39 smithi022 ceph-mon[39439]: osdmap e593: 12 total, 12 up, 11 in 2024-04-01T19:51:39.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:39 smithi022 ceph-mon[39439]: pgmap v1637: 17 pgs: 17 active+clean; 8.3 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 1.18k op/s 2024-04-01T19:51:39.848 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:51:39.849 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:39.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:39 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:51:39.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:39 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:51:39.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:39 smithi188 ceph-mon[43939]: from='client.26758 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:51:39.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:39 smithi188 ceph-mon[43939]: osdmap e593: 12 total, 12 up, 11 in 2024-04-01T19:51:39.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:39 smithi188 ceph-mon[43939]: pgmap v1637: 17 pgs: 17 active+clean; 8.3 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 1.18k op/s 2024-04-01T19:51:40.028 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:51:40.402 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:51:40.406 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:40.407 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:51:40.508 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:51:40.538 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:40.572 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:51:40.580 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:40.580 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:51:40.681 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:51:40.837 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:40.881 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:51:40.888 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:40.888 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:51:40.989 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:51:41.022 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:41.054 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:51:41.059 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:41.060 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:51:41.161 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:51:41.196 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:41.297 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:51:41.300 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:41.300 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:51:41.401 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:51:41.445 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:41 smithi062 ceph-mon[44211]: pgmap v1638: 17 pgs: 17 active+clean; 8.1 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 1.79k op/s 2024-04-01T19:51:41.446 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:41 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:51:41.446 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:41 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:51:41.464 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:41.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:41 smithi022 ceph-mon[39439]: pgmap v1638: 17 pgs: 17 active+clean; 8.1 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 1.79k op/s 2024-04-01T19:51:41.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:41 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:51:41.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:41 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:51:41.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:41 smithi188 ceph-mon[43939]: pgmap v1638: 17 pgs: 17 active+clean; 8.1 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 1.79k op/s 2024-04-01T19:51:41.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:41 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:51:41.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:41 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:51:42.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:42 smithi062 ceph-mon[44211]: osdmap e594: 12 total, 12 up, 11 in 2024-04-01T19:51:42.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:42 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/305680698' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:51:42.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:42.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:42.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:42 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:42.821 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:51:42.821 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:51:42.822 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:51:42.822 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:51:42.822 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:51:42.822 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:51:42.822 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:51:42.822 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:51:42.822 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:51:42.822 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:51:42.822 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:51:42.822 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:51:42.822 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:51:42.823 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:51:42.823 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:51:42.823 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:51:42.823 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:51:42.823 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:51:42.823 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:51:42.823 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:51:42.823 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:51:42.823 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:51:42.823 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:51:42.823 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:51:42.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:42 smithi022 ceph-mon[39439]: osdmap e594: 12 total, 12 up, 11 in 2024-04-01T19:51:42.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:42 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/305680698' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:51:42.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:42.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:42.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:42 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:42.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:42 smithi188 ceph-mon[43939]: osdmap e594: 12 total, 12 up, 11 in 2024-04-01T19:51:42.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:42 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/305680698' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:51:42.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:42.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:42.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:42 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.154 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:51:43.181 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:43.181 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:51:43.283 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:51:43.301 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:51:43.331 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:43.359 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:51:43.364 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:43.364 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:51:43.466 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:51:43.526 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:43.630 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:51:43.634 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:43.635 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:51:43.678 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.678 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.678 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.678 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.678 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.678 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.678 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.678 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.679 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.679 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:43 smithi062 ceph-mon[44211]: 7.c deep-scrub starts 2024-04-01T19:51:43.679 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:43 smithi062 ceph-mon[44211]: pgmap v1640: 17 pgs: 17 active+clean; 8.0 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 941 op/s 2024-04-01T19:51:43.735 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:51:43.793 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.793 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.793 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.793 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.794 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.794 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.794 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.794 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.794 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.794 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:43 smithi022 ceph-mon[39439]: 7.c deep-scrub starts 2024-04-01T19:51:43.794 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:43 smithi022 ceph-mon[39439]: pgmap v1640: 17 pgs: 17 active+clean; 8.0 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 941 op/s 2024-04-01T19:51:43.798 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:43.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:43.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:43 smithi188 ceph-mon[43939]: 7.c deep-scrub starts 2024-04-01T19:51:43.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:43 smithi188 ceph-mon[43939]: pgmap v1640: 17 pgs: 17 active+clean; 8.0 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 941 op/s 2024-04-01T19:51:44.135 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:51:44.146 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:51:44.152 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:44.153 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:51:44.254 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:51:44.293 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:44.838 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:51:44.839 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:51:45.351 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:51:45.358 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:45.359 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:51:45.460 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:51:45.510 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:45.592 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:51:45.599 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:45.600 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:51:45.630 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:51:45.642 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_ops_in_flight 2024-04-01T19:51:45.700 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:51:45.797 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:46.187 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:51:46.189 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:51:46.195 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:46.196 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:51:46.297 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:51:46.328 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:46.352 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:51:46.356 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:46.357 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:51:46.458 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:51:46.509 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:46.538 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:51:46.538 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:46.539 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:51:46.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:46 smithi022 ceph-mon[39439]: pgmap v1641: 17 pgs: 17 active+clean; 8.0 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 893 op/s 2024-04-01T19:51:46.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:51:46.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:51:46.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:51:46.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:51:46.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:51:46.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:46 smithi188 ceph-mon[43939]: pgmap v1641: 17 pgs: 17 active+clean; 8.0 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 893 op/s 2024-04-01T19:51:46.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:46 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:51:46.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:46 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:51:46.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:46 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:51:46.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:46 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:51:46.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:46 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:51:46.639 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:51:46.669 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:46.701 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:51:46.707 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:46.708 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:51:46.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:46 smithi062 ceph-mon[44211]: pgmap v1641: 17 pgs: 17 active+clean; 8.0 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 893 op/s 2024-04-01T19:51:46.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:46 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:51:46.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:46 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:51:46.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:46 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:51:46.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:46 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:51:46.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:46 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:51:46.809 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:51:46.838 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:46.862 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:51:46.864 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:46.865 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:51:46.966 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:51:46.994 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:47.016 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:51:47.022 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:47.023 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:51:47.124 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:51:47.177 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:51:47.449 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:47.449 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:51:47.550 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:51:47.591 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:47.615 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:51:47.620 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:47.621 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:51:47.722 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:51:47.783 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:47.874 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:51:47.878 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:47.878 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:51:47.979 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:51:48.011 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:48.034 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:51:48.038 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:48.038 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:51:48.139 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:51:48.179 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:48.203 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:51:48.207 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:48.208 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:51:48.309 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:51:48.375 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:48.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:48 smithi022 ceph-mon[39439]: pgmap v1642: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 7.7 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.27k op/s 2024-04-01T19:51:48.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:48 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:51:48.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:48 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:51:48.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:48 smithi188 ceph-mon[43939]: pgmap v1642: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 7.7 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.27k op/s 2024-04-01T19:51:48.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:48 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:51:48.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:48 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:51:48.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:48 smithi062 ceph-mon[44211]: pgmap v1642: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 7.7 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.27k op/s 2024-04-01T19:51:48.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:48 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:51:48.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:48 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:51:49.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:49 smithi022 ceph-mon[39439]: osdmap e595: 12 total, 12 up, 11 in 2024-04-01T19:51:49.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:49 smithi188 ceph-mon[43939]: osdmap e595: 12 total, 12 up, 11 in 2024-04-01T19:51:49.698 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:51:49.704 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:51:49.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:49 smithi062 ceph-mon[44211]: osdmap e595: 12 total, 12 up, 11 in 2024-04-01T19:51:50.151 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:51:50.158 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:50.158 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:51:50.259 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:51:50.289 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:50.311 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:51:50.314 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:50.315 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:51:50.416 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:51:50.451 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:50.478 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:51:50.479 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:50 smithi022 ceph-mon[39439]: pgmap v1644: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 7.6 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 926 op/s 2024-04-01T19:51:50.481 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:50.481 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:51:50.582 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:51:50.613 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:50 smithi188 ceph-mon[43939]: pgmap v1644: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 7.6 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 926 op/s 2024-04-01T19:51:50.614 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:50.635 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:51:50.637 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:50.638 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:51:50.739 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:51:50.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:50 smithi062 ceph-mon[44211]: pgmap v1644: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 7.6 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 926 op/s 2024-04-01T19:51:50.780 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:51.056 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:51:51.065 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:51.065 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:51:51.067 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.10 reset_purged_snaps_last 2024-04-01T19:51:51.166 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:51:51.206 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:51.234 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:51:51.237 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:51.238 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:51:51.339 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:51:51.357 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:51:51.466 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:51.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:51 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1953313101' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:51:51.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:51 smithi062 ceph-mon[44211]: from='client.36803 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:51:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:51 smithi062 ceph-mon[44211]: pgmap v1645: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 7.4 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 989 op/s 2024-04-01T19:51:51.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:51 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1953313101' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:51:51.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:51 smithi022 ceph-mon[39439]: from='client.36803 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:51:51.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:51 smithi022 ceph-mon[39439]: pgmap v1645: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 7.4 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 989 op/s 2024-04-01T19:51:51.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:51 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1953313101' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:51:51.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:51 smithi188 ceph-mon[43939]: from='client.36803 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:51:51.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:51 smithi188 ceph-mon[43939]: pgmap v1645: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 7.4 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 989 op/s 2024-04-01T19:51:52.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:52 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:51:52.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:52 smithi022 ceph-mon[39439]: from='client.36803 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:51:52.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:52 smithi022 ceph-mon[39439]: osdmap e596: 12 total, 12 up, 11 in 2024-04-01T19:51:52.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:52 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:51:52.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:52 smithi188 ceph-mon[43939]: from='client.36803 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:51:52.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:52 smithi188 ceph-mon[43939]: osdmap e596: 12 total, 12 up, 11 in 2024-04-01T19:51:52.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:52 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:51:52.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:52 smithi062 ceph-mon[44211]: from='client.36803 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:51:52.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:52 smithi062 ceph-mon[44211]: osdmap e596: 12 total, 12 up, 11 in 2024-04-01T19:51:53.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:53 smithi022 ceph-mon[39439]: pgmap v1647: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 7.4 GiB data, 20 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:51:53.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:53 smithi188 ceph-mon[43939]: pgmap v1647: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 7.4 GiB data, 20 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:51:53.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:53 smithi062 ceph-mon[44211]: pgmap v1647: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 7.4 GiB data, 20 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:51:54.506 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:51:54.510 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:54.511 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:51:54.612 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:51:54.642 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:54.671 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:51:54.679 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:54.680 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:51:54.781 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:51:54.836 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:54.929 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:51:54.939 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:54.939 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:51:55.040 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:51:55.086 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:55.118 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:51:55.123 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:55.124 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:51:55.225 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:51:55.281 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:55.664 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:51:56.045 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:51:56.084 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:51:56.120 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:51:56.151 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:51:56.180 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:51:56.217 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:51:56.234 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:51:56.236 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:56.237 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:51:56.250 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:51:56.284 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:51:56.315 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:51:56.337 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:51:56.343 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:51:56.378 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:51:56.404 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:56.419 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:51:56.451 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:51:56.451 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:51:56.451 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:51:56.451 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:51:56.451 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:51:56.451 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:51:56.451 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:51:56.451 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:51:56.451 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:51:56.451 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:51:56.451 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:51:56.452 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:51:56.480 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:56 smithi022 ceph-mon[39439]: pgmap v1648: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 7.3 GiB data, 20 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 714 op/s 2024-04-01T19:51:56.480 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:56 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:51:56.480 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:56 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:51:56.480 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:56 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3902587553' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:51:56.480 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:56 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:56.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:56 smithi188 ceph-mon[43939]: pgmap v1648: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 7.3 GiB data, 20 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 714 op/s 2024-04-01T19:51:56.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:56 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:51:56.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:56 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:51:56.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:56 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3902587553' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:51:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:56 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:56.656 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:51:56.674 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:51:56.681 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:56.682 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:51:56.706 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:51:56.706 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:51:56.706 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:51:56.706 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.36668.0:225144 7.3 e597/560 7:c936a18b:::benchmark_data_smithi188_147022_object55500:head v 597'13893, mlcod=597'13890)", 2024-04-01T19:51:56.706 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:51:56.703390+0000", 2024-04-01T19:51:56.707 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0052090940000000001, 2024-04-01T19:51:56.707 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0052197709999999998, 2024-04-01T19:51:56.707 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:51:56.707 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:51:56.707 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:51:56.707 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:51:56.707 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:51:56.707 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:51:56.707 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:56.703390+0000", 2024-04-01T19:51:56.707 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:51:56.707 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:51:56.707 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:51:56.708 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:51:56.708 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:56.703390+0000", 2024-04-01T19:51:56.708 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:51:56.708 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:51:56.708 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:51:56.708 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:51:56.708 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:56.703391+0000", 2024-04-01T19:51:56.708 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5200000000000001e-06 2024-04-01T19:51:56.708 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:51:56.708 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:51:56.708 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:51:56.708 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:56.703399+0000", 2024-04-01T19:51:56.709 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2690000000000002e-06 2024-04-01T19:51:56.709 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:51:56.709 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:51:56.709 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:51:56.709 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:56.703410+0000", 2024-04-01T19:51:56.709 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1219e-05 2024-04-01T19:51:56.709 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:51:56.709 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:51:56.709 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:51:56.709 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:56.703419+0000", 2024-04-01T19:51:56.709 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.5359999999999992e-06 2024-04-01T19:51:56.709 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:51:56.709 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:51:56.710 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:51:56.710 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:56.703471+0000", 2024-04-01T19:51:56.710 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2253000000000003e-05 2024-04-01T19:51:56.710 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:51:56.710 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:51:56.710 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:51:56.710 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:56.703496+0000", 2024-04-01T19:51:56.710 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.5426999999999999e-05 2024-04-01T19:51:56.710 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:51:56.710 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:51:56.710 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T19:51:56.710 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:56.708562+0000", 2024-04-01T19:51:56.710 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0050660180000000003 2024-04-01T19:51:56.711 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:51:56.711 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:51:56.711 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T19:51:56.711 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:56.708610+0000", 2024-04-01T19:51:56.711 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7528999999999998e-05 2024-04-01T19:51:56.711 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:51:56.711 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:51:56.711 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:51:56.711 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:51:56.711 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T19:51:56.711 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 1 2024-04-01T19:51:56.711 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:51:56.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:56 smithi062 ceph-mon[44211]: pgmap v1648: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 7.3 GiB data, 20 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 714 op/s 2024-04-01T19:51:56.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:56 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:51:56.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:56 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:51:56.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:56 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3902587553' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:51:56.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:56 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:56.783 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:51:56.813 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:56.837 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:51:56.840 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:56.841 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:51:56.942 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:51:56.971 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:56.997 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:51:57.003 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:57.003 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:51:57.104 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:51:57.134 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:57.168 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:51:57.172 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:57.172 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:51:57.273 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:51:57.327 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:57.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:57 smithi062 ceph-mon[44211]: osdmap e597: 12 total, 12 up, 11 in 2024-04-01T19:51:57.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:57 smithi022 ceph-mon[39439]: osdmap e597: 12 total, 12 up, 11 in 2024-04-01T19:51:57.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:57 smithi188 ceph-mon[43939]: osdmap e597: 12 total, 12 up, 11 in 2024-04-01T19:51:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:51:58.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:58 smithi022 ceph-mon[39439]: pgmap v1650: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 7.0 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:51:58.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:58 smithi188 ceph-mon[43939]: pgmap v1650: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 7.0 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:51:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:58 smithi062 ceph-mon[44211]: pgmap v1650: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 7.0 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:51:58.788 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:51:58.794 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:58.795 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:51:58.895 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:51:58.940 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:58.965 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:51:58.969 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:58.969 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:51:59.070 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:51:59.122 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:59.206 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:51:59.210 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:59.210 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:51:59.311 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:51:59.375 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:51:59.579 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_blocked_ops 2024-04-01T19:51:59.644 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:51:59 smithi022 ceph-mon[39439]: pgmap v1651: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 7.0 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 871 op/s 2024-04-01T19:51:59.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:51:59 smithi062 ceph-mon[44211]: pgmap v1651: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 7.0 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 871 op/s 2024-04-01T19:51:59.853 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:51:59.862 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:51:59.863 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:51:59.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:51:59 smithi188 ceph-mon[43939]: pgmap v1651: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 7.0 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 0 B/s wr, 871 op/s 2024-04-01T19:51:59.964 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:51:59.996 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:00.023 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:52:00.027 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:00.027 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:52:00.128 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:52:00.131 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:52:00.178 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:00.620 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:52:00.627 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:00.627 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:52:00.728 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:52:00.760 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:00.783 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:52:00.785 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:00.785 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:52:00.817 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:52:00.886 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:52:00.929 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:01.064 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:52:01.074 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:01.074 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:52:01.115 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.11 reset_purged_snaps_last 2024-04-01T19:52:01.175 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:52:01.204 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:01.234 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:52:01.240 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:01.241 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:52:01.342 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:52:01.396 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:01.577 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:52:02.173 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:52:02.179 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:02.180 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:52:02.281 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:52:02.327 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:02.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:02 smithi022 ceph-mon[39439]: pgmap v1652: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 6.8 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:52:02.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:02 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:52:02.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:02 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:52:02.381 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:52:02.386 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:02.386 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:52:02.487 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:52:02.521 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:02.543 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:52:02.549 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:02.549 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:52:02.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:02 smithi188 ceph-mon[43939]: pgmap v1652: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 6.8 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:52:02.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:02 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:52:02.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:02 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:52:02.650 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:52:02.683 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:02.684 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:02 smithi062 ceph-mon[44211]: pgmap v1652: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 6.8 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:52:02.684 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:02 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:52:02.684 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:02 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:52:02.710 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:52:02.716 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:02.717 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:52:02.818 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:52:02.854 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:02.885 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:52:02.889 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:02.890 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:52:02.991 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:52:03.025 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:03.048 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:52:03.053 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:03.054 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:52:03.155 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:52:03.188 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:03.214 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:52:03.218 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:03.218 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:52:03.319 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:52:03.369 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:03.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:03 smithi062 ceph-mon[44211]: osdmap e598: 12 total, 12 up, 11 in 2024-04-01T19:52:03.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:03 smithi022 ceph-mon[39439]: osdmap e598: 12 total, 12 up, 11 in 2024-04-01T19:52:03.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:03 smithi188 ceph-mon[43939]: osdmap e598: 12 total, 12 up, 11 in 2024-04-01T19:52:04.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:04 smithi022 ceph-mon[39439]: pgmap v1654: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 6.7 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 1.24k op/s 2024-04-01T19:52:04.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:04 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/129665048' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:52:04.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:04 smithi188 ceph-mon[43939]: pgmap v1654: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 6.7 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 1.24k op/s 2024-04-01T19:52:04.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:04 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/129665048' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:52:04.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:04 smithi062 ceph-mon[44211]: pgmap v1654: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 6.7 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 1.24k op/s 2024-04-01T19:52:04.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:04 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/129665048' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:52:05.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:05 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:52:05.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:05 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/129665048' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:52:05.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:05 smithi022 ceph-mon[39439]: osdmap e599: 12 total, 12 up, 11 in 2024-04-01T19:52:05.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:05 smithi022 ceph-mon[39439]: pgmap v1656: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 6.7 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 725 op/s 2024-04-01T19:52:05.615 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:52:05.623 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:05.623 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:52:05.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:05 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:52:05.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:05 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/129665048' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:52:05.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:05 smithi188 ceph-mon[43939]: osdmap e599: 12 total, 12 up, 11 in 2024-04-01T19:52:05.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:05 smithi188 ceph-mon[43939]: pgmap v1656: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 6.7 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 725 op/s 2024-04-01T19:52:05.724 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:52:05.749 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:52:05.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:05 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:52:05.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:05 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/129665048' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:52:05.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:05 smithi062 ceph-mon[44211]: osdmap e599: 12 total, 12 up, 11 in 2024-04-01T19:52:05.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:05 smithi062 ceph-mon[44211]: pgmap v1656: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 6.7 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 725 op/s 2024-04-01T19:52:05.781 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:05.949 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:52:05.952 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:05.953 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:52:06.054 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:52:06.091 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:06.119 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:52:06.122 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:06.122 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:52:06.223 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:52:06.260 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:06.299 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:52:06.304 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:06.304 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:52:06.405 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:52:06.451 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:06.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:06 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:52:06.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:06 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:52:06.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:06 smithi062 ceph-mon[44211]: osdmap e600: 12 total, 12 up, 11 in 2024-04-01T19:52:06.786 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:52:06.792 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:06 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:52:06.792 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:06 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:52:06.792 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:06 smithi022 ceph-mon[39439]: osdmap e600: 12 total, 12 up, 11 in 2024-04-01T19:52:06.792 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:52:06.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:06 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:52:06.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:06 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:52:06.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:06 smithi188 ceph-mon[43939]: osdmap e600: 12 total, 12 up, 11 in 2024-04-01T19:52:07.133 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:52:07.136 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:07.136 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:52:07.237 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:52:07.292 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:07.507 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:52:07.512 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:07.513 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:52:07.614 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:52:07.646 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:07.667 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:52:07.669 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:07 smithi062 ceph-mon[44211]: pgmap v1658: 17 pgs: 17 active+clean; 6.4 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:52:07.670 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:07.670 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:52:07.736 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:07 smithi022 ceph-mon[39439]: pgmap v1658: 17 pgs: 17 active+clean; 6.4 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:52:07.771 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:52:07.794 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:52:07.794 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:52:07.794 INFO:teuthology.orchestra.run.smithi022.stdout: "complaint_time": 30, 2024-04-01T19:52:07.794 INFO:teuthology.orchestra.run.smithi022.stdout: "num_blocked_ops": 0 2024-04-01T19:52:07.794 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:52:07.804 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:07 smithi188 ceph-mon[43939]: pgmap v1658: 17 pgs: 17 active+clean; 6.4 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:52:07.806 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:07.848 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:52:07.851 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:07.851 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:52:07.952 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:52:07.987 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:08.018 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:52:08.022 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:08.022 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:52:08.123 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:52:08.156 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:08.179 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:52:08.182 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:08.182 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:52:08.283 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:52:08.316 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:08.344 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:52:08.349 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:08.349 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:52:08.450 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:52:08.479 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:08.512 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:52:08.515 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:08.516 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:52:08.617 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:52:08.653 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:08.679 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:52:08.685 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:08.686 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:52:08.787 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:52:08.818 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:08.827 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:52:08.845 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:52:08.847 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:08.847 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:52:08.948 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:52:08.982 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:09.012 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:52:09.018 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:09.019 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:52:09.120 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:52:09.189 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:09.848 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:52:09.862 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:09.863 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:52:09.964 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:52:10.005 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:10.035 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:52:10.038 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:10.038 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:52:10.139 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:52:10.171 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:10.197 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:52:10.200 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:10.200 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:52:10.301 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:52:10.344 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:10.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:10 smithi022 ceph-mon[39439]: pgmap v1659: 17 pgs: 17 active+clean; 6.3 GiB data, 18 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 915 op/s 2024-04-01T19:52:10.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:10 smithi188 ceph-mon[43939]: pgmap v1659: 17 pgs: 17 active+clean; 6.3 GiB data, 18 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 915 op/s 2024-04-01T19:52:10.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:10 smithi062 ceph-mon[44211]: pgmap v1659: 17 pgs: 17 active+clean; 6.3 GiB data, 18 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 915 op/s 2024-04-01T19:52:11.079 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_historic_ops 2024-04-01T19:52:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:52:11.533 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:11.533 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:52:11.634 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:52:11.667 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:11.692 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:52:11.694 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:11 smithi188 ceph-mon[43939]: pgmap v1660: 17 pgs: 17 active+clean; 6.1 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.33k op/s 2024-04-01T19:52:11.695 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:11.695 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:52:11.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:11 smithi062 ceph-mon[44211]: pgmap v1660: 17 pgs: 17 active+clean; 6.1 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.33k op/s 2024-04-01T19:52:11.767 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:11 smithi022 ceph-mon[39439]: pgmap v1660: 17 pgs: 17 active+clean; 6.1 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.33k op/s 2024-04-01T19:52:11.796 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:52:11.832 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:11.860 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:52:11.862 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:11.863 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:52:11.964 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:52:12.001 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:12.030 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:52:12.033 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:12.033 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:52:12.135 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:52:12.202 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:12.233 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:52:12.238 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:12.238 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:52:12.339 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:52:12.370 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:12.391 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:52:12.393 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:12.393 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:52:12.494 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:52:12.521 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:12.540 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:52:12.542 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:12.543 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:52:12.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:12 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:52:12.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:12 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:52:12.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:12 smithi188 ceph-mon[43939]: osdmap e601: 12 total, 12 up, 11 in 2024-04-01T19:52:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:12 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1682487379' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:52:12.643 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:52:12.711 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:12 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:52:12.711 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:12 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:52:12.711 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:12 smithi022 ceph-mon[39439]: osdmap e601: 12 total, 12 up, 11 in 2024-04-01T19:52:12.711 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:12 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1682487379' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:52:12.713 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:12.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:12 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:52:12.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:12 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:52:12.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:12 smithi062 ceph-mon[44211]: osdmap e601: 12 total, 12 up, 11 in 2024-04-01T19:52:12.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:12 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1682487379' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:52:12.911 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:52:12.911 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:52:12.911 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:52:12.911 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:52:12.911 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:52:12.912 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:52:12.912 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:52:12.912 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:52:12.912 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:52:12.912 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:52:12.912 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:52:12.912 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:52:12.915 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:52:12.916 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:52:12.916 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:52:12.916 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:52:12.916 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:52:12.916 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:52:12.916 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:52:12.916 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:52:12.916 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:52:12.916 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:52:12.916 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:52:12.916 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:52:13.706 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:52:13.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:13.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:13.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:13.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:13.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:13.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:13.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:13.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:13.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:13 smithi062 ceph-mon[44211]: pgmap v1662: 17 pgs: 17 active+clean; 6.0 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.40k op/s 2024-04-01T19:52:13.820 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:13.821 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:13.821 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:13.821 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:13.821 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:13.821 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:13.821 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:13.821 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:13.821 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:13 smithi022 ceph-mon[39439]: pgmap v1662: 17 pgs: 17 active+clean; 6.0 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.40k op/s 2024-04-01T19:52:13.848 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.8 reset_purged_snaps_last 2024-04-01T19:52:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:13 smithi188 ceph-mon[43939]: pgmap v1662: 17 pgs: 17 active+clean; 6.0 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.40k op/s 2024-04-01T19:52:14.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:14.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:14.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:14.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:14.743 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:14.744 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:52:14.744 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:52:14.755 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:52:14.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:14.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:14.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:14.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:14.845 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:52:14.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:14.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:14.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:14.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:14.906 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:52:14.909 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:14.910 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:52:15.011 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:52:15.047 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:15.077 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:52:15.079 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:15.080 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:52:15.181 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:52:15.239 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:15.354 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:52:15.365 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:15.366 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:52:15.467 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:52:15.499 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:15.526 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:52:15.530 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:15.531 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:52:15.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:15 smithi022 ceph-mon[39439]: pgmap v1663: 17 pgs: 17 active+clean; 5.9 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:52:15.632 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:52:15.669 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:15.704 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:52:15.708 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:15.709 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:52:15.713 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:15 smithi188 ceph-mon[43939]: pgmap v1663: 17 pgs: 17 active+clean; 5.9 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:52:15.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:15 smithi062 ceph-mon[44211]: pgmap v1663: 17 pgs: 17 active+clean; 5.9 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:52:15.809 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:52:15.843 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:15.864 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:52:15.871 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:15.871 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:52:15.972 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:52:16.002 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:16.027 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:52:16.031 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:16.032 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:52:16.133 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:52:16.207 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:16.260 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:52:16.265 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:16.266 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:52:16.367 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:52:16.429 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:16.600 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:52:16.604 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:16.605 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:52:16.706 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:52:16.751 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:52:16.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:16 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:52:16.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:16 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:52:16.758 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:16.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:16 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:52:16.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:16 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:52:16.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:16 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:52:16.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:16 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:52:17.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:17 smithi062 ceph-mon[44211]: osdmap e602: 12 total, 12 up, 11 in 2024-04-01T19:52:17.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:17 smithi062 ceph-mon[44211]: pgmap v1665: 17 pgs: 17 active+clean; 5.6 GiB data, 17 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 1.42k op/s 2024-04-01T19:52:17.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:17 smithi022 ceph-mon[39439]: osdmap e602: 12 total, 12 up, 11 in 2024-04-01T19:52:17.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:17 smithi022 ceph-mon[39439]: pgmap v1665: 17 pgs: 17 active+clean; 5.6 GiB data, 17 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 1.42k op/s 2024-04-01T19:52:17.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:17 smithi188 ceph-mon[43939]: osdmap e602: 12 total, 12 up, 11 in 2024-04-01T19:52:17.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:17 smithi188 ceph-mon[43939]: pgmap v1665: 17 pgs: 17 active+clean; 5.6 GiB data, 17 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 1.42k op/s 2024-04-01T19:52:18.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:18 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:52:18.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:18 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:52:18.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:18 smithi062 ceph-mon[44211]: osdmap e603: 12 total, 12 up, 11 in 2024-04-01T19:52:18.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:18 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:52:18.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:18 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:52:18.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:18 smithi022 ceph-mon[39439]: osdmap e603: 12 total, 12 up, 11 in 2024-04-01T19:52:18.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:18 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:52:18.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:18 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:52:18.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:18 smithi188 ceph-mon[43939]: osdmap e603: 12 total, 12 up, 11 in 2024-04-01T19:52:19.113 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:52:19.152 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:52:19.159 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:19.160 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:52:19.261 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:52:19.296 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:19.325 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:52:19.331 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:19.331 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:52:19.432 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:52:19.463 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:19.491 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:52:19.495 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:19.495 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:52:19.515 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:52:19.596 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:52:19.628 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:19 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3067630967' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:52:19.628 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:19 smithi062 ceph-mon[44211]: from='client.36836 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:52:19.628 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:19 smithi062 ceph-mon[44211]: pgmap v1667: 17 pgs: 17 active+clean; 5.6 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 948 op/s 2024-04-01T19:52:19.631 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:19.659 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:52:19.665 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:19.666 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:52:19.767 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:52:19.803 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:19 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3067630967' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:52:19.804 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:19 smithi188 ceph-mon[43939]: from='client.36836 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:52:19.804 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:19 smithi188 ceph-mon[43939]: pgmap v1667: 17 pgs: 17 active+clean; 5.6 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 948 op/s 2024-04-01T19:52:19.806 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:19.814 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:19 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3067630967' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:52:19.814 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:19 smithi022 ceph-mon[39439]: from='client.36836 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:52:19.814 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:19 smithi022 ceph-mon[39439]: pgmap v1667: 17 pgs: 17 active+clean; 5.6 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 948 op/s 2024-04-01T19:52:19.835 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:52:19.837 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:19.838 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:52:19.939 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:52:19.995 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:20.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:20 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:52:20.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:20 smithi022 ceph-mon[39439]: from='client.36836 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:52:20.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:20 smithi022 ceph-mon[39439]: osdmap e604: 12 total, 12 up, 11 in 2024-04-01T19:52:20.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:20 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:52:20.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:20 smithi062 ceph-mon[44211]: from='client.36836 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:52:20.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:20 smithi062 ceph-mon[44211]: osdmap e604: 12 total, 12 up, 11 in 2024-04-01T19:52:20.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:20 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:52:20.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:20 smithi188 ceph-mon[43939]: from='client.36836 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:52:20.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:20 smithi188 ceph-mon[43939]: osdmap e604: 12 total, 12 up, 11 in 2024-04-01T19:52:21.121 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:52:21.582 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:52:21.582 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:52:21.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:21 smithi062 ceph-mon[44211]: 7.4 scrub starts 2024-04-01T19:52:21.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:21 smithi062 ceph-mon[44211]: pgmap v1669: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.3 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 1.69k op/s 2024-04-01T19:52:21.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:21 smithi022 ceph-mon[39439]: 7.4 scrub starts 2024-04-01T19:52:21.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:21 smithi022 ceph-mon[39439]: pgmap v1669: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.3 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 1.69k op/s 2024-04-01T19:52:21.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:21 smithi188 ceph-mon[43939]: 7.4 scrub starts 2024-04-01T19:52:21.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:21 smithi188 ceph-mon[43939]: pgmap v1669: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.3 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 0 B/s wr, 1.69k op/s 2024-04-01T19:52:22.595 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:52:22.609 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:22.609 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:52:22.710 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:52:22.742 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:22.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:22 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T19:52:22.769 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:52:22.772 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:22.773 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:52:22.814 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:22 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T19:52:22.874 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:52:22.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:22 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T19:52:22.921 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:23.293 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:52:23.301 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:23.302 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:52:23.403 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:52:23.444 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:23.469 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:52:23.474 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:23.475 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:52:23.576 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:52:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:23.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:23 smithi022 ceph-mon[39439]: 7.4 scrub ok 2024-04-01T19:52:23.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:23 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T19:52:23.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:23 smithi022 ceph-mon[39439]: pgmap v1670: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.3 GiB data, 16 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 902 op/s 2024-04-01T19:52:23.657 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:52:23.664 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:23.665 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:52:23.682 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_ops_in_flight 2024-04-01T19:52:23.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:23 smithi062 ceph-mon[44211]: 7.4 scrub ok 2024-04-01T19:52:23.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:23 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T19:52:23.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:23 smithi062 ceph-mon[44211]: pgmap v1670: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.3 GiB data, 16 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 902 op/s 2024-04-01T19:52:23.766 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:52:23.804 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:23.833 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:52:23.837 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:23.837 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:52:23.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:23 smithi188 ceph-mon[43939]: 7.4 scrub ok 2024-04-01T19:52:23.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:23 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T19:52:23.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:23 smithi188 ceph-mon[43939]: pgmap v1670: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.3 GiB data, 16 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 902 op/s 2024-04-01T19:52:23.938 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:52:23.981 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:24.027 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:52:24.029 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:24.030 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:52:24.131 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:52:24.204 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:24.244 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:52:24.252 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:24.253 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:52:24.354 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:52:24.433 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:24.573 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:24 smithi022 ceph-mon[39439]: 7.0 scrub starts 2024-04-01T19:52:24.573 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:24 smithi022 ceph-mon[39439]: 7.c scrub starts 2024-04-01T19:52:24.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:24 smithi062 ceph-mon[44211]: 7.0 scrub starts 2024-04-01T19:52:24.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:24 smithi062 ceph-mon[44211]: 7.c scrub starts 2024-04-01T19:52:24.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:24 smithi188 ceph-mon[43939]: 7.0 scrub starts 2024-04-01T19:52:24.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:24 smithi188 ceph-mon[43939]: 7.c scrub starts 2024-04-01T19:52:25.339 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:52:25.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:25 smithi022 ceph-mon[39439]: 7.5 scrub starts 2024-04-01T19:52:25.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:25 smithi022 ceph-mon[39439]: 7.0 scrub ok 2024-04-01T19:52:25.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:25 smithi022 ceph-mon[39439]: 7.c scrub ok 2024-04-01T19:52:25.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:25 smithi022 ceph-mon[39439]: pgmap v1671: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.2 GiB data, 16 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 866 op/s 2024-04-01T19:52:25.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:25 smithi188 ceph-mon[43939]: 7.5 scrub starts 2024-04-01T19:52:25.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:25 smithi188 ceph-mon[43939]: 7.0 scrub ok 2024-04-01T19:52:25.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:25 smithi188 ceph-mon[43939]: 7.c scrub ok 2024-04-01T19:52:25.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:25 smithi188 ceph-mon[43939]: pgmap v1671: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.2 GiB data, 16 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 866 op/s 2024-04-01T19:52:25.943 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:52:25.994 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:25.995 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:52:26.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:25 smithi062 ceph-mon[44211]: 7.5 scrub starts 2024-04-01T19:52:26.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:25 smithi062 ceph-mon[44211]: 7.0 scrub ok 2024-04-01T19:52:26.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:25 smithi062 ceph-mon[44211]: 7.c scrub ok 2024-04-01T19:52:26.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:25 smithi062 ceph-mon[44211]: pgmap v1671: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.2 GiB data, 16 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 866 op/s 2024-04-01T19:52:26.095 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:52:26.127 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:26.152 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:52:26.159 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:26.159 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:52:26.260 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:52:26.315 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:26.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:26 smithi022 ceph-mon[39439]: 7.5 scrub ok 2024-04-01T19:52:26.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:26 smithi188 ceph-mon[43939]: 7.5 scrub ok 2024-04-01T19:52:27.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:26 smithi062 ceph-mon[44211]: 7.5 scrub ok 2024-04-01T19:52:27.189 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:52:27.196 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:27.197 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:52:27.210 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.6 reset_purged_snaps_last 2024-04-01T19:52:27.218 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:52:27.298 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:52:27.330 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:27.351 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:52:27.355 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:27.355 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:52:27.456 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:52:27.488 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:27.512 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:52:27.515 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:27.515 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:52:27.616 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:52:27.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:27 smithi188 ceph-mon[43939]: pgmap v1672: 17 pgs: 17 active+clean; 4.9 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:52:27.653 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:27.684 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:52:27.688 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:27.689 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:52:27.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:27 smithi062 ceph-mon[44211]: pgmap v1672: 17 pgs: 17 active+clean; 4.9 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:52:27.790 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:27 smithi022 ceph-mon[39439]: pgmap v1672: 17 pgs: 17 active+clean; 4.9 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:52:27.790 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:52:27.825 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:27.850 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:52:27.853 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:27.854 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:52:27.955 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:52:27.986 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:28.012 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:52:28.016 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:28.016 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:52:28.117 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:52:28.146 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:28.150 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:52:28.172 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:52:28.172 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:52:28.172 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:52:28.175 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:28.175 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:52:28.212 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:52:28.247 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:52:28.276 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:52:28.289 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:52:28.306 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:28.320 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:52:28.328 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:52:28.331 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:28.331 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:52:28.357 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:52:28.387 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:52:28.417 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:52:28.432 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:52:28.449 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:52:28.495 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:28.496 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:52:28.531 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:52:28.542 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:52:28.542 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:52:28.542 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:52:28.542 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:52:28.542 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:52:28.542 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:52:28.542 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:52:28.542 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:52:28.542 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:52:28.543 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:52:28.543 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:52:28.543 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:52:28.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:28 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1737635218' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:52:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:28 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:28.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:28 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1737635218' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:52:28.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:28 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:28 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1737635218' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:52:29.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:28 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.283 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:52:29.293 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:29.293 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:52:29.394 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:52:29.426 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:29.448 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:52:29.450 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:29.451 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:52:29.531 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.531 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.531 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.531 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.532 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.552 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:52:29.580 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:29.605 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:52:29.607 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:29.608 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:52:29.709 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:52:29.744 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.744 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.745 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.745 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.745 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.745 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.745 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.745 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.745 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.745 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.745 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.745 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:29 smithi062 ceph-mon[44211]: pgmap v1673: 17 pgs: 17 active+clean; 4.8 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:52:29.747 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:29.776 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:52:29.782 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:29.783 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:52:29.815 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.815 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.815 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.815 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.815 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.815 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.815 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:29 smithi022 ceph-mon[39439]: pgmap v1673: 17 pgs: 17 active+clean; 4.8 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:52:29.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:29 smithi188 ceph-mon[43939]: pgmap v1673: 17 pgs: 17 active+clean; 4.8 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:52:29.884 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:52:29.916 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:29.938 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:52:29.940 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:29.941 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:52:30.042 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:52:30.077 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:30.107 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:52:30.110 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:30.111 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:52:30.212 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:52:30.241 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:30.264 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:52:30.267 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:30.267 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:52:30.368 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:52:30.432 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:31.442 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:52:31.714 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:52:31.718 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:31 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/72700410' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:52:31.718 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:31 smithi022 ceph-mon[39439]: from='client.36854 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:52:31.718 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:31 smithi022 ceph-mon[39439]: 7.a scrub starts 2024-04-01T19:52:31.718 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:31 smithi022 ceph-mon[39439]: pgmap v1674: 17 pgs: 17 active+clean; 4.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 1.39k op/s 2024-04-01T19:52:31.719 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:31.719 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:52:31.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:31 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/72700410' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:52:31.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:31 smithi062 ceph-mon[44211]: from='client.36854 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:52:31.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:31 smithi062 ceph-mon[44211]: 7.a scrub starts 2024-04-01T19:52:31.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:31 smithi062 ceph-mon[44211]: pgmap v1674: 17 pgs: 17 active+clean; 4.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 1.39k op/s 2024-04-01T19:52:31.821 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:52:31.848 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:31 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/72700410' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:52:31.848 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:31 smithi188 ceph-mon[43939]: from='client.36854 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:52:31.848 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:31 smithi188 ceph-mon[43939]: 7.a scrub starts 2024-04-01T19:52:31.849 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:31 smithi188 ceph-mon[43939]: pgmap v1674: 17 pgs: 17 active+clean; 4.6 GiB data, 15 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 1.39k op/s 2024-04-01T19:52:31.851 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:31.876 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:52:31.880 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:31.881 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:52:31.982 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:52:32.017 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:32.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:32 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:52:32.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:32 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:52:32.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:32 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:52:32.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:32 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:52:32.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:32 smithi022 ceph-mon[39439]: from='client.36854 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:52:32.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:32 smithi022 ceph-mon[39439]: osdmap e605: 12 total, 12 up, 11 in 2024-04-01T19:52:32.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:32 smithi022 ceph-mon[39439]: 7.a scrub ok 2024-04-01T19:52:32.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:32 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:52:32.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:32 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:52:32.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:32 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:52:32.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:32 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:52:32.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:32 smithi062 ceph-mon[44211]: from='client.36854 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:52:32.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:32 smithi062 ceph-mon[44211]: osdmap e605: 12 total, 12 up, 11 in 2024-04-01T19:52:32.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:32 smithi062 ceph-mon[44211]: 7.a scrub ok 2024-04-01T19:52:32.790 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:52:32.799 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:32.799 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:52:32.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:32 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:52:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:32 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:52:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:32 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:52:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:32 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:52:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:32 smithi188 ceph-mon[43939]: from='client.36854 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:52:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:32 smithi188 ceph-mon[43939]: osdmap e605: 12 total, 12 up, 11 in 2024-04-01T19:52:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:32 smithi188 ceph-mon[43939]: 7.a scrub ok 2024-04-01T19:52:32.901 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:52:32.976 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:33.686 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {auth=26,config=2,health=12,kv=53,logm=7} crc {auth=4023383607,config=2353167246,health=861809967,kv=965265598,logm=4238714304}) 2024-04-01T19:52:33.686 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=279751193}) 2024-04-01T19:52:33.686 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1187871174}) 2024-04-01T19:52:33.686 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1864569492}) 2024-04-01T19:52:33.686 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=923996713}) 2024-04-01T19:52:33.686 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2488234412}) 2024-04-01T19:52:33.686 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3216130185}) 2024-04-01T19:52:33.686 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=947555844}) 2024-04-01T19:52:33.686 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3216708208}) 2024-04-01T19:52:33.686 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2740123125}) 2024-04-01T19:52:33.686 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1967379794}) 2024-04-01T19:52:33.687 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2838075376}) 2024-04-01T19:52:33.687 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2869836094}) 2024-04-01T19:52:33.687 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=386439358}) 2024-04-01T19:52:33.687 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3549130550}) 2024-04-01T19:52:33.687 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3629132911}) 2024-04-01T19:52:33.687 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=854555917}) 2024-04-01T19:52:33.687 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1587902432}) 2024-04-01T19:52:33.687 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2678737538}) 2024-04-01T19:52:33.687 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1096604369}) 2024-04-01T19:52:33.687 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1121480872}) 2024-04-01T19:52:33.687 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1029040658}) 2024-04-01T19:52:33.687 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=589872464}) 2024-04-01T19:52:33.687 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4196874059}) 2024-04-01T19:52:33.688 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2654508615}) 2024-04-01T19:52:33.688 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1120361245}) 2024-04-01T19:52:33.688 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2401668711}) 2024-04-01T19:52:33.688 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2474334799}) 2024-04-01T19:52:33.688 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1500840152}) 2024-04-01T19:52:33.688 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=494475325}) 2024-04-01T19:52:33.688 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1969551469}) 2024-04-01T19:52:33.688 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2662646223}) 2024-04-01T19:52:33.688 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1278166207}) 2024-04-01T19:52:33.688 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1756498167}) 2024-04-01T19:52:33.688 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3466484249}) 2024-04-01T19:52:33.688 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3034860921}) 2024-04-01T19:52:33.689 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3568643938}) 2024-04-01T19:52:33.689 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3765281241}) 2024-04-01T19:52:33.689 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2554350602}) 2024-04-01T19:52:33.689 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2168285588}) 2024-04-01T19:52:33.689 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3050847277}) 2024-04-01T19:52:33.689 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3840875154}) 2024-04-01T19:52:33.689 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3143708158}) 2024-04-01T19:52:33.689 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1758956056}) 2024-04-01T19:52:33.689 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=366453196}) 2024-04-01T19:52:33.689 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2944302372}) 2024-04-01T19:52:33.689 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2681829871}) 2024-04-01T19:52:33.689 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4045073246}) 2024-04-01T19:52:33.689 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2013993016}) 2024-04-01T19:52:33.689 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3886629858}) 2024-04-01T19:52:33.689 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2541058765}) 2024-04-01T19:52:33.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2383390688}) 2024-04-01T19:52:33.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1666605226}) 2024-04-01T19:52:33.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1333489153}) 2024-04-01T19:52:33.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2370519788}) 2024-04-01T19:52:33.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2544753121}) 2024-04-01T19:52:33.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1135224321}) 2024-04-01T19:52:33.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3612377613}) 2024-04-01T19:52:33.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3104681872}) 2024-04-01T19:52:33.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4076672531}) 2024-04-01T19:52:33.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=472709562}) 2024-04-01T19:52:33.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2101763676}) 2024-04-01T19:52:33.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1370363734}) 2024-04-01T19:52:33.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2160472308}) 2024-04-01T19:52:33.691 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4108407721}) 2024-04-01T19:52:33.691 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2743643007}) 2024-04-01T19:52:33.691 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3256804603}) 2024-04-01T19:52:33.691 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3225708024}) 2024-04-01T19:52:33.691 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=543499178}) 2024-04-01T19:52:33.691 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2132955903}) 2024-04-01T19:52:33.691 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3043125784}) 2024-04-01T19:52:33.692 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=478242835}) 2024-04-01T19:52:33.692 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3743308218}) 2024-04-01T19:52:33.692 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3757944010}) 2024-04-01T19:52:33.692 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2805455787}) 2024-04-01T19:52:33.692 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1573937}) 2024-04-01T19:52:33.692 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1381104654}) 2024-04-01T19:52:33.692 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=61,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=2,mgrstat=9,mon_config_key=6} crc {logm=2338381553,mdsmap=2840952586,mgr=1734247563,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=1535320701,mon_config_key=4069247392}) 2024-04-01T19:52:33.692 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=3947777721}) 2024-04-01T19:52:33.693 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=788169206}) 2024-04-01T19:52:33.693 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=83,monmap=5,osd_metadata=12} crc {mon_config_key=3157120053,monmap=3338646291,osd_metadata=1675620524}) 2024-04-01T19:52:33.693 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {osd_pg_creating=1,osdmap=99} crc {osd_pg_creating=3932870663,osdmap=1092680300}) 2024-04-01T19:52:33.693 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=26} crc {osdmap=1410701740}) 2024-04-01T19:52:33.693 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:33 smithi022 ceph-mon[39439]: pgmap v1676: 17 pgs: 17 active+clean; 4.5 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:52:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {auth=26,config=2,health=12,kv=53,logm=7} crc {auth=4023383607,config=2353167246,health=861809967,kv=965265598,logm=4238714304}) 2024-04-01T19:52:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=279751193}) 2024-04-01T19:52:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1187871174}) 2024-04-01T19:52:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1864569492}) 2024-04-01T19:52:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=923996713}) 2024-04-01T19:52:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2488234412}) 2024-04-01T19:52:33.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3216130185}) 2024-04-01T19:52:33.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=947555844}) 2024-04-01T19:52:33.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3216708208}) 2024-04-01T19:52:33.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2740123125}) 2024-04-01T19:52:33.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1967379794}) 2024-04-01T19:52:33.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2838075376}) 2024-04-01T19:52:33.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2869836094}) 2024-04-01T19:52:33.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=386439358}) 2024-04-01T19:52:33.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3549130550}) 2024-04-01T19:52:33.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3629132911}) 2024-04-01T19:52:33.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=854555917}) 2024-04-01T19:52:33.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1587902432}) 2024-04-01T19:52:33.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2678737538}) 2024-04-01T19:52:33.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1096604369}) 2024-04-01T19:52:33.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1121480872}) 2024-04-01T19:52:33.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1029040658}) 2024-04-01T19:52:33.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=589872464}) 2024-04-01T19:52:33.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4196874059}) 2024-04-01T19:52:33.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2654508615}) 2024-04-01T19:52:33.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1120361245}) 2024-04-01T19:52:33.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2401668711}) 2024-04-01T19:52:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2474334799}) 2024-04-01T19:52:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1500840152}) 2024-04-01T19:52:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=494475325}) 2024-04-01T19:52:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1969551469}) 2024-04-01T19:52:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2662646223}) 2024-04-01T19:52:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1278166207}) 2024-04-01T19:52:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1756498167}) 2024-04-01T19:52:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3466484249}) 2024-04-01T19:52:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3034860921}) 2024-04-01T19:52:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3568643938}) 2024-04-01T19:52:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3765281241}) 2024-04-01T19:52:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2554350602}) 2024-04-01T19:52:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2168285588}) 2024-04-01T19:52:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3050847277}) 2024-04-01T19:52:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3840875154}) 2024-04-01T19:52:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3143708158}) 2024-04-01T19:52:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1758956056}) 2024-04-01T19:52:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=366453196}) 2024-04-01T19:52:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2944302372}) 2024-04-01T19:52:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2681829871}) 2024-04-01T19:52:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4045073246}) 2024-04-01T19:52:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2013993016}) 2024-04-01T19:52:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3886629858}) 2024-04-01T19:52:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2541058765}) 2024-04-01T19:52:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2383390688}) 2024-04-01T19:52:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1666605226}) 2024-04-01T19:52:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1333489153}) 2024-04-01T19:52:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2370519788}) 2024-04-01T19:52:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2544753121}) 2024-04-01T19:52:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1135224321}) 2024-04-01T19:52:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3612377613}) 2024-04-01T19:52:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3104681872}) 2024-04-01T19:52:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4076672531}) 2024-04-01T19:52:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=472709562}) 2024-04-01T19:52:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2101763676}) 2024-04-01T19:52:33.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1370363734}) 2024-04-01T19:52:33.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2160472308}) 2024-04-01T19:52:33.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4108407721}) 2024-04-01T19:52:33.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2743643007}) 2024-04-01T19:52:33.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3256804603}) 2024-04-01T19:52:33.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3225708024}) 2024-04-01T19:52:33.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=543499178}) 2024-04-01T19:52:33.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2132955903}) 2024-04-01T19:52:33.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3043125784}) 2024-04-01T19:52:33.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=478242835}) 2024-04-01T19:52:33.768 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3743308218}) 2024-04-01T19:52:33.768 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3757944010}) 2024-04-01T19:52:33.768 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2805455787}) 2024-04-01T19:52:33.768 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1573937}) 2024-04-01T19:52:33.768 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1381104654}) 2024-04-01T19:52:33.768 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=61,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=2,mgrstat=9,mon_config_key=6} crc {logm=2338381553,mdsmap=2840952586,mgr=1734247563,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=1535320701,mon_config_key=4069247392}) 2024-04-01T19:52:33.768 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=3947777721}) 2024-04-01T19:52:33.768 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=788169206}) 2024-04-01T19:52:33.768 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=83,monmap=5,osd_metadata=12} crc {mon_config_key=3157120053,monmap=3338646291,osd_metadata=1675620524}) 2024-04-01T19:52:33.768 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {osd_pg_creating=1,osdmap=99} crc {osd_pg_creating=3932870663,osdmap=1092680300}) 2024-04-01T19:52:33.768 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=26} crc {osdmap=1410701740}) 2024-04-01T19:52:33.769 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:33 smithi062 ceph-mon[44211]: pgmap v1676: 17 pgs: 17 active+clean; 4.5 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:52:33.863 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:52:33.869 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:33.870 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:52:33.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {auth=26,config=2,health=12,kv=53,logm=7} crc {auth=4023383607,config=2353167246,health=861809967,kv=965265598,logm=4238714304}) 2024-04-01T19:52:33.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=279751193}) 2024-04-01T19:52:33.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1187871174}) 2024-04-01T19:52:33.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1864569492}) 2024-04-01T19:52:33.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=923996713}) 2024-04-01T19:52:33.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2488234412}) 2024-04-01T19:52:33.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3216130185}) 2024-04-01T19:52:33.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=947555844}) 2024-04-01T19:52:33.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3216708208}) 2024-04-01T19:52:33.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2740123125}) 2024-04-01T19:52:33.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1967379794}) 2024-04-01T19:52:33.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2838075376}) 2024-04-01T19:52:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2869836094}) 2024-04-01T19:52:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=386439358}) 2024-04-01T19:52:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3549130550}) 2024-04-01T19:52:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3629132911}) 2024-04-01T19:52:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=854555917}) 2024-04-01T19:52:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1587902432}) 2024-04-01T19:52:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2678737538}) 2024-04-01T19:52:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1096604369}) 2024-04-01T19:52:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1121480872}) 2024-04-01T19:52:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1029040658}) 2024-04-01T19:52:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=589872464}) 2024-04-01T19:52:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4196874059}) 2024-04-01T19:52:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2654508615}) 2024-04-01T19:52:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1120361245}) 2024-04-01T19:52:33.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2401668711}) 2024-04-01T19:52:33.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2474334799}) 2024-04-01T19:52:33.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1500840152}) 2024-04-01T19:52:33.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=494475325}) 2024-04-01T19:52:33.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1969551469}) 2024-04-01T19:52:33.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2662646223}) 2024-04-01T19:52:33.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1278166207}) 2024-04-01T19:52:33.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1756498167}) 2024-04-01T19:52:33.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3466484249}) 2024-04-01T19:52:33.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3034860921}) 2024-04-01T19:52:33.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3568643938}) 2024-04-01T19:52:33.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3765281241}) 2024-04-01T19:52:33.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2554350602}) 2024-04-01T19:52:33.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2168285588}) 2024-04-01T19:52:33.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3050847277}) 2024-04-01T19:52:33.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3840875154}) 2024-04-01T19:52:33.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3143708158}) 2024-04-01T19:52:33.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1758956056}) 2024-04-01T19:52:33.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=366453196}) 2024-04-01T19:52:33.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2944302372}) 2024-04-01T19:52:33.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2681829871}) 2024-04-01T19:52:33.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4045073246}) 2024-04-01T19:52:33.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2013993016}) 2024-04-01T19:52:33.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3886629858}) 2024-04-01T19:52:33.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2541058765}) 2024-04-01T19:52:33.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2383390688}) 2024-04-01T19:52:33.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1666605226}) 2024-04-01T19:52:33.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1333489153}) 2024-04-01T19:52:33.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2370519788}) 2024-04-01T19:52:33.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2544753121}) 2024-04-01T19:52:33.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1135224321}) 2024-04-01T19:52:33.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3612377613}) 2024-04-01T19:52:33.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3104681872}) 2024-04-01T19:52:33.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4076672531}) 2024-04-01T19:52:33.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=472709562}) 2024-04-01T19:52:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2101763676}) 2024-04-01T19:52:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1370363734}) 2024-04-01T19:52:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2160472308}) 2024-04-01T19:52:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4108407721}) 2024-04-01T19:52:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2743643007}) 2024-04-01T19:52:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3256804603}) 2024-04-01T19:52:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3225708024}) 2024-04-01T19:52:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=543499178}) 2024-04-01T19:52:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2132955903}) 2024-04-01T19:52:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3043125784}) 2024-04-01T19:52:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=478242835}) 2024-04-01T19:52:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3743308218}) 2024-04-01T19:52:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3757944010}) 2024-04-01T19:52:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2805455787}) 2024-04-01T19:52:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1573937}) 2024-04-01T19:52:33.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1381104654}) 2024-04-01T19:52:33.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=61,mdsmap=3,mgr=18,mgr_command_descs=1,mgr_metadata=2,mgrstat=9,mon_config_key=6} crc {logm=2338381553,mdsmap=2840952586,mgr=1734247563,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=1535320701,mon_config_key=4069247392}) 2024-04-01T19:52:33.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=3947777721}) 2024-04-01T19:52:33.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=788169206}) 2024-04-01T19:52:33.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=83,monmap=5,osd_metadata=12} crc {mon_config_key=3157120053,monmap=3338646291,osd_metadata=1675620524}) 2024-04-01T19:52:33.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {osd_pg_creating=1,osdmap=99} crc {osd_pg_creating=3932870663,osdmap=1092680300}) 2024-04-01T19:52:33.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=26} crc {osdmap=1410701740}) 2024-04-01T19:52:33.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:33 smithi188 ceph-mon[43939]: pgmap v1676: 17 pgs: 17 active+clean; 4.5 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:52:33.971 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:52:34.005 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:34.030 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:52:34.039 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:34.040 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:52:34.141 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:52:34.176 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:34.196 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:52:34.205 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:52:34.209 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:34.209 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:52:34.210 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:52:34.210 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:52:34.210 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 0 2024-04-01T19:52:34.210 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:52:34.310 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:52:34.342 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:34.373 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:52:34.376 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:34.377 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:52:34.478 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:52:34.518 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:34.542 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:52:34.545 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:34.546 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:52:34.646 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:52:34.692 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:34.728 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:52:34.734 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:34.735 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:52:34.759 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:52:34.835 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:52:34.873 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:34.902 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:52:34.907 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:34.908 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:52:35.009 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:52:35.081 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:35.693 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:52:36.363 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:52:36.370 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:36.370 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:52:36.400 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_blocked_ops 2024-04-01T19:52:36.472 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:52:36.515 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:36.538 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:52:36.539 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:36.540 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:52:36.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:36 smithi022 ceph-mon[39439]: pgmap v1677: 17 pgs: 17 active+clean; 4.5 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:52:36.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:36 smithi188 ceph-mon[43939]: pgmap v1677: 17 pgs: 17 active+clean; 4.5 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:52:36.642 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:52:36.674 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:36.704 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:52:36.709 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:36.710 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:52:36.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:36 smithi062 ceph-mon[44211]: pgmap v1677: 17 pgs: 17 active+clean; 4.5 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 0 B/s wr, 1.21k op/s 2024-04-01T19:52:36.810 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:52:36.871 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:37.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:37 smithi022 ceph-mon[39439]: 7.b scrub starts 2024-04-01T19:52:37.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:37 smithi022 ceph-mon[39439]: 7.e scrub starts 2024-04-01T19:52:37.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:37 smithi188 ceph-mon[43939]: 7.b scrub starts 2024-04-01T19:52:37.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:37 smithi188 ceph-mon[43939]: 7.e scrub starts 2024-04-01T19:52:37.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:37 smithi062 ceph-mon[44211]: 7.b scrub starts 2024-04-01T19:52:37.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:37 smithi062 ceph-mon[44211]: 7.e scrub starts 2024-04-01T19:52:37.843 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:52:37.855 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:37.856 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:52:37.957 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:52:37.975 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:52:37.975 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:52:37.975 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:52:37.984 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:38.008 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:52:38.010 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:38.011 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:52:38.112 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:52:38.146 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:38.172 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:52:38.178 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:38.179 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:52:38.280 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:52:38.330 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:52:38.554 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:38.554 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:52:38.555 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:38 smithi022 ceph-mon[39439]: 7.b scrub ok 2024-04-01T19:52:38.555 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:38 smithi022 ceph-mon[39439]: 7.e scrub ok 2024-04-01T19:52:38.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:38 smithi022 ceph-mon[39439]: pgmap v1678: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.1 GiB data, 14 GiB used, 970 GiB / 983 GiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:52:38.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:38 smithi188 ceph-mon[43939]: 7.b scrub ok 2024-04-01T19:52:38.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:38 smithi188 ceph-mon[43939]: 7.e scrub ok 2024-04-01T19:52:38.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:38 smithi188 ceph-mon[43939]: pgmap v1678: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.1 GiB data, 14 GiB used, 970 GiB / 983 GiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:52:38.655 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:52:38.687 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:38 smithi062 ceph-mon[44211]: 7.b scrub ok 2024-04-01T19:52:38.687 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:38 smithi062 ceph-mon[44211]: 7.e scrub ok 2024-04-01T19:52:38.687 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:38 smithi062 ceph-mon[44211]: pgmap v1678: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.1 GiB data, 14 GiB used, 970 GiB / 983 GiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:52:38.690 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:38.720 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:52:38.725 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:38.725 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:52:38.826 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:52:38.875 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:38.913 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:52:38.915 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:38.916 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:52:39.017 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:52:39.054 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:39.078 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:52:39.081 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:39.082 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:52:39.183 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:52:39.219 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:39.248 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:52:39.251 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:39.251 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:52:39.352 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:52:39.368 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:39 smithi188 ceph-mon[43939]: 7.d scrub starts 2024-04-01T19:52:39.387 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:39.420 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:52:39.423 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:39.424 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:52:39.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:39 smithi062 ceph-mon[44211]: 7.d scrub starts 2024-04-01T19:52:39.525 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:52:39.582 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:39 smithi022 ceph-mon[39439]: 7.d scrub starts 2024-04-01T19:52:39.945 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:52:39.952 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:39.952 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:52:40.053 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:52:40.106 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:40.156 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:52:40.167 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:40.168 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:52:40.269 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:52:40.307 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:40.334 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:52:40.337 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:40.338 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:52:40.439 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:52:40.472 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:40.500 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:52:40.507 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:40.508 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:52:40.609 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:52:40.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:40 smithi188 ceph-mon[43939]: pgmap v1679: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.1 GiB data, 13 GiB used, 970 GiB / 983 GiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:52:40.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:40 smithi188 ceph-mon[43939]: 7.d scrub ok 2024-04-01T19:52:40.643 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:40 smithi062 ceph-mon[44211]: pgmap v1679: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.1 GiB data, 13 GiB used, 970 GiB / 983 GiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:52:40.643 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:40 smithi062 ceph-mon[44211]: 7.d scrub ok 2024-04-01T19:52:40.645 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:40.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:40 smithi022 ceph-mon[39439]: pgmap v1679: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.1 GiB data, 13 GiB used, 970 GiB / 983 GiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:52:40.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:40 smithi022 ceph-mon[39439]: 7.d scrub ok 2024-04-01T19:52:40.672 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:52:40.675 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:40.676 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:52:40.777 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:52:40.811 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:40.843 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:52:40.848 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:40.848 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:52:40.949 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:52:40.984 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:41.010 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:52:41.012 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:41.013 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:52:41.113 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:52:41.178 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:41.348 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:52:41.363 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:41.363 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:52:41.464 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:52:41.500 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:41.533 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:52:41.535 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:41.536 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:52:41.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:41 smithi022 ceph-mon[39439]: 7.3 scrub starts 2024-04-01T19:52:41.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:41 smithi022 ceph-mon[39439]: pgmap v1680: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 3.8 GiB data, 13 GiB used, 970 GiB / 983 GiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:52:41.637 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:52:41.684 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:41.735 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:52:41.751 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:41.752 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:52:41.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:41 smithi062 ceph-mon[44211]: 7.3 scrub starts 2024-04-01T19:52:41.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:41 smithi062 ceph-mon[44211]: pgmap v1680: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 3.8 GiB data, 13 GiB used, 970 GiB / 983 GiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:52:41.853 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:52:41.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:41 smithi188 ceph-mon[43939]: 7.3 scrub starts 2024-04-01T19:52:41.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:41 smithi188 ceph-mon[43939]: pgmap v1680: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 3.8 GiB data, 13 GiB used, 970 GiB / 983 GiB avail; 0 B/s wr, 1.23k op/s 2024-04-01T19:52:41.886 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:41.914 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:52:41.920 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:41.920 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:52:42.021 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:52:42.074 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:42.345 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:52:42.351 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:42.352 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:52:42.453 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:52:42.493 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:42.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:42 smithi022 ceph-mon[39439]: 7.3 scrub ok 2024-04-01T19:52:42.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:42 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:52:42.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:42 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:52:42.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:42 smithi022 ceph-mon[39439]: osdmap e606: 12 total, 12 up, 11 in 2024-04-01T19:52:42.712 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:52:42.719 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:42.720 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:52:42.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:42 smithi062 ceph-mon[44211]: 7.3 scrub ok 2024-04-01T19:52:42.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:42 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:52:42.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:42 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:52:42.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:42 smithi062 ceph-mon[44211]: osdmap e606: 12 total, 12 up, 11 in 2024-04-01T19:52:42.821 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:52:42.853 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:42 smithi188 ceph-mon[43939]: 7.3 scrub ok 2024-04-01T19:52:42.853 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:42 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:52:42.854 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:42 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:52:42.854 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:42 smithi188 ceph-mon[43939]: osdmap e606: 12 total, 12 up, 11 in 2024-04-01T19:52:42.856 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:42.887 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:52:42.892 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:42.892 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:52:42.994 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:52:43.053 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:43.093 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:52:43.102 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:43.102 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:52:43.203 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:52:43.235 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:43.276 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:52:43.282 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:43.282 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:52:43.383 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:52:43.416 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:43.451 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:52:43.454 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:43.454 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:52:43.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:43 smithi062 ceph-mon[44211]: 7.1 scrub starts 2024-04-01T19:52:43.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:43 smithi062 ceph-mon[44211]: 7.1 scrub ok 2024-04-01T19:52:43.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:43 smithi062 ceph-mon[44211]: pgmap v1682: 17 pgs: 17 active+clean; 3.8 GiB data, 13 GiB used, 971 GiB / 983 GiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:52:43.555 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:52:43.603 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:43 smithi022 ceph-mon[39439]: 7.1 scrub starts 2024-04-01T19:52:43.603 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:43 smithi022 ceph-mon[39439]: 7.1 scrub ok 2024-04-01T19:52:43.603 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:43 smithi022 ceph-mon[39439]: pgmap v1682: 17 pgs: 17 active+clean; 3.8 GiB data, 13 GiB used, 971 GiB / 983 GiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:52:43.617 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:43.658 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:52:43.665 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:43.665 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:52:43.766 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:52:43.796 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:43.818 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:52:43.820 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:43.821 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:52:43.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:43 smithi188 ceph-mon[43939]: 7.1 scrub starts 2024-04-01T19:52:43.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:43 smithi188 ceph-mon[43939]: 7.1 scrub ok 2024-04-01T19:52:43.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:43 smithi188 ceph-mon[43939]: pgmap v1682: 17 pgs: 17 active+clean; 3.8 GiB data, 13 GiB used, 971 GiB / 983 GiB avail; 0 B/s wr, 1.22k op/s 2024-04-01T19:52:43.922 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:52:43.961 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:43.986 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:52:43.988 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:43.989 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:52:44.090 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:52:44.137 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:44.436 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:44 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/745437453' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:52:44.449 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:52:44.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:44 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/745437453' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:52:44.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:44 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/745437453' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:52:45.543 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:52:45.548 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:45.549 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:52:45.650 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:52:45.684 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:45.719 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:52:45.724 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:45 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:52:45.725 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:45 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:52:45.725 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:45 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:52:45.725 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:45 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/745437453' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:52:45.725 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:45 smithi188 ceph-mon[43939]: osdmap e607: 12 total, 12 up, 11 in 2024-04-01T19:52:45.725 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:45 smithi188 ceph-mon[43939]: pgmap v1684: 17 pgs: 17 active+clean; 3.7 GiB data, 13 GiB used, 971 GiB / 983 GiB avail; 0 B/s wr, 848 op/s 2024-04-01T19:52:45.725 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:45.726 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:52:45.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:45 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:52:45.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:45 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:52:45.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:45 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:52:45.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:45 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/745437453' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:52:45.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:45 smithi062 ceph-mon[44211]: osdmap e607: 12 total, 12 up, 11 in 2024-04-01T19:52:45.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:45 smithi062 ceph-mon[44211]: pgmap v1684: 17 pgs: 17 active+clean; 3.7 GiB data, 13 GiB used, 971 GiB / 983 GiB avail; 0 B/s wr, 848 op/s 2024-04-01T19:52:45.826 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:52:45.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:45 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:52:45.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:45 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:52:45.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:45 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:52:45.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:45 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/745437453' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:52:45.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:45 smithi022 ceph-mon[39439]: osdmap e607: 12 total, 12 up, 11 in 2024-04-01T19:52:45.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:45 smithi022 ceph-mon[39439]: pgmap v1684: 17 pgs: 17 active+clean; 3.7 GiB data, 13 GiB used, 971 GiB / 983 GiB avail; 0 B/s wr, 848 op/s 2024-04-01T19:52:45.862 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:45.894 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:52:45.898 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:45.899 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:52:46.000 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:52:46.060 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:46.281 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:52:46.287 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:46.288 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:52:46.389 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:52:46.408 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 7, 9, 10, 11, 8, 6] out_osds: [1] dead_osds: [] live_osds: [0, 2, 3, 4, 5, 7, 9, 10, 11, 8, 6, 1] 2024-04-01T19:52:46.408 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-01T19:52:46.408 INFO:tasks.thrashosds.thrasher:Reweighting osd 10 to 0.6134864927158503 2024-04-01T19:52:46.408 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 10 0.6134864927158503 2024-04-01T19:52:46.451 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:46.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:52:46.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:46 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:52:46.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:46 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:52:47.596 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:52:47.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:52:47.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:52:47.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:52:47.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:47 smithi022 ceph-mon[39439]: pgmap v1685: 17 pgs: 17 active+clean; 3.4 GiB data, 12 GiB used, 971 GiB / 983 GiB avail; 0 B/s wr, 1.41k op/s 2024-04-01T19:52:47.646 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:52:47.686 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:52:47.717 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:52:47.731 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:52:47.731 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:52:47.731 INFO:teuthology.orchestra.run.smithi022.stdout: "complaint_time": 30, 2024-04-01T19:52:47.731 INFO:teuthology.orchestra.run.smithi022.stdout: "num_blocked_ops": 0 2024-04-01T19:52:47.731 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:52:47.742 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:52:47.746 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:52:47.753 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:47.754 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:52:47.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:52:47.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:52:47.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:52:47.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:47 smithi062 ceph-mon[44211]: pgmap v1685: 17 pgs: 17 active+clean; 3.4 GiB data, 12 GiB used, 971 GiB / 983 GiB avail; 0 B/s wr, 1.41k op/s 2024-04-01T19:52:47.777 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:52:47.809 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:52:47.839 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:52:47.855 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:52:47.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:52:47.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:52:47.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:52:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:47 smithi188 ceph-mon[43939]: pgmap v1685: 17 pgs: 17 active+clean; 3.4 GiB data, 12 GiB used, 971 GiB / 983 GiB avail; 0 B/s wr, 1.41k op/s 2024-04-01T19:52:47.879 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:52:47.899 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:47.913 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:52:47.943 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:52:47.965 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:52:47.971 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:47.971 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:52:47.981 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:52:48.000 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:52:48.000 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:52:48.000 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:52:48.000 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:52:48.001 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:52:48.001 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:52:48.001 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:52:48.001 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:52:48.001 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:52:48.001 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:52:48.001 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:52:48.001 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:52:48.072 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:52:48.122 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:48.678 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_historic_ops 2024-04-01T19:52:48.714 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:48 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3321896623' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:52:48.714 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:48 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:48.715 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:48 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:48.715 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:48 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:48.715 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:48 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:48.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:48 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3321896623' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:52:48.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:48 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:48.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:48 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:48.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:48 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:48.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:48 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:48.792 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:52:48.814 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:48.814 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:52:48.815 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:52:48.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:48 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3321896623' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:52:48.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:48 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:48 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:48 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:48 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:48.915 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:52:48.945 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:48.973 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:52:48.975 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:48.975 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:52:49.077 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:52:49.111 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:49.139 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:52:49.150 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:49.151 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:52:49.223 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:52:49.252 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:52:49.281 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:49.298 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:52:49.302 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:52:49.308 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:49.308 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:52:49.315 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:52:49.408 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:52:49.441 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:49.463 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:52:49.466 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:49.467 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:52:49.568 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:52:49.604 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:49.604 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:49.604 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:49.604 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:49.604 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:49.604 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:49.605 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:49.605 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:49.605 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:49 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:52:49.605 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:49 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:52:49.605 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:49 smithi062 ceph-mon[44211]: pgmap v1686: 17 pgs: 17 active+clean; 3.4 GiB data, 12 GiB used, 971 GiB / 983 GiB avail; 0 B/s wr, 967 op/s 2024-04-01T19:52:49.605 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:49.631 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:52:49.635 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:49.636 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:52:49.737 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:52:49.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:49.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:49.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:49.761 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:49.761 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:49.761 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:49.761 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:49.761 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:49.761 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:49 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:52:49.761 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:49 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:52:49.761 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:49 smithi022 ceph-mon[39439]: pgmap v1686: 17 pgs: 17 active+clean; 3.4 GiB data, 12 GiB used, 971 GiB / 983 GiB avail; 0 B/s wr, 967 op/s 2024-04-01T19:52:49.784 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:49.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:49.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:49.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:49.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:49.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:49.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:49.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:49.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:52:49.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:49 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:52:49.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:49 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:52:49.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:49 smithi188 ceph-mon[43939]: pgmap v1686: 17 pgs: 17 active+clean; 3.4 GiB data, 12 GiB used, 971 GiB / 983 GiB avail; 0 B/s wr, 967 op/s 2024-04-01T19:52:50.466 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:50 smithi022 ceph-mon[39439]: osdmap e608: 12 total, 12 up, 11 in 2024-04-01T19:52:50.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:50 smithi062 ceph-mon[44211]: osdmap e608: 12 total, 12 up, 11 in 2024-04-01T19:52:50.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:50 smithi188 ceph-mon[43939]: osdmap e608: 12 total, 12 up, 11 in 2024-04-01T19:52:51.201 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:52:51.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:51 smithi062 ceph-mon[44211]: pgmap v1688: 17 pgs: 17 active+clean; 3.2 GiB data, 12 GiB used, 972 GiB / 983 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:52:51.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:51 smithi022 ceph-mon[39439]: pgmap v1688: 17 pgs: 17 active+clean; 3.2 GiB data, 12 GiB used, 972 GiB / 983 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:52:51.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:51 smithi188 ceph-mon[43939]: pgmap v1688: 17 pgs: 17 active+clean; 3.2 GiB data, 12 GiB used, 972 GiB / 983 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:52:52.301 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:52:52.307 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:52.307 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:52:52.408 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:52:52.473 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:52.503 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:52:52.512 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:52.512 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:52:52.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:52 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:52:52.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:52 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:52:52.613 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:52:52.674 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:52.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:52 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:52:52.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:52 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:52:52.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:52 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:52:52.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:52 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:52:52.949 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:52:52.957 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:52.957 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:52:53.059 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:52:53.093 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:53.114 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:52:53.120 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:53.120 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:52:53.221 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:52:53.250 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:53.279 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:52:53.286 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:53.286 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:52:53.387 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:52:53.421 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:53.446 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:52:53.450 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:53.451 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:52:53.520 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.10 to 0.613486 (9d0d) 2024-04-01T19:52:53.551 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:52:53.593 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:53.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:53 smithi062 ceph-mon[44211]: osdmap e609: 12 total, 12 up, 11 in 2024-04-01T19:52:53.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:53 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/921945924' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 0.6134864927158503}]: dispatch 2024-04-01T19:52:53.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:53 smithi062 ceph-mon[44211]: from='client.36875 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 0.6134864927158503}]: dispatch 2024-04-01T19:52:53.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:53 smithi062 ceph-mon[44211]: pgmap v1690: 17 pgs: 17 active+clean; 3.0 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 0 B/s wr, 1.39k op/s 2024-04-01T19:52:53.788 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:52:53.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:53 smithi022 ceph-mon[39439]: osdmap e609: 12 total, 12 up, 11 in 2024-04-01T19:52:53.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:53 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/921945924' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 0.6134864927158503}]: dispatch 2024-04-01T19:52:53.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:53 smithi022 ceph-mon[39439]: from='client.36875 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 0.6134864927158503}]: dispatch 2024-04-01T19:52:53.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:53 smithi022 ceph-mon[39439]: pgmap v1690: 17 pgs: 17 active+clean; 3.0 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 0 B/s wr, 1.39k op/s 2024-04-01T19:52:53.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:53 smithi188 ceph-mon[43939]: osdmap e609: 12 total, 12 up, 11 in 2024-04-01T19:52:53.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:53 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/921945924' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 0.6134864927158503}]: dispatch 2024-04-01T19:52:53.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:53 smithi188 ceph-mon[43939]: from='client.36875 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 0.6134864927158503}]: dispatch 2024-04-01T19:52:53.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:53 smithi188 ceph-mon[43939]: pgmap v1690: 17 pgs: 17 active+clean; 3.0 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 0 B/s wr, 1.39k op/s 2024-04-01T19:52:54.264 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:52:54.266 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:54.267 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:52:54.368 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:52:54.400 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:54.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:54 smithi062 ceph-mon[44211]: from='client.36875 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 10, "weight": 0.6134864927158503}]': finished 2024-04-01T19:52:54.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:54 smithi062 ceph-mon[44211]: osdmap e610: 12 total, 12 up, 11 in 2024-04-01T19:52:54.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:54 smithi022 ceph-mon[39439]: from='client.36875 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 10, "weight": 0.6134864927158503}]': finished 2024-04-01T19:52:54.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:54 smithi022 ceph-mon[39439]: osdmap e610: 12 total, 12 up, 11 in 2024-04-01T19:52:54.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:54 smithi188 ceph-mon[43939]: from='client.36875 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 10, "weight": 0.6134864927158503}]': finished 2024-04-01T19:52:54.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:54 smithi188 ceph-mon[43939]: osdmap e610: 12 total, 12 up, 11 in 2024-04-01T19:52:55.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:55 smithi022 ceph-mon[39439]: osdmap e611: 12 total, 12 up, 11 in 2024-04-01T19:52:55.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:55 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2206764086' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:52:55.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:55 smithi022 ceph-mon[39439]: pgmap v1693: 17 pgs: 17 active+clean; 3.0 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 0 B/s wr, 1.02k op/s 2024-04-01T19:52:55.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:55 smithi188 ceph-mon[43939]: osdmap e611: 12 total, 12 up, 11 in 2024-04-01T19:52:55.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:55 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2206764086' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:52:55.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:55 smithi188 ceph-mon[43939]: pgmap v1693: 17 pgs: 17 active+clean; 3.0 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 0 B/s wr, 1.02k op/s 2024-04-01T19:52:56.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:55 smithi062 ceph-mon[44211]: osdmap e611: 12 total, 12 up, 11 in 2024-04-01T19:52:56.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:55 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2206764086' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:52:56.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:55 smithi062 ceph-mon[44211]: pgmap v1693: 17 pgs: 17 active+clean; 3.0 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 0 B/s wr, 1.02k op/s 2024-04-01T19:52:56.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:56 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:52:56.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:56 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2206764086' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:52:56.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:56 smithi022 ceph-mon[39439]: osdmap e612: 12 total, 12 up, 11 in 2024-04-01T19:52:56.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:56 smithi022 ceph-mon[39439]: 7.1 starting backfill to osd.3 from (0'0,0'0] MAX to 609'18628 2024-04-01T19:52:56.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:56 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:52:56.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:56 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2206764086' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:52:56.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:56 smithi188 ceph-mon[43939]: osdmap e612: 12 total, 12 up, 11 in 2024-04-01T19:52:56.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:56 smithi188 ceph-mon[43939]: 7.1 starting backfill to osd.3 from (0'0,0'0] MAX to 609'18628 2024-04-01T19:52:57.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:56 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:52:57.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:56 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2206764086' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:52:57.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:56 smithi062 ceph-mon[44211]: osdmap e612: 12 total, 12 up, 11 in 2024-04-01T19:52:57.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:56 smithi062 ceph-mon[44211]: 7.1 starting backfill to osd.3 from (0'0,0'0] MAX to 609'18628 2024-04-01T19:52:57.049 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:52:57.756 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:52:57.765 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:57.766 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:52:57.766 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:52:57 smithi022 ceph-mon[39439]: pgmap v1695: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 2.8 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 0 B/s wr, 813 op/s; 2859/92054 objects misplaced (3.106%); 439 KiB/s, 6 objects/s recovering 2024-04-01T19:52:57.866 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:52:57.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:52:57 smithi188 ceph-mon[43939]: pgmap v1695: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 2.8 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 0 B/s wr, 813 op/s; 2859/92054 objects misplaced (3.106%); 439 KiB/s, 6 objects/s recovering 2024-04-01T19:52:57.895 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:57.916 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:52:57.921 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:57.921 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:52:58.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:52:57 smithi062 ceph-mon[44211]: pgmap v1695: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 2.8 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 0 B/s wr, 813 op/s; 2859/92054 objects misplaced (3.106%); 439 KiB/s, 6 objects/s recovering 2024-04-01T19:52:58.020 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:52:58.020 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:52:58.021 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:52:58.074 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:58.217 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:52:58.223 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:58.224 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:52:58.325 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:52:58.381 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:58.417 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:52:58.420 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:58.420 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:52:58.522 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:52:58.564 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:58.837 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_ops_in_flight 2024-04-01T19:52:58.879 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:52:58.896 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:58.897 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:52:58.998 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:52:59.055 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:59.191 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:52:59.243 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:52:59.247 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:59.248 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:52:59.349 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:52:59.409 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:52:59.886 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:52:59.889 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:52:59.890 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:52:59.913 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:52:59.991 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:53:00.021 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:00.064 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:53:00.067 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:00.068 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:53:00.169 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:53:00.210 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:00.238 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:53:00.241 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:00.242 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:53:00.343 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:53:00.401 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:00.437 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:53:00.445 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:00.445 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:53:00.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:00 smithi062 ceph-mon[44211]: pgmap v1696: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 2.8 GiB data, 11 GiB used, 973 GiB / 983 GiB avail; 0 B/s wr, 718 op/s; 2859/91266 objects misplaced (3.133%); 352 KiB/s, 5 objects/s recovering 2024-04-01T19:53:00.546 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:53:00.579 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:00.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:00 smithi022 ceph-mon[39439]: pgmap v1696: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 2.8 GiB data, 11 GiB used, 973 GiB / 983 GiB avail; 0 B/s wr, 718 op/s; 2859/91266 objects misplaced (3.133%); 352 KiB/s, 5 objects/s recovering 2024-04-01T19:53:00.620 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:53:00.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:00 smithi188 ceph-mon[43939]: pgmap v1696: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 2.8 GiB data, 11 GiB used, 973 GiB / 983 GiB avail; 0 B/s wr, 718 op/s; 2859/91266 objects misplaced (3.133%); 352 KiB/s, 5 objects/s recovering 2024-04-01T19:53:00.650 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:53:00.689 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:53:00.735 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:53:00.767 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:53:00.797 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:53:00.835 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:53:00.865 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:53:00.901 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:53:00.931 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:53:00.939 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:53:00.943 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:00.943 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:53:00.965 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:53:01.002 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:53:01.033 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:53:01.042 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:53:01.042 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:53:01.042 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:53:01.042 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:53:01.043 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:53:01.043 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:53:01.043 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:53:01.043 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:53:01.043 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:53:01.043 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:53:01.043 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:53:01.043 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:53:01.044 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:53:01.087 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:01.114 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:53:01.118 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:01.119 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:53:01.220 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:53:01.263 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:01.291 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:53:01.296 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:01.297 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:53:01.398 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:53:01.439 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:01.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:01 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3578994510' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:53:01.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:01.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:01.537 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:53:01.548 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:01.548 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:53:01.606 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:53:01.607 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:53:01.607 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.607 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:299728 7.1 7:811272f1:::benchmark_data_smithi188_147022_object130084:head [delete] snapc 0=[] ondisk+write+known_if_redirected e612)", 2024-04-01T19:53:01.607 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:53:01.602399+0000", 2024-04-01T19:53:01.607 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0065858269999999998, 2024-04-01T19:53:01.607 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0066210729999999999, 2024-04-01T19:53:01.607 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:53:01.607 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:53:01.607 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:53:01.607 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:53:01.607 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:53:01.607 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:53:01.608 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 299728 2024-04-01T19:53:01.608 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.608 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:53:01.608 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.608 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:53:01.608 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:01.602399+0000", 2024-04-01T19:53:01.608 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:53:01.608 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.608 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.608 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:53:01.608 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:01.602399+0000", 2024-04-01T19:53:01.608 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:53:01.608 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.609 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.609 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:53:01.609 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:01.602401+0000", 2024-04-01T19:53:01.609 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.058e-06 2024-04-01T19:53:01.609 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.609 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.609 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:53:01.609 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:01.602408+0000", 2024-04-01T19:53:01.609 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.4019999999999999e-06 2024-04-01T19:53:01.609 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.609 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.609 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:53:01.609 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:01.602419+0000", 2024-04-01T19:53:01.610 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1409e-05 2024-04-01T19:53:01.610 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.610 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.610 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:53:01.610 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:01.602427+0000", 2024-04-01T19:53:01.610 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.8639999999999996e-06 2024-04-01T19:53:01.610 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.610 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.610 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:53:01.610 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:01.602482+0000", 2024-04-01T19:53:01.610 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5445000000000002e-05 2024-04-01T19:53:01.610 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.610 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.611 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:53:01.611 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:01.602615+0000", 2024-04-01T19:53:01.611 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013249299999999999 2024-04-01T19:53:01.611 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.611 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.611 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3,10", 2024-04-01T19:53:01.611 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:01.602752+0000", 2024-04-01T19:53:01.611 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013693099999999999 2024-04-01T19:53:01.611 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.611 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.611 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:53:01.611 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:01.607756+0000", 2024-04-01T19:53:01.611 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0050047779999999997 2024-04-01T19:53:01.612 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:53:01.612 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:53:01.612 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:53:01.612 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.612 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.612 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.36668.0:299730 7.4 e612/560 7:21e98f85:::benchmark_data_smithi188_147022_object130086:head v 612'18519, mlcod=612'18516)", 2024-04-01T19:53:01.612 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:53:01.603695+0000", 2024-04-01T19:53:01.612 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0052897200000000004, 2024-04-01T19:53:01.612 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.005417224, 2024-04-01T19:53:01.612 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:53:01.612 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:53:01.612 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:01.612 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:53:01.612 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.613 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:53:01.613 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:01.603695+0000", 2024-04-01T19:53:01.613 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:53:01.613 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.613 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.613 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:53:01.613 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:01.603695+0000", 2024-04-01T19:53:01.613 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:53:01.613 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.613 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.613 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:53:01.613 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:01.603696+0000", 2024-04-01T19:53:01.613 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.4200000000000005e-07 2024-04-01T19:53:01.613 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.614 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.614 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:53:01.614 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:01.603703+0000", 2024-04-01T19:53:01.614 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.4919999999999998e-06 2024-04-01T19:53:01.614 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.614 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.614 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:53:01.614 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:01.603714+0000", 2024-04-01T19:53:01.614 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1601e-05 2024-04-01T19:53:01.614 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.614 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.614 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:53:01.614 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:01.603721+0000", 2024-04-01T19:53:01.615 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.4479999999999999e-06 2024-04-01T19:53:01.615 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.615 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.615 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:53:01.615 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:01.603788+0000", 2024-04-01T19:53:01.615 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.7291000000000003e-05 2024-04-01T19:53:01.615 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.615 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.615 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:53:01.615 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:01.603809+0000", 2024-04-01T19:53:01.615 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1243999999999999e-05 2024-04-01T19:53:01.615 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.615 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.615 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:53:01.616 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:01.609078+0000", 2024-04-01T19:53:01.616 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0052687489999999997 2024-04-01T19:53:01.616 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:53:01.616 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:53:01.616 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:53:01.616 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.616 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.616 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:299735 7.1 7.e3d876a1 (undecoded) ondisk+write+known_if_redirected e612)", 2024-04-01T19:53:01.616 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:53:01.608967+0000", 2024-04-01T19:53:01.616 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 1.7813999999999999e-05, 2024-04-01T19:53:01.616 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000216147, 2024-04-01T19:53:01.616 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:53:01.616 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:53:01.616 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "queued for pg", 2024-04-01T19:53:01.617 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:53:01.617 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:53:01.617 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:53:01.617 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 299735 2024-04-01T19:53:01.617 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.617 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:53:01.617 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.617 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:53:01.617 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:01.608967+0000", 2024-04-01T19:53:01.617 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:53:01.617 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.617 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.617 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:53:01.617 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:01.608967+0000", 2024-04-01T19:53:01.618 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:53:01.618 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.618 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.618 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:53:01.618 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:01.608969+0000", 2024-04-01T19:53:01.618 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8920000000000001e-06 2024-04-01T19:53:01.618 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.618 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.618 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:53:01.618 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:01.608975+0000", 2024-04-01T19:53:01.618 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.173e-06 2024-04-01T19:53:01.618 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.618 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.618 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:53:01.619 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:01.608991+0000", 2024-04-01T19:53:01.619 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.5698000000000001e-05 2024-04-01T19:53:01.619 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:01.619 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:01.619 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:53:01.619 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:01.609000+0000", 2024-04-01T19:53:01.619 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.7669999999999992e-06 2024-04-01T19:53:01.619 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:53:01.619 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:53:01.619 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:53:01.619 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:53:01.619 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-04-01T19:53:01.619 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 3 2024-04-01T19:53:01.619 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:53:01.649 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:53:01.705 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:01 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3578994510' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:53:01.706 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:01.706 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:01.707 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:01.741 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:53:01.753 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:01.753 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:53:01.854 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:53:01.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:01 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3578994510' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:53:01.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:01.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:01.908 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:02.381 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:53:02.389 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:02.390 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:53:02.431 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_blocked_ops 2024-04-01T19:53:02.491 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:53:02.527 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:02.556 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:53:02.562 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:02.562 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:53:02.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:02 smithi022 ceph-mon[39439]: pgmap v1697: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 2.6 GiB data, 11 GiB used, 973 GiB / 983 GiB avail; 0 B/s wr, 867 op/s; 1815/86368 objects misplaced (2.101%); 6.1 MiB/s, 97 objects/s recovering 2024-04-01T19:53:02.663 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:53:02.705 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:02.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:02 smithi062 ceph-mon[44211]: pgmap v1697: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 2.6 GiB data, 11 GiB used, 973 GiB / 983 GiB avail; 0 B/s wr, 867 op/s; 1815/86368 objects misplaced (2.101%); 6.1 MiB/s, 97 objects/s recovering 2024-04-01T19:53:02.764 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:53:02.767 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:02.769 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:53:02.828 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:53:02.870 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:53:02.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:02.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:02 smithi188 ceph-mon[43939]: pgmap v1697: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 2.6 GiB data, 11 GiB used, 973 GiB / 983 GiB avail; 0 B/s wr, 867 op/s; 1815/86368 objects misplaced (2.101%); 6.1 MiB/s, 97 objects/s recovering 2024-04-01T19:53:02.904 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:02.927 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:53:02.930 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:02.930 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:53:03.031 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:53:03.073 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:03.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:03 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:53:03.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:03 smithi022 ceph-mon[39439]: osdmap e613: 12 total, 12 up, 11 in 2024-04-01T19:53:03.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:03 smithi022 ceph-mon[39439]: pgmap v1699: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 2.5 GiB data, 10 GiB used, 973 GiB / 983 GiB avail; 0 B/s wr, 1.08k op/s; 1815/81088 objects misplaced (2.238%); 5.9 MiB/s, 94 objects/s recovering 2024-04-01T19:53:03.629 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:53:03.636 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:03.637 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:53:03.736 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:03 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:53:03.736 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:03 smithi062 ceph-mon[44211]: osdmap e613: 12 total, 12 up, 11 in 2024-04-01T19:53:03.736 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:03 smithi062 ceph-mon[44211]: pgmap v1699: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 2.5 GiB data, 10 GiB used, 973 GiB / 983 GiB avail; 0 B/s wr, 1.08k op/s; 1815/81088 objects misplaced (2.238%); 5.9 MiB/s, 94 objects/s recovering 2024-04-01T19:53:03.738 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:53:03.780 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:03 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:53:03.780 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:03 smithi188 ceph-mon[43939]: osdmap e613: 12 total, 12 up, 11 in 2024-04-01T19:53:03.780 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:03 smithi188 ceph-mon[43939]: pgmap v1699: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 2.5 GiB data, 10 GiB used, 973 GiB / 983 GiB avail; 0 B/s wr, 1.08k op/s; 1815/81088 objects misplaced (2.238%); 5.9 MiB/s, 94 objects/s recovering 2024-04-01T19:53:03.782 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:03.813 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:53:03.818 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:03.819 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:53:03.920 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:53:03.949 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:03.975 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:53:03.978 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:03.978 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:53:04.079 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:53:04.114 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:04.278 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 7, 9, 10, 11, 8, 6] out_osds: [1] dead_osds: [] live_osds: [0, 2, 3, 4, 5, 7, 9, 10, 11, 8, 6, 1] 2024-04-01T19:53:04.278 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 0 1 2024-04-01T19:53:04.423 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:04 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/582332222' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:53:04.423 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:04 smithi062 ceph-mon[44211]: from='client.26851 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:53:04.424 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:53:04.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:04 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/582332222' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:53:04.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:04 smithi022 ceph-mon[39439]: from='client.26851 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:53:04.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:04 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/582332222' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:53:04.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:04 smithi188 ceph-mon[43939]: from='client.26851 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:53:04.934 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:53:05.370 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:53:05.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:05 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:53:05.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:05 smithi022 ceph-mon[39439]: from='client.26851 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:53:05.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:05 smithi022 ceph-mon[39439]: osdmap e614: 12 total, 12 up, 11 in 2024-04-01T19:53:05.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:05 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:53:05.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:05 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:53:05.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:05 smithi022 ceph-mon[39439]: pgmap v1701: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 2.4 GiB data, 10 GiB used, 973 GiB / 983 GiB avail; 0 B/s wr, 768 op/s; 1815/79742 objects misplaced (2.276%); 5.7 MiB/s, 90 objects/s recovering 2024-04-01T19:53:05.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:05 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:53:05.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:05 smithi062 ceph-mon[44211]: from='client.26851 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:53:05.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:05 smithi062 ceph-mon[44211]: osdmap e614: 12 total, 12 up, 11 in 2024-04-01T19:53:05.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:05 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:53:05.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:05 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:53:05.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:05 smithi062 ceph-mon[44211]: pgmap v1701: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 2.4 GiB data, 10 GiB used, 973 GiB / 983 GiB avail; 0 B/s wr, 768 op/s; 1815/79742 objects misplaced (2.276%); 5.7 MiB/s, 90 objects/s recovering 2024-04-01T19:53:05.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:05 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:53:05.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:05 smithi188 ceph-mon[43939]: from='client.26851 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:53:05.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:05 smithi188 ceph-mon[43939]: osdmap e614: 12 total, 12 up, 11 in 2024-04-01T19:53:05.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:05 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:53:05.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:05 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:53:05.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:05 smithi188 ceph-mon[43939]: pgmap v1701: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 2.4 GiB data, 10 GiB used, 973 GiB / 983 GiB avail; 0 B/s wr, 768 op/s; 1815/79742 objects misplaced (2.276%); 5.7 MiB/s, 90 objects/s recovering 2024-04-01T19:53:06.266 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:53:06.571 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:53:06.577 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:06.578 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:53:06.679 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:53:06.691 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:06 smithi062 ceph-mon[44211]: osdmap e615: 12 total, 12 up, 11 in 2024-04-01T19:53:06.692 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:06 smithi022 ceph-mon[39439]: osdmap e615: 12 total, 12 up, 11 in 2024-04-01T19:53:06.714 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:06 smithi188 ceph-mon[43939]: osdmap e615: 12 total, 12 up, 11 in 2024-04-01T19:53:06.717 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:06.746 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:53:06.749 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:06.750 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:53:06.851 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:53:06.918 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:07.351 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:53:07.751 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:53:07.751 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:53:07.751 INFO:teuthology.orchestra.run.smithi062.stdout: "complaint_time": 30, 2024-04-01T19:53:07.751 INFO:teuthology.orchestra.run.smithi062.stdout: "num_blocked_ops": 0 2024-04-01T19:53:07.752 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:53:07.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:07 smithi062 ceph-mon[44211]: pgmap v1703: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 2.1 GiB data, 9.7 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 1.41k op/s; 925/69364 objects misplaced (1.334%); 7.4 MiB/s, 119 objects/s recovering 2024-04-01T19:53:07.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:07 smithi022 ceph-mon[39439]: pgmap v1703: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 2.1 GiB data, 9.7 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 1.41k op/s; 925/69364 objects misplaced (1.334%); 7.4 MiB/s, 119 objects/s recovering 2024-04-01T19:53:07.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:07 smithi188 ceph-mon[43939]: pgmap v1703: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 2.1 GiB data, 9.7 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 1.41k op/s; 925/69364 objects misplaced (1.334%); 7.4 MiB/s, 119 objects/s recovering 2024-04-01T19:53:09.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:08 smithi062 ceph-mon[44211]: 7.6 scrub starts 2024-04-01T19:53:09.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:08 smithi062 ceph-mon[44211]: 7.6 scrub ok 2024-04-01T19:53:09.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:08 smithi022 ceph-mon[39439]: 7.6 scrub starts 2024-04-01T19:53:09.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:08 smithi022 ceph-mon[39439]: 7.6 scrub ok 2024-04-01T19:53:09.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:08 smithi188 ceph-mon[43939]: 7.6 scrub starts 2024-04-01T19:53:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:08 smithi188 ceph-mon[43939]: 7.6 scrub ok 2024-04-01T19:53:09.303 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_historic_ops 2024-04-01T19:53:09.701 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:53:10.006 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:09 smithi062 ceph-mon[44211]: 7.8 scrub starts 2024-04-01T19:53:10.007 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:09 smithi062 ceph-mon[44211]: 7.9 scrub starts 2024-04-01T19:53:10.007 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:09 smithi062 ceph-mon[44211]: pgmap v1704: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 2.1 GiB data, 9.6 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 944 op/s; 925/68042 objects misplaced (1.359%); 6.5 MiB/s, 103 objects/s recovering 2024-04-01T19:53:10.007 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:09 smithi062 ceph-mon[44211]: 7.8 scrub ok 2024-04-01T19:53:10.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:09 smithi022 ceph-mon[39439]: 7.8 scrub starts 2024-04-01T19:53:10.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:09 smithi022 ceph-mon[39439]: 7.9 scrub starts 2024-04-01T19:53:10.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:09 smithi022 ceph-mon[39439]: pgmap v1704: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 2.1 GiB data, 9.6 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 944 op/s; 925/68042 objects misplaced (1.359%); 6.5 MiB/s, 103 objects/s recovering 2024-04-01T19:53:10.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:09 smithi022 ceph-mon[39439]: 7.8 scrub ok 2024-04-01T19:53:10.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:09 smithi188 ceph-mon[43939]: 7.8 scrub starts 2024-04-01T19:53:10.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:09 smithi188 ceph-mon[43939]: 7.9 scrub starts 2024-04-01T19:53:10.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:09 smithi188 ceph-mon[43939]: pgmap v1704: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 2.1 GiB data, 9.6 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 944 op/s; 925/68042 objects misplaced (1.359%); 6.5 MiB/s, 103 objects/s recovering 2024-04-01T19:53:10.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:09 smithi188 ceph-mon[43939]: 7.8 scrub ok 2024-04-01T19:53:10.995 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:53:10.998 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:10.999 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:53:10.999 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:10 smithi022 ceph-mon[39439]: 7.7 scrub starts 2024-04-01T19:53:10.999 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:10 smithi022 ceph-mon[39439]: 7.9 scrub ok 2024-04-01T19:53:10.999 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:10 smithi022 ceph-mon[39439]: 7.f scrub starts 2024-04-01T19:53:10.999 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:10 smithi022 ceph-mon[39439]: 7.f scrub ok 2024-04-01T19:53:11.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:10 smithi062 ceph-mon[44211]: 7.7 scrub starts 2024-04-01T19:53:11.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:10 smithi062 ceph-mon[44211]: 7.9 scrub ok 2024-04-01T19:53:11.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:10 smithi062 ceph-mon[44211]: 7.f scrub starts 2024-04-01T19:53:11.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:10 smithi062 ceph-mon[44211]: 7.f scrub ok 2024-04-01T19:53:11.100 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:53:11.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:10 smithi188 ceph-mon[43939]: 7.7 scrub starts 2024-04-01T19:53:11.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:10 smithi188 ceph-mon[43939]: 7.9 scrub ok 2024-04-01T19:53:11.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:10 smithi188 ceph-mon[43939]: 7.f scrub starts 2024-04-01T19:53:11.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:10 smithi188 ceph-mon[43939]: 7.f scrub ok 2024-04-01T19:53:11.140 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:11.166 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:53:11.168 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:11.168 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:53:11.269 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:53:11.309 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:11.785 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:53:12.005 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:11 smithi022 ceph-mon[39439]: 7.7 scrub ok 2024-04-01T19:53:12.005 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:11 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:53:12.005 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:11 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:53:12.005 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:11 smithi022 ceph-mon[39439]: pgmap v1705: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 1.9 GiB data, 9.3 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 1.11k op/s; 60/63292 objects misplaced (0.095%); 12 MiB/s, 187 objects/s recovering 2024-04-01T19:53:12.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:11 smithi062 ceph-mon[44211]: 7.7 scrub ok 2024-04-01T19:53:12.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:11 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:53:12.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:11 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:53:12.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:11 smithi062 ceph-mon[44211]: pgmap v1705: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 1.9 GiB data, 9.3 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 1.11k op/s; 60/63292 objects misplaced (0.095%); 12 MiB/s, 187 objects/s recovering 2024-04-01T19:53:12.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:11 smithi188 ceph-mon[43939]: 7.7 scrub ok 2024-04-01T19:53:12.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:11 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:53:12.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:11 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:53:12.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:11 smithi188 ceph-mon[43939]: pgmap v1705: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 1.9 GiB data, 9.3 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 1.11k op/s; 60/63292 objects misplaced (0.095%); 12 MiB/s, 187 objects/s recovering 2024-04-01T19:53:12.165 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:53:12.171 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:12.172 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:53:12.272 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:53:12.306 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:12.328 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:53:12.331 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:12.331 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:53:12.432 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:53:12.459 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:12.478 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:53:12.480 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:12.481 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:53:12.540 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:53:12.559 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:53:12.578 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:53:12.582 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:53:12.598 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:53:12.611 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:12.618 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:53:12.630 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:53:12.634 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:12.634 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:53:12.638 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:53:12.658 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:53:12.678 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:53:12.698 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:53:12.719 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:53:12.735 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:53:12.739 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:53:12.760 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:53:12.764 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:53:12.764 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:53:12.764 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:53:12.764 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:53:12.764 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:53:12.764 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:53:12.764 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:53:12.765 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:53:12.765 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:53:12.765 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:53:12.765 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:53:12.765 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:53:12.767 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:12.783 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:53:12.783 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:53:12.789 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:53:12.792 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:12.792 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:53:12.893 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:53:12.933 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:12.963 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:53:12.966 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:12.966 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:53:13.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:12 smithi062 ceph-mon[44211]: osdmap e616: 12 total, 12 up, 11 in 2024-04-01T19:53:13.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:12 smithi062 ceph-mon[44211]: 7.2 scrub starts 2024-04-01T19:53:13.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:12 smithi062 ceph-mon[44211]: 7.2 scrub ok 2024-04-01T19:53:13.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:12 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1357509979' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:53:13.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:13.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:13.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:13.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:13.052 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:12 smithi022 ceph-mon[39439]: osdmap e616: 12 total, 12 up, 11 in 2024-04-01T19:53:13.052 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:12 smithi022 ceph-mon[39439]: 7.2 scrub starts 2024-04-01T19:53:13.052 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:12 smithi022 ceph-mon[39439]: 7.2 scrub ok 2024-04-01T19:53:13.052 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:12 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1357509979' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:53:13.052 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:13.052 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:13.052 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:13.052 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:13.067 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:53:13.097 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:13.098 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:12 smithi188 ceph-mon[43939]: osdmap e616: 12 total, 12 up, 11 in 2024-04-01T19:53:13.098 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:12 smithi188 ceph-mon[43939]: 7.2 scrub starts 2024-04-01T19:53:13.098 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:12 smithi188 ceph-mon[43939]: 7.2 scrub ok 2024-04-01T19:53:13.098 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:12 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1357509979' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:53:13.098 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:13.098 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:13.098 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:13.098 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:13.121 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:53:13.126 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:13.127 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:53:13.228 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:53:13.261 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:13.519 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:53:13.523 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_ops_in_flight 2024-04-01T19:53:13.524 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:13.525 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:53:13.626 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:53:13.698 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:13.757 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:53:13.765 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:13.766 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:53:13.867 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:53:13.910 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:53:13.919 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:14.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:14.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:14.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:14.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:14.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:14.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:14.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:14.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:14.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:13 smithi022 ceph-mon[39439]: osdmap e617: 12 total, 12 up, 11 in 2024-04-01T19:53:14.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:13 smithi022 ceph-mon[39439]: pgmap v1708: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 1.8 GiB data, 9.0 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 1.35k op/s; 60/58378 objects misplaced (0.103%); 12 MiB/s, 190 objects/s recovering 2024-04-01T19:53:14.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:14.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:14.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:14.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:14.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:14.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:14.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:14.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:14.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:13 smithi188 ceph-mon[43939]: osdmap e617: 12 total, 12 up, 11 in 2024-04-01T19:53:14.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:13 smithi188 ceph-mon[43939]: pgmap v1708: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 1.8 GiB data, 9.0 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 1.35k op/s; 60/58378 objects misplaced (0.103%); 12 MiB/s, 190 objects/s recovering 2024-04-01T19:53:14.198 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:14.198 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:14.198 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:14.198 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:14.198 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:14.198 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:14.198 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:14.198 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:14.198 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:13 smithi062 ceph-mon[44211]: osdmap e617: 12 total, 12 up, 11 in 2024-04-01T19:53:14.198 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:13 smithi062 ceph-mon[44211]: pgmap v1708: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 1.8 GiB data, 9.0 GiB used, 974 GiB / 983 GiB avail; 0 B/s wr, 1.35k op/s; 60/58378 objects misplaced (0.103%); 12 MiB/s, 190 objects/s recovering 2024-04-01T19:53:14.306 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:53:14.318 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:14.318 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:53:14.419 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:53:14.448 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:14.470 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:53:14.473 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:14.473 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:53:14.574 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:53:14.609 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:14.813 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.0 to 1 (10000) 2024-04-01T19:53:15.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:14 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/914366624' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T19:53:15.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:14 smithi062 ceph-mon[44211]: from='client.36899 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T19:53:15.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:14 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:53:15.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:14 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:53:15.067 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:53:15.074 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:15.074 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:53:15.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:14 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/914366624' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T19:53:15.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:14 smithi022 ceph-mon[39439]: from='client.36899 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T19:53:15.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:14 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:53:15.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:14 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:53:15.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:14 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/914366624' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T19:53:15.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:14 smithi188 ceph-mon[43939]: from='client.36899 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T19:53:15.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:14 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:53:15.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:14 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:53:15.175 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:53:15.206 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:15.230 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:53:15.235 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:15.236 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:53:15.337 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:53:15.389 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:15.850 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:53:15.857 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:15.858 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:53:15.959 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:53:15.989 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:16.018 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:53:16.023 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:16.023 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:53:16.111 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:15 smithi062 ceph-mon[44211]: from='client.36899 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-04-01T19:53:16.111 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:15 smithi062 ceph-mon[44211]: osdmap e618: 12 total, 12 up, 11 in 2024-04-01T19:53:16.111 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:15 smithi062 ceph-mon[44211]: pgmap v1710: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 1.7 GiB data, 8.9 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 902 op/s; 60/57208 objects misplaced (0.105%); 8.1 MiB/s, 130 objects/s recovering 2024-04-01T19:53:16.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:15 smithi022 ceph-mon[39439]: from='client.36899 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-04-01T19:53:16.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:15 smithi022 ceph-mon[39439]: osdmap e618: 12 total, 12 up, 11 in 2024-04-01T19:53:16.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:15 smithi022 ceph-mon[39439]: pgmap v1710: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 1.7 GiB data, 8.9 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 902 op/s; 60/57208 objects misplaced (0.105%); 8.1 MiB/s, 130 objects/s recovering 2024-04-01T19:53:16.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:15 smithi188 ceph-mon[43939]: from='client.36899 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-04-01T19:53:16.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:15 smithi188 ceph-mon[43939]: osdmap e618: 12 total, 12 up, 11 in 2024-04-01T19:53:16.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:15 smithi188 ceph-mon[43939]: pgmap v1710: 17 pgs: 1 active+remapped+backfilling, 16 active+clean; 1.7 GiB data, 8.9 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 902 op/s; 60/57208 objects misplaced (0.105%); 8.1 MiB/s, 130 objects/s recovering 2024-04-01T19:53:16.124 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:53:16.151 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:16.213 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 2 1 2024-04-01T19:53:16.326 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:53:16.330 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:16.331 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:53:16.432 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:53:16.471 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:53:16.471 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:53:16.521 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:16.614 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:53:16.619 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:16.619 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:53:16.720 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:53:16.748 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:16.772 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:53:16.778 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:16.779 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:53:16.826 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:53:16.879 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:53:16.918 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:17.175 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:53:17.180 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:17.181 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:53:17.192 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_blocked_ops 2024-04-01T19:53:17.281 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:53:17.315 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:17.341 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:53:17.344 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:17.345 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:53:17.446 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:53:17.480 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:17.505 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:53:17.511 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:17.511 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:53:17.604 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:53:17.612 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:53:17.648 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:17.670 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:53:17.866 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:53:17.902 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:53:17.906 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:17 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:53:17.906 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:17 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:53:17.906 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:17 smithi062 ceph-mon[44211]: osdmap e619: 12 total, 12 up, 11 in 2024-04-01T19:53:17.906 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:17 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3394312444' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:53:17.906 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:17 smithi062 ceph-mon[44211]: from='client.36905 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:53:17.906 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:17 smithi062 ceph-mon[44211]: pgmap v1712: 17 pgs: 17 active+clean; 1.5 GiB data, 8.5 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 890 op/s; 680 KiB/s, 10 objects/s recovering 2024-04-01T19:53:17.907 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:17.907 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:53:17.987 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:17 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:53:17.987 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:17 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:53:17.987 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:17 smithi022 ceph-mon[39439]: osdmap e619: 12 total, 12 up, 11 in 2024-04-01T19:53:17.987 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:17 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3394312444' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:53:17.987 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:17 smithi022 ceph-mon[39439]: from='client.36905 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:53:17.988 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:17 smithi022 ceph-mon[39439]: pgmap v1712: 17 pgs: 17 active+clean; 1.5 GiB data, 8.5 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 890 op/s; 680 KiB/s, 10 objects/s recovering 2024-04-01T19:53:18.008 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:53:18.035 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:18.061 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:53:18.065 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:17 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:53:18.066 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:17 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:53:18.066 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:17 smithi188 ceph-mon[43939]: osdmap e619: 12 total, 12 up, 11 in 2024-04-01T19:53:18.066 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:17 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3394312444' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:53:18.066 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:17 smithi188 ceph-mon[43939]: from='client.36905 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:53:18.066 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:17 smithi188 ceph-mon[43939]: pgmap v1712: 17 pgs: 17 active+clean; 1.5 GiB data, 8.5 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 890 op/s; 680 KiB/s, 10 objects/s recovering 2024-04-01T19:53:18.067 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:18.067 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:53:18.168 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:53:18.202 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:18.231 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:53:18.236 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:18.236 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:53:18.337 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:53:18.391 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:19.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:18 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:53:19.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:18 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:53:19.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:18 smithi022 ceph-mon[39439]: from='client.36905 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:53:19.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:18 smithi022 ceph-mon[39439]: osdmap e620: 12 total, 12 up, 11 in 2024-04-01T19:53:19.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:18 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:53:19.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:18 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:53:19.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:18 smithi188 ceph-mon[43939]: from='client.36905 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:53:19.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:18 smithi188 ceph-mon[43939]: osdmap e620: 12 total, 12 up, 11 in 2024-04-01T19:53:19.150 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:53:19.153 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:18 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:53:19.153 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:18 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:53:19.154 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:18 smithi062 ceph-mon[44211]: from='client.36905 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:53:19.154 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:18 smithi062 ceph-mon[44211]: osdmap e620: 12 total, 12 up, 11 in 2024-04-01T19:53:19.154 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:19.155 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:53:19.256 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:53:19.304 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:20.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:19 smithi062 ceph-mon[44211]: pgmap v1714: 17 pgs: 17 active+clean; 1.4 GiB data, 8.2 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 943 op/s; 629 KiB/s, 9 objects/s recovering 2024-04-01T19:53:20.106 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:19 smithi022 ceph-mon[39439]: pgmap v1714: 17 pgs: 17 active+clean; 1.4 GiB data, 8.2 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 943 op/s; 629 KiB/s, 9 objects/s recovering 2024-04-01T19:53:20.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:19 smithi188 ceph-mon[43939]: pgmap v1714: 17 pgs: 17 active+clean; 1.4 GiB data, 8.2 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 943 op/s; 629 KiB/s, 9 objects/s recovering 2024-04-01T19:53:20.340 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:53:20.341 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:53:20.673 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:53:20.677 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:20.678 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:53:20.780 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:53:20.795 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:53:20.816 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:21.639 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_historic_ops 2024-04-01T19:53:21.672 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:53:21.675 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:21.676 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:53:21.777 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:53:21.837 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:22.025 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:53:22.385 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.2 to 1 (10000) 2024-04-01T19:53:22.576 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:53:22.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:22 smithi022 ceph-mon[39439]: pgmap v1715: 17 pgs: 17 active+clean; 1.3 GiB data, 8.0 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 1.19k op/s; 578 KiB/s, 9 objects/s recovering 2024-04-01T19:53:22.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:22 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:53:22.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:22 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:53:22.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:22 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/934444248' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:53:22.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:22 smithi022 ceph-mon[39439]: from='client.26875 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:53:22.620 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:22 smithi062 ceph-mon[44211]: pgmap v1715: 17 pgs: 17 active+clean; 1.3 GiB data, 8.0 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 1.19k op/s; 578 KiB/s, 9 objects/s recovering 2024-04-01T19:53:22.620 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:22 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:53:22.620 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:22 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:53:22.620 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:22 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/934444248' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:53:22.620 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:22 smithi062 ceph-mon[44211]: from='client.26875 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:53:22.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:22 smithi188 ceph-mon[43939]: pgmap v1715: 17 pgs: 17 active+clean; 1.3 GiB data, 8.0 GiB used, 975 GiB / 983 GiB avail; 0 B/s wr, 1.19k op/s; 578 KiB/s, 9 objects/s recovering 2024-04-01T19:53:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:22 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:53:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:22 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:53:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:22 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/934444248' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:53:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:22 smithi188 ceph-mon[43939]: from='client.26875 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T19:53:22.936 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:53:22.946 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:22.947 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:53:23.048 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:53:23.083 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:23.439 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:53:23.444 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:23.444 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:53:23.545 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:53:23.575 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:23.598 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:53:23.601 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:23.601 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:53:23.617 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 3 1 2024-04-01T19:53:23.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:23 smithi022 ceph-mon[39439]: from='client.26875 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-04-01T19:53:23.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:23 smithi022 ceph-mon[39439]: osdmap e621: 12 total, 12 up, 11 in 2024-04-01T19:53:23.702 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:53:23.754 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:23 smithi062 ceph-mon[44211]: from='client.26875 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-04-01T19:53:23.754 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:23 smithi062 ceph-mon[44211]: osdmap e621: 12 total, 12 up, 11 in 2024-04-01T19:53:23.755 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:23.796 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:53:23.799 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:23.800 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:53:23.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:23 smithi188 ceph-mon[43939]: from='client.26875 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-04-01T19:53:23.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:23 smithi188 ceph-mon[43939]: osdmap e621: 12 total, 12 up, 11 in 2024-04-01T19:53:23.901 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:53:23.938 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:24.018 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:53:24.024 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:24.024 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:53:24.090 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:53:24.090 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:53:24.125 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:53:24.137 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:53:24.161 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:24.174 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:53:24.176 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:53:24.222 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:53:24.242 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:53:24.274 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:53:24.319 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:53:24.353 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:53:24.382 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:53:24.419 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:53:24.454 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:53:24.481 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:53:24.517 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:53:24.566 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:53:24.581 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:53:24.581 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:53:24.581 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:53:24.581 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:53:24.581 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:53:24.581 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:53:24.582 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:53:24.582 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:53:24.582 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:53:24.582 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:53:24.582 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:53:24.582 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:53:24.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:24 smithi062 ceph-mon[44211]: pgmap v1717: 17 pgs: 17 active+clean; 1.1 GiB data, 7.6 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 920 op/s 2024-04-01T19:53:24.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:24 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/890299626' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:53:24.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:24 smithi022 ceph-mon[39439]: pgmap v1717: 17 pgs: 17 active+clean; 1.1 GiB data, 7.6 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 920 op/s 2024-04-01T19:53:24.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:24 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/890299626' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:53:24.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:24 smithi188 ceph-mon[43939]: pgmap v1717: 17 pgs: 17 active+clean; 1.1 GiB data, 7.6 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 920 op/s 2024-04-01T19:53:24.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:24 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/890299626' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:53:25.016 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:53:25.022 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:25.023 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:53:25.124 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:53:25.158 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:25.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:25 smithi022 ceph-mon[39439]: pgmap v1718: 17 pgs: 17 active+clean; 1.1 GiB data, 7.5 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 845 op/s 2024-04-01T19:53:25.516 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:53:25.528 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:25.528 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:53:25.553 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_ops_in_flight 2024-04-01T19:53:25.629 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:53:25.705 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:25.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:25 smithi062 ceph-mon[44211]: pgmap v1718: 17 pgs: 17 active+clean; 1.1 GiB data, 7.5 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 845 op/s 2024-04-01T19:53:25.780 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:53:25.783 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:25.783 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:53:25.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:25.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:25 smithi188 ceph-mon[43939]: pgmap v1718: 17 pgs: 17 active+clean; 1.1 GiB data, 7.5 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 845 op/s 2024-04-01T19:53:25.884 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:53:25.931 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:25.963 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:53:25.964 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:53:25.972 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:25.972 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:53:26.074 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:53:26.106 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:26.312 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:53:26.321 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:26.321 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:53:26.423 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:53:26.458 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:26.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:26 smithi062 ceph-mon[44211]: 7.4 scrub starts 2024-04-01T19:53:26.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:26 smithi062 ceph-mon[44211]: 7.4 scrub ok 2024-04-01T19:53:26.815 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:53:26.820 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:26.821 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:53:26.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:26 smithi022 ceph-mon[39439]: 7.4 scrub starts 2024-04-01T19:53:26.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:26 smithi022 ceph-mon[39439]: 7.4 scrub ok 2024-04-01T19:53:26.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:26 smithi188 ceph-mon[43939]: 7.4 scrub starts 2024-04-01T19:53:26.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:26 smithi188 ceph-mon[43939]: 7.4 scrub ok 2024-04-01T19:53:26.922 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:53:26.953 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:26.976 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:53:26.979 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:26.979 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:53:27.080 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:53:27.126 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:27.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:27 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.0", "weight": [0.09109505848562978]}]: dispatch 2024-04-01T19:53:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:27 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.1", "weight": [0.0872955322265625]}]: dispatch 2024-04-01T19:53:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:27 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.2", "weight": [0.0926509936326802]}]: dispatch 2024-04-01T19:53:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:27 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.3", "weight": [0.0926509936326802]}]: dispatch 2024-04-01T19:53:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:27 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.4", "weight": [0.10064690010264554]}]: dispatch 2024-04-01T19:53:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:27 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.5", "weight": [0.10064690010264554]}]: dispatch 2024-04-01T19:53:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:27 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.6", "weight": [0.09527612126945549]}]: dispatch 2024-04-01T19:53:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:27 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.7", "weight": [0.09527612126945549]}]: dispatch 2024-04-01T19:53:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:27 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.8", "weight": [0.10064690010264554]}]: dispatch 2024-04-01T19:53:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:27 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.9", "weight": [0.09527612126945549]}]: dispatch 2024-04-01T19:53:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:27 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.10", "weight": [0.0907292832187765]}]: dispatch 2024-04-01T19:53:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:27 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.11", "weight": [0.0926509936326802]}]: dispatch 2024-04-01T19:53:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:27 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd reweightn", "format": "json", "weights": "{\"10\": \"40532\"}"}]: dispatch 2024-04-01T19:53:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:27 smithi062 ceph-mon[44211]: pgmap v1719: 17 pgs: 17 active+clean; 773 MiB data, 7.0 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:53:27.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:27 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.0", "weight": [0.09109505848562978]}]: dispatch 2024-04-01T19:53:27.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:27 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.1", "weight": [0.0872955322265625]}]: dispatch 2024-04-01T19:53:27.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:27 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.2", "weight": [0.0926509936326802]}]: dispatch 2024-04-01T19:53:27.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:27 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.3", "weight": [0.0926509936326802]}]: dispatch 2024-04-01T19:53:27.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:27 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.4", "weight": [0.10064690010264554]}]: dispatch 2024-04-01T19:53:27.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:27 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.5", "weight": [0.10064690010264554]}]: dispatch 2024-04-01T19:53:27.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:27 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.6", "weight": [0.09527612126945549]}]: dispatch 2024-04-01T19:53:27.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:27 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.7", "weight": [0.09527612126945549]}]: dispatch 2024-04-01T19:53:27.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:27 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.8", "weight": [0.10064690010264554]}]: dispatch 2024-04-01T19:53:27.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:27 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.9", "weight": [0.09527612126945549]}]: dispatch 2024-04-01T19:53:27.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:27 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.10", "weight": [0.0907292832187765]}]: dispatch 2024-04-01T19:53:27.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:27 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.11", "weight": [0.0926509936326802]}]: dispatch 2024-04-01T19:53:27.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:27 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd reweightn", "format": "json", "weights": "{\"10\": \"40532\"}"}]: dispatch 2024-04-01T19:53:27.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:27 smithi022 ceph-mon[39439]: pgmap v1719: 17 pgs: 17 active+clean; 773 MiB data, 7.0 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:53:27.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:27 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.0", "weight": [0.09109505848562978]}]: dispatch 2024-04-01T19:53:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:27 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.1", "weight": [0.0872955322265625]}]: dispatch 2024-04-01T19:53:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:27 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.2", "weight": [0.0926509936326802]}]: dispatch 2024-04-01T19:53:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:27 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.3", "weight": [0.0926509936326802]}]: dispatch 2024-04-01T19:53:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:27 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.4", "weight": [0.10064690010264554]}]: dispatch 2024-04-01T19:53:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:27 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.5", "weight": [0.10064690010264554]}]: dispatch 2024-04-01T19:53:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:27 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.6", "weight": [0.09527612126945549]}]: dispatch 2024-04-01T19:53:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:27 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.7", "weight": [0.09527612126945549]}]: dispatch 2024-04-01T19:53:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:27 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.8", "weight": [0.10064690010264554]}]: dispatch 2024-04-01T19:53:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:27 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.9", "weight": [0.09527612126945549]}]: dispatch 2024-04-01T19:53:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:27 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.10", "weight": [0.0907292832187765]}]: dispatch 2024-04-01T19:53:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:27 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.11", "weight": [0.0926509936326802]}]: dispatch 2024-04-01T19:53:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:27 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd reweightn", "format": "json", "weights": "{\"10\": \"40532\"}"}]: dispatch 2024-04-01T19:53:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:27 smithi188 ceph-mon[43939]: pgmap v1719: 17 pgs: 17 active+clean; 773 MiB data, 7.0 GiB used, 976 GiB / 983 GiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T19:53:28.189 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:53:28.193 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:28.193 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:53:28.294 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:53:28.355 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:28.398 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:53:28.411 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:28.412 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:53:28.513 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:53:28.543 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:28.567 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:53:28.572 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:28.572 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:53:28.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.0", "weight": [0.09109505848562978]}]': finished 2024-04-01T19:53:28.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.1", "weight": [0.0872955322265625]}]': finished 2024-04-01T19:53:28.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.2", "weight": [0.0926509936326802]}]': finished 2024-04-01T19:53:28.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.3", "weight": [0.0926509936326802]}]': finished 2024-04-01T19:53:28.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.4", "weight": [0.10064690010264554]}]': finished 2024-04-01T19:53:28.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.5", "weight": [0.10064690010264554]}]': finished 2024-04-01T19:53:28.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.6", "weight": [0.09527612126945549]}]': finished 2024-04-01T19:53:28.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.7", "weight": [0.09527612126945549]}]': finished 2024-04-01T19:53:28.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.8", "weight": [0.10064690010264554]}]': finished 2024-04-01T19:53:28.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.9", "weight": [0.09527612126945549]}]': finished 2024-04-01T19:53:28.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.10", "weight": [0.0907292832187765]}]': finished 2024-04-01T19:53:28.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.11", "weight": [0.0926509936326802]}]': finished 2024-04-01T19:53:28.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:28 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd reweightn", "format": "json", "weights": "{\"10\": \"40532\"}"}]': finished 2024-04-01T19:53:28.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:28 smithi022 ceph-mon[39439]: osdmap e622: 12 total, 12 up, 11 in 2024-04-01T19:53:28.673 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:53:28.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.0", "weight": [0.09109505848562978]}]': finished 2024-04-01T19:53:28.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.1", "weight": [0.0872955322265625]}]': finished 2024-04-01T19:53:28.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.2", "weight": [0.0926509936326802]}]': finished 2024-04-01T19:53:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.3", "weight": [0.0926509936326802]}]': finished 2024-04-01T19:53:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.4", "weight": [0.10064690010264554]}]': finished 2024-04-01T19:53:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.5", "weight": [0.10064690010264554]}]': finished 2024-04-01T19:53:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.6", "weight": [0.09527612126945549]}]': finished 2024-04-01T19:53:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.7", "weight": [0.09527612126945549]}]': finished 2024-04-01T19:53:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.8", "weight": [0.10064690010264554]}]': finished 2024-04-01T19:53:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.9", "weight": [0.09527612126945549]}]': finished 2024-04-01T19:53:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.10", "weight": [0.0907292832187765]}]': finished 2024-04-01T19:53:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.11", "weight": [0.0926509936326802]}]': finished 2024-04-01T19:53:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:28 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd reweightn", "format": "json", "weights": "{\"10\": \"40532\"}"}]': finished 2024-04-01T19:53:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:28 smithi062 ceph-mon[44211]: osdmap e622: 12 total, 12 up, 11 in 2024-04-01T19:53:28.762 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:28.860 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:53:28.865 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:28.866 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:53:28.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.0", "weight": [0.09109505848562978]}]': finished 2024-04-01T19:53:28.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.1", "weight": [0.0872955322265625]}]': finished 2024-04-01T19:53:28.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.2", "weight": [0.0926509936326802]}]': finished 2024-04-01T19:53:28.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.3", "weight": [0.0926509936326802]}]': finished 2024-04-01T19:53:28.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.4", "weight": [0.10064690010264554]}]': finished 2024-04-01T19:53:28.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.5", "weight": [0.10064690010264554]}]': finished 2024-04-01T19:53:28.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.6", "weight": [0.09527612126945549]}]': finished 2024-04-01T19:53:28.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.7", "weight": [0.09527612126945549]}]': finished 2024-04-01T19:53:28.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.8", "weight": [0.10064690010264554]}]': finished 2024-04-01T19:53:28.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.9", "weight": [0.09527612126945549]}]': finished 2024-04-01T19:53:28.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.10", "weight": [0.0907292832187765]}]': finished 2024-04-01T19:53:28.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd crush weight-set reweight-compat", "format": "json", "item": "osd.11", "weight": [0.0926509936326802]}]': finished 2024-04-01T19:53:28.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:28 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd='[{"prefix": "osd reweightn", "format": "json", "weights": "{\"10\": \"40532\"}"}]': finished 2024-04-01T19:53:28.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:28 smithi188 ceph-mon[43939]: osdmap e622: 12 total, 12 up, 11 in 2024-04-01T19:53:28.905 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:53:28.906 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:53:28.906 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:28.906 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.36668.0:330522 7.8 e622/560)", 2024-04-01T19:53:28.906 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:53:28.907783+0000", 2024-04-01T19:53:28.906 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.00010010599999999999, 2024-04-01T19:53:28.906 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012696800000000001, 2024-04-01T19:53:28.906 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:53:28.906 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:53:28.906 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "reached pg", 2024-04-01T19:53:28.906 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:53:28.907 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:28.907 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:53:28.907 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:28.907783+0000", 2024-04-01T19:53:28.907 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:53:28.907 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:28.907 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:28.908 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:53:28.908 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:28.907783+0000", 2024-04-01T19:53:28.908 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:53:28.908 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:28.908 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:28.908 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:53:28.908 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:28.907786+0000", 2024-04-01T19:53:28.908 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.649e-06 2024-04-01T19:53:28.908 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:28.908 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:28.908 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:53:28.908 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:28.907799+0000", 2024-04-01T19:53:28.908 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2456000000000001e-05 2024-04-01T19:53:28.909 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:28.909 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:28.909 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:53:28.909 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:28.907817+0000", 2024-04-01T19:53:28.909 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8141000000000001e-05 2024-04-01T19:53:28.909 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:28.909 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:28.909 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:53:28.909 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:28.907829+0000", 2024-04-01T19:53:28.909 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2525e-05 2024-04-01T19:53:28.909 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:53:28.910 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:53:28.910 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:53:28.910 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:28.907896+0000", 2024-04-01T19:53:28.910 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6916999999999996e-05 2024-04-01T19:53:28.910 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:53:28.910 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:53:28.910 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:53:28.910 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:53:28.910 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-04-01T19:53:28.910 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 1 2024-04-01T19:53:28.910 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:53:28.967 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:53:29.009 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:29.044 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:53:29.139 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:53:29.141 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:29.142 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:53:29.243 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:53:29.297 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:29.340 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:53:29.346 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:29.347 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:53:29.448 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:53:29.472 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:29 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2585859204' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:53:29.472 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:29 smithi022 ceph-mon[39439]: from='client.36920 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:53:29.472 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:29 smithi022 ceph-mon[39439]: pgmap v1721: 17 pgs: 17 active+clean; 728 MiB data, 6.8 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:53:29.472 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:29 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3014850994' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:53:29.472 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:29 smithi022 ceph-mon[39439]: from='client.26890 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:53:29.482 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:29.493 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:53:29.498 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.3 to 1 (10000) 2024-04-01T19:53:29.593 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:53:29.631 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:29 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2585859204' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:53:29.631 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:29 smithi062 ceph-mon[44211]: from='client.36920 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:53:29.631 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:29 smithi062 ceph-mon[44211]: pgmap v1721: 17 pgs: 17 active+clean; 728 MiB data, 6.8 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:53:29.631 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:29 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3014850994' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:53:29.631 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:29 smithi062 ceph-mon[44211]: from='client.26890 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:53:29.637 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:53:29.645 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:29.645 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:53:29.665 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_blocked_ops 2024-04-01T19:53:29.746 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:53:29.798 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:29.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:29 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2585859204' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:53:29.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:29 smithi188 ceph-mon[43939]: from='client.36920 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:53:29.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:29 smithi188 ceph-mon[43939]: pgmap v1721: 17 pgs: 17 active+clean; 728 MiB data, 6.8 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T19:53:29.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:29 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3014850994' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:53:29.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:29 smithi188 ceph-mon[43939]: from='client.26890 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T19:53:30.071 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:53:30.612 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:30 smithi062 ceph-mon[44211]: 7.5 scrub starts 2024-04-01T19:53:30.612 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:30 smithi062 ceph-mon[44211]: 7.5 scrub ok 2024-04-01T19:53:30.613 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:30 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:53:30.613 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:30 smithi062 ceph-mon[44211]: from='client.36920 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:53:30.613 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:30 smithi062 ceph-mon[44211]: from='client.26890 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-04-01T19:53:30.613 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:30 smithi062 ceph-mon[44211]: osdmap e623: 12 total, 12 up, 11 in 2024-04-01T19:53:30.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:30 smithi022 ceph-mon[39439]: 7.5 scrub starts 2024-04-01T19:53:30.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:30 smithi022 ceph-mon[39439]: 7.5 scrub ok 2024-04-01T19:53:30.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:30 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:53:30.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:30 smithi022 ceph-mon[39439]: from='client.36920 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:53:30.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:30 smithi022 ceph-mon[39439]: from='client.26890 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-04-01T19:53:30.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:30 smithi022 ceph-mon[39439]: osdmap e623: 12 total, 12 up, 11 in 2024-04-01T19:53:30.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:30 smithi188 ceph-mon[43939]: 7.5 scrub starts 2024-04-01T19:53:30.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:30 smithi188 ceph-mon[43939]: 7.5 scrub ok 2024-04-01T19:53:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:30 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:53:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:30 smithi188 ceph-mon[43939]: from='client.36920 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:53:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:30 smithi188 ceph-mon[43939]: from='client.26890 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-04-01T19:53:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:30 smithi188 ceph-mon[43939]: osdmap e623: 12 total, 12 up, 11 in 2024-04-01T19:53:31.362 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:53:31.367 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:31.368 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:53:31.469 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:53:31.503 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:31.530 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:53:31.533 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:31.534 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:53:31.635 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:53:31.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:31 smithi022 ceph-mon[39439]: pgmap v1723: 17 pgs: 17 active+clean; 571 MiB data, 6.5 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:53:31.669 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:31.690 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:53:31.693 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:31.693 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:53:31.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:31 smithi062 ceph-mon[44211]: pgmap v1723: 17 pgs: 17 active+clean; 571 MiB data, 6.5 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:53:31.794 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:53:31.854 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:31.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:31 smithi188 ceph-mon[43939]: pgmap v1723: 17 pgs: 17 active+clean; 571 MiB data, 6.5 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T19:53:32.731 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:53:32.735 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:32.735 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:53:32.836 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:53:32.878 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:32.897 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:53:32.898 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:53:32.898 INFO:teuthology.orchestra.run.smithi062.stdout: "complaint_time": 30, 2024-04-01T19:53:32.898 INFO:teuthology.orchestra.run.smithi062.stdout: "num_blocked_ops": 0 2024-04-01T19:53:32.898 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:53:32.908 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:53:32.913 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:32.913 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:53:33.014 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:53:33.056 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:33.158 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:53:33.162 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:33.163 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:53:33.264 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:53:33.299 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:33.655 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:53:33.659 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:33.659 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:53:33.660 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_historic_ops 2024-04-01T19:53:33.685 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 4 1 2024-04-01T19:53:33.760 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:53:33.798 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:33.820 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:53:33.827 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:33.828 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:53:33.928 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:53:33.961 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:33.985 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:53:33.990 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:33.991 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:53:34.042 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:53:34.092 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:53:34.133 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:34.158 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:53:34.162 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:34.162 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:53:34.263 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:53:34.291 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:34 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:53:34.291 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:34 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:53:34.291 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:34 smithi022 ceph-mon[39439]: osdmap e624: 12 total, 12 up, 11 in 2024-04-01T19:53:34.291 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:34 smithi022 ceph-mon[39439]: pgmap v1725: 17 pgs: 17 active+clean; 413 MiB data, 6.2 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 960 op/s 2024-04-01T19:53:34.331 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:34.353 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:53:34.406 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:53:34.411 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:34.412 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:53:34.441 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:53:34.466 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:53:34.481 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:53:34.513 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:53:34.538 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:53:34.568 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:34 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:53:34.568 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:34 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:53:34.568 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:34 smithi062 ceph-mon[44211]: osdmap e624: 12 total, 12 up, 11 in 2024-04-01T19:53:34.568 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:34 smithi062 ceph-mon[44211]: pgmap v1725: 17 pgs: 17 active+clean; 413 MiB data, 6.2 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 960 op/s 2024-04-01T19:53:34.583 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:34.599 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:53:34.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:34 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:53:34.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:34 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:53:34.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:34 smithi188 ceph-mon[43939]: osdmap e624: 12 total, 12 up, 11 in 2024-04-01T19:53:34.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:34 smithi188 ceph-mon[43939]: pgmap v1725: 17 pgs: 17 active+clean; 413 MiB data, 6.2 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 960 op/s 2024-04-01T19:53:34.637 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:53:34.646 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:53:34.661 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:34.661 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:53:34.681 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:53:34.722 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:53:34.757 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:53:34.763 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:53:34.796 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:34.802 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:53:34.842 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:53:34.895 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:53:34.940 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:53:34.945 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:53:34.945 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:53:34.945 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:53:34.945 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:53:34.945 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:53:34.945 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:53:34.945 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:53:34.945 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:53:34.945 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:53:34.945 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:53:34.946 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:53:34.946 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:53:35.551 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:53:35.556 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:35 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/284247365' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:53:35.556 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:35.556 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:35.556 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:35.557 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:35.557 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:35.557 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:35.557 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:35.557 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:35.558 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:53:35.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:35 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/284247365' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:53:35.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:35.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:35.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:35.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:35.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:35.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:35.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:35.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:35 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/284247365' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:53:35.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:35.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:35.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:35.658 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:53:35.725 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:36.388 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Removed 169641 objects 2024-04-01T19:53:36.388 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Clean up completed and total clean up time :147.82 2024-04-01T19:53:36.433 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:36 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:36.434 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:36 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:36.434 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:36 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:36.434 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:36 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:36.434 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:36 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:36.434 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:36 smithi062 ceph-mon[44211]: pgmap v1726: 17 pgs: 17 active+clean; 370 MiB data, 6.0 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 821 op/s 2024-04-01T19:53:36.487 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_5 2024-04-01T19:53:36.488 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pool rm unique_pool_5 unique_pool_5 --yes-i-really-really-mean-it 2024-04-01T19:53:36.607 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:53:36.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:36 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:36.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:36 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:36.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:36 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:36.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:36 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:36.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:36 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:36.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:36 smithi022 ceph-mon[39439]: pgmap v1726: 17 pgs: 17 active+clean; 370 MiB data, 6.0 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 821 op/s 2024-04-01T19:53:36.611 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:36.611 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:53:36.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:36 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:36.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:36 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:36.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:36 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:36.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:36 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:36.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:36 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:36.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:36 smithi188 ceph-mon[43939]: pgmap v1726: 17 pgs: 17 active+clean; 370 MiB data, 6.0 GiB used, 977 GiB / 983 GiB avail; 0 B/s wr, 821 op/s 2024-04-01T19:53:36.704 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:53:36.705 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:53:36.712 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:53:36.740 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:36.759 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:53:36.761 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:36.762 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:53:36.863 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:53:36.890 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:36.908 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:53:36.911 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:36.912 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:53:37.013 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:53:37.039 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:37.058 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:53:37.060 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:37.061 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:53:37.162 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:53:37.191 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:37.215 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:53:37.218 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:37.219 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:53:37.319 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:53:37.352 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:37.381 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:53:37.383 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:37.384 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:53:37.396 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_ops_in_flight 2024-04-01T19:53:37.485 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:53:37.514 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:37.537 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:53:37.539 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:37.539 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:53:37.640 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:53:37.668 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:37.679 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:53:37.687 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:53:37.690 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:37.690 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:53:37.791 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:53:37.821 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:37.875 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:53:37.878 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:37.879 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:53:37.980 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:53:38.007 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:38.383 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.4 to 1 (10000) 2024-04-01T19:53:38.607 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:53:38.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:38 smithi062 ceph-mon[44211]: pgmap v1727: 17 pgs: 17 active+clean; 50 MiB data, 5.5 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.35k op/s 2024-04-01T19:53:38.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:38 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/750498072' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T19:53:38.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:38 smithi022 ceph-mon[39439]: pgmap v1727: 17 pgs: 17 active+clean; 50 MiB data, 5.5 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.35k op/s 2024-04-01T19:53:38.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:38 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/750498072' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T19:53:38.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:38 smithi188 ceph-mon[43939]: pgmap v1727: 17 pgs: 17 active+clean; 50 MiB data, 5.5 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.35k op/s 2024-04-01T19:53:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:38 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/750498072' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T19:53:38.957 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:53:38.960 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:38.960 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:53:39.061 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:53:39.097 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:39.223 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:53:39.226 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:39.227 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:53:39.328 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:53:39.359 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:39.484 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:53:39.487 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:39.487 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:53:39.588 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:53:39.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:39 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/750498072' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-04-01T19:53:39.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:39 smithi022 ceph-mon[39439]: osdmap e625: 12 total, 12 up, 11 in 2024-04-01T19:53:39.614 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:39 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/750498072' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-04-01T19:53:39.615 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:39 smithi188 ceph-mon[43939]: osdmap e625: 12 total, 12 up, 11 in 2024-04-01T19:53:39.616 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:39.664 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:53:39.700 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 5 1 2024-04-01T19:53:39.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:39 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/750498072' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-04-01T19:53:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:39 smithi062 ceph-mon[44211]: osdmap e625: 12 total, 12 up, 11 in 2024-04-01T19:53:40.066 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:53:40.069 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:40.069 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:53:40.170 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:53:40.199 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:40.349 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:53:40.351 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:40.352 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:53:40.424 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:53:40.452 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:40 smithi022 ceph-mon[39439]: pgmap v1729: 17 pgs: 17 active+clean; 26 MiB data, 5.4 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:53:40.453 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:53:40.482 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:40.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:40 smithi188 ceph-mon[43939]: pgmap v1729: 17 pgs: 17 active+clean; 26 MiB data, 5.4 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:53:40.635 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:53:40.639 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:40.639 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:53:40.640 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:53:40.640 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:53:40.739 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:53:40.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:40 smithi062 ceph-mon[44211]: pgmap v1729: 17 pgs: 17 active+clean; 26 MiB data, 5.4 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T19:53:40.767 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:41.140 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_blocked_ops 2024-04-01T19:53:41.399 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:53:41.418 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:53:41.423 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:41.423 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:53:41.524 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:53:41.560 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:41.583 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:53:41.585 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:41.586 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:53:41.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:41 smithi022 ceph-mon[39439]: pgmap v1730: 17 pgs: 17 active+clean; 1.4 MiB data, 5.3 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 817 op/s 2024-04-01T19:53:41.685 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:53:41.686 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:53:41.716 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:41 smithi062 ceph-mon[44211]: pgmap v1730: 17 pgs: 17 active+clean; 1.4 MiB data, 5.3 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 817 op/s 2024-04-01T19:53:41.719 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:41.731 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:41 smithi188 ceph-mon[43939]: pgmap v1730: 17 pgs: 17 active+clean; 1.4 MiB data, 5.3 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 817 op/s 2024-04-01T19:53:41.741 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:53:41.743 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:41.744 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:53:41.845 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:53:41.876 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:42.180 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:53:42.183 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:42.184 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:53:42.285 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:53:42.318 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:42.340 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:53:42.343 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:42.344 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:53:42.445 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:53:42.476 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:42.498 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:53:42.501 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:42.501 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:53:42.602 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:53:42.633 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:42.677 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:53:42.701 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:42 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1392749505' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:53:42.781 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:53:42.784 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:42.784 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:53:42.885 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:53:42.912 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:43.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:42 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1392749505' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:53:43.063 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:53:43.065 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:42 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1392749505' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:53:43.066 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:43.066 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:53:43.167 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:53:43.194 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:43.382 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:53:43.382 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:53:43.392 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:53:43.395 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:43.395 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:53:43.496 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:53:43.529 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:43.633 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:53:43.637 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:43.638 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:53:43.689 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'unique_pool_5' removed 2024-04-01T19:53:43.738 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:53:43.771 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:43.790 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:53:43.793 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:43.793 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:53:43.828 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:43 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:53:43.828 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:43 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1392749505' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:53:43.828 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:43 smithi022 ceph-mon[39439]: osdmap e626: 12 total, 12 up, 11 in 2024-04-01T19:53:43.828 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:43 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/373680120' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_5", "pool2": "unique_pool_5", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:53:43.828 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:43 smithi022 ceph-mon[39439]: from='client.26914 ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_5", "pool2": "unique_pool_5", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:53:43.828 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:43 smithi022 ceph-mon[39439]: pgmap v1732: 17 pgs: 17 active+clean; 577 KiB data, 5.3 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 738 op/s 2024-04-01T19:53:43.894 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:53:43.922 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:43.991 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:53:44.008 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:44.009 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:53:44.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:43 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:53:44.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:43 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1392749505' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:53:44.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:43 smithi062 ceph-mon[44211]: osdmap e626: 12 total, 12 up, 11 in 2024-04-01T19:53:44.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:43 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/373680120' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_5", "pool2": "unique_pool_5", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:53:44.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:43 smithi062 ceph-mon[44211]: from='client.26914 ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_5", "pool2": "unique_pool_5", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:53:44.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:43 smithi062 ceph-mon[44211]: pgmap v1732: 17 pgs: 17 active+clean; 577 KiB data, 5.3 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 738 op/s 2024-04-01T19:53:44.062 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:43 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:53:44.062 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:43 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1392749505' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:53:44.062 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:43 smithi188 ceph-mon[43939]: osdmap e626: 12 total, 12 up, 11 in 2024-04-01T19:53:44.063 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:43 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/373680120' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_5", "pool2": "unique_pool_5", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:53:44.063 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:43 smithi188 ceph-mon[43939]: from='client.26914 ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_5", "pool2": "unique_pool_5", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:53:44.063 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:43 smithi188 ceph-mon[43939]: pgmap v1732: 17 pgs: 17 active+clean; 577 KiB data, 5.3 GiB used, 978 GiB / 983 GiB avail; 0 B/s wr, 738 op/s 2024-04-01T19:53:44.088 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_historic_ops 2024-04-01T19:53:44.110 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:53:44.137 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:44.155 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:53:44.158 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:44.158 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:53:44.259 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:53:44.287 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:44.350 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:53:44.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:44 smithi022 ceph-mon[39439]: from='client.26914 ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_5", "pool2": "unique_pool_5", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T19:53:44.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:44 smithi022 ceph-mon[39439]: osdmap e627: 12 total, 12 up, 11 in 2024-04-01T19:53:44.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:44 smithi188 ceph-mon[43939]: from='client.26914 ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_5", "pool2": "unique_pool_5", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T19:53:44.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:44 smithi188 ceph-mon[43939]: osdmap e627: 12 total, 12 up, 11 in 2024-04-01T19:53:44.906 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:53:44.938 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:53:44.943 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:44.944 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:53:44.946 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-04-01T19:53:44.946 INFO:tasks.radosbench:Beginning radosbench... 2024-04-01T19:53:44.947 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_6 2024-04-01T19:53:44.947 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pool create unique_pool_6 16 2024-04-01T19:53:45.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:44 smithi062 ceph-mon[44211]: from='client.26914 ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_5", "pool2": "unique_pool_5", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T19:53:45.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:44 smithi062 ceph-mon[44211]: osdmap e627: 12 total, 12 up, 11 in 2024-04-01T19:53:45.045 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:53:45.074 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:45.171 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:53:45.173 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:45.174 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:53:45.275 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:53:45.304 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:45.404 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:53:45.408 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:45.409 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:53:45.510 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:53:45.536 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:45.588 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:53:45.592 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:45.592 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:53:45.662 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:53:45.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:45 smithi022 ceph-mon[39439]: pgmap v1734: 1 pgs: 1 active+clean; 577 KiB data, 5.3 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:53:45.693 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:53:45.722 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:45.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:45 smithi188 ceph-mon[43939]: pgmap v1734: 1 pgs: 1 active+clean; 577 KiB data, 5.3 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:53:46.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:45 smithi062 ceph-mon[44211]: pgmap v1734: 1 pgs: 1 active+clean; 577 KiB data, 5.3 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:53:46.208 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:53:46.208 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:53:46.208 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:53:46.208 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:53:46.208 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.208 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:186781 7.a 7:5dbe2754:::benchmark_data_smithi188_147022_object17137:head [delete] snapc 0=[] ondisk+write+known_if_redirected e587)", 2024-04-01T19:53:46.208 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:51:22.322560+0000", 2024-04-01T19:53:46.208 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 143.88523010599999, 2024-04-01T19:53:46.208 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18899632399999999, 2024-04-01T19:53:46.208 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:46.208 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:46.209 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:46.209 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:53:46.209 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:53:46.209 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:53:46.209 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 186781 2024-04-01T19:53:46.209 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.209 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:46.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.209 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:46.209 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.322560+0000", 2024-04-01T19:53:46.209 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.209 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.210 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:46.210 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.322560+0000", 2024-04-01T19:53:46.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.210 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.210 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.210 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:46.210 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.322562+0000", 2024-04-01T19:53:46.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8479999999999999e-06 2024-04-01T19:53:46.210 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.210 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.210 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:46.210 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.322568+0000", 2024-04-01T19:53:46.211 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8680000000000004e-06 2024-04-01T19:53:46.211 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.211 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.211 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:46.211 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.322579+0000", 2024-04-01T19:53:46.211 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1307e-05 2024-04-01T19:53:46.211 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.211 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.211 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:46.211 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.322585+0000", 2024-04-01T19:53:46.211 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3860000000000004e-06 2024-04-01T19:53:46.211 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.211 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.211 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:46.212 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.322645+0000", 2024-04-01T19:53:46.212 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9979000000000003e-05 2024-04-01T19:53:46.212 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.212 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.212 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:46.212 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.322786+0000", 2024-04-01T19:53:46.212 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014019799999999999 2024-04-01T19:53:46.212 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.212 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.212 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:53:46.212 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.322915+0000", 2024-04-01T19:53:46.212 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012924099999999999 2024-04-01T19:53:46.212 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.212 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.213 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:53:46.213 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.326892+0000", 2024-04-01T19:53:46.213 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0039770090000000001 2024-04-01T19:53:46.213 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.213 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.213 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:53:46.213 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.511472+0000", 2024-04-01T19:53:46.213 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.18458012100000001 2024-04-01T19:53:46.213 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.213 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.213 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:46.213 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.511506+0000", 2024-04-01T19:53:46.213 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3759e-05 2024-04-01T19:53:46.213 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.214 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.214 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:46.214 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.511556+0000", 2024-04-01T19:53:46.214 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0608000000000001e-05 2024-04-01T19:53:46.214 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.214 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:46.214 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.214 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.214 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.214 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:186787 7.a 7:57206120:::benchmark_data_smithi188_147022_object17143:head [delete] snapc 0=[] ondisk+write+known_if_redirected e588)", 2024-04-01T19:53:46.214 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:51:22.332409+0000", 2024-04-01T19:53:46.214 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 143.87538078099999, 2024-04-01T19:53:46.214 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.17927041499999999, 2024-04-01T19:53:46.215 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:46.215 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:46.215 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:46.215 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:53:46.215 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:53:46.215 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:53:46.215 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 186787 2024-04-01T19:53:46.215 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.215 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:46.215 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.215 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:46.215 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.332409+0000", 2024-04-01T19:53:46.215 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.215 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:46.216 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.332409+0000", 2024-04-01T19:53:46.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.216 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:46.216 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.332411+0000", 2024-04-01T19:53:46.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0480000000000001e-06 2024-04-01T19:53:46.216 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:46.216 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.332418+0000", 2024-04-01T19:53:46.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3579999999999999e-06 2024-04-01T19:53:46.217 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.217 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.217 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:46.217 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.332430+0000", 2024-04-01T19:53:46.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1831000000000001e-05 2024-04-01T19:53:46.217 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.217 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.217 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:46.217 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.332437+0000", 2024-04-01T19:53:46.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6179999999999997e-06 2024-04-01T19:53:46.217 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.217 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.217 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:46.218 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.332503+0000", 2024-04-01T19:53:46.218 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5829999999999998e-05 2024-04-01T19:53:46.218 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.218 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.218 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-01T19:53:46.218 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.332512+0000", 2024-04-01T19:53:46.218 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5420000000000005e-06 2024-04-01T19:53:46.218 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.218 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.218 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:46.218 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.333456+0000", 2024-04-01T19:53:46.218 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00094419100000000004 2024-04-01T19:53:46.218 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:46.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.333548+0000", 2024-04-01T19:53:46.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2233999999999998e-05 2024-04-01T19:53:46.219 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:53:46.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.333628+0000", 2024-04-01T19:53:46.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0105000000000006e-05 2024-04-01T19:53:46.219 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:53:46.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.337444+0000", 2024-04-01T19:53:46.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0038162360000000002 2024-04-01T19:53:46.220 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.220 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:53:46.220 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.511604+0000", 2024-04-01T19:53:46.220 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.17416003599999999 2024-04-01T19:53:46.220 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.220 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:46.220 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.511636+0000", 2024-04-01T19:53:46.220 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1801000000000003e-05 2024-04-01T19:53:46.220 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.220 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:46.220 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.511680+0000", 2024-04-01T19:53:46.221 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3584999999999997e-05 2024-04-01T19:53:46.221 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.221 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:46.221 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.221 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.221 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.221 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:186796 7.a 7:53dba114:::benchmark_data_smithi188_147022_object17152:head [delete] snapc 0=[] ondisk+write+known_if_redirected e588)", 2024-04-01T19:53:46.221 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:51:22.353769+0000", 2024-04-01T19:53:46.221 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 143.85402142500001, 2024-04-01T19:53:46.221 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16174891999999999, 2024-04-01T19:53:46.221 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:46.221 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:46.221 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:46.222 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:53:46.222 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:53:46.222 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:53:46.222 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 186796 2024-04-01T19:53:46.222 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.222 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:46.222 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.222 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:46.222 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.353769+0000", 2024-04-01T19:53:46.222 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.222 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.222 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.223 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:46.223 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.353769+0000", 2024-04-01T19:53:46.223 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.223 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.223 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.223 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:46.223 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.353771+0000", 2024-04-01T19:53:46.223 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.889e-06 2024-04-01T19:53:46.223 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.223 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.223 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:46.223 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.353776+0000", 2024-04-01T19:53:46.223 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7690000000000002e-06 2024-04-01T19:53:46.223 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:46.224 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.353789+0000", 2024-04-01T19:53:46.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2921e-05 2024-04-01T19:53:46.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:46.224 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.353796+0000", 2024-04-01T19:53:46.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0180000000000004e-06 2024-04-01T19:53:46.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:46.224 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.353841+0000", 2024-04-01T19:53:46.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4888999999999997e-05 2024-04-01T19:53:46.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:46.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.353938+0000", 2024-04-01T19:53:46.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.6416999999999995e-05 2024-04-01T19:53:46.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:53:46.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.354020+0000", 2024-04-01T19:53:46.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2620000000000005e-05 2024-04-01T19:53:46.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:53:46.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.357878+0000", 2024-04-01T19:53:46.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0038581549999999998 2024-04-01T19:53:46.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.226 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.226 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:53:46.226 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.515417+0000", 2024-04-01T19:53:46.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.157538871 2024-04-01T19:53:46.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.226 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.226 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:46.226 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.515471+0000", 2024-04-01T19:53:46.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3198000000000001e-05 2024-04-01T19:53:46.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.226 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.226 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:46.226 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:22.515518+0000", 2024-04-01T19:53:46.227 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7172999999999997e-05 2024-04-01T19:53:46.227 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.227 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:46.227 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.227 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.227 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.227 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:285642 7.a 7:5759a342:::benchmark_data_smithi188_147022_object115998:head [delete] snapc 0=[] ondisk+write+known_if_redirected e607)", 2024-04-01T19:53:46.227 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:52:47.611729+0000", 2024-04-01T19:53:46.227 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 58.596061585000001, 2024-04-01T19:53:46.227 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033525043999999997, 2024-04-01T19:53:46.227 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:46.227 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:46.227 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:46.227 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:53:46.228 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:53:46.228 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:53:46.228 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 285642 2024-04-01T19:53:46.228 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.228 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:46.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.228 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:46.228 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:47.611729+0000", 2024-04-01T19:53:46.228 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.228 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.228 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:46.228 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:47.611729+0000", 2024-04-01T19:53:46.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:46.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:47.611730+0000", 2024-04-01T19:53:46.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2839999999999999e-06 2024-04-01T19:53:46.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:46.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:47.611735+0000", 2024-04-01T19:53:46.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0289999999999996e-06 2024-04-01T19:53:46.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:46.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:47.611745+0000", 2024-04-01T19:53:46.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0015e-05 2024-04-01T19:53:46.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:46.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:47.611753+0000", 2024-04-01T19:53:46.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9829999999999996e-06 2024-04-01T19:53:46.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:46.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:47.622187+0000", 2024-04-01T19:53:46.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010434073 2024-04-01T19:53:46.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:46.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:47.622324+0000", 2024-04-01T19:53:46.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013743499999999999 2024-04-01T19:53:46.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:53:46.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:47.622455+0000", 2024-04-01T19:53:46.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013087400000000001 2024-04-01T19:53:46.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:53:46.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:47.634750+0000", 2024-04-01T19:53:46.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012294292 2024-04-01T19:53:46.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:53:46.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:47.645143+0000", 2024-04-01T19:53:46.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010393539 2024-04-01T19:53:46.232 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:46.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:47.645202+0000", 2024-04-01T19:53:46.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9228999999999998e-05 2024-04-01T19:53:46.232 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:46.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:47.645254+0000", 2024-04-01T19:53:46.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1291000000000001e-05 2024-04-01T19:53:46.232 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.232 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:46.232 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.233 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:308371 7.a 7:5259fc72:::benchmark_data_smithi188_147022_object138727:head [delete] snapc 0=[] ondisk+write+known_if_redirected e615)", 2024-04-01T19:53:46.233 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:09.146334+0000", 2024-04-01T19:53:46.233 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 37.061456606999997, 2024-04-01T19:53:46.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.071710598, 2024-04-01T19:53:46.233 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:46.233 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:46.233 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:46.233 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:53:46.233 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:53:46.233 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:53:46.233 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 308371 2024-04-01T19:53:46.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.233 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:46.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.234 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:46.234 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.146334+0000", 2024-04-01T19:53:46.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.234 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.234 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:46.234 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.146334+0000", 2024-04-01T19:53:46.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.234 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.234 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:46.234 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.146335+0000", 2024-04-01T19:53:46.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5680000000000001e-06 2024-04-01T19:53:46.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:46.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.146353+0000", 2024-04-01T19:53:46.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8165e-05 2024-04-01T19:53:46.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:46.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.146363+0000", 2024-04-01T19:53:46.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.6220000000000004e-06 2024-04-01T19:53:46.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:46.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.146370+0000", 2024-04-01T19:53:46.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.075e-06 2024-04-01T19:53:46.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:46.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.146421+0000", 2024-04-01T19:53:46.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1273999999999997e-05 2024-04-01T19:53:46.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:46.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.146559+0000", 2024-04-01T19:53:46.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013798 2024-04-01T19:53:46.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:53:46.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.146687+0000", 2024-04-01T19:53:46.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012728899999999999 2024-04-01T19:53:46.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:53:46.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.151601+0000", 2024-04-01T19:53:46.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0049145819999999998 2024-04-01T19:53:46.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:53:46.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.217939+0000", 2024-04-01T19:53:46.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066337781999999998 2024-04-01T19:53:46.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:46.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.217994+0000", 2024-04-01T19:53:46.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4805999999999997e-05 2024-04-01T19:53:46.238 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.238 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.238 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:46.238 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.218044+0000", 2024-04-01T19:53:46.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0454999999999997e-05 2024-04-01T19:53:46.238 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.238 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:46.238 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.238 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.238 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.238 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:308379 7.a 7:58b657a5:::benchmark_data_smithi188_147022_object138735:head [delete] snapc 0=[] ondisk+write+known_if_redirected e615)", 2024-04-01T19:53:46.239 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:09.155973+0000", 2024-04-01T19:53:46.239 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 37.051817077999999, 2024-04-01T19:53:46.239 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.062215939999999997, 2024-04-01T19:53:46.239 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:46.239 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:46.239 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:46.239 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:53:46.239 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:53:46.239 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:53:46.239 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 308379 2024-04-01T19:53:46.239 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.239 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:46.239 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.239 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:46.239 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.155973+0000", 2024-04-01T19:53:46.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:46.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.155973+0000", 2024-04-01T19:53:46.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:46.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.155975+0000", 2024-04-01T19:53:46.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9099999999999999e-06 2024-04-01T19:53:46.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:46.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.155981+0000", 2024-04-01T19:53:46.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3969999999999999e-06 2024-04-01T19:53:46.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:46.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.155992+0000", 2024-04-01T19:53:46.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0937999999999999e-05 2024-04-01T19:53:46.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:46.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.156001+0000", 2024-04-01T19:53:46.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0140000000000004e-06 2024-04-01T19:53:46.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:46.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.156048+0000", 2024-04-01T19:53:46.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7129000000000002e-05 2024-04-01T19:53:46.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:46.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.156138+0000", 2024-04-01T19:53:46.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9443000000000004e-05 2024-04-01T19:53:46.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:53:46.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.156214+0000", 2024-04-01T19:53:46.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6310000000000006e-05 2024-04-01T19:53:46.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:53:46.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.160036+0000", 2024-04-01T19:53:46.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0038215469999999998 2024-04-01T19:53:46.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:53:46.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.218098+0000", 2024-04-01T19:53:46.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.058062174000000001 2024-04-01T19:53:46.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:46.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.218148+0000", 2024-04-01T19:53:46.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0476999999999998e-05 2024-04-01T19:53:46.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.244 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:46.244 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:09.218189+0000", 2024-04-01T19:53:46.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0601e-05 2024-04-01T19:53:46.244 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.244 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:46.244 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.244 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:325403 7.a 7:59b2502e:::benchmark_data_smithi188_147022_object155759:head [delete] snapc 0=[] ondisk+write+known_if_redirected e621)", 2024-04-01T19:53:46.244 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:24.514600+0000", 2024-04-01T19:53:46.244 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 21.693189949000001, 2024-04-01T19:53:46.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.032628307000000002, 2024-04-01T19:53:46.245 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:46.245 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:46.245 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:46.245 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:53:46.245 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:53:46.245 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:53:46.245 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 325403 2024-04-01T19:53:46.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.245 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:46.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.245 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:46.245 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.514600+0000", 2024-04-01T19:53:46.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.245 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:46.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.514600+0000", 2024-04-01T19:53:46.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:46.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.514602+0000", 2024-04-01T19:53:46.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8780000000000001e-06 2024-04-01T19:53:46.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:46.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.514608+0000", 2024-04-01T19:53:46.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.037e-06 2024-04-01T19:53:46.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:46.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.514618+0000", 2024-04-01T19:53:46.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.6870000000000006e-06 2024-04-01T19:53:46.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:46.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.514624+0000", 2024-04-01T19:53:46.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2029999999999997e-06 2024-04-01T19:53:46.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:46.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.514672+0000", 2024-04-01T19:53:46.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8254999999999998e-05 2024-04-01T19:53:46.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:46.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.514768+0000", 2024-04-01T19:53:46.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5734000000000002e-05 2024-04-01T19:53:46.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:53:46.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.514843+0000", 2024-04-01T19:53:46.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4682000000000001e-05 2024-04-01T19:53:46.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:53:46.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.518734+0000", 2024-04-01T19:53:46.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0038912730000000002 2024-04-01T19:53:46.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:53:46.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.547123+0000", 2024-04-01T19:53:46.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.02838912 2024-04-01T19:53:46.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.249 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:46.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.547181+0000", 2024-04-01T19:53:46.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7615999999999999e-05 2024-04-01T19:53:46.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.249 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:46.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.547229+0000", 2024-04-01T19:53:46.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7821999999999997e-05 2024-04-01T19:53:46.249 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.249 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:46.250 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.250 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.250 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.250 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:325412 7.a 7:5cdce11c:::benchmark_data_smithi188_147022_object155768:head [delete] snapc 0=[] ondisk+write+known_if_redirected e621)", 2024-04-01T19:53:46.250 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:24.522216+0000", 2024-04-01T19:53:46.250 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 21.685574018000001, 2024-04-01T19:53:46.250 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.037056075000000001, 2024-04-01T19:53:46.250 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:46.250 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:46.250 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:46.250 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:53:46.250 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:53:46.250 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:53:46.250 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 325412 2024-04-01T19:53:46.250 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.251 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:46.251 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.251 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:46.251 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.522216+0000", 2024-04-01T19:53:46.251 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.251 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.251 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.251 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:46.251 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.522216+0000", 2024-04-01T19:53:46.251 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.251 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.251 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.251 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:46.251 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.522218+0000", 2024-04-01T19:53:46.251 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5579999999999999e-06 2024-04-01T19:53:46.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:46.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.522223+0000", 2024-04-01T19:53:46.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1250000000000001e-06 2024-04-01T19:53:46.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:46.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.522233+0000", 2024-04-01T19:53:46.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0385e-05 2024-04-01T19:53:46.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:46.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.522240+0000", 2024-04-01T19:53:46.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7560000000000002e-06 2024-04-01T19:53:46.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:46.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.522293+0000", 2024-04-01T19:53:46.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3124000000000002e-05 2024-04-01T19:53:46.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:46.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.522391+0000", 2024-04-01T19:53:46.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8091999999999995e-05 2024-04-01T19:53:46.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:53:46.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.522471+0000", 2024-04-01T19:53:46.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9460000000000002e-05 2024-04-01T19:53:46.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.254 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.254 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:53:46.254 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.529224+0000", 2024-04-01T19:53:46.254 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067536569999999997 2024-04-01T19:53:46.254 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.254 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.254 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:53:46.254 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.559175+0000", 2024-04-01T19:53:46.254 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029950218000000001 2024-04-01T19:53:46.254 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.254 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.254 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:46.254 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.559228+0000", 2024-04-01T19:53:46.255 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3038999999999998e-05 2024-04-01T19:53:46.255 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.255 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.255 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:46.255 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.559272+0000", 2024-04-01T19:53:46.255 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4660999999999998e-05 2024-04-01T19:53:46.255 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.255 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:46.255 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.255 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.255 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.255 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:325414 7.a 7:53423e4a:::benchmark_data_smithi188_147022_object155770:head [delete] snapc 0=[] ondisk+write+known_if_redirected e621)", 2024-04-01T19:53:46.255 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:24.524349+0000", 2024-04-01T19:53:46.255 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 21.683441330000001, 2024-04-01T19:53:46.255 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035075226000000001, 2024-04-01T19:53:46.256 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:46.256 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:46.256 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:46.256 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:53:46.256 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:53:46.256 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:53:46.256 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 325414 2024-04-01T19:53:46.256 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.256 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:46.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.256 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:46.256 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.524349+0000", 2024-04-01T19:53:46.256 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.256 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.257 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:46.257 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.524349+0000", 2024-04-01T19:53:46.257 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.257 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.257 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:46.257 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.524350+0000", 2024-04-01T19:53:46.257 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2109999999999999e-06 2024-04-01T19:53:46.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.257 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.257 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:46.257 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.524354+0000", 2024-04-01T19:53:46.257 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9990000000000002e-06 2024-04-01T19:53:46.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.258 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:46.258 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.524363+0000", 2024-04-01T19:53:46.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1279999999999997e-06 2024-04-01T19:53:46.258 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.258 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:46.258 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.524369+0000", 2024-04-01T19:53:46.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1770000000000003e-06 2024-04-01T19:53:46.258 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.258 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:46.258 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.525923+0000", 2024-04-01T19:53:46.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001553406 2024-04-01T19:53:46.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.259 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.259 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:46.259 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.526041+0000", 2024-04-01T19:53:46.259 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117751 2024-04-01T19:53:46.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.259 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.259 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:53:46.259 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.526124+0000", 2024-04-01T19:53:46.259 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3656e-05 2024-04-01T19:53:46.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.259 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.259 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:53:46.259 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.529373+0000", 2024-04-01T19:53:46.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032491629999999998 2024-04-01T19:53:46.260 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.260 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.260 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:53:46.260 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.559325+0000", 2024-04-01T19:53:46.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029952084 2024-04-01T19:53:46.260 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.260 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.260 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:46.260 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.559384+0000", 2024-04-01T19:53:46.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8779000000000001e-05 2024-04-01T19:53:46.260 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.260 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.260 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:46.260 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.559424+0000", 2024-04-01T19:53:46.261 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9872e-05 2024-04-01T19:53:46.261 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.261 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:46.261 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.261 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.261 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.261 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:325875 7.a 7:5674e7cb:::benchmark_data_smithi188_147022_object156231:head [delete] snapc 0=[] ondisk+write+known_if_redirected e621)", 2024-04-01T19:53:46.261 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:24.904511+0000", 2024-04-01T19:53:46.261 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 21.303278880000001, 2024-04-01T19:53:46.261 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.032519094999999998, 2024-04-01T19:53:46.261 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:46.261 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:46.261 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:46.261 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:53:46.261 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:53:46.262 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:53:46.262 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 325875 2024-04-01T19:53:46.262 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.262 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:46.262 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.262 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:46.262 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.904511+0000", 2024-04-01T19:53:46.262 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.262 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.262 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.262 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:46.262 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.904511+0000", 2024-04-01T19:53:46.262 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.263 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.263 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:46.263 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.904512+0000", 2024-04-01T19:53:46.263 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3799999999999996e-07 2024-04-01T19:53:46.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.263 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.263 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:46.263 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.904516+0000", 2024-04-01T19:53:46.263 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.552e-06 2024-04-01T19:53:46.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.263 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.263 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:46.263 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.904523+0000", 2024-04-01T19:53:46.263 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8249999999999999e-06 2024-04-01T19:53:46.264 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.264 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:46.264 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.904529+0000", 2024-04-01T19:53:46.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9529999999999996e-06 2024-04-01T19:53:46.264 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.264 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:46.264 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.911103+0000", 2024-04-01T19:53:46.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0065745990000000004 2024-04-01T19:53:46.264 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.264 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:46.264 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.911211+0000", 2024-04-01T19:53:46.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000107587 2024-04-01T19:53:46.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.265 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:53:46.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.911288+0000", 2024-04-01T19:53:46.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6952000000000005e-05 2024-04-01T19:53:46.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.265 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:53:46.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.919968+0000", 2024-04-01T19:53:46.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0086804329999999996 2024-04-01T19:53:46.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.265 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:53:46.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.936929+0000", 2024-04-01T19:53:46.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016960800000000002 2024-04-01T19:53:46.266 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.266 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.266 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:46.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.936984+0000", 2024-04-01T19:53:46.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4805999999999997e-05 2024-04-01T19:53:46.266 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.266 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.266 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:46.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:24.937030+0000", 2024-04-01T19:53:46.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6650000000000002e-05 2024-04-01T19:53:46.266 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.266 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:46.266 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.267 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.267 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.267 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:333385 7.a 7:568697b8:::benchmark_data_smithi188_147022_object163741:head [delete] snapc 0=[] ondisk+write+known_if_redirected e623)", 2024-04-01T19:53:46.267 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:31.413194+0000", 2024-04-01T19:53:46.267 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 14.794596492, 2024-04-01T19:53:46.267 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033462181000000001, 2024-04-01T19:53:46.267 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:46.267 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:46.267 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:46.267 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:53:46.267 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:53:46.267 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:53:46.267 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 333385 2024-04-01T19:53:46.267 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.267 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:46.268 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.268 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:46.268 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:31.413194+0000", 2024-04-01T19:53:46.268 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.268 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.268 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.268 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:46.268 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:31.413194+0000", 2024-04-01T19:53:46.268 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.268 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.268 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.268 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:46.268 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:31.413194+0000", 2024-04-01T19:53:46.268 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.92e-07 2024-04-01T19:53:46.268 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.269 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:46.269 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:31.413198+0000", 2024-04-01T19:53:46.269 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-06 2024-04-01T19:53:46.269 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.269 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:46.269 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:31.413205+0000", 2024-04-01T19:53:46.269 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1439999999999997e-06 2024-04-01T19:53:46.269 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.269 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:46.269 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:31.413210+0000", 2024-04-01T19:53:46.269 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.887e-06 2024-04-01T19:53:46.269 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:46.270 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:31.422002+0000", 2024-04-01T19:53:46.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0087924809999999996 2024-04-01T19:53:46.270 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.270 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:46.270 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:31.422106+0000", 2024-04-01T19:53:46.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010418 2024-04-01T19:53:46.270 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.270 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:53:46.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:31.422201+0000", 2024-04-01T19:53:46.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4668999999999998e-05 2024-04-01T19:53:46.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:53:46.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:31.432211+0000", 2024-04-01T19:53:46.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010010244999999999 2024-04-01T19:53:46.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:53:46.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:31.446545+0000", 2024-04-01T19:53:46.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014333797000000001 2024-04-01T19:53:46.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:46.272 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:31.446603+0000", 2024-04-01T19:53:46.272 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8303000000000001e-05 2024-04-01T19:53:46.272 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.272 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.272 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:46.272 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:31.446656+0000", 2024-04-01T19:53:46.272 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2605000000000002e-05 2024-04-01T19:53:46.272 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.272 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:46.272 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.272 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.272 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.272 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:336010 7.a 7:54e05d8b:::benchmark_data_smithi188_147022_object166366:head [delete] snapc 0=[] ondisk+write+known_if_redirected e624)", 2024-04-01T19:53:46.272 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:33.555169+0000", 2024-04-01T19:53:46.272 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 12.652621078999999, 2024-04-01T19:53:46.273 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.036770878, 2024-04-01T19:53:46.273 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:46.273 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:46.273 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:46.273 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:53:46.273 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:53:46.273 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:53:46.273 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 336010 2024-04-01T19:53:46.273 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.273 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:46.273 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.273 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:46.273 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.555169+0000", 2024-04-01T19:53:46.273 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.273 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.274 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.274 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:46.274 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.555169+0000", 2024-04-01T19:53:46.274 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.274 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.274 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.274 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:46.274 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.555171+0000", 2024-04-01T19:53:46.274 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.114e-06 2024-04-01T19:53:46.274 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.274 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.274 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:46.274 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.555178+0000", 2024-04-01T19:53:46.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4189999999999999e-06 2024-04-01T19:53:46.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:46.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.555189+0000", 2024-04-01T19:53:46.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1351e-05 2024-04-01T19:53:46.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:46.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.555197+0000", 2024-04-01T19:53:46.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7729999999999999e-06 2024-04-01T19:53:46.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:46.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.555250+0000", 2024-04-01T19:53:46.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3276999999999998e-05 2024-04-01T19:53:46.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:46.276 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.555352+0000", 2024-04-01T19:53:46.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000102112 2024-04-01T19:53:46.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:53:46.276 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.555432+0000", 2024-04-01T19:53:46.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0098999999999993e-05 2024-04-01T19:53:46.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:53:46.276 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.568176+0000", 2024-04-01T19:53:46.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012744085 2024-04-01T19:53:46.277 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.277 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.277 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:53:46.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.591838+0000", 2024-04-01T19:53:46.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023661277000000001 2024-04-01T19:53:46.277 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.277 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.277 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:46.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.591900+0000", 2024-04-01T19:53:46.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2389000000000002e-05 2024-04-01T19:53:46.277 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.277 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.277 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:46.278 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.591940+0000", 2024-04-01T19:53:46.278 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9981999999999998e-05 2024-04-01T19:53:46.278 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.278 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:46.278 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.278 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.278 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.278 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:336014 7.a 7:5bc85410:::benchmark_data_smithi188_147022_object166370:head [delete] snapc 0=[] ondisk+write+known_if_redirected e624)", 2024-04-01T19:53:46.278 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:33.555936+0000", 2024-04-01T19:53:46.278 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 12.651854223000001, 2024-04-01T19:53:46.278 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.036164059999999998, 2024-04-01T19:53:46.278 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:46.278 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:46.279 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:46.279 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:53:46.279 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:53:46.279 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:53:46.279 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 336014 2024-04-01T19:53:46.279 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.279 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:46.279 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.279 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:46.279 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.555936+0000", 2024-04-01T19:53:46.279 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.279 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.279 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.279 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:46.280 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.555936+0000", 2024-04-01T19:53:46.280 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.280 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.280 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.280 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:46.280 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.555937+0000", 2024-04-01T19:53:46.280 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.454e-06 2024-04-01T19:53:46.280 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.280 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.280 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:46.280 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.555942+0000", 2024-04-01T19:53:46.280 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0459999999999996e-06 2024-04-01T19:53:46.280 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.280 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.281 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:46.281 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.555955+0000", 2024-04-01T19:53:46.281 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2214e-05 2024-04-01T19:53:46.281 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.281 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.281 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:46.281 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.555962+0000", 2024-04-01T19:53:46.281 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4460000000000004e-06 2024-04-01T19:53:46.281 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.281 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.281 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:46.281 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.559293+0000", 2024-04-01T19:53:46.281 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0033310810000000001 2024-04-01T19:53:46.281 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.281 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.282 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:46.282 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.559423+0000", 2024-04-01T19:53:46.282 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000129398 2024-04-01T19:53:46.282 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.282 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.282 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:53:46.282 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.559515+0000", 2024-04-01T19:53:46.282 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2090999999999996e-05 2024-04-01T19:53:46.282 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.282 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.282 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:53:46.282 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.568278+0000", 2024-04-01T19:53:46.282 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0087634500000000008 2024-04-01T19:53:46.282 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.283 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.283 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:53:46.283 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.592010+0000", 2024-04-01T19:53:46.283 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023731555000000001 2024-04-01T19:53:46.283 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.283 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.283 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:46.283 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.592058+0000", 2024-04-01T19:53:46.283 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8656000000000003e-05 2024-04-01T19:53:46.283 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.283 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.283 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:46.283 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.592100+0000", 2024-04-01T19:53:46.283 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1668999999999997e-05 2024-04-01T19:53:46.284 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.284 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:46.284 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.284 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.284 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.284 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:336016 7.a 7:5f83feb7:::benchmark_data_smithi188_147022_object166372:head [delete] snapc 0=[] ondisk+write+known_if_redirected e624)", 2024-04-01T19:53:46.284 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:33.556647+0000", 2024-04-01T19:53:46.284 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 12.651142988, 2024-04-01T19:53:46.284 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035621866000000002, 2024-04-01T19:53:46.284 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:46.284 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:46.284 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:46.284 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:53:46.285 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:53:46.285 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:53:46.285 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 336016 2024-04-01T19:53:46.285 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.285 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:46.285 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.285 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:46.285 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.556647+0000", 2024-04-01T19:53:46.285 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.285 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.285 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.285 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:46.285 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.556647+0000", 2024-04-01T19:53:46.285 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.286 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.286 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.286 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:46.286 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.556649+0000", 2024-04-01T19:53:46.286 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.403e-06 2024-04-01T19:53:46.286 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.286 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.286 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:46.286 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.556653+0000", 2024-04-01T19:53:46.286 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7790000000000003e-06 2024-04-01T19:53:46.286 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.286 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.286 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:46.287 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.556668+0000", 2024-04-01T19:53:46.287 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4187e-05 2024-04-01T19:53:46.287 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.287 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.287 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:46.287 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.556675+0000", 2024-04-01T19:53:46.287 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2819999999999999e-06 2024-04-01T19:53:46.287 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.287 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.287 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:46.287 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.563866+0000", 2024-04-01T19:53:46.287 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.007191167 2024-04-01T19:53:46.287 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.287 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.288 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:46.288 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.563986+0000", 2024-04-01T19:53:46.288 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119967 2024-04-01T19:53:46.288 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.288 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.288 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:53:46.288 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.564103+0000", 2024-04-01T19:53:46.288 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117169 2024-04-01T19:53:46.288 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.288 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.288 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:53:46.288 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.579840+0000", 2024-04-01T19:53:46.288 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015737010999999999 2024-04-01T19:53:46.288 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.288 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.289 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:53:46.289 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.592175+0000", 2024-04-01T19:53:46.289 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012334855 2024-04-01T19:53:46.289 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.289 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.289 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:46.289 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.592228+0000", 2024-04-01T19:53:46.289 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2581999999999999e-05 2024-04-01T19:53:46.289 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.289 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.289 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:46.289 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.592269+0000", 2024-04-01T19:53:46.289 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1464000000000001e-05 2024-04-01T19:53:46.290 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.290 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:46.290 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.290 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.290 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.290 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:336018 7.a 7:5c14e63f:::benchmark_data_smithi188_147022_object166374:head [delete] snapc 0=[] ondisk+write+known_if_redirected e624)", 2024-04-01T19:53:46.290 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:33.556816+0000", 2024-04-01T19:53:46.290 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 12.650974004, 2024-04-01T19:53:46.290 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035601872999999999, 2024-04-01T19:53:46.290 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:46.290 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:46.290 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:46.290 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:53:46.291 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:53:46.291 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:53:46.291 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 336018 2024-04-01T19:53:46.291 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.291 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:46.291 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.291 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:46.291 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.556816+0000", 2024-04-01T19:53:46.291 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.291 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.291 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.291 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:46.291 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.556816+0000", 2024-04-01T19:53:46.291 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.291 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.292 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.292 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:46.292 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.556818+0000", 2024-04-01T19:53:46.292 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.372e-06 2024-04-01T19:53:46.292 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.292 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.292 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:46.292 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.556822+0000", 2024-04-01T19:53:46.292 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6779999999999999e-06 2024-04-01T19:53:46.292 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.292 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.292 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:46.292 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.556834+0000", 2024-04-01T19:53:46.292 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1514e-05 2024-04-01T19:53:46.293 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.293 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.293 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:46.293 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.556841+0000", 2024-04-01T19:53:46.293 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4819999999999997e-06 2024-04-01T19:53:46.293 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.293 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.293 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:46.293 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.568295+0000", 2024-04-01T19:53:46.293 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011453839 2024-04-01T19:53:46.293 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.293 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.293 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:46.293 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.568411+0000", 2024-04-01T19:53:46.294 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000116315 2024-04-01T19:53:46.294 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.294 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.294 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:53:46.294 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.568485+0000", 2024-04-01T19:53:46.294 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3312999999999994e-05 2024-04-01T19:53:46.294 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.294 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.294 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:53:46.294 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.583681+0000", 2024-04-01T19:53:46.294 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015196392 2024-04-01T19:53:46.294 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.294 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.295 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:53:46.295 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.592322+0000", 2024-04-01T19:53:46.295 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0086407800000000007 2024-04-01T19:53:46.295 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.295 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.295 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:46.295 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.592381+0000", 2024-04-01T19:53:46.295 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9005000000000002e-05 2024-04-01T19:53:46.295 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.295 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.295 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:46.295 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.592418+0000", 2024-04-01T19:53:46.295 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7183e-05 2024-04-01T19:53:46.295 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.295 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:46.296 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.296 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.296 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.296 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:336027 7.a 7:58bfb4c9:::benchmark_data_smithi188_147022_object166383:head [delete] snapc 0=[] ondisk+write+known_if_redirected e624)", 2024-04-01T19:53:46.296 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:33.566511+0000", 2024-04-01T19:53:46.296 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 12.641279101, 2024-04-01T19:53:46.296 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035588518999999999, 2024-04-01T19:53:46.296 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:46.296 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:46.296 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:46.296 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:53:46.296 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:53:46.296 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:53:46.296 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 336027 2024-04-01T19:53:46.297 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.297 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:46.297 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.297 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:46.297 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.566511+0000", 2024-04-01T19:53:46.297 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.297 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.297 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.297 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:46.297 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.566511+0000", 2024-04-01T19:53:46.297 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.297 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.297 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.298 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:46.298 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.566513+0000", 2024-04-01T19:53:46.298 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5269999999999999e-06 2024-04-01T19:53:46.298 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.298 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.298 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:46.298 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.566518+0000", 2024-04-01T19:53:46.298 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6590000000000004e-06 2024-04-01T19:53:46.298 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.298 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.298 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:46.298 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.566531+0000", 2024-04-01T19:53:46.298 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2781e-05 2024-04-01T19:53:46.299 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.299 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.299 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:46.299 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.566540+0000", 2024-04-01T19:53:46.299 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8729999999999996e-06 2024-04-01T19:53:46.299 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.299 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.299 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:46.299 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.576003+0000", 2024-04-01T19:53:46.299 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0094632989999999997 2024-04-01T19:53:46.299 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.299 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.299 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:46.300 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.576091+0000", 2024-04-01T19:53:46.300 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8201000000000005e-05 2024-04-01T19:53:46.300 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.300 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.300 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:53:46.300 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.576172+0000", 2024-04-01T19:53:46.300 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0728000000000004e-05 2024-04-01T19:53:46.300 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.300 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.300 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:53:46.300 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.591782+0000", 2024-04-01T19:53:46.300 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015610186 2024-04-01T19:53:46.300 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.300 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.301 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:53:46.301 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.601996+0000", 2024-04-01T19:53:46.301 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010213425 2024-04-01T19:53:46.301 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.301 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.301 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:46.301 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.602049+0000", 2024-04-01T19:53:46.301 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3730000000000002e-05 2024-04-01T19:53:46.301 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.301 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.301 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:46.301 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.602100+0000", 2024-04-01T19:53:46.301 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.011e-05 2024-04-01T19:53:46.301 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.302 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:46.302 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.302 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.302 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.302 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:336030 7.a 7:5f6845dc:::benchmark_data_smithi188_147022_object166386:head [delete] snapc 0=[] ondisk+write+known_if_redirected e624)", 2024-04-01T19:53:46.302 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:33.566553+0000", 2024-04-01T19:53:46.302 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 12.641237052999999, 2024-04-01T19:53:46.302 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035658827999999997, 2024-04-01T19:53:46.302 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:46.302 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:46.302 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:46.302 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:53:46.302 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:53:46.303 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:53:46.303 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 336030 2024-04-01T19:53:46.303 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.303 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:46.303 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.303 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:46.303 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.566553+0000", 2024-04-01T19:53:46.303 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.303 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.303 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.303 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:46.303 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.566553+0000", 2024-04-01T19:53:46.303 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.304 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.304 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.304 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:46.304 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.566554+0000", 2024-04-01T19:53:46.304 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5000000000000002e-07 2024-04-01T19:53:46.304 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.304 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.304 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:46.304 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.566557+0000", 2024-04-01T19:53:46.304 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.399e-06 2024-04-01T19:53:46.304 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.304 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.304 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:46.305 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.566563+0000", 2024-04-01T19:53:46.305 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6949999999999997e-06 2024-04-01T19:53:46.305 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.305 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.305 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:46.305 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.566568+0000", 2024-04-01T19:53:46.305 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1189999999999996e-06 2024-04-01T19:53:46.305 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.305 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.305 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:46.305 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.579877+0000", 2024-04-01T19:53:46.305 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.01330947 2024-04-01T19:53:46.305 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.305 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.306 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:46.306 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.579993+0000", 2024-04-01T19:53:46.306 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000115287 2024-04-01T19:53:46.306 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.306 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.306 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:53:46.306 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.580122+0000", 2024-04-01T19:53:46.306 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012956799999999999 2024-04-01T19:53:46.306 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.306 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.306 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:53:46.306 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.592111+0000", 2024-04-01T19:53:46.306 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011989079999999999 2024-04-01T19:53:46.307 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.307 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.307 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:53:46.307 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.602135+0000", 2024-04-01T19:53:46.307 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010023261 2024-04-01T19:53:46.307 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.307 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.307 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:46.307 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.602178+0000", 2024-04-01T19:53:46.307 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3668999999999998e-05 2024-04-01T19:53:46.307 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.307 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.307 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:46.307 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.602212+0000", 2024-04-01T19:53:46.308 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3630000000000002e-05 2024-04-01T19:53:46.308 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.308 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:46.308 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.308 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.308 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.308 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:336033 7.a 7:58b86353:::benchmark_data_smithi188_147022_object166389:head [delete] snapc 0=[] ondisk+write+known_if_redirected e624)", 2024-04-01T19:53:46.308 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:33.568423+0000", 2024-04-01T19:53:46.308 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 12.639367678999999, 2024-04-01T19:53:46.308 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033899635999999997, 2024-04-01T19:53:46.308 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:46.308 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:46.308 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:46.308 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:53:46.309 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:53:46.309 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:53:46.309 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 336033 2024-04-01T19:53:46.309 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.309 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:46.309 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.309 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:46.309 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.568423+0000", 2024-04-01T19:53:46.309 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.309 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.309 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.309 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:46.309 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.568423+0000", 2024-04-01T19:53:46.309 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.310 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.310 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.310 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:46.310 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.568424+0000", 2024-04-01T19:53:46.310 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2929999999999999e-06 2024-04-01T19:53:46.310 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.310 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.310 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:46.310 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.568429+0000", 2024-04-01T19:53:46.310 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8470000000000003e-06 2024-04-01T19:53:46.311 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.311 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.311 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:46.311 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.568438+0000", 2024-04-01T19:53:46.311 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.6150000000000003e-06 2024-04-01T19:53:46.311 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.311 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.311 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:46.311 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.568446+0000", 2024-04-01T19:53:46.311 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2409999999999998e-06 2024-04-01T19:53:46.311 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.311 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.311 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:46.311 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.583726+0000", 2024-04-01T19:53:46.312 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015280464000000001 2024-04-01T19:53:46.312 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.312 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.312 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:46.312 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.583828+0000", 2024-04-01T19:53:46.312 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010169400000000001 2024-04-01T19:53:46.312 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.312 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.312 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:53:46.312 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.583904+0000", 2024-04-01T19:53:46.312 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6283000000000001e-05 2024-04-01T19:53:46.312 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.312 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.312 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:53:46.312 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.592119+0000", 2024-04-01T19:53:46.313 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082154749999999999 2024-04-01T19:53:46.313 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.313 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.313 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:53:46.313 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.602244+0000", 2024-04-01T19:53:46.313 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010124174 2024-04-01T19:53:46.313 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.313 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.313 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:46.313 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.602289+0000", 2024-04-01T19:53:46.313 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5389999999999997e-05 2024-04-01T19:53:46.313 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.313 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.313 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:46.313 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.602322+0000", 2024-04-01T19:53:46.314 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3160000000000001e-05 2024-04-01T19:53:46.314 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.314 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:46.314 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.314 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.314 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.314 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:336455 7.a 7:5e94d338:::benchmark_data_smithi188_147022_object166811:head [delete] snapc 0=[] ondisk+write+known_if_redirected e624)", 2024-04-01T19:53:46.314 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:33.955655+0000", 2024-04-01T19:53:46.314 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 12.252135142, 2024-04-01T19:53:46.314 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041341637000000001, 2024-04-01T19:53:46.314 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:46.314 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:46.314 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:46.315 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:53:46.315 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:53:46.315 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:53:46.315 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 336455 2024-04-01T19:53:46.315 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.315 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:46.315 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.315 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:46.315 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.955655+0000", 2024-04-01T19:53:46.315 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.315 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.315 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.315 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:46.315 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.955655+0000", 2024-04-01T19:53:46.316 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.316 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.316 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.316 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:46.316 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.955656+0000", 2024-04-01T19:53:46.316 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.009e-06 2024-04-01T19:53:46.316 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.316 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.316 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:46.316 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.955660+0000", 2024-04-01T19:53:46.316 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7890000000000001e-06 2024-04-01T19:53:46.316 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.316 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.316 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:46.317 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.955666+0000", 2024-04-01T19:53:46.317 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4400000000000002e-06 2024-04-01T19:53:46.317 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.317 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.317 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:46.317 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.955672+0000", 2024-04-01T19:53:46.317 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4410000000000001e-06 2024-04-01T19:53:46.317 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.317 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.317 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:46.317 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.959629+0000", 2024-04-01T19:53:46.317 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0039575560000000001 2024-04-01T19:53:46.317 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.317 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.318 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:46.318 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.959764+0000", 2024-04-01T19:53:46.318 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000135165 2024-04-01T19:53:46.318 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.318 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.318 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:53:46.318 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.959895+0000", 2024-04-01T19:53:46.318 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013043199999999999 2024-04-01T19:53:46.318 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.318 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.318 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:53:46.318 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.967306+0000", 2024-04-01T19:53:46.318 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074113720000000003 2024-04-01T19:53:46.319 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.319 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.319 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:53:46.319 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.996899+0000", 2024-04-01T19:53:46.319 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029592633 2024-04-01T19:53:46.319 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.319 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.319 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:46.319 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.996951+0000", 2024-04-01T19:53:46.319 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2107000000000001e-05 2024-04-01T19:53:46.319 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.319 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.319 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:46.319 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.996997+0000", 2024-04-01T19:53:46.320 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5692999999999998e-05 2024-04-01T19:53:46.320 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.320 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:46.320 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.320 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.320 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.320 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:336461 7.a 7:5fd86aad:::benchmark_data_smithi188_147022_object166817:head [delete] snapc 0=[] ondisk+write+known_if_redirected e624)", 2024-04-01T19:53:46.320 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:33.957759+0000", 2024-04-01T19:53:46.320 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 12.250030697, 2024-04-01T19:53:46.320 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.039360260000000001, 2024-04-01T19:53:46.320 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:46.320 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:46.320 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:46.320 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:53:46.321 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:53:46.321 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:53:46.321 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 336461 2024-04-01T19:53:46.321 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.321 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:46.321 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.321 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:46.321 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.957759+0000", 2024-04-01T19:53:46.321 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.321 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.321 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.321 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:46.321 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.957759+0000", 2024-04-01T19:53:46.322 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:46.322 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.322 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.322 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:46.322 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.957761+0000", 2024-04-01T19:53:46.322 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3710000000000001e-06 2024-04-01T19:53:46.322 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.322 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.322 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:46.322 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.957766+0000", 2024-04-01T19:53:46.322 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7910000000000004e-06 2024-04-01T19:53:46.322 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.322 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.323 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:46.323 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.957777+0000", 2024-04-01T19:53:46.323 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1446e-05 2024-04-01T19:53:46.323 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.323 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.323 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:46.323 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.957784+0000", 2024-04-01T19:53:46.323 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1450000000000002e-06 2024-04-01T19:53:46.323 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.323 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.323 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:46.323 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.963595+0000", 2024-04-01T19:53:46.323 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0058103139999999996 2024-04-01T19:53:46.323 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.324 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.324 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:46.324 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.963684+0000", 2024-04-01T19:53:46.324 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9913000000000005e-05 2024-04-01T19:53:46.324 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.324 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.324 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:53:46.324 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.963762+0000", 2024-04-01T19:53:46.324 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7662000000000003e-05 2024-04-01T19:53:46.324 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.324 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.324 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:53:46.324 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.967405+0000", 2024-04-01T19:53:46.324 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.003642705 2024-04-01T19:53:46.324 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.325 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.325 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:53:46.325 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.997038+0000", 2024-04-01T19:53:46.325 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029633593 2024-04-01T19:53:46.325 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.325 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.325 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:46.325 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.997083+0000", 2024-04-01T19:53:46.325 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5050999999999999e-05 2024-04-01T19:53:46.325 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:46.325 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:46.325 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:46.325 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.997120+0000", 2024-04-01T19:53:46.325 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6269000000000001e-05 2024-04-01T19:53:46.326 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.326 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:46.326 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.326 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:46.326 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:46.326 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:53:46.327 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:46.327 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:53:46.327 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:53:46.428 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:53:46.462 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:46.484 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:53:46.487 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:46.487 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:53:46.588 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:53:46.621 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:46.642 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:53:46.645 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:46.645 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:53:46.746 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:53:46.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:46 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2770006487' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:53:46.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.775 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:46 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2770006487' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:53:46.775 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.775 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.775 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.775 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.775 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.775 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.775 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.775 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.775 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.778 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:46.799 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:53:46.801 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:46.802 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:53:46.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:46 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2770006487' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:53:46.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:46.885 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:53:46.885 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:53:46.885 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:53:46.885 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:53:46.885 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:53:46.885 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:53:46.886 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:53:46.886 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:53:46.886 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:53:46.886 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:53:46.886 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:53:46.886 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:53:46.886 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:53:46.886 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:53:46.886 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:53:46.886 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:53:46.887 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:53:46.887 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:53:46.887 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:53:46.887 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:53:46.887 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:53:46.887 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:53:46.887 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:53:46.887 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:53:46.902 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:53:46.932 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:46.953 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:53:46.956 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:46.956 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:53:46.997 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_ops_in_flight 2024-04-01T19:53:47.057 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:53:47.089 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:47.277 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:53:47.291 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:53:47.295 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:47.295 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:53:47.396 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:53:47.424 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:47.446 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:53:47.448 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:47.449 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:53:47.550 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:53:47.577 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:47.649 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:53:47.652 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:47.652 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:53:47.753 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:53:47.783 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:47.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:53:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:47 smithi188 ceph-mon[43939]: pgmap v1735: 1 pgs: 1 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:53:48.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:48.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:48.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:48.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:53:48.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:47 smithi062 ceph-mon[44211]: pgmap v1735: 1 pgs: 1 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:53:48.108 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:48.108 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:48.108 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:48.109 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:53:48.109 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:47 smithi022 ceph-mon[39439]: pgmap v1735: 1 pgs: 1 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:53:48.133 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:53:48.138 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:48.138 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:53:48.152 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:53:48.156 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:53:48.240 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:53:48.270 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:48.700 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.5 to 1 (10000) 2024-04-01T19:53:48.919 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:53:48.921 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:48 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/260625299' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T19:53:48.921 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:48 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:53:48.921 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:48 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:53:48.922 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:48.922 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:53:49.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:48 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/260625299' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T19:53:49.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:48 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:53:49.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:48 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:53:49.023 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:53:49.051 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:49.070 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:53:49.073 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:49.074 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:53:49.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:48 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/260625299' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T19:53:49.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:48 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:53:49.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:48 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:53:49.174 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:53:49.204 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:53:49.204 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:53:49.204 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-01T19:53:49.204 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:53:49.205 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:49.225 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:53:49.228 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:49.228 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:53:49.329 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:53:49.357 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:49.454 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:53:49.457 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:49.457 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:53:49.558 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:53:49.585 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:49.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:49 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/260625299' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-04-01T19:53:49.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:49 smithi188 ceph-mon[43939]: osdmap e628: 12 total, 12 up, 11 in 2024-04-01T19:53:49.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:49 smithi188 ceph-mon[43939]: pgmap v1737: 1 pgs: 1 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:53:49.911 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_blocked_ops 2024-04-01T19:53:49.989 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:49 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/260625299' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-04-01T19:53:49.989 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:49 smithi022 ceph-mon[39439]: osdmap e628: 12 total, 12 up, 11 in 2024-04-01T19:53:49.989 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:49 smithi022 ceph-mon[39439]: pgmap v1737: 1 pgs: 1 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:53:50.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:49 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/260625299' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-04-01T19:53:50.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:49 smithi062 ceph-mon[44211]: osdmap e628: 12 total, 12 up, 11 in 2024-04-01T19:53:50.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:49 smithi062 ceph-mon[44211]: pgmap v1737: 1 pgs: 1 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:53:50.134 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:53:50.137 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:50.137 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:53:50.149 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:53:50.238 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:53:50.264 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:50.362 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:53:50.364 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:50.365 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:53:50.466 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:53:50.492 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:50.681 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:53:50.690 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:53:50.693 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:50.694 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:53:50.795 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:53:50.830 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:50.851 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:53:50.854 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:50.855 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:53:50.956 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:53:50.982 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:51.120 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 7 1 2024-04-01T19:53:51.715 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:51 smithi188 ceph-mon[43939]: pgmap v1738: 1 pgs: 1 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:53:51.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:51 smithi062 ceph-mon[44211]: pgmap v1738: 1 pgs: 1 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:53:51.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:51 smithi022 ceph-mon[39439]: pgmap v1738: 1 pgs: 1 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:53:51.941 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:53:51.974 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:53:52.260 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:53:52.263 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:52.263 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:53:52.364 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:53:52.398 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:52.447 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'unique_pool_6' created 2024-04-01T19:53:52.450 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:53:52.535 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:52 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/946100804' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_6", "pg_num": 16}]: dispatch 2024-04-01T19:53:52.536 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:52 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3462060117' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:53:52.536 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:52 smithi188 ceph-mon[43939]: from='client.26938 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:53:52.549 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:53:52.563 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:52.563 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:53:52.664 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:53:52.692 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:52.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:52 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/946100804' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_6", "pg_num": 16}]: dispatch 2024-04-01T19:53:52.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:52 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3462060117' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:53:52.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:52 smithi062 ceph-mon[44211]: from='client.26938 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:53:52.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:52 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/946100804' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_6", "pg_num": 16}]: dispatch 2024-04-01T19:53:52.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:52 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3462060117' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:53:52.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:52 smithi022 ceph-mon[39439]: from='client.26938 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:53:53.441 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:53 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:53:53.441 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:53 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:53:53.442 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:53 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:53:53.442 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:53 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/946100804' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_6", "pg_num": 16}]': finished 2024-04-01T19:53:53.442 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:53 smithi022 ceph-mon[39439]: from='client.26938 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:53:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:53 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:53:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:53 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:53:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:53 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:53:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:53 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/946100804' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_6", "pg_num": 16}]': finished 2024-04-01T19:53:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:53 smithi188 ceph-mon[43939]: from='client.26938 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:53:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:53 smithi188 ceph-mon[43939]: osdmap e629: 12 total, 12 up, 11 in 2024-04-01T19:53:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:53 smithi188 ceph-mon[43939]: pgmap v1740: 17 pgs: 16 unknown, 1 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:53:53.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:53 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:53:53.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:53 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:53:53.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:53 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:53:53.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:53 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/946100804' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_6", "pg_num": 16}]': finished 2024-04-01T19:53:53.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:53 smithi062 ceph-mon[44211]: from='client.26938 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:53:53.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:53 smithi062 ceph-mon[44211]: osdmap e629: 12 total, 12 up, 11 in 2024-04-01T19:53:53.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:53 smithi062 ceph-mon[44211]: pgmap v1740: 17 pgs: 16 unknown, 1 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:53:53.790 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:53 smithi022 ceph-mon[39439]: osdmap e629: 12 total, 12 up, 11 in 2024-04-01T19:53:53.791 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:53 smithi022 ceph-mon[39439]: pgmap v1740: 17 pgs: 16 unknown, 1 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:53:54.035 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:53:54.035 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:53:54.036 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-01T19:53:54.036 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-01T19:53:54.036 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:53:54.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:54 smithi188 ceph-mon[43939]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T19:53:54.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:54 smithi188 ceph-mon[43939]: osdmap e630: 12 total, 12 up, 11 in 2024-04-01T19:53:54.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:54 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:53:54.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:54 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:53:54.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:54 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:53:54.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:54 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:53:54.603 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:54 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:53:54.629 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_historic_ops 2024-04-01T19:53:54.642 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:53:54.645 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:54.646 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:53:54.734 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:54 smithi022 ceph-mon[39439]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T19:53:54.734 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:54 smithi022 ceph-mon[39439]: osdmap e630: 12 total, 12 up, 11 in 2024-04-01T19:53:54.734 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:54 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:53:54.734 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:54 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:53:54.735 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:54 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:53:54.735 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:54 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:53:54.735 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:54 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:53:54.746 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:53:54.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:54 smithi062 ceph-mon[44211]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T19:53:54.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:54 smithi062 ceph-mon[44211]: osdmap e630: 12 total, 12 up, 11 in 2024-04-01T19:53:54.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:54 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:53:54.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:54 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:53:54.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:54 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:53:54.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:54 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:53:54.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:54 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:53:54.765 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pool application enable unique_pool_6 rados --yes-i-really-mean-it || true 2024-04-01T19:53:54.779 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:54.801 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:53:54.804 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:54.804 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:53:54.903 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:53:54.905 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:53:54.936 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:54.957 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:53:54.960 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:54.960 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:53:55.061 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:53:55.090 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:55.110 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:53:55.113 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:55.113 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:53:55.214 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:53:55.222 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:53:55.245 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:55.320 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:53:55.323 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:55.323 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:53:55.425 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:53:55.456 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:55.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:55 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T19:53:55.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:55 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T19:53:55.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:55 smithi022 ceph-mon[39439]: osdmap e631: 12 total, 12 up, 11 in 2024-04-01T19:53:55.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:55 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:53:55.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:55 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:53:55.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:55 smithi022 ceph-mon[39439]: pgmap v1743: 17 pgs: 3 active+clean, 1 active+clean+scrubbing, 13 unknown; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:53:55.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:55 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T19:53:55.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:55 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T19:53:55.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:55 smithi062 ceph-mon[44211]: osdmap e631: 12 total, 12 up, 11 in 2024-04-01T19:53:55.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:55 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:53:55.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:55 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:53:55.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:55 smithi062 ceph-mon[44211]: pgmap v1743: 17 pgs: 3 active+clean, 1 active+clean+scrubbing, 13 unknown; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:53:55.862 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:55 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T19:53:55.862 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:55 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T19:53:55.862 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:55 smithi188 ceph-mon[43939]: osdmap e631: 12 total, 12 up, 11 in 2024-04-01T19:53:55.862 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:55 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:53:55.862 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:55 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:53:55.862 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:55 smithi188 ceph-mon[43939]: pgmap v1743: 17 pgs: 3 active+clean, 1 active+clean+scrubbing, 13 unknown; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:53:56.307 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:53:56.312 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:56.312 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:53:56.413 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:53:56.447 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:56.464 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.7 to 1 (10000) 2024-04-01T19:53:56.469 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:53:56.473 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:56.473 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:53:56.574 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:53:56.575 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:56 smithi188 ceph-mon[43939]: osdmap e632: 12 total, 12 up, 11 in 2024-04-01T19:53:56.575 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:56 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:53:56.575 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:56 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:53:56.575 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:56 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1569885607' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T19:53:56.607 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:56.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:56 smithi022 ceph-mon[39439]: osdmap e632: 12 total, 12 up, 11 in 2024-04-01T19:53:56.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:56 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:53:56.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:56 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:53:56.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:56 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1569885607' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T19:53:56.626 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:53:56.629 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:56.630 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:53:56.731 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:53:56.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:56 smithi062 ceph-mon[44211]: osdmap e632: 12 total, 12 up, 11 in 2024-04-01T19:53:56.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:56 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:53:56.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:56 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:53:56.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:56 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1569885607' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T19:53:56.761 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:56.889 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:53:56.889 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:53:56.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:53:56.889 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:53:56.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.889 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:126735 7.e e579/560 7:73d6093d:::benchmark_data_smithi188_147022_object126734:head v 579'7869, mlcod=579'7866)", 2024-04-01T19:53:56.890 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:50:34.781674+0000", 2024-04-01T19:53:56.890 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 202.10861393499999, 2024-04-01T19:53:56.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.021294606000000001, 2024-04-01T19:53:56.890 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:56.890 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:56.890 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:56.890 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:56.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:56.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:34.781674+0000", 2024-04-01T19:53:56.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:56.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:34.781674+0000", 2024-04-01T19:53:56.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:56.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:34.781675+0000", 2024-04-01T19:53:56.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5510000000000001e-06 2024-04-01T19:53:56.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:56.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:34.781732+0000", 2024-04-01T19:53:56.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6536999999999998e-05 2024-04-01T19:53:56.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:56.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:34.781746+0000", 2024-04-01T19:53:56.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4275e-05 2024-04-01T19:53:56.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:56.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:34.781754+0000", 2024-04-01T19:53:56.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.678e-06 2024-04-01T19:53:56.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:56.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:34.781808+0000", 2024-04-01T19:53:56.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3749000000000003e-05 2024-04-01T19:53:56.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:56.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:34.781826+0000", 2024-04-01T19:53:56.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8881000000000001e-05 2024-04-01T19:53:56.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:56.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:34.802916+0000", 2024-04-01T19:53:56.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.021089482 2024-04-01T19:53:56.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.894 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:56.894 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:34.802968+0000", 2024-04-01T19:53:56.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2453000000000001e-05 2024-04-01T19:53:56.894 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.895 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:56.895 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.895 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:159101 7.1 e585/560 7:84cbc983:::benchmark_data_smithi188_147022_object159100:head v 585'10148, mlcod=585'10143)", 2024-04-01T19:53:56.895 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:50:59.814607+0000", 2024-04-01T19:53:56.895 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 177.07568109100001, 2024-04-01T19:53:56.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022839113000000001, 2024-04-01T19:53:56.895 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:56.895 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:56.895 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:56.895 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:56.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:56.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:59.814607+0000", 2024-04-01T19:53:56.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:56.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:59.814607+0000", 2024-04-01T19:53:56.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:56.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:59.814608+0000", 2024-04-01T19:53:56.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3960000000000001e-06 2024-04-01T19:53:56.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.897 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:56.897 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:59.814693+0000", 2024-04-01T19:53:56.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5192999999999996e-05 2024-04-01T19:53:56.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.897 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:56.897 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:59.814705+0000", 2024-04-01T19:53:56.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1765e-05 2024-04-01T19:53:56.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:56.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:59.814714+0000", 2024-04-01T19:53:56.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7099999999999996e-06 2024-04-01T19:53:56.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:56.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:59.817307+0000", 2024-04-01T19:53:56.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002592895 2024-04-01T19:53:56.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:56.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:59.817321+0000", 2024-04-01T19:53:56.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4338999999999999e-05 2024-04-01T19:53:56.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:56.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:59.837364+0000", 2024-04-01T19:53:56.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020043420999999999 2024-04-01T19:53:56.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:56.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:59.837446+0000", 2024-04-01T19:53:56.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1394e-05 2024-04-01T19:53:56.899 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.899 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:56.900 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.900 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:187475 7.e e588/560 7:77cbc52d:::benchmark_data_smithi188_147022_object17831:head v 588'11684, mlcod=588'11681)", 2024-04-01T19:53:56.900 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:51:23.021307+0000", 2024-04-01T19:53:56.900 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 153.86898103999999, 2024-04-01T19:53:56.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020304827000000001, 2024-04-01T19:53:56.900 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:56.900 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:56.900 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:56.900 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:56.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:56.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:23.021307+0000", 2024-04-01T19:53:56.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:56.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:23.021307+0000", 2024-04-01T19:53:56.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:56.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:23.021308+0000", 2024-04-01T19:53:56.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6499999999999998e-07 2024-04-01T19:53:56.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:56.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:23.021313+0000", 2024-04-01T19:53:56.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9460000000000003e-06 2024-04-01T19:53:56.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:56.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:23.021321+0000", 2024-04-01T19:53:56.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9969999999999998e-06 2024-04-01T19:53:56.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:56.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:23.021328+0000", 2024-04-01T19:53:56.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8170000000000001e-06 2024-04-01T19:53:56.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:56.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:23.024613+0000", 2024-04-01T19:53:56.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032851450000000002 2024-04-01T19:53:56.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:56.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:23.024635+0000", 2024-04-01T19:53:56.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1336e-05 2024-04-01T19:53:56.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:56.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:23.041560+0000", 2024-04-01T19:53:56.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016925566 2024-04-01T19:53:56.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:56.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:23.041611+0000", 2024-04-01T19:53:56.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1155000000000001e-05 2024-04-01T19:53:56.904 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.904 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:56.904 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.904 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:192750 7.1 e590/560 7:8936b8ce:::benchmark_data_smithi188_147022_object23106:head v 590'12262, mlcod=590'12259)", 2024-04-01T19:53:56.905 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:51:28.223968+0000", 2024-04-01T19:53:56.905 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 148.666319257, 2024-04-01T19:53:56.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020225792999999999, 2024-04-01T19:53:56.905 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:56.905 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:56.905 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:56.905 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:56.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:56.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:28.223968+0000", 2024-04-01T19:53:56.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:56.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:28.223968+0000", 2024-04-01T19:53:56.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:56.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:28.223970+0000", 2024-04-01T19:53:56.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.195e-06 2024-04-01T19:53:56.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:56.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:28.223976+0000", 2024-04-01T19:53:56.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.545e-06 2024-04-01T19:53:56.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:56.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:28.223987+0000", 2024-04-01T19:53:56.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0691e-05 2024-04-01T19:53:56.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:56.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:28.224001+0000", 2024-04-01T19:53:56.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4081e-05 2024-04-01T19:53:56.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:56.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:28.227960+0000", 2024-04-01T19:53:56.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0039594519999999996 2024-04-01T19:53:56.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:56.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:28.227981+0000", 2024-04-01T19:53:56.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0513000000000002e-05 2024-04-01T19:53:56.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:56.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:28.244161+0000", 2024-04-01T19:53:56.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016179855999999999 2024-04-01T19:53:56.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:56.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:28.244194+0000", 2024-04-01T19:53:56.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3460000000000002e-05 2024-04-01T19:53:56.909 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.909 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:56.909 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.909 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:200991 7.2 e590/560 7:401daf78:::benchmark_data_smithi188_147022_object31347:head v 590'12485, mlcod=590'12481)", 2024-04-01T19:53:56.909 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:51:35.079737+0000", 2024-04-01T19:53:56.909 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 141.810550831, 2024-04-01T19:53:56.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022549322, 2024-04-01T19:53:56.910 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:56.910 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:56.910 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:56.910 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:56.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:56.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.079737+0000", 2024-04-01T19:53:56.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:56.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.079737+0000", 2024-04-01T19:53:56.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:56.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.079738+0000", 2024-04-01T19:53:56.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1599999999999999e-06 2024-04-01T19:53:56.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:56.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.079750+0000", 2024-04-01T19:53:56.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1865000000000001e-05 2024-04-01T19:53:56.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:56.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.079759+0000", 2024-04-01T19:53:56.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3959999999999995e-06 2024-04-01T19:53:56.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:56.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.079766+0000", 2024-04-01T19:53:56.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6470000000000001e-06 2024-04-01T19:53:56.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:56.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.083629+0000", 2024-04-01T19:53:56.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.003863479 2024-04-01T19:53:56.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:56.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.083651+0000", 2024-04-01T19:53:56.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1999999999999999e-05 2024-04-01T19:53:56.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:56.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.102258+0000", 2024-04-01T19:53:56.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018606141 2024-04-01T19:53:56.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:56.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.102286+0000", 2024-04-01T19:53:56.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8634000000000001e-05 2024-04-01T19:53:56.914 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.914 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:56.914 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.914 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:200997 7.2 e590/560 7:43654a6c:::benchmark_data_smithi188_147022_object31353:head v 590'12486, mlcod=590'12481)", 2024-04-01T19:53:56.914 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:51:35.079785+0000", 2024-04-01T19:53:56.914 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 141.81050264500001, 2024-04-01T19:53:56.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022518007, 2024-04-01T19:53:56.914 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:56.914 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:56.914 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:56.914 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:56.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:56.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.079785+0000", 2024-04-01T19:53:56.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:56.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.079785+0000", 2024-04-01T19:53:56.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:56.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.079786+0000", 2024-04-01T19:53:56.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7e-07 2024-04-01T19:53:56.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:56.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.079790+0000", 2024-04-01T19:53:56.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6299999999999997e-06 2024-04-01T19:53:56.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:56.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.079795+0000", 2024-04-01T19:53:56.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7620000000000003e-06 2024-04-01T19:53:56.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:56.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.079799+0000", 2024-04-01T19:53:56.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3030000000000001e-06 2024-04-01T19:53:56.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:56.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.087273+0000", 2024-04-01T19:53:56.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074739159999999997 2024-04-01T19:53:56.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:56.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.087286+0000", 2024-04-01T19:53:56.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2828e-05 2024-04-01T19:53:56.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:56.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.102289+0000", 2024-04-01T19:53:56.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015003012 2024-04-01T19:53:56.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:56.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.102303+0000", 2024-04-01T19:53:56.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4086e-05 2024-04-01T19:53:56.918 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.918 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:56.918 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.918 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:201419 7.e e590/560 7:72ff605e:::benchmark_data_smithi188_147022_object31775:head v 590'12566, mlcod=590'12564)", 2024-04-01T19:53:56.918 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:51:35.416653+0000", 2024-04-01T19:53:56.918 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 141.473634425, 2024-04-01T19:53:56.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.021860816000000002, 2024-04-01T19:53:56.919 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:56.919 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:56.919 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:56.919 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:56.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:56.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.416653+0000", 2024-04-01T19:53:56.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:56.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.416653+0000", 2024-04-01T19:53:56.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:56.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.416655+0000", 2024-04-01T19:53:56.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.423e-06 2024-04-01T19:53:56.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:56.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.416662+0000", 2024-04-01T19:53:56.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.861e-06 2024-04-01T19:53:56.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:56.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.416673+0000", 2024-04-01T19:53:56.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1674e-05 2024-04-01T19:53:56.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:56.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.416681+0000", 2024-04-01T19:53:56.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8949999999999998e-06 2024-04-01T19:53:56.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:56.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.422413+0000", 2024-04-01T19:53:56.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005731725 2024-04-01T19:53:56.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:56.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.422435+0000", 2024-04-01T19:53:56.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2120000000000002e-05 2024-04-01T19:53:56.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:56.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.438469+0000", 2024-04-01T19:53:56.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016034050000000001 2024-04-01T19:53:56.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:56.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:35.438514+0000", 2024-04-01T19:53:56.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5068000000000003e-05 2024-04-01T19:53:56.923 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.923 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:56.923 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.923 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:208510 7.2 e593/560 7:4e2bc860:::benchmark_data_smithi188_147022_object38866:head v 593'12965, mlcod=593'12962)", 2024-04-01T19:53:56.923 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:51:40.970442+0000", 2024-04-01T19:53:56.923 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 135.919845533, 2024-04-01T19:53:56.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023062294000000001, 2024-04-01T19:53:56.923 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:56.923 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:56.923 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:56.923 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:56.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:56.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:40.970442+0000", 2024-04-01T19:53:56.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:56.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:40.970442+0000", 2024-04-01T19:53:56.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:56.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:40.970443+0000", 2024-04-01T19:53:56.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.079e-06 2024-04-01T19:53:56.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:56.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:40.970450+0000", 2024-04-01T19:53:56.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3570000000000003e-06 2024-04-01T19:53:56.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:56.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:40.970459+0000", 2024-04-01T19:53:56.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3619999999999995e-06 2024-04-01T19:53:56.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:56.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:40.970465+0000", 2024-04-01T19:53:56.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7810000000000002e-06 2024-04-01T19:53:56.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:56.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:40.976376+0000", 2024-04-01T19:53:56.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059110090000000001 2024-04-01T19:53:56.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:56.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:40.976393+0000", 2024-04-01T19:53:56.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7728e-05 2024-04-01T19:53:56.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:56.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:40.993468+0000", 2024-04-01T19:53:56.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017074282 2024-04-01T19:53:56.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:56.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:40.993504+0000", 2024-04-01T19:53:56.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6696000000000002e-05 2024-04-01T19:53:56.927 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.927 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:56.927 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.927 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:233682 7.1 e599/560 7:8ac5b615:::benchmark_data_smithi188_147022_object64038:head v 599'14873, mlcod=599'14869)", 2024-04-01T19:53:56.927 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:52:04.798829+0000", 2024-04-01T19:53:56.927 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 112.0914587, 2024-04-01T19:53:56.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022687222999999999, 2024-04-01T19:53:56.928 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:56.928 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:56.928 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:56.928 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:56.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:56.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.798829+0000", 2024-04-01T19:53:56.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:56.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.798829+0000", 2024-04-01T19:53:56.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:56.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.798831+0000", 2024-04-01T19:53:56.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5060000000000001e-06 2024-04-01T19:53:56.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:56.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.798838+0000", 2024-04-01T19:53:56.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8080000000000005e-06 2024-04-01T19:53:56.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:56.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.798851+0000", 2024-04-01T19:53:56.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2568999999999999e-05 2024-04-01T19:53:56.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:56.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.798858+0000", 2024-04-01T19:53:56.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3869999999999997e-06 2024-04-01T19:53:56.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:56.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.800119+0000", 2024-04-01T19:53:56.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012605349999999999 2024-04-01T19:53:56.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:56.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.800138+0000", 2024-04-01T19:53:56.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9238000000000001e-05 2024-04-01T19:53:56.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:56.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.821473+0000", 2024-04-01T19:53:56.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.021335340000000001 2024-04-01T19:53:56.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:56.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.821516+0000", 2024-04-01T19:53:56.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2840000000000003e-05 2024-04-01T19:53:56.931 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.931 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:56.931 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.932 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:238051 7.1 e600/560 7:821e0885:::benchmark_data_smithi188_147022_object68407:head v 600'15134, mlcod=600'15131)", 2024-04-01T19:53:56.932 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:52:08.258366+0000", 2024-04-01T19:53:56.932 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 108.63192123, 2024-04-01T19:53:56.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.021342869, 2024-04-01T19:53:56.932 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:56.932 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:56.932 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:56.932 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:56.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:56.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.258366+0000", 2024-04-01T19:53:56.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:56.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.258366+0000", 2024-04-01T19:53:56.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:56.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.258368+0000", 2024-04-01T19:53:56.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7260000000000001e-06 2024-04-01T19:53:56.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:56.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.258376+0000", 2024-04-01T19:53:56.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8839999999999994e-06 2024-04-01T19:53:56.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:56.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.258387+0000", 2024-04-01T19:53:56.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1083e-05 2024-04-01T19:53:56.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:56.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.258394+0000", 2024-04-01T19:53:56.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9999999999999999e-06 2024-04-01T19:53:56.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:56.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.258445+0000", 2024-04-01T19:53:56.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1230999999999998e-05 2024-04-01T19:53:56.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:56.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.258465+0000", 2024-04-01T19:53:56.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9945e-05 2024-04-01T19:53:56.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:56.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.279670+0000", 2024-04-01T19:53:56.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.021204922000000001 2024-04-01T19:53:56.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:56.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.279709+0000", 2024-04-01T19:53:56.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9078000000000001e-05 2024-04-01T19:53:56.936 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.936 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:56.936 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.936 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:238052 7.1 e600/560 7:86380b42:::benchmark_data_smithi188_147022_object68408:head v 600'15135, mlcod=600'15131)", 2024-04-01T19:53:56.936 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:52:08.258555+0000", 2024-04-01T19:53:56.936 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 108.631732254, 2024-04-01T19:53:56.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.021185418000000001, 2024-04-01T19:53:56.936 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:56.936 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:56.936 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:56.937 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:56.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:56.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.258555+0000", 2024-04-01T19:53:56.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:56.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.258555+0000", 2024-04-01T19:53:56.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:56.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.258556+0000", 2024-04-01T19:53:56.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1600000000000001e-07 2024-04-01T19:53:56.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:56.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.258561+0000", 2024-04-01T19:53:56.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9309999999999999e-06 2024-04-01T19:53:56.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:56.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.258569+0000", 2024-04-01T19:53:56.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0879999999999995e-06 2024-04-01T19:53:56.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:56.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.258575+0000", 2024-04-01T19:53:56.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7950000000000004e-06 2024-04-01T19:53:56.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:56.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.263071+0000", 2024-04-01T19:53:56.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0044963349999999997 2024-04-01T19:53:56.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:56.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.263093+0000", 2024-04-01T19:53:56.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1841999999999999e-05 2024-04-01T19:53:56.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:56.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.279714+0000", 2024-04-01T19:53:56.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016621107 2024-04-01T19:53:56.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:56.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.279741+0000", 2024-04-01T19:53:56.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6604000000000001e-05 2024-04-01T19:53:56.940 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.940 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:56.940 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.941 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:238063 7.1 e600/560 7:80452357:::benchmark_data_smithi188_147022_object68419:head v 600'15137, mlcod=600'15132)", 2024-04-01T19:53:56.941 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:52:08.265159+0000", 2024-04-01T19:53:56.941 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 108.625128813, 2024-04-01T19:53:56.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020963481999999999, 2024-04-01T19:53:56.941 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:56.941 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:56.941 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:56.941 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:56.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:56.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.265159+0000", 2024-04-01T19:53:56.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:56.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.265159+0000", 2024-04-01T19:53:56.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:56.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.265160+0000", 2024-04-01T19:53:56.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3200000000000001e-06 2024-04-01T19:53:56.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:56.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.265168+0000", 2024-04-01T19:53:56.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8609999999999998e-06 2024-04-01T19:53:56.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:56.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.265181+0000", 2024-04-01T19:53:56.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3040999999999999e-05 2024-04-01T19:53:56.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:56.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.265189+0000", 2024-04-01T19:53:56.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.481e-06 2024-04-01T19:53:56.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:56.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.270303+0000", 2024-04-01T19:53:56.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005114398 2024-04-01T19:53:56.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:56.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.270321+0000", 2024-04-01T19:53:56.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8479e-05 2024-04-01T19:53:56.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:56.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.286089+0000", 2024-04-01T19:53:56.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015767599 2024-04-01T19:53:56.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:56.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:08.286122+0000", 2024-04-01T19:53:56.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3303000000000003e-05 2024-04-01T19:53:56.945 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.945 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:56.945 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.945 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:264686 7.2 e604/560 7:4a5b0913:::benchmark_data_smithi188_147022_object95042:head v 604'16516, mlcod=604'16513)", 2024-04-01T19:53:56.945 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:52:30.161128+0000", 2024-04-01T19:53:56.945 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 86.729160074000006, 2024-04-01T19:53:56.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.025840801, 2024-04-01T19:53:56.945 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:56.945 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:56.945 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:56.945 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:56.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:56.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.161128+0000", 2024-04-01T19:53:56.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:56.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.161128+0000", 2024-04-01T19:53:56.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:56.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.161128+0000", 2024-04-01T19:53:56.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2399999999999997e-07 2024-04-01T19:53:56.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:56.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.161133+0000", 2024-04-01T19:53:56.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7180000000000004e-06 2024-04-01T19:53:56.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:56.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.161139+0000", 2024-04-01T19:53:56.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3489999999999997e-06 2024-04-01T19:53:56.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:56.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.161145+0000", 2024-04-01T19:53:56.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1479999999999997e-06 2024-04-01T19:53:56.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:56.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.164860+0000", 2024-04-01T19:53:56.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00371588 2024-04-01T19:53:56.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:56.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.164879+0000", 2024-04-01T19:53:56.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8298999999999999e-05 2024-04-01T19:53:56.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:56.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.186924+0000", 2024-04-01T19:53:56.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022045492 2024-04-01T19:53:56.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:56.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.186968+0000", 2024-04-01T19:53:56.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4190999999999998e-05 2024-04-01T19:53:56.949 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.949 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:56.949 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.950 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:264691 7.2 e604/560 7:4a704d17:::benchmark_data_smithi188_147022_object95047:head v 604'16517, mlcod=604'16513)", 2024-04-01T19:53:56.950 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:52:30.164311+0000", 2024-04-01T19:53:56.950 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 86.725976244999998, 2024-04-01T19:53:56.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022686232000000001, 2024-04-01T19:53:56.950 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:56.950 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:56.950 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:56.950 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:56.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:56.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.164311+0000", 2024-04-01T19:53:56.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:56.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.164311+0000", 2024-04-01T19:53:56.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:56.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.164313+0000", 2024-04-01T19:53:56.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1489999999999999e-06 2024-04-01T19:53:56.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:56.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.164320+0000", 2024-04-01T19:53:56.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9380000000000003e-06 2024-04-01T19:53:56.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:56.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.164331+0000", 2024-04-01T19:53:56.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.102e-05 2024-04-01T19:53:56.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:56.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.164338+0000", 2024-04-01T19:53:56.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3239999999999997e-06 2024-04-01T19:53:56.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:56.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.168489+0000", 2024-04-01T19:53:56.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0041510200000000001 2024-04-01T19:53:56.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:56.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.168503+0000", 2024-04-01T19:53:56.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4316e-05 2024-04-01T19:53:56.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:56.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.186973+0000", 2024-04-01T19:53:56.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018469777 2024-04-01T19:53:56.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:56.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.186998+0000", 2024-04-01T19:53:56.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4688000000000001e-05 2024-04-01T19:53:56.954 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.954 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:56.954 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.954 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:265526 7.e e604/560 7:7e6037d6:::benchmark_data_smithi188_147022_object95882:head v 604'16582, mlcod=604'16579)", 2024-04-01T19:53:56.954 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:52:30.857552+0000", 2024-04-01T19:53:56.954 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 86.032735927999994, 2024-04-01T19:53:56.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020963973, 2024-04-01T19:53:56.955 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:56.955 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:56.955 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:56.955 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:56.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:56.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.857552+0000", 2024-04-01T19:53:56.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:56.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.857552+0000", 2024-04-01T19:53:56.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:56.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.857553+0000", 2024-04-01T19:53:56.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4529999999999999e-06 2024-04-01T19:53:56.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:56.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.857561+0000", 2024-04-01T19:53:56.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-01T19:53:56.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:56.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.857569+0000", 2024-04-01T19:53:56.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5029999999999997e-06 2024-04-01T19:53:56.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:56.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.857576+0000", 2024-04-01T19:53:56.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7560000000000002e-06 2024-04-01T19:53:56.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:56.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.861658+0000", 2024-04-01T19:53:56.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040822920000000004 2024-04-01T19:53:56.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:56.958 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.861678+0000", 2024-04-01T19:53:56.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9449e-05 2024-04-01T19:53:56.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:56.958 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.878485+0000", 2024-04-01T19:53:56.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016807512 2024-04-01T19:53:56.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:56.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.878516+0000", 2024-04-01T19:53:56.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0442000000000001e-05 2024-04-01T19:53:56.959 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.959 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:56.959 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.959 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:265530 7.e e604/560 7:703ad4f0:::benchmark_data_smithi188_147022_object95886:head v 604'16585, mlcod=604'16579)", 2024-04-01T19:53:56.959 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:52:30.869510+0000", 2024-04-01T19:53:56.959 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 86.020777679000005, 2024-04-01T19:53:56.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.024473154, 2024-04-01T19:53:56.960 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:56.960 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:56.960 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:56.960 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:56.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:56.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.869510+0000", 2024-04-01T19:53:56.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:56.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.869510+0000", 2024-04-01T19:53:56.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:56.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.869512+0000", 2024-04-01T19:53:56.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.72e-06 2024-04-01T19:53:56.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:56.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.869520+0000", 2024-04-01T19:53:56.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0090000000000007e-06 2024-04-01T19:53:56.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:56.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.869530+0000", 2024-04-01T19:53:56.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0261999999999999e-05 2024-04-01T19:53:56.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:56.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.869537+0000", 2024-04-01T19:53:56.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.328e-06 2024-04-01T19:53:56.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:56.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.873966+0000", 2024-04-01T19:53:56.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0044289960000000001 2024-04-01T19:53:56.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:56.963 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.873985+0000", 2024-04-01T19:53:56.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8652999999999999e-05 2024-04-01T19:53:56.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.963 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:56.963 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.893940+0000", 2024-04-01T19:53:56.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019955377 2024-04-01T19:53:56.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.963 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:56.963 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.893983+0000", 2024-04-01T19:53:56.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2809000000000003e-05 2024-04-01T19:53:56.963 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.964 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:56.964 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.964 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:265536 7.e e604/560 7:740a6d1c:::benchmark_data_smithi188_147022_object95892:head v 604'16586, mlcod=604'16579)", 2024-04-01T19:53:56.964 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:52:30.873627+0000", 2024-04-01T19:53:56.964 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 86.016660856000001, 2024-04-01T19:53:56.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020390417000000001, 2024-04-01T19:53:56.964 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:56.964 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:56.964 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:56.964 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:56.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:56.965 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.873627+0000", 2024-04-01T19:53:56.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.965 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:56.965 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.873627+0000", 2024-04-01T19:53:56.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.965 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:56.965 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.873629+0000", 2024-04-01T19:53:56.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4279999999999999e-06 2024-04-01T19:53:56.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:56.966 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.873639+0000", 2024-04-01T19:53:56.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.6949999999999995e-06 2024-04-01T19:53:56.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.966 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:56.966 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.873651+0000", 2024-04-01T19:53:56.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2194e-05 2024-04-01T19:53:56.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.966 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:56.966 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.873659+0000", 2024-04-01T19:53:56.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1450000000000008e-06 2024-04-01T19:53:56.967 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.967 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:56.967 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.879925+0000", 2024-04-01T19:53:56.967 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062657140000000004 2024-04-01T19:53:56.967 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.967 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:56.967 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.879946+0000", 2024-04-01T19:53:56.967 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0707999999999999e-05 2024-04-01T19:53:56.967 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.967 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:56.967 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.893991+0000", 2024-04-01T19:53:56.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014045749999999999 2024-04-01T19:53:56.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.968 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:56.968 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.894017+0000", 2024-04-01T19:53:56.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5783e-05 2024-04-01T19:53:56.968 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.968 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:56.968 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.968 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:275944 7.1 e605/560 7:8aaad644:::benchmark_data_smithi188_147022_object106300:head v 605'17529, mlcod=605'17527)", 2024-04-01T19:53:56.968 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:52:39.515047+0000", 2024-04-01T19:53:56.968 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 77.375240938000005, 2024-04-01T19:53:56.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020287224999999999, 2024-04-01T19:53:56.969 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:56.969 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:56.969 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:56.969 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:56.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.969 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:56.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:39.515047+0000", 2024-04-01T19:53:56.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.969 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:56.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:39.515047+0000", 2024-04-01T19:53:56.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:56.970 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:39.515048+0000", 2024-04-01T19:53:56.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.367e-06 2024-04-01T19:53:56.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:56.970 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:39.515055+0000", 2024-04-01T19:53:56.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.832e-06 2024-04-01T19:53:56.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:56.971 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:39.515065+0000", 2024-04-01T19:53:56.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.6870000000000006e-06 2024-04-01T19:53:56.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.971 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:56.971 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:39.515072+0000", 2024-04-01T19:53:56.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.537e-06 2024-04-01T19:53:56.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.971 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:56.971 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:39.515127+0000", 2024-04-01T19:53:56.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4755e-05 2024-04-01T19:53:56.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:56.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:39.515146+0000", 2024-04-01T19:53:56.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9437e-05 2024-04-01T19:53:56.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.972 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:56.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:39.535284+0000", 2024-04-01T19:53:56.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020137842999999999 2024-04-01T19:53:56.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.972 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:56.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:39.535334+0000", 2024-04-01T19:53:56.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9767e-05 2024-04-01T19:53:56.972 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.973 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:56.973 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.973 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.973 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.973 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:306405 7.1 e615/611 7:8512c7da:::benchmark_data_smithi188_147022_object136761:head v 615'19442, mlcod=615'19440)", 2024-04-01T19:53:56.973 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:07.361933+0000", 2024-04-01T19:53:56.973 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 49.528354202999999, 2024-04-01T19:53:56.973 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020159367000000001, 2024-04-01T19:53:56.973 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:56.973 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:56.973 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:56.973 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:56.973 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.973 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:56.974 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:07.361933+0000", 2024-04-01T19:53:56.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.974 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.974 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.974 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:56.974 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:07.361933+0000", 2024-04-01T19:53:56.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.974 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.974 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.974 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:56.974 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:07.361935+0000", 2024-04-01T19:53:56.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.136e-06 2024-04-01T19:53:56.974 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.975 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.975 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:56.975 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:07.361940+0000", 2024-04-01T19:53:56.975 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5639999999999996e-06 2024-04-01T19:53:56.975 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.975 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.975 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:56.975 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:07.361949+0000", 2024-04-01T19:53:56.975 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4440000000000008e-06 2024-04-01T19:53:56.975 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.975 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.975 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:56.975 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:07.361956+0000", 2024-04-01T19:53:56.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1289999999999998e-06 2024-04-01T19:53:56.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.976 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:56.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:07.364887+0000", 2024-04-01T19:53:56.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0029312240000000001 2024-04-01T19:53:56.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.976 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:56.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:07.364920+0000", 2024-04-01T19:53:56.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2916999999999997e-05 2024-04-01T19:53:56.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:56.977 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:07.382051+0000", 2024-04-01T19:53:56.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017130889999999999 2024-04-01T19:53:56.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:56.977 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:07.382093+0000", 2024-04-01T19:53:56.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2063e-05 2024-04-01T19:53:56.977 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.977 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:56.977 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.977 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:336202 7.e e624/560 7:702a381a:::benchmark_data_smithi188_147022_object166558:head v 624'21017, mlcod=624'21013)", 2024-04-01T19:53:56.978 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:33.720704+0000", 2024-04-01T19:53:56.978 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 23.169583635999999, 2024-04-01T19:53:56.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020138583000000002, 2024-04-01T19:53:56.978 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:53:56.978 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:53:56.978 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:53:56.978 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:53:56.978 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.978 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:53:56.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.720704+0000", 2024-04-01T19:53:56.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.978 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.979 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.979 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:53:56.979 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.720704+0000", 2024-04-01T19:53:56.979 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:53:56.979 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.979 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.979 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:53:56.979 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.720706+0000", 2024-04-01T19:53:56.979 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.548e-06 2024-04-01T19:53:56.979 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.979 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.979 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:53:56.979 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.720714+0000", 2024-04-01T19:53:56.979 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3380000000000005e-06 2024-04-01T19:53:56.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:53:56.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.720723+0000", 2024-04-01T19:53:56.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8340000000000005e-06 2024-04-01T19:53:56.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:53:56.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.720730+0000", 2024-04-01T19:53:56.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3150000000000003e-06 2024-04-01T19:53:56.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:53:56.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.722304+0000", 2024-04-01T19:53:56.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001574188 2024-04-01T19:53:56.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:53:56.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.722326+0000", 2024-04-01T19:53:56.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1951e-05 2024-04-01T19:53:56.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:53:56.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.740796+0000", 2024-04-01T19:53:56.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018469401 2024-04-01T19:53:56.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:53:56.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:53:56.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:53:56.982 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.740843+0000", 2024-04-01T19:53:56.982 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7008000000000001e-05 2024-04-01T19:53:56.982 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.982 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:56.982 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.982 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:53:56.982 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:53:56.982 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:53:57.015 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:53:57.029 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:57.030 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:53:57.131 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:53:57.164 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:57.186 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:53:57.188 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:57.189 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:53:57.290 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:53:57.319 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:57.384 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:53:57.417 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 9 1 2024-04-01T19:53:57.419 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:53:57.422 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:57.422 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:53:57.523 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:53:57.557 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:57.579 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:53:57.582 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:57.582 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:53:57.595 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:57 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:53:57.595 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:57 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:53:57.595 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:57 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1569885607' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-04-01T19:53:57.595 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:57 smithi022 ceph-mon[39439]: osdmap e633: 12 total, 12 up, 11 in 2024-04-01T19:53:57.595 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:57 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2619981173' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:53:57.595 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:57.595 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:57 smithi022 ceph-mon[39439]: pgmap v1746: 17 pgs: 16 active+clean, 1 active+clean+scrubbing; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:53:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:57 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:53:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:57 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:53:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:57 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1569885607' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-04-01T19:53:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:57 smithi188 ceph-mon[43939]: osdmap e633: 12 total, 12 up, 11 in 2024-04-01T19:53:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:57 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2619981173' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:53:57.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:57.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:57 smithi188 ceph-mon[43939]: pgmap v1746: 17 pgs: 16 active+clean, 1 active+clean+scrubbing; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:53:57.683 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:53:57.710 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_ops_in_flight 2024-04-01T19:53:57.712 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:57.753 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:53:57.753 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:53:57.753 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:53:57.753 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:53:57.753 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:53:57.754 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:53:57.754 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:53:57.754 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:53:57.754 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:53:57.754 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:53:57.754 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:53:57.754 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:53:57.754 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:53:57.754 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:53:57.754 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:53:57.754 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:53:57.755 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:53:57.755 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:53:57.755 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:53:57.755 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:53:57.755 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:53:57.755 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:53:57.755 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:53:57.755 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:53:57.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:57 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:53:57.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:57 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:53:57.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:57 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1569885607' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-04-01T19:53:57.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:57 smithi062 ceph-mon[44211]: osdmap e633: 12 total, 12 up, 11 in 2024-04-01T19:53:57.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:57 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2619981173' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:53:57.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:57.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:57 smithi062 ceph-mon[44211]: pgmap v1746: 17 pgs: 16 active+clean, 1 active+clean+scrubbing; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:53:57.970 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:53:57.977 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:53:58.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.779 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.779 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.779 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.779 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.779 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.779 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.779 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.779 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.780 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:58.780 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:53:59.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:53:59 smithi188 ceph-mon[43939]: pgmap v1747: 17 pgs: 17 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:53:59.721 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:53:59 smithi022 ceph-mon[39439]: pgmap v1747: 17 pgs: 17 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:53:59.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:53:59 smithi062 ceph-mon[44211]: pgmap v1747: 17 pgs: 17 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:53:59.766 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:53:59.770 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:59.770 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:53:59.871 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:53:59.908 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:53:59.930 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:53:59.933 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:53:59.934 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:53:59.969 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:53:59.969 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:54:00.005 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:54:00.035 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:54:00.065 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:00.263 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:54:00.267 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:00.267 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:54:00.368 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:54:00.396 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:00.547 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:54:00.794 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_blocked_ops 2024-04-01T19:54:00.844 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:54:00.847 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:00.847 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:54:00.948 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:54:00.978 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:01.078 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:54:01.081 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:01.082 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:54:01.090 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:54:01.183 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:54:01.216 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:01.238 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:54:01.241 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:01.242 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:54:01.343 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:54:01.370 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:01.391 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:54:01.394 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:01.394 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:54:01.495 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:54:01.525 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:02.176 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:54:02.179 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:02.180 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:54:02.202 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:54:02.280 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:54:02.310 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:02.390 INFO:teuthology.orchestra.run.smithi022.stderr:enabled application 'rados' on pool 'unique_pool_6' 2024-04-01T19:54:02.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:02 smithi022 ceph-mon[39439]: pgmap v1748: 17 pgs: 17 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:54:02.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:02 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3806939037' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_6", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:54:02.659 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:54:02.662 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:02.663 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:54:02.735 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:02 smithi188 ceph-mon[43939]: pgmap v1748: 17 pgs: 17 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:54:02.735 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:02 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3806939037' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_6", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:54:02.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:02 smithi062 ceph-mon[44211]: pgmap v1748: 17 pgs: 17 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:54:02.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:02 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3806939037' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_6", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:54:02.763 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:54:02.793 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:02.992 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:54:02.994 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:02.995 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:54:03.017 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:54:03.017 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:54:03.096 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:54:03.130 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:03.486 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:54:03.489 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:03.489 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:54:03.589 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:54:03.619 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:03.668 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:03 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3806939037' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_6", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:54:03.668 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:03 smithi188 ceph-mon[43939]: osdmap e634: 12 total, 12 up, 11 in 2024-04-01T19:54:03.695 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_historic_ops 2024-04-01T19:54:03.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:03 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3806939037' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_6", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:54:03.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:03 smithi062 ceph-mon[44211]: osdmap e634: 12 total, 12 up, 11 in 2024-04-01T19:54:03.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:03 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3806939037' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_6", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:54:03.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:03 smithi022 ceph-mon[39439]: osdmap e634: 12 total, 12 up, 11 in 2024-04-01T19:54:03.970 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:54:03.973 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:03.973 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:54:03.995 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:54:04.074 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:54:04.103 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:04.252 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:54:04.255 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:04.255 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:54:04.356 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:54:04.384 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:04.403 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:54:04.485 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:54:04.487 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:04 smithi188 ceph-mon[43939]: pgmap v1750: 17 pgs: 17 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:54:04.487 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:04 smithi188 ceph-mon[43939]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T19:54:04.487 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:04 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1388314551' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:54:04.488 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:04.488 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:54:04.528 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:54:04.548 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:54:04.566 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:54:04.585 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:54:04.589 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:54:04.605 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:54:04.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:04 smithi022 ceph-mon[39439]: pgmap v1750: 17 pgs: 17 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:54:04.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:04 smithi022 ceph-mon[39439]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T19:54:04.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:04 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1388314551' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:54:04.615 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:04.625 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:54:04.646 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:54:04.666 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:54:04.686 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:54:04.705 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:54:04.730 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:54:04.751 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:54:04.752 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:54:04.752 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:54:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:54:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:54:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:54:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:54:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:54:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:54:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:54:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:54:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:54:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:54:04.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:04 smithi062 ceph-mon[44211]: pgmap v1750: 17 pgs: 17 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:54:04.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:04 smithi062 ceph-mon[44211]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T19:54:04.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:04 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1388314551' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:54:04.863 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:54:04.866 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:04.867 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:54:04.968 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:54:04.998 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:05.074 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:54:05.076 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:05.076 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:54:05.178 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:54:05.205 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:05.225 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:54:05.228 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:05.229 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:54:05.330 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:54:05.359 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:05.483 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:54:05.485 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:05.486 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:54:05.523 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:05 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:54:05.523 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:05 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:54:05.523 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:05 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1388314551' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:54:05.523 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:05 smithi188 ceph-mon[43939]: osdmap e635: 12 total, 12 up, 11 in 2024-04-01T19:54:05.523 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:05 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2090811804' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:54:05.523 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:05.523 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:05.523 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:05.523 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:05.524 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:05.524 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:05.524 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:05.524 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:05.587 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:54:05.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:05 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:54:05.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:05 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:54:05.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:05 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1388314551' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:54:05.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:05 smithi022 ceph-mon[39439]: osdmap e635: 12 total, 12 up, 11 in 2024-04-01T19:54:05.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:05 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2090811804' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:54:05.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:05.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:05.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:05.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:05.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:05.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:05.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:05.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:05.621 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:05.642 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:54:05.645 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:05 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:54:05.645 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:05 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:54:05.645 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:05 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1388314551' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:54:05.645 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:05 smithi062 ceph-mon[44211]: osdmap e635: 12 total, 12 up, 11 in 2024-04-01T19:54:05.645 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:05 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2090811804' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:54:05.645 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:05.645 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:05.646 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:05.646 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:05.646 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:05.646 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:05.646 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:05.646 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:05.646 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:05.647 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:54:05.748 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:54:05.776 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:05.855 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:54:05.856 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:54:05.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:54:05.856 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:54:05.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.856 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:154991 7.5 7:a5415130:::benchmark_data_smithi188_147022_object154990:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e585)", 2024-04-01T19:54:05.856 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:50:56.361849+0000", 2024-04-01T19:54:05.856 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 189.46255040899999, 2024-04-01T19:54:05.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033822719000000001, 2024-04-01T19:54:05.856 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:05.856 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:05.856 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:05.856 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:05.856 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:54:05.857 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:54:05.857 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 154991 2024-04-01T19:54:05.857 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.857 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:05.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:05.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.361849+0000", 2024-04-01T19:54:05.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.857 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:05.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.361849+0000", 2024-04-01T19:54:05.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.857 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.858 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:05.858 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.361851+0000", 2024-04-01T19:54:05.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.962e-06 2024-04-01T19:54:05.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.858 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:05.858 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.361901+0000", 2024-04-01T19:54:05.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9929000000000003e-05 2024-04-01T19:54:05.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.858 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:05.858 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.361911+0000", 2024-04-01T19:54:05.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.6690000000000001e-06 2024-04-01T19:54:05.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:05.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.361919+0000", 2024-04-01T19:54:05.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8439999999999998e-06 2024-04-01T19:54:05.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:05.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.366107+0000", 2024-04-01T19:54:05.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0041884590000000003 2024-04-01T19:54:05.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:05.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.366408+0000", 2024-04-01T19:54:05.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030093600000000002 2024-04-01T19:54:05.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.860 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:05.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.366557+0000", 2024-04-01T19:54:05.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014884499999999999 2024-04-01T19:54:05.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.860 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:05.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.375598+0000", 2024-04-01T19:54:05.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0090407100000000004 2024-04-01T19:54:05.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:05.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.395573+0000", 2024-04-01T19:54:05.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019975175000000001 2024-04-01T19:54:05.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:05.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.395625+0000", 2024-04-01T19:54:05.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2580999999999997e-05 2024-04-01T19:54:05.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:05.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.395672+0000", 2024-04-01T19:54:05.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6609e-05 2024-04-01T19:54:05.861 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.861 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:05.861 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.862 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:154996 7.5 7:a60b9be2:::benchmark_data_smithi188_147022_object154995:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e585)", 2024-04-01T19:54:05.862 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:50:56.367238+0000", 2024-04-01T19:54:05.862 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 189.45716145399999, 2024-04-01T19:54:05.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.032324483000000001, 2024-04-01T19:54:05.862 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:05.862 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:05.862 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:05.862 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:05.862 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:54:05.862 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:54:05.862 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 154996 2024-04-01T19:54:05.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.863 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:05.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:05.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.367238+0000", 2024-04-01T19:54:05.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:05.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.367238+0000", 2024-04-01T19:54:05.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:05.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.367240+0000", 2024-04-01T19:54:05.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.813e-06 2024-04-01T19:54:05.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:05.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.367263+0000", 2024-04-01T19:54:05.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2959000000000002e-05 2024-04-01T19:54:05.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:05.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.367277+0000", 2024-04-01T19:54:05.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3837e-05 2024-04-01T19:54:05.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:05.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.367284+0000", 2024-04-01T19:54:05.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3390000000000004e-06 2024-04-01T19:54:05.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:05.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.381388+0000", 2024-04-01T19:54:05.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014103711 2024-04-01T19:54:05.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:05.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.381540+0000", 2024-04-01T19:54:05.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015174599999999999 2024-04-01T19:54:05.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:05.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.381676+0000", 2024-04-01T19:54:05.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013625700000000001 2024-04-01T19:54:05.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:05.866 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.395879+0000", 2024-04-01T19:54:05.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014202862 2024-04-01T19:54:05.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:05.866 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.399470+0000", 2024-04-01T19:54:05.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.003591506 2024-04-01T19:54:05.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:05.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.399532+0000", 2024-04-01T19:54:05.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1512000000000003e-05 2024-04-01T19:54:05.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:05.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:50:56.399563+0000", 2024-04-01T19:54:05.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0941000000000001e-05 2024-04-01T19:54:05.867 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.867 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:05.867 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.867 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:185232 7.5 7:a60d8411:::benchmark_data_smithi188_147022_object15588:head [delete] snapc 0=[] ondisk+write+known_if_redirected e587)", 2024-04-01T19:54:05.867 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:51:21.020147+0000", 2024-04-01T19:54:05.867 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 164.804252357, 2024-04-01T19:54:05.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031155143, 2024-04-01T19:54:05.868 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:05.868 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:05.868 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:05.868 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:05.868 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:54:05.868 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:54:05.868 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 185232 2024-04-01T19:54:05.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.868 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:05.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:05.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.020147+0000", 2024-04-01T19:54:05.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:05.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.020147+0000", 2024-04-01T19:54:05.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:05.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.020148+0000", 2024-04-01T19:54:05.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.16e-07 2024-04-01T19:54:05.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:05.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.020151+0000", 2024-04-01T19:54:05.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3220000000000001e-06 2024-04-01T19:54:05.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:05.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.020158+0000", 2024-04-01T19:54:05.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0779999999999998e-06 2024-04-01T19:54:05.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:05.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.020162+0000", 2024-04-01T19:54:05.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9500000000000003e-06 2024-04-01T19:54:05.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:05.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.029911+0000", 2024-04-01T19:54:05.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0097487310000000001 2024-04-01T19:54:05.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:05.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.030049+0000", 2024-04-01T19:54:05.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000137584 2024-04-01T19:54:05.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:05.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.030178+0000", 2024-04-01T19:54:05.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000129722 2024-04-01T19:54:05.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:05.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.051222+0000", 2024-04-01T19:54:05.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.021043888 2024-04-01T19:54:05.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:05.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.051235+0000", 2024-04-01T19:54:05.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2717999999999999e-05 2024-04-01T19:54:05.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:05.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.051268+0000", 2024-04-01T19:54:05.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2697000000000002e-05 2024-04-01T19:54:05.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:05.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.051302+0000", 2024-04-01T19:54:05.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4637000000000001e-05 2024-04-01T19:54:05.873 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.873 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:05.873 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.873 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:185235 7.5 7:a2c0149e:::benchmark_data_smithi188_147022_object15591:head [delete] snapc 0=[] ondisk+write+known_if_redirected e587)", 2024-04-01T19:54:05.873 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:51:21.021053+0000", 2024-04-01T19:54:05.873 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 164.803346207, 2024-04-01T19:54:05.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.030394945999999999, 2024-04-01T19:54:05.873 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:05.873 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:05.873 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:05.873 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:05.874 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:54:05.874 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:54:05.874 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 185235 2024-04-01T19:54:05.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.874 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:05.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:05.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.021053+0000", 2024-04-01T19:54:05.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:05.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.021053+0000", 2024-04-01T19:54:05.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:05.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.021055+0000", 2024-04-01T19:54:05.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.46e-06 2024-04-01T19:54:05.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:05.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.021060+0000", 2024-04-01T19:54:05.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8450000000000002e-06 2024-04-01T19:54:05.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:05.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.021069+0000", 2024-04-01T19:54:05.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.6600000000000007e-06 2024-04-01T19:54:05.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:05.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.021087+0000", 2024-04-01T19:54:05.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7867e-05 2024-04-01T19:54:05.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:05.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.034538+0000", 2024-04-01T19:54:05.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013450775999999999 2024-04-01T19:54:05.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:05.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.034653+0000", 2024-04-01T19:54:05.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011499500000000001 2024-04-01T19:54:05.877 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.877 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.877 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:05.877 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.034756+0000", 2024-04-01T19:54:05.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010301 2024-04-01T19:54:05.877 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.877 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.877 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:05.877 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.051312+0000", 2024-04-01T19:54:05.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016555534 2024-04-01T19:54:05.877 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.877 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.877 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:05.878 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.051373+0000", 2024-04-01T19:54:05.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1898999999999998e-05 2024-04-01T19:54:05.878 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.878 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.878 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:05.878 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.051411+0000", 2024-04-01T19:54:05.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7715000000000001e-05 2024-04-01T19:54:05.878 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.878 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.878 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:05.878 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:21.051448+0000", 2024-04-01T19:54:05.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7184999999999997e-05 2024-04-01T19:54:05.878 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.878 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:05.879 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.879 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:233226 7.5 7:a0b28ae5:::benchmark_data_smithi188_147022_object63582:head [delete] snapc 0=[] ondisk+write+known_if_redirected e599)", 2024-04-01T19:54:05.879 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:52:04.440967+0000", 2024-04-01T19:54:05.879 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 121.383432822, 2024-04-01T19:54:05.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034168420999999997, 2024-04-01T19:54:05.879 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:05.879 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:05.879 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:05.879 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:05.879 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:54:05.879 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:54:05.879 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 233226 2024-04-01T19:54:05.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.880 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:05.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:05.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.440967+0000", 2024-04-01T19:54:05.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:05.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.440967+0000", 2024-04-01T19:54:05.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:05.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.440969+0000", 2024-04-01T19:54:05.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.903e-06 2024-04-01T19:54:05.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:05.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.440974+0000", 2024-04-01T19:54:05.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2959999999999998e-06 2024-04-01T19:54:05.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:05.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.440984+0000", 2024-04-01T19:54:05.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0441999999999999e-05 2024-04-01T19:54:05.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:05.882 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.440990+0000", 2024-04-01T19:54:05.882 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9819999999999996e-06 2024-04-01T19:54:05.882 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.882 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.882 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:05.882 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.441045+0000", 2024-04-01T19:54:05.882 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4218999999999997e-05 2024-04-01T19:54:05.882 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.882 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.882 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:05.882 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.441178+0000", 2024-04-01T19:54:05.882 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013347599999999999 2024-04-01T19:54:05.882 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:05.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.441290+0000", 2024-04-01T19:54:05.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000111445 2024-04-01T19:54:05.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:05.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.455677+0000", 2024-04-01T19:54:05.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014387713999999999 2024-04-01T19:54:05.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:05.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.475043+0000", 2024-04-01T19:54:05.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019365675999999998 2024-04-01T19:54:05.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:05.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.475091+0000", 2024-04-01T19:54:05.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8021e-05 2024-04-01T19:54:05.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:05.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.475135+0000", 2024-04-01T19:54:05.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4246999999999998e-05 2024-04-01T19:54:05.884 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.884 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:05.884 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.885 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:265666 7.5 7:ab1723d0:::benchmark_data_smithi188_147022_object96022:head [delete] snapc 0=[] ondisk+write+known_if_redirected e604)", 2024-04-01T19:54:05.885 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:52:30.972706+0000", 2024-04-01T19:54:05.885 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 94.851693585999996, 2024-04-01T19:54:05.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.032074248999999999, 2024-04-01T19:54:05.885 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:05.885 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:05.885 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:05.885 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:05.885 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:54:05.885 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:54:05.885 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 265666 2024-04-01T19:54:05.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.886 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:05.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:05.886 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.972706+0000", 2024-04-01T19:54:05.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:05.886 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.972706+0000", 2024-04-01T19:54:05.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:05.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.972707+0000", 2024-04-01T19:54:05.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.471e-06 2024-04-01T19:54:05.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:05.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.972713+0000", 2024-04-01T19:54:05.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1329999999999998e-06 2024-04-01T19:54:05.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:05.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.972724+0000", 2024-04-01T19:54:05.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1188e-05 2024-04-01T19:54:05.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:05.888 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.972732+0000", 2024-04-01T19:54:05.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7379999999999994e-06 2024-04-01T19:54:05.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:05.888 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.976807+0000", 2024-04-01T19:54:05.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040755929999999998 2024-04-01T19:54:05.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:05.888 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.976944+0000", 2024-04-01T19:54:05.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013641099999999999 2024-04-01T19:54:05.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:05.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.977067+0000", 2024-04-01T19:54:05.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000123017 2024-04-01T19:54:05.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:05.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.986353+0000", 2024-04-01T19:54:05.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0092864060000000005 2024-04-01T19:54:05.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:05.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:31.004672+0000", 2024-04-01T19:54:05.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018318950000000001 2024-04-01T19:54:05.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:05.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:31.004726+0000", 2024-04-01T19:54:05.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4392999999999999e-05 2024-04-01T19:54:05.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:05.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:31.004780+0000", 2024-04-01T19:54:05.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3949000000000001e-05 2024-04-01T19:54:05.890 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.890 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:05.890 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.891 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:265668 7.5 7:a423d5b8:::benchmark_data_smithi188_147022_object96024:head [delete] snapc 0=[] ondisk+write+known_if_redirected e604)", 2024-04-01T19:54:05.891 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:52:30.973573+0000", 2024-04-01T19:54:05.891 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 94.850826777999998, 2024-04-01T19:54:05.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031340869, 2024-04-01T19:54:05.891 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:05.891 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:05.891 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:05.891 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:05.891 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:54:05.891 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:54:05.891 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 265668 2024-04-01T19:54:05.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.891 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:05.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:05.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.973573+0000", 2024-04-01T19:54:05.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:05.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.973573+0000", 2024-04-01T19:54:05.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:05.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.973574+0000", 2024-04-01T19:54:05.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.158e-06 2024-04-01T19:54:05.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:05.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.973579+0000", 2024-04-01T19:54:05.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7380000000000002e-06 2024-04-01T19:54:05.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:05.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.973589+0000", 2024-04-01T19:54:05.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0173000000000001e-05 2024-04-01T19:54:05.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:05.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.973604+0000", 2024-04-01T19:54:05.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5608999999999999e-05 2024-04-01T19:54:05.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.894 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:05.894 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.981842+0000", 2024-04-01T19:54:05.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082374270000000003 2024-04-01T19:54:05.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.894 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:05.894 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.981937+0000", 2024-04-01T19:54:05.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5394000000000002e-05 2024-04-01T19:54:05.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:05.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.982016+0000", 2024-04-01T19:54:05.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9076e-05 2024-04-01T19:54:05.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:05.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.991382+0000", 2024-04-01T19:54:05.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0093660050000000002 2024-04-01T19:54:05.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:05.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:31.004823+0000", 2024-04-01T19:54:05.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.01344046 2024-04-01T19:54:05.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:05.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:31.004871+0000", 2024-04-01T19:54:05.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8588000000000003e-05 2024-04-01T19:54:05.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:05.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:31.004914+0000", 2024-04-01T19:54:05.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2240999999999998e-05 2024-04-01T19:54:05.896 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.896 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:05.897 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.897 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:265675 7.5 7:ae6f9cbb:::benchmark_data_smithi188_147022_object96031:head [delete] snapc 0=[] ondisk+write+known_if_redirected e604)", 2024-04-01T19:54:05.897 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:52:30.981073+0000", 2024-04-01T19:54:05.897 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 94.843327024999994, 2024-04-01T19:54:05.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034230641999999999, 2024-04-01T19:54:05.897 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:05.897 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:05.897 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:05.897 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:05.897 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:54:05.897 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:54:05.898 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 265675 2024-04-01T19:54:05.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.898 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:05.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:05.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.981073+0000", 2024-04-01T19:54:05.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:05.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.981073+0000", 2024-04-01T19:54:05.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:05.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.981075+0000", 2024-04-01T19:54:05.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5280000000000002e-06 2024-04-01T19:54:05.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:05.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.981083+0000", 2024-04-01T19:54:05.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1629999999999996e-06 2024-04-01T19:54:05.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:05.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.981098+0000", 2024-04-01T19:54:05.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4960000000000001e-05 2024-04-01T19:54:05.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:05.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.981105+0000", 2024-04-01T19:54:05.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.793e-06 2024-04-01T19:54:05.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:05.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.986386+0000", 2024-04-01T19:54:05.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005281259 2024-04-01T19:54:05.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:05.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.986522+0000", 2024-04-01T19:54:05.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000135494 2024-04-01T19:54:05.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:05.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.986649+0000", 2024-04-01T19:54:05.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012741799999999999 2024-04-01T19:54:05.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:05.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.991543+0000", 2024-04-01T19:54:05.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0048937989999999999 2024-04-01T19:54:05.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:05.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:31.015215+0000", 2024-04-01T19:54:05.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023672456000000001 2024-04-01T19:54:05.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:05.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:31.015249+0000", 2024-04-01T19:54:05.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4029000000000002e-05 2024-04-01T19:54:05.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:05.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:31.015303+0000", 2024-04-01T19:54:05.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3742999999999997e-05 2024-04-01T19:54:05.902 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.902 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:05.902 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.903 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:267091 7.5 7:ac410a6e:::benchmark_data_smithi188_147022_object97447:head [delete] snapc 0=[] ondisk+write+known_if_redirected e605)", 2024-04-01T19:54:05.903 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:52:32.165478+0000", 2024-04-01T19:54:05.903 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 93.658921122999999, 2024-04-01T19:54:05.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040528135, 2024-04-01T19:54:05.903 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:05.903 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:05.903 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:05.903 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:05.903 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:54:05.903 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:54:05.903 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 267091 2024-04-01T19:54:05.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.904 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:05.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:05.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.165478+0000", 2024-04-01T19:54:05.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:05.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.165478+0000", 2024-04-01T19:54:05.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:05.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.165480+0000", 2024-04-01T19:54:05.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3400000000000001e-06 2024-04-01T19:54:05.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:05.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.165485+0000", 2024-04-01T19:54:05.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3249999999999998e-06 2024-04-01T19:54:05.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:05.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.165495+0000", 2024-04-01T19:54:05.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0056e-05 2024-04-01T19:54:05.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:05.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.165503+0000", 2024-04-01T19:54:05.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.909e-06 2024-04-01T19:54:05.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:05.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.178301+0000", 2024-04-01T19:54:05.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012798027999999999 2024-04-01T19:54:05.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:05.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.178423+0000", 2024-04-01T19:54:05.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000122156 2024-04-01T19:54:05.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:05.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.178534+0000", 2024-04-01T19:54:05.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000110404 2024-04-01T19:54:05.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:05.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.187448+0000", 2024-04-01T19:54:05.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0089139679999999995 2024-04-01T19:54:05.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:05.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.205919+0000", 2024-04-01T19:54:05.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018471194999999999 2024-04-01T19:54:05.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:05.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.205965+0000", 2024-04-01T19:54:05.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5708999999999999e-05 2024-04-01T19:54:05.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:05.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.206007+0000", 2024-04-01T19:54:05.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2045000000000001e-05 2024-04-01T19:54:05.908 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.908 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:05.908 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.909 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:267096 7.5 7:a8c0131e:::benchmark_data_smithi188_147022_object97452:head [delete] snapc 0=[] ondisk+write+known_if_redirected e605)", 2024-04-01T19:54:05.909 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:52:32.174477+0000", 2024-04-01T19:54:05.909 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 93.649922282999995, 2024-04-01T19:54:05.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031642926000000002, 2024-04-01T19:54:05.909 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:05.909 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:05.909 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:05.909 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:05.909 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:54:05.909 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:54:05.909 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 267096 2024-04-01T19:54:05.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.909 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:05.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:05.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.174477+0000", 2024-04-01T19:54:05.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:05.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.174477+0000", 2024-04-01T19:54:05.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:05.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.174479+0000", 2024-04-01T19:54:05.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.119e-06 2024-04-01T19:54:05.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:05.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.174486+0000", 2024-04-01T19:54:05.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0650000000000001e-06 2024-04-01T19:54:05.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:05.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.174497+0000", 2024-04-01T19:54:05.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0648999999999999e-05 2024-04-01T19:54:05.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:05.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.174504+0000", 2024-04-01T19:54:05.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6059999999999999e-06 2024-04-01T19:54:05.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:05.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.182864+0000", 2024-04-01T19:54:05.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0083599810000000007 2024-04-01T19:54:05.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:05.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.182967+0000", 2024-04-01T19:54:05.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000103204 2024-04-01T19:54:05.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:05.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.183047+0000", 2024-04-01T19:54:05.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9765000000000006e-05 2024-04-01T19:54:05.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:05.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.187576+0000", 2024-04-01T19:54:05.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0045295639999999998 2024-04-01T19:54:05.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:05.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.206054+0000", 2024-04-01T19:54:05.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018478069 2024-04-01T19:54:05.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:05.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.206093+0000", 2024-04-01T19:54:05.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8825000000000002e-05 2024-04-01T19:54:05.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:05.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:32.206120+0000", 2024-04-01T19:54:05.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7078999999999999e-05 2024-04-01T19:54:05.914 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.914 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:05.915 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.915 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:281382 7.5 7:ac790bf2:::benchmark_data_smithi188_147022_object111738:head [delete] snapc 0=[] ondisk+write+known_if_redirected e606)", 2024-04-01T19:54:05.915 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:52:43.950469+0000", 2024-04-01T19:54:05.915 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 81.873930505000004, 2024-04-01T19:54:05.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031346119999999998, 2024-04-01T19:54:05.915 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:05.915 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:05.915 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:05.915 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:05.915 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:54:05.915 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:54:05.915 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 281382 2024-04-01T19:54:05.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.916 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:05.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:05.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:43.950469+0000", 2024-04-01T19:54:05.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:05.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:43.950469+0000", 2024-04-01T19:54:05.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:05.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:43.950470+0000", 2024-04-01T19:54:05.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3300000000000001e-07 2024-04-01T19:54:05.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:05.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:43.950473+0000", 2024-04-01T19:54:05.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9979999999999999e-06 2024-04-01T19:54:05.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:05.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:43.950482+0000", 2024-04-01T19:54:05.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7180000000000002e-06 2024-04-01T19:54:05.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:05.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:43.950487+0000", 2024-04-01T19:54:05.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5910000000000003e-06 2024-04-01T19:54:05.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:05.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:43.956625+0000", 2024-04-01T19:54:05.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0061376629999999998 2024-04-01T19:54:05.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:05.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:43.956714+0000", 2024-04-01T19:54:05.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8671000000000005e-05 2024-04-01T19:54:05.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:05.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:43.956806+0000", 2024-04-01T19:54:05.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2459000000000004e-05 2024-04-01T19:54:05.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:05.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:43.966622+0000", 2024-04-01T19:54:05.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0098162300000000004 2024-04-01T19:54:05.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:05.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:43.981738+0000", 2024-04-01T19:54:05.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015116015999999999 2024-04-01T19:54:05.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:05.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:43.981778+0000", 2024-04-01T19:54:05.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0194000000000002e-05 2024-04-01T19:54:05.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:05.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:43.981815+0000", 2024-04-01T19:54:05.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6746999999999999e-05 2024-04-01T19:54:05.920 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.920 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:05.920 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.921 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:299309 7.5 7:aa3890d8:::benchmark_data_smithi188_147022_object129665:head [delete] snapc 0=[] ondisk+write+known_if_redirected e612)", 2024-04-01T19:54:05.921 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:01.241648+0000", 2024-04-01T19:54:05.921 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 64.582751271999996, 2024-04-01T19:54:05.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033515975000000003, 2024-04-01T19:54:05.921 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:05.921 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:05.921 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:05.921 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:05.921 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:54:05.921 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:54:05.921 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 299309 2024-04-01T19:54:05.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.921 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:05.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:05.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.241648+0000", 2024-04-01T19:54:05.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:05.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.241648+0000", 2024-04-01T19:54:05.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:05.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.241651+0000", 2024-04-01T19:54:05.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.627e-06 2024-04-01T19:54:05.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:05.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.241658+0000", 2024-04-01T19:54:05.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5360000000000004e-06 2024-04-01T19:54:05.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:05.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.241674+0000", 2024-04-01T19:54:05.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5434000000000002e-05 2024-04-01T19:54:05.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:05.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.241682+0000", 2024-04-01T19:54:05.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1629999999999996e-06 2024-04-01T19:54:05.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:05.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.243432+0000", 2024-04-01T19:54:05.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0017501839999999999 2024-04-01T19:54:05.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:05.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.243534+0000", 2024-04-01T19:54:05.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010207 2024-04-01T19:54:05.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:05.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.243614+0000", 2024-04-01T19:54:05.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9426999999999997e-05 2024-04-01T19:54:05.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:05.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.264486+0000", 2024-04-01T19:54:05.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020872417000000001 2024-04-01T19:54:05.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:05.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.275077+0000", 2024-04-01T19:54:05.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010590952000000001 2024-04-01T19:54:05.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:05.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.275116+0000", 2024-04-01T19:54:05.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.909e-05 2024-04-01T19:54:05.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:05.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.275164+0000", 2024-04-01T19:54:05.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8075000000000003e-05 2024-04-01T19:54:05.926 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.926 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:05.926 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.927 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:299315 7.5 7:a0704a75:::benchmark_data_smithi188_147022_object129671:head [delete] snapc 0=[] ondisk+write+known_if_redirected e612)", 2024-04-01T19:54:05.927 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:01.248012+0000", 2024-04-01T19:54:05.927 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 64.576387672999999, 2024-04-01T19:54:05.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.032747388000000002, 2024-04-01T19:54:05.927 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:05.927 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:05.927 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:05.927 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:05.927 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:54:05.927 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:54:05.927 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 299315 2024-04-01T19:54:05.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.927 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:05.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:05.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.248012+0000", 2024-04-01T19:54:05.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:05.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.248012+0000", 2024-04-01T19:54:05.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:05.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.248013+0000", 2024-04-01T19:54:05.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.415e-06 2024-04-01T19:54:05.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:05.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.248018+0000", 2024-04-01T19:54:05.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.775e-06 2024-04-01T19:54:05.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:05.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.248028+0000", 2024-04-01T19:54:05.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0019e-05 2024-04-01T19:54:05.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:05.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.248036+0000", 2024-04-01T19:54:05.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1130000000000001e-06 2024-04-01T19:54:05.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:05.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.259265+0000", 2024-04-01T19:54:05.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011229253 2024-04-01T19:54:05.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:05.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.259403+0000", 2024-04-01T19:54:05.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000137181 2024-04-01T19:54:05.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:05.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.259537+0000", 2024-04-01T19:54:05.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013396999999999999 2024-04-01T19:54:05.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:05.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.274919+0000", 2024-04-01T19:54:05.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015382269 2024-04-01T19:54:05.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:05.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.280652+0000", 2024-04-01T19:54:05.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0057330150000000002 2024-04-01T19:54:05.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:05.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.280707+0000", 2024-04-01T19:54:05.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5454000000000001e-05 2024-04-01T19:54:05.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:05.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:01.280759+0000", 2024-04-01T19:54:05.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1924e-05 2024-04-01T19:54:05.932 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.932 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:05.932 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.933 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:302325 7.5 7:a6c856c9:::benchmark_data_smithi188_147022_object132681:head [delete] snapc 0=[] ondisk+write+known_if_redirected e613)", 2024-04-01T19:54:05.933 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:03.799520+0000", 2024-04-01T19:54:05.933 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 62.024879208000002, 2024-04-01T19:54:05.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031242703, 2024-04-01T19:54:05.933 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:05.933 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:05.933 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:05.933 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:05.933 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:54:05.933 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:54:05.933 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 302325 2024-04-01T19:54:05.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.933 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:05.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:05.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:03.799520+0000", 2024-04-01T19:54:05.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:05.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:03.799520+0000", 2024-04-01T19:54:05.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:05.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:03.799521+0000", 2024-04-01T19:54:05.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0399999999999995e-07 2024-04-01T19:54:05.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:05.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:03.799524+0000", 2024-04-01T19:54:05.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1439999999999999e-06 2024-04-01T19:54:05.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:05.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:03.799531+0000", 2024-04-01T19:54:05.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0060000000000003e-06 2024-04-01T19:54:05.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:05.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:03.799537+0000", 2024-04-01T19:54:05.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6250000000000004e-06 2024-04-01T19:54:05.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:05.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:03.804750+0000", 2024-04-01T19:54:05.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005213578 2024-04-01T19:54:05.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:05.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:03.804891+0000", 2024-04-01T19:54:05.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014043399999999999 2024-04-01T19:54:05.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:05.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:03.805021+0000", 2024-04-01T19:54:05.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012993400000000001 2024-04-01T19:54:05.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:05.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:03.810543+0000", 2024-04-01T19:54:05.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0055220269999999997 2024-04-01T19:54:05.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:05.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:03.830690+0000", 2024-04-01T19:54:05.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020147387999999999 2024-04-01T19:54:05.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:05.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:03.830729+0000", 2024-04-01T19:54:05.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8794999999999997e-05 2024-04-01T19:54:05.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:05.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:03.830763+0000", 2024-04-01T19:54:05.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4068e-05 2024-04-01T19:54:05.938 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.938 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:05.938 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.939 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:305143 7.5 7:a521d529:::benchmark_data_smithi188_147022_object135499:head [delete] snapc 0=[] ondisk+write+known_if_redirected e615)", 2024-04-01T19:54:05.939 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:06.220243+0000", 2024-04-01T19:54:05.939 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 59.604156379000003, 2024-04-01T19:54:05.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.030133904999999999, 2024-04-01T19:54:05.939 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:05.939 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:05.939 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:05.939 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:05.939 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:54:05.939 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:54:05.939 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 305143 2024-04-01T19:54:05.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.939 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:05.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:05.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:06.220243+0000", 2024-04-01T19:54:05.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:05.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:06.220243+0000", 2024-04-01T19:54:05.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:05.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:06.220245+0000", 2024-04-01T19:54:05.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.409e-06 2024-04-01T19:54:05.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:05.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:06.220250+0000", 2024-04-01T19:54:05.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9690000000000002e-06 2024-04-01T19:54:05.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:05.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:06.220262+0000", 2024-04-01T19:54:05.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2533e-05 2024-04-01T19:54:05.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:05.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:06.220269+0000", 2024-04-01T19:54:05.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0169999999999999e-06 2024-04-01T19:54:05.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:05.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:06.237857+0000", 2024-04-01T19:54:05.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017588073999999999 2024-04-01T19:54:05.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:05.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:06.237969+0000", 2024-04-01T19:54:05.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011181299999999999 2024-04-01T19:54:05.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:05.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:06.238088+0000", 2024-04-01T19:54:05.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000118653 2024-04-01T19:54:05.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:05.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:06.247353+0000", 2024-04-01T19:54:05.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0092650100000000006 2024-04-01T19:54:05.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:05.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:06.250311+0000", 2024-04-01T19:54:05.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0029580800000000001 2024-04-01T19:54:05.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:05.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:06.250346+0000", 2024-04-01T19:54:05.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5147000000000001e-05 2024-04-01T19:54:05.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:05.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:06.250377+0000", 2024-04-01T19:54:05.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1199999999999999e-05 2024-04-01T19:54:05.944 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.944 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:05.944 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.945 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:311061 7.5 7:afeb42f0:::benchmark_data_smithi188_147022_object141417:head [delete] snapc 0=[] ondisk+write+known_if_redirected e615)", 2024-04-01T19:54:05.945 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:11.561584+0000", 2024-04-01T19:54:05.945 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 54.262815785000001, 2024-04-01T19:54:05.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.036471814999999998, 2024-04-01T19:54:05.945 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:05.945 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:05.945 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:05.945 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:05.945 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:54:05.945 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:54:05.945 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 311061 2024-04-01T19:54:05.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.945 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:05.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:05.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.561584+0000", 2024-04-01T19:54:05.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:05.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.561584+0000", 2024-04-01T19:54:05.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:05.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.561585+0000", 2024-04-01T19:54:05.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.271e-06 2024-04-01T19:54:05.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:05.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.561590+0000", 2024-04-01T19:54:05.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9300000000000002e-06 2024-04-01T19:54:05.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:05.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.561603+0000", 2024-04-01T19:54:05.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2998e-05 2024-04-01T19:54:05.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:05.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.561610+0000", 2024-04-01T19:54:05.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2830000000000004e-06 2024-04-01T19:54:05.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:05.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.579693+0000", 2024-04-01T19:54:05.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018082763000000002 2024-04-01T19:54:05.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:05.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.579770+0000", 2024-04-01T19:54:05.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6556000000000004e-05 2024-04-01T19:54:05.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:05.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.579849+0000", 2024-04-01T19:54:05.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9448000000000002e-05 2024-04-01T19:54:05.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:05.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.588330+0000", 2024-04-01T19:54:05.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0084814490000000003 2024-04-01T19:54:05.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:05.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.597952+0000", 2024-04-01T19:54:05.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0096216779999999998 2024-04-01T19:54:05.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:05.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.598005+0000", 2024-04-01T19:54:05.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3090000000000002e-05 2024-04-01T19:54:05.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:05.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.598056+0000", 2024-04-01T19:54:05.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0349000000000002e-05 2024-04-01T19:54:05.950 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.950 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:05.950 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.950 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:311081 7.5 7:a83b16dd:::benchmark_data_smithi188_147022_object141437:head [delete] snapc 0=[] ondisk+write+known_if_redirected e615)", 2024-04-01T19:54:05.950 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:11.576167+0000", 2024-04-01T19:54:05.951 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 54.248233044999999, 2024-04-01T19:54:05.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.037938419000000001, 2024-04-01T19:54:05.951 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:05.951 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:05.951 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:05.951 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:05.951 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:54:05.951 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:54:05.951 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 311081 2024-04-01T19:54:05.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.951 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:05.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:05.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.576167+0000", 2024-04-01T19:54:05.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:05.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.576167+0000", 2024-04-01T19:54:05.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:05.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.576168+0000", 2024-04-01T19:54:05.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7689999999999999e-06 2024-04-01T19:54:05.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:05.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.576174+0000", 2024-04-01T19:54:05.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5670000000000002e-06 2024-04-01T19:54:05.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:05.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.576184+0000", 2024-04-01T19:54:05.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0512e-05 2024-04-01T19:54:05.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:05.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.576192+0000", 2024-04-01T19:54:05.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3209999999999999e-06 2024-04-01T19:54:05.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:05.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.593293+0000", 2024-04-01T19:54:05.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017101484 2024-04-01T19:54:05.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:05.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.593419+0000", 2024-04-01T19:54:05.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0001261 2024-04-01T19:54:05.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:05.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.593539+0000", 2024-04-01T19:54:05.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000120207 2024-04-01T19:54:05.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:05.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.598358+0000", 2024-04-01T19:54:05.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0048186640000000003 2024-04-01T19:54:05.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:05.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.614001+0000", 2024-04-01T19:54:05.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015642954000000001 2024-04-01T19:54:05.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:05.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.614053+0000", 2024-04-01T19:54:05.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2117000000000003e-05 2024-04-01T19:54:05.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:05.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.614105+0000", 2024-04-01T19:54:05.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1724000000000001e-05 2024-04-01T19:54:05.956 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.956 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:05.956 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.956 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:311084 7.5 7:a676acf4:::benchmark_data_smithi188_147022_object141440:head [delete] snapc 0=[] ondisk+write+known_if_redirected e615)", 2024-04-01T19:54:05.956 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:11.580962+0000", 2024-04-01T19:54:05.957 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 54.243437782000001, 2024-04-01T19:54:05.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035969658000000002, 2024-04-01T19:54:05.957 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:05.957 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:05.957 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:05.957 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:05.957 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:54:05.957 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:54:05.957 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 311084 2024-04-01T19:54:05.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.957 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:05.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:05.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.580962+0000", 2024-04-01T19:54:05.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:05.958 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.580962+0000", 2024-04-01T19:54:05.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:05.958 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.580964+0000", 2024-04-01T19:54:05.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9640000000000002e-06 2024-04-01T19:54:05.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:05.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.580970+0000", 2024-04-01T19:54:05.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1510000000000001e-06 2024-04-01T19:54:05.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:05.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.580980+0000", 2024-04-01T19:54:05.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0342e-05 2024-04-01T19:54:05.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:05.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.580988+0000", 2024-04-01T19:54:05.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2830000000000004e-06 2024-04-01T19:54:05.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:05.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.598386+0000", 2024-04-01T19:54:05.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017398568 2024-04-01T19:54:05.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:05.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.598502+0000", 2024-04-01T19:54:05.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011584800000000001 2024-04-01T19:54:05.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:05.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.598624+0000", 2024-04-01T19:54:05.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012228799999999999 2024-04-01T19:54:05.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:05.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.613948+0000", 2024-04-01T19:54:05.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015323295000000001 2024-04-01T19:54:05.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:05.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.616829+0000", 2024-04-01T19:54:05.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0028813739999999999 2024-04-01T19:54:05.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:05.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.616881+0000", 2024-04-01T19:54:05.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1745e-05 2024-04-01T19:54:05.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:05.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:11.616931+0000", 2024-04-01T19:54:05.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0800000000000002e-05 2024-04-01T19:54:05.962 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.962 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:05.962 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.962 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:332297 7.5 7:a99f8751:::benchmark_data_smithi188_147022_object162653:head [delete] snapc 0=[] ondisk+write+known_if_redirected e623)", 2024-04-01T19:54:05.962 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:30.472240+0000", 2024-04-01T19:54:05.962 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 35.352159274000002, 2024-04-01T19:54:05.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.032294512999999997, 2024-04-01T19:54:05.963 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:05.963 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:05.963 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:05.963 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:05.963 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:54:05.963 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:54:05.963 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 332297 2024-04-01T19:54:05.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.963 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:05.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.963 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:05.963 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:30.472240+0000", 2024-04-01T19:54:05.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:05.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:30.472240+0000", 2024-04-01T19:54:05.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:05.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:30.472242+0000", 2024-04-01T19:54:05.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.714e-06 2024-04-01T19:54:05.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:05.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:30.472248+0000", 2024-04-01T19:54:05.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6840000000000001e-06 2024-04-01T19:54:05.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.965 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:05.965 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:30.472256+0000", 2024-04-01T19:54:05.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7819999999999999e-06 2024-04-01T19:54:05.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.965 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:05.965 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:30.472263+0000", 2024-04-01T19:54:05.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8979999999999999e-06 2024-04-01T19:54:05.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.965 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:05.965 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:30.477331+0000", 2024-04-01T19:54:05.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0050680869999999998 2024-04-01T19:54:05.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.966 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:05.966 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:30.477451+0000", 2024-04-01T19:54:05.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119348 2024-04-01T19:54:05.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.966 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:05.966 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:30.477567+0000", 2024-04-01T19:54:05.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011605299999999999 2024-04-01T19:54:05.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.966 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:05.967 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:30.481832+0000", 2024-04-01T19:54:05.967 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0042654340000000002 2024-04-01T19:54:05.967 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.967 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:05.967 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:30.504434+0000", 2024-04-01T19:54:05.967 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022601228000000001 2024-04-01T19:54:05.967 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.967 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:05.967 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:30.504487+0000", 2024-04-01T19:54:05.967 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3227999999999999e-05 2024-04-01T19:54:05.967 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.968 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:05.968 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:30.504535+0000", 2024-04-01T19:54:05.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8056999999999997e-05 2024-04-01T19:54:05.968 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.968 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:05.968 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.968 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.36668.0:335728 7.5 7:a67b02d2:::benchmark_data_smithi188_147022_object166084:head [delete] snapc 0=[] ondisk+write+known_if_redirected e624)", 2024-04-01T19:54:05.968 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:33.320602+0000", 2024-04-01T19:54:05.968 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 32.503797190999997, 2024-04-01T19:54:05.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.032339162999999997, 2024-04-01T19:54:05.968 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:05.969 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:05.969 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:05.969 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:05.969 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.36668", 2024-04-01T19:54:05.969 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:54:05.969 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 335728 2024-04-01T19:54:05.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.969 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:05.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.969 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:05.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.320602+0000", 2024-04-01T19:54:05.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:05.970 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.320602+0000", 2024-04-01T19:54:05.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:05.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:05.970 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.320605+0000", 2024-04-01T19:54:05.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4399999999999999e-06 2024-04-01T19:54:05.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:05.970 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.320615+0000", 2024-04-01T19:54:05.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9510000000000001e-06 2024-04-01T19:54:05.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.971 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:05.971 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.320632+0000", 2024-04-01T19:54:05.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7141000000000001e-05 2024-04-01T19:54:05.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.971 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:05.971 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.320642+0000", 2024-04-01T19:54:05.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.6690000000000001e-06 2024-04-01T19:54:05.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.971 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:05.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.325373+0000", 2024-04-01T19:54:05.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0047314080000000003 2024-04-01T19:54:05.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.972 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:05.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.325505+0000", 2024-04-01T19:54:05.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013175099999999999 2024-04-01T19:54:05.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.972 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:05.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.325634+0000", 2024-04-01T19:54:05.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000129319 2024-04-01T19:54:05.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.972 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:05.973 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.334813+0000", 2024-04-01T19:54:05.973 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091787350000000004 2024-04-01T19:54:05.973 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.973 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.973 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:05.973 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.352839+0000", 2024-04-01T19:54:05.973 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018026489 2024-04-01T19:54:05.973 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.973 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.973 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:05.973 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.352893+0000", 2024-04-01T19:54:05.973 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3946999999999997e-05 2024-04-01T19:54:05.973 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:05.973 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:05.974 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:05.974 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:33.352942+0000", 2024-04-01T19:54:05.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8313000000000003e-05 2024-04-01T19:54:05.974 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.974 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:05.974 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.974 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:05.974 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:05.974 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:54:06.055 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:54:06.057 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:06.058 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:54:06.159 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:54:06.192 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:06.214 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:54:06.216 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:06.217 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:54:06.318 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:54:06.348 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:06.406 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.9 to 1 (10000) 2024-04-01T19:54:06.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:06.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:06.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:06.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:06.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:06 smithi062 ceph-mon[44211]: pgmap v1752: 17 pgs: 17 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:54:06.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:06 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4146143525' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T19:54:06.559 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_ops_in_flight 2024-04-01T19:54:06.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:06.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:06.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:06.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:06.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:06 smithi022 ceph-mon[39439]: pgmap v1752: 17 pgs: 17 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:54:06.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:06 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4146143525' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T19:54:06.818 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:54:06.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:06.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:06.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:06.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:06.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:06 smithi188 ceph-mon[43939]: pgmap v1752: 17 pgs: 17 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:54:06.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:06 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4146143525' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T19:54:07.198 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:54:07.201 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:07.202 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:54:07.303 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:54:07.332 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:07.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:07 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4146143525' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]': finished 2024-04-01T19:54:07.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:07 smithi022 ceph-mon[39439]: osdmap e636: 12 total, 12 up, 11 in 2024-04-01T19:54:07.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:07 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4146143525' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]': finished 2024-04-01T19:54:07.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:07 smithi188 ceph-mon[43939]: osdmap e636: 12 total, 12 up, 11 in 2024-04-01T19:54:07.632 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 10 1 2024-04-01T19:54:07.636 DEBUG:teuthology.orchestra.run.smithi188:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.2 -b 65536 --object-size 65536 -p unique_pool_6 bench 90 write' 2024-04-01T19:54:07.638 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-04-01T19:54:07.638 INFO:teuthology.orchestra.run:waiting for 3000 2024-04-01T19:54:07.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:07 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4146143525' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]': finished 2024-04-01T19:54:07.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:07 smithi062 ceph-mon[44211]: osdmap e636: 12 total, 12 up, 11 in 2024-04-01T19:54:07.780 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:54:07.793 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:07.794 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:54:07.848 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:hints = 1 2024-04-01T19:54:07.848 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-04-01T19:54:07.848 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Object prefix: benchmark_data_smithi188_161190 2024-04-01T19:54:07.849 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:54:07.849 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 0 0 0 0 0 0 - 0 2024-04-01T19:54:07.894 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:54:07.937 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:54:07.937 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:08.056 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:54:08.195 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:54:08.202 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:08.203 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:54:08.304 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:54:08.341 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:08.371 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:54:08.374 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:08.374 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:54:08.475 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:54:08.513 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:08.578 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:08 smithi188 ceph-mon[43939]: pgmap v1754: 17 pgs: 17 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:54:08.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:08 smithi062 ceph-mon[44211]: pgmap v1754: 17 pgs: 17 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:54:08.772 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:54:08.776 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:08.777 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:54:08.777 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:08 smithi022 ceph-mon[39439]: pgmap v1754: 17 pgs: 17 active+clean; 577 KiB data, 5.4 GiB used, 978 GiB / 983 GiB avail 2024-04-01T19:54:08.848 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 1 16 5325 5309 331.787 331.812 0.00298449 0.00300895 2024-04-01T19:54:08.877 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:54:08.917 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:09.196 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:54:09.275 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:54:09.278 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:09.279 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:54:09.380 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:54:09.414 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:54:09.414 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:54:09.414 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-01T19:54:09.414 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:54:09.425 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:09.463 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:54:09.469 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:09 smithi022 ceph-mon[39439]: pgmap v1755: 17 pgs: 17 active+clean; 19 MiB data, 5.4 GiB used, 978 GiB / 983 GiB avail; 2.7 MiB/s wr, 42 op/s 2024-04-01T19:54:09.470 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:09.470 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:54:09.571 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:54:09.607 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:09.634 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:54:09.639 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:09.639 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:54:09.740 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:54:09.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:09 smithi062 ceph-mon[44211]: pgmap v1755: 17 pgs: 17 active+clean; 19 MiB data, 5.4 GiB used, 978 GiB / 983 GiB avail; 2.7 MiB/s wr, 42 op/s 2024-04-01T19:54:09.848 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 2 16 10190 10174 317.913 304.062 0.00360323 0.00314088 2024-04-01T19:54:09.862 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:54:09.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:09 smithi188 ceph-mon[43939]: pgmap v1755: 17 pgs: 17 active+clean; 19 MiB data, 5.4 GiB used, 978 GiB / 983 GiB avail; 2.7 MiB/s wr, 42 op/s 2024-04-01T19:54:10.176 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:10.177 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:54:10.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:10 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/994911526' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T19:54:10.437 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.10 to 1 (10000) 2024-04-01T19:54:10.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:10 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/994911526' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T19:54:10.849 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 3 16 12891 12875 268.204 168.812 0.00353224 0.00321947 2024-04-01T19:54:11.135 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:54:11.140 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:11.140 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:54:11.241 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:54:11.273 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:11.294 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:54:11.296 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:11.297 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:54:11.398 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:54:11.425 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:10 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/994911526' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T19:54:11.427 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:11.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:11 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/994911526' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]': finished 2024-04-01T19:54:11.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:11 smithi062 ceph-mon[44211]: osdmap e637: 12 total, 12 up, 11 in 2024-04-01T19:54:11.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:11 smithi062 ceph-mon[44211]: pgmap v1757: 17 pgs: 17 active+clean; 286 MiB data, 5.9 GiB used, 978 GiB / 983 GiB avail; 41 MiB/s wr, 658 op/s 2024-04-01T19:54:11.849 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 4 16 12929 12913 201.747 2.375 0.00188625 0.00380099 2024-04-01T19:54:11.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:11 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/994911526' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]': finished 2024-04-01T19:54:11.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:11 smithi022 ceph-mon[39439]: osdmap e637: 12 total, 12 up, 11 in 2024-04-01T19:54:11.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:11 smithi022 ceph-mon[39439]: pgmap v1757: 17 pgs: 17 active+clean; 286 MiB data, 5.9 GiB used, 978 GiB / 983 GiB avail; 41 MiB/s wr, 658 op/s 2024-04-01T19:54:11.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:11 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/994911526' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]': finished 2024-04-01T19:54:11.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:11 smithi188 ceph-mon[43939]: osdmap e637: 12 total, 12 up, 11 in 2024-04-01T19:54:11.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:11 smithi188 ceph-mon[43939]: pgmap v1757: 17 pgs: 17 active+clean; 286 MiB data, 5.9 GiB used, 978 GiB / 983 GiB avail; 41 MiB/s wr, 658 op/s 2024-04-01T19:54:12.382 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:54:12.390 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:12.390 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:54:12.491 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:54:12.551 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:12.687 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:12 smithi022 ceph-mon[39439]: osdmap e638: 12 total, 12 up, 11 in 2024-04-01T19:54:12.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:12 smithi062 ceph-mon[44211]: osdmap e638: 12 total, 12 up, 11 in 2024-04-01T19:54:12.849 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 5 16 13928 13912 173.884 62.4375 0.00510244 0.00574512 2024-04-01T19:54:12.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:12 smithi188 ceph-mon[43939]: osdmap e638: 12 total, 12 up, 11 in 2024-04-01T19:54:13.485 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_blocked_ops 2024-04-01T19:54:13.508 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:54:13.514 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:13.515 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:54:13.616 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:54:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:13.687 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:54:13.698 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:13.698 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:54:13.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:13 smithi062 ceph-mon[44211]: osdmap e639: 12 total, 12 up, 11 in 2024-04-01T19:54:13.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:13 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/972146097' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:54:13.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:13 smithi062 ceph-mon[44211]: pgmap v1760: 17 pgs: 2 peering, 15 active+clean; 586 MiB data, 6.7 GiB used, 977 GiB / 983 GiB avail; 98 MiB/s wr, 1.56k op/s 2024-04-01T19:54:13.799 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:54:13.844 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:13 smithi188 ceph-mon[43939]: osdmap e639: 12 total, 12 up, 11 in 2024-04-01T19:54:13.845 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:13 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/972146097' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:54:13.845 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:13 smithi188 ceph-mon[43939]: pgmap v1760: 17 pgs: 2 peering, 15 active+clean; 586 MiB data, 6.7 GiB used, 977 GiB / 983 GiB avail; 98 MiB/s wr, 1.56k op/s 2024-04-01T19:54:13.845 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:13.849 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 6 16 16612 16596 172.859 167.75 0.00871885 0.0057794 2024-04-01T19:54:13.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:13 smithi022 ceph-mon[39439]: osdmap e639: 12 total, 12 up, 11 in 2024-04-01T19:54:13.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:13 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/972146097' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:54:13.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:13 smithi022 ceph-mon[39439]: pgmap v1760: 17 pgs: 2 peering, 15 active+clean; 586 MiB data, 6.7 GiB used, 977 GiB / 983 GiB avail; 98 MiB/s wr, 1.56k op/s 2024-04-01T19:54:13.888 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:54:13.896 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:13.896 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:54:13.952 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:54:13.997 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:54:14.041 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:14.160 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:54:14.160 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:54:14.160 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:54:14.160 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:54:14.160 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:54:14.160 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:54:14.160 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:54:14.160 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:54:14.160 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:54:14.161 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:54:14.161 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:54:14.161 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:54:14.161 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:54:14.161 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:54:14.161 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:54:14.161 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:54:14.161 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:54:14.161 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:54:14.161 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:54:14.161 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:54:14.161 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:54:14.162 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:54:14.162 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:54:14.162 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:54:14.467 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:54:14.604 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:14 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:54:14.604 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:14 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:54:14.604 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.604 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.604 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.604 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.605 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.605 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:14 smithi188 ceph-mon[43939]: osdmap e640: 12 total, 12 up, 11 in 2024-04-01T19:54:14.605 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.605 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.605 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.605 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:14 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/959635657' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:54:14.605 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.605 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.605 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.605 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:14 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:54:14.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:14 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:54:14.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:14 smithi062 ceph-mon[44211]: osdmap e640: 12 total, 12 up, 11 in 2024-04-01T19:54:14.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:14 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/959635657' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:54:14.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.849 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 7 16 19250 19234 171.717 164.875 0.00189861 0.00582055 2024-04-01T19:54:14.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:14 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:54:14.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:14 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:54:14.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:14 smithi022 ceph-mon[39439]: osdmap e640: 12 total, 12 up, 11 in 2024-04-01T19:54:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:14 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/959635657' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:54:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:15.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:15 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:54:15.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:15 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/959635657' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:54:15.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:15 smithi062 ceph-mon[44211]: osdmap e641: 12 total, 12 up, 11 in 2024-04-01T19:54:15.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:15 smithi062 ceph-mon[44211]: pgmap v1763: 17 pgs: 2 peering, 15 active+clean; 704 MiB data, 7.0 GiB used, 976 GiB / 983 GiB avail; 104 MiB/s wr, 1.67k op/s 2024-04-01T19:54:15.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:15 smithi062 ceph-mon[44211]: osdmap e642: 12 total, 12 up, 11 in 2024-04-01T19:54:15.850 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 8 16 22040 22024 172.031 174.375 0.00450426 0.00580854 2024-04-01T19:54:15.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:15 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:54:15.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:15 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/959635657' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:54:15.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:15 smithi022 ceph-mon[39439]: osdmap e641: 12 total, 12 up, 11 in 2024-04-01T19:54:15.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:15 smithi022 ceph-mon[39439]: pgmap v1763: 17 pgs: 2 peering, 15 active+clean; 704 MiB data, 7.0 GiB used, 976 GiB / 983 GiB avail; 104 MiB/s wr, 1.67k op/s 2024-04-01T19:54:15.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:15 smithi022 ceph-mon[39439]: osdmap e642: 12 total, 12 up, 11 in 2024-04-01T19:54:15.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:15 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:54:15.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:15 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/959635657' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:54:15.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:15 smithi188 ceph-mon[43939]: osdmap e641: 12 total, 12 up, 11 in 2024-04-01T19:54:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:15 smithi188 ceph-mon[43939]: pgmap v1763: 17 pgs: 2 peering, 15 active+clean; 704 MiB data, 7.0 GiB used, 976 GiB / 983 GiB avail; 104 MiB/s wr, 1.67k op/s 2024-04-01T19:54:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:15 smithi188 ceph-mon[43939]: osdmap e642: 12 total, 12 up, 11 in 2024-04-01T19:54:16.397 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:54:16.402 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:16.402 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:54:16.503 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:54:16.544 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:16.850 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 9 16 24843 24827 172.38 175.188 0.00415576 0.00579782 2024-04-01T19:54:17.500 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:54:17.502 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:17.503 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:54:17.604 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:54:17.643 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:17.662 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:54:17.664 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:17.665 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:54:17.766 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:54:17.795 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:17.850 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 10 16 25632 25616 160.073 49.3125 0.00185613 0.00576929 2024-04-01T19:54:17.996 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:54:18.000 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:18.000 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:54:18.028 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 11 1 2024-04-01T19:54:18.097 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:18 smithi022 ceph-mon[39439]: osdmap e643: 12 total, 12 up, 11 in 2024-04-01T19:54:18.098 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:18 smithi022 ceph-mon[39439]: pgmap v1766: 17 pgs: 3 active+recovering+remapped, 14 active+clean; 1.3 GiB data, 7.8 GiB used, 976 GiB / 983 GiB avail; 193 MiB/s wr, 3.08k op/s; 487/43416 objects misplaced (1.122%); 54 MiB/s, 864 objects/s recovering 2024-04-01T19:54:18.101 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:54:18.129 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:18.148 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:54:18.151 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:18.152 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:54:18.253 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:54:18.278 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:18 smithi062 ceph-mon[44211]: osdmap e643: 12 total, 12 up, 11 in 2024-04-01T19:54:18.278 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:18 smithi062 ceph-mon[44211]: pgmap v1766: 17 pgs: 3 active+recovering+remapped, 14 active+clean; 1.3 GiB data, 7.8 GiB used, 976 GiB / 983 GiB avail; 193 MiB/s wr, 3.08k op/s; 487/43416 objects misplaced (1.122%); 54 MiB/s, 864 objects/s recovering 2024-04-01T19:54:18.280 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:18.299 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:54:18.301 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:18.302 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:54:18.350 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:54:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:18 smithi188 ceph-mon[43939]: osdmap e643: 12 total, 12 up, 11 in 2024-04-01T19:54:18.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:18 smithi188 ceph-mon[43939]: pgmap v1766: 17 pgs: 3 active+recovering+remapped, 14 active+clean; 1.3 GiB data, 7.8 GiB used, 976 GiB / 983 GiB avail; 193 MiB/s wr, 3.08k op/s; 487/43416 objects misplaced (1.122%); 54 MiB/s, 864 objects/s recovering 2024-04-01T19:54:18.402 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:54:18.430 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:18.449 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:54:18.452 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:18.452 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:54:18.553 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:54:18.586 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:18.850 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 11 16 25754 25738 146.215 7.625 0.00229886 0.00635242 2024-04-01T19:54:19.119 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:54:19.119 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:54:19.123 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:19 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:54:19.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:19 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:54:19.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:19 smithi188 ceph-mon[43939]: osdmap e644: 12 total, 12 up, 11 in 2024-04-01T19:54:19.167 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:54:19.338 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:54:19.344 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:19.344 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:54:19.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:19 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:54:19.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:19 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:54:19.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:19 smithi022 ceph-mon[39439]: osdmap e644: 12 total, 12 up, 11 in 2024-04-01T19:54:19.445 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:54:19.473 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:19.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:19 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:54:19.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:19 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:54:19.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:19 smithi062 ceph-mon[44211]: osdmap e644: 12 total, 12 up, 11 in 2024-04-01T19:54:19.528 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:54:19.850 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 12 16 27700 27684 144.165 121.625 0.00442003 0.0069341 2024-04-01T19:54:20.041 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:20 smithi022 ceph-mon[39439]: osdmap e645: 12 total, 12 up, 11 in 2024-04-01T19:54:20.041 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:20 smithi022 ceph-mon[39439]: pgmap v1769: 17 pgs: 1 peering, 2 active+recovering+remapped, 14 active+clean; 1.4 GiB data, 8.4 GiB used, 975 GiB / 983 GiB avail; 175 MiB/s wr, 2.80k op/s; 344/44912 objects misplaced (0.766%); 56 MiB/s, 900 objects/s recovering 2024-04-01T19:54:20.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:20 smithi188 ceph-mon[43939]: osdmap e645: 12 total, 12 up, 11 in 2024-04-01T19:54:20.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:20 smithi188 ceph-mon[43939]: pgmap v1769: 17 pgs: 1 peering, 2 active+recovering+remapped, 14 active+clean; 1.4 GiB data, 8.4 GiB used, 975 GiB / 983 GiB avail; 175 MiB/s wr, 2.80k op/s; 344/44912 objects misplaced (0.766%); 56 MiB/s, 900 objects/s recovering 2024-04-01T19:54:20.390 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:54:20.444 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:54:20.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:20 smithi062 ceph-mon[44211]: osdmap e645: 12 total, 12 up, 11 in 2024-04-01T19:54:20.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:20 smithi062 ceph-mon[44211]: pgmap v1769: 17 pgs: 1 peering, 2 active+recovering+remapped, 14 active+clean; 1.4 GiB data, 8.4 GiB used, 975 GiB / 983 GiB avail; 175 MiB/s wr, 2.80k op/s; 344/44912 objects misplaced (0.766%); 56 MiB/s, 900 objects/s recovering 2024-04-01T19:54:20.852 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 13 16 30501 30485 146.532 175.062 0.00364422 0.00682195 2024-04-01T19:54:21.128 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:54:21.133 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:21.133 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:54:21.162 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_historic_ops 2024-04-01T19:54:21.234 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:54:21.296 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:21.328 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:54:21.334 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:21.335 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:54:21.436 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:54:21.463 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.11 to 1 (10000) 2024-04-01T19:54:21.469 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:21.490 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:54:21.492 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:21.493 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:54:21.593 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:54:21.623 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:21.645 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:54:21.648 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:21.648 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:54:21.749 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:54:21.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:21 smithi062 ceph-mon[44211]: osdmap e646: 12 total, 12 up, 11 in 2024-04-01T19:54:21.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:21 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/713166469' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T19:54:21.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:21 smithi062 ceph-mon[44211]: pgmap v1771: 17 pgs: 1 peering, 2 active+recovering+remapped, 14 active+clean; 1.6 GiB data, 8.8 GiB used, 975 GiB / 983 GiB avail; 57 MiB/s wr, 916 op/s; 344/51320 objects misplaced (0.670%); 2.1 MiB/s, 33 objects/s recovering 2024-04-01T19:54:21.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:21 smithi188 ceph-mon[43939]: osdmap e646: 12 total, 12 up, 11 in 2024-04-01T19:54:21.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:21 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/713166469' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T19:54:21.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:21 smithi188 ceph-mon[43939]: pgmap v1771: 17 pgs: 1 peering, 2 active+recovering+remapped, 14 active+clean; 1.6 GiB data, 8.8 GiB used, 975 GiB / 983 GiB avail; 57 MiB/s wr, 916 op/s; 344/51320 objects misplaced (0.670%); 2.1 MiB/s, 33 objects/s recovering 2024-04-01T19:54:21.804 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:21.818 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:54:21.850 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:54:21.852 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 14 16 32761 32745 146.143 141.25 0.0112022 0.00683899 2024-04-01T19:54:21.854 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:21.854 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:54:21.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:21 smithi022 ceph-mon[39439]: osdmap e646: 12 total, 12 up, 11 in 2024-04-01T19:54:21.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:21 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/713166469' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T19:54:21.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:21 smithi022 ceph-mon[39439]: pgmap v1771: 17 pgs: 1 peering, 2 active+recovering+remapped, 14 active+clean; 1.6 GiB data, 8.8 GiB used, 975 GiB / 983 GiB avail; 57 MiB/s wr, 916 op/s; 344/51320 objects misplaced (0.670%); 2.1 MiB/s, 33 objects/s recovering 2024-04-01T19:54:21.955 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:54:21.993 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:22.461 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:22 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/713166469' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]': finished 2024-04-01T19:54:22.461 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:22 smithi022 ceph-mon[39439]: osdmap e647: 12 total, 12 up, 11 in 2024-04-01T19:54:22.461 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:22 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:54:22.461 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:22 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:54:22.462 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:22 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:54:22.462 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:22 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:54:22.703 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 8 1 2024-04-01T19:54:22.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:22 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/713166469' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]': finished 2024-04-01T19:54:22.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:22 smithi062 ceph-mon[44211]: osdmap e647: 12 total, 12 up, 11 in 2024-04-01T19:54:22.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:22 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:54:22.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:22 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:54:22.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:22 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:54:22.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:22 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:54:22.853 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 15 16 34908 34892 145.342 134.188 0.0260409 0.00687094 2024-04-01T19:54:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:22 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/713166469' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]': finished 2024-04-01T19:54:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:22 smithi188 ceph-mon[43939]: osdmap e647: 12 total, 12 up, 11 in 2024-04-01T19:54:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:22 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:54:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:22 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:54:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:22 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:54:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:22 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:54:23.062 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:54:23.066 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:23.067 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:54:23.168 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:54:23.204 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:23.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:23 smithi062 ceph-mon[44211]: pgmap v1773: 17 pgs: 17 active+clean; 1.9 GiB data, 9.3 GiB used, 974 GiB / 983 GiB avail; 105 MiB/s wr, 1.67k op/s; 4.1 MiB/s, 64 objects/s recovering 2024-04-01T19:54:23.852 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 16 16 37378 37362 145.906 154.375 0.00568574 0.00685019 2024-04-01T19:54:23.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:23 smithi022 ceph-mon[39439]: pgmap v1773: 17 pgs: 17 active+clean; 1.9 GiB data, 9.3 GiB used, 974 GiB / 983 GiB avail; 105 MiB/s wr, 1.67k op/s; 4.1 MiB/s, 64 objects/s recovering 2024-04-01T19:54:23.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:23 smithi188 ceph-mon[43939]: pgmap v1773: 17 pgs: 17 active+clean; 1.9 GiB data, 9.3 GiB used, 974 GiB / 983 GiB avail; 105 MiB/s wr, 1.67k op/s; 4.1 MiB/s, 64 objects/s recovering 2024-04-01T19:54:24.853 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 17 16 39559 39543 145.341 136.312 0.00312947 0.0068787 2024-04-01T19:54:25.159 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:54:25.161 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:25.162 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:54:25.263 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:54:25.294 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:25.853 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 18 16 41977 41961 145.662 151.125 0.00504331 0.00686317 2024-04-01T19:54:26.058 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:54:26.077 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:54:26.098 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:54:26.122 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:54:26.148 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:54:26.173 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:54:26.198 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:54:26.225 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:54:26.242 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:25 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:54:26.242 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:25 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:54:26.242 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:25 smithi022 ceph-mon[39439]: osdmap e648: 12 total, 12 up, 11 in 2024-04-01T19:54:26.242 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:25 smithi022 ceph-mon[39439]: pgmap v1775: 17 pgs: 17 active+clean; 2.0 GiB data, 9.5 GiB used, 974 GiB / 983 GiB avail; 109 MiB/s wr, 1.74k op/s; 3.6 MiB/s, 57 objects/s recovering 2024-04-01T19:54:26.249 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:54:26.253 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:26.253 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:54:26.258 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:54:26.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:25 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:54:26.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:25 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:54:26.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:25 smithi062 ceph-mon[44211]: osdmap e648: 12 total, 12 up, 11 in 2024-04-01T19:54:26.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:25 smithi062 ceph-mon[44211]: pgmap v1775: 17 pgs: 17 active+clean; 2.0 GiB data, 9.5 GiB used, 974 GiB / 983 GiB avail; 109 MiB/s wr, 1.74k op/s; 3.6 MiB/s, 57 objects/s recovering 2024-04-01T19:54:26.276 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:25 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:54:26.277 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:25 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:54:26.277 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:25 smithi188 ceph-mon[43939]: osdmap e648: 12 total, 12 up, 11 in 2024-04-01T19:54:26.277 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:25 smithi188 ceph-mon[43939]: pgmap v1775: 17 pgs: 17 active+clean; 2.0 GiB data, 9.5 GiB used, 974 GiB / 983 GiB avail; 109 MiB/s wr, 1.74k op/s; 3.6 MiB/s, 57 objects/s recovering 2024-04-01T19:54:26.285 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:54:26.314 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:54:26.343 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:54:26.344 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:54:26.344 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:54:26.344 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:54:26.344 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:54:26.345 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:54:26.345 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:54:26.345 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:54:26.345 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:54:26.345 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:54:26.345 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:54:26.345 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:54:26.345 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:54:26.354 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:54:26.414 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:26.549 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:54:26.553 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:26.554 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:54:26.655 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:54:26.689 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:26.737 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:54:26.742 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:26.743 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:54:26.844 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:54:26.853 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 19 16 43924 43908 144.4 121.688 0.00275255 0.00692251 2024-04-01T19:54:26.878 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:27.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:26 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2082799974' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:54:27.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:27.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:27.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:27.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:27.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:27.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:27.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:27.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:27.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:26 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2082799974' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:54:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:27.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:27.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:26 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2082799974' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:54:27.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:27.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:27.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:27.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:27.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:27.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:27.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:27.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:27.853 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:54:27.856336 min lat: 0.00103479 max lat: 2.06154 avg lat: 0.00694084 2024-04-01T19:54:27.853 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:54:27.853 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 20 16 46121 46105 144.045 137.312 0.00652264 0.00694084 2024-04-01T19:54:27.908 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:54:28.257 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:54:28.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:28.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:27 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3703506910' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:54:28.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:27 smithi062 ceph-mon[44211]: pgmap v1776: 17 pgs: 17 active+clean; 2.4 GiB data, 10 GiB used, 973 GiB / 983 GiB avail; 148 MiB/s wr, 2.36k op/s; 3.1 MiB/s, 49 objects/s recovering 2024-04-01T19:54:28.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:28.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:28.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:28.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:28.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:27 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3703506910' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:54:28.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:27 smithi022 ceph-mon[39439]: pgmap v1776: 17 pgs: 17 active+clean; 2.4 GiB data, 10 GiB used, 973 GiB / 983 GiB avail; 148 MiB/s wr, 2.36k op/s; 3.1 MiB/s, 49 objects/s recovering 2024-04-01T19:54:28.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:28.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:28.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:28.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:28.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:27 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3703506910' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:54:28.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:27 smithi188 ceph-mon[43939]: pgmap v1776: 17 pgs: 17 active+clean; 2.4 GiB data, 10 GiB used, 973 GiB / 983 GiB avail; 148 MiB/s wr, 2.36k op/s; 3.1 MiB/s, 49 objects/s recovering 2024-04-01T19:54:28.853 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 21 15 48186 48171 143.334 129.125 0.0130487 0.00697366 2024-04-01T19:54:28.887 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:54:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:54:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:54:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:54:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:185471 6.1 6:88b25c3d:::benchmark_data_smithi188_134454_object28730:head [delete] snapc 0=[] ondisk+write+known_if_redirected e515)", 2024-04-01T19:54:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:46:50.511843+0000", 2024-04-01T19:54:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 458.37277105099997, 2024-04-01T19:54:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028214843, 2024-04-01T19:54:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:54:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:54:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 185471 2024-04-01T19:54:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.511843+0000", 2024-04-01T19:54:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.511843+0000", 2024-04-01T19:54:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.511844+0000", 2024-04-01T19:54:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1200000000000001e-07 2024-04-01T19:54:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.511848+0000", 2024-04-01T19:54:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3699999999999999e-06 2024-04-01T19:54:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.511855+0000", 2024-04-01T19:54:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3089999999999998e-06 2024-04-01T19:54:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.511860+0000", 2024-04-01T19:54:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3199999999999999e-06 2024-04-01T19:54:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.523528+0000", 2024-04-01T19:54:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011667790000000001 2024-04-01T19:54:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.523629+0000", 2024-04-01T19:54:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010143499999999999 2024-04-01T19:54:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.523718+0000", 2024-04-01T19:54:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8968000000000006e-05 2024-04-01T19:54:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.536018+0000", 2024-04-01T19:54:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012299879 2024-04-01T19:54:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.539982+0000", 2024-04-01T19:54:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0039634370000000002 2024-04-01T19:54:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.540017+0000", 2024-04-01T19:54:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5413999999999997e-05 2024-04-01T19:54:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:46:50.540058+0000", 2024-04-01T19:54:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1009e-05 2024-04-01T19:54:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:200049 6.1 6:8e0eda95:::benchmark_data_smithi188_134454_object43308:head [delete] snapc 0=[] ondisk+write+known_if_redirected e517)", 2024-04-01T19:54:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:03.197534+0000", 2024-04-01T19:54:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 445.68707980200003, 2024-04-01T19:54:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026571332999999999, 2024-04-01T19:54:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:54:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:54:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 200049 2024-04-01T19:54:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.197534+0000", 2024-04-01T19:54:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.197534+0000", 2024-04-01T19:54:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.197536+0000", 2024-04-01T19:54:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3230000000000001e-06 2024-04-01T19:54:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.197541+0000", 2024-04-01T19:54:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8400000000000002e-06 2024-04-01T19:54:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.197552+0000", 2024-04-01T19:54:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0865e-05 2024-04-01T19:54:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.197559+0000", 2024-04-01T19:54:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6159999999999996e-06 2024-04-01T19:54:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.211159+0000", 2024-04-01T19:54:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013599464 2024-04-01T19:54:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.211261+0000", 2024-04-01T19:54:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000102687 2024-04-01T19:54:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.211351+0000", 2024-04-01T19:54:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9952999999999997e-05 2024-04-01T19:54:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.220242+0000", 2024-04-01T19:54:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0088905809999999998 2024-04-01T19:54:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.224002+0000", 2024-04-01T19:54:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.003760228 2024-04-01T19:54:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.224060+0000", 2024-04-01T19:54:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8458999999999997e-05 2024-04-01T19:54:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.224106+0000", 2024-04-01T19:54:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5317e-05 2024-04-01T19:54:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:200073 6.1 6:84f8150d:::benchmark_data_smithi188_134454_object43332:head [delete] snapc 0=[] ondisk+write+known_if_redirected e517)", 2024-04-01T19:54:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:03.216314+0000", 2024-04-01T19:54:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 445.668300139, 2024-04-01T19:54:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028583273999999999, 2024-04-01T19:54:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:54:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:54:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 200073 2024-04-01T19:54:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.216314+0000", 2024-04-01T19:54:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.216314+0000", 2024-04-01T19:54:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.216315+0000", 2024-04-01T19:54:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2720000000000001e-06 2024-04-01T19:54:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.216320+0000", 2024-04-01T19:54:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6759999999999998e-06 2024-04-01T19:54:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.216330+0000", 2024-04-01T19:54:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7650000000000005e-06 2024-04-01T19:54:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.216337+0000", 2024-04-01T19:54:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1489999999999997e-06 2024-04-01T19:54:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.229233+0000", 2024-04-01T19:54:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012895514 2024-04-01T19:54:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.229379+0000", 2024-04-01T19:54:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014660000000000001 2024-04-01T19:54:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.229514+0000", 2024-04-01T19:54:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013490600000000001 2024-04-01T19:54:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.239782+0000", 2024-04-01T19:54:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010268121999999999 2024-04-01T19:54:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.244792+0000", 2024-04-01T19:54:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0050102990000000002 2024-04-01T19:54:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.244848+0000", 2024-04-01T19:54:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5429000000000001e-05 2024-04-01T19:54:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:03.244897+0000", 2024-04-01T19:54:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9542000000000001e-05 2024-04-01T19:54:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:249495 6.1 6:8ccf7b8d:::benchmark_data_smithi188_134454_object92754:head [delete] snapc 0=[] ondisk+write+known_if_redirected e528)", 2024-04-01T19:54:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:47:47.962502+0000", 2024-04-01T19:54:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 400.92211218599999, 2024-04-01T19:54:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028306492999999999, 2024-04-01T19:54:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:54:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:54:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 249495 2024-04-01T19:54:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.962502+0000", 2024-04-01T19:54:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.962502+0000", 2024-04-01T19:54:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.962503+0000", 2024-04-01T19:54:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8000000000000005e-07 2024-04-01T19:54:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.962506+0000", 2024-04-01T19:54:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9809999999999999e-06 2024-04-01T19:54:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.962512+0000", 2024-04-01T19:54:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0979999999999999e-06 2024-04-01T19:54:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.962516+0000", 2024-04-01T19:54:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2130000000000002e-06 2024-04-01T19:54:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.966338+0000", 2024-04-01T19:54:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0038218729999999999 2024-04-01T19:54:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.966521+0000", 2024-04-01T19:54:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018342900000000001 2024-04-01T19:54:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.966658+0000", 2024-04-01T19:54:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013661500000000001 2024-04-01T19:54:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.982441+0000", 2024-04-01T19:54:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015783367 2024-04-01T19:54:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.990689+0000", 2024-04-01T19:54:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082475910000000003 2024-04-01T19:54:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.990751+0000", 2024-04-01T19:54:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2020000000000006e-05 2024-04-01T19:54:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:47:47.990809+0000", 2024-04-01T19:54:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7525999999999998e-05 2024-04-01T19:54:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:299363 6.1 6:8ce05f23:::benchmark_data_smithi188_134454_object142622:head [delete] snapc 0=[] ondisk+write+known_if_redirected e549)", 2024-04-01T19:54:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:48:59.455183+0000", 2024-04-01T19:54:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 329.42943150899998, 2024-04-01T19:54:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.032178037999999999, 2024-04-01T19:54:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:54:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:54:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 299363 2024-04-01T19:54:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.455183+0000", 2024-04-01T19:54:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.455183+0000", 2024-04-01T19:54:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.455184+0000", 2024-04-01T19:54:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.127e-06 2024-04-01T19:54:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.455188+0000", 2024-04-01T19:54:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1359999999999999e-06 2024-04-01T19:54:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.455194+0000", 2024-04-01T19:54:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7209999999999999e-06 2024-04-01T19:54:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.455198+0000", 2024-04-01T19:54:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5990000000000004e-06 2024-04-01T19:54:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.463314+0000", 2024-04-01T19:54:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0081152470000000008 2024-04-01T19:54:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.463446+0000", 2024-04-01T19:54:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013226899999999999 2024-04-01T19:54:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.463568+0000", 2024-04-01T19:54:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012256499999999999 2024-04-01T19:54:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.471669+0000", 2024-04-01T19:54:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.008101057 2024-04-01T19:54:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.487250+0000", 2024-04-01T19:54:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015580586 2024-04-01T19:54:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.487306+0000", 2024-04-01T19:54:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6320999999999998e-05 2024-04-01T19:54:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.487361+0000", 2024-04-01T19:54:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4410000000000003e-05 2024-04-01T19:54:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:299383 6.1 6:8cdd007b:::benchmark_data_smithi188_134454_object142642:head [delete] snapc 0=[] ondisk+write+known_if_redirected e549)", 2024-04-01T19:54:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:48:59.471656+0000", 2024-04-01T19:54:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 329.41295876499998, 2024-04-01T19:54:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027654287999999999, 2024-04-01T19:54:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:54:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:54:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 299383 2024-04-01T19:54:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:28.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.471656+0000", 2024-04-01T19:54:28.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:28.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.471656+0000", 2024-04-01T19:54:28.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:28.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.471657+0000", 2024-04-01T19:54:28.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6390000000000001e-06 2024-04-01T19:54:28.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:28.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.471662+0000", 2024-04-01T19:54:28.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7090000000000001e-06 2024-04-01T19:54:28.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:28.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.471671+0000", 2024-04-01T19:54:28.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0690000000000008e-06 2024-04-01T19:54:28.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:28.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.471679+0000", 2024-04-01T19:54:28.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7540000000000006e-06 2024-04-01T19:54:28.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:28.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.471726+0000", 2024-04-01T19:54:28.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6958e-05 2024-04-01T19:54:28.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.471843+0000", 2024-04-01T19:54:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011765999999999999 2024-04-01T19:54:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.471964+0000", 2024-04-01T19:54:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000120717 2024-04-01T19:54:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.487191+0000", 2024-04-01T19:54:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015226630999999999 2024-04-01T19:54:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.499202+0000", 2024-04-01T19:54:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012011292 2024-04-01T19:54:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.499259+0000", 2024-04-01T19:54:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7133999999999999e-05 2024-04-01T19:54:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.499310+0000", 2024-04-01T19:54:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0725e-05 2024-04-01T19:54:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26287.0:299392 6.1 6:84e62ee0:::benchmark_data_smithi188_134454_object142651:head [delete] snapc 0=[] ondisk+write+known_if_redirected e549)", 2024-04-01T19:54:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:48:59.479520+0000", 2024-04-01T19:54:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 329.40509446599998, 2024-04-01T19:54:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029430510999999999, 2024-04-01T19:54:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26287", 2024-04-01T19:54:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:54:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 299392 2024-04-01T19:54:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.479520+0000", 2024-04-01T19:54:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.479520+0000", 2024-04-01T19:54:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.479520+0000", 2024-04-01T19:54:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4499999999999997e-07 2024-04-01T19:54:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.479523+0000", 2024-04-01T19:54:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4779999999999998e-06 2024-04-01T19:54:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.479528+0000", 2024-04-01T19:54:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1800000000000004e-06 2024-04-01T19:54:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.479533+0000", 2024-04-01T19:54:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9180000000000002e-06 2024-04-01T19:54:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.487544+0000", 2024-04-01T19:54:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080105000000000003 2024-04-01T19:54:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.487668+0000", 2024-04-01T19:54:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012440699999999999 2024-04-01T19:54:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 9", 2024-04-01T19:54:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.487791+0000", 2024-04-01T19:54:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012268199999999999 2024-04-01T19:54:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.499143+0000", 2024-04-01T19:54:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.01135243 2024-04-01T19:54:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.508889+0000", 2024-04-01T19:54:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0097456550000000006 2024-04-01T19:54:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.508922+0000", 2024-04-01T19:54:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3141e-05 2024-04-01T19:54:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:48:59.508950+0000", 2024-04-01T19:54:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8475000000000001e-05 2024-04-01T19:54:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:202547 7.7 e591/560 7:ed659a3a:::benchmark_data_smithi188_147022_object32903:head v 591'12808, mlcod=591'12802)", 2024-04-01T19:54:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:51:36.257325+0000", 2024-04-01T19:54:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 172.62728915, 2024-04-01T19:54:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.030105498000000001, 2024-04-01T19:54:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:36.257325+0000", 2024-04-01T19:54:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:36.257325+0000", 2024-04-01T19:54:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:36.257327+0000", 2024-04-01T19:54:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4810000000000001e-06 2024-04-01T19:54:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:36.257334+0000", 2024-04-01T19:54:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5190000000000003e-06 2024-04-01T19:54:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:36.257350+0000", 2024-04-01T19:54:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6041000000000001e-05 2024-04-01T19:54:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:36.257358+0000", 2024-04-01T19:54:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3860000000000001e-06 2024-04-01T19:54:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.945 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:28.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:36.263591+0000", 2024-04-01T19:54:28.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062335869999999996 2024-04-01T19:54:28.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.945 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:28.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:36.263611+0000", 2024-04-01T19:54:28.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9364e-05 2024-04-01T19:54:28.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:36.287396+0000", 2024-04-01T19:54:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023785354000000002 2024-04-01T19:54:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:51:36.287431+0000", 2024-04-01T19:54:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4765999999999999e-05 2024-04-01T19:54:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:233404 7.f e599/560 7:f1b020b3:::benchmark_data_smithi188_147022_object63760:head v 599'14450, mlcod=599'14446)", 2024-04-01T19:54:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:52:04.578430+0000", 2024-04-01T19:54:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 144.30618468599999, 2024-04-01T19:54:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027502433, 2024-04-01T19:54:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.578430+0000", 2024-04-01T19:54:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.578430+0000", 2024-04-01T19:54:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.578431+0000", 2024-04-01T19:54:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4300000000000001e-06 2024-04-01T19:54:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.578441+0000", 2024-04-01T19:54:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0005e-05 2024-04-01T19:54:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:28.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.578451+0000", 2024-04-01T19:54:28.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0121e-05 2024-04-01T19:54:28.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:28.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.578457+0000", 2024-04-01T19:54:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.908e-06 2024-04-01T19:54:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.578771+0000", 2024-04-01T19:54:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00031405400000000003 2024-04-01T19:54:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.578789+0000", 2024-04-01T19:54:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8232000000000001e-05 2024-04-01T19:54:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.605885+0000", 2024-04-01T19:54:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027095958999999999 2024-04-01T19:54:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.605932+0000", 2024-04-01T19:54:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6724000000000002e-05 2024-04-01T19:54:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.952 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:233398 7.7 e599/560 7:e0b84b62:::benchmark_data_smithi188_147022_object63754:head v 599'14790, mlcod=599'14785)", 2024-04-01T19:54:28.952 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:52:04.578749+0000", 2024-04-01T19:54:28.952 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 144.305865772, 2024-04-01T19:54:28.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027225415999999999, 2024-04-01T19:54:28.952 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:28.952 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:28.952 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:28.952 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:28.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:28.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.578749+0000", 2024-04-01T19:54:28.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:28.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.578749+0000", 2024-04-01T19:54:28.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:28.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.578750+0000", 2024-04-01T19:54:28.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.215e-06 2024-04-01T19:54:28.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:28.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.578757+0000", 2024-04-01T19:54:28.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3849999999999996e-06 2024-04-01T19:54:28.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:28.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.578765+0000", 2024-04-01T19:54:28.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.678e-06 2024-04-01T19:54:28.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:28.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.578771+0000", 2024-04-01T19:54:28.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9190000000000004e-06 2024-04-01T19:54:28.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:28.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.582787+0000", 2024-04-01T19:54:28.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040163339999999999 2024-04-01T19:54:28.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:28.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.582804+0000", 2024-04-01T19:54:28.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7311000000000001e-05 2024-04-01T19:54:28.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:28.958 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.605937+0000", 2024-04-01T19:54:28.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023132203 2024-04-01T19:54:28.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:28.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:04.605974+0000", 2024-04-01T19:54:28.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7370999999999998e-05 2024-04-01T19:54:28.959 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.959 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:28.959 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.959 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:242522 7.7 e601/560 7:e1fe04da:::benchmark_data_smithi188_147022_object72878:head v 601'15381, mlcod=601'15376)", 2024-04-01T19:54:28.960 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:52:11.844468+0000", 2024-04-01T19:54:28.960 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 137.04014589499999, 2024-04-01T19:54:28.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.030435376, 2024-04-01T19:54:28.960 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:28.960 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:28.960 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:28.960 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:28.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:28.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:11.844468+0000", 2024-04-01T19:54:28.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:28.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:11.844468+0000", 2024-04-01T19:54:28.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:28.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:11.844470+0000", 2024-04-01T19:54:28.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.28e-06 2024-04-01T19:54:28.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.963 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:28.963 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:11.844477+0000", 2024-04-01T19:54:28.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2269999999999996e-06 2024-04-01T19:54:28.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.963 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:28.963 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:11.844490+0000", 2024-04-01T19:54:28.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3217999999999999e-05 2024-04-01T19:54:28.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:28.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:11.844498+0000", 2024-04-01T19:54:28.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6790000000000005e-06 2024-04-01T19:54:28.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:28.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:11.848797+0000", 2024-04-01T19:54:28.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.004299041 2024-04-01T19:54:28.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.965 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:28.965 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:11.848821+0000", 2024-04-01T19:54:28.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3968000000000002e-05 2024-04-01T19:54:28.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:28.966 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:11.874875+0000", 2024-04-01T19:54:28.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026054246 2024-04-01T19:54:28.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.966 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:28.966 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:11.874904+0000", 2024-04-01T19:54:28.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8717e-05 2024-04-01T19:54:28.967 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.967 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:28.967 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.967 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.967 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:242531 7.f e601/560 7:fdf6fc66:::benchmark_data_smithi188_147022_object72887:head v 601'15028, mlcod=601'15024)", 2024-04-01T19:54:28.967 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:52:11.850952+0000", 2024-04-01T19:54:28.967 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 137.033662298, 2024-04-01T19:54:28.967 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.030064732, 2024-04-01T19:54:28.968 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:28.968 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:28.968 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:28.968 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:28.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.968 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:28.968 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:11.850952+0000", 2024-04-01T19:54:28.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.968 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:28.968 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:11.850952+0000", 2024-04-01T19:54:28.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.969 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:28.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:11.850953+0000", 2024-04-01T19:54:28.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3e-07 2024-04-01T19:54:28.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.969 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:28.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:11.850957+0000", 2024-04-01T19:54:28.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3209999999999998e-06 2024-04-01T19:54:28.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:28.970 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:11.850963+0000", 2024-04-01T19:54:28.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0739999999999998e-06 2024-04-01T19:54:28.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:28.970 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:11.850969+0000", 2024-04-01T19:54:28.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0190000000000003e-06 2024-04-01T19:54:28.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:28.970 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:11.862694+0000", 2024-04-01T19:54:28.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011724477000000001 2024-04-01T19:54:28.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.971 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:28.971 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:11.862708+0000", 2024-04-01T19:54:28.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4389999999999999e-05 2024-04-01T19:54:28.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.971 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:28.971 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:11.880981+0000", 2024-04-01T19:54:28.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018272931999999999 2024-04-01T19:54:28.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.971 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:28.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:11.881017+0000", 2024-04-01T19:54:28.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5788999999999999e-05 2024-04-01T19:54:28.972 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.972 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:28.972 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.972 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.972 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:265434 7.f e604/560 7:f9099080:::benchmark_data_smithi188_147022_object95790:head v 604'16487, mlcod=604'16485)", 2024-04-01T19:54:28.972 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:52:30.786617+0000", 2024-04-01T19:54:28.972 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 118.097997527, 2024-04-01T19:54:28.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028755118, 2024-04-01T19:54:28.972 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:28.972 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:28.972 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:28.973 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:28.973 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.973 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:28.973 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.786617+0000", 2024-04-01T19:54:28.973 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.973 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.973 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.973 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:28.973 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.786617+0000", 2024-04-01T19:54:28.973 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.973 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.973 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.973 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:28.974 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.786618+0000", 2024-04-01T19:54:28.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7069999999999999e-06 2024-04-01T19:54:28.974 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.974 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.974 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:28.974 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.786635+0000", 2024-04-01T19:54:28.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6175999999999999e-05 2024-04-01T19:54:28.974 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.974 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.974 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:28.974 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.786647+0000", 2024-04-01T19:54:28.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2439000000000001e-05 2024-04-01T19:54:28.975 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.975 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.975 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:28.975 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.786656+0000", 2024-04-01T19:54:28.975 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5709999999999998e-06 2024-04-01T19:54:28.975 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.975 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.975 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:28.975 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.786714+0000", 2024-04-01T19:54:28.975 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8075999999999998e-05 2024-04-01T19:54:28.975 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.975 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.975 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:28.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.786736+0000", 2024-04-01T19:54:28.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1919000000000001e-05 2024-04-01T19:54:28.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.976 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:28.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.815322+0000", 2024-04-01T19:54:28.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028586414000000001 2024-04-01T19:54:28.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.976 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:28.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:30.815372+0000", 2024-04-01T19:54:28.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9815999999999999e-05 2024-04-01T19:54:28.976 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.976 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:28.976 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.977 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:265821 7.7 e604/560 7:e2181cfa:::benchmark_data_smithi188_147022_object96177:head v 604'16894, mlcod=604'16891)", 2024-04-01T19:54:28.977 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:52:31.141204+0000", 2024-04-01T19:54:28.977 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 117.743410642, 2024-04-01T19:54:28.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027987175999999999, 2024-04-01T19:54:28.977 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:28.977 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:28.977 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:28.977 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:28.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:28.977 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:31.141204+0000", 2024-04-01T19:54:28.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.978 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:28.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:31.141204+0000", 2024-04-01T19:54:28.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.978 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.978 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.978 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:28.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:31.141205+0000", 2024-04-01T19:54:28.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.265e-06 2024-04-01T19:54:28.978 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.978 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.978 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:28.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:31.141213+0000", 2024-04-01T19:54:28.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.011e-06 2024-04-01T19:54:28.979 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.979 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.979 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:28.979 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:31.141226+0000", 2024-04-01T19:54:28.979 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3349999999999999e-05 2024-04-01T19:54:28.979 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.979 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.979 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:28.979 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:31.141234+0000", 2024-04-01T19:54:28.979 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.396e-06 2024-04-01T19:54:28.979 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.979 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.979 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:28.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:31.143503+0000", 2024-04-01T19:54:28.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022693969999999998 2024-04-01T19:54:28.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:28.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:31.143523+0000", 2024-04-01T19:54:28.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0205999999999999e-05 2024-04-01T19:54:28.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:28.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:31.169146+0000", 2024-04-01T19:54:28.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.025623046 2024-04-01T19:54:28.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:28.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:31.169191+0000", 2024-04-01T19:54:28.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4505000000000002e-05 2024-04-01T19:54:28.981 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.981 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:28.981 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.981 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:275695 7.f e605/560 7:f001fe1b:::benchmark_data_smithi188_147022_object106051:head v 605'17139, mlcod=605'17135)", 2024-04-01T19:54:28.981 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:52:39.308002+0000", 2024-04-01T19:54:28.981 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 109.57661181500001, 2024-04-01T19:54:28.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031296567999999997, 2024-04-01T19:54:28.981 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:28.981 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:28.981 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:28.981 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:28.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.982 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:28.982 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:39.308002+0000", 2024-04-01T19:54:28.982 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.982 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.982 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.982 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:28.982 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:39.308002+0000", 2024-04-01T19:54:28.982 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.982 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.982 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.982 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:28.982 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:39.308004+0000", 2024-04-01T19:54:28.982 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5430000000000001e-06 2024-04-01T19:54:28.983 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.983 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:28.983 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:39.308011+0000", 2024-04-01T19:54:28.983 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4590000000000001e-06 2024-04-01T19:54:28.983 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.984 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:28.984 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:39.308023+0000", 2024-04-01T19:54:28.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.134e-05 2024-04-01T19:54:28.984 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.984 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.984 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:28.984 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:39.308030+0000", 2024-04-01T19:54:28.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9229999999999996e-06 2024-04-01T19:54:28.984 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.985 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.985 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:28.985 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:39.314381+0000", 2024-04-01T19:54:28.985 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063515009999999998 2024-04-01T19:54:28.985 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.985 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.985 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:28.986 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:39.314402+0000", 2024-04-01T19:54:28.986 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0681000000000001e-05 2024-04-01T19:54:28.986 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.986 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.986 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:28.986 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:39.339252+0000", 2024-04-01T19:54:28.986 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.024850463999999999 2024-04-01T19:54:28.986 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.987 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.987 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:28.987 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:52:39.339299+0000", 2024-04-01T19:54:28.987 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6656999999999997e-05 2024-04-01T19:54:28.987 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.987 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:28.987 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.988 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.988 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.988 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.36668.0:333680 7.f e623/560 7:f34f4367:::benchmark_data_smithi188_147022_object164036:head v 623'20833, mlcod=623'20829)", 2024-04-01T19:54:28.988 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:53:31.673103+0000", 2024-04-01T19:54:28.988 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 57.211511721000001, 2024-04-01T19:54:28.988 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029072951999999999, 2024-04-01T19:54:28.988 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:28.988 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:28.988 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:28.989 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:28.989 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.989 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:28.989 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:31.673103+0000", 2024-04-01T19:54:28.989 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.989 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.989 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.989 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:28.989 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:31.673103+0000", 2024-04-01T19:54:28.989 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.989 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.989 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.990 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:28.990 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:31.673104+0000", 2024-04-01T19:54:28.990 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.325e-06 2024-04-01T19:54:28.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.990 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:28.990 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:31.673112+0000", 2024-04-01T19:54:28.990 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2749999999999995e-06 2024-04-01T19:54:28.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.990 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:28.990 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:31.673125+0000", 2024-04-01T19:54:28.990 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2435e-05 2024-04-01T19:54:28.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:28.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:31.673132+0000", 2024-04-01T19:54:28.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5310000000000004e-06 2024-04-01T19:54:28.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:28.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:31.679392+0000", 2024-04-01T19:54:28.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062602880000000001 2024-04-01T19:54:28.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.992 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.992 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:28.992 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:31.679413+0000", 2024-04-01T19:54:28.992 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0122000000000001e-05 2024-04-01T19:54:28.992 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.992 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.992 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:28.993 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:31.702137+0000", 2024-04-01T19:54:28.993 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022724945999999999 2024-04-01T19:54:28.993 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.993 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:28.993 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:53:31.702176+0000", 2024-04-01T19:54:28.993 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.803e-05 2024-04-01T19:54:28.994 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.994 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:28.994 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:28.994 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.994 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.994 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:46004 8.b 8:d22c0326:::benchmark_data_smithi188_161190_object46003:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e648)", 2024-04-01T19:54:28.995 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:54:27.799999+0000", 2024-04-01T19:54:28.995 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 1.0846155, 2024-04-01T19:54:28.995 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027820124000000002, 2024-04-01T19:54:28.995 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:28.995 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:28.995 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:28.995 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:28.996 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:54:28.996 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:54:28.996 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 46004 2024-04-01T19:54:28.996 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.996 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:28.996 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.997 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:28.997 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.799999+0000", 2024-04-01T19:54:28.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.997 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.997 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.997 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:28.997 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.799999+0000", 2024-04-01T19:54:28.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:28.998 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.998 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:28.998 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.800001+0000", 2024-04-01T19:54:28.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6460000000000002e-06 2024-04-01T19:54:28.998 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:28.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.800028+0000", 2024-04-01T19:54:28.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6565999999999999e-05 2024-04-01T19:54:28.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:28.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.800043+0000", 2024-04-01T19:54:28.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4956999999999999e-05 2024-04-01T19:54:28.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:28.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:28.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:28.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.800052+0000", 2024-04-01T19:54:28.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6419999999999996e-06 2024-04-01T19:54:29.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.000 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.000 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:29.000 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.800112+0000", 2024-04-01T19:54:29.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0847000000000002e-05 2024-04-01T19:54:29.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.000 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.000 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:29.000 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.800239+0000", 2024-04-01T19:54:29.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000126472 2024-04-01T19:54:29.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.000 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.000 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:54:29.000 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.800372+0000", 2024-04-01T19:54:29.001 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000133211 2024-04-01T19:54:29.001 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.001 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:29.001 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.802105+0000", 2024-04-01T19:54:29.001 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001732618 2024-04-01T19:54:29.001 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.001 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:29.001 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.827720+0000", 2024-04-01T19:54:29.001 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.025615598999999999 2024-04-01T19:54:29.001 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.001 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:29.002 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.827774+0000", 2024-04-01T19:54:29.002 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3872000000000002e-05 2024-04-01T19:54:29.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.002 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.002 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:29.002 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.827819+0000", 2024-04-01T19:54:29.002 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4694000000000003e-05 2024-04-01T19:54:29.002 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:29.002 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:29.002 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:29.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.002 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.002 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:46007 8.a 8:51dddb60:::benchmark_data_smithi188_161190_object46006:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e648)", 2024-04-01T19:54:29.003 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:54:27.800187+0000", 2024-04-01T19:54:29.003 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 1.084427196, 2024-04-01T19:54:29.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029299331000000001, 2024-04-01T19:54:29.003 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:29.003 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:29.003 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:29.003 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:29.003 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:54:29.003 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:54:29.003 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 46007 2024-04-01T19:54:29.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.003 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:29.003 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.003 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:29.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.800187+0000", 2024-04-01T19:54:29.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:29.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.004 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:29.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.800187+0000", 2024-04-01T19:54:29.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:29.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.004 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:29.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.800188+0000", 2024-04-01T19:54:29.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1680000000000001e-06 2024-04-01T19:54:29.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:29.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.800208+0000", 2024-04-01T19:54:29.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9930999999999999e-05 2024-04-01T19:54:29.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:29.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.800215+0000", 2024-04-01T19:54:29.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8390000000000001e-06 2024-04-01T19:54:29.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:29.006 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.800221+0000", 2024-04-01T19:54:29.006 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8250000000000001e-06 2024-04-01T19:54:29.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.006 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.006 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:29.006 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.800269+0000", 2024-04-01T19:54:29.006 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7883000000000002e-05 2024-04-01T19:54:29.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.006 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.006 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:29.006 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.800390+0000", 2024-04-01T19:54:29.007 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000121586 2024-04-01T19:54:29.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.007 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.007 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:54:29.007 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.800514+0000", 2024-04-01T19:54:29.007 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012404699999999999 2024-04-01T19:54:29.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.007 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.007 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:29.007 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.803492+0000", 2024-04-01T19:54:29.007 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0029778140000000001 2024-04-01T19:54:29.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.007 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.008 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:29.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.829400+0000", 2024-04-01T19:54:29.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.025907738999999999 2024-04-01T19:54:29.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.008 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:29.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.829446+0000", 2024-04-01T19:54:29.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5612000000000003e-05 2024-04-01T19:54:29.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.008 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:29.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.829486+0000", 2024-04-01T19:54:29.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0886999999999997e-05 2024-04-01T19:54:29.009 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:29.009 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:29.009 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:29.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.009 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:46011 8.a 8:52927097:::benchmark_data_smithi188_161190_object46010:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e648)", 2024-04-01T19:54:29.009 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:54:27.804429+0000", 2024-04-01T19:54:29.009 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 1.080185441, 2024-04-01T19:54:29.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029956917, 2024-04-01T19:54:29.009 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:29.009 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:29.009 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:29.010 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:29.010 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:54:29.010 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:54:29.010 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 46011 2024-04-01T19:54:29.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.010 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:29.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:29.010 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.804429+0000", 2024-04-01T19:54:29.010 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:29.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:29.011 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.804429+0000", 2024-04-01T19:54:29.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:29.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.011 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:29.011 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.804430+0000", 2024-04-01T19:54:29.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.08e-06 2024-04-01T19:54:29.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.011 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:29.011 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.804447+0000", 2024-04-01T19:54:29.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7079999999999999e-05 2024-04-01T19:54:29.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.012 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:29.012 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.804455+0000", 2024-04-01T19:54:29.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8490000000000006e-06 2024-04-01T19:54:29.012 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.012 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.012 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:29.012 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.804460+0000", 2024-04-01T19:54:29.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9949999999999996e-06 2024-04-01T19:54:29.012 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.012 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.012 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:29.012 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.827709+0000", 2024-04-01T19:54:29.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023249044999999999 2024-04-01T19:54:29.012 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.013 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.013 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:29.013 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.827866+0000", 2024-04-01T19:54:29.013 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015758499999999999 2024-04-01T19:54:29.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.013 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.013 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:54:29.013 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.827991+0000", 2024-04-01T19:54:29.013 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012491600000000001 2024-04-01T19:54:29.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.013 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.013 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:29.013 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.832455+0000", 2024-04-01T19:54:29.014 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0044640369999999997 2024-04-01T19:54:29.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.014 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.014 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:29.014 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.834284+0000", 2024-04-01T19:54:29.014 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00182898 2024-04-01T19:54:29.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.014 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.014 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:29.014 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.834336+0000", 2024-04-01T19:54:29.014 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1230000000000002e-05 2024-04-01T19:54:29.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.014 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.015 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:29.015 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.834386+0000", 2024-04-01T19:54:29.015 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0120000000000001e-05 2024-04-01T19:54:29.015 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:29.015 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:29.015 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:29.015 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.015 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.015 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:46020 8.a 8:5dd0b936:::benchmark_data_smithi188_161190_object46019:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e648)", 2024-04-01T19:54:29.015 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:54:27.806681+0000", 2024-04-01T19:54:29.015 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 1.0779336740000001, 2024-04-01T19:54:29.015 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.032284931000000003, 2024-04-01T19:54:29.016 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:54:29.016 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:54:29.016 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:54:29.016 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:54:29.016 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:54:29.016 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:54:29.016 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 46020 2024-04-01T19:54:29.016 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.016 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:54:29.016 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.016 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:54:29.016 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.806681+0000", 2024-04-01T19:54:29.016 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:29.016 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.017 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.017 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:54:29.017 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.806681+0000", 2024-04-01T19:54:29.017 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:54:29.017 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.017 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.017 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:54:29.017 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.806683+0000", 2024-04-01T19:54:29.017 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8989999999999999e-06 2024-04-01T19:54:29.017 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.017 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.017 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:54:29.017 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.806707+0000", 2024-04-01T19:54:29.017 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4110000000000001e-05 2024-04-01T19:54:29.017 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.018 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.018 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:54:29.018 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.827676+0000", 2024-04-01T19:54:29.018 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020969696999999999 2024-04-01T19:54:29.018 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.018 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.018 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:54:29.018 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.827689+0000", 2024-04-01T19:54:29.018 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.239e-05 2024-04-01T19:54:29.018 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.019 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.019 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:54:29.019 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.829535+0000", 2024-04-01T19:54:29.019 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001846545 2024-04-01T19:54:29.019 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.019 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.019 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:54:29.019 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.829634+0000", 2024-04-01T19:54:29.019 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8982999999999997e-05 2024-04-01T19:54:29.019 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.020 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.020 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:54:29.020 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.829757+0000", 2024-04-01T19:54:29.020 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000122819 2024-04-01T19:54:29.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.020 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.020 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:54:29.020 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.834429+0000", 2024-04-01T19:54:29.020 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.004672013 2024-04-01T19:54:29.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.020 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.020 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:54:29.021 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.838874+0000", 2024-04-01T19:54:29.021 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0044449270000000004 2024-04-01T19:54:29.021 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.021 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.021 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:54:29.021 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.838922+0000", 2024-04-01T19:54:29.021 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8383000000000001e-05 2024-04-01T19:54:29.021 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:54:29.021 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:54:29.022 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:54:29.022 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:54:27.838966+0000", 2024-04-01T19:54:29.022 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3164999999999998e-05 2024-04-01T19:54:29.022 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:29.022 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:29.022 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:29.022 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:54:29.022 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:54:29.022 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:54:29.023 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:28 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:54:29.023 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:28 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3703506910' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:54:29.023 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:28 smithi022 ceph-mon[39439]: osdmap e649: 12 total, 12 up, 11 in 2024-04-01T19:54:29.036 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:54:29.039 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:29.040 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:54:29.141 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:54:29.173 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:29.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:28 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:54:29.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:28 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3703506910' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:54:29.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:28 smithi062 ceph-mon[44211]: osdmap e649: 12 total, 12 up, 11 in 2024-04-01T19:54:29.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:28 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:54:29.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:28 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3703506910' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:54:29.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:28 smithi188 ceph-mon[43939]: osdmap e649: 12 total, 12 up, 11 in 2024-04-01T19:54:29.531 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:54:29.534 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:29.535 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:54:29.636 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:54:29.666 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:29.690 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:54:29.694 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:29.694 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:54:29.795 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:54:29.827 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:29.849 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:54:29.853 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 22 16 50311 50295 142.852 132.75 0.0069583 0.00699843 2024-04-01T19:54:29.855 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:29.856 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:54:29.957 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:54:29.989 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:30.109 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:54:30.115 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:54:30.119 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:30.119 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:54:30.220 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:54:30.255 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:30 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:54:30.255 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:30 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:54:30.256 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:30 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:54:30.256 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:30 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:54:30.256 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:30 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:54:30.256 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:30 smithi022 ceph-mon[39439]: pgmap v1778: 17 pgs: 17 active+clean; 2.6 GiB data, 11 GiB used, 973 GiB / 983 GiB avail; 109 MiB/s wr, 1.75k op/s; 2.7 MiB/s, 43 objects/s recovering 2024-04-01T19:54:30.258 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:30.261 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:30 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:54:30.262 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:30 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:54:30.262 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:30 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:54:30.262 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:30 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:54:30.262 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:30 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:54:30.262 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:30 smithi188 ceph-mon[43939]: pgmap v1778: 17 pgs: 17 active+clean; 2.6 GiB data, 11 GiB used, 973 GiB / 983 GiB avail; 109 MiB/s wr, 1.75k op/s; 2.7 MiB/s, 43 objects/s recovering 2024-04-01T19:54:30.306 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_ops_in_flight 2024-04-01T19:54:30.335 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:30 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:54:30.335 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:30 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:54:30.335 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:30 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:54:30.335 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:30 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:54:30.336 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:30 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:54:30.336 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:30 smithi062 ceph-mon[44211]: pgmap v1778: 17 pgs: 17 active+clean; 2.6 GiB data, 11 GiB used, 973 GiB / 983 GiB avail; 109 MiB/s wr, 1.75k op/s; 2.7 MiB/s, 43 objects/s recovering 2024-04-01T19:54:30.513 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:54:30.516 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:30.516 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:54:30.616 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:54:30.617 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:54:30.654 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:30.740 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:54:30.785 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:54:30.790 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:30.791 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:54:30.853 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 23 16 52200 52184 141.774 118.062 0.0043874 0.00705085 2024-04-01T19:54:30.892 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:54:30.905 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:54:30.926 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:30.949 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:54:30.951 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:30.952 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:54:31.053 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:54:31.067 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:31 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:54:31.067 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:31 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:54:31.067 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:31 smithi022 ceph-mon[39439]: osdmap e650: 12 total, 12 up, 11 in 2024-04-01T19:54:31.089 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:31.221 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:54:31.226 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:31.227 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:54:31.228 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:31 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:54:31.228 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:31 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:54:31.228 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:31 smithi062 ceph-mon[44211]: osdmap e650: 12 total, 12 up, 11 in 2024-04-01T19:54:31.327 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:54:31.360 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:31.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:31 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:54:31.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:31 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:54:31.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:31 smithi188 ceph-mon[43939]: osdmap e650: 12 total, 12 up, 11 in 2024-04-01T19:54:31.854 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 24 16 54357 54341 141.482 134.812 0.00614927 0.00706545 2024-04-01T19:54:32.096 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.8 to 1 (10000) 2024-04-01T19:54:32.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:32 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1328525612' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T19:54:32.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:32 smithi022 ceph-mon[39439]: from='client.37049 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T19:54:32.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:32 smithi022 ceph-mon[39439]: pgmap v1780: 17 pgs: 17 active+clean; 2.9 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 139 MiB/s wr, 2.22k op/s 2024-04-01T19:54:32.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:32 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1328525612' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T19:54:32.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:32 smithi188 ceph-mon[43939]: from='client.37049 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T19:54:32.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:32 smithi188 ceph-mon[43939]: pgmap v1780: 17 pgs: 17 active+clean; 2.9 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 139 MiB/s wr, 2.22k op/s 2024-04-01T19:54:32.426 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:32 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1328525612' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T19:54:32.426 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:32 smithi062 ceph-mon[44211]: from='client.37049 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T19:54:32.426 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:32 smithi062 ceph-mon[44211]: pgmap v1780: 17 pgs: 17 active+clean; 2.9 GiB data, 11 GiB used, 972 GiB / 983 GiB avail; 139 MiB/s wr, 2.22k op/s 2024-04-01T19:54:32.768 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:54:32.768 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:54:32.768 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 0 2024-04-01T19:54:32.769 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:54:32.854 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 25 16 56479 56463 141.128 132.625 0.0124731 0.00708376 2024-04-01T19:54:33.355 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:33 smithi022 ceph-mon[39439]: from='client.37049 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]': finished 2024-04-01T19:54:33.355 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:33 smithi022 ceph-mon[39439]: osdmap e651: 12 total, 12 up, 11 in 2024-04-01T19:54:33.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:33 smithi188 ceph-mon[43939]: from='client.37049 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]': finished 2024-04-01T19:54:33.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:33 smithi188 ceph-mon[43939]: osdmap e651: 12 total, 12 up, 11 in 2024-04-01T19:54:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:54:33.392 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 6 1 2024-04-01T19:54:33.480 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:33 smithi062 ceph-mon[44211]: from='client.37049 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]': finished 2024-04-01T19:54:33.480 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:33 smithi062 ceph-mon[44211]: osdmap e651: 12 total, 12 up, 11 in 2024-04-01T19:54:33.513 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_blocked_ops 2024-04-01T19:54:33.743 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:54:33.748 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:33.749 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:54:33.837 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:54:33.850 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:54:33.854 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 26 16 58512 58496 140.586 127.062 0.00420565 0.00711119 2024-04-01T19:54:33.901 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:33.939 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:54:33.951 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:33.952 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:54:34.053 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:54:34.111 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:34.138 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:54:34.142 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:34.143 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:54:34.244 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:54:34.292 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:34 smithi188 ceph-mon[43939]: pgmap v1782: 17 pgs: 17 active+clean; 3.2 GiB data, 12 GiB used, 972 GiB / 983 GiB avail; 131 MiB/s wr, 2.10k op/s 2024-04-01T19:54:34.296 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:34.330 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:54:34.334 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:34.335 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:54:34.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:34 smithi022 ceph-mon[39439]: pgmap v1782: 17 pgs: 17 active+clean; 3.2 GiB data, 12 GiB used, 972 GiB / 983 GiB avail; 131 MiB/s wr, 2.10k op/s 2024-04-01T19:54:34.387 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:34 smithi062 ceph-mon[44211]: pgmap v1782: 17 pgs: 17 active+clean; 3.2 GiB data, 12 GiB used, 972 GiB / 983 GiB avail; 131 MiB/s wr, 2.10k op/s 2024-04-01T19:54:34.435 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:54:34.484 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:34.525 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:54:34.529 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:34.529 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:54:34.630 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:54:34.662 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:34.813 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:54:34.816 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:34.816 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:54:34.845 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:54:34.854 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 27 16 60467 60451 139.905 122.188 0.00306367 0.00714516 2024-04-01T19:54:34.917 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:54:34.951 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:35.202 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:54:35.206 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:35.206 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:54:35.307 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:54:35.359 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:35.399 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:54:35.402 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:35.403 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:54:35.504 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:54:35.537 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:54:35.568 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:35.568 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:54:35.669 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:54:35.704 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:35.760 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:54:35.763 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:35.764 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:54:35.859 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 28 16 62443 62427 139.315 123.5 0.00940117 0.00717619 2024-04-01T19:54:35.864 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:54:35.898 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:35.926 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:54:35.926 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:54:35.926 INFO:teuthology.orchestra.run.smithi062.stdout: "complaint_time": 30, 2024-04-01T19:54:35.927 INFO:teuthology.orchestra.run.smithi062.stdout: "num_blocked_ops": 0 2024-04-01T19:54:35.927 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:54:35.927 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:54:35.931 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:35.931 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:54:36.033 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:54:36.087 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:36.121 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:54:36.126 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:36.127 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:54:36.228 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:54:36.260 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:36.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:36 smithi022 ceph-mon[39439]: pgmap v1783: 17 pgs: 17 active+clean; 3.3 GiB data, 12 GiB used, 971 GiB / 983 GiB avail; 104 MiB/s wr, 1.67k op/s 2024-04-01T19:54:36.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:36 smithi022 ceph-mon[39439]: osdmap e652: 12 total, 12 up, 11 in 2024-04-01T19:54:36.667 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:36 smithi062 ceph-mon[44211]: pgmap v1783: 17 pgs: 17 active+clean; 3.3 GiB data, 12 GiB used, 971 GiB / 983 GiB avail; 104 MiB/s wr, 1.67k op/s 2024-04-01T19:54:36.667 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:36 smithi062 ceph-mon[44211]: osdmap e652: 12 total, 12 up, 11 in 2024-04-01T19:54:36.703 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_historic_ops 2024-04-01T19:54:36.855 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 29 16 64331 64315 138.579 118 0.00877603 0.00721419 2024-04-01T19:54:36.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:36 smithi188 ceph-mon[43939]: pgmap v1783: 17 pgs: 17 active+clean; 3.3 GiB data, 12 GiB used, 971 GiB / 983 GiB avail; 104 MiB/s wr, 1.67k op/s 2024-04-01T19:54:36.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:36 smithi188 ceph-mon[43939]: osdmap e652: 12 total, 12 up, 11 in 2024-04-01T19:54:37.023 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:54:37.316 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:54:37.320 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:37.321 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:54:37.422 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:54:37.456 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:37.534 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:54:37.536 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:37.537 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:54:37.562 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:37 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:54:37.562 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:37 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:54:37.562 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:37 smithi062 ceph-mon[44211]: osdmap e653: 12 total, 12 up, 11 in 2024-04-01T19:54:37.562 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:37 smithi062 ceph-mon[44211]: pgmap v1786: 17 pgs: 17 active+clean; 3.7 GiB data, 13 GiB used, 970 GiB / 983 GiB avail; 140 MiB/s wr, 2.24k op/s 2024-04-01T19:54:37.607 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:54:37.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:37 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:54:37.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:37 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:54:37.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:37 smithi022 ceph-mon[39439]: osdmap e653: 12 total, 12 up, 11 in 2024-04-01T19:54:37.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:37 smithi022 ceph-mon[39439]: pgmap v1786: 17 pgs: 17 active+clean; 3.7 GiB data, 13 GiB used, 970 GiB / 983 GiB avail; 140 MiB/s wr, 2.24k op/s 2024-04-01T19:54:37.629 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:54:37.637 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:54:37.653 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:54:37.671 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:37.678 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:54:37.704 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:54:37.730 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:54:37.768 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:54:37.790 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:54:37.822 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:54:37.849 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:54:37.855 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 30 16 66225 66209 137.906 118.375 0.00383351 0.00724973 2024-04-01T19:54:37.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:37 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:54:37.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:37 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:54:37.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:37 smithi188 ceph-mon[43939]: osdmap e653: 12 total, 12 up, 11 in 2024-04-01T19:54:37.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:37 smithi188 ceph-mon[43939]: pgmap v1786: 17 pgs: 17 active+clean; 3.7 GiB data, 13 GiB used, 970 GiB / 983 GiB avail; 140 MiB/s wr, 2.24k op/s 2024-04-01T19:54:37.876 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:54:37.903 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:54:37.904 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:54:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:54:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:54:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:54:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:54:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:54:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:54:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:54:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:54:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:54:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:54:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:54:38.225 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:54:38.227 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:38.228 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:54:38.329 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:54:38.362 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:38.465 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:54:38.469 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:38.470 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:54:38.470 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:54:38.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:38 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1744410621' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:54:38.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:38.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:38.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:38.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:38.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:38.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:38.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:38.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:38 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2618347332' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:54:38.571 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:54:38.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:38 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1744410621' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:54:38.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:38.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:38.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:38.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:38.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:38.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:38 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2618347332' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:54:38.619 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:38.650 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:54:38.653 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:38.653 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:54:38.754 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:54:38.790 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:38.855 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 31 16 68098 68082 137.233 117.062 0.0101997 0.00728458 2024-04-01T19:54:38.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:38 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1744410621' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:54:38.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:38.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:38.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:38.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:38.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:38.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:38.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:38.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:38 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2618347332' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:54:38.892 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:54:38.895 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:38.895 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:54:38.996 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:54:39.028 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:39.052 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:54:39.065 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:39.066 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:54:39.167 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:54:39.197 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:39.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:39 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:54:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:39 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2618347332' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:54:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:39 smithi062 ceph-mon[44211]: osdmap e654: 12 total, 12 up, 11 in 2024-04-01T19:54:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:39 smithi062 ceph-mon[44211]: pgmap v1788: 17 pgs: 17 active+clean; 3.9 GiB data, 13 GiB used, 970 GiB / 983 GiB avail; 110 MiB/s wr, 1.77k op/s 2024-04-01T19:54:39.855 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 32 16 69942 69926 136.546 115.25 0.00466654 0.00732145 2024-04-01T19:54:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:39 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:54:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:39 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2618347332' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:54:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:39 smithi022 ceph-mon[39439]: osdmap e654: 12 total, 12 up, 11 in 2024-04-01T19:54:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:39 smithi022 ceph-mon[39439]: pgmap v1788: 17 pgs: 17 active+clean; 3.9 GiB data, 13 GiB used, 970 GiB / 983 GiB avail; 110 MiB/s wr, 1.77k op/s 2024-04-01T19:54:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:39 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:54:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:39 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2618347332' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:54:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:39 smithi188 ceph-mon[43939]: osdmap e654: 12 total, 12 up, 11 in 2024-04-01T19:54:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:39 smithi188 ceph-mon[43939]: pgmap v1788: 17 pgs: 17 active+clean; 3.9 GiB data, 13 GiB used, 970 GiB / 983 GiB avail; 110 MiB/s wr, 1.77k op/s 2024-04-01T19:54:40.293 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:54:40.298 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:40.298 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:54:40.399 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:54:40.450 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:40.484 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:54:40.490 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:40.491 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:54:40.591 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:54:40.641 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:40.672 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:54:40.676 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:40.676 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:54:40.777 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:54:40.814 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:40.855 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 33 16 71707 71691 135.751 110.312 0.0108105 0.00736403 2024-04-01T19:54:40.945 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:54:40.949 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:40.949 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:54:40.961 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:54:40.961 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:54:41.050 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:54:41.085 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:41.214 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:54:41.219 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:41.219 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:54:41.320 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:54:41.371 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:41.410 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:54:41.411 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:41.411 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:54:41.475 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.6 to 1 (10000) 2024-04-01T19:54:41.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:41 smithi062 ceph-mon[44211]: pgmap v1789: 17 pgs: 17 active+clean; 4.1 GiB data, 14 GiB used, 970 GiB / 983 GiB avail; 135 MiB/s wr, 2.15k op/s 2024-04-01T19:54:41.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:41 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2756514370' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T19:54:41.512 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:54:41.522 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:54:41.563 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:41.594 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:54:41.599 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:41.600 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:54:41.623 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:41 smithi188 ceph-mon[43939]: pgmap v1789: 17 pgs: 17 active+clean; 4.1 GiB data, 14 GiB used, 970 GiB / 983 GiB avail; 135 MiB/s wr, 2.15k op/s 2024-04-01T19:54:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:41 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2756514370' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T19:54:41.685 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_ops_in_flight 2024-04-01T19:54:41.701 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:54:41.719 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:41 smithi022 ceph-mon[39439]: pgmap v1789: 17 pgs: 17 active+clean; 4.1 GiB data, 14 GiB used, 970 GiB / 983 GiB avail; 135 MiB/s wr, 2.15k op/s 2024-04-01T19:54:41.719 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:41 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2756514370' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T19:54:41.746 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:41.779 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:54:41.786 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:41.787 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:54:41.855 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 34 16 73442 73426 134.947 108.438 0.00906385 0.00740808 2024-04-01T19:54:41.888 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:54:41.931 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:41.965 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:54:41.972 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:41.972 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:54:42.073 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:54:42.118 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:42.150 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:54:42.153 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:42.154 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:54:42.224 INFO:tasks.thrashosds.thrasher:test_map_discontinuity 2024-04-01T19:54:42.225 INFO:tasks.thrashosds.thrasher:Waiting for recovery 2024-04-01T19:54:42.225 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-01T19:54:42.225 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-04-01T19:54:42.254 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:54:42.309 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:42.340 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:54:42.397 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:54:42.398 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:42.398 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:54:42.499 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:54:42.544 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:42.579 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:54:42.582 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:42.582 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:54:42.604 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:54:42.683 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:54:42.722 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:42.752 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:54:42.757 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:42 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2756514370' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-04-01T19:54:42.757 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:42 smithi188 ceph-mon[43939]: osdmap e655: 12 total, 12 up, 11 in 2024-04-01T19:54:42.757 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:42 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:54:42.757 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:42 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:54:42.758 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:42.758 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:54:42.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:42 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2756514370' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-04-01T19:54:42.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:42 smithi062 ceph-mon[44211]: osdmap e655: 12 total, 12 up, 11 in 2024-04-01T19:54:42.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:42 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:54:42.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:42 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:54:42.855 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 35 16 75122 75106 134.092 105 0.00666417 0.00745585 2024-04-01T19:54:42.859 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:54:42.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:42 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2756514370' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-04-01T19:54:42.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:42 smithi022 ceph-mon[39439]: osdmap e655: 12 total, 12 up, 11 in 2024-04-01T19:54:42.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:42 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:54:42.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:42 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:54:42.891 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:42.913 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:54:42.916 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:42.916 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:54:43.017 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:54:43.049 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:43.071 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:54:43.075 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:43.075 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:54:43.111 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:54:43.175 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:54:43.214 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:43.346 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:54:43.348 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:54:43.352 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:43.353 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:54:43.453 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:54:43.497 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:43.530 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:54:43.534 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:43.534 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:54:43.569 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:54:43.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:43 smithi022 ceph-mon[39439]: osdmap e656: 12 total, 12 up, 11 in 2024-04-01T19:54:43.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:43 smithi022 ceph-mon[39439]: pgmap v1792: 17 pgs: 17 active+clean; 4.4 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 115 MiB/s wr, 1.85k op/s 2024-04-01T19:54:43.635 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:54:43.665 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:43.688 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:54:43.690 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:43.691 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:54:43.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:43 smithi062 ceph-mon[44211]: osdmap e656: 12 total, 12 up, 11 in 2024-04-01T19:54:43.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:43 smithi062 ceph-mon[44211]: pgmap v1792: 17 pgs: 17 active+clean; 4.4 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 115 MiB/s wr, 1.85k op/s 2024-04-01T19:54:43.792 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:54:43.826 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:43.855 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 36 16 76864 76848 133.391 108.875 0.00531191 0.00749529 2024-04-01T19:54:43.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:43 smithi188 ceph-mon[43939]: osdmap e656: 12 total, 12 up, 11 in 2024-04-01T19:54:43.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:43 smithi188 ceph-mon[43939]: pgmap v1792: 17 pgs: 17 active+clean; 4.4 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 115 MiB/s wr, 1.85k op/s 2024-04-01T19:54:44.855 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 37 16 78591 78575 132.703 107.938 0.00371237 0.00753386 2024-04-01T19:54:45.855 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 38 16 80269 80253 131.97 104.875 0.00731322 0.00757608 2024-04-01T19:54:46.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:45 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:54:46.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:45 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:54:46.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:45 smithi062 ceph-mon[44211]: osdmap e657: 12 total, 12 up, 11 in 2024-04-01T19:54:46.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:45 smithi062 ceph-mon[44211]: pgmap v1794: 17 pgs: 17 active+clean; 4.5 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 108 MiB/s wr, 1.72k op/s 2024-04-01T19:54:46.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:45 smithi062 ceph-mon[44211]: osdmap e658: 12 total, 12 up, 11 in 2024-04-01T19:54:46.348 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:45 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:54:46.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:45 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:54:46.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:45 smithi022 ceph-mon[39439]: osdmap e657: 12 total, 12 up, 11 in 2024-04-01T19:54:46.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:45 smithi022 ceph-mon[39439]: pgmap v1794: 17 pgs: 17 active+clean; 4.5 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 108 MiB/s wr, 1.72k op/s 2024-04-01T19:54:46.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:45 smithi022 ceph-mon[39439]: osdmap e658: 12 total, 12 up, 11 in 2024-04-01T19:54:46.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:45 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:54:46.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:45 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:54:46.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:45 smithi188 ceph-mon[43939]: osdmap e657: 12 total, 12 up, 11 in 2024-04-01T19:54:46.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:45 smithi188 ceph-mon[43939]: pgmap v1794: 17 pgs: 17 active+clean; 4.5 GiB data, 14 GiB used, 969 GiB / 983 GiB avail; 108 MiB/s wr, 1.72k op/s 2024-04-01T19:54:46.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:45 smithi188 ceph-mon[43939]: osdmap e658: 12 total, 12 up, 11 in 2024-04-01T19:54:46.687 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:54:46.690 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:46.691 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:54:46.792 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:54:46.842 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:46.855 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 39 16 81890 81874 131.184 101.312 0.0241784 0.00762021 2024-04-01T19:54:46.872 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:54:46.877 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:46.877 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:54:46.978 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:54:47.009 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:47.030 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:54:47.035 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:47.035 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:54:47.136 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:54:47.168 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:47.376 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:54:47.380 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:47.380 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:54:47.481 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:54:47.516 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:47.857 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:54:47.860404 min lat: 0.00103479 max lat: 2.06154 avg lat: 0.00766074 2024-04-01T19:54:47.857 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:54:47.857 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 40 16 83555 83539 130.501 104.062 0.00976469 0.00766074 2024-04-01T19:54:48.275 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:54:48.280 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:48.280 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:54:48.381 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:54:48.416 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:48.439 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:54:48.442 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:48.442 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:54:48.543 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:54:48.579 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:48 smithi022 ceph-mon[39439]: pgmap v1796: 17 pgs: 17 active+clean; 4.8 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 92 MiB/s wr, 1.48k op/s 2024-04-01T19:54:48.583 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:48.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:48 smithi062 ceph-mon[44211]: pgmap v1796: 17 pgs: 17 active+clean; 4.8 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 92 MiB/s wr, 1.48k op/s 2024-04-01T19:54:48.857 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 41 16 85170 85154 129.78 100.938 0.00833524 0.00770352 2024-04-01T19:54:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:48 smithi188 ceph-mon[43939]: pgmap v1796: 17 pgs: 17 active+clean; 4.8 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 92 MiB/s wr, 1.48k op/s 2024-04-01T19:54:49.139 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:54:49.143 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:49.143 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:54:49.244 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:54:49.271 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:54:49.271 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":658,"fsid":"09f6b846-f05c-11ee-b647-cb9ed24678a4","created":"2024-04-01T19:15:34.344221+0000","modified":"2024-04-01T19:54:45.451999+0000","last_up_change":"2024-04-01T19:50:17.008336+0000","last_in_change":"2024-04-01T19:48:26.306708+0000","flags":"nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5804032,"flags_set":["nodeep-scrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":32,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T19:18:34.605751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"unique_pool_6","create_time":"2024-04-01T19:53:51.926844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"634","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3.7699999809265137,"score_stable":3.7699999809265137,"optimal_score":0.82999998331069946,"raw_score_acting":3.130000114440918,"raw_score_stable":3.130000114440918,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfd4aa7e-a933-42e2-aac8-f93a3d9fcc3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":643,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":1419201649}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":1419201649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":1419201649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":1419201649}]},"public_addr":"172.21.15.22:6801/1419201649","cluster_addr":"172.21.15.22:6802/1419201649","heartbeat_back_addr":"172.21.15.22:6804/1419201649","heartbeat_front_addr":"172.21.15.22:6803/1419201649","state":["exists","up"]},{"osd":1,"uuid":"6ddadf19-2b4e-4c01-8918-9d51c323925b","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":534,"up_from":571,"up_thru":469,"down_at":535,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":3304599570}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":3304599570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6808","nonce":3304599570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":3304599570}]},"public_addr":"172.21.15.22:6805/3304599570","cluster_addr":"172.21.15.22:6806/3304599570","heartbeat_back_addr":"172.21.15.22:6808/3304599570","heartbeat_front_addr":"172.21.15.22:6807/3304599570","state":["exists","up"]},{"osd":2,"uuid":"4af1f44c-f47c-4ce6-87ba-1aeec3960969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":560,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":835455757}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":835455757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":835455757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":835455757}]},"public_addr":"172.21.15.22:6809/835455757","cluster_addr":"172.21.15.22:6810/835455757","heartbeat_back_addr":"172.21.15.22:6812/835455757","heartbeat_front_addr":"172.21.15.22:6811/835455757","state":["exists","up"]},{"osd":3,"uuid":"c399f336-23c7-414a-822e-63793daf85c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":629,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":90988887}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":90988887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":90988887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":90988887}]},"public_addr":"172.21.15.22:6813/90988887","cluster_addr":"172.21.15.22:6814/90988887","heartbeat_back_addr":"172.21.15.22:6816/90988887","heartbeat_front_addr":"172.21.15.22:6815/90988887","state":["exists","up"]},{"osd":4,"uuid":"0a2690dc-e5b6-4d29-b517-980018519d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":642,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6800","nonce":2408168690}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6801","nonce":2408168690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6803","nonce":2408168690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6802","nonce":2408168690}]},"public_addr":"172.21.15.62:6800/2408168690","cluster_addr":"172.21.15.62:6801/2408168690","heartbeat_back_addr":"172.21.15.62:6803/2408168690","heartbeat_front_addr":"172.21.15.62:6802/2408168690","state":["exists","up"]},{"osd":5,"uuid":"c6830412-959a-4f1e-8c3d-f4b2d88673e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":629,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6804","nonce":386874616}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6805","nonce":386874616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6807","nonce":386874616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6806","nonce":386874616}]},"public_addr":"172.21.15.62:6804/386874616","cluster_addr":"172.21.15.62:6805/386874616","heartbeat_back_addr":"172.21.15.62:6807/386874616","heartbeat_front_addr":"172.21.15.62:6806/386874616","state":["exists","up"]},{"osd":6,"uuid":"f646310b-91a4-4259-a51f-6a0e92b7cba8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":335,"last_clean_end":421,"up_from":457,"up_thru":560,"down_at":422,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6808","nonce":2644974032}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6809","nonce":2644974032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6811","nonce":2644974032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6810","nonce":2644974032}]},"public_addr":"172.21.15.62:6808/2644974032","cluster_addr":"172.21.15.62:6809/2644974032","heartbeat_back_addr":"172.21.15.62:6811/2644974032","heartbeat_front_addr":"172.21.15.62:6810/2644974032","state":["exists","up"]},{"osd":7,"uuid":"afe5f371-c892-43e9-b82e-c2d911354e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":469,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6812","nonce":2055487337}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6813","nonce":2055487337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6815","nonce":2055487337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6814","nonce":2055487337}]},"public_addr":"172.21.15.62:6812/2055487337","cluster_addr":"172.21.15.62:6813/2055487337","heartbeat_back_addr":"172.21.15.62:6815/2055487337","heartbeat_front_addr":"172.21.15.62:6814/2055487337","state":["exists","up"]},{"osd":8,"uuid":"b7eb6461-f6fa-4a12-864c-6e6748e6337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":63,"last_clean_end":159,"up_from":197,"up_thru":629,"down_at":160,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6800","nonce":1873408265}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6801","nonce":1873408265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6803","nonce":1873408265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6802","nonce":1873408265}]},"public_addr":"172.21.15.188:6800/1873408265","cluster_addr":"172.21.15.188:6801/1873408265","heartbeat_back_addr":"172.21.15.188:6803/1873408265","heartbeat_front_addr":"172.21.15.188:6802/1873408265","state":["exists","up"]},{"osd":9,"uuid":"7d496ad5-46bf-485a-81d9-2b9da2a59882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":629,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6804","nonce":1755990887}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6805","nonce":1755990887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6807","nonce":1755990887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6806","nonce":1755990887}]},"public_addr":"172.21.15.188:6804/1755990887","cluster_addr":"172.21.15.188:6805/1755990887","heartbeat_back_addr":"172.21.15.188:6807/1755990887","heartbeat_front_addr":"172.21.15.188:6806/1755990887","state":["exists","up"]},{"osd":10,"uuid":"6cbb80ce-37f7-48df-9090-09a6068e4490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":644,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6808","nonce":3777340429}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6809","nonce":3777340429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6811","nonce":3777340429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6810","nonce":3777340429}]},"public_addr":"172.21.15.188:6808/3777340429","cluster_addr":"172.21.15.188:6809/3777340429","heartbeat_back_addr":"172.21.15.188:6811/3777340429","heartbeat_front_addr":"172.21.15.188:6810/3777340429","state":["exists","up"]},{"osd":11,"uuid":"c03517c4-fdb0-4587-96c1-b959041c4344","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":637,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6812","nonce":3987199514}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6813","nonce":3987199514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6815","nonce":3987199514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6814","nonce":3987199514}]},"public_addr":"172.21.15.188:6812/3987199514","cluster_addr":"172.21.15.188:6813/3987199514","heartbeat_back_addr":"172.21.15.188:6815/3987199514","heartbeat_front_addr":"172.21.15.188:6814/3987199514","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:53:33.216263+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":65536,"last_purged_snaps_scrub":"2024-04-01T19:53:52.382306+0000","dead_epoch":534},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:54:41.631969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:54:13.179623+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:54:17.675371+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:54:35.943684+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:53:54.707376+0000","dead_epoch":421},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:53:56.070015+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:54:24.831697+0000","dead_epoch":159},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:54:44.877273+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:53:55.635560+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T19:54:29.729695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/3735983556":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/3575578250":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/2493529775":"2024-04-02T19:16:02.302343+0000","172.21.15.22:6800/2678666836":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/2389537847":"2024-04-02T19:16:02.302343+0000","172.21.15.22:0/798807675":"2024-04-02T19:16:02.302343+0000","172.21.15.22:6800/1090179981":"2024-04-02T19:16:02.302343+0000","172.21.15.22:0/51907384":"2024-04-02T19:16:30.513384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T19:54:49.295 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:49.320 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:54:49.324 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:49.325 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:54:49.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:49 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4140588455' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T19:54:49.426 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:54:49.457 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:49.481 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:54:49.485 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:49.485 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:54:49.586 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:54:49.624 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:49.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:49 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4140588455' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T19:54:49.652 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:54:49.668 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:49.668 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:54:49.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:49 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4140588455' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T19:54:49.769 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:54:49.813 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:49.842 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:54:49.847 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:49.848 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:54:49.857 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 42 16 86729 86713 129.01 97.4375 0.0122036 0.00774953 2024-04-01T19:54:49.949 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:54:49.985 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:50.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:50 smithi062 ceph-mon[44211]: pgmap v1797: 17 pgs: 17 active+clean; 4.9 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 98 MiB/s wr, 1.57k op/s 2024-04-01T19:54:50.857 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 43 16 88294 88278 128.284 97.8125 0.00485801 0.00779346 2024-04-01T19:54:50.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:50 smithi022 ceph-mon[39439]: pgmap v1797: 17 pgs: 17 active+clean; 4.9 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 98 MiB/s wr, 1.57k op/s 2024-04-01T19:54:50.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:50 smithi188 ceph-mon[43939]: pgmap v1797: 17 pgs: 17 active+clean; 4.9 GiB data, 15 GiB used, 968 GiB / 983 GiB avail; 98 MiB/s wr, 1.57k op/s 2024-04-01T19:54:51.441 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-01T19:54:51.542 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:54:51.545 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:51 smithi022 ceph-mon[39439]: pgmap v1798: 17 pgs: 17 active+clean; 5.2 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 99 MiB/s wr, 1.59k op/s 2024-04-01T19:54:51.546 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:51.546 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:54:51.647 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:54:51.679 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:51.703 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:54:51.707 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:51.707 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:54:51.722 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:54:51.749 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:54:51.749 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:54:51.751 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:54:51.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:51 smithi062 ceph-mon[44211]: pgmap v1798: 17 pgs: 17 active+clean; 5.2 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 99 MiB/s wr, 1.59k op/s 2024-04-01T19:54:51.776 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:54:51.804 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:54:51.809 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:54:51.827 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:54:51.842 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:51.855 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:54:51.858 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 44 16 89847 89831 127.571 97.0625 0.00956881 0.00783734 2024-04-01T19:54:51.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:51 smithi188 ceph-mon[43939]: pgmap v1798: 17 pgs: 17 active+clean; 5.2 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 99 MiB/s wr, 1.59k op/s 2024-04-01T19:54:51.885 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:54:51.909 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:54:51.939 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:54:51.968 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:54:51.996 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:54:52.000 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:54:52.004 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:52.004 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:54:52.029 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:54:52.031 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:54:52.032 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:54:52.032 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:54:52.032 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:54:52.032 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:54:52.032 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:54:52.032 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:54:52.033 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:54:52.033 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:54:52.033 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:54:52.033 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:54:52.033 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:54:52.105 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:54:52.136 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:52.158 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:54:52.162 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:52.163 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:54:52.264 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:54:52.294 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:52.316 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:54:52.320 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:52.320 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:54:52.422 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:54:52.463 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:52.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:52 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/723343194' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:54:52.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:52.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:52.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:52.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:52.820 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:52 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/723343194' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:54:52.820 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:52.820 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:52.820 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:52.820 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:52.852 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_blocked_ops 2024-04-01T19:54:52.858 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 45 16 91303 91287 126.759 91 0.011599 0.00788741 2024-04-01T19:54:52.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:52 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/723343194' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:54:52.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:52.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:52.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:52.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:53.479 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:53.479 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:53.479 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:53.479 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:53.479 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:53.479 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:53.479 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:53.480 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:53.480 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:53 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3411899208' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:54:53.480 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:53 smithi022 ceph-mon[39439]: pgmap v1799: 17 pgs: 17 active+clean; 5.4 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 111 MiB/s wr, 1.78k op/s 2024-04-01T19:54:53.482 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:54:53.488 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:54:53.493 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:53.494 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:54:53.595 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:54:53.627 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:53.741 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:54:53.744 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:53.745 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:54:53.750 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:54:53.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:53.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:53.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:53.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:53.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:53.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:53.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:53.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:53.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:53 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3411899208' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:54:53.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:53 smithi062 ceph-mon[44211]: pgmap v1799: 17 pgs: 17 active+clean; 5.4 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 111 MiB/s wr, 1.78k op/s 2024-04-01T19:54:53.846 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:54:53.859 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 46 16 92800 92784 126.037 93.5625 0.0180852 0.00793194 2024-04-01T19:54:53.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:53.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:53.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:53.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:53.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:53.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:53.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:53.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:54:53.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:53 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3411899208' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:54:53.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:53 smithi188 ceph-mon[43939]: pgmap v1799: 17 pgs: 17 active+clean; 5.4 GiB data, 16 GiB used, 967 GiB / 983 GiB avail; 111 MiB/s wr, 1.78k op/s 2024-04-01T19:54:53.876 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:54.030 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:54:54.033 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:54.034 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:54:54.135 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:54:54.169 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:54.245 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:54:54.248 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:54.249 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:54:54.350 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:54:54.383 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:54.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:54 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:54:54.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:54 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:54:54.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:54 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3411899208' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:54:54.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:54 smithi022 ceph-mon[39439]: osdmap e659: 12 total, 12 up, 11 in 2024-04-01T19:54:54.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:54 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:54:54.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:54 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:54:54.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:54 smithi022 ceph-mon[39439]: 8.3 scrub starts 2024-04-01T19:54:54.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:54 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:54:54.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:54 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:54:54.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:54 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3411899208' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:54:54.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:54 smithi062 ceph-mon[44211]: osdmap e659: 12 total, 12 up, 11 in 2024-04-01T19:54:54.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:54 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:54:54.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:54 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:54:54.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:54 smithi062 ceph-mon[44211]: 8.3 scrub starts 2024-04-01T19:54:54.859 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 47 16 94127 94111 125.12 82.9375 0.0138305 0.00799075 2024-04-01T19:54:54.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:54 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:54:54.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:54 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:54:54.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:54 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3411899208' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:54:54.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:54 smithi188 ceph-mon[43939]: osdmap e659: 12 total, 12 up, 11 in 2024-04-01T19:54:54.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:54 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:54:54.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:54 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:54:54.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:54 smithi188 ceph-mon[43939]: 8.3 scrub starts 2024-04-01T19:54:55.147 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:54:55.149 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:55.150 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:54:55.251 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:54:55.281 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:55.306 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:54:55.311 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:55.312 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:54:55.413 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:54:55.442 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:55.519 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:54:55.601 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:54:55.606 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:55.607 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:54:55.708 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:54:55.753 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:55 smithi188 ceph-mon[43939]: osdmap e660: 12 total, 12 up, 11 in 2024-04-01T19:54:55.753 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:55 smithi188 ceph-mon[43939]: pgmap v1802: 17 pgs: 17 active+clean; 5.5 GiB data, 17 GiB used, 967 GiB / 983 GiB avail; 86 MiB/s wr, 1.38k op/s 2024-04-01T19:54:55.753 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:55.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:55 smithi062 ceph-mon[44211]: osdmap e660: 12 total, 12 up, 11 in 2024-04-01T19:54:55.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:55 smithi062 ceph-mon[44211]: pgmap v1802: 17 pgs: 17 active+clean; 5.5 GiB data, 17 GiB used, 967 GiB / 983 GiB avail; 86 MiB/s wr, 1.38k op/s 2024-04-01T19:54:55.779 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:54:55.782 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:55.782 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:54:55.859 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 48 16 95354 95338 124.111 76.6875 0.00529976 0.0080549 2024-04-01T19:54:55.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:55 smithi022 ceph-mon[39439]: osdmap e660: 12 total, 12 up, 11 in 2024-04-01T19:54:55.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:55 smithi022 ceph-mon[39439]: pgmap v1802: 17 pgs: 17 active+clean; 5.5 GiB data, 17 GiB used, 967 GiB / 983 GiB avail; 86 MiB/s wr, 1.38k op/s 2024-04-01T19:54:55.883 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:54:55.915 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:54:55.950 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:55.951 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:54:56.052 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:54:56.081 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:56.102 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:54:56.107 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:56.107 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:54:56.208 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:54:56.265 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:56.281 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:54:56.296 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:54:56.296 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:54:56.296 INFO:teuthology.orchestra.run.smithi022.stdout: "complaint_time": 30, 2024-04-01T19:54:56.296 INFO:teuthology.orchestra.run.smithi022.stdout: "num_blocked_ops": 0 2024-04-01T19:54:56.297 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:54:56.304 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:54:56.310 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:56.311 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:54:56.412 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:54:56.462 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:56.503 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:54:56.509 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:56.510 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:54:56.593 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:56 smithi022 ceph-mon[39439]: 8.4 deep-scrub starts 2024-04-01T19:54:56.593 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:56 smithi022 ceph-mon[39439]: 8.3 scrub ok 2024-04-01T19:54:56.593 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:56 smithi022 ceph-mon[39439]: 8.1 deep-scrub starts 2024-04-01T19:54:56.611 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:54:56.662 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:56.686 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:54:56.689 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:56.690 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:54:56.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:56 smithi062 ceph-mon[44211]: 8.4 deep-scrub starts 2024-04-01T19:54:56.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:56 smithi062 ceph-mon[44211]: 8.3 scrub ok 2024-04-01T19:54:56.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:56 smithi062 ceph-mon[44211]: 8.1 deep-scrub starts 2024-04-01T19:54:56.790 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:54:56.825 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:56.859 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 49 16 96452 96436 122.979 68.625 0.00523536 0.00812709 2024-04-01T19:54:56.873 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:56 smithi188 ceph-mon[43939]: 8.4 deep-scrub starts 2024-04-01T19:54:56.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:56 smithi188 ceph-mon[43939]: 8.3 scrub ok 2024-04-01T19:54:56.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:56 smithi188 ceph-mon[43939]: 8.1 deep-scrub starts 2024-04-01T19:54:57.141 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:54:57.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:57 smithi022 ceph-mon[39439]: pgmap v1803: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 5.7 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 104 MiB/s wr, 1.66k op/s 2024-04-01T19:54:57.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:57 smithi062 ceph-mon[44211]: pgmap v1803: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 5.7 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 104 MiB/s wr, 1.66k op/s 2024-04-01T19:54:57.859 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 50 16 97604 97588 121.958 72 0.00364203 0.00819697 2024-04-01T19:54:57.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:57 smithi188 ceph-mon[43939]: pgmap v1803: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 5.7 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 104 MiB/s wr, 1.66k op/s 2024-04-01T19:54:57.981 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:54:57.986 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:57.986 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:54:58.087 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:54:58.133 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:58.171 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:54:58.179 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:58.180 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:54:58.281 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:54:58.336 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:58.386 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:54:58.392 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:58.392 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:54:58.493 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:54:58.527 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:58.860 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 51 16 98507 98491 120.673 56.4375 0.0091387 0.00828241 2024-04-01T19:54:59.280 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:54:59.280 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:54:59.284 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_historic_ops 2024-04-01T19:54:59.286 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:59.287 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:54:59.387 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:54:59.429 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:59.457 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:54:59.460 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:59.460 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:54:59.513 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:59 smithi022 ceph-mon[39439]: 8.a scrub starts 2024-04-01T19:54:59.513 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:59 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:54:59.513 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:59 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:54:59.513 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:59 smithi022 ceph-mon[39439]: osdmap e661: 12 total, 12 up, 11 in 2024-04-01T19:54:59.514 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:54:59 smithi022 ceph-mon[39439]: pgmap v1805: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 5.8 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 76 MiB/s wr, 1.21k op/s 2024-04-01T19:54:59.561 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:54:59.597 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:59.806 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:54:59.809 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:59.809 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:54:59.860 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 52 16 99571 99555 119.632 66.5 0.0318589 0.00835701 2024-04-01T19:54:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:59 smithi188 ceph-mon[43939]: 8.a scrub starts 2024-04-01T19:54:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:59 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:54:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:59 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:54:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:59 smithi188 ceph-mon[43939]: osdmap e661: 12 total, 12 up, 11 in 2024-04-01T19:54:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:54:59 smithi188 ceph-mon[43939]: pgmap v1805: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 5.8 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 76 MiB/s wr, 1.21k op/s 2024-04-01T19:54:59.910 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:54:59.947 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:54:59.975 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:54:59.987 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:54:59.987 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:55:00.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:59 smithi062 ceph-mon[44211]: 8.a scrub starts 2024-04-01T19:55:00.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:59 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:55:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:59 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:55:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:59 smithi062 ceph-mon[44211]: osdmap e661: 12 total, 12 up, 11 in 2024-04-01T19:55:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:54:59 smithi062 ceph-mon[44211]: pgmap v1805: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 5.8 GiB data, 17 GiB used, 966 GiB / 983 GiB avail; 76 MiB/s wr, 1.21k op/s 2024-04-01T19:55:00.088 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:55:00.122 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:00.144 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:55:00.148 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:00.149 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:55:00.250 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:55:00.280 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:00.302 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:55:00.304 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:00.304 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:55:00.332 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:55:00.357 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:55:00.384 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:55:00.405 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:55:00.408 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:55:00.434 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:55:00.451 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:00.463 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:55:00.490 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:55:00.514 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:55:00.541 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:55:00.570 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:55:00.605 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:55:00.643 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:55:00.645 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:55:00.645 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:55:00.645 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:55:00.645 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:55:00.645 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:55:00.645 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:55:00.645 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:55:00.645 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:55:00.646 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:55:00.646 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:55:00.646 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:55:00.646 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:55:00.860 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 53 16 100636 100620 118.63 66.5625 0.0627088 0.00842716 2024-04-01T19:55:00.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:00 smithi022 ceph-mon[39439]: 8.a scrub ok 2024-04-01T19:55:00.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:00 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/377988564' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:55:00.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:00.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:00 smithi022 ceph-mon[39439]: osdmap e662: 12 total, 12 up, 11 in 2024-04-01T19:55:00.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:00 smithi188 ceph-mon[43939]: 8.a scrub ok 2024-04-01T19:55:00.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:00 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/377988564' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:55:00.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:00.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:00 smithi188 ceph-mon[43939]: osdmap e662: 12 total, 12 up, 11 in 2024-04-01T19:55:00.909 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:55:00.912 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:00.913 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:55:01.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:00 smithi062 ceph-mon[44211]: 8.a scrub ok 2024-04-01T19:55:01.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:00 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/377988564' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:55:01.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:01.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:00 smithi062 ceph-mon[44211]: osdmap e662: 12 total, 12 up, 11 in 2024-04-01T19:55:01.013 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:55:01.044 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:01.070 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:55:01.073 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:01.073 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:55:01.174 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:55:01.217 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:01.254 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:55:01.259 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:01.260 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:55:01.360 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:55:01.414 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:01.444 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:55:01.451 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:01.452 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:55:01.525 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:01.525 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:01.526 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:01.526 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:01.526 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:01.526 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:01.526 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:01.526 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:01.526 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:01.526 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:01.526 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:01.526 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:01 smithi188 ceph-mon[43939]: pgmap v1807: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 6.0 GiB data, 18 GiB used, 966 GiB / 983 GiB avail; 76 MiB/s wr, 1.22k op/s 2024-04-01T19:55:01.553 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:55:01.590 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:01.614 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:55:01.621 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:01.622 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:55:01.722 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:55:01.768 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:01.781 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:55:01.801 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:55:01.805 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:01.805 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:01.805 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:01.805 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:01.805 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:01.806 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:01.806 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:01.806 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:01.806 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:01.806 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:01.806 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:01.806 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:01 smithi022 ceph-mon[39439]: pgmap v1807: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 6.0 GiB data, 18 GiB used, 966 GiB / 983 GiB avail; 76 MiB/s wr, 1.22k op/s 2024-04-01T19:55:01.814 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:01.815 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:55:01.860 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 54 16 101654 101638 117.612 63.625 0.00505863 0.00850009 2024-04-01T19:55:01.915 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:55:01.973 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:01.999 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:55:02.004 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:02.005 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:55:02.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:02.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:02.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:02.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:02.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:02.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:02.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:02.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:02.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:02.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:02.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:02.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:01 smithi062 ceph-mon[44211]: pgmap v1807: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 6.0 GiB data, 18 GiB used, 966 GiB / 983 GiB avail; 76 MiB/s wr, 1.22k op/s 2024-04-01T19:55:02.106 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:55:02.135 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:02.157 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:55:02.162 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:02.162 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:55:02.263 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:55:02.303 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:02.330 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:55:02.336 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:02.337 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:55:02.437 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:55:02.466 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:02.490 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:55:02.493 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:02.493 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:55:02.594 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:55:02.627 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:02.665 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:55:02.668 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:02.668 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:55:02.769 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:55:02.802 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:02.860 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 55 16 102649 102633 116.604 62.1875 0.0656669 0.0085724 2024-04-01T19:55:02.988 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:02 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:55:02.988 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:02 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:55:03.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:02 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:55:03.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:02 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:55:03.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:02 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:55:03.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:02 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:55:03.658 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:55:03.662 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:03.662 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:55:03.763 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:55:03.794 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:03.860 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 56 16 103676 103660 115.668 64.1875 0.00916947 0.00864135 2024-04-01T19:55:03.900 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:55:03.908 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:03.909 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:55:04.010 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:55:04.044 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:04.147 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:55:04.150 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:04.151 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:55:04.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:03 smithi022 ceph-mon[39439]: osdmap e663: 12 total, 12 up, 11 in 2024-04-01T19:55:04.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:03 smithi022 ceph-mon[39439]: pgmap v1809: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 6.1 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 68 MiB/s wr, 1.09k op/s 2024-04-01T19:55:04.252 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:55:04.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:03 smithi062 ceph-mon[44211]: osdmap e663: 12 total, 12 up, 11 in 2024-04-01T19:55:04.260 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:03 smithi062 ceph-mon[44211]: pgmap v1809: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 6.1 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 68 MiB/s wr, 1.09k op/s 2024-04-01T19:55:04.283 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:04.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:03 smithi188 ceph-mon[43939]: osdmap e663: 12 total, 12 up, 11 in 2024-04-01T19:55:04.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:03 smithi188 ceph-mon[43939]: pgmap v1809: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 6.1 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 68 MiB/s wr, 1.09k op/s 2024-04-01T19:55:04.629 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:55:04.642 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:55:04.648 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:04.648 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:55:04.738 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:55:04.739 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:55:04.749 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:55:04.780 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:04.801 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:55:04.804 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:04.804 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:55:04.860 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 57 16 104655 104639 114.712 61.1875 0.00373263 0.008714 2024-04-01T19:55:04.905 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:55:04.937 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:05.092 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:55:05.098 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:05.099 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:55:05.200 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:55:05.230 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:04 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:55:05.230 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:04 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:55:05.232 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:05.255 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:55:05.262 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:05.262 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:55:05.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:04 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:55:05.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:04 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:55:05.363 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:55:05.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:04 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:55:05.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:04 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:55:05.392 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:05.413 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:55:05.418 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:05.419 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:55:05.519 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:55:05.566 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:05.598 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:55:05.601 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:05.601 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:55:05.614 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:55:05.702 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:55:05.747 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:05.772 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:55:05.776 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:05.776 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:55:05.860 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 58 16 105585 105569 113.737 58.125 0.0370136 0.00878685 2024-04-01T19:55:05.877 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:55:05.906 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:05.928 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:55:05.931 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:05.931 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:55:06.004 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:55:06.031 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:55:06.064 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:06.096 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:55:06.107 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:06.107 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:55:06.208 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:55:06.236 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:06 smithi062 ceph-mon[44211]: osdmap e664: 12 total, 12 up, 11 in 2024-04-01T19:55:06.236 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:06 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2221236415' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:55:06.236 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:06 smithi062 ceph-mon[44211]: pgmap v1811: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 6.2 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 62 MiB/s wr, 985 op/s 2024-04-01T19:55:06.236 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:06 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:55:06.236 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:06 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2221236415' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:55:06.236 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:06 smithi062 ceph-mon[44211]: osdmap e665: 12 total, 12 up, 11 in 2024-04-01T19:55:06.238 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:06.256 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:06 smithi022 ceph-mon[39439]: osdmap e664: 12 total, 12 up, 11 in 2024-04-01T19:55:06.256 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:06 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2221236415' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:55:06.256 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:06 smithi022 ceph-mon[39439]: pgmap v1811: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 6.2 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 62 MiB/s wr, 985 op/s 2024-04-01T19:55:06.256 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:06 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:55:06.256 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:06 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2221236415' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:55:06.256 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:06 smithi022 ceph-mon[39439]: osdmap e665: 12 total, 12 up, 11 in 2024-04-01T19:55:06.261 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:55:06.264 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:06.264 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:55:06.365 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:55:06.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:06 smithi188 ceph-mon[43939]: osdmap e664: 12 total, 12 up, 11 in 2024-04-01T19:55:06.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:06 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2221236415' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:55:06.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:06 smithi188 ceph-mon[43939]: pgmap v1811: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 6.2 GiB data, 18 GiB used, 965 GiB / 983 GiB avail; 62 MiB/s wr, 985 op/s 2024-04-01T19:55:06.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:06 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:55:06.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:06 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2221236415' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:55:06.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:06 smithi188 ceph-mon[43939]: osdmap e665: 12 total, 12 up, 11 in 2024-04-01T19:55:06.425 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:06.458 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:55:06.467 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:06.468 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:55:06.569 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:55:06.602 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:06.759 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:55:06.761 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:06.762 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:55:06.860 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 59 16 106581 106565 112.864 62.25 0.00785261 0.00885545 2024-04-01T19:55:06.863 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:55:06.892 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:06.914 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:55:06.920 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:06.920 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:55:07.021 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:55:07.093 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:07.120 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:55:07.125 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:07.125 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:55:07.226 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:55:07.256 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:07.284 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:55:07.292 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:07.293 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:55:07.394 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:55:07.443 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:07.471 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:55:07.475 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:07.475 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:55:07.576 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:55:07.630 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:07.657 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:55:07.662 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:07.663 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:55:07.764 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:55:07.799 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:07.861 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:55:07.864334 min lat: 0.00103479 max lat: 2.06154 avg lat: 0.00892731 2024-04-01T19:55:07.861 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:55:07.861 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 60 16 107502 107486 111.941 57.5625 0.00398298 0.00892731 2024-04-01T19:55:07.901 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:55:07.904 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:07.904 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:55:08.005 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:55:08.051 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:08.082 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:55:08.084 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:08.085 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:55:08.186 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:55:08.219 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:08.541 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_ops_in_flight 2024-04-01T19:55:08.571 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:55:08.574 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:08.574 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:55:08.675 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:55:08.715 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:08 smithi188 ceph-mon[43939]: pgmap v1813: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 6.4 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 69 MiB/s wr, 1.11k op/s 2024-04-01T19:55:08.717 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:08.753 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:55:08.758 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:08.759 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:55:08.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:08 smithi062 ceph-mon[44211]: pgmap v1813: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 6.4 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 69 MiB/s wr, 1.11k op/s 2024-04-01T19:55:08.860 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:55:08.861 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 61 16 108437 108421 111.064 58.4375 0.0166703 0.0090008 2024-04-01T19:55:08.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:08 smithi022 ceph-mon[39439]: pgmap v1813: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 6.4 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 69 MiB/s wr, 1.11k op/s 2024-04-01T19:55:08.897 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:08.921 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:55:08.925 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:08.926 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:55:08.960 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:55:09.026 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:55:09.061 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:09.108 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:55:09.122 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:55:09.132 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:09.133 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:55:09.138 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:55:09.161 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:55:09.182 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:55:09.204 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:55:09.227 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:55:09.233 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:55:09.250 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:55:09.264 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:09.275 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:55:09.287 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:55:09.291 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:09.292 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:55:09.312 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:55:09.336 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:55:09.363 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:55:09.390 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:55:09.392 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:55:09.392 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:55:09.392 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:55:09.392 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:55:09.392 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:55:09.392 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:55:09.392 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:55:09.392 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:55:09.392 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:55:09.392 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:55:09.393 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:55:09.393 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:55:09.393 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:55:09.438 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:09.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:09 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2487411158' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:55:09.566 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:09.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:09 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2487411158' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:55:09.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:09.861 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 62 16 109374 109358 110.217 58.5625 0.00445947 0.00907117 2024-04-01T19:55:09.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:09 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2487411158' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:55:09.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:09.921 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:55:10.092 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:55:10.096 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:10.097 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:55:10.198 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:55:10.239 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:10.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:10 smithi022 ceph-mon[39439]: pgmap v1814: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 6.5 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 52 MiB/s wr, 838 op/s 2024-04-01T19:55:10.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:10 smithi062 ceph-mon[44211]: pgmap v1814: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 6.5 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 52 MiB/s wr, 838 op/s 2024-04-01T19:55:10.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.862 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 63 16 110322 110306 109.408 59.25 0.049079 0.00913507 2024-04-01T19:55:10.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:10 smithi188 ceph-mon[43939]: pgmap v1814: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 6.5 GiB data, 19 GiB used, 965 GiB / 983 GiB avail; 52 MiB/s wr, 838 op/s 2024-04-01T19:55:10.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:10.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:11.294 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:55:11.297 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:11.298 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:55:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:55:11.399 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:55:11.427 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:11.442 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-01T19:55:11.442 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:55:11.448 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:55:11.451 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:11.451 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:55:11.524 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:11 smithi022 ceph-mon[39439]: osdmap e666: 12 total, 12 up, 11 in 2024-04-01T19:55:11.524 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:11 smithi022 ceph-mon[39439]: pgmap v1816: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 6.7 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 73 MiB/s wr, 1.17k op/s 2024-04-01T19:55:11.552 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:55:11.583 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:11.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:11 smithi062 ceph-mon[44211]: osdmap e666: 12 total, 12 up, 11 in 2024-04-01T19:55:11.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:11 smithi062 ceph-mon[44211]: pgmap v1816: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 6.7 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 73 MiB/s wr, 1.17k op/s 2024-04-01T19:55:11.793 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:55:11.796 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:11.797 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:55:11.862 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 64 16 111273 111257 108.627 59.4375 0.00356843 0.00919911 2024-04-01T19:55:11.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:11 smithi188 ceph-mon[43939]: osdmap e666: 12 total, 12 up, 11 in 2024-04-01T19:55:11.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:11 smithi188 ceph-mon[43939]: pgmap v1816: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 6.7 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 73 MiB/s wr, 1.17k op/s 2024-04-01T19:55:11.897 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:55:11.925 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:11.947 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:55:11.952 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:11.952 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:55:12.053 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:55:12.083 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:12.107 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:55:12.110 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:12.111 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:55:12.212 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:55:12.254 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:12.861 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 65 16 112161 112145 107.81 55.5 0.0046092 0.00926809 2024-04-01T19:55:13.006 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:55:13.006 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:55:13.006 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:55:13.006 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.26983.0:111595 8.2 e666/644 8:40883882:::benchmark_data_smithi188_161190_object111594:head v 666'6840, mlcod=666'6838)", 2024-04-01T19:55:13.006 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:55:12.236222+0000", 2024-04-01T19:55:13.007 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.002636982, 2024-04-01T19:55:13.007 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.002669411, 2024-04-01T19:55:13.007 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:55:13.007 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:55:13.007 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:55:13.007 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:55:13.007 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:55:13.007 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:55:13.007 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:55:12.236222+0000", 2024-04-01T19:55:13.007 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:55:13.007 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:55:13.007 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:55:13.008 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:55:13.008 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:55:12.236222+0000", 2024-04-01T19:55:13.008 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:55:13.008 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:55:13.008 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:55:13.008 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:55:13.008 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:55:12.236224+0000", 2024-04-01T19:55:13.008 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.883e-06 2024-04-01T19:55:13.008 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:55:13.008 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:55:13.008 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:55:13.008 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:55:12.236271+0000", 2024-04-01T19:55:13.008 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.6922999999999998e-05 2024-04-01T19:55:13.009 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:55:13.009 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:55:13.009 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:55:13.009 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:55:12.236283+0000", 2024-04-01T19:55:13.009 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2329e-05 2024-04-01T19:55:13.009 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:55:13.009 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:55:13.009 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:55:13.009 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:55:12.236290+0000", 2024-04-01T19:55:13.009 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.6159999999999998e-06 2024-04-01T19:55:13.009 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:55:13.009 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:55:13.009 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:55:13.010 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:55:12.236351+0000", 2024-04-01T19:55:13.010 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0943999999999998e-05 2024-04-01T19:55:13.010 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:55:13.010 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:55:13.010 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:55:13.010 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:55:12.236369+0000", 2024-04-01T19:55:13.010 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8445e-05 2024-04-01T19:55:13.010 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:55:13.010 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:55:13.010 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:55:13.010 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:55:13.010 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T19:55:13.010 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 1 2024-04-01T19:55:13.011 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:55:13.254 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:55:13.258 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:13.259 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:55:13.360 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:55:13.395 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:13.435 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:55:13.440 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:13.440 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:55:13.541 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:55:13.583 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:13.613 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:55:13.619 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:13.619 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:55:13.720 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:55:13.765 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:13.793 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:55:13.803 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:13.803 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:55:13.867 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 66 16 113084 113068 107.042 57.6875 0.00844897 0.00933836 2024-04-01T19:55:13.904 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:55:13.938 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:13.982 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:55:13.991 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:13.991 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:55:14.092 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:55:14.126 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:14.155 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:55:14.158 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:14.159 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:55:14.260 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:55:14.308 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:14.342 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:55:14.347 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:14.348 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:55:14.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:14 smithi022 ceph-mon[39439]: pgmap v1817: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 6.7 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 65 MiB/s wr, 1.04k op/s 2024-04-01T19:55:14.448 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:55:14.479 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:14.503 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:55:14.506 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:14.507 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:55:14.608 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:55:14.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:14 smithi188 ceph-mon[43939]: pgmap v1817: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 6.7 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 65 MiB/s wr, 1.04k op/s 2024-04-01T19:55:14.638 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:55:14.661 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:14 smithi062 ceph-mon[44211]: pgmap v1817: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 6.7 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 65 MiB/s wr, 1.04k op/s 2024-04-01T19:55:14.662 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:14.663 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:55:14.764 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:55:14.801 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:14.867 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 67 16 113934 113918 106.237 53.125 0.00402269 0.00940727 2024-04-01T19:55:15.003 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:55:15.005 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:55:15.010 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:15.010 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:55:15.044 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_blocked_ops 2024-04-01T19:55:15.111 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:55:15.161 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:15.198 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:55:15.203 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:15.203 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:55:15.304 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:55:15.349 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:15.384 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:55:15.387 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:15.388 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:55:15.413 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:55:15.488 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:55:15.524 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:15.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:15 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4152000827' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:55:15.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:15 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4152000827' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:55:15.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:15 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4152000827' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:55:15.868 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 68 16 114949 114933 105.606 63.4375 0.00997775 0.00946708 2024-04-01T19:55:15.954 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:55:16.481 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:55:16.485 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:16.486 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:55:16.587 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:55:16.636 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:16.662 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:55:16.665 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:16.665 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:55:16.666 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:16 smithi188 ceph-mon[43939]: pgmap v1818: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 6.9 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 60 MiB/s wr, 966 op/s 2024-04-01T19:55:16.666 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:16 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:55:16.666 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:16 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4152000827' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:55:16.666 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:16 smithi188 ceph-mon[43939]: osdmap e667: 12 total, 12 up, 11 in 2024-04-01T19:55:16.666 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:16 smithi188 ceph-mon[43939]: osdmap e668: 12 total, 12 up, 11 in 2024-04-01T19:55:16.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:16 smithi062 ceph-mon[44211]: pgmap v1818: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 6.9 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 60 MiB/s wr, 966 op/s 2024-04-01T19:55:16.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:16 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:55:16.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:16 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4152000827' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:55:16.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:16 smithi062 ceph-mon[44211]: osdmap e667: 12 total, 12 up, 11 in 2024-04-01T19:55:16.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:16 smithi062 ceph-mon[44211]: osdmap e668: 12 total, 12 up, 11 in 2024-04-01T19:55:16.766 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:55:16.808 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:16.838 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:55:16.842 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:16.843 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:55:16.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:16 smithi022 ceph-mon[39439]: pgmap v1818: 17 pgs: 2 active+clean+scrubbing+deep, 15 active+clean; 6.9 GiB data, 19 GiB used, 964 GiB / 983 GiB avail; 60 MiB/s wr, 966 op/s 2024-04-01T19:55:16.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:16 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:55:16.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:16 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4152000827' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:55:16.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:16 smithi022 ceph-mon[39439]: osdmap e667: 12 total, 12 up, 11 in 2024-04-01T19:55:16.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:16 smithi022 ceph-mon[39439]: osdmap e668: 12 total, 12 up, 11 in 2024-04-01T19:55:16.869 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 69 16 116182 116166 105.191 77.0625 0.0190614 0.00950494 2024-04-01T19:55:16.945 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:55:16.975 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:16.998 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:55:17.000 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:17.001 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:55:17.102 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:55:17.134 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:17.156 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:55:17.159 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:17.159 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:55:17.261 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:55:17.296 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:17.346 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:55:17.364 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:17.364 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:55:17.465 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:55:17.497 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:17.846 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:55:17.847 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:55:17.870 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 70 16 117441 117425 104.812 78.6875 0.0160258 0.00953905 2024-04-01T19:55:17.927 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:55:17.927 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:55:18.354 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:55:18.358 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:18.359 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:55:18.460 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:55:18.502 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:18.536 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:55:18.538 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:18.539 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:55:18.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:18 smithi022 ceph-mon[39439]: pgmap v1821: 17 pgs: 17 active+clean; 6.9 GiB data, 20 GiB used, 964 GiB / 983 GiB avail; 51 MiB/s wr, 822 op/s 2024-04-01T19:55:18.640 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:55:18.667 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:18 smithi062 ceph-mon[44211]: pgmap v1821: 17 pgs: 17 active+clean; 6.9 GiB data, 20 GiB used, 964 GiB / 983 GiB avail; 51 MiB/s wr, 822 op/s 2024-04-01T19:55:18.670 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:18.692 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:55:18.697 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:18.698 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:55:18.799 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:55:18.833 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:18 smithi188 ceph-mon[43939]: pgmap v1821: 17 pgs: 17 active+clean; 6.9 GiB data, 20 GiB used, 964 GiB / 983 GiB avail; 51 MiB/s wr, 822 op/s 2024-04-01T19:55:18.836 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:18.870 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 71 16 118679 118663 104.426 77.375 0.00792973 0.00957437 2024-04-01T19:55:18.881 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:55:18.889 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:18.889 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:55:18.894 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":1821,"stamp":"2024-04-01T19:55:17.352013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7447708192,"num_objects":113636,"num_object_clones":0,"num_object_copies":227272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113636,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":113815,"num_write_kb":7275514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3954,"num_bytes_recovered":260720768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119494,"ondisk_log_size":119494,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":11,"num_per_pool_osds":11,"num_per_pool_omap_osds":10,"kb":1031196672,"kb_used":20682496,"kb_used_data":14537360,"kb_used_omap":890,"kb_used_meta":6144133,"kb_avail":1010514176,"statfs":{"total":1055945392128,"available":1034766516224,"internally_reserved":0,"allocated":14886256640,"data_stored":14879826536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":911939,"internal_metadata":6291592637},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,5,3,2,4,7,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":371589120,"num_objects":5670,"num_object_clones":0,"num_object_copies":11340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5670,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5670,"num_write_kb":362880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.889833"},"pg_stats":[{"pgid":"8.f","version":"666'7218","reported_seq":7301,"reported_epoch":666,"state":"active+clean","last_fresh":"2024-04-01T19:55:14.947445+0000","last_change":"2024-04-01T19:53:54.067516+0000","last_active":"2024-04-01T19:55:14.947445+0000","last_peered":"2024-04-01T19:55:14.947445+0000","last_clean":"2024-04-01T19:55:14.947445+0000","last_became_active":"2024-04-01T19:53:54.067307+0000","last_became_peered":"2024-04-01T19:53:54.067307+0000","last_unstale":"2024-04-01T19:55:14.947445+0000","last_undegraded":"2024-04-01T19:55:14.947445+0000","last_fullsized":"2024-04-01T19:55:14.947445+0000","mapping_epoch":629,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":0,"log_size":7218,"log_dups_size":0,"ondisk_log_size":7218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473038848,"num_objects":7218,"num_object_clones":0,"num_object_copies":14436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7218,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7218,"num_write_kb":461952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.e","version":"666'7032","reported_seq":7114,"reported_epoch":666,"state":"active+clean","last_fresh":"2024-04-01T19:55:15.391289+0000","last_change":"2024-04-01T19:53:54.066875+0000","last_active":"2024-04-01T19:55:15.391289+0000","last_peered":"2024-04-01T19:55:15.391289+0000","last_clean":"2024-04-01T19:55:15.391289+0000","last_became_active":"2024-04-01T19:53:54.066471+0000","last_became_peered":"2024-04-01T19:53:54.066471+0000","last_unstale":"2024-04-01T19:55:15.391289+0000","last_undegraded":"2024-04-01T19:55:15.391289+0000","last_fullsized":"2024-04-01T19:55:15.391289+0000","mapping_epoch":629,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":0,"log_size":7032,"log_dups_size":0,"ondisk_log_size":7032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:55:22.111625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":460849152,"num_objects":7032,"num_object_clones":0,"num_object_copies":14064,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7032,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7032,"num_write_kb":450048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"666'7257","reported_seq":7340,"reported_epoch":666,"state":"active+clean","last_fresh":"2024-04-01T19:55:14.897020+0000","last_change":"2024-04-01T19:53:53.679291+0000","last_active":"2024-04-01T19:55:14.897020+0000","last_peered":"2024-04-01T19:55:14.897020+0000","last_clean":"2024-04-01T19:55:14.897020+0000","last_became_active":"2024-04-01T19:53:53.678991+0000","last_became_peered":"2024-04-01T19:53:53.678991+0000","last_unstale":"2024-04-01T19:55:14.897020+0000","last_undegraded":"2024-04-01T19:55:14.897020+0000","last_fullsized":"2024-04-01T19:55:14.897020+0000","mapping_epoch":629,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":0,"log_size":7257,"log_dups_size":0,"ondisk_log_size":7257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:55:15.968860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":475594752,"num_objects":7257,"num_object_clones":0,"num_object_copies":14514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7257,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7257,"num_write_kb":464448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.c","version":"668'7150","reported_seq":7237,"reported_epoch":668,"state":"active+clean","last_fresh":"2024-04-01T19:55:15.594681+0000","last_change":"2024-04-01T19:53:53.462953+0000","last_active":"2024-04-01T19:55:15.594681+0000","last_peered":"2024-04-01T19:55:15.594681+0000","last_clean":"2024-04-01T19:55:15.594681+0000","last_became_active":"2024-04-01T19:53:53.462634+0000","last_became_peered":"2024-04-01T19:53:53.462634+0000","last_unstale":"2024-04-01T19:55:15.594681+0000","last_undegraded":"2024-04-01T19:55:15.594681+0000","last_fullsized":"2024-04-01T19:55:15.594681+0000","mapping_epoch":629,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":0,"log_size":7150,"log_dups_size":0,"ondisk_log_size":7150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:55:17.292820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468582400,"num_objects":7150,"num_object_clones":0,"num_object_copies":14300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7150,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7150,"num_write_kb":457600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"8.b","version":"666'7183","reported_seq":7266,"reported_epoch":666,"state":"active+clean","last_fresh":"2024-04-01T19:55:14.385349+0000","last_change":"2024-04-01T19:53:53.457209+0000","last_active":"2024-04-01T19:55:14.385349+0000","last_peered":"2024-04-01T19:55:14.385349+0000","last_clean":"2024-04-01T19:55:14.385349+0000","last_became_active":"2024-04-01T19:53:53.456979+0000","last_became_peered":"2024-04-01T19:53:53.456979+0000","last_unstale":"2024-04-01T19:55:14.385349+0000","last_undegraded":"2024-04-01T19:55:14.385349+0000","last_fullsized":"2024-04-01T19:55:14.385349+0000","mapping_epoch":629,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":0,"log_size":7183,"log_dups_size":0,"ondisk_log_size":7183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:55:18.060664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470745088,"num_objects":7183,"num_object_clones":0,"num_object_copies":14366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7183,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7183,"num_write_kb":459712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"8.a","version":"666'6985","reported_seq":7136,"reported_epoch":666,"state":"active+clean","last_fresh":"2024-04-01T19:55:14.336414+0000","last_change":"2024-04-01T19:54:58.982265+0000","last_active":"2024-04-01T19:55:14.336414+0000","last_peered":"2024-04-01T19:55:14.336414+0000","last_clean":"2024-04-01T19:55:14.336414+0000","last_became_active":"2024-04-01T19:53:54.066588+0000","last_became_peered":"2024-04-01T19:53:54.066588+0000","last_unstale":"2024-04-01T19:55:14.336414+0000","last_undegraded":"2024-04-01T19:55:14.336414+0000","last_fullsized":"2024-04-01T19:55:14.336414+0000","mapping_epoch":629,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"661'6054","last_scrub_stamp":"2024-04-01T19:54:58.982118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:54:58.982118+0000","objects_scrubbed":6021,"log_size":6985,"log_dups_size":0,"ondisk_log_size":6985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:56:11.305013+0000","scrub_duration":935,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457768960,"num_objects":6985,"num_object_clones":0,"num_object_copies":13970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6985,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6985,"num_write_kb":447040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"8.8","version":"668'7242","reported_seq":7329,"reported_epoch":668,"state":"active+clean","last_fresh":"2024-04-01T19:55:15.650492+0000","last_change":"2024-04-01T19:53:53.455172+0000","last_active":"2024-04-01T19:55:15.650492+0000","last_peered":"2024-04-01T19:55:15.650492+0000","last_clean":"2024-04-01T19:55:15.650492+0000","last_became_active":"2024-04-01T19:53:53.454737+0000","last_became_peered":"2024-04-01T19:53:53.454737+0000","last_unstale":"2024-04-01T19:55:15.650492+0000","last_undegraded":"2024-04-01T19:55:15.650492+0000","last_fullsized":"2024-04-01T19:55:15.650492+0000","mapping_epoch":629,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":0,"log_size":7242,"log_dups_size":0,"ondisk_log_size":7242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:55:20.718821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474611712,"num_objects":7242,"num_object_clones":0,"num_object_copies":14484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7242,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7242,"num_write_kb":463488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"666'7114","reported_seq":8731,"reported_epoch":666,"state":"active+clean","last_fresh":"2024-04-01T19:55:14.936712+0000","last_change":"2024-04-01T19:54:15.322424+0000","last_active":"2024-04-01T19:55:14.936712+0000","last_peered":"2024-04-01T19:55:14.936712+0000","last_clean":"2024-04-01T19:55:14.936712+0000","last_became_active":"2024-04-01T19:54:11.514611+0000","last_became_peered":"2024-04-01T19:54:11.514611+0000","last_unstale":"2024-04-01T19:55:14.936712+0000","last_undegraded":"2024-04-01T19:55:14.936712+0000","last_fullsized":"2024-04-01T19:55:14.936712+0000","mapping_epoch":637,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":641,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":0,"log_size":7114,"log_dups_size":0,"ondisk_log_size":7114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":466223104,"num_objects":7114,"num_object_clones":0,"num_object_copies":14228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7114,"num_write_kb":455296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":764,"num_bytes_recovered":50069504,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.6","version":"666'7160","reported_seq":8858,"reported_epoch":666,"state":"active+clean","last_fresh":"2024-04-01T19:55:14.920231+0000","last_change":"2024-04-01T19:54:15.807532+0000","last_active":"2024-04-01T19:55:14.920231+0000","last_peered":"2024-04-01T19:55:14.920231+0000","last_clean":"2024-04-01T19:55:14.920231+0000","last_became_active":"2024-04-01T19:54:11.515237+0000","last_became_peered":"2024-04-01T19:54:11.515237+0000","last_unstale":"2024-04-01T19:55:14.920231+0000","last_undegraded":"2024-04-01T19:55:14.920231+0000","last_fullsized":"2024-04-01T19:55:14.920231+0000","mapping_epoch":637,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":642,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":0,"log_size":7160,"log_dups_size":0,"ondisk_log_size":7160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":469237760,"num_objects":7160,"num_object_clones":0,"num_object_copies":14320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7160,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7160,"num_write_kb":458240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":804,"num_bytes_recovered":52690944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.5","version":"666'7015","reported_seq":8687,"reported_epoch":666,"state":"active+clean","last_fresh":"2024-04-01T19:55:12.451328+0000","last_change":"2024-04-01T19:54:18.038335+0000","last_active":"2024-04-01T19:55:12.451328+0000","last_peered":"2024-04-01T19:55:12.451328+0000","last_clean":"2024-04-01T19:55:12.451328+0000","last_became_active":"2024-04-01T19:54:18.036312+0000","last_became_peered":"2024-04-01T19:54:18.036312+0000","last_unstale":"2024-04-01T19:55:12.451328+0000","last_undegraded":"2024-04-01T19:55:12.451328+0000","last_fullsized":"2024-04-01T19:55:12.451328+0000","mapping_epoch":643,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":644,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":0,"log_size":7015,"log_dups_size":0,"ondisk_log_size":7015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459735040,"num_objects":7015,"num_object_clones":0,"num_object_copies":14030,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7015,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7015,"num_write_kb":448960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":790,"num_bytes_recovered":51773440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"8.4","version":"668'9998","reported_seq":10288,"reported_epoch":668,"state":"active+clean","last_fresh":"2024-04-01T19:55:15.651681+0000","last_change":"2024-04-01T19:55:15.486738+0000","last_active":"2024-04-01T19:55:15.651681+0000","last_peered":"2024-04-01T19:55:15.651681+0000","last_clean":"2024-04-01T19:55:15.651681+0000","last_became_active":"2024-04-01T19:53:53.462894+0000","last_became_peered":"2024-04-01T19:53:53.462894+0000","last_unstale":"2024-04-01T19:55:15.651681+0000","last_undegraded":"2024-04-01T19:55:15.651681+0000","last_fullsized":"2024-04-01T19:55:15.651681+0000","mapping_epoch":629,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":4859,"log_size":9998,"log_dups_size":0,"ondisk_log_size":9998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:55:20.486240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474218496,"num_objects":7236,"num_object_clones":0,"num_object_copies":14472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7236,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7236,"num_write_kb":463104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"666'7097","reported_seq":7247,"reported_epoch":666,"state":"active+clean","last_fresh":"2024-04-01T19:55:14.925876+0000","last_change":"2024-04-01T19:54:55.108987+0000","last_active":"2024-04-01T19:55:14.925876+0000","last_peered":"2024-04-01T19:55:14.925876+0000","last_clean":"2024-04-01T19:55:14.925876+0000","last_became_active":"2024-04-01T19:53:53.462397+0000","last_became_peered":"2024-04-01T19:53:53.462397+0000","last_unstale":"2024-04-01T19:55:14.925876+0000","last_undegraded":"2024-04-01T19:55:14.925876+0000","last_fullsized":"2024-04-01T19:55:14.925876+0000","mapping_epoch":629,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"660'5871","last_scrub_stamp":"2024-04-01T19:54:55.108780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:54:55.108780+0000","objects_scrubbed":5824,"log_size":7097,"log_dups_size":0,"ondisk_log_size":7097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:55:55.119663+0000","scrub_duration":1164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":465108992,"num_objects":7097,"num_object_clones":0,"num_object_copies":14194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7097,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7097,"num_write_kb":454208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.2","version":"666'6857","reported_seq":8568,"reported_epoch":666,"state":"active+clean","last_fresh":"2024-04-01T19:55:12.456163+0000","last_change":"2024-04-01T19:54:19.037004+0000","last_active":"2024-04-01T19:55:12.456163+0000","last_peered":"2024-04-01T19:55:12.456163+0000","last_clean":"2024-04-01T19:55:12.456163+0000","last_became_active":"2024-04-01T19:54:19.034659+0000","last_became_peered":"2024-04-01T19:54:19.034659+0000","last_unstale":"2024-04-01T19:55:12.456163+0000","last_undegraded":"2024-04-01T19:55:12.456163+0000","last_fullsized":"2024-04-01T19:55:12.456163+0000","mapping_epoch":644,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":645,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":0,"log_size":6857,"log_dups_size":0,"ondisk_log_size":6857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449380352,"num_objects":6857,"num_object_clones":0,"num_object_copies":13714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6857,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6857,"num_write_kb":438848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":810,"num_bytes_recovered":53084160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0],"acting":[10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"8.1","version":"668'10067","reported_seq":10369,"reported_epoch":668,"state":"active+clean","last_fresh":"2024-04-01T19:55:15.603036+0000","last_change":"2024-04-01T19:55:15.421839+0000","last_active":"2024-04-01T19:55:15.603036+0000","last_peered":"2024-04-01T19:55:15.603036+0000","last_clean":"2024-04-01T19:55:15.603036+0000","last_became_active":"2024-04-01T19:53:54.066680+0000","last_became_peered":"2024-04-01T19:53:54.066680+0000","last_unstale":"2024-04-01T19:55:15.603036+0000","last_undegraded":"2024-04-01T19:55:15.603036+0000","last_fullsized":"2024-04-01T19:55:15.603036+0000","mapping_epoch":629,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":5273,"log_size":10067,"log_dups_size":0,"ondisk_log_size":10067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:55:20.421639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":465829888,"num_objects":7108,"num_object_clones":0,"num_object_copies":14216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7108,"num_write_kb":454912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"8.0","version":"666'6946","reported_seq":7029,"reported_epoch":666,"state":"active+clean","last_fresh":"2024-04-01T19:55:13.619014+0000","last_change":"2024-04-01T19:53:53.455578+0000","last_active":"2024-04-01T19:55:13.619014+0000","last_peered":"2024-04-01T19:55:13.619014+0000","last_clean":"2024-04-01T19:55:13.619014+0000","last_became_active":"2024-04-01T19:53:53.455265+0000","last_became_peered":"2024-04-01T19:53:53.455265+0000","last_unstale":"2024-04-01T19:55:13.619014+0000","last_undegraded":"2024-04-01T19:55:13.619014+0000","last_fullsized":"2024-04-01T19:55:13.619014+0000","mapping_epoch":629,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":0,"log_size":6946,"log_dups_size":0,"ondisk_log_size":6946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:55:18.061172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":455213056,"num_objects":6946,"num_object_clones":0,"num_object_copies":13892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6946,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6946,"num_write_kb":444544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"666'7034","reported_seq":8684,"reported_epoch":666,"state":"active+clean","last_fresh":"2024-04-01T19:55:12.487267+0000","last_change":"2024-04-01T19:54:19.037520+0000","last_active":"2024-04-01T19:55:12.487267+0000","last_peered":"2024-04-01T19:55:12.487267+0000","last_clean":"2024-04-01T19:55:12.487267+0000","last_became_active":"2024-04-01T19:54:19.035216+0000","last_became_peered":"2024-04-01T19:54:19.035216+0000","last_unstale":"2024-04-01T19:55:12.487267+0000","last_undegraded":"2024-04-01T19:55:12.487267+0000","last_fullsized":"2024-04-01T19:55:12.487267+0000","mapping_epoch":644,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":645,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":0,"log_size":7034,"log_dups_size":0,"ondisk_log_size":7034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:55:18.410009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":460980224,"num_objects":7034,"num_object_clones":0,"num_object_copies":14068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7034,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7034,"num_write_kb":450176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":778,"num_bytes_recovered":50987008,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":1649,"reported_epoch":666,"state":"active+clean","last_fresh":"2024-04-01T19:55:10.480377+0000","last_change":"2024-04-01T19:53:53.823471+0000","last_active":"2024-04-01T19:55:10.480377+0000","last_peered":"2024-04-01T19:55:10.480377+0000","last_clean":"2024-04-01T19:55:10.480377+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:55:10.480377+0000","last_undegraded":"2024-04-01T19:55:10.480377+0000","last_fullsized":"2024-04-01T19:55:10.480377+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:53:53.823361+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:53:53.823361+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:55:13.806047+0000","scrub_duration":145,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":7447117824,"num_objects":113634,"num_object_clones":0,"num_object_copies":227268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113634,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113634,"num_write_kb":7272576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3946,"num_bytes_recovered":258605056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":14946664448,"data_stored":14946664448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119355,"ondisk_log_size":119355,"up":32,"acting":32,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220552,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3093248,"kb_used_data":2281848,"kb_used_omap":1,"kb_used_meta":811390,"kb_avail":90651904,"statfs":{"total":95995035648,"available":92827549696,"internally_reserved":0,"allocated":2336612352,"data_stored":2336027076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":830863812},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":77,"seq":330712482187,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2833980,"kb_used_data":2221104,"kb_used_omap":1,"kb_used_meta":612862,"kb_avail":90911172,"statfs":{"total":95995035648,"available":93093040128,"internally_reserved":0,"allocated":2274410496,"data_stored":2273828772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":627571136},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678419,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1937528,"kb_used_data":1369072,"kb_used_omap":1,"kb_used_meta":568446,"kb_avail":91807624,"statfs":{"total":95995035648,"available":94011006976,"internally_reserved":0,"allocated":1401929728,"data_stored":1401348024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":582089152},"hb_peers":[1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,3,3,2,4,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557616,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1572216,"kb_used_data":1359664,"kb_used_omap":132,"kb_used_meta":212411,"kb_avail":92172936,"statfs":{"total":95995035648,"available":94385086464,"internally_reserved":0,"allocated":1392295936,"data_stored":1391714232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":217509607},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234397,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1032320,"kb_used_data":459704,"kb_used_omap":1,"kb_used_meta":572606,"kb_avail":92712832,"statfs":{"total":95995035648,"available":94937939968,"internally_reserved":0,"allocated":470736896,"data_stored":470151640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":586349002},"hb_peers":[0,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":457,"seq":1962800054409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":254012,"kb_used_data":1136,"kb_used_omap":744,"kb_used_meta":252119,"kb_avail":93491140,"statfs":{"total":95995035648,"available":95734927360,"internally_reserved":0,"allocated":1163264,"data_stored":581560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":762131,"internal_metadata":258170605},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":0,"seq":2452426326077,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738818,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1515640,"kb_used_data":898608,"kb_used_omap":1,"kb_used_meta":617022,"kb_avail":92229512,"statfs":{"total":95995035648,"available":94443020288,"internally_reserved":0,"allocated":920174592,"data_stored":919592888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":631830981},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346359,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2345880,"kb_used_data":1837128,"kb_used_omap":1,"kb_used_meta":508734,"kb_avail":91399272,"statfs":{"total":95995035648,"available":93592854528,"internally_reserved":0,"allocated":1881219072,"data_stored":1880625260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":520944069},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669150128,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1626424,"kb_used_data":895536,"kb_used_omap":1,"kb_used_meta":730878,"kb_avail":92118728,"statfs":{"total":95995035648,"available":94329577472,"internally_reserved":0,"allocated":917028864,"data_stored":916447160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":748419527},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953899,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1554904,"kb_used_data":928136,"kb_used_omap":1,"kb_used_meta":626750,"kb_avail":92190248,"statfs":{"total":95995035648,"available":94402813952,"internally_reserved":0,"allocated":950411264,"data_stored":949817452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":641792453},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790375,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2916344,"kb_used_data":2285424,"kb_used_omap":1,"kb_used_meta":630910,"kb_avail":90828808,"statfs":{"total":95995035648,"available":93008699392,"internally_reserved":0,"allocated":2340274176,"data_stored":2339692472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":646052293},"hb_peers":[0,1,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,0,0,3,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":919994368,"data_stored":919994368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1885405184,"data_stored":1885405184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":922746880,"data_stored":922746880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":955318272,"data_stored":955318272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2352939008,"data_stored":2352939008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":472317952,"data_stored":472317952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":1393623040,"data_stored":1393623040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":1408434176,"data_stored":1408434176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":2286682112,"data_stored":2286682112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":2349203456,"data_stored":2349203456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:55:18.896 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:55:18.990 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:55:19.020 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:19.041 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:55:19.044 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:19.044 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:55:19.145 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:55:19.204 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:19.243 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:55:19.250 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:19.251 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:55:19.352 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:55:19.408 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:19.454 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:55:19.460 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:19.460 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:55:19.460 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:19 smithi188 ceph-mon[43939]: from='client.17070 v1:172.21.15.22:0/3637588776' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:55:19.461 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:19 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:55:19.461 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:19 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:55:19.561 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:55:19.592 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:19.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:19 smithi062 ceph-mon[44211]: from='client.17070 v1:172.21.15.22:0/3637588776' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:55:19.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:19 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:55:19.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:19 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:55:19.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:19 smithi022 ceph-mon[39439]: from='client.17070 v1:172.21.15.22:0/3637588776' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:55:19.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:19 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:55:19.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:19 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:55:19.873 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 72 16 119881 119865 104.014 75.125 0.0158332 0.00961279 2024-04-01T19:55:19.885 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:55:19.947 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:55:19.952 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:19.953 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:55:20.054 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:55:20.110 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:20.140 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:55:20.146 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:20.147 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:55:20.248 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:55:20.278 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:20.305 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:55:20.308 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:20.308 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:55:20.409 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:55:20.440 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:20.495 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:20 smithi022 ceph-mon[39439]: pgmap v1822: 17 pgs: 17 active+clean; 7.0 GiB data, 20 GiB used, 964 GiB / 983 GiB avail; 46 MiB/s wr, 736 op/s 2024-04-01T19:55:20.496 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:20 smithi022 ceph-mon[39439]: osdmap e669: 12 total, 12 up, 11 in 2024-04-01T19:55:20.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:20 smithi062 ceph-mon[44211]: pgmap v1822: 17 pgs: 17 active+clean; 7.0 GiB data, 20 GiB used, 964 GiB / 983 GiB avail; 46 MiB/s wr, 736 op/s 2024-04-01T19:55:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:20 smithi062 ceph-mon[44211]: osdmap e669: 12 total, 12 up, 11 in 2024-04-01T19:55:20.873 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 73 16 121082 121066 103.617 75.0625 0.00404694 0.00964914 2024-04-01T19:55:20.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:20 smithi188 ceph-mon[43939]: pgmap v1822: 17 pgs: 17 active+clean; 7.0 GiB data, 20 GiB used, 964 GiB / 983 GiB avail; 46 MiB/s wr, 736 op/s 2024-04-01T19:55:20.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:20 smithi188 ceph-mon[43939]: osdmap e669: 12 total, 12 up, 11 in 2024-04-01T19:55:21.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:21 smithi062 ceph-mon[44211]: osdmap e670: 12 total, 12 up, 11 in 2024-04-01T19:55:21.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:21 smithi062 ceph-mon[44211]: pgmap v1825: 17 pgs: 17 active+clean; 7.3 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 73 MiB/s wr, 1.17k op/s 2024-04-01T19:55:21.806 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:55:21.810 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:21 smithi022 ceph-mon[39439]: osdmap e670: 12 total, 12 up, 11 in 2024-04-01T19:55:21.810 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:21 smithi022 ceph-mon[39439]: pgmap v1825: 17 pgs: 17 active+clean; 7.3 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 73 MiB/s wr, 1.17k op/s 2024-04-01T19:55:21.811 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:21.812 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:55:21.814 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:55:21.840 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:55:21.868 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:55:21.877 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 74 16 122259 122243 103.206 73.5625 0.00554816 0.00968781 2024-04-01T19:55:21.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:21 smithi188 ceph-mon[43939]: osdmap e670: 12 total, 12 up, 11 in 2024-04-01T19:55:21.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:21 smithi188 ceph-mon[43939]: pgmap v1825: 17 pgs: 17 active+clean; 7.3 GiB data, 20 GiB used, 963 GiB / 983 GiB avail; 73 MiB/s wr, 1.17k op/s 2024-04-01T19:55:21.894 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:55:21.912 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:55:21.915 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:55:21.946 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:55:21.948 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:21.969 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:55:21.970 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:55:21.975 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:21.975 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:55:21.993 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:55:22.016 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:55:22.045 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:55:22.074 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:55:22.076 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:55:22.103 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:55:22.134 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:22.136 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:55:22.139 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:55:22.139 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:55:22.139 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:55:22.139 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:55:22.140 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:55:22.140 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:55:22.140 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:55:22.140 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:55:22.140 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:55:22.140 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:55:22.140 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:55:22.140 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:55:22.289 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:55:22.292 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:22.293 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:55:22.394 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:55:22.429 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:22.726 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:22 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/382439449' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:55:22.726 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:22.726 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:22.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:22 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/382439449' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:55:22.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:22.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:22 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/382439449' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:55:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:22.878 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 75 16 123458 123442 102.828 74.9375 0.00983296 0.00972367 2024-04-01T19:55:22.909 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:55:22.909 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:55:23.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:23 smithi062 ceph-mon[44211]: pgmap v1826: 17 pgs: 17 active+clean; 7.4 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 64 MiB/s wr, 1.02k op/s 2024-04-01T19:55:23.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:23 smithi022 ceph-mon[39439]: pgmap v1826: 17 pgs: 17 active+clean; 7.4 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 64 MiB/s wr, 1.02k op/s 2024-04-01T19:55:23.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:23.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:23 smithi188 ceph-mon[43939]: pgmap v1826: 17 pgs: 17 active+clean; 7.4 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 64 MiB/s wr, 1.02k op/s 2024-04-01T19:55:23.878 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 76 16 124636 124620 102.443 73.625 0.00596058 0.00975944 2024-04-01T19:55:24.082 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:55:24.088 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:24.088 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:55:24.189 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:55:24.219 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:24.242 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:55:24.246 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:24.247 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:55:24.348 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:55:24.380 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:24.633 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:55:24.643 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:24.643 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:55:24.744 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:55:24.788 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:24.819 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:55:24.823 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:24.824 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:55:24.878 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 77 16 125802 125786 102.06 72.875 0.0105846 0.00979651 2024-04-01T19:55:24.925 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:55:24.955 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:25.011 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:55:25.022 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:25.022 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:55:25.123 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:55:25.156 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:25.179 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:55:25.186 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:25.187 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:55:25.288 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:55:25.318 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:25.515 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_historic_ops 2024-04-01T19:55:25.522 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:55:25.529 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:25.529 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:55:25.630 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:55:25.699 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:25.732 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:55:25.735 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:25.735 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:55:25.836 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:55:25.868 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:25.878 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 78 16 126971 126955 101.688 73.0625 0.0120452 0.00983225 2024-04-01T19:55:25.888 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:55:25.890 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:25.891 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:55:25.992 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:55:26.022 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:26.049 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:55:26.054 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:26.054 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:55:26.155 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:55:26.185 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:26.208 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:55:26.210 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:26.211 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:55:26.312 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:55:26.373 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:26.416 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:55:26.419 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:26.419 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:55:26.441 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:55:26.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:26 smithi062 ceph-mon[44211]: pgmap v1827: 17 pgs: 17 active+clean; 7.5 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 78 MiB/s wr, 1.24k op/s 2024-04-01T19:55:26.520 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:55:26.549 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:26.573 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:55:26.575 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:26.576 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:55:26.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:26 smithi188 ceph-mon[43939]: pgmap v1827: 17 pgs: 17 active+clean; 7.5 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 78 MiB/s wr, 1.24k op/s 2024-04-01T19:55:26.661 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:55:26.676 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:55:26.691 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:26 smithi022 ceph-mon[39439]: pgmap v1827: 17 pgs: 17 active+clean; 7.5 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 78 MiB/s wr, 1.24k op/s 2024-04-01T19:55:26.714 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:26.733 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:55:26.742 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:55:26.747 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:26.748 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:55:26.849 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:55:26.878 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:26.881 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 79 16 128123 128107 101.308 72 0.0187557 0.00986914 2024-04-01T19:55:26.901 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:55:26.905 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:26.906 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:55:27.007 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:55:27.041 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:27.064 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:55:27.068 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:27.069 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:55:27.170 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:55:27.209 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:27.287 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:55:27.290 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:27.291 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:55:27.392 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:55:27.422 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:27.445 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:55:27.450 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:27.450 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:55:27.551 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:55:27.608 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:27.636 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:55:27.639 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:27.639 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:55:27.741 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:55:27.773 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:27.882 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 19:55:27.884829 min lat: 0.00103479 max lat: 2.06154 avg lat: 0.00990548 2024-04-01T19:55:27.882 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:55:27.882 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 80 16 129272 129256 100.939 71.8125 0.00984254 0.00990548 2024-04-01T19:55:27.886 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:55:27.891 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:27.892 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:55:27.993 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:55:28.022 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:28.044 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:55:28.049 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:28.049 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:55:28.150 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:55:28.194 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:28.222 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:55:28.225 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:28.225 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:55:28.326 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:55:28.386 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:28.430 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:55:28.436 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:28.436 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:55:28.538 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:55:28.583 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:28.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:28 smithi188 ceph-mon[43939]: pgmap v1828: 17 pgs: 17 active+clean; 7.7 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 81 MiB/s wr, 1.30k op/s 2024-04-01T19:55:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:28 smithi062 ceph-mon[44211]: pgmap v1828: 17 pgs: 17 active+clean; 7.7 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 81 MiB/s wr, 1.30k op/s 2024-04-01T19:55:28.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:28 smithi022 ceph-mon[39439]: pgmap v1828: 17 pgs: 17 active+clean; 7.7 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 81 MiB/s wr, 1.30k op/s 2024-04-01T19:55:28.882 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 81 16 130422 130406 100.581 71.875 0.00443859 0.0099399 2024-04-01T19:55:29.241 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:55:29.244 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:29.245 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:55:29.345 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:55:29.380 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:29.409 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:55:29.414 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:29.415 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:55:29.429 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:55:29.515 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:55:29.541 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:29 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3289038985' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:55:29.542 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:29 smithi022 ceph-mon[39439]: from='client.37124 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:55:29.542 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:29 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:55:29.552 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:29.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:29 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3289038985' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:55:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:29 smithi062 ceph-mon[44211]: from='client.37124 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:55:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:29 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:55:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:29 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3289038985' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:55:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:29 smithi188 ceph-mon[43939]: from='client.37124 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:55:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:29 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:55:29.882 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 82 16 131517 131501 100.189 68.4375 0.0102153 0.0099792 2024-04-01T19:55:30.714 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:30 smithi022 ceph-mon[39439]: pgmap v1829: 17 pgs: 17 active+clean; 7.7 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 70 MiB/s wr, 1.13k op/s 2024-04-01T19:55:30.714 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:30 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:55:30.714 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:30 smithi022 ceph-mon[39439]: from='client.37124 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:55:30.714 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:30 smithi022 ceph-mon[39439]: osdmap e671: 12 total, 12 up, 11 in 2024-04-01T19:55:30.714 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:30 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:55:30.714 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:30 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:55:30.714 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:30 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:55:30.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:30 smithi062 ceph-mon[44211]: pgmap v1829: 17 pgs: 17 active+clean; 7.7 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 70 MiB/s wr, 1.13k op/s 2024-04-01T19:55:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:30 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:55:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:30 smithi062 ceph-mon[44211]: from='client.37124 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:55:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:30 smithi062 ceph-mon[44211]: osdmap e671: 12 total, 12 up, 11 in 2024-04-01T19:55:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:30 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:55:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:30 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:55:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:30 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:55:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:30 smithi188 ceph-mon[43939]: pgmap v1829: 17 pgs: 17 active+clean; 7.7 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 70 MiB/s wr, 1.13k op/s 2024-04-01T19:55:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:30 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:55:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:30 smithi188 ceph-mon[43939]: from='client.37124 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:55:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:30 smithi188 ceph-mon[43939]: osdmap e671: 12 total, 12 up, 11 in 2024-04-01T19:55:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:30 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:55:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:30 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:55:30.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:30 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:55:30.884 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 83 16 132656 132640 99.8361 71.1875 0.0354293 0.0100149 2024-04-01T19:55:31.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:31 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:55:31.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:31 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:55:31.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:31 smithi022 ceph-mon[39439]: 8.0 scrub starts 2024-04-01T19:55:31.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:31 smithi022 ceph-mon[39439]: pgmap v1831: 17 pgs: 17 active+clean; 8.0 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 73 MiB/s wr, 1.16k op/s 2024-04-01T19:55:31.710 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:55:31.713 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:31.714 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:55:31.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:31 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:55:31.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:31 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:55:31.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:31 smithi062 ceph-mon[44211]: 8.0 scrub starts 2024-04-01T19:55:31.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:31 smithi062 ceph-mon[44211]: pgmap v1831: 17 pgs: 17 active+clean; 8.0 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 73 MiB/s wr, 1.16k op/s 2024-04-01T19:55:31.811 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:55:31.811 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:55:31.815 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:55:31.856 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:31 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:55:31.856 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:31 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:55:31.856 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:31 smithi188 ceph-mon[43939]: 8.0 scrub starts 2024-04-01T19:55:31.856 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:31 smithi188 ceph-mon[43939]: pgmap v1831: 17 pgs: 17 active+clean; 8.0 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 73 MiB/s wr, 1.16k op/s 2024-04-01T19:55:31.859 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:31.884 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 84 16 133789 133773 99.4906 70.8125 0.0137789 0.0100493 2024-04-01T19:55:31.887 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:55:31.894 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:31.894 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:55:31.995 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:55:32.019 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:55:32.040 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:32.076 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:55:32.082 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:32.082 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:55:32.183 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:55:32.220 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:32.270 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:55:32.273 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:32.274 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:55:32.375 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:55:32.408 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:32.455 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:55:32.462 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:32.463 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:55:32.564 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:55:32.595 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:32.620 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:55:32.625 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:32.625 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:55:32.725 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:55:32.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:32 smithi062 ceph-mon[44211]: osdmap e672: 12 total, 12 up, 11 in 2024-04-01T19:55:32.775 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:32 smithi188 ceph-mon[43939]: osdmap e672: 12 total, 12 up, 11 in 2024-04-01T19:55:32.776 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:32.820 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:55:32.825 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:32.825 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:55:32.834 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:32 smithi022 ceph-mon[39439]: osdmap e672: 12 total, 12 up, 11 in 2024-04-01T19:55:32.886 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 85 16 134870 134854 99.1151 67.5625 0.00922572 0.0100878 2024-04-01T19:55:32.926 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:55:32.958 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:32.982 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:55:32.987 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:32.987 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:55:33.044 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:55:33.048 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:55:33.089 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:55:33.119 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:33.154 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:55:33.157 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:33.158 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:55:33.258 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:55:33.313 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:33.340 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:55:33.347 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:33.348 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:55:33.449 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:55:33.479 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:33.506 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:55:33.510 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:33.510 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:55:33.611 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:55:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:33 smithi188 ceph-mon[43939]: 8.0 scrub ok 2024-04-01T19:55:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:33 smithi188 ceph-mon[43939]: 8.e scrub starts 2024-04-01T19:55:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:33 smithi188 ceph-mon[43939]: 8.2 scrub starts 2024-04-01T19:55:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:33 smithi188 ceph-mon[43939]: from='client.17082 v1:172.21.15.22:0/2168832204' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:55:33.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:33 smithi188 ceph-mon[43939]: pgmap v1833: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.1 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 67 MiB/s wr, 1.08k op/s 2024-04-01T19:55:33.646 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:33.719 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:55:33.747 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:33 smithi022 ceph-mon[39439]: 8.0 scrub ok 2024-04-01T19:55:33.747 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:33 smithi022 ceph-mon[39439]: 8.e scrub starts 2024-04-01T19:55:33.747 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:33 smithi022 ceph-mon[39439]: 8.2 scrub starts 2024-04-01T19:55:33.747 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:33 smithi022 ceph-mon[39439]: from='client.17082 v1:172.21.15.22:0/2168832204' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:55:33.747 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:33 smithi022 ceph-mon[39439]: pgmap v1833: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.1 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 67 MiB/s wr, 1.08k op/s 2024-04-01T19:55:33.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:33 smithi062 ceph-mon[44211]: 8.0 scrub ok 2024-04-01T19:55:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:33 smithi062 ceph-mon[44211]: 8.e scrub starts 2024-04-01T19:55:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:33 smithi062 ceph-mon[44211]: 8.2 scrub starts 2024-04-01T19:55:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:33 smithi062 ceph-mon[44211]: from='client.17082 v1:172.21.15.22:0/2168832204' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:55:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:33 smithi062 ceph-mon[44211]: pgmap v1833: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.1 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 67 MiB/s wr, 1.08k op/s 2024-04-01T19:55:33.888 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 86 16 135876 135860 98.69 62.875 0.00740548 0.010131 2024-04-01T19:55:34.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:34 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T19:55:34.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:34 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T19:55:34.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:34 smithi022 ceph-mon[39439]: 8.4 scrub starts 2024-04-01T19:55:34.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:34 smithi022 ceph-mon[39439]: 8.e scrub ok 2024-04-01T19:55:34.755 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":1832,"stamp":"2024-04-01T19:55:31.485162+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8593408544,"num_objects":131118,"num_object_clones":0,"num_object_copies":262236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131118,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":131297,"num_write_kb":8394362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3954,"num_bytes_recovered":260720768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134876,"ondisk_log_size":134876,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":11,"num_per_pool_osds":11,"num_per_pool_omap_osds":10,"kb":1031196672,"kb_used":22897312,"kb_used_data":16690408,"kb_used_omap":890,"kb_used_meta":6205189,"kb_avail":1008299360,"statfs":{"total":1055945392128,"available":1032498544640,"internally_reserved":0,"allocated":17090977792,"data_stored":17084727858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":911939,"internal_metadata":6354113981},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":690094080,"num_objects":10530,"num_object_clones":0,"num_object_copies":21060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10530,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10530,"num_write_kb":673920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.132046"},"pg_stats":[{"pgid":"8.f","version":"671'8299","reported_seq":8392,"reported_epoch":671,"state":"active+clean","last_fresh":"2024-04-01T19:55:30.005349+0000","last_change":"2024-04-01T19:53:54.067516+0000","last_active":"2024-04-01T19:55:30.005349+0000","last_peered":"2024-04-01T19:55:30.005349+0000","last_clean":"2024-04-01T19:55:30.005349+0000","last_became_active":"2024-04-01T19:53:54.067307+0000","last_became_peered":"2024-04-01T19:53:54.067307+0000","last_unstale":"2024-04-01T19:55:30.005349+0000","last_undegraded":"2024-04-01T19:55:30.005349+0000","last_fullsized":"2024-04-01T19:55:30.005349+0000","mapping_epoch":629,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":0,"log_size":8299,"log_dups_size":0,"ondisk_log_size":8299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:55:33.304604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":543883264,"num_objects":8299,"num_object_clones":0,"num_object_copies":16598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8299,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8299,"num_write_kb":531136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.e","version":"671'8119","reported_seq":8211,"reported_epoch":671,"state":"active+clean","last_fresh":"2024-04-01T19:55:30.393708+0000","last_change":"2024-04-01T19:53:54.066875+0000","last_active":"2024-04-01T19:55:30.393708+0000","last_peered":"2024-04-01T19:55:30.393708+0000","last_clean":"2024-04-01T19:55:30.393708+0000","last_became_active":"2024-04-01T19:53:54.066471+0000","last_became_peered":"2024-04-01T19:53:54.066471+0000","last_unstale":"2024-04-01T19:55:30.393708+0000","last_undegraded":"2024-04-01T19:55:30.393708+0000","last_fullsized":"2024-04-01T19:55:30.393708+0000","mapping_epoch":629,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":0,"log_size":8119,"log_dups_size":0,"ondisk_log_size":8119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532086784,"num_objects":8119,"num_object_clones":0,"num_object_copies":16238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8119,"num_write_kb":519616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"671'8367","reported_seq":8460,"reported_epoch":671,"state":"active+clean","last_fresh":"2024-04-01T19:55:29.966658+0000","last_change":"2024-04-01T19:53:53.679291+0000","last_active":"2024-04-01T19:55:29.966658+0000","last_peered":"2024-04-01T19:55:29.966658+0000","last_clean":"2024-04-01T19:55:29.966658+0000","last_became_active":"2024-04-01T19:53:53.678991+0000","last_became_peered":"2024-04-01T19:53:53.678991+0000","last_unstale":"2024-04-01T19:55:29.966658+0000","last_undegraded":"2024-04-01T19:55:29.966658+0000","last_fullsized":"2024-04-01T19:55:29.966658+0000","mapping_epoch":629,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":0,"log_size":8367,"log_dups_size":0,"ondisk_log_size":8367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:55:33.311432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":548339712,"num_objects":8367,"num_object_clones":0,"num_object_copies":16734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8367,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8367,"num_write_kb":535488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.c","version":"671'8280","reported_seq":8372,"reported_epoch":671,"state":"active+clean","last_fresh":"2024-04-01T19:55:30.606595+0000","last_change":"2024-04-01T19:53:53.462953+0000","last_active":"2024-04-01T19:55:30.606595+0000","last_peered":"2024-04-01T19:55:30.606595+0000","last_clean":"2024-04-01T19:55:30.606595+0000","last_became_active":"2024-04-01T19:53:53.462634+0000","last_became_peered":"2024-04-01T19:53:53.462634+0000","last_unstale":"2024-04-01T19:55:30.606595+0000","last_undegraded":"2024-04-01T19:55:30.606595+0000","last_fullsized":"2024-04-01T19:55:30.606595+0000","mapping_epoch":629,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":0,"log_size":8280,"log_dups_size":0,"ondisk_log_size":8280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:55:32.144378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":542638080,"num_objects":8280,"num_object_clones":0,"num_object_copies":16560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8280,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8280,"num_write_kb":529920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"8.b","version":"670'8355","reported_seq":8446,"reported_epoch":670,"state":"active+clean","last_fresh":"2024-04-01T19:55:29.370221+0000","last_change":"2024-04-01T19:53:53.457209+0000","last_active":"2024-04-01T19:55:29.370221+0000","last_peered":"2024-04-01T19:55:29.370221+0000","last_clean":"2024-04-01T19:55:29.370221+0000","last_became_active":"2024-04-01T19:53:53.456979+0000","last_became_peered":"2024-04-01T19:53:53.456979+0000","last_unstale":"2024-04-01T19:55:29.370221+0000","last_undegraded":"2024-04-01T19:55:29.370221+0000","last_fullsized":"2024-04-01T19:55:29.370221+0000","mapping_epoch":629,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":0,"log_size":8355,"log_dups_size":0,"ondisk_log_size":8355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:55:31.846816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":547553280,"num_objects":8355,"num_object_clones":0,"num_object_copies":16710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8355,"num_write_kb":534720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"8.a","version":"670'8068","reported_seq":8227,"reported_epoch":670,"state":"active+clean","last_fresh":"2024-04-01T19:55:29.383410+0000","last_change":"2024-04-01T19:54:58.982265+0000","last_active":"2024-04-01T19:55:29.383410+0000","last_peered":"2024-04-01T19:55:29.383410+0000","last_clean":"2024-04-01T19:55:29.383410+0000","last_became_active":"2024-04-01T19:53:54.066588+0000","last_became_peered":"2024-04-01T19:53:54.066588+0000","last_unstale":"2024-04-01T19:55:29.383410+0000","last_undegraded":"2024-04-01T19:55:29.383410+0000","last_fullsized":"2024-04-01T19:55:29.383410+0000","mapping_epoch":629,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"661'6054","last_scrub_stamp":"2024-04-01T19:54:58.982118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:54:58.982118+0000","objects_scrubbed":6021,"log_size":8068,"log_dups_size":0,"ondisk_log_size":8068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:56:11.305013+0000","scrub_duration":935,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528744448,"num_objects":8068,"num_object_clones":0,"num_object_copies":16136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8068,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8068,"num_write_kb":516352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"8.8","version":"671'8331","reported_seq":8424,"reported_epoch":671,"state":"active+clean","last_fresh":"2024-04-01T19:55:30.645232+0000","last_change":"2024-04-01T19:53:53.455172+0000","last_active":"2024-04-01T19:55:30.645232+0000","last_peered":"2024-04-01T19:55:30.645232+0000","last_clean":"2024-04-01T19:55:30.645232+0000","last_became_active":"2024-04-01T19:53:53.454737+0000","last_became_peered":"2024-04-01T19:53:53.454737+0000","last_unstale":"2024-04-01T19:55:30.645232+0000","last_undegraded":"2024-04-01T19:55:30.645232+0000","last_fullsized":"2024-04-01T19:55:30.645232+0000","mapping_epoch":629,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":0,"log_size":8331,"log_dups_size":0,"ondisk_log_size":8331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":545980416,"num_objects":8331,"num_object_clones":0,"num_object_copies":16662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8331,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8331,"num_write_kb":533184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"671'8170","reported_seq":9797,"reported_epoch":671,"state":"active+clean","last_fresh":"2024-04-01T19:55:29.992656+0000","last_change":"2024-04-01T19:54:15.322424+0000","last_active":"2024-04-01T19:55:29.992656+0000","last_peered":"2024-04-01T19:55:29.992656+0000","last_clean":"2024-04-01T19:55:29.992656+0000","last_became_active":"2024-04-01T19:54:11.514611+0000","last_became_peered":"2024-04-01T19:54:11.514611+0000","last_unstale":"2024-04-01T19:55:29.992656+0000","last_undegraded":"2024-04-01T19:55:29.992656+0000","last_fullsized":"2024-04-01T19:55:29.992656+0000","mapping_epoch":637,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":641,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":0,"log_size":8170,"log_dups_size":0,"ondisk_log_size":8170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:55:33.311393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535429120,"num_objects":8170,"num_object_clones":0,"num_object_copies":16340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8170,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8170,"num_write_kb":522880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":764,"num_bytes_recovered":50069504,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.6","version":"671'8242","reported_seq":9949,"reported_epoch":671,"state":"active+clean","last_fresh":"2024-04-01T19:55:29.997877+0000","last_change":"2024-04-01T19:54:15.807532+0000","last_active":"2024-04-01T19:55:29.997877+0000","last_peered":"2024-04-01T19:55:29.997877+0000","last_clean":"2024-04-01T19:55:29.997877+0000","last_became_active":"2024-04-01T19:54:11.515237+0000","last_became_peered":"2024-04-01T19:54:11.515237+0000","last_unstale":"2024-04-01T19:55:29.997877+0000","last_undegraded":"2024-04-01T19:55:29.997877+0000","last_fullsized":"2024-04-01T19:55:29.997877+0000","mapping_epoch":637,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":642,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":0,"log_size":8242,"log_dups_size":0,"ondisk_log_size":8242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:55:33.304584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540147712,"num_objects":8242,"num_object_clones":0,"num_object_copies":16484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8242,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8242,"num_write_kb":527488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":804,"num_bytes_recovered":52690944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.5","version":"670'8094","reported_seq":9774,"reported_epoch":670,"state":"active+clean","last_fresh":"2024-04-01T19:55:27.468059+0000","last_change":"2024-04-01T19:54:18.038335+0000","last_active":"2024-04-01T19:55:27.468059+0000","last_peered":"2024-04-01T19:55:27.468059+0000","last_clean":"2024-04-01T19:55:27.468059+0000","last_became_active":"2024-04-01T19:54:18.036312+0000","last_became_peered":"2024-04-01T19:54:18.036312+0000","last_unstale":"2024-04-01T19:55:27.468059+0000","last_undegraded":"2024-04-01T19:55:27.468059+0000","last_fullsized":"2024-04-01T19:55:27.468059+0000","mapping_epoch":643,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":644,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":0,"log_size":8094,"log_dups_size":0,"ondisk_log_size":8094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:55:30.568619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530448384,"num_objects":8094,"num_object_clones":0,"num_object_copies":16188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8094,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8094,"num_write_kb":518016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":790,"num_bytes_recovered":51773440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"8.4","version":"671'11095","reported_seq":11391,"reported_epoch":671,"state":"active+clean","last_fresh":"2024-04-01T19:55:30.664697+0000","last_change":"2024-04-01T19:55:15.486738+0000","last_active":"2024-04-01T19:55:30.664697+0000","last_peered":"2024-04-01T19:55:30.664697+0000","last_clean":"2024-04-01T19:55:30.664697+0000","last_became_active":"2024-04-01T19:53:53.462894+0000","last_became_peered":"2024-04-01T19:53:53.462894+0000","last_unstale":"2024-04-01T19:55:30.664697+0000","last_undegraded":"2024-04-01T19:55:30.664697+0000","last_fullsized":"2024-04-01T19:55:30.664697+0000","mapping_epoch":629,"log_start":"639'1000","ondisk_log_start":"639'1000","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":4859,"log_size":10095,"log_dups_size":0,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":546111488,"num_objects":8333,"num_object_clones":0,"num_object_copies":16666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8333,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8333,"num_write_kb":533312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"671'8185","reported_seq":8345,"reported_epoch":671,"state":"active+clean","last_fresh":"2024-04-01T19:55:29.938553+0000","last_change":"2024-04-01T19:54:55.108987+0000","last_active":"2024-04-01T19:55:29.938553+0000","last_peered":"2024-04-01T19:55:29.938553+0000","last_clean":"2024-04-01T19:55:29.938553+0000","last_became_active":"2024-04-01T19:53:53.462397+0000","last_became_peered":"2024-04-01T19:53:53.462397+0000","last_unstale":"2024-04-01T19:55:29.938553+0000","last_undegraded":"2024-04-01T19:55:29.938553+0000","last_fullsized":"2024-04-01T19:55:29.938553+0000","mapping_epoch":629,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"660'5871","last_scrub_stamp":"2024-04-01T19:54:55.108780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:54:55.108780+0000","objects_scrubbed":5824,"log_size":8185,"log_dups_size":0,"ondisk_log_size":8185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:55:55.119663+0000","scrub_duration":1164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":536412160,"num_objects":8185,"num_object_clones":0,"num_object_copies":16370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8185,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8185,"num_write_kb":523840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.2","version":"670'7890","reported_seq":9609,"reported_epoch":670,"state":"active+clean","last_fresh":"2024-04-01T19:55:27.505743+0000","last_change":"2024-04-01T19:54:19.037004+0000","last_active":"2024-04-01T19:55:27.505743+0000","last_peered":"2024-04-01T19:55:27.505743+0000","last_clean":"2024-04-01T19:55:27.505743+0000","last_became_active":"2024-04-01T19:54:19.034659+0000","last_became_peered":"2024-04-01T19:54:19.034659+0000","last_unstale":"2024-04-01T19:55:27.505743+0000","last_undegraded":"2024-04-01T19:55:27.505743+0000","last_fullsized":"2024-04-01T19:55:27.505743+0000","mapping_epoch":644,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":645,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":0,"log_size":7890,"log_dups_size":0,"ondisk_log_size":7890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:55:30.568581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":517079040,"num_objects":7890,"num_object_clones":0,"num_object_copies":15780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7890,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7890,"num_write_kb":504960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":810,"num_bytes_recovered":53084160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0],"acting":[10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"8.1","version":"671'11157","reported_seq":11466,"reported_epoch":671,"state":"active+clean","last_fresh":"2024-04-01T19:55:30.569835+0000","last_change":"2024-04-01T19:55:15.421839+0000","last_active":"2024-04-01T19:55:30.569835+0000","last_peered":"2024-04-01T19:55:30.569835+0000","last_clean":"2024-04-01T19:55:30.569835+0000","last_became_active":"2024-04-01T19:53:54.066680+0000","last_became_peered":"2024-04-01T19:53:54.066680+0000","last_unstale":"2024-04-01T19:55:30.569835+0000","last_undegraded":"2024-04-01T19:55:30.569835+0000","last_fullsized":"2024-04-01T19:55:30.569835+0000","mapping_epoch":629,"log_start":"640'1100","ondisk_log_start":"640'1100","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":5273,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:55:32.142578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":537264128,"num_objects":8198,"num_object_clones":0,"num_object_copies":16396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8198,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8198,"num_write_kb":524672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"8.0","version":"670'8019","reported_seq":8110,"reported_epoch":670,"state":"active+clean","last_fresh":"2024-04-01T19:55:28.636981+0000","last_change":"2024-04-01T19:53:53.455578+0000","last_active":"2024-04-01T19:55:28.636981+0000","last_peered":"2024-04-01T19:55:28.636981+0000","last_clean":"2024-04-01T19:55:28.636981+0000","last_became_active":"2024-04-01T19:53:53.455265+0000","last_became_peered":"2024-04-01T19:53:53.455265+0000","last_unstale":"2024-04-01T19:55:28.636981+0000","last_undegraded":"2024-04-01T19:55:28.636981+0000","last_fullsized":"2024-04-01T19:55:28.636981+0000","mapping_epoch":629,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":0,"log_size":8019,"log_dups_size":0,"ondisk_log_size":8019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525533184,"num_objects":8019,"num_object_clones":0,"num_object_copies":16038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8019,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8019,"num_write_kb":513216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"670'8166","reported_seq":9824,"reported_epoch":670,"state":"active+clean","last_fresh":"2024-04-01T19:55:27.465366+0000","last_change":"2024-04-01T19:54:19.037520+0000","last_active":"2024-04-01T19:55:27.465366+0000","last_peered":"2024-04-01T19:55:27.465366+0000","last_clean":"2024-04-01T19:55:27.465366+0000","last_became_active":"2024-04-01T19:54:19.035216+0000","last_became_peered":"2024-04-01T19:54:19.035216+0000","last_unstale":"2024-04-01T19:55:27.465366+0000","last_undegraded":"2024-04-01T19:55:27.465366+0000","last_fullsized":"2024-04-01T19:55:27.465366+0000","mapping_epoch":644,"log_start":"0'0","ondisk_log_start":"0'0","created":629,"last_epoch_clean":645,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:53:52.440963+0000","objects_scrubbed":0,"log_size":8166,"log_dups_size":0,"ondisk_log_size":8166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:55:30.568659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535166976,"num_objects":8166,"num_object_clones":0,"num_object_copies":16332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8166,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8166,"num_write_kb":522624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":778,"num_bytes_recovered":50987008,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":1657,"reported_epoch":670,"state":"active+clean","last_fresh":"2024-04-01T19:55:20.482234+0000","last_change":"2024-04-01T19:53:53.823471+0000","last_active":"2024-04-01T19:55:20.482234+0000","last_peered":"2024-04-01T19:55:20.482234+0000","last_clean":"2024-04-01T19:55:20.482234+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:55:20.482234+0000","last_undegraded":"2024-04-01T19:55:20.482234+0000","last_fullsized":"2024-04-01T19:55:20.482234+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:53:53.823361+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:53:53.823361+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:55:24.939549+0000","scrub_duration":145,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":8592818176,"num_objects":131116,"num_object_clones":0,"num_object_copies":262232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131116,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131116,"num_write_kb":8391424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3946,"num_bytes_recovered":258605056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17147166720,"data_stored":17147166720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134737,"ondisk_log_size":134737,"up":32,"acting":32,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220555,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3440496,"kb_used_data":2629096,"kb_used_omap":1,"kb_used_meta":811390,"kb_avail":90304656,"statfs":{"total":95995035648,"available":92471967744,"internally_reserved":0,"allocated":2692194304,"data_stored":2691584862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":830863812},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":77,"seq":330712482190,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3171880,"kb_used_data":2554848,"kb_used_omap":1,"kb_used_meta":617022,"kb_avail":90573272,"statfs":{"total":95995035648,"available":92747030528,"internally_reserved":0,"allocated":2616164352,"data_stored":2615558462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":631830976},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678422,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2164216,"kb_used_data":1583096,"kb_used_omap":1,"kb_used_meta":580926,"kb_avail":91580936,"statfs":{"total":95995035648,"available":93778878464,"internally_reserved":0,"allocated":1621090304,"data_stored":1620568790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":594868672},"hb_peers":[1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557619,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1778664,"kb_used_data":1570272,"kb_used_omap":132,"kb_used_meta":208251,"kb_avail":91966488,"statfs":{"total":95995035648,"available":94173683712,"internally_reserved":0,"allocated":1607958528,"data_stored":1607352658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":213249767},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234400,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1108656,"kb_used_data":531880,"kb_used_omap":1,"kb_used_meta":576766,"kb_avail":92636496,"statfs":{"total":95995035648,"available":94859771904,"internally_reserved":0,"allocated":544645120,"data_stored":544035698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":590608842},"hb_peers":[0,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":457,"seq":1962800054412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":254072,"kb_used_data":1016,"kb_used_omap":744,"kb_used_meta":252119,"kb_avail":93491080,"statfs":{"total":95995035648,"available":95734865920,"internally_reserved":0,"allocated":1040384,"data_stored":518870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":762131,"internal_metadata":258170605},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":2452426326079,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738821,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1664248,"kb_used_data":1037304,"kb_used_omap":1,"kb_used_meta":626750,"kb_avail":92080904,"statfs":{"total":95995035648,"available":94290845696,"internally_reserved":0,"allocated":1062199296,"data_stored":1061677782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":641792453},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346361,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2532520,"kb_used_data":2027936,"kb_used_omap":1,"kb_used_meta":504574,"kb_avail":91212632,"statfs":{"total":95995035648,"available":93401735168,"internally_reserved":0,"allocated":2076606464,"data_stored":2076000594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":516684229},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669150131,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1776680,"kb_used_data":1037472,"kb_used_omap":1,"kb_used_meta":739198,"kb_avail":91968472,"statfs":{"total":95995035648,"available":94175715328,"internally_reserved":0,"allocated":1062371328,"data_stored":1061765458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":756939207},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953902,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1712192,"kb_used_data":1077112,"kb_used_omap":1,"kb_used_meta":635070,"kb_avail":92032960,"statfs":{"total":95995035648,"available":94241751040,"internally_reserved":0,"allocated":1102962688,"data_stored":1102441174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":650312133},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790378,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":3293688,"kb_used_data":2640376,"kb_used_omap":1,"kb_used_meta":653118,"kb_avail":90451464,"statfs":{"total":95995035648,"available":92622299136,"internally_reserved":0,"allocated":2703745024,"data_stored":2703223510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":668793285},"hb_peers":[0,1,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1061683200,"data_stored":1061683200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2079129600,"data_stored":2079129600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1061355520,"data_stored":1061355520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1106313216,"data_stored":1106313216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2716205056,"data_stored":2716205056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":542965760,"data_stored":542965760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":1613430784,"data_stored":1613430784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":1626013696,"data_stored":1626013696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":2635726848,"data_stored":2635726848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":2704343040,"data_stored":2704343040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:55:34.756 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-01T19:55:34.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:34 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T19:55:34.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:34 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T19:55:34.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:34 smithi062 ceph-mon[44211]: 8.4 scrub starts 2024-04-01T19:55:34.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:34 smithi062 ceph-mon[44211]: 8.e scrub ok 2024-04-01T19:55:34.799 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:55:34.802 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:34.802 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:55:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:34 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T19:55:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:34 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T19:55:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:34 smithi188 ceph-mon[43939]: 8.4 scrub starts 2024-04-01T19:55:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:34 smithi188 ceph-mon[43939]: 8.e scrub ok 2024-04-01T19:55:34.888 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 87 16 136807 136791 98.2245 58.1875 0.0162116 0.0101788 2024-04-01T19:55:34.903 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:55:34.933 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:34.955 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:55:34.957 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:34.957 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:55:35.058 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:55:35.087 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:35.109 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:55:35.113 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:35.113 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:55:35.214 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:55:35.248 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:35.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:35 smithi022 ceph-mon[39439]: 8.2 scrub ok 2024-04-01T19:55:35.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:35 smithi022 ceph-mon[39439]: 8.1 scrub starts 2024-04-01T19:55:35.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:35 smithi022 ceph-mon[39439]: 8.6 scrub starts 2024-04-01T19:55:35.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:35 smithi022 ceph-mon[39439]: 8.5 scrub starts 2024-04-01T19:55:35.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:35 smithi022 ceph-mon[39439]: pgmap v1834: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.2 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 74 MiB/s wr, 1.18k op/s 2024-04-01T19:55:35.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:35 smithi188 ceph-mon[43939]: 8.2 scrub ok 2024-04-01T19:55:35.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:35 smithi188 ceph-mon[43939]: 8.1 scrub starts 2024-04-01T19:55:35.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:35 smithi188 ceph-mon[43939]: 8.6 scrub starts 2024-04-01T19:55:35.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:35 smithi188 ceph-mon[43939]: 8.5 scrub starts 2024-04-01T19:55:35.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:35 smithi188 ceph-mon[43939]: pgmap v1834: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.2 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 74 MiB/s wr, 1.18k op/s 2024-04-01T19:55:35.892 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 88 16 137569 137553 97.6467 47.625 0.024119 0.0102388 2024-04-01T19:55:36.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:35 smithi062 ceph-mon[44211]: 8.2 scrub ok 2024-04-01T19:55:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:35 smithi062 ceph-mon[44211]: 8.1 scrub starts 2024-04-01T19:55:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:35 smithi062 ceph-mon[44211]: 8.6 scrub starts 2024-04-01T19:55:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:35 smithi062 ceph-mon[44211]: 8.5 scrub starts 2024-04-01T19:55:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:35 smithi062 ceph-mon[44211]: pgmap v1834: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.2 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 74 MiB/s wr, 1.18k op/s 2024-04-01T19:55:36.130 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:55:36.133 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:36.134 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:55:36.235 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:55:36.263 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:36.527 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:36 smithi022 ceph-mon[39439]: 8.4 scrub ok 2024-04-01T19:55:36.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:36 smithi022 ceph-mon[39439]: 8.c scrub starts 2024-04-01T19:55:36.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:36 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:55:36.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:36 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:55:36.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:36 smithi022 ceph-mon[39439]: 8.1 scrub ok 2024-04-01T19:55:36.714 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:55:36.717 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:36.717 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:55:36.745 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_ops_in_flight 2024-04-01T19:55:36.818 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:55:36.845 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:36 smithi062 ceph-mon[44211]: 8.4 scrub ok 2024-04-01T19:55:36.845 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:36 smithi062 ceph-mon[44211]: 8.c scrub starts 2024-04-01T19:55:36.845 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:36 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:55:36.845 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:36 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:55:36.845 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:36 smithi062 ceph-mon[44211]: 8.1 scrub ok 2024-04-01T19:55:36.847 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:36.868 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:55:36.873 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:36.873 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:55:36.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:36 smithi188 ceph-mon[43939]: 8.4 scrub ok 2024-04-01T19:55:36.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:36 smithi188 ceph-mon[43939]: 8.c scrub starts 2024-04-01T19:55:36.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:36 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:55:36.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:36 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:55:36.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:36 smithi188 ceph-mon[43939]: 8.1 scrub ok 2024-04-01T19:55:36.892 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 89 16 138457 138441 97.1721 55.5 0.0140645 0.0102894 2024-04-01T19:55:36.974 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:55:37.018 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:37.056 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:55:37.059 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:37.060 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:55:37.161 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:55:37.195 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:37.399 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:55:37.403 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:37.404 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:55:37.430 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:55:37.433 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:55:37.505 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:55:37.545 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:37 smithi022 ceph-mon[39439]: 8.5 scrub ok 2024-04-01T19:55:37.546 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:37 smithi022 ceph-mon[39439]: osdmap e673: 12 total, 12 up, 11 in 2024-04-01T19:55:37.546 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:37 smithi022 ceph-mon[39439]: 8.6 scrub ok 2024-04-01T19:55:37.546 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:37 smithi022 ceph-mon[39439]: pgmap v1836: 17 pgs: 4 active+clean+scrubbing, 13 active+clean; 8.3 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 70 MiB/s wr, 1.12k op/s 2024-04-01T19:55:37.546 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:37 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1362924091' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:55:37.548 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:37.555 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:55:37.573 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:55:37.596 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:55:37.621 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:55:37.644 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:55:37.667 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:55:37.692 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:55:37.700 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:55:37.703 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:37.703 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:55:37.718 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:55:37.750 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:55:37.779 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:55:37.805 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:55:37.820 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:55:37.839 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:37.844 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:55:37.845 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:55:37.845 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:55:37.846 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:55:37.846 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:55:37.846 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:55:37.846 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:55:37.846 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:55:37.846 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:55:37.846 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:55:37.846 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:55:37.846 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:55:37.846 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:55:37.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:37 smithi188 ceph-mon[43939]: 8.5 scrub ok 2024-04-01T19:55:37.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:37 smithi188 ceph-mon[43939]: osdmap e673: 12 total, 12 up, 11 in 2024-04-01T19:55:37.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:37 smithi188 ceph-mon[43939]: 8.6 scrub ok 2024-04-01T19:55:37.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:37 smithi188 ceph-mon[43939]: pgmap v1836: 17 pgs: 4 active+clean+scrubbing, 13 active+clean; 8.3 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 70 MiB/s wr, 1.12k op/s 2024-04-01T19:55:37.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:37 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1362924091' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:55:37.892 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Total time run: 90.0205 2024-04-01T19:55:37.892 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Total writes made: 139279 2024-04-01T19:55:37.893 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Write size: 65536 2024-04-01T19:55:37.893 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Object size: 65536 2024-04-01T19:55:37.893 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Bandwidth (MB/sec): 96.6996 2024-04-01T19:55:37.893 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Stddev Bandwidth: 49.8494 2024-04-01T19:55:37.893 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Max bandwidth (MB/sec): 331.812 2024-04-01T19:55:37.893 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Min bandwidth (MB/sec): 2.375 2024-04-01T19:55:37.893 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Average IOPS: 1547 2024-04-01T19:55:37.893 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Stddev IOPS: 797.591 2024-04-01T19:55:37.893 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Max IOPS: 5309 2024-04-01T19:55:37.893 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Min IOPS: 38 2024-04-01T19:55:37.893 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Average Latency(s): 0.0103402 2024-04-01T19:55:37.893 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Stddev Latency(s): 0.026022 2024-04-01T19:55:37.893 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Max latency(s): 2.06154 2024-04-01T19:55:37.893 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Min latency(s): 0.00103479 2024-04-01T19:55:37.898 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Cleaning up (deleting benchmark objects) 2024-04-01T19:55:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:37 smithi062 ceph-mon[44211]: 8.5 scrub ok 2024-04-01T19:55:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:37 smithi062 ceph-mon[44211]: osdmap e673: 12 total, 12 up, 11 in 2024-04-01T19:55:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:37 smithi062 ceph-mon[44211]: 8.6 scrub ok 2024-04-01T19:55:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:37 smithi062 ceph-mon[44211]: pgmap v1836: 17 pgs: 4 active+clean+scrubbing, 13 active+clean; 8.3 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 70 MiB/s wr, 1.12k op/s 2024-04-01T19:55:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:37 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1362924091' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:55:38.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:38 smithi022 ceph-mon[39439]: 8.b scrub starts 2024-04-01T19:55:38.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:38 smithi022 ceph-mon[39439]: 8.c scrub ok 2024-04-01T19:55:38.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:38 smithi022 ceph-mon[39439]: 8.f scrub starts 2024-04-01T19:55:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:38 smithi022 ceph-mon[39439]: 8.9 scrub starts 2024-04-01T19:55:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:38.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:38 smithi188 ceph-mon[43939]: 8.b scrub starts 2024-04-01T19:55:38.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:38 smithi188 ceph-mon[43939]: 8.c scrub ok 2024-04-01T19:55:38.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:38 smithi188 ceph-mon[43939]: 8.f scrub starts 2024-04-01T19:55:38.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:38 smithi188 ceph-mon[43939]: 8.9 scrub starts 2024-04-01T19:55:38.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:38.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:38.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:38.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:38.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:38.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:38.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:38.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:38.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:39.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:38 smithi062 ceph-mon[44211]: 8.b scrub starts 2024-04-01T19:55:39.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:38 smithi062 ceph-mon[44211]: 8.c scrub ok 2024-04-01T19:55:39.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:38 smithi062 ceph-mon[44211]: 8.f scrub starts 2024-04-01T19:55:39.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:38 smithi062 ceph-mon[44211]: 8.9 scrub starts 2024-04-01T19:55:39.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:39.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:39.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:39.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:39.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:39.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:39.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:39.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:39.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:39.294 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:55:39.301 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:39.301 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:55:39.402 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:55:39.462 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:39.493 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:55:39.498 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:39.499 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:55:39.600 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:55:39.635 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:39.659 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:55:39.664 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:39.664 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:55:39.765 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:55:39.797 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:39.820 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:55:39.822 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:39.822 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:39.822 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:39.822 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:39 smithi062 ceph-mon[44211]: 8.b scrub ok 2024-04-01T19:55:39.822 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:39 smithi062 ceph-mon[44211]: pgmap v1837: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 8.4 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 50 MiB/s wr, 810 op/s 2024-04-01T19:55:39.823 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:39.823 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:55:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:39.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:39 smithi022 ceph-mon[39439]: 8.b scrub ok 2024-04-01T19:55:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:39 smithi022 ceph-mon[39439]: pgmap v1837: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 8.4 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 50 MiB/s wr, 810 op/s 2024-04-01T19:55:39.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:39.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:39.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:39.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:39 smithi188 ceph-mon[43939]: 8.b scrub ok 2024-04-01T19:55:39.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:39 smithi188 ceph-mon[43939]: pgmap v1837: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 8.4 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 50 MiB/s wr, 810 op/s 2024-04-01T19:55:39.924 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:55:39.974 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:40.006 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:55:40.011 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:40.012 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:55:40.113 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:55:40.151 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:40.196 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:55:40.199 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:40.199 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:55:40.300 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:55:40.356 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:40.398 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:55:40.406 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:40.407 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:55:40.508 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:55:40.540 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:40.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:40 smithi188 ceph-mon[43939]: 8.8 scrub starts 2024-04-01T19:55:40.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:40 smithi188 ceph-mon[43939]: 8.f scrub ok 2024-04-01T19:55:40.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:40 smithi188 ceph-mon[43939]: 8.9 scrub ok 2024-04-01T19:55:40.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:40 smithi022 ceph-mon[39439]: 8.8 scrub starts 2024-04-01T19:55:40.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:40 smithi022 ceph-mon[39439]: 8.f scrub ok 2024-04-01T19:55:40.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:40 smithi022 ceph-mon[39439]: 8.9 scrub ok 2024-04-01T19:55:40.906 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:55:40.910 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:40.910 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:55:41.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:40 smithi062 ceph-mon[44211]: 8.8 scrub starts 2024-04-01T19:55:41.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:40 smithi062 ceph-mon[44211]: 8.f scrub ok 2024-04-01T19:55:41.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:40 smithi062 ceph-mon[44211]: 8.9 scrub ok 2024-04-01T19:55:41.011 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:55:41.047 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:41.127 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:55:41.133 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:41.134 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:55:41.235 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:55:41.297 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:41.343 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:55:41.347 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:41.348 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:55:41.417 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:55:41.418 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T19:55:41.418 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:55:41.418 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.26983.0:142966 8.1 e673/629 8:8e0e8b15:::benchmark_data_smithi188_161190_object3684:head v 673'11831, mlcod=673'11829)", 2024-04-01T19:55:41.418 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:55:41.416881+0000", 2024-04-01T19:55:41.418 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0032467170000000001, 2024-04-01T19:55:41.418 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0032717499999999999, 2024-04-01T19:55:41.418 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T19:55:41.418 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T19:55:41.418 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T19:55:41.418 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T19:55:41.418 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:55:41.419 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T19:55:41.419 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:55:41.416881+0000", 2024-04-01T19:55:41.419 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:55:41.419 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:55:41.419 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:55:41.419 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T19:55:41.419 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:55:41.416881+0000", 2024-04-01T19:55:41.419 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T19:55:41.419 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:55:41.419 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:55:41.419 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T19:55:41.419 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:55:41.416883+0000", 2024-04-01T19:55:41.419 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0150000000000002e-06 2024-04-01T19:55:41.419 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:55:41.419 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:55:41.420 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T19:55:41.420 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:55:41.416893+0000", 2024-04-01T19:55:41.420 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0042e-05 2024-04-01T19:55:41.420 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:55:41.420 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:55:41.420 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T19:55:41.420 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:55:41.416907+0000", 2024-04-01T19:55:41.420 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4165000000000001e-05 2024-04-01T19:55:41.420 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:55:41.420 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:55:41.420 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T19:55:41.420 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:55:41.416918+0000", 2024-04-01T19:55:41.420 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1182000000000001e-05 2024-04-01T19:55:41.420 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:55:41.420 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:55:41.421 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T19:55:41.421 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:55:41.416990+0000", 2024-04-01T19:55:41.421 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.1217000000000006e-05 2024-04-01T19:55:41.421 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T19:55:41.421 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T19:55:41.421 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T19:55:41.421 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:55:41.417008+0000", 2024-04-01T19:55:41.421 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8919e-05 2024-04-01T19:55:41.421 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:55:41.421 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T19:55:41.421 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:55:41.421 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T19:55:41.421 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T19:55:41.421 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 1 2024-04-01T19:55:41.422 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:55:41.448 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:55:41.477 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:41.498 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:55:41.501 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:41.502 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:55:41.571 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:41 smithi188 ceph-mon[43939]: 8.8 scrub ok 2024-04-01T19:55:41.572 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:41 smithi188 ceph-mon[43939]: pgmap v1838: 17 pgs: 17 active+clean; 8.4 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 103 B/s rd, 51 MiB/s wr, 996 op/s 2024-04-01T19:55:41.603 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:55:41.633 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:41.656 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:55:41.658 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:41.659 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:55:41.760 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:55:41.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:41 smithi062 ceph-mon[44211]: 8.8 scrub ok 2024-04-01T19:55:41.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:41 smithi062 ceph-mon[44211]: pgmap v1838: 17 pgs: 17 active+clean; 8.4 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 103 B/s rd, 51 MiB/s wr, 996 op/s 2024-04-01T19:55:41.789 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:41.809 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:55:41.815 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:41.815 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:55:41.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:41 smithi022 ceph-mon[39439]: 8.8 scrub ok 2024-04-01T19:55:41.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:41 smithi022 ceph-mon[39439]: pgmap v1838: 17 pgs: 17 active+clean; 8.4 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 103 B/s rd, 51 MiB/s wr, 996 op/s 2024-04-01T19:55:41.916 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:55:41.960 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:41.997 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:55:42.002 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:42.003 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:55:42.103 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:55:42.134 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:42.160 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:55:42.163 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:42.163 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:55:42.241 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_blocked_ops 2024-04-01T19:55:42.264 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:55:42.317 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:42.341 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:55:42.349 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:42.349 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:55:42.450 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:55:42.492 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:42.533 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:55:42.536 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:42.537 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:55:42.625 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:55:42.638 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:55:42.690 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:42.695 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:55:42.741 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:42 smithi022 ceph-mon[39439]: 8.7 scrub starts 2024-04-01T19:55:42.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:42 smithi188 ceph-mon[43939]: 8.7 scrub starts 2024-04-01T19:55:42.903 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:55:42.910 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:42.910 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:55:43.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:42 smithi062 ceph-mon[44211]: 8.7 scrub starts 2024-04-01T19:55:43.011 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:55:43.040 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:43.061 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:55:43.066 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:43.066 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:55:43.167 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:55:43.197 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:43.218 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:55:43.221 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:43.221 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:55:43.322 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:55:43.367 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:43.407 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:43.408 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:55:43.408 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:55:43.509 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:55:43.538 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:43.559 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:55:43.561 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:43.561 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:55:43.589 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:55:43.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:43 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1689097214' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:55:43.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:43 smithi188 ceph-mon[43939]: pgmap v1839: 17 pgs: 17 active+clean; 8.3 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 102 B/s rd, 44 MiB/s wr, 996 op/s 2024-04-01T19:55:43.662 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:55:43.691 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:43.711 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:55:43.714 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:43.714 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:55:43.815 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:55:43.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:43 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1689097214' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:55:43.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:43 smithi022 ceph-mon[39439]: pgmap v1839: 17 pgs: 17 active+clean; 8.3 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 102 B/s rd, 44 MiB/s wr, 996 op/s 2024-04-01T19:55:43.864 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:43.893 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:55:43.900 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:43.900 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:55:44.001 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:55:44.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:43 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1689097214' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:55:44.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:43 smithi062 ceph-mon[44211]: pgmap v1839: 17 pgs: 17 active+clean; 8.3 GiB data, 23 GiB used, 961 GiB / 983 GiB avail; 102 B/s rd, 44 MiB/s wr, 996 op/s 2024-04-01T19:55:44.037 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:44.787 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:55:44.790 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:44.791 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:55:44.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:44 smithi022 ceph-mon[39439]: 8.d scrub starts 2024-04-01T19:55:44.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:44 smithi022 ceph-mon[39439]: 8.7 scrub ok 2024-04-01T19:55:44.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:44 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:55:44.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:44 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T19:55:44.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:44 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1689097214' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:55:44.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:44 smithi022 ceph-mon[39439]: osdmap e674: 12 total, 12 up, 11 in 2024-04-01T19:55:44.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:44 smithi188 ceph-mon[43939]: 8.d scrub starts 2024-04-01T19:55:44.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:44 smithi188 ceph-mon[43939]: 8.7 scrub ok 2024-04-01T19:55:44.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:44 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:55:44.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:44 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T19:55:44.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:44 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1689097214' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:55:44.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:44 smithi188 ceph-mon[43939]: osdmap e674: 12 total, 12 up, 11 in 2024-04-01T19:55:44.891 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:55:44.922 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:45.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:44 smithi062 ceph-mon[44211]: 8.d scrub starts 2024-04-01T19:55:45.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:44 smithi062 ceph-mon[44211]: 8.7 scrub ok 2024-04-01T19:55:45.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:44 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:55:45.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:44 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T19:55:45.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:44 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1689097214' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:55:45.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:44 smithi062 ceph-mon[44211]: osdmap e674: 12 total, 12 up, 11 in 2024-04-01T19:55:45.374 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:55:45.378 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:45.378 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:55:45.390 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:55:45.479 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:55:45.510 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:45.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:45 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:55:45.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:45 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:55:45.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:45 smithi022 ceph-mon[39439]: pgmap v1841: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.2 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 115 B/s rd, 20 MiB/s wr, 905 op/s 2024-04-01T19:55:45.661 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:55:45.665 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:45.665 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:55:45.766 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:55:45.809 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:45.834 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:55:45.837 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:45.837 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:55:45.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:45 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:55:45.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:45 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:55:45.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:45 smithi188 ceph-mon[43939]: pgmap v1841: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.2 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 115 B/s rd, 20 MiB/s wr, 905 op/s 2024-04-01T19:55:45.938 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:55:45.998 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:46.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:45 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:55:46.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:45 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:55:46.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:45 smithi062 ceph-mon[44211]: pgmap v1841: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.2 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 115 B/s rd, 20 MiB/s wr, 905 op/s 2024-04-01T19:55:46.032 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:55:46.039 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:46.039 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:55:46.140 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:55:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:46.218 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:55:46.227 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:46.227 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:55:46.328 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:55:46.382 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:46.426 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:55:46.431 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:46.431 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:55:46.532 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:55:46.595 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:46.630 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:55:46.632 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:46 smithi188 ceph-mon[43939]: 8.d scrub ok 2024-04-01T19:55:46.632 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:46 smithi188 ceph-mon[43939]: osdmap e675: 12 total, 12 up, 11 in 2024-04-01T19:55:46.633 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:46.634 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:55:46.734 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:55:46.768 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:46.789 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:55:46.791 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:46.792 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:55:46.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:46 smithi022 ceph-mon[39439]: 8.d scrub ok 2024-04-01T19:55:46.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:46 smithi022 ceph-mon[39439]: osdmap e675: 12 total, 12 up, 11 in 2024-04-01T19:55:46.893 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:55:46.943 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:46.973 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:55:46.978 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:46.979 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:55:47.010 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:46 smithi062 ceph-mon[44211]: 8.d scrub ok 2024-04-01T19:55:47.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:46 smithi062 ceph-mon[44211]: osdmap e675: 12 total, 12 up, 11 in 2024-04-01T19:55:47.079 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:55:47.107 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:47.130 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:55:47.134 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:47.135 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:55:47.236 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:55:47.267 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:47.293 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:55:47.297 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:47.297 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:55:47.392 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:55:47.398 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:55:47.429 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:47.449 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:55:47.451 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:47.452 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:55:47.552 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:55:47.584 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:47.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:47 smithi062 ceph-mon[44211]: pgmap v1843: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.1 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 127 B/s rd, 13 MiB/s wr, 1.07k op/s 2024-04-01T19:55:47.848 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:47 smithi022 ceph-mon[39439]: pgmap v1843: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.1 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 127 B/s rd, 13 MiB/s wr, 1.07k op/s 2024-04-01T19:55:47.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:47 smithi188 ceph-mon[43939]: pgmap v1843: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.1 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 127 B/s rd, 13 MiB/s wr, 1.07k op/s 2024-04-01T19:55:48.085 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:55:48.089 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:48.089 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:55:48.190 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:55:48.209 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:55:48.209 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:55:48.209 INFO:teuthology.orchestra.run.smithi022.stdout: "complaint_time": 30, 2024-04-01T19:55:48.209 INFO:teuthology.orchestra.run.smithi022.stdout: "num_blocked_ops": 0 2024-04-01T19:55:48.209 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:55:48.234 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:48.270 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:55:48.273 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:48.273 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:55:48.374 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T19:55:48.407 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:55:48.422 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:48.431 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:55:48.453 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:55:48.460 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T19:55:48.464 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:48.464 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T19:55:48.480 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:55:48.504 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:55:48.525 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:55:48.548 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:55:48.565 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:55:48.577 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:55:48.611 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:48.619 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:48 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2028050603' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:55:48.619 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:48 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:48.619 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:48 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:48.621 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:55:48.667 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:55:48.694 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T19:55:48.728 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:55:48.730 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:55:48.730 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:55:48.730 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:55:48.730 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:55:48.730 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:55:48.730 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:55:48.730 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:55:48.730 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:55:48.730 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:55:48.731 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:55:48.731 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T19:55:48.731 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:55:48.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:48 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2028050603' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:55:48.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:48 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:48.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:48 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:49.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:48 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2028050603' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:55:49.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:48 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:49.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:48 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:49.721 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_historic_ops 2024-04-01T19:55:50.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:49 smithi062 ceph-mon[44211]: pgmap v1844: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.0 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 528 KiB/s wr, 815 op/s 2024-04-01T19:55:50.083 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.083 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.083 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.084 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.084 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.084 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.084 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.084 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.084 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.084 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.084 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:49 smithi022 ceph-mon[39439]: pgmap v1844: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.0 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 528 KiB/s wr, 815 op/s 2024-04-01T19:55:50.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:50.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:49 smithi188 ceph-mon[43939]: pgmap v1844: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.0 GiB data, 22 GiB used, 961 GiB / 983 GiB avail; 528 KiB/s wr, 815 op/s 2024-04-01T19:55:50.452 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:55:50.470 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:55:50.477 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:50.477 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:55:50.578 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:55:50.609 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:50.633 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:55:50.638 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:50.638 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:55:50.739 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:55:50.769 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:50.792 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:55:50.795 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:50.795 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:55:50.897 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:55:50.971 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:51.013 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:55:51.018 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:51.018 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:55:51.119 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:55:51.148 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:51.169 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:55:51.172 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:51.172 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:55:51.273 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:55:51.303 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:51.324 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:55:51.331 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:51.331 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:55:51.337 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:55:51.431 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:55:51.462 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:51.483 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:55:51.486 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:51.487 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:55:51.588 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:55:51.638 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:51.680 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:55:51.684 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:51.684 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:55:51.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:51 smithi062 ceph-mon[44211]: pgmap v1845: 17 pgs: 17 active+clean; 7.7 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 1.18k op/s 2024-04-01T19:55:51.785 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:55:51.815 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:51.835 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:55:51.838 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:51.838 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:55:51.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:51 smithi022 ceph-mon[39439]: pgmap v1845: 17 pgs: 17 active+clean; 7.7 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 1.18k op/s 2024-04-01T19:55:51.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:51 smithi188 ceph-mon[43939]: pgmap v1845: 17 pgs: 17 active+clean; 7.7 GiB data, 22 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 1.18k op/s 2024-04-01T19:55:51.939 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:55:51.970 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:51.992 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:55:51.995 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:51.995 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:55:52.096 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:55:52.129 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:52.149 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:55:52.152 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:52.153 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:55:52.254 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:55:52.327 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:52.365 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:55:52.373 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:52.373 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:55:52.445 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:55:52.474 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:55:52.532 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:52.578 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:55:52.579 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:52 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:55:52.579 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:52 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:55:52.579 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:52 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:55:52.579 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:52 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:55:52.579 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:52 smithi188 ceph-mon[43939]: osdmap e676: 12 total, 12 up, 11 in 2024-04-01T19:55:52.579 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:52.580 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:55:52.681 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:55:52.721 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:52.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:52 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:55:52.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:52 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:55:52.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:52 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:55:52.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:52 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:55:52.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:52 smithi062 ceph-mon[44211]: osdmap e676: 12 total, 12 up, 11 in 2024-04-01T19:55:52.807 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:52 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:55:52.807 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:52 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:55:52.807 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:52 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:55:52.807 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:52 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:55:52.807 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:52 smithi022 ceph-mon[39439]: osdmap e676: 12 total, 12 up, 11 in 2024-04-01T19:55:52.808 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:55:52.822 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:52.823 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:55:52.923 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:55:52.951 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:52.975 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:55:52.979 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:52.979 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:55:53.080 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:55:53.110 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:53.140 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:55:53.144 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:53.144 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:55:53.245 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:55:53.303 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:53.347 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:55:53.350 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:53.350 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:55:53.454 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:55:53.493 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:53.571 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:55:53.575 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:53.576 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:55:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:53 smithi188 ceph-mon[43939]: osdmap e677: 12 total, 12 up, 11 in 2024-04-01T19:55:53.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:53 smithi188 ceph-mon[43939]: pgmap v1848: 17 pgs: 17 active+clean; 7.7 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:55:53.676 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:55:53.711 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:53 smithi022 ceph-mon[39439]: osdmap e677: 12 total, 12 up, 11 in 2024-04-01T19:55:53.711 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:53 smithi022 ceph-mon[39439]: pgmap v1848: 17 pgs: 17 active+clean; 7.7 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:55:53.714 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:53.762 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:55:53.765 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:53.766 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:55:53.867 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:55:53.893 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:53 smithi062 ceph-mon[44211]: osdmap e677: 12 total, 12 up, 11 in 2024-04-01T19:55:53.894 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:53 smithi062 ceph-mon[44211]: pgmap v1848: 17 pgs: 17 active+clean; 7.7 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T19:55:53.896 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:53.921 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:55:53.928 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:53.928 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:55:54.029 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:55:54.057 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:54.081 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:55:54.084 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:54.085 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:55:54.185 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:55:54.217 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:54.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:54 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/186720296' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:55:54.533 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:55:54.570 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:55:54.574 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:54.574 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:55:54.584 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:55:54.675 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:55:54.704 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:54.732 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:55:54.734 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:54.735 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:55:54.757 INFO:tasks.thrashosds.thrasher:Recovered, killing an osd 2024-04-01T19:55:54.757 INFO:tasks.thrashosds.thrasher:Killing osd 10, live_osds are [0, 2, 3, 4, 5, 7, 9, 10, 11, 8, 6, 1] 2024-04-01T19:55:54.757 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-04-01T19:55:54.757 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.10 2024-04-01T19:55:54.804 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:54 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/186720296' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:55:54.823 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:55:54.824 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:55:54.835 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:55:54.866 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:55.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:54 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/186720296' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:55:55.071 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:55:55.074 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:55.074 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:55:55.124 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 19:55:54 smithi188 systemd[1]: Stopping Ceph osd.10 for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T19:55:55.175 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:55:55.227 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:55.522 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:55 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:55:55.522 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:55 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/186720296' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:55:55.522 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:55 smithi188 ceph-mon[43939]: osdmap e678: 12 total, 12 up, 11 in 2024-04-01T19:55:55.522 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:55 smithi188 ceph-mon[43939]: pgmap v1850: 17 pgs: 17 active+clean; 7.5 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 1.30k op/s 2024-04-01T19:55:55.712 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_ops_in_flight 2024-04-01T19:55:55.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:55 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:55:55.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:55 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/186720296' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:55:55.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:55 smithi022 ceph-mon[39439]: osdmap e678: 12 total, 12 up, 11 in 2024-04-01T19:55:55.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:55 smithi022 ceph-mon[39439]: pgmap v1850: 17 pgs: 17 active+clean; 7.5 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 1.30k op/s 2024-04-01T19:55:56.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:55 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:55:56.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:55 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/186720296' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:55:56.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:55 smithi062 ceph-mon[44211]: osdmap e678: 12 total, 12 up, 11 in 2024-04-01T19:55:56.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:55 smithi062 ceph-mon[44211]: pgmap v1850: 17 pgs: 17 active+clean; 7.5 GiB data, 21 GiB used, 962 GiB / 983 GiB avail; 0 B/s wr, 1.30k op/s 2024-04-01T19:55:56.297 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:55:56.305 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:56.305 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:55:56.406 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:55:56.441 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:56.596 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:55:56.599 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:56.599 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:55:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:56 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:55:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:56 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:55:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:56 smithi188 ceph-mon[43939]: osdmap e679: 12 total, 12 up, 11 in 2024-04-01T19:55:56.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:56 smithi188 ceph-mon[43939]: osd.10 marked itself down and dead 2024-04-01T19:55:56.625 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 19:55:56 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[63966]: 2024-04-01T19:55:56.444+0000 7f0219523700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T19:55:56.625 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 19:55:56 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[63966]: 2024-04-01T19:55:56.444+0000 7f0219523700 -1 osd.10 679 *** Got signal Terminated *** 2024-04-01T19:55:56.625 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 19:55:56 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[63966]: 2024-04-01T19:55:56.444+0000 7f0219523700 -1 osd.10 679 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T19:55:56.700 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:55:56.708 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:56 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:55:56.708 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:56 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:55:56.708 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:56 smithi022 ceph-mon[39439]: osdmap e679: 12 total, 12 up, 11 in 2024-04-01T19:55:56.708 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:56 smithi022 ceph-mon[39439]: osd.10 marked itself down and dead 2024-04-01T19:55:56.729 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:56.981 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:55:56.984 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:56.985 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:55:57.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:56 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:55:57.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:56 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:55:57.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:56 smithi062 ceph-mon[44211]: osdmap e679: 12 total, 12 up, 11 in 2024-04-01T19:55:57.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:56 smithi062 ceph-mon[44211]: osd.10 marked itself down and dead 2024-04-01T19:55:57.086 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:55:57.114 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:57.511 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:55:57.543 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:55:57.549 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:57.549 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:55:57.651 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:55:57.680 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:57.754 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:55:57.760 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:57.760 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:55:57.769 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:57 smithi022 ceph-mon[39439]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-01T19:55:57.770 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:57 smithi022 ceph-mon[39439]: osdmap e680: 12 total, 11 up, 11 in 2024-04-01T19:55:57.770 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:57 smithi022 ceph-mon[39439]: pgmap v1853: 17 pgs: 3 stale+active+clean, 14 active+clean; 7.4 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.11k op/s 2024-04-01T19:55:57.862 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:55:57.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:57 smithi188 ceph-mon[43939]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-01T19:55:57.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:57 smithi188 ceph-mon[43939]: osdmap e680: 12 total, 11 up, 11 in 2024-04-01T19:55:57.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:57 smithi188 ceph-mon[43939]: pgmap v1853: 17 pgs: 3 stale+active+clean, 14 active+clean; 7.4 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.11k op/s 2024-04-01T19:55:57.891 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:57.992 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:55:57.995 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:57.996 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:55:58.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:57 smithi062 ceph-mon[44211]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-01T19:55:58.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:57 smithi062 ceph-mon[44211]: osdmap e680: 12 total, 11 up, 11 in 2024-04-01T19:55:58.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:57 smithi062 ceph-mon[44211]: pgmap v1853: 17 pgs: 3 stale+active+clean, 14 active+clean; 7.4 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 1.11k op/s 2024-04-01T19:55:58.096 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:55:58.131 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:58.370 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:55:58.389 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:55:58.408 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:55:58.428 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:55:58.448 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:55:58.462 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:55:58.468 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:55:58.488 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:55:58.509 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:55:58.529 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:55:58.549 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:55:58.570 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:55:58.571 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:55:58.571 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:55:58.571 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:55:58.571 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:55:58.571 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:55:58.571 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:55:58.571 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:55:58.571 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:55:58.571 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:55:58.571 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:55:58.571 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.10 2024-04-01T19:55:58.571 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:55:58.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:58 smithi022 ceph-mon[39439]: osdmap e681: 12 total, 11 up, 11 in 2024-04-01T19:55:58.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:58 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3134562551' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:55:58.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:58.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:58 smithi188 ceph-mon[43939]: osdmap e681: 12 total, 11 up, 11 in 2024-04-01T19:55:58.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:58 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3134562551' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:55:58.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:58 smithi062 ceph-mon[44211]: osdmap e681: 12 total, 11 up, 11 in 2024-04-01T19:55:59.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:58 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3134562551' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:55:59.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.512 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:55:59.513 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:55:59.593 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:55:59.595 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:59.596 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:55:59.697 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:55:59.731 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:59.754 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:55:59.757 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:59.757 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:55:59.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.843 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.843 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.843 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.843 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.843 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.843 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.843 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:55:59 smithi022 ceph-mon[39439]: pgmap v1855: 17 pgs: 3 stale+active+clean, 14 active+clean; 7.4 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 744 op/s 2024-04-01T19:55:59.858 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:55:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:55:59 smithi188 ceph-mon[43939]: pgmap v1855: 17 pgs: 3 stale+active+clean, 14 active+clean; 7.4 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 744 op/s 2024-04-01T19:55:59.888 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.888 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.888 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.888 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.888 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.888 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.888 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.888 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.888 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.888 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:55:59.889 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:55:59 smithi062 ceph-mon[44211]: pgmap v1855: 17 pgs: 3 stale+active+clean, 14 active+clean; 7.4 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 744 op/s 2024-04-01T19:55:59.890 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:55:59.911 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:55:59.913 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:55:59.914 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:55:59.914 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:56:00.015 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:56:00.046 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:00.146 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:56:00.150 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:00.150 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:56:00.251 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:56:00.283 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:00.734 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:56:00.769 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:56:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:56:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 0 2024-04-01T19:56:00.769 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:56:00.798 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:00.798 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:56:00.899 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:56:00.930 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:01.080 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:56:01.082 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:01.083 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:56:01.184 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:56:01.212 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:01.337 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:56:01.340 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:01.340 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:56:01.441 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:56:01.470 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:01.514 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:56:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:01 smithi062 ceph-mon[44211]: pgmap v1856: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 621 op/s; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:01.803 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:01 smithi022 ceph-mon[39439]: pgmap v1856: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 621 op/s; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:01.820 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:56:01.824 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:01.825 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:56:01.835 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_blocked_ops 2024-04-01T19:56:01.871 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:56:01.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:01 smithi188 ceph-mon[43939]: pgmap v1856: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 621 op/s; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:01.926 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:56:01.959 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:01.981 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:56:01.984 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:01.985 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:56:02.086 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:56:02.118 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:02.684 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:02 smithi022 ceph-mon[39439]: Health check failed: Degraded data redundancy: 37362/239050 objects degraded (15.629%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:56:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:02 smithi062 ceph-mon[44211]: Health check failed: Degraded data redundancy: 37362/239050 objects degraded (15.629%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:56:02.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:02 smithi188 ceph-mon[43939]: Health check failed: Degraded data redundancy: 37362/239050 objects degraded (15.629%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:56:03.374 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 19:56:02 smithi188 bash[165250]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10 2024-04-01T19:56:03.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:03 smithi062 ceph-mon[44211]: pgmap v1857: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 434 op/s; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:03.779 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:03 smithi022 ceph-mon[39439]: pgmap v1857: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 434 op/s; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:03.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:03 smithi188 ceph-mon[43939]: pgmap v1857: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 434 op/s; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:04.213 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:56:04.236 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:56:04.237 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:56:04.257 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:56:04.284 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:56:04.304 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:56:04.324 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:56:04.344 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:56:04.364 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:56:04.384 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:56:04.405 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:56:04.425 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:56:04.426 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:56:04.426 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:56:04.426 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:56:04.426 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:56:04.426 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:56:04.426 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:56:04.426 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:56:04.426 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:56:04.426 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:56:04.426 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:56:04.427 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.10 2024-04-01T19:56:04.427 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:56:04.489 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:56:04.543 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:56:04.547 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:04.548 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:56:04.649 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:56:04.682 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:04.704 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:56:04.707 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:04.707 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:56:04.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:04 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:56:04.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:04 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:56:04.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:04 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4125142387' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:56:04.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:04 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3478308158' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:56:04.809 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:56:04.840 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:04.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:04 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:56:04.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:04 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:56:04.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:04 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4125142387' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:56:04.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:04 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3478308158' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:56:04.862 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:56:04.864 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:04.865 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:56:04.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:04 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:56:04.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:04 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:56:04.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:04 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4125142387' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:56:04.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:04 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3478308158' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:56:04.966 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:56:04.997 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:05.749 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:56:05.750 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.750 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.750 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:05 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:56:05.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:05 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3478308158' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:56:05.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:05 smithi022 ceph-mon[39439]: osdmap e682: 12 total, 11 up, 11 in 2024-04-01T19:56:05.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:05 smithi022 ceph-mon[39439]: pgmap v1859: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 259 op/s; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:05.752 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:05.752 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:56:05.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:05 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:56:05.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:05 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3478308158' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:56:05.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:05 smithi062 ceph-mon[44211]: osdmap e682: 12 total, 11 up, 11 in 2024-04-01T19:56:05.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:05 smithi062 ceph-mon[44211]: pgmap v1859: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 259 op/s; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:05.853 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:56:05.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:05 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:56:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:05 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3478308158' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:56:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:05 smithi188 ceph-mon[43939]: osdmap e682: 12 total, 11 up, 11 in 2024-04-01T19:56:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:05 smithi188 ceph-mon[43939]: pgmap v1859: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 259 op/s; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:05.885 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:05.959 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:56:05.963 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:05.963 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:56:06.064 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:56:06.098 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:06.120 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:56:06.123 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:06.123 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:56:06.224 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:56:06.252 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.10.service' 2024-04-01T19:56:06.253 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:06.271 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:56:06.274 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:06.274 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:56:06.309 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T19:56:06.309 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-04-01T19:56:06.309 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd down 10 2024-04-01T19:56:06.376 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:56:06.409 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:06.432 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:56:06.435 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:06.438 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:56:06.539 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:56:06.566 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:06.584 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:56:06.587 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:06.587 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:56:06.688 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:56:06.722 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:06.744 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:56:06.746 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:06.747 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:56:06.848 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:56:06.882 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:06.903 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:56:06.906 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:06.907 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:56:06.914 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:56:06.914 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:56:07.007 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:56:07.034 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:07.053 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:56:07.055 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:07.056 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:56:07.157 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:56:07.190 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:07.211 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:56:07.214 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:07.215 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:56:07.315 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:56:07.344 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:07.697 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:56:07.700 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:07.701 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:56:07.708 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:56:07.802 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:56:07.836 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:07.857 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:56:07.859 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:07.860 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:56:07.961 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:56:07.993 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:08.014 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:56:08.016 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:08.017 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:56:08.117 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:56:08.147 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:08.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:08 smithi062 ceph-mon[44211]: pgmap v1860: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 211 op/s; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:08.823 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:08 smithi022 ceph-mon[39439]: pgmap v1860: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 211 op/s; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:08.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:08 smithi188 ceph-mon[43939]: pgmap v1860: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 211 op/s; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:08.916 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:56:08.936 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:56:08.936 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:56:09.201 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:56:09.205 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:09.206 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:56:09.307 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:56:09.336 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:09.702 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:56:10.187 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:56:10.190 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:10.190 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:56:10.212 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_historic_ops 2024-04-01T19:56:10.291 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:56:10.324 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:10.345 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:56:10.347 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:10.348 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:56:10.432 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:10 smithi022 ceph-mon[39439]: pgmap v1861: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 182 op/s; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:10.442 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:56:10.449 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:56:10.482 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:10.504 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:56:10.506 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:10.507 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:56:10.608 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:56:10.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:10 smithi188 ceph-mon[43939]: pgmap v1861: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 182 op/s; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:10.639 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:10.694 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:56:10.700 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:10.701 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:56:10.721 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:56:10.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:10 smithi062 ceph-mon[44211]: pgmap v1861: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 0 B/s wr, 182 op/s; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:10.801 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:56:10.830 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:10.935 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10 is already down. 2024-04-01T19:56:10.955 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:10 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[39416]: 2024-04-01T19:56:10.933+0000 7fd025a9f700 -1 mon.a@0(leader).osd e683 definitely_dead 0 2024-04-01T19:56:10.980 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:56:10.983 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:10.983 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:56:11.084 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:56:11.117 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:11.139 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:56:11.141 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:11.142 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:56:11.243 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:56:11.273 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:11.581 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:56:11.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:11 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:56:11.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:11 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:56:11.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:11 smithi022 ceph-mon[39439]: osdmap e683: 12 total, 11 up, 11 in 2024-04-01T19:56:11.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:11 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/953401610' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["10"]}]: dispatch 2024-04-01T19:56:11.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:11 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:56:11.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:11 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:56:11.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:11 smithi062 ceph-mon[44211]: osdmap e683: 12 total, 11 up, 11 in 2024-04-01T19:56:11.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:11 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/953401610' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["10"]}]: dispatch 2024-04-01T19:56:11.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:11 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:56:11.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:11 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:56:11.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:11 smithi188 ceph-mon[43939]: osdmap e683: 12 total, 11 up, 11 in 2024-04-01T19:56:11.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:11 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/953401610' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["10"]}]: dispatch 2024-04-01T19:56:12.602 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:56:12.604 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:12 smithi022 ceph-mon[39439]: pgmap v1863: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:12.604 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:12 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:56:12.604 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:12 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:56:12.605 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:12.606 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:56:12.706 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:56:12.737 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:12 smithi062 ceph-mon[44211]: pgmap v1863: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:12.737 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:12 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:56:12.737 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:12 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:56:12.739 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:12.761 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:56:12.764 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:12.765 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:56:12.866 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:56:12.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:12 smithi188 ceph-mon[43939]: pgmap v1863: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:12.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:12 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:56:12.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:12 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:56:12.896 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:12.917 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:56:12.920 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:12.920 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:56:13.021 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:56:13.054 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:13.075 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:56:13.078 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:13.078 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:56:13.179 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:56:13.214 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:13.405 INFO:tasks.thrashosds.thrasher:Removing osd 10, in_osds are: [0, 2, 3, 4, 5, 7, 9, 10, 11, 8, 6] 2024-04-01T19:56:13.405 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd out 10 2024-04-01T19:56:13.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:13 smithi062 ceph-mon[44211]: osdmap e684: 12 total, 11 up, 11 in 2024-04-01T19:56:13.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:13 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:56:13.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:13 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:56:13.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:13 smithi062 ceph-mon[44211]: pgmap v1865: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:13.801 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:13 smithi022 ceph-mon[39439]: osdmap e684: 12 total, 11 up, 11 in 2024-04-01T19:56:13.801 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:13 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:56:13.801 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:13 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:56:13.801 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:13 smithi022 ceph-mon[39439]: pgmap v1865: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:13.866 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:56:13.869 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:13.870 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:56:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:13 smithi188 ceph-mon[43939]: osdmap e684: 12 total, 11 up, 11 in 2024-04-01T19:56:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:13 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:56:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:13 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:56:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:13 smithi188 ceph-mon[43939]: pgmap v1865: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:13.971 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:56:13.999 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:14.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:14 smithi062 ceph-mon[44211]: osdmap e685: 12 total, 11 up, 11 in 2024-04-01T19:56:15.459 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:14 smithi188 ceph-mon[43939]: osdmap e685: 12 total, 11 up, 11 in 2024-04-01T19:56:15.459 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:14 smithi022 ceph-mon[39439]: osdmap e685: 12 total, 11 up, 11 in 2024-04-01T19:56:15.459 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:56:15.651 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:56:15.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:15 smithi022 ceph-mon[39439]: pgmap v1867: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:15.657 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:15.658 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:56:15.758 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:56:15.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:15 smithi062 ceph-mon[44211]: pgmap v1867: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:15.795 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:15.817 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:56:15.818 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:15.819 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:56:15.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:15 smithi188 ceph-mon[43939]: pgmap v1867: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:15.920 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:56:15.952 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:16.304 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:56:16.308 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:16.308 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:56:16.398 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:56:16.398 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:56:16.410 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:56:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:16.464 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:56:16.467 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:16.468 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:56:16.568 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:56:16.597 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:16.617 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:56:16.620 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:16.621 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:56:16.654 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:56:16.721 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:56:16.752 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:16 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1450513644' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:56:16.755 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:16.777 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:56:16.779 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:16.780 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:56:16.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:16 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1450513644' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:56:16.880 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:56:16.912 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:16.933 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:56:16.936 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:16.936 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:56:17.037 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:56:17.068 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:17.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:16 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1450513644' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:56:17.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:17 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:56:17.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:17 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1450513644' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:56:17.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:17 smithi022 ceph-mon[39439]: osdmap e686: 12 total, 11 up, 11 in 2024-04-01T19:56:17.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:17 smithi022 ceph-mon[39439]: pgmap v1869: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:18.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:17 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:56:18.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:17 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1450513644' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:56:18.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:17 smithi062 ceph-mon[44211]: osdmap e686: 12 total, 11 up, 11 in 2024-04-01T19:56:18.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:17 smithi062 ceph-mon[44211]: pgmap v1869: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:18.019 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:56:18.023 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:18.023 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:56:18.033 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_ops_in_flight 2024-04-01T19:56:18.124 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:56:18.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:17 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:56:18.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:17 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1450513644' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:56:18.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:17 smithi188 ceph-mon[43939]: osdmap e686: 12 total, 11 up, 11 in 2024-04-01T19:56:18.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:17 smithi188 ceph-mon[43939]: pgmap v1869: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:18.153 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:18.179 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:56:18.182 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:18.182 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:56:18.283 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:56:18.316 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:18.327 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:56:18.337 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:56:18.340 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:18.340 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:56:18.441 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:56:18.472 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:18.492 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:56:18.495 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:18.495 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:56:18.596 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:56:18.625 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:18.807 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:18 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4172539095' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:56:18.878 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:56:18.881 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:18.882 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:56:18.961 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:18 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4172539095' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:56:18.982 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:56:18.989 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:56:18.989 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:56:18.990 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:56:18.990 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:56:18.990 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:56:18.990 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:56:18.990 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:56:18.990 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:56:18.990 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:56:18.990 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:56:18.990 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:56:18.990 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:56:18.990 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:56:18.991 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:56:18.991 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:56:18.991 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:56:18.991 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:56:18.991 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:56:18.991 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:56:18.991 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:56:18.991 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:56:18.991 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.10 2024-04-01T19:56:18.991 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:56:19.014 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:19.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:18 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4172539095' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:56:19.263 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:56:19.266 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:19.266 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:56:19.368 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:56:19.398 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:19.436 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:56:19.440 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:19.440 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:56:19.541 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:56:19.564 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:56:19.564 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:56:19.571 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:19.772 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:56:19.775 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:19.775 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:56:19.792 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:19.792 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:19.792 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:19.792 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:19.792 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:19.792 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:19.793 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:19.793 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:19.793 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:19 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:19.793 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:19 smithi022 ceph-mon[39439]: pgmap v1870: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:19.876 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:56:19.907 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:19.981 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:56:19.984 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:19.985 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:56:20.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:20.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:20.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:20.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:20.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:20.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:20.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:20.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:20.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:19 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:20.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:19 smithi062 ceph-mon[44211]: pgmap v1870: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:20.085 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:56:20.114 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:20.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:20.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:20.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:20.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:20.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:20.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:20.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:20.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:20.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:19 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:20.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:19 smithi188 ceph-mon[43939]: pgmap v1870: 17 pgs: 5 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 21 GiB used, 963 GiB / 983 GiB avail; 37362/239050 objects degraded (15.629%) 2024-04-01T19:56:20.137 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:56:20.140 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:20.141 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:56:20.241 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:56:20.273 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:20.295 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:56:20.298 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:20.298 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:56:20.399 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:56:20.425 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:20 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[39416]: 2024-04-01T19:56:20.327+0000 7fd025a9f700 -1 mon.a@0(leader).osd e686 definitely_dead 0 2024-04-01T19:56:20.427 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:20.447 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:56:20.450 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:20.450 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:56:20.478 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:56:20.478 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:56:20.478 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 0 2024-04-01T19:56:20.478 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:56:20.551 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:56:20.579 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:20.598 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:56:20.601 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:20.601 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:56:20.676 INFO:teuthology.orchestra.run.smithi022.stderr:marked out osd.10. 2024-04-01T19:56:20.694 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:20.694 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:20.694 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:20 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:56:20.694 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:20 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:56:20.694 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:20 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/333821434' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["10"]}]: dispatch 2024-04-01T19:56:20.694 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:20 smithi022 ceph-mon[39439]: from='client.37190 ' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["10"]}]: dispatch 2024-04-01T19:56:20.694 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:20 smithi022 ceph-mon[39439]: Client client.admin marked osd.10 out, after it was down for 23 seconds 2024-04-01T19:56:20.702 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:56:20.731 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:20.751 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:56:20.753 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:20.754 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:56:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:20 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:56:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:20 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:56:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:20 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/333821434' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["10"]}]: dispatch 2024-04-01T19:56:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:20 smithi062 ceph-mon[44211]: from='client.37190 ' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["10"]}]: dispatch 2024-04-01T19:56:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:20 smithi062 ceph-mon[44211]: Client client.admin marked osd.10 out, after it was down for 23 seconds 2024-04-01T19:56:20.855 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:56:20.885 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:20.906 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:56:21.079 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_blocked_ops 2024-04-01T19:56:21.095 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:56:21.098 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:21.099 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:56:21.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:21.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:21.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:20 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:56:21.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:20 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:56:21.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:20 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/333821434' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["10"]}]: dispatch 2024-04-01T19:56:21.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:20 smithi188 ceph-mon[43939]: from='client.37190 ' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["10"]}]: dispatch 2024-04-01T19:56:21.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:20 smithi188 ceph-mon[43939]: Client client.admin marked osd.10 out, after it was down for 23 seconds 2024-04-01T19:56:21.200 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:56:21.228 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:21.365 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:56:21.565 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:56:21.575 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.10 2024-04-01T19:56:21.576 INFO:tasks.thrashosds.thrasher:remote for osd 10 is ubuntu@smithi188.front.sepia.ceph.com 2024-04-01T19:56:21.576 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -n osd.10 --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-10 --journal-path /var/lib/ceph/osd/ceph-10/journal --op list-pgs 2024-04-01T19:56:21.586 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:56:21.589 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:21.589 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:56:21.627 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:56:21.689 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:56:21.744 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:21.764 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:56:21.767 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:21.767 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:56:21.851 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/osd.10/config 2024-04-01T19:56:21.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:21 smithi022 ceph-mon[39439]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-01T19:56:21.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:21 smithi022 ceph-mon[39439]: from='client.37190 ' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["10"]}]': finished 2024-04-01T19:56:21.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:21 smithi022 ceph-mon[39439]: osdmap e687: 12 total, 11 up, 10 in 2024-04-01T19:56:21.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:21 smithi022 ceph-mon[39439]: pgmap v1872: 17 pgs: 1 peering, 4 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 18 GiB used, 876 GiB / 894 GiB avail; 29810/239050 objects degraded (12.470%) 2024-04-01T19:56:21.868 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:56:21.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:21 smithi188 ceph-mon[43939]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-01T19:56:21.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:21 smithi188 ceph-mon[43939]: from='client.37190 ' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["10"]}]': finished 2024-04-01T19:56:21.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:21 smithi188 ceph-mon[43939]: osdmap e687: 12 total, 11 up, 10 in 2024-04-01T19:56:21.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:21 smithi188 ceph-mon[43939]: pgmap v1872: 17 pgs: 1 peering, 4 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 18 GiB used, 876 GiB / 894 GiB avail; 29810/239050 objects degraded (12.470%) 2024-04-01T19:56:21.897 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:21 smithi062 ceph-mon[44211]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-01T19:56:21.897 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:21 smithi062 ceph-mon[44211]: from='client.37190 ' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["10"]}]': finished 2024-04-01T19:56:21.897 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:21 smithi062 ceph-mon[44211]: osdmap e687: 12 total, 11 up, 10 in 2024-04-01T19:56:21.898 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:21 smithi062 ceph-mon[44211]: pgmap v1872: 17 pgs: 1 peering, 4 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 18 GiB used, 876 GiB / 894 GiB avail; 29810/239050 objects degraded (12.470%) 2024-04-01T19:56:21.901 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:22.752 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:56:22.756 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:22.756 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:56:22.857 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:56:22.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:22 smithi188 ceph-mon[43939]: 8.a scrub starts 2024-04-01T19:56:22.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:22 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 29810/239050 objects degraded (12.470%), 4 pgs degraded (PG_DEGRADED) 2024-04-01T19:56:22.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:22 smithi188 ceph-mon[43939]: osdmap e688: 12 total, 11 up, 10 in 2024-04-01T19:56:22.895 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:22.926 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:22 smithi062 ceph-mon[44211]: 8.a scrub starts 2024-04-01T19:56:22.926 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:22 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 29810/239050 objects degraded (12.470%), 4 pgs degraded (PG_DEGRADED) 2024-04-01T19:56:22.926 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:22 smithi062 ceph-mon[44211]: osdmap e688: 12 total, 11 up, 10 in 2024-04-01T19:56:22.938 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:56:22.944 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:22.945 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:56:22.945 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:22 smithi022 ceph-mon[39439]: 8.a scrub starts 2024-04-01T19:56:22.945 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:22 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 29810/239050 objects degraded (12.470%), 4 pgs degraded (PG_DEGRADED) 2024-04-01T19:56:22.945 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:22 smithi022 ceph-mon[39439]: osdmap e688: 12 total, 11 up, 10 in 2024-04-01T19:56:23.045 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:56:23.079 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:23.398 INFO:teuthology.orchestra.run.smithi188.stderr:Creating an OSD daemon form without an OSD FSID value 2024-04-01T19:56:23.524 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:56:23.539 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:56:23.549 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:23.549 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:56:23.650 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:56:23.688 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:23.771 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:56:23.774 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:23 smithi022 ceph-mon[39439]: 8.a scrub ok 2024-04-01T19:56:23.774 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:23 smithi022 ceph-mon[39439]: pgmap v1874: 17 pgs: 1 peering, 4 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 18 GiB used, 876 GiB / 894 GiB avail; 0 B/s wr, 5 op/s; 29810/238978 objects degraded (12.474%) 2024-04-01T19:56:23.775 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:23.775 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:56:23.876 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:56:23.913 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:23.944 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:56:23.944 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:56:23.944 INFO:teuthology.orchestra.run.smithi062.stdout: "complaint_time": 30, 2024-04-01T19:56:23.944 INFO:teuthology.orchestra.run.smithi062.stdout: "num_blocked_ops": 0 2024-04-01T19:56:23.944 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:56:23.972 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:23 smithi062 ceph-mon[44211]: 8.a scrub ok 2024-04-01T19:56:23.972 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:23 smithi062 ceph-mon[44211]: pgmap v1874: 17 pgs: 1 peering, 4 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 18 GiB used, 876 GiB / 894 GiB avail; 0 B/s wr, 5 op/s; 29810/238978 objects degraded (12.474%) 2024-04-01T19:56:24.034 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:56:24.040 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:23 smithi188 ceph-mon[43939]: 8.a scrub ok 2024-04-01T19:56:24.041 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:23 smithi188 ceph-mon[43939]: pgmap v1874: 17 pgs: 1 peering, 4 undersized+degraded+peered, 12 active+clean; 7.3 GiB data, 18 GiB used, 876 GiB / 894 GiB avail; 0 B/s wr, 5 op/s; 29810/238978 objects degraded (12.474%) 2024-04-01T19:56:24.041 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:24.041 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:56:24.142 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:56:24.183 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:24.215 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:56:24.218 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:24.218 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:56:24.319 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:56:24.394 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:24.426 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:56:24.431 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:24.431 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:56:24.532 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:56:24.577 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:24.655 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:56:24.660 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:24.660 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:56:24.687 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_historic_ops 2024-04-01T19:56:24.761 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:56:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:24.860 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:56:24.866 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:24.867 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:56:24.968 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:56:25.016 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:25.047 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:56:25.051 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:25.051 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:56:25.149 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:56:25.152 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:56:25.184 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:25.223 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:56:25.227 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:25.227 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:56:25.328 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:56:25.380 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:25.440 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:56:25.443 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:25.444 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:56:25.545 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:56:25.580 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:26.440 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:56:26.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:26 smithi062 ceph-mon[44211]: pgmap v1875: 17 pgs: 2 active+recovering+degraded, 1 peering, 2 undersized+degraded+peered, 12 active+clean; 7.2 GiB data, 18 GiB used, 876 GiB / 894 GiB avail; 0 B/s wr, 100 op/s; 29576/237442 objects degraded (12.456%); 1.8 MiB/s, 29 objects/s recovering 2024-04-01T19:56:26.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:26 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2538789814' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:56:26.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:26 smithi022 ceph-mon[39439]: pgmap v1875: 17 pgs: 2 active+recovering+degraded, 1 peering, 2 undersized+degraded+peered, 12 active+clean; 7.2 GiB data, 18 GiB used, 876 GiB / 894 GiB avail; 0 B/s wr, 100 op/s; 29576/237442 objects degraded (12.456%); 1.8 MiB/s, 29 objects/s recovering 2024-04-01T19:56:26.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:26 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2538789814' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:56:26.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:26 smithi188 ceph-mon[43939]: pgmap v1875: 17 pgs: 2 active+recovering+degraded, 1 peering, 2 undersized+degraded+peered, 12 active+clean; 7.2 GiB data, 18 GiB used, 876 GiB / 894 GiB avail; 0 B/s wr, 100 op/s; 29576/237442 objects degraded (12.456%); 1.8 MiB/s, 29 objects/s recovering 2024-04-01T19:56:26.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:26 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2538789814' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:56:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:27 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:56:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:27 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2538789814' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:56:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:27 smithi062 ceph-mon[44211]: osdmap e689: 12 total, 11 up, 10 in 2024-04-01T19:56:27.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:27 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:56:27.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:27 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2538789814' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:56:27.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:27 smithi022 ceph-mon[39439]: osdmap e689: 12 total, 11 up, 10 in 2024-04-01T19:56:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:27 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:56:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:27 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2538789814' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:56:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:27 smithi188 ceph-mon[43939]: osdmap e689: 12 total, 11 up, 10 in 2024-04-01T19:56:28.046 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:56:28.051 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:28.051 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:56:28.152 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:56:28.189 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:28.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:28 smithi022 ceph-mon[39439]: pgmap v1877: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 7.2 GiB data, 18 GiB used, 876 GiB / 894 GiB avail; 0 B/s wr, 275 op/s; 36718/235364 objects degraded (15.601%); 6.0 MiB/s, 97 objects/s recovering 2024-04-01T19:56:28.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:28 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 36718/235364 objects degraded (15.601%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:56:28.627 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:56:28.653 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:56:28.678 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:56:28.712 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:56:28.743 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:56:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:28 smithi062 ceph-mon[44211]: pgmap v1877: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 7.2 GiB data, 18 GiB used, 876 GiB / 894 GiB avail; 0 B/s wr, 275 op/s; 36718/235364 objects degraded (15.601%); 6.0 MiB/s, 97 objects/s recovering 2024-04-01T19:56:28.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:28 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 36718/235364 objects degraded (15.601%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:56:28.767 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:56:28.789 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:56:28.818 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:56:28.845 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:56:28.867 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:56:28.885 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:28 smithi188 ceph-mon[43939]: pgmap v1877: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 7.2 GiB data, 18 GiB used, 876 GiB / 894 GiB avail; 0 B/s wr, 275 op/s; 36718/235364 objects degraded (15.601%); 6.0 MiB/s, 97 objects/s recovering 2024-04-01T19:56:28.885 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:28 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 36718/235364 objects degraded (15.601%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:56:28.903 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:56:28.903 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:56:28.903 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:56:28.904 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:56:28.904 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:56:28.904 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:56:28.904 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:56:28.904 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:56:28.904 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:56:28.904 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:56:28.904 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:56:28.904 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.10 2024-04-01T19:56:28.904 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:56:29.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:29 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2557722569' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:56:29.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:29.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:29.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:29.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:29.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:29.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:29 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:29.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:29 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2557722569' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:56:29.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:29.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:29.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:29.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:29.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:29.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:29 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:29.708 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:56:29.709 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:56:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:29 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2557722569' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:56:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:29.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:29 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:29.993 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:56:30.102 INFO:teuthology.orchestra.run.smithi188.stdout:8.9 2024-04-01T19:56:30.103 INFO:teuthology.orchestra.run.smithi188.stdout:8.7 2024-04-01T19:56:30.103 INFO:teuthology.orchestra.run.smithi188.stdout:8.6 2024-04-01T19:56:30.103 INFO:teuthology.orchestra.run.smithi188.stdout:8.2 2024-04-01T19:56:30.103 INFO:teuthology.orchestra.run.smithi188.stdout:8.5 2024-04-01T19:56:30.360 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:56:30.688 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:30.688 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:30.688 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:30.688 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:30.688 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:30.688 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:30 smithi188 ceph-mon[43939]: pgmap v1878: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 7.2 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 251 op/s; 36718/235018 objects degraded (15.623%); 5.0 MiB/s, 81 objects/s recovering 2024-04-01T19:56:30.693 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:30.693 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:30.693 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:30.693 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:30.693 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:30.693 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:30 smithi022 ceph-mon[39439]: pgmap v1878: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 7.2 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 251 op/s; 36718/235018 objects degraded (15.623%); 5.0 MiB/s, 81 objects/s recovering 2024-04-01T19:56:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:30 smithi062 ceph-mon[44211]: pgmap v1878: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 7.2 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 251 op/s; 36718/235018 objects degraded (15.623%); 5.0 MiB/s, 81 objects/s recovering 2024-04-01T19:56:31.710 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:56:31.750 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:31 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:56:31.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:31 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:56:31.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:31 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:56:32.028 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -n osd.10 --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-10 --journal-path /var/lib/ceph/osd/ceph-10/journal --op export --pgid 8.9 --file /var/log/ceph/exp.8.9.10 2024-04-01T19:56:32.339 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/osd.10/config 2024-04-01T19:56:32.346 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:56:32.350 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:32.351 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:56:32.452 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:56:32.485 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:32.687 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:32 smithi188 ceph-mon[43939]: pgmap v1879: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 7.0 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 486 op/s; 35795/229618 objects degraded (15.589%); 10 MiB/s, 162 objects/s recovering 2024-04-01T19:56:32.687 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:56:32.687 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:56:32.687 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:56:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:32 smithi062 ceph-mon[44211]: pgmap v1879: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 7.0 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 486 op/s; 35795/229618 objects degraded (15.589%); 10 MiB/s, 162 objects/s recovering 2024-04-01T19:56:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:56:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:56:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:56:32.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:32 smithi022 ceph-mon[39439]: pgmap v1879: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 7.0 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 486 op/s; 35795/229618 objects degraded (15.589%); 10 MiB/s, 162 objects/s recovering 2024-04-01T19:56:32.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:56:32.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:56:32.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:56:33.619 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:56:33.619 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:56:33.624 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:33.624 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:56:33.725 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:56:33.747 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:56:33.747 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:56:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:33 smithi062 ceph-mon[44211]: pgmap v1880: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 7.0 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 484 op/s; 35795/229288 objects degraded (15.611%); 9.8 MiB/s, 157 objects/s recovering 2024-04-01T19:56:33.762 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:33 smithi188 ceph-mon[43939]: pgmap v1880: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 7.0 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 484 op/s; 35795/229288 objects degraded (15.611%); 9.8 MiB/s, 157 objects/s recovering 2024-04-01T19:56:33.764 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:33.829 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:56:33.831 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:33.832 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:56:33.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:33 smithi022 ceph-mon[39439]: pgmap v1880: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 7.0 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 484 op/s; 35795/229288 objects degraded (15.611%); 9.8 MiB/s, 157 objects/s recovering 2024-04-01T19:56:33.904 INFO:teuthology.orchestra.run.smithi188.stderr:Creating an OSD daemon form without an OSD FSID value 2024-04-01T19:56:33.932 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:56:33.971 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:34.526 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:56:34.530 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:34.531 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:56:34.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:34 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 35795/229288 objects degraded (15.611%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:56:34.631 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:56:34.676 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:34.726 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:56:34.728 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:34 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 35795/229288 objects degraded (15.611%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:56:34.729 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:34.729 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:56:34.772 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_ops_in_flight 2024-04-01T19:56:34.776 INFO:teuthology.orchestra.run.smithi188.stderr:Exporting 8.9 info 8.9( v 679'10018 (0'0,679'10018] local-lis/les=644/645 n=7600 ec=629/629 lis/c=644/644 les/c/f=645/645/0 sis=644) 2024-04-01T19:56:34.830 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:56:34.836 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:34 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 35795/229288 objects degraded (15.611%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:56:34.861 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:900014b2:::benchmark_data_smithi188_161190_object134254:head# 2024-04-01T19:56:34.861 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90008878:::benchmark_data_smithi188_161190_object35224:head# 2024-04-01T19:56:34.862 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9001f9da:::benchmark_data_smithi188_161190_object62468:head# 2024-04-01T19:56:34.862 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9002055d:::benchmark_data_smithi188_161190_object26804:head# 2024-04-01T19:56:34.863 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:900267f5:::benchmark_data_smithi188_161190_object115861:head# 2024-04-01T19:56:34.863 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9002a36e:::benchmark_data_smithi188_161190_object102118:head# 2024-04-01T19:56:34.864 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9002d7d4:::benchmark_data_smithi188_161190_object112859:head# 2024-04-01T19:56:34.864 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90046d80:::benchmark_data_smithi188_161190_object137075:head# 2024-04-01T19:56:34.864 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:900507d4:::benchmark_data_smithi188_161190_object43115:head# 2024-04-01T19:56:34.865 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90050cef:::benchmark_data_smithi188_161190_object104303:head# 2024-04-01T19:56:34.865 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9005de87:::benchmark_data_smithi188_161190_object29700:head# 2024-04-01T19:56:34.866 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9005fb39:::benchmark_data_smithi188_161190_object42484:head# 2024-04-01T19:56:34.866 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90074d72:::benchmark_data_smithi188_161190_object73323:head# 2024-04-01T19:56:34.867 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:900771a9:::benchmark_data_smithi188_161190_object82703:head# 2024-04-01T19:56:34.867 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90081390:::benchmark_data_smithi188_161190_object64116:head# 2024-04-01T19:56:34.868 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90082e43:::benchmark_data_smithi188_161190_object39304:head# 2024-04-01T19:56:34.868 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:900871f2:::benchmark_data_smithi188_161190_object31261:head# 2024-04-01T19:56:34.868 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9008d7f4:::benchmark_data_smithi188_161190_object62480:head# 2024-04-01T19:56:34.869 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9009b45f:::benchmark_data_smithi188_161190_object72348:head# 2024-04-01T19:56:34.869 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:900a56a2:::benchmark_data_smithi188_161190_object21600:head# 2024-04-01T19:56:34.870 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:900b1056:::benchmark_data_smithi188_161190_object115737:head# 2024-04-01T19:56:34.870 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:900c0c50:::benchmark_data_smithi188_161190_object128124:head# 2024-04-01T19:56:34.871 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:900ce7e3:::benchmark_data_smithi188_161190_object128655:head# 2024-04-01T19:56:34.871 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:900d20b7:::benchmark_data_smithi188_161190_object109210:head# 2024-04-01T19:56:34.871 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:900e1b8e:::benchmark_data_smithi188_161190_object80601:head# 2024-04-01T19:56:34.872 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:900e2a24:::benchmark_data_smithi188_161190_object111679:head# 2024-04-01T19:56:34.872 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:900ec3ad:::benchmark_data_smithi188_161190_object62137:head# 2024-04-01T19:56:34.874 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:900fa4c7:::benchmark_data_smithi188_161190_object40992:head# 2024-04-01T19:56:34.874 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:901082b3:::benchmark_data_smithi188_161190_object127445:head# 2024-04-01T19:56:34.875 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:34.875 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90112f79:::benchmark_data_smithi188_161190_object35138:head# 2024-04-01T19:56:34.875 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90117562:::benchmark_data_smithi188_161190_object85224:head# 2024-04-01T19:56:34.881 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90117e4d:::benchmark_data_smithi188_161190_object129079:head# 2024-04-01T19:56:34.881 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90124356:::benchmark_data_smithi188_161190_object38120:head# 2024-04-01T19:56:34.881 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90126b16:::benchmark_data_smithi188_161190_object73579:head# 2024-04-01T19:56:34.881 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90127bcc:::benchmark_data_smithi188_161190_object32194:head# 2024-04-01T19:56:34.881 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9013451a:::benchmark_data_smithi188_161190_object48141:head# 2024-04-01T19:56:34.881 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:901388cf:::benchmark_data_smithi188_161190_object27218:head# 2024-04-01T19:56:34.881 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9013f611:::benchmark_data_smithi188_161190_object68933:head# 2024-04-01T19:56:34.881 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:901429cb:::benchmark_data_smithi188_161190_object31708:head# 2024-04-01T19:56:34.882 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:901432dd:::benchmark_data_smithi188_161190_object53688:head# 2024-04-01T19:56:34.882 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90147f4c:::benchmark_data_smithi188_161190_object25761:head# 2024-04-01T19:56:34.882 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90149e1a:::benchmark_data_smithi188_161190_object49917:head# 2024-04-01T19:56:34.882 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9015017e:::benchmark_data_smithi188_161190_object128501:head# 2024-04-01T19:56:34.882 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90154582:::benchmark_data_smithi188_161190_object59457:head# 2024-04-01T19:56:34.882 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90159563:::benchmark_data_smithi188_161190_object110334:head# 2024-04-01T19:56:34.882 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90169637:::benchmark_data_smithi188_161190_object28620:head# 2024-04-01T19:56:34.883 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9016c2d8:::benchmark_data_smithi188_161190_object108335:head# 2024-04-01T19:56:34.883 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9016edc3:::benchmark_data_smithi188_161190_object49368:head# 2024-04-01T19:56:34.885 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90172745:::benchmark_data_smithi188_161190_object98561:head# 2024-04-01T19:56:34.885 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90178a88:::benchmark_data_smithi188_161190_object64309:head# 2024-04-01T19:56:34.885 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9017c437:::benchmark_data_smithi188_161190_object34183:head# 2024-04-01T19:56:34.886 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:901842cf:::benchmark_data_smithi188_161190_object50861:head# 2024-04-01T19:56:34.886 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9019413a:::benchmark_data_smithi188_161190_object35945:head# 2024-04-01T19:56:34.886 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9019825e:::benchmark_data_smithi188_161190_object84841:head# 2024-04-01T19:56:34.886 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9019e11f:::benchmark_data_smithi188_161190_object59947:head# 2024-04-01T19:56:34.888 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:901a0808:::benchmark_data_smithi188_161190_object125589:head# 2024-04-01T19:56:34.888 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:901a7f03:::benchmark_data_smithi188_161190_object113557:head# 2024-04-01T19:56:34.888 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:901ad661:::benchmark_data_smithi188_161190_object39816:head# 2024-04-01T19:56:34.889 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:901b0d5d:::benchmark_data_smithi188_161190_object97553:head# 2024-04-01T19:56:34.889 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:901bab18:::benchmark_data_smithi188_161190_object42532:head# 2024-04-01T19:56:34.890 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:901ca976:::benchmark_data_smithi188_161190_object63130:head# 2024-04-01T19:56:34.890 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:901d17c6:::benchmark_data_smithi188_161190_object60749:head# 2024-04-01T19:56:34.890 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:901d57f4:::benchmark_data_smithi188_161190_object23299:head# 2024-04-01T19:56:34.891 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:901f9a6d:::benchmark_data_smithi188_161190_object26823:head# 2024-04-01T19:56:34.892 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:901ffed6:::benchmark_data_smithi188_161190_object76034:head# 2024-04-01T19:56:34.892 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9020517b:::benchmark_data_smithi188_161190_object47257:head# 2024-04-01T19:56:34.892 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9020b1dd:::benchmark_data_smithi188_161190_object112353:head# 2024-04-01T19:56:34.893 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9020f2ae:::benchmark_data_smithi188_161190_object56667:head# 2024-04-01T19:56:34.893 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90211fc5:::benchmark_data_smithi188_161190_object66498:head# 2024-04-01T19:56:34.894 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9021526d:::benchmark_data_smithi188_161190_object47748:head# 2024-04-01T19:56:34.898 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90224673:::benchmark_data_smithi188_161190_object128036:head# 2024-04-01T19:56:34.903 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9022d584:::benchmark_data_smithi188_161190_object132893:head# 2024-04-01T19:56:34.903 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90235186:::benchmark_data_smithi188_161190_object105716:head# 2024-04-01T19:56:34.903 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90249a82:::benchmark_data_smithi188_161190_object88486:head# 2024-04-01T19:56:34.906 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:56:34.907 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9025251e:::benchmark_data_smithi188_161190_object86778:head# 2024-04-01T19:56:34.908 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:902592e7:::benchmark_data_smithi188_161190_object28394:head# 2024-04-01T19:56:34.908 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9026ee90:::benchmark_data_smithi188_161190_object98003:head# 2024-04-01T19:56:34.908 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9027c2e3:::benchmark_data_smithi188_161190_object94006:head# 2024-04-01T19:56:34.908 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9028442b:::benchmark_data_smithi188_161190_object21445:head# 2024-04-01T19:56:34.908 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9028c2b8:::benchmark_data_smithi188_161190_object120168:head# 2024-04-01T19:56:34.909 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9028c83a:::benchmark_data_smithi188_161190_object113161:head# 2024-04-01T19:56:34.909 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9028d336:::benchmark_data_smithi188_161190_object76264:head# 2024-04-01T19:56:34.909 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:902a6c3e:::benchmark_data_smithi188_161190_object43392:head# 2024-04-01T19:56:34.909 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:902a8542:::benchmark_data_smithi188_161190_object126678:head# 2024-04-01T19:56:34.910 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:902aaf29:::benchmark_data_smithi188_161190_object97632:head# 2024-04-01T19:56:34.910 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:902ab15f:::benchmark_data_smithi188_161190_object49068:head# 2024-04-01T19:56:34.910 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:902abc9a:::benchmark_data_smithi188_161190_object34431:head# 2024-04-01T19:56:34.911 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:902ac0c7:::benchmark_data_smithi188_161190_object48857:head# 2024-04-01T19:56:34.911 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:902ae739:::benchmark_data_smithi188_161190_object49187:head# 2024-04-01T19:56:34.912 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:34.913 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:902b382e:::benchmark_data_smithi188_161190_object128384:head# 2024-04-01T19:56:34.913 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:902bccfe:::benchmark_data_smithi188_161190_object21019:head# 2024-04-01T19:56:34.913 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:902c19d7:::benchmark_data_smithi188_161190_object80725:head# 2024-04-01T19:56:34.913 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:902cb160:::benchmark_data_smithi188_161190_object68517:head# 2024-04-01T19:56:34.913 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:56:34.918 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:902cb691:::benchmark_data_smithi188_161190_object134383:head# 2024-04-01T19:56:34.919 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:902cb8d1:::benchmark_data_smithi188_161190_object82379:head# 2024-04-01T19:56:34.919 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:902cf05c:::benchmark_data_smithi188_161190_object68875:head# 2024-04-01T19:56:34.919 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:902d08b2:::benchmark_data_smithi188_161190_object106074:head# 2024-04-01T19:56:34.919 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:902da2a1:::benchmark_data_smithi188_161190_object113719:head# 2024-04-01T19:56:34.919 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:902e6701:::benchmark_data_smithi188_161190_object37031:head# 2024-04-01T19:56:34.919 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:902e76ec:::benchmark_data_smithi188_161190_object47473:head# 2024-04-01T19:56:34.919 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:902fa5c4:::benchmark_data_smithi188_161190_object105646:head# 2024-04-01T19:56:34.919 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:902fb940:::benchmark_data_smithi188_161190_object78349:head# 2024-04-01T19:56:34.919 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:903026da:::benchmark_data_smithi188_161190_object43457:head# 2024-04-01T19:56:34.919 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9032482d:::benchmark_data_smithi188_161190_object123046:head# 2024-04-01T19:56:34.919 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9032995c:::benchmark_data_smithi188_161190_object24169:head# 2024-04-01T19:56:34.924 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9032dc49:::benchmark_data_smithi188_161190_object22570:head# 2024-04-01T19:56:34.924 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90331849:::benchmark_data_smithi188_161190_object49169:head# 2024-04-01T19:56:34.924 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90331d8e:::benchmark_data_smithi188_161190_object132880:head# 2024-04-01T19:56:34.924 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90346efa:::benchmark_data_smithi188_161190_object58478:head# 2024-04-01T19:56:34.924 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:903587bc:::benchmark_data_smithi188_161190_object89797:head# 2024-04-01T19:56:34.925 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9035bc62:::benchmark_data_smithi188_161190_object54613:head# 2024-04-01T19:56:34.925 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:903743d0:::benchmark_data_smithi188_161190_object63438:head# 2024-04-01T19:56:34.925 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9037efb6:::benchmark_data_smithi188_161190_object125832:head# 2024-04-01T19:56:34.925 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9038aabb:::benchmark_data_smithi188_161190_object102379:head# 2024-04-01T19:56:34.929 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9038dd34:::benchmark_data_smithi188_161190_object39143:head# 2024-04-01T19:56:34.929 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90395cfe:::benchmark_data_smithi188_161190_object118483:head# 2024-04-01T19:56:34.931 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:903c9b96:::benchmark_data_smithi188_161190_object99682:head# 2024-04-01T19:56:34.931 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:903d935e:::benchmark_data_smithi188_161190_object85033:head# 2024-04-01T19:56:34.931 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:903db2c7:::benchmark_data_smithi188_161190_object89661:head# 2024-04-01T19:56:34.932 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:903dcc4b:::benchmark_data_smithi188_161190_object81339:head# 2024-04-01T19:56:34.932 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:903e0e4b:::benchmark_data_smithi188_161190_object60965:head# 2024-04-01T19:56:34.933 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:903e1402:::benchmark_data_smithi188_161190_object43882:head# 2024-04-01T19:56:34.933 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:903ff096:::benchmark_data_smithi188_161190_object97497:head# 2024-04-01T19:56:34.933 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9040019e:::benchmark_data_smithi188_161190_object66986:head# 2024-04-01T19:56:34.933 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90401b92:::benchmark_data_smithi188_161190_object115195:head# 2024-04-01T19:56:34.934 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9040f5c0:::benchmark_data_smithi188_161190_object77216:head# 2024-04-01T19:56:34.934 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9041e92c:::benchmark_data_smithi188_161190_object129610:head# 2024-04-01T19:56:34.934 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90425f45:::benchmark_data_smithi188_161190_object71031:head# 2024-04-01T19:56:34.935 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90433b15:::benchmark_data_smithi188_161190_object21696:head# 2024-04-01T19:56:34.935 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90433efc:::benchmark_data_smithi188_161190_object87455:head# 2024-04-01T19:56:34.936 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9043c4cf:::benchmark_data_smithi188_161190_object124686:head# 2024-04-01T19:56:34.936 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9043e01a:::benchmark_data_smithi188_161190_object23830:head# 2024-04-01T19:56:34.937 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9044c73c:::benchmark_data_smithi188_161190_object85499:head# 2024-04-01T19:56:34.937 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9045271e:::benchmark_data_smithi188_161190_object111176:head# 2024-04-01T19:56:34.938 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:904564aa:::benchmark_data_smithi188_161190_object96681:head# 2024-04-01T19:56:34.938 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:904594fb:::benchmark_data_smithi188_161190_object29052:head# 2024-04-01T19:56:34.938 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90469abd:::benchmark_data_smithi188_161190_object43147:head# 2024-04-01T19:56:34.939 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9046b4f1:::benchmark_data_smithi188_161190_object27421:head# 2024-04-01T19:56:34.939 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90482bb5:::benchmark_data_smithi188_161190_object35946:head# 2024-04-01T19:56:34.939 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90482cf6:::benchmark_data_smithi188_161190_object124585:head# 2024-04-01T19:56:34.940 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9048d8f0:::benchmark_data_smithi188_161190_object139276:head# 2024-04-01T19:56:34.940 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90493451:::benchmark_data_smithi188_161190_object111258:head# 2024-04-01T19:56:34.941 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9049b944:::benchmark_data_smithi188_161190_object105729:head# 2024-04-01T19:56:34.941 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:904a78ca:::benchmark_data_smithi188_161190_object47556:head# 2024-04-01T19:56:34.942 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:904c603e:::benchmark_data_smithi188_161190_object132494:head# 2024-04-01T19:56:34.942 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:904cbf79:::benchmark_data_smithi188_161190_object102053:head# 2024-04-01T19:56:34.942 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:904d2a8c:::benchmark_data_smithi188_161190_object50477:head# 2024-04-01T19:56:34.943 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:904d676b:::benchmark_data_smithi188_161190_object48904:head# 2024-04-01T19:56:34.943 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:904d95ba:::benchmark_data_smithi188_161190_object80266:head# 2024-04-01T19:56:34.944 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:904e2dc1:::benchmark_data_smithi188_161190_object82591:head# 2024-04-01T19:56:34.944 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:904e5675:::benchmark_data_smithi188_161190_object40945:head# 2024-04-01T19:56:34.945 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:904e9182:::benchmark_data_smithi188_161190_object32369:head# 2024-04-01T19:56:34.945 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:904ee2a4:::benchmark_data_smithi188_161190_object111545:head# 2024-04-01T19:56:34.945 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:904f2c41:::benchmark_data_smithi188_161190_object108582:head# 2024-04-01T19:56:34.946 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:905013ba:::benchmark_data_smithi188_161190_object50479:head# 2024-04-01T19:56:34.947 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90504ead:::benchmark_data_smithi188_161190_object35712:head# 2024-04-01T19:56:34.947 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9050633e:::benchmark_data_smithi188_161190_object139265:head# 2024-04-01T19:56:34.947 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90508ff4:::benchmark_data_smithi188_161190_object62767:head# 2024-04-01T19:56:34.948 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9050bd7f:::benchmark_data_smithi188_161190_object74527:head# 2024-04-01T19:56:34.950 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90510242:::benchmark_data_smithi188_161190_object121755:head# 2024-04-01T19:56:34.956 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90511876:::benchmark_data_smithi188_161190_object81543:head# 2024-04-01T19:56:34.956 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:905128fa:::benchmark_data_smithi188_161190_object76773:head# 2024-04-01T19:56:34.956 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90513ae7:::benchmark_data_smithi188_161190_object136148:head# 2024-04-01T19:56:34.956 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:905147db:::benchmark_data_smithi188_161190_object49579:head# 2024-04-01T19:56:34.957 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90515b84:::benchmark_data_smithi188_161190_object97905:head# 2024-04-01T19:56:34.957 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9052cfe5:::benchmark_data_smithi188_161190_object85583:head# 2024-04-01T19:56:34.957 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90531582:::benchmark_data_smithi188_161190_object55462:head# 2024-04-01T19:56:34.957 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90537ad0:::benchmark_data_smithi188_161190_object132803:head# 2024-04-01T19:56:34.957 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90541be2:::benchmark_data_smithi188_161190_object112681:head# 2024-04-01T19:56:34.957 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90543e1a:::benchmark_data_smithi188_161190_object37476:head# 2024-04-01T19:56:34.957 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:905476cb:::benchmark_data_smithi188_161190_object74968:head# 2024-04-01T19:56:34.957 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90571b3a:::benchmark_data_smithi188_161190_object107774:head# 2024-04-01T19:56:34.958 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:905757dc:::benchmark_data_smithi188_161190_object95770:head# 2024-04-01T19:56:34.958 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9057ebb8:::benchmark_data_smithi188_161190_object33495:head# 2024-04-01T19:56:34.958 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90582911:::benchmark_data_smithi188_161190_object21546:head# 2024-04-01T19:56:34.958 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:905961a3:::benchmark_data_smithi188_161190_object129897:head# 2024-04-01T19:56:34.959 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9059d422:::benchmark_data_smithi188_161190_object96505:head# 2024-04-01T19:56:34.959 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:905b37a0:::benchmark_data_smithi188_161190_object86464:head# 2024-04-01T19:56:34.960 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:905ba5ce:::benchmark_data_smithi188_161190_object115233:head# 2024-04-01T19:56:34.960 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:905c2ef7:::benchmark_data_smithi188_161190_object81969:head# 2024-04-01T19:56:34.960 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:905c4226:::benchmark_data_smithi188_161190_object79504:head# 2024-04-01T19:56:34.961 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:905e5ce5:::benchmark_data_smithi188_161190_object24224:head# 2024-04-01T19:56:34.961 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:905ec862:::benchmark_data_smithi188_161190_object35618:head# 2024-04-01T19:56:34.962 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:905ee123:::benchmark_data_smithi188_161190_object58789:head# 2024-04-01T19:56:34.962 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:905f1f59:::benchmark_data_smithi188_161190_object46257:head# 2024-04-01T19:56:34.962 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:905f4f74:::benchmark_data_smithi188_161190_object126080:head# 2024-04-01T19:56:34.963 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:905fced8:::benchmark_data_smithi188_161190_object96610:head# 2024-04-01T19:56:34.963 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9060ff73:::benchmark_data_smithi188_161190_object32641:head# 2024-04-01T19:56:34.964 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9061242d:::benchmark_data_smithi188_161190_object89887:head# 2024-04-01T19:56:34.964 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90619873:::benchmark_data_smithi188_161190_object51687:head# 2024-04-01T19:56:34.965 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:906228fd:::benchmark_data_smithi188_161190_object129217:head# 2024-04-01T19:56:34.965 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90626e5d:::benchmark_data_smithi188_161190_object23587:head# 2024-04-01T19:56:34.966 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9064be6a:::benchmark_data_smithi188_161190_object131221:head# 2024-04-01T19:56:34.966 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9064f336:::benchmark_data_smithi188_161190_object137899:head# 2024-04-01T19:56:34.966 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9065b715:::benchmark_data_smithi188_161190_object88381:head# 2024-04-01T19:56:34.967 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:906734ac:::benchmark_data_smithi188_161190_object114023:head# 2024-04-01T19:56:34.968 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90679065:::benchmark_data_smithi188_161190_object91150:head# 2024-04-01T19:56:34.970 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9067cbe3:::benchmark_data_smithi188_161190_object108057:head# 2024-04-01T19:56:34.972 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90680109:::benchmark_data_smithi188_161190_object138105:head# 2024-04-01T19:56:34.973 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90688d42:::benchmark_data_smithi188_161190_object104978:head# 2024-04-01T19:56:34.979 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90688efc:::benchmark_data_smithi188_161190_object85044:head# 2024-04-01T19:56:34.981 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:906897be:::benchmark_data_smithi188_161190_object80200:head# 2024-04-01T19:56:34.981 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9068d762:::benchmark_data_smithi188_161190_object31277:head# 2024-04-01T19:56:34.981 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9069550f:::benchmark_data_smithi188_161190_object119654:head# 2024-04-01T19:56:34.981 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:906a75ba:::benchmark_data_smithi188_161190_object43731:head# 2024-04-01T19:56:34.982 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:906c8440:::benchmark_data_smithi188_161190_object110786:head# 2024-04-01T19:56:34.982 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:906cc2b6:::benchmark_data_smithi188_161190_object131591:head# 2024-04-01T19:56:34.982 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:906d0370:::benchmark_data_smithi188_161190_object130092:head# 2024-04-01T19:56:34.983 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:906d6f4d:::benchmark_data_smithi188_161190_object62696:head# 2024-04-01T19:56:34.983 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:906ddc6e:::benchmark_data_smithi188_161190_object38645:head# 2024-04-01T19:56:34.984 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:906e809c:::benchmark_data_smithi188_161190_object129213:head# 2024-04-01T19:56:34.984 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:906ede0b:::benchmark_data_smithi188_161190_object64288:head# 2024-04-01T19:56:34.984 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:906f03cf:::benchmark_data_smithi188_161190_object68982:head# 2024-04-01T19:56:34.985 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:906f06c5:::benchmark_data_smithi188_161190_object105120:head# 2024-04-01T19:56:34.985 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:906feb5c:::benchmark_data_smithi188_161190_object67848:head# 2024-04-01T19:56:34.987 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:907199d6:::benchmark_data_smithi188_161190_object40157:head# 2024-04-01T19:56:34.988 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9071f09a:::benchmark_data_smithi188_161190_object27504:head# 2024-04-01T19:56:34.988 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90722a6a:::benchmark_data_smithi188_161190_object54858:head# 2024-04-01T19:56:34.989 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9072fef0:::benchmark_data_smithi188_161190_object30768:head# 2024-04-01T19:56:34.989 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90738894:::benchmark_data_smithi188_161190_object135258:head# 2024-04-01T19:56:34.990 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9073af55:::benchmark_data_smithi188_161190_object58670:head# 2024-04-01T19:56:34.990 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9073b4b0:::benchmark_data_smithi188_161190_object104418:head# 2024-04-01T19:56:34.991 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90743633:::benchmark_data_smithi188_161190_object55054:head# 2024-04-01T19:56:34.991 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90746b4d:::benchmark_data_smithi188_161190_object81726:head# 2024-04-01T19:56:34.991 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90750376:::benchmark_data_smithi188_161190_object25244:head# 2024-04-01T19:56:34.992 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90765222:::benchmark_data_smithi188_161190_object133612:head# 2024-04-01T19:56:34.992 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9076b9f2:::benchmark_data_smithi188_161190_object37352:head# 2024-04-01T19:56:34.993 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9076bd6f:::benchmark_data_smithi188_161190_object76227:head# 2024-04-01T19:56:34.993 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90774341:::benchmark_data_smithi188_161190_object48633:head# 2024-04-01T19:56:34.994 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90784e62:::benchmark_data_smithi188_161190_object27687:head# 2024-04-01T19:56:34.995 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:907a68ca:::benchmark_data_smithi188_161190_object94355:head# 2024-04-01T19:56:34.995 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:907accae:::benchmark_data_smithi188_161190_object117676:head# 2024-04-01T19:56:34.996 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:907b2c8d:::benchmark_data_smithi188_161190_object118177:head# 2024-04-01T19:56:34.996 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:907b52b3:::benchmark_data_smithi188_161190_object41210:head# 2024-04-01T19:56:34.997 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:907c3f8e:::benchmark_data_smithi188_161190_object72750:head# 2024-04-01T19:56:34.997 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:907cc470:::benchmark_data_smithi188_161190_object24395:head# 2024-04-01T19:56:34.998 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:907cc6db:::benchmark_data_smithi188_161190_object65973:head# 2024-04-01T19:56:34.998 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:907ccd04:::benchmark_data_smithi188_161190_object47565:head# 2024-04-01T19:56:34.999 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:907d00ad:::benchmark_data_smithi188_161190_object53500:head# 2024-04-01T19:56:34.999 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:907d6cc9:::benchmark_data_smithi188_161190_object37992:head# 2024-04-01T19:56:35.000 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:907e3884:::benchmark_data_smithi188_161190_object101810:head# 2024-04-01T19:56:35.000 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:907e58ca:::benchmark_data_smithi188_161190_object101492:head# 2024-04-01T19:56:35.000 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:907e94f3:::benchmark_data_smithi188_161190_object66945:head# 2024-04-01T19:56:35.001 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:907ec1f8:::benchmark_data_smithi188_161190_object33146:head# 2024-04-01T19:56:35.005 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:907ef555:::benchmark_data_smithi188_161190_object69310:head# 2024-04-01T19:56:35.006 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:907f004d:::benchmark_data_smithi188_161190_object114039:head# 2024-04-01T19:56:35.006 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9080f268:::benchmark_data_smithi188_161190_object130021:head# 2024-04-01T19:56:35.006 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9080ffa5:::benchmark_data_smithi188_161190_object118546:head# 2024-04-01T19:56:35.012 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90812b03:::benchmark_data_smithi188_161190_object66646:head# 2024-04-01T19:56:35.012 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90812b9a:::benchmark_data_smithi188_161190_object59190:head# 2024-04-01T19:56:35.012 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9083a44e:::benchmark_data_smithi188_161190_object119306:head# 2024-04-01T19:56:35.012 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9084431d:::benchmark_data_smithi188_161190_object128619:head# 2024-04-01T19:56:35.012 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90847ab1:::benchmark_data_smithi188_161190_object127233:head# 2024-04-01T19:56:35.012 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90864f3a:::benchmark_data_smithi188_161190_object80891:head# 2024-04-01T19:56:35.012 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9086b184:::benchmark_data_smithi188_161190_object36541:head# 2024-04-01T19:56:35.012 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9086be60:::benchmark_data_smithi188_161190_object125628:head# 2024-04-01T19:56:35.013 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9087c374:::benchmark_data_smithi188_161190_object63979:head# 2024-04-01T19:56:35.013 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9087fa15:::benchmark_data_smithi188_161190_object28778:head# 2024-04-01T19:56:35.013 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90880956:::benchmark_data_smithi188_161190_object28066:head# 2024-04-01T19:56:35.014 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9089453e:::benchmark_data_smithi188_161190_object99203:head# 2024-04-01T19:56:35.014 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:56:35.015 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:908956b9:::benchmark_data_smithi188_161190_object129202:head# 2024-04-01T19:56:35.019 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9089e23e:::benchmark_data_smithi188_161190_object124943:head# 2024-04-01T19:56:35.019 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:908a544b:::benchmark_data_smithi188_161190_object83890:head# 2024-04-01T19:56:35.019 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:908b006b:::benchmark_data_smithi188_161190_object82016:head# 2024-04-01T19:56:35.019 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:908b9e59:::benchmark_data_smithi188_161190_object97761:head# 2024-04-01T19:56:35.019 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:908d3845:::benchmark_data_smithi188_161190_object73793:head# 2024-04-01T19:56:35.020 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:908dc17f:::benchmark_data_smithi188_161190_object82062:head# 2024-04-01T19:56:35.020 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:908dd88b:::benchmark_data_smithi188_161190_object32165:head# 2024-04-01T19:56:35.021 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:908ea042:::benchmark_data_smithi188_161190_object97347:head# 2024-04-01T19:56:35.022 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:908ec668:::benchmark_data_smithi188_161190_object58460:head# 2024-04-01T19:56:35.022 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90901b1e:::benchmark_data_smithi188_161190_object30445:head# 2024-04-01T19:56:35.022 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9090e0f7:::benchmark_data_smithi188_161190_object33540:head# 2024-04-01T19:56:35.023 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9092cf7d:::benchmark_data_smithi188_161190_object126503:head# 2024-04-01T19:56:35.023 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90932c8e:::benchmark_data_smithi188_161190_object79081:head# 2024-04-01T19:56:35.025 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9094b2b1:::benchmark_data_smithi188_161190_object52922:head# 2024-04-01T19:56:35.026 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:909629bc:::benchmark_data_smithi188_161190_object138279:head# 2024-04-01T19:56:35.026 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:909747c0:::benchmark_data_smithi188_161190_object102795:head# 2024-04-01T19:56:35.027 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90976dc5:::benchmark_data_smithi188_161190_object123296:head# 2024-04-01T19:56:35.027 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90976e57:::benchmark_data_smithi188_161190_object121250:head# 2024-04-01T19:56:35.028 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9097a3be:::benchmark_data_smithi188_161190_object59512:head# 2024-04-01T19:56:35.028 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9097fe30:::benchmark_data_smithi188_161190_object94245:head# 2024-04-01T19:56:35.028 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9098102b:::benchmark_data_smithi188_161190_object104144:head# 2024-04-01T19:56:35.029 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90982586:::benchmark_data_smithi188_161190_object24953:head# 2024-04-01T19:56:35.030 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9098851f:::benchmark_data_smithi188_161190_object50773:head# 2024-04-01T19:56:35.030 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9098b736:::benchmark_data_smithi188_161190_object93702:head# 2024-04-01T19:56:35.030 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9098c89d:::benchmark_data_smithi188_161190_object75147:head# 2024-04-01T19:56:35.031 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:909aa63f:::benchmark_data_smithi188_161190_object126248:head# 2024-04-01T19:56:35.031 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:909b2eb6:::benchmark_data_smithi188_161190_object46997:head# 2024-04-01T19:56:35.032 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:909c37ed:::benchmark_data_smithi188_161190_object99797:head# 2024-04-01T19:56:35.032 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:909c4fef:::benchmark_data_smithi188_161190_object20706:head# 2024-04-01T19:56:35.033 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:909cde67:::benchmark_data_smithi188_161190_object103018:head# 2024-04-01T19:56:35.033 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:909d4655:::benchmark_data_smithi188_161190_object110969:head# 2024-04-01T19:56:35.034 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:909df50b:::benchmark_data_smithi188_161190_object126668:head# 2024-04-01T19:56:35.034 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:909e43b5:::benchmark_data_smithi188_161190_object111998:head# 2024-04-01T19:56:35.034 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:909f29d8:::benchmark_data_smithi188_161190_object38668:head# 2024-04-01T19:56:35.040 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:909f9eaf:::benchmark_data_smithi188_161190_object23472:head# 2024-04-01T19:56:35.040 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90a07019:::benchmark_data_smithi188_161190_object137923:head# 2024-04-01T19:56:35.041 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90a0c3c9:::benchmark_data_smithi188_161190_object51840:head# 2024-04-01T19:56:35.042 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90a12bba:::benchmark_data_smithi188_161190_object119939:head# 2024-04-01T19:56:35.046 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90a2d033:::benchmark_data_smithi188_161190_object55049:head# 2024-04-01T19:56:35.046 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90a2f346:::benchmark_data_smithi188_161190_object77443:head# 2024-04-01T19:56:35.047 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90a33e2c:::benchmark_data_smithi188_161190_object42416:head# 2024-04-01T19:56:35.047 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90a3494d:::benchmark_data_smithi188_161190_object90199:head# 2024-04-01T19:56:35.047 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90a38ffd:::benchmark_data_smithi188_161190_object51581:head# 2024-04-01T19:56:35.048 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90a3b693:::benchmark_data_smithi188_161190_object53885:head# 2024-04-01T19:56:35.049 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90a3c6e1:::benchmark_data_smithi188_161190_object20122:head# 2024-04-01T19:56:35.049 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90a40d1e:::benchmark_data_smithi188_161190_object74901:head# 2024-04-01T19:56:35.049 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90a5c0ac:::benchmark_data_smithi188_161190_object134672:head# 2024-04-01T19:56:35.050 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90a5da84:::benchmark_data_smithi188_161190_object108244:head# 2024-04-01T19:56:35.050 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90a5f89c:::benchmark_data_smithi188_161190_object39624:head# 2024-04-01T19:56:35.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90a6a70f:::benchmark_data_smithi188_161190_object123229:head# 2024-04-01T19:56:35.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90a741e8:::benchmark_data_smithi188_161190_object120173:head# 2024-04-01T19:56:35.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90a78a13:::benchmark_data_smithi188_161190_object129962:head# 2024-04-01T19:56:35.052 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90a79f12:::benchmark_data_smithi188_161190_object106620:head# 2024-04-01T19:56:35.052 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90a8036b:::benchmark_data_smithi188_161190_object37509:head# 2024-04-01T19:56:35.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90a863b8:::benchmark_data_smithi188_161190_object60861:head# 2024-04-01T19:56:35.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90a8c836:::benchmark_data_smithi188_161190_object57883:head# 2024-04-01T19:56:35.054 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90a9f641:::benchmark_data_smithi188_161190_object37254:head# 2024-04-01T19:56:35.054 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90ac1246:::benchmark_data_smithi188_161190_object47040:head# 2024-04-01T19:56:35.055 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90ac1da0:::benchmark_data_smithi188_161190_object103790:head# 2024-04-01T19:56:35.055 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90ac2b3d:::benchmark_data_smithi188_161190_object111870:head# 2024-04-01T19:56:35.055 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90ada25e:::benchmark_data_smithi188_161190_object94932:head# 2024-04-01T19:56:35.056 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90adb63f:::benchmark_data_smithi188_161190_object72209:head# 2024-04-01T19:56:35.056 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90adfb54:::benchmark_data_smithi188_161190_object90688:head# 2024-04-01T19:56:35.057 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90ae1102:::benchmark_data_smithi188_161190_object110632:head# 2024-04-01T19:56:35.057 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90ae3b80:::benchmark_data_smithi188_161190_object77600:head# 2024-04-01T19:56:35.057 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90b01743:::benchmark_data_smithi188_161190_object108484:head# 2024-04-01T19:56:35.058 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90b0b94f:::benchmark_data_smithi188_161190_object50138:head# 2024-04-01T19:56:35.058 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90b1c450:::benchmark_data_smithi188_161190_object46848:head# 2024-04-01T19:56:35.059 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90b47b39:::benchmark_data_smithi188_161190_object81497:head# 2024-04-01T19:56:35.059 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90b47d05:::benchmark_data_smithi188_161190_object75731:head# 2024-04-01T19:56:35.060 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90b4f466:::benchmark_data_smithi188_161190_object40241:head# 2024-04-01T19:56:35.060 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90b5fb6b:::benchmark_data_smithi188_161190_object39295:head# 2024-04-01T19:56:35.060 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90b63ed5:::benchmark_data_smithi188_161190_object137836:head# 2024-04-01T19:56:35.061 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90b65806:::benchmark_data_smithi188_161190_object127346:head# 2024-04-01T19:56:35.061 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90b6dbb1:::benchmark_data_smithi188_161190_object73078:head# 2024-04-01T19:56:35.068 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90b78fed:::benchmark_data_smithi188_161190_object86787:head# 2024-04-01T19:56:35.070 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90b793f3:::benchmark_data_smithi188_161190_object39644:head# 2024-04-01T19:56:35.070 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90b7a7ab:::benchmark_data_smithi188_161190_object56950:head# 2024-04-01T19:56:35.070 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90b7eb0a:::benchmark_data_smithi188_161190_object38589:head# 2024-04-01T19:56:35.070 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90b7f583:::benchmark_data_smithi188_161190_object35808:head# 2024-04-01T19:56:35.071 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90b97bf2:::benchmark_data_smithi188_161190_object66077:head# 2024-04-01T19:56:35.071 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:35.072 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90b9a0a4:::benchmark_data_smithi188_161190_object63717:head# 2024-04-01T19:56:35.072 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90bab865:::benchmark_data_smithi188_161190_object101021:head# 2024-04-01T19:56:35.072 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90bb0f31:::benchmark_data_smithi188_161190_object92827:head# 2024-04-01T19:56:35.072 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90bbab26:::benchmark_data_smithi188_161190_object116892:head# 2024-04-01T19:56:35.078 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90bbc084:::benchmark_data_smithi188_161190_object47550:head# 2024-04-01T19:56:35.078 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90be7a1a:::benchmark_data_smithi188_161190_object63743:head# 2024-04-01T19:56:35.078 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90bf2be2:::benchmark_data_smithi188_161190_object41276:head# 2024-04-01T19:56:35.078 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90bfc4bc:::benchmark_data_smithi188_161190_object133812:head# 2024-04-01T19:56:35.078 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90c07901:::benchmark_data_smithi188_161190_object71322:head# 2024-04-01T19:56:35.078 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90c137f2:::benchmark_data_smithi188_161190_object138603:head# 2024-04-01T19:56:35.081 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90c3476e:::benchmark_data_smithi188_161190_object41098:head# 2024-04-01T19:56:35.082 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90c4d0b6:::benchmark_data_smithi188_161190_object99846:head# 2024-04-01T19:56:35.082 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90c5357d:::benchmark_data_smithi188_161190_object40197:head# 2024-04-01T19:56:35.083 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90c60119:::benchmark_data_smithi188_161190_object123228:head# 2024-04-01T19:56:35.085 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90c84455:::benchmark_data_smithi188_161190_object101064:head# 2024-04-01T19:56:35.085 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90c88521:::benchmark_data_smithi188_161190_object53107:head# 2024-04-01T19:56:35.085 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90c911e5:::benchmark_data_smithi188_161190_object101534:head# 2024-04-01T19:56:35.085 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90c91ca1:::benchmark_data_smithi188_161190_object81090:head# 2024-04-01T19:56:35.085 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90caac46:::benchmark_data_smithi188_161190_object83416:head# 2024-04-01T19:56:35.087 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90cb0a6c:::benchmark_data_smithi188_161190_object95960:head# 2024-04-01T19:56:35.088 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90cb5b2d:::benchmark_data_smithi188_161190_object43923:head# 2024-04-01T19:56:35.088 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90cb87a3:::benchmark_data_smithi188_161190_object94137:head# 2024-04-01T19:56:35.089 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90cd09fe:::benchmark_data_smithi188_161190_object102457:head# 2024-04-01T19:56:35.089 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90cd4e3b:::benchmark_data_smithi188_161190_object78943:head# 2024-04-01T19:56:35.089 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90ce313e:::benchmark_data_smithi188_161190_object83961:head# 2024-04-01T19:56:35.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90cf6f4f:::benchmark_data_smithi188_161190_object20803:head# 2024-04-01T19:56:35.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90cf7f4b:::benchmark_data_smithi188_161190_object134495:head# 2024-04-01T19:56:35.091 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90d0317e:::benchmark_data_smithi188_161190_object138716:head# 2024-04-01T19:56:35.091 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90d0faa7:::benchmark_data_smithi188_161190_object65259:head# 2024-04-01T19:56:35.094 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90d173e5:::benchmark_data_smithi188_161190_object106485:head# 2024-04-01T19:56:35.094 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90d2999c:::benchmark_data_smithi188_161190_object38678:head# 2024-04-01T19:56:35.095 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90d343c9:::benchmark_data_smithi188_161190_object79594:head# 2024-04-01T19:56:35.095 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90d39639:::benchmark_data_smithi188_161190_object51969:head# 2024-04-01T19:56:35.096 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90d4b68a:::benchmark_data_smithi188_161190_object60305:head# 2024-04-01T19:56:35.096 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90d4c917:::benchmark_data_smithi188_161190_object56527:head# 2024-04-01T19:56:35.098 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90d4e401:::benchmark_data_smithi188_161190_object49449:head# 2024-04-01T19:56:35.099 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90d4f518:::benchmark_data_smithi188_161190_object22637:head# 2024-04-01T19:56:35.100 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90d534f9:::benchmark_data_smithi188_161190_object44848:head# 2024-04-01T19:56:35.100 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90d56829:::benchmark_data_smithi188_161190_object40767:head# 2024-04-01T19:56:35.105 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90d67baa:::benchmark_data_smithi188_161190_object117660:head# 2024-04-01T19:56:35.106 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90d6d2a2:::benchmark_data_smithi188_161190_object79225:head# 2024-04-01T19:56:35.106 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90d76809:::benchmark_data_smithi188_161190_object77488:head# 2024-04-01T19:56:35.106 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90d7bde0:::benchmark_data_smithi188_161190_object126700:head# 2024-04-01T19:56:35.106 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90d7fec7:::benchmark_data_smithi188_161190_object111857:head# 2024-04-01T19:56:35.106 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90d8050e:::benchmark_data_smithi188_161190_object97760:head# 2024-04-01T19:56:35.106 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90d9b5b5:::benchmark_data_smithi188_161190_object98348:head# 2024-04-01T19:56:35.106 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90da53b9:::benchmark_data_smithi188_161190_object93707:head# 2024-04-01T19:56:35.106 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90dab035:::benchmark_data_smithi188_161190_object27008:head# 2024-04-01T19:56:35.107 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:56:35.107 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90db01fb:::benchmark_data_smithi188_161190_object62843:head# 2024-04-01T19:56:35.108 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90dbbafb:::benchmark_data_smithi188_161190_object127163:head# 2024-04-01T19:56:35.108 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90dc9a86:::benchmark_data_smithi188_161190_object95820:head# 2024-04-01T19:56:35.108 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90dccc84:::benchmark_data_smithi188_161190_object116539:head# 2024-04-01T19:56:35.108 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90dd3e15:::benchmark_data_smithi188_161190_object82042:head# 2024-04-01T19:56:35.109 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90dd5370:::benchmark_data_smithi188_161190_object45353:head# 2024-04-01T19:56:35.109 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90dd5743:::benchmark_data_smithi188_161190_object73840:head# 2024-04-01T19:56:35.109 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90ddbdb0:::benchmark_data_smithi188_161190_object119139:head# 2024-04-01T19:56:35.111 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:35.111 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:56:35.111 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90df3459:::benchmark_data_smithi188_161190_object49388:head# 2024-04-01T19:56:35.112 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90e014ea:::benchmark_data_smithi188_161190_object30095:head# 2024-04-01T19:56:35.113 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90e016e3:::benchmark_data_smithi188_161190_object67676:head# 2024-04-01T19:56:35.113 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90e03151:::benchmark_data_smithi188_161190_object120704:head# 2024-04-01T19:56:35.113 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90e0a10f:::benchmark_data_smithi188_161190_object77667:head# 2024-04-01T19:56:35.113 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90e0bca7:::benchmark_data_smithi188_161190_object70461:head# 2024-04-01T19:56:35.113 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90e343fe:::benchmark_data_smithi188_161190_object29341:head# 2024-04-01T19:56:35.114 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90e3e0d5:::benchmark_data_smithi188_161190_object64701:head# 2024-04-01T19:56:35.114 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90e41200:::benchmark_data_smithi188_161190_object137059:head# 2024-04-01T19:56:35.114 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90e43352:::benchmark_data_smithi188_161190_object73952:head# 2024-04-01T19:56:35.115 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90e534f8:::benchmark_data_smithi188_161190_object98540:head# 2024-04-01T19:56:35.115 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90e627d8:::benchmark_data_smithi188_161190_object115376:head# 2024-04-01T19:56:35.115 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90e62f6e:::benchmark_data_smithi188_161190_object40194:head# 2024-04-01T19:56:35.116 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90e77d5b:::benchmark_data_smithi188_161190_object39028:head# 2024-04-01T19:56:35.116 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90e7b9b5:::benchmark_data_smithi188_161190_object90806:head# 2024-04-01T19:56:35.117 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90e88f6c:::benchmark_data_smithi188_161190_object106588:head# 2024-04-01T19:56:35.119 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90e8c92b:::benchmark_data_smithi188_161190_object29076:head# 2024-04-01T19:56:35.119 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90e9efcf:::benchmark_data_smithi188_161190_object46295:head# 2024-04-01T19:56:35.123 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90ea612f:::benchmark_data_smithi188_161190_object38862:head# 2024-04-01T19:56:35.131 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90ead16f:::benchmark_data_smithi188_161190_object84989:head# 2024-04-01T19:56:35.131 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90eafd77:::benchmark_data_smithi188_161190_object100322:head# 2024-04-01T19:56:35.131 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90ecad9d:::benchmark_data_smithi188_161190_object137593:head# 2024-04-01T19:56:35.131 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90ed2da6:::benchmark_data_smithi188_161190_object138000:head# 2024-04-01T19:56:35.131 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90ed2eb9:::benchmark_data_smithi188_161190_object122208:head# 2024-04-01T19:56:35.131 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90ed788f:::benchmark_data_smithi188_161190_object24428:head# 2024-04-01T19:56:35.131 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90ed7cba:::benchmark_data_smithi188_161190_object36833:head# 2024-04-01T19:56:35.131 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90edcef5:::benchmark_data_smithi188_161190_object104657:head# 2024-04-01T19:56:35.131 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90edd38d:::benchmark_data_smithi188_161190_object109098:head# 2024-04-01T19:56:35.132 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90ee9449:::benchmark_data_smithi188_161190_object65357:head# 2024-04-01T19:56:35.132 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90ef22c4:::benchmark_data_smithi188_161190_object119749:head# 2024-04-01T19:56:35.132 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90ef40ef:::benchmark_data_smithi188_161190_object118398:head# 2024-04-01T19:56:35.132 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90f032f1:::benchmark_data_smithi188_161190_object105434:head# 2024-04-01T19:56:35.132 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90f2178a:::benchmark_data_smithi188_161190_object60468:head# 2024-04-01T19:56:35.132 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90f2614e:::benchmark_data_smithi188_161190_object25806:head# 2024-04-01T19:56:35.132 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90f291fb:::benchmark_data_smithi188_161190_object117228:head# 2024-04-01T19:56:35.132 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90f2f461:::benchmark_data_smithi188_161190_object30619:head# 2024-04-01T19:56:35.132 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90f33d92:::benchmark_data_smithi188_161190_object119570:head# 2024-04-01T19:56:35.132 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90f3ca5b:::benchmark_data_smithi188_161190_object121722:head# 2024-04-01T19:56:35.132 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90f3cea8:::benchmark_data_smithi188_161190_object124613:head# 2024-04-01T19:56:35.132 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90f59745:::benchmark_data_smithi188_161190_object69516:head# 2024-04-01T19:56:35.132 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90f5ad3f:::benchmark_data_smithi188_161190_object39254:head# 2024-04-01T19:56:35.133 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90f5f8a1:::benchmark_data_smithi188_161190_object115097:head# 2024-04-01T19:56:35.133 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90f5ff75:::benchmark_data_smithi188_161190_object81867:head# 2024-04-01T19:56:35.133 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90f649b0:::benchmark_data_smithi188_161190_object24828:head# 2024-04-01T19:56:35.133 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90f6afbd:::benchmark_data_smithi188_161190_object105548:head# 2024-04-01T19:56:35.133 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90f6da23:::benchmark_data_smithi188_161190_object76580:head# 2024-04-01T19:56:35.135 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90f6e422:::benchmark_data_smithi188_161190_object127427:head# 2024-04-01T19:56:35.135 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90f95712:::benchmark_data_smithi188_161190_object123371:head# 2024-04-01T19:56:35.136 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90f9f2cf:::benchmark_data_smithi188_161190_object31047:head# 2024-04-01T19:56:35.136 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90fbfdc0:::benchmark_data_smithi188_161190_object63863:head# 2024-04-01T19:56:35.136 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90fc1089:::benchmark_data_smithi188_161190_object37319:head# 2024-04-01T19:56:35.137 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90fc13c1:::benchmark_data_smithi188_161190_object20269:head# 2024-04-01T19:56:35.137 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90fc6309:::benchmark_data_smithi188_161190_object102363:head# 2024-04-01T19:56:35.138 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90fcee04:::benchmark_data_smithi188_161190_object108583:head# 2024-04-01T19:56:35.138 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90fd4ad7:::benchmark_data_smithi188_161190_object63534:head# 2024-04-01T19:56:35.139 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90fd6d8a:::benchmark_data_smithi188_161190_object84694:head# 2024-04-01T19:56:35.139 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90fe1580:::benchmark_data_smithi188_161190_object55468:head# 2024-04-01T19:56:35.139 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90fef0dd:::benchmark_data_smithi188_161190_object89801:head# 2024-04-01T19:56:35.140 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90ff553b:::benchmark_data_smithi188_161190_object61889:head# 2024-04-01T19:56:35.140 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90ffa713:::benchmark_data_smithi188_161190_object91344:head# 2024-04-01T19:56:35.141 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90ffcc68:::benchmark_data_smithi188_161190_object88331:head# 2024-04-01T19:56:35.141 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90fff33a:::benchmark_data_smithi188_161190_object37368:head# 2024-04-01T19:56:35.142 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:90fff774:::benchmark_data_smithi188_161190_object65963:head# 2024-04-01T19:56:35.142 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9100b883:::benchmark_data_smithi188_161190_object27618:head# 2024-04-01T19:56:35.143 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9101ae0e:::benchmark_data_smithi188_161190_object51808:head# 2024-04-01T19:56:35.143 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9101e801:::benchmark_data_smithi188_161190_object57434:head# 2024-04-01T19:56:35.149 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91029411:::benchmark_data_smithi188_161190_object86050:head# 2024-04-01T19:56:35.149 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9103ed14:::benchmark_data_smithi188_161190_object92913:head# 2024-04-01T19:56:35.149 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91040d1d:::benchmark_data_smithi188_161190_object117539:head# 2024-04-01T19:56:35.149 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91056d77:::benchmark_data_smithi188_161190_object95094:head# 2024-04-01T19:56:35.149 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9105a0ca:::benchmark_data_smithi188_161190_object84954:head# 2024-04-01T19:56:35.149 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9105a6b1:::benchmark_data_smithi188_161190_object86711:head# 2024-04-01T19:56:35.149 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9105e187:::benchmark_data_smithi188_161190_object22366:head# 2024-04-01T19:56:35.149 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9105f743:::benchmark_data_smithi188_161190_object101504:head# 2024-04-01T19:56:35.149 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:910600e4:::benchmark_data_smithi188_161190_object79515:head# 2024-04-01T19:56:35.149 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91066acd:::benchmark_data_smithi188_161190_object41789:head# 2024-04-01T19:56:35.150 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91066c2e:::benchmark_data_smithi188_161190_object92821:head# 2024-04-01T19:56:35.150 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9106f705:::benchmark_data_smithi188_161190_object98999:head# 2024-04-01T19:56:35.150 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91078300:::benchmark_data_smithi188_161190_object131524:head# 2024-04-01T19:56:35.151 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9107908e:::benchmark_data_smithi188_161190_object69317:head# 2024-04-01T19:56:35.151 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9107b111:::benchmark_data_smithi188_161190_object24985:head# 2024-04-01T19:56:35.152 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91082b5d:::benchmark_data_smithi188_161190_object97353:head# 2024-04-01T19:56:35.152 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9109d2a4:::benchmark_data_smithi188_161190_object130234:head# 2024-04-01T19:56:35.152 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:910a77b3:::benchmark_data_smithi188_161190_object130219:head# 2024-04-01T19:56:35.153 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:910a7f68:::benchmark_data_smithi188_161190_object100198:head# 2024-04-01T19:56:35.153 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:910af0d1:::benchmark_data_smithi188_161190_object124715:head# 2024-04-01T19:56:35.153 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:910b0b44:::benchmark_data_smithi188_161190_object138110:head# 2024-04-01T19:56:35.154 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:910b32a6:::benchmark_data_smithi188_161190_object121988:head# 2024-04-01T19:56:35.154 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:910b5b4a:::benchmark_data_smithi188_161190_object97914:head# 2024-04-01T19:56:35.155 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:910b6e98:::benchmark_data_smithi188_161190_object121173:head# 2024-04-01T19:56:35.155 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:910bbc60:::benchmark_data_smithi188_161190_object37850:head# 2024-04-01T19:56:35.156 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:910beb33:::benchmark_data_smithi188_161190_object75861:head# 2024-04-01T19:56:35.156 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:910c5956:::benchmark_data_smithi188_161190_object85042:head# 2024-04-01T19:56:35.162 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:910d1ce2:::benchmark_data_smithi188_161190_object56942:head# 2024-04-01T19:56:35.162 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:910d3ba2:::benchmark_data_smithi188_161190_object76546:head# 2024-04-01T19:56:35.162 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:910dc3cf:::benchmark_data_smithi188_161190_object87799:head# 2024-04-01T19:56:35.162 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:910e432d:::benchmark_data_smithi188_161190_object100616:head# 2024-04-01T19:56:35.163 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:910e4c82:::benchmark_data_smithi188_161190_object129744:head# 2024-04-01T19:56:35.163 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91100ce3:::benchmark_data_smithi188_161190_object86173:head# 2024-04-01T19:56:35.163 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9111d684:::benchmark_data_smithi188_161190_object97683:head# 2024-04-01T19:56:35.163 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91125e68:::benchmark_data_smithi188_161190_object57216:head# 2024-04-01T19:56:35.163 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:911260ad:::benchmark_data_smithi188_161190_object56178:head# 2024-04-01T19:56:35.163 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91130e36:::benchmark_data_smithi188_161190_object84076:head# 2024-04-01T19:56:35.163 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9113989b:::benchmark_data_smithi188_161190_object125417:head# 2024-04-01T19:56:35.163 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9113d049:::benchmark_data_smithi188_161190_object116246:head# 2024-04-01T19:56:35.163 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9113e6b4:::benchmark_data_smithi188_161190_object130255:head# 2024-04-01T19:56:35.163 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9114999e:::benchmark_data_smithi188_161190_object124766:head# 2024-04-01T19:56:35.163 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9114ca97:::benchmark_data_smithi188_161190_object56361:head# 2024-04-01T19:56:35.164 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91153adf:::benchmark_data_smithi188_161190_object50886:head# 2024-04-01T19:56:35.164 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9115a146:::benchmark_data_smithi188_161190_object38810:head# 2024-04-01T19:56:35.164 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9115fd24:::benchmark_data_smithi188_161190_object103169:head# 2024-04-01T19:56:35.164 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9116b57f:::benchmark_data_smithi188_161190_object88586:head# 2024-04-01T19:56:35.165 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:911734da:::benchmark_data_smithi188_161190_object42607:head# 2024-04-01T19:56:35.165 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91174e22:::benchmark_data_smithi188_161190_object121555:head# 2024-04-01T19:56:35.165 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9117798f:::benchmark_data_smithi188_161190_object93428:head# 2024-04-01T19:56:35.166 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9117cc66:::benchmark_data_smithi188_161190_object78733:head# 2024-04-01T19:56:35.166 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9117d337:::benchmark_data_smithi188_161190_object121365:head# 2024-04-01T19:56:35.166 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91189029:::benchmark_data_smithi188_161190_object100872:head# 2024-04-01T19:56:35.167 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:911964e1:::benchmark_data_smithi188_161190_object112221:head# 2024-04-01T19:56:35.167 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91197b72:::benchmark_data_smithi188_161190_object65549:head# 2024-04-01T19:56:35.168 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9119934d:::benchmark_data_smithi188_161190_object70066:head# 2024-04-01T19:56:35.168 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:911a18d7:::benchmark_data_smithi188_161190_object41888:head# 2024-04-01T19:56:35.169 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:911b6979:::benchmark_data_smithi188_161190_object98253:head# 2024-04-01T19:56:35.173 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:911c3552:::benchmark_data_smithi188_161190_object129408:head# 2024-04-01T19:56:35.173 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:911cb339:::benchmark_data_smithi188_161190_object132762:head# 2024-04-01T19:56:35.173 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:911cda92:::benchmark_data_smithi188_161190_object37156:head# 2024-04-01T19:56:35.173 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:911df885:::benchmark_data_smithi188_161190_object77141:head# 2024-04-01T19:56:35.174 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:911e7d40:::benchmark_data_smithi188_161190_object74840:head# 2024-04-01T19:56:35.174 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:911eae2f:::benchmark_data_smithi188_161190_object128234:head# 2024-04-01T19:56:35.174 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:911eea2c:::benchmark_data_smithi188_161190_object91326:head# 2024-04-01T19:56:35.174 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:911fe448:::benchmark_data_smithi188_161190_object41377:head# 2024-04-01T19:56:35.174 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:911ff5d1:::benchmark_data_smithi188_161190_object109882:head# 2024-04-01T19:56:35.174 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9121b869:::benchmark_data_smithi188_161190_object41972:head# 2024-04-01T19:56:35.174 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9121ed48:::benchmark_data_smithi188_161190_object116496:head# 2024-04-01T19:56:35.175 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91228666:::benchmark_data_smithi188_161190_object81920:head# 2024-04-01T19:56:35.175 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9122b0a8:::benchmark_data_smithi188_161190_object39125:head# 2024-04-01T19:56:35.175 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:912361a6:::benchmark_data_smithi188_161190_object79351:head# 2024-04-01T19:56:35.175 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9123c782:::benchmark_data_smithi188_161190_object71630:head# 2024-04-01T19:56:35.176 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9125bb09:::benchmark_data_smithi188_161190_object42425:head# 2024-04-01T19:56:35.176 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91263a27:::benchmark_data_smithi188_161190_object95649:head# 2024-04-01T19:56:35.176 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91272c9e:::benchmark_data_smithi188_161190_object81080:head# 2024-04-01T19:56:35.177 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9127a7d2:::benchmark_data_smithi188_161190_object29755:head# 2024-04-01T19:56:35.177 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:912862aa:::benchmark_data_smithi188_161190_object29170:head# 2024-04-01T19:56:35.177 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:912993ce:::benchmark_data_smithi188_161190_object120276:head# 2024-04-01T19:56:35.178 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:912acb9f:::benchmark_data_smithi188_161190_object29149:head# 2024-04-01T19:56:35.178 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:912adfe6:::benchmark_data_smithi188_161190_object103319:head# 2024-04-01T19:56:35.178 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:912b30e0:::benchmark_data_smithi188_161190_object65095:head# 2024-04-01T19:56:35.179 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:912c22f3:::benchmark_data_smithi188_161190_object82139:head# 2024-04-01T19:56:35.179 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:912d0bf9:::benchmark_data_smithi188_161190_object127343:head# 2024-04-01T19:56:35.183 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:912dbcbb:::benchmark_data_smithi188_161190_object69378:head# 2024-04-01T19:56:35.184 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:912f0772:::benchmark_data_smithi188_161190_object34671:head# 2024-04-01T19:56:35.184 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91303bcf:::benchmark_data_smithi188_161190_object53846:head# 2024-04-01T19:56:35.185 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91309169:::benchmark_data_smithi188_161190_object49344:head# 2024-04-01T19:56:35.185 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91313fef:::benchmark_data_smithi188_161190_object111519:head# 2024-04-01T19:56:35.186 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9131f9a2:::benchmark_data_smithi188_161190_object115205:head# 2024-04-01T19:56:35.186 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9132831a:::benchmark_data_smithi188_161190_object46767:head# 2024-04-01T19:56:35.186 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9133c2e7:::benchmark_data_smithi188_161190_object136472:head# 2024-04-01T19:56:35.187 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9133ea1e:::benchmark_data_smithi188_161190_object118902:head# 2024-04-01T19:56:35.188 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91345c13:::benchmark_data_smithi188_161190_object72965:head# 2024-04-01T19:56:35.188 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91349ddd:::benchmark_data_smithi188_161190_object134429:head# 2024-04-01T19:56:35.188 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9134d885:::benchmark_data_smithi188_161190_object30943:head# 2024-04-01T19:56:35.189 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9135379e:::benchmark_data_smithi188_161190_object57134:head# 2024-04-01T19:56:35.189 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91362b1a:::benchmark_data_smithi188_161190_object89504:head# 2024-04-01T19:56:35.189 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9136782e:::benchmark_data_smithi188_161190_object42742:head# 2024-04-01T19:56:35.190 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91370847:::benchmark_data_smithi188_161190_object39042:head# 2024-04-01T19:56:35.190 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9138867e:::benchmark_data_smithi188_161190_object71985:head# 2024-04-01T19:56:35.191 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9139406b:::benchmark_data_smithi188_161190_object98909:head# 2024-04-01T19:56:35.191 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:913980a8:::benchmark_data_smithi188_161190_object103263:head# 2024-04-01T19:56:35.192 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:56:35.192 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9139c339:::benchmark_data_smithi188_161190_object53582:head# 2024-04-01T19:56:35.192 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:913be3c9:::benchmark_data_smithi188_161190_object51626:head# 2024-04-01T19:56:35.193 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:913c9e62:::benchmark_data_smithi188_161190_object43794:head# 2024-04-01T19:56:35.193 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:913cacbc:::benchmark_data_smithi188_161190_object48913:head# 2024-04-01T19:56:35.194 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:913cc0a6:::benchmark_data_smithi188_161190_object95362:head# 2024-04-01T19:56:35.194 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:913d6245:::benchmark_data_smithi188_161190_object71533:head# 2024-04-01T19:56:35.196 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:913d630a:::benchmark_data_smithi188_161190_object76003:head# 2024-04-01T19:56:35.196 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:913d7152:::benchmark_data_smithi188_161190_object119739:head# 2024-04-01T19:56:35.196 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:913de72d:::benchmark_data_smithi188_161190_object79771:head# 2024-04-01T19:56:35.197 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:913e2ff5:::benchmark_data_smithi188_161190_object72331:head# 2024-04-01T19:56:35.197 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:913e78af:::benchmark_data_smithi188_161190_object113958:head# 2024-04-01T19:56:35.201 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:913ed14b:::benchmark_data_smithi188_161190_object104622:head# 2024-04-01T19:56:35.201 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:913fc56f:::benchmark_data_smithi188_161190_object86933:head# 2024-04-01T19:56:35.201 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91401a0c:::benchmark_data_smithi188_161190_object80728:head# 2024-04-01T19:56:35.201 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91406a4e:::benchmark_data_smithi188_161190_object41809:head# 2024-04-01T19:56:35.202 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9141e2bf:::benchmark_data_smithi188_161190_object56946:head# 2024-04-01T19:56:35.202 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91422e1b:::benchmark_data_smithi188_161190_object58148:head# 2024-04-01T19:56:35.202 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9142363e:::benchmark_data_smithi188_161190_object117981:head# 2024-04-01T19:56:35.202 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9142a00f:::benchmark_data_smithi188_161190_object61505:head# 2024-04-01T19:56:35.202 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91432265:::benchmark_data_smithi188_161190_object71694:head# 2024-04-01T19:56:35.203 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9144d006:::benchmark_data_smithi188_161190_object42717:head# 2024-04-01T19:56:35.203 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91452424:::benchmark_data_smithi188_161190_object22684:head# 2024-04-01T19:56:35.203 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9145e09d:::benchmark_data_smithi188_161190_object134701:head# 2024-04-01T19:56:35.203 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:914637b9:::benchmark_data_smithi188_161190_object19963:head# 2024-04-01T19:56:35.204 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91466f1e:::benchmark_data_smithi188_161190_object93737:head# 2024-04-01T19:56:35.204 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91469cc4:::benchmark_data_smithi188_161190_object76801:head# 2024-04-01T19:56:35.204 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9148e61d:::benchmark_data_smithi188_161190_object65268:head# 2024-04-01T19:56:35.205 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:914a42ac:::benchmark_data_smithi188_161190_object136180:head# 2024-04-01T19:56:35.205 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:914adc2b:::benchmark_data_smithi188_161190_object23464:head# 2024-04-01T19:56:35.206 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:914b651d:::benchmark_data_smithi188_161190_object130630:head# 2024-04-01T19:56:35.206 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:914b8a57:::benchmark_data_smithi188_161190_object20458:head# 2024-04-01T19:56:35.207 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:914bdde9:::benchmark_data_smithi188_161190_object134597:head# 2024-04-01T19:56:35.208 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:914e60c8:::benchmark_data_smithi188_161190_object52056:head# 2024-04-01T19:56:35.208 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:914f7b3c:::benchmark_data_smithi188_161190_object26555:head# 2024-04-01T19:56:35.209 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:914f9d2f:::benchmark_data_smithi188_161190_object118798:head# 2024-04-01T19:56:35.209 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:914fa7ce:::benchmark_data_smithi188_161190_object84725:head# 2024-04-01T19:56:35.211 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:914fc0d7:::benchmark_data_smithi188_161190_object136268:head# 2024-04-01T19:56:35.211 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91500d08:::benchmark_data_smithi188_161190_object98608:head# 2024-04-01T19:56:35.212 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:915067c5:::benchmark_data_smithi188_161190_object129167:head# 2024-04-01T19:56:35.212 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9150cfb6:::benchmark_data_smithi188_161190_object88474:head# 2024-04-01T19:56:35.212 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9150f0b0:::benchmark_data_smithi188_161190_object74556:head# 2024-04-01T19:56:35.212 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91510783:::benchmark_data_smithi188_161190_object86506:head# 2024-04-01T19:56:35.212 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:56:35.213 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91517729:::benchmark_data_smithi188_161190_object112893:head# 2024-04-01T19:56:35.213 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9153b06a:::benchmark_data_smithi188_161190_object55214:head# 2024-04-01T19:56:35.213 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9153d1f9:::benchmark_data_smithi188_161190_object47984:head# 2024-04-01T19:56:35.214 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:915572e2:::benchmark_data_smithi188_161190_object45260:head# 2024-04-01T19:56:35.214 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9156286c:::benchmark_data_smithi188_161190_object56323:head# 2024-04-01T19:56:35.214 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91566a3f:::benchmark_data_smithi188_161190_object128395:head# 2024-04-01T19:56:35.215 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9156bfa0:::benchmark_data_smithi188_161190_object136607:head# 2024-04-01T19:56:35.215 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9156cc52:::benchmark_data_smithi188_161190_object123219:head# 2024-04-01T19:56:35.216 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9156f1cb:::benchmark_data_smithi188_161190_object118166:head# 2024-04-01T19:56:35.216 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9157a873:::benchmark_data_smithi188_161190_object90671:head# 2024-04-01T19:56:35.217 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9157b23d:::benchmark_data_smithi188_161190_object56723:head# 2024-04-01T19:56:35.217 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9157ddb3:::benchmark_data_smithi188_161190_object51082:head# 2024-04-01T19:56:35.218 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91581aef:::benchmark_data_smithi188_161190_object66774:head# 2024-04-01T19:56:35.218 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:915861d9:::benchmark_data_smithi188_161190_object77759:head# 2024-04-01T19:56:35.218 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9158e784:::benchmark_data_smithi188_161190_object76757:head# 2024-04-01T19:56:35.219 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9159ae6c:::benchmark_data_smithi188_161190_object130498:head# 2024-04-01T19:56:35.219 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9159b006:::benchmark_data_smithi188_161190_object47054:head# 2024-04-01T19:56:35.220 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9159ce7c:::benchmark_data_smithi188_161190_object118631:head# 2024-04-01T19:56:35.220 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:915a9ccf:::benchmark_data_smithi188_161190_object98866:head# 2024-04-01T19:56:35.221 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:915a9fb9:::benchmark_data_smithi188_161190_object26426:head# 2024-04-01T19:56:35.221 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:915af76e:::benchmark_data_smithi188_161190_object102109:head# 2024-04-01T19:56:35.225 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:915c13b4:::benchmark_data_smithi188_161190_object135504:head# 2024-04-01T19:56:35.225 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:915c567c:::benchmark_data_smithi188_161190_object90419:head# 2024-04-01T19:56:35.225 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:915cd69b:::benchmark_data_smithi188_161190_object70467:head# 2024-04-01T19:56:35.225 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:915cf149:::benchmark_data_smithi188_161190_object129064:head# 2024-04-01T19:56:35.226 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:915d66a5:::benchmark_data_smithi188_161190_object94874:head# 2024-04-01T19:56:35.226 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:915e750b:::benchmark_data_smithi188_161190_object137885:head# 2024-04-01T19:56:35.226 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91614817:::benchmark_data_smithi188_161190_object91351:head# 2024-04-01T19:56:35.231 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91615507:::benchmark_data_smithi188_161190_object99326:head# 2024-04-01T19:56:35.231 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91634639:::benchmark_data_smithi188_161190_object35170:head# 2024-04-01T19:56:35.233 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:916423a7:::benchmark_data_smithi188_161190_object85854:head# 2024-04-01T19:56:35.234 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91645026:::benchmark_data_smithi188_161190_object81434:head# 2024-04-01T19:56:35.234 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91646960:::benchmark_data_smithi188_161190_object61893:head# 2024-04-01T19:56:35.235 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9164f9c9:::benchmark_data_smithi188_161190_object30088:head# 2024-04-01T19:56:35.235 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:916531f3:::benchmark_data_smithi188_161190_object73348:head# 2024-04-01T19:56:35.236 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9165d4a6:::benchmark_data_smithi188_161190_object54889:head# 2024-04-01T19:56:35.236 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9165dfdf:::benchmark_data_smithi188_161190_object22102:head# 2024-04-01T19:56:35.237 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:916681c6:::benchmark_data_smithi188_161190_object108751:head# 2024-04-01T19:56:35.237 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91671c81:::benchmark_data_smithi188_161190_object122506:head# 2024-04-01T19:56:35.237 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91679503:::benchmark_data_smithi188_161190_object108149:head# 2024-04-01T19:56:35.238 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91682c7d:::benchmark_data_smithi188_161190_object106114:head# 2024-04-01T19:56:35.239 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91695460:::benchmark_data_smithi188_161190_object133042:head# 2024-04-01T19:56:35.239 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:916a3783:::benchmark_data_smithi188_161190_object30223:head# 2024-04-01T19:56:35.239 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:916a71d3:::benchmark_data_smithi188_161190_object50795:head# 2024-04-01T19:56:35.240 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:916aa5c1:::benchmark_data_smithi188_161190_object38622:head# 2024-04-01T19:56:35.240 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:916bb798:::benchmark_data_smithi188_161190_object37270:head# 2024-04-01T19:56:35.245 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:916cb546:::benchmark_data_smithi188_161190_object33223:head# 2024-04-01T19:56:35.246 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:916cdb30:::benchmark_data_smithi188_161190_object118265:head# 2024-04-01T19:56:35.252 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:916d983f:::benchmark_data_smithi188_161190_object24300:head# 2024-04-01T19:56:35.252 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:916e34fc:::benchmark_data_smithi188_161190_object89949:head# 2024-04-01T19:56:35.253 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:916ec445:::benchmark_data_smithi188_161190_object63141:head# 2024-04-01T19:56:35.253 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:916f1ac5:::benchmark_data_smithi188_161190_object125754:head# 2024-04-01T19:56:35.253 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:916f5178:::benchmark_data_smithi188_161190_object132828:head# 2024-04-01T19:56:35.254 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:916f9964:::benchmark_data_smithi188_161190_object76017:head# 2024-04-01T19:56:35.254 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9170b313:::benchmark_data_smithi188_161190_object33133:head# 2024-04-01T19:56:35.255 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9170cc92:::benchmark_data_smithi188_161190_object102951:head# 2024-04-01T19:56:35.255 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9170fca7:::benchmark_data_smithi188_161190_object89964:head# 2024-04-01T19:56:35.255 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91713b40:::benchmark_data_smithi188_161190_object34563:head# 2024-04-01T19:56:35.256 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91728422:::benchmark_data_smithi188_161190_object41029:head# 2024-04-01T19:56:35.256 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9172bfc3:::benchmark_data_smithi188_161190_object106669:head# 2024-04-01T19:56:35.257 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9172f7f9:::benchmark_data_smithi188_161190_object122061:head# 2024-04-01T19:56:35.259 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9174561c:::benchmark_data_smithi188_161190_object54848:head# 2024-04-01T19:56:35.260 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91754561:::benchmark_data_smithi188_161190_object77406:head# 2024-04-01T19:56:35.260 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9175e900:::benchmark_data_smithi188_161190_object30587:head# 2024-04-01T19:56:35.261 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9175fe5f:::benchmark_data_smithi188_161190_object64777:head# 2024-04-01T19:56:35.261 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91772800:::benchmark_data_smithi188_161190_object39782:head# 2024-04-01T19:56:35.262 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:35.263 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91777c7a:::benchmark_data_smithi188_161190_object38841:head# 2024-04-01T19:56:35.263 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:917810c9:::benchmark_data_smithi188_161190_object68851:head# 2024-04-01T19:56:35.263 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9178363d:::benchmark_data_smithi188_161190_object123103:head# 2024-04-01T19:56:35.263 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:917961c3:::benchmark_data_smithi188_161190_object31526:head# 2024-04-01T19:56:35.264 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91797d42:::benchmark_data_smithi188_161190_object38098:head# 2024-04-01T19:56:35.264 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:917ab70f:::benchmark_data_smithi188_161190_object35736:head# 2024-04-01T19:56:35.264 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:917aedfc:::benchmark_data_smithi188_161190_object47111:head# 2024-04-01T19:56:35.265 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:917bc01e:::benchmark_data_smithi188_161190_object118710:head# 2024-04-01T19:56:35.265 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:917c8a4d:::benchmark_data_smithi188_161190_object109683:head# 2024-04-01T19:56:35.266 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:917d0e86:::benchmark_data_smithi188_161190_object128701:head# 2024-04-01T19:56:35.266 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:917de606:::benchmark_data_smithi188_161190_object123113:head# 2024-04-01T19:56:35.267 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:917efd9d:::benchmark_data_smithi188_161190_object56378:head# 2024-04-01T19:56:35.267 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:917f4a4f:::benchmark_data_smithi188_161190_object40746:head# 2024-04-01T19:56:35.267 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:917f8438:::benchmark_data_smithi188_161190_object62213:head# 2024-04-01T19:56:35.268 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:917fb1c8:::benchmark_data_smithi188_161190_object66668:head# 2024-04-01T19:56:35.268 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91806fde:::benchmark_data_smithi188_161190_object112420:head# 2024-04-01T19:56:35.269 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91808a77:::benchmark_data_smithi188_161190_object49807:head# 2024-04-01T19:56:35.269 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9181cbe1:::benchmark_data_smithi188_161190_object126996:head# 2024-04-01T19:56:35.269 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91825416:::benchmark_data_smithi188_161190_object104999:head# 2024-04-01T19:56:35.270 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9182a59d:::benchmark_data_smithi188_161190_object113381:head# 2024-04-01T19:56:35.273 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9182aa99:::benchmark_data_smithi188_161190_object48701:head# 2024-04-01T19:56:35.273 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9182d8bb:::benchmark_data_smithi188_161190_object124075:head# 2024-04-01T19:56:35.274 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91830671:::benchmark_data_smithi188_161190_object119474:head# 2024-04-01T19:56:35.274 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91847a79:::benchmark_data_smithi188_161190_object30036:head# 2024-04-01T19:56:35.275 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9185ce7d:::benchmark_data_smithi188_161190_object29271:head# 2024-04-01T19:56:35.275 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9185f329:::benchmark_data_smithi188_161190_object128994:head# 2024-04-01T19:56:35.276 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9185fa79:::benchmark_data_smithi188_161190_object126776:head# 2024-04-01T19:56:35.276 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:918613be:::benchmark_data_smithi188_161190_object97827:head# 2024-04-01T19:56:35.278 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91864d42:::benchmark_data_smithi188_161190_object119495:head# 2024-04-01T19:56:35.278 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:918710a1:::benchmark_data_smithi188_161190_object121078:head# 2024-04-01T19:56:35.278 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9187e4bf:::benchmark_data_smithi188_161190_object36482:head# 2024-04-01T19:56:35.278 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91881167:::benchmark_data_smithi188_161190_object63861:head# 2024-04-01T19:56:35.281 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91897e0e:::benchmark_data_smithi188_161190_object135109:head# 2024-04-01T19:56:35.281 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:918aebfb:::benchmark_data_smithi188_161190_object78650:head# 2024-04-01T19:56:35.281 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:918c122c:::benchmark_data_smithi188_161190_object88130:head# 2024-04-01T19:56:35.281 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:918c6744:::benchmark_data_smithi188_161190_object89572:head# 2024-04-01T19:56:35.282 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:918d1d9f:::benchmark_data_smithi188_161190_object137302:head# 2024-04-01T19:56:35.282 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:918e3ccf:::benchmark_data_smithi188_161190_object59198:head# 2024-04-01T19:56:35.282 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:918f25d2:::benchmark_data_smithi188_161190_object38116:head# 2024-04-01T19:56:35.282 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:918fec68:::benchmark_data_smithi188_161190_object69883:head# 2024-04-01T19:56:35.282 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91911d92:::benchmark_data_smithi188_161190_object34460:head# 2024-04-01T19:56:35.283 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91914fc9:::benchmark_data_smithi188_161190_object122455:head# 2024-04-01T19:56:35.283 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91915cac:::benchmark_data_smithi188_161190_object33022:head# 2024-04-01T19:56:35.283 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:919363e5:::benchmark_data_smithi188_161190_object57987:head# 2024-04-01T19:56:35.284 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:919381f0:::benchmark_data_smithi188_161190_object55838:head# 2024-04-01T19:56:35.284 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91946428:::benchmark_data_smithi188_161190_object129372:head# 2024-04-01T19:56:35.285 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9194cdaf:::benchmark_data_smithi188_161190_object57822:head# 2024-04-01T19:56:35.285 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9194ce2d:::benchmark_data_smithi188_161190_object106387:head# 2024-04-01T19:56:35.286 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9195e75f:::benchmark_data_smithi188_161190_object63287:head# 2024-04-01T19:56:35.286 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91964553:::benchmark_data_smithi188_161190_object39482:head# 2024-04-01T19:56:35.287 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9196bc8d:::benchmark_data_smithi188_161190_object100420:head# 2024-04-01T19:56:35.287 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9196e4c6:::benchmark_data_smithi188_161190_object37746:head# 2024-04-01T19:56:35.287 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:919800b7:::benchmark_data_smithi188_161190_object35427:head# 2024-04-01T19:56:35.288 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91981cd6:::benchmark_data_smithi188_161190_object62240:head# 2024-04-01T19:56:35.288 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91983610:::benchmark_data_smithi188_161190_object99319:head# 2024-04-01T19:56:35.289 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91984195:::benchmark_data_smithi188_161190_object103110:head# 2024-04-01T19:56:35.290 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91989378:::benchmark_data_smithi188_161190_object77145:head# 2024-04-01T19:56:35.291 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:919a5294:::benchmark_data_smithi188_161190_object136447:head# 2024-04-01T19:56:35.291 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:919bb492:::benchmark_data_smithi188_161190_object126572:head# 2024-04-01T19:56:35.291 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:919c220f:::benchmark_data_smithi188_161190_object95453:head# 2024-04-01T19:56:35.291 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:919c6f65:::benchmark_data_smithi188_161190_object35504:head# 2024-04-01T19:56:35.291 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:919d7e8d:::benchmark_data_smithi188_161190_object66981:head# 2024-04-01T19:56:35.292 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:919dd337:::benchmark_data_smithi188_161190_object137458:head# 2024-04-01T19:56:35.294 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:919e0f3d:::benchmark_data_smithi188_161190_object115813:head# 2024-04-01T19:56:35.294 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:919e1922:::benchmark_data_smithi188_161190_object105275:head# 2024-04-01T19:56:35.294 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:919e5ac5:::benchmark_data_smithi188_161190_object39277:head# 2024-04-01T19:56:35.294 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:919efad2:::benchmark_data_smithi188_161190_object31669:head# 2024-04-01T19:56:35.294 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:919f684b:::benchmark_data_smithi188_161190_object32778:head# 2024-04-01T19:56:35.295 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:919fafbb:::benchmark_data_smithi188_161190_object86321:head# 2024-04-01T19:56:35.295 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91a035c9:::benchmark_data_smithi188_161190_object81506:head# 2024-04-01T19:56:35.296 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91a2199f:::benchmark_data_smithi188_161190_object33708:head# 2024-04-01T19:56:35.296 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91a398b9:::benchmark_data_smithi188_161190_object102196:head# 2024-04-01T19:56:35.297 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91a49c03:::benchmark_data_smithi188_161190_object125367:head# 2024-04-01T19:56:35.297 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91a53207:::benchmark_data_smithi188_161190_object45283:head# 2024-04-01T19:56:35.297 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91a6a581:::benchmark_data_smithi188_161190_object94925:head# 2024-04-01T19:56:35.298 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91a836ec:::benchmark_data_smithi188_161190_object79238:head# 2024-04-01T19:56:35.299 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91a8b2ec:::benchmark_data_smithi188_161190_object78921:head# 2024-04-01T19:56:35.299 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91a90080:::benchmark_data_smithi188_161190_object70347:head# 2024-04-01T19:56:35.300 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91a908e0:::benchmark_data_smithi188_161190_object36431:head# 2024-04-01T19:56:35.300 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91a98248:::benchmark_data_smithi188_161190_object89212:head# 2024-04-01T19:56:35.300 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91a9be0d:::benchmark_data_smithi188_161190_object136700:head# 2024-04-01T19:56:35.301 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91aa03f4:::benchmark_data_smithi188_161190_object119426:head# 2024-04-01T19:56:35.301 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91aa4e0d:::benchmark_data_smithi188_161190_object21798:head# 2024-04-01T19:56:35.302 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91aaecc5:::benchmark_data_smithi188_161190_object99520:head# 2024-04-01T19:56:35.307 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91ac8a62:::benchmark_data_smithi188_161190_object101951:head# 2024-04-01T19:56:35.307 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91acaa4a:::benchmark_data_smithi188_161190_object110409:head# 2024-04-01T19:56:35.307 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91acc42c:::benchmark_data_smithi188_161190_object84579:head# 2024-04-01T19:56:35.307 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91ad2bf6:::benchmark_data_smithi188_161190_object66437:head# 2024-04-01T19:56:35.307 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91ae0d69:::benchmark_data_smithi188_161190_object122774:head# 2024-04-01T19:56:35.308 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91ae0df8:::benchmark_data_smithi188_161190_object91032:head# 2024-04-01T19:56:35.308 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91aee27f:::benchmark_data_smithi188_161190_object80513:head# 2024-04-01T19:56:35.308 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91af0b88:::benchmark_data_smithi188_161190_object29131:head# 2024-04-01T19:56:35.308 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91afc76b:::benchmark_data_smithi188_161190_object38401:head# 2024-04-01T19:56:35.308 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91b1261d:::benchmark_data_smithi188_161190_object116307:head# 2024-04-01T19:56:35.308 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91b13f71:::benchmark_data_smithi188_161190_object101752:head# 2024-04-01T19:56:35.308 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91b1b46a:::benchmark_data_smithi188_161190_object130221:head# 2024-04-01T19:56:35.310 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:56:35.313 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91b21233:::benchmark_data_smithi188_161190_object95709:head# 2024-04-01T19:56:35.313 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91b34b12:::benchmark_data_smithi188_161190_object19919:head# 2024-04-01T19:56:35.313 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91b3f0de:::benchmark_data_smithi188_161190_object132427:head# 2024-04-01T19:56:35.313 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91b40840:::benchmark_data_smithi188_161190_object93647:head# 2024-04-01T19:56:35.313 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91b454b0:::benchmark_data_smithi188_161190_object138332:head# 2024-04-01T19:56:35.313 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91b465c1:::benchmark_data_smithi188_161190_object25445:head# 2024-04-01T19:56:35.313 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91b4b65e:::benchmark_data_smithi188_161190_object122234:head# 2024-04-01T19:56:35.313 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91b6018d:::benchmark_data_smithi188_161190_object109408:head# 2024-04-01T19:56:35.313 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91b62178:::benchmark_data_smithi188_161190_object38121:head# 2024-04-01T19:56:35.314 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91b7cfd5:::benchmark_data_smithi188_161190_object26735:head# 2024-04-01T19:56:35.318 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:35.318 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:56:35.319 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91b7ebff:::benchmark_data_smithi188_161190_object107237:head# 2024-04-01T19:56:35.320 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91b82c22:::benchmark_data_smithi188_161190_object27664:head# 2024-04-01T19:56:35.320 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91b88b28:::benchmark_data_smithi188_161190_object65390:head# 2024-04-01T19:56:35.321 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91ba713e:::benchmark_data_smithi188_161190_object35706:head# 2024-04-01T19:56:35.321 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91bb8959:::benchmark_data_smithi188_161190_object74459:head# 2024-04-01T19:56:35.321 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91bccfc6:::benchmark_data_smithi188_161190_object32358:head# 2024-04-01T19:56:35.322 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91bd16f5:::benchmark_data_smithi188_161190_object104808:head# 2024-04-01T19:56:35.322 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91bd64b8:::benchmark_data_smithi188_161190_object107460:head# 2024-04-01T19:56:35.323 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91be2388:::benchmark_data_smithi188_161190_object24264:head# 2024-04-01T19:56:35.323 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91be3269:::benchmark_data_smithi188_161190_object105633:head# 2024-04-01T19:56:35.323 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91be6159:::benchmark_data_smithi188_161190_object108331:head# 2024-04-01T19:56:35.324 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91bf2744:::benchmark_data_smithi188_161190_object138631:head# 2024-04-01T19:56:35.324 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91c13904:::benchmark_data_smithi188_161190_object83271:head# 2024-04-01T19:56:35.325 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91c1979c:::benchmark_data_smithi188_161190_object73473:head# 2024-04-01T19:56:35.326 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91c3d984:::benchmark_data_smithi188_161190_object68177:head# 2024-04-01T19:56:35.327 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91c3e16b:::benchmark_data_smithi188_161190_object73750:head# 2024-04-01T19:56:35.328 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91c4321d:::benchmark_data_smithi188_161190_object98802:head# 2024-04-01T19:56:35.328 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91c59ddb:::benchmark_data_smithi188_161190_object46898:head# 2024-04-01T19:56:35.329 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91c60c1b:::benchmark_data_smithi188_161190_object114028:head# 2024-04-01T19:56:35.329 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91c63c72:::benchmark_data_smithi188_161190_object31803:head# 2024-04-01T19:56:35.331 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91c6e412:::benchmark_data_smithi188_161190_object45508:head# 2024-04-01T19:56:35.335 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91c7306b:::benchmark_data_smithi188_161190_object107281:head# 2024-04-01T19:56:35.335 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91c770a9:::benchmark_data_smithi188_161190_object121973:head# 2024-04-01T19:56:35.335 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91c918c7:::benchmark_data_smithi188_161190_object41977:head# 2024-04-01T19:56:35.335 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91c91b08:::benchmark_data_smithi188_161190_object97876:head# 2024-04-01T19:56:35.335 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91c965d6:::benchmark_data_smithi188_161190_object45621:head# 2024-04-01T19:56:35.337 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91c9755c:::benchmark_data_smithi188_161190_object63132:head# 2024-04-01T19:56:35.338 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91c983e1:::benchmark_data_smithi188_161190_object24316:head# 2024-04-01T19:56:35.338 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91c9d405:::benchmark_data_smithi188_161190_object40341:head# 2024-04-01T19:56:35.339 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91c9fc2f:::benchmark_data_smithi188_161190_object119925:head# 2024-04-01T19:56:35.339 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91caf7de:::benchmark_data_smithi188_161190_object88555:head# 2024-04-01T19:56:35.340 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91cb8ba2:::benchmark_data_smithi188_161190_object97492:head# 2024-04-01T19:56:35.340 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91cc0a2e:::benchmark_data_smithi188_161190_object83006:head# 2024-04-01T19:56:35.342 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91cc0ed3:::benchmark_data_smithi188_161190_object102938:head# 2024-04-01T19:56:35.342 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91ccfe03:::benchmark_data_smithi188_161190_object70498:head# 2024-04-01T19:56:35.342 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91cdd6fc:::benchmark_data_smithi188_161190_object100001:head# 2024-04-01T19:56:35.342 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91ce5440:::benchmark_data_smithi188_161190_object27752:head# 2024-04-01T19:56:35.342 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91ce5640:::benchmark_data_smithi188_161190_object102962:head# 2024-04-01T19:56:35.343 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91cffd8f:::benchmark_data_smithi188_161190_object35081:head# 2024-04-01T19:56:35.343 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91d09697:::benchmark_data_smithi188_161190_object81873:head# 2024-04-01T19:56:35.344 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91d176b7:::benchmark_data_smithi188_161190_object64131:head# 2024-04-01T19:56:35.344 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91d1a7f1:::benchmark_data_smithi188_161190_object65164:head# 2024-04-01T19:56:35.346 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91d1adf9:::benchmark_data_smithi188_161190_object85433:head# 2024-04-01T19:56:35.347 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91d1d470:::benchmark_data_smithi188_161190_object109855:head# 2024-04-01T19:56:35.347 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91d29d64:::benchmark_data_smithi188_161190_object111180:head# 2024-04-01T19:56:35.348 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91d431c3:::benchmark_data_smithi188_161190_object60007:head# 2024-04-01T19:56:35.348 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91d461a2:::benchmark_data_smithi188_161190_object131713:head# 2024-04-01T19:56:35.348 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91d4e877:::benchmark_data_smithi188_161190_object33700:head# 2024-04-01T19:56:35.349 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91d4f022:::benchmark_data_smithi188_161190_object27954:head# 2024-04-01T19:56:35.349 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91d4f34a:::benchmark_data_smithi188_161190_object135067:head# 2024-04-01T19:56:35.352 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91d5a9b7:::benchmark_data_smithi188_161190_object108575:head# 2024-04-01T19:56:35.356 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91d6eab3:::benchmark_data_smithi188_161190_object129354:head# 2024-04-01T19:56:35.356 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91d73648:::benchmark_data_smithi188_161190_object137153:head# 2024-04-01T19:56:35.356 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91d7bb41:::benchmark_data_smithi188_161190_object41709:head# 2024-04-01T19:56:35.357 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91d7dd8e:::benchmark_data_smithi188_161190_object91943:head# 2024-04-01T19:56:35.357 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91d7df08:::benchmark_data_smithi188_161190_object112630:head# 2024-04-01T19:56:35.358 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91d7e6e0:::benchmark_data_smithi188_161190_object104559:head# 2024-04-01T19:56:35.358 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91d83de7:::benchmark_data_smithi188_161190_object109932:head# 2024-04-01T19:56:35.359 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91d87008:::benchmark_data_smithi188_161190_object101469:head# 2024-04-01T19:56:35.359 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91d90f9d:::benchmark_data_smithi188_161190_object24558:head# 2024-04-01T19:56:35.359 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91da1b01:::benchmark_data_smithi188_161190_object106248:head# 2024-04-01T19:56:35.360 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91da2af0:::benchmark_data_smithi188_161190_object52247:head# 2024-04-01T19:56:35.360 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91da538e:::benchmark_data_smithi188_161190_object79545:head# 2024-04-01T19:56:35.361 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91da9d82:::benchmark_data_smithi188_161190_object139017:head# 2024-04-01T19:56:35.366 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91dad483:::benchmark_data_smithi188_161190_object28265:head# 2024-04-01T19:56:35.366 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91db02bd:::benchmark_data_smithi188_161190_object95921:head# 2024-04-01T19:56:35.366 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91dbea4c:::benchmark_data_smithi188_161190_object121893:head# 2024-04-01T19:56:35.366 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91dc7a0b:::benchmark_data_smithi188_161190_object95582:head# 2024-04-01T19:56:35.366 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91dc83e0:::benchmark_data_smithi188_161190_object80442:head# 2024-04-01T19:56:35.366 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91ded734:::benchmark_data_smithi188_161190_object29185:head# 2024-04-01T19:56:35.366 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91dee15e:::benchmark_data_smithi188_161190_object32014:head# 2024-04-01T19:56:35.367 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91df2b7f:::benchmark_data_smithi188_161190_object116224:head# 2024-04-01T19:56:35.367 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91e01718:::benchmark_data_smithi188_161190_object67514:head# 2024-04-01T19:56:35.367 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91e0cbb6:::benchmark_data_smithi188_161190_object22151:head# 2024-04-01T19:56:35.367 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91e2084c:::benchmark_data_smithi188_161190_object34652:head# 2024-04-01T19:56:35.369 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91e2670d:::benchmark_data_smithi188_161190_object23331:head# 2024-04-01T19:56:35.372 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91e3450a:::benchmark_data_smithi188_161190_object26422:head# 2024-04-01T19:56:35.372 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91e37c1b:::benchmark_data_smithi188_161190_object84338:head# 2024-04-01T19:56:35.372 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91e4060c:::benchmark_data_smithi188_161190_object109160:head# 2024-04-01T19:56:35.373 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91e41481:::benchmark_data_smithi188_161190_object94027:head# 2024-04-01T19:56:35.373 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91e49893:::benchmark_data_smithi188_161190_object56304:head# 2024-04-01T19:56:35.374 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91e4cfca:::benchmark_data_smithi188_161190_object122227:head# 2024-04-01T19:56:35.374 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91e4f7b1:::benchmark_data_smithi188_161190_object113698:head# 2024-04-01T19:56:35.375 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91e515fc:::benchmark_data_smithi188_161190_object59630:head# 2024-04-01T19:56:35.375 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91e55730:::benchmark_data_smithi188_161190_object23705:head# 2024-04-01T19:56:35.376 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91e5670f:::benchmark_data_smithi188_161190_object130055:head# 2024-04-01T19:56:35.376 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91e5680d:::benchmark_data_smithi188_161190_object69142:head# 2024-04-01T19:56:35.376 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91e5d061:::benchmark_data_smithi188_161190_object70466:head# 2024-04-01T19:56:35.377 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91e60b51:::benchmark_data_smithi188_161190_object96843:head# 2024-04-01T19:56:35.377 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91e74088:::benchmark_data_smithi188_161190_object66455:head# 2024-04-01T19:56:35.378 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91e77efb:::benchmark_data_smithi188_161190_object95280:head# 2024-04-01T19:56:35.378 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91e86bd1:::benchmark_data_smithi188_161190_object59157:head# 2024-04-01T19:56:35.379 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91e92c92:::benchmark_data_smithi188_161190_object25122:head# 2024-04-01T19:56:35.380 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91e9c6f1:::benchmark_data_smithi188_161190_object28608:head# 2024-04-01T19:56:35.380 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91ea3a4e:::benchmark_data_smithi188_161190_object109362:head# 2024-04-01T19:56:35.381 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91ea516f:::benchmark_data_smithi188_161190_object53005:head# 2024-04-01T19:56:35.381 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91ea546c:::benchmark_data_smithi188_161190_object126835:head# 2024-04-01T19:56:35.381 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91ebdcd5:::benchmark_data_smithi188_161190_object112823:head# 2024-04-01T19:56:35.382 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91ecc669:::benchmark_data_smithi188_161190_object49175:head# 2024-04-01T19:56:35.382 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91ecfd6d:::benchmark_data_smithi188_161190_object53021:head# 2024-04-01T19:56:35.383 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91ee1ac7:::benchmark_data_smithi188_161190_object113254:head# 2024-04-01T19:56:35.383 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91ee232c:::benchmark_data_smithi188_161190_object130030:head# 2024-04-01T19:56:35.384 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91ee6e55:::benchmark_data_smithi188_161190_object105319:head# 2024-04-01T19:56:35.384 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91eeae61:::benchmark_data_smithi188_161190_object70272:head# 2024-04-01T19:56:35.385 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91ef3a41:::benchmark_data_smithi188_161190_object102649:head# 2024-04-01T19:56:35.385 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91ef7bf5:::benchmark_data_smithi188_161190_object112064:head# 2024-04-01T19:56:35.389 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91f046c1:::benchmark_data_smithi188_161190_object57220:head# 2024-04-01T19:56:35.389 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91f077fa:::benchmark_data_smithi188_161190_object125814:head# 2024-04-01T19:56:35.389 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91f0e4f5:::benchmark_data_smithi188_161190_object80046:head# 2024-04-01T19:56:35.389 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91f3456a:::benchmark_data_smithi188_161190_object40710:head# 2024-04-01T19:56:35.389 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91f382e0:::benchmark_data_smithi188_161190_object57733:head# 2024-04-01T19:56:35.390 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91f38925:::benchmark_data_smithi188_161190_object23086:head# 2024-04-01T19:56:35.390 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91f3919f:::benchmark_data_smithi188_161190_object81243:head# 2024-04-01T19:56:35.390 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91f554ec:::benchmark_data_smithi188_161190_object49912:head# 2024-04-01T19:56:35.390 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91f64274:::benchmark_data_smithi188_161190_object56426:head# 2024-04-01T19:56:35.394 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91f685a6:::benchmark_data_smithi188_161190_object20119:head# 2024-04-01T19:56:35.394 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91f6abc1:::benchmark_data_smithi188_161190_object63760:head# 2024-04-01T19:56:35.399 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91f709ec:::benchmark_data_smithi188_161190_object73877:head# 2024-04-01T19:56:35.399 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91f7dfa8:::benchmark_data_smithi188_161190_object56246:head# 2024-04-01T19:56:35.399 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91f8359f:::benchmark_data_smithi188_161190_object94988:head# 2024-04-01T19:56:35.399 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91f84313:::benchmark_data_smithi188_161190_object86241:head# 2024-04-01T19:56:35.400 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91fb4bde:::benchmark_data_smithi188_161190_object72598:head# 2024-04-01T19:56:35.400 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91fb5783:::benchmark_data_smithi188_161190_object101646:head# 2024-04-01T19:56:35.400 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91fbc425:::benchmark_data_smithi188_161190_object116235:head# 2024-04-01T19:56:35.400 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91fc4607:::benchmark_data_smithi188_161190_object82808:head# 2024-04-01T19:56:35.400 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91fc5c04:::benchmark_data_smithi188_161190_object32344:head# 2024-04-01T19:56:35.402 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91fca455:::benchmark_data_smithi188_161190_object75702:head# 2024-04-01T19:56:35.402 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91fd976f:::benchmark_data_smithi188_161190_object24754:head# 2024-04-01T19:56:35.402 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91ff1916:::benchmark_data_smithi188_161190_object43950:head# 2024-04-01T19:56:35.402 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:91ff514e:::benchmark_data_smithi188_161190_object134980:head# 2024-04-01T19:56:35.404 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92004385:::benchmark_data_smithi188_161190_object133316:head# 2024-04-01T19:56:35.404 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:920058d5:::benchmark_data_smithi188_161190_object94407:head# 2024-04-01T19:56:35.404 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9200dd95:::benchmark_data_smithi188_161190_object100592:head# 2024-04-01T19:56:35.405 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92020913:::benchmark_data_smithi188_161190_object97841:head# 2024-04-01T19:56:35.405 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92025ef7:::benchmark_data_smithi188_161190_object65525:head# 2024-04-01T19:56:35.405 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92026ddc:::benchmark_data_smithi188_161190_object116419:head# 2024-04-01T19:56:35.405 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9202c969:::benchmark_data_smithi188_161190_object78840:head# 2024-04-01T19:56:35.406 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9202eadd:::benchmark_data_smithi188_161190_object80922:head# 2024-04-01T19:56:35.406 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9204fc1e:::benchmark_data_smithi188_161190_object92560:head# 2024-04-01T19:56:35.406 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92057ad8:::benchmark_data_smithi188_161190_object133038:head# 2024-04-01T19:56:35.407 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9205cc0f:::benchmark_data_smithi188_161190_object45412:head# 2024-04-01T19:56:35.407 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:920611fb:::benchmark_data_smithi188_161190_object30116:head# 2024-04-01T19:56:35.408 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:920624dc:::benchmark_data_smithi188_161190_object80680:head# 2024-04-01T19:56:35.408 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92069a2f:::benchmark_data_smithi188_161190_object29904:head# 2024-04-01T19:56:35.409 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92069a51:::benchmark_data_smithi188_161190_object111389:head# 2024-04-01T19:56:35.409 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9206bc90:::benchmark_data_smithi188_161190_object114058:head# 2024-04-01T19:56:35.409 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92071eed:::benchmark_data_smithi188_161190_object100494:head# 2024-04-01T19:56:35.410 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92078735:::benchmark_data_smithi188_161190_object119784:head# 2024-04-01T19:56:35.410 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9208715f:::benchmark_data_smithi188_161190_object85532:head# 2024-04-01T19:56:35.411 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9208f34a:::benchmark_data_smithi188_161190_object106695:head# 2024-04-01T19:56:35.411 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9208f497:::benchmark_data_smithi188_161190_object30197:head# 2024-04-01T19:56:35.412 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:920a32ed:::benchmark_data_smithi188_161190_object126282:head# 2024-04-01T19:56:35.412 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:920acd1e:::benchmark_data_smithi188_161190_object129355:head# 2024-04-01T19:56:35.413 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:920b98b2:::benchmark_data_smithi188_161190_object66066:head# 2024-04-01T19:56:35.413 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:920bcc1b:::benchmark_data_smithi188_161190_object138047:head# 2024-04-01T19:56:35.414 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:920be2e6:::benchmark_data_smithi188_161190_object59462:head# 2024-04-01T19:56:35.419 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:56:35.420 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:920c248b:::benchmark_data_smithi188_161190_object91936:head# 2024-04-01T19:56:35.420 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:920ce902:::benchmark_data_smithi188_161190_object68759:head# 2024-04-01T19:56:35.420 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:920d6495:::benchmark_data_smithi188_161190_object82363:head# 2024-04-01T19:56:35.421 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:920e585f:::benchmark_data_smithi188_161190_object55754:head# 2024-04-01T19:56:35.421 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:920edefa:::benchmark_data_smithi188_161190_object89023:head# 2024-04-01T19:56:35.421 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:920fba26:::benchmark_data_smithi188_161190_object115142:head# 2024-04-01T19:56:35.421 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:920fe6ac:::benchmark_data_smithi188_161190_object68680:head# 2024-04-01T19:56:35.421 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:921028c1:::benchmark_data_smithi188_161190_object24809:head# 2024-04-01T19:56:35.421 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92104961:::benchmark_data_smithi188_161190_object40787:head# 2024-04-01T19:56:35.421 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9210d34b:::benchmark_data_smithi188_161190_object132882:head# 2024-04-01T19:56:35.421 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9210d6ec:::benchmark_data_smithi188_161190_object84766:head# 2024-04-01T19:56:35.421 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9211335e:::benchmark_data_smithi188_161190_object66538:head# 2024-04-01T19:56:35.421 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:921140f4:::benchmark_data_smithi188_161190_object61169:head# 2024-04-01T19:56:35.422 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92125763:::benchmark_data_smithi188_161190_object123289:head# 2024-04-01T19:56:35.423 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:921315e6:::benchmark_data_smithi188_161190_object38375:head# 2024-04-01T19:56:35.424 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9213c39b:::benchmark_data_smithi188_161190_object83828:head# 2024-04-01T19:56:35.424 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9213c50a:::benchmark_data_smithi188_161190_object66086:head# 2024-04-01T19:56:35.424 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9214872d:::benchmark_data_smithi188_161190_object90345:head# 2024-04-01T19:56:35.424 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92154c3a:::benchmark_data_smithi188_161190_object19766:head# 2024-04-01T19:56:35.425 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9215ba96:::benchmark_data_smithi188_161190_object128639:head# 2024-04-01T19:56:35.425 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92160f2b:::benchmark_data_smithi188_161190_object59450:head# 2024-04-01T19:56:35.426 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92165226:::benchmark_data_smithi188_161190_object84228:head# 2024-04-01T19:56:35.427 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92173bff:::benchmark_data_smithi188_161190_object104179:head# 2024-04-01T19:56:35.427 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92174294:::benchmark_data_smithi188_161190_object43462:head# 2024-04-01T19:56:35.427 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92180176:::benchmark_data_smithi188_161190_object129013:head# 2024-04-01T19:56:35.427 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92181f26:::benchmark_data_smithi188_161190_object64878:head# 2024-04-01T19:56:35.428 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9218ae99:::benchmark_data_smithi188_161190_object49785:head# 2024-04-01T19:56:35.428 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9218ef89:::benchmark_data_smithi188_161190_object91165:head# 2024-04-01T19:56:35.429 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:921aee1c:::benchmark_data_smithi188_161190_object103409:head# 2024-04-01T19:56:35.429 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:921af720:::benchmark_data_smithi188_161190_object74419:head# 2024-04-01T19:56:35.430 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:921b476f:::benchmark_data_smithi188_161190_object97338:head# 2024-04-01T19:56:35.430 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:921bf79d:::benchmark_data_smithi188_161190_object107913:head# 2024-04-01T19:56:35.430 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:921c292d:::benchmark_data_smithi188_161190_object80355:head# 2024-04-01T19:56:35.431 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:921d661a:::benchmark_data_smithi188_161190_object24396:head# 2024-04-01T19:56:35.431 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:921db3a9:::benchmark_data_smithi188_161190_object94215:head# 2024-04-01T19:56:35.437 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:921e9169:::benchmark_data_smithi188_161190_object125038:head# 2024-04-01T19:56:35.437 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:921eaf99:::benchmark_data_smithi188_161190_object101935:head# 2024-04-01T19:56:35.437 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:921f5971:::benchmark_data_smithi188_161190_object113955:head# 2024-04-01T19:56:35.437 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:921f7333:::benchmark_data_smithi188_161190_object91581:head# 2024-04-01T19:56:35.437 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92201f50:::benchmark_data_smithi188_161190_object104316:head# 2024-04-01T19:56:35.437 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92208ed9:::benchmark_data_smithi188_161190_object84652:head# 2024-04-01T19:56:35.437 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9221d5bc:::benchmark_data_smithi188_161190_object63800:head# 2024-04-01T19:56:35.437 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:922218d6:::benchmark_data_smithi188_161190_object40360:head# 2024-04-01T19:56:35.438 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:922219c6:::benchmark_data_smithi188_161190_object70773:head# 2024-04-01T19:56:35.443 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9222e4c7:::benchmark_data_smithi188_161190_object65795:head# 2024-04-01T19:56:35.443 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92243935:::benchmark_data_smithi188_161190_object65923:head# 2024-04-01T19:56:35.443 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9224905d:::benchmark_data_smithi188_161190_object96825:head# 2024-04-01T19:56:35.443 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9224f414:::benchmark_data_smithi188_161190_object55715:head# 2024-04-01T19:56:35.443 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92256296:::benchmark_data_smithi188_161190_object107045:head# 2024-04-01T19:56:35.443 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92284ca1:::benchmark_data_smithi188_161190_object69529:head# 2024-04-01T19:56:35.443 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9228ff49:::benchmark_data_smithi188_161190_object103269:head# 2024-04-01T19:56:35.444 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9229181a:::benchmark_data_smithi188_161190_object75956:head# 2024-04-01T19:56:35.444 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92295be2:::benchmark_data_smithi188_161190_object102855:head# 2024-04-01T19:56:35.444 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92295d4e:::benchmark_data_smithi188_161190_object137947:head# 2024-04-01T19:56:35.444 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92299308:::benchmark_data_smithi188_161190_object44077:head# 2024-04-01T19:56:35.444 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:922ab9d3:::benchmark_data_smithi188_161190_object50680:head# 2024-04-01T19:56:35.444 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:922b62b7:::benchmark_data_smithi188_161190_object102414:head# 2024-04-01T19:56:35.444 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:922bb640:::benchmark_data_smithi188_161190_object95205:head# 2024-04-01T19:56:35.445 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:922c5de4:::benchmark_data_smithi188_161190_object37407:head# 2024-04-01T19:56:35.445 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:922c8b08:::benchmark_data_smithi188_161190_object116013:head# 2024-04-01T19:56:35.445 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:922d2900:::benchmark_data_smithi188_161190_object42351:head# 2024-04-01T19:56:35.446 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:922d437c:::benchmark_data_smithi188_161190_object89074:head# 2024-04-01T19:56:35.446 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:922d4a76:::benchmark_data_smithi188_161190_object20484:head# 2024-04-01T19:56:35.447 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:922d980e:::benchmark_data_smithi188_161190_object113488:head# 2024-04-01T19:56:35.447 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:922de58f:::benchmark_data_smithi188_161190_object123628:head# 2024-04-01T19:56:35.448 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:922e3831:::benchmark_data_smithi188_161190_object90166:head# 2024-04-01T19:56:35.448 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:922e3e13:::benchmark_data_smithi188_161190_object106610:head# 2024-04-01T19:56:35.448 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:922e4c6b:::benchmark_data_smithi188_161190_object57795:head# 2024-04-01T19:56:35.449 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:922e8f44:::benchmark_data_smithi188_161190_object40102:head# 2024-04-01T19:56:35.449 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:922f59de:::benchmark_data_smithi188_161190_object113813:head# 2024-04-01T19:56:35.450 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:922ff81f:::benchmark_data_smithi188_161190_object137337:head# 2024-04-01T19:56:35.450 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9230b7ce:::benchmark_data_smithi188_161190_object64871:head# 2024-04-01T19:56:35.453 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92326c82:::benchmark_data_smithi188_161190_object75446:head# 2024-04-01T19:56:35.454 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:923281a7:::benchmark_data_smithi188_161190_object47465:head# 2024-04-01T19:56:35.454 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9234a8bd:::benchmark_data_smithi188_161190_object102643:head# 2024-04-01T19:56:35.454 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:923546f6:::benchmark_data_smithi188_161190_object98368:head# 2024-04-01T19:56:35.454 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:923613c9:::benchmark_data_smithi188_161190_object102580:head# 2024-04-01T19:56:35.454 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92366e7e:::benchmark_data_smithi188_161190_object111605:head# 2024-04-01T19:56:35.455 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9236e439:::benchmark_data_smithi188_161190_object57908:head# 2024-04-01T19:56:35.455 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9237bbaa:::benchmark_data_smithi188_161190_object129345:head# 2024-04-01T19:56:35.455 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9237dd40:::benchmark_data_smithi188_161190_object130694:head# 2024-04-01T19:56:35.455 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9238596e:::benchmark_data_smithi188_161190_object83068:head# 2024-04-01T19:56:35.460 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:923a7723:::benchmark_data_smithi188_161190_object20534:head# 2024-04-01T19:56:35.461 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:923ae506:::benchmark_data_smithi188_161190_object82417:head# 2024-04-01T19:56:35.461 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:923b16a6:::benchmark_data_smithi188_161190_object111936:head# 2024-04-01T19:56:35.463 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:923b7dda:::benchmark_data_smithi188_161190_object84025:head# 2024-04-01T19:56:35.463 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:923b8436:::benchmark_data_smithi188_161190_object26513:head# 2024-04-01T19:56:35.463 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:923bbeb1:::benchmark_data_smithi188_161190_object36253:head# 2024-04-01T19:56:35.463 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:923c3dd7:::benchmark_data_smithi188_161190_object123552:head# 2024-04-01T19:56:35.464 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:923c3f4d:::benchmark_data_smithi188_161190_object130476:head# 2024-04-01T19:56:35.464 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:923e79e6:::benchmark_data_smithi188_161190_object20502:head# 2024-04-01T19:56:35.465 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9240f52b:::benchmark_data_smithi188_161190_object52173:head# 2024-04-01T19:56:35.465 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:924117df:::benchmark_data_smithi188_161190_object47612:head# 2024-04-01T19:56:35.466 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92414b92:::benchmark_data_smithi188_161190_object39196:head# 2024-04-01T19:56:35.466 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9241531c:::benchmark_data_smithi188_161190_object46971:head# 2024-04-01T19:56:35.467 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:35.467 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:924207be:::benchmark_data_smithi188_161190_object53651:head# 2024-04-01T19:56:35.467 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:924287ef:::benchmark_data_smithi188_161190_object82613:head# 2024-04-01T19:56:35.470 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9242a632:::benchmark_data_smithi188_161190_object30710:head# 2024-04-01T19:56:35.470 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92438f4d:::benchmark_data_smithi188_161190_object57920:head# 2024-04-01T19:56:35.470 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9243a4ba:::benchmark_data_smithi188_161190_object33150:head# 2024-04-01T19:56:35.471 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9243d395:::benchmark_data_smithi188_161190_object40427:head# 2024-04-01T19:56:35.471 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9243dcb2:::benchmark_data_smithi188_161190_object135331:head# 2024-04-01T19:56:35.472 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9244bebb:::benchmark_data_smithi188_161190_object112691:head# 2024-04-01T19:56:35.472 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9244d1f5:::benchmark_data_smithi188_161190_object130378:head# 2024-04-01T19:56:35.472 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92450794:::benchmark_data_smithi188_161190_object84732:head# 2024-04-01T19:56:35.473 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92453035:::benchmark_data_smithi188_161190_object21618:head# 2024-04-01T19:56:35.473 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9246605a:::benchmark_data_smithi188_161190_object98682:head# 2024-04-01T19:56:35.474 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9246e910:::benchmark_data_smithi188_161190_object123883:head# 2024-04-01T19:56:35.474 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92477141:::benchmark_data_smithi188_161190_object131417:head# 2024-04-01T19:56:35.475 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9247c0e2:::benchmark_data_smithi188_161190_object46623:head# 2024-04-01T19:56:35.475 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9249177c:::benchmark_data_smithi188_161190_object48050:head# 2024-04-01T19:56:35.476 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9249ee81:::benchmark_data_smithi188_161190_object121926:head# 2024-04-01T19:56:35.476 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:924aefbe:::benchmark_data_smithi188_161190_object124985:head# 2024-04-01T19:56:35.477 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:924b30da:::benchmark_data_smithi188_161190_object125447:head# 2024-04-01T19:56:35.478 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:924bdc0b:::benchmark_data_smithi188_161190_object94992:head# 2024-04-01T19:56:35.478 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:924ce1f6:::benchmark_data_smithi188_161190_object119659:head# 2024-04-01T19:56:35.479 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:924d1aa7:::benchmark_data_smithi188_161190_object68924:head# 2024-04-01T19:56:35.479 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:924d51e2:::benchmark_data_smithi188_161190_object55914:head# 2024-04-01T19:56:35.479 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:924dd50f:::benchmark_data_smithi188_161190_object69849:head# 2024-04-01T19:56:35.479 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:924e25e9:::benchmark_data_smithi188_161190_object32811:head# 2024-04-01T19:56:35.480 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:924e4595:::benchmark_data_smithi188_161190_object23190:head# 2024-04-01T19:56:35.480 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:924e6d59:::benchmark_data_smithi188_161190_object125046:head# 2024-04-01T19:56:35.481 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:924edddb:::benchmark_data_smithi188_161190_object76734:head# 2024-04-01T19:56:35.481 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:924f48be:::benchmark_data_smithi188_161190_object116674:head# 2024-04-01T19:56:35.482 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:924f6db9:::benchmark_data_smithi188_161190_object69691:head# 2024-04-01T19:56:35.482 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:924fa556:::benchmark_data_smithi188_161190_object71305:head# 2024-04-01T19:56:35.483 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:924fb2b0:::benchmark_data_smithi188_161190_object33101:head# 2024-04-01T19:56:35.487 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:925018d9:::benchmark_data_smithi188_161190_object109363:head# 2024-04-01T19:56:35.487 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9250833b:::benchmark_data_smithi188_161190_object73748:head# 2024-04-01T19:56:35.488 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9250e9e6:::benchmark_data_smithi188_161190_object114123:head# 2024-04-01T19:56:35.488 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9251ba3c:::benchmark_data_smithi188_161190_object22347:head# 2024-04-01T19:56:35.488 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9251dc02:::benchmark_data_smithi188_161190_object37027:head# 2024-04-01T19:56:35.488 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92526132:::benchmark_data_smithi188_161190_object76789:head# 2024-04-01T19:56:35.488 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9252b8a9:::benchmark_data_smithi188_161190_object21519:head# 2024-04-01T19:56:35.491 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9252ec2f:::benchmark_data_smithi188_161190_object40055:head# 2024-04-01T19:56:35.491 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:925444b5:::benchmark_data_smithi188_161190_object135154:head# 2024-04-01T19:56:35.491 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:925508ec:::benchmark_data_smithi188_161190_object92943:head# 2024-04-01T19:56:35.492 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9255ac30:::benchmark_data_smithi188_161190_object49459:head# 2024-04-01T19:56:35.492 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9255df90:::benchmark_data_smithi188_161190_object28645:head# 2024-04-01T19:56:35.493 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92570887:::benchmark_data_smithi188_161190_object139221:head# 2024-04-01T19:56:35.493 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9258d20b:::benchmark_data_smithi188_161190_object41354:head# 2024-04-01T19:56:35.496 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9258e429:::benchmark_data_smithi188_161190_object73532:head# 2024-04-01T19:56:35.496 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9258e652:::benchmark_data_smithi188_161190_object23034:head# 2024-04-01T19:56:35.496 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:925958e9:::benchmark_data_smithi188_161190_object110219:head# 2024-04-01T19:56:35.496 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92595e5a:::benchmark_data_smithi188_161190_object98851:head# 2024-04-01T19:56:35.496 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9259997d:::benchmark_data_smithi188_161190_object114394:head# 2024-04-01T19:56:35.496 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:925b6d02:::benchmark_data_smithi188_161190_object82774:head# 2024-04-01T19:56:35.497 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:925bb71d:::benchmark_data_smithi188_161190_object122578:head# 2024-04-01T19:56:35.497 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:925c62a9:::benchmark_data_smithi188_161190_object41915:head# 2024-04-01T19:56:35.497 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:925cf66c:::benchmark_data_smithi188_161190_object71910:head# 2024-04-01T19:56:35.497 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:925d8689:::benchmark_data_smithi188_161190_object75000:head# 2024-04-01T19:56:35.498 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:925dc31e:::benchmark_data_smithi188_161190_object20655:head# 2024-04-01T19:56:35.498 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:925dcad5:::benchmark_data_smithi188_161190_object119568:head# 2024-04-01T19:56:35.499 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:925e1bb0:::benchmark_data_smithi188_161190_object62121:head# 2024-04-01T19:56:35.499 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:925e503c:::benchmark_data_smithi188_161190_object35286:head# 2024-04-01T19:56:35.501 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92603f38:::benchmark_data_smithi188_161190_object83809:head# 2024-04-01T19:56:35.501 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9260c15a:::benchmark_data_smithi188_161190_object135906:head# 2024-04-01T19:56:35.501 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:926186d2:::benchmark_data_smithi188_161190_object69531:head# 2024-04-01T19:56:35.502 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:926336dd:::benchmark_data_smithi188_161190_object111814:head# 2024-04-01T19:56:35.504 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9263fcf2:::benchmark_data_smithi188_161190_object85929:head# 2024-04-01T19:56:35.504 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9264634c:::benchmark_data_smithi188_161190_object128244:head# 2024-04-01T19:56:35.504 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92647ad0:::benchmark_data_smithi188_161190_object131056:head# 2024-04-01T19:56:35.505 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9264886f:::benchmark_data_smithi188_161190_object33887:head# 2024-04-01T19:56:35.505 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:926491fc:::benchmark_data_smithi188_161190_object47211:head# 2024-04-01T19:56:35.505 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9264a357:::benchmark_data_smithi188_161190_object26643:head# 2024-04-01T19:56:35.506 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:926518f5:::benchmark_data_smithi188_161190_object80551:head# 2024-04-01T19:56:35.506 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92653b0c:::benchmark_data_smithi188_161190_object95760:head# 2024-04-01T19:56:35.506 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92655d29:::benchmark_data_smithi188_161190_object62488:head# 2024-04-01T19:56:35.506 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:926563a6:::benchmark_data_smithi188_161190_object22219:head# 2024-04-01T19:56:35.507 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92660c13:::benchmark_data_smithi188_161190_object97996:head# 2024-04-01T19:56:35.507 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9266bf30:::benchmark_data_smithi188_161190_object104207:head# 2024-04-01T19:56:35.508 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92671277:::benchmark_data_smithi188_161190_object68000:head# 2024-04-01T19:56:35.508 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92680ee5:::benchmark_data_smithi188_161190_object62544:head# 2024-04-01T19:56:35.509 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:926837e1:::benchmark_data_smithi188_161190_object35016:head# 2024-04-01T19:56:35.509 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9268bc24:::benchmark_data_smithi188_161190_object59926:head# 2024-04-01T19:56:35.510 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9269184b:::benchmark_data_smithi188_161190_object37596:head# 2024-04-01T19:56:35.510 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:926a152b:::benchmark_data_smithi188_161190_object82059:head# 2024-04-01T19:56:35.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:35 smithi062 ceph-mon[44211]: 8.0 scrub starts 2024-04-01T19:56:35.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:35 smithi062 ceph-mon[44211]: pgmap v1881: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.9 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 541 op/s; 35418/226612 objects degraded (15.629%); 11 MiB/s, 171 objects/s recovering 2024-04-01T19:56:35.511 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:926a8f8e:::benchmark_data_smithi188_161190_object102868:head# 2024-04-01T19:56:35.511 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:926aa845:::benchmark_data_smithi188_161190_object108009:head# 2024-04-01T19:56:35.521 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:926bc27a:::benchmark_data_smithi188_161190_object93593:head# 2024-04-01T19:56:35.523 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:926bc9c0:::benchmark_data_smithi188_161190_object80244:head# 2024-04-01T19:56:35.528 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:926bcfad:::benchmark_data_smithi188_161190_object37349:head# 2024-04-01T19:56:35.528 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:926c1814:::benchmark_data_smithi188_161190_object54675:head# 2024-04-01T19:56:35.528 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:926d31aa:::benchmark_data_smithi188_161190_object130176:head# 2024-04-01T19:56:35.528 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:926d84ab:::benchmark_data_smithi188_161190_object29864:head# 2024-04-01T19:56:35.528 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:926d9b29:::benchmark_data_smithi188_161190_object87369:head# 2024-04-01T19:56:35.528 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:926eedf5:::benchmark_data_smithi188_161190_object99001:head# 2024-04-01T19:56:35.528 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92704f88:::benchmark_data_smithi188_161190_object32432:head# 2024-04-01T19:56:35.528 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9270fda2:::benchmark_data_smithi188_161190_object100307:head# 2024-04-01T19:56:35.528 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:927129f4:::benchmark_data_smithi188_161190_object35942:head# 2024-04-01T19:56:35.528 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92713ff4:::benchmark_data_smithi188_161190_object120289:head# 2024-04-01T19:56:35.529 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92727027:::benchmark_data_smithi188_161190_object93691:head# 2024-04-01T19:56:35.529 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9272f5eb:::benchmark_data_smithi188_161190_object37421:head# 2024-04-01T19:56:35.530 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9272fc4e:::benchmark_data_smithi188_161190_object85321:head# 2024-04-01T19:56:35.530 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9274663e:::benchmark_data_smithi188_161190_object102501:head# 2024-04-01T19:56:35.530 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92746b40:::benchmark_data_smithi188_161190_object21088:head# 2024-04-01T19:56:35.530 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92750c29:::benchmark_data_smithi188_161190_object76348:head# 2024-04-01T19:56:35.531 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:927586e2:::benchmark_data_smithi188_161190_object25634:head# 2024-04-01T19:56:35.531 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9275a9d0:::benchmark_data_smithi188_161190_object83837:head# 2024-04-01T19:56:35.532 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92764764:::benchmark_data_smithi188_161190_object95186:head# 2024-04-01T19:56:35.532 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9277f2bb:::benchmark_data_smithi188_161190_object75028:head# 2024-04-01T19:56:35.533 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9278ec14:::benchmark_data_smithi188_161190_object37937:head# 2024-04-01T19:56:35.533 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92790490:::benchmark_data_smithi188_161190_object106268:head# 2024-04-01T19:56:35.533 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:927964b8:::benchmark_data_smithi188_161190_object112188:head# 2024-04-01T19:56:35.534 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:927992d8:::benchmark_data_smithi188_161190_object108634:head# 2024-04-01T19:56:35.539 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9279e7d1:::benchmark_data_smithi188_161190_object53913:head# 2024-04-01T19:56:35.539 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:927b2342:::benchmark_data_smithi188_161190_object107110:head# 2024-04-01T19:56:35.539 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:927b5969:::benchmark_data_smithi188_161190_object48465:head# 2024-04-01T19:56:35.539 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:927b7363:::benchmark_data_smithi188_161190_object105329:head# 2024-04-01T19:56:35.540 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:927b7896:::benchmark_data_smithi188_161190_object47849:head# 2024-04-01T19:56:35.540 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:927b7e37:::benchmark_data_smithi188_161190_object84382:head# 2024-04-01T19:56:35.540 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:927c2e51:::benchmark_data_smithi188_161190_object90932:head# 2024-04-01T19:56:35.540 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:927c6abe:::benchmark_data_smithi188_161190_object96903:head# 2024-04-01T19:56:35.541 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:927c7a5a:::benchmark_data_smithi188_161190_object72530:head# 2024-04-01T19:56:35.541 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:927ce6ad:::benchmark_data_smithi188_161190_object109659:head# 2024-04-01T19:56:35.541 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:927d1a2b:::benchmark_data_smithi188_161190_object60123:head# 2024-04-01T19:56:35.543 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:927d5da2:::benchmark_data_smithi188_161190_object103307:head# 2024-04-01T19:56:35.543 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:927df318:::benchmark_data_smithi188_161190_object117231:head# 2024-04-01T19:56:35.543 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:927e4324:::benchmark_data_smithi188_161190_object129661:head# 2024-04-01T19:56:35.543 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:927e5a70:::benchmark_data_smithi188_161190_object33706:head# 2024-04-01T19:56:35.544 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:927e7c22:::benchmark_data_smithi188_161190_object36346:head# 2024-04-01T19:56:35.544 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:927face5:::benchmark_data_smithi188_161190_object138212:head# 2024-04-01T19:56:35.545 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:928050e4:::benchmark_data_smithi188_161190_object92775:head# 2024-04-01T19:56:35.545 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9280e23e:::benchmark_data_smithi188_161190_object41360:head# 2024-04-01T19:56:35.546 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:928240ed:::benchmark_data_smithi188_161190_object37000:head# 2024-04-01T19:56:35.546 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:928262ab:::benchmark_data_smithi188_161190_object65439:head# 2024-04-01T19:56:35.547 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:928274a9:::benchmark_data_smithi188_161190_object113339:head# 2024-04-01T19:56:35.547 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9282c41d:::benchmark_data_smithi188_161190_object87854:head# 2024-04-01T19:56:35.547 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:928332f3:::benchmark_data_smithi188_161190_object115572:head# 2024-04-01T19:56:35.548 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92836e27:::benchmark_data_smithi188_161190_object87452:head# 2024-04-01T19:56:35.548 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:928437c5:::benchmark_data_smithi188_161190_object51633:head# 2024-04-01T19:56:35.552 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92843f0c:::benchmark_data_smithi188_161190_object75343:head# 2024-04-01T19:56:35.553 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9284704e:::benchmark_data_smithi188_161190_object63498:head# 2024-04-01T19:56:35.553 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9286bb87:::benchmark_data_smithi188_161190_object54618:head# 2024-04-01T19:56:35.553 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9286d40e:::benchmark_data_smithi188_161190_object61517:head# 2024-04-01T19:56:35.553 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9286db54:::benchmark_data_smithi188_161190_object116586:head# 2024-04-01T19:56:35.553 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92882234:::benchmark_data_smithi188_161190_object89187:head# 2024-04-01T19:56:35.553 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92893867:::benchmark_data_smithi188_161190_object118538:head# 2024-04-01T19:56:35.556 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:928a556e:::benchmark_data_smithi188_161190_object135529:head# 2024-04-01T19:56:35.556 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:928a65ec:::benchmark_data_smithi188_161190_object126121:head# 2024-04-01T19:56:35.556 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:928b59b0:::benchmark_data_smithi188_161190_object44016:head# 2024-04-01T19:56:35.556 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:928b6c70:::benchmark_data_smithi188_161190_object121646:head# 2024-04-01T19:56:35.557 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:928c45f0:::benchmark_data_smithi188_161190_object116191:head# 2024-04-01T19:56:35.557 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:928c8239:::benchmark_data_smithi188_161190_object120406:head# 2024-04-01T19:56:35.558 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:928cc653:::benchmark_data_smithi188_161190_object86970:head# 2024-04-01T19:56:35.558 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:929001ae:::benchmark_data_smithi188_161190_object84504:head# 2024-04-01T19:56:35.559 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92905403:::benchmark_data_smithi188_161190_object108384:head# 2024-04-01T19:56:35.559 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9290cdb1:::benchmark_data_smithi188_161190_object73803:head# 2024-04-01T19:56:35.560 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9290d460:::benchmark_data_smithi188_161190_object72666:head# 2024-04-01T19:56:35.560 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:929146ef:::benchmark_data_smithi188_161190_object123934:head# 2024-04-01T19:56:35.560 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92917bb1:::benchmark_data_smithi188_161190_object74641:head# 2024-04-01T19:56:35.561 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92918314:::benchmark_data_smithi188_161190_object126397:head# 2024-04-01T19:56:35.561 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:929234b5:::benchmark_data_smithi188_161190_object99097:head# 2024-04-01T19:56:35.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92925054:::benchmark_data_smithi188_161190_object39109:head# 2024-04-01T19:56:35.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9292ed7d:::benchmark_data_smithi188_161190_object70712:head# 2024-04-01T19:56:35.563 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9292f0da:::benchmark_data_smithi188_161190_object60165:head# 2024-04-01T19:56:35.563 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92930a8f:::benchmark_data_smithi188_161190_object99411:head# 2024-04-01T19:56:35.564 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92935b2f:::benchmark_data_smithi188_161190_object45064:head# 2024-04-01T19:56:35.564 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92959399:::benchmark_data_smithi188_161190_object39707:head# 2024-04-01T19:56:35.564 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9295d34d:::benchmark_data_smithi188_161190_object32601:head# 2024-04-01T19:56:35.565 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92963fe5:::benchmark_data_smithi188_161190_object126803:head# 2024-04-01T19:56:35.565 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92968338:::benchmark_data_smithi188_161190_object23209:head# 2024-04-01T19:56:35.566 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9296986b:::benchmark_data_smithi188_161190_object88608:head# 2024-04-01T19:56:35.567 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9296c154:::benchmark_data_smithi188_161190_object35820:head# 2024-04-01T19:56:35.567 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9296d86b:::benchmark_data_smithi188_161190_object86773:head# 2024-04-01T19:56:35.572 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9297a81e:::benchmark_data_smithi188_161190_object132093:head# 2024-04-01T19:56:35.573 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:929927c1:::benchmark_data_smithi188_161190_object37326:head# 2024-04-01T19:56:35.573 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9299a3cb:::benchmark_data_smithi188_161190_object105431:head# 2024-04-01T19:56:35.574 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:929a4892:::benchmark_data_smithi188_161190_object80132:head# 2024-04-01T19:56:35.574 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:929a5783:::benchmark_data_smithi188_161190_object31828:head# 2024-04-01T19:56:35.575 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:929b5d21:::benchmark_data_smithi188_161190_object129228:head# 2024-04-01T19:56:35.578 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:929b6de4:::benchmark_data_smithi188_161190_object29677:head# 2024-04-01T19:56:35.579 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:929bab2e:::benchmark_data_smithi188_161190_object107061:head# 2024-04-01T19:56:35.579 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:929bd1fa:::benchmark_data_smithi188_161190_object42691:head# 2024-04-01T19:56:35.579 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:929cfb5d:::benchmark_data_smithi188_161190_object112864:head# 2024-04-01T19:56:35.579 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:929d324c:::benchmark_data_smithi188_161190_object99487:head# 2024-04-01T19:56:35.579 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:929da2dc:::benchmark_data_smithi188_161190_object134233:head# 2024-04-01T19:56:35.579 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:929dab04:::benchmark_data_smithi188_161190_object119475:head# 2024-04-01T19:56:35.579 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:929f606b:::benchmark_data_smithi188_161190_object116744:head# 2024-04-01T19:56:35.579 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:929f7663:::benchmark_data_smithi188_161190_object84348:head# 2024-04-01T19:56:35.580 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:929f92d8:::benchmark_data_smithi188_161190_object120777:head# 2024-04-01T19:56:35.580 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:929fbec2:::benchmark_data_smithi188_161190_object26363:head# 2024-04-01T19:56:35.580 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92a0a424:::benchmark_data_smithi188_161190_object49161:head# 2024-04-01T19:56:35.581 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92a0f2ed:::benchmark_data_smithi188_161190_object42324:head# 2024-04-01T19:56:35.581 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92a1421f:::benchmark_data_smithi188_161190_object97027:head# 2024-04-01T19:56:35.581 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92a1bb9c:::benchmark_data_smithi188_161190_object38331:head# 2024-04-01T19:56:35.582 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92a1ef6b:::benchmark_data_smithi188_161190_object117816:head# 2024-04-01T19:56:35.582 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92a27aac:::benchmark_data_smithi188_161190_object96731:head# 2024-04-01T19:56:35.583 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92a2d0b1:::benchmark_data_smithi188_161190_object51152:head# 2024-04-01T19:56:35.583 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92a37ef7:::benchmark_data_smithi188_161190_object54715:head# 2024-04-01T19:56:35.583 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92a3fa50:::benchmark_data_smithi188_161190_object41928:head# 2024-04-01T19:56:35.584 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92a47ba6:::benchmark_data_smithi188_161190_object121376:head# 2024-04-01T19:56:35.584 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92a4a748:::benchmark_data_smithi188_161190_object123797:head# 2024-04-01T19:56:35.585 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92a52a40:::benchmark_data_smithi188_161190_object60648:head# 2024-04-01T19:56:35.585 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92a58b2e:::benchmark_data_smithi188_161190_object136063:head# 2024-04-01T19:56:35.586 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92a66b47:::benchmark_data_smithi188_161190_object24937:head# 2024-04-01T19:56:35.586 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92a682fb:::benchmark_data_smithi188_161190_object34010:head# 2024-04-01T19:56:35.587 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92a76519:::benchmark_data_smithi188_161190_object101279:head# 2024-04-01T19:56:35.587 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92a81dde:::benchmark_data_smithi188_161190_object87704:head# 2024-04-01T19:56:35.588 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92a87128:::benchmark_data_smithi188_161190_object129305:head# 2024-04-01T19:56:35.588 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92a8e210:::benchmark_data_smithi188_161190_object60295:head# 2024-04-01T19:56:35.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92a919b6:::benchmark_data_smithi188_161190_object118198:head# 2024-04-01T19:56:35.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92aa52dd:::benchmark_data_smithi188_161190_object29044:head# 2024-04-01T19:56:35.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92aa850f:::benchmark_data_smithi188_161190_object37249:head# 2024-04-01T19:56:35.590 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92aa9423:::benchmark_data_smithi188_161190_object38352:head# 2024-04-01T19:56:35.591 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92aadeed:::benchmark_data_smithi188_161190_object97790:head# 2024-04-01T19:56:35.591 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92ab8799:::benchmark_data_smithi188_161190_object131573:head# 2024-04-01T19:56:35.591 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92ab8f40:::benchmark_data_smithi188_161190_object133990:head# 2024-04-01T19:56:35.592 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92abc7c8:::benchmark_data_smithi188_161190_object73343:head# 2024-04-01T19:56:35.592 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92ac88e5:::benchmark_data_smithi188_161190_object107433:head# 2024-04-01T19:56:35.593 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92ac8a86:::benchmark_data_smithi188_161190_object32863:head# 2024-04-01T19:56:35.593 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92ad08cf:::benchmark_data_smithi188_161190_object30990:head# 2024-04-01T19:56:35.593 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92ad1fdc:::benchmark_data_smithi188_161190_object60509:head# 2024-04-01T19:56:35.594 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92ad4a7a:::benchmark_data_smithi188_161190_object30922:head# 2024-04-01T19:56:35.596 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92ad5500:::benchmark_data_smithi188_161190_object117260:head# 2024-04-01T19:56:35.596 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92af2a63:::benchmark_data_smithi188_161190_object55672:head# 2024-04-01T19:56:35.597 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92af6e6e:::benchmark_data_smithi188_161190_object119477:head# 2024-04-01T19:56:35.597 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92af7fec:::benchmark_data_smithi188_161190_object124792:head# 2024-04-01T19:56:35.597 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92b0f2f7:::benchmark_data_smithi188_161190_object91003:head# 2024-04-01T19:56:35.597 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92b130d8:::benchmark_data_smithi188_161190_object62124:head# 2024-04-01T19:56:35.597 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92b15788:::benchmark_data_smithi188_161190_object47818:head# 2024-04-01T19:56:35.598 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92b20e4a:::benchmark_data_smithi188_161190_object87527:head# 2024-04-01T19:56:35.598 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92b24f0b:::benchmark_data_smithi188_161190_object48297:head# 2024-04-01T19:56:35.598 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92b2fa77:::benchmark_data_smithi188_161190_object116089:head# 2024-04-01T19:56:35.599 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92b4093f:::benchmark_data_smithi188_161190_object127770:head# 2024-04-01T19:56:35.599 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92b43c99:::benchmark_data_smithi188_161190_object24391:head# 2024-04-01T19:56:35.600 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92b44c4e:::benchmark_data_smithi188_161190_object54617:head# 2024-04-01T19:56:35.602 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92b4aca6:::benchmark_data_smithi188_161190_object130405:head# 2024-04-01T19:56:35.608 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92b4ed15:::benchmark_data_smithi188_161190_object119660:head# 2024-04-01T19:56:35.613 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92b58dfb:::benchmark_data_smithi188_161190_object82620:head# 2024-04-01T19:56:35.613 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92b591dc:::benchmark_data_smithi188_161190_object31558:head# 2024-04-01T19:56:35.613 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92b62541:::benchmark_data_smithi188_161190_object67549:head# 2024-04-01T19:56:35.615 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92b6edcf:::benchmark_data_smithi188_161190_object67336:head# 2024-04-01T19:56:35.616 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92b771e7:::benchmark_data_smithi188_161190_object68011:head# 2024-04-01T19:56:35.616 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92b7f503:::benchmark_data_smithi188_161190_object128223:head# 2024-04-01T19:56:35.616 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92b93e53:::benchmark_data_smithi188_161190_object55499:head# 2024-04-01T19:56:35.617 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92b9777a:::benchmark_data_smithi188_161190_object62993:head# 2024-04-01T19:56:35.617 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92b9f598:::benchmark_data_smithi188_161190_object50614:head# 2024-04-01T19:56:35.617 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92ba0c6b:::benchmark_data_smithi188_161190_object132022:head# 2024-04-01T19:56:35.621 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92babf85:::benchmark_data_smithi188_161190_object116000:head# 2024-04-01T19:56:35.621 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92bbb436:::benchmark_data_smithi188_161190_object101101:head# 2024-04-01T19:56:35.621 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92be095e:::benchmark_data_smithi188_161190_object130695:head# 2024-04-01T19:56:35.625 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92be4c8d:::benchmark_data_smithi188_161190_object120407:head# 2024-04-01T19:56:35.625 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92be7b44:::benchmark_data_smithi188_161190_object79581:head# 2024-04-01T19:56:35.625 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92bf6523:::benchmark_data_smithi188_161190_object110469:head# 2024-04-01T19:56:35.625 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92c05a99:::benchmark_data_smithi188_161190_object69889:head# 2024-04-01T19:56:35.625 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92c250b8:::benchmark_data_smithi188_161190_object50847:head# 2024-04-01T19:56:35.626 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92c2b43a:::benchmark_data_smithi188_161190_object94818:head# 2024-04-01T19:56:35.626 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92c2ebba:::benchmark_data_smithi188_161190_object128629:head# 2024-04-01T19:56:35.626 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92c3eac5:::benchmark_data_smithi188_161190_object21923:head# 2024-04-01T19:56:35.626 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92c413de:::benchmark_data_smithi188_161190_object40376:head# 2024-04-01T19:56:35.626 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92c46849:::benchmark_data_smithi188_161190_object24620:head# 2024-04-01T19:56:35.626 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92c4e56b:::benchmark_data_smithi188_161190_object85999:head# 2024-04-01T19:56:35.626 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92c50e85:::benchmark_data_smithi188_161190_object78877:head# 2024-04-01T19:56:35.626 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92c54a4a:::benchmark_data_smithi188_161190_object100651:head# 2024-04-01T19:56:35.626 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92c55013:::benchmark_data_smithi188_161190_object27573:head# 2024-04-01T19:56:35.627 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92c5a192:::benchmark_data_smithi188_161190_object43090:head# 2024-04-01T19:56:35.627 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92c5d100:::benchmark_data_smithi188_161190_object125170:head# 2024-04-01T19:56:35.627 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92c8283d:::benchmark_data_smithi188_161190_object129036:head# 2024-04-01T19:56:35.627 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92c8d600:::benchmark_data_smithi188_161190_object84949:head# 2024-04-01T19:56:35.627 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92c94f04:::benchmark_data_smithi188_161190_object41221:head# 2024-04-01T19:56:35.628 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92c9563a:::benchmark_data_smithi188_161190_object76748:head# 2024-04-01T19:56:35.628 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92c9e1b7:::benchmark_data_smithi188_161190_object106302:head# 2024-04-01T19:56:35.628 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92ca0681:::benchmark_data_smithi188_161190_object131246:head# 2024-04-01T19:56:35.629 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92cae266:::benchmark_data_smithi188_161190_object82898:head# 2024-04-01T19:56:35.629 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92cb2ba9:::benchmark_data_smithi188_161190_object37446:head# 2024-04-01T19:56:35.629 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92cb3bd0:::benchmark_data_smithi188_161190_object61841:head# 2024-04-01T19:56:35.630 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92cb4bcf:::benchmark_data_smithi188_161190_object27115:head# 2024-04-01T19:56:35.630 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92ccdc1e:::benchmark_data_smithi188_161190_object124506:head# 2024-04-01T19:56:35.631 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92ce8023:::benchmark_data_smithi188_161190_object39931:head# 2024-04-01T19:56:35.633 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92ce84c4:::benchmark_data_smithi188_161190_object43125:head# 2024-04-01T19:56:35.633 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92cf90ce:::benchmark_data_smithi188_161190_object123466:head# 2024-04-01T19:56:35.634 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92cfb9be:::benchmark_data_smithi188_161190_object32192:head# 2024-04-01T19:56:35.634 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92cffd81:::benchmark_data_smithi188_161190_object81729:head# 2024-04-01T19:56:35.634 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92d06833:::benchmark_data_smithi188_161190_object125532:head# 2024-04-01T19:56:35.635 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92d0a0b7:::benchmark_data_smithi188_161190_object49240:head# 2024-04-01T19:56:35.635 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92d0a232:::benchmark_data_smithi188_161190_object36750:head# 2024-04-01T19:56:35.636 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92d0b7f1:::benchmark_data_smithi188_161190_object77631:head# 2024-04-01T19:56:35.636 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92d0e161:::benchmark_data_smithi188_161190_object27474:head# 2024-04-01T19:56:35.637 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92d13467:::benchmark_data_smithi188_161190_object67065:head# 2024-04-01T19:56:35.637 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92d2994b:::benchmark_data_smithi188_161190_object53304:head# 2024-04-01T19:56:35.637 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92d2f5be:::benchmark_data_smithi188_161190_object32292:head# 2024-04-01T19:56:35.638 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92d30393:::benchmark_data_smithi188_161190_object116983:head# 2024-04-01T19:56:35.638 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92d35d82:::benchmark_data_smithi188_161190_object62136:head# 2024-04-01T19:56:35.639 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92d3d006:::benchmark_data_smithi188_161190_object65928:head# 2024-04-01T19:56:35.639 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92d4c046:::benchmark_data_smithi188_161190_object87504:head# 2024-04-01T19:56:35.640 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92d4dc52:::benchmark_data_smithi188_161190_object123299:head# 2024-04-01T19:56:35.640 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92d52c36:::benchmark_data_smithi188_161190_object40968:head# 2024-04-01T19:56:35.641 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92d6c1f4:::benchmark_data_smithi188_161190_object49441:head# 2024-04-01T19:56:35.641 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92d70897:::benchmark_data_smithi188_161190_object60738:head# 2024-04-01T19:56:35.642 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92d7a80c:::benchmark_data_smithi188_161190_object37711:head# 2024-04-01T19:56:35.642 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92d7fcaa:::benchmark_data_smithi188_161190_object108841:head# 2024-04-01T19:56:35.643 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92d801fe:::benchmark_data_smithi188_161190_object25523:head# 2024-04-01T19:56:35.643 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92d81e63:::benchmark_data_smithi188_161190_object28921:head# 2024-04-01T19:56:35.644 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92d897c0:::benchmark_data_smithi188_161190_object118968:head# 2024-04-01T19:56:35.644 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92d8b261:::benchmark_data_smithi188_161190_object22315:head# 2024-04-01T19:56:35.645 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92d8f47d:::benchmark_data_smithi188_161190_object54524:head# 2024-04-01T19:56:35.645 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92d96d16:::benchmark_data_smithi188_161190_object56222:head# 2024-04-01T19:56:35.645 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92da2347:::benchmark_data_smithi188_161190_object73308:head# 2024-04-01T19:56:35.646 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92da3004:::benchmark_data_smithi188_161190_object86477:head# 2024-04-01T19:56:35.646 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92daacd4:::benchmark_data_smithi188_161190_object136926:head# 2024-04-01T19:56:35.647 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92dacfbc:::benchmark_data_smithi188_161190_object51705:head# 2024-04-01T19:56:35.647 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92dbec73:::benchmark_data_smithi188_161190_object119485:head# 2024-04-01T19:56:35.648 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92dcea3b:::benchmark_data_smithi188_161190_object136581:head# 2024-04-01T19:56:35.648 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92de1533:::benchmark_data_smithi188_161190_object59302:head# 2024-04-01T19:56:35.649 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92dfd1ac:::benchmark_data_smithi188_161190_object49571:head# 2024-04-01T19:56:35.651 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92e002ce:::benchmark_data_smithi188_161190_object128667:head# 2024-04-01T19:56:35.652 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92e01a5d:::benchmark_data_smithi188_161190_object43096:head# 2024-04-01T19:56:35.652 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92e01d8a:::benchmark_data_smithi188_161190_object78424:head# 2024-04-01T19:56:35.653 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92e0d232:::benchmark_data_smithi188_161190_object96777:head# 2024-04-01T19:56:35.653 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92e1bf4a:::benchmark_data_smithi188_161190_object63334:head# 2024-04-01T19:56:35.654 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92e1f983:::benchmark_data_smithi188_161190_object65359:head# 2024-04-01T19:56:35.654 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92e20b85:::benchmark_data_smithi188_161190_object131499:head# 2024-04-01T19:56:35.654 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92e20d6b:::benchmark_data_smithi188_161190_object116883:head# 2024-04-01T19:56:35.655 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92e38c43:::benchmark_data_smithi188_161190_object127862:head# 2024-04-01T19:56:35.655 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92e3b00e:::benchmark_data_smithi188_161190_object120190:head# 2024-04-01T19:56:35.657 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92e4305c:::benchmark_data_smithi188_161190_object59807:head# 2024-04-01T19:56:35.657 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92e4b643:::benchmark_data_smithi188_161190_object41896:head# 2024-04-01T19:56:35.657 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92e57912:::benchmark_data_smithi188_161190_object86967:head# 2024-04-01T19:56:35.657 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92e5c046:::benchmark_data_smithi188_161190_object41356:head# 2024-04-01T19:56:35.658 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92e62d5a:::benchmark_data_smithi188_161190_object91086:head# 2024-04-01T19:56:35.658 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92e64e1e:::benchmark_data_smithi188_161190_object30585:head# 2024-04-01T19:56:35.660 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92e7601d:::benchmark_data_smithi188_161190_object124107:head# 2024-04-01T19:56:35.660 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92e7f911:::benchmark_data_smithi188_161190_object58921:head# 2024-04-01T19:56:35.660 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92e88d35:::benchmark_data_smithi188_161190_object26147:head# 2024-04-01T19:56:35.660 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92e8bbc4:::benchmark_data_smithi188_161190_object73360:head# 2024-04-01T19:56:35.660 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92e9a4a1:::benchmark_data_smithi188_161190_object133566:head# 2024-04-01T19:56:35.661 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92e9e7d5:::benchmark_data_smithi188_161190_object56252:head# 2024-04-01T19:56:35.661 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92ea24a3:::benchmark_data_smithi188_161190_object25384:head# 2024-04-01T19:56:35.661 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92ea65c2:::benchmark_data_smithi188_161190_object71505:head# 2024-04-01T19:56:35.662 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92eaef15:::benchmark_data_smithi188_161190_object134131:head# 2024-04-01T19:56:35.662 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92eb0ff9:::benchmark_data_smithi188_161190_object133919:head# 2024-04-01T19:56:35.662 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92eb1177:::benchmark_data_smithi188_161190_object126500:head# 2024-04-01T19:56:35.663 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92ebac1f:::benchmark_data_smithi188_161190_object101712:head# 2024-04-01T19:56:35.663 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92ed27ce:::benchmark_data_smithi188_161190_object56573:head# 2024-04-01T19:56:35.664 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92ed913d:::benchmark_data_smithi188_161190_object102258:head# 2024-04-01T19:56:35.665 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92ef40a7:::benchmark_data_smithi188_161190_object102183:head# 2024-04-01T19:56:35.666 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92ef5d49:::benchmark_data_smithi188_161190_object38670:head# 2024-04-01T19:56:35.666 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92efacfe:::benchmark_data_smithi188_161190_object86673:head# 2024-04-01T19:56:35.667 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92efc583:::benchmark_data_smithi188_161190_object50426:head# 2024-04-01T19:56:35.667 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f05baf:::benchmark_data_smithi188_161190_object118743:head# 2024-04-01T19:56:35.668 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f0b784:::benchmark_data_smithi188_161190_object47564:head# 2024-04-01T19:56:35.668 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f15829:::benchmark_data_smithi188_161190_object73991:head# 2024-04-01T19:56:35.668 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f1b9db:::benchmark_data_smithi188_161190_object68154:head# 2024-04-01T19:56:35.669 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f26ccc:::benchmark_data_smithi188_161190_object26884:head# 2024-04-01T19:56:35.670 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f28dcb:::benchmark_data_smithi188_161190_object64234:head# 2024-04-01T19:56:35.670 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f2f317:::benchmark_data_smithi188_161190_object91551:head# 2024-04-01T19:56:35.670 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f34d51:::benchmark_data_smithi188_161190_object66825:head# 2024-04-01T19:56:35.671 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f36451:::benchmark_data_smithi188_161190_object24612:head# 2024-04-01T19:56:35.675 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f36fcb:::benchmark_data_smithi188_161190_object107435:head# 2024-04-01T19:56:35.676 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f413e0:::benchmark_data_smithi188_161190_object127330:head# 2024-04-01T19:56:35.676 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f66430:::benchmark_data_smithi188_161190_object49297:head# 2024-04-01T19:56:35.677 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f6812b:::benchmark_data_smithi188_161190_object42412:head# 2024-04-01T19:56:35.677 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f7018a:::benchmark_data_smithi188_161190_object110368:head# 2024-04-01T19:56:35.678 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f745ca:::benchmark_data_smithi188_161190_object60310:head# 2024-04-01T19:56:35.678 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f7b35c:::benchmark_data_smithi188_161190_object105767:head# 2024-04-01T19:56:35.678 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f7ecfe:::benchmark_data_smithi188_161190_object135231:head# 2024-04-01T19:56:35.679 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f81a8b:::benchmark_data_smithi188_161190_object107561:head# 2024-04-01T19:56:35.679 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f83720:::benchmark_data_smithi188_161190_object126151:head# 2024-04-01T19:56:35.682 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f8c7b6:::benchmark_data_smithi188_161190_object45339:head# 2024-04-01T19:56:35.684 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f91cb9:::benchmark_data_smithi188_161190_object47021:head# 2024-04-01T19:56:35.684 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f92342:::benchmark_data_smithi188_161190_object72178:head# 2024-04-01T19:56:35.684 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f94669:::benchmark_data_smithi188_161190_object52043:head# 2024-04-01T19:56:35.685 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f97ed9:::benchmark_data_smithi188_161190_object56448:head# 2024-04-01T19:56:35.685 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f9a823:::benchmark_data_smithi188_161190_object38073:head# 2024-04-01T19:56:35.685 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92f9d4ff:::benchmark_data_smithi188_161190_object61022:head# 2024-04-01T19:56:35.685 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92fa2af3:::benchmark_data_smithi188_161190_object127275:head# 2024-04-01T19:56:35.685 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92fac8d8:::benchmark_data_smithi188_161190_object95308:head# 2024-04-01T19:56:35.685 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92fafac4:::benchmark_data_smithi188_161190_object35977:head# 2024-04-01T19:56:35.685 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92fafacb:::benchmark_data_smithi188_161190_object90362:head# 2024-04-01T19:56:35.685 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92fafd45:::benchmark_data_smithi188_161190_object96642:head# 2024-04-01T19:56:35.691 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92fc7e3a:::benchmark_data_smithi188_161190_object96909:head# 2024-04-01T19:56:35.691 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92fda225:::benchmark_data_smithi188_161190_object30826:head# 2024-04-01T19:56:35.691 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92fda2bb:::benchmark_data_smithi188_161190_object19985:head# 2024-04-01T19:56:35.691 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92fdf474:::benchmark_data_smithi188_161190_object58134:head# 2024-04-01T19:56:35.691 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92fe2633:::benchmark_data_smithi188_161190_object138214:head# 2024-04-01T19:56:35.691 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92fe7858:::benchmark_data_smithi188_161190_object61256:head# 2024-04-01T19:56:35.691 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92fe9c51:::benchmark_data_smithi188_161190_object38361:head# 2024-04-01T19:56:35.691 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92febdc5:::benchmark_data_smithi188_161190_object127079:head# 2024-04-01T19:56:35.692 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:92fed298:::benchmark_data_smithi188_161190_object53162:head# 2024-04-01T19:56:35.702 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:930051de:::benchmark_data_smithi188_161190_object52909:head# 2024-04-01T19:56:35.702 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:930179af:::benchmark_data_smithi188_161190_object37142:head# 2024-04-01T19:56:35.702 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93018596:::benchmark_data_smithi188_161190_object42470:head# 2024-04-01T19:56:35.702 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9301cfbb:::benchmark_data_smithi188_161190_object76992:head# 2024-04-01T19:56:35.703 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93021192:::benchmark_data_smithi188_161190_object93115:head# 2024-04-01T19:56:35.703 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93032da6:::benchmark_data_smithi188_161190_object67554:head# 2024-04-01T19:56:35.703 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9304032c:::benchmark_data_smithi188_161190_object69957:head# 2024-04-01T19:56:35.703 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9304dc82:::benchmark_data_smithi188_161190_object30069:head# 2024-04-01T19:56:35.703 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:930519f4:::benchmark_data_smithi188_161190_object131888:head# 2024-04-01T19:56:35.703 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93051df8:::benchmark_data_smithi188_161190_object43724:head# 2024-04-01T19:56:35.703 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93052806:::benchmark_data_smithi188_161190_object111001:head# 2024-04-01T19:56:35.703 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9305d682:::benchmark_data_smithi188_161190_object112118:head# 2024-04-01T19:56:35.703 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93074930:::benchmark_data_smithi188_161190_object31127:head# 2024-04-01T19:56:35.703 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9307befb:::benchmark_data_smithi188_161190_object75215:head# 2024-04-01T19:56:35.703 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9308e1d2:::benchmark_data_smithi188_161190_object126413:head# 2024-04-01T19:56:35.703 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93090a71:::benchmark_data_smithi188_161190_object23080:head# 2024-04-01T19:56:35.704 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:930a0716:::benchmark_data_smithi188_161190_object32715:head# 2024-04-01T19:56:35.704 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:930a4f8e:::benchmark_data_smithi188_161190_object106129:head# 2024-04-01T19:56:35.704 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:930b320d:::benchmark_data_smithi188_161190_object137394:head# 2024-04-01T19:56:35.704 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:930b5f8d:::benchmark_data_smithi188_161190_object63454:head# 2024-04-01T19:56:35.704 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:930b6a9d:::benchmark_data_smithi188_161190_object74992:head# 2024-04-01T19:56:35.704 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:930b885f:::benchmark_data_smithi188_161190_object117757:head# 2024-04-01T19:56:35.705 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:930cdece:::benchmark_data_smithi188_161190_object72702:head# 2024-04-01T19:56:35.705 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:930e9435:::benchmark_data_smithi188_161190_object56591:head# 2024-04-01T19:56:35.705 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:930ef669:::benchmark_data_smithi188_161190_object53216:head# 2024-04-01T19:56:35.705 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:930ef75b:::benchmark_data_smithi188_161190_object105047:head# 2024-04-01T19:56:35.705 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93101f10:::benchmark_data_smithi188_161190_object49197:head# 2024-04-01T19:56:35.705 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:931042dd:::benchmark_data_smithi188_161190_object95789:head# 2024-04-01T19:56:35.706 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9310bba1:::benchmark_data_smithi188_161190_object34744:head# 2024-04-01T19:56:35.706 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93115460:::benchmark_data_smithi188_161190_object45092:head# 2024-04-01T19:56:35.707 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93123579:::benchmark_data_smithi188_161190_object97341:head# 2024-04-01T19:56:35.707 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9312ec1c:::benchmark_data_smithi188_161190_object89021:head# 2024-04-01T19:56:35.708 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:931445d5:::benchmark_data_smithi188_161190_object82609:head# 2024-04-01T19:56:35.708 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93148722:::benchmark_data_smithi188_161190_object80897:head# 2024-04-01T19:56:35.710 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93149539:::benchmark_data_smithi188_161190_object95611:head# 2024-04-01T19:56:35.711 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9314f49a:::benchmark_data_smithi188_161190_object97360:head# 2024-04-01T19:56:35.711 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93153bea:::benchmark_data_smithi188_161190_object22303:head# 2024-04-01T19:56:35.712 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9318b87c:::benchmark_data_smithi188_161190_object68908:head# 2024-04-01T19:56:35.712 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9319c01e:::benchmark_data_smithi188_161190_object107716:head# 2024-04-01T19:56:35.713 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9319e56c:::benchmark_data_smithi188_161190_object57814:head# 2024-04-01T19:56:35.713 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:931a152f:::benchmark_data_smithi188_161190_object114612:head# 2024-04-01T19:56:35.714 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:931ac9b1:::benchmark_data_smithi188_161190_object26960:head# 2024-04-01T19:56:35.714 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:931af441:::benchmark_data_smithi188_161190_object94659:head# 2024-04-01T19:56:35.714 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:931b64d4:::benchmark_data_smithi188_161190_object134141:head# 2024-04-01T19:56:35.715 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:931bf879:::benchmark_data_smithi188_161190_object90607:head# 2024-04-01T19:56:35.715 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:931e6159:::benchmark_data_smithi188_161190_object118738:head# 2024-04-01T19:56:35.716 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:931efc01:::benchmark_data_smithi188_161190_object115362:head# 2024-04-01T19:56:35.716 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:931f8dd2:::benchmark_data_smithi188_161190_object122283:head# 2024-04-01T19:56:35.716 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9320050c:::benchmark_data_smithi188_161190_object133701:head# 2024-04-01T19:56:35.717 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93213fa2:::benchmark_data_smithi188_161190_object46986:head# 2024-04-01T19:56:35.717 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93215974:::benchmark_data_smithi188_161190_object109093:head# 2024-04-01T19:56:35.718 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9321a3f0:::benchmark_data_smithi188_161190_object42075:head# 2024-04-01T19:56:35.718 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93222261:::benchmark_data_smithi188_161190_object130256:head# 2024-04-01T19:56:35.719 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93224aa3:::benchmark_data_smithi188_161190_object40021:head# 2024-04-01T19:56:35.719 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93233fea:::benchmark_data_smithi188_161190_object93908:head# 2024-04-01T19:56:35.720 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93247cf9:::benchmark_data_smithi188_161190_object121593:head# 2024-04-01T19:56:35.720 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9324d8d1:::benchmark_data_smithi188_161190_object55966:head# 2024-04-01T19:56:35.721 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:932501ac:::benchmark_data_smithi188_161190_object55924:head# 2024-04-01T19:56:35.721 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93253198:::benchmark_data_smithi188_161190_object64303:head# 2024-04-01T19:56:35.722 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93256cbd:::benchmark_data_smithi188_161190_object108316:head# 2024-04-01T19:56:35.722 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9325ac4f:::benchmark_data_smithi188_161190_object37439:head# 2024-04-01T19:56:35.722 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9325d8a5:::benchmark_data_smithi188_161190_object109776:head# 2024-04-01T19:56:35.723 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9327a596:::benchmark_data_smithi188_161190_object82512:head# 2024-04-01T19:56:35.723 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9327abf1:::benchmark_data_smithi188_161190_object75263:head# 2024-04-01T19:56:35.724 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9327eefb:::benchmark_data_smithi188_161190_object43095:head# 2024-04-01T19:56:35.724 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9329bc99:::benchmark_data_smithi188_161190_object105942:head# 2024-04-01T19:56:35.725 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:932a19cd:::benchmark_data_smithi188_161190_object59218:head# 2024-04-01T19:56:35.725 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:932a1f9a:::benchmark_data_smithi188_161190_object137225:head# 2024-04-01T19:56:35.726 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:932b34b0:::benchmark_data_smithi188_161190_object53441:head# 2024-04-01T19:56:35.726 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:932b3e7c:::benchmark_data_smithi188_161190_object68527:head# 2024-04-01T19:56:35.726 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:932b97b8:::benchmark_data_smithi188_161190_object24462:head# 2024-04-01T19:56:35.727 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:932ca2ed:::benchmark_data_smithi188_161190_object76965:head# 2024-04-01T19:56:35.731 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:932cbaae:::benchmark_data_smithi188_161190_object66264:head# 2024-04-01T19:56:35.731 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:932d8238:::benchmark_data_smithi188_161190_object72528:head# 2024-04-01T19:56:35.731 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:932d9c83:::benchmark_data_smithi188_161190_object122603:head# 2024-04-01T19:56:35.731 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:932da1e0:::benchmark_data_smithi188_161190_object80207:head# 2024-04-01T19:56:35.732 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:932db5be:::benchmark_data_smithi188_161190_object116578:head# 2024-04-01T19:56:35.732 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:932e70a8:::benchmark_data_smithi188_161190_object44890:head# 2024-04-01T19:56:35.732 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:932e972f:::benchmark_data_smithi188_161190_object130388:head# 2024-04-01T19:56:35.732 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:932f0325:::benchmark_data_smithi188_161190_object94371:head# 2024-04-01T19:56:35.732 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:932f8f31:::benchmark_data_smithi188_161190_object47739:head# 2024-04-01T19:56:35.732 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9330060e:::benchmark_data_smithi188_161190_object131398:head# 2024-04-01T19:56:35.733 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9330d7e5:::benchmark_data_smithi188_161190_object132017:head# 2024-04-01T19:56:35.733 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9331300f:::benchmark_data_smithi188_161190_object139190:head# 2024-04-01T19:56:35.734 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:933211f8:::benchmark_data_smithi188_161190_object137443:head# 2024-04-01T19:56:35.735 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9332599b:::benchmark_data_smithi188_161190_object112253:head# 2024-04-01T19:56:35.735 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9332e2b6:::benchmark_data_smithi188_161190_object116425:head# 2024-04-01T19:56:35.735 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93338dba:::benchmark_data_smithi188_161190_object135126:head# 2024-04-01T19:56:35.736 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9334c017:::benchmark_data_smithi188_161190_object115480:head# 2024-04-01T19:56:35.736 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93353577:::benchmark_data_smithi188_161190_object31355:head# 2024-04-01T19:56:35.736 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9335949a:::benchmark_data_smithi188_161190_object97660:head# 2024-04-01T19:56:35.739 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93366150:::benchmark_data_smithi188_161190_object130553:head# 2024-04-01T19:56:35.739 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93374254:::benchmark_data_smithi188_161190_object49147:head# 2024-04-01T19:56:35.739 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:933851f6:::benchmark_data_smithi188_161190_object127632:head# 2024-04-01T19:56:35.739 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9338801c:::benchmark_data_smithi188_161190_object33819:head# 2024-04-01T19:56:35.742 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9339330e:::benchmark_data_smithi188_161190_object27177:head# 2024-04-01T19:56:35.742 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9339ecd4:::benchmark_data_smithi188_161190_object121134:head# 2024-04-01T19:56:35.742 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:933a388b:::benchmark_data_smithi188_161190_object21994:head# 2024-04-01T19:56:35.746 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:933a8ac0:::benchmark_data_smithi188_161190_object32141:head# 2024-04-01T19:56:35.746 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:933ad2d0:::benchmark_data_smithi188_161190_object138475:head# 2024-04-01T19:56:35.746 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:933b4451:::benchmark_data_smithi188_161190_object133582:head# 2024-04-01T19:56:35.746 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:933b8925:::benchmark_data_smithi188_161190_object52593:head# 2024-04-01T19:56:35.746 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:933b9332:::benchmark_data_smithi188_161190_object100755:head# 2024-04-01T19:56:35.746 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:933bc6be:::benchmark_data_smithi188_161190_object117711:head# 2024-04-01T19:56:35.747 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:933c85bd:::benchmark_data_smithi188_161190_object115245:head# 2024-04-01T19:56:35.747 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:933cb0b2:::benchmark_data_smithi188_161190_object61230:head# 2024-04-01T19:56:35.747 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:933d28e7:::benchmark_data_smithi188_161190_object24121:head# 2024-04-01T19:56:35.747 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:933d551c:::benchmark_data_smithi188_161190_object52167:head# 2024-04-01T19:56:35.747 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:933d8511:::benchmark_data_smithi188_161190_object73535:head# 2024-04-01T19:56:35.747 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:933e7001:::benchmark_data_smithi188_161190_object70006:head# 2024-04-01T19:56:35.748 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:933f3b46:::benchmark_data_smithi188_161190_object34448:head# 2024-04-01T19:56:35.748 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93400040:::benchmark_data_smithi188_161190_object71967:head# 2024-04-01T19:56:35.749 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9340d66b:::benchmark_data_smithi188_161190_object112791:head# 2024-04-01T19:56:35.749 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93423267:::benchmark_data_smithi188_161190_object29278:head# 2024-04-01T19:56:35.749 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93431602:::benchmark_data_smithi188_161190_object65320:head# 2024-04-01T19:56:35.750 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93432606:::benchmark_data_smithi188_161190_object131482:head# 2024-04-01T19:56:35.750 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93439e10:::benchmark_data_smithi188_161190_object103036:head# 2024-04-01T19:56:35.751 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9343ddd6:::benchmark_data_smithi188_161190_object137314:head# 2024-04-01T19:56:35.751 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93449eb2:::benchmark_data_smithi188_161190_object118121:head# 2024-04-01T19:56:35.752 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9344df36:::benchmark_data_smithi188_161190_object86797:head# 2024-04-01T19:56:35.752 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9345d85c:::benchmark_data_smithi188_161190_object131583:head# 2024-04-01T19:56:35.753 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9346086a:::benchmark_data_smithi188_161190_object138434:head# 2024-04-01T19:56:35.754 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93461e1d:::benchmark_data_smithi188_161190_object103582:head# 2024-04-01T19:56:35.754 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93462f29:::benchmark_data_smithi188_161190_object76235:head# 2024-04-01T19:56:35.756 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:934639dd:::benchmark_data_smithi188_161190_object129459:head# 2024-04-01T19:56:35.756 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93468a35:::benchmark_data_smithi188_161190_object90003:head# 2024-04-01T19:56:35.756 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9346929d:::benchmark_data_smithi188_161190_object23769:head# 2024-04-01T19:56:35.757 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93472a48:::benchmark_data_smithi188_161190_object132387:head# 2024-04-01T19:56:35.757 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9347be1a:::benchmark_data_smithi188_161190_object128294:head# 2024-04-01T19:56:35.758 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9348bef4:::benchmark_data_smithi188_161190_object65374:head# 2024-04-01T19:56:35.758 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:934949cb:::benchmark_data_smithi188_161190_object30187:head# 2024-04-01T19:56:35.759 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:934955b8:::benchmark_data_smithi188_161190_object65565:head# 2024-04-01T19:56:35.759 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9349e3c7:::benchmark_data_smithi188_161190_object93142:head# 2024-04-01T19:56:35.760 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9349e522:::benchmark_data_smithi188_161190_object48897:head# 2024-04-01T19:56:35.760 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:934a3b1a:::benchmark_data_smithi188_161190_object79287:head# 2024-04-01T19:56:35.760 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:934a8452:::benchmark_data_smithi188_161190_object39296:head# 2024-04-01T19:56:35.761 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:934aff73:::benchmark_data_smithi188_161190_object94278:head# 2024-04-01T19:56:35.761 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:934b0446:::benchmark_data_smithi188_161190_object114198:head# 2024-04-01T19:56:35.762 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:934b1f90:::benchmark_data_smithi188_161190_object70919:head# 2024-04-01T19:56:35.762 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:934b206a:::benchmark_data_smithi188_161190_object56896:head# 2024-04-01T19:56:35.763 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:934b7ade:::benchmark_data_smithi188_161190_object128792:head# 2024-04-01T19:56:35.763 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:934c4dec:::benchmark_data_smithi188_161190_object58556:head# 2024-04-01T19:56:35.763 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:934c8d64:::benchmark_data_smithi188_161190_object134999:head# 2024-04-01T19:56:35.764 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:934cba14:::benchmark_data_smithi188_161190_object83344:head# 2024-04-01T19:56:35.764 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:934cbcb7:::benchmark_data_smithi188_161190_object48138:head# 2024-04-01T19:56:35.765 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:934d700f:::benchmark_data_smithi188_161190_object114308:head# 2024-04-01T19:56:35.765 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:934d9547:::benchmark_data_smithi188_161190_object26983:head# 2024-04-01T19:56:35.765 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:934da773:::benchmark_data_smithi188_161190_object80339:head# 2024-04-01T19:56:35.766 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:934e0354:::benchmark_data_smithi188_161190_object114595:head# 2024-04-01T19:56:35.766 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:934e520b:::benchmark_data_smithi188_161190_object59781:head# 2024-04-01T19:56:35.767 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:934ea9aa:::benchmark_data_smithi188_161190_object82671:head# 2024-04-01T19:56:35.767 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:934f83f7:::benchmark_data_smithi188_161190_object69711:head# 2024-04-01T19:56:35.767 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:934f8b67:::benchmark_data_smithi188_161190_object82730:head# 2024-04-01T19:56:35.768 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:934f9513:::benchmark_data_smithi188_161190_object99231:head# 2024-04-01T19:56:35.768 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93501ffa:::benchmark_data_smithi188_161190_object61676:head# 2024-04-01T19:56:35.769 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9350c4fe:::benchmark_data_smithi188_161190_object40797:head# 2024-04-01T19:56:35.769 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93518768:::benchmark_data_smithi188_161190_object24747:head# 2024-04-01T19:56:35.770 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93520784:::benchmark_data_smithi188_161190_object122031:head# 2024-04-01T19:56:35.770 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93537353:::benchmark_data_smithi188_161190_object65947:head# 2024-04-01T19:56:35.771 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9353afb6:::benchmark_data_smithi188_161190_object58334:head# 2024-04-01T19:56:35.771 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9353d269:::benchmark_data_smithi188_161190_object62322:head# 2024-04-01T19:56:35.772 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93542e9f:::benchmark_data_smithi188_161190_object33832:head# 2024-04-01T19:56:35.772 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9354a511:::benchmark_data_smithi188_161190_object129082:head# 2024-04-01T19:56:35.772 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9354fb88:::benchmark_data_smithi188_161190_object138932:head# 2024-04-01T19:56:35.773 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93552d19:::benchmark_data_smithi188_161190_object92219:head# 2024-04-01T19:56:35.774 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93554635:::benchmark_data_smithi188_161190_object37694:head# 2024-04-01T19:56:35.774 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9355fcdd:::benchmark_data_smithi188_161190_object116023:head# 2024-04-01T19:56:35.777 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:935628ab:::benchmark_data_smithi188_161190_object127662:head# 2024-04-01T19:56:35.777 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93566b7a:::benchmark_data_smithi188_161190_object81911:head# 2024-04-01T19:56:35.777 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9357b039:::benchmark_data_smithi188_161190_object59989:head# 2024-04-01T19:56:35.778 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9357b2e1:::benchmark_data_smithi188_161190_object97791:head# 2024-04-01T19:56:35.778 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93580946:::benchmark_data_smithi188_161190_object36815:head# 2024-04-01T19:56:35.779 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93587bab:::benchmark_data_smithi188_161190_object115315:head# 2024-04-01T19:56:35.779 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93592908:::benchmark_data_smithi188_161190_object90881:head# 2024-04-01T19:56:35.780 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:935978d8:::benchmark_data_smithi188_161190_object94747:head# 2024-04-01T19:56:35.780 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9359d5b0:::benchmark_data_smithi188_161190_object25010:head# 2024-04-01T19:56:35.781 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:935a9603:::benchmark_data_smithi188_161190_object83154:head# 2024-04-01T19:56:35.781 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:935aacd0:::benchmark_data_smithi188_161190_object123752:head# 2024-04-01T19:56:35.781 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:935b504b:::benchmark_data_smithi188_161190_object93132:head# 2024-04-01T19:56:35.782 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:935bef96:::benchmark_data_smithi188_161190_object73817:head# 2024-04-01T19:56:35.782 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:935d111d:::benchmark_data_smithi188_161190_object89619:head# 2024-04-01T19:56:35.783 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:935d9617:::benchmark_data_smithi188_161190_object44766:head# 2024-04-01T19:56:35.783 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:935e1796:::benchmark_data_smithi188_161190_object28425:head# 2024-04-01T19:56:35.784 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:935e2139:::benchmark_data_smithi188_161190_object34768:head# 2024-04-01T19:56:35.784 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:935e3841:::benchmark_data_smithi188_161190_object42084:head# 2024-04-01T19:56:35.785 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:935eb71c:::benchmark_data_smithi188_161190_object61624:head# 2024-04-01T19:56:35.785 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:935f2607:::benchmark_data_smithi188_161190_object119561:head# 2024-04-01T19:56:35.786 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:935f37e7:::benchmark_data_smithi188_161190_object139227:head# 2024-04-01T19:56:35.786 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:935f6768:::benchmark_data_smithi188_161190_object110288:head# 2024-04-01T19:56:35.786 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:935fe3ff:::benchmark_data_smithi188_161190_object56557:head# 2024-04-01T19:56:35.787 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9360c176:::benchmark_data_smithi188_161190_object67192:head# 2024-04-01T19:56:35.787 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9360efc8:::benchmark_data_smithi188_161190_object88832:head# 2024-04-01T19:56:35.788 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93616662:::benchmark_data_smithi188_161190_object78010:head# 2024-04-01T19:56:35.788 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9361ade1:::benchmark_data_smithi188_161190_object64889:head# 2024-04-01T19:56:35.789 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9361b40d:::benchmark_data_smithi188_161190_object105208:head# 2024-04-01T19:56:35.790 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93625dda:::benchmark_data_smithi188_161190_object65714:head# 2024-04-01T19:56:35.790 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93627dba:::benchmark_data_smithi188_161190_object118685:head# 2024-04-01T19:56:35.790 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93629cba:::benchmark_data_smithi188_161190_object88256:head# 2024-04-01T19:56:35.791 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9362afdf:::benchmark_data_smithi188_161190_object55212:head# 2024-04-01T19:56:35.791 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93630c02:::benchmark_data_smithi188_161190_object83522:head# 2024-04-01T19:56:35.792 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9363126c:::benchmark_data_smithi188_161190_object116137:head# 2024-04-01T19:56:35.792 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9364121f:::benchmark_data_smithi188_161190_object41326:head# 2024-04-01T19:56:35.792 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93644192:::benchmark_data_smithi188_161190_object35561:head# 2024-04-01T19:56:35.793 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:936443d1:::benchmark_data_smithi188_161190_object27123:head# 2024-04-01T19:56:35.793 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93644760:::benchmark_data_smithi188_161190_object64363:head# 2024-04-01T19:56:35.794 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9364aa74:::benchmark_data_smithi188_161190_object31635:head# 2024-04-01T19:56:35.795 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93650dcb:::benchmark_data_smithi188_161190_object52611:head# 2024-04-01T19:56:35.795 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:936545ed:::benchmark_data_smithi188_161190_object93997:head# 2024-04-01T19:56:35.796 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93658cf9:::benchmark_data_smithi188_161190_object62629:head# 2024-04-01T19:56:35.796 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93660936:::benchmark_data_smithi188_161190_object94545:head# 2024-04-01T19:56:35.796 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93668ffe:::benchmark_data_smithi188_161190_object50135:head# 2024-04-01T19:56:35.797 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9366e61d:::benchmark_data_smithi188_161190_object98475:head# 2024-04-01T19:56:35.797 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93674ed3:::benchmark_data_smithi188_161190_object77719:head# 2024-04-01T19:56:35.798 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9367db2f:::benchmark_data_smithi188_161190_object119338:head# 2024-04-01T19:56:35.798 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93686832:::benchmark_data_smithi188_161190_object125924:head# 2024-04-01T19:56:35.798 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93687e58:::benchmark_data_smithi188_161190_object21040:head# 2024-04-01T19:56:35.799 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9368c771:::benchmark_data_smithi188_161190_object58835:head# 2024-04-01T19:56:35.800 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9368edcb:::benchmark_data_smithi188_161190_object94701:head# 2024-04-01T19:56:35.803 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93690a13:::benchmark_data_smithi188_161190_object54662:head# 2024-04-01T19:56:35.803 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:936a0481:::benchmark_data_smithi188_161190_object67505:head# 2024-04-01T19:56:35.804 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:936abea9:::benchmark_data_smithi188_161190_object89108:head# 2024-04-01T19:56:35.804 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:936af7b1:::benchmark_data_smithi188_161190_object76463:head# 2024-04-01T19:56:35.804 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:936b1af3:::benchmark_data_smithi188_161190_object40682:head# 2024-04-01T19:56:35.804 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:936c418a:::benchmark_data_smithi188_161190_object52924:head# 2024-04-01T19:56:35.804 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:936c8554:::benchmark_data_smithi188_161190_object95320:head# 2024-04-01T19:56:35.804 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:936ca0d7:::benchmark_data_smithi188_161190_object118461:head# 2024-04-01T19:56:35.805 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:936db00c:::benchmark_data_smithi188_161190_object118581:head# 2024-04-01T19:56:35.805 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:936de420:::benchmark_data_smithi188_161190_object79098:head# 2024-04-01T19:56:35.805 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:936f4f81:::benchmark_data_smithi188_161190_object110571:head# 2024-04-01T19:56:35.805 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9370c66f:::benchmark_data_smithi188_161190_object109560:head# 2024-04-01T19:56:35.806 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9370df05:::benchmark_data_smithi188_161190_object43308:head# 2024-04-01T19:56:35.806 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93713058:::benchmark_data_smithi188_161190_object47369:head# 2024-04-01T19:56:35.808 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9371448e:::benchmark_data_smithi188_161190_object78354:head# 2024-04-01T19:56:35.808 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9372aff9:::benchmark_data_smithi188_161190_object114991:head# 2024-04-01T19:56:35.808 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9372cf72:::benchmark_data_smithi188_161190_object125880:head# 2024-04-01T19:56:35.813 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9372e659:::benchmark_data_smithi188_161190_object26298:head# 2024-04-01T19:56:35.814 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93742d19:::benchmark_data_smithi188_161190_object71689:head# 2024-04-01T19:56:35.814 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9374c24c:::benchmark_data_smithi188_161190_object132273:head# 2024-04-01T19:56:35.814 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:937510da:::benchmark_data_smithi188_161190_object97980:head# 2024-04-01T19:56:35.814 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93756697:::benchmark_data_smithi188_161190_object55675:head# 2024-04-01T19:56:35.814 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:937703a1:::benchmark_data_smithi188_161190_object77742:head# 2024-04-01T19:56:35.814 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93773c43:::benchmark_data_smithi188_161190_object84322:head# 2024-04-01T19:56:35.814 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9378073b:::benchmark_data_smithi188_161190_object79293:head# 2024-04-01T19:56:35.814 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9378c88f:::benchmark_data_smithi188_161190_object138783:head# 2024-04-01T19:56:35.814 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9378f7ea:::benchmark_data_smithi188_161190_object138660:head# 2024-04-01T19:56:35.814 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:937ad605:::benchmark_data_smithi188_161190_object83085:head# 2024-04-01T19:56:35.814 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:937b6898:::benchmark_data_smithi188_161190_object55584:head# 2024-04-01T19:56:35.815 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:937b99a6:::benchmark_data_smithi188_161190_object109242:head# 2024-04-01T19:56:35.815 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:937ce726:::benchmark_data_smithi188_161190_object90862:head# 2024-04-01T19:56:35.815 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:937f3534:::benchmark_data_smithi188_161190_object105805:head# 2024-04-01T19:56:35.815 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:937f5189:::benchmark_data_smithi188_161190_object115790:head# 2024-04-01T19:56:35.816 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:937f5324:::benchmark_data_smithi188_161190_object135956:head# 2024-04-01T19:56:35.816 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:937f6ca0:::benchmark_data_smithi188_161190_object118849:head# 2024-04-01T19:56:35.816 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:937f8b42:::benchmark_data_smithi188_161190_object67369:head# 2024-04-01T19:56:35.818 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9380ad8e:::benchmark_data_smithi188_161190_object82756:head# 2024-04-01T19:56:35.818 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93811c98:::benchmark_data_smithi188_161190_object36249:head# 2024-04-01T19:56:35.818 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9381a860:::benchmark_data_smithi188_161190_object104011:head# 2024-04-01T19:56:35.819 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9382076b:::benchmark_data_smithi188_161190_object62035:head# 2024-04-01T19:56:35.819 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9383b6c5:::benchmark_data_smithi188_161190_object117317:head# 2024-04-01T19:56:35.820 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9384940e:::benchmark_data_smithi188_161190_object123684:head# 2024-04-01T19:56:35.820 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9385168b:::benchmark_data_smithi188_161190_object22565:head# 2024-04-01T19:56:35.821 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93852d64:::benchmark_data_smithi188_161190_object136235:head# 2024-04-01T19:56:35.821 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9385386b:::benchmark_data_smithi188_161190_object58582:head# 2024-04-01T19:56:35.825 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93853ecf:::benchmark_data_smithi188_161190_object64145:head# 2024-04-01T19:56:35.825 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:938617ec:::benchmark_data_smithi188_161190_object47456:head# 2024-04-01T19:56:35.825 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9386d648:::benchmark_data_smithi188_161190_object98708:head# 2024-04-01T19:56:35.825 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9387a98f:::benchmark_data_smithi188_161190_object47306:head# 2024-04-01T19:56:35.826 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9387aa14:::benchmark_data_smithi188_161190_object24122:head# 2024-04-01T19:56:35.826 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9387d886:::benchmark_data_smithi188_161190_object40050:head# 2024-04-01T19:56:35.826 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93884758:::benchmark_data_smithi188_161190_object27111:head# 2024-04-01T19:56:35.826 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93888505:::benchmark_data_smithi188_161190_object128373:head# 2024-04-01T19:56:35.826 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9388ed8d:::benchmark_data_smithi188_161190_object65326:head# 2024-04-01T19:56:35.826 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9389a4e7:::benchmark_data_smithi188_161190_object72011:head# 2024-04-01T19:56:35.827 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9389f954:::benchmark_data_smithi188_161190_object42938:head# 2024-04-01T19:56:35.827 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:938a28f4:::benchmark_data_smithi188_161190_object25871:head# 2024-04-01T19:56:35.829 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:938a767c:::benchmark_data_smithi188_161190_object112717:head# 2024-04-01T19:56:35.829 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:938cb59d:::benchmark_data_smithi188_161190_object134442:head# 2024-04-01T19:56:35.830 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:938db561:::benchmark_data_smithi188_161190_object28584:head# 2024-04-01T19:56:35.830 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:938dc423:::benchmark_data_smithi188_161190_object30979:head# 2024-04-01T19:56:35.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:938dd092:::benchmark_data_smithi188_161190_object109194:head# 2024-04-01T19:56:35.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:938dd837:::benchmark_data_smithi188_161190_object90086:head# 2024-04-01T19:56:35.832 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:938e027e:::benchmark_data_smithi188_161190_object72509:head# 2024-04-01T19:56:35.832 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:938e1082:::benchmark_data_smithi188_161190_object99153:head# 2024-04-01T19:56:35.835 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:938e1cda:::benchmark_data_smithi188_161190_object63362:head# 2024-04-01T19:56:35.835 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:938e455f:::benchmark_data_smithi188_161190_object55193:head# 2024-04-01T19:56:35.836 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:938e4802:::benchmark_data_smithi188_161190_object21698:head# 2024-04-01T19:56:35.836 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:938e5bbb:::benchmark_data_smithi188_161190_object127267:head# 2024-04-01T19:56:35.836 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:938ef702:::benchmark_data_smithi188_161190_object61021:head# 2024-04-01T19:56:35.836 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:938f33b4:::benchmark_data_smithi188_161190_object99725:head# 2024-04-01T19:56:35.836 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93905c6d:::benchmark_data_smithi188_161190_object54334:head# 2024-04-01T19:56:35.836 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93906b0c:::benchmark_data_smithi188_161190_object119097:head# 2024-04-01T19:56:35.836 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9390b186:::benchmark_data_smithi188_161190_object92583:head# 2024-04-01T19:56:35.837 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93917359:::benchmark_data_smithi188_161190_object70693:head# 2024-04-01T19:56:35.837 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9391d34f:::benchmark_data_smithi188_161190_object45087:head# 2024-04-01T19:56:35.838 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9391d6f0:::benchmark_data_smithi188_161190_object75450:head# 2024-04-01T19:56:35.838 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93922e50:::benchmark_data_smithi188_161190_object24050:head# 2024-04-01T19:56:35.838 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9392329c:::benchmark_data_smithi188_161190_object119295:head# 2024-04-01T19:56:35.839 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9392b86c:::benchmark_data_smithi188_161190_object50080:head# 2024-04-01T19:56:35.839 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93930a80:::benchmark_data_smithi188_161190_object130735:head# 2024-04-01T19:56:35.840 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:939355d5:::benchmark_data_smithi188_161190_object125878:head# 2024-04-01T19:56:35.840 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93940fdf:::benchmark_data_smithi188_161190_object90750:head# 2024-04-01T19:56:35.841 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9394d59e:::benchmark_data_smithi188_161190_object64426:head# 2024-04-01T19:56:35.841 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9395bf6b:::benchmark_data_smithi188_161190_object110897:head# 2024-04-01T19:56:35.841 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9395c9f2:::benchmark_data_smithi188_161190_object31097:head# 2024-04-01T19:56:35.842 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93960e9d:::benchmark_data_smithi188_161190_object81274:head# 2024-04-01T19:56:35.842 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93966657:::benchmark_data_smithi188_161190_object115633:head# 2024-04-01T19:56:35.843 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93971a78:::benchmark_data_smithi188_161190_object31232:head# 2024-04-01T19:56:35.844 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9397c299:::benchmark_data_smithi188_161190_object95534:head# 2024-04-01T19:56:35.845 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93982096:::benchmark_data_smithi188_161190_object111558:head# 2024-04-01T19:56:35.845 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9398c414:::benchmark_data_smithi188_161190_object120198:head# 2024-04-01T19:56:35.846 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9399cc3d:::benchmark_data_smithi188_161190_object42855:head# 2024-04-01T19:56:35.846 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:939a1fc2:::benchmark_data_smithi188_161190_object26026:head# 2024-04-01T19:56:35.846 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:939a2738:::benchmark_data_smithi188_161190_object79448:head# 2024-04-01T19:56:35.847 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:939a386c:::benchmark_data_smithi188_161190_object104925:head# 2024-04-01T19:56:35.847 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:939b798b:::benchmark_data_smithi188_161190_object22665:head# 2024-04-01T19:56:35.848 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:939b87e6:::benchmark_data_smithi188_161190_object134546:head# 2024-04-01T19:56:35.852 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:939b8fed:::benchmark_data_smithi188_161190_object119224:head# 2024-04-01T19:56:35.852 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:939c092f:::benchmark_data_smithi188_161190_object49561:head# 2024-04-01T19:56:35.852 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:939d04c9:::benchmark_data_smithi188_161190_object30252:head# 2024-04-01T19:56:35.852 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:939d58ad:::benchmark_data_smithi188_161190_object31217:head# 2024-04-01T19:56:35.853 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:939ec180:::benchmark_data_smithi188_161190_object127657:head# 2024-04-01T19:56:35.853 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:939ee920:::benchmark_data_smithi188_161190_object31717:head# 2024-04-01T19:56:35.853 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:939f2c72:::benchmark_data_smithi188_161190_object29280:head# 2024-04-01T19:56:35.853 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:939f463d:::benchmark_data_smithi188_161190_object38411:head# 2024-04-01T19:56:35.853 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:939f9436:::benchmark_data_smithi188_161190_object22061:head# 2024-04-01T19:56:35.854 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:939fef69:::benchmark_data_smithi188_161190_object34117:head# 2024-04-01T19:56:35.854 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93a033ec:::benchmark_data_smithi188_161190_object37141:head# 2024-04-01T19:56:35.854 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93a0bebc:::benchmark_data_smithi188_161190_object131721:head# 2024-04-01T19:56:35.857 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93a0dd88:::benchmark_data_smithi188_161190_object35222:head# 2024-04-01T19:56:35.858 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93a18fe3:::benchmark_data_smithi188_161190_object26851:head# 2024-04-01T19:56:35.858 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93a1f672:::benchmark_data_smithi188_161190_object35546:head# 2024-04-01T19:56:35.858 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93a20be8:::benchmark_data_smithi188_161190_object67122:head# 2024-04-01T19:56:35.858 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93a24e34:::benchmark_data_smithi188_161190_object85246:head# 2024-04-01T19:56:35.858 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93a32927:::benchmark_data_smithi188_161190_object130693:head# 2024-04-01T19:56:35.858 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93a3ae00:::benchmark_data_smithi188_161190_object33605:head# 2024-04-01T19:56:35.858 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93a50e76:::benchmark_data_smithi188_161190_object125503:head# 2024-04-01T19:56:35.859 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93a6024e:::benchmark_data_smithi188_161190_object122138:head# 2024-04-01T19:56:35.859 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93a6382c:::benchmark_data_smithi188_161190_object50308:head# 2024-04-01T19:56:35.861 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93a63892:::benchmark_data_smithi188_161190_object82324:head# 2024-04-01T19:56:35.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:35 smithi022 ceph-mon[39439]: 8.0 scrub starts 2024-04-01T19:56:35.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:35 smithi022 ceph-mon[39439]: pgmap v1881: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.9 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 541 op/s; 35418/226612 objects degraded (15.629%); 11 MiB/s, 171 objects/s recovering 2024-04-01T19:56:35.862 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93a6cb85:::benchmark_data_smithi188_161190_object75293:head# 2024-04-01T19:56:35.862 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93a6da83:::benchmark_data_smithi188_161190_object54708:head# 2024-04-01T19:56:35.862 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93a72bbf:::benchmark_data_smithi188_161190_object79921:head# 2024-04-01T19:56:35.863 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93a7381c:::benchmark_data_smithi188_161190_object84123:head# 2024-04-01T19:56:35.863 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93a895a4:::benchmark_data_smithi188_161190_object114338:head# 2024-04-01T19:56:35.864 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93a8c317:::benchmark_data_smithi188_161190_object36971:head# 2024-04-01T19:56:35.864 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93a9ceb9:::benchmark_data_smithi188_161190_object80063:head# 2024-04-01T19:56:35.865 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93aba5ed:::benchmark_data_smithi188_161190_object106393:head# 2024-04-01T19:56:35.865 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93ac5cda:::benchmark_data_smithi188_161190_object54870:head# 2024-04-01T19:56:35.866 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93acbfee:::benchmark_data_smithi188_161190_object136385:head# 2024-04-01T19:56:35.866 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93ad154c:::benchmark_data_smithi188_161190_object98764:head# 2024-04-01T19:56:35.866 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93adc266:::benchmark_data_smithi188_161190_object32692:head# 2024-04-01T19:56:35.867 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93adf4e2:::benchmark_data_smithi188_161190_object47524:head# 2024-04-01T19:56:35.867 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93ae3796:::benchmark_data_smithi188_161190_object112055:head# 2024-04-01T19:56:35.868 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93ae37e2:::benchmark_data_smithi188_161190_object130883:head# 2024-04-01T19:56:35.868 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93ae6fdf:::benchmark_data_smithi188_161190_object34535:head# 2024-04-01T19:56:35.869 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93ae74b5:::benchmark_data_smithi188_161190_object113122:head# 2024-04-01T19:56:35.869 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93af12e1:::benchmark_data_smithi188_161190_object91914:head# 2024-04-01T19:56:35.870 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93af72fb:::benchmark_data_smithi188_161190_object34886:head# 2024-04-01T19:56:35.870 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93af8b21:::benchmark_data_smithi188_161190_object63558:head# 2024-04-01T19:56:35.872 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93afe1fc:::benchmark_data_smithi188_161190_object121433:head# 2024-04-01T19:56:35.873 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93b0cae3:::benchmark_data_smithi188_161190_object22161:head# 2024-04-01T19:56:35.873 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93b16804:::benchmark_data_smithi188_161190_object122102:head# 2024-04-01T19:56:35.873 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93b1a6e6:::benchmark_data_smithi188_161190_object40059:head# 2024-04-01T19:56:35.873 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93b20ae5:::benchmark_data_smithi188_161190_object42703:head# 2024-04-01T19:56:35.873 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93b3c435:::benchmark_data_smithi188_161190_object76145:head# 2024-04-01T19:56:35.873 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93b3d4be:::benchmark_data_smithi188_161190_object32783:head# 2024-04-01T19:56:35.874 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93b460c9:::benchmark_data_smithi188_161190_object106631:head# 2024-04-01T19:56:35.874 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93b4d82e:::benchmark_data_smithi188_161190_object31512:head# 2024-04-01T19:56:35.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:35 smithi188 ceph-mon[43939]: 8.0 scrub starts 2024-04-01T19:56:35.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:35 smithi188 ceph-mon[43939]: pgmap v1881: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.9 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 541 op/s; 35418/226612 objects degraded (15.629%); 11 MiB/s, 171 objects/s recovering 2024-04-01T19:56:35.875 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93b534a6:::benchmark_data_smithi188_161190_object40843:head# 2024-04-01T19:56:35.875 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93b56844:::benchmark_data_smithi188_161190_object122032:head# 2024-04-01T19:56:35.876 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93b77b48:::benchmark_data_smithi188_161190_object62459:head# 2024-04-01T19:56:35.876 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93b7b5d8:::benchmark_data_smithi188_161190_object116938:head# 2024-04-01T19:56:35.876 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93b8ed55:::benchmark_data_smithi188_161190_object122958:head# 2024-04-01T19:56:35.877 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93b9101a:::benchmark_data_smithi188_161190_object115784:head# 2024-04-01T19:56:35.877 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93b9bc0d:::benchmark_data_smithi188_161190_object137041:head# 2024-04-01T19:56:35.877 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93b9c102:::benchmark_data_smithi188_161190_object117654:head# 2024-04-01T19:56:35.878 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93b9e5e2:::benchmark_data_smithi188_161190_object87535:head# 2024-04-01T19:56:35.878 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93bb9711:::benchmark_data_smithi188_161190_object130579:head# 2024-04-01T19:56:35.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93bc2a84:::benchmark_data_smithi188_161190_object70460:head# 2024-04-01T19:56:35.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93bc4821:::benchmark_data_smithi188_161190_object87058:head# 2024-04-01T19:56:35.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93bd9c57:::benchmark_data_smithi188_161190_object114109:head# 2024-04-01T19:56:35.880 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93be39fb:::benchmark_data_smithi188_161190_object26368:head# 2024-04-01T19:56:35.881 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93bea3ae:::benchmark_data_smithi188_161190_object65821:head# 2024-04-01T19:56:35.882 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93bee105:::benchmark_data_smithi188_161190_object99803:head# 2024-04-01T19:56:35.882 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93bf35f0:::benchmark_data_smithi188_161190_object60787:head# 2024-04-01T19:56:35.882 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93bf7a03:::benchmark_data_smithi188_161190_object129481:head# 2024-04-01T19:56:35.883 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93bfcac3:::benchmark_data_smithi188_161190_object26540:head# 2024-04-01T19:56:35.883 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93bfcb63:::benchmark_data_smithi188_161190_object68613:head# 2024-04-01T19:56:35.884 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93c06613:::benchmark_data_smithi188_161190_object128910:head# 2024-04-01T19:56:35.884 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93c0994d:::benchmark_data_smithi188_161190_object30396:head# 2024-04-01T19:56:35.886 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93c1b3bf:::benchmark_data_smithi188_161190_object46409:head# 2024-04-01T19:56:35.887 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93c21cf3:::benchmark_data_smithi188_161190_object122724:head# 2024-04-01T19:56:35.887 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93c22afb:::benchmark_data_smithi188_161190_object36925:head# 2024-04-01T19:56:35.888 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93c32639:::benchmark_data_smithi188_161190_object52633:head# 2024-04-01T19:56:35.888 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93c346b5:::benchmark_data_smithi188_161190_object48080:head# 2024-04-01T19:56:35.889 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93c39664:::benchmark_data_smithi188_161190_object31812:head# 2024-04-01T19:56:35.889 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93c3b0b9:::benchmark_data_smithi188_161190_object50669:head# 2024-04-01T19:56:35.890 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93c3bdc9:::benchmark_data_smithi188_161190_object69565:head# 2024-04-01T19:56:35.890 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93c3fd38:::benchmark_data_smithi188_161190_object69417:head# 2024-04-01T19:56:35.890 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93c47c18:::benchmark_data_smithi188_161190_object78524:head# 2024-04-01T19:56:35.891 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93c4ad2d:::benchmark_data_smithi188_161190_object50532:head# 2024-04-01T19:56:35.892 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93c4adef:::benchmark_data_smithi188_161190_object47521:head# 2024-04-01T19:56:35.892 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93c5d473:::benchmark_data_smithi188_161190_object56765:head# 2024-04-01T19:56:35.892 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93c6254f:::benchmark_data_smithi188_161190_object111592:head# 2024-04-01T19:56:35.893 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93c6273c:::benchmark_data_smithi188_161190_object127872:head# 2024-04-01T19:56:35.893 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93c69582:::benchmark_data_smithi188_161190_object91084:head# 2024-04-01T19:56:35.894 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93c71f65:::benchmark_data_smithi188_161190_object39340:head# 2024-04-01T19:56:35.894 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93c74bfd:::benchmark_data_smithi188_161190_object110942:head# 2024-04-01T19:56:35.894 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93c840d1:::benchmark_data_smithi188_161190_object117203:head# 2024-04-01T19:56:35.895 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93c8d311:::benchmark_data_smithi188_161190_object127929:head# 2024-04-01T19:56:35.895 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93c9084a:::benchmark_data_smithi188_161190_object52776:head# 2024-04-01T19:56:35.895 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93c96448:::benchmark_data_smithi188_161190_object52798:head# 2024-04-01T19:56:35.896 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93cad622:::benchmark_data_smithi188_161190_object82422:head# 2024-04-01T19:56:35.896 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93cb3664:::benchmark_data_smithi188_161190_object134284:head# 2024-04-01T19:56:35.897 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93cc5579:::benchmark_data_smithi188_161190_object114507:head# 2024-04-01T19:56:35.897 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93cc6fd5:::benchmark_data_smithi188_161190_object83045:head# 2024-04-01T19:56:35.898 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93cc8eb8:::benchmark_data_smithi188_161190_object37239:head# 2024-04-01T19:56:35.898 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93ccdb1c:::benchmark_data_smithi188_161190_object86702:head# 2024-04-01T19:56:35.899 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93cd391e:::benchmark_data_smithi188_161190_object44019:head# 2024-04-01T19:56:35.899 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93cdee7d:::benchmark_data_smithi188_161190_object61137:head# 2024-04-01T19:56:35.900 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93ce0e5f:::benchmark_data_smithi188_161190_object39393:head# 2024-04-01T19:56:35.901 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93ce3ac9:::benchmark_data_smithi188_161190_object40794:head# 2024-04-01T19:56:35.901 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93ceacc8:::benchmark_data_smithi188_161190_object115986:head# 2024-04-01T19:56:35.901 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93cf2309:::benchmark_data_smithi188_161190_object106497:head# 2024-04-01T19:56:35.902 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93d144f4:::benchmark_data_smithi188_161190_object98086:head# 2024-04-01T19:56:35.902 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93d26848:::benchmark_data_smithi188_161190_object69079:head# 2024-04-01T19:56:35.902 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93d27c60:::benchmark_data_smithi188_161190_object87959:head# 2024-04-01T19:56:35.904 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93d39440:::benchmark_data_smithi188_161190_object77055:head# 2024-04-01T19:56:35.905 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93d41248:::benchmark_data_smithi188_161190_object39798:head# 2024-04-01T19:56:35.905 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93d46d7e:::benchmark_data_smithi188_161190_object49943:head# 2024-04-01T19:56:35.906 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93d4b484:::benchmark_data_smithi188_161190_object28283:head# 2024-04-01T19:56:35.907 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93d5c070:::benchmark_data_smithi188_161190_object58946:head# 2024-04-01T19:56:35.907 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93d5e1f0:::benchmark_data_smithi188_161190_object42871:head# 2024-04-01T19:56:35.908 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93d6f86b:::benchmark_data_smithi188_161190_object130655:head# 2024-04-01T19:56:35.908 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93d7b99d:::benchmark_data_smithi188_161190_object122907:head# 2024-04-01T19:56:35.908 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93d7bd1a:::benchmark_data_smithi188_161190_object93472:head# 2024-04-01T19:56:35.908 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93d7f56e:::benchmark_data_smithi188_161190_object109654:head# 2024-04-01T19:56:35.909 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93d80118:::benchmark_data_smithi188_161190_object91301:head# 2024-04-01T19:56:35.909 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93d84298:::benchmark_data_smithi188_161190_object28760:head# 2024-04-01T19:56:35.909 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93d93616:::benchmark_data_smithi188_161190_object93239:head# 2024-04-01T19:56:35.910 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93d963c7:::benchmark_data_smithi188_161190_object23827:head# 2024-04-01T19:56:35.910 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93daea51:::benchmark_data_smithi188_161190_object22848:head# 2024-04-01T19:56:35.913 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93dc0e74:::benchmark_data_smithi188_161190_object67012:head# 2024-04-01T19:56:35.913 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93dc2024:::benchmark_data_smithi188_161190_object51936:head# 2024-04-01T19:56:35.914 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93de551c:::benchmark_data_smithi188_161190_object101612:head# 2024-04-01T19:56:35.914 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93de5800:::benchmark_data_smithi188_161190_object139250:head# 2024-04-01T19:56:35.914 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93de78a1:::benchmark_data_smithi188_161190_object50407:head# 2024-04-01T19:56:35.915 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93de832e:::benchmark_data_smithi188_161190_object64066:head# 2024-04-01T19:56:35.915 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93dedc35:::benchmark_data_smithi188_161190_object66565:head# 2024-04-01T19:56:35.916 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93df3b41:::benchmark_data_smithi188_161190_object122084:head# 2024-04-01T19:56:35.916 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93df5695:::benchmark_data_smithi188_161190_object90637:head# 2024-04-01T19:56:35.916 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93df6eba:::benchmark_data_smithi188_161190_object99471:head# 2024-04-01T19:56:35.917 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93dffab7:::benchmark_data_smithi188_161190_object67141:head# 2024-04-01T19:56:35.917 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93e0b8fc:::benchmark_data_smithi188_161190_object100723:head# 2024-04-01T19:56:35.918 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93e1b2cd:::benchmark_data_smithi188_161190_object133428:head# 2024-04-01T19:56:35.918 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93e28d8f:::benchmark_data_smithi188_161190_object125577:head# 2024-04-01T19:56:35.918 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93e34cbf:::benchmark_data_smithi188_161190_object49312:head# 2024-04-01T19:56:35.919 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93e4751b:::benchmark_data_smithi188_161190_object70286:head# 2024-04-01T19:56:35.919 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93e4de1f:::benchmark_data_smithi188_161190_object105733:head# 2024-04-01T19:56:35.920 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93e698cc:::benchmark_data_smithi188_161190_object102449:head# 2024-04-01T19:56:35.920 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93e739f7:::benchmark_data_smithi188_161190_object105492:head# 2024-04-01T19:56:35.920 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93e7ed3b:::benchmark_data_smithi188_161190_object76288:head# 2024-04-01T19:56:35.921 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93e97180:::benchmark_data_smithi188_161190_object57860:head# 2024-04-01T19:56:35.921 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93ea390a:::benchmark_data_smithi188_161190_object131549:head# 2024-04-01T19:56:35.922 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93ec3473:::benchmark_data_smithi188_161190_object38087:head# 2024-04-01T19:56:35.922 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93ec526e:::benchmark_data_smithi188_161190_object127483:head# 2024-04-01T19:56:35.923 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93ec5f18:::benchmark_data_smithi188_161190_object23323:head# 2024-04-01T19:56:35.925 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93ed3f76:::benchmark_data_smithi188_161190_object99843:head# 2024-04-01T19:56:35.926 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93ef04fb:::benchmark_data_smithi188_161190_object92366:head# 2024-04-01T19:56:35.926 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93ef785a:::benchmark_data_smithi188_161190_object85214:head# 2024-04-01T19:56:35.927 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93efc670:::benchmark_data_smithi188_161190_object61380:head# 2024-04-01T19:56:35.927 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93f03ed4:::benchmark_data_smithi188_161190_object115035:head# 2024-04-01T19:56:35.928 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93f1641f:::benchmark_data_smithi188_161190_object21430:head# 2024-04-01T19:56:35.928 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93f26059:::benchmark_data_smithi188_161190_object71198:head# 2024-04-01T19:56:35.931 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93f27a55:::benchmark_data_smithi188_161190_object46259:head# 2024-04-01T19:56:35.931 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93f44777:::benchmark_data_smithi188_161190_object104101:head# 2024-04-01T19:56:35.932 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93f45a61:::benchmark_data_smithi188_161190_object74116:head# 2024-04-01T19:56:35.932 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93f655a5:::benchmark_data_smithi188_161190_object33338:head# 2024-04-01T19:56:35.932 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93f6664a:::benchmark_data_smithi188_161190_object23026:head# 2024-04-01T19:56:35.932 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93f6b542:::benchmark_data_smithi188_161190_object98209:head# 2024-04-01T19:56:35.933 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93f8a2b2:::benchmark_data_smithi188_161190_object91027:head# 2024-04-01T19:56:35.933 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93f8cd96:::benchmark_data_smithi188_161190_object32424:head# 2024-04-01T19:56:35.933 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93f95753:::benchmark_data_smithi188_161190_object134500:head# 2024-04-01T19:56:35.934 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93fbe230:::benchmark_data_smithi188_161190_object100822:head# 2024-04-01T19:56:35.934 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93fbf83e:::benchmark_data_smithi188_161190_object44513:head# 2024-04-01T19:56:35.937 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93fc3bd8:::benchmark_data_smithi188_161190_object48522:head# 2024-04-01T19:56:35.938 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93fc4184:::benchmark_data_smithi188_161190_object109165:head# 2024-04-01T19:56:35.938 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93fcd181:::benchmark_data_smithi188_161190_object118682:head# 2024-04-01T19:56:35.939 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93fd2e4e:::benchmark_data_smithi188_161190_object126240:head# 2024-04-01T19:56:35.943 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93fdccaa:::benchmark_data_smithi188_161190_object119708:head# 2024-04-01T19:56:35.943 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93fe9812:::benchmark_data_smithi188_161190_object137516:head# 2024-04-01T19:56:35.943 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93ff3830:::benchmark_data_smithi188_161190_object127338:head# 2024-04-01T19:56:35.943 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93ff6241:::benchmark_data_smithi188_161190_object50545:head# 2024-04-01T19:56:35.943 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:93ff8cf5:::benchmark_data_smithi188_161190_object134667:head# 2024-04-01T19:56:35.943 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9400fd48:::benchmark_data_smithi188_161190_object110455:head# 2024-04-01T19:56:35.943 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94019f9f:::benchmark_data_smithi188_161190_object20121:head# 2024-04-01T19:56:35.943 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94039400:::benchmark_data_smithi188_161190_object110465:head# 2024-04-01T19:56:35.947 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9403e2cc:::benchmark_data_smithi188_161190_object35462:head# 2024-04-01T19:56:35.947 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9404ceb1:::benchmark_data_smithi188_161190_object115127:head# 2024-04-01T19:56:35.947 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94057be4:::benchmark_data_smithi188_161190_object101789:head# 2024-04-01T19:56:35.947 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9405b9e8:::benchmark_data_smithi188_161190_object59374:head# 2024-04-01T19:56:35.947 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9406fa36:::benchmark_data_smithi188_161190_object44050:head# 2024-04-01T19:56:35.947 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94072c12:::benchmark_data_smithi188_161190_object125320:head# 2024-04-01T19:56:35.952 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94077a40:::benchmark_data_smithi188_161190_object62152:head# 2024-04-01T19:56:35.954 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:940983c5:::benchmark_data_smithi188_161190_object22757:head# 2024-04-01T19:56:35.955 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94099f77:::benchmark_data_smithi188_161190_object124136:head# 2024-04-01T19:56:35.955 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9409ded0:::benchmark_data_smithi188_161190_object37874:head# 2024-04-01T19:56:35.956 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:940a6e83:::benchmark_data_smithi188_161190_object126916:head# 2024-04-01T19:56:35.961 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:940a7ceb:::benchmark_data_smithi188_161190_object90544:head# 2024-04-01T19:56:35.961 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:940b74f2:::benchmark_data_smithi188_161190_object46821:head# 2024-04-01T19:56:35.961 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:940bcd25:::benchmark_data_smithi188_161190_object42391:head# 2024-04-01T19:56:35.961 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:940d4c52:::benchmark_data_smithi188_161190_object70251:head# 2024-04-01T19:56:35.961 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:940d9686:::benchmark_data_smithi188_161190_object80484:head# 2024-04-01T19:56:35.961 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:940e335f:::benchmark_data_smithi188_161190_object30384:head# 2024-04-01T19:56:35.962 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:940e642d:::benchmark_data_smithi188_161190_object109762:head# 2024-04-01T19:56:35.962 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:940e9242:::benchmark_data_smithi188_161190_object83479:head# 2024-04-01T19:56:35.963 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:940ebd74:::benchmark_data_smithi188_161190_object123734:head# 2024-04-01T19:56:35.963 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9410738a:::benchmark_data_smithi188_161190_object112310:head# 2024-04-01T19:56:35.963 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:941097ac:::benchmark_data_smithi188_161190_object126026:head# 2024-04-01T19:56:35.964 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94118b7b:::benchmark_data_smithi188_161190_object54747:head# 2024-04-01T19:56:35.964 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9411f6c8:::benchmark_data_smithi188_161190_object111329:head# 2024-04-01T19:56:35.965 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9412212a:::benchmark_data_smithi188_161190_object33326:head# 2024-04-01T19:56:35.966 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94132018:::benchmark_data_smithi188_161190_object99505:head# 2024-04-01T19:56:35.970 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94136862:::benchmark_data_smithi188_161190_object38869:head# 2024-04-01T19:56:35.971 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9413f231:::benchmark_data_smithi188_161190_object28032:head# 2024-04-01T19:56:35.971 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94146a75:::benchmark_data_smithi188_161190_object128079:head# 2024-04-01T19:56:35.971 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94152d1f:::benchmark_data_smithi188_161190_object107062:head# 2024-04-01T19:56:35.971 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94156b84:::benchmark_data_smithi188_161190_object91969:head# 2024-04-01T19:56:35.971 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94179766:::benchmark_data_smithi188_161190_object55679:head# 2024-04-01T19:56:35.971 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9417a9a3:::benchmark_data_smithi188_161190_object44688:head# 2024-04-01T19:56:35.971 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9417f43e:::benchmark_data_smithi188_161190_object23853:head# 2024-04-01T19:56:35.971 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:941845b8:::benchmark_data_smithi188_161190_object75494:head# 2024-04-01T19:56:35.971 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9418a160:::benchmark_data_smithi188_161190_object122545:head# 2024-04-01T19:56:35.972 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9419b13e:::benchmark_data_smithi188_161190_object23596:head# 2024-04-01T19:56:35.976 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9419ed5a:::benchmark_data_smithi188_161190_object104318:head# 2024-04-01T19:56:35.976 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:941a3963:::benchmark_data_smithi188_161190_object51961:head# 2024-04-01T19:56:35.976 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:941bfd91:::benchmark_data_smithi188_161190_object39638:head# 2024-04-01T19:56:35.976 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:941c5772:::benchmark_data_smithi188_161190_object105170:head# 2024-04-01T19:56:35.977 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:941c7b45:::benchmark_data_smithi188_161190_object129328:head# 2024-04-01T19:56:35.977 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:941ccda3:::benchmark_data_smithi188_161190_object39102:head# 2024-04-01T19:56:35.977 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:941d5869:::benchmark_data_smithi188_161190_object96992:head# 2024-04-01T19:56:35.977 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:941e6db8:::benchmark_data_smithi188_161190_object131479:head# 2024-04-01T19:56:35.977 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:941ec68b:::benchmark_data_smithi188_161190_object102502:head# 2024-04-01T19:56:35.978 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:941f3666:::benchmark_data_smithi188_161190_object137632:head# 2024-04-01T19:56:35.978 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:941f6a9b:::benchmark_data_smithi188_161190_object118759:head# 2024-04-01T19:56:35.978 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:941f9db3:::benchmark_data_smithi188_161190_object135830:head# 2024-04-01T19:56:35.978 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:941ff40a:::benchmark_data_smithi188_161190_object114889:head# 2024-04-01T19:56:35.979 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94202eaa:::benchmark_data_smithi188_161190_object114157:head# 2024-04-01T19:56:35.980 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94214589:::benchmark_data_smithi188_161190_object130429:head# 2024-04-01T19:56:35.980 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9421bb14:::benchmark_data_smithi188_161190_object104356:head# 2024-04-01T19:56:35.986 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9421da77:::benchmark_data_smithi188_161190_object92098:head# 2024-04-01T19:56:35.986 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9422c4a5:::benchmark_data_smithi188_161190_object66505:head# 2024-04-01T19:56:35.986 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9422c864:::benchmark_data_smithi188_161190_object30813:head# 2024-04-01T19:56:35.986 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:942344b8:::benchmark_data_smithi188_161190_object61508:head# 2024-04-01T19:56:35.986 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9424344f:::benchmark_data_smithi188_161190_object61760:head# 2024-04-01T19:56:35.986 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94245ad8:::benchmark_data_smithi188_161190_object121586:head# 2024-04-01T19:56:35.986 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94246776:::benchmark_data_smithi188_161190_object62618:head# 2024-04-01T19:56:35.986 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9424d5d7:::benchmark_data_smithi188_161190_object90308:head# 2024-04-01T19:56:35.986 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9424dde7:::benchmark_data_smithi188_161190_object96269:head# 2024-04-01T19:56:35.987 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:942659eb:::benchmark_data_smithi188_161190_object63872:head# 2024-04-01T19:56:35.987 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9426d740:::benchmark_data_smithi188_161190_object34657:head# 2024-04-01T19:56:35.987 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9427b153:::benchmark_data_smithi188_161190_object32929:head# 2024-04-01T19:56:35.997 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9427ec51:::benchmark_data_smithi188_161190_object51682:head# 2024-04-01T19:56:35.997 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:942a4bbd:::benchmark_data_smithi188_161190_object120311:head# 2024-04-01T19:56:35.997 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:942b2410:::benchmark_data_smithi188_161190_object32441:head# 2024-04-01T19:56:35.997 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:942dc58a:::benchmark_data_smithi188_161190_object27146:head# 2024-04-01T19:56:35.998 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:942e06ec:::benchmark_data_smithi188_161190_object22354:head# 2024-04-01T19:56:35.998 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:942eacf4:::benchmark_data_smithi188_161190_object89486:head# 2024-04-01T19:56:35.998 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:942f4346:::benchmark_data_smithi188_161190_object31831:head# 2024-04-01T19:56:35.998 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:942f43d0:::benchmark_data_smithi188_161190_object55751:head# 2024-04-01T19:56:35.998 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:942f84a2:::benchmark_data_smithi188_161190_object83483:head# 2024-04-01T19:56:35.998 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94304132:::benchmark_data_smithi188_161190_object138877:head# 2024-04-01T19:56:36.001 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9430ad10:::benchmark_data_smithi188_161190_object87260:head# 2024-04-01T19:56:36.001 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94311ca0:::benchmark_data_smithi188_161190_object105129:head# 2024-04-01T19:56:36.001 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9431383c:::benchmark_data_smithi188_161190_object22018:head# 2024-04-01T19:56:36.003 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94317eb2:::benchmark_data_smithi188_161190_object31325:head# 2024-04-01T19:56:36.003 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9431dc6e:::benchmark_data_smithi188_161190_object55304:head# 2024-04-01T19:56:36.008 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9431f666:::benchmark_data_smithi188_161190_object29771:head# 2024-04-01T19:56:36.008 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94339d80:::benchmark_data_smithi188_161190_object94185:head# 2024-04-01T19:56:36.009 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9433a5bd:::benchmark_data_smithi188_161190_object100682:head# 2024-04-01T19:56:36.009 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9434181a:::benchmark_data_smithi188_161190_object115738:head# 2024-04-01T19:56:36.010 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94341e1d:::benchmark_data_smithi188_161190_object123743:head# 2024-04-01T19:56:36.010 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9434c39e:::benchmark_data_smithi188_161190_object136441:head# 2024-04-01T19:56:36.011 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9434c868:::benchmark_data_smithi188_161190_object85713:head# 2024-04-01T19:56:36.011 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9434cdda:::benchmark_data_smithi188_161190_object42788:head# 2024-04-01T19:56:36.012 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:943550c0:::benchmark_data_smithi188_161190_object67285:head# 2024-04-01T19:56:36.012 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94356570:::benchmark_data_smithi188_161190_object116025:head# 2024-04-01T19:56:36.013 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:943602ca:::benchmark_data_smithi188_161190_object122636:head# 2024-04-01T19:56:36.013 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94363de0:::benchmark_data_smithi188_161190_object51803:head# 2024-04-01T19:56:36.014 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9437c953:::benchmark_data_smithi188_161190_object92939:head# 2024-04-01T19:56:36.017 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9439b80e:::benchmark_data_smithi188_161190_object101803:head# 2024-04-01T19:56:36.017 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9439d0d3:::benchmark_data_smithi188_161190_object127574:head# 2024-04-01T19:56:36.018 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:943a08be:::benchmark_data_smithi188_161190_object114940:head# 2024-04-01T19:56:36.019 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:943b2265:::benchmark_data_smithi188_161190_object93639:head# 2024-04-01T19:56:36.021 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:943b4c56:::benchmark_data_smithi188_161190_object120098:head# 2024-04-01T19:56:36.021 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:943b79a1:::benchmark_data_smithi188_161190_object76945:head# 2024-04-01T19:56:36.022 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:943bbca7:::benchmark_data_smithi188_161190_object108972:head# 2024-04-01T19:56:36.024 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:943bd10a:::benchmark_data_smithi188_161190_object110934:head# 2024-04-01T19:56:36.024 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:943c6fc8:::benchmark_data_smithi188_161190_object58145:head# 2024-04-01T19:56:36.026 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:943c9e60:::benchmark_data_smithi188_161190_object123596:head# 2024-04-01T19:56:36.026 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:943e0861:::benchmark_data_smithi188_161190_object84925:head# 2024-04-01T19:56:36.027 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:943e9d67:::benchmark_data_smithi188_161190_object121418:head# 2024-04-01T19:56:36.027 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:943edab6:::benchmark_data_smithi188_161190_object105113:head# 2024-04-01T19:56:36.027 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:943ef9c3:::benchmark_data_smithi188_161190_object132861:head# 2024-04-01T19:56:36.027 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:943f2453:::benchmark_data_smithi188_161190_object128312:head# 2024-04-01T19:56:36.027 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:943f304f:::benchmark_data_smithi188_161190_object38641:head# 2024-04-01T19:56:36.030 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:943f5284:::benchmark_data_smithi188_161190_object126002:head# 2024-04-01T19:56:36.031 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9440433b:::benchmark_data_smithi188_161190_object136108:head# 2024-04-01T19:56:36.031 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9440516e:::benchmark_data_smithi188_161190_object43024:head# 2024-04-01T19:56:36.031 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94408fea:::benchmark_data_smithi188_161190_object50708:head# 2024-04-01T19:56:36.031 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94412cf2:::benchmark_data_smithi188_161190_object124697:head# 2024-04-01T19:56:36.031 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9441c330:::benchmark_data_smithi188_161190_object63463:head# 2024-04-01T19:56:36.031 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94425b7c:::benchmark_data_smithi188_161190_object111485:head# 2024-04-01T19:56:36.034 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94427d4a:::benchmark_data_smithi188_161190_object91309:head# 2024-04-01T19:56:36.034 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94434e25:::benchmark_data_smithi188_161190_object125538:head# 2024-04-01T19:56:36.034 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9443dca0:::benchmark_data_smithi188_161190_object107796:head# 2024-04-01T19:56:36.034 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9443fde6:::benchmark_data_smithi188_161190_object105139:head# 2024-04-01T19:56:36.034 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:944459c1:::benchmark_data_smithi188_161190_object85186:head# 2024-04-01T19:56:36.034 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94447262:::benchmark_data_smithi188_161190_object56606:head# 2024-04-01T19:56:36.034 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9444820e:::benchmark_data_smithi188_161190_object29911:head# 2024-04-01T19:56:36.035 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94456bf1:::benchmark_data_smithi188_161190_object103794:head# 2024-04-01T19:56:36.035 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94458deb:::benchmark_data_smithi188_161190_object77829:head# 2024-04-01T19:56:36.035 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9445dfeb:::benchmark_data_smithi188_161190_object110235:head# 2024-04-01T19:56:36.036 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:944640b5:::benchmark_data_smithi188_161190_object32892:head# 2024-04-01T19:56:36.036 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94464957:::benchmark_data_smithi188_161190_object34261:head# 2024-04-01T19:56:36.037 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94464e07:::benchmark_data_smithi188_161190_object107295:head# 2024-04-01T19:56:36.037 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:944652ab:::benchmark_data_smithi188_161190_object72940:head# 2024-04-01T19:56:36.038 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9446e526:::benchmark_data_smithi188_161190_object85938:head# 2024-04-01T19:56:36.038 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9447c95e:::benchmark_data_smithi188_161190_object85677:head# 2024-04-01T19:56:36.038 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9448557e:::benchmark_data_smithi188_161190_object33825:head# 2024-04-01T19:56:36.039 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9448c926:::benchmark_data_smithi188_161190_object127912:head# 2024-04-01T19:56:36.039 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9448d2cd:::benchmark_data_smithi188_161190_object21896:head# 2024-04-01T19:56:36.040 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:944baa07:::benchmark_data_smithi188_161190_object81466:head# 2024-04-01T19:56:36.040 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:944bb246:::benchmark_data_smithi188_161190_object26750:head# 2024-04-01T19:56:36.040 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:944bb580:::benchmark_data_smithi188_161190_object81697:head# 2024-04-01T19:56:36.041 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:944bcf70:::benchmark_data_smithi188_161190_object125507:head# 2024-04-01T19:56:36.041 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:944bf115:::benchmark_data_smithi188_161190_object131873:head# 2024-04-01T19:56:36.042 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:944ccf07:::benchmark_data_smithi188_161190_object98429:head# 2024-04-01T19:56:36.042 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:944d1d7b:::benchmark_data_smithi188_161190_object94351:head# 2024-04-01T19:56:36.043 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:944d74c3:::benchmark_data_smithi188_161190_object82901:head# 2024-04-01T19:56:36.043 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:944dee40:::benchmark_data_smithi188_161190_object71452:head# 2024-04-01T19:56:36.044 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:944e9342:::benchmark_data_smithi188_161190_object133009:head# 2024-04-01T19:56:36.044 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:944ebced:::benchmark_data_smithi188_161190_object41148:head# 2024-04-01T19:56:36.044 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:944ef16c:::benchmark_data_smithi188_161190_object122805:head# 2024-04-01T19:56:36.050 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:944fc08f:::benchmark_data_smithi188_161190_object95584:head# 2024-04-01T19:56:36.050 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:944fc5ae:::benchmark_data_smithi188_161190_object130348:head# 2024-04-01T19:56:36.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9450629e:::benchmark_data_smithi188_161190_object39641:head# 2024-04-01T19:56:36.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94513981:::benchmark_data_smithi188_161190_object30481:head# 2024-04-01T19:56:36.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9451491c:::benchmark_data_smithi188_161190_object54809:head# 2024-04-01T19:56:36.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94517794:::benchmark_data_smithi188_161190_object67605:head# 2024-04-01T19:56:36.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94519e42:::benchmark_data_smithi188_161190_object67611:head# 2024-04-01T19:56:36.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94519fd5:::benchmark_data_smithi188_161190_object69734:head# 2024-04-01T19:56:36.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94521dc0:::benchmark_data_smithi188_161190_object112956:head# 2024-04-01T19:56:36.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:945257f7:::benchmark_data_smithi188_161190_object65242:head# 2024-04-01T19:56:36.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9453d50a:::benchmark_data_smithi188_161190_object86693:head# 2024-04-01T19:56:36.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94541b27:::benchmark_data_smithi188_161190_object42215:head# 2024-04-01T19:56:36.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:945454dd:::benchmark_data_smithi188_161190_object95461:head# 2024-04-01T19:56:36.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94547ff4:::benchmark_data_smithi188_161190_object62967:head# 2024-04-01T19:56:36.054 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94548c58:::benchmark_data_smithi188_161190_object95150:head# 2024-04-01T19:56:36.055 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94548d34:::benchmark_data_smithi188_161190_object135599:head# 2024-04-01T19:56:36.060 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9454ec59:::benchmark_data_smithi188_161190_object105347:head# 2024-04-01T19:56:36.060 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94559841:::benchmark_data_smithi188_161190_object108863:head# 2024-04-01T19:56:36.061 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9455f0cb:::benchmark_data_smithi188_161190_object130289:head# 2024-04-01T19:56:36.061 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94564b76:::benchmark_data_smithi188_161190_object68536:head# 2024-04-01T19:56:36.061 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94565ba8:::benchmark_data_smithi188_161190_object62937:head# 2024-04-01T19:56:36.063 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9456f737:::benchmark_data_smithi188_161190_object72638:head# 2024-04-01T19:56:36.063 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:945881a5:::benchmark_data_smithi188_161190_object106925:head# 2024-04-01T19:56:36.063 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9458bd18:::benchmark_data_smithi188_161190_object69667:head# 2024-04-01T19:56:36.064 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9459ceb1:::benchmark_data_smithi188_161190_object78378:head# 2024-04-01T19:56:36.064 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:945a2802:::benchmark_data_smithi188_161190_object122580:head# 2024-04-01T19:56:36.064 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:945a3566:::benchmark_data_smithi188_161190_object55897:head# 2024-04-01T19:56:36.065 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:945a448d:::benchmark_data_smithi188_161190_object28169:head# 2024-04-01T19:56:36.065 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:945a6ee9:::benchmark_data_smithi188_161190_object116483:head# 2024-04-01T19:56:36.065 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:945ae325:::benchmark_data_smithi188_161190_object100486:head# 2024-04-01T19:56:36.066 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:945b4bc1:::benchmark_data_smithi188_161190_object117571:head# 2024-04-01T19:56:36.066 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:945b7b20:::benchmark_data_smithi188_161190_object58041:head# 2024-04-01T19:56:36.067 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:945da48d:::benchmark_data_smithi188_161190_object111767:head# 2024-04-01T19:56:36.067 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:945de3df:::benchmark_data_smithi188_161190_object135480:head# 2024-04-01T19:56:36.068 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:945df806:::benchmark_data_smithi188_161190_object126945:head# 2024-04-01T19:56:36.068 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:945e4f65:::benchmark_data_smithi188_161190_object124877:head# 2024-04-01T19:56:36.069 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:945eb621:::benchmark_data_smithi188_161190_object29559:head# 2024-04-01T19:56:36.069 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94604069:::benchmark_data_smithi188_161190_object32643:head# 2024-04-01T19:56:36.070 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94607862:::benchmark_data_smithi188_161190_object89343:head# 2024-04-01T19:56:36.071 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94610b99:::benchmark_data_smithi188_161190_object55127:head# 2024-04-01T19:56:36.071 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94612b75:::benchmark_data_smithi188_161190_object68474:head# 2024-04-01T19:56:36.072 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9461562b:::benchmark_data_smithi188_161190_object48662:head# 2024-04-01T19:56:36.072 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94616b36:::benchmark_data_smithi188_161190_object45133:head# 2024-04-01T19:56:36.073 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94617caf:::benchmark_data_smithi188_161190_object110830:head# 2024-04-01T19:56:36.073 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9462a374:::benchmark_data_smithi188_161190_object21955:head# 2024-04-01T19:56:36.074 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9462bce4:::benchmark_data_smithi188_161190_object96506:head# 2024-04-01T19:56:36.074 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9462f95e:::benchmark_data_smithi188_161190_object52749:head# 2024-04-01T19:56:36.075 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9463375b:::benchmark_data_smithi188_161190_object115066:head# 2024-04-01T19:56:36.075 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94637c49:::benchmark_data_smithi188_161190_object65784:head# 2024-04-01T19:56:36.076 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9463c17c:::benchmark_data_smithi188_161190_object38686:head# 2024-04-01T19:56:36.076 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94647455:::benchmark_data_smithi188_161190_object44749:head# 2024-04-01T19:56:36.076 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:946501e1:::benchmark_data_smithi188_161190_object80815:head# 2024-04-01T19:56:36.077 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94651540:::benchmark_data_smithi188_161190_object137898:head# 2024-04-01T19:56:36.077 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:946524ab:::benchmark_data_smithi188_161190_object42854:head# 2024-04-01T19:56:36.077 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9465e039:::benchmark_data_smithi188_161190_object75896:head# 2024-04-01T19:56:36.078 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9465e5ab:::benchmark_data_smithi188_161190_object112129:head# 2024-04-01T19:56:36.078 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9468197b:::benchmark_data_smithi188_161190_object95679:head# 2024-04-01T19:56:36.079 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94694927:::benchmark_data_smithi188_161190_object44386:head# 2024-04-01T19:56:36.079 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9469e299:::benchmark_data_smithi188_161190_object83874:head# 2024-04-01T19:56:36.080 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:946a072e:::benchmark_data_smithi188_161190_object117075:head# 2024-04-01T19:56:36.080 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:946a55c6:::benchmark_data_smithi188_161190_object88049:head# 2024-04-01T19:56:36.080 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:946aa5c9:::benchmark_data_smithi188_161190_object38493:head# 2024-04-01T19:56:36.081 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:946bff3c:::benchmark_data_smithi188_161190_object20692:head# 2024-04-01T19:56:36.081 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:946c34ff:::benchmark_data_smithi188_161190_object118078:head# 2024-04-01T19:56:36.082 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:946e0907:::benchmark_data_smithi188_161190_object27238:head# 2024-04-01T19:56:36.082 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:946e5ea5:::benchmark_data_smithi188_161190_object68263:head# 2024-04-01T19:56:36.089 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:946e798c:::benchmark_data_smithi188_161190_object109131:head# 2024-04-01T19:56:36.089 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:946e9f90:::benchmark_data_smithi188_161190_object19938:head# 2024-04-01T19:56:36.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:946ee21a:::benchmark_data_smithi188_161190_object37460:head# 2024-04-01T19:56:36.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:946f0fc2:::benchmark_data_smithi188_161190_object25357:head# 2024-04-01T19:56:36.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:946fd1ae:::benchmark_data_smithi188_161190_object93134:head# 2024-04-01T19:56:36.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9471854c:::benchmark_data_smithi188_161190_object36770:head# 2024-04-01T19:56:36.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9471d549:::benchmark_data_smithi188_161190_object34533:head# 2024-04-01T19:56:36.091 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:947223d7:::benchmark_data_smithi188_161190_object109827:head# 2024-04-01T19:56:36.091 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9472e042:::benchmark_data_smithi188_161190_object139275:head# 2024-04-01T19:56:36.092 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9473869e:::benchmark_data_smithi188_161190_object130985:head# 2024-04-01T19:56:36.092 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9473fc62:::benchmark_data_smithi188_161190_object93801:head# 2024-04-01T19:56:36.093 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94745768:::benchmark_data_smithi188_161190_object95883:head# 2024-04-01T19:56:36.093 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94746733:::benchmark_data_smithi188_161190_object95369:head# 2024-04-01T19:56:36.093 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9474ee8f:::benchmark_data_smithi188_161190_object69706:head# 2024-04-01T19:56:36.095 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9475b50c:::benchmark_data_smithi188_161190_object70371:head# 2024-04-01T19:56:36.095 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9476b42a:::benchmark_data_smithi188_161190_object52767:head# 2024-04-01T19:56:36.095 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9477f8b7:::benchmark_data_smithi188_161190_object54141:head# 2024-04-01T19:56:36.096 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9478f717:::benchmark_data_smithi188_161190_object92167:head# 2024-04-01T19:56:36.096 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:947904f0:::benchmark_data_smithi188_161190_object31748:head# 2024-04-01T19:56:36.097 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9479163d:::benchmark_data_smithi188_161190_object113797:head# 2024-04-01T19:56:36.097 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94791c0d:::benchmark_data_smithi188_161190_object101459:head# 2024-04-01T19:56:36.098 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:947b534a:::benchmark_data_smithi188_161190_object136139:head# 2024-04-01T19:56:36.098 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:947b60c9:::benchmark_data_smithi188_161190_object38767:head# 2024-04-01T19:56:36.099 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:947be579:::benchmark_data_smithi188_161190_object56995:head# 2024-04-01T19:56:36.099 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:947c815e:::benchmark_data_smithi188_161190_object104271:head# 2024-04-01T19:56:36.099 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:947d115e:::benchmark_data_smithi188_161190_object119715:head# 2024-04-01T19:56:36.100 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:947dbba0:::benchmark_data_smithi188_161190_object28628:head# 2024-04-01T19:56:36.100 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:947eb3b3:::benchmark_data_smithi188_161190_object20288:head# 2024-04-01T19:56:36.102 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:947ee555:::benchmark_data_smithi188_161190_object82460:head# 2024-04-01T19:56:36.102 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:947fa794:::benchmark_data_smithi188_161190_object44350:head# 2024-04-01T19:56:36.102 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:947fd345:::benchmark_data_smithi188_161190_object85793:head# 2024-04-01T19:56:36.103 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9480849b:::benchmark_data_smithi188_161190_object25947:head# 2024-04-01T19:56:36.106 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9480a9fe:::benchmark_data_smithi188_161190_object112695:head# 2024-04-01T19:56:36.106 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9480c70e:::benchmark_data_smithi188_161190_object91714:head# 2024-04-01T19:56:36.107 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94827f28:::benchmark_data_smithi188_161190_object113337:head# 2024-04-01T19:56:36.107 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9482dec2:::benchmark_data_smithi188_161190_object22289:head# 2024-04-01T19:56:36.107 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94830b37:::benchmark_data_smithi188_161190_object125133:head# 2024-04-01T19:56:36.107 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94832f8a:::benchmark_data_smithi188_161190_object135310:head# 2024-04-01T19:56:36.107 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94835675:::benchmark_data_smithi188_161190_object43167:head# 2024-04-01T19:56:36.107 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9483a625:::benchmark_data_smithi188_161190_object104203:head# 2024-04-01T19:56:36.107 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9483bb42:::benchmark_data_smithi188_161190_object61661:head# 2024-04-01T19:56:36.109 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94852568:::benchmark_data_smithi188_161190_object53262:head# 2024-04-01T19:56:36.109 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9485c6a1:::benchmark_data_smithi188_161190_object132988:head# 2024-04-01T19:56:36.110 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9486127b:::benchmark_data_smithi188_161190_object48313:head# 2024-04-01T19:56:36.111 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94869846:::benchmark_data_smithi188_161190_object27367:head# 2024-04-01T19:56:36.111 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9486daf5:::benchmark_data_smithi188_161190_object51621:head# 2024-04-01T19:56:36.119 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9487337a:::benchmark_data_smithi188_161190_object78725:head# 2024-04-01T19:56:36.119 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94878c61:::benchmark_data_smithi188_161190_object72976:head# 2024-04-01T19:56:36.119 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9487e66a:::benchmark_data_smithi188_161190_object121914:head# 2024-04-01T19:56:36.119 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94888c52:::benchmark_data_smithi188_161190_object28428:head# 2024-04-01T19:56:36.119 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94898589:::benchmark_data_smithi188_161190_object111104:head# 2024-04-01T19:56:36.119 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94899550:::benchmark_data_smithi188_161190_object78804:head# 2024-04-01T19:56:36.119 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9489a246:::benchmark_data_smithi188_161190_object131669:head# 2024-04-01T19:56:36.119 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:948a5618:::benchmark_data_smithi188_161190_object31796:head# 2024-04-01T19:56:36.119 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:948a653f:::benchmark_data_smithi188_161190_object69048:head# 2024-04-01T19:56:36.119 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:948ab9cf:::benchmark_data_smithi188_161190_object94734:head# 2024-04-01T19:56:36.119 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:948ad962:::benchmark_data_smithi188_161190_object89909:head# 2024-04-01T19:56:36.120 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:948b3a2b:::benchmark_data_smithi188_161190_object67343:head# 2024-04-01T19:56:36.120 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:948bda7d:::benchmark_data_smithi188_161190_object46398:head# 2024-04-01T19:56:36.120 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:948c8ae5:::benchmark_data_smithi188_161190_object128647:head# 2024-04-01T19:56:36.120 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:948d1bf0:::benchmark_data_smithi188_161190_object79466:head# 2024-04-01T19:56:36.120 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:948d1d96:::benchmark_data_smithi188_161190_object59859:head# 2024-04-01T19:56:36.120 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:948e1aab:::benchmark_data_smithi188_161190_object33154:head# 2024-04-01T19:56:36.120 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:948e5936:::benchmark_data_smithi188_161190_object109782:head# 2024-04-01T19:56:36.124 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:948e6394:::benchmark_data_smithi188_161190_object94736:head# 2024-04-01T19:56:36.124 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:948f00b2:::benchmark_data_smithi188_161190_object74423:head# 2024-04-01T19:56:36.124 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9490f6c7:::benchmark_data_smithi188_161190_object84607:head# 2024-04-01T19:56:36.124 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94911375:::benchmark_data_smithi188_161190_object33061:head# 2024-04-01T19:56:36.124 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:949177b2:::benchmark_data_smithi188_161190_object80497:head# 2024-04-01T19:56:36.124 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94923e94:::benchmark_data_smithi188_161190_object58188:head# 2024-04-01T19:56:36.124 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:949311e2:::benchmark_data_smithi188_161190_object116426:head# 2024-04-01T19:56:36.124 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9493302e:::benchmark_data_smithi188_161190_object121276:head# 2024-04-01T19:56:36.124 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9493f960:::benchmark_data_smithi188_161190_object28609:head# 2024-04-01T19:56:36.125 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94942b83:::benchmark_data_smithi188_161190_object109110:head# 2024-04-01T19:56:36.125 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9494bc68:::benchmark_data_smithi188_161190_object71104:head# 2024-04-01T19:56:36.125 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:949592eb:::benchmark_data_smithi188_161190_object125299:head# 2024-04-01T19:56:36.126 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9495aec9:::benchmark_data_smithi188_161190_object49339:head# 2024-04-01T19:56:36.126 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9495b7e8:::benchmark_data_smithi188_161190_object112650:head# 2024-04-01T19:56:36.126 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:949665d4:::benchmark_data_smithi188_161190_object74869:head# 2024-04-01T19:56:36.127 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94971401:::benchmark_data_smithi188_161190_object84078:head# 2024-04-01T19:56:36.127 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94971ae5:::benchmark_data_smithi188_161190_object131168:head# 2024-04-01T19:56:36.128 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9497a8bc:::benchmark_data_smithi188_161190_object87795:head# 2024-04-01T19:56:36.128 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9497bfab:::benchmark_data_smithi188_161190_object55480:head# 2024-04-01T19:56:36.129 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:949837dc:::benchmark_data_smithi188_161190_object45286:head# 2024-04-01T19:56:36.129 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94988317:::benchmark_data_smithi188_161190_object69664:head# 2024-04-01T19:56:36.130 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9498ac66:::benchmark_data_smithi188_161190_object40141:head# 2024-04-01T19:56:36.130 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94992293:::benchmark_data_smithi188_161190_object26017:head# 2024-04-01T19:56:36.131 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94993fa7:::benchmark_data_smithi188_161190_object74033:head# 2024-04-01T19:56:36.131 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:949aa541:::benchmark_data_smithi188_161190_object55854:head# 2024-04-01T19:56:36.132 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:949afc41:::benchmark_data_smithi188_161190_object92994:head# 2024-04-01T19:56:36.132 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:949b85bc:::benchmark_data_smithi188_161190_object74955:head# 2024-04-01T19:56:36.132 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:949bedb8:::benchmark_data_smithi188_161190_object135819:head# 2024-04-01T19:56:36.133 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:949c5654:::benchmark_data_smithi188_161190_object100547:head# 2024-04-01T19:56:36.133 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:949c7f57:::benchmark_data_smithi188_161190_object126799:head# 2024-04-01T19:56:36.134 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:949cc231:::benchmark_data_smithi188_161190_object107722:head# 2024-04-01T19:56:36.134 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:949ce328:::benchmark_data_smithi188_161190_object54384:head# 2024-04-01T19:56:36.135 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:949d46cc:::benchmark_data_smithi188_161190_object40363:head# 2024-04-01T19:56:36.135 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:949d4929:::benchmark_data_smithi188_161190_object72808:head# 2024-04-01T19:56:36.138 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:949d7c7b:::benchmark_data_smithi188_161190_object48513:head# 2024-04-01T19:56:36.140 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:949e3075:::benchmark_data_smithi188_161190_object64452:head# 2024-04-01T19:56:36.140 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:949e43ac:::benchmark_data_smithi188_161190_object122973:head# 2024-04-01T19:56:36.140 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:949e456e:::benchmark_data_smithi188_161190_object26094:head# 2024-04-01T19:56:36.140 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:949ee962:::benchmark_data_smithi188_161190_object114509:head# 2024-04-01T19:56:36.140 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:949f321d:::benchmark_data_smithi188_161190_object60602:head# 2024-04-01T19:56:36.140 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:949f6435:::benchmark_data_smithi188_161190_object79404:head# 2024-04-01T19:56:36.140 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:949f78b0:::benchmark_data_smithi188_161190_object81928:head# 2024-04-01T19:56:36.140 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:949fc236:::benchmark_data_smithi188_161190_object95933:head# 2024-04-01T19:56:36.140 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:949fce83:::benchmark_data_smithi188_161190_object62913:head# 2024-04-01T19:56:36.141 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94a0d5c8:::benchmark_data_smithi188_161190_object134933:head# 2024-04-01T19:56:36.141 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94a1ab59:::benchmark_data_smithi188_161190_object67132:head# 2024-04-01T19:56:36.141 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94a2ea05:::benchmark_data_smithi188_161190_object60170:head# 2024-04-01T19:56:36.142 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94a2fa4f:::benchmark_data_smithi188_161190_object97821:head# 2024-04-01T19:56:36.142 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94a358e5:::benchmark_data_smithi188_161190_object58880:head# 2024-04-01T19:56:36.142 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94a3f360:::benchmark_data_smithi188_161190_object121484:head# 2024-04-01T19:56:36.143 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94a3f495:::benchmark_data_smithi188_161190_object92906:head# 2024-04-01T19:56:36.143 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94a48837:::benchmark_data_smithi188_161190_object59851:head# 2024-04-01T19:56:36.144 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94a48bbc:::benchmark_data_smithi188_161190_object114967:head# 2024-04-01T19:56:36.144 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94a66386:::benchmark_data_smithi188_161190_object116352:head# 2024-04-01T19:56:36.146 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94a864c8:::benchmark_data_smithi188_161190_object37563:head# 2024-04-01T19:56:36.146 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94a94c6d:::benchmark_data_smithi188_161190_object37737:head# 2024-04-01T19:56:36.146 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94a96815:::benchmark_data_smithi188_161190_object120556:head# 2024-04-01T19:56:36.147 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94a992c9:::benchmark_data_smithi188_161190_object109022:head# 2024-04-01T19:56:36.147 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94a9af4d:::benchmark_data_smithi188_161190_object123338:head# 2024-04-01T19:56:36.148 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94a9b65f:::benchmark_data_smithi188_161190_object110788:head# 2024-04-01T19:56:36.148 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94aa83ab:::benchmark_data_smithi188_161190_object131057:head# 2024-04-01T19:56:36.148 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94aaff0c:::benchmark_data_smithi188_161190_object112489:head# 2024-04-01T19:56:36.148 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94ac5f9e:::benchmark_data_smithi188_161190_object81746:head# 2024-04-01T19:56:36.149 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94ad6767:::benchmark_data_smithi188_161190_object55470:head# 2024-04-01T19:56:36.149 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94ad726e:::benchmark_data_smithi188_161190_object92182:head# 2024-04-01T19:56:36.150 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94add713:::benchmark_data_smithi188_161190_object99546:head# 2024-04-01T19:56:36.150 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94ae122d:::benchmark_data_smithi188_161190_object107703:head# 2024-04-01T19:56:36.150 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94af952a:::benchmark_data_smithi188_161190_object132928:head# 2024-04-01T19:56:36.151 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94afad59:::benchmark_data_smithi188_161190_object56262:head# 2024-04-01T19:56:36.151 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94afc92a:::benchmark_data_smithi188_161190_object109053:head# 2024-04-01T19:56:36.152 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94afcf5f:::benchmark_data_smithi188_161190_object84383:head# 2024-04-01T19:56:36.152 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94afd4b0:::benchmark_data_smithi188_161190_object123763:head# 2024-04-01T19:56:36.155 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94afda1d:::benchmark_data_smithi188_161190_object85696:head# 2024-04-01T19:56:36.155 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94afdf91:::benchmark_data_smithi188_161190_object93796:head# 2024-04-01T19:56:36.155 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94affee3:::benchmark_data_smithi188_161190_object130906:head# 2024-04-01T19:56:36.155 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94b07642:::benchmark_data_smithi188_161190_object90087:head# 2024-04-01T19:56:36.156 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94b182e0:::benchmark_data_smithi188_161190_object50241:head# 2024-04-01T19:56:36.157 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94b29926:::benchmark_data_smithi188_161190_object59304:head# 2024-04-01T19:56:36.158 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94b3da7e:::benchmark_data_smithi188_161190_object69480:head# 2024-04-01T19:56:36.159 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94b40162:::benchmark_data_smithi188_161190_object106647:head# 2024-04-01T19:56:36.159 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94b4084b:::benchmark_data_smithi188_161190_object30210:head# 2024-04-01T19:56:36.159 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94b51332:::benchmark_data_smithi188_161190_object138990:head# 2024-04-01T19:56:36.159 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94b5495f:::benchmark_data_smithi188_161190_object40176:head# 2024-04-01T19:56:36.160 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94b5f224:::benchmark_data_smithi188_161190_object77585:head# 2024-04-01T19:56:36.160 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94b66a64:::benchmark_data_smithi188_161190_object60794:head# 2024-04-01T19:56:36.160 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94b6cefe:::benchmark_data_smithi188_161190_object21114:head# 2024-04-01T19:56:36.161 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94b71e41:::benchmark_data_smithi188_161190_object125221:head# 2024-04-01T19:56:36.161 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94b76366:::benchmark_data_smithi188_161190_object130504:head# 2024-04-01T19:56:36.162 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94b76a38:::benchmark_data_smithi188_161190_object33308:head# 2024-04-01T19:56:36.162 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94b843e5:::benchmark_data_smithi188_161190_object84018:head# 2024-04-01T19:56:36.162 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94b8a884:::benchmark_data_smithi188_161190_object86581:head# 2024-04-01T19:56:36.163 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94b94c8e:::benchmark_data_smithi188_161190_object55430:head# 2024-04-01T19:56:36.164 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94b9eaa8:::benchmark_data_smithi188_161190_object114076:head# 2024-04-01T19:56:36.164 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94ba2cb5:::benchmark_data_smithi188_161190_object24479:head# 2024-04-01T19:56:36.165 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94bc5e2e:::benchmark_data_smithi188_161190_object38316:head# 2024-04-01T19:56:36.166 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94bd8eb2:::benchmark_data_smithi188_161190_object30599:head# 2024-04-01T19:56:36.166 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94bd9afd:::benchmark_data_smithi188_161190_object64812:head# 2024-04-01T19:56:36.166 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94bde07a:::benchmark_data_smithi188_161190_object35196:head# 2024-04-01T19:56:36.167 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94be0d3c:::benchmark_data_smithi188_161190_object127406:head# 2024-04-01T19:56:36.167 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94be1777:::benchmark_data_smithi188_161190_object102461:head# 2024-04-01T19:56:36.168 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94be6196:::benchmark_data_smithi188_161190_object64453:head# 2024-04-01T19:56:36.168 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94bea15b:::benchmark_data_smithi188_161190_object136837:head# 2024-04-01T19:56:36.169 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94bea95b:::benchmark_data_smithi188_161190_object25040:head# 2024-04-01T19:56:36.169 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94bef73d:::benchmark_data_smithi188_161190_object116328:head# 2024-04-01T19:56:36.170 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94bf374a:::benchmark_data_smithi188_161190_object114083:head# 2024-04-01T19:56:36.170 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94bf701b:::benchmark_data_smithi188_161190_object134197:head# 2024-04-01T19:56:36.171 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94c03808:::benchmark_data_smithi188_161190_object93596:head# 2024-04-01T19:56:36.171 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94c0477f:::benchmark_data_smithi188_161190_object119078:head# 2024-04-01T19:56:36.171 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94c0cdac:::benchmark_data_smithi188_161190_object111600:head# 2024-04-01T19:56:36.172 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94c11599:::benchmark_data_smithi188_161190_object53128:head# 2024-04-01T19:56:36.172 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94c299c1:::benchmark_data_smithi188_161190_object81191:head# 2024-04-01T19:56:36.173 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94c2bb0a:::benchmark_data_smithi188_161190_object124371:head# 2024-04-01T19:56:36.175 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94c30ce4:::benchmark_data_smithi188_161190_object70604:head# 2024-04-01T19:56:36.176 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94c4e9a1:::benchmark_data_smithi188_161190_object57584:head# 2024-04-01T19:56:36.176 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94c5457e:::benchmark_data_smithi188_161190_object83070:head# 2024-04-01T19:56:36.177 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94c62c63:::benchmark_data_smithi188_161190_object71818:head# 2024-04-01T19:56:36.177 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94c67799:::benchmark_data_smithi188_161190_object60832:head# 2024-04-01T19:56:36.177 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94c738c1:::benchmark_data_smithi188_161190_object63447:head# 2024-04-01T19:56:36.178 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94c75626:::benchmark_data_smithi188_161190_object134683:head# 2024-04-01T19:56:36.178 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94c8463f:::benchmark_data_smithi188_161190_object58054:head# 2024-04-01T19:56:36.179 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94c87935:::benchmark_data_smithi188_161190_object122541:head# 2024-04-01T19:56:36.179 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94c9c1b7:::benchmark_data_smithi188_161190_object85473:head# 2024-04-01T19:56:36.180 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94cb4069:::benchmark_data_smithi188_161190_object57036:head# 2024-04-01T19:56:36.180 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94cb96b6:::benchmark_data_smithi188_161190_object26190:head# 2024-04-01T19:56:36.180 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94cc0b3c:::benchmark_data_smithi188_161190_object117980:head# 2024-04-01T19:56:36.181 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94cca485:::benchmark_data_smithi188_161190_object38615:head# 2024-04-01T19:56:36.181 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94ccce67:::benchmark_data_smithi188_161190_object85372:head# 2024-04-01T19:56:36.182 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94cd5cee:::benchmark_data_smithi188_161190_object50638:head# 2024-04-01T19:56:36.182 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94cd7be3:::benchmark_data_smithi188_161190_object111789:head# 2024-04-01T19:56:36.183 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94ce2b2b:::benchmark_data_smithi188_161190_object66723:head# 2024-04-01T19:56:36.183 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94ce40c6:::benchmark_data_smithi188_161190_object137439:head# 2024-04-01T19:56:36.183 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94cee854:::benchmark_data_smithi188_161190_object136026:head# 2024-04-01T19:56:36.186 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94cf1ed1:::benchmark_data_smithi188_161190_object100862:head# 2024-04-01T19:56:36.187 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94cfff98:::benchmark_data_smithi188_161190_object55352:head# 2024-04-01T19:56:36.187 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94d088b6:::benchmark_data_smithi188_161190_object70855:head# 2024-04-01T19:56:36.188 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94d116b0:::benchmark_data_smithi188_161190_object85578:head# 2024-04-01T19:56:36.188 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94d252f9:::benchmark_data_smithi188_161190_object121098:head# 2024-04-01T19:56:36.188 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94d2745b:::benchmark_data_smithi188_161190_object134070:head# 2024-04-01T19:56:36.189 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94d34748:::benchmark_data_smithi188_161190_object119830:head# 2024-04-01T19:56:36.189 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94d3a427:::benchmark_data_smithi188_161190_object127242:head# 2024-04-01T19:56:36.190 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94d4d628:::benchmark_data_smithi188_161190_object21604:head# 2024-04-01T19:56:36.190 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94d4de6c:::benchmark_data_smithi188_161190_object81291:head# 2024-04-01T19:56:36.191 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94d65830:::benchmark_data_smithi188_161190_object47854:head# 2024-04-01T19:56:36.191 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94d67e6b:::benchmark_data_smithi188_161190_object119520:head# 2024-04-01T19:56:36.192 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94d70da9:::benchmark_data_smithi188_161190_object74210:head# 2024-04-01T19:56:36.192 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94d7a83c:::benchmark_data_smithi188_161190_object113542:head# 2024-04-01T19:56:36.194 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94d8a20e:::benchmark_data_smithi188_161190_object104697:head# 2024-04-01T19:56:36.194 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94d94d32:::benchmark_data_smithi188_161190_object49614:head# 2024-04-01T19:56:36.194 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94d9fa82:::benchmark_data_smithi188_161190_object54420:head# 2024-04-01T19:56:36.194 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94db1571:::benchmark_data_smithi188_161190_object45946:head# 2024-04-01T19:56:36.194 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94db42d5:::benchmark_data_smithi188_161190_object92275:head# 2024-04-01T19:56:36.195 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94db7ea5:::benchmark_data_smithi188_161190_object59706:head# 2024-04-01T19:56:36.195 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94db9114:::benchmark_data_smithi188_161190_object111817:head# 2024-04-01T19:56:36.196 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94dc6c2e:::benchmark_data_smithi188_161190_object34274:head# 2024-04-01T19:56:36.196 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94dd5118:::benchmark_data_smithi188_161190_object110549:head# 2024-04-01T19:56:36.196 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94dd81a2:::benchmark_data_smithi188_161190_object115269:head# 2024-04-01T19:56:36.197 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94ddd581:::benchmark_data_smithi188_161190_object79110:head# 2024-04-01T19:56:36.197 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94ddfeae:::benchmark_data_smithi188_161190_object97018:head# 2024-04-01T19:56:36.198 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94de01e7:::benchmark_data_smithi188_161190_object119179:head# 2024-04-01T19:56:36.198 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94de1eb2:::benchmark_data_smithi188_161190_object79044:head# 2024-04-01T19:56:36.198 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94de62f1:::benchmark_data_smithi188_161190_object92903:head# 2024-04-01T19:56:36.199 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94deb6f6:::benchmark_data_smithi188_161190_object121248:head# 2024-04-01T19:56:36.199 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94df7d2a:::benchmark_data_smithi188_161190_object116645:head# 2024-04-01T19:56:36.200 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94e0e459:::benchmark_data_smithi188_161190_object119380:head# 2024-04-01T19:56:36.200 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94e11d6c:::benchmark_data_smithi188_161190_object34685:head# 2024-04-01T19:56:36.200 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94e12553:::benchmark_data_smithi188_161190_object72608:head# 2024-04-01T19:56:36.201 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94e1b96c:::benchmark_data_smithi188_161190_object98491:head# 2024-04-01T19:56:36.201 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94e1fc8b:::benchmark_data_smithi188_161190_object89714:head# 2024-04-01T19:56:36.202 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94e24dba:::benchmark_data_smithi188_161190_object25278:head# 2024-04-01T19:56:36.202 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94e2d9c0:::benchmark_data_smithi188_161190_object89775:head# 2024-04-01T19:56:36.207 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94e34b80:::benchmark_data_smithi188_161190_object110822:head# 2024-04-01T19:56:36.207 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94e36279:::benchmark_data_smithi188_161190_object82279:head# 2024-04-01T19:56:36.207 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94e37164:::benchmark_data_smithi188_161190_object38597:head# 2024-04-01T19:56:36.207 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94e37a4c:::benchmark_data_smithi188_161190_object19772:head# 2024-04-01T19:56:36.207 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94e4b907:::benchmark_data_smithi188_161190_object35824:head# 2024-04-01T19:56:36.213 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94e55462:::benchmark_data_smithi188_161190_object64890:head# 2024-04-01T19:56:36.213 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94e63a50:::benchmark_data_smithi188_161190_object88877:head# 2024-04-01T19:56:36.213 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94e93922:::benchmark_data_smithi188_161190_object94557:head# 2024-04-01T19:56:36.213 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94e9cd5a:::benchmark_data_smithi188_161190_object28355:head# 2024-04-01T19:56:36.213 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94ea1957:::benchmark_data_smithi188_161190_object63795:head# 2024-04-01T19:56:36.214 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94ea44bb:::benchmark_data_smithi188_161190_object103270:head# 2024-04-01T19:56:36.214 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94ec0583:::benchmark_data_smithi188_161190_object67939:head# 2024-04-01T19:56:36.214 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94ec067a:::benchmark_data_smithi188_161190_object84929:head# 2024-04-01T19:56:36.215 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94ecb8b8:::benchmark_data_smithi188_161190_object73136:head# 2024-04-01T19:56:36.215 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94ed136e:::benchmark_data_smithi188_161190_object97777:head# 2024-04-01T19:56:36.217 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94ee02f1:::benchmark_data_smithi188_161190_object74809:head# 2024-04-01T19:56:36.218 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94ee6fea:::benchmark_data_smithi188_161190_object113494:head# 2024-04-01T19:56:36.218 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94ef24da:::benchmark_data_smithi188_161190_object99563:head# 2024-04-01T19:56:36.218 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94ef2b1d:::benchmark_data_smithi188_161190_object46442:head# 2024-04-01T19:56:36.218 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94f0d9ab:::benchmark_data_smithi188_161190_object35372:head# 2024-04-01T19:56:36.218 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94f19857:::benchmark_data_smithi188_161190_object101132:head# 2024-04-01T19:56:36.218 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94f1ce0c:::benchmark_data_smithi188_161190_object138965:head# 2024-04-01T19:56:36.219 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94f1fe11:::benchmark_data_smithi188_161190_object123386:head# 2024-04-01T19:56:36.219 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94f2974c:::benchmark_data_smithi188_161190_object117566:head# 2024-04-01T19:56:36.220 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94f2a198:::benchmark_data_smithi188_161190_object74471:head# 2024-04-01T19:56:36.220 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94f334a3:::benchmark_data_smithi188_161190_object85630:head# 2024-04-01T19:56:36.220 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94f3d627:::benchmark_data_smithi188_161190_object113727:head# 2024-04-01T19:56:36.221 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94f4374d:::benchmark_data_smithi188_161190_object70725:head# 2024-04-01T19:56:36.221 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94f5748c:::benchmark_data_smithi188_161190_object125374:head# 2024-04-01T19:56:36.222 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94f57e3d:::benchmark_data_smithi188_161190_object80878:head# 2024-04-01T19:56:36.223 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94f5e3ce:::benchmark_data_smithi188_161190_object93171:head# 2024-04-01T19:56:36.224 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94f63f6e:::benchmark_data_smithi188_161190_object90878:head# 2024-04-01T19:56:36.224 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94f66935:::benchmark_data_smithi188_161190_object73257:head# 2024-04-01T19:56:36.224 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94f6c284:::benchmark_data_smithi188_161190_object68118:head# 2024-04-01T19:56:36.225 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94f6f562:::benchmark_data_smithi188_161190_object80875:head# 2024-04-01T19:56:36.225 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94f778ab:::benchmark_data_smithi188_161190_object67351:head# 2024-04-01T19:56:36.226 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94f7d7fb:::benchmark_data_smithi188_161190_object95480:head# 2024-04-01T19:56:36.226 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94f7f270:::benchmark_data_smithi188_161190_object115673:head# 2024-04-01T19:56:36.228 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94f83dfd:::benchmark_data_smithi188_161190_object96451:head# 2024-04-01T19:56:36.229 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94f8f33b:::benchmark_data_smithi188_161190_object21419:head# 2024-04-01T19:56:36.229 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94f97316:::benchmark_data_smithi188_161190_object70252:head# 2024-04-01T19:56:36.230 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94fb2a05:::benchmark_data_smithi188_161190_object86303:head# 2024-04-01T19:56:36.230 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94fc0f31:::benchmark_data_smithi188_161190_object125867:head# 2024-04-01T19:56:36.230 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94fc3ad4:::benchmark_data_smithi188_161190_object116477:head# 2024-04-01T19:56:36.231 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94fc7a11:::benchmark_data_smithi188_161190_object77447:head# 2024-04-01T19:56:36.231 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94fc819a:::benchmark_data_smithi188_161190_object125301:head# 2024-04-01T19:56:36.232 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94fc9541:::benchmark_data_smithi188_161190_object125519:head# 2024-04-01T19:56:36.236 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94fc98ec:::benchmark_data_smithi188_161190_object54607:head# 2024-04-01T19:56:36.236 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94fca13b:::benchmark_data_smithi188_161190_object62611:head# 2024-04-01T19:56:36.237 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94feabf9:::benchmark_data_smithi188_161190_object99633:head# 2024-04-01T19:56:36.237 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94fed780:::benchmark_data_smithi188_161190_object63599:head# 2024-04-01T19:56:36.237 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94ff029e:::benchmark_data_smithi188_161190_object35157:head# 2024-04-01T19:56:36.237 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94ff070c:::benchmark_data_smithi188_161190_object124535:head# 2024-04-01T19:56:36.237 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94ff398b:::benchmark_data_smithi188_161190_object71548:head# 2024-04-01T19:56:36.237 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:94ffbd2b:::benchmark_data_smithi188_161190_object71598:head# 2024-04-01T19:56:36.237 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:950153df:::benchmark_data_smithi188_161190_object45546:head# 2024-04-01T19:56:36.237 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95018c92:::benchmark_data_smithi188_161190_object100152:head# 2024-04-01T19:56:36.238 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95019b59:::benchmark_data_smithi188_161190_object27145:head# 2024-04-01T19:56:36.238 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9501e891:::benchmark_data_smithi188_161190_object57690:head# 2024-04-01T19:56:36.238 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95024820:::benchmark_data_smithi188_161190_object95394:head# 2024-04-01T19:56:36.238 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:950257c2:::benchmark_data_smithi188_161190_object26454:head# 2024-04-01T19:56:36.241 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9502a75a:::benchmark_data_smithi188_161190_object36846:head# 2024-04-01T19:56:36.241 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9502dfa2:::benchmark_data_smithi188_161190_object104274:head# 2024-04-01T19:56:36.241 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95032e4c:::benchmark_data_smithi188_161190_object103297:head# 2024-04-01T19:56:36.242 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95033d0d:::benchmark_data_smithi188_161190_object50438:head# 2024-04-01T19:56:36.242 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95051555:::benchmark_data_smithi188_161190_object47287:head# 2024-04-01T19:56:36.243 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9505629f:::benchmark_data_smithi188_161190_object69621:head# 2024-04-01T19:56:36.243 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95056940:::benchmark_data_smithi188_161190_object42364:head# 2024-04-01T19:56:36.243 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:950596b3:::benchmark_data_smithi188_161190_object68228:head# 2024-04-01T19:56:36.244 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95074305:::benchmark_data_smithi188_161190_object85153:head# 2024-04-01T19:56:36.244 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95076c62:::benchmark_data_smithi188_161190_object83861:head# 2024-04-01T19:56:36.247 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9507ad40:::benchmark_data_smithi188_161190_object108475:head# 2024-04-01T19:56:36.247 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9507b19d:::benchmark_data_smithi188_161190_object90870:head# 2024-04-01T19:56:36.248 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9508390c:::benchmark_data_smithi188_161190_object57219:head# 2024-04-01T19:56:36.248 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9509001e:::benchmark_data_smithi188_161190_object68834:head# 2024-04-01T19:56:36.249 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95093697:::benchmark_data_smithi188_161190_object43736:head# 2024-04-01T19:56:36.249 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9509fd74:::benchmark_data_smithi188_161190_object80017:head# 2024-04-01T19:56:36.250 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:950a4abd:::benchmark_data_smithi188_161190_object38111:head# 2024-04-01T19:56:36.250 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:950ad6c7:::benchmark_data_smithi188_161190_object105248:head# 2024-04-01T19:56:36.251 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:950b9992:::benchmark_data_smithi188_161190_object127197:head# 2024-04-01T19:56:36.251 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:950c0d51:::benchmark_data_smithi188_161190_object107404:head# 2024-04-01T19:56:36.251 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:950cc81a:::benchmark_data_smithi188_161190_object89352:head# 2024-04-01T19:56:36.252 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:950ed6a4:::benchmark_data_smithi188_161190_object128624:head# 2024-04-01T19:56:36.252 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:950ef053:::benchmark_data_smithi188_161190_object117452:head# 2024-04-01T19:56:36.253 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:950f2464:::benchmark_data_smithi188_161190_object69250:head# 2024-04-01T19:56:36.253 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95102941:::benchmark_data_smithi188_161190_object103651:head# 2024-04-01T19:56:36.254 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:951084b8:::benchmark_data_smithi188_161190_object104585:head# 2024-04-01T19:56:36.254 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:951172d0:::benchmark_data_smithi188_161190_object99952:head# 2024-04-01T19:56:36.255 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9511dccc:::benchmark_data_smithi188_161190_object128176:head# 2024-04-01T19:56:36.255 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9512c66b:::benchmark_data_smithi188_161190_object97199:head# 2024-04-01T19:56:36.256 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9512ef7a:::benchmark_data_smithi188_161190_object50069:head# 2024-04-01T19:56:36.256 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95145850:::benchmark_data_smithi188_161190_object98481:head# 2024-04-01T19:56:36.257 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9514a54a:::benchmark_data_smithi188_161190_object123390:head# 2024-04-01T19:56:36.257 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9514b5de:::benchmark_data_smithi188_161190_object58122:head# 2024-04-01T19:56:36.258 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9514b622:::benchmark_data_smithi188_161190_object120555:head# 2024-04-01T19:56:36.258 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9514d88a:::benchmark_data_smithi188_161190_object38654:head# 2024-04-01T19:56:36.259 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9514ebac:::benchmark_data_smithi188_161190_object78974:head# 2024-04-01T19:56:36.259 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9517bf85:::benchmark_data_smithi188_161190_object104003:head# 2024-04-01T19:56:36.260 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9518179c:::benchmark_data_smithi188_161190_object50492:head# 2024-04-01T19:56:36.260 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9518f374:::benchmark_data_smithi188_161190_object92114:head# 2024-04-01T19:56:36.260 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9518ffc6:::benchmark_data_smithi188_161190_object85216:head# 2024-04-01T19:56:36.261 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95191517:::benchmark_data_smithi188_161190_object133980:head# 2024-04-01T19:56:36.261 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9519e703:::benchmark_data_smithi188_161190_object23419:head# 2024-04-01T19:56:36.262 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:951a5627:::benchmark_data_smithi188_161190_object92548:head# 2024-04-01T19:56:36.262 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:951bad30:::benchmark_data_smithi188_161190_object118558:head# 2024-04-01T19:56:36.262 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:951d1411:::benchmark_data_smithi188_161190_object45456:head# 2024-04-01T19:56:36.263 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:951e3bf3:::benchmark_data_smithi188_161190_object46892:head# 2024-04-01T19:56:36.263 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:951e4d75:::benchmark_data_smithi188_161190_object133937:head# 2024-04-01T19:56:36.264 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:951e5c66:::benchmark_data_smithi188_161190_object75583:head# 2024-04-01T19:56:36.264 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:951e6b2c:::benchmark_data_smithi188_161190_object57103:head# 2024-04-01T19:56:36.264 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:951ede25:::benchmark_data_smithi188_161190_object77596:head# 2024-04-01T19:56:36.265 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:951ee805:::benchmark_data_smithi188_161190_object110057:head# 2024-04-01T19:56:36.265 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:951ef801:::benchmark_data_smithi188_161190_object114252:head# 2024-04-01T19:56:36.266 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95200756:::benchmark_data_smithi188_161190_object94375:head# 2024-04-01T19:56:36.266 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9520520e:::benchmark_data_smithi188_161190_object95495:head# 2024-04-01T19:56:36.267 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95216ced:::benchmark_data_smithi188_161190_object69125:head# 2024-04-01T19:56:36.267 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9521bc70:::benchmark_data_smithi188_161190_object66094:head# 2024-04-01T19:56:36.268 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95231cf2:::benchmark_data_smithi188_161190_object108961:head# 2024-04-01T19:56:36.268 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:952342bb:::benchmark_data_smithi188_161190_object127576:head# 2024-04-01T19:56:36.269 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95247ce5:::benchmark_data_smithi188_161190_object108767:head# 2024-04-01T19:56:36.269 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9524fbcd:::benchmark_data_smithi188_161190_object58372:head# 2024-04-01T19:56:36.270 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9525d27c:::benchmark_data_smithi188_161190_object63857:head# 2024-04-01T19:56:36.270 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9525ff70:::benchmark_data_smithi188_161190_object96102:head# 2024-04-01T19:56:36.270 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95262e47:::benchmark_data_smithi188_161190_object85200:head# 2024-04-01T19:56:36.271 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95265bd1:::benchmark_data_smithi188_161190_object53472:head# 2024-04-01T19:56:36.271 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:952814f1:::benchmark_data_smithi188_161190_object52584:head# 2024-04-01T19:56:36.272 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95285ecd:::benchmark_data_smithi188_161190_object105423:head# 2024-04-01T19:56:36.275 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9528d54c:::benchmark_data_smithi188_161190_object22331:head# 2024-04-01T19:56:36.275 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9528d833:::benchmark_data_smithi188_161190_object55816:head# 2024-04-01T19:56:36.276 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:952a467b:::benchmark_data_smithi188_161190_object79506:head# 2024-04-01T19:56:36.276 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:952a841d:::benchmark_data_smithi188_161190_object130089:head# 2024-04-01T19:56:36.276 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:952b5a36:::benchmark_data_smithi188_161190_object134668:head# 2024-04-01T19:56:36.276 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:952e1189:::benchmark_data_smithi188_161190_object128357:head# 2024-04-01T19:56:36.276 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:952e49c3:::benchmark_data_smithi188_161190_object104837:head# 2024-04-01T19:56:36.276 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:952f0c19:::benchmark_data_smithi188_161190_object30504:head# 2024-04-01T19:56:36.276 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:952f5d59:::benchmark_data_smithi188_161190_object25936:head# 2024-04-01T19:56:36.276 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9530b6e8:::benchmark_data_smithi188_161190_object104067:head# 2024-04-01T19:56:36.278 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9530c5d9:::benchmark_data_smithi188_161190_object93853:head# 2024-04-01T19:56:36.278 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9530fcd1:::benchmark_data_smithi188_161190_object75685:head# 2024-04-01T19:56:36.278 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95317b4e:::benchmark_data_smithi188_161190_object89341:head# 2024-04-01T19:56:36.278 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95317d96:::benchmark_data_smithi188_161190_object130456:head# 2024-04-01T19:56:36.279 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9531db5c:::benchmark_data_smithi188_161190_object40805:head# 2024-04-01T19:56:36.279 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:953272d0:::benchmark_data_smithi188_161190_object42015:head# 2024-04-01T19:56:36.279 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9533d1a7:::benchmark_data_smithi188_161190_object98067:head# 2024-04-01T19:56:36.280 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9534ea45:::benchmark_data_smithi188_161190_object69127:head# 2024-04-01T19:56:36.280 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:953571b4:::benchmark_data_smithi188_161190_object123091:head# 2024-04-01T19:56:36.280 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9536c0a5:::benchmark_data_smithi188_161190_object43720:head# 2024-04-01T19:56:36.281 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9537650e:::benchmark_data_smithi188_161190_object138138:head# 2024-04-01T19:56:36.281 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9537a33e:::benchmark_data_smithi188_161190_object70777:head# 2024-04-01T19:56:36.282 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9537c4ec:::benchmark_data_smithi188_161190_object110384:head# 2024-04-01T19:56:36.282 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95387689:::benchmark_data_smithi188_161190_object90452:head# 2024-04-01T19:56:36.283 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:953940a5:::benchmark_data_smithi188_161190_object69754:head# 2024-04-01T19:56:36.283 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9539c120:::benchmark_data_smithi188_161190_object35779:head# 2024-04-01T19:56:36.283 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:953a9926:::benchmark_data_smithi188_161190_object65859:head# 2024-04-01T19:56:36.284 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:953ac87c:::benchmark_data_smithi188_161190_object101136:head# 2024-04-01T19:56:36.284 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:953ad952:::benchmark_data_smithi188_161190_object52390:head# 2024-04-01T19:56:36.285 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:953b0650:::benchmark_data_smithi188_161190_object54176:head# 2024-04-01T19:56:36.285 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:953ce93c:::benchmark_data_smithi188_161190_object80821:head# 2024-04-01T19:56:36.286 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:953d4fe1:::benchmark_data_smithi188_161190_object52841:head# 2024-04-01T19:56:36.286 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:953e7495:::benchmark_data_smithi188_161190_object89520:head# 2024-04-01T19:56:36.287 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:953ec7ed:::benchmark_data_smithi188_161190_object116093:head# 2024-04-01T19:56:36.287 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:953feb73:::benchmark_data_smithi188_161190_object27778:head# 2024-04-01T19:56:36.288 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9540f7c2:::benchmark_data_smithi188_161190_object66216:head# 2024-04-01T19:56:36.288 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95417443:::benchmark_data_smithi188_161190_object136070:head# 2024-04-01T19:56:36.289 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9541fff1:::benchmark_data_smithi188_161190_object30349:head# 2024-04-01T19:56:36.289 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95425b55:::benchmark_data_smithi188_161190_object74215:head# 2024-04-01T19:56:36.289 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95429199:::benchmark_data_smithi188_161190_object129929:head# 2024-04-01T19:56:36.290 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95455888:::benchmark_data_smithi188_161190_object107310:head# 2024-04-01T19:56:36.291 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9545afd4:::benchmark_data_smithi188_161190_object133782:head# 2024-04-01T19:56:36.291 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9545b059:::benchmark_data_smithi188_161190_object124141:head# 2024-04-01T19:56:36.292 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95471147:::benchmark_data_smithi188_161190_object39708:head# 2024-04-01T19:56:36.294 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95473a8d:::benchmark_data_smithi188_161190_object119785:head# 2024-04-01T19:56:36.294 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:954800e9:::benchmark_data_smithi188_161190_object47723:head# 2024-04-01T19:56:36.294 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95486733:::benchmark_data_smithi188_161190_object130793:head# 2024-04-01T19:56:36.295 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:954970d7:::benchmark_data_smithi188_161190_object96061:head# 2024-04-01T19:56:36.295 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9549a587:::benchmark_data_smithi188_161190_object105538:head# 2024-04-01T19:56:36.295 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:954a9efa:::benchmark_data_smithi188_161190_object122994:head# 2024-04-01T19:56:36.296 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:954aa329:::benchmark_data_smithi188_161190_object118923:head# 2024-04-01T19:56:36.296 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:954abbba:::benchmark_data_smithi188_161190_object106304:head# 2024-04-01T19:56:36.297 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:954af765:::benchmark_data_smithi188_161190_object135004:head# 2024-04-01T19:56:36.297 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:954b14ab:::benchmark_data_smithi188_161190_object47773:head# 2024-04-01T19:56:36.297 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:954b6b85:::benchmark_data_smithi188_161190_object50805:head# 2024-04-01T19:56:36.298 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:954bb8bb:::benchmark_data_smithi188_161190_object42861:head# 2024-04-01T19:56:36.298 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:954c193f:::benchmark_data_smithi188_161190_object97405:head# 2024-04-01T19:56:36.299 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:954c4ade:::benchmark_data_smithi188_161190_object101736:head# 2024-04-01T19:56:36.300 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:954e9381:::benchmark_data_smithi188_161190_object113571:head# 2024-04-01T19:56:36.300 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:954eba45:::benchmark_data_smithi188_161190_object54722:head# 2024-04-01T19:56:36.300 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:954edb3e:::benchmark_data_smithi188_161190_object48369:head# 2024-04-01T19:56:36.301 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9550c2cf:::benchmark_data_smithi188_161190_object65464:head# 2024-04-01T19:56:36.301 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9551990b:::benchmark_data_smithi188_161190_object94729:head# 2024-04-01T19:56:36.302 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9551d2d0:::benchmark_data_smithi188_161190_object23255:head# 2024-04-01T19:56:36.302 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:955222d0:::benchmark_data_smithi188_161190_object39209:head# 2024-04-01T19:56:36.303 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:955303c9:::benchmark_data_smithi188_161190_object66354:head# 2024-04-01T19:56:36.303 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95538d7f:::benchmark_data_smithi188_161190_object98924:head# 2024-04-01T19:56:36.304 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9553aef9:::benchmark_data_smithi188_161190_object52384:head# 2024-04-01T19:56:36.304 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9553ca7d:::benchmark_data_smithi188_161190_object74545:head# 2024-04-01T19:56:36.305 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95545346:::benchmark_data_smithi188_161190_object63812:head# 2024-04-01T19:56:36.305 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9554d77c:::benchmark_data_smithi188_161190_object63608:head# 2024-04-01T19:56:36.306 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9554e086:::benchmark_data_smithi188_161190_object60154:head# 2024-04-01T19:56:36.306 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95552094:::benchmark_data_smithi188_161190_object101053:head# 2024-04-01T19:56:36.307 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95557e1a:::benchmark_data_smithi188_161190_object39232:head# 2024-04-01T19:56:36.307 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9555b819:::benchmark_data_smithi188_161190_object72679:head# 2024-04-01T19:56:36.308 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9555f12b:::benchmark_data_smithi188_161190_object90186:head# 2024-04-01T19:56:36.308 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95562bb3:::benchmark_data_smithi188_161190_object63937:head# 2024-04-01T19:56:36.308 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95564dcd:::benchmark_data_smithi188_161190_object117699:head# 2024-04-01T19:56:36.309 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9557ac73:::benchmark_data_smithi188_161190_object135117:head# 2024-04-01T19:56:36.309 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9557f07e:::benchmark_data_smithi188_161190_object77627:head# 2024-04-01T19:56:36.310 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9558c286:::benchmark_data_smithi188_161190_object70560:head# 2024-04-01T19:56:36.310 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9559414b:::benchmark_data_smithi188_161190_object72516:head# 2024-04-01T19:56:36.311 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95599eb6:::benchmark_data_smithi188_161190_object55295:head# 2024-04-01T19:56:36.311 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:955bcf9e:::benchmark_data_smithi188_161190_object95120:head# 2024-04-01T19:56:36.312 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:955d50d0:::benchmark_data_smithi188_161190_object126120:head# 2024-04-01T19:56:36.312 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:955d5588:::benchmark_data_smithi188_161190_object114526:head# 2024-04-01T19:56:36.312 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:955edb67:::benchmark_data_smithi188_161190_object133322:head# 2024-04-01T19:56:36.313 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:955ef7c4:::benchmark_data_smithi188_161190_object23478:head# 2024-04-01T19:56:36.313 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:955f21ac:::benchmark_data_smithi188_161190_object50305:head# 2024-04-01T19:56:36.314 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:955f465f:::benchmark_data_smithi188_161190_object54020:head# 2024-04-01T19:56:36.314 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:955ffe27:::benchmark_data_smithi188_161190_object40004:head# 2024-04-01T19:56:36.315 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95600f0b:::benchmark_data_smithi188_161190_object80509:head# 2024-04-01T19:56:36.315 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9560e8de:::benchmark_data_smithi188_161190_object123543:head# 2024-04-01T19:56:36.316 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:956149ac:::benchmark_data_smithi188_161190_object33691:head# 2024-04-01T19:56:36.316 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9562a447:::benchmark_data_smithi188_161190_object59608:head# 2024-04-01T19:56:36.317 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9562c78d:::benchmark_data_smithi188_161190_object80120:head# 2024-04-01T19:56:36.317 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95635fc9:::benchmark_data_smithi188_161190_object54052:head# 2024-04-01T19:56:36.317 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:956378c6:::benchmark_data_smithi188_161190_object61407:head# 2024-04-01T19:56:36.318 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9563b52c:::benchmark_data_smithi188_161190_object54316:head# 2024-04-01T19:56:36.319 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9564a236:::benchmark_data_smithi188_161190_object125695:head# 2024-04-01T19:56:36.322 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9564e2ee:::benchmark_data_smithi188_161190_object121071:head# 2024-04-01T19:56:36.322 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9565be3a:::benchmark_data_smithi188_161190_object122092:head# 2024-04-01T19:56:36.323 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95665b7c:::benchmark_data_smithi188_161190_object44889:head# 2024-04-01T19:56:36.323 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95666d5f:::benchmark_data_smithi188_161190_object133763:head# 2024-04-01T19:56:36.323 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9566a50f:::benchmark_data_smithi188_161190_object55075:head# 2024-04-01T19:56:36.323 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9566ae20:::benchmark_data_smithi188_161190_object56800:head# 2024-04-01T19:56:36.323 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9567d2a4:::benchmark_data_smithi188_161190_object35798:head# 2024-04-01T19:56:36.324 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95683845:::benchmark_data_smithi188_161190_object76477:head# 2024-04-01T19:56:36.324 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95692f34:::benchmark_data_smithi188_161190_object136623:head# 2024-04-01T19:56:36.324 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:956a1d55:::benchmark_data_smithi188_161190_object93249:head# 2024-04-01T19:56:36.324 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:956b45f0:::benchmark_data_smithi188_161190_object41604:head# 2024-04-01T19:56:36.325 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:956b9ba5:::benchmark_data_smithi188_161190_object86469:head# 2024-04-01T19:56:36.325 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:956c449a:::benchmark_data_smithi188_161190_object107457:head# 2024-04-01T19:56:36.325 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:956db4a9:::benchmark_data_smithi188_161190_object124531:head# 2024-04-01T19:56:36.326 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:956e30ff:::benchmark_data_smithi188_161190_object103456:head# 2024-04-01T19:56:36.326 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:956e4bdb:::benchmark_data_smithi188_161190_object48951:head# 2024-04-01T19:56:36.327 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:956e55fa:::benchmark_data_smithi188_161190_object73070:head# 2024-04-01T19:56:36.327 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:956e841d:::benchmark_data_smithi188_161190_object103025:head# 2024-04-01T19:56:36.328 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:956f3a04:::benchmark_data_smithi188_161190_object32915:head# 2024-04-01T19:56:36.328 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95700859:::benchmark_data_smithi188_161190_object123481:head# 2024-04-01T19:56:36.328 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95706f9d:::benchmark_data_smithi188_161190_object72193:head# 2024-04-01T19:56:36.329 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9570e9a0:::benchmark_data_smithi188_161190_object77203:head# 2024-04-01T19:56:36.329 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:957174ce:::benchmark_data_smithi188_161190_object75523:head# 2024-04-01T19:56:36.330 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95724811:::benchmark_data_smithi188_161190_object87840:head# 2024-04-01T19:56:36.330 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95724ee5:::benchmark_data_smithi188_161190_object90651:head# 2024-04-01T19:56:36.331 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9572c22c:::benchmark_data_smithi188_161190_object121440:head# 2024-04-01T19:56:36.333 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95730d18:::benchmark_data_smithi188_161190_object24662:head# 2024-04-01T19:56:36.333 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9573a7a5:::benchmark_data_smithi188_161190_object131997:head# 2024-04-01T19:56:36.333 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9574700a:::benchmark_data_smithi188_161190_object120414:head# 2024-04-01T19:56:36.333 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9574896d:::benchmark_data_smithi188_161190_object62808:head# 2024-04-01T19:56:36.334 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9574c863:::benchmark_data_smithi188_161190_object41591:head# 2024-04-01T19:56:36.334 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9575134f:::benchmark_data_smithi188_161190_object117379:head# 2024-04-01T19:56:36.339 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95754d05:::benchmark_data_smithi188_161190_object137805:head# 2024-04-01T19:56:36.339 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:957570ba:::benchmark_data_smithi188_161190_object63326:head# 2024-04-01T19:56:36.339 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9575e451:::benchmark_data_smithi188_161190_object74352:head# 2024-04-01T19:56:36.339 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95761f9f:::benchmark_data_smithi188_161190_object131084:head# 2024-04-01T19:56:36.339 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9576e9aa:::benchmark_data_smithi188_161190_object38546:head# 2024-04-01T19:56:36.339 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9576ec0b:::benchmark_data_smithi188_161190_object97482:head# 2024-04-01T19:56:36.340 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:957746df:::benchmark_data_smithi188_161190_object98513:head# 2024-04-01T19:56:36.340 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95776385:::benchmark_data_smithi188_161190_object137034:head# 2024-04-01T19:56:36.340 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9577a62f:::benchmark_data_smithi188_161190_object115953:head# 2024-04-01T19:56:36.340 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9577b61c:::benchmark_data_smithi188_161190_object40019:head# 2024-04-01T19:56:36.340 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95781885:::benchmark_data_smithi188_161190_object36083:head# 2024-04-01T19:56:36.341 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95788f01:::benchmark_data_smithi188_161190_object59393:head# 2024-04-01T19:56:36.341 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9578922c:::benchmark_data_smithi188_161190_object120440:head# 2024-04-01T19:56:36.341 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9579e42c:::benchmark_data_smithi188_161190_object35384:head# 2024-04-01T19:56:36.341 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:957a44bd:::benchmark_data_smithi188_161190_object68530:head# 2024-04-01T19:56:36.341 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:957ab4ba:::benchmark_data_smithi188_161190_object132497:head# 2024-04-01T19:56:36.341 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:957ac752:::benchmark_data_smithi188_161190_object33217:head# 2024-04-01T19:56:36.342 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:957b3dd8:::benchmark_data_smithi188_161190_object98185:head# 2024-04-01T19:56:36.342 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:957ced6e:::benchmark_data_smithi188_161190_object138578:head# 2024-04-01T19:56:36.342 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:957d24ea:::benchmark_data_smithi188_161190_object73713:head# 2024-04-01T19:56:36.343 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:957d8214:::benchmark_data_smithi188_161190_object106362:head# 2024-04-01T19:56:36.343 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:957dac8f:::benchmark_data_smithi188_161190_object99211:head# 2024-04-01T19:56:36.344 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:957e029e:::benchmark_data_smithi188_161190_object82010:head# 2024-04-01T19:56:36.344 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:957e97d1:::benchmark_data_smithi188_161190_object96074:head# 2024-04-01T19:56:36.345 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:957ef5a5:::benchmark_data_smithi188_161190_object64319:head# 2024-04-01T19:56:36.345 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:957f60cc:::benchmark_data_smithi188_161190_object126758:head# 2024-04-01T19:56:36.345 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95808f24:::benchmark_data_smithi188_161190_object98829:head# 2024-04-01T19:56:36.346 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9580c46c:::benchmark_data_smithi188_161190_object66329:head# 2024-04-01T19:56:36.346 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:958140e5:::benchmark_data_smithi188_161190_object63203:head# 2024-04-01T19:56:36.347 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95817d88:::benchmark_data_smithi188_161190_object109555:head# 2024-04-01T19:56:36.347 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:958223c3:::benchmark_data_smithi188_161190_object52612:head# 2024-04-01T19:56:36.347 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9582b680:::benchmark_data_smithi188_161190_object56175:head# 2024-04-01T19:56:36.348 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95832f91:::benchmark_data_smithi188_161190_object69259:head# 2024-04-01T19:56:36.348 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9584c3c6:::benchmark_data_smithi188_161190_object124594:head# 2024-04-01T19:56:36.349 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:958547ca:::benchmark_data_smithi188_161190_object70665:head# 2024-04-01T19:56:36.349 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95859a19:::benchmark_data_smithi188_161190_object48045:head# 2024-04-01T19:56:36.350 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95859e0a:::benchmark_data_smithi188_161190_object40723:head# 2024-04-01T19:56:36.350 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95869dc3:::benchmark_data_smithi188_161190_object34289:head# 2024-04-01T19:56:36.351 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9586c981:::benchmark_data_smithi188_161190_object112425:head# 2024-04-01T19:56:36.351 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95885bcb:::benchmark_data_smithi188_161190_object110072:head# 2024-04-01T19:56:36.352 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95895b50:::benchmark_data_smithi188_161190_object39746:head# 2024-04-01T19:56:36.352 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95896856:::benchmark_data_smithi188_161190_object124399:head# 2024-04-01T19:56:36.353 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:958a8189:::benchmark_data_smithi188_161190_object62741:head# 2024-04-01T19:56:36.353 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:958ad7f4:::benchmark_data_smithi188_161190_object84746:head# 2024-04-01T19:56:36.353 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:958ad936:::benchmark_data_smithi188_161190_object50772:head# 2024-04-01T19:56:36.354 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:958b7384:::benchmark_data_smithi188_161190_object123741:head# 2024-04-01T19:56:36.358 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:958bb2dc:::benchmark_data_smithi188_161190_object131901:head# 2024-04-01T19:56:36.358 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:958bd255:::benchmark_data_smithi188_161190_object39744:head# 2024-04-01T19:56:36.358 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:958bf298:::benchmark_data_smithi188_161190_object23598:head# 2024-04-01T19:56:36.358 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:958c4c03:::benchmark_data_smithi188_161190_object139160:head# 2024-04-01T19:56:36.358 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:958c751e:::benchmark_data_smithi188_161190_object125975:head# 2024-04-01T19:56:36.359 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:958c946c:::benchmark_data_smithi188_161190_object54097:head# 2024-04-01T19:56:36.359 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:958d7f73:::benchmark_data_smithi188_161190_object104753:head# 2024-04-01T19:56:36.359 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:958d9639:::benchmark_data_smithi188_161190_object96593:head# 2024-04-01T19:56:36.359 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:958da3c3:::benchmark_data_smithi188_161190_object120480:head# 2024-04-01T19:56:36.359 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:958dff12:::benchmark_data_smithi188_161190_object88453:head# 2024-04-01T19:56:36.359 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:958eaf9a:::benchmark_data_smithi188_161190_object99927:head# 2024-04-01T19:56:36.362 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:958f9989:::benchmark_data_smithi188_161190_object103618:head# 2024-04-01T19:56:36.363 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95900771:::benchmark_data_smithi188_161190_object76127:head# 2024-04-01T19:56:36.363 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:959009e8:::benchmark_data_smithi188_161190_object104128:head# 2024-04-01T19:56:36.363 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95916230:::benchmark_data_smithi188_161190_object112862:head# 2024-04-01T19:56:36.363 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95919c84:::benchmark_data_smithi188_161190_object128331:head# 2024-04-01T19:56:36.363 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9591b43f:::benchmark_data_smithi188_161190_object85081:head# 2024-04-01T19:56:36.363 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9591d7a9:::benchmark_data_smithi188_161190_object99045:head# 2024-04-01T19:56:36.363 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9591eb8b:::benchmark_data_smithi188_161190_object58654:head# 2024-04-01T19:56:36.364 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95924a73:::benchmark_data_smithi188_161190_object81981:head# 2024-04-01T19:56:36.364 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95957817:::benchmark_data_smithi188_161190_object42791:head# 2024-04-01T19:56:36.364 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9596eacf:::benchmark_data_smithi188_161190_object45448:head# 2024-04-01T19:56:36.364 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95976857:::benchmark_data_smithi188_161190_object86614:head# 2024-04-01T19:56:36.365 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9598238e:::benchmark_data_smithi188_161190_object89081:head# 2024-04-01T19:56:36.365 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95999710:::benchmark_data_smithi188_161190_object111632:head# 2024-04-01T19:56:36.366 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9599e658:::benchmark_data_smithi188_161190_object62986:head# 2024-04-01T19:56:36.366 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9599fba1:::benchmark_data_smithi188_161190_object95828:head# 2024-04-01T19:56:36.366 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:959a3af3:::benchmark_data_smithi188_161190_object22197:head# 2024-04-01T19:56:36.367 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:959a5a5a:::benchmark_data_smithi188_161190_object53725:head# 2024-04-01T19:56:36.367 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:959a5cae:::benchmark_data_smithi188_161190_object111217:head# 2024-04-01T19:56:36.368 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:959a6eab:::benchmark_data_smithi188_161190_object56315:head# 2024-04-01T19:56:36.368 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:959b0c9c:::benchmark_data_smithi188_161190_object34097:head# 2024-04-01T19:56:36.369 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:959ce916:::benchmark_data_smithi188_161190_object110896:head# 2024-04-01T19:56:36.370 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:959d7f2e:::benchmark_data_smithi188_161190_object21945:head# 2024-04-01T19:56:36.370 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:959dc96f:::benchmark_data_smithi188_161190_object19886:head# 2024-04-01T19:56:36.371 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:959e5631:::benchmark_data_smithi188_161190_object91854:head# 2024-04-01T19:56:36.372 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:959f3044:::benchmark_data_smithi188_161190_object77908:head# 2024-04-01T19:56:36.372 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95a0d0ab:::benchmark_data_smithi188_161190_object98541:head# 2024-04-01T19:56:36.373 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95a1939f:::benchmark_data_smithi188_161190_object105868:head# 2024-04-01T19:56:36.373 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95a30b24:::benchmark_data_smithi188_161190_object139179:head# 2024-04-01T19:56:36.373 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95a36c95:::benchmark_data_smithi188_161190_object85627:head# 2024-04-01T19:56:36.374 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95a374fd:::benchmark_data_smithi188_161190_object137412:head# 2024-04-01T19:56:36.374 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95a4b6c9:::benchmark_data_smithi188_161190_object81806:head# 2024-04-01T19:56:36.375 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95a51f07:::benchmark_data_smithi188_161190_object119045:head# 2024-04-01T19:56:36.375 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95a59e51:::benchmark_data_smithi188_161190_object39275:head# 2024-04-01T19:56:36.376 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95a5b330:::benchmark_data_smithi188_161190_object55505:head# 2024-04-01T19:56:36.376 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95a60011:::benchmark_data_smithi188_161190_object124390:head# 2024-04-01T19:56:36.379 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95a626c3:::benchmark_data_smithi188_161190_object56299:head# 2024-04-01T19:56:36.379 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95a7bf99:::benchmark_data_smithi188_161190_object102372:head# 2024-04-01T19:56:36.379 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95a7c9e7:::benchmark_data_smithi188_161190_object78567:head# 2024-04-01T19:56:36.380 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95a8ce6a:::benchmark_data_smithi188_161190_object102400:head# 2024-04-01T19:56:36.380 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95a8d975:::benchmark_data_smithi188_161190_object39376:head# 2024-04-01T19:56:36.380 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95a9376a:::benchmark_data_smithi188_161190_object45887:head# 2024-04-01T19:56:36.380 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95a93e39:::benchmark_data_smithi188_161190_object82575:head# 2024-04-01T19:56:36.380 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95a94cf6:::benchmark_data_smithi188_161190_object106843:head# 2024-04-01T19:56:36.380 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95aaa37c:::benchmark_data_smithi188_161190_object130346:head# 2024-04-01T19:56:36.380 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95ab3f58:::benchmark_data_smithi188_161190_object32398:head# 2024-04-01T19:56:36.381 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95ab7972:::benchmark_data_smithi188_161190_object63757:head# 2024-04-01T19:56:36.381 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95ac18fe:::benchmark_data_smithi188_161190_object78827:head# 2024-04-01T19:56:36.382 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95ac4113:::benchmark_data_smithi188_161190_object107987:head# 2024-04-01T19:56:36.382 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95ace903:::benchmark_data_smithi188_161190_object125147:head# 2024-04-01T19:56:36.383 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95ad497f:::benchmark_data_smithi188_161190_object116664:head# 2024-04-01T19:56:36.383 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95adbfc3:::benchmark_data_smithi188_161190_object98249:head# 2024-04-01T19:56:36.384 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95ae0951:::benchmark_data_smithi188_161190_object67656:head# 2024-04-01T19:56:36.384 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95ae5bf0:::benchmark_data_smithi188_161190_object45867:head# 2024-04-01T19:56:36.384 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95afabd4:::benchmark_data_smithi188_161190_object131113:head# 2024-04-01T19:56:36.385 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95b04ca7:::benchmark_data_smithi188_161190_object112645:head# 2024-04-01T19:56:36.385 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95b0b638:::benchmark_data_smithi188_161190_object127218:head# 2024-04-01T19:56:36.386 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95b16144:::benchmark_data_smithi188_161190_object24172:head# 2024-04-01T19:56:36.386 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95b166ac:::benchmark_data_smithi188_161190_object81650:head# 2024-04-01T19:56:36.387 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95b33af4:::benchmark_data_smithi188_161190_object93700:head# 2024-04-01T19:56:36.387 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95b38664:::benchmark_data_smithi188_161190_object56019:head# 2024-04-01T19:56:36.388 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95b38fc8:::benchmark_data_smithi188_161190_object137721:head# 2024-04-01T19:56:36.388 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95b45f2e:::benchmark_data_smithi188_161190_object94740:head# 2024-04-01T19:56:36.389 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95b512a4:::benchmark_data_smithi188_161190_object24853:head# 2024-04-01T19:56:36.389 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95b6bb6f:::benchmark_data_smithi188_161190_object134761:head# 2024-04-01T19:56:36.389 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95b6f921:::benchmark_data_smithi188_161190_object119046:head# 2024-04-01T19:56:36.390 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95b74129:::benchmark_data_smithi188_161190_object112210:head# 2024-04-01T19:56:36.390 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95b95bf0:::benchmark_data_smithi188_161190_object109381:head# 2024-04-01T19:56:36.391 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95ba6f37:::benchmark_data_smithi188_161190_object101603:head# 2024-04-01T19:56:36.391 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95bbd995:::benchmark_data_smithi188_161190_object131686:head# 2024-04-01T19:56:36.392 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95bbeea6:::benchmark_data_smithi188_161190_object21753:head# 2024-04-01T19:56:36.392 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95bc6d7f:::benchmark_data_smithi188_161190_object61138:head# 2024-04-01T19:56:36.392 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95bd2cca:::benchmark_data_smithi188_161190_object110156:head# 2024-04-01T19:56:36.393 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95bd3044:::benchmark_data_smithi188_161190_object87475:head# 2024-04-01T19:56:36.393 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95be00ba:::benchmark_data_smithi188_161190_object76583:head# 2024-04-01T19:56:36.394 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95bf269a:::benchmark_data_smithi188_161190_object27705:head# 2024-04-01T19:56:36.394 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95bf4418:::benchmark_data_smithi188_161190_object76527:head# 2024-04-01T19:56:36.394 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95bfc2d0:::benchmark_data_smithi188_161190_object131871:head# 2024-04-01T19:56:36.395 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95bfce49:::benchmark_data_smithi188_161190_object29823:head# 2024-04-01T19:56:36.395 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95bfde6d:::benchmark_data_smithi188_161190_object44566:head# 2024-04-01T19:56:36.396 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95bff887:::benchmark_data_smithi188_161190_object131306:head# 2024-04-01T19:56:36.396 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95c027e8:::benchmark_data_smithi188_161190_object123139:head# 2024-04-01T19:56:36.396 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95c05747:::benchmark_data_smithi188_161190_object26413:head# 2024-04-01T19:56:36.397 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95c1e8a1:::benchmark_data_smithi188_161190_object110425:head# 2024-04-01T19:56:36.397 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95c1fd3f:::benchmark_data_smithi188_161190_object89796:head# 2024-04-01T19:56:36.398 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95c2de4e:::benchmark_data_smithi188_161190_object85955:head# 2024-04-01T19:56:36.398 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95c383c4:::benchmark_data_smithi188_161190_object69766:head# 2024-04-01T19:56:36.399 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95c3919d:::benchmark_data_smithi188_161190_object80576:head# 2024-04-01T19:56:36.399 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95c3ee4a:::benchmark_data_smithi188_161190_object30119:head# 2024-04-01T19:56:36.399 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95c4100b:::benchmark_data_smithi188_161190_object29260:head# 2024-04-01T19:56:36.400 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95c4323d:::benchmark_data_smithi188_161190_object132438:head# 2024-04-01T19:56:36.400 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95c432b5:::benchmark_data_smithi188_161190_object129204:head# 2024-04-01T19:56:36.401 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95c69a1d:::benchmark_data_smithi188_161190_object92139:head# 2024-04-01T19:56:36.401 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95c6d066:::benchmark_data_smithi188_161190_object24626:head# 2024-04-01T19:56:36.402 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95c6dc13:::benchmark_data_smithi188_161190_object32738:head# 2024-04-01T19:56:36.402 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95c80462:::benchmark_data_smithi188_161190_object57840:head# 2024-04-01T19:56:36.403 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95c81a73:::benchmark_data_smithi188_161190_object131356:head# 2024-04-01T19:56:36.403 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95c9418d:::benchmark_data_smithi188_161190_object78069:head# 2024-04-01T19:56:36.404 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95ca2603:::benchmark_data_smithi188_161190_object41159:head# 2024-04-01T19:56:36.404 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95cb2cdf:::benchmark_data_smithi188_161190_object61932:head# 2024-04-01T19:56:36.404 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95cb5081:::benchmark_data_smithi188_161190_object77257:head# 2024-04-01T19:56:36.405 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95cbaa18:::benchmark_data_smithi188_161190_object130777:head# 2024-04-01T19:56:36.405 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95cc38bc:::benchmark_data_smithi188_161190_object28254:head# 2024-04-01T19:56:36.406 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95ccac5e:::benchmark_data_smithi188_161190_object58211:head# 2024-04-01T19:56:36.406 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95cdaed2:::benchmark_data_smithi188_161190_object53042:head# 2024-04-01T19:56:36.407 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95cddb2f:::benchmark_data_smithi188_161190_object113820:head# 2024-04-01T19:56:36.407 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95ce39b5:::benchmark_data_smithi188_161190_object29113:head# 2024-04-01T19:56:36.407 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95cfd9f8:::benchmark_data_smithi188_161190_object116366:head# 2024-04-01T19:56:36.408 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95d066b7:::benchmark_data_smithi188_161190_object57643:head# 2024-04-01T19:56:36.408 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95d07484:::benchmark_data_smithi188_161190_object118827:head# 2024-04-01T19:56:36.409 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95d0ebfe:::benchmark_data_smithi188_161190_object68914:head# 2024-04-01T19:56:36.409 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95d0fe12:::benchmark_data_smithi188_161190_object25345:head# 2024-04-01T19:56:36.409 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95d260a9:::benchmark_data_smithi188_161190_object37779:head# 2024-04-01T19:56:36.410 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95d26b4b:::benchmark_data_smithi188_161190_object115978:head# 2024-04-01T19:56:36.410 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95d31597:::benchmark_data_smithi188_161190_object53684:head# 2024-04-01T19:56:36.411 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95d33a28:::benchmark_data_smithi188_161190_object80857:head# 2024-04-01T19:56:36.411 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95d35372:::benchmark_data_smithi188_161190_object71284:head# 2024-04-01T19:56:36.411 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95d48d1c:::benchmark_data_smithi188_161190_object123339:head# 2024-04-01T19:56:36.412 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95d4bd01:::benchmark_data_smithi188_161190_object115366:head# 2024-04-01T19:56:36.412 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95d58dce:::benchmark_data_smithi188_161190_object86319:head# 2024-04-01T19:56:36.413 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95d5e400:::benchmark_data_smithi188_161190_object26506:head# 2024-04-01T19:56:36.413 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95d691ce:::benchmark_data_smithi188_161190_object34142:head# 2024-04-01T19:56:36.414 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95d86e5c:::benchmark_data_smithi188_161190_object44655:head# 2024-04-01T19:56:36.414 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95d87141:::benchmark_data_smithi188_161190_object94146:head# 2024-04-01T19:56:36.415 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95d92837:::benchmark_data_smithi188_161190_object131930:head# 2024-04-01T19:56:36.415 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95db62b2:::benchmark_data_smithi188_161190_object56993:head# 2024-04-01T19:56:36.415 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95db6ce5:::benchmark_data_smithi188_161190_object56833:head# 2024-04-01T19:56:36.416 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95db7812:::benchmark_data_smithi188_161190_object123647:head# 2024-04-01T19:56:36.416 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95dbf817:::benchmark_data_smithi188_161190_object64036:head# 2024-04-01T19:56:36.417 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95dc13cd:::benchmark_data_smithi188_161190_object34188:head# 2024-04-01T19:56:36.417 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95dc66c2:::benchmark_data_smithi188_161190_object43258:head# 2024-04-01T19:56:36.417 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95ddd1ca:::benchmark_data_smithi188_161190_object69406:head# 2024-04-01T19:56:36.418 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95de1f1a:::benchmark_data_smithi188_161190_object105166:head# 2024-04-01T19:56:36.418 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95de2c8d:::benchmark_data_smithi188_161190_object59815:head# 2024-04-01T19:56:36.419 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95de6ffa:::benchmark_data_smithi188_161190_object131520:head# 2024-04-01T19:56:36.419 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95df2163:::benchmark_data_smithi188_161190_object115433:head# 2024-04-01T19:56:36.421 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95df5dde:::benchmark_data_smithi188_161190_object94745:head# 2024-04-01T19:56:36.421 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95df8776:::benchmark_data_smithi188_161190_object89388:head# 2024-04-01T19:56:36.422 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95df8f68:::benchmark_data_smithi188_161190_object78876:head# 2024-04-01T19:56:36.422 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95dfd7e1:::benchmark_data_smithi188_161190_object33996:head# 2024-04-01T19:56:36.422 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95e08509:::benchmark_data_smithi188_161190_object68884:head# 2024-04-01T19:56:36.422 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95e10887:::benchmark_data_smithi188_161190_object29692:head# 2024-04-01T19:56:36.427 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95e370e8:::benchmark_data_smithi188_161190_object28307:head# 2024-04-01T19:56:36.427 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95e3baf8:::benchmark_data_smithi188_161190_object90372:head# 2024-04-01T19:56:36.427 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95e4d672:::benchmark_data_smithi188_161190_object77672:head# 2024-04-01T19:56:36.427 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95e5ed15:::benchmark_data_smithi188_161190_object125480:head# 2024-04-01T19:56:36.427 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95e68e39:::benchmark_data_smithi188_161190_object72340:head# 2024-04-01T19:56:36.427 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95e7546e:::benchmark_data_smithi188_161190_object25543:head# 2024-04-01T19:56:36.427 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95e77d8c:::benchmark_data_smithi188_161190_object114146:head# 2024-04-01T19:56:36.427 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95e7cb3f:::benchmark_data_smithi188_161190_object47312:head# 2024-04-01T19:56:36.428 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95e8c047:::benchmark_data_smithi188_161190_object72529:head# 2024-04-01T19:56:36.428 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95e91439:::benchmark_data_smithi188_161190_object47148:head# 2024-04-01T19:56:36.428 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95eac433:::benchmark_data_smithi188_161190_object19755:head# 2024-04-01T19:56:36.428 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95eac54f:::benchmark_data_smithi188_161190_object80855:head# 2024-04-01T19:56:36.429 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95eb6a57:::benchmark_data_smithi188_161190_object103132:head# 2024-04-01T19:56:36.429 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95ec63ca:::benchmark_data_smithi188_161190_object134621:head# 2024-04-01T19:56:36.432 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95ec8014:::benchmark_data_smithi188_161190_object138534:head# 2024-04-01T19:56:36.432 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95ec8ce5:::benchmark_data_smithi188_161190_object28561:head# 2024-04-01T19:56:36.432 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95eca767:::benchmark_data_smithi188_161190_object35071:head# 2024-04-01T19:56:36.432 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95edd6f2:::benchmark_data_smithi188_161190_object119721:head# 2024-04-01T19:56:36.433 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95ef098b:::benchmark_data_smithi188_161190_object20637:head# 2024-04-01T19:56:36.433 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95f283ea:::benchmark_data_smithi188_161190_object41990:head# 2024-04-01T19:56:36.433 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95f291e0:::benchmark_data_smithi188_161190_object74426:head# 2024-04-01T19:56:36.433 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95f2ea7f:::benchmark_data_smithi188_161190_object57244:head# 2024-04-01T19:56:36.434 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95f3ba2b:::benchmark_data_smithi188_161190_object54685:head# 2024-04-01T19:56:36.434 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95f417f2:::benchmark_data_smithi188_161190_object87519:head# 2024-04-01T19:56:36.434 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95f50f39:::benchmark_data_smithi188_161190_object100742:head# 2024-04-01T19:56:36.435 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95f51c3d:::benchmark_data_smithi188_161190_object24333:head# 2024-04-01T19:56:36.435 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95f53acb:::benchmark_data_smithi188_161190_object95004:head# 2024-04-01T19:56:36.436 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95f5b13a:::benchmark_data_smithi188_161190_object84935:head# 2024-04-01T19:56:36.436 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95f5f7c2:::benchmark_data_smithi188_161190_object82073:head# 2024-04-01T19:56:36.437 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95f63296:::benchmark_data_smithi188_161190_object120609:head# 2024-04-01T19:56:36.437 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95f691e0:::benchmark_data_smithi188_161190_object40443:head# 2024-04-01T19:56:36.438 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95f7019e:::benchmark_data_smithi188_161190_object47626:head# 2024-04-01T19:56:36.438 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95f83360:::benchmark_data_smithi188_161190_object126415:head# 2024-04-01T19:56:36.439 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95f83bab:::benchmark_data_smithi188_161190_object85697:head# 2024-04-01T19:56:36.439 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95f84808:::benchmark_data_smithi188_161190_object125983:head# 2024-04-01T19:56:36.439 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95f84926:::benchmark_data_smithi188_161190_object130472:head# 2024-04-01T19:56:36.440 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95f972c2:::benchmark_data_smithi188_161190_object23488:head# 2024-04-01T19:56:36.440 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95f9de41:::benchmark_data_smithi188_161190_object80556:head# 2024-04-01T19:56:36.441 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95faf381:::benchmark_data_smithi188_161190_object53437:head# 2024-04-01T19:56:36.441 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95fbd77e:::benchmark_data_smithi188_161190_object104030:head# 2024-04-01T19:56:36.442 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95fc1950:::benchmark_data_smithi188_161190_object45077:head# 2024-04-01T19:56:36.442 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95fc45cb:::benchmark_data_smithi188_161190_object38485:head# 2024-04-01T19:56:36.442 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95fd3265:::benchmark_data_smithi188_161190_object137460:head# 2024-04-01T19:56:36.443 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95fdd468:::benchmark_data_smithi188_161190_object133669:head# 2024-04-01T19:56:36.443 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95fe4125:::benchmark_data_smithi188_161190_object59606:head# 2024-04-01T19:56:36.444 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:95fe5f91:::benchmark_data_smithi188_161190_object53145:head# 2024-04-01T19:56:36.444 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9600124d:::benchmark_data_smithi188_161190_object62662:head# 2024-04-01T19:56:36.445 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:960035fc:::benchmark_data_smithi188_161190_object47411:head# 2024-04-01T19:56:36.445 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96003c24:::benchmark_data_smithi188_161190_object91210:head# 2024-04-01T19:56:36.445 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96007241:::benchmark_data_smithi188_161190_object135356:head# 2024-04-01T19:56:36.446 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:960142ee:::benchmark_data_smithi188_161190_object138763:head# 2024-04-01T19:56:36.448 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96019d4b:::benchmark_data_smithi188_161190_object90918:head# 2024-04-01T19:56:36.449 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9601d2ed:::benchmark_data_smithi188_161190_object99643:head# 2024-04-01T19:56:36.449 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9601d5dd:::benchmark_data_smithi188_161190_object67279:head# 2024-04-01T19:56:36.450 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96020178:::benchmark_data_smithi188_161190_object60990:head# 2024-04-01T19:56:36.450 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96027ab7:::benchmark_data_smithi188_161190_object70762:head# 2024-04-01T19:56:36.450 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9602ba89:::benchmark_data_smithi188_161190_object99602:head# 2024-04-01T19:56:36.451 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9603cc7b:::benchmark_data_smithi188_161190_object133196:head# 2024-04-01T19:56:36.451 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9603f54f:::benchmark_data_smithi188_161190_object72133:head# 2024-04-01T19:56:36.452 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9604cf5d:::benchmark_data_smithi188_161190_object120637:head# 2024-04-01T19:56:36.452 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:960515ea:::benchmark_data_smithi188_161190_object48033:head# 2024-04-01T19:56:36.455 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96051a87:::benchmark_data_smithi188_161190_object61896:head# 2024-04-01T19:56:36.455 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:960533c6:::benchmark_data_smithi188_161190_object47737:head# 2024-04-01T19:56:36.455 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9605adaa:::benchmark_data_smithi188_161190_object66348:head# 2024-04-01T19:56:36.455 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9605fdf4:::benchmark_data_smithi188_161190_object24773:head# 2024-04-01T19:56:36.456 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:960658cc:::benchmark_data_smithi188_161190_object32438:head# 2024-04-01T19:56:36.456 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96068577:::benchmark_data_smithi188_161190_object135454:head# 2024-04-01T19:56:36.456 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96071d9a:::benchmark_data_smithi188_161190_object101295:head# 2024-04-01T19:56:36.457 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96076cc2:::benchmark_data_smithi188_161190_object53537:head# 2024-04-01T19:56:36.459 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96078340:::benchmark_data_smithi188_161190_object93213:head# 2024-04-01T19:56:36.460 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9607b524:::benchmark_data_smithi188_161190_object128562:head# 2024-04-01T19:56:36.460 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9607b585:::benchmark_data_smithi188_161190_object109040:head# 2024-04-01T19:56:36.460 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9607f533:::benchmark_data_smithi188_161190_object79127:head# 2024-04-01T19:56:36.462 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96082164:::benchmark_data_smithi188_161190_object28197:head# 2024-04-01T19:56:36.462 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96096b80:::benchmark_data_smithi188_161190_object57659:head# 2024-04-01T19:56:36.463 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9609ca0c:::benchmark_data_smithi188_161190_object78297:head# 2024-04-01T19:56:36.463 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:960a3ea2:::benchmark_data_smithi188_161190_object35412:head# 2024-04-01T19:56:36.464 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:960ac592:::benchmark_data_smithi188_161190_object83359:head# 2024-04-01T19:56:36.464 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:960bbff6:::benchmark_data_smithi188_161190_object19928:head# 2024-04-01T19:56:36.464 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:960c4a78:::benchmark_data_smithi188_161190_object107890:head# 2024-04-01T19:56:36.465 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:960c95be:::benchmark_data_smithi188_161190_object43571:head# 2024-04-01T19:56:36.465 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:960ce665:::benchmark_data_smithi188_161190_object63103:head# 2024-04-01T19:56:36.466 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:960e7a06:::benchmark_data_smithi188_161190_object116916:head# 2024-04-01T19:56:36.466 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:960f0b8c:::benchmark_data_smithi188_161190_object37017:head# 2024-04-01T19:56:36.467 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:960feed4:::benchmark_data_smithi188_161190_object54440:head# 2024-04-01T19:56:36.467 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96108439:::benchmark_data_smithi188_161190_object52736:head# 2024-04-01T19:56:36.467 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9610cb7c:::benchmark_data_smithi188_161190_object121832:head# 2024-04-01T19:56:36.468 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96115ba1:::benchmark_data_smithi188_161190_object109629:head# 2024-04-01T19:56:36.468 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9611ca9f:::benchmark_data_smithi188_161190_object74958:head# 2024-04-01T19:56:36.469 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9611f719:::benchmark_data_smithi188_161190_object135418:head# 2024-04-01T19:56:36.469 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9611f98d:::benchmark_data_smithi188_161190_object85515:head# 2024-04-01T19:56:36.470 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96126e22:::benchmark_data_smithi188_161190_object98309:head# 2024-04-01T19:56:36.470 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96134382:::benchmark_data_smithi188_161190_object34989:head# 2024-04-01T19:56:36.471 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9614549c:::benchmark_data_smithi188_161190_object25156:head# 2024-04-01T19:56:36.471 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96147988:::benchmark_data_smithi188_161190_object100994:head# 2024-04-01T19:56:36.472 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96149466:::benchmark_data_smithi188_161190_object29807:head# 2024-04-01T19:56:36.472 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9614d9c8:::benchmark_data_smithi188_161190_object85618:head# 2024-04-01T19:56:36.473 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9616b423:::benchmark_data_smithi188_161190_object58498:head# 2024-04-01T19:56:36.473 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9617055b:::benchmark_data_smithi188_161190_object38453:head# 2024-04-01T19:56:36.474 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96175a24:::benchmark_data_smithi188_161190_object22762:head# 2024-04-01T19:56:36.474 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96181814:::benchmark_data_smithi188_161190_object87442:head# 2024-04-01T19:56:36.474 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:961845a9:::benchmark_data_smithi188_161190_object114480:head# 2024-04-01T19:56:36.475 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9618c69a:::benchmark_data_smithi188_161190_object33056:head# 2024-04-01T19:56:36.475 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9618fd1b:::benchmark_data_smithi188_161190_object117649:head# 2024-04-01T19:56:36.476 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9619499a:::benchmark_data_smithi188_161190_object85030:head# 2024-04-01T19:56:36.476 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:961992ba:::benchmark_data_smithi188_161190_object122641:head# 2024-04-01T19:56:36.477 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96199515:::benchmark_data_smithi188_161190_object80843:head# 2024-04-01T19:56:36.478 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9619f44c:::benchmark_data_smithi188_161190_object80995:head# 2024-04-01T19:56:36.480 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:961add45:::benchmark_data_smithi188_161190_object85461:head# 2024-04-01T19:56:36.480 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:961bbc1b:::benchmark_data_smithi188_161190_object79633:head# 2024-04-01T19:56:36.481 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:961cbf23:::benchmark_data_smithi188_161190_object85644:head# 2024-04-01T19:56:36.481 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:961cc512:::benchmark_data_smithi188_161190_object70976:head# 2024-04-01T19:56:36.482 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:961cda2c:::benchmark_data_smithi188_161190_object54422:head# 2024-04-01T19:56:36.482 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:961d80fa:::benchmark_data_smithi188_161190_object37762:head# 2024-04-01T19:56:36.482 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:961e3ca1:::benchmark_data_smithi188_161190_object137901:head# 2024-04-01T19:56:36.483 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:961e5dd4:::benchmark_data_smithi188_161190_object23007:head# 2024-04-01T19:56:36.483 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:961e9832:::benchmark_data_smithi188_161190_object60841:head# 2024-04-01T19:56:36.485 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:961ee89c:::benchmark_data_smithi188_161190_object99951:head# 2024-04-01T19:56:36.485 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:961f28a3:::benchmark_data_smithi188_161190_object81744:head# 2024-04-01T19:56:36.486 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:961f6620:::benchmark_data_smithi188_161190_object71211:head# 2024-04-01T19:56:36.486 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:961fd466:::benchmark_data_smithi188_161190_object48245:head# 2024-04-01T19:56:36.487 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96201380:::benchmark_data_smithi188_161190_object42503:head# 2024-04-01T19:56:36.487 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96207e90:::benchmark_data_smithi188_161190_object61343:head# 2024-04-01T19:56:36.488 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9620ae0b:::benchmark_data_smithi188_161190_object79061:head# 2024-04-01T19:56:36.488 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96212a63:::benchmark_data_smithi188_161190_object53172:head# 2024-04-01T19:56:36.488 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96222ee0:::benchmark_data_smithi188_161190_object116548:head# 2024-04-01T19:56:36.489 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9622a7d5:::benchmark_data_smithi188_161190_object99042:head# 2024-04-01T19:56:36.489 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96238a36:::benchmark_data_smithi188_161190_object46168:head# 2024-04-01T19:56:36.490 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9623bae1:::benchmark_data_smithi188_161190_object106332:head# 2024-04-01T19:56:36.490 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96241833:::benchmark_data_smithi188_161190_object69258:head# 2024-04-01T19:56:36.491 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96250d26:::benchmark_data_smithi188_161190_object50853:head# 2024-04-01T19:56:36.491 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9625841b:::benchmark_data_smithi188_161190_object123549:head# 2024-04-01T19:56:36.494 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9625c25f:::benchmark_data_smithi188_161190_object84598:head# 2024-04-01T19:56:36.495 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:962619ab:::benchmark_data_smithi188_161190_object35672:head# 2024-04-01T19:56:36.499 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:962726db:::benchmark_data_smithi188_161190_object110608:head# 2024-04-01T19:56:36.499 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9627d29f:::benchmark_data_smithi188_161190_object58889:head# 2024-04-01T19:56:36.499 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9627ede4:::benchmark_data_smithi188_161190_object50566:head# 2024-04-01T19:56:36.499 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9628053b:::benchmark_data_smithi188_161190_object124393:head# 2024-04-01T19:56:36.499 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96280e6e:::benchmark_data_smithi188_161190_object82871:head# 2024-04-01T19:56:36.499 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9628646d:::benchmark_data_smithi188_161190_object87694:head# 2024-04-01T19:56:36.499 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96288190:::benchmark_data_smithi188_161190_object40872:head# 2024-04-01T19:56:36.500 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9628de42:::benchmark_data_smithi188_161190_object54674:head# 2024-04-01T19:56:36.500 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96298a50:::benchmark_data_smithi188_161190_object27041:head# 2024-04-01T19:56:36.500 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9629a854:::benchmark_data_smithi188_161190_object53322:head# 2024-04-01T19:56:36.501 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9629ef93:::benchmark_data_smithi188_161190_object45075:head# 2024-04-01T19:56:36.501 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:962a0129:::benchmark_data_smithi188_161190_object80390:head# 2024-04-01T19:56:36.501 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:962a0a71:::benchmark_data_smithi188_161190_object45336:head# 2024-04-01T19:56:36.502 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:962a2944:::benchmark_data_smithi188_161190_object132050:head# 2024-04-01T19:56:36.502 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:962af193:::benchmark_data_smithi188_161190_object123602:head# 2024-04-01T19:56:36.503 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:962c7bd8:::benchmark_data_smithi188_161190_object100696:head# 2024-04-01T19:56:36.503 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:962c8d14:::benchmark_data_smithi188_161190_object44329:head# 2024-04-01T19:56:36.504 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:962d2cf3:::benchmark_data_smithi188_161190_object64096:head# 2024-04-01T19:56:36.504 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:962d647c:::benchmark_data_smithi188_161190_object116376:head# 2024-04-01T19:56:36.505 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:962dcd73:::benchmark_data_smithi188_161190_object125338:head# 2024-04-01T19:56:36.506 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:962e2bc7:::benchmark_data_smithi188_161190_object53951:head# 2024-04-01T19:56:36.506 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96306ffc:::benchmark_data_smithi188_161190_object39075:head# 2024-04-01T19:56:36.506 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9630b4b6:::benchmark_data_smithi188_161190_object128971:head# 2024-04-01T19:56:36.506 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96310e8a:::benchmark_data_smithi188_161190_object90537:head# 2024-04-01T19:56:36.507 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96311e9e:::benchmark_data_smithi188_161190_object75705:head# 2024-04-01T19:56:36.507 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9631fd69:::benchmark_data_smithi188_161190_object135087:head# 2024-04-01T19:56:36.508 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96329b9d:::benchmark_data_smithi188_161190_object50587:head# 2024-04-01T19:56:36.508 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9633828b:::benchmark_data_smithi188_161190_object106130:head# 2024-04-01T19:56:36.509 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9633aadb:::benchmark_data_smithi188_161190_object118496:head# 2024-04-01T19:56:36.509 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:963481df:::benchmark_data_smithi188_161190_object30431:head# 2024-04-01T19:56:36.510 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9634a7cd:::benchmark_data_smithi188_161190_object122613:head# 2024-04-01T19:56:36.510 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:963556d6:::benchmark_data_smithi188_161190_object37784:head# 2024-04-01T19:56:36.511 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9635cc69:::benchmark_data_smithi188_161190_object58361:head# 2024-04-01T19:56:36.511 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9635f9ed:::benchmark_data_smithi188_161190_object52349:head# 2024-04-01T19:56:36.512 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9636167e:::benchmark_data_smithi188_161190_object46644:head# 2024-04-01T19:56:36.512 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96361fe9:::benchmark_data_smithi188_161190_object47740:head# 2024-04-01T19:56:36.512 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:963657d7:::benchmark_data_smithi188_161190_object91756:head# 2024-04-01T19:56:36.513 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9636e5af:::benchmark_data_smithi188_161190_object119963:head# 2024-04-01T19:56:36.514 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9637cb11:::benchmark_data_smithi188_161190_object31351:head# 2024-04-01T19:56:36.514 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9638139b:::benchmark_data_smithi188_161190_object25714:head# 2024-04-01T19:56:36.515 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9638d2d9:::benchmark_data_smithi188_161190_object67303:head# 2024-04-01T19:56:36.515 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9638f637:::benchmark_data_smithi188_161190_object28520:head# 2024-04-01T19:56:36.515 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9639075e:::benchmark_data_smithi188_161190_object124135:head# 2024-04-01T19:56:36.516 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96392397:::benchmark_data_smithi188_161190_object49788:head# 2024-04-01T19:56:36.516 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:963a7511:::benchmark_data_smithi188_161190_object72094:head# 2024-04-01T19:56:36.516 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:963bc277:::benchmark_data_smithi188_161190_object74587:head# 2024-04-01T19:56:36.517 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:963cdd79:::benchmark_data_smithi188_161190_object42504:head# 2024-04-01T19:56:36.518 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:963e9e6c:::benchmark_data_smithi188_161190_object81122:head# 2024-04-01T19:56:36.521 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:963ebd6b:::benchmark_data_smithi188_161190_object115935:head# 2024-04-01T19:56:36.521 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:963f7a51:::benchmark_data_smithi188_161190_object75902:head# 2024-04-01T19:56:36.521 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:963f8e34:::benchmark_data_smithi188_161190_object48343:head# 2024-04-01T19:56:36.521 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:963f9802:::benchmark_data_smithi188_161190_object53621:head# 2024-04-01T19:56:36.522 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:963fcfa9:::benchmark_data_smithi188_161190_object85907:head# 2024-04-01T19:56:36.522 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96401f72:::benchmark_data_smithi188_161190_object125749:head# 2024-04-01T19:56:36.522 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9640adcc:::benchmark_data_smithi188_161190_object104324:head# 2024-04-01T19:56:36.522 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96413b2e:::benchmark_data_smithi188_161190_object26299:head# 2024-04-01T19:56:36.528 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96425941:::benchmark_data_smithi188_161190_object61231:head# 2024-04-01T19:56:36.529 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96425c43:::benchmark_data_smithi188_161190_object53113:head# 2024-04-01T19:56:36.529 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9642a08c:::benchmark_data_smithi188_161190_object99275:head# 2024-04-01T19:56:36.529 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9643a8b3:::benchmark_data_smithi188_161190_object104640:head# 2024-04-01T19:56:36.529 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9643e6ba:::benchmark_data_smithi188_161190_object54069:head# 2024-04-01T19:56:36.529 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:964457e2:::benchmark_data_smithi188_161190_object42636:head# 2024-04-01T19:56:36.529 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9644bd24:::benchmark_data_smithi188_161190_object23893:head# 2024-04-01T19:56:36.529 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9644c5ad:::benchmark_data_smithi188_161190_object34376:head# 2024-04-01T19:56:36.529 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9647f0d7:::benchmark_data_smithi188_161190_object114704:head# 2024-04-01T19:56:36.529 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96482343:::benchmark_data_smithi188_161190_object79348:head# 2024-04-01T19:56:36.529 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96499ed9:::benchmark_data_smithi188_161190_object107353:head# 2024-04-01T19:56:36.530 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:964adf45:::benchmark_data_smithi188_161190_object98163:head# 2024-04-01T19:56:36.530 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:964bd98f:::benchmark_data_smithi188_161190_object114930:head# 2024-04-01T19:56:36.530 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:964bdba7:::benchmark_data_smithi188_161190_object107930:head# 2024-04-01T19:56:36.530 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:964c7ad5:::benchmark_data_smithi188_161190_object40505:head# 2024-04-01T19:56:36.531 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:964d2141:::benchmark_data_smithi188_161190_object134083:head# 2024-04-01T19:56:36.531 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:964e3c10:::benchmark_data_smithi188_161190_object63262:head# 2024-04-01T19:56:36.536 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:964f8774:::benchmark_data_smithi188_161190_object109729:head# 2024-04-01T19:56:36.536 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96501574:::benchmark_data_smithi188_161190_object110076:head# 2024-04-01T19:56:36.536 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9650cbb6:::benchmark_data_smithi188_161190_object80281:head# 2024-04-01T19:56:36.537 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96518150:::benchmark_data_smithi188_161190_object36735:head# 2024-04-01T19:56:36.537 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96518837:::benchmark_data_smithi188_161190_object112182:head# 2024-04-01T19:56:36.539 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96536b28:::benchmark_data_smithi188_161190_object128518:head# 2024-04-01T19:56:36.540 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:965476cb:::benchmark_data_smithi188_161190_object47657:head# 2024-04-01T19:56:36.540 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9654bd74:::benchmark_data_smithi188_161190_object96640:head# 2024-04-01T19:56:36.541 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9654cb57:::benchmark_data_smithi188_161190_object93020:head# 2024-04-01T19:56:36.541 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96555a26:::benchmark_data_smithi188_161190_object34508:head# 2024-04-01T19:56:36.542 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9656bc74:::benchmark_data_smithi188_161190_object86609:head# 2024-04-01T19:56:36.542 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96570e0a:::benchmark_data_smithi188_161190_object59120:head# 2024-04-01T19:56:36.543 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9658f55f:::benchmark_data_smithi188_161190_object137095:head# 2024-04-01T19:56:36.545 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96596ee8:::benchmark_data_smithi188_161190_object93151:head# 2024-04-01T19:56:36.545 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9659ae0b:::benchmark_data_smithi188_161190_object64188:head# 2024-04-01T19:56:36.545 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:965a5c52:::benchmark_data_smithi188_161190_object132165:head# 2024-04-01T19:56:36.546 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:965a97aa:::benchmark_data_smithi188_161190_object34600:head# 2024-04-01T19:56:36.546 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:965b6b33:::benchmark_data_smithi188_161190_object86211:head# 2024-04-01T19:56:36.546 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:965b9a26:::benchmark_data_smithi188_161190_object76873:head# 2024-04-01T19:56:36.546 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:965c1786:::benchmark_data_smithi188_161190_object70188:head# 2024-04-01T19:56:36.548 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:965c336d:::benchmark_data_smithi188_161190_object131603:head# 2024-04-01T19:56:36.548 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:965c648a:::benchmark_data_smithi188_161190_object79128:head# 2024-04-01T19:56:36.549 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:965c66ce:::benchmark_data_smithi188_161190_object52205:head# 2024-04-01T19:56:36.549 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:965de665:::benchmark_data_smithi188_161190_object20162:head# 2024-04-01T19:56:36.549 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:965e19fb:::benchmark_data_smithi188_161190_object80325:head# 2024-04-01T19:56:36.549 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:965e9af5:::benchmark_data_smithi188_161190_object87294:head# 2024-04-01T19:56:36.550 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:965f499e:::benchmark_data_smithi188_161190_object121866:head# 2024-04-01T19:56:36.550 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:965f8dcf:::benchmark_data_smithi188_161190_object22009:head# 2024-04-01T19:56:36.551 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96606382:::benchmark_data_smithi188_161190_object94615:head# 2024-04-01T19:56:36.551 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:966079c6:::benchmark_data_smithi188_161190_object73859:head# 2024-04-01T19:56:36.552 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:966084e4:::benchmark_data_smithi188_161190_object85823:head# 2024-04-01T19:56:36.552 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96619e24:::benchmark_data_smithi188_161190_object64092:head# 2024-04-01T19:56:36.552 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96627654:::benchmark_data_smithi188_161190_object74766:head# 2024-04-01T19:56:36.553 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:966278a8:::benchmark_data_smithi188_161190_object97570:head# 2024-04-01T19:56:36.555 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9662b581:::benchmark_data_smithi188_161190_object126897:head# 2024-04-01T19:56:36.555 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9662f91c:::benchmark_data_smithi188_161190_object113528:head# 2024-04-01T19:56:36.555 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:966321e2:::benchmark_data_smithi188_161190_object82145:head# 2024-04-01T19:56:36.556 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:966338e9:::benchmark_data_smithi188_161190_object45253:head# 2024-04-01T19:56:36.558 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9663d5bf:::benchmark_data_smithi188_161190_object116491:head# 2024-04-01T19:56:36.558 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96643b3e:::benchmark_data_smithi188_161190_object95978:head# 2024-04-01T19:56:36.559 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:966463f0:::benchmark_data_smithi188_161190_object93396:head# 2024-04-01T19:56:36.559 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9664d9d6:::benchmark_data_smithi188_161190_object73569:head# 2024-04-01T19:56:36.560 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9665bacb:::benchmark_data_smithi188_161190_object128345:head# 2024-04-01T19:56:36.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9665c491:::benchmark_data_smithi188_161190_object46825:head# 2024-04-01T19:56:36.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96669065:::benchmark_data_smithi188_161190_object100503:head# 2024-04-01T19:56:36.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:966792af:::benchmark_data_smithi188_161190_object42918:head# 2024-04-01T19:56:36.563 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9668e1d1:::benchmark_data_smithi188_161190_object29316:head# 2024-04-01T19:56:36.563 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9668e7a8:::benchmark_data_smithi188_161190_object62093:head# 2024-04-01T19:56:36.564 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9668f5ac:::benchmark_data_smithi188_161190_object95259:head# 2024-04-01T19:56:36.565 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:966b54ac:::benchmark_data_smithi188_161190_object132302:head# 2024-04-01T19:56:36.565 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:966b9f84:::benchmark_data_smithi188_161190_object112723:head# 2024-04-01T19:56:36.566 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:966c34e0:::benchmark_data_smithi188_161190_object111937:head# 2024-04-01T19:56:36.566 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:966c4a52:::benchmark_data_smithi188_161190_object41998:head# 2024-04-01T19:56:36.567 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:966c8493:::benchmark_data_smithi188_161190_object61289:head# 2024-04-01T19:56:36.567 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:966cc530:::benchmark_data_smithi188_161190_object66985:head# 2024-04-01T19:56:36.567 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:966e8ce4:::benchmark_data_smithi188_161190_object131148:head# 2024-04-01T19:56:36.568 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:966fd117:::benchmark_data_smithi188_161190_object67063:head# 2024-04-01T19:56:36.571 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:966ff0bc:::benchmark_data_smithi188_161190_object79667:head# 2024-04-01T19:56:36.574 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9670226c:::benchmark_data_smithi188_161190_object107451:head# 2024-04-01T19:56:36.574 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96703643:::benchmark_data_smithi188_161190_object98671:head# 2024-04-01T19:56:36.574 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9670986f:::benchmark_data_smithi188_161190_object89420:head# 2024-04-01T19:56:36.574 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9670e20f:::benchmark_data_smithi188_161190_object138236:head# 2024-04-01T19:56:36.574 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9670fb67:::benchmark_data_smithi188_161190_object118446:head# 2024-04-01T19:56:36.574 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96715554:::benchmark_data_smithi188_161190_object71858:head# 2024-04-01T19:56:36.577 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9671dd91:::benchmark_data_smithi188_161190_object50515:head# 2024-04-01T19:56:36.577 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96723e88:::benchmark_data_smithi188_161190_object127580:head# 2024-04-01T19:56:36.577 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9672553f:::benchmark_data_smithi188_161190_object69447:head# 2024-04-01T19:56:36.578 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9672db80:::benchmark_data_smithi188_161190_object28000:head# 2024-04-01T19:56:36.578 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9673414f:::benchmark_data_smithi188_161190_object28030:head# 2024-04-01T19:56:36.578 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96736fc3:::benchmark_data_smithi188_161190_object129778:head# 2024-04-01T19:56:36.579 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:967386e7:::benchmark_data_smithi188_161190_object91117:head# 2024-04-01T19:56:36.579 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9674311f:::benchmark_data_smithi188_161190_object47956:head# 2024-04-01T19:56:36.580 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9674384c:::benchmark_data_smithi188_161190_object86311:head# 2024-04-01T19:56:36.580 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9674f5f6:::benchmark_data_smithi188_161190_object114242:head# 2024-04-01T19:56:36.581 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9674f7ec:::benchmark_data_smithi188_161190_object55421:head# 2024-04-01T19:56:36.581 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:967580e0:::benchmark_data_smithi188_161190_object113057:head# 2024-04-01T19:56:36.581 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96764c01:::benchmark_data_smithi188_161190_object113117:head# 2024-04-01T19:56:36.582 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9676577a:::benchmark_data_smithi188_161190_object98483:head# 2024-04-01T19:56:36.583 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9676a87b:::benchmark_data_smithi188_161190_object25233:head# 2024-04-01T19:56:36.583 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96776c4d:::benchmark_data_smithi188_161190_object116383:head# 2024-04-01T19:56:36.584 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9677f937:::benchmark_data_smithi188_161190_object94270:head# 2024-04-01T19:56:36.584 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96783aaa:::benchmark_data_smithi188_161190_object58631:head# 2024-04-01T19:56:36.584 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9678ef91:::benchmark_data_smithi188_161190_object29966:head# 2024-04-01T19:56:36.584 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96792454:::benchmark_data_smithi188_161190_object71337:head# 2024-04-01T19:56:36.585 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:967941a8:::benchmark_data_smithi188_161190_object24810:head# 2024-04-01T19:56:36.585 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:967949d7:::benchmark_data_smithi188_161190_object111801:head# 2024-04-01T19:56:36.586 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96798dee:::benchmark_data_smithi188_161190_object47360:head# 2024-04-01T19:56:36.586 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:967a1b99:::benchmark_data_smithi188_161190_object102672:head# 2024-04-01T19:56:36.587 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:967a2281:::benchmark_data_smithi188_161190_object23070:head# 2024-04-01T19:56:36.587 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:967a3d9b:::benchmark_data_smithi188_161190_object127532:head# 2024-04-01T19:56:36.588 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:967aa5fc:::benchmark_data_smithi188_161190_object67151:head# 2024-04-01T19:56:36.588 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:967b1b4e:::benchmark_data_smithi188_161190_object39174:head# 2024-04-01T19:56:36.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:967c9d65:::benchmark_data_smithi188_161190_object127748:head# 2024-04-01T19:56:36.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:967d0ca9:::benchmark_data_smithi188_161190_object58078:head# 2024-04-01T19:56:36.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:967e537f:::benchmark_data_smithi188_161190_object87079:head# 2024-04-01T19:56:36.590 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:967e8605:::benchmark_data_smithi188_161190_object102826:head# 2024-04-01T19:56:36.590 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:967f32cb:::benchmark_data_smithi188_161190_object32482:head# 2024-04-01T19:56:36.591 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:967f6650:::benchmark_data_smithi188_161190_object92980:head# 2024-04-01T19:56:36.591 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:967ff70c:::benchmark_data_smithi188_161190_object65013:head# 2024-04-01T19:56:36.592 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9680d151:::benchmark_data_smithi188_161190_object44551:head# 2024-04-01T19:56:36.592 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9680d466:::benchmark_data_smithi188_161190_object92000:head# 2024-04-01T19:56:36.593 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96811c93:::benchmark_data_smithi188_161190_object109942:head# 2024-04-01T19:56:36.594 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96815d3b:::benchmark_data_smithi188_161190_object92867:head# 2024-04-01T19:56:36.595 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9681b111:::benchmark_data_smithi188_161190_object76931:head# 2024-04-01T19:56:36.599 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9681f610:::benchmark_data_smithi188_161190_object107465:head# 2024-04-01T19:56:36.599 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9681ff9f:::benchmark_data_smithi188_161190_object57464:head# 2024-04-01T19:56:36.600 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9682d9b9:::benchmark_data_smithi188_161190_object46709:head# 2024-04-01T19:56:36.600 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9683aada:::benchmark_data_smithi188_161190_object136649:head# 2024-04-01T19:56:36.601 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96848a36:::benchmark_data_smithi188_161190_object105850:head# 2024-04-01T19:56:36.602 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96848d23:::benchmark_data_smithi188_161190_object23476:head# 2024-04-01T19:56:36.602 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9684b56a:::benchmark_data_smithi188_161190_object25926:head# 2024-04-01T19:56:36.602 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9684bfb5:::benchmark_data_smithi188_161190_object68635:head# 2024-04-01T19:56:36.603 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96858037:::benchmark_data_smithi188_161190_object71073:head# 2024-04-01T19:56:36.603 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9685bf3b:::benchmark_data_smithi188_161190_object33420:head# 2024-04-01T19:56:36.604 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9686723a:::benchmark_data_smithi188_161190_object111755:head# 2024-04-01T19:56:36.604 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96872dab:::benchmark_data_smithi188_161190_object19807:head# 2024-04-01T19:56:36.604 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96873f8a:::benchmark_data_smithi188_161190_object138293:head# 2024-04-01T19:56:36.605 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96874315:::benchmark_data_smithi188_161190_object39669:head# 2024-04-01T19:56:36.605 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9687cb02:::benchmark_data_smithi188_161190_object83432:head# 2024-04-01T19:56:36.606 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9687cb50:::benchmark_data_smithi188_161190_object75975:head# 2024-04-01T19:56:36.606 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9687ce29:::benchmark_data_smithi188_161190_object112740:head# 2024-04-01T19:56:36.607 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9687fd7c:::benchmark_data_smithi188_161190_object87002:head# 2024-04-01T19:56:36.607 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9688576e:::benchmark_data_smithi188_161190_object95187:head# 2024-04-01T19:56:36.607 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9688cb32:::benchmark_data_smithi188_161190_object85159:head# 2024-04-01T19:56:36.608 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9688e6ae:::benchmark_data_smithi188_161190_object25380:head# 2024-04-01T19:56:36.608 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96899d33:::benchmark_data_smithi188_161190_object67463:head# 2024-04-01T19:56:36.609 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9689a496:::benchmark_data_smithi188_161190_object51458:head# 2024-04-01T19:56:36.609 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:968a0657:::benchmark_data_smithi188_161190_object114633:head# 2024-04-01T19:56:36.610 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:968b4bf6:::benchmark_data_smithi188_161190_object132856:head# 2024-04-01T19:56:36.611 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:968b683a:::benchmark_data_smithi188_161190_object71797:head# 2024-04-01T19:56:36.611 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:968d720e:::benchmark_data_smithi188_161190_object116283:head# 2024-04-01T19:56:36.611 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:968d8e44:::benchmark_data_smithi188_161190_object121435:head# 2024-04-01T19:56:36.612 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:968dbb37:::benchmark_data_smithi188_161190_object66252:head# 2024-04-01T19:56:36.612 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:968dd68f:::benchmark_data_smithi188_161190_object57990:head# 2024-04-01T19:56:36.613 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:968e0812:::benchmark_data_smithi188_161190_object32673:head# 2024-04-01T19:56:36.613 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:968edb98:::benchmark_data_smithi188_161190_object89597:head# 2024-04-01T19:56:36.614 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:968f1c72:::benchmark_data_smithi188_161190_object97901:head# 2024-04-01T19:56:36.614 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:968fec6a:::benchmark_data_smithi188_161190_object137163:head# 2024-04-01T19:56:36.614 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96906ba4:::benchmark_data_smithi188_161190_object82793:head# 2024-04-01T19:56:36.615 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9690bec1:::benchmark_data_smithi188_161190_object49371:head# 2024-04-01T19:56:36.622 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9690c6e6:::benchmark_data_smithi188_161190_object118579:head# 2024-04-01T19:56:36.622 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9690ce92:::benchmark_data_smithi188_161190_object127950:head# 2024-04-01T19:56:36.622 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96913efc:::benchmark_data_smithi188_161190_object28722:head# 2024-04-01T19:56:36.622 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9691f2fd:::benchmark_data_smithi188_161190_object59659:head# 2024-04-01T19:56:36.622 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96926e47:::benchmark_data_smithi188_161190_object63114:head# 2024-04-01T19:56:36.622 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9692cad7:::benchmark_data_smithi188_161190_object43717:head# 2024-04-01T19:56:36.622 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9696a9ba:::benchmark_data_smithi188_161190_object99828:head# 2024-04-01T19:56:36.622 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9696c68a:::benchmark_data_smithi188_161190_object33884:head# 2024-04-01T19:56:36.622 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9696d1c6:::benchmark_data_smithi188_161190_object99878:head# 2024-04-01T19:56:36.623 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9697adf6:::benchmark_data_smithi188_161190_object99483:head# 2024-04-01T19:56:36.623 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9697bcac:::benchmark_data_smithi188_161190_object85744:head# 2024-04-01T19:56:36.623 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9697f8d9:::benchmark_data_smithi188_161190_object123288:head# 2024-04-01T19:56:36.623 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9697faf2:::benchmark_data_smithi188_161190_object104769:head# 2024-04-01T19:56:36.623 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96989e7f:::benchmark_data_smithi188_161190_object116474:head# 2024-04-01T19:56:36.623 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9698af6a:::benchmark_data_smithi188_161190_object67700:head# 2024-04-01T19:56:36.624 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9698cf0c:::benchmark_data_smithi188_161190_object29657:head# 2024-04-01T19:56:36.624 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9698f8db:::benchmark_data_smithi188_161190_object87631:head# 2024-04-01T19:56:36.626 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:969903d5:::benchmark_data_smithi188_161190_object84735:head# 2024-04-01T19:56:36.626 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96993619:::benchmark_data_smithi188_161190_object53154:head# 2024-04-01T19:56:36.627 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96995667:::benchmark_data_smithi188_161190_object118348:head# 2024-04-01T19:56:36.627 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96997f9c:::benchmark_data_smithi188_161190_object82231:head# 2024-04-01T19:56:36.627 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:969aa146:::benchmark_data_smithi188_161190_object60999:head# 2024-04-01T19:56:36.628 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:969aeb5c:::benchmark_data_smithi188_161190_object94479:head# 2024-04-01T19:56:36.628 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:969c6701:::benchmark_data_smithi188_161190_object22227:head# 2024-04-01T19:56:36.629 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:969d35d9:::benchmark_data_smithi188_161190_object55613:head# 2024-04-01T19:56:36.629 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:969d9bdf:::benchmark_data_smithi188_161190_object54028:head# 2024-04-01T19:56:36.629 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:969dfdc9:::benchmark_data_smithi188_161190_object28331:head# 2024-04-01T19:56:36.630 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:969e4157:::benchmark_data_smithi188_161190_object111661:head# 2024-04-01T19:56:36.631 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:969fcb10:::benchmark_data_smithi188_161190_object40966:head# 2024-04-01T19:56:36.631 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96a00ab4:::benchmark_data_smithi188_161190_object104313:head# 2024-04-01T19:56:36.631 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96a012f5:::benchmark_data_smithi188_161190_object64306:head# 2024-04-01T19:56:36.632 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96a0f80a:::benchmark_data_smithi188_161190_object138568:head# 2024-04-01T19:56:36.632 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96a1105e:::benchmark_data_smithi188_161190_object48729:head# 2024-04-01T19:56:36.633 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96a19e84:::benchmark_data_smithi188_161190_object67266:head# 2024-04-01T19:56:36.633 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96a209ba:::benchmark_data_smithi188_161190_object66061:head# 2024-04-01T19:56:36.639 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96a238e7:::benchmark_data_smithi188_161190_object58532:head# 2024-04-01T19:56:36.639 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96a28c0e:::benchmark_data_smithi188_161190_object44048:head# 2024-04-01T19:56:36.644 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96a29a8c:::benchmark_data_smithi188_161190_object92324:head# 2024-04-01T19:56:36.644 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96a2c96a:::benchmark_data_smithi188_161190_object103953:head# 2024-04-01T19:56:36.645 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96a3280e:::benchmark_data_smithi188_161190_object20157:head# 2024-04-01T19:56:36.645 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96a42866:::benchmark_data_smithi188_161190_object79985:head# 2024-04-01T19:56:36.646 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96a50213:::benchmark_data_smithi188_161190_object43680:head# 2024-04-01T19:56:36.647 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96a57551:::benchmark_data_smithi188_161190_object89969:head# 2024-04-01T19:56:36.647 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96a72d90:::benchmark_data_smithi188_161190_object71493:head# 2024-04-01T19:56:36.647 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96a766fb:::benchmark_data_smithi188_161190_object57470:head# 2024-04-01T19:56:36.648 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96a7a656:::benchmark_data_smithi188_161190_object53526:head# 2024-04-01T19:56:36.648 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96a7f301:::benchmark_data_smithi188_161190_object29969:head# 2024-04-01T19:56:36.649 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96a8b075:::benchmark_data_smithi188_161190_object125284:head# 2024-04-01T19:56:36.649 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96a8d61b:::benchmark_data_smithi188_161190_object59604:head# 2024-04-01T19:56:36.650 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96a92957:::benchmark_data_smithi188_161190_object120552:head# 2024-04-01T19:56:36.650 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96ab58e4:::benchmark_data_smithi188_161190_object105078:head# 2024-04-01T19:56:36.650 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96ab8289:::benchmark_data_smithi188_161190_object30437:head# 2024-04-01T19:56:36.651 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96ac6d9f:::benchmark_data_smithi188_161190_object72600:head# 2024-04-01T19:56:36.651 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96ad22cd:::benchmark_data_smithi188_161190_object117640:head# 2024-04-01T19:56:36.652 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96ad7389:::benchmark_data_smithi188_161190_object125121:head# 2024-04-01T19:56:36.652 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96ada6e2:::benchmark_data_smithi188_161190_object44705:head# 2024-04-01T19:56:36.653 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96ae6d2b:::benchmark_data_smithi188_161190_object66237:head# 2024-04-01T19:56:36.653 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96af0390:::benchmark_data_smithi188_161190_object82618:head# 2024-04-01T19:56:36.653 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96af198c:::benchmark_data_smithi188_161190_object69670:head# 2024-04-01T19:56:36.654 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96af1e32:::benchmark_data_smithi188_161190_object54620:head# 2024-04-01T19:56:36.654 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96b011a7:::benchmark_data_smithi188_161190_object101773:head# 2024-04-01T19:56:36.655 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96b01574:::benchmark_data_smithi188_161190_object68280:head# 2024-04-01T19:56:36.655 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96b05bbc:::benchmark_data_smithi188_161190_object59025:head# 2024-04-01T19:56:36.656 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96b1ceca:::benchmark_data_smithi188_161190_object33916:head# 2024-04-01T19:56:36.658 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96b25666:::benchmark_data_smithi188_161190_object53089:head# 2024-04-01T19:56:36.658 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96b32931:::benchmark_data_smithi188_161190_object31725:head# 2024-04-01T19:56:36.658 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96b33fd3:::benchmark_data_smithi188_161190_object108449:head# 2024-04-01T19:56:36.658 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96b3d989:::benchmark_data_smithi188_161190_object126616:head# 2024-04-01T19:56:36.659 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96b404c6:::benchmark_data_smithi188_161190_object61679:head# 2024-04-01T19:56:36.659 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96b435ce:::benchmark_data_smithi188_161190_object37196:head# 2024-04-01T19:56:36.659 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96b441a0:::benchmark_data_smithi188_161190_object45559:head# 2024-04-01T19:56:36.660 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96b470ec:::benchmark_data_smithi188_161190_object51594:head# 2024-04-01T19:56:36.660 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96b5449f:::benchmark_data_smithi188_161190_object112518:head# 2024-04-01T19:56:36.661 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96b5edf8:::benchmark_data_smithi188_161190_object23437:head# 2024-04-01T19:56:36.661 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96b64c87:::benchmark_data_smithi188_161190_object118852:head# 2024-04-01T19:56:36.662 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96b66cfb:::benchmark_data_smithi188_161190_object31891:head# 2024-04-01T19:56:36.663 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96b68189:::benchmark_data_smithi188_161190_object129054:head# 2024-04-01T19:56:36.664 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96b73775:::benchmark_data_smithi188_161190_object20405:head# 2024-04-01T19:56:36.664 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96b920c9:::benchmark_data_smithi188_161190_object137417:head# 2024-04-01T19:56:36.666 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96bbec6a:::benchmark_data_smithi188_161190_object75279:head# 2024-04-01T19:56:36.666 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96bd1aff:::benchmark_data_smithi188_161190_object133145:head# 2024-04-01T19:56:36.666 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96bd9d9d:::benchmark_data_smithi188_161190_object33786:head# 2024-04-01T19:56:36.669 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96be10a3:::benchmark_data_smithi188_161190_object98801:head# 2024-04-01T19:56:36.669 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96be6f94:::benchmark_data_smithi188_161190_object104558:head# 2024-04-01T19:56:36.671 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96bfd0ca:::benchmark_data_smithi188_161190_object125620:head# 2024-04-01T19:56:36.673 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96c00789:::benchmark_data_smithi188_161190_object93622:head# 2024-04-01T19:56:36.673 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96c06b28:::benchmark_data_smithi188_161190_object108790:head# 2024-04-01T19:56:36.673 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96c0b048:::benchmark_data_smithi188_161190_object49635:head# 2024-04-01T19:56:36.674 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96c116a1:::benchmark_data_smithi188_161190_object130593:head# 2024-04-01T19:56:36.674 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96c266a6:::benchmark_data_smithi188_161190_object39886:head# 2024-04-01T19:56:36.674 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96c2af00:::benchmark_data_smithi188_161190_object107883:head# 2024-04-01T19:56:36.675 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96c34b9a:::benchmark_data_smithi188_161190_object45583:head# 2024-04-01T19:56:36.675 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96c44c69:::benchmark_data_smithi188_161190_object73403:head# 2024-04-01T19:56:36.678 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96c457fd:::benchmark_data_smithi188_161190_object102370:head# 2024-04-01T19:56:36.679 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96c63a39:::benchmark_data_smithi188_161190_object61181:head# 2024-04-01T19:56:36.679 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96c76ef9:::benchmark_data_smithi188_161190_object48826:head# 2024-04-01T19:56:36.679 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96c81e7b:::benchmark_data_smithi188_161190_object124816:head# 2024-04-01T19:56:36.679 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96c86bef:::benchmark_data_smithi188_161190_object70051:head# 2024-04-01T19:56:36.680 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96c88840:::benchmark_data_smithi188_161190_object99531:head# 2024-04-01T19:56:36.680 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96c9e3e2:::benchmark_data_smithi188_161190_object86294:head# 2024-04-01T19:56:36.681 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96ca7c97:::benchmark_data_smithi188_161190_object107810:head# 2024-04-01T19:56:36.681 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96cadaa9:::benchmark_data_smithi188_161190_object136741:head# 2024-04-01T19:56:36.681 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96cb1159:::benchmark_data_smithi188_161190_object30072:head# 2024-04-01T19:56:36.682 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96cb5881:::benchmark_data_smithi188_161190_object91862:head# 2024-04-01T19:56:36.682 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96cb7a52:::benchmark_data_smithi188_161190_object38272:head# 2024-04-01T19:56:36.685 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96cbcade:::benchmark_data_smithi188_161190_object42888:head# 2024-04-01T19:56:36.686 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96cd1a4b:::benchmark_data_smithi188_161190_object132544:head# 2024-04-01T19:56:36.686 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96cdea89:::benchmark_data_smithi188_161190_object139074:head# 2024-04-01T19:56:36.687 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96ce5924:::benchmark_data_smithi188_161190_object40247:head# 2024-04-01T19:56:36.687 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96ce8384:::benchmark_data_smithi188_161190_object80363:head# 2024-04-01T19:56:36.688 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96ce9807:::benchmark_data_smithi188_161190_object118447:head# 2024-04-01T19:56:36.693 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96ceb5a6:::benchmark_data_smithi188_161190_object119589:head# 2024-04-01T19:56:36.693 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96ced27e:::benchmark_data_smithi188_161190_object46950:head# 2024-04-01T19:56:36.693 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96cf3d85:::benchmark_data_smithi188_161190_object94941:head# 2024-04-01T19:56:36.693 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96cfc352:::benchmark_data_smithi188_161190_object113451:head# 2024-04-01T19:56:36.693 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96d065e2:::benchmark_data_smithi188_161190_object31293:head# 2024-04-01T19:56:36.693 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96d0cde6:::benchmark_data_smithi188_161190_object97145:head# 2024-04-01T19:56:36.693 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96d0da45:::benchmark_data_smithi188_161190_object36230:head# 2024-04-01T19:56:36.693 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96d122b1:::benchmark_data_smithi188_161190_object76856:head# 2024-04-01T19:56:36.693 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96d15755:::benchmark_data_smithi188_161190_object95430:head# 2024-04-01T19:56:36.694 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96d1d948:::benchmark_data_smithi188_161190_object104731:head# 2024-04-01T19:56:36.695 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96d203a4:::benchmark_data_smithi188_161190_object103201:head# 2024-04-01T19:56:36.695 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96d232e3:::benchmark_data_smithi188_161190_object54841:head# 2024-04-01T19:56:36.695 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96d2ecbd:::benchmark_data_smithi188_161190_object45545:head# 2024-04-01T19:56:36.696 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96d2f126:::benchmark_data_smithi188_161190_object55004:head# 2024-04-01T19:56:36.696 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96d375b8:::benchmark_data_smithi188_161190_object60244:head# 2024-04-01T19:56:36.697 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96d4a70c:::benchmark_data_smithi188_161190_object116068:head# 2024-04-01T19:56:36.697 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96d60354:::benchmark_data_smithi188_161190_object114585:head# 2024-04-01T19:56:36.698 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96d6bd00:::benchmark_data_smithi188_161190_object80334:head# 2024-04-01T19:56:36.698 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96d6f3d9:::benchmark_data_smithi188_161190_object99871:head# 2024-04-01T19:56:36.701 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96d776d2:::benchmark_data_smithi188_161190_object64780:head# 2024-04-01T19:56:36.702 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96d80a9d:::benchmark_data_smithi188_161190_object101134:head# 2024-04-01T19:56:36.702 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96d824fd:::benchmark_data_smithi188_161190_object35704:head# 2024-04-01T19:56:36.703 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96d826d7:::benchmark_data_smithi188_161190_object70502:head# 2024-04-01T19:56:36.703 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96da6b4c:::benchmark_data_smithi188_161190_object44634:head# 2024-04-01T19:56:36.704 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96dadefc:::benchmark_data_smithi188_161190_object23474:head# 2024-04-01T19:56:36.704 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96dbd71d:::benchmark_data_smithi188_161190_object80461:head# 2024-04-01T19:56:36.705 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96dbfc70:::benchmark_data_smithi188_161190_object94389:head# 2024-04-01T19:56:36.705 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96dc903b:::benchmark_data_smithi188_161190_object52895:head# 2024-04-01T19:56:36.706 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96dcf8a9:::benchmark_data_smithi188_161190_object100337:head# 2024-04-01T19:56:36.706 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96de1e45:::benchmark_data_smithi188_161190_object99098:head# 2024-04-01T19:56:36.710 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96de8075:::benchmark_data_smithi188_161190_object111701:head# 2024-04-01T19:56:36.710 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96deda99:::benchmark_data_smithi188_161190_object123612:head# 2024-04-01T19:56:36.710 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96df1fd9:::benchmark_data_smithi188_161190_object112282:head# 2024-04-01T19:56:36.710 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96dfe9f1:::benchmark_data_smithi188_161190_object91866:head# 2024-04-01T19:56:36.710 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96e038a4:::benchmark_data_smithi188_161190_object122151:head# 2024-04-01T19:56:36.711 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96e12b94:::benchmark_data_smithi188_161190_object123642:head# 2024-04-01T19:56:36.711 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96e1f693:::benchmark_data_smithi188_161190_object22141:head# 2024-04-01T19:56:36.714 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96e29e19:::benchmark_data_smithi188_161190_object98445:head# 2024-04-01T19:56:36.714 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96e2d42c:::benchmark_data_smithi188_161190_object101425:head# 2024-04-01T19:56:36.714 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96e2edfc:::benchmark_data_smithi188_161190_object115149:head# 2024-04-01T19:56:36.720 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96e354c4:::benchmark_data_smithi188_161190_object117216:head# 2024-04-01T19:56:36.720 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96e36c86:::benchmark_data_smithi188_161190_object62705:head# 2024-04-01T19:56:36.721 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96e47bc2:::benchmark_data_smithi188_161190_object82461:head# 2024-04-01T19:56:36.721 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96e48585:::benchmark_data_smithi188_161190_object56129:head# 2024-04-01T19:56:36.722 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96e50374:::benchmark_data_smithi188_161190_object88491:head# 2024-04-01T19:56:36.725 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96e53ed6:::benchmark_data_smithi188_161190_object25753:head# 2024-04-01T19:56:36.725 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96e55d1c:::benchmark_data_smithi188_161190_object20504:head# 2024-04-01T19:56:36.725 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96e63cf0:::benchmark_data_smithi188_161190_object135585:head# 2024-04-01T19:56:36.725 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96e6b629:::benchmark_data_smithi188_161190_object36078:head# 2024-04-01T19:56:36.726 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96e708c4:::benchmark_data_smithi188_161190_object95479:head# 2024-04-01T19:56:36.726 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96e74458:::benchmark_data_smithi188_161190_object118754:head# 2024-04-01T19:56:36.726 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96e769e8:::benchmark_data_smithi188_161190_object97388:head# 2024-04-01T19:56:36.726 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96e76e25:::benchmark_data_smithi188_161190_object105916:head# 2024-04-01T19:56:36.726 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96e9cf76:::benchmark_data_smithi188_161190_object112619:head# 2024-04-01T19:56:36.727 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96ea1e7b:::benchmark_data_smithi188_161190_object100419:head# 2024-04-01T19:56:36.727 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96ea7ee5:::benchmark_data_smithi188_161190_object55553:head# 2024-04-01T19:56:36.727 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96eab4e5:::benchmark_data_smithi188_161190_object30364:head# 2024-04-01T19:56:36.728 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96eb8a93:::benchmark_data_smithi188_161190_object89744:head# 2024-04-01T19:56:36.728 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96ecd326:::benchmark_data_smithi188_161190_object43006:head# 2024-04-01T19:56:36.728 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96eee51e:::benchmark_data_smithi188_161190_object131681:head# 2024-04-01T19:56:36.729 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96ef0468:::benchmark_data_smithi188_161190_object75576:head# 2024-04-01T19:56:36.729 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96ef5295:::benchmark_data_smithi188_161190_object138676:head# 2024-04-01T19:56:36.730 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96efa6e8:::benchmark_data_smithi188_161190_object23192:head# 2024-04-01T19:56:36.730 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96f068c1:::benchmark_data_smithi188_161190_object74428:head# 2024-04-01T19:56:36.731 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96f0ea68:::benchmark_data_smithi188_161190_object123817:head# 2024-04-01T19:56:36.731 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96f1bc5b:::benchmark_data_smithi188_161190_object26632:head# 2024-04-01T19:56:36.731 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96f1c070:::benchmark_data_smithi188_161190_object79991:head# 2024-04-01T19:56:36.732 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96f1f359:::benchmark_data_smithi188_161190_object36540:head# 2024-04-01T19:56:36.732 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96f1f77d:::benchmark_data_smithi188_161190_object22740:head# 2024-04-01T19:56:36.733 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96f23ad7:::benchmark_data_smithi188_161190_object124906:head# 2024-04-01T19:56:36.733 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96f23da8:::benchmark_data_smithi188_161190_object126986:head# 2024-04-01T19:56:36.734 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96f24d22:::benchmark_data_smithi188_161190_object110832:head# 2024-04-01T19:56:36.734 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96f30943:::benchmark_data_smithi188_161190_object97854:head# 2024-04-01T19:56:36.735 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96f37fc3:::benchmark_data_smithi188_161190_object108867:head# 2024-04-01T19:56:36.735 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96f4021b:::benchmark_data_smithi188_161190_object34372:head# 2024-04-01T19:56:36.735 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96f40c67:::benchmark_data_smithi188_161190_object124117:head# 2024-04-01T19:56:36.736 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96f49089:::benchmark_data_smithi188_161190_object24730:head# 2024-04-01T19:56:36.736 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96f4c875:::benchmark_data_smithi188_161190_object29109:head# 2024-04-01T19:56:36.736 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96f4cae3:::benchmark_data_smithi188_161190_object26683:head# 2024-04-01T19:56:36.737 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96f5a0ba:::benchmark_data_smithi188_161190_object99807:head# 2024-04-01T19:56:36.737 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96f5f9e0:::benchmark_data_smithi188_161190_object19968:head# 2024-04-01T19:56:36.738 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96f67c19:::benchmark_data_smithi188_161190_object39647:head# 2024-04-01T19:56:36.738 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96f70275:::benchmark_data_smithi188_161190_object40845:head# 2024-04-01T19:56:36.738 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96f89532:::benchmark_data_smithi188_161190_object136612:head# 2024-04-01T19:56:36.739 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96f8c345:::benchmark_data_smithi188_161190_object96863:head# 2024-04-01T19:56:36.739 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96f8ce94:::benchmark_data_smithi188_161190_object57502:head# 2024-04-01T19:56:36.741 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96f9175f:::benchmark_data_smithi188_161190_object71580:head# 2024-04-01T19:56:36.742 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96f99a55:::benchmark_data_smithi188_161190_object98957:head# 2024-04-01T19:56:36.742 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96fa9053:::benchmark_data_smithi188_161190_object89377:head# 2024-04-01T19:56:36.743 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96faa6ee:::benchmark_data_smithi188_161190_object112023:head# 2024-04-01T19:56:36.743 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96fae122:::benchmark_data_smithi188_161190_object83066:head# 2024-04-01T19:56:36.743 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96fc2b89:::benchmark_data_smithi188_161190_object93322:head# 2024-04-01T19:56:36.744 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96fcd900:::benchmark_data_smithi188_161190_object91910:head# 2024-04-01T19:56:36.744 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96fe6a73:::benchmark_data_smithi188_161190_object112602:head# 2024-04-01T19:56:36.745 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96fe8576:::benchmark_data_smithi188_161190_object22145:head# 2024-04-01T19:56:36.745 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96ff2967:::benchmark_data_smithi188_161190_object139023:head# 2024-04-01T19:56:36.746 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:96ffa3cd:::benchmark_data_smithi188_161190_object34488:head# 2024-04-01T19:56:36.746 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:970047e1:::benchmark_data_smithi188_161190_object86510:head# 2024-04-01T19:56:36.747 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9701068c:::benchmark_data_smithi188_161190_object130604:head# 2024-04-01T19:56:36.747 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:970131a9:::benchmark_data_smithi188_161190_object54561:head# 2024-04-01T19:56:36.747 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9701423f:::benchmark_data_smithi188_161190_object72112:head# 2024-04-01T19:56:36.748 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9701d028:::benchmark_data_smithi188_161190_object25712:head# 2024-04-01T19:56:36.748 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9701e01b:::benchmark_data_smithi188_161190_object90795:head# 2024-04-01T19:56:36.749 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9702b544:::benchmark_data_smithi188_161190_object130869:head# 2024-04-01T19:56:36.749 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:970328a3:::benchmark_data_smithi188_161190_object37805:head# 2024-04-01T19:56:36.750 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9703d855:::benchmark_data_smithi188_161190_object21279:head# 2024-04-01T19:56:36.750 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9704b507:::benchmark_data_smithi188_161190_object62260:head# 2024-04-01T19:56:36.751 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9704b598:::benchmark_data_smithi188_161190_object53401:head# 2024-04-01T19:56:36.751 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9706ab39:::benchmark_data_smithi188_161190_object36303:head# 2024-04-01T19:56:36.751 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9706b4d6:::benchmark_data_smithi188_161190_object125493:head# 2024-04-01T19:56:36.752 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:970774e1:::benchmark_data_smithi188_161190_object102685:head# 2024-04-01T19:56:36.752 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97080e7d:::benchmark_data_smithi188_161190_object27901:head# 2024-04-01T19:56:36.752 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9708622d:::benchmark_data_smithi188_161190_object104659:head# 2024-04-01T19:56:36.753 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97087dfd:::benchmark_data_smithi188_161190_object40716:head# 2024-04-01T19:56:36.753 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9708c7d4:::benchmark_data_smithi188_161190_object31451:head# 2024-04-01T19:56:36.753 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97096152:::benchmark_data_smithi188_161190_object47393:head# 2024-04-01T19:56:36.754 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:970a6d5a:::benchmark_data_smithi188_161190_object36743:head# 2024-04-01T19:56:36.754 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:970a9b99:::benchmark_data_smithi188_161190_object117196:head# 2024-04-01T19:56:36.755 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:970a9c35:::benchmark_data_smithi188_161190_object66365:head# 2024-04-01T19:56:36.755 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:970aa784:::benchmark_data_smithi188_161190_object135623:head# 2024-04-01T19:56:36.756 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:970b2b97:::benchmark_data_smithi188_161190_object33745:head# 2024-04-01T19:56:36.757 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:970cc04d:::benchmark_data_smithi188_161190_object76255:head# 2024-04-01T19:56:36.758 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:970e88ce:::benchmark_data_smithi188_161190_object105201:head# 2024-04-01T19:56:36.758 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:970ebb0d:::benchmark_data_smithi188_161190_object34176:head# 2024-04-01T19:56:36.759 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:970ed821:::benchmark_data_smithi188_161190_object137304:head# 2024-04-01T19:56:36.759 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97102425:::benchmark_data_smithi188_161190_object103236:head# 2024-04-01T19:56:36.759 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97105eee:::benchmark_data_smithi188_161190_object70707:head# 2024-04-01T19:56:36.760 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9710eb59:::benchmark_data_smithi188_161190_object77007:head# 2024-04-01T19:56:36.760 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9710f4f6:::benchmark_data_smithi188_161190_object42316:head# 2024-04-01T19:56:36.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:36 smithi062 ceph-mon[44211]: 8.0 scrub ok 2024-04-01T19:56:36.761 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9711356a:::benchmark_data_smithi188_161190_object104822:head# 2024-04-01T19:56:36.761 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97118feb:::benchmark_data_smithi188_161190_object24581:head# 2024-04-01T19:56:36.762 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:971275d7:::benchmark_data_smithi188_161190_object100129:head# 2024-04-01T19:56:36.762 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9712778d:::benchmark_data_smithi188_161190_object106998:head# 2024-04-01T19:56:36.763 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9713a9a0:::benchmark_data_smithi188_161190_object123026:head# 2024-04-01T19:56:36.763 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9713b441:::benchmark_data_smithi188_161190_object58757:head# 2024-04-01T19:56:36.763 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9714fede:::benchmark_data_smithi188_161190_object36308:head# 2024-04-01T19:56:36.763 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97152d1b:::benchmark_data_smithi188_161190_object75826:head# 2024-04-01T19:56:36.764 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97159992:::benchmark_data_smithi188_161190_object74060:head# 2024-04-01T19:56:36.764 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9715e35f:::benchmark_data_smithi188_161190_object108286:head# 2024-04-01T19:56:36.765 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97161afd:::benchmark_data_smithi188_161190_object59572:head# 2024-04-01T19:56:36.765 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:971623b1:::benchmark_data_smithi188_161190_object34311:head# 2024-04-01T19:56:36.765 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97166c73:::benchmark_data_smithi188_161190_object81889:head# 2024-04-01T19:56:36.766 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97179024:::benchmark_data_smithi188_161190_object40663:head# 2024-04-01T19:56:36.766 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9719365f:::benchmark_data_smithi188_161190_object113929:head# 2024-04-01T19:56:36.767 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:971a315c:::benchmark_data_smithi188_161190_object24760:head# 2024-04-01T19:56:36.767 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:971b9565:::benchmark_data_smithi188_161190_object29198:head# 2024-04-01T19:56:36.768 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:971b9ecc:::benchmark_data_smithi188_161190_object77369:head# 2024-04-01T19:56:36.768 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:971bd915:::benchmark_data_smithi188_161190_object67776:head# 2024-04-01T19:56:36.769 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:971ce4a1:::benchmark_data_smithi188_161190_object115298:head# 2024-04-01T19:56:36.769 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:971cf16e:::benchmark_data_smithi188_161190_object41313:head# 2024-04-01T19:56:36.769 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:971dcb88:::benchmark_data_smithi188_161190_object115660:head# 2024-04-01T19:56:36.770 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:971eea5e:::benchmark_data_smithi188_161190_object87033:head# 2024-04-01T19:56:36.770 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:971fade0:::benchmark_data_smithi188_161190_object53628:head# 2024-04-01T19:56:36.771 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:971fc584:::benchmark_data_smithi188_161190_object82540:head# 2024-04-01T19:56:36.771 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9721880d:::benchmark_data_smithi188_161190_object20635:head# 2024-04-01T19:56:36.772 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97224f01:::benchmark_data_smithi188_161190_object67206:head# 2024-04-01T19:56:36.772 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97225a72:::benchmark_data_smithi188_161190_object53023:head# 2024-04-01T19:56:36.772 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9722a1aa:::benchmark_data_smithi188_161190_object53889:head# 2024-04-01T19:56:36.773 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97230c67:::benchmark_data_smithi188_161190_object129991:head# 2024-04-01T19:56:36.773 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9724075c:::benchmark_data_smithi188_161190_object68360:head# 2024-04-01T19:56:36.774 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9725d802:::benchmark_data_smithi188_161190_object70463:head# 2024-04-01T19:56:36.776 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9725edf6:::benchmark_data_smithi188_161190_object104412:head# 2024-04-01T19:56:36.776 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97267bc0:::benchmark_data_smithi188_161190_object115341:head# 2024-04-01T19:56:36.776 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97282911:::benchmark_data_smithi188_161190_object40166:head# 2024-04-01T19:56:36.777 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9728495c:::benchmark_data_smithi188_161190_object129131:head# 2024-04-01T19:56:36.777 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97287758:::benchmark_data_smithi188_161190_object32734:head# 2024-04-01T19:56:36.777 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9728be6b:::benchmark_data_smithi188_161190_object65469:head# 2024-04-01T19:56:36.778 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9728e13d:::benchmark_data_smithi188_161190_object53534:head# 2024-04-01T19:56:36.778 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9729cf2b:::benchmark_data_smithi188_161190_object65638:head# 2024-04-01T19:56:36.778 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:972b0956:::benchmark_data_smithi188_161190_object126311:head# 2024-04-01T19:56:36.779 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:972b20ab:::benchmark_data_smithi188_161190_object59150:head# 2024-04-01T19:56:36.779 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:972bb93d:::benchmark_data_smithi188_161190_object25967:head# 2024-04-01T19:56:36.784 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:972c7301:::benchmark_data_smithi188_161190_object27597:head# 2024-04-01T19:56:36.784 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:972cf24e:::benchmark_data_smithi188_161190_object88921:head# 2024-04-01T19:56:36.785 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:972db805:::benchmark_data_smithi188_161190_object92880:head# 2024-04-01T19:56:36.785 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:972e8502:::benchmark_data_smithi188_161190_object134190:head# 2024-04-01T19:56:36.785 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:972f422e:::benchmark_data_smithi188_161190_object116131:head# 2024-04-01T19:56:36.785 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:972fbe5f:::benchmark_data_smithi188_161190_object109571:head# 2024-04-01T19:56:36.787 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97307005:::benchmark_data_smithi188_161190_object28360:head# 2024-04-01T19:56:36.792 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97309ef3:::benchmark_data_smithi188_161190_object131682:head# 2024-04-01T19:56:36.793 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9731d751:::benchmark_data_smithi188_161190_object106732:head# 2024-04-01T19:56:36.793 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9731d7f9:::benchmark_data_smithi188_161190_object111057:head# 2024-04-01T19:56:36.793 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9731f229:::benchmark_data_smithi188_161190_object72431:head# 2024-04-01T19:56:36.793 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9731feed:::benchmark_data_smithi188_161190_object91407:head# 2024-04-01T19:56:36.793 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97322f5c:::benchmark_data_smithi188_161190_object75992:head# 2024-04-01T19:56:36.793 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:973499c2:::benchmark_data_smithi188_161190_object108218:head# 2024-04-01T19:56:36.793 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97353be4:::benchmark_data_smithi188_161190_object128436:head# 2024-04-01T19:56:36.793 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9735be1d:::benchmark_data_smithi188_161190_object38357:head# 2024-04-01T19:56:36.793 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9735dec6:::benchmark_data_smithi188_161190_object108523:head# 2024-04-01T19:56:36.793 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97378981:::benchmark_data_smithi188_161190_object123077:head# 2024-04-01T19:56:36.793 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9737c481:::benchmark_data_smithi188_161190_object132836:head# 2024-04-01T19:56:36.793 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97380a08:::benchmark_data_smithi188_161190_object93390:head# 2024-04-01T19:56:36.794 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9738141f:::benchmark_data_smithi188_161190_object32556:head# 2024-04-01T19:56:36.794 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97386bf1:::benchmark_data_smithi188_161190_object65466:head# 2024-04-01T19:56:36.794 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:973873e1:::benchmark_data_smithi188_161190_object25807:head# 2024-04-01T19:56:36.795 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97388ce9:::benchmark_data_smithi188_161190_object41442:head# 2024-04-01T19:56:36.795 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97392383:::benchmark_data_smithi188_161190_object55478:head# 2024-04-01T19:56:36.795 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:973ae93b:::benchmark_data_smithi188_161190_object109561:head# 2024-04-01T19:56:36.796 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:973b0e73:::benchmark_data_smithi188_161190_object113602:head# 2024-04-01T19:56:36.797 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:973b71b0:::benchmark_data_smithi188_161190_object38682:head# 2024-04-01T19:56:36.797 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:973b9862:::benchmark_data_smithi188_161190_object134164:head# 2024-04-01T19:56:36.797 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:973c0e45:::benchmark_data_smithi188_161190_object46507:head# 2024-04-01T19:56:36.797 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:973c6082:::benchmark_data_smithi188_161190_object80147:head# 2024-04-01T19:56:36.797 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:973ca9ba:::benchmark_data_smithi188_161190_object35296:head# 2024-04-01T19:56:36.797 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:973ce2fa:::benchmark_data_smithi188_161190_object125369:head# 2024-04-01T19:56:36.798 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:973ee9ff:::benchmark_data_smithi188_161190_object120041:head# 2024-04-01T19:56:36.798 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:973f9f21:::benchmark_data_smithi188_161190_object91384:head# 2024-04-01T19:56:36.799 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:973fa574:::benchmark_data_smithi188_161190_object136958:head# 2024-04-01T19:56:36.799 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:973fad14:::benchmark_data_smithi188_161190_object47518:head# 2024-04-01T19:56:36.799 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:973fd426:::benchmark_data_smithi188_161190_object28457:head# 2024-04-01T19:56:36.803 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97400fae:::benchmark_data_smithi188_161190_object131585:head# 2024-04-01T19:56:36.804 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9740618c:::benchmark_data_smithi188_161190_object68641:head# 2024-04-01T19:56:36.804 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:974065cf:::benchmark_data_smithi188_161190_object122511:head# 2024-04-01T19:56:36.805 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9740c5db:::benchmark_data_smithi188_161190_object50348:head# 2024-04-01T19:56:36.805 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97415824:::benchmark_data_smithi188_161190_object88622:head# 2024-04-01T19:56:36.806 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97416818:::benchmark_data_smithi188_161190_object101192:head# 2024-04-01T19:56:36.806 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9741ecb0:::benchmark_data_smithi188_161190_object110731:head# 2024-04-01T19:56:36.807 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97421465:::benchmark_data_smithi188_161190_object104024:head# 2024-04-01T19:56:36.807 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9742c31a:::benchmark_data_smithi188_161190_object114925:head# 2024-04-01T19:56:36.807 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9742d5e3:::benchmark_data_smithi188_161190_object126471:head# 2024-04-01T19:56:36.808 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97430940:::benchmark_data_smithi188_161190_object67573:head# 2024-04-01T19:56:36.808 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9743236b:::benchmark_data_smithi188_161190_object99885:head# 2024-04-01T19:56:36.809 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97434447:::benchmark_data_smithi188_161190_object58468:head# 2024-04-01T19:56:36.809 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9743d59a:::benchmark_data_smithi188_161190_object27328:head# 2024-04-01T19:56:36.809 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97441664:::benchmark_data_smithi188_161190_object62421:head# 2024-04-01T19:56:36.810 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:974469f9:::benchmark_data_smithi188_161190_object65844:head# 2024-04-01T19:56:36.810 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97454ec9:::benchmark_data_smithi188_161190_object75464:head# 2024-04-01T19:56:36.811 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9745c748:::benchmark_data_smithi188_161190_object48198:head# 2024-04-01T19:56:36.811 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97477a76:::benchmark_data_smithi188_161190_object104488:head# 2024-04-01T19:56:36.816 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9747b703:::benchmark_data_smithi188_161190_object28982:head# 2024-04-01T19:56:36.816 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:974805da:::benchmark_data_smithi188_161190_object104894:head# 2024-04-01T19:56:36.816 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97486224:::benchmark_data_smithi188_161190_object59373:head# 2024-04-01T19:56:36.816 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:974888fc:::benchmark_data_smithi188_161190_object42196:head# 2024-04-01T19:56:36.816 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9748a4ce:::benchmark_data_smithi188_161190_object41323:head# 2024-04-01T19:56:36.816 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9748a636:::benchmark_data_smithi188_161190_object61283:head# 2024-04-01T19:56:36.816 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:974a01df:::benchmark_data_smithi188_161190_object71245:head# 2024-04-01T19:56:36.817 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:974ad069:::benchmark_data_smithi188_161190_object76028:head# 2024-04-01T19:56:36.817 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:974c49a2:::benchmark_data_smithi188_161190_object58007:head# 2024-04-01T19:56:36.817 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:974d8d4a:::benchmark_data_smithi188_161190_object98041:head# 2024-04-01T19:56:36.817 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:974e47db:::benchmark_data_smithi188_161190_object62147:head# 2024-04-01T19:56:36.818 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:974e5d96:::benchmark_data_smithi188_161190_object106919:head# 2024-04-01T19:56:36.818 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:974eb518:::benchmark_data_smithi188_161190_object129938:head# 2024-04-01T19:56:36.818 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:974f56b8:::benchmark_data_smithi188_161190_object66464:head# 2024-04-01T19:56:36.819 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:974fd850:::benchmark_data_smithi188_161190_object48595:head# 2024-04-01T19:56:36.819 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97507ce8:::benchmark_data_smithi188_161190_object96743:head# 2024-04-01T19:56:36.820 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9750c786:::benchmark_data_smithi188_161190_object66120:head# 2024-04-01T19:56:36.820 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9751b9a5:::benchmark_data_smithi188_161190_object100530:head# 2024-04-01T19:56:36.821 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:975406ca:::benchmark_data_smithi188_161190_object55840:head# 2024-04-01T19:56:36.821 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97541dc5:::benchmark_data_smithi188_161190_object69738:head# 2024-04-01T19:56:36.821 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9755f1a8:::benchmark_data_smithi188_161190_object106753:head# 2024-04-01T19:56:36.830 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97568fc7:::benchmark_data_smithi188_161190_object90975:head# 2024-04-01T19:56:36.830 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97574ee6:::benchmark_data_smithi188_161190_object56832:head# 2024-04-01T19:56:36.830 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97583504:::benchmark_data_smithi188_161190_object82675:head# 2024-04-01T19:56:36.830 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97588c0e:::benchmark_data_smithi188_161190_object99305:head# 2024-04-01T19:56:36.830 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:975931ab:::benchmark_data_smithi188_161190_object114948:head# 2024-04-01T19:56:36.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97597fde:::benchmark_data_smithi188_161190_object75535:head# 2024-04-01T19:56:36.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9759fc6d:::benchmark_data_smithi188_161190_object81074:head# 2024-04-01T19:56:36.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:975a9176:::benchmark_data_smithi188_161190_object56503:head# 2024-04-01T19:56:36.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:975b350b:::benchmark_data_smithi188_161190_object130824:head# 2024-04-01T19:56:36.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:975b730b:::benchmark_data_smithi188_161190_object121725:head# 2024-04-01T19:56:36.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:975b9415:::benchmark_data_smithi188_161190_object137485:head# 2024-04-01T19:56:36.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:975c048f:::benchmark_data_smithi188_161190_object47239:head# 2024-04-01T19:56:36.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:975c9b5f:::benchmark_data_smithi188_161190_object36680:head# 2024-04-01T19:56:36.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:975cb10e:::benchmark_data_smithi188_161190_object96261:head# 2024-04-01T19:56:36.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:975cebbb:::benchmark_data_smithi188_161190_object125485:head# 2024-04-01T19:56:36.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:975d5acb:::benchmark_data_smithi188_161190_object64263:head# 2024-04-01T19:56:36.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:975d9ecf:::benchmark_data_smithi188_161190_object91020:head# 2024-04-01T19:56:36.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:975e7d88:::benchmark_data_smithi188_161190_object115526:head# 2024-04-01T19:56:36.832 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97603399:::benchmark_data_smithi188_161190_object80562:head# 2024-04-01T19:56:36.832 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97609544:::benchmark_data_smithi188_161190_object90421:head# 2024-04-01T19:56:36.833 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9760b12c:::benchmark_data_smithi188_161190_object73858:head# 2024-04-01T19:56:36.833 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:976258b9:::benchmark_data_smithi188_161190_object117315:head# 2024-04-01T19:56:36.833 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:976290dd:::benchmark_data_smithi188_161190_object98223:head# 2024-04-01T19:56:36.833 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9762d46c:::benchmark_data_smithi188_161190_object98868:head# 2024-04-01T19:56:36.833 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9763548a:::benchmark_data_smithi188_161190_object28907:head# 2024-04-01T19:56:36.834 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9763acce:::benchmark_data_smithi188_161190_object111109:head# 2024-04-01T19:56:36.834 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9763efcc:::benchmark_data_smithi188_161190_object118604:head# 2024-04-01T19:56:36.834 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97658a4b:::benchmark_data_smithi188_161190_object125286:head# 2024-04-01T19:56:36.835 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9765b413:::benchmark_data_smithi188_161190_object57278:head# 2024-04-01T19:56:36.835 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97672061:::benchmark_data_smithi188_161190_object118480:head# 2024-04-01T19:56:36.836 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9768b12d:::benchmark_data_smithi188_161190_object80655:head# 2024-04-01T19:56:36.836 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9769fb24:::benchmark_data_smithi188_161190_object127182:head# 2024-04-01T19:56:36.837 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9769fb31:::benchmark_data_smithi188_161190_object106023:head# 2024-04-01T19:56:36.837 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:976b5192:::benchmark_data_smithi188_161190_object133395:head# 2024-04-01T19:56:36.837 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:976b739a:::benchmark_data_smithi188_161190_object88874:head# 2024-04-01T19:56:36.838 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:976cc0e7:::benchmark_data_smithi188_161190_object118670:head# 2024-04-01T19:56:36.838 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:976db24a:::benchmark_data_smithi188_161190_object102286:head# 2024-04-01T19:56:36.839 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:976de27b:::benchmark_data_smithi188_161190_object48865:head# 2024-04-01T19:56:36.839 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:976e1334:::benchmark_data_smithi188_161190_object88347:head# 2024-04-01T19:56:36.840 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:976fb2ef:::benchmark_data_smithi188_161190_object103751:head# 2024-04-01T19:56:36.840 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97702277:::benchmark_data_smithi188_161190_object136754:head# 2024-04-01T19:56:36.841 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9770782b:::benchmark_data_smithi188_161190_object27946:head# 2024-04-01T19:56:36.841 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97713171:::benchmark_data_smithi188_161190_object67955:head# 2024-04-01T19:56:36.842 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9773960e:::benchmark_data_smithi188_161190_object34332:head# 2024-04-01T19:56:36.842 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9773e1ea:::benchmark_data_smithi188_161190_object89392:head# 2024-04-01T19:56:36.843 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97747f3d:::benchmark_data_smithi188_161190_object71205:head# 2024-04-01T19:56:36.843 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97766238:::benchmark_data_smithi188_161190_object34257:head# 2024-04-01T19:56:36.843 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9777e6fa:::benchmark_data_smithi188_161190_object94238:head# 2024-04-01T19:56:36.846 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9777fdb2:::benchmark_data_smithi188_161190_object106433:head# 2024-04-01T19:56:36.847 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:977818eb:::benchmark_data_smithi188_161190_object97200:head# 2024-04-01T19:56:36.847 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97793e4b:::benchmark_data_smithi188_161190_object137847:head# 2024-04-01T19:56:36.852 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:977ae881:::benchmark_data_smithi188_161190_object42859:head# 2024-04-01T19:56:36.852 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:977b4abc:::benchmark_data_smithi188_161190_object87199:head# 2024-04-01T19:56:36.853 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:977bfe7b:::benchmark_data_smithi188_161190_object116118:head# 2024-04-01T19:56:36.853 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:977c0bab:::benchmark_data_smithi188_161190_object82456:head# 2024-04-01T19:56:36.853 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:977c2482:::benchmark_data_smithi188_161190_object122559:head# 2024-04-01T19:56:36.853 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:977c6e79:::benchmark_data_smithi188_161190_object47708:head# 2024-04-01T19:56:36.853 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:977d02b1:::benchmark_data_smithi188_161190_object119709:head# 2024-04-01T19:56:36.855 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:977d191f:::benchmark_data_smithi188_161190_object42785:head# 2024-04-01T19:56:36.855 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:977d699b:::benchmark_data_smithi188_161190_object98372:head# 2024-04-01T19:56:36.855 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:977e9f04:::benchmark_data_smithi188_161190_object24369:head# 2024-04-01T19:56:36.856 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:977ef5b6:::benchmark_data_smithi188_161190_object81582:head# 2024-04-01T19:56:36.856 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:977f4f95:::benchmark_data_smithi188_161190_object134271:head# 2024-04-01T19:56:36.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:36 smithi022 ceph-mon[39439]: 8.0 scrub ok 2024-04-01T19:56:36.867 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:977f5c80:::benchmark_data_smithi188_161190_object39695:head# 2024-04-01T19:56:36.867 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:977f7431:::benchmark_data_smithi188_161190_object48912:head# 2024-04-01T19:56:36.867 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9780226b:::benchmark_data_smithi188_161190_object51900:head# 2024-04-01T19:56:36.867 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9780c3d2:::benchmark_data_smithi188_161190_object110447:head# 2024-04-01T19:56:36.867 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97818689:::benchmark_data_smithi188_161190_object68202:head# 2024-04-01T19:56:36.868 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9781d40e:::benchmark_data_smithi188_161190_object121777:head# 2024-04-01T19:56:36.868 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97823ae4:::benchmark_data_smithi188_161190_object125188:head# 2024-04-01T19:56:36.868 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97839e91:::benchmark_data_smithi188_161190_object87030:head# 2024-04-01T19:56:36.868 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9783b454:::benchmark_data_smithi188_161190_object95823:head# 2024-04-01T19:56:36.868 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:978440e0:::benchmark_data_smithi188_161190_object126694:head# 2024-04-01T19:56:36.868 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9784a8bf:::benchmark_data_smithi188_161190_object76236:head# 2024-04-01T19:56:36.868 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97856fe9:::benchmark_data_smithi188_161190_object114169:head# 2024-04-01T19:56:36.868 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:978684be:::benchmark_data_smithi188_161190_object35145:head# 2024-04-01T19:56:36.868 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9786caf8:::benchmark_data_smithi188_161190_object62248:head# 2024-04-01T19:56:36.868 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97871712:::benchmark_data_smithi188_161190_object47617:head# 2024-04-01T19:56:36.868 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9788242c:::benchmark_data_smithi188_161190_object40957:head# 2024-04-01T19:56:36.868 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9788aa68:::benchmark_data_smithi188_161190_object111204:head# 2024-04-01T19:56:36.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:36 smithi188 ceph-mon[43939]: 8.0 scrub ok 2024-04-01T19:56:36.878 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:978917cd:::benchmark_data_smithi188_161190_object60554:head# 2024-04-01T19:56:36.878 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:978998a0:::benchmark_data_smithi188_161190_object86966:head# 2024-04-01T19:56:36.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:978a9ce0:::benchmark_data_smithi188_161190_object102247:head# 2024-04-01T19:56:36.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:978acdf3:::benchmark_data_smithi188_161190_object127921:head# 2024-04-01T19:56:36.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:978c2ea7:::benchmark_data_smithi188_161190_object35773:head# 2024-04-01T19:56:36.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:978c4bbc:::benchmark_data_smithi188_161190_object127446:head# 2024-04-01T19:56:36.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:978d33e8:::benchmark_data_smithi188_161190_object127641:head# 2024-04-01T19:56:36.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:978e716b:::benchmark_data_smithi188_161190_object104838:head# 2024-04-01T19:56:36.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:978ea0ab:::benchmark_data_smithi188_161190_object26019:head# 2024-04-01T19:56:36.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:978faa5f:::benchmark_data_smithi188_161190_object102023:head# 2024-04-01T19:56:36.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97903762:::benchmark_data_smithi188_161190_object100656:head# 2024-04-01T19:56:36.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97907c9b:::benchmark_data_smithi188_161190_object111096:head# 2024-04-01T19:56:36.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:979162ca:::benchmark_data_smithi188_161190_object89065:head# 2024-04-01T19:56:36.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9791aeca:::benchmark_data_smithi188_161190_object27024:head# 2024-04-01T19:56:36.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:979207a7:::benchmark_data_smithi188_161190_object27648:head# 2024-04-01T19:56:36.880 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9792f1dd:::benchmark_data_smithi188_161190_object89310:head# 2024-04-01T19:56:36.880 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9793afcc:::benchmark_data_smithi188_161190_object62233:head# 2024-04-01T19:56:36.880 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9793dec9:::benchmark_data_smithi188_161190_object129216:head# 2024-04-01T19:56:36.880 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97940f4b:::benchmark_data_smithi188_161190_object30546:head# 2024-04-01T19:56:36.880 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9794685a:::benchmark_data_smithi188_161190_object23860:head# 2024-04-01T19:56:36.880 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:979539cb:::benchmark_data_smithi188_161190_object22769:head# 2024-04-01T19:56:36.881 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97970298:::benchmark_data_smithi188_161190_object112346:head# 2024-04-01T19:56:36.881 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9797742a:::benchmark_data_smithi188_161190_object134052:head# 2024-04-01T19:56:36.881 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97980190:::benchmark_data_smithi188_161190_object26321:head# 2024-04-01T19:56:36.881 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:979a5c33:::benchmark_data_smithi188_161190_object56083:head# 2024-04-01T19:56:36.882 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:979c0ad6:::benchmark_data_smithi188_161190_object81317:head# 2024-04-01T19:56:36.882 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:979c937e:::benchmark_data_smithi188_161190_object61413:head# 2024-04-01T19:56:36.882 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:979cf0ee:::benchmark_data_smithi188_161190_object28711:head# 2024-04-01T19:56:36.882 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:979d2a57:::benchmark_data_smithi188_161190_object86416:head# 2024-04-01T19:56:36.883 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:979d6788:::benchmark_data_smithi188_161190_object20364:head# 2024-04-01T19:56:36.883 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:979dbd7d:::benchmark_data_smithi188_161190_object124564:head# 2024-04-01T19:56:36.884 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:979e6de8:::benchmark_data_smithi188_161190_object61374:head# 2024-04-01T19:56:36.890 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:979f280b:::benchmark_data_smithi188_161190_object105091:head# 2024-04-01T19:56:36.890 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:979f5237:::benchmark_data_smithi188_161190_object103082:head# 2024-04-01T19:56:36.890 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:979f5aa1:::benchmark_data_smithi188_161190_object61236:head# 2024-04-01T19:56:36.890 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97a09a57:::benchmark_data_smithi188_161190_object112450:head# 2024-04-01T19:56:36.890 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97a0d462:::benchmark_data_smithi188_161190_object115509:head# 2024-04-01T19:56:36.890 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97a15814:::benchmark_data_smithi188_161190_object63752:head# 2024-04-01T19:56:36.890 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97a15ec3:::benchmark_data_smithi188_161190_object67791:head# 2024-04-01T19:56:36.890 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97a201f4:::benchmark_data_smithi188_161190_object111352:head# 2024-04-01T19:56:36.891 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97a39775:::benchmark_data_smithi188_161190_object126408:head# 2024-04-01T19:56:36.891 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97a50b4f:::benchmark_data_smithi188_161190_object30362:head# 2024-04-01T19:56:36.891 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97a56c56:::benchmark_data_smithi188_161190_object124385:head# 2024-04-01T19:56:36.891 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97a58871:::benchmark_data_smithi188_161190_object89794:head# 2024-04-01T19:56:36.891 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97a593e1:::benchmark_data_smithi188_161190_object65679:head# 2024-04-01T19:56:36.891 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97a5f6a2:::benchmark_data_smithi188_161190_object27279:head# 2024-04-01T19:56:36.892 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97a63f65:::benchmark_data_smithi188_161190_object53745:head# 2024-04-01T19:56:36.892 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97a752e4:::benchmark_data_smithi188_161190_object68364:head# 2024-04-01T19:56:36.892 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97a78bb2:::benchmark_data_smithi188_161190_object59420:head# 2024-04-01T19:56:36.892 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97a7c35d:::benchmark_data_smithi188_161190_object34381:head# 2024-04-01T19:56:36.893 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97a7cea6:::benchmark_data_smithi188_161190_object109083:head# 2024-04-01T19:56:36.893 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97a82e5f:::benchmark_data_smithi188_161190_object88487:head# 2024-04-01T19:56:36.893 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97a8edda:::benchmark_data_smithi188_161190_object123719:head# 2024-04-01T19:56:36.893 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97a9c1e1:::benchmark_data_smithi188_161190_object100735:head# 2024-04-01T19:56:36.894 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97ab2ea8:::benchmark_data_smithi188_161190_object53615:head# 2024-04-01T19:56:36.894 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97ab8b27:::benchmark_data_smithi188_161190_object59234:head# 2024-04-01T19:56:36.895 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97ac572c:::benchmark_data_smithi188_161190_object67624:head# 2024-04-01T19:56:36.895 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97acc64d:::benchmark_data_smithi188_161190_object124175:head# 2024-04-01T19:56:36.895 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97ade612:::benchmark_data_smithi188_161190_object45313:head# 2024-04-01T19:56:36.896 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97ae3914:::benchmark_data_smithi188_161190_object66420:head# 2024-04-01T19:56:36.896 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97ae90e4:::benchmark_data_smithi188_161190_object84861:head# 2024-04-01T19:56:36.897 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97aed1f0:::benchmark_data_smithi188_161190_object71879:head# 2024-04-01T19:56:36.897 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97aefaed:::benchmark_data_smithi188_161190_object119003:head# 2024-04-01T19:56:36.897 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97af5def:::benchmark_data_smithi188_161190_object102971:head# 2024-04-01T19:56:36.898 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97afcba5:::benchmark_data_smithi188_161190_object45634:head# 2024-04-01T19:56:36.898 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97b24626:::benchmark_data_smithi188_161190_object74072:head# 2024-04-01T19:56:36.899 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97b37394:::benchmark_data_smithi188_161190_object52515:head# 2024-04-01T19:56:36.899 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97b38e99:::benchmark_data_smithi188_161190_object64721:head# 2024-04-01T19:56:36.900 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97b3ced6:::benchmark_data_smithi188_161190_object74724:head# 2024-04-01T19:56:36.904 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97b41fc5:::benchmark_data_smithi188_161190_object94167:head# 2024-04-01T19:56:36.905 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97b4f310:::benchmark_data_smithi188_161190_object52474:head# 2024-04-01T19:56:36.905 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97b6a3a5:::benchmark_data_smithi188_161190_object39906:head# 2024-04-01T19:56:36.905 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97b76573:::benchmark_data_smithi188_161190_object57854:head# 2024-04-01T19:56:36.905 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97b9e2e2:::benchmark_data_smithi188_161190_object41229:head# 2024-04-01T19:56:36.905 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97ba4834:::benchmark_data_smithi188_161190_object78209:head# 2024-04-01T19:56:36.905 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97bb2f7e:::benchmark_data_smithi188_161190_object28912:head# 2024-04-01T19:56:36.905 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97bbef9a:::benchmark_data_smithi188_161190_object111731:head# 2024-04-01T19:56:36.905 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97bc1e64:::benchmark_data_smithi188_161190_object116914:head# 2024-04-01T19:56:36.905 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97bc4e6a:::benchmark_data_smithi188_161190_object64719:head# 2024-04-01T19:56:36.905 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97bcfab2:::benchmark_data_smithi188_161190_object112937:head# 2024-04-01T19:56:36.905 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97bd3c0a:::benchmark_data_smithi188_161190_object107141:head# 2024-04-01T19:56:36.906 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97be09b0:::benchmark_data_smithi188_161190_object117460:head# 2024-04-01T19:56:36.907 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97be722c:::benchmark_data_smithi188_161190_object109011:head# 2024-04-01T19:56:36.907 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97be7987:::benchmark_data_smithi188_161190_object97086:head# 2024-04-01T19:56:36.907 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97becff0:::benchmark_data_smithi188_161190_object30462:head# 2024-04-01T19:56:36.908 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97bfa4e3:::benchmark_data_smithi188_161190_object25219:head# 2024-04-01T19:56:36.908 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97bfd6cb:::benchmark_data_smithi188_161190_object114295:head# 2024-04-01T19:56:36.908 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97c0d499:::benchmark_data_smithi188_161190_object27924:head# 2024-04-01T19:56:36.909 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97c0d89c:::benchmark_data_smithi188_161190_object105759:head# 2024-04-01T19:56:36.909 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97c1b7e8:::benchmark_data_smithi188_161190_object104498:head# 2024-04-01T19:56:36.910 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97c22698:::benchmark_data_smithi188_161190_object93226:head# 2024-04-01T19:56:36.910 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97c2de00:::benchmark_data_smithi188_161190_object63433:head# 2024-04-01T19:56:36.911 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97c3079c:::benchmark_data_smithi188_161190_object106666:head# 2024-04-01T19:56:36.911 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97c44e15:::benchmark_data_smithi188_161190_object60046:head# 2024-04-01T19:56:36.912 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97c450c0:::benchmark_data_smithi188_161190_object57767:head# 2024-04-01T19:56:36.912 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97c5524e:::benchmark_data_smithi188_161190_object36970:head# 2024-04-01T19:56:36.912 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97c5985d:::benchmark_data_smithi188_161190_object117423:head# 2024-04-01T19:56:36.913 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97c5ceb1:::benchmark_data_smithi188_161190_object79550:head# 2024-04-01T19:56:36.913 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97c608cb:::benchmark_data_smithi188_161190_object94773:head# 2024-04-01T19:56:36.914 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97c7ad4e:::benchmark_data_smithi188_161190_object62411:head# 2024-04-01T19:56:36.914 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97c8f488:::benchmark_data_smithi188_161190_object35664:head# 2024-04-01T19:56:36.915 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97c963ce:::benchmark_data_smithi188_161190_object86519:head# 2024-04-01T19:56:36.915 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97c9d4b1:::benchmark_data_smithi188_161190_object49394:head# 2024-04-01T19:56:36.915 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97cab564:::benchmark_data_smithi188_161190_object21092:head# 2024-04-01T19:56:36.916 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97cc3c2e:::benchmark_data_smithi188_161190_object133037:head# 2024-04-01T19:56:36.916 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97cc414f:::benchmark_data_smithi188_161190_object52709:head# 2024-04-01T19:56:36.917 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97cd670b:::benchmark_data_smithi188_161190_object109717:head# 2024-04-01T19:56:36.917 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97cd926b:::benchmark_data_smithi188_161190_object79037:head# 2024-04-01T19:56:36.918 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97ce164d:::benchmark_data_smithi188_161190_object54989:head# 2024-04-01T19:56:36.918 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97ceec56:::benchmark_data_smithi188_161190_object57061:head# 2024-04-01T19:56:36.919 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97cf5148:::benchmark_data_smithi188_161190_object20886:head# 2024-04-01T19:56:36.919 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97cf8668:::benchmark_data_smithi188_161190_object94508:head# 2024-04-01T19:56:36.919 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97d0834e:::benchmark_data_smithi188_161190_object94772:head# 2024-04-01T19:56:36.920 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97d0b80e:::benchmark_data_smithi188_161190_object126255:head# 2024-04-01T19:56:36.920 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97d0d247:::benchmark_data_smithi188_161190_object106247:head# 2024-04-01T19:56:36.920 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97d1022f:::benchmark_data_smithi188_161190_object100244:head# 2024-04-01T19:56:36.921 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97d123a3:::benchmark_data_smithi188_161190_object115367:head# 2024-04-01T19:56:36.921 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97d2131e:::benchmark_data_smithi188_161190_object75135:head# 2024-04-01T19:56:36.922 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97d24f04:::benchmark_data_smithi188_161190_object121263:head# 2024-04-01T19:56:36.922 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97d271ae:::benchmark_data_smithi188_161190_object103514:head# 2024-04-01T19:56:36.922 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97d31644:::benchmark_data_smithi188_161190_object41214:head# 2024-04-01T19:56:36.923 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97d31fb0:::benchmark_data_smithi188_161190_object111069:head# 2024-04-01T19:56:36.923 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97d4076a:::benchmark_data_smithi188_161190_object111643:head# 2024-04-01T19:56:36.924 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97d502d5:::benchmark_data_smithi188_161190_object58538:head# 2024-04-01T19:56:36.924 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97d5f0ad:::benchmark_data_smithi188_161190_object96776:head# 2024-04-01T19:56:36.924 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97d6d2ab:::benchmark_data_smithi188_161190_object99474:head# 2024-04-01T19:56:36.925 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97d70c30:::benchmark_data_smithi188_161190_object50692:head# 2024-04-01T19:56:36.925 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97d7514f:::benchmark_data_smithi188_161190_object70521:head# 2024-04-01T19:56:36.925 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97d76fff:::benchmark_data_smithi188_161190_object100023:head# 2024-04-01T19:56:36.926 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97d83f70:::benchmark_data_smithi188_161190_object137038:head# 2024-04-01T19:56:36.926 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97d94e9a:::benchmark_data_smithi188_161190_object113358:head# 2024-04-01T19:56:36.927 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97d97bdb:::benchmark_data_smithi188_161190_object120533:head# 2024-04-01T19:56:36.927 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97db2113:::benchmark_data_smithi188_161190_object83262:head# 2024-04-01T19:56:36.928 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97db538b:::benchmark_data_smithi188_161190_object108204:head# 2024-04-01T19:56:36.928 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97db6ca7:::benchmark_data_smithi188_161190_object122626:head# 2024-04-01T19:56:36.928 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97dbc2b2:::benchmark_data_smithi188_161190_object113663:head# 2024-04-01T19:56:36.929 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97dc78ed:::benchmark_data_smithi188_161190_object90244:head# 2024-04-01T19:56:36.929 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97dc84fa:::benchmark_data_smithi188_161190_object66087:head# 2024-04-01T19:56:36.930 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97dcb403:::benchmark_data_smithi188_161190_object55569:head# 2024-04-01T19:56:36.930 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97dd2258:::benchmark_data_smithi188_161190_object78718:head# 2024-04-01T19:56:36.931 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97dd296f:::benchmark_data_smithi188_161190_object111684:head# 2024-04-01T19:56:36.931 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97dda192:::benchmark_data_smithi188_161190_object71451:head# 2024-04-01T19:56:36.931 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97de8aea:::benchmark_data_smithi188_161190_object70876:head# 2024-04-01T19:56:36.932 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97decdef:::benchmark_data_smithi188_161190_object121379:head# 2024-04-01T19:56:36.932 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97dee277:::benchmark_data_smithi188_161190_object88483:head# 2024-04-01T19:56:36.933 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97df1aa4:::benchmark_data_smithi188_161190_object135593:head# 2024-04-01T19:56:36.934 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97df6c60:::benchmark_data_smithi188_161190_object100890:head# 2024-04-01T19:56:36.935 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97dfae74:::benchmark_data_smithi188_161190_object91875:head# 2024-04-01T19:56:36.935 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97e0bbf1:::benchmark_data_smithi188_161190_object60122:head# 2024-04-01T19:56:36.935 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97e0cbb7:::benchmark_data_smithi188_161190_object44960:head# 2024-04-01T19:56:36.936 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97e16bdc:::benchmark_data_smithi188_161190_object20135:head# 2024-04-01T19:56:36.936 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97e301fd:::benchmark_data_smithi188_161190_object28751:head# 2024-04-01T19:56:36.937 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97e34b3e:::benchmark_data_smithi188_161190_object47171:head# 2024-04-01T19:56:36.937 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97e3ac22:::benchmark_data_smithi188_161190_object46337:head# 2024-04-01T19:56:36.938 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97e3d81d:::benchmark_data_smithi188_161190_object128642:head# 2024-04-01T19:56:36.938 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97e457f3:::benchmark_data_smithi188_161190_object53140:head# 2024-04-01T19:56:36.938 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97e51eb4:::benchmark_data_smithi188_161190_object108150:head# 2024-04-01T19:56:36.939 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97e56f7b:::benchmark_data_smithi188_161190_object47362:head# 2024-04-01T19:56:36.939 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97e5d15e:::benchmark_data_smithi188_161190_object80583:head# 2024-04-01T19:56:36.940 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97e702b6:::benchmark_data_smithi188_161190_object110319:head# 2024-04-01T19:56:36.940 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97e731c2:::benchmark_data_smithi188_161190_object127951:head# 2024-04-01T19:56:36.940 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97e797b1:::benchmark_data_smithi188_161190_object112032:head# 2024-04-01T19:56:36.941 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97e7ec39:::benchmark_data_smithi188_161190_object64862:head# 2024-04-01T19:56:36.941 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97e8b625:::benchmark_data_smithi188_161190_object70852:head# 2024-04-01T19:56:36.942 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97e9e038:::benchmark_data_smithi188_161190_object121927:head# 2024-04-01T19:56:36.942 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97eb5c5b:::benchmark_data_smithi188_161190_object98770:head# 2024-04-01T19:56:36.943 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97ebb977:::benchmark_data_smithi188_161190_object53826:head# 2024-04-01T19:56:36.943 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97ec7bb1:::benchmark_data_smithi188_161190_object125574:head# 2024-04-01T19:56:36.949 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97eca578:::benchmark_data_smithi188_161190_object26639:head# 2024-04-01T19:56:36.949 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97ed569f:::benchmark_data_smithi188_161190_object126409:head# 2024-04-01T19:56:36.949 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97ed7202:::benchmark_data_smithi188_161190_object129394:head# 2024-04-01T19:56:36.949 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97ed7f1a:::benchmark_data_smithi188_161190_object130953:head# 2024-04-01T19:56:36.949 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97ed8c10:::benchmark_data_smithi188_161190_object71753:head# 2024-04-01T19:56:36.949 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97ee6e72:::benchmark_data_smithi188_161190_object19748:head# 2024-04-01T19:56:36.949 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97eec621:::benchmark_data_smithi188_161190_object137328:head# 2024-04-01T19:56:36.949 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97eef225:::benchmark_data_smithi188_161190_object131068:head# 2024-04-01T19:56:36.949 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97ef9707:::benchmark_data_smithi188_161190_object86358:head# 2024-04-01T19:56:36.949 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97efbc7a:::benchmark_data_smithi188_161190_object89993:head# 2024-04-01T19:56:36.949 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97f069a9:::benchmark_data_smithi188_161190_object99683:head# 2024-04-01T19:56:36.950 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97f070aa:::benchmark_data_smithi188_161190_object91123:head# 2024-04-01T19:56:36.950 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97f147fc:::benchmark_data_smithi188_161190_object118439:head# 2024-04-01T19:56:36.951 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97f1ad16:::benchmark_data_smithi188_161190_object65202:head# 2024-04-01T19:56:36.951 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97f228e5:::benchmark_data_smithi188_161190_object131776:head# 2024-04-01T19:56:36.951 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97f2331e:::benchmark_data_smithi188_161190_object78793:head# 2024-04-01T19:56:36.951 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97f32877:::benchmark_data_smithi188_161190_object25225:head# 2024-04-01T19:56:36.951 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97f33af6:::benchmark_data_smithi188_161190_object115384:head# 2024-04-01T19:56:36.952 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97f3ecca:::benchmark_data_smithi188_161190_object133484:head# 2024-04-01T19:56:36.952 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97f40724:::benchmark_data_smithi188_161190_object93124:head# 2024-04-01T19:56:36.952 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97f43169:::benchmark_data_smithi188_161190_object49610:head# 2024-04-01T19:56:36.952 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97f65248:::benchmark_data_smithi188_161190_object53187:head# 2024-04-01T19:56:36.953 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97f712f4:::benchmark_data_smithi188_161190_object137330:head# 2024-04-01T19:56:36.953 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97f76a86:::benchmark_data_smithi188_161190_object73134:head# 2024-04-01T19:56:36.954 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97f78252:::benchmark_data_smithi188_161190_object53451:head# 2024-04-01T19:56:36.954 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97f82bee:::benchmark_data_smithi188_161190_object108173:head# 2024-04-01T19:56:36.954 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97f83bd1:::benchmark_data_smithi188_161190_object126530:head# 2024-04-01T19:56:36.955 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97f84298:::benchmark_data_smithi188_161190_object131155:head# 2024-04-01T19:56:36.955 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97f861ec:::benchmark_data_smithi188_161190_object116289:head# 2024-04-01T19:56:36.956 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97f86468:::benchmark_data_smithi188_161190_object49221:head# 2024-04-01T19:56:36.956 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97f87451:::benchmark_data_smithi188_161190_object126050:head# 2024-04-01T19:56:36.957 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97f9ca91:::benchmark_data_smithi188_161190_object80876:head# 2024-04-01T19:56:36.957 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97f9ef4a:::benchmark_data_smithi188_161190_object86042:head# 2024-04-01T19:56:36.958 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97f9ef76:::benchmark_data_smithi188_161190_object53661:head# 2024-04-01T19:56:36.958 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97fa63a7:::benchmark_data_smithi188_161190_object108784:head# 2024-04-01T19:56:36.959 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97fb57c0:::benchmark_data_smithi188_161190_object41176:head# 2024-04-01T19:56:36.959 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97fb97ab:::benchmark_data_smithi188_161190_object24678:head# 2024-04-01T19:56:36.959 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:97ff9a5d:::benchmark_data_smithi188_161190_object99978:head# 2024-04-01T19:56:36.960 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:980062c4:::benchmark_data_smithi188_161190_object132815:head# 2024-04-01T19:56:36.960 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9800978c:::benchmark_data_smithi188_161190_object79923:head# 2024-04-01T19:56:36.960 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98014c57:::benchmark_data_smithi188_161190_object103576:head# 2024-04-01T19:56:36.961 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9801ae45:::benchmark_data_smithi188_161190_object52124:head# 2024-04-01T19:56:36.961 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:980205af:::benchmark_data_smithi188_161190_object101897:head# 2024-04-01T19:56:36.962 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:980298cb:::benchmark_data_smithi188_161190_object94121:head# 2024-04-01T19:56:36.962 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98030476:::benchmark_data_smithi188_161190_object95050:head# 2024-04-01T19:56:36.963 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98038910:::benchmark_data_smithi188_161190_object68672:head# 2024-04-01T19:56:36.963 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9804e90b:::benchmark_data_smithi188_161190_object35498:head# 2024-04-01T19:56:36.963 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9804edd5:::benchmark_data_smithi188_161190_object95535:head# 2024-04-01T19:56:36.964 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98059c2f:::benchmark_data_smithi188_161190_object21596:head# 2024-04-01T19:56:36.964 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9805d9a3:::benchmark_data_smithi188_161190_object58053:head# 2024-04-01T19:56:36.964 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9805dd6f:::benchmark_data_smithi188_161190_object41073:head# 2024-04-01T19:56:36.965 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9805e271:::benchmark_data_smithi188_161190_object47516:head# 2024-04-01T19:56:36.965 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98060db2:::benchmark_data_smithi188_161190_object85987:head# 2024-04-01T19:56:36.966 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9806267f:::benchmark_data_smithi188_161190_object97630:head# 2024-04-01T19:56:36.966 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9807961e:::benchmark_data_smithi188_161190_object131927:head# 2024-04-01T19:56:36.967 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9808f426:::benchmark_data_smithi188_161190_object110763:head# 2024-04-01T19:56:36.967 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9808f5ff:::benchmark_data_smithi188_161190_object64613:head# 2024-04-01T19:56:36.967 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98095181:::benchmark_data_smithi188_161190_object95825:head# 2024-04-01T19:56:36.967 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:980a2b5f:::benchmark_data_smithi188_161190_object119334:head# 2024-04-01T19:56:36.968 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:980bd22d:::benchmark_data_smithi188_161190_object30305:head# 2024-04-01T19:56:36.968 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:980bdee7:::benchmark_data_smithi188_161190_object132343:head# 2024-04-01T19:56:36.969 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:980ca419:::benchmark_data_smithi188_161190_object46000:head# 2024-04-01T19:56:36.969 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:980d54bf:::benchmark_data_smithi188_161190_object107927:head# 2024-04-01T19:56:36.973 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:980d82ca:::benchmark_data_smithi188_161190_object24713:head# 2024-04-01T19:56:36.973 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:980d9ee6:::benchmark_data_smithi188_161190_object57401:head# 2024-04-01T19:56:36.973 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:980e7566:::benchmark_data_smithi188_161190_object36854:head# 2024-04-01T19:56:36.973 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:980fcc55:::benchmark_data_smithi188_161190_object108488:head# 2024-04-01T19:56:36.973 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98101100:::benchmark_data_smithi188_161190_object70617:head# 2024-04-01T19:56:36.973 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9811b8e1:::benchmark_data_smithi188_161190_object77427:head# 2024-04-01T19:56:36.973 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9811f805:::benchmark_data_smithi188_161190_object59571:head# 2024-04-01T19:56:36.973 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98124071:::benchmark_data_smithi188_161190_object70104:head# 2024-04-01T19:56:36.973 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98128a39:::benchmark_data_smithi188_161190_object43251:head# 2024-04-01T19:56:36.974 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9812a4df:::benchmark_data_smithi188_161190_object126778:head# 2024-04-01T19:56:36.974 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:981395ce:::benchmark_data_smithi188_161190_object65266:head# 2024-04-01T19:56:36.974 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9813d2a5:::benchmark_data_smithi188_161190_object81227:head# 2024-04-01T19:56:36.975 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:981410d3:::benchmark_data_smithi188_161190_object30950:head# 2024-04-01T19:56:36.975 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9814e4b3:::benchmark_data_smithi188_161190_object88726:head# 2024-04-01T19:56:36.975 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9815148b:::benchmark_data_smithi188_161190_object115714:head# 2024-04-01T19:56:36.977 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9815c31c:::benchmark_data_smithi188_161190_object37638:head# 2024-04-01T19:56:36.978 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9815c8ca:::benchmark_data_smithi188_161190_object40389:head# 2024-04-01T19:56:36.979 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9815f26a:::benchmark_data_smithi188_161190_object21346:head# 2024-04-01T19:56:36.979 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:981622c1:::benchmark_data_smithi188_161190_object31842:head# 2024-04-01T19:56:36.979 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98168d32:::benchmark_data_smithi188_161190_object61411:head# 2024-04-01T19:56:36.979 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9817148e:::benchmark_data_smithi188_161190_object97122:head# 2024-04-01T19:56:36.980 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98179334:::benchmark_data_smithi188_161190_object73341:head# 2024-04-01T19:56:36.980 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9817b2cc:::benchmark_data_smithi188_161190_object132574:head# 2024-04-01T19:56:36.981 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:981852e3:::benchmark_data_smithi188_161190_object37143:head# 2024-04-01T19:56:36.981 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98198739:::benchmark_data_smithi188_161190_object54452:head# 2024-04-01T19:56:36.982 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98199060:::benchmark_data_smithi188_161190_object123789:head# 2024-04-01T19:56:36.982 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9819967d:::benchmark_data_smithi188_161190_object46223:head# 2024-04-01T19:56:36.982 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9819c260:::benchmark_data_smithi188_161190_object28020:head# 2024-04-01T19:56:36.983 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:981a2dc9:::benchmark_data_smithi188_161190_object101880:head# 2024-04-01T19:56:36.983 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:981a39ed:::benchmark_data_smithi188_161190_object42202:head# 2024-04-01T19:56:36.984 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:981bb8d6:::benchmark_data_smithi188_161190_object80198:head# 2024-04-01T19:56:36.984 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:981c2fca:::benchmark_data_smithi188_161190_object62138:head# 2024-04-01T19:56:36.984 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:981c82ce:::benchmark_data_smithi188_161190_object97816:head# 2024-04-01T19:56:36.985 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:981d1861:::benchmark_data_smithi188_161190_object91160:head# 2024-04-01T19:56:36.985 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:981d203f:::benchmark_data_smithi188_161190_object120620:head# 2024-04-01T19:56:36.986 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:981e227d:::benchmark_data_smithi188_161190_object28654:head# 2024-04-01T19:56:36.986 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:981f4ae2:::benchmark_data_smithi188_161190_object33263:head# 2024-04-01T19:56:36.987 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:981f5d6e:::benchmark_data_smithi188_161190_object30649:head# 2024-04-01T19:56:36.987 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:981f78d7:::benchmark_data_smithi188_161190_object136405:head# 2024-04-01T19:56:36.987 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98208c35:::benchmark_data_smithi188_161190_object32577:head# 2024-04-01T19:56:36.988 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9820a021:::benchmark_data_smithi188_161190_object82126:head# 2024-04-01T19:56:36.988 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:982107a4:::benchmark_data_smithi188_161190_object59901:head# 2024-04-01T19:56:36.989 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9821d5b0:::benchmark_data_smithi188_161190_object46670:head# 2024-04-01T19:56:36.989 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9821f202:::benchmark_data_smithi188_161190_object100976:head# 2024-04-01T19:56:36.990 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98221007:::benchmark_data_smithi188_161190_object106226:head# 2024-04-01T19:56:36.990 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98222fd0:::benchmark_data_smithi188_161190_object80483:head# 2024-04-01T19:56:36.991 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9822746e:::benchmark_data_smithi188_161190_object114408:head# 2024-04-01T19:56:36.991 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98233a78:::benchmark_data_smithi188_161190_object134168:head# 2024-04-01T19:56:36.992 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9823c756:::benchmark_data_smithi188_161190_object61520:head# 2024-04-01T19:56:36.994 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:982461b5:::benchmark_data_smithi188_161190_object125176:head# 2024-04-01T19:56:36.995 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9824e05a:::benchmark_data_smithi188_161190_object82393:head# 2024-04-01T19:56:36.995 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98254d80:::benchmark_data_smithi188_161190_object32427:head# 2024-04-01T19:56:36.995 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:982552d1:::benchmark_data_smithi188_161190_object115175:head# 2024-04-01T19:56:36.995 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98255f62:::benchmark_data_smithi188_161190_object118408:head# 2024-04-01T19:56:36.995 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98259ffe:::benchmark_data_smithi188_161190_object26408:head# 2024-04-01T19:56:36.995 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98263b19:::benchmark_data_smithi188_161190_object49985:head# 2024-04-01T19:56:36.996 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9826e2e2:::benchmark_data_smithi188_161190_object77951:head# 2024-04-01T19:56:36.996 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98270542:::benchmark_data_smithi188_161190_object120410:head# 2024-04-01T19:56:36.996 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:982721d4:::benchmark_data_smithi188_161190_object81859:head# 2024-04-01T19:56:36.996 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9827d70c:::benchmark_data_smithi188_161190_object66747:head# 2024-04-01T19:56:36.997 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9828eb79:::benchmark_data_smithi188_161190_object59232:head# 2024-04-01T19:56:36.998 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:982960ef:::benchmark_data_smithi188_161190_object55809:head# 2024-04-01T19:56:36.999 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98299a55:::benchmark_data_smithi188_161190_object75760:head# 2024-04-01T19:56:36.999 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9829a317:::benchmark_data_smithi188_161190_object82052:head# 2024-04-01T19:56:36.999 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9829f499:::benchmark_data_smithi188_161190_object79242:head# 2024-04-01T19:56:37.000 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:982acaac:::benchmark_data_smithi188_161190_object104087:head# 2024-04-01T19:56:37.000 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:982bfba1:::benchmark_data_smithi188_161190_object50362:head# 2024-04-01T19:56:37.000 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:982c16f4:::benchmark_data_smithi188_161190_object54658:head# 2024-04-01T19:56:37.001 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:982c3448:::benchmark_data_smithi188_161190_object57839:head# 2024-04-01T19:56:37.001 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:982c5dbd:::benchmark_data_smithi188_161190_object107270:head# 2024-04-01T19:56:37.002 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:982d9da0:::benchmark_data_smithi188_161190_object38033:head# 2024-04-01T19:56:37.002 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:982ee083:::benchmark_data_smithi188_161190_object121949:head# 2024-04-01T19:56:37.002 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:982f3938:::benchmark_data_smithi188_161190_object36337:head# 2024-04-01T19:56:37.005 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:982f749a:::benchmark_data_smithi188_161190_object78020:head# 2024-04-01T19:56:37.006 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:982f91a0:::benchmark_data_smithi188_161190_object103986:head# 2024-04-01T19:56:37.006 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98301a5a:::benchmark_data_smithi188_161190_object105961:head# 2024-04-01T19:56:37.006 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9830435c:::benchmark_data_smithi188_161190_object84136:head# 2024-04-01T19:56:37.006 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:983050c8:::benchmark_data_smithi188_161190_object61516:head# 2024-04-01T19:56:37.006 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9830602a:::benchmark_data_smithi188_161190_object93860:head# 2024-04-01T19:56:37.006 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9830fc30:::benchmark_data_smithi188_161190_object120436:head# 2024-04-01T19:56:37.006 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:983164e0:::benchmark_data_smithi188_161190_object122073:head# 2024-04-01T19:56:37.007 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98321c3d:::benchmark_data_smithi188_161190_object58461:head# 2024-04-01T19:56:37.007 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98325808:::benchmark_data_smithi188_161190_object100724:head# 2024-04-01T19:56:37.010 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:983263be:::benchmark_data_smithi188_161190_object39780:head# 2024-04-01T19:56:37.010 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98336514:::benchmark_data_smithi188_161190_object70504:head# 2024-04-01T19:56:37.010 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98337942:::benchmark_data_smithi188_161190_object127153:head# 2024-04-01T19:56:37.011 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9834a0eb:::benchmark_data_smithi188_161190_object112052:head# 2024-04-01T19:56:37.011 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98356d39:::benchmark_data_smithi188_161190_object68540:head# 2024-04-01T19:56:37.012 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9835d128:::benchmark_data_smithi188_161190_object52880:head# 2024-04-01T19:56:37.012 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:983632ed:::benchmark_data_smithi188_161190_object25604:head# 2024-04-01T19:56:37.013 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:983733fd:::benchmark_data_smithi188_161190_object120922:head# 2024-04-01T19:56:37.013 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98375773:::benchmark_data_smithi188_161190_object129258:head# 2024-04-01T19:56:37.013 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:983787a5:::benchmark_data_smithi188_161190_object131341:head# 2024-04-01T19:56:37.014 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98378e4a:::benchmark_data_smithi188_161190_object136137:head# 2024-04-01T19:56:37.015 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9837957a:::benchmark_data_smithi188_161190_object99394:head# 2024-04-01T19:56:37.015 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9837beef:::benchmark_data_smithi188_161190_object35600:head# 2024-04-01T19:56:37.015 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9837d139:::benchmark_data_smithi188_161190_object25633:head# 2024-04-01T19:56:37.019 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:983816fb:::benchmark_data_smithi188_161190_object62921:head# 2024-04-01T19:56:37.019 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:983856af:::benchmark_data_smithi188_161190_object61342:head# 2024-04-01T19:56:37.020 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9838bb53:::benchmark_data_smithi188_161190_object23184:head# 2024-04-01T19:56:37.020 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9838fbdb:::benchmark_data_smithi188_161190_object107817:head# 2024-04-01T19:56:37.020 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:983a48e1:::benchmark_data_smithi188_161190_object32766:head# 2024-04-01T19:56:37.020 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:983aeada:::benchmark_data_smithi188_161190_object42254:head# 2024-04-01T19:56:37.020 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:983aec39:::benchmark_data_smithi188_161190_object98379:head# 2024-04-01T19:56:37.020 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:983b12a9:::benchmark_data_smithi188_161190_object98593:head# 2024-04-01T19:56:37.021 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:983b5ece:::benchmark_data_smithi188_161190_object98024:head# 2024-04-01T19:56:37.021 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:983c03b4:::benchmark_data_smithi188_161190_object45492:head# 2024-04-01T19:56:37.021 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:983c8762:::benchmark_data_smithi188_161190_object67110:head# 2024-04-01T19:56:37.021 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:983cf9f5:::benchmark_data_smithi188_161190_object83394:head# 2024-04-01T19:56:37.021 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:983d10d8:::benchmark_data_smithi188_161190_object44855:head# 2024-04-01T19:56:37.022 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:983fba37:::benchmark_data_smithi188_161190_object80630:head# 2024-04-01T19:56:37.022 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:983fd517:::benchmark_data_smithi188_161190_object118424:head# 2024-04-01T19:56:37.022 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:984144f3:::benchmark_data_smithi188_161190_object63473:head# 2024-04-01T19:56:37.023 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98427785:::benchmark_data_smithi188_161190_object122718:head# 2024-04-01T19:56:37.023 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9842b082:::benchmark_data_smithi188_161190_object133831:head# 2024-04-01T19:56:37.024 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9842cfde:::benchmark_data_smithi188_161190_object24695:head# 2024-04-01T19:56:37.024 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:984306d9:::benchmark_data_smithi188_161190_object44155:head# 2024-04-01T19:56:37.024 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98432ba4:::benchmark_data_smithi188_161190_object77321:head# 2024-04-01T19:56:37.025 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:984332a4:::benchmark_data_smithi188_161190_object119832:head# 2024-04-01T19:56:37.027 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98435182:::benchmark_data_smithi188_161190_object82755:head# 2024-04-01T19:56:37.027 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9844c882:::benchmark_data_smithi188_161190_object26868:head# 2024-04-01T19:56:37.028 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98450b12:::benchmark_data_smithi188_161190_object107132:head# 2024-04-01T19:56:37.028 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98453237:::benchmark_data_smithi188_161190_object105259:head# 2024-04-01T19:56:37.029 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9845c139:::benchmark_data_smithi188_161190_object84415:head# 2024-04-01T19:56:37.029 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9847fdfc:::benchmark_data_smithi188_161190_object64275:head# 2024-04-01T19:56:37.029 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98485c5d:::benchmark_data_smithi188_161190_object127100:head# 2024-04-01T19:56:37.030 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:984895e6:::benchmark_data_smithi188_161190_object135538:head# 2024-04-01T19:56:37.030 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9848992d:::benchmark_data_smithi188_161190_object47116:head# 2024-04-01T19:56:37.035 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:984933f4:::benchmark_data_smithi188_161190_object121803:head# 2024-04-01T19:56:37.036 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:984983a3:::benchmark_data_smithi188_161190_object50300:head# 2024-04-01T19:56:37.036 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98498e38:::benchmark_data_smithi188_161190_object121017:head# 2024-04-01T19:56:37.037 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:984a52fd:::benchmark_data_smithi188_161190_object27021:head# 2024-04-01T19:56:37.037 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:984a6012:::benchmark_data_smithi188_161190_object106445:head# 2024-04-01T19:56:37.038 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:984a6cd0:::benchmark_data_smithi188_161190_object131357:head# 2024-04-01T19:56:37.038 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:984abdae:::benchmark_data_smithi188_161190_object124301:head# 2024-04-01T19:56:37.039 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:984ba038:::benchmark_data_smithi188_161190_object60011:head# 2024-04-01T19:56:37.039 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:984bab66:::benchmark_data_smithi188_161190_object58706:head# 2024-04-01T19:56:37.050 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:984c70c3:::benchmark_data_smithi188_161190_object136726:head# 2024-04-01T19:56:37.050 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:984cb09a:::benchmark_data_smithi188_161190_object78691:head# 2024-04-01T19:56:37.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:984cc952:::benchmark_data_smithi188_161190_object105796:head# 2024-04-01T19:56:37.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:984d0c75:::benchmark_data_smithi188_161190_object26431:head# 2024-04-01T19:56:37.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:984d9ad4:::benchmark_data_smithi188_161190_object67201:head# 2024-04-01T19:56:37.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:984e4a43:::benchmark_data_smithi188_161190_object89235:head# 2024-04-01T19:56:37.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:984ef3fb:::benchmark_data_smithi188_161190_object109144:head# 2024-04-01T19:56:37.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:984fafdd:::benchmark_data_smithi188_161190_object57235:head# 2024-04-01T19:56:37.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:985177a9:::benchmark_data_smithi188_161190_object94664:head# 2024-04-01T19:56:37.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9851a635:::benchmark_data_smithi188_161190_object127642:head# 2024-04-01T19:56:37.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9851e93d:::benchmark_data_smithi188_161190_object94196:head# 2024-04-01T19:56:37.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98526aa0:::benchmark_data_smithi188_161190_object83554:head# 2024-04-01T19:56:37.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9852744f:::benchmark_data_smithi188_161190_object137049:head# 2024-04-01T19:56:37.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:985363f1:::benchmark_data_smithi188_161190_object33189:head# 2024-04-01T19:56:37.052 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9854972e:::benchmark_data_smithi188_161190_object45999:head# 2024-04-01T19:56:37.052 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9854c5ef:::benchmark_data_smithi188_161190_object20007:head# 2024-04-01T19:56:37.052 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:985677c3:::benchmark_data_smithi188_161190_object97268:head# 2024-04-01T19:56:37.052 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9856a57b:::benchmark_data_smithi188_161190_object57379:head# 2024-04-01T19:56:37.052 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98574eff:::benchmark_data_smithi188_161190_object28326:head# 2024-04-01T19:56:37.052 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9857e3db:::benchmark_data_smithi188_161190_object22571:head# 2024-04-01T19:56:37.052 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9857ebf6:::benchmark_data_smithi188_161190_object30284:head# 2024-04-01T19:56:37.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9857eed8:::benchmark_data_smithi188_161190_object100358:head# 2024-04-01T19:56:37.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9858de74:::benchmark_data_smithi188_161190_object32442:head# 2024-04-01T19:56:37.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9858e4b3:::benchmark_data_smithi188_161190_object81154:head# 2024-04-01T19:56:37.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9859ddd6:::benchmark_data_smithi188_161190_object28199:head# 2024-04-01T19:56:37.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:985a14aa:::benchmark_data_smithi188_161190_object115527:head# 2024-04-01T19:56:37.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:985ad9b2:::benchmark_data_smithi188_161190_object100386:head# 2024-04-01T19:56:37.054 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:985cad8b:::benchmark_data_smithi188_161190_object134230:head# 2024-04-01T19:56:37.054 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:985d23d4:::benchmark_data_smithi188_161190_object80493:head# 2024-04-01T19:56:37.054 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:985d296e:::benchmark_data_smithi188_161190_object137410:head# 2024-04-01T19:56:37.055 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:985d2cb8:::benchmark_data_smithi188_161190_object37036:head# 2024-04-01T19:56:37.055 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:985d4e6b:::benchmark_data_smithi188_161190_object106192:head# 2024-04-01T19:56:37.055 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:985e4f89:::benchmark_data_smithi188_161190_object135511:head# 2024-04-01T19:56:37.058 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:985e8d1c:::benchmark_data_smithi188_161190_object56108:head# 2024-04-01T19:56:37.058 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:985e957f:::benchmark_data_smithi188_161190_object50627:head# 2024-04-01T19:56:37.058 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:985e9f2b:::benchmark_data_smithi188_161190_object30417:head# 2024-04-01T19:56:37.058 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:985ebca4:::benchmark_data_smithi188_161190_object34694:head# 2024-04-01T19:56:37.059 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:985ef6ae:::benchmark_data_smithi188_161190_object115419:head# 2024-04-01T19:56:37.059 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98621689:::benchmark_data_smithi188_161190_object100116:head# 2024-04-01T19:56:37.059 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98624f21:::benchmark_data_smithi188_161190_object139165:head# 2024-04-01T19:56:37.060 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9862ff0e:::benchmark_data_smithi188_161190_object20459:head# 2024-04-01T19:56:37.060 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9863ab2d:::benchmark_data_smithi188_161190_object131182:head# 2024-04-01T19:56:37.060 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9864af4c:::benchmark_data_smithi188_161190_object87071:head# 2024-04-01T19:56:37.060 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98651f8a:::benchmark_data_smithi188_161190_object83267:head# 2024-04-01T19:56:37.060 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9865bfde:::benchmark_data_smithi188_161190_object38304:head# 2024-04-01T19:56:37.061 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9865ffda:::benchmark_data_smithi188_161190_object81253:head# 2024-04-01T19:56:37.061 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:986616fa:::benchmark_data_smithi188_161190_object87094:head# 2024-04-01T19:56:37.062 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98661cca:::benchmark_data_smithi188_161190_object128768:head# 2024-04-01T19:56:37.064 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98668753:::benchmark_data_smithi188_161190_object66779:head# 2024-04-01T19:56:37.064 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98688be4:::benchmark_data_smithi188_161190_object64467:head# 2024-04-01T19:56:37.064 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9869004b:::benchmark_data_smithi188_161190_object30082:head# 2024-04-01T19:56:37.066 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9869094f:::benchmark_data_smithi188_161190_object136846:head# 2024-04-01T19:56:37.067 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:986b300e:::benchmark_data_smithi188_161190_object138851:head# 2024-04-01T19:56:37.067 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:986b3048:::benchmark_data_smithi188_161190_object39108:head# 2024-04-01T19:56:37.068 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:986c0a0f:::benchmark_data_smithi188_161190_object96275:head# 2024-04-01T19:56:37.068 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:986c9e3b:::benchmark_data_smithi188_161190_object105374:head# 2024-04-01T19:56:37.068 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:986cc339:::benchmark_data_smithi188_161190_object74844:head# 2024-04-01T19:56:37.069 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:986d5a56:::benchmark_data_smithi188_161190_object69600:head# 2024-04-01T19:56:37.069 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:986d8e23:::benchmark_data_smithi188_161190_object49048:head# 2024-04-01T19:56:37.070 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:986e3bad:::benchmark_data_smithi188_161190_object20614:head# 2024-04-01T19:56:37.070 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:986e9674:::benchmark_data_smithi188_161190_object49801:head# 2024-04-01T19:56:37.070 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:986ed51b:::benchmark_data_smithi188_161190_object120698:head# 2024-04-01T19:56:37.071 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:986f2a00:::benchmark_data_smithi188_161190_object32609:head# 2024-04-01T19:56:37.071 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:986f4bc1:::benchmark_data_smithi188_161190_object82055:head# 2024-04-01T19:56:37.072 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:986fc1bc:::benchmark_data_smithi188_161190_object99069:head# 2024-04-01T19:56:37.072 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9870c36c:::benchmark_data_smithi188_161190_object28502:head# 2024-04-01T19:56:37.073 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9870c8d8:::benchmark_data_smithi188_161190_object36245:head# 2024-04-01T19:56:37.073 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98711425:::benchmark_data_smithi188_161190_object55474:head# 2024-04-01T19:56:37.073 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98719ccf:::benchmark_data_smithi188_161190_object134778:head# 2024-04-01T19:56:37.074 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9871a064:::benchmark_data_smithi188_161190_object84880:head# 2024-04-01T19:56:37.074 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9871e43e:::benchmark_data_smithi188_161190_object103990:head# 2024-04-01T19:56:37.075 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:987245ef:::benchmark_data_smithi188_161190_object27088:head# 2024-04-01T19:56:37.075 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9872a013:::benchmark_data_smithi188_161190_object57870:head# 2024-04-01T19:56:37.076 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9872b5e5:::benchmark_data_smithi188_161190_object88559:head# 2024-04-01T19:56:37.076 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:987307c2:::benchmark_data_smithi188_161190_object28219:head# 2024-04-01T19:56:37.077 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98744563:::benchmark_data_smithi188_161190_object67421:head# 2024-04-01T19:56:37.077 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98745244:::benchmark_data_smithi188_161190_object32121:head# 2024-04-01T19:56:37.077 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9874c960:::benchmark_data_smithi188_161190_object64447:head# 2024-04-01T19:56:37.078 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98755c78:::benchmark_data_smithi188_161190_object25352:head# 2024-04-01T19:56:37.083 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98759cf6:::benchmark_data_smithi188_161190_object125248:head# 2024-04-01T19:56:37.084 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9875e474:::benchmark_data_smithi188_161190_object31625:head# 2024-04-01T19:56:37.084 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98762c46:::benchmark_data_smithi188_161190_object89919:head# 2024-04-01T19:56:37.085 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98773535:::benchmark_data_smithi188_161190_object59142:head# 2024-04-01T19:56:37.089 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9877598f:::benchmark_data_smithi188_161190_object52395:head# 2024-04-01T19:56:37.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98778b64:::benchmark_data_smithi188_161190_object107136:head# 2024-04-01T19:56:37.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9878fb72:::benchmark_data_smithi188_161190_object117086:head# 2024-04-01T19:56:37.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:987abb52:::benchmark_data_smithi188_161190_object119768:head# 2024-04-01T19:56:37.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:987af029:::benchmark_data_smithi188_161190_object96247:head# 2024-04-01T19:56:37.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:987b3c22:::benchmark_data_smithi188_161190_object72042:head# 2024-04-01T19:56:37.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:987ba287:::benchmark_data_smithi188_161190_object88373:head# 2024-04-01T19:56:37.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:987be2fc:::benchmark_data_smithi188_161190_object109313:head# 2024-04-01T19:56:37.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:987c5989:::benchmark_data_smithi188_161190_object86325:head# 2024-04-01T19:56:37.094 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:987d6f84:::benchmark_data_smithi188_161190_object53919:head# 2024-04-01T19:56:37.095 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:987e0244:::benchmark_data_smithi188_161190_object40468:head# 2024-04-01T19:56:37.097 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:987e4877:::benchmark_data_smithi188_161190_object59686:head# 2024-04-01T19:56:37.097 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:987f30a7:::benchmark_data_smithi188_161190_object66515:head# 2024-04-01T19:56:37.097 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:987f4ba3:::benchmark_data_smithi188_161190_object36864:head# 2024-04-01T19:56:37.098 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:987f77cf:::benchmark_data_smithi188_161190_object75962:head# 2024-04-01T19:56:37.099 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:987ff0b0:::benchmark_data_smithi188_161190_object120135:head# 2024-04-01T19:56:37.099 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:988026cd:::benchmark_data_smithi188_161190_object37236:head# 2024-04-01T19:56:37.102 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98806ff6:::benchmark_data_smithi188_161190_object70074:head# 2024-04-01T19:56:37.102 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9881394d:::benchmark_data_smithi188_161190_object112918:head# 2024-04-01T19:56:37.102 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98816245:::benchmark_data_smithi188_161190_object49013:head# 2024-04-01T19:56:37.111 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98817c18:::benchmark_data_smithi188_161190_object66011:head# 2024-04-01T19:56:37.111 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9883c97d:::benchmark_data_smithi188_161190_object74211:head# 2024-04-01T19:56:37.111 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98841c80:::benchmark_data_smithi188_161190_object25716:head# 2024-04-01T19:56:37.111 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:988531d8:::benchmark_data_smithi188_161190_object114357:head# 2024-04-01T19:56:37.112 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9885cab3:::benchmark_data_smithi188_161190_object139154:head# 2024-04-01T19:56:37.112 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9886135a:::benchmark_data_smithi188_161190_object29368:head# 2024-04-01T19:56:37.112 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98868102:::benchmark_data_smithi188_161190_object73107:head# 2024-04-01T19:56:37.112 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98868521:::benchmark_data_smithi188_161190_object46814:head# 2024-04-01T19:56:37.112 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9886a945:::benchmark_data_smithi188_161190_object21588:head# 2024-04-01T19:56:37.113 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9887c4e9:::benchmark_data_smithi188_161190_object83361:head# 2024-04-01T19:56:37.113 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98882826:::benchmark_data_smithi188_161190_object46585:head# 2024-04-01T19:56:37.114 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98891857:::benchmark_data_smithi188_161190_object31085:head# 2024-04-01T19:56:37.114 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:988a0f47:::benchmark_data_smithi188_161190_object42014:head# 2024-04-01T19:56:37.114 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:988acb8e:::benchmark_data_smithi188_161190_object108805:head# 2024-04-01T19:56:37.114 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:988acbc7:::benchmark_data_smithi188_161190_object101777:head# 2024-04-01T19:56:37.114 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:988ad3ec:::benchmark_data_smithi188_161190_object84784:head# 2024-04-01T19:56:37.114 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:988b1056:::benchmark_data_smithi188_161190_object45672:head# 2024-04-01T19:56:37.114 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:988c0397:::benchmark_data_smithi188_161190_object115538:head# 2024-04-01T19:56:37.114 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:988c8496:::benchmark_data_smithi188_161190_object67106:head# 2024-04-01T19:56:37.114 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:988d342d:::benchmark_data_smithi188_161190_object130609:head# 2024-04-01T19:56:37.114 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:988d4ca1:::benchmark_data_smithi188_161190_object43203:head# 2024-04-01T19:56:37.114 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:988e3542:::benchmark_data_smithi188_161190_object96441:head# 2024-04-01T19:56:37.114 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:988f47c1:::benchmark_data_smithi188_161190_object127190:head# 2024-04-01T19:56:37.115 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:988f8721:::benchmark_data_smithi188_161190_object67991:head# 2024-04-01T19:56:37.115 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:988f986b:::benchmark_data_smithi188_161190_object87124:head# 2024-04-01T19:56:37.115 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:988fa561:::benchmark_data_smithi188_161190_object33037:head# 2024-04-01T19:56:37.115 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:988fbed5:::benchmark_data_smithi188_161190_object98987:head# 2024-04-01T19:56:37.115 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98904a26:::benchmark_data_smithi188_161190_object64805:head# 2024-04-01T19:56:37.115 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9890b9fa:::benchmark_data_smithi188_161190_object64587:head# 2024-04-01T19:56:37.116 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9890f7d2:::benchmark_data_smithi188_161190_object41478:head# 2024-04-01T19:56:37.116 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98914289:::benchmark_data_smithi188_161190_object38749:head# 2024-04-01T19:56:37.116 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98915ba4:::benchmark_data_smithi188_161190_object84763:head# 2024-04-01T19:56:37.116 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9891bc81:::benchmark_data_smithi188_161190_object67258:head# 2024-04-01T19:56:37.116 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9891cd73:::benchmark_data_smithi188_161190_object128969:head# 2024-04-01T19:56:37.116 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:989247a7:::benchmark_data_smithi188_161190_object50600:head# 2024-04-01T19:56:37.116 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:989284df:::benchmark_data_smithi188_161190_object133725:head# 2024-04-01T19:56:37.117 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9892faff:::benchmark_data_smithi188_161190_object119027:head# 2024-04-01T19:56:37.117 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98935645:::benchmark_data_smithi188_161190_object137230:head# 2024-04-01T19:56:37.117 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9893a3f4:::benchmark_data_smithi188_161190_object115614:head# 2024-04-01T19:56:37.118 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9893c013:::benchmark_data_smithi188_161190_object58153:head# 2024-04-01T19:56:37.118 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98941dbb:::benchmark_data_smithi188_161190_object26001:head# 2024-04-01T19:56:37.119 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98943e77:::benchmark_data_smithi188_161190_object115078:head# 2024-04-01T19:56:37.119 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98952605:::benchmark_data_smithi188_161190_object83997:head# 2024-04-01T19:56:37.119 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9895440b:::benchmark_data_smithi188_161190_object23036:head# 2024-04-01T19:56:37.120 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9896c1ae:::benchmark_data_smithi188_161190_object112745:head# 2024-04-01T19:56:37.120 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9896ee66:::benchmark_data_smithi188_161190_object133119:head# 2024-04-01T19:56:37.121 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98976b4b:::benchmark_data_smithi188_161190_object125691:head# 2024-04-01T19:56:37.121 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9897adbd:::benchmark_data_smithi188_161190_object77112:head# 2024-04-01T19:56:37.121 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9897b32a:::benchmark_data_smithi188_161190_object68554:head# 2024-04-01T19:56:37.122 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9898f00e:::benchmark_data_smithi188_161190_object23775:head# 2024-04-01T19:56:37.122 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9899045a:::benchmark_data_smithi188_161190_object81618:head# 2024-04-01T19:56:37.123 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9899af72:::benchmark_data_smithi188_161190_object104170:head# 2024-04-01T19:56:37.123 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:989b0c4f:::benchmark_data_smithi188_161190_object105643:head# 2024-04-01T19:56:37.124 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:989b6afd:::benchmark_data_smithi188_161190_object58052:head# 2024-04-01T19:56:37.124 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:989c56b7:::benchmark_data_smithi188_161190_object135602:head# 2024-04-01T19:56:37.124 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:989d225f:::benchmark_data_smithi188_161190_object137887:head# 2024-04-01T19:56:37.125 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:989d407e:::benchmark_data_smithi188_161190_object100563:head# 2024-04-01T19:56:37.125 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:989ef387:::benchmark_data_smithi188_161190_object137452:head# 2024-04-01T19:56:37.126 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:989f28f8:::benchmark_data_smithi188_161190_object69255:head# 2024-04-01T19:56:37.126 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:989fbd03:::benchmark_data_smithi188_161190_object138059:head# 2024-04-01T19:56:37.127 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:989fe38d:::benchmark_data_smithi188_161190_object46830:head# 2024-04-01T19:56:37.127 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98a07228:::benchmark_data_smithi188_161190_object90768:head# 2024-04-01T19:56:37.127 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98a0d788:::benchmark_data_smithi188_161190_object24164:head# 2024-04-01T19:56:37.128 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98a1536d:::benchmark_data_smithi188_161190_object25490:head# 2024-04-01T19:56:37.128 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98a193ef:::benchmark_data_smithi188_161190_object66419:head# 2024-04-01T19:56:37.129 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98a19860:::benchmark_data_smithi188_161190_object36951:head# 2024-04-01T19:56:37.129 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98a1ef11:::benchmark_data_smithi188_161190_object128909:head# 2024-04-01T19:56:37.130 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98a2e3b6:::benchmark_data_smithi188_161190_object25640:head# 2024-04-01T19:56:37.130 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98a30159:::benchmark_data_smithi188_161190_object101217:head# 2024-04-01T19:56:37.130 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98a366c1:::benchmark_data_smithi188_161190_object101532:head# 2024-04-01T19:56:37.131 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98a41519:::benchmark_data_smithi188_161190_object39861:head# 2024-04-01T19:56:37.131 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98a484dd:::benchmark_data_smithi188_161190_object126592:head# 2024-04-01T19:56:37.132 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98a5eea7:::benchmark_data_smithi188_161190_object43316:head# 2024-04-01T19:56:37.132 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98a5f48d:::benchmark_data_smithi188_161190_object86968:head# 2024-04-01T19:56:37.133 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98a62e8d:::benchmark_data_smithi188_161190_object78792:head# 2024-04-01T19:56:37.133 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98a6fb74:::benchmark_data_smithi188_161190_object75949:head# 2024-04-01T19:56:37.134 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98a9549a:::benchmark_data_smithi188_161190_object35232:head# 2024-04-01T19:56:37.134 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98aafb49:::benchmark_data_smithi188_161190_object54021:head# 2024-04-01T19:56:37.134 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98ab3984:::benchmark_data_smithi188_161190_object24569:head# 2024-04-01T19:56:37.135 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98ac0f26:::benchmark_data_smithi188_161190_object103015:head# 2024-04-01T19:56:37.135 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98ace567:::benchmark_data_smithi188_161190_object107721:head# 2024-04-01T19:56:37.136 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98aced2e:::benchmark_data_smithi188_161190_object36031:head# 2024-04-01T19:56:37.136 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98ad4cbe:::benchmark_data_smithi188_161190_object102149:head# 2024-04-01T19:56:37.137 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98af0f9c:::benchmark_data_smithi188_161190_object123864:head# 2024-04-01T19:56:37.137 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98b01ec7:::benchmark_data_smithi188_161190_object134605:head# 2024-04-01T19:56:37.137 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98b11872:::benchmark_data_smithi188_161190_object109005:head# 2024-04-01T19:56:37.138 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98b120c0:::benchmark_data_smithi188_161190_object92431:head# 2024-04-01T19:56:37.138 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98b17a12:::benchmark_data_smithi188_161190_object138619:head# 2024-04-01T19:56:37.139 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98b1a9a8:::benchmark_data_smithi188_161190_object135081:head# 2024-04-01T19:56:37.139 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98b2f4b0:::benchmark_data_smithi188_161190_object103798:head# 2024-04-01T19:56:37.139 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98b32c25:::benchmark_data_smithi188_161190_object44992:head# 2024-04-01T19:56:37.140 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98b3734d:::benchmark_data_smithi188_161190_object97354:head# 2024-04-01T19:56:37.140 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98b37815:::benchmark_data_smithi188_161190_object106277:head# 2024-04-01T19:56:37.141 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98b3dd81:::benchmark_data_smithi188_161190_object115079:head# 2024-04-01T19:56:37.141 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98b3e61a:::benchmark_data_smithi188_161190_object136644:head# 2024-04-01T19:56:37.141 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98b42295:::benchmark_data_smithi188_161190_object100662:head# 2024-04-01T19:56:37.142 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98b4404a:::benchmark_data_smithi188_161190_object57796:head# 2024-04-01T19:56:37.142 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98b4ad00:::benchmark_data_smithi188_161190_object77258:head# 2024-04-01T19:56:37.143 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98b6151a:::benchmark_data_smithi188_161190_object91723:head# 2024-04-01T19:56:37.144 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98b63c3a:::benchmark_data_smithi188_161190_object49172:head# 2024-04-01T19:56:37.144 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98b644c1:::benchmark_data_smithi188_161190_object113347:head# 2024-04-01T19:56:37.145 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98b766aa:::benchmark_data_smithi188_161190_object70064:head# 2024-04-01T19:56:37.145 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98b89270:::benchmark_data_smithi188_161190_object93738:head# 2024-04-01T19:56:37.147 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98b8c1eb:::benchmark_data_smithi188_161190_object120549:head# 2024-04-01T19:56:37.147 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98ba60ee:::benchmark_data_smithi188_161190_object127368:head# 2024-04-01T19:56:37.148 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98bafc01:::benchmark_data_smithi188_161190_object95125:head# 2024-04-01T19:56:37.149 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98baff79:::benchmark_data_smithi188_161190_object62291:head# 2024-04-01T19:56:37.149 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98bc7213:::benchmark_data_smithi188_161190_object93945:head# 2024-04-01T19:56:37.149 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98bd13c7:::benchmark_data_smithi188_161190_object96930:head# 2024-04-01T19:56:37.150 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98bda4f1:::benchmark_data_smithi188_161190_object104638:head# 2024-04-01T19:56:37.150 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98bf109d:::benchmark_data_smithi188_161190_object83153:head# 2024-04-01T19:56:37.150 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98bf3553:::benchmark_data_smithi188_161190_object66960:head# 2024-04-01T19:56:37.151 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98c007de:::benchmark_data_smithi188_161190_object31499:head# 2024-04-01T19:56:37.151 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98c0bd40:::benchmark_data_smithi188_161190_object105779:head# 2024-04-01T19:56:37.152 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98c12c97:::benchmark_data_smithi188_161190_object66337:head# 2024-04-01T19:56:37.152 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98c27869:::benchmark_data_smithi188_161190_object118043:head# 2024-04-01T19:56:37.152 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98c2d3e2:::benchmark_data_smithi188_161190_object118956:head# 2024-04-01T19:56:37.153 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98c3c18b:::benchmark_data_smithi188_161190_object118914:head# 2024-04-01T19:56:37.153 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98c4e843:::benchmark_data_smithi188_161190_object19912:head# 2024-04-01T19:56:37.154 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98c4f5a4:::benchmark_data_smithi188_161190_object42205:head# 2024-04-01T19:56:37.154 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98c504a5:::benchmark_data_smithi188_161190_object124199:head# 2024-04-01T19:56:37.155 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98c53121:::benchmark_data_smithi188_161190_object82396:head# 2024-04-01T19:56:37.155 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98c599de:::benchmark_data_smithi188_161190_object91749:head# 2024-04-01T19:56:37.156 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98c5a03c:::benchmark_data_smithi188_161190_object95524:head# 2024-04-01T19:56:37.156 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98c636da:::benchmark_data_smithi188_161190_object111513:head# 2024-04-01T19:56:37.157 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98c6f74d:::benchmark_data_smithi188_161190_object63506:head# 2024-04-01T19:56:37.157 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98c7b832:::benchmark_data_smithi188_161190_object56746:head# 2024-04-01T19:56:37.159 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98c9399a:::benchmark_data_smithi188_161190_object99398:head# 2024-04-01T19:56:37.159 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98c97ef2:::benchmark_data_smithi188_161190_object104928:head# 2024-04-01T19:56:37.159 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98ca8c8e:::benchmark_data_smithi188_161190_object25935:head# 2024-04-01T19:56:37.159 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98cbbf92:::benchmark_data_smithi188_161190_object32483:head# 2024-04-01T19:56:37.160 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98cddce4:::benchmark_data_smithi188_161190_object97234:head# 2024-04-01T19:56:37.160 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98cf2a7c:::benchmark_data_smithi188_161190_object32486:head# 2024-04-01T19:56:37.161 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98cf33bb:::benchmark_data_smithi188_161190_object23959:head# 2024-04-01T19:56:37.161 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98cfaf39:::benchmark_data_smithi188_161190_object75406:head# 2024-04-01T19:56:37.161 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98d01c4c:::benchmark_data_smithi188_161190_object51058:head# 2024-04-01T19:56:37.162 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98d0fba1:::benchmark_data_smithi188_161190_object85365:head# 2024-04-01T19:56:37.162 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98d13cf6:::benchmark_data_smithi188_161190_object51765:head# 2024-04-01T19:56:37.163 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98d1555f:::benchmark_data_smithi188_161190_object133304:head# 2024-04-01T19:56:37.163 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98d2322b:::benchmark_data_smithi188_161190_object75498:head# 2024-04-01T19:56:37.163 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98d285c5:::benchmark_data_smithi188_161190_object29727:head# 2024-04-01T19:56:37.164 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98d34cc5:::benchmark_data_smithi188_161190_object21723:head# 2024-04-01T19:56:37.164 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98d3ee0b:::benchmark_data_smithi188_161190_object131004:head# 2024-04-01T19:56:37.165 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98d44960:::benchmark_data_smithi188_161190_object125311:head# 2024-04-01T19:56:37.165 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98d62908:::benchmark_data_smithi188_161190_object111713:head# 2024-04-01T19:56:37.166 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98d73443:::benchmark_data_smithi188_161190_object64620:head# 2024-04-01T19:56:37.166 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98d73f39:::benchmark_data_smithi188_161190_object131674:head# 2024-04-01T19:56:37.172 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98d79f89:::benchmark_data_smithi188_161190_object129429:head# 2024-04-01T19:56:37.172 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98d7bb36:::benchmark_data_smithi188_161190_object94765:head# 2024-04-01T19:56:37.172 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98d90e82:::benchmark_data_smithi188_161190_object24351:head# 2024-04-01T19:56:37.172 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98d92879:::benchmark_data_smithi188_161190_object76193:head# 2024-04-01T19:56:37.172 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98d99e1d:::benchmark_data_smithi188_161190_object34947:head# 2024-04-01T19:56:37.172 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98da8e25:::benchmark_data_smithi188_161190_object43501:head# 2024-04-01T19:56:37.172 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98db2dea:::benchmark_data_smithi188_161190_object104494:head# 2024-04-01T19:56:37.172 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98dbbc33:::benchmark_data_smithi188_161190_object49799:head# 2024-04-01T19:56:37.172 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98dce7be:::benchmark_data_smithi188_161190_object70830:head# 2024-04-01T19:56:37.172 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98dd31c1:::benchmark_data_smithi188_161190_object88054:head# 2024-04-01T19:56:37.173 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98dd3da1:::benchmark_data_smithi188_161190_object58347:head# 2024-04-01T19:56:37.173 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98dd5e4e:::benchmark_data_smithi188_161190_object101510:head# 2024-04-01T19:56:37.173 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98de2475:::benchmark_data_smithi188_161190_object45413:head# 2024-04-01T19:56:37.173 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98de3915:::benchmark_data_smithi188_161190_object66846:head# 2024-04-01T19:56:37.173 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98de7fad:::benchmark_data_smithi188_161190_object60106:head# 2024-04-01T19:56:37.175 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98ded79a:::benchmark_data_smithi188_161190_object21900:head# 2024-04-01T19:56:37.175 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98deea7a:::benchmark_data_smithi188_161190_object35274:head# 2024-04-01T19:56:37.176 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98dfca80:::benchmark_data_smithi188_161190_object33741:head# 2024-04-01T19:56:37.176 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98e04a08:::benchmark_data_smithi188_161190_object75012:head# 2024-04-01T19:56:37.176 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98e07013:::benchmark_data_smithi188_161190_object58734:head# 2024-04-01T19:56:37.177 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98e0ce1b:::benchmark_data_smithi188_161190_object102057:head# 2024-04-01T19:56:37.178 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98e0ff1d:::benchmark_data_smithi188_161190_object70243:head# 2024-04-01T19:56:37.179 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98e108e3:::benchmark_data_smithi188_161190_object76726:head# 2024-04-01T19:56:37.179 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98e1da2d:::benchmark_data_smithi188_161190_object81607:head# 2024-04-01T19:56:37.179 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98e2db60:::benchmark_data_smithi188_161190_object67685:head# 2024-04-01T19:56:37.180 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98e30b42:::benchmark_data_smithi188_161190_object97517:head# 2024-04-01T19:56:37.180 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98e40a66:::benchmark_data_smithi188_161190_object118794:head# 2024-04-01T19:56:37.180 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98e477ee:::benchmark_data_smithi188_161190_object124217:head# 2024-04-01T19:56:37.181 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98e58815:::benchmark_data_smithi188_161190_object41646:head# 2024-04-01T19:56:37.181 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98e5c84b:::benchmark_data_smithi188_161190_object42372:head# 2024-04-01T19:56:37.182 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98e6b114:::benchmark_data_smithi188_161190_object106534:head# 2024-04-01T19:56:37.182 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98e6f432:::benchmark_data_smithi188_161190_object54460:head# 2024-04-01T19:56:37.182 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98e795b9:::benchmark_data_smithi188_161190_object122220:head# 2024-04-01T19:56:37.183 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98e908b4:::benchmark_data_smithi188_161190_object118280:head# 2024-04-01T19:56:37.183 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98e94107:::benchmark_data_smithi188_161190_object85100:head# 2024-04-01T19:56:37.184 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98e99bcd:::benchmark_data_smithi188_161190_object29735:head# 2024-04-01T19:56:37.187 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98e9ab6a:::benchmark_data_smithi188_161190_object93320:head# 2024-04-01T19:56:37.188 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98e9e125:::benchmark_data_smithi188_161190_object46836:head# 2024-04-01T19:56:37.188 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98ea562a:::benchmark_data_smithi188_161190_object32830:head# 2024-04-01T19:56:37.188 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98eb253c:::benchmark_data_smithi188_161190_object65515:head# 2024-04-01T19:56:37.188 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98eb2a39:::benchmark_data_smithi188_161190_object37938:head# 2024-04-01T19:56:37.188 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98eba751:::benchmark_data_smithi188_161190_object133260:head# 2024-04-01T19:56:37.188 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98eef3e3:::benchmark_data_smithi188_161190_object45541:head# 2024-04-01T19:56:37.188 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98efd05d:::benchmark_data_smithi188_161190_object135175:head# 2024-04-01T19:56:37.192 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98f08122:::benchmark_data_smithi188_161190_object117626:head# 2024-04-01T19:56:37.194 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98f0c9ec:::benchmark_data_smithi188_161190_object115540:head# 2024-04-01T19:56:37.195 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98f1b75f:::benchmark_data_smithi188_161190_object137808:head# 2024-04-01T19:56:37.195 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98f1dbec:::benchmark_data_smithi188_161190_object27859:head# 2024-04-01T19:56:37.195 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98f1de2d:::benchmark_data_smithi188_161190_object56040:head# 2024-04-01T19:56:37.196 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98f25b85:::benchmark_data_smithi188_161190_object139155:head# 2024-04-01T19:56:37.196 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98f373a2:::benchmark_data_smithi188_161190_object104581:head# 2024-04-01T19:56:37.197 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98f44d2e:::benchmark_data_smithi188_161190_object122287:head# 2024-04-01T19:56:37.197 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98f558b8:::benchmark_data_smithi188_161190_object130301:head# 2024-04-01T19:56:37.197 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98f5845b:::benchmark_data_smithi188_161190_object30387:head# 2024-04-01T19:56:37.198 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98f5c8fa:::benchmark_data_smithi188_161190_object101356:head# 2024-04-01T19:56:37.198 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98f60763:::benchmark_data_smithi188_161190_object46579:head# 2024-04-01T19:56:37.199 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98f71a01:::benchmark_data_smithi188_161190_object127658:head# 2024-04-01T19:56:37.199 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98f808db:::benchmark_data_smithi188_161190_object132197:head# 2024-04-01T19:56:37.200 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98f830ed:::benchmark_data_smithi188_161190_object115466:head# 2024-04-01T19:56:37.200 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98f84ca7:::benchmark_data_smithi188_161190_object123626:head# 2024-04-01T19:56:37.201 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98f84de3:::benchmark_data_smithi188_161190_object128185:head# 2024-04-01T19:56:37.201 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98f8c361:::benchmark_data_smithi188_161190_object89634:head# 2024-04-01T19:56:37.202 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98f8fe0a:::benchmark_data_smithi188_161190_object113988:head# 2024-04-01T19:56:37.202 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98f936ee:::benchmark_data_smithi188_161190_object47491:head# 2024-04-01T19:56:37.202 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98f94699:::benchmark_data_smithi188_161190_object107103:head# 2024-04-01T19:56:37.203 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98f963ea:::benchmark_data_smithi188_161190_object58150:head# 2024-04-01T19:56:37.203 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98f96c03:::benchmark_data_smithi188_161190_object74431:head# 2024-04-01T19:56:37.204 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98f9e1b9:::benchmark_data_smithi188_161190_object132058:head# 2024-04-01T19:56:37.204 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98fb2bdd:::benchmark_data_smithi188_161190_object83803:head# 2024-04-01T19:56:37.204 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98fbe60a:::benchmark_data_smithi188_161190_object92509:head# 2024-04-01T19:56:37.205 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98fc6691:::benchmark_data_smithi188_161190_object64394:head# 2024-04-01T19:56:37.205 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98fddc5a:::benchmark_data_smithi188_161190_object87622:head# 2024-04-01T19:56:37.205 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:98fe3432:::benchmark_data_smithi188_161190_object86337:head# 2024-04-01T19:56:37.206 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99004772:::benchmark_data_smithi188_161190_object52652:head# 2024-04-01T19:56:37.212 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99006db3:::benchmark_data_smithi188_161190_object77471:head# 2024-04-01T19:56:37.213 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99017c0d:::benchmark_data_smithi188_161190_object69825:head# 2024-04-01T19:56:37.213 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9901af66:::benchmark_data_smithi188_161190_object24494:head# 2024-04-01T19:56:37.213 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9901d483:::benchmark_data_smithi188_161190_object89770:head# 2024-04-01T19:56:37.213 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9901e2a0:::benchmark_data_smithi188_161190_object128109:head# 2024-04-01T19:56:37.213 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:990275ee:::benchmark_data_smithi188_161190_object26519:head# 2024-04-01T19:56:37.213 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9902d7a9:::benchmark_data_smithi188_161190_object116405:head# 2024-04-01T19:56:37.213 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99032c15:::benchmark_data_smithi188_161190_object75354:head# 2024-04-01T19:56:37.213 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9903bf55:::benchmark_data_smithi188_161190_object112805:head# 2024-04-01T19:56:37.214 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:990473d6:::benchmark_data_smithi188_161190_object26613:head# 2024-04-01T19:56:37.214 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9904944b:::benchmark_data_smithi188_161190_object139067:head# 2024-04-01T19:56:37.214 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9904c408:::benchmark_data_smithi188_161190_object33796:head# 2024-04-01T19:56:37.214 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:990539cc:::benchmark_data_smithi188_161190_object86095:head# 2024-04-01T19:56:37.215 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99053a32:::benchmark_data_smithi188_161190_object58225:head# 2024-04-01T19:56:37.218 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99054914:::benchmark_data_smithi188_161190_object49557:head# 2024-04-01T19:56:37.218 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99063480:::benchmark_data_smithi188_161190_object22406:head# 2024-04-01T19:56:37.219 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9906d19e:::benchmark_data_smithi188_161190_object137208:head# 2024-04-01T19:56:37.219 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99078a99:::benchmark_data_smithi188_161190_object80032:head# 2024-04-01T19:56:37.219 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9907bb07:::benchmark_data_smithi188_161190_object96446:head# 2024-04-01T19:56:37.219 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:990846c9:::benchmark_data_smithi188_161190_object71363:head# 2024-04-01T19:56:37.219 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9909b2dc:::benchmark_data_smithi188_161190_object25642:head# 2024-04-01T19:56:37.219 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:990a9fb3:::benchmark_data_smithi188_161190_object64869:head# 2024-04-01T19:56:37.219 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:990adc32:::benchmark_data_smithi188_161190_object38760:head# 2024-04-01T19:56:37.224 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:990b31b9:::benchmark_data_smithi188_161190_object21621:head# 2024-04-01T19:56:37.224 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:990b5eab:::benchmark_data_smithi188_161190_object21428:head# 2024-04-01T19:56:37.224 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:990b9d8f:::benchmark_data_smithi188_161190_object125421:head# 2024-04-01T19:56:37.225 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:990bff8e:::benchmark_data_smithi188_161190_object61737:head# 2024-04-01T19:56:37.225 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:990c6e8d:::benchmark_data_smithi188_161190_object73319:head# 2024-04-01T19:56:37.226 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:990d10a5:::benchmark_data_smithi188_161190_object105588:head# 2024-04-01T19:56:37.227 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:990d4e7d:::benchmark_data_smithi188_161190_object26741:head# 2024-04-01T19:56:37.227 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:990d9087:::benchmark_data_smithi188_161190_object55506:head# 2024-04-01T19:56:37.227 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:990dd1ed:::benchmark_data_smithi188_161190_object47864:head# 2024-04-01T19:56:37.228 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:990df4a8:::benchmark_data_smithi188_161190_object99579:head# 2024-04-01T19:56:37.230 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:990ee1c7:::benchmark_data_smithi188_161190_object56992:head# 2024-04-01T19:56:37.234 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:990f77e6:::benchmark_data_smithi188_161190_object93511:head# 2024-04-01T19:56:37.234 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:990fe1d6:::benchmark_data_smithi188_161190_object128242:head# 2024-04-01T19:56:37.234 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99111829:::benchmark_data_smithi188_161190_object80693:head# 2024-04-01T19:56:37.235 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:991159ba:::benchmark_data_smithi188_161190_object86178:head# 2024-04-01T19:56:37.235 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99120fe8:::benchmark_data_smithi188_161190_object91244:head# 2024-04-01T19:56:37.235 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99127833:::benchmark_data_smithi188_161190_object129948:head# 2024-04-01T19:56:37.236 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9912ae87:::benchmark_data_smithi188_161190_object88081:head# 2024-04-01T19:56:37.236 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99133590:::benchmark_data_smithi188_161190_object69918:head# 2024-04-01T19:56:37.237 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99134388:::benchmark_data_smithi188_161190_object120419:head# 2024-04-01T19:56:37.237 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99146111:::benchmark_data_smithi188_161190_object38294:head# 2024-04-01T19:56:37.238 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:991478c9:::benchmark_data_smithi188_161190_object40538:head# 2024-04-01T19:56:37.238 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9914a314:::benchmark_data_smithi188_161190_object61628:head# 2024-04-01T19:56:37.241 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9914c35d:::benchmark_data_smithi188_161190_object28263:head# 2024-04-01T19:56:37.241 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9914c62a:::benchmark_data_smithi188_161190_object134913:head# 2024-04-01T19:56:37.242 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9914d5c9:::benchmark_data_smithi188_161190_object49202:head# 2024-04-01T19:56:37.242 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9915c3f9:::benchmark_data_smithi188_161190_object135912:head# 2024-04-01T19:56:37.242 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9915ec29:::benchmark_data_smithi188_161190_object131850:head# 2024-04-01T19:56:37.243 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9916d1a2:::benchmark_data_smithi188_161190_object58193:head# 2024-04-01T19:56:37.243 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99171d43:::benchmark_data_smithi188_161190_object115523:head# 2024-04-01T19:56:37.244 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99178e22:::benchmark_data_smithi188_161190_object52806:head# 2024-04-01T19:56:37.244 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9917ddcf:::benchmark_data_smithi188_161190_object107907:head# 2024-04-01T19:56:37.245 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:991a56c2:::benchmark_data_smithi188_161190_object83787:head# 2024-04-01T19:56:37.245 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:991aaa2c:::benchmark_data_smithi188_161190_object23550:head# 2024-04-01T19:56:37.245 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:991b1bef:::benchmark_data_smithi188_161190_object21130:head# 2024-04-01T19:56:37.246 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:991b2436:::benchmark_data_smithi188_161190_object108282:head# 2024-04-01T19:56:37.246 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:991b6024:::benchmark_data_smithi188_161190_object84407:head# 2024-04-01T19:56:37.247 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:991b8c42:::benchmark_data_smithi188_161190_object34247:head# 2024-04-01T19:56:37.247 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:991b9649:::benchmark_data_smithi188_161190_object114072:head# 2024-04-01T19:56:37.248 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:991bd658:::benchmark_data_smithi188_161190_object136144:head# 2024-04-01T19:56:37.248 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:991bf29b:::benchmark_data_smithi188_161190_object84270:head# 2024-04-01T19:56:37.248 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:991c1301:::benchmark_data_smithi188_161190_object23842:head# 2024-04-01T19:56:37.249 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:991c18d3:::benchmark_data_smithi188_161190_object101943:head# 2024-04-01T19:56:37.249 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:991c210b:::benchmark_data_smithi188_161190_object65667:head# 2024-04-01T19:56:37.250 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:991c7da9:::benchmark_data_smithi188_161190_object110761:head# 2024-04-01T19:56:37.250 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:991c8d9e:::benchmark_data_smithi188_161190_object62574:head# 2024-04-01T19:56:37.251 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:991d0c2a:::benchmark_data_smithi188_161190_object106991:head# 2024-04-01T19:56:37.251 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:991d275d:::benchmark_data_smithi188_161190_object87148:head# 2024-04-01T19:56:37.251 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:991d5ae5:::benchmark_data_smithi188_161190_object130168:head# 2024-04-01T19:56:37.252 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:991eaf65:::benchmark_data_smithi188_161190_object122382:head# 2024-04-01T19:56:37.252 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:991fad96:::benchmark_data_smithi188_161190_object26588:head# 2024-04-01T19:56:37.253 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:991fdc5a:::benchmark_data_smithi188_161190_object126824:head# 2024-04-01T19:56:37.253 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99207ab1:::benchmark_data_smithi188_161190_object42471:head# 2024-04-01T19:56:37.253 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99226bf3:::benchmark_data_smithi188_161190_object121167:head# 2024-04-01T19:56:37.254 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9922f8ca:::benchmark_data_smithi188_161190_object130899:head# 2024-04-01T19:56:37.254 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99235c65:::benchmark_data_smithi188_161190_object131293:head# 2024-04-01T19:56:37.255 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99235e22:::benchmark_data_smithi188_161190_object53027:head# 2024-04-01T19:56:37.255 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99245ca7:::benchmark_data_smithi188_161190_object19976:head# 2024-04-01T19:56:37.256 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9924bd30:::benchmark_data_smithi188_161190_object34783:head# 2024-04-01T19:56:37.256 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9925c159:::benchmark_data_smithi188_161190_object64208:head# 2024-04-01T19:56:37.256 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99268129:::benchmark_data_smithi188_161190_object136591:head# 2024-04-01T19:56:37.257 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9926b611:::benchmark_data_smithi188_161190_object93450:head# 2024-04-01T19:56:37.257 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9926d397:::benchmark_data_smithi188_161190_object24266:head# 2024-04-01T19:56:37.260 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99274f0a:::benchmark_data_smithi188_161190_object68847:head# 2024-04-01T19:56:37.261 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:992759b1:::benchmark_data_smithi188_161190_object70404:head# 2024-04-01T19:56:37.262 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9927ae2c:::benchmark_data_smithi188_161190_object20767:head# 2024-04-01T19:56:37.262 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99296d0f:::benchmark_data_smithi188_161190_object136795:head# 2024-04-01T19:56:37.263 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99296e46:::benchmark_data_smithi188_161190_object87611:head# 2024-04-01T19:56:37.263 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:992a5877:::benchmark_data_smithi188_161190_object36141:head# 2024-04-01T19:56:37.264 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:992abd16:::benchmark_data_smithi188_161190_object22058:head# 2024-04-01T19:56:37.264 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:992b6fdf:::benchmark_data_smithi188_161190_object124821:head# 2024-04-01T19:56:37.264 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:992c54cd:::benchmark_data_smithi188_161190_object78338:head# 2024-04-01T19:56:37.265 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:992c884f:::benchmark_data_smithi188_161190_object47975:head# 2024-04-01T19:56:37.265 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:992cf97b:::benchmark_data_smithi188_161190_object29764:head# 2024-04-01T19:56:37.266 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:992d09ac:::benchmark_data_smithi188_161190_object68081:head# 2024-04-01T19:56:37.266 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:992edf0c:::benchmark_data_smithi188_161190_object72819:head# 2024-04-01T19:56:37.267 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:993035b0:::benchmark_data_smithi188_161190_object36941:head# 2024-04-01T19:56:37.267 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9930525d:::benchmark_data_smithi188_161190_object24502:head# 2024-04-01T19:56:37.268 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99308a8d:::benchmark_data_smithi188_161190_object65506:head# 2024-04-01T19:56:37.269 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9930fd96:::benchmark_data_smithi188_161190_object127379:head# 2024-04-01T19:56:37.269 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9930fe73:::benchmark_data_smithi188_161190_object44010:head# 2024-04-01T19:56:37.269 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:993109a7:::benchmark_data_smithi188_161190_object72266:head# 2024-04-01T19:56:37.270 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99316e88:::benchmark_data_smithi188_161190_object114120:head# 2024-04-01T19:56:37.271 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99324ccf:::benchmark_data_smithi188_161190_object68130:head# 2024-04-01T19:56:37.271 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99324e22:::benchmark_data_smithi188_161190_object124246:head# 2024-04-01T19:56:37.272 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:993336a1:::benchmark_data_smithi188_161190_object36433:head# 2024-04-01T19:56:37.273 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99338500:::benchmark_data_smithi188_161190_object81476:head# 2024-04-01T19:56:37.273 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9933d4f6:::benchmark_data_smithi188_161190_object122056:head# 2024-04-01T19:56:37.273 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9933f2c9:::benchmark_data_smithi188_161190_object106784:head# 2024-04-01T19:56:37.273 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99349a13:::benchmark_data_smithi188_161190_object128709:head# 2024-04-01T19:56:37.274 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9934fc12:::benchmark_data_smithi188_161190_object111851:head# 2024-04-01T19:56:37.274 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:993541ff:::benchmark_data_smithi188_161190_object121041:head# 2024-04-01T19:56:37.275 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:993560a2:::benchmark_data_smithi188_161190_object22528:head# 2024-04-01T19:56:37.275 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9935ab3d:::benchmark_data_smithi188_161190_object37029:head# 2024-04-01T19:56:37.275 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9936943d:::benchmark_data_smithi188_161190_object103658:head# 2024-04-01T19:56:37.279 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9936cc74:::benchmark_data_smithi188_161190_object118201:head# 2024-04-01T19:56:37.280 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9936dcd9:::benchmark_data_smithi188_161190_object24458:head# 2024-04-01T19:56:37.280 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:993753b0:::benchmark_data_smithi188_161190_object62221:head# 2024-04-01T19:56:37.280 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99390f62:::benchmark_data_smithi188_161190_object50459:head# 2024-04-01T19:56:37.280 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:993945cc:::benchmark_data_smithi188_161190_object30543:head# 2024-04-01T19:56:37.280 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:993b3466:::benchmark_data_smithi188_161190_object52398:head# 2024-04-01T19:56:37.280 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:993bb020:::benchmark_data_smithi188_161190_object132864:head# 2024-04-01T19:56:37.280 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:993bb424:::benchmark_data_smithi188_161190_object111982:head# 2024-04-01T19:56:37.280 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:993cbfdc:::benchmark_data_smithi188_161190_object32415:head# 2024-04-01T19:56:37.280 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:993d3cf2:::benchmark_data_smithi188_161190_object83349:head# 2024-04-01T19:56:37.281 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:993dc0f3:::benchmark_data_smithi188_161190_object137214:head# 2024-04-01T19:56:37.281 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:993dfb0f:::benchmark_data_smithi188_161190_object101063:head# 2024-04-01T19:56:37.281 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:993eafe6:::benchmark_data_smithi188_161190_object32886:head# 2024-04-01T19:56:37.282 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99403cb3:::benchmark_data_smithi188_161190_object45510:head# 2024-04-01T19:56:37.282 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:994075e3:::benchmark_data_smithi188_161190_object121520:head# 2024-04-01T19:56:37.282 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:994082a3:::benchmark_data_smithi188_161190_object27612:head# 2024-04-01T19:56:37.282 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9940e776:::benchmark_data_smithi188_161190_object48578:head# 2024-04-01T19:56:37.283 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99415dfa:::benchmark_data_smithi188_161190_object94598:head# 2024-04-01T19:56:37.283 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9941c010:::benchmark_data_smithi188_161190_object75537:head# 2024-04-01T19:56:37.284 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99423c22:::benchmark_data_smithi188_161190_object131498:head# 2024-04-01T19:56:37.284 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:994296eb:::benchmark_data_smithi188_161190_object74537:head# 2024-04-01T19:56:37.286 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99429973:::benchmark_data_smithi188_161190_object65014:head# 2024-04-01T19:56:37.286 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99431d27:::benchmark_data_smithi188_161190_object124979:head# 2024-04-01T19:56:37.286 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:994344bc:::benchmark_data_smithi188_161190_object78517:head# 2024-04-01T19:56:37.287 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99455381:::benchmark_data_smithi188_161190_object123926:head# 2024-04-01T19:56:37.287 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99456092:::benchmark_data_smithi188_161190_object53156:head# 2024-04-01T19:56:37.287 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99473e78:::benchmark_data_smithi188_161190_object51481:head# 2024-04-01T19:56:37.287 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9947e6f2:::benchmark_data_smithi188_161190_object133854:head# 2024-04-01T19:56:37.288 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9948c56e:::benchmark_data_smithi188_161190_object57465:head# 2024-04-01T19:56:37.288 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9949443f:::benchmark_data_smithi188_161190_object57241:head# 2024-04-01T19:56:37.288 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:994a198f:::benchmark_data_smithi188_161190_object100296:head# 2024-04-01T19:56:37.289 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:994cdc82:::benchmark_data_smithi188_161190_object131094:head# 2024-04-01T19:56:37.289 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:994cdfff:::benchmark_data_smithi188_161190_object83996:head# 2024-04-01T19:56:37.289 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:994daff6:::benchmark_data_smithi188_161190_object89401:head# 2024-04-01T19:56:37.290 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:994e5359:::benchmark_data_smithi188_161190_object56888:head# 2024-04-01T19:56:37.290 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:994fb950:::benchmark_data_smithi188_161190_object86176:head# 2024-04-01T19:56:37.291 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9950781f:::benchmark_data_smithi188_161190_object48588:head# 2024-04-01T19:56:37.291 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99508873:::benchmark_data_smithi188_161190_object65309:head# 2024-04-01T19:56:37.291 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9950a237:::benchmark_data_smithi188_161190_object87674:head# 2024-04-01T19:56:37.292 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9950b0a3:::benchmark_data_smithi188_161190_object23098:head# 2024-04-01T19:56:37.292 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9951bdb0:::benchmark_data_smithi188_161190_object135088:head# 2024-04-01T19:56:37.293 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99525c3b:::benchmark_data_smithi188_161190_object88915:head# 2024-04-01T19:56:37.293 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99533f2a:::benchmark_data_smithi188_161190_object74387:head# 2024-04-01T19:56:37.295 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99535750:::benchmark_data_smithi188_161190_object23315:head# 2024-04-01T19:56:37.295 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99543392:::benchmark_data_smithi188_161190_object116429:head# 2024-04-01T19:56:37.295 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9954fbc9:::benchmark_data_smithi188_161190_object138524:head# 2024-04-01T19:56:37.296 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:995502c4:::benchmark_data_smithi188_161190_object115624:head# 2024-04-01T19:56:37.296 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:995541f2:::benchmark_data_smithi188_161190_object65011:head# 2024-04-01T19:56:37.297 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:995583b6:::benchmark_data_smithi188_161190_object41621:head# 2024-04-01T19:56:37.297 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9955d32f:::benchmark_data_smithi188_161190_object136728:head# 2024-04-01T19:56:37.297 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99569bfc:::benchmark_data_smithi188_161190_object49878:head# 2024-04-01T19:56:37.298 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9956c3f1:::benchmark_data_smithi188_161190_object83137:head# 2024-04-01T19:56:37.298 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9958bb43:::benchmark_data_smithi188_161190_object22842:head# 2024-04-01T19:56:37.299 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:995a6554:::benchmark_data_smithi188_161190_object49811:head# 2024-04-01T19:56:37.299 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:995a6e39:::benchmark_data_smithi188_161190_object92127:head# 2024-04-01T19:56:37.300 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:995b3fbf:::benchmark_data_smithi188_161190_object134729:head# 2024-04-01T19:56:37.300 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:995b558f:::benchmark_data_smithi188_161190_object66493:head# 2024-04-01T19:56:37.301 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:995cd882:::benchmark_data_smithi188_161190_object29144:head# 2024-04-01T19:56:37.301 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:995dc24d:::benchmark_data_smithi188_161190_object66461:head# 2024-04-01T19:56:37.301 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:995dcfb7:::benchmark_data_smithi188_161190_object125663:head# 2024-04-01T19:56:37.302 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:995e2d56:::benchmark_data_smithi188_161190_object30136:head# 2024-04-01T19:56:37.303 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:995fe2c8:::benchmark_data_smithi188_161190_object81983:head# 2024-04-01T19:56:37.303 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:995ff608:::benchmark_data_smithi188_161190_object79343:head# 2024-04-01T19:56:37.304 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99602a2a:::benchmark_data_smithi188_161190_object37920:head# 2024-04-01T19:56:37.304 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:996039c6:::benchmark_data_smithi188_161190_object75986:head# 2024-04-01T19:56:37.304 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:996084d4:::benchmark_data_smithi188_161190_object85915:head# 2024-04-01T19:56:37.307 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99613958:::benchmark_data_smithi188_161190_object79902:head# 2024-04-01T19:56:37.307 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9961b21c:::benchmark_data_smithi188_161190_object101382:head# 2024-04-01T19:56:37.314 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9961b72e:::benchmark_data_smithi188_161190_object91699:head# 2024-04-01T19:56:37.315 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9961d46b:::benchmark_data_smithi188_161190_object45076:head# 2024-04-01T19:56:37.315 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9962e29f:::benchmark_data_smithi188_161190_object79765:head# 2024-04-01T19:56:37.315 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9963532a:::benchmark_data_smithi188_161190_object73358:head# 2024-04-01T19:56:37.315 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99635bbb:::benchmark_data_smithi188_161190_object45199:head# 2024-04-01T19:56:37.315 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9965d3ed:::benchmark_data_smithi188_161190_object45519:head# 2024-04-01T19:56:37.315 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9965fba6:::benchmark_data_smithi188_161190_object27524:head# 2024-04-01T19:56:37.315 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99662009:::benchmark_data_smithi188_161190_object93397:head# 2024-04-01T19:56:37.315 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:996652f3:::benchmark_data_smithi188_161190_object21038:head# 2024-04-01T19:56:37.315 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:996807c6:::benchmark_data_smithi188_161190_object22995:head# 2024-04-01T19:56:37.315 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99682c45:::benchmark_data_smithi188_161190_object127294:head# 2024-04-01T19:56:37.315 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9968c350:::benchmark_data_smithi188_161190_object99281:head# 2024-04-01T19:56:37.316 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9968e379:::benchmark_data_smithi188_161190_object39679:head# 2024-04-01T19:56:37.316 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99692c97:::benchmark_data_smithi188_161190_object20925:head# 2024-04-01T19:56:37.316 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:996938e0:::benchmark_data_smithi188_161190_object91381:head# 2024-04-01T19:56:37.316 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:996a2501:::benchmark_data_smithi188_161190_object73305:head# 2024-04-01T19:56:37.317 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:996aca42:::benchmark_data_smithi188_161190_object84797:head# 2024-04-01T19:56:37.317 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:996b1bc8:::benchmark_data_smithi188_161190_object46567:head# 2024-04-01T19:56:37.319 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:996bec9c:::benchmark_data_smithi188_161190_object110716:head# 2024-04-01T19:56:37.319 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:996c1622:::benchmark_data_smithi188_161190_object66393:head# 2024-04-01T19:56:37.320 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:996cf4cf:::benchmark_data_smithi188_161190_object41832:head# 2024-04-01T19:56:37.320 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:996d3483:::benchmark_data_smithi188_161190_object114664:head# 2024-04-01T19:56:37.320 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:996e7cb3:::benchmark_data_smithi188_161190_object132452:head# 2024-04-01T19:56:37.321 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:996ec283:::benchmark_data_smithi188_161190_object98750:head# 2024-04-01T19:56:37.321 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9970db4a:::benchmark_data_smithi188_161190_object69792:head# 2024-04-01T19:56:37.321 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9970fb9f:::benchmark_data_smithi188_161190_object76405:head# 2024-04-01T19:56:37.322 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:997134b7:::benchmark_data_smithi188_161190_object108927:head# 2024-04-01T19:56:37.323 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99715ba5:::benchmark_data_smithi188_161190_object55943:head# 2024-04-01T19:56:37.323 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9972eeb8:::benchmark_data_smithi188_161190_object48147:head# 2024-04-01T19:56:37.324 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9973d782:::benchmark_data_smithi188_161190_object132883:head# 2024-04-01T19:56:37.324 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99741cab:::benchmark_data_smithi188_161190_object44625:head# 2024-04-01T19:56:37.324 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9974c0ca:::benchmark_data_smithi188_161190_object135135:head# 2024-04-01T19:56:37.325 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9975f25b:::benchmark_data_smithi188_161190_object22180:head# 2024-04-01T19:56:37.325 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9975f4fa:::benchmark_data_smithi188_161190_object104751:head# 2024-04-01T19:56:37.326 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9976426b:::benchmark_data_smithi188_161190_object77988:head# 2024-04-01T19:56:37.326 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99778f27:::benchmark_data_smithi188_161190_object78506:head# 2024-04-01T19:56:37.327 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9977f9d6:::benchmark_data_smithi188_161190_object65890:head# 2024-04-01T19:56:37.330 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:997810f5:::benchmark_data_smithi188_161190_object137859:head# 2024-04-01T19:56:37.330 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:997916dc:::benchmark_data_smithi188_161190_object29659:head# 2024-04-01T19:56:37.331 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:997918d0:::benchmark_data_smithi188_161190_object81588:head# 2024-04-01T19:56:37.331 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9979e896:::benchmark_data_smithi188_161190_object90936:head# 2024-04-01T19:56:37.331 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:997af3cd:::benchmark_data_smithi188_161190_object108481:head# 2024-04-01T19:56:37.331 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:997b46f8:::benchmark_data_smithi188_161190_object69865:head# 2024-04-01T19:56:37.331 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:997b6985:::benchmark_data_smithi188_161190_object37417:head# 2024-04-01T19:56:37.331 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:997c3290:::benchmark_data_smithi188_161190_object41180:head# 2024-04-01T19:56:37.332 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:997c552e:::benchmark_data_smithi188_161190_object90296:head# 2024-04-01T19:56:37.332 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:997c8485:::benchmark_data_smithi188_161190_object36561:head# 2024-04-01T19:56:37.332 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:997c8ca3:::benchmark_data_smithi188_161190_object72072:head# 2024-04-01T19:56:37.332 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:997c9e2f:::benchmark_data_smithi188_161190_object107420:head# 2024-04-01T19:56:37.332 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:997ccbc0:::benchmark_data_smithi188_161190_object73775:head# 2024-04-01T19:56:37.333 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:997d6853:::benchmark_data_smithi188_161190_object93282:head# 2024-04-01T19:56:37.334 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:997dbb18:::benchmark_data_smithi188_161190_object113972:head# 2024-04-01T19:56:37.334 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:997e1064:::benchmark_data_smithi188_161190_object36917:head# 2024-04-01T19:56:37.334 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:997f019f:::benchmark_data_smithi188_161190_object108836:head# 2024-04-01T19:56:37.335 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:997f3270:::benchmark_data_smithi188_161190_object114673:head# 2024-04-01T19:56:37.335 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9980c977:::benchmark_data_smithi188_161190_object105676:head# 2024-04-01T19:56:37.336 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9980dd0d:::benchmark_data_smithi188_161190_object104236:head# 2024-04-01T19:56:37.336 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9980fceb:::benchmark_data_smithi188_161190_object125324:head# 2024-04-01T19:56:37.337 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99813361:::benchmark_data_smithi188_161190_object62673:head# 2024-04-01T19:56:37.337 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99821a44:::benchmark_data_smithi188_161190_object36740:head# 2024-04-01T19:56:37.338 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:998222ee:::benchmark_data_smithi188_161190_object50673:head# 2024-04-01T19:56:37.338 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9982ef36:::benchmark_data_smithi188_161190_object34325:head# 2024-04-01T19:56:37.338 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99833789:::benchmark_data_smithi188_161190_object58648:head# 2024-04-01T19:56:37.339 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:998377e2:::benchmark_data_smithi188_161190_object79878:head# 2024-04-01T19:56:37.339 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9984461f:::benchmark_data_smithi188_161190_object78868:head# 2024-04-01T19:56:37.340 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9984dbcd:::benchmark_data_smithi188_161190_object118621:head# 2024-04-01T19:56:37.340 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99862e0e:::benchmark_data_smithi188_161190_object136415:head# 2024-04-01T19:56:37.340 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99868094:::benchmark_data_smithi188_161190_object70065:head# 2024-04-01T19:56:37.341 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99868a6d:::benchmark_data_smithi188_161190_object44559:head# 2024-04-01T19:56:37.341 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9987c972:::benchmark_data_smithi188_161190_object127209:head# 2024-04-01T19:56:37.342 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9987e579:::benchmark_data_smithi188_161190_object119292:head# 2024-04-01T19:56:37.342 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9989006f:::benchmark_data_smithi188_161190_object45180:head# 2024-04-01T19:56:37.343 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99890159:::benchmark_data_smithi188_161190_object116507:head# 2024-04-01T19:56:37.343 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:998941aa:::benchmark_data_smithi188_161190_object77758:head# 2024-04-01T19:56:37.344 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99894c72:::benchmark_data_smithi188_161190_object138865:head# 2024-04-01T19:56:37.344 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:998970b4:::benchmark_data_smithi188_161190_object66303:head# 2024-04-01T19:56:37.344 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:998a94bd:::benchmark_data_smithi188_161190_object109359:head# 2024-04-01T19:56:37.345 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:998ab767:::benchmark_data_smithi188_161190_object60852:head# 2024-04-01T19:56:37.345 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:998b161c:::benchmark_data_smithi188_161190_object77977:head# 2024-04-01T19:56:37.345 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:998c32e0:::benchmark_data_smithi188_161190_object41492:head# 2024-04-01T19:56:37.346 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:998ca0d1:::benchmark_data_smithi188_161190_object66955:head# 2024-04-01T19:56:37.346 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:998d637e:::benchmark_data_smithi188_161190_object65553:head# 2024-04-01T19:56:37.347 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:998ee659:::benchmark_data_smithi188_161190_object74632:head# 2024-04-01T19:56:37.347 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99900498:::benchmark_data_smithi188_161190_object112927:head# 2024-04-01T19:56:37.349 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99904225:::benchmark_data_smithi188_161190_object124281:head# 2024-04-01T19:56:37.349 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9990efc2:::benchmark_data_smithi188_161190_object70088:head# 2024-04-01T19:56:37.349 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9991ab63:::benchmark_data_smithi188_161190_object68513:head# 2024-04-01T19:56:37.350 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9991c682:::benchmark_data_smithi188_161190_object107804:head# 2024-04-01T19:56:37.350 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9991cf00:::benchmark_data_smithi188_161190_object126917:head# 2024-04-01T19:56:37.351 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9991d06a:::benchmark_data_smithi188_161190_object123998:head# 2024-04-01T19:56:37.351 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99924e22:::benchmark_data_smithi188_161190_object82632:head# 2024-04-01T19:56:37.351 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9993252b:::benchmark_data_smithi188_161190_object64619:head# 2024-04-01T19:56:37.352 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99932d25:::benchmark_data_smithi188_161190_object119280:head# 2024-04-01T19:56:37.352 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99938e47:::benchmark_data_smithi188_161190_object129968:head# 2024-04-01T19:56:37.353 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99941c87:::benchmark_data_smithi188_161190_object88051:head# 2024-04-01T19:56:37.353 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99946479:::benchmark_data_smithi188_161190_object50643:head# 2024-04-01T19:56:37.353 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99953ad3:::benchmark_data_smithi188_161190_object77058:head# 2024-04-01T19:56:37.354 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9997c33d:::benchmark_data_smithi188_161190_object100757:head# 2024-04-01T19:56:37.354 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9997e818:::benchmark_data_smithi188_161190_object23305:head# 2024-04-01T19:56:37.355 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9998624a:::benchmark_data_smithi188_161190_object90156:head# 2024-04-01T19:56:37.355 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:999b0320:::benchmark_data_smithi188_161190_object57069:head# 2024-04-01T19:56:37.355 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:999b5de3:::benchmark_data_smithi188_161190_object125869:head# 2024-04-01T19:56:37.356 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:999ba864:::benchmark_data_smithi188_161190_object128300:head# 2024-04-01T19:56:37.356 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:999bfc46:::benchmark_data_smithi188_161190_object28606:head# 2024-04-01T19:56:37.356 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:999c95ae:::benchmark_data_smithi188_161190_object43297:head# 2024-04-01T19:56:37.357 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:999c9a09:::benchmark_data_smithi188_161190_object126144:head# 2024-04-01T19:56:37.357 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:999cb1bf:::benchmark_data_smithi188_161190_object94546:head# 2024-04-01T19:56:37.358 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:999cf9fa:::benchmark_data_smithi188_161190_object135892:head# 2024-04-01T19:56:37.358 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:999d5456:::benchmark_data_smithi188_161190_object28191:head# 2024-04-01T19:56:37.358 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:999ea0ca:::benchmark_data_smithi188_161190_object113075:head# 2024-04-01T19:56:37.359 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:999ea94a:::benchmark_data_smithi188_161190_object128027:head# 2024-04-01T19:56:37.359 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:999ed29d:::benchmark_data_smithi188_161190_object136691:head# 2024-04-01T19:56:37.360 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99a00fc1:::benchmark_data_smithi188_161190_object29667:head# 2024-04-01T19:56:37.360 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99a0375b:::benchmark_data_smithi188_161190_object59052:head# 2024-04-01T19:56:37.361 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99a0af51:::benchmark_data_smithi188_161190_object77659:head# 2024-04-01T19:56:37.361 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99a0d4c5:::benchmark_data_smithi188_161190_object26957:head# 2024-04-01T19:56:37.362 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99a0eb79:::benchmark_data_smithi188_161190_object34069:head# 2024-04-01T19:56:37.362 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99a29b23:::benchmark_data_smithi188_161190_object27016:head# 2024-04-01T19:56:37.362 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99a395a8:::benchmark_data_smithi188_161190_object101045:head# 2024-04-01T19:56:37.363 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99a3985a:::benchmark_data_smithi188_161190_object88941:head# 2024-04-01T19:56:37.363 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99a3eb33:::benchmark_data_smithi188_161190_object68421:head# 2024-04-01T19:56:37.364 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99a404fb:::benchmark_data_smithi188_161190_object130036:head# 2024-04-01T19:56:37.364 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99a44186:::benchmark_data_smithi188_161190_object100980:head# 2024-04-01T19:56:37.365 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99a4984e:::benchmark_data_smithi188_161190_object115319:head# 2024-04-01T19:56:37.365 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99a4f9b7:::benchmark_data_smithi188_161190_object89793:head# 2024-04-01T19:56:37.365 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99a5aac1:::benchmark_data_smithi188_161190_object40612:head# 2024-04-01T19:56:37.366 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99a6320d:::benchmark_data_smithi188_161190_object79312:head# 2024-04-01T19:56:37.366 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99a75ef7:::benchmark_data_smithi188_161190_object31132:head# 2024-04-01T19:56:37.367 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99a7eec0:::benchmark_data_smithi188_161190_object92798:head# 2024-04-01T19:56:37.367 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99a81766:::benchmark_data_smithi188_161190_object98607:head# 2024-04-01T19:56:37.368 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99a8d50b:::benchmark_data_smithi188_161190_object88879:head# 2024-04-01T19:56:37.368 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99a8d7a9:::benchmark_data_smithi188_161190_object45465:head# 2024-04-01T19:56:37.368 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99a96177:::benchmark_data_smithi188_161190_object29548:head# 2024-04-01T19:56:37.369 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99a9e34f:::benchmark_data_smithi188_161190_object40063:head# 2024-04-01T19:56:37.369 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99aa13ac:::benchmark_data_smithi188_161190_object101779:head# 2024-04-01T19:56:37.370 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99aa767e:::benchmark_data_smithi188_161190_object123514:head# 2024-04-01T19:56:37.370 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99aa7a6c:::benchmark_data_smithi188_161190_object92714:head# 2024-04-01T19:56:37.371 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99aaa280:::benchmark_data_smithi188_161190_object20592:head# 2024-04-01T19:56:37.371 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99ab5ff3:::benchmark_data_smithi188_161190_object127314:head# 2024-04-01T19:56:37.371 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99ab7c71:::benchmark_data_smithi188_161190_object78416:head# 2024-04-01T19:56:37.372 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99ad030f:::benchmark_data_smithi188_161190_object74363:head# 2024-04-01T19:56:37.372 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99adba4e:::benchmark_data_smithi188_161190_object41483:head# 2024-04-01T19:56:37.372 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99aeec5a:::benchmark_data_smithi188_161190_object55172:head# 2024-04-01T19:56:37.373 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99af8ebd:::benchmark_data_smithi188_161190_object126009:head# 2024-04-01T19:56:37.373 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99b19a7b:::benchmark_data_smithi188_161190_object20585:head# 2024-04-01T19:56:37.374 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99b211f5:::benchmark_data_smithi188_161190_object26854:head# 2024-04-01T19:56:37.374 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99b219ea:::benchmark_data_smithi188_161190_object116816:head# 2024-04-01T19:56:37.375 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99b34850:::benchmark_data_smithi188_161190_object113900:head# 2024-04-01T19:56:37.375 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99b3f37d:::benchmark_data_smithi188_161190_object32195:head# 2024-04-01T19:56:37.375 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99b44495:::benchmark_data_smithi188_161190_object118824:head# 2024-04-01T19:56:37.376 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99b4a256:::benchmark_data_smithi188_161190_object124068:head# 2024-04-01T19:56:37.376 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99b5ac15:::benchmark_data_smithi188_161190_object66683:head# 2024-04-01T19:56:37.377 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99b67e42:::benchmark_data_smithi188_161190_object107893:head# 2024-04-01T19:56:37.377 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99b6bee8:::benchmark_data_smithi188_161190_object126202:head# 2024-04-01T19:56:37.378 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99b6f0c0:::benchmark_data_smithi188_161190_object42209:head# 2024-04-01T19:56:37.379 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99b72e9c:::benchmark_data_smithi188_161190_object89402:head# 2024-04-01T19:56:37.379 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99b781c0:::benchmark_data_smithi188_161190_object38923:head# 2024-04-01T19:56:37.384 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99b79721:::benchmark_data_smithi188_161190_object28043:head# 2024-04-01T19:56:37.384 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99b8156d:::benchmark_data_smithi188_161190_object89948:head# 2024-04-01T19:56:37.384 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99b9685f:::benchmark_data_smithi188_161190_object72841:head# 2024-04-01T19:56:37.384 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99b976be:::benchmark_data_smithi188_161190_object55061:head# 2024-04-01T19:56:37.384 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99ba0540:::benchmark_data_smithi188_161190_object96013:head# 2024-04-01T19:56:37.385 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99ba6841:::benchmark_data_smithi188_161190_object65378:head# 2024-04-01T19:56:37.385 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99ba7513:::benchmark_data_smithi188_161190_object90041:head# 2024-04-01T19:56:37.385 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99bce8ce:::benchmark_data_smithi188_161190_object133975:head# 2024-04-01T19:56:37.386 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99bd3132:::benchmark_data_smithi188_161190_object101346:head# 2024-04-01T19:56:37.387 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99bd5aa5:::benchmark_data_smithi188_161190_object113114:head# 2024-04-01T19:56:37.387 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99bd6d58:::benchmark_data_smithi188_161190_object97523:head# 2024-04-01T19:56:37.388 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99be32f6:::benchmark_data_smithi188_161190_object48281:head# 2024-04-01T19:56:37.388 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99be6b9b:::benchmark_data_smithi188_161190_object113782:head# 2024-04-01T19:56:37.388 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99bea185:::benchmark_data_smithi188_161190_object25315:head# 2024-04-01T19:56:37.389 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99bfd882:::benchmark_data_smithi188_161190_object87128:head# 2024-04-01T19:56:37.389 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99c0be74:::benchmark_data_smithi188_161190_object31344:head# 2024-04-01T19:56:37.390 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99c0eece:::benchmark_data_smithi188_161190_object104864:head# 2024-04-01T19:56:37.392 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99c11f33:::benchmark_data_smithi188_161190_object23873:head# 2024-04-01T19:56:37.402 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99c1779f:::benchmark_data_smithi188_161190_object87365:head# 2024-04-01T19:56:37.407 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99c2528b:::benchmark_data_smithi188_161190_object104213:head# 2024-04-01T19:56:37.407 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99c29409:::benchmark_data_smithi188_161190_object117394:head# 2024-04-01T19:56:37.408 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99c2a791:::benchmark_data_smithi188_161190_object83222:head# 2024-04-01T19:56:37.408 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99c321dd:::benchmark_data_smithi188_161190_object25550:head# 2024-04-01T19:56:37.408 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99c35af5:::benchmark_data_smithi188_161190_object126156:head# 2024-04-01T19:56:37.408 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99c3bdee:::benchmark_data_smithi188_161190_object115053:head# 2024-04-01T19:56:37.408 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99c41193:::benchmark_data_smithi188_161190_object42644:head# 2024-04-01T19:56:37.408 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99c49b14:::benchmark_data_smithi188_161190_object76705:head# 2024-04-01T19:56:37.408 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99c4bc6e:::benchmark_data_smithi188_161190_object44256:head# 2024-04-01T19:56:37.408 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99c748ad:::benchmark_data_smithi188_161190_object79521:head# 2024-04-01T19:56:37.409 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99c7ade1:::benchmark_data_smithi188_161190_object75197:head# 2024-04-01T19:56:37.409 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99c809e8:::benchmark_data_smithi188_161190_object133865:head# 2024-04-01T19:56:37.409 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99c86789:::benchmark_data_smithi188_161190_object33516:head# 2024-04-01T19:56:37.409 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99c96939:::benchmark_data_smithi188_161190_object84215:head# 2024-04-01T19:56:37.410 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99c98a71:::benchmark_data_smithi188_161190_object81021:head# 2024-04-01T19:56:37.410 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99ca737a:::benchmark_data_smithi188_161190_object70951:head# 2024-04-01T19:56:37.413 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99cae92a:::benchmark_data_smithi188_161190_object90740:head# 2024-04-01T19:56:37.413 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99cb521f:::benchmark_data_smithi188_161190_object82313:head# 2024-04-01T19:56:37.413 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99cb9098:::benchmark_data_smithi188_161190_object67614:head# 2024-04-01T19:56:37.417 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99cc1782:::benchmark_data_smithi188_161190_object126868:head# 2024-04-01T19:56:37.417 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99cc8a43:::benchmark_data_smithi188_161190_object124557:head# 2024-04-01T19:56:37.417 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99cd220d:::benchmark_data_smithi188_161190_object81163:head# 2024-04-01T19:56:37.417 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99cd2dad:::benchmark_data_smithi188_161190_object94376:head# 2024-04-01T19:56:37.417 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99cdd63b:::benchmark_data_smithi188_161190_object87804:head# 2024-04-01T19:56:37.417 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99ce3cd0:::benchmark_data_smithi188_161190_object100633:head# 2024-04-01T19:56:37.417 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99ce4122:::benchmark_data_smithi188_161190_object78334:head# 2024-04-01T19:56:37.418 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99cee20c:::benchmark_data_smithi188_161190_object98738:head# 2024-04-01T19:56:37.418 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99cf9304:::benchmark_data_smithi188_161190_object126015:head# 2024-04-01T19:56:37.418 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99cfb952:::benchmark_data_smithi188_161190_object41811:head# 2024-04-01T19:56:37.419 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99d0decf:::benchmark_data_smithi188_161190_object130361:head# 2024-04-01T19:56:37.420 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99d11773:::benchmark_data_smithi188_161190_object50791:head# 2024-04-01T19:56:37.420 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99d1cd98:::benchmark_data_smithi188_161190_object92592:head# 2024-04-01T19:56:37.420 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99d1ed2a:::benchmark_data_smithi188_161190_object67772:head# 2024-04-01T19:56:37.420 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99d27e00:::benchmark_data_smithi188_161190_object56006:head# 2024-04-01T19:56:37.421 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99d3b2cc:::benchmark_data_smithi188_161190_object61225:head# 2024-04-01T19:56:37.421 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99d47890:::benchmark_data_smithi188_161190_object62293:head# 2024-04-01T19:56:37.421 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99d4d938:::benchmark_data_smithi188_161190_object133466:head# 2024-04-01T19:56:37.422 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99d51113:::benchmark_data_smithi188_161190_object132970:head# 2024-04-01T19:56:37.422 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99d602f7:::benchmark_data_smithi188_161190_object49311:head# 2024-04-01T19:56:37.424 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99d60c09:::benchmark_data_smithi188_161190_object71870:head# 2024-04-01T19:56:37.427 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99d6d33f:::benchmark_data_smithi188_161190_object115407:head# 2024-04-01T19:56:37.432 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99d6ddd6:::benchmark_data_smithi188_161190_object58341:head# 2024-04-01T19:56:37.432 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99d6ebad:::benchmark_data_smithi188_161190_object65908:head# 2024-04-01T19:56:37.433 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99d7bea1:::benchmark_data_smithi188_161190_object79366:head# 2024-04-01T19:56:37.433 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99d7dbe8:::benchmark_data_smithi188_161190_object64272:head# 2024-04-01T19:56:37.434 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99d869f6:::benchmark_data_smithi188_161190_object114331:head# 2024-04-01T19:56:37.434 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99d89002:::benchmark_data_smithi188_161190_object99427:head# 2024-04-01T19:56:37.434 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99d903ec:::benchmark_data_smithi188_161190_object92346:head# 2024-04-01T19:56:37.435 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99daa923:::benchmark_data_smithi188_161190_object73610:head# 2024-04-01T19:56:37.435 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99dbbbb6:::benchmark_data_smithi188_161190_object66818:head# 2024-04-01T19:56:37.436 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99dbe598:::benchmark_data_smithi188_161190_object102421:head# 2024-04-01T19:56:37.436 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99dcccff:::benchmark_data_smithi188_161190_object107684:head# 2024-04-01T19:56:37.437 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99dcdc10:::benchmark_data_smithi188_161190_object113332:head# 2024-04-01T19:56:37.437 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99dcf678:::benchmark_data_smithi188_161190_object123292:head# 2024-04-01T19:56:37.438 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99dd1e8f:::benchmark_data_smithi188_161190_object35445:head# 2024-04-01T19:56:37.438 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99dd2988:::benchmark_data_smithi188_161190_object42505:head# 2024-04-01T19:56:37.438 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99dd51f2:::benchmark_data_smithi188_161190_object87327:head# 2024-04-01T19:56:37.439 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99dd8095:::benchmark_data_smithi188_161190_object45374:head# 2024-04-01T19:56:37.439 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99ded8cd:::benchmark_data_smithi188_161190_object42736:head# 2024-04-01T19:56:37.439 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99df7d84:::benchmark_data_smithi188_161190_object35969:head# 2024-04-01T19:56:37.440 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99dfeeff:::benchmark_data_smithi188_161190_object128505:head# 2024-04-01T19:56:37.440 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99e0ac3f:::benchmark_data_smithi188_161190_object42793:head# 2024-04-01T19:56:37.441 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99e1adc0:::benchmark_data_smithi188_161190_object61529:head# 2024-04-01T19:56:37.441 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99e2418f:::benchmark_data_smithi188_161190_object45119:head# 2024-04-01T19:56:37.442 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99e25b8d:::benchmark_data_smithi188_161190_object65002:head# 2024-04-01T19:56:37.442 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99e26509:::benchmark_data_smithi188_161190_object52130:head# 2024-04-01T19:56:37.442 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99e26e26:::benchmark_data_smithi188_161190_object132319:head# 2024-04-01T19:56:37.448 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99e286b7:::benchmark_data_smithi188_161190_object54644:head# 2024-04-01T19:56:37.449 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99e2c1b8:::benchmark_data_smithi188_161190_object63014:head# 2024-04-01T19:56:37.449 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99e3efa7:::benchmark_data_smithi188_161190_object98740:head# 2024-04-01T19:56:37.449 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99e474b5:::benchmark_data_smithi188_161190_object124270:head# 2024-04-01T19:56:37.449 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99e47ae0:::benchmark_data_smithi188_161190_object134032:head# 2024-04-01T19:56:37.449 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99e547df:::benchmark_data_smithi188_161190_object120523:head# 2024-04-01T19:56:37.449 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99e63ef7:::benchmark_data_smithi188_161190_object117953:head# 2024-04-01T19:56:37.449 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99e6a462:::benchmark_data_smithi188_161190_object53536:head# 2024-04-01T19:56:37.449 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99e6b905:::benchmark_data_smithi188_161190_object73741:head# 2024-04-01T19:56:37.449 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99e77b1e:::benchmark_data_smithi188_161190_object131546:head# 2024-04-01T19:56:37.450 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99e824fd:::benchmark_data_smithi188_161190_object52809:head# 2024-04-01T19:56:37.451 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99e8c391:::benchmark_data_smithi188_161190_object54536:head# 2024-04-01T19:56:37.452 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99e8d940:::benchmark_data_smithi188_161190_object42704:head# 2024-04-01T19:56:37.452 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99e91435:::benchmark_data_smithi188_161190_object69735:head# 2024-04-01T19:56:37.453 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99e9f80a:::benchmark_data_smithi188_161190_object53471:head# 2024-04-01T19:56:37.453 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99ea92de:::benchmark_data_smithi188_161190_object80490:head# 2024-04-01T19:56:37.454 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99eb370c:::benchmark_data_smithi188_161190_object53227:head# 2024-04-01T19:56:37.454 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99eb6544:::benchmark_data_smithi188_161190_object25824:head# 2024-04-01T19:56:37.454 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99ec0326:::benchmark_data_smithi188_161190_object138969:head# 2024-04-01T19:56:37.455 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99ec6406:::benchmark_data_smithi188_161190_object74289:head# 2024-04-01T19:56:37.455 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99ed2701:::benchmark_data_smithi188_161190_object123873:head# 2024-04-01T19:56:37.456 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99ed8577:::benchmark_data_smithi188_161190_object56377:head# 2024-04-01T19:56:37.456 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99edb246:::benchmark_data_smithi188_161190_object90328:head# 2024-04-01T19:56:37.457 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99edcb36:::benchmark_data_smithi188_161190_object28358:head# 2024-04-01T19:56:37.457 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99ee518a:::benchmark_data_smithi188_161190_object115493:head# 2024-04-01T19:56:37.461 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99ee5d36:::benchmark_data_smithi188_161190_object91336:head# 2024-04-01T19:56:37.461 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99ee9bd7:::benchmark_data_smithi188_161190_object95159:head# 2024-04-01T19:56:37.462 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99efea25:::benchmark_data_smithi188_161190_object40859:head# 2024-04-01T19:56:37.462 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99f0deb5:::benchmark_data_smithi188_161190_object95979:head# 2024-04-01T19:56:37.463 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99f14664:::benchmark_data_smithi188_161190_object135731:head# 2024-04-01T19:56:37.463 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99f16926:::benchmark_data_smithi188_161190_object49379:head# 2024-04-01T19:56:37.464 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99f19691:::benchmark_data_smithi188_161190_object112209:head# 2024-04-01T19:56:37.464 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99f263e0:::benchmark_data_smithi188_161190_object60604:head# 2024-04-01T19:56:37.465 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99f28925:::benchmark_data_smithi188_161190_object24821:head# 2024-04-01T19:56:37.465 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99f2c78a:::benchmark_data_smithi188_161190_object83051:head# 2024-04-01T19:56:37.465 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99f2de4c:::benchmark_data_smithi188_161190_object50589:head# 2024-04-01T19:56:37.466 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99f34985:::benchmark_data_smithi188_161190_object101042:head# 2024-04-01T19:56:37.466 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99f35ae4:::benchmark_data_smithi188_161190_object121251:head# 2024-04-01T19:56:37.467 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99f376e7:::benchmark_data_smithi188_161190_object76486:head# 2024-04-01T19:56:37.467 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99f3f21c:::benchmark_data_smithi188_161190_object34810:head# 2024-04-01T19:56:37.468 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99f47c3a:::benchmark_data_smithi188_161190_object126209:head# 2024-04-01T19:56:37.468 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99f53510:::benchmark_data_smithi188_161190_object47682:head# 2024-04-01T19:56:37.468 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99f7ec40:::benchmark_data_smithi188_161190_object89394:head# 2024-04-01T19:56:37.469 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99f88d77:::benchmark_data_smithi188_161190_object86613:head# 2024-04-01T19:56:37.469 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99f8ae2c:::benchmark_data_smithi188_161190_object28063:head# 2024-04-01T19:56:37.469 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99f8bf01:::benchmark_data_smithi188_161190_object21208:head# 2024-04-01T19:56:37.470 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99fa2728:::benchmark_data_smithi188_161190_object127359:head# 2024-04-01T19:56:37.470 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99facda5:::benchmark_data_smithi188_161190_object45485:head# 2024-04-01T19:56:37.471 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99fad29c:::benchmark_data_smithi188_161190_object72650:head# 2024-04-01T19:56:37.471 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99fba68d:::benchmark_data_smithi188_161190_object40918:head# 2024-04-01T19:56:37.472 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99fc090c:::benchmark_data_smithi188_161190_object50699:head# 2024-04-01T19:56:37.472 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99fc151c:::benchmark_data_smithi188_161190_object106187:head# 2024-04-01T19:56:37.473 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99fd1fd3:::benchmark_data_smithi188_161190_object108548:head# 2024-04-01T19:56:37.475 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99fd4cd4:::benchmark_data_smithi188_161190_object77653:head# 2024-04-01T19:56:37.475 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99fd98be:::benchmark_data_smithi188_161190_object31878:head# 2024-04-01T19:56:37.475 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99fe9918:::benchmark_data_smithi188_161190_object35023:head# 2024-04-01T19:56:37.476 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99fee0ed:::benchmark_data_smithi188_161190_object82368:head# 2024-04-01T19:56:37.476 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99ff13c4:::benchmark_data_smithi188_161190_object70372:head# 2024-04-01T19:56:37.477 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:99ffb567:::benchmark_data_smithi188_161190_object97254:head# 2024-04-01T19:56:37.477 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a00e6a7:::benchmark_data_smithi188_161190_object86952:head# 2024-04-01T19:56:37.478 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a011055:::benchmark_data_smithi188_161190_object105994:head# 2024-04-01T19:56:37.478 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a017309:::benchmark_data_smithi188_161190_object21741:head# 2024-04-01T19:56:37.479 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a02fe23:::benchmark_data_smithi188_161190_object45753:head# 2024-04-01T19:56:37.479 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a03dc5b:::benchmark_data_smithi188_161190_object19934:head# 2024-04-01T19:56:37.481 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a04d19f:::benchmark_data_smithi188_161190_object119750:head# 2024-04-01T19:56:37.484 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a04f3a1:::benchmark_data_smithi188_161190_object108792:head# 2024-04-01T19:56:37.485 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a05457f:::benchmark_data_smithi188_161190_object90063:head# 2024-04-01T19:56:37.486 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a05f309:::benchmark_data_smithi188_161190_object116316:head# 2024-04-01T19:56:37.486 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a07c0ea:::benchmark_data_smithi188_161190_object119395:head# 2024-04-01T19:56:37.487 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a0b14cd:::benchmark_data_smithi188_161190_object72726:head# 2024-04-01T19:56:37.487 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a0cd0e1:::benchmark_data_smithi188_161190_object130283:head# 2024-04-01T19:56:37.488 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a0cfa98:::benchmark_data_smithi188_161190_object99788:head# 2024-04-01T19:56:37.488 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a0d1991:::benchmark_data_smithi188_161190_object83282:head# 2024-04-01T19:56:37.489 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a0d4af1:::benchmark_data_smithi188_161190_object35771:head# 2024-04-01T19:56:37.489 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a0dc2e7:::benchmark_data_smithi188_161190_object28594:head# 2024-04-01T19:56:37.490 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a0dda0a:::benchmark_data_smithi188_161190_object99787:head# 2024-04-01T19:56:37.490 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a0dfd94:::benchmark_data_smithi188_161190_object135407:head# 2024-04-01T19:56:37.490 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a0e66fa:::benchmark_data_smithi188_161190_object60978:head# 2024-04-01T19:56:37.491 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a0f0b2e:::benchmark_data_smithi188_161190_object137661:head# 2024-04-01T19:56:37.492 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a102448:::benchmark_data_smithi188_161190_object47868:head# 2024-04-01T19:56:37.492 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a10297c:::benchmark_data_smithi188_161190_object138582:head# 2024-04-01T19:56:37.492 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a1099e2:::benchmark_data_smithi188_161190_object101331:head# 2024-04-01T19:56:37.493 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a118457:::benchmark_data_smithi188_161190_object86216:head# 2024-04-01T19:56:37.493 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a118849:::benchmark_data_smithi188_161190_object44094:head# 2024-04-01T19:56:37.494 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a11af92:::benchmark_data_smithi188_161190_object88249:head# 2024-04-01T19:56:37.497 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a12095d:::benchmark_data_smithi188_161190_object137680:head# 2024-04-01T19:56:37.497 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a121687:::benchmark_data_smithi188_161190_object61184:head# 2024-04-01T19:56:37.497 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a12bc24:::benchmark_data_smithi188_161190_object137667:head# 2024-04-01T19:56:37.499 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a1380e7:::benchmark_data_smithi188_161190_object83223:head# 2024-04-01T19:56:37.501 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a13fbdd:::benchmark_data_smithi188_161190_object28996:head# 2024-04-01T19:56:37.502 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a144f7f:::benchmark_data_smithi188_161190_object75103:head# 2024-04-01T19:56:37.503 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a14ef17:::benchmark_data_smithi188_161190_object29348:head# 2024-04-01T19:56:37.503 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a1579e8:::benchmark_data_smithi188_161190_object110005:head# 2024-04-01T19:56:37.503 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a162449:::benchmark_data_smithi188_161190_object43830:head# 2024-04-01T19:56:37.504 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a163616:::benchmark_data_smithi188_161190_object58807:head# 2024-04-01T19:56:37.504 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a163ea4:::benchmark_data_smithi188_161190_object131083:head# 2024-04-01T19:56:37.505 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a169c75:::benchmark_data_smithi188_161190_object53711:head# 2024-04-01T19:56:37.505 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a186106:::benchmark_data_smithi188_161190_object106240:head# 2024-04-01T19:56:37.506 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a189f6f:::benchmark_data_smithi188_161190_object76542:head# 2024-04-01T19:56:37.506 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a190d5b:::benchmark_data_smithi188_161190_object133749:head# 2024-04-01T19:56:37.506 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a196d41:::benchmark_data_smithi188_161190_object27169:head# 2024-04-01T19:56:37.507 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a19a23a:::benchmark_data_smithi188_161190_object131114:head# 2024-04-01T19:56:37.507 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a1a051e:::benchmark_data_smithi188_161190_object112393:head# 2024-04-01T19:56:37.508 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a1a671e:::benchmark_data_smithi188_161190_object40022:head# 2024-04-01T19:56:37.508 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a1b4a1a:::benchmark_data_smithi188_161190_object92850:head# 2024-04-01T19:56:37.509 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a1b5b41:::benchmark_data_smithi188_161190_object82477:head# 2024-04-01T19:56:37.509 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a1bbf84:::benchmark_data_smithi188_161190_object48749:head# 2024-04-01T19:56:37.509 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a1c76f6:::benchmark_data_smithi188_161190_object36446:head# 2024-04-01T19:56:37.510 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a1e754f:::benchmark_data_smithi188_161190_object76756:head# 2024-04-01T19:56:37.510 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a1f2e3c:::benchmark_data_smithi188_161190_object130684:head# 2024-04-01T19:56:37.512 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a1fd9cc:::benchmark_data_smithi188_161190_object21340:head# 2024-04-01T19:56:37.512 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a201144:::benchmark_data_smithi188_161190_object116849:head# 2024-04-01T19:56:37.512 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a20794e:::benchmark_data_smithi188_161190_object137561:head# 2024-04-01T19:56:37.513 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a217af3:::benchmark_data_smithi188_161190_object94285:head# 2024-04-01T19:56:37.513 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a2256d7:::benchmark_data_smithi188_161190_object115081:head# 2024-04-01T19:56:37.513 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a2293f9:::benchmark_data_smithi188_161190_object124129:head# 2024-04-01T19:56:37.513 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a23895c:::benchmark_data_smithi188_161190_object70781:head# 2024-04-01T19:56:37.518 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a24b74e:::benchmark_data_smithi188_161190_object42304:head# 2024-04-01T19:56:37.518 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a25660c:::benchmark_data_smithi188_161190_object78197:head# 2024-04-01T19:56:37.518 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a270adf:::benchmark_data_smithi188_161190_object130265:head# 2024-04-01T19:56:37.518 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a27f2c0:::benchmark_data_smithi188_161190_object76708:head# 2024-04-01T19:56:37.518 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a283671:::benchmark_data_smithi188_161190_object113598:head# 2024-04-01T19:56:37.519 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a290f27:::benchmark_data_smithi188_161190_object92985:head# 2024-04-01T19:56:37.519 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a291ee7:::benchmark_data_smithi188_161190_object67298:head# 2024-04-01T19:56:37.519 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a29ae33:::benchmark_data_smithi188_161190_object128462:head# 2024-04-01T19:56:37.520 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a2abb43:::benchmark_data_smithi188_161190_object109963:head# 2024-04-01T19:56:37.520 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a2b2683:::benchmark_data_smithi188_161190_object79299:head# 2024-04-01T19:56:37.520 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a2ba261:::benchmark_data_smithi188_161190_object113189:head# 2024-04-01T19:56:37.521 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a2be548:::benchmark_data_smithi188_161190_object106102:head# 2024-04-01T19:56:37.521 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a2c4de8:::benchmark_data_smithi188_161190_object136427:head# 2024-04-01T19:56:37.522 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a2ca4c6:::benchmark_data_smithi188_161190_object88447:head# 2024-04-01T19:56:37.522 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a2ca648:::benchmark_data_smithi188_161190_object70684:head# 2024-04-01T19:56:37.522 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a2de5a9:::benchmark_data_smithi188_161190_object49986:head# 2024-04-01T19:56:37.523 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a2e7e2a:::benchmark_data_smithi188_161190_object134625:head# 2024-04-01T19:56:37.523 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a2f1998:::benchmark_data_smithi188_161190_object123965:head# 2024-04-01T19:56:37.524 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a30c22e:::benchmark_data_smithi188_161190_object50504:head# 2024-04-01T19:56:37.524 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a30e5bd:::benchmark_data_smithi188_161190_object125725:head# 2024-04-01T19:56:37.524 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a30f0da:::benchmark_data_smithi188_161190_object112154:head# 2024-04-01T19:56:37.525 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a3145aa:::benchmark_data_smithi188_161190_object113471:head# 2024-04-01T19:56:37.525 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a31fca8:::benchmark_data_smithi188_161190_object116130:head# 2024-04-01T19:56:37.526 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a33e322:::benchmark_data_smithi188_161190_object56843:head# 2024-04-01T19:56:37.526 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a340184:::benchmark_data_smithi188_161190_object114132:head# 2024-04-01T19:56:37.526 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a348b3d:::benchmark_data_smithi188_161190_object29225:head# 2024-04-01T19:56:37.527 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a353727:::benchmark_data_smithi188_161190_object48072:head# 2024-04-01T19:56:37.528 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a357480:::benchmark_data_smithi188_161190_object81558:head# 2024-04-01T19:56:37.528 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a364d5e:::benchmark_data_smithi188_161190_object54774:head# 2024-04-01T19:56:37.528 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a365a12:::benchmark_data_smithi188_161190_object128663:head# 2024-04-01T19:56:37.533 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a375849:::benchmark_data_smithi188_161190_object63290:head# 2024-04-01T19:56:37.533 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a378bfd:::benchmark_data_smithi188_161190_object116279:head# 2024-04-01T19:56:37.533 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a37ec1e:::benchmark_data_smithi188_161190_object49088:head# 2024-04-01T19:56:37.534 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a38c6d8:::benchmark_data_smithi188_161190_object36165:head# 2024-04-01T19:56:37.534 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a38d52e:::benchmark_data_smithi188_161190_object27809:head# 2024-04-01T19:56:37.534 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a3910fb:::benchmark_data_smithi188_161190_object38322:head# 2024-04-01T19:56:37.534 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a39a85c:::benchmark_data_smithi188_161190_object106947:head# 2024-04-01T19:56:37.534 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a39fb6d:::benchmark_data_smithi188_161190_object36119:head# 2024-04-01T19:56:37.534 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a3a9fdb:::benchmark_data_smithi188_161190_object40126:head# 2024-04-01T19:56:37.538 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a3aa368:::benchmark_data_smithi188_161190_object56594:head# 2024-04-01T19:56:37.538 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a3ba298:::benchmark_data_smithi188_161190_object23398:head# 2024-04-01T19:56:37.538 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a3c9196:::benchmark_data_smithi188_161190_object21497:head# 2024-04-01T19:56:37.539 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a3e2904:::benchmark_data_smithi188_161190_object40250:head# 2024-04-01T19:56:37.542 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a3efa88:::benchmark_data_smithi188_161190_object109315:head# 2024-04-01T19:56:37.542 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a3ff541:::benchmark_data_smithi188_161190_object103126:head# 2024-04-01T19:56:37.543 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a405a28:::benchmark_data_smithi188_161190_object114159:head# 2024-04-01T19:56:37.543 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a40fac5:::benchmark_data_smithi188_161190_object81472:head# 2024-04-01T19:56:37.544 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a41061e:::benchmark_data_smithi188_161190_object85127:head# 2024-04-01T19:56:37.545 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a4108ea:::benchmark_data_smithi188_161190_object76584:head# 2024-04-01T19:56:37.545 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a4156e1:::benchmark_data_smithi188_161190_object115856:head# 2024-04-01T19:56:37.546 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a4181ef:::benchmark_data_smithi188_161190_object90039:head# 2024-04-01T19:56:37.546 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a425d5f:::benchmark_data_smithi188_161190_object137914:head# 2024-04-01T19:56:37.546 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a42cc0f:::benchmark_data_smithi188_161190_object36586:head# 2024-04-01T19:56:37.547 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a42ed2f:::benchmark_data_smithi188_161190_object124743:head# 2024-04-01T19:56:37.547 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a43f0c6:::benchmark_data_smithi188_161190_object113661:head# 2024-04-01T19:56:37.548 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a453121:::benchmark_data_smithi188_161190_object119323:head# 2024-04-01T19:56:37.548 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a4608f3:::benchmark_data_smithi188_161190_object41196:head# 2024-04-01T19:56:37.549 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a469427:::benchmark_data_smithi188_161190_object41469:head# 2024-04-01T19:56:37.549 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a47d6f8:::benchmark_data_smithi188_161190_object81410:head# 2024-04-01T19:56:37.549 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a47f992:::benchmark_data_smithi188_161190_object35661:head# 2024-04-01T19:56:37.550 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a489e40:::benchmark_data_smithi188_161190_object77482:head# 2024-04-01T19:56:37.553 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a48d72f:::benchmark_data_smithi188_161190_object100488:head# 2024-04-01T19:56:37.553 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a49b50d:::benchmark_data_smithi188_161190_object29443:head# 2024-04-01T19:56:37.554 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a49bcfd:::benchmark_data_smithi188_161190_object73030:head# 2024-04-01T19:56:37.554 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a49d4cb:::benchmark_data_smithi188_161190_object80861:head# 2024-04-01T19:56:37.555 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a4a6cc6:::benchmark_data_smithi188_161190_object41854:head# 2024-04-01T19:56:37.560 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a4ad0f2:::benchmark_data_smithi188_161190_object72366:head# 2024-04-01T19:56:37.560 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a4af919:::benchmark_data_smithi188_161190_object39276:head# 2024-04-01T19:56:37.560 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a4b994d:::benchmark_data_smithi188_161190_object92855:head# 2024-04-01T19:56:37.560 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a4bdef2:::benchmark_data_smithi188_161190_object30268:head# 2024-04-01T19:56:37.560 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a4bf534:::benchmark_data_smithi188_161190_object54711:head# 2024-04-01T19:56:37.560 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a4db7fe:::benchmark_data_smithi188_161190_object131548:head# 2024-04-01T19:56:37.561 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a4e95f6:::benchmark_data_smithi188_161190_object104050:head# 2024-04-01T19:56:37.561 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a4ebe8a:::benchmark_data_smithi188_161190_object20597:head# 2024-04-01T19:56:37.561 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a4ed3eb:::benchmark_data_smithi188_161190_object79019:head# 2024-04-01T19:56:37.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a4f7d19:::benchmark_data_smithi188_161190_object135727:head# 2024-04-01T19:56:37.564 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a4fc223:::benchmark_data_smithi188_161190_object71831:head# 2024-04-01T19:56:37.565 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a5020f4:::benchmark_data_smithi188_161190_object96950:head# 2024-04-01T19:56:37.565 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a50c4cb:::benchmark_data_smithi188_161190_object101291:head# 2024-04-01T19:56:37.566 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a514ee0:::benchmark_data_smithi188_161190_object60504:head# 2024-04-01T19:56:37.566 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a521209:::benchmark_data_smithi188_161190_object38156:head# 2024-04-01T19:56:37.567 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a521971:::benchmark_data_smithi188_161190_object33078:head# 2024-04-01T19:56:37.567 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a522afa:::benchmark_data_smithi188_161190_object93500:head# 2024-04-01T19:56:37.567 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a54076c:::benchmark_data_smithi188_161190_object49957:head# 2024-04-01T19:56:37.568 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a541eb4:::benchmark_data_smithi188_161190_object66531:head# 2024-04-01T19:56:37.568 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a54c80a:::benchmark_data_smithi188_161190_object37729:head# 2024-04-01T19:56:37.569 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a552d4a:::benchmark_data_smithi188_161190_object41265:head# 2024-04-01T19:56:37.569 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a5532b9:::benchmark_data_smithi188_161190_object103041:head# 2024-04-01T19:56:37.570 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a555c8d:::benchmark_data_smithi188_161190_object131545:head# 2024-04-01T19:56:37.570 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a557e20:::benchmark_data_smithi188_161190_object38953:head# 2024-04-01T19:56:37.571 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a55b4c1:::benchmark_data_smithi188_161190_object84385:head# 2024-04-01T19:56:37.571 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a55b86c:::benchmark_data_smithi188_161190_object85990:head# 2024-04-01T19:56:37.571 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a55bb51:::benchmark_data_smithi188_161190_object29535:head# 2024-04-01T19:56:37.572 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a55f532:::benchmark_data_smithi188_161190_object37074:head# 2024-04-01T19:56:37.577 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a566155:::benchmark_data_smithi188_161190_object93162:head# 2024-04-01T19:56:37.577 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a574fba:::benchmark_data_smithi188_161190_object33246:head# 2024-04-01T19:56:37.577 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a578e14:::benchmark_data_smithi188_161190_object113288:head# 2024-04-01T19:56:37.577 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a582f5f:::benchmark_data_smithi188_161190_object89850:head# 2024-04-01T19:56:37.577 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a58435a:::benchmark_data_smithi188_161190_object68855:head# 2024-04-01T19:56:37.577 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a584f1d:::benchmark_data_smithi188_161190_object55721:head# 2024-04-01T19:56:37.577 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a5850de:::benchmark_data_smithi188_161190_object45692:head# 2024-04-01T19:56:37.577 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a5a5691:::benchmark_data_smithi188_161190_object75946:head# 2024-04-01T19:56:37.577 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a5c34ec:::benchmark_data_smithi188_161190_object71153:head# 2024-04-01T19:56:37.577 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a5c612a:::benchmark_data_smithi188_161190_object84858:head# 2024-04-01T19:56:37.577 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a5d1ea4:::benchmark_data_smithi188_161190_object74971:head# 2024-04-01T19:56:37.580 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a5d666f:::benchmark_data_smithi188_161190_object36321:head# 2024-04-01T19:56:37.581 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a5d9975:::benchmark_data_smithi188_161190_object96251:head# 2024-04-01T19:56:37.581 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a5dc38c:::benchmark_data_smithi188_161190_object138027:head# 2024-04-01T19:56:37.582 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a5ddfbd:::benchmark_data_smithi188_161190_object41529:head# 2024-04-01T19:56:37.582 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a5e714e:::benchmark_data_smithi188_161190_object114156:head# 2024-04-01T19:56:37.583 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a5f7211:::benchmark_data_smithi188_161190_object67416:head# 2024-04-01T19:56:37.583 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a602339:::benchmark_data_smithi188_161190_object138521:head# 2024-04-01T19:56:37.583 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a603512:::benchmark_data_smithi188_161190_object46901:head# 2024-04-01T19:56:37.584 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a60486d:::benchmark_data_smithi188_161190_object103196:head# 2024-04-01T19:56:37.584 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a6068ba:::benchmark_data_smithi188_161190_object73214:head# 2024-04-01T19:56:37.585 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a613aa8:::benchmark_data_smithi188_161190_object38527:head# 2024-04-01T19:56:37.585 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a6235fa:::benchmark_data_smithi188_161190_object135924:head# 2024-04-01T19:56:37.585 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a626183:::benchmark_data_smithi188_161190_object100912:head# 2024-04-01T19:56:37.586 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a62b260:::benchmark_data_smithi188_161190_object113454:head# 2024-04-01T19:56:37.586 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a62d3e4:::benchmark_data_smithi188_161190_object102360:head# 2024-04-01T19:56:37.587 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a62fa8f:::benchmark_data_smithi188_161190_object99111:head# 2024-04-01T19:56:37.587 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a6396dc:::benchmark_data_smithi188_161190_object66166:head# 2024-04-01T19:56:37.587 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a63d5d0:::benchmark_data_smithi188_161190_object84406:head# 2024-04-01T19:56:37.588 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a646a8d:::benchmark_data_smithi188_161190_object127776:head# 2024-04-01T19:56:37.588 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a64b1cf:::benchmark_data_smithi188_161190_object20960:head# 2024-04-01T19:56:37.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a652c2e:::benchmark_data_smithi188_161190_object123837:head# 2024-04-01T19:56:37.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a653edc:::benchmark_data_smithi188_161190_object99795:head# 2024-04-01T19:56:37.590 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a6561c2:::benchmark_data_smithi188_161190_object102849:head# 2024-04-01T19:56:37.590 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a6593cc:::benchmark_data_smithi188_161190_object63877:head# 2024-04-01T19:56:37.591 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a66f25b:::benchmark_data_smithi188_161190_object59655:head# 2024-04-01T19:56:37.591 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a6742c8:::benchmark_data_smithi188_161190_object102976:head# 2024-04-01T19:56:37.591 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a680e15:::benchmark_data_smithi188_161190_object58683:head# 2024-04-01T19:56:37.592 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a68a924:::benchmark_data_smithi188_161190_object77874:head# 2024-04-01T19:56:37.594 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a68d89f:::benchmark_data_smithi188_161190_object54216:head# 2024-04-01T19:56:37.594 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a69022d:::benchmark_data_smithi188_161190_object123255:head# 2024-04-01T19:56:37.594 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a6969ae:::benchmark_data_smithi188_161190_object86102:head# 2024-04-01T19:56:37.598 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a69ae03:::benchmark_data_smithi188_161190_object79805:head# 2024-04-01T19:56:37.598 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a6a1607:::benchmark_data_smithi188_161190_object111384:head# 2024-04-01T19:56:37.598 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a6a5327:::benchmark_data_smithi188_161190_object114601:head# 2024-04-01T19:56:37.598 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a6aab1d:::benchmark_data_smithi188_161190_object64148:head# 2024-04-01T19:56:37.598 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a6acaec:::benchmark_data_smithi188_161190_object57010:head# 2024-04-01T19:56:37.598 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a6ad0c8:::benchmark_data_smithi188_161190_object28322:head# 2024-04-01T19:56:37.599 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a6b56c0:::benchmark_data_smithi188_161190_object79163:head# 2024-04-01T19:56:37.599 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a6bea35:::benchmark_data_smithi188_161190_object125200:head# 2024-04-01T19:56:37.599 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a6bffae:::benchmark_data_smithi188_161190_object37851:head# 2024-04-01T19:56:37.599 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a6c0cc4:::benchmark_data_smithi188_161190_object126094:head# 2024-04-01T19:56:37.599 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a6c386d:::benchmark_data_smithi188_161190_object92111:head# 2024-04-01T19:56:37.599 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a6d5ca6:::benchmark_data_smithi188_161190_object35578:head# 2024-04-01T19:56:37.599 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a6dce03:::benchmark_data_smithi188_161190_object122807:head# 2024-04-01T19:56:37.600 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a6e44a1:::benchmark_data_smithi188_161190_object45329:head# 2024-04-01T19:56:37.600 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a6e59b5:::benchmark_data_smithi188_161190_object100366:head# 2024-04-01T19:56:37.600 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a6efeb4:::benchmark_data_smithi188_161190_object125757:head# 2024-04-01T19:56:37.601 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a6f9852:::benchmark_data_smithi188_161190_object52634:head# 2024-04-01T19:56:37.601 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a6fc08a:::benchmark_data_smithi188_161190_object68193:head# 2024-04-01T19:56:37.602 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a707c65:::benchmark_data_smithi188_161190_object92650:head# 2024-04-01T19:56:37.602 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a70cec6:::benchmark_data_smithi188_161190_object124960:head# 2024-04-01T19:56:37.603 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a70f221:::benchmark_data_smithi188_161190_object34364:head# 2024-04-01T19:56:37.603 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a70f76e:::benchmark_data_smithi188_161190_object127689:head# 2024-04-01T19:56:37.603 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a711c7a:::benchmark_data_smithi188_161190_object79651:head# 2024-04-01T19:56:37.604 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a717252:::benchmark_data_smithi188_161190_object34566:head# 2024-04-01T19:56:37.605 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a71ae58:::benchmark_data_smithi188_161190_object64378:head# 2024-04-01T19:56:37.606 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a73aaa8:::benchmark_data_smithi188_161190_object43397:head# 2024-04-01T19:56:37.607 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a73d3fb:::benchmark_data_smithi188_161190_object54612:head# 2024-04-01T19:56:37.607 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a7456a4:::benchmark_data_smithi188_161190_object110545:head# 2024-04-01T19:56:37.608 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a746e44:::benchmark_data_smithi188_161190_object28200:head# 2024-04-01T19:56:37.608 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a74d181:::benchmark_data_smithi188_161190_object37445:head# 2024-04-01T19:56:37.608 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a7593f2:::benchmark_data_smithi188_161190_object121852:head# 2024-04-01T19:56:37.609 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a7598e6:::benchmark_data_smithi188_161190_object90962:head# 2024-04-01T19:56:37.609 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a75b7e3:::benchmark_data_smithi188_161190_object67411:head# 2024-04-01T19:56:37.610 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a76da3c:::benchmark_data_smithi188_161190_object79696:head# 2024-04-01T19:56:37.610 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a783b7f:::benchmark_data_smithi188_161190_object60378:head# 2024-04-01T19:56:37.611 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a786ebb:::benchmark_data_smithi188_161190_object97064:head# 2024-04-01T19:56:37.616 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a793a51:::benchmark_data_smithi188_161190_object29143:head# 2024-04-01T19:56:37.616 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a7a02c2:::benchmark_data_smithi188_161190_object47882:head# 2024-04-01T19:56:37.616 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a7a6ed5:::benchmark_data_smithi188_161190_object123104:head# 2024-04-01T19:56:37.617 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a7a75b6:::benchmark_data_smithi188_161190_object130121:head# 2024-04-01T19:56:37.617 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a7a8d26:::benchmark_data_smithi188_161190_object115684:head# 2024-04-01T19:56:37.618 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a7aa7f4:::benchmark_data_smithi188_161190_object45494:head# 2024-04-01T19:56:37.618 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a7b235d:::benchmark_data_smithi188_161190_object95370:head# 2024-04-01T19:56:37.619 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a7b7b7d:::benchmark_data_smithi188_161190_object58966:head# 2024-04-01T19:56:37.619 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a7b82b5:::benchmark_data_smithi188_161190_object96990:head# 2024-04-01T19:56:37.620 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a7bec5f:::benchmark_data_smithi188_161190_object102344:head# 2024-04-01T19:56:37.620 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a7c4e05:::benchmark_data_smithi188_161190_object98158:head# 2024-04-01T19:56:37.620 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a7c9811:::benchmark_data_smithi188_161190_object138015:head# 2024-04-01T19:56:37.621 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a7d7c1c:::benchmark_data_smithi188_161190_object114717:head# 2024-04-01T19:56:37.621 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a7dede6:::benchmark_data_smithi188_161190_object37863:head# 2024-04-01T19:56:37.621 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a7e58a0:::benchmark_data_smithi188_161190_object116529:head# 2024-04-01T19:56:37.622 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a7f8347:::benchmark_data_smithi188_161190_object132361:head# 2024-04-01T19:56:37.622 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a7f83c2:::benchmark_data_smithi188_161190_object105315:head# 2024-04-01T19:56:37.623 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a7fde84:::benchmark_data_smithi188_161190_object72596:head# 2024-04-01T19:56:37.623 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a8040fb:::benchmark_data_smithi188_161190_object23709:head# 2024-04-01T19:56:37.623 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a809f12:::benchmark_data_smithi188_161190_object101512:head# 2024-04-01T19:56:37.624 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a81141b:::benchmark_data_smithi188_161190_object59026:head# 2024-04-01T19:56:37.624 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a81507a:::benchmark_data_smithi188_161190_object81032:head# 2024-04-01T19:56:37.625 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a82d5dd:::benchmark_data_smithi188_161190_object36624:head# 2024-04-01T19:56:37.630 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a82f82a:::benchmark_data_smithi188_161190_object23683:head# 2024-04-01T19:56:37.630 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a832b88:::benchmark_data_smithi188_161190_object76206:head# 2024-04-01T19:56:37.630 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a838a1b:::benchmark_data_smithi188_161190_object67512:head# 2024-04-01T19:56:37.630 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a83d84c:::benchmark_data_smithi188_161190_object132272:head# 2024-04-01T19:56:37.631 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a864128:::benchmark_data_smithi188_161190_object61735:head# 2024-04-01T19:56:37.631 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a86a929:::benchmark_data_smithi188_161190_object51254:head# 2024-04-01T19:56:37.631 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a880f23:::benchmark_data_smithi188_161190_object120742:head# 2024-04-01T19:56:37.631 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a8833c8:::benchmark_data_smithi188_161190_object108221:head# 2024-04-01T19:56:37.631 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a889aff:::benchmark_data_smithi188_161190_object102648:head# 2024-04-01T19:56:37.631 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a889c19:::benchmark_data_smithi188_161190_object79755:head# 2024-04-01T19:56:37.631 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a895a32:::benchmark_data_smithi188_161190_object80850:head# 2024-04-01T19:56:37.631 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:56:37.632 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a89e19b:::benchmark_data_smithi188_161190_object49678:head# 2024-04-01T19:56:37.632 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a8a009f:::benchmark_data_smithi188_161190_object79400:head# 2024-04-01T19:56:37.636 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:37.636 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:56:37.637 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a8b95ac:::benchmark_data_smithi188_161190_object124902:head# 2024-04-01T19:56:37.637 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a8c71e5:::benchmark_data_smithi188_161190_object30945:head# 2024-04-01T19:56:37.637 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a8ceee4:::benchmark_data_smithi188_161190_object95352:head# 2024-04-01T19:56:37.637 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a8d45ba:::benchmark_data_smithi188_161190_object21594:head# 2024-04-01T19:56:37.637 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a8e7cd0:::benchmark_data_smithi188_161190_object119301:head# 2024-04-01T19:56:37.638 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a8e9496:::benchmark_data_smithi188_161190_object84658:head# 2024-04-01T19:56:37.638 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a8f33ec:::benchmark_data_smithi188_161190_object47290:head# 2024-04-01T19:56:37.638 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a905ef5:::benchmark_data_smithi188_161190_object71990:head# 2024-04-01T19:56:37.638 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a909ab6:::benchmark_data_smithi188_161190_object67807:head# 2024-04-01T19:56:37.638 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a912739:::benchmark_data_smithi188_161190_object95309:head# 2024-04-01T19:56:37.638 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a9181e3:::benchmark_data_smithi188_161190_object65894:head# 2024-04-01T19:56:37.638 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a91c75b:::benchmark_data_smithi188_161190_object119223:head# 2024-04-01T19:56:37.638 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a933764:::benchmark_data_smithi188_161190_object132745:head# 2024-04-01T19:56:37.638 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a937bb6:::benchmark_data_smithi188_161190_object134340:head# 2024-04-01T19:56:37.639 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a948212:::benchmark_data_smithi188_161190_object64588:head# 2024-04-01T19:56:37.639 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a956375:::benchmark_data_smithi188_161190_object67085:head# 2024-04-01T19:56:37.643 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a957904:::benchmark_data_smithi188_161190_object76125:head# 2024-04-01T19:56:37.644 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a958392:::benchmark_data_smithi188_161190_object85699:head# 2024-04-01T19:56:37.644 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a96149d:::benchmark_data_smithi188_161190_object76283:head# 2024-04-01T19:56:37.644 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a96760f:::benchmark_data_smithi188_161190_object67370:head# 2024-04-01T19:56:37.644 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a9743a4:::benchmark_data_smithi188_161190_object87089:head# 2024-04-01T19:56:37.644 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a97cd0a:::benchmark_data_smithi188_161190_object110569:head# 2024-04-01T19:56:37.644 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a981f13:::benchmark_data_smithi188_161190_object53076:head# 2024-04-01T19:56:37.644 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a98b4bf:::benchmark_data_smithi188_161190_object77740:head# 2024-04-01T19:56:37.645 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a98e90b:::benchmark_data_smithi188_161190_object117830:head# 2024-04-01T19:56:37.645 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a98ebbe:::benchmark_data_smithi188_161190_object98364:head# 2024-04-01T19:56:37.645 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a998e7c:::benchmark_data_smithi188_161190_object48747:head# 2024-04-01T19:56:37.649 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a99a18c:::benchmark_data_smithi188_161190_object133285:head# 2024-04-01T19:56:37.649 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a99a7f8:::benchmark_data_smithi188_161190_object118363:head# 2024-04-01T19:56:37.649 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a9a6eda:::benchmark_data_smithi188_161190_object131786:head# 2024-04-01T19:56:37.650 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a9a779a:::benchmark_data_smithi188_161190_object54873:head# 2024-04-01T19:56:37.650 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a9a9231:::benchmark_data_smithi188_161190_object69298:head# 2024-04-01T19:56:37.650 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a9d00b2:::benchmark_data_smithi188_161190_object101017:head# 2024-04-01T19:56:37.650 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a9d0b76:::benchmark_data_smithi188_161190_object111146:head# 2024-04-01T19:56:37.650 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a9da6ad:::benchmark_data_smithi188_161190_object121359:head# 2024-04-01T19:56:37.650 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a9e044d:::benchmark_data_smithi188_161190_object30357:head# 2024-04-01T19:56:37.650 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a9e9956:::benchmark_data_smithi188_161190_object40779:head# 2024-04-01T19:56:37.650 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9a9f8777:::benchmark_data_smithi188_161190_object53102:head# 2024-04-01T19:56:37.650 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aa091b0:::benchmark_data_smithi188_161190_object91605:head# 2024-04-01T19:56:37.651 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aa31c25:::benchmark_data_smithi188_161190_object87808:head# 2024-04-01T19:56:37.651 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aa323d4:::benchmark_data_smithi188_161190_object114284:head# 2024-04-01T19:56:37.653 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aa32b7f:::benchmark_data_smithi188_161190_object86447:head# 2024-04-01T19:56:37.654 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aa359cc:::benchmark_data_smithi188_161190_object95541:head# 2024-04-01T19:56:37.654 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aa46774:::benchmark_data_smithi188_161190_object45273:head# 2024-04-01T19:56:37.655 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aa489e6:::benchmark_data_smithi188_161190_object57031:head# 2024-04-01T19:56:37.656 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aa4915e:::benchmark_data_smithi188_161190_object113478:head# 2024-04-01T19:56:37.657 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aa51145:::benchmark_data_smithi188_161190_object57035:head# 2024-04-01T19:56:37.657 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aa62d9b:::benchmark_data_smithi188_161190_object38495:head# 2024-04-01T19:56:37.658 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aa79e98:::benchmark_data_smithi188_161190_object134941:head# 2024-04-01T19:56:37.658 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aa845c5:::benchmark_data_smithi188_161190_object76621:head# 2024-04-01T19:56:37.658 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aa93f9f:::benchmark_data_smithi188_161190_object88544:head# 2024-04-01T19:56:37.659 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aaac5c5:::benchmark_data_smithi188_161190_object35567:head# 2024-04-01T19:56:37.659 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aab4df9:::benchmark_data_smithi188_161190_object31607:head# 2024-04-01T19:56:37.660 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aac00f3:::benchmark_data_smithi188_161190_object93404:head# 2024-04-01T19:56:37.660 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aac5554:::benchmark_data_smithi188_161190_object71772:head# 2024-04-01T19:56:37.660 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aac8c08:::benchmark_data_smithi188_161190_object75990:head# 2024-04-01T19:56:37.661 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aad52be:::benchmark_data_smithi188_161190_object69580:head# 2024-04-01T19:56:37.661 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aadf221:::benchmark_data_smithi188_161190_object63343:head# 2024-04-01T19:56:37.662 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aaef6ff:::benchmark_data_smithi188_161190_object110215:head# 2024-04-01T19:56:37.662 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aaef742:::benchmark_data_smithi188_161190_object92305:head# 2024-04-01T19:56:37.662 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aaf2a68:::benchmark_data_smithi188_161190_object48956:head# 2024-04-01T19:56:37.663 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aaf67a9:::benchmark_data_smithi188_161190_object31516:head# 2024-04-01T19:56:37.663 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ab07295:::benchmark_data_smithi188_161190_object135859:head# 2024-04-01T19:56:37.664 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ab09ce6:::benchmark_data_smithi188_161190_object64711:head# 2024-04-01T19:56:37.664 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ab15061:::benchmark_data_smithi188_161190_object54748:head# 2024-04-01T19:56:37.665 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ab28c12:::benchmark_data_smithi188_161190_object66336:head# 2024-04-01T19:56:37.667 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ab29f5d:::benchmark_data_smithi188_161190_object29051:head# 2024-04-01T19:56:37.667 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ab51513:::benchmark_data_smithi188_161190_object38648:head# 2024-04-01T19:56:37.667 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ab522be:::benchmark_data_smithi188_161190_object42515:head# 2024-04-01T19:56:37.667 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ab5cdc6:::benchmark_data_smithi188_161190_object93640:head# 2024-04-01T19:56:37.670 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ab796b0:::benchmark_data_smithi188_161190_object119688:head# 2024-04-01T19:56:37.670 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ab95180:::benchmark_data_smithi188_161190_object124259:head# 2024-04-01T19:56:37.671 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aba08a5:::benchmark_data_smithi188_161190_object41726:head# 2024-04-01T19:56:37.671 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aba4a78:::benchmark_data_smithi188_161190_object116736:head# 2024-04-01T19:56:37.672 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9abaae3e:::benchmark_data_smithi188_161190_object117345:head# 2024-04-01T19:56:37.672 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9abacf88:::benchmark_data_smithi188_161190_object137520:head# 2024-04-01T19:56:37.673 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9abaf2e9:::benchmark_data_smithi188_161190_object129523:head# 2024-04-01T19:56:37.673 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9abc0c94:::benchmark_data_smithi188_161190_object97477:head# 2024-04-01T19:56:37.673 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9abcc5e4:::benchmark_data_smithi188_161190_object118074:head# 2024-04-01T19:56:37.674 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9abd7c74:::benchmark_data_smithi188_161190_object107471:head# 2024-04-01T19:56:37.674 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9abe79df:::benchmark_data_smithi188_161190_object106145:head# 2024-04-01T19:56:37.675 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9abe7e36:::benchmark_data_smithi188_161190_object28332:head# 2024-04-01T19:56:37.675 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9abee519:::benchmark_data_smithi188_161190_object28823:head# 2024-04-01T19:56:37.676 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac05957:::benchmark_data_smithi188_161190_object56271:head# 2024-04-01T19:56:37.676 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac07420:::benchmark_data_smithi188_161190_object136548:head# 2024-04-01T19:56:37.676 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac0c720:::benchmark_data_smithi188_161190_object84661:head# 2024-04-01T19:56:37.677 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac0e5d0:::benchmark_data_smithi188_161190_object79882:head# 2024-04-01T19:56:37.677 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac1e4d9:::benchmark_data_smithi188_161190_object72714:head# 2024-04-01T19:56:37.678 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac1f228:::benchmark_data_smithi188_161190_object80849:head# 2024-04-01T19:56:37.678 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac203ae:::benchmark_data_smithi188_161190_object87962:head# 2024-04-01T19:56:37.678 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac376ad:::benchmark_data_smithi188_161190_object62466:head# 2024-04-01T19:56:37.679 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac38171:::benchmark_data_smithi188_161190_object67049:head# 2024-04-01T19:56:37.679 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac39210:::benchmark_data_smithi188_161190_object27972:head# 2024-04-01T19:56:37.680 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac3f332:::benchmark_data_smithi188_161190_object93861:head# 2024-04-01T19:56:37.680 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac42b67:::benchmark_data_smithi188_161190_object109870:head# 2024-04-01T19:56:37.680 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac43ba0:::benchmark_data_smithi188_161190_object136476:head# 2024-04-01T19:56:37.681 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac46f24:::benchmark_data_smithi188_161190_object135003:head# 2024-04-01T19:56:37.681 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac531ac:::benchmark_data_smithi188_161190_object137922:head# 2024-04-01T19:56:37.681 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac5aca1:::benchmark_data_smithi188_161190_object37248:head# 2024-04-01T19:56:37.682 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac675bc:::benchmark_data_smithi188_161190_object129130:head# 2024-04-01T19:56:37.682 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac67bc1:::benchmark_data_smithi188_161190_object52344:head# 2024-04-01T19:56:37.683 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac7c5ba:::benchmark_data_smithi188_161190_object37695:head# 2024-04-01T19:56:37.683 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac89926:::benchmark_data_smithi188_161190_object138366:head# 2024-04-01T19:56:37.684 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac8bd40:::benchmark_data_smithi188_161190_object78009:head# 2024-04-01T19:56:37.684 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac8fe95:::benchmark_data_smithi188_161190_object101110:head# 2024-04-01T19:56:37.685 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac944f2:::benchmark_data_smithi188_161190_object114129:head# 2024-04-01T19:56:37.685 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac955f9:::benchmark_data_smithi188_161190_object97300:head# 2024-04-01T19:56:37.686 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac9b7c1:::benchmark_data_smithi188_161190_object82226:head# 2024-04-01T19:56:37.686 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ac9f11d:::benchmark_data_smithi188_161190_object90121:head# 2024-04-01T19:56:37.686 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aca50cf:::benchmark_data_smithi188_161190_object98571:head# 2024-04-01T19:56:37.686 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aca7676:::benchmark_data_smithi188_161190_object89445:head# 2024-04-01T19:56:37.687 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9acb320f:::benchmark_data_smithi188_161190_object101342:head# 2024-04-01T19:56:37.687 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9acc547a:::benchmark_data_smithi188_161190_object79695:head# 2024-04-01T19:56:37.688 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9acc5ba7:::benchmark_data_smithi188_161190_object88057:head# 2024-04-01T19:56:37.688 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9acd5303:::benchmark_data_smithi188_161190_object131511:head# 2024-04-01T19:56:37.689 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ace0772:::benchmark_data_smithi188_161190_object137365:head# 2024-04-01T19:56:37.689 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ace0b81:::benchmark_data_smithi188_161190_object108549:head# 2024-04-01T19:56:37.690 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ace1fb8:::benchmark_data_smithi188_161190_object71717:head# 2024-04-01T19:56:37.690 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9acf4309:::benchmark_data_smithi188_161190_object29684:head# 2024-04-01T19:56:37.691 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9acf8558:::benchmark_data_smithi188_161190_object99084:head# 2024-04-01T19:56:37.691 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ad060d5:::benchmark_data_smithi188_161190_object66207:head# 2024-04-01T19:56:37.691 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ad085e1:::benchmark_data_smithi188_161190_object95132:head# 2024-04-01T19:56:37.692 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ad0eda3:::benchmark_data_smithi188_161190_object55722:head# 2024-04-01T19:56:37.692 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ad119e7:::benchmark_data_smithi188_161190_object111702:head# 2024-04-01T19:56:37.693 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ad15141:::benchmark_data_smithi188_161190_object86650:head# 2024-04-01T19:56:37.693 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ad1687b:::benchmark_data_smithi188_161190_object67689:head# 2024-04-01T19:56:37.694 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ad18df0:::benchmark_data_smithi188_161190_object81616:head# 2024-04-01T19:56:37.694 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ad34d3d:::benchmark_data_smithi188_161190_object138410:head# 2024-04-01T19:56:37.695 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ad4b8e9:::benchmark_data_smithi188_161190_object135232:head# 2024-04-01T19:56:37.695 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ad55d88:::benchmark_data_smithi188_161190_object83184:head# 2024-04-01T19:56:37.695 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ad5f179:::benchmark_data_smithi188_161190_object64761:head# 2024-04-01T19:56:37.696 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ad6a793:::benchmark_data_smithi188_161190_object117955:head# 2024-04-01T19:56:37.696 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ad6abdf:::benchmark_data_smithi188_161190_object124203:head# 2024-04-01T19:56:37.697 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ad7f39a:::benchmark_data_smithi188_161190_object45683:head# 2024-04-01T19:56:37.697 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ad85317:::benchmark_data_smithi188_161190_object105732:head# 2024-04-01T19:56:37.697 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ad95996:::benchmark_data_smithi188_161190_object131372:head# 2024-04-01T19:56:37.698 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9adaca12:::benchmark_data_smithi188_161190_object50653:head# 2024-04-01T19:56:37.698 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9adc1cc6:::benchmark_data_smithi188_161190_object106089:head# 2024-04-01T19:56:37.699 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9adc2344:::benchmark_data_smithi188_161190_object28400:head# 2024-04-01T19:56:37.699 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9adc2acf:::benchmark_data_smithi188_161190_object117598:head# 2024-04-01T19:56:37.700 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9adc5e15:::benchmark_data_smithi188_161190_object39961:head# 2024-04-01T19:56:37.700 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9adc89e7:::benchmark_data_smithi188_161190_object20768:head# 2024-04-01T19:56:37.700 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9addd182:::benchmark_data_smithi188_161190_object87969:head# 2024-04-01T19:56:37.701 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9addd408:::benchmark_data_smithi188_161190_object49218:head# 2024-04-01T19:56:37.705 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9addd4c2:::benchmark_data_smithi188_161190_object122764:head# 2024-04-01T19:56:37.705 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9addefd1:::benchmark_data_smithi188_161190_object63426:head# 2024-04-01T19:56:37.705 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ade5549:::benchmark_data_smithi188_161190_object75599:head# 2024-04-01T19:56:37.706 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ade5b76:::benchmark_data_smithi188_161190_object69294:head# 2024-04-01T19:56:37.706 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9adf1172:::benchmark_data_smithi188_161190_object48835:head# 2024-04-01T19:56:37.711 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9adfcc33:::benchmark_data_smithi188_161190_object65854:head# 2024-04-01T19:56:37.711 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ae0d3ab:::benchmark_data_smithi188_161190_object60901:head# 2024-04-01T19:56:37.711 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ae0db0a:::benchmark_data_smithi188_161190_object62739:head# 2024-04-01T19:56:37.712 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ae145d2:::benchmark_data_smithi188_161190_object87425:head# 2024-04-01T19:56:37.712 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ae16e18:::benchmark_data_smithi188_161190_object44810:head# 2024-04-01T19:56:37.712 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ae1ffa5:::benchmark_data_smithi188_161190_object38044:head# 2024-04-01T19:56:37.712 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ae2e1d2:::benchmark_data_smithi188_161190_object67114:head# 2024-04-01T19:56:37.712 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ae4ff5c:::benchmark_data_smithi188_161190_object97911:head# 2024-04-01T19:56:37.712 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ae5dd9b:::benchmark_data_smithi188_161190_object67839:head# 2024-04-01T19:56:37.712 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ae650b9:::benchmark_data_smithi188_161190_object69195:head# 2024-04-01T19:56:37.712 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ae736fe:::benchmark_data_smithi188_161190_object136882:head# 2024-04-01T19:56:37.712 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ae7a579:::benchmark_data_smithi188_161190_object64642:head# 2024-04-01T19:56:37.713 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ae7c390:::benchmark_data_smithi188_161190_object33735:head# 2024-04-01T19:56:37.713 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ae87f93:::benchmark_data_smithi188_161190_object108220:head# 2024-04-01T19:56:37.713 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ae8a397:::benchmark_data_smithi188_161190_object29075:head# 2024-04-01T19:56:37.713 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ae8a6a3:::benchmark_data_smithi188_161190_object81323:head# 2024-04-01T19:56:37.713 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ae8dbf5:::benchmark_data_smithi188_161190_object109356:head# 2024-04-01T19:56:37.714 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ae94e73:::benchmark_data_smithi188_161190_object57292:head# 2024-04-01T19:56:37.714 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ae98731:::benchmark_data_smithi188_161190_object49594:head# 2024-04-01T19:56:37.715 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aea250c:::benchmark_data_smithi188_161190_object109638:head# 2024-04-01T19:56:37.715 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aea9857:::benchmark_data_smithi188_161190_object136250:head# 2024-04-01T19:56:37.716 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aeb8945:::benchmark_data_smithi188_161190_object69998:head# 2024-04-01T19:56:37.716 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aeccc4f:::benchmark_data_smithi188_161190_object31994:head# 2024-04-01T19:56:37.716 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aed3beb:::benchmark_data_smithi188_161190_object135588:head# 2024-04-01T19:56:37.717 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aed43f2:::benchmark_data_smithi188_161190_object74024:head# 2024-04-01T19:56:37.717 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aed4f12:::benchmark_data_smithi188_161190_object123607:head# 2024-04-01T19:56:37.718 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aed917c:::benchmark_data_smithi188_161190_object69293:head# 2024-04-01T19:56:37.718 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aedd333:::benchmark_data_smithi188_161190_object82608:head# 2024-04-01T19:56:37.718 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9af02e8e:::benchmark_data_smithi188_161190_object135321:head# 2024-04-01T19:56:37.719 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9af06804:::benchmark_data_smithi188_161190_object64506:head# 2024-04-01T19:56:37.719 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9af18658:::benchmark_data_smithi188_161190_object106885:head# 2024-04-01T19:56:37.720 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9af1cfbc:::benchmark_data_smithi188_161190_object84555:head# 2024-04-01T19:56:37.720 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9af1fe55:::benchmark_data_smithi188_161190_object66479:head# 2024-04-01T19:56:37.720 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9af3199a:::benchmark_data_smithi188_161190_object85654:head# 2024-04-01T19:56:37.721 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9af34ded:::benchmark_data_smithi188_161190_object41903:head# 2024-04-01T19:56:37.721 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9af3b7fb:::benchmark_data_smithi188_161190_object137005:head# 2024-04-01T19:56:37.722 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9af3dd26:::benchmark_data_smithi188_161190_object108224:head# 2024-04-01T19:56:37.722 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9af41881:::benchmark_data_smithi188_161190_object84408:head# 2024-04-01T19:56:37.723 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9af4b814:::benchmark_data_smithi188_161190_object122697:head# 2024-04-01T19:56:37.725 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9af52ae3:::benchmark_data_smithi188_161190_object48568:head# 2024-04-01T19:56:37.725 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9af5edbd:::benchmark_data_smithi188_161190_object56147:head# 2024-04-01T19:56:37.725 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9af651b6:::benchmark_data_smithi188_161190_object100760:head# 2024-04-01T19:56:37.726 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9af6dcd4:::benchmark_data_smithi188_161190_object34263:head# 2024-04-01T19:56:37.726 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9af795c7:::benchmark_data_smithi188_161190_object75004:head# 2024-04-01T19:56:37.726 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9af7b6a5:::benchmark_data_smithi188_161190_object63467:head# 2024-04-01T19:56:37.726 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9af7c424:::benchmark_data_smithi188_161190_object65697:head# 2024-04-01T19:56:37.726 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9af83fb3:::benchmark_data_smithi188_161190_object132797:head# 2024-04-01T19:56:37.727 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9af894ad:::benchmark_data_smithi188_161190_object21182:head# 2024-04-01T19:56:37.727 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9af8ba48:::benchmark_data_smithi188_161190_object42187:head# 2024-04-01T19:56:37.729 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9af8d49b:::benchmark_data_smithi188_161190_object71788:head# 2024-04-01T19:56:37.732 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9af97d6a:::benchmark_data_smithi188_161190_object54825:head# 2024-04-01T19:56:37.732 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9afb1712:::benchmark_data_smithi188_161190_object93180:head# 2024-04-01T19:56:37.733 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9afb479a:::benchmark_data_smithi188_161190_object43422:head# 2024-04-01T19:56:37.733 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9afb6174:::benchmark_data_smithi188_161190_object83514:head# 2024-04-01T19:56:37.734 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9afb6511:::benchmark_data_smithi188_161190_object125834:head# 2024-04-01T19:56:37.734 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9afba1bf:::benchmark_data_smithi188_161190_object60586:head# 2024-04-01T19:56:37.734 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9afbfb5a:::benchmark_data_smithi188_161190_object122024:head# 2024-04-01T19:56:37.735 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9afd74aa:::benchmark_data_smithi188_161190_object40154:head# 2024-04-01T19:56:37.735 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9afe0c89:::benchmark_data_smithi188_161190_object26595:head# 2024-04-01T19:56:37.736 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:37 smithi062 ceph-mon[44211]: pgmap v1882: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.8 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 532 op/s; 34875/223708 objects degraded (15.590%); 11 MiB/s, 168 objects/s recovering 2024-04-01T19:56:37.736 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9afebd33:::benchmark_data_smithi188_161190_object84754:head# 2024-04-01T19:56:37.736 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aff5a45:::benchmark_data_smithi188_161190_object67108:head# 2024-04-01T19:56:37.737 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aff65f2:::benchmark_data_smithi188_161190_object21251:head# 2024-04-01T19:56:37.737 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:56:37.738 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9aff8473:::benchmark_data_smithi188_161190_object90060:head# 2024-04-01T19:56:37.738 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9affb2fa:::benchmark_data_smithi188_161190_object85367:head# 2024-04-01T19:56:37.744 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b007fe2:::benchmark_data_smithi188_161190_object94893:head# 2024-04-01T19:56:37.744 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b00dd0d:::benchmark_data_smithi188_161190_object77953:head# 2024-04-01T19:56:37.744 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b019b81:::benchmark_data_smithi188_161190_object121158:head# 2024-04-01T19:56:37.744 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b02b9f4:::benchmark_data_smithi188_161190_object105863:head# 2024-04-01T19:56:37.744 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b041b91:::benchmark_data_smithi188_161190_object118904:head# 2024-04-01T19:56:37.744 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b0421fd:::benchmark_data_smithi188_161190_object110004:head# 2024-04-01T19:56:37.744 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b0423bf:::benchmark_data_smithi188_161190_object74383:head# 2024-04-01T19:56:37.744 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b05d2fc:::benchmark_data_smithi188_161190_object60515:head# 2024-04-01T19:56:37.744 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b0628c8:::benchmark_data_smithi188_161190_object51456:head# 2024-04-01T19:56:37.744 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b067610:::benchmark_data_smithi188_161190_object78379:head# 2024-04-01T19:56:37.744 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b0710b4:::benchmark_data_smithi188_161190_object84148:head# 2024-04-01T19:56:37.744 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b074789:::benchmark_data_smithi188_161190_object107076:head# 2024-04-01T19:56:37.745 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b07c8a9:::benchmark_data_smithi188_161190_object91681:head# 2024-04-01T19:56:37.745 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b07f7c8:::benchmark_data_smithi188_161190_object55619:head# 2024-04-01T19:56:37.745 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b07facb:::benchmark_data_smithi188_161190_object105529:head# 2024-04-01T19:56:37.745 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b080ad1:::benchmark_data_smithi188_161190_object100625:head# 2024-04-01T19:56:37.746 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b08c082:::benchmark_data_smithi188_161190_object113840:head# 2024-04-01T19:56:37.746 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b0a4a0a:::benchmark_data_smithi188_161190_object56030:head# 2024-04-01T19:56:37.748 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b0ab062:::benchmark_data_smithi188_161190_object138819:head# 2024-04-01T19:56:37.748 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b0aba27:::benchmark_data_smithi188_161190_object48945:head# 2024-04-01T19:56:37.748 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b0b588a:::benchmark_data_smithi188_161190_object77784:head# 2024-04-01T19:56:37.748 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b0c2d2e:::benchmark_data_smithi188_161190_object135967:head# 2024-04-01T19:56:37.749 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b0d80d5:::benchmark_data_smithi188_161190_object103742:head# 2024-04-01T19:56:37.749 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b0dff40:::benchmark_data_smithi188_161190_object36440:head# 2024-04-01T19:56:37.749 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b0f5862:::benchmark_data_smithi188_161190_object98834:head# 2024-04-01T19:56:37.750 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b0fd4b4:::benchmark_data_smithi188_161190_object36766:head# 2024-04-01T19:56:37.752 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b10dc6e:::benchmark_data_smithi188_161190_object56872:head# 2024-04-01T19:56:37.753 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b110228:::benchmark_data_smithi188_161190_object26500:head# 2024-04-01T19:56:37.753 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b117c42:::benchmark_data_smithi188_161190_object112846:head# 2024-04-01T19:56:37.753 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b11909d:::benchmark_data_smithi188_161190_object46142:head# 2024-04-01T19:56:37.753 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b11b93c:::benchmark_data_smithi188_161190_object95206:head# 2024-04-01T19:56:37.753 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b11e3d4:::benchmark_data_smithi188_161190_object70162:head# 2024-04-01T19:56:37.758 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b125259:::benchmark_data_smithi188_161190_object100217:head# 2024-04-01T19:56:37.758 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b12966d:::benchmark_data_smithi188_161190_object128588:head# 2024-04-01T19:56:37.759 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b12be6e:::benchmark_data_smithi188_161190_object58693:head# 2024-04-01T19:56:37.759 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b1372b7:::benchmark_data_smithi188_161190_object136460:head# 2024-04-01T19:56:37.759 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b144375:::benchmark_data_smithi188_161190_object73971:head# 2024-04-01T19:56:37.760 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b153e12:::benchmark_data_smithi188_161190_object49181:head# 2024-04-01T19:56:37.760 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b154a78:::benchmark_data_smithi188_161190_object59821:head# 2024-04-01T19:56:37.761 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b15845c:::benchmark_data_smithi188_161190_object27598:head# 2024-04-01T19:56:37.762 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b15f11b:::benchmark_data_smithi188_161190_object106033:head# 2024-04-01T19:56:37.763 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b1607e4:::benchmark_data_smithi188_161190_object110904:head# 2024-04-01T19:56:37.763 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b163377:::benchmark_data_smithi188_161190_object35841:head# 2024-04-01T19:56:37.764 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b16d6e5:::benchmark_data_smithi188_161190_object84171:head# 2024-04-01T19:56:37.768 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b1751a6:::benchmark_data_smithi188_161190_object90050:head# 2024-04-01T19:56:37.768 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b17f7b4:::benchmark_data_smithi188_161190_object132848:head# 2024-04-01T19:56:37.768 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b183ec5:::benchmark_data_smithi188_161190_object72830:head# 2024-04-01T19:56:37.769 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b185d22:::benchmark_data_smithi188_161190_object41165:head# 2024-04-01T19:56:37.769 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b18dcac:::benchmark_data_smithi188_161190_object33166:head# 2024-04-01T19:56:37.769 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b18f6ea:::benchmark_data_smithi188_161190_object93620:head# 2024-04-01T19:56:37.769 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b196fa1:::benchmark_data_smithi188_161190_object119149:head# 2024-04-01T19:56:37.769 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b1a9e0c:::benchmark_data_smithi188_161190_object138528:head# 2024-04-01T19:56:37.769 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b1aba37:::benchmark_data_smithi188_161190_object115802:head# 2024-04-01T19:56:37.769 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b1afa3c:::benchmark_data_smithi188_161190_object57787:head# 2024-04-01T19:56:37.769 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b1b10e1:::benchmark_data_smithi188_161190_object25189:head# 2024-04-01T19:56:37.770 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:37 smithi022 ceph-mon[39439]: pgmap v1882: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.8 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 532 op/s; 34875/223708 objects degraded (15.590%); 11 MiB/s, 168 objects/s recovering 2024-04-01T19:56:37.770 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b1b9e85:::benchmark_data_smithi188_161190_object92370:head# 2024-04-01T19:56:37.770 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b1c1387:::benchmark_data_smithi188_161190_object49988:head# 2024-04-01T19:56:37.770 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b1c8ad3:::benchmark_data_smithi188_161190_object59379:head# 2024-04-01T19:56:37.771 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b1ccec1:::benchmark_data_smithi188_161190_object115410:head# 2024-04-01T19:56:37.771 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b1d4c6e:::benchmark_data_smithi188_161190_object101191:head# 2024-04-01T19:56:37.771 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b1d533f:::benchmark_data_smithi188_161190_object96615:head# 2024-04-01T19:56:37.772 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b1dfcb7:::benchmark_data_smithi188_161190_object34249:head# 2024-04-01T19:56:37.772 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:37.772 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b1ed4bd:::benchmark_data_smithi188_161190_object130704:head# 2024-04-01T19:56:37.773 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b1ed4ca:::benchmark_data_smithi188_161190_object50958:head# 2024-04-01T19:56:37.773 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b1ee4f2:::benchmark_data_smithi188_161190_object120154:head# 2024-04-01T19:56:37.776 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b1f9e9a:::benchmark_data_smithi188_161190_object118573:head# 2024-04-01T19:56:37.776 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b1ff1db:::benchmark_data_smithi188_161190_object92833:head# 2024-04-01T19:56:37.776 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b2037b4:::benchmark_data_smithi188_161190_object99341:head# 2024-04-01T19:56:37.776 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b210349:::benchmark_data_smithi188_161190_object27742:head# 2024-04-01T19:56:37.777 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b21268d:::benchmark_data_smithi188_161190_object35925:head# 2024-04-01T19:56:37.777 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b216333:::benchmark_data_smithi188_161190_object101237:head# 2024-04-01T19:56:37.777 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b2197af:::benchmark_data_smithi188_161190_object35691:head# 2024-04-01T19:56:37.779 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b228489:::benchmark_data_smithi188_161190_object75699:head# 2024-04-01T19:56:37.779 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b22fa56:::benchmark_data_smithi188_161190_object22345:head# 2024-04-01T19:56:37.779 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b237551:::benchmark_data_smithi188_161190_object72728:head# 2024-04-01T19:56:37.779 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b239847:::benchmark_data_smithi188_161190_object91021:head# 2024-04-01T19:56:37.780 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b247d79:::benchmark_data_smithi188_161190_object62484:head# 2024-04-01T19:56:37.780 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b24c667:::benchmark_data_smithi188_161190_object75381:head# 2024-04-01T19:56:37.781 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b250966:::benchmark_data_smithi188_161190_object128689:head# 2024-04-01T19:56:37.781 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b2631e7:::benchmark_data_smithi188_161190_object127977:head# 2024-04-01T19:56:37.782 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b2633cb:::benchmark_data_smithi188_161190_object62165:head# 2024-04-01T19:56:37.782 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b264f2f:::benchmark_data_smithi188_161190_object136019:head# 2024-04-01T19:56:37.782 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b26a976:::benchmark_data_smithi188_161190_object63430:head# 2024-04-01T19:56:37.783 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b26aa58:::benchmark_data_smithi188_161190_object89772:head# 2024-04-01T19:56:37.783 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b26c28c:::benchmark_data_smithi188_161190_object30091:head# 2024-04-01T19:56:37.783 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b27fd7d:::benchmark_data_smithi188_161190_object74121:head# 2024-04-01T19:56:37.784 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b2923f6:::benchmark_data_smithi188_161190_object133924:head# 2024-04-01T19:56:37.784 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b293b6c:::benchmark_data_smithi188_161190_object121360:head# 2024-04-01T19:56:37.785 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b298888:::benchmark_data_smithi188_161190_object38099:head# 2024-04-01T19:56:37.785 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b29cd49:::benchmark_data_smithi188_161190_object91226:head# 2024-04-01T19:56:37.785 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b29e2c8:::benchmark_data_smithi188_161190_object56624:head# 2024-04-01T19:56:37.786 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b2a10e1:::benchmark_data_smithi188_161190_object102955:head# 2024-04-01T19:56:37.786 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b2c3d97:::benchmark_data_smithi188_161190_object106614:head# 2024-04-01T19:56:37.787 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b2c95a1:::benchmark_data_smithi188_161190_object95028:head# 2024-04-01T19:56:37.787 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b2d8142:::benchmark_data_smithi188_161190_object63553:head# 2024-04-01T19:56:37.787 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b2e4628:::benchmark_data_smithi188_161190_object108129:head# 2024-04-01T19:56:37.788 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b2e5801:::benchmark_data_smithi188_161190_object129225:head# 2024-04-01T19:56:37.788 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b2ed2ea:::benchmark_data_smithi188_161190_object109908:head# 2024-04-01T19:56:37.788 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b2f3d43:::benchmark_data_smithi188_161190_object36305:head# 2024-04-01T19:56:37.789 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b319977:::benchmark_data_smithi188_161190_object81011:head# 2024-04-01T19:56:37.789 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b32c469:::benchmark_data_smithi188_161190_object126600:head# 2024-04-01T19:56:37.790 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b333996:::benchmark_data_smithi188_161190_object127089:head# 2024-04-01T19:56:37.790 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b33c7fa:::benchmark_data_smithi188_161190_object36549:head# 2024-04-01T19:56:37.791 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b3493e9:::benchmark_data_smithi188_161190_object41462:head# 2024-04-01T19:56:37.791 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b34acbc:::benchmark_data_smithi188_161190_object75641:head# 2024-04-01T19:56:37.794 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b351c66:::benchmark_data_smithi188_161190_object45562:head# 2024-04-01T19:56:37.794 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b359bef:::benchmark_data_smithi188_161190_object109905:head# 2024-04-01T19:56:37.794 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b35d3cb:::benchmark_data_smithi188_161190_object63742:head# 2024-04-01T19:56:37.795 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b377fa3:::benchmark_data_smithi188_161190_object81626:head# 2024-04-01T19:56:37.795 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b37dbb9:::benchmark_data_smithi188_161190_object103961:head# 2024-04-01T19:56:37.796 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b388848:::benchmark_data_smithi188_161190_object124883:head# 2024-04-01T19:56:37.796 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b3917b1:::benchmark_data_smithi188_161190_object58169:head# 2024-04-01T19:56:37.797 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b3950f4:::benchmark_data_smithi188_161190_object54006:head# 2024-04-01T19:56:37.797 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b3b0aa5:::benchmark_data_smithi188_161190_object53799:head# 2024-04-01T19:56:37.798 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b3c00b0:::benchmark_data_smithi188_161190_object94529:head# 2024-04-01T19:56:37.798 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b3c0ecc:::benchmark_data_smithi188_161190_object93580:head# 2024-04-01T19:56:37.799 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b3d141d:::benchmark_data_smithi188_161190_object99616:head# 2024-04-01T19:56:37.799 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b3d1911:::benchmark_data_smithi188_161190_object31551:head# 2024-04-01T19:56:37.799 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b3d73e8:::benchmark_data_smithi188_161190_object45770:head# 2024-04-01T19:56:37.800 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b3d75f1:::benchmark_data_smithi188_161190_object21000:head# 2024-04-01T19:56:37.800 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b3d7e9a:::benchmark_data_smithi188_161190_object43579:head# 2024-04-01T19:56:37.800 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b3dad25:::benchmark_data_smithi188_161190_object71907:head# 2024-04-01T19:56:37.801 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b3e0683:::benchmark_data_smithi188_161190_object36830:head# 2024-04-01T19:56:37.801 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b3e2730:::benchmark_data_smithi188_161190_object29495:head# 2024-04-01T19:56:37.802 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b3e7fd7:::benchmark_data_smithi188_161190_object90704:head# 2024-04-01T19:56:37.802 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b3e8b39:::benchmark_data_smithi188_161190_object92911:head# 2024-04-01T19:56:37.802 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b3f1773:::benchmark_data_smithi188_161190_object42189:head# 2024-04-01T19:56:37.803 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b3f1f27:::benchmark_data_smithi188_161190_object76875:head# 2024-04-01T19:56:37.803 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b3fc8dc:::benchmark_data_smithi188_161190_object135140:head# 2024-04-01T19:56:37.803 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b3fe046:::benchmark_data_smithi188_161190_object78393:head# 2024-04-01T19:56:37.805 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b4229d8:::benchmark_data_smithi188_161190_object129173:head# 2024-04-01T19:56:37.806 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b4310c6:::benchmark_data_smithi188_161190_object121769:head# 2024-04-01T19:56:37.806 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:56:37.806 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b43266d:::benchmark_data_smithi188_161190_object32683:head# 2024-04-01T19:56:37.807 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b439dcc:::benchmark_data_smithi188_161190_object46465:head# 2024-04-01T19:56:37.808 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b4473de:::benchmark_data_smithi188_161190_object98939:head# 2024-04-01T19:56:37.808 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b449de1:::benchmark_data_smithi188_161190_object71599:head# 2024-04-01T19:56:37.809 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b45073a:::benchmark_data_smithi188_161190_object25835:head# 2024-04-01T19:56:37.809 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b464b00:::benchmark_data_smithi188_161190_object117726:head# 2024-04-01T19:56:37.810 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b46ba32:::benchmark_data_smithi188_161190_object117992:head# 2024-04-01T19:56:37.810 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b473358:::benchmark_data_smithi188_161190_object92060:head# 2024-04-01T19:56:37.811 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b47c91d:::benchmark_data_smithi188_161190_object108029:head# 2024-04-01T19:56:37.811 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b47d8f2:::benchmark_data_smithi188_161190_object100233:head# 2024-04-01T19:56:37.812 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b47f7be:::benchmark_data_smithi188_161190_object63682:head# 2024-04-01T19:56:37.812 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b493c0f:::benchmark_data_smithi188_161190_object62806:head# 2024-04-01T19:56:37.814 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b494e2f:::benchmark_data_smithi188_161190_object31848:head# 2024-04-01T19:56:37.814 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b49bd39:::benchmark_data_smithi188_161190_object124994:head# 2024-04-01T19:56:37.815 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b49c672:::benchmark_data_smithi188_161190_object63904:head# 2024-04-01T19:56:37.815 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b4a6b25:::benchmark_data_smithi188_161190_object117778:head# 2024-04-01T19:56:37.816 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b4aec16:::benchmark_data_smithi188_161190_object123352:head# 2024-04-01T19:56:37.816 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b4b17ac:::benchmark_data_smithi188_161190_object69081:head# 2024-04-01T19:56:37.816 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b4b9bbd:::benchmark_data_smithi188_161190_object31318:head# 2024-04-01T19:56:37.817 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b4c4856:::benchmark_data_smithi188_161190_object81870:head# 2024-04-01T19:56:37.817 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b4d07dd:::benchmark_data_smithi188_161190_object21229:head# 2024-04-01T19:56:37.819 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b4d190b:::benchmark_data_smithi188_161190_object136429:head# 2024-04-01T19:56:37.819 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b4dfce3:::benchmark_data_smithi188_161190_object93352:head# 2024-04-01T19:56:37.819 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b4e9acf:::benchmark_data_smithi188_161190_object46661:head# 2024-04-01T19:56:37.825 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b4ef1ac:::benchmark_data_smithi188_161190_object118822:head# 2024-04-01T19:56:37.825 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b4f15a5:::benchmark_data_smithi188_161190_object105514:head# 2024-04-01T19:56:37.825 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b4f2fc0:::benchmark_data_smithi188_161190_object22713:head# 2024-04-01T19:56:37.825 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b4fb46f:::benchmark_data_smithi188_161190_object107943:head# 2024-04-01T19:56:37.826 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b4fda8c:::benchmark_data_smithi188_161190_object100376:head# 2024-04-01T19:56:37.826 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b4fe01c:::benchmark_data_smithi188_161190_object130137:head# 2024-04-01T19:56:37.826 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b508710:::benchmark_data_smithi188_161190_object105560:head# 2024-04-01T19:56:37.826 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b509e51:::benchmark_data_smithi188_161190_object42236:head# 2024-04-01T19:56:37.826 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b50e204:::benchmark_data_smithi188_161190_object58429:head# 2024-04-01T19:56:37.827 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b512dcc:::benchmark_data_smithi188_161190_object39355:head# 2024-04-01T19:56:37.827 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b51df44:::benchmark_data_smithi188_161190_object122854:head# 2024-04-01T19:56:37.827 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:37.828 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:56:37.830 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b525dcf:::benchmark_data_smithi188_161190_object74805:head# 2024-04-01T19:56:37.830 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b526f53:::benchmark_data_smithi188_161190_object33746:head# 2024-04-01T19:56:37.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b53b2d2:::benchmark_data_smithi188_161190_object69835:head# 2024-04-01T19:56:37.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b53b67f:::benchmark_data_smithi188_161190_object37030:head# 2024-04-01T19:56:37.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b54003e:::benchmark_data_smithi188_161190_object110649:head# 2024-04-01T19:56:37.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b548126:::benchmark_data_smithi188_161190_object99348:head# 2024-04-01T19:56:37.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b555e64:::benchmark_data_smithi188_161190_object25374:head# 2024-04-01T19:56:37.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b565d29:::benchmark_data_smithi188_161190_object36499:head# 2024-04-01T19:56:37.832 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b56aeec:::benchmark_data_smithi188_161190_object78061:head# 2024-04-01T19:56:37.832 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b58565f:::benchmark_data_smithi188_161190_object92013:head# 2024-04-01T19:56:37.838 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b587a26:::benchmark_data_smithi188_161190_object97305:head# 2024-04-01T19:56:37.838 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b5a2fc4:::benchmark_data_smithi188_161190_object74401:head# 2024-04-01T19:56:37.838 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b5a42c2:::benchmark_data_smithi188_161190_object43342:head# 2024-04-01T19:56:37.838 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b5a8b40:::benchmark_data_smithi188_161190_object119882:head# 2024-04-01T19:56:37.838 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b5af6b7:::benchmark_data_smithi188_161190_object65664:head# 2024-04-01T19:56:37.838 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b5b6c5f:::benchmark_data_smithi188_161190_object38299:head# 2024-04-01T19:56:37.838 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b5ba95b:::benchmark_data_smithi188_161190_object131761:head# 2024-04-01T19:56:37.838 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b5c6f95:::benchmark_data_smithi188_161190_object71756:head# 2024-04-01T19:56:37.838 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b5cbef5:::benchmark_data_smithi188_161190_object112139:head# 2024-04-01T19:56:37.839 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b5db58d:::benchmark_data_smithi188_161190_object124748:head# 2024-04-01T19:56:37.839 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b5de15b:::benchmark_data_smithi188_161190_object62094:head# 2024-04-01T19:56:37.839 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b5fb504:::benchmark_data_smithi188_161190_object126218:head# 2024-04-01T19:56:37.839 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b6000bf:::benchmark_data_smithi188_161190_object24097:head# 2024-04-01T19:56:37.839 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b60709a:::benchmark_data_smithi188_161190_object118330:head# 2024-04-01T19:56:37.839 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b609e5e:::benchmark_data_smithi188_161190_object93546:head# 2024-04-01T19:56:37.839 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b60f444:::benchmark_data_smithi188_161190_object71122:head# 2024-04-01T19:56:37.840 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b61fe35:::benchmark_data_smithi188_161190_object51743:head# 2024-04-01T19:56:37.840 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b62dd3a:::benchmark_data_smithi188_161190_object131522:head# 2024-04-01T19:56:37.843 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b630d2f:::benchmark_data_smithi188_161190_object47030:head# 2024-04-01T19:56:37.843 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b633b19:::benchmark_data_smithi188_161190_object62449:head# 2024-04-01T19:56:37.843 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b6382d6:::benchmark_data_smithi188_161190_object84679:head# 2024-04-01T19:56:37.843 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b63fcd4:::benchmark_data_smithi188_161190_object70581:head# 2024-04-01T19:56:37.843 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b64fd5f:::benchmark_data_smithi188_161190_object137299:head# 2024-04-01T19:56:37.843 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b6509b0:::benchmark_data_smithi188_161190_object84496:head# 2024-04-01T19:56:37.843 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b6543e8:::benchmark_data_smithi188_161190_object118186:head# 2024-04-01T19:56:37.843 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b65958f:::benchmark_data_smithi188_161190_object31719:head# 2024-04-01T19:56:37.844 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b65c268:::benchmark_data_smithi188_161190_object72281:head# 2024-04-01T19:56:37.844 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b66d142:::benchmark_data_smithi188_161190_object48454:head# 2024-04-01T19:56:37.844 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b679004:::benchmark_data_smithi188_161190_object128069:head# 2024-04-01T19:56:37.844 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b688e34:::benchmark_data_smithi188_161190_object52414:head# 2024-04-01T19:56:37.845 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b68990d:::benchmark_data_smithi188_161190_object131117:head# 2024-04-01T19:56:37.846 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b68a850:::benchmark_data_smithi188_161190_object61006:head# 2024-04-01T19:56:37.846 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b69ca04:::benchmark_data_smithi188_161190_object123583:head# 2024-04-01T19:56:37.846 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b69d8b7:::benchmark_data_smithi188_161190_object60673:head# 2024-04-01T19:56:37.847 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b6a08a7:::benchmark_data_smithi188_161190_object70374:head# 2024-04-01T19:56:37.847 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b6a1a61:::benchmark_data_smithi188_161190_object130439:head# 2024-04-01T19:56:37.847 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b6a6d6b:::benchmark_data_smithi188_161190_object80940:head# 2024-04-01T19:56:37.847 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b6aac8a:::benchmark_data_smithi188_161190_object116582:head# 2024-04-01T19:56:37.848 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b6c83e9:::benchmark_data_smithi188_161190_object25647:head# 2024-04-01T19:56:37.848 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b6d539c:::benchmark_data_smithi188_161190_object112165:head# 2024-04-01T19:56:37.849 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b6d880a:::benchmark_data_smithi188_161190_object87788:head# 2024-04-01T19:56:37.849 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b6ee48b:::benchmark_data_smithi188_161190_object61412:head# 2024-04-01T19:56:37.849 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b6f8222:::benchmark_data_smithi188_161190_object135413:head# 2024-04-01T19:56:37.850 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b6fb63a:::benchmark_data_smithi188_161190_object71187:head# 2024-04-01T19:56:37.850 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b6ff77c:::benchmark_data_smithi188_161190_object119257:head# 2024-04-01T19:56:37.851 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b713d16:::benchmark_data_smithi188_161190_object34347:head# 2024-04-01T19:56:37.851 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b7156af:::benchmark_data_smithi188_161190_object22005:head# 2024-04-01T19:56:37.851 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b715fce:::benchmark_data_smithi188_161190_object124021:head# 2024-04-01T19:56:37.852 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b718b65:::benchmark_data_smithi188_161190_object127750:head# 2024-04-01T19:56:37.852 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b72176d:::benchmark_data_smithi188_161190_object73960:head# 2024-04-01T19:56:37.853 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b74988e:::benchmark_data_smithi188_161190_object48460:head# 2024-04-01T19:56:37.853 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b74da30:::benchmark_data_smithi188_161190_object30689:head# 2024-04-01T19:56:37.854 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b74eecd:::benchmark_data_smithi188_161190_object34766:head# 2024-04-01T19:56:37.854 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b7648aa:::benchmark_data_smithi188_161190_object19914:head# 2024-04-01T19:56:37.855 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b765a47:::benchmark_data_smithi188_161190_object93417:head# 2024-04-01T19:56:37.855 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b76d1e8:::benchmark_data_smithi188_161190_object68046:head# 2024-04-01T19:56:37.855 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b7716ce:::benchmark_data_smithi188_161190_object102499:head# 2024-04-01T19:56:37.856 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b77acc3:::benchmark_data_smithi188_161190_object131384:head# 2024-04-01T19:56:37.856 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b77f16d:::benchmark_data_smithi188_161190_object124795:head# 2024-04-01T19:56:37.857 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b77f866:::benchmark_data_smithi188_161190_object28455:head# 2024-04-01T19:56:37.857 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b7848fa:::benchmark_data_smithi188_161190_object53594:head# 2024-04-01T19:56:37.858 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b78f7b8:::benchmark_data_smithi188_161190_object120072:head# 2024-04-01T19:56:37.858 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b7bde8f:::benchmark_data_smithi188_161190_object125870:head# 2024-04-01T19:56:37.862 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b7c5a19:::benchmark_data_smithi188_161190_object57196:head# 2024-04-01T19:56:37.863 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b7c80f3:::benchmark_data_smithi188_161190_object89438:head# 2024-04-01T19:56:37.863 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b7e3ceb:::benchmark_data_smithi188_161190_object121522:head# 2024-04-01T19:56:37.863 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b7ee386:::benchmark_data_smithi188_161190_object64968:head# 2024-04-01T19:56:37.863 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b7f4b6c:::benchmark_data_smithi188_161190_object109272:head# 2024-04-01T19:56:37.863 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b800457:::benchmark_data_smithi188_161190_object118051:head# 2024-04-01T19:56:37.863 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b805b7c:::benchmark_data_smithi188_161190_object90306:head# 2024-04-01T19:56:37.864 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b8103fd:::benchmark_data_smithi188_161190_object83186:head# 2024-04-01T19:56:37.864 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b824974:::benchmark_data_smithi188_161190_object137491:head# 2024-04-01T19:56:37.865 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b84a025:::benchmark_data_smithi188_161190_object136010:head# 2024-04-01T19:56:37.866 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b84fd9b:::benchmark_data_smithi188_161190_object81235:head# 2024-04-01T19:56:37.866 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b852688:::benchmark_data_smithi188_161190_object98326:head# 2024-04-01T19:56:37.866 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b8626e8:::benchmark_data_smithi188_161190_object93451:head# 2024-04-01T19:56:37.867 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b863193:::benchmark_data_smithi188_161190_object27614:head# 2024-04-01T19:56:37.868 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b866fba:::benchmark_data_smithi188_161190_object133446:head# 2024-04-01T19:56:37.868 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b86a121:::benchmark_data_smithi188_161190_object50397:head# 2024-04-01T19:56:37.873 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b86e4ec:::benchmark_data_smithi188_161190_object84241:head# 2024-04-01T19:56:37.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:37 smithi188 ceph-mon[43939]: pgmap v1882: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.8 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 532 op/s; 34875/223708 objects degraded (15.590%); 11 MiB/s, 168 objects/s recovering 2024-04-01T19:56:37.874 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b8793e2:::benchmark_data_smithi188_161190_object94713:head# 2024-04-01T19:56:37.878 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b87db42:::benchmark_data_smithi188_161190_object76065:head# 2024-04-01T19:56:37.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b884052:::benchmark_data_smithi188_161190_object34366:head# 2024-04-01T19:56:37.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b89af20:::benchmark_data_smithi188_161190_object103681:head# 2024-04-01T19:56:37.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b8adf87:::benchmark_data_smithi188_161190_object114996:head# 2024-04-01T19:56:37.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b8aef8d:::benchmark_data_smithi188_161190_object21544:head# 2024-04-01T19:56:37.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b8d1190:::benchmark_data_smithi188_161190_object29656:head# 2024-04-01T19:56:37.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b8d1c15:::benchmark_data_smithi188_161190_object56584:head# 2024-04-01T19:56:37.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b8e7dc7:::benchmark_data_smithi188_161190_object76684:head# 2024-04-01T19:56:37.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b8e9d8a:::benchmark_data_smithi188_161190_object126011:head# 2024-04-01T19:56:37.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b8f1726:::benchmark_data_smithi188_161190_object104778:head# 2024-04-01T19:56:37.880 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b8fad88:::benchmark_data_smithi188_161190_object92817:head# 2024-04-01T19:56:37.880 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b92987d:::benchmark_data_smithi188_161190_object134441:head# 2024-04-01T19:56:37.880 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b92b6f2:::benchmark_data_smithi188_161190_object34614:head# 2024-04-01T19:56:37.883 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b92dd17:::benchmark_data_smithi188_161190_object100461:head# 2024-04-01T19:56:37.883 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b933e22:::benchmark_data_smithi188_161190_object125246:head# 2024-04-01T19:56:37.883 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b935e8c:::benchmark_data_smithi188_161190_object138244:head# 2024-04-01T19:56:37.883 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b93894f:::benchmark_data_smithi188_161190_object121441:head# 2024-04-01T19:56:37.884 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b940990:::benchmark_data_smithi188_161190_object134470:head# 2024-04-01T19:56:37.884 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b94625d:::benchmark_data_smithi188_161190_object21083:head# 2024-04-01T19:56:37.885 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b9598ff:::benchmark_data_smithi188_161190_object34482:head# 2024-04-01T19:56:37.885 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b95eb06:::benchmark_data_smithi188_161190_object76295:head# 2024-04-01T19:56:37.885 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b9818f0:::benchmark_data_smithi188_161190_object118742:head# 2024-04-01T19:56:37.885 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b983821:::benchmark_data_smithi188_161190_object37518:head# 2024-04-01T19:56:37.886 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b98e3a6:::benchmark_data_smithi188_161190_object38715:head# 2024-04-01T19:56:37.886 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b9939ee:::benchmark_data_smithi188_161190_object39023:head# 2024-04-01T19:56:37.887 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b998b14:::benchmark_data_smithi188_161190_object59920:head# 2024-04-01T19:56:37.887 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b99f79d:::benchmark_data_smithi188_161190_object38403:head# 2024-04-01T19:56:37.887 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b9a4b48:::benchmark_data_smithi188_161190_object91703:head# 2024-04-01T19:56:37.888 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b9c3754:::benchmark_data_smithi188_161190_object80822:head# 2024-04-01T19:56:37.888 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b9ce08f:::benchmark_data_smithi188_161190_object26444:head# 2024-04-01T19:56:37.889 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b9d3590:::benchmark_data_smithi188_161190_object59197:head# 2024-04-01T19:56:37.889 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b9d7eea:::benchmark_data_smithi188_161190_object74251:head# 2024-04-01T19:56:37.889 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b9ec0d6:::benchmark_data_smithi188_161190_object46502:head# 2024-04-01T19:56:37.893 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b9f804c:::benchmark_data_smithi188_161190_object80453:head# 2024-04-01T19:56:37.893 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9b9fa044:::benchmark_data_smithi188_161190_object38077:head# 2024-04-01T19:56:37.893 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ba05079:::benchmark_data_smithi188_161190_object35037:head# 2024-04-01T19:56:37.894 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ba0ceca:::benchmark_data_smithi188_161190_object123128:head# 2024-04-01T19:56:37.894 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ba1c112:::benchmark_data_smithi188_161190_object38152:head# 2024-04-01T19:56:37.895 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ba28799:::benchmark_data_smithi188_161190_object21018:head# 2024-04-01T19:56:37.901 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ba2e8ce:::benchmark_data_smithi188_161190_object66719:head# 2024-04-01T19:56:37.901 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ba2fdf8:::benchmark_data_smithi188_161190_object74836:head# 2024-04-01T19:56:37.901 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ba331bb:::benchmark_data_smithi188_161190_object29924:head# 2024-04-01T19:56:37.901 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ba40d0f:::benchmark_data_smithi188_161190_object117303:head# 2024-04-01T19:56:37.901 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ba50957:::benchmark_data_smithi188_161190_object128771:head# 2024-04-01T19:56:37.902 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ba547c9:::benchmark_data_smithi188_161190_object118781:head# 2024-04-01T19:56:37.902 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ba74535:::benchmark_data_smithi188_161190_object131473:head# 2024-04-01T19:56:37.903 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ba7ec69:::benchmark_data_smithi188_161190_object19828:head# 2024-04-01T19:56:37.903 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ba7fea5:::benchmark_data_smithi188_161190_object81869:head# 2024-04-01T19:56:37.903 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ba8055d:::benchmark_data_smithi188_161190_object97395:head# 2024-04-01T19:56:37.904 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ba8e917:::benchmark_data_smithi188_161190_object52123:head# 2024-04-01T19:56:37.905 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ba8fad2:::benchmark_data_smithi188_161190_object91750:head# 2024-04-01T19:56:37.905 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ba96c47:::benchmark_data_smithi188_161190_object79560:head# 2024-04-01T19:56:37.906 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9baaffea:::benchmark_data_smithi188_161190_object137290:head# 2024-04-01T19:56:37.906 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bac7f72:::benchmark_data_smithi188_161190_object36751:head# 2024-04-01T19:56:37.906 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9badd442:::benchmark_data_smithi188_161190_object120958:head# 2024-04-01T19:56:37.909 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bade403:::benchmark_data_smithi188_161190_object23163:head# 2024-04-01T19:56:37.909 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bae4f40:::benchmark_data_smithi188_161190_object24910:head# 2024-04-01T19:56:37.909 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bae899a:::benchmark_data_smithi188_161190_object23465:head# 2024-04-01T19:56:37.909 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9baeae1b:::benchmark_data_smithi188_161190_object52298:head# 2024-04-01T19:56:37.915 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9baf4ff8:::benchmark_data_smithi188_161190_object131377:head# 2024-04-01T19:56:37.915 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9baf6341:::benchmark_data_smithi188_161190_object106903:head# 2024-04-01T19:56:37.916 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bb00586:::benchmark_data_smithi188_161190_object54938:head# 2024-04-01T19:56:37.916 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bb00883:::benchmark_data_smithi188_161190_object33430:head# 2024-04-01T19:56:37.917 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bb04d53:::benchmark_data_smithi188_161190_object24538:head# 2024-04-01T19:56:37.917 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bb0e11d:::benchmark_data_smithi188_161190_object82359:head# 2024-04-01T19:56:37.917 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bb0fb72:::benchmark_data_smithi188_161190_object87574:head# 2024-04-01T19:56:37.918 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bb298da:::benchmark_data_smithi188_161190_object112546:head# 2024-04-01T19:56:37.919 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bb2acd3:::benchmark_data_smithi188_161190_object98426:head# 2024-04-01T19:56:37.919 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bb2c058:::benchmark_data_smithi188_161190_object71407:head# 2024-04-01T19:56:37.920 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bb2c2f1:::benchmark_data_smithi188_161190_object105673:head# 2024-04-01T19:56:37.920 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bb2ca56:::benchmark_data_smithi188_161190_object55492:head# 2024-04-01T19:56:37.921 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bb2cc6f:::benchmark_data_smithi188_161190_object36782:head# 2024-04-01T19:56:37.921 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bb48aaa:::benchmark_data_smithi188_161190_object115735:head# 2024-04-01T19:56:37.921 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bb59b75:::benchmark_data_smithi188_161190_object113469:head# 2024-04-01T19:56:37.922 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bb5df50:::benchmark_data_smithi188_161190_object43793:head# 2024-04-01T19:56:37.922 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bb69f8e:::benchmark_data_smithi188_161190_object44099:head# 2024-04-01T19:56:37.923 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bb6a958:::benchmark_data_smithi188_161190_object125434:head# 2024-04-01T19:56:37.924 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bb6bc87:::benchmark_data_smithi188_161190_object99074:head# 2024-04-01T19:56:37.924 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bb77cf6:::benchmark_data_smithi188_161190_object87338:head# 2024-04-01T19:56:37.924 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bb9fab4:::benchmark_data_smithi188_161190_object118397:head# 2024-04-01T19:56:37.929 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:56:37.930 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bbab73f:::benchmark_data_smithi188_161190_object39316:head# 2024-04-01T19:56:37.930 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bbc78c3:::benchmark_data_smithi188_161190_object100889:head# 2024-04-01T19:56:37.930 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bbc992b:::benchmark_data_smithi188_161190_object44129:head# 2024-04-01T19:56:37.930 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bbccfa4:::benchmark_data_smithi188_161190_object77413:head# 2024-04-01T19:56:37.930 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bbd3955:::benchmark_data_smithi188_161190_object101155:head# 2024-04-01T19:56:37.930 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bbd62af:::benchmark_data_smithi188_161190_object77106:head# 2024-04-01T19:56:37.930 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bbde5eb:::benchmark_data_smithi188_161190_object106230:head# 2024-04-01T19:56:37.930 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bbe1a43:::benchmark_data_smithi188_161190_object59725:head# 2024-04-01T19:56:37.930 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bc08e5c:::benchmark_data_smithi188_161190_object58901:head# 2024-04-01T19:56:37.930 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bc10a02:::benchmark_data_smithi188_161190_object90180:head# 2024-04-01T19:56:37.931 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bc2bf19:::benchmark_data_smithi188_161190_object123448:head# 2024-04-01T19:56:37.931 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bc51ecc:::benchmark_data_smithi188_161190_object30552:head# 2024-04-01T19:56:37.931 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bc5d458:::benchmark_data_smithi188_161190_object61883:head# 2024-04-01T19:56:37.931 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bc66994:::benchmark_data_smithi188_161190_object67289:head# 2024-04-01T19:56:37.932 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bc7169b:::benchmark_data_smithi188_161190_object53829:head# 2024-04-01T19:56:37.932 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bc754e2:::benchmark_data_smithi188_161190_object77603:head# 2024-04-01T19:56:37.932 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bc78d8d:::benchmark_data_smithi188_161190_object96203:head# 2024-04-01T19:56:37.932 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bc7ee06:::benchmark_data_smithi188_161190_object97187:head# 2024-04-01T19:56:37.932 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bc87440:::benchmark_data_smithi188_161190_object71794:head# 2024-04-01T19:56:37.933 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bc88db2:::benchmark_data_smithi188_161190_object71018:head# 2024-04-01T19:56:37.933 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bc8a731:::benchmark_data_smithi188_161190_object41080:head# 2024-04-01T19:56:37.934 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bc90e68:::benchmark_data_smithi188_161190_object42701:head# 2024-04-01T19:56:37.934 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bc92ebe:::benchmark_data_smithi188_161190_object21431:head# 2024-04-01T19:56:37.934 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bc94780:::benchmark_data_smithi188_161190_object53001:head# 2024-04-01T19:56:37.934 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bc94a0a:::benchmark_data_smithi188_161190_object91724:head# 2024-04-01T19:56:37.935 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bc9db01:::benchmark_data_smithi188_161190_object56451:head# 2024-04-01T19:56:37.936 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bca1085:::benchmark_data_smithi188_161190_object124915:head# 2024-04-01T19:56:37.936 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bcadedb:::benchmark_data_smithi188_161190_object97606:head# 2024-04-01T19:56:37.936 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bcd0e1c:::benchmark_data_smithi188_161190_object56235:head# 2024-04-01T19:56:37.937 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bce007d:::benchmark_data_smithi188_161190_object70784:head# 2024-04-01T19:56:37.937 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bce25a2:::benchmark_data_smithi188_161190_object103951:head# 2024-04-01T19:56:37.938 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bce56c3:::benchmark_data_smithi188_161190_object56785:head# 2024-04-01T19:56:37.938 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bce89f0:::benchmark_data_smithi188_161190_object121475:head# 2024-04-01T19:56:37.939 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bcec76f:::benchmark_data_smithi188_161190_object135037:head# 2024-04-01T19:56:37.939 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bcfc2f0:::benchmark_data_smithi188_161190_object68975:head# 2024-04-01T19:56:37.939 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bcffcdc:::benchmark_data_smithi188_161190_object32594:head# 2024-04-01T19:56:37.940 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bd05fb8:::benchmark_data_smithi188_161190_object66996:head# 2024-04-01T19:56:37.940 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bd08ec3:::benchmark_data_smithi188_161190_object127765:head# 2024-04-01T19:56:37.941 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bd12792:::benchmark_data_smithi188_161190_object45971:head# 2024-04-01T19:56:37.941 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bd311da:::benchmark_data_smithi188_161190_object111822:head# 2024-04-01T19:56:37.942 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bd3a0cb:::benchmark_data_smithi188_161190_object59015:head# 2024-04-01T19:56:37.942 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bd3a7f9:::benchmark_data_smithi188_161190_object51862:head# 2024-04-01T19:56:37.942 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bd3bed8:::benchmark_data_smithi188_161190_object29279:head# 2024-04-01T19:56:37.943 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bd3e409:::benchmark_data_smithi188_161190_object121975:head# 2024-04-01T19:56:37.944 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bd4cc9f:::benchmark_data_smithi188_161190_object130853:head# 2024-04-01T19:56:37.944 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bd543e6:::benchmark_data_smithi188_161190_object20999:head# 2024-04-01T19:56:37.949 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bd55143:::benchmark_data_smithi188_161190_object79195:head# 2024-04-01T19:56:37.949 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bd56b6c:::benchmark_data_smithi188_161190_object33918:head# 2024-04-01T19:56:37.949 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bd59bec:::benchmark_data_smithi188_161190_object128534:head# 2024-04-01T19:56:37.949 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bd5a0c0:::benchmark_data_smithi188_161190_object23201:head# 2024-04-01T19:56:37.950 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bd5c61a:::benchmark_data_smithi188_161190_object51150:head# 2024-04-01T19:56:37.950 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bd6a934:::benchmark_data_smithi188_161190_object70727:head# 2024-04-01T19:56:37.951 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bd72d8e:::benchmark_data_smithi188_161190_object97566:head# 2024-04-01T19:56:37.952 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bd91384:::benchmark_data_smithi188_161190_object76925:head# 2024-04-01T19:56:37.953 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bda5d2a:::benchmark_data_smithi188_161190_object132425:head# 2024-04-01T19:56:37.956 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bda904b:::benchmark_data_smithi188_161190_object106486:head# 2024-04-01T19:56:37.956 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bdb8455:::benchmark_data_smithi188_161190_object110067:head# 2024-04-01T19:56:37.956 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bdcd877:::benchmark_data_smithi188_161190_object99146:head# 2024-04-01T19:56:37.957 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bdce66b:::benchmark_data_smithi188_161190_object111965:head# 2024-04-01T19:56:37.958 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bdd8a8c:::benchmark_data_smithi188_161190_object81793:head# 2024-04-01T19:56:37.958 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bdea884:::benchmark_data_smithi188_161190_object62903:head# 2024-04-01T19:56:37.958 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bdf299d:::benchmark_data_smithi188_161190_object66302:head# 2024-04-01T19:56:37.959 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bdfb106:::benchmark_data_smithi188_161190_object65016:head# 2024-04-01T19:56:37.961 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bdfe67b:::benchmark_data_smithi188_161190_object31106:head# 2024-04-01T19:56:37.961 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9be0a16c:::benchmark_data_smithi188_161190_object73609:head# 2024-04-01T19:56:37.962 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9be0f0cd:::benchmark_data_smithi188_161190_object96340:head# 2024-04-01T19:56:37.962 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9be16b98:::benchmark_data_smithi188_161190_object117886:head# 2024-04-01T19:56:37.963 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9be1e29a:::benchmark_data_smithi188_161190_object130337:head# 2024-04-01T19:56:37.963 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9be304e9:::benchmark_data_smithi188_161190_object37051:head# 2024-04-01T19:56:37.964 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9be3d448:::benchmark_data_smithi188_161190_object132773:head# 2024-04-01T19:56:37.964 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9be3f078:::benchmark_data_smithi188_161190_object68021:head# 2024-04-01T19:56:37.964 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9be45b89:::benchmark_data_smithi188_161190_object136307:head# 2024-04-01T19:56:37.965 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9be61560:::benchmark_data_smithi188_161190_object82626:head# 2024-04-01T19:56:37.965 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9be6969e:::benchmark_data_smithi188_161190_object91017:head# 2024-04-01T19:56:37.966 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9be6ec55:::benchmark_data_smithi188_161190_object105989:head# 2024-04-01T19:56:37.970 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9be73bea:::benchmark_data_smithi188_161190_object99419:head# 2024-04-01T19:56:37.970 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9be8d5b0:::benchmark_data_smithi188_161190_object126942:head# 2024-04-01T19:56:37.971 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9be96f15:::benchmark_data_smithi188_161190_object71722:head# 2024-04-01T19:56:37.971 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9be9d0ff:::benchmark_data_smithi188_161190_object90415:head# 2024-04-01T19:56:37.971 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bea08c2:::benchmark_data_smithi188_161190_object23261:head# 2024-04-01T19:56:37.971 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bea245d:::benchmark_data_smithi188_161190_object53508:head# 2024-04-01T19:56:37.971 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9beb0670:::benchmark_data_smithi188_161190_object35298:head# 2024-04-01T19:56:37.971 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9beb5ab9:::benchmark_data_smithi188_161190_object125772:head# 2024-04-01T19:56:37.971 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bebf28d:::benchmark_data_smithi188_161190_object85203:head# 2024-04-01T19:56:37.971 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bed5698:::benchmark_data_smithi188_161190_object70328:head# 2024-04-01T19:56:37.972 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bedd236:::benchmark_data_smithi188_161190_object130697:head# 2024-04-01T19:56:37.972 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bedf602:::benchmark_data_smithi188_161190_object77568:head# 2024-04-01T19:56:37.972 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bee4e55:::benchmark_data_smithi188_161190_object60647:head# 2024-04-01T19:56:37.972 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9beedb38:::benchmark_data_smithi188_161190_object49295:head# 2024-04-01T19:56:37.974 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:37.975 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bef42f9:::benchmark_data_smithi188_161190_object65162:head# 2024-04-01T19:56:37.975 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bef5ab2:::benchmark_data_smithi188_161190_object86191:head# 2024-04-01T19:56:37.975 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bef6d3f:::benchmark_data_smithi188_161190_object135998:head# 2024-04-01T19:56:37.975 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9befce0b:::benchmark_data_smithi188_161190_object45549:head# 2024-04-01T19:56:37.976 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bf046ce:::benchmark_data_smithi188_161190_object68259:head# 2024-04-01T19:56:37.976 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bf063e6:::benchmark_data_smithi188_161190_object40572:head# 2024-04-01T19:56:37.976 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bf18d0a:::benchmark_data_smithi188_161190_object97255:head# 2024-04-01T19:56:37.976 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bf2cd4e:::benchmark_data_smithi188_161190_object59775:head# 2024-04-01T19:56:37.977 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bf3fae0:::benchmark_data_smithi188_161190_object26783:head# 2024-04-01T19:56:37.983 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bf4abd0:::benchmark_data_smithi188_161190_object122983:head# 2024-04-01T19:56:37.983 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bf53839:::benchmark_data_smithi188_161190_object36226:head# 2024-04-01T19:56:37.983 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bf5f67f:::benchmark_data_smithi188_161190_object58237:head# 2024-04-01T19:56:37.983 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bf6892f:::benchmark_data_smithi188_161190_object126469:head# 2024-04-01T19:56:37.983 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bf6a6aa:::benchmark_data_smithi188_161190_object53435:head# 2024-04-01T19:56:37.983 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bf70c4e:::benchmark_data_smithi188_161190_object57118:head# 2024-04-01T19:56:37.983 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bf71d91:::benchmark_data_smithi188_161190_object59777:head# 2024-04-01T19:56:37.983 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bf81b6c:::benchmark_data_smithi188_161190_object83471:head# 2024-04-01T19:56:37.983 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bf870e6:::benchmark_data_smithi188_161190_object32592:head# 2024-04-01T19:56:37.984 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bf8b0f0:::benchmark_data_smithi188_161190_object103903:head# 2024-04-01T19:56:37.984 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bfa19b3:::benchmark_data_smithi188_161190_object82600:head# 2024-04-01T19:56:37.984 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bfa4ed2:::benchmark_data_smithi188_161190_object103680:head# 2024-04-01T19:56:37.984 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bfa7825:::benchmark_data_smithi188_161190_object115960:head# 2024-04-01T19:56:37.986 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bfbb50d:::benchmark_data_smithi188_161190_object81627:head# 2024-04-01T19:56:37.986 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bfc01b6:::benchmark_data_smithi188_161190_object79441:head# 2024-04-01T19:56:37.987 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bfc36a0:::benchmark_data_smithi188_161190_object52932:head# 2024-04-01T19:56:37.987 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bfc663a:::benchmark_data_smithi188_161190_object83649:head# 2024-04-01T19:56:37.988 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bfcbeab:::benchmark_data_smithi188_161190_object89730:head# 2024-04-01T19:56:37.988 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bfcd3dc:::benchmark_data_smithi188_161190_object130613:head# 2024-04-01T19:56:37.988 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bfce2fb:::benchmark_data_smithi188_161190_object76099:head# 2024-04-01T19:56:37.988 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bfd9628:::benchmark_data_smithi188_161190_object118247:head# 2024-04-01T19:56:37.989 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bfe0f98:::benchmark_data_smithi188_161190_object105191:head# 2024-04-01T19:56:37.989 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bfe2d83:::benchmark_data_smithi188_161190_object137055:head# 2024-04-01T19:56:37.990 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bfe91f3:::benchmark_data_smithi188_161190_object138006:head# 2024-04-01T19:56:37.993 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bfeb08d:::benchmark_data_smithi188_161190_object65512:head# 2024-04-01T19:56:37.993 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9bff1857:::benchmark_data_smithi188_161190_object51929:head# 2024-04-01T19:56:37.994 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c006eb7:::benchmark_data_smithi188_161190_object66713:head# 2024-04-01T19:56:37.994 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c0121cf:::benchmark_data_smithi188_161190_object93061:head# 2024-04-01T19:56:37.994 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c02b9ae:::benchmark_data_smithi188_161190_object46342:head# 2024-04-01T19:56:37.995 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c02f9b7:::benchmark_data_smithi188_161190_object134557:head# 2024-04-01T19:56:37.995 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c039eee:::benchmark_data_smithi188_161190_object20069:head# 2024-04-01T19:56:37.996 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c03a3b1:::benchmark_data_smithi188_161190_object112088:head# 2024-04-01T19:56:37.996 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c03a6f5:::benchmark_data_smithi188_161190_object137757:head# 2024-04-01T19:56:37.997 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c048822:::benchmark_data_smithi188_161190_object27061:head# 2024-04-01T19:56:37.997 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c054378:::benchmark_data_smithi188_161190_object34620:head# 2024-04-01T19:56:37.998 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c05bbc5:::benchmark_data_smithi188_161190_object115776:head# 2024-04-01T19:56:38.000 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c0678fc:::benchmark_data_smithi188_161190_object50324:head# 2024-04-01T19:56:38.000 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c0680b4:::benchmark_data_smithi188_161190_object50933:head# 2024-04-01T19:56:38.001 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c0696bf:::benchmark_data_smithi188_161190_object79115:head# 2024-04-01T19:56:38.001 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c085fbe:::benchmark_data_smithi188_161190_object110801:head# 2024-04-01T19:56:38.004 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c087821:::benchmark_data_smithi188_161190_object35258:head# 2024-04-01T19:56:38.005 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c08b821:::benchmark_data_smithi188_161190_object51856:head# 2024-04-01T19:56:38.005 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c08fa50:::benchmark_data_smithi188_161190_object99397:head# 2024-04-01T19:56:38.005 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c096c5e:::benchmark_data_smithi188_161190_object99249:head# 2024-04-01T19:56:38.006 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c0979ba:::benchmark_data_smithi188_161190_object41628:head# 2024-04-01T19:56:38.007 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c09e850:::benchmark_data_smithi188_161190_object59482:head# 2024-04-01T19:56:38.007 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c0c493f:::benchmark_data_smithi188_161190_object24150:head# 2024-04-01T19:56:38.007 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c0ca9c7:::benchmark_data_smithi188_161190_object47426:head# 2024-04-01T19:56:38.010 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c0e8c15:::benchmark_data_smithi188_161190_object54179:head# 2024-04-01T19:56:38.011 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c0ee9cc:::benchmark_data_smithi188_161190_object58781:head# 2024-04-01T19:56:38.011 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c1026f2:::benchmark_data_smithi188_161190_object89182:head# 2024-04-01T19:56:38.011 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c11fb57:::benchmark_data_smithi188_161190_object119504:head# 2024-04-01T19:56:38.011 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c135e84:::benchmark_data_smithi188_161190_object31428:head# 2024-04-01T19:56:38.011 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c142829:::benchmark_data_smithi188_161190_object47159:head# 2024-04-01T19:56:38.011 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c15e43b:::benchmark_data_smithi188_161190_object33493:head# 2024-04-01T19:56:38.011 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c162adb:::benchmark_data_smithi188_161190_object82656:head# 2024-04-01T19:56:38.012 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c169e26:::benchmark_data_smithi188_161190_object118666:head# 2024-04-01T19:56:38.012 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c17faa0:::benchmark_data_smithi188_161190_object132774:head# 2024-04-01T19:56:38.012 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c18f73f:::benchmark_data_smithi188_161190_object131272:head# 2024-04-01T19:56:38.013 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c191e25:::benchmark_data_smithi188_161190_object86844:head# 2024-04-01T19:56:38.013 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c19b103:::benchmark_data_smithi188_161190_object79840:head# 2024-04-01T19:56:38.013 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c19b1ec:::benchmark_data_smithi188_161190_object66629:head# 2024-04-01T19:56:38.014 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c1a28c1:::benchmark_data_smithi188_161190_object113555:head# 2024-04-01T19:56:38.014 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c1a7209:::benchmark_data_smithi188_161190_object37548:head# 2024-04-01T19:56:38.015 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c1a760c:::benchmark_data_smithi188_161190_object118505:head# 2024-04-01T19:56:38.015 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c1be322:::benchmark_data_smithi188_161190_object60194:head# 2024-04-01T19:56:38.016 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c1c8f72:::benchmark_data_smithi188_161190_object131588:head# 2024-04-01T19:56:38.016 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c1d1471:::benchmark_data_smithi188_161190_object102563:head# 2024-04-01T19:56:38.016 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c1eb028:::benchmark_data_smithi188_161190_object92543:head# 2024-04-01T19:56:38.017 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c1f3582:::benchmark_data_smithi188_161190_object60922:head# 2024-04-01T19:56:38.017 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c2036bc:::benchmark_data_smithi188_161190_object100740:head# 2024-04-01T19:56:38.018 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c207188:::benchmark_data_smithi188_161190_object65519:head# 2024-04-01T19:56:38.024 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c20f1ca:::benchmark_data_smithi188_161190_object38165:head# 2024-04-01T19:56:38.024 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c20f3c2:::benchmark_data_smithi188_161190_object29952:head# 2024-04-01T19:56:38.025 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c21002f:::benchmark_data_smithi188_161190_object135191:head# 2024-04-01T19:56:38.025 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c217882:::benchmark_data_smithi188_161190_object55980:head# 2024-04-01T19:56:38.026 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c227436:::benchmark_data_smithi188_161190_object135575:head# 2024-04-01T19:56:38.026 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c22ae51:::benchmark_data_smithi188_161190_object110616:head# 2024-04-01T19:56:38.027 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c2353c6:::benchmark_data_smithi188_161190_object54709:head# 2024-04-01T19:56:38.027 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c2406f3:::benchmark_data_smithi188_161190_object104250:head# 2024-04-01T19:56:38.027 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c240c73:::benchmark_data_smithi188_161190_object60619:head# 2024-04-01T19:56:38.028 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c2415ff:::benchmark_data_smithi188_161190_object64513:head# 2024-04-01T19:56:38.028 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c25a2a0:::benchmark_data_smithi188_161190_object90264:head# 2024-04-01T19:56:38.029 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c26ba9b:::benchmark_data_smithi188_161190_object121793:head# 2024-04-01T19:56:38.029 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c2807c5:::benchmark_data_smithi188_161190_object81247:head# 2024-04-01T19:56:38.030 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c28ce2d:::benchmark_data_smithi188_161190_object116991:head# 2024-04-01T19:56:38.030 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c294fb9:::benchmark_data_smithi188_161190_object101793:head# 2024-04-01T19:56:38.031 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c29df1b:::benchmark_data_smithi188_161190_object116124:head# 2024-04-01T19:56:38.031 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c29e2f8:::benchmark_data_smithi188_161190_object37183:head# 2024-04-01T19:56:38.032 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c2a50c6:::benchmark_data_smithi188_161190_object97260:head# 2024-04-01T19:56:38.032 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c2b0dff:::benchmark_data_smithi188_161190_object71989:head# 2024-04-01T19:56:38.033 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c2b3580:::benchmark_data_smithi188_161190_object118152:head# 2024-04-01T19:56:38.033 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c2b43c5:::benchmark_data_smithi188_161190_object108873:head# 2024-04-01T19:56:38.034 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c2c7c0f:::benchmark_data_smithi188_161190_object20973:head# 2024-04-01T19:56:38.034 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c2cb942:::benchmark_data_smithi188_161190_object34960:head# 2024-04-01T19:56:38.034 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c2d056a:::benchmark_data_smithi188_161190_object54493:head# 2024-04-01T19:56:38.035 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c2d6a4b:::benchmark_data_smithi188_161190_object110248:head# 2024-04-01T19:56:38.035 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c2e25e0:::benchmark_data_smithi188_161190_object81079:head# 2024-04-01T19:56:38.036 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c2ea4df:::benchmark_data_smithi188_161190_object44630:head# 2024-04-01T19:56:38.036 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c2f4553:::benchmark_data_smithi188_161190_object36536:head# 2024-04-01T19:56:38.037 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c319c69:::benchmark_data_smithi188_161190_object118603:head# 2024-04-01T19:56:38.037 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c31bdc7:::benchmark_data_smithi188_161190_object53740:head# 2024-04-01T19:56:38.039 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c31cb01:::benchmark_data_smithi188_161190_object41156:head# 2024-04-01T19:56:38.040 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c32ccc1:::benchmark_data_smithi188_161190_object134078:head# 2024-04-01T19:56:38.040 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c32fa9f:::benchmark_data_smithi188_161190_object36369:head# 2024-04-01T19:56:38.041 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c349d4f:::benchmark_data_smithi188_161190_object91467:head# 2024-04-01T19:56:38.041 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c354c57:::benchmark_data_smithi188_161190_object27216:head# 2024-04-01T19:56:38.042 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c3598da:::benchmark_data_smithi188_161190_object92144:head# 2024-04-01T19:56:38.042 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c35e9b8:::benchmark_data_smithi188_161190_object47784:head# 2024-04-01T19:56:38.042 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c36ee4e:::benchmark_data_smithi188_161190_object105265:head# 2024-04-01T19:56:38.043 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c375c6a:::benchmark_data_smithi188_161190_object96426:head# 2024-04-01T19:56:38.043 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c377878:::benchmark_data_smithi188_161190_object48938:head# 2024-04-01T19:56:38.044 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c37d729:::benchmark_data_smithi188_161190_object68525:head# 2024-04-01T19:56:38.044 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c380379:::benchmark_data_smithi188_161190_object42857:head# 2024-04-01T19:56:38.045 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c38e367:::benchmark_data_smithi188_161190_object120418:head# 2024-04-01T19:56:38.045 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c391492:::benchmark_data_smithi188_161190_object26417:head# 2024-04-01T19:56:38.045 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c393563:::benchmark_data_smithi188_161190_object119493:head# 2024-04-01T19:56:38.046 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c39ddc5:::benchmark_data_smithi188_161190_object93296:head# 2024-04-01T19:56:38.046 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c39f59a:::benchmark_data_smithi188_161190_object37410:head# 2024-04-01T19:56:38.049 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c3a5345:::benchmark_data_smithi188_161190_object88962:head# 2024-04-01T19:56:38.049 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c3a5428:::benchmark_data_smithi188_161190_object95527:head# 2024-04-01T19:56:38.050 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c3a686f:::benchmark_data_smithi188_161190_object24468:head# 2024-04-01T19:56:38.050 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c3af3a8:::benchmark_data_smithi188_161190_object100030:head# 2024-04-01T19:56:38.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c3b5f6b:::benchmark_data_smithi188_161190_object46357:head# 2024-04-01T19:56:38.051 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c3bbf04:::benchmark_data_smithi188_161190_object70706:head# 2024-04-01T19:56:38.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c3bdb45:::benchmark_data_smithi188_161190_object50361:head# 2024-04-01T19:56:38.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c3c5936:::benchmark_data_smithi188_161190_object35001:head# 2024-04-01T19:56:38.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c3d23c8:::benchmark_data_smithi188_161190_object120221:head# 2024-04-01T19:56:38.054 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c3d6262:::benchmark_data_smithi188_161190_object80164:head# 2024-04-01T19:56:38.054 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c3f1e6e:::benchmark_data_smithi188_161190_object121272:head# 2024-04-01T19:56:38.054 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c3f20a3:::benchmark_data_smithi188_161190_object114448:head# 2024-04-01T19:56:38.054 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c3f6ae7:::benchmark_data_smithi188_161190_object46198:head# 2024-04-01T19:56:38.055 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c3f97f7:::benchmark_data_smithi188_161190_object46136:head# 2024-04-01T19:56:38.055 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c409fbb:::benchmark_data_smithi188_161190_object123215:head# 2024-04-01T19:56:38.056 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c410d81:::benchmark_data_smithi188_161190_object38455:head# 2024-04-01T19:56:38.057 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c41228e:::benchmark_data_smithi188_161190_object90520:head# 2024-04-01T19:56:38.057 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c41a39c:::benchmark_data_smithi188_161190_object38378:head# 2024-04-01T19:56:38.057 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c420605:::benchmark_data_smithi188_161190_object53625:head# 2024-04-01T19:56:38.057 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c428105:::benchmark_data_smithi188_161190_object68044:head# 2024-04-01T19:56:38.057 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c42c363:::benchmark_data_smithi188_161190_object58862:head# 2024-04-01T19:56:38.058 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c44221e:::benchmark_data_smithi188_161190_object106461:head# 2024-04-01T19:56:38.058 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c4446f6:::benchmark_data_smithi188_161190_object36664:head# 2024-04-01T19:56:38.059 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c44637a:::benchmark_data_smithi188_161190_object134714:head# 2024-04-01T19:56:38.059 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c44c647:::benchmark_data_smithi188_161190_object54446:head# 2024-04-01T19:56:38.059 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c47010f:::benchmark_data_smithi188_161190_object65062:head# 2024-04-01T19:56:38.060 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c483440:::benchmark_data_smithi188_161190_object64687:head# 2024-04-01T19:56:38.060 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c48d4b0:::benchmark_data_smithi188_161190_object135371:head# 2024-04-01T19:56:38.060 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c491893:::benchmark_data_smithi188_161190_object126933:head# 2024-04-01T19:56:38.062 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c499a62:::benchmark_data_smithi188_161190_object111379:head# 2024-04-01T19:56:38.062 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c49b3b1:::benchmark_data_smithi188_161190_object40536:head# 2024-04-01T19:56:38.062 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c49be03:::benchmark_data_smithi188_161190_object46463:head# 2024-04-01T19:56:38.062 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c49e278:::benchmark_data_smithi188_161190_object96756:head# 2024-04-01T19:56:38.063 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c4b920c:::benchmark_data_smithi188_161190_object100031:head# 2024-04-01T19:56:38.063 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c4bacf4:::benchmark_data_smithi188_161190_object75219:head# 2024-04-01T19:56:38.064 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c4bc489:::benchmark_data_smithi188_161190_object130281:head# 2024-04-01T19:56:38.064 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c4d0f54:::benchmark_data_smithi188_161190_object68194:head# 2024-04-01T19:56:38.065 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c4d4783:::benchmark_data_smithi188_161190_object121512:head# 2024-04-01T19:56:38.065 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c4dde98:::benchmark_data_smithi188_161190_object30418:head# 2024-04-01T19:56:38.065 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c4e240b:::benchmark_data_smithi188_161190_object138740:head# 2024-04-01T19:56:38.067 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c4e5538:::benchmark_data_smithi188_161190_object66370:head# 2024-04-01T19:56:38.068 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c4ea58f:::benchmark_data_smithi188_161190_object40826:head# 2024-04-01T19:56:38.068 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c4f5d71:::benchmark_data_smithi188_161190_object87194:head# 2024-04-01T19:56:38.069 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c4f9084:::benchmark_data_smithi188_161190_object72265:head# 2024-04-01T19:56:38.069 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c500be5:::benchmark_data_smithi188_161190_object64237:head# 2024-04-01T19:56:38.071 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c5063a4:::benchmark_data_smithi188_161190_object20939:head# 2024-04-01T19:56:38.071 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c508243:::benchmark_data_smithi188_161190_object26693:head# 2024-04-01T19:56:38.071 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c510263:::benchmark_data_smithi188_161190_object108747:head# 2024-04-01T19:56:38.071 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c51b600:::benchmark_data_smithi188_161190_object102581:head# 2024-04-01T19:56:38.072 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c5311f1:::benchmark_data_smithi188_161190_object44738:head# 2024-04-01T19:56:38.072 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c535a11:::benchmark_data_smithi188_161190_object111008:head# 2024-04-01T19:56:38.072 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c5375d5:::benchmark_data_smithi188_161190_object61276:head# 2024-04-01T19:56:38.073 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c538d2f:::benchmark_data_smithi188_161190_object123888:head# 2024-04-01T19:56:38.076 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c53fbc3:::benchmark_data_smithi188_161190_object67236:head# 2024-04-01T19:56:38.076 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c543de8:::benchmark_data_smithi188_161190_object121706:head# 2024-04-01T19:56:38.076 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c54854a:::benchmark_data_smithi188_161190_object32466:head# 2024-04-01T19:56:38.076 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c5503d3:::benchmark_data_smithi188_161190_object41948:head# 2024-04-01T19:56:38.077 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c565deb:::benchmark_data_smithi188_161190_object135261:head# 2024-04-01T19:56:38.077 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c57af4e:::benchmark_data_smithi188_161190_object23321:head# 2024-04-01T19:56:38.077 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c5833d5:::benchmark_data_smithi188_161190_object113382:head# 2024-04-01T19:56:38.078 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c585934:::benchmark_data_smithi188_161190_object116264:head# 2024-04-01T19:56:38.078 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c595b58:::benchmark_data_smithi188_161190_object31367:head# 2024-04-01T19:56:38.078 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c597213:::benchmark_data_smithi188_161190_object79000:head# 2024-04-01T19:56:38.082 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c5a78b2:::benchmark_data_smithi188_161190_object111967:head# 2024-04-01T19:56:38.082 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c5a7fce:::benchmark_data_smithi188_161190_object27377:head# 2024-04-01T19:56:38.083 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c5adc25:::benchmark_data_smithi188_161190_object71230:head# 2024-04-01T19:56:38.083 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c5b23d1:::benchmark_data_smithi188_161190_object70561:head# 2024-04-01T19:56:38.083 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c5be967:::benchmark_data_smithi188_161190_object111771:head# 2024-04-01T19:56:38.083 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c5c92fe:::benchmark_data_smithi188_161190_object84466:head# 2024-04-01T19:56:38.084 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c5c9eae:::benchmark_data_smithi188_161190_object37587:head# 2024-04-01T19:56:38.084 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c5e1e86:::benchmark_data_smithi188_161190_object131964:head# 2024-04-01T19:56:38.084 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c5e2441:::benchmark_data_smithi188_161190_object119831:head# 2024-04-01T19:56:38.085 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c5e89fb:::benchmark_data_smithi188_161190_object104385:head# 2024-04-01T19:56:38.085 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c5eb74e:::benchmark_data_smithi188_161190_object85653:head# 2024-04-01T19:56:38.086 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c5ebc3c:::benchmark_data_smithi188_161190_object25791:head# 2024-04-01T19:56:38.089 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c5ebc7c:::benchmark_data_smithi188_161190_object55939:head# 2024-04-01T19:56:38.089 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c5f1dc8:::benchmark_data_smithi188_161190_object128599:head# 2024-04-01T19:56:38.089 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c60877e:::benchmark_data_smithi188_161190_object66424:head# 2024-04-01T19:56:38.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c60d249:::benchmark_data_smithi188_161190_object93837:head# 2024-04-01T19:56:38.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c61529d:::benchmark_data_smithi188_161190_object42001:head# 2024-04-01T19:56:38.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c61e7f3:::benchmark_data_smithi188_161190_object134397:head# 2024-04-01T19:56:38.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c620009:::benchmark_data_smithi188_161190_object22974:head# 2024-04-01T19:56:38.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c6203e7:::benchmark_data_smithi188_161190_object22172:head# 2024-04-01T19:56:38.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c620cda:::benchmark_data_smithi188_161190_object69351:head# 2024-04-01T19:56:38.090 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c63b2d1:::benchmark_data_smithi188_161190_object83844:head# 2024-04-01T19:56:38.095 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c640c92:::benchmark_data_smithi188_161190_object20678:head# 2024-04-01T19:56:38.096 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c648854:::benchmark_data_smithi188_161190_object61543:head# 2024-04-01T19:56:38.096 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c64f4af:::benchmark_data_smithi188_161190_object66144:head# 2024-04-01T19:56:38.096 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c658a17:::benchmark_data_smithi188_161190_object93498:head# 2024-04-01T19:56:38.096 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c65c444:::benchmark_data_smithi188_161190_object66702:head# 2024-04-01T19:56:38.096 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c65d997:::benchmark_data_smithi188_161190_object63712:head# 2024-04-01T19:56:38.096 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c668192:::benchmark_data_smithi188_161190_object102215:head# 2024-04-01T19:56:38.096 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c67bd58:::benchmark_data_smithi188_161190_object112324:head# 2024-04-01T19:56:38.096 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c67ea51:::benchmark_data_smithi188_161190_object72938:head# 2024-04-01T19:56:38.096 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c680b2a:::benchmark_data_smithi188_161190_object103793:head# 2024-04-01T19:56:38.097 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c6917d3:::benchmark_data_smithi188_161190_object25463:head# 2024-04-01T19:56:38.097 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c6a0b75:::benchmark_data_smithi188_161190_object24895:head# 2024-04-01T19:56:38.097 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c6a3e9b:::benchmark_data_smithi188_161190_object111327:head# 2024-04-01T19:56:38.098 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c6b3a9c:::benchmark_data_smithi188_161190_object76740:head# 2024-04-01T19:56:38.098 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c6b7989:::benchmark_data_smithi188_161190_object87014:head# 2024-04-01T19:56:38.098 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c6b8e11:::benchmark_data_smithi188_161190_object125044:head# 2024-04-01T19:56:38.099 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c6c0b94:::benchmark_data_smithi188_161190_object48822:head# 2024-04-01T19:56:38.099 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c6cc504:::benchmark_data_smithi188_161190_object76121:head# 2024-04-01T19:56:38.100 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c6d9373:::benchmark_data_smithi188_161190_object105699:head# 2024-04-01T19:56:38.102 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c6f4c6e:::benchmark_data_smithi188_161190_object28532:head# 2024-04-01T19:56:38.103 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c704503:::benchmark_data_smithi188_161190_object72147:head# 2024-04-01T19:56:38.104 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c7050ea:::benchmark_data_smithi188_161190_object22216:head# 2024-04-01T19:56:38.104 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c709b5c:::benchmark_data_smithi188_161190_object121947:head# 2024-04-01T19:56:38.105 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c714bea:::benchmark_data_smithi188_161190_object52630:head# 2024-04-01T19:56:38.105 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c71b8f6:::benchmark_data_smithi188_161190_object79838:head# 2024-04-01T19:56:38.106 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c71e24b:::benchmark_data_smithi188_161190_object95217:head# 2024-04-01T19:56:38.106 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c72eb93:::benchmark_data_smithi188_161190_object22059:head# 2024-04-01T19:56:38.106 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c740c23:::benchmark_data_smithi188_161190_object24600:head# 2024-04-01T19:56:38.107 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c746c86:::benchmark_data_smithi188_161190_object101605:head# 2024-04-01T19:56:38.110 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c749030:::benchmark_data_smithi188_161190_object70630:head# 2024-04-01T19:56:38.120 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c75480d:::benchmark_data_smithi188_161190_object117631:head# 2024-04-01T19:56:38.125 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c7818cd:::benchmark_data_smithi188_161190_object124351:head# 2024-04-01T19:56:38.125 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c78c3b3:::benchmark_data_smithi188_161190_object53064:head# 2024-04-01T19:56:38.125 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c79eb01:::benchmark_data_smithi188_161190_object20764:head# 2024-04-01T19:56:38.126 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c7ad720:::benchmark_data_smithi188_161190_object19836:head# 2024-04-01T19:56:38.126 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c7b0ce2:::benchmark_data_smithi188_161190_object137113:head# 2024-04-01T19:56:38.126 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c7b8c0f:::benchmark_data_smithi188_161190_object24642:head# 2024-04-01T19:56:38.127 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c7bbb4c:::benchmark_data_smithi188_161190_object61362:head# 2024-04-01T19:56:38.127 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c7d1e19:::benchmark_data_smithi188_161190_object91015:head# 2024-04-01T19:56:38.128 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c7d7982:::benchmark_data_smithi188_161190_object126081:head# 2024-04-01T19:56:38.129 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c7def4b:::benchmark_data_smithi188_161190_object68003:head# 2024-04-01T19:56:38.129 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c7e1d87:::benchmark_data_smithi188_161190_object128381:head# 2024-04-01T19:56:38.129 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c7f0851:::benchmark_data_smithi188_161190_object29766:head# 2024-04-01T19:56:38.130 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c7f1085:::benchmark_data_smithi188_161190_object37780:head# 2024-04-01T19:56:38.130 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c800cb5:::benchmark_data_smithi188_161190_object107449:head# 2024-04-01T19:56:38.131 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c8029d4:::benchmark_data_smithi188_161190_object104378:head# 2024-04-01T19:56:38.131 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c807d24:::benchmark_data_smithi188_161190_object54975:head# 2024-04-01T19:56:38.136 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c814d69:::benchmark_data_smithi188_161190_object108307:head# 2024-04-01T19:56:38.136 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c81f66a:::benchmark_data_smithi188_161190_object79743:head# 2024-04-01T19:56:38.137 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c8215fb:::benchmark_data_smithi188_161190_object63887:head# 2024-04-01T19:56:38.137 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c830174:::benchmark_data_smithi188_161190_object37823:head# 2024-04-01T19:56:38.137 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c8380e8:::benchmark_data_smithi188_161190_object40354:head# 2024-04-01T19:56:38.138 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c8401d8:::benchmark_data_smithi188_161190_object53246:head# 2024-04-01T19:56:38.138 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c8484de:::benchmark_data_smithi188_161190_object126998:head# 2024-04-01T19:56:38.139 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c84d770:::benchmark_data_smithi188_161190_object136488:head# 2024-04-01T19:56:38.139 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c854ef2:::benchmark_data_smithi188_161190_object123154:head# 2024-04-01T19:56:38.139 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c85ce91:::benchmark_data_smithi188_161190_object129070:head# 2024-04-01T19:56:38.140 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c85d52a:::benchmark_data_smithi188_161190_object135767:head# 2024-04-01T19:56:38.140 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c865271:::benchmark_data_smithi188_161190_object77188:head# 2024-04-01T19:56:38.141 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c8667cb:::benchmark_data_smithi188_161190_object50202:head# 2024-04-01T19:56:38.141 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c869183:::benchmark_data_smithi188_161190_object81815:head# 2024-04-01T19:56:38.142 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c86d998:::benchmark_data_smithi188_161190_object120647:head# 2024-04-01T19:56:38.142 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c889164:::benchmark_data_smithi188_161190_object20613:head# 2024-04-01T19:56:38.142 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c88baff:::benchmark_data_smithi188_161190_object40075:head# 2024-04-01T19:56:38.143 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c88fe9f:::benchmark_data_smithi188_161190_object103171:head# 2024-04-01T19:56:38.143 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c891501:::benchmark_data_smithi188_161190_object137882:head# 2024-04-01T19:56:38.144 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c898216:::benchmark_data_smithi188_161190_object125016:head# 2024-04-01T19:56:38.144 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c8a3d19:::benchmark_data_smithi188_161190_object28783:head# 2024-04-01T19:56:38.144 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c8b0862:::benchmark_data_smithi188_161190_object43515:head# 2024-04-01T19:56:38.145 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c8b1003:::benchmark_data_smithi188_161190_object94851:head# 2024-04-01T19:56:38.145 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c8b24b5:::benchmark_data_smithi188_161190_object92147:head# 2024-04-01T19:56:38.145 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c8b6201:::benchmark_data_smithi188_161190_object62275:head# 2024-04-01T19:56:38.146 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c8bd462:::benchmark_data_smithi188_161190_object43315:head# 2024-04-01T19:56:38.146 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c8c90f9:::benchmark_data_smithi188_161190_object83822:head# 2024-04-01T19:56:38.147 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c8df80a:::benchmark_data_smithi188_161190_object91878:head# 2024-04-01T19:56:38.147 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c8e763e:::benchmark_data_smithi188_161190_object104342:head# 2024-04-01T19:56:38.148 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c8e9c68:::benchmark_data_smithi188_161190_object81611:head# 2024-04-01T19:56:38.148 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c8ea1ff:::benchmark_data_smithi188_161190_object51996:head# 2024-04-01T19:56:38.148 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c8ea3cd:::benchmark_data_smithi188_161190_object43634:head# 2024-04-01T19:56:38.149 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c8ea619:::benchmark_data_smithi188_161190_object25547:head# 2024-04-01T19:56:38.150 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c8eafb9:::benchmark_data_smithi188_161190_object137671:head# 2024-04-01T19:56:38.150 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c8f014e:::benchmark_data_smithi188_161190_object112540:head# 2024-04-01T19:56:38.151 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c8f8e1b:::benchmark_data_smithi188_161190_object31510:head# 2024-04-01T19:56:38.151 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c901932:::benchmark_data_smithi188_161190_object106390:head# 2024-04-01T19:56:38.151 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c91841f:::benchmark_data_smithi188_161190_object85534:head# 2024-04-01T19:56:38.152 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c91e600:::benchmark_data_smithi188_161190_object84790:head# 2024-04-01T19:56:38.152 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c947040:::benchmark_data_smithi188_161190_object105058:head# 2024-04-01T19:56:38.152 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c949262:::benchmark_data_smithi188_161190_object50592:head# 2024-04-01T19:56:38.153 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c95c2a3:::benchmark_data_smithi188_161190_object33053:head# 2024-04-01T19:56:38.153 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c96a1dd:::benchmark_data_smithi188_161190_object21357:head# 2024-04-01T19:56:38.153 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c96e70e:::benchmark_data_smithi188_161190_object76122:head# 2024-04-01T19:56:38.154 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c974ae8:::benchmark_data_smithi188_161190_object46554:head# 2024-04-01T19:56:38.154 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c976f8a:::benchmark_data_smithi188_161190_object93212:head# 2024-04-01T19:56:38.155 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c97a787:::benchmark_data_smithi188_161190_object61226:head# 2024-04-01T19:56:38.155 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c97a7d9:::benchmark_data_smithi188_161190_object130678:head# 2024-04-01T19:56:38.155 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c990b1a:::benchmark_data_smithi188_161190_object94488:head# 2024-04-01T19:56:38.156 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c996ae9:::benchmark_data_smithi188_161190_object48326:head# 2024-04-01T19:56:38.156 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c9a1359:::benchmark_data_smithi188_161190_object82022:head# 2024-04-01T19:56:38.157 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c9a1d8d:::benchmark_data_smithi188_161190_object54972:head# 2024-04-01T19:56:38.157 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c9a5cd1:::benchmark_data_smithi188_161190_object86454:head# 2024-04-01T19:56:38.158 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c9b5526:::benchmark_data_smithi188_161190_object125336:head# 2024-04-01T19:56:38.158 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c9c2e53:::benchmark_data_smithi188_161190_object60402:head# 2024-04-01T19:56:38.159 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c9c8b38:::benchmark_data_smithi188_161190_object79248:head# 2024-04-01T19:56:38.159 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c9ca5ce:::benchmark_data_smithi188_161190_object21248:head# 2024-04-01T19:56:38.159 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c9faf99:::benchmark_data_smithi188_161190_object67553:head# 2024-04-01T19:56:38.159 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9c9fe37d:::benchmark_data_smithi188_161190_object105209:head# 2024-04-01T19:56:38.160 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ca0d287:::benchmark_data_smithi188_161190_object127049:head# 2024-04-01T19:56:38.163 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ca103c0:::benchmark_data_smithi188_161190_object116545:head# 2024-04-01T19:56:38.163 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ca1bdd5:::benchmark_data_smithi188_161190_object89188:head# 2024-04-01T19:56:38.164 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ca1c30d:::benchmark_data_smithi188_161190_object74011:head# 2024-04-01T19:56:38.164 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ca1cc65:::benchmark_data_smithi188_161190_object134274:head# 2024-04-01T19:56:38.164 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ca4cf7a:::benchmark_data_smithi188_161190_object93233:head# 2024-04-01T19:56:38.164 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ca4fc7c:::benchmark_data_smithi188_161190_object120432:head# 2024-04-01T19:56:38.164 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ca4ff91:::benchmark_data_smithi188_161190_object24480:head# 2024-04-01T19:56:38.164 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ca509db:::benchmark_data_smithi188_161190_object139256:head# 2024-04-01T19:56:38.165 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ca5a159:::benchmark_data_smithi188_161190_object57828:head# 2024-04-01T19:56:38.165 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ca89d12:::benchmark_data_smithi188_161190_object51674:head# 2024-04-01T19:56:38.165 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9caa03a4:::benchmark_data_smithi188_161190_object80383:head# 2024-04-01T19:56:38.165 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9caa3f6f:::benchmark_data_smithi188_161190_object63024:head# 2024-04-01T19:56:38.166 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cab827f:::benchmark_data_smithi188_161190_object47999:head# 2024-04-01T19:56:38.168 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cac5bef:::benchmark_data_smithi188_161190_object107418:head# 2024-04-01T19:56:38.168 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cacb00c:::benchmark_data_smithi188_161190_object132738:head# 2024-04-01T19:56:38.169 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cacc737:::benchmark_data_smithi188_161190_object30861:head# 2024-04-01T19:56:38.169 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cad6463:::benchmark_data_smithi188_161190_object20349:head# 2024-04-01T19:56:38.169 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cadf9b1:::benchmark_data_smithi188_161190_object45214:head# 2024-04-01T19:56:38.175 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9caeb50c:::benchmark_data_smithi188_161190_object23884:head# 2024-04-01T19:56:38.175 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9caeb57b:::benchmark_data_smithi188_161190_object23501:head# 2024-04-01T19:56:38.175 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9caf2ec9:::benchmark_data_smithi188_161190_object125228:head# 2024-04-01T19:56:38.175 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9caf5013:::benchmark_data_smithi188_161190_object52519:head# 2024-04-01T19:56:38.176 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9caf96b8:::benchmark_data_smithi188_161190_object67096:head# 2024-04-01T19:56:38.176 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cb078e8:::benchmark_data_smithi188_161190_object129014:head# 2024-04-01T19:56:38.176 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cb0c39b:::benchmark_data_smithi188_161190_object81402:head# 2024-04-01T19:56:38.176 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cb146a8:::benchmark_data_smithi188_161190_object130366:head# 2024-04-01T19:56:38.176 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cb17fb4:::benchmark_data_smithi188_161190_object102609:head# 2024-04-01T19:56:38.176 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cb2a844:::benchmark_data_smithi188_161190_object131510:head# 2024-04-01T19:56:38.176 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cb2bb93:::benchmark_data_smithi188_161190_object20151:head# 2024-04-01T19:56:38.176 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cb32e84:::benchmark_data_smithi188_161190_object39925:head# 2024-04-01T19:56:38.176 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cb336e2:::benchmark_data_smithi188_161190_object124899:head# 2024-04-01T19:56:38.177 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cb43692:::benchmark_data_smithi188_161190_object98133:head# 2024-04-01T19:56:38.177 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cb467eb:::benchmark_data_smithi188_161190_object45874:head# 2024-04-01T19:56:38.177 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cb6106c:::benchmark_data_smithi188_161190_object75913:head# 2024-04-01T19:56:38.177 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cb65694:::benchmark_data_smithi188_161190_object98056:head# 2024-04-01T19:56:38.178 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cb656c7:::benchmark_data_smithi188_161190_object85956:head# 2024-04-01T19:56:38.178 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cb6cf39:::benchmark_data_smithi188_161190_object120754:head# 2024-04-01T19:56:38.179 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cb73993:::benchmark_data_smithi188_161190_object76123:head# 2024-04-01T19:56:38.179 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cb936c0:::benchmark_data_smithi188_161190_object130585:head# 2024-04-01T19:56:38.181 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cb94648:::benchmark_data_smithi188_161190_object81999:head# 2024-04-01T19:56:38.181 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cb9e944:::benchmark_data_smithi188_161190_object79724:head# 2024-04-01T19:56:38.181 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cba288b:::benchmark_data_smithi188_161190_object61957:head# 2024-04-01T19:56:38.181 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cba3baf:::benchmark_data_smithi188_161190_object94696:head# 2024-04-01T19:56:38.181 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cbad61d:::benchmark_data_smithi188_161190_object90221:head# 2024-04-01T19:56:38.182 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cbad6c2:::benchmark_data_smithi188_161190_object62080:head# 2024-04-01T19:56:38.182 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cbb5a0a:::benchmark_data_smithi188_161190_object38011:head# 2024-04-01T19:56:38.183 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cbcba0e:::benchmark_data_smithi188_161190_object85284:head# 2024-04-01T19:56:38.183 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cbcc933:::benchmark_data_smithi188_161190_object111348:head# 2024-04-01T19:56:38.183 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cbd15da:::benchmark_data_smithi188_161190_object84428:head# 2024-04-01T19:56:38.184 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cbd41e1:::benchmark_data_smithi188_161190_object79482:head# 2024-04-01T19:56:38.184 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cbdf964:::benchmark_data_smithi188_161190_object46048:head# 2024-04-01T19:56:38.185 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cbe656e:::benchmark_data_smithi188_161190_object133135:head# 2024-04-01T19:56:38.185 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cbe86fe:::benchmark_data_smithi188_161190_object119441:head# 2024-04-01T19:56:38.186 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cbe9991:::benchmark_data_smithi188_161190_object22859:head# 2024-04-01T19:56:38.186 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cbfaeaa:::benchmark_data_smithi188_161190_object102904:head# 2024-04-01T19:56:38.187 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cc03fd3:::benchmark_data_smithi188_161190_object129539:head# 2024-04-01T19:56:38.187 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cc049b9:::benchmark_data_smithi188_161190_object32479:head# 2024-04-01T19:56:38.188 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cc09156:::benchmark_data_smithi188_161190_object32157:head# 2024-04-01T19:56:38.188 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cc0b79b:::benchmark_data_smithi188_161190_object28430:head# 2024-04-01T19:56:38.188 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cc16951:::benchmark_data_smithi188_161190_object117750:head# 2024-04-01T19:56:38.189 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cc1dcff:::benchmark_data_smithi188_161190_object123367:head# 2024-04-01T19:56:38.189 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cc2224f:::benchmark_data_smithi188_161190_object101806:head# 2024-04-01T19:56:38.190 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cc3e661:::benchmark_data_smithi188_161190_object91031:head# 2024-04-01T19:56:38.190 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cc50e15:::benchmark_data_smithi188_161190_object131973:head# 2024-04-01T19:56:38.191 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cc59c4b:::benchmark_data_smithi188_161190_object26126:head# 2024-04-01T19:56:38.193 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cc5e099:::benchmark_data_smithi188_161190_object49592:head# 2024-04-01T19:56:38.194 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cc5feb6:::benchmark_data_smithi188_161190_object99283:head# 2024-04-01T19:56:38.194 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cc606f9:::benchmark_data_smithi188_161190_object104571:head# 2024-04-01T19:56:38.195 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cc6b317:::benchmark_data_smithi188_161190_object100622:head# 2024-04-01T19:56:38.195 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cc6d9df:::benchmark_data_smithi188_161190_object88881:head# 2024-04-01T19:56:38.196 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cc78717:::benchmark_data_smithi188_161190_object91651:head# 2024-04-01T19:56:38.196 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cc83526:::benchmark_data_smithi188_161190_object82106:head# 2024-04-01T19:56:38.196 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cc8e6df:::benchmark_data_smithi188_161190_object99221:head# 2024-04-01T19:56:38.197 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cc98f2f:::benchmark_data_smithi188_161190_object27862:head# 2024-04-01T19:56:38.197 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cc9a707:::benchmark_data_smithi188_161190_object119897:head# 2024-04-01T19:56:38.198 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cc9ed75:::benchmark_data_smithi188_161190_object50997:head# 2024-04-01T19:56:38.198 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ccb0822:::benchmark_data_smithi188_161190_object132205:head# 2024-04-01T19:56:38.198 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ccb32a7:::benchmark_data_smithi188_161190_object65674:head# 2024-04-01T19:56:38.199 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ccb7779:::benchmark_data_smithi188_161190_object47776:head# 2024-04-01T19:56:38.199 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ccb77b4:::benchmark_data_smithi188_161190_object129231:head# 2024-04-01T19:56:38.200 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ccc7ae9:::benchmark_data_smithi188_161190_object94263:head# 2024-04-01T19:56:38.200 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ccd9dd8:::benchmark_data_smithi188_161190_object44289:head# 2024-04-01T19:56:38.204 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ccdbaec:::benchmark_data_smithi188_161190_object120618:head# 2024-04-01T19:56:38.204 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cce400c:::benchmark_data_smithi188_161190_object22034:head# 2024-04-01T19:56:38.204 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ccf37b1:::benchmark_data_smithi188_161190_object67597:head# 2024-04-01T19:56:38.207 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ccf479c:::benchmark_data_smithi188_161190_object48792:head# 2024-04-01T19:56:38.207 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ccfd394:::benchmark_data_smithi188_161190_object34961:head# 2024-04-01T19:56:38.207 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cd0d903:::benchmark_data_smithi188_161190_object85420:head# 2024-04-01T19:56:38.208 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cd10e1b:::benchmark_data_smithi188_161190_object87523:head# 2024-04-01T19:56:38.208 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cd1a4bd:::benchmark_data_smithi188_161190_object92314:head# 2024-04-01T19:56:38.213 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cd25f77:::benchmark_data_smithi188_161190_object57757:head# 2024-04-01T19:56:38.213 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cd2a0bb:::benchmark_data_smithi188_161190_object59226:head# 2024-04-01T19:56:38.213 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cd33d2d:::benchmark_data_smithi188_161190_object31124:head# 2024-04-01T19:56:38.214 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cd371eb:::benchmark_data_smithi188_161190_object60127:head# 2024-04-01T19:56:38.214 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cd37c37:::benchmark_data_smithi188_161190_object36848:head# 2024-04-01T19:56:38.215 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cd44cc9:::benchmark_data_smithi188_161190_object127083:head# 2024-04-01T19:56:38.215 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cd6421e:::benchmark_data_smithi188_161190_object110320:head# 2024-04-01T19:56:38.215 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cd6b08f:::benchmark_data_smithi188_161190_object134865:head# 2024-04-01T19:56:38.216 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cd76d02:::benchmark_data_smithi188_161190_object39620:head# 2024-04-01T19:56:38.216 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cd7aca2:::benchmark_data_smithi188_161190_object72411:head# 2024-04-01T19:56:38.217 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cd91bef:::benchmark_data_smithi188_161190_object94846:head# 2024-04-01T19:56:38.217 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cd965df:::benchmark_data_smithi188_161190_object116017:head# 2024-04-01T19:56:38.217 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cd9ffa5:::benchmark_data_smithi188_161190_object126237:head# 2024-04-01T19:56:38.218 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cda3bc7:::benchmark_data_smithi188_161190_object58234:head# 2024-04-01T19:56:38.220 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cdac4cd:::benchmark_data_smithi188_161190_object72645:head# 2024-04-01T19:56:38.220 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cdb248f:::benchmark_data_smithi188_161190_object118199:head# 2024-04-01T19:56:38.221 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cdb607e:::benchmark_data_smithi188_161190_object55416:head# 2024-04-01T19:56:38.221 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cdc1409:::benchmark_data_smithi188_161190_object112552:head# 2024-04-01T19:56:38.221 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cdcad77:::benchmark_data_smithi188_161190_object21482:head# 2024-04-01T19:56:38.222 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cdd2651:::benchmark_data_smithi188_161190_object105224:head# 2024-04-01T19:56:38.222 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cdd2709:::benchmark_data_smithi188_161190_object96494:head# 2024-04-01T19:56:38.223 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cdd8c46:::benchmark_data_smithi188_161190_object83116:head# 2024-04-01T19:56:38.223 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cdd8ffd:::benchmark_data_smithi188_161190_object57267:head# 2024-04-01T19:56:38.224 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cdde082:::benchmark_data_smithi188_161190_object60576:head# 2024-04-01T19:56:38.224 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cdeaf2d:::benchmark_data_smithi188_161190_object35588:head# 2024-04-01T19:56:38.224 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cdf53c0:::benchmark_data_smithi188_161190_object86234:head# 2024-04-01T19:56:38.225 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cdf92dc:::benchmark_data_smithi188_161190_object50511:head# 2024-04-01T19:56:38.225 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cdfe497:::benchmark_data_smithi188_161190_object63913:head# 2024-04-01T19:56:38.226 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ce08f9d:::benchmark_data_smithi188_161190_object133642:head# 2024-04-01T19:56:38.226 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ce2ef65:::benchmark_data_smithi188_161190_object88869:head# 2024-04-01T19:56:38.227 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ce3c3c1:::benchmark_data_smithi188_161190_object138774:head# 2024-04-01T19:56:38.227 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ce4197b:::benchmark_data_smithi188_161190_object74671:head# 2024-04-01T19:56:38.227 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ce66b68:::benchmark_data_smithi188_161190_object60874:head# 2024-04-01T19:56:38.228 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ce6976d:::benchmark_data_smithi188_161190_object101699:head# 2024-04-01T19:56:38.228 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ce6d377:::benchmark_data_smithi188_161190_object56677:head# 2024-04-01T19:56:38.228 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ce73a8c:::benchmark_data_smithi188_161190_object66773:head# 2024-04-01T19:56:38.229 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ce7738e:::benchmark_data_smithi188_161190_object109010:head# 2024-04-01T19:56:38.229 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ce77f4f:::benchmark_data_smithi188_161190_object62424:head# 2024-04-01T19:56:38.229 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ce926fa:::benchmark_data_smithi188_161190_object70281:head# 2024-04-01T19:56:38.230 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ce98c31:::benchmark_data_smithi188_161190_object30586:head# 2024-04-01T19:56:38.230 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ce9f365:::benchmark_data_smithi188_161190_object60224:head# 2024-04-01T19:56:38.231 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ce9f973:::benchmark_data_smithi188_161190_object135243:head# 2024-04-01T19:56:38.232 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cead2f6:::benchmark_data_smithi188_161190_object121258:head# 2024-04-01T19:56:38.233 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ceb2280:::benchmark_data_smithi188_161190_object129330:head# 2024-04-01T19:56:38.233 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cebf798:::benchmark_data_smithi188_161190_object132189:head# 2024-04-01T19:56:38.234 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cec7c41:::benchmark_data_smithi188_161190_object44811:head# 2024-04-01T19:56:38.235 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cee6450:::benchmark_data_smithi188_161190_object28802:head# 2024-04-01T19:56:38.242 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cef57eb:::benchmark_data_smithi188_161190_object23841:head# 2024-04-01T19:56:38.242 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cef7b37:::benchmark_data_smithi188_161190_object129943:head# 2024-04-01T19:56:38.243 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cf035ae:::benchmark_data_smithi188_161190_object121144:head# 2024-04-01T19:56:38.243 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cf1bc4b:::benchmark_data_smithi188_161190_object112853:head# 2024-04-01T19:56:38.243 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cf1c481:::benchmark_data_smithi188_161190_object84289:head# 2024-04-01T19:56:38.243 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cf20d0c:::benchmark_data_smithi188_161190_object65108:head# 2024-04-01T19:56:38.243 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cf2629e:::benchmark_data_smithi188_161190_object130284:head# 2024-04-01T19:56:38.243 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cf328d8:::benchmark_data_smithi188_161190_object68438:head# 2024-04-01T19:56:38.243 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cf36e3f:::benchmark_data_smithi188_161190_object63189:head# 2024-04-01T19:56:38.243 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cf37f66:::benchmark_data_smithi188_161190_object22335:head# 2024-04-01T19:56:38.243 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cf39edf:::benchmark_data_smithi188_161190_object52496:head# 2024-04-01T19:56:38.243 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cf3e367:::benchmark_data_smithi188_161190_object68539:head# 2024-04-01T19:56:38.243 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cf3fec3:::benchmark_data_smithi188_161190_object101719:head# 2024-04-01T19:56:38.243 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cf47277:::benchmark_data_smithi188_161190_object72096:head# 2024-04-01T19:56:38.243 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cf56d61:::benchmark_data_smithi188_161190_object123259:head# 2024-04-01T19:56:38.244 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cf58185:::benchmark_data_smithi188_161190_object120331:head# 2024-04-01T19:56:38.244 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cf640f7:::benchmark_data_smithi188_161190_object66658:head# 2024-04-01T19:56:38.244 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cf6b9b0:::benchmark_data_smithi188_161190_object87137:head# 2024-04-01T19:56:38.244 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cf6c980:::benchmark_data_smithi188_161190_object124750:head# 2024-04-01T19:56:38.244 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cf7a2b9:::benchmark_data_smithi188_161190_object75631:head# 2024-04-01T19:56:38.244 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cf81adb:::benchmark_data_smithi188_161190_object51603:head# 2024-04-01T19:56:38.246 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cf89d96:::benchmark_data_smithi188_161190_object60980:head# 2024-04-01T19:56:38.246 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cf8b372:::benchmark_data_smithi188_161190_object127452:head# 2024-04-01T19:56:38.247 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cf90402:::benchmark_data_smithi188_161190_object48013:head# 2024-04-01T19:56:38.247 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cfc4b82:::benchmark_data_smithi188_161190_object69045:head# 2024-04-01T19:56:38.247 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cfc99e8:::benchmark_data_smithi188_161190_object54396:head# 2024-04-01T19:56:38.249 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cfd4d2e:::benchmark_data_smithi188_161190_object75773:head# 2024-04-01T19:56:38.250 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cfe821b:::benchmark_data_smithi188_161190_object94801:head# 2024-04-01T19:56:38.250 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cfed68d:::benchmark_data_smithi188_161190_object51451:head# 2024-04-01T19:56:38.256 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cff2c25:::benchmark_data_smithi188_161190_object102077:head# 2024-04-01T19:56:38.256 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cff6603:::benchmark_data_smithi188_161190_object114374:head# 2024-04-01T19:56:38.256 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9cffc4dd:::benchmark_data_smithi188_161190_object128074:head# 2024-04-01T19:56:38.256 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d00979e:::benchmark_data_smithi188_161190_object50880:head# 2024-04-01T19:56:38.256 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d00bdb6:::benchmark_data_smithi188_161190_object112001:head# 2024-04-01T19:56:38.256 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d01503f:::benchmark_data_smithi188_161190_object33722:head# 2024-04-01T19:56:38.256 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d01c33f:::benchmark_data_smithi188_161190_object92386:head# 2024-04-01T19:56:38.257 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d02c4a1:::benchmark_data_smithi188_161190_object139091:head# 2024-04-01T19:56:38.257 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d040acb:::benchmark_data_smithi188_161190_object97456:head# 2024-04-01T19:56:38.257 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d04f802:::benchmark_data_smithi188_161190_object102603:head# 2024-04-01T19:56:38.257 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d054dbe:::benchmark_data_smithi188_161190_object23912:head# 2024-04-01T19:56:38.257 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d058071:::benchmark_data_smithi188_161190_object103882:head# 2024-04-01T19:56:38.257 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d059ae0:::benchmark_data_smithi188_161190_object134026:head# 2024-04-01T19:56:38.257 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d06133d:::benchmark_data_smithi188_161190_object86631:head# 2024-04-01T19:56:38.258 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d06cb64:::benchmark_data_smithi188_161190_object113934:head# 2024-04-01T19:56:38.258 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d06ecb4:::benchmark_data_smithi188_161190_object36953:head# 2024-04-01T19:56:38.258 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d08d96c:::benchmark_data_smithi188_161190_object21141:head# 2024-04-01T19:56:38.259 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d091ae1:::benchmark_data_smithi188_161190_object45909:head# 2024-04-01T19:56:38.261 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d09fa67:::benchmark_data_smithi188_161190_object92321:head# 2024-04-01T19:56:38.261 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d0a74b3:::benchmark_data_smithi188_161190_object107608:head# 2024-04-01T19:56:38.264 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d0afedd:::benchmark_data_smithi188_161190_object130297:head# 2024-04-01T19:56:38.264 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d0b3446:::benchmark_data_smithi188_161190_object22433:head# 2024-04-01T19:56:38.265 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d0b3922:::benchmark_data_smithi188_161190_object133275:head# 2024-04-01T19:56:38.265 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d0e4ef7:::benchmark_data_smithi188_161190_object40915:head# 2024-04-01T19:56:38.265 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d0e92df:::benchmark_data_smithi188_161190_object85057:head# 2024-04-01T19:56:38.265 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d0eef9b:::benchmark_data_smithi188_161190_object135844:head# 2024-04-01T19:56:38.265 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d0ff619:::benchmark_data_smithi188_161190_object64493:head# 2024-04-01T19:56:38.265 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d1055c7:::benchmark_data_smithi188_161190_object109709:head# 2024-04-01T19:56:38.265 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d125f5e:::benchmark_data_smithi188_161190_object29077:head# 2024-04-01T19:56:38.265 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d12f17c:::benchmark_data_smithi188_161190_object135578:head# 2024-04-01T19:56:38.265 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d1325b7:::benchmark_data_smithi188_161190_object60860:head# 2024-04-01T19:56:38.268 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d14bdbe:::benchmark_data_smithi188_161190_object70353:head# 2024-04-01T19:56:38.269 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d14d6af:::benchmark_data_smithi188_161190_object121283:head# 2024-04-01T19:56:38.269 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d152379:::benchmark_data_smithi188_161190_object58819:head# 2024-04-01T19:56:38.269 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d156a36:::benchmark_data_smithi188_161190_object56387:head# 2024-04-01T19:56:38.270 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d1634a4:::benchmark_data_smithi188_161190_object47876:head# 2024-04-01T19:56:38.270 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d17067a:::benchmark_data_smithi188_161190_object21792:head# 2024-04-01T19:56:38.271 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d170bd2:::benchmark_data_smithi188_161190_object109264:head# 2024-04-01T19:56:38.271 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d171199:::benchmark_data_smithi188_161190_object65220:head# 2024-04-01T19:56:38.272 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d178f9a:::benchmark_data_smithi188_161190_object20565:head# 2024-04-01T19:56:38.272 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d187db3:::benchmark_data_smithi188_161190_object75336:head# 2024-04-01T19:56:38.272 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d19bdf8:::benchmark_data_smithi188_161190_object55846:head# 2024-04-01T19:56:38.273 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d1ad184:::benchmark_data_smithi188_161190_object106317:head# 2024-04-01T19:56:38.273 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d1be487:::benchmark_data_smithi188_161190_object121402:head# 2024-04-01T19:56:38.274 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d1c7b05:::benchmark_data_smithi188_161190_object35034:head# 2024-04-01T19:56:38.274 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d1cb1f9:::benchmark_data_smithi188_161190_object111093:head# 2024-04-01T19:56:38.275 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d1d6cd6:::benchmark_data_smithi188_161190_object71708:head# 2024-04-01T19:56:38.275 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d1e8058:::benchmark_data_smithi188_161190_object77582:head# 2024-04-01T19:56:38.275 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d1ec21e:::benchmark_data_smithi188_161190_object38801:head# 2024-04-01T19:56:38.276 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d1f55e1:::benchmark_data_smithi188_161190_object63437:head# 2024-04-01T19:56:38.277 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d1fc3b3:::benchmark_data_smithi188_161190_object68555:head# 2024-04-01T19:56:38.277 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d2138d9:::benchmark_data_smithi188_161190_object84585:head# 2024-04-01T19:56:38.278 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d215c26:::benchmark_data_smithi188_161190_object78806:head# 2024-04-01T19:56:38.278 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d222552:::benchmark_data_smithi188_161190_object69540:head# 2024-04-01T19:56:38.278 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d235b75:::benchmark_data_smithi188_161190_object97886:head# 2024-04-01T19:56:38.279 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d235ba2:::benchmark_data_smithi188_161190_object115631:head# 2024-04-01T19:56:38.279 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d24c65b:::benchmark_data_smithi188_161190_object57531:head# 2024-04-01T19:56:38.280 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d251990:::benchmark_data_smithi188_161190_object47039:head# 2024-04-01T19:56:38.280 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d257402:::benchmark_data_smithi188_161190_object118351:head# 2024-04-01T19:56:38.281 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d25bc70:::benchmark_data_smithi188_161190_object105484:head# 2024-04-01T19:56:38.281 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d25e5e6:::benchmark_data_smithi188_161190_object20359:head# 2024-04-01T19:56:38.282 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d26f257:::benchmark_data_smithi188_161190_object93879:head# 2024-04-01T19:56:38.282 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d273bf9:::benchmark_data_smithi188_161190_object83830:head# 2024-04-01T19:56:38.288 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d27a711:::benchmark_data_smithi188_161190_object104292:head# 2024-04-01T19:56:38.289 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d28ce43:::benchmark_data_smithi188_161190_object40483:head# 2024-04-01T19:56:38.289 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d28f966:::benchmark_data_smithi188_161190_object105411:head# 2024-04-01T19:56:38.289 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d295d8f:::benchmark_data_smithi188_161190_object124421:head# 2024-04-01T19:56:38.290 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d29d22c:::benchmark_data_smithi188_161190_object114333:head# 2024-04-01T19:56:38.290 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d2a289e:::benchmark_data_smithi188_161190_object75427:head# 2024-04-01T19:56:38.291 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d2a7425:::benchmark_data_smithi188_161190_object98461:head# 2024-04-01T19:56:38.291 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d2ac736:::benchmark_data_smithi188_161190_object48937:head# 2024-04-01T19:56:38.292 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d2ae031:::benchmark_data_smithi188_161190_object30786:head# 2024-04-01T19:56:38.292 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d2b185d:::benchmark_data_smithi188_161190_object27207:head# 2024-04-01T19:56:38.293 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d2c119d:::benchmark_data_smithi188_161190_object29665:head# 2024-04-01T19:56:38.293 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d2c2eff:::benchmark_data_smithi188_161190_object40738:head# 2024-04-01T19:56:38.294 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d2cf74c:::benchmark_data_smithi188_161190_object23650:head# 2024-04-01T19:56:38.294 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d2de3a5:::benchmark_data_smithi188_161190_object59677:head# 2024-04-01T19:56:38.295 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d2e1709:::benchmark_data_smithi188_161190_object115358:head# 2024-04-01T19:56:38.295 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d2ea4df:::benchmark_data_smithi188_161190_object43798:head# 2024-04-01T19:56:38.296 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d2f3474:::benchmark_data_smithi188_161190_object119303:head# 2024-04-01T19:56:38.296 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d2fc83c:::benchmark_data_smithi188_161190_object64643:head# 2024-04-01T19:56:38.303 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d2feb91:::benchmark_data_smithi188_161190_object128380:head# 2024-04-01T19:56:38.304 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d30175f:::benchmark_data_smithi188_161190_object63505:head# 2024-04-01T19:56:38.304 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d313f12:::benchmark_data_smithi188_161190_object135139:head# 2024-04-01T19:56:38.304 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d31c304:::benchmark_data_smithi188_161190_object138200:head# 2024-04-01T19:56:38.304 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d321545:::benchmark_data_smithi188_161190_object48827:head# 2024-04-01T19:56:38.304 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d327a21:::benchmark_data_smithi188_161190_object48500:head# 2024-04-01T19:56:38.304 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d34d292:::benchmark_data_smithi188_161190_object124252:head# 2024-04-01T19:56:38.304 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d34e935:::benchmark_data_smithi188_161190_object93615:head# 2024-04-01T19:56:38.304 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d34fe80:::benchmark_data_smithi188_161190_object74498:head# 2024-04-01T19:56:38.304 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d3636e7:::benchmark_data_smithi188_161190_object59613:head# 2024-04-01T19:56:38.304 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d368a01:::benchmark_data_smithi188_161190_object54265:head# 2024-04-01T19:56:38.304 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d36f195:::benchmark_data_smithi188_161190_object43226:head# 2024-04-01T19:56:38.304 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d3816bc:::benchmark_data_smithi188_161190_object83299:head# 2024-04-01T19:56:38.305 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d3861b8:::benchmark_data_smithi188_161190_object38433:head# 2024-04-01T19:56:38.305 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d38e2d5:::benchmark_data_smithi188_161190_object91451:head# 2024-04-01T19:56:38.309 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d3a5444:::benchmark_data_smithi188_161190_object102668:head# 2024-04-01T19:56:38.310 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d3c909c:::benchmark_data_smithi188_161190_object46391:head# 2024-04-01T19:56:38.310 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d3d4518:::benchmark_data_smithi188_161190_object52987:head# 2024-04-01T19:56:38.311 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d3d80e6:::benchmark_data_smithi188_161190_object26795:head# 2024-04-01T19:56:38.311 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d3fb46c:::benchmark_data_smithi188_161190_object123599:head# 2024-04-01T19:56:38.311 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d3fcd8b:::benchmark_data_smithi188_161190_object55545:head# 2024-04-01T19:56:38.312 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d3fdb80:::benchmark_data_smithi188_161190_object48778:head# 2024-04-01T19:56:38.312 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d401fb1:::benchmark_data_smithi188_161190_object44704:head# 2024-04-01T19:56:38.313 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d4035e7:::benchmark_data_smithi188_161190_object126775:head# 2024-04-01T19:56:38.313 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d410df7:::benchmark_data_smithi188_161190_object21301:head# 2024-04-01T19:56:38.313 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d416b2c:::benchmark_data_smithi188_161190_object64227:head# 2024-04-01T19:56:38.314 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d41d3ca:::benchmark_data_smithi188_161190_object88982:head# 2024-04-01T19:56:38.314 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d42a3f8:::benchmark_data_smithi188_161190_object101732:head# 2024-04-01T19:56:38.315 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d4326b5:::benchmark_data_smithi188_161190_object129507:head# 2024-04-01T19:56:38.315 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d4352ea:::benchmark_data_smithi188_161190_object95623:head# 2024-04-01T19:56:38.316 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d43660f:::benchmark_data_smithi188_161190_object89991:head# 2024-04-01T19:56:38.316 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d447d9a:::benchmark_data_smithi188_161190_object132459:head# 2024-04-01T19:56:38.317 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d448102:::benchmark_data_smithi188_161190_object22294:head# 2024-04-01T19:56:38.317 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d45fde2:::benchmark_data_smithi188_161190_object123452:head# 2024-04-01T19:56:38.317 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d46739b:::benchmark_data_smithi188_161190_object61478:head# 2024-04-01T19:56:38.318 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d473ac4:::benchmark_data_smithi188_161190_object41273:head# 2024-04-01T19:56:38.318 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d48503f:::benchmark_data_smithi188_161190_object116064:head# 2024-04-01T19:56:38.318 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d48af63:::benchmark_data_smithi188_161190_object123657:head# 2024-04-01T19:56:38.319 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d48ce1d:::benchmark_data_smithi188_161190_object71867:head# 2024-04-01T19:56:38.320 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d48f336:::benchmark_data_smithi188_161190_object82220:head# 2024-04-01T19:56:38.321 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d4a4066:::benchmark_data_smithi188_161190_object78968:head# 2024-04-01T19:56:38.321 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d4ade1d:::benchmark_data_smithi188_161190_object20742:head# 2024-04-01T19:56:38.321 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d4af1d1:::benchmark_data_smithi188_161190_object48310:head# 2024-04-01T19:56:38.322 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d4c424b:::benchmark_data_smithi188_161190_object132710:head# 2024-04-01T19:56:38.323 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d4c7947:::benchmark_data_smithi188_161190_object64846:head# 2024-04-01T19:56:38.323 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d4cb5e8:::benchmark_data_smithi188_161190_object70640:head# 2024-04-01T19:56:38.323 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d4d1e0c:::benchmark_data_smithi188_161190_object52984:head# 2024-04-01T19:56:38.324 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d4d956a:::benchmark_data_smithi188_161190_object137494:head# 2024-04-01T19:56:38.324 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d4f1e0b:::benchmark_data_smithi188_161190_object94769:head# 2024-04-01T19:56:38.325 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d500b5f:::benchmark_data_smithi188_161190_object77821:head# 2024-04-01T19:56:38.325 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d505bd1:::benchmark_data_smithi188_161190_object100465:head# 2024-04-01T19:56:38.325 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d5075c8:::benchmark_data_smithi188_161190_object84541:head# 2024-04-01T19:56:38.326 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d50bc86:::benchmark_data_smithi188_161190_object67161:head# 2024-04-01T19:56:38.326 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d50ce0b:::benchmark_data_smithi188_161190_object31304:head# 2024-04-01T19:56:38.326 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d515767:::benchmark_data_smithi188_161190_object102046:head# 2024-04-01T19:56:38.327 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d521017:::benchmark_data_smithi188_161190_object40308:head# 2024-04-01T19:56:38.327 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d52c69f:::benchmark_data_smithi188_161190_object40524:head# 2024-04-01T19:56:38.328 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d53717b:::benchmark_data_smithi188_161190_object65833:head# 2024-04-01T19:56:38.328 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d538cd7:::benchmark_data_smithi188_161190_object124397:head# 2024-04-01T19:56:38.329 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d542cc0:::benchmark_data_smithi188_161190_object135612:head# 2024-04-01T19:56:38.329 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d5610fe:::benchmark_data_smithi188_161190_object55250:head# 2024-04-01T19:56:38.329 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d56517a:::benchmark_data_smithi188_161190_object83583:head# 2024-04-01T19:56:38.330 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d571371:::benchmark_data_smithi188_161190_object30141:head# 2024-04-01T19:56:38.330 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d572056:::benchmark_data_smithi188_161190_object95151:head# 2024-04-01T19:56:38.331 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d5888eb:::benchmark_data_smithi188_161190_object54363:head# 2024-04-01T19:56:38.331 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d59ba5f:::benchmark_data_smithi188_161190_object85549:head# 2024-04-01T19:56:38.331 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d5a36d8:::benchmark_data_smithi188_161190_object29439:head# 2024-04-01T19:56:38.332 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d5b174e:::benchmark_data_smithi188_161190_object24679:head# 2024-04-01T19:56:38.332 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d5b2e06:::benchmark_data_smithi188_161190_object48719:head# 2024-04-01T19:56:38.332 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d5bef48:::benchmark_data_smithi188_161190_object68698:head# 2024-04-01T19:56:38.333 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d5befb4:::benchmark_data_smithi188_161190_object110043:head# 2024-04-01T19:56:38.333 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d5c1377:::benchmark_data_smithi188_161190_object50981:head# 2024-04-01T19:56:38.334 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d5c277a:::benchmark_data_smithi188_161190_object36484:head# 2024-04-01T19:56:38.334 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d5c2d0b:::benchmark_data_smithi188_161190_object120890:head# 2024-04-01T19:56:38.335 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d5d6d2b:::benchmark_data_smithi188_161190_object51309:head# 2024-04-01T19:56:38.335 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d5d7567:::benchmark_data_smithi188_161190_object96191:head# 2024-04-01T19:56:38.335 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d5e4191:::benchmark_data_smithi188_161190_object58306:head# 2024-04-01T19:56:38.336 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d5f16ce:::benchmark_data_smithi188_161190_object67157:head# 2024-04-01T19:56:38.336 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d6102b2:::benchmark_data_smithi188_161190_object41943:head# 2024-04-01T19:56:38.337 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d6131c0:::benchmark_data_smithi188_161190_object68067:head# 2024-04-01T19:56:38.337 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d6192ea:::benchmark_data_smithi188_161190_object109540:head# 2024-04-01T19:56:38.337 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d623a93:::benchmark_data_smithi188_161190_object120293:head# 2024-04-01T19:56:38.338 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d626cea:::benchmark_data_smithi188_161190_object120252:head# 2024-04-01T19:56:38.338 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d62af6d:::benchmark_data_smithi188_161190_object120320:head# 2024-04-01T19:56:38.339 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d639e38:::benchmark_data_smithi188_161190_object56620:head# 2024-04-01T19:56:38.339 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d63dc43:::benchmark_data_smithi188_161190_object28177:head# 2024-04-01T19:56:38.339 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d648379:::benchmark_data_smithi188_161190_object24376:head# 2024-04-01T19:56:38.340 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d659bb5:::benchmark_data_smithi188_161190_object71921:head# 2024-04-01T19:56:38.340 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d65ecca:::benchmark_data_smithi188_161190_object114432:head# 2024-04-01T19:56:38.340 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d66c35b:::benchmark_data_smithi188_161190_object50390:head# 2024-04-01T19:56:38.341 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d6710ee:::benchmark_data_smithi188_161190_object85928:head# 2024-04-01T19:56:38.341 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d679350:::benchmark_data_smithi188_161190_object57674:head# 2024-04-01T19:56:38.342 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d67d779:::benchmark_data_smithi188_161190_object90654:head# 2024-04-01T19:56:38.342 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d6815ce:::benchmark_data_smithi188_161190_object56525:head# 2024-04-01T19:56:38.343 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d681afc:::benchmark_data_smithi188_161190_object31092:head# 2024-04-01T19:56:38.343 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d684065:::benchmark_data_smithi188_161190_object101503:head# 2024-04-01T19:56:38.343 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d6869f5:::benchmark_data_smithi188_161190_object71134:head# 2024-04-01T19:56:38.348 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d688f2d:::benchmark_data_smithi188_161190_object23702:head# 2024-04-01T19:56:38.348 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d691664:::benchmark_data_smithi188_161190_object76363:head# 2024-04-01T19:56:38.348 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d6919d8:::benchmark_data_smithi188_161190_object109075:head# 2024-04-01T19:56:38.348 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d693a5b:::benchmark_data_smithi188_161190_object87617:head# 2024-04-01T19:56:38.349 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d69766a:::benchmark_data_smithi188_161190_object104923:head# 2024-04-01T19:56:38.349 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d69db1f:::benchmark_data_smithi188_161190_object137120:head# 2024-04-01T19:56:38.349 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d69ed81:::benchmark_data_smithi188_161190_object118441:head# 2024-04-01T19:56:38.349 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d6a05f2:::benchmark_data_smithi188_161190_object31534:head# 2024-04-01T19:56:38.349 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d6a3c35:::benchmark_data_smithi188_161190_object22663:head# 2024-04-01T19:56:38.349 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d6a975b:::benchmark_data_smithi188_161190_object22357:head# 2024-04-01T19:56:38.350 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d6aae41:::benchmark_data_smithi188_161190_object124221:head# 2024-04-01T19:56:38.350 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d6aeca4:::benchmark_data_smithi188_161190_object62815:head# 2024-04-01T19:56:38.350 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d6d50d4:::benchmark_data_smithi188_161190_object38197:head# 2024-04-01T19:56:38.350 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d6ec37e:::benchmark_data_smithi188_161190_object84184:head# 2024-04-01T19:56:38.350 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d6eeea7:::benchmark_data_smithi188_161190_object128268:head# 2024-04-01T19:56:38.351 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d6fbf5e:::benchmark_data_smithi188_161190_object101431:head# 2024-04-01T19:56:38.351 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d6ff811:::benchmark_data_smithi188_161190_object99147:head# 2024-04-01T19:56:38.352 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d70d5e3:::benchmark_data_smithi188_161190_object102129:head# 2024-04-01T19:56:38.352 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d710e6a:::benchmark_data_smithi188_161190_object63882:head# 2024-04-01T19:56:38.352 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d719438:::benchmark_data_smithi188_161190_object68127:head# 2024-04-01T19:56:38.353 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d72b249:::benchmark_data_smithi188_161190_object33743:head# 2024-04-01T19:56:38.354 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d72be57:::benchmark_data_smithi188_161190_object34161:head# 2024-04-01T19:56:38.354 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d744da8:::benchmark_data_smithi188_161190_object107602:head# 2024-04-01T19:56:38.354 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d74b74c:::benchmark_data_smithi188_161190_object99959:head# 2024-04-01T19:56:38.355 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d75c679:::benchmark_data_smithi188_161190_object50493:head# 2024-04-01T19:56:38.355 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d75f1bd:::benchmark_data_smithi188_161190_object74841:head# 2024-04-01T19:56:38.356 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d76267d:::benchmark_data_smithi188_161190_object123959:head# 2024-04-01T19:56:38.356 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d79cd55:::benchmark_data_smithi188_161190_object81620:head# 2024-04-01T19:56:38.356 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d7acef8:::benchmark_data_smithi188_161190_object118609:head# 2024-04-01T19:56:38.357 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d7b1091:::benchmark_data_smithi188_161190_object24413:head# 2024-04-01T19:56:38.357 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d7b1500:::benchmark_data_smithi188_161190_object62217:head# 2024-04-01T19:56:38.358 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d7b960f:::benchmark_data_smithi188_161190_object43672:head# 2024-04-01T19:56:38.358 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d7c6904:::benchmark_data_smithi188_161190_object30928:head# 2024-04-01T19:56:38.364 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d7d552a:::benchmark_data_smithi188_161190_object47725:head# 2024-04-01T19:56:38.364 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d7d75d9:::benchmark_data_smithi188_161190_object93979:head# 2024-04-01T19:56:38.364 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d7d9d6e:::benchmark_data_smithi188_161190_object101222:head# 2024-04-01T19:56:38.364 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d7ded1c:::benchmark_data_smithi188_161190_object120205:head# 2024-04-01T19:56:38.364 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d7f71af:::benchmark_data_smithi188_161190_object111508:head# 2024-04-01T19:56:38.364 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d7ff45d:::benchmark_data_smithi188_161190_object64334:head# 2024-04-01T19:56:38.364 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d803cc0:::benchmark_data_smithi188_161190_object105701:head# 2024-04-01T19:56:38.365 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d80d073:::benchmark_data_smithi188_161190_object130802:head# 2024-04-01T19:56:38.365 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d817f7e:::benchmark_data_smithi188_161190_object83969:head# 2024-04-01T19:56:38.365 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d819a08:::benchmark_data_smithi188_161190_object99850:head# 2024-04-01T19:56:38.365 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d81ed69:::benchmark_data_smithi188_161190_object74233:head# 2024-04-01T19:56:38.366 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d82379d:::benchmark_data_smithi188_161190_object111877:head# 2024-04-01T19:56:38.366 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d82c774:::benchmark_data_smithi188_161190_object46435:head# 2024-04-01T19:56:38.366 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d82fc61:::benchmark_data_smithi188_161190_object111612:head# 2024-04-01T19:56:38.366 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d83b3e9:::benchmark_data_smithi188_161190_object72558:head# 2024-04-01T19:56:38.367 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d8424b7:::benchmark_data_smithi188_161190_object95635:head# 2024-04-01T19:56:38.367 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d8438f7:::benchmark_data_smithi188_161190_object53202:head# 2024-04-01T19:56:38.367 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d84f2b8:::benchmark_data_smithi188_161190_object127187:head# 2024-04-01T19:56:38.367 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d85b373:::benchmark_data_smithi188_161190_object84054:head# 2024-04-01T19:56:38.368 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d865f12:::benchmark_data_smithi188_161190_object43117:head# 2024-04-01T19:56:38.368 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d8686bb:::benchmark_data_smithi188_161190_object79957:head# 2024-04-01T19:56:38.369 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d86e21b:::benchmark_data_smithi188_161190_object115277:head# 2024-04-01T19:56:38.369 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d8890f0:::benchmark_data_smithi188_161190_object121247:head# 2024-04-01T19:56:38.370 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d88af1f:::benchmark_data_smithi188_161190_object60088:head# 2024-04-01T19:56:38.375 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d88da73:::benchmark_data_smithi188_161190_object42499:head# 2024-04-01T19:56:38.375 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d88ef71:::benchmark_data_smithi188_161190_object90615:head# 2024-04-01T19:56:38.375 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d890e70:::benchmark_data_smithi188_161190_object77584:head# 2024-04-01T19:56:38.375 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d893b0b:::benchmark_data_smithi188_161190_object58986:head# 2024-04-01T19:56:38.375 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d89ef0c:::benchmark_data_smithi188_161190_object52527:head# 2024-04-01T19:56:38.376 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d8bdd81:::benchmark_data_smithi188_161190_object89177:head# 2024-04-01T19:56:38.376 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d8caef0:::benchmark_data_smithi188_161190_object78372:head# 2024-04-01T19:56:38.376 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d8d70ab:::benchmark_data_smithi188_161190_object115133:head# 2024-04-01T19:56:38.376 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d8e135a:::benchmark_data_smithi188_161190_object79194:head# 2024-04-01T19:56:38.376 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d8fa19f:::benchmark_data_smithi188_161190_object137565:head# 2024-04-01T19:56:38.376 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d9018c7:::benchmark_data_smithi188_161190_object24685:head# 2024-04-01T19:56:38.376 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d904429:::benchmark_data_smithi188_161190_object131601:head# 2024-04-01T19:56:38.377 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d90905a:::benchmark_data_smithi188_161190_object74139:head# 2024-04-01T19:56:38.378 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d91ad29:::benchmark_data_smithi188_161190_object117871:head# 2024-04-01T19:56:38.378 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d91c97e:::benchmark_data_smithi188_161190_object83979:head# 2024-04-01T19:56:38.379 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d91cdb0:::benchmark_data_smithi188_161190_object34662:head# 2024-04-01T19:56:38.379 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d91d42a:::benchmark_data_smithi188_161190_object123413:head# 2024-04-01T19:56:38.379 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d926842:::benchmark_data_smithi188_161190_object96489:head# 2024-04-01T19:56:38.380 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d92b695:::benchmark_data_smithi188_161190_object132505:head# 2024-04-01T19:56:38.380 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d939e0b:::benchmark_data_smithi188_161190_object49071:head# 2024-04-01T19:56:38.381 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d93c583:::benchmark_data_smithi188_161190_object28748:head# 2024-04-01T19:56:38.381 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d94826b:::benchmark_data_smithi188_161190_object98226:head# 2024-04-01T19:56:38.382 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d95b229:::benchmark_data_smithi188_161190_object34558:head# 2024-04-01T19:56:38.382 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d96cc4c:::benchmark_data_smithi188_161190_object25961:head# 2024-04-01T19:56:38.382 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d97a465:::benchmark_data_smithi188_161190_object34175:head# 2024-04-01T19:56:38.383 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d989804:::benchmark_data_smithi188_161190_object93439:head# 2024-04-01T19:56:38.383 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d99294c:::benchmark_data_smithi188_161190_object46725:head# 2024-04-01T19:56:38.384 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d99b824:::benchmark_data_smithi188_161190_object49963:head# 2024-04-01T19:56:38.384 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d99e743:::benchmark_data_smithi188_161190_object124823:head# 2024-04-01T19:56:38.385 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d9a471b:::benchmark_data_smithi188_161190_object37866:head# 2024-04-01T19:56:38.385 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d9aa79e:::benchmark_data_smithi188_161190_object58695:head# 2024-04-01T19:56:38.385 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d9b0267:::benchmark_data_smithi188_161190_object119055:head# 2024-04-01T19:56:38.386 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d9bf2b3:::benchmark_data_smithi188_161190_object22720:head# 2024-04-01T19:56:38.386 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d9d889c:::benchmark_data_smithi188_161190_object106764:head# 2024-04-01T19:56:38.387 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d9df062:::benchmark_data_smithi188_161190_object50378:head# 2024-04-01T19:56:38.387 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d9e000a:::benchmark_data_smithi188_161190_object44279:head# 2024-04-01T19:56:38.387 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d9e8b2c:::benchmark_data_smithi188_161190_object21744:head# 2024-04-01T19:56:38.388 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d9f2236:::benchmark_data_smithi188_161190_object124483:head# 2024-04-01T19:56:38.388 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d9f48ca:::benchmark_data_smithi188_161190_object34714:head# 2024-04-01T19:56:38.389 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9d9f9873:::benchmark_data_smithi188_161190_object76935:head# 2024-04-01T19:56:38.389 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9da06d8b:::benchmark_data_smithi188_161190_object113879:head# 2024-04-01T19:56:38.390 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9da079a5:::benchmark_data_smithi188_161190_object30232:head# 2024-04-01T19:56:38.390 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9da2bb59:::benchmark_data_smithi188_161190_object49413:head# 2024-04-01T19:56:38.390 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9da3774a:::benchmark_data_smithi188_161190_object30001:head# 2024-04-01T19:56:38.391 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9da4e7a9:::benchmark_data_smithi188_161190_object132938:head# 2024-04-01T19:56:38.391 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9da63dcc:::benchmark_data_smithi188_161190_object112366:head# 2024-04-01T19:56:38.392 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9da64898:::benchmark_data_smithi188_161190_object65511:head# 2024-04-01T19:56:38.392 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9da6b30f:::benchmark_data_smithi188_161190_object74663:head# 2024-04-01T19:56:38.392 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9da6e1c1:::benchmark_data_smithi188_161190_object78699:head# 2024-04-01T19:56:38.393 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9da794b1:::benchmark_data_smithi188_161190_object50659:head# 2024-04-01T19:56:38.393 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9da8b7a6:::benchmark_data_smithi188_161190_object21444:head# 2024-04-01T19:56:38.394 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9da8ef35:::benchmark_data_smithi188_161190_object67433:head# 2024-04-01T19:56:38.394 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9da93a5b:::benchmark_data_smithi188_161190_object117104:head# 2024-04-01T19:56:38.394 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9daa317a:::benchmark_data_smithi188_161190_object133480:head# 2024-04-01T19:56:38.395 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9daaadf5:::benchmark_data_smithi188_161190_object96781:head# 2024-04-01T19:56:38.396 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9daaecb8:::benchmark_data_smithi188_161190_object102507:head# 2024-04-01T19:56:38.396 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dab0332:::benchmark_data_smithi188_161190_object76936:head# 2024-04-01T19:56:38.402 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dabadfe:::benchmark_data_smithi188_161190_object130457:head# 2024-04-01T19:56:38.402 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dabd82f:::benchmark_data_smithi188_161190_object136574:head# 2024-04-01T19:56:38.402 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dad707e:::benchmark_data_smithi188_161190_object114422:head# 2024-04-01T19:56:38.402 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dae5373:::benchmark_data_smithi188_161190_object84023:head# 2024-04-01T19:56:38.402 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9daeaa03:::benchmark_data_smithi188_161190_object129934:head# 2024-04-01T19:56:38.402 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9daf6777:::benchmark_data_smithi188_161190_object52217:head# 2024-04-01T19:56:38.402 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9db0b0f3:::benchmark_data_smithi188_161190_object20813:head# 2024-04-01T19:56:38.402 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9db1dcc1:::benchmark_data_smithi188_161190_object30885:head# 2024-04-01T19:56:38.402 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9db36e33:::benchmark_data_smithi188_161190_object102295:head# 2024-04-01T19:56:38.402 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9db43201:::benchmark_data_smithi188_161190_object47399:head# 2024-04-01T19:56:38.403 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9db4345a:::benchmark_data_smithi188_161190_object127721:head# 2024-04-01T19:56:38.403 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9db46573:::benchmark_data_smithi188_161190_object124288:head# 2024-04-01T19:56:38.403 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9db47066:::benchmark_data_smithi188_161190_object138438:head# 2024-04-01T19:56:38.403 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9db5125e:::benchmark_data_smithi188_161190_object46360:head# 2024-04-01T19:56:38.403 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9db5efa5:::benchmark_data_smithi188_161190_object137054:head# 2024-04-01T19:56:38.404 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9db67d42:::benchmark_data_smithi188_161190_object117211:head# 2024-04-01T19:56:38.404 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9db6a7e5:::benchmark_data_smithi188_161190_object78591:head# 2024-04-01T19:56:38.404 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9db6bbdb:::benchmark_data_smithi188_161190_object100599:head# 2024-04-01T19:56:38.405 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9db7a541:::benchmark_data_smithi188_161190_object65276:head# 2024-04-01T19:56:38.405 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9db82fea:::benchmark_data_smithi188_161190_object37437:head# 2024-04-01T19:56:38.406 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9db87bc8:::benchmark_data_smithi188_161190_object85060:head# 2024-04-01T19:56:38.406 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9db89f19:::benchmark_data_smithi188_161190_object40900:head# 2024-04-01T19:56:38.407 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9db94f47:::benchmark_data_smithi188_161190_object23173:head# 2024-04-01T19:56:38.407 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dbab8b9:::benchmark_data_smithi188_161190_object30830:head# 2024-04-01T19:56:38.408 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dbacd77:::benchmark_data_smithi188_161190_object41566:head# 2024-04-01T19:56:38.408 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dbb6f80:::benchmark_data_smithi188_161190_object93547:head# 2024-04-01T19:56:38.409 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dbb791e:::benchmark_data_smithi188_161190_object130972:head# 2024-04-01T19:56:38.409 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dbbb197:::benchmark_data_smithi188_161190_object66617:head# 2024-04-01T19:56:38.410 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dbd05b6:::benchmark_data_smithi188_161190_object78064:head# 2024-04-01T19:56:38.411 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dbd5088:::benchmark_data_smithi188_161190_object94247:head# 2024-04-01T19:56:38.411 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dbdb76c:::benchmark_data_smithi188_161190_object87233:head# 2024-04-01T19:56:38.412 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dbf4ef6:::benchmark_data_smithi188_161190_object34436:head# 2024-04-01T19:56:38.412 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dbf8709:::benchmark_data_smithi188_161190_object81233:head# 2024-04-01T19:56:38.412 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dbf8f83:::benchmark_data_smithi188_161190_object115535:head# 2024-04-01T19:56:38.412 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dc04f72:::benchmark_data_smithi188_161190_object35845:head# 2024-04-01T19:56:38.413 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dc054f8:::benchmark_data_smithi188_161190_object103123:head# 2024-04-01T19:56:38.418 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dc0bdbc:::benchmark_data_smithi188_161190_object24407:head# 2024-04-01T19:56:38.419 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dc14d68:::benchmark_data_smithi188_161190_object51639:head# 2024-04-01T19:56:38.419 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dc238d2:::benchmark_data_smithi188_161190_object63102:head# 2024-04-01T19:56:38.419 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dc27a5e:::benchmark_data_smithi188_161190_object32926:head# 2024-04-01T19:56:38.419 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dc3350f:::benchmark_data_smithi188_161190_object20841:head# 2024-04-01T19:56:38.419 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dc3f58e:::benchmark_data_smithi188_161190_object32913:head# 2024-04-01T19:56:38.419 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dc401b8:::benchmark_data_smithi188_161190_object43092:head# 2024-04-01T19:56:38.419 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dc4a080:::benchmark_data_smithi188_161190_object74262:head# 2024-04-01T19:56:38.419 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dc4a1d5:::benchmark_data_smithi188_161190_object105574:head# 2024-04-01T19:56:38.420 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dc5180b:::benchmark_data_smithi188_161190_object101006:head# 2024-04-01T19:56:38.420 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dc6109a:::benchmark_data_smithi188_161190_object127422:head# 2024-04-01T19:56:38.420 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dc83c31:::benchmark_data_smithi188_161190_object70153:head# 2024-04-01T19:56:38.421 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dc8bd81:::benchmark_data_smithi188_161190_object137358:head# 2024-04-01T19:56:38.421 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dc8d27e:::benchmark_data_smithi188_161190_object103797:head# 2024-04-01T19:56:38.421 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dc8d436:::benchmark_data_smithi188_161190_object103101:head# 2024-04-01T19:56:38.422 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dc98587:::benchmark_data_smithi188_161190_object46314:head# 2024-04-01T19:56:38.422 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dca1948:::benchmark_data_smithi188_161190_object106744:head# 2024-04-01T19:56:38.423 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dca6883:::benchmark_data_smithi188_161190_object118712:head# 2024-04-01T19:56:38.423 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dcb91fb:::benchmark_data_smithi188_161190_object98061:head# 2024-04-01T19:56:38.424 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dcd2a3e:::benchmark_data_smithi188_161190_object134958:head# 2024-04-01T19:56:38.424 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dcea8d3:::benchmark_data_smithi188_161190_object78051:head# 2024-04-01T19:56:38.425 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dcf6e09:::benchmark_data_smithi188_161190_object78418:head# 2024-04-01T19:56:38.430 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dd00c8c:::benchmark_data_smithi188_161190_object62244:head# 2024-04-01T19:56:38.430 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dd15dc7:::benchmark_data_smithi188_161190_object51360:head# 2024-04-01T19:56:38.430 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dd3b4c7:::benchmark_data_smithi188_161190_object21752:head# 2024-04-01T19:56:38.430 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dd443cf:::benchmark_data_smithi188_161190_object46014:head# 2024-04-01T19:56:38.430 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dd5f48e:::benchmark_data_smithi188_161190_object135786:head# 2024-04-01T19:56:38.430 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dd73cd1:::benchmark_data_smithi188_161190_object90972:head# 2024-04-01T19:56:38.430 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dd7798c:::benchmark_data_smithi188_161190_object116217:head# 2024-04-01T19:56:38.430 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dd77ad5:::benchmark_data_smithi188_161190_object112114:head# 2024-04-01T19:56:38.431 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dd79dfa:::benchmark_data_smithi188_161190_object115899:head# 2024-04-01T19:56:38.431 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dd7b116:::benchmark_data_smithi188_161190_object41922:head# 2024-04-01T19:56:38.431 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dd7e49a:::benchmark_data_smithi188_161190_object47583:head# 2024-04-01T19:56:38.432 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dd81ac3:::benchmark_data_smithi188_161190_object130746:head# 2024-04-01T19:56:38.432 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dd874d5:::benchmark_data_smithi188_161190_object77681:head# 2024-04-01T19:56:38.432 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dd8852a:::benchmark_data_smithi188_161190_object136037:head# 2024-04-01T19:56:38.433 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dd8ee41:::benchmark_data_smithi188_161190_object108672:head# 2024-04-01T19:56:38.433 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dd90366:::benchmark_data_smithi188_161190_object96935:head# 2024-04-01T19:56:38.434 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dd9c812:::benchmark_data_smithi188_161190_object135436:head# 2024-04-01T19:56:38.439 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dda9d79:::benchmark_data_smithi188_161190_object20608:head# 2024-04-01T19:56:38.439 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ddb6b80:::benchmark_data_smithi188_161190_object79399:head# 2024-04-01T19:56:38.439 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ddb6d63:::benchmark_data_smithi188_161190_object68745:head# 2024-04-01T19:56:38.451 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dde0045:::benchmark_data_smithi188_161190_object117284:head# 2024-04-01T19:56:38.451 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dde71ec:::benchmark_data_smithi188_161190_object20717:head# 2024-04-01T19:56:38.451 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ddeac58:::benchmark_data_smithi188_161190_object50570:head# 2024-04-01T19:56:38.451 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ddf9e72:::benchmark_data_smithi188_161190_object63350:head# 2024-04-01T19:56:38.452 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9de08ac5:::benchmark_data_smithi188_161190_object114922:head# 2024-04-01T19:56:38.452 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9de0a83b:::benchmark_data_smithi188_161190_object89264:head# 2024-04-01T19:56:38.452 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9de0dfc5:::benchmark_data_smithi188_161190_object107063:head# 2024-04-01T19:56:38.456 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9de285aa:::benchmark_data_smithi188_161190_object103972:head# 2024-04-01T19:56:38.456 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9de2c2f9:::benchmark_data_smithi188_161190_object101706:head# 2024-04-01T19:56:38.456 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9de2d528:::benchmark_data_smithi188_161190_object99942:head# 2024-04-01T19:56:38.456 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9de2ddca:::benchmark_data_smithi188_161190_object114818:head# 2024-04-01T19:56:38.456 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9de420dd:::benchmark_data_smithi188_161190_object108431:head# 2024-04-01T19:56:38.456 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9de45df1:::benchmark_data_smithi188_161190_object134105:head# 2024-04-01T19:56:38.456 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9de465d6:::benchmark_data_smithi188_161190_object66547:head# 2024-04-01T19:56:38.456 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9de5057a:::benchmark_data_smithi188_161190_object61502:head# 2024-04-01T19:56:38.457 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9de5570d:::benchmark_data_smithi188_161190_object111821:head# 2024-04-01T19:56:38.457 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9de588b7:::benchmark_data_smithi188_161190_object100641:head# 2024-04-01T19:56:38.457 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9de62a2b:::benchmark_data_smithi188_161190_object37522:head# 2024-04-01T19:56:38.457 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9de67509:::benchmark_data_smithi188_161190_object30514:head# 2024-04-01T19:56:38.457 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9de69ef2:::benchmark_data_smithi188_161190_object65654:head# 2024-04-01T19:56:38.457 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9de70773:::benchmark_data_smithi188_161190_object73481:head# 2024-04-01T19:56:38.458 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9de7834a:::benchmark_data_smithi188_161190_object69696:head# 2024-04-01T19:56:38.458 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9de816d7:::benchmark_data_smithi188_161190_object67027:head# 2024-04-01T19:56:38.458 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9de90d95:::benchmark_data_smithi188_161190_object108674:head# 2024-04-01T19:56:38.459 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9de929b3:::benchmark_data_smithi188_161190_object104006:head# 2024-04-01T19:56:38.459 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9de93ee9:::benchmark_data_smithi188_161190_object41242:head# 2024-04-01T19:56:38.459 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9de9dab8:::benchmark_data_smithi188_161190_object68606:head# 2024-04-01T19:56:38.460 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dea1ba9:::benchmark_data_smithi188_161190_object110225:head# 2024-04-01T19:56:38.460 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9deacdf3:::benchmark_data_smithi188_161190_object126652:head# 2024-04-01T19:56:38.461 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9debc450:::benchmark_data_smithi188_161190_object104054:head# 2024-04-01T19:56:38.461 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9debf05d:::benchmark_data_smithi188_161190_object23287:head# 2024-04-01T19:56:38.461 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dec4827:::benchmark_data_smithi188_161190_object79288:head# 2024-04-01T19:56:38.461 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dec521c:::benchmark_data_smithi188_161190_object128142:head# 2024-04-01T19:56:38.462 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9decf893:::benchmark_data_smithi188_161190_object69561:head# 2024-04-01T19:56:38.462 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ded525c:::benchmark_data_smithi188_161190_object107639:head# 2024-04-01T19:56:38.463 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ded8896:::benchmark_data_smithi188_161190_object87360:head# 2024-04-01T19:56:38.465 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9deec211:::benchmark_data_smithi188_161190_object120485:head# 2024-04-01T19:56:38.466 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9def0403:::benchmark_data_smithi188_161190_object83254:head# 2024-04-01T19:56:38.466 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9def8738:::benchmark_data_smithi188_161190_object89222:head# 2024-04-01T19:56:38.467 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9df02032:::benchmark_data_smithi188_161190_object85213:head# 2024-04-01T19:56:38.467 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9df0404c:::benchmark_data_smithi188_161190_object94549:head# 2024-04-01T19:56:38.468 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9df0c716:::benchmark_data_smithi188_161190_object74583:head# 2024-04-01T19:56:38.474 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9df19eb9:::benchmark_data_smithi188_161190_object123208:head# 2024-04-01T19:56:38.474 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9df228f6:::benchmark_data_smithi188_161190_object130843:head# 2024-04-01T19:56:38.474 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9df2336b:::benchmark_data_smithi188_161190_object55941:head# 2024-04-01T19:56:38.474 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9df3069d:::benchmark_data_smithi188_161190_object43484:head# 2024-04-01T19:56:38.474 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9df38611:::benchmark_data_smithi188_161190_object29421:head# 2024-04-01T19:56:38.474 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9df58ad4:::benchmark_data_smithi188_161190_object39571:head# 2024-04-01T19:56:38.475 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9df5a160:::benchmark_data_smithi188_161190_object78612:head# 2024-04-01T19:56:38.475 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9df64ab7:::benchmark_data_smithi188_161190_object112329:head# 2024-04-01T19:56:38.476 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9df65855:::benchmark_data_smithi188_161190_object42583:head# 2024-04-01T19:56:38.476 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9df7789f:::benchmark_data_smithi188_161190_object29471:head# 2024-04-01T19:56:38.477 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9df7cc81:::benchmark_data_smithi188_161190_object120911:head# 2024-04-01T19:56:38.477 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9df7e3d4:::benchmark_data_smithi188_161190_object109535:head# 2024-04-01T19:56:38.477 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9df8b21f:::benchmark_data_smithi188_161190_object113724:head# 2024-04-01T19:56:38.478 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9df96a12:::benchmark_data_smithi188_161190_object79306:head# 2024-04-01T19:56:38.478 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9df9f706:::benchmark_data_smithi188_161190_object25924:head# 2024-04-01T19:56:38.479 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dfa955f:::benchmark_data_smithi188_161190_object20482:head# 2024-04-01T19:56:38.479 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dfaedf1:::benchmark_data_smithi188_161190_object37772:head# 2024-04-01T19:56:38.480 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dfb5b1e:::benchmark_data_smithi188_161190_object130546:head# 2024-04-01T19:56:38.480 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dfbca97:::benchmark_data_smithi188_161190_object37964:head# 2024-04-01T19:56:38.480 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dfcdf67:::benchmark_data_smithi188_161190_object89511:head# 2024-04-01T19:56:38.481 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dfd2cc9:::benchmark_data_smithi188_161190_object49546:head# 2024-04-01T19:56:38.481 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dfdd1ab:::benchmark_data_smithi188_161190_object90274:head# 2024-04-01T19:56:38.487 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dfe5829:::benchmark_data_smithi188_161190_object88461:head# 2024-04-01T19:56:38.489 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dfe9daa:::benchmark_data_smithi188_161190_object82045:head# 2024-04-01T19:56:38.489 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dff074b:::benchmark_data_smithi188_161190_object111167:head# 2024-04-01T19:56:38.489 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dff8cba:::benchmark_data_smithi188_161190_object55005:head# 2024-04-01T19:56:38.490 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dff9e3f:::benchmark_data_smithi188_161190_object82983:head# 2024-04-01T19:56:38.495 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9dffe416:::benchmark_data_smithi188_161190_object107383:head# 2024-04-01T19:56:38.495 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e0029cc:::benchmark_data_smithi188_161190_object49075:head# 2024-04-01T19:56:38.500 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e01cd27:::benchmark_data_smithi188_161190_object95209:head# 2024-04-01T19:56:38.500 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e01ff20:::benchmark_data_smithi188_161190_object123434:head# 2024-04-01T19:56:38.500 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e026e7e:::benchmark_data_smithi188_161190_object49279:head# 2024-04-01T19:56:38.500 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e037bd6:::benchmark_data_smithi188_161190_object19747:head# 2024-04-01T19:56:38.500 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e0390e1:::benchmark_data_smithi188_161190_object26230:head# 2024-04-01T19:56:38.500 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e0404db:::benchmark_data_smithi188_161190_object73522:head# 2024-04-01T19:56:38.501 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e0408a4:::benchmark_data_smithi188_161190_object50720:head# 2024-04-01T19:56:38.501 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e04a91f:::benchmark_data_smithi188_161190_object77139:head# 2024-04-01T19:56:38.502 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e05e8dc:::benchmark_data_smithi188_161190_object130998:head# 2024-04-01T19:56:38.502 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e076ebf:::benchmark_data_smithi188_161190_object39451:head# 2024-04-01T19:56:38.502 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e07a888:::benchmark_data_smithi188_161190_object106060:head# 2024-04-01T19:56:38.503 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e07b445:::benchmark_data_smithi188_161190_object75860:head# 2024-04-01T19:56:38.503 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e08559a:::benchmark_data_smithi188_161190_object43578:head# 2024-04-01T19:56:38.503 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e0859f4:::benchmark_data_smithi188_161190_object28234:head# 2024-04-01T19:56:38.504 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e096606:::benchmark_data_smithi188_161190_object100645:head# 2024-04-01T19:56:38.504 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e0b8cc1:::benchmark_data_smithi188_161190_object94246:head# 2024-04-01T19:56:38.505 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e0c416f:::benchmark_data_smithi188_161190_object111491:head# 2024-04-01T19:56:38.506 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e0c9525:::benchmark_data_smithi188_161190_object123693:head# 2024-04-01T19:56:38.509 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e0ca700:::benchmark_data_smithi188_161190_object31896:head# 2024-04-01T19:56:38.510 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e0caffd:::benchmark_data_smithi188_161190_object107942:head# 2024-04-01T19:56:38.510 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e0d96a2:::benchmark_data_smithi188_161190_object35212:head# 2024-04-01T19:56:38.510 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e0e22fa:::benchmark_data_smithi188_161190_object126053:head# 2024-04-01T19:56:38.510 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e0ea09c:::benchmark_data_smithi188_161190_object32534:head# 2024-04-01T19:56:38.511 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e0ee73b:::benchmark_data_smithi188_161190_object119491:head# 2024-04-01T19:56:38.511 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e0eee8b:::benchmark_data_smithi188_161190_object29398:head# 2024-04-01T19:56:38.512 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e0f8282:::benchmark_data_smithi188_161190_object135576:head# 2024-04-01T19:56:38.512 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e0f89cd:::benchmark_data_smithi188_161190_object70866:head# 2024-04-01T19:56:38.512 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e1016c1:::benchmark_data_smithi188_161190_object32690:head# 2024-04-01T19:56:38.513 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e1076af:::benchmark_data_smithi188_161190_object25494:head# 2024-04-01T19:56:38.514 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e107870:::benchmark_data_smithi188_161190_object37680:head# 2024-04-01T19:56:38.514 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e115726:::benchmark_data_smithi188_161190_object135680:head# 2024-04-01T19:56:38.519 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e142ddf:::benchmark_data_smithi188_161190_object40061:head# 2024-04-01T19:56:38.520 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e14e064:::benchmark_data_smithi188_161190_object78346:head# 2024-04-01T19:56:38.521 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:56:38.526 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e14e0e1:::benchmark_data_smithi188_161190_object103118:head# 2024-04-01T19:56:38.526 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e16b934:::benchmark_data_smithi188_161190_object124780:head# 2024-04-01T19:56:38.526 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e174cc1:::benchmark_data_smithi188_161190_object80134:head# 2024-04-01T19:56:38.527 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e181744:::benchmark_data_smithi188_161190_object36039:head# 2024-04-01T19:56:38.527 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e19259a:::benchmark_data_smithi188_161190_object30182:head# 2024-04-01T19:56:38.528 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e1965cc:::benchmark_data_smithi188_161190_object43990:head# 2024-04-01T19:56:38.528 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e19dbfd:::benchmark_data_smithi188_161190_object56309:head# 2024-04-01T19:56:38.529 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e1a33e7:::benchmark_data_smithi188_161190_object21948:head# 2024-04-01T19:56:38.529 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e1a7fb0:::benchmark_data_smithi188_161190_object53034:head# 2024-04-01T19:56:38.530 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e1aa0f0:::benchmark_data_smithi188_161190_object137543:head# 2024-04-01T19:56:38.530 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e1c594b:::benchmark_data_smithi188_161190_object122501:head# 2024-04-01T19:56:38.530 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e1cc8a5:::benchmark_data_smithi188_161190_object83000:head# 2024-04-01T19:56:38.531 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e1e2a2a:::benchmark_data_smithi188_161190_object58611:head# 2024-04-01T19:56:38.531 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e1f6d55:::benchmark_data_smithi188_161190_object95746:head# 2024-04-01T19:56:38.532 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e1f9d37:::benchmark_data_smithi188_161190_object116437:head# 2024-04-01T19:56:38.534 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e2088c7:::benchmark_data_smithi188_161190_object33001:head# 2024-04-01T19:56:38.534 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e215c7e:::benchmark_data_smithi188_161190_object37917:head# 2024-04-01T19:56:38.534 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e21aa46:::benchmark_data_smithi188_161190_object40329:head# 2024-04-01T19:56:38.535 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e223e77:::benchmark_data_smithi188_161190_object62265:head# 2024-04-01T19:56:38.535 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e2415ba:::benchmark_data_smithi188_161190_object99110:head# 2024-04-01T19:56:38.535 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e24275f:::benchmark_data_smithi188_161190_object52906:head# 2024-04-01T19:56:38.536 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e25c666:::benchmark_data_smithi188_161190_object45362:head# 2024-04-01T19:56:38.536 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e268837:::benchmark_data_smithi188_161190_object101751:head# 2024-04-01T19:56:38.537 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e268b61:::benchmark_data_smithi188_161190_object96365:head# 2024-04-01T19:56:38.537 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e27ef8c:::benchmark_data_smithi188_161190_object122969:head# 2024-04-01T19:56:38.537 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e27f231:::benchmark_data_smithi188_161190_object125949:head# 2024-04-01T19:56:38.538 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e285fea:::benchmark_data_smithi188_161190_object35877:head# 2024-04-01T19:56:38.538 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e2874f4:::benchmark_data_smithi188_161190_object35223:head# 2024-04-01T19:56:38.538 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e28cdc4:::benchmark_data_smithi188_161190_object88378:head# 2024-04-01T19:56:38.539 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e29fce9:::benchmark_data_smithi188_161190_object121993:head# 2024-04-01T19:56:38.539 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e2b1633:::benchmark_data_smithi188_161190_object82946:head# 2024-04-01T19:56:38.540 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e2be00b:::benchmark_data_smithi188_161190_object101907:head# 2024-04-01T19:56:38.541 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e2c2b89:::benchmark_data_smithi188_161190_object51221:head# 2024-04-01T19:56:38.541 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e2c5913:::benchmark_data_smithi188_161190_object63168:head# 2024-04-01T19:56:38.547 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e2e1d37:::benchmark_data_smithi188_161190_object97773:head# 2024-04-01T19:56:38.547 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e2e9896:::benchmark_data_smithi188_161190_object65598:head# 2024-04-01T19:56:38.547 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e2ed809:::benchmark_data_smithi188_161190_object132873:head# 2024-04-01T19:56:38.547 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e2f15f1:::benchmark_data_smithi188_161190_object56465:head# 2024-04-01T19:56:38.547 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e2f5f79:::benchmark_data_smithi188_161190_object99037:head# 2024-04-01T19:56:38.547 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e2fefa9:::benchmark_data_smithi188_161190_object112761:head# 2024-04-01T19:56:38.548 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e2ff0a3:::benchmark_data_smithi188_161190_object101488:head# 2024-04-01T19:56:38.548 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e30585a:::benchmark_data_smithi188_161190_object82593:head# 2024-04-01T19:56:38.548 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e306c8a:::benchmark_data_smithi188_161190_object35378:head# 2024-04-01T19:56:38.548 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e30a537:::benchmark_data_smithi188_161190_object125726:head# 2024-04-01T19:56:38.548 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e3268ec:::benchmark_data_smithi188_161190_object76601:head# 2024-04-01T19:56:38.548 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e32c03e:::benchmark_data_smithi188_161190_object38526:head# 2024-04-01T19:56:38.548 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e342306:::benchmark_data_smithi188_161190_object54442:head# 2024-04-01T19:56:38.549 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e34850e:::benchmark_data_smithi188_161190_object81486:head# 2024-04-01T19:56:38.549 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e35ed85:::benchmark_data_smithi188_161190_object92341:head# 2024-04-01T19:56:38.549 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e3616a8:::benchmark_data_smithi188_161190_object67089:head# 2024-04-01T19:56:38.550 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e361738:::benchmark_data_smithi188_161190_object61435:head# 2024-04-01T19:56:38.561 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e362819:::benchmark_data_smithi188_161190_object89543:head# 2024-04-01T19:56:38.561 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e362912:::benchmark_data_smithi188_161190_object81789:head# 2024-04-01T19:56:38.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e366604:::benchmark_data_smithi188_161190_object20324:head# 2024-04-01T19:56:38.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e379f0a:::benchmark_data_smithi188_161190_object110247:head# 2024-04-01T19:56:38.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e37e13d:::benchmark_data_smithi188_161190_object19765:head# 2024-04-01T19:56:38.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e392d3a:::benchmark_data_smithi188_161190_object99970:head# 2024-04-01T19:56:38.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e3ab427:::benchmark_data_smithi188_161190_object122148:head# 2024-04-01T19:56:38.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e3afc47:::benchmark_data_smithi188_161190_object67694:head# 2024-04-01T19:56:38.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e3b2d95:::benchmark_data_smithi188_161190_object22829:head# 2024-04-01T19:56:38.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e3b80ce:::benchmark_data_smithi188_161190_object96572:head# 2024-04-01T19:56:38.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e3c18db:::benchmark_data_smithi188_161190_object100285:head# 2024-04-01T19:56:38.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e3c9751:::benchmark_data_smithi188_161190_object118513:head# 2024-04-01T19:56:38.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e3d4009:::benchmark_data_smithi188_161190_object88234:head# 2024-04-01T19:56:38.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e3d99c9:::benchmark_data_smithi188_161190_object78998:head# 2024-04-01T19:56:38.562 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e3dda6c:::benchmark_data_smithi188_161190_object41498:head# 2024-04-01T19:56:38.563 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e3e73b8:::benchmark_data_smithi188_161190_object74567:head# 2024-04-01T19:56:38.563 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e3f376d:::benchmark_data_smithi188_161190_object96043:head# 2024-04-01T19:56:38.563 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e3fbda7:::benchmark_data_smithi188_161190_object111572:head# 2024-04-01T19:56:38.563 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e3fbfb1:::benchmark_data_smithi188_161190_object70204:head# 2024-04-01T19:56:38.563 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e40ef01:::benchmark_data_smithi188_161190_object23999:head# 2024-04-01T19:56:38.563 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e40efbc:::benchmark_data_smithi188_161190_object107611:head# 2024-04-01T19:56:38.563 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e40fbf1:::benchmark_data_smithi188_161190_object59714:head# 2024-04-01T19:56:38.563 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e425b77:::benchmark_data_smithi188_161190_object78900:head# 2024-04-01T19:56:38.563 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e42dd67:::benchmark_data_smithi188_161190_object42446:head# 2024-04-01T19:56:38.563 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e438415:::benchmark_data_smithi188_161190_object66533:head# 2024-04-01T19:56:38.563 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e4399c1:::benchmark_data_smithi188_161190_object136168:head# 2024-04-01T19:56:38.563 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e439a52:::benchmark_data_smithi188_161190_object136100:head# 2024-04-01T19:56:38.564 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e445e4a:::benchmark_data_smithi188_161190_object97688:head# 2024-04-01T19:56:38.565 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e446a91:::benchmark_data_smithi188_161190_object37792:head# 2024-04-01T19:56:38.565 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e446c58:::benchmark_data_smithi188_161190_object79327:head# 2024-04-01T19:56:38.565 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e4496e7:::benchmark_data_smithi188_161190_object40666:head# 2024-04-01T19:56:38.565 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e44c242:::benchmark_data_smithi188_161190_object78171:head# 2024-04-01T19:56:38.565 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e450b1e:::benchmark_data_smithi188_161190_object44641:head# 2024-04-01T19:56:38.565 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e4526f9:::benchmark_data_smithi188_161190_object29154:head# 2024-04-01T19:56:38.566 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e45ab29:::benchmark_data_smithi188_161190_object45858:head# 2024-04-01T19:56:38.566 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e45ae24:::benchmark_data_smithi188_161190_object20358:head# 2024-04-01T19:56:38.566 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e47952e:::benchmark_data_smithi188_161190_object70749:head# 2024-04-01T19:56:38.566 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e47d9f2:::benchmark_data_smithi188_161190_object105803:head# 2024-04-01T19:56:38.566 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e48d424:::benchmark_data_smithi188_161190_object26457:head# 2024-04-01T19:56:38.567 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e48fe60:::benchmark_data_smithi188_161190_object27286:head# 2024-04-01T19:56:38.567 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e4a8299:::benchmark_data_smithi188_161190_object129379:head# 2024-04-01T19:56:38.572 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e4b279f:::benchmark_data_smithi188_161190_object114888:head# 2024-04-01T19:56:38.572 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e4b2a4f:::benchmark_data_smithi188_161190_object57019:head# 2024-04-01T19:56:38.572 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e4c7b05:::benchmark_data_smithi188_161190_object93533:head# 2024-04-01T19:56:38.572 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e4cdb93:::benchmark_data_smithi188_161190_object130029:head# 2024-04-01T19:56:38.572 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e4ce373:::benchmark_data_smithi188_161190_object113183:head# 2024-04-01T19:56:38.573 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e4cec7a:::benchmark_data_smithi188_161190_object69892:head# 2024-04-01T19:56:38.573 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e4cf207:::benchmark_data_smithi188_161190_object94838:head# 2024-04-01T19:56:38.573 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e4cf90b:::benchmark_data_smithi188_161190_object78916:head# 2024-04-01T19:56:38.574 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e4cfe0e:::benchmark_data_smithi188_161190_object121383:head# 2024-04-01T19:56:38.577 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e4d06a6:::benchmark_data_smithi188_161190_object88795:head# 2024-04-01T19:56:38.577 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e5188ed:::benchmark_data_smithi188_161190_object74877:head# 2024-04-01T19:56:38.588 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e51ead5:::benchmark_data_smithi188_161190_object121311:head# 2024-04-01T19:56:38.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e52029c:::benchmark_data_smithi188_161190_object25923:head# 2024-04-01T19:56:38.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e524ef5:::benchmark_data_smithi188_161190_object28593:head# 2024-04-01T19:56:38.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e52a6d9:::benchmark_data_smithi188_161190_object94813:head# 2024-04-01T19:56:38.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e52c1d4:::benchmark_data_smithi188_161190_object35211:head# 2024-04-01T19:56:38.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e52c7b4:::benchmark_data_smithi188_161190_object105014:head# 2024-04-01T19:56:38.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e533fb0:::benchmark_data_smithi188_161190_object119331:head# 2024-04-01T19:56:38.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e53bd1e:::benchmark_data_smithi188_161190_object44541:head# 2024-04-01T19:56:38.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e540c19:::benchmark_data_smithi188_161190_object104980:head# 2024-04-01T19:56:38.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e541548:::benchmark_data_smithi188_161190_object53287:head# 2024-04-01T19:56:38.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e54b4f3:::benchmark_data_smithi188_161190_object98906:head# 2024-04-01T19:56:38.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e55d240:::benchmark_data_smithi188_161190_object50982:head# 2024-04-01T19:56:38.589 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e560517:::benchmark_data_smithi188_161190_object60404:head# 2024-04-01T19:56:38.590 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e5774a1:::benchmark_data_smithi188_161190_object40628:head# 2024-04-01T19:56:38.590 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e581138:::benchmark_data_smithi188_161190_object88178:head# 2024-04-01T19:56:38.590 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e5885d5:::benchmark_data_smithi188_161190_object85919:head# 2024-04-01T19:56:38.590 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e58a0b5:::benchmark_data_smithi188_161190_object63645:head# 2024-04-01T19:56:38.590 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e5924ce:::benchmark_data_smithi188_161190_object62442:head# 2024-04-01T19:56:38.591 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e59565b:::benchmark_data_smithi188_161190_object68888:head# 2024-04-01T19:56:38.597 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e597515:::benchmark_data_smithi188_161190_object107833:head# 2024-04-01T19:56:38.597 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e59e194:::benchmark_data_smithi188_161190_object52980:head# 2024-04-01T19:56:38.597 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e59f66d:::benchmark_data_smithi188_161190_object105617:head# 2024-04-01T19:56:38.597 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e5be27d:::benchmark_data_smithi188_161190_object98984:head# 2024-04-01T19:56:38.597 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e5c69b8:::benchmark_data_smithi188_161190_object91085:head# 2024-04-01T19:56:38.597 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e5c7fe0:::benchmark_data_smithi188_161190_object128933:head# 2024-04-01T19:56:38.597 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e5c82b3:::benchmark_data_smithi188_161190_object20758:head# 2024-04-01T19:56:38.597 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e5ca14a:::benchmark_data_smithi188_161190_object138403:head# 2024-04-01T19:56:38.598 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e5cd267:::benchmark_data_smithi188_161190_object48239:head# 2024-04-01T19:56:38.598 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e5d0a50:::benchmark_data_smithi188_161190_object59810:head# 2024-04-01T19:56:38.599 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e5d320f:::benchmark_data_smithi188_161190_object85156:head# 2024-04-01T19:56:38.599 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e5dab54:::benchmark_data_smithi188_161190_object111025:head# 2024-04-01T19:56:38.600 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e5dc194:::benchmark_data_smithi188_161190_object52308:head# 2024-04-01T19:56:38.600 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e5dea5d:::benchmark_data_smithi188_161190_object85573:head# 2024-04-01T19:56:38.601 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e5df53d:::benchmark_data_smithi188_161190_object108465:head# 2024-04-01T19:56:38.601 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e5e374b:::benchmark_data_smithi188_161190_object90330:head# 2024-04-01T19:56:38.602 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e5ef52c:::benchmark_data_smithi188_161190_object69414:head# 2024-04-01T19:56:38.604 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e5f1dd9:::benchmark_data_smithi188_161190_object112884:head# 2024-04-01T19:56:38.604 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e60c879:::benchmark_data_smithi188_161190_object98632:head# 2024-04-01T19:56:38.604 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e60de0c:::benchmark_data_smithi188_161190_object79701:head# 2024-04-01T19:56:38.605 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e60f008:::benchmark_data_smithi188_161190_object37723:head# 2024-04-01T19:56:38.605 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e612769:::benchmark_data_smithi188_161190_object107263:head# 2024-04-01T19:56:38.606 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e61aeea:::benchmark_data_smithi188_161190_object43668:head# 2024-04-01T19:56:38.606 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e6209fe:::benchmark_data_smithi188_161190_object90154:head# 2024-04-01T19:56:38.607 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e622f2a:::benchmark_data_smithi188_161190_object100793:head# 2024-04-01T19:56:38.614 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e62d3df:::benchmark_data_smithi188_161190_object24250:head# 2024-04-01T19:56:38.614 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e636d35:::benchmark_data_smithi188_161190_object30783:head# 2024-04-01T19:56:38.614 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e64051d:::benchmark_data_smithi188_161190_object32001:head# 2024-04-01T19:56:38.614 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e64839f:::benchmark_data_smithi188_161190_object83504:head# 2024-04-01T19:56:38.614 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e64c4b8:::benchmark_data_smithi188_161190_object101593:head# 2024-04-01T19:56:38.614 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e660750:::benchmark_data_smithi188_161190_object45447:head# 2024-04-01T19:56:38.614 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e6677e1:::benchmark_data_smithi188_161190_object128104:head# 2024-04-01T19:56:38.614 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e673377:::benchmark_data_smithi188_161190_object42090:head# 2024-04-01T19:56:38.614 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e6755f7:::benchmark_data_smithi188_161190_object57889:head# 2024-04-01T19:56:38.615 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e678032:::benchmark_data_smithi188_161190_object105709:head# 2024-04-01T19:56:38.615 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e67e024:::benchmark_data_smithi188_161190_object75002:head# 2024-04-01T19:56:38.615 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e68a614:::benchmark_data_smithi188_161190_object104684:head# 2024-04-01T19:56:38.615 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e69378f:::benchmark_data_smithi188_161190_object79470:head# 2024-04-01T19:56:38.616 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e6979d9:::benchmark_data_smithi188_161190_object88668:head# 2024-04-01T19:56:38.616 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e69ba34:::benchmark_data_smithi188_161190_object29336:head# 2024-04-01T19:56:38.617 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e69d141:::benchmark_data_smithi188_161190_object130417:head# 2024-04-01T19:56:38.617 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e6a1484:::benchmark_data_smithi188_161190_object24505:head# 2024-04-01T19:56:38.618 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e6a4cca:::benchmark_data_smithi188_161190_object57618:head# 2024-04-01T19:56:38.618 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e6a740f:::benchmark_data_smithi188_161190_object59586:head# 2024-04-01T19:56:38.618 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e6c0fa4:::benchmark_data_smithi188_161190_object59808:head# 2024-04-01T19:56:38.619 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e6c71ac:::benchmark_data_smithi188_161190_object32547:head# 2024-04-01T19:56:38.619 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e6cb04f:::benchmark_data_smithi188_161190_object82910:head# 2024-04-01T19:56:38.619 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e6d2b68:::benchmark_data_smithi188_161190_object34524:head# 2024-04-01T19:56:38.620 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e6e31ad:::benchmark_data_smithi188_161190_object128382:head# 2024-04-01T19:56:38.620 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e6e5ed1:::benchmark_data_smithi188_161190_object42750:head# 2024-04-01T19:56:38.621 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e6ef996:::benchmark_data_smithi188_161190_object72578:head# 2024-04-01T19:56:38.621 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e6f82c1:::benchmark_data_smithi188_161190_object101073:head# 2024-04-01T19:56:38.621 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e71a0d7:::benchmark_data_smithi188_161190_object106157:head# 2024-04-01T19:56:38.622 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e723e75:::benchmark_data_smithi188_161190_object95084:head# 2024-04-01T19:56:38.622 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e7279d6:::benchmark_data_smithi188_161190_object92205:head# 2024-04-01T19:56:38.623 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e73e400:::benchmark_data_smithi188_161190_object114592:head# 2024-04-01T19:56:38.623 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e7465f4:::benchmark_data_smithi188_161190_object96245:head# 2024-04-01T19:56:38.624 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e74f7ab:::benchmark_data_smithi188_161190_object32651:head# 2024-04-01T19:56:38.624 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e76972a:::benchmark_data_smithi188_161190_object28585:head# 2024-04-01T19:56:38.624 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e76b892:::benchmark_data_smithi188_161190_object49337:head# 2024-04-01T19:56:38.625 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e77979c:::benchmark_data_smithi188_161190_object59567:head# 2024-04-01T19:56:38.625 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e787814:::benchmark_data_smithi188_161190_object45797:head# 2024-04-01T19:56:38.626 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e787b94:::benchmark_data_smithi188_161190_object92095:head# 2024-04-01T19:56:38.626 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e791851:::benchmark_data_smithi188_161190_object95171:head# 2024-04-01T19:56:38.627 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e7934c4:::benchmark_data_smithi188_161190_object43786:head# 2024-04-01T19:56:38.627 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e794ad6:::benchmark_data_smithi188_161190_object86832:head# 2024-04-01T19:56:38.627 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e79a1eb:::benchmark_data_smithi188_161190_object61526:head# 2024-04-01T19:56:38.628 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e7aa59f:::benchmark_data_smithi188_161190_object95312:head# 2024-04-01T19:56:38.628 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e7aae7d:::benchmark_data_smithi188_161190_object37943:head# 2024-04-01T19:56:38.629 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e7b4255:::benchmark_data_smithi188_161190_object39274:head# 2024-04-01T19:56:38.629 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e7b7293:::benchmark_data_smithi188_161190_object98385:head# 2024-04-01T19:56:38.630 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e7c7580:::benchmark_data_smithi188_161190_object137492:head# 2024-04-01T19:56:38.630 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e7e6342:::benchmark_data_smithi188_161190_object44112:head# 2024-04-01T19:56:38.630 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e7eb049:::benchmark_data_smithi188_161190_object56103:head# 2024-04-01T19:56:38.631 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e7f21e3:::benchmark_data_smithi188_161190_object108363:head# 2024-04-01T19:56:38.631 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e7fa80a:::benchmark_data_smithi188_161190_object100157:head# 2024-04-01T19:56:38.632 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e80068c:::benchmark_data_smithi188_161190_object50014:head# 2024-04-01T19:56:38.632 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e80bac3:::benchmark_data_smithi188_161190_object79833:head# 2024-04-01T19:56:38.633 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e80c6af:::benchmark_data_smithi188_161190_object117350:head# 2024-04-01T19:56:38.633 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e812922:::benchmark_data_smithi188_161190_object116661:head# 2024-04-01T19:56:38.634 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e814794:::benchmark_data_smithi188_161190_object105558:head# 2024-04-01T19:56:38.634 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e81c4ca:::benchmark_data_smithi188_161190_object131643:head# 2024-04-01T19:56:38.634 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e84a501:::benchmark_data_smithi188_161190_object28586:head# 2024-04-01T19:56:38.635 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e84aa73:::benchmark_data_smithi188_161190_object99610:head# 2024-04-01T19:56:38.635 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e852b2b:::benchmark_data_smithi188_161190_object116552:head# 2024-04-01T19:56:38.636 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e8549e3:::benchmark_data_smithi188_161190_object83553:head# 2024-04-01T19:56:38.636 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e85abfc:::benchmark_data_smithi188_161190_object50065:head# 2024-04-01T19:56:38.637 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e85afbf:::benchmark_data_smithi188_161190_object134096:head# 2024-04-01T19:56:38.637 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e870e3e:::benchmark_data_smithi188_161190_object110800:head# 2024-04-01T19:56:38.638 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e874cdd:::benchmark_data_smithi188_161190_object138254:head# 2024-04-01T19:56:38.638 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e876d3e:::benchmark_data_smithi188_161190_object87307:head# 2024-04-01T19:56:38.638 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e87df7d:::benchmark_data_smithi188_161190_object120910:head# 2024-04-01T19:56:38.643 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e8828b3:::benchmark_data_smithi188_161190_object108531:head# 2024-04-01T19:56:38.644 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e88614a:::benchmark_data_smithi188_161190_object103292:head# 2024-04-01T19:56:38.644 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e8890c0:::benchmark_data_smithi188_161190_object43234:head# 2024-04-01T19:56:38.644 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e892b68:::benchmark_data_smithi188_161190_object101275:head# 2024-04-01T19:56:38.644 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e898555:::benchmark_data_smithi188_161190_object58172:head# 2024-04-01T19:56:38.644 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e89935d:::benchmark_data_smithi188_161190_object25229:head# 2024-04-01T19:56:38.644 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e8a56b4:::benchmark_data_smithi188_161190_object85745:head# 2024-04-01T19:56:38.647 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e8a619d:::benchmark_data_smithi188_161190_object35094:head# 2024-04-01T19:56:38.647 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e8b1155:::benchmark_data_smithi188_161190_object27665:head# 2024-04-01T19:56:38.647 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e8b4005:::benchmark_data_smithi188_161190_object47808:head# 2024-04-01T19:56:38.647 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e8b9293:::benchmark_data_smithi188_161190_object60230:head# 2024-04-01T19:56:38.647 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e8c56dd:::benchmark_data_smithi188_161190_object117421:head# 2024-04-01T19:56:38.647 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e8cbc56:::benchmark_data_smithi188_161190_object121485:head# 2024-04-01T19:56:38.648 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e8d3d61:::benchmark_data_smithi188_161190_object132551:head# 2024-04-01T19:56:38.648 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e8d65e4:::benchmark_data_smithi188_161190_object98343:head# 2024-04-01T19:56:38.648 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e8f83c2:::benchmark_data_smithi188_161190_object60819:head# 2024-04-01T19:56:38.648 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e8f88f3:::benchmark_data_smithi188_161190_object86128:head# 2024-04-01T19:56:38.648 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e8f8ed7:::benchmark_data_smithi188_161190_object126790:head# 2024-04-01T19:56:38.648 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e9034b5:::benchmark_data_smithi188_161190_object66952:head# 2024-04-01T19:56:38.648 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e90f64b:::benchmark_data_smithi188_161190_object120654:head# 2024-04-01T19:56:38.649 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e9138b4:::benchmark_data_smithi188_161190_object54364:head# 2024-04-01T19:56:38.649 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e91c626:::benchmark_data_smithi188_161190_object122154:head# 2024-04-01T19:56:38.649 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e91ff07:::benchmark_data_smithi188_161190_object81234:head# 2024-04-01T19:56:38.655 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e925ce3:::benchmark_data_smithi188_161190_object26079:head# 2024-04-01T19:56:38.661 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e92977b:::benchmark_data_smithi188_161190_object84173:head# 2024-04-01T19:56:38.661 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e958447:::benchmark_data_smithi188_161190_object60064:head# 2024-04-01T19:56:38.662 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e96884b:::benchmark_data_smithi188_161190_object28644:head# 2024-04-01T19:56:38.662 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e96b062:::benchmark_data_smithi188_161190_object89346:head# 2024-04-01T19:56:38.663 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e970d93:::benchmark_data_smithi188_161190_object55079:head# 2024-04-01T19:56:38.664 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e975fdc:::benchmark_data_smithi188_161190_object133345:head# 2024-04-01T19:56:38.665 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e979f1e:::benchmark_data_smithi188_161190_object52253:head# 2024-04-01T19:56:38.665 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e97ff5a:::benchmark_data_smithi188_161190_object89342:head# 2024-04-01T19:56:38.667 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e980cdb:::benchmark_data_smithi188_161190_object47155:head# 2024-04-01T19:56:38.667 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e988fd6:::benchmark_data_smithi188_161190_object128898:head# 2024-04-01T19:56:38.667 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e9929c4:::benchmark_data_smithi188_161190_object114310:head# 2024-04-01T19:56:38.668 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e996f74:::benchmark_data_smithi188_161190_object117417:head# 2024-04-01T19:56:38.668 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e998875:::benchmark_data_smithi188_161190_object135443:head# 2024-04-01T19:56:38.669 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e9ad460:::benchmark_data_smithi188_161190_object23269:head# 2024-04-01T19:56:38.669 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e9b46f7:::benchmark_data_smithi188_161190_object84922:head# 2024-04-01T19:56:38.669 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e9bb8af:::benchmark_data_smithi188_161190_object83142:head# 2024-04-01T19:56:38.670 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e9d18e0:::benchmark_data_smithi188_161190_object91011:head# 2024-04-01T19:56:38.670 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e9e5d05:::benchmark_data_smithi188_161190_object48520:head# 2024-04-01T19:56:38.671 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e9efdcc:::benchmark_data_smithi188_161190_object129864:head# 2024-04-01T19:56:38.671 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9e9f1c4c:::benchmark_data_smithi188_161190_object38292:head# 2024-04-01T19:56:38.671 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ea017e7:::benchmark_data_smithi188_161190_object93648:head# 2024-04-01T19:56:38.672 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ea052ec:::benchmark_data_smithi188_161190_object27120:head# 2024-04-01T19:56:38.672 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ea1442e:::benchmark_data_smithi188_161190_object121353:head# 2024-04-01T19:56:38.673 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ea1643c:::benchmark_data_smithi188_161190_object32176:head# 2024-04-01T19:56:38.673 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ea26662:::benchmark_data_smithi188_161190_object34040:head# 2024-04-01T19:56:38.675 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ea36758:::benchmark_data_smithi188_161190_object29870:head# 2024-04-01T19:56:38.675 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ea43222:::benchmark_data_smithi188_161190_object125825:head# 2024-04-01T19:56:38.676 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ea5577e:::benchmark_data_smithi188_161190_object51069:head# 2024-04-01T19:56:38.676 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ea64dd1:::benchmark_data_smithi188_161190_object118379:head# 2024-04-01T19:56:38.676 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ea677be:::benchmark_data_smithi188_161190_object21985:head# 2024-04-01T19:56:38.678 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ea6b557:::benchmark_data_smithi188_161190_object56529:head# 2024-04-01T19:56:38.678 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ea6bddf:::benchmark_data_smithi188_161190_object93730:head# 2024-04-01T19:56:38.678 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ea6eeab:::benchmark_data_smithi188_161190_object29552:head# 2024-04-01T19:56:38.678 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ea7490c:::benchmark_data_smithi188_161190_object121662:head# 2024-04-01T19:56:38.682 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ea8a02b:::benchmark_data_smithi188_161190_object30930:head# 2024-04-01T19:56:38.682 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ea8a06c:::benchmark_data_smithi188_161190_object47161:head# 2024-04-01T19:56:38.682 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ea91a15:::benchmark_data_smithi188_161190_object49987:head# 2024-04-01T19:56:38.683 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ea9da59:::benchmark_data_smithi188_161190_object86029:head# 2024-04-01T19:56:38.683 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eaa599f:::benchmark_data_smithi188_161190_object86124:head# 2024-04-01T19:56:38.684 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eabf0fc:::benchmark_data_smithi188_161190_object91558:head# 2024-04-01T19:56:38.684 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eacfa64:::benchmark_data_smithi188_161190_object111195:head# 2024-04-01T19:56:38.684 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eadbe61:::benchmark_data_smithi188_161190_object65217:head# 2024-04-01T19:56:38.688 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eae5285:::benchmark_data_smithi188_161190_object21574:head# 2024-04-01T19:56:38.689 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eaf536b:::benchmark_data_smithi188_161190_object37598:head# 2024-04-01T19:56:38.690 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eb05a9d:::benchmark_data_smithi188_161190_object56744:head# 2024-04-01T19:56:38.690 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eb06148:::benchmark_data_smithi188_161190_object68357:head# 2024-04-01T19:56:38.690 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eb17ebd:::benchmark_data_smithi188_161190_object36721:head# 2024-04-01T19:56:38.691 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eb19343:::benchmark_data_smithi188_161190_object51546:head# 2024-04-01T19:56:38.697 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eb2c862:::benchmark_data_smithi188_161190_object51951:head# 2024-04-01T19:56:38.698 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eb2cd25:::benchmark_data_smithi188_161190_object85694:head# 2024-04-01T19:56:38.698 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eb3c8ec:::benchmark_data_smithi188_161190_object45444:head# 2024-04-01T19:56:38.698 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eb4408e:::benchmark_data_smithi188_161190_object119452:head# 2024-04-01T19:56:38.698 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eb4bb12:::benchmark_data_smithi188_161190_object65492:head# 2024-04-01T19:56:38.698 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eb69ab8:::benchmark_data_smithi188_161190_object74683:head# 2024-04-01T19:56:38.698 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eb6d837:::benchmark_data_smithi188_161190_object74522:head# 2024-04-01T19:56:38.698 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eb8cf2f:::benchmark_data_smithi188_161190_object137076:head# 2024-04-01T19:56:38.698 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eb8ef38:::benchmark_data_smithi188_161190_object81330:head# 2024-04-01T19:56:38.698 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eb977d5:::benchmark_data_smithi188_161190_object84217:head# 2024-04-01T19:56:38.699 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eba931d:::benchmark_data_smithi188_161190_object32297:head# 2024-04-01T19:56:38.699 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ebaac1e:::benchmark_data_smithi188_161190_object125004:head# 2024-04-01T19:56:38.699 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ebaf079:::benchmark_data_smithi188_161190_object42511:head# 2024-04-01T19:56:38.699 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ebb29e3:::benchmark_data_smithi188_161190_object57168:head# 2024-04-01T19:56:38.704 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ebb8548:::benchmark_data_smithi188_161190_object126349:head# 2024-04-01T19:56:38.705 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ebb8f97:::benchmark_data_smithi188_161190_object115429:head# 2024-04-01T19:56:38.705 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ebc120f:::benchmark_data_smithi188_161190_object56654:head# 2024-04-01T19:56:38.706 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ebc5c6f:::benchmark_data_smithi188_161190_object129808:head# 2024-04-01T19:56:38.706 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ebcf0ea:::benchmark_data_smithi188_161190_object77026:head# 2024-04-01T19:56:38.706 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ebd261c:::benchmark_data_smithi188_161190_object21235:head# 2024-04-01T19:56:38.707 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ebd2c99:::benchmark_data_smithi188_161190_object45921:head# 2024-04-01T19:56:38.707 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ebdaf25:::benchmark_data_smithi188_161190_object100346:head# 2024-04-01T19:56:38.708 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ebe424c:::benchmark_data_smithi188_161190_object75573:head# 2024-04-01T19:56:38.708 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ebe967b:::benchmark_data_smithi188_161190_object105495:head# 2024-04-01T19:56:38.709 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ebf40b2:::benchmark_data_smithi188_161190_object108043:head# 2024-04-01T19:56:38.709 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ebfae59:::benchmark_data_smithi188_161190_object35065:head# 2024-04-01T19:56:38.709 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ec01344:::benchmark_data_smithi188_161190_object74565:head# 2024-04-01T19:56:38.709 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ec0ca67:::benchmark_data_smithi188_161190_object120001:head# 2024-04-01T19:56:38.710 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ec121fd:::benchmark_data_smithi188_161190_object32566:head# 2024-04-01T19:56:38.710 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ec14585:::benchmark_data_smithi188_161190_object38001:head# 2024-04-01T19:56:38.710 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ec14a22:::benchmark_data_smithi188_161190_object47055:head# 2024-04-01T19:56:38.711 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ec1a8e5:::benchmark_data_smithi188_161190_object53666:head# 2024-04-01T19:56:38.714 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ec1fcbf:::benchmark_data_smithi188_161190_object40809:head# 2024-04-01T19:56:38.714 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ec26a9a:::benchmark_data_smithi188_161190_object117650:head# 2024-04-01T19:56:38.715 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ec29a45:::benchmark_data_smithi188_161190_object66890:head# 2024-04-01T19:56:38.715 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ec33cff:::benchmark_data_smithi188_161190_object105452:head# 2024-04-01T19:56:38.715 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ec3a042:::benchmark_data_smithi188_161190_object72478:head# 2024-04-01T19:56:38.715 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ec4871a:::benchmark_data_smithi188_161190_object78598:head# 2024-04-01T19:56:38.715 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ec4b5a9:::benchmark_data_smithi188_161190_object89982:head# 2024-04-01T19:56:38.715 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ec4e8f3:::benchmark_data_smithi188_161190_object130812:head# 2024-04-01T19:56:38.722 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ec5f575:::benchmark_data_smithi188_161190_object41314:head# 2024-04-01T19:56:38.722 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ec6d2d0:::benchmark_data_smithi188_161190_object81045:head# 2024-04-01T19:56:38.722 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ec755a3:::benchmark_data_smithi188_161190_object66837:head# 2024-04-01T19:56:38.722 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ec84df9:::benchmark_data_smithi188_161190_object59305:head# 2024-04-01T19:56:38.722 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ec882f0:::benchmark_data_smithi188_161190_object27011:head# 2024-04-01T19:56:38.723 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ec89b04:::benchmark_data_smithi188_161190_object63575:head# 2024-04-01T19:56:38.723 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ec8c0ff:::benchmark_data_smithi188_161190_object55017:head# 2024-04-01T19:56:38.728 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ec991b5:::benchmark_data_smithi188_161190_object40674:head# 2024-04-01T19:56:38.728 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ec9e873:::benchmark_data_smithi188_161190_object122801:head# 2024-04-01T19:56:38.728 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eca8ba5:::benchmark_data_smithi188_161190_object68261:head# 2024-04-01T19:56:38.728 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ecab095:::benchmark_data_smithi188_161190_object42059:head# 2024-04-01T19:56:38.729 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ecc7a87:::benchmark_data_smithi188_161190_object75308:head# 2024-04-01T19:56:38.729 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ecc94fc:::benchmark_data_smithi188_161190_object21549:head# 2024-04-01T19:56:38.729 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ecca58a:::benchmark_data_smithi188_161190_object110589:head# 2024-04-01T19:56:38.729 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eccb52c:::benchmark_data_smithi188_161190_object118578:head# 2024-04-01T19:56:38.729 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eccbf04:::benchmark_data_smithi188_161190_object114108:head# 2024-04-01T19:56:38.729 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eccf2f0:::benchmark_data_smithi188_161190_object92348:head# 2024-04-01T19:56:38.729 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ecd18ef:::benchmark_data_smithi188_161190_object103692:head# 2024-04-01T19:56:38.734 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ecd77b0:::benchmark_data_smithi188_161190_object55872:head# 2024-04-01T19:56:38.734 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ecd7e0b:::benchmark_data_smithi188_161190_object88022:head# 2024-04-01T19:56:38.734 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ece0d8f:::benchmark_data_smithi188_161190_object33672:head# 2024-04-01T19:56:38.734 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ece18a4:::benchmark_data_smithi188_161190_object66792:head# 2024-04-01T19:56:38.734 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ece4603:::benchmark_data_smithi188_161190_object42680:head# 2024-04-01T19:56:38.738 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ece483b:::benchmark_data_smithi188_161190_object65460:head# 2024-04-01T19:56:38.738 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ece9bff:::benchmark_data_smithi188_161190_object44918:head# 2024-04-01T19:56:38.738 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ececab6:::benchmark_data_smithi188_161190_object44181:head# 2024-04-01T19:56:38.739 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ecf45fb:::benchmark_data_smithi188_161190_object44750:head# 2024-04-01T19:56:38.745 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ed10520:::benchmark_data_smithi188_161190_object112031:head# 2024-04-01T19:56:38.745 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ed10807:::benchmark_data_smithi188_161190_object60036:head# 2024-04-01T19:56:38.745 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ed261ec:::benchmark_data_smithi188_161190_object47028:head# 2024-04-01T19:56:38.745 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ed263f7:::benchmark_data_smithi188_161190_object33919:head# 2024-04-01T19:56:38.746 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ed27f38:::benchmark_data_smithi188_161190_object94483:head# 2024-04-01T19:56:38.748 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ed330fb:::benchmark_data_smithi188_161190_object31158:head# 2024-04-01T19:56:38.748 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ed3a5fb:::benchmark_data_smithi188_161190_object56164:head# 2024-04-01T19:56:38.748 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ed3a69d:::benchmark_data_smithi188_161190_object59092:head# 2024-04-01T19:56:38.748 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ed4b904:::benchmark_data_smithi188_161190_object31827:head# 2024-04-01T19:56:38.753 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ed4d6ac:::benchmark_data_smithi188_161190_object67726:head# 2024-04-01T19:56:38.753 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ed5ae26:::benchmark_data_smithi188_161190_object98532:head# 2024-04-01T19:56:38.753 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ed5e867:::benchmark_data_smithi188_161190_object51270:head# 2024-04-01T19:56:38.753 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ed64d8d:::benchmark_data_smithi188_161190_object85103:head# 2024-04-01T19:56:38.753 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ed6801c:::benchmark_data_smithi188_161190_object51673:head# 2024-04-01T19:56:38.753 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ed736c3:::benchmark_data_smithi188_161190_object91189:head# 2024-04-01T19:56:38.753 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ed7c1d3:::benchmark_data_smithi188_161190_object62010:head# 2024-04-01T19:56:38.753 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ed887ae:::benchmark_data_smithi188_161190_object51108:head# 2024-04-01T19:56:38.753 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ed8d8b8:::benchmark_data_smithi188_161190_object77990:head# 2024-04-01T19:56:38.753 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9edab843:::benchmark_data_smithi188_161190_object78481:head# 2024-04-01T19:56:38.758 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9edac6b9:::benchmark_data_smithi188_161190_object103899:head# 2024-04-01T19:56:38.760 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:38 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/426780015' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:56:38.762 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9edb41f3:::benchmark_data_smithi188_161190_object125400:head# 2024-04-01T19:56:38.770 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9edc2bd5:::benchmark_data_smithi188_161190_object50812:head# 2024-04-01T19:56:38.770 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9edc5bef:::benchmark_data_smithi188_161190_object85215:head# 2024-04-01T19:56:38.771 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9edc9f6f:::benchmark_data_smithi188_161190_object58119:head# 2024-04-01T19:56:38.771 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9edd450f:::benchmark_data_smithi188_161190_object20190:head# 2024-04-01T19:56:38.771 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9edd64d2:::benchmark_data_smithi188_161190_object138874:head# 2024-04-01T19:56:38.771 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9edde539:::benchmark_data_smithi188_161190_object133634:head# 2024-04-01T19:56:38.771 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ede70fd:::benchmark_data_smithi188_161190_object134403:head# 2024-04-01T19:56:38.772 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ede966d:::benchmark_data_smithi188_161190_object27826:head# 2024-04-01T19:56:38.772 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9edf00cc:::benchmark_data_smithi188_161190_object38945:head# 2024-04-01T19:56:38.774 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9edf707d:::benchmark_data_smithi188_161190_object93107:head# 2024-04-01T19:56:38.774 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9edf993b:::benchmark_data_smithi188_161190_object102977:head# 2024-04-01T19:56:38.775 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ee0a20a:::benchmark_data_smithi188_161190_object89943:head# 2024-04-01T19:56:38.775 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ee10703:::benchmark_data_smithi188_161190_object126303:head# 2024-04-01T19:56:38.776 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ee1227b:::benchmark_data_smithi188_161190_object65237:head# 2024-04-01T19:56:38.776 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ee1447d:::benchmark_data_smithi188_161190_object125652:head# 2024-04-01T19:56:38.776 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ee1da8b:::benchmark_data_smithi188_161190_object86186:head# 2024-04-01T19:56:38.777 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ee1e9e6:::benchmark_data_smithi188_161190_object69031:head# 2024-04-01T19:56:38.778 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ee26ab5:::benchmark_data_smithi188_161190_object136535:head# 2024-04-01T19:56:38.779 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ee2b9e9:::benchmark_data_smithi188_161190_object108933:head# 2024-04-01T19:56:38.779 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ee2c1bd:::benchmark_data_smithi188_161190_object123235:head# 2024-04-01T19:56:38.780 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ee2efa4:::benchmark_data_smithi188_161190_object25800:head# 2024-04-01T19:56:38.780 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ee3927c:::benchmark_data_smithi188_161190_object44390:head# 2024-04-01T19:56:38.781 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ee39810:::benchmark_data_smithi188_161190_object30574:head# 2024-04-01T19:56:38.781 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ee3cddf:::benchmark_data_smithi188_161190_object118626:head# 2024-04-01T19:56:38.781 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ee6b0b3:::benchmark_data_smithi188_161190_object27070:head# 2024-04-01T19:56:38.784 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ee7469b:::benchmark_data_smithi188_161190_object55177:head# 2024-04-01T19:56:38.784 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ee86b8e:::benchmark_data_smithi188_161190_object36285:head# 2024-04-01T19:56:38.784 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ee88699:::benchmark_data_smithi188_161190_object135942:head# 2024-04-01T19:56:38.785 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ee97acd:::benchmark_data_smithi188_161190_object44723:head# 2024-04-01T19:56:38.785 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eea1296:::benchmark_data_smithi188_161190_object128267:head# 2024-04-01T19:56:38.786 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eeaa174:::benchmark_data_smithi188_161190_object66499:head# 2024-04-01T19:56:38.786 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eeb00ca:::benchmark_data_smithi188_161190_object122272:head# 2024-04-01T19:56:38.787 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eec1b1d:::benchmark_data_smithi188_161190_object126407:head# 2024-04-01T19:56:38.787 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eec6e07:::benchmark_data_smithi188_161190_object120699:head# 2024-04-01T19:56:38.787 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eecdc7f:::benchmark_data_smithi188_161190_object80608:head# 2024-04-01T19:56:38.788 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eeed01a:::benchmark_data_smithi188_161190_object138875:head# 2024-04-01T19:56:38.788 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eef7ba5:::benchmark_data_smithi188_161190_object67024:head# 2024-04-01T19:56:38.789 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eef83ab:::benchmark_data_smithi188_161190_object97389:head# 2024-04-01T19:56:38.789 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eef9dca:::benchmark_data_smithi188_161190_object43124:head# 2024-04-01T19:56:38.789 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef023d0:::benchmark_data_smithi188_161190_object44553:head# 2024-04-01T19:56:38.793 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef038f3:::benchmark_data_smithi188_161190_object135171:head# 2024-04-01T19:56:38.793 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef12b38:::benchmark_data_smithi188_161190_object110669:head# 2024-04-01T19:56:38.793 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef173f6:::benchmark_data_smithi188_161190_object43486:head# 2024-04-01T19:56:38.793 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef1d430:::benchmark_data_smithi188_161190_object66222:head# 2024-04-01T19:56:38.793 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef262b6:::benchmark_data_smithi188_161190_object44082:head# 2024-04-01T19:56:38.794 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef2d931:::benchmark_data_smithi188_161190_object58639:head# 2024-04-01T19:56:38.794 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef2e4b9:::benchmark_data_smithi188_161190_object38716:head# 2024-04-01T19:56:38.794 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef2f3c8:::benchmark_data_smithi188_161190_object49395:head# 2024-04-01T19:56:38.794 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef3cd03:::benchmark_data_smithi188_161190_object23087:head# 2024-04-01T19:56:38.794 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef3eadf:::benchmark_data_smithi188_161190_object53840:head# 2024-04-01T19:56:38.795 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef42368:::benchmark_data_smithi188_161190_object93978:head# 2024-04-01T19:56:38.795 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef43993:::benchmark_data_smithi188_161190_object32122:head# 2024-04-01T19:56:38.795 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef51803:::benchmark_data_smithi188_161190_object104910:head# 2024-04-01T19:56:38.796 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef5213c:::benchmark_data_smithi188_161190_object131010:head# 2024-04-01T19:56:38.796 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef54b6a:::benchmark_data_smithi188_161190_object22572:head# 2024-04-01T19:56:38.796 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef67c5a:::benchmark_data_smithi188_161190_object66055:head# 2024-04-01T19:56:38.797 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef6982c:::benchmark_data_smithi188_161190_object117973:head# 2024-04-01T19:56:38.797 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef6a035:::benchmark_data_smithi188_161190_object104947:head# 2024-04-01T19:56:38.797 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef728b6:::benchmark_data_smithi188_161190_object69877:head# 2024-04-01T19:56:38.798 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef73ecc:::benchmark_data_smithi188_161190_object118746:head# 2024-04-01T19:56:38.798 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef80bf6:::benchmark_data_smithi188_161190_object84404:head# 2024-04-01T19:56:38.798 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef82d5c:::benchmark_data_smithi188_161190_object131884:head# 2024-04-01T19:56:38.799 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef83939:::benchmark_data_smithi188_161190_object137521:head# 2024-04-01T19:56:38.799 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef8b01f:::benchmark_data_smithi188_161190_object26491:head# 2024-04-01T19:56:38.800 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef97f15:::benchmark_data_smithi188_161190_object53716:head# 2024-04-01T19:56:38.800 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ef9b1cb:::benchmark_data_smithi188_161190_object96888:head# 2024-04-01T19:56:38.801 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9efa8ce0:::benchmark_data_smithi188_161190_object138478:head# 2024-04-01T19:56:38.801 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9efa9cf5:::benchmark_data_smithi188_161190_object69448:head# 2024-04-01T19:56:38.801 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9efacbd0:::benchmark_data_smithi188_161190_object39382:head# 2024-04-01T19:56:38.802 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9efba1c6:::benchmark_data_smithi188_161190_object53070:head# 2024-04-01T19:56:38.802 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9efbae07:::benchmark_data_smithi188_161190_object41266:head# 2024-04-01T19:56:38.803 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9efbe0a3:::benchmark_data_smithi188_161190_object69040:head# 2024-04-01T19:56:38.803 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9efbfbe8:::benchmark_data_smithi188_161190_object64457:head# 2024-04-01T19:56:38.804 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9efc4c41:::benchmark_data_smithi188_161190_object103649:head# 2024-04-01T19:56:38.804 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9efd00a9:::benchmark_data_smithi188_161190_object39779:head# 2024-04-01T19:56:38.805 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9efd1e06:::benchmark_data_smithi188_161190_object93674:head# 2024-04-01T19:56:38.805 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9efda440:::benchmark_data_smithi188_161190_object125494:head# 2024-04-01T19:56:38.805 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9efe427d:::benchmark_data_smithi188_161190_object137341:head# 2024-04-01T19:56:38.806 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9efef8c0:::benchmark_data_smithi188_161190_object103062:head# 2024-04-01T19:56:38.806 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eff0993:::benchmark_data_smithi188_161190_object131679:head# 2024-04-01T19:56:38.807 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eff5771:::benchmark_data_smithi188_161190_object33548:head# 2024-04-01T19:56:38.807 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9eff87d8:::benchmark_data_smithi188_161190_object95720:head# 2024-04-01T19:56:38.807 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9effae74:::benchmark_data_smithi188_161190_object68882:head# 2024-04-01T19:56:38.813 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9effe847:::benchmark_data_smithi188_161190_object78843:head# 2024-04-01T19:56:38.813 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f008bfb:::benchmark_data_smithi188_161190_object29753:head# 2024-04-01T19:56:38.813 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f00e4ab:::benchmark_data_smithi188_161190_object94289:head# 2024-04-01T19:56:38.813 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f012362:::benchmark_data_smithi188_161190_object67210:head# 2024-04-01T19:56:38.813 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f018365:::benchmark_data_smithi188_161190_object125462:head# 2024-04-01T19:56:38.814 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f023337:::benchmark_data_smithi188_161190_object69755:head# 2024-04-01T19:56:38.814 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f029c23:::benchmark_data_smithi188_161190_object25794:head# 2024-04-01T19:56:38.814 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f02be00:::benchmark_data_smithi188_161190_object97057:head# 2024-04-01T19:56:38.814 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f0378bd:::benchmark_data_smithi188_161190_object102889:head# 2024-04-01T19:56:38.814 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f03cfe9:::benchmark_data_smithi188_161190_object20012:head# 2024-04-01T19:56:38.814 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f03d168:::benchmark_data_smithi188_161190_object20532:head# 2024-04-01T19:56:38.814 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f041365:::benchmark_data_smithi188_161190_object105246:head# 2024-04-01T19:56:38.814 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f055139:::benchmark_data_smithi188_161190_object96585:head# 2024-04-01T19:56:38.816 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f0562bc:::benchmark_data_smithi188_161190_object22208:head# 2024-04-01T19:56:38.816 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f05f2fc:::benchmark_data_smithi188_161190_object46335:head# 2024-04-01T19:56:38.816 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f06048b:::benchmark_data_smithi188_161190_object115033:head# 2024-04-01T19:56:38.816 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f062ec5:::benchmark_data_smithi188_161190_object27936:head# 2024-04-01T19:56:38.816 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f0803ec:::benchmark_data_smithi188_161190_object119044:head# 2024-04-01T19:56:38.816 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f08ba11:::benchmark_data_smithi188_161190_object132517:head# 2024-04-01T19:56:38.817 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f0a26e7:::benchmark_data_smithi188_161190_object85305:head# 2024-04-01T19:56:38.817 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f0a9d31:::benchmark_data_smithi188_161190_object92986:head# 2024-04-01T19:56:38.818 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f0afb1c:::benchmark_data_smithi188_161190_object125081:head# 2024-04-01T19:56:38.818 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f0b8b7c:::benchmark_data_smithi188_161190_object98387:head# 2024-04-01T19:56:38.818 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f0ba54d:::benchmark_data_smithi188_161190_object135101:head# 2024-04-01T19:56:38.819 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f0c81bd:::benchmark_data_smithi188_161190_object46481:head# 2024-04-01T19:56:38.821 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f0ce30f:::benchmark_data_smithi188_161190_object32994:head# 2024-04-01T19:56:38.821 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f0d2f67:::benchmark_data_smithi188_161190_object35282:head# 2024-04-01T19:56:38.821 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f0d6be4:::benchmark_data_smithi188_161190_object120175:head# 2024-04-01T19:56:38.821 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f0d7d8d:::benchmark_data_smithi188_161190_object87940:head# 2024-04-01T19:56:38.822 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f0dd331:::benchmark_data_smithi188_161190_object41077:head# 2024-04-01T19:56:38.822 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f0ea70b:::benchmark_data_smithi188_161190_object94099:head# 2024-04-01T19:56:38.822 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f0f96be:::benchmark_data_smithi188_161190_object26459:head# 2024-04-01T19:56:38.822 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f0ffc55:::benchmark_data_smithi188_161190_object37444:head# 2024-04-01T19:56:38.823 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f113bcb:::benchmark_data_smithi188_161190_object104400:head# 2024-04-01T19:56:38.823 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f11a8a5:::benchmark_data_smithi188_161190_object109148:head# 2024-04-01T19:56:38.824 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f11cae3:::benchmark_data_smithi188_161190_object51247:head# 2024-04-01T19:56:38.824 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f1221e8:::benchmark_data_smithi188_161190_object108695:head# 2024-04-01T19:56:38.824 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f12288a:::benchmark_data_smithi188_161190_object52717:head# 2024-04-01T19:56:38.830 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f128b36:::benchmark_data_smithi188_161190_object57258:head# 2024-04-01T19:56:38.830 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f129c26:::benchmark_data_smithi188_161190_object75619:head# 2024-04-01T19:56:38.830 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f13b81f:::benchmark_data_smithi188_161190_object132460:head# 2024-04-01T19:56:38.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f1418c0:::benchmark_data_smithi188_161190_object45632:head# 2024-04-01T19:56:38.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f14448f:::benchmark_data_smithi188_161190_object137743:head# 2024-04-01T19:56:38.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f1453d8:::benchmark_data_smithi188_161190_object97731:head# 2024-04-01T19:56:38.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f15936c:::benchmark_data_smithi188_161190_object57180:head# 2024-04-01T19:56:38.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f16dd3f:::benchmark_data_smithi188_161190_object22050:head# 2024-04-01T19:56:38.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f17828c:::benchmark_data_smithi188_161190_object109895:head# 2024-04-01T19:56:38.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f178d79:::benchmark_data_smithi188_161190_object27649:head# 2024-04-01T19:56:38.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f1812ee:::benchmark_data_smithi188_161190_object50953:head# 2024-04-01T19:56:38.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f18317c:::benchmark_data_smithi188_161190_object107211:head# 2024-04-01T19:56:38.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f1874a4:::benchmark_data_smithi188_161190_object127606:head# 2024-04-01T19:56:38.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f18785e:::benchmark_data_smithi188_161190_object62726:head# 2024-04-01T19:56:38.831 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f19c914:::benchmark_data_smithi188_161190_object84152:head# 2024-04-01T19:56:38.832 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f1a7227:::benchmark_data_smithi188_161190_object58602:head# 2024-04-01T19:56:38.832 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f1a91ed:::benchmark_data_smithi188_161190_object133489:head# 2024-04-01T19:56:38.832 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f1ad839:::benchmark_data_smithi188_161190_object75796:head# 2024-04-01T19:56:38.832 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f1b9210:::benchmark_data_smithi188_161190_object120507:head# 2024-04-01T19:56:38.833 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f1c94a3:::benchmark_data_smithi188_161190_object108114:head# 2024-04-01T19:56:38.833 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f1cc129:::benchmark_data_smithi188_161190_object116082:head# 2024-04-01T19:56:38.833 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f1d062f:::benchmark_data_smithi188_161190_object29349:head# 2024-04-01T19:56:38.834 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f1d12e3:::benchmark_data_smithi188_161190_object43828:head# 2024-04-01T19:56:38.834 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f1f0571:::benchmark_data_smithi188_161190_object110847:head# 2024-04-01T19:56:38.834 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f1f0822:::benchmark_data_smithi188_161190_object129384:head# 2024-04-01T19:56:38.835 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f1f6a6a:::benchmark_data_smithi188_161190_object25726:head# 2024-04-01T19:56:38.835 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f1fc0ba:::benchmark_data_smithi188_161190_object109215:head# 2024-04-01T19:56:38.836 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f1fe3eb:::benchmark_data_smithi188_161190_object40115:head# 2024-04-01T19:56:38.837 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f1fed63:::benchmark_data_smithi188_161190_object41540:head# 2024-04-01T19:56:38.837 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f205a2c:::benchmark_data_smithi188_161190_object50385:head# 2024-04-01T19:56:38.837 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f214304:::benchmark_data_smithi188_161190_object24137:head# 2024-04-01T19:56:38.837 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f215b8f:::benchmark_data_smithi188_161190_object57040:head# 2024-04-01T19:56:38.838 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f21a6f4:::benchmark_data_smithi188_161190_object29532:head# 2024-04-01T19:56:38.839 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f21c327:::benchmark_data_smithi188_161190_object58294:head# 2024-04-01T19:56:38.844 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f21e305:::benchmark_data_smithi188_161190_object85453:head# 2024-04-01T19:56:38.844 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f21f19d:::benchmark_data_smithi188_161190_object30981:head# 2024-04-01T19:56:38.845 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f2225cd:::benchmark_data_smithi188_161190_object61058:head# 2024-04-01T19:56:38.845 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f225c8c:::benchmark_data_smithi188_161190_object28679:head# 2024-04-01T19:56:38.845 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f22ac84:::benchmark_data_smithi188_161190_object113909:head# 2024-04-01T19:56:38.845 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f230655:::benchmark_data_smithi188_161190_object84620:head# 2024-04-01T19:56:38.845 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f238fa8:::benchmark_data_smithi188_161190_object127069:head# 2024-04-01T19:56:38.845 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f2440a4:::benchmark_data_smithi188_161190_object22268:head# 2024-04-01T19:56:38.845 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f244460:::benchmark_data_smithi188_161190_object54027:head# 2024-04-01T19:56:38.845 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f254067:::benchmark_data_smithi188_161190_object33051:head# 2024-04-01T19:56:38.854 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f255f88:::benchmark_data_smithi188_161190_object86492:head# 2024-04-01T19:56:38.855 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f289ae0:::benchmark_data_smithi188_161190_object134648:head# 2024-04-01T19:56:38.855 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f29c587:::benchmark_data_smithi188_161190_object36523:head# 2024-04-01T19:56:38.855 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f2a4ef3:::benchmark_data_smithi188_161190_object91895:head# 2024-04-01T19:56:38.855 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f2ac39f:::benchmark_data_smithi188_161190_object90892:head# 2024-04-01T19:56:38.855 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f2b1e36:::benchmark_data_smithi188_161190_object118617:head# 2024-04-01T19:56:38.855 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f2bb4c2:::benchmark_data_smithi188_161190_object56974:head# 2024-04-01T19:56:38.855 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f2c4ba8:::benchmark_data_smithi188_161190_object72383:head# 2024-04-01T19:56:38.855 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f2d2c08:::benchmark_data_smithi188_161190_object47667:head# 2024-04-01T19:56:38.855 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f2da263:::benchmark_data_smithi188_161190_object49865:head# 2024-04-01T19:56:38.855 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f2ec917:::benchmark_data_smithi188_161190_object72054:head# 2024-04-01T19:56:38.856 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f2fd5e2:::benchmark_data_smithi188_161190_object35054:head# 2024-04-01T19:56:38.856 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f306ee9:::benchmark_data_smithi188_161190_object54575:head# 2024-04-01T19:56:38.856 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f30cb29:::benchmark_data_smithi188_161190_object56932:head# 2024-04-01T19:56:38.856 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f31574b:::benchmark_data_smithi188_161190_object74610:head# 2024-04-01T19:56:38.857 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f3188ae:::benchmark_data_smithi188_161190_object30864:head# 2024-04-01T19:56:38.857 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f31bca6:::benchmark_data_smithi188_161190_object89688:head# 2024-04-01T19:56:38.857 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f31f85d:::benchmark_data_smithi188_161190_object132765:head# 2024-04-01T19:56:38.858 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f32435a:::benchmark_data_smithi188_161190_object31468:head# 2024-04-01T19:56:38.858 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f33800d:::benchmark_data_smithi188_161190_object70367:head# 2024-04-01T19:56:38.859 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f33e8be:::benchmark_data_smithi188_161190_object134198:head# 2024-04-01T19:56:38.859 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f340dd4:::benchmark_data_smithi188_161190_object119140:head# 2024-04-01T19:56:38.860 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f3467c1:::benchmark_data_smithi188_161190_object38758:head# 2024-04-01T19:56:38.860 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f34bbc1:::benchmark_data_smithi188_161190_object124262:head# 2024-04-01T19:56:38.861 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f34c090:::benchmark_data_smithi188_161190_object85830:head# 2024-04-01T19:56:38.862 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f34cee6:::benchmark_data_smithi188_161190_object126092:head# 2024-04-01T19:56:38.862 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f34e6eb:::benchmark_data_smithi188_161190_object38402:head# 2024-04-01T19:56:38.862 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f36d2bc:::benchmark_data_smithi188_161190_object37911:head# 2024-04-01T19:56:38.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:38 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/426780015' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:56:38.863 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f3712af:::benchmark_data_smithi188_161190_object78055:head# 2024-04-01T19:56:38.863 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f37162b:::benchmark_data_smithi188_161190_object111495:head# 2024-04-01T19:56:38.863 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f375806:::benchmark_data_smithi188_161190_object76250:head# 2024-04-01T19:56:38.864 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f379951:::benchmark_data_smithi188_161190_object73605:head# 2024-04-01T19:56:38.864 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f37b040:::benchmark_data_smithi188_161190_object68342:head# 2024-04-01T19:56:38.864 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f37dab0:::benchmark_data_smithi188_161190_object23647:head# 2024-04-01T19:56:38.869 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f385b23:::benchmark_data_smithi188_161190_object115824:head# 2024-04-01T19:56:38.869 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f388cc8:::benchmark_data_smithi188_161190_object126906:head# 2024-04-01T19:56:38.869 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f3914cf:::benchmark_data_smithi188_161190_object46960:head# 2024-04-01T19:56:38.869 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f396114:::benchmark_data_smithi188_161190_object22471:head# 2024-04-01T19:56:38.869 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f399d27:::benchmark_data_smithi188_161190_object70080:head# 2024-04-01T19:56:38.869 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f3a14d7:::benchmark_data_smithi188_161190_object97583:head# 2024-04-01T19:56:38.869 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f3a6a70:::benchmark_data_smithi188_161190_object105730:head# 2024-04-01T19:56:38.869 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f3ae0b5:::benchmark_data_smithi188_161190_object106790:head# 2024-04-01T19:56:38.869 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f3af50f:::benchmark_data_smithi188_161190_object38679:head# 2024-04-01T19:56:38.869 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f3bbc87:::benchmark_data_smithi188_161190_object124941:head# 2024-04-01T19:56:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:38 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/426780015' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:56:38.875 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f3bd0be:::benchmark_data_smithi188_161190_object73340:head# 2024-04-01T19:56:38.875 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f3c0b04:::benchmark_data_smithi188_161190_object66168:head# 2024-04-01T19:56:38.875 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f3c1388:::benchmark_data_smithi188_161190_object107798:head# 2024-04-01T19:56:38.876 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f3c14fb:::benchmark_data_smithi188_161190_object93645:head# 2024-04-01T19:56:38.876 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f3c40e8:::benchmark_data_smithi188_161190_object52587:head# 2024-04-01T19:56:38.877 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f3c62f6:::benchmark_data_smithi188_161190_object49627:head# 2024-04-01T19:56:38.877 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f3cb682:::benchmark_data_smithi188_161190_object134830:head# 2024-04-01T19:56:38.878 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f3da132:::benchmark_data_smithi188_161190_object68617:head# 2024-04-01T19:56:38.878 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f3da2f7:::benchmark_data_smithi188_161190_object116066:head# 2024-04-01T19:56:38.878 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f3dc45a:::benchmark_data_smithi188_161190_object122326:head# 2024-04-01T19:56:38.879 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f3eae1b:::benchmark_data_smithi188_161190_object48590:head# 2024-04-01T19:56:38.880 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f3efe11:::benchmark_data_smithi188_161190_object54065:head# 2024-04-01T19:56:38.880 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f3f727a:::benchmark_data_smithi188_161190_object61602:head# 2024-04-01T19:56:38.880 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f3f8bba:::benchmark_data_smithi188_161190_object116457:head# 2024-04-01T19:56:38.880 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f4193d1:::benchmark_data_smithi188_161190_object33429:head# 2024-04-01T19:56:38.881 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f41c9b8:::benchmark_data_smithi188_161190_object111137:head# 2024-04-01T19:56:38.881 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f42316e:::benchmark_data_smithi188_161190_object99592:head# 2024-04-01T19:56:38.882 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f424a70:::benchmark_data_smithi188_161190_object109569:head# 2024-04-01T19:56:38.882 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f42ed5d:::benchmark_data_smithi188_161190_object104134:head# 2024-04-01T19:56:38.883 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f435419:::benchmark_data_smithi188_161190_object36679:head# 2024-04-01T19:56:38.883 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f437af7:::benchmark_data_smithi188_161190_object55440:head# 2024-04-01T19:56:38.884 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f43f6e3:::benchmark_data_smithi188_161190_object69303:head# 2024-04-01T19:56:38.884 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f44a613:::benchmark_data_smithi188_161190_object96337:head# 2024-04-01T19:56:38.884 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f44adcf:::benchmark_data_smithi188_161190_object120243:head# 2024-04-01T19:56:38.885 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f44c2e2:::benchmark_data_smithi188_161190_object44060:head# 2024-04-01T19:56:38.886 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f44c2ec:::benchmark_data_smithi188_161190_object84441:head# 2024-04-01T19:56:38.886 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f44cf3c:::benchmark_data_smithi188_161190_object123708:head# 2024-04-01T19:56:38.886 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f44dbec:::benchmark_data_smithi188_161190_object124291:head# 2024-04-01T19:56:38.887 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f455d47:::benchmark_data_smithi188_161190_object134891:head# 2024-04-01T19:56:38.888 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f457dd6:::benchmark_data_smithi188_161190_object40471:head# 2024-04-01T19:56:38.888 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f45d9e1:::benchmark_data_smithi188_161190_object91260:head# 2024-04-01T19:56:38.888 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f460911:::benchmark_data_smithi188_161190_object34360:head# 2024-04-01T19:56:38.889 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f460fcf:::benchmark_data_smithi188_161190_object94894:head# 2024-04-01T19:56:38.889 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f47d0b7:::benchmark_data_smithi188_161190_object56462:head# 2024-04-01T19:56:38.890 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f47e257:::benchmark_data_smithi188_161190_object41158:head# 2024-04-01T19:56:38.890 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f498768:::benchmark_data_smithi188_161190_object123958:head# 2024-04-01T19:56:38.891 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f4aafb9:::benchmark_data_smithi188_161190_object125289:head# 2024-04-01T19:56:38.891 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f4b7c72:::benchmark_data_smithi188_161190_object90650:head# 2024-04-01T19:56:38.896 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f4c999d:::benchmark_data_smithi188_161190_object23602:head# 2024-04-01T19:56:38.896 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f4c9f4b:::benchmark_data_smithi188_161190_object131903:head# 2024-04-01T19:56:38.896 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f4cb22b:::benchmark_data_smithi188_161190_object46221:head# 2024-04-01T19:56:38.897 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f4d2f4b:::benchmark_data_smithi188_161190_object102369:head# 2024-04-01T19:56:38.897 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f4d45fb:::benchmark_data_smithi188_161190_object80525:head# 2024-04-01T19:56:38.898 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f4d611c:::benchmark_data_smithi188_161190_object26040:head# 2024-04-01T19:56:38.904 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f4dde7e:::benchmark_data_smithi188_161190_object39120:head# 2024-04-01T19:56:38.904 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f502d6c:::benchmark_data_smithi188_161190_object71264:head# 2024-04-01T19:56:38.904 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f507164:::benchmark_data_smithi188_161190_object106657:head# 2024-04-01T19:56:38.904 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f50868d:::benchmark_data_smithi188_161190_object135582:head# 2024-04-01T19:56:38.904 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f513958:::benchmark_data_smithi188_161190_object127940:head# 2024-04-01T19:56:38.904 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f51b6c5:::benchmark_data_smithi188_161190_object26702:head# 2024-04-01T19:56:38.904 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f51e43f:::benchmark_data_smithi188_161190_object52568:head# 2024-04-01T19:56:38.904 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f527fff:::benchmark_data_smithi188_161190_object70370:head# 2024-04-01T19:56:38.904 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f52c9d5:::benchmark_data_smithi188_161190_object120408:head# 2024-04-01T19:56:38.904 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f53cf34:::benchmark_data_smithi188_161190_object98824:head# 2024-04-01T19:56:38.904 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f54cbf9:::benchmark_data_smithi188_161190_object119858:head# 2024-04-01T19:56:38.904 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f55040a:::benchmark_data_smithi188_161190_object84771:head# 2024-04-01T19:56:38.905 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f5657c9:::benchmark_data_smithi188_161190_object123169:head# 2024-04-01T19:56:38.905 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f5680e0:::benchmark_data_smithi188_161190_object82058:head# 2024-04-01T19:56:38.905 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f56f22a:::benchmark_data_smithi188_161190_object131772:head# 2024-04-01T19:56:38.905 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f56f53a:::benchmark_data_smithi188_161190_object101856:head# 2024-04-01T19:56:38.906 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f573716:::benchmark_data_smithi188_161190_object122935:head# 2024-04-01T19:56:38.906 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f576252:::benchmark_data_smithi188_161190_object93462:head# 2024-04-01T19:56:38.906 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f586d9d:::benchmark_data_smithi188_161190_object109725:head# 2024-04-01T19:56:38.906 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f58941e:::benchmark_data_smithi188_161190_object111514:head# 2024-04-01T19:56:38.907 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f591723:::benchmark_data_smithi188_161190_object31071:head# 2024-04-01T19:56:38.907 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f59ba91:::benchmark_data_smithi188_161190_object136273:head# 2024-04-01T19:56:38.907 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f59ebf8:::benchmark_data_smithi188_161190_object75876:head# 2024-04-01T19:56:38.913 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f5ab3a1:::benchmark_data_smithi188_161190_object37242:head# 2024-04-01T19:56:38.913 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f5ac026:::benchmark_data_smithi188_161190_object113385:head# 2024-04-01T19:56:38.913 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f5b4cfb:::benchmark_data_smithi188_161190_object99649:head# 2024-04-01T19:56:38.913 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f5c709d:::benchmark_data_smithi188_161190_object107535:head# 2024-04-01T19:56:38.913 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f5d1755:::benchmark_data_smithi188_161190_object34151:head# 2024-04-01T19:56:38.914 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f5dbdd3:::benchmark_data_smithi188_161190_object86148:head# 2024-04-01T19:56:38.914 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f5dda8f:::benchmark_data_smithi188_161190_object20155:head# 2024-04-01T19:56:38.914 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f5e5b3d:::benchmark_data_smithi188_161190_object118498:head# 2024-04-01T19:56:38.914 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f5ea33c:::benchmark_data_smithi188_161190_object97505:head# 2024-04-01T19:56:38.914 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f5f2a7b:::benchmark_data_smithi188_161190_object120456:head# 2024-04-01T19:56:38.914 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f5f8a43:::benchmark_data_smithi188_161190_object123472:head# 2024-04-01T19:56:38.914 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f60f5a6:::benchmark_data_smithi188_161190_object91343:head# 2024-04-01T19:56:38.914 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f62731d:::benchmark_data_smithi188_161190_object74499:head# 2024-04-01T19:56:38.914 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f630e93:::benchmark_data_smithi188_161190_object61189:head# 2024-04-01T19:56:38.915 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f635a38:::benchmark_data_smithi188_161190_object45162:head# 2024-04-01T19:56:38.915 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f6415e2:::benchmark_data_smithi188_161190_object54842:head# 2024-04-01T19:56:38.915 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f64382c:::benchmark_data_smithi188_161190_object31279:head# 2024-04-01T19:56:38.915 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f647614:::benchmark_data_smithi188_161190_object27391:head# 2024-04-01T19:56:38.915 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f64c8c5:::benchmark_data_smithi188_161190_object86523:head# 2024-04-01T19:56:38.916 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f650253:::benchmark_data_smithi188_161190_object82214:head# 2024-04-01T19:56:38.916 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f659be2:::benchmark_data_smithi188_161190_object71063:head# 2024-04-01T19:56:38.917 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f65a2a4:::benchmark_data_smithi188_161190_object129137:head# 2024-04-01T19:56:38.917 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f65a8b5:::benchmark_data_smithi188_161190_object25202:head# 2024-04-01T19:56:38.917 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f67b505:::benchmark_data_smithi188_161190_object110836:head# 2024-04-01T19:56:38.918 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f67d520:::benchmark_data_smithi188_161190_object116571:head# 2024-04-01T19:56:38.928 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f683d95:::benchmark_data_smithi188_161190_object69347:head# 2024-04-01T19:56:38.928 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f6847d3:::benchmark_data_smithi188_161190_object29660:head# 2024-04-01T19:56:38.928 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f692e8f:::benchmark_data_smithi188_161190_object28663:head# 2024-04-01T19:56:38.928 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f69445d:::benchmark_data_smithi188_161190_object91623:head# 2024-04-01T19:56:38.928 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f6aa1ad:::benchmark_data_smithi188_161190_object127857:head# 2024-04-01T19:56:38.928 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f6ab242:::benchmark_data_smithi188_161190_object50819:head# 2024-04-01T19:56:38.928 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f6c35c0:::benchmark_data_smithi188_161190_object79263:head# 2024-04-01T19:56:38.928 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f6cbc72:::benchmark_data_smithi188_161190_object49019:head# 2024-04-01T19:56:38.928 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f6d0536:::benchmark_data_smithi188_161190_object112605:head# 2024-04-01T19:56:38.928 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f6dd508:::benchmark_data_smithi188_161190_object87814:head# 2024-04-01T19:56:38.928 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f6df79e:::benchmark_data_smithi188_161190_object39827:head# 2024-04-01T19:56:38.928 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f6e3db1:::benchmark_data_smithi188_161190_object29759:head# 2024-04-01T19:56:38.929 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f6f9795:::benchmark_data_smithi188_161190_object121368:head# 2024-04-01T19:56:38.929 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f6fc4a8:::benchmark_data_smithi188_161190_object37807:head# 2024-04-01T19:56:38.929 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f7044d0:::benchmark_data_smithi188_161190_object23155:head# 2024-04-01T19:56:38.929 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f7089fc:::benchmark_data_smithi188_161190_object128995:head# 2024-04-01T19:56:38.929 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f726327:::benchmark_data_smithi188_161190_object66040:head# 2024-04-01T19:56:38.929 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f7344fc:::benchmark_data_smithi188_161190_object59105:head# 2024-04-01T19:56:38.929 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f7348b1:::benchmark_data_smithi188_161190_object60840:head# 2024-04-01T19:56:38.929 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f735298:::benchmark_data_smithi188_161190_object70013:head# 2024-04-01T19:56:38.929 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f73eb38:::benchmark_data_smithi188_161190_object65075:head# 2024-04-01T19:56:38.930 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f746053:::benchmark_data_smithi188_161190_object93041:head# 2024-04-01T19:56:38.930 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f752729:::benchmark_data_smithi188_161190_object77558:head# 2024-04-01T19:56:38.930 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f75c310:::benchmark_data_smithi188_161190_object52421:head# 2024-04-01T19:56:38.931 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f775bf6:::benchmark_data_smithi188_161190_object84362:head# 2024-04-01T19:56:38.931 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f778f8c:::benchmark_data_smithi188_161190_object97547:head# 2024-04-01T19:56:38.931 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f77d432:::benchmark_data_smithi188_161190_object64817:head# 2024-04-01T19:56:38.931 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f77f4b6:::benchmark_data_smithi188_161190_object119013:head# 2024-04-01T19:56:38.931 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f783c42:::benchmark_data_smithi188_161190_object92689:head# 2024-04-01T19:56:38.932 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f78bab6:::benchmark_data_smithi188_161190_object95451:head# 2024-04-01T19:56:38.932 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f79ac86:::benchmark_data_smithi188_161190_object50057:head# 2024-04-01T19:56:38.932 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f7a252d:::benchmark_data_smithi188_161190_object86834:head# 2024-04-01T19:56:38.933 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f7a88e5:::benchmark_data_smithi188_161190_object69392:head# 2024-04-01T19:56:38.933 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f7b349c:::benchmark_data_smithi188_161190_object106660:head# 2024-04-01T19:56:38.934 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f7be2a9:::benchmark_data_smithi188_161190_object39073:head# 2024-04-01T19:56:38.934 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f7efd27:::benchmark_data_smithi188_161190_object73671:head# 2024-04-01T19:56:38.935 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f82abd9:::benchmark_data_smithi188_161190_object139042:head# 2024-04-01T19:56:38.935 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f830a11:::benchmark_data_smithi188_161190_object29590:head# 2024-04-01T19:56:38.935 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f83c25f:::benchmark_data_smithi188_161190_object66741:head# 2024-04-01T19:56:38.936 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f844c71:::benchmark_data_smithi188_161190_object27222:head# 2024-04-01T19:56:38.936 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f84f824:::benchmark_data_smithi188_161190_object131947:head# 2024-04-01T19:56:38.937 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f8574ae:::benchmark_data_smithi188_161190_object77180:head# 2024-04-01T19:56:38.937 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f867b38:::benchmark_data_smithi188_161190_object31664:head# 2024-04-01T19:56:38.937 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f8778eb:::benchmark_data_smithi188_161190_object109351:head# 2024-04-01T19:56:38.941 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f880703:::benchmark_data_smithi188_161190_object29595:head# 2024-04-01T19:56:38.942 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f886466:::benchmark_data_smithi188_161190_object102152:head# 2024-04-01T19:56:38.942 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f88ba6e:::benchmark_data_smithi188_161190_object70182:head# 2024-04-01T19:56:38.942 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f88c91f:::benchmark_data_smithi188_161190_object23946:head# 2024-04-01T19:56:38.943 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f8a1aeb:::benchmark_data_smithi188_161190_object114726:head# 2024-04-01T19:56:38.943 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f8a21f0:::benchmark_data_smithi188_161190_object37861:head# 2024-04-01T19:56:38.943 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f8aa309:::benchmark_data_smithi188_161190_object44000:head# 2024-04-01T19:56:38.943 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f8ad3c9:::benchmark_data_smithi188_161190_object133330:head# 2024-04-01T19:56:38.945 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f8b73e8:::benchmark_data_smithi188_161190_object55347:head# 2024-04-01T19:56:38.945 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f8c4300:::benchmark_data_smithi188_161190_object127987:head# 2024-04-01T19:56:38.949 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f8c4fa6:::benchmark_data_smithi188_161190_object114470:head# 2024-04-01T19:56:38.949 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f8e7fd2:::benchmark_data_smithi188_161190_object114251:head# 2024-04-01T19:56:38.949 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f8f7ba3:::benchmark_data_smithi188_161190_object67179:head# 2024-04-01T19:56:38.950 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f8fcf04:::benchmark_data_smithi188_161190_object55955:head# 2024-04-01T19:56:38.951 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f90375a:::benchmark_data_smithi188_161190_object64416:head# 2024-04-01T19:56:38.951 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f90cd58:::benchmark_data_smithi188_161190_object125066:head# 2024-04-01T19:56:38.951 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f911614:::benchmark_data_smithi188_161190_object48344:head# 2024-04-01T19:56:38.952 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f91a15a:::benchmark_data_smithi188_161190_object94559:head# 2024-04-01T19:56:38.952 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f91cfd1:::benchmark_data_smithi188_161190_object30458:head# 2024-04-01T19:56:38.952 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f920113:::benchmark_data_smithi188_161190_object122898:head# 2024-04-01T19:56:38.953 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f934336:::benchmark_data_smithi188_161190_object105802:head# 2024-04-01T19:56:38.953 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f93645a:::benchmark_data_smithi188_161190_object51832:head# 2024-04-01T19:56:38.954 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f93f4f4:::benchmark_data_smithi188_161190_object98248:head# 2024-04-01T19:56:38.954 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f94a9bd:::benchmark_data_smithi188_161190_object107998:head# 2024-04-01T19:56:38.954 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f94af38:::benchmark_data_smithi188_161190_object112551:head# 2024-04-01T19:56:38.955 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f9556f9:::benchmark_data_smithi188_161190_object139201:head# 2024-04-01T19:56:38.955 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f95e12e:::benchmark_data_smithi188_161190_object81298:head# 2024-04-01T19:56:38.956 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f961f80:::benchmark_data_smithi188_161190_object127038:head# 2024-04-01T19:56:38.956 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f9699e4:::benchmark_data_smithi188_161190_object42429:head# 2024-04-01T19:56:38.956 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f976dba:::benchmark_data_smithi188_161190_object61978:head# 2024-04-01T19:56:38.957 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f9871a1:::benchmark_data_smithi188_161190_object34386:head# 2024-04-01T19:56:38.957 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f99077f:::benchmark_data_smithi188_161190_object116114:head# 2024-04-01T19:56:38.958 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f992f0f:::benchmark_data_smithi188_161190_object96693:head# 2024-04-01T19:56:38.958 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f9987ca:::benchmark_data_smithi188_161190_object23077:head# 2024-04-01T19:56:38.959 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f998d69:::benchmark_data_smithi188_161190_object102288:head# 2024-04-01T19:56:38.959 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f9a2a1b:::benchmark_data_smithi188_161190_object37615:head# 2024-04-01T19:56:38.959 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f9af3d7:::benchmark_data_smithi188_161190_object59154:head# 2024-04-01T19:56:38.960 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f9b2226:::benchmark_data_smithi188_161190_object87536:head# 2024-04-01T19:56:38.960 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f9d4689:::benchmark_data_smithi188_161190_object121255:head# 2024-04-01T19:56:38.961 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f9e894c:::benchmark_data_smithi188_161190_object86880:head# 2024-04-01T19:56:38.961 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f9f0b99:::benchmark_data_smithi188_161190_object26509:head# 2024-04-01T19:56:38.962 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f9f12d4:::benchmark_data_smithi188_161190_object61536:head# 2024-04-01T19:56:38.962 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f9f378c:::benchmark_data_smithi188_161190_object138876:head# 2024-04-01T19:56:38.962 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f9fb8d8:::benchmark_data_smithi188_161190_object62945:head# 2024-04-01T19:56:38.963 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9f9fc106:::benchmark_data_smithi188_161190_object33206:head# 2024-04-01T19:56:38.964 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fa0acf2:::benchmark_data_smithi188_161190_object99496:head# 2024-04-01T19:56:38.964 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fa102a7:::benchmark_data_smithi188_161190_object86935:head# 2024-04-01T19:56:38.965 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fa10d89:::benchmark_data_smithi188_161190_object38435:head# 2024-04-01T19:56:38.965 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fa207f4:::benchmark_data_smithi188_161190_object47066:head# 2024-04-01T19:56:38.965 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fa28014:::benchmark_data_smithi188_161190_object33878:head# 2024-04-01T19:56:38.966 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fa322d1:::benchmark_data_smithi188_161190_object119826:head# 2024-04-01T19:56:38.966 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fa3a350:::benchmark_data_smithi188_161190_object127503:head# 2024-04-01T19:56:38.967 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fa47203:::benchmark_data_smithi188_161190_object93300:head# 2024-04-01T19:56:38.967 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fa58b3b:::benchmark_data_smithi188_161190_object127173:head# 2024-04-01T19:56:38.967 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fa5d640:::benchmark_data_smithi188_161190_object27371:head# 2024-04-01T19:56:38.968 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fa63133:::benchmark_data_smithi188_161190_object135120:head# 2024-04-01T19:56:38.968 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fa67502:::benchmark_data_smithi188_161190_object19901:head# 2024-04-01T19:56:38.970 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fa78d1e:::benchmark_data_smithi188_161190_object87492:head# 2024-04-01T19:56:38.971 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fa7af19:::benchmark_data_smithi188_161190_object104398:head# 2024-04-01T19:56:38.971 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fa80c48:::benchmark_data_smithi188_161190_object116139:head# 2024-04-01T19:56:38.972 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fa85b4f:::benchmark_data_smithi188_161190_object119816:head# 2024-04-01T19:56:38.972 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fa8b7cf:::benchmark_data_smithi188_161190_object49727:head# 2024-04-01T19:56:38.973 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fa8bd25:::benchmark_data_smithi188_161190_object55648:head# 2024-04-01T19:56:38.973 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fa8d858:::benchmark_data_smithi188_161190_object126679:head# 2024-04-01T19:56:38.973 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fa976cb:::benchmark_data_smithi188_161190_object30502:head# 2024-04-01T19:56:38.974 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fa98bbc:::benchmark_data_smithi188_161190_object32393:head# 2024-04-01T19:56:38.974 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fab4cdd:::benchmark_data_smithi188_161190_object107730:head# 2024-04-01T19:56:38.975 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fab4f94:::benchmark_data_smithi188_161190_object121585:head# 2024-04-01T19:56:38.975 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fabfb02:::benchmark_data_smithi188_161190_object113673:head# 2024-04-01T19:56:38.975 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fac6136:::benchmark_data_smithi188_161190_object67981:head# 2024-04-01T19:56:38.976 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9faca7e5:::benchmark_data_smithi188_161190_object57813:head# 2024-04-01T19:56:38.979 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:56:38.981 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9facfa7a:::benchmark_data_smithi188_161190_object90994:head# 2024-04-01T19:56:38.981 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fad232b:::benchmark_data_smithi188_161190_object43367:head# 2024-04-01T19:56:38.981 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fadabcb:::benchmark_data_smithi188_161190_object30668:head# 2024-04-01T19:56:38.982 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fadc331:::benchmark_data_smithi188_161190_object33421:head# 2024-04-01T19:56:38.982 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fadd6cc:::benchmark_data_smithi188_161190_object39286:head# 2024-04-01T19:56:38.983 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fae2abc:::benchmark_data_smithi188_161190_object40377:head# 2024-04-01T19:56:38.983 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fae5342:::benchmark_data_smithi188_161190_object72273:head# 2024-04-01T19:56:38.983 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9faec9cf:::benchmark_data_smithi188_161190_object58276:head# 2024-04-01T19:56:38.984 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9faf1396:::benchmark_data_smithi188_161190_object28102:head# 2024-04-01T19:56:38.984 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9faf323d:::benchmark_data_smithi188_161190_object52476:head# 2024-04-01T19:56:38.984 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9faf7a31:::benchmark_data_smithi188_161190_object28772:head# 2024-04-01T19:56:38.986 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fb04bbf:::benchmark_data_smithi188_161190_object38785:head# 2024-04-01T19:56:38.986 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fb1036a:::benchmark_data_smithi188_161190_object24692:head# 2024-04-01T19:56:38.986 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fb1b4f3:::benchmark_data_smithi188_161190_object124844:head# 2024-04-01T19:56:38.987 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fb1fed9:::benchmark_data_smithi188_161190_object35189:head# 2024-04-01T19:56:38.987 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fb2806a:::benchmark_data_smithi188_161190_object97915:head# 2024-04-01T19:56:38.988 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fb346ce:::benchmark_data_smithi188_161190_object128283:head# 2024-04-01T19:56:38.988 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fb43a48:::benchmark_data_smithi188_161190_object128823:head# 2024-04-01T19:56:38.989 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fb5888c:::benchmark_data_smithi188_161190_object30191:head# 2024-04-01T19:56:38.989 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fb5c577:::benchmark_data_smithi188_161190_object137024:head# 2024-04-01T19:56:38.989 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fb679f8:::benchmark_data_smithi188_161190_object111265:head# 2024-04-01T19:56:38.990 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fb772dd:::benchmark_data_smithi188_161190_object63931:head# 2024-04-01T19:56:38.990 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fb7cfe0:::benchmark_data_smithi188_161190_object23788:head# 2024-04-01T19:56:38.991 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fb829c3:::benchmark_data_smithi188_161190_object90042:head# 2024-04-01T19:56:38.991 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fb83566:::benchmark_data_smithi188_161190_object44041:head# 2024-04-01T19:56:38.991 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fba087d:::benchmark_data_smithi188_161190_object42724:head# 2024-04-01T19:56:38.992 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fba7ca1:::benchmark_data_smithi188_161190_object96728:head# 2024-04-01T19:56:38.992 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fbac040:::benchmark_data_smithi188_161190_object123358:head# 2024-04-01T19:56:38.993 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fbb26f0:::benchmark_data_smithi188_161190_object96685:head# 2024-04-01T19:56:38.993 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fbbd1f2:::benchmark_data_smithi188_161190_object67639:head# 2024-04-01T19:56:38.994 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fbc1bbd:::benchmark_data_smithi188_161190_object21838:head# 2024-04-01T19:56:38.994 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fbc76f7:::benchmark_data_smithi188_161190_object78244:head# 2024-04-01T19:56:38.994 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fbc95e1:::benchmark_data_smithi188_161190_object25316:head# 2024-04-01T19:56:38.996 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fbcabd4:::benchmark_data_smithi188_161190_object130880:head# 2024-04-01T19:56:38.996 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fbce9de:::benchmark_data_smithi188_161190_object131895:head# 2024-04-01T19:56:38.997 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fbe0a92:::benchmark_data_smithi188_161190_object63858:head# 2024-04-01T19:56:38.998 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fbe8609:::benchmark_data_smithi188_161190_object91248:head# 2024-04-01T19:56:38.999 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fbf2178:::benchmark_data_smithi188_161190_object90258:head# 2024-04-01T19:56:38.999 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fbf3615:::benchmark_data_smithi188_161190_object96495:head# 2024-04-01T19:56:38.999 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fc02e0d:::benchmark_data_smithi188_161190_object62197:head# 2024-04-01T19:56:38.999 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fc0af6d:::benchmark_data_smithi188_161190_object138484:head# 2024-04-01T19:56:38.999 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fc18adc:::benchmark_data_smithi188_161190_object96119:head# 2024-04-01T19:56:39.000 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fc1b0cf:::benchmark_data_smithi188_161190_object30562:head# 2024-04-01T19:56:39.000 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fc21bd9:::benchmark_data_smithi188_161190_object67541:head# 2024-04-01T19:56:39.001 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fc22e0e:::benchmark_data_smithi188_161190_object66450:head# 2024-04-01T19:56:39.001 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fc35efb:::benchmark_data_smithi188_161190_object89678:head# 2024-04-01T19:56:39.001 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fc3b275:::benchmark_data_smithi188_161190_object73863:head# 2024-04-01T19:56:39.002 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fc60ee6:::benchmark_data_smithi188_161190_object125142:head# 2024-04-01T19:56:39.004 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fc6ec9f:::benchmark_data_smithi188_161190_object84308:head# 2024-04-01T19:56:39.004 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fc7a156:::benchmark_data_smithi188_161190_object54373:head# 2024-04-01T19:56:39.004 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fc9dfcc:::benchmark_data_smithi188_161190_object103090:head# 2024-04-01T19:56:39.004 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fca4534:::benchmark_data_smithi188_161190_object83596:head# 2024-04-01T19:56:39.004 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fcaeb95:::benchmark_data_smithi188_161190_object62263:head# 2024-04-01T19:56:39.005 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fcb284b:::benchmark_data_smithi188_161190_object27119:head# 2024-04-01T19:56:39.005 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fcb42d0:::benchmark_data_smithi188_161190_object129492:head# 2024-04-01T19:56:39.005 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fcb8cd2:::benchmark_data_smithi188_161190_object115143:head# 2024-04-01T19:56:39.007 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fcbe42a:::benchmark_data_smithi188_161190_object62386:head# 2024-04-01T19:56:39.007 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fcc5752:::benchmark_data_smithi188_161190_object97211:head# 2024-04-01T19:56:39.007 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fcdb553:::benchmark_data_smithi188_161190_object97873:head# 2024-04-01T19:56:39.007 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:56:39.008 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fcdec86:::benchmark_data_smithi188_161190_object35839:head# 2024-04-01T19:56:39.008 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fcedfc1:::benchmark_data_smithi188_161190_object21468:head# 2024-04-01T19:56:39.008 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fcee273:::benchmark_data_smithi188_161190_object137348:head# 2024-04-01T19:56:39.009 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fcf00ce:::benchmark_data_smithi188_161190_object123648:head# 2024-04-01T19:56:39.009 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fcf82b6:::benchmark_data_smithi188_161190_object46390:head# 2024-04-01T19:56:39.010 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fcf9258:::benchmark_data_smithi188_161190_object52259:head# 2024-04-01T19:56:39.010 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fcfbfcb:::benchmark_data_smithi188_161190_object41752:head# 2024-04-01T19:56:39.011 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fd0970b:::benchmark_data_smithi188_161190_object51161:head# 2024-04-01T19:56:39.011 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fd0f3ef:::benchmark_data_smithi188_161190_object72293:head# 2024-04-01T19:56:39.011 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fd15478:::benchmark_data_smithi188_161190_object98175:head# 2024-04-01T19:56:39.015 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fd1c157:::benchmark_data_smithi188_161190_object121685:head# 2024-04-01T19:56:39.015 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fd1f88b:::benchmark_data_smithi188_161190_object30027:head# 2024-04-01T19:56:39.015 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fd2af9f:::benchmark_data_smithi188_161190_object76430:head# 2024-04-01T19:56:39.016 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fd31b00:::benchmark_data_smithi188_161190_object30288:head# 2024-04-01T19:56:39.017 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fd38a9b:::benchmark_data_smithi188_161190_object126890:head# 2024-04-01T19:56:39.017 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fd3c995:::benchmark_data_smithi188_161190_object101814:head# 2024-04-01T19:56:39.018 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fd3e7f6:::benchmark_data_smithi188_161190_object55598:head# 2024-04-01T19:56:39.018 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fd41be5:::benchmark_data_smithi188_161190_object50380:head# 2024-04-01T19:56:39.018 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fd4941d:::benchmark_data_smithi188_161190_object58540:head# 2024-04-01T19:56:39.019 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fd4f4f1:::benchmark_data_smithi188_161190_object111633:head# 2024-04-01T19:56:39.019 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fd620e7:::benchmark_data_smithi188_161190_object84231:head# 2024-04-01T19:56:39.020 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fd64111:::benchmark_data_smithi188_161190_object71106:head# 2024-04-01T19:56:39.021 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fd737bc:::benchmark_data_smithi188_161190_object57671:head# 2024-04-01T19:56:39.022 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fd737cd:::benchmark_data_smithi188_161190_object33915:head# 2024-04-01T19:56:39.022 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fd7e191:::benchmark_data_smithi188_161190_object56625:head# 2024-04-01T19:56:39.022 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fd83c66:::benchmark_data_smithi188_161190_object134015:head# 2024-04-01T19:56:39.025 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fd8a0ea:::benchmark_data_smithi188_161190_object90498:head# 2024-04-01T19:56:39.025 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fd9829e:::benchmark_data_smithi188_161190_object108231:head# 2024-04-01T19:56:39.025 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fdae086:::benchmark_data_smithi188_161190_object67239:head# 2024-04-01T19:56:39.025 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fdb0dcb:::benchmark_data_smithi188_161190_object60012:head# 2024-04-01T19:56:39.026 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fdb8a51:::benchmark_data_smithi188_161190_object49774:head# 2024-04-01T19:56:39.026 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fdbc111:::benchmark_data_smithi188_161190_object37147:head# 2024-04-01T19:56:39.026 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fdc1615:::benchmark_data_smithi188_161190_object85329:head# 2024-04-01T19:56:39.026 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fdc6564:::benchmark_data_smithi188_161190_object35416:head# 2024-04-01T19:56:39.026 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fdd912b:::benchmark_data_smithi188_161190_object121629:head# 2024-04-01T19:56:39.026 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fdd9f24:::benchmark_data_smithi188_161190_object58865:head# 2024-04-01T19:56:39.027 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fdddc97:::benchmark_data_smithi188_161190_object96922:head# 2024-04-01T19:56:39.027 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fde08fc:::benchmark_data_smithi188_161190_object30214:head# 2024-04-01T19:56:39.029 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fdeaf57:::benchmark_data_smithi188_161190_object76588:head# 2024-04-01T19:56:39.029 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fdf2ca4:::benchmark_data_smithi188_161190_object56885:head# 2024-04-01T19:56:39.030 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fdffb31:::benchmark_data_smithi188_161190_object94697:head# 2024-04-01T19:56:39.030 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fe0aed7:::benchmark_data_smithi188_161190_object50187:head# 2024-04-01T19:56:39.031 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fe1015f:::benchmark_data_smithi188_161190_object126277:head# 2024-04-01T19:56:39.031 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fe1202e:::benchmark_data_smithi188_161190_object97442:head# 2024-04-01T19:56:39.031 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fe269bf:::benchmark_data_smithi188_161190_object118608:head# 2024-04-01T19:56:39.032 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fe2c5b7:::benchmark_data_smithi188_161190_object97403:head# 2024-04-01T19:56:39.032 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fe37b5c:::benchmark_data_smithi188_161190_object135798:head# 2024-04-01T19:56:39.040 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fe38a20:::benchmark_data_smithi188_161190_object118865:head# 2024-04-01T19:56:39.040 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fe3beb7:::benchmark_data_smithi188_161190_object66139:head# 2024-04-01T19:56:39.040 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fe40562:::benchmark_data_smithi188_161190_object69614:head# 2024-04-01T19:56:39.040 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fe417b3:::benchmark_data_smithi188_161190_object37903:head# 2024-04-01T19:56:39.040 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fe5b16b:::benchmark_data_smithi188_161190_object125728:head# 2024-04-01T19:56:39.040 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fe665c7:::benchmark_data_smithi188_161190_object52581:head# 2024-04-01T19:56:39.041 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fe67f56:::benchmark_data_smithi188_161190_object106874:head# 2024-04-01T19:56:39.041 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fe7250c:::benchmark_data_smithi188_161190_object59010:head# 2024-04-01T19:56:39.041 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fe78040:::benchmark_data_smithi188_161190_object87906:head# 2024-04-01T19:56:39.041 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:56:39.041 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fe7c607:::benchmark_data_smithi188_161190_object136402:head# 2024-04-01T19:56:39.042 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fe83ef3:::benchmark_data_smithi188_161190_object104896:head# 2024-04-01T19:56:39.042 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fe8412e:::benchmark_data_smithi188_161190_object55428:head# 2024-04-01T19:56:39.042 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fe86540:::benchmark_data_smithi188_161190_object118390:head# 2024-04-01T19:56:39.043 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fe928de:::benchmark_data_smithi188_161190_object114019:head# 2024-04-01T19:56:39.043 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fe9734a:::benchmark_data_smithi188_161190_object36920:head# 2024-04-01T19:56:39.044 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fe99952:::benchmark_data_smithi188_161190_object52084:head# 2024-04-01T19:56:39.044 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fe9c69e:::benchmark_data_smithi188_161190_object113108:head# 2024-04-01T19:56:39.044 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9feae7b9:::benchmark_data_smithi188_161190_object109467:head# 2024-04-01T19:56:39.045 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9feb8bbb:::benchmark_data_smithi188_161190_object70848:head# 2024-04-01T19:56:39.045 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fedb5cb:::benchmark_data_smithi188_161190_object59235:head# 2024-04-01T19:56:39.046 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fede415:::benchmark_data_smithi188_161190_object30285:head# 2024-04-01T19:56:39.046 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fee510a:::benchmark_data_smithi188_161190_object138512:head# 2024-04-01T19:56:39.047 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9feebfb6:::benchmark_data_smithi188_161190_object133201:head# 2024-04-01T19:56:39.047 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9feec899:::benchmark_data_smithi188_161190_object55574:head# 2024-04-01T19:56:39.047 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9feee38e:::benchmark_data_smithi188_161190_object136789:head# 2024-04-01T19:56:39.048 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fef4259:::benchmark_data_smithi188_161190_object112435:head# 2024-04-01T19:56:39.052 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fef7e26:::benchmark_data_smithi188_161190_object40629:head# 2024-04-01T19:56:39.052 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ff03a81:::benchmark_data_smithi188_161190_object66285:head# 2024-04-01T19:56:39.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ff15b1e:::benchmark_data_smithi188_161190_object47503:head# 2024-04-01T19:56:39.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ff2ed5e:::benchmark_data_smithi188_161190_object115993:head# 2024-04-01T19:56:39.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ff32bd6:::benchmark_data_smithi188_161190_object92105:head# 2024-04-01T19:56:39.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ff374d1:::benchmark_data_smithi188_161190_object105768:head# 2024-04-01T19:56:39.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ff5247d:::benchmark_data_smithi188_161190_object90985:head# 2024-04-01T19:56:39.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ff607c0:::benchmark_data_smithi188_161190_object41476:head# 2024-04-01T19:56:39.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ff6728e:::benchmark_data_smithi188_161190_object75241:head# 2024-04-01T19:56:39.053 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ff681a1:::benchmark_data_smithi188_161190_object112617:head# 2024-04-01T19:56:39.058 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ff7498b:::benchmark_data_smithi188_161190_object114116:head# 2024-04-01T19:56:39.059 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ff799c4:::benchmark_data_smithi188_161190_object72165:head# 2024-04-01T19:56:39.059 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ff7bca1:::benchmark_data_smithi188_161190_object96252:head# 2024-04-01T19:56:39.059 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ff9c3a7:::benchmark_data_smithi188_161190_object52624:head# 2024-04-01T19:56:39.059 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ff9f1ad:::benchmark_data_smithi188_161190_object42852:head# 2024-04-01T19:56:39.059 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ffaa7d8:::benchmark_data_smithi188_161190_object50632:head# 2024-04-01T19:56:39.059 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ffab107:::benchmark_data_smithi188_161190_object97154:head# 2024-04-01T19:56:39.059 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ffb12ef:::benchmark_data_smithi188_161190_object80901:head# 2024-04-01T19:56:39.059 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ffbd87f:::benchmark_data_smithi188_161190_object30653:head# 2024-04-01T19:56:39.059 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ffc106a:::benchmark_data_smithi188_161190_object80675:head# 2024-04-01T19:56:39.059 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ffc5a8a:::benchmark_data_smithi188_161190_object125733:head# 2024-04-01T19:56:39.059 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ffd1471:::benchmark_data_smithi188_161190_object42408:head# 2024-04-01T19:56:39.059 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ffdbecf:::benchmark_data_smithi188_161190_object113384:head# 2024-04-01T19:56:39.060 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9ffe6dc0:::benchmark_data_smithi188_161190_object65096:head# 2024-04-01T19:56:39.060 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fff3858:::benchmark_data_smithi188_161190_object127751:head# 2024-04-01T19:56:39.060 INFO:teuthology.orchestra.run.smithi188.stderr:Read #8:9fff7669:::benchmark_data_smithi188_161190_object109123:head# 2024-04-01T19:56:39.066 INFO:teuthology.orchestra.run.smithi188.stderr:Export successful 2024-04-01T19:56:39.071 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:56:39.102 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:56:39.131 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:56:39.160 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:56:39.182 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:56:39.210 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:56:39.238 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:56:39.273 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:56:39.273 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:56:39.273 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:56:39.273 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:56:39.273 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:56:39.273 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:56:39.273 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:56:39.273 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:56:39.274 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:56:39.274 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:56:39.274 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:56:39.274 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.10 2024-04-01T19:56:39.274 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:56:39.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:39 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:56:39.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:39 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/426780015' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:56:39.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:39 smithi022 ceph-mon[39439]: osdmap e690: 12 total, 11 up, 10 in 2024-04-01T19:56:39.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:39 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/372444600' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:56:39.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:39.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:39 smithi022 ceph-mon[39439]: pgmap v1884: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.8 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 583 op/s; 34875/223340 objects degraded (15.615%); 12 MiB/s, 184 objects/s recovering 2024-04-01T19:56:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:39 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:56:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:39 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/426780015' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:56:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:39 smithi062 ceph-mon[44211]: osdmap e690: 12 total, 11 up, 10 in 2024-04-01T19:56:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:39 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/372444600' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:56:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:39 smithi062 ceph-mon[44211]: pgmap v1884: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.8 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 583 op/s; 34875/223340 objects degraded (15.615%); 12 MiB/s, 184 objects/s recovering 2024-04-01T19:56:39.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:39 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:56:39.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:39 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/426780015' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:56:39.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:39 smithi188 ceph-mon[43939]: osdmap e690: 12 total, 11 up, 10 in 2024-04-01T19:56:39.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:39 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/372444600' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:56:39.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:39.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:39 smithi188 ceph-mon[43939]: pgmap v1884: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.8 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 583 op/s; 34875/223340 objects degraded (15.615%); 12 MiB/s, 184 objects/s recovering 2024-04-01T19:56:40.414 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:56:40.415 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:56:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:56:40.673 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:40.673 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:56:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:40 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:40 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 34875/223340 objects degraded (15.615%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:56:40.774 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:56:40.807 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.807 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.807 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.808 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.808 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.808 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.808 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.808 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.808 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.808 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:40 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.808 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:40 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 34875/223340 objects degraded (15.615%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:56:40.811 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:40.837 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:56:40.843 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:40.844 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:56:40.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:40 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:40.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:40 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 34875/223340 objects degraded (15.615%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:56:40.944 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:56:40.979 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:41.005 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:56:41.008 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:41.008 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:56:41.109 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:56:41.140 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:41.163 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:56:41.168 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:41.169 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:56:41.270 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:56:41.306 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:41.334 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:56:41.339 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:41.339 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:56:41.427 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:56:41.427 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:56:41.427 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.427 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26983.0:170463 8.4 8:270ed2f1:::benchmark_data_smithi188_161190_object31181:head [delete] snapc 0=[] ondisk+write+known_if_redirected e690)", 2024-04-01T19:56:41.427 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:41.422450+0000", 2024-04-01T19:56:41.427 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0069019160000000001, 2024-04-01T19:56:41.428 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0069252029999999996, 2024-04-01T19:56:41.428 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:56:41.428 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:56:41.428 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:56:41.428 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:56:41.428 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26983", 2024-04-01T19:56:41.428 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:56:41.428 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 170463 2024-04-01T19:56:41.428 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:56:41.428 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:56:41.428 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.428 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:56:41.428 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:41.422450+0000", 2024-04-01T19:56:41.428 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:56:41.429 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:56:41.429 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.429 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:56:41.429 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:41.422450+0000", 2024-04-01T19:56:41.429 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:56:41.429 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:56:41.429 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.429 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:56:41.429 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:41.422452+0000", 2024-04-01T19:56:41.429 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.384e-06 2024-04-01T19:56:41.429 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:56:41.429 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.429 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:56:41.430 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:41.422461+0000", 2024-04-01T19:56:41.430 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.2279999999999998e-06 2024-04-01T19:56:41.430 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:56:41.430 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.430 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:56:41.430 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:41.422488+0000", 2024-04-01T19:56:41.430 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.7766000000000001e-05 2024-04-01T19:56:41.430 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:56:41.430 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.430 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:56:41.430 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:41.422499+0000", 2024-04-01T19:56:41.430 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1046000000000001e-05 2024-04-01T19:56:41.430 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:56:41.430 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.431 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:56:41.431 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:41.422564+0000", 2024-04-01T19:56:41.431 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.4454000000000003e-05 2024-04-01T19:56:41.431 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:56:41.431 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.431 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:56:41.431 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:41.422680+0000", 2024-04-01T19:56:41.431 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000116248 2024-04-01T19:56:41.431 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:56:41.431 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.431 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 9", 2024-04-01T19:56:41.431 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:41.422809+0000", 2024-04-01T19:56:41.431 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000129152 2024-04-01T19:56:41.431 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:56:41.432 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:56:41.432 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:56:41.432 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:56:41.432 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.432 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26983.0:170469 8.4 8:2a7bdc74:::benchmark_data_smithi188_161190_object31187:head [delete] snapc 0=[] ondisk+write+known_if_redirected e690)", 2024-04-01T19:56:41.432 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:41.422527+0000", 2024-04-01T19:56:41.432 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0068253530000000001, 2024-04-01T19:56:41.432 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0069003279999999998, 2024-04-01T19:56:41.432 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:56:41.432 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:56:41.432 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "waiting for sub ops", 2024-04-01T19:56:41.432 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:56:41.433 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26983", 2024-04-01T19:56:41.433 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:56:41.433 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 170469 2024-04-01T19:56:41.433 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:56:41.433 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:56:41.433 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.433 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:56:41.433 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:41.422527+0000", 2024-04-01T19:56:41.433 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:56:41.433 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:56:41.433 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.433 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:56:41.433 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:41.422527+0000", 2024-04-01T19:56:41.433 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:56:41.434 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:56:41.434 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.434 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:56:41.434 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:41.422527+0000", 2024-04-01T19:56:41.434 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.16e-07 2024-04-01T19:56:41.434 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:56:41.434 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.434 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:56:41.434 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:41.422532+0000", 2024-04-01T19:56:41.434 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.4299999999999999e-06 2024-04-01T19:56:41.434 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:56:41.434 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.434 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:56:41.434 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:41.422538+0000", 2024-04-01T19:56:41.435 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.0630000000000002e-06 2024-04-01T19:56:41.435 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:56:41.435 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.435 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:56:41.435 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:41.422544+0000", 2024-04-01T19:56:41.435 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5570000000000001e-06 2024-04-01T19:56:41.435 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:56:41.435 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.435 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:56:41.435 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:41.426544+0000", 2024-04-01T19:56:41.435 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0039991820000000004 2024-04-01T19:56:41.435 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:56:41.435 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.435 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:56:41.435 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:41.426684+0000", 2024-04-01T19:56:41.436 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000140323 2024-04-01T19:56:41.436 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:56:41.436 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.436 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 9", 2024-04-01T19:56:41.436 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:41.426830+0000", 2024-04-01T19:56:41.436 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014637499999999999 2024-04-01T19:56:41.436 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:56:41.436 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:56:41.436 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:56:41.436 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:56:41.436 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.436 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop_reply(client.26983.0:170463 8.4 e690/629)", 2024-04-01T19:56:41.436 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:41.427788+0000", 2024-04-01T19:56:41.436 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.001563711, 2024-04-01T19:56:41.437 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0016803650000000001, 2024-04-01T19:56:41.437 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:56:41.437 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:56:41.437 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "queued for pg", 2024-04-01T19:56:41.437 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:56:41.437 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.437 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:56:41.437 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:41.427788+0000", 2024-04-01T19:56:41.437 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:56:41.437 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:56:41.437 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.437 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:56:41.437 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:41.427788+0000", 2024-04-01T19:56:41.437 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:56:41.437 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:56:41.437 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.438 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:56:41.438 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:41.427790+0000", 2024-04-01T19:56:41.438 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4920000000000001e-06 2024-04-01T19:56:41.438 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:56:41.438 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.438 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:56:41.438 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:41.427795+0000", 2024-04-01T19:56:41.438 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.938e-06 2024-04-01T19:56:41.438 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:56:41.438 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.438 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:56:41.438 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:41.427804+0000", 2024-04-01T19:56:41.438 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.3700000000000001e-06 2024-04-01T19:56:41.439 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:56:41.439 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:56:41.439 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:56:41.439 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:41.427812+0000", 2024-04-01T19:56:41.439 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.8140000000000001e-06 2024-04-01T19:56:41.439 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:56:41.439 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:56:41.439 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:56:41.439 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:56:41.439 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-04-01T19:56:41.439 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 3 2024-04-01T19:56:41.439 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:56:41.439 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:56:41.483 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:41.709 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:56:41.713 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:41.714 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:56:41.717 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:41 smithi062 ceph-mon[44211]: pgmap v1885: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.6 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 598 op/s; 33930/217648 objects degraded (15.589%); 12 MiB/s, 186 objects/s recovering 2024-04-01T19:56:41.744 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:56:41.815 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:56:41.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:41 smithi022 ceph-mon[39439]: pgmap v1885: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.6 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 598 op/s; 33930/217648 objects degraded (15.589%); 12 MiB/s, 186 objects/s recovering 2024-04-01T19:56:41.872 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:41.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:41 smithi188 ceph-mon[43939]: pgmap v1885: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.6 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 598 op/s; 33930/217648 objects degraded (15.589%); 12 MiB/s, 186 objects/s recovering 2024-04-01T19:56:41.909 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:56:41.916 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:41.916 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:56:42.017 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:56:42.055 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:42.090 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:56:42.095 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:42.096 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:56:42.166 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:56:42.196 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:56:42.241 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:42.415 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:56:43.668 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:56:44.046 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -n osd.10 --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-10 --journal-path /var/lib/ceph/osd/ceph-10/journal --force --op remove --pgid 8.9 2024-04-01T19:56:44.362 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/osd.10/config 2024-04-01T19:56:44.541 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:44 smithi022 ceph-mon[39439]: pgmap v1886: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.6 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 601 op/s; 33930/217256 objects degraded (15.618%); 12 MiB/s, 186 objects/s recovering 2024-04-01T19:56:44.695 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:44 smithi188 ceph-mon[43939]: pgmap v1886: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.6 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 601 op/s; 33930/217256 objects degraded (15.618%); 12 MiB/s, 186 objects/s recovering 2024-04-01T19:56:44.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:44 smithi062 ceph-mon[44211]: pgmap v1886: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.6 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 601 op/s; 33930/217256 objects degraded (15.618%); 12 MiB/s, 186 objects/s recovering 2024-04-01T19:56:45.352 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:56:45.365 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:45.365 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:56:45.385 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_blocked_ops 2024-04-01T19:56:45.466 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:56:45.500 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:45.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:45 smithi062 ceph-mon[44211]: pgmap v1887: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.5 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 599 op/s; 33503/214610 objects degraded (15.611%); 12 MiB/s, 191 objects/s recovering 2024-04-01T19:56:45.780 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:45 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 33503/214610 objects degraded (15.611%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:56:45.849 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:56:45.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:45 smithi022 ceph-mon[39439]: pgmap v1887: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.5 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 599 op/s; 33503/214610 objects degraded (15.611%); 12 MiB/s, 191 objects/s recovering 2024-04-01T19:56:45.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:45 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 33503/214610 objects degraded (15.611%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:56:45.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:45 smithi188 ceph-mon[43939]: pgmap v1887: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.5 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 0 B/s wr, 599 op/s; 33503/214610 objects degraded (15.611%); 12 MiB/s, 191 objects/s recovering 2024-04-01T19:56:45.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:45 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 33503/214610 objects degraded (15.611%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:56:46.487 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:56:46.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:46 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2735984374' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:56:46.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:46 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2735984374' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:56:46.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:46 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2735984374' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:56:47.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:47 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:56:47.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:47 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2735984374' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:56:47.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:47 smithi062 ceph-mon[44211]: osdmap e691: 12 total, 11 up, 10 in 2024-04-01T19:56:47.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:47 smithi062 ceph-mon[44211]: pgmap v1889: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.5 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 0 B/s wr, 662 op/s; 32949/211600 objects degraded (15.571%); 14 MiB/s, 217 objects/s recovering 2024-04-01T19:56:47.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:47 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:56:47.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:47 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2735984374' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:56:47.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:47 smithi022 ceph-mon[39439]: osdmap e691: 12 total, 11 up, 10 in 2024-04-01T19:56:47.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:47 smithi022 ceph-mon[39439]: pgmap v1889: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.5 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 0 B/s wr, 662 op/s; 32949/211600 objects degraded (15.571%); 14 MiB/s, 217 objects/s recovering 2024-04-01T19:56:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:47 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:56:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:47 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2735984374' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:56:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:47 smithi188 ceph-mon[43939]: osdmap e691: 12 total, 11 up, 10 in 2024-04-01T19:56:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:47 smithi188 ceph-mon[43939]: pgmap v1889: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.5 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 0 B/s wr, 662 op/s; 32949/211600 objects degraded (15.571%); 14 MiB/s, 217 objects/s recovering 2024-04-01T19:56:48.059 INFO:teuthology.orchestra.run.smithi188.stderr:Creating an OSD daemon form without an OSD FSID value 2024-04-01T19:56:48.372 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:56:48.372 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:56:48.372 INFO:teuthology.orchestra.run.smithi062.stdout: "complaint_time": 30, 2024-04-01T19:56:48.372 INFO:teuthology.orchestra.run.smithi062.stdout: "num_blocked_ops": 0 2024-04-01T19:56:48.373 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:56:48.659 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:56:48.663 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:48.663 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:56:48.764 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:56:48.800 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:49.175 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_historic_ops 2024-04-01T19:56:49.685 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:56:50.079 INFO:teuthology.orchestra.run.smithi188.stdout: marking collection for removal 2024-04-01T19:56:50.079 INFO:teuthology.orchestra.run.smithi188.stdout:setting '_remove' omap key 2024-04-01T19:56:50.079 INFO:teuthology.orchestra.run.smithi188.stdout:finish_remove_pgs 8.9_head removing 8.9 2024-04-01T19:56:50.261 INFO:teuthology.orchestra.run.smithi188.stdout:Remove successful 2024-04-01T19:56:50.339 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:56:50.344 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:50.344 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:56:50.446 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:56:50.482 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:50.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:50 smithi022 ceph-mon[39439]: pgmap v1890: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.4 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 0 B/s wr, 606 op/s; 32949/211214 objects degraded (15.600%); 12 MiB/s, 192 objects/s recovering 2024-04-01T19:56:50.683 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:50 smithi188 ceph-mon[43939]: pgmap v1890: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.4 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 0 B/s wr, 606 op/s; 32949/211214 objects degraded (15.600%); 12 MiB/s, 192 objects/s recovering 2024-04-01T19:56:50.691 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:56:50.695 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:50.695 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:56:50.719 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:50 smithi062 ceph-mon[44211]: pgmap v1890: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.4 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 0 B/s wr, 606 op/s; 32949/211214 objects degraded (15.600%); 12 MiB/s, 192 objects/s recovering 2024-04-01T19:56:50.796 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:56:50.841 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:51.047 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:56:51.052 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:51.053 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:56:51.154 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:56:51.188 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:51.224 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:56:51.246 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:56:51.277 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:56:51.307 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:56:51.332 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:56:51.361 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:56:51.393 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:56:51.393 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:56:51.404 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:51.405 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:56:51.419 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:56:51.448 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:56:51.475 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:56:51.500 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:56:51.500 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:56:51.501 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:56:51.501 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:56:51.501 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:56:51.501 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:56:51.501 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:56:51.501 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:56:51.501 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:56:51.501 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:56:51.501 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:56:51.501 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.10 2024-04-01T19:56:51.501 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:56:51.505 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:56:51.576 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:51.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:51 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 32949/211214 objects degraded (15.600%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:56:51.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:51 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1316227867' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:56:51.849 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:51 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 32949/211214 objects degraded (15.600%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:56:51.849 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:51 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1316227867' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:56:51.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:51 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 32949/211214 objects degraded (15.600%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:56:51.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:51 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1316227867' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:56:51.881 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:56:51.881 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:56:52.231 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:56:52.237 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:52.237 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:56:52.249 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -n osd.10 --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-10 --journal-path /var/lib/ceph/osd/ceph-10/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.8.9.10 2024-04-01T19:56:52.339 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:56:52.370 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:56:52.371 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:52.398 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:56:52.403 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:52.403 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:56:52.417 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:56:52.417 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:56:52.504 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:56:52.563 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:52.593 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:56:52.597 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:52.597 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:56:52.609 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/osd.10/config 2024-04-01T19:56:52.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:52 smithi188 ceph-mon[43939]: pgmap v1891: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.3 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 0 B/s wr, 589 op/s; 32199/205860 objects degraded (15.641%); 11 MiB/s, 173 objects/s recovering 2024-04-01T19:56:52.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.674 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.674 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.674 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.674 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.674 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.675 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.675 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:52 smithi062 ceph-mon[44211]: pgmap v1891: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.3 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 0 B/s wr, 589 op/s; 32199/205860 objects degraded (15.641%); 11 MiB/s, 173 objects/s recovering 2024-04-01T19:56:52.675 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.675 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.675 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.675 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.698 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:56:52.717 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_ops_in_flight 2024-04-01T19:56:52.738 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.738 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.738 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.738 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.738 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.738 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.738 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:52 smithi022 ceph-mon[39439]: pgmap v1891: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.3 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 0 B/s wr, 589 op/s; 32199/205860 objects degraded (15.641%); 11 MiB/s, 173 objects/s recovering 2024-04-01T19:56:52.739 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.739 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.739 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.739 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:56:52.742 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:52.783 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:56:52.791 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:52.791 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:56:52.816 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:56:52.892 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:56:52.941 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:52.981 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:56:52.984 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:52.985 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:56:53.085 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:56:53.123 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:56:53.135 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:53.174 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:56:53.185 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:53.185 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:56:53.286 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:56:53.320 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:53.552 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:53 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:56:53.553 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:53 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:56:53.553 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:53 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:56:53.553 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:53 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:56:53.553 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:53 smithi188 ceph-mon[43939]: osdmap e692: 12 total, 11 up, 10 in 2024-04-01T19:56:53.553 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:53 smithi188 ceph-mon[43939]: pgmap v1893: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.3 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 0 B/s wr, 595 op/s; 32004/205080 objects degraded (15.606%); 12 MiB/s, 187 objects/s recovering 2024-04-01T19:56:53.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:53 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:56:53.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:53 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:56:53.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:53 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:56:53.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:53 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:56:53.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:53 smithi062 ceph-mon[44211]: osdmap e692: 12 total, 11 up, 10 in 2024-04-01T19:56:53.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:53 smithi062 ceph-mon[44211]: pgmap v1893: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.3 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 0 B/s wr, 595 op/s; 32004/205080 objects degraded (15.606%); 12 MiB/s, 187 objects/s recovering 2024-04-01T19:56:53.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:53 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:56:53.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:53 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:56:53.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:53 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:56:53.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:53 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:56:53.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:53 smithi022 ceph-mon[39439]: osdmap e692: 12 total, 11 up, 10 in 2024-04-01T19:56:53.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:53 smithi022 ceph-mon[39439]: pgmap v1893: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.3 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 0 B/s wr, 595 op/s; 32004/205080 objects degraded (15.606%); 12 MiB/s, 187 objects/s recovering 2024-04-01T19:56:54.418 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:56:55.051 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:56:55.185 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:56:55.199 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:55.199 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:56:55.300 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:56:55.359 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:55.386 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:56:55.390 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:56:55.391 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:56:55.492 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:56:55.539 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:56:55.558 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:56:55.558 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:56:55.762 INFO:teuthology.orchestra.run.smithi188.stderr:Creating an OSD daemon form without an OSD FSID value 2024-04-01T19:56:56.300 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_blocked_ops 2024-04-01T19:56:56.439 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:56:56.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:56 smithi062 ceph-mon[44211]: pgmap v1894: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.2 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 0 B/s wr, 409 op/s; 32004/204328 objects degraded (15.663%); 6.6 MiB/s, 106 objects/s recovering 2024-04-01T19:56:56.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:56 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3790110099' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:56:56.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:56 smithi062 ceph-mon[44211]: from='client.37229 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:56:56.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:56 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 32004/204328 objects degraded (15.663%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:56:56.617 INFO:teuthology.orchestra.run.smithi188.stdout:get_pg_num_history pg_num_history pg_num_history(e679 pg_nums {7={560=16},8={629=16}} deleted_pools 627,7) 2024-04-01T19:56:56.617 INFO:teuthology.orchestra.run.smithi188.stdout:Importing pgid 8.9 2024-04-01T19:56:56.650 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:900014b2:::benchmark_data_smithi188_161190_object134254:head# 2024-04-01T19:56:56.651 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.651 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90008878:::benchmark_data_smithi188_161190_object35224:head# 2024-04-01T19:56:56.651 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.651 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9001f9da:::benchmark_data_smithi188_161190_object62468:head# 2024-04-01T19:56:56.651 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.652 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9002055d:::benchmark_data_smithi188_161190_object26804:head# 2024-04-01T19:56:56.652 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.652 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:900267f5:::benchmark_data_smithi188_161190_object115861:head# 2024-04-01T19:56:56.652 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.653 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9002a36e:::benchmark_data_smithi188_161190_object102118:head# 2024-04-01T19:56:56.653 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.653 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9002d7d4:::benchmark_data_smithi188_161190_object112859:head# 2024-04-01T19:56:56.653 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.653 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90046d80:::benchmark_data_smithi188_161190_object137075:head# 2024-04-01T19:56:56.653 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.653 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:900507d4:::benchmark_data_smithi188_161190_object43115:head# 2024-04-01T19:56:56.653 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.655 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90050cef:::benchmark_data_smithi188_161190_object104303:head# 2024-04-01T19:56:56.655 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.655 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9005de87:::benchmark_data_smithi188_161190_object29700:head# 2024-04-01T19:56:56.655 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.656 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9005fb39:::benchmark_data_smithi188_161190_object42484:head# 2024-04-01T19:56:56.656 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.656 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90074d72:::benchmark_data_smithi188_161190_object73323:head# 2024-04-01T19:56:56.656 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.656 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:900771a9:::benchmark_data_smithi188_161190_object82703:head# 2024-04-01T19:56:56.656 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.656 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90081390:::benchmark_data_smithi188_161190_object64116:head# 2024-04-01T19:56:56.656 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.656 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90082e43:::benchmark_data_smithi188_161190_object39304:head# 2024-04-01T19:56:56.656 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.656 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:900871f2:::benchmark_data_smithi188_161190_object31261:head# 2024-04-01T19:56:56.656 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.656 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9008d7f4:::benchmark_data_smithi188_161190_object62480:head# 2024-04-01T19:56:56.656 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.656 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9009b45f:::benchmark_data_smithi188_161190_object72348:head# 2024-04-01T19:56:56.657 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.658 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:900a56a2:::benchmark_data_smithi188_161190_object21600:head# 2024-04-01T19:56:56.658 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.658 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:900b1056:::benchmark_data_smithi188_161190_object115737:head# 2024-04-01T19:56:56.658 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.658 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:900c0c50:::benchmark_data_smithi188_161190_object128124:head# 2024-04-01T19:56:56.659 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.659 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:900ce7e3:::benchmark_data_smithi188_161190_object128655:head# 2024-04-01T19:56:56.659 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.659 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:900d20b7:::benchmark_data_smithi188_161190_object109210:head# 2024-04-01T19:56:56.659 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.659 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:900e1b8e:::benchmark_data_smithi188_161190_object80601:head# 2024-04-01T19:56:56.659 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.659 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:900e2a24:::benchmark_data_smithi188_161190_object111679:head# 2024-04-01T19:56:56.659 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.659 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:900ec3ad:::benchmark_data_smithi188_161190_object62137:head# 2024-04-01T19:56:56.659 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.660 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:900fa4c7:::benchmark_data_smithi188_161190_object40992:head# 2024-04-01T19:56:56.662 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.662 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:901082b3:::benchmark_data_smithi188_161190_object127445:head# 2024-04-01T19:56:56.662 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.662 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90112f79:::benchmark_data_smithi188_161190_object35138:head# 2024-04-01T19:56:56.663 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.663 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90117562:::benchmark_data_smithi188_161190_object85224:head# 2024-04-01T19:56:56.663 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.663 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90117e4d:::benchmark_data_smithi188_161190_object129079:head# 2024-04-01T19:56:56.663 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.663 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90124356:::benchmark_data_smithi188_161190_object38120:head# 2024-04-01T19:56:56.663 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.663 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90126b16:::benchmark_data_smithi188_161190_object73579:head# 2024-04-01T19:56:56.663 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.663 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90127bcc:::benchmark_data_smithi188_161190_object32194:head# 2024-04-01T19:56:56.663 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.663 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9013451a:::benchmark_data_smithi188_161190_object48141:head# 2024-04-01T19:56:56.664 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.664 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:901388cf:::benchmark_data_smithi188_161190_object27218:head# 2024-04-01T19:56:56.664 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.664 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9013f611:::benchmark_data_smithi188_161190_object68933:head# 2024-04-01T19:56:56.664 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.664 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:901429cb:::benchmark_data_smithi188_161190_object31708:head# 2024-04-01T19:56:56.664 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.664 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:901432dd:::benchmark_data_smithi188_161190_object53688:head# 2024-04-01T19:56:56.664 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.664 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90147f4c:::benchmark_data_smithi188_161190_object25761:head# 2024-04-01T19:56:56.664 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.667 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90149e1a:::benchmark_data_smithi188_161190_object49917:head# 2024-04-01T19:56:56.667 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.667 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9015017e:::benchmark_data_smithi188_161190_object128501:head# 2024-04-01T19:56:56.667 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.667 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90154582:::benchmark_data_smithi188_161190_object59457:head# 2024-04-01T19:56:56.667 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.667 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90159563:::benchmark_data_smithi188_161190_object110334:head# 2024-04-01T19:56:56.668 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.668 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90169637:::benchmark_data_smithi188_161190_object28620:head# 2024-04-01T19:56:56.668 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.668 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9016c2d8:::benchmark_data_smithi188_161190_object108335:head# 2024-04-01T19:56:56.668 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.668 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9016edc3:::benchmark_data_smithi188_161190_object49368:head# 2024-04-01T19:56:56.668 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.668 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90172745:::benchmark_data_smithi188_161190_object98561:head# 2024-04-01T19:56:56.668 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.668 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90178a88:::benchmark_data_smithi188_161190_object64309:head# 2024-04-01T19:56:56.668 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.668 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9017c437:::benchmark_data_smithi188_161190_object34183:head# 2024-04-01T19:56:56.668 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.668 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:901842cf:::benchmark_data_smithi188_161190_object50861:head# 2024-04-01T19:56:56.669 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.669 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9019413a:::benchmark_data_smithi188_161190_object35945:head# 2024-04-01T19:56:56.669 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.669 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9019825e:::benchmark_data_smithi188_161190_object84841:head# 2024-04-01T19:56:56.669 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.669 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9019e11f:::benchmark_data_smithi188_161190_object59947:head# 2024-04-01T19:56:56.669 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.669 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:901a0808:::benchmark_data_smithi188_161190_object125589:head# 2024-04-01T19:56:56.669 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.669 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:901a7f03:::benchmark_data_smithi188_161190_object113557:head# 2024-04-01T19:56:56.669 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.669 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:901ad661:::benchmark_data_smithi188_161190_object39816:head# 2024-04-01T19:56:56.669 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.671 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:901b0d5d:::benchmark_data_smithi188_161190_object97553:head# 2024-04-01T19:56:56.671 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.672 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:901bab18:::benchmark_data_smithi188_161190_object42532:head# 2024-04-01T19:56:56.672 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.672 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:901ca976:::benchmark_data_smithi188_161190_object63130:head# 2024-04-01T19:56:56.672 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.672 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:901d17c6:::benchmark_data_smithi188_161190_object60749:head# 2024-04-01T19:56:56.672 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.672 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:901d57f4:::benchmark_data_smithi188_161190_object23299:head# 2024-04-01T19:56:56.672 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.672 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:901f9a6d:::benchmark_data_smithi188_161190_object26823:head# 2024-04-01T19:56:56.672 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.672 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:901ffed6:::benchmark_data_smithi188_161190_object76034:head# 2024-04-01T19:56:56.672 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.673 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9020517b:::benchmark_data_smithi188_161190_object47257:head# 2024-04-01T19:56:56.673 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.673 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9020b1dd:::benchmark_data_smithi188_161190_object112353:head# 2024-04-01T19:56:56.673 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.675 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9020f2ae:::benchmark_data_smithi188_161190_object56667:head# 2024-04-01T19:56:56.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.675 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90211fc5:::benchmark_data_smithi188_161190_object66498:head# 2024-04-01T19:56:56.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.675 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9021526d:::benchmark_data_smithi188_161190_object47748:head# 2024-04-01T19:56:56.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.675 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90224673:::benchmark_data_smithi188_161190_object128036:head# 2024-04-01T19:56:56.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.675 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9022d584:::benchmark_data_smithi188_161190_object132893:head# 2024-04-01T19:56:56.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.676 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90235186:::benchmark_data_smithi188_161190_object105716:head# 2024-04-01T19:56:56.676 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.676 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90249a82:::benchmark_data_smithi188_161190_object88486:head# 2024-04-01T19:56:56.676 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.676 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9025251e:::benchmark_data_smithi188_161190_object86778:head# 2024-04-01T19:56:56.676 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.677 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:902592e7:::benchmark_data_smithi188_161190_object28394:head# 2024-04-01T19:56:56.678 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.678 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9026ee90:::benchmark_data_smithi188_161190_object98003:head# 2024-04-01T19:56:56.678 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.678 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9027c2e3:::benchmark_data_smithi188_161190_object94006:head# 2024-04-01T19:56:56.678 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.678 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9028442b:::benchmark_data_smithi188_161190_object21445:head# 2024-04-01T19:56:56.678 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.678 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9028c2b8:::benchmark_data_smithi188_161190_object120168:head# 2024-04-01T19:56:56.678 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.678 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9028c83a:::benchmark_data_smithi188_161190_object113161:head# 2024-04-01T19:56:56.678 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.678 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9028d336:::benchmark_data_smithi188_161190_object76264:head# 2024-04-01T19:56:56.678 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.679 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:902a6c3e:::benchmark_data_smithi188_161190_object43392:head# 2024-04-01T19:56:56.679 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.679 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:902a8542:::benchmark_data_smithi188_161190_object126678:head# 2024-04-01T19:56:56.680 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.681 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:902aaf29:::benchmark_data_smithi188_161190_object97632:head# 2024-04-01T19:56:56.681 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.681 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:902ab15f:::benchmark_data_smithi188_161190_object49068:head# 2024-04-01T19:56:56.681 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.681 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:902abc9a:::benchmark_data_smithi188_161190_object34431:head# 2024-04-01T19:56:56.681 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.681 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:902ac0c7:::benchmark_data_smithi188_161190_object48857:head# 2024-04-01T19:56:56.681 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.681 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:902ae739:::benchmark_data_smithi188_161190_object49187:head# 2024-04-01T19:56:56.681 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.683 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:902b382e:::benchmark_data_smithi188_161190_object128384:head# 2024-04-01T19:56:56.683 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.683 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:902bccfe:::benchmark_data_smithi188_161190_object21019:head# 2024-04-01T19:56:56.683 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.683 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:902c19d7:::benchmark_data_smithi188_161190_object80725:head# 2024-04-01T19:56:56.683 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.683 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:902cb160:::benchmark_data_smithi188_161190_object68517:head# 2024-04-01T19:56:56.683 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.685 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:902cb691:::benchmark_data_smithi188_161190_object134383:head# 2024-04-01T19:56:56.685 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.685 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:902cb8d1:::benchmark_data_smithi188_161190_object82379:head# 2024-04-01T19:56:56.685 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.685 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:902cf05c:::benchmark_data_smithi188_161190_object68875:head# 2024-04-01T19:56:56.685 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.685 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:902d08b2:::benchmark_data_smithi188_161190_object106074:head# 2024-04-01T19:56:56.686 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.686 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:902da2a1:::benchmark_data_smithi188_161190_object113719:head# 2024-04-01T19:56:56.686 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.686 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:902e6701:::benchmark_data_smithi188_161190_object37031:head# 2024-04-01T19:56:56.686 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.686 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:902e76ec:::benchmark_data_smithi188_161190_object47473:head# 2024-04-01T19:56:56.686 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.686 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:902fa5c4:::benchmark_data_smithi188_161190_object105646:head# 2024-04-01T19:56:56.686 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.686 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:902fb940:::benchmark_data_smithi188_161190_object78349:head# 2024-04-01T19:56:56.686 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:903026da:::benchmark_data_smithi188_161190_object43457:head# 2024-04-01T19:56:56.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9032482d:::benchmark_data_smithi188_161190_object123046:head# 2024-04-01T19:56:56.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9032995c:::benchmark_data_smithi188_161190_object24169:head# 2024-04-01T19:56:56.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9032dc49:::benchmark_data_smithi188_161190_object22570:head# 2024-04-01T19:56:56.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.690 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90331849:::benchmark_data_smithi188_161190_object49169:head# 2024-04-01T19:56:56.690 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.690 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90331d8e:::benchmark_data_smithi188_161190_object132880:head# 2024-04-01T19:56:56.690 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.690 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90346efa:::benchmark_data_smithi188_161190_object58478:head# 2024-04-01T19:56:56.690 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.690 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:903587bc:::benchmark_data_smithi188_161190_object89797:head# 2024-04-01T19:56:56.690 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.690 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9035bc62:::benchmark_data_smithi188_161190_object54613:head# 2024-04-01T19:56:56.690 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.690 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:903743d0:::benchmark_data_smithi188_161190_object63438:head# 2024-04-01T19:56:56.690 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.690 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9037efb6:::benchmark_data_smithi188_161190_object125832:head# 2024-04-01T19:56:56.691 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.691 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9038aabb:::benchmark_data_smithi188_161190_object102379:head# 2024-04-01T19:56:56.691 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.691 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9038dd34:::benchmark_data_smithi188_161190_object39143:head# 2024-04-01T19:56:56.691 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.691 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90395cfe:::benchmark_data_smithi188_161190_object118483:head# 2024-04-01T19:56:56.691 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.691 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:903c9b96:::benchmark_data_smithi188_161190_object99682:head# 2024-04-01T19:56:56.691 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.692 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:903d935e:::benchmark_data_smithi188_161190_object85033:head# 2024-04-01T19:56:56.692 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.692 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:903db2c7:::benchmark_data_smithi188_161190_object89661:head# 2024-04-01T19:56:56.692 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.695 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:903dcc4b:::benchmark_data_smithi188_161190_object81339:head# 2024-04-01T19:56:56.695 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.695 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:903e0e4b:::benchmark_data_smithi188_161190_object60965:head# 2024-04-01T19:56:56.695 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.695 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:903e1402:::benchmark_data_smithi188_161190_object43882:head# 2024-04-01T19:56:56.695 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.696 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:903ff096:::benchmark_data_smithi188_161190_object97497:head# 2024-04-01T19:56:56.696 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.696 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9040019e:::benchmark_data_smithi188_161190_object66986:head# 2024-04-01T19:56:56.696 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.696 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90401b92:::benchmark_data_smithi188_161190_object115195:head# 2024-04-01T19:56:56.696 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.696 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9040f5c0:::benchmark_data_smithi188_161190_object77216:head# 2024-04-01T19:56:56.696 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.696 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9041e92c:::benchmark_data_smithi188_161190_object129610:head# 2024-04-01T19:56:56.696 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.696 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90425f45:::benchmark_data_smithi188_161190_object71031:head# 2024-04-01T19:56:56.696 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.696 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90433b15:::benchmark_data_smithi188_161190_object21696:head# 2024-04-01T19:56:56.697 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.697 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90433efc:::benchmark_data_smithi188_161190_object87455:head# 2024-04-01T19:56:56.697 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.697 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9043c4cf:::benchmark_data_smithi188_161190_object124686:head# 2024-04-01T19:56:56.697 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.697 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9043e01a:::benchmark_data_smithi188_161190_object23830:head# 2024-04-01T19:56:56.697 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.697 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9044c73c:::benchmark_data_smithi188_161190_object85499:head# 2024-04-01T19:56:56.697 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.697 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9045271e:::benchmark_data_smithi188_161190_object111176:head# 2024-04-01T19:56:56.697 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.697 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:904564aa:::benchmark_data_smithi188_161190_object96681:head# 2024-04-01T19:56:56.697 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.698 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:904594fb:::benchmark_data_smithi188_161190_object29052:head# 2024-04-01T19:56:56.698 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.698 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90469abd:::benchmark_data_smithi188_161190_object43147:head# 2024-04-01T19:56:56.698 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.705 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9046b4f1:::benchmark_data_smithi188_161190_object27421:head# 2024-04-01T19:56:56.705 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.705 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90482bb5:::benchmark_data_smithi188_161190_object35946:head# 2024-04-01T19:56:56.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90482cf6:::benchmark_data_smithi188_161190_object124585:head# 2024-04-01T19:56:56.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9048d8f0:::benchmark_data_smithi188_161190_object139276:head# 2024-04-01T19:56:56.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90493451:::benchmark_data_smithi188_161190_object111258:head# 2024-04-01T19:56:56.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9049b944:::benchmark_data_smithi188_161190_object105729:head# 2024-04-01T19:56:56.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:904a78ca:::benchmark_data_smithi188_161190_object47556:head# 2024-04-01T19:56:56.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:904c603e:::benchmark_data_smithi188_161190_object132494:head# 2024-04-01T19:56:56.707 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.707 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:904cbf79:::benchmark_data_smithi188_161190_object102053:head# 2024-04-01T19:56:56.707 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.707 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:904d2a8c:::benchmark_data_smithi188_161190_object50477:head# 2024-04-01T19:56:56.707 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.707 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:904d676b:::benchmark_data_smithi188_161190_object48904:head# 2024-04-01T19:56:56.707 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.707 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:904d95ba:::benchmark_data_smithi188_161190_object80266:head# 2024-04-01T19:56:56.707 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.707 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:904e2dc1:::benchmark_data_smithi188_161190_object82591:head# 2024-04-01T19:56:56.707 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.707 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:904e5675:::benchmark_data_smithi188_161190_object40945:head# 2024-04-01T19:56:56.707 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.707 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:904e9182:::benchmark_data_smithi188_161190_object32369:head# 2024-04-01T19:56:56.708 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.708 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:904ee2a4:::benchmark_data_smithi188_161190_object111545:head# 2024-04-01T19:56:56.708 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.708 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:904f2c41:::benchmark_data_smithi188_161190_object108582:head# 2024-04-01T19:56:56.708 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.708 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:905013ba:::benchmark_data_smithi188_161190_object50479:head# 2024-04-01T19:56:56.708 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.708 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90504ead:::benchmark_data_smithi188_161190_object35712:head# 2024-04-01T19:56:56.708 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.708 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9050633e:::benchmark_data_smithi188_161190_object139265:head# 2024-04-01T19:56:56.708 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.708 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90508ff4:::benchmark_data_smithi188_161190_object62767:head# 2024-04-01T19:56:56.709 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.709 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9050bd7f:::benchmark_data_smithi188_161190_object74527:head# 2024-04-01T19:56:56.709 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.709 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90510242:::benchmark_data_smithi188_161190_object121755:head# 2024-04-01T19:56:56.709 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.709 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90511876:::benchmark_data_smithi188_161190_object81543:head# 2024-04-01T19:56:56.709 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.709 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:905128fa:::benchmark_data_smithi188_161190_object76773:head# 2024-04-01T19:56:56.709 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.709 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90513ae7:::benchmark_data_smithi188_161190_object136148:head# 2024-04-01T19:56:56.709 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.709 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:905147db:::benchmark_data_smithi188_161190_object49579:head# 2024-04-01T19:56:56.709 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.710 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90515b84:::benchmark_data_smithi188_161190_object97905:head# 2024-04-01T19:56:56.710 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.710 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9052cfe5:::benchmark_data_smithi188_161190_object85583:head# 2024-04-01T19:56:56.710 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.710 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90531582:::benchmark_data_smithi188_161190_object55462:head# 2024-04-01T19:56:56.710 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.710 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90537ad0:::benchmark_data_smithi188_161190_object132803:head# 2024-04-01T19:56:56.710 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.710 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90541be2:::benchmark_data_smithi188_161190_object112681:head# 2024-04-01T19:56:56.710 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.710 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90543e1a:::benchmark_data_smithi188_161190_object37476:head# 2024-04-01T19:56:56.710 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.711 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:905476cb:::benchmark_data_smithi188_161190_object74968:head# 2024-04-01T19:56:56.711 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.711 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90571b3a:::benchmark_data_smithi188_161190_object107774:head# 2024-04-01T19:56:56.711 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.711 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:905757dc:::benchmark_data_smithi188_161190_object95770:head# 2024-04-01T19:56:56.711 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.711 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9057ebb8:::benchmark_data_smithi188_161190_object33495:head# 2024-04-01T19:56:56.711 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.711 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90582911:::benchmark_data_smithi188_161190_object21546:head# 2024-04-01T19:56:56.711 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.711 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:905961a3:::benchmark_data_smithi188_161190_object129897:head# 2024-04-01T19:56:56.711 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.715 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9059d422:::benchmark_data_smithi188_161190_object96505:head# 2024-04-01T19:56:56.715 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.715 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:905b37a0:::benchmark_data_smithi188_161190_object86464:head# 2024-04-01T19:56:56.715 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.715 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:905ba5ce:::benchmark_data_smithi188_161190_object115233:head# 2024-04-01T19:56:56.715 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.715 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:905c2ef7:::benchmark_data_smithi188_161190_object81969:head# 2024-04-01T19:56:56.715 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.715 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:905c4226:::benchmark_data_smithi188_161190_object79504:head# 2024-04-01T19:56:56.715 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.715 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:905e5ce5:::benchmark_data_smithi188_161190_object24224:head# 2024-04-01T19:56:56.716 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.716 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:905ec862:::benchmark_data_smithi188_161190_object35618:head# 2024-04-01T19:56:56.716 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.716 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:905ee123:::benchmark_data_smithi188_161190_object58789:head# 2024-04-01T19:56:56.716 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.716 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:905f1f59:::benchmark_data_smithi188_161190_object46257:head# 2024-04-01T19:56:56.716 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.716 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:905f4f74:::benchmark_data_smithi188_161190_object126080:head# 2024-04-01T19:56:56.716 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.716 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:905fced8:::benchmark_data_smithi188_161190_object96610:head# 2024-04-01T19:56:56.716 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.716 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9060ff73:::benchmark_data_smithi188_161190_object32641:head# 2024-04-01T19:56:56.717 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.717 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9061242d:::benchmark_data_smithi188_161190_object89887:head# 2024-04-01T19:56:56.717 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.717 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90619873:::benchmark_data_smithi188_161190_object51687:head# 2024-04-01T19:56:56.717 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.717 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:906228fd:::benchmark_data_smithi188_161190_object129217:head# 2024-04-01T19:56:56.717 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.717 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90626e5d:::benchmark_data_smithi188_161190_object23587:head# 2024-04-01T19:56:56.717 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.717 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9064be6a:::benchmark_data_smithi188_161190_object131221:head# 2024-04-01T19:56:56.717 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.717 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9064f336:::benchmark_data_smithi188_161190_object137899:head# 2024-04-01T19:56:56.717 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.717 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9065b715:::benchmark_data_smithi188_161190_object88381:head# 2024-04-01T19:56:56.718 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.718 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:906734ac:::benchmark_data_smithi188_161190_object114023:head# 2024-04-01T19:56:56.718 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.718 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90679065:::benchmark_data_smithi188_161190_object91150:head# 2024-04-01T19:56:56.718 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.718 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9067cbe3:::benchmark_data_smithi188_161190_object108057:head# 2024-04-01T19:56:56.718 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.718 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90680109:::benchmark_data_smithi188_161190_object138105:head# 2024-04-01T19:56:56.718 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.719 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:56:56.720 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90688d42:::benchmark_data_smithi188_161190_object104978:head# 2024-04-01T19:56:56.720 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.720 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90688efc:::benchmark_data_smithi188_161190_object85044:head# 2024-04-01T19:56:56.720 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.720 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:906897be:::benchmark_data_smithi188_161190_object80200:head# 2024-04-01T19:56:56.721 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.721 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9068d762:::benchmark_data_smithi188_161190_object31277:head# 2024-04-01T19:56:56.721 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.721 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9069550f:::benchmark_data_smithi188_161190_object119654:head# 2024-04-01T19:56:56.721 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.721 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:906a75ba:::benchmark_data_smithi188_161190_object43731:head# 2024-04-01T19:56:56.721 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.721 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:906c8440:::benchmark_data_smithi188_161190_object110786:head# 2024-04-01T19:56:56.721 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.721 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:906cc2b6:::benchmark_data_smithi188_161190_object131591:head# 2024-04-01T19:56:56.721 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.725 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:906d0370:::benchmark_data_smithi188_161190_object130092:head# 2024-04-01T19:56:56.725 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.725 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:906d6f4d:::benchmark_data_smithi188_161190_object62696:head# 2024-04-01T19:56:56.725 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.725 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:906ddc6e:::benchmark_data_smithi188_161190_object38645:head# 2024-04-01T19:56:56.726 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.727 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:906e809c:::benchmark_data_smithi188_161190_object129213:head# 2024-04-01T19:56:56.727 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.727 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:906ede0b:::benchmark_data_smithi188_161190_object64288:head# 2024-04-01T19:56:56.727 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.727 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:906f03cf:::benchmark_data_smithi188_161190_object68982:head# 2024-04-01T19:56:56.727 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.727 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:906f06c5:::benchmark_data_smithi188_161190_object105120:head# 2024-04-01T19:56:56.727 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.727 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:906feb5c:::benchmark_data_smithi188_161190_object67848:head# 2024-04-01T19:56:56.727 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.727 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:907199d6:::benchmark_data_smithi188_161190_object40157:head# 2024-04-01T19:56:56.727 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.729 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9071f09a:::benchmark_data_smithi188_161190_object27504:head# 2024-04-01T19:56:56.729 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.729 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90722a6a:::benchmark_data_smithi188_161190_object54858:head# 2024-04-01T19:56:56.729 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.729 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9072fef0:::benchmark_data_smithi188_161190_object30768:head# 2024-04-01T19:56:56.729 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.729 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90738894:::benchmark_data_smithi188_161190_object135258:head# 2024-04-01T19:56:56.729 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.729 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9073af55:::benchmark_data_smithi188_161190_object58670:head# 2024-04-01T19:56:56.729 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.729 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9073b4b0:::benchmark_data_smithi188_161190_object104418:head# 2024-04-01T19:56:56.729 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.732 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90743633:::benchmark_data_smithi188_161190_object55054:head# 2024-04-01T19:56:56.732 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.732 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90746b4d:::benchmark_data_smithi188_161190_object81726:head# 2024-04-01T19:56:56.732 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.732 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90750376:::benchmark_data_smithi188_161190_object25244:head# 2024-04-01T19:56:56.732 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.732 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90765222:::benchmark_data_smithi188_161190_object133612:head# 2024-04-01T19:56:56.732 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.733 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9076b9f2:::benchmark_data_smithi188_161190_object37352:head# 2024-04-01T19:56:56.733 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.733 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9076bd6f:::benchmark_data_smithi188_161190_object76227:head# 2024-04-01T19:56:56.733 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.733 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90774341:::benchmark_data_smithi188_161190_object48633:head# 2024-04-01T19:56:56.733 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.733 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90784e62:::benchmark_data_smithi188_161190_object27687:head# 2024-04-01T19:56:56.733 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.733 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:907a68ca:::benchmark_data_smithi188_161190_object94355:head# 2024-04-01T19:56:56.733 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.733 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:907accae:::benchmark_data_smithi188_161190_object117676:head# 2024-04-01T19:56:56.733 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.733 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:907b2c8d:::benchmark_data_smithi188_161190_object118177:head# 2024-04-01T19:56:56.733 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.734 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:907b52b3:::benchmark_data_smithi188_161190_object41210:head# 2024-04-01T19:56:56.734 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.734 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:907c3f8e:::benchmark_data_smithi188_161190_object72750:head# 2024-04-01T19:56:56.734 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.736 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:907cc470:::benchmark_data_smithi188_161190_object24395:head# 2024-04-01T19:56:56.736 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.736 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:907cc6db:::benchmark_data_smithi188_161190_object65973:head# 2024-04-01T19:56:56.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:907ccd04:::benchmark_data_smithi188_161190_object47565:head# 2024-04-01T19:56:56.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:907d00ad:::benchmark_data_smithi188_161190_object53500:head# 2024-04-01T19:56:56.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:907d6cc9:::benchmark_data_smithi188_161190_object37992:head# 2024-04-01T19:56:56.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:907e3884:::benchmark_data_smithi188_161190_object101810:head# 2024-04-01T19:56:56.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:907e58ca:::benchmark_data_smithi188_161190_object101492:head# 2024-04-01T19:56:56.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:907e94f3:::benchmark_data_smithi188_161190_object66945:head# 2024-04-01T19:56:56.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:907ec1f8:::benchmark_data_smithi188_161190_object33146:head# 2024-04-01T19:56:56.738 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.738 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:907ef555:::benchmark_data_smithi188_161190_object69310:head# 2024-04-01T19:56:56.738 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.738 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:907f004d:::benchmark_data_smithi188_161190_object114039:head# 2024-04-01T19:56:56.738 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.738 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9080f268:::benchmark_data_smithi188_161190_object130021:head# 2024-04-01T19:56:56.738 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.738 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9080ffa5:::benchmark_data_smithi188_161190_object118546:head# 2024-04-01T19:56:56.738 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.738 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90812b03:::benchmark_data_smithi188_161190_object66646:head# 2024-04-01T19:56:56.738 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.738 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90812b9a:::benchmark_data_smithi188_161190_object59190:head# 2024-04-01T19:56:56.738 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.739 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9083a44e:::benchmark_data_smithi188_161190_object119306:head# 2024-04-01T19:56:56.739 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.741 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9084431d:::benchmark_data_smithi188_161190_object128619:head# 2024-04-01T19:56:56.741 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.741 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90847ab1:::benchmark_data_smithi188_161190_object127233:head# 2024-04-01T19:56:56.741 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.741 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90864f3a:::benchmark_data_smithi188_161190_object80891:head# 2024-04-01T19:56:56.741 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.741 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9086b184:::benchmark_data_smithi188_161190_object36541:head# 2024-04-01T19:56:56.741 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9086be60:::benchmark_data_smithi188_161190_object125628:head# 2024-04-01T19:56:56.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9087c374:::benchmark_data_smithi188_161190_object63979:head# 2024-04-01T19:56:56.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9087fa15:::benchmark_data_smithi188_161190_object28778:head# 2024-04-01T19:56:56.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90880956:::benchmark_data_smithi188_161190_object28066:head# 2024-04-01T19:56:56.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9089453e:::benchmark_data_smithi188_161190_object99203:head# 2024-04-01T19:56:56.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:908956b9:::benchmark_data_smithi188_161190_object129202:head# 2024-04-01T19:56:56.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9089e23e:::benchmark_data_smithi188_161190_object124943:head# 2024-04-01T19:56:56.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:908a544b:::benchmark_data_smithi188_161190_object83890:head# 2024-04-01T19:56:56.743 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.743 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:908b006b:::benchmark_data_smithi188_161190_object82016:head# 2024-04-01T19:56:56.743 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.743 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:908b9e59:::benchmark_data_smithi188_161190_object97761:head# 2024-04-01T19:56:56.743 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.743 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:908d3845:::benchmark_data_smithi188_161190_object73793:head# 2024-04-01T19:56:56.743 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.743 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:908dc17f:::benchmark_data_smithi188_161190_object82062:head# 2024-04-01T19:56:56.743 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.743 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:908dd88b:::benchmark_data_smithi188_161190_object32165:head# 2024-04-01T19:56:56.743 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.746 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:908ea042:::benchmark_data_smithi188_161190_object97347:head# 2024-04-01T19:56:56.746 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.746 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:908ec668:::benchmark_data_smithi188_161190_object58460:head# 2024-04-01T19:56:56.746 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.746 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90901b1e:::benchmark_data_smithi188_161190_object30445:head# 2024-04-01T19:56:56.746 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.746 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9090e0f7:::benchmark_data_smithi188_161190_object33540:head# 2024-04-01T19:56:56.746 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.746 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9092cf7d:::benchmark_data_smithi188_161190_object126503:head# 2024-04-01T19:56:56.746 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.746 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90932c8e:::benchmark_data_smithi188_161190_object79081:head# 2024-04-01T19:56:56.747 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.747 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9094b2b1:::benchmark_data_smithi188_161190_object52922:head# 2024-04-01T19:56:56.747 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.747 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:909629bc:::benchmark_data_smithi188_161190_object138279:head# 2024-04-01T19:56:56.747 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.747 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:909747c0:::benchmark_data_smithi188_161190_object102795:head# 2024-04-01T19:56:56.747 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.747 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90976dc5:::benchmark_data_smithi188_161190_object123296:head# 2024-04-01T19:56:56.747 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.747 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90976e57:::benchmark_data_smithi188_161190_object121250:head# 2024-04-01T19:56:56.747 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.747 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9097a3be:::benchmark_data_smithi188_161190_object59512:head# 2024-04-01T19:56:56.747 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.747 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9097fe30:::benchmark_data_smithi188_161190_object94245:head# 2024-04-01T19:56:56.748 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.748 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9098102b:::benchmark_data_smithi188_161190_object104144:head# 2024-04-01T19:56:56.748 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.748 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90982586:::benchmark_data_smithi188_161190_object24953:head# 2024-04-01T19:56:56.748 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.748 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9098851f:::benchmark_data_smithi188_161190_object50773:head# 2024-04-01T19:56:56.748 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.748 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9098b736:::benchmark_data_smithi188_161190_object93702:head# 2024-04-01T19:56:56.748 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.748 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9098c89d:::benchmark_data_smithi188_161190_object75147:head# 2024-04-01T19:56:56.748 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.752 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:909aa63f:::benchmark_data_smithi188_161190_object126248:head# 2024-04-01T19:56:56.753 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.753 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:909b2eb6:::benchmark_data_smithi188_161190_object46997:head# 2024-04-01T19:56:56.753 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.753 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:909c37ed:::benchmark_data_smithi188_161190_object99797:head# 2024-04-01T19:56:56.753 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.753 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:909c4fef:::benchmark_data_smithi188_161190_object20706:head# 2024-04-01T19:56:56.753 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.753 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:909cde67:::benchmark_data_smithi188_161190_object103018:head# 2024-04-01T19:56:56.753 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.753 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:909d4655:::benchmark_data_smithi188_161190_object110969:head# 2024-04-01T19:56:56.753 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.753 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:909df50b:::benchmark_data_smithi188_161190_object126668:head# 2024-04-01T19:56:56.753 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.753 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:909e43b5:::benchmark_data_smithi188_161190_object111998:head# 2024-04-01T19:56:56.754 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.754 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:909f29d8:::benchmark_data_smithi188_161190_object38668:head# 2024-04-01T19:56:56.754 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.754 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:909f9eaf:::benchmark_data_smithi188_161190_object23472:head# 2024-04-01T19:56:56.754 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.754 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90a07019:::benchmark_data_smithi188_161190_object137923:head# 2024-04-01T19:56:56.754 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.754 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90a0c3c9:::benchmark_data_smithi188_161190_object51840:head# 2024-04-01T19:56:56.754 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.754 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90a12bba:::benchmark_data_smithi188_161190_object119939:head# 2024-04-01T19:56:56.754 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.754 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90a2d033:::benchmark_data_smithi188_161190_object55049:head# 2024-04-01T19:56:56.754 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.754 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90a2f346:::benchmark_data_smithi188_161190_object77443:head# 2024-04-01T19:56:56.754 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.755 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90a33e2c:::benchmark_data_smithi188_161190_object42416:head# 2024-04-01T19:56:56.755 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.755 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90a3494d:::benchmark_data_smithi188_161190_object90199:head# 2024-04-01T19:56:56.755 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.755 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90a38ffd:::benchmark_data_smithi188_161190_object51581:head# 2024-04-01T19:56:56.755 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.755 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90a3b693:::benchmark_data_smithi188_161190_object53885:head# 2024-04-01T19:56:56.755 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.755 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90a3c6e1:::benchmark_data_smithi188_161190_object20122:head# 2024-04-01T19:56:56.755 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.755 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90a40d1e:::benchmark_data_smithi188_161190_object74901:head# 2024-04-01T19:56:56.755 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.755 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90a5c0ac:::benchmark_data_smithi188_161190_object134672:head# 2024-04-01T19:56:56.755 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.755 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90a5da84:::benchmark_data_smithi188_161190_object108244:head# 2024-04-01T19:56:56.755 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.756 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90a5f89c:::benchmark_data_smithi188_161190_object39624:head# 2024-04-01T19:56:56.756 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.756 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90a6a70f:::benchmark_data_smithi188_161190_object123229:head# 2024-04-01T19:56:56.756 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.756 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90a741e8:::benchmark_data_smithi188_161190_object120173:head# 2024-04-01T19:56:56.756 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.757 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90a78a13:::benchmark_data_smithi188_161190_object129962:head# 2024-04-01T19:56:56.757 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.757 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90a79f12:::benchmark_data_smithi188_161190_object106620:head# 2024-04-01T19:56:56.757 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.757 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90a8036b:::benchmark_data_smithi188_161190_object37509:head# 2024-04-01T19:56:56.757 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.758 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90a863b8:::benchmark_data_smithi188_161190_object60861:head# 2024-04-01T19:56:56.758 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.758 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90a8c836:::benchmark_data_smithi188_161190_object57883:head# 2024-04-01T19:56:56.758 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.758 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90a9f641:::benchmark_data_smithi188_161190_object37254:head# 2024-04-01T19:56:56.758 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.758 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90ac1246:::benchmark_data_smithi188_161190_object47040:head# 2024-04-01T19:56:56.758 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.761 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90ac1da0:::benchmark_data_smithi188_161190_object103790:head# 2024-04-01T19:56:56.761 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.761 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90ac2b3d:::benchmark_data_smithi188_161190_object111870:head# 2024-04-01T19:56:56.761 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.761 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90ada25e:::benchmark_data_smithi188_161190_object94932:head# 2024-04-01T19:56:56.761 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.763 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90adb63f:::benchmark_data_smithi188_161190_object72209:head# 2024-04-01T19:56:56.763 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.763 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90adfb54:::benchmark_data_smithi188_161190_object90688:head# 2024-04-01T19:56:56.763 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.763 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90ae1102:::benchmark_data_smithi188_161190_object110632:head# 2024-04-01T19:56:56.763 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.763 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90ae3b80:::benchmark_data_smithi188_161190_object77600:head# 2024-04-01T19:56:56.764 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.764 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90b01743:::benchmark_data_smithi188_161190_object108484:head# 2024-04-01T19:56:56.764 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.764 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90b0b94f:::benchmark_data_smithi188_161190_object50138:head# 2024-04-01T19:56:56.764 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.764 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90b1c450:::benchmark_data_smithi188_161190_object46848:head# 2024-04-01T19:56:56.764 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.764 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90b47b39:::benchmark_data_smithi188_161190_object81497:head# 2024-04-01T19:56:56.764 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.764 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90b47d05:::benchmark_data_smithi188_161190_object75731:head# 2024-04-01T19:56:56.764 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.766 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90b4f466:::benchmark_data_smithi188_161190_object40241:head# 2024-04-01T19:56:56.766 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.766 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90b5fb6b:::benchmark_data_smithi188_161190_object39295:head# 2024-04-01T19:56:56.766 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.766 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90b63ed5:::benchmark_data_smithi188_161190_object137836:head# 2024-04-01T19:56:56.766 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.766 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90b65806:::benchmark_data_smithi188_161190_object127346:head# 2024-04-01T19:56:56.766 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.766 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90b6dbb1:::benchmark_data_smithi188_161190_object73078:head# 2024-04-01T19:56:56.766 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.766 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90b78fed:::benchmark_data_smithi188_161190_object86787:head# 2024-04-01T19:56:56.766 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.767 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90b793f3:::benchmark_data_smithi188_161190_object39644:head# 2024-04-01T19:56:56.767 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.767 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90b7a7ab:::benchmark_data_smithi188_161190_object56950:head# 2024-04-01T19:56:56.767 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.767 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90b7eb0a:::benchmark_data_smithi188_161190_object38589:head# 2024-04-01T19:56:56.767 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.767 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90b7f583:::benchmark_data_smithi188_161190_object35808:head# 2024-04-01T19:56:56.767 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.769 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90b97bf2:::benchmark_data_smithi188_161190_object66077:head# 2024-04-01T19:56:56.769 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.769 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90b9a0a4:::benchmark_data_smithi188_161190_object63717:head# 2024-04-01T19:56:56.770 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.770 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90bab865:::benchmark_data_smithi188_161190_object101021:head# 2024-04-01T19:56:56.770 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.770 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90bb0f31:::benchmark_data_smithi188_161190_object92827:head# 2024-04-01T19:56:56.770 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.770 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90bbab26:::benchmark_data_smithi188_161190_object116892:head# 2024-04-01T19:56:56.770 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.770 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90bbc084:::benchmark_data_smithi188_161190_object47550:head# 2024-04-01T19:56:56.770 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.770 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90be7a1a:::benchmark_data_smithi188_161190_object63743:head# 2024-04-01T19:56:56.770 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.770 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90bf2be2:::benchmark_data_smithi188_161190_object41276:head# 2024-04-01T19:56:56.771 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.771 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90bfc4bc:::benchmark_data_smithi188_161190_object133812:head# 2024-04-01T19:56:56.771 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.771 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90c07901:::benchmark_data_smithi188_161190_object71322:head# 2024-04-01T19:56:56.771 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.771 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90c137f2:::benchmark_data_smithi188_161190_object138603:head# 2024-04-01T19:56:56.771 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.771 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90c3476e:::benchmark_data_smithi188_161190_object41098:head# 2024-04-01T19:56:56.771 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.771 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90c4d0b6:::benchmark_data_smithi188_161190_object99846:head# 2024-04-01T19:56:56.771 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.771 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90c5357d:::benchmark_data_smithi188_161190_object40197:head# 2024-04-01T19:56:56.771 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.772 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90c60119:::benchmark_data_smithi188_161190_object123228:head# 2024-04-01T19:56:56.773 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.773 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90c84455:::benchmark_data_smithi188_161190_object101064:head# 2024-04-01T19:56:56.773 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.773 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90c88521:::benchmark_data_smithi188_161190_object53107:head# 2024-04-01T19:56:56.773 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.773 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90c911e5:::benchmark_data_smithi188_161190_object101534:head# 2024-04-01T19:56:56.773 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.773 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90c91ca1:::benchmark_data_smithi188_161190_object81090:head# 2024-04-01T19:56:56.773 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.773 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90caac46:::benchmark_data_smithi188_161190_object83416:head# 2024-04-01T19:56:56.773 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.773 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90cb0a6c:::benchmark_data_smithi188_161190_object95960:head# 2024-04-01T19:56:56.773 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.774 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90cb5b2d:::benchmark_data_smithi188_161190_object43923:head# 2024-04-01T19:56:56.774 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.774 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90cb87a3:::benchmark_data_smithi188_161190_object94137:head# 2024-04-01T19:56:56.774 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.774 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90cd09fe:::benchmark_data_smithi188_161190_object102457:head# 2024-04-01T19:56:56.774 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.774 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90cd4e3b:::benchmark_data_smithi188_161190_object78943:head# 2024-04-01T19:56:56.774 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.774 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90ce313e:::benchmark_data_smithi188_161190_object83961:head# 2024-04-01T19:56:56.775 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.775 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90cf6f4f:::benchmark_data_smithi188_161190_object20803:head# 2024-04-01T19:56:56.775 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.775 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90cf7f4b:::benchmark_data_smithi188_161190_object134495:head# 2024-04-01T19:56:56.775 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.777 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90d0317e:::benchmark_data_smithi188_161190_object138716:head# 2024-04-01T19:56:56.777 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.777 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90d0faa7:::benchmark_data_smithi188_161190_object65259:head# 2024-04-01T19:56:56.778 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.778 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90d173e5:::benchmark_data_smithi188_161190_object106485:head# 2024-04-01T19:56:56.778 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.778 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90d2999c:::benchmark_data_smithi188_161190_object38678:head# 2024-04-01T19:56:56.778 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.779 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90d343c9:::benchmark_data_smithi188_161190_object79594:head# 2024-04-01T19:56:56.779 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90d39639:::benchmark_data_smithi188_161190_object51969:head# 2024-04-01T19:56:56.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90d4b68a:::benchmark_data_smithi188_161190_object60305:head# 2024-04-01T19:56:56.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90d4c917:::benchmark_data_smithi188_161190_object56527:head# 2024-04-01T19:56:56.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90d4e401:::benchmark_data_smithi188_161190_object49449:head# 2024-04-01T19:56:56.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90d4f518:::benchmark_data_smithi188_161190_object22637:head# 2024-04-01T19:56:56.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90d534f9:::benchmark_data_smithi188_161190_object44848:head# 2024-04-01T19:56:56.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90d56829:::benchmark_data_smithi188_161190_object40767:head# 2024-04-01T19:56:56.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.782 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90d67baa:::benchmark_data_smithi188_161190_object117660:head# 2024-04-01T19:56:56.782 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.782 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90d6d2a2:::benchmark_data_smithi188_161190_object79225:head# 2024-04-01T19:56:56.782 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.782 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90d76809:::benchmark_data_smithi188_161190_object77488:head# 2024-04-01T19:56:56.782 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.782 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90d7bde0:::benchmark_data_smithi188_161190_object126700:head# 2024-04-01T19:56:56.782 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.783 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90d7fec7:::benchmark_data_smithi188_161190_object111857:head# 2024-04-01T19:56:56.783 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.783 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90d8050e:::benchmark_data_smithi188_161190_object97760:head# 2024-04-01T19:56:56.783 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.783 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90d9b5b5:::benchmark_data_smithi188_161190_object98348:head# 2024-04-01T19:56:56.783 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.783 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90da53b9:::benchmark_data_smithi188_161190_object93707:head# 2024-04-01T19:56:56.783 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.783 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90dab035:::benchmark_data_smithi188_161190_object27008:head# 2024-04-01T19:56:56.783 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.786 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90db01fb:::benchmark_data_smithi188_161190_object62843:head# 2024-04-01T19:56:56.786 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.786 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90dbbafb:::benchmark_data_smithi188_161190_object127163:head# 2024-04-01T19:56:56.786 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.786 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90dc9a86:::benchmark_data_smithi188_161190_object95820:head# 2024-04-01T19:56:56.786 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.786 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90dccc84:::benchmark_data_smithi188_161190_object116539:head# 2024-04-01T19:56:56.786 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.786 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90dd3e15:::benchmark_data_smithi188_161190_object82042:head# 2024-04-01T19:56:56.786 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.786 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90dd5370:::benchmark_data_smithi188_161190_object45353:head# 2024-04-01T19:56:56.786 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.786 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90dd5743:::benchmark_data_smithi188_161190_object73840:head# 2024-04-01T19:56:56.787 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.787 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90ddbdb0:::benchmark_data_smithi188_161190_object119139:head# 2024-04-01T19:56:56.787 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.787 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90df3459:::benchmark_data_smithi188_161190_object49388:head# 2024-04-01T19:56:56.787 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.787 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90e014ea:::benchmark_data_smithi188_161190_object30095:head# 2024-04-01T19:56:56.787 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.787 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90e016e3:::benchmark_data_smithi188_161190_object67676:head# 2024-04-01T19:56:56.787 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.787 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90e03151:::benchmark_data_smithi188_161190_object120704:head# 2024-04-01T19:56:56.787 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.787 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90e0a10f:::benchmark_data_smithi188_161190_object77667:head# 2024-04-01T19:56:56.787 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.787 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90e0bca7:::benchmark_data_smithi188_161190_object70461:head# 2024-04-01T19:56:56.787 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.790 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90e343fe:::benchmark_data_smithi188_161190_object29341:head# 2024-04-01T19:56:56.790 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.790 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90e3e0d5:::benchmark_data_smithi188_161190_object64701:head# 2024-04-01T19:56:56.790 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.791 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90e41200:::benchmark_data_smithi188_161190_object137059:head# 2024-04-01T19:56:56.791 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.791 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90e43352:::benchmark_data_smithi188_161190_object73952:head# 2024-04-01T19:56:56.791 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.791 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90e534f8:::benchmark_data_smithi188_161190_object98540:head# 2024-04-01T19:56:56.791 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.791 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90e627d8:::benchmark_data_smithi188_161190_object115376:head# 2024-04-01T19:56:56.791 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.791 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90e62f6e:::benchmark_data_smithi188_161190_object40194:head# 2024-04-01T19:56:56.791 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.791 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90e77d5b:::benchmark_data_smithi188_161190_object39028:head# 2024-04-01T19:56:56.791 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.791 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90e7b9b5:::benchmark_data_smithi188_161190_object90806:head# 2024-04-01T19:56:56.791 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.792 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90e88f6c:::benchmark_data_smithi188_161190_object106588:head# 2024-04-01T19:56:56.792 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.792 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90e8c92b:::benchmark_data_smithi188_161190_object29076:head# 2024-04-01T19:56:56.792 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.792 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90e9efcf:::benchmark_data_smithi188_161190_object46295:head# 2024-04-01T19:56:56.792 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.792 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90ea612f:::benchmark_data_smithi188_161190_object38862:head# 2024-04-01T19:56:56.792 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.792 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90ead16f:::benchmark_data_smithi188_161190_object84989:head# 2024-04-01T19:56:56.792 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.792 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90eafd77:::benchmark_data_smithi188_161190_object100322:head# 2024-04-01T19:56:56.792 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.792 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90ecad9d:::benchmark_data_smithi188_161190_object137593:head# 2024-04-01T19:56:56.792 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.792 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90ed2da6:::benchmark_data_smithi188_161190_object138000:head# 2024-04-01T19:56:56.793 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.795 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90ed2eb9:::benchmark_data_smithi188_161190_object122208:head# 2024-04-01T19:56:56.795 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.796 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90ed788f:::benchmark_data_smithi188_161190_object24428:head# 2024-04-01T19:56:56.796 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.796 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90ed7cba:::benchmark_data_smithi188_161190_object36833:head# 2024-04-01T19:56:56.796 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.796 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90edcef5:::benchmark_data_smithi188_161190_object104657:head# 2024-04-01T19:56:56.796 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.796 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90edd38d:::benchmark_data_smithi188_161190_object109098:head# 2024-04-01T19:56:56.796 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.796 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90ee9449:::benchmark_data_smithi188_161190_object65357:head# 2024-04-01T19:56:56.796 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.796 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90ef22c4:::benchmark_data_smithi188_161190_object119749:head# 2024-04-01T19:56:56.796 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.796 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90ef40ef:::benchmark_data_smithi188_161190_object118398:head# 2024-04-01T19:56:56.796 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.796 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90f032f1:::benchmark_data_smithi188_161190_object105434:head# 2024-04-01T19:56:56.797 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.797 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90f2178a:::benchmark_data_smithi188_161190_object60468:head# 2024-04-01T19:56:56.797 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.797 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90f2614e:::benchmark_data_smithi188_161190_object25806:head# 2024-04-01T19:56:56.797 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.797 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90f291fb:::benchmark_data_smithi188_161190_object117228:head# 2024-04-01T19:56:56.797 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.797 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90f2f461:::benchmark_data_smithi188_161190_object30619:head# 2024-04-01T19:56:56.797 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.797 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90f33d92:::benchmark_data_smithi188_161190_object119570:head# 2024-04-01T19:56:56.797 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.797 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90f3ca5b:::benchmark_data_smithi188_161190_object121722:head# 2024-04-01T19:56:56.797 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.797 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90f3cea8:::benchmark_data_smithi188_161190_object124613:head# 2024-04-01T19:56:56.797 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.798 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90f59745:::benchmark_data_smithi188_161190_object69516:head# 2024-04-01T19:56:56.798 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.798 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90f5ad3f:::benchmark_data_smithi188_161190_object39254:head# 2024-04-01T19:56:56.798 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.798 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90f5f8a1:::benchmark_data_smithi188_161190_object115097:head# 2024-04-01T19:56:56.798 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.801 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90f5ff75:::benchmark_data_smithi188_161190_object81867:head# 2024-04-01T19:56:56.801 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.801 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90f649b0:::benchmark_data_smithi188_161190_object24828:head# 2024-04-01T19:56:56.801 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.801 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90f6afbd:::benchmark_data_smithi188_161190_object105548:head# 2024-04-01T19:56:56.801 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.801 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90f6da23:::benchmark_data_smithi188_161190_object76580:head# 2024-04-01T19:56:56.801 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.801 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90f6e422:::benchmark_data_smithi188_161190_object127427:head# 2024-04-01T19:56:56.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.802 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90f95712:::benchmark_data_smithi188_161190_object123371:head# 2024-04-01T19:56:56.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.802 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90f9f2cf:::benchmark_data_smithi188_161190_object31047:head# 2024-04-01T19:56:56.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.802 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90fbfdc0:::benchmark_data_smithi188_161190_object63863:head# 2024-04-01T19:56:56.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.802 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90fc1089:::benchmark_data_smithi188_161190_object37319:head# 2024-04-01T19:56:56.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.802 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90fc13c1:::benchmark_data_smithi188_161190_object20269:head# 2024-04-01T19:56:56.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.802 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90fc6309:::benchmark_data_smithi188_161190_object102363:head# 2024-04-01T19:56:56.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.802 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90fcee04:::benchmark_data_smithi188_161190_object108583:head# 2024-04-01T19:56:56.803 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.803 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90fd4ad7:::benchmark_data_smithi188_161190_object63534:head# 2024-04-01T19:56:56.803 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.803 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90fd6d8a:::benchmark_data_smithi188_161190_object84694:head# 2024-04-01T19:56:56.803 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.803 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90fe1580:::benchmark_data_smithi188_161190_object55468:head# 2024-04-01T19:56:56.803 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.803 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90fef0dd:::benchmark_data_smithi188_161190_object89801:head# 2024-04-01T19:56:56.803 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.803 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90ff553b:::benchmark_data_smithi188_161190_object61889:head# 2024-04-01T19:56:56.803 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.803 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90ffa713:::benchmark_data_smithi188_161190_object91344:head# 2024-04-01T19:56:56.803 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.803 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90ffcc68:::benchmark_data_smithi188_161190_object88331:head# 2024-04-01T19:56:56.803 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.804 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90fff33a:::benchmark_data_smithi188_161190_object37368:head# 2024-04-01T19:56:56.804 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.808 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:90fff774:::benchmark_data_smithi188_161190_object65963:head# 2024-04-01T19:56:56.808 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.808 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9100b883:::benchmark_data_smithi188_161190_object27618:head# 2024-04-01T19:56:56.808 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.808 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9101ae0e:::benchmark_data_smithi188_161190_object51808:head# 2024-04-01T19:56:56.808 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.808 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9101e801:::benchmark_data_smithi188_161190_object57434:head# 2024-04-01T19:56:56.808 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.808 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91029411:::benchmark_data_smithi188_161190_object86050:head# 2024-04-01T19:56:56.808 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.809 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9103ed14:::benchmark_data_smithi188_161190_object92913:head# 2024-04-01T19:56:56.809 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.809 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91040d1d:::benchmark_data_smithi188_161190_object117539:head# 2024-04-01T19:56:56.809 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.809 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91056d77:::benchmark_data_smithi188_161190_object95094:head# 2024-04-01T19:56:56.809 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.809 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9105a0ca:::benchmark_data_smithi188_161190_object84954:head# 2024-04-01T19:56:56.809 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.809 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9105a6b1:::benchmark_data_smithi188_161190_object86711:head# 2024-04-01T19:56:56.809 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.809 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9105e187:::benchmark_data_smithi188_161190_object22366:head# 2024-04-01T19:56:56.809 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.809 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9105f743:::benchmark_data_smithi188_161190_object101504:head# 2024-04-01T19:56:56.809 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.810 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:910600e4:::benchmark_data_smithi188_161190_object79515:head# 2024-04-01T19:56:56.810 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.810 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91066acd:::benchmark_data_smithi188_161190_object41789:head# 2024-04-01T19:56:56.810 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.810 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91066c2e:::benchmark_data_smithi188_161190_object92821:head# 2024-04-01T19:56:56.810 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.810 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9106f705:::benchmark_data_smithi188_161190_object98999:head# 2024-04-01T19:56:56.810 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.810 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91078300:::benchmark_data_smithi188_161190_object131524:head# 2024-04-01T19:56:56.810 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.810 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9107908e:::benchmark_data_smithi188_161190_object69317:head# 2024-04-01T19:56:56.810 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.810 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9107b111:::benchmark_data_smithi188_161190_object24985:head# 2024-04-01T19:56:56.811 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.811 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91082b5d:::benchmark_data_smithi188_161190_object97353:head# 2024-04-01T19:56:56.811 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.811 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9109d2a4:::benchmark_data_smithi188_161190_object130234:head# 2024-04-01T19:56:56.811 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.811 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:910a77b3:::benchmark_data_smithi188_161190_object130219:head# 2024-04-01T19:56:56.811 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.811 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:910a7f68:::benchmark_data_smithi188_161190_object100198:head# 2024-04-01T19:56:56.811 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.811 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:910af0d1:::benchmark_data_smithi188_161190_object124715:head# 2024-04-01T19:56:56.811 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.811 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:910b0b44:::benchmark_data_smithi188_161190_object138110:head# 2024-04-01T19:56:56.811 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.811 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:910b32a6:::benchmark_data_smithi188_161190_object121988:head# 2024-04-01T19:56:56.811 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.811 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:910b5b4a:::benchmark_data_smithi188_161190_object97914:head# 2024-04-01T19:56:56.812 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.812 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:910b6e98:::benchmark_data_smithi188_161190_object121173:head# 2024-04-01T19:56:56.812 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.815 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:910bbc60:::benchmark_data_smithi188_161190_object37850:head# 2024-04-01T19:56:56.815 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.815 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:910beb33:::benchmark_data_smithi188_161190_object75861:head# 2024-04-01T19:56:56.815 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.815 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:910c5956:::benchmark_data_smithi188_161190_object85042:head# 2024-04-01T19:56:56.815 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.815 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:910d1ce2:::benchmark_data_smithi188_161190_object56942:head# 2024-04-01T19:56:56.815 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.815 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:910d3ba2:::benchmark_data_smithi188_161190_object76546:head# 2024-04-01T19:56:56.816 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.816 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:910dc3cf:::benchmark_data_smithi188_161190_object87799:head# 2024-04-01T19:56:56.816 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.816 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:910e432d:::benchmark_data_smithi188_161190_object100616:head# 2024-04-01T19:56:56.816 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.816 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:910e4c82:::benchmark_data_smithi188_161190_object129744:head# 2024-04-01T19:56:56.816 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.816 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91100ce3:::benchmark_data_smithi188_161190_object86173:head# 2024-04-01T19:56:56.816 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.816 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9111d684:::benchmark_data_smithi188_161190_object97683:head# 2024-04-01T19:56:56.816 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.816 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91125e68:::benchmark_data_smithi188_161190_object57216:head# 2024-04-01T19:56:56.817 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.817 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:911260ad:::benchmark_data_smithi188_161190_object56178:head# 2024-04-01T19:56:56.817 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.817 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91130e36:::benchmark_data_smithi188_161190_object84076:head# 2024-04-01T19:56:56.817 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.817 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9113989b:::benchmark_data_smithi188_161190_object125417:head# 2024-04-01T19:56:56.817 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.817 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9113d049:::benchmark_data_smithi188_161190_object116246:head# 2024-04-01T19:56:56.817 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.817 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9113e6b4:::benchmark_data_smithi188_161190_object130255:head# 2024-04-01T19:56:56.817 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.817 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9114999e:::benchmark_data_smithi188_161190_object124766:head# 2024-04-01T19:56:56.817 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.818 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9114ca97:::benchmark_data_smithi188_161190_object56361:head# 2024-04-01T19:56:56.818 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.818 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91153adf:::benchmark_data_smithi188_161190_object50886:head# 2024-04-01T19:56:56.818 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.818 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9115a146:::benchmark_data_smithi188_161190_object38810:head# 2024-04-01T19:56:56.818 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.818 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9115fd24:::benchmark_data_smithi188_161190_object103169:head# 2024-04-01T19:56:56.818 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.818 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9116b57f:::benchmark_data_smithi188_161190_object88586:head# 2024-04-01T19:56:56.818 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.819 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:911734da:::benchmark_data_smithi188_161190_object42607:head# 2024-04-01T19:56:56.819 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.819 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91174e22:::benchmark_data_smithi188_161190_object121555:head# 2024-04-01T19:56:56.819 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.819 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9117798f:::benchmark_data_smithi188_161190_object93428:head# 2024-04-01T19:56:56.819 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.825 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9117cc66:::benchmark_data_smithi188_161190_object78733:head# 2024-04-01T19:56:56.825 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9117d337:::benchmark_data_smithi188_161190_object121365:head# 2024-04-01T19:56:56.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91189029:::benchmark_data_smithi188_161190_object100872:head# 2024-04-01T19:56:56.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:911964e1:::benchmark_data_smithi188_161190_object112221:head# 2024-04-01T19:56:56.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91197b72:::benchmark_data_smithi188_161190_object65549:head# 2024-04-01T19:56:56.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9119934d:::benchmark_data_smithi188_161190_object70066:head# 2024-04-01T19:56:56.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:911a18d7:::benchmark_data_smithi188_161190_object41888:head# 2024-04-01T19:56:56.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:911b6979:::benchmark_data_smithi188_161190_object98253:head# 2024-04-01T19:56:56.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.827 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:911c3552:::benchmark_data_smithi188_161190_object129408:head# 2024-04-01T19:56:56.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.827 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:911cb339:::benchmark_data_smithi188_161190_object132762:head# 2024-04-01T19:56:56.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.827 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:911cda92:::benchmark_data_smithi188_161190_object37156:head# 2024-04-01T19:56:56.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.827 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:911df885:::benchmark_data_smithi188_161190_object77141:head# 2024-04-01T19:56:56.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.827 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:911e7d40:::benchmark_data_smithi188_161190_object74840:head# 2024-04-01T19:56:56.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.827 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:911eae2f:::benchmark_data_smithi188_161190_object128234:head# 2024-04-01T19:56:56.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.828 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:911eea2c:::benchmark_data_smithi188_161190_object91326:head# 2024-04-01T19:56:56.828 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.828 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:911fe448:::benchmark_data_smithi188_161190_object41377:head# 2024-04-01T19:56:56.828 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.828 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:911ff5d1:::benchmark_data_smithi188_161190_object109882:head# 2024-04-01T19:56:56.828 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.828 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9121b869:::benchmark_data_smithi188_161190_object41972:head# 2024-04-01T19:56:56.828 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.828 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9121ed48:::benchmark_data_smithi188_161190_object116496:head# 2024-04-01T19:56:56.828 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.828 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91228666:::benchmark_data_smithi188_161190_object81920:head# 2024-04-01T19:56:56.828 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.828 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9122b0a8:::benchmark_data_smithi188_161190_object39125:head# 2024-04-01T19:56:56.829 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.829 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:912361a6:::benchmark_data_smithi188_161190_object79351:head# 2024-04-01T19:56:56.829 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.829 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9123c782:::benchmark_data_smithi188_161190_object71630:head# 2024-04-01T19:56:56.829 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.829 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9125bb09:::benchmark_data_smithi188_161190_object42425:head# 2024-04-01T19:56:56.829 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.829 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91263a27:::benchmark_data_smithi188_161190_object95649:head# 2024-04-01T19:56:56.829 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.829 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91272c9e:::benchmark_data_smithi188_161190_object81080:head# 2024-04-01T19:56:56.829 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.829 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9127a7d2:::benchmark_data_smithi188_161190_object29755:head# 2024-04-01T19:56:56.829 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:912862aa:::benchmark_data_smithi188_161190_object29170:head# 2024-04-01T19:56:56.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:912993ce:::benchmark_data_smithi188_161190_object120276:head# 2024-04-01T19:56:56.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:912acb9f:::benchmark_data_smithi188_161190_object29149:head# 2024-04-01T19:56:56.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:912adfe6:::benchmark_data_smithi188_161190_object103319:head# 2024-04-01T19:56:56.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:912b30e0:::benchmark_data_smithi188_161190_object65095:head# 2024-04-01T19:56:56.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:912c22f3:::benchmark_data_smithi188_161190_object82139:head# 2024-04-01T19:56:56.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:912d0bf9:::benchmark_data_smithi188_161190_object127343:head# 2024-04-01T19:56:56.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:912dbcbb:::benchmark_data_smithi188_161190_object69378:head# 2024-04-01T19:56:56.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:912f0772:::benchmark_data_smithi188_161190_object34671:head# 2024-04-01T19:56:56.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91303bcf:::benchmark_data_smithi188_161190_object53846:head# 2024-04-01T19:56:56.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91309169:::benchmark_data_smithi188_161190_object49344:head# 2024-04-01T19:56:56.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91313fef:::benchmark_data_smithi188_161190_object111519:head# 2024-04-01T19:56:56.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9131f9a2:::benchmark_data_smithi188_161190_object115205:head# 2024-04-01T19:56:56.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.832 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9132831a:::benchmark_data_smithi188_161190_object46767:head# 2024-04-01T19:56:56.832 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.834 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9133c2e7:::benchmark_data_smithi188_161190_object136472:head# 2024-04-01T19:56:56.834 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.834 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9133ea1e:::benchmark_data_smithi188_161190_object118902:head# 2024-04-01T19:56:56.834 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.834 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91345c13:::benchmark_data_smithi188_161190_object72965:head# 2024-04-01T19:56:56.834 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.834 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91349ddd:::benchmark_data_smithi188_161190_object134429:head# 2024-04-01T19:56:56.834 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.834 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9134d885:::benchmark_data_smithi188_161190_object30943:head# 2024-04-01T19:56:56.834 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.835 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9135379e:::benchmark_data_smithi188_161190_object57134:head# 2024-04-01T19:56:56.835 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.835 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91362b1a:::benchmark_data_smithi188_161190_object89504:head# 2024-04-01T19:56:56.835 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.835 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9136782e:::benchmark_data_smithi188_161190_object42742:head# 2024-04-01T19:56:56.835 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.835 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91370847:::benchmark_data_smithi188_161190_object39042:head# 2024-04-01T19:56:56.835 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.835 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9138867e:::benchmark_data_smithi188_161190_object71985:head# 2024-04-01T19:56:56.835 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.835 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9139406b:::benchmark_data_smithi188_161190_object98909:head# 2024-04-01T19:56:56.835 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.835 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:913980a8:::benchmark_data_smithi188_161190_object103263:head# 2024-04-01T19:56:56.835 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.836 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9139c339:::benchmark_data_smithi188_161190_object53582:head# 2024-04-01T19:56:56.836 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.836 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:913be3c9:::benchmark_data_smithi188_161190_object51626:head# 2024-04-01T19:56:56.836 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.837 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:913c9e62:::benchmark_data_smithi188_161190_object43794:head# 2024-04-01T19:56:56.837 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.837 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:913cacbc:::benchmark_data_smithi188_161190_object48913:head# 2024-04-01T19:56:56.837 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.837 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:913cc0a6:::benchmark_data_smithi188_161190_object95362:head# 2024-04-01T19:56:56.837 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.837 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:913d6245:::benchmark_data_smithi188_161190_object71533:head# 2024-04-01T19:56:56.837 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.837 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:913d630a:::benchmark_data_smithi188_161190_object76003:head# 2024-04-01T19:56:56.837 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.837 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:913d7152:::benchmark_data_smithi188_161190_object119739:head# 2024-04-01T19:56:56.837 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.837 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:913de72d:::benchmark_data_smithi188_161190_object79771:head# 2024-04-01T19:56:56.838 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.838 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:913e2ff5:::benchmark_data_smithi188_161190_object72331:head# 2024-04-01T19:56:56.838 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.838 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:913e78af:::benchmark_data_smithi188_161190_object113958:head# 2024-04-01T19:56:56.838 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.838 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:913ed14b:::benchmark_data_smithi188_161190_object104622:head# 2024-04-01T19:56:56.838 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.838 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:913fc56f:::benchmark_data_smithi188_161190_object86933:head# 2024-04-01T19:56:56.838 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.838 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91401a0c:::benchmark_data_smithi188_161190_object80728:head# 2024-04-01T19:56:56.838 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.838 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91406a4e:::benchmark_data_smithi188_161190_object41809:head# 2024-04-01T19:56:56.838 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.838 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9141e2bf:::benchmark_data_smithi188_161190_object56946:head# 2024-04-01T19:56:56.838 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.839 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91422e1b:::benchmark_data_smithi188_161190_object58148:head# 2024-04-01T19:56:56.839 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.839 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9142363e:::benchmark_data_smithi188_161190_object117981:head# 2024-04-01T19:56:56.839 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.839 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9142a00f:::benchmark_data_smithi188_161190_object61505:head# 2024-04-01T19:56:56.839 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.839 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91432265:::benchmark_data_smithi188_161190_object71694:head# 2024-04-01T19:56:56.840 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.840 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9144d006:::benchmark_data_smithi188_161190_object42717:head# 2024-04-01T19:56:56.840 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.840 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91452424:::benchmark_data_smithi188_161190_object22684:head# 2024-04-01T19:56:56.840 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.844 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9145e09d:::benchmark_data_smithi188_161190_object134701:head# 2024-04-01T19:56:56.844 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.845 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:914637b9:::benchmark_data_smithi188_161190_object19963:head# 2024-04-01T19:56:56.845 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.845 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91466f1e:::benchmark_data_smithi188_161190_object93737:head# 2024-04-01T19:56:56.845 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.845 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91469cc4:::benchmark_data_smithi188_161190_object76801:head# 2024-04-01T19:56:56.845 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.846 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9148e61d:::benchmark_data_smithi188_161190_object65268:head# 2024-04-01T19:56:56.846 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.846 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:914a42ac:::benchmark_data_smithi188_161190_object136180:head# 2024-04-01T19:56:56.846 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.846 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:914adc2b:::benchmark_data_smithi188_161190_object23464:head# 2024-04-01T19:56:56.846 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.846 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:914b651d:::benchmark_data_smithi188_161190_object130630:head# 2024-04-01T19:56:56.846 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.847 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:914b8a57:::benchmark_data_smithi188_161190_object20458:head# 2024-04-01T19:56:56.847 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.847 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:914bdde9:::benchmark_data_smithi188_161190_object134597:head# 2024-04-01T19:56:56.847 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.848 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:914e60c8:::benchmark_data_smithi188_161190_object52056:head# 2024-04-01T19:56:56.848 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.848 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:914f7b3c:::benchmark_data_smithi188_161190_object26555:head# 2024-04-01T19:56:56.848 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.848 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:914f9d2f:::benchmark_data_smithi188_161190_object118798:head# 2024-04-01T19:56:56.848 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.848 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:914fa7ce:::benchmark_data_smithi188_161190_object84725:head# 2024-04-01T19:56:56.848 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:914fc0d7:::benchmark_data_smithi188_161190_object136268:head# 2024-04-01T19:56:56.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91500d08:::benchmark_data_smithi188_161190_object98608:head# 2024-04-01T19:56:56.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:915067c5:::benchmark_data_smithi188_161190_object129167:head# 2024-04-01T19:56:56.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9150cfb6:::benchmark_data_smithi188_161190_object88474:head# 2024-04-01T19:56:56.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9150f0b0:::benchmark_data_smithi188_161190_object74556:head# 2024-04-01T19:56:56.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91510783:::benchmark_data_smithi188_161190_object86506:head# 2024-04-01T19:56:56.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91517729:::benchmark_data_smithi188_161190_object112893:head# 2024-04-01T19:56:56.851 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.852 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9153b06a:::benchmark_data_smithi188_161190_object55214:head# 2024-04-01T19:56:56.852 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.852 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9153d1f9:::benchmark_data_smithi188_161190_object47984:head# 2024-04-01T19:56:56.853 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.853 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:915572e2:::benchmark_data_smithi188_161190_object45260:head# 2024-04-01T19:56:56.853 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.853 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9156286c:::benchmark_data_smithi188_161190_object56323:head# 2024-04-01T19:56:56.853 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.853 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91566a3f:::benchmark_data_smithi188_161190_object128395:head# 2024-04-01T19:56:56.853 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.853 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9156bfa0:::benchmark_data_smithi188_161190_object136607:head# 2024-04-01T19:56:56.853 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.853 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9156cc52:::benchmark_data_smithi188_161190_object123219:head# 2024-04-01T19:56:56.853 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.853 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9156f1cb:::benchmark_data_smithi188_161190_object118166:head# 2024-04-01T19:56:56.853 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.853 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9157a873:::benchmark_data_smithi188_161190_object90671:head# 2024-04-01T19:56:56.854 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.854 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9157b23d:::benchmark_data_smithi188_161190_object56723:head# 2024-04-01T19:56:56.854 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.854 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9157ddb3:::benchmark_data_smithi188_161190_object51082:head# 2024-04-01T19:56:56.854 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91581aef:::benchmark_data_smithi188_161190_object66774:head# 2024-04-01T19:56:56.855 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:915861d9:::benchmark_data_smithi188_161190_object77759:head# 2024-04-01T19:56:56.855 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9158e784:::benchmark_data_smithi188_161190_object76757:head# 2024-04-01T19:56:56.855 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9159ae6c:::benchmark_data_smithi188_161190_object130498:head# 2024-04-01T19:56:56.855 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9159b006:::benchmark_data_smithi188_161190_object47054:head# 2024-04-01T19:56:56.855 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9159ce7c:::benchmark_data_smithi188_161190_object118631:head# 2024-04-01T19:56:56.856 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.856 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:915a9ccf:::benchmark_data_smithi188_161190_object98866:head# 2024-04-01T19:56:56.856 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.857 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:915a9fb9:::benchmark_data_smithi188_161190_object26426:head# 2024-04-01T19:56:56.857 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.857 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:915af76e:::benchmark_data_smithi188_161190_object102109:head# 2024-04-01T19:56:56.857 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.857 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:915c13b4:::benchmark_data_smithi188_161190_object135504:head# 2024-04-01T19:56:56.857 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.857 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:915c567c:::benchmark_data_smithi188_161190_object90419:head# 2024-04-01T19:56:56.857 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.857 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:915cd69b:::benchmark_data_smithi188_161190_object70467:head# 2024-04-01T19:56:56.857 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.858 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:915cf149:::benchmark_data_smithi188_161190_object129064:head# 2024-04-01T19:56:56.858 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.858 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:915d66a5:::benchmark_data_smithi188_161190_object94874:head# 2024-04-01T19:56:56.858 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.858 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:915e750b:::benchmark_data_smithi188_161190_object137885:head# 2024-04-01T19:56:56.858 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.858 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91614817:::benchmark_data_smithi188_161190_object91351:head# 2024-04-01T19:56:56.858 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.859 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91615507:::benchmark_data_smithi188_161190_object99326:head# 2024-04-01T19:56:56.859 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.859 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91634639:::benchmark_data_smithi188_161190_object35170:head# 2024-04-01T19:56:56.860 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.860 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:916423a7:::benchmark_data_smithi188_161190_object85854:head# 2024-04-01T19:56:56.860 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.860 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91645026:::benchmark_data_smithi188_161190_object81434:head# 2024-04-01T19:56:56.860 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.860 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91646960:::benchmark_data_smithi188_161190_object61893:head# 2024-04-01T19:56:56.860 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.860 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9164f9c9:::benchmark_data_smithi188_161190_object30088:head# 2024-04-01T19:56:56.860 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.861 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:916531f3:::benchmark_data_smithi188_161190_object73348:head# 2024-04-01T19:56:56.861 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.861 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9165d4a6:::benchmark_data_smithi188_161190_object54889:head# 2024-04-01T19:56:56.861 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.861 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9165dfdf:::benchmark_data_smithi188_161190_object22102:head# 2024-04-01T19:56:56.862 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.862 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:916681c6:::benchmark_data_smithi188_161190_object108751:head# 2024-04-01T19:56:56.862 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.862 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91671c81:::benchmark_data_smithi188_161190_object122506:head# 2024-04-01T19:56:56.862 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.862 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91679503:::benchmark_data_smithi188_161190_object108149:head# 2024-04-01T19:56:56.862 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:56 smithi022 ceph-mon[39439]: pgmap v1894: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.2 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 0 B/s wr, 409 op/s; 32004/204328 objects degraded (15.663%); 6.6 MiB/s, 106 objects/s recovering 2024-04-01T19:56:56.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:56 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3790110099' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:56:56.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:56 smithi022 ceph-mon[39439]: from='client.37229 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:56:56.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:56 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 32004/204328 objects degraded (15.663%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:56:56.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91682c7d:::benchmark_data_smithi188_161190_object106114:head# 2024-04-01T19:56:56.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91695460:::benchmark_data_smithi188_161190_object133042:head# 2024-04-01T19:56:56.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:916a3783:::benchmark_data_smithi188_161190_object30223:head# 2024-04-01T19:56:56.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:916a71d3:::benchmark_data_smithi188_161190_object50795:head# 2024-04-01T19:56:56.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:916aa5c1:::benchmark_data_smithi188_161190_object38622:head# 2024-04-01T19:56:56.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:916bb798:::benchmark_data_smithi188_161190_object37270:head# 2024-04-01T19:56:56.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:916cb546:::benchmark_data_smithi188_161190_object33223:head# 2024-04-01T19:56:56.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.865 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:916cdb30:::benchmark_data_smithi188_161190_object118265:head# 2024-04-01T19:56:56.865 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.865 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:916d983f:::benchmark_data_smithi188_161190_object24300:head# 2024-04-01T19:56:56.865 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.866 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:916e34fc:::benchmark_data_smithi188_161190_object89949:head# 2024-04-01T19:56:56.866 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.866 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:916ec445:::benchmark_data_smithi188_161190_object63141:head# 2024-04-01T19:56:56.866 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.866 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:916f1ac5:::benchmark_data_smithi188_161190_object125754:head# 2024-04-01T19:56:56.866 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.866 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:916f5178:::benchmark_data_smithi188_161190_object132828:head# 2024-04-01T19:56:56.866 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.866 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:916f9964:::benchmark_data_smithi188_161190_object76017:head# 2024-04-01T19:56:56.867 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.867 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9170b313:::benchmark_data_smithi188_161190_object33133:head# 2024-04-01T19:56:56.867 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.867 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9170cc92:::benchmark_data_smithi188_161190_object102951:head# 2024-04-01T19:56:56.867 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.867 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9170fca7:::benchmark_data_smithi188_161190_object89964:head# 2024-04-01T19:56:56.867 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.867 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91713b40:::benchmark_data_smithi188_161190_object34563:head# 2024-04-01T19:56:56.868 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.873 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91728422:::benchmark_data_smithi188_161190_object41029:head# 2024-04-01T19:56:56.873 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.873 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9172bfc3:::benchmark_data_smithi188_161190_object106669:head# 2024-04-01T19:56:56.873 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.873 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9172f7f9:::benchmark_data_smithi188_161190_object122061:head# 2024-04-01T19:56:56.873 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.873 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9174561c:::benchmark_data_smithi188_161190_object54848:head# 2024-04-01T19:56:56.873 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.873 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91754561:::benchmark_data_smithi188_161190_object77406:head# 2024-04-01T19:56:56.873 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.873 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9175e900:::benchmark_data_smithi188_161190_object30587:head# 2024-04-01T19:56:56.873 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.873 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9175fe5f:::benchmark_data_smithi188_161190_object64777:head# 2024-04-01T19:56:56.874 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:56 smithi188 ceph-mon[43939]: pgmap v1894: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.2 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 0 B/s wr, 409 op/s; 32004/204328 objects degraded (15.663%); 6.6 MiB/s, 106 objects/s recovering 2024-04-01T19:56:56.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:56 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3790110099' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:56:56.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:56 smithi188 ceph-mon[43939]: from='client.37229 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:56:56.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:56 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 32004/204328 objects degraded (15.663%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:56:56.880 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91772800:::benchmark_data_smithi188_161190_object39782:head# 2024-04-01T19:56:56.880 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.880 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91777c7a:::benchmark_data_smithi188_161190_object38841:head# 2024-04-01T19:56:56.880 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.880 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:917810c9:::benchmark_data_smithi188_161190_object68851:head# 2024-04-01T19:56:56.880 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.880 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9178363d:::benchmark_data_smithi188_161190_object123103:head# 2024-04-01T19:56:56.880 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.880 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:917961c3:::benchmark_data_smithi188_161190_object31526:head# 2024-04-01T19:56:56.880 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91797d42:::benchmark_data_smithi188_161190_object38098:head# 2024-04-01T19:56:56.881 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:917ab70f:::benchmark_data_smithi188_161190_object35736:head# 2024-04-01T19:56:56.881 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:917aedfc:::benchmark_data_smithi188_161190_object47111:head# 2024-04-01T19:56:56.881 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.882 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:917bc01e:::benchmark_data_smithi188_161190_object118710:head# 2024-04-01T19:56:56.882 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.886 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:917c8a4d:::benchmark_data_smithi188_161190_object109683:head# 2024-04-01T19:56:56.887 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.888 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:917d0e86:::benchmark_data_smithi188_161190_object128701:head# 2024-04-01T19:56:56.888 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.888 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:917de606:::benchmark_data_smithi188_161190_object123113:head# 2024-04-01T19:56:56.888 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.891 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:917efd9d:::benchmark_data_smithi188_161190_object56378:head# 2024-04-01T19:56:56.891 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.891 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:917f4a4f:::benchmark_data_smithi188_161190_object40746:head# 2024-04-01T19:56:56.891 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.891 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:917f8438:::benchmark_data_smithi188_161190_object62213:head# 2024-04-01T19:56:56.891 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.891 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:917fb1c8:::benchmark_data_smithi188_161190_object66668:head# 2024-04-01T19:56:56.892 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.892 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91806fde:::benchmark_data_smithi188_161190_object112420:head# 2024-04-01T19:56:56.892 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.892 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91808a77:::benchmark_data_smithi188_161190_object49807:head# 2024-04-01T19:56:56.892 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.892 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9181cbe1:::benchmark_data_smithi188_161190_object126996:head# 2024-04-01T19:56:56.892 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.892 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91825416:::benchmark_data_smithi188_161190_object104999:head# 2024-04-01T19:56:56.892 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.892 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9182a59d:::benchmark_data_smithi188_161190_object113381:head# 2024-04-01T19:56:56.892 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.892 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9182aa99:::benchmark_data_smithi188_161190_object48701:head# 2024-04-01T19:56:56.892 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.893 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9182d8bb:::benchmark_data_smithi188_161190_object124075:head# 2024-04-01T19:56:56.894 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.894 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91830671:::benchmark_data_smithi188_161190_object119474:head# 2024-04-01T19:56:56.894 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.894 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91847a79:::benchmark_data_smithi188_161190_object30036:head# 2024-04-01T19:56:56.894 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.894 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9185ce7d:::benchmark_data_smithi188_161190_object29271:head# 2024-04-01T19:56:56.894 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.894 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9185f329:::benchmark_data_smithi188_161190_object128994:head# 2024-04-01T19:56:56.894 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.894 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9185fa79:::benchmark_data_smithi188_161190_object126776:head# 2024-04-01T19:56:56.894 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.894 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:918613be:::benchmark_data_smithi188_161190_object97827:head# 2024-04-01T19:56:56.894 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.895 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91864d42:::benchmark_data_smithi188_161190_object119495:head# 2024-04-01T19:56:56.895 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.895 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:918710a1:::benchmark_data_smithi188_161190_object121078:head# 2024-04-01T19:56:56.895 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.895 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9187e4bf:::benchmark_data_smithi188_161190_object36482:head# 2024-04-01T19:56:56.895 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.897 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91881167:::benchmark_data_smithi188_161190_object63861:head# 2024-04-01T19:56:56.897 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.897 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91897e0e:::benchmark_data_smithi188_161190_object135109:head# 2024-04-01T19:56:56.897 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.897 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:918aebfb:::benchmark_data_smithi188_161190_object78650:head# 2024-04-01T19:56:56.897 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.897 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:918c122c:::benchmark_data_smithi188_161190_object88130:head# 2024-04-01T19:56:56.897 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.897 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:918c6744:::benchmark_data_smithi188_161190_object89572:head# 2024-04-01T19:56:56.898 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.898 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:918d1d9f:::benchmark_data_smithi188_161190_object137302:head# 2024-04-01T19:56:56.898 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.898 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:918e3ccf:::benchmark_data_smithi188_161190_object59198:head# 2024-04-01T19:56:56.898 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.898 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:918f25d2:::benchmark_data_smithi188_161190_object38116:head# 2024-04-01T19:56:56.898 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.898 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:918fec68:::benchmark_data_smithi188_161190_object69883:head# 2024-04-01T19:56:56.898 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.898 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91911d92:::benchmark_data_smithi188_161190_object34460:head# 2024-04-01T19:56:56.898 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.898 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91914fc9:::benchmark_data_smithi188_161190_object122455:head# 2024-04-01T19:56:56.898 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.898 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91915cac:::benchmark_data_smithi188_161190_object33022:head# 2024-04-01T19:56:56.898 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.899 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:919363e5:::benchmark_data_smithi188_161190_object57987:head# 2024-04-01T19:56:56.899 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.900 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:919381f0:::benchmark_data_smithi188_161190_object55838:head# 2024-04-01T19:56:56.900 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.900 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91946428:::benchmark_data_smithi188_161190_object129372:head# 2024-04-01T19:56:56.900 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9194cdaf:::benchmark_data_smithi188_161190_object57822:head# 2024-04-01T19:56:56.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9194ce2d:::benchmark_data_smithi188_161190_object106387:head# 2024-04-01T19:56:56.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9195e75f:::benchmark_data_smithi188_161190_object63287:head# 2024-04-01T19:56:56.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91964553:::benchmark_data_smithi188_161190_object39482:head# 2024-04-01T19:56:56.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9196bc8d:::benchmark_data_smithi188_161190_object100420:head# 2024-04-01T19:56:56.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9196e4c6:::benchmark_data_smithi188_161190_object37746:head# 2024-04-01T19:56:56.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:919800b7:::benchmark_data_smithi188_161190_object35427:head# 2024-04-01T19:56:56.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91981cd6:::benchmark_data_smithi188_161190_object62240:head# 2024-04-01T19:56:56.902 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.903 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91983610:::benchmark_data_smithi188_161190_object99319:head# 2024-04-01T19:56:56.903 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.904 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91984195:::benchmark_data_smithi188_161190_object103110:head# 2024-04-01T19:56:56.904 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.904 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91989378:::benchmark_data_smithi188_161190_object77145:head# 2024-04-01T19:56:56.904 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.904 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:919a5294:::benchmark_data_smithi188_161190_object136447:head# 2024-04-01T19:56:56.904 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.904 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:919bb492:::benchmark_data_smithi188_161190_object126572:head# 2024-04-01T19:56:56.904 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.904 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:919c220f:::benchmark_data_smithi188_161190_object95453:head# 2024-04-01T19:56:56.904 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.904 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:919c6f65:::benchmark_data_smithi188_161190_object35504:head# 2024-04-01T19:56:56.904 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.904 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:919d7e8d:::benchmark_data_smithi188_161190_object66981:head# 2024-04-01T19:56:56.905 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.905 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:919dd337:::benchmark_data_smithi188_161190_object137458:head# 2024-04-01T19:56:56.905 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.905 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:919e0f3d:::benchmark_data_smithi188_161190_object115813:head# 2024-04-01T19:56:56.905 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.905 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:919e1922:::benchmark_data_smithi188_161190_object105275:head# 2024-04-01T19:56:56.905 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.905 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:919e5ac5:::benchmark_data_smithi188_161190_object39277:head# 2024-04-01T19:56:56.905 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.906 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:919efad2:::benchmark_data_smithi188_161190_object31669:head# 2024-04-01T19:56:56.906 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.906 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:919f684b:::benchmark_data_smithi188_161190_object32778:head# 2024-04-01T19:56:56.906 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.906 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:919fafbb:::benchmark_data_smithi188_161190_object86321:head# 2024-04-01T19:56:56.906 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.911 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91a035c9:::benchmark_data_smithi188_161190_object81506:head# 2024-04-01T19:56:56.911 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.911 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91a2199f:::benchmark_data_smithi188_161190_object33708:head# 2024-04-01T19:56:56.911 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.911 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91a398b9:::benchmark_data_smithi188_161190_object102196:head# 2024-04-01T19:56:56.911 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.911 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91a49c03:::benchmark_data_smithi188_161190_object125367:head# 2024-04-01T19:56:56.911 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.912 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91a53207:::benchmark_data_smithi188_161190_object45283:head# 2024-04-01T19:56:56.912 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.912 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91a6a581:::benchmark_data_smithi188_161190_object94925:head# 2024-04-01T19:56:56.912 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.912 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91a836ec:::benchmark_data_smithi188_161190_object79238:head# 2024-04-01T19:56:56.912 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.912 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91a8b2ec:::benchmark_data_smithi188_161190_object78921:head# 2024-04-01T19:56:56.912 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.912 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91a90080:::benchmark_data_smithi188_161190_object70347:head# 2024-04-01T19:56:56.912 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.912 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91a908e0:::benchmark_data_smithi188_161190_object36431:head# 2024-04-01T19:56:56.912 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.912 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91a98248:::benchmark_data_smithi188_161190_object89212:head# 2024-04-01T19:56:56.912 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.913 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91a9be0d:::benchmark_data_smithi188_161190_object136700:head# 2024-04-01T19:56:56.913 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.913 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91aa03f4:::benchmark_data_smithi188_161190_object119426:head# 2024-04-01T19:56:56.913 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.913 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91aa4e0d:::benchmark_data_smithi188_161190_object21798:head# 2024-04-01T19:56:56.913 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.913 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91aaecc5:::benchmark_data_smithi188_161190_object99520:head# 2024-04-01T19:56:56.913 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.913 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91ac8a62:::benchmark_data_smithi188_161190_object101951:head# 2024-04-01T19:56:56.913 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.913 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91acaa4a:::benchmark_data_smithi188_161190_object110409:head# 2024-04-01T19:56:56.913 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.913 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91acc42c:::benchmark_data_smithi188_161190_object84579:head# 2024-04-01T19:56:56.913 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.913 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91ad2bf6:::benchmark_data_smithi188_161190_object66437:head# 2024-04-01T19:56:56.913 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.914 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91ae0d69:::benchmark_data_smithi188_161190_object122774:head# 2024-04-01T19:56:56.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.914 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91ae0df8:::benchmark_data_smithi188_161190_object91032:head# 2024-04-01T19:56:56.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.914 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91aee27f:::benchmark_data_smithi188_161190_object80513:head# 2024-04-01T19:56:56.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.914 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91af0b88:::benchmark_data_smithi188_161190_object29131:head# 2024-04-01T19:56:56.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.914 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91afc76b:::benchmark_data_smithi188_161190_object38401:head# 2024-04-01T19:56:56.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.915 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91b1261d:::benchmark_data_smithi188_161190_object116307:head# 2024-04-01T19:56:56.915 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.915 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91b13f71:::benchmark_data_smithi188_161190_object101752:head# 2024-04-01T19:56:56.915 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.915 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91b1b46a:::benchmark_data_smithi188_161190_object130221:head# 2024-04-01T19:56:56.915 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.915 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91b21233:::benchmark_data_smithi188_161190_object95709:head# 2024-04-01T19:56:56.915 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.915 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91b34b12:::benchmark_data_smithi188_161190_object19919:head# 2024-04-01T19:56:56.916 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.916 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91b3f0de:::benchmark_data_smithi188_161190_object132427:head# 2024-04-01T19:56:56.916 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.916 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91b40840:::benchmark_data_smithi188_161190_object93647:head# 2024-04-01T19:56:56.916 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.916 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91b454b0:::benchmark_data_smithi188_161190_object138332:head# 2024-04-01T19:56:56.916 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.917 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91b465c1:::benchmark_data_smithi188_161190_object25445:head# 2024-04-01T19:56:56.917 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.918 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91b4b65e:::benchmark_data_smithi188_161190_object122234:head# 2024-04-01T19:56:56.918 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.922 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91b6018d:::benchmark_data_smithi188_161190_object109408:head# 2024-04-01T19:56:56.922 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.922 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91b62178:::benchmark_data_smithi188_161190_object38121:head# 2024-04-01T19:56:56.922 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.923 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91b7cfd5:::benchmark_data_smithi188_161190_object26735:head# 2024-04-01T19:56:56.923 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.923 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91b7ebff:::benchmark_data_smithi188_161190_object107237:head# 2024-04-01T19:56:56.923 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.923 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91b82c22:::benchmark_data_smithi188_161190_object27664:head# 2024-04-01T19:56:56.923 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.924 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91b88b28:::benchmark_data_smithi188_161190_object65390:head# 2024-04-01T19:56:56.924 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.924 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91ba713e:::benchmark_data_smithi188_161190_object35706:head# 2024-04-01T19:56:56.924 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.924 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91bb8959:::benchmark_data_smithi188_161190_object74459:head# 2024-04-01T19:56:56.925 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.925 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91bccfc6:::benchmark_data_smithi188_161190_object32358:head# 2024-04-01T19:56:56.925 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.925 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91bd16f5:::benchmark_data_smithi188_161190_object104808:head# 2024-04-01T19:56:56.925 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.925 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91bd64b8:::benchmark_data_smithi188_161190_object107460:head# 2024-04-01T19:56:56.926 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.926 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91be2388:::benchmark_data_smithi188_161190_object24264:head# 2024-04-01T19:56:56.926 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.926 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91be3269:::benchmark_data_smithi188_161190_object105633:head# 2024-04-01T19:56:56.926 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.926 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91be6159:::benchmark_data_smithi188_161190_object108331:head# 2024-04-01T19:56:56.926 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.927 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91bf2744:::benchmark_data_smithi188_161190_object138631:head# 2024-04-01T19:56:56.927 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.927 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91c13904:::benchmark_data_smithi188_161190_object83271:head# 2024-04-01T19:56:56.928 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.928 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91c1979c:::benchmark_data_smithi188_161190_object73473:head# 2024-04-01T19:56:56.928 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.928 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91c3d984:::benchmark_data_smithi188_161190_object68177:head# 2024-04-01T19:56:56.928 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.928 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91c3e16b:::benchmark_data_smithi188_161190_object73750:head# 2024-04-01T19:56:56.928 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.928 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91c4321d:::benchmark_data_smithi188_161190_object98802:head# 2024-04-01T19:56:56.928 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.929 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91c59ddb:::benchmark_data_smithi188_161190_object46898:head# 2024-04-01T19:56:56.929 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.929 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91c60c1b:::benchmark_data_smithi188_161190_object114028:head# 2024-04-01T19:56:56.930 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.930 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91c63c72:::benchmark_data_smithi188_161190_object31803:head# 2024-04-01T19:56:56.930 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.930 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91c6e412:::benchmark_data_smithi188_161190_object45508:head# 2024-04-01T19:56:56.930 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.930 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91c7306b:::benchmark_data_smithi188_161190_object107281:head# 2024-04-01T19:56:56.930 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.932 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91c770a9:::benchmark_data_smithi188_161190_object121973:head# 2024-04-01T19:56:56.932 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.932 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91c918c7:::benchmark_data_smithi188_161190_object41977:head# 2024-04-01T19:56:56.933 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.933 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91c91b08:::benchmark_data_smithi188_161190_object97876:head# 2024-04-01T19:56:56.933 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.933 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91c965d6:::benchmark_data_smithi188_161190_object45621:head# 2024-04-01T19:56:56.933 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.933 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91c9755c:::benchmark_data_smithi188_161190_object63132:head# 2024-04-01T19:56:56.933 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.933 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91c983e1:::benchmark_data_smithi188_161190_object24316:head# 2024-04-01T19:56:56.933 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.933 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91c9d405:::benchmark_data_smithi188_161190_object40341:head# 2024-04-01T19:56:56.933 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.933 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91c9fc2f:::benchmark_data_smithi188_161190_object119925:head# 2024-04-01T19:56:56.933 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.933 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91caf7de:::benchmark_data_smithi188_161190_object88555:head# 2024-04-01T19:56:56.934 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.934 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91cb8ba2:::benchmark_data_smithi188_161190_object97492:head# 2024-04-01T19:56:56.934 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.934 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91cc0a2e:::benchmark_data_smithi188_161190_object83006:head# 2024-04-01T19:56:56.934 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.934 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91cc0ed3:::benchmark_data_smithi188_161190_object102938:head# 2024-04-01T19:56:56.934 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.937 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91ccfe03:::benchmark_data_smithi188_161190_object70498:head# 2024-04-01T19:56:56.937 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.937 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91cdd6fc:::benchmark_data_smithi188_161190_object100001:head# 2024-04-01T19:56:56.937 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.937 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91ce5440:::benchmark_data_smithi188_161190_object27752:head# 2024-04-01T19:56:56.937 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.937 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91ce5640:::benchmark_data_smithi188_161190_object102962:head# 2024-04-01T19:56:56.937 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.937 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91cffd8f:::benchmark_data_smithi188_161190_object35081:head# 2024-04-01T19:56:56.937 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.937 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91d09697:::benchmark_data_smithi188_161190_object81873:head# 2024-04-01T19:56:56.937 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.938 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91d176b7:::benchmark_data_smithi188_161190_object64131:head# 2024-04-01T19:56:56.938 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.938 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91d1a7f1:::benchmark_data_smithi188_161190_object65164:head# 2024-04-01T19:56:56.938 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.938 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91d1adf9:::benchmark_data_smithi188_161190_object85433:head# 2024-04-01T19:56:56.938 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.938 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91d1d470:::benchmark_data_smithi188_161190_object109855:head# 2024-04-01T19:56:56.938 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.938 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91d29d64:::benchmark_data_smithi188_161190_object111180:head# 2024-04-01T19:56:56.938 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.938 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91d431c3:::benchmark_data_smithi188_161190_object60007:head# 2024-04-01T19:56:56.938 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.938 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91d461a2:::benchmark_data_smithi188_161190_object131713:head# 2024-04-01T19:56:56.938 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.939 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91d4e877:::benchmark_data_smithi188_161190_object33700:head# 2024-04-01T19:56:56.939 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.939 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91d4f022:::benchmark_data_smithi188_161190_object27954:head# 2024-04-01T19:56:56.939 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.939 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91d4f34a:::benchmark_data_smithi188_161190_object135067:head# 2024-04-01T19:56:56.939 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.940 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91d5a9b7:::benchmark_data_smithi188_161190_object108575:head# 2024-04-01T19:56:56.940 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.940 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91d6eab3:::benchmark_data_smithi188_161190_object129354:head# 2024-04-01T19:56:56.941 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.941 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91d73648:::benchmark_data_smithi188_161190_object137153:head# 2024-04-01T19:56:56.941 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.941 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91d7bb41:::benchmark_data_smithi188_161190_object41709:head# 2024-04-01T19:56:56.941 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.941 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91d7dd8e:::benchmark_data_smithi188_161190_object91943:head# 2024-04-01T19:56:56.941 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.941 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91d7df08:::benchmark_data_smithi188_161190_object112630:head# 2024-04-01T19:56:56.941 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.941 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91d7e6e0:::benchmark_data_smithi188_161190_object104559:head# 2024-04-01T19:56:56.941 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.941 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91d83de7:::benchmark_data_smithi188_161190_object109932:head# 2024-04-01T19:56:56.941 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.945 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91d87008:::benchmark_data_smithi188_161190_object101469:head# 2024-04-01T19:56:56.945 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.945 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91d90f9d:::benchmark_data_smithi188_161190_object24558:head# 2024-04-01T19:56:56.945 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.946 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91da1b01:::benchmark_data_smithi188_161190_object106248:head# 2024-04-01T19:56:56.946 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.946 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91da2af0:::benchmark_data_smithi188_161190_object52247:head# 2024-04-01T19:56:56.946 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.947 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91da538e:::benchmark_data_smithi188_161190_object79545:head# 2024-04-01T19:56:56.947 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.947 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91da9d82:::benchmark_data_smithi188_161190_object139017:head# 2024-04-01T19:56:56.947 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.947 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91dad483:::benchmark_data_smithi188_161190_object28265:head# 2024-04-01T19:56:56.947 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.947 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91db02bd:::benchmark_data_smithi188_161190_object95921:head# 2024-04-01T19:56:56.948 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.953 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91dbea4c:::benchmark_data_smithi188_161190_object121893:head# 2024-04-01T19:56:56.953 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.953 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91dc7a0b:::benchmark_data_smithi188_161190_object95582:head# 2024-04-01T19:56:56.953 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.953 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91dc83e0:::benchmark_data_smithi188_161190_object80442:head# 2024-04-01T19:56:56.953 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.953 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91ded734:::benchmark_data_smithi188_161190_object29185:head# 2024-04-01T19:56:56.953 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.953 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91dee15e:::benchmark_data_smithi188_161190_object32014:head# 2024-04-01T19:56:56.953 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.954 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91df2b7f:::benchmark_data_smithi188_161190_object116224:head# 2024-04-01T19:56:56.954 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.954 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91e01718:::benchmark_data_smithi188_161190_object67514:head# 2024-04-01T19:56:56.954 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.954 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91e0cbb6:::benchmark_data_smithi188_161190_object22151:head# 2024-04-01T19:56:56.954 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.954 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91e2084c:::benchmark_data_smithi188_161190_object34652:head# 2024-04-01T19:56:56.954 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.954 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91e2670d:::benchmark_data_smithi188_161190_object23331:head# 2024-04-01T19:56:56.954 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.954 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91e3450a:::benchmark_data_smithi188_161190_object26422:head# 2024-04-01T19:56:56.954 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.954 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91e37c1b:::benchmark_data_smithi188_161190_object84338:head# 2024-04-01T19:56:56.954 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.955 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91e4060c:::benchmark_data_smithi188_161190_object109160:head# 2024-04-01T19:56:56.955 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.955 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91e41481:::benchmark_data_smithi188_161190_object94027:head# 2024-04-01T19:56:56.955 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.955 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91e49893:::benchmark_data_smithi188_161190_object56304:head# 2024-04-01T19:56:56.955 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.955 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91e4cfca:::benchmark_data_smithi188_161190_object122227:head# 2024-04-01T19:56:56.955 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.955 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91e4f7b1:::benchmark_data_smithi188_161190_object113698:head# 2024-04-01T19:56:56.955 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.955 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91e515fc:::benchmark_data_smithi188_161190_object59630:head# 2024-04-01T19:56:56.955 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.955 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91e55730:::benchmark_data_smithi188_161190_object23705:head# 2024-04-01T19:56:56.955 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.955 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91e5670f:::benchmark_data_smithi188_161190_object130055:head# 2024-04-01T19:56:56.955 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.956 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91e5680d:::benchmark_data_smithi188_161190_object69142:head# 2024-04-01T19:56:56.956 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.956 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91e5d061:::benchmark_data_smithi188_161190_object70466:head# 2024-04-01T19:56:56.956 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.956 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91e60b51:::benchmark_data_smithi188_161190_object96843:head# 2024-04-01T19:56:56.956 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.956 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91e74088:::benchmark_data_smithi188_161190_object66455:head# 2024-04-01T19:56:56.957 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.958 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91e77efb:::benchmark_data_smithi188_161190_object95280:head# 2024-04-01T19:56:56.958 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.958 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91e86bd1:::benchmark_data_smithi188_161190_object59157:head# 2024-04-01T19:56:56.958 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.958 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91e92c92:::benchmark_data_smithi188_161190_object25122:head# 2024-04-01T19:56:56.958 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.958 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91e9c6f1:::benchmark_data_smithi188_161190_object28608:head# 2024-04-01T19:56:56.958 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.958 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91ea3a4e:::benchmark_data_smithi188_161190_object109362:head# 2024-04-01T19:56:56.958 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.958 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91ea516f:::benchmark_data_smithi188_161190_object53005:head# 2024-04-01T19:56:56.959 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.959 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91ea546c:::benchmark_data_smithi188_161190_object126835:head# 2024-04-01T19:56:56.959 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.959 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91ebdcd5:::benchmark_data_smithi188_161190_object112823:head# 2024-04-01T19:56:56.959 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.959 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91ecc669:::benchmark_data_smithi188_161190_object49175:head# 2024-04-01T19:56:56.959 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.959 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91ecfd6d:::benchmark_data_smithi188_161190_object53021:head# 2024-04-01T19:56:56.959 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.959 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91ee1ac7:::benchmark_data_smithi188_161190_object113254:head# 2024-04-01T19:56:56.959 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.959 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91ee232c:::benchmark_data_smithi188_161190_object130030:head# 2024-04-01T19:56:56.959 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.961 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91ee6e55:::benchmark_data_smithi188_161190_object105319:head# 2024-04-01T19:56:56.961 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.961 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91eeae61:::benchmark_data_smithi188_161190_object70272:head# 2024-04-01T19:56:56.961 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.961 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91ef3a41:::benchmark_data_smithi188_161190_object102649:head# 2024-04-01T19:56:56.961 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.961 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91ef7bf5:::benchmark_data_smithi188_161190_object112064:head# 2024-04-01T19:56:56.961 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.961 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91f046c1:::benchmark_data_smithi188_161190_object57220:head# 2024-04-01T19:56:56.962 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.962 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91f077fa:::benchmark_data_smithi188_161190_object125814:head# 2024-04-01T19:56:56.962 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.962 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91f0e4f5:::benchmark_data_smithi188_161190_object80046:head# 2024-04-01T19:56:56.962 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.962 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91f3456a:::benchmark_data_smithi188_161190_object40710:head# 2024-04-01T19:56:56.962 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.962 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91f382e0:::benchmark_data_smithi188_161190_object57733:head# 2024-04-01T19:56:56.962 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.962 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91f38925:::benchmark_data_smithi188_161190_object23086:head# 2024-04-01T19:56:56.962 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.962 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91f3919f:::benchmark_data_smithi188_161190_object81243:head# 2024-04-01T19:56:56.962 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.963 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91f554ec:::benchmark_data_smithi188_161190_object49912:head# 2024-04-01T19:56:56.963 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.964 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91f64274:::benchmark_data_smithi188_161190_object56426:head# 2024-04-01T19:56:56.964 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.964 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91f685a6:::benchmark_data_smithi188_161190_object20119:head# 2024-04-01T19:56:56.964 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.965 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91f6abc1:::benchmark_data_smithi188_161190_object63760:head# 2024-04-01T19:56:56.965 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.965 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91f709ec:::benchmark_data_smithi188_161190_object73877:head# 2024-04-01T19:56:56.965 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.965 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91f7dfa8:::benchmark_data_smithi188_161190_object56246:head# 2024-04-01T19:56:56.965 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.966 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91f8359f:::benchmark_data_smithi188_161190_object94988:head# 2024-04-01T19:56:56.966 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.966 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91f84313:::benchmark_data_smithi188_161190_object86241:head# 2024-04-01T19:56:56.966 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.966 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91fb4bde:::benchmark_data_smithi188_161190_object72598:head# 2024-04-01T19:56:56.966 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.969 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91fb5783:::benchmark_data_smithi188_161190_object101646:head# 2024-04-01T19:56:56.970 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.970 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91fbc425:::benchmark_data_smithi188_161190_object116235:head# 2024-04-01T19:56:56.970 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.975 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91fc4607:::benchmark_data_smithi188_161190_object82808:head# 2024-04-01T19:56:56.975 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.981 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91fc5c04:::benchmark_data_smithi188_161190_object32344:head# 2024-04-01T19:56:56.981 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.981 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91fca455:::benchmark_data_smithi188_161190_object75702:head# 2024-04-01T19:56:56.981 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.981 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91fd976f:::benchmark_data_smithi188_161190_object24754:head# 2024-04-01T19:56:56.981 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.982 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91ff1916:::benchmark_data_smithi188_161190_object43950:head# 2024-04-01T19:56:56.982 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.982 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:91ff514e:::benchmark_data_smithi188_161190_object134980:head# 2024-04-01T19:56:56.982 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.982 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92004385:::benchmark_data_smithi188_161190_object133316:head# 2024-04-01T19:56:56.983 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.983 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:920058d5:::benchmark_data_smithi188_161190_object94407:head# 2024-04-01T19:56:56.983 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.984 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9200dd95:::benchmark_data_smithi188_161190_object100592:head# 2024-04-01T19:56:56.984 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.984 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92020913:::benchmark_data_smithi188_161190_object97841:head# 2024-04-01T19:56:56.984 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.984 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92025ef7:::benchmark_data_smithi188_161190_object65525:head# 2024-04-01T19:56:56.984 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.984 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92026ddc:::benchmark_data_smithi188_161190_object116419:head# 2024-04-01T19:56:56.984 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.985 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9202c969:::benchmark_data_smithi188_161190_object78840:head# 2024-04-01T19:56:56.985 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.985 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9202eadd:::benchmark_data_smithi188_161190_object80922:head# 2024-04-01T19:56:56.985 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.985 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9204fc1e:::benchmark_data_smithi188_161190_object92560:head# 2024-04-01T19:56:56.985 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.986 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92057ad8:::benchmark_data_smithi188_161190_object133038:head# 2024-04-01T19:56:56.986 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.986 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9205cc0f:::benchmark_data_smithi188_161190_object45412:head# 2024-04-01T19:56:56.986 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.986 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:920611fb:::benchmark_data_smithi188_161190_object30116:head# 2024-04-01T19:56:56.986 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.986 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:920624dc:::benchmark_data_smithi188_161190_object80680:head# 2024-04-01T19:56:56.986 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.987 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92069a2f:::benchmark_data_smithi188_161190_object29904:head# 2024-04-01T19:56:56.987 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.987 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92069a51:::benchmark_data_smithi188_161190_object111389:head# 2024-04-01T19:56:56.987 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.987 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9206bc90:::benchmark_data_smithi188_161190_object114058:head# 2024-04-01T19:56:56.987 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.988 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92071eed:::benchmark_data_smithi188_161190_object100494:head# 2024-04-01T19:56:56.988 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.989 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92078735:::benchmark_data_smithi188_161190_object119784:head# 2024-04-01T19:56:56.989 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.989 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9208715f:::benchmark_data_smithi188_161190_object85532:head# 2024-04-01T19:56:56.989 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.989 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9208f34a:::benchmark_data_smithi188_161190_object106695:head# 2024-04-01T19:56:56.989 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.989 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9208f497:::benchmark_data_smithi188_161190_object30197:head# 2024-04-01T19:56:56.989 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.989 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:920a32ed:::benchmark_data_smithi188_161190_object126282:head# 2024-04-01T19:56:56.989 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.991 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:920acd1e:::benchmark_data_smithi188_161190_object129355:head# 2024-04-01T19:56:56.991 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.991 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:920b98b2:::benchmark_data_smithi188_161190_object66066:head# 2024-04-01T19:56:56.991 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.991 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:920bcc1b:::benchmark_data_smithi188_161190_object138047:head# 2024-04-01T19:56:56.991 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.991 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:920be2e6:::benchmark_data_smithi188_161190_object59462:head# 2024-04-01T19:56:56.991 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.991 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:920c248b:::benchmark_data_smithi188_161190_object91936:head# 2024-04-01T19:56:56.991 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.992 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:920ce902:::benchmark_data_smithi188_161190_object68759:head# 2024-04-01T19:56:56.992 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.992 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:920d6495:::benchmark_data_smithi188_161190_object82363:head# 2024-04-01T19:56:56.992 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.992 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:920e585f:::benchmark_data_smithi188_161190_object55754:head# 2024-04-01T19:56:56.992 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.993 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:920edefa:::benchmark_data_smithi188_161190_object89023:head# 2024-04-01T19:56:56.993 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.993 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:920fba26:::benchmark_data_smithi188_161190_object115142:head# 2024-04-01T19:56:56.993 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.993 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:920fe6ac:::benchmark_data_smithi188_161190_object68680:head# 2024-04-01T19:56:56.993 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.994 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:921028c1:::benchmark_data_smithi188_161190_object24809:head# 2024-04-01T19:56:56.994 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.994 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92104961:::benchmark_data_smithi188_161190_object40787:head# 2024-04-01T19:56:56.994 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.994 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9210d34b:::benchmark_data_smithi188_161190_object132882:head# 2024-04-01T19:56:56.994 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.994 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9210d6ec:::benchmark_data_smithi188_161190_object84766:head# 2024-04-01T19:56:56.994 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.994 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9211335e:::benchmark_data_smithi188_161190_object66538:head# 2024-04-01T19:56:56.994 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.994 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:921140f4:::benchmark_data_smithi188_161190_object61169:head# 2024-04-01T19:56:56.994 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.995 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92125763:::benchmark_data_smithi188_161190_object123289:head# 2024-04-01T19:56:56.995 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.995 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:921315e6:::benchmark_data_smithi188_161190_object38375:head# 2024-04-01T19:56:56.995 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.995 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9213c39b:::benchmark_data_smithi188_161190_object83828:head# 2024-04-01T19:56:56.995 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.996 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9213c50a:::benchmark_data_smithi188_161190_object66086:head# 2024-04-01T19:56:56.996 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:56.996 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9214872d:::benchmark_data_smithi188_161190_object90345:head# 2024-04-01T19:56:56.996 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.000 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92154c3a:::benchmark_data_smithi188_161190_object19766:head# 2024-04-01T19:56:57.000 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.000 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9215ba96:::benchmark_data_smithi188_161190_object128639:head# 2024-04-01T19:56:57.000 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.000 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92160f2b:::benchmark_data_smithi188_161190_object59450:head# 2024-04-01T19:56:57.000 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.000 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92165226:::benchmark_data_smithi188_161190_object84228:head# 2024-04-01T19:56:57.000 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.000 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92173bff:::benchmark_data_smithi188_161190_object104179:head# 2024-04-01T19:56:57.000 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.000 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92174294:::benchmark_data_smithi188_161190_object43462:head# 2024-04-01T19:56:57.000 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.000 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92180176:::benchmark_data_smithi188_161190_object129013:head# 2024-04-01T19:56:57.001 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.001 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92181f26:::benchmark_data_smithi188_161190_object64878:head# 2024-04-01T19:56:57.001 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.001 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9218ae99:::benchmark_data_smithi188_161190_object49785:head# 2024-04-01T19:56:57.001 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.001 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9218ef89:::benchmark_data_smithi188_161190_object91165:head# 2024-04-01T19:56:57.001 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.001 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:921aee1c:::benchmark_data_smithi188_161190_object103409:head# 2024-04-01T19:56:57.001 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.001 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:921af720:::benchmark_data_smithi188_161190_object74419:head# 2024-04-01T19:56:57.001 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.001 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:921b476f:::benchmark_data_smithi188_161190_object97338:head# 2024-04-01T19:56:57.001 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.001 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:921bf79d:::benchmark_data_smithi188_161190_object107913:head# 2024-04-01T19:56:57.001 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.002 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:921c292d:::benchmark_data_smithi188_161190_object80355:head# 2024-04-01T19:56:57.002 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.002 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:921d661a:::benchmark_data_smithi188_161190_object24396:head# 2024-04-01T19:56:57.002 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.004 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:921db3a9:::benchmark_data_smithi188_161190_object94215:head# 2024-04-01T19:56:57.004 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.004 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:921e9169:::benchmark_data_smithi188_161190_object125038:head# 2024-04-01T19:56:57.004 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.005 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:921eaf99:::benchmark_data_smithi188_161190_object101935:head# 2024-04-01T19:56:57.005 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.005 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:921f5971:::benchmark_data_smithi188_161190_object113955:head# 2024-04-01T19:56:57.005 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.005 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:921f7333:::benchmark_data_smithi188_161190_object91581:head# 2024-04-01T19:56:57.005 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.005 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92201f50:::benchmark_data_smithi188_161190_object104316:head# 2024-04-01T19:56:57.005 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.005 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92208ed9:::benchmark_data_smithi188_161190_object84652:head# 2024-04-01T19:56:57.005 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.005 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9221d5bc:::benchmark_data_smithi188_161190_object63800:head# 2024-04-01T19:56:57.005 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.005 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:922218d6:::benchmark_data_smithi188_161190_object40360:head# 2024-04-01T19:56:57.005 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.006 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:922219c6:::benchmark_data_smithi188_161190_object70773:head# 2024-04-01T19:56:57.006 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.006 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9222e4c7:::benchmark_data_smithi188_161190_object65795:head# 2024-04-01T19:56:57.006 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.006 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92243935:::benchmark_data_smithi188_161190_object65923:head# 2024-04-01T19:56:57.006 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.006 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9224905d:::benchmark_data_smithi188_161190_object96825:head# 2024-04-01T19:56:57.006 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.006 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9224f414:::benchmark_data_smithi188_161190_object55715:head# 2024-04-01T19:56:57.006 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.006 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92256296:::benchmark_data_smithi188_161190_object107045:head# 2024-04-01T19:56:57.006 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.006 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92284ca1:::benchmark_data_smithi188_161190_object69529:head# 2024-04-01T19:56:57.006 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.006 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9228ff49:::benchmark_data_smithi188_161190_object103269:head# 2024-04-01T19:56:57.007 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.007 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9229181a:::benchmark_data_smithi188_161190_object75956:head# 2024-04-01T19:56:57.007 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.007 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92295be2:::benchmark_data_smithi188_161190_object102855:head# 2024-04-01T19:56:57.008 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.008 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92295d4e:::benchmark_data_smithi188_161190_object137947:head# 2024-04-01T19:56:57.008 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.008 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92299308:::benchmark_data_smithi188_161190_object44077:head# 2024-04-01T19:56:57.008 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.008 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:922ab9d3:::benchmark_data_smithi188_161190_object50680:head# 2024-04-01T19:56:57.008 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.010 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:922b62b7:::benchmark_data_smithi188_161190_object102414:head# 2024-04-01T19:56:57.010 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.010 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:922bb640:::benchmark_data_smithi188_161190_object95205:head# 2024-04-01T19:56:57.010 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.010 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:922c5de4:::benchmark_data_smithi188_161190_object37407:head# 2024-04-01T19:56:57.010 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.010 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:922c8b08:::benchmark_data_smithi188_161190_object116013:head# 2024-04-01T19:56:57.011 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.011 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:922d2900:::benchmark_data_smithi188_161190_object42351:head# 2024-04-01T19:56:57.011 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.011 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:922d437c:::benchmark_data_smithi188_161190_object89074:head# 2024-04-01T19:56:57.011 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.011 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:922d4a76:::benchmark_data_smithi188_161190_object20484:head# 2024-04-01T19:56:57.011 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.011 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:922d980e:::benchmark_data_smithi188_161190_object113488:head# 2024-04-01T19:56:57.011 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.011 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:922de58f:::benchmark_data_smithi188_161190_object123628:head# 2024-04-01T19:56:57.011 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.011 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:922e3831:::benchmark_data_smithi188_161190_object90166:head# 2024-04-01T19:56:57.011 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.011 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:922e3e13:::benchmark_data_smithi188_161190_object106610:head# 2024-04-01T19:56:57.011 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.011 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:922e4c6b:::benchmark_data_smithi188_161190_object57795:head# 2024-04-01T19:56:57.012 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.012 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:922e8f44:::benchmark_data_smithi188_161190_object40102:head# 2024-04-01T19:56:57.012 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.012 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:922f59de:::benchmark_data_smithi188_161190_object113813:head# 2024-04-01T19:56:57.012 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.012 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:922ff81f:::benchmark_data_smithi188_161190_object137337:head# 2024-04-01T19:56:57.012 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.012 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9230b7ce:::benchmark_data_smithi188_161190_object64871:head# 2024-04-01T19:56:57.013 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.013 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92326c82:::benchmark_data_smithi188_161190_object75446:head# 2024-04-01T19:56:57.013 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.013 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:923281a7:::benchmark_data_smithi188_161190_object47465:head# 2024-04-01T19:56:57.013 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.013 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9234a8bd:::benchmark_data_smithi188_161190_object102643:head# 2024-04-01T19:56:57.013 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.013 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:923546f6:::benchmark_data_smithi188_161190_object98368:head# 2024-04-01T19:56:57.013 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.013 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:923613c9:::benchmark_data_smithi188_161190_object102580:head# 2024-04-01T19:56:57.013 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.013 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92366e7e:::benchmark_data_smithi188_161190_object111605:head# 2024-04-01T19:56:57.013 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.013 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9236e439:::benchmark_data_smithi188_161190_object57908:head# 2024-04-01T19:56:57.014 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.018 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9237bbaa:::benchmark_data_smithi188_161190_object129345:head# 2024-04-01T19:56:57.018 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.018 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9237dd40:::benchmark_data_smithi188_161190_object130694:head# 2024-04-01T19:56:57.018 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.018 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9238596e:::benchmark_data_smithi188_161190_object83068:head# 2024-04-01T19:56:57.018 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.018 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:923a7723:::benchmark_data_smithi188_161190_object20534:head# 2024-04-01T19:56:57.018 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.018 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:923ae506:::benchmark_data_smithi188_161190_object82417:head# 2024-04-01T19:56:57.018 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.022 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:923b16a6:::benchmark_data_smithi188_161190_object111936:head# 2024-04-01T19:56:57.022 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.022 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:923b7dda:::benchmark_data_smithi188_161190_object84025:head# 2024-04-01T19:56:57.022 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.023 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:923b8436:::benchmark_data_smithi188_161190_object26513:head# 2024-04-01T19:56:57.023 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.023 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:923bbeb1:::benchmark_data_smithi188_161190_object36253:head# 2024-04-01T19:56:57.023 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.023 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:923c3dd7:::benchmark_data_smithi188_161190_object123552:head# 2024-04-01T19:56:57.023 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.024 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:923c3f4d:::benchmark_data_smithi188_161190_object130476:head# 2024-04-01T19:56:57.024 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.024 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:923e79e6:::benchmark_data_smithi188_161190_object20502:head# 2024-04-01T19:56:57.024 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.024 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9240f52b:::benchmark_data_smithi188_161190_object52173:head# 2024-04-01T19:56:57.024 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.024 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:924117df:::benchmark_data_smithi188_161190_object47612:head# 2024-04-01T19:56:57.024 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.025 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92414b92:::benchmark_data_smithi188_161190_object39196:head# 2024-04-01T19:56:57.025 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.025 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9241531c:::benchmark_data_smithi188_161190_object46971:head# 2024-04-01T19:56:57.025 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.030 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:924207be:::benchmark_data_smithi188_161190_object53651:head# 2024-04-01T19:56:57.030 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.030 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:924287ef:::benchmark_data_smithi188_161190_object82613:head# 2024-04-01T19:56:57.030 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.030 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9242a632:::benchmark_data_smithi188_161190_object30710:head# 2024-04-01T19:56:57.030 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.030 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92438f4d:::benchmark_data_smithi188_161190_object57920:head# 2024-04-01T19:56:57.030 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.031 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9243a4ba:::benchmark_data_smithi188_161190_object33150:head# 2024-04-01T19:56:57.031 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.031 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9243d395:::benchmark_data_smithi188_161190_object40427:head# 2024-04-01T19:56:57.031 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.031 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9243dcb2:::benchmark_data_smithi188_161190_object135331:head# 2024-04-01T19:56:57.031 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.031 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9244bebb:::benchmark_data_smithi188_161190_object112691:head# 2024-04-01T19:56:57.031 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.031 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9244d1f5:::benchmark_data_smithi188_161190_object130378:head# 2024-04-01T19:56:57.031 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.031 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92450794:::benchmark_data_smithi188_161190_object84732:head# 2024-04-01T19:56:57.031 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.031 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92453035:::benchmark_data_smithi188_161190_object21618:head# 2024-04-01T19:56:57.031 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.031 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9246605a:::benchmark_data_smithi188_161190_object98682:head# 2024-04-01T19:56:57.032 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.032 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9246e910:::benchmark_data_smithi188_161190_object123883:head# 2024-04-01T19:56:57.032 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.032 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92477141:::benchmark_data_smithi188_161190_object131417:head# 2024-04-01T19:56:57.032 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.032 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9247c0e2:::benchmark_data_smithi188_161190_object46623:head# 2024-04-01T19:56:57.032 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.032 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9249177c:::benchmark_data_smithi188_161190_object48050:head# 2024-04-01T19:56:57.032 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.032 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9249ee81:::benchmark_data_smithi188_161190_object121926:head# 2024-04-01T19:56:57.032 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.032 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:924aefbe:::benchmark_data_smithi188_161190_object124985:head# 2024-04-01T19:56:57.032 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.032 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:924b30da:::benchmark_data_smithi188_161190_object125447:head# 2024-04-01T19:56:57.032 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.033 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:924bdc0b:::benchmark_data_smithi188_161190_object94992:head# 2024-04-01T19:56:57.033 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.033 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:924ce1f6:::benchmark_data_smithi188_161190_object119659:head# 2024-04-01T19:56:57.033 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.035 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:924d1aa7:::benchmark_data_smithi188_161190_object68924:head# 2024-04-01T19:56:57.035 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.035 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:924d51e2:::benchmark_data_smithi188_161190_object55914:head# 2024-04-01T19:56:57.035 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.035 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:924dd50f:::benchmark_data_smithi188_161190_object69849:head# 2024-04-01T19:56:57.035 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.035 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:924e25e9:::benchmark_data_smithi188_161190_object32811:head# 2024-04-01T19:56:57.035 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.035 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:924e4595:::benchmark_data_smithi188_161190_object23190:head# 2024-04-01T19:56:57.035 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.035 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:924e6d59:::benchmark_data_smithi188_161190_object125046:head# 2024-04-01T19:56:57.035 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.035 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:924edddb:::benchmark_data_smithi188_161190_object76734:head# 2024-04-01T19:56:57.036 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.036 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:924f48be:::benchmark_data_smithi188_161190_object116674:head# 2024-04-01T19:56:57.036 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.036 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:924f6db9:::benchmark_data_smithi188_161190_object69691:head# 2024-04-01T19:56:57.036 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.036 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:924fa556:::benchmark_data_smithi188_161190_object71305:head# 2024-04-01T19:56:57.036 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.038 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:924fb2b0:::benchmark_data_smithi188_161190_object33101:head# 2024-04-01T19:56:57.038 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.038 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:925018d9:::benchmark_data_smithi188_161190_object109363:head# 2024-04-01T19:56:57.039 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.039 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9250833b:::benchmark_data_smithi188_161190_object73748:head# 2024-04-01T19:56:57.039 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.039 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9250e9e6:::benchmark_data_smithi188_161190_object114123:head# 2024-04-01T19:56:57.039 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.039 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9251ba3c:::benchmark_data_smithi188_161190_object22347:head# 2024-04-01T19:56:57.039 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.039 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9251dc02:::benchmark_data_smithi188_161190_object37027:head# 2024-04-01T19:56:57.039 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.039 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92526132:::benchmark_data_smithi188_161190_object76789:head# 2024-04-01T19:56:57.039 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.039 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9252b8a9:::benchmark_data_smithi188_161190_object21519:head# 2024-04-01T19:56:57.040 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.040 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9252ec2f:::benchmark_data_smithi188_161190_object40055:head# 2024-04-01T19:56:57.040 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.040 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:925444b5:::benchmark_data_smithi188_161190_object135154:head# 2024-04-01T19:56:57.040 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.040 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:925508ec:::benchmark_data_smithi188_161190_object92943:head# 2024-04-01T19:56:57.040 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.040 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9255ac30:::benchmark_data_smithi188_161190_object49459:head# 2024-04-01T19:56:57.040 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.040 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9255df90:::benchmark_data_smithi188_161190_object28645:head# 2024-04-01T19:56:57.040 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.040 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92570887:::benchmark_data_smithi188_161190_object139221:head# 2024-04-01T19:56:57.040 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.042 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9258d20b:::benchmark_data_smithi188_161190_object41354:head# 2024-04-01T19:56:57.042 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.042 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9258e429:::benchmark_data_smithi188_161190_object73532:head# 2024-04-01T19:56:57.042 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.042 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9258e652:::benchmark_data_smithi188_161190_object23034:head# 2024-04-01T19:56:57.042 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.042 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:925958e9:::benchmark_data_smithi188_161190_object110219:head# 2024-04-01T19:56:57.043 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.043 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92595e5a:::benchmark_data_smithi188_161190_object98851:head# 2024-04-01T19:56:57.043 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.043 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9259997d:::benchmark_data_smithi188_161190_object114394:head# 2024-04-01T19:56:57.043 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.043 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:925b6d02:::benchmark_data_smithi188_161190_object82774:head# 2024-04-01T19:56:57.043 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.043 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:925bb71d:::benchmark_data_smithi188_161190_object122578:head# 2024-04-01T19:56:57.043 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.043 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:925c62a9:::benchmark_data_smithi188_161190_object41915:head# 2024-04-01T19:56:57.043 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.043 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:925cf66c:::benchmark_data_smithi188_161190_object71910:head# 2024-04-01T19:56:57.043 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.044 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:925d8689:::benchmark_data_smithi188_161190_object75000:head# 2024-04-01T19:56:57.044 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.044 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:925dc31e:::benchmark_data_smithi188_161190_object20655:head# 2024-04-01T19:56:57.044 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.044 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:925dcad5:::benchmark_data_smithi188_161190_object119568:head# 2024-04-01T19:56:57.044 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.045 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:925e1bb0:::benchmark_data_smithi188_161190_object62121:head# 2024-04-01T19:56:57.045 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.045 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:925e503c:::benchmark_data_smithi188_161190_object35286:head# 2024-04-01T19:56:57.045 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.046 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92603f38:::benchmark_data_smithi188_161190_object83809:head# 2024-04-01T19:56:57.046 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.046 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9260c15a:::benchmark_data_smithi188_161190_object135906:head# 2024-04-01T19:56:57.046 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.046 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:926186d2:::benchmark_data_smithi188_161190_object69531:head# 2024-04-01T19:56:57.046 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.046 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:926336dd:::benchmark_data_smithi188_161190_object111814:head# 2024-04-01T19:56:57.046 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.046 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9263fcf2:::benchmark_data_smithi188_161190_object85929:head# 2024-04-01T19:56:57.046 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.046 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9264634c:::benchmark_data_smithi188_161190_object128244:head# 2024-04-01T19:56:57.046 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.046 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92647ad0:::benchmark_data_smithi188_161190_object131056:head# 2024-04-01T19:56:57.047 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.047 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9264886f:::benchmark_data_smithi188_161190_object33887:head# 2024-04-01T19:56:57.047 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.047 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:926491fc:::benchmark_data_smithi188_161190_object47211:head# 2024-04-01T19:56:57.047 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.048 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9264a357:::benchmark_data_smithi188_161190_object26643:head# 2024-04-01T19:56:57.049 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.049 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:926518f5:::benchmark_data_smithi188_161190_object80551:head# 2024-04-01T19:56:57.049 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.049 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92653b0c:::benchmark_data_smithi188_161190_object95760:head# 2024-04-01T19:56:57.049 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.049 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92655d29:::benchmark_data_smithi188_161190_object62488:head# 2024-04-01T19:56:57.049 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.049 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:926563a6:::benchmark_data_smithi188_161190_object22219:head# 2024-04-01T19:56:57.049 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.049 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92660c13:::benchmark_data_smithi188_161190_object97996:head# 2024-04-01T19:56:57.049 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.049 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9266bf30:::benchmark_data_smithi188_161190_object104207:head# 2024-04-01T19:56:57.049 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.050 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92671277:::benchmark_data_smithi188_161190_object68000:head# 2024-04-01T19:56:57.050 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.050 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92680ee5:::benchmark_data_smithi188_161190_object62544:head# 2024-04-01T19:56:57.050 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.050 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:926837e1:::benchmark_data_smithi188_161190_object35016:head# 2024-04-01T19:56:57.050 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.050 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9268bc24:::benchmark_data_smithi188_161190_object59926:head# 2024-04-01T19:56:57.050 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.050 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9269184b:::benchmark_data_smithi188_161190_object37596:head# 2024-04-01T19:56:57.050 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.051 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:926a152b:::benchmark_data_smithi188_161190_object82059:head# 2024-04-01T19:56:57.051 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.051 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:926a8f8e:::benchmark_data_smithi188_161190_object102868:head# 2024-04-01T19:56:57.051 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.051 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:926aa845:::benchmark_data_smithi188_161190_object108009:head# 2024-04-01T19:56:57.051 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.052 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:926bc27a:::benchmark_data_smithi188_161190_object93593:head# 2024-04-01T19:56:57.052 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.052 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:926bc9c0:::benchmark_data_smithi188_161190_object80244:head# 2024-04-01T19:56:57.052 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.055 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:926bcfad:::benchmark_data_smithi188_161190_object37349:head# 2024-04-01T19:56:57.055 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.055 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:926c1814:::benchmark_data_smithi188_161190_object54675:head# 2024-04-01T19:56:57.056 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.056 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:926d31aa:::benchmark_data_smithi188_161190_object130176:head# 2024-04-01T19:56:57.056 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.056 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:926d84ab:::benchmark_data_smithi188_161190_object29864:head# 2024-04-01T19:56:57.056 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.056 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:926d9b29:::benchmark_data_smithi188_161190_object87369:head# 2024-04-01T19:56:57.056 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.056 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:926eedf5:::benchmark_data_smithi188_161190_object99001:head# 2024-04-01T19:56:57.056 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.056 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92704f88:::benchmark_data_smithi188_161190_object32432:head# 2024-04-01T19:56:57.056 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.056 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9270fda2:::benchmark_data_smithi188_161190_object100307:head# 2024-04-01T19:56:57.056 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.056 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:927129f4:::benchmark_data_smithi188_161190_object35942:head# 2024-04-01T19:56:57.056 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.056 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92713ff4:::benchmark_data_smithi188_161190_object120289:head# 2024-04-01T19:56:57.057 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.057 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92727027:::benchmark_data_smithi188_161190_object93691:head# 2024-04-01T19:56:57.057 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.057 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9272f5eb:::benchmark_data_smithi188_161190_object37421:head# 2024-04-01T19:56:57.057 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.059 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9272fc4e:::benchmark_data_smithi188_161190_object85321:head# 2024-04-01T19:56:57.059 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.060 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9274663e:::benchmark_data_smithi188_161190_object102501:head# 2024-04-01T19:56:57.060 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.060 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92746b40:::benchmark_data_smithi188_161190_object21088:head# 2024-04-01T19:56:57.060 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.061 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92750c29:::benchmark_data_smithi188_161190_object76348:head# 2024-04-01T19:56:57.062 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.062 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:927586e2:::benchmark_data_smithi188_161190_object25634:head# 2024-04-01T19:56:57.062 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.062 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9275a9d0:::benchmark_data_smithi188_161190_object83837:head# 2024-04-01T19:56:57.062 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.062 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92764764:::benchmark_data_smithi188_161190_object95186:head# 2024-04-01T19:56:57.062 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.062 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9277f2bb:::benchmark_data_smithi188_161190_object75028:head# 2024-04-01T19:56:57.062 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.063 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9278ec14:::benchmark_data_smithi188_161190_object37937:head# 2024-04-01T19:56:57.063 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.063 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92790490:::benchmark_data_smithi188_161190_object106268:head# 2024-04-01T19:56:57.063 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.063 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:927964b8:::benchmark_data_smithi188_161190_object112188:head# 2024-04-01T19:56:57.063 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.063 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:927992d8:::benchmark_data_smithi188_161190_object108634:head# 2024-04-01T19:56:57.063 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.065 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9279e7d1:::benchmark_data_smithi188_161190_object53913:head# 2024-04-01T19:56:57.065 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.065 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:927b2342:::benchmark_data_smithi188_161190_object107110:head# 2024-04-01T19:56:57.065 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.065 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:927b5969:::benchmark_data_smithi188_161190_object48465:head# 2024-04-01T19:56:57.065 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.065 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:927b7363:::benchmark_data_smithi188_161190_object105329:head# 2024-04-01T19:56:57.065 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.065 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:927b7896:::benchmark_data_smithi188_161190_object47849:head# 2024-04-01T19:56:57.065 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.065 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:927b7e37:::benchmark_data_smithi188_161190_object84382:head# 2024-04-01T19:56:57.066 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.066 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:927c2e51:::benchmark_data_smithi188_161190_object90932:head# 2024-04-01T19:56:57.066 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.067 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:927c6abe:::benchmark_data_smithi188_161190_object96903:head# 2024-04-01T19:56:57.067 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.067 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:927c7a5a:::benchmark_data_smithi188_161190_object72530:head# 2024-04-01T19:56:57.067 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.067 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:927ce6ad:::benchmark_data_smithi188_161190_object109659:head# 2024-04-01T19:56:57.067 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.067 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:927d1a2b:::benchmark_data_smithi188_161190_object60123:head# 2024-04-01T19:56:57.067 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.067 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:927d5da2:::benchmark_data_smithi188_161190_object103307:head# 2024-04-01T19:56:57.067 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.067 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:927df318:::benchmark_data_smithi188_161190_object117231:head# 2024-04-01T19:56:57.067 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.067 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:927e4324:::benchmark_data_smithi188_161190_object129661:head# 2024-04-01T19:56:57.067 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.068 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:927e5a70:::benchmark_data_smithi188_161190_object33706:head# 2024-04-01T19:56:57.069 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.069 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:927e7c22:::benchmark_data_smithi188_161190_object36346:head# 2024-04-01T19:56:57.069 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.069 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:927face5:::benchmark_data_smithi188_161190_object138212:head# 2024-04-01T19:56:57.069 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.069 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:928050e4:::benchmark_data_smithi188_161190_object92775:head# 2024-04-01T19:56:57.069 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.069 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9280e23e:::benchmark_data_smithi188_161190_object41360:head# 2024-04-01T19:56:57.069 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.069 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:928240ed:::benchmark_data_smithi188_161190_object37000:head# 2024-04-01T19:56:57.069 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.069 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:928262ab:::benchmark_data_smithi188_161190_object65439:head# 2024-04-01T19:56:57.070 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.071 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:928274a9:::benchmark_data_smithi188_161190_object113339:head# 2024-04-01T19:56:57.071 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.072 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9282c41d:::benchmark_data_smithi188_161190_object87854:head# 2024-04-01T19:56:57.072 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.072 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:928332f3:::benchmark_data_smithi188_161190_object115572:head# 2024-04-01T19:56:57.072 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.072 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92836e27:::benchmark_data_smithi188_161190_object87452:head# 2024-04-01T19:56:57.072 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.072 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:928437c5:::benchmark_data_smithi188_161190_object51633:head# 2024-04-01T19:56:57.072 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.072 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92843f0c:::benchmark_data_smithi188_161190_object75343:head# 2024-04-01T19:56:57.072 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.072 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9284704e:::benchmark_data_smithi188_161190_object63498:head# 2024-04-01T19:56:57.072 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.072 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9286bb87:::benchmark_data_smithi188_161190_object54618:head# 2024-04-01T19:56:57.073 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.073 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9286d40e:::benchmark_data_smithi188_161190_object61517:head# 2024-04-01T19:56:57.073 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.073 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9286db54:::benchmark_data_smithi188_161190_object116586:head# 2024-04-01T19:56:57.073 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.073 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92882234:::benchmark_data_smithi188_161190_object89187:head# 2024-04-01T19:56:57.073 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.073 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92893867:::benchmark_data_smithi188_161190_object118538:head# 2024-04-01T19:56:57.073 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.075 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:928a556e:::benchmark_data_smithi188_161190_object135529:head# 2024-04-01T19:56:57.075 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.076 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:928a65ec:::benchmark_data_smithi188_161190_object126121:head# 2024-04-01T19:56:57.076 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.076 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:928b59b0:::benchmark_data_smithi188_161190_object44016:head# 2024-04-01T19:56:57.076 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.076 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:928b6c70:::benchmark_data_smithi188_161190_object121646:head# 2024-04-01T19:56:57.076 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.076 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:928c45f0:::benchmark_data_smithi188_161190_object116191:head# 2024-04-01T19:56:57.076 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.076 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:928c8239:::benchmark_data_smithi188_161190_object120406:head# 2024-04-01T19:56:57.076 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.076 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:928cc653:::benchmark_data_smithi188_161190_object86970:head# 2024-04-01T19:56:57.076 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.076 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:929001ae:::benchmark_data_smithi188_161190_object84504:head# 2024-04-01T19:56:57.076 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.076 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92905403:::benchmark_data_smithi188_161190_object108384:head# 2024-04-01T19:56:57.077 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.077 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9290cdb1:::benchmark_data_smithi188_161190_object73803:head# 2024-04-01T19:56:57.077 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.077 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9290d460:::benchmark_data_smithi188_161190_object72666:head# 2024-04-01T19:56:57.077 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.077 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:929146ef:::benchmark_data_smithi188_161190_object123934:head# 2024-04-01T19:56:57.077 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.077 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92917bb1:::benchmark_data_smithi188_161190_object74641:head# 2024-04-01T19:56:57.077 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.077 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92918314:::benchmark_data_smithi188_161190_object126397:head# 2024-04-01T19:56:57.077 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.079 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:929234b5:::benchmark_data_smithi188_161190_object99097:head# 2024-04-01T19:56:57.079 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.079 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92925054:::benchmark_data_smithi188_161190_object39109:head# 2024-04-01T19:56:57.079 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.079 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9292ed7d:::benchmark_data_smithi188_161190_object70712:head# 2024-04-01T19:56:57.080 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.080 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9292f0da:::benchmark_data_smithi188_161190_object60165:head# 2024-04-01T19:56:57.080 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.080 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92930a8f:::benchmark_data_smithi188_161190_object99411:head# 2024-04-01T19:56:57.080 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.080 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92935b2f:::benchmark_data_smithi188_161190_object45064:head# 2024-04-01T19:56:57.080 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.080 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92959399:::benchmark_data_smithi188_161190_object39707:head# 2024-04-01T19:56:57.080 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.080 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9295d34d:::benchmark_data_smithi188_161190_object32601:head# 2024-04-01T19:56:57.080 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.080 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92963fe5:::benchmark_data_smithi188_161190_object126803:head# 2024-04-01T19:56:57.080 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.080 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92968338:::benchmark_data_smithi188_161190_object23209:head# 2024-04-01T19:56:57.080 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.081 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9296986b:::benchmark_data_smithi188_161190_object88608:head# 2024-04-01T19:56:57.081 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.081 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9296c154:::benchmark_data_smithi188_161190_object35820:head# 2024-04-01T19:56:57.081 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.081 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9296d86b:::benchmark_data_smithi188_161190_object86773:head# 2024-04-01T19:56:57.081 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.081 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9297a81e:::benchmark_data_smithi188_161190_object132093:head# 2024-04-01T19:56:57.081 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.085 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:929927c1:::benchmark_data_smithi188_161190_object37326:head# 2024-04-01T19:56:57.086 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.090 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9299a3cb:::benchmark_data_smithi188_161190_object105431:head# 2024-04-01T19:56:57.090 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.091 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:929a4892:::benchmark_data_smithi188_161190_object80132:head# 2024-04-01T19:56:57.091 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.091 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:929a5783:::benchmark_data_smithi188_161190_object31828:head# 2024-04-01T19:56:57.091 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.091 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:929b5d21:::benchmark_data_smithi188_161190_object129228:head# 2024-04-01T19:56:57.091 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.091 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:929b6de4:::benchmark_data_smithi188_161190_object29677:head# 2024-04-01T19:56:57.091 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.091 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:929bab2e:::benchmark_data_smithi188_161190_object107061:head# 2024-04-01T19:56:57.091 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.091 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:929bd1fa:::benchmark_data_smithi188_161190_object42691:head# 2024-04-01T19:56:57.091 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.095 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:929cfb5d:::benchmark_data_smithi188_161190_object112864:head# 2024-04-01T19:56:57.095 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.095 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:929d324c:::benchmark_data_smithi188_161190_object99487:head# 2024-04-01T19:56:57.095 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.096 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:929da2dc:::benchmark_data_smithi188_161190_object134233:head# 2024-04-01T19:56:57.096 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.096 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:929dab04:::benchmark_data_smithi188_161190_object119475:head# 2024-04-01T19:56:57.096 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.096 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:929f606b:::benchmark_data_smithi188_161190_object116744:head# 2024-04-01T19:56:57.096 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.096 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:929f7663:::benchmark_data_smithi188_161190_object84348:head# 2024-04-01T19:56:57.096 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.096 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:929f92d8:::benchmark_data_smithi188_161190_object120777:head# 2024-04-01T19:56:57.096 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.096 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:929fbec2:::benchmark_data_smithi188_161190_object26363:head# 2024-04-01T19:56:57.096 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.096 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92a0a424:::benchmark_data_smithi188_161190_object49161:head# 2024-04-01T19:56:57.096 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.097 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92a0f2ed:::benchmark_data_smithi188_161190_object42324:head# 2024-04-01T19:56:57.097 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.097 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92a1421f:::benchmark_data_smithi188_161190_object97027:head# 2024-04-01T19:56:57.097 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.097 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92a1bb9c:::benchmark_data_smithi188_161190_object38331:head# 2024-04-01T19:56:57.097 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.097 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92a1ef6b:::benchmark_data_smithi188_161190_object117816:head# 2024-04-01T19:56:57.097 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.097 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92a27aac:::benchmark_data_smithi188_161190_object96731:head# 2024-04-01T19:56:57.097 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.097 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92a2d0b1:::benchmark_data_smithi188_161190_object51152:head# 2024-04-01T19:56:57.097 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.097 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92a37ef7:::benchmark_data_smithi188_161190_object54715:head# 2024-04-01T19:56:57.097 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.097 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92a3fa50:::benchmark_data_smithi188_161190_object41928:head# 2024-04-01T19:56:57.098 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.098 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92a47ba6:::benchmark_data_smithi188_161190_object121376:head# 2024-04-01T19:56:57.098 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.098 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92a4a748:::benchmark_data_smithi188_161190_object123797:head# 2024-04-01T19:56:57.098 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.099 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92a52a40:::benchmark_data_smithi188_161190_object60648:head# 2024-04-01T19:56:57.099 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.101 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92a58b2e:::benchmark_data_smithi188_161190_object136063:head# 2024-04-01T19:56:57.101 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.102 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92a66b47:::benchmark_data_smithi188_161190_object24937:head# 2024-04-01T19:56:57.102 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.102 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92a682fb:::benchmark_data_smithi188_161190_object34010:head# 2024-04-01T19:56:57.102 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.102 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92a76519:::benchmark_data_smithi188_161190_object101279:head# 2024-04-01T19:56:57.102 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.103 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92a81dde:::benchmark_data_smithi188_161190_object87704:head# 2024-04-01T19:56:57.103 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.103 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92a87128:::benchmark_data_smithi188_161190_object129305:head# 2024-04-01T19:56:57.103 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.103 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92a8e210:::benchmark_data_smithi188_161190_object60295:head# 2024-04-01T19:56:57.104 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.104 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92a919b6:::benchmark_data_smithi188_161190_object118198:head# 2024-04-01T19:56:57.104 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.105 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92aa52dd:::benchmark_data_smithi188_161190_object29044:head# 2024-04-01T19:56:57.105 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.105 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92aa850f:::benchmark_data_smithi188_161190_object37249:head# 2024-04-01T19:56:57.105 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.105 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92aa9423:::benchmark_data_smithi188_161190_object38352:head# 2024-04-01T19:56:57.105 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.105 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92aadeed:::benchmark_data_smithi188_161190_object97790:head# 2024-04-01T19:56:57.105 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.105 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92ab8799:::benchmark_data_smithi188_161190_object131573:head# 2024-04-01T19:56:57.105 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.107 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92ab8f40:::benchmark_data_smithi188_161190_object133990:head# 2024-04-01T19:56:57.107 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.107 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92abc7c8:::benchmark_data_smithi188_161190_object73343:head# 2024-04-01T19:56:57.107 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.107 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92ac88e5:::benchmark_data_smithi188_161190_object107433:head# 2024-04-01T19:56:57.107 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.107 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92ac8a86:::benchmark_data_smithi188_161190_object32863:head# 2024-04-01T19:56:57.107 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.107 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92ad08cf:::benchmark_data_smithi188_161190_object30990:head# 2024-04-01T19:56:57.107 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.107 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92ad1fdc:::benchmark_data_smithi188_161190_object60509:head# 2024-04-01T19:56:57.107 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.108 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92ad4a7a:::benchmark_data_smithi188_161190_object30922:head# 2024-04-01T19:56:57.108 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.109 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92ad5500:::benchmark_data_smithi188_161190_object117260:head# 2024-04-01T19:56:57.109 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.109 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92af2a63:::benchmark_data_smithi188_161190_object55672:head# 2024-04-01T19:56:57.109 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.109 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92af6e6e:::benchmark_data_smithi188_161190_object119477:head# 2024-04-01T19:56:57.109 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.109 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92af7fec:::benchmark_data_smithi188_161190_object124792:head# 2024-04-01T19:56:57.109 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.109 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92b0f2f7:::benchmark_data_smithi188_161190_object91003:head# 2024-04-01T19:56:57.109 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.109 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92b130d8:::benchmark_data_smithi188_161190_object62124:head# 2024-04-01T19:56:57.110 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.110 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92b15788:::benchmark_data_smithi188_161190_object47818:head# 2024-04-01T19:56:57.110 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.111 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92b20e4a:::benchmark_data_smithi188_161190_object87527:head# 2024-04-01T19:56:57.111 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.111 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92b24f0b:::benchmark_data_smithi188_161190_object48297:head# 2024-04-01T19:56:57.111 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.111 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92b2fa77:::benchmark_data_smithi188_161190_object116089:head# 2024-04-01T19:56:57.112 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.112 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92b4093f:::benchmark_data_smithi188_161190_object127770:head# 2024-04-01T19:56:57.112 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.112 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92b43c99:::benchmark_data_smithi188_161190_object24391:head# 2024-04-01T19:56:57.112 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.112 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92b44c4e:::benchmark_data_smithi188_161190_object54617:head# 2024-04-01T19:56:57.112 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.112 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92b4aca6:::benchmark_data_smithi188_161190_object130405:head# 2024-04-01T19:56:57.112 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.112 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92b4ed15:::benchmark_data_smithi188_161190_object119660:head# 2024-04-01T19:56:57.112 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.112 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92b58dfb:::benchmark_data_smithi188_161190_object82620:head# 2024-04-01T19:56:57.112 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.113 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92b591dc:::benchmark_data_smithi188_161190_object31558:head# 2024-04-01T19:56:57.113 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.113 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92b62541:::benchmark_data_smithi188_161190_object67549:head# 2024-04-01T19:56:57.113 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.117 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92b6edcf:::benchmark_data_smithi188_161190_object67336:head# 2024-04-01T19:56:57.117 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.117 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92b771e7:::benchmark_data_smithi188_161190_object68011:head# 2024-04-01T19:56:57.117 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.117 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92b7f503:::benchmark_data_smithi188_161190_object128223:head# 2024-04-01T19:56:57.117 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.118 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92b93e53:::benchmark_data_smithi188_161190_object55499:head# 2024-04-01T19:56:57.118 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.118 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92b9777a:::benchmark_data_smithi188_161190_object62993:head# 2024-04-01T19:56:57.118 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.119 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92b9f598:::benchmark_data_smithi188_161190_object50614:head# 2024-04-01T19:56:57.119 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.119 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92ba0c6b:::benchmark_data_smithi188_161190_object132022:head# 2024-04-01T19:56:57.119 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.119 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92babf85:::benchmark_data_smithi188_161190_object116000:head# 2024-04-01T19:56:57.119 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.120 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92bbb436:::benchmark_data_smithi188_161190_object101101:head# 2024-04-01T19:56:57.120 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.120 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92be095e:::benchmark_data_smithi188_161190_object130695:head# 2024-04-01T19:56:57.120 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.120 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92be4c8d:::benchmark_data_smithi188_161190_object120407:head# 2024-04-01T19:56:57.121 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.121 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92be7b44:::benchmark_data_smithi188_161190_object79581:head# 2024-04-01T19:56:57.121 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.121 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92bf6523:::benchmark_data_smithi188_161190_object110469:head# 2024-04-01T19:56:57.121 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.122 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92c05a99:::benchmark_data_smithi188_161190_object69889:head# 2024-04-01T19:56:57.122 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.122 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92c250b8:::benchmark_data_smithi188_161190_object50847:head# 2024-04-01T19:56:57.122 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.122 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92c2b43a:::benchmark_data_smithi188_161190_object94818:head# 2024-04-01T19:56:57.122 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.123 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92c2ebba:::benchmark_data_smithi188_161190_object128629:head# 2024-04-01T19:56:57.123 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.123 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92c3eac5:::benchmark_data_smithi188_161190_object21923:head# 2024-04-01T19:56:57.123 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.124 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92c413de:::benchmark_data_smithi188_161190_object40376:head# 2024-04-01T19:56:57.124 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.125 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92c46849:::benchmark_data_smithi188_161190_object24620:head# 2024-04-01T19:56:57.125 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.125 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92c4e56b:::benchmark_data_smithi188_161190_object85999:head# 2024-04-01T19:56:57.125 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.125 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92c50e85:::benchmark_data_smithi188_161190_object78877:head# 2024-04-01T19:56:57.125 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.125 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92c54a4a:::benchmark_data_smithi188_161190_object100651:head# 2024-04-01T19:56:57.125 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.127 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92c55013:::benchmark_data_smithi188_161190_object27573:head# 2024-04-01T19:56:57.128 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.128 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92c5a192:::benchmark_data_smithi188_161190_object43090:head# 2024-04-01T19:56:57.128 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.128 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92c5d100:::benchmark_data_smithi188_161190_object125170:head# 2024-04-01T19:56:57.128 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.128 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92c8283d:::benchmark_data_smithi188_161190_object129036:head# 2024-04-01T19:56:57.128 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.128 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92c8d600:::benchmark_data_smithi188_161190_object84949:head# 2024-04-01T19:56:57.128 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.128 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92c94f04:::benchmark_data_smithi188_161190_object41221:head# 2024-04-01T19:56:57.128 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.128 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92c9563a:::benchmark_data_smithi188_161190_object76748:head# 2024-04-01T19:56:57.128 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.129 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92c9e1b7:::benchmark_data_smithi188_161190_object106302:head# 2024-04-01T19:56:57.129 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.129 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92ca0681:::benchmark_data_smithi188_161190_object131246:head# 2024-04-01T19:56:57.129 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.131 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92cae266:::benchmark_data_smithi188_161190_object82898:head# 2024-04-01T19:56:57.131 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.131 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92cb2ba9:::benchmark_data_smithi188_161190_object37446:head# 2024-04-01T19:56:57.131 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.131 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92cb3bd0:::benchmark_data_smithi188_161190_object61841:head# 2024-04-01T19:56:57.131 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.131 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92cb4bcf:::benchmark_data_smithi188_161190_object27115:head# 2024-04-01T19:56:57.131 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.131 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92ccdc1e:::benchmark_data_smithi188_161190_object124506:head# 2024-04-01T19:56:57.131 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.131 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92ce8023:::benchmark_data_smithi188_161190_object39931:head# 2024-04-01T19:56:57.131 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.132 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92ce84c4:::benchmark_data_smithi188_161190_object43125:head# 2024-04-01T19:56:57.132 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.132 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92cf90ce:::benchmark_data_smithi188_161190_object123466:head# 2024-04-01T19:56:57.132 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.132 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92cfb9be:::benchmark_data_smithi188_161190_object32192:head# 2024-04-01T19:56:57.132 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.132 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92cffd81:::benchmark_data_smithi188_161190_object81729:head# 2024-04-01T19:56:57.132 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.132 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92d06833:::benchmark_data_smithi188_161190_object125532:head# 2024-04-01T19:56:57.132 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.138 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92d0a0b7:::benchmark_data_smithi188_161190_object49240:head# 2024-04-01T19:56:57.138 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.138 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92d0a232:::benchmark_data_smithi188_161190_object36750:head# 2024-04-01T19:56:57.138 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.138 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92d0b7f1:::benchmark_data_smithi188_161190_object77631:head# 2024-04-01T19:56:57.138 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.138 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92d0e161:::benchmark_data_smithi188_161190_object27474:head# 2024-04-01T19:56:57.138 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.139 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92d13467:::benchmark_data_smithi188_161190_object67065:head# 2024-04-01T19:56:57.139 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.139 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92d2994b:::benchmark_data_smithi188_161190_object53304:head# 2024-04-01T19:56:57.139 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.139 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92d2f5be:::benchmark_data_smithi188_161190_object32292:head# 2024-04-01T19:56:57.139 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.139 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92d30393:::benchmark_data_smithi188_161190_object116983:head# 2024-04-01T19:56:57.139 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.139 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92d35d82:::benchmark_data_smithi188_161190_object62136:head# 2024-04-01T19:56:57.139 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.139 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92d3d006:::benchmark_data_smithi188_161190_object65928:head# 2024-04-01T19:56:57.139 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.139 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92d4c046:::benchmark_data_smithi188_161190_object87504:head# 2024-04-01T19:56:57.139 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.140 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92d4dc52:::benchmark_data_smithi188_161190_object123299:head# 2024-04-01T19:56:57.140 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.140 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92d52c36:::benchmark_data_smithi188_161190_object40968:head# 2024-04-01T19:56:57.140 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.140 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92d6c1f4:::benchmark_data_smithi188_161190_object49441:head# 2024-04-01T19:56:57.140 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.140 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92d70897:::benchmark_data_smithi188_161190_object60738:head# 2024-04-01T19:56:57.140 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.140 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92d7a80c:::benchmark_data_smithi188_161190_object37711:head# 2024-04-01T19:56:57.140 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.140 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92d7fcaa:::benchmark_data_smithi188_161190_object108841:head# 2024-04-01T19:56:57.140 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.140 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92d801fe:::benchmark_data_smithi188_161190_object25523:head# 2024-04-01T19:56:57.141 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.141 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92d81e63:::benchmark_data_smithi188_161190_object28921:head# 2024-04-01T19:56:57.141 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.141 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92d897c0:::benchmark_data_smithi188_161190_object118968:head# 2024-04-01T19:56:57.141 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.141 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92d8b261:::benchmark_data_smithi188_161190_object22315:head# 2024-04-01T19:56:57.141 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.141 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92d8f47d:::benchmark_data_smithi188_161190_object54524:head# 2024-04-01T19:56:57.141 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.141 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92d96d16:::benchmark_data_smithi188_161190_object56222:head# 2024-04-01T19:56:57.141 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.141 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92da2347:::benchmark_data_smithi188_161190_object73308:head# 2024-04-01T19:56:57.141 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.141 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92da3004:::benchmark_data_smithi188_161190_object86477:head# 2024-04-01T19:56:57.141 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.142 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92daacd4:::benchmark_data_smithi188_161190_object136926:head# 2024-04-01T19:56:57.142 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.142 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92dacfbc:::benchmark_data_smithi188_161190_object51705:head# 2024-04-01T19:56:57.142 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.142 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92dbec73:::benchmark_data_smithi188_161190_object119485:head# 2024-04-01T19:56:57.142 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.142 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92dcea3b:::benchmark_data_smithi188_161190_object136581:head# 2024-04-01T19:56:57.142 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.142 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92de1533:::benchmark_data_smithi188_161190_object59302:head# 2024-04-01T19:56:57.142 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.145 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92dfd1ac:::benchmark_data_smithi188_161190_object49571:head# 2024-04-01T19:56:57.145 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.145 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92e002ce:::benchmark_data_smithi188_161190_object128667:head# 2024-04-01T19:56:57.145 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.145 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92e01a5d:::benchmark_data_smithi188_161190_object43096:head# 2024-04-01T19:56:57.145 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.145 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92e01d8a:::benchmark_data_smithi188_161190_object78424:head# 2024-04-01T19:56:57.145 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.145 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92e0d232:::benchmark_data_smithi188_161190_object96777:head# 2024-04-01T19:56:57.146 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.146 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92e1bf4a:::benchmark_data_smithi188_161190_object63334:head# 2024-04-01T19:56:57.146 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.146 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92e1f983:::benchmark_data_smithi188_161190_object65359:head# 2024-04-01T19:56:57.146 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.146 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92e20b85:::benchmark_data_smithi188_161190_object131499:head# 2024-04-01T19:56:57.146 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.146 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92e20d6b:::benchmark_data_smithi188_161190_object116883:head# 2024-04-01T19:56:57.146 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.146 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92e38c43:::benchmark_data_smithi188_161190_object127862:head# 2024-04-01T19:56:57.146 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.146 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92e3b00e:::benchmark_data_smithi188_161190_object120190:head# 2024-04-01T19:56:57.146 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.146 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92e4305c:::benchmark_data_smithi188_161190_object59807:head# 2024-04-01T19:56:57.147 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.147 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92e4b643:::benchmark_data_smithi188_161190_object41896:head# 2024-04-01T19:56:57.147 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.147 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92e57912:::benchmark_data_smithi188_161190_object86967:head# 2024-04-01T19:56:57.147 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.147 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92e5c046:::benchmark_data_smithi188_161190_object41356:head# 2024-04-01T19:56:57.147 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.147 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92e62d5a:::benchmark_data_smithi188_161190_object91086:head# 2024-04-01T19:56:57.147 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.147 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92e64e1e:::benchmark_data_smithi188_161190_object30585:head# 2024-04-01T19:56:57.147 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.147 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92e7601d:::benchmark_data_smithi188_161190_object124107:head# 2024-04-01T19:56:57.147 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.148 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92e7f911:::benchmark_data_smithi188_161190_object58921:head# 2024-04-01T19:56:57.149 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.149 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92e88d35:::benchmark_data_smithi188_161190_object26147:head# 2024-04-01T19:56:57.149 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.149 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92e8bbc4:::benchmark_data_smithi188_161190_object73360:head# 2024-04-01T19:56:57.149 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.149 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92e9a4a1:::benchmark_data_smithi188_161190_object133566:head# 2024-04-01T19:56:57.149 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.149 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92e9e7d5:::benchmark_data_smithi188_161190_object56252:head# 2024-04-01T19:56:57.149 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.149 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92ea24a3:::benchmark_data_smithi188_161190_object25384:head# 2024-04-01T19:56:57.149 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.149 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92ea65c2:::benchmark_data_smithi188_161190_object71505:head# 2024-04-01T19:56:57.149 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.150 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92eaef15:::benchmark_data_smithi188_161190_object134131:head# 2024-04-01T19:56:57.150 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.150 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92eb0ff9:::benchmark_data_smithi188_161190_object133919:head# 2024-04-01T19:56:57.150 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.150 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92eb1177:::benchmark_data_smithi188_161190_object126500:head# 2024-04-01T19:56:57.150 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.150 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92ebac1f:::benchmark_data_smithi188_161190_object101712:head# 2024-04-01T19:56:57.150 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.152 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92ed27ce:::benchmark_data_smithi188_161190_object56573:head# 2024-04-01T19:56:57.152 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.152 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92ed913d:::benchmark_data_smithi188_161190_object102258:head# 2024-04-01T19:56:57.152 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.152 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92ef40a7:::benchmark_data_smithi188_161190_object102183:head# 2024-04-01T19:56:57.153 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.153 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92ef5d49:::benchmark_data_smithi188_161190_object38670:head# 2024-04-01T19:56:57.153 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.153 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92efacfe:::benchmark_data_smithi188_161190_object86673:head# 2024-04-01T19:56:57.153 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.153 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92efc583:::benchmark_data_smithi188_161190_object50426:head# 2024-04-01T19:56:57.153 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.153 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f05baf:::benchmark_data_smithi188_161190_object118743:head# 2024-04-01T19:56:57.153 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.153 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f0b784:::benchmark_data_smithi188_161190_object47564:head# 2024-04-01T19:56:57.153 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.153 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f15829:::benchmark_data_smithi188_161190_object73991:head# 2024-04-01T19:56:57.153 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.153 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f1b9db:::benchmark_data_smithi188_161190_object68154:head# 2024-04-01T19:56:57.154 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.154 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f26ccc:::benchmark_data_smithi188_161190_object26884:head# 2024-04-01T19:56:57.154 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.154 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f28dcb:::benchmark_data_smithi188_161190_object64234:head# 2024-04-01T19:56:57.154 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.157 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f2f317:::benchmark_data_smithi188_161190_object91551:head# 2024-04-01T19:56:57.157 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.157 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f34d51:::benchmark_data_smithi188_161190_object66825:head# 2024-04-01T19:56:57.157 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.157 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f36451:::benchmark_data_smithi188_161190_object24612:head# 2024-04-01T19:56:57.158 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.158 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f36fcb:::benchmark_data_smithi188_161190_object107435:head# 2024-04-01T19:56:57.158 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.158 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f413e0:::benchmark_data_smithi188_161190_object127330:head# 2024-04-01T19:56:57.158 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.158 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f66430:::benchmark_data_smithi188_161190_object49297:head# 2024-04-01T19:56:57.158 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.158 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f6812b:::benchmark_data_smithi188_161190_object42412:head# 2024-04-01T19:56:57.158 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.158 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f7018a:::benchmark_data_smithi188_161190_object110368:head# 2024-04-01T19:56:57.158 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.158 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f745ca:::benchmark_data_smithi188_161190_object60310:head# 2024-04-01T19:56:57.158 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.159 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f7b35c:::benchmark_data_smithi188_161190_object105767:head# 2024-04-01T19:56:57.159 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.159 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f7ecfe:::benchmark_data_smithi188_161190_object135231:head# 2024-04-01T19:56:57.159 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.159 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f81a8b:::benchmark_data_smithi188_161190_object107561:head# 2024-04-01T19:56:57.159 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.159 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f83720:::benchmark_data_smithi188_161190_object126151:head# 2024-04-01T19:56:57.159 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.159 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f8c7b6:::benchmark_data_smithi188_161190_object45339:head# 2024-04-01T19:56:57.159 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.163 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f91cb9:::benchmark_data_smithi188_161190_object47021:head# 2024-04-01T19:56:57.163 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.163 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f92342:::benchmark_data_smithi188_161190_object72178:head# 2024-04-01T19:56:57.163 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.163 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f94669:::benchmark_data_smithi188_161190_object52043:head# 2024-04-01T19:56:57.164 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.164 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f97ed9:::benchmark_data_smithi188_161190_object56448:head# 2024-04-01T19:56:57.164 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.164 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f9a823:::benchmark_data_smithi188_161190_object38073:head# 2024-04-01T19:56:57.164 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.164 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92f9d4ff:::benchmark_data_smithi188_161190_object61022:head# 2024-04-01T19:56:57.164 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.164 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92fa2af3:::benchmark_data_smithi188_161190_object127275:head# 2024-04-01T19:56:57.164 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.164 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92fac8d8:::benchmark_data_smithi188_161190_object95308:head# 2024-04-01T19:56:57.164 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.164 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92fafac4:::benchmark_data_smithi188_161190_object35977:head# 2024-04-01T19:56:57.164 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.164 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92fafacb:::benchmark_data_smithi188_161190_object90362:head# 2024-04-01T19:56:57.164 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.164 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92fafd45:::benchmark_data_smithi188_161190_object96642:head# 2024-04-01T19:56:57.165 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.165 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92fc7e3a:::benchmark_data_smithi188_161190_object96909:head# 2024-04-01T19:56:57.165 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.165 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92fda225:::benchmark_data_smithi188_161190_object30826:head# 2024-04-01T19:56:57.165 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.165 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92fda2bb:::benchmark_data_smithi188_161190_object19985:head# 2024-04-01T19:56:57.165 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.165 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92fdf474:::benchmark_data_smithi188_161190_object58134:head# 2024-04-01T19:56:57.165 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.165 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92fe2633:::benchmark_data_smithi188_161190_object138214:head# 2024-04-01T19:56:57.165 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.165 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92fe7858:::benchmark_data_smithi188_161190_object61256:head# 2024-04-01T19:56:57.165 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.165 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92fe9c51:::benchmark_data_smithi188_161190_object38361:head# 2024-04-01T19:56:57.165 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.165 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92febdc5:::benchmark_data_smithi188_161190_object127079:head# 2024-04-01T19:56:57.166 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.166 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:92fed298:::benchmark_data_smithi188_161190_object53162:head# 2024-04-01T19:56:57.166 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.166 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:930051de:::benchmark_data_smithi188_161190_object52909:head# 2024-04-01T19:56:57.166 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.166 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:930179af:::benchmark_data_smithi188_161190_object37142:head# 2024-04-01T19:56:57.166 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.166 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93018596:::benchmark_data_smithi188_161190_object42470:head# 2024-04-01T19:56:57.166 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.166 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9301cfbb:::benchmark_data_smithi188_161190_object76992:head# 2024-04-01T19:56:57.166 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.167 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93021192:::benchmark_data_smithi188_161190_object93115:head# 2024-04-01T19:56:57.167 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.167 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93032da6:::benchmark_data_smithi188_161190_object67554:head# 2024-04-01T19:56:57.168 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.168 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9304032c:::benchmark_data_smithi188_161190_object69957:head# 2024-04-01T19:56:57.168 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.168 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9304dc82:::benchmark_data_smithi188_161190_object30069:head# 2024-04-01T19:56:57.168 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.168 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:930519f4:::benchmark_data_smithi188_161190_object131888:head# 2024-04-01T19:56:57.168 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.168 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93051df8:::benchmark_data_smithi188_161190_object43724:head# 2024-04-01T19:56:57.168 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.168 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93052806:::benchmark_data_smithi188_161190_object111001:head# 2024-04-01T19:56:57.168 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.170 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9305d682:::benchmark_data_smithi188_161190_object112118:head# 2024-04-01T19:56:57.170 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.170 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93074930:::benchmark_data_smithi188_161190_object31127:head# 2024-04-01T19:56:57.170 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.170 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9307befb:::benchmark_data_smithi188_161190_object75215:head# 2024-04-01T19:56:57.170 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.170 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9308e1d2:::benchmark_data_smithi188_161190_object126413:head# 2024-04-01T19:56:57.170 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.170 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93090a71:::benchmark_data_smithi188_161190_object23080:head# 2024-04-01T19:56:57.171 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.171 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:930a0716:::benchmark_data_smithi188_161190_object32715:head# 2024-04-01T19:56:57.171 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.171 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:930a4f8e:::benchmark_data_smithi188_161190_object106129:head# 2024-04-01T19:56:57.171 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.171 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:930b320d:::benchmark_data_smithi188_161190_object137394:head# 2024-04-01T19:56:57.171 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.172 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:930b5f8d:::benchmark_data_smithi188_161190_object63454:head# 2024-04-01T19:56:57.172 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.172 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:930b6a9d:::benchmark_data_smithi188_161190_object74992:head# 2024-04-01T19:56:57.172 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.172 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:930b885f:::benchmark_data_smithi188_161190_object117757:head# 2024-04-01T19:56:57.172 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.172 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:930cdece:::benchmark_data_smithi188_161190_object72702:head# 2024-04-01T19:56:57.172 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.172 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:930e9435:::benchmark_data_smithi188_161190_object56591:head# 2024-04-01T19:56:57.172 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.176 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:930ef669:::benchmark_data_smithi188_161190_object53216:head# 2024-04-01T19:56:57.177 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.177 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:930ef75b:::benchmark_data_smithi188_161190_object105047:head# 2024-04-01T19:56:57.177 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.177 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93101f10:::benchmark_data_smithi188_161190_object49197:head# 2024-04-01T19:56:57.177 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.179 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:931042dd:::benchmark_data_smithi188_161190_object95789:head# 2024-04-01T19:56:57.179 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.180 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9310bba1:::benchmark_data_smithi188_161190_object34744:head# 2024-04-01T19:56:57.181 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.181 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93115460:::benchmark_data_smithi188_161190_object45092:head# 2024-04-01T19:56:57.181 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.181 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93123579:::benchmark_data_smithi188_161190_object97341:head# 2024-04-01T19:56:57.181 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.181 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9312ec1c:::benchmark_data_smithi188_161190_object89021:head# 2024-04-01T19:56:57.181 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.183 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:931445d5:::benchmark_data_smithi188_161190_object82609:head# 2024-04-01T19:56:57.183 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.183 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93148722:::benchmark_data_smithi188_161190_object80897:head# 2024-04-01T19:56:57.183 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.183 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93149539:::benchmark_data_smithi188_161190_object95611:head# 2024-04-01T19:56:57.183 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.183 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9314f49a:::benchmark_data_smithi188_161190_object97360:head# 2024-04-01T19:56:57.183 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.184 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93153bea:::benchmark_data_smithi188_161190_object22303:head# 2024-04-01T19:56:57.184 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.184 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9318b87c:::benchmark_data_smithi188_161190_object68908:head# 2024-04-01T19:56:57.184 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.184 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9319c01e:::benchmark_data_smithi188_161190_object107716:head# 2024-04-01T19:56:57.184 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.184 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9319e56c:::benchmark_data_smithi188_161190_object57814:head# 2024-04-01T19:56:57.184 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.184 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:931a152f:::benchmark_data_smithi188_161190_object114612:head# 2024-04-01T19:56:57.184 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.184 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:931ac9b1:::benchmark_data_smithi188_161190_object26960:head# 2024-04-01T19:56:57.184 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.186 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:931af441:::benchmark_data_smithi188_161190_object94659:head# 2024-04-01T19:56:57.186 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.186 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:931b64d4:::benchmark_data_smithi188_161190_object134141:head# 2024-04-01T19:56:57.186 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.186 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:931bf879:::benchmark_data_smithi188_161190_object90607:head# 2024-04-01T19:56:57.187 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.187 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:931e6159:::benchmark_data_smithi188_161190_object118738:head# 2024-04-01T19:56:57.187 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.187 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:931efc01:::benchmark_data_smithi188_161190_object115362:head# 2024-04-01T19:56:57.187 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.187 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:931f8dd2:::benchmark_data_smithi188_161190_object122283:head# 2024-04-01T19:56:57.187 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.187 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9320050c:::benchmark_data_smithi188_161190_object133701:head# 2024-04-01T19:56:57.187 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.187 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93213fa2:::benchmark_data_smithi188_161190_object46986:head# 2024-04-01T19:56:57.187 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.187 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93215974:::benchmark_data_smithi188_161190_object109093:head# 2024-04-01T19:56:57.187 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.187 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9321a3f0:::benchmark_data_smithi188_161190_object42075:head# 2024-04-01T19:56:57.188 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.188 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93222261:::benchmark_data_smithi188_161190_object130256:head# 2024-04-01T19:56:57.188 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.188 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93224aa3:::benchmark_data_smithi188_161190_object40021:head# 2024-04-01T19:56:57.188 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.188 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93233fea:::benchmark_data_smithi188_161190_object93908:head# 2024-04-01T19:56:57.188 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.190 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93247cf9:::benchmark_data_smithi188_161190_object121593:head# 2024-04-01T19:56:57.190 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.191 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9324d8d1:::benchmark_data_smithi188_161190_object55966:head# 2024-04-01T19:56:57.191 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.191 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:932501ac:::benchmark_data_smithi188_161190_object55924:head# 2024-04-01T19:56:57.191 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.191 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93253198:::benchmark_data_smithi188_161190_object64303:head# 2024-04-01T19:56:57.191 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.191 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93256cbd:::benchmark_data_smithi188_161190_object108316:head# 2024-04-01T19:56:57.191 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.191 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9325ac4f:::benchmark_data_smithi188_161190_object37439:head# 2024-04-01T19:56:57.191 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.191 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9325d8a5:::benchmark_data_smithi188_161190_object109776:head# 2024-04-01T19:56:57.191 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.192 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9327a596:::benchmark_data_smithi188_161190_object82512:head# 2024-04-01T19:56:57.192 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.192 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9327abf1:::benchmark_data_smithi188_161190_object75263:head# 2024-04-01T19:56:57.192 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.192 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9327eefb:::benchmark_data_smithi188_161190_object43095:head# 2024-04-01T19:56:57.192 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.192 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9329bc99:::benchmark_data_smithi188_161190_object105942:head# 2024-04-01T19:56:57.192 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.192 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:932a19cd:::benchmark_data_smithi188_161190_object59218:head# 2024-04-01T19:56:57.192 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.192 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:932a1f9a:::benchmark_data_smithi188_161190_object137225:head# 2024-04-01T19:56:57.192 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.192 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:932b34b0:::benchmark_data_smithi188_161190_object53441:head# 2024-04-01T19:56:57.193 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.193 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:932b3e7c:::benchmark_data_smithi188_161190_object68527:head# 2024-04-01T19:56:57.193 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.193 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:932b97b8:::benchmark_data_smithi188_161190_object24462:head# 2024-04-01T19:56:57.193 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.196 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:932ca2ed:::benchmark_data_smithi188_161190_object76965:head# 2024-04-01T19:56:57.196 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.196 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:932cbaae:::benchmark_data_smithi188_161190_object66264:head# 2024-04-01T19:56:57.196 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.196 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:932d8238:::benchmark_data_smithi188_161190_object72528:head# 2024-04-01T19:56:57.196 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.196 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:932d9c83:::benchmark_data_smithi188_161190_object122603:head# 2024-04-01T19:56:57.196 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.197 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:932da1e0:::benchmark_data_smithi188_161190_object80207:head# 2024-04-01T19:56:57.197 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.197 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:932db5be:::benchmark_data_smithi188_161190_object116578:head# 2024-04-01T19:56:57.197 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.197 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:932e70a8:::benchmark_data_smithi188_161190_object44890:head# 2024-04-01T19:56:57.197 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.197 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:932e972f:::benchmark_data_smithi188_161190_object130388:head# 2024-04-01T19:56:57.197 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.197 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:932f0325:::benchmark_data_smithi188_161190_object94371:head# 2024-04-01T19:56:57.197 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.197 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:932f8f31:::benchmark_data_smithi188_161190_object47739:head# 2024-04-01T19:56:57.197 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.197 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9330060e:::benchmark_data_smithi188_161190_object131398:head# 2024-04-01T19:56:57.197 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.197 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9330d7e5:::benchmark_data_smithi188_161190_object132017:head# 2024-04-01T19:56:57.198 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.198 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9331300f:::benchmark_data_smithi188_161190_object139190:head# 2024-04-01T19:56:57.198 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.198 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:933211f8:::benchmark_data_smithi188_161190_object137443:head# 2024-04-01T19:56:57.198 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.198 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9332599b:::benchmark_data_smithi188_161190_object112253:head# 2024-04-01T19:56:57.198 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.198 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9332e2b6:::benchmark_data_smithi188_161190_object116425:head# 2024-04-01T19:56:57.198 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.198 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93338dba:::benchmark_data_smithi188_161190_object135126:head# 2024-04-01T19:56:57.198 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.198 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9334c017:::benchmark_data_smithi188_161190_object115480:head# 2024-04-01T19:56:57.198 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.198 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93353577:::benchmark_data_smithi188_161190_object31355:head# 2024-04-01T19:56:57.198 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.199 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9335949a:::benchmark_data_smithi188_161190_object97660:head# 2024-04-01T19:56:57.199 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.199 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93366150:::benchmark_data_smithi188_161190_object130553:head# 2024-04-01T19:56:57.199 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.200 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93374254:::benchmark_data_smithi188_161190_object49147:head# 2024-04-01T19:56:57.200 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.200 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:933851f6:::benchmark_data_smithi188_161190_object127632:head# 2024-04-01T19:56:57.200 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.201 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9338801c:::benchmark_data_smithi188_161190_object33819:head# 2024-04-01T19:56:57.201 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.201 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9339330e:::benchmark_data_smithi188_161190_object27177:head# 2024-04-01T19:56:57.201 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.201 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9339ecd4:::benchmark_data_smithi188_161190_object121134:head# 2024-04-01T19:56:57.201 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.202 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:933a388b:::benchmark_data_smithi188_161190_object21994:head# 2024-04-01T19:56:57.202 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.203 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:933a8ac0:::benchmark_data_smithi188_161190_object32141:head# 2024-04-01T19:56:57.203 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.203 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:933ad2d0:::benchmark_data_smithi188_161190_object138475:head# 2024-04-01T19:56:57.203 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.203 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:933b4451:::benchmark_data_smithi188_161190_object133582:head# 2024-04-01T19:56:57.203 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.203 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:933b8925:::benchmark_data_smithi188_161190_object52593:head# 2024-04-01T19:56:57.203 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.203 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:933b9332:::benchmark_data_smithi188_161190_object100755:head# 2024-04-01T19:56:57.203 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.205 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:933bc6be:::benchmark_data_smithi188_161190_object117711:head# 2024-04-01T19:56:57.205 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.205 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:933c85bd:::benchmark_data_smithi188_161190_object115245:head# 2024-04-01T19:56:57.206 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.206 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:933cb0b2:::benchmark_data_smithi188_161190_object61230:head# 2024-04-01T19:56:57.206 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.206 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:933d28e7:::benchmark_data_smithi188_161190_object24121:head# 2024-04-01T19:56:57.206 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.206 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:933d551c:::benchmark_data_smithi188_161190_object52167:head# 2024-04-01T19:56:57.206 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.206 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:933d8511:::benchmark_data_smithi188_161190_object73535:head# 2024-04-01T19:56:57.206 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.206 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:933e7001:::benchmark_data_smithi188_161190_object70006:head# 2024-04-01T19:56:57.206 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.206 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:933f3b46:::benchmark_data_smithi188_161190_object34448:head# 2024-04-01T19:56:57.206 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.206 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93400040:::benchmark_data_smithi188_161190_object71967:head# 2024-04-01T19:56:57.206 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.207 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9340d66b:::benchmark_data_smithi188_161190_object112791:head# 2024-04-01T19:56:57.207 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.207 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93423267:::benchmark_data_smithi188_161190_object29278:head# 2024-04-01T19:56:57.207 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.207 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93431602:::benchmark_data_smithi188_161190_object65320:head# 2024-04-01T19:56:57.207 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.208 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93432606:::benchmark_data_smithi188_161190_object131482:head# 2024-04-01T19:56:57.208 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.208 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93439e10:::benchmark_data_smithi188_161190_object103036:head# 2024-04-01T19:56:57.209 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.209 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9343ddd6:::benchmark_data_smithi188_161190_object137314:head# 2024-04-01T19:56:57.209 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.209 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93449eb2:::benchmark_data_smithi188_161190_object118121:head# 2024-04-01T19:56:57.209 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.209 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9344df36:::benchmark_data_smithi188_161190_object86797:head# 2024-04-01T19:56:57.209 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.209 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9345d85c:::benchmark_data_smithi188_161190_object131583:head# 2024-04-01T19:56:57.209 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.209 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9346086a:::benchmark_data_smithi188_161190_object138434:head# 2024-04-01T19:56:57.209 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.209 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93461e1d:::benchmark_data_smithi188_161190_object103582:head# 2024-04-01T19:56:57.209 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.209 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93462f29:::benchmark_data_smithi188_161190_object76235:head# 2024-04-01T19:56:57.209 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.210 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:934639dd:::benchmark_data_smithi188_161190_object129459:head# 2024-04-01T19:56:57.210 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.210 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93468a35:::benchmark_data_smithi188_161190_object90003:head# 2024-04-01T19:56:57.210 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.212 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9346929d:::benchmark_data_smithi188_161190_object23769:head# 2024-04-01T19:56:57.212 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.212 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93472a48:::benchmark_data_smithi188_161190_object132387:head# 2024-04-01T19:56:57.212 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.212 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9347be1a:::benchmark_data_smithi188_161190_object128294:head# 2024-04-01T19:56:57.212 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.212 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9348bef4:::benchmark_data_smithi188_161190_object65374:head# 2024-04-01T19:56:57.212 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.212 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:934949cb:::benchmark_data_smithi188_161190_object30187:head# 2024-04-01T19:56:57.212 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.212 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:934955b8:::benchmark_data_smithi188_161190_object65565:head# 2024-04-01T19:56:57.212 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.212 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9349e3c7:::benchmark_data_smithi188_161190_object93142:head# 2024-04-01T19:56:57.213 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.213 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9349e522:::benchmark_data_smithi188_161190_object48897:head# 2024-04-01T19:56:57.213 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.213 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:934a3b1a:::benchmark_data_smithi188_161190_object79287:head# 2024-04-01T19:56:57.213 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.213 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:934a8452:::benchmark_data_smithi188_161190_object39296:head# 2024-04-01T19:56:57.213 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.213 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:934aff73:::benchmark_data_smithi188_161190_object94278:head# 2024-04-01T19:56:57.213 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.213 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:934b0446:::benchmark_data_smithi188_161190_object114198:head# 2024-04-01T19:56:57.213 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.213 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:934b1f90:::benchmark_data_smithi188_161190_object70919:head# 2024-04-01T19:56:57.213 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.216 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:934b206a:::benchmark_data_smithi188_161190_object56896:head# 2024-04-01T19:56:57.216 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.217 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:934b7ade:::benchmark_data_smithi188_161190_object128792:head# 2024-04-01T19:56:57.217 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.217 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:934c4dec:::benchmark_data_smithi188_161190_object58556:head# 2024-04-01T19:56:57.217 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.217 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:934c8d64:::benchmark_data_smithi188_161190_object134999:head# 2024-04-01T19:56:57.217 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.217 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:934cba14:::benchmark_data_smithi188_161190_object83344:head# 2024-04-01T19:56:57.217 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.217 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:934cbcb7:::benchmark_data_smithi188_161190_object48138:head# 2024-04-01T19:56:57.217 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.217 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:934d700f:::benchmark_data_smithi188_161190_object114308:head# 2024-04-01T19:56:57.217 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.217 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:934d9547:::benchmark_data_smithi188_161190_object26983:head# 2024-04-01T19:56:57.217 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.218 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:934da773:::benchmark_data_smithi188_161190_object80339:head# 2024-04-01T19:56:57.218 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.218 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:934e0354:::benchmark_data_smithi188_161190_object114595:head# 2024-04-01T19:56:57.218 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.218 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:934e520b:::benchmark_data_smithi188_161190_object59781:head# 2024-04-01T19:56:57.218 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.218 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:934ea9aa:::benchmark_data_smithi188_161190_object82671:head# 2024-04-01T19:56:57.218 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.218 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:934f83f7:::benchmark_data_smithi188_161190_object69711:head# 2024-04-01T19:56:57.218 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.218 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:934f8b67:::benchmark_data_smithi188_161190_object82730:head# 2024-04-01T19:56:57.218 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.218 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:934f9513:::benchmark_data_smithi188_161190_object99231:head# 2024-04-01T19:56:57.218 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.218 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93501ffa:::benchmark_data_smithi188_161190_object61676:head# 2024-04-01T19:56:57.219 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.219 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9350c4fe:::benchmark_data_smithi188_161190_object40797:head# 2024-04-01T19:56:57.219 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.219 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93518768:::benchmark_data_smithi188_161190_object24747:head# 2024-04-01T19:56:57.219 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.219 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93520784:::benchmark_data_smithi188_161190_object122031:head# 2024-04-01T19:56:57.219 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.220 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93537353:::benchmark_data_smithi188_161190_object65947:head# 2024-04-01T19:56:57.220 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.221 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9353afb6:::benchmark_data_smithi188_161190_object58334:head# 2024-04-01T19:56:57.221 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.221 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9353d269:::benchmark_data_smithi188_161190_object62322:head# 2024-04-01T19:56:57.221 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.221 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93542e9f:::benchmark_data_smithi188_161190_object33832:head# 2024-04-01T19:56:57.221 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.221 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9354a511:::benchmark_data_smithi188_161190_object129082:head# 2024-04-01T19:56:57.221 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.221 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9354fb88:::benchmark_data_smithi188_161190_object138932:head# 2024-04-01T19:56:57.221 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.221 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93552d19:::benchmark_data_smithi188_161190_object92219:head# 2024-04-01T19:56:57.221 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.221 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93554635:::benchmark_data_smithi188_161190_object37694:head# 2024-04-01T19:56:57.221 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.222 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9355fcdd:::benchmark_data_smithi188_161190_object116023:head# 2024-04-01T19:56:57.222 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.222 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:935628ab:::benchmark_data_smithi188_161190_object127662:head# 2024-04-01T19:56:57.222 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.222 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93566b7a:::benchmark_data_smithi188_161190_object81911:head# 2024-04-01T19:56:57.222 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.233 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9357b039:::benchmark_data_smithi188_161190_object59989:head# 2024-04-01T19:56:57.233 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.233 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9357b2e1:::benchmark_data_smithi188_161190_object97791:head# 2024-04-01T19:56:57.233 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.233 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93580946:::benchmark_data_smithi188_161190_object36815:head# 2024-04-01T19:56:57.233 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.233 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93587bab:::benchmark_data_smithi188_161190_object115315:head# 2024-04-01T19:56:57.233 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.234 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93592908:::benchmark_data_smithi188_161190_object90881:head# 2024-04-01T19:56:57.234 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.234 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:935978d8:::benchmark_data_smithi188_161190_object94747:head# 2024-04-01T19:56:57.234 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.234 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9359d5b0:::benchmark_data_smithi188_161190_object25010:head# 2024-04-01T19:56:57.234 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.234 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:935a9603:::benchmark_data_smithi188_161190_object83154:head# 2024-04-01T19:56:57.234 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.234 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:935aacd0:::benchmark_data_smithi188_161190_object123752:head# 2024-04-01T19:56:57.234 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.234 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:935b504b:::benchmark_data_smithi188_161190_object93132:head# 2024-04-01T19:56:57.234 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.234 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:935bef96:::benchmark_data_smithi188_161190_object73817:head# 2024-04-01T19:56:57.235 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.235 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:935d111d:::benchmark_data_smithi188_161190_object89619:head# 2024-04-01T19:56:57.235 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.235 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:935d9617:::benchmark_data_smithi188_161190_object44766:head# 2024-04-01T19:56:57.235 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.235 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:935e1796:::benchmark_data_smithi188_161190_object28425:head# 2024-04-01T19:56:57.235 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.235 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:935e2139:::benchmark_data_smithi188_161190_object34768:head# 2024-04-01T19:56:57.235 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.235 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:935e3841:::benchmark_data_smithi188_161190_object42084:head# 2024-04-01T19:56:57.235 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.235 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:935eb71c:::benchmark_data_smithi188_161190_object61624:head# 2024-04-01T19:56:57.235 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.235 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:935f2607:::benchmark_data_smithi188_161190_object119561:head# 2024-04-01T19:56:57.235 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.236 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:935f37e7:::benchmark_data_smithi188_161190_object139227:head# 2024-04-01T19:56:57.236 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.236 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:935f6768:::benchmark_data_smithi188_161190_object110288:head# 2024-04-01T19:56:57.236 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.236 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:935fe3ff:::benchmark_data_smithi188_161190_object56557:head# 2024-04-01T19:56:57.236 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.236 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9360c176:::benchmark_data_smithi188_161190_object67192:head# 2024-04-01T19:56:57.236 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.239 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9360efc8:::benchmark_data_smithi188_161190_object88832:head# 2024-04-01T19:56:57.239 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.239 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93616662:::benchmark_data_smithi188_161190_object78010:head# 2024-04-01T19:56:57.239 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.240 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9361ade1:::benchmark_data_smithi188_161190_object64889:head# 2024-04-01T19:56:57.240 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.240 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9361b40d:::benchmark_data_smithi188_161190_object105208:head# 2024-04-01T19:56:57.240 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.240 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93625dda:::benchmark_data_smithi188_161190_object65714:head# 2024-04-01T19:56:57.240 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.240 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93627dba:::benchmark_data_smithi188_161190_object118685:head# 2024-04-01T19:56:57.240 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.240 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93629cba:::benchmark_data_smithi188_161190_object88256:head# 2024-04-01T19:56:57.240 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.240 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9362afdf:::benchmark_data_smithi188_161190_object55212:head# 2024-04-01T19:56:57.240 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.240 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93630c02:::benchmark_data_smithi188_161190_object83522:head# 2024-04-01T19:56:57.240 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.241 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9363126c:::benchmark_data_smithi188_161190_object116137:head# 2024-04-01T19:56:57.241 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.241 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9364121f:::benchmark_data_smithi188_161190_object41326:head# 2024-04-01T19:56:57.241 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.241 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93644192:::benchmark_data_smithi188_161190_object35561:head# 2024-04-01T19:56:57.241 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.241 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:936443d1:::benchmark_data_smithi188_161190_object27123:head# 2024-04-01T19:56:57.241 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.241 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93644760:::benchmark_data_smithi188_161190_object64363:head# 2024-04-01T19:56:57.241 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.241 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9364aa74:::benchmark_data_smithi188_161190_object31635:head# 2024-04-01T19:56:57.241 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.241 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93650dcb:::benchmark_data_smithi188_161190_object52611:head# 2024-04-01T19:56:57.241 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.242 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:936545ed:::benchmark_data_smithi188_161190_object93997:head# 2024-04-01T19:56:57.242 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.242 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93658cf9:::benchmark_data_smithi188_161190_object62629:head# 2024-04-01T19:56:57.242 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.242 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93660936:::benchmark_data_smithi188_161190_object94545:head# 2024-04-01T19:56:57.242 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.242 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93668ffe:::benchmark_data_smithi188_161190_object50135:head# 2024-04-01T19:56:57.242 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.242 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9366e61d:::benchmark_data_smithi188_161190_object98475:head# 2024-04-01T19:56:57.242 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.242 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93674ed3:::benchmark_data_smithi188_161190_object77719:head# 2024-04-01T19:56:57.243 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.243 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9367db2f:::benchmark_data_smithi188_161190_object119338:head# 2024-04-01T19:56:57.243 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.244 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93686832:::benchmark_data_smithi188_161190_object125924:head# 2024-04-01T19:56:57.244 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.244 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93687e58:::benchmark_data_smithi188_161190_object21040:head# 2024-04-01T19:56:57.244 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.244 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9368c771:::benchmark_data_smithi188_161190_object58835:head# 2024-04-01T19:56:57.244 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.244 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9368edcb:::benchmark_data_smithi188_161190_object94701:head# 2024-04-01T19:56:57.244 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.245 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93690a13:::benchmark_data_smithi188_161190_object54662:head# 2024-04-01T19:56:57.245 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.251 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:936a0481:::benchmark_data_smithi188_161190_object67505:head# 2024-04-01T19:56:57.251 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.251 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:936abea9:::benchmark_data_smithi188_161190_object89108:head# 2024-04-01T19:56:57.251 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.251 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:936af7b1:::benchmark_data_smithi188_161190_object76463:head# 2024-04-01T19:56:57.251 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.251 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:936b1af3:::benchmark_data_smithi188_161190_object40682:head# 2024-04-01T19:56:57.251 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.251 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:936c418a:::benchmark_data_smithi188_161190_object52924:head# 2024-04-01T19:56:57.251 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.252 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:936c8554:::benchmark_data_smithi188_161190_object95320:head# 2024-04-01T19:56:57.252 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.252 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:936ca0d7:::benchmark_data_smithi188_161190_object118461:head# 2024-04-01T19:56:57.252 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.252 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:936db00c:::benchmark_data_smithi188_161190_object118581:head# 2024-04-01T19:56:57.252 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.252 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:936de420:::benchmark_data_smithi188_161190_object79098:head# 2024-04-01T19:56:57.252 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.252 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:936f4f81:::benchmark_data_smithi188_161190_object110571:head# 2024-04-01T19:56:57.252 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.252 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9370c66f:::benchmark_data_smithi188_161190_object109560:head# 2024-04-01T19:56:57.252 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.252 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9370df05:::benchmark_data_smithi188_161190_object43308:head# 2024-04-01T19:56:57.252 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.253 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93713058:::benchmark_data_smithi188_161190_object47369:head# 2024-04-01T19:56:57.253 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.253 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9371448e:::benchmark_data_smithi188_161190_object78354:head# 2024-04-01T19:56:57.253 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.253 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9372aff9:::benchmark_data_smithi188_161190_object114991:head# 2024-04-01T19:56:57.253 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.253 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9372cf72:::benchmark_data_smithi188_161190_object125880:head# 2024-04-01T19:56:57.253 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.253 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9372e659:::benchmark_data_smithi188_161190_object26298:head# 2024-04-01T19:56:57.253 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.253 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93742d19:::benchmark_data_smithi188_161190_object71689:head# 2024-04-01T19:56:57.253 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.253 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9374c24c:::benchmark_data_smithi188_161190_object132273:head# 2024-04-01T19:56:57.253 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.253 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:937510da:::benchmark_data_smithi188_161190_object97980:head# 2024-04-01T19:56:57.254 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.254 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93756697:::benchmark_data_smithi188_161190_object55675:head# 2024-04-01T19:56:57.254 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.254 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:937703a1:::benchmark_data_smithi188_161190_object77742:head# 2024-04-01T19:56:57.254 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.254 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93773c43:::benchmark_data_smithi188_161190_object84322:head# 2024-04-01T19:56:57.254 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.254 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9378073b:::benchmark_data_smithi188_161190_object79293:head# 2024-04-01T19:56:57.254 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.254 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9378c88f:::benchmark_data_smithi188_161190_object138783:head# 2024-04-01T19:56:57.254 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.255 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9378f7ea:::benchmark_data_smithi188_161190_object138660:head# 2024-04-01T19:56:57.255 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.255 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:937ad605:::benchmark_data_smithi188_161190_object83085:head# 2024-04-01T19:56:57.255 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.257 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:937b6898:::benchmark_data_smithi188_161190_object55584:head# 2024-04-01T19:56:57.257 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.257 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:937b99a6:::benchmark_data_smithi188_161190_object109242:head# 2024-04-01T19:56:57.257 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.257 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:937ce726:::benchmark_data_smithi188_161190_object90862:head# 2024-04-01T19:56:57.258 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.258 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:937f3534:::benchmark_data_smithi188_161190_object105805:head# 2024-04-01T19:56:57.258 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.258 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:937f5189:::benchmark_data_smithi188_161190_object115790:head# 2024-04-01T19:56:57.258 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.258 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:937f5324:::benchmark_data_smithi188_161190_object135956:head# 2024-04-01T19:56:57.258 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.258 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:937f6ca0:::benchmark_data_smithi188_161190_object118849:head# 2024-04-01T19:56:57.258 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.258 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:937f8b42:::benchmark_data_smithi188_161190_object67369:head# 2024-04-01T19:56:57.258 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.258 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9380ad8e:::benchmark_data_smithi188_161190_object82756:head# 2024-04-01T19:56:57.258 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.258 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93811c98:::benchmark_data_smithi188_161190_object36249:head# 2024-04-01T19:56:57.259 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.259 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9381a860:::benchmark_data_smithi188_161190_object104011:head# 2024-04-01T19:56:57.259 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.259 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9382076b:::benchmark_data_smithi188_161190_object62035:head# 2024-04-01T19:56:57.259 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.259 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9383b6c5:::benchmark_data_smithi188_161190_object117317:head# 2024-04-01T19:56:57.259 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.259 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9384940e:::benchmark_data_smithi188_161190_object123684:head# 2024-04-01T19:56:57.259 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.261 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9385168b:::benchmark_data_smithi188_161190_object22565:head# 2024-04-01T19:56:57.261 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.261 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93852d64:::benchmark_data_smithi188_161190_object136235:head# 2024-04-01T19:56:57.261 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.261 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9385386b:::benchmark_data_smithi188_161190_object58582:head# 2024-04-01T19:56:57.261 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.261 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93853ecf:::benchmark_data_smithi188_161190_object64145:head# 2024-04-01T19:56:57.261 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.261 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:938617ec:::benchmark_data_smithi188_161190_object47456:head# 2024-04-01T19:56:57.261 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.262 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9386d648:::benchmark_data_smithi188_161190_object98708:head# 2024-04-01T19:56:57.262 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.262 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9387a98f:::benchmark_data_smithi188_161190_object47306:head# 2024-04-01T19:56:57.262 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.262 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9387aa14:::benchmark_data_smithi188_161190_object24122:head# 2024-04-01T19:56:57.262 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.262 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9387d886:::benchmark_data_smithi188_161190_object40050:head# 2024-04-01T19:56:57.262 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.262 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93884758:::benchmark_data_smithi188_161190_object27111:head# 2024-04-01T19:56:57.262 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.266 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93888505:::benchmark_data_smithi188_161190_object128373:head# 2024-04-01T19:56:57.266 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.266 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9388ed8d:::benchmark_data_smithi188_161190_object65326:head# 2024-04-01T19:56:57.266 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.266 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9389a4e7:::benchmark_data_smithi188_161190_object72011:head# 2024-04-01T19:56:57.266 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.266 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9389f954:::benchmark_data_smithi188_161190_object42938:head# 2024-04-01T19:56:57.266 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.267 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:938a28f4:::benchmark_data_smithi188_161190_object25871:head# 2024-04-01T19:56:57.267 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.267 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:938a767c:::benchmark_data_smithi188_161190_object112717:head# 2024-04-01T19:56:57.267 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.267 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:938cb59d:::benchmark_data_smithi188_161190_object134442:head# 2024-04-01T19:56:57.267 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.267 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:938db561:::benchmark_data_smithi188_161190_object28584:head# 2024-04-01T19:56:57.267 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.267 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:938dc423:::benchmark_data_smithi188_161190_object30979:head# 2024-04-01T19:56:57.267 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.267 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:938dd092:::benchmark_data_smithi188_161190_object109194:head# 2024-04-01T19:56:57.267 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.267 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:938dd837:::benchmark_data_smithi188_161190_object90086:head# 2024-04-01T19:56:57.267 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.267 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:938e027e:::benchmark_data_smithi188_161190_object72509:head# 2024-04-01T19:56:57.268 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.268 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:938e1082:::benchmark_data_smithi188_161190_object99153:head# 2024-04-01T19:56:57.268 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.268 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:938e1cda:::benchmark_data_smithi188_161190_object63362:head# 2024-04-01T19:56:57.268 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.268 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:938e455f:::benchmark_data_smithi188_161190_object55193:head# 2024-04-01T19:56:57.268 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.268 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:938e4802:::benchmark_data_smithi188_161190_object21698:head# 2024-04-01T19:56:57.268 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.268 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:938e5bbb:::benchmark_data_smithi188_161190_object127267:head# 2024-04-01T19:56:57.268 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.268 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:938ef702:::benchmark_data_smithi188_161190_object61021:head# 2024-04-01T19:56:57.268 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.268 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:938f33b4:::benchmark_data_smithi188_161190_object99725:head# 2024-04-01T19:56:57.268 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.269 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93905c6d:::benchmark_data_smithi188_161190_object54334:head# 2024-04-01T19:56:57.269 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.270 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93906b0c:::benchmark_data_smithi188_161190_object119097:head# 2024-04-01T19:56:57.270 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.270 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9390b186:::benchmark_data_smithi188_161190_object92583:head# 2024-04-01T19:56:57.270 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.270 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93917359:::benchmark_data_smithi188_161190_object70693:head# 2024-04-01T19:56:57.270 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.273 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9391d34f:::benchmark_data_smithi188_161190_object45087:head# 2024-04-01T19:56:57.273 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.273 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9391d6f0:::benchmark_data_smithi188_161190_object75450:head# 2024-04-01T19:56:57.273 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.279 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93922e50:::benchmark_data_smithi188_161190_object24050:head# 2024-04-01T19:56:57.279 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.279 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9392329c:::benchmark_data_smithi188_161190_object119295:head# 2024-04-01T19:56:57.279 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.279 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9392b86c:::benchmark_data_smithi188_161190_object50080:head# 2024-04-01T19:56:57.279 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.279 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93930a80:::benchmark_data_smithi188_161190_object130735:head# 2024-04-01T19:56:57.279 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.279 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:939355d5:::benchmark_data_smithi188_161190_object125878:head# 2024-04-01T19:56:57.279 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.279 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93940fdf:::benchmark_data_smithi188_161190_object90750:head# 2024-04-01T19:56:57.279 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.279 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9394d59e:::benchmark_data_smithi188_161190_object64426:head# 2024-04-01T19:56:57.280 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.280 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9395bf6b:::benchmark_data_smithi188_161190_object110897:head# 2024-04-01T19:56:57.280 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.280 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9395c9f2:::benchmark_data_smithi188_161190_object31097:head# 2024-04-01T19:56:57.280 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.280 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93960e9d:::benchmark_data_smithi188_161190_object81274:head# 2024-04-01T19:56:57.280 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.280 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93966657:::benchmark_data_smithi188_161190_object115633:head# 2024-04-01T19:56:57.280 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.280 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93971a78:::benchmark_data_smithi188_161190_object31232:head# 2024-04-01T19:56:57.280 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.280 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9397c299:::benchmark_data_smithi188_161190_object95534:head# 2024-04-01T19:56:57.280 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.281 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93982096:::benchmark_data_smithi188_161190_object111558:head# 2024-04-01T19:56:57.281 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.281 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9398c414:::benchmark_data_smithi188_161190_object120198:head# 2024-04-01T19:56:57.281 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.282 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9399cc3d:::benchmark_data_smithi188_161190_object42855:head# 2024-04-01T19:56:57.282 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.282 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:939a1fc2:::benchmark_data_smithi188_161190_object26026:head# 2024-04-01T19:56:57.282 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.283 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:939a2738:::benchmark_data_smithi188_161190_object79448:head# 2024-04-01T19:56:57.283 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.283 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:939a386c:::benchmark_data_smithi188_161190_object104925:head# 2024-04-01T19:56:57.283 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.283 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:939b798b:::benchmark_data_smithi188_161190_object22665:head# 2024-04-01T19:56:57.283 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.283 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:939b87e6:::benchmark_data_smithi188_161190_object134546:head# 2024-04-01T19:56:57.283 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.283 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:939b8fed:::benchmark_data_smithi188_161190_object119224:head# 2024-04-01T19:56:57.283 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.283 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:939c092f:::benchmark_data_smithi188_161190_object49561:head# 2024-04-01T19:56:57.283 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.283 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:939d04c9:::benchmark_data_smithi188_161190_object30252:head# 2024-04-01T19:56:57.284 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.284 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:939d58ad:::benchmark_data_smithi188_161190_object31217:head# 2024-04-01T19:56:57.284 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.284 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:939ec180:::benchmark_data_smithi188_161190_object127657:head# 2024-04-01T19:56:57.284 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.284 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:939ee920:::benchmark_data_smithi188_161190_object31717:head# 2024-04-01T19:56:57.284 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.286 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:939f2c72:::benchmark_data_smithi188_161190_object29280:head# 2024-04-01T19:56:57.286 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.286 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:939f463d:::benchmark_data_smithi188_161190_object38411:head# 2024-04-01T19:56:57.286 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.286 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:939f9436:::benchmark_data_smithi188_161190_object22061:head# 2024-04-01T19:56:57.286 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.286 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:939fef69:::benchmark_data_smithi188_161190_object34117:head# 2024-04-01T19:56:57.286 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.286 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93a033ec:::benchmark_data_smithi188_161190_object37141:head# 2024-04-01T19:56:57.286 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.286 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93a0bebc:::benchmark_data_smithi188_161190_object131721:head# 2024-04-01T19:56:57.286 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.287 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93a0dd88:::benchmark_data_smithi188_161190_object35222:head# 2024-04-01T19:56:57.287 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.287 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93a18fe3:::benchmark_data_smithi188_161190_object26851:head# 2024-04-01T19:56:57.287 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.287 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93a1f672:::benchmark_data_smithi188_161190_object35546:head# 2024-04-01T19:56:57.287 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.289 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93a20be8:::benchmark_data_smithi188_161190_object67122:head# 2024-04-01T19:56:57.289 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.289 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93a24e34:::benchmark_data_smithi188_161190_object85246:head# 2024-04-01T19:56:57.289 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.289 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93a32927:::benchmark_data_smithi188_161190_object130693:head# 2024-04-01T19:56:57.289 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.289 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93a3ae00:::benchmark_data_smithi188_161190_object33605:head# 2024-04-01T19:56:57.290 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.290 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93a50e76:::benchmark_data_smithi188_161190_object125503:head# 2024-04-01T19:56:57.290 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.290 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93a6024e:::benchmark_data_smithi188_161190_object122138:head# 2024-04-01T19:56:57.290 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.290 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93a6382c:::benchmark_data_smithi188_161190_object50308:head# 2024-04-01T19:56:57.290 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.290 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93a63892:::benchmark_data_smithi188_161190_object82324:head# 2024-04-01T19:56:57.290 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.290 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93a6cb85:::benchmark_data_smithi188_161190_object75293:head# 2024-04-01T19:56:57.290 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.290 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93a6da83:::benchmark_data_smithi188_161190_object54708:head# 2024-04-01T19:56:57.290 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.291 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93a72bbf:::benchmark_data_smithi188_161190_object79921:head# 2024-04-01T19:56:57.291 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.291 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93a7381c:::benchmark_data_smithi188_161190_object84123:head# 2024-04-01T19:56:57.291 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.291 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93a895a4:::benchmark_data_smithi188_161190_object114338:head# 2024-04-01T19:56:57.292 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.295 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93a8c317:::benchmark_data_smithi188_161190_object36971:head# 2024-04-01T19:56:57.296 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.296 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93a9ceb9:::benchmark_data_smithi188_161190_object80063:head# 2024-04-01T19:56:57.296 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.297 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93aba5ed:::benchmark_data_smithi188_161190_object106393:head# 2024-04-01T19:56:57.297 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.297 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93ac5cda:::benchmark_data_smithi188_161190_object54870:head# 2024-04-01T19:56:57.297 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.297 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93acbfee:::benchmark_data_smithi188_161190_object136385:head# 2024-04-01T19:56:57.297 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.298 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93ad154c:::benchmark_data_smithi188_161190_object98764:head# 2024-04-01T19:56:57.298 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.298 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93adc266:::benchmark_data_smithi188_161190_object32692:head# 2024-04-01T19:56:57.298 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.298 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93adf4e2:::benchmark_data_smithi188_161190_object47524:head# 2024-04-01T19:56:57.299 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.303 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93ae3796:::benchmark_data_smithi188_161190_object112055:head# 2024-04-01T19:56:57.303 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.303 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93ae37e2:::benchmark_data_smithi188_161190_object130883:head# 2024-04-01T19:56:57.303 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.303 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93ae6fdf:::benchmark_data_smithi188_161190_object34535:head# 2024-04-01T19:56:57.303 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.303 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93ae74b5:::benchmark_data_smithi188_161190_object113122:head# 2024-04-01T19:56:57.303 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.303 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93af12e1:::benchmark_data_smithi188_161190_object91914:head# 2024-04-01T19:56:57.303 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.303 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93af72fb:::benchmark_data_smithi188_161190_object34886:head# 2024-04-01T19:56:57.303 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.303 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93af8b21:::benchmark_data_smithi188_161190_object63558:head# 2024-04-01T19:56:57.303 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.304 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93afe1fc:::benchmark_data_smithi188_161190_object121433:head# 2024-04-01T19:56:57.304 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.304 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93b0cae3:::benchmark_data_smithi188_161190_object22161:head# 2024-04-01T19:56:57.304 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.304 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93b16804:::benchmark_data_smithi188_161190_object122102:head# 2024-04-01T19:56:57.304 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.304 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93b1a6e6:::benchmark_data_smithi188_161190_object40059:head# 2024-04-01T19:56:57.304 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.304 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93b20ae5:::benchmark_data_smithi188_161190_object42703:head# 2024-04-01T19:56:57.304 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.304 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93b3c435:::benchmark_data_smithi188_161190_object76145:head# 2024-04-01T19:56:57.304 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.304 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93b3d4be:::benchmark_data_smithi188_161190_object32783:head# 2024-04-01T19:56:57.304 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.304 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93b460c9:::benchmark_data_smithi188_161190_object106631:head# 2024-04-01T19:56:57.304 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.311 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93b4d82e:::benchmark_data_smithi188_161190_object31512:head# 2024-04-01T19:56:57.311 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.311 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93b534a6:::benchmark_data_smithi188_161190_object40843:head# 2024-04-01T19:56:57.311 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.311 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93b56844:::benchmark_data_smithi188_161190_object122032:head# 2024-04-01T19:56:57.312 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.312 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93b77b48:::benchmark_data_smithi188_161190_object62459:head# 2024-04-01T19:56:57.312 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.312 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93b7b5d8:::benchmark_data_smithi188_161190_object116938:head# 2024-04-01T19:56:57.312 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.312 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93b8ed55:::benchmark_data_smithi188_161190_object122958:head# 2024-04-01T19:56:57.312 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.312 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93b9101a:::benchmark_data_smithi188_161190_object115784:head# 2024-04-01T19:56:57.312 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.312 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93b9bc0d:::benchmark_data_smithi188_161190_object137041:head# 2024-04-01T19:56:57.312 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.313 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93b9c102:::benchmark_data_smithi188_161190_object117654:head# 2024-04-01T19:56:57.313 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.313 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93b9e5e2:::benchmark_data_smithi188_161190_object87535:head# 2024-04-01T19:56:57.313 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.313 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93bb9711:::benchmark_data_smithi188_161190_object130579:head# 2024-04-01T19:56:57.313 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.313 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93bc2a84:::benchmark_data_smithi188_161190_object70460:head# 2024-04-01T19:56:57.314 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.314 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93bc4821:::benchmark_data_smithi188_161190_object87058:head# 2024-04-01T19:56:57.314 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.314 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93bd9c57:::benchmark_data_smithi188_161190_object114109:head# 2024-04-01T19:56:57.314 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.314 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93be39fb:::benchmark_data_smithi188_161190_object26368:head# 2024-04-01T19:56:57.314 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.314 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93bea3ae:::benchmark_data_smithi188_161190_object65821:head# 2024-04-01T19:56:57.314 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.314 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93bee105:::benchmark_data_smithi188_161190_object99803:head# 2024-04-01T19:56:57.314 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.314 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93bf35f0:::benchmark_data_smithi188_161190_object60787:head# 2024-04-01T19:56:57.314 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.314 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93bf7a03:::benchmark_data_smithi188_161190_object129481:head# 2024-04-01T19:56:57.315 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.315 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93bfcac3:::benchmark_data_smithi188_161190_object26540:head# 2024-04-01T19:56:57.315 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.318 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93bfcb63:::benchmark_data_smithi188_161190_object68613:head# 2024-04-01T19:56:57.318 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.318 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93c06613:::benchmark_data_smithi188_161190_object128910:head# 2024-04-01T19:56:57.318 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.318 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93c0994d:::benchmark_data_smithi188_161190_object30396:head# 2024-04-01T19:56:57.318 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.319 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93c1b3bf:::benchmark_data_smithi188_161190_object46409:head# 2024-04-01T19:56:57.319 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.319 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93c21cf3:::benchmark_data_smithi188_161190_object122724:head# 2024-04-01T19:56:57.319 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.319 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93c22afb:::benchmark_data_smithi188_161190_object36925:head# 2024-04-01T19:56:57.319 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.319 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93c32639:::benchmark_data_smithi188_161190_object52633:head# 2024-04-01T19:56:57.319 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.319 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93c346b5:::benchmark_data_smithi188_161190_object48080:head# 2024-04-01T19:56:57.319 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.319 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93c39664:::benchmark_data_smithi188_161190_object31812:head# 2024-04-01T19:56:57.320 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.320 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93c3b0b9:::benchmark_data_smithi188_161190_object50669:head# 2024-04-01T19:56:57.320 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.320 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93c3bdc9:::benchmark_data_smithi188_161190_object69565:head# 2024-04-01T19:56:57.320 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.320 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93c3fd38:::benchmark_data_smithi188_161190_object69417:head# 2024-04-01T19:56:57.320 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.320 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93c47c18:::benchmark_data_smithi188_161190_object78524:head# 2024-04-01T19:56:57.320 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.320 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93c4ad2d:::benchmark_data_smithi188_161190_object50532:head# 2024-04-01T19:56:57.321 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.321 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93c4adef:::benchmark_data_smithi188_161190_object47521:head# 2024-04-01T19:56:57.321 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.321 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93c5d473:::benchmark_data_smithi188_161190_object56765:head# 2024-04-01T19:56:57.321 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.321 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93c6254f:::benchmark_data_smithi188_161190_object111592:head# 2024-04-01T19:56:57.321 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.321 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93c6273c:::benchmark_data_smithi188_161190_object127872:head# 2024-04-01T19:56:57.321 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.321 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93c69582:::benchmark_data_smithi188_161190_object91084:head# 2024-04-01T19:56:57.321 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.321 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93c71f65:::benchmark_data_smithi188_161190_object39340:head# 2024-04-01T19:56:57.321 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.321 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93c74bfd:::benchmark_data_smithi188_161190_object110942:head# 2024-04-01T19:56:57.322 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.322 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93c840d1:::benchmark_data_smithi188_161190_object117203:head# 2024-04-01T19:56:57.322 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.322 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93c8d311:::benchmark_data_smithi188_161190_object127929:head# 2024-04-01T19:56:57.322 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.322 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93c9084a:::benchmark_data_smithi188_161190_object52776:head# 2024-04-01T19:56:57.322 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.322 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93c96448:::benchmark_data_smithi188_161190_object52798:head# 2024-04-01T19:56:57.322 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.326 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93cad622:::benchmark_data_smithi188_161190_object82422:head# 2024-04-01T19:56:57.327 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.327 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93cb3664:::benchmark_data_smithi188_161190_object134284:head# 2024-04-01T19:56:57.327 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.327 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93cc5579:::benchmark_data_smithi188_161190_object114507:head# 2024-04-01T19:56:57.327 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.327 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93cc6fd5:::benchmark_data_smithi188_161190_object83045:head# 2024-04-01T19:56:57.327 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.327 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93cc8eb8:::benchmark_data_smithi188_161190_object37239:head# 2024-04-01T19:56:57.327 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.327 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93ccdb1c:::benchmark_data_smithi188_161190_object86702:head# 2024-04-01T19:56:57.327 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.327 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93cd391e:::benchmark_data_smithi188_161190_object44019:head# 2024-04-01T19:56:57.328 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.328 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93cdee7d:::benchmark_data_smithi188_161190_object61137:head# 2024-04-01T19:56:57.328 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.328 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93ce0e5f:::benchmark_data_smithi188_161190_object39393:head# 2024-04-01T19:56:57.328 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.328 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93ce3ac9:::benchmark_data_smithi188_161190_object40794:head# 2024-04-01T19:56:57.328 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.328 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93ceacc8:::benchmark_data_smithi188_161190_object115986:head# 2024-04-01T19:56:57.328 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.328 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93cf2309:::benchmark_data_smithi188_161190_object106497:head# 2024-04-01T19:56:57.328 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.328 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93d144f4:::benchmark_data_smithi188_161190_object98086:head# 2024-04-01T19:56:57.328 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.328 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93d26848:::benchmark_data_smithi188_161190_object69079:head# 2024-04-01T19:56:57.329 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.329 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93d27c60:::benchmark_data_smithi188_161190_object87959:head# 2024-04-01T19:56:57.329 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.329 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93d39440:::benchmark_data_smithi188_161190_object77055:head# 2024-04-01T19:56:57.329 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.329 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93d41248:::benchmark_data_smithi188_161190_object39798:head# 2024-04-01T19:56:57.329 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.329 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93d46d7e:::benchmark_data_smithi188_161190_object49943:head# 2024-04-01T19:56:57.329 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.329 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93d4b484:::benchmark_data_smithi188_161190_object28283:head# 2024-04-01T19:56:57.329 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.329 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93d5c070:::benchmark_data_smithi188_161190_object58946:head# 2024-04-01T19:56:57.329 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.330 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93d5e1f0:::benchmark_data_smithi188_161190_object42871:head# 2024-04-01T19:56:57.330 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.330 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93d6f86b:::benchmark_data_smithi188_161190_object130655:head# 2024-04-01T19:56:57.330 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.330 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93d7b99d:::benchmark_data_smithi188_161190_object122907:head# 2024-04-01T19:56:57.330 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.330 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93d7bd1a:::benchmark_data_smithi188_161190_object93472:head# 2024-04-01T19:56:57.330 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.330 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93d7f56e:::benchmark_data_smithi188_161190_object109654:head# 2024-04-01T19:56:57.330 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.330 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93d80118:::benchmark_data_smithi188_161190_object91301:head# 2024-04-01T19:56:57.330 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.330 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93d84298:::benchmark_data_smithi188_161190_object28760:head# 2024-04-01T19:56:57.330 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.331 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93d93616:::benchmark_data_smithi188_161190_object93239:head# 2024-04-01T19:56:57.331 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.331 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93d963c7:::benchmark_data_smithi188_161190_object23827:head# 2024-04-01T19:56:57.331 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.331 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93daea51:::benchmark_data_smithi188_161190_object22848:head# 2024-04-01T19:56:57.331 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.331 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93dc0e74:::benchmark_data_smithi188_161190_object67012:head# 2024-04-01T19:56:57.331 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.339 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93dc2024:::benchmark_data_smithi188_161190_object51936:head# 2024-04-01T19:56:57.340 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.340 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93de551c:::benchmark_data_smithi188_161190_object101612:head# 2024-04-01T19:56:57.340 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.340 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93de5800:::benchmark_data_smithi188_161190_object139250:head# 2024-04-01T19:56:57.340 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.340 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93de78a1:::benchmark_data_smithi188_161190_object50407:head# 2024-04-01T19:56:57.340 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.340 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93de832e:::benchmark_data_smithi188_161190_object64066:head# 2024-04-01T19:56:57.340 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.340 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93dedc35:::benchmark_data_smithi188_161190_object66565:head# 2024-04-01T19:56:57.340 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.340 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93df3b41:::benchmark_data_smithi188_161190_object122084:head# 2024-04-01T19:56:57.341 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.341 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93df5695:::benchmark_data_smithi188_161190_object90637:head# 2024-04-01T19:56:57.341 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.341 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93df6eba:::benchmark_data_smithi188_161190_object99471:head# 2024-04-01T19:56:57.341 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.341 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93dffab7:::benchmark_data_smithi188_161190_object67141:head# 2024-04-01T19:56:57.341 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.341 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93e0b8fc:::benchmark_data_smithi188_161190_object100723:head# 2024-04-01T19:56:57.341 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.341 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93e1b2cd:::benchmark_data_smithi188_161190_object133428:head# 2024-04-01T19:56:57.341 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.341 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93e28d8f:::benchmark_data_smithi188_161190_object125577:head# 2024-04-01T19:56:57.341 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.341 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93e34cbf:::benchmark_data_smithi188_161190_object49312:head# 2024-04-01T19:56:57.342 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.342 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93e4751b:::benchmark_data_smithi188_161190_object70286:head# 2024-04-01T19:56:57.342 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.342 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93e4de1f:::benchmark_data_smithi188_161190_object105733:head# 2024-04-01T19:56:57.342 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.342 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93e698cc:::benchmark_data_smithi188_161190_object102449:head# 2024-04-01T19:56:57.342 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.342 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93e739f7:::benchmark_data_smithi188_161190_object105492:head# 2024-04-01T19:56:57.342 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.342 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93e7ed3b:::benchmark_data_smithi188_161190_object76288:head# 2024-04-01T19:56:57.342 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.342 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93e97180:::benchmark_data_smithi188_161190_object57860:head# 2024-04-01T19:56:57.342 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.342 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93ea390a:::benchmark_data_smithi188_161190_object131549:head# 2024-04-01T19:56:57.343 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.343 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93ec3473:::benchmark_data_smithi188_161190_object38087:head# 2024-04-01T19:56:57.343 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.343 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93ec526e:::benchmark_data_smithi188_161190_object127483:head# 2024-04-01T19:56:57.343 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.343 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93ec5f18:::benchmark_data_smithi188_161190_object23323:head# 2024-04-01T19:56:57.343 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.343 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93ed3f76:::benchmark_data_smithi188_161190_object99843:head# 2024-04-01T19:56:57.343 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.343 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93ef04fb:::benchmark_data_smithi188_161190_object92366:head# 2024-04-01T19:56:57.343 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93ef785a:::benchmark_data_smithi188_161190_object85214:head# 2024-04-01T19:56:57.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93efc670:::benchmark_data_smithi188_161190_object61380:head# 2024-04-01T19:56:57.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93f03ed4:::benchmark_data_smithi188_161190_object115035:head# 2024-04-01T19:56:57.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93f1641f:::benchmark_data_smithi188_161190_object21430:head# 2024-04-01T19:56:57.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93f26059:::benchmark_data_smithi188_161190_object71198:head# 2024-04-01T19:56:57.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93f27a55:::benchmark_data_smithi188_161190_object46259:head# 2024-04-01T19:56:57.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93f44777:::benchmark_data_smithi188_161190_object104101:head# 2024-04-01T19:56:57.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93f45a61:::benchmark_data_smithi188_161190_object74116:head# 2024-04-01T19:56:57.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93f655a5:::benchmark_data_smithi188_161190_object33338:head# 2024-04-01T19:56:57.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93f6664a:::benchmark_data_smithi188_161190_object23026:head# 2024-04-01T19:56:57.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93f6b542:::benchmark_data_smithi188_161190_object98209:head# 2024-04-01T19:56:57.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93f8a2b2:::benchmark_data_smithi188_161190_object91027:head# 2024-04-01T19:56:57.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93f8cd96:::benchmark_data_smithi188_161190_object32424:head# 2024-04-01T19:56:57.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93f95753:::benchmark_data_smithi188_161190_object134500:head# 2024-04-01T19:56:57.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.346 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93fbe230:::benchmark_data_smithi188_161190_object100822:head# 2024-04-01T19:56:57.346 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.346 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93fbf83e:::benchmark_data_smithi188_161190_object44513:head# 2024-04-01T19:56:57.346 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.346 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93fc3bd8:::benchmark_data_smithi188_161190_object48522:head# 2024-04-01T19:56:57.346 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.346 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93fc4184:::benchmark_data_smithi188_161190_object109165:head# 2024-04-01T19:56:57.346 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.346 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93fcd181:::benchmark_data_smithi188_161190_object118682:head# 2024-04-01T19:56:57.346 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.346 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93fd2e4e:::benchmark_data_smithi188_161190_object126240:head# 2024-04-01T19:56:57.346 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.346 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93fdccaa:::benchmark_data_smithi188_161190_object119708:head# 2024-04-01T19:56:57.347 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.347 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93fe9812:::benchmark_data_smithi188_161190_object137516:head# 2024-04-01T19:56:57.347 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.347 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93ff3830:::benchmark_data_smithi188_161190_object127338:head# 2024-04-01T19:56:57.347 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.347 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93ff6241:::benchmark_data_smithi188_161190_object50545:head# 2024-04-01T19:56:57.347 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.347 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:93ff8cf5:::benchmark_data_smithi188_161190_object134667:head# 2024-04-01T19:56:57.347 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.348 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9400fd48:::benchmark_data_smithi188_161190_object110455:head# 2024-04-01T19:56:57.348 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.348 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94019f9f:::benchmark_data_smithi188_161190_object20121:head# 2024-04-01T19:56:57.348 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.348 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94039400:::benchmark_data_smithi188_161190_object110465:head# 2024-04-01T19:56:57.349 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.349 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9403e2cc:::benchmark_data_smithi188_161190_object35462:head# 2024-04-01T19:56:57.349 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.349 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9404ceb1:::benchmark_data_smithi188_161190_object115127:head# 2024-04-01T19:56:57.349 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.349 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94057be4:::benchmark_data_smithi188_161190_object101789:head# 2024-04-01T19:56:57.349 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.349 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9405b9e8:::benchmark_data_smithi188_161190_object59374:head# 2024-04-01T19:56:57.349 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.349 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9406fa36:::benchmark_data_smithi188_161190_object44050:head# 2024-04-01T19:56:57.349 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.349 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94072c12:::benchmark_data_smithi188_161190_object125320:head# 2024-04-01T19:56:57.349 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.349 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94077a40:::benchmark_data_smithi188_161190_object62152:head# 2024-04-01T19:56:57.350 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.350 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:940983c5:::benchmark_data_smithi188_161190_object22757:head# 2024-04-01T19:56:57.350 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.350 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94099f77:::benchmark_data_smithi188_161190_object124136:head# 2024-04-01T19:56:57.350 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.351 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9409ded0:::benchmark_data_smithi188_161190_object37874:head# 2024-04-01T19:56:57.351 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.352 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:940a6e83:::benchmark_data_smithi188_161190_object126916:head# 2024-04-01T19:56:57.352 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.352 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:940a7ceb:::benchmark_data_smithi188_161190_object90544:head# 2024-04-01T19:56:57.352 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.352 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:940b74f2:::benchmark_data_smithi188_161190_object46821:head# 2024-04-01T19:56:57.352 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.353 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:940bcd25:::benchmark_data_smithi188_161190_object42391:head# 2024-04-01T19:56:57.354 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.354 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:940d4c52:::benchmark_data_smithi188_161190_object70251:head# 2024-04-01T19:56:57.354 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.354 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:940d9686:::benchmark_data_smithi188_161190_object80484:head# 2024-04-01T19:56:57.354 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.354 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:940e335f:::benchmark_data_smithi188_161190_object30384:head# 2024-04-01T19:56:57.354 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.354 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:940e642d:::benchmark_data_smithi188_161190_object109762:head# 2024-04-01T19:56:57.354 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.355 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:940e9242:::benchmark_data_smithi188_161190_object83479:head# 2024-04-01T19:56:57.355 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.358 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:940ebd74:::benchmark_data_smithi188_161190_object123734:head# 2024-04-01T19:56:57.358 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.358 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9410738a:::benchmark_data_smithi188_161190_object112310:head# 2024-04-01T19:56:57.359 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.359 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:941097ac:::benchmark_data_smithi188_161190_object126026:head# 2024-04-01T19:56:57.360 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.360 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94118b7b:::benchmark_data_smithi188_161190_object54747:head# 2024-04-01T19:56:57.360 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.360 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9411f6c8:::benchmark_data_smithi188_161190_object111329:head# 2024-04-01T19:56:57.360 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.360 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9412212a:::benchmark_data_smithi188_161190_object33326:head# 2024-04-01T19:56:57.360 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.361 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94132018:::benchmark_data_smithi188_161190_object99505:head# 2024-04-01T19:56:57.362 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.362 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94136862:::benchmark_data_smithi188_161190_object38869:head# 2024-04-01T19:56:57.362 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.362 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9413f231:::benchmark_data_smithi188_161190_object28032:head# 2024-04-01T19:56:57.362 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.362 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94146a75:::benchmark_data_smithi188_161190_object128079:head# 2024-04-01T19:56:57.362 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.362 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94152d1f:::benchmark_data_smithi188_161190_object107062:head# 2024-04-01T19:56:57.362 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.362 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94156b84:::benchmark_data_smithi188_161190_object91969:head# 2024-04-01T19:56:57.362 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.362 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94179766:::benchmark_data_smithi188_161190_object55679:head# 2024-04-01T19:56:57.362 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.364 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9417a9a3:::benchmark_data_smithi188_161190_object44688:head# 2024-04-01T19:56:57.364 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.365 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9417f43e:::benchmark_data_smithi188_161190_object23853:head# 2024-04-01T19:56:57.365 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.365 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:941845b8:::benchmark_data_smithi188_161190_object75494:head# 2024-04-01T19:56:57.365 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.365 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9418a160:::benchmark_data_smithi188_161190_object122545:head# 2024-04-01T19:56:57.365 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.365 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9419b13e:::benchmark_data_smithi188_161190_object23596:head# 2024-04-01T19:56:57.365 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.365 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9419ed5a:::benchmark_data_smithi188_161190_object104318:head# 2024-04-01T19:56:57.365 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.365 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:941a3963:::benchmark_data_smithi188_161190_object51961:head# 2024-04-01T19:56:57.365 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.365 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:941bfd91:::benchmark_data_smithi188_161190_object39638:head# 2024-04-01T19:56:57.365 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.366 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:941c5772:::benchmark_data_smithi188_161190_object105170:head# 2024-04-01T19:56:57.366 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.366 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:941c7b45:::benchmark_data_smithi188_161190_object129328:head# 2024-04-01T19:56:57.366 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.368 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:941ccda3:::benchmark_data_smithi188_161190_object39102:head# 2024-04-01T19:56:57.368 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.368 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:941d5869:::benchmark_data_smithi188_161190_object96992:head# 2024-04-01T19:56:57.369 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.369 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:941e6db8:::benchmark_data_smithi188_161190_object131479:head# 2024-04-01T19:56:57.369 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.369 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:941ec68b:::benchmark_data_smithi188_161190_object102502:head# 2024-04-01T19:56:57.369 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.369 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:941f3666:::benchmark_data_smithi188_161190_object137632:head# 2024-04-01T19:56:57.369 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.369 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:941f6a9b:::benchmark_data_smithi188_161190_object118759:head# 2024-04-01T19:56:57.369 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.369 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:941f9db3:::benchmark_data_smithi188_161190_object135830:head# 2024-04-01T19:56:57.369 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.369 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:941ff40a:::benchmark_data_smithi188_161190_object114889:head# 2024-04-01T19:56:57.369 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.369 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94202eaa:::benchmark_data_smithi188_161190_object114157:head# 2024-04-01T19:56:57.369 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.370 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94214589:::benchmark_data_smithi188_161190_object130429:head# 2024-04-01T19:56:57.370 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.370 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9421bb14:::benchmark_data_smithi188_161190_object104356:head# 2024-04-01T19:56:57.370 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.370 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9421da77:::benchmark_data_smithi188_161190_object92098:head# 2024-04-01T19:56:57.370 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.370 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9422c4a5:::benchmark_data_smithi188_161190_object66505:head# 2024-04-01T19:56:57.370 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.370 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9422c864:::benchmark_data_smithi188_161190_object30813:head# 2024-04-01T19:56:57.370 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.370 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:942344b8:::benchmark_data_smithi188_161190_object61508:head# 2024-04-01T19:56:57.370 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.371 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9424344f:::benchmark_data_smithi188_161190_object61760:head# 2024-04-01T19:56:57.371 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.371 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94245ad8:::benchmark_data_smithi188_161190_object121586:head# 2024-04-01T19:56:57.371 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.375 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94246776:::benchmark_data_smithi188_161190_object62618:head# 2024-04-01T19:56:57.375 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.375 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9424d5d7:::benchmark_data_smithi188_161190_object90308:head# 2024-04-01T19:56:57.375 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.375 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9424dde7:::benchmark_data_smithi188_161190_object96269:head# 2024-04-01T19:56:57.375 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.375 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:942659eb:::benchmark_data_smithi188_161190_object63872:head# 2024-04-01T19:56:57.375 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.376 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9426d740:::benchmark_data_smithi188_161190_object34657:head# 2024-04-01T19:56:57.376 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.376 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9427b153:::benchmark_data_smithi188_161190_object32929:head# 2024-04-01T19:56:57.376 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.376 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9427ec51:::benchmark_data_smithi188_161190_object51682:head# 2024-04-01T19:56:57.376 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.378 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:942a4bbd:::benchmark_data_smithi188_161190_object120311:head# 2024-04-01T19:56:57.378 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.378 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:942b2410:::benchmark_data_smithi188_161190_object32441:head# 2024-04-01T19:56:57.378 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.378 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:942dc58a:::benchmark_data_smithi188_161190_object27146:head# 2024-04-01T19:56:57.378 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.378 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:942e06ec:::benchmark_data_smithi188_161190_object22354:head# 2024-04-01T19:56:57.378 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.378 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:942eacf4:::benchmark_data_smithi188_161190_object89486:head# 2024-04-01T19:56:57.378 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.379 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:942f4346:::benchmark_data_smithi188_161190_object31831:head# 2024-04-01T19:56:57.379 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.379 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:942f43d0:::benchmark_data_smithi188_161190_object55751:head# 2024-04-01T19:56:57.379 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.379 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:942f84a2:::benchmark_data_smithi188_161190_object83483:head# 2024-04-01T19:56:57.379 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.379 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94304132:::benchmark_data_smithi188_161190_object138877:head# 2024-04-01T19:56:57.379 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.379 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9430ad10:::benchmark_data_smithi188_161190_object87260:head# 2024-04-01T19:56:57.379 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.380 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94311ca0:::benchmark_data_smithi188_161190_object105129:head# 2024-04-01T19:56:57.380 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.380 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9431383c:::benchmark_data_smithi188_161190_object22018:head# 2024-04-01T19:56:57.380 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.380 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94317eb2:::benchmark_data_smithi188_161190_object31325:head# 2024-04-01T19:56:57.380 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.380 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9431dc6e:::benchmark_data_smithi188_161190_object55304:head# 2024-04-01T19:56:57.380 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.381 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9431f666:::benchmark_data_smithi188_161190_object29771:head# 2024-04-01T19:56:57.381 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.383 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94339d80:::benchmark_data_smithi188_161190_object94185:head# 2024-04-01T19:56:57.383 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.383 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9433a5bd:::benchmark_data_smithi188_161190_object100682:head# 2024-04-01T19:56:57.383 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.383 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9434181a:::benchmark_data_smithi188_161190_object115738:head# 2024-04-01T19:56:57.383 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.383 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94341e1d:::benchmark_data_smithi188_161190_object123743:head# 2024-04-01T19:56:57.383 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.383 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9434c39e:::benchmark_data_smithi188_161190_object136441:head# 2024-04-01T19:56:57.383 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.384 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9434c868:::benchmark_data_smithi188_161190_object85713:head# 2024-04-01T19:56:57.384 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.384 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9434cdda:::benchmark_data_smithi188_161190_object42788:head# 2024-04-01T19:56:57.384 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.384 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:943550c0:::benchmark_data_smithi188_161190_object67285:head# 2024-04-01T19:56:57.384 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.384 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94356570:::benchmark_data_smithi188_161190_object116025:head# 2024-04-01T19:56:57.384 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.384 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:943602ca:::benchmark_data_smithi188_161190_object122636:head# 2024-04-01T19:56:57.384 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.384 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94363de0:::benchmark_data_smithi188_161190_object51803:head# 2024-04-01T19:56:57.385 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.385 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9437c953:::benchmark_data_smithi188_161190_object92939:head# 2024-04-01T19:56:57.385 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.386 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9439b80e:::benchmark_data_smithi188_161190_object101803:head# 2024-04-01T19:56:57.386 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.387 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9439d0d3:::benchmark_data_smithi188_161190_object127574:head# 2024-04-01T19:56:57.387 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.387 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:943a08be:::benchmark_data_smithi188_161190_object114940:head# 2024-04-01T19:56:57.387 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.387 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:943b2265:::benchmark_data_smithi188_161190_object93639:head# 2024-04-01T19:56:57.387 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.387 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:943b4c56:::benchmark_data_smithi188_161190_object120098:head# 2024-04-01T19:56:57.387 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.387 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:943b79a1:::benchmark_data_smithi188_161190_object76945:head# 2024-04-01T19:56:57.387 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.387 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:943bbca7:::benchmark_data_smithi188_161190_object108972:head# 2024-04-01T19:56:57.387 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.387 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:943bd10a:::benchmark_data_smithi188_161190_object110934:head# 2024-04-01T19:56:57.387 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.388 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:943c6fc8:::benchmark_data_smithi188_161190_object58145:head# 2024-04-01T19:56:57.388 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.388 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:943c9e60:::benchmark_data_smithi188_161190_object123596:head# 2024-04-01T19:56:57.388 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.388 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:943e0861:::benchmark_data_smithi188_161190_object84925:head# 2024-04-01T19:56:57.389 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.389 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:943e9d67:::benchmark_data_smithi188_161190_object121418:head# 2024-04-01T19:56:57.390 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.390 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:943edab6:::benchmark_data_smithi188_161190_object105113:head# 2024-04-01T19:56:57.390 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.390 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:943ef9c3:::benchmark_data_smithi188_161190_object132861:head# 2024-04-01T19:56:57.390 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.390 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:943f2453:::benchmark_data_smithi188_161190_object128312:head# 2024-04-01T19:56:57.390 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.390 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:943f304f:::benchmark_data_smithi188_161190_object38641:head# 2024-04-01T19:56:57.390 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.390 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:943f5284:::benchmark_data_smithi188_161190_object126002:head# 2024-04-01T19:56:57.390 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.390 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9440433b:::benchmark_data_smithi188_161190_object136108:head# 2024-04-01T19:56:57.391 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.391 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9440516e:::benchmark_data_smithi188_161190_object43024:head# 2024-04-01T19:56:57.391 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.391 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94408fea:::benchmark_data_smithi188_161190_object50708:head# 2024-04-01T19:56:57.391 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.391 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94412cf2:::benchmark_data_smithi188_161190_object124697:head# 2024-04-01T19:56:57.391 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.392 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9441c330:::benchmark_data_smithi188_161190_object63463:head# 2024-04-01T19:56:57.392 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.393 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94425b7c:::benchmark_data_smithi188_161190_object111485:head# 2024-04-01T19:56:57.393 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.396 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94427d4a:::benchmark_data_smithi188_161190_object91309:head# 2024-04-01T19:56:57.396 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.396 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94434e25:::benchmark_data_smithi188_161190_object125538:head# 2024-04-01T19:56:57.396 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.396 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9443dca0:::benchmark_data_smithi188_161190_object107796:head# 2024-04-01T19:56:57.397 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.397 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9443fde6:::benchmark_data_smithi188_161190_object105139:head# 2024-04-01T19:56:57.397 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.397 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:944459c1:::benchmark_data_smithi188_161190_object85186:head# 2024-04-01T19:56:57.397 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.397 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94447262:::benchmark_data_smithi188_161190_object56606:head# 2024-04-01T19:56:57.397 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.397 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9444820e:::benchmark_data_smithi188_161190_object29911:head# 2024-04-01T19:56:57.397 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.397 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94456bf1:::benchmark_data_smithi188_161190_object103794:head# 2024-04-01T19:56:57.397 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.397 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94458deb:::benchmark_data_smithi188_161190_object77829:head# 2024-04-01T19:56:57.397 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.397 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9445dfeb:::benchmark_data_smithi188_161190_object110235:head# 2024-04-01T19:56:57.397 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.398 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:944640b5:::benchmark_data_smithi188_161190_object32892:head# 2024-04-01T19:56:57.398 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.398 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94464957:::benchmark_data_smithi188_161190_object34261:head# 2024-04-01T19:56:57.398 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.399 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94464e07:::benchmark_data_smithi188_161190_object107295:head# 2024-04-01T19:56:57.399 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.399 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:944652ab:::benchmark_data_smithi188_161190_object72940:head# 2024-04-01T19:56:57.399 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.399 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9446e526:::benchmark_data_smithi188_161190_object85938:head# 2024-04-01T19:56:57.399 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.399 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9447c95e:::benchmark_data_smithi188_161190_object85677:head# 2024-04-01T19:56:57.400 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.400 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9448557e:::benchmark_data_smithi188_161190_object33825:head# 2024-04-01T19:56:57.400 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.400 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9448c926:::benchmark_data_smithi188_161190_object127912:head# 2024-04-01T19:56:57.400 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.410 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9448d2cd:::benchmark_data_smithi188_161190_object21896:head# 2024-04-01T19:56:57.411 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.412 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:944baa07:::benchmark_data_smithi188_161190_object81466:head# 2024-04-01T19:56:57.412 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.413 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:944bb246:::benchmark_data_smithi188_161190_object26750:head# 2024-04-01T19:56:57.413 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.413 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:944bb580:::benchmark_data_smithi188_161190_object81697:head# 2024-04-01T19:56:57.413 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.413 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:944bcf70:::benchmark_data_smithi188_161190_object125507:head# 2024-04-01T19:56:57.414 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.414 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:944bf115:::benchmark_data_smithi188_161190_object131873:head# 2024-04-01T19:56:57.415 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.415 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:944ccf07:::benchmark_data_smithi188_161190_object98429:head# 2024-04-01T19:56:57.415 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.415 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:944d1d7b:::benchmark_data_smithi188_161190_object94351:head# 2024-04-01T19:56:57.415 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.415 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:944d74c3:::benchmark_data_smithi188_161190_object82901:head# 2024-04-01T19:56:57.415 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.415 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:944dee40:::benchmark_data_smithi188_161190_object71452:head# 2024-04-01T19:56:57.415 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.416 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:944e9342:::benchmark_data_smithi188_161190_object133009:head# 2024-04-01T19:56:57.416 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.417 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:944ebced:::benchmark_data_smithi188_161190_object41148:head# 2024-04-01T19:56:57.417 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.417 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:944ef16c:::benchmark_data_smithi188_161190_object122805:head# 2024-04-01T19:56:57.417 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.417 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:944fc08f:::benchmark_data_smithi188_161190_object95584:head# 2024-04-01T19:56:57.417 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.417 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:944fc5ae:::benchmark_data_smithi188_161190_object130348:head# 2024-04-01T19:56:57.417 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.417 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9450629e:::benchmark_data_smithi188_161190_object39641:head# 2024-04-01T19:56:57.417 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.417 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94513981:::benchmark_data_smithi188_161190_object30481:head# 2024-04-01T19:56:57.417 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.418 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9451491c:::benchmark_data_smithi188_161190_object54809:head# 2024-04-01T19:56:57.419 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.419 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94517794:::benchmark_data_smithi188_161190_object67605:head# 2024-04-01T19:56:57.419 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.419 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94519e42:::benchmark_data_smithi188_161190_object67611:head# 2024-04-01T19:56:57.419 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.419 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94519fd5:::benchmark_data_smithi188_161190_object69734:head# 2024-04-01T19:56:57.419 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.419 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94521dc0:::benchmark_data_smithi188_161190_object112956:head# 2024-04-01T19:56:57.419 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.419 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:945257f7:::benchmark_data_smithi188_161190_object65242:head# 2024-04-01T19:56:57.420 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.423 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9453d50a:::benchmark_data_smithi188_161190_object86693:head# 2024-04-01T19:56:57.423 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.423 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94541b27:::benchmark_data_smithi188_161190_object42215:head# 2024-04-01T19:56:57.423 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.423 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:945454dd:::benchmark_data_smithi188_161190_object95461:head# 2024-04-01T19:56:57.423 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.423 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94547ff4:::benchmark_data_smithi188_161190_object62967:head# 2024-04-01T19:56:57.423 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.423 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94548c58:::benchmark_data_smithi188_161190_object95150:head# 2024-04-01T19:56:57.423 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.424 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94548d34:::benchmark_data_smithi188_161190_object135599:head# 2024-04-01T19:56:57.424 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.424 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9454ec59:::benchmark_data_smithi188_161190_object105347:head# 2024-04-01T19:56:57.424 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.424 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94559841:::benchmark_data_smithi188_161190_object108863:head# 2024-04-01T19:56:57.424 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.424 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9455f0cb:::benchmark_data_smithi188_161190_object130289:head# 2024-04-01T19:56:57.424 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.424 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94564b76:::benchmark_data_smithi188_161190_object68536:head# 2024-04-01T19:56:57.424 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.424 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94565ba8:::benchmark_data_smithi188_161190_object62937:head# 2024-04-01T19:56:57.424 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.425 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9456f737:::benchmark_data_smithi188_161190_object72638:head# 2024-04-01T19:56:57.425 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.425 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:945881a5:::benchmark_data_smithi188_161190_object106925:head# 2024-04-01T19:56:57.425 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.434 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9458bd18:::benchmark_data_smithi188_161190_object69667:head# 2024-04-01T19:56:57.434 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.435 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9459ceb1:::benchmark_data_smithi188_161190_object78378:head# 2024-04-01T19:56:57.435 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.435 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:945a2802:::benchmark_data_smithi188_161190_object122580:head# 2024-04-01T19:56:57.435 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.435 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:945a3566:::benchmark_data_smithi188_161190_object55897:head# 2024-04-01T19:56:57.435 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.435 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:945a448d:::benchmark_data_smithi188_161190_object28169:head# 2024-04-01T19:56:57.435 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.435 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:945a6ee9:::benchmark_data_smithi188_161190_object116483:head# 2024-04-01T19:56:57.435 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.435 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:945ae325:::benchmark_data_smithi188_161190_object100486:head# 2024-04-01T19:56:57.435 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.435 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:945b4bc1:::benchmark_data_smithi188_161190_object117571:head# 2024-04-01T19:56:57.435 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.435 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:945b7b20:::benchmark_data_smithi188_161190_object58041:head# 2024-04-01T19:56:57.436 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.436 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:945da48d:::benchmark_data_smithi188_161190_object111767:head# 2024-04-01T19:56:57.436 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.436 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:945de3df:::benchmark_data_smithi188_161190_object135480:head# 2024-04-01T19:56:57.436 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.436 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:945df806:::benchmark_data_smithi188_161190_object126945:head# 2024-04-01T19:56:57.436 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.436 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:945e4f65:::benchmark_data_smithi188_161190_object124877:head# 2024-04-01T19:56:57.436 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.436 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:945eb621:::benchmark_data_smithi188_161190_object29559:head# 2024-04-01T19:56:57.436 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.436 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94604069:::benchmark_data_smithi188_161190_object32643:head# 2024-04-01T19:56:57.436 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.436 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94607862:::benchmark_data_smithi188_161190_object89343:head# 2024-04-01T19:56:57.436 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.437 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94610b99:::benchmark_data_smithi188_161190_object55127:head# 2024-04-01T19:56:57.437 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.437 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94612b75:::benchmark_data_smithi188_161190_object68474:head# 2024-04-01T19:56:57.437 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.437 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9461562b:::benchmark_data_smithi188_161190_object48662:head# 2024-04-01T19:56:57.437 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.437 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94616b36:::benchmark_data_smithi188_161190_object45133:head# 2024-04-01T19:56:57.437 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94617caf:::benchmark_data_smithi188_161190_object110830:head# 2024-04-01T19:56:57.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9462a374:::benchmark_data_smithi188_161190_object21955:head# 2024-04-01T19:56:57.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9462bce4:::benchmark_data_smithi188_161190_object96506:head# 2024-04-01T19:56:57.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9462f95e:::benchmark_data_smithi188_161190_object52749:head# 2024-04-01T19:56:57.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9463375b:::benchmark_data_smithi188_161190_object115066:head# 2024-04-01T19:56:57.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94637c49:::benchmark_data_smithi188_161190_object65784:head# 2024-04-01T19:56:57.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9463c17c:::benchmark_data_smithi188_161190_object38686:head# 2024-04-01T19:56:57.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.445 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94647455:::benchmark_data_smithi188_161190_object44749:head# 2024-04-01T19:56:57.445 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.445 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:946501e1:::benchmark_data_smithi188_161190_object80815:head# 2024-04-01T19:56:57.445 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.445 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94651540:::benchmark_data_smithi188_161190_object137898:head# 2024-04-01T19:56:57.445 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.445 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:946524ab:::benchmark_data_smithi188_161190_object42854:head# 2024-04-01T19:56:57.445 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.445 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9465e039:::benchmark_data_smithi188_161190_object75896:head# 2024-04-01T19:56:57.445 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.445 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9465e5ab:::benchmark_data_smithi188_161190_object112129:head# 2024-04-01T19:56:57.445 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.445 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9468197b:::benchmark_data_smithi188_161190_object95679:head# 2024-04-01T19:56:57.445 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.446 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94694927:::benchmark_data_smithi188_161190_object44386:head# 2024-04-01T19:56:57.446 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.446 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9469e299:::benchmark_data_smithi188_161190_object83874:head# 2024-04-01T19:56:57.446 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.447 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:946a072e:::benchmark_data_smithi188_161190_object117075:head# 2024-04-01T19:56:57.447 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.447 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:946a55c6:::benchmark_data_smithi188_161190_object88049:head# 2024-04-01T19:56:57.447 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.448 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:946aa5c9:::benchmark_data_smithi188_161190_object38493:head# 2024-04-01T19:56:57.448 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.455 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:946bff3c:::benchmark_data_smithi188_161190_object20692:head# 2024-04-01T19:56:57.455 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.455 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:946c34ff:::benchmark_data_smithi188_161190_object118078:head# 2024-04-01T19:56:57.455 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.455 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:946e0907:::benchmark_data_smithi188_161190_object27238:head# 2024-04-01T19:56:57.455 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.458 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:946e5ea5:::benchmark_data_smithi188_161190_object68263:head# 2024-04-01T19:56:57.458 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.468 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:946e798c:::benchmark_data_smithi188_161190_object109131:head# 2024-04-01T19:56:57.468 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.472 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:946e9f90:::benchmark_data_smithi188_161190_object19938:head# 2024-04-01T19:56:57.473 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.473 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:946ee21a:::benchmark_data_smithi188_161190_object37460:head# 2024-04-01T19:56:57.474 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.474 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:946f0fc2:::benchmark_data_smithi188_161190_object25357:head# 2024-04-01T19:56:57.474 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.474 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:946fd1ae:::benchmark_data_smithi188_161190_object93134:head# 2024-04-01T19:56:57.474 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.475 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9471854c:::benchmark_data_smithi188_161190_object36770:head# 2024-04-01T19:56:57.475 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.475 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9471d549:::benchmark_data_smithi188_161190_object34533:head# 2024-04-01T19:56:57.475 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.475 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:947223d7:::benchmark_data_smithi188_161190_object109827:head# 2024-04-01T19:56:57.475 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.475 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9472e042:::benchmark_data_smithi188_161190_object139275:head# 2024-04-01T19:56:57.475 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.475 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9473869e:::benchmark_data_smithi188_161190_object130985:head# 2024-04-01T19:56:57.475 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9473fc62:::benchmark_data_smithi188_161190_object93801:head# 2024-04-01T19:56:57.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94745768:::benchmark_data_smithi188_161190_object95883:head# 2024-04-01T19:56:57.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94746733:::benchmark_data_smithi188_161190_object95369:head# 2024-04-01T19:56:57.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9474ee8f:::benchmark_data_smithi188_161190_object69706:head# 2024-04-01T19:56:57.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9475b50c:::benchmark_data_smithi188_161190_object70371:head# 2024-04-01T19:56:57.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9476b42a:::benchmark_data_smithi188_161190_object52767:head# 2024-04-01T19:56:57.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9477f8b7:::benchmark_data_smithi188_161190_object54141:head# 2024-04-01T19:56:57.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.479 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9478f717:::benchmark_data_smithi188_161190_object92167:head# 2024-04-01T19:56:57.479 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.479 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:947904f0:::benchmark_data_smithi188_161190_object31748:head# 2024-04-01T19:56:57.479 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.479 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9479163d:::benchmark_data_smithi188_161190_object113797:head# 2024-04-01T19:56:57.479 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.479 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94791c0d:::benchmark_data_smithi188_161190_object101459:head# 2024-04-01T19:56:57.479 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.480 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:947b534a:::benchmark_data_smithi188_161190_object136139:head# 2024-04-01T19:56:57.480 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.480 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:947b60c9:::benchmark_data_smithi188_161190_object38767:head# 2024-04-01T19:56:57.480 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.480 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:947be579:::benchmark_data_smithi188_161190_object56995:head# 2024-04-01T19:56:57.480 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.480 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:947c815e:::benchmark_data_smithi188_161190_object104271:head# 2024-04-01T19:56:57.480 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.481 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:947d115e:::benchmark_data_smithi188_161190_object119715:head# 2024-04-01T19:56:57.481 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.481 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:947dbba0:::benchmark_data_smithi188_161190_object28628:head# 2024-04-01T19:56:57.481 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.481 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:947eb3b3:::benchmark_data_smithi188_161190_object20288:head# 2024-04-01T19:56:57.481 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.490 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:947ee555:::benchmark_data_smithi188_161190_object82460:head# 2024-04-01T19:56:57.490 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.490 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:947fa794:::benchmark_data_smithi188_161190_object44350:head# 2024-04-01T19:56:57.490 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:947fd345:::benchmark_data_smithi188_161190_object85793:head# 2024-04-01T19:56:57.491 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9480849b:::benchmark_data_smithi188_161190_object25947:head# 2024-04-01T19:56:57.491 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9480a9fe:::benchmark_data_smithi188_161190_object112695:head# 2024-04-01T19:56:57.491 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9480c70e:::benchmark_data_smithi188_161190_object91714:head# 2024-04-01T19:56:57.491 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94827f28:::benchmark_data_smithi188_161190_object113337:head# 2024-04-01T19:56:57.491 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9482dec2:::benchmark_data_smithi188_161190_object22289:head# 2024-04-01T19:56:57.491 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94830b37:::benchmark_data_smithi188_161190_object125133:head# 2024-04-01T19:56:57.491 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94832f8a:::benchmark_data_smithi188_161190_object135310:head# 2024-04-01T19:56:57.492 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.492 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94835675:::benchmark_data_smithi188_161190_object43167:head# 2024-04-01T19:56:57.492 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.492 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9483a625:::benchmark_data_smithi188_161190_object104203:head# 2024-04-01T19:56:57.492 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.492 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9483bb42:::benchmark_data_smithi188_161190_object61661:head# 2024-04-01T19:56:57.492 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.492 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94852568:::benchmark_data_smithi188_161190_object53262:head# 2024-04-01T19:56:57.492 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.492 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9485c6a1:::benchmark_data_smithi188_161190_object132988:head# 2024-04-01T19:56:57.492 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.492 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9486127b:::benchmark_data_smithi188_161190_object48313:head# 2024-04-01T19:56:57.492 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.494 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94869846:::benchmark_data_smithi188_161190_object27367:head# 2024-04-01T19:56:57.494 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.494 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9486daf5:::benchmark_data_smithi188_161190_object51621:head# 2024-04-01T19:56:57.494 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.496 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9487337a:::benchmark_data_smithi188_161190_object78725:head# 2024-04-01T19:56:57.497 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.497 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94878c61:::benchmark_data_smithi188_161190_object72976:head# 2024-04-01T19:56:57.497 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.497 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9487e66a:::benchmark_data_smithi188_161190_object121914:head# 2024-04-01T19:56:57.497 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.497 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94888c52:::benchmark_data_smithi188_161190_object28428:head# 2024-04-01T19:56:57.497 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.497 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94898589:::benchmark_data_smithi188_161190_object111104:head# 2024-04-01T19:56:57.497 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.497 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94899550:::benchmark_data_smithi188_161190_object78804:head# 2024-04-01T19:56:57.497 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.497 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9489a246:::benchmark_data_smithi188_161190_object131669:head# 2024-04-01T19:56:57.497 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.497 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:948a5618:::benchmark_data_smithi188_161190_object31796:head# 2024-04-01T19:56:57.498 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.498 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:948a653f:::benchmark_data_smithi188_161190_object69048:head# 2024-04-01T19:56:57.498 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.499 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:948ab9cf:::benchmark_data_smithi188_161190_object94734:head# 2024-04-01T19:56:57.499 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.499 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:948ad962:::benchmark_data_smithi188_161190_object89909:head# 2024-04-01T19:56:57.500 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.500 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:948b3a2b:::benchmark_data_smithi188_161190_object67343:head# 2024-04-01T19:56:57.500 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.500 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:948bda7d:::benchmark_data_smithi188_161190_object46398:head# 2024-04-01T19:56:57.500 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.500 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:948c8ae5:::benchmark_data_smithi188_161190_object128647:head# 2024-04-01T19:56:57.500 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.500 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:948d1bf0:::benchmark_data_smithi188_161190_object79466:head# 2024-04-01T19:56:57.500 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.500 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:948d1d96:::benchmark_data_smithi188_161190_object59859:head# 2024-04-01T19:56:57.500 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.500 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:948e1aab:::benchmark_data_smithi188_161190_object33154:head# 2024-04-01T19:56:57.500 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.500 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:948e5936:::benchmark_data_smithi188_161190_object109782:head# 2024-04-01T19:56:57.500 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.501 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:948e6394:::benchmark_data_smithi188_161190_object94736:head# 2024-04-01T19:56:57.501 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.501 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:948f00b2:::benchmark_data_smithi188_161190_object74423:head# 2024-04-01T19:56:57.501 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.501 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9490f6c7:::benchmark_data_smithi188_161190_object84607:head# 2024-04-01T19:56:57.502 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.502 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94911375:::benchmark_data_smithi188_161190_object33061:head# 2024-04-01T19:56:57.502 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.502 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:949177b2:::benchmark_data_smithi188_161190_object80497:head# 2024-04-01T19:56:57.502 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.502 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94923e94:::benchmark_data_smithi188_161190_object58188:head# 2024-04-01T19:56:57.502 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.502 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:949311e2:::benchmark_data_smithi188_161190_object116426:head# 2024-04-01T19:56:57.502 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.502 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9493302e:::benchmark_data_smithi188_161190_object121276:head# 2024-04-01T19:56:57.502 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.502 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9493f960:::benchmark_data_smithi188_161190_object28609:head# 2024-04-01T19:56:57.502 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.503 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94942b83:::benchmark_data_smithi188_161190_object109110:head# 2024-04-01T19:56:57.503 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.504 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9494bc68:::benchmark_data_smithi188_161190_object71104:head# 2024-04-01T19:56:57.504 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.504 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:949592eb:::benchmark_data_smithi188_161190_object125299:head# 2024-04-01T19:56:57.504 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.504 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9495aec9:::benchmark_data_smithi188_161190_object49339:head# 2024-04-01T19:56:57.504 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.505 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9495b7e8:::benchmark_data_smithi188_161190_object112650:head# 2024-04-01T19:56:57.505 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.505 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:949665d4:::benchmark_data_smithi188_161190_object74869:head# 2024-04-01T19:56:57.505 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.505 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94971401:::benchmark_data_smithi188_161190_object84078:head# 2024-04-01T19:56:57.505 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.505 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94971ae5:::benchmark_data_smithi188_161190_object131168:head# 2024-04-01T19:56:57.505 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.505 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9497a8bc:::benchmark_data_smithi188_161190_object87795:head# 2024-04-01T19:56:57.505 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.505 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9497bfab:::benchmark_data_smithi188_161190_object55480:head# 2024-04-01T19:56:57.505 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.506 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:949837dc:::benchmark_data_smithi188_161190_object45286:head# 2024-04-01T19:56:57.506 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.509 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94988317:::benchmark_data_smithi188_161190_object69664:head# 2024-04-01T19:56:57.509 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.509 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9498ac66:::benchmark_data_smithi188_161190_object40141:head# 2024-04-01T19:56:57.509 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.510 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94992293:::benchmark_data_smithi188_161190_object26017:head# 2024-04-01T19:56:57.510 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.510 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94993fa7:::benchmark_data_smithi188_161190_object74033:head# 2024-04-01T19:56:57.510 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.510 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:949aa541:::benchmark_data_smithi188_161190_object55854:head# 2024-04-01T19:56:57.510 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.510 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:949afc41:::benchmark_data_smithi188_161190_object92994:head# 2024-04-01T19:56:57.511 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.512 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:949b85bc:::benchmark_data_smithi188_161190_object74955:head# 2024-04-01T19:56:57.512 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.512 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:949bedb8:::benchmark_data_smithi188_161190_object135819:head# 2024-04-01T19:56:57.512 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.512 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:949c5654:::benchmark_data_smithi188_161190_object100547:head# 2024-04-01T19:56:57.513 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.513 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:949c7f57:::benchmark_data_smithi188_161190_object126799:head# 2024-04-01T19:56:57.513 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.513 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:949cc231:::benchmark_data_smithi188_161190_object107722:head# 2024-04-01T19:56:57.513 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.513 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:949ce328:::benchmark_data_smithi188_161190_object54384:head# 2024-04-01T19:56:57.513 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.513 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:949d46cc:::benchmark_data_smithi188_161190_object40363:head# 2024-04-01T19:56:57.513 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.513 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:949d4929:::benchmark_data_smithi188_161190_object72808:head# 2024-04-01T19:56:57.513 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.513 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:949d7c7b:::benchmark_data_smithi188_161190_object48513:head# 2024-04-01T19:56:57.513 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.517 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:949e3075:::benchmark_data_smithi188_161190_object64452:head# 2024-04-01T19:56:57.517 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.518 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:949e43ac:::benchmark_data_smithi188_161190_object122973:head# 2024-04-01T19:56:57.518 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.522 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:949e456e:::benchmark_data_smithi188_161190_object26094:head# 2024-04-01T19:56:57.522 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.523 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:949ee962:::benchmark_data_smithi188_161190_object114509:head# 2024-04-01T19:56:57.523 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.523 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:949f321d:::benchmark_data_smithi188_161190_object60602:head# 2024-04-01T19:56:57.523 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.523 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:949f6435:::benchmark_data_smithi188_161190_object79404:head# 2024-04-01T19:56:57.523 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.523 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:949f78b0:::benchmark_data_smithi188_161190_object81928:head# 2024-04-01T19:56:57.523 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.525 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:949fc236:::benchmark_data_smithi188_161190_object95933:head# 2024-04-01T19:56:57.525 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.525 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:949fce83:::benchmark_data_smithi188_161190_object62913:head# 2024-04-01T19:56:57.525 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.525 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94a0d5c8:::benchmark_data_smithi188_161190_object134933:head# 2024-04-01T19:56:57.525 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.525 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94a1ab59:::benchmark_data_smithi188_161190_object67132:head# 2024-04-01T19:56:57.525 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.526 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94a2ea05:::benchmark_data_smithi188_161190_object60170:head# 2024-04-01T19:56:57.526 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.526 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94a2fa4f:::benchmark_data_smithi188_161190_object97821:head# 2024-04-01T19:56:57.526 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.526 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94a358e5:::benchmark_data_smithi188_161190_object58880:head# 2024-04-01T19:56:57.526 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.526 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94a3f360:::benchmark_data_smithi188_161190_object121484:head# 2024-04-01T19:56:57.526 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.527 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94a3f495:::benchmark_data_smithi188_161190_object92906:head# 2024-04-01T19:56:57.527 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.527 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94a48837:::benchmark_data_smithi188_161190_object59851:head# 2024-04-01T19:56:57.527 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.527 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94a48bbc:::benchmark_data_smithi188_161190_object114967:head# 2024-04-01T19:56:57.527 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.528 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94a66386:::benchmark_data_smithi188_161190_object116352:head# 2024-04-01T19:56:57.528 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.528 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94a864c8:::benchmark_data_smithi188_161190_object37563:head# 2024-04-01T19:56:57.528 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.528 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94a94c6d:::benchmark_data_smithi188_161190_object37737:head# 2024-04-01T19:56:57.528 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.529 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94a96815:::benchmark_data_smithi188_161190_object120556:head# 2024-04-01T19:56:57.529 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.529 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94a992c9:::benchmark_data_smithi188_161190_object109022:head# 2024-04-01T19:56:57.529 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.529 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94a9af4d:::benchmark_data_smithi188_161190_object123338:head# 2024-04-01T19:56:57.529 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.529 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94a9b65f:::benchmark_data_smithi188_161190_object110788:head# 2024-04-01T19:56:57.529 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.529 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94aa83ab:::benchmark_data_smithi188_161190_object131057:head# 2024-04-01T19:56:57.529 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.529 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94aaff0c:::benchmark_data_smithi188_161190_object112489:head# 2024-04-01T19:56:57.529 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.530 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94ac5f9e:::benchmark_data_smithi188_161190_object81746:head# 2024-04-01T19:56:57.530 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.530 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94ad6767:::benchmark_data_smithi188_161190_object55470:head# 2024-04-01T19:56:57.530 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.531 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94ad726e:::benchmark_data_smithi188_161190_object92182:head# 2024-04-01T19:56:57.531 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.531 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94add713:::benchmark_data_smithi188_161190_object99546:head# 2024-04-01T19:56:57.531 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.531 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94ae122d:::benchmark_data_smithi188_161190_object107703:head# 2024-04-01T19:56:57.531 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.531 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94af952a:::benchmark_data_smithi188_161190_object132928:head# 2024-04-01T19:56:57.531 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.531 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94afad59:::benchmark_data_smithi188_161190_object56262:head# 2024-04-01T19:56:57.531 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.535 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94afc92a:::benchmark_data_smithi188_161190_object109053:head# 2024-04-01T19:56:57.535 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.540 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94afcf5f:::benchmark_data_smithi188_161190_object84383:head# 2024-04-01T19:56:57.540 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.540 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94afd4b0:::benchmark_data_smithi188_161190_object123763:head# 2024-04-01T19:56:57.540 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.552 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94afda1d:::benchmark_data_smithi188_161190_object85696:head# 2024-04-01T19:56:57.552 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.552 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94afdf91:::benchmark_data_smithi188_161190_object93796:head# 2024-04-01T19:56:57.553 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.553 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94affee3:::benchmark_data_smithi188_161190_object130906:head# 2024-04-01T19:56:57.553 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.553 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94b07642:::benchmark_data_smithi188_161190_object90087:head# 2024-04-01T19:56:57.553 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.553 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94b182e0:::benchmark_data_smithi188_161190_object50241:head# 2024-04-01T19:56:57.553 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.557 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94b29926:::benchmark_data_smithi188_161190_object59304:head# 2024-04-01T19:56:57.557 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.558 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94b3da7e:::benchmark_data_smithi188_161190_object69480:head# 2024-04-01T19:56:57.558 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.559 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94b40162:::benchmark_data_smithi188_161190_object106647:head# 2024-04-01T19:56:57.559 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.559 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94b4084b:::benchmark_data_smithi188_161190_object30210:head# 2024-04-01T19:56:57.559 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.560 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94b51332:::benchmark_data_smithi188_161190_object138990:head# 2024-04-01T19:56:57.560 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.560 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94b5495f:::benchmark_data_smithi188_161190_object40176:head# 2024-04-01T19:56:57.560 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.560 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94b5f224:::benchmark_data_smithi188_161190_object77585:head# 2024-04-01T19:56:57.560 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.561 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94b66a64:::benchmark_data_smithi188_161190_object60794:head# 2024-04-01T19:56:57.561 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.561 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94b6cefe:::benchmark_data_smithi188_161190_object21114:head# 2024-04-01T19:56:57.561 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.561 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94b71e41:::benchmark_data_smithi188_161190_object125221:head# 2024-04-01T19:56:57.562 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.562 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94b76366:::benchmark_data_smithi188_161190_object130504:head# 2024-04-01T19:56:57.562 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.562 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94b76a38:::benchmark_data_smithi188_161190_object33308:head# 2024-04-01T19:56:57.562 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.562 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94b843e5:::benchmark_data_smithi188_161190_object84018:head# 2024-04-01T19:56:57.562 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.562 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94b8a884:::benchmark_data_smithi188_161190_object86581:head# 2024-04-01T19:56:57.562 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.567 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94b94c8e:::benchmark_data_smithi188_161190_object55430:head# 2024-04-01T19:56:57.567 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.567 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94b9eaa8:::benchmark_data_smithi188_161190_object114076:head# 2024-04-01T19:56:57.567 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.568 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94ba2cb5:::benchmark_data_smithi188_161190_object24479:head# 2024-04-01T19:56:57.568 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.569 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94bc5e2e:::benchmark_data_smithi188_161190_object38316:head# 2024-04-01T19:56:57.569 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.569 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94bd8eb2:::benchmark_data_smithi188_161190_object30599:head# 2024-04-01T19:56:57.569 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.569 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94bd9afd:::benchmark_data_smithi188_161190_object64812:head# 2024-04-01T19:56:57.569 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.569 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94bde07a:::benchmark_data_smithi188_161190_object35196:head# 2024-04-01T19:56:57.569 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.570 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94be0d3c:::benchmark_data_smithi188_161190_object127406:head# 2024-04-01T19:56:57.570 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.570 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94be1777:::benchmark_data_smithi188_161190_object102461:head# 2024-04-01T19:56:57.570 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.571 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94be6196:::benchmark_data_smithi188_161190_object64453:head# 2024-04-01T19:56:57.571 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.571 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94bea15b:::benchmark_data_smithi188_161190_object136837:head# 2024-04-01T19:56:57.571 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.571 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94bea95b:::benchmark_data_smithi188_161190_object25040:head# 2024-04-01T19:56:57.571 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.571 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94bef73d:::benchmark_data_smithi188_161190_object116328:head# 2024-04-01T19:56:57.571 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.571 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94bf374a:::benchmark_data_smithi188_161190_object114083:head# 2024-04-01T19:56:57.571 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.572 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94bf701b:::benchmark_data_smithi188_161190_object134197:head# 2024-04-01T19:56:57.572 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.572 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94c03808:::benchmark_data_smithi188_161190_object93596:head# 2024-04-01T19:56:57.572 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.573 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94c0477f:::benchmark_data_smithi188_161190_object119078:head# 2024-04-01T19:56:57.573 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.573 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94c0cdac:::benchmark_data_smithi188_161190_object111600:head# 2024-04-01T19:56:57.573 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.574 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94c11599:::benchmark_data_smithi188_161190_object53128:head# 2024-04-01T19:56:57.574 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.574 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94c299c1:::benchmark_data_smithi188_161190_object81191:head# 2024-04-01T19:56:57.574 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.575 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94c2bb0a:::benchmark_data_smithi188_161190_object124371:head# 2024-04-01T19:56:57.575 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.575 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94c30ce4:::benchmark_data_smithi188_161190_object70604:head# 2024-04-01T19:56:57.575 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.575 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94c4e9a1:::benchmark_data_smithi188_161190_object57584:head# 2024-04-01T19:56:57.575 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.575 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94c5457e:::benchmark_data_smithi188_161190_object83070:head# 2024-04-01T19:56:57.576 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.576 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94c62c63:::benchmark_data_smithi188_161190_object71818:head# 2024-04-01T19:56:57.576 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.576 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94c67799:::benchmark_data_smithi188_161190_object60832:head# 2024-04-01T19:56:57.576 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.576 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94c738c1:::benchmark_data_smithi188_161190_object63447:head# 2024-04-01T19:56:57.576 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.579 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94c75626:::benchmark_data_smithi188_161190_object134683:head# 2024-04-01T19:56:57.579 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.579 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94c8463f:::benchmark_data_smithi188_161190_object58054:head# 2024-04-01T19:56:57.580 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.580 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94c87935:::benchmark_data_smithi188_161190_object122541:head# 2024-04-01T19:56:57.580 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.580 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94c9c1b7:::benchmark_data_smithi188_161190_object85473:head# 2024-04-01T19:56:57.580 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.580 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94cb4069:::benchmark_data_smithi188_161190_object57036:head# 2024-04-01T19:56:57.580 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.580 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94cb96b6:::benchmark_data_smithi188_161190_object26190:head# 2024-04-01T19:56:57.580 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.580 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94cc0b3c:::benchmark_data_smithi188_161190_object117980:head# 2024-04-01T19:56:57.580 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.580 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94cca485:::benchmark_data_smithi188_161190_object38615:head# 2024-04-01T19:56:57.580 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.582 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94ccce67:::benchmark_data_smithi188_161190_object85372:head# 2024-04-01T19:56:57.582 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.582 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94cd5cee:::benchmark_data_smithi188_161190_object50638:head# 2024-04-01T19:56:57.582 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.582 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94cd7be3:::benchmark_data_smithi188_161190_object111789:head# 2024-04-01T19:56:57.583 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.583 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94ce2b2b:::benchmark_data_smithi188_161190_object66723:head# 2024-04-01T19:56:57.583 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.583 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94ce40c6:::benchmark_data_smithi188_161190_object137439:head# 2024-04-01T19:56:57.583 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.583 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94cee854:::benchmark_data_smithi188_161190_object136026:head# 2024-04-01T19:56:57.583 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.583 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94cf1ed1:::benchmark_data_smithi188_161190_object100862:head# 2024-04-01T19:56:57.583 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.583 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94cfff98:::benchmark_data_smithi188_161190_object55352:head# 2024-04-01T19:56:57.583 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.583 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94d088b6:::benchmark_data_smithi188_161190_object70855:head# 2024-04-01T19:56:57.583 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.583 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94d116b0:::benchmark_data_smithi188_161190_object85578:head# 2024-04-01T19:56:57.584 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.586 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94d252f9:::benchmark_data_smithi188_161190_object121098:head# 2024-04-01T19:56:57.586 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.586 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94d2745b:::benchmark_data_smithi188_161190_object134070:head# 2024-04-01T19:56:57.586 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.586 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94d34748:::benchmark_data_smithi188_161190_object119830:head# 2024-04-01T19:56:57.586 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.586 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94d3a427:::benchmark_data_smithi188_161190_object127242:head# 2024-04-01T19:56:57.586 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.587 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94d4d628:::benchmark_data_smithi188_161190_object21604:head# 2024-04-01T19:56:57.587 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.587 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94d4de6c:::benchmark_data_smithi188_161190_object81291:head# 2024-04-01T19:56:57.587 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.587 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94d65830:::benchmark_data_smithi188_161190_object47854:head# 2024-04-01T19:56:57.587 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.587 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94d67e6b:::benchmark_data_smithi188_161190_object119520:head# 2024-04-01T19:56:57.587 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.587 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94d70da9:::benchmark_data_smithi188_161190_object74210:head# 2024-04-01T19:56:57.587 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.587 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94d7a83c:::benchmark_data_smithi188_161190_object113542:head# 2024-04-01T19:56:57.587 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.587 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94d8a20e:::benchmark_data_smithi188_161190_object104697:head# 2024-04-01T19:56:57.587 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.589 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94d94d32:::benchmark_data_smithi188_161190_object49614:head# 2024-04-01T19:56:57.589 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.590 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94d9fa82:::benchmark_data_smithi188_161190_object54420:head# 2024-04-01T19:56:57.590 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.590 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94db1571:::benchmark_data_smithi188_161190_object45946:head# 2024-04-01T19:56:57.590 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.590 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94db42d5:::benchmark_data_smithi188_161190_object92275:head# 2024-04-01T19:56:57.590 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.590 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94db7ea5:::benchmark_data_smithi188_161190_object59706:head# 2024-04-01T19:56:57.590 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.590 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94db9114:::benchmark_data_smithi188_161190_object111817:head# 2024-04-01T19:56:57.590 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.590 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94dc6c2e:::benchmark_data_smithi188_161190_object34274:head# 2024-04-01T19:56:57.590 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.590 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94dd5118:::benchmark_data_smithi188_161190_object110549:head# 2024-04-01T19:56:57.591 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.591 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94dd81a2:::benchmark_data_smithi188_161190_object115269:head# 2024-04-01T19:56:57.591 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.591 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94ddd581:::benchmark_data_smithi188_161190_object79110:head# 2024-04-01T19:56:57.591 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.591 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94ddfeae:::benchmark_data_smithi188_161190_object97018:head# 2024-04-01T19:56:57.591 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.591 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94de01e7:::benchmark_data_smithi188_161190_object119179:head# 2024-04-01T19:56:57.591 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.593 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94de1eb2:::benchmark_data_smithi188_161190_object79044:head# 2024-04-01T19:56:57.593 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.593 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94de62f1:::benchmark_data_smithi188_161190_object92903:head# 2024-04-01T19:56:57.593 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.593 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94deb6f6:::benchmark_data_smithi188_161190_object121248:head# 2024-04-01T19:56:57.593 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.594 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94df7d2a:::benchmark_data_smithi188_161190_object116645:head# 2024-04-01T19:56:57.594 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.594 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94e0e459:::benchmark_data_smithi188_161190_object119380:head# 2024-04-01T19:56:57.594 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.594 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94e11d6c:::benchmark_data_smithi188_161190_object34685:head# 2024-04-01T19:56:57.594 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.594 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94e12553:::benchmark_data_smithi188_161190_object72608:head# 2024-04-01T19:56:57.594 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.594 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94e1b96c:::benchmark_data_smithi188_161190_object98491:head# 2024-04-01T19:56:57.594 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.594 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94e1fc8b:::benchmark_data_smithi188_161190_object89714:head# 2024-04-01T19:56:57.594 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94e24dba:::benchmark_data_smithi188_161190_object25278:head# 2024-04-01T19:56:57.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94e2d9c0:::benchmark_data_smithi188_161190_object89775:head# 2024-04-01T19:56:57.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94e34b80:::benchmark_data_smithi188_161190_object110822:head# 2024-04-01T19:56:57.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94e36279:::benchmark_data_smithi188_161190_object82279:head# 2024-04-01T19:56:57.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94e37164:::benchmark_data_smithi188_161190_object38597:head# 2024-04-01T19:56:57.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.596 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94e37a4c:::benchmark_data_smithi188_161190_object19772:head# 2024-04-01T19:56:57.596 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.605 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94e4b907:::benchmark_data_smithi188_161190_object35824:head# 2024-04-01T19:56:57.605 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.605 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94e55462:::benchmark_data_smithi188_161190_object64890:head# 2024-04-01T19:56:57.605 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.605 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94e63a50:::benchmark_data_smithi188_161190_object88877:head# 2024-04-01T19:56:57.606 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.606 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94e93922:::benchmark_data_smithi188_161190_object94557:head# 2024-04-01T19:56:57.606 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.606 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94e9cd5a:::benchmark_data_smithi188_161190_object28355:head# 2024-04-01T19:56:57.606 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.606 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94ea1957:::benchmark_data_smithi188_161190_object63795:head# 2024-04-01T19:56:57.606 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.606 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94ea44bb:::benchmark_data_smithi188_161190_object103270:head# 2024-04-01T19:56:57.606 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.606 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94ec0583:::benchmark_data_smithi188_161190_object67939:head# 2024-04-01T19:56:57.606 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.606 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94ec067a:::benchmark_data_smithi188_161190_object84929:head# 2024-04-01T19:56:57.606 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.607 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94ecb8b8:::benchmark_data_smithi188_161190_object73136:head# 2024-04-01T19:56:57.607 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.607 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94ed136e:::benchmark_data_smithi188_161190_object97777:head# 2024-04-01T19:56:57.607 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.607 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94ee02f1:::benchmark_data_smithi188_161190_object74809:head# 2024-04-01T19:56:57.607 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.607 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94ee6fea:::benchmark_data_smithi188_161190_object113494:head# 2024-04-01T19:56:57.607 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.607 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94ef24da:::benchmark_data_smithi188_161190_object99563:head# 2024-04-01T19:56:57.607 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.607 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94ef2b1d:::benchmark_data_smithi188_161190_object46442:head# 2024-04-01T19:56:57.607 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.607 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94f0d9ab:::benchmark_data_smithi188_161190_object35372:head# 2024-04-01T19:56:57.607 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.608 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94f19857:::benchmark_data_smithi188_161190_object101132:head# 2024-04-01T19:56:57.608 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.608 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94f1ce0c:::benchmark_data_smithi188_161190_object138965:head# 2024-04-01T19:56:57.608 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.608 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94f1fe11:::benchmark_data_smithi188_161190_object123386:head# 2024-04-01T19:56:57.608 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.608 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94f2974c:::benchmark_data_smithi188_161190_object117566:head# 2024-04-01T19:56:57.608 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.608 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94f2a198:::benchmark_data_smithi188_161190_object74471:head# 2024-04-01T19:56:57.608 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.609 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94f334a3:::benchmark_data_smithi188_161190_object85630:head# 2024-04-01T19:56:57.609 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.609 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94f3d627:::benchmark_data_smithi188_161190_object113727:head# 2024-04-01T19:56:57.610 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.610 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94f4374d:::benchmark_data_smithi188_161190_object70725:head# 2024-04-01T19:56:57.610 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.610 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94f5748c:::benchmark_data_smithi188_161190_object125374:head# 2024-04-01T19:56:57.610 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.610 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94f57e3d:::benchmark_data_smithi188_161190_object80878:head# 2024-04-01T19:56:57.610 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.610 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94f5e3ce:::benchmark_data_smithi188_161190_object93171:head# 2024-04-01T19:56:57.610 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.610 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94f63f6e:::benchmark_data_smithi188_161190_object90878:head# 2024-04-01T19:56:57.610 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.610 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94f66935:::benchmark_data_smithi188_161190_object73257:head# 2024-04-01T19:56:57.610 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.611 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94f6c284:::benchmark_data_smithi188_161190_object68118:head# 2024-04-01T19:56:57.611 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.611 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94f6f562:::benchmark_data_smithi188_161190_object80875:head# 2024-04-01T19:56:57.611 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.611 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94f778ab:::benchmark_data_smithi188_161190_object67351:head# 2024-04-01T19:56:57.611 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:57 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:56:57.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:57 smithi022 ceph-mon[39439]: from='client.37229 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:56:57.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:57 smithi022 ceph-mon[39439]: osdmap e693: 12 total, 11 up, 10 in 2024-04-01T19:56:57.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:57 smithi022 ceph-mon[39439]: pgmap v1896: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.1 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 0 B/s wr, 732 op/s; 31028/199486 objects degraded (15.554%); 15 MiB/s, 240 objects/s recovering 2024-04-01T19:56:57.612 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94f7d7fb:::benchmark_data_smithi188_161190_object95480:head# 2024-04-01T19:56:57.612 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.613 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94f7f270:::benchmark_data_smithi188_161190_object115673:head# 2024-04-01T19:56:57.613 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.619 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94f83dfd:::benchmark_data_smithi188_161190_object96451:head# 2024-04-01T19:56:57.620 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.626 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94f8f33b:::benchmark_data_smithi188_161190_object21419:head# 2024-04-01T19:56:57.626 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.632 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94f97316:::benchmark_data_smithi188_161190_object70252:head# 2024-04-01T19:56:57.632 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.633 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94fb2a05:::benchmark_data_smithi188_161190_object86303:head# 2024-04-01T19:56:57.633 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.633 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94fc0f31:::benchmark_data_smithi188_161190_object125867:head# 2024-04-01T19:56:57.633 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.634 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94fc3ad4:::benchmark_data_smithi188_161190_object116477:head# 2024-04-01T19:56:57.634 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.634 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94fc7a11:::benchmark_data_smithi188_161190_object77447:head# 2024-04-01T19:56:57.634 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.635 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94fc819a:::benchmark_data_smithi188_161190_object125301:head# 2024-04-01T19:56:57.635 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.635 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94fc9541:::benchmark_data_smithi188_161190_object125519:head# 2024-04-01T19:56:57.635 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.636 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94fc98ec:::benchmark_data_smithi188_161190_object54607:head# 2024-04-01T19:56:57.636 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.636 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94fca13b:::benchmark_data_smithi188_161190_object62611:head# 2024-04-01T19:56:57.636 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.637 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94feabf9:::benchmark_data_smithi188_161190_object99633:head# 2024-04-01T19:56:57.637 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.637 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94fed780:::benchmark_data_smithi188_161190_object63599:head# 2024-04-01T19:56:57.637 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.638 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94ff029e:::benchmark_data_smithi188_161190_object35157:head# 2024-04-01T19:56:57.638 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.638 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94ff070c:::benchmark_data_smithi188_161190_object124535:head# 2024-04-01T19:56:57.638 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.638 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94ff398b:::benchmark_data_smithi188_161190_object71548:head# 2024-04-01T19:56:57.638 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.639 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:94ffbd2b:::benchmark_data_smithi188_161190_object71598:head# 2024-04-01T19:56:57.639 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.639 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:950153df:::benchmark_data_smithi188_161190_object45546:head# 2024-04-01T19:56:57.639 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.642 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95018c92:::benchmark_data_smithi188_161190_object100152:head# 2024-04-01T19:56:57.642 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.642 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95019b59:::benchmark_data_smithi188_161190_object27145:head# 2024-04-01T19:56:57.642 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.642 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9501e891:::benchmark_data_smithi188_161190_object57690:head# 2024-04-01T19:56:57.642 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.642 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95024820:::benchmark_data_smithi188_161190_object95394:head# 2024-04-01T19:56:57.642 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.642 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:950257c2:::benchmark_data_smithi188_161190_object26454:head# 2024-04-01T19:56:57.642 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.642 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9502a75a:::benchmark_data_smithi188_161190_object36846:head# 2024-04-01T19:56:57.643 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.643 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9502dfa2:::benchmark_data_smithi188_161190_object104274:head# 2024-04-01T19:56:57.643 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.643 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95032e4c:::benchmark_data_smithi188_161190_object103297:head# 2024-04-01T19:56:57.643 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.643 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95033d0d:::benchmark_data_smithi188_161190_object50438:head# 2024-04-01T19:56:57.643 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.643 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95051555:::benchmark_data_smithi188_161190_object47287:head# 2024-04-01T19:56:57.643 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.643 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9505629f:::benchmark_data_smithi188_161190_object69621:head# 2024-04-01T19:56:57.643 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.643 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95056940:::benchmark_data_smithi188_161190_object42364:head# 2024-04-01T19:56:57.643 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.643 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:950596b3:::benchmark_data_smithi188_161190_object68228:head# 2024-04-01T19:56:57.643 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.647 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95074305:::benchmark_data_smithi188_161190_object85153:head# 2024-04-01T19:56:57.647 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.647 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95076c62:::benchmark_data_smithi188_161190_object83861:head# 2024-04-01T19:56:57.647 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.647 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9507ad40:::benchmark_data_smithi188_161190_object108475:head# 2024-04-01T19:56:57.647 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.647 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9507b19d:::benchmark_data_smithi188_161190_object90870:head# 2024-04-01T19:56:57.647 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.647 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9508390c:::benchmark_data_smithi188_161190_object57219:head# 2024-04-01T19:56:57.647 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.647 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9509001e:::benchmark_data_smithi188_161190_object68834:head# 2024-04-01T19:56:57.647 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.648 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95093697:::benchmark_data_smithi188_161190_object43736:head# 2024-04-01T19:56:57.648 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.648 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9509fd74:::benchmark_data_smithi188_161190_object80017:head# 2024-04-01T19:56:57.648 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.648 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:950a4abd:::benchmark_data_smithi188_161190_object38111:head# 2024-04-01T19:56:57.648 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.648 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:950ad6c7:::benchmark_data_smithi188_161190_object105248:head# 2024-04-01T19:56:57.648 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.648 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:950b9992:::benchmark_data_smithi188_161190_object127197:head# 2024-04-01T19:56:57.648 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.648 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:950c0d51:::benchmark_data_smithi188_161190_object107404:head# 2024-04-01T19:56:57.648 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.648 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:950cc81a:::benchmark_data_smithi188_161190_object89352:head# 2024-04-01T19:56:57.648 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.649 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:950ed6a4:::benchmark_data_smithi188_161190_object128624:head# 2024-04-01T19:56:57.649 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.649 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:950ef053:::benchmark_data_smithi188_161190_object117452:head# 2024-04-01T19:56:57.649 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.649 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:950f2464:::benchmark_data_smithi188_161190_object69250:head# 2024-04-01T19:56:57.649 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.649 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95102941:::benchmark_data_smithi188_161190_object103651:head# 2024-04-01T19:56:57.649 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.649 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:951084b8:::benchmark_data_smithi188_161190_object104585:head# 2024-04-01T19:56:57.649 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.649 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:951172d0:::benchmark_data_smithi188_161190_object99952:head# 2024-04-01T19:56:57.649 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.651 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9511dccc:::benchmark_data_smithi188_161190_object128176:head# 2024-04-01T19:56:57.651 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.651 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9512c66b:::benchmark_data_smithi188_161190_object97199:head# 2024-04-01T19:56:57.651 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.651 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9512ef7a:::benchmark_data_smithi188_161190_object50069:head# 2024-04-01T19:56:57.651 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.651 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95145850:::benchmark_data_smithi188_161190_object98481:head# 2024-04-01T19:56:57.651 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.651 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9514a54a:::benchmark_data_smithi188_161190_object123390:head# 2024-04-01T19:56:57.651 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.653 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9514b5de:::benchmark_data_smithi188_161190_object58122:head# 2024-04-01T19:56:57.653 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.653 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9514b622:::benchmark_data_smithi188_161190_object120555:head# 2024-04-01T19:56:57.654 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.654 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9514d88a:::benchmark_data_smithi188_161190_object38654:head# 2024-04-01T19:56:57.654 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.654 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9514ebac:::benchmark_data_smithi188_161190_object78974:head# 2024-04-01T19:56:57.654 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.654 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9517bf85:::benchmark_data_smithi188_161190_object104003:head# 2024-04-01T19:56:57.654 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.654 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9518179c:::benchmark_data_smithi188_161190_object50492:head# 2024-04-01T19:56:57.654 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.654 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9518f374:::benchmark_data_smithi188_161190_object92114:head# 2024-04-01T19:56:57.654 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.654 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9518ffc6:::benchmark_data_smithi188_161190_object85216:head# 2024-04-01T19:56:57.655 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.655 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95191517:::benchmark_data_smithi188_161190_object133980:head# 2024-04-01T19:56:57.655 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.655 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9519e703:::benchmark_data_smithi188_161190_object23419:head# 2024-04-01T19:56:57.655 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.655 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:951a5627:::benchmark_data_smithi188_161190_object92548:head# 2024-04-01T19:56:57.655 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.655 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:951bad30:::benchmark_data_smithi188_161190_object118558:head# 2024-04-01T19:56:57.655 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.655 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:951d1411:::benchmark_data_smithi188_161190_object45456:head# 2024-04-01T19:56:57.655 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.655 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:951e3bf3:::benchmark_data_smithi188_161190_object46892:head# 2024-04-01T19:56:57.655 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.656 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:951e4d75:::benchmark_data_smithi188_161190_object133937:head# 2024-04-01T19:56:57.656 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.656 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:951e5c66:::benchmark_data_smithi188_161190_object75583:head# 2024-04-01T19:56:57.656 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.656 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:951e6b2c:::benchmark_data_smithi188_161190_object57103:head# 2024-04-01T19:56:57.656 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.656 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:951ede25:::benchmark_data_smithi188_161190_object77596:head# 2024-04-01T19:56:57.656 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.657 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:951ee805:::benchmark_data_smithi188_161190_object110057:head# 2024-04-01T19:56:57.657 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.657 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:951ef801:::benchmark_data_smithi188_161190_object114252:head# 2024-04-01T19:56:57.657 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.657 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95200756:::benchmark_data_smithi188_161190_object94375:head# 2024-04-01T19:56:57.658 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.658 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9520520e:::benchmark_data_smithi188_161190_object95495:head# 2024-04-01T19:56:57.658 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.658 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95216ced:::benchmark_data_smithi188_161190_object69125:head# 2024-04-01T19:56:57.658 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.658 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9521bc70:::benchmark_data_smithi188_161190_object66094:head# 2024-04-01T19:56:57.658 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.658 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95231cf2:::benchmark_data_smithi188_161190_object108961:head# 2024-04-01T19:56:57.658 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.658 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:952342bb:::benchmark_data_smithi188_161190_object127576:head# 2024-04-01T19:56:57.658 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.658 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95247ce5:::benchmark_data_smithi188_161190_object108767:head# 2024-04-01T19:56:57.658 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.659 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9524fbcd:::benchmark_data_smithi188_161190_object58372:head# 2024-04-01T19:56:57.659 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.671 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9525d27c:::benchmark_data_smithi188_161190_object63857:head# 2024-04-01T19:56:57.671 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.681 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9525ff70:::benchmark_data_smithi188_161190_object96102:head# 2024-04-01T19:56:57.681 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.681 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95262e47:::benchmark_data_smithi188_161190_object85200:head# 2024-04-01T19:56:57.681 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.681 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95265bd1:::benchmark_data_smithi188_161190_object53472:head# 2024-04-01T19:56:57.681 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.681 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:952814f1:::benchmark_data_smithi188_161190_object52584:head# 2024-04-01T19:56:57.681 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.681 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95285ecd:::benchmark_data_smithi188_161190_object105423:head# 2024-04-01T19:56:57.681 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.681 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9528d54c:::benchmark_data_smithi188_161190_object22331:head# 2024-04-01T19:56:57.682 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.682 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9528d833:::benchmark_data_smithi188_161190_object55816:head# 2024-04-01T19:56:57.682 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.682 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:952a467b:::benchmark_data_smithi188_161190_object79506:head# 2024-04-01T19:56:57.682 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.682 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:952a841d:::benchmark_data_smithi188_161190_object130089:head# 2024-04-01T19:56:57.682 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.682 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:952b5a36:::benchmark_data_smithi188_161190_object134668:head# 2024-04-01T19:56:57.682 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.682 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:952e1189:::benchmark_data_smithi188_161190_object128357:head# 2024-04-01T19:56:57.682 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.682 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:952e49c3:::benchmark_data_smithi188_161190_object104837:head# 2024-04-01T19:56:57.682 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.683 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:952f0c19:::benchmark_data_smithi188_161190_object30504:head# 2024-04-01T19:56:57.683 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.683 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:952f5d59:::benchmark_data_smithi188_161190_object25936:head# 2024-04-01T19:56:57.683 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.683 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9530b6e8:::benchmark_data_smithi188_161190_object104067:head# 2024-04-01T19:56:57.683 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.683 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9530c5d9:::benchmark_data_smithi188_161190_object93853:head# 2024-04-01T19:56:57.683 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.683 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9530fcd1:::benchmark_data_smithi188_161190_object75685:head# 2024-04-01T19:56:57.683 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.683 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95317b4e:::benchmark_data_smithi188_161190_object89341:head# 2024-04-01T19:56:57.683 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.683 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95317d96:::benchmark_data_smithi188_161190_object130456:head# 2024-04-01T19:56:57.684 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.684 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9531db5c:::benchmark_data_smithi188_161190_object40805:head# 2024-04-01T19:56:57.684 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.684 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:953272d0:::benchmark_data_smithi188_161190_object42015:head# 2024-04-01T19:56:57.684 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.684 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9533d1a7:::benchmark_data_smithi188_161190_object98067:head# 2024-04-01T19:56:57.684 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.687 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9534ea45:::benchmark_data_smithi188_161190_object69127:head# 2024-04-01T19:56:57.687 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.687 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:953571b4:::benchmark_data_smithi188_161190_object123091:head# 2024-04-01T19:56:57.687 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.688 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9536c0a5:::benchmark_data_smithi188_161190_object43720:head# 2024-04-01T19:56:57.688 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.688 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9537650e:::benchmark_data_smithi188_161190_object138138:head# 2024-04-01T19:56:57.688 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.688 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9537a33e:::benchmark_data_smithi188_161190_object70777:head# 2024-04-01T19:56:57.688 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.688 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9537c4ec:::benchmark_data_smithi188_161190_object110384:head# 2024-04-01T19:56:57.688 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.688 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95387689:::benchmark_data_smithi188_161190_object90452:head# 2024-04-01T19:56:57.688 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.688 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:953940a5:::benchmark_data_smithi188_161190_object69754:head# 2024-04-01T19:56:57.688 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.688 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9539c120:::benchmark_data_smithi188_161190_object35779:head# 2024-04-01T19:56:57.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:953a9926:::benchmark_data_smithi188_161190_object65859:head# 2024-04-01T19:56:57.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:953ac87c:::benchmark_data_smithi188_161190_object101136:head# 2024-04-01T19:56:57.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:953ad952:::benchmark_data_smithi188_161190_object52390:head# 2024-04-01T19:56:57.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:953b0650:::benchmark_data_smithi188_161190_object54176:head# 2024-04-01T19:56:57.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:953ce93c:::benchmark_data_smithi188_161190_object80821:head# 2024-04-01T19:56:57.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:953d4fe1:::benchmark_data_smithi188_161190_object52841:head# 2024-04-01T19:56:57.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:953e7495:::benchmark_data_smithi188_161190_object89520:head# 2024-04-01T19:56:57.690 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.690 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:953ec7ed:::benchmark_data_smithi188_161190_object116093:head# 2024-04-01T19:56:57.690 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.690 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:953feb73:::benchmark_data_smithi188_161190_object27778:head# 2024-04-01T19:56:57.690 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.690 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9540f7c2:::benchmark_data_smithi188_161190_object66216:head# 2024-04-01T19:56:57.690 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.690 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95417443:::benchmark_data_smithi188_161190_object136070:head# 2024-04-01T19:56:57.690 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.690 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9541fff1:::benchmark_data_smithi188_161190_object30349:head# 2024-04-01T19:56:57.690 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.690 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95425b55:::benchmark_data_smithi188_161190_object74215:head# 2024-04-01T19:56:57.690 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.693 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95429199:::benchmark_data_smithi188_161190_object129929:head# 2024-04-01T19:56:57.693 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.693 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95455888:::benchmark_data_smithi188_161190_object107310:head# 2024-04-01T19:56:57.693 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.693 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9545afd4:::benchmark_data_smithi188_161190_object133782:head# 2024-04-01T19:56:57.693 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.693 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9545b059:::benchmark_data_smithi188_161190_object124141:head# 2024-04-01T19:56:57.693 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.693 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95471147:::benchmark_data_smithi188_161190_object39708:head# 2024-04-01T19:56:57.693 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.693 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95473a8d:::benchmark_data_smithi188_161190_object119785:head# 2024-04-01T19:56:57.694 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.694 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:954800e9:::benchmark_data_smithi188_161190_object47723:head# 2024-04-01T19:56:57.694 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.694 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95486733:::benchmark_data_smithi188_161190_object130793:head# 2024-04-01T19:56:57.694 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.694 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:954970d7:::benchmark_data_smithi188_161190_object96061:head# 2024-04-01T19:56:57.694 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.694 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9549a587:::benchmark_data_smithi188_161190_object105538:head# 2024-04-01T19:56:57.694 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.694 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:954a9efa:::benchmark_data_smithi188_161190_object122994:head# 2024-04-01T19:56:57.694 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.695 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:954aa329:::benchmark_data_smithi188_161190_object118923:head# 2024-04-01T19:56:57.695 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.695 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:954abbba:::benchmark_data_smithi188_161190_object106304:head# 2024-04-01T19:56:57.695 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.695 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:954af765:::benchmark_data_smithi188_161190_object135004:head# 2024-04-01T19:56:57.695 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.695 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:954b14ab:::benchmark_data_smithi188_161190_object47773:head# 2024-04-01T19:56:57.695 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.697 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:954b6b85:::benchmark_data_smithi188_161190_object50805:head# 2024-04-01T19:56:57.697 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.698 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:954bb8bb:::benchmark_data_smithi188_161190_object42861:head# 2024-04-01T19:56:57.699 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.699 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:954c193f:::benchmark_data_smithi188_161190_object97405:head# 2024-04-01T19:56:57.699 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.699 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:954c4ade:::benchmark_data_smithi188_161190_object101736:head# 2024-04-01T19:56:57.699 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.699 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:954e9381:::benchmark_data_smithi188_161190_object113571:head# 2024-04-01T19:56:57.699 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.700 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:954eba45:::benchmark_data_smithi188_161190_object54722:head# 2024-04-01T19:56:57.700 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.700 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:954edb3e:::benchmark_data_smithi188_161190_object48369:head# 2024-04-01T19:56:57.700 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.700 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9550c2cf:::benchmark_data_smithi188_161190_object65464:head# 2024-04-01T19:56:57.700 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.701 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9551990b:::benchmark_data_smithi188_161190_object94729:head# 2024-04-01T19:56:57.701 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.701 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9551d2d0:::benchmark_data_smithi188_161190_object23255:head# 2024-04-01T19:56:57.701 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.701 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:955222d0:::benchmark_data_smithi188_161190_object39209:head# 2024-04-01T19:56:57.701 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.701 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:955303c9:::benchmark_data_smithi188_161190_object66354:head# 2024-04-01T19:56:57.702 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.702 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95538d7f:::benchmark_data_smithi188_161190_object98924:head# 2024-04-01T19:56:57.702 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.702 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9553aef9:::benchmark_data_smithi188_161190_object52384:head# 2024-04-01T19:56:57.702 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.703 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9553ca7d:::benchmark_data_smithi188_161190_object74545:head# 2024-04-01T19:56:57.703 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.703 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95545346:::benchmark_data_smithi188_161190_object63812:head# 2024-04-01T19:56:57.703 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.703 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9554d77c:::benchmark_data_smithi188_161190_object63608:head# 2024-04-01T19:56:57.703 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.706 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:57 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:56:57.706 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:57 smithi062 ceph-mon[44211]: from='client.37229 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:56:57.706 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:57 smithi062 ceph-mon[44211]: osdmap e693: 12 total, 11 up, 10 in 2024-04-01T19:56:57.706 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:57 smithi062 ceph-mon[44211]: pgmap v1896: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.1 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 0 B/s wr, 732 op/s; 31028/199486 objects degraded (15.554%); 15 MiB/s, 240 objects/s recovering 2024-04-01T19:56:57.708 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9554e086:::benchmark_data_smithi188_161190_object60154:head# 2024-04-01T19:56:57.708 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.709 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95552094:::benchmark_data_smithi188_161190_object101053:head# 2024-04-01T19:56:57.709 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.709 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95557e1a:::benchmark_data_smithi188_161190_object39232:head# 2024-04-01T19:56:57.709 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.710 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9555b819:::benchmark_data_smithi188_161190_object72679:head# 2024-04-01T19:56:57.710 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.710 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9555f12b:::benchmark_data_smithi188_161190_object90186:head# 2024-04-01T19:56:57.710 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.724 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95562bb3:::benchmark_data_smithi188_161190_object63937:head# 2024-04-01T19:56:57.724 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.725 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95564dcd:::benchmark_data_smithi188_161190_object117699:head# 2024-04-01T19:56:57.725 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.731 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9557ac73:::benchmark_data_smithi188_161190_object135117:head# 2024-04-01T19:56:57.731 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.731 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9557f07e:::benchmark_data_smithi188_161190_object77627:head# 2024-04-01T19:56:57.731 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.731 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9558c286:::benchmark_data_smithi188_161190_object70560:head# 2024-04-01T19:56:57.732 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.732 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9559414b:::benchmark_data_smithi188_161190_object72516:head# 2024-04-01T19:56:57.732 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.732 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95599eb6:::benchmark_data_smithi188_161190_object55295:head# 2024-04-01T19:56:57.732 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.732 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:955bcf9e:::benchmark_data_smithi188_161190_object95120:head# 2024-04-01T19:56:57.732 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.732 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:955d50d0:::benchmark_data_smithi188_161190_object126120:head# 2024-04-01T19:56:57.732 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.732 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:955d5588:::benchmark_data_smithi188_161190_object114526:head# 2024-04-01T19:56:57.732 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.732 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:955edb67:::benchmark_data_smithi188_161190_object133322:head# 2024-04-01T19:56:57.732 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.733 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:955ef7c4:::benchmark_data_smithi188_161190_object23478:head# 2024-04-01T19:56:57.733 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.733 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:955f21ac:::benchmark_data_smithi188_161190_object50305:head# 2024-04-01T19:56:57.733 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.733 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:955f465f:::benchmark_data_smithi188_161190_object54020:head# 2024-04-01T19:56:57.733 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.733 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:955ffe27:::benchmark_data_smithi188_161190_object40004:head# 2024-04-01T19:56:57.733 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.733 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95600f0b:::benchmark_data_smithi188_161190_object80509:head# 2024-04-01T19:56:57.733 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.733 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9560e8de:::benchmark_data_smithi188_161190_object123543:head# 2024-04-01T19:56:57.733 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.733 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:956149ac:::benchmark_data_smithi188_161190_object33691:head# 2024-04-01T19:56:57.733 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.734 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9562a447:::benchmark_data_smithi188_161190_object59608:head# 2024-04-01T19:56:57.734 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.734 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9562c78d:::benchmark_data_smithi188_161190_object80120:head# 2024-04-01T19:56:57.734 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.734 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95635fc9:::benchmark_data_smithi188_161190_object54052:head# 2024-04-01T19:56:57.734 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.734 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:956378c6:::benchmark_data_smithi188_161190_object61407:head# 2024-04-01T19:56:57.734 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.734 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9563b52c:::benchmark_data_smithi188_161190_object54316:head# 2024-04-01T19:56:57.734 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.734 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9564a236:::benchmark_data_smithi188_161190_object125695:head# 2024-04-01T19:56:57.734 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.736 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9564e2ee:::benchmark_data_smithi188_161190_object121071:head# 2024-04-01T19:56:57.736 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.736 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9565be3a:::benchmark_data_smithi188_161190_object122092:head# 2024-04-01T19:56:57.736 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.736 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95665b7c:::benchmark_data_smithi188_161190_object44889:head# 2024-04-01T19:56:57.736 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.736 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95666d5f:::benchmark_data_smithi188_161190_object133763:head# 2024-04-01T19:56:57.736 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9566a50f:::benchmark_data_smithi188_161190_object55075:head# 2024-04-01T19:56:57.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9566ae20:::benchmark_data_smithi188_161190_object56800:head# 2024-04-01T19:56:57.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9567d2a4:::benchmark_data_smithi188_161190_object35798:head# 2024-04-01T19:56:57.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95683845:::benchmark_data_smithi188_161190_object76477:head# 2024-04-01T19:56:57.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95692f34:::benchmark_data_smithi188_161190_object136623:head# 2024-04-01T19:56:57.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:956a1d55:::benchmark_data_smithi188_161190_object93249:head# 2024-04-01T19:56:57.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:956b45f0:::benchmark_data_smithi188_161190_object41604:head# 2024-04-01T19:56:57.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.738 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:956b9ba5:::benchmark_data_smithi188_161190_object86469:head# 2024-04-01T19:56:57.738 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.738 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:956c449a:::benchmark_data_smithi188_161190_object107457:head# 2024-04-01T19:56:57.738 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.741 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:956db4a9:::benchmark_data_smithi188_161190_object124531:head# 2024-04-01T19:56:57.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:956e30ff:::benchmark_data_smithi188_161190_object103456:head# 2024-04-01T19:56:57.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:956e4bdb:::benchmark_data_smithi188_161190_object48951:head# 2024-04-01T19:56:57.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:956e55fa:::benchmark_data_smithi188_161190_object73070:head# 2024-04-01T19:56:57.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:956e841d:::benchmark_data_smithi188_161190_object103025:head# 2024-04-01T19:56:57.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:956f3a04:::benchmark_data_smithi188_161190_object32915:head# 2024-04-01T19:56:57.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95700859:::benchmark_data_smithi188_161190_object123481:head# 2024-04-01T19:56:57.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.743 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95706f9d:::benchmark_data_smithi188_161190_object72193:head# 2024-04-01T19:56:57.743 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.743 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9570e9a0:::benchmark_data_smithi188_161190_object77203:head# 2024-04-01T19:56:57.743 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.743 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:957174ce:::benchmark_data_smithi188_161190_object75523:head# 2024-04-01T19:56:57.743 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.743 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95724811:::benchmark_data_smithi188_161190_object87840:head# 2024-04-01T19:56:57.743 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.743 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95724ee5:::benchmark_data_smithi188_161190_object90651:head# 2024-04-01T19:56:57.743 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.743 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9572c22c:::benchmark_data_smithi188_161190_object121440:head# 2024-04-01T19:56:57.743 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.743 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95730d18:::benchmark_data_smithi188_161190_object24662:head# 2024-04-01T19:56:57.743 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.744 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9573a7a5:::benchmark_data_smithi188_161190_object131997:head# 2024-04-01T19:56:57.744 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.744 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9574700a:::benchmark_data_smithi188_161190_object120414:head# 2024-04-01T19:56:57.744 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.744 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9574896d:::benchmark_data_smithi188_161190_object62808:head# 2024-04-01T19:56:57.744 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.744 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9574c863:::benchmark_data_smithi188_161190_object41591:head# 2024-04-01T19:56:57.744 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.746 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9575134f:::benchmark_data_smithi188_161190_object117379:head# 2024-04-01T19:56:57.746 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.746 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95754d05:::benchmark_data_smithi188_161190_object137805:head# 2024-04-01T19:56:57.746 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.746 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:957570ba:::benchmark_data_smithi188_161190_object63326:head# 2024-04-01T19:56:57.746 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.746 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9575e451:::benchmark_data_smithi188_161190_object74352:head# 2024-04-01T19:56:57.746 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.746 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95761f9f:::benchmark_data_smithi188_161190_object131084:head# 2024-04-01T19:56:57.746 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.746 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9576e9aa:::benchmark_data_smithi188_161190_object38546:head# 2024-04-01T19:56:57.747 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.747 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9576ec0b:::benchmark_data_smithi188_161190_object97482:head# 2024-04-01T19:56:57.747 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.747 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:957746df:::benchmark_data_smithi188_161190_object98513:head# 2024-04-01T19:56:57.747 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.747 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95776385:::benchmark_data_smithi188_161190_object137034:head# 2024-04-01T19:56:57.747 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.747 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9577a62f:::benchmark_data_smithi188_161190_object115953:head# 2024-04-01T19:56:57.747 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.748 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9577b61c:::benchmark_data_smithi188_161190_object40019:head# 2024-04-01T19:56:57.748 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.748 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95781885:::benchmark_data_smithi188_161190_object36083:head# 2024-04-01T19:56:57.748 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.748 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95788f01:::benchmark_data_smithi188_161190_object59393:head# 2024-04-01T19:56:57.748 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.748 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9578922c:::benchmark_data_smithi188_161190_object120440:head# 2024-04-01T19:56:57.748 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.749 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9579e42c:::benchmark_data_smithi188_161190_object35384:head# 2024-04-01T19:56:57.749 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.749 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:957a44bd:::benchmark_data_smithi188_161190_object68530:head# 2024-04-01T19:56:57.749 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.754 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:957ab4ba:::benchmark_data_smithi188_161190_object132497:head# 2024-04-01T19:56:57.754 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.754 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:957ac752:::benchmark_data_smithi188_161190_object33217:head# 2024-04-01T19:56:57.754 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.755 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:957b3dd8:::benchmark_data_smithi188_161190_object98185:head# 2024-04-01T19:56:57.755 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.755 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:957ced6e:::benchmark_data_smithi188_161190_object138578:head# 2024-04-01T19:56:57.755 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.755 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:957d24ea:::benchmark_data_smithi188_161190_object73713:head# 2024-04-01T19:56:57.755 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.756 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:957d8214:::benchmark_data_smithi188_161190_object106362:head# 2024-04-01T19:56:57.756 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.756 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:957dac8f:::benchmark_data_smithi188_161190_object99211:head# 2024-04-01T19:56:57.756 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.756 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:957e029e:::benchmark_data_smithi188_161190_object82010:head# 2024-04-01T19:56:57.756 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.756 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:957e97d1:::benchmark_data_smithi188_161190_object96074:head# 2024-04-01T19:56:57.757 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.757 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:957ef5a5:::benchmark_data_smithi188_161190_object64319:head# 2024-04-01T19:56:57.757 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.757 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:957f60cc:::benchmark_data_smithi188_161190_object126758:head# 2024-04-01T19:56:57.757 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.758 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95808f24:::benchmark_data_smithi188_161190_object98829:head# 2024-04-01T19:56:57.758 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.758 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9580c46c:::benchmark_data_smithi188_161190_object66329:head# 2024-04-01T19:56:57.758 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.758 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:958140e5:::benchmark_data_smithi188_161190_object63203:head# 2024-04-01T19:56:57.758 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.758 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95817d88:::benchmark_data_smithi188_161190_object109555:head# 2024-04-01T19:56:57.758 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.759 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:958223c3:::benchmark_data_smithi188_161190_object52612:head# 2024-04-01T19:56:57.759 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.759 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9582b680:::benchmark_data_smithi188_161190_object56175:head# 2024-04-01T19:56:57.759 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.759 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95832f91:::benchmark_data_smithi188_161190_object69259:head# 2024-04-01T19:56:57.759 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.759 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9584c3c6:::benchmark_data_smithi188_161190_object124594:head# 2024-04-01T19:56:57.760 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.760 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:958547ca:::benchmark_data_smithi188_161190_object70665:head# 2024-04-01T19:56:57.760 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.760 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95859a19:::benchmark_data_smithi188_161190_object48045:head# 2024-04-01T19:56:57.760 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.760 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95859e0a:::benchmark_data_smithi188_161190_object40723:head# 2024-04-01T19:56:57.761 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.761 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95869dc3:::benchmark_data_smithi188_161190_object34289:head# 2024-04-01T19:56:57.761 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.770 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9586c981:::benchmark_data_smithi188_161190_object112425:head# 2024-04-01T19:56:57.770 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.775 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95885bcb:::benchmark_data_smithi188_161190_object110072:head# 2024-04-01T19:56:57.775 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.775 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95895b50:::benchmark_data_smithi188_161190_object39746:head# 2024-04-01T19:56:57.775 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.775 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95896856:::benchmark_data_smithi188_161190_object124399:head# 2024-04-01T19:56:57.775 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.775 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:958a8189:::benchmark_data_smithi188_161190_object62741:head# 2024-04-01T19:56:57.775 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.775 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:958ad7f4:::benchmark_data_smithi188_161190_object84746:head# 2024-04-01T19:56:57.775 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.775 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:958ad936:::benchmark_data_smithi188_161190_object50772:head# 2024-04-01T19:56:57.776 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.776 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:958b7384:::benchmark_data_smithi188_161190_object123741:head# 2024-04-01T19:56:57.776 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.776 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:958bb2dc:::benchmark_data_smithi188_161190_object131901:head# 2024-04-01T19:56:57.776 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.776 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:958bd255:::benchmark_data_smithi188_161190_object39744:head# 2024-04-01T19:56:57.776 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.776 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:958bf298:::benchmark_data_smithi188_161190_object23598:head# 2024-04-01T19:56:57.776 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.776 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:958c4c03:::benchmark_data_smithi188_161190_object139160:head# 2024-04-01T19:56:57.776 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.776 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:958c751e:::benchmark_data_smithi188_161190_object125975:head# 2024-04-01T19:56:57.776 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.777 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:958c946c:::benchmark_data_smithi188_161190_object54097:head# 2024-04-01T19:56:57.777 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.777 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:958d7f73:::benchmark_data_smithi188_161190_object104753:head# 2024-04-01T19:56:57.777 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.777 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:958d9639:::benchmark_data_smithi188_161190_object96593:head# 2024-04-01T19:56:57.777 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.777 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:958da3c3:::benchmark_data_smithi188_161190_object120480:head# 2024-04-01T19:56:57.777 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.777 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:958dff12:::benchmark_data_smithi188_161190_object88453:head# 2024-04-01T19:56:57.777 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.777 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:958eaf9a:::benchmark_data_smithi188_161190_object99927:head# 2024-04-01T19:56:57.777 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.777 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:958f9989:::benchmark_data_smithi188_161190_object103618:head# 2024-04-01T19:56:57.777 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95900771:::benchmark_data_smithi188_161190_object76127:head# 2024-04-01T19:56:57.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:959009e8:::benchmark_data_smithi188_161190_object104128:head# 2024-04-01T19:56:57.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95916230:::benchmark_data_smithi188_161190_object112862:head# 2024-04-01T19:56:57.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95919c84:::benchmark_data_smithi188_161190_object128331:head# 2024-04-01T19:56:57.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9591b43f:::benchmark_data_smithi188_161190_object85081:head# 2024-04-01T19:56:57.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9591d7a9:::benchmark_data_smithi188_161190_object99045:head# 2024-04-01T19:56:57.781 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.781 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9591eb8b:::benchmark_data_smithi188_161190_object58654:head# 2024-04-01T19:56:57.781 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.781 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95924a73:::benchmark_data_smithi188_161190_object81981:head# 2024-04-01T19:56:57.781 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.781 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95957817:::benchmark_data_smithi188_161190_object42791:head# 2024-04-01T19:56:57.781 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.781 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9596eacf:::benchmark_data_smithi188_161190_object45448:head# 2024-04-01T19:56:57.781 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.781 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95976857:::benchmark_data_smithi188_161190_object86614:head# 2024-04-01T19:56:57.781 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.781 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9598238e:::benchmark_data_smithi188_161190_object89081:head# 2024-04-01T19:56:57.781 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.781 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95999710:::benchmark_data_smithi188_161190_object111632:head# 2024-04-01T19:56:57.782 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.782 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9599e658:::benchmark_data_smithi188_161190_object62986:head# 2024-04-01T19:56:57.782 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.783 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9599fba1:::benchmark_data_smithi188_161190_object95828:head# 2024-04-01T19:56:57.783 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.783 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:959a3af3:::benchmark_data_smithi188_161190_object22197:head# 2024-04-01T19:56:57.783 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.784 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:959a5a5a:::benchmark_data_smithi188_161190_object53725:head# 2024-04-01T19:56:57.784 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.784 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:959a5cae:::benchmark_data_smithi188_161190_object111217:head# 2024-04-01T19:56:57.784 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.784 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:959a6eab:::benchmark_data_smithi188_161190_object56315:head# 2024-04-01T19:56:57.784 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.785 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:959b0c9c:::benchmark_data_smithi188_161190_object34097:head# 2024-04-01T19:56:57.785 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.785 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:959ce916:::benchmark_data_smithi188_161190_object110896:head# 2024-04-01T19:56:57.786 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.786 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:959d7f2e:::benchmark_data_smithi188_161190_object21945:head# 2024-04-01T19:56:57.786 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.786 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:959dc96f:::benchmark_data_smithi188_161190_object19886:head# 2024-04-01T19:56:57.786 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.788 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:959e5631:::benchmark_data_smithi188_161190_object91854:head# 2024-04-01T19:56:57.789 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.789 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:959f3044:::benchmark_data_smithi188_161190_object77908:head# 2024-04-01T19:56:57.789 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.789 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95a0d0ab:::benchmark_data_smithi188_161190_object98541:head# 2024-04-01T19:56:57.789 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.789 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95a1939f:::benchmark_data_smithi188_161190_object105868:head# 2024-04-01T19:56:57.789 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.789 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95a30b24:::benchmark_data_smithi188_161190_object139179:head# 2024-04-01T19:56:57.789 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.800 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95a36c95:::benchmark_data_smithi188_161190_object85627:head# 2024-04-01T19:56:57.801 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.801 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95a374fd:::benchmark_data_smithi188_161190_object137412:head# 2024-04-01T19:56:57.801 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.801 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95a4b6c9:::benchmark_data_smithi188_161190_object81806:head# 2024-04-01T19:56:57.801 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.801 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95a51f07:::benchmark_data_smithi188_161190_object119045:head# 2024-04-01T19:56:57.801 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.801 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95a59e51:::benchmark_data_smithi188_161190_object39275:head# 2024-04-01T19:56:57.801 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.801 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95a5b330:::benchmark_data_smithi188_161190_object55505:head# 2024-04-01T19:56:57.801 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.801 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95a60011:::benchmark_data_smithi188_161190_object124390:head# 2024-04-01T19:56:57.801 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.801 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95a626c3:::benchmark_data_smithi188_161190_object56299:head# 2024-04-01T19:56:57.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.802 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95a7bf99:::benchmark_data_smithi188_161190_object102372:head# 2024-04-01T19:56:57.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.802 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95a7c9e7:::benchmark_data_smithi188_161190_object78567:head# 2024-04-01T19:56:57.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.802 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95a8ce6a:::benchmark_data_smithi188_161190_object102400:head# 2024-04-01T19:56:57.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.802 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95a8d975:::benchmark_data_smithi188_161190_object39376:head# 2024-04-01T19:56:57.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.802 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95a9376a:::benchmark_data_smithi188_161190_object45887:head# 2024-04-01T19:56:57.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.802 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95a93e39:::benchmark_data_smithi188_161190_object82575:head# 2024-04-01T19:56:57.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.803 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95a94cf6:::benchmark_data_smithi188_161190_object106843:head# 2024-04-01T19:56:57.803 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.804 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95aaa37c:::benchmark_data_smithi188_161190_object130346:head# 2024-04-01T19:56:57.804 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.804 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95ab3f58:::benchmark_data_smithi188_161190_object32398:head# 2024-04-01T19:56:57.804 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.804 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95ab7972:::benchmark_data_smithi188_161190_object63757:head# 2024-04-01T19:56:57.804 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.805 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95ac18fe:::benchmark_data_smithi188_161190_object78827:head# 2024-04-01T19:56:57.805 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.805 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95ac4113:::benchmark_data_smithi188_161190_object107987:head# 2024-04-01T19:56:57.805 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.805 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95ace903:::benchmark_data_smithi188_161190_object125147:head# 2024-04-01T19:56:57.805 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.805 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95ad497f:::benchmark_data_smithi188_161190_object116664:head# 2024-04-01T19:56:57.805 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.805 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95adbfc3:::benchmark_data_smithi188_161190_object98249:head# 2024-04-01T19:56:57.805 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.805 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95ae0951:::benchmark_data_smithi188_161190_object67656:head# 2024-04-01T19:56:57.805 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.805 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95ae5bf0:::benchmark_data_smithi188_161190_object45867:head# 2024-04-01T19:56:57.805 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.805 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95afabd4:::benchmark_data_smithi188_161190_object131113:head# 2024-04-01T19:56:57.806 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.806 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95b04ca7:::benchmark_data_smithi188_161190_object112645:head# 2024-04-01T19:56:57.806 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.809 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95b0b638:::benchmark_data_smithi188_161190_object127218:head# 2024-04-01T19:56:57.810 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.810 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95b16144:::benchmark_data_smithi188_161190_object24172:head# 2024-04-01T19:56:57.810 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.810 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95b166ac:::benchmark_data_smithi188_161190_object81650:head# 2024-04-01T19:56:57.810 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.810 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95b33af4:::benchmark_data_smithi188_161190_object93700:head# 2024-04-01T19:56:57.810 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.810 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95b38664:::benchmark_data_smithi188_161190_object56019:head# 2024-04-01T19:56:57.810 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.810 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95b38fc8:::benchmark_data_smithi188_161190_object137721:head# 2024-04-01T19:56:57.810 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.810 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95b45f2e:::benchmark_data_smithi188_161190_object94740:head# 2024-04-01T19:56:57.810 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.813 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95b512a4:::benchmark_data_smithi188_161190_object24853:head# 2024-04-01T19:56:57.813 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.814 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95b6bb6f:::benchmark_data_smithi188_161190_object134761:head# 2024-04-01T19:56:57.814 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.820 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95b6f921:::benchmark_data_smithi188_161190_object119046:head# 2024-04-01T19:56:57.820 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.821 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95b74129:::benchmark_data_smithi188_161190_object112210:head# 2024-04-01T19:56:57.821 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.821 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95b95bf0:::benchmark_data_smithi188_161190_object109381:head# 2024-04-01T19:56:57.821 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.823 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95ba6f37:::benchmark_data_smithi188_161190_object101603:head# 2024-04-01T19:56:57.823 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.823 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95bbd995:::benchmark_data_smithi188_161190_object131686:head# 2024-04-01T19:56:57.823 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.823 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95bbeea6:::benchmark_data_smithi188_161190_object21753:head# 2024-04-01T19:56:57.823 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.823 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95bc6d7f:::benchmark_data_smithi188_161190_object61138:head# 2024-04-01T19:56:57.823 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.823 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95bd2cca:::benchmark_data_smithi188_161190_object110156:head# 2024-04-01T19:56:57.823 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.824 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95bd3044:::benchmark_data_smithi188_161190_object87475:head# 2024-04-01T19:56:57.824 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.828 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95be00ba:::benchmark_data_smithi188_161190_object76583:head# 2024-04-01T19:56:57.828 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.829 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95bf269a:::benchmark_data_smithi188_161190_object27705:head# 2024-04-01T19:56:57.829 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95bf4418:::benchmark_data_smithi188_161190_object76527:head# 2024-04-01T19:56:57.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.832 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95bfc2d0:::benchmark_data_smithi188_161190_object131871:head# 2024-04-01T19:56:57.833 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.833 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95bfce49:::benchmark_data_smithi188_161190_object29823:head# 2024-04-01T19:56:57.833 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.833 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95bfde6d:::benchmark_data_smithi188_161190_object44566:head# 2024-04-01T19:56:57.833 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.840 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95bff887:::benchmark_data_smithi188_161190_object131306:head# 2024-04-01T19:56:57.840 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.843 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95c027e8:::benchmark_data_smithi188_161190_object123139:head# 2024-04-01T19:56:57.844 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.844 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95c05747:::benchmark_data_smithi188_161190_object26413:head# 2024-04-01T19:56:57.844 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.845 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95c1e8a1:::benchmark_data_smithi188_161190_object110425:head# 2024-04-01T19:56:57.845 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.845 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95c1fd3f:::benchmark_data_smithi188_161190_object89796:head# 2024-04-01T19:56:57.846 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.846 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95c2de4e:::benchmark_data_smithi188_161190_object85955:head# 2024-04-01T19:56:57.846 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.846 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95c383c4:::benchmark_data_smithi188_161190_object69766:head# 2024-04-01T19:56:57.846 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.846 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95c3919d:::benchmark_data_smithi188_161190_object80576:head# 2024-04-01T19:56:57.846 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.849 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95c3ee4a:::benchmark_data_smithi188_161190_object30119:head# 2024-04-01T19:56:57.849 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.849 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95c4100b:::benchmark_data_smithi188_161190_object29260:head# 2024-04-01T19:56:57.849 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.849 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95c4323d:::benchmark_data_smithi188_161190_object132438:head# 2024-04-01T19:56:57.849 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.849 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95c432b5:::benchmark_data_smithi188_161190_object129204:head# 2024-04-01T19:56:57.849 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.849 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95c69a1d:::benchmark_data_smithi188_161190_object92139:head# 2024-04-01T19:56:57.849 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.849 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95c6d066:::benchmark_data_smithi188_161190_object24626:head# 2024-04-01T19:56:57.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95c6dc13:::benchmark_data_smithi188_161190_object32738:head# 2024-04-01T19:56:57.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95c80462:::benchmark_data_smithi188_161190_object57840:head# 2024-04-01T19:56:57.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95c81a73:::benchmark_data_smithi188_161190_object131356:head# 2024-04-01T19:56:57.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95c9418d:::benchmark_data_smithi188_161190_object78069:head# 2024-04-01T19:56:57.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95ca2603:::benchmark_data_smithi188_161190_object41159:head# 2024-04-01T19:56:57.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95cb2cdf:::benchmark_data_smithi188_161190_object61932:head# 2024-04-01T19:56:57.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.851 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95cb5081:::benchmark_data_smithi188_161190_object77257:head# 2024-04-01T19:56:57.851 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.851 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95cbaa18:::benchmark_data_smithi188_161190_object130777:head# 2024-04-01T19:56:57.851 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.851 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95cc38bc:::benchmark_data_smithi188_161190_object28254:head# 2024-04-01T19:56:57.851 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.852 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95ccac5e:::benchmark_data_smithi188_161190_object58211:head# 2024-04-01T19:56:57.852 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.852 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95cdaed2:::benchmark_data_smithi188_161190_object53042:head# 2024-04-01T19:56:57.852 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.853 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95cddb2f:::benchmark_data_smithi188_161190_object113820:head# 2024-04-01T19:56:57.853 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.853 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95ce39b5:::benchmark_data_smithi188_161190_object29113:head# 2024-04-01T19:56:57.853 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.853 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95cfd9f8:::benchmark_data_smithi188_161190_object116366:head# 2024-04-01T19:56:57.853 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.853 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95d066b7:::benchmark_data_smithi188_161190_object57643:head# 2024-04-01T19:56:57.853 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95d07484:::benchmark_data_smithi188_161190_object118827:head# 2024-04-01T19:56:57.855 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95d0ebfe:::benchmark_data_smithi188_161190_object68914:head# 2024-04-01T19:56:57.855 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95d0fe12:::benchmark_data_smithi188_161190_object25345:head# 2024-04-01T19:56:57.855 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.855 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95d260a9:::benchmark_data_smithi188_161190_object37779:head# 2024-04-01T19:56:57.856 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.856 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95d26b4b:::benchmark_data_smithi188_161190_object115978:head# 2024-04-01T19:56:57.856 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.856 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95d31597:::benchmark_data_smithi188_161190_object53684:head# 2024-04-01T19:56:57.856 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.856 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95d33a28:::benchmark_data_smithi188_161190_object80857:head# 2024-04-01T19:56:57.856 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.856 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95d35372:::benchmark_data_smithi188_161190_object71284:head# 2024-04-01T19:56:57.856 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.857 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95d48d1c:::benchmark_data_smithi188_161190_object123339:head# 2024-04-01T19:56:57.857 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.857 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95d4bd01:::benchmark_data_smithi188_161190_object115366:head# 2024-04-01T19:56:57.857 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.858 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95d58dce:::benchmark_data_smithi188_161190_object86319:head# 2024-04-01T19:56:57.858 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.858 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95d5e400:::benchmark_data_smithi188_161190_object26506:head# 2024-04-01T19:56:57.858 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.858 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95d691ce:::benchmark_data_smithi188_161190_object34142:head# 2024-04-01T19:56:57.858 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.858 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95d86e5c:::benchmark_data_smithi188_161190_object44655:head# 2024-04-01T19:56:57.858 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.858 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95d87141:::benchmark_data_smithi188_161190_object94146:head# 2024-04-01T19:56:57.858 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.859 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95d92837:::benchmark_data_smithi188_161190_object131930:head# 2024-04-01T19:56:57.859 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.860 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95db62b2:::benchmark_data_smithi188_161190_object56993:head# 2024-04-01T19:56:57.860 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.860 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95db6ce5:::benchmark_data_smithi188_161190_object56833:head# 2024-04-01T19:56:57.860 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.860 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95db7812:::benchmark_data_smithi188_161190_object123647:head# 2024-04-01T19:56:57.860 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.860 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95dbf817:::benchmark_data_smithi188_161190_object64036:head# 2024-04-01T19:56:57.860 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.860 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95dc13cd:::benchmark_data_smithi188_161190_object34188:head# 2024-04-01T19:56:57.860 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.860 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95dc66c2:::benchmark_data_smithi188_161190_object43258:head# 2024-04-01T19:56:57.860 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.860 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95ddd1ca:::benchmark_data_smithi188_161190_object69406:head# 2024-04-01T19:56:57.861 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.861 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95de1f1a:::benchmark_data_smithi188_161190_object105166:head# 2024-04-01T19:56:57.861 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.863 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95de2c8d:::benchmark_data_smithi188_161190_object59815:head# 2024-04-01T19:56:57.863 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.863 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95de6ffa:::benchmark_data_smithi188_161190_object131520:head# 2024-04-01T19:56:57.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95df2163:::benchmark_data_smithi188_161190_object115433:head# 2024-04-01T19:56:57.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95df5dde:::benchmark_data_smithi188_161190_object94745:head# 2024-04-01T19:56:57.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95df8776:::benchmark_data_smithi188_161190_object89388:head# 2024-04-01T19:56:57.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95df8f68:::benchmark_data_smithi188_161190_object78876:head# 2024-04-01T19:56:57.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95dfd7e1:::benchmark_data_smithi188_161190_object33996:head# 2024-04-01T19:56:57.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95e08509:::benchmark_data_smithi188_161190_object68884:head# 2024-04-01T19:56:57.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95e10887:::benchmark_data_smithi188_161190_object29692:head# 2024-04-01T19:56:57.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.865 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95e370e8:::benchmark_data_smithi188_161190_object28307:head# 2024-04-01T19:56:57.865 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.865 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95e3baf8:::benchmark_data_smithi188_161190_object90372:head# 2024-04-01T19:56:57.865 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.865 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95e4d672:::benchmark_data_smithi188_161190_object77672:head# 2024-04-01T19:56:57.865 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.865 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95e5ed15:::benchmark_data_smithi188_161190_object125480:head# 2024-04-01T19:56:57.865 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.865 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95e68e39:::benchmark_data_smithi188_161190_object72340:head# 2024-04-01T19:56:57.865 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.868 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95e7546e:::benchmark_data_smithi188_161190_object25543:head# 2024-04-01T19:56:57.868 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.868 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95e77d8c:::benchmark_data_smithi188_161190_object114146:head# 2024-04-01T19:56:57.868 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.868 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95e7cb3f:::benchmark_data_smithi188_161190_object47312:head# 2024-04-01T19:56:57.868 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.868 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95e8c047:::benchmark_data_smithi188_161190_object72529:head# 2024-04-01T19:56:57.868 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.868 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95e91439:::benchmark_data_smithi188_161190_object47148:head# 2024-04-01T19:56:57.868 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.868 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95eac433:::benchmark_data_smithi188_161190_object19755:head# 2024-04-01T19:56:57.868 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95eac54f:::benchmark_data_smithi188_161190_object80855:head# 2024-04-01T19:56:57.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95eb6a57:::benchmark_data_smithi188_161190_object103132:head# 2024-04-01T19:56:57.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95ec63ca:::benchmark_data_smithi188_161190_object134621:head# 2024-04-01T19:56:57.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95ec8014:::benchmark_data_smithi188_161190_object138534:head# 2024-04-01T19:56:57.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95ec8ce5:::benchmark_data_smithi188_161190_object28561:head# 2024-04-01T19:56:57.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95eca767:::benchmark_data_smithi188_161190_object35071:head# 2024-04-01T19:56:57.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95edd6f2:::benchmark_data_smithi188_161190_object119721:head# 2024-04-01T19:56:57.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95ef098b:::benchmark_data_smithi188_161190_object20637:head# 2024-04-01T19:56:57.870 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.872 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95f283ea:::benchmark_data_smithi188_161190_object41990:head# 2024-04-01T19:56:57.872 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.872 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95f291e0:::benchmark_data_smithi188_161190_object74426:head# 2024-04-01T19:56:57.872 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.872 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95f2ea7f:::benchmark_data_smithi188_161190_object57244:head# 2024-04-01T19:56:57.872 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.872 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95f3ba2b:::benchmark_data_smithi188_161190_object54685:head# 2024-04-01T19:56:57.872 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.872 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95f417f2:::benchmark_data_smithi188_161190_object87519:head# 2024-04-01T19:56:57.872 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.872 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95f50f39:::benchmark_data_smithi188_161190_object100742:head# 2024-04-01T19:56:57.872 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.872 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95f51c3d:::benchmark_data_smithi188_161190_object24333:head# 2024-04-01T19:56:57.873 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.873 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95f53acb:::benchmark_data_smithi188_161190_object95004:head# 2024-04-01T19:56:57.873 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.873 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95f5b13a:::benchmark_data_smithi188_161190_object84935:head# 2024-04-01T19:56:57.873 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.873 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95f5f7c2:::benchmark_data_smithi188_161190_object82073:head# 2024-04-01T19:56:57.873 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.873 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95f63296:::benchmark_data_smithi188_161190_object120609:head# 2024-04-01T19:56:57.873 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.873 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95f691e0:::benchmark_data_smithi188_161190_object40443:head# 2024-04-01T19:56:57.873 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.873 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95f7019e:::benchmark_data_smithi188_161190_object47626:head# 2024-04-01T19:56:57.874 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:57 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:56:57.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:57 smithi188 ceph-mon[43939]: from='client.37229 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:56:57.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:57 smithi188 ceph-mon[43939]: osdmap e693: 12 total, 11 up, 10 in 2024-04-01T19:56:57.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:57 smithi188 ceph-mon[43939]: pgmap v1896: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.1 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 0 B/s wr, 732 op/s; 31028/199486 objects degraded (15.554%); 15 MiB/s, 240 objects/s recovering 2024-04-01T19:56:57.877 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95f83360:::benchmark_data_smithi188_161190_object126415:head# 2024-04-01T19:56:57.877 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.877 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95f83bab:::benchmark_data_smithi188_161190_object85697:head# 2024-04-01T19:56:57.877 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.877 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95f84808:::benchmark_data_smithi188_161190_object125983:head# 2024-04-01T19:56:57.878 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.878 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95f84926:::benchmark_data_smithi188_161190_object130472:head# 2024-04-01T19:56:57.878 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.878 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95f972c2:::benchmark_data_smithi188_161190_object23488:head# 2024-04-01T19:56:57.878 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.878 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95f9de41:::benchmark_data_smithi188_161190_object80556:head# 2024-04-01T19:56:57.878 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.878 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95faf381:::benchmark_data_smithi188_161190_object53437:head# 2024-04-01T19:56:57.878 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.878 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95fbd77e:::benchmark_data_smithi188_161190_object104030:head# 2024-04-01T19:56:57.878 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95fc1950:::benchmark_data_smithi188_161190_object45077:head# 2024-04-01T19:56:57.881 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.882 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95fc45cb:::benchmark_data_smithi188_161190_object38485:head# 2024-04-01T19:56:57.882 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.882 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95fd3265:::benchmark_data_smithi188_161190_object137460:head# 2024-04-01T19:56:57.882 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.882 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95fdd468:::benchmark_data_smithi188_161190_object133669:head# 2024-04-01T19:56:57.882 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.882 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95fe4125:::benchmark_data_smithi188_161190_object59606:head# 2024-04-01T19:56:57.882 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.882 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:95fe5f91:::benchmark_data_smithi188_161190_object53145:head# 2024-04-01T19:56:57.883 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.885 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9600124d:::benchmark_data_smithi188_161190_object62662:head# 2024-04-01T19:56:57.885 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.885 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:960035fc:::benchmark_data_smithi188_161190_object47411:head# 2024-04-01T19:56:57.885 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.885 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96003c24:::benchmark_data_smithi188_161190_object91210:head# 2024-04-01T19:56:57.885 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.885 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96007241:::benchmark_data_smithi188_161190_object135356:head# 2024-04-01T19:56:57.885 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.885 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:960142ee:::benchmark_data_smithi188_161190_object138763:head# 2024-04-01T19:56:57.885 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.885 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96019d4b:::benchmark_data_smithi188_161190_object90918:head# 2024-04-01T19:56:57.885 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.885 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9601d2ed:::benchmark_data_smithi188_161190_object99643:head# 2024-04-01T19:56:57.886 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.886 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9601d5dd:::benchmark_data_smithi188_161190_object67279:head# 2024-04-01T19:56:57.886 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.886 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96020178:::benchmark_data_smithi188_161190_object60990:head# 2024-04-01T19:56:57.886 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.886 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96027ab7:::benchmark_data_smithi188_161190_object70762:head# 2024-04-01T19:56:57.886 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.889 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9602ba89:::benchmark_data_smithi188_161190_object99602:head# 2024-04-01T19:56:57.889 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.889 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9603cc7b:::benchmark_data_smithi188_161190_object133196:head# 2024-04-01T19:56:57.889 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.889 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9603f54f:::benchmark_data_smithi188_161190_object72133:head# 2024-04-01T19:56:57.889 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.889 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9604cf5d:::benchmark_data_smithi188_161190_object120637:head# 2024-04-01T19:56:57.889 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.889 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:960515ea:::benchmark_data_smithi188_161190_object48033:head# 2024-04-01T19:56:57.889 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.889 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96051a87:::benchmark_data_smithi188_161190_object61896:head# 2024-04-01T19:56:57.889 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.889 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:960533c6:::benchmark_data_smithi188_161190_object47737:head# 2024-04-01T19:56:57.890 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.890 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9605adaa:::benchmark_data_smithi188_161190_object66348:head# 2024-04-01T19:56:57.890 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.890 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9605fdf4:::benchmark_data_smithi188_161190_object24773:head# 2024-04-01T19:56:57.890 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.890 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:960658cc:::benchmark_data_smithi188_161190_object32438:head# 2024-04-01T19:56:57.890 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.890 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96068577:::benchmark_data_smithi188_161190_object135454:head# 2024-04-01T19:56:57.890 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.890 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96071d9a:::benchmark_data_smithi188_161190_object101295:head# 2024-04-01T19:56:57.890 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.890 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96076cc2:::benchmark_data_smithi188_161190_object53537:head# 2024-04-01T19:56:57.891 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.891 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96078340:::benchmark_data_smithi188_161190_object93213:head# 2024-04-01T19:56:57.891 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.891 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9607b524:::benchmark_data_smithi188_161190_object128562:head# 2024-04-01T19:56:57.891 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.891 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9607b585:::benchmark_data_smithi188_161190_object109040:head# 2024-04-01T19:56:57.891 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.891 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9607f533:::benchmark_data_smithi188_161190_object79127:head# 2024-04-01T19:56:57.891 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.894 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96082164:::benchmark_data_smithi188_161190_object28197:head# 2024-04-01T19:56:57.894 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.895 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96096b80:::benchmark_data_smithi188_161190_object57659:head# 2024-04-01T19:56:57.895 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.895 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9609ca0c:::benchmark_data_smithi188_161190_object78297:head# 2024-04-01T19:56:57.895 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.895 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:960a3ea2:::benchmark_data_smithi188_161190_object35412:head# 2024-04-01T19:56:57.895 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.895 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:960ac592:::benchmark_data_smithi188_161190_object83359:head# 2024-04-01T19:56:57.895 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.895 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:960bbff6:::benchmark_data_smithi188_161190_object19928:head# 2024-04-01T19:56:57.895 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.895 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:960c4a78:::benchmark_data_smithi188_161190_object107890:head# 2024-04-01T19:56:57.896 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.896 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:960c95be:::benchmark_data_smithi188_161190_object43571:head# 2024-04-01T19:56:57.896 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.896 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:960ce665:::benchmark_data_smithi188_161190_object63103:head# 2024-04-01T19:56:57.896 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.896 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:960e7a06:::benchmark_data_smithi188_161190_object116916:head# 2024-04-01T19:56:57.896 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.896 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:960f0b8c:::benchmark_data_smithi188_161190_object37017:head# 2024-04-01T19:56:57.896 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.896 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:960feed4:::benchmark_data_smithi188_161190_object54440:head# 2024-04-01T19:56:57.896 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.896 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96108439:::benchmark_data_smithi188_161190_object52736:head# 2024-04-01T19:56:57.896 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.896 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9610cb7c:::benchmark_data_smithi188_161190_object121832:head# 2024-04-01T19:56:57.896 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.897 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96115ba1:::benchmark_data_smithi188_161190_object109629:head# 2024-04-01T19:56:57.897 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.897 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9611ca9f:::benchmark_data_smithi188_161190_object74958:head# 2024-04-01T19:56:57.897 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.897 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9611f719:::benchmark_data_smithi188_161190_object135418:head# 2024-04-01T19:56:57.897 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.897 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9611f98d:::benchmark_data_smithi188_161190_object85515:head# 2024-04-01T19:56:57.897 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.897 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96126e22:::benchmark_data_smithi188_161190_object98309:head# 2024-04-01T19:56:57.897 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.897 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96134382:::benchmark_data_smithi188_161190_object34989:head# 2024-04-01T19:56:57.897 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.897 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9614549c:::benchmark_data_smithi188_161190_object25156:head# 2024-04-01T19:56:57.898 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.900 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96147988:::benchmark_data_smithi188_161190_object100994:head# 2024-04-01T19:56:57.900 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.900 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96149466:::benchmark_data_smithi188_161190_object29807:head# 2024-04-01T19:56:57.900 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.900 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9614d9c8:::benchmark_data_smithi188_161190_object85618:head# 2024-04-01T19:56:57.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9616b423:::benchmark_data_smithi188_161190_object58498:head# 2024-04-01T19:56:57.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9617055b:::benchmark_data_smithi188_161190_object38453:head# 2024-04-01T19:56:57.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96175a24:::benchmark_data_smithi188_161190_object22762:head# 2024-04-01T19:56:57.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96181814:::benchmark_data_smithi188_161190_object87442:head# 2024-04-01T19:56:57.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:961845a9:::benchmark_data_smithi188_161190_object114480:head# 2024-04-01T19:56:57.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9618c69a:::benchmark_data_smithi188_161190_object33056:head# 2024-04-01T19:56:57.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9618fd1b:::benchmark_data_smithi188_161190_object117649:head# 2024-04-01T19:56:57.902 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.902 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9619499a:::benchmark_data_smithi188_161190_object85030:head# 2024-04-01T19:56:57.902 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.902 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:961992ba:::benchmark_data_smithi188_161190_object122641:head# 2024-04-01T19:56:57.902 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.902 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96199515:::benchmark_data_smithi188_161190_object80843:head# 2024-04-01T19:56:57.902 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.902 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9619f44c:::benchmark_data_smithi188_161190_object80995:head# 2024-04-01T19:56:57.902 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.902 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:961add45:::benchmark_data_smithi188_161190_object85461:head# 2024-04-01T19:56:57.903 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.903 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:961bbc1b:::benchmark_data_smithi188_161190_object79633:head# 2024-04-01T19:56:57.903 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.903 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:961cbf23:::benchmark_data_smithi188_161190_object85644:head# 2024-04-01T19:56:57.903 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.910 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:961cc512:::benchmark_data_smithi188_161190_object70976:head# 2024-04-01T19:56:57.910 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.911 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:961cda2c:::benchmark_data_smithi188_161190_object54422:head# 2024-04-01T19:56:57.911 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.912 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:961d80fa:::benchmark_data_smithi188_161190_object37762:head# 2024-04-01T19:56:57.912 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.912 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:961e3ca1:::benchmark_data_smithi188_161190_object137901:head# 2024-04-01T19:56:57.912 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.912 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:961e5dd4:::benchmark_data_smithi188_161190_object23007:head# 2024-04-01T19:56:57.912 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.912 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:961e9832:::benchmark_data_smithi188_161190_object60841:head# 2024-04-01T19:56:57.912 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.913 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:961ee89c:::benchmark_data_smithi188_161190_object99951:head# 2024-04-01T19:56:57.913 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.913 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:961f28a3:::benchmark_data_smithi188_161190_object81744:head# 2024-04-01T19:56:57.913 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.913 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:961f6620:::benchmark_data_smithi188_161190_object71211:head# 2024-04-01T19:56:57.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.914 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:961fd466:::benchmark_data_smithi188_161190_object48245:head# 2024-04-01T19:56:57.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.914 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96201380:::benchmark_data_smithi188_161190_object42503:head# 2024-04-01T19:56:57.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.915 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96207e90:::benchmark_data_smithi188_161190_object61343:head# 2024-04-01T19:56:57.915 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.915 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9620ae0b:::benchmark_data_smithi188_161190_object79061:head# 2024-04-01T19:56:57.915 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.915 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96212a63:::benchmark_data_smithi188_161190_object53172:head# 2024-04-01T19:56:57.915 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.919 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96222ee0:::benchmark_data_smithi188_161190_object116548:head# 2024-04-01T19:56:57.919 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.920 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9622a7d5:::benchmark_data_smithi188_161190_object99042:head# 2024-04-01T19:56:57.920 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.920 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96238a36:::benchmark_data_smithi188_161190_object46168:head# 2024-04-01T19:56:57.920 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.920 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9623bae1:::benchmark_data_smithi188_161190_object106332:head# 2024-04-01T19:56:57.920 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.920 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96241833:::benchmark_data_smithi188_161190_object69258:head# 2024-04-01T19:56:57.920 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.922 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96250d26:::benchmark_data_smithi188_161190_object50853:head# 2024-04-01T19:56:57.923 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.923 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9625841b:::benchmark_data_smithi188_161190_object123549:head# 2024-04-01T19:56:57.923 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.923 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9625c25f:::benchmark_data_smithi188_161190_object84598:head# 2024-04-01T19:56:57.923 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.923 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:962619ab:::benchmark_data_smithi188_161190_object35672:head# 2024-04-01T19:56:57.923 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.923 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:962726db:::benchmark_data_smithi188_161190_object110608:head# 2024-04-01T19:56:57.923 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.923 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9627d29f:::benchmark_data_smithi188_161190_object58889:head# 2024-04-01T19:56:57.923 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.923 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9627ede4:::benchmark_data_smithi188_161190_object50566:head# 2024-04-01T19:56:57.924 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.924 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9628053b:::benchmark_data_smithi188_161190_object124393:head# 2024-04-01T19:56:57.924 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.924 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96280e6e:::benchmark_data_smithi188_161190_object82871:head# 2024-04-01T19:56:57.924 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.924 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9628646d:::benchmark_data_smithi188_161190_object87694:head# 2024-04-01T19:56:57.924 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.925 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96288190:::benchmark_data_smithi188_161190_object40872:head# 2024-04-01T19:56:57.926 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.926 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9628de42:::benchmark_data_smithi188_161190_object54674:head# 2024-04-01T19:56:57.926 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.926 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96298a50:::benchmark_data_smithi188_161190_object27041:head# 2024-04-01T19:56:57.926 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.926 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9629a854:::benchmark_data_smithi188_161190_object53322:head# 2024-04-01T19:56:57.926 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.926 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9629ef93:::benchmark_data_smithi188_161190_object45075:head# 2024-04-01T19:56:57.926 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.926 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:962a0129:::benchmark_data_smithi188_161190_object80390:head# 2024-04-01T19:56:57.926 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.926 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:962a0a71:::benchmark_data_smithi188_161190_object45336:head# 2024-04-01T19:56:57.926 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.927 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:962a2944:::benchmark_data_smithi188_161190_object132050:head# 2024-04-01T19:56:57.927 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.927 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:962af193:::benchmark_data_smithi188_161190_object123602:head# 2024-04-01T19:56:57.927 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.929 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:962c7bd8:::benchmark_data_smithi188_161190_object100696:head# 2024-04-01T19:56:57.930 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.930 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:962c8d14:::benchmark_data_smithi188_161190_object44329:head# 2024-04-01T19:56:57.930 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.940 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:962d2cf3:::benchmark_data_smithi188_161190_object64096:head# 2024-04-01T19:56:57.940 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.941 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:962d647c:::benchmark_data_smithi188_161190_object116376:head# 2024-04-01T19:56:57.941 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.941 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:962dcd73:::benchmark_data_smithi188_161190_object125338:head# 2024-04-01T19:56:57.941 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.941 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:962e2bc7:::benchmark_data_smithi188_161190_object53951:head# 2024-04-01T19:56:57.941 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.941 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96306ffc:::benchmark_data_smithi188_161190_object39075:head# 2024-04-01T19:56:57.941 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.941 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9630b4b6:::benchmark_data_smithi188_161190_object128971:head# 2024-04-01T19:56:57.941 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.941 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96310e8a:::benchmark_data_smithi188_161190_object90537:head# 2024-04-01T19:56:57.941 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.941 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96311e9e:::benchmark_data_smithi188_161190_object75705:head# 2024-04-01T19:56:57.942 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.942 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9631fd69:::benchmark_data_smithi188_161190_object135087:head# 2024-04-01T19:56:57.942 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.942 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96329b9d:::benchmark_data_smithi188_161190_object50587:head# 2024-04-01T19:56:57.942 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.942 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9633828b:::benchmark_data_smithi188_161190_object106130:head# 2024-04-01T19:56:57.942 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.942 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9633aadb:::benchmark_data_smithi188_161190_object118496:head# 2024-04-01T19:56:57.942 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.942 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:963481df:::benchmark_data_smithi188_161190_object30431:head# 2024-04-01T19:56:57.942 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.943 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9634a7cd:::benchmark_data_smithi188_161190_object122613:head# 2024-04-01T19:56:57.943 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.943 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:963556d6:::benchmark_data_smithi188_161190_object37784:head# 2024-04-01T19:56:57.943 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.943 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9635cc69:::benchmark_data_smithi188_161190_object58361:head# 2024-04-01T19:56:57.943 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.943 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9635f9ed:::benchmark_data_smithi188_161190_object52349:head# 2024-04-01T19:56:57.943 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.943 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9636167e:::benchmark_data_smithi188_161190_object46644:head# 2024-04-01T19:56:57.943 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.943 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96361fe9:::benchmark_data_smithi188_161190_object47740:head# 2024-04-01T19:56:57.943 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.943 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:963657d7:::benchmark_data_smithi188_161190_object91756:head# 2024-04-01T19:56:57.944 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.944 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9636e5af:::benchmark_data_smithi188_161190_object119963:head# 2024-04-01T19:56:57.944 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.944 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9637cb11:::benchmark_data_smithi188_161190_object31351:head# 2024-04-01T19:56:57.944 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.944 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9638139b:::benchmark_data_smithi188_161190_object25714:head# 2024-04-01T19:56:57.944 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.944 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9638d2d9:::benchmark_data_smithi188_161190_object67303:head# 2024-04-01T19:56:57.944 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.944 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9638f637:::benchmark_data_smithi188_161190_object28520:head# 2024-04-01T19:56:57.944 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.944 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9639075e:::benchmark_data_smithi188_161190_object124135:head# 2024-04-01T19:56:57.944 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.945 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96392397:::benchmark_data_smithi188_161190_object49788:head# 2024-04-01T19:56:57.945 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.945 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:963a7511:::benchmark_data_smithi188_161190_object72094:head# 2024-04-01T19:56:57.945 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.945 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:963bc277:::benchmark_data_smithi188_161190_object74587:head# 2024-04-01T19:56:57.945 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.945 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:963cdd79:::benchmark_data_smithi188_161190_object42504:head# 2024-04-01T19:56:57.945 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.945 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:963e9e6c:::benchmark_data_smithi188_161190_object81122:head# 2024-04-01T19:56:57.945 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.945 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:963ebd6b:::benchmark_data_smithi188_161190_object115935:head# 2024-04-01T19:56:57.946 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.946 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:963f7a51:::benchmark_data_smithi188_161190_object75902:head# 2024-04-01T19:56:57.946 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.946 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:963f8e34:::benchmark_data_smithi188_161190_object48343:head# 2024-04-01T19:56:57.946 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.947 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:963f9802:::benchmark_data_smithi188_161190_object53621:head# 2024-04-01T19:56:57.947 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.947 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:963fcfa9:::benchmark_data_smithi188_161190_object85907:head# 2024-04-01T19:56:57.947 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.948 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96401f72:::benchmark_data_smithi188_161190_object125749:head# 2024-04-01T19:56:57.948 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.948 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9640adcc:::benchmark_data_smithi188_161190_object104324:head# 2024-04-01T19:56:57.948 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.948 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96413b2e:::benchmark_data_smithi188_161190_object26299:head# 2024-04-01T19:56:57.948 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.948 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96425941:::benchmark_data_smithi188_161190_object61231:head# 2024-04-01T19:56:57.948 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.948 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96425c43:::benchmark_data_smithi188_161190_object53113:head# 2024-04-01T19:56:57.948 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.948 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9642a08c:::benchmark_data_smithi188_161190_object99275:head# 2024-04-01T19:56:57.948 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.948 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9643a8b3:::benchmark_data_smithi188_161190_object104640:head# 2024-04-01T19:56:57.948 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.949 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9643e6ba:::benchmark_data_smithi188_161190_object54069:head# 2024-04-01T19:56:57.949 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.949 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:964457e2:::benchmark_data_smithi188_161190_object42636:head# 2024-04-01T19:56:57.949 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.949 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9644bd24:::benchmark_data_smithi188_161190_object23893:head# 2024-04-01T19:56:57.949 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.949 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9644c5ad:::benchmark_data_smithi188_161190_object34376:head# 2024-04-01T19:56:57.949 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.949 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9647f0d7:::benchmark_data_smithi188_161190_object114704:head# 2024-04-01T19:56:57.949 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.949 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96482343:::benchmark_data_smithi188_161190_object79348:head# 2024-04-01T19:56:57.949 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.952 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96499ed9:::benchmark_data_smithi188_161190_object107353:head# 2024-04-01T19:56:57.952 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.952 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:964adf45:::benchmark_data_smithi188_161190_object98163:head# 2024-04-01T19:56:57.953 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.953 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:964bd98f:::benchmark_data_smithi188_161190_object114930:head# 2024-04-01T19:56:57.953 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.953 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:964bdba7:::benchmark_data_smithi188_161190_object107930:head# 2024-04-01T19:56:57.953 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.953 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:964c7ad5:::benchmark_data_smithi188_161190_object40505:head# 2024-04-01T19:56:57.953 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.953 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:964d2141:::benchmark_data_smithi188_161190_object134083:head# 2024-04-01T19:56:57.953 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.953 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:964e3c10:::benchmark_data_smithi188_161190_object63262:head# 2024-04-01T19:56:57.953 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.953 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:964f8774:::benchmark_data_smithi188_161190_object109729:head# 2024-04-01T19:56:57.953 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.953 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96501574:::benchmark_data_smithi188_161190_object110076:head# 2024-04-01T19:56:57.954 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.954 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9650cbb6:::benchmark_data_smithi188_161190_object80281:head# 2024-04-01T19:56:57.954 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.954 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96518150:::benchmark_data_smithi188_161190_object36735:head# 2024-04-01T19:56:57.954 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.954 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96518837:::benchmark_data_smithi188_161190_object112182:head# 2024-04-01T19:56:57.954 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.954 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96536b28:::benchmark_data_smithi188_161190_object128518:head# 2024-04-01T19:56:57.954 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.954 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:965476cb:::benchmark_data_smithi188_161190_object47657:head# 2024-04-01T19:56:57.954 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.954 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9654bd74:::benchmark_data_smithi188_161190_object96640:head# 2024-04-01T19:56:57.955 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.955 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9654cb57:::benchmark_data_smithi188_161190_object93020:head# 2024-04-01T19:56:57.955 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.955 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96555a26:::benchmark_data_smithi188_161190_object34508:head# 2024-04-01T19:56:57.955 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.955 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9656bc74:::benchmark_data_smithi188_161190_object86609:head# 2024-04-01T19:56:57.955 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.955 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96570e0a:::benchmark_data_smithi188_161190_object59120:head# 2024-04-01T19:56:57.955 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.955 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9658f55f:::benchmark_data_smithi188_161190_object137095:head# 2024-04-01T19:56:57.955 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.956 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96596ee8:::benchmark_data_smithi188_161190_object93151:head# 2024-04-01T19:56:57.956 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.957 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9659ae0b:::benchmark_data_smithi188_161190_object64188:head# 2024-04-01T19:56:57.957 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.957 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:965a5c52:::benchmark_data_smithi188_161190_object132165:head# 2024-04-01T19:56:57.957 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.957 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:965a97aa:::benchmark_data_smithi188_161190_object34600:head# 2024-04-01T19:56:57.957 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.957 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:965b6b33:::benchmark_data_smithi188_161190_object86211:head# 2024-04-01T19:56:57.957 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.957 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:965b9a26:::benchmark_data_smithi188_161190_object76873:head# 2024-04-01T19:56:57.957 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.957 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:965c1786:::benchmark_data_smithi188_161190_object70188:head# 2024-04-01T19:56:57.957 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.957 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:965c336d:::benchmark_data_smithi188_161190_object131603:head# 2024-04-01T19:56:57.957 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.958 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:965c648a:::benchmark_data_smithi188_161190_object79128:head# 2024-04-01T19:56:57.958 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.958 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:965c66ce:::benchmark_data_smithi188_161190_object52205:head# 2024-04-01T19:56:57.959 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.959 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:965de665:::benchmark_data_smithi188_161190_object20162:head# 2024-04-01T19:56:57.959 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.959 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:965e19fb:::benchmark_data_smithi188_161190_object80325:head# 2024-04-01T19:56:57.959 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.959 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:965e9af5:::benchmark_data_smithi188_161190_object87294:head# 2024-04-01T19:56:57.959 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.959 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:965f499e:::benchmark_data_smithi188_161190_object121866:head# 2024-04-01T19:56:57.959 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.959 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:965f8dcf:::benchmark_data_smithi188_161190_object22009:head# 2024-04-01T19:56:57.960 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.960 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96606382:::benchmark_data_smithi188_161190_object94615:head# 2024-04-01T19:56:57.960 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.960 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:966079c6:::benchmark_data_smithi188_161190_object73859:head# 2024-04-01T19:56:57.960 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.964 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:966084e4:::benchmark_data_smithi188_161190_object85823:head# 2024-04-01T19:56:57.964 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.965 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96619e24:::benchmark_data_smithi188_161190_object64092:head# 2024-04-01T19:56:57.965 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.965 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96627654:::benchmark_data_smithi188_161190_object74766:head# 2024-04-01T19:56:57.965 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.965 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:966278a8:::benchmark_data_smithi188_161190_object97570:head# 2024-04-01T19:56:57.965 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.966 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9662b581:::benchmark_data_smithi188_161190_object126897:head# 2024-04-01T19:56:57.966 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.966 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9662f91c:::benchmark_data_smithi188_161190_object113528:head# 2024-04-01T19:56:57.966 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.966 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:966321e2:::benchmark_data_smithi188_161190_object82145:head# 2024-04-01T19:56:57.966 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.967 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:966338e9:::benchmark_data_smithi188_161190_object45253:head# 2024-04-01T19:56:57.968 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.968 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9663d5bf:::benchmark_data_smithi188_161190_object116491:head# 2024-04-01T19:56:57.968 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.968 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96643b3e:::benchmark_data_smithi188_161190_object95978:head# 2024-04-01T19:56:57.968 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.968 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:966463f0:::benchmark_data_smithi188_161190_object93396:head# 2024-04-01T19:56:57.968 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.968 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9664d9d6:::benchmark_data_smithi188_161190_object73569:head# 2024-04-01T19:56:57.968 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.968 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9665bacb:::benchmark_data_smithi188_161190_object128345:head# 2024-04-01T19:56:57.968 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.968 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9665c491:::benchmark_data_smithi188_161190_object46825:head# 2024-04-01T19:56:57.968 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.970 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96669065:::benchmark_data_smithi188_161190_object100503:head# 2024-04-01T19:56:57.970 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.970 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:966792af:::benchmark_data_smithi188_161190_object42918:head# 2024-04-01T19:56:57.970 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.971 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9668e1d1:::benchmark_data_smithi188_161190_object29316:head# 2024-04-01T19:56:57.971 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.971 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9668e7a8:::benchmark_data_smithi188_161190_object62093:head# 2024-04-01T19:56:57.971 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.971 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9668f5ac:::benchmark_data_smithi188_161190_object95259:head# 2024-04-01T19:56:57.971 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.971 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:966b54ac:::benchmark_data_smithi188_161190_object132302:head# 2024-04-01T19:56:57.971 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.971 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:966b9f84:::benchmark_data_smithi188_161190_object112723:head# 2024-04-01T19:56:57.971 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.971 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:966c34e0:::benchmark_data_smithi188_161190_object111937:head# 2024-04-01T19:56:57.971 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.972 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:966c4a52:::benchmark_data_smithi188_161190_object41998:head# 2024-04-01T19:56:57.972 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.972 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:966c8493:::benchmark_data_smithi188_161190_object61289:head# 2024-04-01T19:56:57.972 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.973 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:966cc530:::benchmark_data_smithi188_161190_object66985:head# 2024-04-01T19:56:57.973 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.973 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:966e8ce4:::benchmark_data_smithi188_161190_object131148:head# 2024-04-01T19:56:57.973 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.973 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:966fd117:::benchmark_data_smithi188_161190_object67063:head# 2024-04-01T19:56:57.974 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.974 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:966ff0bc:::benchmark_data_smithi188_161190_object79667:head# 2024-04-01T19:56:57.974 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.974 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9670226c:::benchmark_data_smithi188_161190_object107451:head# 2024-04-01T19:56:57.974 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.974 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96703643:::benchmark_data_smithi188_161190_object98671:head# 2024-04-01T19:56:57.974 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.974 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9670986f:::benchmark_data_smithi188_161190_object89420:head# 2024-04-01T19:56:57.974 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.974 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9670e20f:::benchmark_data_smithi188_161190_object138236:head# 2024-04-01T19:56:57.974 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.974 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9670fb67:::benchmark_data_smithi188_161190_object118446:head# 2024-04-01T19:56:57.974 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.976 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96715554:::benchmark_data_smithi188_161190_object71858:head# 2024-04-01T19:56:57.976 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.976 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9671dd91:::benchmark_data_smithi188_161190_object50515:head# 2024-04-01T19:56:57.976 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.976 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96723e88:::benchmark_data_smithi188_161190_object127580:head# 2024-04-01T19:56:57.976 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.977 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9672553f:::benchmark_data_smithi188_161190_object69447:head# 2024-04-01T19:56:57.977 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.977 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9672db80:::benchmark_data_smithi188_161190_object28000:head# 2024-04-01T19:56:57.977 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.977 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9673414f:::benchmark_data_smithi188_161190_object28030:head# 2024-04-01T19:56:57.977 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.977 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96736fc3:::benchmark_data_smithi188_161190_object129778:head# 2024-04-01T19:56:57.977 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.977 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:967386e7:::benchmark_data_smithi188_161190_object91117:head# 2024-04-01T19:56:57.977 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.977 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9674311f:::benchmark_data_smithi188_161190_object47956:head# 2024-04-01T19:56:57.977 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.977 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9674384c:::benchmark_data_smithi188_161190_object86311:head# 2024-04-01T19:56:57.977 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.979 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9674f5f6:::benchmark_data_smithi188_161190_object114242:head# 2024-04-01T19:56:57.979 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.979 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9674f7ec:::benchmark_data_smithi188_161190_object55421:head# 2024-04-01T19:56:57.979 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.979 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:967580e0:::benchmark_data_smithi188_161190_object113057:head# 2024-04-01T19:56:57.979 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.979 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96764c01:::benchmark_data_smithi188_161190_object113117:head# 2024-04-01T19:56:57.979 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.979 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9676577a:::benchmark_data_smithi188_161190_object98483:head# 2024-04-01T19:56:57.979 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.979 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9676a87b:::benchmark_data_smithi188_161190_object25233:head# 2024-04-01T19:56:57.980 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.980 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96776c4d:::benchmark_data_smithi188_161190_object116383:head# 2024-04-01T19:56:57.980 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.980 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9677f937:::benchmark_data_smithi188_161190_object94270:head# 2024-04-01T19:56:57.980 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.982 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96783aaa:::benchmark_data_smithi188_161190_object58631:head# 2024-04-01T19:56:57.983 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.983 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9678ef91:::benchmark_data_smithi188_161190_object29966:head# 2024-04-01T19:56:57.983 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.983 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96792454:::benchmark_data_smithi188_161190_object71337:head# 2024-04-01T19:56:57.983 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.983 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:967941a8:::benchmark_data_smithi188_161190_object24810:head# 2024-04-01T19:56:57.983 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.983 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:967949d7:::benchmark_data_smithi188_161190_object111801:head# 2024-04-01T19:56:57.983 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.983 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96798dee:::benchmark_data_smithi188_161190_object47360:head# 2024-04-01T19:56:57.983 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.983 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:967a1b99:::benchmark_data_smithi188_161190_object102672:head# 2024-04-01T19:56:57.983 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.984 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:967a2281:::benchmark_data_smithi188_161190_object23070:head# 2024-04-01T19:56:57.984 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.984 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:967a3d9b:::benchmark_data_smithi188_161190_object127532:head# 2024-04-01T19:56:57.984 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.984 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:967aa5fc:::benchmark_data_smithi188_161190_object67151:head# 2024-04-01T19:56:57.984 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.984 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:967b1b4e:::benchmark_data_smithi188_161190_object39174:head# 2024-04-01T19:56:57.984 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.984 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:967c9d65:::benchmark_data_smithi188_161190_object127748:head# 2024-04-01T19:56:57.984 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.984 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:967d0ca9:::benchmark_data_smithi188_161190_object58078:head# 2024-04-01T19:56:57.984 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.984 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:967e537f:::benchmark_data_smithi188_161190_object87079:head# 2024-04-01T19:56:57.984 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.985 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:967e8605:::benchmark_data_smithi188_161190_object102826:head# 2024-04-01T19:56:57.985 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.986 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:967f32cb:::benchmark_data_smithi188_161190_object32482:head# 2024-04-01T19:56:57.986 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.986 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:967f6650:::benchmark_data_smithi188_161190_object92980:head# 2024-04-01T19:56:57.986 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.987 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:967ff70c:::benchmark_data_smithi188_161190_object65013:head# 2024-04-01T19:56:57.987 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.987 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9680d151:::benchmark_data_smithi188_161190_object44551:head# 2024-04-01T19:56:57.987 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.987 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9680d466:::benchmark_data_smithi188_161190_object92000:head# 2024-04-01T19:56:57.987 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.987 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96811c93:::benchmark_data_smithi188_161190_object109942:head# 2024-04-01T19:56:57.987 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.987 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96815d3b:::benchmark_data_smithi188_161190_object92867:head# 2024-04-01T19:56:57.988 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.988 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9681b111:::benchmark_data_smithi188_161190_object76931:head# 2024-04-01T19:56:57.988 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.988 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9681f610:::benchmark_data_smithi188_161190_object107465:head# 2024-04-01T19:56:57.988 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.988 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9681ff9f:::benchmark_data_smithi188_161190_object57464:head# 2024-04-01T19:56:57.988 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.989 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9682d9b9:::benchmark_data_smithi188_161190_object46709:head# 2024-04-01T19:56:57.989 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.989 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9683aada:::benchmark_data_smithi188_161190_object136649:head# 2024-04-01T19:56:57.989 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.989 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96848a36:::benchmark_data_smithi188_161190_object105850:head# 2024-04-01T19:56:57.989 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.989 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96848d23:::benchmark_data_smithi188_161190_object23476:head# 2024-04-01T19:56:57.989 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.989 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9684b56a:::benchmark_data_smithi188_161190_object25926:head# 2024-04-01T19:56:57.990 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.990 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9684bfb5:::benchmark_data_smithi188_161190_object68635:head# 2024-04-01T19:56:57.990 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.990 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96858037:::benchmark_data_smithi188_161190_object71073:head# 2024-04-01T19:56:57.990 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.990 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9685bf3b:::benchmark_data_smithi188_161190_object33420:head# 2024-04-01T19:56:57.990 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.990 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9686723a:::benchmark_data_smithi188_161190_object111755:head# 2024-04-01T19:56:57.990 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.990 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96872dab:::benchmark_data_smithi188_161190_object19807:head# 2024-04-01T19:56:57.990 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.990 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96873f8a:::benchmark_data_smithi188_161190_object138293:head# 2024-04-01T19:56:57.991 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.999 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96874315:::benchmark_data_smithi188_161190_object39669:head# 2024-04-01T19:56:57.999 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:57.999 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9687cb02:::benchmark_data_smithi188_161190_object83432:head# 2024-04-01T19:56:57.999 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.000 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9687cb50:::benchmark_data_smithi188_161190_object75975:head# 2024-04-01T19:56:58.000 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.000 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9687ce29:::benchmark_data_smithi188_161190_object112740:head# 2024-04-01T19:56:58.000 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.000 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9687fd7c:::benchmark_data_smithi188_161190_object87002:head# 2024-04-01T19:56:58.000 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.000 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9688576e:::benchmark_data_smithi188_161190_object95187:head# 2024-04-01T19:56:58.000 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.001 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9688cb32:::benchmark_data_smithi188_161190_object85159:head# 2024-04-01T19:56:58.001 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.003 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9688e6ae:::benchmark_data_smithi188_161190_object25380:head# 2024-04-01T19:56:58.003 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.003 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96899d33:::benchmark_data_smithi188_161190_object67463:head# 2024-04-01T19:56:58.003 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.003 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9689a496:::benchmark_data_smithi188_161190_object51458:head# 2024-04-01T19:56:58.003 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.003 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:968a0657:::benchmark_data_smithi188_161190_object114633:head# 2024-04-01T19:56:58.003 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.003 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:968b4bf6:::benchmark_data_smithi188_161190_object132856:head# 2024-04-01T19:56:58.003 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.003 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:968b683a:::benchmark_data_smithi188_161190_object71797:head# 2024-04-01T19:56:58.004 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.004 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:968d720e:::benchmark_data_smithi188_161190_object116283:head# 2024-04-01T19:56:58.004 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.004 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:968d8e44:::benchmark_data_smithi188_161190_object121435:head# 2024-04-01T19:56:58.004 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.004 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:968dbb37:::benchmark_data_smithi188_161190_object66252:head# 2024-04-01T19:56:58.004 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.004 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:968dd68f:::benchmark_data_smithi188_161190_object57990:head# 2024-04-01T19:56:58.004 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.004 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:968e0812:::benchmark_data_smithi188_161190_object32673:head# 2024-04-01T19:56:58.004 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.005 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:968edb98:::benchmark_data_smithi188_161190_object89597:head# 2024-04-01T19:56:58.005 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.005 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:968f1c72:::benchmark_data_smithi188_161190_object97901:head# 2024-04-01T19:56:58.005 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.005 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:968fec6a:::benchmark_data_smithi188_161190_object137163:head# 2024-04-01T19:56:58.006 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.006 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96906ba4:::benchmark_data_smithi188_161190_object82793:head# 2024-04-01T19:56:58.006 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.006 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9690bec1:::benchmark_data_smithi188_161190_object49371:head# 2024-04-01T19:56:58.007 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.007 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9690c6e6:::benchmark_data_smithi188_161190_object118579:head# 2024-04-01T19:56:58.007 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.007 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9690ce92:::benchmark_data_smithi188_161190_object127950:head# 2024-04-01T19:56:58.007 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.007 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96913efc:::benchmark_data_smithi188_161190_object28722:head# 2024-04-01T19:56:58.007 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.007 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9691f2fd:::benchmark_data_smithi188_161190_object59659:head# 2024-04-01T19:56:58.007 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.007 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96926e47:::benchmark_data_smithi188_161190_object63114:head# 2024-04-01T19:56:58.007 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.008 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9692cad7:::benchmark_data_smithi188_161190_object43717:head# 2024-04-01T19:56:58.008 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.008 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9696a9ba:::benchmark_data_smithi188_161190_object99828:head# 2024-04-01T19:56:58.008 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.009 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9696c68a:::benchmark_data_smithi188_161190_object33884:head# 2024-04-01T19:56:58.009 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.009 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9696d1c6:::benchmark_data_smithi188_161190_object99878:head# 2024-04-01T19:56:58.009 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.009 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9697adf6:::benchmark_data_smithi188_161190_object99483:head# 2024-04-01T19:56:58.009 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.009 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9697bcac:::benchmark_data_smithi188_161190_object85744:head# 2024-04-01T19:56:58.009 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.009 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9697f8d9:::benchmark_data_smithi188_161190_object123288:head# 2024-04-01T19:56:58.009 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.011 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9697faf2:::benchmark_data_smithi188_161190_object104769:head# 2024-04-01T19:56:58.011 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.011 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96989e7f:::benchmark_data_smithi188_161190_object116474:head# 2024-04-01T19:56:58.011 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.011 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9698af6a:::benchmark_data_smithi188_161190_object67700:head# 2024-04-01T19:56:58.012 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.012 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9698cf0c:::benchmark_data_smithi188_161190_object29657:head# 2024-04-01T19:56:58.012 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.012 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9698f8db:::benchmark_data_smithi188_161190_object87631:head# 2024-04-01T19:56:58.012 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.012 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:969903d5:::benchmark_data_smithi188_161190_object84735:head# 2024-04-01T19:56:58.012 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.012 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96993619:::benchmark_data_smithi188_161190_object53154:head# 2024-04-01T19:56:58.012 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.012 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96995667:::benchmark_data_smithi188_161190_object118348:head# 2024-04-01T19:56:58.012 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.012 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96997f9c:::benchmark_data_smithi188_161190_object82231:head# 2024-04-01T19:56:58.012 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.012 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:969aa146:::benchmark_data_smithi188_161190_object60999:head# 2024-04-01T19:56:58.013 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.013 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:969aeb5c:::benchmark_data_smithi188_161190_object94479:head# 2024-04-01T19:56:58.013 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.019 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:969c6701:::benchmark_data_smithi188_161190_object22227:head# 2024-04-01T19:56:58.020 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.023 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:969d35d9:::benchmark_data_smithi188_161190_object55613:head# 2024-04-01T19:56:58.023 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.026 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:969d9bdf:::benchmark_data_smithi188_161190_object54028:head# 2024-04-01T19:56:58.026 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.026 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:969dfdc9:::benchmark_data_smithi188_161190_object28331:head# 2024-04-01T19:56:58.026 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.026 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:969e4157:::benchmark_data_smithi188_161190_object111661:head# 2024-04-01T19:56:58.026 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.028 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:969fcb10:::benchmark_data_smithi188_161190_object40966:head# 2024-04-01T19:56:58.028 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.028 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96a00ab4:::benchmark_data_smithi188_161190_object104313:head# 2024-04-01T19:56:58.028 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.028 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96a012f5:::benchmark_data_smithi188_161190_object64306:head# 2024-04-01T19:56:58.028 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.028 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96a0f80a:::benchmark_data_smithi188_161190_object138568:head# 2024-04-01T19:56:58.028 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.029 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96a1105e:::benchmark_data_smithi188_161190_object48729:head# 2024-04-01T19:56:58.029 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.029 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96a19e84:::benchmark_data_smithi188_161190_object67266:head# 2024-04-01T19:56:58.029 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.029 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96a209ba:::benchmark_data_smithi188_161190_object66061:head# 2024-04-01T19:56:58.029 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.029 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96a238e7:::benchmark_data_smithi188_161190_object58532:head# 2024-04-01T19:56:58.029 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.029 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96a28c0e:::benchmark_data_smithi188_161190_object44048:head# 2024-04-01T19:56:58.029 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.035 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96a29a8c:::benchmark_data_smithi188_161190_object92324:head# 2024-04-01T19:56:58.035 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.035 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96a2c96a:::benchmark_data_smithi188_161190_object103953:head# 2024-04-01T19:56:58.035 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.035 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96a3280e:::benchmark_data_smithi188_161190_object20157:head# 2024-04-01T19:56:58.035 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.035 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96a42866:::benchmark_data_smithi188_161190_object79985:head# 2024-04-01T19:56:58.035 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.035 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96a50213:::benchmark_data_smithi188_161190_object43680:head# 2024-04-01T19:56:58.035 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.035 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96a57551:::benchmark_data_smithi188_161190_object89969:head# 2024-04-01T19:56:58.036 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.036 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96a72d90:::benchmark_data_smithi188_161190_object71493:head# 2024-04-01T19:56:58.036 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.036 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96a766fb:::benchmark_data_smithi188_161190_object57470:head# 2024-04-01T19:56:58.036 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.036 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96a7a656:::benchmark_data_smithi188_161190_object53526:head# 2024-04-01T19:56:58.036 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.038 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96a7f301:::benchmark_data_smithi188_161190_object29969:head# 2024-04-01T19:56:58.038 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.038 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96a8b075:::benchmark_data_smithi188_161190_object125284:head# 2024-04-01T19:56:58.038 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.038 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96a8d61b:::benchmark_data_smithi188_161190_object59604:head# 2024-04-01T19:56:58.039 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.039 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96a92957:::benchmark_data_smithi188_161190_object120552:head# 2024-04-01T19:56:58.039 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.039 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96ab58e4:::benchmark_data_smithi188_161190_object105078:head# 2024-04-01T19:56:58.039 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.039 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96ab8289:::benchmark_data_smithi188_161190_object30437:head# 2024-04-01T19:56:58.039 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.039 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96ac6d9f:::benchmark_data_smithi188_161190_object72600:head# 2024-04-01T19:56:58.039 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.039 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96ad22cd:::benchmark_data_smithi188_161190_object117640:head# 2024-04-01T19:56:58.039 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.039 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96ad7389:::benchmark_data_smithi188_161190_object125121:head# 2024-04-01T19:56:58.039 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.039 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96ada6e2:::benchmark_data_smithi188_161190_object44705:head# 2024-04-01T19:56:58.040 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.040 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96ae6d2b:::benchmark_data_smithi188_161190_object66237:head# 2024-04-01T19:56:58.040 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.040 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96af0390:::benchmark_data_smithi188_161190_object82618:head# 2024-04-01T19:56:58.040 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.040 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96af198c:::benchmark_data_smithi188_161190_object69670:head# 2024-04-01T19:56:58.040 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.042 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96af1e32:::benchmark_data_smithi188_161190_object54620:head# 2024-04-01T19:56:58.042 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.042 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96b011a7:::benchmark_data_smithi188_161190_object101773:head# 2024-04-01T19:56:58.042 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.042 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96b01574:::benchmark_data_smithi188_161190_object68280:head# 2024-04-01T19:56:58.042 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.042 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96b05bbc:::benchmark_data_smithi188_161190_object59025:head# 2024-04-01T19:56:58.042 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.042 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96b1ceca:::benchmark_data_smithi188_161190_object33916:head# 2024-04-01T19:56:58.042 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.042 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96b25666:::benchmark_data_smithi188_161190_object53089:head# 2024-04-01T19:56:58.042 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.042 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96b32931:::benchmark_data_smithi188_161190_object31725:head# 2024-04-01T19:56:58.043 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.043 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96b33fd3:::benchmark_data_smithi188_161190_object108449:head# 2024-04-01T19:56:58.043 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.043 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96b3d989:::benchmark_data_smithi188_161190_object126616:head# 2024-04-01T19:56:58.043 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.043 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96b404c6:::benchmark_data_smithi188_161190_object61679:head# 2024-04-01T19:56:58.043 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.043 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96b435ce:::benchmark_data_smithi188_161190_object37196:head# 2024-04-01T19:56:58.043 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.043 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96b441a0:::benchmark_data_smithi188_161190_object45559:head# 2024-04-01T19:56:58.043 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.043 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96b470ec:::benchmark_data_smithi188_161190_object51594:head# 2024-04-01T19:56:58.043 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.045 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96b5449f:::benchmark_data_smithi188_161190_object112518:head# 2024-04-01T19:56:58.045 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.045 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96b5edf8:::benchmark_data_smithi188_161190_object23437:head# 2024-04-01T19:56:58.045 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.046 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96b64c87:::benchmark_data_smithi188_161190_object118852:head# 2024-04-01T19:56:58.046 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.046 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96b66cfb:::benchmark_data_smithi188_161190_object31891:head# 2024-04-01T19:56:58.046 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.046 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96b68189:::benchmark_data_smithi188_161190_object129054:head# 2024-04-01T19:56:58.046 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.046 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96b73775:::benchmark_data_smithi188_161190_object20405:head# 2024-04-01T19:56:58.046 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.046 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96b920c9:::benchmark_data_smithi188_161190_object137417:head# 2024-04-01T19:56:58.046 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.046 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96bbec6a:::benchmark_data_smithi188_161190_object75279:head# 2024-04-01T19:56:58.046 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.046 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96bd1aff:::benchmark_data_smithi188_161190_object133145:head# 2024-04-01T19:56:58.047 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.047 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96bd9d9d:::benchmark_data_smithi188_161190_object33786:head# 2024-04-01T19:56:58.047 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.047 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96be10a3:::benchmark_data_smithi188_161190_object98801:head# 2024-04-01T19:56:58.047 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.050 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96be6f94:::benchmark_data_smithi188_161190_object104558:head# 2024-04-01T19:56:58.051 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.051 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96bfd0ca:::benchmark_data_smithi188_161190_object125620:head# 2024-04-01T19:56:58.051 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.051 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96c00789:::benchmark_data_smithi188_161190_object93622:head# 2024-04-01T19:56:58.052 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.052 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96c06b28:::benchmark_data_smithi188_161190_object108790:head# 2024-04-01T19:56:58.052 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.053 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96c0b048:::benchmark_data_smithi188_161190_object49635:head# 2024-04-01T19:56:58.053 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.053 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96c116a1:::benchmark_data_smithi188_161190_object130593:head# 2024-04-01T19:56:58.053 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.053 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96c266a6:::benchmark_data_smithi188_161190_object39886:head# 2024-04-01T19:56:58.053 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.053 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96c2af00:::benchmark_data_smithi188_161190_object107883:head# 2024-04-01T19:56:58.054 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.054 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96c34b9a:::benchmark_data_smithi188_161190_object45583:head# 2024-04-01T19:56:58.054 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.054 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96c44c69:::benchmark_data_smithi188_161190_object73403:head# 2024-04-01T19:56:58.054 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.055 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96c457fd:::benchmark_data_smithi188_161190_object102370:head# 2024-04-01T19:56:58.055 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.055 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96c63a39:::benchmark_data_smithi188_161190_object61181:head# 2024-04-01T19:56:58.055 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.055 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96c76ef9:::benchmark_data_smithi188_161190_object48826:head# 2024-04-01T19:56:58.055 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.055 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96c81e7b:::benchmark_data_smithi188_161190_object124816:head# 2024-04-01T19:56:58.055 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.055 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96c86bef:::benchmark_data_smithi188_161190_object70051:head# 2024-04-01T19:56:58.055 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.056 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96c88840:::benchmark_data_smithi188_161190_object99531:head# 2024-04-01T19:56:58.056 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.056 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96c9e3e2:::benchmark_data_smithi188_161190_object86294:head# 2024-04-01T19:56:58.056 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.067 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96ca7c97:::benchmark_data_smithi188_161190_object107810:head# 2024-04-01T19:56:58.067 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.068 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96cadaa9:::benchmark_data_smithi188_161190_object136741:head# 2024-04-01T19:56:58.068 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.068 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96cb1159:::benchmark_data_smithi188_161190_object30072:head# 2024-04-01T19:56:58.068 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.069 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96cb5881:::benchmark_data_smithi188_161190_object91862:head# 2024-04-01T19:56:58.069 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.069 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96cb7a52:::benchmark_data_smithi188_161190_object38272:head# 2024-04-01T19:56:58.069 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.073 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96cbcade:::benchmark_data_smithi188_161190_object42888:head# 2024-04-01T19:56:58.073 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.074 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96cd1a4b:::benchmark_data_smithi188_161190_object132544:head# 2024-04-01T19:56:58.074 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.074 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96cdea89:::benchmark_data_smithi188_161190_object139074:head# 2024-04-01T19:56:58.074 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.074 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96ce5924:::benchmark_data_smithi188_161190_object40247:head# 2024-04-01T19:56:58.074 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.074 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96ce8384:::benchmark_data_smithi188_161190_object80363:head# 2024-04-01T19:56:58.074 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.075 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96ce9807:::benchmark_data_smithi188_161190_object118447:head# 2024-04-01T19:56:58.075 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.075 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96ceb5a6:::benchmark_data_smithi188_161190_object119589:head# 2024-04-01T19:56:58.075 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.076 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96ced27e:::benchmark_data_smithi188_161190_object46950:head# 2024-04-01T19:56:58.076 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.076 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96cf3d85:::benchmark_data_smithi188_161190_object94941:head# 2024-04-01T19:56:58.076 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.076 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96cfc352:::benchmark_data_smithi188_161190_object113451:head# 2024-04-01T19:56:58.076 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.076 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96d065e2:::benchmark_data_smithi188_161190_object31293:head# 2024-04-01T19:56:58.076 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.077 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96d0cde6:::benchmark_data_smithi188_161190_object97145:head# 2024-04-01T19:56:58.078 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.078 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96d0da45:::benchmark_data_smithi188_161190_object36230:head# 2024-04-01T19:56:58.078 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.078 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96d122b1:::benchmark_data_smithi188_161190_object76856:head# 2024-04-01T19:56:58.078 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.078 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96d15755:::benchmark_data_smithi188_161190_object95430:head# 2024-04-01T19:56:58.078 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.078 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96d1d948:::benchmark_data_smithi188_161190_object104731:head# 2024-04-01T19:56:58.078 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.078 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96d203a4:::benchmark_data_smithi188_161190_object103201:head# 2024-04-01T19:56:58.078 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.078 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96d232e3:::benchmark_data_smithi188_161190_object54841:head# 2024-04-01T19:56:58.079 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.079 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96d2ecbd:::benchmark_data_smithi188_161190_object45545:head# 2024-04-01T19:56:58.079 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.079 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96d2f126:::benchmark_data_smithi188_161190_object55004:head# 2024-04-01T19:56:58.079 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.080 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96d375b8:::benchmark_data_smithi188_161190_object60244:head# 2024-04-01T19:56:58.080 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.080 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96d4a70c:::benchmark_data_smithi188_161190_object116068:head# 2024-04-01T19:56:58.080 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.081 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96d60354:::benchmark_data_smithi188_161190_object114585:head# 2024-04-01T19:56:58.081 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.081 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96d6bd00:::benchmark_data_smithi188_161190_object80334:head# 2024-04-01T19:56:58.081 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.081 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96d6f3d9:::benchmark_data_smithi188_161190_object99871:head# 2024-04-01T19:56:58.081 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.081 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96d776d2:::benchmark_data_smithi188_161190_object64780:head# 2024-04-01T19:56:58.081 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.081 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96d80a9d:::benchmark_data_smithi188_161190_object101134:head# 2024-04-01T19:56:58.081 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.081 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96d824fd:::benchmark_data_smithi188_161190_object35704:head# 2024-04-01T19:56:58.081 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.081 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96d826d7:::benchmark_data_smithi188_161190_object70502:head# 2024-04-01T19:56:58.081 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.081 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96da6b4c:::benchmark_data_smithi188_161190_object44634:head# 2024-04-01T19:56:58.082 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.084 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96dadefc:::benchmark_data_smithi188_161190_object23474:head# 2024-04-01T19:56:58.084 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.084 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96dbd71d:::benchmark_data_smithi188_161190_object80461:head# 2024-04-01T19:56:58.084 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.085 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96dbfc70:::benchmark_data_smithi188_161190_object94389:head# 2024-04-01T19:56:58.085 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.085 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96dc903b:::benchmark_data_smithi188_161190_object52895:head# 2024-04-01T19:56:58.085 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.085 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96dcf8a9:::benchmark_data_smithi188_161190_object100337:head# 2024-04-01T19:56:58.086 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.086 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96de1e45:::benchmark_data_smithi188_161190_object99098:head# 2024-04-01T19:56:58.086 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.086 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96de8075:::benchmark_data_smithi188_161190_object111701:head# 2024-04-01T19:56:58.086 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.087 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96deda99:::benchmark_data_smithi188_161190_object123612:head# 2024-04-01T19:56:58.087 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.088 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96df1fd9:::benchmark_data_smithi188_161190_object112282:head# 2024-04-01T19:56:58.088 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.088 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96dfe9f1:::benchmark_data_smithi188_161190_object91866:head# 2024-04-01T19:56:58.088 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.088 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96e038a4:::benchmark_data_smithi188_161190_object122151:head# 2024-04-01T19:56:58.088 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.088 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96e12b94:::benchmark_data_smithi188_161190_object123642:head# 2024-04-01T19:56:58.088 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.088 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96e1f693:::benchmark_data_smithi188_161190_object22141:head# 2024-04-01T19:56:58.088 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.089 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96e29e19:::benchmark_data_smithi188_161190_object98445:head# 2024-04-01T19:56:58.089 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.091 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96e2d42c:::benchmark_data_smithi188_161190_object101425:head# 2024-04-01T19:56:58.091 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.091 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96e2edfc:::benchmark_data_smithi188_161190_object115149:head# 2024-04-01T19:56:58.091 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.091 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96e354c4:::benchmark_data_smithi188_161190_object117216:head# 2024-04-01T19:56:58.091 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.091 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96e36c86:::benchmark_data_smithi188_161190_object62705:head# 2024-04-01T19:56:58.091 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.091 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96e47bc2:::benchmark_data_smithi188_161190_object82461:head# 2024-04-01T19:56:58.091 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.091 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96e48585:::benchmark_data_smithi188_161190_object56129:head# 2024-04-01T19:56:58.091 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.091 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96e50374:::benchmark_data_smithi188_161190_object88491:head# 2024-04-01T19:56:58.092 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.092 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96e53ed6:::benchmark_data_smithi188_161190_object25753:head# 2024-04-01T19:56:58.092 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.092 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96e55d1c:::benchmark_data_smithi188_161190_object20504:head# 2024-04-01T19:56:58.092 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.092 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96e63cf0:::benchmark_data_smithi188_161190_object135585:head# 2024-04-01T19:56:58.092 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.092 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96e6b629:::benchmark_data_smithi188_161190_object36078:head# 2024-04-01T19:56:58.092 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.096 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96e708c4:::benchmark_data_smithi188_161190_object95479:head# 2024-04-01T19:56:58.096 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.096 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96e74458:::benchmark_data_smithi188_161190_object118754:head# 2024-04-01T19:56:58.096 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.096 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96e769e8:::benchmark_data_smithi188_161190_object97388:head# 2024-04-01T19:56:58.096 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.097 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96e76e25:::benchmark_data_smithi188_161190_object105916:head# 2024-04-01T19:56:58.097 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.097 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96e9cf76:::benchmark_data_smithi188_161190_object112619:head# 2024-04-01T19:56:58.097 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.097 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96ea1e7b:::benchmark_data_smithi188_161190_object100419:head# 2024-04-01T19:56:58.097 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.097 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96ea7ee5:::benchmark_data_smithi188_161190_object55553:head# 2024-04-01T19:56:58.097 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.097 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96eab4e5:::benchmark_data_smithi188_161190_object30364:head# 2024-04-01T19:56:58.097 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.097 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96eb8a93:::benchmark_data_smithi188_161190_object89744:head# 2024-04-01T19:56:58.097 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.097 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96ecd326:::benchmark_data_smithi188_161190_object43006:head# 2024-04-01T19:56:58.098 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.098 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96eee51e:::benchmark_data_smithi188_161190_object131681:head# 2024-04-01T19:56:58.098 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.098 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96ef0468:::benchmark_data_smithi188_161190_object75576:head# 2024-04-01T19:56:58.098 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.098 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96ef5295:::benchmark_data_smithi188_161190_object138676:head# 2024-04-01T19:56:58.098 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.098 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96efa6e8:::benchmark_data_smithi188_161190_object23192:head# 2024-04-01T19:56:58.098 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.098 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96f068c1:::benchmark_data_smithi188_161190_object74428:head# 2024-04-01T19:56:58.098 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.098 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96f0ea68:::benchmark_data_smithi188_161190_object123817:head# 2024-04-01T19:56:58.098 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.098 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96f1bc5b:::benchmark_data_smithi188_161190_object26632:head# 2024-04-01T19:56:58.099 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.099 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96f1c070:::benchmark_data_smithi188_161190_object79991:head# 2024-04-01T19:56:58.099 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.099 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96f1f359:::benchmark_data_smithi188_161190_object36540:head# 2024-04-01T19:56:58.099 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.099 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96f1f77d:::benchmark_data_smithi188_161190_object22740:head# 2024-04-01T19:56:58.099 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.099 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96f23ad7:::benchmark_data_smithi188_161190_object124906:head# 2024-04-01T19:56:58.099 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.099 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96f23da8:::benchmark_data_smithi188_161190_object126986:head# 2024-04-01T19:56:58.099 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.103 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96f24d22:::benchmark_data_smithi188_161190_object110832:head# 2024-04-01T19:56:58.103 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.103 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96f30943:::benchmark_data_smithi188_161190_object97854:head# 2024-04-01T19:56:58.103 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.103 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96f37fc3:::benchmark_data_smithi188_161190_object108867:head# 2024-04-01T19:56:58.103 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.103 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96f4021b:::benchmark_data_smithi188_161190_object34372:head# 2024-04-01T19:56:58.103 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.103 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96f40c67:::benchmark_data_smithi188_161190_object124117:head# 2024-04-01T19:56:58.104 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.104 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96f49089:::benchmark_data_smithi188_161190_object24730:head# 2024-04-01T19:56:58.104 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.104 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96f4c875:::benchmark_data_smithi188_161190_object29109:head# 2024-04-01T19:56:58.104 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.104 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96f4cae3:::benchmark_data_smithi188_161190_object26683:head# 2024-04-01T19:56:58.104 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.104 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96f5a0ba:::benchmark_data_smithi188_161190_object99807:head# 2024-04-01T19:56:58.104 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.104 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96f5f9e0:::benchmark_data_smithi188_161190_object19968:head# 2024-04-01T19:56:58.104 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.104 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96f67c19:::benchmark_data_smithi188_161190_object39647:head# 2024-04-01T19:56:58.104 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.104 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96f70275:::benchmark_data_smithi188_161190_object40845:head# 2024-04-01T19:56:58.104 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.105 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96f89532:::benchmark_data_smithi188_161190_object136612:head# 2024-04-01T19:56:58.105 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.105 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96f8c345:::benchmark_data_smithi188_161190_object96863:head# 2024-04-01T19:56:58.105 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.105 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96f8ce94:::benchmark_data_smithi188_161190_object57502:head# 2024-04-01T19:56:58.105 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.105 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96f9175f:::benchmark_data_smithi188_161190_object71580:head# 2024-04-01T19:56:58.105 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.105 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96f99a55:::benchmark_data_smithi188_161190_object98957:head# 2024-04-01T19:56:58.105 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.105 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96fa9053:::benchmark_data_smithi188_161190_object89377:head# 2024-04-01T19:56:58.105 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.105 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96faa6ee:::benchmark_data_smithi188_161190_object112023:head# 2024-04-01T19:56:58.105 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.106 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96fae122:::benchmark_data_smithi188_161190_object83066:head# 2024-04-01T19:56:58.106 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.106 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96fc2b89:::benchmark_data_smithi188_161190_object93322:head# 2024-04-01T19:56:58.106 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.106 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96fcd900:::benchmark_data_smithi188_161190_object91910:head# 2024-04-01T19:56:58.106 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.106 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96fe6a73:::benchmark_data_smithi188_161190_object112602:head# 2024-04-01T19:56:58.106 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.108 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96fe8576:::benchmark_data_smithi188_161190_object22145:head# 2024-04-01T19:56:58.108 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.108 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96ff2967:::benchmark_data_smithi188_161190_object139023:head# 2024-04-01T19:56:58.108 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.109 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:96ffa3cd:::benchmark_data_smithi188_161190_object34488:head# 2024-04-01T19:56:58.109 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.109 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:970047e1:::benchmark_data_smithi188_161190_object86510:head# 2024-04-01T19:56:58.109 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.109 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9701068c:::benchmark_data_smithi188_161190_object130604:head# 2024-04-01T19:56:58.109 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.109 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:970131a9:::benchmark_data_smithi188_161190_object54561:head# 2024-04-01T19:56:58.109 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.109 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9701423f:::benchmark_data_smithi188_161190_object72112:head# 2024-04-01T19:56:58.109 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.109 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9701d028:::benchmark_data_smithi188_161190_object25712:head# 2024-04-01T19:56:58.109 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.109 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9701e01b:::benchmark_data_smithi188_161190_object90795:head# 2024-04-01T19:56:58.110 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.110 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9702b544:::benchmark_data_smithi188_161190_object130869:head# 2024-04-01T19:56:58.110 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.110 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:970328a3:::benchmark_data_smithi188_161190_object37805:head# 2024-04-01T19:56:58.110 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.110 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9703d855:::benchmark_data_smithi188_161190_object21279:head# 2024-04-01T19:56:58.110 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.110 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9704b507:::benchmark_data_smithi188_161190_object62260:head# 2024-04-01T19:56:58.110 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.110 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9704b598:::benchmark_data_smithi188_161190_object53401:head# 2024-04-01T19:56:58.111 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.111 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9706ab39:::benchmark_data_smithi188_161190_object36303:head# 2024-04-01T19:56:58.111 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.114 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9706b4d6:::benchmark_data_smithi188_161190_object125493:head# 2024-04-01T19:56:58.114 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.114 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:970774e1:::benchmark_data_smithi188_161190_object102685:head# 2024-04-01T19:56:58.114 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.114 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97080e7d:::benchmark_data_smithi188_161190_object27901:head# 2024-04-01T19:56:58.114 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.114 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9708622d:::benchmark_data_smithi188_161190_object104659:head# 2024-04-01T19:56:58.114 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.114 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97087dfd:::benchmark_data_smithi188_161190_object40716:head# 2024-04-01T19:56:58.114 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.114 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9708c7d4:::benchmark_data_smithi188_161190_object31451:head# 2024-04-01T19:56:58.114 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.115 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97096152:::benchmark_data_smithi188_161190_object47393:head# 2024-04-01T19:56:58.115 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.115 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:970a6d5a:::benchmark_data_smithi188_161190_object36743:head# 2024-04-01T19:56:58.115 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.115 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:970a9b99:::benchmark_data_smithi188_161190_object117196:head# 2024-04-01T19:56:58.115 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.115 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:970a9c35:::benchmark_data_smithi188_161190_object66365:head# 2024-04-01T19:56:58.115 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.115 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:970aa784:::benchmark_data_smithi188_161190_object135623:head# 2024-04-01T19:56:58.115 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.115 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:970b2b97:::benchmark_data_smithi188_161190_object33745:head# 2024-04-01T19:56:58.115 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.115 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:970cc04d:::benchmark_data_smithi188_161190_object76255:head# 2024-04-01T19:56:58.116 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.116 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:970e88ce:::benchmark_data_smithi188_161190_object105201:head# 2024-04-01T19:56:58.116 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.116 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:970ebb0d:::benchmark_data_smithi188_161190_object34176:head# 2024-04-01T19:56:58.116 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.116 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:970ed821:::benchmark_data_smithi188_161190_object137304:head# 2024-04-01T19:56:58.116 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.116 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97102425:::benchmark_data_smithi188_161190_object103236:head# 2024-04-01T19:56:58.116 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.116 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97105eee:::benchmark_data_smithi188_161190_object70707:head# 2024-04-01T19:56:58.116 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.116 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9710eb59:::benchmark_data_smithi188_161190_object77007:head# 2024-04-01T19:56:58.117 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.117 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9710f4f6:::benchmark_data_smithi188_161190_object42316:head# 2024-04-01T19:56:58.117 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.118 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9711356a:::benchmark_data_smithi188_161190_object104822:head# 2024-04-01T19:56:58.119 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.119 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97118feb:::benchmark_data_smithi188_161190_object24581:head# 2024-04-01T19:56:58.119 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.119 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:971275d7:::benchmark_data_smithi188_161190_object100129:head# 2024-04-01T19:56:58.119 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.119 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9712778d:::benchmark_data_smithi188_161190_object106998:head# 2024-04-01T19:56:58.119 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.119 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9713a9a0:::benchmark_data_smithi188_161190_object123026:head# 2024-04-01T19:56:58.119 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.119 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9713b441:::benchmark_data_smithi188_161190_object58757:head# 2024-04-01T19:56:58.119 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.119 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9714fede:::benchmark_data_smithi188_161190_object36308:head# 2024-04-01T19:56:58.120 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.120 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97152d1b:::benchmark_data_smithi188_161190_object75826:head# 2024-04-01T19:56:58.120 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.120 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97159992:::benchmark_data_smithi188_161190_object74060:head# 2024-04-01T19:56:58.120 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.120 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9715e35f:::benchmark_data_smithi188_161190_object108286:head# 2024-04-01T19:56:58.120 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.120 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97161afd:::benchmark_data_smithi188_161190_object59572:head# 2024-04-01T19:56:58.120 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.120 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:971623b1:::benchmark_data_smithi188_161190_object34311:head# 2024-04-01T19:56:58.120 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.120 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97166c73:::benchmark_data_smithi188_161190_object81889:head# 2024-04-01T19:56:58.120 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.121 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97179024:::benchmark_data_smithi188_161190_object40663:head# 2024-04-01T19:56:58.121 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.121 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9719365f:::benchmark_data_smithi188_161190_object113929:head# 2024-04-01T19:56:58.121 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.121 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:971a315c:::benchmark_data_smithi188_161190_object24760:head# 2024-04-01T19:56:58.121 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.121 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:971b9565:::benchmark_data_smithi188_161190_object29198:head# 2024-04-01T19:56:58.121 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.121 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:971b9ecc:::benchmark_data_smithi188_161190_object77369:head# 2024-04-01T19:56:58.121 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.121 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:971bd915:::benchmark_data_smithi188_161190_object67776:head# 2024-04-01T19:56:58.121 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.121 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:971ce4a1:::benchmark_data_smithi188_161190_object115298:head# 2024-04-01T19:56:58.122 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.122 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:971cf16e:::benchmark_data_smithi188_161190_object41313:head# 2024-04-01T19:56:58.122 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.122 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:971dcb88:::benchmark_data_smithi188_161190_object115660:head# 2024-04-01T19:56:58.122 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.128 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:971eea5e:::benchmark_data_smithi188_161190_object87033:head# 2024-04-01T19:56:58.128 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.128 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:971fade0:::benchmark_data_smithi188_161190_object53628:head# 2024-04-01T19:56:58.128 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.128 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:971fc584:::benchmark_data_smithi188_161190_object82540:head# 2024-04-01T19:56:58.128 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.128 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9721880d:::benchmark_data_smithi188_161190_object20635:head# 2024-04-01T19:56:58.128 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.129 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97224f01:::benchmark_data_smithi188_161190_object67206:head# 2024-04-01T19:56:58.129 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.129 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97225a72:::benchmark_data_smithi188_161190_object53023:head# 2024-04-01T19:56:58.129 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.129 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9722a1aa:::benchmark_data_smithi188_161190_object53889:head# 2024-04-01T19:56:58.129 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.129 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97230c67:::benchmark_data_smithi188_161190_object129991:head# 2024-04-01T19:56:58.129 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.129 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9724075c:::benchmark_data_smithi188_161190_object68360:head# 2024-04-01T19:56:58.129 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.129 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9725d802:::benchmark_data_smithi188_161190_object70463:head# 2024-04-01T19:56:58.129 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.129 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9725edf6:::benchmark_data_smithi188_161190_object104412:head# 2024-04-01T19:56:58.129 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.129 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97267bc0:::benchmark_data_smithi188_161190_object115341:head# 2024-04-01T19:56:58.130 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.130 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97282911:::benchmark_data_smithi188_161190_object40166:head# 2024-04-01T19:56:58.130 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.130 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9728495c:::benchmark_data_smithi188_161190_object129131:head# 2024-04-01T19:56:58.130 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.130 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97287758:::benchmark_data_smithi188_161190_object32734:head# 2024-04-01T19:56:58.130 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.130 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9728be6b:::benchmark_data_smithi188_161190_object65469:head# 2024-04-01T19:56:58.130 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.130 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9728e13d:::benchmark_data_smithi188_161190_object53534:head# 2024-04-01T19:56:58.130 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.130 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9729cf2b:::benchmark_data_smithi188_161190_object65638:head# 2024-04-01T19:56:58.130 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.131 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:972b0956:::benchmark_data_smithi188_161190_object126311:head# 2024-04-01T19:56:58.131 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.131 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:972b20ab:::benchmark_data_smithi188_161190_object59150:head# 2024-04-01T19:56:58.131 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.131 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:972bb93d:::benchmark_data_smithi188_161190_object25967:head# 2024-04-01T19:56:58.131 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.131 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:972c7301:::benchmark_data_smithi188_161190_object27597:head# 2024-04-01T19:56:58.131 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.131 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:972cf24e:::benchmark_data_smithi188_161190_object88921:head# 2024-04-01T19:56:58.131 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.131 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:972db805:::benchmark_data_smithi188_161190_object92880:head# 2024-04-01T19:56:58.131 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.131 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:972e8502:::benchmark_data_smithi188_161190_object134190:head# 2024-04-01T19:56:58.131 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.132 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:972f422e:::benchmark_data_smithi188_161190_object116131:head# 2024-04-01T19:56:58.132 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.132 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:972fbe5f:::benchmark_data_smithi188_161190_object109571:head# 2024-04-01T19:56:58.132 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.132 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97307005:::benchmark_data_smithi188_161190_object28360:head# 2024-04-01T19:56:58.132 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.132 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97309ef3:::benchmark_data_smithi188_161190_object131682:head# 2024-04-01T19:56:58.132 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.132 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9731d751:::benchmark_data_smithi188_161190_object106732:head# 2024-04-01T19:56:58.132 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.132 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9731d7f9:::benchmark_data_smithi188_161190_object111057:head# 2024-04-01T19:56:58.132 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.132 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9731f229:::benchmark_data_smithi188_161190_object72431:head# 2024-04-01T19:56:58.132 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.132 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9731feed:::benchmark_data_smithi188_161190_object91407:head# 2024-04-01T19:56:58.132 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.133 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97322f5c:::benchmark_data_smithi188_161190_object75992:head# 2024-04-01T19:56:58.133 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.133 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:973499c2:::benchmark_data_smithi188_161190_object108218:head# 2024-04-01T19:56:58.133 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.133 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97353be4:::benchmark_data_smithi188_161190_object128436:head# 2024-04-01T19:56:58.133 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.135 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9735be1d:::benchmark_data_smithi188_161190_object38357:head# 2024-04-01T19:56:58.135 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.135 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9735dec6:::benchmark_data_smithi188_161190_object108523:head# 2024-04-01T19:56:58.135 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.135 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97378981:::benchmark_data_smithi188_161190_object123077:head# 2024-04-01T19:56:58.136 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.136 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9737c481:::benchmark_data_smithi188_161190_object132836:head# 2024-04-01T19:56:58.136 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.136 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97380a08:::benchmark_data_smithi188_161190_object93390:head# 2024-04-01T19:56:58.136 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.136 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9738141f:::benchmark_data_smithi188_161190_object32556:head# 2024-04-01T19:56:58.136 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.136 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97386bf1:::benchmark_data_smithi188_161190_object65466:head# 2024-04-01T19:56:58.136 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.136 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:973873e1:::benchmark_data_smithi188_161190_object25807:head# 2024-04-01T19:56:58.136 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.136 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97388ce9:::benchmark_data_smithi188_161190_object41442:head# 2024-04-01T19:56:58.136 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.136 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97392383:::benchmark_data_smithi188_161190_object55478:head# 2024-04-01T19:56:58.137 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.137 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:973ae93b:::benchmark_data_smithi188_161190_object109561:head# 2024-04-01T19:56:58.137 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.137 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:973b0e73:::benchmark_data_smithi188_161190_object113602:head# 2024-04-01T19:56:58.137 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.137 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:973b71b0:::benchmark_data_smithi188_161190_object38682:head# 2024-04-01T19:56:58.137 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.137 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:973b9862:::benchmark_data_smithi188_161190_object134164:head# 2024-04-01T19:56:58.137 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.137 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:973c0e45:::benchmark_data_smithi188_161190_object46507:head# 2024-04-01T19:56:58.137 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.137 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:973c6082:::benchmark_data_smithi188_161190_object80147:head# 2024-04-01T19:56:58.137 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.137 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:973ca9ba:::benchmark_data_smithi188_161190_object35296:head# 2024-04-01T19:56:58.138 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.138 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:973ce2fa:::benchmark_data_smithi188_161190_object125369:head# 2024-04-01T19:56:58.138 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.138 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:973ee9ff:::benchmark_data_smithi188_161190_object120041:head# 2024-04-01T19:56:58.138 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.138 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:973f9f21:::benchmark_data_smithi188_161190_object91384:head# 2024-04-01T19:56:58.138 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.138 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:973fa574:::benchmark_data_smithi188_161190_object136958:head# 2024-04-01T19:56:58.138 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.139 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:973fad14:::benchmark_data_smithi188_161190_object47518:head# 2024-04-01T19:56:58.139 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.139 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:973fd426:::benchmark_data_smithi188_161190_object28457:head# 2024-04-01T19:56:58.139 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.139 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97400fae:::benchmark_data_smithi188_161190_object131585:head# 2024-04-01T19:56:58.140 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.140 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9740618c:::benchmark_data_smithi188_161190_object68641:head# 2024-04-01T19:56:58.140 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.140 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:974065cf:::benchmark_data_smithi188_161190_object122511:head# 2024-04-01T19:56:58.140 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.146 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9740c5db:::benchmark_data_smithi188_161190_object50348:head# 2024-04-01T19:56:58.146 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.146 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97415824:::benchmark_data_smithi188_161190_object88622:head# 2024-04-01T19:56:58.147 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.147 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97416818:::benchmark_data_smithi188_161190_object101192:head# 2024-04-01T19:56:58.147 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.147 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9741ecb0:::benchmark_data_smithi188_161190_object110731:head# 2024-04-01T19:56:58.147 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.147 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97421465:::benchmark_data_smithi188_161190_object104024:head# 2024-04-01T19:56:58.147 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.147 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9742c31a:::benchmark_data_smithi188_161190_object114925:head# 2024-04-01T19:56:58.147 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.147 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9742d5e3:::benchmark_data_smithi188_161190_object126471:head# 2024-04-01T19:56:58.147 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.147 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97430940:::benchmark_data_smithi188_161190_object67573:head# 2024-04-01T19:56:58.147 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.147 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9743236b:::benchmark_data_smithi188_161190_object99885:head# 2024-04-01T19:56:58.148 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.148 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97434447:::benchmark_data_smithi188_161190_object58468:head# 2024-04-01T19:56:58.148 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.148 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9743d59a:::benchmark_data_smithi188_161190_object27328:head# 2024-04-01T19:56:58.148 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.148 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97441664:::benchmark_data_smithi188_161190_object62421:head# 2024-04-01T19:56:58.148 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.148 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:974469f9:::benchmark_data_smithi188_161190_object65844:head# 2024-04-01T19:56:58.148 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.148 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97454ec9:::benchmark_data_smithi188_161190_object75464:head# 2024-04-01T19:56:58.148 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.148 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9745c748:::benchmark_data_smithi188_161190_object48198:head# 2024-04-01T19:56:58.148 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.149 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97477a76:::benchmark_data_smithi188_161190_object104488:head# 2024-04-01T19:56:58.149 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.149 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9747b703:::benchmark_data_smithi188_161190_object28982:head# 2024-04-01T19:56:58.149 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.149 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:974805da:::benchmark_data_smithi188_161190_object104894:head# 2024-04-01T19:56:58.149 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.149 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97486224:::benchmark_data_smithi188_161190_object59373:head# 2024-04-01T19:56:58.149 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.149 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:974888fc:::benchmark_data_smithi188_161190_object42196:head# 2024-04-01T19:56:58.149 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.149 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9748a4ce:::benchmark_data_smithi188_161190_object41323:head# 2024-04-01T19:56:58.149 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.149 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9748a636:::benchmark_data_smithi188_161190_object61283:head# 2024-04-01T19:56:58.149 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.149 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:974a01df:::benchmark_data_smithi188_161190_object71245:head# 2024-04-01T19:56:58.150 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.150 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:974ad069:::benchmark_data_smithi188_161190_object76028:head# 2024-04-01T19:56:58.150 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.150 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:974c49a2:::benchmark_data_smithi188_161190_object58007:head# 2024-04-01T19:56:58.150 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.155 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:974d8d4a:::benchmark_data_smithi188_161190_object98041:head# 2024-04-01T19:56:58.155 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.155 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:974e47db:::benchmark_data_smithi188_161190_object62147:head# 2024-04-01T19:56:58.155 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.155 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:974e5d96:::benchmark_data_smithi188_161190_object106919:head# 2024-04-01T19:56:58.155 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.155 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:974eb518:::benchmark_data_smithi188_161190_object129938:head# 2024-04-01T19:56:58.155 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.155 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:974f56b8:::benchmark_data_smithi188_161190_object66464:head# 2024-04-01T19:56:58.155 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.155 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:974fd850:::benchmark_data_smithi188_161190_object48595:head# 2024-04-01T19:56:58.155 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.156 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97507ce8:::benchmark_data_smithi188_161190_object96743:head# 2024-04-01T19:56:58.156 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.156 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9750c786:::benchmark_data_smithi188_161190_object66120:head# 2024-04-01T19:56:58.156 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.156 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9751b9a5:::benchmark_data_smithi188_161190_object100530:head# 2024-04-01T19:56:58.156 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.156 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:975406ca:::benchmark_data_smithi188_161190_object55840:head# 2024-04-01T19:56:58.156 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.156 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97541dc5:::benchmark_data_smithi188_161190_object69738:head# 2024-04-01T19:56:58.156 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.156 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9755f1a8:::benchmark_data_smithi188_161190_object106753:head# 2024-04-01T19:56:58.156 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.156 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97568fc7:::benchmark_data_smithi188_161190_object90975:head# 2024-04-01T19:56:58.157 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.157 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97574ee6:::benchmark_data_smithi188_161190_object56832:head# 2024-04-01T19:56:58.157 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.157 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97583504:::benchmark_data_smithi188_161190_object82675:head# 2024-04-01T19:56:58.157 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.157 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97588c0e:::benchmark_data_smithi188_161190_object99305:head# 2024-04-01T19:56:58.157 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.157 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:975931ab:::benchmark_data_smithi188_161190_object114948:head# 2024-04-01T19:56:58.157 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.157 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97597fde:::benchmark_data_smithi188_161190_object75535:head# 2024-04-01T19:56:58.157 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.157 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9759fc6d:::benchmark_data_smithi188_161190_object81074:head# 2024-04-01T19:56:58.157 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.158 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:975a9176:::benchmark_data_smithi188_161190_object56503:head# 2024-04-01T19:56:58.158 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.158 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:975b350b:::benchmark_data_smithi188_161190_object130824:head# 2024-04-01T19:56:58.158 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.158 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:975b730b:::benchmark_data_smithi188_161190_object121725:head# 2024-04-01T19:56:58.158 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.158 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:975b9415:::benchmark_data_smithi188_161190_object137485:head# 2024-04-01T19:56:58.158 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.158 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:975c048f:::benchmark_data_smithi188_161190_object47239:head# 2024-04-01T19:56:58.158 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.158 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:975c9b5f:::benchmark_data_smithi188_161190_object36680:head# 2024-04-01T19:56:58.158 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.158 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:975cb10e:::benchmark_data_smithi188_161190_object96261:head# 2024-04-01T19:56:58.159 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.159 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:975cebbb:::benchmark_data_smithi188_161190_object125485:head# 2024-04-01T19:56:58.159 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.159 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:975d5acb:::benchmark_data_smithi188_161190_object64263:head# 2024-04-01T19:56:58.159 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.159 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:975d9ecf:::benchmark_data_smithi188_161190_object91020:head# 2024-04-01T19:56:58.159 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.159 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:975e7d88:::benchmark_data_smithi188_161190_object115526:head# 2024-04-01T19:56:58.159 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.159 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97603399:::benchmark_data_smithi188_161190_object80562:head# 2024-04-01T19:56:58.159 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.159 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97609544:::benchmark_data_smithi188_161190_object90421:head# 2024-04-01T19:56:58.159 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.162 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9760b12c:::benchmark_data_smithi188_161190_object73858:head# 2024-04-01T19:56:58.162 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.162 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:976258b9:::benchmark_data_smithi188_161190_object117315:head# 2024-04-01T19:56:58.162 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.162 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:976290dd:::benchmark_data_smithi188_161190_object98223:head# 2024-04-01T19:56:58.162 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.162 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9762d46c:::benchmark_data_smithi188_161190_object98868:head# 2024-04-01T19:56:58.162 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.162 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9763548a:::benchmark_data_smithi188_161190_object28907:head# 2024-04-01T19:56:58.162 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.162 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9763acce:::benchmark_data_smithi188_161190_object111109:head# 2024-04-01T19:56:58.162 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.163 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9763efcc:::benchmark_data_smithi188_161190_object118604:head# 2024-04-01T19:56:58.163 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.163 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97658a4b:::benchmark_data_smithi188_161190_object125286:head# 2024-04-01T19:56:58.163 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.163 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9765b413:::benchmark_data_smithi188_161190_object57278:head# 2024-04-01T19:56:58.163 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.163 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97672061:::benchmark_data_smithi188_161190_object118480:head# 2024-04-01T19:56:58.163 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.163 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9768b12d:::benchmark_data_smithi188_161190_object80655:head# 2024-04-01T19:56:58.163 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.163 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9769fb24:::benchmark_data_smithi188_161190_object127182:head# 2024-04-01T19:56:58.163 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.163 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9769fb31:::benchmark_data_smithi188_161190_object106023:head# 2024-04-01T19:56:58.163 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.164 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:976b5192:::benchmark_data_smithi188_161190_object133395:head# 2024-04-01T19:56:58.164 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.164 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:976b739a:::benchmark_data_smithi188_161190_object88874:head# 2024-04-01T19:56:58.164 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.164 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:976cc0e7:::benchmark_data_smithi188_161190_object118670:head# 2024-04-01T19:56:58.164 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.164 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:976db24a:::benchmark_data_smithi188_161190_object102286:head# 2024-04-01T19:56:58.164 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.164 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:976de27b:::benchmark_data_smithi188_161190_object48865:head# 2024-04-01T19:56:58.164 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.164 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:976e1334:::benchmark_data_smithi188_161190_object88347:head# 2024-04-01T19:56:58.164 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.165 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:976fb2ef:::benchmark_data_smithi188_161190_object103751:head# 2024-04-01T19:56:58.165 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.169 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97702277:::benchmark_data_smithi188_161190_object136754:head# 2024-04-01T19:56:58.170 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.176 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9770782b:::benchmark_data_smithi188_161190_object27946:head# 2024-04-01T19:56:58.176 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.176 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97713171:::benchmark_data_smithi188_161190_object67955:head# 2024-04-01T19:56:58.177 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.177 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9773960e:::benchmark_data_smithi188_161190_object34332:head# 2024-04-01T19:56:58.177 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.177 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9773e1ea:::benchmark_data_smithi188_161190_object89392:head# 2024-04-01T19:56:58.177 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.181 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97747f3d:::benchmark_data_smithi188_161190_object71205:head# 2024-04-01T19:56:58.181 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.182 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97766238:::benchmark_data_smithi188_161190_object34257:head# 2024-04-01T19:56:58.182 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.182 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9777e6fa:::benchmark_data_smithi188_161190_object94238:head# 2024-04-01T19:56:58.182 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.182 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9777fdb2:::benchmark_data_smithi188_161190_object106433:head# 2024-04-01T19:56:58.182 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.182 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:977818eb:::benchmark_data_smithi188_161190_object97200:head# 2024-04-01T19:56:58.182 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.182 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97793e4b:::benchmark_data_smithi188_161190_object137847:head# 2024-04-01T19:56:58.182 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.182 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:977ae881:::benchmark_data_smithi188_161190_object42859:head# 2024-04-01T19:56:58.182 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.183 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:977b4abc:::benchmark_data_smithi188_161190_object87199:head# 2024-04-01T19:56:58.183 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.183 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:977bfe7b:::benchmark_data_smithi188_161190_object116118:head# 2024-04-01T19:56:58.183 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.183 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:977c0bab:::benchmark_data_smithi188_161190_object82456:head# 2024-04-01T19:56:58.183 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.183 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:977c2482:::benchmark_data_smithi188_161190_object122559:head# 2024-04-01T19:56:58.183 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.183 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:977c6e79:::benchmark_data_smithi188_161190_object47708:head# 2024-04-01T19:56:58.183 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.183 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:977d02b1:::benchmark_data_smithi188_161190_object119709:head# 2024-04-01T19:56:58.183 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.183 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:977d191f:::benchmark_data_smithi188_161190_object42785:head# 2024-04-01T19:56:58.183 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.184 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:977d699b:::benchmark_data_smithi188_161190_object98372:head# 2024-04-01T19:56:58.184 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.184 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:977e9f04:::benchmark_data_smithi188_161190_object24369:head# 2024-04-01T19:56:58.184 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.184 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:977ef5b6:::benchmark_data_smithi188_161190_object81582:head# 2024-04-01T19:56:58.184 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.185 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:977f4f95:::benchmark_data_smithi188_161190_object134271:head# 2024-04-01T19:56:58.185 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.185 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:977f5c80:::benchmark_data_smithi188_161190_object39695:head# 2024-04-01T19:56:58.185 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.185 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:977f7431:::benchmark_data_smithi188_161190_object48912:head# 2024-04-01T19:56:58.185 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.185 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9780226b:::benchmark_data_smithi188_161190_object51900:head# 2024-04-01T19:56:58.185 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.186 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9780c3d2:::benchmark_data_smithi188_161190_object110447:head# 2024-04-01T19:56:58.186 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.186 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97818689:::benchmark_data_smithi188_161190_object68202:head# 2024-04-01T19:56:58.186 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.187 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9781d40e:::benchmark_data_smithi188_161190_object121777:head# 2024-04-01T19:56:58.187 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.188 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97823ae4:::benchmark_data_smithi188_161190_object125188:head# 2024-04-01T19:56:58.188 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.188 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97839e91:::benchmark_data_smithi188_161190_object87030:head# 2024-04-01T19:56:58.188 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.188 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9783b454:::benchmark_data_smithi188_161190_object95823:head# 2024-04-01T19:56:58.188 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.190 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:978440e0:::benchmark_data_smithi188_161190_object126694:head# 2024-04-01T19:56:58.190 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.190 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9784a8bf:::benchmark_data_smithi188_161190_object76236:head# 2024-04-01T19:56:58.190 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.190 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97856fe9:::benchmark_data_smithi188_161190_object114169:head# 2024-04-01T19:56:58.190 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.190 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:978684be:::benchmark_data_smithi188_161190_object35145:head# 2024-04-01T19:56:58.191 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.191 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9786caf8:::benchmark_data_smithi188_161190_object62248:head# 2024-04-01T19:56:58.191 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.191 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97871712:::benchmark_data_smithi188_161190_object47617:head# 2024-04-01T19:56:58.191 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.191 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9788242c:::benchmark_data_smithi188_161190_object40957:head# 2024-04-01T19:56:58.191 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.191 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9788aa68:::benchmark_data_smithi188_161190_object111204:head# 2024-04-01T19:56:58.191 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.191 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:978917cd:::benchmark_data_smithi188_161190_object60554:head# 2024-04-01T19:56:58.191 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.193 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:978998a0:::benchmark_data_smithi188_161190_object86966:head# 2024-04-01T19:56:58.193 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.193 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:978a9ce0:::benchmark_data_smithi188_161190_object102247:head# 2024-04-01T19:56:58.193 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.193 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:978acdf3:::benchmark_data_smithi188_161190_object127921:head# 2024-04-01T19:56:58.194 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.194 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:978c2ea7:::benchmark_data_smithi188_161190_object35773:head# 2024-04-01T19:56:58.194 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.194 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:978c4bbc:::benchmark_data_smithi188_161190_object127446:head# 2024-04-01T19:56:58.194 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.194 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:978d33e8:::benchmark_data_smithi188_161190_object127641:head# 2024-04-01T19:56:58.194 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.194 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:978e716b:::benchmark_data_smithi188_161190_object104838:head# 2024-04-01T19:56:58.194 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.194 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:978ea0ab:::benchmark_data_smithi188_161190_object26019:head# 2024-04-01T19:56:58.194 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.194 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:978faa5f:::benchmark_data_smithi188_161190_object102023:head# 2024-04-01T19:56:58.194 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.194 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97903762:::benchmark_data_smithi188_161190_object100656:head# 2024-04-01T19:56:58.195 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.195 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97907c9b:::benchmark_data_smithi188_161190_object111096:head# 2024-04-01T19:56:58.195 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.195 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:979162ca:::benchmark_data_smithi188_161190_object89065:head# 2024-04-01T19:56:58.195 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.197 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9791aeca:::benchmark_data_smithi188_161190_object27024:head# 2024-04-01T19:56:58.198 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.198 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:979207a7:::benchmark_data_smithi188_161190_object27648:head# 2024-04-01T19:56:58.198 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.198 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9792f1dd:::benchmark_data_smithi188_161190_object89310:head# 2024-04-01T19:56:58.198 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.198 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9793afcc:::benchmark_data_smithi188_161190_object62233:head# 2024-04-01T19:56:58.198 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.198 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9793dec9:::benchmark_data_smithi188_161190_object129216:head# 2024-04-01T19:56:58.198 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.198 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97940f4b:::benchmark_data_smithi188_161190_object30546:head# 2024-04-01T19:56:58.198 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.198 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9794685a:::benchmark_data_smithi188_161190_object23860:head# 2024-04-01T19:56:58.198 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.199 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:979539cb:::benchmark_data_smithi188_161190_object22769:head# 2024-04-01T19:56:58.199 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.199 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97970298:::benchmark_data_smithi188_161190_object112346:head# 2024-04-01T19:56:58.199 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.199 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9797742a:::benchmark_data_smithi188_161190_object134052:head# 2024-04-01T19:56:58.199 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.199 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97980190:::benchmark_data_smithi188_161190_object26321:head# 2024-04-01T19:56:58.199 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.199 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:979a5c33:::benchmark_data_smithi188_161190_object56083:head# 2024-04-01T19:56:58.199 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.199 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:979c0ad6:::benchmark_data_smithi188_161190_object81317:head# 2024-04-01T19:56:58.200 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.200 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:979c937e:::benchmark_data_smithi188_161190_object61413:head# 2024-04-01T19:56:58.200 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.200 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:979cf0ee:::benchmark_data_smithi188_161190_object28711:head# 2024-04-01T19:56:58.200 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.200 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:979d2a57:::benchmark_data_smithi188_161190_object86416:head# 2024-04-01T19:56:58.200 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.200 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:979d6788:::benchmark_data_smithi188_161190_object20364:head# 2024-04-01T19:56:58.200 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.200 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:979dbd7d:::benchmark_data_smithi188_161190_object124564:head# 2024-04-01T19:56:58.201 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.203 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:979e6de8:::benchmark_data_smithi188_161190_object61374:head# 2024-04-01T19:56:58.203 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.203 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:979f280b:::benchmark_data_smithi188_161190_object105091:head# 2024-04-01T19:56:58.203 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:979f5237:::benchmark_data_smithi188_161190_object103082:head# 2024-04-01T19:56:58.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:979f5aa1:::benchmark_data_smithi188_161190_object61236:head# 2024-04-01T19:56:58.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97a09a57:::benchmark_data_smithi188_161190_object112450:head# 2024-04-01T19:56:58.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97a0d462:::benchmark_data_smithi188_161190_object115509:head# 2024-04-01T19:56:58.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97a15814:::benchmark_data_smithi188_161190_object63752:head# 2024-04-01T19:56:58.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97a15ec3:::benchmark_data_smithi188_161190_object67791:head# 2024-04-01T19:56:58.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97a201f4:::benchmark_data_smithi188_161190_object111352:head# 2024-04-01T19:56:58.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97a39775:::benchmark_data_smithi188_161190_object126408:head# 2024-04-01T19:56:58.205 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.205 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97a50b4f:::benchmark_data_smithi188_161190_object30362:head# 2024-04-01T19:56:58.205 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.205 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97a56c56:::benchmark_data_smithi188_161190_object124385:head# 2024-04-01T19:56:58.205 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.205 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97a58871:::benchmark_data_smithi188_161190_object89794:head# 2024-04-01T19:56:58.205 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.205 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97a593e1:::benchmark_data_smithi188_161190_object65679:head# 2024-04-01T19:56:58.205 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.205 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97a5f6a2:::benchmark_data_smithi188_161190_object27279:head# 2024-04-01T19:56:58.205 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.205 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97a63f65:::benchmark_data_smithi188_161190_object53745:head# 2024-04-01T19:56:58.205 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.205 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97a752e4:::benchmark_data_smithi188_161190_object68364:head# 2024-04-01T19:56:58.205 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.205 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97a78bb2:::benchmark_data_smithi188_161190_object59420:head# 2024-04-01T19:56:58.206 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.206 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97a7c35d:::benchmark_data_smithi188_161190_object34381:head# 2024-04-01T19:56:58.206 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.208 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97a7cea6:::benchmark_data_smithi188_161190_object109083:head# 2024-04-01T19:56:58.208 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.208 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97a82e5f:::benchmark_data_smithi188_161190_object88487:head# 2024-04-01T19:56:58.208 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.208 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97a8edda:::benchmark_data_smithi188_161190_object123719:head# 2024-04-01T19:56:58.208 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.208 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97a9c1e1:::benchmark_data_smithi188_161190_object100735:head# 2024-04-01T19:56:58.208 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.208 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97ab2ea8:::benchmark_data_smithi188_161190_object53615:head# 2024-04-01T19:56:58.208 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.208 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97ab8b27:::benchmark_data_smithi188_161190_object59234:head# 2024-04-01T19:56:58.208 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.209 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97ac572c:::benchmark_data_smithi188_161190_object67624:head# 2024-04-01T19:56:58.209 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.209 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97acc64d:::benchmark_data_smithi188_161190_object124175:head# 2024-04-01T19:56:58.209 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.209 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97ade612:::benchmark_data_smithi188_161190_object45313:head# 2024-04-01T19:56:58.209 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.209 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97ae3914:::benchmark_data_smithi188_161190_object66420:head# 2024-04-01T19:56:58.209 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.209 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97ae90e4:::benchmark_data_smithi188_161190_object84861:head# 2024-04-01T19:56:58.209 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.209 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97aed1f0:::benchmark_data_smithi188_161190_object71879:head# 2024-04-01T19:56:58.209 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.209 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97aefaed:::benchmark_data_smithi188_161190_object119003:head# 2024-04-01T19:56:58.210 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.210 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97af5def:::benchmark_data_smithi188_161190_object102971:head# 2024-04-01T19:56:58.210 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.210 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97afcba5:::benchmark_data_smithi188_161190_object45634:head# 2024-04-01T19:56:58.210 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.210 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97b24626:::benchmark_data_smithi188_161190_object74072:head# 2024-04-01T19:56:58.210 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.210 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97b37394:::benchmark_data_smithi188_161190_object52515:head# 2024-04-01T19:56:58.210 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.210 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97b38e99:::benchmark_data_smithi188_161190_object64721:head# 2024-04-01T19:56:58.210 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.211 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97b3ced6:::benchmark_data_smithi188_161190_object74724:head# 2024-04-01T19:56:58.211 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.212 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97b41fc5:::benchmark_data_smithi188_161190_object94167:head# 2024-04-01T19:56:58.212 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.212 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97b4f310:::benchmark_data_smithi188_161190_object52474:head# 2024-04-01T19:56:58.212 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.212 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97b6a3a5:::benchmark_data_smithi188_161190_object39906:head# 2024-04-01T19:56:58.212 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.212 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97b76573:::benchmark_data_smithi188_161190_object57854:head# 2024-04-01T19:56:58.212 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.212 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97b9e2e2:::benchmark_data_smithi188_161190_object41229:head# 2024-04-01T19:56:58.212 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.212 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97ba4834:::benchmark_data_smithi188_161190_object78209:head# 2024-04-01T19:56:58.213 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.220 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97bb2f7e:::benchmark_data_smithi188_161190_object28912:head# 2024-04-01T19:56:58.221 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.221 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97bbef9a:::benchmark_data_smithi188_161190_object111731:head# 2024-04-01T19:56:58.221 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.221 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97bc1e64:::benchmark_data_smithi188_161190_object116914:head# 2024-04-01T19:56:58.221 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.221 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97bc4e6a:::benchmark_data_smithi188_161190_object64719:head# 2024-04-01T19:56:58.221 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.221 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97bcfab2:::benchmark_data_smithi188_161190_object112937:head# 2024-04-01T19:56:58.221 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.221 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97bd3c0a:::benchmark_data_smithi188_161190_object107141:head# 2024-04-01T19:56:58.221 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.221 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97be09b0:::benchmark_data_smithi188_161190_object117460:head# 2024-04-01T19:56:58.221 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.221 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97be722c:::benchmark_data_smithi188_161190_object109011:head# 2024-04-01T19:56:58.222 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.222 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97be7987:::benchmark_data_smithi188_161190_object97086:head# 2024-04-01T19:56:58.222 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.222 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97becff0:::benchmark_data_smithi188_161190_object30462:head# 2024-04-01T19:56:58.222 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.222 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97bfa4e3:::benchmark_data_smithi188_161190_object25219:head# 2024-04-01T19:56:58.222 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.222 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97bfd6cb:::benchmark_data_smithi188_161190_object114295:head# 2024-04-01T19:56:58.222 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.222 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97c0d499:::benchmark_data_smithi188_161190_object27924:head# 2024-04-01T19:56:58.222 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.222 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97c0d89c:::benchmark_data_smithi188_161190_object105759:head# 2024-04-01T19:56:58.222 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.223 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97c1b7e8:::benchmark_data_smithi188_161190_object104498:head# 2024-04-01T19:56:58.223 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.223 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97c22698:::benchmark_data_smithi188_161190_object93226:head# 2024-04-01T19:56:58.223 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.223 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97c2de00:::benchmark_data_smithi188_161190_object63433:head# 2024-04-01T19:56:58.223 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.223 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97c3079c:::benchmark_data_smithi188_161190_object106666:head# 2024-04-01T19:56:58.223 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.223 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97c44e15:::benchmark_data_smithi188_161190_object60046:head# 2024-04-01T19:56:58.223 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.223 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97c450c0:::benchmark_data_smithi188_161190_object57767:head# 2024-04-01T19:56:58.223 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.223 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97c5524e:::benchmark_data_smithi188_161190_object36970:head# 2024-04-01T19:56:58.224 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.224 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97c5985d:::benchmark_data_smithi188_161190_object117423:head# 2024-04-01T19:56:58.224 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.224 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97c5ceb1:::benchmark_data_smithi188_161190_object79550:head# 2024-04-01T19:56:58.224 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.224 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97c608cb:::benchmark_data_smithi188_161190_object94773:head# 2024-04-01T19:56:58.224 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.224 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97c7ad4e:::benchmark_data_smithi188_161190_object62411:head# 2024-04-01T19:56:58.224 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.224 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97c8f488:::benchmark_data_smithi188_161190_object35664:head# 2024-04-01T19:56:58.224 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.224 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97c963ce:::benchmark_data_smithi188_161190_object86519:head# 2024-04-01T19:56:58.225 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.225 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97c9d4b1:::benchmark_data_smithi188_161190_object49394:head# 2024-04-01T19:56:58.225 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.225 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97cab564:::benchmark_data_smithi188_161190_object21092:head# 2024-04-01T19:56:58.225 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.225 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97cc3c2e:::benchmark_data_smithi188_161190_object133037:head# 2024-04-01T19:56:58.225 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.225 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97cc414f:::benchmark_data_smithi188_161190_object52709:head# 2024-04-01T19:56:58.225 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.226 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97cd670b:::benchmark_data_smithi188_161190_object109717:head# 2024-04-01T19:56:58.226 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.226 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97cd926b:::benchmark_data_smithi188_161190_object79037:head# 2024-04-01T19:56:58.226 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.226 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97ce164d:::benchmark_data_smithi188_161190_object54989:head# 2024-04-01T19:56:58.226 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.226 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97ceec56:::benchmark_data_smithi188_161190_object57061:head# 2024-04-01T19:56:58.227 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.227 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97cf5148:::benchmark_data_smithi188_161190_object20886:head# 2024-04-01T19:56:58.227 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.230 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97cf8668:::benchmark_data_smithi188_161190_object94508:head# 2024-04-01T19:56:58.230 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.230 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97d0834e:::benchmark_data_smithi188_161190_object94772:head# 2024-04-01T19:56:58.231 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.231 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97d0b80e:::benchmark_data_smithi188_161190_object126255:head# 2024-04-01T19:56:58.231 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.231 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97d0d247:::benchmark_data_smithi188_161190_object106247:head# 2024-04-01T19:56:58.231 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.231 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97d1022f:::benchmark_data_smithi188_161190_object100244:head# 2024-04-01T19:56:58.231 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.234 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97d123a3:::benchmark_data_smithi188_161190_object115367:head# 2024-04-01T19:56:58.234 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.234 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97d2131e:::benchmark_data_smithi188_161190_object75135:head# 2024-04-01T19:56:58.234 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.234 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97d24f04:::benchmark_data_smithi188_161190_object121263:head# 2024-04-01T19:56:58.234 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.235 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97d271ae:::benchmark_data_smithi188_161190_object103514:head# 2024-04-01T19:56:58.235 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.235 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97d31644:::benchmark_data_smithi188_161190_object41214:head# 2024-04-01T19:56:58.235 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.235 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97d31fb0:::benchmark_data_smithi188_161190_object111069:head# 2024-04-01T19:56:58.235 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.235 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97d4076a:::benchmark_data_smithi188_161190_object111643:head# 2024-04-01T19:56:58.235 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.235 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97d502d5:::benchmark_data_smithi188_161190_object58538:head# 2024-04-01T19:56:58.235 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.235 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97d5f0ad:::benchmark_data_smithi188_161190_object96776:head# 2024-04-01T19:56:58.235 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.235 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97d6d2ab:::benchmark_data_smithi188_161190_object99474:head# 2024-04-01T19:56:58.236 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.236 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97d70c30:::benchmark_data_smithi188_161190_object50692:head# 2024-04-01T19:56:58.236 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.236 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97d7514f:::benchmark_data_smithi188_161190_object70521:head# 2024-04-01T19:56:58.236 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.237 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97d76fff:::benchmark_data_smithi188_161190_object100023:head# 2024-04-01T19:56:58.237 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.237 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97d83f70:::benchmark_data_smithi188_161190_object137038:head# 2024-04-01T19:56:58.237 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.237 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97d94e9a:::benchmark_data_smithi188_161190_object113358:head# 2024-04-01T19:56:58.238 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.238 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97d97bdb:::benchmark_data_smithi188_161190_object120533:head# 2024-04-01T19:56:58.238 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.238 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97db2113:::benchmark_data_smithi188_161190_object83262:head# 2024-04-01T19:56:58.238 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.238 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97db538b:::benchmark_data_smithi188_161190_object108204:head# 2024-04-01T19:56:58.238 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.238 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97db6ca7:::benchmark_data_smithi188_161190_object122626:head# 2024-04-01T19:56:58.238 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.238 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97dbc2b2:::benchmark_data_smithi188_161190_object113663:head# 2024-04-01T19:56:58.238 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.241 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97dc78ed:::benchmark_data_smithi188_161190_object90244:head# 2024-04-01T19:56:58.241 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.241 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97dc84fa:::benchmark_data_smithi188_161190_object66087:head# 2024-04-01T19:56:58.241 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.241 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97dcb403:::benchmark_data_smithi188_161190_object55569:head# 2024-04-01T19:56:58.241 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.241 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97dd2258:::benchmark_data_smithi188_161190_object78718:head# 2024-04-01T19:56:58.241 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.241 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97dd296f:::benchmark_data_smithi188_161190_object111684:head# 2024-04-01T19:56:58.242 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.242 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97dda192:::benchmark_data_smithi188_161190_object71451:head# 2024-04-01T19:56:58.242 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.242 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97de8aea:::benchmark_data_smithi188_161190_object70876:head# 2024-04-01T19:56:58.242 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.242 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97decdef:::benchmark_data_smithi188_161190_object121379:head# 2024-04-01T19:56:58.242 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.242 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97dee277:::benchmark_data_smithi188_161190_object88483:head# 2024-04-01T19:56:58.242 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.242 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97df1aa4:::benchmark_data_smithi188_161190_object135593:head# 2024-04-01T19:56:58.242 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.242 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97df6c60:::benchmark_data_smithi188_161190_object100890:head# 2024-04-01T19:56:58.242 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.243 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97dfae74:::benchmark_data_smithi188_161190_object91875:head# 2024-04-01T19:56:58.243 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.243 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97e0bbf1:::benchmark_data_smithi188_161190_object60122:head# 2024-04-01T19:56:58.243 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.244 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97e0cbb7:::benchmark_data_smithi188_161190_object44960:head# 2024-04-01T19:56:58.244 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.245 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97e16bdc:::benchmark_data_smithi188_161190_object20135:head# 2024-04-01T19:56:58.245 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.245 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97e301fd:::benchmark_data_smithi188_161190_object28751:head# 2024-04-01T19:56:58.245 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.245 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97e34b3e:::benchmark_data_smithi188_161190_object47171:head# 2024-04-01T19:56:58.245 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.245 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97e3ac22:::benchmark_data_smithi188_161190_object46337:head# 2024-04-01T19:56:58.245 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.245 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97e3d81d:::benchmark_data_smithi188_161190_object128642:head# 2024-04-01T19:56:58.245 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.245 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97e457f3:::benchmark_data_smithi188_161190_object53140:head# 2024-04-01T19:56:58.245 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.245 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97e51eb4:::benchmark_data_smithi188_161190_object108150:head# 2024-04-01T19:56:58.245 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.246 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97e56f7b:::benchmark_data_smithi188_161190_object47362:head# 2024-04-01T19:56:58.246 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.246 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97e5d15e:::benchmark_data_smithi188_161190_object80583:head# 2024-04-01T19:56:58.246 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.246 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97e702b6:::benchmark_data_smithi188_161190_object110319:head# 2024-04-01T19:56:58.246 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.247 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97e731c2:::benchmark_data_smithi188_161190_object127951:head# 2024-04-01T19:56:58.247 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.247 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97e797b1:::benchmark_data_smithi188_161190_object112032:head# 2024-04-01T19:56:58.247 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.247 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97e7ec39:::benchmark_data_smithi188_161190_object64862:head# 2024-04-01T19:56:58.247 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.247 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97e8b625:::benchmark_data_smithi188_161190_object70852:head# 2024-04-01T19:56:58.247 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.247 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97e9e038:::benchmark_data_smithi188_161190_object121927:head# 2024-04-01T19:56:58.247 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.248 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97eb5c5b:::benchmark_data_smithi188_161190_object98770:head# 2024-04-01T19:56:58.248 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.253 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97ebb977:::benchmark_data_smithi188_161190_object53826:head# 2024-04-01T19:56:58.253 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.253 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97ec7bb1:::benchmark_data_smithi188_161190_object125574:head# 2024-04-01T19:56:58.253 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.254 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97eca578:::benchmark_data_smithi188_161190_object26639:head# 2024-04-01T19:56:58.254 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.255 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97ed569f:::benchmark_data_smithi188_161190_object126409:head# 2024-04-01T19:56:58.255 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.255 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97ed7202:::benchmark_data_smithi188_161190_object129394:head# 2024-04-01T19:56:58.255 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.255 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97ed7f1a:::benchmark_data_smithi188_161190_object130953:head# 2024-04-01T19:56:58.255 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.256 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97ed8c10:::benchmark_data_smithi188_161190_object71753:head# 2024-04-01T19:56:58.256 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.256 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97ee6e72:::benchmark_data_smithi188_161190_object19748:head# 2024-04-01T19:56:58.256 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.257 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97eec621:::benchmark_data_smithi188_161190_object137328:head# 2024-04-01T19:56:58.257 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.257 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97eef225:::benchmark_data_smithi188_161190_object131068:head# 2024-04-01T19:56:58.257 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.257 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97ef9707:::benchmark_data_smithi188_161190_object86358:head# 2024-04-01T19:56:58.257 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.258 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97efbc7a:::benchmark_data_smithi188_161190_object89993:head# 2024-04-01T19:56:58.258 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.258 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97f069a9:::benchmark_data_smithi188_161190_object99683:head# 2024-04-01T19:56:58.258 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.258 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97f070aa:::benchmark_data_smithi188_161190_object91123:head# 2024-04-01T19:56:58.258 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.258 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97f147fc:::benchmark_data_smithi188_161190_object118439:head# 2024-04-01T19:56:58.258 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.258 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97f1ad16:::benchmark_data_smithi188_161190_object65202:head# 2024-04-01T19:56:58.258 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.263 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97f228e5:::benchmark_data_smithi188_161190_object131776:head# 2024-04-01T19:56:58.263 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.270 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97f2331e:::benchmark_data_smithi188_161190_object78793:head# 2024-04-01T19:56:58.270 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.270 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97f32877:::benchmark_data_smithi188_161190_object25225:head# 2024-04-01T19:56:58.271 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.271 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97f33af6:::benchmark_data_smithi188_161190_object115384:head# 2024-04-01T19:56:58.271 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.271 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97f3ecca:::benchmark_data_smithi188_161190_object133484:head# 2024-04-01T19:56:58.271 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.271 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97f40724:::benchmark_data_smithi188_161190_object93124:head# 2024-04-01T19:56:58.271 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.272 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97f43169:::benchmark_data_smithi188_161190_object49610:head# 2024-04-01T19:56:58.273 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.273 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97f65248:::benchmark_data_smithi188_161190_object53187:head# 2024-04-01T19:56:58.273 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.273 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97f712f4:::benchmark_data_smithi188_161190_object137330:head# 2024-04-01T19:56:58.273 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.274 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97f76a86:::benchmark_data_smithi188_161190_object73134:head# 2024-04-01T19:56:58.274 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.282 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97f78252:::benchmark_data_smithi188_161190_object53451:head# 2024-04-01T19:56:58.283 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.283 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97f82bee:::benchmark_data_smithi188_161190_object108173:head# 2024-04-01T19:56:58.283 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.283 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97f83bd1:::benchmark_data_smithi188_161190_object126530:head# 2024-04-01T19:56:58.283 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.283 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97f84298:::benchmark_data_smithi188_161190_object131155:head# 2024-04-01T19:56:58.283 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.283 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97f861ec:::benchmark_data_smithi188_161190_object116289:head# 2024-04-01T19:56:58.283 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.283 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97f86468:::benchmark_data_smithi188_161190_object49221:head# 2024-04-01T19:56:58.283 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.283 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97f87451:::benchmark_data_smithi188_161190_object126050:head# 2024-04-01T19:56:58.283 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.284 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97f9ca91:::benchmark_data_smithi188_161190_object80876:head# 2024-04-01T19:56:58.284 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.284 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97f9ef4a:::benchmark_data_smithi188_161190_object86042:head# 2024-04-01T19:56:58.284 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.284 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97f9ef76:::benchmark_data_smithi188_161190_object53661:head# 2024-04-01T19:56:58.284 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.284 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97fa63a7:::benchmark_data_smithi188_161190_object108784:head# 2024-04-01T19:56:58.284 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.284 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97fb57c0:::benchmark_data_smithi188_161190_object41176:head# 2024-04-01T19:56:58.284 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.285 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97fb97ab:::benchmark_data_smithi188_161190_object24678:head# 2024-04-01T19:56:58.285 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.285 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:97ff9a5d:::benchmark_data_smithi188_161190_object99978:head# 2024-04-01T19:56:58.285 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.285 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:980062c4:::benchmark_data_smithi188_161190_object132815:head# 2024-04-01T19:56:58.285 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.286 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9800978c:::benchmark_data_smithi188_161190_object79923:head# 2024-04-01T19:56:58.286 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.286 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98014c57:::benchmark_data_smithi188_161190_object103576:head# 2024-04-01T19:56:58.286 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.286 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9801ae45:::benchmark_data_smithi188_161190_object52124:head# 2024-04-01T19:56:58.286 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.287 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:980205af:::benchmark_data_smithi188_161190_object101897:head# 2024-04-01T19:56:58.287 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.287 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:980298cb:::benchmark_data_smithi188_161190_object94121:head# 2024-04-01T19:56:58.287 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.287 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98030476:::benchmark_data_smithi188_161190_object95050:head# 2024-04-01T19:56:58.287 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.287 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98038910:::benchmark_data_smithi188_161190_object68672:head# 2024-04-01T19:56:58.287 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.287 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9804e90b:::benchmark_data_smithi188_161190_object35498:head# 2024-04-01T19:56:58.287 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.287 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9804edd5:::benchmark_data_smithi188_161190_object95535:head# 2024-04-01T19:56:58.287 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.288 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98059c2f:::benchmark_data_smithi188_161190_object21596:head# 2024-04-01T19:56:58.289 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.289 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9805d9a3:::benchmark_data_smithi188_161190_object58053:head# 2024-04-01T19:56:58.289 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.289 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9805dd6f:::benchmark_data_smithi188_161190_object41073:head# 2024-04-01T19:56:58.289 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.289 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9805e271:::benchmark_data_smithi188_161190_object47516:head# 2024-04-01T19:56:58.289 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.289 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98060db2:::benchmark_data_smithi188_161190_object85987:head# 2024-04-01T19:56:58.289 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.289 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9806267f:::benchmark_data_smithi188_161190_object97630:head# 2024-04-01T19:56:58.289 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.290 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9807961e:::benchmark_data_smithi188_161190_object131927:head# 2024-04-01T19:56:58.290 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.290 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9808f426:::benchmark_data_smithi188_161190_object110763:head# 2024-04-01T19:56:58.291 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.291 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9808f5ff:::benchmark_data_smithi188_161190_object64613:head# 2024-04-01T19:56:58.291 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.291 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98095181:::benchmark_data_smithi188_161190_object95825:head# 2024-04-01T19:56:58.291 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.291 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:980a2b5f:::benchmark_data_smithi188_161190_object119334:head# 2024-04-01T19:56:58.291 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.291 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:980bd22d:::benchmark_data_smithi188_161190_object30305:head# 2024-04-01T19:56:58.291 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.292 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:980bdee7:::benchmark_data_smithi188_161190_object132343:head# 2024-04-01T19:56:58.292 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.292 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:980ca419:::benchmark_data_smithi188_161190_object46000:head# 2024-04-01T19:56:58.292 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.292 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:980d54bf:::benchmark_data_smithi188_161190_object107927:head# 2024-04-01T19:56:58.292 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.295 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:980d82ca:::benchmark_data_smithi188_161190_object24713:head# 2024-04-01T19:56:58.295 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.296 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:980d9ee6:::benchmark_data_smithi188_161190_object57401:head# 2024-04-01T19:56:58.296 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.298 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:980e7566:::benchmark_data_smithi188_161190_object36854:head# 2024-04-01T19:56:58.298 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.303 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:980fcc55:::benchmark_data_smithi188_161190_object108488:head# 2024-04-01T19:56:58.303 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.303 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98101100:::benchmark_data_smithi188_161190_object70617:head# 2024-04-01T19:56:58.303 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.303 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9811b8e1:::benchmark_data_smithi188_161190_object77427:head# 2024-04-01T19:56:58.303 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.303 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9811f805:::benchmark_data_smithi188_161190_object59571:head# 2024-04-01T19:56:58.303 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.303 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98124071:::benchmark_data_smithi188_161190_object70104:head# 2024-04-01T19:56:58.303 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.303 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98128a39:::benchmark_data_smithi188_161190_object43251:head# 2024-04-01T19:56:58.303 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.303 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9812a4df:::benchmark_data_smithi188_161190_object126778:head# 2024-04-01T19:56:58.304 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.304 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:981395ce:::benchmark_data_smithi188_161190_object65266:head# 2024-04-01T19:56:58.304 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.304 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9813d2a5:::benchmark_data_smithi188_161190_object81227:head# 2024-04-01T19:56:58.304 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.304 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:981410d3:::benchmark_data_smithi188_161190_object30950:head# 2024-04-01T19:56:58.304 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.304 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9814e4b3:::benchmark_data_smithi188_161190_object88726:head# 2024-04-01T19:56:58.304 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.304 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9815148b:::benchmark_data_smithi188_161190_object115714:head# 2024-04-01T19:56:58.304 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.304 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9815c31c:::benchmark_data_smithi188_161190_object37638:head# 2024-04-01T19:56:58.304 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.304 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9815c8ca:::benchmark_data_smithi188_161190_object40389:head# 2024-04-01T19:56:58.305 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.305 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9815f26a:::benchmark_data_smithi188_161190_object21346:head# 2024-04-01T19:56:58.305 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.305 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:981622c1:::benchmark_data_smithi188_161190_object31842:head# 2024-04-01T19:56:58.305 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.305 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98168d32:::benchmark_data_smithi188_161190_object61411:head# 2024-04-01T19:56:58.305 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.308 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9817148e:::benchmark_data_smithi188_161190_object97122:head# 2024-04-01T19:56:58.308 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.308 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98179334:::benchmark_data_smithi188_161190_object73341:head# 2024-04-01T19:56:58.308 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.308 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9817b2cc:::benchmark_data_smithi188_161190_object132574:head# 2024-04-01T19:56:58.308 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.308 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:981852e3:::benchmark_data_smithi188_161190_object37143:head# 2024-04-01T19:56:58.308 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.309 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98198739:::benchmark_data_smithi188_161190_object54452:head# 2024-04-01T19:56:58.309 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.309 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98199060:::benchmark_data_smithi188_161190_object123789:head# 2024-04-01T19:56:58.309 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.309 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9819967d:::benchmark_data_smithi188_161190_object46223:head# 2024-04-01T19:56:58.309 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.309 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9819c260:::benchmark_data_smithi188_161190_object28020:head# 2024-04-01T19:56:58.309 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.313 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:981a2dc9:::benchmark_data_smithi188_161190_object101880:head# 2024-04-01T19:56:58.313 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.313 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:981a39ed:::benchmark_data_smithi188_161190_object42202:head# 2024-04-01T19:56:58.313 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.313 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:981bb8d6:::benchmark_data_smithi188_161190_object80198:head# 2024-04-01T19:56:58.313 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.313 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:981c2fca:::benchmark_data_smithi188_161190_object62138:head# 2024-04-01T19:56:58.313 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.313 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:981c82ce:::benchmark_data_smithi188_161190_object97816:head# 2024-04-01T19:56:58.313 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.313 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:981d1861:::benchmark_data_smithi188_161190_object91160:head# 2024-04-01T19:56:58.313 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.314 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:981d203f:::benchmark_data_smithi188_161190_object120620:head# 2024-04-01T19:56:58.314 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.314 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:981e227d:::benchmark_data_smithi188_161190_object28654:head# 2024-04-01T19:56:58.314 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.314 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:981f4ae2:::benchmark_data_smithi188_161190_object33263:head# 2024-04-01T19:56:58.314 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.314 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:981f5d6e:::benchmark_data_smithi188_161190_object30649:head# 2024-04-01T19:56:58.314 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.314 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:981f78d7:::benchmark_data_smithi188_161190_object136405:head# 2024-04-01T19:56:58.314 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.315 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98208c35:::benchmark_data_smithi188_161190_object32577:head# 2024-04-01T19:56:58.316 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.316 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9820a021:::benchmark_data_smithi188_161190_object82126:head# 2024-04-01T19:56:58.316 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.316 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:982107a4:::benchmark_data_smithi188_161190_object59901:head# 2024-04-01T19:56:58.316 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.316 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9821d5b0:::benchmark_data_smithi188_161190_object46670:head# 2024-04-01T19:56:58.316 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.316 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9821f202:::benchmark_data_smithi188_161190_object100976:head# 2024-04-01T19:56:58.316 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.316 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98221007:::benchmark_data_smithi188_161190_object106226:head# 2024-04-01T19:56:58.316 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.316 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98222fd0:::benchmark_data_smithi188_161190_object80483:head# 2024-04-01T19:56:58.316 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.317 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9822746e:::benchmark_data_smithi188_161190_object114408:head# 2024-04-01T19:56:58.317 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.317 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98233a78:::benchmark_data_smithi188_161190_object134168:head# 2024-04-01T19:56:58.317 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.320 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9823c756:::benchmark_data_smithi188_161190_object61520:head# 2024-04-01T19:56:58.320 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.322 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:982461b5:::benchmark_data_smithi188_161190_object125176:head# 2024-04-01T19:56:58.322 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.323 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9824e05a:::benchmark_data_smithi188_161190_object82393:head# 2024-04-01T19:56:58.323 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.323 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98254d80:::benchmark_data_smithi188_161190_object32427:head# 2024-04-01T19:56:58.323 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.325 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:982552d1:::benchmark_data_smithi188_161190_object115175:head# 2024-04-01T19:56:58.325 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.325 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98255f62:::benchmark_data_smithi188_161190_object118408:head# 2024-04-01T19:56:58.326 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.326 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98259ffe:::benchmark_data_smithi188_161190_object26408:head# 2024-04-01T19:56:58.326 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.326 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98263b19:::benchmark_data_smithi188_161190_object49985:head# 2024-04-01T19:56:58.326 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.326 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9826e2e2:::benchmark_data_smithi188_161190_object77951:head# 2024-04-01T19:56:58.326 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.326 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98270542:::benchmark_data_smithi188_161190_object120410:head# 2024-04-01T19:56:58.326 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.326 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:982721d4:::benchmark_data_smithi188_161190_object81859:head# 2024-04-01T19:56:58.326 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.326 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9827d70c:::benchmark_data_smithi188_161190_object66747:head# 2024-04-01T19:56:58.327 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.327 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9828eb79:::benchmark_data_smithi188_161190_object59232:head# 2024-04-01T19:56:58.327 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.327 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:982960ef:::benchmark_data_smithi188_161190_object55809:head# 2024-04-01T19:56:58.327 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.327 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98299a55:::benchmark_data_smithi188_161190_object75760:head# 2024-04-01T19:56:58.327 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.327 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9829a317:::benchmark_data_smithi188_161190_object82052:head# 2024-04-01T19:56:58.327 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.327 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9829f499:::benchmark_data_smithi188_161190_object79242:head# 2024-04-01T19:56:58.327 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.329 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:982acaac:::benchmark_data_smithi188_161190_object104087:head# 2024-04-01T19:56:58.329 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.329 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:982bfba1:::benchmark_data_smithi188_161190_object50362:head# 2024-04-01T19:56:58.330 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.330 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:982c16f4:::benchmark_data_smithi188_161190_object54658:head# 2024-04-01T19:56:58.330 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.330 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:982c3448:::benchmark_data_smithi188_161190_object57839:head# 2024-04-01T19:56:58.330 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.330 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:982c5dbd:::benchmark_data_smithi188_161190_object107270:head# 2024-04-01T19:56:58.330 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.330 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:982d9da0:::benchmark_data_smithi188_161190_object38033:head# 2024-04-01T19:56:58.330 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.330 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:982ee083:::benchmark_data_smithi188_161190_object121949:head# 2024-04-01T19:56:58.330 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.330 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:982f3938:::benchmark_data_smithi188_161190_object36337:head# 2024-04-01T19:56:58.330 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.330 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:982f749a:::benchmark_data_smithi188_161190_object78020:head# 2024-04-01T19:56:58.331 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.331 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:982f91a0:::benchmark_data_smithi188_161190_object103986:head# 2024-04-01T19:56:58.331 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.333 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98301a5a:::benchmark_data_smithi188_161190_object105961:head# 2024-04-01T19:56:58.333 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.333 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9830435c:::benchmark_data_smithi188_161190_object84136:head# 2024-04-01T19:56:58.333 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.333 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:983050c8:::benchmark_data_smithi188_161190_object61516:head# 2024-04-01T19:56:58.333 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.334 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9830602a:::benchmark_data_smithi188_161190_object93860:head# 2024-04-01T19:56:58.334 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.334 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9830fc30:::benchmark_data_smithi188_161190_object120436:head# 2024-04-01T19:56:58.334 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.334 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:983164e0:::benchmark_data_smithi188_161190_object122073:head# 2024-04-01T19:56:58.334 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.334 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98321c3d:::benchmark_data_smithi188_161190_object58461:head# 2024-04-01T19:56:58.334 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.334 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98325808:::benchmark_data_smithi188_161190_object100724:head# 2024-04-01T19:56:58.334 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.334 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:983263be:::benchmark_data_smithi188_161190_object39780:head# 2024-04-01T19:56:58.334 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.334 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98336514:::benchmark_data_smithi188_161190_object70504:head# 2024-04-01T19:56:58.335 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.335 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98337942:::benchmark_data_smithi188_161190_object127153:head# 2024-04-01T19:56:58.335 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.336 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9834a0eb:::benchmark_data_smithi188_161190_object112052:head# 2024-04-01T19:56:58.336 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.336 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98356d39:::benchmark_data_smithi188_161190_object68540:head# 2024-04-01T19:56:58.337 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.337 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9835d128:::benchmark_data_smithi188_161190_object52880:head# 2024-04-01T19:56:58.337 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.337 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:983632ed:::benchmark_data_smithi188_161190_object25604:head# 2024-04-01T19:56:58.337 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.337 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:983733fd:::benchmark_data_smithi188_161190_object120922:head# 2024-04-01T19:56:58.337 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.337 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98375773:::benchmark_data_smithi188_161190_object129258:head# 2024-04-01T19:56:58.337 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.337 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:983787a5:::benchmark_data_smithi188_161190_object131341:head# 2024-04-01T19:56:58.337 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.337 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98378e4a:::benchmark_data_smithi188_161190_object136137:head# 2024-04-01T19:56:58.337 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.338 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9837957a:::benchmark_data_smithi188_161190_object99394:head# 2024-04-01T19:56:58.338 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.338 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9837beef:::benchmark_data_smithi188_161190_object35600:head# 2024-04-01T19:56:58.338 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.338 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9837d139:::benchmark_data_smithi188_161190_object25633:head# 2024-04-01T19:56:58.338 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.339 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:983816fb:::benchmark_data_smithi188_161190_object62921:head# 2024-04-01T19:56:58.339 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.340 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:983856af:::benchmark_data_smithi188_161190_object61342:head# 2024-04-01T19:56:58.340 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.340 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9838bb53:::benchmark_data_smithi188_161190_object23184:head# 2024-04-01T19:56:58.340 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.340 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9838fbdb:::benchmark_data_smithi188_161190_object107817:head# 2024-04-01T19:56:58.340 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.340 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:983a48e1:::benchmark_data_smithi188_161190_object32766:head# 2024-04-01T19:56:58.340 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.340 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:983aeada:::benchmark_data_smithi188_161190_object42254:head# 2024-04-01T19:56:58.340 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.340 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:983aec39:::benchmark_data_smithi188_161190_object98379:head# 2024-04-01T19:56:58.340 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.340 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:983b12a9:::benchmark_data_smithi188_161190_object98593:head# 2024-04-01T19:56:58.340 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.341 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:983b5ece:::benchmark_data_smithi188_161190_object98024:head# 2024-04-01T19:56:58.341 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.341 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:983c03b4:::benchmark_data_smithi188_161190_object45492:head# 2024-04-01T19:56:58.341 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.341 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:983c8762:::benchmark_data_smithi188_161190_object67110:head# 2024-04-01T19:56:58.341 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.341 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:983cf9f5:::benchmark_data_smithi188_161190_object83394:head# 2024-04-01T19:56:58.341 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.343 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:983d10d8:::benchmark_data_smithi188_161190_object44855:head# 2024-04-01T19:56:58.343 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.343 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:983fba37:::benchmark_data_smithi188_161190_object80630:head# 2024-04-01T19:56:58.343 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.343 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:983fd517:::benchmark_data_smithi188_161190_object118424:head# 2024-04-01T19:56:58.343 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.343 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:984144f3:::benchmark_data_smithi188_161190_object63473:head# 2024-04-01T19:56:58.343 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.343 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98427785:::benchmark_data_smithi188_161190_object122718:head# 2024-04-01T19:56:58.343 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9842b082:::benchmark_data_smithi188_161190_object133831:head# 2024-04-01T19:56:58.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9842cfde:::benchmark_data_smithi188_161190_object24695:head# 2024-04-01T19:56:58.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:984306d9:::benchmark_data_smithi188_161190_object44155:head# 2024-04-01T19:56:58.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98432ba4:::benchmark_data_smithi188_161190_object77321:head# 2024-04-01T19:56:58.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:984332a4:::benchmark_data_smithi188_161190_object119832:head# 2024-04-01T19:56:58.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98435182:::benchmark_data_smithi188_161190_object82755:head# 2024-04-01T19:56:58.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9844c882:::benchmark_data_smithi188_161190_object26868:head# 2024-04-01T19:56:58.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98450b12:::benchmark_data_smithi188_161190_object107132:head# 2024-04-01T19:56:58.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98453237:::benchmark_data_smithi188_161190_object105259:head# 2024-04-01T19:56:58.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.346 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9845c139:::benchmark_data_smithi188_161190_object84415:head# 2024-04-01T19:56:58.346 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.346 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9847fdfc:::benchmark_data_smithi188_161190_object64275:head# 2024-04-01T19:56:58.346 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.346 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98485c5d:::benchmark_data_smithi188_161190_object127100:head# 2024-04-01T19:56:58.346 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.346 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:984895e6:::benchmark_data_smithi188_161190_object135538:head# 2024-04-01T19:56:58.346 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.346 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9848992d:::benchmark_data_smithi188_161190_object47116:head# 2024-04-01T19:56:58.347 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.347 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:984933f4:::benchmark_data_smithi188_161190_object121803:head# 2024-04-01T19:56:58.347 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.347 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:984983a3:::benchmark_data_smithi188_161190_object50300:head# 2024-04-01T19:56:58.347 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.347 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98498e38:::benchmark_data_smithi188_161190_object121017:head# 2024-04-01T19:56:58.347 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.349 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:984a52fd:::benchmark_data_smithi188_161190_object27021:head# 2024-04-01T19:56:58.349 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.349 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:984a6012:::benchmark_data_smithi188_161190_object106445:head# 2024-04-01T19:56:58.349 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.349 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:984a6cd0:::benchmark_data_smithi188_161190_object131357:head# 2024-04-01T19:56:58.349 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.350 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:984abdae:::benchmark_data_smithi188_161190_object124301:head# 2024-04-01T19:56:58.350 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.350 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:984ba038:::benchmark_data_smithi188_161190_object60011:head# 2024-04-01T19:56:58.350 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.350 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:984bab66:::benchmark_data_smithi188_161190_object58706:head# 2024-04-01T19:56:58.350 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.350 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:984c70c3:::benchmark_data_smithi188_161190_object136726:head# 2024-04-01T19:56:58.350 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.350 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:984cb09a:::benchmark_data_smithi188_161190_object78691:head# 2024-04-01T19:56:58.350 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.350 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:984cc952:::benchmark_data_smithi188_161190_object105796:head# 2024-04-01T19:56:58.350 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.351 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:984d0c75:::benchmark_data_smithi188_161190_object26431:head# 2024-04-01T19:56:58.351 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.351 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:984d9ad4:::benchmark_data_smithi188_161190_object67201:head# 2024-04-01T19:56:58.351 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.351 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:984e4a43:::benchmark_data_smithi188_161190_object89235:head# 2024-04-01T19:56:58.351 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.355 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:984ef3fb:::benchmark_data_smithi188_161190_object109144:head# 2024-04-01T19:56:58.355 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.355 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:984fafdd:::benchmark_data_smithi188_161190_object57235:head# 2024-04-01T19:56:58.355 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.355 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:985177a9:::benchmark_data_smithi188_161190_object94664:head# 2024-04-01T19:56:58.355 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.355 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9851a635:::benchmark_data_smithi188_161190_object127642:head# 2024-04-01T19:56:58.355 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.355 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9851e93d:::benchmark_data_smithi188_161190_object94196:head# 2024-04-01T19:56:58.355 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.356 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98526aa0:::benchmark_data_smithi188_161190_object83554:head# 2024-04-01T19:56:58.356 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.356 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9852744f:::benchmark_data_smithi188_161190_object137049:head# 2024-04-01T19:56:58.356 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.356 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:985363f1:::benchmark_data_smithi188_161190_object33189:head# 2024-04-01T19:56:58.356 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.356 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9854972e:::benchmark_data_smithi188_161190_object45999:head# 2024-04-01T19:56:58.356 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.356 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9854c5ef:::benchmark_data_smithi188_161190_object20007:head# 2024-04-01T19:56:58.356 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.356 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:985677c3:::benchmark_data_smithi188_161190_object97268:head# 2024-04-01T19:56:58.356 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.356 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9856a57b:::benchmark_data_smithi188_161190_object57379:head# 2024-04-01T19:56:58.356 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.356 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98574eff:::benchmark_data_smithi188_161190_object28326:head# 2024-04-01T19:56:58.357 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.357 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9857e3db:::benchmark_data_smithi188_161190_object22571:head# 2024-04-01T19:56:58.357 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.357 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9857ebf6:::benchmark_data_smithi188_161190_object30284:head# 2024-04-01T19:56:58.357 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.357 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9857eed8:::benchmark_data_smithi188_161190_object100358:head# 2024-04-01T19:56:58.357 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.357 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9858de74:::benchmark_data_smithi188_161190_object32442:head# 2024-04-01T19:56:58.357 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.357 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9858e4b3:::benchmark_data_smithi188_161190_object81154:head# 2024-04-01T19:56:58.357 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.357 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9859ddd6:::benchmark_data_smithi188_161190_object28199:head# 2024-04-01T19:56:58.357 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.357 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:985a14aa:::benchmark_data_smithi188_161190_object115527:head# 2024-04-01T19:56:58.358 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.358 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:985ad9b2:::benchmark_data_smithi188_161190_object100386:head# 2024-04-01T19:56:58.358 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.358 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:985cad8b:::benchmark_data_smithi188_161190_object134230:head# 2024-04-01T19:56:58.358 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.358 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:985d23d4:::benchmark_data_smithi188_161190_object80493:head# 2024-04-01T19:56:58.358 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.358 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:985d296e:::benchmark_data_smithi188_161190_object137410:head# 2024-04-01T19:56:58.358 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.359 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:985d2cb8:::benchmark_data_smithi188_161190_object37036:head# 2024-04-01T19:56:58.359 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.364 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:985d4e6b:::benchmark_data_smithi188_161190_object106192:head# 2024-04-01T19:56:58.364 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.364 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:985e4f89:::benchmark_data_smithi188_161190_object135511:head# 2024-04-01T19:56:58.365 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.365 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:985e8d1c:::benchmark_data_smithi188_161190_object56108:head# 2024-04-01T19:56:58.365 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.365 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:985e957f:::benchmark_data_smithi188_161190_object50627:head# 2024-04-01T19:56:58.365 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.365 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:985e9f2b:::benchmark_data_smithi188_161190_object30417:head# 2024-04-01T19:56:58.365 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.365 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:985ebca4:::benchmark_data_smithi188_161190_object34694:head# 2024-04-01T19:56:58.365 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.365 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:985ef6ae:::benchmark_data_smithi188_161190_object115419:head# 2024-04-01T19:56:58.365 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.365 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98621689:::benchmark_data_smithi188_161190_object100116:head# 2024-04-01T19:56:58.365 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.365 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98624f21:::benchmark_data_smithi188_161190_object139165:head# 2024-04-01T19:56:58.365 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.366 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9862ff0e:::benchmark_data_smithi188_161190_object20459:head# 2024-04-01T19:56:58.366 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.366 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9863ab2d:::benchmark_data_smithi188_161190_object131182:head# 2024-04-01T19:56:58.366 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.366 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9864af4c:::benchmark_data_smithi188_161190_object87071:head# 2024-04-01T19:56:58.366 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.366 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98651f8a:::benchmark_data_smithi188_161190_object83267:head# 2024-04-01T19:56:58.366 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.366 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9865bfde:::benchmark_data_smithi188_161190_object38304:head# 2024-04-01T19:56:58.366 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.366 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9865ffda:::benchmark_data_smithi188_161190_object81253:head# 2024-04-01T19:56:58.366 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.366 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:986616fa:::benchmark_data_smithi188_161190_object87094:head# 2024-04-01T19:56:58.366 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.367 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98661cca:::benchmark_data_smithi188_161190_object128768:head# 2024-04-01T19:56:58.367 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.367 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98668753:::benchmark_data_smithi188_161190_object66779:head# 2024-04-01T19:56:58.367 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.367 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98688be4:::benchmark_data_smithi188_161190_object64467:head# 2024-04-01T19:56:58.367 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.370 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9869004b:::benchmark_data_smithi188_161190_object30082:head# 2024-04-01T19:56:58.371 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.372 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9869094f:::benchmark_data_smithi188_161190_object136846:head# 2024-04-01T19:56:58.372 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.373 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:986b300e:::benchmark_data_smithi188_161190_object138851:head# 2024-04-01T19:56:58.373 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.373 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:986b3048:::benchmark_data_smithi188_161190_object39108:head# 2024-04-01T19:56:58.373 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.373 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:986c0a0f:::benchmark_data_smithi188_161190_object96275:head# 2024-04-01T19:56:58.373 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.373 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:986c9e3b:::benchmark_data_smithi188_161190_object105374:head# 2024-04-01T19:56:58.373 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.373 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:986cc339:::benchmark_data_smithi188_161190_object74844:head# 2024-04-01T19:56:58.373 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.373 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:986d5a56:::benchmark_data_smithi188_161190_object69600:head# 2024-04-01T19:56:58.373 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.373 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:986d8e23:::benchmark_data_smithi188_161190_object49048:head# 2024-04-01T19:56:58.373 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.374 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:986e3bad:::benchmark_data_smithi188_161190_object20614:head# 2024-04-01T19:56:58.374 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.374 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:986e9674:::benchmark_data_smithi188_161190_object49801:head# 2024-04-01T19:56:58.374 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.374 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:986ed51b:::benchmark_data_smithi188_161190_object120698:head# 2024-04-01T19:56:58.374 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.374 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:986f2a00:::benchmark_data_smithi188_161190_object32609:head# 2024-04-01T19:56:58.374 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.374 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:986f4bc1:::benchmark_data_smithi188_161190_object82055:head# 2024-04-01T19:56:58.375 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.375 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:986fc1bc:::benchmark_data_smithi188_161190_object99069:head# 2024-04-01T19:56:58.375 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.379 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9870c36c:::benchmark_data_smithi188_161190_object28502:head# 2024-04-01T19:56:58.379 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.379 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9870c8d8:::benchmark_data_smithi188_161190_object36245:head# 2024-04-01T19:56:58.380 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.380 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98711425:::benchmark_data_smithi188_161190_object55474:head# 2024-04-01T19:56:58.380 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.380 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98719ccf:::benchmark_data_smithi188_161190_object134778:head# 2024-04-01T19:56:58.380 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.380 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9871a064:::benchmark_data_smithi188_161190_object84880:head# 2024-04-01T19:56:58.380 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.380 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9871e43e:::benchmark_data_smithi188_161190_object103990:head# 2024-04-01T19:56:58.380 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.380 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:987245ef:::benchmark_data_smithi188_161190_object27088:head# 2024-04-01T19:56:58.380 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.380 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9872a013:::benchmark_data_smithi188_161190_object57870:head# 2024-04-01T19:56:58.380 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.380 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9872b5e5:::benchmark_data_smithi188_161190_object88559:head# 2024-04-01T19:56:58.381 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.382 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:987307c2:::benchmark_data_smithi188_161190_object28219:head# 2024-04-01T19:56:58.382 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.382 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98744563:::benchmark_data_smithi188_161190_object67421:head# 2024-04-01T19:56:58.382 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.382 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98745244:::benchmark_data_smithi188_161190_object32121:head# 2024-04-01T19:56:58.382 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.382 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9874c960:::benchmark_data_smithi188_161190_object64447:head# 2024-04-01T19:56:58.382 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.382 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98755c78:::benchmark_data_smithi188_161190_object25352:head# 2024-04-01T19:56:58.383 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.383 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98759cf6:::benchmark_data_smithi188_161190_object125248:head# 2024-04-01T19:56:58.383 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.383 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9875e474:::benchmark_data_smithi188_161190_object31625:head# 2024-04-01T19:56:58.383 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.383 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98762c46:::benchmark_data_smithi188_161190_object89919:head# 2024-04-01T19:56:58.383 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.383 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98773535:::benchmark_data_smithi188_161190_object59142:head# 2024-04-01T19:56:58.383 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.384 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9877598f:::benchmark_data_smithi188_161190_object52395:head# 2024-04-01T19:56:58.384 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.384 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98778b64:::benchmark_data_smithi188_161190_object107136:head# 2024-04-01T19:56:58.384 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.384 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9878fb72:::benchmark_data_smithi188_161190_object117086:head# 2024-04-01T19:56:58.384 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.384 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:987abb52:::benchmark_data_smithi188_161190_object119768:head# 2024-04-01T19:56:58.384 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.384 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:987af029:::benchmark_data_smithi188_161190_object96247:head# 2024-04-01T19:56:58.385 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.385 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:987b3c22:::benchmark_data_smithi188_161190_object72042:head# 2024-04-01T19:56:58.386 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.386 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:987ba287:::benchmark_data_smithi188_161190_object88373:head# 2024-04-01T19:56:58.386 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.386 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:987be2fc:::benchmark_data_smithi188_161190_object109313:head# 2024-04-01T19:56:58.386 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.386 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:987c5989:::benchmark_data_smithi188_161190_object86325:head# 2024-04-01T19:56:58.386 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.386 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:987d6f84:::benchmark_data_smithi188_161190_object53919:head# 2024-04-01T19:56:58.386 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.392 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:987e0244:::benchmark_data_smithi188_161190_object40468:head# 2024-04-01T19:56:58.392 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.392 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:987e4877:::benchmark_data_smithi188_161190_object59686:head# 2024-04-01T19:56:58.392 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.392 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:987f30a7:::benchmark_data_smithi188_161190_object66515:head# 2024-04-01T19:56:58.392 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.392 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:987f4ba3:::benchmark_data_smithi188_161190_object36864:head# 2024-04-01T19:56:58.393 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.397 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:987f77cf:::benchmark_data_smithi188_161190_object75962:head# 2024-04-01T19:56:58.397 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.400 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:987ff0b0:::benchmark_data_smithi188_161190_object120135:head# 2024-04-01T19:56:58.400 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.400 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:988026cd:::benchmark_data_smithi188_161190_object37236:head# 2024-04-01T19:56:58.400 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.400 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98806ff6:::benchmark_data_smithi188_161190_object70074:head# 2024-04-01T19:56:58.400 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.401 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9881394d:::benchmark_data_smithi188_161190_object112918:head# 2024-04-01T19:56:58.401 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.401 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98816245:::benchmark_data_smithi188_161190_object49013:head# 2024-04-01T19:56:58.401 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.401 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98817c18:::benchmark_data_smithi188_161190_object66011:head# 2024-04-01T19:56:58.401 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.401 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9883c97d:::benchmark_data_smithi188_161190_object74211:head# 2024-04-01T19:56:58.401 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.401 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98841c80:::benchmark_data_smithi188_161190_object25716:head# 2024-04-01T19:56:58.401 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.401 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:988531d8:::benchmark_data_smithi188_161190_object114357:head# 2024-04-01T19:56:58.401 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.401 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9885cab3:::benchmark_data_smithi188_161190_object139154:head# 2024-04-01T19:56:58.401 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.402 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9886135a:::benchmark_data_smithi188_161190_object29368:head# 2024-04-01T19:56:58.402 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.403 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98868102:::benchmark_data_smithi188_161190_object73107:head# 2024-04-01T19:56:58.403 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.403 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98868521:::benchmark_data_smithi188_161190_object46814:head# 2024-04-01T19:56:58.403 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.404 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9886a945:::benchmark_data_smithi188_161190_object21588:head# 2024-04-01T19:56:58.404 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.404 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9887c4e9:::benchmark_data_smithi188_161190_object83361:head# 2024-04-01T19:56:58.404 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.404 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98882826:::benchmark_data_smithi188_161190_object46585:head# 2024-04-01T19:56:58.404 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.404 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98891857:::benchmark_data_smithi188_161190_object31085:head# 2024-04-01T19:56:58.404 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.404 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:988a0f47:::benchmark_data_smithi188_161190_object42014:head# 2024-04-01T19:56:58.404 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.404 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:988acb8e:::benchmark_data_smithi188_161190_object108805:head# 2024-04-01T19:56:58.404 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.404 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:988acbc7:::benchmark_data_smithi188_161190_object101777:head# 2024-04-01T19:56:58.404 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.413 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:988ad3ec:::benchmark_data_smithi188_161190_object84784:head# 2024-04-01T19:56:58.414 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.414 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:988b1056:::benchmark_data_smithi188_161190_object45672:head# 2024-04-01T19:56:58.414 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.414 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:988c0397:::benchmark_data_smithi188_161190_object115538:head# 2024-04-01T19:56:58.414 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.414 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:988c8496:::benchmark_data_smithi188_161190_object67106:head# 2024-04-01T19:56:58.414 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.414 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:988d342d:::benchmark_data_smithi188_161190_object130609:head# 2024-04-01T19:56:58.414 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.416 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:988d4ca1:::benchmark_data_smithi188_161190_object43203:head# 2024-04-01T19:56:58.416 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.416 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:988e3542:::benchmark_data_smithi188_161190_object96441:head# 2024-04-01T19:56:58.416 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.416 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:988f47c1:::benchmark_data_smithi188_161190_object127190:head# 2024-04-01T19:56:58.416 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.416 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:988f8721:::benchmark_data_smithi188_161190_object67991:head# 2024-04-01T19:56:58.416 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.416 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:988f986b:::benchmark_data_smithi188_161190_object87124:head# 2024-04-01T19:56:58.416 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.416 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:988fa561:::benchmark_data_smithi188_161190_object33037:head# 2024-04-01T19:56:58.416 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.417 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:988fbed5:::benchmark_data_smithi188_161190_object98987:head# 2024-04-01T19:56:58.417 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.417 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98904a26:::benchmark_data_smithi188_161190_object64805:head# 2024-04-01T19:56:58.417 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.417 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9890b9fa:::benchmark_data_smithi188_161190_object64587:head# 2024-04-01T19:56:58.417 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.420 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9890f7d2:::benchmark_data_smithi188_161190_object41478:head# 2024-04-01T19:56:58.421 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.421 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98914289:::benchmark_data_smithi188_161190_object38749:head# 2024-04-01T19:56:58.421 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.421 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98915ba4:::benchmark_data_smithi188_161190_object84763:head# 2024-04-01T19:56:58.421 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.421 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9891bc81:::benchmark_data_smithi188_161190_object67258:head# 2024-04-01T19:56:58.421 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.421 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9891cd73:::benchmark_data_smithi188_161190_object128969:head# 2024-04-01T19:56:58.421 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.421 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:989247a7:::benchmark_data_smithi188_161190_object50600:head# 2024-04-01T19:56:58.421 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.421 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:989284df:::benchmark_data_smithi188_161190_object133725:head# 2024-04-01T19:56:58.421 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.422 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9892faff:::benchmark_data_smithi188_161190_object119027:head# 2024-04-01T19:56:58.422 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.422 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98935645:::benchmark_data_smithi188_161190_object137230:head# 2024-04-01T19:56:58.422 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.422 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9893a3f4:::benchmark_data_smithi188_161190_object115614:head# 2024-04-01T19:56:58.422 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.422 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9893c013:::benchmark_data_smithi188_161190_object58153:head# 2024-04-01T19:56:58.422 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.422 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98941dbb:::benchmark_data_smithi188_161190_object26001:head# 2024-04-01T19:56:58.422 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.422 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98943e77:::benchmark_data_smithi188_161190_object115078:head# 2024-04-01T19:56:58.422 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.422 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98952605:::benchmark_data_smithi188_161190_object83997:head# 2024-04-01T19:56:58.423 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.423 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9895440b:::benchmark_data_smithi188_161190_object23036:head# 2024-04-01T19:56:58.423 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.423 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9896c1ae:::benchmark_data_smithi188_161190_object112745:head# 2024-04-01T19:56:58.423 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.423 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9896ee66:::benchmark_data_smithi188_161190_object133119:head# 2024-04-01T19:56:58.423 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.424 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98976b4b:::benchmark_data_smithi188_161190_object125691:head# 2024-04-01T19:56:58.424 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.424 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9897adbd:::benchmark_data_smithi188_161190_object77112:head# 2024-04-01T19:56:58.424 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.424 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9897b32a:::benchmark_data_smithi188_161190_object68554:head# 2024-04-01T19:56:58.424 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.424 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9898f00e:::benchmark_data_smithi188_161190_object23775:head# 2024-04-01T19:56:58.424 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.424 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9899045a:::benchmark_data_smithi188_161190_object81618:head# 2024-04-01T19:56:58.424 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.425 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9899af72:::benchmark_data_smithi188_161190_object104170:head# 2024-04-01T19:56:58.425 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.425 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:989b0c4f:::benchmark_data_smithi188_161190_object105643:head# 2024-04-01T19:56:58.425 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.425 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:989b6afd:::benchmark_data_smithi188_161190_object58052:head# 2024-04-01T19:56:58.425 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.425 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:989c56b7:::benchmark_data_smithi188_161190_object135602:head# 2024-04-01T19:56:58.425 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.425 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:989d225f:::benchmark_data_smithi188_161190_object137887:head# 2024-04-01T19:56:58.425 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.427 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:989d407e:::benchmark_data_smithi188_161190_object100563:head# 2024-04-01T19:56:58.427 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.427 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:989ef387:::benchmark_data_smithi188_161190_object137452:head# 2024-04-01T19:56:58.427 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.427 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:989f28f8:::benchmark_data_smithi188_161190_object69255:head# 2024-04-01T19:56:58.427 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.427 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:989fbd03:::benchmark_data_smithi188_161190_object138059:head# 2024-04-01T19:56:58.427 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.427 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:989fe38d:::benchmark_data_smithi188_161190_object46830:head# 2024-04-01T19:56:58.427 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.427 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98a07228:::benchmark_data_smithi188_161190_object90768:head# 2024-04-01T19:56:58.427 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.428 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98a0d788:::benchmark_data_smithi188_161190_object24164:head# 2024-04-01T19:56:58.428 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.428 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98a1536d:::benchmark_data_smithi188_161190_object25490:head# 2024-04-01T19:56:58.428 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.430 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98a193ef:::benchmark_data_smithi188_161190_object66419:head# 2024-04-01T19:56:58.430 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.430 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98a19860:::benchmark_data_smithi188_161190_object36951:head# 2024-04-01T19:56:58.430 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.430 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98a1ef11:::benchmark_data_smithi188_161190_object128909:head# 2024-04-01T19:56:58.430 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.431 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98a2e3b6:::benchmark_data_smithi188_161190_object25640:head# 2024-04-01T19:56:58.431 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.431 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98a30159:::benchmark_data_smithi188_161190_object101217:head# 2024-04-01T19:56:58.431 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.431 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98a366c1:::benchmark_data_smithi188_161190_object101532:head# 2024-04-01T19:56:58.431 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.431 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98a41519:::benchmark_data_smithi188_161190_object39861:head# 2024-04-01T19:56:58.431 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.431 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98a484dd:::benchmark_data_smithi188_161190_object126592:head# 2024-04-01T19:56:58.431 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.431 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98a5eea7:::benchmark_data_smithi188_161190_object43316:head# 2024-04-01T19:56:58.431 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.431 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98a5f48d:::benchmark_data_smithi188_161190_object86968:head# 2024-04-01T19:56:58.432 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.432 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98a62e8d:::benchmark_data_smithi188_161190_object78792:head# 2024-04-01T19:56:58.432 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.432 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98a6fb74:::benchmark_data_smithi188_161190_object75949:head# 2024-04-01T19:56:58.432 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.432 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98a9549a:::benchmark_data_smithi188_161190_object35232:head# 2024-04-01T19:56:58.432 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.432 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98aafb49:::benchmark_data_smithi188_161190_object54021:head# 2024-04-01T19:56:58.433 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.433 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98ab3984:::benchmark_data_smithi188_161190_object24569:head# 2024-04-01T19:56:58.433 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.434 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98ac0f26:::benchmark_data_smithi188_161190_object103015:head# 2024-04-01T19:56:58.435 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.435 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98ace567:::benchmark_data_smithi188_161190_object107721:head# 2024-04-01T19:56:58.435 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.435 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98aced2e:::benchmark_data_smithi188_161190_object36031:head# 2024-04-01T19:56:58.435 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.435 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98ad4cbe:::benchmark_data_smithi188_161190_object102149:head# 2024-04-01T19:56:58.435 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.435 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98af0f9c:::benchmark_data_smithi188_161190_object123864:head# 2024-04-01T19:56:58.435 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.435 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98b01ec7:::benchmark_data_smithi188_161190_object134605:head# 2024-04-01T19:56:58.435 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.436 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98b11872:::benchmark_data_smithi188_161190_object109005:head# 2024-04-01T19:56:58.436 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.436 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98b120c0:::benchmark_data_smithi188_161190_object92431:head# 2024-04-01T19:56:58.436 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.436 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98b17a12:::benchmark_data_smithi188_161190_object138619:head# 2024-04-01T19:56:58.436 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.436 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98b1a9a8:::benchmark_data_smithi188_161190_object135081:head# 2024-04-01T19:56:58.436 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.436 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98b2f4b0:::benchmark_data_smithi188_161190_object103798:head# 2024-04-01T19:56:58.436 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.437 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98b32c25:::benchmark_data_smithi188_161190_object44992:head# 2024-04-01T19:56:58.437 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.437 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98b3734d:::benchmark_data_smithi188_161190_object97354:head# 2024-04-01T19:56:58.437 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.437 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98b37815:::benchmark_data_smithi188_161190_object106277:head# 2024-04-01T19:56:58.437 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.442 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98b3dd81:::benchmark_data_smithi188_161190_object115079:head# 2024-04-01T19:56:58.442 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.442 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98b3e61a:::benchmark_data_smithi188_161190_object136644:head# 2024-04-01T19:56:58.442 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.442 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98b42295:::benchmark_data_smithi188_161190_object100662:head# 2024-04-01T19:56:58.442 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.442 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98b4404a:::benchmark_data_smithi188_161190_object57796:head# 2024-04-01T19:56:58.442 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.442 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98b4ad00:::benchmark_data_smithi188_161190_object77258:head# 2024-04-01T19:56:58.443 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.443 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98b6151a:::benchmark_data_smithi188_161190_object91723:head# 2024-04-01T19:56:58.443 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.443 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98b63c3a:::benchmark_data_smithi188_161190_object49172:head# 2024-04-01T19:56:58.443 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.443 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98b644c1:::benchmark_data_smithi188_161190_object113347:head# 2024-04-01T19:56:58.443 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.443 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98b766aa:::benchmark_data_smithi188_161190_object70064:head# 2024-04-01T19:56:58.443 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.443 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98b89270:::benchmark_data_smithi188_161190_object93738:head# 2024-04-01T19:56:58.443 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.443 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98b8c1eb:::benchmark_data_smithi188_161190_object120549:head# 2024-04-01T19:56:58.443 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98ba60ee:::benchmark_data_smithi188_161190_object127368:head# 2024-04-01T19:56:58.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98bafc01:::benchmark_data_smithi188_161190_object95125:head# 2024-04-01T19:56:58.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98baff79:::benchmark_data_smithi188_161190_object62291:head# 2024-04-01T19:56:58.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98bc7213:::benchmark_data_smithi188_161190_object93945:head# 2024-04-01T19:56:58.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98bd13c7:::benchmark_data_smithi188_161190_object96930:head# 2024-04-01T19:56:58.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98bda4f1:::benchmark_data_smithi188_161190_object104638:head# 2024-04-01T19:56:58.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98bf109d:::benchmark_data_smithi188_161190_object83153:head# 2024-04-01T19:56:58.445 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.445 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98bf3553:::benchmark_data_smithi188_161190_object66960:head# 2024-04-01T19:56:58.445 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.445 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98c007de:::benchmark_data_smithi188_161190_object31499:head# 2024-04-01T19:56:58.445 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.445 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98c0bd40:::benchmark_data_smithi188_161190_object105779:head# 2024-04-01T19:56:58.445 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.445 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98c12c97:::benchmark_data_smithi188_161190_object66337:head# 2024-04-01T19:56:58.445 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.447 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98c27869:::benchmark_data_smithi188_161190_object118043:head# 2024-04-01T19:56:58.447 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.447 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98c2d3e2:::benchmark_data_smithi188_161190_object118956:head# 2024-04-01T19:56:58.448 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.448 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98c3c18b:::benchmark_data_smithi188_161190_object118914:head# 2024-04-01T19:56:58.448 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.448 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98c4e843:::benchmark_data_smithi188_161190_object19912:head# 2024-04-01T19:56:58.448 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.448 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98c4f5a4:::benchmark_data_smithi188_161190_object42205:head# 2024-04-01T19:56:58.448 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.448 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98c504a5:::benchmark_data_smithi188_161190_object124199:head# 2024-04-01T19:56:58.448 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.448 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98c53121:::benchmark_data_smithi188_161190_object82396:head# 2024-04-01T19:56:58.448 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.449 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98c599de:::benchmark_data_smithi188_161190_object91749:head# 2024-04-01T19:56:58.449 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.449 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98c5a03c:::benchmark_data_smithi188_161190_object95524:head# 2024-04-01T19:56:58.449 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.449 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98c636da:::benchmark_data_smithi188_161190_object111513:head# 2024-04-01T19:56:58.449 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.449 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98c6f74d:::benchmark_data_smithi188_161190_object63506:head# 2024-04-01T19:56:58.449 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.449 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98c7b832:::benchmark_data_smithi188_161190_object56746:head# 2024-04-01T19:56:58.449 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.449 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98c9399a:::benchmark_data_smithi188_161190_object99398:head# 2024-04-01T19:56:58.449 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.450 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98c97ef2:::benchmark_data_smithi188_161190_object104928:head# 2024-04-01T19:56:58.450 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.450 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98ca8c8e:::benchmark_data_smithi188_161190_object25935:head# 2024-04-01T19:56:58.450 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.453 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98cbbf92:::benchmark_data_smithi188_161190_object32483:head# 2024-04-01T19:56:58.453 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.453 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98cddce4:::benchmark_data_smithi188_161190_object97234:head# 2024-04-01T19:56:58.453 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.453 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98cf2a7c:::benchmark_data_smithi188_161190_object32486:head# 2024-04-01T19:56:58.453 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.454 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98cf33bb:::benchmark_data_smithi188_161190_object23959:head# 2024-04-01T19:56:58.454 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.458 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98cfaf39:::benchmark_data_smithi188_161190_object75406:head# 2024-04-01T19:56:58.458 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.458 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98d01c4c:::benchmark_data_smithi188_161190_object51058:head# 2024-04-01T19:56:58.458 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.460 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98d0fba1:::benchmark_data_smithi188_161190_object85365:head# 2024-04-01T19:56:58.460 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.461 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98d13cf6:::benchmark_data_smithi188_161190_object51765:head# 2024-04-01T19:56:58.461 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.461 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98d1555f:::benchmark_data_smithi188_161190_object133304:head# 2024-04-01T19:56:58.461 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.462 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98d2322b:::benchmark_data_smithi188_161190_object75498:head# 2024-04-01T19:56:58.462 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.462 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98d285c5:::benchmark_data_smithi188_161190_object29727:head# 2024-04-01T19:56:58.462 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.463 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98d34cc5:::benchmark_data_smithi188_161190_object21723:head# 2024-04-01T19:56:58.463 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.467 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98d3ee0b:::benchmark_data_smithi188_161190_object131004:head# 2024-04-01T19:56:58.468 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.469 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98d44960:::benchmark_data_smithi188_161190_object125311:head# 2024-04-01T19:56:58.469 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.469 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98d62908:::benchmark_data_smithi188_161190_object111713:head# 2024-04-01T19:56:58.469 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.469 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98d73443:::benchmark_data_smithi188_161190_object64620:head# 2024-04-01T19:56:58.469 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.469 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98d73f39:::benchmark_data_smithi188_161190_object131674:head# 2024-04-01T19:56:58.469 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.469 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98d79f89:::benchmark_data_smithi188_161190_object129429:head# 2024-04-01T19:56:58.470 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.470 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98d7bb36:::benchmark_data_smithi188_161190_object94765:head# 2024-04-01T19:56:58.470 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.470 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98d90e82:::benchmark_data_smithi188_161190_object24351:head# 2024-04-01T19:56:58.470 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.471 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98d92879:::benchmark_data_smithi188_161190_object76193:head# 2024-04-01T19:56:58.472 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.472 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98d99e1d:::benchmark_data_smithi188_161190_object34947:head# 2024-04-01T19:56:58.472 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.472 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98da8e25:::benchmark_data_smithi188_161190_object43501:head# 2024-04-01T19:56:58.472 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.472 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98db2dea:::benchmark_data_smithi188_161190_object104494:head# 2024-04-01T19:56:58.472 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.472 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98dbbc33:::benchmark_data_smithi188_161190_object49799:head# 2024-04-01T19:56:58.472 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.472 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98dce7be:::benchmark_data_smithi188_161190_object70830:head# 2024-04-01T19:56:58.472 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.475 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98dd31c1:::benchmark_data_smithi188_161190_object88054:head# 2024-04-01T19:56:58.476 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.476 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98dd3da1:::benchmark_data_smithi188_161190_object58347:head# 2024-04-01T19:56:58.476 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.476 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98dd5e4e:::benchmark_data_smithi188_161190_object101510:head# 2024-04-01T19:56:58.476 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.476 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98de2475:::benchmark_data_smithi188_161190_object45413:head# 2024-04-01T19:56:58.476 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.476 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98de3915:::benchmark_data_smithi188_161190_object66846:head# 2024-04-01T19:56:58.476 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.476 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98de7fad:::benchmark_data_smithi188_161190_object60106:head# 2024-04-01T19:56:58.476 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.476 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98ded79a:::benchmark_data_smithi188_161190_object21900:head# 2024-04-01T19:56:58.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98deea7a:::benchmark_data_smithi188_161190_object35274:head# 2024-04-01T19:56:58.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98dfca80:::benchmark_data_smithi188_161190_object33741:head# 2024-04-01T19:56:58.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98e04a08:::benchmark_data_smithi188_161190_object75012:head# 2024-04-01T19:56:58.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98e07013:::benchmark_data_smithi188_161190_object58734:head# 2024-04-01T19:56:58.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98e0ce1b:::benchmark_data_smithi188_161190_object102057:head# 2024-04-01T19:56:58.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98e0ff1d:::benchmark_data_smithi188_161190_object70243:head# 2024-04-01T19:56:58.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.478 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98e108e3:::benchmark_data_smithi188_161190_object76726:head# 2024-04-01T19:56:58.478 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.478 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98e1da2d:::benchmark_data_smithi188_161190_object81607:head# 2024-04-01T19:56:58.478 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.478 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98e2db60:::benchmark_data_smithi188_161190_object67685:head# 2024-04-01T19:56:58.478 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.478 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98e30b42:::benchmark_data_smithi188_161190_object97517:head# 2024-04-01T19:56:58.478 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.478 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98e40a66:::benchmark_data_smithi188_161190_object118794:head# 2024-04-01T19:56:58.478 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.479 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98e477ee:::benchmark_data_smithi188_161190_object124217:head# 2024-04-01T19:56:58.479 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.480 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98e58815:::benchmark_data_smithi188_161190_object41646:head# 2024-04-01T19:56:58.480 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.480 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98e5c84b:::benchmark_data_smithi188_161190_object42372:head# 2024-04-01T19:56:58.480 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.480 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98e6b114:::benchmark_data_smithi188_161190_object106534:head# 2024-04-01T19:56:58.480 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.480 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98e6f432:::benchmark_data_smithi188_161190_object54460:head# 2024-04-01T19:56:58.480 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.480 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98e795b9:::benchmark_data_smithi188_161190_object122220:head# 2024-04-01T19:56:58.480 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.481 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98e908b4:::benchmark_data_smithi188_161190_object118280:head# 2024-04-01T19:56:58.481 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.482 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98e94107:::benchmark_data_smithi188_161190_object85100:head# 2024-04-01T19:56:58.482 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.483 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98e99bcd:::benchmark_data_smithi188_161190_object29735:head# 2024-04-01T19:56:58.483 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.483 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98e9ab6a:::benchmark_data_smithi188_161190_object93320:head# 2024-04-01T19:56:58.484 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.484 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98e9e125:::benchmark_data_smithi188_161190_object46836:head# 2024-04-01T19:56:58.484 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.484 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98ea562a:::benchmark_data_smithi188_161190_object32830:head# 2024-04-01T19:56:58.484 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.484 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98eb253c:::benchmark_data_smithi188_161190_object65515:head# 2024-04-01T19:56:58.484 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.485 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98eb2a39:::benchmark_data_smithi188_161190_object37938:head# 2024-04-01T19:56:58.485 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.485 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98eba751:::benchmark_data_smithi188_161190_object133260:head# 2024-04-01T19:56:58.485 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.485 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98eef3e3:::benchmark_data_smithi188_161190_object45541:head# 2024-04-01T19:56:58.485 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.485 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98efd05d:::benchmark_data_smithi188_161190_object135175:head# 2024-04-01T19:56:58.486 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.486 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98f08122:::benchmark_data_smithi188_161190_object117626:head# 2024-04-01T19:56:58.486 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.486 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98f0c9ec:::benchmark_data_smithi188_161190_object115540:head# 2024-04-01T19:56:58.486 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.487 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98f1b75f:::benchmark_data_smithi188_161190_object137808:head# 2024-04-01T19:56:58.487 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.487 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98f1dbec:::benchmark_data_smithi188_161190_object27859:head# 2024-04-01T19:56:58.487 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.487 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98f1de2d:::benchmark_data_smithi188_161190_object56040:head# 2024-04-01T19:56:58.487 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.489 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98f25b85:::benchmark_data_smithi188_161190_object139155:head# 2024-04-01T19:56:58.489 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.489 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98f373a2:::benchmark_data_smithi188_161190_object104581:head# 2024-04-01T19:56:58.489 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.490 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98f44d2e:::benchmark_data_smithi188_161190_object122287:head# 2024-04-01T19:56:58.490 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.490 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98f558b8:::benchmark_data_smithi188_161190_object130301:head# 2024-04-01T19:56:58.490 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.490 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98f5845b:::benchmark_data_smithi188_161190_object30387:head# 2024-04-01T19:56:58.490 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.490 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98f5c8fa:::benchmark_data_smithi188_161190_object101356:head# 2024-04-01T19:56:58.490 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98f60763:::benchmark_data_smithi188_161190_object46579:head# 2024-04-01T19:56:58.491 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.496 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98f71a01:::benchmark_data_smithi188_161190_object127658:head# 2024-04-01T19:56:58.496 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.496 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98f808db:::benchmark_data_smithi188_161190_object132197:head# 2024-04-01T19:56:58.496 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.496 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98f830ed:::benchmark_data_smithi188_161190_object115466:head# 2024-04-01T19:56:58.497 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.497 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98f84ca7:::benchmark_data_smithi188_161190_object123626:head# 2024-04-01T19:56:58.497 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.497 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98f84de3:::benchmark_data_smithi188_161190_object128185:head# 2024-04-01T19:56:58.497 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.497 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98f8c361:::benchmark_data_smithi188_161190_object89634:head# 2024-04-01T19:56:58.497 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.497 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98f8fe0a:::benchmark_data_smithi188_161190_object113988:head# 2024-04-01T19:56:58.497 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.505 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98f936ee:::benchmark_data_smithi188_161190_object47491:head# 2024-04-01T19:56:58.505 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.506 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98f94699:::benchmark_data_smithi188_161190_object107103:head# 2024-04-01T19:56:58.506 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.506 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98f963ea:::benchmark_data_smithi188_161190_object58150:head# 2024-04-01T19:56:58.506 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.507 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98f96c03:::benchmark_data_smithi188_161190_object74431:head# 2024-04-01T19:56:58.507 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.507 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98f9e1b9:::benchmark_data_smithi188_161190_object132058:head# 2024-04-01T19:56:58.507 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.507 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98fb2bdd:::benchmark_data_smithi188_161190_object83803:head# 2024-04-01T19:56:58.507 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.507 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98fbe60a:::benchmark_data_smithi188_161190_object92509:head# 2024-04-01T19:56:58.508 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.509 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98fc6691:::benchmark_data_smithi188_161190_object64394:head# 2024-04-01T19:56:58.509 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.509 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98fddc5a:::benchmark_data_smithi188_161190_object87622:head# 2024-04-01T19:56:58.509 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.509 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:98fe3432:::benchmark_data_smithi188_161190_object86337:head# 2024-04-01T19:56:58.509 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.509 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99004772:::benchmark_data_smithi188_161190_object52652:head# 2024-04-01T19:56:58.509 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.510 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99006db3:::benchmark_data_smithi188_161190_object77471:head# 2024-04-01T19:56:58.510 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.510 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99017c0d:::benchmark_data_smithi188_161190_object69825:head# 2024-04-01T19:56:58.510 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.513 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9901af66:::benchmark_data_smithi188_161190_object24494:head# 2024-04-01T19:56:58.513 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.513 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9901d483:::benchmark_data_smithi188_161190_object89770:head# 2024-04-01T19:56:58.513 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.513 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9901e2a0:::benchmark_data_smithi188_161190_object128109:head# 2024-04-01T19:56:58.513 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.513 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:990275ee:::benchmark_data_smithi188_161190_object26519:head# 2024-04-01T19:56:58.514 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.514 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9902d7a9:::benchmark_data_smithi188_161190_object116405:head# 2024-04-01T19:56:58.514 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.514 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99032c15:::benchmark_data_smithi188_161190_object75354:head# 2024-04-01T19:56:58.514 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.514 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9903bf55:::benchmark_data_smithi188_161190_object112805:head# 2024-04-01T19:56:58.514 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.514 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:990473d6:::benchmark_data_smithi188_161190_object26613:head# 2024-04-01T19:56:58.514 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.514 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9904944b:::benchmark_data_smithi188_161190_object139067:head# 2024-04-01T19:56:58.514 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.515 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9904c408:::benchmark_data_smithi188_161190_object33796:head# 2024-04-01T19:56:58.515 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.515 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:990539cc:::benchmark_data_smithi188_161190_object86095:head# 2024-04-01T19:56:58.515 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.515 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99053a32:::benchmark_data_smithi188_161190_object58225:head# 2024-04-01T19:56:58.515 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.515 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99054914:::benchmark_data_smithi188_161190_object49557:head# 2024-04-01T19:56:58.515 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.515 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99063480:::benchmark_data_smithi188_161190_object22406:head# 2024-04-01T19:56:58.516 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.518 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9906d19e:::benchmark_data_smithi188_161190_object137208:head# 2024-04-01T19:56:58.518 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.518 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99078a99:::benchmark_data_smithi188_161190_object80032:head# 2024-04-01T19:56:58.518 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.518 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9907bb07:::benchmark_data_smithi188_161190_object96446:head# 2024-04-01T19:56:58.518 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.518 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:990846c9:::benchmark_data_smithi188_161190_object71363:head# 2024-04-01T19:56:58.518 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.518 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9909b2dc:::benchmark_data_smithi188_161190_object25642:head# 2024-04-01T19:56:58.519 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.519 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:990a9fb3:::benchmark_data_smithi188_161190_object64869:head# 2024-04-01T19:56:58.519 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.519 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:990adc32:::benchmark_data_smithi188_161190_object38760:head# 2024-04-01T19:56:58.519 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.521 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:990b31b9:::benchmark_data_smithi188_161190_object21621:head# 2024-04-01T19:56:58.521 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.522 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:990b5eab:::benchmark_data_smithi188_161190_object21428:head# 2024-04-01T19:56:58.522 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.522 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:990b9d8f:::benchmark_data_smithi188_161190_object125421:head# 2024-04-01T19:56:58.522 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.522 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:990bff8e:::benchmark_data_smithi188_161190_object61737:head# 2024-04-01T19:56:58.522 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.522 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:990c6e8d:::benchmark_data_smithi188_161190_object73319:head# 2024-04-01T19:56:58.522 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.522 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:990d10a5:::benchmark_data_smithi188_161190_object105588:head# 2024-04-01T19:56:58.522 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.523 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:990d4e7d:::benchmark_data_smithi188_161190_object26741:head# 2024-04-01T19:56:58.523 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.525 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:990d9087:::benchmark_data_smithi188_161190_object55506:head# 2024-04-01T19:56:58.525 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.525 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:990dd1ed:::benchmark_data_smithi188_161190_object47864:head# 2024-04-01T19:56:58.525 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.525 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:990df4a8:::benchmark_data_smithi188_161190_object99579:head# 2024-04-01T19:56:58.525 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.525 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:990ee1c7:::benchmark_data_smithi188_161190_object56992:head# 2024-04-01T19:56:58.526 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.526 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:990f77e6:::benchmark_data_smithi188_161190_object93511:head# 2024-04-01T19:56:58.526 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.526 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:990fe1d6:::benchmark_data_smithi188_161190_object128242:head# 2024-04-01T19:56:58.526 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.526 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99111829:::benchmark_data_smithi188_161190_object80693:head# 2024-04-01T19:56:58.526 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.526 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:991159ba:::benchmark_data_smithi188_161190_object86178:head# 2024-04-01T19:56:58.526 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.527 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99120fe8:::benchmark_data_smithi188_161190_object91244:head# 2024-04-01T19:56:58.527 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.527 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99127833:::benchmark_data_smithi188_161190_object129948:head# 2024-04-01T19:56:58.527 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.527 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9912ae87:::benchmark_data_smithi188_161190_object88081:head# 2024-04-01T19:56:58.527 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.527 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99133590:::benchmark_data_smithi188_161190_object69918:head# 2024-04-01T19:56:58.527 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.527 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99134388:::benchmark_data_smithi188_161190_object120419:head# 2024-04-01T19:56:58.527 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.532 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99146111:::benchmark_data_smithi188_161190_object38294:head# 2024-04-01T19:56:58.532 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.532 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:991478c9:::benchmark_data_smithi188_161190_object40538:head# 2024-04-01T19:56:58.533 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.533 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9914a314:::benchmark_data_smithi188_161190_object61628:head# 2024-04-01T19:56:58.533 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.533 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9914c35d:::benchmark_data_smithi188_161190_object28263:head# 2024-04-01T19:56:58.533 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.533 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9914c62a:::benchmark_data_smithi188_161190_object134913:head# 2024-04-01T19:56:58.533 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.533 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9914d5c9:::benchmark_data_smithi188_161190_object49202:head# 2024-04-01T19:56:58.533 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.533 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9915c3f9:::benchmark_data_smithi188_161190_object135912:head# 2024-04-01T19:56:58.534 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.534 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9915ec29:::benchmark_data_smithi188_161190_object131850:head# 2024-04-01T19:56:58.534 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.534 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9916d1a2:::benchmark_data_smithi188_161190_object58193:head# 2024-04-01T19:56:58.534 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.534 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99171d43:::benchmark_data_smithi188_161190_object115523:head# 2024-04-01T19:56:58.534 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.534 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99178e22:::benchmark_data_smithi188_161190_object52806:head# 2024-04-01T19:56:58.534 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.534 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9917ddcf:::benchmark_data_smithi188_161190_object107907:head# 2024-04-01T19:56:58.535 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.535 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:991a56c2:::benchmark_data_smithi188_161190_object83787:head# 2024-04-01T19:56:58.535 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.535 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:991aaa2c:::benchmark_data_smithi188_161190_object23550:head# 2024-04-01T19:56:58.535 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.535 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:991b1bef:::benchmark_data_smithi188_161190_object21130:head# 2024-04-01T19:56:58.535 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.535 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:991b2436:::benchmark_data_smithi188_161190_object108282:head# 2024-04-01T19:56:58.535 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.535 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:991b6024:::benchmark_data_smithi188_161190_object84407:head# 2024-04-01T19:56:58.535 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.535 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:991b8c42:::benchmark_data_smithi188_161190_object34247:head# 2024-04-01T19:56:58.536 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.536 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:991b9649:::benchmark_data_smithi188_161190_object114072:head# 2024-04-01T19:56:58.536 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.536 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:991bd658:::benchmark_data_smithi188_161190_object136144:head# 2024-04-01T19:56:58.536 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.536 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:991bf29b:::benchmark_data_smithi188_161190_object84270:head# 2024-04-01T19:56:58.536 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.536 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:991c1301:::benchmark_data_smithi188_161190_object23842:head# 2024-04-01T19:56:58.536 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.536 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:991c18d3:::benchmark_data_smithi188_161190_object101943:head# 2024-04-01T19:56:58.536 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.536 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:991c210b:::benchmark_data_smithi188_161190_object65667:head# 2024-04-01T19:56:58.536 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.537 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:991c7da9:::benchmark_data_smithi188_161190_object110761:head# 2024-04-01T19:56:58.537 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.537 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:991c8d9e:::benchmark_data_smithi188_161190_object62574:head# 2024-04-01T19:56:58.537 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.537 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:991d0c2a:::benchmark_data_smithi188_161190_object106991:head# 2024-04-01T19:56:58.537 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.537 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:991d275d:::benchmark_data_smithi188_161190_object87148:head# 2024-04-01T19:56:58.537 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.537 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:991d5ae5:::benchmark_data_smithi188_161190_object130168:head# 2024-04-01T19:56:58.537 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.540 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:991eaf65:::benchmark_data_smithi188_161190_object122382:head# 2024-04-01T19:56:58.540 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.540 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:991fad96:::benchmark_data_smithi188_161190_object26588:head# 2024-04-01T19:56:58.540 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.540 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:991fdc5a:::benchmark_data_smithi188_161190_object126824:head# 2024-04-01T19:56:58.540 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.540 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99207ab1:::benchmark_data_smithi188_161190_object42471:head# 2024-04-01T19:56:58.540 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.540 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99226bf3:::benchmark_data_smithi188_161190_object121167:head# 2024-04-01T19:56:58.541 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.541 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9922f8ca:::benchmark_data_smithi188_161190_object130899:head# 2024-04-01T19:56:58.541 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.541 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99235c65:::benchmark_data_smithi188_161190_object131293:head# 2024-04-01T19:56:58.541 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.541 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99235e22:::benchmark_data_smithi188_161190_object53027:head# 2024-04-01T19:56:58.541 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.541 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99245ca7:::benchmark_data_smithi188_161190_object19976:head# 2024-04-01T19:56:58.541 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.541 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9924bd30:::benchmark_data_smithi188_161190_object34783:head# 2024-04-01T19:56:58.541 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.541 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9925c159:::benchmark_data_smithi188_161190_object64208:head# 2024-04-01T19:56:58.542 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.542 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99268129:::benchmark_data_smithi188_161190_object136591:head# 2024-04-01T19:56:58.542 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.542 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9926b611:::benchmark_data_smithi188_161190_object93450:head# 2024-04-01T19:56:58.542 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.542 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9926d397:::benchmark_data_smithi188_161190_object24266:head# 2024-04-01T19:56:58.542 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.542 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99274f0a:::benchmark_data_smithi188_161190_object68847:head# 2024-04-01T19:56:58.542 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.542 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:992759b1:::benchmark_data_smithi188_161190_object70404:head# 2024-04-01T19:56:58.542 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.543 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9927ae2c:::benchmark_data_smithi188_161190_object20767:head# 2024-04-01T19:56:58.543 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.543 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99296d0f:::benchmark_data_smithi188_161190_object136795:head# 2024-04-01T19:56:58.543 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.543 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99296e46:::benchmark_data_smithi188_161190_object87611:head# 2024-04-01T19:56:58.543 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.545 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:992a5877:::benchmark_data_smithi188_161190_object36141:head# 2024-04-01T19:56:58.546 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.546 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:992abd16:::benchmark_data_smithi188_161190_object22058:head# 2024-04-01T19:56:58.546 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.546 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:992b6fdf:::benchmark_data_smithi188_161190_object124821:head# 2024-04-01T19:56:58.546 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.546 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:992c54cd:::benchmark_data_smithi188_161190_object78338:head# 2024-04-01T19:56:58.546 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.546 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:992c884f:::benchmark_data_smithi188_161190_object47975:head# 2024-04-01T19:56:58.546 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.546 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:992cf97b:::benchmark_data_smithi188_161190_object29764:head# 2024-04-01T19:56:58.547 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.547 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:992d09ac:::benchmark_data_smithi188_161190_object68081:head# 2024-04-01T19:56:58.547 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.547 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:992edf0c:::benchmark_data_smithi188_161190_object72819:head# 2024-04-01T19:56:58.547 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.547 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:993035b0:::benchmark_data_smithi188_161190_object36941:head# 2024-04-01T19:56:58.547 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.547 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9930525d:::benchmark_data_smithi188_161190_object24502:head# 2024-04-01T19:56:58.547 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.548 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99308a8d:::benchmark_data_smithi188_161190_object65506:head# 2024-04-01T19:56:58.548 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.548 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9930fd96:::benchmark_data_smithi188_161190_object127379:head# 2024-04-01T19:56:58.548 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.548 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9930fe73:::benchmark_data_smithi188_161190_object44010:head# 2024-04-01T19:56:58.548 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.548 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:993109a7:::benchmark_data_smithi188_161190_object72266:head# 2024-04-01T19:56:58.548 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.548 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99316e88:::benchmark_data_smithi188_161190_object114120:head# 2024-04-01T19:56:58.548 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.548 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99324ccf:::benchmark_data_smithi188_161190_object68130:head# 2024-04-01T19:56:58.548 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.548 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99324e22:::benchmark_data_smithi188_161190_object124246:head# 2024-04-01T19:56:58.549 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.549 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:993336a1:::benchmark_data_smithi188_161190_object36433:head# 2024-04-01T19:56:58.549 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.549 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99338500:::benchmark_data_smithi188_161190_object81476:head# 2024-04-01T19:56:58.549 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.550 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9933d4f6:::benchmark_data_smithi188_161190_object122056:head# 2024-04-01T19:56:58.550 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.550 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9933f2c9:::benchmark_data_smithi188_161190_object106784:head# 2024-04-01T19:56:58.550 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.550 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99349a13:::benchmark_data_smithi188_161190_object128709:head# 2024-04-01T19:56:58.551 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.551 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9934fc12:::benchmark_data_smithi188_161190_object111851:head# 2024-04-01T19:56:58.551 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.551 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:993541ff:::benchmark_data_smithi188_161190_object121041:head# 2024-04-01T19:56:58.551 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.551 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:993560a2:::benchmark_data_smithi188_161190_object22528:head# 2024-04-01T19:56:58.551 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.551 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9935ab3d:::benchmark_data_smithi188_161190_object37029:head# 2024-04-01T19:56:58.551 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.551 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9936943d:::benchmark_data_smithi188_161190_object103658:head# 2024-04-01T19:56:58.551 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.551 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9936cc74:::benchmark_data_smithi188_161190_object118201:head# 2024-04-01T19:56:58.552 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.552 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9936dcd9:::benchmark_data_smithi188_161190_object24458:head# 2024-04-01T19:56:58.552 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.552 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:993753b0:::benchmark_data_smithi188_161190_object62221:head# 2024-04-01T19:56:58.552 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.556 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99390f62:::benchmark_data_smithi188_161190_object50459:head# 2024-04-01T19:56:58.556 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.564 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:993945cc:::benchmark_data_smithi188_161190_object30543:head# 2024-04-01T19:56:58.564 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.564 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:993b3466:::benchmark_data_smithi188_161190_object52398:head# 2024-04-01T19:56:58.564 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.564 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:993bb020:::benchmark_data_smithi188_161190_object132864:head# 2024-04-01T19:56:58.565 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.565 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:993bb424:::benchmark_data_smithi188_161190_object111982:head# 2024-04-01T19:56:58.565 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.565 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:993cbfdc:::benchmark_data_smithi188_161190_object32415:head# 2024-04-01T19:56:58.566 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.566 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:993d3cf2:::benchmark_data_smithi188_161190_object83349:head# 2024-04-01T19:56:58.566 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.567 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:993dc0f3:::benchmark_data_smithi188_161190_object137214:head# 2024-04-01T19:56:58.567 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.567 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:993dfb0f:::benchmark_data_smithi188_161190_object101063:head# 2024-04-01T19:56:58.567 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.567 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:993eafe6:::benchmark_data_smithi188_161190_object32886:head# 2024-04-01T19:56:58.568 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.568 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99403cb3:::benchmark_data_smithi188_161190_object45510:head# 2024-04-01T19:56:58.568 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.579 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:994075e3:::benchmark_data_smithi188_161190_object121520:head# 2024-04-01T19:56:58.580 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.580 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:994082a3:::benchmark_data_smithi188_161190_object27612:head# 2024-04-01T19:56:58.580 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.580 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9940e776:::benchmark_data_smithi188_161190_object48578:head# 2024-04-01T19:56:58.580 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.580 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99415dfa:::benchmark_data_smithi188_161190_object94598:head# 2024-04-01T19:56:58.580 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.580 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9941c010:::benchmark_data_smithi188_161190_object75537:head# 2024-04-01T19:56:58.580 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.583 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99423c22:::benchmark_data_smithi188_161190_object131498:head# 2024-04-01T19:56:58.583 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.583 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:994296eb:::benchmark_data_smithi188_161190_object74537:head# 2024-04-01T19:56:58.583 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.583 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99429973:::benchmark_data_smithi188_161190_object65014:head# 2024-04-01T19:56:58.583 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.583 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99431d27:::benchmark_data_smithi188_161190_object124979:head# 2024-04-01T19:56:58.583 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.584 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:994344bc:::benchmark_data_smithi188_161190_object78517:head# 2024-04-01T19:56:58.584 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.584 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99455381:::benchmark_data_smithi188_161190_object123926:head# 2024-04-01T19:56:58.584 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.584 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99456092:::benchmark_data_smithi188_161190_object53156:head# 2024-04-01T19:56:58.584 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.584 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99473e78:::benchmark_data_smithi188_161190_object51481:head# 2024-04-01T19:56:58.584 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.584 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9947e6f2:::benchmark_data_smithi188_161190_object133854:head# 2024-04-01T19:56:58.584 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.584 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9948c56e:::benchmark_data_smithi188_161190_object57465:head# 2024-04-01T19:56:58.585 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.585 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9949443f:::benchmark_data_smithi188_161190_object57241:head# 2024-04-01T19:56:58.585 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.587 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:994a198f:::benchmark_data_smithi188_161190_object100296:head# 2024-04-01T19:56:58.587 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.587 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:994cdc82:::benchmark_data_smithi188_161190_object131094:head# 2024-04-01T19:56:58.587 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.587 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:994cdfff:::benchmark_data_smithi188_161190_object83996:head# 2024-04-01T19:56:58.588 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.588 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:994daff6:::benchmark_data_smithi188_161190_object89401:head# 2024-04-01T19:56:58.588 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.588 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:994e5359:::benchmark_data_smithi188_161190_object56888:head# 2024-04-01T19:56:58.588 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.588 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:994fb950:::benchmark_data_smithi188_161190_object86176:head# 2024-04-01T19:56:58.588 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.588 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9950781f:::benchmark_data_smithi188_161190_object48588:head# 2024-04-01T19:56:58.588 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.588 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99508873:::benchmark_data_smithi188_161190_object65309:head# 2024-04-01T19:56:58.588 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.588 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9950a237:::benchmark_data_smithi188_161190_object87674:head# 2024-04-01T19:56:58.588 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.589 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9950b0a3:::benchmark_data_smithi188_161190_object23098:head# 2024-04-01T19:56:58.589 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.589 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9951bdb0:::benchmark_data_smithi188_161190_object135088:head# 2024-04-01T19:56:58.589 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.589 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99525c3b:::benchmark_data_smithi188_161190_object88915:head# 2024-04-01T19:56:58.589 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.589 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99533f2a:::benchmark_data_smithi188_161190_object74387:head# 2024-04-01T19:56:58.589 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.589 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99535750:::benchmark_data_smithi188_161190_object23315:head# 2024-04-01T19:56:58.589 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.591 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99543392:::benchmark_data_smithi188_161190_object116429:head# 2024-04-01T19:56:58.591 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.591 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9954fbc9:::benchmark_data_smithi188_161190_object138524:head# 2024-04-01T19:56:58.591 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.591 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:995502c4:::benchmark_data_smithi188_161190_object115624:head# 2024-04-01T19:56:58.591 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.591 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:995541f2:::benchmark_data_smithi188_161190_object65011:head# 2024-04-01T19:56:58.591 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.591 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:995583b6:::benchmark_data_smithi188_161190_object41621:head# 2024-04-01T19:56:58.591 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.592 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9955d32f:::benchmark_data_smithi188_161190_object136728:head# 2024-04-01T19:56:58.592 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.592 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99569bfc:::benchmark_data_smithi188_161190_object49878:head# 2024-04-01T19:56:58.592 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.593 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9956c3f1:::benchmark_data_smithi188_161190_object83137:head# 2024-04-01T19:56:58.593 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.593 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9958bb43:::benchmark_data_smithi188_161190_object22842:head# 2024-04-01T19:56:58.593 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.593 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:995a6554:::benchmark_data_smithi188_161190_object49811:head# 2024-04-01T19:56:58.593 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.593 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:995a6e39:::benchmark_data_smithi188_161190_object92127:head# 2024-04-01T19:56:58.593 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.593 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:995b3fbf:::benchmark_data_smithi188_161190_object134729:head# 2024-04-01T19:56:58.594 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.594 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:995b558f:::benchmark_data_smithi188_161190_object66493:head# 2024-04-01T19:56:58.594 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.594 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:995cd882:::benchmark_data_smithi188_161190_object29144:head# 2024-04-01T19:56:58.594 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.594 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:995dc24d:::benchmark_data_smithi188_161190_object66461:head# 2024-04-01T19:56:58.594 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.594 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:995dcfb7:::benchmark_data_smithi188_161190_object125663:head# 2024-04-01T19:56:58.594 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:995e2d56:::benchmark_data_smithi188_161190_object30136:head# 2024-04-01T19:56:58.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:995fe2c8:::benchmark_data_smithi188_161190_object81983:head# 2024-04-01T19:56:58.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.603 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:995ff608:::benchmark_data_smithi188_161190_object79343:head# 2024-04-01T19:56:58.603 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.604 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99602a2a:::benchmark_data_smithi188_161190_object37920:head# 2024-04-01T19:56:58.604 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.605 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:996039c6:::benchmark_data_smithi188_161190_object75986:head# 2024-04-01T19:56:58.605 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.605 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:996084d4:::benchmark_data_smithi188_161190_object85915:head# 2024-04-01T19:56:58.605 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.605 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99613958:::benchmark_data_smithi188_161190_object79902:head# 2024-04-01T19:56:58.605 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.610 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9961b21c:::benchmark_data_smithi188_161190_object101382:head# 2024-04-01T19:56:58.610 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.610 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9961b72e:::benchmark_data_smithi188_161190_object91699:head# 2024-04-01T19:56:58.611 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.611 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9961d46b:::benchmark_data_smithi188_161190_object45076:head# 2024-04-01T19:56:58.611 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.611 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9962e29f:::benchmark_data_smithi188_161190_object79765:head# 2024-04-01T19:56:58.611 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.611 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9963532a:::benchmark_data_smithi188_161190_object73358:head# 2024-04-01T19:56:58.611 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.611 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99635bbb:::benchmark_data_smithi188_161190_object45199:head# 2024-04-01T19:56:58.612 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.612 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9965d3ed:::benchmark_data_smithi188_161190_object45519:head# 2024-04-01T19:56:58.612 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.612 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9965fba6:::benchmark_data_smithi188_161190_object27524:head# 2024-04-01T19:56:58.612 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.612 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99662009:::benchmark_data_smithi188_161190_object93397:head# 2024-04-01T19:56:58.612 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.612 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:996652f3:::benchmark_data_smithi188_161190_object21038:head# 2024-04-01T19:56:58.612 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.612 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:996807c6:::benchmark_data_smithi188_161190_object22995:head# 2024-04-01T19:56:58.612 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.612 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99682c45:::benchmark_data_smithi188_161190_object127294:head# 2024-04-01T19:56:58.612 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.613 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9968c350:::benchmark_data_smithi188_161190_object99281:head# 2024-04-01T19:56:58.613 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.613 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9968e379:::benchmark_data_smithi188_161190_object39679:head# 2024-04-01T19:56:58.613 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.613 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99692c97:::benchmark_data_smithi188_161190_object20925:head# 2024-04-01T19:56:58.613 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.613 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:996938e0:::benchmark_data_smithi188_161190_object91381:head# 2024-04-01T19:56:58.613 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.613 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:996a2501:::benchmark_data_smithi188_161190_object73305:head# 2024-04-01T19:56:58.613 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.613 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:996aca42:::benchmark_data_smithi188_161190_object84797:head# 2024-04-01T19:56:58.613 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.613 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:996b1bc8:::benchmark_data_smithi188_161190_object46567:head# 2024-04-01T19:56:58.614 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.614 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:996bec9c:::benchmark_data_smithi188_161190_object110716:head# 2024-04-01T19:56:58.614 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.614 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:996c1622:::benchmark_data_smithi188_161190_object66393:head# 2024-04-01T19:56:58.615 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.615 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:996cf4cf:::benchmark_data_smithi188_161190_object41832:head# 2024-04-01T19:56:58.615 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.615 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:996d3483:::benchmark_data_smithi188_161190_object114664:head# 2024-04-01T19:56:58.615 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.615 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:996e7cb3:::benchmark_data_smithi188_161190_object132452:head# 2024-04-01T19:56:58.615 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.615 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:996ec283:::benchmark_data_smithi188_161190_object98750:head# 2024-04-01T19:56:58.615 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.622 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9970db4a:::benchmark_data_smithi188_161190_object69792:head# 2024-04-01T19:56:58.622 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.622 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9970fb9f:::benchmark_data_smithi188_161190_object76405:head# 2024-04-01T19:56:58.622 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.623 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:997134b7:::benchmark_data_smithi188_161190_object108927:head# 2024-04-01T19:56:58.623 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.623 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99715ba5:::benchmark_data_smithi188_161190_object55943:head# 2024-04-01T19:56:58.623 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.623 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9972eeb8:::benchmark_data_smithi188_161190_object48147:head# 2024-04-01T19:56:58.623 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.623 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9973d782:::benchmark_data_smithi188_161190_object132883:head# 2024-04-01T19:56:58.623 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.623 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99741cab:::benchmark_data_smithi188_161190_object44625:head# 2024-04-01T19:56:58.623 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.623 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9974c0ca:::benchmark_data_smithi188_161190_object135135:head# 2024-04-01T19:56:58.623 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.623 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9975f25b:::benchmark_data_smithi188_161190_object22180:head# 2024-04-01T19:56:58.624 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.624 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9975f4fa:::benchmark_data_smithi188_161190_object104751:head# 2024-04-01T19:56:58.624 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.624 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9976426b:::benchmark_data_smithi188_161190_object77988:head# 2024-04-01T19:56:58.624 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.624 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99778f27:::benchmark_data_smithi188_161190_object78506:head# 2024-04-01T19:56:58.624 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.624 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9977f9d6:::benchmark_data_smithi188_161190_object65890:head# 2024-04-01T19:56:58.624 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.624 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:997810f5:::benchmark_data_smithi188_161190_object137859:head# 2024-04-01T19:56:58.624 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.627 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:997916dc:::benchmark_data_smithi188_161190_object29659:head# 2024-04-01T19:56:58.627 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.637 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:997918d0:::benchmark_data_smithi188_161190_object81588:head# 2024-04-01T19:56:58.637 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.640 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9979e896:::benchmark_data_smithi188_161190_object90936:head# 2024-04-01T19:56:58.641 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.652 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:997af3cd:::benchmark_data_smithi188_161190_object108481:head# 2024-04-01T19:56:58.652 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.653 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:997b46f8:::benchmark_data_smithi188_161190_object69865:head# 2024-04-01T19:56:58.653 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.653 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:997b6985:::benchmark_data_smithi188_161190_object37417:head# 2024-04-01T19:56:58.653 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.653 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:997c3290:::benchmark_data_smithi188_161190_object41180:head# 2024-04-01T19:56:58.654 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.654 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:997c552e:::benchmark_data_smithi188_161190_object90296:head# 2024-04-01T19:56:58.654 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.654 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:997c8485:::benchmark_data_smithi188_161190_object36561:head# 2024-04-01T19:56:58.654 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.655 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:997c8ca3:::benchmark_data_smithi188_161190_object72072:head# 2024-04-01T19:56:58.655 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.655 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:997c9e2f:::benchmark_data_smithi188_161190_object107420:head# 2024-04-01T19:56:58.655 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.655 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:997ccbc0:::benchmark_data_smithi188_161190_object73775:head# 2024-04-01T19:56:58.656 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.656 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:997d6853:::benchmark_data_smithi188_161190_object93282:head# 2024-04-01T19:56:58.656 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.656 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:997dbb18:::benchmark_data_smithi188_161190_object113972:head# 2024-04-01T19:56:58.656 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.658 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:997e1064:::benchmark_data_smithi188_161190_object36917:head# 2024-04-01T19:56:58.658 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.658 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:997f019f:::benchmark_data_smithi188_161190_object108836:head# 2024-04-01T19:56:58.658 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.658 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:997f3270:::benchmark_data_smithi188_161190_object114673:head# 2024-04-01T19:56:58.658 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.658 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9980c977:::benchmark_data_smithi188_161190_object105676:head# 2024-04-01T19:56:58.658 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.658 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9980dd0d:::benchmark_data_smithi188_161190_object104236:head# 2024-04-01T19:56:58.659 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.659 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9980fceb:::benchmark_data_smithi188_161190_object125324:head# 2024-04-01T19:56:58.659 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.659 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99813361:::benchmark_data_smithi188_161190_object62673:head# 2024-04-01T19:56:58.659 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.659 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99821a44:::benchmark_data_smithi188_161190_object36740:head# 2024-04-01T19:56:58.659 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.659 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:998222ee:::benchmark_data_smithi188_161190_object50673:head# 2024-04-01T19:56:58.659 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.660 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9982ef36:::benchmark_data_smithi188_161190_object34325:head# 2024-04-01T19:56:58.660 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.660 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99833789:::benchmark_data_smithi188_161190_object58648:head# 2024-04-01T19:56:58.660 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.660 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:998377e2:::benchmark_data_smithi188_161190_object79878:head# 2024-04-01T19:56:58.660 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.660 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9984461f:::benchmark_data_smithi188_161190_object78868:head# 2024-04-01T19:56:58.661 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.670 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9984dbcd:::benchmark_data_smithi188_161190_object118621:head# 2024-04-01T19:56:58.670 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.674 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99862e0e:::benchmark_data_smithi188_161190_object136415:head# 2024-04-01T19:56:58.674 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.674 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99868094:::benchmark_data_smithi188_161190_object70065:head# 2024-04-01T19:56:58.674 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.674 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99868a6d:::benchmark_data_smithi188_161190_object44559:head# 2024-04-01T19:56:58.674 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.674 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9987c972:::benchmark_data_smithi188_161190_object127209:head# 2024-04-01T19:56:58.674 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.675 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9987e579:::benchmark_data_smithi188_161190_object119292:head# 2024-04-01T19:56:58.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.675 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9989006f:::benchmark_data_smithi188_161190_object45180:head# 2024-04-01T19:56:58.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.675 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99890159:::benchmark_data_smithi188_161190_object116507:head# 2024-04-01T19:56:58.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.675 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:998941aa:::benchmark_data_smithi188_161190_object77758:head# 2024-04-01T19:56:58.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.676 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99894c72:::benchmark_data_smithi188_161190_object138865:head# 2024-04-01T19:56:58.676 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.676 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:998970b4:::benchmark_data_smithi188_161190_object66303:head# 2024-04-01T19:56:58.676 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.676 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:998a94bd:::benchmark_data_smithi188_161190_object109359:head# 2024-04-01T19:56:58.676 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.677 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:998ab767:::benchmark_data_smithi188_161190_object60852:head# 2024-04-01T19:56:58.677 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.688 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:998b161c:::benchmark_data_smithi188_161190_object77977:head# 2024-04-01T19:56:58.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:998c32e0:::benchmark_data_smithi188_161190_object41492:head# 2024-04-01T19:56:58.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.691 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:998ca0d1:::benchmark_data_smithi188_161190_object66955:head# 2024-04-01T19:56:58.691 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.692 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:998d637e:::benchmark_data_smithi188_161190_object65553:head# 2024-04-01T19:56:58.692 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.692 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:998ee659:::benchmark_data_smithi188_161190_object74632:head# 2024-04-01T19:56:58.692 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.692 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99900498:::benchmark_data_smithi188_161190_object112927:head# 2024-04-01T19:56:58.692 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.692 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99904225:::benchmark_data_smithi188_161190_object124281:head# 2024-04-01T19:56:58.692 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.692 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9990efc2:::benchmark_data_smithi188_161190_object70088:head# 2024-04-01T19:56:58.692 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.692 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9991ab63:::benchmark_data_smithi188_161190_object68513:head# 2024-04-01T19:56:58.692 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.693 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9991c682:::benchmark_data_smithi188_161190_object107804:head# 2024-04-01T19:56:58.693 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.694 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9991cf00:::benchmark_data_smithi188_161190_object126917:head# 2024-04-01T19:56:58.694 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.695 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9991d06a:::benchmark_data_smithi188_161190_object123998:head# 2024-04-01T19:56:58.695 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.695 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99924e22:::benchmark_data_smithi188_161190_object82632:head# 2024-04-01T19:56:58.695 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.695 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9993252b:::benchmark_data_smithi188_161190_object64619:head# 2024-04-01T19:56:58.695 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.695 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99932d25:::benchmark_data_smithi188_161190_object119280:head# 2024-04-01T19:56:58.696 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.696 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99938e47:::benchmark_data_smithi188_161190_object129968:head# 2024-04-01T19:56:58.696 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.697 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99941c87:::benchmark_data_smithi188_161190_object88051:head# 2024-04-01T19:56:58.697 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.697 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99946479:::benchmark_data_smithi188_161190_object50643:head# 2024-04-01T19:56:58.697 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.697 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99953ad3:::benchmark_data_smithi188_161190_object77058:head# 2024-04-01T19:56:58.697 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.698 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9997c33d:::benchmark_data_smithi188_161190_object100757:head# 2024-04-01T19:56:58.698 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.699 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9997e818:::benchmark_data_smithi188_161190_object23305:head# 2024-04-01T19:56:58.699 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.699 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9998624a:::benchmark_data_smithi188_161190_object90156:head# 2024-04-01T19:56:58.699 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.699 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:999b0320:::benchmark_data_smithi188_161190_object57069:head# 2024-04-01T19:56:58.699 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.699 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:999b5de3:::benchmark_data_smithi188_161190_object125869:head# 2024-04-01T19:56:58.699 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.700 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:999ba864:::benchmark_data_smithi188_161190_object128300:head# 2024-04-01T19:56:58.700 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.700 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:999bfc46:::benchmark_data_smithi188_161190_object28606:head# 2024-04-01T19:56:58.700 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.701 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:999c95ae:::benchmark_data_smithi188_161190_object43297:head# 2024-04-01T19:56:58.701 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:999c9a09:::benchmark_data_smithi188_161190_object126144:head# 2024-04-01T19:56:58.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:999cb1bf:::benchmark_data_smithi188_161190_object94546:head# 2024-04-01T19:56:58.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:999cf9fa:::benchmark_data_smithi188_161190_object135892:head# 2024-04-01T19:56:58.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:999d5456:::benchmark_data_smithi188_161190_object28191:head# 2024-04-01T19:56:58.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.707 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:999ea0ca:::benchmark_data_smithi188_161190_object113075:head# 2024-04-01T19:56:58.708 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.708 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:999ea94a:::benchmark_data_smithi188_161190_object128027:head# 2024-04-01T19:56:58.708 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.708 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:999ed29d:::benchmark_data_smithi188_161190_object136691:head# 2024-04-01T19:56:58.708 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.708 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99a00fc1:::benchmark_data_smithi188_161190_object29667:head# 2024-04-01T19:56:58.708 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.708 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99a0375b:::benchmark_data_smithi188_161190_object59052:head# 2024-04-01T19:56:58.708 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.708 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99a0af51:::benchmark_data_smithi188_161190_object77659:head# 2024-04-01T19:56:58.708 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.715 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99a0d4c5:::benchmark_data_smithi188_161190_object26957:head# 2024-04-01T19:56:58.715 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.716 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99a0eb79:::benchmark_data_smithi188_161190_object34069:head# 2024-04-01T19:56:58.716 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.717 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99a29b23:::benchmark_data_smithi188_161190_object27016:head# 2024-04-01T19:56:58.717 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.717 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99a395a8:::benchmark_data_smithi188_161190_object101045:head# 2024-04-01T19:56:58.717 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.717 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99a3985a:::benchmark_data_smithi188_161190_object88941:head# 2024-04-01T19:56:58.717 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.719 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99a3eb33:::benchmark_data_smithi188_161190_object68421:head# 2024-04-01T19:56:58.719 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.719 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99a404fb:::benchmark_data_smithi188_161190_object130036:head# 2024-04-01T19:56:58.719 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.719 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99a44186:::benchmark_data_smithi188_161190_object100980:head# 2024-04-01T19:56:58.719 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.719 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99a4984e:::benchmark_data_smithi188_161190_object115319:head# 2024-04-01T19:56:58.719 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.719 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99a4f9b7:::benchmark_data_smithi188_161190_object89793:head# 2024-04-01T19:56:58.719 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.724 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99a5aac1:::benchmark_data_smithi188_161190_object40612:head# 2024-04-01T19:56:58.724 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.725 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99a6320d:::benchmark_data_smithi188_161190_object79312:head# 2024-04-01T19:56:58.725 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.726 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99a75ef7:::benchmark_data_smithi188_161190_object31132:head# 2024-04-01T19:56:58.727 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.727 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99a7eec0:::benchmark_data_smithi188_161190_object92798:head# 2024-04-01T19:56:58.727 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.727 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99a81766:::benchmark_data_smithi188_161190_object98607:head# 2024-04-01T19:56:58.727 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.727 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99a8d50b:::benchmark_data_smithi188_161190_object88879:head# 2024-04-01T19:56:58.727 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.728 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99a8d7a9:::benchmark_data_smithi188_161190_object45465:head# 2024-04-01T19:56:58.728 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.728 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99a96177:::benchmark_data_smithi188_161190_object29548:head# 2024-04-01T19:56:58.728 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.729 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99a9e34f:::benchmark_data_smithi188_161190_object40063:head# 2024-04-01T19:56:58.729 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.729 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99aa13ac:::benchmark_data_smithi188_161190_object101779:head# 2024-04-01T19:56:58.729 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.729 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99aa767e:::benchmark_data_smithi188_161190_object123514:head# 2024-04-01T19:56:58.729 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.731 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99aa7a6c:::benchmark_data_smithi188_161190_object92714:head# 2024-04-01T19:56:58.731 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.731 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99aaa280:::benchmark_data_smithi188_161190_object20592:head# 2024-04-01T19:56:58.731 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.731 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99ab5ff3:::benchmark_data_smithi188_161190_object127314:head# 2024-04-01T19:56:58.731 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.731 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99ab7c71:::benchmark_data_smithi188_161190_object78416:head# 2024-04-01T19:56:58.731 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.731 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99ad030f:::benchmark_data_smithi188_161190_object74363:head# 2024-04-01T19:56:58.731 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.732 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99adba4e:::benchmark_data_smithi188_161190_object41483:head# 2024-04-01T19:56:58.732 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.732 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99aeec5a:::benchmark_data_smithi188_161190_object55172:head# 2024-04-01T19:56:58.732 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.732 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99af8ebd:::benchmark_data_smithi188_161190_object126009:head# 2024-04-01T19:56:58.732 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.736 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99b19a7b:::benchmark_data_smithi188_161190_object20585:head# 2024-04-01T19:56:58.736 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.736 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99b211f5:::benchmark_data_smithi188_161190_object26854:head# 2024-04-01T19:56:58.736 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.736 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99b219ea:::benchmark_data_smithi188_161190_object116816:head# 2024-04-01T19:56:58.736 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99b34850:::benchmark_data_smithi188_161190_object113900:head# 2024-04-01T19:56:58.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99b3f37d:::benchmark_data_smithi188_161190_object32195:head# 2024-04-01T19:56:58.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99b44495:::benchmark_data_smithi188_161190_object118824:head# 2024-04-01T19:56:58.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99b4a256:::benchmark_data_smithi188_161190_object124068:head# 2024-04-01T19:56:58.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99b5ac15:::benchmark_data_smithi188_161190_object66683:head# 2024-04-01T19:56:58.737 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.737 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99b67e42:::benchmark_data_smithi188_161190_object107893:head# 2024-04-01T19:56:58.738 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.738 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99b6bee8:::benchmark_data_smithi188_161190_object126202:head# 2024-04-01T19:56:58.738 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.738 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99b6f0c0:::benchmark_data_smithi188_161190_object42209:head# 2024-04-01T19:56:58.738 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.738 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99b72e9c:::benchmark_data_smithi188_161190_object89402:head# 2024-04-01T19:56:58.738 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.738 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99b781c0:::benchmark_data_smithi188_161190_object38923:head# 2024-04-01T19:56:58.738 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.738 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99b79721:::benchmark_data_smithi188_161190_object28043:head# 2024-04-01T19:56:58.738 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.739 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99b8156d:::benchmark_data_smithi188_161190_object89948:head# 2024-04-01T19:56:58.739 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.739 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99b9685f:::benchmark_data_smithi188_161190_object72841:head# 2024-04-01T19:56:58.739 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.739 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99b976be:::benchmark_data_smithi188_161190_object55061:head# 2024-04-01T19:56:58.739 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.741 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99ba0540:::benchmark_data_smithi188_161190_object96013:head# 2024-04-01T19:56:58.741 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.741 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99ba6841:::benchmark_data_smithi188_161190_object65378:head# 2024-04-01T19:56:58.741 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.741 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99ba7513:::benchmark_data_smithi188_161190_object90041:head# 2024-04-01T19:56:58.741 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.741 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99bce8ce:::benchmark_data_smithi188_161190_object133975:head# 2024-04-01T19:56:58.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99bd3132:::benchmark_data_smithi188_161190_object101346:head# 2024-04-01T19:56:58.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99bd5aa5:::benchmark_data_smithi188_161190_object113114:head# 2024-04-01T19:56:58.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99bd6d58:::benchmark_data_smithi188_161190_object97523:head# 2024-04-01T19:56:58.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99be32f6:::benchmark_data_smithi188_161190_object48281:head# 2024-04-01T19:56:58.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99be6b9b:::benchmark_data_smithi188_161190_object113782:head# 2024-04-01T19:56:58.742 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.742 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99bea185:::benchmark_data_smithi188_161190_object25315:head# 2024-04-01T19:56:58.743 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.743 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99bfd882:::benchmark_data_smithi188_161190_object87128:head# 2024-04-01T19:56:58.743 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.743 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99c0be74:::benchmark_data_smithi188_161190_object31344:head# 2024-04-01T19:56:58.743 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.743 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99c0eece:::benchmark_data_smithi188_161190_object104864:head# 2024-04-01T19:56:58.743 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.743 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99c11f33:::benchmark_data_smithi188_161190_object23873:head# 2024-04-01T19:56:58.743 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.743 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99c1779f:::benchmark_data_smithi188_161190_object87365:head# 2024-04-01T19:56:58.743 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.745 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99c2528b:::benchmark_data_smithi188_161190_object104213:head# 2024-04-01T19:56:58.745 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.745 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99c29409:::benchmark_data_smithi188_161190_object117394:head# 2024-04-01T19:56:58.745 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.745 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99c2a791:::benchmark_data_smithi188_161190_object83222:head# 2024-04-01T19:56:58.745 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.745 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99c321dd:::benchmark_data_smithi188_161190_object25550:head# 2024-04-01T19:56:58.745 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.745 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99c35af5:::benchmark_data_smithi188_161190_object126156:head# 2024-04-01T19:56:58.746 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.746 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99c3bdee:::benchmark_data_smithi188_161190_object115053:head# 2024-04-01T19:56:58.746 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.746 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99c41193:::benchmark_data_smithi188_161190_object42644:head# 2024-04-01T19:56:58.746 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.746 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99c49b14:::benchmark_data_smithi188_161190_object76705:head# 2024-04-01T19:56:58.746 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.747 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99c4bc6e:::benchmark_data_smithi188_161190_object44256:head# 2024-04-01T19:56:58.747 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.748 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99c748ad:::benchmark_data_smithi188_161190_object79521:head# 2024-04-01T19:56:58.748 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.748 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99c7ade1:::benchmark_data_smithi188_161190_object75197:head# 2024-04-01T19:56:58.748 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.748 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99c809e8:::benchmark_data_smithi188_161190_object133865:head# 2024-04-01T19:56:58.748 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.748 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99c86789:::benchmark_data_smithi188_161190_object33516:head# 2024-04-01T19:56:58.748 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.748 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99c96939:::benchmark_data_smithi188_161190_object84215:head# 2024-04-01T19:56:58.748 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.749 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99c98a71:::benchmark_data_smithi188_161190_object81021:head# 2024-04-01T19:56:58.749 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.749 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99ca737a:::benchmark_data_smithi188_161190_object70951:head# 2024-04-01T19:56:58.749 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.750 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99cae92a:::benchmark_data_smithi188_161190_object90740:head# 2024-04-01T19:56:58.750 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.750 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99cb521f:::benchmark_data_smithi188_161190_object82313:head# 2024-04-01T19:56:58.750 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.750 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99cb9098:::benchmark_data_smithi188_161190_object67614:head# 2024-04-01T19:56:58.750 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.750 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99cc1782:::benchmark_data_smithi188_161190_object126868:head# 2024-04-01T19:56:58.750 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.750 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99cc8a43:::benchmark_data_smithi188_161190_object124557:head# 2024-04-01T19:56:58.750 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.751 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99cd220d:::benchmark_data_smithi188_161190_object81163:head# 2024-04-01T19:56:58.751 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.754 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99cd2dad:::benchmark_data_smithi188_161190_object94376:head# 2024-04-01T19:56:58.754 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.754 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99cdd63b:::benchmark_data_smithi188_161190_object87804:head# 2024-04-01T19:56:58.755 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.758 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99ce3cd0:::benchmark_data_smithi188_161190_object100633:head# 2024-04-01T19:56:58.759 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:58 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:56:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:58 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:56:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:58 smithi062 ceph-mon[44211]: osdmap e694: 12 total, 11 up, 10 in 2024-04-01T19:56:58.765 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99ce4122:::benchmark_data_smithi188_161190_object78334:head# 2024-04-01T19:56:58.765 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.765 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99cee20c:::benchmark_data_smithi188_161190_object98738:head# 2024-04-01T19:56:58.765 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.765 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99cf9304:::benchmark_data_smithi188_161190_object126015:head# 2024-04-01T19:56:58.765 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.765 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99cfb952:::benchmark_data_smithi188_161190_object41811:head# 2024-04-01T19:56:58.765 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.766 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99d0decf:::benchmark_data_smithi188_161190_object130361:head# 2024-04-01T19:56:58.766 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.766 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99d11773:::benchmark_data_smithi188_161190_object50791:head# 2024-04-01T19:56:58.766 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.766 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99d1cd98:::benchmark_data_smithi188_161190_object92592:head# 2024-04-01T19:56:58.766 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.766 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99d1ed2a:::benchmark_data_smithi188_161190_object67772:head# 2024-04-01T19:56:58.766 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.766 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99d27e00:::benchmark_data_smithi188_161190_object56006:head# 2024-04-01T19:56:58.766 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.771 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99d3b2cc:::benchmark_data_smithi188_161190_object61225:head# 2024-04-01T19:56:58.771 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.774 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99d47890:::benchmark_data_smithi188_161190_object62293:head# 2024-04-01T19:56:58.775 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.775 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99d4d938:::benchmark_data_smithi188_161190_object133466:head# 2024-04-01T19:56:58.776 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.776 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99d51113:::benchmark_data_smithi188_161190_object132970:head# 2024-04-01T19:56:58.776 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.776 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99d602f7:::benchmark_data_smithi188_161190_object49311:head# 2024-04-01T19:56:58.776 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.777 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99d60c09:::benchmark_data_smithi188_161190_object71870:head# 2024-04-01T19:56:58.777 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.777 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99d6d33f:::benchmark_data_smithi188_161190_object115407:head# 2024-04-01T19:56:58.778 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.778 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99d6ddd6:::benchmark_data_smithi188_161190_object58341:head# 2024-04-01T19:56:58.778 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.778 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99d6ebad:::benchmark_data_smithi188_161190_object65908:head# 2024-04-01T19:56:58.778 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.778 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99d7bea1:::benchmark_data_smithi188_161190_object79366:head# 2024-04-01T19:56:58.778 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.779 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99d7dbe8:::benchmark_data_smithi188_161190_object64272:head# 2024-04-01T19:56:58.779 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99d869f6:::benchmark_data_smithi188_161190_object114331:head# 2024-04-01T19:56:58.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99d89002:::benchmark_data_smithi188_161190_object99427:head# 2024-04-01T19:56:58.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99d903ec:::benchmark_data_smithi188_161190_object92346:head# 2024-04-01T19:56:58.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99daa923:::benchmark_data_smithi188_161190_object73610:head# 2024-04-01T19:56:58.781 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.781 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99dbbbb6:::benchmark_data_smithi188_161190_object66818:head# 2024-04-01T19:56:58.781 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.781 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99dbe598:::benchmark_data_smithi188_161190_object102421:head# 2024-04-01T19:56:58.781 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.781 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99dcccff:::benchmark_data_smithi188_161190_object107684:head# 2024-04-01T19:56:58.781 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.786 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99dcdc10:::benchmark_data_smithi188_161190_object113332:head# 2024-04-01T19:56:58.786 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.797 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99dcf678:::benchmark_data_smithi188_161190_object123292:head# 2024-04-01T19:56:58.797 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.797 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99dd1e8f:::benchmark_data_smithi188_161190_object35445:head# 2024-04-01T19:56:58.797 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.800 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99dd2988:::benchmark_data_smithi188_161190_object42505:head# 2024-04-01T19:56:58.800 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.800 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99dd51f2:::benchmark_data_smithi188_161190_object87327:head# 2024-04-01T19:56:58.800 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.800 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99dd8095:::benchmark_data_smithi188_161190_object45374:head# 2024-04-01T19:56:58.800 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.800 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99ded8cd:::benchmark_data_smithi188_161190_object42736:head# 2024-04-01T19:56:58.800 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.804 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99df7d84:::benchmark_data_smithi188_161190_object35969:head# 2024-04-01T19:56:58.804 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.804 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99dfeeff:::benchmark_data_smithi188_161190_object128505:head# 2024-04-01T19:56:58.805 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.805 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99e0ac3f:::benchmark_data_smithi188_161190_object42793:head# 2024-04-01T19:56:58.805 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.805 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99e1adc0:::benchmark_data_smithi188_161190_object61529:head# 2024-04-01T19:56:58.805 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.806 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99e2418f:::benchmark_data_smithi188_161190_object45119:head# 2024-04-01T19:56:58.807 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.807 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99e25b8d:::benchmark_data_smithi188_161190_object65002:head# 2024-04-01T19:56:58.807 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.807 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99e26509:::benchmark_data_smithi188_161190_object52130:head# 2024-04-01T19:56:58.807 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.807 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99e26e26:::benchmark_data_smithi188_161190_object132319:head# 2024-04-01T19:56:58.807 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.807 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99e286b7:::benchmark_data_smithi188_161190_object54644:head# 2024-04-01T19:56:58.808 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.808 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99e2c1b8:::benchmark_data_smithi188_161190_object63014:head# 2024-04-01T19:56:58.808 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.808 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99e3efa7:::benchmark_data_smithi188_161190_object98740:head# 2024-04-01T19:56:58.808 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.808 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99e474b5:::benchmark_data_smithi188_161190_object124270:head# 2024-04-01T19:56:58.808 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.808 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99e47ae0:::benchmark_data_smithi188_161190_object134032:head# 2024-04-01T19:56:58.809 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.809 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99e547df:::benchmark_data_smithi188_161190_object120523:head# 2024-04-01T19:56:58.809 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.812 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99e63ef7:::benchmark_data_smithi188_161190_object117953:head# 2024-04-01T19:56:58.812 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.812 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99e6a462:::benchmark_data_smithi188_161190_object53536:head# 2024-04-01T19:56:58.812 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.812 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99e6b905:::benchmark_data_smithi188_161190_object73741:head# 2024-04-01T19:56:58.813 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.813 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99e77b1e:::benchmark_data_smithi188_161190_object131546:head# 2024-04-01T19:56:58.813 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.813 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99e824fd:::benchmark_data_smithi188_161190_object52809:head# 2024-04-01T19:56:58.813 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.813 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99e8c391:::benchmark_data_smithi188_161190_object54536:head# 2024-04-01T19:56:58.813 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.813 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99e8d940:::benchmark_data_smithi188_161190_object42704:head# 2024-04-01T19:56:58.813 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.813 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99e91435:::benchmark_data_smithi188_161190_object69735:head# 2024-04-01T19:56:58.813 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.817 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99e9f80a:::benchmark_data_smithi188_161190_object53471:head# 2024-04-01T19:56:58.817 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.817 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99ea92de:::benchmark_data_smithi188_161190_object80490:head# 2024-04-01T19:56:58.817 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.817 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99eb370c:::benchmark_data_smithi188_161190_object53227:head# 2024-04-01T19:56:58.817 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.817 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99eb6544:::benchmark_data_smithi188_161190_object25824:head# 2024-04-01T19:56:58.817 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.817 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99ec0326:::benchmark_data_smithi188_161190_object138969:head# 2024-04-01T19:56:58.818 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.818 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99ec6406:::benchmark_data_smithi188_161190_object74289:head# 2024-04-01T19:56:58.818 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.818 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99ed2701:::benchmark_data_smithi188_161190_object123873:head# 2024-04-01T19:56:58.818 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.818 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99ed8577:::benchmark_data_smithi188_161190_object56377:head# 2024-04-01T19:56:58.818 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.818 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99edb246:::benchmark_data_smithi188_161190_object90328:head# 2024-04-01T19:56:58.818 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.819 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99edcb36:::benchmark_data_smithi188_161190_object28358:head# 2024-04-01T19:56:58.819 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.819 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99ee518a:::benchmark_data_smithi188_161190_object115493:head# 2024-04-01T19:56:58.819 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.819 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99ee5d36:::benchmark_data_smithi188_161190_object91336:head# 2024-04-01T19:56:58.819 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.819 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99ee9bd7:::benchmark_data_smithi188_161190_object95159:head# 2024-04-01T19:56:58.819 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.819 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99efea25:::benchmark_data_smithi188_161190_object40859:head# 2024-04-01T19:56:58.819 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.819 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99f0deb5:::benchmark_data_smithi188_161190_object95979:head# 2024-04-01T19:56:58.820 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.820 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99f14664:::benchmark_data_smithi188_161190_object135731:head# 2024-04-01T19:56:58.820 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.820 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99f16926:::benchmark_data_smithi188_161190_object49379:head# 2024-04-01T19:56:58.820 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.824 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99f19691:::benchmark_data_smithi188_161190_object112209:head# 2024-04-01T19:56:58.824 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.824 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99f263e0:::benchmark_data_smithi188_161190_object60604:head# 2024-04-01T19:56:58.824 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.824 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99f28925:::benchmark_data_smithi188_161190_object24821:head# 2024-04-01T19:56:58.824 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.824 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99f2c78a:::benchmark_data_smithi188_161190_object83051:head# 2024-04-01T19:56:58.824 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.824 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99f2de4c:::benchmark_data_smithi188_161190_object50589:head# 2024-04-01T19:56:58.824 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.824 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99f34985:::benchmark_data_smithi188_161190_object101042:head# 2024-04-01T19:56:58.825 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.825 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99f35ae4:::benchmark_data_smithi188_161190_object121251:head# 2024-04-01T19:56:58.825 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.825 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99f376e7:::benchmark_data_smithi188_161190_object76486:head# 2024-04-01T19:56:58.825 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.825 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99f3f21c:::benchmark_data_smithi188_161190_object34810:head# 2024-04-01T19:56:58.825 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.825 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99f47c3a:::benchmark_data_smithi188_161190_object126209:head# 2024-04-01T19:56:58.825 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.825 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99f53510:::benchmark_data_smithi188_161190_object47682:head# 2024-04-01T19:56:58.825 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.825 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99f7ec40:::benchmark_data_smithi188_161190_object89394:head# 2024-04-01T19:56:58.825 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99f88d77:::benchmark_data_smithi188_161190_object86613:head# 2024-04-01T19:56:58.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99f8ae2c:::benchmark_data_smithi188_161190_object28063:head# 2024-04-01T19:56:58.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99f8bf01:::benchmark_data_smithi188_161190_object21208:head# 2024-04-01T19:56:58.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99fa2728:::benchmark_data_smithi188_161190_object127359:head# 2024-04-01T19:56:58.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99facda5:::benchmark_data_smithi188_161190_object45485:head# 2024-04-01T19:56:58.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99fad29c:::benchmark_data_smithi188_161190_object72650:head# 2024-04-01T19:56:58.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99fba68d:::benchmark_data_smithi188_161190_object40918:head# 2024-04-01T19:56:58.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.827 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99fc090c:::benchmark_data_smithi188_161190_object50699:head# 2024-04-01T19:56:58.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.827 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99fc151c:::benchmark_data_smithi188_161190_object106187:head# 2024-04-01T19:56:58.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.827 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99fd1fd3:::benchmark_data_smithi188_161190_object108548:head# 2024-04-01T19:56:58.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.829 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99fd4cd4:::benchmark_data_smithi188_161190_object77653:head# 2024-04-01T19:56:58.829 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.829 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99fd98be:::benchmark_data_smithi188_161190_object31878:head# 2024-04-01T19:56:58.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99fe9918:::benchmark_data_smithi188_161190_object35023:head# 2024-04-01T19:56:58.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99fee0ed:::benchmark_data_smithi188_161190_object82368:head# 2024-04-01T19:56:58.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99ff13c4:::benchmark_data_smithi188_161190_object70372:head# 2024-04-01T19:56:58.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:99ffb567:::benchmark_data_smithi188_161190_object97254:head# 2024-04-01T19:56:58.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a00e6a7:::benchmark_data_smithi188_161190_object86952:head# 2024-04-01T19:56:58.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a011055:::benchmark_data_smithi188_161190_object105994:head# 2024-04-01T19:56:58.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a017309:::benchmark_data_smithi188_161190_object21741:head# 2024-04-01T19:56:58.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a02fe23:::benchmark_data_smithi188_161190_object45753:head# 2024-04-01T19:56:58.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a03dc5b:::benchmark_data_smithi188_161190_object19934:head# 2024-04-01T19:56:58.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a04d19f:::benchmark_data_smithi188_161190_object119750:head# 2024-04-01T19:56:58.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.832 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a04f3a1:::benchmark_data_smithi188_161190_object108792:head# 2024-04-01T19:56:58.832 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.832 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a05457f:::benchmark_data_smithi188_161190_object90063:head# 2024-04-01T19:56:58.833 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.833 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a05f309:::benchmark_data_smithi188_161190_object116316:head# 2024-04-01T19:56:58.833 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.833 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a07c0ea:::benchmark_data_smithi188_161190_object119395:head# 2024-04-01T19:56:58.833 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.833 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a0b14cd:::benchmark_data_smithi188_161190_object72726:head# 2024-04-01T19:56:58.833 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.836 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a0cd0e1:::benchmark_data_smithi188_161190_object130283:head# 2024-04-01T19:56:58.836 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.839 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a0cfa98:::benchmark_data_smithi188_161190_object99788:head# 2024-04-01T19:56:58.840 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.840 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a0d1991:::benchmark_data_smithi188_161190_object83282:head# 2024-04-01T19:56:58.840 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.840 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a0d4af1:::benchmark_data_smithi188_161190_object35771:head# 2024-04-01T19:56:58.840 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.840 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a0dc2e7:::benchmark_data_smithi188_161190_object28594:head# 2024-04-01T19:56:58.840 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.847 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a0dda0a:::benchmark_data_smithi188_161190_object99787:head# 2024-04-01T19:56:58.847 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.847 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a0dfd94:::benchmark_data_smithi188_161190_object135407:head# 2024-04-01T19:56:58.847 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.847 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a0e66fa:::benchmark_data_smithi188_161190_object60978:head# 2024-04-01T19:56:58.847 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.847 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a0f0b2e:::benchmark_data_smithi188_161190_object137661:head# 2024-04-01T19:56:58.847 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.848 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a102448:::benchmark_data_smithi188_161190_object47868:head# 2024-04-01T19:56:58.848 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.848 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a10297c:::benchmark_data_smithi188_161190_object138582:head# 2024-04-01T19:56:58.848 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.848 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a1099e2:::benchmark_data_smithi188_161190_object101331:head# 2024-04-01T19:56:58.848 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.848 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a118457:::benchmark_data_smithi188_161190_object86216:head# 2024-04-01T19:56:58.849 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.849 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a118849:::benchmark_data_smithi188_161190_object44094:head# 2024-04-01T19:56:58.849 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.849 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a11af92:::benchmark_data_smithi188_161190_object88249:head# 2024-04-01T19:56:58.849 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.849 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a12095d:::benchmark_data_smithi188_161190_object137680:head# 2024-04-01T19:56:58.849 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.849 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a121687:::benchmark_data_smithi188_161190_object61184:head# 2024-04-01T19:56:58.849 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.849 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a12bc24:::benchmark_data_smithi188_161190_object137667:head# 2024-04-01T19:56:58.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a1380e7:::benchmark_data_smithi188_161190_object83223:head# 2024-04-01T19:56:58.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a13fbdd:::benchmark_data_smithi188_161190_object28996:head# 2024-04-01T19:56:58.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a144f7f:::benchmark_data_smithi188_161190_object75103:head# 2024-04-01T19:56:58.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a14ef17:::benchmark_data_smithi188_161190_object29348:head# 2024-04-01T19:56:58.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a1579e8:::benchmark_data_smithi188_161190_object110005:head# 2024-04-01T19:56:58.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a162449:::benchmark_data_smithi188_161190_object43830:head# 2024-04-01T19:56:58.850 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.850 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a163616:::benchmark_data_smithi188_161190_object58807:head# 2024-04-01T19:56:58.851 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.851 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a163ea4:::benchmark_data_smithi188_161190_object131083:head# 2024-04-01T19:56:58.851 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.851 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a169c75:::benchmark_data_smithi188_161190_object53711:head# 2024-04-01T19:56:58.851 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.851 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a186106:::benchmark_data_smithi188_161190_object106240:head# 2024-04-01T19:56:58.851 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.851 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a189f6f:::benchmark_data_smithi188_161190_object76542:head# 2024-04-01T19:56:58.851 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.857 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a190d5b:::benchmark_data_smithi188_161190_object133749:head# 2024-04-01T19:56:58.858 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.858 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a196d41:::benchmark_data_smithi188_161190_object27169:head# 2024-04-01T19:56:58.858 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.858 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a19a23a:::benchmark_data_smithi188_161190_object131114:head# 2024-04-01T19:56:58.858 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.858 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a1a051e:::benchmark_data_smithi188_161190_object112393:head# 2024-04-01T19:56:58.858 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.858 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a1a671e:::benchmark_data_smithi188_161190_object40022:head# 2024-04-01T19:56:58.858 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.858 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a1b4a1a:::benchmark_data_smithi188_161190_object92850:head# 2024-04-01T19:56:58.858 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.858 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a1b5b41:::benchmark_data_smithi188_161190_object82477:head# 2024-04-01T19:56:58.858 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.859 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a1bbf84:::benchmark_data_smithi188_161190_object48749:head# 2024-04-01T19:56:58.859 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.859 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a1c76f6:::benchmark_data_smithi188_161190_object36446:head# 2024-04-01T19:56:58.859 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:58 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:56:58.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:58 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:56:58.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:58 smithi022 ceph-mon[39439]: osdmap e694: 12 total, 11 up, 10 in 2024-04-01T19:56:58.868 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a1e754f:::benchmark_data_smithi188_161190_object76756:head# 2024-04-01T19:56:58.868 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.868 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a1f2e3c:::benchmark_data_smithi188_161190_object130684:head# 2024-04-01T19:56:58.868 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.868 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a1fd9cc:::benchmark_data_smithi188_161190_object21340:head# 2024-04-01T19:56:58.868 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.868 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a201144:::benchmark_data_smithi188_161190_object116849:head# 2024-04-01T19:56:58.868 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.868 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a20794e:::benchmark_data_smithi188_161190_object137561:head# 2024-04-01T19:56:58.868 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a217af3:::benchmark_data_smithi188_161190_object94285:head# 2024-04-01T19:56:58.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a2256d7:::benchmark_data_smithi188_161190_object115081:head# 2024-04-01T19:56:58.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a2293f9:::benchmark_data_smithi188_161190_object124129:head# 2024-04-01T19:56:58.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a23895c:::benchmark_data_smithi188_161190_object70781:head# 2024-04-01T19:56:58.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a24b74e:::benchmark_data_smithi188_161190_object42304:head# 2024-04-01T19:56:58.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a25660c:::benchmark_data_smithi188_161190_object78197:head# 2024-04-01T19:56:58.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a270adf:::benchmark_data_smithi188_161190_object130265:head# 2024-04-01T19:56:58.870 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.870 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a27f2c0:::benchmark_data_smithi188_161190_object76708:head# 2024-04-01T19:56:58.870 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.870 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a283671:::benchmark_data_smithi188_161190_object113598:head# 2024-04-01T19:56:58.870 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.870 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a290f27:::benchmark_data_smithi188_161190_object92985:head# 2024-04-01T19:56:58.870 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.871 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a291ee7:::benchmark_data_smithi188_161190_object67298:head# 2024-04-01T19:56:58.871 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.871 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a29ae33:::benchmark_data_smithi188_161190_object128462:head# 2024-04-01T19:56:58.871 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.871 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a2abb43:::benchmark_data_smithi188_161190_object109963:head# 2024-04-01T19:56:58.871 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.871 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a2b2683:::benchmark_data_smithi188_161190_object79299:head# 2024-04-01T19:56:58.871 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:58 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:56:58.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:58 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:56:58.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:58 smithi188 ceph-mon[43939]: osdmap e694: 12 total, 11 up, 10 in 2024-04-01T19:56:58.874 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a2ba261:::benchmark_data_smithi188_161190_object113189:head# 2024-04-01T19:56:58.874 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.876 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a2be548:::benchmark_data_smithi188_161190_object106102:head# 2024-04-01T19:56:58.876 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.876 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a2c4de8:::benchmark_data_smithi188_161190_object136427:head# 2024-04-01T19:56:58.876 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.877 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a2ca4c6:::benchmark_data_smithi188_161190_object88447:head# 2024-04-01T19:56:58.877 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.877 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a2ca648:::benchmark_data_smithi188_161190_object70684:head# 2024-04-01T19:56:58.877 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.877 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a2de5a9:::benchmark_data_smithi188_161190_object49986:head# 2024-04-01T19:56:58.878 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.878 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a2e7e2a:::benchmark_data_smithi188_161190_object134625:head# 2024-04-01T19:56:58.878 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.878 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a2f1998:::benchmark_data_smithi188_161190_object123965:head# 2024-04-01T19:56:58.878 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.879 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a30c22e:::benchmark_data_smithi188_161190_object50504:head# 2024-04-01T19:56:58.879 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.879 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a30e5bd:::benchmark_data_smithi188_161190_object125725:head# 2024-04-01T19:56:58.879 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.880 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a30f0da:::benchmark_data_smithi188_161190_object112154:head# 2024-04-01T19:56:58.880 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a3145aa:::benchmark_data_smithi188_161190_object113471:head# 2024-04-01T19:56:58.881 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a31fca8:::benchmark_data_smithi188_161190_object116130:head# 2024-04-01T19:56:58.881 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a33e322:::benchmark_data_smithi188_161190_object56843:head# 2024-04-01T19:56:58.881 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a340184:::benchmark_data_smithi188_161190_object114132:head# 2024-04-01T19:56:58.881 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a348b3d:::benchmark_data_smithi188_161190_object29225:head# 2024-04-01T19:56:58.881 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a353727:::benchmark_data_smithi188_161190_object48072:head# 2024-04-01T19:56:58.881 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a357480:::benchmark_data_smithi188_161190_object81558:head# 2024-04-01T19:56:58.882 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.885 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a364d5e:::benchmark_data_smithi188_161190_object54774:head# 2024-04-01T19:56:58.885 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.892 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a365a12:::benchmark_data_smithi188_161190_object128663:head# 2024-04-01T19:56:58.892 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.892 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a375849:::benchmark_data_smithi188_161190_object63290:head# 2024-04-01T19:56:58.892 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.892 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a378bfd:::benchmark_data_smithi188_161190_object116279:head# 2024-04-01T19:56:58.893 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.893 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a37ec1e:::benchmark_data_smithi188_161190_object49088:head# 2024-04-01T19:56:58.893 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.895 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a38c6d8:::benchmark_data_smithi188_161190_object36165:head# 2024-04-01T19:56:58.896 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.896 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a38d52e:::benchmark_data_smithi188_161190_object27809:head# 2024-04-01T19:56:58.896 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.896 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a3910fb:::benchmark_data_smithi188_161190_object38322:head# 2024-04-01T19:56:58.896 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.896 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a39a85c:::benchmark_data_smithi188_161190_object106947:head# 2024-04-01T19:56:58.896 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.896 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a39fb6d:::benchmark_data_smithi188_161190_object36119:head# 2024-04-01T19:56:58.896 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.896 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a3a9fdb:::benchmark_data_smithi188_161190_object40126:head# 2024-04-01T19:56:58.896 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.896 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a3aa368:::benchmark_data_smithi188_161190_object56594:head# 2024-04-01T19:56:58.896 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.897 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a3ba298:::benchmark_data_smithi188_161190_object23398:head# 2024-04-01T19:56:58.897 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.897 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a3c9196:::benchmark_data_smithi188_161190_object21497:head# 2024-04-01T19:56:58.897 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.898 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a3e2904:::benchmark_data_smithi188_161190_object40250:head# 2024-04-01T19:56:58.898 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.898 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a3efa88:::benchmark_data_smithi188_161190_object109315:head# 2024-04-01T19:56:58.898 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.908 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a3ff541:::benchmark_data_smithi188_161190_object103126:head# 2024-04-01T19:56:58.908 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.908 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a405a28:::benchmark_data_smithi188_161190_object114159:head# 2024-04-01T19:56:58.909 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.909 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a40fac5:::benchmark_data_smithi188_161190_object81472:head# 2024-04-01T19:56:58.909 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.910 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a41061e:::benchmark_data_smithi188_161190_object85127:head# 2024-04-01T19:56:58.910 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.910 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a4108ea:::benchmark_data_smithi188_161190_object76584:head# 2024-04-01T19:56:58.910 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.910 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a4156e1:::benchmark_data_smithi188_161190_object115856:head# 2024-04-01T19:56:58.910 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.910 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a4181ef:::benchmark_data_smithi188_161190_object90039:head# 2024-04-01T19:56:58.910 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.910 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a425d5f:::benchmark_data_smithi188_161190_object137914:head# 2024-04-01T19:56:58.911 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.913 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a42cc0f:::benchmark_data_smithi188_161190_object36586:head# 2024-04-01T19:56:58.913 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.913 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a42ed2f:::benchmark_data_smithi188_161190_object124743:head# 2024-04-01T19:56:58.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.914 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a43f0c6:::benchmark_data_smithi188_161190_object113661:head# 2024-04-01T19:56:58.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.914 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a453121:::benchmark_data_smithi188_161190_object119323:head# 2024-04-01T19:56:58.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.914 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a4608f3:::benchmark_data_smithi188_161190_object41196:head# 2024-04-01T19:56:58.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.914 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a469427:::benchmark_data_smithi188_161190_object41469:head# 2024-04-01T19:56:58.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.918 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a47d6f8:::benchmark_data_smithi188_161190_object81410:head# 2024-04-01T19:56:58.918 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.918 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a47f992:::benchmark_data_smithi188_161190_object35661:head# 2024-04-01T19:56:58.918 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.921 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a489e40:::benchmark_data_smithi188_161190_object77482:head# 2024-04-01T19:56:58.921 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.921 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a48d72f:::benchmark_data_smithi188_161190_object100488:head# 2024-04-01T19:56:58.921 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.921 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a49b50d:::benchmark_data_smithi188_161190_object29443:head# 2024-04-01T19:56:58.921 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.921 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a49bcfd:::benchmark_data_smithi188_161190_object73030:head# 2024-04-01T19:56:58.921 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.921 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a49d4cb:::benchmark_data_smithi188_161190_object80861:head# 2024-04-01T19:56:58.921 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.921 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a4a6cc6:::benchmark_data_smithi188_161190_object41854:head# 2024-04-01T19:56:58.922 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.922 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a4ad0f2:::benchmark_data_smithi188_161190_object72366:head# 2024-04-01T19:56:58.922 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.923 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a4af919:::benchmark_data_smithi188_161190_object39276:head# 2024-04-01T19:56:58.923 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.923 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a4b994d:::benchmark_data_smithi188_161190_object92855:head# 2024-04-01T19:56:58.923 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.924 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a4bdef2:::benchmark_data_smithi188_161190_object30268:head# 2024-04-01T19:56:58.924 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.924 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a4bf534:::benchmark_data_smithi188_161190_object54711:head# 2024-04-01T19:56:58.924 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.924 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a4db7fe:::benchmark_data_smithi188_161190_object131548:head# 2024-04-01T19:56:58.924 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.924 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a4e95f6:::benchmark_data_smithi188_161190_object104050:head# 2024-04-01T19:56:58.924 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.924 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a4ebe8a:::benchmark_data_smithi188_161190_object20597:head# 2024-04-01T19:56:58.924 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.924 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a4ed3eb:::benchmark_data_smithi188_161190_object79019:head# 2024-04-01T19:56:58.925 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.927 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a4f7d19:::benchmark_data_smithi188_161190_object135727:head# 2024-04-01T19:56:58.927 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.927 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a4fc223:::benchmark_data_smithi188_161190_object71831:head# 2024-04-01T19:56:58.927 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.927 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a5020f4:::benchmark_data_smithi188_161190_object96950:head# 2024-04-01T19:56:58.928 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.928 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a50c4cb:::benchmark_data_smithi188_161190_object101291:head# 2024-04-01T19:56:58.928 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.928 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a514ee0:::benchmark_data_smithi188_161190_object60504:head# 2024-04-01T19:56:58.928 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.928 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a521209:::benchmark_data_smithi188_161190_object38156:head# 2024-04-01T19:56:58.928 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.928 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a521971:::benchmark_data_smithi188_161190_object33078:head# 2024-04-01T19:56:58.928 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.928 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a522afa:::benchmark_data_smithi188_161190_object93500:head# 2024-04-01T19:56:58.928 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.928 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a54076c:::benchmark_data_smithi188_161190_object49957:head# 2024-04-01T19:56:58.928 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.928 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a541eb4:::benchmark_data_smithi188_161190_object66531:head# 2024-04-01T19:56:58.929 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.929 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a54c80a:::benchmark_data_smithi188_161190_object37729:head# 2024-04-01T19:56:58.929 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.929 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a552d4a:::benchmark_data_smithi188_161190_object41265:head# 2024-04-01T19:56:58.929 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.929 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a5532b9:::benchmark_data_smithi188_161190_object103041:head# 2024-04-01T19:56:58.929 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.929 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a555c8d:::benchmark_data_smithi188_161190_object131545:head# 2024-04-01T19:56:58.929 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.929 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a557e20:::benchmark_data_smithi188_161190_object38953:head# 2024-04-01T19:56:58.929 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.931 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a55b4c1:::benchmark_data_smithi188_161190_object84385:head# 2024-04-01T19:56:58.931 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.931 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a55b86c:::benchmark_data_smithi188_161190_object85990:head# 2024-04-01T19:56:58.931 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.931 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a55bb51:::benchmark_data_smithi188_161190_object29535:head# 2024-04-01T19:56:58.931 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.931 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a55f532:::benchmark_data_smithi188_161190_object37074:head# 2024-04-01T19:56:58.931 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.931 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a566155:::benchmark_data_smithi188_161190_object93162:head# 2024-04-01T19:56:58.932 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.932 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a574fba:::benchmark_data_smithi188_161190_object33246:head# 2024-04-01T19:56:58.932 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.932 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a578e14:::benchmark_data_smithi188_161190_object113288:head# 2024-04-01T19:56:58.932 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.932 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a582f5f:::benchmark_data_smithi188_161190_object89850:head# 2024-04-01T19:56:58.932 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.932 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a58435a:::benchmark_data_smithi188_161190_object68855:head# 2024-04-01T19:56:58.932 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.932 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a584f1d:::benchmark_data_smithi188_161190_object55721:head# 2024-04-01T19:56:58.932 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.934 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a5850de:::benchmark_data_smithi188_161190_object45692:head# 2024-04-01T19:56:58.934 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.934 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a5a5691:::benchmark_data_smithi188_161190_object75946:head# 2024-04-01T19:56:58.934 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.934 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a5c34ec:::benchmark_data_smithi188_161190_object71153:head# 2024-04-01T19:56:58.934 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.934 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a5c612a:::benchmark_data_smithi188_161190_object84858:head# 2024-04-01T19:56:58.934 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.934 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a5d1ea4:::benchmark_data_smithi188_161190_object74971:head# 2024-04-01T19:56:58.935 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.935 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a5d666f:::benchmark_data_smithi188_161190_object36321:head# 2024-04-01T19:56:58.935 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.935 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a5d9975:::benchmark_data_smithi188_161190_object96251:head# 2024-04-01T19:56:58.935 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.935 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a5dc38c:::benchmark_data_smithi188_161190_object138027:head# 2024-04-01T19:56:58.935 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.935 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a5ddfbd:::benchmark_data_smithi188_161190_object41529:head# 2024-04-01T19:56:58.935 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.941 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a5e714e:::benchmark_data_smithi188_161190_object114156:head# 2024-04-01T19:56:58.941 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.941 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a5f7211:::benchmark_data_smithi188_161190_object67416:head# 2024-04-01T19:56:58.941 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.941 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a602339:::benchmark_data_smithi188_161190_object138521:head# 2024-04-01T19:56:58.941 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.941 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a603512:::benchmark_data_smithi188_161190_object46901:head# 2024-04-01T19:56:58.941 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.941 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a60486d:::benchmark_data_smithi188_161190_object103196:head# 2024-04-01T19:56:58.941 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.941 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a6068ba:::benchmark_data_smithi188_161190_object73214:head# 2024-04-01T19:56:58.942 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.942 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a613aa8:::benchmark_data_smithi188_161190_object38527:head# 2024-04-01T19:56:58.942 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.942 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a6235fa:::benchmark_data_smithi188_161190_object135924:head# 2024-04-01T19:56:58.942 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.942 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a626183:::benchmark_data_smithi188_161190_object100912:head# 2024-04-01T19:56:58.942 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.942 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a62b260:::benchmark_data_smithi188_161190_object113454:head# 2024-04-01T19:56:58.942 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.942 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a62d3e4:::benchmark_data_smithi188_161190_object102360:head# 2024-04-01T19:56:58.942 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.942 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a62fa8f:::benchmark_data_smithi188_161190_object99111:head# 2024-04-01T19:56:58.942 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.942 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a6396dc:::benchmark_data_smithi188_161190_object66166:head# 2024-04-01T19:56:58.943 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.943 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a63d5d0:::benchmark_data_smithi188_161190_object84406:head# 2024-04-01T19:56:58.943 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.943 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a646a8d:::benchmark_data_smithi188_161190_object127776:head# 2024-04-01T19:56:58.943 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.943 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a64b1cf:::benchmark_data_smithi188_161190_object20960:head# 2024-04-01T19:56:58.943 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.943 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a652c2e:::benchmark_data_smithi188_161190_object123837:head# 2024-04-01T19:56:58.943 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.943 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a653edc:::benchmark_data_smithi188_161190_object99795:head# 2024-04-01T19:56:58.943 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.943 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a6561c2:::benchmark_data_smithi188_161190_object102849:head# 2024-04-01T19:56:58.943 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.943 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a6593cc:::benchmark_data_smithi188_161190_object63877:head# 2024-04-01T19:56:58.944 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.944 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a66f25b:::benchmark_data_smithi188_161190_object59655:head# 2024-04-01T19:56:58.944 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.944 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a6742c8:::benchmark_data_smithi188_161190_object102976:head# 2024-04-01T19:56:58.944 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.950 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a680e15:::benchmark_data_smithi188_161190_object58683:head# 2024-04-01T19:56:58.950 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.950 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a68a924:::benchmark_data_smithi188_161190_object77874:head# 2024-04-01T19:56:58.950 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.950 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a68d89f:::benchmark_data_smithi188_161190_object54216:head# 2024-04-01T19:56:58.950 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.950 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a69022d:::benchmark_data_smithi188_161190_object123255:head# 2024-04-01T19:56:58.950 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.950 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a6969ae:::benchmark_data_smithi188_161190_object86102:head# 2024-04-01T19:56:58.950 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.950 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a69ae03:::benchmark_data_smithi188_161190_object79805:head# 2024-04-01T19:56:58.951 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.951 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a6a1607:::benchmark_data_smithi188_161190_object111384:head# 2024-04-01T19:56:58.951 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.951 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a6a5327:::benchmark_data_smithi188_161190_object114601:head# 2024-04-01T19:56:58.951 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.951 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a6aab1d:::benchmark_data_smithi188_161190_object64148:head# 2024-04-01T19:56:58.951 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.951 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a6acaec:::benchmark_data_smithi188_161190_object57010:head# 2024-04-01T19:56:58.951 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.951 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a6ad0c8:::benchmark_data_smithi188_161190_object28322:head# 2024-04-01T19:56:58.951 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.951 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a6b56c0:::benchmark_data_smithi188_161190_object79163:head# 2024-04-01T19:56:58.951 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.951 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a6bea35:::benchmark_data_smithi188_161190_object125200:head# 2024-04-01T19:56:58.951 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.952 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a6bffae:::benchmark_data_smithi188_161190_object37851:head# 2024-04-01T19:56:58.952 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.952 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a6c0cc4:::benchmark_data_smithi188_161190_object126094:head# 2024-04-01T19:56:58.952 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.952 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a6c386d:::benchmark_data_smithi188_161190_object92111:head# 2024-04-01T19:56:58.952 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.952 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a6d5ca6:::benchmark_data_smithi188_161190_object35578:head# 2024-04-01T19:56:58.952 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.952 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a6dce03:::benchmark_data_smithi188_161190_object122807:head# 2024-04-01T19:56:58.952 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.952 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a6e44a1:::benchmark_data_smithi188_161190_object45329:head# 2024-04-01T19:56:58.952 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.952 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a6e59b5:::benchmark_data_smithi188_161190_object100366:head# 2024-04-01T19:56:58.952 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.953 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a6efeb4:::benchmark_data_smithi188_161190_object125757:head# 2024-04-01T19:56:58.953 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.953 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a6f9852:::benchmark_data_smithi188_161190_object52634:head# 2024-04-01T19:56:58.953 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.953 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a6fc08a:::benchmark_data_smithi188_161190_object68193:head# 2024-04-01T19:56:58.953 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.953 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a707c65:::benchmark_data_smithi188_161190_object92650:head# 2024-04-01T19:56:58.953 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.953 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a70cec6:::benchmark_data_smithi188_161190_object124960:head# 2024-04-01T19:56:58.953 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.953 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a70f221:::benchmark_data_smithi188_161190_object34364:head# 2024-04-01T19:56:58.953 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.953 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a70f76e:::benchmark_data_smithi188_161190_object127689:head# 2024-04-01T19:56:58.953 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.953 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a711c7a:::benchmark_data_smithi188_161190_object79651:head# 2024-04-01T19:56:58.954 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.954 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a717252:::benchmark_data_smithi188_161190_object34566:head# 2024-04-01T19:56:58.954 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.954 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a71ae58:::benchmark_data_smithi188_161190_object64378:head# 2024-04-01T19:56:58.954 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.957 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a73aaa8:::benchmark_data_smithi188_161190_object43397:head# 2024-04-01T19:56:58.957 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.957 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a73d3fb:::benchmark_data_smithi188_161190_object54612:head# 2024-04-01T19:56:58.957 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.957 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a7456a4:::benchmark_data_smithi188_161190_object110545:head# 2024-04-01T19:56:58.957 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.957 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a746e44:::benchmark_data_smithi188_161190_object28200:head# 2024-04-01T19:56:58.957 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.963 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a74d181:::benchmark_data_smithi188_161190_object37445:head# 2024-04-01T19:56:58.964 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.964 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a7593f2:::benchmark_data_smithi188_161190_object121852:head# 2024-04-01T19:56:58.964 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.964 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a7598e6:::benchmark_data_smithi188_161190_object90962:head# 2024-04-01T19:56:58.964 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.965 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a75b7e3:::benchmark_data_smithi188_161190_object67411:head# 2024-04-01T19:56:58.965 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.966 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a76da3c:::benchmark_data_smithi188_161190_object79696:head# 2024-04-01T19:56:58.966 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.966 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a783b7f:::benchmark_data_smithi188_161190_object60378:head# 2024-04-01T19:56:58.966 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.966 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a786ebb:::benchmark_data_smithi188_161190_object97064:head# 2024-04-01T19:56:58.966 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.966 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a793a51:::benchmark_data_smithi188_161190_object29143:head# 2024-04-01T19:56:58.966 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.967 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a7a02c2:::benchmark_data_smithi188_161190_object47882:head# 2024-04-01T19:56:58.967 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.967 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a7a6ed5:::benchmark_data_smithi188_161190_object123104:head# 2024-04-01T19:56:58.967 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.972 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a7a75b6:::benchmark_data_smithi188_161190_object130121:head# 2024-04-01T19:56:58.972 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.974 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a7a8d26:::benchmark_data_smithi188_161190_object115684:head# 2024-04-01T19:56:58.974 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.975 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a7aa7f4:::benchmark_data_smithi188_161190_object45494:head# 2024-04-01T19:56:58.975 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.975 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a7b235d:::benchmark_data_smithi188_161190_object95370:head# 2024-04-01T19:56:58.976 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.976 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a7b7b7d:::benchmark_data_smithi188_161190_object58966:head# 2024-04-01T19:56:58.976 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.981 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a7b82b5:::benchmark_data_smithi188_161190_object96990:head# 2024-04-01T19:56:58.981 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.982 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a7bec5f:::benchmark_data_smithi188_161190_object102344:head# 2024-04-01T19:56:58.982 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.982 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a7c4e05:::benchmark_data_smithi188_161190_object98158:head# 2024-04-01T19:56:58.983 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.983 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a7c9811:::benchmark_data_smithi188_161190_object138015:head# 2024-04-01T19:56:58.983 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.983 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a7d7c1c:::benchmark_data_smithi188_161190_object114717:head# 2024-04-01T19:56:58.983 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.984 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a7dede6:::benchmark_data_smithi188_161190_object37863:head# 2024-04-01T19:56:58.984 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.984 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a7e58a0:::benchmark_data_smithi188_161190_object116529:head# 2024-04-01T19:56:58.984 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.984 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a7f8347:::benchmark_data_smithi188_161190_object132361:head# 2024-04-01T19:56:58.984 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.984 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a7f83c2:::benchmark_data_smithi188_161190_object105315:head# 2024-04-01T19:56:58.984 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.985 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a7fde84:::benchmark_data_smithi188_161190_object72596:head# 2024-04-01T19:56:58.985 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.985 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a8040fb:::benchmark_data_smithi188_161190_object23709:head# 2024-04-01T19:56:58.985 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.985 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a809f12:::benchmark_data_smithi188_161190_object101512:head# 2024-04-01T19:56:58.985 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.986 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a81141b:::benchmark_data_smithi188_161190_object59026:head# 2024-04-01T19:56:58.986 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.986 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a81507a:::benchmark_data_smithi188_161190_object81032:head# 2024-04-01T19:56:58.986 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.991 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a82d5dd:::benchmark_data_smithi188_161190_object36624:head# 2024-04-01T19:56:58.991 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.992 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a82f82a:::benchmark_data_smithi188_161190_object23683:head# 2024-04-01T19:56:58.992 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.996 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a832b88:::benchmark_data_smithi188_161190_object76206:head# 2024-04-01T19:56:58.996 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.997 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a838a1b:::benchmark_data_smithi188_161190_object67512:head# 2024-04-01T19:56:58.998 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.998 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a83d84c:::benchmark_data_smithi188_161190_object132272:head# 2024-04-01T19:56:58.998 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.998 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a864128:::benchmark_data_smithi188_161190_object61735:head# 2024-04-01T19:56:58.998 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.998 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a86a929:::benchmark_data_smithi188_161190_object51254:head# 2024-04-01T19:56:58.998 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.999 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a880f23:::benchmark_data_smithi188_161190_object120742:head# 2024-04-01T19:56:58.999 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.999 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a8833c8:::benchmark_data_smithi188_161190_object108221:head# 2024-04-01T19:56:58.999 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:58.999 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a889aff:::benchmark_data_smithi188_161190_object102648:head# 2024-04-01T19:56:58.999 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.005 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a889c19:::benchmark_data_smithi188_161190_object79755:head# 2024-04-01T19:56:59.005 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.006 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a895a32:::benchmark_data_smithi188_161190_object80850:head# 2024-04-01T19:56:59.006 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.006 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a89e19b:::benchmark_data_smithi188_161190_object49678:head# 2024-04-01T19:56:59.006 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.006 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a8a009f:::benchmark_data_smithi188_161190_object79400:head# 2024-04-01T19:56:59.006 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.006 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a8b95ac:::benchmark_data_smithi188_161190_object124902:head# 2024-04-01T19:56:59.006 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.006 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a8c71e5:::benchmark_data_smithi188_161190_object30945:head# 2024-04-01T19:56:59.006 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.006 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a8ceee4:::benchmark_data_smithi188_161190_object95352:head# 2024-04-01T19:56:59.006 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.007 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a8d45ba:::benchmark_data_smithi188_161190_object21594:head# 2024-04-01T19:56:59.007 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.007 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a8e7cd0:::benchmark_data_smithi188_161190_object119301:head# 2024-04-01T19:56:59.007 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.010 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a8e9496:::benchmark_data_smithi188_161190_object84658:head# 2024-04-01T19:56:59.011 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.011 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a8f33ec:::benchmark_data_smithi188_161190_object47290:head# 2024-04-01T19:56:59.011 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.011 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a905ef5:::benchmark_data_smithi188_161190_object71990:head# 2024-04-01T19:56:59.011 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.011 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a909ab6:::benchmark_data_smithi188_161190_object67807:head# 2024-04-01T19:56:59.011 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.011 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a912739:::benchmark_data_smithi188_161190_object95309:head# 2024-04-01T19:56:59.011 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.011 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a9181e3:::benchmark_data_smithi188_161190_object65894:head# 2024-04-01T19:56:59.011 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.011 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a91c75b:::benchmark_data_smithi188_161190_object119223:head# 2024-04-01T19:56:59.011 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.021 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a933764:::benchmark_data_smithi188_161190_object132745:head# 2024-04-01T19:56:59.021 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.021 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a937bb6:::benchmark_data_smithi188_161190_object134340:head# 2024-04-01T19:56:59.021 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.021 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a948212:::benchmark_data_smithi188_161190_object64588:head# 2024-04-01T19:56:59.022 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.022 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a956375:::benchmark_data_smithi188_161190_object67085:head# 2024-04-01T19:56:59.022 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.022 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a957904:::benchmark_data_smithi188_161190_object76125:head# 2024-04-01T19:56:59.022 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.022 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a958392:::benchmark_data_smithi188_161190_object85699:head# 2024-04-01T19:56:59.022 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.022 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a96149d:::benchmark_data_smithi188_161190_object76283:head# 2024-04-01T19:56:59.022 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.022 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a96760f:::benchmark_data_smithi188_161190_object67370:head# 2024-04-01T19:56:59.022 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.022 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a9743a4:::benchmark_data_smithi188_161190_object87089:head# 2024-04-01T19:56:59.023 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.024 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a97cd0a:::benchmark_data_smithi188_161190_object110569:head# 2024-04-01T19:56:59.024 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.024 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a981f13:::benchmark_data_smithi188_161190_object53076:head# 2024-04-01T19:56:59.024 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.024 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a98b4bf:::benchmark_data_smithi188_161190_object77740:head# 2024-04-01T19:56:59.024 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.024 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a98e90b:::benchmark_data_smithi188_161190_object117830:head# 2024-04-01T19:56:59.024 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.024 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a98ebbe:::benchmark_data_smithi188_161190_object98364:head# 2024-04-01T19:56:59.024 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.025 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a998e7c:::benchmark_data_smithi188_161190_object48747:head# 2024-04-01T19:56:59.025 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.025 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a99a18c:::benchmark_data_smithi188_161190_object133285:head# 2024-04-01T19:56:59.025 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.025 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a99a7f8:::benchmark_data_smithi188_161190_object118363:head# 2024-04-01T19:56:59.025 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.025 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a9a6eda:::benchmark_data_smithi188_161190_object131786:head# 2024-04-01T19:56:59.025 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.026 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a9a779a:::benchmark_data_smithi188_161190_object54873:head# 2024-04-01T19:56:59.027 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.027 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a9a9231:::benchmark_data_smithi188_161190_object69298:head# 2024-04-01T19:56:59.027 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.027 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a9d00b2:::benchmark_data_smithi188_161190_object101017:head# 2024-04-01T19:56:59.027 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.027 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a9d0b76:::benchmark_data_smithi188_161190_object111146:head# 2024-04-01T19:56:59.027 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.027 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a9da6ad:::benchmark_data_smithi188_161190_object121359:head# 2024-04-01T19:56:59.027 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.027 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a9e044d:::benchmark_data_smithi188_161190_object30357:head# 2024-04-01T19:56:59.027 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.027 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a9e9956:::benchmark_data_smithi188_161190_object40779:head# 2024-04-01T19:56:59.028 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.028 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9a9f8777:::benchmark_data_smithi188_161190_object53102:head# 2024-04-01T19:56:59.028 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.028 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aa091b0:::benchmark_data_smithi188_161190_object91605:head# 2024-04-01T19:56:59.028 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.028 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aa31c25:::benchmark_data_smithi188_161190_object87808:head# 2024-04-01T19:56:59.028 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.030 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aa323d4:::benchmark_data_smithi188_161190_object114284:head# 2024-04-01T19:56:59.030 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.030 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aa32b7f:::benchmark_data_smithi188_161190_object86447:head# 2024-04-01T19:56:59.030 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.030 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aa359cc:::benchmark_data_smithi188_161190_object95541:head# 2024-04-01T19:56:59.030 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.031 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aa46774:::benchmark_data_smithi188_161190_object45273:head# 2024-04-01T19:56:59.031 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.031 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aa489e6:::benchmark_data_smithi188_161190_object57031:head# 2024-04-01T19:56:59.031 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.031 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aa4915e:::benchmark_data_smithi188_161190_object113478:head# 2024-04-01T19:56:59.031 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.031 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aa51145:::benchmark_data_smithi188_161190_object57035:head# 2024-04-01T19:56:59.031 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.031 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aa62d9b:::benchmark_data_smithi188_161190_object38495:head# 2024-04-01T19:56:59.031 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.031 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aa79e98:::benchmark_data_smithi188_161190_object134941:head# 2024-04-01T19:56:59.031 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.031 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aa845c5:::benchmark_data_smithi188_161190_object76621:head# 2024-04-01T19:56:59.032 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.032 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aa93f9f:::benchmark_data_smithi188_161190_object88544:head# 2024-04-01T19:56:59.032 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.042 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aaac5c5:::benchmark_data_smithi188_161190_object35567:head# 2024-04-01T19:56:59.042 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.044 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aab4df9:::benchmark_data_smithi188_161190_object31607:head# 2024-04-01T19:56:59.044 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.044 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aac00f3:::benchmark_data_smithi188_161190_object93404:head# 2024-04-01T19:56:59.044 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.044 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aac5554:::benchmark_data_smithi188_161190_object71772:head# 2024-04-01T19:56:59.044 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.044 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aac8c08:::benchmark_data_smithi188_161190_object75990:head# 2024-04-01T19:56:59.044 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.044 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aad52be:::benchmark_data_smithi188_161190_object69580:head# 2024-04-01T19:56:59.044 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.047 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aadf221:::benchmark_data_smithi188_161190_object63343:head# 2024-04-01T19:56:59.047 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.047 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aaef6ff:::benchmark_data_smithi188_161190_object110215:head# 2024-04-01T19:56:59.047 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.047 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aaef742:::benchmark_data_smithi188_161190_object92305:head# 2024-04-01T19:56:59.047 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.047 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aaf2a68:::benchmark_data_smithi188_161190_object48956:head# 2024-04-01T19:56:59.048 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.048 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aaf67a9:::benchmark_data_smithi188_161190_object31516:head# 2024-04-01T19:56:59.048 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.048 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ab07295:::benchmark_data_smithi188_161190_object135859:head# 2024-04-01T19:56:59.048 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.048 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ab09ce6:::benchmark_data_smithi188_161190_object64711:head# 2024-04-01T19:56:59.048 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.048 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ab15061:::benchmark_data_smithi188_161190_object54748:head# 2024-04-01T19:56:59.048 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.048 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ab28c12:::benchmark_data_smithi188_161190_object66336:head# 2024-04-01T19:56:59.048 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.049 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ab29f5d:::benchmark_data_smithi188_161190_object29051:head# 2024-04-01T19:56:59.049 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.049 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ab51513:::benchmark_data_smithi188_161190_object38648:head# 2024-04-01T19:56:59.049 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.049 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ab522be:::benchmark_data_smithi188_161190_object42515:head# 2024-04-01T19:56:59.049 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.050 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ab5cdc6:::benchmark_data_smithi188_161190_object93640:head# 2024-04-01T19:56:59.050 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.050 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ab796b0:::benchmark_data_smithi188_161190_object119688:head# 2024-04-01T19:56:59.050 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.053 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ab95180:::benchmark_data_smithi188_161190_object124259:head# 2024-04-01T19:56:59.053 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.053 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aba08a5:::benchmark_data_smithi188_161190_object41726:head# 2024-04-01T19:56:59.053 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.053 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aba4a78:::benchmark_data_smithi188_161190_object116736:head# 2024-04-01T19:56:59.053 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.054 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9abaae3e:::benchmark_data_smithi188_161190_object117345:head# 2024-04-01T19:56:59.054 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.055 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9abacf88:::benchmark_data_smithi188_161190_object137520:head# 2024-04-01T19:56:59.055 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.059 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9abaf2e9:::benchmark_data_smithi188_161190_object129523:head# 2024-04-01T19:56:59.059 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.059 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9abc0c94:::benchmark_data_smithi188_161190_object97477:head# 2024-04-01T19:56:59.059 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.059 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9abcc5e4:::benchmark_data_smithi188_161190_object118074:head# 2024-04-01T19:56:59.059 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.059 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9abd7c74:::benchmark_data_smithi188_161190_object107471:head# 2024-04-01T19:56:59.059 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.061 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9abe79df:::benchmark_data_smithi188_161190_object106145:head# 2024-04-01T19:56:59.061 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.061 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9abe7e36:::benchmark_data_smithi188_161190_object28332:head# 2024-04-01T19:56:59.061 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.061 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9abee519:::benchmark_data_smithi188_161190_object28823:head# 2024-04-01T19:56:59.061 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.062 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac05957:::benchmark_data_smithi188_161190_object56271:head# 2024-04-01T19:56:59.062 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.062 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac07420:::benchmark_data_smithi188_161190_object136548:head# 2024-04-01T19:56:59.062 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.062 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac0c720:::benchmark_data_smithi188_161190_object84661:head# 2024-04-01T19:56:59.062 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.062 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac0e5d0:::benchmark_data_smithi188_161190_object79882:head# 2024-04-01T19:56:59.062 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.062 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac1e4d9:::benchmark_data_smithi188_161190_object72714:head# 2024-04-01T19:56:59.062 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.063 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac1f228:::benchmark_data_smithi188_161190_object80849:head# 2024-04-01T19:56:59.063 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.063 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac203ae:::benchmark_data_smithi188_161190_object87962:head# 2024-04-01T19:56:59.063 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.063 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac376ad:::benchmark_data_smithi188_161190_object62466:head# 2024-04-01T19:56:59.063 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.064 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac38171:::benchmark_data_smithi188_161190_object67049:head# 2024-04-01T19:56:59.064 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.064 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac39210:::benchmark_data_smithi188_161190_object27972:head# 2024-04-01T19:56:59.064 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.065 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac3f332:::benchmark_data_smithi188_161190_object93861:head# 2024-04-01T19:56:59.065 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.065 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac42b67:::benchmark_data_smithi188_161190_object109870:head# 2024-04-01T19:56:59.065 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.065 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac43ba0:::benchmark_data_smithi188_161190_object136476:head# 2024-04-01T19:56:59.065 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.065 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac46f24:::benchmark_data_smithi188_161190_object135003:head# 2024-04-01T19:56:59.065 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.065 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac531ac:::benchmark_data_smithi188_161190_object137922:head# 2024-04-01T19:56:59.065 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.066 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac5aca1:::benchmark_data_smithi188_161190_object37248:head# 2024-04-01T19:56:59.066 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.066 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac675bc:::benchmark_data_smithi188_161190_object129130:head# 2024-04-01T19:56:59.066 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.066 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac67bc1:::benchmark_data_smithi188_161190_object52344:head# 2024-04-01T19:56:59.066 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.070 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac7c5ba:::benchmark_data_smithi188_161190_object37695:head# 2024-04-01T19:56:59.070 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.070 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac89926:::benchmark_data_smithi188_161190_object138366:head# 2024-04-01T19:56:59.070 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.071 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac8bd40:::benchmark_data_smithi188_161190_object78009:head# 2024-04-01T19:56:59.071 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.071 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac8fe95:::benchmark_data_smithi188_161190_object101110:head# 2024-04-01T19:56:59.071 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.075 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac944f2:::benchmark_data_smithi188_161190_object114129:head# 2024-04-01T19:56:59.076 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.076 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac955f9:::benchmark_data_smithi188_161190_object97300:head# 2024-04-01T19:56:59.076 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.076 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac9b7c1:::benchmark_data_smithi188_161190_object82226:head# 2024-04-01T19:56:59.076 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.076 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ac9f11d:::benchmark_data_smithi188_161190_object90121:head# 2024-04-01T19:56:59.076 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.076 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aca50cf:::benchmark_data_smithi188_161190_object98571:head# 2024-04-01T19:56:59.076 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.081 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aca7676:::benchmark_data_smithi188_161190_object89445:head# 2024-04-01T19:56:59.081 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.082 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9acb320f:::benchmark_data_smithi188_161190_object101342:head# 2024-04-01T19:56:59.082 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.082 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9acc547a:::benchmark_data_smithi188_161190_object79695:head# 2024-04-01T19:56:59.083 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.083 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9acc5ba7:::benchmark_data_smithi188_161190_object88057:head# 2024-04-01T19:56:59.083 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.083 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9acd5303:::benchmark_data_smithi188_161190_object131511:head# 2024-04-01T19:56:59.083 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.084 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ace0772:::benchmark_data_smithi188_161190_object137365:head# 2024-04-01T19:56:59.084 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.084 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ace0b81:::benchmark_data_smithi188_161190_object108549:head# 2024-04-01T19:56:59.084 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.084 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ace1fb8:::benchmark_data_smithi188_161190_object71717:head# 2024-04-01T19:56:59.085 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.085 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9acf4309:::benchmark_data_smithi188_161190_object29684:head# 2024-04-01T19:56:59.085 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.085 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9acf8558:::benchmark_data_smithi188_161190_object99084:head# 2024-04-01T19:56:59.085 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.085 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ad060d5:::benchmark_data_smithi188_161190_object66207:head# 2024-04-01T19:56:59.085 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.085 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ad085e1:::benchmark_data_smithi188_161190_object95132:head# 2024-04-01T19:56:59.085 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.087 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ad0eda3:::benchmark_data_smithi188_161190_object55722:head# 2024-04-01T19:56:59.087 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.088 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ad119e7:::benchmark_data_smithi188_161190_object111702:head# 2024-04-01T19:56:59.088 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.089 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ad15141:::benchmark_data_smithi188_161190_object86650:head# 2024-04-01T19:56:59.089 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.089 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ad1687b:::benchmark_data_smithi188_161190_object67689:head# 2024-04-01T19:56:59.089 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.091 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ad18df0:::benchmark_data_smithi188_161190_object81616:head# 2024-04-01T19:56:59.091 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.091 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ad34d3d:::benchmark_data_smithi188_161190_object138410:head# 2024-04-01T19:56:59.091 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.094 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ad4b8e9:::benchmark_data_smithi188_161190_object135232:head# 2024-04-01T19:56:59.094 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.094 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ad55d88:::benchmark_data_smithi188_161190_object83184:head# 2024-04-01T19:56:59.094 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.094 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ad5f179:::benchmark_data_smithi188_161190_object64761:head# 2024-04-01T19:56:59.094 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.094 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ad6a793:::benchmark_data_smithi188_161190_object117955:head# 2024-04-01T19:56:59.095 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.096 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ad6abdf:::benchmark_data_smithi188_161190_object124203:head# 2024-04-01T19:56:59.096 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.097 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ad7f39a:::benchmark_data_smithi188_161190_object45683:head# 2024-04-01T19:56:59.097 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.097 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ad85317:::benchmark_data_smithi188_161190_object105732:head# 2024-04-01T19:56:59.097 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.097 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ad95996:::benchmark_data_smithi188_161190_object131372:head# 2024-04-01T19:56:59.097 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.097 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9adaca12:::benchmark_data_smithi188_161190_object50653:head# 2024-04-01T19:56:59.097 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.098 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9adc1cc6:::benchmark_data_smithi188_161190_object106089:head# 2024-04-01T19:56:59.098 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.098 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9adc2344:::benchmark_data_smithi188_161190_object28400:head# 2024-04-01T19:56:59.098 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.100 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9adc2acf:::benchmark_data_smithi188_161190_object117598:head# 2024-04-01T19:56:59.101 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.101 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9adc5e15:::benchmark_data_smithi188_161190_object39961:head# 2024-04-01T19:56:59.101 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.101 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9adc89e7:::benchmark_data_smithi188_161190_object20768:head# 2024-04-01T19:56:59.101 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.101 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9addd182:::benchmark_data_smithi188_161190_object87969:head# 2024-04-01T19:56:59.101 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.101 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9addd408:::benchmark_data_smithi188_161190_object49218:head# 2024-04-01T19:56:59.101 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.101 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9addd4c2:::benchmark_data_smithi188_161190_object122764:head# 2024-04-01T19:56:59.101 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.101 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9addefd1:::benchmark_data_smithi188_161190_object63426:head# 2024-04-01T19:56:59.101 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.102 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ade5549:::benchmark_data_smithi188_161190_object75599:head# 2024-04-01T19:56:59.102 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.102 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ade5b76:::benchmark_data_smithi188_161190_object69294:head# 2024-04-01T19:56:59.102 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.102 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9adf1172:::benchmark_data_smithi188_161190_object48835:head# 2024-04-01T19:56:59.102 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.102 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9adfcc33:::benchmark_data_smithi188_161190_object65854:head# 2024-04-01T19:56:59.102 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.111 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ae0d3ab:::benchmark_data_smithi188_161190_object60901:head# 2024-04-01T19:56:59.111 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.111 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ae0db0a:::benchmark_data_smithi188_161190_object62739:head# 2024-04-01T19:56:59.111 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.111 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ae145d2:::benchmark_data_smithi188_161190_object87425:head# 2024-04-01T19:56:59.111 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.111 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ae16e18:::benchmark_data_smithi188_161190_object44810:head# 2024-04-01T19:56:59.111 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.111 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ae1ffa5:::benchmark_data_smithi188_161190_object38044:head# 2024-04-01T19:56:59.111 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.111 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ae2e1d2:::benchmark_data_smithi188_161190_object67114:head# 2024-04-01T19:56:59.111 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.111 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ae4ff5c:::benchmark_data_smithi188_161190_object97911:head# 2024-04-01T19:56:59.112 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.112 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ae5dd9b:::benchmark_data_smithi188_161190_object67839:head# 2024-04-01T19:56:59.112 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.112 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ae650b9:::benchmark_data_smithi188_161190_object69195:head# 2024-04-01T19:56:59.112 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.112 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ae736fe:::benchmark_data_smithi188_161190_object136882:head# 2024-04-01T19:56:59.112 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.112 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ae7a579:::benchmark_data_smithi188_161190_object64642:head# 2024-04-01T19:56:59.112 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.112 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ae7c390:::benchmark_data_smithi188_161190_object33735:head# 2024-04-01T19:56:59.112 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.112 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ae87f93:::benchmark_data_smithi188_161190_object108220:head# 2024-04-01T19:56:59.112 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.112 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ae8a397:::benchmark_data_smithi188_161190_object29075:head# 2024-04-01T19:56:59.112 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.115 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ae8a6a3:::benchmark_data_smithi188_161190_object81323:head# 2024-04-01T19:56:59.115 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.115 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ae8dbf5:::benchmark_data_smithi188_161190_object109356:head# 2024-04-01T19:56:59.115 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.115 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ae94e73:::benchmark_data_smithi188_161190_object57292:head# 2024-04-01T19:56:59.115 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.115 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ae98731:::benchmark_data_smithi188_161190_object49594:head# 2024-04-01T19:56:59.116 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.116 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aea250c:::benchmark_data_smithi188_161190_object109638:head# 2024-04-01T19:56:59.116 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.116 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aea9857:::benchmark_data_smithi188_161190_object136250:head# 2024-04-01T19:56:59.116 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.116 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aeb8945:::benchmark_data_smithi188_161190_object69998:head# 2024-04-01T19:56:59.116 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.116 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aeccc4f:::benchmark_data_smithi188_161190_object31994:head# 2024-04-01T19:56:59.116 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.116 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aed3beb:::benchmark_data_smithi188_161190_object135588:head# 2024-04-01T19:56:59.116 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.116 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aed43f2:::benchmark_data_smithi188_161190_object74024:head# 2024-04-01T19:56:59.116 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.117 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aed4f12:::benchmark_data_smithi188_161190_object123607:head# 2024-04-01T19:56:59.117 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.117 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aed917c:::benchmark_data_smithi188_161190_object69293:head# 2024-04-01T19:56:59.117 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.117 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aedd333:::benchmark_data_smithi188_161190_object82608:head# 2024-04-01T19:56:59.117 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.117 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9af02e8e:::benchmark_data_smithi188_161190_object135321:head# 2024-04-01T19:56:59.117 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.117 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9af06804:::benchmark_data_smithi188_161190_object64506:head# 2024-04-01T19:56:59.117 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.118 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9af18658:::benchmark_data_smithi188_161190_object106885:head# 2024-04-01T19:56:59.118 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.118 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9af1cfbc:::benchmark_data_smithi188_161190_object84555:head# 2024-04-01T19:56:59.118 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.118 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9af1fe55:::benchmark_data_smithi188_161190_object66479:head# 2024-04-01T19:56:59.118 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.118 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9af3199a:::benchmark_data_smithi188_161190_object85654:head# 2024-04-01T19:56:59.119 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.119 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9af34ded:::benchmark_data_smithi188_161190_object41903:head# 2024-04-01T19:56:59.119 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.119 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9af3b7fb:::benchmark_data_smithi188_161190_object137005:head# 2024-04-01T19:56:59.119 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.120 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9af3dd26:::benchmark_data_smithi188_161190_object108224:head# 2024-04-01T19:56:59.120 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.120 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9af41881:::benchmark_data_smithi188_161190_object84408:head# 2024-04-01T19:56:59.121 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.121 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9af4b814:::benchmark_data_smithi188_161190_object122697:head# 2024-04-01T19:56:59.121 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.121 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9af52ae3:::benchmark_data_smithi188_161190_object48568:head# 2024-04-01T19:56:59.121 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.121 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9af5edbd:::benchmark_data_smithi188_161190_object56147:head# 2024-04-01T19:56:59.121 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.121 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9af651b6:::benchmark_data_smithi188_161190_object100760:head# 2024-04-01T19:56:59.121 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.121 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9af6dcd4:::benchmark_data_smithi188_161190_object34263:head# 2024-04-01T19:56:59.121 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.121 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9af795c7:::benchmark_data_smithi188_161190_object75004:head# 2024-04-01T19:56:59.121 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.122 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9af7b6a5:::benchmark_data_smithi188_161190_object63467:head# 2024-04-01T19:56:59.122 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.122 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9af7c424:::benchmark_data_smithi188_161190_object65697:head# 2024-04-01T19:56:59.122 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.122 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9af83fb3:::benchmark_data_smithi188_161190_object132797:head# 2024-04-01T19:56:59.122 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.122 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9af894ad:::benchmark_data_smithi188_161190_object21182:head# 2024-04-01T19:56:59.122 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.124 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9af8ba48:::benchmark_data_smithi188_161190_object42187:head# 2024-04-01T19:56:59.124 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.124 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9af8d49b:::benchmark_data_smithi188_161190_object71788:head# 2024-04-01T19:56:59.124 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.124 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9af97d6a:::benchmark_data_smithi188_161190_object54825:head# 2024-04-01T19:56:59.124 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.124 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9afb1712:::benchmark_data_smithi188_161190_object93180:head# 2024-04-01T19:56:59.124 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.124 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9afb479a:::benchmark_data_smithi188_161190_object43422:head# 2024-04-01T19:56:59.124 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.125 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9afb6174:::benchmark_data_smithi188_161190_object83514:head# 2024-04-01T19:56:59.125 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.125 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9afb6511:::benchmark_data_smithi188_161190_object125834:head# 2024-04-01T19:56:59.125 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.125 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9afba1bf:::benchmark_data_smithi188_161190_object60586:head# 2024-04-01T19:56:59.125 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.125 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9afbfb5a:::benchmark_data_smithi188_161190_object122024:head# 2024-04-01T19:56:59.125 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.125 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9afd74aa:::benchmark_data_smithi188_161190_object40154:head# 2024-04-01T19:56:59.125 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.125 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9afe0c89:::benchmark_data_smithi188_161190_object26595:head# 2024-04-01T19:56:59.125 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.125 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9afebd33:::benchmark_data_smithi188_161190_object84754:head# 2024-04-01T19:56:59.125 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.129 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aff5a45:::benchmark_data_smithi188_161190_object67108:head# 2024-04-01T19:56:59.130 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.133 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aff65f2:::benchmark_data_smithi188_161190_object21251:head# 2024-04-01T19:56:59.134 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.134 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9aff8473:::benchmark_data_smithi188_161190_object90060:head# 2024-04-01T19:56:59.134 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.135 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9affb2fa:::benchmark_data_smithi188_161190_object85367:head# 2024-04-01T19:56:59.135 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.135 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b007fe2:::benchmark_data_smithi188_161190_object94893:head# 2024-04-01T19:56:59.135 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.135 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b00dd0d:::benchmark_data_smithi188_161190_object77953:head# 2024-04-01T19:56:59.135 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.135 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b019b81:::benchmark_data_smithi188_161190_object121158:head# 2024-04-01T19:56:59.135 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.135 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b02b9f4:::benchmark_data_smithi188_161190_object105863:head# 2024-04-01T19:56:59.136 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.137 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b041b91:::benchmark_data_smithi188_161190_object118904:head# 2024-04-01T19:56:59.137 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.137 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b0421fd:::benchmark_data_smithi188_161190_object110004:head# 2024-04-01T19:56:59.137 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.137 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b0423bf:::benchmark_data_smithi188_161190_object74383:head# 2024-04-01T19:56:59.137 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.137 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b05d2fc:::benchmark_data_smithi188_161190_object60515:head# 2024-04-01T19:56:59.137 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.137 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b0628c8:::benchmark_data_smithi188_161190_object51456:head# 2024-04-01T19:56:59.137 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.137 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b067610:::benchmark_data_smithi188_161190_object78379:head# 2024-04-01T19:56:59.137 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.139 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b0710b4:::benchmark_data_smithi188_161190_object84148:head# 2024-04-01T19:56:59.139 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.139 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b074789:::benchmark_data_smithi188_161190_object107076:head# 2024-04-01T19:56:59.139 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.139 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b07c8a9:::benchmark_data_smithi188_161190_object91681:head# 2024-04-01T19:56:59.139 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.139 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b07f7c8:::benchmark_data_smithi188_161190_object55619:head# 2024-04-01T19:56:59.139 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.139 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b07facb:::benchmark_data_smithi188_161190_object105529:head# 2024-04-01T19:56:59.139 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.140 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b080ad1:::benchmark_data_smithi188_161190_object100625:head# 2024-04-01T19:56:59.140 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.140 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b08c082:::benchmark_data_smithi188_161190_object113840:head# 2024-04-01T19:56:59.140 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.140 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b0a4a0a:::benchmark_data_smithi188_161190_object56030:head# 2024-04-01T19:56:59.140 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.140 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b0ab062:::benchmark_data_smithi188_161190_object138819:head# 2024-04-01T19:56:59.140 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.142 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b0aba27:::benchmark_data_smithi188_161190_object48945:head# 2024-04-01T19:56:59.142 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.142 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b0b588a:::benchmark_data_smithi188_161190_object77784:head# 2024-04-01T19:56:59.142 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.142 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b0c2d2e:::benchmark_data_smithi188_161190_object135967:head# 2024-04-01T19:56:59.142 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.142 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b0d80d5:::benchmark_data_smithi188_161190_object103742:head# 2024-04-01T19:56:59.142 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.142 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b0dff40:::benchmark_data_smithi188_161190_object36440:head# 2024-04-01T19:56:59.142 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.142 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b0f5862:::benchmark_data_smithi188_161190_object98834:head# 2024-04-01T19:56:59.142 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.143 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b0fd4b4:::benchmark_data_smithi188_161190_object36766:head# 2024-04-01T19:56:59.143 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.143 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b10dc6e:::benchmark_data_smithi188_161190_object56872:head# 2024-04-01T19:56:59.143 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.143 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b110228:::benchmark_data_smithi188_161190_object26500:head# 2024-04-01T19:56:59.143 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.143 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b117c42:::benchmark_data_smithi188_161190_object112846:head# 2024-04-01T19:56:59.143 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.143 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b11909d:::benchmark_data_smithi188_161190_object46142:head# 2024-04-01T19:56:59.143 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.143 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b11b93c:::benchmark_data_smithi188_161190_object95206:head# 2024-04-01T19:56:59.144 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.144 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b11e3d4:::benchmark_data_smithi188_161190_object70162:head# 2024-04-01T19:56:59.144 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.153 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b125259:::benchmark_data_smithi188_161190_object100217:head# 2024-04-01T19:56:59.153 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.153 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b12966d:::benchmark_data_smithi188_161190_object128588:head# 2024-04-01T19:56:59.153 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.153 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b12be6e:::benchmark_data_smithi188_161190_object58693:head# 2024-04-01T19:56:59.153 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.154 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b1372b7:::benchmark_data_smithi188_161190_object136460:head# 2024-04-01T19:56:59.154 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.154 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b144375:::benchmark_data_smithi188_161190_object73971:head# 2024-04-01T19:56:59.154 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.158 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b153e12:::benchmark_data_smithi188_161190_object49181:head# 2024-04-01T19:56:59.158 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.158 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b154a78:::benchmark_data_smithi188_161190_object59821:head# 2024-04-01T19:56:59.158 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.158 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b15845c:::benchmark_data_smithi188_161190_object27598:head# 2024-04-01T19:56:59.158 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.158 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b15f11b:::benchmark_data_smithi188_161190_object106033:head# 2024-04-01T19:56:59.158 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.158 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b1607e4:::benchmark_data_smithi188_161190_object110904:head# 2024-04-01T19:56:59.158 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.159 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b163377:::benchmark_data_smithi188_161190_object35841:head# 2024-04-01T19:56:59.159 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.159 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b16d6e5:::benchmark_data_smithi188_161190_object84171:head# 2024-04-01T19:56:59.159 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.159 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b1751a6:::benchmark_data_smithi188_161190_object90050:head# 2024-04-01T19:56:59.159 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.159 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b17f7b4:::benchmark_data_smithi188_161190_object132848:head# 2024-04-01T19:56:59.159 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.159 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b183ec5:::benchmark_data_smithi188_161190_object72830:head# 2024-04-01T19:56:59.159 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.159 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b185d22:::benchmark_data_smithi188_161190_object41165:head# 2024-04-01T19:56:59.159 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.159 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b18dcac:::benchmark_data_smithi188_161190_object33166:head# 2024-04-01T19:56:59.160 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.160 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b18f6ea:::benchmark_data_smithi188_161190_object93620:head# 2024-04-01T19:56:59.160 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.160 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b196fa1:::benchmark_data_smithi188_161190_object119149:head# 2024-04-01T19:56:59.160 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.170 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b1a9e0c:::benchmark_data_smithi188_161190_object138528:head# 2024-04-01T19:56:59.170 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.170 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b1aba37:::benchmark_data_smithi188_161190_object115802:head# 2024-04-01T19:56:59.170 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.170 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b1afa3c:::benchmark_data_smithi188_161190_object57787:head# 2024-04-01T19:56:59.170 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.171 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b1b10e1:::benchmark_data_smithi188_161190_object25189:head# 2024-04-01T19:56:59.171 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.171 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b1b9e85:::benchmark_data_smithi188_161190_object92370:head# 2024-04-01T19:56:59.171 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.171 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b1c1387:::benchmark_data_smithi188_161190_object49988:head# 2024-04-01T19:56:59.171 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.171 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b1c8ad3:::benchmark_data_smithi188_161190_object59379:head# 2024-04-01T19:56:59.171 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.171 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b1ccec1:::benchmark_data_smithi188_161190_object115410:head# 2024-04-01T19:56:59.171 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.171 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b1d4c6e:::benchmark_data_smithi188_161190_object101191:head# 2024-04-01T19:56:59.171 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.171 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b1d533f:::benchmark_data_smithi188_161190_object96615:head# 2024-04-01T19:56:59.171 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.171 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b1dfcb7:::benchmark_data_smithi188_161190_object34249:head# 2024-04-01T19:56:59.171 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.172 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b1ed4bd:::benchmark_data_smithi188_161190_object130704:head# 2024-04-01T19:56:59.172 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.172 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b1ed4ca:::benchmark_data_smithi188_161190_object50958:head# 2024-04-01T19:56:59.172 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.172 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b1ee4f2:::benchmark_data_smithi188_161190_object120154:head# 2024-04-01T19:56:59.172 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.172 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b1f9e9a:::benchmark_data_smithi188_161190_object118573:head# 2024-04-01T19:56:59.172 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.172 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b1ff1db:::benchmark_data_smithi188_161190_object92833:head# 2024-04-01T19:56:59.172 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.172 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b2037b4:::benchmark_data_smithi188_161190_object99341:head# 2024-04-01T19:56:59.172 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.172 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b210349:::benchmark_data_smithi188_161190_object27742:head# 2024-04-01T19:56:59.173 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.173 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b21268d:::benchmark_data_smithi188_161190_object35925:head# 2024-04-01T19:56:59.173 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.173 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b216333:::benchmark_data_smithi188_161190_object101237:head# 2024-04-01T19:56:59.173 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.173 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b2197af:::benchmark_data_smithi188_161190_object35691:head# 2024-04-01T19:56:59.173 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.173 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b228489:::benchmark_data_smithi188_161190_object75699:head# 2024-04-01T19:56:59.173 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.173 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b22fa56:::benchmark_data_smithi188_161190_object22345:head# 2024-04-01T19:56:59.173 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.173 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b237551:::benchmark_data_smithi188_161190_object72728:head# 2024-04-01T19:56:59.173 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.174 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b239847:::benchmark_data_smithi188_161190_object91021:head# 2024-04-01T19:56:59.174 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.174 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b247d79:::benchmark_data_smithi188_161190_object62484:head# 2024-04-01T19:56:59.174 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.174 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b24c667:::benchmark_data_smithi188_161190_object75381:head# 2024-04-01T19:56:59.174 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.174 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b250966:::benchmark_data_smithi188_161190_object128689:head# 2024-04-01T19:56:59.174 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.174 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b2631e7:::benchmark_data_smithi188_161190_object127977:head# 2024-04-01T19:56:59.174 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.174 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b2633cb:::benchmark_data_smithi188_161190_object62165:head# 2024-04-01T19:56:59.174 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.174 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b264f2f:::benchmark_data_smithi188_161190_object136019:head# 2024-04-01T19:56:59.174 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.175 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b26a976:::benchmark_data_smithi188_161190_object63430:head# 2024-04-01T19:56:59.175 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.175 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b26aa58:::benchmark_data_smithi188_161190_object89772:head# 2024-04-01T19:56:59.175 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.175 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b26c28c:::benchmark_data_smithi188_161190_object30091:head# 2024-04-01T19:56:59.175 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.175 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b27fd7d:::benchmark_data_smithi188_161190_object74121:head# 2024-04-01T19:56:59.175 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.176 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b2923f6:::benchmark_data_smithi188_161190_object133924:head# 2024-04-01T19:56:59.176 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.176 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b293b6c:::benchmark_data_smithi188_161190_object121360:head# 2024-04-01T19:56:59.176 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.176 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b298888:::benchmark_data_smithi188_161190_object38099:head# 2024-04-01T19:56:59.176 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.176 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b29cd49:::benchmark_data_smithi188_161190_object91226:head# 2024-04-01T19:56:59.176 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.176 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b29e2c8:::benchmark_data_smithi188_161190_object56624:head# 2024-04-01T19:56:59.176 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.177 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b2a10e1:::benchmark_data_smithi188_161190_object102955:head# 2024-04-01T19:56:59.177 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.188 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b2c3d97:::benchmark_data_smithi188_161190_object106614:head# 2024-04-01T19:56:59.188 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.188 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b2c95a1:::benchmark_data_smithi188_161190_object95028:head# 2024-04-01T19:56:59.188 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.188 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b2d8142:::benchmark_data_smithi188_161190_object63553:head# 2024-04-01T19:56:59.188 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.188 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b2e4628:::benchmark_data_smithi188_161190_object108129:head# 2024-04-01T19:56:59.189 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.189 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b2e5801:::benchmark_data_smithi188_161190_object129225:head# 2024-04-01T19:56:59.189 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.189 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b2ed2ea:::benchmark_data_smithi188_161190_object109908:head# 2024-04-01T19:56:59.189 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.189 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b2f3d43:::benchmark_data_smithi188_161190_object36305:head# 2024-04-01T19:56:59.189 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.190 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b319977:::benchmark_data_smithi188_161190_object81011:head# 2024-04-01T19:56:59.190 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.190 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b32c469:::benchmark_data_smithi188_161190_object126600:head# 2024-04-01T19:56:59.190 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.194 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b333996:::benchmark_data_smithi188_161190_object127089:head# 2024-04-01T19:56:59.194 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.196 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b33c7fa:::benchmark_data_smithi188_161190_object36549:head# 2024-04-01T19:56:59.196 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.196 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b3493e9:::benchmark_data_smithi188_161190_object41462:head# 2024-04-01T19:56:59.196 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.197 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b34acbc:::benchmark_data_smithi188_161190_object75641:head# 2024-04-01T19:56:59.197 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.197 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b351c66:::benchmark_data_smithi188_161190_object45562:head# 2024-04-01T19:56:59.197 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.197 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b359bef:::benchmark_data_smithi188_161190_object109905:head# 2024-04-01T19:56:59.197 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.198 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b35d3cb:::benchmark_data_smithi188_161190_object63742:head# 2024-04-01T19:56:59.198 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.198 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b377fa3:::benchmark_data_smithi188_161190_object81626:head# 2024-04-01T19:56:59.198 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.198 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b37dbb9:::benchmark_data_smithi188_161190_object103961:head# 2024-04-01T19:56:59.198 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.198 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b388848:::benchmark_data_smithi188_161190_object124883:head# 2024-04-01T19:56:59.198 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.198 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b3917b1:::benchmark_data_smithi188_161190_object58169:head# 2024-04-01T19:56:59.199 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.200 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b3950f4:::benchmark_data_smithi188_161190_object54006:head# 2024-04-01T19:56:59.200 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.201 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b3b0aa5:::benchmark_data_smithi188_161190_object53799:head# 2024-04-01T19:56:59.201 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.201 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b3c00b0:::benchmark_data_smithi188_161190_object94529:head# 2024-04-01T19:56:59.201 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.201 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b3c0ecc:::benchmark_data_smithi188_161190_object93580:head# 2024-04-01T19:56:59.201 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.201 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b3d141d:::benchmark_data_smithi188_161190_object99616:head# 2024-04-01T19:56:59.201 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.201 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b3d1911:::benchmark_data_smithi188_161190_object31551:head# 2024-04-01T19:56:59.201 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.201 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b3d73e8:::benchmark_data_smithi188_161190_object45770:head# 2024-04-01T19:56:59.201 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.201 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b3d75f1:::benchmark_data_smithi188_161190_object21000:head# 2024-04-01T19:56:59.202 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.202 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b3d7e9a:::benchmark_data_smithi188_161190_object43579:head# 2024-04-01T19:56:59.202 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.202 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b3dad25:::benchmark_data_smithi188_161190_object71907:head# 2024-04-01T19:56:59.202 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.202 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b3e0683:::benchmark_data_smithi188_161190_object36830:head# 2024-04-01T19:56:59.203 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.203 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b3e2730:::benchmark_data_smithi188_161190_object29495:head# 2024-04-01T19:56:59.203 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.203 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b3e7fd7:::benchmark_data_smithi188_161190_object90704:head# 2024-04-01T19:56:59.203 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b3e8b39:::benchmark_data_smithi188_161190_object92911:head# 2024-04-01T19:56:59.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b3f1773:::benchmark_data_smithi188_161190_object42189:head# 2024-04-01T19:56:59.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b3f1f27:::benchmark_data_smithi188_161190_object76875:head# 2024-04-01T19:56:59.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b3fc8dc:::benchmark_data_smithi188_161190_object135140:head# 2024-04-01T19:56:59.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b3fe046:::benchmark_data_smithi188_161190_object78393:head# 2024-04-01T19:56:59.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b4229d8:::benchmark_data_smithi188_161190_object129173:head# 2024-04-01T19:56:59.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b4310c6:::benchmark_data_smithi188_161190_object121769:head# 2024-04-01T19:56:59.205 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.205 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b43266d:::benchmark_data_smithi188_161190_object32683:head# 2024-04-01T19:56:59.205 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.206 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b439dcc:::benchmark_data_smithi188_161190_object46465:head# 2024-04-01T19:56:59.206 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.206 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b4473de:::benchmark_data_smithi188_161190_object98939:head# 2024-04-01T19:56:59.207 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.207 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b449de1:::benchmark_data_smithi188_161190_object71599:head# 2024-04-01T19:56:59.207 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.207 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b45073a:::benchmark_data_smithi188_161190_object25835:head# 2024-04-01T19:56:59.207 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.207 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b464b00:::benchmark_data_smithi188_161190_object117726:head# 2024-04-01T19:56:59.207 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.207 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b46ba32:::benchmark_data_smithi188_161190_object117992:head# 2024-04-01T19:56:59.207 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.207 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b473358:::benchmark_data_smithi188_161190_object92060:head# 2024-04-01T19:56:59.207 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.207 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b47c91d:::benchmark_data_smithi188_161190_object108029:head# 2024-04-01T19:56:59.207 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.208 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b47d8f2:::benchmark_data_smithi188_161190_object100233:head# 2024-04-01T19:56:59.208 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.208 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b47f7be:::benchmark_data_smithi188_161190_object63682:head# 2024-04-01T19:56:59.208 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.209 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b493c0f:::benchmark_data_smithi188_161190_object62806:head# 2024-04-01T19:56:59.209 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.209 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b494e2f:::benchmark_data_smithi188_161190_object31848:head# 2024-04-01T19:56:59.209 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.209 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b49bd39:::benchmark_data_smithi188_161190_object124994:head# 2024-04-01T19:56:59.209 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.209 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b49c672:::benchmark_data_smithi188_161190_object63904:head# 2024-04-01T19:56:59.209 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.209 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b4a6b25:::benchmark_data_smithi188_161190_object117778:head# 2024-04-01T19:56:59.209 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.212 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b4aec16:::benchmark_data_smithi188_161190_object123352:head# 2024-04-01T19:56:59.212 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.212 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b4b17ac:::benchmark_data_smithi188_161190_object69081:head# 2024-04-01T19:56:59.212 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.212 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b4b9bbd:::benchmark_data_smithi188_161190_object31318:head# 2024-04-01T19:56:59.212 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.215 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b4c4856:::benchmark_data_smithi188_161190_object81870:head# 2024-04-01T19:56:59.215 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.215 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b4d07dd:::benchmark_data_smithi188_161190_object21229:head# 2024-04-01T19:56:59.215 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.217 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b4d190b:::benchmark_data_smithi188_161190_object136429:head# 2024-04-01T19:56:59.217 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.217 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b4dfce3:::benchmark_data_smithi188_161190_object93352:head# 2024-04-01T19:56:59.217 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.217 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b4e9acf:::benchmark_data_smithi188_161190_object46661:head# 2024-04-01T19:56:59.217 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.218 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b4ef1ac:::benchmark_data_smithi188_161190_object118822:head# 2024-04-01T19:56:59.218 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.218 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b4f15a5:::benchmark_data_smithi188_161190_object105514:head# 2024-04-01T19:56:59.218 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.219 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b4f2fc0:::benchmark_data_smithi188_161190_object22713:head# 2024-04-01T19:56:59.219 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.223 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b4fb46f:::benchmark_data_smithi188_161190_object107943:head# 2024-04-01T19:56:59.223 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.223 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b4fda8c:::benchmark_data_smithi188_161190_object100376:head# 2024-04-01T19:56:59.223 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.223 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b4fe01c:::benchmark_data_smithi188_161190_object130137:head# 2024-04-01T19:56:59.224 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.224 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b508710:::benchmark_data_smithi188_161190_object105560:head# 2024-04-01T19:56:59.224 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.224 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b509e51:::benchmark_data_smithi188_161190_object42236:head# 2024-04-01T19:56:59.224 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.224 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b50e204:::benchmark_data_smithi188_161190_object58429:head# 2024-04-01T19:56:59.224 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.224 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b512dcc:::benchmark_data_smithi188_161190_object39355:head# 2024-04-01T19:56:59.224 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.224 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b51df44:::benchmark_data_smithi188_161190_object122854:head# 2024-04-01T19:56:59.224 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.224 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b525dcf:::benchmark_data_smithi188_161190_object74805:head# 2024-04-01T19:56:59.224 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.224 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b526f53:::benchmark_data_smithi188_161190_object33746:head# 2024-04-01T19:56:59.225 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.225 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b53b2d2:::benchmark_data_smithi188_161190_object69835:head# 2024-04-01T19:56:59.225 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.225 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b53b67f:::benchmark_data_smithi188_161190_object37030:head# 2024-04-01T19:56:59.225 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.225 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b54003e:::benchmark_data_smithi188_161190_object110649:head# 2024-04-01T19:56:59.225 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.225 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b548126:::benchmark_data_smithi188_161190_object99348:head# 2024-04-01T19:56:59.225 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.225 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b555e64:::benchmark_data_smithi188_161190_object25374:head# 2024-04-01T19:56:59.225 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.225 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b565d29:::benchmark_data_smithi188_161190_object36499:head# 2024-04-01T19:56:59.225 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.225 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b56aeec:::benchmark_data_smithi188_161190_object78061:head# 2024-04-01T19:56:59.225 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.231 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b58565f:::benchmark_data_smithi188_161190_object92013:head# 2024-04-01T19:56:59.231 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.231 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b587a26:::benchmark_data_smithi188_161190_object97305:head# 2024-04-01T19:56:59.231 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.231 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b5a2fc4:::benchmark_data_smithi188_161190_object74401:head# 2024-04-01T19:56:59.231 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.231 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b5a42c2:::benchmark_data_smithi188_161190_object43342:head# 2024-04-01T19:56:59.231 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.231 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b5a8b40:::benchmark_data_smithi188_161190_object119882:head# 2024-04-01T19:56:59.231 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.231 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b5af6b7:::benchmark_data_smithi188_161190_object65664:head# 2024-04-01T19:56:59.231 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.233 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b5b6c5f:::benchmark_data_smithi188_161190_object38299:head# 2024-04-01T19:56:59.233 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.234 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b5ba95b:::benchmark_data_smithi188_161190_object131761:head# 2024-04-01T19:56:59.234 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.234 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b5c6f95:::benchmark_data_smithi188_161190_object71756:head# 2024-04-01T19:56:59.234 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.235 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b5cbef5:::benchmark_data_smithi188_161190_object112139:head# 2024-04-01T19:56:59.235 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.235 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b5db58d:::benchmark_data_smithi188_161190_object124748:head# 2024-04-01T19:56:59.235 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.235 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b5de15b:::benchmark_data_smithi188_161190_object62094:head# 2024-04-01T19:56:59.235 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.235 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b5fb504:::benchmark_data_smithi188_161190_object126218:head# 2024-04-01T19:56:59.235 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.236 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b6000bf:::benchmark_data_smithi188_161190_object24097:head# 2024-04-01T19:56:59.236 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.237 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b60709a:::benchmark_data_smithi188_161190_object118330:head# 2024-04-01T19:56:59.237 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.237 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b609e5e:::benchmark_data_smithi188_161190_object93546:head# 2024-04-01T19:56:59.237 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.237 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b60f444:::benchmark_data_smithi188_161190_object71122:head# 2024-04-01T19:56:59.237 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.237 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b61fe35:::benchmark_data_smithi188_161190_object51743:head# 2024-04-01T19:56:59.237 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.237 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b62dd3a:::benchmark_data_smithi188_161190_object131522:head# 2024-04-01T19:56:59.237 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.240 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b630d2f:::benchmark_data_smithi188_161190_object47030:head# 2024-04-01T19:56:59.240 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.243 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b633b19:::benchmark_data_smithi188_161190_object62449:head# 2024-04-01T19:56:59.243 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.243 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b6382d6:::benchmark_data_smithi188_161190_object84679:head# 2024-04-01T19:56:59.243 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.246 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b63fcd4:::benchmark_data_smithi188_161190_object70581:head# 2024-04-01T19:56:59.246 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.246 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b64fd5f:::benchmark_data_smithi188_161190_object137299:head# 2024-04-01T19:56:59.246 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.246 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b6509b0:::benchmark_data_smithi188_161190_object84496:head# 2024-04-01T19:56:59.246 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.247 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b6543e8:::benchmark_data_smithi188_161190_object118186:head# 2024-04-01T19:56:59.248 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.248 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b65958f:::benchmark_data_smithi188_161190_object31719:head# 2024-04-01T19:56:59.248 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.248 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b65c268:::benchmark_data_smithi188_161190_object72281:head# 2024-04-01T19:56:59.248 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.249 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b66d142:::benchmark_data_smithi188_161190_object48454:head# 2024-04-01T19:56:59.249 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.249 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b679004:::benchmark_data_smithi188_161190_object128069:head# 2024-04-01T19:56:59.250 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.250 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b688e34:::benchmark_data_smithi188_161190_object52414:head# 2024-04-01T19:56:59.250 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.250 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b68990d:::benchmark_data_smithi188_161190_object131117:head# 2024-04-01T19:56:59.250 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.250 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b68a850:::benchmark_data_smithi188_161190_object61006:head# 2024-04-01T19:56:59.250 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.250 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b69ca04:::benchmark_data_smithi188_161190_object123583:head# 2024-04-01T19:56:59.251 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.251 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b69d8b7:::benchmark_data_smithi188_161190_object60673:head# 2024-04-01T19:56:59.251 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.251 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b6a08a7:::benchmark_data_smithi188_161190_object70374:head# 2024-04-01T19:56:59.251 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.252 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b6a1a61:::benchmark_data_smithi188_161190_object130439:head# 2024-04-01T19:56:59.252 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.252 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b6a6d6b:::benchmark_data_smithi188_161190_object80940:head# 2024-04-01T19:56:59.252 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.252 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b6aac8a:::benchmark_data_smithi188_161190_object116582:head# 2024-04-01T19:56:59.252 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.252 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b6c83e9:::benchmark_data_smithi188_161190_object25647:head# 2024-04-01T19:56:59.252 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.253 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b6d539c:::benchmark_data_smithi188_161190_object112165:head# 2024-04-01T19:56:59.253 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.253 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b6d880a:::benchmark_data_smithi188_161190_object87788:head# 2024-04-01T19:56:59.254 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.254 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b6ee48b:::benchmark_data_smithi188_161190_object61412:head# 2024-04-01T19:56:59.254 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.254 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b6f8222:::benchmark_data_smithi188_161190_object135413:head# 2024-04-01T19:56:59.254 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.254 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b6fb63a:::benchmark_data_smithi188_161190_object71187:head# 2024-04-01T19:56:59.254 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.254 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b6ff77c:::benchmark_data_smithi188_161190_object119257:head# 2024-04-01T19:56:59.254 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.254 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b713d16:::benchmark_data_smithi188_161190_object34347:head# 2024-04-01T19:56:59.254 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.256 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b7156af:::benchmark_data_smithi188_161190_object22005:head# 2024-04-01T19:56:59.256 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.256 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b715fce:::benchmark_data_smithi188_161190_object124021:head# 2024-04-01T19:56:59.256 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.256 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b718b65:::benchmark_data_smithi188_161190_object127750:head# 2024-04-01T19:56:59.256 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.256 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b72176d:::benchmark_data_smithi188_161190_object73960:head# 2024-04-01T19:56:59.256 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.256 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b74988e:::benchmark_data_smithi188_161190_object48460:head# 2024-04-01T19:56:59.256 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.256 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b74da30:::benchmark_data_smithi188_161190_object30689:head# 2024-04-01T19:56:59.256 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.257 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b74eecd:::benchmark_data_smithi188_161190_object34766:head# 2024-04-01T19:56:59.257 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.257 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b7648aa:::benchmark_data_smithi188_161190_object19914:head# 2024-04-01T19:56:59.257 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.258 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b765a47:::benchmark_data_smithi188_161190_object93417:head# 2024-04-01T19:56:59.258 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.258 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b76d1e8:::benchmark_data_smithi188_161190_object68046:head# 2024-04-01T19:56:59.258 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.258 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b7716ce:::benchmark_data_smithi188_161190_object102499:head# 2024-04-01T19:56:59.259 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.259 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b77acc3:::benchmark_data_smithi188_161190_object131384:head# 2024-04-01T19:56:59.259 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.259 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b77f16d:::benchmark_data_smithi188_161190_object124795:head# 2024-04-01T19:56:59.259 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.259 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b77f866:::benchmark_data_smithi188_161190_object28455:head# 2024-04-01T19:56:59.259 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.259 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b7848fa:::benchmark_data_smithi188_161190_object53594:head# 2024-04-01T19:56:59.259 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.259 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b78f7b8:::benchmark_data_smithi188_161190_object120072:head# 2024-04-01T19:56:59.259 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.259 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b7bde8f:::benchmark_data_smithi188_161190_object125870:head# 2024-04-01T19:56:59.259 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.260 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b7c5a19:::benchmark_data_smithi188_161190_object57196:head# 2024-04-01T19:56:59.260 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.261 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b7c80f3:::benchmark_data_smithi188_161190_object89438:head# 2024-04-01T19:56:59.261 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.261 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b7e3ceb:::benchmark_data_smithi188_161190_object121522:head# 2024-04-01T19:56:59.261 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.261 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b7ee386:::benchmark_data_smithi188_161190_object64968:head# 2024-04-01T19:56:59.261 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.261 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b7f4b6c:::benchmark_data_smithi188_161190_object109272:head# 2024-04-01T19:56:59.261 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.261 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b800457:::benchmark_data_smithi188_161190_object118051:head# 2024-04-01T19:56:59.261 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.262 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b805b7c:::benchmark_data_smithi188_161190_object90306:head# 2024-04-01T19:56:59.262 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.262 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b8103fd:::benchmark_data_smithi188_161190_object83186:head# 2024-04-01T19:56:59.262 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.262 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b824974:::benchmark_data_smithi188_161190_object137491:head# 2024-04-01T19:56:59.262 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.262 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b84a025:::benchmark_data_smithi188_161190_object136010:head# 2024-04-01T19:56:59.262 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.263 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b84fd9b:::benchmark_data_smithi188_161190_object81235:head# 2024-04-01T19:56:59.263 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.263 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b852688:::benchmark_data_smithi188_161190_object98326:head# 2024-04-01T19:56:59.263 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.263 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b8626e8:::benchmark_data_smithi188_161190_object93451:head# 2024-04-01T19:56:59.264 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.264 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b863193:::benchmark_data_smithi188_161190_object27614:head# 2024-04-01T19:56:59.264 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.264 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b866fba:::benchmark_data_smithi188_161190_object133446:head# 2024-04-01T19:56:59.264 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.264 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b86a121:::benchmark_data_smithi188_161190_object50397:head# 2024-04-01T19:56:59.264 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.264 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b86e4ec:::benchmark_data_smithi188_161190_object84241:head# 2024-04-01T19:56:59.264 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.264 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b8793e2:::benchmark_data_smithi188_161190_object94713:head# 2024-04-01T19:56:59.264 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.264 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b87db42:::benchmark_data_smithi188_161190_object76065:head# 2024-04-01T19:56:59.264 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.265 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b884052:::benchmark_data_smithi188_161190_object34366:head# 2024-04-01T19:56:59.266 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.266 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b89af20:::benchmark_data_smithi188_161190_object103681:head# 2024-04-01T19:56:59.266 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.266 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b8adf87:::benchmark_data_smithi188_161190_object114996:head# 2024-04-01T19:56:59.266 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.266 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b8aef8d:::benchmark_data_smithi188_161190_object21544:head# 2024-04-01T19:56:59.266 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.266 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b8d1190:::benchmark_data_smithi188_161190_object29656:head# 2024-04-01T19:56:59.266 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.270 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b8d1c15:::benchmark_data_smithi188_161190_object56584:head# 2024-04-01T19:56:59.270 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.271 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b8e7dc7:::benchmark_data_smithi188_161190_object76684:head# 2024-04-01T19:56:59.271 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.271 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b8e9d8a:::benchmark_data_smithi188_161190_object126011:head# 2024-04-01T19:56:59.271 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.271 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b8f1726:::benchmark_data_smithi188_161190_object104778:head# 2024-04-01T19:56:59.271 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.272 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b8fad88:::benchmark_data_smithi188_161190_object92817:head# 2024-04-01T19:56:59.272 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.272 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b92987d:::benchmark_data_smithi188_161190_object134441:head# 2024-04-01T19:56:59.272 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.272 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b92b6f2:::benchmark_data_smithi188_161190_object34614:head# 2024-04-01T19:56:59.272 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.272 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b92dd17:::benchmark_data_smithi188_161190_object100461:head# 2024-04-01T19:56:59.272 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.273 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b933e22:::benchmark_data_smithi188_161190_object125246:head# 2024-04-01T19:56:59.273 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.273 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b935e8c:::benchmark_data_smithi188_161190_object138244:head# 2024-04-01T19:56:59.273 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.274 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b93894f:::benchmark_data_smithi188_161190_object121441:head# 2024-04-01T19:56:59.274 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.274 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b940990:::benchmark_data_smithi188_161190_object134470:head# 2024-04-01T19:56:59.274 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.274 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b94625d:::benchmark_data_smithi188_161190_object21083:head# 2024-04-01T19:56:59.274 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.274 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b9598ff:::benchmark_data_smithi188_161190_object34482:head# 2024-04-01T19:56:59.274 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.275 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b95eb06:::benchmark_data_smithi188_161190_object76295:head# 2024-04-01T19:56:59.275 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.275 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b9818f0:::benchmark_data_smithi188_161190_object118742:head# 2024-04-01T19:56:59.275 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.275 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b983821:::benchmark_data_smithi188_161190_object37518:head# 2024-04-01T19:56:59.275 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.276 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b98e3a6:::benchmark_data_smithi188_161190_object38715:head# 2024-04-01T19:56:59.276 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.276 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b9939ee:::benchmark_data_smithi188_161190_object39023:head# 2024-04-01T19:56:59.276 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.276 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b998b14:::benchmark_data_smithi188_161190_object59920:head# 2024-04-01T19:56:59.276 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.276 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b99f79d:::benchmark_data_smithi188_161190_object38403:head# 2024-04-01T19:56:59.276 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.277 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b9a4b48:::benchmark_data_smithi188_161190_object91703:head# 2024-04-01T19:56:59.277 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.282 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b9c3754:::benchmark_data_smithi188_161190_object80822:head# 2024-04-01T19:56:59.282 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.283 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b9ce08f:::benchmark_data_smithi188_161190_object26444:head# 2024-04-01T19:56:59.283 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.283 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b9d3590:::benchmark_data_smithi188_161190_object59197:head# 2024-04-01T19:56:59.283 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.283 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b9d7eea:::benchmark_data_smithi188_161190_object74251:head# 2024-04-01T19:56:59.283 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.283 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b9ec0d6:::benchmark_data_smithi188_161190_object46502:head# 2024-04-01T19:56:59.283 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.283 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b9f804c:::benchmark_data_smithi188_161190_object80453:head# 2024-04-01T19:56:59.283 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.283 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9b9fa044:::benchmark_data_smithi188_161190_object38077:head# 2024-04-01T19:56:59.283 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.283 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ba05079:::benchmark_data_smithi188_161190_object35037:head# 2024-04-01T19:56:59.283 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.283 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ba0ceca:::benchmark_data_smithi188_161190_object123128:head# 2024-04-01T19:56:59.284 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.284 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ba1c112:::benchmark_data_smithi188_161190_object38152:head# 2024-04-01T19:56:59.284 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.284 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ba28799:::benchmark_data_smithi188_161190_object21018:head# 2024-04-01T19:56:59.284 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.284 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ba2e8ce:::benchmark_data_smithi188_161190_object66719:head# 2024-04-01T19:56:59.284 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.284 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ba2fdf8:::benchmark_data_smithi188_161190_object74836:head# 2024-04-01T19:56:59.284 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.284 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ba331bb:::benchmark_data_smithi188_161190_object29924:head# 2024-04-01T19:56:59.284 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.284 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ba40d0f:::benchmark_data_smithi188_161190_object117303:head# 2024-04-01T19:56:59.284 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.286 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ba50957:::benchmark_data_smithi188_161190_object128771:head# 2024-04-01T19:56:59.286 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.286 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ba547c9:::benchmark_data_smithi188_161190_object118781:head# 2024-04-01T19:56:59.286 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.287 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ba74535:::benchmark_data_smithi188_161190_object131473:head# 2024-04-01T19:56:59.287 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.287 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ba7ec69:::benchmark_data_smithi188_161190_object19828:head# 2024-04-01T19:56:59.287 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.287 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ba7fea5:::benchmark_data_smithi188_161190_object81869:head# 2024-04-01T19:56:59.288 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.288 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ba8055d:::benchmark_data_smithi188_161190_object97395:head# 2024-04-01T19:56:59.288 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.288 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ba8e917:::benchmark_data_smithi188_161190_object52123:head# 2024-04-01T19:56:59.288 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.288 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ba8fad2:::benchmark_data_smithi188_161190_object91750:head# 2024-04-01T19:56:59.288 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.289 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ba96c47:::benchmark_data_smithi188_161190_object79560:head# 2024-04-01T19:56:59.290 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.290 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9baaffea:::benchmark_data_smithi188_161190_object137290:head# 2024-04-01T19:56:59.290 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.290 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bac7f72:::benchmark_data_smithi188_161190_object36751:head# 2024-04-01T19:56:59.290 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.290 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9badd442:::benchmark_data_smithi188_161190_object120958:head# 2024-04-01T19:56:59.290 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.290 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bade403:::benchmark_data_smithi188_161190_object23163:head# 2024-04-01T19:56:59.290 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.291 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bae4f40:::benchmark_data_smithi188_161190_object24910:head# 2024-04-01T19:56:59.291 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.291 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bae899a:::benchmark_data_smithi188_161190_object23465:head# 2024-04-01T19:56:59.291 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.291 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9baeae1b:::benchmark_data_smithi188_161190_object52298:head# 2024-04-01T19:56:59.292 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.292 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9baf4ff8:::benchmark_data_smithi188_161190_object131377:head# 2024-04-01T19:56:59.292 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.292 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9baf6341:::benchmark_data_smithi188_161190_object106903:head# 2024-04-01T19:56:59.292 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.293 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bb00586:::benchmark_data_smithi188_161190_object54938:head# 2024-04-01T19:56:59.293 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.293 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bb00883:::benchmark_data_smithi188_161190_object33430:head# 2024-04-01T19:56:59.293 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.293 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bb04d53:::benchmark_data_smithi188_161190_object24538:head# 2024-04-01T19:56:59.294 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.294 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bb0e11d:::benchmark_data_smithi188_161190_object82359:head# 2024-04-01T19:56:59.294 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.294 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bb0fb72:::benchmark_data_smithi188_161190_object87574:head# 2024-04-01T19:56:59.294 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.294 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bb298da:::benchmark_data_smithi188_161190_object112546:head# 2024-04-01T19:56:59.294 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.294 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bb2acd3:::benchmark_data_smithi188_161190_object98426:head# 2024-04-01T19:56:59.294 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.294 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bb2c058:::benchmark_data_smithi188_161190_object71407:head# 2024-04-01T19:56:59.294 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.296 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bb2c2f1:::benchmark_data_smithi188_161190_object105673:head# 2024-04-01T19:56:59.296 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.296 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bb2ca56:::benchmark_data_smithi188_161190_object55492:head# 2024-04-01T19:56:59.296 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.296 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bb2cc6f:::benchmark_data_smithi188_161190_object36782:head# 2024-04-01T19:56:59.296 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.296 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bb48aaa:::benchmark_data_smithi188_161190_object115735:head# 2024-04-01T19:56:59.296 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.296 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bb59b75:::benchmark_data_smithi188_161190_object113469:head# 2024-04-01T19:56:59.296 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.296 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bb5df50:::benchmark_data_smithi188_161190_object43793:head# 2024-04-01T19:56:59.296 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.297 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bb69f8e:::benchmark_data_smithi188_161190_object44099:head# 2024-04-01T19:56:59.297 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.297 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bb6a958:::benchmark_data_smithi188_161190_object125434:head# 2024-04-01T19:56:59.297 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.297 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bb6bc87:::benchmark_data_smithi188_161190_object99074:head# 2024-04-01T19:56:59.297 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.298 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bb77cf6:::benchmark_data_smithi188_161190_object87338:head# 2024-04-01T19:56:59.299 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.299 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bb9fab4:::benchmark_data_smithi188_161190_object118397:head# 2024-04-01T19:56:59.299 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.299 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bbab73f:::benchmark_data_smithi188_161190_object39316:head# 2024-04-01T19:56:59.299 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.299 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bbc78c3:::benchmark_data_smithi188_161190_object100889:head# 2024-04-01T19:56:59.299 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.299 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bbc992b:::benchmark_data_smithi188_161190_object44129:head# 2024-04-01T19:56:59.299 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.299 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bbccfa4:::benchmark_data_smithi188_161190_object77413:head# 2024-04-01T19:56:59.299 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.299 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bbd3955:::benchmark_data_smithi188_161190_object101155:head# 2024-04-01T19:56:59.299 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.300 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bbd62af:::benchmark_data_smithi188_161190_object77106:head# 2024-04-01T19:56:59.300 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.300 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bbde5eb:::benchmark_data_smithi188_161190_object106230:head# 2024-04-01T19:56:59.300 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.300 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bbe1a43:::benchmark_data_smithi188_161190_object59725:head# 2024-04-01T19:56:59.300 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.300 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bc08e5c:::benchmark_data_smithi188_161190_object58901:head# 2024-04-01T19:56:59.300 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.300 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bc10a02:::benchmark_data_smithi188_161190_object90180:head# 2024-04-01T19:56:59.301 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.304 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bc2bf19:::benchmark_data_smithi188_161190_object123448:head# 2024-04-01T19:56:59.305 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.305 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bc51ecc:::benchmark_data_smithi188_161190_object30552:head# 2024-04-01T19:56:59.305 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.305 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bc5d458:::benchmark_data_smithi188_161190_object61883:head# 2024-04-01T19:56:59.305 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.306 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bc66994:::benchmark_data_smithi188_161190_object67289:head# 2024-04-01T19:56:59.306 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.306 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bc7169b:::benchmark_data_smithi188_161190_object53829:head# 2024-04-01T19:56:59.306 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.306 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bc754e2:::benchmark_data_smithi188_161190_object77603:head# 2024-04-01T19:56:59.306 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.317 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bc78d8d:::benchmark_data_smithi188_161190_object96203:head# 2024-04-01T19:56:59.317 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.317 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bc7ee06:::benchmark_data_smithi188_161190_object97187:head# 2024-04-01T19:56:59.317 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.317 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bc87440:::benchmark_data_smithi188_161190_object71794:head# 2024-04-01T19:56:59.317 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.317 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bc88db2:::benchmark_data_smithi188_161190_object71018:head# 2024-04-01T19:56:59.317 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.317 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bc8a731:::benchmark_data_smithi188_161190_object41080:head# 2024-04-01T19:56:59.317 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.317 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bc90e68:::benchmark_data_smithi188_161190_object42701:head# 2024-04-01T19:56:59.317 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.317 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bc92ebe:::benchmark_data_smithi188_161190_object21431:head# 2024-04-01T19:56:59.317 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.318 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bc94780:::benchmark_data_smithi188_161190_object53001:head# 2024-04-01T19:56:59.318 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.318 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bc94a0a:::benchmark_data_smithi188_161190_object91724:head# 2024-04-01T19:56:59.318 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.318 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bc9db01:::benchmark_data_smithi188_161190_object56451:head# 2024-04-01T19:56:59.318 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.318 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bca1085:::benchmark_data_smithi188_161190_object124915:head# 2024-04-01T19:56:59.318 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.318 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bcadedb:::benchmark_data_smithi188_161190_object97606:head# 2024-04-01T19:56:59.318 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.318 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bcd0e1c:::benchmark_data_smithi188_161190_object56235:head# 2024-04-01T19:56:59.318 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.318 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bce007d:::benchmark_data_smithi188_161190_object70784:head# 2024-04-01T19:56:59.318 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.318 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bce25a2:::benchmark_data_smithi188_161190_object103951:head# 2024-04-01T19:56:59.319 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.319 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bce56c3:::benchmark_data_smithi188_161190_object56785:head# 2024-04-01T19:56:59.319 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.322 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bce89f0:::benchmark_data_smithi188_161190_object121475:head# 2024-04-01T19:56:59.322 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.324 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bcec76f:::benchmark_data_smithi188_161190_object135037:head# 2024-04-01T19:56:59.324 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.325 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bcfc2f0:::benchmark_data_smithi188_161190_object68975:head# 2024-04-01T19:56:59.325 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.330 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bcffcdc:::benchmark_data_smithi188_161190_object32594:head# 2024-04-01T19:56:59.330 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.331 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bd05fb8:::benchmark_data_smithi188_161190_object66996:head# 2024-04-01T19:56:59.331 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.331 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bd08ec3:::benchmark_data_smithi188_161190_object127765:head# 2024-04-01T19:56:59.331 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.331 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bd12792:::benchmark_data_smithi188_161190_object45971:head# 2024-04-01T19:56:59.331 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.332 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bd311da:::benchmark_data_smithi188_161190_object111822:head# 2024-04-01T19:56:59.332 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.332 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bd3a0cb:::benchmark_data_smithi188_161190_object59015:head# 2024-04-01T19:56:59.332 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.333 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bd3a7f9:::benchmark_data_smithi188_161190_object51862:head# 2024-04-01T19:56:59.333 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.333 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bd3bed8:::benchmark_data_smithi188_161190_object29279:head# 2024-04-01T19:56:59.333 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.333 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bd3e409:::benchmark_data_smithi188_161190_object121975:head# 2024-04-01T19:56:59.333 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.333 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bd4cc9f:::benchmark_data_smithi188_161190_object130853:head# 2024-04-01T19:56:59.333 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.334 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bd543e6:::benchmark_data_smithi188_161190_object20999:head# 2024-04-01T19:56:59.335 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.335 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bd55143:::benchmark_data_smithi188_161190_object79195:head# 2024-04-01T19:56:59.335 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.335 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bd56b6c:::benchmark_data_smithi188_161190_object33918:head# 2024-04-01T19:56:59.335 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.335 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bd59bec:::benchmark_data_smithi188_161190_object128534:head# 2024-04-01T19:56:59.335 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.335 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bd5a0c0:::benchmark_data_smithi188_161190_object23201:head# 2024-04-01T19:56:59.335 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.335 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bd5c61a:::benchmark_data_smithi188_161190_object51150:head# 2024-04-01T19:56:59.335 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.335 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bd6a934:::benchmark_data_smithi188_161190_object70727:head# 2024-04-01T19:56:59.335 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.342 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bd72d8e:::benchmark_data_smithi188_161190_object97566:head# 2024-04-01T19:56:59.342 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.343 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bd91384:::benchmark_data_smithi188_161190_object76925:head# 2024-04-01T19:56:59.343 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.343 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bda5d2a:::benchmark_data_smithi188_161190_object132425:head# 2024-04-01T19:56:59.343 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bda904b:::benchmark_data_smithi188_161190_object106486:head# 2024-04-01T19:56:59.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bdb8455:::benchmark_data_smithi188_161190_object110067:head# 2024-04-01T19:56:59.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bdcd877:::benchmark_data_smithi188_161190_object99146:head# 2024-04-01T19:56:59.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bdce66b:::benchmark_data_smithi188_161190_object111965:head# 2024-04-01T19:56:59.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bdd8a8c:::benchmark_data_smithi188_161190_object81793:head# 2024-04-01T19:56:59.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bdea884:::benchmark_data_smithi188_161190_object62903:head# 2024-04-01T19:56:59.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.346 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bdf299d:::benchmark_data_smithi188_161190_object66302:head# 2024-04-01T19:56:59.346 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.346 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bdfb106:::benchmark_data_smithi188_161190_object65016:head# 2024-04-01T19:56:59.346 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.347 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bdfe67b:::benchmark_data_smithi188_161190_object31106:head# 2024-04-01T19:56:59.347 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.347 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9be0a16c:::benchmark_data_smithi188_161190_object73609:head# 2024-04-01T19:56:59.347 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.347 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9be0f0cd:::benchmark_data_smithi188_161190_object96340:head# 2024-04-01T19:56:59.347 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.347 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9be16b98:::benchmark_data_smithi188_161190_object117886:head# 2024-04-01T19:56:59.347 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.347 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9be1e29a:::benchmark_data_smithi188_161190_object130337:head# 2024-04-01T19:56:59.347 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.348 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9be304e9:::benchmark_data_smithi188_161190_object37051:head# 2024-04-01T19:56:59.348 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.348 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9be3d448:::benchmark_data_smithi188_161190_object132773:head# 2024-04-01T19:56:59.348 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.349 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9be3f078:::benchmark_data_smithi188_161190_object68021:head# 2024-04-01T19:56:59.349 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.349 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9be45b89:::benchmark_data_smithi188_161190_object136307:head# 2024-04-01T19:56:59.349 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.349 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9be61560:::benchmark_data_smithi188_161190_object82626:head# 2024-04-01T19:56:59.349 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.349 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9be6969e:::benchmark_data_smithi188_161190_object91017:head# 2024-04-01T19:56:59.350 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.350 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9be6ec55:::benchmark_data_smithi188_161190_object105989:head# 2024-04-01T19:56:59.350 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.351 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9be73bea:::benchmark_data_smithi188_161190_object99419:head# 2024-04-01T19:56:59.351 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.351 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9be8d5b0:::benchmark_data_smithi188_161190_object126942:head# 2024-04-01T19:56:59.351 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.351 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9be96f15:::benchmark_data_smithi188_161190_object71722:head# 2024-04-01T19:56:59.351 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.355 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9be9d0ff:::benchmark_data_smithi188_161190_object90415:head# 2024-04-01T19:56:59.355 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.357 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bea08c2:::benchmark_data_smithi188_161190_object23261:head# 2024-04-01T19:56:59.357 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.358 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bea245d:::benchmark_data_smithi188_161190_object53508:head# 2024-04-01T19:56:59.358 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.358 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9beb0670:::benchmark_data_smithi188_161190_object35298:head# 2024-04-01T19:56:59.358 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.359 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9beb5ab9:::benchmark_data_smithi188_161190_object125772:head# 2024-04-01T19:56:59.359 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.359 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bebf28d:::benchmark_data_smithi188_161190_object85203:head# 2024-04-01T19:56:59.359 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.367 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bed5698:::benchmark_data_smithi188_161190_object70328:head# 2024-04-01T19:56:59.367 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.371 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bedd236:::benchmark_data_smithi188_161190_object130697:head# 2024-04-01T19:56:59.371 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.379 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bedf602:::benchmark_data_smithi188_161190_object77568:head# 2024-04-01T19:56:59.379 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.379 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bee4e55:::benchmark_data_smithi188_161190_object60647:head# 2024-04-01T19:56:59.379 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.385 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9beedb38:::benchmark_data_smithi188_161190_object49295:head# 2024-04-01T19:56:59.385 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.388 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bef42f9:::benchmark_data_smithi188_161190_object65162:head# 2024-04-01T19:56:59.389 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.395 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bef5ab2:::benchmark_data_smithi188_161190_object86191:head# 2024-04-01T19:56:59.396 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.405 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bef6d3f:::benchmark_data_smithi188_161190_object135998:head# 2024-04-01T19:56:59.405 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.406 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9befce0b:::benchmark_data_smithi188_161190_object45549:head# 2024-04-01T19:56:59.406 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.406 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bf046ce:::benchmark_data_smithi188_161190_object68259:head# 2024-04-01T19:56:59.406 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.406 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bf063e6:::benchmark_data_smithi188_161190_object40572:head# 2024-04-01T19:56:59.406 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.406 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bf18d0a:::benchmark_data_smithi188_161190_object97255:head# 2024-04-01T19:56:59.406 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.406 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bf2cd4e:::benchmark_data_smithi188_161190_object59775:head# 2024-04-01T19:56:59.406 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.406 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bf3fae0:::benchmark_data_smithi188_161190_object26783:head# 2024-04-01T19:56:59.406 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.407 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bf4abd0:::benchmark_data_smithi188_161190_object122983:head# 2024-04-01T19:56:59.407 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.407 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bf53839:::benchmark_data_smithi188_161190_object36226:head# 2024-04-01T19:56:59.407 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.407 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bf5f67f:::benchmark_data_smithi188_161190_object58237:head# 2024-04-01T19:56:59.407 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.407 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bf6892f:::benchmark_data_smithi188_161190_object126469:head# 2024-04-01T19:56:59.407 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.407 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bf6a6aa:::benchmark_data_smithi188_161190_object53435:head# 2024-04-01T19:56:59.407 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.407 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bf70c4e:::benchmark_data_smithi188_161190_object57118:head# 2024-04-01T19:56:59.407 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.407 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bf71d91:::benchmark_data_smithi188_161190_object59777:head# 2024-04-01T19:56:59.407 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.408 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bf81b6c:::benchmark_data_smithi188_161190_object83471:head# 2024-04-01T19:56:59.408 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.408 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bf870e6:::benchmark_data_smithi188_161190_object32592:head# 2024-04-01T19:56:59.408 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.408 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bf8b0f0:::benchmark_data_smithi188_161190_object103903:head# 2024-04-01T19:56:59.408 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.408 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bfa19b3:::benchmark_data_smithi188_161190_object82600:head# 2024-04-01T19:56:59.408 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.408 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bfa4ed2:::benchmark_data_smithi188_161190_object103680:head# 2024-04-01T19:56:59.408 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.408 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bfa7825:::benchmark_data_smithi188_161190_object115960:head# 2024-04-01T19:56:59.408 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.408 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bfbb50d:::benchmark_data_smithi188_161190_object81627:head# 2024-04-01T19:56:59.408 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.408 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bfc01b6:::benchmark_data_smithi188_161190_object79441:head# 2024-04-01T19:56:59.409 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.409 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bfc36a0:::benchmark_data_smithi188_161190_object52932:head# 2024-04-01T19:56:59.409 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.409 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bfc663a:::benchmark_data_smithi188_161190_object83649:head# 2024-04-01T19:56:59.409 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.413 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bfcbeab:::benchmark_data_smithi188_161190_object89730:head# 2024-04-01T19:56:59.413 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.413 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bfcd3dc:::benchmark_data_smithi188_161190_object130613:head# 2024-04-01T19:56:59.413 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.413 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bfce2fb:::benchmark_data_smithi188_161190_object76099:head# 2024-04-01T19:56:59.413 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.413 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bfd9628:::benchmark_data_smithi188_161190_object118247:head# 2024-04-01T19:56:59.413 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.413 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bfe0f98:::benchmark_data_smithi188_161190_object105191:head# 2024-04-01T19:56:59.413 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.413 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bfe2d83:::benchmark_data_smithi188_161190_object137055:head# 2024-04-01T19:56:59.413 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.414 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bfe91f3:::benchmark_data_smithi188_161190_object138006:head# 2024-04-01T19:56:59.414 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.414 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bfeb08d:::benchmark_data_smithi188_161190_object65512:head# 2024-04-01T19:56:59.414 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.414 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9bff1857:::benchmark_data_smithi188_161190_object51929:head# 2024-04-01T19:56:59.414 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.414 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c006eb7:::benchmark_data_smithi188_161190_object66713:head# 2024-04-01T19:56:59.414 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.414 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c0121cf:::benchmark_data_smithi188_161190_object93061:head# 2024-04-01T19:56:59.414 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.414 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c02b9ae:::benchmark_data_smithi188_161190_object46342:head# 2024-04-01T19:56:59.414 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.414 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c02f9b7:::benchmark_data_smithi188_161190_object134557:head# 2024-04-01T19:56:59.414 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.415 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c039eee:::benchmark_data_smithi188_161190_object20069:head# 2024-04-01T19:56:59.415 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.415 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c03a3b1:::benchmark_data_smithi188_161190_object112088:head# 2024-04-01T19:56:59.415 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.415 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c03a6f5:::benchmark_data_smithi188_161190_object137757:head# 2024-04-01T19:56:59.415 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.415 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c048822:::benchmark_data_smithi188_161190_object27061:head# 2024-04-01T19:56:59.415 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.416 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c054378:::benchmark_data_smithi188_161190_object34620:head# 2024-04-01T19:56:59.416 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.431 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c05bbc5:::benchmark_data_smithi188_161190_object115776:head# 2024-04-01T19:56:59.432 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.432 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c0678fc:::benchmark_data_smithi188_161190_object50324:head# 2024-04-01T19:56:59.432 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.432 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c0680b4:::benchmark_data_smithi188_161190_object50933:head# 2024-04-01T19:56:59.432 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.432 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c0696bf:::benchmark_data_smithi188_161190_object79115:head# 2024-04-01T19:56:59.432 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.432 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c085fbe:::benchmark_data_smithi188_161190_object110801:head# 2024-04-01T19:56:59.432 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.432 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c087821:::benchmark_data_smithi188_161190_object35258:head# 2024-04-01T19:56:59.432 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.432 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c08b821:::benchmark_data_smithi188_161190_object51856:head# 2024-04-01T19:56:59.432 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.432 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c08fa50:::benchmark_data_smithi188_161190_object99397:head# 2024-04-01T19:56:59.433 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.433 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c096c5e:::benchmark_data_smithi188_161190_object99249:head# 2024-04-01T19:56:59.433 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.433 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c0979ba:::benchmark_data_smithi188_161190_object41628:head# 2024-04-01T19:56:59.433 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.441 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c09e850:::benchmark_data_smithi188_161190_object59482:head# 2024-04-01T19:56:59.441 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.441 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c0c493f:::benchmark_data_smithi188_161190_object24150:head# 2024-04-01T19:56:59.441 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.441 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c0ca9c7:::benchmark_data_smithi188_161190_object47426:head# 2024-04-01T19:56:59.441 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.441 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c0e8c15:::benchmark_data_smithi188_161190_object54179:head# 2024-04-01T19:56:59.441 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.441 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c0ee9cc:::benchmark_data_smithi188_161190_object58781:head# 2024-04-01T19:56:59.441 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.441 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c1026f2:::benchmark_data_smithi188_161190_object89182:head# 2024-04-01T19:56:59.441 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.441 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c11fb57:::benchmark_data_smithi188_161190_object119504:head# 2024-04-01T19:56:59.442 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.442 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c135e84:::benchmark_data_smithi188_161190_object31428:head# 2024-04-01T19:56:59.442 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.442 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c142829:::benchmark_data_smithi188_161190_object47159:head# 2024-04-01T19:56:59.442 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.442 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c15e43b:::benchmark_data_smithi188_161190_object33493:head# 2024-04-01T19:56:59.442 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.442 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c162adb:::benchmark_data_smithi188_161190_object82656:head# 2024-04-01T19:56:59.442 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.442 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c169e26:::benchmark_data_smithi188_161190_object118666:head# 2024-04-01T19:56:59.442 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.442 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c17faa0:::benchmark_data_smithi188_161190_object132774:head# 2024-04-01T19:56:59.442 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.443 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c18f73f:::benchmark_data_smithi188_161190_object131272:head# 2024-04-01T19:56:59.443 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c191e25:::benchmark_data_smithi188_161190_object86844:head# 2024-04-01T19:56:59.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c19b103:::benchmark_data_smithi188_161190_object79840:head# 2024-04-01T19:56:59.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c19b1ec:::benchmark_data_smithi188_161190_object66629:head# 2024-04-01T19:56:59.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c1a28c1:::benchmark_data_smithi188_161190_object113555:head# 2024-04-01T19:56:59.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c1a7209:::benchmark_data_smithi188_161190_object37548:head# 2024-04-01T19:56:59.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c1a760c:::benchmark_data_smithi188_161190_object118505:head# 2024-04-01T19:56:59.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.444 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c1be322:::benchmark_data_smithi188_161190_object60194:head# 2024-04-01T19:56:59.444 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.445 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c1c8f72:::benchmark_data_smithi188_161190_object131588:head# 2024-04-01T19:56:59.445 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.454 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c1d1471:::benchmark_data_smithi188_161190_object102563:head# 2024-04-01T19:56:59.454 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.462 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c1eb028:::benchmark_data_smithi188_161190_object92543:head# 2024-04-01T19:56:59.462 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.463 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c1f3582:::benchmark_data_smithi188_161190_object60922:head# 2024-04-01T19:56:59.463 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.463 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c2036bc:::benchmark_data_smithi188_161190_object100740:head# 2024-04-01T19:56:59.463 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.463 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c207188:::benchmark_data_smithi188_161190_object65519:head# 2024-04-01T19:56:59.464 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.464 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c20f1ca:::benchmark_data_smithi188_161190_object38165:head# 2024-04-01T19:56:59.464 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.468 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c20f3c2:::benchmark_data_smithi188_161190_object29952:head# 2024-04-01T19:56:59.468 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.468 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c21002f:::benchmark_data_smithi188_161190_object135191:head# 2024-04-01T19:56:59.468 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.468 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c217882:::benchmark_data_smithi188_161190_object55980:head# 2024-04-01T19:56:59.469 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.469 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c227436:::benchmark_data_smithi188_161190_object135575:head# 2024-04-01T19:56:59.469 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.469 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c22ae51:::benchmark_data_smithi188_161190_object110616:head# 2024-04-01T19:56:59.469 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.469 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c2353c6:::benchmark_data_smithi188_161190_object54709:head# 2024-04-01T19:56:59.469 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.469 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c2406f3:::benchmark_data_smithi188_161190_object104250:head# 2024-04-01T19:56:59.469 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.469 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c240c73:::benchmark_data_smithi188_161190_object60619:head# 2024-04-01T19:56:59.469 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.469 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c2415ff:::benchmark_data_smithi188_161190_object64513:head# 2024-04-01T19:56:59.470 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.470 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c25a2a0:::benchmark_data_smithi188_161190_object90264:head# 2024-04-01T19:56:59.470 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.476 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c26ba9b:::benchmark_data_smithi188_161190_object121793:head# 2024-04-01T19:56:59.476 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.476 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c2807c5:::benchmark_data_smithi188_161190_object81247:head# 2024-04-01T19:56:59.476 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.476 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c28ce2d:::benchmark_data_smithi188_161190_object116991:head# 2024-04-01T19:56:59.476 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.476 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c294fb9:::benchmark_data_smithi188_161190_object101793:head# 2024-04-01T19:56:59.476 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c29df1b:::benchmark_data_smithi188_161190_object116124:head# 2024-04-01T19:56:59.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c29e2f8:::benchmark_data_smithi188_161190_object37183:head# 2024-04-01T19:56:59.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.481 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c2a50c6:::benchmark_data_smithi188_161190_object97260:head# 2024-04-01T19:56:59.481 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.481 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c2b0dff:::benchmark_data_smithi188_161190_object71989:head# 2024-04-01T19:56:59.481 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.481 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c2b3580:::benchmark_data_smithi188_161190_object118152:head# 2024-04-01T19:56:59.481 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.481 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c2b43c5:::benchmark_data_smithi188_161190_object108873:head# 2024-04-01T19:56:59.482 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.482 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c2c7c0f:::benchmark_data_smithi188_161190_object20973:head# 2024-04-01T19:56:59.482 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.482 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c2cb942:::benchmark_data_smithi188_161190_object34960:head# 2024-04-01T19:56:59.482 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.482 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c2d056a:::benchmark_data_smithi188_161190_object54493:head# 2024-04-01T19:56:59.482 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.482 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c2d6a4b:::benchmark_data_smithi188_161190_object110248:head# 2024-04-01T19:56:59.482 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.482 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c2e25e0:::benchmark_data_smithi188_161190_object81079:head# 2024-04-01T19:56:59.482 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.484 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c2ea4df:::benchmark_data_smithi188_161190_object44630:head# 2024-04-01T19:56:59.484 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.484 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c2f4553:::benchmark_data_smithi188_161190_object36536:head# 2024-04-01T19:56:59.484 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.484 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c319c69:::benchmark_data_smithi188_161190_object118603:head# 2024-04-01T19:56:59.484 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.484 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c31bdc7:::benchmark_data_smithi188_161190_object53740:head# 2024-04-01T19:56:59.484 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.485 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c31cb01:::benchmark_data_smithi188_161190_object41156:head# 2024-04-01T19:56:59.485 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.485 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c32ccc1:::benchmark_data_smithi188_161190_object134078:head# 2024-04-01T19:56:59.485 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.485 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c32fa9f:::benchmark_data_smithi188_161190_object36369:head# 2024-04-01T19:56:59.485 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.485 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c349d4f:::benchmark_data_smithi188_161190_object91467:head# 2024-04-01T19:56:59.485 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.485 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c354c57:::benchmark_data_smithi188_161190_object27216:head# 2024-04-01T19:56:59.485 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.485 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c3598da:::benchmark_data_smithi188_161190_object92144:head# 2024-04-01T19:56:59.485 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.485 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c35e9b8:::benchmark_data_smithi188_161190_object47784:head# 2024-04-01T19:56:59.485 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.489 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c36ee4e:::benchmark_data_smithi188_161190_object105265:head# 2024-04-01T19:56:59.490 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.490 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c375c6a:::benchmark_data_smithi188_161190_object96426:head# 2024-04-01T19:56:59.490 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.490 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c377878:::benchmark_data_smithi188_161190_object48938:head# 2024-04-01T19:56:59.490 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c37d729:::benchmark_data_smithi188_161190_object68525:head# 2024-04-01T19:56:59.491 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c380379:::benchmark_data_smithi188_161190_object42857:head# 2024-04-01T19:56:59.491 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c38e367:::benchmark_data_smithi188_161190_object120418:head# 2024-04-01T19:56:59.491 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c391492:::benchmark_data_smithi188_161190_object26417:head# 2024-04-01T19:56:59.492 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.492 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c393563:::benchmark_data_smithi188_161190_object119493:head# 2024-04-01T19:56:59.492 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.492 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c39ddc5:::benchmark_data_smithi188_161190_object93296:head# 2024-04-01T19:56:59.492 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.492 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c39f59a:::benchmark_data_smithi188_161190_object37410:head# 2024-04-01T19:56:59.493 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.493 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c3a5345:::benchmark_data_smithi188_161190_object88962:head# 2024-04-01T19:56:59.493 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.493 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c3a5428:::benchmark_data_smithi188_161190_object95527:head# 2024-04-01T19:56:59.493 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.493 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c3a686f:::benchmark_data_smithi188_161190_object24468:head# 2024-04-01T19:56:59.493 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.494 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c3af3a8:::benchmark_data_smithi188_161190_object100030:head# 2024-04-01T19:56:59.495 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.495 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c3b5f6b:::benchmark_data_smithi188_161190_object46357:head# 2024-04-01T19:56:59.495 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.495 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c3bbf04:::benchmark_data_smithi188_161190_object70706:head# 2024-04-01T19:56:59.495 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.495 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c3bdb45:::benchmark_data_smithi188_161190_object50361:head# 2024-04-01T19:56:59.495 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.495 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c3c5936:::benchmark_data_smithi188_161190_object35001:head# 2024-04-01T19:56:59.495 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.496 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c3d23c8:::benchmark_data_smithi188_161190_object120221:head# 2024-04-01T19:56:59.496 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.496 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c3d6262:::benchmark_data_smithi188_161190_object80164:head# 2024-04-01T19:56:59.496 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.496 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c3f1e6e:::benchmark_data_smithi188_161190_object121272:head# 2024-04-01T19:56:59.496 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.496 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c3f20a3:::benchmark_data_smithi188_161190_object114448:head# 2024-04-01T19:56:59.497 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.497 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c3f6ae7:::benchmark_data_smithi188_161190_object46198:head# 2024-04-01T19:56:59.497 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.506 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c3f97f7:::benchmark_data_smithi188_161190_object46136:head# 2024-04-01T19:56:59.506 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.506 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c409fbb:::benchmark_data_smithi188_161190_object123215:head# 2024-04-01T19:56:59.506 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.507 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c410d81:::benchmark_data_smithi188_161190_object38455:head# 2024-04-01T19:56:59.507 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.512 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c41228e:::benchmark_data_smithi188_161190_object90520:head# 2024-04-01T19:56:59.512 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.514 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c41a39c:::benchmark_data_smithi188_161190_object38378:head# 2024-04-01T19:56:59.514 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.514 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c420605:::benchmark_data_smithi188_161190_object53625:head# 2024-04-01T19:56:59.514 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.515 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c428105:::benchmark_data_smithi188_161190_object68044:head# 2024-04-01T19:56:59.515 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.520 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c42c363:::benchmark_data_smithi188_161190_object58862:head# 2024-04-01T19:56:59.520 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.520 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c44221e:::benchmark_data_smithi188_161190_object106461:head# 2024-04-01T19:56:59.520 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.521 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c4446f6:::benchmark_data_smithi188_161190_object36664:head# 2024-04-01T19:56:59.521 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.521 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c44637a:::benchmark_data_smithi188_161190_object134714:head# 2024-04-01T19:56:59.521 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.521 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c44c647:::benchmark_data_smithi188_161190_object54446:head# 2024-04-01T19:56:59.521 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.522 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c47010f:::benchmark_data_smithi188_161190_object65062:head# 2024-04-01T19:56:59.522 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.522 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c483440:::benchmark_data_smithi188_161190_object64687:head# 2024-04-01T19:56:59.522 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.522 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c48d4b0:::benchmark_data_smithi188_161190_object135371:head# 2024-04-01T19:56:59.522 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.522 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c491893:::benchmark_data_smithi188_161190_object126933:head# 2024-04-01T19:56:59.523 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.523 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c499a62:::benchmark_data_smithi188_161190_object111379:head# 2024-04-01T19:56:59.523 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.524 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c49b3b1:::benchmark_data_smithi188_161190_object40536:head# 2024-04-01T19:56:59.524 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.524 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c49be03:::benchmark_data_smithi188_161190_object46463:head# 2024-04-01T19:56:59.525 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.525 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c49e278:::benchmark_data_smithi188_161190_object96756:head# 2024-04-01T19:56:59.525 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.525 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c4b920c:::benchmark_data_smithi188_161190_object100031:head# 2024-04-01T19:56:59.525 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.525 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c4bacf4:::benchmark_data_smithi188_161190_object75219:head# 2024-04-01T19:56:59.525 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.525 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c4bc489:::benchmark_data_smithi188_161190_object130281:head# 2024-04-01T19:56:59.525 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.525 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c4d0f54:::benchmark_data_smithi188_161190_object68194:head# 2024-04-01T19:56:59.525 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.525 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c4d4783:::benchmark_data_smithi188_161190_object121512:head# 2024-04-01T19:56:59.526 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.526 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c4dde98:::benchmark_data_smithi188_161190_object30418:head# 2024-04-01T19:56:59.526 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.526 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c4e240b:::benchmark_data_smithi188_161190_object138740:head# 2024-04-01T19:56:59.526 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.526 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c4e5538:::benchmark_data_smithi188_161190_object66370:head# 2024-04-01T19:56:59.527 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.527 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c4ea58f:::benchmark_data_smithi188_161190_object40826:head# 2024-04-01T19:56:59.527 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.534 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c4f5d71:::benchmark_data_smithi188_161190_object87194:head# 2024-04-01T19:56:59.534 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.534 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c4f9084:::benchmark_data_smithi188_161190_object72265:head# 2024-04-01T19:56:59.534 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.534 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c500be5:::benchmark_data_smithi188_161190_object64237:head# 2024-04-01T19:56:59.535 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.535 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c5063a4:::benchmark_data_smithi188_161190_object20939:head# 2024-04-01T19:56:59.535 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.535 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c508243:::benchmark_data_smithi188_161190_object26693:head# 2024-04-01T19:56:59.535 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.535 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c510263:::benchmark_data_smithi188_161190_object108747:head# 2024-04-01T19:56:59.535 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.536 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c51b600:::benchmark_data_smithi188_161190_object102581:head# 2024-04-01T19:56:59.536 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.536 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c5311f1:::benchmark_data_smithi188_161190_object44738:head# 2024-04-01T19:56:59.536 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.536 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c535a11:::benchmark_data_smithi188_161190_object111008:head# 2024-04-01T19:56:59.536 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.548 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c5375d5:::benchmark_data_smithi188_161190_object61276:head# 2024-04-01T19:56:59.548 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.548 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c538d2f:::benchmark_data_smithi188_161190_object123888:head# 2024-04-01T19:56:59.548 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.548 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c53fbc3:::benchmark_data_smithi188_161190_object67236:head# 2024-04-01T19:56:59.549 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.549 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c543de8:::benchmark_data_smithi188_161190_object121706:head# 2024-04-01T19:56:59.549 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.549 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c54854a:::benchmark_data_smithi188_161190_object32466:head# 2024-04-01T19:56:59.549 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.549 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c5503d3:::benchmark_data_smithi188_161190_object41948:head# 2024-04-01T19:56:59.549 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.549 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c565deb:::benchmark_data_smithi188_161190_object135261:head# 2024-04-01T19:56:59.549 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.550 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c57af4e:::benchmark_data_smithi188_161190_object23321:head# 2024-04-01T19:56:59.550 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.550 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c5833d5:::benchmark_data_smithi188_161190_object113382:head# 2024-04-01T19:56:59.550 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.550 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c585934:::benchmark_data_smithi188_161190_object116264:head# 2024-04-01T19:56:59.550 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.551 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c595b58:::benchmark_data_smithi188_161190_object31367:head# 2024-04-01T19:56:59.551 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.563 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c597213:::benchmark_data_smithi188_161190_object79000:head# 2024-04-01T19:56:59.564 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.586 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c5a78b2:::benchmark_data_smithi188_161190_object111967:head# 2024-04-01T19:56:59.586 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.586 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c5a7fce:::benchmark_data_smithi188_161190_object27377:head# 2024-04-01T19:56:59.586 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.586 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c5adc25:::benchmark_data_smithi188_161190_object71230:head# 2024-04-01T19:56:59.586 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.586 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c5b23d1:::benchmark_data_smithi188_161190_object70561:head# 2024-04-01T19:56:59.586 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.586 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c5be967:::benchmark_data_smithi188_161190_object111771:head# 2024-04-01T19:56:59.586 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.587 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c5c92fe:::benchmark_data_smithi188_161190_object84466:head# 2024-04-01T19:56:59.587 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.587 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c5c9eae:::benchmark_data_smithi188_161190_object37587:head# 2024-04-01T19:56:59.587 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.587 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c5e1e86:::benchmark_data_smithi188_161190_object131964:head# 2024-04-01T19:56:59.587 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.587 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c5e2441:::benchmark_data_smithi188_161190_object119831:head# 2024-04-01T19:56:59.587 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.587 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c5e89fb:::benchmark_data_smithi188_161190_object104385:head# 2024-04-01T19:56:59.587 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.589 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c5eb74e:::benchmark_data_smithi188_161190_object85653:head# 2024-04-01T19:56:59.589 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.589 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c5ebc3c:::benchmark_data_smithi188_161190_object25791:head# 2024-04-01T19:56:59.589 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.589 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c5ebc7c:::benchmark_data_smithi188_161190_object55939:head# 2024-04-01T19:56:59.589 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.589 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c5f1dc8:::benchmark_data_smithi188_161190_object128599:head# 2024-04-01T19:56:59.589 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.589 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c60877e:::benchmark_data_smithi188_161190_object66424:head# 2024-04-01T19:56:59.589 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.589 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c60d249:::benchmark_data_smithi188_161190_object93837:head# 2024-04-01T19:56:59.589 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.589 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c61529d:::benchmark_data_smithi188_161190_object42001:head# 2024-04-01T19:56:59.590 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.594 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c61e7f3:::benchmark_data_smithi188_161190_object134397:head# 2024-04-01T19:56:59.594 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.594 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c620009:::benchmark_data_smithi188_161190_object22974:head# 2024-04-01T19:56:59.594 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c6203e7:::benchmark_data_smithi188_161190_object22172:head# 2024-04-01T19:56:59.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c620cda:::benchmark_data_smithi188_161190_object69351:head# 2024-04-01T19:56:59.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c63b2d1:::benchmark_data_smithi188_161190_object83844:head# 2024-04-01T19:56:59.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c640c92:::benchmark_data_smithi188_161190_object20678:head# 2024-04-01T19:56:59.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c648854:::benchmark_data_smithi188_161190_object61543:head# 2024-04-01T19:56:59.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c64f4af:::benchmark_data_smithi188_161190_object66144:head# 2024-04-01T19:56:59.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c658a17:::benchmark_data_smithi188_161190_object93498:head# 2024-04-01T19:56:59.595 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.595 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c65c444:::benchmark_data_smithi188_161190_object66702:head# 2024-04-01T19:56:59.596 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.596 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c65d997:::benchmark_data_smithi188_161190_object63712:head# 2024-04-01T19:56:59.596 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.596 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c668192:::benchmark_data_smithi188_161190_object102215:head# 2024-04-01T19:56:59.596 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.596 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c67bd58:::benchmark_data_smithi188_161190_object112324:head# 2024-04-01T19:56:59.596 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.596 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c67ea51:::benchmark_data_smithi188_161190_object72938:head# 2024-04-01T19:56:59.596 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.596 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c680b2a:::benchmark_data_smithi188_161190_object103793:head# 2024-04-01T19:56:59.596 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.596 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c6917d3:::benchmark_data_smithi188_161190_object25463:head# 2024-04-01T19:56:59.596 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.596 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c6a0b75:::benchmark_data_smithi188_161190_object24895:head# 2024-04-01T19:56:59.596 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.597 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c6a3e9b:::benchmark_data_smithi188_161190_object111327:head# 2024-04-01T19:56:59.597 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.598 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c6b3a9c:::benchmark_data_smithi188_161190_object76740:head# 2024-04-01T19:56:59.599 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.599 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c6b7989:::benchmark_data_smithi188_161190_object87014:head# 2024-04-01T19:56:59.599 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.599 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c6b8e11:::benchmark_data_smithi188_161190_object125044:head# 2024-04-01T19:56:59.599 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.599 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c6c0b94:::benchmark_data_smithi188_161190_object48822:head# 2024-04-01T19:56:59.599 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.599 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c6cc504:::benchmark_data_smithi188_161190_object76121:head# 2024-04-01T19:56:59.599 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.599 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c6d9373:::benchmark_data_smithi188_161190_object105699:head# 2024-04-01T19:56:59.599 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.599 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c6f4c6e:::benchmark_data_smithi188_161190_object28532:head# 2024-04-01T19:56:59.600 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.600 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c704503:::benchmark_data_smithi188_161190_object72147:head# 2024-04-01T19:56:59.600 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.600 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c7050ea:::benchmark_data_smithi188_161190_object22216:head# 2024-04-01T19:56:59.600 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.600 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c709b5c:::benchmark_data_smithi188_161190_object121947:head# 2024-04-01T19:56:59.600 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.600 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c714bea:::benchmark_data_smithi188_161190_object52630:head# 2024-04-01T19:56:59.600 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.600 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c71b8f6:::benchmark_data_smithi188_161190_object79838:head# 2024-04-01T19:56:59.600 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.600 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c71e24b:::benchmark_data_smithi188_161190_object95217:head# 2024-04-01T19:56:59.600 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.601 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c72eb93:::benchmark_data_smithi188_161190_object22059:head# 2024-04-01T19:56:59.601 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.601 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c740c23:::benchmark_data_smithi188_161190_object24600:head# 2024-04-01T19:56:59.601 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.601 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c746c86:::benchmark_data_smithi188_161190_object101605:head# 2024-04-01T19:56:59.601 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.601 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c749030:::benchmark_data_smithi188_161190_object70630:head# 2024-04-01T19:56:59.601 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.602 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c75480d:::benchmark_data_smithi188_161190_object117631:head# 2024-04-01T19:56:59.603 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.603 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c7818cd:::benchmark_data_smithi188_161190_object124351:head# 2024-04-01T19:56:59.603 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.603 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c78c3b3:::benchmark_data_smithi188_161190_object53064:head# 2024-04-01T19:56:59.603 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.603 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c79eb01:::benchmark_data_smithi188_161190_object20764:head# 2024-04-01T19:56:59.603 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.603 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c7ad720:::benchmark_data_smithi188_161190_object19836:head# 2024-04-01T19:56:59.603 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.603 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c7b0ce2:::benchmark_data_smithi188_161190_object137113:head# 2024-04-01T19:56:59.603 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.603 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c7b8c0f:::benchmark_data_smithi188_161190_object24642:head# 2024-04-01T19:56:59.603 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.604 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c7bbb4c:::benchmark_data_smithi188_161190_object61362:head# 2024-04-01T19:56:59.604 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.604 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c7d1e19:::benchmark_data_smithi188_161190_object91015:head# 2024-04-01T19:56:59.604 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.604 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c7d7982:::benchmark_data_smithi188_161190_object126081:head# 2024-04-01T19:56:59.604 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.604 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c7def4b:::benchmark_data_smithi188_161190_object68003:head# 2024-04-01T19:56:59.604 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.604 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c7e1d87:::benchmark_data_smithi188_161190_object128381:head# 2024-04-01T19:56:59.604 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.604 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c7f0851:::benchmark_data_smithi188_161190_object29766:head# 2024-04-01T19:56:59.604 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.604 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c7f1085:::benchmark_data_smithi188_161190_object37780:head# 2024-04-01T19:56:59.604 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.604 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c800cb5:::benchmark_data_smithi188_161190_object107449:head# 2024-04-01T19:56:59.605 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.605 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c8029d4:::benchmark_data_smithi188_161190_object104378:head# 2024-04-01T19:56:59.605 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.606 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c807d24:::benchmark_data_smithi188_161190_object54975:head# 2024-04-01T19:56:59.606 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.606 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c814d69:::benchmark_data_smithi188_161190_object108307:head# 2024-04-01T19:56:59.606 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.606 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c81f66a:::benchmark_data_smithi188_161190_object79743:head# 2024-04-01T19:56:59.606 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.606 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c8215fb:::benchmark_data_smithi188_161190_object63887:head# 2024-04-01T19:56:59.606 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.606 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c830174:::benchmark_data_smithi188_161190_object37823:head# 2024-04-01T19:56:59.606 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.606 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c8380e8:::benchmark_data_smithi188_161190_object40354:head# 2024-04-01T19:56:59.606 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.606 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c8401d8:::benchmark_data_smithi188_161190_object53246:head# 2024-04-01T19:56:59.606 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.607 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c8484de:::benchmark_data_smithi188_161190_object126998:head# 2024-04-01T19:56:59.607 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.607 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c84d770:::benchmark_data_smithi188_161190_object136488:head# 2024-04-01T19:56:59.607 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.610 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c854ef2:::benchmark_data_smithi188_161190_object123154:head# 2024-04-01T19:56:59.610 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.610 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c85ce91:::benchmark_data_smithi188_161190_object129070:head# 2024-04-01T19:56:59.611 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.611 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c85d52a:::benchmark_data_smithi188_161190_object135767:head# 2024-04-01T19:56:59.611 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.615 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c865271:::benchmark_data_smithi188_161190_object77188:head# 2024-04-01T19:56:59.615 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.616 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c8667cb:::benchmark_data_smithi188_161190_object50202:head# 2024-04-01T19:56:59.616 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.616 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c869183:::benchmark_data_smithi188_161190_object81815:head# 2024-04-01T19:56:59.616 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.617 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c86d998:::benchmark_data_smithi188_161190_object120647:head# 2024-04-01T19:56:59.617 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.617 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c889164:::benchmark_data_smithi188_161190_object20613:head# 2024-04-01T19:56:59.617 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.617 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c88baff:::benchmark_data_smithi188_161190_object40075:head# 2024-04-01T19:56:59.617 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.620 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c88fe9f:::benchmark_data_smithi188_161190_object103171:head# 2024-04-01T19:56:59.620 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.631 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c891501:::benchmark_data_smithi188_161190_object137882:head# 2024-04-01T19:56:59.631 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.631 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c898216:::benchmark_data_smithi188_161190_object125016:head# 2024-04-01T19:56:59.631 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.631 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c8a3d19:::benchmark_data_smithi188_161190_object28783:head# 2024-04-01T19:56:59.631 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.631 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c8b0862:::benchmark_data_smithi188_161190_object43515:head# 2024-04-01T19:56:59.631 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.631 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c8b1003:::benchmark_data_smithi188_161190_object94851:head# 2024-04-01T19:56:59.631 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.631 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c8b24b5:::benchmark_data_smithi188_161190_object92147:head# 2024-04-01T19:56:59.632 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.632 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c8b6201:::benchmark_data_smithi188_161190_object62275:head# 2024-04-01T19:56:59.632 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.632 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c8bd462:::benchmark_data_smithi188_161190_object43315:head# 2024-04-01T19:56:59.632 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.632 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c8c90f9:::benchmark_data_smithi188_161190_object83822:head# 2024-04-01T19:56:59.632 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.632 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c8df80a:::benchmark_data_smithi188_161190_object91878:head# 2024-04-01T19:56:59.632 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.632 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c8e763e:::benchmark_data_smithi188_161190_object104342:head# 2024-04-01T19:56:59.632 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.632 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c8e9c68:::benchmark_data_smithi188_161190_object81611:head# 2024-04-01T19:56:59.632 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.632 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c8ea1ff:::benchmark_data_smithi188_161190_object51996:head# 2024-04-01T19:56:59.633 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.633 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c8ea3cd:::benchmark_data_smithi188_161190_object43634:head# 2024-04-01T19:56:59.633 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.633 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c8ea619:::benchmark_data_smithi188_161190_object25547:head# 2024-04-01T19:56:59.633 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.633 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c8eafb9:::benchmark_data_smithi188_161190_object137671:head# 2024-04-01T19:56:59.633 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.633 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c8f014e:::benchmark_data_smithi188_161190_object112540:head# 2024-04-01T19:56:59.633 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.633 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c8f8e1b:::benchmark_data_smithi188_161190_object31510:head# 2024-04-01T19:56:59.633 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.636 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c901932:::benchmark_data_smithi188_161190_object106390:head# 2024-04-01T19:56:59.636 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.642 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c91841f:::benchmark_data_smithi188_161190_object85534:head# 2024-04-01T19:56:59.642 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.652 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c91e600:::benchmark_data_smithi188_161190_object84790:head# 2024-04-01T19:56:59.653 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.653 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c947040:::benchmark_data_smithi188_161190_object105058:head# 2024-04-01T19:56:59.653 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.653 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c949262:::benchmark_data_smithi188_161190_object50592:head# 2024-04-01T19:56:59.653 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.653 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c95c2a3:::benchmark_data_smithi188_161190_object33053:head# 2024-04-01T19:56:59.653 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.653 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c96a1dd:::benchmark_data_smithi188_161190_object21357:head# 2024-04-01T19:56:59.653 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.653 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c96e70e:::benchmark_data_smithi188_161190_object76122:head# 2024-04-01T19:56:59.653 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.653 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c974ae8:::benchmark_data_smithi188_161190_object46554:head# 2024-04-01T19:56:59.653 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.653 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c976f8a:::benchmark_data_smithi188_161190_object93212:head# 2024-04-01T19:56:59.654 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.654 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c97a787:::benchmark_data_smithi188_161190_object61226:head# 2024-04-01T19:56:59.654 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.654 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c97a7d9:::benchmark_data_smithi188_161190_object130678:head# 2024-04-01T19:56:59.654 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.657 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c990b1a:::benchmark_data_smithi188_161190_object94488:head# 2024-04-01T19:56:59.657 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.660 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c996ae9:::benchmark_data_smithi188_161190_object48326:head# 2024-04-01T19:56:59.661 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.661 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c9a1359:::benchmark_data_smithi188_161190_object82022:head# 2024-04-01T19:56:59.661 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.661 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c9a1d8d:::benchmark_data_smithi188_161190_object54972:head# 2024-04-01T19:56:59.661 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.665 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c9a5cd1:::benchmark_data_smithi188_161190_object86454:head# 2024-04-01T19:56:59.665 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.665 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c9b5526:::benchmark_data_smithi188_161190_object125336:head# 2024-04-01T19:56:59.665 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.665 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c9c2e53:::benchmark_data_smithi188_161190_object60402:head# 2024-04-01T19:56:59.665 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.666 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c9c8b38:::benchmark_data_smithi188_161190_object79248:head# 2024-04-01T19:56:59.666 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.666 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c9ca5ce:::benchmark_data_smithi188_161190_object21248:head# 2024-04-01T19:56:59.666 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.667 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c9faf99:::benchmark_data_smithi188_161190_object67553:head# 2024-04-01T19:56:59.667 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.667 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9c9fe37d:::benchmark_data_smithi188_161190_object105209:head# 2024-04-01T19:56:59.667 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.667 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ca0d287:::benchmark_data_smithi188_161190_object127049:head# 2024-04-01T19:56:59.667 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.667 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ca103c0:::benchmark_data_smithi188_161190_object116545:head# 2024-04-01T19:56:59.667 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.668 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ca1bdd5:::benchmark_data_smithi188_161190_object89188:head# 2024-04-01T19:56:59.668 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.668 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ca1c30d:::benchmark_data_smithi188_161190_object74011:head# 2024-04-01T19:56:59.668 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.668 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ca1cc65:::benchmark_data_smithi188_161190_object134274:head# 2024-04-01T19:56:59.669 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.669 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ca4cf7a:::benchmark_data_smithi188_161190_object93233:head# 2024-04-01T19:56:59.669 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.669 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ca4fc7c:::benchmark_data_smithi188_161190_object120432:head# 2024-04-01T19:56:59.669 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.671 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ca4ff91:::benchmark_data_smithi188_161190_object24480:head# 2024-04-01T19:56:59.671 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.671 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ca509db:::benchmark_data_smithi188_161190_object139256:head# 2024-04-01T19:56:59.671 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.672 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ca5a159:::benchmark_data_smithi188_161190_object57828:head# 2024-04-01T19:56:59.672 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.672 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ca89d12:::benchmark_data_smithi188_161190_object51674:head# 2024-04-01T19:56:59.672 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.673 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9caa03a4:::benchmark_data_smithi188_161190_object80383:head# 2024-04-01T19:56:59.673 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.673 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9caa3f6f:::benchmark_data_smithi188_161190_object63024:head# 2024-04-01T19:56:59.673 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.674 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cab827f:::benchmark_data_smithi188_161190_object47999:head# 2024-04-01T19:56:59.674 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.674 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cac5bef:::benchmark_data_smithi188_161190_object107418:head# 2024-04-01T19:56:59.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.675 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cacb00c:::benchmark_data_smithi188_161190_object132738:head# 2024-04-01T19:56:59.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.675 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cacc737:::benchmark_data_smithi188_161190_object30861:head# 2024-04-01T19:56:59.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.675 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cad6463:::benchmark_data_smithi188_161190_object20349:head# 2024-04-01T19:56:59.675 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.680 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cadf9b1:::benchmark_data_smithi188_161190_object45214:head# 2024-04-01T19:56:59.680 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.686 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9caeb50c:::benchmark_data_smithi188_161190_object23884:head# 2024-04-01T19:56:59.686 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.686 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9caeb57b:::benchmark_data_smithi188_161190_object23501:head# 2024-04-01T19:56:59.686 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.686 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9caf2ec9:::benchmark_data_smithi188_161190_object125228:head# 2024-04-01T19:56:59.686 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.687 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9caf5013:::benchmark_data_smithi188_161190_object52519:head# 2024-04-01T19:56:59.687 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.687 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9caf96b8:::benchmark_data_smithi188_161190_object67096:head# 2024-04-01T19:56:59.688 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.688 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cb078e8:::benchmark_data_smithi188_161190_object129014:head# 2024-04-01T19:56:59.688 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.688 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cb0c39b:::benchmark_data_smithi188_161190_object81402:head# 2024-04-01T19:56:59.688 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.688 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cb146a8:::benchmark_data_smithi188_161190_object130366:head# 2024-04-01T19:56:59.688 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.688 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cb17fb4:::benchmark_data_smithi188_161190_object102609:head# 2024-04-01T19:56:59.688 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cb2a844:::benchmark_data_smithi188_161190_object131510:head# 2024-04-01T19:56:59.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cb2bb93:::benchmark_data_smithi188_161190_object20151:head# 2024-04-01T19:56:59.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.689 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cb32e84:::benchmark_data_smithi188_161190_object39925:head# 2024-04-01T19:56:59.689 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.690 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cb336e2:::benchmark_data_smithi188_161190_object124899:head# 2024-04-01T19:56:59.690 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.690 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cb43692:::benchmark_data_smithi188_161190_object98133:head# 2024-04-01T19:56:59.690 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.690 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cb467eb:::benchmark_data_smithi188_161190_object45874:head# 2024-04-01T19:56:59.690 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.691 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cb6106c:::benchmark_data_smithi188_161190_object75913:head# 2024-04-01T19:56:59.691 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.691 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cb65694:::benchmark_data_smithi188_161190_object98056:head# 2024-04-01T19:56:59.691 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.691 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cb656c7:::benchmark_data_smithi188_161190_object85956:head# 2024-04-01T19:56:59.691 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.691 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cb6cf39:::benchmark_data_smithi188_161190_object120754:head# 2024-04-01T19:56:59.691 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.698 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cb73993:::benchmark_data_smithi188_161190_object76123:head# 2024-04-01T19:56:59.698 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.698 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cb936c0:::benchmark_data_smithi188_161190_object130585:head# 2024-04-01T19:56:59.698 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.701 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cb94648:::benchmark_data_smithi188_161190_object81999:head# 2024-04-01T19:56:59.701 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.701 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cb9e944:::benchmark_data_smithi188_161190_object79724:head# 2024-04-01T19:56:59.701 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.702 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cba288b:::benchmark_data_smithi188_161190_object61957:head# 2024-04-01T19:56:59.702 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.702 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cba3baf:::benchmark_data_smithi188_161190_object94696:head# 2024-04-01T19:56:59.702 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.702 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cbad61d:::benchmark_data_smithi188_161190_object90221:head# 2024-04-01T19:56:59.702 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.702 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cbad6c2:::benchmark_data_smithi188_161190_object62080:head# 2024-04-01T19:56:59.702 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.702 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cbb5a0a:::benchmark_data_smithi188_161190_object38011:head# 2024-04-01T19:56:59.702 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.702 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cbcba0e:::benchmark_data_smithi188_161190_object85284:head# 2024-04-01T19:56:59.702 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.702 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cbcc933:::benchmark_data_smithi188_161190_object111348:head# 2024-04-01T19:56:59.702 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.703 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cbd15da:::benchmark_data_smithi188_161190_object84428:head# 2024-04-01T19:56:59.703 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.703 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cbd41e1:::benchmark_data_smithi188_161190_object79482:head# 2024-04-01T19:56:59.703 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.703 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cbdf964:::benchmark_data_smithi188_161190_object46048:head# 2024-04-01T19:56:59.703 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.703 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cbe656e:::benchmark_data_smithi188_161190_object133135:head# 2024-04-01T19:56:59.703 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.704 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cbe86fe:::benchmark_data_smithi188_161190_object119441:head# 2024-04-01T19:56:59.704 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.704 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cbe9991:::benchmark_data_smithi188_161190_object22859:head# 2024-04-01T19:56:59.704 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.704 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cbfaeaa:::benchmark_data_smithi188_161190_object102904:head# 2024-04-01T19:56:59.704 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.704 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cc03fd3:::benchmark_data_smithi188_161190_object129539:head# 2024-04-01T19:56:59.704 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.704 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cc049b9:::benchmark_data_smithi188_161190_object32479:head# 2024-04-01T19:56:59.705 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.705 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cc09156:::benchmark_data_smithi188_161190_object32157:head# 2024-04-01T19:56:59.705 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.705 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cc0b79b:::benchmark_data_smithi188_161190_object28430:head# 2024-04-01T19:56:59.705 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.705 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cc16951:::benchmark_data_smithi188_161190_object117750:head# 2024-04-01T19:56:59.705 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.705 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cc1dcff:::benchmark_data_smithi188_161190_object123367:head# 2024-04-01T19:56:59.705 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.705 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cc2224f:::benchmark_data_smithi188_161190_object101806:head# 2024-04-01T19:56:59.705 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cc3e661:::benchmark_data_smithi188_161190_object91031:head# 2024-04-01T19:56:59.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cc50e15:::benchmark_data_smithi188_161190_object131973:head# 2024-04-01T19:56:59.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.706 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cc59c4b:::benchmark_data_smithi188_161190_object26126:head# 2024-04-01T19:56:59.706 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.708 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cc5e099:::benchmark_data_smithi188_161190_object49592:head# 2024-04-01T19:56:59.708 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.708 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cc5feb6:::benchmark_data_smithi188_161190_object99283:head# 2024-04-01T19:56:59.708 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.709 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cc606f9:::benchmark_data_smithi188_161190_object104571:head# 2024-04-01T19:56:59.709 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.713 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cc6b317:::benchmark_data_smithi188_161190_object100622:head# 2024-04-01T19:56:59.713 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.713 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cc6d9df:::benchmark_data_smithi188_161190_object88881:head# 2024-04-01T19:56:59.714 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.714 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cc78717:::benchmark_data_smithi188_161190_object91651:head# 2024-04-01T19:56:59.714 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.715 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cc83526:::benchmark_data_smithi188_161190_object82106:head# 2024-04-01T19:56:59.715 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.716 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cc8e6df:::benchmark_data_smithi188_161190_object99221:head# 2024-04-01T19:56:59.716 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.716 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cc98f2f:::benchmark_data_smithi188_161190_object27862:head# 2024-04-01T19:56:59.716 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.716 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cc9a707:::benchmark_data_smithi188_161190_object119897:head# 2024-04-01T19:56:59.716 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.717 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cc9ed75:::benchmark_data_smithi188_161190_object50997:head# 2024-04-01T19:56:59.717 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.717 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ccb0822:::benchmark_data_smithi188_161190_object132205:head# 2024-04-01T19:56:59.717 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.717 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ccb32a7:::benchmark_data_smithi188_161190_object65674:head# 2024-04-01T19:56:59.717 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.717 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ccb7779:::benchmark_data_smithi188_161190_object47776:head# 2024-04-01T19:56:59.718 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.719 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ccb77b4:::benchmark_data_smithi188_161190_object129231:head# 2024-04-01T19:56:59.719 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.719 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ccc7ae9:::benchmark_data_smithi188_161190_object94263:head# 2024-04-01T19:56:59.719 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.719 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ccd9dd8:::benchmark_data_smithi188_161190_object44289:head# 2024-04-01T19:56:59.719 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.719 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ccdbaec:::benchmark_data_smithi188_161190_object120618:head# 2024-04-01T19:56:59.719 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.720 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cce400c:::benchmark_data_smithi188_161190_object22034:head# 2024-04-01T19:56:59.720 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.720 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ccf37b1:::benchmark_data_smithi188_161190_object67597:head# 2024-04-01T19:56:59.720 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.720 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ccf479c:::benchmark_data_smithi188_161190_object48792:head# 2024-04-01T19:56:59.720 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.720 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ccfd394:::benchmark_data_smithi188_161190_object34961:head# 2024-04-01T19:56:59.720 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.722 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cd0d903:::benchmark_data_smithi188_161190_object85420:head# 2024-04-01T19:56:59.722 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.722 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cd10e1b:::benchmark_data_smithi188_161190_object87523:head# 2024-04-01T19:56:59.723 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.723 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cd1a4bd:::benchmark_data_smithi188_161190_object92314:head# 2024-04-01T19:56:59.723 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.723 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cd25f77:::benchmark_data_smithi188_161190_object57757:head# 2024-04-01T19:56:59.723 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.723 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cd2a0bb:::benchmark_data_smithi188_161190_object59226:head# 2024-04-01T19:56:59.723 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.723 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cd33d2d:::benchmark_data_smithi188_161190_object31124:head# 2024-04-01T19:56:59.723 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.723 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cd371eb:::benchmark_data_smithi188_161190_object60127:head# 2024-04-01T19:56:59.723 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.723 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cd37c37:::benchmark_data_smithi188_161190_object36848:head# 2024-04-01T19:56:59.723 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.724 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cd44cc9:::benchmark_data_smithi188_161190_object127083:head# 2024-04-01T19:56:59.724 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.724 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cd6421e:::benchmark_data_smithi188_161190_object110320:head# 2024-04-01T19:56:59.724 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.724 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cd6b08f:::benchmark_data_smithi188_161190_object134865:head# 2024-04-01T19:56:59.724 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.724 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cd76d02:::benchmark_data_smithi188_161190_object39620:head# 2024-04-01T19:56:59.724 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.724 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cd7aca2:::benchmark_data_smithi188_161190_object72411:head# 2024-04-01T19:56:59.725 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.725 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cd91bef:::benchmark_data_smithi188_161190_object94846:head# 2024-04-01T19:56:59.725 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.725 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cd965df:::benchmark_data_smithi188_161190_object116017:head# 2024-04-01T19:56:59.725 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.726 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cd9ffa5:::benchmark_data_smithi188_161190_object126237:head# 2024-04-01T19:56:59.726 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.726 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cda3bc7:::benchmark_data_smithi188_161190_object58234:head# 2024-04-01T19:56:59.727 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.727 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cdac4cd:::benchmark_data_smithi188_161190_object72645:head# 2024-04-01T19:56:59.727 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.727 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cdb248f:::benchmark_data_smithi188_161190_object118199:head# 2024-04-01T19:56:59.727 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.727 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cdb607e:::benchmark_data_smithi188_161190_object55416:head# 2024-04-01T19:56:59.727 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.728 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cdc1409:::benchmark_data_smithi188_161190_object112552:head# 2024-04-01T19:56:59.728 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.728 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cdcad77:::benchmark_data_smithi188_161190_object21482:head# 2024-04-01T19:56:59.728 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.738 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cdd2651:::benchmark_data_smithi188_161190_object105224:head# 2024-04-01T19:56:59.738 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.745 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cdd2709:::benchmark_data_smithi188_161190_object96494:head# 2024-04-01T19:56:59.745 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.745 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cdd8c46:::benchmark_data_smithi188_161190_object83116:head# 2024-04-01T19:56:59.745 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.750 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cdd8ffd:::benchmark_data_smithi188_161190_object57267:head# 2024-04-01T19:56:59.750 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.750 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cdde082:::benchmark_data_smithi188_161190_object60576:head# 2024-04-01T19:56:59.750 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.750 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cdeaf2d:::benchmark_data_smithi188_161190_object35588:head# 2024-04-01T19:56:59.750 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.751 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cdf53c0:::benchmark_data_smithi188_161190_object86234:head# 2024-04-01T19:56:59.751 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.751 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cdf92dc:::benchmark_data_smithi188_161190_object50511:head# 2024-04-01T19:56:59.752 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.752 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cdfe497:::benchmark_data_smithi188_161190_object63913:head# 2024-04-01T19:56:59.752 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.752 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ce08f9d:::benchmark_data_smithi188_161190_object133642:head# 2024-04-01T19:56:59.752 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.752 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ce2ef65:::benchmark_data_smithi188_161190_object88869:head# 2024-04-01T19:56:59.752 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.753 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ce3c3c1:::benchmark_data_smithi188_161190_object138774:head# 2024-04-01T19:56:59.753 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.753 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ce4197b:::benchmark_data_smithi188_161190_object74671:head# 2024-04-01T19:56:59.753 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.753 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ce66b68:::benchmark_data_smithi188_161190_object60874:head# 2024-04-01T19:56:59.753 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.753 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ce6976d:::benchmark_data_smithi188_161190_object101699:head# 2024-04-01T19:56:59.753 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.753 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ce6d377:::benchmark_data_smithi188_161190_object56677:head# 2024-04-01T19:56:59.753 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.754 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ce73a8c:::benchmark_data_smithi188_161190_object66773:head# 2024-04-01T19:56:59.754 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.754 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ce7738e:::benchmark_data_smithi188_161190_object109010:head# 2024-04-01T19:56:59.754 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.758 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ce77f4f:::benchmark_data_smithi188_161190_object62424:head# 2024-04-01T19:56:59.758 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.758 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ce926fa:::benchmark_data_smithi188_161190_object70281:head# 2024-04-01T19:56:59.759 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.759 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ce98c31:::benchmark_data_smithi188_161190_object30586:head# 2024-04-01T19:56:59.759 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.759 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ce9f365:::benchmark_data_smithi188_161190_object60224:head# 2024-04-01T19:56:59.759 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.759 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ce9f973:::benchmark_data_smithi188_161190_object135243:head# 2024-04-01T19:56:59.759 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.759 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cead2f6:::benchmark_data_smithi188_161190_object121258:head# 2024-04-01T19:56:59.759 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.759 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ceb2280:::benchmark_data_smithi188_161190_object129330:head# 2024-04-01T19:56:59.759 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.759 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cebf798:::benchmark_data_smithi188_161190_object132189:head# 2024-04-01T19:56:59.760 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:59 smithi062 ceph-mon[44211]: 8.b scrub starts 2024-04-01T19:56:59.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:56:59 smithi062 ceph-mon[44211]: pgmap v1898: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.1 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 0 B/s wr, 469 op/s; 31028/199070 objects degraded (15.586%); 8.9 MiB/s, 142 objects/s recovering 2024-04-01T19:56:59.767 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cec7c41:::benchmark_data_smithi188_161190_object44811:head# 2024-04-01T19:56:59.767 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.767 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cee6450:::benchmark_data_smithi188_161190_object28802:head# 2024-04-01T19:56:59.767 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.767 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cef57eb:::benchmark_data_smithi188_161190_object23841:head# 2024-04-01T19:56:59.767 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.767 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cef7b37:::benchmark_data_smithi188_161190_object129943:head# 2024-04-01T19:56:59.767 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.767 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cf035ae:::benchmark_data_smithi188_161190_object121144:head# 2024-04-01T19:56:59.767 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.767 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cf1bc4b:::benchmark_data_smithi188_161190_object112853:head# 2024-04-01T19:56:59.768 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.768 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cf1c481:::benchmark_data_smithi188_161190_object84289:head# 2024-04-01T19:56:59.768 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.768 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cf20d0c:::benchmark_data_smithi188_161190_object65108:head# 2024-04-01T19:56:59.768 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.768 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cf2629e:::benchmark_data_smithi188_161190_object130284:head# 2024-04-01T19:56:59.768 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.768 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cf328d8:::benchmark_data_smithi188_161190_object68438:head# 2024-04-01T19:56:59.768 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.768 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cf36e3f:::benchmark_data_smithi188_161190_object63189:head# 2024-04-01T19:56:59.768 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.768 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cf37f66:::benchmark_data_smithi188_161190_object22335:head# 2024-04-01T19:56:59.768 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.768 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cf39edf:::benchmark_data_smithi188_161190_object52496:head# 2024-04-01T19:56:59.769 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.769 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cf3e367:::benchmark_data_smithi188_161190_object68539:head# 2024-04-01T19:56:59.769 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.769 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cf3fec3:::benchmark_data_smithi188_161190_object101719:head# 2024-04-01T19:56:59.769 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.769 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cf47277:::benchmark_data_smithi188_161190_object72096:head# 2024-04-01T19:56:59.769 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.769 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cf56d61:::benchmark_data_smithi188_161190_object123259:head# 2024-04-01T19:56:59.769 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.769 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cf58185:::benchmark_data_smithi188_161190_object120331:head# 2024-04-01T19:56:59.769 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.769 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cf640f7:::benchmark_data_smithi188_161190_object66658:head# 2024-04-01T19:56:59.769 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.770 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cf6b9b0:::benchmark_data_smithi188_161190_object87137:head# 2024-04-01T19:56:59.770 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.770 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cf6c980:::benchmark_data_smithi188_161190_object124750:head# 2024-04-01T19:56:59.770 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.770 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cf7a2b9:::benchmark_data_smithi188_161190_object75631:head# 2024-04-01T19:56:59.770 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.770 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cf81adb:::benchmark_data_smithi188_161190_object51603:head# 2024-04-01T19:56:59.770 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.770 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cf89d96:::benchmark_data_smithi188_161190_object60980:head# 2024-04-01T19:56:59.770 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.770 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cf8b372:::benchmark_data_smithi188_161190_object127452:head# 2024-04-01T19:56:59.770 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.770 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cf90402:::benchmark_data_smithi188_161190_object48013:head# 2024-04-01T19:56:59.771 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.771 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cfc4b82:::benchmark_data_smithi188_161190_object69045:head# 2024-04-01T19:56:59.771 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.771 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cfc99e8:::benchmark_data_smithi188_161190_object54396:head# 2024-04-01T19:56:59.771 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.771 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cfd4d2e:::benchmark_data_smithi188_161190_object75773:head# 2024-04-01T19:56:59.771 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.771 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cfe821b:::benchmark_data_smithi188_161190_object94801:head# 2024-04-01T19:56:59.771 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.771 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cfed68d:::benchmark_data_smithi188_161190_object51451:head# 2024-04-01T19:56:59.771 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.774 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cff2c25:::benchmark_data_smithi188_161190_object102077:head# 2024-04-01T19:56:59.774 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.774 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cff6603:::benchmark_data_smithi188_161190_object114374:head# 2024-04-01T19:56:59.774 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.774 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9cffc4dd:::benchmark_data_smithi188_161190_object128074:head# 2024-04-01T19:56:59.774 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.774 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d00979e:::benchmark_data_smithi188_161190_object50880:head# 2024-04-01T19:56:59.774 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.774 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d00bdb6:::benchmark_data_smithi188_161190_object112001:head# 2024-04-01T19:56:59.774 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.775 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d01503f:::benchmark_data_smithi188_161190_object33722:head# 2024-04-01T19:56:59.775 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.775 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d01c33f:::benchmark_data_smithi188_161190_object92386:head# 2024-04-01T19:56:59.775 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.775 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d02c4a1:::benchmark_data_smithi188_161190_object139091:head# 2024-04-01T19:56:59.775 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.775 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d040acb:::benchmark_data_smithi188_161190_object97456:head# 2024-04-01T19:56:59.775 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.775 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d04f802:::benchmark_data_smithi188_161190_object102603:head# 2024-04-01T19:56:59.775 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.775 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d054dbe:::benchmark_data_smithi188_161190_object23912:head# 2024-04-01T19:56:59.775 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.775 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d058071:::benchmark_data_smithi188_161190_object103882:head# 2024-04-01T19:56:59.775 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.776 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d059ae0:::benchmark_data_smithi188_161190_object134026:head# 2024-04-01T19:56:59.776 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.776 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d06133d:::benchmark_data_smithi188_161190_object86631:head# 2024-04-01T19:56:59.776 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.776 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d06cb64:::benchmark_data_smithi188_161190_object113934:head# 2024-04-01T19:56:59.776 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.776 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d06ecb4:::benchmark_data_smithi188_161190_object36953:head# 2024-04-01T19:56:59.776 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.776 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d08d96c:::benchmark_data_smithi188_161190_object21141:head# 2024-04-01T19:56:59.776 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.779 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d091ae1:::benchmark_data_smithi188_161190_object45909:head# 2024-04-01T19:56:59.779 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.779 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d09fa67:::benchmark_data_smithi188_161190_object92321:head# 2024-04-01T19:56:59.779 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.779 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d0a74b3:::benchmark_data_smithi188_161190_object107608:head# 2024-04-01T19:56:59.779 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.779 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d0afedd:::benchmark_data_smithi188_161190_object130297:head# 2024-04-01T19:56:59.779 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.779 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d0b3446:::benchmark_data_smithi188_161190_object22433:head# 2024-04-01T19:56:59.779 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.779 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d0b3922:::benchmark_data_smithi188_161190_object133275:head# 2024-04-01T19:56:59.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d0e4ef7:::benchmark_data_smithi188_161190_object40915:head# 2024-04-01T19:56:59.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d0e92df:::benchmark_data_smithi188_161190_object85057:head# 2024-04-01T19:56:59.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d0eef9b:::benchmark_data_smithi188_161190_object135844:head# 2024-04-01T19:56:59.780 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.780 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d0ff619:::benchmark_data_smithi188_161190_object64493:head# 2024-04-01T19:56:59.781 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.781 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d1055c7:::benchmark_data_smithi188_161190_object109709:head# 2024-04-01T19:56:59.781 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.781 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d125f5e:::benchmark_data_smithi188_161190_object29077:head# 2024-04-01T19:56:59.781 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.782 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d12f17c:::benchmark_data_smithi188_161190_object135578:head# 2024-04-01T19:56:59.782 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.782 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d1325b7:::benchmark_data_smithi188_161190_object60860:head# 2024-04-01T19:56:59.782 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.783 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d14bdbe:::benchmark_data_smithi188_161190_object70353:head# 2024-04-01T19:56:59.783 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.783 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d14d6af:::benchmark_data_smithi188_161190_object121283:head# 2024-04-01T19:56:59.783 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.783 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d152379:::benchmark_data_smithi188_161190_object58819:head# 2024-04-01T19:56:59.783 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.783 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d156a36:::benchmark_data_smithi188_161190_object56387:head# 2024-04-01T19:56:59.783 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.783 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d1634a4:::benchmark_data_smithi188_161190_object47876:head# 2024-04-01T19:56:59.783 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.784 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d17067a:::benchmark_data_smithi188_161190_object21792:head# 2024-04-01T19:56:59.784 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.789 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d170bd2:::benchmark_data_smithi188_161190_object109264:head# 2024-04-01T19:56:59.789 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.791 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d171199:::benchmark_data_smithi188_161190_object65220:head# 2024-04-01T19:56:59.791 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.795 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d178f9a:::benchmark_data_smithi188_161190_object20565:head# 2024-04-01T19:56:59.795 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.796 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d187db3:::benchmark_data_smithi188_161190_object75336:head# 2024-04-01T19:56:59.796 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.796 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d19bdf8:::benchmark_data_smithi188_161190_object55846:head# 2024-04-01T19:56:59.796 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.796 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d1ad184:::benchmark_data_smithi188_161190_object106317:head# 2024-04-01T19:56:59.796 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.797 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d1be487:::benchmark_data_smithi188_161190_object121402:head# 2024-04-01T19:56:59.797 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.797 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d1c7b05:::benchmark_data_smithi188_161190_object35034:head# 2024-04-01T19:56:59.797 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.801 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d1cb1f9:::benchmark_data_smithi188_161190_object111093:head# 2024-04-01T19:56:59.801 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.801 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d1d6cd6:::benchmark_data_smithi188_161190_object71708:head# 2024-04-01T19:56:59.802 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.807 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d1e8058:::benchmark_data_smithi188_161190_object77582:head# 2024-04-01T19:56:59.807 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.808 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d1ec21e:::benchmark_data_smithi188_161190_object38801:head# 2024-04-01T19:56:59.808 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.808 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d1f55e1:::benchmark_data_smithi188_161190_object63437:head# 2024-04-01T19:56:59.808 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.808 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d1fc3b3:::benchmark_data_smithi188_161190_object68555:head# 2024-04-01T19:56:59.808 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.809 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d2138d9:::benchmark_data_smithi188_161190_object84585:head# 2024-04-01T19:56:59.809 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.809 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d215c26:::benchmark_data_smithi188_161190_object78806:head# 2024-04-01T19:56:59.809 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.810 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d222552:::benchmark_data_smithi188_161190_object69540:head# 2024-04-01T19:56:59.810 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.810 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d235b75:::benchmark_data_smithi188_161190_object97886:head# 2024-04-01T19:56:59.810 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.820 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d235ba2:::benchmark_data_smithi188_161190_object115631:head# 2024-04-01T19:56:59.821 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d24c65b:::benchmark_data_smithi188_161190_object57531:head# 2024-04-01T19:56:59.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d251990:::benchmark_data_smithi188_161190_object47039:head# 2024-04-01T19:56:59.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d257402:::benchmark_data_smithi188_161190_object118351:head# 2024-04-01T19:56:59.826 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.826 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d25bc70:::benchmark_data_smithi188_161190_object105484:head# 2024-04-01T19:56:59.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.827 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d25e5e6:::benchmark_data_smithi188_161190_object20359:head# 2024-04-01T19:56:59.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.827 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d26f257:::benchmark_data_smithi188_161190_object93879:head# 2024-04-01T19:56:59.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.827 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d273bf9:::benchmark_data_smithi188_161190_object83830:head# 2024-04-01T19:56:59.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.827 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d27a711:::benchmark_data_smithi188_161190_object104292:head# 2024-04-01T19:56:59.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.827 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d28ce43:::benchmark_data_smithi188_161190_object40483:head# 2024-04-01T19:56:59.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.827 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d28f966:::benchmark_data_smithi188_161190_object105411:head# 2024-04-01T19:56:59.827 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.827 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d295d8f:::benchmark_data_smithi188_161190_object124421:head# 2024-04-01T19:56:59.828 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.829 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d29d22c:::benchmark_data_smithi188_161190_object114333:head# 2024-04-01T19:56:59.829 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.829 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d2a289e:::benchmark_data_smithi188_161190_object75427:head# 2024-04-01T19:56:59.829 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.829 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d2a7425:::benchmark_data_smithi188_161190_object98461:head# 2024-04-01T19:56:59.829 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.829 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d2ac736:::benchmark_data_smithi188_161190_object48937:head# 2024-04-01T19:56:59.829 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.829 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d2ae031:::benchmark_data_smithi188_161190_object30786:head# 2024-04-01T19:56:59.829 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.829 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d2b185d:::benchmark_data_smithi188_161190_object27207:head# 2024-04-01T19:56:59.829 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.829 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d2c119d:::benchmark_data_smithi188_161190_object29665:head# 2024-04-01T19:56:59.829 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d2c2eff:::benchmark_data_smithi188_161190_object40738:head# 2024-04-01T19:56:59.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d2cf74c:::benchmark_data_smithi188_161190_object23650:head# 2024-04-01T19:56:59.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d2de3a5:::benchmark_data_smithi188_161190_object59677:head# 2024-04-01T19:56:59.830 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.830 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d2e1709:::benchmark_data_smithi188_161190_object115358:head# 2024-04-01T19:56:59.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d2ea4df:::benchmark_data_smithi188_161190_object43798:head# 2024-04-01T19:56:59.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d2f3474:::benchmark_data_smithi188_161190_object119303:head# 2024-04-01T19:56:59.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d2fc83c:::benchmark_data_smithi188_161190_object64643:head# 2024-04-01T19:56:59.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d2feb91:::benchmark_data_smithi188_161190_object128380:head# 2024-04-01T19:56:59.831 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.831 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d30175f:::benchmark_data_smithi188_161190_object63505:head# 2024-04-01T19:56:59.832 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.832 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d313f12:::benchmark_data_smithi188_161190_object135139:head# 2024-04-01T19:56:59.832 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.832 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d31c304:::benchmark_data_smithi188_161190_object138200:head# 2024-04-01T19:56:59.832 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.832 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d321545:::benchmark_data_smithi188_161190_object48827:head# 2024-04-01T19:56:59.832 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.836 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d327a21:::benchmark_data_smithi188_161190_object48500:head# 2024-04-01T19:56:59.836 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.836 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d34d292:::benchmark_data_smithi188_161190_object124252:head# 2024-04-01T19:56:59.836 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.847 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d34e935:::benchmark_data_smithi188_161190_object93615:head# 2024-04-01T19:56:59.847 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.848 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d34fe80:::benchmark_data_smithi188_161190_object74498:head# 2024-04-01T19:56:59.848 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.851 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d3636e7:::benchmark_data_smithi188_161190_object59613:head# 2024-04-01T19:56:59.851 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:59 smithi022 ceph-mon[39439]: 8.b scrub starts 2024-04-01T19:56:59.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:56:59 smithi022 ceph-mon[39439]: pgmap v1898: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.1 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 0 B/s wr, 469 op/s; 31028/199070 objects degraded (15.586%); 8.9 MiB/s, 142 objects/s recovering 2024-04-01T19:56:59.863 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d368a01:::benchmark_data_smithi188_161190_object54265:head# 2024-04-01T19:56:59.863 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.863 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d36f195:::benchmark_data_smithi188_161190_object43226:head# 2024-04-01T19:56:59.863 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.863 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d3816bc:::benchmark_data_smithi188_161190_object83299:head# 2024-04-01T19:56:59.863 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.863 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d3861b8:::benchmark_data_smithi188_161190_object38433:head# 2024-04-01T19:56:59.863 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.863 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d38e2d5:::benchmark_data_smithi188_161190_object91451:head# 2024-04-01T19:56:59.863 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d3a5444:::benchmark_data_smithi188_161190_object102668:head# 2024-04-01T19:56:59.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d3c909c:::benchmark_data_smithi188_161190_object46391:head# 2024-04-01T19:56:59.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d3d4518:::benchmark_data_smithi188_161190_object52987:head# 2024-04-01T19:56:59.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d3d80e6:::benchmark_data_smithi188_161190_object26795:head# 2024-04-01T19:56:59.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d3fb46c:::benchmark_data_smithi188_161190_object123599:head# 2024-04-01T19:56:59.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d3fcd8b:::benchmark_data_smithi188_161190_object55545:head# 2024-04-01T19:56:59.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d3fdb80:::benchmark_data_smithi188_161190_object48778:head# 2024-04-01T19:56:59.864 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.864 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d401fb1:::benchmark_data_smithi188_161190_object44704:head# 2024-04-01T19:56:59.865 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.865 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d4035e7:::benchmark_data_smithi188_161190_object126775:head# 2024-04-01T19:56:59.865 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.865 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d410df7:::benchmark_data_smithi188_161190_object21301:head# 2024-04-01T19:56:59.865 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.865 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d416b2c:::benchmark_data_smithi188_161190_object64227:head# 2024-04-01T19:56:59.865 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.865 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d41d3ca:::benchmark_data_smithi188_161190_object88982:head# 2024-04-01T19:56:59.865 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.865 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d42a3f8:::benchmark_data_smithi188_161190_object101732:head# 2024-04-01T19:56:59.865 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.865 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d4326b5:::benchmark_data_smithi188_161190_object129507:head# 2024-04-01T19:56:59.865 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.865 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d4352ea:::benchmark_data_smithi188_161190_object95623:head# 2024-04-01T19:56:59.865 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.866 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d43660f:::benchmark_data_smithi188_161190_object89991:head# 2024-04-01T19:56:59.866 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.866 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d447d9a:::benchmark_data_smithi188_161190_object132459:head# 2024-04-01T19:56:59.866 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.866 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d448102:::benchmark_data_smithi188_161190_object22294:head# 2024-04-01T19:56:59.866 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.866 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d45fde2:::benchmark_data_smithi188_161190_object123452:head# 2024-04-01T19:56:59.866 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.866 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d46739b:::benchmark_data_smithi188_161190_object61478:head# 2024-04-01T19:56:59.866 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.866 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d473ac4:::benchmark_data_smithi188_161190_object41273:head# 2024-04-01T19:56:59.866 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.866 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d48503f:::benchmark_data_smithi188_161190_object116064:head# 2024-04-01T19:56:59.866 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.867 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d48af63:::benchmark_data_smithi188_161190_object123657:head# 2024-04-01T19:56:59.867 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.867 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d48ce1d:::benchmark_data_smithi188_161190_object71867:head# 2024-04-01T19:56:59.867 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.867 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d48f336:::benchmark_data_smithi188_161190_object82220:head# 2024-04-01T19:56:59.867 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.868 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d4a4066:::benchmark_data_smithi188_161190_object78968:head# 2024-04-01T19:56:59.868 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.868 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d4ade1d:::benchmark_data_smithi188_161190_object20742:head# 2024-04-01T19:56:59.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d4af1d1:::benchmark_data_smithi188_161190_object48310:head# 2024-04-01T19:56:59.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d4c424b:::benchmark_data_smithi188_161190_object132710:head# 2024-04-01T19:56:59.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d4c7947:::benchmark_data_smithi188_161190_object64846:head# 2024-04-01T19:56:59.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d4cb5e8:::benchmark_data_smithi188_161190_object70640:head# 2024-04-01T19:56:59.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d4d1e0c:::benchmark_data_smithi188_161190_object52984:head# 2024-04-01T19:56:59.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.869 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d4d956a:::benchmark_data_smithi188_161190_object137494:head# 2024-04-01T19:56:59.869 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.870 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d4f1e0b:::benchmark_data_smithi188_161190_object94769:head# 2024-04-01T19:56:59.870 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.870 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d500b5f:::benchmark_data_smithi188_161190_object77821:head# 2024-04-01T19:56:59.870 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.870 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d505bd1:::benchmark_data_smithi188_161190_object100465:head# 2024-04-01T19:56:59.870 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.870 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d5075c8:::benchmark_data_smithi188_161190_object84541:head# 2024-04-01T19:56:59.870 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.870 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d50bc86:::benchmark_data_smithi188_161190_object67161:head# 2024-04-01T19:56:59.870 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.870 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d50ce0b:::benchmark_data_smithi188_161190_object31304:head# 2024-04-01T19:56:59.870 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.870 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d515767:::benchmark_data_smithi188_161190_object102046:head# 2024-04-01T19:56:59.870 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.871 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d521017:::benchmark_data_smithi188_161190_object40308:head# 2024-04-01T19:56:59.871 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.874 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d52c69f:::benchmark_data_smithi188_161190_object40524:head# 2024-04-01T19:56:59.874 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.874 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d53717b:::benchmark_data_smithi188_161190_object65833:head# 2024-04-01T19:56:59.874 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.874 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d538cd7:::benchmark_data_smithi188_161190_object124397:head# 2024-04-01T19:56:59.874 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.874 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d542cc0:::benchmark_data_smithi188_161190_object135612:head# 2024-04-01T19:56:59.874 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.874 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d5610fe:::benchmark_data_smithi188_161190_object55250:head# 2024-04-01T19:56:59.875 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.875 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d56517a:::benchmark_data_smithi188_161190_object83583:head# 2024-04-01T19:56:59.875 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.875 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d571371:::benchmark_data_smithi188_161190_object30141:head# 2024-04-01T19:56:59.875 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.875 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d572056:::benchmark_data_smithi188_161190_object95151:head# 2024-04-01T19:56:59.875 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.875 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d5888eb:::benchmark_data_smithi188_161190_object54363:head# 2024-04-01T19:56:59.875 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.875 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d59ba5f:::benchmark_data_smithi188_161190_object85549:head# 2024-04-01T19:56:59.875 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.875 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d5a36d8:::benchmark_data_smithi188_161190_object29439:head# 2024-04-01T19:56:59.875 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.875 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d5b174e:::benchmark_data_smithi188_161190_object24679:head# 2024-04-01T19:56:59.876 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.876 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d5b2e06:::benchmark_data_smithi188_161190_object48719:head# 2024-04-01T19:56:59.876 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.876 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d5bef48:::benchmark_data_smithi188_161190_object68698:head# 2024-04-01T19:56:59.876 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.876 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d5befb4:::benchmark_data_smithi188_161190_object110043:head# 2024-04-01T19:56:59.876 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.876 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d5c1377:::benchmark_data_smithi188_161190_object50981:head# 2024-04-01T19:56:59.876 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:59 smithi188 ceph-mon[43939]: 8.b scrub starts 2024-04-01T19:56:59.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:56:59 smithi188 ceph-mon[43939]: pgmap v1898: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 6.1 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 0 B/s wr, 469 op/s; 31028/199070 objects degraded (15.586%); 8.9 MiB/s, 142 objects/s recovering 2024-04-01T19:56:59.879 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d5c277a:::benchmark_data_smithi188_161190_object36484:head# 2024-04-01T19:56:59.879 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.879 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d5c2d0b:::benchmark_data_smithi188_161190_object120890:head# 2024-04-01T19:56:59.879 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.879 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d5d6d2b:::benchmark_data_smithi188_161190_object51309:head# 2024-04-01T19:56:59.879 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.880 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d5d7567:::benchmark_data_smithi188_161190_object96191:head# 2024-04-01T19:56:59.880 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.880 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d5e4191:::benchmark_data_smithi188_161190_object58306:head# 2024-04-01T19:56:59.880 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.880 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d5f16ce:::benchmark_data_smithi188_161190_object67157:head# 2024-04-01T19:56:59.880 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.880 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d6102b2:::benchmark_data_smithi188_161190_object41943:head# 2024-04-01T19:56:59.880 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.880 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d6131c0:::benchmark_data_smithi188_161190_object68067:head# 2024-04-01T19:56:59.880 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.880 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d6192ea:::benchmark_data_smithi188_161190_object109540:head# 2024-04-01T19:56:59.880 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d623a93:::benchmark_data_smithi188_161190_object120293:head# 2024-04-01T19:56:59.881 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d626cea:::benchmark_data_smithi188_161190_object120252:head# 2024-04-01T19:56:59.881 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d62af6d:::benchmark_data_smithi188_161190_object120320:head# 2024-04-01T19:56:59.881 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d639e38:::benchmark_data_smithi188_161190_object56620:head# 2024-04-01T19:56:59.881 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d63dc43:::benchmark_data_smithi188_161190_object28177:head# 2024-04-01T19:56:59.881 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d648379:::benchmark_data_smithi188_161190_object24376:head# 2024-04-01T19:56:59.881 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.881 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d659bb5:::benchmark_data_smithi188_161190_object71921:head# 2024-04-01T19:56:59.881 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.882 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d65ecca:::benchmark_data_smithi188_161190_object114432:head# 2024-04-01T19:56:59.882 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.882 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d66c35b:::benchmark_data_smithi188_161190_object50390:head# 2024-04-01T19:56:59.882 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.882 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d6710ee:::benchmark_data_smithi188_161190_object85928:head# 2024-04-01T19:56:59.882 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.883 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d679350:::benchmark_data_smithi188_161190_object57674:head# 2024-04-01T19:56:59.883 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.884 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d67d779:::benchmark_data_smithi188_161190_object90654:head# 2024-04-01T19:56:59.884 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.884 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d6815ce:::benchmark_data_smithi188_161190_object56525:head# 2024-04-01T19:56:59.884 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.884 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d681afc:::benchmark_data_smithi188_161190_object31092:head# 2024-04-01T19:56:59.884 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.884 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d684065:::benchmark_data_smithi188_161190_object101503:head# 2024-04-01T19:56:59.884 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.884 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d6869f5:::benchmark_data_smithi188_161190_object71134:head# 2024-04-01T19:56:59.884 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.884 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d688f2d:::benchmark_data_smithi188_161190_object23702:head# 2024-04-01T19:56:59.884 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.884 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d691664:::benchmark_data_smithi188_161190_object76363:head# 2024-04-01T19:56:59.884 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.884 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d6919d8:::benchmark_data_smithi188_161190_object109075:head# 2024-04-01T19:56:59.885 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.885 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d693a5b:::benchmark_data_smithi188_161190_object87617:head# 2024-04-01T19:56:59.885 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.885 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d69766a:::benchmark_data_smithi188_161190_object104923:head# 2024-04-01T19:56:59.885 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.885 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d69db1f:::benchmark_data_smithi188_161190_object137120:head# 2024-04-01T19:56:59.885 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.885 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d69ed81:::benchmark_data_smithi188_161190_object118441:head# 2024-04-01T19:56:59.885 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.885 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d6a05f2:::benchmark_data_smithi188_161190_object31534:head# 2024-04-01T19:56:59.885 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.886 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d6a3c35:::benchmark_data_smithi188_161190_object22663:head# 2024-04-01T19:56:59.886 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.886 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d6a975b:::benchmark_data_smithi188_161190_object22357:head# 2024-04-01T19:56:59.886 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.886 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d6aae41:::benchmark_data_smithi188_161190_object124221:head# 2024-04-01T19:56:59.887 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.887 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d6aeca4:::benchmark_data_smithi188_161190_object62815:head# 2024-04-01T19:56:59.887 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.887 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d6d50d4:::benchmark_data_smithi188_161190_object38197:head# 2024-04-01T19:56:59.887 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.887 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d6ec37e:::benchmark_data_smithi188_161190_object84184:head# 2024-04-01T19:56:59.887 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.887 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d6eeea7:::benchmark_data_smithi188_161190_object128268:head# 2024-04-01T19:56:59.887 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.887 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d6fbf5e:::benchmark_data_smithi188_161190_object101431:head# 2024-04-01T19:56:59.887 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.887 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d6ff811:::benchmark_data_smithi188_161190_object99147:head# 2024-04-01T19:56:59.887 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.887 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d70d5e3:::benchmark_data_smithi188_161190_object102129:head# 2024-04-01T19:56:59.887 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.888 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d710e6a:::benchmark_data_smithi188_161190_object63882:head# 2024-04-01T19:56:59.888 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.888 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d719438:::benchmark_data_smithi188_161190_object68127:head# 2024-04-01T19:56:59.888 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.888 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d72b249:::benchmark_data_smithi188_161190_object33743:head# 2024-04-01T19:56:59.888 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.888 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d72be57:::benchmark_data_smithi188_161190_object34161:head# 2024-04-01T19:56:59.888 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.889 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d744da8:::benchmark_data_smithi188_161190_object107602:head# 2024-04-01T19:56:59.889 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.889 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d74b74c:::benchmark_data_smithi188_161190_object99959:head# 2024-04-01T19:56:59.889 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.889 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d75c679:::benchmark_data_smithi188_161190_object50493:head# 2024-04-01T19:56:59.889 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.889 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d75f1bd:::benchmark_data_smithi188_161190_object74841:head# 2024-04-01T19:56:59.889 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.890 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d76267d:::benchmark_data_smithi188_161190_object123959:head# 2024-04-01T19:56:59.890 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.890 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d79cd55:::benchmark_data_smithi188_161190_object81620:head# 2024-04-01T19:56:59.890 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.891 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d7acef8:::benchmark_data_smithi188_161190_object118609:head# 2024-04-01T19:56:59.891 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.891 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d7b1091:::benchmark_data_smithi188_161190_object24413:head# 2024-04-01T19:56:59.891 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.891 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d7b1500:::benchmark_data_smithi188_161190_object62217:head# 2024-04-01T19:56:59.891 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.891 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d7b960f:::benchmark_data_smithi188_161190_object43672:head# 2024-04-01T19:56:59.891 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.891 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d7c6904:::benchmark_data_smithi188_161190_object30928:head# 2024-04-01T19:56:59.891 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.892 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d7d552a:::benchmark_data_smithi188_161190_object47725:head# 2024-04-01T19:56:59.892 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.892 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d7d75d9:::benchmark_data_smithi188_161190_object93979:head# 2024-04-01T19:56:59.892 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.893 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d7d9d6e:::benchmark_data_smithi188_161190_object101222:head# 2024-04-01T19:56:59.894 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.894 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d7ded1c:::benchmark_data_smithi188_161190_object120205:head# 2024-04-01T19:56:59.894 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.894 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d7f71af:::benchmark_data_smithi188_161190_object111508:head# 2024-04-01T19:56:59.894 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.894 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d7ff45d:::benchmark_data_smithi188_161190_object64334:head# 2024-04-01T19:56:59.894 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.894 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d803cc0:::benchmark_data_smithi188_161190_object105701:head# 2024-04-01T19:56:59.894 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.894 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d80d073:::benchmark_data_smithi188_161190_object130802:head# 2024-04-01T19:56:59.894 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.894 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d817f7e:::benchmark_data_smithi188_161190_object83969:head# 2024-04-01T19:56:59.894 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.895 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d819a08:::benchmark_data_smithi188_161190_object99850:head# 2024-04-01T19:56:59.895 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.895 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d81ed69:::benchmark_data_smithi188_161190_object74233:head# 2024-04-01T19:56:59.895 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.895 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d82379d:::benchmark_data_smithi188_161190_object111877:head# 2024-04-01T19:56:59.895 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.899 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d82c774:::benchmark_data_smithi188_161190_object46435:head# 2024-04-01T19:56:59.899 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.900 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d82fc61:::benchmark_data_smithi188_161190_object111612:head# 2024-04-01T19:56:59.900 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.900 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d83b3e9:::benchmark_data_smithi188_161190_object72558:head# 2024-04-01T19:56:59.900 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.900 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d8424b7:::benchmark_data_smithi188_161190_object95635:head# 2024-04-01T19:56:59.900 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.900 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d8438f7:::benchmark_data_smithi188_161190_object53202:head# 2024-04-01T19:56:59.900 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.900 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d84f2b8:::benchmark_data_smithi188_161190_object127187:head# 2024-04-01T19:56:59.900 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.900 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d85b373:::benchmark_data_smithi188_161190_object84054:head# 2024-04-01T19:56:59.900 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.900 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d865f12:::benchmark_data_smithi188_161190_object43117:head# 2024-04-01T19:56:59.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d8686bb:::benchmark_data_smithi188_161190_object79957:head# 2024-04-01T19:56:59.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d86e21b:::benchmark_data_smithi188_161190_object115277:head# 2024-04-01T19:56:59.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d8890f0:::benchmark_data_smithi188_161190_object121247:head# 2024-04-01T19:56:59.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.901 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d88af1f:::benchmark_data_smithi188_161190_object60088:head# 2024-04-01T19:56:59.901 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.903 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d88da73:::benchmark_data_smithi188_161190_object42499:head# 2024-04-01T19:56:59.903 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.903 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d88ef71:::benchmark_data_smithi188_161190_object90615:head# 2024-04-01T19:56:59.903 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.903 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d890e70:::benchmark_data_smithi188_161190_object77584:head# 2024-04-01T19:56:59.903 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.903 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d893b0b:::benchmark_data_smithi188_161190_object58986:head# 2024-04-01T19:56:59.903 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.904 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d89ef0c:::benchmark_data_smithi188_161190_object52527:head# 2024-04-01T19:56:59.904 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.904 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d8bdd81:::benchmark_data_smithi188_161190_object89177:head# 2024-04-01T19:56:59.904 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.904 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d8caef0:::benchmark_data_smithi188_161190_object78372:head# 2024-04-01T19:56:59.904 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.904 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d8d70ab:::benchmark_data_smithi188_161190_object115133:head# 2024-04-01T19:56:59.904 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.904 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d8e135a:::benchmark_data_smithi188_161190_object79194:head# 2024-04-01T19:56:59.904 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.904 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d8fa19f:::benchmark_data_smithi188_161190_object137565:head# 2024-04-01T19:56:59.904 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.904 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d9018c7:::benchmark_data_smithi188_161190_object24685:head# 2024-04-01T19:56:59.904 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.904 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d904429:::benchmark_data_smithi188_161190_object131601:head# 2024-04-01T19:56:59.905 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.905 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d90905a:::benchmark_data_smithi188_161190_object74139:head# 2024-04-01T19:56:59.905 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.906 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d91ad29:::benchmark_data_smithi188_161190_object117871:head# 2024-04-01T19:56:59.906 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.906 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d91c97e:::benchmark_data_smithi188_161190_object83979:head# 2024-04-01T19:56:59.906 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.907 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d91cdb0:::benchmark_data_smithi188_161190_object34662:head# 2024-04-01T19:56:59.907 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.907 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d91d42a:::benchmark_data_smithi188_161190_object123413:head# 2024-04-01T19:56:59.907 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.907 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d926842:::benchmark_data_smithi188_161190_object96489:head# 2024-04-01T19:56:59.907 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.907 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d92b695:::benchmark_data_smithi188_161190_object132505:head# 2024-04-01T19:56:59.907 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.907 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d939e0b:::benchmark_data_smithi188_161190_object49071:head# 2024-04-01T19:56:59.907 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.907 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d93c583:::benchmark_data_smithi188_161190_object28748:head# 2024-04-01T19:56:59.907 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.907 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d94826b:::benchmark_data_smithi188_161190_object98226:head# 2024-04-01T19:56:59.908 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.908 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d95b229:::benchmark_data_smithi188_161190_object34558:head# 2024-04-01T19:56:59.908 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.908 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d96cc4c:::benchmark_data_smithi188_161190_object25961:head# 2024-04-01T19:56:59.908 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.910 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d97a465:::benchmark_data_smithi188_161190_object34175:head# 2024-04-01T19:56:59.910 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.910 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d989804:::benchmark_data_smithi188_161190_object93439:head# 2024-04-01T19:56:59.911 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.911 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d99294c:::benchmark_data_smithi188_161190_object46725:head# 2024-04-01T19:56:59.911 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.911 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d99b824:::benchmark_data_smithi188_161190_object49963:head# 2024-04-01T19:56:59.911 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.911 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d99e743:::benchmark_data_smithi188_161190_object124823:head# 2024-04-01T19:56:59.911 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.911 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d9a471b:::benchmark_data_smithi188_161190_object37866:head# 2024-04-01T19:56:59.911 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.911 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d9aa79e:::benchmark_data_smithi188_161190_object58695:head# 2024-04-01T19:56:59.911 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.911 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d9b0267:::benchmark_data_smithi188_161190_object119055:head# 2024-04-01T19:56:59.911 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.911 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d9bf2b3:::benchmark_data_smithi188_161190_object22720:head# 2024-04-01T19:56:59.912 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.912 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d9d889c:::benchmark_data_smithi188_161190_object106764:head# 2024-04-01T19:56:59.912 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.912 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d9df062:::benchmark_data_smithi188_161190_object50378:head# 2024-04-01T19:56:59.912 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.912 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d9e000a:::benchmark_data_smithi188_161190_object44279:head# 2024-04-01T19:56:59.912 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.912 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d9e8b2c:::benchmark_data_smithi188_161190_object21744:head# 2024-04-01T19:56:59.912 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.912 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d9f2236:::benchmark_data_smithi188_161190_object124483:head# 2024-04-01T19:56:59.912 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.912 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d9f48ca:::benchmark_data_smithi188_161190_object34714:head# 2024-04-01T19:56:59.912 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.914 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9d9f9873:::benchmark_data_smithi188_161190_object76935:head# 2024-04-01T19:56:59.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.914 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9da06d8b:::benchmark_data_smithi188_161190_object113879:head# 2024-04-01T19:56:59.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.914 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9da079a5:::benchmark_data_smithi188_161190_object30232:head# 2024-04-01T19:56:59.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.914 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9da2bb59:::benchmark_data_smithi188_161190_object49413:head# 2024-04-01T19:56:59.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.914 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9da3774a:::benchmark_data_smithi188_161190_object30001:head# 2024-04-01T19:56:59.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.914 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9da4e7a9:::benchmark_data_smithi188_161190_object132938:head# 2024-04-01T19:56:59.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.914 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9da63dcc:::benchmark_data_smithi188_161190_object112366:head# 2024-04-01T19:56:59.914 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.915 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9da64898:::benchmark_data_smithi188_161190_object65511:head# 2024-04-01T19:56:59.915 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.915 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9da6b30f:::benchmark_data_smithi188_161190_object74663:head# 2024-04-01T19:56:59.915 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.919 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9da6e1c1:::benchmark_data_smithi188_161190_object78699:head# 2024-04-01T19:56:59.919 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.920 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9da794b1:::benchmark_data_smithi188_161190_object50659:head# 2024-04-01T19:56:59.920 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.926 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9da8b7a6:::benchmark_data_smithi188_161190_object21444:head# 2024-04-01T19:56:59.926 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.926 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9da8ef35:::benchmark_data_smithi188_161190_object67433:head# 2024-04-01T19:56:59.926 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.926 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9da93a5b:::benchmark_data_smithi188_161190_object117104:head# 2024-04-01T19:56:59.926 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.927 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9daa317a:::benchmark_data_smithi188_161190_object133480:head# 2024-04-01T19:56:59.927 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.927 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9daaadf5:::benchmark_data_smithi188_161190_object96781:head# 2024-04-01T19:56:59.927 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.927 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9daaecb8:::benchmark_data_smithi188_161190_object102507:head# 2024-04-01T19:56:59.927 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.927 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dab0332:::benchmark_data_smithi188_161190_object76936:head# 2024-04-01T19:56:59.927 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.927 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dabadfe:::benchmark_data_smithi188_161190_object130457:head# 2024-04-01T19:56:59.927 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.927 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dabd82f:::benchmark_data_smithi188_161190_object136574:head# 2024-04-01T19:56:59.927 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.927 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dad707e:::benchmark_data_smithi188_161190_object114422:head# 2024-04-01T19:56:59.927 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.927 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dae5373:::benchmark_data_smithi188_161190_object84023:head# 2024-04-01T19:56:59.928 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.928 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9daeaa03:::benchmark_data_smithi188_161190_object129934:head# 2024-04-01T19:56:59.928 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.928 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9daf6777:::benchmark_data_smithi188_161190_object52217:head# 2024-04-01T19:56:59.928 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.928 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9db0b0f3:::benchmark_data_smithi188_161190_object20813:head# 2024-04-01T19:56:59.928 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.928 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9db1dcc1:::benchmark_data_smithi188_161190_object30885:head# 2024-04-01T19:56:59.928 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.928 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9db36e33:::benchmark_data_smithi188_161190_object102295:head# 2024-04-01T19:56:59.928 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.928 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9db43201:::benchmark_data_smithi188_161190_object47399:head# 2024-04-01T19:56:59.928 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.929 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9db4345a:::benchmark_data_smithi188_161190_object127721:head# 2024-04-01T19:56:59.929 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.929 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9db46573:::benchmark_data_smithi188_161190_object124288:head# 2024-04-01T19:56:59.929 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.931 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9db47066:::benchmark_data_smithi188_161190_object138438:head# 2024-04-01T19:56:59.931 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.931 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9db5125e:::benchmark_data_smithi188_161190_object46360:head# 2024-04-01T19:56:59.931 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.931 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9db5efa5:::benchmark_data_smithi188_161190_object137054:head# 2024-04-01T19:56:59.931 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.931 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9db67d42:::benchmark_data_smithi188_161190_object117211:head# 2024-04-01T19:56:59.931 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.931 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9db6a7e5:::benchmark_data_smithi188_161190_object78591:head# 2024-04-01T19:56:59.931 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.931 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9db6bbdb:::benchmark_data_smithi188_161190_object100599:head# 2024-04-01T19:56:59.932 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.932 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9db7a541:::benchmark_data_smithi188_161190_object65276:head# 2024-04-01T19:56:59.932 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.932 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9db82fea:::benchmark_data_smithi188_161190_object37437:head# 2024-04-01T19:56:59.932 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.932 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9db87bc8:::benchmark_data_smithi188_161190_object85060:head# 2024-04-01T19:56:59.932 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.932 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9db89f19:::benchmark_data_smithi188_161190_object40900:head# 2024-04-01T19:56:59.932 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.932 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9db94f47:::benchmark_data_smithi188_161190_object23173:head# 2024-04-01T19:56:59.932 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.932 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dbab8b9:::benchmark_data_smithi188_161190_object30830:head# 2024-04-01T19:56:59.932 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.932 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dbacd77:::benchmark_data_smithi188_161190_object41566:head# 2024-04-01T19:56:59.933 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.933 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dbb6f80:::benchmark_data_smithi188_161190_object93547:head# 2024-04-01T19:56:59.933 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.933 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dbb791e:::benchmark_data_smithi188_161190_object130972:head# 2024-04-01T19:56:59.933 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.934 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dbbb197:::benchmark_data_smithi188_161190_object66617:head# 2024-04-01T19:56:59.934 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.934 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dbd05b6:::benchmark_data_smithi188_161190_object78064:head# 2024-04-01T19:56:59.934 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.934 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dbd5088:::benchmark_data_smithi188_161190_object94247:head# 2024-04-01T19:56:59.935 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.935 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dbdb76c:::benchmark_data_smithi188_161190_object87233:head# 2024-04-01T19:56:59.935 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.935 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dbf4ef6:::benchmark_data_smithi188_161190_object34436:head# 2024-04-01T19:56:59.935 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.935 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dbf8709:::benchmark_data_smithi188_161190_object81233:head# 2024-04-01T19:56:59.935 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.935 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dbf8f83:::benchmark_data_smithi188_161190_object115535:head# 2024-04-01T19:56:59.935 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.935 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dc04f72:::benchmark_data_smithi188_161190_object35845:head# 2024-04-01T19:56:59.935 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.935 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dc054f8:::benchmark_data_smithi188_161190_object103123:head# 2024-04-01T19:56:59.935 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.936 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dc0bdbc:::benchmark_data_smithi188_161190_object24407:head# 2024-04-01T19:56:59.936 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.936 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dc14d68:::benchmark_data_smithi188_161190_object51639:head# 2024-04-01T19:56:59.936 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.936 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dc238d2:::benchmark_data_smithi188_161190_object63102:head# 2024-04-01T19:56:59.936 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.936 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dc27a5e:::benchmark_data_smithi188_161190_object32926:head# 2024-04-01T19:56:59.936 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.936 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dc3350f:::benchmark_data_smithi188_161190_object20841:head# 2024-04-01T19:56:59.936 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.936 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dc3f58e:::benchmark_data_smithi188_161190_object32913:head# 2024-04-01T19:56:59.936 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.937 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dc401b8:::benchmark_data_smithi188_161190_object43092:head# 2024-04-01T19:56:59.937 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.937 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dc4a080:::benchmark_data_smithi188_161190_object74262:head# 2024-04-01T19:56:59.937 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.937 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dc4a1d5:::benchmark_data_smithi188_161190_object105574:head# 2024-04-01T19:56:59.937 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.941 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dc5180b:::benchmark_data_smithi188_161190_object101006:head# 2024-04-01T19:56:59.942 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.947 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dc6109a:::benchmark_data_smithi188_161190_object127422:head# 2024-04-01T19:56:59.947 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.948 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dc83c31:::benchmark_data_smithi188_161190_object70153:head# 2024-04-01T19:56:59.948 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.949 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dc8bd81:::benchmark_data_smithi188_161190_object137358:head# 2024-04-01T19:56:59.949 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.949 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dc8d27e:::benchmark_data_smithi188_161190_object103797:head# 2024-04-01T19:56:59.949 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.954 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dc8d436:::benchmark_data_smithi188_161190_object103101:head# 2024-04-01T19:56:59.954 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.955 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dc98587:::benchmark_data_smithi188_161190_object46314:head# 2024-04-01T19:56:59.955 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.956 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dca1948:::benchmark_data_smithi188_161190_object106744:head# 2024-04-01T19:56:59.956 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.956 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dca6883:::benchmark_data_smithi188_161190_object118712:head# 2024-04-01T19:56:59.956 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.966 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dcb91fb:::benchmark_data_smithi188_161190_object98061:head# 2024-04-01T19:56:59.966 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.967 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dcd2a3e:::benchmark_data_smithi188_161190_object134958:head# 2024-04-01T19:56:59.967 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.967 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dcea8d3:::benchmark_data_smithi188_161190_object78051:head# 2024-04-01T19:56:59.967 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.968 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dcf6e09:::benchmark_data_smithi188_161190_object78418:head# 2024-04-01T19:56:59.968 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.970 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dd00c8c:::benchmark_data_smithi188_161190_object62244:head# 2024-04-01T19:56:59.970 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.972 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dd15dc7:::benchmark_data_smithi188_161190_object51360:head# 2024-04-01T19:56:59.972 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.974 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dd3b4c7:::benchmark_data_smithi188_161190_object21752:head# 2024-04-01T19:56:59.975 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.975 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dd443cf:::benchmark_data_smithi188_161190_object46014:head# 2024-04-01T19:56:59.975 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.976 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dd5f48e:::benchmark_data_smithi188_161190_object135786:head# 2024-04-01T19:56:59.976 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.976 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dd73cd1:::benchmark_data_smithi188_161190_object90972:head# 2024-04-01T19:56:59.976 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.978 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dd7798c:::benchmark_data_smithi188_161190_object116217:head# 2024-04-01T19:56:59.978 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.978 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dd77ad5:::benchmark_data_smithi188_161190_object112114:head# 2024-04-01T19:56:59.978 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.978 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dd79dfa:::benchmark_data_smithi188_161190_object115899:head# 2024-04-01T19:56:59.978 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.978 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dd7b116:::benchmark_data_smithi188_161190_object41922:head# 2024-04-01T19:56:59.978 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.978 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dd7e49a:::benchmark_data_smithi188_161190_object47583:head# 2024-04-01T19:56:59.978 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.978 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dd81ac3:::benchmark_data_smithi188_161190_object130746:head# 2024-04-01T19:56:59.979 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.979 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dd874d5:::benchmark_data_smithi188_161190_object77681:head# 2024-04-01T19:56:59.979 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.979 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dd8852a:::benchmark_data_smithi188_161190_object136037:head# 2024-04-01T19:56:59.979 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.979 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dd8ee41:::benchmark_data_smithi188_161190_object108672:head# 2024-04-01T19:56:59.979 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.981 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dd90366:::benchmark_data_smithi188_161190_object96935:head# 2024-04-01T19:56:59.981 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.981 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dd9c812:::benchmark_data_smithi188_161190_object135436:head# 2024-04-01T19:56:59.981 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.982 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dda9d79:::benchmark_data_smithi188_161190_object20608:head# 2024-04-01T19:56:59.982 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.982 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ddb6b80:::benchmark_data_smithi188_161190_object79399:head# 2024-04-01T19:56:59.982 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.982 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ddb6d63:::benchmark_data_smithi188_161190_object68745:head# 2024-04-01T19:56:59.982 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.982 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dde0045:::benchmark_data_smithi188_161190_object117284:head# 2024-04-01T19:56:59.982 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.982 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dde71ec:::benchmark_data_smithi188_161190_object20717:head# 2024-04-01T19:56:59.982 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.982 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ddeac58:::benchmark_data_smithi188_161190_object50570:head# 2024-04-01T19:56:59.982 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.982 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ddf9e72:::benchmark_data_smithi188_161190_object63350:head# 2024-04-01T19:56:59.983 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.983 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9de08ac5:::benchmark_data_smithi188_161190_object114922:head# 2024-04-01T19:56:59.983 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.983 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9de0a83b:::benchmark_data_smithi188_161190_object89264:head# 2024-04-01T19:56:59.983 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.983 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9de0dfc5:::benchmark_data_smithi188_161190_object107063:head# 2024-04-01T19:56:59.983 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.983 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9de285aa:::benchmark_data_smithi188_161190_object103972:head# 2024-04-01T19:56:59.983 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.983 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9de2c2f9:::benchmark_data_smithi188_161190_object101706:head# 2024-04-01T19:56:59.983 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.985 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9de2d528:::benchmark_data_smithi188_161190_object99942:head# 2024-04-01T19:56:59.985 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.985 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9de2ddca:::benchmark_data_smithi188_161190_object114818:head# 2024-04-01T19:56:59.985 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.985 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9de420dd:::benchmark_data_smithi188_161190_object108431:head# 2024-04-01T19:56:59.985 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.985 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9de45df1:::benchmark_data_smithi188_161190_object134105:head# 2024-04-01T19:56:59.986 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.986 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9de465d6:::benchmark_data_smithi188_161190_object66547:head# 2024-04-01T19:56:59.986 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.986 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9de5057a:::benchmark_data_smithi188_161190_object61502:head# 2024-04-01T19:56:59.986 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.986 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9de5570d:::benchmark_data_smithi188_161190_object111821:head# 2024-04-01T19:56:59.986 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.986 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9de588b7:::benchmark_data_smithi188_161190_object100641:head# 2024-04-01T19:56:59.986 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.986 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9de62a2b:::benchmark_data_smithi188_161190_object37522:head# 2024-04-01T19:56:59.986 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.986 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9de67509:::benchmark_data_smithi188_161190_object30514:head# 2024-04-01T19:56:59.986 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.987 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9de69ef2:::benchmark_data_smithi188_161190_object65654:head# 2024-04-01T19:56:59.987 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.987 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9de70773:::benchmark_data_smithi188_161190_object73481:head# 2024-04-01T19:56:59.987 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.987 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9de7834a:::benchmark_data_smithi188_161190_object69696:head# 2024-04-01T19:56:59.987 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.987 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9de816d7:::benchmark_data_smithi188_161190_object67027:head# 2024-04-01T19:56:59.987 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.989 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9de90d95:::benchmark_data_smithi188_161190_object108674:head# 2024-04-01T19:56:59.989 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.999 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9de929b3:::benchmark_data_smithi188_161190_object104006:head# 2024-04-01T19:56:59.999 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.999 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9de93ee9:::benchmark_data_smithi188_161190_object41242:head# 2024-04-01T19:56:59.999 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.999 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9de9dab8:::benchmark_data_smithi188_161190_object68606:head# 2024-04-01T19:56:59.999 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:56:59.999 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dea1ba9:::benchmark_data_smithi188_161190_object110225:head# 2024-04-01T19:56:59.999 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.000 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9deacdf3:::benchmark_data_smithi188_161190_object126652:head# 2024-04-01T19:57:00.000 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.000 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9debc450:::benchmark_data_smithi188_161190_object104054:head# 2024-04-01T19:57:00.000 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.004 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9debf05d:::benchmark_data_smithi188_161190_object23287:head# 2024-04-01T19:57:00.004 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.004 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dec4827:::benchmark_data_smithi188_161190_object79288:head# 2024-04-01T19:57:00.004 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.004 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dec521c:::benchmark_data_smithi188_161190_object128142:head# 2024-04-01T19:57:00.004 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.004 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9decf893:::benchmark_data_smithi188_161190_object69561:head# 2024-04-01T19:57:00.004 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.004 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ded525c:::benchmark_data_smithi188_161190_object107639:head# 2024-04-01T19:57:00.004 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.004 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ded8896:::benchmark_data_smithi188_161190_object87360:head# 2024-04-01T19:57:00.004 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.005 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9deec211:::benchmark_data_smithi188_161190_object120485:head# 2024-04-01T19:57:00.005 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.005 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9def0403:::benchmark_data_smithi188_161190_object83254:head# 2024-04-01T19:57:00.005 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.005 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9def8738:::benchmark_data_smithi188_161190_object89222:head# 2024-04-01T19:57:00.005 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.005 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9df02032:::benchmark_data_smithi188_161190_object85213:head# 2024-04-01T19:57:00.005 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.005 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9df0404c:::benchmark_data_smithi188_161190_object94549:head# 2024-04-01T19:57:00.005 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.007 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9df0c716:::benchmark_data_smithi188_161190_object74583:head# 2024-04-01T19:57:00.007 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.007 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9df19eb9:::benchmark_data_smithi188_161190_object123208:head# 2024-04-01T19:57:00.007 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.007 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9df228f6:::benchmark_data_smithi188_161190_object130843:head# 2024-04-01T19:57:00.007 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.007 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9df2336b:::benchmark_data_smithi188_161190_object55941:head# 2024-04-01T19:57:00.007 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.007 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9df3069d:::benchmark_data_smithi188_161190_object43484:head# 2024-04-01T19:57:00.007 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.008 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9df38611:::benchmark_data_smithi188_161190_object29421:head# 2024-04-01T19:57:00.008 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.008 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9df58ad4:::benchmark_data_smithi188_161190_object39571:head# 2024-04-01T19:57:00.008 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.008 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9df5a160:::benchmark_data_smithi188_161190_object78612:head# 2024-04-01T19:57:00.008 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.008 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9df64ab7:::benchmark_data_smithi188_161190_object112329:head# 2024-04-01T19:57:00.008 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.008 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9df65855:::benchmark_data_smithi188_161190_object42583:head# 2024-04-01T19:57:00.008 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.008 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9df7789f:::benchmark_data_smithi188_161190_object29471:head# 2024-04-01T19:57:00.008 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.011 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9df7cc81:::benchmark_data_smithi188_161190_object120911:head# 2024-04-01T19:57:00.011 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.011 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9df7e3d4:::benchmark_data_smithi188_161190_object109535:head# 2024-04-01T19:57:00.011 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.011 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9df8b21f:::benchmark_data_smithi188_161190_object113724:head# 2024-04-01T19:57:00.011 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.011 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9df96a12:::benchmark_data_smithi188_161190_object79306:head# 2024-04-01T19:57:00.011 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.011 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9df9f706:::benchmark_data_smithi188_161190_object25924:head# 2024-04-01T19:57:00.011 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.012 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dfa955f:::benchmark_data_smithi188_161190_object20482:head# 2024-04-01T19:57:00.012 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.012 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dfaedf1:::benchmark_data_smithi188_161190_object37772:head# 2024-04-01T19:57:00.012 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.012 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dfb5b1e:::benchmark_data_smithi188_161190_object130546:head# 2024-04-01T19:57:00.012 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.012 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dfbca97:::benchmark_data_smithi188_161190_object37964:head# 2024-04-01T19:57:00.012 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.012 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dfcdf67:::benchmark_data_smithi188_161190_object89511:head# 2024-04-01T19:57:00.012 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.012 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dfd2cc9:::benchmark_data_smithi188_161190_object49546:head# 2024-04-01T19:57:00.012 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.012 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dfdd1ab:::benchmark_data_smithi188_161190_object90274:head# 2024-04-01T19:57:00.012 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.013 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dfe5829:::benchmark_data_smithi188_161190_object88461:head# 2024-04-01T19:57:00.013 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.013 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dfe9daa:::benchmark_data_smithi188_161190_object82045:head# 2024-04-01T19:57:00.013 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.013 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dff074b:::benchmark_data_smithi188_161190_object111167:head# 2024-04-01T19:57:00.014 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.014 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dff8cba:::benchmark_data_smithi188_161190_object55005:head# 2024-04-01T19:57:00.014 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.014 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dff9e3f:::benchmark_data_smithi188_161190_object82983:head# 2024-04-01T19:57:00.014 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.014 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9dffe416:::benchmark_data_smithi188_161190_object107383:head# 2024-04-01T19:57:00.014 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.014 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e0029cc:::benchmark_data_smithi188_161190_object49075:head# 2024-04-01T19:57:00.014 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.014 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e01cd27:::benchmark_data_smithi188_161190_object95209:head# 2024-04-01T19:57:00.014 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.014 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e01ff20:::benchmark_data_smithi188_161190_object123434:head# 2024-04-01T19:57:00.015 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.015 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e026e7e:::benchmark_data_smithi188_161190_object49279:head# 2024-04-01T19:57:00.015 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.015 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e037bd6:::benchmark_data_smithi188_161190_object19747:head# 2024-04-01T19:57:00.015 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.015 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e0390e1:::benchmark_data_smithi188_161190_object26230:head# 2024-04-01T19:57:00.015 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.015 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e0404db:::benchmark_data_smithi188_161190_object73522:head# 2024-04-01T19:57:00.015 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.015 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e0408a4:::benchmark_data_smithi188_161190_object50720:head# 2024-04-01T19:57:00.015 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.016 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e04a91f:::benchmark_data_smithi188_161190_object77139:head# 2024-04-01T19:57:00.016 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.016 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e05e8dc:::benchmark_data_smithi188_161190_object130998:head# 2024-04-01T19:57:00.016 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.016 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e076ebf:::benchmark_data_smithi188_161190_object39451:head# 2024-04-01T19:57:00.016 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.016 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e07a888:::benchmark_data_smithi188_161190_object106060:head# 2024-04-01T19:57:00.016 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.016 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e07b445:::benchmark_data_smithi188_161190_object75860:head# 2024-04-01T19:57:00.017 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.017 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e08559a:::benchmark_data_smithi188_161190_object43578:head# 2024-04-01T19:57:00.017 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.019 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e0859f4:::benchmark_data_smithi188_161190_object28234:head# 2024-04-01T19:57:00.019 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.019 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e096606:::benchmark_data_smithi188_161190_object100645:head# 2024-04-01T19:57:00.020 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.020 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e0b8cc1:::benchmark_data_smithi188_161190_object94246:head# 2024-04-01T19:57:00.020 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.020 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e0c416f:::benchmark_data_smithi188_161190_object111491:head# 2024-04-01T19:57:00.020 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.020 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e0c9525:::benchmark_data_smithi188_161190_object123693:head# 2024-04-01T19:57:00.020 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.030 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e0ca700:::benchmark_data_smithi188_161190_object31896:head# 2024-04-01T19:57:00.030 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.031 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e0caffd:::benchmark_data_smithi188_161190_object107942:head# 2024-04-01T19:57:00.031 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.032 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e0d96a2:::benchmark_data_smithi188_161190_object35212:head# 2024-04-01T19:57:00.032 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.032 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e0e22fa:::benchmark_data_smithi188_161190_object126053:head# 2024-04-01T19:57:00.032 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.032 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e0ea09c:::benchmark_data_smithi188_161190_object32534:head# 2024-04-01T19:57:00.032 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.033 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e0ee73b:::benchmark_data_smithi188_161190_object119491:head# 2024-04-01T19:57:00.033 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.033 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e0eee8b:::benchmark_data_smithi188_161190_object29398:head# 2024-04-01T19:57:00.033 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.033 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e0f8282:::benchmark_data_smithi188_161190_object135576:head# 2024-04-01T19:57:00.033 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.033 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e0f89cd:::benchmark_data_smithi188_161190_object70866:head# 2024-04-01T19:57:00.033 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.034 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e1016c1:::benchmark_data_smithi188_161190_object32690:head# 2024-04-01T19:57:00.034 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.035 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e1076af:::benchmark_data_smithi188_161190_object25494:head# 2024-04-01T19:57:00.035 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.035 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e107870:::benchmark_data_smithi188_161190_object37680:head# 2024-04-01T19:57:00.035 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.035 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e115726:::benchmark_data_smithi188_161190_object135680:head# 2024-04-01T19:57:00.035 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.035 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e142ddf:::benchmark_data_smithi188_161190_object40061:head# 2024-04-01T19:57:00.035 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.035 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e14e064:::benchmark_data_smithi188_161190_object78346:head# 2024-04-01T19:57:00.035 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.036 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e14e0e1:::benchmark_data_smithi188_161190_object103118:head# 2024-04-01T19:57:00.036 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.036 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e16b934:::benchmark_data_smithi188_161190_object124780:head# 2024-04-01T19:57:00.036 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.037 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e174cc1:::benchmark_data_smithi188_161190_object80134:head# 2024-04-01T19:57:00.037 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.037 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e181744:::benchmark_data_smithi188_161190_object36039:head# 2024-04-01T19:57:00.037 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.038 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e19259a:::benchmark_data_smithi188_161190_object30182:head# 2024-04-01T19:57:00.038 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.038 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e1965cc:::benchmark_data_smithi188_161190_object43990:head# 2024-04-01T19:57:00.038 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.038 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e19dbfd:::benchmark_data_smithi188_161190_object56309:head# 2024-04-01T19:57:00.038 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.038 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e1a33e7:::benchmark_data_smithi188_161190_object21948:head# 2024-04-01T19:57:00.038 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.038 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e1a7fb0:::benchmark_data_smithi188_161190_object53034:head# 2024-04-01T19:57:00.038 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.038 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e1aa0f0:::benchmark_data_smithi188_161190_object137543:head# 2024-04-01T19:57:00.038 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.038 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e1c594b:::benchmark_data_smithi188_161190_object122501:head# 2024-04-01T19:57:00.039 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.039 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e1cc8a5:::benchmark_data_smithi188_161190_object83000:head# 2024-04-01T19:57:00.039 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.039 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e1e2a2a:::benchmark_data_smithi188_161190_object58611:head# 2024-04-01T19:57:00.039 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.039 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e1f6d55:::benchmark_data_smithi188_161190_object95746:head# 2024-04-01T19:57:00.040 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.040 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e1f9d37:::benchmark_data_smithi188_161190_object116437:head# 2024-04-01T19:57:00.040 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.040 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e2088c7:::benchmark_data_smithi188_161190_object33001:head# 2024-04-01T19:57:00.040 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.040 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e215c7e:::benchmark_data_smithi188_161190_object37917:head# 2024-04-01T19:57:00.040 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.040 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e21aa46:::benchmark_data_smithi188_161190_object40329:head# 2024-04-01T19:57:00.040 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.055 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e223e77:::benchmark_data_smithi188_161190_object62265:head# 2024-04-01T19:57:00.055 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.055 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e2415ba:::benchmark_data_smithi188_161190_object99110:head# 2024-04-01T19:57:00.055 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.063 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e24275f:::benchmark_data_smithi188_161190_object52906:head# 2024-04-01T19:57:00.063 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.076 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e25c666:::benchmark_data_smithi188_161190_object45362:head# 2024-04-01T19:57:00.076 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.079 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e268837:::benchmark_data_smithi188_161190_object101751:head# 2024-04-01T19:57:00.079 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.080 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e268b61:::benchmark_data_smithi188_161190_object96365:head# 2024-04-01T19:57:00.080 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.080 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e27ef8c:::benchmark_data_smithi188_161190_object122969:head# 2024-04-01T19:57:00.080 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.080 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e27f231:::benchmark_data_smithi188_161190_object125949:head# 2024-04-01T19:57:00.080 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.080 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e285fea:::benchmark_data_smithi188_161190_object35877:head# 2024-04-01T19:57:00.080 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.080 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e2874f4:::benchmark_data_smithi188_161190_object35223:head# 2024-04-01T19:57:00.080 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.080 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e28cdc4:::benchmark_data_smithi188_161190_object88378:head# 2024-04-01T19:57:00.080 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.081 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:57:00.081 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:57:00.085 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e29fce9:::benchmark_data_smithi188_161190_object121993:head# 2024-04-01T19:57:00.085 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.085 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e2b1633:::benchmark_data_smithi188_161190_object82946:head# 2024-04-01T19:57:00.085 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.085 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e2be00b:::benchmark_data_smithi188_161190_object101907:head# 2024-04-01T19:57:00.085 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.086 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e2c2b89:::benchmark_data_smithi188_161190_object51221:head# 2024-04-01T19:57:00.086 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.086 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e2c5913:::benchmark_data_smithi188_161190_object63168:head# 2024-04-01T19:57:00.086 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.086 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e2e1d37:::benchmark_data_smithi188_161190_object97773:head# 2024-04-01T19:57:00.086 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.086 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e2e9896:::benchmark_data_smithi188_161190_object65598:head# 2024-04-01T19:57:00.086 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.086 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e2ed809:::benchmark_data_smithi188_161190_object132873:head# 2024-04-01T19:57:00.086 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.086 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e2f15f1:::benchmark_data_smithi188_161190_object56465:head# 2024-04-01T19:57:00.086 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.087 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e2f5f79:::benchmark_data_smithi188_161190_object99037:head# 2024-04-01T19:57:00.087 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.087 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e2fefa9:::benchmark_data_smithi188_161190_object112761:head# 2024-04-01T19:57:00.087 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.087 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e2ff0a3:::benchmark_data_smithi188_161190_object101488:head# 2024-04-01T19:57:00.087 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.087 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e30585a:::benchmark_data_smithi188_161190_object82593:head# 2024-04-01T19:57:00.087 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.087 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e306c8a:::benchmark_data_smithi188_161190_object35378:head# 2024-04-01T19:57:00.087 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.087 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e30a537:::benchmark_data_smithi188_161190_object125726:head# 2024-04-01T19:57:00.087 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.087 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e3268ec:::benchmark_data_smithi188_161190_object76601:head# 2024-04-01T19:57:00.088 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.088 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e32c03e:::benchmark_data_smithi188_161190_object38526:head# 2024-04-01T19:57:00.088 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.088 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e342306:::benchmark_data_smithi188_161190_object54442:head# 2024-04-01T19:57:00.088 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.094 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e34850e:::benchmark_data_smithi188_161190_object81486:head# 2024-04-01T19:57:00.094 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.094 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e35ed85:::benchmark_data_smithi188_161190_object92341:head# 2024-04-01T19:57:00.094 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.094 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e3616a8:::benchmark_data_smithi188_161190_object67089:head# 2024-04-01T19:57:00.094 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.094 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e361738:::benchmark_data_smithi188_161190_object61435:head# 2024-04-01T19:57:00.094 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.094 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e362819:::benchmark_data_smithi188_161190_object89543:head# 2024-04-01T19:57:00.094 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.095 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e362912:::benchmark_data_smithi188_161190_object81789:head# 2024-04-01T19:57:00.095 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.095 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e366604:::benchmark_data_smithi188_161190_object20324:head# 2024-04-01T19:57:00.095 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.095 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e379f0a:::benchmark_data_smithi188_161190_object110247:head# 2024-04-01T19:57:00.095 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.095 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e37e13d:::benchmark_data_smithi188_161190_object19765:head# 2024-04-01T19:57:00.095 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.101 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e392d3a:::benchmark_data_smithi188_161190_object99970:head# 2024-04-01T19:57:00.101 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.102 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e3ab427:::benchmark_data_smithi188_161190_object122148:head# 2024-04-01T19:57:00.102 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.102 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e3afc47:::benchmark_data_smithi188_161190_object67694:head# 2024-04-01T19:57:00.103 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.103 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e3b2d95:::benchmark_data_smithi188_161190_object22829:head# 2024-04-01T19:57:00.103 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.103 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:57:00.107 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e3b80ce:::benchmark_data_smithi188_161190_object96572:head# 2024-04-01T19:57:00.107 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.107 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e3c18db:::benchmark_data_smithi188_161190_object100285:head# 2024-04-01T19:57:00.108 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.108 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e3c9751:::benchmark_data_smithi188_161190_object118513:head# 2024-04-01T19:57:00.108 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.108 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e3d4009:::benchmark_data_smithi188_161190_object88234:head# 2024-04-01T19:57:00.108 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.108 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e3d99c9:::benchmark_data_smithi188_161190_object78998:head# 2024-04-01T19:57:00.108 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.108 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e3dda6c:::benchmark_data_smithi188_161190_object41498:head# 2024-04-01T19:57:00.108 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.108 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e3e73b8:::benchmark_data_smithi188_161190_object74567:head# 2024-04-01T19:57:00.108 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.108 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e3f376d:::benchmark_data_smithi188_161190_object96043:head# 2024-04-01T19:57:00.108 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.109 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e3fbda7:::benchmark_data_smithi188_161190_object111572:head# 2024-04-01T19:57:00.109 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.109 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:00.110 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:57:00.116 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e3fbfb1:::benchmark_data_smithi188_161190_object70204:head# 2024-04-01T19:57:00.116 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.116 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e40ef01:::benchmark_data_smithi188_161190_object23999:head# 2024-04-01T19:57:00.116 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.118 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e40efbc:::benchmark_data_smithi188_161190_object107611:head# 2024-04-01T19:57:00.118 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.118 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e40fbf1:::benchmark_data_smithi188_161190_object59714:head# 2024-04-01T19:57:00.118 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.118 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e425b77:::benchmark_data_smithi188_161190_object78900:head# 2024-04-01T19:57:00.118 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.118 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e42dd67:::benchmark_data_smithi188_161190_object42446:head# 2024-04-01T19:57:00.118 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.129 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e438415:::benchmark_data_smithi188_161190_object66533:head# 2024-04-01T19:57:00.129 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.129 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e4399c1:::benchmark_data_smithi188_161190_object136168:head# 2024-04-01T19:57:00.130 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.130 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e439a52:::benchmark_data_smithi188_161190_object136100:head# 2024-04-01T19:57:00.130 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.130 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e445e4a:::benchmark_data_smithi188_161190_object97688:head# 2024-04-01T19:57:00.130 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.130 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e446a91:::benchmark_data_smithi188_161190_object37792:head# 2024-04-01T19:57:00.130 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.130 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e446c58:::benchmark_data_smithi188_161190_object79327:head# 2024-04-01T19:57:00.130 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.130 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e4496e7:::benchmark_data_smithi188_161190_object40666:head# 2024-04-01T19:57:00.130 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.130 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e44c242:::benchmark_data_smithi188_161190_object78171:head# 2024-04-01T19:57:00.130 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.130 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e450b1e:::benchmark_data_smithi188_161190_object44641:head# 2024-04-01T19:57:00.131 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.131 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e4526f9:::benchmark_data_smithi188_161190_object29154:head# 2024-04-01T19:57:00.131 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.131 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e45ab29:::benchmark_data_smithi188_161190_object45858:head# 2024-04-01T19:57:00.131 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.131 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e45ae24:::benchmark_data_smithi188_161190_object20358:head# 2024-04-01T19:57:00.131 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.131 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e47952e:::benchmark_data_smithi188_161190_object70749:head# 2024-04-01T19:57:00.131 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.131 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e47d9f2:::benchmark_data_smithi188_161190_object105803:head# 2024-04-01T19:57:00.131 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.131 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e48d424:::benchmark_data_smithi188_161190_object26457:head# 2024-04-01T19:57:00.131 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.131 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e48fe60:::benchmark_data_smithi188_161190_object27286:head# 2024-04-01T19:57:00.131 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.131 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e4a8299:::benchmark_data_smithi188_161190_object129379:head# 2024-04-01T19:57:00.132 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.132 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e4b279f:::benchmark_data_smithi188_161190_object114888:head# 2024-04-01T19:57:00.132 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.132 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e4b2a4f:::benchmark_data_smithi188_161190_object57019:head# 2024-04-01T19:57:00.132 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.132 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e4c7b05:::benchmark_data_smithi188_161190_object93533:head# 2024-04-01T19:57:00.132 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.132 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e4cdb93:::benchmark_data_smithi188_161190_object130029:head# 2024-04-01T19:57:00.132 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.132 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e4ce373:::benchmark_data_smithi188_161190_object113183:head# 2024-04-01T19:57:00.132 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.132 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e4cec7a:::benchmark_data_smithi188_161190_object69892:head# 2024-04-01T19:57:00.132 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.132 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e4cf207:::benchmark_data_smithi188_161190_object94838:head# 2024-04-01T19:57:00.133 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.134 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e4cf90b:::benchmark_data_smithi188_161190_object78916:head# 2024-04-01T19:57:00.134 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.134 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e4cfe0e:::benchmark_data_smithi188_161190_object121383:head# 2024-04-01T19:57:00.134 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.134 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e4d06a6:::benchmark_data_smithi188_161190_object88795:head# 2024-04-01T19:57:00.134 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.134 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e5188ed:::benchmark_data_smithi188_161190_object74877:head# 2024-04-01T19:57:00.134 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.134 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e51ead5:::benchmark_data_smithi188_161190_object121311:head# 2024-04-01T19:57:00.134 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.135 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e52029c:::benchmark_data_smithi188_161190_object25923:head# 2024-04-01T19:57:00.135 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.135 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e524ef5:::benchmark_data_smithi188_161190_object28593:head# 2024-04-01T19:57:00.135 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.135 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e52a6d9:::benchmark_data_smithi188_161190_object94813:head# 2024-04-01T19:57:00.135 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.135 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e52c1d4:::benchmark_data_smithi188_161190_object35211:head# 2024-04-01T19:57:00.135 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.135 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e52c7b4:::benchmark_data_smithi188_161190_object105014:head# 2024-04-01T19:57:00.135 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.135 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e533fb0:::benchmark_data_smithi188_161190_object119331:head# 2024-04-01T19:57:00.135 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.135 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e53bd1e:::benchmark_data_smithi188_161190_object44541:head# 2024-04-01T19:57:00.135 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.135 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e540c19:::benchmark_data_smithi188_161190_object104980:head# 2024-04-01T19:57:00.135 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.136 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e541548:::benchmark_data_smithi188_161190_object53287:head# 2024-04-01T19:57:00.136 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.136 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e54b4f3:::benchmark_data_smithi188_161190_object98906:head# 2024-04-01T19:57:00.136 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.136 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e55d240:::benchmark_data_smithi188_161190_object50982:head# 2024-04-01T19:57:00.136 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.137 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e560517:::benchmark_data_smithi188_161190_object60404:head# 2024-04-01T19:57:00.138 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.138 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e5774a1:::benchmark_data_smithi188_161190_object40628:head# 2024-04-01T19:57:00.138 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.138 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e581138:::benchmark_data_smithi188_161190_object88178:head# 2024-04-01T19:57:00.138 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.138 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e5885d5:::benchmark_data_smithi188_161190_object85919:head# 2024-04-01T19:57:00.138 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.138 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e58a0b5:::benchmark_data_smithi188_161190_object63645:head# 2024-04-01T19:57:00.138 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.138 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e5924ce:::benchmark_data_smithi188_161190_object62442:head# 2024-04-01T19:57:00.138 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.138 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e59565b:::benchmark_data_smithi188_161190_object68888:head# 2024-04-01T19:57:00.139 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.139 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e597515:::benchmark_data_smithi188_161190_object107833:head# 2024-04-01T19:57:00.139 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.139 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e59e194:::benchmark_data_smithi188_161190_object52980:head# 2024-04-01T19:57:00.139 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.139 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e59f66d:::benchmark_data_smithi188_161190_object105617:head# 2024-04-01T19:57:00.139 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.139 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e5be27d:::benchmark_data_smithi188_161190_object98984:head# 2024-04-01T19:57:00.139 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.139 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e5c69b8:::benchmark_data_smithi188_161190_object91085:head# 2024-04-01T19:57:00.139 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.141 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e5c7fe0:::benchmark_data_smithi188_161190_object128933:head# 2024-04-01T19:57:00.141 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.142 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e5c82b3:::benchmark_data_smithi188_161190_object20758:head# 2024-04-01T19:57:00.142 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.142 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e5ca14a:::benchmark_data_smithi188_161190_object138403:head# 2024-04-01T19:57:00.142 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.142 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e5cd267:::benchmark_data_smithi188_161190_object48239:head# 2024-04-01T19:57:00.142 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.142 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e5d0a50:::benchmark_data_smithi188_161190_object59810:head# 2024-04-01T19:57:00.142 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.142 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e5d320f:::benchmark_data_smithi188_161190_object85156:head# 2024-04-01T19:57:00.142 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.142 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e5dab54:::benchmark_data_smithi188_161190_object111025:head# 2024-04-01T19:57:00.142 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.142 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e5dc194:::benchmark_data_smithi188_161190_object52308:head# 2024-04-01T19:57:00.143 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.143 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e5dea5d:::benchmark_data_smithi188_161190_object85573:head# 2024-04-01T19:57:00.143 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.143 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e5df53d:::benchmark_data_smithi188_161190_object108465:head# 2024-04-01T19:57:00.143 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.143 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e5e374b:::benchmark_data_smithi188_161190_object90330:head# 2024-04-01T19:57:00.143 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.143 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e5ef52c:::benchmark_data_smithi188_161190_object69414:head# 2024-04-01T19:57:00.143 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.143 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e5f1dd9:::benchmark_data_smithi188_161190_object112884:head# 2024-04-01T19:57:00.143 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.144 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e60c879:::benchmark_data_smithi188_161190_object98632:head# 2024-04-01T19:57:00.144 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.144 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e60de0c:::benchmark_data_smithi188_161190_object79701:head# 2024-04-01T19:57:00.144 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.152 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e60f008:::benchmark_data_smithi188_161190_object37723:head# 2024-04-01T19:57:00.152 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.153 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e612769:::benchmark_data_smithi188_161190_object107263:head# 2024-04-01T19:57:00.153 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.155 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e61aeea:::benchmark_data_smithi188_161190_object43668:head# 2024-04-01T19:57:00.155 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.155 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e6209fe:::benchmark_data_smithi188_161190_object90154:head# 2024-04-01T19:57:00.155 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.155 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e622f2a:::benchmark_data_smithi188_161190_object100793:head# 2024-04-01T19:57:00.155 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.155 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e62d3df:::benchmark_data_smithi188_161190_object24250:head# 2024-04-01T19:57:00.155 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.155 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e636d35:::benchmark_data_smithi188_161190_object30783:head# 2024-04-01T19:57:00.155 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.156 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e64051d:::benchmark_data_smithi188_161190_object32001:head# 2024-04-01T19:57:00.156 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.156 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e64839f:::benchmark_data_smithi188_161190_object83504:head# 2024-04-01T19:57:00.156 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.156 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e64c4b8:::benchmark_data_smithi188_161190_object101593:head# 2024-04-01T19:57:00.156 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.166 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e660750:::benchmark_data_smithi188_161190_object45447:head# 2024-04-01T19:57:00.167 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.167 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e6677e1:::benchmark_data_smithi188_161190_object128104:head# 2024-04-01T19:57:00.167 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.167 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e673377:::benchmark_data_smithi188_161190_object42090:head# 2024-04-01T19:57:00.167 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.167 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e6755f7:::benchmark_data_smithi188_161190_object57889:head# 2024-04-01T19:57:00.167 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.167 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e678032:::benchmark_data_smithi188_161190_object105709:head# 2024-04-01T19:57:00.167 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.167 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e67e024:::benchmark_data_smithi188_161190_object75002:head# 2024-04-01T19:57:00.167 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.167 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e68a614:::benchmark_data_smithi188_161190_object104684:head# 2024-04-01T19:57:00.167 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.168 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e69378f:::benchmark_data_smithi188_161190_object79470:head# 2024-04-01T19:57:00.168 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.168 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e6979d9:::benchmark_data_smithi188_161190_object88668:head# 2024-04-01T19:57:00.168 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.168 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e69ba34:::benchmark_data_smithi188_161190_object29336:head# 2024-04-01T19:57:00.168 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.168 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e69d141:::benchmark_data_smithi188_161190_object130417:head# 2024-04-01T19:57:00.168 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.168 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e6a1484:::benchmark_data_smithi188_161190_object24505:head# 2024-04-01T19:57:00.168 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.169 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e6a4cca:::benchmark_data_smithi188_161190_object57618:head# 2024-04-01T19:57:00.169 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.169 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e6a740f:::benchmark_data_smithi188_161190_object59586:head# 2024-04-01T19:57:00.169 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.169 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e6c0fa4:::benchmark_data_smithi188_161190_object59808:head# 2024-04-01T19:57:00.169 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.169 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e6c71ac:::benchmark_data_smithi188_161190_object32547:head# 2024-04-01T19:57:00.169 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.180 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e6cb04f:::benchmark_data_smithi188_161190_object82910:head# 2024-04-01T19:57:00.180 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.184 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e6d2b68:::benchmark_data_smithi188_161190_object34524:head# 2024-04-01T19:57:00.184 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.184 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e6e31ad:::benchmark_data_smithi188_161190_object128382:head# 2024-04-01T19:57:00.184 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.184 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e6e5ed1:::benchmark_data_smithi188_161190_object42750:head# 2024-04-01T19:57:00.184 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.184 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e6ef996:::benchmark_data_smithi188_161190_object72578:head# 2024-04-01T19:57:00.184 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.184 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e6f82c1:::benchmark_data_smithi188_161190_object101073:head# 2024-04-01T19:57:00.184 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.184 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e71a0d7:::benchmark_data_smithi188_161190_object106157:head# 2024-04-01T19:57:00.184 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.185 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e723e75:::benchmark_data_smithi188_161190_object95084:head# 2024-04-01T19:57:00.185 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.186 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e7279d6:::benchmark_data_smithi188_161190_object92205:head# 2024-04-01T19:57:00.186 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.187 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e73e400:::benchmark_data_smithi188_161190_object114592:head# 2024-04-01T19:57:00.187 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.193 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e7465f4:::benchmark_data_smithi188_161190_object96245:head# 2024-04-01T19:57:00.194 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.199 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e74f7ab:::benchmark_data_smithi188_161190_object32651:head# 2024-04-01T19:57:00.199 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.199 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e76972a:::benchmark_data_smithi188_161190_object28585:head# 2024-04-01T19:57:00.199 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.199 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e76b892:::benchmark_data_smithi188_161190_object49337:head# 2024-04-01T19:57:00.199 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.199 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e77979c:::benchmark_data_smithi188_161190_object59567:head# 2024-04-01T19:57:00.199 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.199 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e787814:::benchmark_data_smithi188_161190_object45797:head# 2024-04-01T19:57:00.200 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.200 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e787b94:::benchmark_data_smithi188_161190_object92095:head# 2024-04-01T19:57:00.200 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.200 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e791851:::benchmark_data_smithi188_161190_object95171:head# 2024-04-01T19:57:00.200 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.200 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e7934c4:::benchmark_data_smithi188_161190_object43786:head# 2024-04-01T19:57:00.200 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.200 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e794ad6:::benchmark_data_smithi188_161190_object86832:head# 2024-04-01T19:57:00.200 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.200 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e79a1eb:::benchmark_data_smithi188_161190_object61526:head# 2024-04-01T19:57:00.200 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.200 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e7aa59f:::benchmark_data_smithi188_161190_object95312:head# 2024-04-01T19:57:00.200 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.200 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e7aae7d:::benchmark_data_smithi188_161190_object37943:head# 2024-04-01T19:57:00.201 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.201 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e7b4255:::benchmark_data_smithi188_161190_object39274:head# 2024-04-01T19:57:00.201 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.201 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e7b7293:::benchmark_data_smithi188_161190_object98385:head# 2024-04-01T19:57:00.201 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.201 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e7c7580:::benchmark_data_smithi188_161190_object137492:head# 2024-04-01T19:57:00.201 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.201 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e7e6342:::benchmark_data_smithi188_161190_object44112:head# 2024-04-01T19:57:00.201 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.201 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e7eb049:::benchmark_data_smithi188_161190_object56103:head# 2024-04-01T19:57:00.201 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.201 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e7f21e3:::benchmark_data_smithi188_161190_object108363:head# 2024-04-01T19:57:00.201 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.202 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e7fa80a:::benchmark_data_smithi188_161190_object100157:head# 2024-04-01T19:57:00.202 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.202 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e80068c:::benchmark_data_smithi188_161190_object50014:head# 2024-04-01T19:57:00.202 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.202 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e80bac3:::benchmark_data_smithi188_161190_object79833:head# 2024-04-01T19:57:00.203 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.203 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e80c6af:::benchmark_data_smithi188_161190_object117350:head# 2024-04-01T19:57:00.203 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e812922:::benchmark_data_smithi188_161190_object116661:head# 2024-04-01T19:57:00.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e814794:::benchmark_data_smithi188_161190_object105558:head# 2024-04-01T19:57:00.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e81c4ca:::benchmark_data_smithi188_161190_object131643:head# 2024-04-01T19:57:00.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e84a501:::benchmark_data_smithi188_161190_object28586:head# 2024-04-01T19:57:00.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e84aa73:::benchmark_data_smithi188_161190_object99610:head# 2024-04-01T19:57:00.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.204 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e852b2b:::benchmark_data_smithi188_161190_object116552:head# 2024-04-01T19:57:00.204 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.205 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e8549e3:::benchmark_data_smithi188_161190_object83553:head# 2024-04-01T19:57:00.205 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.205 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e85abfc:::benchmark_data_smithi188_161190_object50065:head# 2024-04-01T19:57:00.205 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.205 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e85afbf:::benchmark_data_smithi188_161190_object134096:head# 2024-04-01T19:57:00.205 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.205 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e870e3e:::benchmark_data_smithi188_161190_object110800:head# 2024-04-01T19:57:00.205 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.205 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e874cdd:::benchmark_data_smithi188_161190_object138254:head# 2024-04-01T19:57:00.206 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.206 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e876d3e:::benchmark_data_smithi188_161190_object87307:head# 2024-04-01T19:57:00.206 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.206 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e87df7d:::benchmark_data_smithi188_161190_object120910:head# 2024-04-01T19:57:00.206 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.207 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e8828b3:::benchmark_data_smithi188_161190_object108531:head# 2024-04-01T19:57:00.207 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.207 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e88614a:::benchmark_data_smithi188_161190_object103292:head# 2024-04-01T19:57:00.207 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.207 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e8890c0:::benchmark_data_smithi188_161190_object43234:head# 2024-04-01T19:57:00.207 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.207 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e892b68:::benchmark_data_smithi188_161190_object101275:head# 2024-04-01T19:57:00.207 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.208 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e898555:::benchmark_data_smithi188_161190_object58172:head# 2024-04-01T19:57:00.208 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.208 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e89935d:::benchmark_data_smithi188_161190_object25229:head# 2024-04-01T19:57:00.208 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.208 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e8a56b4:::benchmark_data_smithi188_161190_object85745:head# 2024-04-01T19:57:00.208 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.208 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e8a619d:::benchmark_data_smithi188_161190_object35094:head# 2024-04-01T19:57:00.208 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.208 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e8b1155:::benchmark_data_smithi188_161190_object27665:head# 2024-04-01T19:57:00.209 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.209 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e8b4005:::benchmark_data_smithi188_161190_object47808:head# 2024-04-01T19:57:00.209 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.210 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e8b9293:::benchmark_data_smithi188_161190_object60230:head# 2024-04-01T19:57:00.210 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.210 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e8c56dd:::benchmark_data_smithi188_161190_object117421:head# 2024-04-01T19:57:00.210 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.210 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e8cbc56:::benchmark_data_smithi188_161190_object121485:head# 2024-04-01T19:57:00.210 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.210 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e8d3d61:::benchmark_data_smithi188_161190_object132551:head# 2024-04-01T19:57:00.210 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.210 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:57:00.211 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e8d65e4:::benchmark_data_smithi188_161190_object98343:head# 2024-04-01T19:57:00.211 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.212 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e8f83c2:::benchmark_data_smithi188_161190_object60819:head# 2024-04-01T19:57:00.212 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.212 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e8f88f3:::benchmark_data_smithi188_161190_object86128:head# 2024-04-01T19:57:00.212 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.212 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e8f8ed7:::benchmark_data_smithi188_161190_object126790:head# 2024-04-01T19:57:00.212 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.213 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e9034b5:::benchmark_data_smithi188_161190_object66952:head# 2024-04-01T19:57:00.213 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.216 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e90f64b:::benchmark_data_smithi188_161190_object120654:head# 2024-04-01T19:57:00.216 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.216 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e9138b4:::benchmark_data_smithi188_161190_object54364:head# 2024-04-01T19:57:00.216 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.217 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e91c626:::benchmark_data_smithi188_161190_object122154:head# 2024-04-01T19:57:00.217 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.218 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e91ff07:::benchmark_data_smithi188_161190_object81234:head# 2024-04-01T19:57:00.218 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.218 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e925ce3:::benchmark_data_smithi188_161190_object26079:head# 2024-04-01T19:57:00.218 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.218 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e92977b:::benchmark_data_smithi188_161190_object84173:head# 2024-04-01T19:57:00.218 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.218 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e958447:::benchmark_data_smithi188_161190_object60064:head# 2024-04-01T19:57:00.218 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.218 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e96884b:::benchmark_data_smithi188_161190_object28644:head# 2024-04-01T19:57:00.218 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.219 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e96b062:::benchmark_data_smithi188_161190_object89346:head# 2024-04-01T19:57:00.219 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.219 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e970d93:::benchmark_data_smithi188_161190_object55079:head# 2024-04-01T19:57:00.219 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.219 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e975fdc:::benchmark_data_smithi188_161190_object133345:head# 2024-04-01T19:57:00.220 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.220 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e979f1e:::benchmark_data_smithi188_161190_object52253:head# 2024-04-01T19:57:00.220 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.220 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e97ff5a:::benchmark_data_smithi188_161190_object89342:head# 2024-04-01T19:57:00.221 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.221 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e980cdb:::benchmark_data_smithi188_161190_object47155:head# 2024-04-01T19:57:00.221 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.221 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e988fd6:::benchmark_data_smithi188_161190_object128898:head# 2024-04-01T19:57:00.221 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.221 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e9929c4:::benchmark_data_smithi188_161190_object114310:head# 2024-04-01T19:57:00.221 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.221 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e996f74:::benchmark_data_smithi188_161190_object117417:head# 2024-04-01T19:57:00.221 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.221 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e998875:::benchmark_data_smithi188_161190_object135443:head# 2024-04-01T19:57:00.221 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.222 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e9ad460:::benchmark_data_smithi188_161190_object23269:head# 2024-04-01T19:57:00.222 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.222 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e9b46f7:::benchmark_data_smithi188_161190_object84922:head# 2024-04-01T19:57:00.222 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.222 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e9bb8af:::benchmark_data_smithi188_161190_object83142:head# 2024-04-01T19:57:00.223 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.223 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e9d18e0:::benchmark_data_smithi188_161190_object91011:head# 2024-04-01T19:57:00.223 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.223 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e9e5d05:::benchmark_data_smithi188_161190_object48520:head# 2024-04-01T19:57:00.223 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.243 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e9efdcc:::benchmark_data_smithi188_161190_object129864:head# 2024-04-01T19:57:00.244 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.244 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9e9f1c4c:::benchmark_data_smithi188_161190_object38292:head# 2024-04-01T19:57:00.244 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.244 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ea017e7:::benchmark_data_smithi188_161190_object93648:head# 2024-04-01T19:57:00.244 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.244 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ea052ec:::benchmark_data_smithi188_161190_object27120:head# 2024-04-01T19:57:00.244 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.244 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ea1442e:::benchmark_data_smithi188_161190_object121353:head# 2024-04-01T19:57:00.244 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.244 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ea1643c:::benchmark_data_smithi188_161190_object32176:head# 2024-04-01T19:57:00.244 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.244 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ea26662:::benchmark_data_smithi188_161190_object34040:head# 2024-04-01T19:57:00.244 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.245 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ea36758:::benchmark_data_smithi188_161190_object29870:head# 2024-04-01T19:57:00.245 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.245 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ea43222:::benchmark_data_smithi188_161190_object125825:head# 2024-04-01T19:57:00.245 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.245 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ea5577e:::benchmark_data_smithi188_161190_object51069:head# 2024-04-01T19:57:00.245 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.245 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ea64dd1:::benchmark_data_smithi188_161190_object118379:head# 2024-04-01T19:57:00.245 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.245 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ea677be:::benchmark_data_smithi188_161190_object21985:head# 2024-04-01T19:57:00.245 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.245 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ea6b557:::benchmark_data_smithi188_161190_object56529:head# 2024-04-01T19:57:00.245 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.246 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ea6bddf:::benchmark_data_smithi188_161190_object93730:head# 2024-04-01T19:57:00.246 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.246 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ea6eeab:::benchmark_data_smithi188_161190_object29552:head# 2024-04-01T19:57:00.246 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.246 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ea7490c:::benchmark_data_smithi188_161190_object121662:head# 2024-04-01T19:57:00.246 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.246 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:00.247 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ea8a02b:::benchmark_data_smithi188_161190_object30930:head# 2024-04-01T19:57:00.247 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.247 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ea8a06c:::benchmark_data_smithi188_161190_object47161:head# 2024-04-01T19:57:00.247 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.248 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ea91a15:::benchmark_data_smithi188_161190_object49987:head# 2024-04-01T19:57:00.248 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.248 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ea9da59:::benchmark_data_smithi188_161190_object86029:head# 2024-04-01T19:57:00.248 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.248 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eaa599f:::benchmark_data_smithi188_161190_object86124:head# 2024-04-01T19:57:00.248 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.248 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eabf0fc:::benchmark_data_smithi188_161190_object91558:head# 2024-04-01T19:57:00.248 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.248 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eacfa64:::benchmark_data_smithi188_161190_object111195:head# 2024-04-01T19:57:00.248 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.248 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eadbe61:::benchmark_data_smithi188_161190_object65217:head# 2024-04-01T19:57:00.248 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.248 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eae5285:::benchmark_data_smithi188_161190_object21574:head# 2024-04-01T19:57:00.248 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.258 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eaf536b:::benchmark_data_smithi188_161190_object37598:head# 2024-04-01T19:57:00.258 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.261 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eb05a9d:::benchmark_data_smithi188_161190_object56744:head# 2024-04-01T19:57:00.261 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.262 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eb06148:::benchmark_data_smithi188_161190_object68357:head# 2024-04-01T19:57:00.262 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.273 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eb17ebd:::benchmark_data_smithi188_161190_object36721:head# 2024-04-01T19:57:00.273 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.276 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eb19343:::benchmark_data_smithi188_161190_object51546:head# 2024-04-01T19:57:00.276 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.277 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eb2c862:::benchmark_data_smithi188_161190_object51951:head# 2024-04-01T19:57:00.277 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.278 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eb2cd25:::benchmark_data_smithi188_161190_object85694:head# 2024-04-01T19:57:00.278 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.278 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eb3c8ec:::benchmark_data_smithi188_161190_object45444:head# 2024-04-01T19:57:00.278 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.278 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eb4408e:::benchmark_data_smithi188_161190_object119452:head# 2024-04-01T19:57:00.279 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.279 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eb4bb12:::benchmark_data_smithi188_161190_object65492:head# 2024-04-01T19:57:00.279 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.279 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eb69ab8:::benchmark_data_smithi188_161190_object74683:head# 2024-04-01T19:57:00.279 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.279 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eb6d837:::benchmark_data_smithi188_161190_object74522:head# 2024-04-01T19:57:00.280 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.280 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eb8cf2f:::benchmark_data_smithi188_161190_object137076:head# 2024-04-01T19:57:00.280 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.280 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eb8ef38:::benchmark_data_smithi188_161190_object81330:head# 2024-04-01T19:57:00.280 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.298 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eb977d5:::benchmark_data_smithi188_161190_object84217:head# 2024-04-01T19:57:00.299 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.299 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eba931d:::benchmark_data_smithi188_161190_object32297:head# 2024-04-01T19:57:00.299 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.299 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ebaac1e:::benchmark_data_smithi188_161190_object125004:head# 2024-04-01T19:57:00.299 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.299 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ebaf079:::benchmark_data_smithi188_161190_object42511:head# 2024-04-01T19:57:00.299 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.299 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ebb29e3:::benchmark_data_smithi188_161190_object57168:head# 2024-04-01T19:57:00.299 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.299 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ebb8548:::benchmark_data_smithi188_161190_object126349:head# 2024-04-01T19:57:00.299 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.299 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ebb8f97:::benchmark_data_smithi188_161190_object115429:head# 2024-04-01T19:57:00.300 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.300 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ebc120f:::benchmark_data_smithi188_161190_object56654:head# 2024-04-01T19:57:00.300 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.300 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ebc5c6f:::benchmark_data_smithi188_161190_object129808:head# 2024-04-01T19:57:00.300 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.301 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ebcf0ea:::benchmark_data_smithi188_161190_object77026:head# 2024-04-01T19:57:00.301 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.301 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ebd261c:::benchmark_data_smithi188_161190_object21235:head# 2024-04-01T19:57:00.301 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.301 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ebd2c99:::benchmark_data_smithi188_161190_object45921:head# 2024-04-01T19:57:00.301 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.301 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ebdaf25:::benchmark_data_smithi188_161190_object100346:head# 2024-04-01T19:57:00.301 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.301 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ebe424c:::benchmark_data_smithi188_161190_object75573:head# 2024-04-01T19:57:00.301 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.302 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ebe967b:::benchmark_data_smithi188_161190_object105495:head# 2024-04-01T19:57:00.302 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.304 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ebf40b2:::benchmark_data_smithi188_161190_object108043:head# 2024-04-01T19:57:00.304 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.304 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ebfae59:::benchmark_data_smithi188_161190_object35065:head# 2024-04-01T19:57:00.304 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.308 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ec01344:::benchmark_data_smithi188_161190_object74565:head# 2024-04-01T19:57:00.308 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.315 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ec0ca67:::benchmark_data_smithi188_161190_object120001:head# 2024-04-01T19:57:00.315 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.315 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ec121fd:::benchmark_data_smithi188_161190_object32566:head# 2024-04-01T19:57:00.315 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.316 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ec14585:::benchmark_data_smithi188_161190_object38001:head# 2024-04-01T19:57:00.316 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.316 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ec14a22:::benchmark_data_smithi188_161190_object47055:head# 2024-04-01T19:57:00.316 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.316 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ec1a8e5:::benchmark_data_smithi188_161190_object53666:head# 2024-04-01T19:57:00.316 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.316 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ec1fcbf:::benchmark_data_smithi188_161190_object40809:head# 2024-04-01T19:57:00.316 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.317 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ec26a9a:::benchmark_data_smithi188_161190_object117650:head# 2024-04-01T19:57:00.317 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.317 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ec29a45:::benchmark_data_smithi188_161190_object66890:head# 2024-04-01T19:57:00.317 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.317 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ec33cff:::benchmark_data_smithi188_161190_object105452:head# 2024-04-01T19:57:00.317 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.317 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ec3a042:::benchmark_data_smithi188_161190_object72478:head# 2024-04-01T19:57:00.318 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.318 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ec4871a:::benchmark_data_smithi188_161190_object78598:head# 2024-04-01T19:57:00.318 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.318 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ec4b5a9:::benchmark_data_smithi188_161190_object89982:head# 2024-04-01T19:57:00.318 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.318 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ec4e8f3:::benchmark_data_smithi188_161190_object130812:head# 2024-04-01T19:57:00.318 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.318 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ec5f575:::benchmark_data_smithi188_161190_object41314:head# 2024-04-01T19:57:00.318 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.320 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ec6d2d0:::benchmark_data_smithi188_161190_object81045:head# 2024-04-01T19:57:00.320 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.320 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ec755a3:::benchmark_data_smithi188_161190_object66837:head# 2024-04-01T19:57:00.320 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.320 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ec84df9:::benchmark_data_smithi188_161190_object59305:head# 2024-04-01T19:57:00.320 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.321 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ec882f0:::benchmark_data_smithi188_161190_object27011:head# 2024-04-01T19:57:00.321 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.321 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ec89b04:::benchmark_data_smithi188_161190_object63575:head# 2024-04-01T19:57:00.321 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.321 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ec8c0ff:::benchmark_data_smithi188_161190_object55017:head# 2024-04-01T19:57:00.321 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.321 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ec991b5:::benchmark_data_smithi188_161190_object40674:head# 2024-04-01T19:57:00.321 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.321 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ec9e873:::benchmark_data_smithi188_161190_object122801:head# 2024-04-01T19:57:00.321 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.321 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eca8ba5:::benchmark_data_smithi188_161190_object68261:head# 2024-04-01T19:57:00.321 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.324 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ecab095:::benchmark_data_smithi188_161190_object42059:head# 2024-04-01T19:57:00.324 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.324 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ecc7a87:::benchmark_data_smithi188_161190_object75308:head# 2024-04-01T19:57:00.324 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.324 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ecc94fc:::benchmark_data_smithi188_161190_object21549:head# 2024-04-01T19:57:00.324 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.324 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ecca58a:::benchmark_data_smithi188_161190_object110589:head# 2024-04-01T19:57:00.324 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.324 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eccb52c:::benchmark_data_smithi188_161190_object118578:head# 2024-04-01T19:57:00.324 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.324 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eccbf04:::benchmark_data_smithi188_161190_object114108:head# 2024-04-01T19:57:00.324 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.324 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eccf2f0:::benchmark_data_smithi188_161190_object92348:head# 2024-04-01T19:57:00.324 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.324 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ecd18ef:::benchmark_data_smithi188_161190_object103692:head# 2024-04-01T19:57:00.325 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.325 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ecd77b0:::benchmark_data_smithi188_161190_object55872:head# 2024-04-01T19:57:00.325 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.325 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ecd7e0b:::benchmark_data_smithi188_161190_object88022:head# 2024-04-01T19:57:00.325 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.325 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ece0d8f:::benchmark_data_smithi188_161190_object33672:head# 2024-04-01T19:57:00.325 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.325 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ece18a4:::benchmark_data_smithi188_161190_object66792:head# 2024-04-01T19:57:00.325 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.325 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ece4603:::benchmark_data_smithi188_161190_object42680:head# 2024-04-01T19:57:00.325 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.325 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ece483b:::benchmark_data_smithi188_161190_object65460:head# 2024-04-01T19:57:00.325 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.325 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ece9bff:::benchmark_data_smithi188_161190_object44918:head# 2024-04-01T19:57:00.325 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.327 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ececab6:::benchmark_data_smithi188_161190_object44181:head# 2024-04-01T19:57:00.327 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.327 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ecf45fb:::benchmark_data_smithi188_161190_object44750:head# 2024-04-01T19:57:00.328 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.328 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ed10520:::benchmark_data_smithi188_161190_object112031:head# 2024-04-01T19:57:00.328 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.328 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ed10807:::benchmark_data_smithi188_161190_object60036:head# 2024-04-01T19:57:00.328 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.329 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ed261ec:::benchmark_data_smithi188_161190_object47028:head# 2024-04-01T19:57:00.329 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.331 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ed263f7:::benchmark_data_smithi188_161190_object33919:head# 2024-04-01T19:57:00.331 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.331 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ed27f38:::benchmark_data_smithi188_161190_object94483:head# 2024-04-01T19:57:00.331 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.331 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ed330fb:::benchmark_data_smithi188_161190_object31158:head# 2024-04-01T19:57:00.331 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.331 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ed3a5fb:::benchmark_data_smithi188_161190_object56164:head# 2024-04-01T19:57:00.332 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.332 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ed3a69d:::benchmark_data_smithi188_161190_object59092:head# 2024-04-01T19:57:00.332 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.332 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ed4b904:::benchmark_data_smithi188_161190_object31827:head# 2024-04-01T19:57:00.332 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.333 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ed4d6ac:::benchmark_data_smithi188_161190_object67726:head# 2024-04-01T19:57:00.333 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.333 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ed5ae26:::benchmark_data_smithi188_161190_object98532:head# 2024-04-01T19:57:00.333 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.333 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ed5e867:::benchmark_data_smithi188_161190_object51270:head# 2024-04-01T19:57:00.333 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.333 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ed64d8d:::benchmark_data_smithi188_161190_object85103:head# 2024-04-01T19:57:00.334 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.334 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ed6801c:::benchmark_data_smithi188_161190_object51673:head# 2024-04-01T19:57:00.334 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.334 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ed736c3:::benchmark_data_smithi188_161190_object91189:head# 2024-04-01T19:57:00.334 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.334 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ed7c1d3:::benchmark_data_smithi188_161190_object62010:head# 2024-04-01T19:57:00.334 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.335 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ed887ae:::benchmark_data_smithi188_161190_object51108:head# 2024-04-01T19:57:00.335 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.335 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ed8d8b8:::benchmark_data_smithi188_161190_object77990:head# 2024-04-01T19:57:00.335 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.335 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9edab843:::benchmark_data_smithi188_161190_object78481:head# 2024-04-01T19:57:00.336 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.336 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9edac6b9:::benchmark_data_smithi188_161190_object103899:head# 2024-04-01T19:57:00.336 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.336 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9edb41f3:::benchmark_data_smithi188_161190_object125400:head# 2024-04-01T19:57:00.336 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.336 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9edc2bd5:::benchmark_data_smithi188_161190_object50812:head# 2024-04-01T19:57:00.336 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.336 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9edc5bef:::benchmark_data_smithi188_161190_object85215:head# 2024-04-01T19:57:00.336 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.337 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9edc9f6f:::benchmark_data_smithi188_161190_object58119:head# 2024-04-01T19:57:00.337 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.337 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9edd450f:::benchmark_data_smithi188_161190_object20190:head# 2024-04-01T19:57:00.338 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.338 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9edd64d2:::benchmark_data_smithi188_161190_object138874:head# 2024-04-01T19:57:00.338 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.338 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9edde539:::benchmark_data_smithi188_161190_object133634:head# 2024-04-01T19:57:00.338 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.338 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ede70fd:::benchmark_data_smithi188_161190_object134403:head# 2024-04-01T19:57:00.338 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.338 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ede966d:::benchmark_data_smithi188_161190_object27826:head# 2024-04-01T19:57:00.338 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.338 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9edf00cc:::benchmark_data_smithi188_161190_object38945:head# 2024-04-01T19:57:00.339 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.339 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9edf707d:::benchmark_data_smithi188_161190_object93107:head# 2024-04-01T19:57:00.339 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.340 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9edf993b:::benchmark_data_smithi188_161190_object102977:head# 2024-04-01T19:57:00.341 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.341 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ee0a20a:::benchmark_data_smithi188_161190_object89943:head# 2024-04-01T19:57:00.341 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.341 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ee10703:::benchmark_data_smithi188_161190_object126303:head# 2024-04-01T19:57:00.341 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.341 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ee1227b:::benchmark_data_smithi188_161190_object65237:head# 2024-04-01T19:57:00.341 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.341 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ee1447d:::benchmark_data_smithi188_161190_object125652:head# 2024-04-01T19:57:00.341 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.341 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ee1da8b:::benchmark_data_smithi188_161190_object86186:head# 2024-04-01T19:57:00.341 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.341 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ee1e9e6:::benchmark_data_smithi188_161190_object69031:head# 2024-04-01T19:57:00.341 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.342 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ee26ab5:::benchmark_data_smithi188_161190_object136535:head# 2024-04-01T19:57:00.342 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.342 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ee2b9e9:::benchmark_data_smithi188_161190_object108933:head# 2024-04-01T19:57:00.342 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.342 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ee2c1bd:::benchmark_data_smithi188_161190_object123235:head# 2024-04-01T19:57:00.342 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.342 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ee2efa4:::benchmark_data_smithi188_161190_object25800:head# 2024-04-01T19:57:00.342 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.342 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ee3927c:::benchmark_data_smithi188_161190_object44390:head# 2024-04-01T19:57:00.342 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ee39810:::benchmark_data_smithi188_161190_object30574:head# 2024-04-01T19:57:00.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ee3cddf:::benchmark_data_smithi188_161190_object118626:head# 2024-04-01T19:57:00.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ee6b0b3:::benchmark_data_smithi188_161190_object27070:head# 2024-04-01T19:57:00.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ee7469b:::benchmark_data_smithi188_161190_object55177:head# 2024-04-01T19:57:00.344 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.344 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ee86b8e:::benchmark_data_smithi188_161190_object36285:head# 2024-04-01T19:57:00.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ee88699:::benchmark_data_smithi188_161190_object135942:head# 2024-04-01T19:57:00.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ee97acd:::benchmark_data_smithi188_161190_object44723:head# 2024-04-01T19:57:00.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eea1296:::benchmark_data_smithi188_161190_object128267:head# 2024-04-01T19:57:00.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eeaa174:::benchmark_data_smithi188_161190_object66499:head# 2024-04-01T19:57:00.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eeb00ca:::benchmark_data_smithi188_161190_object122272:head# 2024-04-01T19:57:00.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eec1b1d:::benchmark_data_smithi188_161190_object126407:head# 2024-04-01T19:57:00.345 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.345 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eec6e07:::benchmark_data_smithi188_161190_object120699:head# 2024-04-01T19:57:00.346 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.346 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eecdc7f:::benchmark_data_smithi188_161190_object80608:head# 2024-04-01T19:57:00.346 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.348 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eeed01a:::benchmark_data_smithi188_161190_object138875:head# 2024-04-01T19:57:00.348 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.348 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eef7ba5:::benchmark_data_smithi188_161190_object67024:head# 2024-04-01T19:57:00.349 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.349 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eef83ab:::benchmark_data_smithi188_161190_object97389:head# 2024-04-01T19:57:00.349 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.349 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eef9dca:::benchmark_data_smithi188_161190_object43124:head# 2024-04-01T19:57:00.349 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.349 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef023d0:::benchmark_data_smithi188_161190_object44553:head# 2024-04-01T19:57:00.349 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.349 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef038f3:::benchmark_data_smithi188_161190_object135171:head# 2024-04-01T19:57:00.349 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.349 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef12b38:::benchmark_data_smithi188_161190_object110669:head# 2024-04-01T19:57:00.349 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.349 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef173f6:::benchmark_data_smithi188_161190_object43486:head# 2024-04-01T19:57:00.349 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.350 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef1d430:::benchmark_data_smithi188_161190_object66222:head# 2024-04-01T19:57:00.350 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.350 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef262b6:::benchmark_data_smithi188_161190_object44082:head# 2024-04-01T19:57:00.350 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.350 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef2d931:::benchmark_data_smithi188_161190_object58639:head# 2024-04-01T19:57:00.350 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.350 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef2e4b9:::benchmark_data_smithi188_161190_object38716:head# 2024-04-01T19:57:00.350 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.350 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef2f3c8:::benchmark_data_smithi188_161190_object49395:head# 2024-04-01T19:57:00.350 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.350 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef3cd03:::benchmark_data_smithi188_161190_object23087:head# 2024-04-01T19:57:00.350 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.350 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef3eadf:::benchmark_data_smithi188_161190_object53840:head# 2024-04-01T19:57:00.351 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.351 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef42368:::benchmark_data_smithi188_161190_object93978:head# 2024-04-01T19:57:00.351 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.353 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef43993:::benchmark_data_smithi188_161190_object32122:head# 2024-04-01T19:57:00.353 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.353 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef51803:::benchmark_data_smithi188_161190_object104910:head# 2024-04-01T19:57:00.353 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.353 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef5213c:::benchmark_data_smithi188_161190_object131010:head# 2024-04-01T19:57:00.353 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.353 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef54b6a:::benchmark_data_smithi188_161190_object22572:head# 2024-04-01T19:57:00.353 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.354 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef67c5a:::benchmark_data_smithi188_161190_object66055:head# 2024-04-01T19:57:00.354 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.354 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef6982c:::benchmark_data_smithi188_161190_object117973:head# 2024-04-01T19:57:00.354 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.354 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef6a035:::benchmark_data_smithi188_161190_object104947:head# 2024-04-01T19:57:00.354 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.354 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef728b6:::benchmark_data_smithi188_161190_object69877:head# 2024-04-01T19:57:00.354 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.354 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef73ecc:::benchmark_data_smithi188_161190_object118746:head# 2024-04-01T19:57:00.354 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.354 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef80bf6:::benchmark_data_smithi188_161190_object84404:head# 2024-04-01T19:57:00.355 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.355 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef82d5c:::benchmark_data_smithi188_161190_object131884:head# 2024-04-01T19:57:00.355 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.355 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef83939:::benchmark_data_smithi188_161190_object137521:head# 2024-04-01T19:57:00.355 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.355 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef8b01f:::benchmark_data_smithi188_161190_object26491:head# 2024-04-01T19:57:00.355 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.355 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef97f15:::benchmark_data_smithi188_161190_object53716:head# 2024-04-01T19:57:00.355 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.355 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ef9b1cb:::benchmark_data_smithi188_161190_object96888:head# 2024-04-01T19:57:00.355 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.356 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9efa8ce0:::benchmark_data_smithi188_161190_object138478:head# 2024-04-01T19:57:00.356 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.358 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9efa9cf5:::benchmark_data_smithi188_161190_object69448:head# 2024-04-01T19:57:00.358 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.358 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9efacbd0:::benchmark_data_smithi188_161190_object39382:head# 2024-04-01T19:57:00.358 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.358 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9efba1c6:::benchmark_data_smithi188_161190_object53070:head# 2024-04-01T19:57:00.358 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.358 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9efbae07:::benchmark_data_smithi188_161190_object41266:head# 2024-04-01T19:57:00.359 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.359 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9efbe0a3:::benchmark_data_smithi188_161190_object69040:head# 2024-04-01T19:57:00.359 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.359 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9efbfbe8:::benchmark_data_smithi188_161190_object64457:head# 2024-04-01T19:57:00.359 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.359 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9efc4c41:::benchmark_data_smithi188_161190_object103649:head# 2024-04-01T19:57:00.359 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.359 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9efd00a9:::benchmark_data_smithi188_161190_object39779:head# 2024-04-01T19:57:00.359 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.359 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9efd1e06:::benchmark_data_smithi188_161190_object93674:head# 2024-04-01T19:57:00.359 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.359 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9efda440:::benchmark_data_smithi188_161190_object125494:head# 2024-04-01T19:57:00.359 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.359 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9efe427d:::benchmark_data_smithi188_161190_object137341:head# 2024-04-01T19:57:00.359 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.359 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9efef8c0:::benchmark_data_smithi188_161190_object103062:head# 2024-04-01T19:57:00.360 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.360 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eff0993:::benchmark_data_smithi188_161190_object131679:head# 2024-04-01T19:57:00.360 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.360 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eff5771:::benchmark_data_smithi188_161190_object33548:head# 2024-04-01T19:57:00.360 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.360 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9eff87d8:::benchmark_data_smithi188_161190_object95720:head# 2024-04-01T19:57:00.360 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.360 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9effae74:::benchmark_data_smithi188_161190_object68882:head# 2024-04-01T19:57:00.360 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.363 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9effe847:::benchmark_data_smithi188_161190_object78843:head# 2024-04-01T19:57:00.363 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.363 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f008bfb:::benchmark_data_smithi188_161190_object29753:head# 2024-04-01T19:57:00.363 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.364 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f00e4ab:::benchmark_data_smithi188_161190_object94289:head# 2024-04-01T19:57:00.364 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.365 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f012362:::benchmark_data_smithi188_161190_object67210:head# 2024-04-01T19:57:00.365 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.365 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f018365:::benchmark_data_smithi188_161190_object125462:head# 2024-04-01T19:57:00.365 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.365 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f023337:::benchmark_data_smithi188_161190_object69755:head# 2024-04-01T19:57:00.365 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.366 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f029c23:::benchmark_data_smithi188_161190_object25794:head# 2024-04-01T19:57:00.366 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.368 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f02be00:::benchmark_data_smithi188_161190_object97057:head# 2024-04-01T19:57:00.368 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.375 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f0378bd:::benchmark_data_smithi188_161190_object102889:head# 2024-04-01T19:57:00.375 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.377 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f03cfe9:::benchmark_data_smithi188_161190_object20012:head# 2024-04-01T19:57:00.377 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.381 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f03d168:::benchmark_data_smithi188_161190_object20532:head# 2024-04-01T19:57:00.381 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.381 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f041365:::benchmark_data_smithi188_161190_object105246:head# 2024-04-01T19:57:00.381 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.381 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f055139:::benchmark_data_smithi188_161190_object96585:head# 2024-04-01T19:57:00.381 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.386 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f0562bc:::benchmark_data_smithi188_161190_object22208:head# 2024-04-01T19:57:00.387 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.393 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f05f2fc:::benchmark_data_smithi188_161190_object46335:head# 2024-04-01T19:57:00.393 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.393 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f06048b:::benchmark_data_smithi188_161190_object115033:head# 2024-04-01T19:57:00.393 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.394 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f062ec5:::benchmark_data_smithi188_161190_object27936:head# 2024-04-01T19:57:00.394 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.394 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f0803ec:::benchmark_data_smithi188_161190_object119044:head# 2024-04-01T19:57:00.394 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.394 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f08ba11:::benchmark_data_smithi188_161190_object132517:head# 2024-04-01T19:57:00.394 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.395 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f0a26e7:::benchmark_data_smithi188_161190_object85305:head# 2024-04-01T19:57:00.396 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.396 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f0a9d31:::benchmark_data_smithi188_161190_object92986:head# 2024-04-01T19:57:00.396 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.396 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f0afb1c:::benchmark_data_smithi188_161190_object125081:head# 2024-04-01T19:57:00.396 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.396 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f0b8b7c:::benchmark_data_smithi188_161190_object98387:head# 2024-04-01T19:57:00.396 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.397 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f0ba54d:::benchmark_data_smithi188_161190_object135101:head# 2024-04-01T19:57:00.397 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.397 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f0c81bd:::benchmark_data_smithi188_161190_object46481:head# 2024-04-01T19:57:00.397 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.397 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f0ce30f:::benchmark_data_smithi188_161190_object32994:head# 2024-04-01T19:57:00.397 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.397 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f0d2f67:::benchmark_data_smithi188_161190_object35282:head# 2024-04-01T19:57:00.397 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.397 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f0d6be4:::benchmark_data_smithi188_161190_object120175:head# 2024-04-01T19:57:00.397 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.398 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f0d7d8d:::benchmark_data_smithi188_161190_object87940:head# 2024-04-01T19:57:00.398 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.398 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f0dd331:::benchmark_data_smithi188_161190_object41077:head# 2024-04-01T19:57:00.399 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.399 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f0ea70b:::benchmark_data_smithi188_161190_object94099:head# 2024-04-01T19:57:00.399 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.399 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f0f96be:::benchmark_data_smithi188_161190_object26459:head# 2024-04-01T19:57:00.399 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.399 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f0ffc55:::benchmark_data_smithi188_161190_object37444:head# 2024-04-01T19:57:00.399 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.399 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f113bcb:::benchmark_data_smithi188_161190_object104400:head# 2024-04-01T19:57:00.399 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.399 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f11a8a5:::benchmark_data_smithi188_161190_object109148:head# 2024-04-01T19:57:00.399 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.400 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f11cae3:::benchmark_data_smithi188_161190_object51247:head# 2024-04-01T19:57:00.400 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.400 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f1221e8:::benchmark_data_smithi188_161190_object108695:head# 2024-04-01T19:57:00.400 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.400 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f12288a:::benchmark_data_smithi188_161190_object52717:head# 2024-04-01T19:57:00.400 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.401 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f128b36:::benchmark_data_smithi188_161190_object57258:head# 2024-04-01T19:57:00.401 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.402 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f129c26:::benchmark_data_smithi188_161190_object75619:head# 2024-04-01T19:57:00.402 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.402 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f13b81f:::benchmark_data_smithi188_161190_object132460:head# 2024-04-01T19:57:00.402 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.402 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f1418c0:::benchmark_data_smithi188_161190_object45632:head# 2024-04-01T19:57:00.403 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.403 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f14448f:::benchmark_data_smithi188_161190_object137743:head# 2024-04-01T19:57:00.403 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.403 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f1453d8:::benchmark_data_smithi188_161190_object97731:head# 2024-04-01T19:57:00.403 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.403 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f15936c:::benchmark_data_smithi188_161190_object57180:head# 2024-04-01T19:57:00.403 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.403 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f16dd3f:::benchmark_data_smithi188_161190_object22050:head# 2024-04-01T19:57:00.403 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.403 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f17828c:::benchmark_data_smithi188_161190_object109895:head# 2024-04-01T19:57:00.403 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.404 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f178d79:::benchmark_data_smithi188_161190_object27649:head# 2024-04-01T19:57:00.404 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.404 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f1812ee:::benchmark_data_smithi188_161190_object50953:head# 2024-04-01T19:57:00.404 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.404 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f18317c:::benchmark_data_smithi188_161190_object107211:head# 2024-04-01T19:57:00.405 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.405 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f1874a4:::benchmark_data_smithi188_161190_object127606:head# 2024-04-01T19:57:00.405 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.410 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f18785e:::benchmark_data_smithi188_161190_object62726:head# 2024-04-01T19:57:00.410 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.410 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f19c914:::benchmark_data_smithi188_161190_object84152:head# 2024-04-01T19:57:00.410 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.410 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f1a7227:::benchmark_data_smithi188_161190_object58602:head# 2024-04-01T19:57:00.410 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.411 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f1a91ed:::benchmark_data_smithi188_161190_object133489:head# 2024-04-01T19:57:00.411 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.411 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f1ad839:::benchmark_data_smithi188_161190_object75796:head# 2024-04-01T19:57:00.411 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.411 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f1b9210:::benchmark_data_smithi188_161190_object120507:head# 2024-04-01T19:57:00.411 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.412 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f1c94a3:::benchmark_data_smithi188_161190_object108114:head# 2024-04-01T19:57:00.412 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.412 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f1cc129:::benchmark_data_smithi188_161190_object116082:head# 2024-04-01T19:57:00.412 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.412 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f1d062f:::benchmark_data_smithi188_161190_object29349:head# 2024-04-01T19:57:00.412 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.413 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f1d12e3:::benchmark_data_smithi188_161190_object43828:head# 2024-04-01T19:57:00.413 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.413 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f1f0571:::benchmark_data_smithi188_161190_object110847:head# 2024-04-01T19:57:00.413 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.413 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f1f0822:::benchmark_data_smithi188_161190_object129384:head# 2024-04-01T19:57:00.414 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.415 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f1f6a6a:::benchmark_data_smithi188_161190_object25726:head# 2024-04-01T19:57:00.415 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.415 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f1fc0ba:::benchmark_data_smithi188_161190_object109215:head# 2024-04-01T19:57:00.415 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.415 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f1fe3eb:::benchmark_data_smithi188_161190_object40115:head# 2024-04-01T19:57:00.415 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.416 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f1fed63:::benchmark_data_smithi188_161190_object41540:head# 2024-04-01T19:57:00.416 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.416 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f205a2c:::benchmark_data_smithi188_161190_object50385:head# 2024-04-01T19:57:00.416 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.416 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f214304:::benchmark_data_smithi188_161190_object24137:head# 2024-04-01T19:57:00.416 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.416 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f215b8f:::benchmark_data_smithi188_161190_object57040:head# 2024-04-01T19:57:00.416 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.416 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f21a6f4:::benchmark_data_smithi188_161190_object29532:head# 2024-04-01T19:57:00.416 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.416 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f21c327:::benchmark_data_smithi188_161190_object58294:head# 2024-04-01T19:57:00.416 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.416 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f21e305:::benchmark_data_smithi188_161190_object85453:head# 2024-04-01T19:57:00.417 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.417 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f21f19d:::benchmark_data_smithi188_161190_object30981:head# 2024-04-01T19:57:00.417 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.419 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f2225cd:::benchmark_data_smithi188_161190_object61058:head# 2024-04-01T19:57:00.419 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.419 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f225c8c:::benchmark_data_smithi188_161190_object28679:head# 2024-04-01T19:57:00.419 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.420 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f22ac84:::benchmark_data_smithi188_161190_object113909:head# 2024-04-01T19:57:00.420 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.420 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f230655:::benchmark_data_smithi188_161190_object84620:head# 2024-04-01T19:57:00.420 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.420 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f238fa8:::benchmark_data_smithi188_161190_object127069:head# 2024-04-01T19:57:00.420 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.420 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f2440a4:::benchmark_data_smithi188_161190_object22268:head# 2024-04-01T19:57:00.420 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.420 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f244460:::benchmark_data_smithi188_161190_object54027:head# 2024-04-01T19:57:00.420 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.420 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f254067:::benchmark_data_smithi188_161190_object33051:head# 2024-04-01T19:57:00.421 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.421 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f255f88:::benchmark_data_smithi188_161190_object86492:head# 2024-04-01T19:57:00.421 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.421 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f289ae0:::benchmark_data_smithi188_161190_object134648:head# 2024-04-01T19:57:00.421 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.421 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f29c587:::benchmark_data_smithi188_161190_object36523:head# 2024-04-01T19:57:00.421 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.421 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f2a4ef3:::benchmark_data_smithi188_161190_object91895:head# 2024-04-01T19:57:00.421 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.421 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f2ac39f:::benchmark_data_smithi188_161190_object90892:head# 2024-04-01T19:57:00.421 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.421 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f2b1e36:::benchmark_data_smithi188_161190_object118617:head# 2024-04-01T19:57:00.421 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.421 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f2bb4c2:::benchmark_data_smithi188_161190_object56974:head# 2024-04-01T19:57:00.422 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.424 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f2c4ba8:::benchmark_data_smithi188_161190_object72383:head# 2024-04-01T19:57:00.425 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.425 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f2d2c08:::benchmark_data_smithi188_161190_object47667:head# 2024-04-01T19:57:00.425 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.425 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f2da263:::benchmark_data_smithi188_161190_object49865:head# 2024-04-01T19:57:00.425 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.425 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f2ec917:::benchmark_data_smithi188_161190_object72054:head# 2024-04-01T19:57:00.425 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.425 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f2fd5e2:::benchmark_data_smithi188_161190_object35054:head# 2024-04-01T19:57:00.425 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.426 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f306ee9:::benchmark_data_smithi188_161190_object54575:head# 2024-04-01T19:57:00.426 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.426 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f30cb29:::benchmark_data_smithi188_161190_object56932:head# 2024-04-01T19:57:00.426 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.426 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f31574b:::benchmark_data_smithi188_161190_object74610:head# 2024-04-01T19:57:00.426 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.426 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f3188ae:::benchmark_data_smithi188_161190_object30864:head# 2024-04-01T19:57:00.427 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.427 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f31bca6:::benchmark_data_smithi188_161190_object89688:head# 2024-04-01T19:57:00.427 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.427 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f31f85d:::benchmark_data_smithi188_161190_object132765:head# 2024-04-01T19:57:00.427 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.427 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f32435a:::benchmark_data_smithi188_161190_object31468:head# 2024-04-01T19:57:00.427 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.427 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f33800d:::benchmark_data_smithi188_161190_object70367:head# 2024-04-01T19:57:00.427 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.427 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f33e8be:::benchmark_data_smithi188_161190_object134198:head# 2024-04-01T19:57:00.427 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.427 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f340dd4:::benchmark_data_smithi188_161190_object119140:head# 2024-04-01T19:57:00.428 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.428 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f3467c1:::benchmark_data_smithi188_161190_object38758:head# 2024-04-01T19:57:00.428 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.428 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f34bbc1:::benchmark_data_smithi188_161190_object124262:head# 2024-04-01T19:57:00.428 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.428 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f34c090:::benchmark_data_smithi188_161190_object85830:head# 2024-04-01T19:57:00.428 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.429 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f34cee6:::benchmark_data_smithi188_161190_object126092:head# 2024-04-01T19:57:00.429 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.429 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f34e6eb:::benchmark_data_smithi188_161190_object38402:head# 2024-04-01T19:57:00.429 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.429 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f36d2bc:::benchmark_data_smithi188_161190_object37911:head# 2024-04-01T19:57:00.430 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.430 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f3712af:::benchmark_data_smithi188_161190_object78055:head# 2024-04-01T19:57:00.430 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.430 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f37162b:::benchmark_data_smithi188_161190_object111495:head# 2024-04-01T19:57:00.430 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.430 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f375806:::benchmark_data_smithi188_161190_object76250:head# 2024-04-01T19:57:00.430 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.430 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f379951:::benchmark_data_smithi188_161190_object73605:head# 2024-04-01T19:57:00.430 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.430 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f37b040:::benchmark_data_smithi188_161190_object68342:head# 2024-04-01T19:57:00.430 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.430 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f37dab0:::benchmark_data_smithi188_161190_object23647:head# 2024-04-01T19:57:00.431 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.431 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f385b23:::benchmark_data_smithi188_161190_object115824:head# 2024-04-01T19:57:00.431 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.431 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f388cc8:::benchmark_data_smithi188_161190_object126906:head# 2024-04-01T19:57:00.431 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.431 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f3914cf:::benchmark_data_smithi188_161190_object46960:head# 2024-04-01T19:57:00.431 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.431 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f396114:::benchmark_data_smithi188_161190_object22471:head# 2024-04-01T19:57:00.431 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.431 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f399d27:::benchmark_data_smithi188_161190_object70080:head# 2024-04-01T19:57:00.431 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.431 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f3a14d7:::benchmark_data_smithi188_161190_object97583:head# 2024-04-01T19:57:00.432 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.432 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f3a6a70:::benchmark_data_smithi188_161190_object105730:head# 2024-04-01T19:57:00.432 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.432 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f3ae0b5:::benchmark_data_smithi188_161190_object106790:head# 2024-04-01T19:57:00.432 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.432 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f3af50f:::benchmark_data_smithi188_161190_object38679:head# 2024-04-01T19:57:00.432 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.432 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f3bbc87:::benchmark_data_smithi188_161190_object124941:head# 2024-04-01T19:57:00.432 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.437 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f3bd0be:::benchmark_data_smithi188_161190_object73340:head# 2024-04-01T19:57:00.438 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.438 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f3c0b04:::benchmark_data_smithi188_161190_object66168:head# 2024-04-01T19:57:00.438 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.438 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f3c1388:::benchmark_data_smithi188_161190_object107798:head# 2024-04-01T19:57:00.438 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.438 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f3c14fb:::benchmark_data_smithi188_161190_object93645:head# 2024-04-01T19:57:00.438 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.438 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f3c40e8:::benchmark_data_smithi188_161190_object52587:head# 2024-04-01T19:57:00.438 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.438 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f3c62f6:::benchmark_data_smithi188_161190_object49627:head# 2024-04-01T19:57:00.439 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.439 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f3cb682:::benchmark_data_smithi188_161190_object134830:head# 2024-04-01T19:57:00.439 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.439 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f3da132:::benchmark_data_smithi188_161190_object68617:head# 2024-04-01T19:57:00.439 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.439 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f3da2f7:::benchmark_data_smithi188_161190_object116066:head# 2024-04-01T19:57:00.439 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.439 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f3dc45a:::benchmark_data_smithi188_161190_object122326:head# 2024-04-01T19:57:00.439 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.439 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f3eae1b:::benchmark_data_smithi188_161190_object48590:head# 2024-04-01T19:57:00.439 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.439 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f3efe11:::benchmark_data_smithi188_161190_object54065:head# 2024-04-01T19:57:00.439 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.439 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f3f727a:::benchmark_data_smithi188_161190_object61602:head# 2024-04-01T19:57:00.440 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.440 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f3f8bba:::benchmark_data_smithi188_161190_object116457:head# 2024-04-01T19:57:00.440 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.440 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f4193d1:::benchmark_data_smithi188_161190_object33429:head# 2024-04-01T19:57:00.440 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.440 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f41c9b8:::benchmark_data_smithi188_161190_object111137:head# 2024-04-01T19:57:00.440 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.440 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f42316e:::benchmark_data_smithi188_161190_object99592:head# 2024-04-01T19:57:00.440 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.440 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f424a70:::benchmark_data_smithi188_161190_object109569:head# 2024-04-01T19:57:00.440 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.440 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f42ed5d:::benchmark_data_smithi188_161190_object104134:head# 2024-04-01T19:57:00.440 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.440 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f435419:::benchmark_data_smithi188_161190_object36679:head# 2024-04-01T19:57:00.441 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.441 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f437af7:::benchmark_data_smithi188_161190_object55440:head# 2024-04-01T19:57:00.441 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.441 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f43f6e3:::benchmark_data_smithi188_161190_object69303:head# 2024-04-01T19:57:00.441 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.441 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f44a613:::benchmark_data_smithi188_161190_object96337:head# 2024-04-01T19:57:00.441 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.441 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f44adcf:::benchmark_data_smithi188_161190_object120243:head# 2024-04-01T19:57:00.441 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.441 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f44c2e2:::benchmark_data_smithi188_161190_object44060:head# 2024-04-01T19:57:00.441 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.441 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f44c2ec:::benchmark_data_smithi188_161190_object84441:head# 2024-04-01T19:57:00.441 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.441 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f44cf3c:::benchmark_data_smithi188_161190_object123708:head# 2024-04-01T19:57:00.441 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.442 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f44dbec:::benchmark_data_smithi188_161190_object124291:head# 2024-04-01T19:57:00.442 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.442 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f455d47:::benchmark_data_smithi188_161190_object134891:head# 2024-04-01T19:57:00.442 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.442 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f457dd6:::benchmark_data_smithi188_161190_object40471:head# 2024-04-01T19:57:00.442 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.442 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f45d9e1:::benchmark_data_smithi188_161190_object91260:head# 2024-04-01T19:57:00.442 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.442 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f460911:::benchmark_data_smithi188_161190_object34360:head# 2024-04-01T19:57:00.442 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.445 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f460fcf:::benchmark_data_smithi188_161190_object94894:head# 2024-04-01T19:57:00.445 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.445 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f47d0b7:::benchmark_data_smithi188_161190_object56462:head# 2024-04-01T19:57:00.445 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.445 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f47e257:::benchmark_data_smithi188_161190_object41158:head# 2024-04-01T19:57:00.445 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.445 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f498768:::benchmark_data_smithi188_161190_object123958:head# 2024-04-01T19:57:00.445 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.446 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f4aafb9:::benchmark_data_smithi188_161190_object125289:head# 2024-04-01T19:57:00.446 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.446 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f4b7c72:::benchmark_data_smithi188_161190_object90650:head# 2024-04-01T19:57:00.446 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.446 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f4c999d:::benchmark_data_smithi188_161190_object23602:head# 2024-04-01T19:57:00.446 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.446 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f4c9f4b:::benchmark_data_smithi188_161190_object131903:head# 2024-04-01T19:57:00.446 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.446 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f4cb22b:::benchmark_data_smithi188_161190_object46221:head# 2024-04-01T19:57:00.446 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.446 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f4d2f4b:::benchmark_data_smithi188_161190_object102369:head# 2024-04-01T19:57:00.446 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.446 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f4d45fb:::benchmark_data_smithi188_161190_object80525:head# 2024-04-01T19:57:00.446 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.447 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f4d611c:::benchmark_data_smithi188_161190_object26040:head# 2024-04-01T19:57:00.447 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.447 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f4dde7e:::benchmark_data_smithi188_161190_object39120:head# 2024-04-01T19:57:00.447 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.447 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f502d6c:::benchmark_data_smithi188_161190_object71264:head# 2024-04-01T19:57:00.447 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.447 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f507164:::benchmark_data_smithi188_161190_object106657:head# 2024-04-01T19:57:00.447 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.447 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f50868d:::benchmark_data_smithi188_161190_object135582:head# 2024-04-01T19:57:00.447 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.447 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f513958:::benchmark_data_smithi188_161190_object127940:head# 2024-04-01T19:57:00.447 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.447 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f51b6c5:::benchmark_data_smithi188_161190_object26702:head# 2024-04-01T19:57:00.448 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.448 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f51e43f:::benchmark_data_smithi188_161190_object52568:head# 2024-04-01T19:57:00.448 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.448 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f527fff:::benchmark_data_smithi188_161190_object70370:head# 2024-04-01T19:57:00.448 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.448 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f52c9d5:::benchmark_data_smithi188_161190_object120408:head# 2024-04-01T19:57:00.448 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.448 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f53cf34:::benchmark_data_smithi188_161190_object98824:head# 2024-04-01T19:57:00.448 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.449 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f54cbf9:::benchmark_data_smithi188_161190_object119858:head# 2024-04-01T19:57:00.449 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.449 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f55040a:::benchmark_data_smithi188_161190_object84771:head# 2024-04-01T19:57:00.449 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.449 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f5657c9:::benchmark_data_smithi188_161190_object123169:head# 2024-04-01T19:57:00.449 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.449 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f5680e0:::benchmark_data_smithi188_161190_object82058:head# 2024-04-01T19:57:00.450 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.450 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f56f22a:::benchmark_data_smithi188_161190_object131772:head# 2024-04-01T19:57:00.450 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.450 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f56f53a:::benchmark_data_smithi188_161190_object101856:head# 2024-04-01T19:57:00.450 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.450 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f573716:::benchmark_data_smithi188_161190_object122935:head# 2024-04-01T19:57:00.450 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.450 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f576252:::benchmark_data_smithi188_161190_object93462:head# 2024-04-01T19:57:00.450 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.450 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f586d9d:::benchmark_data_smithi188_161190_object109725:head# 2024-04-01T19:57:00.450 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.450 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f58941e:::benchmark_data_smithi188_161190_object111514:head# 2024-04-01T19:57:00.450 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.451 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f591723:::benchmark_data_smithi188_161190_object31071:head# 2024-04-01T19:57:00.451 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.451 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f59ba91:::benchmark_data_smithi188_161190_object136273:head# 2024-04-01T19:57:00.451 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.451 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f59ebf8:::benchmark_data_smithi188_161190_object75876:head# 2024-04-01T19:57:00.451 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.451 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f5ab3a1:::benchmark_data_smithi188_161190_object37242:head# 2024-04-01T19:57:00.451 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.451 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f5ac026:::benchmark_data_smithi188_161190_object113385:head# 2024-04-01T19:57:00.451 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.451 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f5b4cfb:::benchmark_data_smithi188_161190_object99649:head# 2024-04-01T19:57:00.451 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.451 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f5c709d:::benchmark_data_smithi188_161190_object107535:head# 2024-04-01T19:57:00.451 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.452 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:57:00.456 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:00.456 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:57:00.457 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f5d1755:::benchmark_data_smithi188_161190_object34151:head# 2024-04-01T19:57:00.457 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.457 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f5dbdd3:::benchmark_data_smithi188_161190_object86148:head# 2024-04-01T19:57:00.458 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.458 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f5dda8f:::benchmark_data_smithi188_161190_object20155:head# 2024-04-01T19:57:00.458 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.458 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f5e5b3d:::benchmark_data_smithi188_161190_object118498:head# 2024-04-01T19:57:00.458 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.460 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f5ea33c:::benchmark_data_smithi188_161190_object97505:head# 2024-04-01T19:57:00.460 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.460 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f5f2a7b:::benchmark_data_smithi188_161190_object120456:head# 2024-04-01T19:57:00.460 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.460 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f5f8a43:::benchmark_data_smithi188_161190_object123472:head# 2024-04-01T19:57:00.460 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.460 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f60f5a6:::benchmark_data_smithi188_161190_object91343:head# 2024-04-01T19:57:00.460 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.460 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f62731d:::benchmark_data_smithi188_161190_object74499:head# 2024-04-01T19:57:00.460 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.461 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f630e93:::benchmark_data_smithi188_161190_object61189:head# 2024-04-01T19:57:00.461 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.461 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f635a38:::benchmark_data_smithi188_161190_object45162:head# 2024-04-01T19:57:00.461 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.461 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f6415e2:::benchmark_data_smithi188_161190_object54842:head# 2024-04-01T19:57:00.461 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.461 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f64382c:::benchmark_data_smithi188_161190_object31279:head# 2024-04-01T19:57:00.461 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.462 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f647614:::benchmark_data_smithi188_161190_object27391:head# 2024-04-01T19:57:00.462 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.462 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f64c8c5:::benchmark_data_smithi188_161190_object86523:head# 2024-04-01T19:57:00.462 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.463 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f650253:::benchmark_data_smithi188_161190_object82214:head# 2024-04-01T19:57:00.463 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.463 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f659be2:::benchmark_data_smithi188_161190_object71063:head# 2024-04-01T19:57:00.463 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.463 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f65a2a4:::benchmark_data_smithi188_161190_object129137:head# 2024-04-01T19:57:00.463 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.463 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f65a8b5:::benchmark_data_smithi188_161190_object25202:head# 2024-04-01T19:57:00.463 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.463 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f67b505:::benchmark_data_smithi188_161190_object110836:head# 2024-04-01T19:57:00.463 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.463 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f67d520:::benchmark_data_smithi188_161190_object116571:head# 2024-04-01T19:57:00.463 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.463 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f683d95:::benchmark_data_smithi188_161190_object69347:head# 2024-04-01T19:57:00.464 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.465 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f6847d3:::benchmark_data_smithi188_161190_object29660:head# 2024-04-01T19:57:00.465 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.465 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f692e8f:::benchmark_data_smithi188_161190_object28663:head# 2024-04-01T19:57:00.465 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.466 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f69445d:::benchmark_data_smithi188_161190_object91623:head# 2024-04-01T19:57:00.466 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.466 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f6aa1ad:::benchmark_data_smithi188_161190_object127857:head# 2024-04-01T19:57:00.466 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.466 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f6ab242:::benchmark_data_smithi188_161190_object50819:head# 2024-04-01T19:57:00.466 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.466 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f6c35c0:::benchmark_data_smithi188_161190_object79263:head# 2024-04-01T19:57:00.466 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.466 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f6cbc72:::benchmark_data_smithi188_161190_object49019:head# 2024-04-01T19:57:00.466 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.466 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f6d0536:::benchmark_data_smithi188_161190_object112605:head# 2024-04-01T19:57:00.466 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.466 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f6dd508:::benchmark_data_smithi188_161190_object87814:head# 2024-04-01T19:57:00.466 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.467 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f6df79e:::benchmark_data_smithi188_161190_object39827:head# 2024-04-01T19:57:00.467 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.467 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f6e3db1:::benchmark_data_smithi188_161190_object29759:head# 2024-04-01T19:57:00.467 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.467 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f6f9795:::benchmark_data_smithi188_161190_object121368:head# 2024-04-01T19:57:00.467 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.470 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f6fc4a8:::benchmark_data_smithi188_161190_object37807:head# 2024-04-01T19:57:00.470 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.470 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f7044d0:::benchmark_data_smithi188_161190_object23155:head# 2024-04-01T19:57:00.470 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.470 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f7089fc:::benchmark_data_smithi188_161190_object128995:head# 2024-04-01T19:57:00.470 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.471 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f726327:::benchmark_data_smithi188_161190_object66040:head# 2024-04-01T19:57:00.471 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.471 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f7344fc:::benchmark_data_smithi188_161190_object59105:head# 2024-04-01T19:57:00.471 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.471 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f7348b1:::benchmark_data_smithi188_161190_object60840:head# 2024-04-01T19:57:00.471 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.471 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f735298:::benchmark_data_smithi188_161190_object70013:head# 2024-04-01T19:57:00.471 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.471 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f73eb38:::benchmark_data_smithi188_161190_object65075:head# 2024-04-01T19:57:00.471 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.471 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f746053:::benchmark_data_smithi188_161190_object93041:head# 2024-04-01T19:57:00.471 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.471 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f752729:::benchmark_data_smithi188_161190_object77558:head# 2024-04-01T19:57:00.472 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.472 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f75c310:::benchmark_data_smithi188_161190_object52421:head# 2024-04-01T19:57:00.472 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.472 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f775bf6:::benchmark_data_smithi188_161190_object84362:head# 2024-04-01T19:57:00.472 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.472 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f778f8c:::benchmark_data_smithi188_161190_object97547:head# 2024-04-01T19:57:00.472 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.472 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f77d432:::benchmark_data_smithi188_161190_object64817:head# 2024-04-01T19:57:00.473 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.473 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f77f4b6:::benchmark_data_smithi188_161190_object119013:head# 2024-04-01T19:57:00.473 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.473 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f783c42:::benchmark_data_smithi188_161190_object92689:head# 2024-04-01T19:57:00.473 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.473 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f78bab6:::benchmark_data_smithi188_161190_object95451:head# 2024-04-01T19:57:00.473 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.473 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f79ac86:::benchmark_data_smithi188_161190_object50057:head# 2024-04-01T19:57:00.473 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.476 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f7a252d:::benchmark_data_smithi188_161190_object86834:head# 2024-04-01T19:57:00.476 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.476 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f7a88e5:::benchmark_data_smithi188_161190_object69392:head# 2024-04-01T19:57:00.476 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.476 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f7b349c:::benchmark_data_smithi188_161190_object106660:head# 2024-04-01T19:57:00.476 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.476 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f7be2a9:::benchmark_data_smithi188_161190_object39073:head# 2024-04-01T19:57:00.476 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.476 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f7efd27:::benchmark_data_smithi188_161190_object73671:head# 2024-04-01T19:57:00.476 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f82abd9:::benchmark_data_smithi188_161190_object139042:head# 2024-04-01T19:57:00.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f830a11:::benchmark_data_smithi188_161190_object29590:head# 2024-04-01T19:57:00.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f83c25f:::benchmark_data_smithi188_161190_object66741:head# 2024-04-01T19:57:00.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f844c71:::benchmark_data_smithi188_161190_object27222:head# 2024-04-01T19:57:00.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f84f824:::benchmark_data_smithi188_161190_object131947:head# 2024-04-01T19:57:00.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f8574ae:::benchmark_data_smithi188_161190_object77180:head# 2024-04-01T19:57:00.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f867b38:::benchmark_data_smithi188_161190_object31664:head# 2024-04-01T19:57:00.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.477 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f8778eb:::benchmark_data_smithi188_161190_object109351:head# 2024-04-01T19:57:00.477 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.478 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f880703:::benchmark_data_smithi188_161190_object29595:head# 2024-04-01T19:57:00.478 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.478 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f886466:::benchmark_data_smithi188_161190_object102152:head# 2024-04-01T19:57:00.478 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.478 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f88ba6e:::benchmark_data_smithi188_161190_object70182:head# 2024-04-01T19:57:00.478 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.479 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f88c91f:::benchmark_data_smithi188_161190_object23946:head# 2024-04-01T19:57:00.480 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.480 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f8a1aeb:::benchmark_data_smithi188_161190_object114726:head# 2024-04-01T19:57:00.480 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.480 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f8a21f0:::benchmark_data_smithi188_161190_object37861:head# 2024-04-01T19:57:00.480 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.480 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f8aa309:::benchmark_data_smithi188_161190_object44000:head# 2024-04-01T19:57:00.480 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.480 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f8ad3c9:::benchmark_data_smithi188_161190_object133330:head# 2024-04-01T19:57:00.480 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.480 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f8b73e8:::benchmark_data_smithi188_161190_object55347:head# 2024-04-01T19:57:00.480 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.480 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f8c4300:::benchmark_data_smithi188_161190_object127987:head# 2024-04-01T19:57:00.480 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.480 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f8c4fa6:::benchmark_data_smithi188_161190_object114470:head# 2024-04-01T19:57:00.481 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.481 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f8e7fd2:::benchmark_data_smithi188_161190_object114251:head# 2024-04-01T19:57:00.481 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.481 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f8f7ba3:::benchmark_data_smithi188_161190_object67179:head# 2024-04-01T19:57:00.481 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.482 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f8fcf04:::benchmark_data_smithi188_161190_object55955:head# 2024-04-01T19:57:00.482 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.482 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f90375a:::benchmark_data_smithi188_161190_object64416:head# 2024-04-01T19:57:00.482 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.484 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f90cd58:::benchmark_data_smithi188_161190_object125066:head# 2024-04-01T19:57:00.484 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.487 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f911614:::benchmark_data_smithi188_161190_object48344:head# 2024-04-01T19:57:00.487 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.488 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f91a15a:::benchmark_data_smithi188_161190_object94559:head# 2024-04-01T19:57:00.488 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.488 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f91cfd1:::benchmark_data_smithi188_161190_object30458:head# 2024-04-01T19:57:00.488 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.488 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f920113:::benchmark_data_smithi188_161190_object122898:head# 2024-04-01T19:57:00.489 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f934336:::benchmark_data_smithi188_161190_object105802:head# 2024-04-01T19:57:00.491 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f93645a:::benchmark_data_smithi188_161190_object51832:head# 2024-04-01T19:57:00.491 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f93f4f4:::benchmark_data_smithi188_161190_object98248:head# 2024-04-01T19:57:00.491 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f94a9bd:::benchmark_data_smithi188_161190_object107998:head# 2024-04-01T19:57:00.491 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f94af38:::benchmark_data_smithi188_161190_object112551:head# 2024-04-01T19:57:00.491 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.491 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f9556f9:::benchmark_data_smithi188_161190_object139201:head# 2024-04-01T19:57:00.491 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.492 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f95e12e:::benchmark_data_smithi188_161190_object81298:head# 2024-04-01T19:57:00.492 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.492 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f961f80:::benchmark_data_smithi188_161190_object127038:head# 2024-04-01T19:57:00.492 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.492 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f9699e4:::benchmark_data_smithi188_161190_object42429:head# 2024-04-01T19:57:00.492 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.493 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f976dba:::benchmark_data_smithi188_161190_object61978:head# 2024-04-01T19:57:00.493 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.493 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f9871a1:::benchmark_data_smithi188_161190_object34386:head# 2024-04-01T19:57:00.493 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.494 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f99077f:::benchmark_data_smithi188_161190_object116114:head# 2024-04-01T19:57:00.494 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.494 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f992f0f:::benchmark_data_smithi188_161190_object96693:head# 2024-04-01T19:57:00.494 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.497 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f9987ca:::benchmark_data_smithi188_161190_object23077:head# 2024-04-01T19:57:00.497 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.497 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f998d69:::benchmark_data_smithi188_161190_object102288:head# 2024-04-01T19:57:00.497 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.498 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f9a2a1b:::benchmark_data_smithi188_161190_object37615:head# 2024-04-01T19:57:00.498 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.498 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f9af3d7:::benchmark_data_smithi188_161190_object59154:head# 2024-04-01T19:57:00.498 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.498 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f9b2226:::benchmark_data_smithi188_161190_object87536:head# 2024-04-01T19:57:00.498 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.498 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f9d4689:::benchmark_data_smithi188_161190_object121255:head# 2024-04-01T19:57:00.498 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.498 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f9e894c:::benchmark_data_smithi188_161190_object86880:head# 2024-04-01T19:57:00.498 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.498 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f9f0b99:::benchmark_data_smithi188_161190_object26509:head# 2024-04-01T19:57:00.498 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.498 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f9f12d4:::benchmark_data_smithi188_161190_object61536:head# 2024-04-01T19:57:00.499 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.499 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f9f378c:::benchmark_data_smithi188_161190_object138876:head# 2024-04-01T19:57:00.499 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.499 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f9fb8d8:::benchmark_data_smithi188_161190_object62945:head# 2024-04-01T19:57:00.499 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.499 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9f9fc106:::benchmark_data_smithi188_161190_object33206:head# 2024-04-01T19:57:00.499 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.499 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fa0acf2:::benchmark_data_smithi188_161190_object99496:head# 2024-04-01T19:57:00.499 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.499 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fa102a7:::benchmark_data_smithi188_161190_object86935:head# 2024-04-01T19:57:00.499 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.500 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fa10d89:::benchmark_data_smithi188_161190_object38435:head# 2024-04-01T19:57:00.500 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.500 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fa207f4:::benchmark_data_smithi188_161190_object47066:head# 2024-04-01T19:57:00.500 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.505 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fa28014:::benchmark_data_smithi188_161190_object33878:head# 2024-04-01T19:57:00.505 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.506 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fa322d1:::benchmark_data_smithi188_161190_object119826:head# 2024-04-01T19:57:00.506 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.506 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fa3a350:::benchmark_data_smithi188_161190_object127503:head# 2024-04-01T19:57:00.506 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.506 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fa47203:::benchmark_data_smithi188_161190_object93300:head# 2024-04-01T19:57:00.506 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.507 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fa58b3b:::benchmark_data_smithi188_161190_object127173:head# 2024-04-01T19:57:00.507 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.508 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fa5d640:::benchmark_data_smithi188_161190_object27371:head# 2024-04-01T19:57:00.508 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.508 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fa63133:::benchmark_data_smithi188_161190_object135120:head# 2024-04-01T19:57:00.508 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.508 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fa67502:::benchmark_data_smithi188_161190_object19901:head# 2024-04-01T19:57:00.508 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.508 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fa78d1e:::benchmark_data_smithi188_161190_object87492:head# 2024-04-01T19:57:00.508 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.509 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fa7af19:::benchmark_data_smithi188_161190_object104398:head# 2024-04-01T19:57:00.509 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.509 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fa80c48:::benchmark_data_smithi188_161190_object116139:head# 2024-04-01T19:57:00.509 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.509 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fa85b4f:::benchmark_data_smithi188_161190_object119816:head# 2024-04-01T19:57:00.509 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.509 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fa8b7cf:::benchmark_data_smithi188_161190_object49727:head# 2024-04-01T19:57:00.509 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.511 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fa8bd25:::benchmark_data_smithi188_161190_object55648:head# 2024-04-01T19:57:00.511 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.511 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fa8d858:::benchmark_data_smithi188_161190_object126679:head# 2024-04-01T19:57:00.511 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.511 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fa976cb:::benchmark_data_smithi188_161190_object30502:head# 2024-04-01T19:57:00.511 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.511 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fa98bbc:::benchmark_data_smithi188_161190_object32393:head# 2024-04-01T19:57:00.512 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.512 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fab4cdd:::benchmark_data_smithi188_161190_object107730:head# 2024-04-01T19:57:00.512 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.512 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fab4f94:::benchmark_data_smithi188_161190_object121585:head# 2024-04-01T19:57:00.512 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.513 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fabfb02:::benchmark_data_smithi188_161190_object113673:head# 2024-04-01T19:57:00.513 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.513 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fac6136:::benchmark_data_smithi188_161190_object67981:head# 2024-04-01T19:57:00.513 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.513 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9faca7e5:::benchmark_data_smithi188_161190_object57813:head# 2024-04-01T19:57:00.513 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.513 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9facfa7a:::benchmark_data_smithi188_161190_object90994:head# 2024-04-01T19:57:00.513 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.513 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fad232b:::benchmark_data_smithi188_161190_object43367:head# 2024-04-01T19:57:00.514 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.519 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fadabcb:::benchmark_data_smithi188_161190_object30668:head# 2024-04-01T19:57:00.519 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.519 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fadc331:::benchmark_data_smithi188_161190_object33421:head# 2024-04-01T19:57:00.519 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.519 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fadd6cc:::benchmark_data_smithi188_161190_object39286:head# 2024-04-01T19:57:00.519 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.520 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fae2abc:::benchmark_data_smithi188_161190_object40377:head# 2024-04-01T19:57:00.521 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.521 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fae5342:::benchmark_data_smithi188_161190_object72273:head# 2024-04-01T19:57:00.521 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.521 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9faec9cf:::benchmark_data_smithi188_161190_object58276:head# 2024-04-01T19:57:00.521 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.521 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9faf1396:::benchmark_data_smithi188_161190_object28102:head# 2024-04-01T19:57:00.521 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.521 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9faf323d:::benchmark_data_smithi188_161190_object52476:head# 2024-04-01T19:57:00.521 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.521 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9faf7a31:::benchmark_data_smithi188_161190_object28772:head# 2024-04-01T19:57:00.521 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.522 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fb04bbf:::benchmark_data_smithi188_161190_object38785:head# 2024-04-01T19:57:00.522 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.522 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fb1036a:::benchmark_data_smithi188_161190_object24692:head# 2024-04-01T19:57:00.523 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.523 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fb1b4f3:::benchmark_data_smithi188_161190_object124844:head# 2024-04-01T19:57:00.523 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.531 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fb1fed9:::benchmark_data_smithi188_161190_object35189:head# 2024-04-01T19:57:00.531 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.531 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fb2806a:::benchmark_data_smithi188_161190_object97915:head# 2024-04-01T19:57:00.531 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.531 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fb346ce:::benchmark_data_smithi188_161190_object128283:head# 2024-04-01T19:57:00.532 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.532 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fb43a48:::benchmark_data_smithi188_161190_object128823:head# 2024-04-01T19:57:00.532 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.532 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fb5888c:::benchmark_data_smithi188_161190_object30191:head# 2024-04-01T19:57:00.532 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.532 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fb5c577:::benchmark_data_smithi188_161190_object137024:head# 2024-04-01T19:57:00.532 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.532 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fb679f8:::benchmark_data_smithi188_161190_object111265:head# 2024-04-01T19:57:00.532 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.532 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fb772dd:::benchmark_data_smithi188_161190_object63931:head# 2024-04-01T19:57:00.532 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.532 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fb7cfe0:::benchmark_data_smithi188_161190_object23788:head# 2024-04-01T19:57:00.532 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.532 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fb829c3:::benchmark_data_smithi188_161190_object90042:head# 2024-04-01T19:57:00.533 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.533 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fb83566:::benchmark_data_smithi188_161190_object44041:head# 2024-04-01T19:57:00.533 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.533 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fba087d:::benchmark_data_smithi188_161190_object42724:head# 2024-04-01T19:57:00.533 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.533 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fba7ca1:::benchmark_data_smithi188_161190_object96728:head# 2024-04-01T19:57:00.533 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.533 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fbac040:::benchmark_data_smithi188_161190_object123358:head# 2024-04-01T19:57:00.533 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.539 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fbb26f0:::benchmark_data_smithi188_161190_object96685:head# 2024-04-01T19:57:00.540 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.540 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fbbd1f2:::benchmark_data_smithi188_161190_object67639:head# 2024-04-01T19:57:00.540 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.541 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fbc1bbd:::benchmark_data_smithi188_161190_object21838:head# 2024-04-01T19:57:00.541 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.541 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fbc76f7:::benchmark_data_smithi188_161190_object78244:head# 2024-04-01T19:57:00.541 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.541 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fbc95e1:::benchmark_data_smithi188_161190_object25316:head# 2024-04-01T19:57:00.541 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.542 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fbcabd4:::benchmark_data_smithi188_161190_object130880:head# 2024-04-01T19:57:00.542 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.543 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fbce9de:::benchmark_data_smithi188_161190_object131895:head# 2024-04-01T19:57:00.543 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.543 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fbe0a92:::benchmark_data_smithi188_161190_object63858:head# 2024-04-01T19:57:00.543 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.543 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fbe8609:::benchmark_data_smithi188_161190_object91248:head# 2024-04-01T19:57:00.543 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.543 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fbf2178:::benchmark_data_smithi188_161190_object90258:head# 2024-04-01T19:57:00.543 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.544 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fbf3615:::benchmark_data_smithi188_161190_object96495:head# 2024-04-01T19:57:00.544 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.544 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fc02e0d:::benchmark_data_smithi188_161190_object62197:head# 2024-04-01T19:57:00.544 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.544 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fc0af6d:::benchmark_data_smithi188_161190_object138484:head# 2024-04-01T19:57:00.545 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.545 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fc18adc:::benchmark_data_smithi188_161190_object96119:head# 2024-04-01T19:57:00.545 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.545 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fc1b0cf:::benchmark_data_smithi188_161190_object30562:head# 2024-04-01T19:57:00.545 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.545 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fc21bd9:::benchmark_data_smithi188_161190_object67541:head# 2024-04-01T19:57:00.545 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.545 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fc22e0e:::benchmark_data_smithi188_161190_object66450:head# 2024-04-01T19:57:00.545 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.546 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fc35efb:::benchmark_data_smithi188_161190_object89678:head# 2024-04-01T19:57:00.547 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.547 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fc3b275:::benchmark_data_smithi188_161190_object73863:head# 2024-04-01T19:57:00.547 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.547 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fc60ee6:::benchmark_data_smithi188_161190_object125142:head# 2024-04-01T19:57:00.547 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.547 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fc6ec9f:::benchmark_data_smithi188_161190_object84308:head# 2024-04-01T19:57:00.547 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.547 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fc7a156:::benchmark_data_smithi188_161190_object54373:head# 2024-04-01T19:57:00.547 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.547 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fc9dfcc:::benchmark_data_smithi188_161190_object103090:head# 2024-04-01T19:57:00.547 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.547 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fca4534:::benchmark_data_smithi188_161190_object83596:head# 2024-04-01T19:57:00.548 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.548 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fcaeb95:::benchmark_data_smithi188_161190_object62263:head# 2024-04-01T19:57:00.548 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.548 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fcb284b:::benchmark_data_smithi188_161190_object27119:head# 2024-04-01T19:57:00.548 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.551 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fcb42d0:::benchmark_data_smithi188_161190_object129492:head# 2024-04-01T19:57:00.551 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.551 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fcb8cd2:::benchmark_data_smithi188_161190_object115143:head# 2024-04-01T19:57:00.551 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.551 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fcbe42a:::benchmark_data_smithi188_161190_object62386:head# 2024-04-01T19:57:00.551 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.551 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fcc5752:::benchmark_data_smithi188_161190_object97211:head# 2024-04-01T19:57:00.551 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.552 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fcdb553:::benchmark_data_smithi188_161190_object97873:head# 2024-04-01T19:57:00.552 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.552 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fcdec86:::benchmark_data_smithi188_161190_object35839:head# 2024-04-01T19:57:00.552 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.552 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fcedfc1:::benchmark_data_smithi188_161190_object21468:head# 2024-04-01T19:57:00.552 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.552 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fcee273:::benchmark_data_smithi188_161190_object137348:head# 2024-04-01T19:57:00.552 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.552 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fcf00ce:::benchmark_data_smithi188_161190_object123648:head# 2024-04-01T19:57:00.552 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.552 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fcf82b6:::benchmark_data_smithi188_161190_object46390:head# 2024-04-01T19:57:00.552 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.552 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fcf9258:::benchmark_data_smithi188_161190_object52259:head# 2024-04-01T19:57:00.553 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.553 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fcfbfcb:::benchmark_data_smithi188_161190_object41752:head# 2024-04-01T19:57:00.553 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.553 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fd0970b:::benchmark_data_smithi188_161190_object51161:head# 2024-04-01T19:57:00.553 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.553 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fd0f3ef:::benchmark_data_smithi188_161190_object72293:head# 2024-04-01T19:57:00.553 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.554 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fd15478:::benchmark_data_smithi188_161190_object98175:head# 2024-04-01T19:57:00.554 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.554 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fd1c157:::benchmark_data_smithi188_161190_object121685:head# 2024-04-01T19:57:00.554 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.554 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fd1f88b:::benchmark_data_smithi188_161190_object30027:head# 2024-04-01T19:57:00.554 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.555 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fd2af9f:::benchmark_data_smithi188_161190_object76430:head# 2024-04-01T19:57:00.555 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.555 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fd31b00:::benchmark_data_smithi188_161190_object30288:head# 2024-04-01T19:57:00.555 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.555 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fd38a9b:::benchmark_data_smithi188_161190_object126890:head# 2024-04-01T19:57:00.556 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.556 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fd3c995:::benchmark_data_smithi188_161190_object101814:head# 2024-04-01T19:57:00.556 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.556 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fd3e7f6:::benchmark_data_smithi188_161190_object55598:head# 2024-04-01T19:57:00.556 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.556 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fd41be5:::benchmark_data_smithi188_161190_object50380:head# 2024-04-01T19:57:00.556 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.556 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fd4941d:::benchmark_data_smithi188_161190_object58540:head# 2024-04-01T19:57:00.556 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.556 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fd4f4f1:::benchmark_data_smithi188_161190_object111633:head# 2024-04-01T19:57:00.556 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.557 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:57:00.560 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fd620e7:::benchmark_data_smithi188_161190_object84231:head# 2024-04-01T19:57:00.560 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.560 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fd64111:::benchmark_data_smithi188_161190_object71106:head# 2024-04-01T19:57:00.560 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.560 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fd737bc:::benchmark_data_smithi188_161190_object57671:head# 2024-04-01T19:57:00.560 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.561 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fd737cd:::benchmark_data_smithi188_161190_object33915:head# 2024-04-01T19:57:00.561 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.561 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fd7e191:::benchmark_data_smithi188_161190_object56625:head# 2024-04-01T19:57:00.561 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.561 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fd83c66:::benchmark_data_smithi188_161190_object134015:head# 2024-04-01T19:57:00.561 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.561 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fd8a0ea:::benchmark_data_smithi188_161190_object90498:head# 2024-04-01T19:57:00.561 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.561 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fd9829e:::benchmark_data_smithi188_161190_object108231:head# 2024-04-01T19:57:00.561 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.561 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fdae086:::benchmark_data_smithi188_161190_object67239:head# 2024-04-01T19:57:00.561 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.561 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fdb0dcb:::benchmark_data_smithi188_161190_object60012:head# 2024-04-01T19:57:00.561 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.562 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fdb8a51:::benchmark_data_smithi188_161190_object49774:head# 2024-04-01T19:57:00.562 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.562 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fdbc111:::benchmark_data_smithi188_161190_object37147:head# 2024-04-01T19:57:00.562 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.562 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fdc1615:::benchmark_data_smithi188_161190_object85329:head# 2024-04-01T19:57:00.562 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.562 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fdc6564:::benchmark_data_smithi188_161190_object35416:head# 2024-04-01T19:57:00.562 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.562 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fdd912b:::benchmark_data_smithi188_161190_object121629:head# 2024-04-01T19:57:00.562 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.562 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fdd9f24:::benchmark_data_smithi188_161190_object58865:head# 2024-04-01T19:57:00.562 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.562 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fdddc97:::benchmark_data_smithi188_161190_object96922:head# 2024-04-01T19:57:00.563 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.563 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fde08fc:::benchmark_data_smithi188_161190_object30214:head# 2024-04-01T19:57:00.563 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.563 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fdeaf57:::benchmark_data_smithi188_161190_object76588:head# 2024-04-01T19:57:00.563 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.563 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fdf2ca4:::benchmark_data_smithi188_161190_object56885:head# 2024-04-01T19:57:00.563 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.563 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fdffb31:::benchmark_data_smithi188_161190_object94697:head# 2024-04-01T19:57:00.563 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.563 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fe0aed7:::benchmark_data_smithi188_161190_object50187:head# 2024-04-01T19:57:00.563 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.563 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fe1015f:::benchmark_data_smithi188_161190_object126277:head# 2024-04-01T19:57:00.563 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.564 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fe1202e:::benchmark_data_smithi188_161190_object97442:head# 2024-04-01T19:57:00.564 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.566 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fe269bf:::benchmark_data_smithi188_161190_object118608:head# 2024-04-01T19:57:00.566 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.566 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fe2c5b7:::benchmark_data_smithi188_161190_object97403:head# 2024-04-01T19:57:00.567 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.567 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fe37b5c:::benchmark_data_smithi188_161190_object135798:head# 2024-04-01T19:57:00.567 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.567 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fe38a20:::benchmark_data_smithi188_161190_object118865:head# 2024-04-01T19:57:00.567 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.567 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fe3beb7:::benchmark_data_smithi188_161190_object66139:head# 2024-04-01T19:57:00.567 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.567 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fe40562:::benchmark_data_smithi188_161190_object69614:head# 2024-04-01T19:57:00.567 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.567 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fe417b3:::benchmark_data_smithi188_161190_object37903:head# 2024-04-01T19:57:00.567 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.567 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fe5b16b:::benchmark_data_smithi188_161190_object125728:head# 2024-04-01T19:57:00.567 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.567 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fe665c7:::benchmark_data_smithi188_161190_object52581:head# 2024-04-01T19:57:00.568 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.568 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fe67f56:::benchmark_data_smithi188_161190_object106874:head# 2024-04-01T19:57:00.568 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.568 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fe7250c:::benchmark_data_smithi188_161190_object59010:head# 2024-04-01T19:57:00.568 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.568 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fe78040:::benchmark_data_smithi188_161190_object87906:head# 2024-04-01T19:57:00.568 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.568 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fe7c607:::benchmark_data_smithi188_161190_object136402:head# 2024-04-01T19:57:00.568 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.568 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fe83ef3:::benchmark_data_smithi188_161190_object104896:head# 2024-04-01T19:57:00.568 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.568 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fe8412e:::benchmark_data_smithi188_161190_object55428:head# 2024-04-01T19:57:00.568 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.568 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fe86540:::benchmark_data_smithi188_161190_object118390:head# 2024-04-01T19:57:00.569 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.569 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fe928de:::benchmark_data_smithi188_161190_object114019:head# 2024-04-01T19:57:00.569 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.569 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fe9734a:::benchmark_data_smithi188_161190_object36920:head# 2024-04-01T19:57:00.569 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.569 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fe99952:::benchmark_data_smithi188_161190_object52084:head# 2024-04-01T19:57:00.569 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.569 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fe9c69e:::benchmark_data_smithi188_161190_object113108:head# 2024-04-01T19:57:00.569 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.569 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9feae7b9:::benchmark_data_smithi188_161190_object109467:head# 2024-04-01T19:57:00.569 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.569 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9feb8bbb:::benchmark_data_smithi188_161190_object70848:head# 2024-04-01T19:57:00.569 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.569 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fedb5cb:::benchmark_data_smithi188_161190_object59235:head# 2024-04-01T19:57:00.570 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.572 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fede415:::benchmark_data_smithi188_161190_object30285:head# 2024-04-01T19:57:00.572 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.572 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fee510a:::benchmark_data_smithi188_161190_object138512:head# 2024-04-01T19:57:00.572 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.572 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9feebfb6:::benchmark_data_smithi188_161190_object133201:head# 2024-04-01T19:57:00.572 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.572 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9feec899:::benchmark_data_smithi188_161190_object55574:head# 2024-04-01T19:57:00.572 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.572 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9feee38e:::benchmark_data_smithi188_161190_object136789:head# 2024-04-01T19:57:00.572 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.573 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fef4259:::benchmark_data_smithi188_161190_object112435:head# 2024-04-01T19:57:00.573 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.573 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fef7e26:::benchmark_data_smithi188_161190_object40629:head# 2024-04-01T19:57:00.573 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.573 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ff03a81:::benchmark_data_smithi188_161190_object66285:head# 2024-04-01T19:57:00.573 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.573 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ff15b1e:::benchmark_data_smithi188_161190_object47503:head# 2024-04-01T19:57:00.573 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.573 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ff2ed5e:::benchmark_data_smithi188_161190_object115993:head# 2024-04-01T19:57:00.573 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.573 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ff32bd6:::benchmark_data_smithi188_161190_object92105:head# 2024-04-01T19:57:00.573 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.573 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ff374d1:::benchmark_data_smithi188_161190_object105768:head# 2024-04-01T19:57:00.573 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.573 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ff5247d:::benchmark_data_smithi188_161190_object90985:head# 2024-04-01T19:57:00.574 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.574 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ff607c0:::benchmark_data_smithi188_161190_object41476:head# 2024-04-01T19:57:00.574 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.574 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ff6728e:::benchmark_data_smithi188_161190_object75241:head# 2024-04-01T19:57:00.574 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.574 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ff681a1:::benchmark_data_smithi188_161190_object112617:head# 2024-04-01T19:57:00.574 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.575 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ff7498b:::benchmark_data_smithi188_161190_object114116:head# 2024-04-01T19:57:00.575 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.576 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ff799c4:::benchmark_data_smithi188_161190_object72165:head# 2024-04-01T19:57:00.576 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.576 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ff7bca1:::benchmark_data_smithi188_161190_object96252:head# 2024-04-01T19:57:00.576 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.576 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ff9c3a7:::benchmark_data_smithi188_161190_object52624:head# 2024-04-01T19:57:00.576 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.576 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ff9f1ad:::benchmark_data_smithi188_161190_object42852:head# 2024-04-01T19:57:00.576 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.576 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ffaa7d8:::benchmark_data_smithi188_161190_object50632:head# 2024-04-01T19:57:00.576 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.576 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ffab107:::benchmark_data_smithi188_161190_object97154:head# 2024-04-01T19:57:00.576 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.576 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ffb12ef:::benchmark_data_smithi188_161190_object80901:head# 2024-04-01T19:57:00.576 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.576 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ffbd87f:::benchmark_data_smithi188_161190_object30653:head# 2024-04-01T19:57:00.577 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.577 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ffc106a:::benchmark_data_smithi188_161190_object80675:head# 2024-04-01T19:57:00.577 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.577 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ffc5a8a:::benchmark_data_smithi188_161190_object125733:head# 2024-04-01T19:57:00.577 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.577 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ffd1471:::benchmark_data_smithi188_161190_object42408:head# 2024-04-01T19:57:00.577 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.577 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ffdbecf:::benchmark_data_smithi188_161190_object113384:head# 2024-04-01T19:57:00.577 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.577 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9ffe6dc0:::benchmark_data_smithi188_161190_object65096:head# 2024-04-01T19:57:00.577 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.577 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fff3858:::benchmark_data_smithi188_161190_object127751:head# 2024-04-01T19:57:00.577 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.577 INFO:teuthology.orchestra.run.smithi188.stdout:Write #8:9fff7669:::benchmark_data_smithi188_161190_object109123:head# 2024-04-01T19:57:00.577 INFO:teuthology.orchestra.run.smithi188.stdout:snapset 0=[]:{} 2024-04-01T19:57:00.591 INFO:teuthology.orchestra.run.smithi188.stdout:write_pg epoch 679 info 8.9( v 679'10018 (0'0,679'10018] local-lis/les=644/645 n=7600 ec=629/629 lis/c=644/644 les/c/f=645/645/0 sis=644) 2024-04-01T19:57:00.593 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:00.672 INFO:teuthology.orchestra.run.smithi188.stdout:Import successful 2024-04-01T19:57:00.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:00 smithi062 ceph-mon[44211]: 8.b scrub ok 2024-04-01T19:57:00.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:00 smithi062 ceph-mon[44211]: 8.1 scrub starts 2024-04-01T19:57:00.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:00 smithi022 ceph-mon[39439]: 8.b scrub ok 2024-04-01T19:57:00.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:00 smithi022 ceph-mon[39439]: 8.1 scrub starts 2024-04-01T19:57:00.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:00 smithi188 ceph-mon[43939]: 8.b scrub ok 2024-04-01T19:57:00.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:00 smithi188 ceph-mon[43939]: 8.1 scrub starts 2024-04-01T19:57:01.048 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:57:01.053 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:01.054 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:57:01.155 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:57:01.243 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:01.446 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:57:01.452 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:01.453 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:57:01.487 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:01 smithi188 ceph-mon[43939]: 8.1 scrub ok 2024-04-01T19:57:01.488 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:01 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 31028/199070 objects degraded (15.586%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:01.554 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:57:01.596 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:01 smithi062 ceph-mon[44211]: 8.1 scrub ok 2024-04-01T19:57:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:01 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 31028/199070 objects degraded (15.586%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:01.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:01 smithi062 ceph-mon[44211]: pgmap v1899: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.9 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 0 B/s wr, 713 op/s; 30257/193662 objects degraded (15.624%); 14 MiB/s, 218 objects/s recovering 2024-04-01T19:57:01.824 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:57:01.849 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:57:01.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:01 smithi022 ceph-mon[39439]: 8.1 scrub ok 2024-04-01T19:57:01.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:01 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 31028/199070 objects degraded (15.586%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:01.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:01 smithi022 ceph-mon[39439]: pgmap v1899: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.9 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 0 B/s wr, 713 op/s; 30257/193662 objects degraded (15.624%); 14 MiB/s, 218 objects/s recovering 2024-04-01T19:57:01.872 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:57:01.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:01 smithi188 ceph-mon[43939]: pgmap v1899: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.9 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 0 B/s wr, 713 op/s; 30257/193662 objects degraded (15.624%); 14 MiB/s, 218 objects/s recovering 2024-04-01T19:57:01.898 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:57:01.929 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:57:01.959 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:57:01.989 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:57:02.017 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:57:02.052 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:57:02.060 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/exp.8.9.10 2024-04-01T19:57:02.066 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:57:02.072 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:02.073 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:57:02.084 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:57:02.113 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:57:02.113 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:57:02.113 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:57:02.113 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:57:02.113 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:57:02.113 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:57:02.114 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:57:02.114 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:57:02.114 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:57:02.114 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:57:02.114 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.10 2024-04-01T19:57:02.114 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:57:02.145 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:57:02.173 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:57:02.190 INFO:tasks.thrashosds.thrasher:Waiting for clean again 2024-04-01T19:57:02.190 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-01T19:57:02.190 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:57:02.222 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:02.493 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:02 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/599951816' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:57:02.494 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:02.494 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:02.494 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:02 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/599951816' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:57:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:02.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:02 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/599951816' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:57:02.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:02.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:02.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:03.025 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:57:03.026 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:57:03.135 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:57:03.139 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:57:03.184 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:57:03.187 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:03.188 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:57:03.289 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:57:03.328 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:03.363 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:57:03.366 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:03.366 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:57:03.467 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:57:03.509 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:03.509 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:03.509 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:03.509 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:03.509 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:03.509 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:03.509 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:03.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:03.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:03 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:57:03.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:03 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:57:03.510 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:03 smithi062 ceph-mon[44211]: pgmap v1900: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.9 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 717 op/s; 30063/192852 objects degraded (15.589%); 15 MiB/s, 242 objects/s recovering 2024-04-01T19:57:03.522 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:03.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:03.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:03.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:03.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:03.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:03.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:03.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:03.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:03.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:03 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:57:03.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:03 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:57:03.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:03 smithi022 ceph-mon[39439]: pgmap v1900: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.9 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 717 op/s; 30063/192852 objects degraded (15.589%); 15 MiB/s, 242 objects/s recovering 2024-04-01T19:57:03.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:03.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:03.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:03.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:03.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:03.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:03.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:03.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:03.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:03 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:57:03.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:03 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:57:03.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:03 smithi188 ceph-mon[43939]: pgmap v1900: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.9 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 717 op/s; 30063/192852 objects degraded (15.589%); 15 MiB/s, 242 objects/s recovering 2024-04-01T19:57:04.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:04 smithi022 ceph-mon[39439]: osdmap e695: 12 total, 11 up, 10 in 2024-04-01T19:57:04.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:04 smithi188 ceph-mon[43939]: osdmap e695: 12 total, 11 up, 10 in 2024-04-01T19:57:05.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:04 smithi062 ceph-mon[44211]: osdmap e695: 12 total, 11 up, 10 in 2024-04-01T19:57:05.027 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:57:05.286 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:57:05.289 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:05.290 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:57:05.391 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:57:05.434 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:05.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:05 smithi022 ceph-mon[39439]: pgmap v1902: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.9 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 471 op/s; 30063/191940 objects degraded (15.663%); 7.5 MiB/s, 120 objects/s recovering 2024-04-01T19:57:05.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:05 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 30063/192852 objects degraded (15.589%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:05.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:05 smithi188 ceph-mon[43939]: pgmap v1902: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.9 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 471 op/s; 30063/191940 objects degraded (15.663%); 7.5 MiB/s, 120 objects/s recovering 2024-04-01T19:57:05.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:05 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 30063/192852 objects degraded (15.589%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:06.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:05 smithi062 ceph-mon[44211]: pgmap v1902: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.9 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 471 op/s; 30063/191940 objects degraded (15.663%); 7.5 MiB/s, 120 objects/s recovering 2024-04-01T19:57:06.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:05 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 30063/192852 objects degraded (15.589%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:06.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:06 smithi022 ceph-mon[39439]: 8.c scrub starts 2024-04-01T19:57:06.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:06 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:57:06.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:06 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:57:06.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:06 smithi022 ceph-mon[39439]: osdmap e696: 12 total, 11 up, 10 in 2024-04-01T19:57:06.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:06 smithi188 ceph-mon[43939]: 8.c scrub starts 2024-04-01T19:57:06.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:06 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:57:06.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:06 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:57:06.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:06 smithi188 ceph-mon[43939]: osdmap e696: 12 total, 11 up, 10 in 2024-04-01T19:57:07.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:06 smithi062 ceph-mon[44211]: 8.c scrub starts 2024-04-01T19:57:07.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:06 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:57:07.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:06 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:57:07.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:06 smithi062 ceph-mon[44211]: osdmap e696: 12 total, 11 up, 10 in 2024-04-01T19:57:07.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:07 smithi022 ceph-mon[39439]: 8.c scrub ok 2024-04-01T19:57:07.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:07 smithi022 ceph-mon[39439]: pgmap v1904: 17 pgs: 1 active+clean+scrubbing, 5 active+recovering+degraded, 11 active+clean; 5.7 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 778 op/s; 29061/186608 objects degraded (15.573%); 15 MiB/s, 245 objects/s recovering 2024-04-01T19:57:07.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:07 smithi188 ceph-mon[43939]: 8.c scrub ok 2024-04-01T19:57:07.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:07 smithi188 ceph-mon[43939]: pgmap v1904: 17 pgs: 1 active+clean+scrubbing, 5 active+recovering+degraded, 11 active+clean; 5.7 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 778 op/s; 29061/186608 objects degraded (15.573%); 15 MiB/s, 245 objects/s recovering 2024-04-01T19:57:07.993 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:57:07.997 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:07.997 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:57:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:07 smithi062 ceph-mon[44211]: 8.c scrub ok 2024-04-01T19:57:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:07 smithi062 ceph-mon[44211]: pgmap v1904: 17 pgs: 1 active+clean+scrubbing, 5 active+recovering+degraded, 11 active+clean; 5.7 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 778 op/s; 29061/186608 objects degraded (15.573%); 15 MiB/s, 245 objects/s recovering 2024-04-01T19:57:08.097 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:57:08.136 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:08.169 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:57:08.179 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:08.180 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:57:08.281 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:57:08.303 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_historic_ops 2024-04-01T19:57:08.313 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:08.566 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:57:08.572 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:08.572 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:57:08.619 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:57:08.673 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:57:08.729 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:08.757 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:57:08.761 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:57:08.766 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:08.766 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:57:08.867 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:57:08.913 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:09.572 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:57:09.575 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:09.575 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:57:09.676 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:57:09.716 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:09.778 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:57:09.781 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:09.781 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:57:09.882 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:57:09.932 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:10.695 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:57:10.699 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:10.700 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:57:10.700 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:10 smithi022 ceph-mon[39439]: pgmap v1905: 17 pgs: 1 active+clean+scrubbing, 5 active+recovering+degraded, 11 active+clean; 5.7 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 465 op/s; 29061/186216 objects degraded (15.606%); 9.3 MiB/s, 149 objects/s recovering 2024-04-01T19:57:10.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:10 smithi062 ceph-mon[44211]: pgmap v1905: 17 pgs: 1 active+clean+scrubbing, 5 active+recovering+degraded, 11 active+clean; 5.7 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 465 op/s; 29061/186216 objects degraded (15.606%); 9.3 MiB/s, 149 objects/s recovering 2024-04-01T19:57:10.801 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:57:10.835 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:10 smithi188 ceph-mon[43939]: pgmap v1905: 17 pgs: 1 active+clean+scrubbing, 5 active+recovering+degraded, 11 active+clean; 5.7 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 465 op/s; 29061/186216 objects degraded (15.606%); 9.3 MiB/s, 149 objects/s recovering 2024-04-01T19:57:10.837 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:10.862 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:57:10.866 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:10.867 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:57:10.965 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:57:10.966 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:57:10.967 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:57:11.004 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:11.030 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:57:11.033 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:11.034 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:57:11.135 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:57:11.171 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:11.199 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:57:11.209 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:11.209 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:57:11.311 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:57:11.354 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:11.451 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:11 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 29061/186216 objects degraded (15.606%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:11.451 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:11 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3168655245' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:57:11.451 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:11.452 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:57:11.452 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:57:11.458 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:11 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 29061/186216 objects degraded (15.606%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:11.458 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:11 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3168655245' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:57:11.525 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:57:11.553 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:57:11.597 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:11.626 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:57:11.628 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:11.628 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:57:11.729 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:57:11.767 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:11.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:11 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 29061/186216 objects degraded (15.606%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:11.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:11 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3168655245' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:57:12.126 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:57:12.131 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:12.131 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:57:12.232 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:57:12.275 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:12.301 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:57:12.309 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:12.309 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:57:12.342 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":1905,"stamp":"2024-04-01T19:57:09.376273+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6102319672,"num_objects":93108,"num_object_clones":0,"num_object_copies":186216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":29061,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93108,"num_whiteouts":0,"num_read":127,"num_read_kb":110,"num_write":185635,"num_write_kb":8916795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12262,"num_bytes_recovered":804735104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161014,"ondisk_log_size":161014,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":9,"kb":937451520,"kb_used":15835372,"kb_used_data":10060100,"kb_used_omap":889,"kb_used_meta":5774214,"kb_avail":921616148,"statfs":{"total":959950356480,"available":943734935552,"internally_reserved":0,"allocated":10301542400,"data_stored":10297898920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":910339,"internal_metadata":5912796157},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,2,5,0,4,4,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-243990528,"num_objects":-3723,"num_object_clones":0,"num_object_copies":-7446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1196,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3723,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3723,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1196,"num_bytes_recovered":78381056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001866"},"pg_stats":[{"pgid":"8.f","version":"695'11745","reported_seq":11982,"reported_epoch":695,"state":"active+clean","last_fresh":"2024-04-01T19:57:05.356380+0000","last_change":"2024-04-01T19:55:39.217150+0000","last_active":"2024-04-01T19:57:05.356380+0000","last_peered":"2024-04-01T19:57:05.356380+0000","last_clean":"2024-04-01T19:57:05.356380+0000","last_became_active":"2024-04-01T19:53:54.067307+0000","last_became_peered":"2024-04-01T19:53:54.067307+0000","last_unstale":"2024-04-01T19:57:05.356380+0000","last_undegraded":"2024-04-01T19:57:05.356380+0000","last_fullsized":"2024-04-01T19:57:05.356380+0000","mapping_epoch":629,"log_start":"645'1700","ondisk_log_start":"645'1700","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8876","last_scrub_stamp":"2024-04-01T19:55:39.216977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:39.216977+0000","objects_scrubbed":8773,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1863,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383844352,"num_objects":5857,"num_object_clones":0,"num_object_copies":11714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5857,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11745,"num_write_kb":563264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.e","version":"695'11526","reported_seq":11759,"reported_epoch":695,"state":"active+clean","last_fresh":"2024-04-01T19:57:05.493249+0000","last_change":"2024-04-01T19:55:33.528266+0000","last_active":"2024-04-01T19:57:05.493249+0000","last_peered":"2024-04-01T19:57:05.493249+0000","last_clean":"2024-04-01T19:57:05.493249+0000","last_became_active":"2024-04-01T19:53:54.066471+0000","last_became_peered":"2024-04-01T19:53:54.066471+0000","last_unstale":"2024-04-01T19:57:05.493249+0000","last_undegraded":"2024-04-01T19:57:05.493249+0000","last_fullsized":"2024-04-01T19:57:05.493249+0000","mapping_epoch":629,"log_start":"642'1500","ondisk_log_start":"642'1500","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'8369","last_scrub_stamp":"2024-04-01T19:55:33.528006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:33.528006+0000","objects_scrubbed":8332,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1210,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":372244480,"num_objects":5680,"num_object_clones":0,"num_object_copies":11360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5680,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11526,"num_write_kb":550592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"695'11698","reported_seq":11934,"reported_epoch":695,"state":"active+clean","last_fresh":"2024-04-01T19:57:05.451346+0000","last_change":"2024-04-01T19:55:45.161755+0000","last_active":"2024-04-01T19:57:05.451346+0000","last_peered":"2024-04-01T19:57:05.451346+0000","last_clean":"2024-04-01T19:57:05.451346+0000","last_became_active":"2024-04-01T19:53:53.678991+0000","last_became_peered":"2024-04-01T19:53:53.678991+0000","last_unstale":"2024-04-01T19:57:05.451346+0000","last_undegraded":"2024-04-01T19:57:05.451346+0000","last_fullsized":"2024-04-01T19:57:05.451346+0000","mapping_epoch":629,"log_start":"645'1600","ondisk_log_start":"645'1600","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"674'9322","last_scrub_stamp":"2024-04-01T19:55:45.161618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:45.161618+0000","objects_scrubbed":8442,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1822,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393412632,"num_objects":6004,"num_object_clones":0,"num_object_copies":12008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6004,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11698,"num_write_kb":566401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.c","version":"695'11608","reported_seq":11870,"reported_epoch":695,"state":"active+clean+scrubbing","last_fresh":"2024-04-01T19:57:05.721156+0000","last_change":"2024-04-01T19:57:05.281855+0000","last_active":"2024-04-01T19:57:05.721156+0000","last_peered":"2024-04-01T19:57:05.721156+0000","last_clean":"2024-04-01T19:57:05.721156+0000","last_became_active":"2024-04-01T19:53:53.462634+0000","last_became_peered":"2024-04-01T19:53:53.462634+0000","last_unstale":"2024-04-01T19:57:05.721156+0000","last_undegraded":"2024-04-01T19:57:05.721156+0000","last_fullsized":"2024-04-01T19:57:05.721156+0000","mapping_epoch":629,"log_start":"643'1600","ondisk_log_start":"643'1600","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8663","last_scrub_stamp":"2024-04-01T19:55:37.272661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:37.272661+0000","objects_scrubbed":2199,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"scrubbing for 0s","scrub_duration":1996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":379846656,"num_objects":5796,"num_object_clones":0,"num_object_copies":11592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5796,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11608,"num_write_kb":556928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"8.b","version":"695'11684","reported_seq":11991,"reported_epoch":695,"state":"active+clean","last_fresh":"2024-04-01T19:57:04.348935+0000","last_change":"2024-04-01T19:56:59.305034+0000","last_active":"2024-04-01T19:57:04.348935+0000","last_peered":"2024-04-01T19:57:04.348935+0000","last_clean":"2024-04-01T19:57:04.348935+0000","last_became_active":"2024-04-01T19:53:53.456979+0000","last_became_peered":"2024-04-01T19:53:53.456979+0000","last_unstale":"2024-04-01T19:57:04.348935+0000","last_undegraded":"2024-04-01T19:57:04.348935+0000","last_fullsized":"2024-04-01T19:57:04.348935+0000","mapping_epoch":629,"log_start":"645'1600","ondisk_log_start":"645'1600","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"694'11454","last_scrub_stamp":"2024-04-01T19:56:59.304718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:56:59.304718+0000","objects_scrubbed":6290,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:58:02.508594+0000","scrub_duration":957,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395968512,"num_objects":6042,"num_object_clones":0,"num_object_copies":12084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6042,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11684,"num_write_kb":567232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"8.a","version":"695'11333","reported_seq":11623,"reported_epoch":695,"state":"active+clean","last_fresh":"2024-04-01T19:57:04.389843+0000","last_change":"2024-04-01T19:56:21.853413+0000","last_active":"2024-04-01T19:57:04.389843+0000","last_peered":"2024-04-01T19:57:04.389843+0000","last_clean":"2024-04-01T19:57:04.389843+0000","last_became_active":"2024-04-01T19:53:54.066588+0000","last_became_peered":"2024-04-01T19:53:54.066588+0000","last_unstale":"2024-04-01T19:57:04.389843+0000","last_undegraded":"2024-04-01T19:57:04.389843+0000","last_fullsized":"2024-04-01T19:57:04.389843+0000","mapping_epoch":629,"log_start":"642'1300","ondisk_log_start":"642'1300","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"680'9768","last_scrub_stamp":"2024-04-01T19:56:21.853096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:56:21.853096+0000","objects_scrubbed":7384,"log_size":10033,"log_dups_size":0,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:57:37.729675+0000","scrub_duration":668,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381353984,"num_objects":5819,"num_object_clones":0,"num_object_copies":11638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5819,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11333,"num_write_kb":548864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"8.8","version":"695'11634","reported_seq":11870,"reported_epoch":695,"state":"active+clean","last_fresh":"2024-04-01T19:57:05.650583+0000","last_change":"2024-04-01T19:55:40.424211+0000","last_active":"2024-04-01T19:57:05.650583+0000","last_peered":"2024-04-01T19:57:05.650583+0000","last_clean":"2024-04-01T19:57:05.650583+0000","last_became_active":"2024-04-01T19:53:53.454737+0000","last_became_peered":"2024-04-01T19:53:53.454737+0000","last_unstale":"2024-04-01T19:57:05.650583+0000","last_undegraded":"2024-04-01T19:57:05.650583+0000","last_fullsized":"2024-04-01T19:57:05.650583+0000","mapping_epoch":629,"log_start":"643'1600","ondisk_log_start":"643'1600","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8915","last_scrub_stamp":"2024-04-01T19:55:40.424044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:40.424044+0000","objects_scrubbed":8661,"log_size":10034,"log_dups_size":0,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:57:06.523660+0000","scrub_duration":1277,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":386793472,"num_objects":5902,"num_object_clones":0,"num_object_copies":11804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5902,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11634,"num_write_kb":561152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"695'11554","reported_seq":16681,"reported_epoch":695,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:57:05.500351+0000","last_change":"2024-04-01T19:56:22.028676+0000","last_active":"2024-04-01T19:57:05.500351+0000","last_peered":"2024-04-01T19:57:05.500351+0000","last_clean":"2024-04-01T19:55:56.524590+0000","last_became_active":"2024-04-01T19:56:21.981743+0000","last_became_peered":"2024-04-01T19:56:21.981743+0000","last_unstale":"2024-04-01T19:57:05.500351+0000","last_undegraded":"2024-04-01T19:56:21.738659+0000","last_fullsized":"2024-04-01T19:57:05.500351+0000","mapping_epoch":687,"log_start":"642'1500","ondisk_log_start":"642'1500","created":629,"last_epoch_clean":641,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'9008","last_scrub_stamp":"2024-04-01T19:55:43.358714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:43.358714+0000","objects_scrubbed":8387,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"no scrub is scheduled","scrub_duration":2089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":378273792,"num_objects":5772,"num_object_clones":0,"num_object_copies":11544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5771,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5772,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11554,"num_write_kb":554432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2441,"num_bytes_recovered":159907840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":["11"],"object_location_counts":[{"shards":"2,11","objects":1},{"shards":"11","objects":5771}],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.6","version":"695'11584","reported_seq":16756,"reported_epoch":695,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:57:05.480431+0000","last_change":"2024-04-01T19:56:22.018466+0000","last_active":"2024-04-01T19:57:05.480431+0000","last_peered":"2024-04-01T19:57:05.480431+0000","last_clean":"2024-04-01T19:55:56.539057+0000","last_became_active":"2024-04-01T19:56:21.956699+0000","last_became_peered":"2024-04-01T19:56:21.956699+0000","last_unstale":"2024-04-01T19:57:05.480431+0000","last_undegraded":"2024-04-01T19:56:21.744926+0000","last_fullsized":"2024-04-01T19:57:05.480431+0000","mapping_epoch":687,"log_start":"642'1500","ondisk_log_start":"642'1500","created":629,"last_epoch_clean":642,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8615","last_scrub_stamp":"2024-04-01T19:55:36.688352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:36.688352+0000","objects_scrubbed":8556,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"no scrub is scheduled","scrub_duration":2331,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":379060224,"num_objects":5784,"num_object_clones":0,"num_object_copies":11568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5784,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5784,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11584,"num_write_kb":555776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2463,"num_bytes_recovered":161218560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":["11"],"object_location_counts":[{"shards":"11","objects":5784}],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.5","version":"695'11704","reported_seq":16933,"reported_epoch":695,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:57:06.422988+0000","last_change":"2024-04-01T19:56:22.002998+0000","last_active":"2024-04-01T19:57:06.422988+0000","last_peered":"2024-04-01T19:57:06.422988+0000","last_clean":"2024-04-01T19:55:56.434043+0000","last_became_active":"2024-04-01T19:56:21.952684+0000","last_became_peered":"2024-04-01T19:56:21.952684+0000","last_unstale":"2024-04-01T19:57:06.422988+0000","last_undegraded":"2024-04-01T19:56:21.721301+0000","last_fullsized":"2024-04-01T19:57:06.422988+0000","mapping_epoch":687,"log_start":"645'1700","ondisk_log_start":"645'1700","created":629,"last_epoch_clean":644,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'8660","last_scrub_stamp":"2024-04-01T19:55:36.183547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:36.183547+0000","objects_scrubbed":8628,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"no scrub is scheduled","scrub_duration":1673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383516672,"num_objects":5852,"num_object_clones":0,"num_object_copies":11704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5851,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5852,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11704,"num_write_kb":561792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2491,"num_bytes_recovered":163250176,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":5851},{"shards":"4,11","objects":1}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.4","version":"695'14483","reported_seq":14922,"reported_epoch":695,"state":"active+clean","last_fresh":"2024-04-01T19:57:05.746400+0000","last_change":"2024-04-01T19:55:34.954183+0000","last_active":"2024-04-01T19:57:05.746400+0000","last_peered":"2024-04-01T19:57:05.746400+0000","last_clean":"2024-04-01T19:57:05.746400+0000","last_became_active":"2024-04-01T19:53:53.462894+0000","last_became_peered":"2024-04-01T19:53:53.462894+0000","last_unstale":"2024-04-01T19:57:05.746400+0000","last_undegraded":"2024-04-01T19:57:05.746400+0000","last_fullsized":"2024-04-01T19:57:05.746400+0000","mapping_epoch":629,"log_start":"654'4400","ondisk_log_start":"654'4400","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'11373","last_scrub_stamp":"2024-04-01T19:55:34.954011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:34.954011+0000","objects_scrubbed":8546,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":380567552,"num_objects":5807,"num_object_clones":0,"num_object_copies":11614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5807,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11721,"num_write_kb":560896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"695'11504","reported_seq":11713,"reported_epoch":695,"state":"active+clean","last_fresh":"2024-04-01T19:57:05.425051+0000","last_change":"2024-04-01T19:54:55.108987+0000","last_active":"2024-04-01T19:57:05.425051+0000","last_peered":"2024-04-01T19:57:05.425051+0000","last_clean":"2024-04-01T19:57:05.425051+0000","last_became_active":"2024-04-01T19:53:53.462397+0000","last_became_peered":"2024-04-01T19:53:53.462397+0000","last_unstale":"2024-04-01T19:57:05.425051+0000","last_undegraded":"2024-04-01T19:57:05.425051+0000","last_fullsized":"2024-04-01T19:57:05.425051+0000","mapping_epoch":629,"log_start":"642'1500","ondisk_log_start":"642'1500","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"660'5871","last_scrub_stamp":"2024-04-01T19:54:55.108780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:54:55.108780+0000","objects_scrubbed":5824,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":378142720,"num_objects":5770,"num_object_clones":0,"num_object_copies":11540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5770,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11504,"num_write_kb":552768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.2","version":"695'11368","reported_seq":16393,"reported_epoch":695,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:57:05.521204+0000","last_change":"2024-04-01T19:56:22.018621+0000","last_active":"2024-04-01T19:57:05.521204+0000","last_peered":"2024-04-01T19:57:05.521204+0000","last_clean":"2024-04-01T19:55:56.523442+0000","last_became_active":"2024-04-01T19:56:21.981766+0000","last_became_peered":"2024-04-01T19:56:21.981766+0000","last_unstale":"2024-04-01T19:57:05.521204+0000","last_undegraded":"2024-04-01T19:56:21.720612+0000","last_fullsized":"2024-04-01T19:57:05.521204+0000","mapping_epoch":687,"log_start":"642'1300","ondisk_log_start":"642'1300","created":629,"last_epoch_clean":645,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'8353","last_scrub_stamp":"2024-04-01T19:55:34.153804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:34.153804+0000","objects_scrubbed":8295,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"no scrub is scheduled","scrub_duration":1672,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":377356288,"num_objects":5758,"num_object_clones":0,"num_object_copies":11516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5745,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5758,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11368,"num_write_kb":548032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2390,"num_bytes_recovered":156499968,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":5745},{"shards":"0,4","objects":13}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"695'14457","reported_seq":14976,"reported_epoch":695,"state":"active+clean","last_fresh":"2024-04-01T19:57:05.665972+0000","last_change":"2024-04-01T19:57:00.295446+0000","last_active":"2024-04-01T19:57:05.665972+0000","last_peered":"2024-04-01T19:57:05.665972+0000","last_clean":"2024-04-01T19:57:05.665972+0000","last_became_active":"2024-04-01T19:53:54.066680+0000","last_became_peered":"2024-04-01T19:53:54.066680+0000","last_unstale":"2024-04-01T19:57:05.665972+0000","last_undegraded":"2024-04-01T19:57:05.665972+0000","last_fullsized":"2024-04-01T19:57:05.665972+0000","mapping_epoch":629,"log_start":"654'4400","ondisk_log_start":"654'4400","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"694'14240","last_scrub_stamp":"2024-04-01T19:57:00.295287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:57:00.295287+0000","objects_scrubbed":6022,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:58:19.188940+0000","scrub_duration":983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":378798080,"num_objects":5780,"num_object_clones":0,"num_object_copies":11560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5780,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11498,"num_write_kb":552896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"8.0","version":"696'11596","reported_seq":11905,"reported_epoch":696,"state":"active+clean","last_fresh":"2024-04-01T19:57:07.633251+0000","last_change":"2024-04-01T19:56:35.611718+0000","last_active":"2024-04-01T19:57:07.633251+0000","last_peered":"2024-04-01T19:57:07.633251+0000","last_clean":"2024-04-01T19:57:07.633251+0000","last_became_active":"2024-04-01T19:53:53.455265+0000","last_became_peered":"2024-04-01T19:53:53.455265+0000","last_unstale":"2024-04-01T19:57:07.633251+0000","last_undegraded":"2024-04-01T19:57:07.633251+0000","last_fullsized":"2024-04-01T19:57:07.633251+0000","mapping_epoch":629,"log_start":"642'1500","ondisk_log_start":"642'1500","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"689'10321","last_scrub_stamp":"2024-04-01T19:56:35.611492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:56:35.611492+0000","objects_scrubbed":6862,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:57:38.680310+0000","scrub_duration":1148,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364511232,"num_objects":5562,"num_object_clones":0,"num_object_copies":11124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5562,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11596,"num_write_kb":549056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"695'11697","reported_seq":16889,"reported_epoch":695,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:57:05.777976+0000","last_change":"2024-04-01T19:56:22.004749+0000","last_active":"2024-04-01T19:57:05.777976+0000","last_peered":"2024-04-01T19:57:05.777976+0000","last_clean":"2024-04-01T19:55:56.538683+0000","last_became_active":"2024-04-01T19:56:21.960415+0000","last_became_peered":"2024-04-01T19:56:21.960415+0000","last_unstale":"2024-04-01T19:57:05.777976+0000","last_undegraded":"2024-04-01T19:56:21.714140+0000","last_fullsized":"2024-04-01T19:57:05.777976+0000","mapping_epoch":687,"log_start":"645'1600","ondisk_log_start":"645'1600","created":629,"last_epoch_clean":645,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8889","last_scrub_stamp":"2024-04-01T19:55:39.237364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:39.237364+0000","objects_scrubbed":8775,"log_size":10097,"log_dups_size":0,"ondisk_log_size":10097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"no scrub is scheduled","scrub_duration":1706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388038656,"num_objects":5921,"num_object_clones":0,"num_object_copies":11842,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5910,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5921,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11697,"num_write_kb":563776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2469,"num_bytes_recovered":161742848,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":["5"],"object_location_counts":[{"shards":"0,5","objects":11},{"shards":"5","objects":5910}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":1718,"reported_epoch":696,"state":"active+clean","last_fresh":"2024-04-01T19:57:06.561432+0000","last_change":"2024-04-01T19:55:33.016809+0000","last_active":"2024-04-01T19:57:06.561432+0000","last_peered":"2024-04-01T19:57:06.561432+0000","last_clean":"2024-04-01T19:57:06.561432+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:57:06.561432+0000","last_undegraded":"2024-04-01T19:57:06.561432+0000","last_fullsized":"2024-04-01T19:57:06.561432+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:55:33.016695+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:55:33.016695+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":192,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":6101729304,"num_objects":93106,"num_object_clones":0,"num_object_copies":186212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":29061,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93106,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":185454,"num_write_kb":8913857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12254,"num_bytes_recovered":802619392,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12803776512,"data_stored":12803768368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160875,"ondisk_log_size":160875,"up":32,"acting":32,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220574,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2708424,"kb_used_data":1869248,"kb_used_omap":1,"kb_used_meta":839166,"kb_avail":91036728,"statfs":{"total":95995035648,"available":93221609472,"internally_reserved":0,"allocated":1914109952,"data_stored":1913741288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":859306436},"hb_peers":[0,1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,0,2,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678441,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1708416,"kb_used_data":1117748,"kb_used_omap":1,"kb_used_meta":590654,"kb_avail":92036736,"statfs":{"total":95995035648,"available":94245617664,"internally_reserved":0,"allocated":1144573952,"data_stored":1144212932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":604830144},"hb_peers":[0,1,2,3,4,5,6,7,8,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557638,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1365376,"kb_used_data":1134708,"kb_used_omap":132,"kb_used_meta":230459,"kb_avail":92379776,"statfs":{"total":95995035648,"available":94596890624,"internally_reserved":0,"allocated":1161940992,"data_stored":1161579972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":235990759},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234420,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":949012,"kb_used_data":376396,"kb_used_omap":1,"kb_used_meta":572606,"kb_avail":92796140,"statfs":{"total":95995035648,"available":95023247360,"internally_reserved":0,"allocated":385429504,"data_stored":385054856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":586349002},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":457,"seq":1962800054431,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":253568,"kb_used_data":692,"kb_used_omap":744,"kb_used_meta":252119,"kb_avail":93491584,"statfs":{"total":95995035648,"available":95735382016,"internally_reserved":0,"allocated":708608,"data_stored":347588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":762131,"internal_metadata":258170605},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":0,"seq":2452426326099,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738840,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1410556,"kb_used_data":739380,"kb_used_omap":1,"kb_used_meta":671166,"kb_avail":92334596,"statfs":{"total":95995035648,"available":94550626304,"internally_reserved":0,"allocated":757125120,"data_stored":756764100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":687274437},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1,0,0,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346381,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2011212,"kb_used_data":1466368,"kb_used_omap":1,"kb_used_meta":544830,"kb_avail":91733940,"statfs":{"total":95995035648,"available":93935554560,"internally_reserved":0,"allocated":1501560832,"data_stored":1501193808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":557906373},"hb_peers":[0,1,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669150151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1482572,"kb_used_data":729472,"kb_used_omap":1,"kb_used_meta":753086,"kb_avail":92262580,"statfs":{"total":95995035648,"available":94476881920,"internally_reserved":0,"allocated":746979328,"data_stored":746612304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":771160519},"hb_peers":[0,1,2,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953921,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1407744,"kb_used_data":762932,"kb_used_omap":1,"kb_used_meta":644798,"kb_avail":92337408,"statfs":{"total":95995035648,"available":94553505792,"internally_reserved":0,"allocated":781242368,"data_stored":780881348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":660273605},"hb_peers":[0,1,2,3,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,0,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790397,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2538492,"kb_used_data":1863156,"kb_used_omap":1,"kb_used_meta":675326,"kb_avail":91206660,"statfs":{"total":95995035648,"available":93395619840,"internally_reserved":0,"allocated":1907871744,"data_stored":1907510724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":691534277},"hb_peers":[0,1,2,3,4,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":750059520,"data_stored":750059520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1500315648,"data_stored":1500315648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":745078784,"data_stored":745078784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":774897664,"data_stored":774897664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1901854720,"data_stored":1901854720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":384176128,"data_stored":384172056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":1161101312,"data_stored":1161101312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":1139277824,"data_stored":1139277824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":2534604800,"data_stored":2534604800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":1912410112,"data_stored":1912406040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:57:12.343 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:57:12.409 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:57:12.441 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:12.467 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:57:12.470 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:12.471 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:57:12.572 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:57:12.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:12 smithi022 ceph-mon[39439]: from='client.37244 v1:172.21.15.22:0/3669657029' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:57:12.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:12 smithi022 ceph-mon[39439]: pgmap v1906: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.5 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 785 op/s; 28276/180274 objects degraded (15.685%); 14 MiB/s, 223 objects/s recovering 2024-04-01T19:57:12.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:12 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:57:12.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:12 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3168655245' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:57:12.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:12 smithi022 ceph-mon[39439]: osdmap e697: 12 total, 11 up, 10 in 2024-04-01T19:57:12.613 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:12 smithi188 ceph-mon[43939]: from='client.37244 v1:172.21.15.22:0/3669657029' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:57:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:12 smithi188 ceph-mon[43939]: pgmap v1906: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.5 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 785 op/s; 28276/180274 objects degraded (15.685%); 14 MiB/s, 223 objects/s recovering 2024-04-01T19:57:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:12 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:57:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:12 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3168655245' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:57:12.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:12 smithi188 ceph-mon[43939]: osdmap e697: 12 total, 11 up, 10 in 2024-04-01T19:57:12.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:12 smithi062 ceph-mon[44211]: from='client.37244 v1:172.21.15.22:0/3669657029' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:57:12.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:12 smithi062 ceph-mon[44211]: pgmap v1906: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.5 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 785 op/s; 28276/180274 objects degraded (15.685%); 14 MiB/s, 223 objects/s recovering 2024-04-01T19:57:12.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:12 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:57:12.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:12 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3168655245' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:57:12.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:12 smithi062 ceph-mon[44211]: osdmap e697: 12 total, 11 up, 10 in 2024-04-01T19:57:13.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:13 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:57:13.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:13 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:57:13.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:13 smithi022 ceph-mon[39439]: osdmap e698: 12 total, 11 up, 10 in 2024-04-01T19:57:13.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:13 smithi022 ceph-mon[39439]: pgmap v1909: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.5 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 525 op/s; 28033/179426 objects degraded (15.624%); 9.4 MiB/s, 150 objects/s recovering 2024-04-01T19:57:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:13 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:57:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:13 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:57:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:13 smithi188 ceph-mon[43939]: osdmap e698: 12 total, 11 up, 10 in 2024-04-01T19:57:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:13 smithi188 ceph-mon[43939]: pgmap v1909: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.5 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 525 op/s; 28033/179426 objects degraded (15.624%); 9.4 MiB/s, 150 objects/s recovering 2024-04-01T19:57:14.183 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:13 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:57:14.183 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:13 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:57:14.183 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:13 smithi062 ceph-mon[44211]: osdmap e698: 12 total, 11 up, 10 in 2024-04-01T19:57:14.183 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:13 smithi062 ceph-mon[44211]: pgmap v1909: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.5 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 525 op/s; 28033/179426 objects degraded (15.624%); 9.4 MiB/s, 150 objects/s recovering 2024-04-01T19:57:15.268 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:57:15.272 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:15.272 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:57:15.373 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:57:15.409 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:15.769 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:57:15.775 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:15.775 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:57:15.806 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:57:15.876 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:57:15.925 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:15.956 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:57:15.962 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:15.962 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:57:16.063 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:57:16.104 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:16.136 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:57:16.140 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:16.140 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:57:16.241 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:57:16.287 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:16.319 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:57:16.319 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 20, 2024-04-01T19:57:16.319 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 600, 2024-04-01T19:57:16.319 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:57:16.319 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.319 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:222722 6.3 6:c873d116:::benchmark_data_smithi188_134454_object65981:head [delete] snapc 0=[] ondisk+write+known_if_redirected e522)", 2024-04-01T19:57:16.319 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:47:23.726021+0000", 2024-04-01T19:57:16.319 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 592.58958036299998, 2024-04-01T19:57:16.320 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.10164761999999999, 2024-04-01T19:57:16.320 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:57:16.320 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:57:16.320 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:57:16.320 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:57:16.320 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:57:16.320 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:57:16.320 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 222722 2024-04-01T19:57:16.320 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.320 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:57:16.320 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.320 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:57:16.321 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.726021+0000", 2024-04-01T19:57:16.321 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.321 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.321 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.321 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:57:16.321 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.726021+0000", 2024-04-01T19:57:16.321 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.321 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.321 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.321 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:57:16.321 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.726023+0000", 2024-04-01T19:57:16.322 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.389e-06 2024-04-01T19:57:16.322 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.322 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.322 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:57:16.322 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.726027+0000", 2024-04-01T19:57:16.322 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6990000000000002e-06 2024-04-01T19:57:16.322 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.322 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.322 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:57:16.322 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.726035+0000", 2024-04-01T19:57:16.322 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9659999999999996e-06 2024-04-01T19:57:16.322 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.322 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.323 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:57:16.323 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.726043+0000", 2024-04-01T19:57:16.323 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.2899999999999997e-06 2024-04-01T19:57:16.323 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.323 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.323 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:57:16.323 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.735110+0000", 2024-04-01T19:57:16.323 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0090677229999999998 2024-04-01T19:57:16.323 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.323 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.323 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:57:16.323 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.735223+0000", 2024-04-01T19:57:16.323 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000112629 2024-04-01T19:57:16.324 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.324 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.324 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 6", 2024-04-01T19:57:16.324 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.735333+0000", 2024-04-01T19:57:16.324 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000110302 2024-04-01T19:57:16.324 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.324 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.324 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:57:16.324 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.808821+0000", 2024-04-01T19:57:16.324 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.073487989000000004 2024-04-01T19:57:16.324 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.324 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.324 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:57:16.324 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.827553+0000", 2024-04-01T19:57:16.324 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.018731379999999999 2024-04-01T19:57:16.325 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.325 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.325 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:57:16.325 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.827604+0000", 2024-04-01T19:57:16.325 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1873999999999998e-05 2024-04-01T19:57:16.325 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.325 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.325 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:57:16.325 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.827669+0000", 2024-04-01T19:57:16.325 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.4379000000000001e-05 2024-04-01T19:57:16.325 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.325 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:57:16.325 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.326 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.326 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.326 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.26287.0:222723 6.b e522/469 6:dbb8954d:::benchmark_data_smithi188_134454_object65982:head v 522'13803, mlcod=522'13800)", 2024-04-01T19:57:16.326 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:47:23.732813+0000", 2024-04-01T19:57:16.326 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 592.58278840399998, 2024-04-01T19:57:16.326 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.087701936999999994, 2024-04-01T19:57:16.326 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:57:16.326 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:57:16.326 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:57:16.326 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:57:16.326 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.326 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:57:16.326 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.732813+0000", 2024-04-01T19:57:16.327 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.327 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.327 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.327 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:57:16.327 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.732813+0000", 2024-04-01T19:57:16.327 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.327 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.327 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.327 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:57:16.327 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.732815+0000", 2024-04-01T19:57:16.327 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.5409999999999999e-06 2024-04-01T19:57:16.327 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.327 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.327 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:57:16.327 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.732824+0000", 2024-04-01T19:57:16.327 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.4550000000000001e-06 2024-04-01T19:57:16.328 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.328 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.328 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:57:16.328 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.732836+0000", 2024-04-01T19:57:16.328 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1925e-05 2024-04-01T19:57:16.328 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.328 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.328 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:57:16.328 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.732842+0000", 2024-04-01T19:57:16.328 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5659999999999997e-06 2024-04-01T19:57:16.328 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.328 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.328 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:57:16.328 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.735124+0000", 2024-04-01T19:57:16.329 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0022823800000000001 2024-04-01T19:57:16.329 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.329 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.329 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:57:16.329 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.735144+0000", 2024-04-01T19:57:16.329 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.0129e-05 2024-04-01T19:57:16.329 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.329 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.329 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:57:16.329 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.820474+0000", 2024-04-01T19:57:16.329 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.085329505 2024-04-01T19:57:16.329 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.330 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.330 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:57:16.330 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.820515+0000", 2024-04-01T19:57:16.330 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.1436000000000001e-05 2024-04-01T19:57:16.330 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.330 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:57:16.330 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.330 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.330 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.330 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:222729 6.3 6:c106bad3:::benchmark_data_smithi188_134454_object65988:head [delete] snapc 0=[] ondisk+write+known_if_redirected e522)", 2024-04-01T19:57:16.330 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:47:23.732865+0000", 2024-04-01T19:57:16.330 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 592.58273647800002, 2024-04-01T19:57:16.330 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.099954187, 2024-04-01T19:57:16.331 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:57:16.331 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:57:16.331 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:57:16.331 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:57:16.331 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:57:16.331 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:57:16.331 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 222729 2024-04-01T19:57:16.331 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.331 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:57:16.331 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.331 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:57:16.331 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.732865+0000", 2024-04-01T19:57:16.331 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.332 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.332 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.332 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:57:16.332 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.732865+0000", 2024-04-01T19:57:16.332 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.332 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.332 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.332 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:57:16.332 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.732867+0000", 2024-04-01T19:57:16.332 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8509999999999999e-06 2024-04-01T19:57:16.332 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.332 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.332 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:57:16.332 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.732873+0000", 2024-04-01T19:57:16.333 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6829999999999996e-06 2024-04-01T19:57:16.333 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.333 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.333 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:57:16.333 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.732881+0000", 2024-04-01T19:57:16.333 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9160000000000001e-06 2024-04-01T19:57:16.333 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.333 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.333 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:57:16.333 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.732886+0000", 2024-04-01T19:57:16.333 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0030000000000002e-06 2024-04-01T19:57:16.333 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.333 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.333 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:57:16.333 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.740496+0000", 2024-04-01T19:57:16.334 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0076100530000000003 2024-04-01T19:57:16.334 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.334 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.334 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:57:16.334 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.740598+0000", 2024-04-01T19:57:16.334 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00010225699999999999 2024-04-01T19:57:16.334 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.334 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.334 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 6", 2024-04-01T19:57:16.334 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.740712+0000", 2024-04-01T19:57:16.335 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000113851 2024-04-01T19:57:16.335 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.335 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.335 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:57:16.335 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.809131+0000", 2024-04-01T19:57:16.335 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.068418988 2024-04-01T19:57:16.335 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.335 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.335 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:57:16.335 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.832693+0000", 2024-04-01T19:57:16.335 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.023562118 2024-04-01T19:57:16.335 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.335 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.335 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:57:16.336 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.832746+0000", 2024-04-01T19:57:16.336 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3251999999999998e-05 2024-04-01T19:57:16.336 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.336 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.336 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:57:16.336 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.832819+0000", 2024-04-01T19:57:16.336 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.3214999999999996e-05 2024-04-01T19:57:16.336 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.336 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:57:16.336 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.336 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.336 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.337 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.26287.0:222741 6.b e522/469 6:d9737e32:::benchmark_data_smithi188_134454_object66000:head v 522'13804, mlcod=522'13800)", 2024-04-01T19:57:16.337 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:47:23.745491+0000", 2024-04-01T19:57:16.337 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 592.57011063200002, 2024-04-01T19:57:16.337 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.087368582, 2024-04-01T19:57:16.337 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:57:16.337 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:57:16.337 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:57:16.337 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:57:16.337 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.337 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:57:16.337 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.745491+0000", 2024-04-01T19:57:16.337 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.337 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.338 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.338 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:57:16.338 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.745491+0000", 2024-04-01T19:57:16.338 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.338 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.338 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.338 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:57:16.338 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.745492+0000", 2024-04-01T19:57:16.338 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1699999999999997e-07 2024-04-01T19:57:16.338 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.338 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.338 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:57:16.338 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.745499+0000", 2024-04-01T19:57:16.338 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9210000000000003e-06 2024-04-01T19:57:16.338 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.339 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.339 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:57:16.339 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.745508+0000", 2024-04-01T19:57:16.339 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1020000000000003e-06 2024-04-01T19:57:16.339 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.339 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.339 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:57:16.339 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.745513+0000", 2024-04-01T19:57:16.339 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.626e-06 2024-04-01T19:57:16.339 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.339 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.339 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:57:16.339 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.808850+0000", 2024-04-01T19:57:16.339 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.063337122999999995 2024-04-01T19:57:16.340 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.340 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.340 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:57:16.340 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.808869+0000", 2024-04-01T19:57:16.340 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8899999999999999e-05 2024-04-01T19:57:16.340 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.340 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.340 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:57:16.340 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.832828+0000", 2024-04-01T19:57:16.340 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.023958765999999999 2024-04-01T19:57:16.340 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.340 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.340 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:57:16.340 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.832859+0000", 2024-04-01T19:57:16.340 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.1427000000000003e-05 2024-04-01T19:57:16.341 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.341 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:57:16.341 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.341 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.341 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.341 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:222742 6.3 6:c95d6b5e:::benchmark_data_smithi188_134454_object66001:head [delete] snapc 0=[] ondisk+write+known_if_redirected e522)", 2024-04-01T19:57:16.341 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:47:23.745588+0000", 2024-04-01T19:57:16.341 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 592.57001324700002, 2024-04-01T19:57:16.341 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.093380164000000002, 2024-04-01T19:57:16.341 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:57:16.341 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:57:16.341 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:57:16.341 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:57:16.341 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:57:16.341 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:57:16.341 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 222742 2024-04-01T19:57:16.342 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.342 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:57:16.342 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.342 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:57:16.342 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.745588+0000", 2024-04-01T19:57:16.342 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.342 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.342 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.342 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:57:16.342 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.745588+0000", 2024-04-01T19:57:16.342 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.342 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.342 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.343 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:57:16.343 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.745590+0000", 2024-04-01T19:57:16.343 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.9429999999999999e-06 2024-04-01T19:57:16.343 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.343 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.343 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:57:16.343 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.745595+0000", 2024-04-01T19:57:16.343 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7809999999999996e-06 2024-04-01T19:57:16.343 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.343 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.343 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:57:16.343 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.745604+0000", 2024-04-01T19:57:16.343 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1460000000000002e-06 2024-04-01T19:57:16.344 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.344 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.344 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:57:16.344 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.745611+0000", 2024-04-01T19:57:16.344 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.08e-06 2024-04-01T19:57:16.344 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.344 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.344 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:57:16.344 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.818199+0000", 2024-04-01T19:57:16.344 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.072587873999999997 2024-04-01T19:57:16.344 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.344 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.344 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:57:16.344 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.818316+0000", 2024-04-01T19:57:16.344 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000116966 2024-04-01T19:57:16.345 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.345 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.345 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 6", 2024-04-01T19:57:16.345 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.818436+0000", 2024-04-01T19:57:16.345 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000120066 2024-04-01T19:57:16.345 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.345 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.345 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:57:16.345 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.832909+0000", 2024-04-01T19:57:16.345 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.014472483 2024-04-01T19:57:16.345 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.345 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.345 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:57:16.345 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.838833+0000", 2024-04-01T19:57:16.345 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0059241169999999996 2024-04-01T19:57:16.346 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.346 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.346 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:57:16.346 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.838900+0000", 2024-04-01T19:57:16.346 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.7434999999999994e-05 2024-04-01T19:57:16.346 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.346 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.346 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:57:16.346 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:23.838968+0000", 2024-04-01T19:57:16.346 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8273000000000002e-05 2024-04-01T19:57:16.346 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.346 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:57:16.346 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.346 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.346 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.346 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26287.0:225477 6.3 6:c55f12d7:::benchmark_data_smithi188_134454_object68736:head [delete] snapc 0=[] ondisk+write+known_if_redirected e523)", 2024-04-01T19:57:16.347 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:47:26.389218+0000", 2024-04-01T19:57:16.347 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 589.92638335699996, 2024-04-01T19:57:16.347 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.099156575999999996, 2024-04-01T19:57:16.347 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:57:16.347 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:57:16.347 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:57:16.347 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:57:16.347 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26287", 2024-04-01T19:57:16.347 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/3418904510", 2024-04-01T19:57:16.347 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 225477 2024-04-01T19:57:16.347 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.347 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:57:16.347 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.347 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:57:16.347 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.389218+0000", 2024-04-01T19:57:16.348 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.348 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.348 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.348 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:57:16.348 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.389218+0000", 2024-04-01T19:57:16.348 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.348 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.348 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.348 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:57:16.348 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.389222+0000", 2024-04-01T19:57:16.348 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3050000000000003e-06 2024-04-01T19:57:16.348 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.348 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.348 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:57:16.348 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.389227+0000", 2024-04-01T19:57:16.349 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0110000000000002e-06 2024-04-01T19:57:16.349 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.349 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.349 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:57:16.349 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.389235+0000", 2024-04-01T19:57:16.349 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0830000000000004e-06 2024-04-01T19:57:16.349 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.349 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.349 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:57:16.349 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.389244+0000", 2024-04-01T19:57:16.349 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1859999999999998e-06 2024-04-01T19:57:16.349 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.349 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.349 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:57:16.349 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.389335+0000", 2024-04-01T19:57:16.350 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1570000000000006e-05 2024-04-01T19:57:16.350 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.350 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.350 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting_for_map not empty", 2024-04-01T19:57:16.350 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.389341+0000", 2024-04-01T19:57:16.350 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.322e-06 2024-04-01T19:57:16.350 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.350 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.350 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:57:16.350 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.462724+0000", 2024-04-01T19:57:16.350 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.073383637000000002 2024-04-01T19:57:16.350 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.350 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.350 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:57:16.350 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.462838+0000", 2024-04-01T19:57:16.351 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000113626 2024-04-01T19:57:16.351 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.351 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.351 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 6", 2024-04-01T19:57:16.351 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.462943+0000", 2024-04-01T19:57:16.351 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00010527300000000001 2024-04-01T19:57:16.351 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.351 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.351 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:57:16.351 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.474886+0000", 2024-04-01T19:57:16.351 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.011943103 2024-04-01T19:57:16.351 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.351 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.351 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:57:16.351 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.488279+0000", 2024-04-01T19:57:16.352 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.013393149999999999 2024-04-01T19:57:16.352 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.352 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.352 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:57:16.352 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.488329+0000", 2024-04-01T19:57:16.352 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0022999999999999e-05 2024-04-01T19:57:16.352 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.352 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.352 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:57:16.352 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:47:26.488375+0000", 2024-04-01T19:57:16.352 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.5287000000000002e-05 2024-04-01T19:57:16.352 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.352 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:57:16.352 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.352 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.352 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.353 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.36668.0:283496 7.8 e607/560 7:1acd3fdc:::benchmark_data_smithi188_147022_object113852:head v 607'17825, mlcod=607'17821)", 2024-04-01T19:57:16.353 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:52:45.763708+0000", 2024-04-01T19:57:16.353 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 270.55189356900001, 2024-04-01T19:57:16.353 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.032190860000000002, 2024-04-01T19:57:16.353 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:57:16.353 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:57:16.353 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:57:16.353 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:57:16.353 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.353 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:57:16.353 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:45.763708+0000", 2024-04-01T19:57:16.353 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.353 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.353 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.353 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:57:16.354 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:45.763708+0000", 2024-04-01T19:57:16.354 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.354 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.354 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.354 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:57:16.354 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:45.763709+0000", 2024-04-01T19:57:16.354 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.187e-06 2024-04-01T19:57:16.354 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.354 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.354 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:57:16.354 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:45.763716+0000", 2024-04-01T19:57:16.354 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1369999999999996e-06 2024-04-01T19:57:16.354 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.354 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.354 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:57:16.354 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:45.763725+0000", 2024-04-01T19:57:16.355 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.2810000000000008e-06 2024-04-01T19:57:16.355 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.355 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.355 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:57:16.355 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:45.763731+0000", 2024-04-01T19:57:16.355 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.0950000000000001e-06 2024-04-01T19:57:16.355 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.355 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.355 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:57:16.355 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:45.767431+0000", 2024-04-01T19:57:16.355 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0037007910000000001 2024-04-01T19:57:16.355 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.355 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.355 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:57:16.355 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:45.767452+0000", 2024-04-01T19:57:16.356 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.0608e-05 2024-04-01T19:57:16.356 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.356 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.356 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:57:16.356 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:45.795852+0000", 2024-04-01T19:57:16.356 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.02839993 2024-04-01T19:57:16.356 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.356 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.356 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:57:16.356 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:45.795899+0000", 2024-04-01T19:57:16.356 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6830999999999999e-05 2024-04-01T19:57:16.356 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.356 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:57:16.356 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.357 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.357 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.357 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.36668.0:283497 7.8 e607/560 7:185259b0:::benchmark_data_smithi188_147022_object113853:head v 607'17826, mlcod=607'17821)", 2024-04-01T19:57:16.357 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:52:45.768635+0000", 2024-04-01T19:57:16.357 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 270.54696626499998, 2024-04-01T19:57:16.357 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.035957531000000001, 2024-04-01T19:57:16.357 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:57:16.357 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:57:16.357 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:57:16.357 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:57:16.357 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.357 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:57:16.357 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:45.768635+0000", 2024-04-01T19:57:16.357 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.357 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.358 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.358 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:57:16.358 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:45.768635+0000", 2024-04-01T19:57:16.358 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.358 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.358 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.358 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:57:16.358 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:45.768637+0000", 2024-04-01T19:57:16.358 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.6589999999999999e-06 2024-04-01T19:57:16.358 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.358 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.358 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:57:16.358 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:45.768647+0000", 2024-04-01T19:57:16.358 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.7100000000000002e-06 2024-04-01T19:57:16.358 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.358 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.359 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:57:16.359 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:45.768660+0000", 2024-04-01T19:57:16.359 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3101999999999999e-05 2024-04-01T19:57:16.359 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.359 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.359 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:57:16.359 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:45.768668+0000", 2024-04-01T19:57:16.359 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.1899999999999995e-06 2024-04-01T19:57:16.359 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.359 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.359 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:57:16.359 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:45.774883+0000", 2024-04-01T19:57:16.359 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0062152209999999999 2024-04-01T19:57:16.359 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.359 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.360 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:57:16.360 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:45.774903+0000", 2024-04-01T19:57:16.360 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.0060000000000001e-05 2024-04-01T19:57:16.360 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.360 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.360 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:57:16.360 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:45.804539+0000", 2024-04-01T19:57:16.360 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.029635723999999999 2024-04-01T19:57:16.360 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.360 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.360 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:57:16.360 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:45.804593+0000", 2024-04-01T19:57:16.360 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3865e-05 2024-04-01T19:57:16.360 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.360 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:57:16.361 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.361 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.361 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.361 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.26983.0:160188 8.6 e688/687 8:6f504b3a:::benchmark_data_smithi188_161190_object20906:head v 688'9993, mlcod=642'1312)", 2024-04-01T19:57:16.361 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:23.940914+0000", 2024-04-01T19:57:16.361 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 52.374687887, 2024-04-01T19:57:16.361 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.035302045999999997, 2024-04-01T19:57:16.361 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:57:16.361 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:57:16.361 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:57:16.361 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:57:16.361 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.361 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:57:16.361 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:23.940914+0000", 2024-04-01T19:57:16.361 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.361 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.362 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.362 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:57:16.362 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:23.940914+0000", 2024-04-01T19:57:16.362 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.362 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.362 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.362 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:57:16.362 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:23.940915+0000", 2024-04-01T19:57:16.362 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.094e-06 2024-04-01T19:57:16.362 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.362 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.362 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:57:16.362 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:23.940922+0000", 2024-04-01T19:57:16.363 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.2690000000000002e-06 2024-04-01T19:57:16.363 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.363 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.363 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:57:16.363 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:23.940929+0000", 2024-04-01T19:57:16.363 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.3889999999999999e-06 2024-04-01T19:57:16.363 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.363 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.363 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:57:16.363 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:23.940936+0000", 2024-04-01T19:57:16.363 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.1929999999999998e-06 2024-04-01T19:57:16.363 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.363 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.363 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:57:16.363 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:23.943793+0000", 2024-04-01T19:57:16.364 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0028576880000000002 2024-04-01T19:57:16.364 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.364 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.364 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:57:16.364 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:23.943811+0000", 2024-04-01T19:57:16.364 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.7275999999999999e-05 2024-04-01T19:57:16.364 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.364 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.364 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:57:16.364 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:23.976174+0000", 2024-04-01T19:57:16.364 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.032363534999999999 2024-04-01T19:57:16.364 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.364 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.365 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:57:16.365 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:23.976216+0000", 2024-04-01T19:57:16.365 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.1601999999999999e-05 2024-04-01T19:57:16.365 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.365 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:57:16.365 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.365 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.365 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.365 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.26983.0:162329 8.6 e689/687 8:643144e0:::benchmark_data_smithi188_161190_object23047:head v 689'10118, mlcod=642'1432)", 2024-04-01T19:57:16.365 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:27.783214+0000", 2024-04-01T19:57:16.365 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 48.532388019000003, 2024-04-01T19:57:16.365 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.044482739, 2024-04-01T19:57:16.365 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:57:16.366 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:57:16.366 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:57:16.366 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:57:16.366 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.366 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:57:16.366 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.783214+0000", 2024-04-01T19:57:16.366 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.366 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.366 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.366 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:57:16.366 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.783214+0000", 2024-04-01T19:57:16.366 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.366 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.367 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.367 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:57:16.367 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.783215+0000", 2024-04-01T19:57:16.367 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.593e-06 2024-04-01T19:57:16.367 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.367 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.367 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:57:16.367 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.783223+0000", 2024-04-01T19:57:16.367 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9500000000000001e-06 2024-04-01T19:57:16.367 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.367 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.367 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:57:16.367 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.783235+0000", 2024-04-01T19:57:16.367 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2432000000000001e-05 2024-04-01T19:57:16.368 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.368 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.368 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:57:16.368 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.783242+0000", 2024-04-01T19:57:16.368 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6460000000000004e-06 2024-04-01T19:57:16.368 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.368 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.368 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:57:16.368 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.792309+0000", 2024-04-01T19:57:16.368 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0090671580000000005 2024-04-01T19:57:16.368 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.368 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.368 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:57:16.368 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.792327+0000", 2024-04-01T19:57:16.368 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.7989e-05 2024-04-01T19:57:16.369 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.369 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.369 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:57:16.369 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.827644+0000", 2024-04-01T19:57:16.369 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.035316473000000001 2024-04-01T19:57:16.369 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.369 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.369 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:57:16.369 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.827696+0000", 2024-04-01T19:57:16.369 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2497999999999998e-05 2024-04-01T19:57:16.369 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.369 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:57:16.369 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.369 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.370 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.370 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.26983.0:162332 8.6 e689/687 8:62109575:::benchmark_data_smithi188_161190_object23050:head v 689'10119, mlcod=642'1432)", 2024-04-01T19:57:16.370 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:27.792916+0000", 2024-04-01T19:57:16.370 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 48.522685551000002, 2024-04-01T19:57:16.370 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.034811462000000001, 2024-04-01T19:57:16.370 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:57:16.370 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:57:16.370 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:57:16.370 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:57:16.370 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.370 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:57:16.370 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.792916+0000", 2024-04-01T19:57:16.370 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.370 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.371 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.371 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:57:16.371 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.792916+0000", 2024-04-01T19:57:16.371 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.371 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.371 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.371 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:57:16.371 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.792917+0000", 2024-04-01T19:57:16.371 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.423e-06 2024-04-01T19:57:16.371 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.371 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.371 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:57:16.371 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.792924+0000", 2024-04-01T19:57:16.372 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2890000000000003e-06 2024-04-01T19:57:16.372 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.372 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.372 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:57:16.372 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.792933+0000", 2024-04-01T19:57:16.372 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1859999999999998e-06 2024-04-01T19:57:16.372 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.372 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.372 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:57:16.372 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.792940+0000", 2024-04-01T19:57:16.372 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.7129999999999999e-06 2024-04-01T19:57:16.372 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.372 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.373 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:57:16.373 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.799981+0000", 2024-04-01T19:57:16.373 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0070418340000000003 2024-04-01T19:57:16.373 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.373 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.373 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:57:16.373 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.800000+0000", 2024-04-01T19:57:16.373 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8805e-05 2024-04-01T19:57:16.373 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.373 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.373 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:57:16.373 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.827701+0000", 2024-04-01T19:57:16.373 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.027700415999999999 2024-04-01T19:57:16.373 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.374 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.374 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:57:16.374 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.827727+0000", 2024-04-01T19:57:16.374 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.6795999999999999e-05 2024-04-01T19:57:16.374 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.374 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:57:16.374 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.374 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.374 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.374 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.26983.0:162346 8.6 e689/687 8:68b9f67a:::benchmark_data_smithi188_161190_object23064:head v 689'10120, mlcod=642'1432)", 2024-04-01T19:57:16.374 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:27.794082+0000", 2024-04-01T19:57:16.374 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 48.521519662999999, 2024-04-01T19:57:16.374 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.03369983, 2024-04-01T19:57:16.375 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:57:16.375 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:57:16.375 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:57:16.375 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:57:16.375 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.375 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:57:16.375 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.794082+0000", 2024-04-01T19:57:16.375 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.375 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.375 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.375 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:57:16.375 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.794082+0000", 2024-04-01T19:57:16.375 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.375 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.376 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.376 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:57:16.376 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.794083+0000", 2024-04-01T19:57:16.376 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.415e-06 2024-04-01T19:57:16.376 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.376 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.376 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:57:16.376 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.794091+0000", 2024-04-01T19:57:16.376 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.4719999999999998e-06 2024-04-01T19:57:16.376 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.376 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.376 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:57:16.376 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.794101+0000", 2024-04-01T19:57:16.377 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0382e-05 2024-04-01T19:57:16.377 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.377 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.377 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:57:16.377 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.794108+0000", 2024-04-01T19:57:16.377 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.3100000000000003e-06 2024-04-01T19:57:16.377 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.377 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.377 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:57:16.377 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.810008+0000", 2024-04-01T19:57:16.377 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.015899261000000001 2024-04-01T19:57:16.377 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.377 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.377 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:57:16.378 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.810029+0000", 2024-04-01T19:57:16.378 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1208000000000001e-05 2024-04-01T19:57:16.378 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.378 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.378 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:57:16.378 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.827733+0000", 2024-04-01T19:57:16.378 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.017704180999999999 2024-04-01T19:57:16.378 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.378 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.378 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:57:16.378 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:27.827782+0000", 2024-04-01T19:57:16.378 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8600999999999998e-05 2024-04-01T19:57:16.378 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.378 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:57:16.379 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.379 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.379 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.379 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "MOSDPGPush(8.6 690/687 [PushOp(8:6a2770ae:::benchmark_data_smithi188_161190_object32326:head, version: 647'2030, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(8:6a2770ae:::benchmark_data_smithi188_161190_object32326:head@647'2030, size: 65536, copy_subset: [(0, 65536)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 65536, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-04-01T19:57:16.379 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:43.342098+0000", 2024-04-01T19:57:16.379 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 32.973503213000001, 2024-04-01T19:57:16.379 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.042696848000000003, 2024-04-01T19:57:16.379 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:57:16.379 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:57:16.379 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "started", 2024-04-01T19:57:16.379 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:57:16.379 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.379 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:57:16.379 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:43.342098+0000", 2024-04-01T19:57:16.380 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.380 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.380 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.380 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:57:16.380 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:43.342098+0000", 2024-04-01T19:57:16.380 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.380 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.380 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.380 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:57:16.380 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:43.342100+0000", 2024-04-01T19:57:16.380 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1790000000000001e-06 2024-04-01T19:57:16.380 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.380 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.380 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:57:16.381 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:43.342221+0000", 2024-04-01T19:57:16.381 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000121216 2024-04-01T19:57:16.381 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.381 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.381 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:57:16.381 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:43.342234+0000", 2024-04-01T19:57:16.381 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3456e-05 2024-04-01T19:57:16.381 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.381 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.381 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:57:16.381 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:43.342245+0000", 2024-04-01T19:57:16.381 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0363000000000001e-05 2024-04-01T19:57:16.381 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.382 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.382 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:57:16.382 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:43.362271+0000", 2024-04-01T19:57:16.382 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.020026371000000001 2024-04-01T19:57:16.382 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.382 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.382 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:57:16.382 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:43.362279+0000", 2024-04-01T19:57:16.382 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9119999999999998e-06 2024-04-01T19:57:16.382 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.382 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.383 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:57:16.383 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:43.384795+0000", 2024-04-01T19:57:16.383 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.022516351 2024-04-01T19:57:16.383 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.383 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:57:16.383 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.383 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.383 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.383 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.26983.0:172584 8.6 e690/687 8:610177ed:::benchmark_data_smithi188_161190_object33302:head v 690'10778, mlcod=647'2097)", 2024-04-01T19:57:16.383 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:45.093304+0000", 2024-04-01T19:57:16.383 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 31.22229772, 2024-04-01T19:57:16.383 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.032904042000000001, 2024-04-01T19:57:16.383 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:57:16.383 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:57:16.383 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:57:16.384 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:57:16.384 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.384 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:57:16.384 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.093304+0000", 2024-04-01T19:57:16.384 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.384 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.384 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.384 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:57:16.384 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.093304+0000", 2024-04-01T19:57:16.384 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.384 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.384 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.384 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:57:16.384 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.093306+0000", 2024-04-01T19:57:16.384 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.2400000000000002e-06 2024-04-01T19:57:16.385 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.385 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.385 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:57:16.385 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.093325+0000", 2024-04-01T19:57:16.385 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.9168e-05 2024-04-01T19:57:16.385 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.385 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.385 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:57:16.385 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.093343+0000", 2024-04-01T19:57:16.385 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.7285000000000001e-05 2024-04-01T19:57:16.385 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.385 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.385 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:57:16.385 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.093352+0000", 2024-04-01T19:57:16.386 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.3009999999999995e-06 2024-04-01T19:57:16.386 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.386 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.386 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:57:16.386 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.093413+0000", 2024-04-01T19:57:16.386 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.0948e-05 2024-04-01T19:57:16.386 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.386 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.386 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:57:16.386 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.093434+0000", 2024-04-01T19:57:16.386 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1435000000000001e-05 2024-04-01T19:57:16.386 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.386 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.386 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:57:16.386 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.126153+0000", 2024-04-01T19:57:16.387 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.032718499999999998 2024-04-01T19:57:16.387 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.387 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.387 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:57:16.387 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.126208+0000", 2024-04-01T19:57:16.387 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5164999999999998e-05 2024-04-01T19:57:16.387 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.387 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:57:16.387 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.387 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.387 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.387 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.26983.0:172615 8.6 e690/687 8:61ba0dc3:::benchmark_data_smithi188_161190_object33333:head v 690'10781, mlcod=647'2097)", 2024-04-01T19:57:16.387 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:45.106370+0000", 2024-04-01T19:57:16.387 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 31.209231943999999, 2024-04-01T19:57:16.388 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.046897791000000001, 2024-04-01T19:57:16.388 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:57:16.388 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:57:16.388 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:57:16.388 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:57:16.388 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.388 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:57:16.388 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.106370+0000", 2024-04-01T19:57:16.388 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.388 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.388 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.388 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:57:16.388 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.106370+0000", 2024-04-01T19:57:16.388 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.389 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.389 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.389 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:57:16.389 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.106373+0000", 2024-04-01T19:57:16.389 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.0400000000000001e-06 2024-04-01T19:57:16.389 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.389 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.389 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:57:16.389 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.106384+0000", 2024-04-01T19:57:16.389 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.13e-05 2024-04-01T19:57:16.389 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.389 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.389 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:57:16.389 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.106399+0000", 2024-04-01T19:57:16.390 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4792e-05 2024-04-01T19:57:16.390 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.390 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.390 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:57:16.390 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.106408+0000", 2024-04-01T19:57:16.390 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1090000000000004e-06 2024-04-01T19:57:16.390 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.390 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.390 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:57:16.390 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.135021+0000", 2024-04-01T19:57:16.390 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.028612822 2024-04-01T19:57:16.391 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.391 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.391 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:57:16.391 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.135052+0000", 2024-04-01T19:57:16.391 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.0877000000000003e-05 2024-04-01T19:57:16.391 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.391 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.391 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:57:16.391 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.153231+0000", 2024-04-01T19:57:16.391 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.018179807999999999 2024-04-01T19:57:16.391 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.391 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.391 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:57:16.391 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.153267+0000", 2024-04-01T19:57:16.391 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.6043e-05 2024-04-01T19:57:16.392 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.392 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:57:16.392 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.392 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.392 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.392 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.26983.0:173071 8.6 e690/687 8:6b6639f4:::benchmark_data_smithi188_161190_object33789:head v 690'10812, mlcod=647'2127)", 2024-04-01T19:57:16.392 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:45.845444+0000", 2024-04-01T19:57:16.392 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 30.470157552, 2024-04-01T19:57:16.392 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.036016052, 2024-04-01T19:57:16.392 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:57:16.392 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:57:16.392 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:57:16.392 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:57:16.392 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.392 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:57:16.393 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.845444+0000", 2024-04-01T19:57:16.393 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.393 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.393 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.393 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:57:16.393 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.845444+0000", 2024-04-01T19:57:16.393 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.393 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.393 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.393 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:57:16.393 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.845445+0000", 2024-04-01T19:57:16.393 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.091e-06 2024-04-01T19:57:16.393 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.393 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.394 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:57:16.394 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.845451+0000", 2024-04-01T19:57:16.394 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.9959999999999999e-06 2024-04-01T19:57:16.394 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.394 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.394 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:57:16.394 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.845459+0000", 2024-04-01T19:57:16.394 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.3899999999999993e-06 2024-04-01T19:57:16.394 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.394 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.394 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:57:16.394 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.845467+0000", 2024-04-01T19:57:16.394 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.0530000000000001e-06 2024-04-01T19:57:16.394 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.394 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.395 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:57:16.395 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.845522+0000", 2024-04-01T19:57:16.395 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5355000000000001e-05 2024-04-01T19:57:16.395 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.395 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.395 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:57:16.395 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.845549+0000", 2024-04-01T19:57:16.395 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.7007000000000001e-05 2024-04-01T19:57:16.395 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.395 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.395 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:57:16.395 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.881430+0000", 2024-04-01T19:57:16.395 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.035880948000000003 2024-04-01T19:57:16.395 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.395 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.396 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:57:16.396 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:45.881460+0000", 2024-04-01T19:57:16.396 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.0212000000000001e-05 2024-04-01T19:57:16.396 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.396 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:57:16.396 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.396 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.396 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.396 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.26983.0:174043 8.6 e691/687 8:64c202ad:::benchmark_data_smithi188_161190_object34761:head v 691'10872, mlcod=647'2192)", 2024-04-01T19:57:16.396 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:47.515745+0000", 2024-04-01T19:57:16.396 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 28.799856617, 2024-04-01T19:57:16.396 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.038818766999999997, 2024-04-01T19:57:16.396 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:57:16.396 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:57:16.397 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:57:16.397 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:57:16.397 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.397 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:57:16.397 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.515745+0000", 2024-04-01T19:57:16.397 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.397 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.397 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.397 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:57:16.397 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.515745+0000", 2024-04-01T19:57:16.397 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.397 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.397 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.397 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:57:16.397 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.515748+0000", 2024-04-01T19:57:16.398 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8030000000000001e-06 2024-04-01T19:57:16.398 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.398 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.398 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:57:16.398 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.515768+0000", 2024-04-01T19:57:16.398 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.0429e-05 2024-04-01T19:57:16.398 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.398 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.398 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:57:16.398 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.515783+0000", 2024-04-01T19:57:16.398 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.5298000000000002e-05 2024-04-01T19:57:16.398 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.398 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.398 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:57:16.398 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.515794+0000", 2024-04-01T19:57:16.399 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0907000000000001e-05 2024-04-01T19:57:16.399 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.399 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.399 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:57:16.399 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.515855+0000", 2024-04-01T19:57:16.399 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.0327e-05 2024-04-01T19:57:16.399 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.399 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.399 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:57:16.399 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.515876+0000", 2024-04-01T19:57:16.399 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1600999999999999e-05 2024-04-01T19:57:16.399 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.399 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.399 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:57:16.399 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.554503+0000", 2024-04-01T19:57:16.400 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.038626636999999998 2024-04-01T19:57:16.400 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.400 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.400 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:57:16.400 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.554564+0000", 2024-04-01T19:57:16.400 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.0764999999999998e-05 2024-04-01T19:57:16.400 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.400 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:57:16.400 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.400 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.400 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.400 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.26983.0:174059 8.6 e691/687 8:654be06d:::benchmark_data_smithi188_161190_object34777:head v 691'10873, mlcod=647'2192)", 2024-04-01T19:57:16.400 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:47.520907+0000", 2024-04-01T19:57:16.400 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 28.794695020999999, 2024-04-01T19:57:16.401 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.033691028999999997, 2024-04-01T19:57:16.401 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:57:16.401 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:57:16.401 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:57:16.401 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:57:16.401 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.401 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:57:16.401 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.520907+0000", 2024-04-01T19:57:16.401 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.401 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.401 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.401 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:57:16.401 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.520907+0000", 2024-04-01T19:57:16.401 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.401 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.402 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.402 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:57:16.402 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.520909+0000", 2024-04-01T19:57:16.402 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3089999999999998e-06 2024-04-01T19:57:16.402 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.402 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.402 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:57:16.402 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.520920+0000", 2024-04-01T19:57:16.402 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1362999999999999e-05 2024-04-01T19:57:16.402 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.402 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.402 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:57:16.402 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.520934+0000", 2024-04-01T19:57:16.402 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4032000000000001e-05 2024-04-01T19:57:16.403 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.403 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.403 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:57:16.403 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.520943+0000", 2024-04-01T19:57:16.403 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.3690000000000007e-06 2024-04-01T19:57:16.403 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.403 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.403 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:57:16.403 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.524393+0000", 2024-04-01T19:57:16.403 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.003449967 2024-04-01T19:57:16.403 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.403 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.403 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:57:16.403 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.524426+0000", 2024-04-01T19:57:16.404 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.3324999999999997e-05 2024-04-01T19:57:16.404 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.404 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.404 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:57:16.404 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.554569+0000", 2024-04-01T19:57:16.404 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.030142914999999999 2024-04-01T19:57:16.404 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.404 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.404 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:57:16.404 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.554598+0000", 2024-04-01T19:57:16.404 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8748999999999999e-05 2024-04-01T19:57:16.404 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.404 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:57:16.404 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.404 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.405 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.405 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.26983.0:186533 8.6 e696/687 8:629c7a78:::benchmark_data_smithi188_161190_object47251:head v 696'11650, mlcod=649'2969)", 2024-04-01T19:57:16.405 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:57:07.201210+0000", 2024-04-01T19:57:16.405 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 9.1143910550000005, 2024-04-01T19:57:16.405 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.032365360000000003, 2024-04-01T19:57:16.405 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:57:16.405 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:57:16.405 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:57:16.405 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:57:16.405 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.405 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:57:16.405 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:57:07.201210+0000", 2024-04-01T19:57:16.405 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.405 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.406 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.406 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:57:16.406 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:57:07.201210+0000", 2024-04-01T19:57:16.406 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.406 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.406 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.406 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:57:16.406 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:57:07.201212+0000", 2024-04-01T19:57:16.406 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1209999999999999e-06 2024-04-01T19:57:16.406 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.406 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.406 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:57:16.406 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:57:07.201219+0000", 2024-04-01T19:57:16.406 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1160000000000001e-06 2024-04-01T19:57:16.407 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.407 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.407 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:57:16.407 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:57:07.201228+0000", 2024-04-01T19:57:16.407 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.5000000000000005e-06 2024-04-01T19:57:16.407 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.407 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.407 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:57:16.407 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:57:07.201234+0000", 2024-04-01T19:57:16.407 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.0349999999999998e-06 2024-04-01T19:57:16.407 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.407 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.407 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:57:16.407 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:57:07.205090+0000", 2024-04-01T19:57:16.408 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0038561609999999999 2024-04-01T19:57:16.408 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.408 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.408 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:57:16.408 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:57:07.205126+0000", 2024-04-01T19:57:16.408 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.5552000000000001e-05 2024-04-01T19:57:16.408 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.408 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.408 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:57:16.408 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:57:07.233554+0000", 2024-04-01T19:57:16.408 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.028427821999999998 2024-04-01T19:57:16.408 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.408 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.408 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:57:16.408 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:57:07.233576+0000", 2024-04-01T19:57:16.409 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.2053e-05 2024-04-01T19:57:16.409 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.409 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:57:16.409 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.409 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.409 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.409 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop(client.26983.0:186581 8.6 e696/687 8:6738024a:::benchmark_data_smithi188_161190_object47299:head v 696'11655, mlcod=649'2971)", 2024-04-01T19:57:16.409 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:57:07.275731+0000", 2024-04-01T19:57:16.409 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 9.0398704649999999, 2024-04-01T19:57:16.409 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.036412676999999997, 2024-04-01T19:57:16.409 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:57:16.409 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:57:16.409 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:57:16.409 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:57:16.410 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.410 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:57:16.410 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:57:07.275731+0000", 2024-04-01T19:57:16.410 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.410 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.410 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.410 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:57:16.410 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:57:07.275731+0000", 2024-04-01T19:57:16.410 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:57:16.410 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.410 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.410 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:57:16.410 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:57:07.275733+0000", 2024-04-01T19:57:16.411 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.311e-06 2024-04-01T19:57:16.411 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.411 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.411 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:57:16.411 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:57:07.275744+0000", 2024-04-01T19:57:16.411 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1070000000000001e-05 2024-04-01T19:57:16.411 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.411 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.411 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:57:16.411 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:57:07.275758+0000", 2024-04-01T19:57:16.411 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3334e-05 2024-04-01T19:57:16.411 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.411 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.411 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:57:16.411 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:57:07.275777+0000", 2024-04-01T19:57:16.412 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8848e-05 2024-04-01T19:57:16.412 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.412 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.412 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:57:16.412 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:57:07.282543+0000", 2024-04-01T19:57:16.412 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0067663389999999997 2024-04-01T19:57:16.412 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.412 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.412 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:57:16.412 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:57:07.282570+0000", 2024-04-01T19:57:16.412 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.6542000000000001e-05 2024-04-01T19:57:16.412 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.412 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.412 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:57:16.413 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:57:07.312096+0000", 2024-04-01T19:57:16.413 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.029526803000000001 2024-04-01T19:57:16.413 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:57:16.413 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:57:16.413 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:57:16.413 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:57:07.312144+0000", 2024-04-01T19:57:16.413 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7429999999999998e-05 2024-04-01T19:57:16.413 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.413 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:57:16.413 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.413 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:57:16.413 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:57:16.413 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:57:16.414 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:16.414 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:57:16.415 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:57:16.432 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:16 smithi022 ceph-mon[39439]: pgmap v1910: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.5 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 495 op/s; 28033/178682 objects degraded (15.689%); 8.0 MiB/s, 128 objects/s recovering 2024-04-01T19:57:16.432 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:16 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 28033/178682 objects degraded (15.689%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:16.515 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:57:16.557 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:16.586 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:57:16.595 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:16.596 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:57:16.697 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:57:16.732 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:16 smithi062 ceph-mon[44211]: pgmap v1910: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.5 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 495 op/s; 28033/178682 objects degraded (15.689%); 8.0 MiB/s, 128 objects/s recovering 2024-04-01T19:57:16.732 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:16 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 28033/178682 objects degraded (15.689%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:16.735 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:16.766 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:57:16.774 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:16.774 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:57:16.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:16 smithi188 ceph-mon[43939]: pgmap v1910: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.5 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 0 B/s wr, 495 op/s; 28033/178682 objects degraded (15.689%); 8.0 MiB/s, 128 objects/s recovering 2024-04-01T19:57:16.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:16 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 28033/178682 objects degraded (15.689%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:16.876 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:57:16.919 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:17.034 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:57:17.132 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:57:17.132 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:57:17.132 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:57:17.142 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:57:17.167 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:57:17.203 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:57:17.227 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:57:17.266 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:57:17.274 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:57:17.282 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:17.283 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:57:17.306 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:57:17.320 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:57:17.342 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:57:17.345 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:57:17.345 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:57:17.345 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:57:17.345 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:57:17.345 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:57:17.346 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:57:17.346 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:57:17.346 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:57:17.346 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:57:17.346 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:57:17.346 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.10 2024-04-01T19:57:17.346 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:57:17.384 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:57:17.431 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:17.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:17 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:57:17.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:17 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:57:17.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:17 smithi022 ceph-mon[39439]: osdmap e699: 12 total, 11 up, 10 in 2024-04-01T19:57:17.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:17 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3193370243' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:57:17.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:17 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:17.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:17 smithi022 ceph-mon[39439]: pgmap v1912: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.3 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 594 op/s; 26967/173134 objects degraded (15.576%); 14 MiB/s, 218 objects/s recovering 2024-04-01T19:57:17.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:17 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:57:17.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:17 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:57:17.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:17 smithi062 ceph-mon[44211]: osdmap e699: 12 total, 11 up, 10 in 2024-04-01T19:57:17.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:17 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3193370243' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:57:17.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:17 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:17.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:17 smithi062 ceph-mon[44211]: pgmap v1912: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.3 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 594 op/s; 26967/173134 objects degraded (15.576%); 14 MiB/s, 218 objects/s recovering 2024-04-01T19:57:17.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:17 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:57:17.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:17 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:57:17.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:17 smithi188 ceph-mon[43939]: osdmap e699: 12 total, 11 up, 10 in 2024-04-01T19:57:17.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:17 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3193370243' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:57:17.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:17 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:17.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:17 smithi188 ceph-mon[43939]: pgmap v1912: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.3 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 594 op/s; 26967/173134 objects degraded (15.576%); 14 MiB/s, 218 objects/s recovering 2024-04-01T19:57:18.538 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:18.538 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:18.539 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:18.539 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:18.539 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:18.539 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:18.539 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:18.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:18.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:18.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:18 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:18.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:18.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:18.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:18.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:18.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:18.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:18.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:18.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:18.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:18.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:18 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:19.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:19.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:19.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:19.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:19.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:19.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:19.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:19.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:19.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:19.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:18 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:19.117 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:57:19.117 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:57:19.503 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:57:19.506 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:19.506 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:57:19.607 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:57:19.662 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:57:19.677 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:19.719 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:57:19.729 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:19.730 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:57:19.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:19 smithi062 ceph-mon[44211]: pgmap v1913: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.3 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 449 op/s; 26967/172718 objects degraded (15.613%); 8.5 MiB/s, 135 objects/s recovering 2024-04-01T19:57:19.831 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:57:19.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:19 smithi022 ceph-mon[39439]: pgmap v1913: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.3 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 449 op/s; 26967/172718 objects degraded (15.613%); 8.5 MiB/s, 135 objects/s recovering 2024-04-01T19:57:19.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:19 smithi188 ceph-mon[43939]: pgmap v1913: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.3 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 449 op/s; 26967/172718 objects degraded (15.613%); 8.5 MiB/s, 135 objects/s recovering 2024-04-01T19:57:19.875 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:19.987 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:57:19.994 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:19.994 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:57:20.095 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:57:20.293 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:20.329 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:57:20.337 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:20.337 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:57:20.438 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:57:20.476 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:20.508 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:57:20.513 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:20.514 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:57:20.545 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:20 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 26967/172718 objects degraded (15.613%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:20.546 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:20 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 26967/172718 objects degraded (15.613%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:20.615 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:57:20.662 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:20.691 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:57:20.695 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:20.695 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:57:20.797 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:57:20.823 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:20 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 26967/172718 objects degraded (15.613%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:20.832 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:20.894 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:57:20.900 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:20.900 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:57:21.000 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:57:21.028 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:21.050 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:57:21.054 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:21.055 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:57:21.118 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:57:21.155 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:57:21.189 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:21.555 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:21 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:57:21.555 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:21 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:57:21.555 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:21 smithi022 ceph-mon[39439]: pgmap v1914: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.1 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 736 op/s; 26121/166732 objects degraded (15.666%); 13 MiB/s, 215 objects/s recovering 2024-04-01T19:57:21.640 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:57:21.646 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:57:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:21 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:57:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:21 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:57:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:21 smithi188 ceph-mon[43939]: pgmap v1914: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.1 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 736 op/s; 26121/166732 objects degraded (15.666%); 13 MiB/s, 215 objects/s recovering 2024-04-01T19:57:22.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:21 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:57:22.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:21 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:57:22.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:21 smithi062 ceph-mon[44211]: pgmap v1914: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.1 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 736 op/s; 26121/166732 objects degraded (15.666%); 13 MiB/s, 215 objects/s recovering 2024-04-01T19:57:22.510 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_ops_in_flight 2024-04-01T19:57:22.545 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:57:22.552 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:22.552 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:57:22.653 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:57:22.702 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:22.731 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:57:22.736 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:22 smithi062 ceph-mon[44211]: osdmap e700: 12 total, 11 up, 10 in 2024-04-01T19:57:22.737 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:22 smithi062 ceph-mon[44211]: from='client.17220 v1:172.21.15.22:0/108921885' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:57:22.738 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:22.738 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:57:22.839 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:57:22.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:22 smithi022 ceph-mon[39439]: osdmap e700: 12 total, 11 up, 10 in 2024-04-01T19:57:22.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:22 smithi022 ceph-mon[39439]: from='client.17220 v1:172.21.15.22:0/108921885' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:57:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:22 smithi188 ceph-mon[43939]: osdmap e700: 12 total, 11 up, 10 in 2024-04-01T19:57:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:22 smithi188 ceph-mon[43939]: from='client.17220 v1:172.21.15.22:0/108921885' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:57:22.882 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:22.930 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:57:22.934 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:22.934 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:57:23.035 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:57:23.076 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:23.593 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:57:23.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:23 smithi022 ceph-mon[39439]: pgmap v1916: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.1 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 800 op/s; 25897/165878 objects degraded (15.612%); 17 MiB/s, 266 objects/s recovering 2024-04-01T19:57:23.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:23 smithi188 ceph-mon[43939]: pgmap v1916: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.1 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 800 op/s; 25897/165878 objects degraded (15.612%); 17 MiB/s, 266 objects/s recovering 2024-04-01T19:57:24.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:23 smithi062 ceph-mon[44211]: pgmap v1916: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.1 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 800 op/s; 25897/165878 objects degraded (15.612%); 17 MiB/s, 266 objects/s recovering 2024-04-01T19:57:24.135 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:57:24.139 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:24.139 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:57:24.240 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:57:24.277 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:24.308 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:57:24.313 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:24.314 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:57:24.415 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:57:24.420 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:57:24.458 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:24.487 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:57:24.490 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:24.490 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:57:24.572 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:24 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:57:24.572 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:24 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:57:24.578 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:24 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:57:24.578 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:24 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:57:24.591 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:57:24.628 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:24.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:24 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:57:24.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:24 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:57:24.986 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:57:24.990 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:24.990 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:57:25.012 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":1915,"stamp":"2024-04-01T19:57:21.556063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5449712184,"num_objects":83150,"num_object_clones":0,"num_object_copies":166300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":25897,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83150,"num_whiteouts":0,"num_read":127,"num_read_kb":110,"num_write":195593,"num_write_kb":8916795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15426,"num_bytes_recovered":1012091008,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161072,"ondisk_log_size":161072,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":9,"kb":937451520,"kb_used":14890780,"kb_used_data":9057088,"kb_used_omap":889,"kb_used_meta":5832518,"kb_avail":922560740,"statfs":{"total":959950356480,"available":944702197760,"internally_reserved":0,"allocated":9274458112,"data_stored":9270591984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":910339,"internal_metadata":5972499453},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,3,8,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-430112768,"num_objects":-6563,"num_object_clones":0,"num_object_copies":-13126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-2136,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-6563,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6563,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2136,"num_bytes_recovered":139984896,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.178815"},"pg_stats":[{"pgid":"8.f","version":"699'12388","reported_seq":12633,"reported_epoch":699,"state":"active+clean","last_fresh":"2024-04-01T19:57:20.662458+0000","last_change":"2024-04-01T19:55:39.217150+0000","last_active":"2024-04-01T19:57:20.662458+0000","last_peered":"2024-04-01T19:57:20.662458+0000","last_clean":"2024-04-01T19:57:20.662458+0000","last_became_active":"2024-04-01T19:53:54.067307+0000","last_became_peered":"2024-04-01T19:53:54.067307+0000","last_unstale":"2024-04-01T19:57:20.662458+0000","last_undegraded":"2024-04-01T19:57:20.662458+0000","last_fullsized":"2024-04-01T19:57:20.662458+0000","mapping_epoch":629,"log_start":"647'2300","ondisk_log_start":"647'2300","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8876","last_scrub_stamp":"2024-04-01T19:55:39.216977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:39.216977+0000","objects_scrubbed":8773,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1863,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":341704704,"num_objects":5214,"num_object_clones":0,"num_object_copies":10428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5214,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12388,"num_write_kb":563264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.e","version":"699'12118","reported_seq":12359,"reported_epoch":699,"state":"active+clean","last_fresh":"2024-04-01T19:57:20.549662+0000","last_change":"2024-04-01T19:55:33.528266+0000","last_active":"2024-04-01T19:57:20.549662+0000","last_peered":"2024-04-01T19:57:20.549662+0000","last_clean":"2024-04-01T19:57:20.549662+0000","last_became_active":"2024-04-01T19:53:54.066471+0000","last_became_peered":"2024-04-01T19:53:54.066471+0000","last_unstale":"2024-04-01T19:57:20.549662+0000","last_undegraded":"2024-04-01T19:57:20.549662+0000","last_fullsized":"2024-04-01T19:57:20.549662+0000","mapping_epoch":629,"log_start":"647'2100","ondisk_log_start":"647'2100","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'8369","last_scrub_stamp":"2024-04-01T19:55:33.528006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:33.528006+0000","objects_scrubbed":8332,"log_size":10018,"log_dups_size":0,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1210,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333447168,"num_objects":5088,"num_object_clones":0,"num_object_copies":10176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5088,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12118,"num_write_kb":550592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"699'12372","reported_seq":12616,"reported_epoch":699,"state":"active+clean","last_fresh":"2024-04-01T19:57:20.599165+0000","last_change":"2024-04-01T19:55:45.161755+0000","last_active":"2024-04-01T19:57:20.599165+0000","last_peered":"2024-04-01T19:57:20.599165+0000","last_clean":"2024-04-01T19:57:20.599165+0000","last_became_active":"2024-04-01T19:53:53.678991+0000","last_became_peered":"2024-04-01T19:53:53.678991+0000","last_unstale":"2024-04-01T19:57:20.599165+0000","last_undegraded":"2024-04-01T19:57:20.599165+0000","last_fullsized":"2024-04-01T19:57:20.599165+0000","mapping_epoch":629,"log_start":"647'2300","ondisk_log_start":"647'2300","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"674'9322","last_scrub_stamp":"2024-04-01T19:55:45.161618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:45.161618+0000","objects_scrubbed":8442,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1822,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":349241368,"num_objects":5330,"num_object_clones":0,"num_object_copies":10660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5330,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12372,"num_write_kb":566401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.c","version":"699'12227","reported_seq":12538,"reported_epoch":699,"state":"active+clean","last_fresh":"2024-04-01T19:57:20.736085+0000","last_change":"2024-04-01T19:57:06.345540+0000","last_active":"2024-04-01T19:57:20.736085+0000","last_peered":"2024-04-01T19:57:20.736085+0000","last_clean":"2024-04-01T19:57:20.736085+0000","last_became_active":"2024-04-01T19:53:53.462634+0000","last_became_peered":"2024-04-01T19:53:53.462634+0000","last_unstale":"2024-04-01T19:57:20.736085+0000","last_undegraded":"2024-04-01T19:57:20.736085+0000","last_fullsized":"2024-04-01T19:57:20.736085+0000","mapping_epoch":629,"log_start":"647'2200","ondisk_log_start":"647'2200","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"695'11630","last_scrub_stamp":"2024-04-01T19:57:06.345285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:57:06.345285+0000","objects_scrubbed":5792,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:58:22.050371+0000","scrub_duration":1062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339279872,"num_objects":5177,"num_object_clones":0,"num_object_copies":10354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5177,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12227,"num_write_kb":556928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"8.b","version":"699'12334","reported_seq":12649,"reported_epoch":699,"state":"active+clean","last_fresh":"2024-04-01T19:57:19.375187+0000","last_change":"2024-04-01T19:56:59.305034+0000","last_active":"2024-04-01T19:57:19.375187+0000","last_peered":"2024-04-01T19:57:19.375187+0000","last_clean":"2024-04-01T19:57:19.375187+0000","last_became_active":"2024-04-01T19:53:53.456979+0000","last_became_peered":"2024-04-01T19:53:53.456979+0000","last_unstale":"2024-04-01T19:57:19.375187+0000","last_undegraded":"2024-04-01T19:57:19.375187+0000","last_fullsized":"2024-04-01T19:57:19.375187+0000","mapping_epoch":629,"log_start":"647'2300","ondisk_log_start":"647'2300","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"694'11454","last_scrub_stamp":"2024-04-01T19:56:59.304718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:56:59.304718+0000","objects_scrubbed":6290,"log_size":10034,"log_dups_size":0,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:58:02.508594+0000","scrub_duration":957,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353370112,"num_objects":5392,"num_object_clones":0,"num_object_copies":10784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5392,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12334,"num_write_kb":567232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"8.a","version":"699'11950","reported_seq":12248,"reported_epoch":699,"state":"active+clean","last_fresh":"2024-04-01T19:57:19.381935+0000","last_change":"2024-04-01T19:56:21.853413+0000","last_active":"2024-04-01T19:57:19.381935+0000","last_peered":"2024-04-01T19:57:19.381935+0000","last_clean":"2024-04-01T19:57:19.381935+0000","last_became_active":"2024-04-01T19:53:54.066588+0000","last_became_peered":"2024-04-01T19:53:54.066588+0000","last_unstale":"2024-04-01T19:57:19.381935+0000","last_undegraded":"2024-04-01T19:57:19.381935+0000","last_fullsized":"2024-04-01T19:57:19.381935+0000","mapping_epoch":629,"log_start":"646'1900","ondisk_log_start":"646'1900","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"680'9768","last_scrub_stamp":"2024-04-01T19:56:21.853096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:56:21.853096+0000","objects_scrubbed":7384,"log_size":10050,"log_dups_size":0,"ondisk_log_size":10050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:57:37.729675+0000","scrub_duration":668,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340918272,"num_objects":5202,"num_object_clones":0,"num_object_copies":10404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5202,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11950,"num_write_kb":548864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"8.8","version":"699'12284","reported_seq":12528,"reported_epoch":699,"state":"active+clean","last_fresh":"2024-04-01T19:57:20.788667+0000","last_change":"2024-04-01T19:55:40.424211+0000","last_active":"2024-04-01T19:57:20.788667+0000","last_peered":"2024-04-01T19:57:20.788667+0000","last_clean":"2024-04-01T19:57:20.788667+0000","last_became_active":"2024-04-01T19:53:53.454737+0000","last_became_peered":"2024-04-01T19:53:53.454737+0000","last_unstale":"2024-04-01T19:57:20.788667+0000","last_undegraded":"2024-04-01T19:57:20.788667+0000","last_fullsized":"2024-04-01T19:57:20.788667+0000","mapping_epoch":629,"log_start":"647'2200","ondisk_log_start":"647'2200","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8915","last_scrub_stamp":"2024-04-01T19:55:40.424044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:40.424044+0000","objects_scrubbed":8661,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1277,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":344195072,"num_objects":5252,"num_object_clones":0,"num_object_copies":10504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5252,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12284,"num_write_kb":561152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"699'12162","reported_seq":18514,"reported_epoch":699,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:57:20.657080+0000","last_change":"2024-04-01T19:56:22.028676+0000","last_active":"2024-04-01T19:57:20.657080+0000","last_peered":"2024-04-01T19:57:20.657080+0000","last_clean":"2024-04-01T19:55:56.524590+0000","last_became_active":"2024-04-01T19:56:21.981743+0000","last_became_peered":"2024-04-01T19:56:21.981743+0000","last_unstale":"2024-04-01T19:57:20.657080+0000","last_undegraded":"2024-04-01T19:56:21.738659+0000","last_fullsized":"2024-04-01T19:57:20.657080+0000","mapping_epoch":687,"log_start":"647'2100","ondisk_log_start":"647'2100","created":629,"last_epoch_clean":641,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'9008","last_scrub_stamp":"2024-04-01T19:55:43.358714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:43.358714+0000","objects_scrubbed":8387,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"no scrub is scheduled","scrub_duration":2089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":338427904,"num_objects":5164,"num_object_clones":0,"num_object_copies":10328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5163,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5164,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12162,"num_write_kb":554432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3049,"num_bytes_recovered":199753728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":["11"],"object_location_counts":[{"shards":"2,11","objects":1},{"shards":"11","objects":5163}],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.6","version":"699'12222","reported_seq":18680,"reported_epoch":699,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:57:20.660771+0000","last_change":"2024-04-01T19:56:22.018466+0000","last_active":"2024-04-01T19:57:20.660771+0000","last_peered":"2024-04-01T19:57:20.660771+0000","last_clean":"2024-04-01T19:55:56.539057+0000","last_became_active":"2024-04-01T19:56:21.956699+0000","last_became_peered":"2024-04-01T19:56:21.956699+0000","last_unstale":"2024-04-01T19:57:20.660771+0000","last_undegraded":"2024-04-01T19:56:21.744926+0000","last_fullsized":"2024-04-01T19:57:20.660771+0000","mapping_epoch":687,"log_start":"647'2200","ondisk_log_start":"647'2200","created":629,"last_epoch_clean":642,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8615","last_scrub_stamp":"2024-04-01T19:55:36.688352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:36.688352+0000","objects_scrubbed":8556,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"no scrub is scheduled","scrub_duration":2331,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":337248256,"num_objects":5146,"num_object_clones":0,"num_object_copies":10292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5145,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5146,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12222,"num_write_kb":555776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3102,"num_bytes_recovered":203096064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":["11"],"object_location_counts":[{"shards":"7,11","objects":1},{"shards":"11","objects":5145}],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.5","version":"699'12399","reported_seq":19044,"reported_epoch":699,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:57:21.458477+0000","last_change":"2024-04-01T19:56:22.002998+0000","last_active":"2024-04-01T19:57:21.458477+0000","last_peered":"2024-04-01T19:57:21.458477+0000","last_clean":"2024-04-01T19:55:56.434043+0000","last_became_active":"2024-04-01T19:56:21.952684+0000","last_became_peered":"2024-04-01T19:56:21.952684+0000","last_unstale":"2024-04-01T19:57:21.458477+0000","last_undegraded":"2024-04-01T19:56:21.721301+0000","last_fullsized":"2024-04-01T19:57:21.458477+0000","mapping_epoch":687,"log_start":"647'2300","ondisk_log_start":"647'2300","created":629,"last_epoch_clean":644,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'8660","last_scrub_stamp":"2024-04-01T19:55:36.183547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:36.183547+0000","objects_scrubbed":8628,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"no scrub is scheduled","scrub_duration":1673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":337969152,"num_objects":5157,"num_object_clones":0,"num_object_copies":10314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5148,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5157,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12399,"num_write_kb":561792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3194,"num_bytes_recovered":209321984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":5148},{"shards":"4,11","objects":9}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.4","version":"699'15158","reported_seq":15606,"reported_epoch":699,"state":"active+clean","last_fresh":"2024-04-01T19:57:20.758299+0000","last_change":"2024-04-01T19:55:34.954183+0000","last_active":"2024-04-01T19:57:20.758299+0000","last_peered":"2024-04-01T19:57:20.758299+0000","last_clean":"2024-04-01T19:57:20.758299+0000","last_became_active":"2024-04-01T19:53:53.462894+0000","last_became_peered":"2024-04-01T19:53:53.462894+0000","last_unstale":"2024-04-01T19:57:20.758299+0000","last_undegraded":"2024-04-01T19:57:20.758299+0000","last_fullsized":"2024-04-01T19:57:20.758299+0000","mapping_epoch":629,"log_start":"658'5100","ondisk_log_start":"658'5100","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'11373","last_scrub_stamp":"2024-04-01T19:55:34.954011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:34.954011+0000","objects_scrubbed":8546,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":336330752,"num_objects":5132,"num_object_clones":0,"num_object_copies":10264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5132,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12396,"num_write_kb":560896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"699'12151","reported_seq":12368,"reported_epoch":699,"state":"active+clean","last_fresh":"2024-04-01T19:57:20.588624+0000","last_change":"2024-04-01T19:54:55.108987+0000","last_active":"2024-04-01T19:57:20.588624+0000","last_peered":"2024-04-01T19:57:20.588624+0000","last_clean":"2024-04-01T19:57:20.588624+0000","last_became_active":"2024-04-01T19:53:53.462397+0000","last_became_peered":"2024-04-01T19:53:53.462397+0000","last_unstale":"2024-04-01T19:57:20.588624+0000","last_undegraded":"2024-04-01T19:57:20.588624+0000","last_fullsized":"2024-04-01T19:57:20.588624+0000","mapping_epoch":629,"log_start":"647'2100","ondisk_log_start":"647'2100","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"660'5871","last_scrub_stamp":"2024-04-01T19:54:55.108780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:54:55.108780+0000","objects_scrubbed":5824,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335740928,"num_objects":5123,"num_object_clones":0,"num_object_copies":10246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12151,"num_write_kb":552768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.2","version":"699'11957","reported_seq":18144,"reported_epoch":699,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:57:20.592328+0000","last_change":"2024-04-01T19:56:22.018621+0000","last_active":"2024-04-01T19:57:20.592328+0000","last_peered":"2024-04-01T19:57:20.592328+0000","last_clean":"2024-04-01T19:55:56.523442+0000","last_became_active":"2024-04-01T19:56:21.981766+0000","last_became_peered":"2024-04-01T19:56:21.981766+0000","last_unstale":"2024-04-01T19:57:20.592328+0000","last_undegraded":"2024-04-01T19:56:21.720612+0000","last_fullsized":"2024-04-01T19:57:20.592328+0000","mapping_epoch":687,"log_start":"646'1900","ondisk_log_start":"646'1900","created":629,"last_epoch_clean":645,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'8353","last_scrub_stamp":"2024-04-01T19:55:34.153804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:34.153804+0000","objects_scrubbed":8295,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"no scrub is scheduled","scrub_duration":1672,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":338755584,"num_objects":5169,"num_object_clones":0,"num_object_copies":10338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5169,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11957,"num_write_kb":548032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2967,"num_bytes_recovered":194314240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":5168},{"shards":"0,4","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"699'15083","reported_seq":15610,"reported_epoch":699,"state":"active+clean","last_fresh":"2024-04-01T19:57:20.671508+0000","last_change":"2024-04-01T19:57:00.295446+0000","last_active":"2024-04-01T19:57:20.671508+0000","last_peered":"2024-04-01T19:57:20.671508+0000","last_clean":"2024-04-01T19:57:20.671508+0000","last_became_active":"2024-04-01T19:53:54.066680+0000","last_became_peered":"2024-04-01T19:53:54.066680+0000","last_unstale":"2024-04-01T19:57:20.671508+0000","last_undegraded":"2024-04-01T19:57:20.671508+0000","last_fullsized":"2024-04-01T19:57:20.671508+0000","mapping_epoch":629,"log_start":"658'5000","ondisk_log_start":"658'5000","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"694'14240","last_scrub_stamp":"2024-04-01T19:57:00.295287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:57:00.295287+0000","objects_scrubbed":6022,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:58:19.188940+0000","scrub_duration":983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":337772544,"num_objects":5154,"num_object_clones":0,"num_object_copies":10308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5154,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12124,"num_write_kb":552896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"8.0","version":"699'11985","reported_seq":12300,"reported_epoch":699,"state":"active+clean","last_fresh":"2024-04-01T19:57:17.633290+0000","last_change":"2024-04-01T19:56:35.611718+0000","last_active":"2024-04-01T19:57:17.633290+0000","last_peered":"2024-04-01T19:57:17.633290+0000","last_clean":"2024-04-01T19:57:17.633290+0000","last_became_active":"2024-04-01T19:53:53.455265+0000","last_became_peered":"2024-04-01T19:53:53.455265+0000","last_unstale":"2024-04-01T19:57:17.633290+0000","last_undegraded":"2024-04-01T19:57:17.633290+0000","last_fullsized":"2024-04-01T19:57:17.633290+0000","mapping_epoch":629,"log_start":"646'1900","ondisk_log_start":"646'1900","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"689'10321","last_scrub_stamp":"2024-04-01T19:56:35.611492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:56:35.611492+0000","objects_scrubbed":6862,"log_size":10085,"log_dups_size":0,"ondisk_log_size":10085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:57:38.680310+0000","scrub_duration":1148,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339017728,"num_objects":5173,"num_object_clones":0,"num_object_copies":10346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5173,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11985,"num_write_kb":549056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"699'12343","reported_seq":18817,"reported_epoch":699,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:57:20.833502+0000","last_change":"2024-04-01T19:56:22.004749+0000","last_active":"2024-04-01T19:57:20.833502+0000","last_peered":"2024-04-01T19:57:20.833502+0000","last_clean":"2024-04-01T19:55:56.538683+0000","last_became_active":"2024-04-01T19:56:21.960415+0000","last_became_peered":"2024-04-01T19:56:21.960415+0000","last_unstale":"2024-04-01T19:57:20.833502+0000","last_undegraded":"2024-04-01T19:56:21.714140+0000","last_fullsized":"2024-04-01T19:57:20.833502+0000","mapping_epoch":687,"log_start":"647'2300","ondisk_log_start":"647'2300","created":629,"last_epoch_clean":645,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8889","last_scrub_stamp":"2024-04-01T19:55:39.237364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:39.237364+0000","objects_scrubbed":8775,"log_size":10043,"log_dups_size":0,"ondisk_log_size":10043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"no scrub is scheduled","scrub_duration":1706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":345702400,"num_objects":5275,"num_object_clones":0,"num_object_copies":10550,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5273,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5275,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12343,"num_write_kb":563776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3106,"num_bytes_recovered":203489280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":["5"],"object_location_counts":[{"shards":"0,5","objects":2},{"shards":"5","objects":5273}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":1724,"reported_epoch":699,"state":"active+clean","last_fresh":"2024-04-01T19:57:16.475544+0000","last_change":"2024-04-01T19:55:33.016809+0000","last_active":"2024-04-01T19:57:16.475544+0000","last_peered":"2024-04-01T19:57:16.475544+0000","last_clean":"2024-04-01T19:57:16.475544+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:57:16.475544+0000","last_undegraded":"2024-04-01T19:57:16.475544+0000","last_fullsized":"2024-04-01T19:57:16.475544+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:55:33.016695+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:55:33.016695+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":192,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":5449121816,"num_objects":83148,"num_object_clones":0,"num_object_copies":166296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":25897,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83148,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":195412,"num_write_kb":8913857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15418,"num_bytes_recovered":1009975296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11780038656,"data_stored":11780030512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160933,"ondisk_log_size":160933,"up":32,"acting":32,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220577,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2507384,"kb_used_data":1663920,"kb_used_omap":1,"kb_used_meta":843326,"kb_avail":91237768,"statfs":{"total":95995035648,"available":93427474432,"internally_reserved":0,"allocated":1703854080,"data_stored":1703461350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":863566276},"hb_peers":[0,1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1593900,"kb_used_data":994852,"kb_used_omap":1,"kb_used_meta":598974,"kb_avail":92151252,"statfs":{"total":95995035648,"available":94362882048,"internally_reserved":0,"allocated":1018728448,"data_stored":1018343362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":613349824},"hb_peers":[0,1,2,3,4,5,6,7,8,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557641,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1237036,"kb_used_data":1014756,"kb_used_omap":132,"kb_used_meta":222139,"kb_avail":92508116,"statfs":{"total":95995035648,"available":94728310784,"internally_reserved":0,"allocated":1039110144,"data_stored":1038725058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":227471079},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234422,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":925048,"kb_used_data":348272,"kb_used_omap":1,"kb_used_meta":576766,"kb_avail":92820104,"statfs":{"total":95995035648,"available":95047786496,"internally_reserved":0,"allocated":356630528,"data_stored":356237818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":590608842},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":457,"seq":1962800054434,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":253616,"kb_used_data":740,"kb_used_omap":744,"kb_used_meta":252119,"kb_avail":93491536,"statfs":{"total":95995035648,"available":95735332864,"internally_reserved":0,"allocated":757760,"data_stored":372674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":762131,"internal_metadata":258170605},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":2452426326101,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738843,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1356524,"kb_used_data":657572,"kb_used_omap":1,"kb_used_meta":698942,"kb_avail":92388628,"statfs":{"total":95995035648,"available":94605955072,"internally_reserved":0,"allocated":673353728,"data_stored":672968642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":715717061},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346383,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1904560,"kb_used_data":1363876,"kb_used_omap":1,"kb_used_meta":540670,"kb_avail":91840592,"statfs":{"total":95995035648,"available":94044766208,"internally_reserved":0,"allocated":1396609024,"data_stored":1396223938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":553646533},"hb_peers":[0,1,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,4,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669150153,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1435632,"kb_used_data":678372,"kb_used_omap":1,"kb_used_meta":757246,"kb_avail":92309520,"statfs":{"total":95995035648,"available":94524948480,"internally_reserved":0,"allocated":694652928,"data_stored":694267842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":775420359},"hb_peers":[0,1,2,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953924,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1346348,"kb_used_data":675172,"kb_used_omap":1,"kb_used_meta":671166,"kb_avail":92398804,"statfs":{"total":95995035648,"available":94616375296,"internally_reserved":0,"allocated":691376128,"data_stored":690991042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":687274437},"hb_peers":[0,1,2,3,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790400,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2330732,"kb_used_data":1659556,"kb_used_omap":1,"kb_used_meta":671166,"kb_avail":91414420,"statfs":{"total":95995035648,"available":93608366080,"internally_reserved":0,"allocated":1699385344,"data_stored":1699000258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":687274437},"hb_peers":[0,1,2,3,4,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,2,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":672202752,"data_stored":672202752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1394737152,"data_stored":1394737152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":692125696,"data_stored":692125696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":686227456,"data_stored":686227456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1691942912,"data_stored":1691942912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":355340288,"data_stored":355336216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":1037303808,"data_stored":1037303808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":1013514240,"data_stored":1013514240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":2534604800,"data_stored":2534604800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":1702039552,"data_stored":1702035480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:57:25.013 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:57:25.091 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:57:25.126 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:25.795 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:57:25.802 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:25.803 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:57:25.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:25 smithi022 ceph-mon[39439]: osdmap e701: 12 total, 11 up, 10 in 2024-04-01T19:57:25.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:25 smithi022 ceph-mon[39439]: pgmap v1918: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.0 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 499 op/s; 25897/165136 objects degraded (15.682%); 8.4 MiB/s, 133 objects/s recovering 2024-04-01T19:57:25.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:25 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 25897/165878 objects degraded (15.612%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:25.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:25 smithi188 ceph-mon[43939]: osdmap e701: 12 total, 11 up, 10 in 2024-04-01T19:57:25.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:25 smithi188 ceph-mon[43939]: pgmap v1918: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.0 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 499 op/s; 25897/165136 objects degraded (15.682%); 8.4 MiB/s, 133 objects/s recovering 2024-04-01T19:57:25.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:25 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 25897/165878 objects degraded (15.612%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:25.903 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:57:25.938 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:25 smithi062 ceph-mon[44211]: osdmap e701: 12 total, 11 up, 10 in 2024-04-01T19:57:25.938 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:25 smithi062 ceph-mon[44211]: pgmap v1918: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 5.0 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 499 op/s; 25897/165136 objects degraded (15.682%); 8.4 MiB/s, 133 objects/s recovering 2024-04-01T19:57:25.938 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:25 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 25897/165878 objects degraded (15.612%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:25.941 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:25.981 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:57:25.985 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:25.986 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:57:26.087 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:57:26.125 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:26.168 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:57:26.171 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:26.171 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:57:26.272 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:57:26.308 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:26.596 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:57:26.604 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:26.604 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:57:26.705 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:57:26.745 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:26.775 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:57:26.778 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:26.779 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:57:26.880 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:57:26.913 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:26.949 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:57:26.953 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:26.953 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:57:27.054 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:57:27.096 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:27.432 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:57:27.456 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:57:27.467 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:27.467 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:57:27.568 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:57:27.611 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:27 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1028699911' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:57:27.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:27 smithi062 ceph-mon[44211]: from='client.37259 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:57:27.834 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:27 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1028699911' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:57:27.834 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:27 smithi188 ceph-mon[43939]: from='client.37259 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:57:27.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:27 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1028699911' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:57:27.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:27 smithi022 ceph-mon[39439]: from='client.37259 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:57:28.462 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:57:28.462 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:57:28.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:28 smithi022 ceph-mon[39439]: pgmap v1919: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.9 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 813 op/s; 24802/159704 objects degraded (15.530%); 17 MiB/s, 270 objects/s recovering 2024-04-01T19:57:28.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:28 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:57:28.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:28 smithi022 ceph-mon[39439]: from='client.37259 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:57:28.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:28 smithi022 ceph-mon[39439]: osdmap e702: 12 total, 11 up, 10 in 2024-04-01T19:57:28.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:28 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:57:28.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:28 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:57:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:28 smithi188 ceph-mon[43939]: pgmap v1919: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.9 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 813 op/s; 24802/159704 objects degraded (15.530%); 17 MiB/s, 270 objects/s recovering 2024-04-01T19:57:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:28 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:57:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:28 smithi188 ceph-mon[43939]: from='client.37259 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:57:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:28 smithi188 ceph-mon[43939]: osdmap e702: 12 total, 11 up, 10 in 2024-04-01T19:57:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:28 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:57:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:28 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:57:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:28 smithi062 ceph-mon[44211]: pgmap v1919: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.9 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 813 op/s; 24802/159704 objects degraded (15.530%); 17 MiB/s, 270 objects/s recovering 2024-04-01T19:57:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:28 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:57:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:28 smithi062 ceph-mon[44211]: from='client.37259 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:57:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:28 smithi062 ceph-mon[44211]: osdmap e702: 12 total, 11 up, 10 in 2024-04-01T19:57:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:28 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:57:28.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:28 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:57:29.078 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:57:29.081 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:29.081 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:57:29.182 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:57:29.221 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:29 smithi188 ceph-mon[43939]: osdmap e703: 12 total, 11 up, 10 in 2024-04-01T19:57:29.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:29 smithi062 ceph-mon[44211]: osdmap e703: 12 total, 11 up, 10 in 2024-04-01T19:57:29.799 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:29 smithi022 ceph-mon[39439]: osdmap e703: 12 total, 11 up, 10 in 2024-04-01T19:57:29.850 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:57:30.681 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:30 smithi022 ceph-mon[39439]: pgmap v1922: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.9 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 548 op/s; 24802/159292 objects degraded (15.570%); 11 MiB/s, 182 objects/s recovering 2024-04-01T19:57:30.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:30 smithi062 ceph-mon[44211]: pgmap v1922: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.9 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 548 op/s; 24802/159292 objects degraded (15.570%); 11 MiB/s, 182 objects/s recovering 2024-04-01T19:57:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:30 smithi188 ceph-mon[43939]: pgmap v1922: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.9 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 548 op/s; 24802/159292 objects degraded (15.570%); 11 MiB/s, 182 objects/s recovering 2024-04-01T19:57:30.882 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:57:30.890 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:30.891 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:57:30.992 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:57:31.305 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:31 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 24802/159292 objects degraded (15.570%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:31.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:31 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3734825889' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:57:31.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:31.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:31.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:31.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:31 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 24802/159292 objects degraded (15.570%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:31.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:31 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3734825889' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:57:31.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:31.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:31.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:31.844 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:57:31.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:31 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 24802/159292 objects degraded (15.570%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:31.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:31 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3734825889' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:57:31.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:31.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:31.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:32.539 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:57:32.539 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:57:32.539 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:57:32.539 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:57:32.539 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:57:32.539 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:57:32.539 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:57:32.540 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:57:32.540 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:57:32.540 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:57:32.540 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:57:32.540 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:57:32.540 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:57:32.540 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:57:32.540 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:57:32.540 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:57:32.541 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:57:32.541 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:57:32.541 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:57:32.541 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:57:32.541 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:57:32.541 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.10 2024-04-01T19:57:32.541 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:57:32.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:32.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:32.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:32 smithi188 ceph-mon[43939]: pgmap v1923: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.7 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 867 op/s; 23931/153302 objects degraded (15.610%); 18 MiB/s, 288 objects/s recovering 2024-04-01T19:57:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:32 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:57:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:32 smithi062 ceph-mon[44211]: pgmap v1923: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.7 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 867 op/s; 23931/153302 objects degraded (15.610%); 18 MiB/s, 288 objects/s recovering 2024-04-01T19:57:32.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:32 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:57:32.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:32 smithi022 ceph-mon[39439]: pgmap v1923: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.7 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 0 B/s wr, 867 op/s; 23931/153302 objects degraded (15.610%); 18 MiB/s, 288 objects/s recovering 2024-04-01T19:57:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:32 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:57:33.351 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:57:33.351 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:57:33.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {auth=27,config=2,health=12,kv=54,logm=5} crc {auth=594293713,config=2353167246,health=2708719545,kv=3671791291,logm=1566701421}) 2024-04-01T19:57:33.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=561145584}) 2024-04-01T19:57:33.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3574012815}) 2024-04-01T19:57:33.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2693343484}) 2024-04-01T19:57:33.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1663148726}) 2024-04-01T19:57:33.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=15368932}) 2024-04-01T19:57:33.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3701432068}) 2024-04-01T19:57:33.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=501842337}) 2024-04-01T19:57:33.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1427610345}) 2024-04-01T19:57:33.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2175353730}) 2024-04-01T19:57:33.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=904533792}) 2024-04-01T19:57:33.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1574506417}) 2024-04-01T19:57:33.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4170560483}) 2024-04-01T19:57:33.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1398843995}) 2024-04-01T19:57:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3967929430}) 2024-04-01T19:57:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3406339983}) 2024-04-01T19:57:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=306755207}) 2024-04-01T19:57:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=183458283}) 2024-04-01T19:57:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3585950419}) 2024-04-01T19:57:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1837370952}) 2024-04-01T19:57:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2350355385}) 2024-04-01T19:57:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2406532542}) 2024-04-01T19:57:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=540025399}) 2024-04-01T19:57:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3508011437}) 2024-04-01T19:57:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1103691521}) 2024-04-01T19:57:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=491768266}) 2024-04-01T19:57:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1553595788}) 2024-04-01T19:57:33.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3508465328}) 2024-04-01T19:57:33.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3420673025}) 2024-04-01T19:57:33.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3689072919}) 2024-04-01T19:57:33.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1456542805}) 2024-04-01T19:57:33.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=65734089}) 2024-04-01T19:57:33.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3960810744}) 2024-04-01T19:57:33.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4249919107}) 2024-04-01T19:57:33.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2317692961}) 2024-04-01T19:57:33.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=640629722}) 2024-04-01T19:57:33.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3365848490}) 2024-04-01T19:57:33.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2443494367}) 2024-04-01T19:57:33.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3028931769}) 2024-04-01T19:57:33.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1981645444}) 2024-04-01T19:57:33.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2651212698}) 2024-04-01T19:57:33.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2541614936}) 2024-04-01T19:57:33.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2601602587}) 2024-04-01T19:57:33.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1322726269}) 2024-04-01T19:57:33.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=892698674}) 2024-04-01T19:57:33.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3549386446}) 2024-04-01T19:57:33.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1708134742}) 2024-04-01T19:57:33.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1169487690}) 2024-04-01T19:57:33.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=512638340}) 2024-04-01T19:57:33.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4012780183}) 2024-04-01T19:57:33.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3008152847}) 2024-04-01T19:57:33.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=406824288}) 2024-04-01T19:57:33.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1857831023}) 2024-04-01T19:57:33.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3804978181}) 2024-04-01T19:57:33.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2981378101}) 2024-04-01T19:57:33.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1936478190}) 2024-04-01T19:57:33.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4210738967}) 2024-04-01T19:57:33.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=303554706}) 2024-04-01T19:57:33.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3369517568}) 2024-04-01T19:57:33.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=440622520}) 2024-04-01T19:57:33.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2316132962}) 2024-04-01T19:57:33.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1971210999}) 2024-04-01T19:57:33.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=828608473}) 2024-04-01T19:57:33.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2560834635}) 2024-04-01T19:57:33.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2193476075}) 2024-04-01T19:57:33.618 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=387893210}) 2024-04-01T19:57:33.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2266373794}) 2024-04-01T19:57:33.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3525142561}) 2024-04-01T19:57:33.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3518666793}) 2024-04-01T19:57:33.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1793025537}) 2024-04-01T19:57:33.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=166339364}) 2024-04-01T19:57:33.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=292328871}) 2024-04-01T19:57:33.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2122343509}) 2024-04-01T19:57:33.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2425503312}) 2024-04-01T19:57:33.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4117999174}) 2024-04-01T19:57:33.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1434888531}) 2024-04-01T19:57:33.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2561744966}) 2024-04-01T19:57:33.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3960390003}) 2024-04-01T19:57:33.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2500497710}) 2024-04-01T19:57:33.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3562148833}) 2024-04-01T19:57:33.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1220346881}) 2024-04-01T19:57:33.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2339768378}) 2024-04-01T19:57:33.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3012114703}) 2024-04-01T19:57:33.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=581930425}) 2024-04-01T19:57:33.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3486108350}) 2024-04-01T19:57:33.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2458306224}) 2024-04-01T19:57:33.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2404566472}) 2024-04-01T19:57:33.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=95,mdsmap=3,mgr=2} crc {logm=1910535910,mdsmap=2840952586,mgr=1403444643}) 2024-04-01T19:57:33.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mgr=16,mgr_command_descs=1,mgr_metadata=2,mgrstat=9,mon_config_key=72} crc {mgr=3306625633,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=3690433477,mon_config_key=427858187}) 2024-04-01T19:57:33.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=4224330410}) 2024-04-01T19:57:33.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1101063980}) 2024-04-01T19:57:33.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=17,monmap=5,osd_metadata=12,osd_pg_creating=1,osdmap=65} crc {mon_config_key=3146815388,monmap=3338646291,osd_metadata=1675620524,osd_pg_creating=3317208422,osdmap=9530706}) 2024-04-01T19:57:33.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=44} crc {osdmap=3281136312}) 2024-04-01T19:57:33.621 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:33 smithi022 ceph-mon[39439]: pgmap v1924: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.7 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 792 op/s; 23715/152454 objects degraded (15.556%); 17 MiB/s, 272 objects/s recovering 2024-04-01T19:57:33.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {auth=27,config=2,health=12,kv=54,logm=5} crc {auth=594293713,config=2353167246,health=2708719545,kv=3671791291,logm=1566701421}) 2024-04-01T19:57:33.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=561145584}) 2024-04-01T19:57:33.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3574012815}) 2024-04-01T19:57:33.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2693343484}) 2024-04-01T19:57:33.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1663148726}) 2024-04-01T19:57:33.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=15368932}) 2024-04-01T19:57:33.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3701432068}) 2024-04-01T19:57:33.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=501842337}) 2024-04-01T19:57:33.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1427610345}) 2024-04-01T19:57:33.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2175353730}) 2024-04-01T19:57:33.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=904533792}) 2024-04-01T19:57:33.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1574506417}) 2024-04-01T19:57:33.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4170560483}) 2024-04-01T19:57:33.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1398843995}) 2024-04-01T19:57:33.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3967929430}) 2024-04-01T19:57:33.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3406339983}) 2024-04-01T19:57:33.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=306755207}) 2024-04-01T19:57:33.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=183458283}) 2024-04-01T19:57:33.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3585950419}) 2024-04-01T19:57:33.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1837370952}) 2024-04-01T19:57:33.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2350355385}) 2024-04-01T19:57:33.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2406532542}) 2024-04-01T19:57:33.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=540025399}) 2024-04-01T19:57:33.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3508011437}) 2024-04-01T19:57:33.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1103691521}) 2024-04-01T19:57:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=491768266}) 2024-04-01T19:57:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1553595788}) 2024-04-01T19:57:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3508465328}) 2024-04-01T19:57:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3420673025}) 2024-04-01T19:57:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3689072919}) 2024-04-01T19:57:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1456542805}) 2024-04-01T19:57:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=65734089}) 2024-04-01T19:57:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3960810744}) 2024-04-01T19:57:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4249919107}) 2024-04-01T19:57:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2317692961}) 2024-04-01T19:57:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=640629722}) 2024-04-01T19:57:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3365848490}) 2024-04-01T19:57:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2443494367}) 2024-04-01T19:57:33.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3028931769}) 2024-04-01T19:57:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1981645444}) 2024-04-01T19:57:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2651212698}) 2024-04-01T19:57:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2541614936}) 2024-04-01T19:57:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2601602587}) 2024-04-01T19:57:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1322726269}) 2024-04-01T19:57:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=892698674}) 2024-04-01T19:57:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3549386446}) 2024-04-01T19:57:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1708134742}) 2024-04-01T19:57:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1169487690}) 2024-04-01T19:57:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=512638340}) 2024-04-01T19:57:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4012780183}) 2024-04-01T19:57:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3008152847}) 2024-04-01T19:57:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=406824288}) 2024-04-01T19:57:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1857831023}) 2024-04-01T19:57:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3804978181}) 2024-04-01T19:57:33.765 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2981378101}) 2024-04-01T19:57:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1936478190}) 2024-04-01T19:57:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4210738967}) 2024-04-01T19:57:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=303554706}) 2024-04-01T19:57:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3369517568}) 2024-04-01T19:57:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=440622520}) 2024-04-01T19:57:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2316132962}) 2024-04-01T19:57:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1971210999}) 2024-04-01T19:57:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=828608473}) 2024-04-01T19:57:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2560834635}) 2024-04-01T19:57:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2193476075}) 2024-04-01T19:57:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=387893210}) 2024-04-01T19:57:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2266373794}) 2024-04-01T19:57:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3525142561}) 2024-04-01T19:57:33.766 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3518666793}) 2024-04-01T19:57:33.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1793025537}) 2024-04-01T19:57:33.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=166339364}) 2024-04-01T19:57:33.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=292328871}) 2024-04-01T19:57:33.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2122343509}) 2024-04-01T19:57:33.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2425503312}) 2024-04-01T19:57:33.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4117999174}) 2024-04-01T19:57:33.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1434888531}) 2024-04-01T19:57:33.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2561744966}) 2024-04-01T19:57:33.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3960390003}) 2024-04-01T19:57:33.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2500497710}) 2024-04-01T19:57:33.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3562148833}) 2024-04-01T19:57:33.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1220346881}) 2024-04-01T19:57:33.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2339768378}) 2024-04-01T19:57:33.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3012114703}) 2024-04-01T19:57:33.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=581930425}) 2024-04-01T19:57:33.768 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3486108350}) 2024-04-01T19:57:33.768 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2458306224}) 2024-04-01T19:57:33.768 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2404566472}) 2024-04-01T19:57:33.768 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=95,mdsmap=3,mgr=2} crc {logm=1910535910,mdsmap=2840952586,mgr=1403444643}) 2024-04-01T19:57:33.768 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mgr=16,mgr_command_descs=1,mgr_metadata=2,mgrstat=9,mon_config_key=72} crc {mgr=3306625633,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=3690433477,mon_config_key=427858187}) 2024-04-01T19:57:33.768 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=4224330410}) 2024-04-01T19:57:33.768 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1101063980}) 2024-04-01T19:57:33.768 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=17,monmap=5,osd_metadata=12,osd_pg_creating=1,osdmap=65} crc {mon_config_key=3146815388,monmap=3338646291,osd_metadata=1675620524,osd_pg_creating=3317208422,osdmap=9530706}) 2024-04-01T19:57:33.768 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=44} crc {osdmap=3281136312}) 2024-04-01T19:57:33.768 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:33 smithi062 ceph-mon[44211]: pgmap v1924: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.7 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 792 op/s; 23715/152454 objects degraded (15.556%); 17 MiB/s, 272 objects/s recovering 2024-04-01T19:57:33.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {auth=27,config=2,health=12,kv=54,logm=5} crc {auth=594293713,config=2353167246,health=2708719545,kv=3671791291,logm=1566701421}) 2024-04-01T19:57:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=561145584}) 2024-04-01T19:57:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3574012815}) 2024-04-01T19:57:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2693343484}) 2024-04-01T19:57:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1663148726}) 2024-04-01T19:57:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=15368932}) 2024-04-01T19:57:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3701432068}) 2024-04-01T19:57:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=501842337}) 2024-04-01T19:57:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1427610345}) 2024-04-01T19:57:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2175353730}) 2024-04-01T19:57:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=904533792}) 2024-04-01T19:57:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1574506417}) 2024-04-01T19:57:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4170560483}) 2024-04-01T19:57:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1398843995}) 2024-04-01T19:57:33.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3967929430}) 2024-04-01T19:57:33.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3406339983}) 2024-04-01T19:57:33.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=306755207}) 2024-04-01T19:57:33.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=183458283}) 2024-04-01T19:57:33.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3585950419}) 2024-04-01T19:57:33.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1837370952}) 2024-04-01T19:57:33.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2350355385}) 2024-04-01T19:57:33.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2406532542}) 2024-04-01T19:57:33.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=540025399}) 2024-04-01T19:57:33.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3508011437}) 2024-04-01T19:57:33.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1103691521}) 2024-04-01T19:57:33.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=491768266}) 2024-04-01T19:57:33.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1553595788}) 2024-04-01T19:57:33.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3508465328}) 2024-04-01T19:57:33.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3420673025}) 2024-04-01T19:57:33.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3689072919}) 2024-04-01T19:57:33.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1456542805}) 2024-04-01T19:57:33.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=65734089}) 2024-04-01T19:57:33.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3960810744}) 2024-04-01T19:57:33.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4249919107}) 2024-04-01T19:57:33.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2317692961}) 2024-04-01T19:57:33.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=640629722}) 2024-04-01T19:57:33.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3365848490}) 2024-04-01T19:57:33.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2443494367}) 2024-04-01T19:57:33.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3028931769}) 2024-04-01T19:57:33.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1981645444}) 2024-04-01T19:57:33.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2651212698}) 2024-04-01T19:57:33.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2541614936}) 2024-04-01T19:57:33.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2601602587}) 2024-04-01T19:57:33.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1322726269}) 2024-04-01T19:57:33.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=892698674}) 2024-04-01T19:57:33.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3549386446}) 2024-04-01T19:57:33.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1708134742}) 2024-04-01T19:57:33.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1169487690}) 2024-04-01T19:57:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=512638340}) 2024-04-01T19:57:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4012780183}) 2024-04-01T19:57:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3008152847}) 2024-04-01T19:57:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=406824288}) 2024-04-01T19:57:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1857831023}) 2024-04-01T19:57:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3804978181}) 2024-04-01T19:57:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2981378101}) 2024-04-01T19:57:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1936478190}) 2024-04-01T19:57:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4210738967}) 2024-04-01T19:57:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=303554706}) 2024-04-01T19:57:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3369517568}) 2024-04-01T19:57:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=440622520}) 2024-04-01T19:57:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2316132962}) 2024-04-01T19:57:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1971210999}) 2024-04-01T19:57:33.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=828608473}) 2024-04-01T19:57:33.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2560834635}) 2024-04-01T19:57:33.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2193476075}) 2024-04-01T19:57:33.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=387893210}) 2024-04-01T19:57:33.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2266373794}) 2024-04-01T19:57:33.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3525142561}) 2024-04-01T19:57:33.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3518666793}) 2024-04-01T19:57:33.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1793025537}) 2024-04-01T19:57:33.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=166339364}) 2024-04-01T19:57:33.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=292328871}) 2024-04-01T19:57:33.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2122343509}) 2024-04-01T19:57:33.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2425503312}) 2024-04-01T19:57:33.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4117999174}) 2024-04-01T19:57:33.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1434888531}) 2024-04-01T19:57:33.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2561744966}) 2024-04-01T19:57:33.880 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3960390003}) 2024-04-01T19:57:33.881 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2500497710}) 2024-04-01T19:57:33.881 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3562148833}) 2024-04-01T19:57:33.881 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1220346881}) 2024-04-01T19:57:33.881 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2339768378}) 2024-04-01T19:57:33.881 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3012114703}) 2024-04-01T19:57:33.881 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=581930425}) 2024-04-01T19:57:33.881 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3486108350}) 2024-04-01T19:57:33.881 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2458306224}) 2024-04-01T19:57:33.881 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2404566472}) 2024-04-01T19:57:33.881 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=95,mdsmap=3,mgr=2} crc {logm=1910535910,mdsmap=2840952586,mgr=1403444643}) 2024-04-01T19:57:33.881 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mgr=16,mgr_command_descs=1,mgr_metadata=2,mgrstat=9,mon_config_key=72} crc {mgr=3306625633,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=3690433477,mon_config_key=427858187}) 2024-04-01T19:57:33.881 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=4224330410}) 2024-04-01T19:57:33.881 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=1101063980}) 2024-04-01T19:57:33.881 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=17,monmap=5,osd_metadata=12,osd_pg_creating=1,osdmap=65} crc {mon_config_key=3146815388,monmap=3338646291,osd_metadata=1675620524,osd_pg_creating=3317208422,osdmap=9530706}) 2024-04-01T19:57:33.881 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=44} crc {osdmap=3281136312}) 2024-04-01T19:57:33.882 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:33 smithi188 ceph-mon[43939]: pgmap v1924: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.7 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 792 op/s; 23715/152454 objects degraded (15.556%); 17 MiB/s, 272 objects/s recovering 2024-04-01T19:57:33.988 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:57:35.353 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:57:35.559 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_blocked_ops 2024-04-01T19:57:35.602 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:57:35.608 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:35.609 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:57:35.710 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:57:35.760 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:57:35.761 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:57:35.761 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:57:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:57:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:57:35.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:57:35.767 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:35.802 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:57:35.805 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:35.806 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:57:35.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:57:35.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:57:35.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:57:35.906 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:57:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:35.978 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:57:35.981 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:35.981 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:57:36.017 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:57:36.082 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:57:36.114 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:36.577 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:57:36.583 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:36.584 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:57:36.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:36 smithi188 ceph-mon[43939]: pgmap v1925: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.6 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 510 op/s; 23715/151530 objects degraded (15.650%); 8.5 MiB/s, 135 objects/s recovering 2024-04-01T19:57:36.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:36 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 23715/152454 objects degraded (15.556%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:36.683 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:36 smithi022 ceph-mon[39439]: pgmap v1925: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.6 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 510 op/s; 23715/151530 objects degraded (15.650%); 8.5 MiB/s, 135 objects/s recovering 2024-04-01T19:57:36.683 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:36 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 23715/152454 objects degraded (15.556%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:36.685 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:57:36.725 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:36 smithi062 ceph-mon[44211]: pgmap v1925: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.6 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 510 op/s; 23715/151530 objects degraded (15.650%); 8.5 MiB/s, 135 objects/s recovering 2024-04-01T19:57:36.725 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:36 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 23715/152454 objects degraded (15.556%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:36.729 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:36.764 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:57:36.768 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:36.769 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:57:36.870 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:57:36.905 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:37.162 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:57:37.169 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:37.169 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:57:37.270 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:57:37.304 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:37.517 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:57:37.521 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:37.522 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:57:37.623 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:57:37.676 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:37.726 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:57:37.732 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:37.732 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:57:37.833 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:57:37.879 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:37.912 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:57:37.916 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:37.916 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:57:38.018 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:57:38.063 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:38.142 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:57:38.147 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:38.147 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:57:38.186 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:57:38.192 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:57:38.248 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:57:38.293 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:38.324 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:57:38.330 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:38.331 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:57:38.432 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:57:38.481 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:38 smithi022 ceph-mon[39439]: pgmap v1926: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.5 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 690 op/s; 22615/145942 objects degraded (15.496%); 14 MiB/s, 219 objects/s recovering 2024-04-01T19:57:38.483 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:38.556 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:57:38.568 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:57:38.574 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:38.575 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:57:38.676 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:57:38.709 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:38 smithi062 ceph-mon[44211]: pgmap v1926: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.5 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 690 op/s; 22615/145942 objects degraded (15.496%); 14 MiB/s, 219 objects/s recovering 2024-04-01T19:57:38.712 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:38.718 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:57:38.718 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:57:38.718 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-01T19:57:38.718 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-01T19:57:38.718 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:57:38.742 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:57:38.746 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:38.746 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:57:38.749 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:38 smithi188 ceph-mon[43939]: pgmap v1926: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.5 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 690 op/s; 22615/145942 objects degraded (15.496%); 14 MiB/s, 219 objects/s recovering 2024-04-01T19:57:38.846 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:57:38.891 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:38.935 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:57:38.943 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:38.944 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:57:39.044 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:57:39.093 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":1926,"stamp":"2024-04-01T19:57:37.384201+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4782621240,"num_objects":72971,"num_object_clones":0,"num_object_copies":145942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":22615,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72971,"num_whiteouts":0,"num_read":127,"num_read_kb":110,"num_write":205772,"num_write_kb":8916795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18708,"num_bytes_recovered":1227180160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161051,"ondisk_log_size":161051,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":9,"kb":937451520,"kb_used":13777856,"kb_used_data":7910832,"kb_used_omap":889,"kb_used_meta":5865862,"kb_avail":923673664,"statfs":{"total":959950356480,"available":945841831936,"internally_reserved":0,"allocated":8100691968,"data_stored":8097185730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":910339,"internal_metadata":6006643709},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,4,7,14,4,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-450953216,"num_objects":-6881,"num_object_clones":0,"num_object_copies":-13762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-2187,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-6881,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6881,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2187,"num_bytes_recovered":143327232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.961543"},"pg_stats":[{"pgid":"8.f","version":"703'13029","reported_seq":13282,"reported_epoch":703,"state":"active+clean","last_fresh":"2024-04-01T19:57:35.748199+0000","last_change":"2024-04-01T19:55:39.217150+0000","last_active":"2024-04-01T19:57:35.748199+0000","last_peered":"2024-04-01T19:57:35.748199+0000","last_clean":"2024-04-01T19:57:35.748199+0000","last_became_active":"2024-04-01T19:53:54.067307+0000","last_became_peered":"2024-04-01T19:53:54.067307+0000","last_unstale":"2024-04-01T19:57:35.748199+0000","last_undegraded":"2024-04-01T19:57:35.748199+0000","last_fullsized":"2024-04-01T19:57:35.748199+0000","mapping_epoch":629,"log_start":"649'3000","ondisk_log_start":"649'3000","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8876","last_scrub_stamp":"2024-04-01T19:55:39.216977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:39.216977+0000","objects_scrubbed":8773,"log_size":10029,"log_dups_size":0,"ondisk_log_size":10029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1863,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299696128,"num_objects":4573,"num_object_clones":0,"num_object_copies":9146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4573,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13029,"num_write_kb":563264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.e","version":"703'12749","reported_seq":12998,"reported_epoch":703,"state":"active+clean","last_fresh":"2024-04-01T19:57:35.600768+0000","last_change":"2024-04-01T19:55:33.528266+0000","last_active":"2024-04-01T19:57:35.600768+0000","last_peered":"2024-04-01T19:57:35.600768+0000","last_clean":"2024-04-01T19:57:35.600768+0000","last_became_active":"2024-04-01T19:53:54.066471+0000","last_became_peered":"2024-04-01T19:53:54.066471+0000","last_unstale":"2024-04-01T19:57:35.600768+0000","last_undegraded":"2024-04-01T19:57:35.600768+0000","last_fullsized":"2024-04-01T19:57:35.600768+0000","mapping_epoch":629,"log_start":"648'2700","ondisk_log_start":"648'2700","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'8369","last_scrub_stamp":"2024-04-01T19:55:33.528006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:33.528006+0000","objects_scrubbed":8332,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1210,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292093952,"num_objects":4457,"num_object_clones":0,"num_object_copies":8914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4457,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12749,"num_write_kb":550592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"703'13030","reported_seq":13282,"reported_epoch":703,"state":"active+clean","last_fresh":"2024-04-01T19:57:35.763603+0000","last_change":"2024-04-01T19:55:45.161755+0000","last_active":"2024-04-01T19:57:35.763603+0000","last_peered":"2024-04-01T19:57:35.763603+0000","last_clean":"2024-04-01T19:57:35.763603+0000","last_became_active":"2024-04-01T19:53:53.678991+0000","last_became_peered":"2024-04-01T19:53:53.678991+0000","last_unstale":"2024-04-01T19:57:35.763603+0000","last_undegraded":"2024-04-01T19:57:35.763603+0000","last_fullsized":"2024-04-01T19:57:35.763603+0000","mapping_epoch":629,"log_start":"649'3000","ondisk_log_start":"649'3000","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"674'9322","last_scrub_stamp":"2024-04-01T19:55:45.161618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:45.161618+0000","objects_scrubbed":8442,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1822,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306118680,"num_objects":4672,"num_object_clones":0,"num_object_copies":9344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4672,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13030,"num_write_kb":566401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.c","version":"703'12845","reported_seq":13164,"reported_epoch":703,"state":"active+clean","last_fresh":"2024-04-01T19:57:35.717989+0000","last_change":"2024-04-01T19:57:06.345540+0000","last_active":"2024-04-01T19:57:35.717989+0000","last_peered":"2024-04-01T19:57:35.717989+0000","last_clean":"2024-04-01T19:57:35.717989+0000","last_became_active":"2024-04-01T19:53:53.462634+0000","last_became_peered":"2024-04-01T19:53:53.462634+0000","last_unstale":"2024-04-01T19:57:35.717989+0000","last_undegraded":"2024-04-01T19:57:35.717989+0000","last_fullsized":"2024-04-01T19:57:35.717989+0000","mapping_epoch":629,"log_start":"648'2800","ondisk_log_start":"648'2800","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"695'11630","last_scrub_stamp":"2024-04-01T19:57:06.345285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:57:06.345285+0000","objects_scrubbed":5792,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:58:22.050371+0000","scrub_duration":1062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298778624,"num_objects":4559,"num_object_clones":0,"num_object_copies":9118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4559,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12845,"num_write_kb":556928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"8.b","version":"703'12981","reported_seq":13304,"reported_epoch":703,"state":"active+clean","last_fresh":"2024-04-01T19:57:34.427535+0000","last_change":"2024-04-01T19:56:59.305034+0000","last_active":"2024-04-01T19:57:34.427535+0000","last_peered":"2024-04-01T19:57:34.427535+0000","last_clean":"2024-04-01T19:57:34.427535+0000","last_became_active":"2024-04-01T19:53:53.456979+0000","last_became_peered":"2024-04-01T19:53:53.456979+0000","last_unstale":"2024-04-01T19:57:34.427535+0000","last_undegraded":"2024-04-01T19:57:34.427535+0000","last_fullsized":"2024-04-01T19:57:34.427535+0000","mapping_epoch":629,"log_start":"649'2900","ondisk_log_start":"649'2900","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"694'11454","last_scrub_stamp":"2024-04-01T19:56:59.304718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:56:59.304718+0000","objects_scrubbed":6290,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:58:02.508594+0000","scrub_duration":957,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310968320,"num_objects":4745,"num_object_clones":0,"num_object_copies":9490,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4745,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12981,"num_write_kb":567232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"8.a","version":"703'12572","reported_seq":12878,"reported_epoch":703,"state":"active+clean","last_fresh":"2024-04-01T19:57:34.420077+0000","last_change":"2024-04-01T19:56:21.853413+0000","last_active":"2024-04-01T19:57:34.420077+0000","last_peered":"2024-04-01T19:57:34.420077+0000","last_clean":"2024-04-01T19:57:34.420077+0000","last_became_active":"2024-04-01T19:53:54.066588+0000","last_became_peered":"2024-04-01T19:53:54.066588+0000","last_unstale":"2024-04-01T19:57:34.420077+0000","last_undegraded":"2024-04-01T19:57:34.420077+0000","last_fullsized":"2024-04-01T19:57:34.420077+0000","mapping_epoch":629,"log_start":"648'2500","ondisk_log_start":"648'2500","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"680'9768","last_scrub_stamp":"2024-04-01T19:56:21.853096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:56:21.853096+0000","objects_scrubbed":7384,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:57:37.729675+0000","scrub_duration":668,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300154880,"num_objects":4580,"num_object_clones":0,"num_object_copies":9160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4580,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12572,"num_write_kb":548864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"8.8","version":"703'12910","reported_seq":13162,"reported_epoch":703,"state":"active+clean","last_fresh":"2024-04-01T19:57:35.813280+0000","last_change":"2024-04-01T19:55:40.424211+0000","last_active":"2024-04-01T19:57:35.813280+0000","last_peered":"2024-04-01T19:57:35.813280+0000","last_clean":"2024-04-01T19:57:35.813280+0000","last_became_active":"2024-04-01T19:53:53.454737+0000","last_became_peered":"2024-04-01T19:53:53.454737+0000","last_unstale":"2024-04-01T19:57:35.813280+0000","last_undegraded":"2024-04-01T19:57:35.813280+0000","last_fullsized":"2024-04-01T19:57:35.813280+0000","mapping_epoch":629,"log_start":"649'2900","ondisk_log_start":"649'2900","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8915","last_scrub_stamp":"2024-04-01T19:55:40.424044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:40.424044+0000","objects_scrubbed":8661,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1277,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":303169536,"num_objects":4626,"num_object_clones":0,"num_object_copies":9252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4626,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12910,"num_write_kb":561152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"703'12858","reported_seq":20612,"reported_epoch":703,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:57:35.782720+0000","last_change":"2024-04-01T19:56:22.028676+0000","last_active":"2024-04-01T19:57:35.782720+0000","last_peered":"2024-04-01T19:57:35.782720+0000","last_clean":"2024-04-01T19:55:56.524590+0000","last_became_active":"2024-04-01T19:56:21.981743+0000","last_became_peered":"2024-04-01T19:56:21.981743+0000","last_unstale":"2024-04-01T19:57:35.782720+0000","last_undegraded":"2024-04-01T19:56:21.738659+0000","last_fullsized":"2024-04-01T19:57:35.782720+0000","mapping_epoch":687,"log_start":"648'2800","ondisk_log_start":"648'2800","created":629,"last_epoch_clean":641,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'9008","last_scrub_stamp":"2024-04-01T19:55:43.358714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:43.358714+0000","objects_scrubbed":8387,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"no scrub is scheduled","scrub_duration":2089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292814848,"num_objects":4468,"num_object_clones":0,"num_object_copies":8936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4466,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4468,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12858,"num_write_kb":554432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3746,"num_bytes_recovered":245432320,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":["11"],"object_location_counts":[{"shards":"2,11","objects":2},{"shards":"11","objects":4466}],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.6","version":"703'12899","reported_seq":20723,"reported_epoch":703,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:57:35.784192+0000","last_change":"2024-04-01T19:56:22.018466+0000","last_active":"2024-04-01T19:57:35.784192+0000","last_peered":"2024-04-01T19:57:35.784192+0000","last_clean":"2024-04-01T19:55:56.539057+0000","last_became_active":"2024-04-01T19:56:21.956699+0000","last_became_peered":"2024-04-01T19:56:21.956699+0000","last_unstale":"2024-04-01T19:57:35.784192+0000","last_undegraded":"2024-04-01T19:56:21.744926+0000","last_fullsized":"2024-04-01T19:57:35.784192+0000","mapping_epoch":687,"log_start":"648'2800","ondisk_log_start":"648'2800","created":629,"last_epoch_clean":642,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8615","last_scrub_stamp":"2024-04-01T19:55:36.688352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:36.688352+0000","objects_scrubbed":8556,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"no scrub is scheduled","scrub_duration":2331,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292880384,"num_objects":4469,"num_object_clones":0,"num_object_copies":8938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4466,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4469,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12899,"num_write_kb":555776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3781,"num_bytes_recovered":247595008,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":["11"],"object_location_counts":[{"shards":"7,11","objects":3},{"shards":"11","objects":4466}],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.5","version":"703'13025","reported_seq":20912,"reported_epoch":703,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:57:36.498086+0000","last_change":"2024-04-01T19:56:22.002998+0000","last_active":"2024-04-01T19:57:36.498086+0000","last_peered":"2024-04-01T19:57:36.498086+0000","last_clean":"2024-04-01T19:55:56.434043+0000","last_became_active":"2024-04-01T19:56:21.952684+0000","last_became_peered":"2024-04-01T19:56:21.952684+0000","last_unstale":"2024-04-01T19:57:36.498086+0000","last_undegraded":"2024-04-01T19:56:21.721301+0000","last_fullsized":"2024-04-01T19:57:36.498086+0000","mapping_epoch":687,"log_start":"649'3000","ondisk_log_start":"649'3000","created":629,"last_epoch_clean":644,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'8660","last_scrub_stamp":"2024-04-01T19:55:36.183547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:36.183547+0000","objects_scrubbed":8628,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"no scrub is scheduled","scrub_duration":1673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":296943616,"num_objects":4531,"num_object_clones":0,"num_object_copies":9062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4531,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4531,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13025,"num_write_kb":561792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3811,"num_bytes_recovered":249757696,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":4531}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.4","version":"703'15774","reported_seq":16230,"reported_epoch":703,"state":"active+clean","last_fresh":"2024-04-01T19:57:35.796692+0000","last_change":"2024-04-01T19:55:34.954183+0000","last_active":"2024-04-01T19:57:35.796692+0000","last_peered":"2024-04-01T19:57:35.796692+0000","last_clean":"2024-04-01T19:57:35.796692+0000","last_became_active":"2024-04-01T19:53:53.462894+0000","last_became_peered":"2024-04-01T19:53:53.462894+0000","last_unstale":"2024-04-01T19:57:35.796692+0000","last_undegraded":"2024-04-01T19:57:35.796692+0000","last_fullsized":"2024-04-01T19:57:35.796692+0000","mapping_epoch":629,"log_start":"658'5700","ondisk_log_start":"658'5700","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'11373","last_scrub_stamp":"2024-04-01T19:55:34.954011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:34.954011+0000","objects_scrubbed":8546,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295960576,"num_objects":4516,"num_object_clones":0,"num_object_copies":9032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4516,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13012,"num_write_kb":560896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"703'12788","reported_seq":13013,"reported_epoch":703,"state":"active+clean","last_fresh":"2024-04-01T19:57:35.711557+0000","last_change":"2024-04-01T19:54:55.108987+0000","last_active":"2024-04-01T19:57:35.711557+0000","last_peered":"2024-04-01T19:57:35.711557+0000","last_clean":"2024-04-01T19:57:35.711557+0000","last_became_active":"2024-04-01T19:53:53.462397+0000","last_became_peered":"2024-04-01T19:53:53.462397+0000","last_unstale":"2024-04-01T19:57:35.711557+0000","last_undegraded":"2024-04-01T19:57:35.711557+0000","last_fullsized":"2024-04-01T19:57:35.711557+0000","mapping_epoch":629,"log_start":"648'2700","ondisk_log_start":"648'2700","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"660'5871","last_scrub_stamp":"2024-04-01T19:54:55.108780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:54:55.108780+0000","objects_scrubbed":5824,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293994496,"num_objects":4486,"num_object_clones":0,"num_object_copies":8972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4486,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12788,"num_write_kb":552768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.2","version":"703'12587","reported_seq":20056,"reported_epoch":703,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:57:35.668441+0000","last_change":"2024-04-01T19:56:22.018621+0000","last_active":"2024-04-01T19:57:35.668441+0000","last_peered":"2024-04-01T19:57:35.668441+0000","last_clean":"2024-04-01T19:55:56.523442+0000","last_became_active":"2024-04-01T19:56:21.981766+0000","last_became_peered":"2024-04-01T19:56:21.981766+0000","last_unstale":"2024-04-01T19:57:35.668441+0000","last_undegraded":"2024-04-01T19:56:21.720612+0000","last_fullsized":"2024-04-01T19:57:35.668441+0000","mapping_epoch":687,"log_start":"648'2500","ondisk_log_start":"648'2500","created":629,"last_epoch_clean":645,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'8353","last_scrub_stamp":"2024-04-01T19:55:34.153804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:34.153804+0000","objects_scrubbed":8295,"log_size":10087,"log_dups_size":0,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"no scrub is scheduled","scrub_duration":1672,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297467904,"num_objects":4539,"num_object_clones":0,"num_object_copies":9078,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4530,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4539,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12587,"num_write_kb":548032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3605,"num_bytes_recovered":236126208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":4530},{"shards":"0,4","objects":9}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"703'15658","reported_seq":16193,"reported_epoch":703,"state":"active+clean","last_fresh":"2024-04-01T19:57:35.747004+0000","last_change":"2024-04-01T19:57:00.295446+0000","last_active":"2024-04-01T19:57:35.747004+0000","last_peered":"2024-04-01T19:57:35.747004+0000","last_clean":"2024-04-01T19:57:35.747004+0000","last_became_active":"2024-04-01T19:53:54.066680+0000","last_became_peered":"2024-04-01T19:53:54.066680+0000","last_unstale":"2024-04-01T19:57:35.747004+0000","last_undegraded":"2024-04-01T19:57:35.747004+0000","last_fullsized":"2024-04-01T19:57:35.747004+0000","mapping_epoch":629,"log_start":"658'5600","ondisk_log_start":"658'5600","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"694'14240","last_scrub_stamp":"2024-04-01T19:57:00.295287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:57:00.295287+0000","objects_scrubbed":6022,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:58:19.188940+0000","scrub_duration":983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300089344,"num_objects":4579,"num_object_clones":0,"num_object_copies":9158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4579,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12699,"num_write_kb":552896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"8.0","version":"703'12612","reported_seq":12935,"reported_epoch":703,"state":"active+clean","last_fresh":"2024-04-01T19:57:32.637147+0000","last_change":"2024-04-01T19:56:35.611718+0000","last_active":"2024-04-01T19:57:32.637147+0000","last_peered":"2024-04-01T19:57:32.637147+0000","last_clean":"2024-04-01T19:57:32.637147+0000","last_became_active":"2024-04-01T19:53:53.455265+0000","last_became_peered":"2024-04-01T19:53:53.455265+0000","last_unstale":"2024-04-01T19:57:32.637147+0000","last_undegraded":"2024-04-01T19:57:32.637147+0000","last_fullsized":"2024-04-01T19:57:32.637147+0000","mapping_epoch":629,"log_start":"648'2600","ondisk_log_start":"648'2600","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"689'10321","last_scrub_stamp":"2024-04-01T19:56:35.611492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:56:35.611492+0000","objects_scrubbed":6862,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:57:38.680310+0000","scrub_duration":1148,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297926656,"num_objects":4546,"num_object_clones":0,"num_object_copies":9092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4546,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12612,"num_write_kb":549056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"703'12995","reported_seq":20778,"reported_epoch":703,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:57:35.872154+0000","last_change":"2024-04-01T19:56:22.004749+0000","last_active":"2024-04-01T19:57:35.872154+0000","last_peered":"2024-04-01T19:57:35.872154+0000","last_clean":"2024-04-01T19:55:56.538683+0000","last_became_active":"2024-04-01T19:56:21.960415+0000","last_became_peered":"2024-04-01T19:56:21.960415+0000","last_unstale":"2024-04-01T19:57:35.872154+0000","last_undegraded":"2024-04-01T19:56:21.714140+0000","last_fullsized":"2024-04-01T19:57:35.872154+0000","mapping_epoch":687,"log_start":"649'2900","ondisk_log_start":"649'2900","created":629,"last_epoch_clean":645,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8889","last_scrub_stamp":"2024-04-01T19:55:39.237364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:39.237364+0000","objects_scrubbed":8775,"log_size":10095,"log_dups_size":0,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"no scrub is scheduled","scrub_duration":1706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302972928,"num_objects":4623,"num_object_clones":0,"num_object_copies":9246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4622,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4623,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12995,"num_write_kb":563776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3757,"num_bytes_recovered":246153216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":["5"],"object_location_counts":[{"shards":"0,5","objects":1},{"shards":"5","objects":4622}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":1732,"reported_epoch":703,"state":"active+clean","last_fresh":"2024-04-01T19:57:28.462976+0000","last_change":"2024-04-01T19:55:33.016809+0000","last_active":"2024-04-01T19:57:28.462976+0000","last_peered":"2024-04-01T19:57:28.462976+0000","last_clean":"2024-04-01T19:57:28.462976+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:57:28.462976+0000","last_undegraded":"2024-04-01T19:57:28.462976+0000","last_fullsized":"2024-04-01T19:57:28.462976+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:55:33.016695+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:55:33.016695+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":192,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":4782030872,"num_objects":72969,"num_object_clones":0,"num_object_copies":145938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":22615,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72969,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":205591,"num_write_kb":8913857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18700,"num_bytes_recovered":1225064448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10603274240,"data_stored":10603266096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160912,"ondisk_log_size":160912,"up":32,"acting":32,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220580,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2314096,"kb_used_data":1452648,"kb_used_omap":1,"kb_used_meta":861374,"kb_avail":91431056,"statfs":{"total":95995035648,"available":93625401344,"internally_reserved":0,"allocated":1487511552,"data_stored":1487154811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":882047428},"hb_peers":[0,1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,2,10,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678447,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1464804,"kb_used_data":878300,"kb_used_omap":1,"kb_used_meta":586494,"kb_avail":92280348,"statfs":{"total":95995035648,"available":94495076352,"internally_reserved":0,"allocated":899379200,"data_stored":899030103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":600570304},"hb_peers":[0,1,2,3,4,5,6,7,8,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557644,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1125284,"kb_used_data":894684,"kb_used_omap":132,"kb_used_meta":230459,"kb_avail":92619868,"statfs":{"total":95995035648,"available":94842744832,"internally_reserved":0,"allocated":916156416,"data_stored":915807319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":235990759},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234425,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":910128,"kb_used_data":305576,"kb_used_omap":1,"kb_used_meta":604542,"kb_avail":92835024,"statfs":{"total":95995035648,"available":95063064576,"internally_reserved":0,"allocated":312909824,"data_stored":312553103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":619051466},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":457,"seq":1962800054437,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":253668,"kb_used_data":668,"kb_used_omap":744,"kb_used_meta":252119,"kb_avail":93491484,"statfs":{"total":95995035648,"available":95735279616,"internally_reserved":0,"allocated":684032,"data_stored":334935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":762131,"internal_metadata":258170605},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":2452426326105,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738846,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1272356,"kb_used_data":577564,"kb_used_omap":1,"kb_used_meta":694782,"kb_avail":92472796,"statfs":{"total":95995035648,"available":94692143104,"internally_reserved":0,"allocated":591425536,"data_stored":591076439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":711457221},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346387,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1695332,"kb_used_data":1150492,"kb_used_omap":1,"kb_used_meta":544830,"kb_avail":92049820,"statfs":{"total":95995035648,"available":94259015680,"internally_reserved":0,"allocated":1178103808,"data_stored":1177754711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":557906373},"hb_peers":[0,1,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669150156,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1358372,"kb_used_data":596956,"kb_used_omap":1,"kb_used_meta":761406,"kb_avail":92386780,"statfs":{"total":95995035648,"available":94604062720,"internally_reserved":0,"allocated":611282944,"data_stored":610933847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":779680199},"hb_peers":[0,1,2,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953927,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1257124,"kb_used_data":594268,"kb_used_omap":1,"kb_used_meta":662846,"kb_avail":92488028,"statfs":{"total":95995035648,"available":94707740672,"internally_reserved":0,"allocated":608530432,"data_stored":608181335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":678754757},"hb_peers":[0,1,2,3,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,2,0,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790403,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2126692,"kb_used_data":1459676,"kb_used_omap":1,"kb_used_meta":667006,"kb_avail":91618460,"statfs":{"total":95995035648,"available":93817303040,"internally_reserved":0,"allocated":1494708224,"data_stored":1494359127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":683014597},"hb_peers":[0,1,2,3,4,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":589561856,"data_stored":589561856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1176961024,"data_stored":1176961024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":609026048,"data_stored":609026048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":602210304,"data_stored":602210304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1484521472,"data_stored":1484521472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":311824384,"data_stored":311820312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":913833984,"data_stored":913833984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":894959616,"data_stored":894959616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":2534604800,"data_stored":2534604800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":1485770752,"data_stored":1485766680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:57:39.094 INFO:tasks.cephadm.ceph_manager.ceph:PG 8.7 is not active+clean 2024-04-01T19:57:39.094 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '8.7', 'version': "703'12858", 'reported_seq': 20612, 'reported_epoch': 703, 'state': 'active+recovering+degraded', 'last_fresh': '2024-04-01T19:57:35.782720+0000', 'last_change': '2024-04-01T19:56:22.028676+0000', 'last_active': '2024-04-01T19:57:35.782720+0000', 'last_peered': '2024-04-01T19:57:35.782720+0000', 'last_clean': '2024-04-01T19:55:56.524590+0000', 'last_became_active': '2024-04-01T19:56:21.981743+0000', 'last_became_peered': '2024-04-01T19:56:21.981743+0000', 'last_unstale': '2024-04-01T19:57:35.782720+0000', 'last_undegraded': '2024-04-01T19:56:21.738659+0000', 'last_fullsized': '2024-04-01T19:57:35.782720+0000', 'mapping_epoch': 687, 'log_start': "648'2800", 'ondisk_log_start': "648'2800", 'created': 629, 'last_epoch_clean': 641, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "673'9008", 'last_scrub_stamp': '2024-04-01T19:55:43.358714+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T19:53:52.440963+0000', 'last_clean_scrub_stamp': '2024-04-01T19:55:43.358714+0000', 'objects_scrubbed': 8387, 'log_size': 10058, 'log_dups_size': 0, 'ondisk_log_size': 10058, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 3, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 2089, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 292814848, 'num_objects': 4468, 'num_object_clones': 0, 'num_object_copies': 8936, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 4466, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 4468, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 12858, 'num_write_kb': 554432, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 3746, 'num_bytes_recovered': 245432320, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [11, 2], 'acting': [11, 2], 'avail_no_missing': ['11'], 'object_location_counts': [{'shards': '2,11', 'objects': 2}, {'shards': '11', 'objects': 4466}], 'blocked_by': [], 'up_primary': 11, 'acting_primary': 11, 'purged_snaps': []} 2024-04-01T19:57:39.094 INFO:tasks.cephadm.ceph_manager.ceph:PG 8.6 is not active+clean 2024-04-01T19:57:39.094 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '8.6', 'version': "703'12899", 'reported_seq': 20723, 'reported_epoch': 703, 'state': 'active+recovering+degraded', 'last_fresh': '2024-04-01T19:57:35.784192+0000', 'last_change': '2024-04-01T19:56:22.018466+0000', 'last_active': '2024-04-01T19:57:35.784192+0000', 'last_peered': '2024-04-01T19:57:35.784192+0000', 'last_clean': '2024-04-01T19:55:56.539057+0000', 'last_became_active': '2024-04-01T19:56:21.956699+0000', 'last_became_peered': '2024-04-01T19:56:21.956699+0000', 'last_unstale': '2024-04-01T19:57:35.784192+0000', 'last_undegraded': '2024-04-01T19:56:21.744926+0000', 'last_fullsized': '2024-04-01T19:57:35.784192+0000', 'mapping_epoch': 687, 'log_start': "648'2800", 'ondisk_log_start': "648'2800", 'created': 629, 'last_epoch_clean': 642, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "673'8615", 'last_scrub_stamp': '2024-04-01T19:55:36.688352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T19:53:52.440963+0000', 'last_clean_scrub_stamp': '2024-04-01T19:55:36.688352+0000', 'objects_scrubbed': 8556, 'log_size': 10099, 'log_dups_size': 0, 'ondisk_log_size': 10099, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 3, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 2331, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 292880384, 'num_objects': 4469, 'num_object_clones': 0, 'num_object_copies': 8938, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 4466, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 4469, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 12899, 'num_write_kb': 555776, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 3781, 'num_bytes_recovered': 247595008, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [11, 7], 'acting': [11, 7], 'avail_no_missing': ['11'], 'object_location_counts': [{'shards': '7,11', 'objects': 3}, {'shards': '11', 'objects': 4466}], 'blocked_by': [], 'up_primary': 11, 'acting_primary': 11, 'purged_snaps': []} 2024-04-01T19:57:39.095 INFO:tasks.cephadm.ceph_manager.ceph:PG 8.5 is not active+clean 2024-04-01T19:57:39.095 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '8.5', 'version': "703'13025", 'reported_seq': 20912, 'reported_epoch': 703, 'state': 'active+recovering+degraded', 'last_fresh': '2024-04-01T19:57:36.498086+0000', 'last_change': '2024-04-01T19:56:22.002998+0000', 'last_active': '2024-04-01T19:57:36.498086+0000', 'last_peered': '2024-04-01T19:57:36.498086+0000', 'last_clean': '2024-04-01T19:55:56.434043+0000', 'last_became_active': '2024-04-01T19:56:21.952684+0000', 'last_became_peered': '2024-04-01T19:56:21.952684+0000', 'last_unstale': '2024-04-01T19:57:36.498086+0000', 'last_undegraded': '2024-04-01T19:56:21.721301+0000', 'last_fullsized': '2024-04-01T19:57:36.498086+0000', 'mapping_epoch': 687, 'log_start': "649'3000", 'ondisk_log_start': "649'3000", 'created': 629, 'last_epoch_clean': 644, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "672'8660", 'last_scrub_stamp': '2024-04-01T19:55:36.183547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T19:53:52.440963+0000', 'last_clean_scrub_stamp': '2024-04-01T19:55:36.183547+0000', 'objects_scrubbed': 8628, 'log_size': 10025, 'log_dups_size': 0, 'ondisk_log_size': 10025, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 2, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 1673, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 296943616, 'num_objects': 4531, 'num_object_clones': 0, 'num_object_copies': 9062, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 4531, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 4531, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 13025, 'num_write_kb': 561792, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 3811, 'num_bytes_recovered': 249757696, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 11], 'acting': [4, 11], 'avail_no_missing': ['4'], 'object_location_counts': [{'shards': '4', 'objects': 4531}], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-01T19:57:39.095 INFO:tasks.cephadm.ceph_manager.ceph:PG 8.2 is not active+clean 2024-04-01T19:57:39.095 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '8.2', 'version': "703'12587", 'reported_seq': 20056, 'reported_epoch': 703, 'state': 'active+recovering+degraded', 'last_fresh': '2024-04-01T19:57:35.668441+0000', 'last_change': '2024-04-01T19:56:22.018621+0000', 'last_active': '2024-04-01T19:57:35.668441+0000', 'last_peered': '2024-04-01T19:57:35.668441+0000', 'last_clean': '2024-04-01T19:55:56.523442+0000', 'last_became_active': '2024-04-01T19:56:21.981766+0000', 'last_became_peered': '2024-04-01T19:56:21.981766+0000', 'last_unstale': '2024-04-01T19:57:35.668441+0000', 'last_undegraded': '2024-04-01T19:56:21.720612+0000', 'last_fullsized': '2024-04-01T19:57:35.668441+0000', 'mapping_epoch': 687, 'log_start': "648'2500", 'ondisk_log_start': "648'2500", 'created': 629, 'last_epoch_clean': 645, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "672'8353", 'last_scrub_stamp': '2024-04-01T19:55:34.153804+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T19:53:52.440963+0000', 'last_clean_scrub_stamp': '2024-04-01T19:55:34.153804+0000', 'objects_scrubbed': 8295, 'log_size': 10087, 'log_dups_size': 0, 'ondisk_log_size': 10087, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 2, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 1672, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 297467904, 'num_objects': 4539, 'num_object_clones': 0, 'num_object_copies': 9078, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 4530, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 4539, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 12587, 'num_write_kb': 548032, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 3605, 'num_bytes_recovered': 236126208, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': ['0'], 'object_location_counts': [{'shards': '0', 'objects': 4530}, {'shards': '0,4', 'objects': 9}], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-01T19:57:39.095 INFO:tasks.cephadm.ceph_manager.ceph:PG 8.9 is not active+clean 2024-04-01T19:57:39.095 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '8.9', 'version': "703'12995", 'reported_seq': 20778, 'reported_epoch': 703, 'state': 'active+recovering+degraded', 'last_fresh': '2024-04-01T19:57:35.872154+0000', 'last_change': '2024-04-01T19:56:22.004749+0000', 'last_active': '2024-04-01T19:57:35.872154+0000', 'last_peered': '2024-04-01T19:57:35.872154+0000', 'last_clean': '2024-04-01T19:55:56.538683+0000', 'last_became_active': '2024-04-01T19:56:21.960415+0000', 'last_became_peered': '2024-04-01T19:56:21.960415+0000', 'last_unstale': '2024-04-01T19:57:35.872154+0000', 'last_undegraded': '2024-04-01T19:56:21.714140+0000', 'last_fullsized': '2024-04-01T19:57:35.872154+0000', 'mapping_epoch': 687, 'log_start': "649'2900", 'ondisk_log_start': "649'2900", 'created': 629, 'last_epoch_clean': 645, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "673'8889", 'last_scrub_stamp': '2024-04-01T19:55:39.237364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T19:53:52.440963+0000', 'last_clean_scrub_stamp': '2024-04-01T19:55:39.237364+0000', 'objects_scrubbed': 8775, 'log_size': 10095, 'log_dups_size': 0, 'ondisk_log_size': 10095, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 2, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 1706, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 302972928, 'num_objects': 4623, 'num_object_clones': 0, 'num_object_copies': 9246, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 4622, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 4623, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 12995, 'num_write_kb': 563776, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 3757, 'num_bytes_recovered': 246153216, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': ['5'], 'object_location_counts': [{'shards': '0,5', 'objects': 1}, {'shards': '5', 'objects': 4622}], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-01T19:57:39.095 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph status --format=json 2024-04-01T19:57:39.096 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:39.312 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:57:39.319 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:39.319 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:57:39.420 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:57:39.424 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:57:39.464 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:39.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:39 smithi022 ceph-mon[39439]: from='client.17235 v1:172.21.15.22:0/1952758224' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:57:39.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:39 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3957237537' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:57:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:39 smithi062 ceph-mon[44211]: from='client.17235 v1:172.21.15.22:0/1952758224' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:57:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:39 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3957237537' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:57:39.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:39 smithi188 ceph-mon[43939]: from='client.17235 v1:172.21.15.22:0/1952758224' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:57:39.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:39 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3957237537' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:57:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:40 smithi062 ceph-mon[44211]: pgmap v1927: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.4 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 630 op/s; 22615/145496 objects degraded (15.543%); 12 MiB/s, 199 objects/s recovering 2024-04-01T19:57:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:40 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:57:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:40 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3957237537' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:57:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:40 smithi062 ceph-mon[44211]: osdmap e704: 12 total, 11 up, 10 in 2024-04-01T19:57:40.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:40 smithi022 ceph-mon[39439]: pgmap v1927: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.4 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 630 op/s; 22615/145496 objects degraded (15.543%); 12 MiB/s, 199 objects/s recovering 2024-04-01T19:57:40.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:40 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:57:40.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:40 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3957237537' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:57:40.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:40 smithi022 ceph-mon[39439]: osdmap e704: 12 total, 11 up, 10 in 2024-04-01T19:57:40.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:40 smithi188 ceph-mon[43939]: pgmap v1927: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.4 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 630 op/s; 22615/145496 objects degraded (15.543%); 12 MiB/s, 199 objects/s recovering 2024-04-01T19:57:40.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:40 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:57:40.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:40 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3957237537' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:57:40.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:40 smithi188 ceph-mon[43939]: osdmap e704: 12 total, 11 up, 10 in 2024-04-01T19:57:41.328 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:57:41.333 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:41.333 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:57:41.434 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:57:41.473 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:41.502 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:57:41.505 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:41.505 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:57:41.606 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:57:41.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:41 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 22615/145496 objects degraded (15.543%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:41.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:41 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:57:41.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:41 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:57:41.647 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:41.678 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:57:41.686 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:41.686 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:57:41.736 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:41 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 22615/145496 objects degraded (15.543%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:41.736 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:41 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:57:41.736 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:41 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:57:41.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:41 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 22615/145496 objects degraded (15.543%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:41.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:41 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:57:41.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:41 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:57:41.786 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:57:41.834 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:41.868 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:57:41.875 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:41.876 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:57:41.977 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:57:42.020 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:42.131 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:57:42.138 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:42.138 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:57:42.239 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:57:42.276 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:42.311 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:57:42.317 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:42.318 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:57:42.419 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:57:42.458 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:42.473 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_historic_ops 2024-04-01T19:57:42.486 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:57:42.492 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:42.493 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:57:42.594 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:57:42.627 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:42.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:42 smithi062 ceph-mon[44211]: pgmap v1929: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.2 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 703 op/s; 21733/139236 objects degraded (15.609%); 14 MiB/s, 219 objects/s recovering 2024-04-01T19:57:42.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:42 smithi062 ceph-mon[44211]: osdmap e705: 12 total, 11 up, 10 in 2024-04-01T19:57:42.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:42 smithi022 ceph-mon[39439]: pgmap v1929: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.2 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 703 op/s; 21733/139236 objects degraded (15.609%); 14 MiB/s, 219 objects/s recovering 2024-04-01T19:57:42.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:42 smithi022 ceph-mon[39439]: osdmap e705: 12 total, 11 up, 10 in 2024-04-01T19:57:42.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:42 smithi188 ceph-mon[43939]: pgmap v1929: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.2 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 703 op/s; 21733/139236 objects degraded (15.609%); 14 MiB/s, 219 objects/s recovering 2024-04-01T19:57:42.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:42 smithi188 ceph-mon[43939]: osdmap e705: 12 total, 11 up, 10 in 2024-04-01T19:57:42.893 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:57:43.118 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:57:43.125 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:43.125 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:57:43.226 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:57:43.287 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:43.341 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:57:43.346 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:43.347 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:57:43.448 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:57:43.484 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:43.552 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:57:43.560 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:57:43.572 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:43.572 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:57:43.673 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:57:43.715 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:43.828 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:57:43.836 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:43.836 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:57:43.937 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:57:43.994 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:44.462 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:57:44.467 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:44.468 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:57:44.569 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:57:44.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:44 smithi022 ceph-mon[39439]: pgmap v1931: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.2 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 822 op/s; 21516/138362 objects degraded (15.551%); 17 MiB/s, 274 objects/s recovering 2024-04-01T19:57:44.630 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:44.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:44 smithi062 ceph-mon[44211]: pgmap v1931: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.2 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 822 op/s; 21516/138362 objects degraded (15.551%); 17 MiB/s, 274 objects/s recovering 2024-04-01T19:57:44.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:44 smithi188 ceph-mon[43939]: pgmap v1931: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.2 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 822 op/s; 21516/138362 objects degraded (15.551%); 17 MiB/s, 274 objects/s recovering 2024-04-01T19:57:45.160 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:57:45.307 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:57:45.336 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:57:45.361 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:57:45.395 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:57:45.438 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:57:45.475 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:57:45.511 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:57:45.541 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:57:45.563 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:57:45.591 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:57:45.602 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:45.602 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:57:45.604 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:57:45.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:45 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4158979008' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:57:45.639 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:57:45.639 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:57:45.639 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:57:45.639 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:57:45.639 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:57:45.639 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:57:45.639 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:57:45.640 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:57:45.640 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:57:45.640 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:57:45.640 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:57:45.640 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.10 2024-04-01T19:57:45.640 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:57:45.703 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:57:45.738 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:45 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4158979008' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:57:45.740 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:45.769 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:57:45.773 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:45.774 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:57:45.846 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:45 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4158979008' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:57:45.874 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:57:45.908 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:45.937 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:57:45.946 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:45.947 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:57:46.047 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:57:46.089 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:46.198 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:57:46.202 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:46.202 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:57:46.303 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:57:46.342 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:46.379 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:57:46.382 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:46.382 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:57:46.483 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:57:46.523 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:46.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:46 smithi062 ceph-mon[44211]: pgmap v1932: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.2 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 536 op/s; 21516/137358 objects degraded (15.664%); 8.6 MiB/s, 137 objects/s recovering 2024-04-01T19:57:46.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:46 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 21516/137358 objects degraded (15.664%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:46.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:46 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:46 smithi022 ceph-mon[39439]: pgmap v1932: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.2 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 536 op/s; 21516/137358 objects degraded (15.664%); 8.6 MiB/s, 137 objects/s recovering 2024-04-01T19:57:46.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:46 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 21516/137358 objects degraded (15.664%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:46.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:46 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:46 smithi188 ceph-mon[43939]: pgmap v1932: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.2 GiB data, 13 GiB used, 881 GiB / 894 GiB avail; 0 B/s wr, 536 op/s; 21516/137358 objects degraded (15.664%); 8.6 MiB/s, 137 objects/s recovering 2024-04-01T19:57:46.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:46 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 21516/137358 objects degraded (15.664%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:46.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:46.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:46 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:57:47.380 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:57:47.383 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:47.384 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:57:47.470 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:57:47.471 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:57:47.485 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:57:47.530 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:47.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:47 smithi062 ceph-mon[44211]: pgmap v1933: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.0 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 877 op/s; 20383/131452 objects degraded (15.506%); 17 MiB/s, 278 objects/s recovering 2024-04-01T19:57:47.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:47 smithi022 ceph-mon[39439]: pgmap v1933: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.0 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 877 op/s; 20383/131452 objects degraded (15.506%); 17 MiB/s, 278 objects/s recovering 2024-04-01T19:57:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:47 smithi188 ceph-mon[43939]: pgmap v1933: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.0 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 877 op/s; 20383/131452 objects degraded (15.506%); 17 MiB/s, 278 objects/s recovering 2024-04-01T19:57:48.822 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:57:48.864 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:57:48.864 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:57:48.928 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:57:48.939 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:48.940 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:57:49.040 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:57:49.040 INFO:teuthology.orchestra.run.smithi022.stdout:{"fsid":"09f6b846-f05c-11ee-b647-cb9ed24678a4","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noscrub,nodeep-scrub flag(s) set","count":20},"muted":false},"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 20383/131452 objects degraded (15.506%), 5 pgs degraded","count":5},"muted":false}},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":2416,"monmap":{"epoch":3,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":705,"num_osds":12,"num_up_osds":11,"osd_up_since":1712001356,"num_in_osds":10,"osd_in_since":1712001380,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":12},{"state_name":"active+recovering+degraded","count":5}],"num_pgs":17,"num_pools":2,"num_objects":65726,"data_bytes":4307812920,"bytes_used":13296001024,"bytes_avail":946654355456,"bytes_total":959950356480,"degraded_objects":20383,"degraded_total":131452,"degraded_ratio":0.15506040227611601,"recovering_objects_per_sec":278,"recovering_bytes_per_sec":18273132,"recovering_keys_per_sec":0,"num_objects_recovered":2232,"num_bytes_recovered":146276352,"num_keys_recovered":0,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":877},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["cephadm","dashboard","iostat","nfs","restful"],"services":{"dashboard":"https://172.21.15.22:8443/"}},"servicemap":{"epoch":50,"modified":"2024-04-01T19:56:43.370770+0000","services":{}},"progress_events":{}} 2024-04-01T19:57:49.040 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:57:49.100 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:49.147 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:57:49.154 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:49.154 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:57:49.255 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:57:49.296 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:49.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:49 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/145943405' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-04-01T19:57:49.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:49 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/145943405' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-04-01T19:57:49.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:49 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/145943405' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-04-01T19:57:49.852 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:57:49.857 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:49.858 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:57:49.959 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:57:50.003 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:50.031 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:57:50.038 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:50.038 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:57:50.103 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_ops_in_flight 2024-04-01T19:57:50.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:50 smithi022 ceph-mon[39439]: pgmap v1934: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.0 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 725 op/s; 20383/131004 objects degraded (15.559%); 14 MiB/s, 223 objects/s recovering 2024-04-01T19:57:50.139 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:57:50.175 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:50.210 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:57:50.213 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:50.214 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:57:50.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:50 smithi062 ceph-mon[44211]: pgmap v1934: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.0 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 725 op/s; 20383/131004 objects degraded (15.559%); 14 MiB/s, 223 objects/s recovering 2024-04-01T19:57:50.314 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:57:50.351 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:50.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:50 smithi188 ceph-mon[43939]: pgmap v1934: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 4.0 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 725 op/s; 20383/131004 objects degraded (15.559%); 14 MiB/s, 223 objects/s recovering 2024-04-01T19:57:50.381 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:57:50.385 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:50.385 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:57:50.486 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:57:50.524 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:50.560 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:57:50.571 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:50.571 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:57:50.595 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:57:50.672 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:57:50.712 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:50.741 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:57:50.744 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:50.745 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:57:50.845 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:57:50.865 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:57:50.885 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:50.914 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:57:50.919 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:50.919 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:57:50.991 INFO:tasks.cephadm.ceph_manager.ceph:making progress, resetting timeout 2024-04-01T19:57:50.992 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:57:51.020 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:57:51.108 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:51.304 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:57:51.308 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:51.309 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:57:51.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:51 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 20383/131004 objects degraded (15.559%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:51.340 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:51 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 20383/131004 objects degraded (15.559%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:51.410 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:57:51.457 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:51.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:51 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 20383/131004 objects degraded (15.559%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:51.672 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:57:51.682 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:51.682 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:57:51.731 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:57:51.746 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:57:51.783 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:57:51.827 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:52.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:52 smithi022 ceph-mon[39439]: pgmap v1935: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 3.8 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 751 op/s; 19496/124196 objects degraded (15.698%); 14 MiB/s, 223 objects/s recovering 2024-04-01T19:57:52.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:52 smithi188 ceph-mon[43939]: pgmap v1935: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 3.8 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 751 op/s; 19496/124196 objects degraded (15.698%); 14 MiB/s, 223 objects/s recovering 2024-04-01T19:57:52.390 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:57:52.395 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:52.395 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:57:52.496 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:57:52.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:52 smithi062 ceph-mon[44211]: pgmap v1935: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 3.8 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 751 op/s; 19496/124196 objects degraded (15.698%); 14 MiB/s, 223 objects/s recovering 2024-04-01T19:57:52.555 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:52.809 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:57:52.813 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:52.813 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:57:52.914 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:57:52.961 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:52.987 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:57:52.993 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:52.994 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:57:53.095 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:57:53.109 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:53 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3787730575' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:57:53.119 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:53 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3787730575' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:57:53.129 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:57:53.132 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:53.160 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:57:53.164 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:53.165 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:57:53.199 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:57:53.199 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:57:53.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:53 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3787730575' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:57:53.266 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:57:53.316 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:53.342 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:57:53.349 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:53.350 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:57:53.451 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:57:53.500 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:53.540 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:57:53.544 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:53.545 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:57:53.646 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:57:53.681 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:53.715 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:57:53.722 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:53.723 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:57:53.824 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:57:53.868 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:54.049 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_blocked_ops 2024-04-01T19:57:54.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:54 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:57:54.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:54 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3787730575' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:57:54.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:54 smithi022 ceph-mon[39439]: osdmap e706: 12 total, 11 up, 10 in 2024-04-01T19:57:54.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:54 smithi022 ceph-mon[39439]: pgmap v1937: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 3.8 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 754 op/s; 19255/123258 objects degraded (15.622%); 14 MiB/s, 225 objects/s recovering 2024-04-01T19:57:54.379 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:54 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:57:54.380 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:54 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3787730575' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:57:54.380 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:54 smithi188 ceph-mon[43939]: osdmap e706: 12 total, 11 up, 10 in 2024-04-01T19:57:54.380 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:54 smithi188 ceph-mon[43939]: pgmap v1937: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 3.8 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 754 op/s; 19255/123258 objects degraded (15.622%); 14 MiB/s, 225 objects/s recovering 2024-04-01T19:57:54.449 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:57:54.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:54 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:57:54.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:54 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3787730575' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:57:54.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:54 smithi062 ceph-mon[44211]: osdmap e706: 12 total, 11 up, 10 in 2024-04-01T19:57:54.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:54 smithi062 ceph-mon[44211]: pgmap v1937: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 3.8 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 754 op/s; 19255/123258 objects degraded (15.622%); 14 MiB/s, 225 objects/s recovering 2024-04-01T19:57:56.335 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:57:56.341 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:56.341 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:57:56.443 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:57:56.490 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:56.517 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:57:56.525 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:56.526 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:57:56.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:56 smithi022 ceph-mon[39439]: pgmap v1938: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 3.7 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 746 op/s; 19255/122428 objects degraded (15.728%); 14 MiB/s, 225 objects/s recovering 2024-04-01T19:57:56.614 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:56 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 19255/122428 objects degraded (15.728%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:56.627 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:57:56.683 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:56.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:56 smithi062 ceph-mon[44211]: pgmap v1938: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 3.7 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 746 op/s; 19255/122428 objects degraded (15.728%); 14 MiB/s, 225 objects/s recovering 2024-04-01T19:57:56.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:56 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 19255/122428 objects degraded (15.728%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:56.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:56 smithi188 ceph-mon[43939]: pgmap v1938: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 3.7 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 746 op/s; 19255/122428 objects degraded (15.728%); 14 MiB/s, 225 objects/s recovering 2024-04-01T19:57:56.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:56 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 19255/122428 objects degraded (15.728%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:57:57.146 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:57:57.155 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:57.155 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:57:57.256 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:57:57.299 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:57.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:57 smithi062 ceph-mon[44211]: 8.0 scrub starts 2024-04-01T19:57:57.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:57 smithi062 ceph-mon[44211]: 8.a scrub starts 2024-04-01T19:57:57.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:57 smithi022 ceph-mon[39439]: 8.0 scrub starts 2024-04-01T19:57:57.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:57 smithi022 ceph-mon[39439]: 8.a scrub starts 2024-04-01T19:57:57.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:57 smithi188 ceph-mon[43939]: 8.0 scrub starts 2024-04-01T19:57:57.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:57 smithi188 ceph-mon[43939]: 8.a scrub starts 2024-04-01T19:57:57.970 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:57:57.976 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:57.976 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:57:58.077 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:57:58.116 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:58.147 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:57:58.155 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:58.156 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:57:58.256 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:57:58.298 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:58.359 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:57:58.477 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:57:58.486 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:58.486 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:57:58.495 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:58 smithi022 ceph-mon[39439]: 8.0 scrub ok 2024-04-01T19:57:58.495 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:58 smithi022 ceph-mon[39439]: 8.a scrub ok 2024-04-01T19:57:58.496 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:58 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:57:58.496 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:58 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:57:58.496 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:58 smithi022 ceph-mon[39439]: pgmap v1939: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 3.6 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 749 op/s; 18070/116462 objects degraded (15.516%); 14 MiB/s, 231 objects/s recovering 2024-04-01T19:57:58.496 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:58 smithi022 ceph-mon[39439]: osdmap e707: 12 total, 11 up, 10 in 2024-04-01T19:57:58.587 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:57:58.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:58 smithi188 ceph-mon[43939]: 8.0 scrub ok 2024-04-01T19:57:58.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:58 smithi188 ceph-mon[43939]: 8.a scrub ok 2024-04-01T19:57:58.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:58 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:57:58.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:58 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:57:58.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:58 smithi188 ceph-mon[43939]: pgmap v1939: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 3.6 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 749 op/s; 18070/116462 objects degraded (15.516%); 14 MiB/s, 231 objects/s recovering 2024-04-01T19:57:58.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:58 smithi188 ceph-mon[43939]: osdmap e707: 12 total, 11 up, 10 in 2024-04-01T19:57:58.626 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:58.658 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:57:58.661 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:57:58.662 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:57:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:58 smithi062 ceph-mon[44211]: 8.0 scrub ok 2024-04-01T19:57:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:58 smithi062 ceph-mon[44211]: 8.a scrub ok 2024-04-01T19:57:58.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:58 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:57:58.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:58 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:57:58.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:58 smithi062 ceph-mon[44211]: pgmap v1939: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 3.6 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 749 op/s; 18070/116462 objects degraded (15.516%); 14 MiB/s, 231 objects/s recovering 2024-04-01T19:57:58.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:58 smithi062 ceph-mon[44211]: osdmap e707: 12 total, 11 up, 10 in 2024-04-01T19:57:58.763 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:57:58.804 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:57:59.472 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:57:59 smithi022 ceph-mon[39439]: pgmap v1941: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 3.5 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 509 op/s; 18070/116036 objects degraded (15.573%); 11 MiB/s, 178 objects/s recovering 2024-04-01T19:57:59.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:57:59 smithi062 ceph-mon[44211]: pgmap v1941: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 3.5 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 509 op/s; 18070/116036 objects degraded (15.573%); 11 MiB/s, 178 objects/s recovering 2024-04-01T19:57:59.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:57:59 smithi188 ceph-mon[43939]: pgmap v1941: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 3.5 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 0 B/s wr, 509 op/s; 18070/116036 objects degraded (15.573%); 11 MiB/s, 178 objects/s recovering 2024-04-01T19:58:00.069 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:58:00.072 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:00.073 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:58:00.174 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:58:00.213 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:00.243 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:58:00.248 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:00.249 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:58:00.350 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:58:00.383 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:00.844 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:58:00.847 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:00 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 18070/116036 objects degraded (15.573%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:00.847 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:00.848 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:58:00.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:00 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 18070/116036 objects degraded (15.573%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:00.948 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:58:00.991 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:01.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:00 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 18070/116036 objects degraded (15.573%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:01.018 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:58:01.026 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:01.026 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:58:01.127 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:58:01.157 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:01.498 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:58:01.537 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:58:01.540 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:58:01.589 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:58:01.635 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:58:01.658 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:58:01.671 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:01.671 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:58:01.682 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:58:01.723 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:58:01.761 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:58:01.772 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:58:01.801 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:58:01.818 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:01 smithi188 ceph-mon[43939]: pgmap v1942: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 3.3 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 849 op/s; 17069/109212 objects degraded (15.629%); 17 MiB/s, 264 objects/s recovering 2024-04-01T19:58:01.818 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:01 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1939235794' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:58:01.824 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:01.840 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:58:01.840 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:58:01.842 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:58:01.865 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:01 smithi022 ceph-mon[39439]: pgmap v1942: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 3.3 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 849 op/s; 17069/109212 objects degraded (15.629%); 17 MiB/s, 264 objects/s recovering 2024-04-01T19:58:01.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:01 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1939235794' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:58:01.882 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:58:01.910 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:58:01.910 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:58:01.911 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:58:01.911 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:58:01.911 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:58:01.911 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:58:01.911 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:58:01.911 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:58:01.911 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:58:01.911 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:58:01.911 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:58:01.911 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.10 2024-04-01T19:58:01.911 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:58:01.949 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:58:01.955 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:01.955 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:58:02.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:01 smithi062 ceph-mon[44211]: pgmap v1942: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 3.3 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 849 op/s; 17069/109212 objects degraded (15.629%); 17 MiB/s, 264 objects/s recovering 2024-04-01T19:58:02.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:01 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1939235794' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:58:02.056 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:58:02.110 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:02.294 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:58:02.294 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T19:58:02.294 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-01T19:58:02.294 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-01T19:58:02.294 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:58:02.593 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:02.593 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:02.593 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:02.593 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:02.593 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:02.593 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:02.593 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:02 smithi188 ceph-mon[43939]: from='client.37298 v1:172.21.15.22:0/1281098163' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:58:02.593 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:02.593 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:02.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:02.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:02.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:02.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:02.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:02.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:02.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:02 smithi022 ceph-mon[39439]: from='client.37298 v1:172.21.15.22:0/1281098163' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:58:02.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:02.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:03.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:03.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:03.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:03.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:03.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:03.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:03.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:02 smithi062 ceph-mon[44211]: from='client.37298 v1:172.21.15.22:0/1281098163' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:58:03.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:03.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:03.491 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:58:03.496 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:03.496 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:58:03.597 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:58:03.640 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:03.678 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:58:03.681 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:03.681 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:58:03.782 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:58:03.819 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:03.819 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:03.819 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:03.819 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:03 smithi022 ceph-mon[39439]: pgmap v1943: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 3.3 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 746 op/s; 16853/108332 objects degraded (15.557%); 15 MiB/s, 240 objects/s recovering 2024-04-01T19:58:03.831 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:03.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:03.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:03.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:03.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:03 smithi188 ceph-mon[43939]: pgmap v1943: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 3.3 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 746 op/s; 16853/108332 objects degraded (15.557%); 15 MiB/s, 240 objects/s recovering 2024-04-01T19:58:04.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:04.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:04.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:04.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:03 smithi062 ceph-mon[44211]: pgmap v1943: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 3.3 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 746 op/s; 16853/108332 objects degraded (15.557%); 15 MiB/s, 240 objects/s recovering 2024-04-01T19:58:04.025 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_historic_ops 2024-04-01T19:58:04.186 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:58:04.189 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:04.190 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:58:04.291 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:58:04.332 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:04.366 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:58:04.369 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:04.369 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:58:04.470 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:58:04.535 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:04.695 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:58:04.702 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:04.702 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:58:04.777 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:58:04.777 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:58:04.803 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:58:04.808 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:58:04.836 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:04.848 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:04 smithi188 ceph-mon[43939]: 8.b scrub starts 2024-04-01T19:58:04.863 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:58:04.866 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:04.867 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:58:04.968 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:58:05.032 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:05.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:04 smithi022 ceph-mon[39439]: 8.b scrub starts 2024-04-01T19:58:05.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:04 smithi062 ceph-mon[44211]: 8.b scrub starts 2024-04-01T19:58:05.854 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:05 smithi022 ceph-mon[39439]: 8.b scrub ok 2024-04-01T19:58:05.854 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:05 smithi022 ceph-mon[39439]: pgmap v1944: 17 pgs: 1 active+clean+scrubbing, 5 active+recovering+degraded, 11 active+clean; 3.3 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 751 op/s; 16853/107398 objects degraded (15.692%); 15 MiB/s, 240 objects/s recovering 2024-04-01T19:58:05.854 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:05 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 16853/108332 objects degraded (15.557%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:06.075 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":1942,"stamp":"2024-04-01T19:58:01.394857+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3579052600,"num_objects":54606,"num_object_clones":0,"num_object_copies":109212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":17069,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54606,"num_whiteouts":0,"num_read":127,"num_read_kb":110,"num_write":224137,"num_write_kb":8916795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24254,"num_bytes_recovered":1590642816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161016,"ondisk_log_size":161016,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":9,"kb":937451520,"kb_used":11915908,"kb_used_data":6010156,"kb_used_omap":889,"kb_used_meta":5904710,"kb_avail":925535612,"statfs":{"total":959950356480,"available":947748466688,"internally_reserved":0,"allocated":6154399744,"data_stored":6150670358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":910339,"internal_metadata":6046424061},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-460259328,"num_objects":-7023,"num_object_clones":0,"num_object_copies":-14046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-2186,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7023,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7023,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2186,"num_bytes_recovered":143261696,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.268615"},"pg_stats":[{"pgid":"8.f","version":"707'14198","reported_seq":14458,"reported_epoch":707,"state":"active+clean","last_fresh":"2024-04-01T19:58:00.963492+0000","last_change":"2024-04-01T19:55:39.217150+0000","last_active":"2024-04-01T19:58:00.963492+0000","last_peered":"2024-04-01T19:58:00.963492+0000","last_clean":"2024-04-01T19:58:00.963492+0000","last_became_active":"2024-04-01T19:53:54.067307+0000","last_became_peered":"2024-04-01T19:53:54.067307+0000","last_unstale":"2024-04-01T19:58:00.963492+0000","last_undegraded":"2024-04-01T19:58:00.963492+0000","last_fullsized":"2024-04-01T19:58:00.963492+0000","mapping_epoch":629,"log_start":"653'4100","ondisk_log_start":"653'4100","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8876","last_scrub_stamp":"2024-04-01T19:55:39.216977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:39.216977+0000","objects_scrubbed":8773,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1863,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223084544,"num_objects":3404,"num_object_clones":0,"num_object_copies":6808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3404,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14198,"num_write_kb":563264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.e","version":"707'13848","reported_seq":14105,"reported_epoch":707,"state":"active+clean","last_fresh":"2024-04-01T19:58:00.706207+0000","last_change":"2024-04-01T19:55:33.528266+0000","last_active":"2024-04-01T19:58:00.706207+0000","last_peered":"2024-04-01T19:58:00.706207+0000","last_clean":"2024-04-01T19:58:00.706207+0000","last_became_active":"2024-04-01T19:53:54.066471+0000","last_became_peered":"2024-04-01T19:53:54.066471+0000","last_unstale":"2024-04-01T19:58:00.706207+0000","last_undegraded":"2024-04-01T19:58:00.706207+0000","last_fullsized":"2024-04-01T19:58:00.706207+0000","mapping_epoch":629,"log_start":"651'3800","ondisk_log_start":"651'3800","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'8369","last_scrub_stamp":"2024-04-01T19:55:33.528006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:33.528006+0000","objects_scrubbed":8332,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1210,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220069888,"num_objects":3358,"num_object_clones":0,"num_object_copies":6716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3358,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13848,"num_write_kb":550592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"707'14248","reported_seq":14509,"reported_epoch":707,"state":"active+clean","last_fresh":"2024-04-01T19:58:00.992410+0000","last_change":"2024-04-01T19:55:45.161755+0000","last_active":"2024-04-01T19:58:00.992410+0000","last_peered":"2024-04-01T19:58:00.992410+0000","last_clean":"2024-04-01T19:58:00.992410+0000","last_became_active":"2024-04-01T19:53:53.678991+0000","last_became_peered":"2024-04-01T19:53:53.678991+0000","last_unstale":"2024-04-01T19:58:00.992410+0000","last_undegraded":"2024-04-01T19:58:00.992410+0000","last_fullsized":"2024-04-01T19:58:00.992410+0000","mapping_epoch":629,"log_start":"653'4200","ondisk_log_start":"653'4200","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"674'9322","last_scrub_stamp":"2024-04-01T19:55:45.161618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:45.161618+0000","objects_scrubbed":8442,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1822,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226295832,"num_objects":3454,"num_object_clones":0,"num_object_copies":6908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3454,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14248,"num_write_kb":566401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.c","version":"707'14039","reported_seq":14366,"reported_epoch":707,"state":"active+clean","last_fresh":"2024-04-01T19:58:00.732711+0000","last_change":"2024-04-01T19:57:06.345540+0000","last_active":"2024-04-01T19:58:00.732711+0000","last_peered":"2024-04-01T19:58:00.732711+0000","last_clean":"2024-04-01T19:58:00.732711+0000","last_became_active":"2024-04-01T19:53:53.462634+0000","last_became_peered":"2024-04-01T19:53:53.462634+0000","last_unstale":"2024-04-01T19:58:00.732711+0000","last_undegraded":"2024-04-01T19:58:00.732711+0000","last_fullsized":"2024-04-01T19:58:00.732711+0000","mapping_epoch":629,"log_start":"653'4000","ondisk_log_start":"653'4000","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"695'11630","last_scrub_stamp":"2024-04-01T19:57:06.345285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:57:06.345285+0000","objects_scrubbed":5792,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:58:22.050371+0000","scrub_duration":1062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220528640,"num_objects":3365,"num_object_clones":0,"num_object_copies":6730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3365,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14039,"num_write_kb":556928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"8.b","version":"707'14147","reported_seq":14478,"reported_epoch":707,"state":"active+clean","last_fresh":"2024-04-01T19:57:59.417610+0000","last_change":"2024-04-01T19:56:59.305034+0000","last_active":"2024-04-01T19:57:59.417610+0000","last_peered":"2024-04-01T19:57:59.417610+0000","last_clean":"2024-04-01T19:57:59.417610+0000","last_became_active":"2024-04-01T19:53:53.456979+0000","last_became_peered":"2024-04-01T19:53:53.456979+0000","last_unstale":"2024-04-01T19:57:59.417610+0000","last_undegraded":"2024-04-01T19:57:59.417610+0000","last_fullsized":"2024-04-01T19:57:59.417610+0000","mapping_epoch":629,"log_start":"653'4100","ondisk_log_start":"653'4100","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"694'11454","last_scrub_stamp":"2024-04-01T19:56:59.304718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:56:59.304718+0000","objects_scrubbed":6290,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:58:02.508594+0000","scrub_duration":957,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234553344,"num_objects":3579,"num_object_clones":0,"num_object_copies":7158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3579,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14147,"num_write_kb":567232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"8.a","version":"707'13737","reported_seq":14094,"reported_epoch":707,"state":"active+clean","last_fresh":"2024-04-01T19:57:59.421481+0000","last_change":"2024-04-01T19:57:56.975934+0000","last_active":"2024-04-01T19:57:59.421481+0000","last_peered":"2024-04-01T19:57:59.421481+0000","last_clean":"2024-04-01T19:57:59.421481+0000","last_became_active":"2024-04-01T19:53:54.066588+0000","last_became_peered":"2024-04-01T19:53:54.066588+0000","last_unstale":"2024-04-01T19:57:59.421481+0000","last_undegraded":"2024-04-01T19:57:59.421481+0000","last_fullsized":"2024-04-01T19:57:59.421481+0000","mapping_epoch":629,"log_start":"651'3700","ondisk_log_start":"651'3700","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"706'13635","last_scrub_stamp":"2024-04-01T19:57:56.975745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:57:56.975745+0000","objects_scrubbed":3527,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:59:06.634758+0000","scrub_duration":583,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223805440,"num_objects":3415,"num_object_clones":0,"num_object_copies":6830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3415,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13737,"num_write_kb":548864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"8.8","version":"707'14174","reported_seq":14434,"reported_epoch":707,"state":"active+clean","last_fresh":"2024-04-01T19:58:00.925623+0000","last_change":"2024-04-01T19:55:40.424211+0000","last_active":"2024-04-01T19:58:00.925623+0000","last_peered":"2024-04-01T19:58:00.925623+0000","last_clean":"2024-04-01T19:58:00.925623+0000","last_became_active":"2024-04-01T19:53:53.454737+0000","last_became_peered":"2024-04-01T19:53:53.454737+0000","last_unstale":"2024-04-01T19:58:00.925623+0000","last_undegraded":"2024-04-01T19:58:00.925623+0000","last_fullsized":"2024-04-01T19:58:00.925623+0000","mapping_epoch":629,"log_start":"653'4100","ondisk_log_start":"653'4100","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8915","last_scrub_stamp":"2024-04-01T19:55:40.424044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:40.424044+0000","objects_scrubbed":8661,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1277,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220332032,"num_objects":3362,"num_object_clones":0,"num_object_copies":6724,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3362,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14174,"num_write_kb":561152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"707'13993","reported_seq":24024,"reported_epoch":707,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:58:01.029976+0000","last_change":"2024-04-01T19:56:22.028676+0000","last_active":"2024-04-01T19:58:01.029976+0000","last_peered":"2024-04-01T19:58:01.029976+0000","last_clean":"2024-04-01T19:55:56.524590+0000","last_became_active":"2024-04-01T19:56:21.981743+0000","last_became_peered":"2024-04-01T19:56:21.981743+0000","last_unstale":"2024-04-01T19:58:01.029976+0000","last_undegraded":"2024-04-01T19:56:21.738659+0000","last_fullsized":"2024-04-01T19:58:01.029976+0000","mapping_epoch":687,"log_start":"652'3900","ondisk_log_start":"652'3900","created":629,"last_epoch_clean":641,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'9008","last_scrub_stamp":"2024-04-01T19:55:43.358714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:43.358714+0000","objects_scrubbed":8387,"log_size":10093,"log_dups_size":0,"ondisk_log_size":10093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"no scrub is scheduled","scrub_duration":2089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218431488,"num_objects":3333,"num_object_clones":0,"num_object_copies":6666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3331,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3333,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13993,"num_write_kb":554432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4881,"num_bytes_recovered":319815680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":["11"],"object_location_counts":[{"shards":"2,11","objects":2},{"shards":"11","objects":3331}],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.6","version":"707'14067","reported_seq":24240,"reported_epoch":707,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:58:01.019573+0000","last_change":"2024-04-01T19:56:22.018466+0000","last_active":"2024-04-01T19:58:01.019573+0000","last_peered":"2024-04-01T19:58:01.019573+0000","last_clean":"2024-04-01T19:55:56.539057+0000","last_became_active":"2024-04-01T19:56:21.956699+0000","last_became_peered":"2024-04-01T19:56:21.956699+0000","last_unstale":"2024-04-01T19:58:01.019573+0000","last_undegraded":"2024-04-01T19:56:21.744926+0000","last_fullsized":"2024-04-01T19:58:01.019573+0000","mapping_epoch":687,"log_start":"652'4000","ondisk_log_start":"652'4000","created":629,"last_epoch_clean":642,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8615","last_scrub_stamp":"2024-04-01T19:55:36.688352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:36.688352+0000","objects_scrubbed":8556,"log_size":10067,"log_dups_size":0,"ondisk_log_size":10067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"no scrub is scheduled","scrub_duration":2331,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":216334336,"num_objects":3301,"num_object_clones":0,"num_object_copies":6602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3296,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3301,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14067,"num_write_kb":555776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4951,"num_bytes_recovered":324272128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":["11"],"object_location_counts":[{"shards":"7,11","objects":5},{"shards":"11","objects":3296}],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.5","version":"706'13952","reported_seq":23699,"reported_epoch":706,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:57:56.525147+0000","last_change":"2024-04-01T19:56:22.002998+0000","last_active":"2024-04-01T19:57:56.525147+0000","last_peered":"2024-04-01T19:57:56.525147+0000","last_clean":"2024-04-01T19:55:56.434043+0000","last_became_active":"2024-04-01T19:56:21.952684+0000","last_became_peered":"2024-04-01T19:56:21.952684+0000","last_unstale":"2024-04-01T19:57:56.525147+0000","last_undegraded":"2024-04-01T19:56:21.721301+0000","last_fullsized":"2024-04-01T19:57:56.525147+0000","mapping_epoch":687,"log_start":"651'3900","ondisk_log_start":"651'3900","created":629,"last_epoch_clean":644,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'8660","last_scrub_stamp":"2024-04-01T19:55:36.183547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:36.183547+0000","objects_scrubbed":8628,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"no scrub is scheduled","scrub_duration":1673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236191744,"num_objects":3604,"num_object_clones":0,"num_object_copies":7208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3604,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3604,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13952,"num_write_kb":561792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4738,"num_bytes_recovered":310509568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":3604}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.4","version":"707'16907","reported_seq":17371,"reported_epoch":707,"state":"active+clean","last_fresh":"2024-04-01T19:58:00.908102+0000","last_change":"2024-04-01T19:55:34.954183+0000","last_active":"2024-04-01T19:58:00.908102+0000","last_peered":"2024-04-01T19:58:00.908102+0000","last_clean":"2024-04-01T19:58:00.908102+0000","last_became_active":"2024-04-01T19:53:53.462894+0000","last_became_peered":"2024-04-01T19:53:53.462894+0000","last_unstale":"2024-04-01T19:58:00.908102+0000","last_undegraded":"2024-04-01T19:58:00.908102+0000","last_fullsized":"2024-04-01T19:58:00.908102+0000","mapping_epoch":629,"log_start":"661'6900","ondisk_log_start":"661'6900","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'11373","last_scrub_stamp":"2024-04-01T19:55:34.954011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:34.954011+0000","objects_scrubbed":8546,"log_size":10007,"log_dups_size":0,"ondisk_log_size":10007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":221708288,"num_objects":3383,"num_object_clones":0,"num_object_copies":6766,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3383,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14145,"num_write_kb":560896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"707'13893","reported_seq":14126,"reported_epoch":707,"state":"active+clean","last_fresh":"2024-04-01T19:58:00.974117+0000","last_change":"2024-04-01T19:54:55.108987+0000","last_active":"2024-04-01T19:58:00.974117+0000","last_peered":"2024-04-01T19:58:00.974117+0000","last_clean":"2024-04-01T19:58:00.974117+0000","last_became_active":"2024-04-01T19:53:53.462397+0000","last_became_peered":"2024-04-01T19:53:53.462397+0000","last_unstale":"2024-04-01T19:58:00.974117+0000","last_undegraded":"2024-04-01T19:58:00.974117+0000","last_fullsized":"2024-04-01T19:58:00.974117+0000","mapping_epoch":629,"log_start":"651'3800","ondisk_log_start":"651'3800","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"660'5871","last_scrub_stamp":"2024-04-01T19:54:55.108780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:54:55.108780+0000","objects_scrubbed":5824,"log_size":10093,"log_dups_size":0,"ondisk_log_size":10093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":221577216,"num_objects":3381,"num_object_clones":0,"num_object_copies":6762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3381,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13893,"num_write_kb":552768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.2","version":"707'13722","reported_seq":23513,"reported_epoch":707,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:58:00.717966+0000","last_change":"2024-04-01T19:56:22.018621+0000","last_active":"2024-04-01T19:58:00.717966+0000","last_peered":"2024-04-01T19:58:00.717966+0000","last_clean":"2024-04-01T19:55:56.523442+0000","last_became_active":"2024-04-01T19:56:21.981766+0000","last_became_peered":"2024-04-01T19:56:21.981766+0000","last_unstale":"2024-04-01T19:58:00.717966+0000","last_undegraded":"2024-04-01T19:56:21.720612+0000","last_fullsized":"2024-04-01T19:58:00.717966+0000","mapping_epoch":687,"log_start":"651'3700","ondisk_log_start":"651'3700","created":629,"last_epoch_clean":645,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'8353","last_scrub_stamp":"2024-04-01T19:55:34.153804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:34.153804+0000","objects_scrubbed":8295,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"no scrub is scheduled","scrub_duration":1672,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223084544,"num_objects":3404,"num_object_clones":0,"num_object_copies":6808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3374,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3404,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13722,"num_write_kb":548032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4761,"num_bytes_recovered":311885824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3374},{"shards":"0,4","objects":30}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"707'16877","reported_seq":17421,"reported_epoch":707,"state":"active+clean","last_fresh":"2024-04-01T19:58:00.745251+0000","last_change":"2024-04-01T19:57:00.295446+0000","last_active":"2024-04-01T19:58:00.745251+0000","last_peered":"2024-04-01T19:58:00.745251+0000","last_clean":"2024-04-01T19:58:00.745251+0000","last_became_active":"2024-04-01T19:53:54.066680+0000","last_became_peered":"2024-04-01T19:53:54.066680+0000","last_unstale":"2024-04-01T19:58:00.745251+0000","last_undegraded":"2024-04-01T19:58:00.745251+0000","last_fullsized":"2024-04-01T19:58:00.745251+0000","mapping_epoch":629,"log_start":"661'6800","ondisk_log_start":"661'6800","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"694'14240","last_scrub_stamp":"2024-04-01T19:57:00.295287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:57:00.295287+0000","objects_scrubbed":6022,"log_size":10077,"log_dups_size":0,"ondisk_log_size":10077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:58:19.188940+0000","scrub_duration":983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220200960,"num_objects":3360,"num_object_clones":0,"num_object_copies":6720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3360,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13918,"num_write_kb":552896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"8.0","version":"707'13721","reported_seq":14095,"reported_epoch":707,"state":"active+clean","last_fresh":"2024-04-01T19:57:57.620440+0000","last_change":"2024-04-01T19:57:56.925685+0000","last_active":"2024-04-01T19:57:57.620440+0000","last_peered":"2024-04-01T19:57:57.620440+0000","last_clean":"2024-04-01T19:57:57.620440+0000","last_became_active":"2024-04-01T19:53:53.455265+0000","last_became_peered":"2024-04-01T19:53:53.455265+0000","last_unstale":"2024-04-01T19:57:57.620440+0000","last_undegraded":"2024-04-01T19:57:57.620440+0000","last_fullsized":"2024-04-01T19:57:57.620440+0000","mapping_epoch":629,"log_start":"651'3700","ondisk_log_start":"651'3700","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"706'13692","last_scrub_stamp":"2024-04-01T19:57:56.925430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:57:56.925430+0000","objects_scrubbed":3477,"log_size":10021,"log_dups_size":0,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:58:57.818501+0000","scrub_duration":572,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225247232,"num_objects":3437,"num_object_clones":0,"num_object_copies":6874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3437,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13721,"num_write_kb":549056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"707'14154","reported_seq":24261,"reported_epoch":707,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:58:00.931614+0000","last_change":"2024-04-01T19:56:22.004749+0000","last_active":"2024-04-01T19:58:00.931614+0000","last_peered":"2024-04-01T19:58:00.931614+0000","last_clean":"2024-04-01T19:55:56.538683+0000","last_became_active":"2024-04-01T19:56:21.960415+0000","last_became_peered":"2024-04-01T19:56:21.960415+0000","last_unstale":"2024-04-01T19:58:00.931614+0000","last_undegraded":"2024-04-01T19:56:21.714140+0000","last_fullsized":"2024-04-01T19:58:00.931614+0000","mapping_epoch":687,"log_start":"653'4100","ondisk_log_start":"653'4100","created":629,"last_epoch_clean":645,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8889","last_scrub_stamp":"2024-04-01T19:55:39.237364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:39.237364+0000","objects_scrubbed":8775,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"no scrub is scheduled","scrub_duration":1706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227016704,"num_objects":3464,"num_object_clones":0,"num_object_copies":6928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3464,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3464,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14154,"num_write_kb":563776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4915,"num_bytes_recovered":322043904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":3464}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":1741,"reported_epoch":707,"state":"active+clean","last_fresh":"2024-04-01T19:57:57.476046+0000","last_change":"2024-04-01T19:55:33.016809+0000","last_active":"2024-04-01T19:57:57.476046+0000","last_peered":"2024-04-01T19:57:57.476046+0000","last_clean":"2024-04-01T19:57:57.476046+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:57:57.476046+0000","last_undegraded":"2024-04-01T19:57:57.476046+0000","last_fullsized":"2024-04-01T19:57:57.476046+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:55:33.016695+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:55:33.016695+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":192,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":3578462232,"num_objects":54604,"num_object_clones":0,"num_object_copies":109208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":17069,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54604,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":223956,"num_write_kb":8913857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24246,"num_bytes_recovered":1588527104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8644534272,"data_stored":8644526128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160877,"ondisk_log_size":160877,"up":32,"acting":32,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220585,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1943008,"kb_used_data":1085784,"kb_used_omap":1,"kb_used_meta":857214,"kb_avail":91802144,"statfs":{"total":95995035648,"available":94005395456,"internally_reserved":0,"allocated":1111842816,"data_stored":1111461959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":877787588},"hb_peers":[0,1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678452,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1254868,"kb_used_data":651724,"kb_used_omap":1,"kb_used_meta":603134,"kb_avail":92490284,"statfs":{"total":95995035648,"available":94710050816,"internally_reserved":0,"allocated":667365376,"data_stored":666992163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":617609664},"hb_peers":[0,1,2,3,4,5,6,7,8,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557649,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":896084,"kb_used_data":669644,"kb_used_omap":132,"kb_used_meta":226299,"kb_avail":92849068,"statfs":{"total":95995035648,"available":95077445632,"internally_reserved":0,"allocated":685715456,"data_stored":685342243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":231730919},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234430,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":846244,"kb_used_data":229208,"kb_used_omap":1,"kb_used_meta":617022,"kb_avail":92898908,"statfs":{"total":95995035648,"available":95128481792,"internally_reserved":0,"allocated":234708992,"data_stored":234328155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":631830986},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":457,"seq":1962800054442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":253592,"kb_used_data":716,"kb_used_omap":744,"kb_used_meta":252119,"kb_avail":93491560,"statfs":{"total":95995035648,"available":95735357440,"internally_reserved":0,"allocated":733184,"data_stored":359971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":762131,"internal_metadata":258170605},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":2452426326109,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1147668,"kb_used_data":434764,"kb_used_omap":1,"kb_used_meta":712830,"kb_avail":92597484,"statfs":{"total":95995035648,"available":94819823616,"internally_reserved":0,"allocated":445198336,"data_stored":444825123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":729938373},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346391,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1468232,"kb_used_data":923392,"kb_used_omap":1,"kb_used_meta":544830,"kb_avail":92276920,"statfs":{"total":95995035648,"available":94491566080,"internally_reserved":0,"allocated":945553408,"data_stored":945186199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":557906373},"hb_peers":[0,1,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669150161,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1206088,"kb_used_data":448832,"kb_used_omap":1,"kb_used_meta":757246,"kb_avail":92539064,"statfs":{"total":95995035648,"available":94760001536,"internally_reserved":0,"allocated":459603968,"data_stored":459236759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":775420359},"hb_peers":[0,1,2,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953931,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1134920,"kb_used_data":472064,"kb_used_omap":1,"kb_used_meta":662846,"kb_avail":92610232,"statfs":{"total":95995035648,"available":94832877568,"internally_reserved":0,"allocated":483393536,"data_stored":483026327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":678754757},"hb_peers":[0,1,2,3,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790408,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1765204,"kb_used_data":1094028,"kb_used_omap":1,"kb_used_meta":671166,"kb_avail":91979948,"statfs":{"total":95995035648,"available":94187466752,"internally_reserved":0,"allocated":1120284672,"data_stored":1119911459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":687274437},"hb_peers":[0,1,2,3,4,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":443351040,"data_stored":443351040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":934674432,"data_stored":934674432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":457375744,"data_stored":457375744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":482672640,"data_stored":482672640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1105592320,"data_stored":1105592320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":233377792,"data_stored":233373720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":683802624,"data_stored":683802624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":662765568,"data_stored":662765568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":2534604800,"data_stored":2534604800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":1106317312,"data_stored":1106313240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:58:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:05 smithi188 ceph-mon[43939]: 8.b scrub ok 2024-04-01T19:58:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:05 smithi188 ceph-mon[43939]: pgmap v1944: 17 pgs: 1 active+clean+scrubbing, 5 active+recovering+degraded, 11 active+clean; 3.3 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 751 op/s; 16853/107398 objects degraded (15.692%); 15 MiB/s, 240 objects/s recovering 2024-04-01T19:58:06.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:05 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 16853/108332 objects degraded (15.557%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:06.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:05 smithi062 ceph-mon[44211]: 8.b scrub ok 2024-04-01T19:58:06.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:05 smithi062 ceph-mon[44211]: pgmap v1944: 17 pgs: 1 active+clean+scrubbing, 5 active+recovering+degraded, 11 active+clean; 3.3 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 751 op/s; 16853/107398 objects degraded (15.692%); 15 MiB/s, 240 objects/s recovering 2024-04-01T19:58:06.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:05 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 16853/108332 objects degraded (15.557%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:06.292 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:58:06.297 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:06.297 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:58:06.398 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:58:06.447 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:06.484 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:58:06.491 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:06.491 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:58:06.592 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:58:06.631 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:06.778 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:58:07.018 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:58:07.021 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:07.022 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:58:07.123 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:58:07.175 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:58:07.197 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:07.216 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:58:07.242 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:58:07.245 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:07.246 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:58:07.347 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:58:07.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:07 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1985040802' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:58:07.382 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:07.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:07 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1985040802' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:58:07.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:07 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1985040802' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:58:08.161 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:08 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:58:08.161 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:08 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1985040802' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:58:08.161 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:08 smithi188 ceph-mon[43939]: osdmap e708: 12 total, 11 up, 10 in 2024-04-01T19:58:08.161 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:08 smithi188 ceph-mon[43939]: pgmap v1946: 17 pgs: 1 active+clean+scrubbing, 5 active+recovering+degraded, 11 active+clean; 3.1 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 777 op/s; 15630/101028 objects degraded (15.471%); 15 MiB/s, 245 objects/s recovering 2024-04-01T19:58:08.390 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:58:08.390 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:58:08.391 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:58:08.391 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:58:08.391 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.391 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:159025 8.7 8:ed612cfa:::benchmark_data_smithi188_161190_object19743:head [delete] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e688)", 2024-04-01T19:58:08.391 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:21.740622+0000", 2024-04-01T19:58:08.391 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 106.648865945, 2024-04-01T19:58:08.391 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.275231748, 2024-04-01T19:58:08.391 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:08.391 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:08.391 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:58:08.391 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:08.392 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:08.392 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:08.392 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 159025 2024-04-01T19:58:08.392 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.392 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:08.392 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.392 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:08.392 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.740622+0000", 2024-04-01T19:58:08.392 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.392 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.392 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.392 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:08.392 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.740622+0000", 2024-04-01T19:58:08.392 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.392 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.393 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.393 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:08.393 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.740624+0000", 2024-04-01T19:58:08.393 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5979999999999999e-06 2024-04-01T19:58:08.393 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.393 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.393 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:08.393 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.740631+0000", 2024-04-01T19:58:08.393 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1999999999999997e-06 2024-04-01T19:58:08.393 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.393 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.393 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:08.394 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.740644+0000", 2024-04-01T19:58:08.394 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2394e-05 2024-04-01T19:58:08.394 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.394 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.394 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:08.394 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.740656+0000", 2024-04-01T19:58:08.394 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2097e-05 2024-04-01T19:58:08.394 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.394 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.394 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.394 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.743814+0000", 2024-04-01T19:58:08.394 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031578510000000001 2024-04-01T19:58:08.394 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.395 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.395 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:58:08.395 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.743826+0000", 2024-04-01T19:58:08.395 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2238e-05 2024-04-01T19:58:08.395 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.395 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.395 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.395 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.004934+0000", 2024-04-01T19:58:08.395 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.26110845999999999 2024-04-01T19:58:08.395 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.395 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.395 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for missing object", 2024-04-01T19:58:08.395 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.005050+0000", 2024-04-01T19:58:08.396 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000115344 2024-04-01T19:58:08.396 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.396 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.396 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.396 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.015792+0000", 2024-04-01T19:58:08.396 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010742435 2024-04-01T19:58:08.396 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.396 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.396 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:08.396 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.015853+0000", 2024-04-01T19:58:08.396 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1130999999999995e-05 2024-04-01T19:58:08.396 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.396 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:08.396 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.397 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.397 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.397 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:159041 8.7 8:edb8ec9f:::benchmark_data_smithi188_161190_object19759:head [delete] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e688)", 2024-04-01T19:58:08.397 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:21.740783+0000", 2024-04-01T19:58:08.397 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 106.648704638, 2024-04-01T19:58:08.397 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.294953311, 2024-04-01T19:58:08.397 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:08.397 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:08.397 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:08.397 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:08.397 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:08.398 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:08.398 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 159041 2024-04-01T19:58:08.398 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.398 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:08.398 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.398 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:08.398 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.740783+0000", 2024-04-01T19:58:08.398 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.398 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.398 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.398 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:08.398 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.740783+0000", 2024-04-01T19:58:08.398 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.398 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.399 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.399 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:08.399 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.740784+0000", 2024-04-01T19:58:08.399 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0669999999999999e-06 2024-04-01T19:58:08.399 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.399 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.399 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:08.399 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.740788+0000", 2024-04-01T19:58:08.399 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3460000000000004e-06 2024-04-01T19:58:08.399 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.399 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.399 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:08.399 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.740796+0000", 2024-04-01T19:58:08.399 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4889999999999998e-06 2024-04-01T19:58:08.399 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.400 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.400 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:08.400 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.740802+0000", 2024-04-01T19:58:08.400 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4169999999999997e-06 2024-04-01T19:58:08.400 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.400 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.400 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.400 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.743856+0000", 2024-04-01T19:58:08.400 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030542630000000002 2024-04-01T19:58:08.400 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.400 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.400 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:58:08.400 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.743864+0000", 2024-04-01T19:58:08.400 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6990000000000003e-06 2024-04-01T19:58:08.400 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.400 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.401 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.401 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.008546+0000", 2024-04-01T19:58:08.401 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.26468152099999998 2024-04-01T19:58:08.401 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.401 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.401 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T19:58:08.401 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.009249+0000", 2024-04-01T19:58:08.401 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00070286700000000003 2024-04-01T19:58:08.401 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.401 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.401 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.401 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.023817+0000", 2024-04-01T19:58:08.401 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014568957 2024-04-01T19:58:08.401 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.401 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.401 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:08.402 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.023887+0000", 2024-04-01T19:58:08.402 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9821999999999997e-05 2024-04-01T19:58:08.402 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.402 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.402 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:58:08.402 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.023996+0000", 2024-04-01T19:58:08.402 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010890799999999999 2024-04-01T19:58:08.402 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.402 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.402 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:08.402 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.032873+0000", 2024-04-01T19:58:08.402 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0088766539999999994 2024-04-01T19:58:08.402 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.402 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.402 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:08.403 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.032923+0000", 2024-04-01T19:58:08.403 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0130000000000003e-05 2024-04-01T19:58:08.403 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.403 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.403 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:08.403 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.032961+0000", 2024-04-01T19:58:08.403 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7975999999999997e-05 2024-04-01T19:58:08.403 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.403 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.403 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:08.403 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.035736+0000", 2024-04-01T19:58:08.403 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0027751949999999998 2024-04-01T19:58:08.403 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.403 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:08.403 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.403 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.404 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.404 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:159013 8.6 8:6457a00e:::benchmark_data_smithi188_161190_object19731:head [delete] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e688)", 2024-04-01T19:58:08.404 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:21.745490+0000", 2024-04-01T19:58:08.404 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 106.64399739700001, 2024-04-01T19:58:08.404 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.23998613199999999, 2024-04-01T19:58:08.404 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:08.404 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:08.404 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:58:08.404 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:08.404 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:08.404 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:08.404 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 159013 2024-04-01T19:58:08.404 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.404 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:08.405 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.405 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:08.405 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745490+0000", 2024-04-01T19:58:08.405 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.405 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.405 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.405 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:08.405 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745490+0000", 2024-04-01T19:58:08.405 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.405 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.405 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.405 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:08.405 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745493+0000", 2024-04-01T19:58:08.405 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6400000000000001e-06 2024-04-01T19:58:08.405 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.405 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.406 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:08.406 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745500+0000", 2024-04-01T19:58:08.406 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6699999999999994e-06 2024-04-01T19:58:08.406 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.406 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.406 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:08.406 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745513+0000", 2024-04-01T19:58:08.406 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.225e-05 2024-04-01T19:58:08.406 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.406 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.406 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:08.406 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745524+0000", 2024-04-01T19:58:08.406 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1112e-05 2024-04-01T19:58:08.406 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.406 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.407 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.407 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.750014+0000", 2024-04-01T19:58:08.407 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0044899520000000002 2024-04-01T19:58:08.407 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.407 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.407 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:58:08.407 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.750025+0000", 2024-04-01T19:58:08.407 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1072e-05 2024-04-01T19:58:08.407 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.407 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.407 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.407 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.972680+0000", 2024-04-01T19:58:08.407 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.22265532599999999 2024-04-01T19:58:08.407 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.408 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.408 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for missing object", 2024-04-01T19:58:08.408 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.972783+0000", 2024-04-01T19:58:08.408 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000103149 2024-04-01T19:58:08.408 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.408 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.408 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.408 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.985394+0000", 2024-04-01T19:58:08.408 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.01261108 2024-04-01T19:58:08.408 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.408 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.408 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:08.408 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.985476+0000", 2024-04-01T19:58:08.408 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1880999999999998e-05 2024-04-01T19:58:08.408 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.408 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:08.409 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.409 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.409 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.409 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:159016 8.6 8:6d519853:::benchmark_data_smithi188_161190_object19734:head [delete] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e688)", 2024-04-01T19:58:08.409 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:21.745546+0000", 2024-04-01T19:58:08.409 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 106.64394177200001, 2024-04-01T19:58:08.409 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25014217399999999, 2024-04-01T19:58:08.409 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:08.409 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:08.409 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:58:08.409 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:08.409 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:08.409 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:08.409 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 159016 2024-04-01T19:58:08.409 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.410 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:08.410 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.410 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:08.410 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745546+0000", 2024-04-01T19:58:08.410 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.410 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.410 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.410 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:08.410 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745546+0000", 2024-04-01T19:58:08.410 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.410 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.410 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.411 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:08.411 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745546+0000", 2024-04-01T19:58:08.411 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7300000000000005e-07 2024-04-01T19:58:08.411 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.411 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.411 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:08.411 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745550+0000", 2024-04-01T19:58:08.411 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3419999999999999e-06 2024-04-01T19:58:08.411 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.411 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.411 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:08.411 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745555+0000", 2024-04-01T19:58:08.411 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.631e-06 2024-04-01T19:58:08.411 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.412 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.412 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:08.412 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745561+0000", 2024-04-01T19:58:08.412 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5500000000000002e-06 2024-04-01T19:58:08.412 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.412 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.412 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.412 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.750052+0000", 2024-04-01T19:58:08.412 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0044913280000000002 2024-04-01T19:58:08.412 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.412 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.412 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:58:08.412 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.750058+0000", 2024-04-01T19:58:08.412 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7450000000000001e-06 2024-04-01T19:58:08.412 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.412 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.413 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.413 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.975565+0000", 2024-04-01T19:58:08.413 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.225506969 2024-04-01T19:58:08.413 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.413 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.413 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for missing object", 2024-04-01T19:58:08.413 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.975649+0000", 2024-04-01T19:58:08.413 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3628999999999995e-05 2024-04-01T19:58:08.413 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.413 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.413 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.413 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.995600+0000", 2024-04-01T19:58:08.413 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019950862999999999 2024-04-01T19:58:08.413 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.413 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.413 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:08.414 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.995688+0000", 2024-04-01T19:58:08.414 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8344000000000007e-05 2024-04-01T19:58:08.414 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.414 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:08.414 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.414 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.414 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.414 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:159022 8.6 8:62ca23b9:::benchmark_data_smithi188_161190_object19740:head [delete] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e688)", 2024-04-01T19:58:08.414 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:21.745568+0000", 2024-04-01T19:58:08.414 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 106.64391958500001, 2024-04-01T19:58:08.414 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25909227699999998, 2024-04-01T19:58:08.414 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:08.415 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:08.415 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T19:58:08.415 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:08.415 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:08.415 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:08.415 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 159022 2024-04-01T19:58:08.415 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.415 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:08.415 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.415 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:08.415 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745568+0000", 2024-04-01T19:58:08.415 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.415 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.415 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.415 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:08.416 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745568+0000", 2024-04-01T19:58:08.416 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.416 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.416 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.416 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:08.416 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745569+0000", 2024-04-01T19:58:08.416 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7700000000000004e-07 2024-04-01T19:58:08.416 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.416 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.416 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:08.416 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745571+0000", 2024-04-01T19:58:08.416 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4719999999999998e-06 2024-04-01T19:58:08.416 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.416 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.416 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:08.416 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745576+0000", 2024-04-01T19:58:08.417 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8570000000000003e-06 2024-04-01T19:58:08.417 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.417 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.417 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:08.417 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745581+0000", 2024-04-01T19:58:08.417 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.843e-06 2024-04-01T19:58:08.417 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.417 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.417 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.417 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.750081+0000", 2024-04-01T19:58:08.417 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0045002239999999997 2024-04-01T19:58:08.417 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.417 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.417 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:58:08.417 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.750087+0000", 2024-04-01T19:58:08.417 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7130000000000002e-06 2024-04-01T19:58:08.418 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.418 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.418 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.418 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.975671+0000", 2024-04-01T19:58:08.418 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.225584223 2024-04-01T19:58:08.418 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.418 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.418 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for missing object", 2024-04-01T19:58:08.418 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.975733+0000", 2024-04-01T19:58:08.418 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1755999999999996e-05 2024-04-01T19:58:08.418 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.418 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.418 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.419 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.004595+0000", 2024-04-01T19:58:08.419 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028862539 2024-04-01T19:58:08.419 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.419 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.419 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:08.419 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.004660+0000", 2024-04-01T19:58:08.419 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4873e-05 2024-04-01T19:58:08.419 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.419 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:08.419 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.419 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.419 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.419 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:159038 8.6 8:6486510a:::benchmark_data_smithi188_161190_object19756:head [delete] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e688)", 2024-04-01T19:58:08.420 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:21.745588+0000", 2024-04-01T19:58:08.420 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 106.64389981799999, 2024-04-01T19:58:08.420 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.29499959799999997, 2024-04-01T19:58:08.420 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:08.420 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:08.420 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:08.420 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:08.420 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:08.420 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:08.420 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 159038 2024-04-01T19:58:08.420 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.420 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:08.420 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.420 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:08.421 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745588+0000", 2024-04-01T19:58:08.421 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.421 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.421 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.421 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:08.421 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745588+0000", 2024-04-01T19:58:08.421 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.421 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.421 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.421 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:08.421 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745588+0000", 2024-04-01T19:58:08.421 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2499999999999995e-07 2024-04-01T19:58:08.421 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.421 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.421 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:08.421 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745590+0000", 2024-04-01T19:58:08.422 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2979999999999999e-06 2024-04-01T19:58:08.422 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.422 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.422 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:08.422 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745595+0000", 2024-04-01T19:58:08.422 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9269999999999996e-06 2024-04-01T19:58:08.422 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.422 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.422 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:08.422 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745600+0000", 2024-04-01T19:58:08.422 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5730000000000001e-06 2024-04-01T19:58:08.422 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.422 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.422 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.423 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.750113+0000", 2024-04-01T19:58:08.423 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0045133450000000002 2024-04-01T19:58:08.423 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.423 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.423 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T19:58:08.423 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.750119+0000", 2024-04-01T19:58:08.423 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5679999999999999e-06 2024-04-01T19:58:08.423 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.423 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.423 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.423 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.975767+0000", 2024-04-01T19:58:08.423 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.225647713 2024-04-01T19:58:08.423 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.423 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.423 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T19:58:08.423 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.976480+0000", 2024-04-01T19:58:08.424 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00071369100000000002 2024-04-01T19:58:08.424 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.424 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.424 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.424 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.012603+0000", 2024-04-01T19:58:08.424 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.036122833 2024-04-01T19:58:08.424 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.424 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.424 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:08.424 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.012711+0000", 2024-04-01T19:58:08.424 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000107668 2024-04-01T19:58:08.424 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.424 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.425 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 7", 2024-04-01T19:58:08.425 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.012811+0000", 2024-04-01T19:58:08.425 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000100105 2024-04-01T19:58:08.425 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.425 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.425 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:08.425 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.035733+0000", 2024-04-01T19:58:08.425 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022922512999999999 2024-04-01T19:58:08.425 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.425 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.425 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:08.425 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.035782+0000", 2024-04-01T19:58:08.425 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8742000000000002e-05 2024-04-01T19:58:08.426 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.426 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.426 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:08.426 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.035861+0000", 2024-04-01T19:58:08.426 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9153999999999995e-05 2024-04-01T19:58:08.426 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.426 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.426 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:08.426 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.040587+0000", 2024-04-01T19:58:08.426 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0047259429999999998 2024-04-01T19:58:08.426 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.427 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:08.427 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.427 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.427 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.427 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:160520 8.7 8:e6e8615a:::benchmark_data_smithi188_161190_object21238:head [delete] snapc 0=[] ondisk+write+known_if_redirected e688)", 2024-04-01T19:58:08.427 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:24.508528+0000", 2024-04-01T19:58:08.427 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 103.88095960699999, 2024-04-01T19:58:08.427 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.29421895999999997, 2024-04-01T19:58:08.427 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:08.427 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:08.427 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:08.427 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:08.428 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:08.428 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:08.428 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 160520 2024-04-01T19:58:08.428 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.428 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:08.428 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.428 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:08.428 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.508528+0000", 2024-04-01T19:58:08.428 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.428 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.428 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.429 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:08.429 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.508528+0000", 2024-04-01T19:58:08.429 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.429 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.429 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.429 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:08.429 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.508530+0000", 2024-04-01T19:58:08.429 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1789999999999998e-06 2024-04-01T19:58:08.429 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.429 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.429 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:08.429 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.508537+0000", 2024-04-01T19:58:08.430 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9650000000000002e-06 2024-04-01T19:58:08.430 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.430 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.430 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:08.430 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.508549+0000", 2024-04-01T19:58:08.430 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2081e-05 2024-04-01T19:58:08.430 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.430 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.430 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:08.430 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.508557+0000", 2024-04-01T19:58:08.431 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2400000000000007e-06 2024-04-01T19:58:08.431 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.431 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.431 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.431 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.534744+0000", 2024-04-01T19:58:08.431 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026186437999999999 2024-04-01T19:58:08.431 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.431 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.431 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T19:58:08.431 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.534799+0000", 2024-04-01T19:58:08.431 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5692999999999997e-05 2024-04-01T19:58:08.431 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.431 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.432 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.432 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.749774+0000", 2024-04-01T19:58:08.432 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.21497492300000001 2024-04-01T19:58:08.432 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.432 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.432 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:08.432 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.749870+0000", 2024-04-01T19:58:08.432 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5564999999999997e-05 2024-04-01T19:58:08.432 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.432 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.432 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:58:08.432 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.749992+0000", 2024-04-01T19:58:08.432 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012204199999999999 2024-04-01T19:58:08.433 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.433 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.433 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:08.433 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.778855+0000", 2024-04-01T19:58:08.433 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028862794000000001 2024-04-01T19:58:08.433 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.433 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.433 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:08.433 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.798835+0000", 2024-04-01T19:58:08.433 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019980629999999999 2024-04-01T19:58:08.433 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.433 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.433 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:08.433 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.798902+0000", 2024-04-01T19:58:08.434 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6272000000000005e-05 2024-04-01T19:58:08.434 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.434 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.434 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:08.434 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.802747+0000", 2024-04-01T19:58:08.434 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0038451380000000001 2024-04-01T19:58:08.434 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.434 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:08.434 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.434 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.434 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.434 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:170001 8.7 8:efa1051b:::benchmark_data_smithi188_161190_object30719:head [delete] snapc 0=[] ondisk+write+known_if_redirected e690)", 2024-04-01T19:58:08.434 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:40.590584+0000", 2024-04-01T19:58:08.435 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 87.798903375999998, 2024-04-01T19:58:08.435 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.26288546000000002, 2024-04-01T19:58:08.435 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:08.435 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:08.435 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:08.435 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:08.435 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:08.435 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:08.435 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 170001 2024-04-01T19:58:08.435 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.435 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:08.435 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.435 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:08.436 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.590584+0000", 2024-04-01T19:58:08.436 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.436 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.436 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.436 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:08.436 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.590584+0000", 2024-04-01T19:58:08.436 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.436 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.436 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.436 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:08.436 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.590585+0000", 2024-04-01T19:58:08.436 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6000000000000003e-07 2024-04-01T19:58:08.436 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.436 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.437 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:08.437 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.590588+0000", 2024-04-01T19:58:08.437 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.96e-06 2024-04-01T19:58:08.437 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.437 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.437 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:08.437 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.590593+0000", 2024-04-01T19:58:08.437 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5799999999999999e-06 2024-04-01T19:58:08.437 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.437 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.437 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:08.437 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.590598+0000", 2024-04-01T19:58:08.437 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8760000000000004e-06 2024-04-01T19:58:08.437 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.437 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.438 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.438 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.642537+0000", 2024-04-01T19:58:08.438 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.051938627000000001 2024-04-01T19:58:08.438 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.438 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.438 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T19:58:08.438 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.642583+0000", 2024-04-01T19:58:08.438 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5750000000000001e-05 2024-04-01T19:58:08.438 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.438 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.438 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.438 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.810036+0000", 2024-04-01T19:58:08.438 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16745390600000001 2024-04-01T19:58:08.438 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.439 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.439 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:08.439 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.810146+0000", 2024-04-01T19:58:08.439 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0001093 2024-04-01T19:58:08.439 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.439 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.439 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:58:08.439 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.810303+0000", 2024-04-01T19:58:08.439 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000157558 2024-04-01T19:58:08.439 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.439 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.439 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:08.439 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.839064+0000", 2024-04-01T19:58:08.439 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028761129999999999 2024-04-01T19:58:08.440 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.440 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.440 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:08.440 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.849700+0000", 2024-04-01T19:58:08.440 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010635886000000001 2024-04-01T19:58:08.440 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.440 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.440 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:08.440 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.849768+0000", 2024-04-01T19:58:08.440 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7178e-05 2024-04-01T19:58:08.440 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.440 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.440 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:08.441 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.853470+0000", 2024-04-01T19:58:08.441 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0037020489999999998 2024-04-01T19:58:08.441 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.441 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:08.441 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.441 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.441 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.441 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:171487 8.6 8:64be4325:::benchmark_data_smithi188_161190_object32205:head [delete] snapc 0=[] ondisk+write+known_if_redirected e690)", 2024-04-01T19:58:08.441 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:43.086543+0000", 2024-04-01T19:58:08.441 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.302944554999996, 2024-04-01T19:58:08.441 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.22478701200000001, 2024-04-01T19:58:08.441 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:08.441 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:08.441 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:08.442 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:08.442 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:08.442 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:08.442 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 171487 2024-04-01T19:58:08.442 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.442 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:08.442 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.442 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:08.442 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.086543+0000", 2024-04-01T19:58:08.442 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.442 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.443 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.443 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:08.443 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.086543+0000", 2024-04-01T19:58:08.443 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.443 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.443 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.443 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:08.443 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.086544+0000", 2024-04-01T19:58:08.443 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2900000000000002e-07 2024-04-01T19:58:08.443 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.443 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.443 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:08.443 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.086547+0000", 2024-04-01T19:58:08.443 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0850000000000001e-06 2024-04-01T19:58:08.444 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.444 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.444 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:08.444 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.086554+0000", 2024-04-01T19:58:08.444 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2150000000000004e-06 2024-04-01T19:58:08.444 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.444 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.444 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:08.444 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.086560+0000", 2024-04-01T19:58:08.444 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7219999999999996e-06 2024-04-01T19:58:08.444 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.444 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.444 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.444 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.163514+0000", 2024-04-01T19:58:08.444 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.076953860999999998 2024-04-01T19:58:08.445 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.445 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T19:58:08.445 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.163566+0000", 2024-04-01T19:58:08.445 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1829000000000001e-05 2024-04-01T19:58:08.445 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.445 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.445 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.188759+0000", 2024-04-01T19:58:08.445 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.025193002999999999 2024-04-01T19:58:08.445 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.445 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:08.445 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.188851+0000", 2024-04-01T19:58:08.446 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2128999999999998e-05 2024-04-01T19:58:08.446 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.446 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.446 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 7", 2024-04-01T19:58:08.446 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.188958+0000", 2024-04-01T19:58:08.446 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010709699999999999 2024-04-01T19:58:08.446 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.446 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.446 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:08.446 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.254083+0000", 2024-04-01T19:58:08.446 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.065125475000000002 2024-04-01T19:58:08.446 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.446 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.447 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:08.447 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.307781+0000", 2024-04-01T19:58:08.447 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.053697347999999999 2024-04-01T19:58:08.447 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.447 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.447 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:08.447 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.307816+0000", 2024-04-01T19:58:08.447 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5218000000000001e-05 2024-04-01T19:58:08.447 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.447 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.447 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:08.447 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.311330+0000", 2024-04-01T19:58:08.448 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0035141009999999999 2024-04-01T19:58:08.448 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.448 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:08.448 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.448 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.448 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.448 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:171560 8.6 8:65953a38:::benchmark_data_smithi188_161190_object32278:head [delete] snapc 0=[] ondisk+write+known_if_redirected e690)", 2024-04-01T19:58:08.448 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:43.206778+0000", 2024-04-01T19:58:08.448 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.182709231000004, 2024-04-01T19:58:08.448 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.28133534199999999, 2024-04-01T19:58:08.448 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:08.448 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:08.448 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:08.448 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:08.449 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:08.449 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:08.449 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 171560 2024-04-01T19:58:08.449 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.449 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:08.449 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.449 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:08.449 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.206778+0000", 2024-04-01T19:58:08.449 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.449 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.449 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.449 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:08.449 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.206778+0000", 2024-04-01T19:58:08.449 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.449 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.450 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.450 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:08.450 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.206781+0000", 2024-04-01T19:58:08.450 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.852e-06 2024-04-01T19:58:08.450 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.450 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.450 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:08.450 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.206792+0000", 2024-04-01T19:58:08.450 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0404000000000001e-05 2024-04-01T19:58:08.450 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.450 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.450 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:08.450 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.206804+0000", 2024-04-01T19:58:08.450 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2235000000000001e-05 2024-04-01T19:58:08.451 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.451 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.451 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:08.451 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.206812+0000", 2024-04-01T19:58:08.451 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7810000000000005e-06 2024-04-01T19:58:08.451 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.451 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.451 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.451 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.336077+0000", 2024-04-01T19:58:08.451 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.12926535 2024-04-01T19:58:08.451 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.451 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.451 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T19:58:08.452 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.336676+0000", 2024-04-01T19:58:08.452 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00059951899999999996 2024-04-01T19:58:08.452 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.452 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.452 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.452 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.361304+0000", 2024-04-01T19:58:08.452 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.024627454999999999 2024-04-01T19:58:08.452 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.452 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.452 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:08.452 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.361383+0000", 2024-04-01T19:58:08.452 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8684999999999996e-05 2024-04-01T19:58:08.452 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.452 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.452 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 7", 2024-04-01T19:58:08.453 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.361491+0000", 2024-04-01T19:58:08.453 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010888800000000001 2024-04-01T19:58:08.453 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.453 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.453 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:08.453 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.384693+0000", 2024-04-01T19:58:08.453 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023201368 2024-04-01T19:58:08.453 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.453 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.453 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:08.453 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.483620+0000", 2024-04-01T19:58:08.453 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.098927541999999993 2024-04-01T19:58:08.453 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.453 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.453 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:08.454 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.483680+0000", 2024-04-01T19:58:08.454 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9809000000000003e-05 2024-04-01T19:58:08.454 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.454 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.454 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:08.454 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.488114+0000", 2024-04-01T19:58:08.454 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0044334539999999999 2024-04-01T19:58:08.454 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.454 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:08.454 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.454 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.454 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.454 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:171562 8.6 8:66be2490:::benchmark_data_smithi188_161190_object32280:head [delete] snapc 0=[] ondisk+write+known_if_redirected e690)", 2024-04-01T19:58:08.455 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:43.206867+0000", 2024-04-01T19:58:08.455 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.182620486000005, 2024-04-01T19:58:08.455 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.28561927799999998, 2024-04-01T19:58:08.455 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:08.455 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:08.455 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:08.455 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:08.455 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:08.455 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:08.455 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 171562 2024-04-01T19:58:08.455 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.455 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:08.455 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.456 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:08.456 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.206867+0000", 2024-04-01T19:58:08.456 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.456 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.456 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.456 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:08.456 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.206867+0000", 2024-04-01T19:58:08.456 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.456 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.456 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.456 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:08.456 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.206868+0000", 2024-04-01T19:58:08.456 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.186e-06 2024-04-01T19:58:08.456 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.456 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.457 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:08.457 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.206873+0000", 2024-04-01T19:58:08.457 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7029999999999997e-06 2024-04-01T19:58:08.457 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.457 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.457 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:08.457 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.206880+0000", 2024-04-01T19:58:08.457 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4070000000000004e-06 2024-04-01T19:58:08.457 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.457 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.457 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:08.457 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.206885+0000", 2024-04-01T19:58:08.457 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8720000000000001e-06 2024-04-01T19:58:08.457 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.457 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.457 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.458 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.336728+0000", 2024-04-01T19:58:08.458 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.12984235399999999 2024-04-01T19:58:08.458 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.458 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.458 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T19:58:08.458 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.337265+0000", 2024-04-01T19:58:08.458 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00053725699999999997 2024-04-01T19:58:08.458 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.458 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.458 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.458 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.372042+0000", 2024-04-01T19:58:08.458 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034777300999999997 2024-04-01T19:58:08.458 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.458 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.458 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:08.459 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.372141+0000", 2024-04-01T19:58:08.459 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9281e-05 2024-04-01T19:58:08.459 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.459 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.459 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 7", 2024-04-01T19:58:08.459 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.372291+0000", 2024-04-01T19:58:08.459 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014947100000000001 2024-04-01T19:58:08.459 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.459 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.459 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:08.459 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.388948+0000", 2024-04-01T19:58:08.459 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016657603999999999 2024-04-01T19:58:08.459 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.459 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.459 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:08.460 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.488178+0000", 2024-04-01T19:58:08.460 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.099229687999999996 2024-04-01T19:58:08.460 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.460 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.460 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:08.460 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.488230+0000", 2024-04-01T19:58:08.460 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1700999999999998e-05 2024-04-01T19:58:08.460 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.460 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.460 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:08.460 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.492486+0000", 2024-04-01T19:58:08.460 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0042564530000000003 2024-04-01T19:58:08.460 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.460 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:08.461 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.461 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.461 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.461 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:171567 8.6 8:6140cec1:::benchmark_data_smithi188_161190_object32285:head [delete] snapc 0=[] ondisk+write+known_if_redirected e690)", 2024-04-01T19:58:08.461 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:43.246544+0000", 2024-04-01T19:58:08.461 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.142943932999998, 2024-04-01T19:58:08.461 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25015635600000002, 2024-04-01T19:58:08.461 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:08.461 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:08.461 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:08.461 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:08.461 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:08.461 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:08.462 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 171567 2024-04-01T19:58:08.462 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.462 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:08.462 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.462 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:08.462 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.246544+0000", 2024-04-01T19:58:08.462 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.462 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.462 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.462 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:08.462 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.246544+0000", 2024-04-01T19:58:08.462 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.463 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.463 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.463 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:08.463 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.246546+0000", 2024-04-01T19:58:08.463 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4310000000000001e-06 2024-04-01T19:58:08.463 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.463 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.463 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:08.463 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.246554+0000", 2024-04-01T19:58:08.463 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5299999999999999e-06 2024-04-01T19:58:08.463 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.463 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.463 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:08.463 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.246565+0000", 2024-04-01T19:58:08.464 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1887e-05 2024-04-01T19:58:08.464 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.464 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.464 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:08.464 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.246572+0000", 2024-04-01T19:58:08.464 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9210000000000003e-06 2024-04-01T19:58:08.464 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.464 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.464 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.464 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.337331+0000", 2024-04-01T19:58:08.464 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.090758491999999996 2024-04-01T19:58:08.464 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.464 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.464 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T19:58:08.464 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.337814+0000", 2024-04-01T19:58:08.465 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00048355300000000001 2024-04-01T19:58:08.465 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.465 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.465 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.465 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.384725+0000", 2024-04-01T19:58:08.465 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.046910489 2024-04-01T19:58:08.465 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.465 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.465 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:08.465 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.384796+0000", 2024-04-01T19:58:08.465 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1036000000000002e-05 2024-04-01T19:58:08.465 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.465 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.465 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 7", 2024-04-01T19:58:08.466 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.384928+0000", 2024-04-01T19:58:08.466 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000132175 2024-04-01T19:58:08.466 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.466 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.466 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:08.466 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.411587+0000", 2024-04-01T19:58:08.466 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026658602 2024-04-01T19:58:08.466 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.466 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.466 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:08.466 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.492533+0000", 2024-04-01T19:58:08.466 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.080946362999999993 2024-04-01T19:58:08.466 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.466 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.467 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:08.467 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.492569+0000", 2024-04-01T19:58:08.467 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6334999999999997e-05 2024-04-01T19:58:08.467 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.467 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.467 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:08.467 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.496700+0000", 2024-04-01T19:58:08.467 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0041305420000000001 2024-04-01T19:58:08.467 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.467 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:08.467 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.467 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.467 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.467 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:171568 8.6 8:60e68e7c:::benchmark_data_smithi188_161190_object32286:head [delete] snapc 0=[] ondisk+write+known_if_redirected e690)", 2024-04-01T19:58:08.467 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:43.246584+0000", 2024-04-01T19:58:08.468 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.142903115999999, 2024-04-01T19:58:08.468 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.253975966, 2024-04-01T19:58:08.468 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:08.468 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:08.468 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:08.468 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:08.468 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:08.468 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:08.468 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 171568 2024-04-01T19:58:08.468 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.468 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:08.468 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.468 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:08.468 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.246584+0000", 2024-04-01T19:58:08.468 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.469 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.469 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.469 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:08.469 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.246584+0000", 2024-04-01T19:58:08.469 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.469 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.469 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.469 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:08.469 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.246585+0000", 2024-04-01T19:58:08.469 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4900000000000005e-07 2024-04-01T19:58:08.469 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.469 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.469 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:08.469 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.246588+0000", 2024-04-01T19:58:08.469 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3129999999999999e-06 2024-04-01T19:58:08.469 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.470 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.470 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:08.470 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.246594+0000", 2024-04-01T19:58:08.470 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2220000000000001e-06 2024-04-01T19:58:08.470 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.470 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.470 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:08.470 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.246599+0000", 2024-04-01T19:58:08.470 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5890000000000002e-06 2024-04-01T19:58:08.470 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.470 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.470 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.470 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.337856+0000", 2024-04-01T19:58:08.470 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.091256867000000005 2024-04-01T19:58:08.470 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.471 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.471 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T19:58:08.471 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.338461+0000", 2024-04-01T19:58:08.471 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00060456400000000003 2024-04-01T19:58:08.471 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.471 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.471 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.471 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.396477+0000", 2024-04-01T19:58:08.471 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.058016124000000002 2024-04-01T19:58:08.471 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.471 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.471 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:08.471 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.396542+0000", 2024-04-01T19:58:08.471 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5012999999999996e-05 2024-04-01T19:58:08.471 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.471 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.472 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 7", 2024-04-01T19:58:08.472 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.396627+0000", 2024-04-01T19:58:08.472 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5668999999999996e-05 2024-04-01T19:58:08.472 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.472 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.472 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:08.472 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.422943+0000", 2024-04-01T19:58:08.472 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026315541000000001 2024-04-01T19:58:08.472 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.472 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.472 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:08.472 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.496776+0000", 2024-04-01T19:58:08.472 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.073832780000000001 2024-04-01T19:58:08.472 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.472 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.473 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:08.473 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.496836+0000", 2024-04-01T19:58:08.473 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0068999999999997e-05 2024-04-01T19:58:08.473 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.473 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.473 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:08.473 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.500560+0000", 2024-04-01T19:58:08.473 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0037244660000000001 2024-04-01T19:58:08.473 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.473 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:08.473 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.473 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.473 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.473 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:171582 8.6 8:6a291430:::benchmark_data_smithi188_161190_object32300:head [delete] snapc 0=[] ondisk+write+known_if_redirected e690)", 2024-04-01T19:58:08.474 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:43.278740+0000", 2024-04-01T19:58:08.474 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.110747033999999, 2024-04-01T19:58:08.474 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.22503316600000001, 2024-04-01T19:58:08.474 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:08.474 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:08.474 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:08.474 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:08.474 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:08.474 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:08.474 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 171582 2024-04-01T19:58:08.474 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.474 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:08.474 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.474 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:08.474 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.278740+0000", 2024-04-01T19:58:08.475 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.475 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.475 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.475 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:08.475 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.278740+0000", 2024-04-01T19:58:08.475 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.475 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.475 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.475 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:08.475 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.278743+0000", 2024-04-01T19:58:08.475 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.08e-06 2024-04-01T19:58:08.475 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.475 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.475 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:08.475 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.278749+0000", 2024-04-01T19:58:08.475 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6880000000000002e-06 2024-04-01T19:58:08.476 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.476 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.476 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:08.476 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.278761+0000", 2024-04-01T19:58:08.476 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1780000000000001e-05 2024-04-01T19:58:08.476 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.476 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.476 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:08.476 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.278768+0000", 2024-04-01T19:58:08.476 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3780000000000003e-06 2024-04-01T19:58:08.476 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.476 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.476 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.476 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.338501+0000", 2024-04-01T19:58:08.476 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.059732711000000001 2024-04-01T19:58:08.476 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.477 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.477 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T19:58:08.477 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.338977+0000", 2024-04-01T19:58:08.477 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00047590000000000002 2024-04-01T19:58:08.477 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.477 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.477 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.477 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.407542+0000", 2024-04-01T19:58:08.477 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.068565040999999993 2024-04-01T19:58:08.477 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.477 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.477 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:08.477 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.407613+0000", 2024-04-01T19:58:08.477 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1247000000000004e-05 2024-04-01T19:58:08.477 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.477 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.478 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 7", 2024-04-01T19:58:08.478 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.407715+0000", 2024-04-01T19:58:08.478 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000102216 2024-04-01T19:58:08.478 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.478 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.478 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:08.478 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.434730+0000", 2024-04-01T19:58:08.478 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027014251999999999 2024-04-01T19:58:08.478 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.478 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.478 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:08.478 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.500611+0000", 2024-04-01T19:58:08.478 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.065880843999999994 2024-04-01T19:58:08.478 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.478 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.479 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:08.479 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.500645+0000", 2024-04-01T19:58:08.479 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4582000000000002e-05 2024-04-01T19:58:08.479 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.479 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.479 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:08.479 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.503774+0000", 2024-04-01T19:58:08.479 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031284469999999999 2024-04-01T19:58:08.479 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.479 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:08.479 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.479 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.479 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.479 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:171616 8.6 8:68689a02:::benchmark_data_smithi188_161190_object32334:head [delete] snapc 0=[] ondisk+write+known_if_redirected e690)", 2024-04-01T19:58:08.479 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:43.362930+0000", 2024-04-01T19:58:08.479 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.026557675999996, 2024-04-01T19:58:08.480 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.223873023, 2024-04-01T19:58:08.480 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:08.480 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:08.480 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:08.480 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:08.480 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:08.480 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:08.480 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 171616 2024-04-01T19:58:08.480 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.480 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:08.480 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.480 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:08.480 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.362930+0000", 2024-04-01T19:58:08.480 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.480 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.481 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.481 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:08.481 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.362930+0000", 2024-04-01T19:58:08.481 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.481 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.481 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.481 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:08.481 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.362931+0000", 2024-04-01T19:58:08.481 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.525e-06 2024-04-01T19:58:08.481 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.481 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.481 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:08.481 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.362936+0000", 2024-04-01T19:58:08.481 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4599999999999996e-06 2024-04-01T19:58:08.481 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.481 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.482 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:08.482 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.362950+0000", 2024-04-01T19:58:08.482 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4064e-05 2024-04-01T19:58:08.482 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.482 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.482 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:08.482 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.362958+0000", 2024-04-01T19:58:08.482 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8040000000000002e-06 2024-04-01T19:58:08.482 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.482 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.482 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.482 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.388880+0000", 2024-04-01T19:58:08.482 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.025922458999999998 2024-04-01T19:58:08.482 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.483 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.483 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T19:58:08.483 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.388938+0000", 2024-04-01T19:58:08.483 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7383000000000003e-05 2024-04-01T19:58:08.483 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.483 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.483 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.483 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.552235+0000", 2024-04-01T19:58:08.483 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.163297676 2024-04-01T19:58:08.483 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.483 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.483 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:08.483 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.552337+0000", 2024-04-01T19:58:08.483 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010166399999999999 2024-04-01T19:58:08.484 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.484 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.484 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 7", 2024-04-01T19:58:08.484 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.552493+0000", 2024-04-01T19:58:08.484 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015653100000000001 2024-04-01T19:58:08.484 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.484 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.484 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:08.484 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.570745+0000", 2024-04-01T19:58:08.484 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018251304999999999 2024-04-01T19:58:08.484 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.484 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.484 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:08.484 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.582258+0000", 2024-04-01T19:58:08.484 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011512926 2024-04-01T19:58:08.484 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.485 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.485 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:08.485 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.582289+0000", 2024-04-01T19:58:08.485 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1809e-05 2024-04-01T19:58:08.485 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.485 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.485 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:08.485 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.586803+0000", 2024-04-01T19:58:08.485 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0045134169999999996 2024-04-01T19:58:08.485 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.485 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:08.485 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.485 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.485 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.486 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:176236 8.6 8:619d2bb6:::benchmark_data_smithi188_161190_object36954:head [delete] snapc 0=[] ondisk+write+known_if_redirected e691)", 2024-04-01T19:58:08.486 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:50.875093+0000", 2024-04-01T19:58:08.486 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 77.514394271, 2024-04-01T19:58:08.486 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.24717445900000001, 2024-04-01T19:58:08.486 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:08.486 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:08.486 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:08.486 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:08.486 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:08.486 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:08.486 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 176236 2024-04-01T19:58:08.486 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.486 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:08.487 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.487 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:08.487 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:50.875093+0000", 2024-04-01T19:58:08.487 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.487 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.487 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.487 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:08.487 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:50.875093+0000", 2024-04-01T19:58:08.487 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.487 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.487 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.487 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:08.488 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:50.875094+0000", 2024-04-01T19:58:08.488 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.159e-06 2024-04-01T19:58:08.488 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.488 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.488 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:08.488 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:50.875098+0000", 2024-04-01T19:58:08.488 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0629999999999999e-06 2024-04-01T19:58:08.488 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.488 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.488 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:08.488 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:50.875104+0000", 2024-04-01T19:58:08.488 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.485e-06 2024-04-01T19:58:08.488 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.489 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.489 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:08.489 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:50.875108+0000", 2024-04-01T19:58:08.489 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4259999999999996e-06 2024-04-01T19:58:08.489 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.489 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.489 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.489 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.007440+0000", 2024-04-01T19:58:08.489 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13233178700000001 2024-04-01T19:58:08.489 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.489 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.489 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T19:58:08.489 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.007503+0000", 2024-04-01T19:58:08.490 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3343999999999995e-05 2024-04-01T19:58:08.490 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.490 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.490 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.490 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.021686+0000", 2024-04-01T19:58:08.490 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014182693999999999 2024-04-01T19:58:08.490 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.490 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.490 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:08.490 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.021773+0000", 2024-04-01T19:58:08.490 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7162000000000003e-05 2024-04-01T19:58:08.490 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.490 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.490 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 7", 2024-04-01T19:58:08.491 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.021878+0000", 2024-04-01T19:58:08.491 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000104706 2024-04-01T19:58:08.491 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.491 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.491 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:08.491 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.040696+0000", 2024-04-01T19:58:08.491 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018817758 2024-04-01T19:58:08.491 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.491 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.491 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:08.491 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.118762+0000", 2024-04-01T19:58:08.491 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.078065857000000002 2024-04-01T19:58:08.491 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.491 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.492 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:08.492 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.118825+0000", 2024-04-01T19:58:08.492 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2965000000000004e-05 2024-04-01T19:58:08.492 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.492 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.492 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:08.492 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.122268+0000", 2024-04-01T19:58:08.492 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0034430530000000002 2024-04-01T19:58:08.492 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.492 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:08.492 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.492 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.492 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.493 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:176238 8.6 8:6c718e26:::benchmark_data_smithi188_161190_object36956:head [delete] snapc 0=[] ondisk+write+known_if_redirected e691)", 2024-04-01T19:58:08.493 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:50.875306+0000", 2024-04-01T19:58:08.493 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 77.514181755999999, 2024-04-01T19:58:08.493 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.28142732799999998, 2024-04-01T19:58:08.493 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:08.493 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:08.493 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:08.493 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:08.493 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:08.493 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:08.493 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 176238 2024-04-01T19:58:08.493 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.493 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:08.493 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.494 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:08.494 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:50.875306+0000", 2024-04-01T19:58:08.494 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.494 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.494 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.494 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:08.494 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:50.875306+0000", 2024-04-01T19:58:08.494 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.494 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.494 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.494 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:08.494 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:50.875307+0000", 2024-04-01T19:58:08.494 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8100000000000002e-07 2024-04-01T19:58:08.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.495 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.495 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:08.495 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:50.875310+0000", 2024-04-01T19:58:08.495 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.433e-06 2024-04-01T19:58:08.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.495 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.495 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:08.495 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:50.875316+0000", 2024-04-01T19:58:08.495 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1249999999999998e-06 2024-04-01T19:58:08.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.495 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.495 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:08.495 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:50.875320+0000", 2024-04-01T19:58:08.495 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0040000000000001e-06 2024-04-01T19:58:08.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.496 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.496 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.496 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.011477+0000", 2024-04-01T19:58:08.496 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13615714200000001 2024-04-01T19:58:08.496 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.496 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.496 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T19:58:08.496 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.012006+0000", 2024-04-01T19:58:08.496 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00052850300000000005 2024-04-01T19:58:08.496 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.496 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.496 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.496 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.061619+0000", 2024-04-01T19:58:08.496 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.049613537999999999 2024-04-01T19:58:08.496 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.496 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:08.497 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.061678+0000", 2024-04-01T19:58:08.497 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8711000000000001e-05 2024-04-01T19:58:08.497 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 7", 2024-04-01T19:58:08.497 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.061756+0000", 2024-04-01T19:58:08.497 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8207999999999994e-05 2024-04-01T19:58:08.497 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:08.497 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.076183+0000", 2024-04-01T19:58:08.497 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014426690000000001 2024-04-01T19:58:08.497 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:08.498 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.153064+0000", 2024-04-01T19:58:08.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.076881122999999996 2024-04-01T19:58:08.498 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.498 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.498 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:08.498 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.153101+0000", 2024-04-01T19:58:08.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6973e-05 2024-04-01T19:58:08.498 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.498 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.498 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:08.498 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.156733+0000", 2024-04-01T19:58:08.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036320969999999999 2024-04-01T19:58:08.498 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.498 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:08.498 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.499 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.499 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:176267 8.6 8:608daf81:::benchmark_data_smithi188_161190_object36985:head [delete] snapc 0=[] ondisk+write+known_if_redirected e691)", 2024-04-01T19:58:08.499 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:51.017714+0000", 2024-04-01T19:58:08.499 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 77.371773446000006, 2024-04-01T19:58:08.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.229489213, 2024-04-01T19:58:08.499 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:08.499 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:08.499 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:08.499 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:08.499 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:08.499 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:08.499 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 176267 2024-04-01T19:58:08.499 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.499 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:08.500 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.500 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:08.500 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.017714+0000", 2024-04-01T19:58:08.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.500 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.500 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.500 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:08.500 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.017714+0000", 2024-04-01T19:58:08.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.500 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.500 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.500 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:08.500 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.017716+0000", 2024-04-01T19:58:08.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.875e-06 2024-04-01T19:58:08.500 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.500 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.501 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:08.501 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.017721+0000", 2024-04-01T19:58:08.501 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0579999999999997e-06 2024-04-01T19:58:08.501 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.501 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:08.501 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.017731+0000", 2024-04-01T19:58:08.501 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7790000000000007e-06 2024-04-01T19:58:08.501 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.501 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:08.501 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.017739+0000", 2024-04-01T19:58:08.501 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0190000000000006e-06 2024-04-01T19:58:08.501 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.502 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.039279+0000", 2024-04-01T19:58:08.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.021540442 2024-04-01T19:58:08.502 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.502 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T19:58:08.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.039361+0000", 2024-04-01T19:58:08.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1630000000000003e-05 2024-04-01T19:58:08.502 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.502 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.198813+0000", 2024-04-01T19:58:08.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.15945219299999999 2024-04-01T19:58:08.502 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:08.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.198878+0000", 2024-04-01T19:58:08.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4586999999999997e-05 2024-04-01T19:58:08.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 7", 2024-04-01T19:58:08.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.199007+0000", 2024-04-01T19:58:08.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012929099999999999 2024-04-01T19:58:08.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:08.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.231533+0000", 2024-04-01T19:58:08.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.032525652000000002 2024-04-01T19:58:08.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:08.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.243876+0000", 2024-04-01T19:58:08.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012342937999999999 2024-04-01T19:58:08.504 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.504 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:08.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.243912+0000", 2024-04-01T19:58:08.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6125999999999999e-05 2024-04-01T19:58:08.504 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.504 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:08.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.247203+0000", 2024-04-01T19:58:08.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.003291623 2024-04-01T19:58:08.504 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.504 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:08.505 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.505 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.505 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.505 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:188437 8.7 8:e49277ca:::benchmark_data_smithi188_161190_object49155:head [delete] snapc 0=[] ondisk+write+known_if_redirected e696)", 2024-04-01T19:58:08.505 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:57:09.999899+0000", 2024-04-01T19:58:08.505 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 58.389588203000002, 2024-04-01T19:58:08.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.23475475900000001, 2024-04-01T19:58:08.505 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:08.505 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:08.505 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:08.505 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:08.505 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:08.505 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:08.505 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 188437 2024-04-01T19:58:08.505 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.505 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:08.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.506 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:08.506 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:09.999899+0000", 2024-04-01T19:58:08.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.506 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.506 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:08.506 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:09.999899+0000", 2024-04-01T19:58:08.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.506 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.506 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:08.506 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:09.999903+0000", 2024-04-01T19:58:08.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.393e-06 2024-04-01T19:58:08.506 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:08.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:09.999910+0000", 2024-04-01T19:58:08.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6140000000000003e-06 2024-04-01T19:58:08.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:08.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:09.999927+0000", 2024-04-01T19:58:08.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6875999999999999e-05 2024-04-01T19:58:08.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:08.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:09.999936+0000", 2024-04-01T19:58:08.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9400000000000008e-06 2024-04-01T19:58:08.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:10.068312+0000", 2024-04-01T19:58:08.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.068375936999999998 2024-04-01T19:58:08.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T19:58:08.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:10.068383+0000", 2024-04-01T19:58:08.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0982999999999994e-05 2024-04-01T19:58:08.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:10.184430+0000", 2024-04-01T19:58:08.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.11604685100000001 2024-04-01T19:58:08.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:08.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:10.184490+0000", 2024-04-01T19:58:08.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9809999999999998e-05 2024-04-01T19:58:08.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:58:08.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:10.184566+0000", 2024-04-01T19:58:08.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6292999999999996e-05 2024-04-01T19:58:08.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:08.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:10.213308+0000", 2024-04-01T19:58:08.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028741791999999999 2024-04-01T19:58:08.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.510 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:08.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:10.231824+0000", 2024-04-01T19:58:08.510 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018516583 2024-04-01T19:58:08.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.510 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:08.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:10.231862+0000", 2024-04-01T19:58:08.510 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.765e-05 2024-04-01T19:58:08.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.510 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:08.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:10.234654+0000", 2024-04-01T19:58:08.510 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0027920369999999998 2024-04-01T19:58:08.511 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.511 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:08.511 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.511 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:193057 8.7 8:e026767a:::benchmark_data_smithi188_161190_object53775:head [delete] snapc 0=[] ondisk+write+known_if_redirected e699)", 2024-04-01T19:58:08.511 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:57:16.924519+0000", 2024-04-01T19:58:08.511 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 51.464968460000001, 2024-04-01T19:58:08.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.263612285, 2024-04-01T19:58:08.511 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:08.511 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:08.511 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:08.511 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:08.511 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:08.512 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:08.512 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 193057 2024-04-01T19:58:08.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.512 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:08.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:08.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.924519+0000", 2024-04-01T19:58:08.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:08.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.924519+0000", 2024-04-01T19:58:08.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:08.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:08.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.924522+0000", 2024-04-01T19:58:08.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0620000000000001e-06 2024-04-01T19:58:08.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:08.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.924530+0000", 2024-04-01T19:58:08.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3119999999999994e-06 2024-04-01T19:58:08.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:08.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.924544+0000", 2024-04-01T19:58:08.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3675e-05 2024-04-01T19:58:08.514 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:08.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.924555+0000", 2024-04-01T19:58:08.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0514e-05 2024-04-01T19:58:08.514 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.927622+0000", 2024-04-01T19:58:08.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030675609999999999 2024-04-01T19:58:08.514 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T19:58:08.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.927687+0000", 2024-04-01T19:58:08.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4517999999999995e-05 2024-04-01T19:58:08.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:08.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:17.166978+0000", 2024-04-01T19:58:08.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.23929161400000001 2024-04-01T19:58:08.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:08.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:17.167088+0000", 2024-04-01T19:58:08.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010994599999999999 2024-04-01T19:58:08.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:58:08.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:17.167246+0000", 2024-04-01T19:58:08.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015796399999999999 2024-04-01T19:58:08.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:08.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:17.186228+0000", 2024-04-01T19:58:08.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018981326 2024-04-01T19:58:08.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:08.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:17.186270+0000", 2024-04-01T19:58:08.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2123000000000003e-05 2024-04-01T19:58:08.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:08.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:17.186332+0000", 2024-04-01T19:58:08.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2501000000000003e-05 2024-04-01T19:58:08.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:08.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:08.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:08.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:17.188131+0000", 2024-04-01T19:58:08.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001799169 2024-04-01T19:58:08.517 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.517 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:08.517 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.517 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:08.517 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:08.517 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:58:08.518 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:08 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:58:08.518 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:08 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1985040802' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:58:08.518 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:08 smithi062 ceph-mon[44211]: osdmap e708: 12 total, 11 up, 10 in 2024-04-01T19:58:08.518 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:08 smithi062 ceph-mon[44211]: pgmap v1946: 17 pgs: 1 active+clean+scrubbing, 5 active+recovering+degraded, 11 active+clean; 3.1 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 777 op/s; 15630/101028 objects degraded (15.471%); 15 MiB/s, 245 objects/s recovering 2024-04-01T19:58:08.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:08 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:58:08.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:08 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1985040802' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:58:08.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:08 smithi022 ceph-mon[39439]: osdmap e708: 12 total, 11 up, 10 in 2024-04-01T19:58:08.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:08 smithi022 ceph-mon[39439]: pgmap v1946: 17 pgs: 1 active+clean+scrubbing, 5 active+recovering+degraded, 11 active+clean; 3.1 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 777 op/s; 15630/101028 objects degraded (15.471%); 15 MiB/s, 245 objects/s recovering 2024-04-01T19:58:09.045 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:58:09.050 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:09.051 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:58:09.078 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:58:09.152 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:58:09.199 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:09.234 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:58:09.236 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:09.237 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:58:09.338 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:58:09.444 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:10.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:10 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:58:10.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:10 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:58:10.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:10 smithi188 ceph-mon[43939]: osdmap e709: 12 total, 11 up, 10 in 2024-04-01T19:58:10.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:10 smithi188 ceph-mon[43939]: pgmap v1948: 17 pgs: 1 active+clean+scrubbing, 5 active+recovering+degraded, 11 active+clean; 3.1 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 543 op/s; 15630/100520 objects degraded (15.549%); 11 MiB/s, 179 objects/s recovering 2024-04-01T19:58:10.509 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:10 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:58:10.509 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:10 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:58:10.509 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:10 smithi022 ceph-mon[39439]: osdmap e709: 12 total, 11 up, 10 in 2024-04-01T19:58:10.509 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:10 smithi022 ceph-mon[39439]: pgmap v1948: 17 pgs: 1 active+clean+scrubbing, 5 active+recovering+degraded, 11 active+clean; 3.1 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 543 op/s; 15630/100520 objects degraded (15.549%); 11 MiB/s, 179 objects/s recovering 2024-04-01T19:58:10.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:10 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:58:10.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:10 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:58:10.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:10 smithi062 ceph-mon[44211]: osdmap e709: 12 total, 11 up, 10 in 2024-04-01T19:58:10.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:10 smithi062 ceph-mon[44211]: pgmap v1948: 17 pgs: 1 active+clean+scrubbing, 5 active+recovering+degraded, 11 active+clean; 3.1 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 543 op/s; 15630/100520 objects degraded (15.549%); 11 MiB/s, 179 objects/s recovering 2024-04-01T19:58:11.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:11 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 15630/100520 objects degraded (15.549%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:11.452 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:58:11.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:11 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 15630/100520 objects degraded (15.549%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:11.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:11 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 15630/100520 objects degraded (15.549%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:12.352 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:58:12.359 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:12.360 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:58:12.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:12 smithi022 ceph-mon[39439]: pgmap v1949: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.9 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 924 op/s; 14631/93544 objects degraded (15.641%); 17 MiB/s, 277 objects/s recovering 2024-04-01T19:58:12.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:12 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:58:12.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:12 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:58:12.447 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_ops_in_flight 2024-04-01T19:58:12.448 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:12 smithi188 ceph-mon[43939]: pgmap v1949: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.9 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 924 op/s; 14631/93544 objects degraded (15.641%); 17 MiB/s, 277 objects/s recovering 2024-04-01T19:58:12.448 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:12 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:58:12.448 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:12 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:58:12.461 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:58:12.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:12 smithi062 ceph-mon[44211]: pgmap v1949: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.9 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 0 B/s wr, 924 op/s; 14631/93544 objects degraded (15.641%); 17 MiB/s, 277 objects/s recovering 2024-04-01T19:58:12.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:12 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:58:12.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:12 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:58:12.542 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:12.552 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:58:12.573 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:58:12.577 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:12.578 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:58:12.678 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:58:12.739 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:12.881 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:58:13.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:13 smithi062 ceph-mon[44211]: osdmap e710: 12 total, 11 up, 10 in 2024-04-01T19:58:13.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:13 smithi022 ceph-mon[39439]: osdmap e710: 12 total, 11 up, 10 in 2024-04-01T19:58:13.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:13 smithi188 ceph-mon[43939]: osdmap e710: 12 total, 11 up, 10 in 2024-04-01T19:58:14.108 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:58:14.112 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:14.113 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:58:14.214 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:58:14.250 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:14.289 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:58:14.294 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:14.294 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:58:14.396 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:58:14.437 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:14.441 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:14 smithi062 ceph-mon[44211]: pgmap v1951: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.8 GiB data, 10 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 677 op/s; 14387/92564 objects degraded (15.543%); 12 MiB/s, 199 objects/s recovering 2024-04-01T19:58:14.473 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:58:14.476 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:14.477 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:58:14.483 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:14 smithi188 ceph-mon[43939]: pgmap v1951: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.8 GiB data, 10 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 677 op/s; 14387/92564 objects degraded (15.543%); 12 MiB/s, 199 objects/s recovering 2024-04-01T19:58:14.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:14 smithi022 ceph-mon[39439]: pgmap v1951: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.8 GiB data, 10 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 677 op/s; 14387/92564 objects degraded (15.543%); 12 MiB/s, 199 objects/s recovering 2024-04-01T19:58:14.577 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:58:14.609 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:14.630 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:58:14.643 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:58:14.646 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:14.646 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:58:14.657 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:58:14.689 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:58:14.723 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:58:14.747 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:58:14.753 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:58:14.783 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:58:14.787 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:14.793 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:58:14.825 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:58:14.869 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:58:14.898 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:58:14.927 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:58:14.962 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:58:14.962 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:58:14.962 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:58:14.962 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:58:14.962 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:58:14.962 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:58:14.963 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:58:14.963 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:58:14.963 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:58:14.963 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:58:14.963 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:58:14.963 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.10 2024-04-01T19:58:14.963 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:58:15.165 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:58:15.170 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:15.170 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:58:15.271 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:58:15.308 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:15.344 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:58:15.348 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:15.348 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:58:15.449 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:58:15.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:15 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2736852861' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:58:15.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:15.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:15.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:15.498 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:15 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2736852861' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:58:15.498 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:15.498 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:15.498 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:15.500 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:15.540 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:58:15.540 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:15.541 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:58:15.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:15 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2736852861' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:58:15.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:15.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:15.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:15.641 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:58:15.681 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:15.723 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:58:15.731 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:15.731 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:58:15.832 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:58:15.866 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:16.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:16 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:16.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:16 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:16.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:16 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:16.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:16 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:16.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:16 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:16.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:16 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:16.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:16 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:16.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:16 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:16.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:16 smithi188 ceph-mon[43939]: pgmap v1952: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.8 GiB data, 10 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 588 op/s; 14387/91616 objects degraded (15.704%); 9.7 MiB/s, 155 objects/s recovering 2024-04-01T19:58:16.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:16 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 14387/92564 objects degraded (15.543%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:16.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:16 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:16.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:16 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:16.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:16 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:16.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:16 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:16.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:16 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:16.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:16 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:16.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:16 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:16.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:16 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:16.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:16 smithi022 ceph-mon[39439]: pgmap v1952: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.8 GiB data, 10 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 588 op/s; 14387/91616 objects degraded (15.704%); 9.7 MiB/s, 155 objects/s recovering 2024-04-01T19:58:16.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:16 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 14387/92564 objects degraded (15.543%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:16.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:16 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:16.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:16 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:16.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:16 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:16.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:16 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:16.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:16 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:16.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:16 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:16.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:16 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:16.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:16 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:16.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:16 smithi062 ceph-mon[44211]: pgmap v1952: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.8 GiB data, 10 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 588 op/s; 14387/91616 objects degraded (15.704%); 9.7 MiB/s, 155 objects/s recovering 2024-04-01T19:58:16.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:16 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 14387/92564 objects degraded (15.543%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:16.788 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:58:16.788 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:58:17.669 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_blocked_ops 2024-04-01T19:58:18.104 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:58:18.241 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:58:18.242 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:58:18.509 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:18 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:58:18.509 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:18 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:58:18.509 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:18 smithi188 ceph-mon[43939]: osdmap e711: 12 total, 11 up, 10 in 2024-04-01T19:58:18.509 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:18 smithi188 ceph-mon[43939]: pgmap v1954: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.6 GiB data, 10 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 965 op/s; 13091/85066 objects degraded (15.389%); 20 MiB/s, 317 objects/s recovering 2024-04-01T19:58:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:18 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:58:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:18 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:58:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:18 smithi062 ceph-mon[44211]: osdmap e711: 12 total, 11 up, 10 in 2024-04-01T19:58:18.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:18 smithi062 ceph-mon[44211]: pgmap v1954: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.6 GiB data, 10 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 965 op/s; 13091/85066 objects degraded (15.389%); 20 MiB/s, 317 objects/s recovering 2024-04-01T19:58:18.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:18 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:58:18.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:18 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:58:18.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:18 smithi022 ceph-mon[39439]: osdmap e711: 12 total, 11 up, 10 in 2024-04-01T19:58:18.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:18 smithi022 ceph-mon[39439]: pgmap v1954: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.6 GiB data, 10 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 965 op/s; 13091/85066 objects degraded (15.389%); 20 MiB/s, 317 objects/s recovering 2024-04-01T19:58:18.625 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:58:18.627 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:18.628 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:58:18.729 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:58:18.775 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:19.142 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:58:19.151 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:19.152 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:58:19.252 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:58:19.305 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:20.237 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:58:20.242 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:58:20.243 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:58:20.490 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:58:20.526 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:20 smithi022 ceph-mon[39439]: pgmap v1955: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.6 GiB data, 10 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 561 op/s; 13091/84560 objects degraded (15.481%); 12 MiB/s, 192 objects/s recovering 2024-04-01T19:58:20.526 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:20 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2847138596' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:58:20.526 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:20 smithi022 ceph-mon[39439]: from='client.27229 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:58:20.648 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:58:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:20 smithi062 ceph-mon[44211]: pgmap v1955: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.6 GiB data, 10 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 561 op/s; 13091/84560 objects degraded (15.481%); 12 MiB/s, 192 objects/s recovering 2024-04-01T19:58:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:20 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2847138596' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:58:20.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:20 smithi062 ceph-mon[44211]: from='client.27229 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:58:20.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:20 smithi188 ceph-mon[43939]: pgmap v1955: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.6 GiB data, 10 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 561 op/s; 13091/84560 objects degraded (15.481%); 12 MiB/s, 192 objects/s recovering 2024-04-01T19:58:20.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:20 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2847138596' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:58:20.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:20 smithi188 ceph-mon[43939]: from='client.27229 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:58:21.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:21 smithi062 ceph-mon[44211]: from='client.17277 v1:172.21.15.22:0/2422585255' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:58:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:21 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:58:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:21 smithi062 ceph-mon[44211]: from='client.27229 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:58:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:21 smithi062 ceph-mon[44211]: osdmap e712: 12 total, 11 up, 10 in 2024-04-01T19:58:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:21 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 13091/84560 objects degraded (15.481%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:21 smithi062 ceph-mon[44211]: pgmap v1957: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.4 GiB data, 9.8 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 964 op/s; 12036/77124 objects degraded (15.606%); 18 MiB/s, 293 objects/s recovering 2024-04-01T19:58:21.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:21 smithi022 ceph-mon[39439]: from='client.17277 v1:172.21.15.22:0/2422585255' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:58:21.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:21 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:58:21.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:21 smithi022 ceph-mon[39439]: from='client.27229 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:58:21.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:21 smithi022 ceph-mon[39439]: osdmap e712: 12 total, 11 up, 10 in 2024-04-01T19:58:21.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:21 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 13091/84560 objects degraded (15.481%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:21.867 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:21 smithi022 ceph-mon[39439]: pgmap v1957: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.4 GiB data, 9.8 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 964 op/s; 12036/77124 objects degraded (15.606%); 18 MiB/s, 293 objects/s recovering 2024-04-01T19:58:21.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:21 smithi188 ceph-mon[43939]: from='client.17277 v1:172.21.15.22:0/2422585255' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:58:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:21 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:58:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:21 smithi188 ceph-mon[43939]: from='client.27229 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:58:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:21 smithi188 ceph-mon[43939]: osdmap e712: 12 total, 11 up, 10 in 2024-04-01T19:58:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:21 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 13091/84560 objects degraded (15.481%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:21 smithi188 ceph-mon[43939]: pgmap v1957: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.4 GiB data, 9.8 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 964 op/s; 12036/77124 objects degraded (15.606%); 18 MiB/s, 293 objects/s recovering 2024-04-01T19:58:22.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:22 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:58:22.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:22 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:58:22.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:22 smithi062 ceph-mon[44211]: osdmap e713: 12 total, 11 up, 10 in 2024-04-01T19:58:22.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:22 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:58:22.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:22 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:58:22.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:22 smithi022 ceph-mon[39439]: osdmap e713: 12 total, 11 up, 10 in 2024-04-01T19:58:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:22 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:58:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:22 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:58:22.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:22 smithi188 ceph-mon[43939]: osdmap e713: 12 total, 11 up, 10 in 2024-04-01T19:58:23.251 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:58:23.260 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:23.260 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:58:23.361 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:58:23.404 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:23.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:23 smithi188 ceph-mon[43939]: pgmap v1959: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.3 GiB data, 9.6 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 719 op/s; 11787/76158 objects degraded (15.477%); 13 MiB/s, 210 objects/s recovering 2024-04-01T19:58:23.720 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:23 smithi022 ceph-mon[39439]: pgmap v1959: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.3 GiB data, 9.6 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 719 op/s; 11787/76158 objects degraded (15.477%); 13 MiB/s, 210 objects/s recovering 2024-04-01T19:58:23.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:23 smithi062 ceph-mon[44211]: pgmap v1959: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.3 GiB data, 9.6 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 719 op/s; 11787/76158 objects degraded (15.477%); 13 MiB/s, 210 objects/s recovering 2024-04-01T19:58:23.866 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:58:23.870 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:23.871 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:58:23.877 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":1955,"stamp":"2024-04-01T19:58:19.403296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2771255864,"num_objects":42280,"num_object_clones":0,"num_object_copies":84560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":13091,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42280,"num_whiteouts":0,"num_read":127,"num_read_kb":110,"num_write":236463,"num_write_kb":8916795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28232,"num_bytes_recovered":1851345024,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160942,"ondisk_log_size":160942,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":9,"kb":937451520,"kb_used":10535400,"kb_used_data":4593616,"kb_used_omap":889,"kb_used_meta":5940806,"kb_avail":926916120,"statfs":{"total":959950356480,"available":949162106880,"internally_reserved":0,"allocated":4703862784,"data_stored":4699922758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":910339,"internal_metadata":6083386365},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,3,6,6,3,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-294387712,"num_objects":-4492,"num_object_clones":0,"num_object_copies":-8984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1540,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4492,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4492,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1540,"num_bytes_recovered":100925440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.006340"},"pg_stats":[{"pgid":"8.f","version":"710'14926","reported_seq":15192,"reported_epoch":710,"state":"active+clean","last_fresh":"2024-04-01T19:58:16.116124+0000","last_change":"2024-04-01T19:55:39.217150+0000","last_active":"2024-04-01T19:58:16.116124+0000","last_peered":"2024-04-01T19:58:16.116124+0000","last_clean":"2024-04-01T19:58:16.116124+0000","last_became_active":"2024-04-01T19:53:54.067307+0000","last_became_peered":"2024-04-01T19:53:54.067307+0000","last_unstale":"2024-04-01T19:58:16.116124+0000","last_undegraded":"2024-04-01T19:58:16.116124+0000","last_fullsized":"2024-04-01T19:58:16.116124+0000","mapping_epoch":629,"log_start":"656'4900","ondisk_log_start":"656'4900","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8876","last_scrub_stamp":"2024-04-01T19:55:39.216977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:39.216977+0000","objects_scrubbed":8773,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1863,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175374336,"num_objects":2676,"num_object_clones":0,"num_object_copies":5352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2676,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14926,"num_write_kb":563264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.e","version":"710'14573","reported_seq":14836,"reported_epoch":710,"state":"active+clean","last_fresh":"2024-04-01T19:58:15.687936+0000","last_change":"2024-04-01T19:55:33.528266+0000","last_active":"2024-04-01T19:58:15.687936+0000","last_peered":"2024-04-01T19:58:15.687936+0000","last_clean":"2024-04-01T19:58:15.687936+0000","last_became_active":"2024-04-01T19:53:54.066471+0000","last_became_peered":"2024-04-01T19:53:54.066471+0000","last_unstale":"2024-04-01T19:58:15.687936+0000","last_undegraded":"2024-04-01T19:58:15.687936+0000","last_fullsized":"2024-04-01T19:58:15.687936+0000","mapping_epoch":629,"log_start":"654'4500","ondisk_log_start":"654'4500","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'8369","last_scrub_stamp":"2024-04-01T19:55:33.528006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:33.528006+0000","objects_scrubbed":8332,"log_size":10073,"log_dups_size":0,"ondisk_log_size":10073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1210,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172556288,"num_objects":2633,"num_object_clones":0,"num_object_copies":5266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2633,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14573,"num_write_kb":550592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"710'15011","reported_seq":15278,"reported_epoch":710,"state":"active+clean","last_fresh":"2024-04-01T19:58:16.038080+0000","last_change":"2024-04-01T19:55:45.161755+0000","last_active":"2024-04-01T19:58:16.038080+0000","last_peered":"2024-04-01T19:58:16.038080+0000","last_clean":"2024-04-01T19:58:16.038080+0000","last_became_active":"2024-04-01T19:53:53.678991+0000","last_became_peered":"2024-04-01T19:53:53.678991+0000","last_unstale":"2024-04-01T19:58:16.038080+0000","last_undegraded":"2024-04-01T19:58:16.038080+0000","last_fullsized":"2024-04-01T19:58:16.038080+0000","mapping_epoch":629,"log_start":"657'5000","ondisk_log_start":"657'5000","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"674'9322","last_scrub_stamp":"2024-04-01T19:55:45.161618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:45.161618+0000","objects_scrubbed":8442,"log_size":10011,"log_dups_size":0,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1822,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176291864,"num_objects":2691,"num_object_clones":0,"num_object_copies":5382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2691,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":15011,"num_write_kb":566401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.c","version":"710'14761","reported_seq":15094,"reported_epoch":710,"state":"active+clean","last_fresh":"2024-04-01T19:58:15.752492+0000","last_change":"2024-04-01T19:57:06.345540+0000","last_active":"2024-04-01T19:58:15.752492+0000","last_peered":"2024-04-01T19:58:15.752492+0000","last_clean":"2024-04-01T19:58:15.752492+0000","last_became_active":"2024-04-01T19:53:53.462634+0000","last_became_peered":"2024-04-01T19:53:53.462634+0000","last_unstale":"2024-04-01T19:58:15.752492+0000","last_undegraded":"2024-04-01T19:58:15.752492+0000","last_fullsized":"2024-04-01T19:58:15.752492+0000","mapping_epoch":629,"log_start":"656'4700","ondisk_log_start":"656'4700","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"695'11630","last_scrub_stamp":"2024-04-01T19:57:06.345285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:57:06.345285+0000","objects_scrubbed":5792,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:58:22.050371+0000","scrub_duration":1062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173211648,"num_objects":2643,"num_object_clones":0,"num_object_copies":5286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2643,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14761,"num_write_kb":556928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"8.b","version":"710'14875","reported_seq":15254,"reported_epoch":710,"state":"active+clean","last_fresh":"2024-04-01T19:58:14.445257+0000","last_change":"2024-04-01T19:58:04.980816+0000","last_active":"2024-04-01T19:58:14.445257+0000","last_peered":"2024-04-01T19:58:14.445257+0000","last_clean":"2024-04-01T19:58:14.445257+0000","last_became_active":"2024-04-01T19:53:53.456979+0000","last_became_peered":"2024-04-01T19:53:53.456979+0000","last_unstale":"2024-04-01T19:58:14.445257+0000","last_undegraded":"2024-04-01T19:58:14.445257+0000","last_fullsized":"2024-04-01T19:58:14.445257+0000","mapping_epoch":629,"log_start":"656'4800","ondisk_log_start":"656'4800","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"707'14413","last_scrub_stamp":"2024-04-01T19:58:04.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:58:04.980641+0000","objects_scrubbed":3325,"log_size":10075,"log_dups_size":0,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:59:19.064773+0000","scrub_duration":600,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186843136,"num_objects":2851,"num_object_clones":0,"num_object_copies":5702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2851,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14875,"num_write_kb":567232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"8.a","version":"710'14454","reported_seq":14818,"reported_epoch":710,"state":"active+clean","last_fresh":"2024-04-01T19:58:14.454919+0000","last_change":"2024-04-01T19:57:56.975934+0000","last_active":"2024-04-01T19:58:14.454919+0000","last_peered":"2024-04-01T19:58:14.454919+0000","last_clean":"2024-04-01T19:58:14.454919+0000","last_became_active":"2024-04-01T19:53:54.066588+0000","last_became_peered":"2024-04-01T19:53:54.066588+0000","last_unstale":"2024-04-01T19:58:14.454919+0000","last_undegraded":"2024-04-01T19:58:14.454919+0000","last_fullsized":"2024-04-01T19:58:14.454919+0000","mapping_epoch":629,"log_start":"654'4400","ondisk_log_start":"654'4400","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"706'13635","last_scrub_stamp":"2024-04-01T19:57:56.975745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:57:56.975745+0000","objects_scrubbed":3527,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:59:06.634758+0000","scrub_duration":583,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176816128,"num_objects":2698,"num_object_clones":0,"num_object_copies":5396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2698,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14454,"num_write_kb":548864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"8.8","version":"710'14940","reported_seq":15207,"reported_epoch":710,"state":"active+clean","last_fresh":"2024-04-01T19:58:15.943434+0000","last_change":"2024-04-01T19:55:40.424211+0000","last_active":"2024-04-01T19:58:15.943434+0000","last_peered":"2024-04-01T19:58:15.943434+0000","last_clean":"2024-04-01T19:58:15.943434+0000","last_became_active":"2024-04-01T19:53:53.454737+0000","last_became_peered":"2024-04-01T19:53:53.454737+0000","last_unstale":"2024-04-01T19:58:15.943434+0000","last_undegraded":"2024-04-01T19:58:15.943434+0000","last_fullsized":"2024-04-01T19:58:15.943434+0000","mapping_epoch":629,"log_start":"656'4900","ondisk_log_start":"656'4900","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8915","last_scrub_stamp":"2024-04-01T19:55:40.424044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:40.424044+0000","objects_scrubbed":8661,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1277,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170131456,"num_objects":2596,"num_object_clones":0,"num_object_copies":5192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2596,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14940,"num_write_kb":561152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"710'14736","reported_seq":26258,"reported_epoch":710,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:58:16.143600+0000","last_change":"2024-04-01T19:56:22.028676+0000","last_active":"2024-04-01T19:58:16.143600+0000","last_peered":"2024-04-01T19:58:16.143600+0000","last_clean":"2024-04-01T19:55:56.524590+0000","last_became_active":"2024-04-01T19:56:21.981743+0000","last_became_peered":"2024-04-01T19:56:21.981743+0000","last_unstale":"2024-04-01T19:58:16.143600+0000","last_undegraded":"2024-04-01T19:56:21.738659+0000","last_fullsized":"2024-04-01T19:58:16.143600+0000","mapping_epoch":687,"log_start":"656'4700","ondisk_log_start":"656'4700","created":629,"last_epoch_clean":641,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'9008","last_scrub_stamp":"2024-04-01T19:55:43.358714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:43.358714+0000","objects_scrubbed":8387,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"no scrub is scheduled","scrub_duration":2089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169738240,"num_objects":2590,"num_object_clones":0,"num_object_copies":5180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2589,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2590,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14736,"num_write_kb":554432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5623,"num_bytes_recovered":368443392,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":["11"],"object_location_counts":[{"shards":"2,11","objects":1},{"shards":"11","objects":2589}],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.6","version":"710'14807","reported_seq":26476,"reported_epoch":710,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:58:16.127099+0000","last_change":"2024-04-01T19:56:22.018466+0000","last_active":"2024-04-01T19:58:16.127099+0000","last_peered":"2024-04-01T19:58:16.127099+0000","last_clean":"2024-04-01T19:55:56.539057+0000","last_became_active":"2024-04-01T19:56:21.956699+0000","last_became_peered":"2024-04-01T19:56:21.956699+0000","last_unstale":"2024-04-01T19:58:16.127099+0000","last_undegraded":"2024-04-01T19:56:21.744926+0000","last_fullsized":"2024-04-01T19:58:16.127099+0000","mapping_epoch":687,"log_start":"656'4800","ondisk_log_start":"656'4800","created":629,"last_epoch_clean":642,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8615","last_scrub_stamp":"2024-04-01T19:55:36.688352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:36.688352+0000","objects_scrubbed":8556,"log_size":10007,"log_dups_size":0,"ondisk_log_size":10007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"no scrub is scheduled","scrub_duration":2331,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167837696,"num_objects":2561,"num_object_clones":0,"num_object_copies":5122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2551,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14807,"num_write_kb":555776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5696,"num_bytes_recovered":373096448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":["11"],"object_location_counts":[{"shards":"7,11","objects":10},{"shards":"11","objects":2551}],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.5","version":"710'14910","reported_seq":26590,"reported_epoch":710,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:58:16.587897+0000","last_change":"2024-04-01T19:56:22.002998+0000","last_active":"2024-04-01T19:58:16.587897+0000","last_peered":"2024-04-01T19:58:16.587897+0000","last_clean":"2024-04-01T19:55:56.434043+0000","last_became_active":"2024-04-01T19:56:21.952684+0000","last_became_peered":"2024-04-01T19:56:21.952684+0000","last_unstale":"2024-04-01T19:58:16.587897+0000","last_undegraded":"2024-04-01T19:56:21.721301+0000","last_fullsized":"2024-04-01T19:58:16.587897+0000","mapping_epoch":687,"log_start":"656'4900","ondisk_log_start":"656'4900","created":629,"last_epoch_clean":644,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'8660","last_scrub_stamp":"2024-04-01T19:55:36.183547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:36.183547+0000","objects_scrubbed":8628,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"no scrub is scheduled","scrub_duration":1673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173408256,"num_objects":2646,"num_object_clones":0,"num_object_copies":5292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2642,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2646,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14910,"num_write_kb":561792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5700,"num_bytes_recovered":373555200,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":2642},{"shards":"4,11","objects":4}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.4","version":"710'17649","reported_seq":18119,"reported_epoch":710,"state":"active+clean","last_fresh":"2024-04-01T19:58:15.957660+0000","last_change":"2024-04-01T19:55:34.954183+0000","last_active":"2024-04-01T19:58:15.957660+0000","last_peered":"2024-04-01T19:58:15.957660+0000","last_clean":"2024-04-01T19:58:15.957660+0000","last_became_active":"2024-04-01T19:53:53.462894+0000","last_became_peered":"2024-04-01T19:53:53.462894+0000","last_unstale":"2024-04-01T19:58:15.957660+0000","last_undegraded":"2024-04-01T19:58:15.957660+0000","last_fullsized":"2024-04-01T19:58:15.957660+0000","mapping_epoch":629,"log_start":"662'7600","ondisk_log_start":"662'7600","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'11373","last_scrub_stamp":"2024-04-01T19:55:34.954011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:34.954011+0000","objects_scrubbed":8546,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173080576,"num_objects":2641,"num_object_clones":0,"num_object_copies":5282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2641,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14887,"num_write_kb":560896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"710'14698","reported_seq":14938,"reported_epoch":710,"state":"active+clean","last_fresh":"2024-04-01T19:58:16.087405+0000","last_change":"2024-04-01T19:54:55.108987+0000","last_active":"2024-04-01T19:58:16.087405+0000","last_peered":"2024-04-01T19:58:16.087405+0000","last_clean":"2024-04-01T19:58:16.087405+0000","last_became_active":"2024-04-01T19:53:53.462397+0000","last_became_peered":"2024-04-01T19:53:53.462397+0000","last_unstale":"2024-04-01T19:58:16.087405+0000","last_undegraded":"2024-04-01T19:58:16.087405+0000","last_fullsized":"2024-04-01T19:58:16.087405+0000","mapping_epoch":629,"log_start":"655'4600","ondisk_log_start":"655'4600","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"660'5871","last_scrub_stamp":"2024-04-01T19:54:55.108780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:54:55.108780+0000","objects_scrubbed":5824,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168820736,"num_objects":2576,"num_object_clones":0,"num_object_copies":5152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2576,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14698,"num_write_kb":552768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.2","version":"710'14462","reported_seq":25822,"reported_epoch":710,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:58:15.739471+0000","last_change":"2024-04-01T19:56:22.018621+0000","last_active":"2024-04-01T19:58:15.739471+0000","last_peered":"2024-04-01T19:58:15.739471+0000","last_clean":"2024-04-01T19:55:56.523442+0000","last_became_active":"2024-04-01T19:56:21.981766+0000","last_became_peered":"2024-04-01T19:56:21.981766+0000","last_unstale":"2024-04-01T19:58:15.739471+0000","last_undegraded":"2024-04-01T19:56:21.720612+0000","last_fullsized":"2024-04-01T19:58:15.739471+0000","mapping_epoch":687,"log_start":"654'4400","ondisk_log_start":"654'4400","created":629,"last_epoch_clean":645,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'8353","last_scrub_stamp":"2024-04-01T19:55:34.153804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:34.153804+0000","objects_scrubbed":8295,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"no scrub is scheduled","scrub_duration":1672,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174587904,"num_objects":2664,"num_object_clones":0,"num_object_copies":5328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2593,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2664,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14462,"num_write_kb":548032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5542,"num_bytes_recovered":363069440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2593},{"shards":"0,4","objects":71}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"710'17621","reported_seq":18171,"reported_epoch":710,"state":"active+clean","last_fresh":"2024-04-01T19:58:15.713605+0000","last_change":"2024-04-01T19:57:00.295446+0000","last_active":"2024-04-01T19:58:15.713605+0000","last_peered":"2024-04-01T19:58:15.713605+0000","last_clean":"2024-04-01T19:58:15.713605+0000","last_became_active":"2024-04-01T19:53:54.066680+0000","last_became_peered":"2024-04-01T19:53:54.066680+0000","last_unstale":"2024-04-01T19:58:15.713605+0000","last_undegraded":"2024-04-01T19:58:15.713605+0000","last_fullsized":"2024-04-01T19:58:15.713605+0000","mapping_epoch":629,"log_start":"663'7600","ondisk_log_start":"663'7600","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"694'14240","last_scrub_stamp":"2024-04-01T19:57:00.295287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:57:00.295287+0000","objects_scrubbed":6022,"log_size":10021,"log_dups_size":0,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:58:19.188940+0000","scrub_duration":983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171442176,"num_objects":2616,"num_object_clones":0,"num_object_copies":5232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2616,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14662,"num_write_kb":552896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"8.0","version":"711'14696","reported_seq":15078,"reported_epoch":711,"state":"active+clean","last_fresh":"2024-04-01T19:58:17.669634+0000","last_change":"2024-04-01T19:57:56.925685+0000","last_active":"2024-04-01T19:58:17.669634+0000","last_peered":"2024-04-01T19:58:17.669634+0000","last_clean":"2024-04-01T19:58:17.669634+0000","last_became_active":"2024-04-01T19:53:53.455265+0000","last_became_peered":"2024-04-01T19:53:53.455265+0000","last_unstale":"2024-04-01T19:58:17.669634+0000","last_undegraded":"2024-04-01T19:58:17.669634+0000","last_fullsized":"2024-04-01T19:58:17.669634+0000","mapping_epoch":629,"log_start":"655'4600","ondisk_log_start":"655'4600","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"706'13692","last_scrub_stamp":"2024-04-01T19:57:56.925430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:57:56.925430+0000","objects_scrubbed":3477,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:58:57.818501+0000","scrub_duration":572,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161349632,"num_objects":2462,"num_object_clones":0,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14696,"num_write_kb":549056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"710'14884","reported_seq":26494,"reported_epoch":710,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:58:15.957878+0000","last_change":"2024-04-01T19:56:22.004749+0000","last_active":"2024-04-01T19:58:15.957878+0000","last_peered":"2024-04-01T19:58:15.957878+0000","last_clean":"2024-04-01T19:55:56.538683+0000","last_became_active":"2024-04-01T19:56:21.960415+0000","last_became_peered":"2024-04-01T19:56:21.960415+0000","last_unstale":"2024-04-01T19:58:15.957878+0000","last_undegraded":"2024-04-01T19:56:21.714140+0000","last_fullsized":"2024-04-01T19:58:15.957878+0000","mapping_epoch":687,"log_start":"656'4800","ondisk_log_start":"656'4800","created":629,"last_epoch_clean":645,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8889","last_scrub_stamp":"2024-04-01T19:55:39.237364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:39.237364+0000","objects_scrubbed":8775,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"no scrub is scheduled","scrub_duration":1706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179175424,"num_objects":2734,"num_object_clones":0,"num_object_copies":5468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2716,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2734,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14884,"num_write_kb":563776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5663,"num_bytes_recovered":371064832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":["5"],"object_location_counts":[{"shards":"0,5","objects":18},{"shards":"5","objects":2716}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":1749,"reported_epoch":711,"state":"active+clean","last_fresh":"2024-04-01T19:58:17.230724+0000","last_change":"2024-04-01T19:55:33.016809+0000","last_active":"2024-04-01T19:58:17.230724+0000","last_peered":"2024-04-01T19:58:17.230724+0000","last_clean":"2024-04-01T19:58:17.230724+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:58:17.230724+0000","last_undegraded":"2024-04-01T19:58:17.230724+0000","last_fullsized":"2024-04-01T19:58:17.230724+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:55:33.016695+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:55:33.016695+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":192,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":2770665496,"num_objects":42278,"num_object_clones":0,"num_object_copies":84556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":13091,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42278,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":236282,"num_write_kb":8913857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28224,"num_bytes_recovered":1849229312,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7189766144,"data_stored":7189758000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160803,"ondisk_log_size":160803,"up":32,"acting":32,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220588,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1703236,"kb_used_data":841852,"kb_used_omap":1,"kb_used_meta":861374,"kb_avail":92041916,"statfs":{"total":95995035648,"available":94250921984,"internally_reserved":0,"allocated":862056448,"data_stored":861657529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":882047428},"hb_peers":[0,1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,3,1,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678455,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1105592,"kb_used_data":510768,"kb_used_omap":1,"kb_used_meta":594814,"kb_avail":92639560,"statfs":{"total":95995035648,"available":94862909440,"internally_reserved":0,"allocated":523026432,"data_stored":522635157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":609089984},"hb_peers":[0,1,2,3,4,5,6,7,8,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557652,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":752568,"kb_used_data":530288,"kb_used_omap":132,"kb_used_meta":222139,"kb_avail":92992584,"statfs":{"total":95995035648,"available":95224406016,"internally_reserved":0,"allocated":543014912,"data_stored":542623637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":227471079},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234434,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":779024,"kb_used_data":166152,"kb_used_omap":1,"kb_used_meta":612862,"kb_avail":92966128,"statfs":{"total":95995035648,"available":95197315072,"internally_reserved":0,"allocated":170139648,"data_stored":169734745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":627571146},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":457,"seq":1962800054445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":253628,"kb_used_data":752,"kb_used_omap":744,"kb_used_meta":252119,"kb_avail":93491524,"statfs":{"total":95995035648,"available":95735320576,"internally_reserved":0,"allocated":770048,"data_stored":378773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":762131,"internal_metadata":258170605},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":2452426326113,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1066680,"kb_used_data":341360,"kb_used_omap":1,"kb_used_meta":725310,"kb_avail":92678472,"statfs":{"total":95995035648,"available":94902755328,"internally_reserved":0,"allocated":349552640,"data_stored":349161365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":742717893},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,2,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346395,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1250680,"kb_used_data":678064,"kb_used_omap":1,"kb_used_meta":572606,"kb_avail":92494472,"statfs":{"total":95995035648,"available":94714339328,"internally_reserved":0,"allocated":694337536,"data_stored":693946261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":586348997},"hb_peers":[0,1,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669150165,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1086152,"kb_used_data":320572,"kb_used_omap":1,"kb_used_meta":765566,"kb_avail":92659000,"statfs":{"total":95995035648,"available":94882816000,"internally_reserved":0,"allocated":328265728,"data_stored":327868449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":783940039},"hb_peers":[0,1,2,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953935,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1013688,"kb_used_data":350832,"kb_used_omap":1,"kb_used_meta":662846,"kb_avail":92731464,"statfs":{"total":95995035648,"available":94957019136,"internally_reserved":0,"allocated":359251968,"data_stored":358860693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":678754757},"hb_peers":[0,1,2,3,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,0,1,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790411,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1524152,"kb_used_data":852976,"kb_used_omap":1,"kb_used_meta":671166,"kb_avail":92221000,"statfs":{"total":95995035648,"available":94434304000,"internally_reserved":0,"allocated":873447424,"data_stored":873056149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":687274437},"hb_peers":[0,1,2,3,4,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":348389376,"data_stored":348389376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":679936000,"data_stored":679936000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":325713920,"data_stored":325713920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":356843520,"data_stored":356843520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":857669632,"data_stored":857669632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":168759296,"data_stored":168755224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":541327360,"data_stored":541327360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":518520832,"data_stored":518520832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":2534604800,"data_stored":2534604800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":858001408,"data_stored":857997336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:58:23.878 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:58:23.972 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:58:24.007 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:24.053 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:58:24.059 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:24.060 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:58:24.161 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:58:24.205 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:24.324 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:58:24.331 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:24.331 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:58:24.432 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:58:24.435 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:58:24.485 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:24.770 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:58:24.775 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:24.775 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:58:24.876 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:58:24.932 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:24.991 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:58:24.995 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:24.996 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:58:25.097 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:58:25.133 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:25.158 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:58:25.168 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:25.168 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:58:25.269 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:58:25.320 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:25.539 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:58:25.542 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:25.543 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:58:25.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:25 smithi022 ceph-mon[39439]: pgmap v1960: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.3 GiB data, 9.6 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 624 op/s; 11787/75076 objects degraded (15.700%); 10 MiB/s, 162 objects/s recovering 2024-04-01T19:58:25.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:25 smithi022 ceph-mon[39439]: osdmap e714: 12 total, 11 up, 10 in 2024-04-01T19:58:25.643 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:58:25.695 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:25.712 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:58:25.726 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:58:25.731 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:25.732 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:58:25.742 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:58:25.766 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:58:25.767 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:58:25.802 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:58:25.832 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:58:25.833 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:58:25.839 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T19:58:25.839 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:58:25.857 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:25 smithi188 ceph-mon[43939]: pgmap v1960: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.3 GiB data, 9.6 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 624 op/s; 11787/75076 objects degraded (15.700%); 10 MiB/s, 162 objects/s recovering 2024-04-01T19:58:25.857 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:25 smithi188 ceph-mon[43939]: osdmap e714: 12 total, 11 up, 10 in 2024-04-01T19:58:25.862 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:58:25.886 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:25.899 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:58:25.913 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:58:25.916 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:25.917 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:58:25.930 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:58:25.973 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:58:26.007 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:58:26.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:25 smithi062 ceph-mon[44211]: pgmap v1960: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.3 GiB data, 9.6 GiB used, 884 GiB / 894 GiB avail; 0 B/s wr, 624 op/s; 11787/75076 objects degraded (15.700%); 10 MiB/s, 162 objects/s recovering 2024-04-01T19:58:26.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:25 smithi062 ceph-mon[44211]: osdmap e714: 12 total, 11 up, 10 in 2024-04-01T19:58:26.017 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:58:26.049 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:58:26.049 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:58:26.049 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:58:26.049 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:58:26.050 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:58:26.050 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:58:26.050 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:58:26.050 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:58:26.050 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:58:26.050 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:58:26.050 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:58:26.050 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.10 2024-04-01T19:58:26.050 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:58:26.060 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:26.170 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:58:26.177 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:26.178 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:58:26.279 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:58:26.321 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:26.683 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:58:26.694 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:26.695 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:58:26.727 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_historic_ops 2024-04-01T19:58:26.796 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:58:26.812 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:26 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:58:26.812 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:26 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:58:26.812 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:26 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 11787/75076 objects degraded (15.700%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:26.813 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:26 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1125774630' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:58:26.813 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:26.813 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:26.813 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:26.813 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:26.826 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:26 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:58:26.826 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:26 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:58:26.826 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:26 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 11787/75076 objects degraded (15.700%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:26.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:26 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1125774630' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:58:26.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:26.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:26.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:26.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:26.829 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:26.860 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:58:26.866 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:26.867 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:58:26.968 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:58:27.004 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:26 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:58:27.004 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:26 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:58:27.004 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:26 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 11787/75076 objects degraded (15.700%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:27.004 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:26 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1125774630' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:58:27.004 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:27.004 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:27.004 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:27.004 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:27.006 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:27.035 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:58:27.040 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:27.041 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:58:27.142 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:58:27.156 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T19:58:27.175 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:27.222 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:58:27.228 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:27.228 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:58:27.267 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:58:27.267 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:58:27.280 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:58:27.329 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:58:27.376 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:27.486 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:58:27.489 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:27.490 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:58:27.591 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:58:27.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:27.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:27.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:27.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:27.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:27.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:27.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:27 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:27.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:27 smithi188 ceph-mon[43939]: pgmap v1962: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.1 GiB data, 9.2 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 1.11k op/s; 10482/68052 objects degraded (15.403%); 24 MiB/s, 376 objects/s recovering 2024-04-01T19:58:27.639 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:27.669 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:58:27.674 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:27.674 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:58:27.775 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:58:27.790 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:27.790 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:27.790 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:27.790 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:27.790 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:27.790 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:27.790 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:27 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:27.790 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:27 smithi022 ceph-mon[39439]: pgmap v1962: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.1 GiB data, 9.2 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 1.11k op/s; 10482/68052 objects degraded (15.403%); 24 MiB/s, 376 objects/s recovering 2024-04-01T19:58:27.828 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:27.915 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:58:27.918 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:27.918 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:58:28.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:28.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:28.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:28.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:28.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:28.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:28.015 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:27 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:28.015 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:27 smithi062 ceph-mon[44211]: pgmap v1962: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.1 GiB data, 9.2 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 1.11k op/s; 10482/68052 objects degraded (15.403%); 24 MiB/s, 376 objects/s recovering 2024-04-01T19:58:28.019 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:58:28.058 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:28.125 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:58:28.130 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:28.131 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:58:28.232 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:58:28.273 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:28.299 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:58:28.305 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:28.306 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:58:28.406 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:58:28.444 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:28.474 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:58:28.490 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:28.490 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:58:28.591 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:58:28.603 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:58:28.604 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:58:28.629 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:28.840 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:58:28.844 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:28.845 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:58:28.946 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:58:28.987 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:29.207 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:58:29.219 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:29.220 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:58:29.269 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:58:29.320 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:58:29.370 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:29.522 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:29 smithi188 ceph-mon[43939]: from='client.17289 v1:172.21.15.22:0/2971508202' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:58:29.522 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:29 smithi188 ceph-mon[43939]: pgmap v1963: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.1 GiB data, 9.2 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 595 op/s; 10482/67594 objects degraded (15.507%); 12 MiB/s, 194 objects/s recovering 2024-04-01T19:58:29.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:29 smithi022 ceph-mon[39439]: from='client.17289 v1:172.21.15.22:0/2971508202' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:58:29.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:29 smithi022 ceph-mon[39439]: pgmap v1963: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.1 GiB data, 9.2 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 595 op/s; 10482/67594 objects degraded (15.507%); 12 MiB/s, 194 objects/s recovering 2024-04-01T19:58:29.764 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T19:58:29.764 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T19:58:29.764 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T19:58:29.764 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T19:58:29.764 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.764 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:139565 8.b 8:d44b272e:::benchmark_data_smithi188_161190_object283:head [delete] snapc 0=[] ondisk+write+known_if_redirected e673)", 2024-04-01T19:58:29.764 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:55:38.238642+0000", 2024-04-01T19:58:29.765 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 171.52518375, 2024-04-01T19:58:29.765 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040142140999999999, 2024-04-01T19:58:29.765 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:29.765 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:29.765 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:29.765 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:29.765 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:29.765 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:29.765 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 139565 2024-04-01T19:58:29.765 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.765 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:29.765 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.765 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:29.765 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:38.238642+0000", 2024-04-01T19:58:29.766 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.766 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.766 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.766 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:29.766 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:38.238642+0000", 2024-04-01T19:58:29.766 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.766 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.766 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.766 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:29.766 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:38.238643+0000", 2024-04-01T19:58:29.766 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1500000000000005e-07 2024-04-01T19:58:29.766 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.766 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.766 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:29.766 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:38.238649+0000", 2024-04-01T19:58:29.767 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3929999999999996e-06 2024-04-01T19:58:29.767 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.767 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.767 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:29.767 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:38.238654+0000", 2024-04-01T19:58:29.767 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7330000000000003e-06 2024-04-01T19:58:29.767 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.767 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.767 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:29.767 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:38.238659+0000", 2024-04-01T19:58:29.767 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5399999999999997e-06 2024-04-01T19:58:29.767 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.767 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.767 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:29.767 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:38.247806+0000", 2024-04-01T19:58:29.768 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091469080000000005 2024-04-01T19:58:29.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.768 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.768 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:29.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:38.247926+0000", 2024-04-01T19:58:29.768 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000120575 2024-04-01T19:58:29.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.768 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.768 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:58:29.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:38.248003+0000", 2024-04-01T19:58:29.768 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7132000000000006e-05 2024-04-01T19:58:29.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.768 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.768 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:29.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:38.252429+0000", 2024-04-01T19:58:29.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0044260250000000001 2024-04-01T19:58:29.769 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.769 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:29.769 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:38.278669+0000", 2024-04-01T19:58:29.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026240181000000001 2024-04-01T19:58:29.769 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.769 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:29.769 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:38.278724+0000", 2024-04-01T19:58:29.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4814000000000001e-05 2024-04-01T19:58:29.769 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.769 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:29.770 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:38.278785+0000", 2024-04-01T19:58:29.770 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0325000000000003e-05 2024-04-01T19:58:29.770 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.770 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:29.770 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.770 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.770 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.770 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:142869 8.b 8:d837181b:::benchmark_data_smithi188_161190_object3587:head [delete] snapc 0=[] ondisk+write+known_if_redirected e673)", 2024-04-01T19:58:29.770 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:55:41.313170+0000", 2024-04-01T19:58:29.770 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 168.45065625500001, 2024-04-01T19:58:29.770 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.043805385000000002, 2024-04-01T19:58:29.770 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:29.770 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:29.770 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:29.771 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:29.771 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:29.771 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:29.771 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 142869 2024-04-01T19:58:29.771 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.771 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:29.771 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.771 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:29.771 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:41.313170+0000", 2024-04-01T19:58:29.771 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.771 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.771 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.771 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:29.771 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:41.313170+0000", 2024-04-01T19:58:29.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.772 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.772 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:29.772 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:41.313172+0000", 2024-04-01T19:58:29.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2749999999999998e-06 2024-04-01T19:58:29.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.772 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.772 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:29.772 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:41.313179+0000", 2024-04-01T19:58:29.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5919999999999997e-06 2024-04-01T19:58:29.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.772 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.772 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:29.772 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:41.313195+0000", 2024-04-01T19:58:29.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6351999999999999e-05 2024-04-01T19:58:29.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.773 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:29.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:41.313205+0000", 2024-04-01T19:58:29.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0268999999999999e-05 2024-04-01T19:58:29.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.773 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:29.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:41.335324+0000", 2024-04-01T19:58:29.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022118209999999999 2024-04-01T19:58:29.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.773 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:29.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:41.335452+0000", 2024-04-01T19:58:29.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012868100000000001 2024-04-01T19:58:29.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.774 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:58:29.774 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:41.335558+0000", 2024-04-01T19:58:29.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000105418 2024-04-01T19:58:29.774 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.774 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:29.774 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:41.344397+0000", 2024-04-01T19:58:29.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0088389230000000003 2024-04-01T19:58:29.774 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.774 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:29.774 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:41.356880+0000", 2024-04-01T19:58:29.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012483227 2024-04-01T19:58:29.774 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.775 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.775 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:29.775 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:41.356934+0000", 2024-04-01T19:58:29.775 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4067999999999998e-05 2024-04-01T19:58:29.775 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.775 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.775 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:29.775 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:41.356975+0000", 2024-04-01T19:58:29.775 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1369999999999999e-05 2024-04-01T19:58:29.775 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.775 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:29.775 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.775 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.775 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.775 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26983.0:145019 8.c e673/629 8:35220e10:::benchmark_data_smithi188_161190_object5737:head v 673'9044, mlcod=673'9039)", 2024-04-01T19:58:29.776 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:55:43.445240+0000", 2024-04-01T19:58:29.776 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 166.31858656200001, 2024-04-01T19:58:29.776 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034166609000000001, 2024-04-01T19:58:29.776 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:29.776 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:29.776 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:29.776 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:29.776 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.776 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:29.776 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.445240+0000", 2024-04-01T19:58:29.776 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.776 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.776 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.776 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:29.776 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.445240+0000", 2024-04-01T19:58:29.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:29.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.445240+0000", 2024-04-01T19:58:29.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.44e-07 2024-04-01T19:58:29.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:29.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.445244+0000", 2024-04-01T19:58:29.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1409999999999998e-06 2024-04-01T19:58:29.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:29.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.445249+0000", 2024-04-01T19:58:29.778 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8720000000000001e-06 2024-04-01T19:58:29.778 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.778 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.778 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:29.778 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.445254+0000", 2024-04-01T19:58:29.778 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.352e-06 2024-04-01T19:58:29.778 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.778 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.778 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:29.778 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.449282+0000", 2024-04-01T19:58:29.778 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040285130000000001 2024-04-01T19:58:29.778 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.778 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.778 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:29.778 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.449302+0000", 2024-04-01T19:58:29.779 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9854999999999999e-05 2024-04-01T19:58:29.779 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.779 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.779 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:29.779 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.479365+0000", 2024-04-01T19:58:29.779 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.030063258999999998 2024-04-01T19:58:29.779 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.779 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.779 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:29.779 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.479406+0000", 2024-04-01T19:58:29.779 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1072999999999998e-05 2024-04-01T19:58:29.779 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.779 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:29.779 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.780 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.780 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.780 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:145428 8.b 8:dcd2202c:::benchmark_data_smithi188_161190_object6146:head [delete] snapc 0=[] ondisk+write+known_if_redirected e674)", 2024-04-01T19:58:29.780 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:55:43.849869+0000", 2024-04-01T19:58:29.780 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 165.913956724, 2024-04-01T19:58:29.780 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034188863999999999, 2024-04-01T19:58:29.780 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:29.780 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:29.780 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:29.780 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:29.780 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:29.780 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:29.780 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 145428 2024-04-01T19:58:29.780 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.780 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:29.781 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.781 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:29.781 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.849869+0000", 2024-04-01T19:58:29.781 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.781 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.781 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.781 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:29.781 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.849869+0000", 2024-04-01T19:58:29.781 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.781 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.781 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.781 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:29.781 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.849870+0000", 2024-04-01T19:58:29.781 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5899999999999995e-07 2024-04-01T19:58:29.782 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.782 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.782 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:29.782 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.849873+0000", 2024-04-01T19:58:29.782 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0970000000000002e-06 2024-04-01T19:58:29.782 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.782 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.782 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:29.782 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.849880+0000", 2024-04-01T19:58:29.782 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.443e-06 2024-04-01T19:58:29.782 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.782 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.782 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:29.782 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.849887+0000", 2024-04-01T19:58:29.782 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0890000000000002e-06 2024-04-01T19:58:29.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:29.783 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.854645+0000", 2024-04-01T19:58:29.783 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0047586319999999996 2024-04-01T19:58:29.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:29.783 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.854764+0000", 2024-04-01T19:58:29.783 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000118687 2024-04-01T19:58:29.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:58:29.783 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.854868+0000", 2024-04-01T19:58:29.783 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000103831 2024-04-01T19:58:29.784 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.784 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.784 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:29.784 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.871220+0000", 2024-04-01T19:58:29.784 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016352419 2024-04-01T19:58:29.784 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.784 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.784 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:29.784 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.883958+0000", 2024-04-01T19:58:29.784 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.01273728 2024-04-01T19:58:29.784 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.784 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.784 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:29.784 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.884008+0000", 2024-04-01T19:58:29.784 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0216000000000002e-05 2024-04-01T19:58:29.784 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.785 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.785 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:29.785 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.884058+0000", 2024-04-01T19:58:29.785 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0411000000000002e-05 2024-04-01T19:58:29.785 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.785 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:29.785 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.785 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.785 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.785 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:145580 8.a 8:5f6bf605:::benchmark_data_smithi188_161190_object6298:head [delete] snapc 0=[] ondisk+write+known_if_redirected e674)", 2024-04-01T19:58:29.785 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:55:43.994802+0000", 2024-04-01T19:58:29.785 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 165.76902443099999, 2024-04-01T19:58:29.785 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.032509494999999999, 2024-04-01T19:58:29.785 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:29.785 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:29.786 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:29.786 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:29.786 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:29.786 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:29.786 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 145580 2024-04-01T19:58:29.786 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.786 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:29.786 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.786 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:29.786 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.994802+0000", 2024-04-01T19:58:29.786 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.786 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.786 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.786 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:29.786 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.994802+0000", 2024-04-01T19:58:29.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.787 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.787 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:29.787 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.994804+0000", 2024-04-01T19:58:29.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0219999999999999e-06 2024-04-01T19:58:29.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.787 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.787 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:29.787 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.994809+0000", 2024-04-01T19:58:29.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4779999999999999e-06 2024-04-01T19:58:29.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.787 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.787 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:29.787 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.994824+0000", 2024-04-01T19:58:29.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4722000000000001e-05 2024-04-01T19:58:29.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.788 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:29.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.994833+0000", 2024-04-01T19:58:29.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.585e-06 2024-04-01T19:58:29.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.788 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:29.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.994893+0000", 2024-04-01T19:58:29.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0642e-05 2024-04-01T19:58:29.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.788 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:29.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.995005+0000", 2024-04-01T19:58:29.789 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000111691 2024-04-01T19:58:29.789 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.789 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.789 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:58:29.789 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:43.995095+0000", 2024-04-01T19:58:29.789 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9895000000000006e-05 2024-04-01T19:58:29.789 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.789 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.789 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:29.789 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:44.005728+0000", 2024-04-01T19:58:29.789 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010632897000000001 2024-04-01T19:58:29.789 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.789 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.789 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:29.789 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:44.027232+0000", 2024-04-01T19:58:29.790 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.021503880999999999 2024-04-01T19:58:29.790 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.790 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.790 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:29.790 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:44.027281+0000", 2024-04-01T19:58:29.790 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9264999999999997e-05 2024-04-01T19:58:29.790 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.790 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.790 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:29.790 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:44.027311+0000", 2024-04-01T19:58:29.790 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0417e-05 2024-04-01T19:58:29.790 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.790 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:29.791 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.791 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.791 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.791 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.26983.0:145957 8.c e674/629 8:3c66e53b:::benchmark_data_smithi188_161190_object6675:head v 674'9115, mlcod=674'9112)", 2024-04-01T19:58:29.791 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:55:44.363917+0000", 2024-04-01T19:58:29.791 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 165.39990931200001, 2024-04-01T19:58:29.791 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035677925999999999, 2024-04-01T19:58:29.791 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:29.791 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:29.791 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:29.791 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:29.791 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.791 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:29.791 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:44.363917+0000", 2024-04-01T19:58:29.791 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.791 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.792 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.792 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:29.792 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:44.363917+0000", 2024-04-01T19:58:29.792 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.792 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.792 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.792 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:29.792 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:44.363919+0000", 2024-04-01T19:58:29.792 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9360000000000002e-06 2024-04-01T19:58:29.792 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.792 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.792 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:29.792 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:44.363930+0000", 2024-04-01T19:58:29.792 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.099e-05 2024-04-01T19:58:29.792 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.793 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.793 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:29.793 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:44.363943+0000", 2024-04-01T19:58:29.793 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2840000000000001e-05 2024-04-01T19:58:29.793 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.793 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.793 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:29.793 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:44.363952+0000", 2024-04-01T19:58:29.793 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3870000000000001e-06 2024-04-01T19:58:29.793 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.793 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.793 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:29.793 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:44.364008+0000", 2024-04-01T19:58:29.793 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5549e-05 2024-04-01T19:58:29.794 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.794 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.794 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:29.794 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:44.364031+0000", 2024-04-01T19:58:29.794 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2955e-05 2024-04-01T19:58:29.794 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.794 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.794 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:29.794 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:44.399554+0000", 2024-04-01T19:58:29.794 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035523855 2024-04-01T19:58:29.794 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.794 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.794 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:29.794 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:55:44.399595+0000", 2024-04-01T19:58:29.794 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0414000000000003e-05 2024-04-01T19:58:29.795 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.795 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:29.795 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.795 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.795 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.795 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:161733 8.b 8:da509a76:::benchmark_data_smithi188_161190_object22451:head [delete] snapc 0=[] ondisk+write+known_if_redirected e689)", 2024-04-01T19:58:29.795 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:26.639762+0000", 2024-04-01T19:58:29.795 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 123.124064217, 2024-04-01T19:58:29.795 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.036760928999999998, 2024-04-01T19:58:29.795 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:29.795 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:29.795 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:29.795 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:29.796 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:29.796 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:29.796 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 161733 2024-04-01T19:58:29.796 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.796 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:29.796 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.796 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:29.796 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:26.639762+0000", 2024-04-01T19:58:29.796 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.796 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.796 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.796 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:29.796 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:26.639762+0000", 2024-04-01T19:58:29.796 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.797 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.797 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.797 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:29.797 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:26.639764+0000", 2024-04-01T19:58:29.797 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.81e-06 2024-04-01T19:58:29.797 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.797 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.797 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:29.797 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:26.639769+0000", 2024-04-01T19:58:29.797 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8799999999999999e-06 2024-04-01T19:58:29.797 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.797 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.797 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:29.797 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:26.639780+0000", 2024-04-01T19:58:29.797 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1277999999999999e-05 2024-04-01T19:58:29.798 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.798 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.798 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:29.798 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:26.639787+0000", 2024-04-01T19:58:29.798 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1919999999999999e-06 2024-04-01T19:58:29.798 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.798 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.798 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:29.798 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:26.648550+0000", 2024-04-01T19:58:29.798 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0087627290000000004 2024-04-01T19:58:29.798 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.798 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.798 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:29.798 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:26.648696+0000", 2024-04-01T19:58:29.799 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014633800000000001 2024-04-01T19:58:29.799 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.799 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.799 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:58:29.799 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:26.648823+0000", 2024-04-01T19:58:29.799 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012706100000000001 2024-04-01T19:58:29.799 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.799 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.799 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:29.799 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:26.664203+0000", 2024-04-01T19:58:29.799 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015379768 2024-04-01T19:58:29.799 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.799 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.799 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:29.800 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:26.676416+0000", 2024-04-01T19:58:29.800 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012212799 2024-04-01T19:58:29.800 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.800 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.800 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:29.800 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:26.676478+0000", 2024-04-01T19:58:29.800 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2232999999999999e-05 2024-04-01T19:58:29.800 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.800 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.800 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:29.800 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:26.676523+0000", 2024-04-01T19:58:29.800 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4841e-05 2024-04-01T19:58:29.800 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.800 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:29.801 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.801 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.801 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:169549 8.b 8:daa61bd5:::benchmark_data_smithi188_161190_object30267:head [delete] snapc 0=[] ondisk+write+known_if_redirected e690)", 2024-04-01T19:58:29.801 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:39.881620+0000", 2024-04-01T19:58:29.801 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 109.882205885, 2024-04-01T19:58:29.801 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.047892639000000001, 2024-04-01T19:58:29.801 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:29.801 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:29.801 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:29.801 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:29.801 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:29.801 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:29.801 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 169549 2024-04-01T19:58:29.802 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.802 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:29.802 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.802 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:29.802 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:39.881620+0000", 2024-04-01T19:58:29.802 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.802 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.802 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.802 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:29.802 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:39.881620+0000", 2024-04-01T19:58:29.802 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.802 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.802 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.802 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:29.803 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:39.881622+0000", 2024-04-01T19:58:29.803 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2130000000000001e-06 2024-04-01T19:58:29.803 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.803 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.803 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:29.803 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:39.881625+0000", 2024-04-01T19:58:29.803 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8850000000000001e-06 2024-04-01T19:58:29.803 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.803 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.803 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:29.803 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:39.881632+0000", 2024-04-01T19:58:29.803 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0110000000000003e-06 2024-04-01T19:58:29.803 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.803 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.804 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:29.804 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:39.881638+0000", 2024-04-01T19:58:29.804 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.648e-06 2024-04-01T19:58:29.804 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.804 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.804 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:29.804 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:39.881688+0000", 2024-04-01T19:58:29.804 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0018000000000001e-05 2024-04-01T19:58:29.804 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.804 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.804 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:29.804 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:39.881791+0000", 2024-04-01T19:58:29.804 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010316599999999999 2024-04-01T19:58:29.804 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.805 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.805 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:58:29.805 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:39.882477+0000", 2024-04-01T19:58:29.805 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00068604099999999997 2024-04-01T19:58:29.805 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.805 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.805 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:29.805 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:39.887699+0000", 2024-04-01T19:58:29.805 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005222076 2024-04-01T19:58:29.805 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.805 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.805 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:29.805 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:39.929409+0000", 2024-04-01T19:58:29.805 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041709201000000001 2024-04-01T19:58:29.806 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.806 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.806 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:29.806 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:39.929464+0000", 2024-04-01T19:58:29.806 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5300999999999998e-05 2024-04-01T19:58:29.806 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.806 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.806 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:29.806 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:39.929513+0000", 2024-04-01T19:58:29.806 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9079000000000002e-05 2024-04-01T19:58:29.806 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.806 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:29.806 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.807 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.807 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.807 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:193053 8.a 8:551149b2:::benchmark_data_smithi188_161190_object53771:head [delete] snapc 0=[] ondisk+write+known_if_redirected e699)", 2024-04-01T19:58:29.807 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:57:16.920451+0000", 2024-04-01T19:58:29.807 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.843375042999995, 2024-04-01T19:58:29.807 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.080220335000000004, 2024-04-01T19:58:29.807 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:29.807 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:29.807 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:29.807 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:29.807 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:29.807 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:29.807 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 193053 2024-04-01T19:58:29.807 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.808 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:29.808 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.808 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:29.808 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.920451+0000", 2024-04-01T19:58:29.808 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.808 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.808 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.808 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:29.808 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.920451+0000", 2024-04-01T19:58:29.808 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.808 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.808 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.808 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:29.808 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.920454+0000", 2024-04-01T19:58:29.809 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.903e-06 2024-04-01T19:58:29.809 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.809 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.809 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:29.809 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.920462+0000", 2024-04-01T19:58:29.809 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7859999999999997e-06 2024-04-01T19:58:29.809 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.809 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.809 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:29.809 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.920481+0000", 2024-04-01T19:58:29.809 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8865999999999999e-05 2024-04-01T19:58:29.809 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.809 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.809 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:29.810 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.920491+0000", 2024-04-01T19:58:29.810 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0033e-05 2024-04-01T19:58:29.810 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.810 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.810 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:29.810 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.920555+0000", 2024-04-01T19:58:29.810 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4579999999999995e-05 2024-04-01T19:58:29.810 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.810 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.810 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:29.810 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.920683+0000", 2024-04-01T19:58:29.810 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012783299999999999 2024-04-01T19:58:29.811 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.811 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.811 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:58:29.811 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.920801+0000", 2024-04-01T19:58:29.811 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117416 2024-04-01T19:58:29.811 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.811 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.811 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:29.811 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.924994+0000", 2024-04-01T19:58:29.811 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0041936609999999996 2024-04-01T19:58:29.811 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.811 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.811 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:29.811 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:17.000581+0000", 2024-04-01T19:58:29.812 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.075586948000000001 2024-04-01T19:58:29.812 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.812 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.812 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:29.812 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:17.000636+0000", 2024-04-01T19:58:29.812 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5336e-05 2024-04-01T19:58:29.812 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.812 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.812 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:29.812 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:17.000671+0000", 2024-04-01T19:58:29.812 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4972999999999999e-05 2024-04-01T19:58:29.812 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.812 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:29.812 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.812 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.813 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.813 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:193068 8.a 8:5ec103cf:::benchmark_data_smithi188_161190_object53786:head [delete] snapc 0=[] ondisk+write+known_if_redirected e699)", 2024-04-01T19:58:29.813 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:57:16.943926+0000", 2024-04-01T19:58:29.813 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.819900387000004, 2024-04-01T19:58:29.813 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.065735010999999996, 2024-04-01T19:58:29.813 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:29.813 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:29.813 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:29.813 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:29.813 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:29.813 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:29.813 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 193068 2024-04-01T19:58:29.813 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.813 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:29.814 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.814 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:29.814 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.943926+0000", 2024-04-01T19:58:29.814 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.814 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.814 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.814 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:29.814 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.943926+0000", 2024-04-01T19:58:29.814 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.814 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.814 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.814 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:29.814 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.943929+0000", 2024-04-01T19:58:29.815 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1829999999999998e-06 2024-04-01T19:58:29.815 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.815 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.815 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:29.815 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.943937+0000", 2024-04-01T19:58:29.815 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0399999999999993e-06 2024-04-01T19:58:29.815 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.815 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.815 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:29.815 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.943954+0000", 2024-04-01T19:58:29.815 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6619000000000001e-05 2024-04-01T19:58:29.815 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.815 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.815 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:29.816 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.943962+0000", 2024-04-01T19:58:29.816 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2290000000000003e-06 2024-04-01T19:58:29.816 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.816 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.816 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:29.816 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.944026+0000", 2024-04-01T19:58:29.816 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4039000000000001e-05 2024-04-01T19:58:29.816 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.816 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.816 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:29.816 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.944131+0000", 2024-04-01T19:58:29.816 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000105283 2024-04-01T19:58:29.816 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.816 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.816 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:58:29.817 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.944213+0000", 2024-04-01T19:58:29.817 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1496999999999996e-05 2024-04-01T19:58:29.817 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.817 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.817 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:29.817 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.948278+0000", 2024-04-01T19:58:29.817 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.004065735 2024-04-01T19:58:29.817 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.817 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.817 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:29.817 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:17.009560+0000", 2024-04-01T19:58:29.817 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.061281185000000002 2024-04-01T19:58:29.817 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.817 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.818 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:29.818 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:17.009611+0000", 2024-04-01T19:58:29.818 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1721000000000002e-05 2024-04-01T19:58:29.818 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.818 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.818 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:29.818 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:17.009661+0000", 2024-04-01T19:58:29.818 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9480000000000001e-05 2024-04-01T19:58:29.818 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.818 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:29.818 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.818 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.818 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.818 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:208475 8.a 8:5e1b005f:::benchmark_data_smithi188_161190_object69193:head [delete] snapc 0=[] ondisk+write+known_if_redirected e704)", 2024-04-01T19:58:29.819 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:57:39.513686+0000", 2024-04-01T19:58:29.819 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 50.250140184999999, 2024-04-01T19:58:29.819 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033770201999999999, 2024-04-01T19:58:29.819 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:29.819 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:29.819 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:29.819 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:29.819 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:29.819 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:29.819 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 208475 2024-04-01T19:58:29.819 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.819 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:29.819 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.819 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:29.820 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:39.513686+0000", 2024-04-01T19:58:29.820 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.820 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.820 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.820 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:29.820 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:39.513686+0000", 2024-04-01T19:58:29.820 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.820 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.820 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.820 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:29.820 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:39.513687+0000", 2024-04-01T19:58:29.820 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4300000000000002e-07 2024-04-01T19:58:29.820 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.821 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.821 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:29.821 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:39.513689+0000", 2024-04-01T19:58:29.821 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.587e-06 2024-04-01T19:58:29.821 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.821 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.821 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:29.821 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:39.513695+0000", 2024-04-01T19:58:29.821 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2560000000000002e-06 2024-04-01T19:58:29.821 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.821 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.821 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:29.821 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:39.513698+0000", 2024-04-01T19:58:29.821 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8469999999999998e-06 2024-04-01T19:58:29.822 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.822 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.822 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:29.822 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:39.517444+0000", 2024-04-01T19:58:29.822 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.003746002 2024-04-01T19:58:29.822 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.822 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.822 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:29.822 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:39.517514+0000", 2024-04-01T19:58:29.822 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9851000000000006e-05 2024-04-01T19:58:29.822 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.822 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.822 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:58:29.823 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:39.517578+0000", 2024-04-01T19:58:29.823 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3998999999999995e-05 2024-04-01T19:58:29.823 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.823 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.823 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:29.823 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:39.520058+0000", 2024-04-01T19:58:29.823 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0024797500000000002 2024-04-01T19:58:29.823 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.823 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.823 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:29.823 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:39.547338+0000", 2024-04-01T19:58:29.823 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027279877000000001 2024-04-01T19:58:29.823 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.823 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.823 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:29.824 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:39.547415+0000", 2024-04-01T19:58:29.824 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6822000000000004e-05 2024-04-01T19:58:29.824 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.824 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.824 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:29.824 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:39.547456+0000", 2024-04-01T19:58:29.824 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1467999999999997e-05 2024-04-01T19:58:29.824 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.824 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:29.824 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.824 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.824 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.824 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:208958 8.a 8:55505b17:::benchmark_data_smithi188_161190_object69676:head [delete] snapc 0=[] ondisk+write+known_if_redirected e704)", 2024-04-01T19:58:29.824 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:57:40.168584+0000", 2024-04-01T19:58:29.825 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 49.595242298000002, 2024-04-01T19:58:29.825 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035595374999999999, 2024-04-01T19:58:29.825 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:29.825 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:29.825 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:29.825 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:29.825 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:29.825 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:29.825 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 208958 2024-04-01T19:58:29.825 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.825 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:29.825 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.825 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:29.825 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:40.168584+0000", 2024-04-01T19:58:29.826 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.826 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.826 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.826 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:29.826 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:40.168584+0000", 2024-04-01T19:58:29.826 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.826 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.826 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.826 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:29.826 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:40.168584+0000", 2024-04-01T19:58:29.826 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0699999999999997e-07 2024-04-01T19:58:29.826 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.826 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.826 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:29.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:40.168587+0000", 2024-04-01T19:58:29.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.452e-06 2024-04-01T19:58:29.827 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.827 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.827 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:29.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:40.168591+0000", 2024-04-01T19:58:29.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3089999999999997e-06 2024-04-01T19:58:29.827 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.827 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.827 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:29.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:40.168597+0000", 2024-04-01T19:58:29.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.412e-06 2024-04-01T19:58:29.827 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.827 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.828 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:29.828 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:40.179941+0000", 2024-04-01T19:58:29.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011344442 2024-04-01T19:58:29.828 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.828 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.828 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:29.828 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:40.180059+0000", 2024-04-01T19:58:29.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000118119 2024-04-01T19:58:29.828 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.828 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.828 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:58:29.828 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:40.180139+0000", 2024-04-01T19:58:29.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9470999999999999e-05 2024-04-01T19:58:29.828 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.829 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.829 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:29.829 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:40.199281+0000", 2024-04-01T19:58:29.829 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.01914213 2024-04-01T19:58:29.829 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.829 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.829 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:29.829 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:40.204083+0000", 2024-04-01T19:58:29.829 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0048025009999999998 2024-04-01T19:58:29.829 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.829 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.830 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:29.830 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:40.204135+0000", 2024-04-01T19:58:29.830 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1471000000000002e-05 2024-04-01T19:58:29.830 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.830 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.830 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:29.830 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:40.204179+0000", 2024-04-01T19:58:29.830 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4461e-05 2024-04-01T19:58:29.830 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.830 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:29.830 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.830 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.830 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.830 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:225228 8.a 8:5a4c645e:::benchmark_data_smithi188_161190_object85946:head [delete] snapc 0=[] ondisk+write+known_if_redirected e707)", 2024-04-01T19:58:29.831 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:58:01.934725+0000", 2024-04-01T19:58:29.831 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.829101632, 2024-04-01T19:58:29.831 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035297927, 2024-04-01T19:58:29.831 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:29.831 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:29.831 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:29.831 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:29.831 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:29.831 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:29.831 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 225228 2024-04-01T19:58:29.831 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.831 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:29.831 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.831 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:29.831 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:01.934725+0000", 2024-04-01T19:58:29.831 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.832 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.832 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.832 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:29.832 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:01.934725+0000", 2024-04-01T19:58:29.832 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.832 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.832 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.832 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:29.832 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:01.934727+0000", 2024-04-01T19:58:29.832 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0269999999999998e-06 2024-04-01T19:58:29.832 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.832 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.832 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:29.832 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:01.934732+0000", 2024-04-01T19:58:29.832 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2909999999999998e-06 2024-04-01T19:58:29.833 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.833 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.833 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:29.833 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:01.934746+0000", 2024-04-01T19:58:29.833 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4139e-05 2024-04-01T19:58:29.833 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.833 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.833 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:29.833 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:01.934755+0000", 2024-04-01T19:58:29.833 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0489999999999993e-06 2024-04-01T19:58:29.833 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.833 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.833 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:29.833 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:01.939070+0000", 2024-04-01T19:58:29.833 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0043154370000000001 2024-04-01T19:58:29.833 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.834 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:29.834 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:01.939206+0000", 2024-04-01T19:58:29.834 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013551899999999999 2024-04-01T19:58:29.834 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.834 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:58:29.834 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:01.939327+0000", 2024-04-01T19:58:29.834 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012126800000000001 2024-04-01T19:58:29.834 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.834 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:29.834 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:01.944188+0000", 2024-04-01T19:58:29.834 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0048607019999999997 2024-04-01T19:58:29.834 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.835 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.835 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:29.835 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:01.969913+0000", 2024-04-01T19:58:29.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.025725047000000001 2024-04-01T19:58:29.835 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.835 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.835 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:29.835 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:01.969975+0000", 2024-04-01T19:58:29.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2463000000000001e-05 2024-04-01T19:58:29.835 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.835 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.835 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:29.835 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:01.970022+0000", 2024-04-01T19:58:29.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6984999999999998e-05 2024-04-01T19:58:29.836 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.836 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:29.836 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.836 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.836 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.836 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:231296 8.a 8:522bdd94:::benchmark_data_smithi188_161190_object92014:head [delete] snapc 0=[] ondisk+write+known_if_redirected e709)", 2024-04-01T19:58:29.836 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:58:09.587563+0000", 2024-04-01T19:58:29.836 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 20.176263552000002, 2024-04-01T19:58:29.836 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041047109999999998, 2024-04-01T19:58:29.836 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:29.836 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:29.836 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:29.836 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:29.836 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:29.836 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:29.836 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 231296 2024-04-01T19:58:29.837 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.837 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:29.837 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.837 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:29.837 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.587563+0000", 2024-04-01T19:58:29.837 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.837 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.837 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.837 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:29.837 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.587563+0000", 2024-04-01T19:58:29.837 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.837 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.837 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.837 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:29.838 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.587566+0000", 2024-04-01T19:58:29.838 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1250000000000001e-06 2024-04-01T19:58:29.838 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.838 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.838 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:29.838 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.587575+0000", 2024-04-01T19:58:29.838 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.6129999999999993e-06 2024-04-01T19:58:29.838 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.838 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.838 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:29.838 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.587593+0000", 2024-04-01T19:58:29.838 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7183000000000001e-05 2024-04-01T19:58:29.838 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.838 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.838 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:29.839 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.587603+0000", 2024-04-01T19:58:29.839 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0514e-05 2024-04-01T19:58:29.839 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.839 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.839 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:29.839 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.589402+0000", 2024-04-01T19:58:29.839 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0017988209999999999 2024-04-01T19:58:29.839 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.839 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.839 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:29.839 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.589520+0000", 2024-04-01T19:58:29.839 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117773 2024-04-01T19:58:29.839 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.839 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.839 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:58:29.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.589616+0000", 2024-04-01T19:58:29.840 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5889000000000003e-05 2024-04-01T19:58:29.840 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.840 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.840 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:29.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.628227+0000", 2024-04-01T19:58:29.840 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.038611118999999999 2024-04-01T19:58:29.840 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.840 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.840 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:29.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.628528+0000", 2024-04-01T19:58:29.840 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030105699999999997 2024-04-01T19:58:29.840 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.840 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.840 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:29.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.628568+0000", 2024-04-01T19:58:29.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0404999999999997e-05 2024-04-01T19:58:29.841 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.841 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.841 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:29.841 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.628610+0000", 2024-04-01T19:58:29.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1610999999999999e-05 2024-04-01T19:58:29.841 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.841 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:29.841 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.841 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.841 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.841 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:231298 8.a 8:58e278bd:::benchmark_data_smithi188_161190_object92016:head [delete] snapc 0=[] ondisk+write+known_if_redirected e709)", 2024-04-01T19:58:29.841 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:58:09.587641+0000", 2024-04-01T19:58:29.841 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 20.176184886000001, 2024-04-01T19:58:29.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041038945, 2024-04-01T19:58:29.841 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:29.842 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:29.842 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:29.842 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:29.842 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:29.842 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:29.842 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 231298 2024-04-01T19:58:29.842 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.842 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:29.842 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.842 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:29.842 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.587641+0000", 2024-04-01T19:58:29.842 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.842 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.842 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.842 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:29.843 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.587641+0000", 2024-04-01T19:58:29.843 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.843 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.843 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.843 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:29.843 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.587642+0000", 2024-04-01T19:58:29.843 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0400000000000005e-07 2024-04-01T19:58:29.843 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.843 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.843 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:29.843 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.587646+0000", 2024-04-01T19:58:29.843 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6459999999999999e-06 2024-04-01T19:58:29.843 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.843 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.843 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:29.843 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.587652+0000", 2024-04-01T19:58:29.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2519999999999996e-06 2024-04-01T19:58:29.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:29.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.587658+0000", 2024-04-01T19:58:29.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4210000000000003e-06 2024-04-01T19:58:29.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:29.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.593817+0000", 2024-04-01T19:58:29.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0061597600000000002 2024-04-01T19:58:29.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:29.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.593918+0000", 2024-04-01T19:58:29.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101042 2024-04-01T19:58:29.845 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:58:29.845 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.593994+0000", 2024-04-01T19:58:29.845 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6130999999999993e-05 2024-04-01T19:58:29.845 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:29.845 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.628263+0000", 2024-04-01T19:58:29.845 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034269032999999997 2024-04-01T19:58:29.845 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:29.845 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.628617+0000", 2024-04-01T19:58:29.845 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000353164 2024-04-01T19:58:29.846 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.846 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.846 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:29.846 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.628650+0000", 2024-04-01T19:58:29.846 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3714999999999998e-05 2024-04-01T19:58:29.846 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.846 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.846 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:29.846 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.628680+0000", 2024-04-01T19:58:29.846 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9876999999999999e-05 2024-04-01T19:58:29.846 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.846 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:29.846 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.846 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.847 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.847 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:231302 8.a 8:58e83b79:::benchmark_data_smithi188_161190_object92020:head [delete] snapc 0=[] ondisk+write+known_if_redirected e709)", 2024-04-01T19:58:29.847 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:58:09.593940+0000", 2024-04-01T19:58:29.847 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 20.169886231, 2024-04-01T19:58:29.847 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034815606999999998, 2024-04-01T19:58:29.847 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:29.847 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:29.847 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:29.847 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:29.847 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:29.847 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:29.847 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 231302 2024-04-01T19:58:29.847 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.847 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:29.847 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.848 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:29.848 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.593940+0000", 2024-04-01T19:58:29.848 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.848 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.848 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.848 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:29.848 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.593940+0000", 2024-04-01T19:58:29.848 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.848 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.848 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.848 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:29.848 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.593942+0000", 2024-04-01T19:58:29.848 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3300000000000001e-06 2024-04-01T19:58:29.848 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.848 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.848 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:29.849 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.593949+0000", 2024-04-01T19:58:29.849 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.002e-06 2024-04-01T19:58:29.849 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.849 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.849 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:29.849 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.593960+0000", 2024-04-01T19:58:29.849 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0737000000000001e-05 2024-04-01T19:58:29.849 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.849 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.849 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:29.849 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.593967+0000", 2024-04-01T19:58:29.849 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4259999999999997e-06 2024-04-01T19:58:29.849 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.849 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.849 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:29.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.598500+0000", 2024-04-01T19:58:29.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0045324040000000003 2024-04-01T19:58:29.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.850 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:29.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.598608+0000", 2024-04-01T19:58:29.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108546 2024-04-01T19:58:29.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.850 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:58:29.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.598738+0000", 2024-04-01T19:58:29.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000129336 2024-04-01T19:58:29.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.850 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:29.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.628516+0000", 2024-04-01T19:58:29.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029777939999999999 2024-04-01T19:58:29.851 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.851 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:29.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.628688+0000", 2024-04-01T19:58:29.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017275600000000001 2024-04-01T19:58:29.851 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.851 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:29.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.628722+0000", 2024-04-01T19:58:29.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3473999999999998e-05 2024-04-01T19:58:29.851 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.851 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:29.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.628756+0000", 2024-04-01T19:58:29.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3655999999999998e-05 2024-04-01T19:58:29.852 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.852 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:29.852 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.852 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:231304 8.a 8:575152f9:::benchmark_data_smithi188_161190_object92022:head [delete] snapc 0=[] ondisk+write+known_if_redirected e709)", 2024-04-01T19:58:29.852 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:58:09.596338+0000", 2024-04-01T19:58:29.852 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 20.167488637000002, 2024-04-01T19:58:29.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.039660704999999997, 2024-04-01T19:58:29.852 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:29.852 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:29.852 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:29.852 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:29.852 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:29.852 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:29.853 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 231304 2024-04-01T19:58:29.853 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.853 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:29.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.853 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:29.853 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.596338+0000", 2024-04-01T19:58:29.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.853 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.853 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:29.853 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.596338+0000", 2024-04-01T19:58:29.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.853 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.853 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:29.854 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.596339+0000", 2024-04-01T19:58:29.854 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-01T19:58:29.854 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.854 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.854 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:29.854 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.596347+0000", 2024-04-01T19:58:29.854 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8310000000000007e-06 2024-04-01T19:58:29.854 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.854 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.854 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:29.854 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.596354+0000", 2024-04-01T19:58:29.854 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8240000000000002e-06 2024-04-01T19:58:29.854 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.854 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:29.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.596360+0000", 2024-04-01T19:58:29.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0739999999999998e-06 2024-04-01T19:58:29.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:29.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.603490+0000", 2024-04-01T19:58:29.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071294690000000003 2024-04-01T19:58:29.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:29.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.603594+0000", 2024-04-01T19:58:29.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010438 2024-04-01T19:58:29.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T19:58:29.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.603698+0000", 2024-04-01T19:58:29.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000103337 2024-04-01T19:58:29.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.856 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:29.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.628761+0000", 2024-04-01T19:58:29.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.025063101000000001 2024-04-01T19:58:29.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.856 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:29.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.635910+0000", 2024-04-01T19:58:29.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071490010000000003 2024-04-01T19:58:29.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:29.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.635956+0000", 2024-04-01T19:58:29.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6050000000000001e-05 2024-04-01T19:58:29.857 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:29.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.635998+0000", 2024-04-01T19:58:29.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2537999999999998e-05 2024-04-01T19:58:29.857 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.857 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:29.857 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.857 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.858 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:231314 8.b 8:da2965d4:::benchmark_data_smithi188_161190_object92032:head [delete] snapc 0=[] ondisk+write+known_if_redirected e709)", 2024-04-01T19:58:29.858 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:58:09.607696+0000", 2024-04-01T19:58:29.858 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 20.156129688, 2024-04-01T19:58:29.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035545433000000001, 2024-04-01T19:58:29.858 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:29.858 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:29.858 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:29.858 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:29.858 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:29.858 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:29.858 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 231314 2024-04-01T19:58:29.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.859 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:29.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:29.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.607696+0000", 2024-04-01T19:58:29.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:29.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.607696+0000", 2024-04-01T19:58:29.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:29.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.607698+0000", 2024-04-01T19:58:29.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8619999999999999e-06 2024-04-01T19:58:29.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.860 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:29.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.607704+0000", 2024-04-01T19:58:29.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2630000000000003e-06 2024-04-01T19:58:29.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.860 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:29.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.607714+0000", 2024-04-01T19:58:29.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0128e-05 2024-04-01T19:58:29.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.860 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:29.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.607721+0000", 2024-04-01T19:58:29.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1219999999999997e-06 2024-04-01T19:58:29.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:29.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.607768+0000", 2024-04-01T19:58:29.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7416999999999997e-05 2024-04-01T19:58:29.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:29.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.628183+0000", 2024-04-01T19:58:29.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020414759000000001 2024-04-01T19:58:29.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:58:29.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.628310+0000", 2024-04-01T19:58:29.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000127093 2024-04-01T19:58:29.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:29.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.643132+0000", 2024-04-01T19:58:29.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014822076 2024-04-01T19:58:29.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:29.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.643150+0000", 2024-04-01T19:58:29.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7314999999999999e-05 2024-04-01T19:58:29.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:29.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.643199+0000", 2024-04-01T19:58:29.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9134000000000001e-05 2024-04-01T19:58:29.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:29.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:09.643242+0000", 2024-04-01T19:58:29.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3263999999999998e-05 2024-04-01T19:58:29.863 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.863 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:29.863 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.863 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:246365 8.b 8:deb60042:::benchmark_data_smithi188_161190_object107083:head [delete] snapc 0=[] ondisk+write+known_if_redirected e714)", 2024-04-01T19:58:29.863 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:58:27.999808+0000", 2024-04-01T19:58:29.864 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 1.764018066, 2024-04-01T19:58:29.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033591280000000001, 2024-04-01T19:58:29.864 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:29.864 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:29.864 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:29.864 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:29.864 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:29.864 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:29.864 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 246365 2024-04-01T19:58:29.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.864 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:29.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:29.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:27.999808+0000", 2024-04-01T19:58:29.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:29.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:27.999808+0000", 2024-04-01T19:58:29.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:29.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:27.999812+0000", 2024-04-01T19:58:29.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4290000000000001e-06 2024-04-01T19:58:29.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:29.866 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:27.999822+0000", 2024-04-01T19:58:29.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0115999999999999e-05 2024-04-01T19:58:29.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:29.866 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:27.999844+0000", 2024-04-01T19:58:29.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2041000000000001e-05 2024-04-01T19:58:29.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:29.866 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:27.999854+0000", 2024-04-01T19:58:29.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0411000000000001e-05 2024-04-01T19:58:29.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:29.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:28.000366+0000", 2024-04-01T19:58:29.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00051152200000000004 2024-04-01T19:58:29.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:29.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:28.000491+0000", 2024-04-01T19:58:29.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000124945 2024-04-01T19:58:29.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:58:29.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:28.000607+0000", 2024-04-01T19:58:29.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0001167 2024-04-01T19:58:29.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:29.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:28.013515+0000", 2024-04-01T19:58:29.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012907437000000001 2024-04-01T19:58:29.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:29.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:28.033283+0000", 2024-04-01T19:58:29.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019768602999999999 2024-04-01T19:58:29.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:29.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:28.033345+0000", 2024-04-01T19:58:29.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1977999999999995e-05 2024-04-01T19:58:29.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:29.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:28.033399+0000", 2024-04-01T19:58:29.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4098000000000003e-05 2024-04-01T19:58:29.869 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.869 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:29.869 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.869 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:247686 8.b 8:d89a02ed:::benchmark_data_smithi188_161190_object108404:head [delete] snapc 0=[] ondisk+write+known_if_redirected e714)", 2024-04-01T19:58:29.869 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:58:29.552448+0000", 2024-04-01T19:58:29.869 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.21137841099999999, 2024-04-01T19:58:29.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034284982999999998, 2024-04-01T19:58:29.869 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T19:58:29.869 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T19:58:29.869 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:29.870 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T19:58:29.870 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T19:58:29.870 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T19:58:29.870 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 247686 2024-04-01T19:58:29.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.870 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T19:58:29.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T19:58:29.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:29.552448+0000", 2024-04-01T19:58:29.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T19:58:29.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:29.552448+0000", 2024-04-01T19:58:29.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T19:58:29.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T19:58:29.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:29.552448+0000", 2024-04-01T19:58:29.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8100000000000002e-07 2024-04-01T19:58:29.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T19:58:29.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:29.552452+0000", 2024-04-01T19:58:29.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1590000000000002e-06 2024-04-01T19:58:29.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T19:58:29.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:29.552458+0000", 2024-04-01T19:58:29.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8519999999999998e-06 2024-04-01T19:58:29.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T19:58:29.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:29.552463+0000", 2024-04-01T19:58:29.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9849999999999997e-06 2024-04-01T19:58:29.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T19:58:29.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:29.561195+0000", 2024-04-01T19:58:29.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.008731539 2024-04-01T19:58:29.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T19:58:29.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:29.561299+0000", 2024-04-01T19:58:29.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010357900000000001 2024-04-01T19:58:29.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 4", 2024-04-01T19:58:29.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:29.561406+0000", 2024-04-01T19:58:29.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000106953 2024-04-01T19:58:29.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T19:58:29.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:29.575047+0000", 2024-04-01T19:58:29.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.01364161 2024-04-01T19:58:29.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:29.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:29.586627+0000", 2024-04-01T19:58:29.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011579860000000001 2024-04-01T19:58:29.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T19:58:29.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:29.586686+0000", 2024-04-01T19:58:29.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9157999999999998e-05 2024-04-01T19:58:29.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T19:58:29.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T19:58:29.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T19:58:29.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:29.586733+0000", 2024-04-01T19:58:29.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6607000000000003e-05 2024-04-01T19:58:29.874 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.874 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:29.874 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.874 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T19:58:29.875 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T19:58:29.875 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T19:58:30.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:29 smithi062 ceph-mon[44211]: from='client.17289 v1:172.21.15.22:0/2971508202' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:58:30.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:29 smithi062 ceph-mon[44211]: pgmap v1963: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 2.1 GiB data, 9.2 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 595 op/s; 10482/67594 objects degraded (15.507%); 12 MiB/s, 194 objects/s recovering 2024-04-01T19:58:30.235 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:58:30.239 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:30.239 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:58:30.340 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:58:30.371 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:30.405 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:58:30.411 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:30.412 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:58:30.513 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:58:30.572 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:30 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:58:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:30 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:58:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:30 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 10482/67594 objects degraded (15.507%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:30 smithi062 ceph-mon[44211]: osdmap e715: 12 total, 11 up, 10 in 2024-04-01T19:58:30.782 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:58:30.784 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:30 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:58:30.784 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:30 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:58:30.784 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:30 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 10482/67594 objects degraded (15.507%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:30.784 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:30 smithi188 ceph-mon[43939]: osdmap e715: 12 total, 11 up, 10 in 2024-04-01T19:58:30.788 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:30.788 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:58:30.821 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_ops_in_flight 2024-04-01T19:58:30.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:30 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:58:30.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:30 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:58:30.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:30 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 10482/67594 objects degraded (15.507%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:30.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:30 smithi022 ceph-mon[39439]: osdmap e715: 12 total, 11 up, 10 in 2024-04-01T19:58:30.889 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:58:30.954 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:30.988 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:58:30.996 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:30.997 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:58:31.098 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:58:31.137 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:31.247 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:58:31.706 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:58:31.709 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:31.710 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:58:31.811 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:58:31.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:31 smithi022 ceph-mon[39439]: pgmap v1965: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1.8 GiB data, 8.9 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 981 op/s; 9357/60442 objects degraded (15.481%); 19 MiB/s, 303 objects/s recovering 2024-04-01T19:58:31.864 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:31 smithi062 ceph-mon[44211]: pgmap v1965: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1.8 GiB data, 8.9 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 981 op/s; 9357/60442 objects degraded (15.481%); 19 MiB/s, 303 objects/s recovering 2024-04-01T19:58:31.865 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:31.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:31 smithi188 ceph-mon[43939]: pgmap v1965: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1.8 GiB data, 8.9 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 981 op/s; 9357/60442 objects degraded (15.481%); 19 MiB/s, 303 objects/s recovering 2024-04-01T19:58:31.897 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:58:31.901 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:31.901 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:58:32.002 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:58:32.048 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:32.494 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":1962,"stamp":"2024-04-01T19:58:27.404818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2230321720,"num_objects":34026,"num_object_clones":0,"num_object_copies":68052,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":10482,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34026,"num_whiteouts":0,"num_read":127,"num_read_kb":110,"num_write":244717,"num_write_kb":8916795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30841,"num_bytes_recovered":2022328448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160996,"ondisk_log_size":160996,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":9,"kb":937451520,"kb_used":9692292,"kb_used_data":3734992,"kb_used_omap":889,"kb_used_meta":5956102,"kb_avail":927759228,"statfs":{"total":959950356480,"available":950025449472,"internally_reserved":0,"allocated":3824631808,"data_stored":3820499154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":910339,"internal_metadata":6099049469},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-505675776,"num_objects":-7716,"num_object_clones":0,"num_object_copies":-15432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-2609,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7716,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7716,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2609,"num_bytes_recovered":170983424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.938474"},"pg_stats":[{"pgid":"8.f","version":"714'15460","reported_seq":15735,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-01T19:58:26.129459+0000","last_change":"2024-04-01T19:55:39.217150+0000","last_active":"2024-04-01T19:58:26.129459+0000","last_peered":"2024-04-01T19:58:26.129459+0000","last_clean":"2024-04-01T19:58:26.129459+0000","last_became_active":"2024-04-01T19:53:54.067307+0000","last_became_peered":"2024-04-01T19:53:54.067307+0000","last_unstale":"2024-04-01T19:58:26.129459+0000","last_undegraded":"2024-04-01T19:58:26.129459+0000","last_fullsized":"2024-04-01T19:58:26.129459+0000","mapping_epoch":629,"log_start":"658'5400","ondisk_log_start":"658'5400","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8876","last_scrub_stamp":"2024-04-01T19:55:39.216977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:39.216977+0000","objects_scrubbed":8773,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1863,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140378112,"num_objects":2142,"num_object_clones":0,"num_object_copies":4284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2142,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15460,"num_write_kb":563264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.e","version":"714'15079","reported_seq":15351,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-01T19:58:25.791261+0000","last_change":"2024-04-01T19:55:33.528266+0000","last_active":"2024-04-01T19:58:25.791261+0000","last_peered":"2024-04-01T19:58:25.791261+0000","last_clean":"2024-04-01T19:58:25.791261+0000","last_became_active":"2024-04-01T19:53:54.066471+0000","last_became_peered":"2024-04-01T19:53:54.066471+0000","last_unstale":"2024-04-01T19:58:25.791261+0000","last_undegraded":"2024-04-01T19:58:25.791261+0000","last_fullsized":"2024-04-01T19:58:25.791261+0000","mapping_epoch":629,"log_start":"658'5000","ondisk_log_start":"658'5000","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'8369","last_scrub_stamp":"2024-04-01T19:55:33.528006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:33.528006+0000","objects_scrubbed":8332,"log_size":10079,"log_dups_size":0,"ondisk_log_size":10079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1210,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139395072,"num_objects":2127,"num_object_clones":0,"num_object_copies":4254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2127,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15079,"num_write_kb":550592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"714'15569","reported_seq":15843,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-01T19:58:26.190598+0000","last_change":"2024-04-01T19:55:45.161755+0000","last_active":"2024-04-01T19:58:26.190598+0000","last_peered":"2024-04-01T19:58:26.190598+0000","last_clean":"2024-04-01T19:58:26.190598+0000","last_became_active":"2024-04-01T19:53:53.678991+0000","last_became_peered":"2024-04-01T19:53:53.678991+0000","last_unstale":"2024-04-01T19:58:26.190598+0000","last_undegraded":"2024-04-01T19:58:26.190598+0000","last_fullsized":"2024-04-01T19:58:26.190598+0000","mapping_epoch":629,"log_start":"658'5500","ondisk_log_start":"658'5500","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"674'9322","last_scrub_stamp":"2024-04-01T19:55:45.161618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:45.161618+0000","objects_scrubbed":8442,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1822,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139722776,"num_objects":2133,"num_object_clones":0,"num_object_copies":4266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2133,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":15569,"num_write_kb":566401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.c","version":"714'15298","reported_seq":15639,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-01T19:58:25.723630+0000","last_change":"2024-04-01T19:57:06.345540+0000","last_active":"2024-04-01T19:58:25.723630+0000","last_peered":"2024-04-01T19:58:25.723630+0000","last_clean":"2024-04-01T19:58:25.723630+0000","last_became_active":"2024-04-01T19:53:53.462634+0000","last_became_peered":"2024-04-01T19:53:53.462634+0000","last_unstale":"2024-04-01T19:58:25.723630+0000","last_undegraded":"2024-04-01T19:58:25.723630+0000","last_fullsized":"2024-04-01T19:58:25.723630+0000","mapping_epoch":629,"log_start":"658'5200","ondisk_log_start":"658'5200","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"695'11630","last_scrub_stamp":"2024-04-01T19:57:06.345285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:57:06.345285+0000","objects_scrubbed":5792,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:58:27.497643+0000","scrub_duration":1062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138018816,"num_objects":2106,"num_object_clones":0,"num_object_copies":4212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2106,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15298,"num_write_kb":556928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"8.b","version":"713'15433","reported_seq":15817,"reported_epoch":713,"state":"active+clean","last_fresh":"2024-04-01T19:58:24.370280+0000","last_change":"2024-04-01T19:58:04.980816+0000","last_active":"2024-04-01T19:58:24.370280+0000","last_peered":"2024-04-01T19:58:24.370280+0000","last_clean":"2024-04-01T19:58:24.370280+0000","last_became_active":"2024-04-01T19:53:53.456979+0000","last_became_peered":"2024-04-01T19:53:53.456979+0000","last_unstale":"2024-04-01T19:58:24.370280+0000","last_undegraded":"2024-04-01T19:58:24.370280+0000","last_fullsized":"2024-04-01T19:58:24.370280+0000","mapping_epoch":629,"log_start":"658'5400","ondisk_log_start":"658'5400","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"707'14413","last_scrub_stamp":"2024-04-01T19:58:04.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:58:04.980641+0000","objects_scrubbed":3325,"log_size":10033,"log_dups_size":0,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:59:19.064773+0000","scrub_duration":600,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150274048,"num_objects":2293,"num_object_clones":0,"num_object_copies":4586,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2293,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15433,"num_write_kb":567232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"8.a","version":"713'14975","reported_seq":15345,"reported_epoch":713,"state":"active+clean","last_fresh":"2024-04-01T19:58:24.410543+0000","last_change":"2024-04-01T19:57:56.975934+0000","last_active":"2024-04-01T19:58:24.410543+0000","last_peered":"2024-04-01T19:58:24.410543+0000","last_clean":"2024-04-01T19:58:24.410543+0000","last_became_active":"2024-04-01T19:53:54.066588+0000","last_became_peered":"2024-04-01T19:53:54.066588+0000","last_unstale":"2024-04-01T19:58:24.410543+0000","last_undegraded":"2024-04-01T19:58:24.410543+0000","last_fullsized":"2024-04-01T19:58:24.410543+0000","mapping_epoch":629,"log_start":"657'4900","ondisk_log_start":"657'4900","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"706'13635","last_scrub_stamp":"2024-04-01T19:57:56.975745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:57:56.975745+0000","objects_scrubbed":3527,"log_size":10075,"log_dups_size":0,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:59:06.634758+0000","scrub_duration":583,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142671872,"num_objects":2177,"num_object_clones":0,"num_object_copies":4354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2177,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14975,"num_write_kb":548864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"8.8","version":"714'15484","reported_seq":15758,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-01T19:58:25.960666+0000","last_change":"2024-04-01T19:55:40.424211+0000","last_active":"2024-04-01T19:58:25.960666+0000","last_peered":"2024-04-01T19:58:25.960666+0000","last_clean":"2024-04-01T19:58:25.960666+0000","last_became_active":"2024-04-01T19:53:53.454737+0000","last_became_peered":"2024-04-01T19:53:53.454737+0000","last_unstale":"2024-04-01T19:58:25.960666+0000","last_undegraded":"2024-04-01T19:58:25.960666+0000","last_fullsized":"2024-04-01T19:58:25.960666+0000","mapping_epoch":629,"log_start":"658'5400","ondisk_log_start":"658'5400","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8915","last_scrub_stamp":"2024-04-01T19:55:40.424044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:40.424044+0000","objects_scrubbed":8661,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1277,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134479872,"num_objects":2052,"num_object_clones":0,"num_object_copies":4104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2052,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15484,"num_write_kb":561152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"714'15248","reported_seq":27803,"reported_epoch":714,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:58:26.204754+0000","last_change":"2024-04-01T19:56:22.028676+0000","last_active":"2024-04-01T19:58:26.204754+0000","last_peered":"2024-04-01T19:58:26.204754+0000","last_clean":"2024-04-01T19:55:56.524590+0000","last_became_active":"2024-04-01T19:56:21.981743+0000","last_became_peered":"2024-04-01T19:56:21.981743+0000","last_unstale":"2024-04-01T19:58:26.204754+0000","last_undegraded":"2024-04-01T19:56:21.738659+0000","last_fullsized":"2024-04-01T19:58:26.204754+0000","mapping_epoch":687,"log_start":"658'5200","ondisk_log_start":"658'5200","created":629,"last_epoch_clean":641,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'9008","last_scrub_stamp":"2024-04-01T19:55:43.358714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:43.358714+0000","objects_scrubbed":8387,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"no scrub is scheduled","scrub_duration":2089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136183808,"num_objects":2078,"num_object_clones":0,"num_object_copies":4156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2077,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15248,"num_write_kb":554432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6135,"num_bytes_recovered":401997824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":["11"],"object_location_counts":[{"shards":"2,11","objects":1},{"shards":"11","objects":2077}],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.6","version":"714'15324","reported_seq":28025,"reported_epoch":714,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:58:26.206847+0000","last_change":"2024-04-01T19:56:22.018466+0000","last_active":"2024-04-01T19:58:26.206847+0000","last_peered":"2024-04-01T19:58:26.206847+0000","last_clean":"2024-04-01T19:55:56.539057+0000","last_became_active":"2024-04-01T19:56:21.956699+0000","last_became_peered":"2024-04-01T19:56:21.956699+0000","last_unstale":"2024-04-01T19:58:26.206847+0000","last_undegraded":"2024-04-01T19:56:21.744926+0000","last_fullsized":"2024-04-01T19:58:26.206847+0000","mapping_epoch":687,"log_start":"658'5300","ondisk_log_start":"658'5300","created":629,"last_epoch_clean":642,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8615","last_scrub_stamp":"2024-04-01T19:55:36.688352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:36.688352+0000","objects_scrubbed":8556,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"no scrub is scheduled","scrub_duration":2331,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133955584,"num_objects":2044,"num_object_clones":0,"num_object_copies":4088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2039,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2044,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15324,"num_write_kb":555776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6208,"num_bytes_recovered":406650880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":["11"],"object_location_counts":[{"shards":"7,11","objects":5},{"shards":"11","objects":2039}],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.5","version":"714'15404","reported_seq":28071,"reported_epoch":714,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:58:26.635062+0000","last_change":"2024-04-01T19:56:22.002998+0000","last_active":"2024-04-01T19:58:26.635062+0000","last_peered":"2024-04-01T19:58:26.635062+0000","last_clean":"2024-04-01T19:55:56.434043+0000","last_became_active":"2024-04-01T19:56:21.952684+0000","last_became_peered":"2024-04-01T19:56:21.952684+0000","last_unstale":"2024-04-01T19:58:26.635062+0000","last_undegraded":"2024-04-01T19:56:21.721301+0000","last_fullsized":"2024-04-01T19:58:26.635062+0000","mapping_epoch":687,"log_start":"658'5400","ondisk_log_start":"658'5400","created":629,"last_epoch_clean":644,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'8660","last_scrub_stamp":"2024-04-01T19:55:36.183547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:36.183547+0000","objects_scrubbed":8628,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"no scrub is scheduled","scrub_duration":1673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141033472,"num_objects":2152,"num_object_clones":0,"num_object_copies":4304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2152,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15404,"num_write_kb":561792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6190,"num_bytes_recovered":405667840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":2152}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.4","version":"714'18233","reported_seq":18711,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-01T19:58:25.940108+0000","last_change":"2024-04-01T19:55:34.954183+0000","last_active":"2024-04-01T19:58:25.940108+0000","last_peered":"2024-04-01T19:58:25.940108+0000","last_clean":"2024-04-01T19:58:25.940108+0000","last_became_active":"2024-04-01T19:53:53.462894+0000","last_became_peered":"2024-04-01T19:53:53.462894+0000","last_unstale":"2024-04-01T19:58:25.940108+0000","last_undegraded":"2024-04-01T19:58:25.940108+0000","last_fullsized":"2024-04-01T19:58:25.940108+0000","mapping_epoch":629,"log_start":"664'8200","ondisk_log_start":"664'8200","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'11373","last_scrub_stamp":"2024-04-01T19:55:34.954011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:34.954011+0000","objects_scrubbed":8546,"log_size":10033,"log_dups_size":0,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134807552,"num_objects":2057,"num_object_clones":0,"num_object_copies":4114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2057,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15471,"num_write_kb":560896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"714'15233","reported_seq":15481,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-01T19:58:26.193567+0000","last_change":"2024-04-01T19:54:55.108987+0000","last_active":"2024-04-01T19:58:26.193567+0000","last_peered":"2024-04-01T19:58:26.193567+0000","last_clean":"2024-04-01T19:58:26.193567+0000","last_became_active":"2024-04-01T19:53:53.462397+0000","last_became_peered":"2024-04-01T19:53:53.462397+0000","last_unstale":"2024-04-01T19:58:26.193567+0000","last_undegraded":"2024-04-01T19:58:26.193567+0000","last_fullsized":"2024-04-01T19:58:26.193567+0000","mapping_epoch":629,"log_start":"658'5200","ondisk_log_start":"658'5200","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"660'5871","last_scrub_stamp":"2024-04-01T19:54:55.108780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:54:55.108780+0000","objects_scrubbed":5824,"log_size":10033,"log_dups_size":0,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133758976,"num_objects":2041,"num_object_clones":0,"num_object_copies":4082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2041,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15233,"num_write_kb":552768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.2","version":"714'14982","reported_seq":27436,"reported_epoch":714,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:58:25.791008+0000","last_change":"2024-04-01T19:56:22.018621+0000","last_active":"2024-04-01T19:58:25.791008+0000","last_peered":"2024-04-01T19:58:25.791008+0000","last_clean":"2024-04-01T19:55:56.523442+0000","last_became_active":"2024-04-01T19:56:21.981766+0000","last_became_peered":"2024-04-01T19:56:21.981766+0000","last_unstale":"2024-04-01T19:58:25.791008+0000","last_undegraded":"2024-04-01T19:56:21.720612+0000","last_fullsized":"2024-04-01T19:58:25.791008+0000","mapping_epoch":687,"log_start":"658'4900","ondisk_log_start":"658'4900","created":629,"last_epoch_clean":645,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'8353","last_scrub_stamp":"2024-04-01T19:55:34.153804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:34.153804+0000","objects_scrubbed":8295,"log_size":10082,"log_dups_size":0,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"no scrub is scheduled","scrub_duration":1672,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140509184,"num_objects":2144,"num_object_clones":0,"num_object_copies":4288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2050,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14982,"num_write_kb":548032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6085,"num_bytes_recovered":398655488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2050},{"shards":"0,4","objects":94}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"714'18146","reported_seq":18704,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-01T19:58:25.668279+0000","last_change":"2024-04-01T19:57:00.295446+0000","last_active":"2024-04-01T19:58:25.668279+0000","last_peered":"2024-04-01T19:58:25.668279+0000","last_clean":"2024-04-01T19:58:25.668279+0000","last_became_active":"2024-04-01T19:53:54.066680+0000","last_became_peered":"2024-04-01T19:53:54.066680+0000","last_unstale":"2024-04-01T19:58:25.668279+0000","last_undegraded":"2024-04-01T19:58:25.668279+0000","last_fullsized":"2024-04-01T19:58:25.668279+0000","mapping_epoch":629,"log_start":"664'8100","ondisk_log_start":"664'8100","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"694'14240","last_scrub_stamp":"2024-04-01T19:57:00.295287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:57:00.295287+0000","objects_scrubbed":6022,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:58:27.497611+0000","scrub_duration":983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137035776,"num_objects":2091,"num_object_clones":0,"num_object_copies":4182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2091,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15187,"num_write_kb":552896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"8.0","version":"713'14939","reported_seq":15325,"reported_epoch":713,"state":"active+clean","last_fresh":"2024-04-01T19:58:22.664348+0000","last_change":"2024-04-01T19:57:56.925685+0000","last_active":"2024-04-01T19:58:22.664348+0000","last_peered":"2024-04-01T19:58:22.664348+0000","last_clean":"2024-04-01T19:58:22.664348+0000","last_became_active":"2024-04-01T19:53:53.455265+0000","last_became_peered":"2024-04-01T19:53:53.455265+0000","last_unstale":"2024-04-01T19:58:22.664348+0000","last_undegraded":"2024-04-01T19:58:22.664348+0000","last_fullsized":"2024-04-01T19:58:22.664348+0000","mapping_epoch":629,"log_start":"656'4900","ondisk_log_start":"656'4900","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"706'13692","last_scrub_stamp":"2024-04-01T19:57:56.925430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:57:56.925430+0000","objects_scrubbed":3477,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:58:57.818501+0000","scrub_duration":572,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145424384,"num_objects":2219,"num_object_clones":0,"num_object_copies":4438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2219,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14939,"num_write_kb":549056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"714'15450","reported_seq":28173,"reported_epoch":714,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:58:25.968464+0000","last_change":"2024-04-01T19:56:22.004749+0000","last_active":"2024-04-01T19:58:25.968464+0000","last_peered":"2024-04-01T19:58:25.968464+0000","last_clean":"2024-04-01T19:55:56.538683+0000","last_became_active":"2024-04-01T19:56:21.960415+0000","last_became_peered":"2024-04-01T19:56:21.960415+0000","last_unstale":"2024-04-01T19:58:25.968464+0000","last_undegraded":"2024-04-01T19:56:21.714140+0000","last_fullsized":"2024-04-01T19:58:25.968464+0000","mapping_epoch":687,"log_start":"658'5400","ondisk_log_start":"658'5400","created":629,"last_epoch_clean":645,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8889","last_scrub_stamp":"2024-04-01T19:55:39.237364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:39.237364+0000","objects_scrubbed":8775,"log_size":10050,"log_dups_size":0,"ondisk_log_size":10050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"no scrub is scheduled","scrub_duration":1706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142082048,"num_objects":2168,"num_object_clones":0,"num_object_copies":4336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2168,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15450,"num_write_kb":563776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6215,"num_bytes_recovered":407240704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":["5"],"object_location_counts":[{"shards":"0,5","objects":4},{"shards":"5","objects":2164}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":1753,"reported_epoch":713,"state":"active+clean","last_fresh":"2024-04-01T19:58:21.502079+0000","last_change":"2024-04-01T19:55:33.016809+0000","last_active":"2024-04-01T19:58:21.502079+0000","last_peered":"2024-04-01T19:58:21.502079+0000","last_clean":"2024-04-01T19:58:21.502079+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:58:21.502079+0000","last_undegraded":"2024-04-01T19:58:21.502079+0000","last_fullsized":"2024-04-01T19:58:21.502079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:55:33.016695+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:55:33.016695+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":192,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":2229731352,"num_objects":34024,"num_object_clones":0,"num_object_copies":68048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":10482,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34024,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":244536,"num_write_kb":8913857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30833,"num_bytes_recovered":2020212736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6300508160,"data_stored":6300500016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160857,"ondisk_log_size":160857,"up":32,"acting":32,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220590,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1548664,"kb_used_data":673388,"kb_used_omap":1,"kb_used_meta":875262,"kb_avail":92196488,"statfs":{"total":95995035648,"available":94409203712,"internally_reserved":0,"allocated":689549312,"data_stored":689126327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":896268740},"hb_peers":[0,1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678457,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1002988,"kb_used_data":404000,"kb_used_omap":1,"kb_used_meta":598974,"kb_avail":92742164,"statfs":{"total":95995035648,"available":94967975936,"internally_reserved":0,"allocated":413696000,"data_stored":413280659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":613349824},"hb_peers":[0,1,2,3,4,5,6,7,8,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557654,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":653916,"kb_used_data":427476,"kb_used_omap":132,"kb_used_meta":226299,"kb_avail":93091236,"statfs":{"total":95995035648,"available":95325425664,"internally_reserved":0,"allocated":437735424,"data_stored":437326087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":231730919},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234435,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":768688,"kb_used_data":151520,"kb_used_omap":1,"kb_used_meta":617022,"kb_avail":92976464,"statfs":{"total":95995035648,"available":95207899136,"internally_reserved":0,"allocated":155156480,"data_stored":154739519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":631830986},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":457,"seq":1962800054447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":253668,"kb_used_data":788,"kb_used_omap":744,"kb_used_meta":252119,"kb_avail":93491484,"statfs":{"total":95995035648,"available":95735279616,"internally_reserved":0,"allocated":806912,"data_stored":397575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":762131,"internal_metadata":258170605},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":2452426326115,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738856,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":998108,"kb_used_data":281108,"kb_used_omap":1,"kb_used_meta":716990,"kb_avail":92747044,"statfs":{"total":95995035648,"available":94972973056,"internally_reserved":0,"allocated":287854592,"data_stored":287445255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":734198213},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346397,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1113004,"kb_used_data":544544,"kb_used_omap":1,"kb_used_meta":568446,"kb_avail":92632148,"statfs":{"total":95995035648,"available":94855319552,"internally_reserved":0,"allocated":557613056,"data_stored":557197715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":582089157},"hb_peers":[0,1,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669150166,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1036640,"kb_used_data":287700,"kb_used_omap":1,"kb_used_meta":748926,"kb_avail":92708512,"statfs":{"total":95995035648,"available":94933516288,"internally_reserved":0,"allocated":294604800,"data_stored":294195463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":766900679},"hb_peers":[0,1,2,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953937,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":957612,"kb_used_data":286432,"kb_used_omap":1,"kb_used_meta":671166,"kb_avail":92787540,"statfs":{"total":95995035648,"available":95014440960,"internally_reserved":0,"allocated":293306368,"data_stored":292891027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":687274437},"hb_peers":[0,1,2,3,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790413,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1359004,"kb_used_data":678036,"kb_used_omap":1,"kb_used_meta":680894,"kb_avail":92386148,"statfs":{"total":95995035648,"available":94603415552,"internally_reserved":0,"allocated":694308864,"data_stored":693899527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":697235909},"hb_peers":[0,1,2,3,4,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":280166400,"data_stored":280166400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":543948800,"data_stored":543948800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":291307520,"data_stored":291307520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":288882688,"data_stored":288882688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":681771008,"data_stored":681771008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":150081536,"data_stored":150077464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":435486720,"data_stored":435486720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":410058752,"data_stored":410058752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":2534604800,"data_stored":2534604800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":684199936,"data_stored":684195864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:58:32.496 INFO:tasks.cephadm.ceph_manager.ceph:PG 8.7 is not active+clean 2024-04-01T19:58:32.496 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '8.7', 'version': "714'15248", 'reported_seq': 27803, 'reported_epoch': 714, 'state': 'active+recovering+degraded', 'last_fresh': '2024-04-01T19:58:26.204754+0000', 'last_change': '2024-04-01T19:56:22.028676+0000', 'last_active': '2024-04-01T19:58:26.204754+0000', 'last_peered': '2024-04-01T19:58:26.204754+0000', 'last_clean': '2024-04-01T19:55:56.524590+0000', 'last_became_active': '2024-04-01T19:56:21.981743+0000', 'last_became_peered': '2024-04-01T19:56:21.981743+0000', 'last_unstale': '2024-04-01T19:58:26.204754+0000', 'last_undegraded': '2024-04-01T19:56:21.738659+0000', 'last_fullsized': '2024-04-01T19:58:26.204754+0000', 'mapping_epoch': 687, 'log_start': "658'5200", 'ondisk_log_start': "658'5200", 'created': 629, 'last_epoch_clean': 641, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "673'9008", 'last_scrub_stamp': '2024-04-01T19:55:43.358714+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T19:53:52.440963+0000', 'last_clean_scrub_stamp': '2024-04-01T19:55:43.358714+0000', 'objects_scrubbed': 8387, 'log_size': 10048, 'log_dups_size': 0, 'ondisk_log_size': 10048, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 3, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 2089, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 136183808, 'num_objects': 2078, 'num_object_clones': 0, 'num_object_copies': 4156, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 2077, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 2078, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 15248, 'num_write_kb': 554432, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 6135, 'num_bytes_recovered': 401997824, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [11, 2], 'acting': [11, 2], 'avail_no_missing': ['11'], 'object_location_counts': [{'shards': '2,11', 'objects': 1}, {'shards': '11', 'objects': 2077}], 'blocked_by': [], 'up_primary': 11, 'acting_primary': 11, 'purged_snaps': []} 2024-04-01T19:58:32.496 INFO:tasks.cephadm.ceph_manager.ceph:PG 8.6 is not active+clean 2024-04-01T19:58:32.496 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '8.6', 'version': "714'15324", 'reported_seq': 28025, 'reported_epoch': 714, 'state': 'active+recovering+degraded', 'last_fresh': '2024-04-01T19:58:26.206847+0000', 'last_change': '2024-04-01T19:56:22.018466+0000', 'last_active': '2024-04-01T19:58:26.206847+0000', 'last_peered': '2024-04-01T19:58:26.206847+0000', 'last_clean': '2024-04-01T19:55:56.539057+0000', 'last_became_active': '2024-04-01T19:56:21.956699+0000', 'last_became_peered': '2024-04-01T19:56:21.956699+0000', 'last_unstale': '2024-04-01T19:58:26.206847+0000', 'last_undegraded': '2024-04-01T19:56:21.744926+0000', 'last_fullsized': '2024-04-01T19:58:26.206847+0000', 'mapping_epoch': 687, 'log_start': "658'5300", 'ondisk_log_start': "658'5300", 'created': 629, 'last_epoch_clean': 642, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "673'8615", 'last_scrub_stamp': '2024-04-01T19:55:36.688352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T19:53:52.440963+0000', 'last_clean_scrub_stamp': '2024-04-01T19:55:36.688352+0000', 'objects_scrubbed': 8556, 'log_size': 10024, 'log_dups_size': 0, 'ondisk_log_size': 10024, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 3, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 2331, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 133955584, 'num_objects': 2044, 'num_object_clones': 0, 'num_object_copies': 4088, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 2039, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 2044, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 15324, 'num_write_kb': 555776, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 6208, 'num_bytes_recovered': 406650880, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [11, 7], 'acting': [11, 7], 'avail_no_missing': ['11'], 'object_location_counts': [{'shards': '7,11', 'objects': 5}, {'shards': '11', 'objects': 2039}], 'blocked_by': [], 'up_primary': 11, 'acting_primary': 11, 'purged_snaps': []} 2024-04-01T19:58:32.496 INFO:tasks.cephadm.ceph_manager.ceph:PG 8.5 is not active+clean 2024-04-01T19:58:32.496 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '8.5', 'version': "714'15404", 'reported_seq': 28071, 'reported_epoch': 714, 'state': 'active+recovering+degraded', 'last_fresh': '2024-04-01T19:58:26.635062+0000', 'last_change': '2024-04-01T19:56:22.002998+0000', 'last_active': '2024-04-01T19:58:26.635062+0000', 'last_peered': '2024-04-01T19:58:26.635062+0000', 'last_clean': '2024-04-01T19:55:56.434043+0000', 'last_became_active': '2024-04-01T19:56:21.952684+0000', 'last_became_peered': '2024-04-01T19:56:21.952684+0000', 'last_unstale': '2024-04-01T19:58:26.635062+0000', 'last_undegraded': '2024-04-01T19:56:21.721301+0000', 'last_fullsized': '2024-04-01T19:58:26.635062+0000', 'mapping_epoch': 687, 'log_start': "658'5400", 'ondisk_log_start': "658'5400", 'created': 629, 'last_epoch_clean': 644, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "672'8660", 'last_scrub_stamp': '2024-04-01T19:55:36.183547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T19:53:52.440963+0000', 'last_clean_scrub_stamp': '2024-04-01T19:55:36.183547+0000', 'objects_scrubbed': 8628, 'log_size': 10004, 'log_dups_size': 0, 'ondisk_log_size': 10004, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 2, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 1673, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 141033472, 'num_objects': 2152, 'num_object_clones': 0, 'num_object_copies': 4304, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 2152, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 2152, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 15404, 'num_write_kb': 561792, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 6190, 'num_bytes_recovered': 405667840, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 11], 'acting': [4, 11], 'avail_no_missing': ['4'], 'object_location_counts': [{'shards': '4', 'objects': 2152}], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-01T19:58:32.497 INFO:tasks.cephadm.ceph_manager.ceph:PG 8.2 is not active+clean 2024-04-01T19:58:32.497 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '8.2', 'version': "714'14982", 'reported_seq': 27436, 'reported_epoch': 714, 'state': 'active+recovering+degraded', 'last_fresh': '2024-04-01T19:58:25.791008+0000', 'last_change': '2024-04-01T19:56:22.018621+0000', 'last_active': '2024-04-01T19:58:25.791008+0000', 'last_peered': '2024-04-01T19:58:25.791008+0000', 'last_clean': '2024-04-01T19:55:56.523442+0000', 'last_became_active': '2024-04-01T19:56:21.981766+0000', 'last_became_peered': '2024-04-01T19:56:21.981766+0000', 'last_unstale': '2024-04-01T19:58:25.791008+0000', 'last_undegraded': '2024-04-01T19:56:21.720612+0000', 'last_fullsized': '2024-04-01T19:58:25.791008+0000', 'mapping_epoch': 687, 'log_start': "658'4900", 'ondisk_log_start': "658'4900", 'created': 629, 'last_epoch_clean': 645, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "672'8353", 'last_scrub_stamp': '2024-04-01T19:55:34.153804+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T19:53:52.440963+0000', 'last_clean_scrub_stamp': '2024-04-01T19:55:34.153804+0000', 'objects_scrubbed': 8295, 'log_size': 10082, 'log_dups_size': 0, 'ondisk_log_size': 10082, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 2, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 1672, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 140509184, 'num_objects': 2144, 'num_object_clones': 0, 'num_object_copies': 4288, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 2050, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 2144, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 14982, 'num_write_kb': 548032, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 6085, 'num_bytes_recovered': 398655488, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': ['0'], 'object_location_counts': [{'shards': '0', 'objects': 2050}, {'shards': '0,4', 'objects': 94}], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-01T19:58:32.497 INFO:tasks.cephadm.ceph_manager.ceph:PG 8.9 is not active+clean 2024-04-01T19:58:32.497 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '8.9', 'version': "714'15450", 'reported_seq': 28173, 'reported_epoch': 714, 'state': 'active+recovering+degraded', 'last_fresh': '2024-04-01T19:58:25.968464+0000', 'last_change': '2024-04-01T19:56:22.004749+0000', 'last_active': '2024-04-01T19:58:25.968464+0000', 'last_peered': '2024-04-01T19:58:25.968464+0000', 'last_clean': '2024-04-01T19:55:56.538683+0000', 'last_became_active': '2024-04-01T19:56:21.960415+0000', 'last_became_peered': '2024-04-01T19:56:21.960415+0000', 'last_unstale': '2024-04-01T19:58:25.968464+0000', 'last_undegraded': '2024-04-01T19:56:21.714140+0000', 'last_fullsized': '2024-04-01T19:58:25.968464+0000', 'mapping_epoch': 687, 'log_start': "658'5400", 'ondisk_log_start': "658'5400", 'created': 629, 'last_epoch_clean': 645, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "673'8889", 'last_scrub_stamp': '2024-04-01T19:55:39.237364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-01T19:53:52.440963+0000', 'last_clean_scrub_stamp': '2024-04-01T19:55:39.237364+0000', 'objects_scrubbed': 8775, 'log_size': 10050, 'log_dups_size': 0, 'ondisk_log_size': 10050, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 2, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 1706, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 142082048, 'num_objects': 2168, 'num_object_clones': 0, 'num_object_copies': 4336, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 2164, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 2168, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 15450, 'num_write_kb': 563776, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 6215, 'num_bytes_recovered': 407240704, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': ['5'], 'object_location_counts': [{'shards': '0,5', 'objects': 4}, {'shards': '5', 'objects': 2164}], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-01T19:58:32.497 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph status --format=json 2024-04-01T19:58:32.789 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:58:32.807 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:58:32.812 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:32.812 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:58:32.913 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:58:32.954 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:33.546 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:58:33.559 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:33.559 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:58:33.660 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:58:33.697 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:33 smithi062 ceph-mon[44211]: pgmap v1966: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1.8 GiB data, 8.8 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 982 op/s; 9070/59356 objects degraded (15.281%); 21 MiB/s, 339 objects/s recovering 2024-04-01T19:58:33.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:33 smithi022 ceph-mon[39439]: pgmap v1966: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1.8 GiB data, 8.8 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 982 op/s; 9070/59356 objects degraded (15.281%); 21 MiB/s, 339 objects/s recovering 2024-04-01T19:58:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:33 smithi188 ceph-mon[43939]: pgmap v1966: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1.8 GiB data, 8.8 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 982 op/s; 9070/59356 objects degraded (15.281%); 21 MiB/s, 339 objects/s recovering 2024-04-01T19:58:33.941 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:58:33.964 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:58:33.967 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:33.967 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:58:34.026 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:58:34.026 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T19:58:34.027 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 0 2024-04-01T19:58:34.027 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:58:34.068 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:58:34.102 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:34.987 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_blocked_ops 2024-04-01T19:58:35.425 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:58:35.497 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:58:35.507 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:35.507 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:58:35.608 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:58:35.656 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:35.796 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:35 smithi062 ceph-mon[44211]: pgmap v1967: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1.8 GiB data, 8.7 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 851 op/s; 9070/58188 objects degraded (15.587%); 17 MiB/s, 273 objects/s recovering 2024-04-01T19:58:35.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:35 smithi022 ceph-mon[39439]: pgmap v1967: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1.8 GiB data, 8.7 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 851 op/s; 9070/58188 objects degraded (15.587%); 17 MiB/s, 273 objects/s recovering 2024-04-01T19:58:35.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:35 smithi188 ceph-mon[43939]: pgmap v1967: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1.8 GiB data, 8.7 GiB used, 885 GiB / 894 GiB avail; 0 B/s wr, 851 op/s; 9070/58188 objects degraded (15.587%); 17 MiB/s, 273 objects/s recovering 2024-04-01T19:58:35.918 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:58:35.922 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:35.923 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:58:36.024 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:58:36.274 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:36.309 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:58:36.316 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:36.317 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:58:36.418 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:58:36.465 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:36.492 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:58:36.496 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:36.496 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:58:36.516 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:36 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 9070/58188 objects degraded (15.587%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:36.597 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:58:36.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:36 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 9070/58188 objects degraded (15.587%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:36.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:36 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:58:36.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:36 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:58:36.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:36 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:58:36.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:36 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:58:36.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:36 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:58:36.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:36 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:58:36.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:36 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:58:36.637 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:36.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:36 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:58:36.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:36 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:58:36.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:36 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:58:36.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:36 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:58:36.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:36 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:58:36.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:36 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:58:36.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:36 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:58:37.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:36 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 9070/58188 objects degraded (15.587%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:37.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:36 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:58:37.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:36 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:58:37.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:36 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:58:37.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:36 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:58:37.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:36 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:58:37.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:36 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:58:37.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:36 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:58:37.398 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:58:37.404 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:37.404 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:58:37.505 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:58:37.553 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:58:37.553 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:37.720 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:37 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3961281110' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:58:37.720 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:37 smithi062 ceph-mon[44211]: from='client.37325 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:58:37.720 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:58:37.720 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:58:37.720 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:37 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:58:37.720 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:37 smithi062 ceph-mon[44211]: pgmap v1968: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1.6 GiB data, 8.4 GiB used, 886 GiB / 894 GiB avail; 0 B/s wr, 850 op/s; 7669/51032 objects degraded (15.028%); 18 MiB/s, 281 objects/s recovering 2024-04-01T19:58:37.728 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:58:37.760 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:37.761 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:58:37.862 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:58:37.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:37 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3961281110' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:58:37.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:37 smithi022 ceph-mon[39439]: from='client.37325 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:58:37.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:58:37.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:58:37.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:37 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:58:37.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:37 smithi022 ceph-mon[39439]: pgmap v1968: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1.6 GiB data, 8.4 GiB used, 886 GiB / 894 GiB avail; 0 B/s wr, 850 op/s; 7669/51032 objects degraded (15.028%); 18 MiB/s, 281 objects/s recovering 2024-04-01T19:58:37.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:37 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3961281110' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:58:37.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:37 smithi188 ceph-mon[43939]: from='client.37325 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:58:37.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:58:37.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:58:37.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:37 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:58:37.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:37 smithi188 ceph-mon[43939]: pgmap v1968: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1.6 GiB data, 8.4 GiB used, 886 GiB / 894 GiB avail; 0 B/s wr, 850 op/s; 7669/51032 objects degraded (15.028%); 18 MiB/s, 281 objects/s recovering 2024-04-01T19:58:37.910 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:37.944 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:58:37.947 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:37.947 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:58:38.048 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:58:38.094 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:38.405 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T19:58:38.405 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:58:38.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:38 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:58:38.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:38 smithi062 ceph-mon[44211]: from='client.37325 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:58:38.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:38 smithi062 ceph-mon[44211]: osdmap e716: 12 total, 11 up, 10 in 2024-04-01T19:58:38.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:38 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2608056027' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:58:38.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:38.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:38.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:38.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:38.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:38 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:58:38.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:38 smithi022 ceph-mon[39439]: from='client.37325 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:58:38.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:38 smithi022 ceph-mon[39439]: osdmap e716: 12 total, 11 up, 10 in 2024-04-01T19:58:38.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:38 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2608056027' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:58:38.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:38.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:38.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:38.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:38 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:58:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:38 smithi188 ceph-mon[43939]: from='client.37325 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:58:38.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:38 smithi188 ceph-mon[43939]: osdmap e716: 12 total, 11 up, 10 in 2024-04-01T19:58:38.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:38 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2608056027' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:58:38.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:38.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:38.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:38.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:39.158 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:58:39.158 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:58:39.158 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:58:39.158 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:58:39.158 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:58:39.158 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:58:39.158 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:58:39.158 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:58:39.158 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:58:39.158 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:58:39.158 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:58:39.159 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:58:39.159 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:58:39.159 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:58:39.159 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:58:39.159 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:58:39.159 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:58:39.159 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:58:39.159 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:58:39.159 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:58:39.159 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:58:39.159 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.10 2024-04-01T19:58:39.159 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:58:39.291 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_historic_ops 2024-04-01T19:58:39.737 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T19:58:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:39.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:39.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:39 smithi022 ceph-mon[39439]: pgmap v1970: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1.5 GiB data, 8.3 GiB used, 886 GiB / 894 GiB avail; 0 B/s wr, 905 op/s; 7669/50490 objects degraded (15.189%); 20 MiB/s, 316 objects/s recovering 2024-04-01T19:58:39.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:39.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:39.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:39.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:39.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:39.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:39.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:39.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:39 smithi188 ceph-mon[43939]: pgmap v1970: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1.5 GiB data, 8.3 GiB used, 886 GiB / 894 GiB avail; 0 B/s wr, 905 op/s; 7669/50490 objects degraded (15.189%); 20 MiB/s, 316 objects/s recovering 2024-04-01T19:58:39.932 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:58:39.939 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:39.939 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:58:39.976 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:58:39.977 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:58:40.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:40.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:40.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:40.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:40.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:40.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:40.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:40.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:39 smithi062 ceph-mon[44211]: pgmap v1970: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1.5 GiB data, 8.3 GiB used, 886 GiB / 894 GiB avail; 0 B/s wr, 905 op/s; 7669/50490 objects degraded (15.189%); 20 MiB/s, 316 objects/s recovering 2024-04-01T19:58:40.040 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:58:40.080 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:40.229 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:58:40.234 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:40.235 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:58:40.335 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:58:40.387 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:40 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 7669/50490 objects degraded (15.189%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:40 smithi062 ceph-mon[44211]: osdmap e717: 12 total, 11 up, 10 in 2024-04-01T19:58:40.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:40 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 7669/50490 objects degraded (15.189%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:40.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:40 smithi022 ceph-mon[39439]: osdmap e717: 12 total, 11 up, 10 in 2024-04-01T19:58:40.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:40 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 7669/50490 objects degraded (15.189%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:40.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:40 smithi188 ceph-mon[43939]: osdmap e717: 12 total, 11 up, 10 in 2024-04-01T19:58:41.152 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:58:41.156 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:41.157 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:58:41.258 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:58:41.262 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:58:41.262 INFO:teuthology.orchestra.run.smithi022.stdout:{"fsid":"09f6b846-f05c-11ee-b647-cb9ed24678a4","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noscrub,nodeep-scrub flag(s) set","count":20},"muted":false},"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 7669/50490 objects degraded (15.189%), 5 pgs degraded","count":5},"muted":false}},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":2469,"monmap":{"epoch":3,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":717,"num_osds":12,"num_up_osds":11,"osd_up_since":1712001356,"num_in_osds":10,"osd_in_since":1712001380,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":12},{"state_name":"active+recovering+degraded","count":5}],"num_pgs":17,"num_pools":2,"num_objects":25245,"data_bytes":1654850104,"bytes_used":8963608576,"bytes_avail":950986747904,"bytes_total":959950356480,"degraded_objects":7669,"degraded_total":50490,"degraded_ratio":0.15189146365616954,"recovering_objects_per_sec":316,"recovering_bytes_per_sec":20771918,"recovering_keys_per_sec":0,"num_objects_recovered":2813,"num_bytes_recovered":184352768,"num_keys_recovered":0,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":905},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["cephadm","dashboard","iostat","nfs","restful"],"services":{"dashboard":"https://172.21.15.22:8443/"}},"servicemap":{"epoch":50,"modified":"2024-04-01T19:56:43.370770+0000","services":{}},"progress_events":{}} 2024-04-01T19:58:41.293 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:41.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:41 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2831395378' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-04-01T19:58:41.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:41 smithi022 ceph-mon[39439]: pgmap v1972: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1.3 GiB data, 8.0 GiB used, 886 GiB / 894 GiB avail; 0 B/s wr, 1.04k op/s; 6494/42680 objects degraded (15.216%); 20 MiB/s, 321 objects/s recovering 2024-04-01T19:58:41.830 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:41 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2831395378' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-04-01T19:58:41.830 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:41 smithi062 ceph-mon[44211]: pgmap v1972: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1.3 GiB data, 8.0 GiB used, 886 GiB / 894 GiB avail; 0 B/s wr, 1.04k op/s; 6494/42680 objects degraded (15.216%); 20 MiB/s, 321 objects/s recovering 2024-04-01T19:58:41.882 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:41 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2831395378' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-04-01T19:58:41.883 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:41 smithi188 ceph-mon[43939]: pgmap v1972: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1.3 GiB data, 8.0 GiB used, 886 GiB / 894 GiB avail; 0 B/s wr, 1.04k op/s; 6494/42680 objects degraded (15.216%); 20 MiB/s, 321 objects/s recovering 2024-04-01T19:58:41.978 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:58:42.115 INFO:tasks.cephadm.ceph_manager.ceph:making progress, resetting timeout 2024-04-01T19:58:42.115 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:58:42.394 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:58:43.050 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:58:44.674 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:58:44.678 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:44.678 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:58:44.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:44 smithi062 ceph-mon[44211]: pgmap v1973: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1.3 GiB data, 7.9 GiB used, 886 GiB / 894 GiB avail; 0 B/s wr, 1.04k op/s; 6212/41548 objects degraded (14.951%); 22 MiB/s, 357 objects/s recovering 2024-04-01T19:58:44.780 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:58:44.811 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:44 smithi022 ceph-mon[39439]: pgmap v1973: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1.3 GiB data, 7.9 GiB used, 886 GiB / 894 GiB avail; 0 B/s wr, 1.04k op/s; 6212/41548 objects degraded (14.951%); 22 MiB/s, 357 objects/s recovering 2024-04-01T19:58:44.813 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:44.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:44 smithi188 ceph-mon[43939]: pgmap v1973: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1.3 GiB data, 7.9 GiB used, 886 GiB / 894 GiB avail; 0 B/s wr, 1.04k op/s; 6212/41548 objects degraded (14.951%); 22 MiB/s, 357 objects/s recovering 2024-04-01T19:58:45.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:45 smithi062 ceph-mon[44211]: pgmap v1974: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1.2 GiB data, 7.8 GiB used, 886 GiB / 894 GiB avail; 0 B/s wr, 665 op/s; 6212/40386 objects degraded (15.382%); 11 MiB/s, 182 objects/s recovering 2024-04-01T19:58:45.767 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:58:45.774 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:45 smithi022 ceph-mon[39439]: pgmap v1974: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1.2 GiB data, 7.8 GiB used, 886 GiB / 894 GiB avail; 0 B/s wr, 665 op/s; 6212/40386 objects degraded (15.382%); 11 MiB/s, 182 objects/s recovering 2024-04-01T19:58:45.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:45 smithi188 ceph-mon[43939]: pgmap v1974: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1.2 GiB data, 7.8 GiB used, 886 GiB / 894 GiB avail; 0 B/s wr, 665 op/s; 6212/40386 objects degraded (15.382%); 11 MiB/s, 182 objects/s recovering 2024-04-01T19:58:46.048 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:58:46.049 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:46.049 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:58:46.150 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:58:46.193 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:46.226 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:58:46.230 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:46.231 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:58:46.331 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:58:46.375 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:46.403 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:58:46.405 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:46.406 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:58:46.480 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:46 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 6212/40386 objects degraded (15.382%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:46.481 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:46 smithi188 ceph-mon[43939]: osdmap e718: 12 total, 11 up, 10 in 2024-04-01T19:58:46.507 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:58:46.548 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:46.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:46 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 6212/40386 objects degraded (15.382%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:46.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:46 smithi062 ceph-mon[44211]: osdmap e718: 12 total, 11 up, 10 in 2024-04-01T19:58:46.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:46 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 6212/40386 objects degraded (15.382%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:46.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:46 smithi022 ceph-mon[39439]: osdmap e718: 12 total, 11 up, 10 in 2024-04-01T19:58:47.013 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:58:47.017 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:58:47.021 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:47.021 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:58:47.122 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:58:47.167 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:47.193 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:58:47.200 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:47.200 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:58:47.301 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:58:47.343 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:47.544 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:47 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:58:47.544 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:47 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:58:47.544 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:47 smithi188 ceph-mon[43939]: osdmap e719: 12 total, 11 up, 10 in 2024-04-01T19:58:47.544 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:47 smithi188 ceph-mon[43939]: pgmap v1977: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1022 MiB data, 7.5 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 1.21k op/s; 4681/32700 objects degraded (14.315%); 27 MiB/s, 434 objects/s recovering 2024-04-01T19:58:47.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:47 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:58:47.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:47 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:58:47.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:47 smithi022 ceph-mon[39439]: osdmap e719: 12 total, 11 up, 10 in 2024-04-01T19:58:47.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:47 smithi022 ceph-mon[39439]: pgmap v1977: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1022 MiB data, 7.5 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 1.21k op/s; 4681/32700 objects degraded (14.315%); 27 MiB/s, 434 objects/s recovering 2024-04-01T19:58:47.698 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:58:47.702 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:47.702 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:58:47.803 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:58:47.849 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:48.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:47 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:58:48.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:47 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:58:48.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:47 smithi062 ceph-mon[44211]: osdmap e719: 12 total, 11 up, 10 in 2024-04-01T19:58:48.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:47 smithi062 ceph-mon[44211]: pgmap v1977: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1022 MiB data, 7.5 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 1.21k op/s; 4681/32700 objects degraded (14.315%); 27 MiB/s, 434 objects/s recovering 2024-04-01T19:58:48.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:48 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:58:48.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:48 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:58:48.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:48 smithi022 ceph-mon[39439]: osdmap e720: 12 total, 11 up, 10 in 2024-04-01T19:58:48.723 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:58:48.754 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:58:48.785 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:58:48.821 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:48 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:58:48.821 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:48 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:58:48.821 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:48 smithi062 ceph-mon[44211]: osdmap e720: 12 total, 11 up, 10 in 2024-04-01T19:58:48.826 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:58:48.855 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:58:48.859 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:48.860 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:58:48.861 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:58:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:48 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:58:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:48 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:58:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:48 smithi188 ceph-mon[43939]: osdmap e720: 12 total, 11 up, 10 in 2024-04-01T19:58:48.908 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:58:48.953 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:58:48.961 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:58:48.976 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:58:49.012 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:58:49.015 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:49.045 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:58:49.081 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:58:49.081 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:58:49.081 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:58:49.081 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:58:49.081 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:58:49.081 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:58:49.082 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:58:49.082 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:58:49.082 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:58:49.082 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:58:49.082 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:58:49.082 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.10 2024-04-01T19:58:49.082 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:58:49.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:49 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:58:49.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:49 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:58:49.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:49 smithi022 ceph-mon[39439]: osdmap e721: 12 total, 11 up, 10 in 2024-04-01T19:58:49.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:49 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1064468713' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:58:49.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:49.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:49.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:49.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:49.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:49.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:49 smithi022 ceph-mon[39439]: pgmap v1980: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1005 MiB data, 7.4 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 1.03k op/s; 4681/32132 objects degraded (14.568%); 24 MiB/s, 382 objects/s recovering 2024-04-01T19:58:49.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:49 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:58:49.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:49 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:58:49.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:49 smithi188 ceph-mon[43939]: osdmap e721: 12 total, 11 up, 10 in 2024-04-01T19:58:49.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:49 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1064468713' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:58:49.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:49.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:49.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:49.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:49.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:49.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:49 smithi188 ceph-mon[43939]: pgmap v1980: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1005 MiB data, 7.4 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 1.03k op/s; 4681/32132 objects degraded (14.568%); 24 MiB/s, 382 objects/s recovering 2024-04-01T19:58:50.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:49 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:58:50.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:49 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:58:50.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:49 smithi062 ceph-mon[44211]: osdmap e721: 12 total, 11 up, 10 in 2024-04-01T19:58:50.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:49 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1064468713' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:58:50.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:50.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:50.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:50.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:50.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:50.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:49 smithi062 ceph-mon[44211]: pgmap v1980: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 1005 MiB data, 7.4 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 1.03k op/s; 4681/32132 objects degraded (14.568%); 24 MiB/s, 382 objects/s recovering 2024-04-01T19:58:50.306 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:58:50.309 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:50.309 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:58:50.410 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:58:50.457 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:50.487 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:58:50.499 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:50.499 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:58:50.579 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:50.580 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:50.580 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:50.580 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:50.580 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:50.580 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:50.580 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:50 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 4681/32132 objects degraded (14.568%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:50.580 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:50 smithi022 ceph-mon[39439]: osdmap e722: 12 total, 11 up, 10 in 2024-04-01T19:58:50.600 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:58:50.639 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:50.665 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:58:50.667 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:50.668 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:58:50.769 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:58:50.820 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:50.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:50.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:50.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:50.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:50.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:50.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:50.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:50 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 4681/32132 objects degraded (14.568%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:50.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:50 smithi188 ceph-mon[43939]: osdmap e722: 12 total, 11 up, 10 in 2024-04-01T19:58:51.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:51.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:51.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:51.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:51.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:51.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:51.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:50 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 4681/32132 objects degraded (14.568%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:51.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:50 smithi062 ceph-mon[44211]: osdmap e722: 12 total, 11 up, 10 in 2024-04-01T19:58:51.510 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:58:51.513 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:51.514 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:58:51.615 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:58:51.671 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:51.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:51 smithi062 ceph-mon[44211]: pgmap v1982: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 745 MiB data, 7.1 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 971 op/s; 3313/23830 objects degraded (13.903%); 21 MiB/s, 339 objects/s recovering 2024-04-01T19:58:51.767 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:58:51.770 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:51.770 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:58:51.824 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:51 smithi022 ceph-mon[39439]: pgmap v1982: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 745 MiB data, 7.1 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 971 op/s; 3313/23830 objects degraded (13.903%); 21 MiB/s, 339 objects/s recovering 2024-04-01T19:58:51.871 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:58:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:51 smithi188 ceph-mon[43939]: pgmap v1982: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 745 MiB data, 7.1 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 971 op/s; 3313/23830 objects degraded (13.903%); 21 MiB/s, 339 objects/s recovering 2024-04-01T19:58:51.917 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:51.949 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:58:51.962 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:51.962 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:58:52.063 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:58:52.126 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:52.162 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:58:52.165 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:52.166 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:58:52.267 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:58:52.310 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:52.335 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:58:52.335 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:58:52.336 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:58:52.342 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:52.342 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:58:52.373 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T19:58:52.373 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 20, 2024-04-01T19:58:52.373 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 600, 2024-04-01T19:58:52.373 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T19:58:52.373 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.373 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:31454 7.7 7:e549ac6c:::benchmark_data_smithi188_147022_object31453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:58:52.373 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:45.948019+0000", 2024-04-01T19:58:52.373 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 546.42388105400005, 2024-04-01T19:58:52.374 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.20546144499999999, 2024-04-01T19:58:52.374 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:58:52.374 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:58:52.374 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:52.374 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:58:52.374 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:58:52.374 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:58:52.374 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 31454 2024-04-01T19:58:52.374 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.374 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:58:52.374 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.374 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:58:52.374 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.948019+0000", 2024-04-01T19:58:52.374 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.375 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.375 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.375 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:58:52.375 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.948019+0000", 2024-04-01T19:58:52.375 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.375 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.375 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.375 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:58:52.375 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.948020+0000", 2024-04-01T19:58:52.375 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.124e-06 2024-04-01T19:58:52.375 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.375 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.375 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:58:52.375 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.948089+0000", 2024-04-01T19:58:52.375 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9233999999999995e-05 2024-04-01T19:58:52.375 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.376 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.376 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:58:52.376 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.948102+0000", 2024-04-01T19:58:52.376 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2887e-05 2024-04-01T19:58:52.376 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.376 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.376 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:58:52.376 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.948110+0000", 2024-04-01T19:58:52.376 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.2630000000000003e-06 2024-04-01T19:58:52.376 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.376 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.376 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:58:52.376 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.948181+0000", 2024-04-01T19:58:52.376 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.0549999999999994e-05 2024-04-01T19:58:52.376 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.377 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.377 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:58:52.377 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.948308+0000", 2024-04-01T19:58:52.377 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012682399999999999 2024-04-01T19:58:52.377 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.377 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.377 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T19:58:52.377 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.948454+0000", 2024-04-01T19:58:52.377 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014685800000000001 2024-04-01T19:58:52.377 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.377 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.377 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:58:52.377 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.949548+0000", 2024-04-01T19:58:52.377 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.001093388 2024-04-01T19:58:52.377 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.378 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.378 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:52.378 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.153411+0000", 2024-04-01T19:58:52.378 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.20386356 2024-04-01T19:58:52.378 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.378 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.378 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:58:52.378 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.153450+0000", 2024-04-01T19:58:52.378 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8760000000000002e-05 2024-04-01T19:58:52.378 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.378 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.378 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:58:52.378 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.153480+0000", 2024-04-01T19:58:52.378 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.9997000000000001e-05 2024-04-01T19:58:52.378 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.379 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:58:52.379 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.379 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.379 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.379 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:31485 7.7 7:eb292cd5:::benchmark_data_smithi188_147022_object31484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:58:52.379 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:45.957753+0000", 2024-04-01T19:58:52.379 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 546.41414663299997, 2024-04-01T19:58:52.379 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.196695432, 2024-04-01T19:58:52.379 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:58:52.379 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:58:52.379 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:52.379 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:58:52.379 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:58:52.379 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:58:52.379 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 31485 2024-04-01T19:58:52.380 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.380 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:58:52.380 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.380 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:58:52.380 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.957753+0000", 2024-04-01T19:58:52.380 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.380 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.380 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.380 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:58:52.380 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.957753+0000", 2024-04-01T19:58:52.380 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.380 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.380 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.380 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:58:52.380 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.957755+0000", 2024-04-01T19:58:52.381 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4780000000000001e-06 2024-04-01T19:58:52.381 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.381 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.381 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:58:52.381 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.957856+0000", 2024-04-01T19:58:52.381 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000101314 2024-04-01T19:58:52.381 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.381 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.381 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:58:52.381 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.957866+0000", 2024-04-01T19:58:52.381 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0087e-05 2024-04-01T19:58:52.381 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.381 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.381 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:58:52.381 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.957872+0000", 2024-04-01T19:58:52.382 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.4729999999999999e-06 2024-04-01T19:58:52.382 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.382 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.382 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:58:52.382 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.957928+0000", 2024-04-01T19:58:52.382 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6716999999999999e-05 2024-04-01T19:58:52.382 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.382 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.382 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:58:52.382 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.958061+0000", 2024-04-01T19:58:52.382 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000132559 2024-04-01T19:58:52.382 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.382 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.382 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T19:58:52.382 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.958210+0000", 2024-04-01T19:58:52.382 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000149698 2024-04-01T19:58:52.383 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.383 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.383 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:58:52.383 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.960306+0000", 2024-04-01T19:58:52.383 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0020952179999999998 2024-04-01T19:58:52.383 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.383 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.383 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:52.383 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.154374+0000", 2024-04-01T19:58:52.383 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.194068713 2024-04-01T19:58:52.383 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.383 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.383 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:58:52.383 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.154409+0000", 2024-04-01T19:58:52.383 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.4995e-05 2024-04-01T19:58:52.384 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.384 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.384 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:58:52.384 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.154449+0000", 2024-04-01T19:58:52.384 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9180000000000001e-05 2024-04-01T19:58:52.384 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.384 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:58:52.384 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.384 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.384 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.384 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:31488 7.7 7:eb7e4340:::benchmark_data_smithi188_147022_object31487:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:58:52.384 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:45.957937+0000", 2024-04-01T19:58:52.384 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 546.41396323200001, 2024-04-01T19:58:52.384 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.19660248599999999, 2024-04-01T19:58:52.384 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:58:52.384 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:58:52.385 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:52.385 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:58:52.385 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:58:52.385 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:58:52.385 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 31488 2024-04-01T19:58:52.385 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.385 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:58:52.385 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.385 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:58:52.385 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.957937+0000", 2024-04-01T19:58:52.385 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.385 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.385 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.385 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:58:52.385 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.957937+0000", 2024-04-01T19:58:52.386 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.386 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.386 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.386 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:58:52.386 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.957941+0000", 2024-04-01T19:58:52.386 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0169999999999998e-06 2024-04-01T19:58:52.386 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.386 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.386 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:58:52.386 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.957998+0000", 2024-04-01T19:58:52.386 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7416000000000001e-05 2024-04-01T19:58:52.386 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.387 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.387 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:58:52.387 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.958009+0000", 2024-04-01T19:58:52.387 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1147e-05 2024-04-01T19:58:52.387 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.387 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.387 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:58:52.387 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.958013+0000", 2024-04-01T19:58:52.387 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0960000000000003e-06 2024-04-01T19:58:52.387 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.387 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.387 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:58:52.387 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.959281+0000", 2024-04-01T19:58:52.387 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0012678660000000001 2024-04-01T19:58:52.387 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.388 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.388 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:58:52.388 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.959399+0000", 2024-04-01T19:58:52.388 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000118014 2024-04-01T19:58:52.388 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.388 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.388 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T19:58:52.388 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.959524+0000", 2024-04-01T19:58:52.388 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012448099999999999 2024-04-01T19:58:52.388 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.388 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.388 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:58:52.388 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.960426+0000", 2024-04-01T19:58:52.389 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00090252799999999999 2024-04-01T19:58:52.389 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.389 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.389 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:52.389 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.154484+0000", 2024-04-01T19:58:52.389 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.19405744999999999 2024-04-01T19:58:52.389 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.389 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.389 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:58:52.389 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.154516+0000", 2024-04-01T19:58:52.389 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.2778999999999999e-05 2024-04-01T19:58:52.389 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.389 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.389 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:58:52.390 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.154539+0000", 2024-04-01T19:58:52.390 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.2691999999999999e-05 2024-04-01T19:58:52.390 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.390 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:58:52.390 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.390 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.390 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.390 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:31536 7.7 7:e6abc489:::benchmark_data_smithi188_147022_object31535:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:58:52.390 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:45.970575+0000", 2024-04-01T19:58:52.390 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 546.40132516899996, 2024-04-01T19:58:52.390 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.18439016699999999, 2024-04-01T19:58:52.390 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:58:52.390 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:58:52.390 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:52.391 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:58:52.391 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:58:52.391 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:58:52.391 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 31536 2024-04-01T19:58:52.391 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.391 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:58:52.391 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.391 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:58:52.391 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.970575+0000", 2024-04-01T19:58:52.391 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.391 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.391 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.391 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:58:52.391 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.970575+0000", 2024-04-01T19:58:52.391 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.392 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.392 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.392 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:58:52.392 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.970576+0000", 2024-04-01T19:58:52.392 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.8199999999999998e-07 2024-04-01T19:58:52.392 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.392 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.392 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:58:52.392 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.970651+0000", 2024-04-01T19:58:52.392 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.5970000000000006e-05 2024-04-01T19:58:52.392 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.392 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.392 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:58:52.392 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.970663+0000", 2024-04-01T19:58:52.392 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1704e-05 2024-04-01T19:58:52.392 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.393 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.393 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:58:52.393 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.970677+0000", 2024-04-01T19:58:52.393 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3720000000000001e-05 2024-04-01T19:58:52.393 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.393 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.393 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:58:52.393 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.970734+0000", 2024-04-01T19:58:52.393 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6851000000000002e-05 2024-04-01T19:58:52.393 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.393 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.393 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:58:52.393 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.970815+0000", 2024-04-01T19:58:52.393 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.1201999999999999e-05 2024-04-01T19:58:52.393 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.393 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.394 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T19:58:52.394 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.970907+0000", 2024-04-01T19:58:52.394 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1936999999999997e-05 2024-04-01T19:58:52.394 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.394 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.394 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:58:52.394 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.973109+0000", 2024-04-01T19:58:52.394 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0022020780000000001 2024-04-01T19:58:52.394 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.394 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.394 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:52.394 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.154867+0000", 2024-04-01T19:58:52.394 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.18175835900000001 2024-04-01T19:58:52.394 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.395 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.395 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:58:52.395 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.154925+0000", 2024-04-01T19:58:52.395 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7853999999999999e-05 2024-04-01T19:58:52.395 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.395 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.395 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:58:52.395 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.154965+0000", 2024-04-01T19:58:52.395 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9610000000000002e-05 2024-04-01T19:58:52.395 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.395 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:58:52.395 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.395 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.395 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.395 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:31541 7.7 7:e6e3d096:::benchmark_data_smithi188_147022_object31540:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:58:52.395 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:45.971577+0000", 2024-04-01T19:58:52.396 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 546.40032249000001, 2024-04-01T19:58:52.396 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.18458508600000001, 2024-04-01T19:58:52.396 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:58:52.396 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:58:52.396 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:52.396 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:58:52.396 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:58:52.396 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:58:52.396 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 31541 2024-04-01T19:58:52.396 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.396 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:58:52.396 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.396 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:58:52.396 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.971577+0000", 2024-04-01T19:58:52.396 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.396 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.397 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.397 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:58:52.397 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.971577+0000", 2024-04-01T19:58:52.397 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.397 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.397 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.397 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:58:52.397 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.971578+0000", 2024-04-01T19:58:52.397 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0780000000000001e-06 2024-04-01T19:58:52.397 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.397 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.397 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:58:52.397 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.971641+0000", 2024-04-01T19:58:52.397 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2241000000000003e-05 2024-04-01T19:58:52.398 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.398 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.398 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:58:52.398 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.971651+0000", 2024-04-01T19:58:52.398 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.012e-05 2024-04-01T19:58:52.398 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.398 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.398 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:58:52.398 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.971656+0000", 2024-04-01T19:58:52.398 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8350000000000003e-06 2024-04-01T19:58:52.398 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.398 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.398 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:58:52.398 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.971943+0000", 2024-04-01T19:58:52.399 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00028743099999999999 2024-04-01T19:58:52.399 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.399 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.399 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:58:52.399 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.972076+0000", 2024-04-01T19:58:52.399 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013280799999999999 2024-04-01T19:58:52.399 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.399 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.399 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T19:58:52.399 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.972205+0000", 2024-04-01T19:58:52.399 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000129252 2024-04-01T19:58:52.399 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.399 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.399 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:58:52.400 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.973232+0000", 2024-04-01T19:58:52.400 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.001027427 2024-04-01T19:58:52.400 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.400 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.400 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:52.400 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.156072+0000", 2024-04-01T19:58:52.400 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.18283970899999999 2024-04-01T19:58:52.400 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.400 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.400 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:58:52.400 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.156125+0000", 2024-04-01T19:58:52.400 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2497999999999998e-05 2024-04-01T19:58:52.400 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.400 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.401 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:58:52.401 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.156162+0000", 2024-04-01T19:58:52.401 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.7687e-05 2024-04-01T19:58:52.401 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.401 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:58:52.401 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.401 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.401 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.401 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:31550 7.7 7:eeca41cf:::benchmark_data_smithi188_147022_object31549:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:58:52.401 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:45.973923+0000", 2024-04-01T19:58:52.401 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 546.39797661499995, 2024-04-01T19:58:52.401 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.18235397, 2024-04-01T19:58:52.401 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:58:52.401 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:58:52.401 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:52.402 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:58:52.402 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:58:52.402 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:58:52.402 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 31550 2024-04-01T19:58:52.402 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.402 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:58:52.402 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.402 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:58:52.402 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.973923+0000", 2024-04-01T19:58:52.402 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.402 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.402 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.402 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:58:52.402 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.973923+0000", 2024-04-01T19:58:52.403 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.403 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.403 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.403 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:58:52.403 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.973925+0000", 2024-04-01T19:58:52.403 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.6610000000000001e-06 2024-04-01T19:58:52.403 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.403 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.403 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:58:52.403 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.974030+0000", 2024-04-01T19:58:52.403 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00010470499999999999 2024-04-01T19:58:52.403 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.403 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.403 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:58:52.404 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.974042+0000", 2024-04-01T19:58:52.404 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2035000000000001e-05 2024-04-01T19:58:52.404 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.404 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.404 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:58:52.404 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.974050+0000", 2024-04-01T19:58:52.404 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.5750000000000001e-06 2024-04-01T19:58:52.404 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.404 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.404 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:58:52.404 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.974111+0000", 2024-04-01T19:58:52.404 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.0569999999999998e-05 2024-04-01T19:58:52.404 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.404 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.404 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:58:52.405 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.974221+0000", 2024-04-01T19:58:52.405 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000110485 2024-04-01T19:58:52.405 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.405 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.405 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T19:58:52.405 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.974348+0000", 2024-04-01T19:58:52.405 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012690800000000001 2024-04-01T19:58:52.405 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.405 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.405 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:58:52.405 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.975312+0000", 2024-04-01T19:58:52.405 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00096376399999999998 2024-04-01T19:58:52.405 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.405 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.405 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:52.406 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.156206+0000", 2024-04-01T19:58:52.406 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.18089391899999999 2024-04-01T19:58:52.406 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.406 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.406 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:58:52.406 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.156238+0000", 2024-04-01T19:58:52.406 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.2379000000000003e-05 2024-04-01T19:58:52.406 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.406 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.406 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:58:52.406 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.156277+0000", 2024-04-01T19:58:52.406 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8968999999999999e-05 2024-04-01T19:58:52.406 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.407 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:58:52.407 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.407 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.407 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.407 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:31572 7.7 7:e6e2beb1:::benchmark_data_smithi188_147022_object31571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:58:52.407 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:45.981256+0000", 2024-04-01T19:58:52.407 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 546.39064398999994, 2024-04-01T19:58:52.407 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.17591066299999999, 2024-04-01T19:58:52.407 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:58:52.407 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:58:52.407 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:52.407 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:58:52.407 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:58:52.407 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:58:52.407 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 31572 2024-04-01T19:58:52.407 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.408 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:58:52.408 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.408 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:58:52.408 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.981256+0000", 2024-04-01T19:58:52.408 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.408 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.408 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.408 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:58:52.408 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.981256+0000", 2024-04-01T19:58:52.408 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.408 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.408 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.408 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:58:52.408 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.981258+0000", 2024-04-01T19:58:52.408 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.4059999999999999e-06 2024-04-01T19:58:52.409 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.409 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.409 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:58:52.409 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.981322+0000", 2024-04-01T19:58:52.409 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.4028000000000004e-05 2024-04-01T19:58:52.409 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.409 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.409 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:58:52.409 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.981337+0000", 2024-04-01T19:58:52.409 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4518999999999999e-05 2024-04-01T19:58:52.409 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.409 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.409 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:58:52.409 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.981346+0000", 2024-04-01T19:58:52.410 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.7170000000000003e-06 2024-04-01T19:58:52.410 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.410 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.410 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:58:52.410 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.981394+0000", 2024-04-01T19:58:52.410 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7902999999999999e-05 2024-04-01T19:58:52.410 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.410 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.410 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:58:52.410 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.981523+0000", 2024-04-01T19:58:52.410 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000128658 2024-04-01T19:58:52.410 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.410 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.410 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T19:58:52.411 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.981685+0000", 2024-04-01T19:58:52.411 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00016220199999999999 2024-04-01T19:58:52.411 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.411 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.411 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:58:52.411 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.982734+0000", 2024-04-01T19:58:52.411 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0010491070000000001 2024-04-01T19:58:52.411 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.411 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.411 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:52.411 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.157109+0000", 2024-04-01T19:58:52.411 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.17437504100000001 2024-04-01T19:58:52.411 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.411 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.411 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:58:52.412 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.157143+0000", 2024-04-01T19:58:52.412 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.3319999999999999e-05 2024-04-01T19:58:52.412 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.412 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.412 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:58:52.412 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.157166+0000", 2024-04-01T19:58:52.412 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3762000000000001e-05 2024-04-01T19:58:52.412 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.412 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:58:52.412 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.412 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.412 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.412 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:31589 7.7 7:ece83e20:::benchmark_data_smithi188_147022_object31588:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e565)", 2024-04-01T19:58:52.412 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:49:45.986038+0000", 2024-04-01T19:58:52.412 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 546.38586187700002, 2024-04-01T19:58:52.413 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.171304445, 2024-04-01T19:58:52.413 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:58:52.413 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:58:52.413 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:52.413 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:58:52.413 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:58:52.413 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:58:52.413 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 31589 2024-04-01T19:58:52.413 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.413 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:58:52.413 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.414 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:58:52.414 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.986038+0000", 2024-04-01T19:58:52.414 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.414 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.414 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.414 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:58:52.414 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.986038+0000", 2024-04-01T19:58:52.414 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.414 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.414 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.414 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:58:52.414 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.986039+0000", 2024-04-01T19:58:52.414 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1930000000000001e-06 2024-04-01T19:58:52.414 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.415 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.415 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:58:52.415 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.986139+0000", 2024-04-01T19:58:52.415 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.9622000000000003e-05 2024-04-01T19:58:52.415 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.415 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.415 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:58:52.415 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.986147+0000", 2024-04-01T19:58:52.415 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.7849999999999992e-06 2024-04-01T19:58:52.415 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.415 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.415 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:58:52.415 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.986151+0000", 2024-04-01T19:58:52.415 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7849999999999999e-06 2024-04-01T19:58:52.415 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.416 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.416 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:58:52.416 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.986192+0000", 2024-04-01T19:58:52.416 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0917000000000001e-05 2024-04-01T19:58:52.416 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.416 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.416 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:58:52.416 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.986275+0000", 2024-04-01T19:58:52.416 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.3058000000000003e-05 2024-04-01T19:58:52.416 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.416 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.416 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T19:58:52.416 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.986371+0000", 2024-04-01T19:58:52.416 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.5489999999999995e-05 2024-04-01T19:58:52.416 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.416 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.417 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:58:52.417 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:45.987564+0000", 2024-04-01T19:58:52.417 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0011932119999999999 2024-04-01T19:58:52.417 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.417 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.417 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:52.417 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.157268+0000", 2024-04-01T19:58:52.417 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.169704366 2024-04-01T19:58:52.417 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.417 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.417 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:58:52.417 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.157301+0000", 2024-04-01T19:58:52.417 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.2382999999999998e-05 2024-04-01T19:58:52.417 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.417 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.418 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:58:52.418 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:49:46.157342+0000", 2024-04-01T19:58:52.418 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.1634000000000002e-05 2024-04-01T19:58:52.418 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.418 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:58:52.418 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.418 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.418 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.418 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:228671 7.c 7:30fe35dd:::benchmark_data_smithi188_147022_object59027:head [delete] snapc 0=[] ondisk+write+known_if_redirected e597)", 2024-04-01T19:58:52.418 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:52:00.034527+0000", 2024-04-01T19:58:52.418 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 412.33737286500002, 2024-04-01T19:58:52.418 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.166259556, 2024-04-01T19:58:52.418 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:58:52.419 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:58:52.419 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:52.419 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:58:52.419 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:58:52.419 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:58:52.419 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 228671 2024-04-01T19:58:52.419 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.419 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:58:52.419 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.419 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:58:52.419 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:00.034527+0000", 2024-04-01T19:58:52.419 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.419 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.419 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.420 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:58:52.420 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:00.034527+0000", 2024-04-01T19:58:52.420 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.420 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.420 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.420 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:58:52.420 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:00.034528+0000", 2024-04-01T19:58:52.420 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.4399999999999999e-07 2024-04-01T19:58:52.420 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.420 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.420 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:58:52.420 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:00.034531+0000", 2024-04-01T19:58:52.420 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.36e-06 2024-04-01T19:58:52.421 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.421 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.421 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:58:52.421 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:00.034538+0000", 2024-04-01T19:58:52.421 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.4180000000000002e-06 2024-04-01T19:58:52.421 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.421 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.421 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:58:52.421 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:00.034543+0000", 2024-04-01T19:58:52.421 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8130000000000001e-06 2024-04-01T19:58:52.421 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.421 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.421 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:58:52.421 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:00.101435+0000", 2024-04-01T19:58:52.421 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.066891439999999996 2024-04-01T19:58:52.422 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.422 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.422 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:58:52.422 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:00.101567+0000", 2024-04-01T19:58:52.422 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000132092 2024-04-01T19:58:52.422 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.422 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.422 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:58:52.422 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:00.101709+0000", 2024-04-01T19:58:52.422 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014219300000000001 2024-04-01T19:58:52.422 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.422 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.422 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:58:52.422 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:00.109735+0000", 2024-04-01T19:58:52.423 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.008026399 2024-04-01T19:58:52.423 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.423 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.423 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:52.423 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:00.200682+0000", 2024-04-01T19:58:52.423 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.090946777000000006 2024-04-01T19:58:52.423 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.423 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.423 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:58:52.423 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:00.200726+0000", 2024-04-01T19:58:52.423 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3364e-05 2024-04-01T19:58:52.423 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.423 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.423 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:58:52.423 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:00.200786+0000", 2024-04-01T19:58:52.424 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.0856000000000001e-05 2024-04-01T19:58:52.424 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.424 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:58:52.424 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.424 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.424 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.424 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:243128 7.c 7:3600df1b:::benchmark_data_smithi188_147022_object73484:head [delete] snapc 0=[] ondisk+write+known_if_redirected e601)", 2024-04-01T19:58:52.424 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:52:12.356620+0000", 2024-04-01T19:58:52.424 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 400.01527955400002, 2024-04-01T19:58:52.424 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.23430883699999999, 2024-04-01T19:58:52.424 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:58:52.424 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:58:52.424 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:52.424 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:58:52.424 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:58:52.424 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:58:52.425 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 243128 2024-04-01T19:58:52.425 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.425 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:58:52.425 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.425 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:58:52.425 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.356620+0000", 2024-04-01T19:58:52.425 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.425 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.425 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.425 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:58:52.425 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.356620+0000", 2024-04-01T19:58:52.425 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.425 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.425 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.425 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:58:52.426 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.356623+0000", 2024-04-01T19:58:52.426 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.2649999999999999e-06 2024-04-01T19:58:52.426 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.426 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.426 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:58:52.426 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.356628+0000", 2024-04-01T19:58:52.426 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3369999999999999e-06 2024-04-01T19:58:52.426 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.426 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.426 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:58:52.426 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.356640+0000", 2024-04-01T19:58:52.426 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1747e-05 2024-04-01T19:58:52.426 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.426 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.427 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:58:52.427 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.356648+0000", 2024-04-01T19:58:52.427 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.106e-06 2024-04-01T19:58:52.427 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.427 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.427 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:58:52.427 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.356707+0000", 2024-04-01T19:58:52.427 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8986000000000001e-05 2024-04-01T19:58:52.427 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.427 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.427 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:58:52.427 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.356841+0000", 2024-04-01T19:58:52.427 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013432799999999999 2024-04-01T19:58:52.427 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.427 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.427 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:58:52.428 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.356919+0000", 2024-04-01T19:58:52.428 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.8295999999999997e-05 2024-04-01T19:58:52.428 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.428 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.428 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:58:52.428 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.364158+0000", 2024-04-01T19:58:52.428 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0072384930000000004 2024-04-01T19:58:52.428 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.428 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.428 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:52.428 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.590851+0000", 2024-04-01T19:58:52.428 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.22669340399999999 2024-04-01T19:58:52.428 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.428 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.428 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:58:52.428 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.590890+0000", 2024-04-01T19:58:52.429 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9155e-05 2024-04-01T19:58:52.429 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.429 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.429 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:58:52.429 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.590929+0000", 2024-04-01T19:58:52.429 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8720000000000002e-05 2024-04-01T19:58:52.429 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.429 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:58:52.429 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.429 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.429 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.429 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:243130 7.c 7:3068e762:::benchmark_data_smithi188_147022_object73486:head [delete] snapc 0=[] ondisk+write+known_if_redirected e601)", 2024-04-01T19:58:52.429 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:52:12.357461+0000", 2024-04-01T19:58:52.429 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 400.01443893499999, 2024-04-01T19:58:52.429 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.23950650100000001, 2024-04-01T19:58:52.430 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:58:52.430 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:58:52.430 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:52.430 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:58:52.430 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:58:52.430 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:58:52.430 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 243130 2024-04-01T19:58:52.430 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.430 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:58:52.430 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.430 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:58:52.430 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.357461+0000", 2024-04-01T19:58:52.430 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.431 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.431 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.431 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:58:52.431 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.357461+0000", 2024-04-01T19:58:52.431 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.431 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.431 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.431 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:58:52.431 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.357462+0000", 2024-04-01T19:58:52.431 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.452e-06 2024-04-01T19:58:52.431 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.431 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.431 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:58:52.432 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.357467+0000", 2024-04-01T19:58:52.432 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9790000000000001e-06 2024-04-01T19:58:52.432 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.432 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.432 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:58:52.432 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.357480+0000", 2024-04-01T19:58:52.432 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2631e-05 2024-04-01T19:58:52.432 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.432 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.432 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:58:52.432 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.357487+0000", 2024-04-01T19:58:52.432 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.3730000000000004e-06 2024-04-01T19:58:52.432 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.433 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.433 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:58:52.433 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.360515+0000", 2024-04-01T19:58:52.433 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0030279450000000002 2024-04-01T19:58:52.433 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.433 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.433 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:58:52.433 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.360595+0000", 2024-04-01T19:58:52.433 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9380000000000002e-05 2024-04-01T19:58:52.433 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.433 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.433 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:58:52.433 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.360684+0000", 2024-04-01T19:58:52.433 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.9339000000000006e-05 2024-04-01T19:58:52.434 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.434 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.434 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:58:52.434 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.364275+0000", 2024-04-01T19:58:52.434 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0035907489999999999 2024-04-01T19:58:52.434 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.434 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.434 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:52.434 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.596897+0000", 2024-04-01T19:58:52.434 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.23262228600000001 2024-04-01T19:58:52.434 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.434 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.434 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:58:52.434 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.596934+0000", 2024-04-01T19:58:52.435 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.7115e-05 2024-04-01T19:58:52.435 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.435 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.435 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:58:52.435 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.596967+0000", 2024-04-01T19:58:52.435 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.3251999999999999e-05 2024-04-01T19:58:52.435 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.435 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:58:52.435 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.435 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.435 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.435 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:243140 7.c 7:399ed37c:::benchmark_data_smithi188_147022_object73496:head [delete] snapc 0=[] ondisk+write+known_if_redirected e601)", 2024-04-01T19:58:52.435 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:52:12.368476+0000", 2024-04-01T19:58:52.435 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 400.00342342200003, 2024-04-01T19:58:52.435 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.23427136800000001, 2024-04-01T19:58:52.435 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:58:52.436 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:58:52.436 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:52.436 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:58:52.436 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:58:52.436 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:58:52.436 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 243140 2024-04-01T19:58:52.436 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.436 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:58:52.436 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.436 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:58:52.436 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.368476+0000", 2024-04-01T19:58:52.436 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.436 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.436 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.436 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:58:52.437 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.368476+0000", 2024-04-01T19:58:52.437 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.437 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.437 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.437 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:58:52.437 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.368479+0000", 2024-04-01T19:58:52.437 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.159e-06 2024-04-01T19:58:52.437 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.437 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.437 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:58:52.437 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.368484+0000", 2024-04-01T19:58:52.437 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6239999999999999e-06 2024-04-01T19:58:52.437 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.437 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.437 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:58:52.437 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.368496+0000", 2024-04-01T19:58:52.438 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2102e-05 2024-04-01T19:58:52.438 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.438 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.438 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:58:52.438 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.368504+0000", 2024-04-01T19:58:52.438 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.7249999999999997e-06 2024-04-01T19:58:52.438 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.438 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.438 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:58:52.438 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.368561+0000", 2024-04-01T19:58:52.438 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6805999999999998e-05 2024-04-01T19:58:52.438 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.438 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.438 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:58:52.438 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.368643+0000", 2024-04-01T19:58:52.438 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.2696999999999998e-05 2024-04-01T19:58:52.439 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.439 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.439 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:58:52.439 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.368756+0000", 2024-04-01T19:58:52.439 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00011202899999999999 2024-04-01T19:58:52.439 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.439 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.439 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:58:52.439 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.372364+0000", 2024-04-01T19:58:52.439 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0036085739999999998 2024-04-01T19:58:52.439 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.439 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.439 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:52.439 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.602679+0000", 2024-04-01T19:58:52.439 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.230314875 2024-04-01T19:58:52.440 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.440 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.440 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:58:52.440 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.602714+0000", 2024-04-01T19:58:52.440 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.4560000000000001e-05 2024-04-01T19:58:52.440 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.440 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.440 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:58:52.440 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.602748+0000", 2024-04-01T19:58:52.440 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.4217000000000001e-05 2024-04-01T19:58:52.440 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.440 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:58:52.440 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.440 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.440 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.441 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:243151 7.c 7:3d2edb53:::benchmark_data_smithi188_147022_object73507:head [delete] snapc 0=[] ondisk+write+known_if_redirected e601)", 2024-04-01T19:58:52.441 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:52:12.376747+0000", 2024-04-01T19:58:52.441 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 399.99515247699998, 2024-04-01T19:58:52.441 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.22611092799999999, 2024-04-01T19:58:52.441 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:58:52.441 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:58:52.441 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:52.441 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:58:52.441 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:58:52.441 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:58:52.441 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 243151 2024-04-01T19:58:52.441 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.441 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:58:52.441 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.441 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:58:52.441 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.376747+0000", 2024-04-01T19:58:52.442 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.442 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.442 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.442 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:58:52.442 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.376747+0000", 2024-04-01T19:58:52.442 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.442 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.442 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.442 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:58:52.442 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.376750+0000", 2024-04-01T19:58:52.442 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.2390000000000001e-06 2024-04-01T19:58:52.442 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.442 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.442 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:58:52.442 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.376756+0000", 2024-04-01T19:58:52.443 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.7259999999999996e-06 2024-04-01T19:58:52.443 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.443 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.443 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:58:52.443 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.376778+0000", 2024-04-01T19:58:52.443 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1311e-05 2024-04-01T19:58:52.443 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.443 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.443 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:58:52.443 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.376786+0000", 2024-04-01T19:58:52.443 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.4479999999999994e-06 2024-04-01T19:58:52.443 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.443 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.444 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:58:52.444 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.376844+0000", 2024-04-01T19:58:52.444 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7648000000000001e-05 2024-04-01T19:58:52.444 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.444 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.444 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:58:52.444 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.376924+0000", 2024-04-01T19:58:52.444 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0012999999999994e-05 2024-04-01T19:58:52.444 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.444 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.444 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:58:52.444 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.376994+0000", 2024-04-01T19:58:52.444 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.0630999999999995e-05 2024-04-01T19:58:52.444 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.444 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.444 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:58:52.445 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.380512+0000", 2024-04-01T19:58:52.445 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0035177609999999999 2024-04-01T19:58:52.445 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.445 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.445 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:52.445 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.602804+0000", 2024-04-01T19:58:52.445 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.222291603 2024-04-01T19:58:52.445 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.445 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.445 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:58:52.445 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.602834+0000", 2024-04-01T19:58:52.445 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.0133000000000001e-05 2024-04-01T19:58:52.445 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.445 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.445 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:58:52.445 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.602858+0000", 2024-04-01T19:58:52.446 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.4414999999999999e-05 2024-04-01T19:58:52.446 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.446 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:58:52.446 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.446 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.446 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.446 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:243157 7.c 7:3d809e55:::benchmark_data_smithi188_147022_object73513:head [delete] snapc 0=[] ondisk+write+known_if_redirected e601)", 2024-04-01T19:58:52.446 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:52:12.386493+0000", 2024-04-01T19:58:52.446 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 399.98540719499999, 2024-04-01T19:58:52.446 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.216457765, 2024-04-01T19:58:52.446 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:58:52.446 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:58:52.446 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:52.446 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:58:52.447 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:58:52.447 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:58:52.447 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 243157 2024-04-01T19:58:52.447 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.447 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:58:52.447 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.447 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:58:52.447 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.386493+0000", 2024-04-01T19:58:52.447 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.447 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.447 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.447 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:58:52.447 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.386493+0000", 2024-04-01T19:58:52.447 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.447 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.447 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.448 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:58:52.448 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.386494+0000", 2024-04-01T19:58:52.448 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.9800000000000002e-07 2024-04-01T19:58:52.448 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.448 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.448 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:58:52.448 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.386498+0000", 2024-04-01T19:58:52.448 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.2690000000000001e-06 2024-04-01T19:58:52.448 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.448 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.448 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:58:52.448 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.386506+0000", 2024-04-01T19:58:52.448 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.6119999999999999e-06 2024-04-01T19:58:52.448 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.448 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.449 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:58:52.449 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.386512+0000", 2024-04-01T19:58:52.449 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3170000000000001e-06 2024-04-01T19:58:52.449 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.449 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.449 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:58:52.449 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.386582+0000", 2024-04-01T19:58:52.449 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.0533999999999999e-05 2024-04-01T19:58:52.449 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.449 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.449 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:58:52.449 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.386657+0000", 2024-04-01T19:58:52.449 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.4967000000000002e-05 2024-04-01T19:58:52.449 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.450 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.450 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:58:52.450 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.386724+0000", 2024-04-01T19:58:52.450 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6501000000000006e-05 2024-04-01T19:58:52.450 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.450 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.450 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:58:52.450 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.389858+0000", 2024-04-01T19:58:52.450 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0031343870000000002 2024-04-01T19:58:52.450 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.450 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.450 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:52.450 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.602894+0000", 2024-04-01T19:58:52.451 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.213036111 2024-04-01T19:58:52.451 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.451 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.451 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:58:52.451 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.602923+0000", 2024-04-01T19:58:52.451 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.9149000000000002e-05 2024-04-01T19:58:52.451 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.451 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.451 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:58:52.451 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:52:12.602950+0000", 2024-04-01T19:58:52.451 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.692e-05 2024-04-01T19:58:52.451 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.451 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:58:52.451 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.451 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.452 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.452 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:329334 7.c 7:389f4bb4:::benchmark_data_smithi188_147022_object159690:head [delete] snapc 0=[] ondisk+write+known_if_redirected e622)", 2024-04-01T19:58:52.452 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:53:27.731053+0000", 2024-04-01T19:58:52.452 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 324.64084728799997, 2024-04-01T19:58:52.452 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.19616381799999999, 2024-04-01T19:58:52.452 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:58:52.452 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:58:52.452 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:52.452 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:58:52.452 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:58:52.452 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:58:52.452 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 329334 2024-04-01T19:58:52.452 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.452 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:58:52.452 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.453 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:58:52.453 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.731053+0000", 2024-04-01T19:58:52.453 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.453 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.453 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.453 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:58:52.453 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.731053+0000", 2024-04-01T19:58:52.453 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.453 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.453 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.453 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:58:52.453 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.731054+0000", 2024-04-01T19:58:52.453 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1769999999999999e-06 2024-04-01T19:58:52.453 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.453 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.453 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:58:52.454 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.731058+0000", 2024-04-01T19:58:52.454 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0080000000000004e-06 2024-04-01T19:58:52.454 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.454 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.454 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:58:52.454 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.731065+0000", 2024-04-01T19:58:52.454 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.5789999999999998e-06 2024-04-01T19:58:52.454 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.454 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.454 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:58:52.454 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.731073+0000", 2024-04-01T19:58:52.454 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9510000000000006e-06 2024-04-01T19:58:52.454 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.454 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.455 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:58:52.455 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.731123+0000", 2024-04-01T19:58:52.455 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9558000000000002e-05 2024-04-01T19:58:52.455 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.455 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.455 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:58:52.455 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.731234+0000", 2024-04-01T19:58:52.455 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00011090999999999999 2024-04-01T19:58:52.455 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.455 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.455 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:58:52.455 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.731360+0000", 2024-04-01T19:58:52.455 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000126248 2024-04-01T19:58:52.455 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.456 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.456 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:52.456 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.921941+0000", 2024-04-01T19:58:52.456 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.19058085499999999 2024-04-01T19:58:52.456 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.456 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.456 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:58:52.456 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.927143+0000", 2024-04-01T19:58:52.456 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0052024619999999997 2024-04-01T19:58:52.456 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.456 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.456 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:58:52.456 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.927173+0000", 2024-04-01T19:58:52.456 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.9485999999999999e-05 2024-04-01T19:58:52.457 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.457 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.457 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:58:52.457 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.927216+0000", 2024-04-01T19:58:52.457 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3584000000000001e-05 2024-04-01T19:58:52.457 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.457 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:58:52.457 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.457 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.457 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.457 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:329337 7.c 7:31871c04:::benchmark_data_smithi188_147022_object159693:head [delete] snapc 0=[] ondisk+write+known_if_redirected e622)", 2024-04-01T19:58:52.457 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:53:27.737976+0000", 2024-04-01T19:58:52.457 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 324.63392421899999, 2024-04-01T19:58:52.457 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.18930788300000001, 2024-04-01T19:58:52.457 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:58:52.457 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:58:52.458 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:52.458 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:58:52.458 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:58:52.458 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:58:52.458 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 329337 2024-04-01T19:58:52.458 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.458 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:58:52.458 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.458 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:58:52.458 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.737976+0000", 2024-04-01T19:58:52.458 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.458 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.458 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.458 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:58:52.458 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.737976+0000", 2024-04-01T19:58:52.459 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.459 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.459 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.459 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:58:52.459 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.737977+0000", 2024-04-01T19:58:52.459 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.288e-06 2024-04-01T19:58:52.459 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.459 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.459 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:58:52.459 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.737982+0000", 2024-04-01T19:58:52.459 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.057e-06 2024-04-01T19:58:52.459 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.459 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.459 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:58:52.459 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.737990+0000", 2024-04-01T19:58:52.459 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.6070000000000002e-06 2024-04-01T19:58:52.460 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.460 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.460 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:58:52.460 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.737996+0000", 2024-04-01T19:58:52.460 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2999999999999998e-06 2024-04-01T19:58:52.460 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.460 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.460 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:58:52.460 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.738051+0000", 2024-04-01T19:58:52.460 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.4942999999999999e-05 2024-04-01T19:58:52.460 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.460 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.460 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:58:52.460 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.738160+0000", 2024-04-01T19:58:52.460 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000109641 2024-04-01T19:58:52.461 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.461 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.461 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:58:52.461 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.738268+0000", 2024-04-01T19:58:52.461 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000107602 2024-04-01T19:58:52.461 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.461 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.461 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:52.461 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.927086+0000", 2024-04-01T19:58:52.461 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.18881805300000001 2024-04-01T19:58:52.461 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.461 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.461 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:58:52.462 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.927222+0000", 2024-04-01T19:58:52.462 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013590999999999999 2024-04-01T19:58:52.462 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.462 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.462 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:58:52.462 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.927248+0000", 2024-04-01T19:58:52.462 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.5551999999999999e-05 2024-04-01T19:58:52.462 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.462 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.462 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:58:52.462 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.927283+0000", 2024-04-01T19:58:52.462 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.5930000000000003e-05 2024-04-01T19:58:52.462 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.462 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:58:52.463 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.463 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.463 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.463 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop_reply(client.36668.0:329334 7.c e622/560 ondisk, result = 0)", 2024-04-01T19:58:52.463 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:53:27.738368+0000", 2024-04-01T19:58:52.463 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 324.63353202899998, 2024-04-01T19:58:52.463 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.183621647, 2024-04-01T19:58:52.463 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:58:52.463 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:58:52.463 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "started", 2024-04-01T19:58:52.463 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:58:52.463 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.463 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:58:52.463 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.738368+0000", 2024-04-01T19:58:52.463 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.463 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.464 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.464 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:58:52.464 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.738368+0000", 2024-04-01T19:58:52.464 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.464 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.464 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.464 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:58:52.464 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.738369+0000", 2024-04-01T19:58:52.464 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.0400000000000005e-07 2024-04-01T19:58:52.464 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.464 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.464 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:58:52.464 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.738372+0000", 2024-04-01T19:58:52.464 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.5310000000000002e-06 2024-04-01T19:58:52.465 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.465 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.465 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:58:52.465 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.738379+0000", 2024-04-01T19:58:52.465 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3280000000000002e-06 2024-04-01T19:58:52.465 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.465 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.465 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:58:52.465 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.738383+0000", 2024-04-01T19:58:52.465 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.5079999999999999e-06 2024-04-01T19:58:52.465 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.465 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.465 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:58:52.465 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.742292+0000", 2024-04-01T19:58:52.466 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0039086900000000003 2024-04-01T19:58:52.466 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.466 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.466 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:58:52.466 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.742296+0000", 2024-04-01T19:58:52.466 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.4290000000000003e-06 2024-04-01T19:58:52.466 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.466 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.466 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:58:52.466 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.921989+0000", 2024-04-01T19:58:52.466 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.179693257 2024-04-01T19:58:52.466 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.466 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:58:52.466 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.467 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.467 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.467 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:329338 7.c 7:31a980e6:::benchmark_data_smithi188_147022_object159694:head [delete] snapc 0=[] ondisk+write+known_if_redirected e622)", 2024-04-01T19:58:52.467 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:53:27.738789+0000", 2024-04-01T19:58:52.467 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 324.633110972, 2024-04-01T19:58:52.467 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.196744946, 2024-04-01T19:58:52.467 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:58:52.467 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:58:52.467 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:52.467 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:58:52.467 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:58:52.467 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:58:52.467 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 329338 2024-04-01T19:58:52.467 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.468 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:58:52.468 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.468 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:58:52.468 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.738789+0000", 2024-04-01T19:58:52.468 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.468 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.468 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.468 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:58:52.468 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.738789+0000", 2024-04-01T19:58:52.468 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.468 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.468 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.468 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:58:52.468 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.738790+0000", 2024-04-01T19:58:52.468 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.569999999999999e-07 2024-04-01T19:58:52.469 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.469 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.469 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:58:52.469 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.738794+0000", 2024-04-01T19:58:52.469 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9559999999999999e-06 2024-04-01T19:58:52.469 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.469 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.469 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:58:52.469 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.738800+0000", 2024-04-01T19:58:52.469 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2879999999999998e-06 2024-04-01T19:58:52.469 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.469 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.469 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:58:52.469 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.738804+0000", 2024-04-01T19:58:52.470 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.3789999999999999e-06 2024-04-01T19:58:52.470 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.470 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.470 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:58:52.470 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.922070+0000", 2024-04-01T19:58:52.470 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.18326556799999999 2024-04-01T19:58:52.470 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.470 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.470 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:58:52.470 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.922202+0000", 2024-04-01T19:58:52.470 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013193499999999999 2024-04-01T19:58:52.470 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.470 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.470 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T19:58:52.470 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.922334+0000", 2024-04-01T19:58:52.471 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000131662 2024-04-01T19:58:52.471 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.471 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.471 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:52.471 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.927135+0000", 2024-04-01T19:58:52.471 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0048011140000000004 2024-04-01T19:58:52.471 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.471 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.471 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:58:52.471 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.935469+0000", 2024-04-01T19:58:52.471 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0083348060000000002 2024-04-01T19:58:52.471 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.471 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.471 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:58:52.471 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.935500+0000", 2024-04-01T19:58:52.472 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.0164000000000001e-05 2024-04-01T19:58:52.472 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.472 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.472 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:58:52.472 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.935534+0000", 2024-04-01T19:58:52.472 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.4116999999999999e-05 2024-04-01T19:58:52.472 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.472 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:58:52.472 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.472 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.472 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.472 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_repop_reply(client.36668.0:329337 7.c e622/560 ondisk, result = 0)", 2024-04-01T19:58:52.472 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:53:27.743330+0000", 2024-04-01T19:58:52.472 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 324.62857016100003, 2024-04-01T19:58:52.472 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.18376652800000001, 2024-04-01T19:58:52.472 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:58:52.473 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:58:52.473 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "started", 2024-04-01T19:58:52.473 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:58:52.473 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.473 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:58:52.473 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.743330+0000", 2024-04-01T19:58:52.473 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.473 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.473 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.473 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:58:52.473 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.743330+0000", 2024-04-01T19:58:52.473 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.473 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.473 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.474 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:58:52.474 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.743332+0000", 2024-04-01T19:58:52.474 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1500000000000002e-06 2024-04-01T19:58:52.474 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.474 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.474 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:58:52.474 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.743341+0000", 2024-04-01T19:58:52.474 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1700000000000003e-06 2024-04-01T19:58:52.474 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.474 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.474 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:58:52.474 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.921964+0000", 2024-04-01T19:58:52.474 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.17862303199999999 2024-04-01T19:58:52.474 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.475 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.475 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:58:52.475 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.921984+0000", 2024-04-01T19:58:52.475 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.9769999999999999e-05 2024-04-01T19:58:52.475 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.475 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.475 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:58:52.475 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.927071+0000", 2024-04-01T19:58:52.475 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0050876109999999997 2024-04-01T19:58:52.475 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.475 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.475 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:58:52.475 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.927080+0000", 2024-04-01T19:58:52.475 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.2120000000000003e-06 2024-04-01T19:58:52.475 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.476 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.476 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:58:52.476 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.927096+0000", 2024-04-01T19:58:52.476 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.6583e-05 2024-04-01T19:58:52.476 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.476 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:58:52.476 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.476 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.476 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.476 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.36668.0:329350 7.7 7:e9fdaa95:::benchmark_data_smithi188_147022_object159706:head [delete] snapc 0=[] ondisk+write+known_if_redirected e622)", 2024-04-01T19:58:52.476 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:53:27.746293+0000", 2024-04-01T19:58:52.476 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 324.62560708299998, 2024-04-01T19:58:52.476 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.18550022999999999, 2024-04-01T19:58:52.476 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T19:58:52.476 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T19:58:52.476 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T19:58:52.477 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T19:58:52.477 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.36668", 2024-04-01T19:58:52.477 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T19:58:52.477 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 329350 2024-04-01T19:58:52.477 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.477 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T19:58:52.477 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.477 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T19:58:52.477 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.746293+0000", 2024-04-01T19:58:52.477 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.477 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.477 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.477 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T19:58:52.477 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.746293+0000", 2024-04-01T19:58:52.477 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T19:58:52.477 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.478 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.478 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T19:58:52.478 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.746294+0000", 2024-04-01T19:58:52.478 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4759999999999999e-06 2024-04-01T19:58:52.478 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.478 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.478 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T19:58:52.478 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.746298+0000", 2024-04-01T19:58:52.478 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.2320000000000003e-06 2024-04-01T19:58:52.478 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.478 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.478 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T19:58:52.478 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.921956+0000", 2024-04-01T19:58:52.478 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.175658016 2024-04-01T19:58:52.479 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.479 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.479 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T19:58:52.479 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.921988+0000", 2024-04-01T19:58:52.479 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.1486999999999999e-05 2024-04-01T19:58:52.479 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.479 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.479 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T19:58:52.479 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.922090+0000", 2024-04-01T19:58:52.479 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00010241 2024-04-01T19:58:52.479 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.479 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.479 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T19:58:52.479 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.922201+0000", 2024-04-01T19:58:52.479 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000110983 2024-04-01T19:58:52.480 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.480 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.480 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T19:58:52.480 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.922334+0000", 2024-04-01T19:58:52.480 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013221199999999999 2024-04-01T19:58:52.480 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.480 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.480 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T19:58:52.480 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.931612+0000", 2024-04-01T19:58:52.480 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0092787749999999995 2024-04-01T19:58:52.480 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.480 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.480 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T19:58:52.480 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.931690+0000", 2024-04-01T19:58:52.481 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.7286999999999994e-05 2024-04-01T19:58:52.481 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.481 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.481 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T19:58:52.481 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.931738+0000", 2024-04-01T19:58:52.481 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8316999999999998e-05 2024-04-01T19:58:52.481 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T19:58:52.481 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T19:58:52.481 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T19:58:52.481 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:53:27.931793+0000", 2024-04-01T19:58:52.481 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5034999999999997e-05 2024-04-01T19:58:52.481 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.481 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:58:52.481 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.481 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T19:58:52.481 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T19:58:52.482 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T19:58:52.482 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:58:52.519 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:52.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:52 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:58:52.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:52 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:58:52.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:52 smithi062 ceph-mon[44211]: from='client.37346 v1:172.21.15.22:0/698587637' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:58:52.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:52 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:58:52.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:52 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:58:52.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:52 smithi022 ceph-mon[39439]: from='client.37346 v1:172.21.15.22:0/698587637' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:58:52.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:52 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:58:52.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:52 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:58:52.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:52 smithi188 ceph-mon[43939]: from='client.37346 v1:172.21.15.22:0/698587637' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:58:53.143 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:58:53.143 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:58:53.383 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:58:53.386 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:53.387 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:58:53.488 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:58:53.529 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:53.574 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":1982,"stamp":"2024-04-01T19:58:51.411516+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":781255224,"num_objects":11915,"num_object_clones":0,"num_object_copies":23830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3313,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11915,"num_whiteouts":0,"num_read":127,"num_read_kb":110,"num_write":266828,"num_write_kb":8916795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":38010,"num_bytes_recovered":2492156032,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160807,"ondisk_log_size":160807,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":9,"kb":937451520,"kb_used":7483080,"kb_used_data":1452364,"kb_used_omap":889,"kb_used_meta":6029638,"kb_avail":929968440,"statfs":{"total":959950356480,"available":952287682560,"internally_reserved":0,"allocated":1487220736,"data_stored":1482672206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":910339,"internal_metadata":6174350333},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1,3,2,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-310116352,"num_objects":-4732,"num_object_clones":0,"num_object_copies":-9464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1653,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4732,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4732,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1653,"num_bytes_recovered":108331008,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.873087"},"pg_stats":[{"pgid":"8.f","version":"722'16908","reported_seq":17200,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-04-01T19:58:51.250443+0000","last_change":"2024-04-01T19:55:39.217150+0000","last_active":"2024-04-01T19:58:51.250443+0000","last_peered":"2024-04-01T19:58:51.250443+0000","last_clean":"2024-04-01T19:58:51.250443+0000","last_became_active":"2024-04-01T19:53:54.067307+0000","last_became_peered":"2024-04-01T19:53:54.067307+0000","last_unstale":"2024-04-01T19:58:51.250443+0000","last_undegraded":"2024-04-01T19:58:51.250443+0000","last_fullsized":"2024-04-01T19:58:51.250443+0000","mapping_epoch":629,"log_start":"665'6900","ondisk_log_start":"665'6900","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8876","last_scrub_stamp":"2024-04-01T19:55:39.216977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:39.216977+0000","objects_scrubbed":8773,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1863,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45481984,"num_objects":694,"num_object_clones":0,"num_object_copies":1388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":694,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16908,"num_write_kb":563264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.e","version":"722'16464","reported_seq":16752,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-04-01T19:58:50.837725+0000","last_change":"2024-04-01T19:55:33.528266+0000","last_active":"2024-04-01T19:58:50.837725+0000","last_peered":"2024-04-01T19:58:50.837725+0000","last_clean":"2024-04-01T19:58:50.837725+0000","last_became_active":"2024-04-01T19:53:54.066471+0000","last_became_peered":"2024-04-01T19:53:54.066471+0000","last_unstale":"2024-04-01T19:58:50.837725+0000","last_undegraded":"2024-04-01T19:58:50.837725+0000","last_fullsized":"2024-04-01T19:58:50.837725+0000","mapping_epoch":629,"log_start":"663'6400","ondisk_log_start":"663'6400","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'8369","last_scrub_stamp":"2024-04-01T19:55:33.528006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:33.528006+0000","objects_scrubbed":8332,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1210,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48627712,"num_objects":742,"num_object_clones":0,"num_object_copies":1484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":742,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16464,"num_write_kb":550592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"722'16997","reported_seq":17288,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-04-01T19:58:51.277608+0000","last_change":"2024-04-01T19:55:45.161755+0000","last_active":"2024-04-01T19:58:51.277608+0000","last_peered":"2024-04-01T19:58:51.277608+0000","last_clean":"2024-04-01T19:58:51.277608+0000","last_became_active":"2024-04-01T19:53:53.678991+0000","last_became_peered":"2024-04-01T19:53:53.678991+0000","last_unstale":"2024-04-01T19:58:51.277608+0000","last_undegraded":"2024-04-01T19:58:51.277608+0000","last_fullsized":"2024-04-01T19:58:51.277608+0000","mapping_epoch":629,"log_start":"665'6900","ondisk_log_start":"665'6900","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"674'9322","last_scrub_stamp":"2024-04-01T19:55:45.161618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:45.161618+0000","objects_scrubbed":8442,"log_size":10097,"log_dups_size":0,"ondisk_log_size":10097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1822,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137368,"num_objects":705,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":705,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":16997,"num_write_kb":566401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.c","version":"722'16704","reported_seq":17061,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-04-01T19:58:50.794958+0000","last_change":"2024-04-01T19:57:06.345540+0000","last_active":"2024-04-01T19:58:50.794958+0000","last_peered":"2024-04-01T19:58:50.794958+0000","last_clean":"2024-04-01T19:58:50.794958+0000","last_became_active":"2024-04-01T19:53:53.462634+0000","last_became_peered":"2024-04-01T19:53:53.462634+0000","last_unstale":"2024-04-01T19:58:50.794958+0000","last_undegraded":"2024-04-01T19:58:50.794958+0000","last_fullsized":"2024-04-01T19:58:50.794958+0000","mapping_epoch":629,"log_start":"665'6700","ondisk_log_start":"665'6700","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"695'11630","last_scrub_stamp":"2024-04-01T19:57:06.345285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:57:06.345285+0000","objects_scrubbed":5792,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:58:55.760087+0000","scrub_duration":1062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45875200,"num_objects":700,"num_object_clones":0,"num_object_copies":1400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":700,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16704,"num_write_kb":556928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"8.b","version":"721'16923","reported_seq":17324,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-04-01T19:58:49.481527+0000","last_change":"2024-04-01T19:58:04.980816+0000","last_active":"2024-04-01T19:58:49.481527+0000","last_peered":"2024-04-01T19:58:49.481527+0000","last_clean":"2024-04-01T19:58:49.481527+0000","last_became_active":"2024-04-01T19:53:53.456979+0000","last_became_peered":"2024-04-01T19:53:53.456979+0000","last_unstale":"2024-04-01T19:58:49.481527+0000","last_undegraded":"2024-04-01T19:58:49.481527+0000","last_fullsized":"2024-04-01T19:58:49.481527+0000","mapping_epoch":629,"log_start":"665'6900","ondisk_log_start":"665'6900","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"707'14413","last_scrub_stamp":"2024-04-01T19:58:04.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:58:04.980641+0000","objects_scrubbed":3325,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:59:19.064773+0000","scrub_duration":600,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52625408,"num_objects":803,"num_object_clones":0,"num_object_copies":1606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":803,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16923,"num_write_kb":567232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"8.a","version":"721'16367","reported_seq":16753,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-04-01T19:58:49.444573+0000","last_change":"2024-04-01T19:57:56.975934+0000","last_active":"2024-04-01T19:58:49.444573+0000","last_peered":"2024-04-01T19:58:49.444573+0000","last_clean":"2024-04-01T19:58:49.444573+0000","last_became_active":"2024-04-01T19:53:54.066588+0000","last_became_peered":"2024-04-01T19:53:54.066588+0000","last_unstale":"2024-04-01T19:58:49.444573+0000","last_undegraded":"2024-04-01T19:58:49.444573+0000","last_fullsized":"2024-04-01T19:58:49.444573+0000","mapping_epoch":629,"log_start":"662'6300","ondisk_log_start":"662'6300","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"706'13635","last_scrub_stamp":"2024-04-01T19:57:56.975745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:57:56.975745+0000","objects_scrubbed":3527,"log_size":10067,"log_dups_size":0,"ondisk_log_size":10067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:59:06.634758+0000","scrub_duration":583,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51445760,"num_objects":785,"num_object_clones":0,"num_object_copies":1570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":785,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16367,"num_write_kb":548864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"8.8","version":"722'16824","reported_seq":17115,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-04-01T19:58:50.998285+0000","last_change":"2024-04-01T19:55:40.424211+0000","last_active":"2024-04-01T19:58:50.998285+0000","last_peered":"2024-04-01T19:58:50.998285+0000","last_clean":"2024-04-01T19:58:50.998285+0000","last_became_active":"2024-04-01T19:53:53.454737+0000","last_became_peered":"2024-04-01T19:53:53.454737+0000","last_unstale":"2024-04-01T19:58:50.998285+0000","last_undegraded":"2024-04-01T19:58:50.998285+0000","last_fullsized":"2024-04-01T19:58:50.998285+0000","mapping_epoch":629,"log_start":"665'6800","ondisk_log_start":"665'6800","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8915","last_scrub_stamp":"2024-04-01T19:55:40.424044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:40.424044+0000","objects_scrubbed":8661,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1277,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46661632,"num_objects":712,"num_object_clones":0,"num_object_copies":1424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":712,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16824,"num_write_kb":561152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"722'16617","reported_seq":32010,"reported_epoch":722,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:58:51.301873+0000","last_change":"2024-04-01T19:56:22.028676+0000","last_active":"2024-04-01T19:58:51.301873+0000","last_peered":"2024-04-01T19:58:51.301873+0000","last_clean":"2024-04-01T19:55:56.524590+0000","last_became_active":"2024-04-01T19:56:21.981743+0000","last_became_peered":"2024-04-01T19:56:21.981743+0000","last_unstale":"2024-04-01T19:58:51.301873+0000","last_undegraded":"2024-04-01T19:56:21.738659+0000","last_fullsized":"2024-04-01T19:58:51.301873+0000","mapping_epoch":687,"log_start":"665'6600","ondisk_log_start":"665'6600","created":629,"last_epoch_clean":641,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'9008","last_scrub_stamp":"2024-04-01T19:55:43.358714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:43.358714+0000","objects_scrubbed":8387,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"no scrub is scheduled","scrub_duration":2089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46465024,"num_objects":709,"num_object_clones":0,"num_object_copies":1418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":666,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":709,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16617,"num_write_kb":554432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7546,"num_bytes_recovered":494469120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":["11"],"object_location_counts":[{"shards":"2,11","objects":43},{"shards":"11","objects":666}],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.6","version":"722'16725","reported_seq":32460,"reported_epoch":722,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:58:51.294288+0000","last_change":"2024-04-01T19:56:22.018466+0000","last_active":"2024-04-01T19:58:51.294288+0000","last_peered":"2024-04-01T19:58:51.294288+0000","last_clean":"2024-04-01T19:55:56.539057+0000","last_became_active":"2024-04-01T19:56:21.956699+0000","last_became_peered":"2024-04-01T19:56:21.956699+0000","last_unstale":"2024-04-01T19:58:51.294288+0000","last_undegraded":"2024-04-01T19:56:21.744926+0000","last_fullsized":"2024-04-01T19:58:51.294288+0000","mapping_epoch":687,"log_start":"665'6700","ondisk_log_start":"665'6700","created":629,"last_epoch_clean":642,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8615","last_scrub_stamp":"2024-04-01T19:55:36.688352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:36.688352+0000","objects_scrubbed":8556,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"no scrub is scheduled","scrub_duration":2331,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42139648,"num_objects":643,"num_object_clones":0,"num_object_copies":1286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":530,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":643,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16725,"num_write_kb":555776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7717,"num_bytes_recovered":505544704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":["11"],"object_location_counts":[{"shards":"7,11","objects":113},{"shards":"11","objects":530}],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.5","version":"719'16549","reported_seq":31516,"reported_epoch":719,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:58:46.673796+0000","last_change":"2024-04-01T19:56:22.002998+0000","last_active":"2024-04-01T19:58:46.673796+0000","last_peered":"2024-04-01T19:58:46.673796+0000","last_clean":"2024-04-01T19:55:56.434043+0000","last_became_active":"2024-04-01T19:56:21.952684+0000","last_became_peered":"2024-04-01T19:56:21.952684+0000","last_unstale":"2024-04-01T19:58:46.673796+0000","last_undegraded":"2024-04-01T19:56:21.721301+0000","last_fullsized":"2024-04-01T19:58:46.673796+0000","mapping_epoch":687,"log_start":"663'6500","ondisk_log_start":"663'6500","created":629,"last_epoch_clean":644,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'8660","last_scrub_stamp":"2024-04-01T19:55:36.183547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:36.183547+0000","objects_scrubbed":8628,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"no scrub is scheduled","scrub_duration":1673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65994752,"num_objects":1007,"num_object_clones":0,"num_object_copies":2014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1007,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1007,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16549,"num_write_kb":561792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7335,"num_bytes_recovered":480706560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":1007}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.4","version":"722'19574","reported_seq":20068,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-04-01T19:58:51.035150+0000","last_change":"2024-04-01T19:55:34.954183+0000","last_active":"2024-04-01T19:58:51.035150+0000","last_peered":"2024-04-01T19:58:51.035150+0000","last_clean":"2024-04-01T19:58:51.035150+0000","last_became_active":"2024-04-01T19:53:53.462894+0000","last_became_peered":"2024-04-01T19:53:53.462894+0000","last_unstale":"2024-04-01T19:58:51.035150+0000","last_undegraded":"2024-04-01T19:58:51.035150+0000","last_fullsized":"2024-04-01T19:58:51.035150+0000","mapping_epoch":629,"log_start":"666'9500","ondisk_log_start":"666'9500","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'11373","last_scrub_stamp":"2024-04-01T19:55:34.954011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:34.954011+0000","objects_scrubbed":8546,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46923776,"num_objects":716,"num_object_clones":0,"num_object_copies":1432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":716,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16812,"num_write_kb":560896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"722'16623","reported_seq":16886,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-04-01T19:58:51.295135+0000","last_change":"2024-04-01T19:54:55.108987+0000","last_active":"2024-04-01T19:58:51.295135+0000","last_peered":"2024-04-01T19:58:51.295135+0000","last_clean":"2024-04-01T19:58:51.295135+0000","last_became_active":"2024-04-01T19:53:53.462397+0000","last_became_peered":"2024-04-01T19:53:53.462397+0000","last_unstale":"2024-04-01T19:58:51.295135+0000","last_undegraded":"2024-04-01T19:58:51.295135+0000","last_fullsized":"2024-04-01T19:58:51.295135+0000","mapping_epoch":629,"log_start":"665'6600","ondisk_log_start":"665'6600","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"660'5871","last_scrub_stamp":"2024-04-01T19:54:55.108780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:54:55.108780+0000","objects_scrubbed":5824,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42663936,"num_objects":651,"num_object_clones":0,"num_object_copies":1302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":651,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16623,"num_write_kb":552768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.2","version":"722'16383","reported_seq":32121,"reported_epoch":722,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:58:50.853764+0000","last_change":"2024-04-01T19:56:22.018621+0000","last_active":"2024-04-01T19:58:50.853764+0000","last_peered":"2024-04-01T19:58:50.853764+0000","last_clean":"2024-04-01T19:55:56.523442+0000","last_became_active":"2024-04-01T19:56:21.981766+0000","last_became_peered":"2024-04-01T19:56:21.981766+0000","last_unstale":"2024-04-01T19:58:50.853764+0000","last_undegraded":"2024-04-01T19:56:21.720612+0000","last_fullsized":"2024-04-01T19:58:50.853764+0000","mapping_epoch":687,"log_start":"663'6300","ondisk_log_start":"663'6300","created":629,"last_epoch_clean":645,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'8353","last_scrub_stamp":"2024-04-01T19:55:34.153804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:34.153804+0000","objects_scrubbed":8295,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"no scrub is scheduled","scrub_duration":1672,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48693248,"num_objects":743,"num_object_clones":0,"num_object_copies":1486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":416,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":743,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16383,"num_write_kb":548032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7719,"num_bytes_recovered":505741312,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":416},{"shards":"0,4","objects":327}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"722'19514","reported_seq":20087,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-04-01T19:58:50.740461+0000","last_change":"2024-04-01T19:57:00.295446+0000","last_active":"2024-04-01T19:58:50.740461+0000","last_peered":"2024-04-01T19:58:50.740461+0000","last_clean":"2024-04-01T19:58:50.740461+0000","last_became_active":"2024-04-01T19:53:54.066680+0000","last_became_peered":"2024-04-01T19:53:54.066680+0000","last_unstale":"2024-04-01T19:58:50.740461+0000","last_undegraded":"2024-04-01T19:58:50.740461+0000","last_fullsized":"2024-04-01T19:58:50.740461+0000","mapping_epoch":629,"log_start":"666'9500","ondisk_log_start":"666'9500","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"694'14240","last_scrub_stamp":"2024-04-01T19:57:00.295287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:57:00.295287+0000","objects_scrubbed":6022,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:58:55.756894+0000","scrub_duration":983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47382528,"num_objects":723,"num_object_clones":0,"num_object_copies":1446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":723,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16555,"num_write_kb":552896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"8.0","version":"720'16276","reported_seq":16676,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-04-01T19:58:47.672262+0000","last_change":"2024-04-01T19:57:56.925685+0000","last_active":"2024-04-01T19:58:47.672262+0000","last_peered":"2024-04-01T19:58:47.672262+0000","last_clean":"2024-04-01T19:58:47.672262+0000","last_became_active":"2024-04-01T19:53:53.455265+0000","last_became_peered":"2024-04-01T19:53:53.455265+0000","last_unstale":"2024-04-01T19:58:47.672262+0000","last_undegraded":"2024-04-01T19:58:47.672262+0000","last_fullsized":"2024-04-01T19:58:47.672262+0000","mapping_epoch":629,"log_start":"661'6200","ondisk_log_start":"661'6200","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"706'13692","last_scrub_stamp":"2024-04-01T19:57:56.925430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:57:56.925430+0000","objects_scrubbed":3477,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:58:57.818501+0000","scrub_duration":572,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57802752,"num_objects":882,"num_object_clones":0,"num_object_copies":1764,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":882,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16276,"num_write_kb":549056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"722'16920","reported_seq":32599,"reported_epoch":722,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:58:51.046976+0000","last_change":"2024-04-01T19:56:22.004749+0000","last_active":"2024-04-01T19:58:51.046976+0000","last_peered":"2024-04-01T19:58:51.046976+0000","last_clean":"2024-04-01T19:55:56.538683+0000","last_became_active":"2024-04-01T19:56:21.960415+0000","last_became_peered":"2024-04-01T19:56:21.960415+0000","last_unstale":"2024-04-01T19:58:51.046976+0000","last_undegraded":"2024-04-01T19:56:21.714140+0000","last_fullsized":"2024-04-01T19:58:51.046976+0000","mapping_epoch":687,"log_start":"665'6900","ondisk_log_start":"665'6900","created":629,"last_epoch_clean":645,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8889","last_scrub_stamp":"2024-04-01T19:55:39.237364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:39.237364+0000","objects_scrubbed":8775,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"no scrub is scheduled","scrub_duration":1706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45744128,"num_objects":698,"num_object_clones":0,"num_object_copies":1396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":694,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":698,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16920,"num_write_kb":563776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7685,"num_bytes_recovered":503578624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":["5"],"object_location_counts":[{"shards":"0,5","objects":4},{"shards":"5","objects":694}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":1769,"reported_epoch":721,"state":"active+clean","last_fresh":"2024-04-01T19:58:48.580261+0000","last_change":"2024-04-01T19:55:33.016809+0000","last_active":"2024-04-01T19:58:48.580261+0000","last_peered":"2024-04-01T19:58:48.580261+0000","last_clean":"2024-04-01T19:58:48.580261+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:58:48.580261+0000","last_undegraded":"2024-04-01T19:58:48.580261+0000","last_fullsized":"2024-04-01T19:58:48.580261+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:55:33.016695+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:55:33.016695+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":192,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":780664856,"num_objects":11913,"num_object_clones":0,"num_object_copies":23826,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3313,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11913,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":266647,"num_write_kb":8913857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":38002,"num_bytes_recovered":2490040320,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3956875264,"data_stored":3956867120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160668,"ondisk_log_size":160668,"up":32,"acting":32,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220595,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1103060,"kb_used_data":223628,"kb_used_omap":1,"kb_used_meta":879422,"kb_avail":92642092,"statfs":{"total":95995035648,"available":94865502208,"internally_reserved":0,"allocated":228995072,"data_stored":228523855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":900528580},"hb_peers":[0,1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,1,1,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678462,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":738124,"kb_used_data":139136,"kb_used_omap":1,"kb_used_meta":598974,"kb_avail":93007028,"statfs":{"total":95995035648,"available":95239196672,"internally_reserved":0,"allocated":142475264,"data_stored":142011691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":613349824},"hb_peers":[0,1,2,3,4,5,6,7,8,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557659,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":382596,"kb_used_data":156084,"kb_used_omap":132,"kb_used_meta":226299,"kb_avail":93362556,"statfs":{"total":95995035648,"available":95603257344,"internally_reserved":0,"allocated":159830016,"data_stored":159372497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":231730919},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234440,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":678336,"kb_used_data":61300,"kb_used_omap":1,"kb_used_meta":617022,"kb_avail":93066816,"statfs":{"total":95995035648,"available":95300419584,"internally_reserved":0,"allocated":62771200,"data_stored":62312061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":631830986},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":457,"seq":1962800054452,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":253764,"kb_used_data":884,"kb_used_omap":744,"kb_used_meta":252119,"kb_avail":93491388,"statfs":{"total":95995035648,"available":95735181312,"internally_reserved":0,"allocated":905216,"data_stored":447697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":762131,"internal_metadata":258170605},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":2452426326119,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738861,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":825924,"kb_used_data":104756,"kb_used_omap":1,"kb_used_meta":721150,"kb_avail":92919228,"statfs":{"total":95995035648,"available":95149289472,"internally_reserved":0,"allocated":107270144,"data_stored":106812625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":738458053},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346401,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":837724,"kb_used_data":260944,"kb_used_omap":1,"kb_used_meta":576766,"kb_avail":92907428,"statfs":{"total":95995035648,"available":95137206272,"internally_reserved":0,"allocated":267206656,"data_stored":266767149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":590608837},"hb_peers":[0,1,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669150171,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":879596,"kb_used_data":118172,"kb_used_omap":1,"kb_used_meta":761406,"kb_avail":92865556,"statfs":{"total":95995035648,"available":95094329344,"internally_reserved":0,"allocated":121008128,"data_stored":120562617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":779680199},"hb_peers":[0,1,2,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953941,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":853464,"kb_used_data":146192,"kb_used_omap":1,"kb_used_meta":707262,"kb_avail":92891688,"statfs":{"total":95995035648,"available":95121088512,"internally_reserved":0,"allocated":149700608,"data_stored":149261101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":724236741},"hb_peers":[0,1,2,3,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790418,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":930492,"kb_used_data":241268,"kb_used_omap":1,"kb_used_meta":689214,"kb_avail":92814660,"statfs":{"total":95995035648,"available":95042211840,"internally_reserved":0,"allocated":247058432,"data_stored":246600913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":705755589},"hb_peers":[0,1,2,3,4,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":97452032,"data_stored":97452032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":253755392,"data_stored":253755392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":117768192,"data_stored":117768192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":147128320,"data_stored":147128320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":229179392,"data_stored":229179392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":58462208,"data_stored":58458136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":154861568,"data_stored":154861568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":140967936,"data_stored":140967936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":2534604800,"data_stored":2534604800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":222695424,"data_stored":222691352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:58:53.592 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:58:53.599 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:53.599 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:58:53.700 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:58:53.745 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:53.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:53 smithi062 ceph-mon[44211]: osdmap e723: 12 total, 11 up, 10 in 2024-04-01T19:58:53.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:53 smithi062 ceph-mon[44211]: pgmap v1984: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 707 MiB data, 7.0 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 859 op/s; 2986/22624 objects degraded (13.198%); 18 MiB/s, 289 objects/s recovering 2024-04-01T19:58:53.771 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:58:53.780 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:53.781 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:58:53.789 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:53 smithi022 ceph-mon[39439]: osdmap e723: 12 total, 11 up, 10 in 2024-04-01T19:58:53.789 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:53 smithi022 ceph-mon[39439]: pgmap v1984: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 707 MiB data, 7.0 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 859 op/s; 2986/22624 objects degraded (13.198%); 18 MiB/s, 289 objects/s recovering 2024-04-01T19:58:53.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:53 smithi188 ceph-mon[43939]: osdmap e723: 12 total, 11 up, 10 in 2024-04-01T19:58:53.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:53 smithi188 ceph-mon[43939]: pgmap v1984: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 707 MiB data, 7.0 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 859 op/s; 2986/22624 objects degraded (13.198%); 18 MiB/s, 289 objects/s recovering 2024-04-01T19:58:53.882 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:58:53.938 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:54.153 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:58:54.161 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:54.161 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:58:54.262 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:58:54.333 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:54.370 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:58:54.375 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:54.376 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:58:54.477 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:58:54.511 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:54.545 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:58:54.549 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:54.549 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:58:54.613 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:58:54.650 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:58:54.691 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:54.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:54 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/285297542' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:58:54.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:54 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/285297542' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:58:55.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:54 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/285297542' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:58:55.144 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:58:55.590 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:58:55.857 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:55 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:58:55.857 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:55 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/285297542' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:58:55.857 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:55 smithi022 ceph-mon[39439]: osdmap e724: 12 total, 11 up, 10 in 2024-04-01T19:58:55.857 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:55 smithi022 ceph-mon[39439]: pgmap v1986: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 667 MiB data, 6.9 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 898 op/s; 2986/21344 objects degraded (13.990%); 18 MiB/s, 282 objects/s recovering 2024-04-01T19:58:55.857 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:55 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 2986/22624 objects degraded (13.198%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:55.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:55 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:58:55.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:55 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/285297542' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:58:55.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:55 smithi188 ceph-mon[43939]: osdmap e724: 12 total, 11 up, 10 in 2024-04-01T19:58:55.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:55 smithi188 ceph-mon[43939]: pgmap v1986: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 667 MiB data, 6.9 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 898 op/s; 2986/21344 objects degraded (13.990%); 18 MiB/s, 282 objects/s recovering 2024-04-01T19:58:55.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:55 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 2986/22624 objects degraded (13.198%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:56.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:55 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:58:56.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:55 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/285297542' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:58:56.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:55 smithi062 ceph-mon[44211]: osdmap e724: 12 total, 11 up, 10 in 2024-04-01T19:58:56.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:55 smithi062 ceph-mon[44211]: pgmap v1986: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 667 MiB data, 6.9 GiB used, 887 GiB / 894 GiB avail; 0 B/s wr, 898 op/s; 2986/21344 objects degraded (13.990%); 18 MiB/s, 282 objects/s recovering 2024-04-01T19:58:56.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:55 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 2986/22624 objects degraded (13.198%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:58:56.577 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:58:57.105 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:58:57.493 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:58:57.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:57 smithi022 ceph-mon[39439]: pgmap v1987: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 414 MiB data, 6.5 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 1.28k op/s; 1234/13236 objects degraded (9.323%); 31 MiB/s, 500 objects/s recovering 2024-04-01T19:58:57.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:57 smithi188 ceph-mon[43939]: pgmap v1987: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 414 MiB data, 6.5 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 1.28k op/s; 1234/13236 objects degraded (9.323%); 31 MiB/s, 500 objects/s recovering 2024-04-01T19:58:57.897 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:58:57.923 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:58:57.951 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:58:57.979 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:58:58.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:57 smithi062 ceph-mon[44211]: pgmap v1987: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 414 MiB data, 6.5 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 1.28k op/s; 1234/13236 objects degraded (9.323%); 31 MiB/s, 500 objects/s recovering 2024-04-01T19:58:58.022 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:58:58.050 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:58:58.099 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:58:58.123 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:58:58.162 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:58:58.199 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:58:58.228 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:58:58.229 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:58:58.229 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:58:58.229 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:58:58.229 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:58:58.229 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:58:58.229 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:58:58.229 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:58:58.229 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:58:58.229 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:58:58.229 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:58:58.229 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.10 2024-04-01T19:58:58.229 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:58:58.564 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:58:58.569 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:58:58.570 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:58:58.581 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_ops_in_flight 2024-04-01T19:58:58.671 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:58:58.707 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:58:58.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:58 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2828667695' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:58:58.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:58.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:58 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:58.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:58 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2828667695' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:58:58.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:58.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:58 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:59.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:58 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2828667695' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:58:59.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:59.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:58 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:59.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:59.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:59.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:58:59 smithi022 ceph-mon[39439]: pgmap v1988: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 395 MiB data, 6.5 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 700 op/s; 1234/12614 objects degraded (9.783%); 16 MiB/s, 259 objects/s recovering 2024-04-01T19:58:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:58:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:58:59 smithi188 ceph-mon[43939]: pgmap v1988: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 395 MiB data, 6.5 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 700 op/s; 1234/12614 objects degraded (9.783%); 16 MiB/s, 259 objects/s recovering 2024-04-01T19:59:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:00.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:00.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:58:59 smithi062 ceph-mon[44211]: pgmap v1988: 17 pgs: 5 active+recovering+degraded, 12 active+clean; 395 MiB data, 6.5 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 700 op/s; 1234/12614 objects degraded (9.783%); 16 MiB/s, 259 objects/s recovering 2024-04-01T19:59:00.177 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:59:00.180 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:00.181 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:59:00.281 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:59:00.323 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:00.355 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:59:00.362 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:00.362 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:59:00.463 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:59:00.511 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:00.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:00 smithi022 ceph-mon[39439]: 8.1 scrub starts 2024-04-01T19:59:00.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:00 smithi022 ceph-mon[39439]: 8.1 scrub ok 2024-04-01T19:59:00.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:00 smithi188 ceph-mon[43939]: 8.1 scrub starts 2024-04-01T19:59:00.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:00 smithi188 ceph-mon[43939]: 8.1 scrub ok 2024-04-01T19:59:00.760 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:59:00.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:00 smithi062 ceph-mon[44211]: 8.1 scrub starts 2024-04-01T19:59:00.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:00 smithi062 ceph-mon[44211]: 8.1 scrub ok 2024-04-01T19:59:00.765 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:00.766 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:59:00.867 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:59:00.899 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:01.174 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:59:01.178 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:01.179 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:59:01.195 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:59:01.196 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:59:01.280 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:59:01.328 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:01.360 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:59:01.368 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:01.368 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:59:01.469 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:59:01.508 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:01.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:01 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 1234/12614 objects degraded (9.783%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:59:01.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:01 smithi188 ceph-mon[43939]: pgmap v1989: 17 pgs: 2 active+recovering+degraded, 3 active+recovering, 12 active+clean; 117 MiB data, 6.1 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 1.10k op/s; 391/3732 objects degraded (10.477%); 18 MiB/s, 382 objects/s recovering 2024-04-01T19:59:01.766 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:59:01.774 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:01 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 1234/12614 objects degraded (9.783%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:59:01.774 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:01 smithi022 ceph-mon[39439]: pgmap v1989: 17 pgs: 2 active+recovering+degraded, 3 active+recovering, 12 active+clean; 117 MiB data, 6.1 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 1.10k op/s; 391/3732 objects degraded (10.477%); 18 MiB/s, 382 objects/s recovering 2024-04-01T19:59:01.775 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:01.776 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:59:01.864 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:59:01.870 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:59:01.876 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:59:01.908 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:01 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 1234/12614 objects degraded (9.783%), 5 pgs degraded (PG_DEGRADED) 2024-04-01T19:59:01.908 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:01 smithi062 ceph-mon[44211]: pgmap v1989: 17 pgs: 2 active+recovering+degraded, 3 active+recovering, 12 active+clean; 117 MiB data, 6.1 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 1.10k op/s; 391/3732 objects degraded (10.477%); 18 MiB/s, 382 objects/s recovering 2024-04-01T19:59:01.910 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:01.945 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:59:01.953 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:01.953 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:59:02.054 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:59:02.103 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:02.136 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:59:02.144 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:02.144 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:59:02.245 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:59:02.264 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Removed 139279 objects 2024-04-01T19:59:02.264 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Clean up completed and total clean up time :204.365 2024-04-01T19:59:02.290 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:02.366 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:59:02.369 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:02.369 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:59:02.470 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:59:02.497 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:02.520 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:59:02.523 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:02.525 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:59:02.626 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:59:02.660 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:02.682 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:59:02.686 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:02.686 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:59:02.787 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:59:02.814 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:02 smithi062 ceph-mon[44211]: 8.c scrub starts 2024-04-01T19:59:02.814 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:02 smithi062 ceph-mon[44211]: 8.c scrub ok 2024-04-01T19:59:02.816 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:02.839 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:59:02.842 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:02.843 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:59:02.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:02 smithi022 ceph-mon[39439]: 8.c scrub starts 2024-04-01T19:59:02.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:02 smithi022 ceph-mon[39439]: 8.c scrub ok 2024-04-01T19:59:02.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:02 smithi188 ceph-mon[43939]: 8.c scrub starts 2024-04-01T19:59:02.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:02 smithi188 ceph-mon[43939]: 8.c scrub ok 2024-04-01T19:59:02.944 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:59:02.977 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:03.127 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:59:03.130 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:03.131 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:59:03.197 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:59:03.232 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:59:03.275 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:03.484 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:59:03.485 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:59:03.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:03 smithi022 ceph-mon[39439]: 8.0 scrub starts 2024-04-01T19:59:03.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:03 smithi022 ceph-mon[39439]: 8.0 scrub ok 2024-04-01T19:59:03.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:03 smithi022 ceph-mon[39439]: from='client.17322 v1:172.21.15.22:0/3524841858' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:59:03.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:03 smithi022 ceph-mon[39439]: pgmap v1990: 17 pgs: 2 active+recovering+degraded, 3 active+recovering, 12 active+clean; 80 MiB data, 6.0 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 1.00k op/s; 68/2540 objects degraded (2.677%); 18 MiB/s, 369 objects/s recovering 2024-04-01T19:59:03.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:03 smithi188 ceph-mon[43939]: 8.0 scrub starts 2024-04-01T19:59:03.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:03 smithi188 ceph-mon[43939]: 8.0 scrub ok 2024-04-01T19:59:03.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:03 smithi188 ceph-mon[43939]: from='client.17322 v1:172.21.15.22:0/3524841858' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:59:03.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:03 smithi188 ceph-mon[43939]: pgmap v1990: 17 pgs: 2 active+recovering+degraded, 3 active+recovering, 12 active+clean; 80 MiB data, 6.0 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 1.00k op/s; 68/2540 objects degraded (2.677%); 18 MiB/s, 369 objects/s recovering 2024-04-01T19:59:04.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:03 smithi062 ceph-mon[44211]: 8.0 scrub starts 2024-04-01T19:59:04.101 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:03 smithi062 ceph-mon[44211]: 8.0 scrub ok 2024-04-01T19:59:04.101 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:03 smithi062 ceph-mon[44211]: from='client.17322 v1:172.21.15.22:0/3524841858' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:59:04.101 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:03 smithi062 ceph-mon[44211]: pgmap v1990: 17 pgs: 2 active+recovering+degraded, 3 active+recovering, 12 active+clean; 80 MiB data, 6.0 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 1.00k op/s; 68/2540 objects degraded (2.677%); 18 MiB/s, 369 objects/s recovering 2024-04-01T19:59:05.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:05 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:59:05.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:05 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:59:05.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:05 smithi022 ceph-mon[39439]: osdmap e725: 12 total, 11 up, 10 in 2024-04-01T19:59:05.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:05 smithi022 ceph-mon[39439]: pgmap v1992: 17 pgs: 2 active+recovering+degraded, 3 active+recovering, 12 active+clean; 59 MiB data, 5.9 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 973 op/s; 68/1860 objects degraded (3.656%); 18 MiB/s, 369 objects/s recovering 2024-04-01T19:59:05.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:05 smithi022 ceph-mon[39439]: Health check update: Degraded data redundancy: 68/2540 objects degraded (2.677%), 2 pgs degraded (PG_DEGRADED) 2024-04-01T19:59:05.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:05 smithi022 ceph-mon[39439]: osdmap e726: 12 total, 11 up, 10 in 2024-04-01T19:59:05.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:05 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:59:05.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:05 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:59:05.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:05 smithi188 ceph-mon[43939]: osdmap e725: 12 total, 11 up, 10 in 2024-04-01T19:59:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:05 smithi188 ceph-mon[43939]: pgmap v1992: 17 pgs: 2 active+recovering+degraded, 3 active+recovering, 12 active+clean; 59 MiB data, 5.9 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 973 op/s; 68/1860 objects degraded (3.656%); 18 MiB/s, 369 objects/s recovering 2024-04-01T19:59:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:05 smithi188 ceph-mon[43939]: Health check update: Degraded data redundancy: 68/2540 objects degraded (2.677%), 2 pgs degraded (PG_DEGRADED) 2024-04-01T19:59:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:05 smithi188 ceph-mon[43939]: osdmap e726: 12 total, 11 up, 10 in 2024-04-01T19:59:06.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:05 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:59:06.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:05 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:59:06.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:05 smithi062 ceph-mon[44211]: osdmap e725: 12 total, 11 up, 10 in 2024-04-01T19:59:06.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:05 smithi062 ceph-mon[44211]: pgmap v1992: 17 pgs: 2 active+recovering+degraded, 3 active+recovering, 12 active+clean; 59 MiB data, 5.9 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 973 op/s; 68/1860 objects degraded (3.656%); 18 MiB/s, 369 objects/s recovering 2024-04-01T19:59:06.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:05 smithi062 ceph-mon[44211]: Health check update: Degraded data redundancy: 68/2540 objects degraded (2.677%), 2 pgs degraded (PG_DEGRADED) 2024-04-01T19:59:06.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:05 smithi062 ceph-mon[44211]: osdmap e726: 12 total, 11 up, 10 in 2024-04-01T19:59:06.608 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_6 2024-04-01T19:59:06.608 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pool rm unique_pool_6 unique_pool_6 --yes-i-really-really-mean-it 2024-04-01T19:59:07.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:06 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T19:59:07.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:06 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T19:59:07.011 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:06 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T19:59:07.012 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:06 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T19:59:07.035 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:59:07.039 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:07.040 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:59:07.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:06 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T19:59:07.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:06 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T19:59:07.141 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:59:07.170 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:07.220 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:59:07.222 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:07.223 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:59:07.323 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:59:07.352 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:07.371 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:59:07.374 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:07.374 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:59:07.382 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:59:07.382 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:59:07.475 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:59:07.506 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:07.528 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:59:07.532 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:07.532 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:59:07.633 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:59:07.662 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:07.700 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:59:07.718 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:07.718 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:59:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T19:59:07.819 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:59:07.846 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:07 smithi062 ceph-mon[44211]: pgmap v1994: 17 pgs: 2 active+recovering, 15 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 787 op/s; 9.6 MiB/s, 887 objects/s recovering 2024-04-01T19:59:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:07 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/576455581' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:59:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:07 smithi062 ceph-mon[44211]: from='client.37370 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:59:08.021 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:07 smithi022 ceph-mon[39439]: pgmap v1994: 17 pgs: 2 active+recovering, 15 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 787 op/s; 9.6 MiB/s, 887 objects/s recovering 2024-04-01T19:59:08.021 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:07 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/576455581' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:59:08.021 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:07 smithi022 ceph-mon[39439]: from='client.37370 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:59:08.046 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_blocked_ops 2024-04-01T19:59:08.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:07 smithi188 ceph-mon[43939]: pgmap v1994: 17 pgs: 2 active+recovering, 15 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 787 op/s; 9.6 MiB/s, 887 objects/s recovering 2024-04-01T19:59:08.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:07 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/576455581' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:59:08.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:07 smithi188 ceph-mon[43939]: from='client.37370 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:59:08.779 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":1989,"stamp":"2024-04-01T19:59:01.417144+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":122683960,"num_objects":1866,"num_object_clones":0,"num_object_copies":3732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":391,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1866,"num_whiteouts":0,"num_read":127,"num_read_kb":110,"num_write":276877,"num_write_kb":8916795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41710,"num_bytes_recovered":2683652224,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160856,"ondisk_log_size":160856,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":9,"kb":937451520,"kb_used":6408868,"kb_used_data":410056,"kb_used_omap":889,"kb_used_meta":5997766,"kb_avail":931042652,"statfs":{"total":959950356480,"available":953387675648,"internally_reserved":0,"allocated":419897344,"data_stored":415125766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":910339,"internal_metadata":6141713405},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,3,3,3,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-637927424,"num_objects":-9734,"num_object_clones":0,"num_object_copies":-19468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-2595,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-9734,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9734,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3373,"num_bytes_recovered":170065920,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.826811"},"pg_stats":[{"pgid":"8.f","version":"724'17543","reported_seq":17839,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-04-01T19:59:01.293087+0000","last_change":"2024-04-01T19:55:39.217150+0000","last_active":"2024-04-01T19:59:01.293087+0000","last_peered":"2024-04-01T19:59:01.293087+0000","last_clean":"2024-04-01T19:59:01.293087+0000","last_became_active":"2024-04-01T19:53:54.067307+0000","last_became_peered":"2024-04-01T19:53:54.067307+0000","last_unstale":"2024-04-01T19:59:01.293087+0000","last_undegraded":"2024-04-01T19:59:01.293087+0000","last_fullsized":"2024-04-01T19:59:01.293087+0000","mapping_epoch":629,"log_start":"668'7500","ondisk_log_start":"668'7500","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8876","last_scrub_stamp":"2024-04-01T19:55:39.216977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:39.216977+0000","objects_scrubbed":8773,"log_size":10043,"log_dups_size":0,"ondisk_log_size":10043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1863,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17543,"num_write_kb":563264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.e","version":"724'17114","reported_seq":17406,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-04-01T19:59:00.816201+0000","last_change":"2024-04-01T19:55:33.528266+0000","last_active":"2024-04-01T19:59:00.816201+0000","last_peered":"2024-04-01T19:59:00.816201+0000","last_clean":"2024-04-01T19:59:00.816201+0000","last_became_active":"2024-04-01T19:53:54.066471+0000","last_became_peered":"2024-04-01T19:53:54.066471+0000","last_unstale":"2024-04-01T19:59:00.816201+0000","last_undegraded":"2024-04-01T19:59:00.816201+0000","last_fullsized":"2024-04-01T19:59:00.816201+0000","mapping_epoch":629,"log_start":"668'7100","ondisk_log_start":"668'7100","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'8369","last_scrub_stamp":"2024-04-01T19:55:33.528006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:33.528006+0000","objects_scrubbed":8332,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1210,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17114,"num_write_kb":550592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"724'17644","reported_seq":17939,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-04-01T19:59:01.327135+0000","last_change":"2024-04-01T19:55:45.161755+0000","last_active":"2024-04-01T19:59:01.327135+0000","last_peered":"2024-04-01T19:59:01.327135+0000","last_clean":"2024-04-01T19:59:01.327135+0000","last_became_active":"2024-04-01T19:53:53.678991+0000","last_became_peered":"2024-04-01T19:53:53.678991+0000","last_unstale":"2024-04-01T19:59:01.327135+0000","last_undegraded":"2024-04-01T19:59:01.327135+0000","last_fullsized":"2024-04-01T19:59:01.327135+0000","mapping_epoch":629,"log_start":"669'7600","ondisk_log_start":"669'7600","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"674'9322","last_scrub_stamp":"2024-04-01T19:55:45.161618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:45.161618+0000","objects_scrubbed":8442,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1822,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735576,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":17644,"num_write_kb":566401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.c","version":"724'17312","reported_seq":17673,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-04-01T19:59:00.793535+0000","last_change":"2024-04-01T19:57:06.345540+0000","last_active":"2024-04-01T19:59:00.793535+0000","last_peered":"2024-04-01T19:59:00.793535+0000","last_clean":"2024-04-01T19:59:00.793535+0000","last_became_active":"2024-04-01T19:53:53.462634+0000","last_became_peered":"2024-04-01T19:53:53.462634+0000","last_unstale":"2024-04-01T19:59:00.793535+0000","last_undegraded":"2024-04-01T19:59:00.793535+0000","last_fullsized":"2024-04-01T19:59:00.793535+0000","mapping_epoch":629,"log_start":"668'7300","ondisk_log_start":"668'7300","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"695'11630","last_scrub_stamp":"2024-04-01T19:57:06.345285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:57:06.345285+0000","objects_scrubbed":5792,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17312,"num_write_kb":556928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"8.b","version":"724'17560","reported_seq":17967,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-04-01T19:58:59.479067+0000","last_change":"2024-04-01T19:58:04.980816+0000","last_active":"2024-04-01T19:58:59.479067+0000","last_peered":"2024-04-01T19:58:59.479067+0000","last_clean":"2024-04-01T19:58:59.479067+0000","last_became_active":"2024-04-01T19:53:53.456979+0000","last_became_peered":"2024-04-01T19:53:53.456979+0000","last_unstale":"2024-04-01T19:58:59.479067+0000","last_undegraded":"2024-04-01T19:58:59.479067+0000","last_fullsized":"2024-04-01T19:58:59.479067+0000","mapping_epoch":629,"log_start":"668'7500","ondisk_log_start":"668'7500","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"707'14413","last_scrub_stamp":"2024-04-01T19:58:04.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:58:04.980641+0000","objects_scrubbed":3325,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:59:19.064773+0000","scrub_duration":600,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10878976,"num_objects":166,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17560,"num_write_kb":567232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"8.a","version":"724'16978","reported_seq":17370,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-04-01T19:58:59.411960+0000","last_change":"2024-04-01T19:57:56.975934+0000","last_active":"2024-04-01T19:58:59.411960+0000","last_peered":"2024-04-01T19:58:59.411960+0000","last_clean":"2024-04-01T19:58:59.411960+0000","last_became_active":"2024-04-01T19:53:54.066588+0000","last_became_peered":"2024-04-01T19:53:54.066588+0000","last_unstale":"2024-04-01T19:58:59.411960+0000","last_undegraded":"2024-04-01T19:58:59.411960+0000","last_fullsized":"2024-04-01T19:58:59.411960+0000","mapping_epoch":629,"log_start":"666'6900","ondisk_log_start":"666'6900","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"706'13635","last_scrub_stamp":"2024-04-01T19:57:56.975745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:57:56.975745+0000","objects_scrubbed":3527,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:59:06.634758+0000","scrub_duration":583,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11403264,"num_objects":174,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":174,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16978,"num_write_kb":548864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"8.8","version":"724'17463","reported_seq":17757,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-04-01T19:59:01.050018+0000","last_change":"2024-04-01T19:55:40.424211+0000","last_active":"2024-04-01T19:59:01.050018+0000","last_peered":"2024-04-01T19:59:01.050018+0000","last_clean":"2024-04-01T19:59:01.050018+0000","last_became_active":"2024-04-01T19:53:53.454737+0000","last_became_peered":"2024-04-01T19:53:53.454737+0000","last_unstale":"2024-04-01T19:59:01.050018+0000","last_undegraded":"2024-04-01T19:59:01.050018+0000","last_fullsized":"2024-04-01T19:59:01.050018+0000","mapping_epoch":629,"log_start":"668'7400","ondisk_log_start":"668'7400","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8915","last_scrub_stamp":"2024-04-01T19:55:40.424044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:40.424044+0000","objects_scrubbed":8661,"log_size":10063,"log_dups_size":0,"ondisk_log_size":10063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1277,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17463,"num_write_kb":561152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"724'17277","reported_seq":33926,"reported_epoch":724,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:59:01.340218+0000","last_change":"2024-04-01T19:56:22.028676+0000","last_active":"2024-04-01T19:59:01.340218+0000","last_peered":"2024-04-01T19:59:01.340218+0000","last_clean":"2024-04-01T19:55:56.524590+0000","last_became_active":"2024-04-01T19:56:21.981743+0000","last_became_peered":"2024-04-01T19:56:21.981743+0000","last_unstale":"2024-04-01T19:59:01.340218+0000","last_undegraded":"2024-04-01T19:56:21.738659+0000","last_fullsized":"2024-04-01T19:59:01.340218+0000","mapping_epoch":687,"log_start":"668'7200","ondisk_log_start":"668'7200","created":629,"last_epoch_clean":641,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'9008","last_scrub_stamp":"2024-04-01T19:55:43.358714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:43.358714+0000","objects_scrubbed":8387,"log_size":10077,"log_dups_size":0,"ondisk_log_size":10077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"no scrub is scheduled","scrub_duration":2089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":40,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17277,"num_write_kb":554432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8172,"num_bytes_recovered":535494656,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":["11"],"object_location_counts":[{"shards":"2,11","objects":9},{"shards":"11","objects":40}],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.6","version":"724'17310","reported_seq":34720,"reported_epoch":724,"state":"active+recovering","last_fresh":"2024-04-01T19:59:01.339055+0000","last_change":"2024-04-01T19:58:57.900413+0000","last_active":"2024-04-01T19:59:01.339055+0000","last_peered":"2024-04-01T19:59:01.339055+0000","last_clean":"2024-04-01T19:55:56.539057+0000","last_became_active":"2024-04-01T19:56:21.956699+0000","last_became_peered":"2024-04-01T19:56:21.956699+0000","last_unstale":"2024-04-01T19:59:01.339055+0000","last_undegraded":"2024-04-01T19:59:01.339055+0000","last_fullsized":"2024-04-01T19:59:01.339055+0000","mapping_epoch":687,"log_start":"668'7300","ondisk_log_start":"668'7300","created":629,"last_epoch_clean":642,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8615","last_scrub_stamp":"2024-04-01T19:55:36.688352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:36.688352+0000","objects_scrubbed":8556,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"no scrub is scheduled","scrub_duration":2331,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17310,"num_write_kb":555776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8554,"num_bytes_recovered":540278784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":["11"],"object_location_counts":[{"shards":"7,11","objects":58}],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.5","version":"724'17200","reported_seq":33490,"reported_epoch":724,"state":"active+recovering+degraded","last_fresh":"2024-04-01T19:58:56.694553+0000","last_change":"2024-04-01T19:56:22.002998+0000","last_active":"2024-04-01T19:58:56.694553+0000","last_peered":"2024-04-01T19:58:56.694553+0000","last_clean":"2024-04-01T19:55:56.434043+0000","last_became_active":"2024-04-01T19:56:21.952684+0000","last_became_peered":"2024-04-01T19:56:21.952684+0000","last_unstale":"2024-04-01T19:58:56.694553+0000","last_undegraded":"2024-04-01T19:56:21.721301+0000","last_fullsized":"2024-04-01T19:58:56.694553+0000","mapping_epoch":687,"log_start":"666'7100","ondisk_log_start":"666'7100","created":629,"last_epoch_clean":644,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'8660","last_scrub_stamp":"2024-04-01T19:55:36.183547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:36.183547+0000","objects_scrubbed":8628,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"no scrub is scheduled","scrub_duration":1673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23330816,"num_objects":356,"num_object_clones":0,"num_object_copies":712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":351,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":356,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17200,"num_write_kb":561792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7991,"num_bytes_recovered":523698176,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":351},{"shards":"4,11","objects":5}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.4","version":"724'20212","reported_seq":20710,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-04-01T19:59:01.022977+0000","last_change":"2024-04-01T19:55:34.954183+0000","last_active":"2024-04-01T19:59:01.022977+0000","last_peered":"2024-04-01T19:59:01.022977+0000","last_clean":"2024-04-01T19:59:01.022977+0000","last_became_active":"2024-04-01T19:53:53.462894+0000","last_became_peered":"2024-04-01T19:53:53.462894+0000","last_unstale":"2024-04-01T19:59:01.022977+0000","last_undegraded":"2024-04-01T19:59:01.022977+0000","last_fullsized":"2024-04-01T19:59:01.022977+0000","mapping_epoch":629,"log_start":"668'10200","ondisk_log_start":"668'10200","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'11373","last_scrub_stamp":"2024-04-01T19:55:34.954011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:34.954011+0000","objects_scrubbed":8546,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17450,"num_write_kb":560896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"724'17222","reported_seq":17490,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-04-01T19:59:01.323490+0000","last_change":"2024-04-01T19:54:55.108987+0000","last_active":"2024-04-01T19:59:01.323490+0000","last_peered":"2024-04-01T19:59:01.323490+0000","last_clean":"2024-04-01T19:59:01.323490+0000","last_became_active":"2024-04-01T19:53:53.462397+0000","last_became_peered":"2024-04-01T19:53:53.462397+0000","last_unstale":"2024-04-01T19:59:01.323490+0000","last_undegraded":"2024-04-01T19:59:01.323490+0000","last_fullsized":"2024-04-01T19:59:01.323490+0000","mapping_epoch":629,"log_start":"668'7200","ondisk_log_start":"668'7200","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"660'5871","last_scrub_stamp":"2024-04-01T19:54:55.108780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:54:55.108780+0000","objects_scrubbed":5824,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17222,"num_write_kb":552768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"8.2","version":"724'17015","reported_seq":34457,"reported_epoch":724,"state":"active+recovering","last_fresh":"2024-04-01T19:59:00.887416+0000","last_change":"2024-04-01T19:58:56.145257+0000","last_active":"2024-04-01T19:59:00.887416+0000","last_peered":"2024-04-01T19:59:00.887416+0000","last_clean":"2024-04-01T19:55:56.523442+0000","last_became_active":"2024-04-01T19:56:21.981766+0000","last_became_peered":"2024-04-01T19:56:21.981766+0000","last_unstale":"2024-04-01T19:59:00.887416+0000","last_undegraded":"2024-04-01T19:59:00.887416+0000","last_fullsized":"2024-04-01T19:59:00.887416+0000","mapping_epoch":687,"log_start":"666'7000","ondisk_log_start":"666'7000","created":629,"last_epoch_clean":645,"parent":"0.0","parent_split_bits":0,"last_scrub":"672'8353","last_scrub_stamp":"2024-04-01T19:55:34.153804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:34.153804+0000","objects_scrubbed":8295,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"no scrub is scheduled","scrub_duration":1672,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17015,"num_write_kb":548032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8569,"num_bytes_recovered":533004288,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0,4","objects":111}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"724'20145","reported_seq":20733,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-04-01T19:59:00.763982+0000","last_change":"2024-04-01T19:58:59.748446+0000","last_active":"2024-04-01T19:59:00.763982+0000","last_peered":"2024-04-01T19:59:00.763982+0000","last_clean":"2024-04-01T19:59:00.763982+0000","last_became_active":"2024-04-01T19:53:54.066680+0000","last_became_peered":"2024-04-01T19:53:54.066680+0000","last_unstale":"2024-04-01T19:59:00.763982+0000","last_undegraded":"2024-04-01T19:59:00.763982+0000","last_fullsized":"2024-04-01T19:59:00.763982+0000","mapping_epoch":629,"log_start":"668'10100","ondisk_log_start":"668'10100","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"724'20076","last_scrub_stamp":"2024-04-01T19:58:59.748294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:58:59.748294+0000","objects_scrubbed":161,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:02.403340+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17186,"num_write_kb":552896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"8.0","version":"724'16875","reported_seq":17283,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-04-01T19:58:57.687237+0000","last_change":"2024-04-01T19:57:56.925685+0000","last_active":"2024-04-01T19:58:57.687237+0000","last_peered":"2024-04-01T19:58:57.687237+0000","last_clean":"2024-04-01T19:58:57.687237+0000","last_became_active":"2024-04-01T19:53:53.455265+0000","last_became_peered":"2024-04-01T19:53:53.455265+0000","last_unstale":"2024-04-01T19:58:57.687237+0000","last_undegraded":"2024-04-01T19:58:57.687237+0000","last_fullsized":"2024-04-01T19:58:57.687237+0000","mapping_epoch":629,"log_start":"666'6800","ondisk_log_start":"666'6800","created":629,"last_epoch_clean":630,"parent":"0.0","parent_split_bits":0,"last_scrub":"706'13692","last_scrub_stamp":"2024-04-01T19:57:56.925430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:57:56.925430+0000","objects_scrubbed":3477,"log_size":10075,"log_dups_size":0,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:58:57.818501+0000","scrub_duration":572,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18546688,"num_objects":283,"num_object_clones":0,"num_object_copies":566,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":283,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16875,"num_write_kb":549056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"724'17547","reported_seq":34692,"reported_epoch":724,"state":"active+recovering","last_fresh":"2024-04-01T19:59:01.060943+0000","last_change":"2024-04-01T19:59:00.677398+0000","last_active":"2024-04-01T19:59:01.060943+0000","last_peered":"2024-04-01T19:59:01.060943+0000","last_clean":"2024-04-01T19:55:56.538683+0000","last_became_active":"2024-04-01T19:56:21.960415+0000","last_became_peered":"2024-04-01T19:56:21.960415+0000","last_unstale":"2024-04-01T19:59:01.060943+0000","last_undegraded":"2024-04-01T19:59:01.060943+0000","last_fullsized":"2024-04-01T19:59:01.060943+0000","mapping_epoch":687,"log_start":"668'7500","ondisk_log_start":"668'7500","created":629,"last_epoch_clean":645,"parent":"0.0","parent_split_bits":0,"last_scrub":"673'8889","last_scrub_stamp":"2024-04-01T19:55:39.237364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:53:52.440963+0000","last_clean_scrub_stamp":"2024-04-01T19:55:39.237364+0000","objects_scrubbed":8775,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"no scrub is scheduled","scrub_duration":1706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17547,"num_write_kb":563776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8416,"num_bytes_recovered":549060608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":["5"],"object_location_counts":[{"shards":"0,5","objects":71}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":1775,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-04-01T19:58:54.621207+0000","last_change":"2024-04-01T19:55:33.016809+0000","last_active":"2024-04-01T19:58:54.621207+0000","last_peered":"2024-04-01T19:58:54.621207+0000","last_clean":"2024-04-01T19:58:54.621207+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:58:54.621207+0000","last_undegraded":"2024-04-01T19:58:54.621207+0000","last_fullsized":"2024-04-01T19:58:54.621207+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:55:33.016695+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:55:33.016695+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":192,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":122093592,"num_objects":1864,"num_object_clones":0,"num_object_copies":3728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":391,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1864,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":276696,"num_write_kb":8913857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41702,"num_bytes_recovered":2681536512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2880643072,"data_stored":2880634928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160717,"ondisk_log_size":160717,"up":32,"acting":32,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220597,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":924460,"kb_used_data":22820,"kb_used_omap":1,"kb_used_meta":901630,"kb_avail":92820692,"statfs":{"total":95995035648,"available":95048388608,"internally_reserved":0,"allocated":23367680,"data_stored":22884405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":923269572},"hb_peers":[0,1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678464,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":611168,"kb_used_data":20504,"kb_used_omap":1,"kb_used_meta":590654,"kb_avail":93133984,"statfs":{"total":95995035648,"available":95369199616,"internally_reserved":0,"allocated":20996096,"data_stored":20520465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":604830144},"hb_peers":[0,1,2,3,4,5,6,7,8,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557661,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":256288,"kb_used_data":38168,"kb_used_omap":132,"kb_used_meta":217979,"kb_avail":93488864,"statfs":{"total":95995035648,"available":95732596736,"internally_reserved":0,"allocated":39084032,"data_stored":38608401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":223211239},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234442,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":647084,"kb_used_data":38372,"kb_used_omap":1,"kb_used_meta":608702,"kb_avail":93098068,"statfs":{"total":95995035648,"available":95332421632,"internally_reserved":0,"allocated":39292928,"data_stored":38809673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":623311306},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":457,"seq":1962800054454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":253796,"kb_used_data":920,"kb_used_omap":744,"kb_used_meta":252119,"kb_avail":93491356,"statfs":{"total":95995035648,"available":95735148544,"internally_reserved":0,"allocated":942080,"data_stored":466449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":762131,"internal_metadata":258170605},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":2452426326121,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738863,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":744416,"kb_used_data":27416,"kb_used_omap":1,"kb_used_meta":716990,"kb_avail":93000736,"statfs":{"total":95995035648,"available":95232753664,"internally_reserved":0,"allocated":28073984,"data_stored":27598353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":734198213},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346403,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":678948,"kb_used_data":106264,"kb_used_omap":1,"kb_used_meta":572606,"kb_avail":93066204,"statfs":{"total":95995035648,"available":95299792896,"internally_reserved":0,"allocated":108814336,"data_stored":108338705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":586348997},"hb_peers":[0,1,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669150173,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":790564,"kb_used_data":41624,"kb_used_omap":1,"kb_used_meta":748926,"kb_avail":92954588,"statfs":{"total":95995035648,"available":95185498112,"internally_reserved":0,"allocated":42622976,"data_stored":42147345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":766900679},"hb_peers":[0,1,2,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953943,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":776800,"kb_used_data":73688,"kb_used_omap":1,"kb_used_meta":703102,"kb_avail":92968352,"statfs":{"total":95995035648,"available":95199592448,"internally_reserved":0,"allocated":75456512,"data_stored":74980881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":719976901},"hb_peers":[0,1,2,3,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,1,0,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790420,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":725344,"kb_used_data":40280,"kb_used_omap":1,"kb_used_meta":685054,"kb_avail":93019808,"statfs":{"total":95995035648,"available":95252283392,"internally_reserved":0,"allocated":41246720,"data_stored":40771089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":701495749},"hb_peers":[0,1,2,3,4,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18874368,"data_stored":18874368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94896128,"data_stored":94896128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38076416,"data_stored":38076416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":70057984,"data_stored":70057984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":23461888,"data_stored":23461888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":29626368,"data_stored":29622296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":33488896,"data_stored":33488896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":18350080,"data_stored":18350080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":2534604800,"data_stored":2534604800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":19206144,"data_stored":19202072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:59:08.780 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:59:08.811 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:59:08.817 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:08.818 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:59:08.818 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:59:08.919 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:59:08.950 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:08.972 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:59:08.975 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:08.976 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:59:09.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:08 smithi062 ceph-mon[44211]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 68/1860 objects degraded (3.656%), 2 pgs degraded) 2024-04-01T19:59:09.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:08 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:59:09.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:08 smithi062 ceph-mon[44211]: from='client.37370 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:59:09.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:08 smithi062 ceph-mon[44211]: osdmap e727: 12 total, 11 up, 10 in 2024-04-01T19:59:09.076 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:59:09.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:08 smithi022 ceph-mon[39439]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 68/1860 objects degraded (3.656%), 2 pgs degraded) 2024-04-01T19:59:09.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:08 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:59:09.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:08 smithi022 ceph-mon[39439]: from='client.37370 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:59:09.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:08 smithi022 ceph-mon[39439]: osdmap e727: 12 total, 11 up, 10 in 2024-04-01T19:59:09.103 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:09.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:08 smithi188 ceph-mon[43939]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 68/1860 objects degraded (3.656%), 2 pgs degraded) 2024-04-01T19:59:09.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:08 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T19:59:09.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:08 smithi188 ceph-mon[43939]: from='client.37370 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T19:59:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:08 smithi188 ceph-mon[43939]: osdmap e727: 12 total, 11 up, 10 in 2024-04-01T19:59:09.262 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:59:09.296 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:59:10.012 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:09 smithi022 ceph-mon[39439]: 8.3 scrub starts 2024-04-01T19:59:10.012 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:09 smithi022 ceph-mon[39439]: 8.3 scrub ok 2024-04-01T19:59:10.012 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:09 smithi022 ceph-mon[39439]: 8.9 scrub starts 2024-04-01T19:59:10.012 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:09 smithi022 ceph-mon[39439]: 8.9 scrub ok 2024-04-01T19:59:10.013 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:09 smithi022 ceph-mon[39439]: 8.5 scrub starts 2024-04-01T19:59:10.013 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:09 smithi022 ceph-mon[39439]: 8.5 scrub ok 2024-04-01T19:59:10.013 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:09 smithi022 ceph-mon[39439]: pgmap v1996: 17 pgs: 2 active+recovering, 15 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 211 op/s; 725 KiB/s, 858 objects/s recovering 2024-04-01T19:59:10.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:09 smithi188 ceph-mon[43939]: 8.3 scrub starts 2024-04-01T19:59:10.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:09 smithi188 ceph-mon[43939]: 8.3 scrub ok 2024-04-01T19:59:10.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:09 smithi188 ceph-mon[43939]: 8.9 scrub starts 2024-04-01T19:59:10.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:09 smithi188 ceph-mon[43939]: 8.9 scrub ok 2024-04-01T19:59:10.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:09 smithi188 ceph-mon[43939]: 8.5 scrub starts 2024-04-01T19:59:10.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:09 smithi188 ceph-mon[43939]: 8.5 scrub ok 2024-04-01T19:59:10.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:09 smithi188 ceph-mon[43939]: pgmap v1996: 17 pgs: 2 active+recovering, 15 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 211 op/s; 725 KiB/s, 858 objects/s recovering 2024-04-01T19:59:10.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:09 smithi062 ceph-mon[44211]: 8.3 scrub starts 2024-04-01T19:59:10.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:09 smithi062 ceph-mon[44211]: 8.3 scrub ok 2024-04-01T19:59:10.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:09 smithi062 ceph-mon[44211]: 8.9 scrub starts 2024-04-01T19:59:10.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:09 smithi062 ceph-mon[44211]: 8.9 scrub ok 2024-04-01T19:59:10.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:09 smithi062 ceph-mon[44211]: 8.5 scrub starts 2024-04-01T19:59:10.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:09 smithi062 ceph-mon[44211]: 8.5 scrub ok 2024-04-01T19:59:10.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:09 smithi062 ceph-mon[44211]: pgmap v1996: 17 pgs: 2 active+recovering, 15 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 211 op/s; 725 KiB/s, 858 objects/s recovering 2024-04-01T19:59:11.232 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:59:11.241 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:11.242 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:59:11.304 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T19:59:11.342 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:59:11.375 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:11.396 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:59:11.399 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:11.400 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:59:11.501 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:59:11.533 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:11.554 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:59:11.558 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:11.558 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:59:11.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:11 smithi188 ceph-mon[43939]: osdmap e728: 12 total, 11 up, 10 in 2024-04-01T19:59:11.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:11 smithi188 ceph-mon[43939]: pgmap v1998: 17 pgs: 17 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 154 op/s; 725 KiB/s, 902 objects/s recovering 2024-04-01T19:59:11.659 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:59:11.690 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:11.712 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:59:11.715 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:11.715 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:59:11.816 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:59:11.824 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:11 smithi022 ceph-mon[39439]: osdmap e728: 12 total, 11 up, 10 in 2024-04-01T19:59:11.824 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:11 smithi022 ceph-mon[39439]: pgmap v1998: 17 pgs: 17 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 154 op/s; 725 KiB/s, 902 objects/s recovering 2024-04-01T19:59:11.846 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:12.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:11 smithi062 ceph-mon[44211]: osdmap e728: 12 total, 11 up, 10 in 2024-04-01T19:59:12.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:11 smithi062 ceph-mon[44211]: pgmap v1998: 17 pgs: 17 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 154 op/s; 725 KiB/s, 902 objects/s recovering 2024-04-01T19:59:12.681 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:12 smithi022 ceph-mon[39439]: 8.2 scrub starts 2024-04-01T19:59:12.681 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:12 smithi022 ceph-mon[39439]: 8.2 scrub ok 2024-04-01T19:59:12.705 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:59:12.707 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:12.708 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:59:12.809 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:59:12.840 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:12 smithi062 ceph-mon[44211]: 8.2 scrub starts 2024-04-01T19:59:12.840 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:12 smithi062 ceph-mon[44211]: 8.2 scrub ok 2024-04-01T19:59:12.843 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:12.865 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:59:12.867 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:12.868 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:59:12.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:12 smithi188 ceph-mon[43939]: 8.2 scrub starts 2024-04-01T19:59:12.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:12 smithi188 ceph-mon[43939]: 8.2 scrub ok 2024-04-01T19:59:12.969 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:59:13.001 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:13.100 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:59:13.103 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:13.103 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:59:13.204 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:59:13.236 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:59:13.236 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:59:13.236 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:13.258 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:59:13.261 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:13.261 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:59:13.362 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:59:13.391 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:13.419 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:59:13.422 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:13.422 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:59:13.523 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:59:13.552 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:13.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:13 smithi022 ceph-mon[39439]: 8.4 deep-scrub starts 2024-04-01T19:59:13.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:13 smithi022 ceph-mon[39439]: 8.4 deep-scrub ok 2024-04-01T19:59:13.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:13 smithi022 ceph-mon[39439]: pgmap v1999: 17 pgs: 17 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 117 op/s; 552 KiB/s, 687 objects/s recovering 2024-04-01T19:59:13.869 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:59:13.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:13 smithi188 ceph-mon[43939]: 8.4 deep-scrub starts 2024-04-01T19:59:13.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:13 smithi188 ceph-mon[43939]: 8.4 deep-scrub ok 2024-04-01T19:59:13.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:13 smithi188 ceph-mon[43939]: pgmap v1999: 17 pgs: 17 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 117 op/s; 552 KiB/s, 687 objects/s recovering 2024-04-01T19:59:13.890 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:59:13.910 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:59:13.930 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:59:13.950 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:59:13.971 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:59:13.991 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:59:14.005 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:59:14.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:13 smithi062 ceph-mon[44211]: 8.4 deep-scrub starts 2024-04-01T19:59:14.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:13 smithi062 ceph-mon[44211]: 8.4 deep-scrub ok 2024-04-01T19:59:14.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:13 smithi062 ceph-mon[44211]: pgmap v1999: 17 pgs: 17 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail; 0 B/s wr, 117 op/s; 552 KiB/s, 687 objects/s recovering 2024-04-01T19:59:14.013 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:59:14.016 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:14.016 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:59:14.034 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:59:14.054 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:59:14.076 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:59:14.076 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:59:14.076 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:59:14.076 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:59:14.076 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:59:14.076 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:59:14.076 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:59:14.076 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:59:14.076 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:59:14.076 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:59:14.077 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:59:14.077 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.10 2024-04-01T19:59:14.077 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:59:14.117 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:59:14.149 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:14.171 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:59:14.174 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:14.174 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:59:14.275 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:59:14.308 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:14.330 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:59:14.333 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:14.333 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:59:14.434 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:59:14.463 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:14.492 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:59:14.495 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:14.495 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:59:14.596 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:59:14.630 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:14.652 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:59:14.654 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:14.655 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:59:14.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:14 smithi022 ceph-mon[39439]: 8.e deep-scrub starts 2024-04-01T19:59:14.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:14 smithi022 ceph-mon[39439]: 8.e deep-scrub ok 2024-04-01T19:59:14.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:14 smithi022 ceph-mon[39439]: 8.a scrub starts 2024-04-01T19:59:14.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:14 smithi022 ceph-mon[39439]: 8.a scrub ok 2024-04-01T19:59:14.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:14 smithi022 ceph-mon[39439]: 8.8 scrub starts 2024-04-01T19:59:14.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:14 smithi022 ceph-mon[39439]: 8.f scrub starts 2024-04-01T19:59:14.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:14 smithi022 ceph-mon[39439]: 8.8 scrub ok 2024-04-01T19:59:14.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:14 smithi022 ceph-mon[39439]: 8.f scrub ok 2024-04-01T19:59:14.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:14 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/407008473' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:59:14.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:14.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:14.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:14.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:14 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:59:14.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:14 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:59:14.756 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:59:14.779 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_historic_ops 2024-04-01T19:59:14.787 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:14.808 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:59:14.811 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:14.811 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:59:14.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:14 smithi188 ceph-mon[43939]: 8.e deep-scrub starts 2024-04-01T19:59:14.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:14 smithi188 ceph-mon[43939]: 8.e deep-scrub ok 2024-04-01T19:59:14.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:14 smithi188 ceph-mon[43939]: 8.a scrub starts 2024-04-01T19:59:14.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:14 smithi188 ceph-mon[43939]: 8.a scrub ok 2024-04-01T19:59:14.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:14 smithi188 ceph-mon[43939]: 8.8 scrub starts 2024-04-01T19:59:14.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:14 smithi188 ceph-mon[43939]: 8.f scrub starts 2024-04-01T19:59:14.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:14 smithi188 ceph-mon[43939]: 8.8 scrub ok 2024-04-01T19:59:14.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:14 smithi188 ceph-mon[43939]: 8.f scrub ok 2024-04-01T19:59:14.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:14 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/407008473' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:59:14.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:14.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:14.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:14.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:14 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:59:14.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:14 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:59:14.912 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:59:14.942 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:14.966 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:59:14.966 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:59:14.969 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:59:14.973 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:14.974 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:59:15.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:14 smithi062 ceph-mon[44211]: 8.e deep-scrub starts 2024-04-01T19:59:15.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:14 smithi062 ceph-mon[44211]: 8.e deep-scrub ok 2024-04-01T19:59:15.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:14 smithi062 ceph-mon[44211]: 8.a scrub starts 2024-04-01T19:59:15.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:14 smithi062 ceph-mon[44211]: 8.a scrub ok 2024-04-01T19:59:15.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:14 smithi062 ceph-mon[44211]: 8.8 scrub starts 2024-04-01T19:59:15.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:14 smithi062 ceph-mon[44211]: 8.f scrub starts 2024-04-01T19:59:15.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:14 smithi062 ceph-mon[44211]: 8.8 scrub ok 2024-04-01T19:59:15.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:14 smithi062 ceph-mon[44211]: 8.f scrub ok 2024-04-01T19:59:15.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:14 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/407008473' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:59:15.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:14 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:59:15.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:14 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:59:15.074 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:59:15.102 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:15.451 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:59:15.455 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:15.455 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:59:15.478 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:59:15.478 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:59:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'unique_pool_6' removed 2024-04-01T19:59:15.556 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:59:15.590 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:15.610 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:59:15.613 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:15.613 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:59:15.706 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.706 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.706 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.706 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.706 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.706 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.706 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.706 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.706 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:15 smithi022 ceph-mon[39439]: osdmap e729: 12 total, 11 up, 10 in 2024-04-01T19:59:15.706 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:15 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1437086875' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_6", "pool2": "unique_pool_6", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:59:15.706 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:15 smithi022 ceph-mon[39439]: pgmap v2001: 17 pgs: 17 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail; 0 B/s, 34 objects/s recovering 2024-04-01T19:59:15.706 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:15 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1437086875' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_6", "pool2": "unique_pool_6", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T19:59:15.707 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:15 smithi022 ceph-mon[39439]: osdmap e730: 12 total, 11 up, 10 in 2024-04-01T19:59:15.714 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:59:15.742 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:15.761 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:59:15.764 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:15.765 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:59:15.865 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:59:15.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:15 smithi188 ceph-mon[43939]: osdmap e729: 12 total, 11 up, 10 in 2024-04-01T19:59:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:15 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1437086875' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_6", "pool2": "unique_pool_6", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:59:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:15 smithi188 ceph-mon[43939]: pgmap v2001: 17 pgs: 17 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail; 0 B/s, 34 objects/s recovering 2024-04-01T19:59:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:15 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1437086875' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_6", "pool2": "unique_pool_6", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T19:59:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:15 smithi188 ceph-mon[43939]: osdmap e730: 12 total, 11 up, 10 in 2024-04-01T19:59:15.891 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.891 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.891 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.891 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.892 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.892 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.892 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.892 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:15.892 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:15 smithi062 ceph-mon[44211]: osdmap e729: 12 total, 11 up, 10 in 2024-04-01T19:59:15.892 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:15 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1437086875' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_6", "pool2": "unique_pool_6", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T19:59:15.892 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:15 smithi062 ceph-mon[44211]: pgmap v2001: 17 pgs: 17 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail; 0 B/s, 34 objects/s recovering 2024-04-01T19:59:15.892 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:15 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1437086875' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_6", "pool2": "unique_pool_6", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T19:59:15.892 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:15 smithi062 ceph-mon[44211]: osdmap e730: 12 total, 11 up, 10 in 2024-04-01T19:59:15.893 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:15.912 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:59:15.915 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:15.915 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:59:16.016 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:59:16.043 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:16.062 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:59:16.065 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:16.066 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:59:16.167 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:59:16.196 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:16.294 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:59:16.297 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:16.298 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:59:16.310 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:59:16.399 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:59:16.425 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:16.443 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:59:16.446 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:16.446 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:59:16.547 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:59:16.577 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:16.597 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:59:16.600 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:16.600 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:59:16.701 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:59:16.729 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:16.749 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:59:16.752 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:16.752 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:59:16.853 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:59:16.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:16 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:59:16.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:16 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:59:16.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:16 smithi022 ceph-mon[39439]: osdmap e731: 12 total, 11 up, 10 in 2024-04-01T19:59:16.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:16 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:59:16.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:16 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:59:16.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:16 smithi188 ceph-mon[43939]: osdmap e731: 12 total, 11 up, 10 in 2024-04-01T19:59:16.882 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:17.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:16 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:59:17.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:16 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:59:17.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:16 smithi062 ceph-mon[44211]: osdmap e731: 12 total, 11 up, 10 in 2024-04-01T19:59:17.479 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:59:17.832 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:59:17.834 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:17 smithi022 ceph-mon[39439]: pgmap v2004: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:17.835 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:17.835 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:59:17.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:17 smithi188 ceph-mon[43939]: pgmap v2004: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:17.936 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:59:17.968 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:17 smithi062 ceph-mon[44211]: pgmap v2004: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:17.970 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:17.992 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:59:17.995 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:17.995 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:59:18.096 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:59:18.128 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:18.149 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:59:18.152 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:18.152 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:59:18.253 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:59:18.283 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:18.303 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:59:18.306 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:18.307 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:59:18.408 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:59:18.441 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:18.463 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:59:18.466 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:18.466 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:59:18.567 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:59:18.597 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:18.618 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:59:18.621 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:18.621 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:59:18.722 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:59:18.753 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:18.915 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:59:18.917 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:59:19.632 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-04-01T19:59:19.632 INFO:tasks.radosbench:Beginning radosbench... 2024-04-01T19:59:19.632 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_7 2024-04-01T19:59:19.633 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pool create unique_pool_7 16 2024-04-01T19:59:19.848 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:19 smithi022 ceph-mon[39439]: from='client.17346 v1:172.21.15.22:0/3858960301' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:59:19.848 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:19 smithi022 ceph-mon[39439]: pgmap v2005: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:19.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:19 smithi188 ceph-mon[43939]: from='client.17346 v1:172.21.15.22:0/3858960301' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:59:19.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:19 smithi188 ceph-mon[43939]: pgmap v2005: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:20.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:19 smithi062 ceph-mon[44211]: from='client.17346 v1:172.21.15.22:0/3858960301' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:59:20.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:19 smithi062 ceph-mon[44211]: pgmap v2005: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:20.157 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:59:20.189 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":2004,"stamp":"2024-04-01T19:59:17.420178+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":7,"kb":937451520,"kb_used":6108164,"kb_used_data":10828,"kb_used_omap":889,"kb_used_meta":6096326,"kb_avail":931343356,"statfs":{"total":959950356480,"available":953695596544,"internally_reserved":0,"allocated":11087872,"data_stored":6022332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":910339,"internal_metadata":6242638845},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-278560,"num_write_kb":-8913857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-47443,"num_bytes_recovered":-2707161088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001035"},"pg_stats":[{"pgid":"1.0","version":"156'139","reported_seq":1791,"reported_epoch":728,"state":"active+clean","last_fresh":"2024-04-01T19:59:10.575964+0000","last_change":"2024-04-01T19:59:06.207530+0000","last_active":"2024-04-01T19:59:10.575964+0000","last_peered":"2024-04-01T19:59:10.575964+0000","last_clean":"2024-04-01T19:59:10.575964+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:59:10.575964+0000","last_undegraded":"2024-04-01T19:59:10.575964+0000","last_fullsized":"2024-04-01T19:59:10.575964+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:59:06.207374+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:59:06.207374+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:34.869784+0000","scrub_duration":166,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220600,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":894840,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":893310,"kb_avail":92850312,"statfs":{"total":95995035648,"available":95078719488,"internally_reserved":0,"allocated":1552384,"data_stored":1032869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":914749892},"hb_peers":[0,1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":10,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678467,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":591636,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":590654,"kb_avail":93153516,"statfs":{"total":95995035648,"available":95389200384,"internally_reserved":0,"allocated":991232,"data_stored":491435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":604830144},"hb_peers":[0,1,2,3,4,5,6,7,8,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557664,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":219088,"kb_used_data":968,"kb_used_omap":132,"kb_used_meta":217979,"kb_avail":93526064,"statfs":{"total":95995035648,"available":95770689536,"internally_reserved":0,"allocated":991232,"data_stored":491435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":223211239},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":624092,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":622590,"kb_avail":93121060,"statfs":{"total":95995035648,"available":95355965440,"internally_reserved":0,"allocated":1523712,"data_stored":1020363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":637532618},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":457,"seq":1962800054457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":253848,"kb_used_data":968,"kb_used_omap":744,"kb_used_meta":252119,"kb_avail":93491304,"statfs":{"total":95995035648,"available":95735095296,"internally_reserved":0,"allocated":991232,"data_stored":491435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":762131,"internal_metadata":258170605},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":2452426326125,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":766560,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":765566,"kb_avail":92978592,"statfs":{"total":95995035648,"available":95210078208,"internally_reserved":0,"allocated":1003520,"data_stored":497719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":783940037},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346407,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":613868,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":612862,"kb_avail":93131284,"statfs":{"total":95995035648,"available":95366434816,"internally_reserved":0,"allocated":1019904,"data_stored":503961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":627571141},"hb_peers":[0,1,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669150176,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":749908,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":748926,"kb_avail":92995244,"statfs":{"total":95995035648,"available":95227129856,"internally_reserved":0,"allocated":991232,"data_stored":491435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":766900679},"hb_peers":[0,1,2,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953947,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":704116,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":703102,"kb_avail":93041036,"statfs":{"total":95995035648,"available":95274020864,"internally_reserved":0,"allocated":1019904,"data_stored":503961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":719976901},"hb_peers":[0,1,2,3,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790423,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":690208,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":689214,"kb_avail":93054944,"statfs":{"total":95995035648,"available":95288262656,"internally_reserved":0,"allocated":1003520,"data_stored":497719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":705755589},"hb_peers":[0,1,2,3,4,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:59:20.190 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph status --format=json 2024-04-01T19:59:21.816 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:21 smithi022 ceph-mon[39439]: osdmap e732: 12 total, 11 up, 10 in 2024-04-01T19:59:21.816 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:21 smithi022 ceph-mon[39439]: pgmap v2007: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:21.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:21 smithi188 ceph-mon[43939]: osdmap e732: 12 total, 11 up, 10 in 2024-04-01T19:59:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:21 smithi188 ceph-mon[43939]: pgmap v2007: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:22.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:21 smithi062 ceph-mon[44211]: osdmap e732: 12 total, 11 up, 10 in 2024-04-01T19:59:22.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:21 smithi062 ceph-mon[44211]: pgmap v2007: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:22.380 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:59:22.424 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:59:22.424 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 20, 2024-04-01T19:59:22.424 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 600, 2024-04-01T19:59:22.424 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [] 2024-04-01T19:59:22.425 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:59:22.938 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:59:22.945 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:59:22.945 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:22.946 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:59:23.047 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:59:23.079 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:23.100 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:59:23.103 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:23.104 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:59:23.114 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T19:59:23.198 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:23 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/900824814' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:59:23.205 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:59:23.235 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:23.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:23 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/900824814' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:59:23.483 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:59:23.489 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:23.489 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:59:23.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:23 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/900824814' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T19:59:23.590 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:59:23.620 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:23.909 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_ops_in_flight 2024-04-01T19:59:24.134 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:24 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:59:24.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:24 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/900824814' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:59:24.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:24 smithi022 ceph-mon[39439]: osdmap e733: 12 total, 11 up, 10 in 2024-04-01T19:59:24.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:24 smithi022 ceph-mon[39439]: pgmap v2009: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:24.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:24 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:59:24.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:24 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/900824814' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:59:24.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:24 smithi188 ceph-mon[43939]: osdmap e733: 12 total, 11 up, 10 in 2024-04-01T19:59:24.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:24 smithi188 ceph-mon[43939]: pgmap v2009: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:24.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:24 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:59:24.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:24 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/900824814' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T19:59:24.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:24 smithi062 ceph-mon[44211]: osdmap e733: 12 total, 11 up, 10 in 2024-04-01T19:59:24.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:24 smithi062 ceph-mon[44211]: pgmap v2009: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:25.315 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:59:25.316 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:59:25.316 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:59:25.316 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:59:25.316 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:59:25.316 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:59:25.316 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:59:25.316 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:59:25.316 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:59:25.316 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:59:25.316 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:59:25.316 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:59:25.317 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:59:25.317 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:59:25.317 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:59:25.317 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:59:25.317 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:59:25.317 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:59:25.317 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:59:25.317 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:59:25.317 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:59:25.317 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.10 2024-04-01T19:59:25.317 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:59:25.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:25 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3927698102' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:59:25.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:25.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:25.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:25.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:25.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:25.586 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:25 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3927698102' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:59:25.586 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:25.586 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:25.586 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:25.586 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:25.586 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:25.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:25 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3927698102' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:59:25.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:25.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:25.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:25.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:25.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:25.837 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:59:25.837 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:59:26.072 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:59:26.076 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:26.076 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:59:26.177 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:59:26.211 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:26.234 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:59:26.236 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:26.237 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:59:26.338 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:59:26.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:26.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:26.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:26.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:26.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:26.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:26 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:26.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:26 smithi022 ceph-mon[39439]: pgmap v2010: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:26.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:26 smithi022 ceph-mon[39439]: osdmap e734: 12 total, 11 up, 10 in 2024-04-01T19:59:26.371 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:26.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:26.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:26.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:26.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:26.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:26.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:26 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:26.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:26 smithi062 ceph-mon[44211]: pgmap v2010: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:26.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:26 smithi062 ceph-mon[44211]: osdmap e734: 12 total, 11 up, 10 in 2024-04-01T19:59:26.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:26.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:26.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:26.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:26.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:26.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:26 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:26.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:26 smithi188 ceph-mon[43939]: pgmap v2010: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:26.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:26 smithi188 ceph-mon[43939]: osdmap e734: 12 total, 11 up, 10 in 2024-04-01T19:59:27.147 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'unique_pool_7' created 2024-04-01T19:59:27.178 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:27 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2740592275' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_7", "pg_num": 16}]: dispatch 2024-04-01T19:59:27.178 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:27 smithi022 ceph-mon[39439]: from='client.37406 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_7", "pg_num": 16}]: dispatch 2024-04-01T19:59:27.321 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:59:27.325 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:27.326 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:59:27.426 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:59:27.456 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:27.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:27 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2740592275' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_7", "pg_num": 16}]: dispatch 2024-04-01T19:59:27.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:27 smithi062 ceph-mon[44211]: from='client.37406 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_7", "pg_num": 16}]: dispatch 2024-04-01T19:59:27.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:27 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2740592275' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_7", "pg_num": 16}]: dispatch 2024-04-01T19:59:27.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:27 smithi188 ceph-mon[43939]: from='client.37406 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_7", "pg_num": 16}]: dispatch 2024-04-01T19:59:27.839 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:59:27.984 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:59:27.986 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:27.987 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:59:28.088 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:59:28.116 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:28.509 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:28 smithi022 ceph-mon[39439]: from='client.37406 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_7", "pg_num": 16}]': finished 2024-04-01T19:59:28.509 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:28 smithi022 ceph-mon[39439]: osdmap e735: 12 total, 11 up, 10 in 2024-04-01T19:59:28.509 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:28 smithi022 ceph-mon[39439]: pgmap v2013: 17 pgs: 16 unknown, 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:28.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:28 smithi062 ceph-mon[44211]: from='client.37406 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_7", "pg_num": 16}]': finished 2024-04-01T19:59:28.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:28 smithi062 ceph-mon[44211]: osdmap e735: 12 total, 11 up, 10 in 2024-04-01T19:59:28.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:28 smithi062 ceph-mon[44211]: pgmap v2013: 17 pgs: 16 unknown, 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:28.544 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pool application enable unique_pool_7 rados --yes-i-really-mean-it || true 2024-04-01T19:59:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:28 smithi188 ceph-mon[43939]: from='client.37406 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_7", "pg_num": 16}]': finished 2024-04-01T19:59:28.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:28 smithi188 ceph-mon[43939]: osdmap e735: 12 total, 11 up, 10 in 2024-04-01T19:59:28.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:28 smithi188 ceph-mon[43939]: pgmap v2013: 17 pgs: 16 unknown, 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:28.765 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:59:28.769 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:28.770 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:59:28.870 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:59:28.903 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:29.022 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:59:29.027 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:59:29.032 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:29.032 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:59:29.064 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:59:29.133 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:59:29.165 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:29.187 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:59:29.190 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:29.190 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:59:29.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:29 smithi022 ceph-mon[39439]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T19:59:29.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:29 smithi022 ceph-mon[39439]: osdmap e736: 12 total, 11 up, 10 in 2024-04-01T19:59:29.291 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:59:29.322 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:29.331 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:59:29.331 INFO:teuthology.orchestra.run.smithi022.stdout:{"fsid":"09f6b846-f05c-11ee-b647-cb9ed24678a4","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noscrub flag(s) set","count":7},"muted":false},"POOL_APP_NOT_ENABLED":{"severity":"HEALTH_WARN","summary":{"message":"1 pool(s) do not have an application enabled","count":1},"muted":false}},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":2517,"monmap":{"epoch":3,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":737,"num_osds":12,"num_up_osds":11,"osd_up_since":1712001356,"num_in_osds":10,"osd_in_since":1712001380,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":16},{"state_name":"active+clean","count":1}],"num_pgs":17,"num_pools":2,"num_objects":2,"data_bytes":590368,"bytes_used":6278049792,"bytes_avail":953672306688,"bytes_total":959950356480,"unknown_pgs_ratio":0.94117647409439087},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["cephadm","dashboard","iostat","nfs","restful"],"services":{"dashboard":"https://172.21.15.22:8443/"}},"servicemap":{"epoch":50,"modified":"2024-04-01T19:56:43.370770+0000","services":{}},"progress_events":{}} 2024-04-01T19:59:29.342 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:59:29.345 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:29.345 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:59:29.446 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:59:29.478 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:29 smithi062 ceph-mon[44211]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T19:59:29.479 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:29 smithi062 ceph-mon[44211]: osdmap e736: 12 total, 11 up, 10 in 2024-04-01T19:59:29.481 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:29.503 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:59:29.506 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:29.507 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:59:29.607 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:59:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:29 smithi188 ceph-mon[43939]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T19:59:29.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:29 smithi188 ceph-mon[43939]: osdmap e736: 12 total, 11 up, 10 in 2024-04-01T19:59:29.639 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:29.659 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:59:29.662 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:29.663 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:59:29.763 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:59:29.793 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:29.967 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T19:59:30.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:30 smithi062 ceph-mon[44211]: osdmap e737: 12 total, 11 up, 10 in 2024-04-01T19:59:30.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:30 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1264808318' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-04-01T19:59:30.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:30 smithi062 ceph-mon[44211]: pgmap v2016: 17 pgs: 4 active+clean, 2 creating+peering, 11 unknown; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:30.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:30 smithi022 ceph-mon[39439]: osdmap e737: 12 total, 11 up, 10 in 2024-04-01T19:59:30.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:30 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1264808318' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-04-01T19:59:30.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:30 smithi022 ceph-mon[39439]: pgmap v2016: 17 pgs: 4 active+clean, 2 creating+peering, 11 unknown; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:30.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:30 smithi188 ceph-mon[43939]: osdmap e737: 12 total, 11 up, 10 in 2024-04-01T19:59:30.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:30 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1264808318' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-04-01T19:59:30.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:30 smithi188 ceph-mon[43939]: pgmap v2016: 17 pgs: 4 active+clean, 2 creating+peering, 11 unknown; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:30.643 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:59:30.645 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:30.646 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:59:30.747 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:59:30.776 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:31.125 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:59:31.128 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:31.129 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:59:31.230 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:59:31.259 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:31.358 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:59:31.361 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:31.361 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:59:31.462 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:59:31.496 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:31.518 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:59:31.522 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:31.522 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:59:31.623 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:59:31.650 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:31 smithi022 ceph-mon[39439]: osdmap e738: 12 total, 11 up, 10 in 2024-04-01T19:59:31.650 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:31 smithi022 ceph-mon[39439]: pgmap v2018: 17 pgs: 14 active+clean, 2 creating+peering, 1 unknown; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:31.652 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:31.663 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:59:31.675 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:59:31.679 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:31.680 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:59:31.699 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-04-01T19:59:31.699 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:59:31.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:31 smithi062 ceph-mon[44211]: osdmap e738: 12 total, 11 up, 10 in 2024-04-01T19:59:31.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:31 smithi062 ceph-mon[44211]: pgmap v2018: 17 pgs: 14 active+clean, 2 creating+peering, 1 unknown; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:31.781 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:59:31.810 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:31.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:31 smithi188 ceph-mon[43939]: osdmap e738: 12 total, 11 up, 10 in 2024-04-01T19:59:31.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:31 smithi188 ceph-mon[43939]: pgmap v2018: 17 pgs: 14 active+clean, 2 creating+peering, 1 unknown; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:31.912 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:59:31.915 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:31.915 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:59:32.016 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:59:32.048 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:32.177 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:59:32.186 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:59:32.210 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:59:32.235 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:59:32.255 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:59:32.275 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:59:32.296 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:59:32.302 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:59:32.309 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:32.310 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:59:32.317 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:59:32.338 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:59:32.359 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:59:32.380 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:59:32.380 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:59:32.380 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:59:32.380 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:59:32.380 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:59:32.380 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:59:32.380 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:59:32.381 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:59:32.381 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:59:32.381 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:59:32.381 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:59:32.381 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.10 2024-04-01T19:59:32.381 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:59:32.410 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:59:32.444 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:32.466 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:59:32.469 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:32.469 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:59:32.570 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:59:32.601 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:32.621 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:59:32.624 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:32.625 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:59:32.725 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:59:32.755 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:32 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/831038953' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:59:32.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:32 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/831038953' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:59:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:32 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/831038953' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:59:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:33.005 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:59:33.008 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:33.009 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:59:33.110 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:59:33.142 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:33.162 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:59:33.166 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:33.166 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:59:33.267 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:59:33.300 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:33.322 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:59:33.325 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:33.326 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:59:33.427 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:59:33.459 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:33.480 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:59:33.484 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:33.484 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:59:33.584 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:59:33.584 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:59:33.584 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 0 2024-04-01T19:59:33.584 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:59:33.585 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:59:33.616 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:33.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:33.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:33.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:33.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:33.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:33.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:33.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:33.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:33.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:33.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:33.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:33 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:59:33.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:33 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:59:33.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:33 smithi022 ceph-mon[39439]: pgmap v2019: 17 pgs: 17 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:33.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:33 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:59:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:33 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:59:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:33 smithi188 ceph-mon[43939]: pgmap v2019: 17 pgs: 17 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:34.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:34.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:34.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:34.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:34.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:33 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:59:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:33 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:59:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:33 smithi062 ceph-mon[44211]: pgmap v2019: 17 pgs: 17 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:34.162 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:59:34.166 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:59:34.170 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:34.171 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:59:34.272 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:59:34.301 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:34.819 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:34 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:59:34.819 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:34 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:59:34.819 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:34 smithi022 ceph-mon[39439]: osdmap e739: 12 total, 11 up, 10 in 2024-04-01T19:59:34.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:34 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:59:34.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:34 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:59:34.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:34 smithi188 ceph-mon[43939]: osdmap e739: 12 total, 11 up, 10 in 2024-04-01T19:59:35.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:34 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:59:35.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:34 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:59:35.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:34 smithi062 ceph-mon[44211]: osdmap e739: 12 total, 11 up, 10 in 2024-04-01T19:59:35.127 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_blocked_ops 2024-04-01T19:59:35.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:35 smithi022 ceph-mon[39439]: pgmap v2021: 17 pgs: 17 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:35.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:35 smithi022 ceph-mon[39439]: osdmap e740: 12 total, 11 up, 10 in 2024-04-01T19:59:35.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:35 smithi188 ceph-mon[43939]: pgmap v2021: 17 pgs: 17 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:35.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:35 smithi188 ceph-mon[43939]: osdmap e740: 12 total, 11 up, 10 in 2024-04-01T19:59:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:35 smithi062 ceph-mon[44211]: pgmap v2021: 17 pgs: 17 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:35 smithi062 ceph-mon[44211]: osdmap e740: 12 total, 11 up, 10 in 2024-04-01T19:59:36.081 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:59:36.112 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:59:36.112 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:59:36.553 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:59:36.557 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:36.557 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:59:36.658 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:59:36.691 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:36.713 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:59:36.716 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:36.716 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:59:36.817 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:59:36.847 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:36.868 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:59:36.871 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:36.871 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:59:36.972 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:59:37.002 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:37.023 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:59:37.026 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:37.026 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:59:37.127 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:59:37.159 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:37.181 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:59:37.183 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:37.184 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:59:37.285 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:59:37.316 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:37.336 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:59:37.338 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:37.339 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:59:37.440 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:59:37.471 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:37.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:37 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/108085871' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_7", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:59:37.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:37 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/108085871' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_7", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:59:37.719 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:59:37.722 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:37.723 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:59:37.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:37 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/108085871' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_7", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T19:59:37.825 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:59:37.854 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:37.873 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:59:37.875 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:37.876 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:59:37.977 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:59:38.011 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:38.113 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T19:59:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:38 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/108085871' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_7", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:59:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:38 smithi022 ceph-mon[39439]: osdmap e741: 12 total, 11 up, 10 in 2024-04-01T19:59:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:38 smithi022 ceph-mon[39439]: pgmap v2024: 17 pgs: 17 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:38 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:59:38.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:38 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/108085871' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_7", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:59:38.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:38 smithi188 ceph-mon[43939]: osdmap e741: 12 total, 11 up, 10 in 2024-04-01T19:59:38.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:38 smithi188 ceph-mon[43939]: pgmap v2024: 17 pgs: 17 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:38.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:38 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:59:38.715 INFO:teuthology.orchestra.run.smithi022.stderr:enabled application 'rados' on pool 'unique_pool_7' 2024-04-01T19:59:38.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:38 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/108085871' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_7", "app": "rados", "yes_i_really_mean_it": true}]': finished 2024-04-01T19:59:38.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:38 smithi062 ceph-mon[44211]: osdmap e741: 12 total, 11 up, 10 in 2024-04-01T19:59:38.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:38 smithi062 ceph-mon[44211]: pgmap v2024: 17 pgs: 17 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:38.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:38 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:59:39.559 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:39 smithi022 ceph-mon[39439]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T19:59:39.560 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:59:39.564 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:39.565 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:59:39.571 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:59:39.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:39 smithi188 ceph-mon[43939]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T19:59:39.666 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:59:39.698 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:39.719 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:59:39.722 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:39.723 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:59:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:39 smithi062 ceph-mon[44211]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T19:59:39.824 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:59:39.856 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:59:39.880 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:39.881 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:59:39.982 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:59:40.012 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:40.033 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:59:40.036 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:40.037 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:59:40.137 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:59:40.170 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:40.243 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:59:40.245 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:40.246 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:59:40.288 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:59:40.291 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:59:40.347 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:59:40.354 DEBUG:teuthology.orchestra.run.smithi188:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.2 -b 65536 --object-size 65536 -p unique_pool_7 bench 90 write' 2024-04-01T19:59:40.356 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-04-01T19:59:40.356 INFO:teuthology.orchestra.run:waiting for 3000 2024-04-01T19:59:40.380 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:40.473 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:hints = 1 2024-04-01T19:59:40.473 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-04-01T19:59:40.473 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Object prefix: benchmark_data_smithi188_173515 2024-04-01T19:59:40.474 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T19:59:40.474 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 0 0 0 0 0 0 - 0 2024-04-01T19:59:40.549 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T19:59:40.575 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:40 smithi022 ceph-mon[39439]: pgmap v2025: 17 pgs: 17 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:40.575 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:40 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:59:40.575 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:40 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:59:40.575 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:40 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:59:40.575 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:40 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:59:40.575 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:40 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:59:40.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:40 smithi188 ceph-mon[43939]: pgmap v2025: 17 pgs: 17 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:40.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:40 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:59:40.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:40 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:59:40.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:40 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:59:40.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:40 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:59:40.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:40 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:59:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:40 smithi062 ceph-mon[44211]: pgmap v2025: 17 pgs: 17 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T19:59:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:40 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:59:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:40 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:59:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:40 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:59:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:40 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:59:40.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:40 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:59:41.045 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:59:41.048 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:41.048 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:59:41.149 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:59:41.189 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:41.214 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:59:41.218 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:41.218 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:59:41.294 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:41 smithi022 ceph-mon[39439]: from='client.17385 v1:172.21.15.22:0/3743707920' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:59:41.294 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:41 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3695610677' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:59:41.294 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:41 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:59:41.294 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:41 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3695610677' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:59:41.294 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:41 smithi022 ceph-mon[39439]: osdmap e742: 12 total, 11 up, 10 in 2024-04-01T19:59:41.319 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:59:41.359 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:41.388 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:59:41.391 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:41.392 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:59:41.473 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 1 16 5329 5313 332.045 332.062 0.00441465 0.00300461 2024-04-01T19:59:41.493 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:59:41.538 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:41.570 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:59:41.573 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:41 smithi062 ceph-mon[44211]: from='client.17385 v1:172.21.15.22:0/3743707920' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:59:41.574 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:41 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3695610677' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:59:41.574 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:41 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:59:41.574 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:41 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3695610677' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:59:41.574 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:41 smithi062 ceph-mon[44211]: osdmap e742: 12 total, 11 up, 10 in 2024-04-01T19:59:41.574 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:41.575 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:59:41.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:41 smithi188 ceph-mon[43939]: from='client.17385 v1:172.21.15.22:0/3743707920' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:59:41.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:41 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3695610677' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T19:59:41.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:41 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:59:41.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:41 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3695610677' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T19:59:41.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:41 smithi188 ceph-mon[43939]: osdmap e742: 12 total, 11 up, 10 in 2024-04-01T19:59:41.676 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:59:41.710 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:41.739 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:59:41.748 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:41.749 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:59:41.850 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:59:41.892 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:41.921 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:59:41.924 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:41.925 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:59:42.026 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:59:42.068 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:42.097 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:59:42.102 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:42.102 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:59:42.203 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:59:42.234 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:42.261 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:59:42.264 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:42.264 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:59:42.365 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:59:42.396 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:42.474 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 2 16 10171 10155 317.323 302.625 0.00206684 0.00314725 2024-04-01T19:59:42.588 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:42 smithi022 ceph-mon[39439]: pgmap v2027: 17 pgs: 17 active+clean; 97 MiB data, 6.0 GiB used, 888 GiB / 894 GiB avail; 16 MiB/s wr, 258 op/s 2024-04-01T19:59:42.597 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:59:42.602 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:42.602 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:59:42.619 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":2025,"stamp":"2024-04-01T19:59:39.423975+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":937451520,"kb_used":6131676,"kb_used_data":12128,"kb_used_omap":889,"kb_used_meta":6118534,"kb_avail":931319844,"statfs":{"total":959950356480,"available":953671520256,"internally_reserved":0,"allocated":12419072,"data_stored":6677543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":910339,"internal_metadata":6265379837},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001181"},"pg_stats":[{"pgid":"9.f","version":"0'0","reported_seq":16,"reported_epoch":739,"state":"active+clean","last_fresh":"2024-04-01T19:59:33.655604+0000","last_change":"2024-04-01T19:59:28.154819+0000","last_active":"2024-04-01T19:59:33.655604+0000","last_peered":"2024-04-01T19:59:33.655604+0000","last_clean":"2024-04-01T19:59:33.655604+0000","last_became_active":"2024-04-01T19:59:28.154474+0000","last_became_peered":"2024-04-01T19:59:28.154474+0000","last_unstale":"2024-04-01T19:59:33.655604+0000","last_undegraded":"2024-04-01T19:59:33.655604+0000","last_fullsized":"2024-04-01T19:59:33.655604+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:34.121672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":21,"reported_epoch":741,"state":"active+clean","last_fresh":"2024-04-01T19:59:38.015868+0000","last_change":"2024-04-01T19:59:28.152165+0000","last_active":"2024-04-01T19:59:38.015868+0000","last_peered":"2024-04-01T19:59:38.015868+0000","last_clean":"2024-04-01T19:59:38.015868+0000","last_became_active":"2024-04-01T19:59:28.151863+0000","last_became_peered":"2024-04-01T19:59:28.151863+0000","last_unstale":"2024-04-01T19:59:38.015868+0000","last_undegraded":"2024-04-01T19:59:38.015868+0000","last_fullsized":"2024-04-01T19:59:38.015868+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:32.153574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":21,"reported_epoch":741,"state":"active+clean","last_fresh":"2024-04-01T19:59:38.015883+0000","last_change":"2024-04-01T19:59:28.153611+0000","last_active":"2024-04-01T19:59:38.015883+0000","last_peered":"2024-04-01T19:59:38.015883+0000","last_clean":"2024-04-01T19:59:38.015883+0000","last_became_active":"2024-04-01T19:59:28.153275+0000","last_became_peered":"2024-04-01T19:59:28.153275+0000","last_unstale":"2024-04-01T19:59:38.015883+0000","last_undegraded":"2024-04-01T19:59:38.015883+0000","last_fullsized":"2024-04-01T19:59:38.015883+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:46.257638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":18,"reported_epoch":740,"state":"active+clean","last_fresh":"2024-04-01T19:59:35.547139+0000","last_change":"2024-04-01T19:59:28.152444+0000","last_active":"2024-04-01T19:59:35.547139+0000","last_peered":"2024-04-01T19:59:35.547139+0000","last_clean":"2024-04-01T19:59:35.547139+0000","last_became_active":"2024-04-01T19:59:28.152217+0000","last_became_peered":"2024-04-01T19:59:28.152217+0000","last_unstale":"2024-04-01T19:59:35.547139+0000","last_undegraded":"2024-04-01T19:59:35.547139+0000","last_fullsized":"2024-04-01T19:59:35.547139+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:56.722093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":16,"reported_epoch":739,"state":"active+clean","last_fresh":"2024-04-01T19:59:33.561793+0000","last_change":"2024-04-01T19:59:28.153735+0000","last_active":"2024-04-01T19:59:33.561793+0000","last_peered":"2024-04-01T19:59:33.561793+0000","last_clean":"2024-04-01T19:59:33.561793+0000","last_became_active":"2024-04-01T19:59:28.153409+0000","last_became_peered":"2024-04-01T19:59:28.153409+0000","last_unstale":"2024-04-01T19:59:33.561793+0000","last_undegraded":"2024-04-01T19:59:33.561793+0000","last_fullsized":"2024-04-01T19:59:33.561793+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:52.015869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":16,"reported_epoch":739,"state":"active+clean","last_fresh":"2024-04-01T19:59:33.655540+0000","last_change":"2024-04-01T19:59:28.153919+0000","last_active":"2024-04-01T19:59:33.655540+0000","last_peered":"2024-04-01T19:59:33.655540+0000","last_clean":"2024-04-01T19:59:33.655540+0000","last_became_active":"2024-04-01T19:59:28.153559+0000","last_became_peered":"2024-04-01T19:59:28.153559+0000","last_unstale":"2024-04-01T19:59:33.655540+0000","last_undegraded":"2024-04-01T19:59:33.655540+0000","last_fullsized":"2024-04-01T19:59:33.655540+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:46.909058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":18,"reported_epoch":740,"state":"active+clean","last_fresh":"2024-04-01T19:59:36.238628+0000","last_change":"2024-04-01T19:59:28.153739+0000","last_active":"2024-04-01T19:59:36.238628+0000","last_peered":"2024-04-01T19:59:36.238628+0000","last_clean":"2024-04-01T19:59:36.238628+0000","last_became_active":"2024-04-01T19:59:28.153481+0000","last_became_peered":"2024-04-01T19:59:28.153481+0000","last_unstale":"2024-04-01T19:59:36.238628+0000","last_undegraded":"2024-04-01T19:59:36.238628+0000","last_fullsized":"2024-04-01T19:59:36.238628+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:51.220468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":21,"reported_epoch":741,"state":"active+clean","last_fresh":"2024-04-01T19:59:38.015855+0000","last_change":"2024-04-01T19:59:28.150633+0000","last_active":"2024-04-01T19:59:38.015855+0000","last_peered":"2024-04-01T19:59:38.015855+0000","last_clean":"2024-04-01T19:59:38.015855+0000","last_became_active":"2024-04-01T19:59:28.150334+0000","last_became_peered":"2024-04-01T19:59:28.150334+0000","last_unstale":"2024-04-01T19:59:38.015855+0000","last_undegraded":"2024-04-01T19:59:38.015855+0000","last_fullsized":"2024-04-01T19:59:38.015855+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:41.119934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":16,"reported_epoch":739,"state":"active+clean","last_fresh":"2024-04-01T19:59:33.655607+0000","last_change":"2024-04-01T19:59:28.154806+0000","last_active":"2024-04-01T19:59:33.655607+0000","last_peered":"2024-04-01T19:59:33.655607+0000","last_clean":"2024-04-01T19:59:33.655607+0000","last_became_active":"2024-04-01T19:59:28.154515+0000","last_became_peered":"2024-04-01T19:59:28.154515+0000","last_unstale":"2024-04-01T19:59:33.655607+0000","last_undegraded":"2024-04-01T19:59:33.655607+0000","last_fullsized":"2024-04-01T19:59:33.655607+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:43.995128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":18,"reported_epoch":740,"state":"active+clean","last_fresh":"2024-04-01T19:59:36.238624+0000","last_change":"2024-04-01T19:59:28.153871+0000","last_active":"2024-04-01T19:59:36.238624+0000","last_peered":"2024-04-01T19:59:36.238624+0000","last_clean":"2024-04-01T19:59:36.238624+0000","last_became_active":"2024-04-01T19:59:28.153590+0000","last_became_peered":"2024-04-01T19:59:28.153590+0000","last_unstale":"2024-04-01T19:59:36.238624+0000","last_undegraded":"2024-04-01T19:59:36.238624+0000","last_fullsized":"2024-04-01T19:59:36.238624+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:54.970877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":18,"reported_epoch":740,"state":"active+clean","last_fresh":"2024-04-01T19:59:35.548028+0000","last_change":"2024-04-01T19:59:28.149516+0000","last_active":"2024-04-01T19:59:35.548028+0000","last_peered":"2024-04-01T19:59:35.548028+0000","last_clean":"2024-04-01T19:59:35.548028+0000","last_became_active":"2024-04-01T19:59:28.149183+0000","last_became_peered":"2024-04-01T19:59:28.149183+0000","last_unstale":"2024-04-01T19:59:35.548028+0000","last_undegraded":"2024-04-01T19:59:35.548028+0000","last_fullsized":"2024-04-01T19:59:35.548028+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:43.685232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":16,"reported_epoch":739,"state":"active+clean","last_fresh":"2024-04-01T19:59:33.561798+0000","last_change":"2024-04-01T19:59:28.150737+0000","last_active":"2024-04-01T19:59:33.561798+0000","last_peered":"2024-04-01T19:59:33.561798+0000","last_clean":"2024-04-01T19:59:33.561798+0000","last_became_active":"2024-04-01T19:59:28.150450+0000","last_became_peered":"2024-04-01T19:59:28.150450+0000","last_unstale":"2024-04-01T19:59:33.561798+0000","last_undegraded":"2024-04-01T19:59:33.561798+0000","last_fullsized":"2024-04-01T19:59:33.561798+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:43.422515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":16,"reported_epoch":739,"state":"active+clean","last_fresh":"2024-04-01T19:59:33.561809+0000","last_change":"2024-04-01T19:59:28.152371+0000","last_active":"2024-04-01T19:59:33.561809+0000","last_peered":"2024-04-01T19:59:33.561809+0000","last_clean":"2024-04-01T19:59:33.561809+0000","last_became_active":"2024-04-01T19:59:28.151577+0000","last_became_peered":"2024-04-01T19:59:28.151577+0000","last_unstale":"2024-04-01T19:59:33.561809+0000","last_undegraded":"2024-04-01T19:59:33.561809+0000","last_fullsized":"2024-04-01T19:59:33.561809+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:27.713408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":18,"reported_epoch":740,"state":"active+clean","last_fresh":"2024-04-01T19:59:35.547139+0000","last_change":"2024-04-01T19:59:28.151735+0000","last_active":"2024-04-01T19:59:35.547139+0000","last_peered":"2024-04-01T19:59:35.547139+0000","last_clean":"2024-04-01T19:59:35.547139+0000","last_became_active":"2024-04-01T19:59:28.151479+0000","last_became_peered":"2024-04-01T19:59:28.151479+0000","last_unstale":"2024-04-01T19:59:35.547139+0000","last_undegraded":"2024-04-01T19:59:35.547139+0000","last_fullsized":"2024-04-01T19:59:35.547139+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:45.633610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":16,"reported_epoch":739,"state":"active+clean","last_fresh":"2024-04-01T19:59:33.655534+0000","last_change":"2024-04-01T19:59:28.244498+0000","last_active":"2024-04-01T19:59:33.655534+0000","last_peered":"2024-04-01T19:59:33.655534+0000","last_clean":"2024-04-01T19:59:33.655534+0000","last_became_active":"2024-04-01T19:59:28.244137+0000","last_became_peered":"2024-04-01T19:59:28.244137+0000","last_unstale":"2024-04-01T19:59:33.655534+0000","last_undegraded":"2024-04-01T19:59:33.655534+0000","last_fullsized":"2024-04-01T19:59:33.655534+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:38.809945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":16,"reported_epoch":739,"state":"active+clean","last_fresh":"2024-04-01T19:59:33.656076+0000","last_change":"2024-04-01T19:59:28.153018+0000","last_active":"2024-04-01T19:59:33.656076+0000","last_peered":"2024-04-01T19:59:33.656076+0000","last_clean":"2024-04-01T19:59:33.656076+0000","last_became_active":"2024-04-01T19:59:28.152370+0000","last_became_peered":"2024-04-01T19:59:28.152370+0000","last_unstale":"2024-04-01T19:59:33.656076+0000","last_undegraded":"2024-04-01T19:59:33.656076+0000","last_fullsized":"2024-04-01T19:59:33.656076+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:48.090059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11],"acting":[9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":1817,"reported_epoch":741,"state":"active+clean","last_fresh":"2024-04-01T19:59:38.015804+0000","last_change":"2024-04-01T19:59:06.207530+0000","last_active":"2024-04-01T19:59:38.015804+0000","last_peered":"2024-04-01T19:59:38.015804+0000","last_clean":"2024-04-01T19:59:38.015804+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:59:38.015804+0000","last_undegraded":"2024-04-01T19:59:38.015804+0000","last_fullsized":"2024-04-01T19:59:38.015804+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:59:06.207374+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:59:06.207374+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:34.869784+0000","scrub_duration":166,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220604,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":894948,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":893310,"kb_avail":92850204,"statfs":{"total":95995035648,"available":95078608896,"internally_reserved":0,"allocated":1662976,"data_stored":1088355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":914749892},"hb_peers":[0,1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678471,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":591772,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":590654,"kb_avail":93153380,"statfs":{"total":95995035648,"available":95389061120,"internally_reserved":0,"allocated":1130496,"data_stored":559447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":604830144},"hb_peers":[0,1,2,3,4,5,6,7,8,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557668,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":219228,"kb_used_data":1104,"kb_used_omap":132,"kb_used_meta":217979,"kb_avail":93525924,"statfs":{"total":95995035648,"available":95770546176,"internally_reserved":0,"allocated":1130496,"data_stored":559447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":223211239},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234450,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":642300,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":640638,"kb_avail":93102852,"statfs":{"total":95995035648,"available":95337320448,"internally_reserved":0,"allocated":1687552,"data_stored":1101170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":656013770},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":457,"seq":1962800054461,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":253980,"kb_used_data":1104,"kb_used_omap":744,"kb_used_meta":252119,"kb_avail":93491172,"statfs":{"total":95995035648,"available":95734960128,"internally_reserved":0,"allocated":1130496,"data_stored":559447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":762131,"internal_metadata":258170605},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":2452426326129,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":766684,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":765566,"kb_avail":92978468,"statfs":{"total":95995035648,"available":95209951232,"internally_reserved":0,"allocated":1130496,"data_stored":559447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":783940037},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346411,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":613980,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":612862,"kb_avail":93131172,"statfs":{"total":95995035648,"available":95366320128,"internally_reserved":0,"allocated":1130496,"data_stored":559447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":627571141},"hb_peers":[0,1,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669150181,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":754220,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":753086,"kb_avail":92990932,"statfs":{"total":95995035648,"available":95222714368,"internally_reserved":0,"allocated":1142784,"data_stored":565668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":771160519},"hb_peers":[0,1,2,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953951,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":704232,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":703102,"kb_avail":93040920,"statfs":{"total":95995035648,"available":95273902080,"internally_reserved":0,"allocated":1142784,"data_stored":565668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":719976901},"hb_peers":[0,1,2,3,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790427,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":690332,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":689214,"kb_avail":93054820,"statfs":{"total":95995035648,"available":95288135680,"internally_reserved":0,"allocated":1130496,"data_stored":559447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":705755589},"hb_peers":[0,1,2,3,4,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:59:42.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:42 smithi188 ceph-mon[43939]: pgmap v2027: 17 pgs: 17 active+clean; 97 MiB data, 6.0 GiB used, 888 GiB / 894 GiB avail; 16 MiB/s wr, 258 op/s 2024-04-01T19:59:42.703 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:59:42.746 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:42.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:42 smithi062 ceph-mon[44211]: pgmap v2027: 17 pgs: 17 active+clean; 97 MiB data, 6.0 GiB used, 888 GiB / 894 GiB avail; 16 MiB/s wr, 258 op/s 2024-04-01T19:59:42.773 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:59:42.777 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:42.777 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:59:42.878 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T19:59:42.918 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:42.945 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T19:59:42.949 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:42.949 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T19:59:43.050 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:59:43.053 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:59:43.092 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:43.120 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:59:43.124 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:43.125 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:59:43.226 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:59:43.268 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:43.296 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:59:43.300 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:43.300 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:59:43.401 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:59:43.435 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:43.474 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 3 16 14576 14560 303.311 275.312 0.00217706 0.00329245 2024-04-01T19:59:43.515 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T19:59:43.564 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:59:43.568 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:43.568 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:59:43.573 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:43 smithi022 ceph-mon[39439]: pgmap v2028: 17 pgs: 17 active+clean; 213 MiB data, 6.2 GiB used, 888 GiB / 894 GiB avail; 27 MiB/s wr, 431 op/s 2024-04-01T19:59:43.669 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T19:59:43.702 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:43.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:43 smithi188 ceph-mon[43939]: pgmap v2028: 17 pgs: 17 active+clean; 213 MiB data, 6.2 GiB used, 888 GiB / 894 GiB avail; 27 MiB/s wr, 431 op/s 2024-04-01T19:59:44.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:43 smithi062 ceph-mon[44211]: pgmap v2028: 17 pgs: 17 active+clean; 213 MiB data, 6.2 GiB used, 888 GiB / 894 GiB avail; 27 MiB/s wr, 431 op/s 2024-04-01T19:59:44.158 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T19:59:44.161 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:44.162 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T19:59:44.262 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:59:44.267 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T19:59:44.267 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T19:59:44.267 INFO:teuthology.orchestra.run.smithi022.stdout: "complaint_time": 30, 2024-04-01T19:59:44.267 INFO:teuthology.orchestra.run.smithi022.stdout: "num_blocked_ops": 0 2024-04-01T19:59:44.267 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T19:59:44.306 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:44.331 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:59:44.335 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:44.335 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:59:44.436 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:59:44.474 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 4 15 18746 18731 292.65 260.688 0.00406034 0.0034126 2024-04-01T19:59:44.477 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:44.509 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:59:44.512 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:44.513 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:59:44.613 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:59:44.655 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:44.682 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:59:44.686 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:44.686 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:59:44.787 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:59:44.828 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:44.849 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:59:44.852 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:44.852 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:59:44.953 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T19:59:45.077 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_historic_ops 2024-04-01T19:59:45.121 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:45.153 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T19:59:45.157 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:45.158 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T19:59:45.259 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:59:45.292 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:45.475 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 5 16 22472 22456 280.602 232.812 0.00707014 0.00356133 2024-04-01T19:59:45.621 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T19:59:45.647 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:59:45.650 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:45.651 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:59:45.681 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:59:45.752 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:59:45.779 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:45 smithi022 ceph-mon[39439]: pgmap v2029: 17 pgs: 17 active+clean; 626 MiB data, 6.7 GiB used, 887 GiB / 894 GiB avail; 77 MiB/s wr, 1.23k op/s 2024-04-01T19:59:45.781 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:45.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:45 smithi188 ceph-mon[43939]: pgmap v2029: 17 pgs: 17 active+clean; 626 MiB data, 6.7 GiB used, 887 GiB / 894 GiB avail; 77 MiB/s wr, 1.23k op/s 2024-04-01T19:59:46.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:45 smithi062 ceph-mon[44211]: pgmap v2029: 17 pgs: 17 active+clean; 626 MiB data, 6.7 GiB used, 887 GiB / 894 GiB avail; 77 MiB/s wr, 1.23k op/s 2024-04-01T19:59:46.475 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 6 16 26072 26056 271.334 225 0.00477182 0.00368343 2024-04-01T19:59:46.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:46 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:59:46.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:46 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:59:46.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:46 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:59:46.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:46 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:59:47.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:46 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:59:47.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:46 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:59:47.476 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 7 16 29512 29496 263.285 215 0.00523459 0.00379582 2024-04-01T19:59:47.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:47 smithi022 ceph-mon[39439]: osdmap e743: 12 total, 11 up, 10 in 2024-04-01T19:59:47.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:47 smithi022 ceph-mon[39439]: pgmap v2031: 17 pgs: 17 active+clean; 1.3 GiB data, 8.3 GiB used, 886 GiB / 894 GiB avail; 160 MiB/s wr, 2.56k op/s 2024-04-01T19:59:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:47 smithi188 ceph-mon[43939]: osdmap e743: 12 total, 11 up, 10 in 2024-04-01T19:59:47.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:47 smithi188 ceph-mon[43939]: pgmap v2031: 17 pgs: 17 active+clean; 1.3 GiB data, 8.3 GiB used, 886 GiB / 894 GiB avail; 160 MiB/s wr, 2.56k op/s 2024-04-01T19:59:48.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:47 smithi062 ceph-mon[44211]: osdmap e743: 12 total, 11 up, 10 in 2024-04-01T19:59:48.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:47 smithi062 ceph-mon[44211]: pgmap v2031: 17 pgs: 17 active+clean; 1.3 GiB data, 8.3 GiB used, 886 GiB / 894 GiB avail; 160 MiB/s wr, 2.56k op/s 2024-04-01T19:59:48.475 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 8 16 32744 32728 255.624 202 0.00257283 0.00391006 2024-04-01T19:59:48.844 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T19:59:48.844 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T19:59:48.844 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T19:59:48.844 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T19:59:48.844 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T19:59:48.844 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T19:59:48.844 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T19:59:48.844 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T19:59:48.845 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T19:59:48.845 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T19:59:48.845 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T19:59:48.845 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T19:59:48.845 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T19:59:48.845 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T19:59:48.845 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T19:59:48.845 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T19:59:48.845 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T19:59:48.845 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T19:59:48.845 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T19:59:48.845 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T19:59:48.845 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T19:59:48.846 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.10 2024-04-01T19:59:48.846 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T19:59:48.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:48 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/472833902' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:59:48.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:48 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:48 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/472833902' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:59:48.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:48 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:49.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:48 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/472833902' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T19:59:49.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:48 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:49.071 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:59:49.075 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:49.076 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:59:49.177 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:59:49.219 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:49.261 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:59:49.264 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:49.264 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:59:49.365 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:59:49.398 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:49.476 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 9 15 35854 35839 248.825 194.438 0.00661232 0.00401729 2024-04-01T19:59:49.577 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:49.577 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:49.577 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:49.577 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:49.577 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:49.577 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:49.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:49.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:49.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:49.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:49.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:49.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:49.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:49.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:49.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:49.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:49 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:49.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:49 smithi022 ceph-mon[39439]: pgmap v2032: 17 pgs: 17 active+clean; 1.6 GiB data, 8.8 GiB used, 885 GiB / 894 GiB avail; 184 MiB/s wr, 2.95k op/s 2024-04-01T19:59:49.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:49.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:49.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:49.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:49 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:49.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:49 smithi188 ceph-mon[43939]: pgmap v2032: 17 pgs: 17 active+clean; 1.6 GiB data, 8.8 GiB used, 885 GiB / 894 GiB avail; 184 MiB/s wr, 2.95k op/s 2024-04-01T19:59:50.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:50.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:50.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:50.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:50.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:50.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:50.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:50.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:50.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:50.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:49 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T19:59:50.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:49 smithi062 ceph-mon[44211]: pgmap v2032: 17 pgs: 17 active+clean; 1.6 GiB data, 8.8 GiB used, 885 GiB / 894 GiB avail; 184 MiB/s wr, 2.95k op/s 2024-04-01T19:59:50.136 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T19:59:50.137 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T19:59:50.440 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:59:50.451 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:59:50.456 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:50.456 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:59:50.476 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 10 16 38712 38696 241.796 178.562 0.00377966 0.00413412 2024-04-01T19:59:50.480 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:59:50.557 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:59:50.608 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:50.645 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:59:50.650 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:50.650 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:59:50.751 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:59:50.785 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:51.476 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 11 16 41527 41511 235.807 175.938 0.00439839 0.00423887 2024-04-01T19:59:51.551 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:51 smithi022 ceph-mon[39439]: osdmap e744: 12 total, 11 up, 10 in 2024-04-01T19:59:51.551 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:51 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:59:51.551 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:51 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:59:51.551 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:51 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:59:51.551 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:51 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:59:51.551 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:51 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:59:51.551 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:51 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:59:51.551 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:51 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:59:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:51 smithi188 ceph-mon[43939]: osdmap e744: 12 total, 11 up, 10 in 2024-04-01T19:59:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:51 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:59:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:51 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:59:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:51 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:59:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:51 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:59:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:51 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:59:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:51 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:59:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:51 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:59:52.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:51 smithi062 ceph-mon[44211]: osdmap e744: 12 total, 11 up, 10 in 2024-04-01T19:59:52.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:51 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T19:59:52.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:51 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T19:59:52.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:51 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T19:59:52.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:51 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T19:59:52.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:51 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T19:59:52.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:51 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T19:59:52.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:51 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T19:59:52.138 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T19:59:52.477 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 12 15 44281 44266 230.489 172.188 0.00639281 0.00433626 2024-04-01T19:59:52.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:52 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:59:52.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:52 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:59:52.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:52 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2348866295' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:59:52.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:52 smithi022 ceph-mon[39439]: from='client.27367 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:59:52.568 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T19:59:52.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:52 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:59:52.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:52 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:59:52.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:52 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2348866295' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:59:52.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:52 smithi188 ceph-mon[43939]: from='client.27367 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:59:53.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:52 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:59:53.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:52 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:59:53.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:52 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2348866295' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:59:53.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:52 smithi062 ceph-mon[44211]: from='client.27367 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T19:59:53.437 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:59:53.442 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:53.443 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:59:53.477 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 13 16 46952 46936 225.594 166.875 0.00887601 0.00443142 2024-04-01T19:59:53.544 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:59:53.577 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:53.707 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:59:53.714 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:53 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:59:53.714 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:53 smithi022 ceph-mon[39439]: from='client.27367 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:59:53.714 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:53 smithi022 ceph-mon[39439]: osdmap e745: 12 total, 11 up, 10 in 2024-04-01T19:59:53.714 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:53 smithi022 ceph-mon[39439]: pgmap v2036: 17 pgs: 17 active+clean; 2.4 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 181 MiB/s wr, 2.89k op/s 2024-04-01T19:59:53.715 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:53.715 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:59:53.816 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:59:53.864 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:53 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:59:53.864 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:53 smithi062 ceph-mon[44211]: from='client.27367 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:59:53.864 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:53 smithi062 ceph-mon[44211]: osdmap e745: 12 total, 11 up, 10 in 2024-04-01T19:59:53.864 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:53 smithi062 ceph-mon[44211]: pgmap v2036: 17 pgs: 17 active+clean; 2.4 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 181 MiB/s wr, 2.89k op/s 2024-04-01T19:59:53.867 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:53.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:53 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T19:59:53.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:53 smithi188 ceph-mon[43939]: from='client.27367 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T19:59:53.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:53 smithi188 ceph-mon[43939]: osdmap e745: 12 total, 11 up, 10 in 2024-04-01T19:59:53.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:53 smithi188 ceph-mon[43939]: pgmap v2036: 17 pgs: 17 active+clean; 2.4 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 181 MiB/s wr, 2.89k op/s 2024-04-01T19:59:53.904 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:59:53.908 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:53.909 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:59:54.010 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:59:54.056 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:54.088 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:59:54.092 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:54.093 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:59:54.194 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:59:54.224 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:54.249 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:59:54.252 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:54.252 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:59:54.353 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T19:59:54.397 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:54.427 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T19:59:54.434 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:54.434 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T19:59:54.477 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 14 16 49476 49460 220.748 157.75 0.00465046 0.00452794 2024-04-01T19:59:54.535 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T19:59:54.567 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:55.477 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 15 16 51968 51952 216.414 155.75 0.0084021 0.00461858 2024-04-01T19:59:55.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:55 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T19:59:55.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:55 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T19:59:55.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:55 smithi022 ceph-mon[39439]: osdmap e746: 12 total, 11 up, 10 in 2024-04-01T19:59:55.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:55 smithi022 ceph-mon[39439]: pgmap v2038: 17 pgs: 17 active+clean; 2.7 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 188 MiB/s wr, 3.01k op/s 2024-04-01T19:59:55.719 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T19:59:55.721 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:55.722 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T19:59:55.823 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:59:55.854 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:55.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:55 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T19:59:55.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:55 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T19:59:55.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:55 smithi188 ceph-mon[43939]: osdmap e746: 12 total, 11 up, 10 in 2024-04-01T19:59:55.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:55 smithi188 ceph-mon[43939]: pgmap v2038: 17 pgs: 17 active+clean; 2.7 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 188 MiB/s wr, 3.01k op/s 2024-04-01T19:59:55.953 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:59:55.957 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:55.958 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:59:55.995 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:59:56.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:55 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T19:59:56.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:55 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T19:59:56.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:55 smithi062 ceph-mon[44211]: osdmap e746: 12 total, 11 up, 10 in 2024-04-01T19:59:56.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:55 smithi062 ceph-mon[44211]: pgmap v2038: 17 pgs: 17 active+clean; 2.7 GiB data, 11 GiB used, 883 GiB / 894 GiB avail; 188 MiB/s wr, 3.01k op/s 2024-04-01T19:59:56.059 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:59:56.111 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:56.141 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:59:56.145 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:56.146 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:59:56.247 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:59:56.279 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:56.315 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:59:56.316 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T19:59:56.316 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T19:59:56.320 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:56.320 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T19:59:56.421 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:59:56.456 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:56.477 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 16 16 54383 54367 212.322 150.938 0.00614873 0.00470818 2024-04-01T19:59:56.581 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:59:56.584 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:56.585 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:59:56.686 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T19:59:56.736 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:56.767 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T19:59:56.773 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:56.773 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T19:59:56.875 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:59:56.882 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T19:59:56.920 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:56.948 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:59:56.951 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:56.952 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:59:57.053 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:59:57.090 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:57.477 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 17 15 56624 56609 208.075 140.125 0.00506903 0.00480447 2024-04-01T19:59:57.591 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T19:59:57.591 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T19:59:57.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:57 smithi022 ceph-mon[39439]: from='client.17418 v1:172.21.15.22:0/3471712623' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:59:57.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:57 smithi022 ceph-mon[39439]: pgmap v2039: 17 pgs: 17 active+clean; 3.1 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 195 MiB/s wr, 3.11k op/s 2024-04-01T19:59:57.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:57 smithi188 ceph-mon[43939]: from='client.17418 v1:172.21.15.22:0/3471712623' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:59:57.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:57 smithi188 ceph-mon[43939]: pgmap v2039: 17 pgs: 17 active+clean; 3.1 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 195 MiB/s wr, 3.11k op/s 2024-04-01T19:59:58.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:57 smithi062 ceph-mon[44211]: from='client.17418 v1:172.21.15.22:0/3471712623' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T19:59:58.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:57 smithi062 ceph-mon[44211]: pgmap v2039: 17 pgs: 17 active+clean; 3.1 GiB data, 12 GiB used, 882 GiB / 894 GiB avail; 195 MiB/s wr, 3.11k op/s 2024-04-01T19:59:58.145 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:59:58.148 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:58.149 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:59:58.250 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:59:58.290 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:58.320 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:59:58.324 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:58.325 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:59:58.426 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T19:59:58.472 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:58.477 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 18 16 58777 58761 203.987 134.5 0.00934845 0.00489999 2024-04-01T19:59:58.507 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T19:59:58.511 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:58.511 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T19:59:58.612 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T19:59:58.654 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:58.688 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T19:59:58.692 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:58.692 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T19:59:58.793 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T19:59:58.826 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:58.855 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T19:59:58.859 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:58.859 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T19:59:58.960 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T19:59:58.990 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:59.346 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_ops_in_flight 2024-04-01T19:59:59.477 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 19 16 60809 60793 199.935 127 0.00796073 0.00499984 2024-04-01T19:59:59.542 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T19:59:59.545 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:59.546 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T19:59:59.579 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 19:59:59 smithi022 ceph-mon[39439]: pgmap v2040: 17 pgs: 17 active+clean; 3.3 GiB data, 13 GiB used, 882 GiB / 894 GiB avail; 142 MiB/s wr, 2.27k op/s 2024-04-01T19:59:59.647 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T19:59:59.679 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T19:59:59.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 19:59:59 smithi188 ceph-mon[43939]: pgmap v2040: 17 pgs: 17 active+clean; 3.3 GiB data, 13 GiB used, 882 GiB / 894 GiB avail; 142 MiB/s wr, 2.27k op/s 2024-04-01T19:59:59.891 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T19:59:59.928 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":2038,"stamp":"2024-04-01T19:59:55.426558+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2897936928,"num_objects":44212,"num_object_clones":0,"num_object_copies":88424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44212,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":44391,"num_write_kb":2832378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44349,"ondisk_log_size":44349,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":937451520,"kb_used":11765052,"kb_used_data":5408148,"kb_used_omap":889,"kb_used_meta":6355910,"kb_avail":925686468,"statfs":{"total":959950356480,"available":947902943232,"internally_reserved":0,"allocated":5537943552,"data_stored":5531921604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":910339,"internal_metadata":6508452861},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1182269440,"num_objects":18040,"num_object_clones":0,"num_object_copies":36080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18040,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18040,"num_write_kb":1154560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001000"},"pg_stats":[{"pgid":"9.f","version":"744'2449","reported_seq":2475,"reported_epoch":744,"state":"active+clean","last_fresh":"2024-04-01T19:59:51.072691+0000","last_change":"2024-04-01T19:59:28.154819+0000","last_active":"2024-04-01T19:59:51.072691+0000","last_peered":"2024-04-01T19:59:51.072691+0000","last_clean":"2024-04-01T19:59:51.072691+0000","last_became_active":"2024-04-01T19:59:28.154474+0000","last_became_peered":"2024-04-01T19:59:28.154474+0000","last_unstale":"2024-04-01T19:59:51.072691+0000","last_undegraded":"2024-04-01T19:59:51.072691+0000","last_fullsized":"2024-04-01T19:59:51.072691+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":2449,"log_dups_size":0,"ondisk_log_size":2449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:29.561267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160497664,"num_objects":2449,"num_object_clones":0,"num_object_copies":4898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2449,"num_write_kb":156736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.e","version":"745'2949","reported_seq":2978,"reported_epoch":745,"state":"active+clean","last_fresh":"2024-04-01T19:59:53.909701+0000","last_change":"2024-04-01T19:59:28.152165+0000","last_active":"2024-04-01T19:59:53.909701+0000","last_peered":"2024-04-01T19:59:53.909701+0000","last_clean":"2024-04-01T19:59:53.909701+0000","last_became_active":"2024-04-01T19:59:28.151863+0000","last_became_peered":"2024-04-01T19:59:28.151863+0000","last_unstale":"2024-04-01T19:59:53.909701+0000","last_undegraded":"2024-04-01T19:59:53.909701+0000","last_fullsized":"2024-04-01T19:59:53.909701+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":2949,"log_dups_size":0,"ondisk_log_size":2949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:32.153574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193265664,"num_objects":2949,"num_object_clones":0,"num_object_copies":5898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2949,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2949,"num_write_kb":188736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"745'3005","reported_seq":3034,"reported_epoch":745,"state":"active+clean","last_fresh":"2024-04-01T19:59:53.916932+0000","last_change":"2024-04-01T19:59:28.153611+0000","last_active":"2024-04-01T19:59:53.916932+0000","last_peered":"2024-04-01T19:59:53.916932+0000","last_clean":"2024-04-01T19:59:53.916932+0000","last_became_active":"2024-04-01T19:59:28.153275+0000","last_became_peered":"2024-04-01T19:59:28.153275+0000","last_unstale":"2024-04-01T19:59:53.916932+0000","last_undegraded":"2024-04-01T19:59:53.916932+0000","last_fullsized":"2024-04-01T19:59:53.916932+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":3005,"log_dups_size":0,"ondisk_log_size":3005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:46.257638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196935680,"num_objects":3005,"num_object_clones":0,"num_object_copies":6010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3005,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3005,"num_write_kb":192320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.c","version":"745'2820","reported_seq":2849,"reported_epoch":745,"state":"active+clean","last_fresh":"2024-04-01T19:59:52.732298+0000","last_change":"2024-04-01T19:59:28.152444+0000","last_active":"2024-04-01T19:59:52.732298+0000","last_peered":"2024-04-01T19:59:52.732298+0000","last_clean":"2024-04-01T19:59:52.732298+0000","last_became_active":"2024-04-01T19:59:28.152217+0000","last_became_peered":"2024-04-01T19:59:28.152217+0000","last_unstale":"2024-04-01T19:59:52.732298+0000","last_undegraded":"2024-04-01T19:59:52.732298+0000","last_fullsized":"2024-04-01T19:59:52.732298+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":2820,"log_dups_size":0,"ondisk_log_size":2820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:54.566553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184811520,"num_objects":2820,"num_object_clones":0,"num_object_copies":5640,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2820,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2820,"num_write_kb":180480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"745'3124","reported_seq":3153,"reported_epoch":745,"state":"active+clean","last_fresh":"2024-04-01T19:59:54.461696+0000","last_change":"2024-04-01T19:59:28.153735+0000","last_active":"2024-04-01T19:59:54.461696+0000","last_peered":"2024-04-01T19:59:54.461696+0000","last_clean":"2024-04-01T19:59:54.461696+0000","last_became_active":"2024-04-01T19:59:28.153409+0000","last_became_peered":"2024-04-01T19:59:28.153409+0000","last_unstale":"2024-04-01T19:59:54.461696+0000","last_undegraded":"2024-04-01T19:59:54.461696+0000","last_fullsized":"2024-04-01T19:59:54.461696+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":3124,"log_dups_size":0,"ondisk_log_size":3124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:30.973166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204734464,"num_objects":3124,"num_object_clones":0,"num_object_copies":6248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3124,"num_write_kb":199936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"9.a","version":"744'2558","reported_seq":2585,"reported_epoch":744,"state":"active+clean","last_fresh":"2024-04-01T19:59:51.058110+0000","last_change":"2024-04-01T19:59:28.153919+0000","last_active":"2024-04-01T19:59:51.058110+0000","last_peered":"2024-04-01T19:59:51.058110+0000","last_clean":"2024-04-01T19:59:51.058110+0000","last_became_active":"2024-04-01T19:59:28.153559+0000","last_became_peered":"2024-04-01T19:59:28.153559+0000","last_unstale":"2024-04-01T19:59:51.058110+0000","last_undegraded":"2024-04-01T19:59:51.058110+0000","last_fullsized":"2024-04-01T19:59:51.058110+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":2558,"log_dups_size":0,"ondisk_log_size":2558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:35.575567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167641088,"num_objects":2558,"num_object_clones":0,"num_object_copies":5116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2558,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2558,"num_write_kb":163712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"744'2601","reported_seq":2628,"reported_epoch":744,"state":"active+clean","last_fresh":"2024-04-01T19:59:51.336568+0000","last_change":"2024-04-01T19:59:28.153739+0000","last_active":"2024-04-01T19:59:51.336568+0000","last_peered":"2024-04-01T19:59:51.336568+0000","last_clean":"2024-04-01T19:59:51.336568+0000","last_became_active":"2024-04-01T19:59:28.153481+0000","last_became_peered":"2024-04-01T19:59:28.153481+0000","last_unstale":"2024-04-01T19:59:51.336568+0000","last_undegraded":"2024-04-01T19:59:51.336568+0000","last_fullsized":"2024-04-01T19:59:51.336568+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":2601,"log_dups_size":0,"ondisk_log_size":2601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:52.253028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170459136,"num_objects":2601,"num_object_clones":0,"num_object_copies":5202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2601,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2601,"num_write_kb":166464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"9.7","version":"745'2948","reported_seq":2977,"reported_epoch":745,"state":"active+clean","last_fresh":"2024-04-01T19:59:53.920125+0000","last_change":"2024-04-01T19:59:28.150633+0000","last_active":"2024-04-01T19:59:53.920125+0000","last_peered":"2024-04-01T19:59:53.920125+0000","last_clean":"2024-04-01T19:59:53.920125+0000","last_became_active":"2024-04-01T19:59:28.150334+0000","last_became_peered":"2024-04-01T19:59:28.150334+0000","last_unstale":"2024-04-01T19:59:53.920125+0000","last_undegraded":"2024-04-01T19:59:53.920125+0000","last_fullsized":"2024-04-01T19:59:53.920125+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":2948,"log_dups_size":0,"ondisk_log_size":2948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:41.119934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193200128,"num_objects":2948,"num_object_clones":0,"num_object_copies":5896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2948,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2948,"num_write_kb":188672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"744'2528","reported_seq":2554,"reported_epoch":744,"state":"active+clean","last_fresh":"2024-04-01T19:59:51.061390+0000","last_change":"2024-04-01T19:59:28.154806+0000","last_active":"2024-04-01T19:59:51.061390+0000","last_peered":"2024-04-01T19:59:51.061390+0000","last_clean":"2024-04-01T19:59:51.061390+0000","last_became_active":"2024-04-01T19:59:28.154515+0000","last_became_peered":"2024-04-01T19:59:28.154515+0000","last_unstale":"2024-04-01T19:59:51.061390+0000","last_undegraded":"2024-04-01T19:59:51.061390+0000","last_fullsized":"2024-04-01T19:59:51.061390+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":2528,"log_dups_size":0,"ondisk_log_size":2528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:42.163388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165675008,"num_objects":2528,"num_object_clones":0,"num_object_copies":5056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2528,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2528,"num_write_kb":161792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"744'2531","reported_seq":2558,"reported_epoch":744,"state":"active+clean","last_fresh":"2024-04-01T19:59:51.320677+0000","last_change":"2024-04-01T19:59:28.153871+0000","last_active":"2024-04-01T19:59:51.320677+0000","last_peered":"2024-04-01T19:59:51.320677+0000","last_clean":"2024-04-01T19:59:51.320677+0000","last_became_active":"2024-04-01T19:59:28.153590+0000","last_became_peered":"2024-04-01T19:59:28.153590+0000","last_unstale":"2024-04-01T19:59:51.320677+0000","last_undegraded":"2024-04-01T19:59:51.320677+0000","last_fullsized":"2024-04-01T19:59:51.320677+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":2531,"log_dups_size":0,"ondisk_log_size":2531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:32.219310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165871616,"num_objects":2531,"num_object_clones":0,"num_object_copies":5062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2531,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2531,"num_write_kb":161984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"9.4","version":"744'2629","reported_seq":2656,"reported_epoch":744,"state":"active+clean","last_fresh":"2024-04-01T19:59:51.693766+0000","last_change":"2024-04-01T19:59:28.149516+0000","last_active":"2024-04-01T19:59:51.693766+0000","last_peered":"2024-04-01T19:59:51.693766+0000","last_clean":"2024-04-01T19:59:51.693766+0000","last_became_active":"2024-04-01T19:59:28.149183+0000","last_became_peered":"2024-04-01T19:59:28.149183+0000","last_unstale":"2024-04-01T19:59:51.693766+0000","last_undegraded":"2024-04-01T19:59:51.693766+0000","last_fullsized":"2024-04-01T19:59:51.693766+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":2629,"log_dups_size":0,"ondisk_log_size":2629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:41.960741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172294144,"num_objects":2629,"num_object_clones":0,"num_object_copies":5258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2629,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2629,"num_write_kb":168256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3","version":"745'3131","reported_seq":3160,"reported_epoch":745,"state":"active+clean","last_fresh":"2024-04-01T19:59:54.494717+0000","last_change":"2024-04-01T19:59:28.150737+0000","last_active":"2024-04-01T19:59:54.494717+0000","last_peered":"2024-04-01T19:59:54.494717+0000","last_clean":"2024-04-01T19:59:54.494717+0000","last_became_active":"2024-04-01T19:59:28.150450+0000","last_became_peered":"2024-04-01T19:59:28.150450+0000","last_unstale":"2024-04-01T19:59:54.494717+0000","last_undegraded":"2024-04-01T19:59:54.494717+0000","last_fullsized":"2024-04-01T19:59:54.494717+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":3131,"log_dups_size":0,"ondisk_log_size":3131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:47.551272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205193216,"num_objects":3131,"num_object_clones":0,"num_object_copies":6262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3131,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3131,"num_write_kb":200384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"9.2","version":"745'3070","reported_seq":3099,"reported_epoch":745,"state":"active+clean","last_fresh":"2024-04-01T19:59:54.486471+0000","last_change":"2024-04-01T19:59:28.152371+0000","last_active":"2024-04-01T19:59:54.486471+0000","last_peered":"2024-04-01T19:59:54.486471+0000","last_clean":"2024-04-01T19:59:54.486471+0000","last_became_active":"2024-04-01T19:59:28.151577+0000","last_became_peered":"2024-04-01T19:59:28.151577+0000","last_unstale":"2024-04-01T19:59:54.486471+0000","last_undegraded":"2024-04-01T19:59:54.486471+0000","last_fullsized":"2024-04-01T19:59:54.486471+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":3070,"log_dups_size":0,"ondisk_log_size":3070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:45.816486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201195520,"num_objects":3070,"num_object_clones":0,"num_object_copies":6140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3070,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3070,"num_write_kb":196480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"9.1","version":"745'2907","reported_seq":2936,"reported_epoch":745,"state":"active+clean","last_fresh":"2024-04-01T19:59:52.719619+0000","last_change":"2024-04-01T19:59:28.151735+0000","last_active":"2024-04-01T19:59:52.719619+0000","last_peered":"2024-04-01T19:59:52.719619+0000","last_clean":"2024-04-01T19:59:52.719619+0000","last_became_active":"2024-04-01T19:59:28.151479+0000","last_became_peered":"2024-04-01T19:59:28.151479+0000","last_unstale":"2024-04-01T19:59:52.719619+0000","last_undegraded":"2024-04-01T19:59:52.719619+0000","last_fullsized":"2024-04-01T19:59:52.719619+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":2907,"log_dups_size":0,"ondisk_log_size":2907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:42.012383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190513152,"num_objects":2907,"num_object_clones":0,"num_object_copies":5814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2907,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2907,"num_write_kb":186048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"744'2531","reported_seq":2558,"reported_epoch":744,"state":"active+clean","last_fresh":"2024-04-01T19:59:51.068499+0000","last_change":"2024-04-01T19:59:28.244498+0000","last_active":"2024-04-01T19:59:51.068499+0000","last_peered":"2024-04-01T19:59:51.068499+0000","last_clean":"2024-04-01T19:59:51.068499+0000","last_became_active":"2024-04-01T19:59:28.244137+0000","last_became_peered":"2024-04-01T19:59:28.244137+0000","last_unstale":"2024-04-01T19:59:51.068499+0000","last_undegraded":"2024-04-01T19:59:51.068499+0000","last_fullsized":"2024-04-01T19:59:51.068499+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":2531,"log_dups_size":0,"ondisk_log_size":2531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:39.043246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165871616,"num_objects":2531,"num_object_clones":0,"num_object_copies":5062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2531,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2531,"num_write_kb":161984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"744'2429","reported_seq":2455,"reported_epoch":744,"state":"active+clean","last_fresh":"2024-04-01T19:59:50.803419+0000","last_change":"2024-04-01T19:59:28.153018+0000","last_active":"2024-04-01T19:59:50.803419+0000","last_peered":"2024-04-01T19:59:50.803419+0000","last_clean":"2024-04-01T19:59:50.803419+0000","last_became_active":"2024-04-01T19:59:28.152370+0000","last_became_peered":"2024-04-01T19:59:28.152370+0000","last_unstale":"2024-04-01T19:59:50.803419+0000","last_undegraded":"2024-04-01T19:59:50.803419+0000","last_fullsized":"2024-04-01T19:59:50.803419+0000","mapping_epoch":735,"log_start":"0'0","ondisk_log_start":"0'0","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T19:59:27.133854+0000","objects_scrubbed":0,"log_size":2429,"log_dups_size":0,"ondisk_log_size":2429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:44.591600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159186944,"num_objects":2429,"num_object_clones":0,"num_object_copies":4858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2429,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2429,"num_write_kb":155456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11],"acting":[9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":1826,"reported_epoch":745,"state":"active+clean","last_fresh":"2024-04-01T19:59:52.567752+0000","last_change":"2024-04-01T19:59:06.207530+0000","last_active":"2024-04-01T19:59:52.567752+0000","last_peered":"2024-04-01T19:59:52.567752+0000","last_clean":"2024-04-01T19:59:52.567752+0000","last_became_active":"2024-04-01T19:22:55.688661+0000","last_became_peered":"2024-04-01T19:22:55.688661+0000","last_unstale":"2024-04-01T19:59:52.567752+0000","last_undegraded":"2024-04-01T19:59:52.567752+0000","last_fullsized":"2024-04-01T19:59:52.567752+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T19:59:06.207374+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T19:59:06.207374+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:00:34.869784+0000","scrub_duration":166,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":2897346560,"num_objects":44210,"num_object_clones":0,"num_object_copies":88420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44210,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44210,"num_write_kb":2829440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5654183936,"data_stored":5654183936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44210,"ondisk_log_size":44210,"up":32,"acting":32,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2115712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220607,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1396060,"kb_used_data":490260,"kb_used_omap":1,"kb_used_meta":905790,"kb_avail":92349092,"statfs":{"total":95995035648,"available":94565470208,"internally_reserved":0,"allocated":502026240,"data_stored":501421776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":927529412},"hb_peers":[0,1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678474,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1503688,"kb_used_data":881088,"kb_used_omap":1,"kb_used_meta":622590,"kb_avail":92241464,"statfs":{"total":95995035648,"available":94455259136,"internally_reserved":0,"allocated":902234112,"data_stored":901639274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":637532608},"hb_peers":[0,1,2,3,4,5,6,7,8,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557672,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1286112,"kb_used_data":991640,"kb_used_omap":132,"kb_used_meta":294331,"kb_avail":92459040,"statfs":{"total":95995035648,"available":94678056960,"internally_reserved":0,"allocated":1015439360,"data_stored":1014832464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":301395687},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234453,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1196268,"kb_used_data":543136,"kb_used_omap":1,"kb_used_meta":653118,"kb_avail":92548884,"statfs":{"total":95995035648,"available":94770057216,"internally_reserved":0,"allocated":556171264,"data_stored":555560816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":668793290},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":457,"seq":1962800054464,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":393736,"kb_used_data":149184,"kb_used_omap":744,"kb_used_meta":243799,"kb_avail":93351416,"statfs":{"total":95995035648,"available":95591849984,"internally_reserved":0,"allocated":152764416,"data_stored":152169578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":762131,"internal_metadata":249650925},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":2452426326132,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":766744,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":765566,"kb_avail":92978408,"statfs":{"total":95995035648,"available":95209889792,"internally_reserved":0,"allocated":1191936,"data_stored":591044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":783940037},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346414,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":614040,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":612862,"kb_avail":93131112,"statfs":{"total":95995035648,"available":95366258688,"internally_reserved":0,"allocated":1191936,"data_stored":591044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":627571141},"hb_peers":[0,1,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669150184,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1505380,"kb_used_data":725912,"kb_used_omap":1,"kb_used_meta":779454,"kb_avail":92239772,"statfs":{"total":95995035648,"available":94453526528,"internally_reserved":0,"allocated":743333888,"data_stored":742726992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":798161351},"hb_peers":[0,1,2,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953954,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1036568,"kb_used_data":333452,"kb_used_omap":1,"kb_used_meta":703102,"kb_avail":92708584,"statfs":{"total":95995035648,"available":94933590016,"internally_reserved":0,"allocated":341454848,"data_stored":340853956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":719976901},"hb_peers":[0,1,2,3,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790430,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2066456,"kb_used_data":1291148,"kb_used_omap":1,"kb_used_meta":775294,"kb_avail":91678696,"statfs":{"total":95995035648,"available":93878984704,"internally_reserved":0,"allocated":1322135552,"data_stored":1321534660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":793901509},"hb_peers":[0,1,2,3,4,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":743702528,"data_stored":743702528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":346882048,"data_stored":346882048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1322385408,"data_stored":1322385408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":161480704,"data_stored":161480704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":583794688,"data_stored":583794688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":1022361600,"data_stored":1022361600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":971243520,"data_stored":971243520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":502333440,"data_stored":502333440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T19:59:59.929 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-01T19:59:59.930 INFO:tasks.thrashosds.thrasher:Waiting for trim 2024-04-01T19:59:59.930 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T19:59:59.932 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T19:59:59.932 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:00:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 19:59:59 smithi062 ceph-mon[44211]: pgmap v2040: 17 pgs: 17 active+clean; 3.3 GiB data, 13 GiB used, 882 GiB / 894 GiB avail; 142 MiB/s wr, 2.27k op/s 2024-04-01T20:00:00.032 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:00:00.073 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:00.099 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:00:00.102 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:00.102 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:00:00.203 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:00:00.248 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:00.277 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:00:00.280 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:00.281 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:00:00.382 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:00:00.428 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:00.460 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:00:00.463 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:00.464 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:00:00.478 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 20:00:00.480161 min lat: 0.00101525 max lat: 0.0772469 avg lat: 0.00508329 2024-04-01T20:00:00.478 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T20:00:00.478 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 20 16 62951 62935 196.632 133.875 0.00873693 0.00508329 2024-04-01T20:00:00.527 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:00 smithi022 ceph-mon[39439]: Health detail: HEALTH_WARN nodeep-scrub flag(s) set 2024-04-01T20:00:00.527 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:00 smithi022 ceph-mon[39439]: [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set 2024-04-01T20:00:00.564 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:00:00.610 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:00.640 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:00:00.644 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:00.645 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:00:00.746 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:00:00.793 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:00 smithi062 ceph-mon[44211]: Health detail: HEALTH_WARN nodeep-scrub flag(s) set 2024-04-01T20:00:00.793 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:00 smithi062 ceph-mon[44211]: [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set 2024-04-01T20:00:00.796 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:00.835 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:00:00.842 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:00.843 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:00:00.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:00 smithi188 ceph-mon[43939]: Health detail: HEALTH_WARN nodeep-scrub flag(s) set 2024-04-01T20:00:00.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:00 smithi188 ceph-mon[43939]: [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set 2024-04-01T20:00:00.943 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:00:00.979 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:01.004 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:00:01.007 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:01.008 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:00:01.109 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:00:01.149 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:01.176 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:00:01.179 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:01.180 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:00:01.204 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:00:01.204 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:00:01.204 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:00:01.204 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T20:00:01.205 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:00:01.205 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:00:01.205 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:00:01.205 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:00:01.205 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:00:01.205 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:00:01.205 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:00:01.205 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:00:01.205 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:00:01.205 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:00:01.205 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T20:00:01.205 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:00:01.205 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:00:01.206 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:00:01.206 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:00:01.206 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:00:01.206 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:00:01.206 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.10 2024-04-01T20:00:01.206 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:00:01.280 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:00:01.323 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:01.355 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:00:01.363 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:01.363 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:00:01.464 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:00:01.478 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 21 16 64993 64977 193.346 127.625 0.00612283 0.00517047 2024-04-01T20:00:01.496 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:01.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:01 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2154158453' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:00:01.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:01.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:01.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:01 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:01.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:01 smithi062 ceph-mon[44211]: pgmap v2041: 17 pgs: 17 active+clean; 3.7 GiB data, 14 GiB used, 881 GiB / 894 GiB avail; 169 MiB/s wr, 2.70k op/s 2024-04-01T20:00:01.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:01 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2154158453' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:00:01.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:01.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:01.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:01 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:01.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:01 smithi022 ceph-mon[39439]: pgmap v2041: 17 pgs: 17 active+clean; 3.7 GiB data, 14 GiB used, 881 GiB / 894 GiB avail; 169 MiB/s wr, 2.70k op/s 2024-04-01T20:00:01.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:01 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2154158453' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:00:01.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:01.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:01.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:01 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:01.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:01 smithi188 ceph-mon[43939]: pgmap v2041: 17 pgs: 17 active+clean; 3.7 GiB data, 14 GiB used, 881 GiB / 894 GiB avail; 169 MiB/s wr, 2.70k op/s 2024-04-01T20:00:02.089 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T20:00:02.089 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T20:00:02.478 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 22 16 67074 67058 190.469 130.062 0.00488984 0.00524838 2024-04-01T20:00:02.546 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:00:02.549 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:02.550 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:00:02.568 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:00:02.651 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:00:02.681 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:02.807 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:00:02.810 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:02.810 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:00:02.810 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:02.811 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:02.811 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:02.811 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:02.811 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:02.811 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:02.811 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:02.811 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:02 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:02.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:02.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:02.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:02.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:02.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:02.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:02.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:02.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:02 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:02.911 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:00:02.947 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:02.947 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:02.947 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:02.947 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:02.947 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:02.948 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:02.948 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:02.948 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:02 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:02.950 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:02.982 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:00:02.988 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:02.989 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:00:03.089 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:00:03.131 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:03.156 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:00:03.161 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:03.161 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:00:03.262 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:00:03.297 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:03.356 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:00:03.359 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:03.360 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:00:03.460 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:00:03.479 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 23 16 69094 69078 187.668 126.25 0.00966495 0.00532714 2024-04-01T20:00:03.502 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:03.531 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:00:03.536 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:03.537 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:00:03.637 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:00:03.676 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:03.706 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:00:03.710 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:03.710 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:00:03.811 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:00:03.846 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:03 smithi188 ceph-mon[43939]: pgmap v2042: 17 pgs: 17 active+clean; 3.9 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 151 MiB/s wr, 2.41k op/s 2024-04-01T20:00:03.849 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:03.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:03 smithi022 ceph-mon[39439]: pgmap v2042: 17 pgs: 17 active+clean; 3.9 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 151 MiB/s wr, 2.41k op/s 2024-04-01T20:00:03.874 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:00:03.879 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:03.879 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:00:03.980 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:00:04.008 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:03 smithi062 ceph-mon[44211]: pgmap v2042: 17 pgs: 17 active+clean; 3.9 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 151 MiB/s wr, 2.41k op/s 2024-04-01T20:00:04.011 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:04.033 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:00:04.036 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:04.037 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:00:04.090 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T20:00:04.138 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:00:04.182 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:04.211 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:00:04.216 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:04.217 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:00:04.317 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:00:04.358 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:04.394 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:00:04.401 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:04.401 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:00:04.482 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 24 16 70874 70858 184.47 111.25 0.00579331 0.00541906 2024-04-01T20:00:04.502 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:00:04.548 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:04.578 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:00:04.580 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T20:00:04.581 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:04.581 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:00:04.682 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:00:04.723 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:04.749 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:00:04.752 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:04.753 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:00:04.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:04 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1532733914' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:00:04.854 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:00:04.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:04 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1532733914' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:00:04.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:04 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1532733914' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:00:04.898 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:04.934 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:00:04.939 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:04.939 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:00:05.040 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:00:05.073 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:05.482 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 25 16 72782 72766 181.855 119.25 0.00424516 0.00549688 2024-04-01T20:00:05.624 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:00:05.626 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:00:05.630 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:05.631 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:00:05.687 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T20:00:05.687 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T20:00:05.687 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 0 2024-04-01T20:00:05.687 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T20:00:05.714 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:05 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T20:00:05.714 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:05 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T20:00:05.714 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:05 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1532733914' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T20:00:05.714 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:05 smithi022 ceph-mon[39439]: osdmap e747: 12 total, 11 up, 10 in 2024-04-01T20:00:05.714 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:05 smithi022 ceph-mon[39439]: pgmap v2044: 17 pgs: 17 active+clean; 4.1 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 143 MiB/s wr, 2.29k op/s 2024-04-01T20:00:05.714 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:05 smithi022 ceph-mon[39439]: osdmap e748: 12 total, 11 up, 10 in 2024-04-01T20:00:05.731 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:00:05.771 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:05.801 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:00:05.805 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:05.805 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:00:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:05 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T20:00:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:05 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T20:00:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:05 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1532733914' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T20:00:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:05 smithi188 ceph-mon[43939]: osdmap e747: 12 total, 11 up, 10 in 2024-04-01T20:00:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:05 smithi188 ceph-mon[43939]: pgmap v2044: 17 pgs: 17 active+clean; 4.1 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 143 MiB/s wr, 2.29k op/s 2024-04-01T20:00:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:05 smithi188 ceph-mon[43939]: osdmap e748: 12 total, 11 up, 10 in 2024-04-01T20:00:05.906 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:00:05.946 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:05 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T20:00:05.946 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:05 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T20:00:05.946 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:05 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1532733914' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T20:00:05.946 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:05 smithi062 ceph-mon[44211]: osdmap e747: 12 total, 11 up, 10 in 2024-04-01T20:00:05.946 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:05 smithi062 ceph-mon[44211]: pgmap v2044: 17 pgs: 17 active+clean; 4.1 GiB data, 14 GiB used, 880 GiB / 894 GiB avail; 143 MiB/s wr, 2.29k op/s 2024-04-01T20:00:05.946 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:05 smithi062 ceph-mon[44211]: osdmap e748: 12 total, 11 up, 10 in 2024-04-01T20:00:05.951 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:05.979 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:00:05.981 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:05.982 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:00:06.082 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:00:06.113 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:06.483 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 26 16 74680 74664 179.415 118.625 0.00936262 0.00557188 2024-04-01T20:00:06.797 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_blocked_ops 2024-04-01T20:00:07.165 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:00:07.170 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:07.170 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:00:07.271 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:00:07.301 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:07.442 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T20:00:07.483 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 27 16 76563 76547 177.129 117.688 0.00616633 0.00564388 2024-04-01T20:00:07.651 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:00:07.655 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:07.656 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:00:07.660 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:00:07.757 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:00:07.804 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:07 smithi062 ceph-mon[44211]: pgmap v2046: 17 pgs: 17 active+clean; 4.4 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 137 MiB/s wr, 2.19k op/s 2024-04-01T20:00:07.812 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:07.846 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:00:07.851 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:07.852 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:00:07.861 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:07 smithi022 ceph-mon[39439]: pgmap v2046: 17 pgs: 17 active+clean; 4.4 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 137 MiB/s wr, 2.19k op/s 2024-04-01T20:00:07.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:07 smithi188 ceph-mon[43939]: pgmap v2046: 17 pgs: 17 active+clean; 4.4 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 137 MiB/s wr, 2.19k op/s 2024-04-01T20:00:07.953 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:00:07.991 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:08.483 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 28 16 78430 78414 174.97 116.688 0.0148632 0.00571311 2024-04-01T20:00:09.483 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 29 16 80280 80264 172.924 115.625 0.00904182 0.00578145 2024-04-01T20:00:09.546 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:00:09.549 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:09.550 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:00:09.650 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:00:09.683 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:09.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:09 smithi022 ceph-mon[39439]: pgmap v2047: 17 pgs: 17 active+clean; 4.6 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 106 MiB/s wr, 1.70k op/s 2024-04-01T20:00:09.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:09 smithi188 ceph-mon[43939]: pgmap v2047: 17 pgs: 17 active+clean; 4.6 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 106 MiB/s wr, 1.70k op/s 2024-04-01T20:00:10.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:09 smithi062 ceph-mon[44211]: pgmap v2047: 17 pgs: 17 active+clean; 4.6 GiB data, 15 GiB used, 879 GiB / 894 GiB avail; 106 MiB/s wr, 1.70k op/s 2024-04-01T20:00:10.388 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:00:10.388 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:00:10.388 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:00:10.388 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T20:00:10.389 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:00:10.389 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:00:10.389 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:00:10.389 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:00:10.389 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:00:10.389 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:00:10.410 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:00:10.411 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:00:10.411 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:00:10.411 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:00:10.411 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T20:00:10.411 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:00:10.411 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:00:10.411 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:00:10.411 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:00:10.411 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:00:10.411 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:00:10.411 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.10 2024-04-01T20:00:10.411 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:00:10.435 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:00:10.436 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:00:10.439 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:10.440 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:00:10.483 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 30 16 82096 82080 170.944 113.5 0.00414244 0.00584855 2024-04-01T20:00:10.540 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:00:10.570 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:10.793 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:10 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1589349523' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:00:10.793 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:10.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:10 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1589349523' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:00:10.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:11.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:10 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1589349523' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:00:11.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:11.310 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T20:00:11.311 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T20:00:11.484 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 31 16 83892 83876 169.05 112.25 0.00815268 0.00591347 2024-04-01T20:00:11.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:11.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:11.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:11.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:11.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:11.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:11.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:11.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:11.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:11.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:11 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:11.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:11 smithi022 ceph-mon[39439]: pgmap v2048: 17 pgs: 17 active+clean; 4.9 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 136 MiB/s wr, 2.18k op/s 2024-04-01T20:00:11.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:11.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:11.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:11.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:11.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:11.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:11.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:11.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:11.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:11.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:11 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:11.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:11 smithi188 ceph-mon[43939]: pgmap v2048: 17 pgs: 17 active+clean; 4.9 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 136 MiB/s wr, 2.18k op/s 2024-04-01T20:00:12.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:12.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:12.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:12.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:12.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:12.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:12.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:12.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:12.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:12.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:11 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:12.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:11 smithi062 ceph-mon[44211]: pgmap v2048: 17 pgs: 17 active+clean; 4.9 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 136 MiB/s wr, 2.18k op/s 2024-04-01T20:00:12.023 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:00:12.026 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:12.026 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:00:12.127 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:00:12.175 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:12.213 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:00:12.219 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:12.219 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:00:12.320 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:00:12.368 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:12.399 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:00:12.406 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:12.406 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:00:12.483 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 32 16 85639 85623 167.18 109.188 0.00353347 0.00598006 2024-04-01T20:00:12.507 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:00:12.557 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:12.585 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:00:12.589 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:12.589 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:00:12.690 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:00:12.722 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:13.076 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:00:13.086 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:13.086 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:00:13.187 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:00:13.237 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:13.272 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:00:13.276 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:13.276 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:00:13.311 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T20:00:13.377 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:00:13.411 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:13.445 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:00:13.452 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:13.452 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:00:13.484 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 33 16 87363 87347 165.379 107.75 0.00488026 0.00604496 2024-04-01T20:00:13.553 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:00:13.585 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:13.611 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:13 smithi022 ceph-mon[39439]: pgmap v2049: 17 pgs: 17 active+clean; 5.0 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 108 MiB/s wr, 1.73k op/s 2024-04-01T20:00:13.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:13 smithi022 ceph-mon[39439]: osdmap e749: 12 total, 11 up, 10 in 2024-04-01T20:00:13.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:13 smithi188 ceph-mon[43939]: pgmap v2049: 17 pgs: 17 active+clean; 5.0 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 108 MiB/s wr, 1.73k op/s 2024-04-01T20:00:13.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:13 smithi188 ceph-mon[43939]: osdmap e749: 12 total, 11 up, 10 in 2024-04-01T20:00:14.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:13 smithi062 ceph-mon[44211]: pgmap v2049: 17 pgs: 17 active+clean; 5.0 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 108 MiB/s wr, 1.73k op/s 2024-04-01T20:00:14.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:13 smithi062 ceph-mon[44211]: osdmap e749: 12 total, 11 up, 10 in 2024-04-01T20:00:14.484 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 34 16 89091 89075 163.692 108 0.00390963 0.0061073 2024-04-01T20:00:14.542 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T20:00:14.543 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:14 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:00:14.543 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:14 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:00:14.543 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:14 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/9284140' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:00:14.543 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:14 smithi022 ceph-mon[39439]: from='client.37478 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:00:14.846 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T20:00:14.846 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:00:14.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:14 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:00:14.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:14 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:00:14.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:14 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/9284140' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:00:14.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:14 smithi188 ceph-mon[43939]: from='client.37478 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:00:15.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:14 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:00:15.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:14 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:00:15.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:14 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/9284140' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:00:15.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:14 smithi062 ceph-mon[44211]: from='client.37478 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:00:15.484 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 35 15 90789 90774 162.049 106.188 0.0057668 0.00616942 2024-04-01T20:00:15.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:15 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:00:15.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:15 smithi022 ceph-mon[39439]: from='client.37478 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T20:00:15.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:15 smithi022 ceph-mon[39439]: osdmap e750: 12 total, 11 up, 10 in 2024-04-01T20:00:15.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:15 smithi022 ceph-mon[39439]: pgmap v2052: 17 pgs: 17 active+clean; 5.2 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 107 MiB/s wr, 1.72k op/s 2024-04-01T20:00:15.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:15 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:00:15.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:15 smithi188 ceph-mon[43939]: from='client.37478 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T20:00:15.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:15 smithi188 ceph-mon[43939]: osdmap e750: 12 total, 11 up, 10 in 2024-04-01T20:00:15.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:15 smithi188 ceph-mon[43939]: pgmap v2052: 17 pgs: 17 active+clean; 5.2 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 107 MiB/s wr, 1.72k op/s 2024-04-01T20:00:16.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:15 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:00:16.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:15 smithi062 ceph-mon[44211]: from='client.37478 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T20:00:16.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:15 smithi062 ceph-mon[44211]: osdmap e750: 12 total, 11 up, 10 in 2024-04-01T20:00:16.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:15 smithi062 ceph-mon[44211]: pgmap v2052: 17 pgs: 17 active+clean; 5.2 GiB data, 16 GiB used, 878 GiB / 894 GiB avail; 107 MiB/s wr, 1.72k op/s 2024-04-01T20:00:16.040 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:00:16.046 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:16.046 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:00:16.056 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_historic_ops 2024-04-01T20:00:16.147 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:00:16.186 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:16.226 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:00:16.230 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:16.230 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:00:16.331 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:00:16.360 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:16.484 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 36 15 92422 92407 160.383 102.062 0.0138876 0.00623334 2024-04-01T20:00:16.515 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:00:16.520 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:16.521 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:00:16.563 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:00:16.571 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:00:16.621 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:00:16.664 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:16.698 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:00:16.702 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:16.703 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:00:16.804 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:00:16.853 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:16.887 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:00:16.892 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:16.892 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:00:16.993 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:00:17.023 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:17.063 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:00:17.066 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:17.067 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:00:17.168 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:00:17.213 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:17.237 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:00:17.240 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:17.241 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:00:17.341 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:00:17.382 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:17.406 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:00:17.409 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:17.410 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:00:17.484 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 37 16 94033 94017 158.768 100.625 0.0143071 0.00629694 2024-04-01T20:00:17.511 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:00:17.541 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:17.668 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:00:17.670 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:17.671 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:00:17.772 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:00:17.800 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:17.998 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:00:18.001 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:18.002 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:00:18.103 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:00:18.146 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:18.168 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:00:18.172 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:18.172 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:00:18.273 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:00:18.311 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:18.341 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:00:18.347 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:18.347 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:00:18.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:18 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:00:18.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:18 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:00:18.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:18 smithi022 ceph-mon[39439]: osdmap e751: 12 total, 11 up, 10 in 2024-04-01T20:00:18.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:18 smithi022 ceph-mon[39439]: pgmap v2054: 17 pgs: 17 active+clean; 5.5 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 97 MiB/s wr, 1.55k op/s 2024-04-01T20:00:18.448 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:00:18.484 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 38 16 95652 95636 157.252 101.188 0.00905557 0.0063574 2024-04-01T20:00:18.497 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:18.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:18 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:00:18.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:18 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:00:18.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:18 smithi062 ceph-mon[44211]: osdmap e751: 12 total, 11 up, 10 in 2024-04-01T20:00:18.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:18 smithi062 ceph-mon[44211]: pgmap v2054: 17 pgs: 17 active+clean; 5.5 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 97 MiB/s wr, 1.55k op/s 2024-04-01T20:00:18.527 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:00:18.531 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:18.532 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:00:18.571 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T20:00:18.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:18 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:00:18.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:18 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:00:18.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:18 smithi188 ceph-mon[43939]: osdmap e751: 12 total, 11 up, 10 in 2024-04-01T20:00:18.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:18 smithi188 ceph-mon[43939]: pgmap v2054: 17 pgs: 17 active+clean; 5.5 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 97 MiB/s wr, 1.55k op/s 2024-04-01T20:00:18.632 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:00:18.679 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:18.717 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:00:18.723 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:18.723 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:00:18.824 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:00:18.864 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:18.891 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:00:18.896 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:18.897 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:00:18.998 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:00:19.063 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:19.093 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:00:19.098 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:19.098 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:00:19.199 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:00:19.236 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:19.268 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:00:19.273 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:19.273 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:00:19.374 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:00:19.408 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:19.484 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 39 16 97218 97202 155.73 97.875 0.00521532 0.00641975 2024-04-01T20:00:19.528 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:19 smithi188 ceph-mon[43939]: pgmap v2055: 17 pgs: 17 active+clean; 5.6 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 106 MiB/s wr, 1.69k op/s 2024-04-01T20:00:19.604 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:19 smithi022 ceph-mon[39439]: pgmap v2055: 17 pgs: 17 active+clean; 5.6 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 106 MiB/s wr, 1.69k op/s 2024-04-01T20:00:20.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:19 smithi062 ceph-mon[44211]: pgmap v2055: 17 pgs: 17 active+clean; 5.6 GiB data, 17 GiB used, 877 GiB / 894 GiB avail; 106 MiB/s wr, 1.69k op/s 2024-04-01T20:00:20.043 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:00:20.047 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:20.047 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:00:20.063 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:00:20.085 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:00:20.109 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:00:20.131 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T20:00:20.148 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:00:20.155 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:00:20.182 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:20.183 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:00:20.209 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:00:20.234 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:00:20.256 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:00:20.292 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:00:20.316 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:00:20.316 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:00:20.317 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:00:20.317 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:00:20.317 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T20:00:20.317 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:00:20.317 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:00:20.317 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:00:20.317 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:00:20.317 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:00:20.317 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:00:20.317 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.10 2024-04-01T20:00:20.317 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:00:20.484 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 20:00:20.486831 min lat: 0.00101525 max lat: 0.211697 avg lat: 0.0064792 2024-04-01T20:00:20.484 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T20:00:20.484 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 40 16 98797 98781 154.304 98.6875 0.0152001 0.0064792 2024-04-01T20:00:20.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:20 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3106367255' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:00:20.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:20 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:20.721 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T20:00:20.722 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 20, 2024-04-01T20:00:20.722 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 600, 2024-04-01T20:00:20.722 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T20:00:20.722 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.722 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.36668.0:186749 7.e 7:73ae032b:::benchmark_data_smithi188_147022_object17105:head [delete] snapc 0=[] ondisk+write+known_if_redirected e587)", 2024-04-01T20:00:20.722 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:51:22.299501+0000", 2024-04-01T20:00:20.722 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 537.83722480899996, 2024-04-01T20:00:20.722 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.19556689099999999, 2024-04-01T20:00:20.722 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:00:20.722 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:00:20.722 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:20.722 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T20:00:20.723 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.36668", 2024-04-01T20:00:20.723 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T20:00:20.723 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 186749 2024-04-01T20:00:20.723 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.723 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:00:20.723 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.723 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:00:20.723 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.299501+0000", 2024-04-01T20:00:20.723 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.723 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.723 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.723 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:00:20.723 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.299501+0000", 2024-04-01T20:00:20.723 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.723 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.724 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.724 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:00:20.724 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.299502+0000", 2024-04-01T20:00:20.724 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7499999999999999e-07 2024-04-01T20:00:20.724 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.724 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.724 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:00:20.724 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.299505+0000", 2024-04-01T20:00:20.724 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.117e-06 2024-04-01T20:00:20.724 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.724 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.724 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:00:20.724 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.299516+0000", 2024-04-01T20:00:20.724 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1167e-05 2024-04-01T20:00:20.725 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.725 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.725 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:00:20.725 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.299522+0000", 2024-04-01T20:00:20.725 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9889999999999997e-06 2024-04-01T20:00:20.725 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.725 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.725 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:00:20.725 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.303780+0000", 2024-04-01T20:00:20.725 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0042581540000000001 2024-04-01T20:00:20.725 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.725 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.725 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:00:20.725 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.303915+0000", 2024-04-01T20:00:20.726 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000134809 2024-04-01T20:00:20.726 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.726 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.726 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 10", 2024-04-01T20:00:20.726 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.304042+0000", 2024-04-01T20:00:20.726 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012704200000000001 2024-04-01T20:00:20.726 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.726 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.726 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T20:00:20.726 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.313811+0000", 2024-04-01T20:00:20.726 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0097695560000000004 2024-04-01T20:00:20.726 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.727 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.727 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:20.727 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.494957+0000", 2024-04-01T20:00:20.727 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.18114571500000001 2024-04-01T20:00:20.727 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.727 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.727 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:00:20.727 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.495015+0000", 2024-04-01T20:00:20.727 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7547000000000003e-05 2024-04-01T20:00:20.727 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.727 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.727 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:00:20.727 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.495068+0000", 2024-04-01T20:00:20.728 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3019999999999997e-05 2024-04-01T20:00:20.728 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.728 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:20.728 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.728 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.728 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.728 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.36668.0:186754 7.8 7:18c32b65:::benchmark_data_smithi188_147022_object17110:head [delete] snapc 0=[] ondisk+write+known_if_redirected e587)", 2024-04-01T20:00:20.728 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:51:22.299539+0000", 2024-04-01T20:00:20.728 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 537.83718678800005, 2024-04-01T20:00:20.728 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.19571966900000001, 2024-04-01T20:00:20.728 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:00:20.728 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:00:20.728 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:20.729 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T20:00:20.729 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.36668", 2024-04-01T20:00:20.729 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T20:00:20.729 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 186754 2024-04-01T20:00:20.729 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.729 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:00:20.729 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.729 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:00:20.729 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.299539+0000", 2024-04-01T20:00:20.729 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.729 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.729 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.729 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:00:20.730 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.299539+0000", 2024-04-01T20:00:20.730 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.730 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.730 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.730 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:00:20.730 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.299539+0000", 2024-04-01T20:00:20.730 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.6300000000000005e-07 2024-04-01T20:00:20.730 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.730 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.730 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:00:20.730 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.299542+0000", 2024-04-01T20:00:20.730 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.7690000000000001e-06 2024-04-01T20:00:20.730 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.730 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.731 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:00:20.731 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.299549+0000", 2024-04-01T20:00:20.731 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5860000000000001e-06 2024-04-01T20:00:20.731 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.731 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.731 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:00:20.731 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.299555+0000", 2024-04-01T20:00:20.731 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9889999999999997e-06 2024-04-01T20:00:20.731 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.731 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.731 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:00:20.731 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.304525+0000", 2024-04-01T20:00:20.731 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0049701529999999997 2024-04-01T20:00:20.731 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.731 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.731 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:00:20.732 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.304621+0000", 2024-04-01T20:00:20.732 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.5666000000000002e-05 2024-04-01T20:00:20.732 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.732 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.732 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 7", 2024-04-01T20:00:20.732 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.304689+0000", 2024-04-01T20:00:20.732 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8174000000000002e-05 2024-04-01T20:00:20.732 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.732 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.732 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T20:00:20.732 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.311704+0000", 2024-04-01T20:00:20.732 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0070154470000000002 2024-04-01T20:00:20.732 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.732 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.732 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:20.732 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.495166+0000", 2024-04-01T20:00:20.733 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.18346157299999999 2024-04-01T20:00:20.733 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.733 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.733 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:00:20.733 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.495218+0000", 2024-04-01T20:00:20.733 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2447000000000001e-05 2024-04-01T20:00:20.733 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.733 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.733 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:00:20.733 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.495258+0000", 2024-04-01T20:00:20.733 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.0201999999999999e-05 2024-04-01T20:00:20.733 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.733 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:20.733 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.733 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.734 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.734 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.36668.0:186759 7.8 7:1b9088a4:::benchmark_data_smithi188_147022_object17115:head [delete] snapc 0=[] ondisk+write+known_if_redirected e587)", 2024-04-01T20:00:20.734 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:51:22.303922+0000", 2024-04-01T20:00:20.734 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 537.83280322899998, 2024-04-01T20:00:20.734 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.19144355099999999, 2024-04-01T20:00:20.734 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:00:20.734 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:00:20.734 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:20.734 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T20:00:20.734 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.36668", 2024-04-01T20:00:20.734 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T20:00:20.734 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 186759 2024-04-01T20:00:20.734 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.734 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:00:20.734 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.735 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:00:20.735 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.303922+0000", 2024-04-01T20:00:20.735 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.735 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.735 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.735 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:00:20.735 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.303922+0000", 2024-04-01T20:00:20.735 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.735 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.735 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.735 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:00:20.735 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.303924+0000", 2024-04-01T20:00:20.735 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0719999999999998e-06 2024-04-01T20:00:20.735 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.735 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.736 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:00:20.736 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.303930+0000", 2024-04-01T20:00:20.736 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6400000000000002e-06 2024-04-01T20:00:20.736 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.736 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.736 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:00:20.736 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.303941+0000", 2024-04-01T20:00:20.736 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.102e-05 2024-04-01T20:00:20.736 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.736 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.736 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:00:20.736 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.303949+0000", 2024-04-01T20:00:20.736 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6599999999999995e-06 2024-04-01T20:00:20.736 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.737 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.737 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:00:20.737 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.308134+0000", 2024-04-01T20:00:20.737 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0041855909999999998 2024-04-01T20:00:20.737 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.737 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.737 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:00:20.737 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.308244+0000", 2024-04-01T20:00:20.737 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000110097 2024-04-01T20:00:20.737 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.737 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.737 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 7", 2024-04-01T20:00:20.737 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.308326+0000", 2024-04-01T20:00:20.738 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.1814e-05 2024-04-01T20:00:20.738 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.738 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.738 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T20:00:20.738 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.311712+0000", 2024-04-01T20:00:20.738 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.003385253 2024-04-01T20:00:20.738 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.738 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.738 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:20.738 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.495294+0000", 2024-04-01T20:00:20.738 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.183582042 2024-04-01T20:00:20.738 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.738 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.739 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:00:20.739 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.495333+0000", 2024-04-01T20:00:20.739 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.968e-05 2024-04-01T20:00:20.739 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.739 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.739 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:00:20.739 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.495366+0000", 2024-04-01T20:00:20.739 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.2682000000000003e-05 2024-04-01T20:00:20.739 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.739 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:20.739 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.739 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.739 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.739 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.36668.0:186764 7.e 7:7e1061c8:::benchmark_data_smithi188_147022_object17120:head [delete] snapc 0=[] ondisk+write+known_if_redirected e587)", 2024-04-01T20:00:20.740 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:51:22.308731+0000", 2024-04-01T20:00:20.740 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 537.82799510999996, 2024-04-01T20:00:20.740 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.18686917, 2024-04-01T20:00:20.740 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:00:20.740 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:00:20.740 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:20.740 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T20:00:20.740 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.36668", 2024-04-01T20:00:20.740 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T20:00:20.740 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 186764 2024-04-01T20:00:20.740 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.740 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:00:20.740 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.741 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:00:20.741 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.308731+0000", 2024-04-01T20:00:20.741 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.741 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.741 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.741 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:00:20.741 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.308731+0000", 2024-04-01T20:00:20.741 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.741 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.741 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.741 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:00:20.741 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.308733+0000", 2024-04-01T20:00:20.741 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.407e-06 2024-04-01T20:00:20.741 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.741 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.742 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:00:20.742 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.308741+0000", 2024-04-01T20:00:20.742 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6290000000000001e-06 2024-04-01T20:00:20.742 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.742 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.742 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:00:20.742 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.308752+0000", 2024-04-01T20:00:20.742 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1435e-05 2024-04-01T20:00:20.742 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.742 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.742 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:00:20.742 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.308762+0000", 2024-04-01T20:00:20.742 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.6600000000000007e-06 2024-04-01T20:00:20.742 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.742 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.743 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:00:20.743 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.308930+0000", 2024-04-01T20:00:20.743 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000168789 2024-04-01T20:00:20.743 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.743 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.743 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:00:20.743 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.309057+0000", 2024-04-01T20:00:20.743 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012666399999999999 2024-04-01T20:00:20.743 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.743 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.743 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 10", 2024-04-01T20:00:20.743 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.309174+0000", 2024-04-01T20:00:20.743 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000117228 2024-04-01T20:00:20.743 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.743 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.743 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:20.744 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.495116+0000", 2024-04-01T20:00:20.744 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.185942045 2024-04-01T20:00:20.744 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.744 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.744 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T20:00:20.744 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.495545+0000", 2024-04-01T20:00:20.744 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00042850000000000001 2024-04-01T20:00:20.744 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.744 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.744 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:00:20.744 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.495573+0000", 2024-04-01T20:00:20.744 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.7832000000000001e-05 2024-04-01T20:00:20.744 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.744 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.744 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:00:20.745 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.495600+0000", 2024-04-01T20:00:20.745 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6981000000000001e-05 2024-04-01T20:00:20.745 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.745 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:20.745 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.745 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.745 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.745 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.36668.0:186766 7.8 7:1daf86ab:::benchmark_data_smithi188_147022_object17122:head [delete] snapc 0=[] ondisk+write+known_if_redirected e587)", 2024-04-01T20:00:20.745 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:51:22.311024+0000", 2024-04-01T20:00:20.745 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 537.82570171099997, 2024-04-01T20:00:20.745 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.184444263, 2024-04-01T20:00:20.745 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:00:20.745 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:00:20.745 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:20.746 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T20:00:20.746 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.36668", 2024-04-01T20:00:20.746 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T20:00:20.746 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 186766 2024-04-01T20:00:20.746 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.746 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:00:20.746 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.746 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:00:20.746 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.311024+0000", 2024-04-01T20:00:20.746 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.746 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.746 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.746 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:00:20.746 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.311024+0000", 2024-04-01T20:00:20.747 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.747 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.747 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.747 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:00:20.747 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.311026+0000", 2024-04-01T20:00:20.747 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7910000000000001e-06 2024-04-01T20:00:20.747 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.747 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.747 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:00:20.747 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.311032+0000", 2024-04-01T20:00:20.747 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3239999999999999e-06 2024-04-01T20:00:20.747 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.747 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.747 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:00:20.747 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.311042+0000", 2024-04-01T20:00:20.747 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0135e-05 2024-04-01T20:00:20.748 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.748 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.748 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:00:20.748 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.311051+0000", 2024-04-01T20:00:20.748 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6719999999999993e-06 2024-04-01T20:00:20.748 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.748 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.748 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:00:20.748 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.311733+0000", 2024-04-01T20:00:20.748 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00068233400000000004 2024-04-01T20:00:20.748 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.748 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.748 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:00:20.748 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.311808+0000", 2024-04-01T20:00:20.748 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4975999999999995e-05 2024-04-01T20:00:20.748 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.749 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.749 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 7", 2024-04-01T20:00:20.749 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.311878+0000", 2024-04-01T20:00:20.749 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9935e-05 2024-04-01T20:00:20.749 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.749 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.749 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T20:00:20.749 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.494958+0000", 2024-04-01T20:00:20.749 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.18307981000000001 2024-04-01T20:00:20.749 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.749 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.749 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:20.749 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.495398+0000", 2024-04-01T20:00:20.749 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000440326 2024-04-01T20:00:20.749 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.750 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.750 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:00:20.750 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.495437+0000", 2024-04-01T20:00:20.750 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.9010000000000001e-05 2024-04-01T20:00:20.750 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.750 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.750 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:00:20.750 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.495468+0000", 2024-04-01T20:00:20.750 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.095e-05 2024-04-01T20:00:20.750 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.750 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:20.750 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.750 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.750 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.751 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.36668.0:186774 7.8 7:1dac7c28:::benchmark_data_smithi188_147022_object17130:head [delete] snapc 0=[] ondisk+write+known_if_redirected e587)", 2024-04-01T20:00:20.751 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:51:22.314637+0000", 2024-04-01T20:00:20.751 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 537.822089065, 2024-04-01T20:00:20.751 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.191032284, 2024-04-01T20:00:20.751 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:00:20.751 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:00:20.751 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:20.751 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T20:00:20.751 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.36668", 2024-04-01T20:00:20.751 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T20:00:20.751 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 186774 2024-04-01T20:00:20.751 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.751 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:00:20.751 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.752 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:00:20.752 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.314637+0000", 2024-04-01T20:00:20.752 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.752 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.752 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.752 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:00:20.752 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.314637+0000", 2024-04-01T20:00:20.752 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.752 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.752 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.752 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:00:20.752 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.314639+0000", 2024-04-01T20:00:20.752 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.979e-06 2024-04-01T20:00:20.753 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.753 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.753 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:00:20.753 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.314645+0000", 2024-04-01T20:00:20.753 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5799999999999997e-06 2024-04-01T20:00:20.753 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.753 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.753 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:00:20.753 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.314657+0000", 2024-04-01T20:00:20.753 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1647999999999999e-05 2024-04-01T20:00:20.753 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.753 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.753 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:00:20.753 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.314665+0000", 2024-04-01T20:00:20.754 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.1079999999999993e-06 2024-04-01T20:00:20.754 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.754 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.754 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:00:20.754 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.315426+0000", 2024-04-01T20:00:20.754 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00076071699999999995 2024-04-01T20:00:20.754 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.754 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.754 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:00:20.754 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.315500+0000", 2024-04-01T20:00:20.754 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4473000000000003e-05 2024-04-01T20:00:20.754 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.754 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.755 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 7", 2024-04-01T20:00:20.755 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.315584+0000", 2024-04-01T20:00:20.755 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3881999999999994e-05 2024-04-01T20:00:20.755 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.755 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.755 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T20:00:20.755 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.494965+0000", 2024-04-01T20:00:20.755 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.17938093399999999 2024-04-01T20:00:20.755 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.755 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.755 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:20.755 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.505566+0000", 2024-04-01T20:00:20.755 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010601200999999999 2024-04-01T20:00:20.755 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.756 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.756 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:00:20.756 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.505622+0000", 2024-04-01T20:00:20.756 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5686999999999997e-05 2024-04-01T20:00:20.756 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.756 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.756 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:00:20.756 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.505669+0000", 2024-04-01T20:00:20.756 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7074999999999999e-05 2024-04-01T20:00:20.756 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.756 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:20.756 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.756 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.756 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.757 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop_reply(client.36668.0:186749 7.e e587/560 ondisk, result = 0)", 2024-04-01T20:00:20.757 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:51:22.316239+0000", 2024-04-01T20:00:20.757 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 537.82048648900002, 2024-04-01T20:00:20.757 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.178839207, 2024-04-01T20:00:20.757 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:00:20.757 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:00:20.757 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T20:00:20.757 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:00:20.757 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.757 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:00:20.757 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.316239+0000", 2024-04-01T20:00:20.757 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.757 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.757 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.758 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:00:20.758 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.316239+0000", 2024-04-01T20:00:20.758 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.758 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.758 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.758 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:00:20.758 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.316240+0000", 2024-04-01T20:00:20.758 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.291e-06 2024-04-01T20:00:20.758 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.758 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.758 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:00:20.758 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.316248+0000", 2024-04-01T20:00:20.758 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.1199999999999996e-06 2024-04-01T20:00:20.758 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.759 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.759 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:00:20.759 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.316256+0000", 2024-04-01T20:00:20.759 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3119999999999994e-06 2024-04-01T20:00:20.759 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.759 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.759 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:00:20.759 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.316262+0000", 2024-04-01T20:00:20.759 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3230000000000003e-06 2024-04-01T20:00:20.759 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.759 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.759 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:00:20.759 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.494939+0000", 2024-04-01T20:00:20.759 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.17867634800000001 2024-04-01T20:00:20.759 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.760 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.760 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:00:20.760 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.494950+0000", 2024-04-01T20:00:20.760 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.153e-05 2024-04-01T20:00:20.760 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.760 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.760 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:00:20.760 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.495078+0000", 2024-04-01T20:00:20.760 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000128283 2024-04-01T20:00:20.760 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.760 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:20.760 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.760 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.760 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.760 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop_reply(client.36668.0:186764 7.e e587/560 ondisk, result = 0)", 2024-04-01T20:00:20.761 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:51:22.316403+0000", 2024-04-01T20:00:20.761 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 537.820322584, 2024-04-01T20:00:20.761 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.17872153800000001, 2024-04-01T20:00:20.761 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:00:20.761 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:00:20.761 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T20:00:20.761 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:00:20.761 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.761 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:00:20.761 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.316403+0000", 2024-04-01T20:00:20.761 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.761 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.761 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.761 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:00:20.762 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.316403+0000", 2024-04-01T20:00:20.762 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.762 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.762 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.762 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:00:20.762 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.316404+0000", 2024-04-01T20:00:20.762 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.2999999999999999e-07 2024-04-01T20:00:20.762 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.762 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.762 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:00:20.762 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.316408+0000", 2024-04-01T20:00:20.762 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.569e-06 2024-04-01T20:00:20.762 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.762 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.763 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:00:20.763 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.494889+0000", 2024-04-01T20:00:20.763 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.178481001 2024-04-01T20:00:20.763 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.763 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.763 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:00:20.763 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.494917+0000", 2024-04-01T20:00:20.763 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.8136999999999998e-05 2024-04-01T20:00:20.763 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.763 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.763 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:00:20.763 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.495103+0000", 2024-04-01T20:00:20.763 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00018663800000000001 2024-04-01T20:00:20.763 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.764 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.764 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:00:20.764 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.495110+0000", 2024-04-01T20:00:20.764 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9210000000000003e-06 2024-04-01T20:00:20.764 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.764 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.764 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:00:20.764 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.495125+0000", 2024-04-01T20:00:20.764 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4341999999999999e-05 2024-04-01T20:00:20.764 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.764 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:20.764 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.764 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.765 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.765 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.36668.0:186773 7.3 e587/560 7:c989cd8e:::benchmark_data_smithi188_147022_object17129:head v 587'11546, mlcod=587'11544)", 2024-04-01T20:00:20.765 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:51:22.319241+0000", 2024-04-01T20:00:20.765 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 537.81748495299996, 2024-04-01T20:00:20.765 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.18955282200000001, 2024-04-01T20:00:20.765 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:00:20.765 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:00:20.765 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:20.765 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:00:20.765 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.765 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:00:20.765 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.319241+0000", 2024-04-01T20:00:20.765 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.765 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.765 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.766 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:00:20.766 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.319241+0000", 2024-04-01T20:00:20.766 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.766 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.766 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.766 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:00:20.766 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.319243+0000", 2024-04-01T20:00:20.766 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8560000000000001e-06 2024-04-01T20:00:20.766 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.766 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.766 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:00:20.766 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.319252+0000", 2024-04-01T20:00:20.766 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.4590000000000004e-06 2024-04-01T20:00:20.767 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.767 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.767 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:00:20.767 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.494893+0000", 2024-04-01T20:00:20.767 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.17564069700000001 2024-04-01T20:00:20.767 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.767 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.767 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:00:20.767 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.494906+0000", 2024-04-01T20:00:20.769 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3013999999999999e-05 2024-04-01T20:00:20.770 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.770 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.770 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:00:20.770 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.494970+0000", 2024-04-01T20:00:20.770 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4092999999999998e-05 2024-04-01T20:00:20.770 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.770 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.770 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:00:20.770 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.494994+0000", 2024-04-01T20:00:20.770 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4417e-05 2024-04-01T20:00:20.770 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.770 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.770 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:00:20.770 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.508727+0000", 2024-04-01T20:00:20.771 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.013732790999999999 2024-04-01T20:00:20.771 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.771 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.771 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:00:20.771 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.508793+0000", 2024-04-01T20:00:20.771 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.6495000000000006e-05 2024-04-01T20:00:20.771 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.771 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:20.771 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.771 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.771 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.771 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.36668.0:186781 7.a e587/560 7:5dbe2754:::benchmark_data_smithi188_147022_object17137:head v 587'11871, mlcod=587'11869)", 2024-04-01T20:00:20.771 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:51:22.326396+0000", 2024-04-01T20:00:20.771 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 537.81032985900003, 2024-04-01T20:00:20.772 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.18485558799999999, 2024-04-01T20:00:20.772 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:00:20.772 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:00:20.772 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:20.772 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:00:20.772 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.772 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:00:20.772 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.326396+0000", 2024-04-01T20:00:20.772 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.772 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.772 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.772 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:00:20.772 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.326396+0000", 2024-04-01T20:00:20.772 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.773 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.773 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.773 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:00:20.773 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.326399+0000", 2024-04-01T20:00:20.773 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.4680000000000001e-06 2024-04-01T20:00:20.773 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.773 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.773 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:00:20.773 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.326413+0000", 2024-04-01T20:00:20.773 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3672999999999999e-05 2024-04-01T20:00:20.773 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.773 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.773 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:00:20.773 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.494986+0000", 2024-04-01T20:00:20.774 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.16857344199999999 2024-04-01T20:00:20.774 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.774 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.774 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:00:20.774 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.494994+0000", 2024-04-01T20:00:20.774 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0830000000000004e-06 2024-04-01T20:00:20.774 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.774 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.774 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:00:20.774 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.495047+0000", 2024-04-01T20:00:20.774 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3056999999999997e-05 2024-04-01T20:00:20.774 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.774 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.774 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:00:20.775 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.495069+0000", 2024-04-01T20:00:20.775 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1759e-05 2024-04-01T20:00:20.775 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.775 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.775 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:00:20.775 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.511214+0000", 2024-04-01T20:00:20.775 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.016145257 2024-04-01T20:00:20.775 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.775 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.775 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:00:20.775 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:51:22.511251+0000", 2024-04-01T20:00:20.775 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.6848999999999999e-05 2024-04-01T20:00:20.775 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.775 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:20.775 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.776 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.776 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.776 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.36668.0:281814 7.e 7:722306f7:::benchmark_data_smithi188_147022_object112170:head [delete] snapc 0=[] ondisk+write+known_if_redirected e606)", 2024-04-01T20:00:20.776 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:52:44.294030+0000", 2024-04-01T20:00:20.776 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 455.84269525600001, 2024-04-01T20:00:20.776 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.128815711, 2024-04-01T20:00:20.776 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:00:20.776 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:00:20.776 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:20.776 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T20:00:20.776 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.36668", 2024-04-01T20:00:20.776 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T20:00:20.776 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 281814 2024-04-01T20:00:20.776 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:00:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:00:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.294030+0000", 2024-04-01T20:00:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:00:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.294030+0000", 2024-04-01T20:00:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:00:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.294032+0000", 2024-04-01T20:00:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8279999999999999e-06 2024-04-01T20:00:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:00:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.294040+0000", 2024-04-01T20:00:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.8609999999999998e-06 2024-04-01T20:00:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:00:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.294049+0000", 2024-04-01T20:00:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.1649999999999995e-06 2024-04-01T20:00:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:00:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.294055+0000", 2024-04-01T20:00:20.779 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7440000000000004e-06 2024-04-01T20:00:20.779 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.779 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.779 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:00:20.779 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.294105+0000", 2024-04-01T20:00:20.779 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.0278999999999998e-05 2024-04-01T20:00:20.779 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.779 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.779 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:00:20.779 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.294188+0000", 2024-04-01T20:00:20.779 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.3249000000000002e-05 2024-04-01T20:00:20.779 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.779 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.780 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 10", 2024-04-01T20:00:20.780 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.294284+0000", 2024-04-01T20:00:20.780 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.5319e-05 2024-04-01T20:00:20.780 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.780 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.780 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T20:00:20.780 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.298011+0000", 2024-04-01T20:00:20.780 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0037276290000000001 2024-04-01T20:00:20.780 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.780 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.780 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:20.780 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.301304+0000", 2024-04-01T20:00:20.780 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0032920890000000002 2024-04-01T20:00:20.780 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.781 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.781 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:00:20.781 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.422791+0000", 2024-04-01T20:00:20.781 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.121487962 2024-04-01T20:00:20.781 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.781 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.781 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:00:20.781 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.422846+0000", 2024-04-01T20:00:20.781 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4586000000000002e-05 2024-04-01T20:00:20.781 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.781 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:20.781 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.781 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.781 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.781 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.36668.0:281815 7.8 7:17328645:::benchmark_data_smithi188_147022_object112171:head [delete] snapc 0=[] ondisk+write+known_if_redirected e606)", 2024-04-01T20:00:20.782 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:52:44.294181+0000", 2024-04-01T20:00:20.782 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 455.84254469799998, 2024-04-01T20:00:20.782 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.12875745299999999, 2024-04-01T20:00:20.782 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:00:20.782 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:00:20.782 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:20.782 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T20:00:20.782 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.36668", 2024-04-01T20:00:20.782 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T20:00:20.782 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 281815 2024-04-01T20:00:20.782 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.782 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:00:20.782 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.783 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:00:20.783 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.294181+0000", 2024-04-01T20:00:20.783 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.783 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.783 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.783 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:00:20.783 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.294181+0000", 2024-04-01T20:00:20.783 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.783 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.783 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.783 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:00:20.783 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.294182+0000", 2024-04-01T20:00:20.783 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.4099999999999997e-07 2024-04-01T20:00:20.784 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.784 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.784 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:00:20.784 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.294186+0000", 2024-04-01T20:00:20.784 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.7299999999999999e-06 2024-04-01T20:00:20.784 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.784 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.784 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:00:20.784 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.294191+0000", 2024-04-01T20:00:20.784 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9059999999999999e-06 2024-04-01T20:00:20.784 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.784 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.784 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:00:20.784 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.294197+0000", 2024-04-01T20:00:20.784 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2070000000000003e-06 2024-04-01T20:00:20.785 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.785 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.785 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:00:20.785 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.294244+0000", 2024-04-01T20:00:20.785 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7253999999999999e-05 2024-04-01T20:00:20.785 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.785 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.785 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:00:20.785 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.294319+0000", 2024-04-01T20:00:20.785 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5195000000000001e-05 2024-04-01T20:00:20.785 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.785 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.785 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 7", 2024-04-01T20:00:20.785 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.294384+0000", 2024-04-01T20:00:20.785 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4362000000000005e-05 2024-04-01T20:00:20.786 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.786 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.786 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:20.786 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.422831+0000", 2024-04-01T20:00:20.786 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.12844742000000001 2024-04-01T20:00:20.786 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.786 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.786 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T20:00:20.786 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.422844+0000", 2024-04-01T20:00:20.786 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2989e-05 2024-04-01T20:00:20.786 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.786 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.786 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:00:20.786 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.422893+0000", 2024-04-01T20:00:20.787 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8838999999999998e-05 2024-04-01T20:00:20.787 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.787 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.787 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:00:20.787 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.422938+0000", 2024-04-01T20:00:20.787 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.5609999999999999e-05 2024-04-01T20:00:20.787 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.787 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:20.787 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.787 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.787 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.787 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.36668.0:281818 7.8 7:166cbe0f:::benchmark_data_smithi188_147022_object112174:head [delete] snapc 0=[] ondisk+write+known_if_redirected e606)", 2024-04-01T20:00:20.787 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:52:44.294207+0000", 2024-04-01T20:00:20.787 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 455.84251889199999, 2024-04-01T20:00:20.788 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.12887468799999999, 2024-04-01T20:00:20.788 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:00:20.788 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:00:20.788 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:20.788 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T20:00:20.788 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.36668", 2024-04-01T20:00:20.788 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/4208994849", 2024-04-01T20:00:20.788 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 281818 2024-04-01T20:00:20.788 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.788 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:00:20.788 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.788 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:00:20.788 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.294207+0000", 2024-04-01T20:00:20.788 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.789 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.789 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.789 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:00:20.789 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.294207+0000", 2024-04-01T20:00:20.789 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.789 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.789 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.789 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:00:20.789 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.294207+0000", 2024-04-01T20:00:20.789 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4099999999999999e-07 2024-04-01T20:00:20.789 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.789 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.789 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:00:20.790 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.294210+0000", 2024-04-01T20:00:20.790 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.7199999999999998e-06 2024-04-01T20:00:20.790 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.790 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.790 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:00:20.790 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.294215+0000", 2024-04-01T20:00:20.790 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3890000000000004e-06 2024-04-01T20:00:20.790 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.790 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.790 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:00:20.790 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.294221+0000", 2024-04-01T20:00:20.790 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5650000000000001e-06 2024-04-01T20:00:20.790 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.790 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.791 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:00:20.791 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.297882+0000", 2024-04-01T20:00:20.791 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0036609479999999998 2024-04-01T20:00:20.791 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.791 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.791 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:00:20.791 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.297990+0000", 2024-04-01T20:00:20.791 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000108242 2024-04-01T20:00:20.791 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.791 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.791 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 7", 2024-04-01T20:00:20.791 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.298068+0000", 2024-04-01T20:00:20.791 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7774000000000004e-05 2024-04-01T20:00:20.792 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.792 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.792 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T20:00:20.792 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.422948+0000", 2024-04-01T20:00:20.792 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.124880587 2024-04-01T20:00:20.792 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.792 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.792 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:20.792 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.423005+0000", 2024-04-01T20:00:20.792 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.6569e-05 2024-04-01T20:00:20.792 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.792 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.792 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:00:20.792 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.423046+0000", 2024-04-01T20:00:20.793 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1431999999999999e-05 2024-04-01T20:00:20.793 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.793 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.793 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:00:20.793 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.423081+0000", 2024-04-01T20:00:20.793 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.4921e-05 2024-04-01T20:00:20.793 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.793 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:20.793 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.793 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.793 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.793 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop_reply(client.36668.0:281814 7.e e606/560 ondisk, result = 0)", 2024-04-01T20:00:20.793 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:52:44.301195+0000", 2024-04-01T20:00:20.793 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 455.83553024899999, 2024-04-01T20:00:20.793 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.121658134, 2024-04-01T20:00:20.794 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:00:20.794 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:00:20.794 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T20:00:20.794 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:00:20.794 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.794 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:00:20.794 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.301195+0000", 2024-04-01T20:00:20.794 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.794 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.794 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.794 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:00:20.794 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.301195+0000", 2024-04-01T20:00:20.794 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.795 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.795 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.795 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:00:20.795 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.301196+0000", 2024-04-01T20:00:20.795 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.9899999999999999e-07 2024-04-01T20:00:20.795 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.795 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.795 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:00:20.795 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.301200+0000", 2024-04-01T20:00:20.795 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.608e-06 2024-04-01T20:00:20.795 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.795 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.795 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:00:20.796 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.301207+0000", 2024-04-01T20:00:20.796 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0010000000000004e-06 2024-04-01T20:00:20.796 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.796 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.796 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:00:20.796 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.301213+0000", 2024-04-01T20:00:20.796 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.7989999999999999e-06 2024-04-01T20:00:20.796 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.796 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.796 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:00:20.796 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.301291+0000", 2024-04-01T20:00:20.796 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.8244000000000005e-05 2024-04-01T20:00:20.796 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.796 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.796 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:00:20.797 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.301298+0000", 2024-04-01T20:00:20.797 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2169999999999997e-06 2024-04-01T20:00:20.797 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.797 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.797 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:00:20.797 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.422854+0000", 2024-04-01T20:00:20.797 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.121555366 2024-04-01T20:00:20.797 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.797 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:20.797 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.797 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.797 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.797 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop_reply(client.36668.0:281815 7.8 e606/560 ondisk, result = 0)", 2024-04-01T20:00:20.798 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:52:44.302496+0000", 2024-04-01T20:00:20.798 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 455.83422981799998, 2024-04-01T20:00:20.798 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.12045528799999999, 2024-04-01T20:00:20.798 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:00:20.798 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:00:20.798 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T20:00:20.798 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:00:20.798 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.798 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:00:20.798 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.302496+0000", 2024-04-01T20:00:20.798 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.798 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.798 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.798 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:00:20.799 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.302496+0000", 2024-04-01T20:00:20.799 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.799 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.799 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.799 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:00:20.799 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.302497+0000", 2024-04-01T20:00:20.799 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.226e-06 2024-04-01T20:00:20.799 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.799 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.799 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:00:20.799 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.302502+0000", 2024-04-01T20:00:20.799 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8160000000000001e-06 2024-04-01T20:00:20.799 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.799 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.800 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:00:20.800 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.422749+0000", 2024-04-01T20:00:20.800 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.120247124 2024-04-01T20:00:20.800 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.800 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.800 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:00:20.800 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.422762+0000", 2024-04-01T20:00:20.800 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2812e-05 2024-04-01T20:00:20.800 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.800 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.800 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:00:20.800 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.422815+0000", 2024-04-01T20:00:20.800 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2986999999999999e-05 2024-04-01T20:00:20.800 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.801 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.801 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:00:20.801 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.422824+0000", 2024-04-01T20:00:20.801 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.251e-06 2024-04-01T20:00:20.801 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.801 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.801 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:00:20.801 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.422951+0000", 2024-04-01T20:00:20.801 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00012707199999999999 2024-04-01T20:00:20.801 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.801 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:20.801 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.801 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.801 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.801 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.36668.0:281825 7.a e606/560 7:58612e7c:::benchmark_data_smithi188_147022_object112181:head v 606'17929, mlcod=606'17927)", 2024-04-01T20:00:20.801 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:52:44.302869+0000", 2024-04-01T20:00:20.802 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 455.83385660099998, 2024-04-01T20:00:20.802 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.12580872500000001, 2024-04-01T20:00:20.802 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:00:20.802 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:00:20.802 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:20.802 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:00:20.802 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.802 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:00:20.802 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.302869+0000", 2024-04-01T20:00:20.802 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.802 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.802 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.802 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:00:20.802 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.302869+0000", 2024-04-01T20:00:20.802 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.803 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.803 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.803 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:00:20.803 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.302870+0000", 2024-04-01T20:00:20.803 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0240000000000001e-06 2024-04-01T20:00:20.803 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.803 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.803 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:00:20.803 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.302877+0000", 2024-04-01T20:00:20.803 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5860000000000001e-06 2024-04-01T20:00:20.803 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.803 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.803 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:00:20.803 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.422750+0000", 2024-04-01T20:00:20.803 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.11987334400000001 2024-04-01T20:00:20.804 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.804 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.804 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:00:20.804 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.422763+0000", 2024-04-01T20:00:20.804 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2609000000000001e-05 2024-04-01T20:00:20.804 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.804 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.804 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:00:20.804 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.422842+0000", 2024-04-01T20:00:20.804 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9653999999999993e-05 2024-04-01T20:00:20.804 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.804 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.804 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:00:20.804 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.422864+0000", 2024-04-01T20:00:20.804 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1458999999999999e-05 2024-04-01T20:00:20.804 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.805 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.805 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:00:20.805 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.428627+0000", 2024-04-01T20:00:20.805 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0057628540000000004 2024-04-01T20:00:20.805 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.805 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.805 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:00:20.805 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.428678+0000", 2024-04-01T20:00:20.805 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.1195e-05 2024-04-01T20:00:20.805 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.805 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:20.805 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.805 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.805 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.806 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.36668.0:281835 7.3 e606/560 7:cef138b2:::benchmark_data_smithi188_147022_object112191:head v 606'17432, mlcod=606'17430)", 2024-04-01T20:00:20.806 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:52:44.309960+0000", 2024-04-01T20:00:20.806 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 455.82676542500002, 2024-04-01T20:00:20.806 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.132481134, 2024-04-01T20:00:20.806 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:00:20.806 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:00:20.806 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:20.806 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:00:20.806 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.806 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:00:20.806 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.309960+0000", 2024-04-01T20:00:20.806 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.807 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.807 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.807 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:00:20.807 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.309960+0000", 2024-04-01T20:00:20.807 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.807 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.807 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.807 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:00:20.807 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.309962+0000", 2024-04-01T20:00:20.807 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0140000000000001e-06 2024-04-01T20:00:20.807 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.807 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.807 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:00:20.808 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.309972+0000", 2024-04-01T20:00:20.808 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0212e-05 2024-04-01T20:00:20.808 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.808 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.808 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:00:20.808 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.422727+0000", 2024-04-01T20:00:20.808 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.11275489700000001 2024-04-01T20:00:20.808 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.808 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.808 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:00:20.808 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.422739+0000", 2024-04-01T20:00:20.808 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1934e-05 2024-04-01T20:00:20.808 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.809 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.809 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:00:20.809 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.422814+0000", 2024-04-01T20:00:20.809 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.4559000000000002e-05 2024-04-01T20:00:20.809 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.809 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.809 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:00:20.809 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.422837+0000", 2024-04-01T20:00:20.809 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2974000000000001e-05 2024-04-01T20:00:20.809 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.809 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.809 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:00:20.809 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.442393+0000", 2024-04-01T20:00:20.810 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.019556084000000001 2024-04-01T20:00:20.810 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.810 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.810 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:00:20.810 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:52:44.442441+0000", 2024-04-01T20:00:20.810 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.846e-05 2024-04-01T20:00:20.810 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.810 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:20.810 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.810 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.810 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.810 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.26983.0:193021 8.7 e699/687 8:ee0f5235:::benchmark_data_smithi188_161190_object53739:head v 699'12004, mlcod=650'3341)", 2024-04-01T20:00:20.810 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:57:16.908543+0000", 2024-04-01T20:00:20.811 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 183.22818297500001, 2024-04-01T20:00:20.811 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.094493299000000003, 2024-04-01T20:00:20.811 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:00:20.811 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:00:20.811 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:20.811 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:00:20.811 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.811 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:00:20.811 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.908543+0000", 2024-04-01T20:00:20.811 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.811 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.811 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.812 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:00:20.812 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.908543+0000", 2024-04-01T20:00:20.812 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.812 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.812 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.812 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:00:20.812 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.908545+0000", 2024-04-01T20:00:20.812 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.83e-06 2024-04-01T20:00:20.812 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.812 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.812 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:00:20.812 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.908558+0000", 2024-04-01T20:00:20.812 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2894000000000001e-05 2024-04-01T20:00:20.812 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.813 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.813 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:00:20.813 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.908571+0000", 2024-04-01T20:00:20.813 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3009e-05 2024-04-01T20:00:20.813 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.813 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.813 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:00:20.813 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.908579+0000", 2024-04-01T20:00:20.813 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2180000000000002e-06 2024-04-01T20:00:20.813 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.813 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.813 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:00:20.813 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.908644+0000", 2024-04-01T20:00:20.813 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5699999999999998e-05 2024-04-01T20:00:20.814 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.814 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.814 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:00:20.814 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.908672+0000", 2024-04-01T20:00:20.814 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.7549999999999999e-05 2024-04-01T20:00:20.814 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.814 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.814 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:00:20.814 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:17.002976+0000", 2024-04-01T20:00:20.814 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.094303989000000005 2024-04-01T20:00:20.814 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.814 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.814 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:00:20.815 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:17.003036+0000", 2024-04-01T20:00:20.815 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0109000000000003e-05 2024-04-01T20:00:20.815 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.815 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:20.815 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.815 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.815 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.815 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "MOSDPGPush(8.7 699/687 [PushOp(8:e5203172:::benchmark_data_smithi188_161190_object53766:head, version: 650'3344, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(8:e5203172:::benchmark_data_smithi188_161190_object53766:head@650'3344, size: 65536, copy_subset: [(0, 65536)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 65536, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-04-01T20:00:20.815 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:57:16.917487+0000", 2024-04-01T20:00:20.815 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 183.219238757, 2024-04-01T20:00:20.815 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.085559417999999998, 2024-04-01T20:00:20.815 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:00:20.815 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:00:20.815 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T20:00:20.816 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:00:20.816 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.816 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:00:20.816 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.917487+0000", 2024-04-01T20:00:20.816 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.816 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.816 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.816 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:00:20.816 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.917487+0000", 2024-04-01T20:00:20.816 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.816 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.816 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.816 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:00:20.816 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.917488+0000", 2024-04-01T20:00:20.817 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1620000000000001e-06 2024-04-01T20:00:20.817 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.817 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.817 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:00:20.817 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.917563+0000", 2024-04-01T20:00:20.817 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5240999999999993e-05 2024-04-01T20:00:20.817 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.817 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.817 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:00:20.817 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.917579+0000", 2024-04-01T20:00:20.817 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5517999999999999e-05 2024-04-01T20:00:20.817 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.817 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.817 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:00:20.817 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.917593+0000", 2024-04-01T20:00:20.818 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4450999999999999e-05 2024-04-01T20:00:20.818 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.818 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.818 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:00:20.818 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.922683+0000", 2024-04-01T20:00:20.818 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0050897410000000001 2024-04-01T20:00:20.818 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.818 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.818 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:00:20.818 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.922696+0000", 2024-04-01T20:00:20.818 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2782000000000001e-05 2024-04-01T20:00:20.818 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.818 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.818 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:00:20.819 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:17.003046+0000", 2024-04-01T20:00:20.819 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.080350522999999993 2024-04-01T20:00:20.819 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.819 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:20.819 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.819 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.819 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.819 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.26983.0:193052 8.f e699/629 8:f81309d7:::benchmark_data_smithi188_161190_object53770:head v 699'12218, mlcod=699'12216)", 2024-04-01T20:00:20.819 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:57:16.917794+0000", 2024-04-01T20:00:20.819 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 183.21893143400001, 2024-04-01T20:00:20.819 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.092198751999999995, 2024-04-01T20:00:20.819 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:00:20.819 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:00:20.819 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:20.819 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:00:20.820 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.820 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:00:20.820 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.917794+0000", 2024-04-01T20:00:20.820 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.820 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.820 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.820 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:00:20.820 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.917794+0000", 2024-04-01T20:00:20.820 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:20.820 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.820 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.820 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:00:20.820 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.917795+0000", 2024-04-01T20:00:20.821 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.9099999999999991e-07 2024-04-01T20:00:20.821 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.821 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.821 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:00:20.821 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.917805+0000", 2024-04-01T20:00:20.821 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.9559999999999992e-06 2024-04-01T20:00:20.821 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.821 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.821 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:00:20.821 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.917812+0000", 2024-04-01T20:00:20.821 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0890000000000002e-06 2024-04-01T20:00:20.821 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.821 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.821 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:00:20.821 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.917818+0000", 2024-04-01T20:00:20.822 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3109999999999996e-06 2024-04-01T20:00:20.822 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.822 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.822 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:00:20.822 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.922632+0000", 2024-04-01T20:00:20.822 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0048140149999999996 2024-04-01T20:00:20.822 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.822 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.822 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:00:20.822 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.922654+0000", 2024-04-01T20:00:20.822 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2240000000000001e-05 2024-04-01T20:00:20.822 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.822 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.823 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:00:20.823 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:17.009959+0000", 2024-04-01T20:00:20.823 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.087305383 2024-04-01T20:00:20.823 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:20.823 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:20.823 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:00:20.823 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:17.009993+0000", 2024-04-01T20:00:20.823 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3766999999999997e-05 2024-04-01T20:00:20.823 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.823 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:20.823 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.823 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:20.823 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:20.823 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T20:00:20.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:20 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3106367255' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:00:20.879 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:20 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:20.931 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:00:20.934 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:20.934 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:00:21.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:20 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3106367255' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:00:21.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:20 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.035 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:00:21.086 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:21.120 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:00:21.127 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:21.127 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:00:21.228 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:00:21.274 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:21.306 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:00:21.311 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:21.311 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:00:21.412 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:00:21.465 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:21.484 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 41 16 100331 100315 152.879 95.875 0.00849278 0.00653954 2024-04-01T20:00:21.491 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:00:21.495 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:21.495 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:00:21.596 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:00:21.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:21 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:21 smithi022 ceph-mon[39439]: osdmap e752: 12 total, 11 up, 10 in 2024-04-01T20:00:21.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:21 smithi022 ceph-mon[39439]: pgmap v2057: 17 pgs: 17 active+clean; 6.0 GiB data, 18 GiB used, 876 GiB / 894 GiB avail; 108 MiB/s wr, 1.72k op/s 2024-04-01T20:00:21.641 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:21.678 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:00:21.685 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:21.685 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:00:21.751 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:00:21.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:21 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:21 smithi062 ceph-mon[44211]: osdmap e752: 12 total, 11 up, 10 in 2024-04-01T20:00:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:21 smithi062 ceph-mon[44211]: pgmap v2057: 17 pgs: 17 active+clean; 6.0 GiB data, 18 GiB used, 876 GiB / 894 GiB avail; 108 MiB/s wr, 1.72k op/s 2024-04-01T20:00:21.786 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:00:21.787 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T20:00:21.788 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T20:00:21.827 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.827 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.827 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.827 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.827 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.827 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.827 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.827 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.827 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.827 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:21 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:21.828 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:21 smithi188 ceph-mon[43939]: osdmap e752: 12 total, 11 up, 10 in 2024-04-01T20:00:21.828 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:21 smithi188 ceph-mon[43939]: pgmap v2057: 17 pgs: 17 active+clean; 6.0 GiB data, 18 GiB used, 876 GiB / 894 GiB avail; 108 MiB/s wr, 1.72k op/s 2024-04-01T20:00:21.831 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:21.860 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:00:21.865 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:21.865 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:00:21.966 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:00:21.996 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:22.485 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 42 16 101853 101837 151.504 95.125 0.0118397 0.00659894 2024-04-01T20:00:22.549 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_ops_in_flight 2024-04-01T20:00:22.552 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:00:22.555 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:22.555 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:00:22.656 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:00:22.705 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:22.735 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:00:22.739 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:22.740 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:00:22.840 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:00:22.883 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:22.924 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:00:22.930 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:22.931 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:00:23.032 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:00:23.077 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:23.109 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:00:23.112 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:23.113 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:00:23.181 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:00:23.213 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:00:23.243 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:23.317 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:00:23.324 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:23.324 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:00:23.425 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:00:23.468 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:23.485 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 43 16 103358 103342 150.168 94.0625 0.00408253 0.00665736 2024-04-01T20:00:23.523 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:00:23.527 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:23.527 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:00:23.628 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:00:23.658 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:23.786 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:00:23.789 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T20:00:23.790 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:23.791 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:00:23.794 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:23 smithi022 ceph-mon[39439]: pgmap v2058: 17 pgs: 17 active+clean; 6.0 GiB data, 18 GiB used, 876 GiB / 894 GiB avail; 104 MiB/s wr, 1.67k op/s 2024-04-01T20:00:23.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:23 smithi188 ceph-mon[43939]: pgmap v2058: 17 pgs: 17 active+clean; 6.0 GiB data, 18 GiB used, 876 GiB / 894 GiB avail; 104 MiB/s wr, 1.67k op/s 2024-04-01T20:00:23.893 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:00:23.931 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:24.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:23 smithi062 ceph-mon[44211]: pgmap v2058: 17 pgs: 17 active+clean; 6.0 GiB data, 18 GiB used, 876 GiB / 894 GiB avail; 104 MiB/s wr, 1.67k op/s 2024-04-01T20:00:24.031 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:00:24.036 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:24.036 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:00:24.137 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:00:24.167 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:24.419 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:00:24.422 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:24.423 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:00:24.485 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 44 16 104863 104847 148.893 94.0625 0.00841178 0.00671414 2024-04-01T20:00:24.523 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:00:24.552 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:25.486 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 45 16 106364 106348 147.666 93.8125 0.00923884 0.00676995 2024-04-01T20:00:25.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:25 smithi022 ceph-mon[39439]: pgmap v2059: 17 pgs: 17 active+clean; 6.2 GiB data, 18 GiB used, 876 GiB / 894 GiB avail; 91 MiB/s wr, 1.46k op/s 2024-04-01T20:00:25.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:25 smithi188 ceph-mon[43939]: pgmap v2059: 17 pgs: 17 active+clean; 6.2 GiB data, 18 GiB used, 876 GiB / 894 GiB avail; 91 MiB/s wr, 1.46k op/s 2024-04-01T20:00:26.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:25 smithi062 ceph-mon[44211]: pgmap v2059: 17 pgs: 17 active+clean; 6.2 GiB data, 18 GiB used, 876 GiB / 894 GiB avail; 91 MiB/s wr, 1.46k op/s 2024-04-01T20:00:26.102 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:00:26.106 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:26.106 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:00:26.128 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T20:00:26.128 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T20:00:26.128 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.128 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.27358.0:107292 9.c 9:37ca697a:::benchmark_data_smithi188_173515_object107291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e752)", 2024-04-01T20:00:26.128 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T20:00:26.118799+0000", 2024-04-01T20:00:26.128 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.010501142999999999, 2024-04-01T20:00:26.128 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010530384, 2024-04-01T20:00:26.128 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:00:26.128 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:00:26.128 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T20:00:26.128 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T20:00:26.129 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.27358", 2024-04-01T20:00:26.129 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:00:26.129 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 107292 2024-04-01T20:00:26.129 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.129 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:00:26.129 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.129 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:00:26.129 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.118799+0000", 2024-04-01T20:00:26.129 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:26.129 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.129 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.129 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:00:26.129 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.118799+0000", 2024-04-01T20:00:26.130 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:26.130 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.130 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.130 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:00:26.130 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.118802+0000", 2024-04-01T20:00:26.130 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1950000000000002e-06 2024-04-01T20:00:26.130 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.130 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.130 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:00:26.130 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.118870+0000", 2024-04-01T20:00:26.130 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8257999999999996e-05 2024-04-01T20:00:26.131 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.131 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.131 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:00:26.131 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.118884+0000", 2024-04-01T20:00:26.131 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3729e-05 2024-04-01T20:00:26.131 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.131 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.131 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:00:26.131 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.118893+0000", 2024-04-01T20:00:26.131 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.2189999999999993e-06 2024-04-01T20:00:26.131 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.131 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.131 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:00:26.132 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.118998+0000", 2024-04-01T20:00:26.132 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000105666 2024-04-01T20:00:26.132 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.132 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.132 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:00:26.132 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.119164+0000", 2024-04-01T20:00:26.132 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000165468 2024-04-01T20:00:26.132 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.132 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.132 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 4", 2024-04-01T20:00:26.132 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.119317+0000", 2024-04-01T20:00:26.132 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00015343 2024-04-01T20:00:26.132 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.133 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.133 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "op_commit", 2024-04-01T20:00:26.133 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.126831+0000", 2024-04-01T20:00:26.133 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0075136129999999997 2024-04-01T20:00:26.133 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:26.133 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:26.133 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:26.133 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.133 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.133 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.27358.0:107293 9.c 9:327e3d99:::benchmark_data_smithi188_173515_object107292:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e752)", 2024-04-01T20:00:26.133 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T20:00:26.118939+0000", 2024-04-01T20:00:26.133 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.010361685000000001, 2024-04-01T20:00:26.133 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010449973, 2024-04-01T20:00:26.133 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:00:26.134 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:00:26.134 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T20:00:26.134 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T20:00:26.134 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.27358", 2024-04-01T20:00:26.134 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:00:26.134 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 107293 2024-04-01T20:00:26.134 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.134 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:00:26.134 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.134 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:00:26.134 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.118939+0000", 2024-04-01T20:00:26.134 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:26.134 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.134 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.134 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:00:26.135 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.118939+0000", 2024-04-01T20:00:26.135 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:26.135 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.135 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.135 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:00:26.135 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.118940+0000", 2024-04-01T20:00:26.135 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0699999999999999e-06 2024-04-01T20:00:26.135 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.135 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.135 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:00:26.135 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.118999+0000", 2024-04-01T20:00:26.135 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9011000000000001e-05 2024-04-01T20:00:26.135 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.135 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.135 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:00:26.136 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.119020+0000", 2024-04-01T20:00:26.136 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1294e-05 2024-04-01T20:00:26.136 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.136 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.136 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:00:26.136 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.119028+0000", 2024-04-01T20:00:26.136 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.8439999999999998e-06 2024-04-01T20:00:26.136 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.136 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.136 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:00:26.136 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.122265+0000", 2024-04-01T20:00:26.136 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0032370760000000002 2024-04-01T20:00:26.136 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.136 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.136 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:00:26.136 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.122444+0000", 2024-04-01T20:00:26.137 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00017912000000000001 2024-04-01T20:00:26.137 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.137 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.137 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 4", 2024-04-01T20:00:26.137 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.122637+0000", 2024-04-01T20:00:26.137 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00019242700000000001 2024-04-01T20:00:26.137 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:26.137 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:26.137 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:26.137 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.137 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.137 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.27358.0:107308 9.c 9:31a8c84b:::benchmark_data_smithi188_173515_object107307:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e752)", 2024-04-01T20:00:26.137 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T20:00:26.125816+0000", 2024-04-01T20:00:26.137 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.003484202, 2024-04-01T20:00:26.137 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0036286700000000001, 2024-04-01T20:00:26.137 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:00:26.138 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:00:26.138 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T20:00:26.138 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T20:00:26.138 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.27358", 2024-04-01T20:00:26.138 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:00:26.138 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 107308 2024-04-01T20:00:26.138 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.138 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:00:26.138 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.138 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:00:26.138 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.125816+0000", 2024-04-01T20:00:26.138 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:26.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.139 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.139 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:00:26.139 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.125816+0000", 2024-04-01T20:00:26.139 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:26.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.139 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.139 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:00:26.139 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.125818+0000", 2024-04-01T20:00:26.139 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.781e-06 2024-04-01T20:00:26.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.139 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.139 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:00:26.139 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.125854+0000", 2024-04-01T20:00:26.139 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.6353000000000002e-05 2024-04-01T20:00:26.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.140 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.140 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:00:26.140 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.125865+0000", 2024-04-01T20:00:26.140 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0934000000000001e-05 2024-04-01T20:00:26.140 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.140 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.140 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:00:26.140 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.125873+0000", 2024-04-01T20:00:26.140 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.6690000000000006e-06 2024-04-01T20:00:26.140 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.140 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.140 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:00:26.140 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.126861+0000", 2024-04-01T20:00:26.140 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00098761300000000003 2024-04-01T20:00:26.140 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.141 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.141 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:00:26.141 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.127000+0000", 2024-04-01T20:00:26.141 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000139429 2024-04-01T20:00:26.141 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.141 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.141 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 4", 2024-04-01T20:00:26.141 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.127154+0000", 2024-04-01T20:00:26.141 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000154396 2024-04-01T20:00:26.141 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:26.141 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:26.141 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:26.141 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.141 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.142 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_op(client.27358.0:107309 9.1 9:80ee19ec:::benchmark_data_smithi188_173515_object107308:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e752)", 2024-04-01T20:00:26.142 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T20:00:26.126055+0000", 2024-04-01T20:00:26.142 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0032459619999999998, 2024-04-01T20:00:26.142 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.003436096, 2024-04-01T20:00:26.142 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:00:26.142 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:00:26.142 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "waiting for sub ops", 2024-04-01T20:00:26.142 INFO:teuthology.orchestra.run.smithi022.stdout: "client_info": { 2024-04-01T20:00:26.142 INFO:teuthology.orchestra.run.smithi022.stdout: "client": "client.27358", 2024-04-01T20:00:26.142 INFO:teuthology.orchestra.run.smithi022.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:00:26.142 INFO:teuthology.orchestra.run.smithi022.stdout: "tid": 107309 2024-04-01T20:00:26.142 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.142 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:00:26.143 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.143 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:00:26.143 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.126055+0000", 2024-04-01T20:00:26.143 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:26.143 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.143 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.143 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:00:26.143 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.126055+0000", 2024-04-01T20:00:26.143 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:26.143 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.143 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.143 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:00:26.143 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.126055+0000", 2024-04-01T20:00:26.143 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.3699999999999999e-07 2024-04-01T20:00:26.144 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.144 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.144 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:00:26.144 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.126121+0000", 2024-04-01T20:00:26.144 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5820000000000003e-05 2024-04-01T20:00:26.144 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.144 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.144 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:00:26.144 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.126129+0000", 2024-04-01T20:00:26.144 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5279999999999998e-06 2024-04-01T20:00:26.144 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.144 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.144 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:00:26.144 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.126133+0000", 2024-04-01T20:00:26.144 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.2810000000000002e-06 2024-04-01T20:00:26.145 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.145 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.145 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:00:26.145 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.126188+0000", 2024-04-01T20:00:26.145 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4749e-05 2024-04-01T20:00:26.145 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.145 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.145 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:00:26.145 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.126340+0000", 2024-04-01T20:00:26.145 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000152633 2024-04-01T20:00:26.145 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.145 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.145 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "waiting for subops from 9", 2024-04-01T20:00:26.145 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.126500+0000", 2024-04-01T20:00:26.145 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.000159994 2024-04-01T20:00:26.145 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:26.146 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:26.146 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:26.146 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.146 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.146 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.27358.0:107300 9.7 e752/735 9:e389cba8:::benchmark_data_smithi188_173515_object107299:head v 752'6626, mlcod=752'6624)", 2024-04-01T20:00:26.146 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T20:00:26.126257+0000", 2024-04-01T20:00:26.146 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0030437870000000001, 2024-04-01T20:00:26.146 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0032963340000000002, 2024-04-01T20:00:26.146 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:00:26.146 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:00:26.146 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T20:00:26.146 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:00:26.146 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.146 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:00:26.146 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.126257+0000", 2024-04-01T20:00:26.147 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:26.147 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.147 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.147 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:00:26.147 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.126257+0000", 2024-04-01T20:00:26.147 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:00:26.147 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.147 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.147 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:00:26.147 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.126258+0000", 2024-04-01T20:00:26.147 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.850000000000001e-07 2024-04-01T20:00:26.147 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.147 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.147 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:00:26.148 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.126341+0000", 2024-04-01T20:00:26.148 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2939e-05 2024-04-01T20:00:26.148 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.148 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.148 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:00:26.148 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.126346+0000", 2024-04-01T20:00:26.148 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.8170000000000004e-06 2024-04-01T20:00:26.148 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.148 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.148 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:00:26.148 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.126350+0000", 2024-04-01T20:00:26.148 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.489e-06 2024-04-01T20:00:26.148 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.148 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.148 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:00:26.148 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.126399+0000", 2024-04-01T20:00:26.149 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8862000000000001e-05 2024-04-01T20:00:26.149 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:00:26.149 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:00:26.149 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:00:26.149 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:00:26.126421+0000", 2024-04-01T20:00:26.149 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1787999999999999e-05 2024-04-01T20:00:26.149 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:26.149 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:00:26.149 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:26.149 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:00:26.149 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-04-01T20:00:26.149 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 5 2024-04-01T20:00:26.149 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T20:00:26.207 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:00:26.216 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:00:26.248 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:26.383 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:00:26.390 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:26.390 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:00:26.486 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 46 16 107827 107811 146.444 91.4375 0.0105245 0.00682683 2024-04-01T20:00:26.491 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:00:26.533 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:26.542 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T20:00:26.592 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:00:26.598 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:26.599 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:00:26.700 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:00:26.743 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:26.771 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:00:26.776 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:26.777 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:00:26.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:26 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3122833139' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:00:26.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:26 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3122833139' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:00:26.878 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:00:26.917 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:26 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3122833139' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:00:26.920 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:26.960 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:00:26.963 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:26.964 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:00:27.064 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:00:27.096 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:27.486 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 47 16 109265 109249 145.24 89.875 0.0166066 0.00688327 2024-04-01T20:00:27.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:27 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:00:27.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:27 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3122833139' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T20:00:27.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:27 smithi022 ceph-mon[39439]: osdmap e753: 12 total, 11 up, 10 in 2024-04-01T20:00:27.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:27 smithi022 ceph-mon[39439]: pgmap v2061: 17 pgs: 17 active+clean; 6.5 GiB data, 19 GiB used, 875 GiB / 894 GiB avail; 103 MiB/s wr, 1.65k op/s 2024-04-01T20:00:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:27 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:00:27.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:27 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3122833139' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T20:00:27.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:27 smithi188 ceph-mon[43939]: osdmap e753: 12 total, 11 up, 10 in 2024-04-01T20:00:27.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:27 smithi188 ceph-mon[43939]: pgmap v2061: 17 pgs: 17 active+clean; 6.5 GiB data, 19 GiB used, 875 GiB / 894 GiB avail; 103 MiB/s wr, 1.65k op/s 2024-04-01T20:00:28.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:27 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:00:28.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:27 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3122833139' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T20:00:28.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:27 smithi062 ceph-mon[44211]: osdmap e753: 12 total, 11 up, 10 in 2024-04-01T20:00:28.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:27 smithi062 ceph-mon[44211]: pgmap v2061: 17 pgs: 17 active+clean; 6.5 GiB data, 19 GiB used, 875 GiB / 894 GiB avail; 103 MiB/s wr, 1.65k op/s 2024-04-01T20:00:28.489 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 48 16 110702 110686 144.077 89.8125 0.0144084 0.00693892 2024-04-01T20:00:28.533 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_blocked_ops 2024-04-01T20:00:28.851 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:00:28.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:28 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:00:28.853 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:28 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:00:28.853 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:28.854 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:00:28.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:28 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:00:28.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:28 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:00:28.954 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:00:29.000 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:28 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:00:29.000 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:28 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:00:29.003 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:29.038 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:00:29.043 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:29.043 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:00:29.144 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:00:29.172 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:29.352 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:00:29.366 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:00:29.371 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:29.371 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:00:29.472 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:00:29.490 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 49 16 112126 112110 142.951 89 0.00896822 0.00699428 2024-04-01T20:00:29.502 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:29.852 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:00:29.854 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:29 smithi022 ceph-mon[39439]: osdmap e754: 12 total, 11 up, 10 in 2024-04-01T20:00:29.854 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:29 smithi022 ceph-mon[39439]: pgmap v2063: 17 pgs: 17 active+clean; 6.6 GiB data, 19 GiB used, 875 GiB / 894 GiB avail; 82 MiB/s wr, 1.31k op/s 2024-04-01T20:00:29.855 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:29.856 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:00:29.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:29 smithi188 ceph-mon[43939]: osdmap e754: 12 total, 11 up, 10 in 2024-04-01T20:00:29.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:29 smithi188 ceph-mon[43939]: pgmap v2063: 17 pgs: 17 active+clean; 6.6 GiB data, 19 GiB used, 875 GiB / 894 GiB avail; 82 MiB/s wr, 1.31k op/s 2024-04-01T20:00:29.956 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:00:30.007 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:29 smithi062 ceph-mon[44211]: osdmap e754: 12 total, 11 up, 10 in 2024-04-01T20:00:30.007 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:29 smithi062 ceph-mon[44211]: pgmap v2063: 17 pgs: 17 active+clean; 6.6 GiB data, 19 GiB used, 875 GiB / 894 GiB avail; 82 MiB/s wr, 1.31k op/s 2024-04-01T20:00:30.009 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:30.043 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:00:30.055 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:30.055 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:00:30.156 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:00:30.185 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:30.209 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:00:30.213 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:30.213 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:00:30.314 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:00:30.356 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:30.391 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:00:30.394 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:30.395 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:00:30.490 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 50 16 113525 113509 141.841 87.4375 0.0122963 0.00704906 2024-04-01T20:00:30.495 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:00:30.546 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:30.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:30 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:00:30.574 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:00:30.576 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:30.576 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:00:30.677 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:00:30.715 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:30.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:30 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:00:30.765 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:00:30.771 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:30.771 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:00:30.872 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:00:30.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:30 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:00:30.920 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:30.959 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:00:30.970 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:30.971 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:00:31.072 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:00:31.104 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:31.392 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T20:00:31.490 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 51 16 114912 114896 140.76 86.6875 0.00653956 0.00710223 2024-04-01T20:00:31.755 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:00:31.758 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:31.759 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:00:31.759 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:31 smithi022 ceph-mon[39439]: osdmap e755: 12 total, 11 up, 10 in 2024-04-01T20:00:31.759 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:31 smithi022 ceph-mon[39439]: pgmap v2065: 17 pgs: 17 active+clean; 6.9 GiB data, 20 GiB used, 874 GiB / 894 GiB avail; 109 MiB/s wr, 1.75k op/s 2024-04-01T20:00:31.859 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:00:31.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:31 smithi188 ceph-mon[43939]: osdmap e755: 12 total, 11 up, 10 in 2024-04-01T20:00:31.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:31 smithi188 ceph-mon[43939]: pgmap v2065: 17 pgs: 17 active+clean; 6.9 GiB data, 20 GiB used, 874 GiB / 894 GiB avail; 109 MiB/s wr, 1.75k op/s 2024-04-01T20:00:31.890 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:32.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:31 smithi062 ceph-mon[44211]: osdmap e755: 12 total, 11 up, 10 in 2024-04-01T20:00:32.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:31 smithi062 ceph-mon[44211]: pgmap v2065: 17 pgs: 17 active+clean; 6.9 GiB data, 20 GiB used, 874 GiB / 894 GiB avail; 109 MiB/s wr, 1.75k op/s 2024-04-01T20:00:32.142 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:00:32.145 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:32.145 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:00:32.221 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:00:32.242 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:00:32.246 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:00:32.270 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:00:32.283 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:32.297 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T20:00:32.325 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:00:32.357 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:00:32.382 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:00:32.391 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:00:32.395 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:32.396 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:00:32.413 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:00:32.425 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T20:00:32.425 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:00:32.427 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:00:32.435 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:00:32.479 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:00:32.490 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 52 16 116319 116303 139.744 87.9375 0.00476566 0.00715385 2024-04-01T20:00:32.497 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:00:32.509 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:00:32.509 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:00:32.509 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:00:32.510 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:00:32.510 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T20:00:32.510 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:00:32.510 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:00:32.510 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:00:32.510 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:00:32.510 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:00:32.510 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:00:32.510 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.10 2024-04-01T20:00:32.510 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:00:32.536 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:32.568 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:00:32.573 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:32.573 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:00:32.674 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:00:32.702 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:32 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:00:32.702 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:32 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:00:32.702 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:32 smithi022 ceph-mon[39439]: osdmap e756: 12 total, 11 up, 10 in 2024-04-01T20:00:32.702 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:32 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3776480594' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:00:32.703 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:32.705 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:32.761 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:00:32.768 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:32.768 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:00:32.869 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:00:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:32 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:00:32.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:32 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:00:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:32 smithi188 ceph-mon[43939]: osdmap e756: 12 total, 11 up, 10 in 2024-04-01T20:00:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:32 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3776480594' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:00:32.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:32.907 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:32.934 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:00:32.940 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:32.940 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:00:33.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:32 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:00:33.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:32 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:00:33.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:32 smithi062 ceph-mon[44211]: osdmap e756: 12 total, 11 up, 10 in 2024-04-01T20:00:33.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:32 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3776480594' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:00:33.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:33.041 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:00:33.072 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:33.491 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 53 16 117683 117667 138.712 85.25 0.0157764 0.00720776 2024-04-01T20:00:33.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:33.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:33.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:33.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:33.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:33.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:33.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:33.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:33.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:33.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:33 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:33.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:33 smithi022 ceph-mon[39439]: pgmap v2067: 17 pgs: 17 active+clean; 6.9 GiB data, 20 GiB used, 874 GiB / 894 GiB avail; 84 MiB/s wr, 1.34k op/s 2024-04-01T20:00:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:33 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:33 smithi188 ceph-mon[43939]: pgmap v2067: 17 pgs: 17 active+clean; 6.9 GiB data, 20 GiB used, 874 GiB / 894 GiB avail; 84 MiB/s wr, 1.34k op/s 2024-04-01T20:00:33.928 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T20:00:33.928 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T20:00:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:33 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:34.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:33 smithi062 ceph-mon[44211]: pgmap v2067: 17 pgs: 17 active+clean; 6.9 GiB data, 20 GiB used, 874 GiB / 894 GiB avail; 84 MiB/s wr, 1.34k op/s 2024-04-01T20:00:34.224 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:00:34.227 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:34.227 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:00:34.328 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:00:34.358 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:34.459 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:00:34.461 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:34.462 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:00:34.491 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 54 16 119073 119057 137.752 86.875 0.00837909 0.00725796 2024-04-01T20:00:34.562 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:00:34.617 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:34.652 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:00:34.658 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:34.659 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:00:34.760 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:00:34.808 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:34.843 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:00:34.850 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:34.850 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:00:34.918 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_historic_ops 2024-04-01T20:00:34.951 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:00:34.993 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:35.055 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:00:35.061 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:35.061 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:00:35.162 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:00:35.220 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:35.263 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:00:35.270 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:35.271 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:00:35.372 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:00:35.402 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:35.424 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:00:35.429 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:35.429 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:00:35.491 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 55 16 120408 120392 136.764 83.4375 0.0115135 0.00731061 2024-04-01T20:00:35.530 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:00:35.577 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:35.604 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:00:35.610 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:35.611 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:00:35.711 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:00:35.712 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:35 smithi022 ceph-mon[39439]: pgmap v2068: 17 pgs: 17 active+clean; 7.1 GiB data, 20 GiB used, 874 GiB / 894 GiB avail; 89 MiB/s wr, 1.42k op/s 2024-04-01T20:00:35.755 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:35.777 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:00:35.781 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:35.782 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:00:35.782 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:35 smithi062 ceph-mon[44211]: pgmap v2068: 17 pgs: 17 active+clean; 7.1 GiB data, 20 GiB used, 874 GiB / 894 GiB avail; 89 MiB/s wr, 1.42k op/s 2024-04-01T20:00:35.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:35 smithi188 ceph-mon[43939]: pgmap v2068: 17 pgs: 17 active+clean; 7.1 GiB data, 20 GiB used, 874 GiB / 894 GiB avail; 89 MiB/s wr, 1.42k op/s 2024-04-01T20:00:35.883 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:00:35.913 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:35.929 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T20:00:36.068 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:00:36.074 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:36.075 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:00:36.089 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:00:36.176 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:00:36.303 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:36.325 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:00:36.331 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:36.332 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:00:36.432 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:00:36.467 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:36.492 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 56 16 121753 121737 135.823 84.0625 0.00916776 0.00736094 2024-04-01T20:00:36.545 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:00:36.548 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:36.548 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:00:36.585 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T20:00:36.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:36 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3032410082' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:00:36.649 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:00:36.696 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:36.727 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:00:36.754 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:36.755 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:00:36.856 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:00:36.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:36 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3032410082' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:00:36.905 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:36.933 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:00:36.937 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:36.937 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:00:37.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:36 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3032410082' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:00:37.038 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:00:37.068 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:37.493 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 57 16 123023 123007 134.833 79.375 0.0183255 0.00741499 2024-04-01T20:00:37.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:37 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:00:37.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:37 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3032410082' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T20:00:37.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:37 smithi022 ceph-mon[39439]: osdmap e757: 12 total, 11 up, 10 in 2024-04-01T20:00:37.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:37 smithi022 ceph-mon[39439]: pgmap v2070: 17 pgs: 17 active+clean; 7.3 GiB data, 21 GiB used, 873 GiB / 894 GiB avail; 96 MiB/s wr, 1.53k op/s 2024-04-01T20:00:37.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:37 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:00:37.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:37 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3032410082' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T20:00:37.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:37 smithi188 ceph-mon[43939]: osdmap e757: 12 total, 11 up, 10 in 2024-04-01T20:00:37.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:37 smithi188 ceph-mon[43939]: pgmap v2070: 17 pgs: 17 active+clean; 7.3 GiB data, 21 GiB used, 873 GiB / 894 GiB avail; 96 MiB/s wr, 1.53k op/s 2024-04-01T20:00:38.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:37 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:00:38.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:37 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3032410082' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T20:00:38.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:37 smithi062 ceph-mon[44211]: osdmap e757: 12 total, 11 up, 10 in 2024-04-01T20:00:38.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:37 smithi062 ceph-mon[44211]: pgmap v2070: 17 pgs: 17 active+clean; 7.3 GiB data, 21 GiB used, 873 GiB / 894 GiB avail; 96 MiB/s wr, 1.53k op/s 2024-04-01T20:00:38.472 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:00:38.492 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 58 16 124258 124242 133.839 77.1875 0.00696972 0.00746992 2024-04-01T20:00:38.650 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:00:38.655 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:38.656 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:00:38.756 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:00:38.774 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:38 smithi022 ceph-mon[39439]: 9.f scrub starts 2024-04-01T20:00:38.797 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:38.836 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:00:38.841 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:38.842 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:00:38.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:38 smithi188 ceph-mon[43939]: 9.f scrub starts 2024-04-01T20:00:38.942 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:00:38.974 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:39.015 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:38 smithi062 ceph-mon[44211]: 9.f scrub starts 2024-04-01T20:00:39.492 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 59 16 125499 125483 132.886 77.5625 0.00615342 0.00752346 2024-04-01T20:00:39.627 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:00:39.631 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:39.631 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:00:39.733 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:00:39.754 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T20:00:39.754 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:00:39.766 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T20:00:39.789 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:39.794 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:39 smithi022 ceph-mon[39439]: 9.b scrub starts 2024-04-01T20:00:39.794 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:39 smithi022 ceph-mon[39439]: 9.f scrub ok 2024-04-01T20:00:39.794 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:39 smithi022 ceph-mon[39439]: pgmap v2071: 17 pgs: 17 active+clean; 7.4 GiB data, 21 GiB used, 873 GiB / 894 GiB avail; 74 MiB/s wr, 1.18k op/s 2024-04-01T20:00:39.817 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:00:39.820 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:39.820 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:00:39.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:39 smithi188 ceph-mon[43939]: 9.b scrub starts 2024-04-01T20:00:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:39 smithi188 ceph-mon[43939]: 9.f scrub ok 2024-04-01T20:00:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:39 smithi188 ceph-mon[43939]: pgmap v2071: 17 pgs: 17 active+clean; 7.4 GiB data, 21 GiB used, 873 GiB / 894 GiB avail; 74 MiB/s wr, 1.18k op/s 2024-04-01T20:00:39.921 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:00:39.931 INFO:tasks.thrashosds.thrasher:Reviving osd 10 2024-04-01T20:00:39.931 INFO:tasks.cephadm.osd.10:Restarting osd.10 (starting--it wasn't running)... 2024-04-01T20:00:39.931 DEBUG:teuthology.orchestra.run.smithi188:osd.10> sudo journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.10.service 2024-04-01T20:00:39.939 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl start ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.10 2024-04-01T20:00:39.957 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:39 smithi062 ceph-mon[44211]: 9.b scrub starts 2024-04-01T20:00:39.957 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:39 smithi062 ceph-mon[44211]: 9.f scrub ok 2024-04-01T20:00:39.957 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:39 smithi062 ceph-mon[44211]: pgmap v2071: 17 pgs: 17 active+clean; 7.4 GiB data, 21 GiB used, 873 GiB / 894 GiB avail; 74 MiB/s wr, 1.18k op/s 2024-04-01T20:00:39.960 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:39.996 INFO:journalctl@ceph.osd.10.smithi188.stdout:-- Logs begin at Mon 2024-04-01 19:04:09 UTC. -- 2024-04-01T20:00:40.002 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:00:40.005 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:40.005 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:00:40.106 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:00:40.137 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:40.376 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:40 smithi188 systemd[1]: Starting Ceph osd.10 for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T20:00:40.492 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 20:00:40.494509 min lat: 0.00101525 max lat: 0.211697 avg lat: 0.00758207 2024-04-01T20:00:40.492 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T20:00:40.492 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 60 16 126639 126623 131.859 71.25 0.0141747 0.00758207 2024-04-01T20:00:41.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:40 smithi022 ceph-mon[39439]: 9.e scrub starts 2024-04-01T20:00:41.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:40 smithi188 ceph-mon[43939]: 9.e scrub starts 2024-04-01T20:00:41.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:40 smithi062 ceph-mon[44211]: 9.e scrub starts 2024-04-01T20:00:41.384 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_ops_in_flight 2024-04-01T20:00:41.390 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:00:41.393 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:41.394 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:00:41.492 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 61 15 127829 127814 130.917 74.4375 0.010171 0.00763693 2024-04-01T20:00:41.495 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:00:41.568 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:41.607 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:00:41.614 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:41.614 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:00:41.715 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:00:41.776 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:41.816 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:00:41.819 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:41.819 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:00:41.857 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T20:00:41.920 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:00:41.965 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:42.038 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:00:42.082 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:42 smithi188 bash[175044]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2024-04-01T20:00:42.082 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:42 smithi188 bash[175044]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-10 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-01T20:00:42.082 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:42 smithi188 bash[175044]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-01T20:00:42.082 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:42 smithi188 bash[175044]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-01T20:00:42.082 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:42 smithi188 bash[175044]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-10/block 2024-04-01T20:00:42.083 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:42 smithi188 bash[175044]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2024-04-01T20:00:42.083 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:42 smithi188 bash[175044]: --> ceph-volume raw activate successful for osd ID: 10 2024-04-01T20:00:42.083 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:41 smithi188 ceph-mon[43939]: 9.b scrub ok 2024-04-01T20:00:42.083 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:41 smithi188 ceph-mon[43939]: pgmap v2072: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 7.7 GiB data, 22 GiB used, 872 GiB / 894 GiB avail; 84 MiB/s wr, 1.35k op/s 2024-04-01T20:00:42.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:41 smithi022 ceph-mon[39439]: 9.b scrub ok 2024-04-01T20:00:42.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:41 smithi022 ceph-mon[39439]: pgmap v2072: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 7.7 GiB data, 22 GiB used, 872 GiB / 894 GiB avail; 84 MiB/s wr, 1.35k op/s 2024-04-01T20:00:42.224 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:41 smithi062 ceph-mon[44211]: 9.b scrub ok 2024-04-01T20:00:42.224 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:41 smithi062 ceph-mon[44211]: pgmap v2072: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 7.7 GiB data, 22 GiB used, 872 GiB / 894 GiB avail; 84 MiB/s wr, 1.35k op/s 2024-04-01T20:00:42.230 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:00:42.238 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:42.238 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:00:42.339 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:00:42.402 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:42.442 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:00:42.444 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:42.444 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:00:42.492 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 62 16 128877 128861 129.861 65.4375 0.00896939 0.00769925 2024-04-01T20:00:42.545 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:00:42.596 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:42.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:42 smithi188 ceph-mon[43939]: 9.e scrub ok 2024-04-01T20:00:42.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:42 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T20:00:42.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:42 smithi188 ceph-mon[43939]: 9.4 scrub starts 2024-04-01T20:00:42.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:42 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T20:00:42.801 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:42 smithi188 ceph-mon[43939]: 9.1 scrub starts 2024-04-01T20:00:42.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:42 smithi022 ceph-mon[39439]: 9.e scrub ok 2024-04-01T20:00:42.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:42 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T20:00:42.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:42 smithi022 ceph-mon[39439]: 9.4 scrub starts 2024-04-01T20:00:42.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:42 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T20:00:42.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:42 smithi022 ceph-mon[39439]: 9.1 scrub starts 2024-04-01T20:00:42.973 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:00:42.978 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:42 smithi062 ceph-mon[44211]: 9.e scrub ok 2024-04-01T20:00:42.978 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:42 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T20:00:42.979 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:42 smithi062 ceph-mon[44211]: 9.4 scrub starts 2024-04-01T20:00:42.979 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:42 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T20:00:42.979 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:42 smithi062 ceph-mon[44211]: 9.1 scrub starts 2024-04-01T20:00:42.979 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:42.980 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:00:43.080 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:00:43.141 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:43.411 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:00:43.415 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:43.415 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:00:43.492 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 63 16 129929 129913 128.844 65.75 0.0138453 0.00775989 2024-04-01T20:00:43.516 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:00:43.546 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:00:43.546 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:00:43.546 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:00:43.547 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T20:00:43.547 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:00:43.547 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:00:43.567 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:43.575 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:00:43.611 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:00:43.617 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:00:43.624 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:43.624 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:00:43.634 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:00:43.660 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:00:43.686 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:00:43.686 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:00:43.686 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:00:43.686 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:00:43.686 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T20:00:43.686 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:00:43.686 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:00:43.686 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:00:43.687 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:00:43.687 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:00:43.687 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:00:43.687 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.10 2024-04-01T20:00:43.687 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:00:43.720 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:43 smithi188 bash[175309]: 2b74c41430eeb7e0b9b53e15228a265fb5fa2df0d605b735f0d9e6e9e4e915e2 2024-04-01T20:00:43.725 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:00:43.727 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_ops_in_flight 2024-04-01T20:00:43.804 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:43.817 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:43 smithi062 ceph-mon[44211]: 9.7 scrub starts 2024-04-01T20:00:43.817 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:43 smithi062 ceph-mon[44211]: 9.1 scrub ok 2024-04-01T20:00:43.818 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:43 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3874802743' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:00:43.818 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:43.818 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:43 smithi062 ceph-mon[44211]: pgmap v2073: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 7.7 GiB data, 22 GiB used, 872 GiB / 894 GiB avail; 82 MiB/s wr, 1.31k op/s 2024-04-01T20:00:43.818 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:43.818 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:43.818 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:43.818 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:43.818 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:43 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:43.845 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:00:43.850 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:43.850 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:00:43.951 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:00:43.982 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:43 smithi188 systemd[1]: Started Ceph osd.10 for 09f6b846-f05c-11ee-b647-cb9ed24678a4. 2024-04-01T20:00:43.982 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:43 smithi188 ceph-mon[43939]: 9.7 scrub starts 2024-04-01T20:00:43.982 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:43 smithi188 ceph-mon[43939]: 9.1 scrub ok 2024-04-01T20:00:43.982 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:43 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3874802743' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:00:43.982 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:43.982 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:43 smithi188 ceph-mon[43939]: pgmap v2073: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 7.7 GiB data, 22 GiB used, 872 GiB / 894 GiB avail; 82 MiB/s wr, 1.31k op/s 2024-04-01T20:00:43.982 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:43.983 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:43.983 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:43.983 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:43.983 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:43 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:43.987 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:44.022 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:00:44.028 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:44.029 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:00:44.097 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:43 smithi022 ceph-mon[39439]: 9.7 scrub starts 2024-04-01T20:00:44.097 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:43 smithi022 ceph-mon[39439]: 9.1 scrub ok 2024-04-01T20:00:44.097 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:43 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3874802743' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:00:44.097 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:44.097 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:43 smithi022 ceph-mon[39439]: pgmap v2073: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 7.7 GiB data, 22 GiB used, 872 GiB / 894 GiB avail; 82 MiB/s wr, 1.31k op/s 2024-04-01T20:00:44.097 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:44.097 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:44.098 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:44.098 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:44.098 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:43 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:44.129 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:00:44.183 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T20:00:44.189 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:44.240 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:00:44.242 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:44 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:44.184+0000 7fa80f05f7c0 -1 Falling back to public interface 2024-04-01T20:00:44.243 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:44.243 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:00:44.344 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:00:44.404 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:44.447 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:00:44.454 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:44.454 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:00:44.492 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 64 16 130921 130905 127.8 62 0.0197589 0.0078225 2024-04-01T20:00:44.555 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:00:44.593 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:44.599 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T20:00:44.599 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T20:00:44.599 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 0 2024-04-01T20:00:44.599 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T20:00:44.623 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:00:44.626 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:44.626 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:00:44.727 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:00:44.771 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:44.924 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:44 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:44.924 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:44 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:00:44.924 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:44 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:00:44.924 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:44 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:44.924 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:44 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:44.924 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:44 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:44.925 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:44 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:44.925 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:44 smithi022 ceph-mon[39439]: osdmap e758: 12 total, 11 up, 10 in 2024-04-01T20:00:44.925 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:44 smithi022 ceph-mon[39439]: 9.4 scrub ok 2024-04-01T20:00:44.925 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:44 smithi022 ceph-mon[39439]: 9.7 scrub ok 2024-04-01T20:00:45.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:44 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:45.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:44 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:00:45.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:44 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:00:45.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:44 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:45.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:44 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:45.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:44 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:45.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:44 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:45.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:44 smithi188 ceph-mon[43939]: osdmap e758: 12 total, 11 up, 10 in 2024-04-01T20:00:45.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:44 smithi188 ceph-mon[43939]: 9.4 scrub ok 2024-04-01T20:00:45.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:44 smithi188 ceph-mon[43939]: 9.7 scrub ok 2024-04-01T20:00:45.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:44 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:45.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:44 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:00:45.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:44 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:00:45.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:44 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:45.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:44 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:45.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:44 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:45.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:44 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:45.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:44 smithi062 ceph-mon[44211]: osdmap e758: 12 total, 11 up, 10 in 2024-04-01T20:00:45.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:44 smithi062 ceph-mon[44211]: 9.4 scrub ok 2024-04-01T20:00:45.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:44 smithi062 ceph-mon[44211]: 9.7 scrub ok 2024-04-01T20:00:45.409 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_blocked_ops 2024-04-01T20:00:45.492 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 65 16 132108 132092 126.975 74.1875 0.00508965 0.00787398 2024-04-01T20:00:45.824 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T20:00:45.878 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T20:00:46.081 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:45 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1274055647' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:00:46.081 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:45 smithi062 ceph-mon[44211]: pgmap v2075: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 7.9 GiB data, 22 GiB used, 872 GiB / 894 GiB avail; 67 MiB/s wr, 1.07k op/s 2024-04-01T20:00:46.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:45 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1274055647' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:00:46.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:45 smithi022 ceph-mon[39439]: pgmap v2075: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 7.9 GiB data, 22 GiB used, 872 GiB / 894 GiB avail; 67 MiB/s wr, 1.07k op/s 2024-04-01T20:00:46.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:45 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1274055647' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:00:46.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:45 smithi188 ceph-mon[43939]: pgmap v2075: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 7.9 GiB data, 22 GiB used, 872 GiB / 894 GiB avail; 67 MiB/s wr, 1.07k op/s 2024-04-01T20:00:46.433 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T20:00:46.434 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T20:00:46.492 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 66 16 133145 133129 126.033 64.8125 0.0153946 0.00793329 2024-04-01T20:00:47.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:46 smithi022 ceph-mon[39439]: 9.8 scrub starts 2024-04-01T20:00:47.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:46 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T20:00:47.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:46 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T20:00:47.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:46 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1274055647' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T20:00:47.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:46 smithi022 ceph-mon[39439]: osdmap e759: 12 total, 11 up, 10 in 2024-04-01T20:00:47.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:46 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:00:47.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:46 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:00:47.127 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:46 smithi188 ceph-mon[43939]: 9.8 scrub starts 2024-04-01T20:00:47.127 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:46 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T20:00:47.127 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:46 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T20:00:47.127 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:46 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1274055647' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T20:00:47.127 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:46 smithi188 ceph-mon[43939]: osdmap e759: 12 total, 11 up, 10 in 2024-04-01T20:00:47.127 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:46 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:00:47.127 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:46 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:00:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:46 smithi062 ceph-mon[44211]: 9.8 scrub starts 2024-04-01T20:00:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:46 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T20:00:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:46 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T20:00:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:46 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1274055647' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T20:00:47.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:46 smithi062 ceph-mon[44211]: osdmap e759: 12 total, 11 up, 10 in 2024-04-01T20:00:47.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:46 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:00:47.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:46 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:00:47.492 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 67 16 134153 134137 125.092 63 0.00969091 0.00799223 2024-04-01T20:00:47.544 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:00:47.549 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:47.550 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:00:47.651 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:00:47.683 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:47.703 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:00:47.706 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:47.706 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:00:47.807 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:00:47.814 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.810+0000 7fa80f05f7c0 -1 osd.10 679 log_to_monitors true 2024-04-01T20:00:47.846 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:48.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:47 smithi022 ceph-mon[39439]: osdmap e760: 12 total, 11 up, 10 in 2024-04-01T20:00:48.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:47 smithi022 ceph-mon[39439]: pgmap v2078: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 8.0 GiB data, 22 GiB used, 872 GiB / 894 GiB avail; 61 MiB/s wr, 980 op/s 2024-04-01T20:00:48.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:47 smithi022 ceph-mon[39439]: from='osd.10 v1:172.21.15.188:6808/260531768' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-01T20:00:48.128 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-mon[43939]: osdmap e760: 12 total, 11 up, 10 in 2024-04-01T20:00:48.128 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-mon[43939]: pgmap v2078: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 8.0 GiB data, 22 GiB used, 872 GiB / 894 GiB avail; 61 MiB/s wr, 980 op/s 2024-04-01T20:00:48.128 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-mon[43939]: from='osd.10 v1:172.21.15.188:6808/260531768' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-01T20:00:48.129 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.894+0000 7fa7f7e3f700 -1 osd.10 679 failed to load OSD map for epoch 705, got 0 bytes 2024-04-01T20:00:48.129 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 680, got 0 bytes 2024-04-01T20:00:48.129 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 681, got 0 bytes 2024-04-01T20:00:48.129 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 682, got 0 bytes 2024-04-01T20:00:48.129 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 680, got 0 bytes 2024-04-01T20:00:48.129 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 681, got 0 bytes 2024-04-01T20:00:48.129 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 682, got 0 bytes 2024-04-01T20:00:48.129 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 683, got 0 bytes 2024-04-01T20:00:48.129 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 684, got 0 bytes 2024-04-01T20:00:48.129 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 685, got 0 bytes 2024-04-01T20:00:48.129 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 686, got 0 bytes 2024-04-01T20:00:48.130 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 687, got 0 bytes 2024-04-01T20:00:48.130 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 688, got 0 bytes 2024-04-01T20:00:48.130 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 689, got 0 bytes 2024-04-01T20:00:48.130 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 690, got 0 bytes 2024-04-01T20:00:48.130 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 691, got 0 bytes 2024-04-01T20:00:48.130 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 692, got 0 bytes 2024-04-01T20:00:48.130 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 693, got 0 bytes 2024-04-01T20:00:48.130 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 694, got 0 bytes 2024-04-01T20:00:48.130 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 695, got 0 bytes 2024-04-01T20:00:48.130 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 696, got 0 bytes 2024-04-01T20:00:48.130 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 697, got 0 bytes 2024-04-01T20:00:48.131 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 698, got 0 bytes 2024-04-01T20:00:48.131 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 699, got 0 bytes 2024-04-01T20:00:48.131 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 700, got 0 bytes 2024-04-01T20:00:48.131 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 701, got 0 bytes 2024-04-01T20:00:48.131 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 702, got 0 bytes 2024-04-01T20:00:48.131 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 703, got 0 bytes 2024-04-01T20:00:48.131 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 704, got 0 bytes 2024-04-01T20:00:48.131 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.899+0000 7fa7e9c8a700 -1 osd.10 706 failed to load OSD map for epoch 705, got 0 bytes 2024-04-01T20:00:48.131 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 680, got 0 bytes 2024-04-01T20:00:48.131 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 681, got 0 bytes 2024-04-01T20:00:48.131 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 682, got 0 bytes 2024-04-01T20:00:48.131 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 683, got 0 bytes 2024-04-01T20:00:48.131 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 684, got 0 bytes 2024-04-01T20:00:48.131 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 685, got 0 bytes 2024-04-01T20:00:48.132 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 686, got 0 bytes 2024-04-01T20:00:48.132 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 687, got 0 bytes 2024-04-01T20:00:48.132 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 688, got 0 bytes 2024-04-01T20:00:48.132 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 689, got 0 bytes 2024-04-01T20:00:48.132 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 690, got 0 bytes 2024-04-01T20:00:48.132 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 691, got 0 bytes 2024-04-01T20:00:48.132 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 692, got 0 bytes 2024-04-01T20:00:48.132 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 693, got 0 bytes 2024-04-01T20:00:48.132 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 694, got 0 bytes 2024-04-01T20:00:48.132 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 695, got 0 bytes 2024-04-01T20:00:48.132 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 696, got 0 bytes 2024-04-01T20:00:48.132 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 697, got 0 bytes 2024-04-01T20:00:48.132 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 698, got 0 bytes 2024-04-01T20:00:48.132 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 699, got 0 bytes 2024-04-01T20:00:48.132 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 700, got 0 bytes 2024-04-01T20:00:48.132 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 701, got 0 bytes 2024-04-01T20:00:48.133 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 702, got 0 bytes 2024-04-01T20:00:48.133 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 703, got 0 bytes 2024-04-01T20:00:48.133 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 704, got 0 bytes 2024-04-01T20:00:48.133 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e3c7e700 -1 osd.10 706 failed to load OSD map for epoch 705, got 0 bytes 2024-04-01T20:00:48.133 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 680, got 0 bytes 2024-04-01T20:00:48.133 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 681, got 0 bytes 2024-04-01T20:00:48.133 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 682, got 0 bytes 2024-04-01T20:00:48.133 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 683, got 0 bytes 2024-04-01T20:00:48.133 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 684, got 0 bytes 2024-04-01T20:00:48.133 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 685, got 0 bytes 2024-04-01T20:00:48.133 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 686, got 0 bytes 2024-04-01T20:00:48.133 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 687, got 0 bytes 2024-04-01T20:00:48.133 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 688, got 0 bytes 2024-04-01T20:00:48.133 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 689, got 0 bytes 2024-04-01T20:00:48.133 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 690, got 0 bytes 2024-04-01T20:00:48.134 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 691, got 0 bytes 2024-04-01T20:00:48.134 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 692, got 0 bytes 2024-04-01T20:00:48.134 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 693, got 0 bytes 2024-04-01T20:00:48.134 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 694, got 0 bytes 2024-04-01T20:00:48.134 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 695, got 0 bytes 2024-04-01T20:00:48.134 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 696, got 0 bytes 2024-04-01T20:00:48.134 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 697, got 0 bytes 2024-04-01T20:00:48.134 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 698, got 0 bytes 2024-04-01T20:00:48.134 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 699, got 0 bytes 2024-04-01T20:00:48.134 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 700, got 0 bytes 2024-04-01T20:00:48.134 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 701, got 0 bytes 2024-04-01T20:00:48.134 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 702, got 0 bytes 2024-04-01T20:00:48.134 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 703, got 0 bytes 2024-04-01T20:00:48.134 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 704, got 0 bytes 2024-04-01T20:00:48.135 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.900+0000 7fa7e447f700 -1 osd.10 706 failed to load OSD map for epoch 705, got 0 bytes 2024-04-01T20:00:48.135 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 680, got 0 bytes 2024-04-01T20:00:48.135 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 681, got 0 bytes 2024-04-01T20:00:48.135 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 682, got 0 bytes 2024-04-01T20:00:48.135 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 683, got 0 bytes 2024-04-01T20:00:48.135 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 684, got 0 bytes 2024-04-01T20:00:48.135 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 685, got 0 bytes 2024-04-01T20:00:48.135 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 686, got 0 bytes 2024-04-01T20:00:48.135 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 687, got 0 bytes 2024-04-01T20:00:48.135 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 688, got 0 bytes 2024-04-01T20:00:48.135 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 689, got 0 bytes 2024-04-01T20:00:48.135 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 690, got 0 bytes 2024-04-01T20:00:48.135 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 691, got 0 bytes 2024-04-01T20:00:48.136 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 692, got 0 bytes 2024-04-01T20:00:48.136 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 693, got 0 bytes 2024-04-01T20:00:48.136 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 694, got 0 bytes 2024-04-01T20:00:48.136 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 695, got 0 bytes 2024-04-01T20:00:48.136 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 696, got 0 bytes 2024-04-01T20:00:48.136 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 697, got 0 bytes 2024-04-01T20:00:48.136 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 698, got 0 bytes 2024-04-01T20:00:48.136 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 699, got 0 bytes 2024-04-01T20:00:48.136 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 700, got 0 bytes 2024-04-01T20:00:48.136 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 701, got 0 bytes 2024-04-01T20:00:48.136 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 702, got 0 bytes 2024-04-01T20:00:48.136 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 703, got 0 bytes 2024-04-01T20:00:48.136 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 704, got 0 bytes 2024-04-01T20:00:48.137 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e7485700 -1 osd.10 706 failed to load OSD map for epoch 705, got 0 bytes 2024-04-01T20:00:48.137 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 683, got 0 bytes 2024-04-01T20:00:48.137 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 684, got 0 bytes 2024-04-01T20:00:48.137 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 685, got 0 bytes 2024-04-01T20:00:48.137 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 686, got 0 bytes 2024-04-01T20:00:48.137 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 687, got 0 bytes 2024-04-01T20:00:48.137 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 688, got 0 bytes 2024-04-01T20:00:48.137 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 689, got 0 bytes 2024-04-01T20:00:48.137 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 690, got 0 bytes 2024-04-01T20:00:48.137 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 691, got 0 bytes 2024-04-01T20:00:48.137 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 692, got 0 bytes 2024-04-01T20:00:48.137 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 693, got 0 bytes 2024-04-01T20:00:48.137 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 694, got 0 bytes 2024-04-01T20:00:48.137 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 695, got 0 bytes 2024-04-01T20:00:48.137 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 696, got 0 bytes 2024-04-01T20:00:48.137 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 697, got 0 bytes 2024-04-01T20:00:48.138 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 698, got 0 bytes 2024-04-01T20:00:48.138 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 699, got 0 bytes 2024-04-01T20:00:48.138 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 700, got 0 bytes 2024-04-01T20:00:48.138 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 701, got 0 bytes 2024-04-01T20:00:48.138 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 702, got 0 bytes 2024-04-01T20:00:48.138 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 703, got 0 bytes 2024-04-01T20:00:48.138 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 704, got 0 bytes 2024-04-01T20:00:48.138 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.902+0000 7fa7e6483700 -1 osd.10 706 failed to load OSD map for epoch 705, got 0 bytes 2024-04-01T20:00:48.138 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:00:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:00:47.933+0000 7fa7fc4af700 -1 osd.10 746 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T20:00:48.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:47 smithi062 ceph-mon[44211]: osdmap e760: 12 total, 11 up, 10 in 2024-04-01T20:00:48.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:47 smithi062 ceph-mon[44211]: pgmap v2078: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 8.0 GiB data, 22 GiB used, 872 GiB / 894 GiB avail; 61 MiB/s wr, 980 op/s 2024-04-01T20:00:48.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:47 smithi062 ceph-mon[44211]: from='osd.10 v1:172.21.15.188:6808/260531768' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-01T20:00:48.435 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T20:00:48.494 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 68 16 135163 135147 124.178 63.125 0.0196994 0.0080511 2024-04-01T20:00:48.652 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T20:00:48.652 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T20:00:48.653 INFO:teuthology.orchestra.run.smithi062.stdout: "complaint_time": 30, 2024-04-01T20:00:48.653 INFO:teuthology.orchestra.run.smithi062.stdout: "num_blocked_ops": 0 2024-04-01T20:00:48.653 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T20:00:48.725 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:00:49.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:48 smithi062 ceph-mon[44211]: 9.8 scrub ok 2024-04-01T20:00:49.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:48 smithi062 ceph-mon[44211]: from='osd.10 v1:172.21.15.188:6808/260531768' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-01T20:00:49.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:48 smithi062 ceph-mon[44211]: osdmap e761: 12 total, 11 up, 10 in 2024-04-01T20:00:49.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:48 smithi062 ceph-mon[44211]: from='osd.10 v1:172.21.15.188:6808/260531768' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T20:00:49.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:48 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T20:00:49.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:48 smithi062 ceph-mon[44211]: 9.2 scrub starts 2024-04-01T20:00:49.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:48 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:00:49.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:48 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:00:49.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:48 smithi188 ceph-mon[43939]: 9.8 scrub ok 2024-04-01T20:00:49.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:48 smithi188 ceph-mon[43939]: from='osd.10 v1:172.21.15.188:6808/260531768' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-01T20:00:49.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:48 smithi188 ceph-mon[43939]: osdmap e761: 12 total, 11 up, 10 in 2024-04-01T20:00:49.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:48 smithi188 ceph-mon[43939]: from='osd.10 v1:172.21.15.188:6808/260531768' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T20:00:49.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:48 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T20:00:49.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:48 smithi188 ceph-mon[43939]: 9.2 scrub starts 2024-04-01T20:00:49.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:48 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:00:49.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:48 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:00:49.283 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T20:00:49.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:48 smithi022 ceph-mon[39439]: 9.8 scrub ok 2024-04-01T20:00:49.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:48 smithi022 ceph-mon[39439]: from='osd.10 v1:172.21.15.188:6808/260531768' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-01T20:00:49.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:48 smithi022 ceph-mon[39439]: osdmap e761: 12 total, 11 up, 10 in 2024-04-01T20:00:49.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:48 smithi022 ceph-mon[39439]: from='osd.10 v1:172.21.15.188:6808/260531768' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-04-01T20:00:49.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:48 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T20:00:49.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:48 smithi022 ceph-mon[39439]: 9.2 scrub starts 2024-04-01T20:00:49.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:48 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:00:49.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:48 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:00:49.494 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 69 16 136122 136106 123.248 59.9375 0.00949378 0.00811178 2024-04-01T20:00:50.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:49 smithi022 ceph-mon[39439]: osd.10 v1:172.21.15.188:6808/260531768 boot 2024-04-01T20:00:50.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:49 smithi022 ceph-mon[39439]: osdmap e762: 12 total, 12 up, 10 in 2024-04-01T20:00:50.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:49 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T20:00:50.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:49 smithi022 ceph-mon[39439]: 9.d deep-scrub starts 2024-04-01T20:00:50.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:49 smithi022 ceph-mon[39439]: pgmap v2081: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.1 GiB data, 22 GiB used, 872 GiB / 894 GiB avail; 68 MiB/s wr, 1.08k op/s 2024-04-01T20:00:50.246 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:00:50.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:49 smithi062 ceph-mon[44211]: osd.10 v1:172.21.15.188:6808/260531768 boot 2024-04-01T20:00:50.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:49 smithi062 ceph-mon[44211]: osdmap e762: 12 total, 12 up, 10 in 2024-04-01T20:00:50.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:49 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T20:00:50.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:49 smithi062 ceph-mon[44211]: 9.d deep-scrub starts 2024-04-01T20:00:50.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:49 smithi062 ceph-mon[44211]: pgmap v2081: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.1 GiB data, 22 GiB used, 872 GiB / 894 GiB avail; 68 MiB/s wr, 1.08k op/s 2024-04-01T20:00:50.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:49 smithi188 ceph-mon[43939]: osd.10 v1:172.21.15.188:6808/260531768 boot 2024-04-01T20:00:50.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:49 smithi188 ceph-mon[43939]: osdmap e762: 12 total, 12 up, 10 in 2024-04-01T20:00:50.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:49 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T20:00:50.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:49 smithi188 ceph-mon[43939]: 9.d deep-scrub starts 2024-04-01T20:00:50.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:49 smithi188 ceph-mon[43939]: pgmap v2081: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.1 GiB data, 22 GiB used, 872 GiB / 894 GiB avail; 68 MiB/s wr, 1.08k op/s 2024-04-01T20:00:50.494 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 70 16 137045 137029 122.311 57.6875 0.00523298 0.00817309 2024-04-01T20:00:50.690 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:00:50.695 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:50.696 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:00:50.797 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:00:50.847 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:51.053 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:50 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:51.053 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:50 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:00:51.053 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:50 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:00:51.053 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:50 smithi188 ceph-mon[43939]: osdmap e763: 12 total, 12 up, 10 in 2024-04-01T20:00:51.053 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:50 smithi188 ceph-mon[43939]: 9.5 scrub starts 2024-04-01T20:00:51.053 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:50 smithi188 ceph-mon[43939]: 9.2 scrub ok 2024-04-01T20:00:51.053 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:50 smithi188 ceph-mon[43939]: 9.3 scrub starts 2024-04-01T20:00:51.067 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:00:51.073 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:51.074 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:00:51.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:50 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:51.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:50 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:00:51.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:50 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:00:51.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:50 smithi022 ceph-mon[39439]: osdmap e763: 12 total, 12 up, 10 in 2024-04-01T20:00:51.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:50 smithi022 ceph-mon[39439]: 9.5 scrub starts 2024-04-01T20:00:51.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:50 smithi022 ceph-mon[39439]: 9.2 scrub ok 2024-04-01T20:00:51.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:50 smithi022 ceph-mon[39439]: 9.3 scrub starts 2024-04-01T20:00:51.175 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:00:51.217 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:50 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:51.217 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:50 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:00:51.217 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:50 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:00:51.217 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:50 smithi062 ceph-mon[44211]: osdmap e763: 12 total, 12 up, 10 in 2024-04-01T20:00:51.217 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:50 smithi062 ceph-mon[44211]: 9.5 scrub starts 2024-04-01T20:00:51.217 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:50 smithi062 ceph-mon[44211]: 9.2 scrub ok 2024-04-01T20:00:51.217 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:50 smithi062 ceph-mon[44211]: 9.3 scrub starts 2024-04-01T20:00:51.222 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:51.436 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T20:00:51.436 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T20:00:51.436 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-01T20:00:51.436 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T20:00:51.461 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:00:51.464 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:51.464 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:00:51.495 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 71 16 137876 137860 121.32 51.9375 0.0154275 0.00824017 2024-04-01T20:00:51.565 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:00:51.599 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:51.749 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:00:51.755 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:51.755 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:00:51.856 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:00:51.899 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:51.932 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:00:51.962 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:00:51.982 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:00:52.002 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T20:00:52.025 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:00:52.053 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:00:52.079 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:00:52.107 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:00:52.131 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:51 smithi188 ceph-mon[43939]: pgmap v2083: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.3 GiB data, 23 GiB used, 871 GiB / 894 GiB avail; 64 MiB/s wr, 1.02k op/s 2024-04-01T20:00:52.131 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:51 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:00:52.131 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:51 smithi188 ceph-mon[43939]: 9.3 scrub ok 2024-04-01T20:00:52.131 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:51 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/861686145' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:00:52.131 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:00:52.152 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:00:52.172 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T20:00:52.192 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:00:52.194 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:00:52.194 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:00:52.194 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:00:52.194 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T20:00:52.194 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:00:52.194 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:00:52.194 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:00:52.195 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:00:52.195 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:00:52.195 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:00:52.195 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-04-01T20:00:52.195 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:00:52.212 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:51 smithi022 ceph-mon[39439]: pgmap v2083: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.3 GiB data, 23 GiB used, 871 GiB / 894 GiB avail; 64 MiB/s wr, 1.02k op/s 2024-04-01T20:00:52.213 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:51 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:00:52.213 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:51 smithi022 ceph-mon[39439]: 9.3 scrub ok 2024-04-01T20:00:52.213 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:51 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/861686145' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:00:52.254 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:00:52.262 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:52.262 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:00:52.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:51 smithi062 ceph-mon[44211]: pgmap v2083: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.3 GiB data, 23 GiB used, 871 GiB / 894 GiB avail; 64 MiB/s wr, 1.02k op/s 2024-04-01T20:00:52.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:51 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:00:52.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:51 smithi062 ceph-mon[44211]: 9.3 scrub ok 2024-04-01T20:00:52.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:51 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/861686145' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:00:52.292 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-01T20:00:52.292 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-04-01T20:00:52.292 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-01T20:00:52.292 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-01T20:00:52.292 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 config set filestore_inject_stall 3 2024-04-01T20:00:52.364 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:00:52.442 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:52.494 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 72 16 138672 138656 120.326 49.75 0.0444189 0.00830577 2024-04-01T20:00:53.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:52 smithi062 ceph-mon[44211]: 9.a scrub starts 2024-04-01T20:00:53.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:52 smithi022 ceph-mon[39439]: 9.a scrub starts 2024-04-01T20:00:53.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:52 smithi188 ceph-mon[43939]: 9.a scrub starts 2024-04-01T20:00:53.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:53.495 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 73 16 139492 139476 119.38 51.25 0.00622069 0.00837095 2024-04-01T20:00:54.195 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:54.196 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:53 smithi022 ceph-mon[39439]: 9.0 scrub starts 2024-04-01T20:00:54.196 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:53 smithi022 ceph-mon[39439]: pgmap v2084: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.4 GiB data, 23 GiB used, 871 GiB / 894 GiB avail; 58 MiB/s wr, 924 op/s 2024-04-01T20:00:54.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:54.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:53 smithi062 ceph-mon[44211]: 9.0 scrub starts 2024-04-01T20:00:54.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:53 smithi062 ceph-mon[44211]: pgmap v2084: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.4 GiB data, 23 GiB used, 871 GiB / 894 GiB avail; 58 MiB/s wr, 924 op/s 2024-04-01T20:00:54.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:54.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:53 smithi188 ceph-mon[43939]: 9.0 scrub starts 2024-04-01T20:00:54.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:53 smithi188 ceph-mon[43939]: pgmap v2084: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 8.4 GiB data, 23 GiB used, 871 GiB / 894 GiB avail; 58 MiB/s wr, 924 op/s 2024-04-01T20:00:54.495 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 74 16 140223 140207 118.384 45.6875 0.00788509 0.0084443 2024-04-01T20:00:54.913 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:00:54.917 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:54.918 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:00:54.937 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T20:00:54.954 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_historic_ops 2024-04-01T20:00:55.019 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:00:55.046 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:55.048 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T20:00:55.085 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:00:55.087 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:55.088 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:00:55.188 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:00:55.251 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:54 smithi062 ceph-mon[44211]: 9.5 scrub ok 2024-04-01T20:00:55.251 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:54 smithi062 ceph-mon[44211]: 9.a scrub ok 2024-04-01T20:00:55.252 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:54 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1527203154' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:00:55.256 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:55.345 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:54 smithi022 ceph-mon[39439]: 9.5 scrub ok 2024-04-01T20:00:55.345 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:54 smithi022 ceph-mon[39439]: 9.a scrub ok 2024-04-01T20:00:55.345 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:54 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1527203154' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:00:55.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:54 smithi188 ceph-mon[43939]: 9.5 scrub ok 2024-04-01T20:00:55.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:54 smithi188 ceph-mon[43939]: 9.a scrub ok 2024-04-01T20:00:55.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:54 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1527203154' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:00:55.406 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:00:55.410 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:55.411 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:00:55.495 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 75 16 141033 141017 117.481 50.625 0.0152228 0.00850969 2024-04-01T20:00:55.511 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:00:55.547 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:55.577 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:00:55.581 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:55.581 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:00:55.682 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:00:55.723 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:55.892 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:00:55.898 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:55.899 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:00:56.000 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:00:56.016 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:55 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:00:56.016 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:55 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:00:56.017 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:55 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:00:56.017 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:55 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1527203154' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T20:00:56.017 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:55 smithi062 ceph-mon[44211]: osdmap e764: 12 total, 12 up, 10 in 2024-04-01T20:00:56.017 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:55 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:00:56.017 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:55 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:00:56.017 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:55 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T20:00:56.017 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:55 smithi062 ceph-mon[44211]: pgmap v2086: 17 pgs: 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 15 active+clean; 8.5 GiB data, 23 GiB used, 871 GiB / 894 GiB avail; 61 MiB/s wr, 983 op/s 2024-04-01T20:00:56.030 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:56.050 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:00:56.052 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:55 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:00:56.053 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:55 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:00:56.053 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:55 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:00:56.053 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:55 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1527203154' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T20:00:56.053 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:55 smithi022 ceph-mon[39439]: osdmap e764: 12 total, 12 up, 10 in 2024-04-01T20:00:56.053 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:55 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:00:56.053 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:55 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:00:56.053 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:55 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T20:00:56.053 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:55 smithi022 ceph-mon[39439]: pgmap v2086: 17 pgs: 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 15 active+clean; 8.5 GiB data, 23 GiB used, 871 GiB / 894 GiB avail; 61 MiB/s wr, 983 op/s 2024-04-01T20:00:56.054 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:56.054 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:00:56.155 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:00:56.190 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:56.197 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T20:00:56.205 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T20:00:56.217 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:00:56.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:55 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:00:56.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:55 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:00:56.221 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:55 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:00:56.222 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:55 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1527203154' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T20:00:56.222 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:55 smithi188 ceph-mon[43939]: osdmap e764: 12 total, 12 up, 10 in 2024-04-01T20:00:56.222 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:55 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:00:56.222 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:55 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:00:56.222 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:55 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T20:00:56.222 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:55 smithi188 ceph-mon[43939]: pgmap v2086: 17 pgs: 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 15 active+clean; 8.5 GiB data, 23 GiB used, 871 GiB / 894 GiB avail; 61 MiB/s wr, 983 op/s 2024-04-01T20:00:56.222 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:56.223 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:00:56.324 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:00:56.351 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:56.372 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:00:56.375 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:56.375 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:00:56.476 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:00:56.491 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:00:56.495 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 76 16 141939 141923 116.68 56.625 0.00522429 0.00856744 2024-04-01T20:00:56.507 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:56.539 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:00:56.542 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:56.542 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:00:56.643 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:00:56.672 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:56.726 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:00:56.729 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:56.729 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:00:56.830 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:00:56.860 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:57.008 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:00:57.012 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:57.012 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:00:57.113 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:00:57.143 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:57.341 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:00:57.344 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:57.345 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:00:57.445 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:00:57.478 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:57.495 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 77 16 142847 142831 115.902 56.75 0.0126715 0.00862484 2024-04-01T20:00:57.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:57 smithi022 ceph-mon[39439]: pgmap v2087: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.6 GiB data, 24 GiB used, 871 GiB / 894 GiB avail; 59 MiB/s wr, 941 op/s 2024-04-01T20:00:57.799 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:57 smithi062 ceph-mon[44211]: pgmap v2087: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.6 GiB data, 24 GiB used, 871 GiB / 894 GiB avail; 59 MiB/s wr, 941 op/s 2024-04-01T20:00:57.824 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T20:00:57.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:57 smithi188 ceph-mon[43939]: pgmap v2087: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.6 GiB data, 24 GiB used, 871 GiB / 894 GiB avail; 59 MiB/s wr, 941 op/s 2024-04-01T20:00:57.929 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:00:57.934 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:57.934 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:00:58.035 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:00:58.082 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:00:58.204 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:58.205 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:00:58.306 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:00:58.368 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:58.399 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:00:58.405 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:58.406 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:00:58.495 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 78 16 143749 143733 115.139 56.375 0.0112743 0.00868154 2024-04-01T20:00:58.506 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:00:58.519 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:00:58.528 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:00:58.535 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:58 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1770541343' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:00:58.539 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:58.545 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:00:58.563 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:00:58.566 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:58.566 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:00:58.571 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:00:58.594 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T20:00:58.617 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:00:58.642 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:00:58.667 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:00:58.668 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:00:58.698 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:00:58.719 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:00:58.725 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:58 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1770541343' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:00:58.728 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:58.740 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:00:58.763 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T20:00:58.788 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:00:58.790 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:00:58.790 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:00:58.790 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:00:58.790 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T20:00:58.790 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:00:58.790 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:00:58.790 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:00:58.791 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:00:58.791 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:00:58.791 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:00:58.791 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T20:00:58.791 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:00:58.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:58 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1770541343' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:00:58.988 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:00:58.994 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:58.994 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:00:59.095 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:00:59.144 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:59.241 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T20:00:59.242 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-01T20:00:59.242 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T20:00:59.267 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:00:59.272 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:59.272 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:00:59.373 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:00:59.441 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:00:59.469 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T20:00:59.469 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 20, 2024-04-01T20:00:59.469 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 600, 2024-04-01T20:00:59.469 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T20:00:59.469 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.469 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26983.0:159033 8.5 8:a54e7f3a:::benchmark_data_smithi188_161190_object19751:head [delete] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e688)", 2024-04-01T20:00:59.469 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:21.730606+0000", 2024-04-01T20:00:59.470 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 277.73467436300001, 2024-04-01T20:00:59.470 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.27229044800000002, 2024-04-01T20:00:59.470 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:00:59.470 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:00:59.470 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:59.470 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:00:59.470 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26983", 2024-04-01T20:00:59.470 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:00:59.470 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 159033 2024-04-01T20:00:59.470 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.470 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:00:59.470 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.470 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:00:59.471 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.730606+0000", 2024-04-01T20:00:59.471 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.471 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.471 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.471 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:00:59.471 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.730606+0000", 2024-04-01T20:00:59.471 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.471 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.471 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.471 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:00:59.471 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.730608+0000", 2024-04-01T20:00:59.471 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1600000000000001e-06 2024-04-01T20:00:59.471 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.471 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.472 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:00:59.472 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.730615+0000", 2024-04-01T20:00:59.472 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.7290000000000003e-06 2024-04-01T20:00:59.472 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.472 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.472 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:00:59.472 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.730626+0000", 2024-04-01T20:00:59.472 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0569e-05 2024-04-01T20:00:59.472 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.472 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.472 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:00:59.472 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.730634+0000", 2024-04-01T20:00:59.472 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9689999999999994e-06 2024-04-01T20:00:59.472 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.473 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.473 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.473 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.730696+0000", 2024-04-01T20:00:59.473 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2528999999999997e-05 2024-04-01T20:00:59.473 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.473 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.473 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for peered", 2024-04-01T20:00:59.473 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.730708+0000", 2024-04-01T20:00:59.473 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.224e-05 2024-04-01T20:00:59.473 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.473 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.473 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.473 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.974283+0000", 2024-04-01T20:00:59.473 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.243574495 2024-04-01T20:00:59.474 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.474 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.474 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for degraded object", 2024-04-01T20:00:59.474 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.974935+0000", 2024-04-01T20:00:59.474 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00065220000000000002 2024-04-01T20:00:59.474 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.474 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.474 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.474 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.983868+0000", 2024-04-01T20:00:59.474 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0089330020000000007 2024-04-01T20:00:59.474 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.474 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.474 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:00:59.475 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.983938+0000", 2024-04-01T20:00:59.475 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.0165000000000003e-05 2024-04-01T20:00:59.475 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.475 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.475 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T20:00:59.475 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.984032+0000", 2024-04-01T20:00:59.475 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.3432999999999998e-05 2024-04-01T20:00:59.475 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.475 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.475 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:00:59.475 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.994529+0000", 2024-04-01T20:00:59.475 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.010497866 2024-04-01T20:00:59.475 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.475 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.475 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:59.476 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.998746+0000", 2024-04-01T20:00:59.476 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0042168249999999996 2024-04-01T20:00:59.476 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.476 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.476 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:00:59.476 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.998842+0000", 2024-04-01T20:00:59.476 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.6162000000000005e-05 2024-04-01T20:00:59.476 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.476 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.476 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:00:59.476 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:22.002897+0000", 2024-04-01T20:00:59.476 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0040541040000000002 2024-04-01T20:00:59.476 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.476 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:00:59.477 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.477 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.477 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.477 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26983.0:159035 8.5 8:a048e5ab:::benchmark_data_smithi188_161190_object19753:head [delete] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e688)", 2024-04-01T20:00:59.477 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:21.730648+0000", 2024-04-01T20:00:59.477 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 277.73463212299998, 2024-04-01T20:00:59.477 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.27950175500000002, 2024-04-01T20:00:59.477 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:00:59.477 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:00:59.477 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:59.477 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:00:59.477 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26983", 2024-04-01T20:00:59.477 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:00:59.477 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 159035 2024-04-01T20:00:59.478 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.478 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:00:59.478 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.478 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:00:59.478 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.730648+0000", 2024-04-01T20:00:59.478 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.478 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.478 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.478 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:00:59.478 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.730648+0000", 2024-04-01T20:00:59.478 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.478 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.478 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.478 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:00:59.479 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.730649+0000", 2024-04-01T20:00:59.479 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.4900000000000001e-07 2024-04-01T20:00:59.479 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.479 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.479 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:00:59.479 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.730651+0000", 2024-04-01T20:00:59.479 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.2630000000000002e-06 2024-04-01T20:00:59.479 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.479 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.479 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:00:59.479 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.730655+0000", 2024-04-01T20:00:59.479 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.9179999999999996e-06 2024-04-01T20:00:59.479 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.479 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.479 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:00:59.480 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.730658+0000", 2024-04-01T20:00:59.480 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.2799999999999999e-06 2024-04-01T20:00:59.480 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.480 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.480 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.480 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.730741+0000", 2024-04-01T20:00:59.480 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.2769000000000007e-05 2024-04-01T20:00:59.480 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.480 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.480 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for peered", 2024-04-01T20:00:59.480 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.730751+0000", 2024-04-01T20:00:59.480 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.8169999999999994e-06 2024-04-01T20:00:59.481 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.481 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.481 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.481 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.978337+0000", 2024-04-01T20:00:59.481 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.247586474 2024-04-01T20:00:59.481 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.481 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.481 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for degraded object", 2024-04-01T20:00:59.481 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.979039+0000", 2024-04-01T20:00:59.481 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00070131200000000005 2024-04-01T20:00:59.481 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.481 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.481 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.481 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.990941+0000", 2024-04-01T20:00:59.481 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.011902892 2024-04-01T20:00:59.482 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.482 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.482 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:00:59.482 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.991008+0000", 2024-04-01T20:00:59.482 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6835000000000006e-05 2024-04-01T20:00:59.482 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.482 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.482 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T20:00:59.482 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.991097+0000", 2024-04-01T20:00:59.482 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.8634000000000006e-05 2024-04-01T20:00:59.482 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.482 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.482 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:00:59.483 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:21.996292+0000", 2024-04-01T20:00:59.483 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0051949989999999996 2024-04-01T20:00:59.483 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.483 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.483 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:59.483 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:22.006992+0000", 2024-04-01T20:00:59.483 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.010700276 2024-04-01T20:00:59.483 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.483 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.483 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:00:59.483 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:22.007095+0000", 2024-04-01T20:00:59.483 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00010321499999999999 2024-04-01T20:00:59.483 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.483 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.484 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:00:59.484 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:22.010150+0000", 2024-04-01T20:00:59.484 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0030546219999999999 2024-04-01T20:00:59.484 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.484 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:00:59.484 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.484 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.484 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.484 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26983.0:172381 8.5 8:a2a92d36:::benchmark_data_smithi188_161190_object33099:head [delete] snapc 0=[] ondisk+write+known_if_redirected e690)", 2024-04-01T20:00:59.484 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:44.570730+0000", 2024-04-01T20:00:59.484 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 254.89455085399999, 2024-04-01T20:00:59.484 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.22335607199999999, 2024-04-01T20:00:59.484 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:00:59.484 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:00:59.485 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:59.485 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:00:59.485 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26983", 2024-04-01T20:00:59.485 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:00:59.485 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 172381 2024-04-01T20:00:59.485 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.485 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:00:59.485 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.485 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:00:59.485 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.570730+0000", 2024-04-01T20:00:59.485 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.485 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.485 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.485 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:00:59.486 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.570730+0000", 2024-04-01T20:00:59.486 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.486 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.486 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.486 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:00:59.486 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.570732+0000", 2024-04-01T20:00:59.486 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.4040000000000002e-06 2024-04-01T20:00:59.486 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.486 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.486 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:00:59.486 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.570739+0000", 2024-04-01T20:00:59.486 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8700000000000003e-06 2024-04-01T20:00:59.486 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.487 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.487 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:00:59.487 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.570753+0000", 2024-04-01T20:00:59.487 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3736e-05 2024-04-01T20:00:59.487 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.487 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.487 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:00:59.487 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.570773+0000", 2024-04-01T20:00:59.487 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.0370999999999999e-05 2024-04-01T20:00:59.487 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.487 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.487 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.487 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.575324+0000", 2024-04-01T20:00:59.487 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0045506679999999999 2024-04-01T20:00:59.488 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.488 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.488 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:00:59.488 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.575405+0000", 2024-04-01T20:00:59.488 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.1611000000000002e-05 2024-04-01T20:00:59.488 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.488 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.488 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T20:00:59.488 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.575499+0000", 2024-04-01T20:00:59.488 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.3585999999999995e-05 2024-04-01T20:00:59.488 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.488 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.488 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:00:59.489 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.582351+0000", 2024-04-01T20:00:59.489 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0068523079999999997 2024-04-01T20:00:59.489 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.489 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.489 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:59.489 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.791321+0000", 2024-04-01T20:00:59.489 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.208969398 2024-04-01T20:00:59.489 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.489 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.489 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:00:59.489 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.791365+0000", 2024-04-01T20:00:59.489 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.4110000000000003e-05 2024-04-01T20:00:59.490 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.490 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.490 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:00:59.490 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.794086+0000", 2024-04-01T20:00:59.490 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0027210099999999998 2024-04-01T20:00:59.490 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.490 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:00:59.490 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.490 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.490 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.490 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26983.0:172401 8.5 8:a3227be5:::benchmark_data_smithi188_161190_object33119:head [delete] snapc 0=[] ondisk+write+known_if_redirected e690)", 2024-04-01T20:00:59.490 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:44.598430+0000", 2024-04-01T20:00:59.491 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 254.866850626, 2024-04-01T20:00:59.491 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.27556739000000002, 2024-04-01T20:00:59.491 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:00:59.491 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:00:59.491 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:59.491 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:00:59.491 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26983", 2024-04-01T20:00:59.491 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:00:59.491 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 172401 2024-04-01T20:00:59.491 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.491 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:00:59.491 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.491 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:00:59.492 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.598430+0000", 2024-04-01T20:00:59.492 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.492 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.492 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.492 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:00:59.492 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.598430+0000", 2024-04-01T20:00:59.492 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.492 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.492 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.492 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:00:59.492 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.598432+0000", 2024-04-01T20:00:59.492 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.058e-06 2024-04-01T20:00:59.492 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.492 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.493 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:00:59.493 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.598438+0000", 2024-04-01T20:00:59.493 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6120000000000004e-06 2024-04-01T20:00:59.493 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.493 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.493 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:00:59.493 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.598448+0000", 2024-04-01T20:00:59.493 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.302e-06 2024-04-01T20:00:59.493 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.493 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.493 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:00:59.493 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.598455+0000", 2024-04-01T20:00:59.493 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.7259999999999996e-06 2024-04-01T20:00:59.493 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.493 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.494 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.494 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.598522+0000", 2024-04-01T20:00:59.494 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.7912999999999998e-05 2024-04-01T20:00:59.494 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.494 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.494 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:00:59.494 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.598648+0000", 2024-04-01T20:00:59.494 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000125203 2024-04-01T20:00:59.494 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.494 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.494 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T20:00:59.494 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.598822+0000", 2024-04-01T20:00:59.495 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00017485600000000001 2024-04-01T20:00:59.495 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.495 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.495 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:00:59.495 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.602597+0000", 2024-04-01T20:00:59.495 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0037744050000000002 2024-04-01T20:00:59.495 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.495 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.495 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:59.495 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.871301+0000", 2024-04-01T20:00:59.495 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.26870460699999998 2024-04-01T20:00:59.495 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.495 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.495 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:00:59.496 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.871370+0000", 2024-04-01T20:00:59.496 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8028000000000007e-05 2024-04-01T20:00:59.496 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.496 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.496 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:00:59.496 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.873997+0000", 2024-04-01T20:00:59.496 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0026276799999999999 2024-04-01T20:00:59.496 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.496 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:00:59.496 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.496 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.496 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.496 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26983.0:172414 8.5 8:ae625502:::benchmark_data_smithi188_161190_object33132:head [delete] snapc 0=[] ondisk+write+known_if_redirected e690)", 2024-04-01T20:00:59.496 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:44.612700+0000", 2024-04-01T20:00:59.497 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 254.852579988, 2024-04-01T20:00:59.497 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.32733424799999999, 2024-04-01T20:00:59.497 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:00:59.497 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:00:59.497 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:59.497 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:00:59.497 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26983", 2024-04-01T20:00:59.497 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:00:59.497 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 172414 2024-04-01T20:00:59.497 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.497 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:00:59.497 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.497 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:00:59.497 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.612700+0000", 2024-04-01T20:00:59.498 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.498 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.498 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.498 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:00:59.498 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.612700+0000", 2024-04-01T20:00:59.498 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.498 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.498 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.498 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:00:59.498 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.612703+0000", 2024-04-01T20:00:59.498 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1799999999999999e-06 2024-04-01T20:00:59.498 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.498 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.499 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:00:59.499 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.612708+0000", 2024-04-01T20:00:59.499 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.4929999999999998e-06 2024-04-01T20:00:59.499 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.499 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.499 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:00:59.499 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.612720+0000", 2024-04-01T20:00:59.499 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1508999999999999e-05 2024-04-01T20:00:59.499 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.499 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.499 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:00:59.499 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.612728+0000", 2024-04-01T20:00:59.499 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.5699999999999993e-06 2024-04-01T20:00:59.500 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.500 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.500 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.500 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.612798+0000", 2024-04-01T20:00:59.500 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.0168999999999999e-05 2024-04-01T20:00:59.500 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.500 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.500 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for degraded object", 2024-04-01T20:00:59.500 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.612847+0000", 2024-04-01T20:00:59.500 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8891000000000003e-05 2024-04-01T20:00:59.500 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.500 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.500 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.500 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.908507+0000", 2024-04-01T20:00:59.500 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.29565930299999998 2024-04-01T20:00:59.501 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.501 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.501 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:00:59.501 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.908583+0000", 2024-04-01T20:00:59.501 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.6008999999999997e-05 2024-04-01T20:00:59.501 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.501 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.501 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T20:00:59.501 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.908683+0000", 2024-04-01T20:00:59.501 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000100837 2024-04-01T20:00:59.501 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.501 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.502 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:00:59.502 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.936864+0000", 2024-04-01T20:00:59.502 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.028180370999999999 2024-04-01T20:00:59.502 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.502 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.502 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:59.502 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.936918+0000", 2024-04-01T20:00:59.502 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.4067000000000003e-05 2024-04-01T20:00:59.502 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.502 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.502 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:00:59.502 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.936971+0000", 2024-04-01T20:00:59.502 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2812999999999997e-05 2024-04-01T20:00:59.503 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.503 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.503 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:00:59.503 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.940035+0000", 2024-04-01T20:00:59.503 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.003064036 2024-04-01T20:00:59.503 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.503 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:00:59.503 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.503 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.503 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.503 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26983.0:172423 8.5 8:a73cf1eb:::benchmark_data_smithi188_161190_object33141:head [delete] snapc 0=[] ondisk+write+known_if_redirected e690)", 2024-04-01T20:00:59.503 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:44.626596+0000", 2024-04-01T20:00:59.503 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 254.83868448600001, 2024-04-01T20:00:59.503 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.259158901, 2024-04-01T20:00:59.504 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:00:59.504 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:00:59.504 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:59.504 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:00:59.504 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26983", 2024-04-01T20:00:59.504 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:00:59.504 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 172423 2024-04-01T20:00:59.504 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.504 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:00:59.504 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.504 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:00:59.504 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.626596+0000", 2024-04-01T20:00:59.504 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.504 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.504 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.505 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:00:59.505 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.626596+0000", 2024-04-01T20:00:59.505 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.505 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.505 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.505 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:00:59.505 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.626599+0000", 2024-04-01T20:00:59.505 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.734e-06 2024-04-01T20:00:59.505 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.505 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.505 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:00:59.505 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.626609+0000", 2024-04-01T20:00:59.505 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0492999999999999e-05 2024-04-01T20:00:59.505 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.506 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.506 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:00:59.506 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.626628+0000", 2024-04-01T20:00:59.506 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8997000000000001e-05 2024-04-01T20:00:59.506 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.506 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.506 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:00:59.506 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.626639+0000", 2024-04-01T20:00:59.506 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1171e-05 2024-04-01T20:00:59.506 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.506 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.506 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.506 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.626706+0000", 2024-04-01T20:00:59.506 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6458999999999995e-05 2024-04-01T20:00:59.506 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.507 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.507 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for degraded object", 2024-04-01T20:00:59.507 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.627298+0000", 2024-04-01T20:00:59.507 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00059240300000000003 2024-04-01T20:00:59.507 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.507 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.507 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.507 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.808295+0000", 2024-04-01T20:00:59.507 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.180996975 2024-04-01T20:00:59.507 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.507 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.507 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:00:59.507 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.808370+0000", 2024-04-01T20:00:59.507 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.4742999999999999e-05 2024-04-01T20:00:59.507 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.508 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.508 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T20:00:59.508 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.808465+0000", 2024-04-01T20:00:59.508 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.5567000000000002e-05 2024-04-01T20:00:59.508 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.508 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.508 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:00:59.508 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.832080+0000", 2024-04-01T20:00:59.508 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.023614423999999998 2024-04-01T20:00:59.508 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.508 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.508 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:59.508 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.881863+0000", 2024-04-01T20:00:59.508 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.049783366000000003 2024-04-01T20:00:59.509 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.509 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.509 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:00:59.509 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.881931+0000", 2024-04-01T20:00:59.509 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.7644000000000005e-05 2024-04-01T20:00:59.509 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.509 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.509 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:00:59.509 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.885755+0000", 2024-04-01T20:00:59.509 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0038239250000000002 2024-04-01T20:00:59.509 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.509 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:00:59.509 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.510 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.510 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.510 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26983.0:172425 8.5 8:a5312702:::benchmark_data_smithi188_161190_object33143:head [delete] snapc 0=[] ondisk+write+known_if_redirected e690)", 2024-04-01T20:00:59.510 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:44.627706+0000", 2024-04-01T20:00:59.510 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 254.83757483400001, 2024-04-01T20:00:59.510 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.26061880900000001, 2024-04-01T20:00:59.510 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:00:59.510 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:00:59.510 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:59.510 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:00:59.510 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26983", 2024-04-01T20:00:59.510 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:00:59.511 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 172425 2024-04-01T20:00:59.511 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.511 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:00:59.511 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.511 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:00:59.511 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.627706+0000", 2024-04-01T20:00:59.511 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.511 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.511 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.511 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:00:59.511 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.627706+0000", 2024-04-01T20:00:59.511 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.511 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.512 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.512 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:00:59.512 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.627708+0000", 2024-04-01T20:00:59.512 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.933e-06 2024-04-01T20:00:59.512 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.512 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.512 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:00:59.512 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.627713+0000", 2024-04-01T20:00:59.512 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8440000000000003e-06 2024-04-01T20:00:59.512 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.512 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.512 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:00:59.512 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.627722+0000", 2024-04-01T20:00:59.512 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.8019999999999998e-06 2024-04-01T20:00:59.512 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.513 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.513 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:00:59.513 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.627728+0000", 2024-04-01T20:00:59.513 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6810000000000003e-06 2024-04-01T20:00:59.513 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.513 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.513 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.513 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.627791+0000", 2024-04-01T20:00:59.513 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3400999999999998e-05 2024-04-01T20:00:59.513 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.513 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.513 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for degraded object", 2024-04-01T20:00:59.513 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.628470+0000", 2024-04-01T20:00:59.513 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00067922800000000004 2024-04-01T20:00:59.513 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.514 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.514 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.514 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.817015+0000", 2024-04-01T20:00:59.514 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.18854467699999999 2024-04-01T20:00:59.514 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.514 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.514 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:00:59.514 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.817141+0000", 2024-04-01T20:00:59.514 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000126184 2024-04-01T20:00:59.514 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.514 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.514 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T20:00:59.514 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.817316+0000", 2024-04-01T20:00:59.514 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00017500299999999999 2024-04-01T20:00:59.515 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.515 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.515 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:00:59.515 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.832090+0000", 2024-04-01T20:00:59.515 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.014773847999999999 2024-04-01T20:00:59.515 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.515 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.515 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:59.515 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.885837+0000", 2024-04-01T20:00:59.515 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.053746708999999997 2024-04-01T20:00:59.515 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.515 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.515 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:00:59.515 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.885878+0000", 2024-04-01T20:00:59.516 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0615999999999999e-05 2024-04-01T20:00:59.516 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.516 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.516 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:00:59.516 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.888324+0000", 2024-04-01T20:00:59.516 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.002446883 2024-04-01T20:00:59.516 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.516 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:00:59.516 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.516 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.516 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.516 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26983.0:172430 8.5 8:a58507bd:::benchmark_data_smithi188_161190_object33148:head [delete] snapc 0=[] ondisk+write+known_if_redirected e690)", 2024-04-01T20:00:59.516 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:44.641452+0000", 2024-04-01T20:00:59.516 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 254.823828832, 2024-04-01T20:00:59.516 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.249813128, 2024-04-01T20:00:59.517 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:00:59.517 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:00:59.517 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:59.517 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:00:59.517 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26983", 2024-04-01T20:00:59.517 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:00:59.517 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 172430 2024-04-01T20:00:59.517 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.517 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:00:59.517 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.517 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:00:59.517 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.641452+0000", 2024-04-01T20:00:59.517 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.517 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.517 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.517 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:00:59.518 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.641452+0000", 2024-04-01T20:00:59.518 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.518 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.518 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.518 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:00:59.518 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.641455+0000", 2024-04-01T20:00:59.518 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.354e-06 2024-04-01T20:00:59.518 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.518 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.518 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:00:59.518 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.641466+0000", 2024-04-01T20:00:59.518 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0865e-05 2024-04-01T20:00:59.518 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.519 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.519 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:00:59.519 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.641486+0000", 2024-04-01T20:00:59.519 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.0174e-05 2024-04-01T20:00:59.519 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.519 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.519 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:00:59.519 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.641498+0000", 2024-04-01T20:00:59.519 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1534e-05 2024-04-01T20:00:59.519 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.519 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.519 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.519 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.641571+0000", 2024-04-01T20:00:59.519 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.3170999999999995e-05 2024-04-01T20:00:59.519 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.520 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.520 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for degraded object", 2024-04-01T20:00:59.520 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.642256+0000", 2024-04-01T20:00:59.520 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00068494699999999999 2024-04-01T20:00:59.520 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.520 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.520 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.520 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.837458+0000", 2024-04-01T20:00:59.520 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.19520283099999999 2024-04-01T20:00:59.520 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.520 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.520 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:00:59.520 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.837580+0000", 2024-04-01T20:00:59.521 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012183 2024-04-01T20:00:59.521 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.521 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.521 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T20:00:59.521 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.837749+0000", 2024-04-01T20:00:59.521 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00016899600000000001 2024-04-01T20:00:59.521 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.521 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.521 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:00:59.521 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.861300+0000", 2024-04-01T20:00:59.521 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.023550222999999999 2024-04-01T20:00:59.521 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.521 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.521 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:59.522 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.888402+0000", 2024-04-01T20:00:59.522 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.027102610999999999 2024-04-01T20:00:59.522 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.522 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.522 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:00:59.522 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.888464+0000", 2024-04-01T20:00:59.522 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.1509999999999999e-05 2024-04-01T20:00:59.522 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.522 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.522 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:00:59.522 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.891265+0000", 2024-04-01T20:00:59.522 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0028010819999999999 2024-04-01T20:00:59.522 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.522 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:00:59.522 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.522 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.523 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.523 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26983.0:172443 8.5 8:a458bb3c:::benchmark_data_smithi188_161190_object33161:head [delete] snapc 0=[] ondisk+write+known_if_redirected e690)", 2024-04-01T20:00:59.523 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:44.683579+0000", 2024-04-01T20:00:59.523 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 254.781701062, 2024-04-01T20:00:59.523 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.21034204200000001, 2024-04-01T20:00:59.523 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:00:59.523 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:00:59.523 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:59.523 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:00:59.523 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26983", 2024-04-01T20:00:59.523 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:00:59.523 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 172443 2024-04-01T20:00:59.523 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.523 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:00:59.523 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.524 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:00:59.524 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.683579+0000", 2024-04-01T20:00:59.524 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.524 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.524 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.524 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:00:59.524 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.683579+0000", 2024-04-01T20:00:59.524 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.524 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.524 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.524 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:00:59.524 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.683582+0000", 2024-04-01T20:00:59.524 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.4980000000000001e-06 2024-04-01T20:00:59.524 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.524 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.525 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:00:59.525 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.683589+0000", 2024-04-01T20:00:59.525 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.6199999999999999e-06 2024-04-01T20:00:59.525 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.525 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.525 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:00:59.525 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.683602+0000", 2024-04-01T20:00:59.525 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2118e-05 2024-04-01T20:00:59.525 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.525 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.525 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:00:59.525 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.683610+0000", 2024-04-01T20:00:59.525 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0770000000000008e-06 2024-04-01T20:00:59.526 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.526 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.526 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.526 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.683659+0000", 2024-04-01T20:00:59.526 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9747999999999999e-05 2024-04-01T20:00:59.526 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.526 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.526 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for degraded object", 2024-04-01T20:00:59.526 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.684278+0000", 2024-04-01T20:00:59.526 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00061874800000000002 2024-04-01T20:00:59.526 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.526 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.526 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.526 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.848259+0000", 2024-04-01T20:00:59.527 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.163981288 2024-04-01T20:00:59.527 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.527 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.527 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:00:59.527 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.848334+0000", 2024-04-01T20:00:59.527 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.4751000000000003e-05 2024-04-01T20:00:59.527 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.527 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.527 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T20:00:59.527 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.848426+0000", 2024-04-01T20:00:59.527 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1970000000000002e-05 2024-04-01T20:00:59.527 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.527 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.527 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:00:59.527 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.874013+0000", 2024-04-01T20:00:59.528 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.025586814999999999 2024-04-01T20:00:59.528 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.528 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.528 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:59.528 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.891509+0000", 2024-04-01T20:00:59.528 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.017496256000000002 2024-04-01T20:00:59.528 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.528 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.528 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:00:59.528 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.891576+0000", 2024-04-01T20:00:59.528 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6314000000000002e-05 2024-04-01T20:00:59.528 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.528 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.528 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:00:59.528 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:44.893921+0000", 2024-04-01T20:00:59.529 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0023458390000000002 2024-04-01T20:00:59.529 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.529 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:00:59.529 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.529 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.529 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.529 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26983.0:174003 8.5 8:a123cf75:::benchmark_data_smithi188_161190_object34721:head [delete] snapc 0=[] ondisk+write+known_if_redirected e691)", 2024-04-01T20:00:59.529 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:47.343469+0000", 2024-04-01T20:00:59.529 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 252.12181147699999, 2024-04-01T20:00:59.529 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.28051173899999998, 2024-04-01T20:00:59.529 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:00:59.529 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:00:59.529 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:59.529 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:00:59.529 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26983", 2024-04-01T20:00:59.530 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:00:59.530 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 174003 2024-04-01T20:00:59.530 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.530 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:00:59.530 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.530 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:00:59.530 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.343469+0000", 2024-04-01T20:00:59.530 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.530 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.530 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.530 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:00:59.530 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.343469+0000", 2024-04-01T20:00:59.530 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.530 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.531 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.531 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:00:59.531 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.343471+0000", 2024-04-01T20:00:59.531 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.2709999999999999e-06 2024-04-01T20:00:59.531 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.531 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.531 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:00:59.531 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.343478+0000", 2024-04-01T20:00:59.531 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5710000000000003e-06 2024-04-01T20:00:59.531 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.531 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.531 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:00:59.531 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.343489+0000", 2024-04-01T20:00:59.531 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.097e-05 2024-04-01T20:00:59.531 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.531 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.532 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:00:59.532 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.343495+0000", 2024-04-01T20:00:59.532 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2349999999999996e-06 2024-04-01T20:00:59.532 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.532 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.532 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.532 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.343539+0000", 2024-04-01T20:00:59.532 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.4042999999999998e-05 2024-04-01T20:00:59.532 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.532 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.532 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for degraded object", 2024-04-01T20:00:59.532 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.343588+0000", 2024-04-01T20:00:59.532 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9181999999999998e-05 2024-04-01T20:00:59.532 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.532 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.533 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.533 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.551621+0000", 2024-04-01T20:00:59.533 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.208032681 2024-04-01T20:00:59.533 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.533 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.533 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:00:59.533 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.551743+0000", 2024-04-01T20:00:59.533 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000121787 2024-04-01T20:00:59.533 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.533 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.533 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T20:00:59.533 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.551941+0000", 2024-04-01T20:00:59.533 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000198173 2024-04-01T20:00:59.533 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.533 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.533 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:00:59.534 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.579265+0000", 2024-04-01T20:00:59.534 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.027324053000000001 2024-04-01T20:00:59.534 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.534 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.534 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:59.534 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.621812+0000", 2024-04-01T20:00:59.534 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.042547301000000003 2024-04-01T20:00:59.534 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.534 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.534 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:00:59.534 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.621855+0000", 2024-04-01T20:00:59.534 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.2332000000000001e-05 2024-04-01T20:00:59.534 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.534 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.534 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:00:59.535 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.623981+0000", 2024-04-01T20:00:59.535 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0021261399999999999 2024-04-01T20:00:59.535 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.535 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:00:59.535 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.535 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.535 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.535 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26983.0:174013 8.5 8:a02c794d:::benchmark_data_smithi188_161190_object34731:head [delete] snapc 0=[] ondisk+write+known_if_redirected e691)", 2024-04-01T20:00:59.535 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:47.355904+0000", 2024-04-01T20:00:59.535 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 252.10937594500001, 2024-04-01T20:00:59.535 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.270188335, 2024-04-01T20:00:59.535 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:00:59.535 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:00:59.535 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:59.535 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:00:59.536 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26983", 2024-04-01T20:00:59.536 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:00:59.536 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 174013 2024-04-01T20:00:59.536 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.536 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:00:59.536 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.536 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:00:59.536 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.355904+0000", 2024-04-01T20:00:59.536 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.536 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.536 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.536 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:00:59.536 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.355904+0000", 2024-04-01T20:00:59.536 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.536 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.536 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.537 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:00:59.537 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.355907+0000", 2024-04-01T20:00:59.537 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.6539999999999999e-06 2024-04-01T20:00:59.537 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.537 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.537 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:00:59.537 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.355916+0000", 2024-04-01T20:00:59.537 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.0340000000000002e-06 2024-04-01T20:00:59.537 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.537 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.537 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:00:59.537 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.355935+0000", 2024-04-01T20:00:59.537 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8437e-05 2024-04-01T20:00:59.537 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.538 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.538 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:00:59.538 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.355945+0000", 2024-04-01T20:00:59.538 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0322e-05 2024-04-01T20:00:59.538 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.538 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.538 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.538 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.356016+0000", 2024-04-01T20:00:59.538 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1427999999999994e-05 2024-04-01T20:00:59.538 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.538 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.538 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for degraded object", 2024-04-01T20:00:59.538 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.356667+0000", 2024-04-01T20:00:59.538 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00065076399999999996 2024-04-01T20:00:59.538 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.539 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.539 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.539 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.574270+0000", 2024-04-01T20:00:59.539 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.21760296700000001 2024-04-01T20:00:59.539 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.539 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.539 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:00:59.539 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.574370+0000", 2024-04-01T20:00:59.539 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.9477999999999999e-05 2024-04-01T20:00:59.539 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.539 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.539 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T20:00:59.539 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.574516+0000", 2024-04-01T20:00:59.539 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014674999999999999 2024-04-01T20:00:59.539 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.540 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.540 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:00:59.540 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.596690+0000", 2024-04-01T20:00:59.540 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.022173891000000001 2024-04-01T20:00:59.540 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.540 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.540 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:59.540 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.624043+0000", 2024-04-01T20:00:59.540 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.027352946 2024-04-01T20:00:59.540 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.540 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.540 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:00:59.540 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.624083+0000", 2024-04-01T20:00:59.540 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0173999999999999e-05 2024-04-01T20:00:59.541 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.541 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.541 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:00:59.541 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.626093+0000", 2024-04-01T20:00:59.541 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0020094900000000001 2024-04-01T20:00:59.541 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.541 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:00:59.541 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.541 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.541 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.541 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26983.0:174039 8.5 8:a45c2532:::benchmark_data_smithi188_161190_object34757:head [delete] snapc 0=[] ondisk+write+known_if_redirected e691)", 2024-04-01T20:00:59.541 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:47.399583+0000", 2024-04-01T20:00:59.541 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 252.06569759300001, 2024-04-01T20:00:59.541 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.22946511, 2024-04-01T20:00:59.542 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:00:59.542 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:00:59.542 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:59.542 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:00:59.542 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26983", 2024-04-01T20:00:59.542 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:00:59.542 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 174039 2024-04-01T20:00:59.542 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.542 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:00:59.542 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.542 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:00:59.542 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.399583+0000", 2024-04-01T20:00:59.542 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.542 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.543 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.543 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:00:59.543 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.399583+0000", 2024-04-01T20:00:59.543 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.543 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.543 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.543 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:00:59.543 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.399586+0000", 2024-04-01T20:00:59.543 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.9000000000000002e-06 2024-04-01T20:00:59.543 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.543 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.543 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:00:59.543 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.399596+0000", 2024-04-01T20:00:59.543 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.9459999999999993e-06 2024-04-01T20:00:59.543 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.544 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.544 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:00:59.544 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.399610+0000", 2024-04-01T20:00:59.544 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3862999999999999e-05 2024-04-01T20:00:59.544 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.544 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.544 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:00:59.544 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.399618+0000", 2024-04-01T20:00:59.544 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.9390000000000003e-06 2024-04-01T20:00:59.544 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.544 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.544 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.544 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.399679+0000", 2024-04-01T20:00:59.544 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.0469e-05 2024-04-01T20:00:59.545 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.545 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.545 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for degraded object", 2024-04-01T20:00:59.545 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.400320+0000", 2024-04-01T20:00:59.545 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00064124899999999999 2024-04-01T20:00:59.545 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.545 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.545 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.545 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.584226+0000", 2024-04-01T20:00:59.545 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.18390562199999999 2024-04-01T20:00:59.545 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.545 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.545 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:00:59.545 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.584302+0000", 2024-04-01T20:00:59.545 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.6044000000000006e-05 2024-04-01T20:00:59.546 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.546 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.546 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T20:00:59.546 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.584394+0000", 2024-04-01T20:00:59.546 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1712000000000006e-05 2024-04-01T20:00:59.546 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.546 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.546 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:00:59.546 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.610491+0000", 2024-04-01T20:00:59.546 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.026097605999999999 2024-04-01T20:00:59.546 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.546 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.546 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:59.546 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.626175+0000", 2024-04-01T20:00:59.546 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.015683312000000001 2024-04-01T20:00:59.547 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.547 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.547 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:00:59.547 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.626237+0000", 2024-04-01T20:00:59.547 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2701999999999997e-05 2024-04-01T20:00:59.547 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.547 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.547 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:00:59.547 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.629048+0000", 2024-04-01T20:00:59.547 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0028107459999999998 2024-04-01T20:00:59.547 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.547 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:00:59.548 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.548 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.548 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.548 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26983.0:174053 8.5 8:ac5d1fef:::benchmark_data_smithi188_161190_object34771:head [delete] snapc 0=[] ondisk+write+known_if_redirected e691)", 2024-04-01T20:00:59.548 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:47.419889+0000", 2024-04-01T20:00:59.548 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 252.04539169200001, 2024-04-01T20:00:59.548 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.211645887, 2024-04-01T20:00:59.548 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:00:59.548 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:00:59.548 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:59.548 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:00:59.548 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26983", 2024-04-01T20:00:59.548 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:00:59.548 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 174053 2024-04-01T20:00:59.548 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.549 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:00:59.549 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.549 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:00:59.549 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.419889+0000", 2024-04-01T20:00:59.549 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.549 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.549 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.549 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:00:59.549 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.419889+0000", 2024-04-01T20:00:59.549 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.549 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.549 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.549 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:00:59.549 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.419891+0000", 2024-04-01T20:00:59.549 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.7130000000000001e-06 2024-04-01T20:00:59.549 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.550 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.550 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:00:59.550 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.419899+0000", 2024-04-01T20:00:59.550 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9820000000000008e-06 2024-04-01T20:00:59.550 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.550 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.550 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:00:59.550 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.419920+0000", 2024-04-01T20:00:59.550 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.0890000000000002e-05 2024-04-01T20:00:59.550 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.550 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.550 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:00:59.551 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.419930+0000", 2024-04-01T20:00:59.551 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.7699999999999996e-06 2024-04-01T20:00:59.551 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.551 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.551 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.551 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.420002+0000", 2024-04-01T20:00:59.551 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1767000000000006e-05 2024-04-01T20:00:59.551 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.551 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.551 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for degraded object", 2024-04-01T20:00:59.551 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.420720+0000", 2024-04-01T20:00:59.551 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00071786300000000001 2024-04-01T20:00:59.551 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.552 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.552 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.552 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.593012+0000", 2024-04-01T20:00:59.552 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.172292155 2024-04-01T20:00:59.552 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.552 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.552 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:00:59.552 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.593075+0000", 2024-04-01T20:00:59.552 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2714999999999998e-05 2024-04-01T20:00:59.552 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.552 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.552 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T20:00:59.552 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.593155+0000", 2024-04-01T20:00:59.553 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0278000000000006e-05 2024-04-01T20:00:59.553 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.553 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.553 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:00:59.553 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.626109+0000", 2024-04-01T20:00:59.553 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.032954127999999999 2024-04-01T20:00:59.553 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.553 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.553 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:59.553 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.629118+0000", 2024-04-01T20:00:59.553 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0030087759999999999 2024-04-01T20:00:59.553 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.553 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.554 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:00:59.554 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.629184+0000", 2024-04-01T20:00:59.554 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5950000000000004e-05 2024-04-01T20:00:59.554 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.554 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.554 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:00:59.554 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.631535+0000", 2024-04-01T20:00:59.554 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0023509 2024-04-01T20:00:59.554 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.554 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:00:59.554 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.554 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.554 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.555 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26983.0:174150 8.5 8:ad10cb2c:::benchmark_data_smithi188_161190_object34868:head [delete] snapc 0=[] ondisk+write+known_if_redirected e691)", 2024-04-01T20:00:59.555 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:47.599508+0000", 2024-04-01T20:00:59.555 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 251.86577286100001, 2024-04-01T20:00:59.555 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.22937937999999999, 2024-04-01T20:00:59.555 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:00:59.555 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:00:59.555 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:59.555 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:00:59.555 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26983", 2024-04-01T20:00:59.555 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:00:59.555 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 174150 2024-04-01T20:00:59.555 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.555 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:00:59.555 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.555 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:00:59.556 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.599508+0000", 2024-04-01T20:00:59.556 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.556 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.556 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.556 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:00:59.556 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.599508+0000", 2024-04-01T20:00:59.556 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.556 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.556 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.556 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:00:59.556 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.599510+0000", 2024-04-01T20:00:59.556 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.6910000000000002e-06 2024-04-01T20:00:59.556 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.556 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.556 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:00:59.557 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.599517+0000", 2024-04-01T20:00:59.557 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.827e-06 2024-04-01T20:00:59.557 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.557 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.557 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:00:59.557 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.599529+0000", 2024-04-01T20:00:59.557 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2302e-05 2024-04-01T20:00:59.557 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.557 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.557 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:00:59.557 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.599544+0000", 2024-04-01T20:00:59.557 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4348000000000001e-05 2024-04-01T20:00:59.557 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.557 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.557 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.558 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.701279+0000", 2024-04-01T20:00:59.558 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.101735744 2024-04-01T20:00:59.558 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.558 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.558 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for degraded object", 2024-04-01T20:00:59.558 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.701959+0000", 2024-04-01T20:00:59.558 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00067959300000000004 2024-04-01T20:00:59.558 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.558 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.558 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.558 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.758153+0000", 2024-04-01T20:00:59.558 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.056193809999999997 2024-04-01T20:00:59.558 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.558 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.559 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:00:59.559 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.758250+0000", 2024-04-01T20:00:59.559 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.7476e-05 2024-04-01T20:00:59.559 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.559 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.559 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T20:00:59.559 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.758382+0000", 2024-04-01T20:00:59.559 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013138599999999999 2024-04-01T20:00:59.559 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.559 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.559 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:00:59.559 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.778173+0000", 2024-04-01T20:00:59.559 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.019791027999999999 2024-04-01T20:00:59.560 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.560 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.560 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:59.560 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.825954+0000", 2024-04-01T20:00:59.560 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.047780734999999998 2024-04-01T20:00:59.560 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.560 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.560 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:00:59.560 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.826034+0000", 2024-04-01T20:00:59.560 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0362000000000001e-05 2024-04-01T20:00:59.560 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.560 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.560 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:00:59.560 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.828887+0000", 2024-04-01T20:00:59.561 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0028530780000000002 2024-04-01T20:00:59.561 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.561 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:00:59.561 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.561 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.561 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.561 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26983.0:174152 8.5 8:a6b64f12:::benchmark_data_smithi188_161190_object34870:head [delete] snapc 0=[] ondisk+write+known_if_redirected e691)", 2024-04-01T20:00:59.561 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:47.603495+0000", 2024-04-01T20:00:59.561 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 251.86178508500001, 2024-04-01T20:00:59.561 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.22873225, 2024-04-01T20:00:59.561 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:00:59.561 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:00:59.561 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:59.561 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:00:59.561 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26983", 2024-04-01T20:00:59.562 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:00:59.562 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 174152 2024-04-01T20:00:59.562 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.562 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:00:59.562 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.562 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:00:59.562 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.603495+0000", 2024-04-01T20:00:59.562 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.562 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.562 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.562 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:00:59.562 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.603495+0000", 2024-04-01T20:00:59.562 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.562 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.562 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.563 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:00:59.563 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.603498+0000", 2024-04-01T20:00:59.563 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.723e-06 2024-04-01T20:00:59.563 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.563 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.563 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:00:59.563 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.603506+0000", 2024-04-01T20:00:59.563 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.6070000000000002e-06 2024-04-01T20:00:59.563 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.563 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.563 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:00:59.563 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.603519+0000", 2024-04-01T20:00:59.563 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3001e-05 2024-04-01T20:00:59.563 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.564 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.564 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:00:59.564 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.603527+0000", 2024-04-01T20:00:59.564 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.7409999999999998e-06 2024-04-01T20:00:59.564 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.564 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.564 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.564 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.702018+0000", 2024-04-01T20:00:59.564 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.098490523999999996 2024-04-01T20:00:59.564 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.564 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.564 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for degraded object", 2024-04-01T20:00:59.564 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.702606+0000", 2024-04-01T20:00:59.565 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00058784400000000002 2024-04-01T20:00:59.565 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.565 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.565 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.565 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.768893+0000", 2024-04-01T20:00:59.565 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.066287110999999996 2024-04-01T20:00:59.565 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.565 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.565 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:00:59.565 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.768960+0000", 2024-04-01T20:00:59.565 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.7167000000000003e-05 2024-04-01T20:00:59.565 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.565 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.566 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T20:00:59.566 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.769041+0000", 2024-04-01T20:00:59.566 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.1050999999999994e-05 2024-04-01T20:00:59.566 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.566 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.566 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:00:59.566 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.788141+0000", 2024-04-01T20:00:59.566 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.019099543 2024-04-01T20:00:59.566 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.566 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.566 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:59.566 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.828950+0000", 2024-04-01T20:00:59.566 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.040809399000000003 2024-04-01T20:00:59.567 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.567 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.567 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:00:59.567 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.829008+0000", 2024-04-01T20:00:59.567 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8276999999999998e-05 2024-04-01T20:00:59.567 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.567 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.567 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:00:59.567 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.832228+0000", 2024-04-01T20:00:59.567 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0032192620000000001 2024-04-01T20:00:59.567 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.567 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:00:59.567 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.567 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.567 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.568 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26983.0:174171 8.5 8:ab871ca4:::benchmark_data_smithi188_161190_object34889:head [delete] snapc 0=[] ondisk+write+known_if_redirected e691)", 2024-04-01T20:00:59.568 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:47.645091+0000", 2024-04-01T20:00:59.568 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 251.82018969800001, 2024-04-01T20:00:59.568 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.19029623500000001, 2024-04-01T20:00:59.568 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:00:59.568 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:00:59.568 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:59.568 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:00:59.568 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26983", 2024-04-01T20:00:59.568 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:00:59.568 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 174171 2024-04-01T20:00:59.568 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.568 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:00:59.568 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.568 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:00:59.569 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.645091+0000", 2024-04-01T20:00:59.569 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.569 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.569 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.569 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:00:59.569 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.645091+0000", 2024-04-01T20:00:59.569 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.569 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.569 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.569 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:00:59.569 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.645093+0000", 2024-04-01T20:00:59.569 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.1430000000000001e-06 2024-04-01T20:00:59.569 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.570 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.570 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:00:59.570 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.645099+0000", 2024-04-01T20:00:59.570 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.4110000000000001e-06 2024-04-01T20:00:59.570 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.570 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.570 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:00:59.570 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.645110+0000", 2024-04-01T20:00:59.570 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1133e-05 2024-04-01T20:00:59.570 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.570 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.570 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:00:59.570 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.645120+0000", 2024-04-01T20:00:59.571 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.1500000000000005e-06 2024-04-01T20:00:59.571 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.571 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.571 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.571 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.705724+0000", 2024-04-01T20:00:59.571 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.060603924000000003 2024-04-01T20:00:59.571 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.571 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.571 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for degraded object", 2024-04-01T20:00:59.571 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.706435+0000", 2024-04-01T20:00:59.571 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00071171600000000004 2024-04-01T20:00:59.571 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.571 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.572 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.572 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.778215+0000", 2024-04-01T20:00:59.572 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.071779635999999994 2024-04-01T20:00:59.572 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.572 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.572 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:00:59.572 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.778312+0000", 2024-04-01T20:00:59.572 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.6773000000000003e-05 2024-04-01T20:00:59.572 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.572 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.572 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T20:00:59.572 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.778447+0000", 2024-04-01T20:00:59.572 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000135709 2024-04-01T20:00:59.572 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.573 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.573 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:00:59.573 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.803875+0000", 2024-04-01T20:00:59.573 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.025428099999999999 2024-04-01T20:00:59.573 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.573 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.573 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:59.573 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.832296+0000", 2024-04-01T20:00:59.573 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.028420411999999999 2024-04-01T20:00:59.573 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.573 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.573 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:00:59.573 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.832343+0000", 2024-04-01T20:00:59.573 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7503000000000002e-05 2024-04-01T20:00:59.573 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.574 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.574 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:00:59.574 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.835387+0000", 2024-04-01T20:00:59.574 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0030436249999999999 2024-04-01T20:00:59.574 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.574 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:00:59.574 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.574 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.574 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.574 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.26983.0:174173 8.5 8:a389ac73:::benchmark_data_smithi188_161190_object34891:head [delete] snapc 0=[] ondisk+write+known_if_redirected e691)", 2024-04-01T20:00:59.574 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T19:56:47.645897+0000", 2024-04-01T20:00:59.574 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 251.81938328300001, 2024-04-01T20:00:59.574 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.193315564, 2024-04-01T20:00:59.575 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:00:59.575 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:00:59.575 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:59.575 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:00:59.575 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.26983", 2024-04-01T20:00:59.575 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:00:59.575 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 174173 2024-04-01T20:00:59.575 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.575 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:00:59.575 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.575 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:00:59.575 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.645897+0000", 2024-04-01T20:00:59.575 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.575 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.576 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.576 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:00:59.576 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.645897+0000", 2024-04-01T20:00:59.576 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.576 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.576 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.576 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:00:59.576 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.645898+0000", 2024-04-01T20:00:59.576 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2890000000000001e-06 2024-04-01T20:00:59.576 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.576 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.576 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:00:59.576 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.645903+0000", 2024-04-01T20:00:59.577 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9470000000000002e-06 2024-04-01T20:00:59.577 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.577 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.577 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:00:59.577 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.645915+0000", 2024-04-01T20:00:59.577 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1399999999999999e-05 2024-04-01T20:00:59.577 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.577 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.577 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:00:59.577 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.645922+0000", 2024-04-01T20:00:59.577 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.6199999999999999e-06 2024-04-01T20:00:59.577 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.577 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.577 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.577 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.706472+0000", 2024-04-01T20:00:59.578 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.060549647999999998 2024-04-01T20:00:59.578 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.578 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.578 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for degraded object", 2024-04-01T20:00:59.578 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.707001+0000", 2024-04-01T20:00:59.578 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00052902600000000004 2024-04-01T20:00:59.578 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.578 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.578 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.578 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.788201+0000", 2024-04-01T20:00:59.578 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.081200099999999997 2024-04-01T20:00:59.578 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.579 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.579 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:00:59.579 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.788312+0000", 2024-04-01T20:00:59.579 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00011059499999999999 2024-04-01T20:00:59.579 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.579 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.579 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 11", 2024-04-01T20:00:59.579 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.788478+0000", 2024-04-01T20:00:59.579 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00016575100000000001 2024-04-01T20:00:59.579 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.579 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.579 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:00:59.579 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.813555+0000", 2024-04-01T20:00:59.579 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.025077522000000001 2024-04-01T20:00:59.580 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.580 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.580 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:59.580 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.835463+0000", 2024-04-01T20:00:59.580 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.021907848000000001 2024-04-01T20:00:59.580 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.580 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.580 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:00:59.580 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.835526+0000", 2024-04-01T20:00:59.580 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2811000000000006e-05 2024-04-01T20:00:59.580 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.580 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.580 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:00:59.580 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T19:56:47.839213+0000", 2024-04-01T20:00:59.581 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.003687007 2024-04-01T20:00:59.581 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.581 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:00:59.581 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.581 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.581 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.581 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:69837 9.4 9:2efbf499:::benchmark_data_smithi188_173515_object69836:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e746)", 2024-04-01T20:00:59.581 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:00:03.873063+0000", 2024-04-01T20:00:59.581 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 55.592217230999999, 2024-04-01T20:00:59.581 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.20930348200000001, 2024-04-01T20:00:59.581 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:00:59.581 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:00:59.581 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:59.581 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:00:59.581 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:00:59.582 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:00:59.582 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 69837 2024-04-01T20:00:59.582 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.582 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:00:59.582 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.582 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:00:59.582 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.873063+0000", 2024-04-01T20:00:59.582 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.582 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.582 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.582 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:00:59.582 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.873063+0000", 2024-04-01T20:00:59.582 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.583 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.583 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.583 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:00:59.583 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.873066+0000", 2024-04-01T20:00:59.583 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.7439999999999999e-06 2024-04-01T20:00:59.583 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.583 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.583 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:00:59.583 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.873126+0000", 2024-04-01T20:00:59.583 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.961e-05 2024-04-01T20:00:59.583 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.583 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.583 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:00:59.583 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.873168+0000", 2024-04-01T20:00:59.583 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.2134e-05 2024-04-01T20:00:59.584 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.584 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.584 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:00:59.584 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.873179+0000", 2024-04-01T20:00:59.584 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0874e-05 2024-04-01T20:00:59.584 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.584 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.584 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.584 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.873244+0000", 2024-04-01T20:00:59.584 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5201000000000001e-05 2024-04-01T20:00:59.584 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.584 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.584 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:00:59.584 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.873396+0000", 2024-04-01T20:00:59.584 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000151898 2024-04-01T20:00:59.585 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.585 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.585 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T20:00:59.585 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.873550+0000", 2024-04-01T20:00:59.585 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000154196 2024-04-01T20:00:59.585 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.585 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.585 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:00:59.585 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.877999+0000", 2024-04-01T20:00:59.585 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.004449606 2024-04-01T20:00:59.585 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.585 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.585 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:59.585 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:04.082303+0000", 2024-04-01T20:00:59.585 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.20430330699999999 2024-04-01T20:00:59.586 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.586 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.586 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:00:59.586 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:04.082337+0000", 2024-04-01T20:00:59.586 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.4127e-05 2024-04-01T20:00:59.586 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.586 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.586 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:00:59.586 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:04.082367+0000", 2024-04-01T20:00:59.586 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.9785e-05 2024-04-01T20:00:59.586 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.586 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:00:59.586 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.586 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.587 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.587 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:69839 9.4 9:2d73c6dd:::benchmark_data_smithi188_173515_object69838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e746)", 2024-04-01T20:00:59.587 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:00:03.873200+0000", 2024-04-01T20:00:59.587 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 55.592080197000001, 2024-04-01T20:00:59.587 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.21131520300000001, 2024-04-01T20:00:59.587 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:00:59.587 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:00:59.587 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:59.587 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:00:59.587 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:00:59.587 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:00:59.587 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 69839 2024-04-01T20:00:59.587 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.587 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:00:59.588 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.588 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:00:59.588 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.873200+0000", 2024-04-01T20:00:59.588 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.588 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.588 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.588 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:00:59.588 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.873200+0000", 2024-04-01T20:00:59.588 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.588 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.588 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.588 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:00:59.588 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.873201+0000", 2024-04-01T20:00:59.588 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.9699999999999994e-07 2024-04-01T20:00:59.588 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.589 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.589 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:00:59.589 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.873287+0000", 2024-04-01T20:00:59.589 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.5789000000000001e-05 2024-04-01T20:00:59.589 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.589 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.589 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:00:59.589 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.873296+0000", 2024-04-01T20:00:59.589 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.0920000000000004e-06 2024-04-01T20:00:59.589 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.589 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.589 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:00:59.589 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.873304+0000", 2024-04-01T20:00:59.589 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.4490000000000002e-06 2024-04-01T20:00:59.589 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.589 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.590 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.590 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.875836+0000", 2024-04-01T20:00:59.590 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0025327219999999998 2024-04-01T20:00:59.590 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.590 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.590 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:00:59.590 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.875997+0000", 2024-04-01T20:00:59.590 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000160445 2024-04-01T20:00:59.590 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.590 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.590 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T20:00:59.590 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.876202+0000", 2024-04-01T20:00:59.590 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00020574100000000001 2024-04-01T20:00:59.590 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.591 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.591 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:00:59.591 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.878142+0000", 2024-04-01T20:00:59.591 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.001939482 2024-04-01T20:00:59.591 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.591 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.591 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:59.591 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:04.084459+0000", 2024-04-01T20:00:59.591 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.20631682200000001 2024-04-01T20:00:59.591 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.591 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.591 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:00:59.591 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:04.084492+0000", 2024-04-01T20:00:59.591 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.3244000000000002e-05 2024-04-01T20:00:59.592 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.592 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.592 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:00:59.592 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:04.084515+0000", 2024-04-01T20:00:59.592 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3419999999999999e-05 2024-04-01T20:00:59.592 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.592 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:00:59.592 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.592 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.592 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.592 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:69846 9.4 9:2d565c33:::benchmark_data_smithi188_173515_object69845:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e746)", 2024-04-01T20:00:59.592 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:00:03.878857+0000", 2024-04-01T20:00:59.592 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 55.586423437999997, 2024-04-01T20:00:59.592 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.205766595, 2024-04-01T20:00:59.593 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:00:59.593 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:00:59.593 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:00:59.593 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:00:59.593 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:00:59.593 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:00:59.593 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 69846 2024-04-01T20:00:59.593 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.593 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:00:59.593 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.593 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:00:59.593 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.878857+0000", 2024-04-01T20:00:59.593 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:00:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.878857+0000", 2024-04-01T20:00:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:00:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:00:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.878859+0000", 2024-04-01T20:00:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.9609999999999999e-06 2024-04-01T20:00:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:00:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.878918+0000", 2024-04-01T20:00:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8712999999999998e-05 2024-04-01T20:00:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:00:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.878931+0000", 2024-04-01T20:00:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3210999999999999e-05 2024-04-01T20:00:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:00:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.878939+0000", 2024-04-01T20:00:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0299999999999994e-06 2024-04-01T20:00:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:00:59.596 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.878992+0000", 2024-04-01T20:00:59.596 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2975e-05 2024-04-01T20:00:59.596 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.596 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.596 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:00:59.596 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.879111+0000", 2024-04-01T20:00:59.596 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00011898800000000001 2024-04-01T20:00:59.596 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.596 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.596 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 8", 2024-04-01T20:00:59.596 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.879197+0000", 2024-04-01T20:00:59.596 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.6557999999999994e-05 2024-04-01T20:00:59.596 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.596 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.596 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:00:59.597 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:03.881816+0000", 2024-04-01T20:00:59.597 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0026186719999999998 2024-04-01T20:00:59.597 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.597 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.597 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:00:59.597 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:04.084549+0000", 2024-04-01T20:00:59.597 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.20273308000000001 2024-04-01T20:00:59.597 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.597 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.597 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:00:59.597 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:04.084599+0000", 2024-04-01T20:00:59.597 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.02e-05 2024-04-01T20:00:59.597 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:00:59.598 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:00:59.598 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:00:59.598 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:04.084624+0000", 2024-04-01T20:00:59.598 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.4207e-05 2024-04-01T20:00:59.598 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.598 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:00:59.598 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.598 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:00:59.598 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:00:59.598 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T20:00:59.599 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 79 16 144605 144589 114.359 53.5 0.0100461 0.0087363 2024-04-01T20:00:59.599 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.599 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.599 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.600 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.600 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.600 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.600 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.600 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.600 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.600 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.600 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:59 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.600 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:00:59 smithi062 ceph-mon[44211]: pgmap v2088: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.7 GiB data, 24 GiB used, 870 GiB / 894 GiB avail; 52 MiB/s wr, 832 op/s 2024-04-01T20:00:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:59 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:00:59 smithi022 ceph-mon[39439]: pgmap v2088: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.7 GiB data, 24 GiB used, 870 GiB / 894 GiB avail; 52 MiB/s wr, 832 op/s 2024-04-01T20:00:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:59 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:00:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:00:59 smithi188 ceph-mon[43939]: pgmap v2088: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.7 GiB data, 24 GiB used, 870 GiB / 894 GiB avail; 52 MiB/s wr, 832 op/s 2024-04-01T20:00:59.911 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:00:59.919 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:00:59.919 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:01:00.020 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:01:00.055 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:00.110 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:01:00.113 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:00.113 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:01:00.214 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:01:00.276 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:00.495 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:2024-04-01 20:01:00.497661 min lat: 0.00101525 max lat: 0.231407 avg lat: 0.00879341 2024-04-01T20:01:00.495 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-01T20:01:00.495 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 80 16 145549 145533 113.667 59 0.00979581 0.00879341 2024-04-01T20:01:00.843 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:00 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:00.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:00 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:00.868 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:01:00.873 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:00.874 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:01:00.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:00 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:00.884 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_ops_in_flight 2024-04-01T20:01:00.975 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:01:01.038 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:01.070 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:01:01.073 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:01.073 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:01:01.174 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:01:01.229 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:01.263 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:01:01.279 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:01.279 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:01:01.380 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:01:01.413 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T20:01:01.460 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:01.495 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 81 16 146470 146454 112.975 57.5625 0.0168792 0.0088493 2024-04-01T20:01:01.601 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T20:01:01.842 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:01 smithi062 ceph-mon[44211]: pgmap v2089: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.8 GiB data, 24 GiB used, 870 GiB / 894 GiB avail; 54 MiB/s wr, 863 op/s 2024-04-01T20:01:01.846 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:01:01.853 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:01.853 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:01:01.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:01 smithi022 ceph-mon[39439]: pgmap v2089: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.8 GiB data, 24 GiB used, 870 GiB / 894 GiB avail; 54 MiB/s wr, 863 op/s 2024-04-01T20:01:01.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:01 smithi188 ceph-mon[43939]: pgmap v2089: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.8 GiB data, 24 GiB used, 870 GiB / 894 GiB avail; 54 MiB/s wr, 863 op/s 2024-04-01T20:01:01.896 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:01:01.954 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:01:02.000 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:02.024 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:01:02.029 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:02.030 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:01:02.130 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:01:02.170 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:02.196 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:01:02.205 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:02.205 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:01:02.306 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:01:02.359 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:02.495 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 82 16 147379 147363 112.29 56.8125 0.00573583 0.00890265 2024-04-01T20:01:02.497 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:01:02.504 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:02.504 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:01:02.584 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T20:01:02.605 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:01:02.637 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:02.738 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:01:02.739 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:02 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1398401704' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:01:02.740 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:02.741 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:01:02.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:02 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1398401704' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:01:02.841 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:01:02.870 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:02.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:02 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1398401704' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:01:02.947 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:01:02.950 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:02.950 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:01:03.051 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:01:03.089 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:03.122 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:01:03.125 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:03.125 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:01:03.226 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:01:03.270 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:03.370 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:01:03.376 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:03.376 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:01:03.477 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:01:03.495 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 83 16 148460 148444 111.751 67.5625 0.00986557 0.00894689 2024-04-01T20:01:03.519 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:03.548 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:01:03.553 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:03.553 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:01:03.588 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:03 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:01:03.588 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:03 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:01:03.588 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:03 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:01:03.588 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:03 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1398401704' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T20:01:03.588 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:03 smithi062 ceph-mon[44211]: osdmap e765: 12 total, 12 up, 10 in 2024-04-01T20:01:03.588 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:03 smithi062 ceph-mon[44211]: pgmap v2091: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.9 GiB data, 24 GiB used, 870 GiB / 894 GiB avail; 52 MiB/s wr, 827 op/s 2024-04-01T20:01:03.654 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:01:03.685 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:03.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:03 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:01:03.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:03 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:01:03.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:03 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:01:03.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:03 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1398401704' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T20:01:03.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:03 smithi022 ceph-mon[39439]: osdmap e765: 12 total, 12 up, 10 in 2024-04-01T20:01:03.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:03 smithi022 ceph-mon[39439]: pgmap v2091: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.9 GiB data, 24 GiB used, 870 GiB / 894 GiB avail; 52 MiB/s wr, 827 op/s 2024-04-01T20:01:03.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:03 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:01:03.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:03 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:01:03.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:03 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:01:03.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:03 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1398401704' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T20:01:03.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:03 smithi188 ceph-mon[43939]: osdmap e765: 12 total, 12 up, 10 in 2024-04-01T20:01:03.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:03 smithi188 ceph-mon[43939]: pgmap v2091: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 8.9 GiB data, 24 GiB used, 870 GiB / 894 GiB avail; 52 MiB/s wr, 827 op/s 2024-04-01T20:01:03.934 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T20:01:03.935 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T20:01:03.935 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:03.935 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:148936 9.f 9:fa7b4113:::benchmark_data_smithi188_173515_object148935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected e765)", 2024-04-01T20:01:03.935 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:01:03.928521+0000", 2024-04-01T20:01:03.935 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0076967310000000001, 2024-04-01T20:01:03.935 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0077302630000000002, 2024-04-01T20:01:03.935 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:01:03.935 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:01:03.935 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "waiting for sub ops", 2024-04-01T20:01:03.935 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:01:03.936 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:01:03.936 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:01:03.936 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 148936 2024-04-01T20:01:03.936 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:03.936 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:01:03.936 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:03.936 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:01:03.936 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:03.928521+0000", 2024-04-01T20:01:03.936 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:03.936 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:03.936 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:03.936 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:01:03.936 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:03.928521+0000", 2024-04-01T20:01:03.937 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:03.937 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:03.937 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:03.937 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:01:03.937 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:03.928523+0000", 2024-04-01T20:01:03.937 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.0470000000000001e-06 2024-04-01T20:01:03.937 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:03.937 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:03.937 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:01:03.937 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:03.928595+0000", 2024-04-01T20:01:03.937 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1223999999999994e-05 2024-04-01T20:01:03.937 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:03.937 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:03.938 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:01:03.938 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:03.928613+0000", 2024-04-01T20:01:03.938 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8836999999999999e-05 2024-04-01T20:01:03.938 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:03.938 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:03.938 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:01:03.938 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:03.928621+0000", 2024-04-01T20:01:03.938 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.6129999999999998e-06 2024-04-01T20:01:03.938 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:03.938 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:03.938 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:01:03.938 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:03.928690+0000", 2024-04-01T20:01:03.938 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.8522999999999994e-05 2024-04-01T20:01:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:01:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:03.928864+0000", 2024-04-01T20:01:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00017471500000000001 2024-04-01T20:01:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 9", 2024-04-01T20:01:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:03.929021+0000", 2024-04-01T20:01:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00015667200000000001 2024-04-01T20:01:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:01:03.940 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:03.933790+0000", 2024-04-01T20:01:03.940 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0047690650000000003 2024-04-01T20:01:03.940 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:03.940 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:01:03.940 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:03.940 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:03.940 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-04-01T20:01:03.940 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 1 2024-04-01T20:01:03.940 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T20:01:04.035 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:01:04.037 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:04.038 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:01:04.138 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:01:04.176 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:04.220 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:01:04.223 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:04.224 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:01:04.325 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:01:04.373 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:04.411 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:01:04.420 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:04.421 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:01:04.495 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 84 16 149582 149566 111.255 70.125 0.014921 0.00898699 2024-04-01T20:01:04.521 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:01:04.553 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:04.576 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:01:04.579 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:04.579 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:01:04.594 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:01:04.618 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:01:04.642 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:01:04.666 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T20:01:04.679 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:01:04.692 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:01:04.711 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:04.718 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:01:04.733 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:01:04.736 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:04.736 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:01:04.742 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:01:04.768 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:01:04.798 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:01:04.819 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:01:04.838 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:01:04.841 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T20:01:04.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:04 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4148177784' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:01:04.867 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:04.869 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:01:04.871 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:01:04.871 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:01:04.871 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:01:04.872 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T20:01:04.872 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:01:04.872 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:01:04.872 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:01:04.872 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:01:04.872 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:01:04.872 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:01:04.872 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T20:01:04.872 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:01:04.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:04 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4148177784' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:01:04.890 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:01:04.893 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:04.893 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:01:04.994 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:01:05.016 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:04 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4148177784' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:01:05.034 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:05.441 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 7, 9, 11, 8, 6] out_osds: [1, 10] dead_osds: [] live_osds: [0, 2, 3, 4, 5, 7, 9, 11, 8, 6, 1, 10] 2024-04-01T20:01:05.441 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-01T20:01:05.442 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-01T20:01:05.442 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.383950 2024-04-01T20:01:05.442 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd primary-affinity 2 0.3839496248818274 2024-04-01T20:01:05.498 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 85 16 150732 150716 110.789 71.875 0.0155455 0.00902516 2024-04-01T20:01:05.515 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T20:01:05.799 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:01:05.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:05.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:05.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:05.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:05.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:05.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:05.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:05.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:05.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:05 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:05.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:05 smithi022 ceph-mon[39439]: pgmap v2092: 17 pgs: 17 active+clean; 9.0 GiB data, 24 GiB used, 870 GiB / 894 GiB avail; 56 MiB/s wr, 891 op/s 2024-04-01T20:01:05.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:05.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:05 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:05 smithi188 ceph-mon[43939]: pgmap v2092: 17 pgs: 17 active+clean; 9.0 GiB data, 24 GiB used, 870 GiB / 894 GiB avail; 56 MiB/s wr, 891 op/s 2024-04-01T20:01:06.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:06.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:06.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:06.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:06.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:06.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:06.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:06.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:06.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:05 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:06.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:05 smithi062 ceph-mon[44211]: pgmap v2092: 17 pgs: 17 active+clean; 9.0 GiB data, 24 GiB used, 870 GiB / 894 GiB avail; 56 MiB/s wr, 891 op/s 2024-04-01T20:01:06.080 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:01:06.498 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 86 16 151789 151773 110.269 66.0625 0.010278 0.00906719 2024-04-01T20:01:06.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:06.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:06.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:06 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:06.704 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:01:06.707 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:06.708 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:01:06.809 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:01:06.855 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:06.907 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:06.907 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:06.907 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:06 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:06.943 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:06.943 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:06.943 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:06 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:06.945 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:01:06.954 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:06.955 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:01:07.056 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:01:07.097 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:07.131 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:01:07.138 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:07.138 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:01:07.239 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:01:07.289 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:07.330 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:01:07.348 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:07.348 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:01:07.390 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_blocked_ops 2024-04-01T20:01:07.450 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:01:07.481 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:07.498 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 87 16 152894 152878 109.795 69.0625 0.00946697 0.00910625 2024-04-01T20:01:07.751 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T20:01:07.777 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:07 smithi022 ceph-mon[39439]: pgmap v2093: 17 pgs: 17 active+clean; 9.2 GiB data, 25 GiB used, 869 GiB / 894 GiB avail; 59 MiB/s wr, 949 op/s 2024-04-01T20:01:07.815 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T20:01:07.833 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:01:07.838 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:07.838 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:01:07.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:07 smithi188 ceph-mon[43939]: pgmap v2093: 17 pgs: 17 active+clean; 9.2 GiB data, 25 GiB used, 869 GiB / 894 GiB avail; 59 MiB/s wr, 949 op/s 2024-04-01T20:01:07.939 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:01:07.985 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:07 smithi062 ceph-mon[44211]: pgmap v2093: 17 pgs: 17 active+clean; 9.2 GiB data, 25 GiB used, 869 GiB / 894 GiB avail; 59 MiB/s wr, 949 op/s 2024-04-01T20:01:08.013 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:01:08.018 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:08.018 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:01:08.119 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:01:08.154 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:08.183 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:01:08.187 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:08.187 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:01:08.288 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:01:08.319 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:08.349 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:01:08.352 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:08.352 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:01:08.453 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:01:08.498 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 88 16 153951 153935 109.298 66.0625 0.0214438 0.00914707 2024-04-01T20:01:08.507 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:08.779 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:01:08.782 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:08.783 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:01:08.884 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:01:08.939 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:08.971 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:01:08.983 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:08.983 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:01:09.084 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:01:09.136 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:09.147 INFO:teuthology.orchestra.run.smithi022.stderr:set osd.2 primary-affinity to 0.38395 (8251622) 2024-04-01T20:01:09.353 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:01:09.357 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:09.358 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:01:09.459 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:01:09.486 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:09 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1783993393' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 0.3839496248818274}]: dispatch 2024-04-01T20:01:09.489 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:09.498 INFO:tasks.radosbench.radosbench.2.smithi188.stdout: 89 16 155040 155024 108.835 68.0625 0.00559465 0.0091873 2024-04-01T20:01:09.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:09 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1783993393' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 0.3839496248818274}]: dispatch 2024-04-01T20:01:09.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:09 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1783993393' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 0.3839496248818274}]: dispatch 2024-04-01T20:01:10.169 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:01:10.172 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:10.172 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:01:10.273 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:01:10.276 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T20:01:10.277 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:01:10.320 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:10.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:10 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1783993393' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 2, "weight": 0.3839496248818274}]': finished 2024-04-01T20:01:10.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:10 smithi022 ceph-mon[39439]: osdmap e766: 12 total, 12 up, 10 in 2024-04-01T20:01:10.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:10 smithi022 ceph-mon[39439]: pgmap v2095: 17 pgs: 17 active+clean; 9.3 GiB data, 25 GiB used, 869 GiB / 894 GiB avail; 56 MiB/s wr, 891 op/s 2024-04-01T20:01:10.498 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Total time run: 90.017 2024-04-01T20:01:10.499 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Total writes made: 156082 2024-04-01T20:01:10.499 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Write size: 65536 2024-04-01T20:01:10.499 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Object size: 65536 2024-04-01T20:01:10.499 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Bandwidth (MB/sec): 108.37 2024-04-01T20:01:10.499 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Stddev Bandwidth: 58.3625 2024-04-01T20:01:10.499 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Max bandwidth (MB/sec): 332.062 2024-04-01T20:01:10.499 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Min bandwidth (MB/sec): 45.6875 2024-04-01T20:01:10.499 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Average IOPS: 1733 2024-04-01T20:01:10.499 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Stddev IOPS: 933.799 2024-04-01T20:01:10.499 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Max IOPS: 5313 2024-04-01T20:01:10.499 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Min IOPS: 731 2024-04-01T20:01:10.499 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Average Latency(s): 0.00922699 2024-04-01T20:01:10.499 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Stddev Latency(s): 0.00879276 2024-04-01T20:01:10.499 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Max latency(s): 0.231407 2024-04-01T20:01:10.500 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Min latency(s): 0.00101525 2024-04-01T20:01:10.507 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Cleaning up (deleting benchmark objects) 2024-04-01T20:01:10.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:10 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1783993393' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 2, "weight": 0.3839496248818274}]': finished 2024-04-01T20:01:10.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:10 smithi062 ceph-mon[44211]: osdmap e766: 12 total, 12 up, 10 in 2024-04-01T20:01:10.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:10 smithi062 ceph-mon[44211]: pgmap v2095: 17 pgs: 17 active+clean; 9.3 GiB data, 25 GiB used, 869 GiB / 894 GiB avail; 56 MiB/s wr, 891 op/s 2024-04-01T20:01:10.551 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:01:10.561 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:10.562 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:01:10.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:10 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1783993393' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 2, "weight": 0.3839496248818274}]': finished 2024-04-01T20:01:10.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:10 smithi188 ceph-mon[43939]: osdmap e766: 12 total, 12 up, 10 in 2024-04-01T20:01:10.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:10 smithi188 ceph-mon[43939]: pgmap v2095: 17 pgs: 17 active+clean; 9.3 GiB data, 25 GiB used, 869 GiB / 894 GiB avail; 56 MiB/s wr, 891 op/s 2024-04-01T20:01:10.663 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:01:10.697 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:11.095 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_historic_ops 2024-04-01T20:01:11.348 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:01:11.350 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:11.351 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:01:11.452 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:01:11.491 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:01:11.492 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:11.515 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T20:01:11.528 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:01:11.535 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:11.535 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:01:11.594 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T20:01:11.635 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:01:11.688 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:11.734 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:01:11.740 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:11 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2089000784' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:01:11.741 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:11 smithi188 ceph-mon[43939]: pgmap v2096: 17 pgs: 17 active+clean; 9.4 GiB data, 25 GiB used, 869 GiB / 894 GiB avail; 70 MiB/s wr, 1.15k op/s 2024-04-01T20:01:11.741 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:11.741 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:01:11.829 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:11 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2089000784' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:01:11.829 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:11 smithi022 ceph-mon[39439]: pgmap v2096: 17 pgs: 17 active+clean; 9.4 GiB data, 25 GiB used, 869 GiB / 894 GiB avail; 70 MiB/s wr, 1.15k op/s 2024-04-01T20:01:11.832 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:11 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2089000784' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:01:11.833 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:11 smithi062 ceph-mon[44211]: pgmap v2096: 17 pgs: 17 active+clean; 9.4 GiB data, 25 GiB used, 869 GiB / 894 GiB avail; 70 MiB/s wr, 1.15k op/s 2024-04-01T20:01:11.842 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:01:11.873 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:11.998 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:01:12.001 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:12.001 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:01:12.102 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:01:12.157 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:12.424 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:01:12.429 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:12.430 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:01:12.531 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:01:12.559 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:12.581 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:01:12.587 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:12.587 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:01:12.688 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:01:12.717 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:12.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:12 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:01:12.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:12 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2089000784' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T20:01:12.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:12 smithi062 ceph-mon[44211]: osdmap e767: 12 total, 12 up, 10 in 2024-04-01T20:01:12.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:12 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:01:12.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:12 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2089000784' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T20:01:12.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:12 smithi022 ceph-mon[39439]: osdmap e767: 12 total, 12 up, 10 in 2024-04-01T20:01:12.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:12 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:01:12.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:12 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2089000784' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T20:01:12.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:12 smithi188 ceph-mon[43939]: osdmap e767: 12 total, 12 up, 10 in 2024-04-01T20:01:13.066 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:01:13.068 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:13.069 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:01:13.169 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:01:13.198 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:13.647 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:01:13.650 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:13.650 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:01:13.751 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:01:13.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:13 smithi062 ceph-mon[44211]: 9.d scrub starts 2024-04-01T20:01:13.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:13 smithi062 ceph-mon[44211]: pgmap v2098: 17 pgs: 17 active+clean; 9.5 GiB data, 25 GiB used, 869 GiB / 894 GiB avail; 62 MiB/s wr, 1.09k op/s 2024-04-01T20:01:13.781 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:13.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:13 smithi022 ceph-mon[39439]: 9.d scrub starts 2024-04-01T20:01:13.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:13 smithi022 ceph-mon[39439]: pgmap v2098: 17 pgs: 17 active+clean; 9.5 GiB data, 25 GiB used, 869 GiB / 894 GiB avail; 62 MiB/s wr, 1.09k op/s 2024-04-01T20:01:13.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:13 smithi188 ceph-mon[43939]: 9.d scrub starts 2024-04-01T20:01:13.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:13 smithi188 ceph-mon[43939]: pgmap v2098: 17 pgs: 17 active+clean; 9.5 GiB data, 25 GiB used, 869 GiB / 894 GiB avail; 62 MiB/s wr, 1.09k op/s 2024-04-01T20:01:13.895 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T20:01:13.895 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:01:13.930 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:01:13.933 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:13.933 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:01:14.035 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:01:14.099 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:14.246 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:01:14.266 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:01:14.286 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:01:14.309 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T20:01:14.338 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:01:14.366 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:01:14.387 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:01:14.409 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:01:14.430 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:01:14.459 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:01:14.481 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T20:01:14.506 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:01:14.508 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:01:14.508 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:01:14.508 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:01:14.508 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T20:01:14.508 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:01:14.509 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:01:14.509 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:01:14.509 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:01:14.509 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:01:14.509 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:01:14.509 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T20:01:14.509 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:01:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:14 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1007265121' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:01:14.877 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:14 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1007265121' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:01:14.878 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:01:14.880 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:14 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1007265121' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:01:14.881 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:14.882 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:01:14.983 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:01:15.016 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:15.061 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T20:01:15.367 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:01:15.372 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:15.372 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:01:15.426 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:01:15.473 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:01:15.530 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:15.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:15.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:15.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:15.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:15.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:15.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:15.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:15.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:15 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:01:15.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:15 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:01:15.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:15.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:15.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:15.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:15.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:15 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:15.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:15 smithi022 ceph-mon[39439]: osdmap e768: 12 total, 12 up, 10 in 2024-04-01T20:01:15.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:15 smithi022 ceph-mon[39439]: pgmap v2100: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.4 GiB data, 25 GiB used, 869 GiB / 894 GiB avail; 162 B/s rd, 40 MiB/s wr, 999 op/s 2024-04-01T20:01:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:15 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:01:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:15 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:01:15.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:15.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:15.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:15.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:15.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:15 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:15.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:15 smithi188 ceph-mon[43939]: osdmap e768: 12 total, 12 up, 10 in 2024-04-01T20:01:15.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:15 smithi188 ceph-mon[43939]: pgmap v2100: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.4 GiB data, 25 GiB used, 869 GiB / 894 GiB avail; 162 B/s rd, 40 MiB/s wr, 999 op/s 2024-04-01T20:01:16.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:16.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:16.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:16.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:16.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:16.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:16.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:16.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:15 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:01:16.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:15 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:01:16.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:16.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:16.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:16.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:16.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:15 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:16.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:15 smithi062 ceph-mon[44211]: osdmap e768: 12 total, 12 up, 10 in 2024-04-01T20:01:16.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:15 smithi062 ceph-mon[44211]: pgmap v2100: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.4 GiB data, 25 GiB used, 869 GiB / 894 GiB avail; 162 B/s rd, 40 MiB/s wr, 999 op/s 2024-04-01T20:01:16.234 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 7, 9, 11, 8, 6] out_osds: [1, 10] dead_osds: [] live_osds: [0, 2, 3, 4, 5, 7, 9, 11, 8, 6, 1, 10] 2024-04-01T20:01:16.235 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-01T20:01:16.235 INFO:tasks.thrashosds.thrasher:Adding osd 1 2024-04-01T20:01:16.235 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd in 1 2024-04-01T20:01:16.606 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:16 smithi062 ceph-mon[44211]: 9.d scrub ok 2024-04-01T20:01:16.606 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:16 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:01:16.606 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:16 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:01:16.606 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:16 smithi062 ceph-mon[44211]: 9.c scrub starts 2024-04-01T20:01:16.606 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:16 smithi062 ceph-mon[44211]: osdmap e769: 12 total, 12 up, 10 in 2024-04-01T20:01:16.606 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:16 smithi062 ceph-mon[44211]: 9.9 scrub starts 2024-04-01T20:01:16.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:16 smithi022 ceph-mon[39439]: 9.d scrub ok 2024-04-01T20:01:16.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:16 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:01:16.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:16 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:01:16.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:16 smithi022 ceph-mon[39439]: 9.c scrub starts 2024-04-01T20:01:16.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:16 smithi022 ceph-mon[39439]: osdmap e769: 12 total, 12 up, 10 in 2024-04-01T20:01:16.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:16 smithi022 ceph-mon[39439]: 9.9 scrub starts 2024-04-01T20:01:16.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:16 smithi188 ceph-mon[43939]: 9.d scrub ok 2024-04-01T20:01:16.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:16 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:01:16.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:16 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:01:16.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:16 smithi188 ceph-mon[43939]: 9.c scrub starts 2024-04-01T20:01:16.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:16 smithi188 ceph-mon[43939]: osdmap e769: 12 total, 12 up, 10 in 2024-04-01T20:01:16.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:16 smithi188 ceph-mon[43939]: 9.9 scrub starts 2024-04-01T20:01:17.201 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:01:17.213 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:17.214 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:01:17.219 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_ops_in_flight 2024-04-01T20:01:17.315 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:01:17.373 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T20:01:17.373 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:17.420 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:01:17.423 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:17.424 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:01:17.525 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:01:17.557 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:17.587 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:01:17.591 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:17.591 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:01:17.638 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:01:17.693 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:01:17.702 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T20:01:17.753 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:17.829 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:01:17.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:17 smithi022 ceph-mon[39439]: 9.0 scrub starts 2024-04-01T20:01:17.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:17 smithi022 ceph-mon[39439]: pgmap v2102: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.2 GiB data, 25 GiB used, 869 GiB / 894 GiB avail; 170 B/s rd, 11 MiB/s wr, 934 op/s 2024-04-01T20:01:17.959 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:01:17.964 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:17 smithi062 ceph-mon[44211]: 9.0 scrub starts 2024-04-01T20:01:17.964 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:17 smithi062 ceph-mon[44211]: pgmap v2102: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.2 GiB data, 25 GiB used, 869 GiB / 894 GiB avail; 170 B/s rd, 11 MiB/s wr, 934 op/s 2024-04-01T20:01:17.968 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:17.968 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:01:18.069 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:01:18.121 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:18.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:17 smithi188 ceph-mon[43939]: 9.0 scrub starts 2024-04-01T20:01:18.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:17 smithi188 ceph-mon[43939]: pgmap v2102: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 9.2 GiB data, 25 GiB used, 869 GiB / 894 GiB avail; 170 B/s rd, 11 MiB/s wr, 934 op/s 2024-04-01T20:01:18.146 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:01:18.152 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:18.152 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:01:18.253 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:01:18.281 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:18.629 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T20:01:18.633 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:01:18.637 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:18.638 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:01:18.738 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:01:18.769 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:18.872 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:01:18.874 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:18 smithi022 ceph-mon[39439]: 9.c scrub ok 2024-04-01T20:01:18.874 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:18 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3815728639' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:01:18.874 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:18 smithi022 ceph-mon[39439]: 9.9 scrub ok 2024-04-01T20:01:18.875 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:18.875 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:01:18.976 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:01:18.982 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:18 smithi062 ceph-mon[44211]: 9.c scrub ok 2024-04-01T20:01:18.982 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:18 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3815728639' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:01:18.982 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:18 smithi062 ceph-mon[44211]: 9.9 scrub ok 2024-04-01T20:01:19.015 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:18 smithi188 ceph-mon[43939]: 9.c scrub ok 2024-04-01T20:01:19.015 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:18 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3815728639' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:01:19.015 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:18 smithi188 ceph-mon[43939]: 9.9 scrub ok 2024-04-01T20:01:19.019 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:19.058 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:01:19.065 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:19.065 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:01:19.166 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:01:19.211 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:19.356 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:01:19.370 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:19.371 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:01:19.471 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:01:19.513 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:19.781 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:01:19.784 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:19.785 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:01:19.886 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:01:19.928 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:19 smithi062 ceph-mon[44211]: 9.0 scrub ok 2024-04-01T20:01:19.928 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:19 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T20:01:19.928 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:19 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T20:01:19.928 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:19 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3815728639' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T20:01:19.929 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:19 smithi062 ceph-mon[44211]: osdmap e770: 12 total, 12 up, 10 in 2024-04-01T20:01:19.929 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:19 smithi062 ceph-mon[44211]: pgmap v2104: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.1 GiB data, 25 GiB used, 869 GiB / 894 GiB avail; 170 B/s rd, 4.9 MiB/s wr, 1.04k op/s 2024-04-01T20:01:19.931 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:19.965 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:01:19.975 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:19.975 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:01:20.076 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:01:20.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:19 smithi022 ceph-mon[39439]: 9.0 scrub ok 2024-04-01T20:01:20.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:19 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T20:01:20.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:19 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T20:01:20.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:19 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3815728639' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T20:01:20.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:19 smithi022 ceph-mon[39439]: osdmap e770: 12 total, 12 up, 10 in 2024-04-01T20:01:20.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:19 smithi022 ceph-mon[39439]: pgmap v2104: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.1 GiB data, 25 GiB used, 869 GiB / 894 GiB avail; 170 B/s rd, 4.9 MiB/s wr, 1.04k op/s 2024-04-01T20:01:20.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:19 smithi188 ceph-mon[43939]: 9.0 scrub ok 2024-04-01T20:01:20.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:19 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T20:01:20.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:19 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T20:01:20.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:19 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3815728639' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T20:01:20.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:19 smithi188 ceph-mon[43939]: osdmap e770: 12 total, 12 up, 10 in 2024-04-01T20:01:20.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:19 smithi188 ceph-mon[43939]: pgmap v2104: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 9.1 GiB data, 25 GiB used, 869 GiB / 894 GiB avail; 170 B/s rd, 4.9 MiB/s wr, 1.04k op/s 2024-04-01T20:01:20.134 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:20.169 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:01:20.172 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:20.172 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:01:20.273 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:01:20.305 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:20.381 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:01:20.384 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:20.384 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:01:20.485 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:01:20.516 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T20:01:20.516 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T20:01:20.516 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.516 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:166545 9.e 9:7c87b589:::benchmark_data_smithi188_173515_object10460:head [delete] snapc 0=[] ondisk+write+known_if_redirected e770)", 2024-04-01T20:01:20.516 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:01:20.495423+0000", 2024-04-01T20:01:20.516 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.012563905, 2024-04-01T20:01:20.516 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.012601443, 2024-04-01T20:01:20.516 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:01:20.516 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:01:20.516 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "waiting for sub ops", 2024-04-01T20:01:20.517 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:01:20.517 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:01:20.517 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:01:20.517 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 166545 2024-04-01T20:01:20.517 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.517 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:01:20.517 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.517 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:01:20.517 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.495423+0000", 2024-04-01T20:01:20.517 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:20.517 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.517 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.517 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:01:20.518 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.495423+0000", 2024-04-01T20:01:20.518 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:20.518 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.518 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.518 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:01:20.518 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.495425+0000", 2024-04-01T20:01:20.518 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.9230000000000001e-06 2024-04-01T20:01:20.518 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.518 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.518 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:01:20.518 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.495430+0000", 2024-04-01T20:01:20.518 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8209999999999998e-06 2024-04-01T20:01:20.518 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.519 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.519 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:01:20.519 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.495444+0000", 2024-04-01T20:01:20.519 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.384e-05 2024-04-01T20:01:20.519 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.519 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.519 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:01:20.519 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.495452+0000", 2024-04-01T20:01:20.519 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0949999999999996e-06 2024-04-01T20:01:20.519 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.519 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.519 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:01:20.519 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.497041+0000", 2024-04-01T20:01:20.520 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.001588817 2024-04-01T20:01:20.520 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.520 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.520 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:01:20.520 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.497165+0000", 2024-04-01T20:01:20.520 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000123664 2024-04-01T20:01:20.520 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.520 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.520 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 9", 2024-04-01T20:01:20.520 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.497280+0000", 2024-04-01T20:01:20.520 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00011561399999999999 2024-04-01T20:01:20.520 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.521 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.521 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:01:20.521 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.502355+0000", 2024-04-01T20:01:20.521 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0050749239999999998 2024-04-01T20:01:20.521 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:20.521 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:01:20.521 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:20.521 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.521 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.521 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:166548 9.7 9:e72a1000:::benchmark_data_smithi188_173515_object10463:head [delete] snapc 0=[] ondisk+write+known_if_redirected e770)", 2024-04-01T20:01:20.521 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:01:20.498519+0000", 2024-04-01T20:01:20.521 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0094678490000000004, 2024-04-01T20:01:20.521 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0096074790000000004, 2024-04-01T20:01:20.522 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:01:20.522 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:01:20.522 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:01:20.522 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:01:20.522 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:01:20.522 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:01:20.522 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 166548 2024-04-01T20:01:20.522 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.522 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:01:20.522 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.522 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:01:20.522 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.498519+0000", 2024-04-01T20:01:20.522 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:20.523 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.523 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.523 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:01:20.523 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.498519+0000", 2024-04-01T20:01:20.523 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:20.523 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.523 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.523 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:01:20.523 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.498521+0000", 2024-04-01T20:01:20.523 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.5390000000000002e-06 2024-04-01T20:01:20.523 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.523 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.523 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:01:20.523 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.498528+0000", 2024-04-01T20:01:20.524 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.4860000000000002e-06 2024-04-01T20:01:20.524 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.524 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.524 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:01:20.524 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.498539+0000", 2024-04-01T20:01:20.524 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1253000000000001e-05 2024-04-01T20:01:20.524 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.524 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.524 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:01:20.524 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.498548+0000", 2024-04-01T20:01:20.524 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.0420000000000008e-06 2024-04-01T20:01:20.524 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.524 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.525 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:01:20.525 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.498614+0000", 2024-04-01T20:01:20.525 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.5901999999999993e-05 2024-04-01T20:01:20.525 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.525 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.525 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:01:20.525 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.498747+0000", 2024-04-01T20:01:20.525 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000132929 2024-04-01T20:01:20.525 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.525 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.525 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 3", 2024-04-01T20:01:20.525 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.498881+0000", 2024-04-01T20:01:20.525 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013430899999999999 2024-04-01T20:01:20.525 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.526 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.526 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:01:20.526 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.506496+0000", 2024-04-01T20:01:20.526 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0076144079999999996 2024-04-01T20:01:20.526 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.526 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.526 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:01:20.526 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.508063+0000", 2024-04-01T20:01:20.526 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.001567791 2024-04-01T20:01:20.526 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.526 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.526 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:01:20.526 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.508108+0000", 2024-04-01T20:01:20.527 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.4631e-05 2024-04-01T20:01:20.527 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:20.527 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:01:20.527 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:20.527 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.527 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.527 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:166558 9.e 9:777035fe:::benchmark_data_smithi188_173515_object10473:head [delete] snapc 0=[] ondisk+write+known_if_redirected e770)", 2024-04-01T20:01:20.527 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:01:20.506481+0000", 2024-04-01T20:01:20.527 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0015055400000000001, 2024-04-01T20:01:20.527 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00174508, 2024-04-01T20:01:20.527 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:01:20.527 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:01:20.527 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "waiting for sub ops", 2024-04-01T20:01:20.527 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:01:20.528 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:01:20.528 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:01:20.528 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 166558 2024-04-01T20:01:20.528 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.528 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:01:20.528 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.528 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:01:20.528 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.506481+0000", 2024-04-01T20:01:20.528 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:20.528 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.528 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.528 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:01:20.528 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.506481+0000", 2024-04-01T20:01:20.529 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:20.529 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.529 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.529 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:01:20.529 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.506483+0000", 2024-04-01T20:01:20.529 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.3089999999999998e-06 2024-04-01T20:01:20.529 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.529 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.529 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:01:20.529 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.506490+0000", 2024-04-01T20:01:20.529 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.7329999999999997e-06 2024-04-01T20:01:20.529 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.529 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.529 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:01:20.530 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.506499+0000", 2024-04-01T20:01:20.530 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.4299999999999995e-06 2024-04-01T20:01:20.530 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.530 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.530 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:01:20.530 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.506507+0000", 2024-04-01T20:01:20.530 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.1029999999999996e-06 2024-04-01T20:01:20.530 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.530 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.530 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:01:20.530 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.506561+0000", 2024-04-01T20:01:20.530 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.4268999999999998e-05 2024-04-01T20:01:20.531 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.531 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.531 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:01:20.531 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.506694+0000", 2024-04-01T20:01:20.531 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013321700000000001 2024-04-01T20:01:20.531 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:20.531 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:20.531 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 9", 2024-04-01T20:01:20.531 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:20.506829+0000", 2024-04-01T20:01:20.531 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013527799999999999 2024-04-01T20:01:20.531 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:20.531 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:01:20.531 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:20.531 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:20.531 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-04-01T20:01:20.532 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 3 2024-04-01T20:01:20.532 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T20:01:20.532 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:21.457 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_blocked_ops 2024-04-01T20:01:21.501 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:01:21.507 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:21.507 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:01:21.608 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:01:21.642 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:21.674 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:01:21.678 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:21.678 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:01:21.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:21 smithi062 ceph-mon[44211]: pgmap v2105: 17 pgs: 17 active+clean; 8.9 GiB data, 24 GiB used, 870 GiB / 894 GiB avail; 1.7 MiB/s wr, 1.24k op/s 2024-04-01T20:01:21.779 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:01:21.830 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:21.857 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:01:21.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:21 smithi022 ceph-mon[39439]: pgmap v2105: 17 pgs: 17 active+clean; 8.9 GiB data, 24 GiB used, 870 GiB / 894 GiB avail; 1.7 MiB/s wr, 1.24k op/s 2024-04-01T20:01:21.869 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:21.869 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:01:21.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:21 smithi188 ceph-mon[43939]: pgmap v2105: 17 pgs: 17 active+clean; 8.9 GiB data, 24 GiB used, 870 GiB / 894 GiB avail; 1.7 MiB/s wr, 1.24k op/s 2024-04-01T20:01:21.946 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T20:01:21.970 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:01:22.004 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:22.289 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T20:01:23.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:22 smithi062 ceph-mon[44211]: 9.6 scrub starts 2024-04-01T20:01:23.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:22 smithi022 ceph-mon[39439]: 9.6 scrub starts 2024-04-01T20:01:23.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:22 smithi188 ceph-mon[43939]: 9.6 scrub starts 2024-04-01T20:01:23.288 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:01:23.309 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:01:23.331 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:01:23.353 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T20:01:23.376 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:01:23.397 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:01:23.421 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:01:23.450 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:01:23.456 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:01:23.462 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:23.462 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:01:23.474 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:01:23.500 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:01:23.522 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T20:01:23.543 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:01:23.545 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:01:23.545 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:01:23.545 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:01:23.545 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T20:01:23.545 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:01:23.545 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:01:23.545 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:01:23.546 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:01:23.546 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:01:23.546 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:01:23.546 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T20:01:23.546 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:01:23.563 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:01:23.598 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:23.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:23 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[39416]: 2024-04-01T20:01:23.546+0000 7fd025a9f700 -1 mon.a@0(leader).osd e770 definitely_dead 0 2024-04-01T20:01:23.796 INFO:teuthology.orchestra.run.smithi022.stderr:marked in osd.1. 2024-04-01T20:01:24.044 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:01:24.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:23 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3886586127' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:01:24.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:24.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:24.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:24.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:24.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:24.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:23 smithi022 ceph-mon[39439]: pgmap v2106: 17 pgs: 17 active+clean; 8.9 GiB data, 24 GiB used, 870 GiB / 894 GiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T20:01:24.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:24.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:23 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/794491171' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["1"]}]: dispatch 2024-04-01T20:01:24.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:23 smithi022 ceph-mon[39439]: from='client.27463 ' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["1"]}]: dispatch 2024-04-01T20:01:24.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:23 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3886586127' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:01:24.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:24.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:24.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:24.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:24.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:24.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:23 smithi188 ceph-mon[43939]: pgmap v2106: 17 pgs: 17 active+clean; 8.9 GiB data, 24 GiB used, 870 GiB / 894 GiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T20:01:24.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:24.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:23 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/794491171' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["1"]}]: dispatch 2024-04-01T20:01:24.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:23 smithi188 ceph-mon[43939]: from='client.27463 ' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["1"]}]: dispatch 2024-04-01T20:01:24.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:23 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3886586127' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:01:24.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:24.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:24.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:24.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:24.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:24.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:23 smithi062 ceph-mon[44211]: pgmap v2106: 17 pgs: 17 active+clean; 8.9 GiB data, 24 GiB used, 870 GiB / 894 GiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T20:01:24.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:24.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:23 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/794491171' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["1"]}]: dispatch 2024-04-01T20:01:24.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:23 smithi062 ceph-mon[44211]: from='client.27463 ' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["1"]}]: dispatch 2024-04-01T20:01:25.025 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:25.026 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:25.026 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:25.026 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:25.026 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:25.026 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:24 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:25.026 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:24 smithi022 ceph-mon[39439]: from='client.27463 ' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["1"]}]': finished 2024-04-01T20:01:25.026 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:24 smithi022 ceph-mon[39439]: osdmap e771: 12 total, 12 up, 11 in 2024-04-01T20:01:25.054 INFO:tasks.thrashosds.thrasher:Added osd 1 2024-04-01T20:01:25.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:25.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:25.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:25.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:25.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:25.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:24 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:25.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:24 smithi188 ceph-mon[43939]: from='client.27463 ' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["1"]}]': finished 2024-04-01T20:01:25.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:24 smithi188 ceph-mon[43939]: osdmap e771: 12 total, 12 up, 11 in 2024-04-01T20:01:25.254 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:01:25.259 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:25.259 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:01:25.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:25.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:25.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:25.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:25.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:25.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:24 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:25.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:24 smithi062 ceph-mon[44211]: from='client.27463 ' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["1"]}]': finished 2024-04-01T20:01:25.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:24 smithi062 ceph-mon[44211]: osdmap e771: 12 total, 12 up, 11 in 2024-04-01T20:01:25.360 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:01:25.390 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:25.464 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:01:25.467 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:25.468 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:01:25.568 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:01:25.602 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:25.624 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:01:25.627 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:25.627 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:01:25.728 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:01:25.757 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:25.786 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:01:25.788 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:25.788 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:01:25.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:25 smithi188 ceph-mon[43939]: osdmap e772: 12 total, 12 up, 11 in 2024-04-01T20:01:25.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:25 smithi188 ceph-mon[43939]: pgmap v2109: 17 pgs: 3 peering, 14 active+clean; 8.8 GiB data, 24 GiB used, 870 GiB / 894 GiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T20:01:25.889 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:01:25.943 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:26.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:25 smithi022 ceph-mon[39439]: osdmap e772: 12 total, 12 up, 11 in 2024-04-01T20:01:26.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:25 smithi022 ceph-mon[39439]: pgmap v2109: 17 pgs: 3 peering, 14 active+clean; 8.8 GiB data, 24 GiB used, 870 GiB / 894 GiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T20:01:26.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:25 smithi062 ceph-mon[44211]: osdmap e772: 12 total, 12 up, 11 in 2024-04-01T20:01:26.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:25 smithi062 ceph-mon[44211]: pgmap v2109: 17 pgs: 3 peering, 14 active+clean; 8.8 GiB data, 24 GiB used, 870 GiB / 894 GiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T20:01:26.306 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:01:26.313 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:26.313 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:01:26.414 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:01:26.448 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:26.478 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:01:26.485 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:26.486 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:01:26.586 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:01:26.621 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:26.647 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:01:26.650 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:26.651 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:01:26.752 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:01:26.760 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T20:01:26.804 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:26 smithi188 ceph-mon[43939]: 9.4 starting backfill to osd.1 from (0'0,0'0] MAX to 770'10708 2024-04-01T20:01:26.804 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:26 smithi188 ceph-mon[43939]: osdmap e773: 12 total, 12 up, 11 in 2024-04-01T20:01:26.804 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:26 smithi188 ceph-mon[43939]: 9.2 starting backfill to osd.1 from (0'0,0'0] MAX to 770'10611 2024-04-01T20:01:26.804 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:26 smithi188 ceph-mon[43939]: 9.f starting backfill to osd.1 from (0'0,0'0] MAX to 770'10450 2024-04-01T20:01:26.804 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:26 smithi188 ceph-mon[43939]: 9.6 starting backfill to osd.1 from (0'0,0'0] MAX to 770'10663 2024-04-01T20:01:26.804 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:26 smithi188 ceph-mon[43939]: 9.d starting backfill to osd.1 from (0'0,0'0] MAX to 770'12221 2024-04-01T20:01:26.804 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:26 smithi188 ceph-mon[43939]: 9.e starting backfill to osd.1 from (0'0,0'0] MAX to 770'10602 2024-04-01T20:01:26.807 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:26.833 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:01:26.836 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:26.836 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:01:26.938 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:01:26.976 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:26.982 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:26 smithi022 ceph-mon[39439]: 9.4 starting backfill to osd.1 from (0'0,0'0] MAX to 770'10708 2024-04-01T20:01:26.982 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:26 smithi022 ceph-mon[39439]: osdmap e773: 12 total, 12 up, 11 in 2024-04-01T20:01:26.982 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:26 smithi022 ceph-mon[39439]: 9.2 starting backfill to osd.1 from (0'0,0'0] MAX to 770'10611 2024-04-01T20:01:26.982 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:26 smithi022 ceph-mon[39439]: 9.f starting backfill to osd.1 from (0'0,0'0] MAX to 770'10450 2024-04-01T20:01:26.982 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:26 smithi022 ceph-mon[39439]: 9.6 starting backfill to osd.1 from (0'0,0'0] MAX to 770'10663 2024-04-01T20:01:26.982 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:26 smithi022 ceph-mon[39439]: 9.d starting backfill to osd.1 from (0'0,0'0] MAX to 770'12221 2024-04-01T20:01:26.982 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:26 smithi022 ceph-mon[39439]: 9.e starting backfill to osd.1 from (0'0,0'0] MAX to 770'10602 2024-04-01T20:01:27.180 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T20:01:27.180 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:01:27.195 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:01:27.198 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:27.198 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:01:27.211 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:26 smithi062 ceph-mon[44211]: 9.4 starting backfill to osd.1 from (0'0,0'0] MAX to 770'10708 2024-04-01T20:01:27.211 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:26 smithi062 ceph-mon[44211]: osdmap e773: 12 total, 12 up, 11 in 2024-04-01T20:01:27.211 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:26 smithi062 ceph-mon[44211]: 9.2 starting backfill to osd.1 from (0'0,0'0] MAX to 770'10611 2024-04-01T20:01:27.211 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:26 smithi062 ceph-mon[44211]: 9.f starting backfill to osd.1 from (0'0,0'0] MAX to 770'10450 2024-04-01T20:01:27.212 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:26 smithi062 ceph-mon[44211]: 9.6 starting backfill to osd.1 from (0'0,0'0] MAX to 770'10663 2024-04-01T20:01:27.212 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:26 smithi062 ceph-mon[44211]: 9.d starting backfill to osd.1 from (0'0,0'0] MAX to 770'12221 2024-04-01T20:01:27.212 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:26 smithi062 ceph-mon[44211]: 9.e starting backfill to osd.1 from (0'0,0'0] MAX to 770'10602 2024-04-01T20:01:27.269 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:01:27.299 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:01:27.337 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:27.692 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:01:27.698 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:27.699 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:01:27.800 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:01:27.845 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:27.880 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:01:27.885 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:27 smithi022 ceph-mon[39439]: pgmap v2111: 17 pgs: 3 active+remapped+backfilling, 3 peering, 11 active+clean; 8.7 GiB data, 24 GiB used, 960 GiB / 983 GiB avail; 0 B/s wr, 714 op/s; 26450/284140 objects misplaced (9.309%); 1.2 MiB/s, 19 objects/s recovering 2024-04-01T20:01:27.886 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:27.886 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:01:27.987 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:01:28.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:27 smithi062 ceph-mon[44211]: pgmap v2111: 17 pgs: 3 active+remapped+backfilling, 3 peering, 11 active+clean; 8.7 GiB data, 24 GiB used, 960 GiB / 983 GiB avail; 0 B/s wr, 714 op/s; 26450/284140 objects misplaced (9.309%); 1.2 MiB/s, 19 objects/s recovering 2024-04-01T20:01:28.066 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:28.094 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:01:28.118 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:28.118 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:01:28.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:27 smithi188 ceph-mon[43939]: pgmap v2111: 17 pgs: 3 active+remapped+backfilling, 3 peering, 11 active+clean; 8.7 GiB data, 24 GiB used, 960 GiB / 983 GiB avail; 0 B/s wr, 714 op/s; 26450/284140 objects misplaced (9.309%); 1.2 MiB/s, 19 objects/s recovering 2024-04-01T20:01:28.132 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_historic_ops 2024-04-01T20:01:28.219 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:01:28.259 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:28.296 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:01:28.300 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:28.300 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:01:28.401 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:01:28.438 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:28.638 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T20:01:28.797 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:01:28.800 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:28.801 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:01:28.857 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T20:01:28.902 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:01:28.938 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:29.018 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:01:29.025 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:29.026 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:01:29.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:28 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3784730960' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:01:29.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:28 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3784730960' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:01:29.126 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:01:29.180 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:28 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3784730960' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:01:29.190 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:30.016 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:29 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:01:30.017 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:29 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3784730960' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T20:01:30.017 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:29 smithi062 ceph-mon[44211]: osdmap e774: 12 total, 12 up, 11 in 2024-04-01T20:01:30.017 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:29 smithi062 ceph-mon[44211]: pgmap v2113: 17 pgs: 5 active+remapped+backfilling, 1 peering, 11 active+clean; 8.6 GiB data, 24 GiB used, 960 GiB / 983 GiB avail; 0 B/s wr, 731 op/s; 42948/282378 objects misplaced (15.209%); 11 MiB/s, 173 objects/s recovering 2024-04-01T20:01:30.054 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 7, 9, 11, 8, 6, 1] out_osds: [10] dead_osds: [] live_osds: [0, 2, 3, 4, 5, 7, 9, 11, 8, 6, 1, 10] 2024-04-01T20:01:30.055 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-01T20:01:30.055 INFO:tasks.thrashosds.thrasher:Removing osd 3, in_osds are: [0, 2, 3, 4, 5, 7, 9, 11, 8, 6, 1] 2024-04-01T20:01:30.055 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd out 3 2024-04-01T20:01:30.075 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:01:30.079 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:30.080 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:01:30.097 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:29 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:01:30.097 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:29 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3784730960' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T20:01:30.097 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:29 smithi022 ceph-mon[39439]: osdmap e774: 12 total, 12 up, 11 in 2024-04-01T20:01:30.097 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:29 smithi022 ceph-mon[39439]: pgmap v2113: 17 pgs: 5 active+remapped+backfilling, 1 peering, 11 active+clean; 8.6 GiB data, 24 GiB used, 960 GiB / 983 GiB avail; 0 B/s wr, 731 op/s; 42948/282378 objects misplaced (15.209%); 11 MiB/s, 173 objects/s recovering 2024-04-01T20:01:30.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:29 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:01:30.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:29 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3784730960' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T20:01:30.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:29 smithi188 ceph-mon[43939]: osdmap e774: 12 total, 12 up, 11 in 2024-04-01T20:01:30.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:29 smithi188 ceph-mon[43939]: pgmap v2113: 17 pgs: 5 active+remapped+backfilling, 1 peering, 11 active+clean; 8.6 GiB data, 24 GiB used, 960 GiB / 983 GiB avail; 0 B/s wr, 731 op/s; 42948/282378 objects misplaced (15.209%); 11 MiB/s, 173 objects/s recovering 2024-04-01T20:01:30.180 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:01:30.223 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:30.240 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:01:30.267 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:01:30.269 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:01:30.277 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:30.277 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:01:30.298 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:01:30.329 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T20:01:30.358 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:01:30.378 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:01:30.395 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:01:30.416 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:30.435 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:01:30.440 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:01:30.443 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:30.444 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:01:30.458 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:01:30.486 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:01:30.516 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:01:30.542 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:01:30.544 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:01:30.570 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T20:01:30.582 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:30.599 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:01:30.601 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:01:30.601 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:01:30.601 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:01:30.601 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T20:01:30.602 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:01:30.602 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:01:30.602 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:01:30.602 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:01:30.602 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:01:30.602 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:01:30.602 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T20:01:30.602 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:01:30.609 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:01:30.617 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:30.618 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:01:30.719 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:01:30.756 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:30.791 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T20:01:30.792 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 20, 2024-04-01T20:01:30.792 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 600, 2024-04-01T20:01:30.792 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-04-01T20:01:30.792 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.792 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:136582 9.d 9:bda52011:::benchmark_data_smithi188_173515_object136581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e763)", 2024-04-01T20:01:30.792 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:00:50.009998+0000", 2024-04-01T20:01:30.792 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.779580070999998, 2024-04-01T20:01:30.792 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.146264963, 2024-04-01T20:01:30.792 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:01:30.792 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:01:30.792 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:01:30.792 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:01:30.792 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:01:30.792 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:01:30.793 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 136582 2024-04-01T20:01:30.793 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.793 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:01:30.793 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.793 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:01:30.793 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:50.009998+0000", 2024-04-01T20:01:30.793 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.793 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.793 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.793 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:01:30.793 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:50.009998+0000", 2024-04-01T20:01:30.793 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.793 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.793 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.793 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:01:30.793 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:50.010001+0000", 2024-04-01T20:01:30.794 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.4150000000000002e-06 2024-04-01T20:01:30.794 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.794 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.794 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:01:30.794 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:50.010052+0000", 2024-04-01T20:01:30.794 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1606e-05 2024-04-01T20:01:30.794 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.794 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.794 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:01:30.794 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:50.010065+0000", 2024-04-01T20:01:30.794 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2478e-05 2024-04-01T20:01:30.794 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.794 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.794 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:01:30.795 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:50.010072+0000", 2024-04-01T20:01:30.795 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.4479999999999997e-06 2024-04-01T20:01:30.795 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.795 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.795 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:01:30.795 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:50.042886+0000", 2024-04-01T20:01:30.795 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.032813121000000001 2024-04-01T20:01:30.795 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.795 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.795 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:01:30.795 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:50.043021+0000", 2024-04-01T20:01:30.795 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013595999999999999 2024-04-01T20:01:30.795 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.795 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.795 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 5", 2024-04-01T20:01:30.796 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:50.043168+0000", 2024-04-01T20:01:30.796 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014658499999999999 2024-04-01T20:01:30.796 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.796 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.796 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:01:30.796 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:50.050884+0000", 2024-04-01T20:01:30.796 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0077156530000000003 2024-04-01T20:01:30.796 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.796 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.796 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:01:30.796 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:50.156176+0000", 2024-04-01T20:01:30.796 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.105292169 2024-04-01T20:01:30.796 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.796 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.797 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:01:30.797 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:50.156214+0000", 2024-04-01T20:01:30.797 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.7880999999999999e-05 2024-04-01T20:01:30.797 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.797 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.797 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:01:30.797 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:50.156263+0000", 2024-04-01T20:01:30.797 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9647000000000001e-05 2024-04-01T20:01:30.797 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.797 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:01:30.797 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.797 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.797 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.797 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:137417 9.d 9:b447ebc0:::benchmark_data_smithi188_173515_object137416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e763)", 2024-04-01T20:01:30.797 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:00:50.920737+0000", 2024-04-01T20:01:30.798 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 39.868841513, 2024-04-01T20:01:30.798 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.14089523300000001, 2024-04-01T20:01:30.798 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:01:30.798 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:01:30.798 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:01:30.798 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:01:30.798 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:01:30.798 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:01:30.798 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 137417 2024-04-01T20:01:30.798 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.799 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:01:30.799 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.799 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:01:30.799 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:50.920737+0000", 2024-04-01T20:01:30.799 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.799 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.799 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.799 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:01:30.799 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:50.920737+0000", 2024-04-01T20:01:30.799 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.799 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.799 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.800 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:01:30.800 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:50.920738+0000", 2024-04-01T20:01:30.800 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.5199999999999995e-07 2024-04-01T20:01:30.800 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.800 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.800 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:01:30.801 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:50.920799+0000", 2024-04-01T20:01:30.801 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.1354999999999998e-05 2024-04-01T20:01:30.801 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.801 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.801 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:01:30.801 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:50.920807+0000", 2024-04-01T20:01:30.801 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9820000000000008e-06 2024-04-01T20:01:30.801 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.801 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.802 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:01:30.802 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:50.920813+0000", 2024-04-01T20:01:30.802 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.1020000000000002e-06 2024-04-01T20:01:30.802 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.802 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.802 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:01:30.802 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.015384+0000", 2024-04-01T20:01:30.802 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.094570540999999994 2024-04-01T20:01:30.802 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.802 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.802 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:01:30.802 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.015542+0000", 2024-04-01T20:01:30.802 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000158271 2024-04-01T20:01:30.802 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.803 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.803 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 5", 2024-04-01T20:01:30.803 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.015642+0000", 2024-04-01T20:01:30.803 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.9998e-05 2024-04-01T20:01:30.803 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.803 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.803 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:01:30.803 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.024197+0000", 2024-04-01T20:01:30.803 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0085550060000000004 2024-04-01T20:01:30.803 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.803 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.803 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:01:30.803 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.061501+0000", 2024-04-01T20:01:30.803 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.037304235999999998 2024-04-01T20:01:30.803 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.804 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.804 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:01:30.804 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.061552+0000", 2024-04-01T20:01:30.804 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.0222999999999997e-05 2024-04-01T20:01:30.804 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.804 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.804 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:01:30.804 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.061632+0000", 2024-04-01T20:01:30.804 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0667000000000005e-05 2024-04-01T20:01:30.804 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.804 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:01:30.804 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.804 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.804 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.805 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:137418 9.d 9:b1dc9d83:::benchmark_data_smithi188_173515_object137417:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e763)", 2024-04-01T20:01:30.805 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:00:50.921795+0000", 2024-04-01T20:01:30.805 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 39.867783906, 2024-04-01T20:01:30.805 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.139905798, 2024-04-01T20:01:30.805 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:01:30.805 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:01:30.805 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:01:30.805 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:01:30.805 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:01:30.805 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:01:30.805 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 137418 2024-04-01T20:01:30.806 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.806 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:01:30.806 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.806 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:01:30.806 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:50.921795+0000", 2024-04-01T20:01:30.806 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.806 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.806 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.806 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:01:30.806 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:50.921795+0000", 2024-04-01T20:01:30.806 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.806 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.806 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.806 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:01:30.807 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:50.921796+0000", 2024-04-01T20:01:30.807 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.212e-06 2024-04-01T20:01:30.807 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.807 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.807 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:01:30.807 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:50.921863+0000", 2024-04-01T20:01:30.807 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6696e-05 2024-04-01T20:01:30.807 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.807 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.807 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:01:30.807 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:50.921871+0000", 2024-04-01T20:01:30.807 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.3489999999999992e-06 2024-04-01T20:01:30.807 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.807 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.807 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:01:30.807 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:50.921877+0000", 2024-04-01T20:01:30.808 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2600000000000002e-06 2024-04-01T20:01:30.808 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.808 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.808 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:01:30.808 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.019964+0000", 2024-04-01T20:01:30.808 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.098086729999999997 2024-04-01T20:01:30.808 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.808 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.808 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:01:30.808 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.020100+0000", 2024-04-01T20:01:30.808 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013578099999999999 2024-04-01T20:01:30.808 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.808 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.808 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 5", 2024-04-01T20:01:30.808 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.020271+0000", 2024-04-01T20:01:30.809 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000171523 2024-04-01T20:01:30.809 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.809 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.809 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:01:30.809 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.046392+0000", 2024-04-01T20:01:30.809 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.026120754999999999 2024-04-01T20:01:30.809 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.809 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.809 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:01:30.809 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.061640+0000", 2024-04-01T20:01:30.809 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.015248456000000001 2024-04-01T20:01:30.809 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.809 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.809 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:01:30.809 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.061671+0000", 2024-04-01T20:01:30.810 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.0369999999999999e-05 2024-04-01T20:01:30.810 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.810 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.810 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:01:30.810 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.061700+0000", 2024-04-01T20:01:30.810 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.9666e-05 2024-04-01T20:01:30.810 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.810 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:01:30.810 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.810 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.810 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.810 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:137711 9.d 9:b51b13d5:::benchmark_data_smithi188_173515_object137710:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e763)", 2024-04-01T20:01:30.811 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:00:51.295912+0000", 2024-04-01T20:01:30.811 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 39.493666973000003, 2024-04-01T20:01:30.811 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.13798676400000001, 2024-04-01T20:01:30.811 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:01:30.811 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:01:30.811 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:01:30.811 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:01:30.811 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:01:30.811 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:01:30.811 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 137711 2024-04-01T20:01:30.811 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.811 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:01:30.811 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.811 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:01:30.811 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.295912+0000", 2024-04-01T20:01:30.812 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.812 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.812 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.812 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:01:30.812 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.295912+0000", 2024-04-01T20:01:30.812 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.812 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.812 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.812 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:01:30.812 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.295912+0000", 2024-04-01T20:01:30.812 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.7700000000000004e-07 2024-04-01T20:01:30.812 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.812 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.812 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:01:30.812 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.295976+0000", 2024-04-01T20:01:30.813 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3723e-05 2024-04-01T20:01:30.813 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.813 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.813 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:01:30.813 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.295981+0000", 2024-04-01T20:01:30.813 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1800000000000004e-06 2024-04-01T20:01:30.813 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.813 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.813 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:01:30.813 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.295985+0000", 2024-04-01T20:01:30.813 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.0840000000000002e-06 2024-04-01T20:01:30.813 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.813 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.814 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:01:30.814 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.335874+0000", 2024-04-01T20:01:30.814 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.039889170000000002 2024-04-01T20:01:30.814 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.814 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.814 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:01:30.815 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.336002+0000", 2024-04-01T20:01:30.815 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000127835 2024-04-01T20:01:30.815 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.815 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.815 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 5", 2024-04-01T20:01:30.816 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.336135+0000", 2024-04-01T20:01:30.816 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013295599999999999 2024-04-01T20:01:30.816 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.816 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.816 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:01:30.816 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.340555+0000", 2024-04-01T20:01:30.816 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0044201190000000001 2024-04-01T20:01:30.816 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.816 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.816 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:01:30.816 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.433779+0000", 2024-04-01T20:01:30.816 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.093223977 2024-04-01T20:01:30.816 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.817 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.817 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:01:30.817 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.433838+0000", 2024-04-01T20:01:30.817 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.9018999999999999e-05 2024-04-01T20:01:30.817 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.817 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.817 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:01:30.817 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.433898+0000", 2024-04-01T20:01:30.817 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.9923999999999998e-05 2024-04-01T20:01:30.817 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.817 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:01:30.817 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.817 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.817 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.818 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:137933 9.d 9:ba390f18:::benchmark_data_smithi188_173515_object137932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e763)", 2024-04-01T20:01:30.818 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:00:51.570032+0000", 2024-04-01T20:01:30.818 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 39.219546665000003, 2024-04-01T20:01:30.818 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.147172624, 2024-04-01T20:01:30.818 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:01:30.818 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:01:30.818 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:01:30.818 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:01:30.818 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:01:30.818 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:01:30.818 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 137933 2024-04-01T20:01:30.818 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.818 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:01:30.819 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.819 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:01:30.819 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.570032+0000", 2024-04-01T20:01:30.819 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.819 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.819 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.819 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:01:30.819 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.570032+0000", 2024-04-01T20:01:30.819 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.819 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.819 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.819 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:01:30.819 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.570033+0000", 2024-04-01T20:01:30.819 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.44e-06 2024-04-01T20:01:30.820 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.820 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.820 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:01:30.820 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.570085+0000", 2024-04-01T20:01:30.820 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1539000000000002e-05 2024-04-01T20:01:30.820 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.820 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.820 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:01:30.820 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.570098+0000", 2024-04-01T20:01:30.820 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.3447e-05 2024-04-01T20:01:30.820 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.820 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.820 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:01:30.820 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.570107+0000", 2024-04-01T20:01:30.821 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.4999999999999999e-06 2024-04-01T20:01:30.821 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.821 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.821 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:01:30.821 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.594390+0000", 2024-04-01T20:01:30.821 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.024283119999999998 2024-04-01T20:01:30.821 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.821 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.821 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:01:30.821 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.594538+0000", 2024-04-01T20:01:30.821 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000148014 2024-04-01T20:01:30.821 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.821 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.821 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 5", 2024-04-01T20:01:30.821 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.594710+0000", 2024-04-01T20:01:30.822 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00017179599999999999 2024-04-01T20:01:30.822 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.822 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.822 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:01:30.822 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.599816+0000", 2024-04-01T20:01:30.822 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0051059950000000003 2024-04-01T20:01:30.822 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.822 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.822 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:01:30.822 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.717090+0000", 2024-04-01T20:01:30.822 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.11727433700000001 2024-04-01T20:01:30.822 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.822 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.822 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:01:30.823 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.717141+0000", 2024-04-01T20:01:30.823 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1439e-05 2024-04-01T20:01:30.823 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.823 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.823 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:01:30.823 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:51.717204+0000", 2024-04-01T20:01:30.823 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2996999999999993e-05 2024-04-01T20:01:30.823 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.823 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:01:30.823 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.823 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.823 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.823 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:144340 9.d 9:b767ed63:::benchmark_data_smithi188_173515_object144339:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e764)", 2024-04-01T20:01:30.823 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:00:59.168076+0000", 2024-04-01T20:01:30.823 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 31.621502916000001, 2024-04-01T20:01:30.823 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.170542472, 2024-04-01T20:01:30.824 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:01:30.824 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:01:30.824 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:01:30.824 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:01:30.824 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:01:30.824 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:01:30.824 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 144340 2024-04-01T20:01:30.824 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.824 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:01:30.824 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.824 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:01:30.824 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.168076+0000", 2024-04-01T20:01:30.824 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.824 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.824 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.825 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:01:30.825 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.168076+0000", 2024-04-01T20:01:30.825 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.825 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.825 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.825 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:01:30.825 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.168078+0000", 2024-04-01T20:01:30.825 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.238e-06 2024-04-01T20:01:30.825 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.825 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.825 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:01:30.825 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.168107+0000", 2024-04-01T20:01:30.825 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8971000000000001e-05 2024-04-01T20:01:30.825 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.825 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.825 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:01:30.826 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.168116+0000", 2024-04-01T20:01:30.826 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.2590000000000006e-06 2024-04-01T20:01:30.826 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.826 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.826 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:01:30.826 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.168122+0000", 2024-04-01T20:01:30.826 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.4119999999999998e-06 2024-04-01T20:01:30.826 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.826 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.826 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:01:30.826 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.184965+0000", 2024-04-01T20:01:30.826 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.016842665 2024-04-01T20:01:30.826 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.826 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.827 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:01:30.827 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.185102+0000", 2024-04-01T20:01:30.827 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013685699999999999 2024-04-01T20:01:30.827 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.827 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.827 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 5", 2024-04-01T20:01:30.827 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.185245+0000", 2024-04-01T20:01:30.827 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014345699999999999 2024-04-01T20:01:30.827 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.827 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.827 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:01:30.827 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.194884+0000", 2024-04-01T20:01:30.827 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0096387250000000008 2024-04-01T20:01:30.827 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.827 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.828 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:01:30.828 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.338498+0000", 2024-04-01T20:01:30.828 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.143613463 2024-04-01T20:01:30.828 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.828 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.828 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:01:30.828 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.338556+0000", 2024-04-01T20:01:30.828 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8511999999999998e-05 2024-04-01T20:01:30.828 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.828 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.828 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:01:30.828 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.338618+0000", 2024-04-01T20:01:30.828 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.1913000000000002e-05 2024-04-01T20:01:30.828 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.828 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:01:30.829 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.829 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.829 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.829 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:144351 9.d 9:b20803d5:::benchmark_data_smithi188_173515_object144350:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e764)", 2024-04-01T20:01:30.829 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:00:59.182211+0000", 2024-04-01T20:01:30.829 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 31.607367352000001, 2024-04-01T20:01:30.829 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.15663912799999999, 2024-04-01T20:01:30.829 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:01:30.829 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:01:30.829 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:01:30.829 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:01:30.829 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:01:30.829 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:01:30.829 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 144351 2024-04-01T20:01:30.829 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.830 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:01:30.830 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.830 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:01:30.830 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.182211+0000", 2024-04-01T20:01:30.830 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.830 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.830 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.830 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:01:30.830 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.182211+0000", 2024-04-01T20:01:30.830 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.830 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.830 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.830 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:01:30.830 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.182213+0000", 2024-04-01T20:01:30.831 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.5600000000000001e-06 2024-04-01T20:01:30.831 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.831 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.831 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:01:30.831 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.182277+0000", 2024-04-01T20:01:30.831 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3808999999999998e-05 2024-04-01T20:01:30.831 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.831 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.831 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:01:30.831 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.182285+0000", 2024-04-01T20:01:30.831 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.4770000000000003e-06 2024-04-01T20:01:30.831 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.831 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.831 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:01:30.831 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.182291+0000", 2024-04-01T20:01:30.832 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.1460000000000001e-06 2024-04-01T20:01:30.832 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.832 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.832 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:01:30.832 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.190067+0000", 2024-04-01T20:01:30.832 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.007776112 2024-04-01T20:01:30.832 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.832 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.832 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:01:30.832 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.190206+0000", 2024-04-01T20:01:30.832 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013832699999999999 2024-04-01T20:01:30.832 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.832 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.832 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 5", 2024-04-01T20:01:30.832 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.190362+0000", 2024-04-01T20:01:30.832 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000156212 2024-04-01T20:01:30.833 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.833 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.833 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:01:30.833 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.197159+0000", 2024-04-01T20:01:30.833 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0067967899999999996 2024-04-01T20:01:30.833 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.833 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.833 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:01:30.833 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.338748+0000", 2024-04-01T20:01:30.833 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.14158958699999999 2024-04-01T20:01:30.833 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.833 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.833 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:01:30.834 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.338801+0000", 2024-04-01T20:01:30.834 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2339000000000002e-05 2024-04-01T20:01:30.834 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.834 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.834 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:01:30.834 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.338850+0000", 2024-04-01T20:01:30.834 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.9768999999999997e-05 2024-04-01T20:01:30.834 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.834 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:01:30.834 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.834 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.834 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.834 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:144418 9.d 9:b114a9fe:::benchmark_data_smithi188_173515_object144417:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e764)", 2024-04-01T20:01:30.834 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:00:59.255810+0000", 2024-04-01T20:01:30.835 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 31.533768359, 2024-04-01T20:01:30.835 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.14340724599999999, 2024-04-01T20:01:30.835 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:01:30.835 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:01:30.835 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:01:30.835 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:01:30.835 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:01:30.835 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:01:30.835 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 144418 2024-04-01T20:01:30.835 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.835 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:01:30.835 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.835 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:01:30.835 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.255810+0000", 2024-04-01T20:01:30.835 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.835 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.836 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.836 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:01:30.836 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.255810+0000", 2024-04-01T20:01:30.836 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.836 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.836 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.836 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:01:30.836 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.255812+0000", 2024-04-01T20:01:30.836 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.7710000000000001e-06 2024-04-01T20:01:30.836 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.836 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.836 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:01:30.836 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.255864+0000", 2024-04-01T20:01:30.836 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1643e-05 2024-04-01T20:01:30.836 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.837 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.837 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:01:30.837 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.255873+0000", 2024-04-01T20:01:30.837 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.7939999999999997e-06 2024-04-01T20:01:30.837 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.837 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.837 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:01:30.837 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.255881+0000", 2024-04-01T20:01:30.837 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.0630000000000006e-06 2024-04-01T20:01:30.837 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.837 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.837 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:01:30.837 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.340296+0000", 2024-04-01T20:01:30.837 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.084414219999999998 2024-04-01T20:01:30.837 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.838 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.838 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:01:30.838 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.340432+0000", 2024-04-01T20:01:30.838 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013645700000000001 2024-04-01T20:01:30.838 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.838 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.838 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 5", 2024-04-01T20:01:30.838 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.340631+0000", 2024-04-01T20:01:30.838 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00019881799999999999 2024-04-01T20:01:30.838 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.838 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.838 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:01:30.838 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.362960+0000", 2024-04-01T20:01:30.838 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.022328982000000001 2024-04-01T20:01:30.839 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.839 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.839 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:01:30.839 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.399058+0000", 2024-04-01T20:01:30.839 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.03609805 2024-04-01T20:01:30.839 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.839 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.839 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:01:30.839 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.399130+0000", 2024-04-01T20:01:30.839 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.2268999999999995e-05 2024-04-01T20:01:30.839 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.839 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.840 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:01:30.840 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.399217+0000", 2024-04-01T20:01:30.840 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.7179e-05 2024-04-01T20:01:30.840 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.840 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:01:30.840 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.840 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.840 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.840 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:144425 9.d 9:bb36421b:::benchmark_data_smithi188_173515_object144424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e764)", 2024-04-01T20:01:30.840 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:00:59.270882+0000", 2024-04-01T20:01:30.840 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 31.518696630000001, 2024-04-01T20:01:30.840 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.22886659100000001, 2024-04-01T20:01:30.840 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:01:30.840 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:01:30.840 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:01:30.841 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:01:30.841 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:01:30.841 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:01:30.841 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 144425 2024-04-01T20:01:30.841 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.841 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:01:30.841 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.841 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:01:30.841 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.270882+0000", 2024-04-01T20:01:30.841 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.841 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.841 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.842 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:01:30.842 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.270882+0000", 2024-04-01T20:01:30.842 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.842 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.842 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.842 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:01:30.842 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.270883+0000", 2024-04-01T20:01:30.842 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.7000000000000003e-07 2024-04-01T20:01:30.842 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.842 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.842 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:01:30.842 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.270921+0000", 2024-04-01T20:01:30.842 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.8105999999999997e-05 2024-04-01T20:01:30.842 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.842 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.843 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:01:30.843 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.270930+0000", 2024-04-01T20:01:30.843 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.8400000000000001e-06 2024-04-01T20:01:30.843 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.843 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.843 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:01:30.843 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.270936+0000", 2024-04-01T20:01:30.843 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.0750000000000003e-06 2024-04-01T20:01:30.843 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.843 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.843 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:01:30.843 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.346570+0000", 2024-04-01T20:01:30.843 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.075634542999999999 2024-04-01T20:01:30.843 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.843 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.843 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:01:30.844 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.346721+0000", 2024-04-01T20:01:30.844 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000150292 2024-04-01T20:01:30.844 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.844 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.844 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 5", 2024-04-01T20:01:30.844 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.347523+0000", 2024-04-01T20:01:30.844 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000802401 2024-04-01T20:01:30.844 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.844 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.844 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:01:30.844 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.362965+0000", 2024-04-01T20:01:30.844 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.015442252 2024-04-01T20:01:30.844 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.844 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.844 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:01:30.845 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.499630+0000", 2024-04-01T20:01:30.845 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.13666476299999999 2024-04-01T20:01:30.845 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.845 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.845 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:01:30.845 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.499690+0000", 2024-04-01T20:01:30.845 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.9913e-05 2024-04-01T20:01:30.845 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.845 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.845 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:01:30.845 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.499748+0000", 2024-04-01T20:01:30.845 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8536000000000003e-05 2024-04-01T20:01:30.845 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.845 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:01:30.845 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.845 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.846 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.846 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:144450 9.d 9:b6ab4734:::benchmark_data_smithi188_173515_object144449:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e764)", 2024-04-01T20:01:30.846 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:00:59.297550+0000", 2024-04-01T20:01:30.846 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 31.492028632, 2024-04-01T20:01:30.846 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.202348852, 2024-04-01T20:01:30.846 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:01:30.846 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:01:30.846 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:01:30.846 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:01:30.846 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:01:30.846 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:01:30.846 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 144450 2024-04-01T20:01:30.846 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.846 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:01:30.846 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.847 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:01:30.847 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.297550+0000", 2024-04-01T20:01:30.847 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.847 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.847 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.847 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:01:30.847 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.297550+0000", 2024-04-01T20:01:30.847 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.847 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.847 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.847 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:01:30.847 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.297551+0000", 2024-04-01T20:01:30.847 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.545e-06 2024-04-01T20:01:30.847 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.847 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.848 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:01:30.848 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.297628+0000", 2024-04-01T20:01:30.848 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.6180000000000006e-05 2024-04-01T20:01:30.848 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.848 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.848 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:01:30.848 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.297639+0000", 2024-04-01T20:01:30.848 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1539000000000001e-05 2024-04-01T20:01:30.848 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.848 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.848 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:01:30.848 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.297647+0000", 2024-04-01T20:01:30.848 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9889999999999992e-06 2024-04-01T20:01:30.849 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.849 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.849 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:01:30.849 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.353690+0000", 2024-04-01T20:01:30.849 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.05604278 2024-04-01T20:01:30.849 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.849 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.849 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:01:30.849 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.353840+0000", 2024-04-01T20:01:30.849 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000149829 2024-04-01T20:01:30.849 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.849 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.849 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 5", 2024-04-01T20:01:30.849 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.353991+0000", 2024-04-01T20:01:30.849 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00015155799999999999 2024-04-01T20:01:30.849 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.850 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.850 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:01:30.850 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.362971+0000", 2024-04-01T20:01:30.850 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0089794060000000005 2024-04-01T20:01:30.850 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.850 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.850 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:01:30.850 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.499801+0000", 2024-04-01T20:01:30.850 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.13683020700000001 2024-04-01T20:01:30.850 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.850 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.850 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:01:30.850 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.499847+0000", 2024-04-01T20:01:30.850 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6362000000000001e-05 2024-04-01T20:01:30.851 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.851 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.851 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:01:30.851 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.499899+0000", 2024-04-01T20:01:30.851 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1456999999999999e-05 2024-04-01T20:01:30.851 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.851 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:01:30.851 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.851 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.851 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.851 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:144452 9.d 9:b8862b67:::benchmark_data_smithi188_173515_object144451:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e764)", 2024-04-01T20:01:30.851 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:00:59.298313+0000", 2024-04-01T20:01:30.851 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 31.491265927000001, 2024-04-01T20:01:30.851 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.201728082, 2024-04-01T20:01:30.851 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:01:30.852 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:01:30.852 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:01:30.852 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:01:30.852 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:01:30.852 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:01:30.852 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 144452 2024-04-01T20:01:30.852 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.852 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:01:30.852 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.852 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:01:30.852 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.298313+0000", 2024-04-01T20:01:30.852 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.852 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.852 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.852 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:01:30.853 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.298313+0000", 2024-04-01T20:01:30.853 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.853 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.853 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.853 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:01:30.853 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.298323+0000", 2024-04-01T20:01:30.853 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0254999999999999e-05 2024-04-01T20:01:30.853 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.853 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.853 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:01:30.853 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.298360+0000", 2024-04-01T20:01:30.853 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.6909000000000002e-05 2024-04-01T20:01:30.853 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.853 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.853 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:01:30.854 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.298375+0000", 2024-04-01T20:01:30.854 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.4766999999999999e-05 2024-04-01T20:01:30.854 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.854 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.854 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:01:30.854 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.298384+0000", 2024-04-01T20:01:30.854 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.0420000000000008e-06 2024-04-01T20:01:30.854 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.854 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.854 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:01:30.854 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.358745+0000", 2024-04-01T20:01:30.854 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.060361006000000002 2024-04-01T20:01:30.854 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.854 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.855 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:01:30.855 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.358861+0000", 2024-04-01T20:01:30.855 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00011615799999999999 2024-04-01T20:01:30.855 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.855 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.855 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 5", 2024-04-01T20:01:30.855 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.358962+0000", 2024-04-01T20:01:30.855 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000101641 2024-04-01T20:01:30.855 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.855 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.855 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:01:30.855 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.387125+0000", 2024-04-01T20:01:30.855 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.028162920000000001 2024-04-01T20:01:30.855 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.855 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.856 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:01:30.856 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.499939+0000", 2024-04-01T20:01:30.856 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.112813749 2024-04-01T20:01:30.856 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.856 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.856 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:01:30.856 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.499992+0000", 2024-04-01T20:01:30.856 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.3356999999999998e-05 2024-04-01T20:01:30.856 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.857 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.857 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:01:30.857 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:00:59.500041+0000", 2024-04-01T20:01:30.857 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8278000000000001e-05 2024-04-01T20:01:30.857 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.857 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:01:30.857 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.857 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.857 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.857 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:145306 9.d 9:bde508a1:::benchmark_data_smithi188_173515_object145305:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e764)", 2024-04-01T20:01:30.858 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:01:00.210133+0000", 2024-04-01T20:01:30.858 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 30.579445789000001, 2024-04-01T20:01:30.858 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.140475188, 2024-04-01T20:01:30.858 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:01:30.858 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:01:30.858 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:01:30.858 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:01:30.858 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:01:30.858 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:01:30.859 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 145306 2024-04-01T20:01:30.859 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.859 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:01:30.859 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.859 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:01:30.859 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.210133+0000", 2024-04-01T20:01:30.859 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.859 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.859 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.859 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:01:30.859 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.210133+0000", 2024-04-01T20:01:30.859 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.859 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.859 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.859 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:01:30.859 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.210134+0000", 2024-04-01T20:01:30.860 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.5600000000000004e-07 2024-04-01T20:01:30.860 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.860 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.860 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:01:30.860 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.210162+0000", 2024-04-01T20:01:30.860 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.8466000000000002e-05 2024-04-01T20:01:30.860 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.860 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.860 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:01:30.860 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.210169+0000", 2024-04-01T20:01:30.860 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.199e-06 2024-04-01T20:01:30.860 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.860 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.860 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:01:30.861 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.210176+0000", 2024-04-01T20:01:30.861 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.9399999999999996e-06 2024-04-01T20:01:30.861 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.861 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.861 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:01:30.861 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.310227+0000", 2024-04-01T20:01:30.861 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.100050396 2024-04-01T20:01:30.861 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.861 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.861 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:01:30.861 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.310377+0000", 2024-04-01T20:01:30.861 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00015037300000000001 2024-04-01T20:01:30.861 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.861 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.861 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 5", 2024-04-01T20:01:30.861 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.310542+0000", 2024-04-01T20:01:30.862 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00016474600000000001 2024-04-01T20:01:30.862 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.862 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.862 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:01:30.862 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.315735+0000", 2024-04-01T20:01:30.862 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0051927379999999997 2024-04-01T20:01:30.862 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.862 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.862 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:01:30.862 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.350486+0000", 2024-04-01T20:01:30.862 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.034751226000000003 2024-04-01T20:01:30.862 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.862 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.862 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:01:30.863 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.350544+0000", 2024-04-01T20:01:30.863 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8341000000000003e-05 2024-04-01T20:01:30.863 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.863 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.863 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:01:30.863 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.350608+0000", 2024-04-01T20:01:30.863 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3806999999999994e-05 2024-04-01T20:01:30.863 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.863 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:01:30.863 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.863 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.863 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.863 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:145397 9.d 9:b569d815:::benchmark_data_smithi188_173515_object145396:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e764)", 2024-04-01T20:01:30.863 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:01:00.314682+0000", 2024-04-01T20:01:30.863 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 30.47489659, 2024-04-01T20:01:30.864 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.172405274, 2024-04-01T20:01:30.864 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:01:30.864 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:01:30.864 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:01:30.864 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:01:30.864 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:01:30.864 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:01:30.864 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 145397 2024-04-01T20:01:30.864 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.864 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:01:30.864 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.864 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:01:30.864 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.314682+0000", 2024-04-01T20:01:30.864 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.864 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.865 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.865 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:01:30.865 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.314682+0000", 2024-04-01T20:01:30.865 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.865 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.865 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.865 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:01:30.865 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.314684+0000", 2024-04-01T20:01:30.865 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.6789999999999999e-06 2024-04-01T20:01:30.865 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.865 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.865 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:01:30.865 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.314743+0000", 2024-04-01T20:01:30.865 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.9243999999999997e-05 2024-04-01T20:01:30.865 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.866 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.866 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:01:30.866 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.314755+0000", 2024-04-01T20:01:30.866 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.1945e-05 2024-04-01T20:01:30.866 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.866 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.866 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:01:30.866 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.314773+0000", 2024-04-01T20:01:30.866 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.8110000000000001e-05 2024-04-01T20:01:30.866 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.866 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.866 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:01:30.866 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.351057+0000", 2024-04-01T20:01:30.866 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.036284196999999997 2024-04-01T20:01:30.867 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.867 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.867 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:01:30.867 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.351218+0000", 2024-04-01T20:01:30.867 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00016085399999999999 2024-04-01T20:01:30.867 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.867 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.867 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 5", 2024-04-01T20:01:30.867 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.351376+0000", 2024-04-01T20:01:30.867 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000158319 2024-04-01T20:01:30.867 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.867 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.867 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:01:30.867 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.366302+0000", 2024-04-01T20:01:30.868 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.01492577 2024-04-01T20:01:30.868 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.868 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.868 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:01:30.868 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.486947+0000", 2024-04-01T20:01:30.868 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.120644655 2024-04-01T20:01:30.868 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.868 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.868 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:01:30.868 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.487008+0000", 2024-04-01T20:01:30.868 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.1291000000000007e-05 2024-04-01T20:01:30.868 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.868 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.868 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:01:30.868 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.487087+0000", 2024-04-01T20:01:30.868 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.9209999999999995e-05 2024-04-01T20:01:30.869 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.869 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:01:30.869 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.869 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.869 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.869 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:145405 9.d 9:ba37bd5d:::benchmark_data_smithi188_173515_object145404:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e764)", 2024-04-01T20:01:30.869 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:01:00.328352+0000", 2024-04-01T20:01:30.869 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 30.461226687, 2024-04-01T20:01:30.869 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.15889392899999999, 2024-04-01T20:01:30.869 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:01:30.869 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:01:30.869 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:01:30.869 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:01:30.869 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:01:30.869 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:01:30.870 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 145405 2024-04-01T20:01:30.870 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.870 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:01:30.870 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.870 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:01:30.870 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.328352+0000", 2024-04-01T20:01:30.870 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.870 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.870 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.870 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:01:30.871 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.328352+0000", 2024-04-01T20:01:30.871 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.871 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.871 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.871 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:01:30.871 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.328353+0000", 2024-04-01T20:01:30.872 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.2109999999999999e-06 2024-04-01T20:01:30.872 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.872 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.872 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:01:30.872 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.328400+0000", 2024-04-01T20:01:30.873 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6516e-05 2024-04-01T20:01:30.873 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.873 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.873 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:01:30.873 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.328408+0000", 2024-04-01T20:01:30.873 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.8279999999999992e-06 2024-04-01T20:01:30.874 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.874 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.874 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:01:30.874 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.328414+0000", 2024-04-01T20:01:30.874 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1950000000000002e-06 2024-04-01T20:01:30.874 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.875 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.875 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:01:30.875 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.355449+0000", 2024-04-01T20:01:30.875 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.027035152 2024-04-01T20:01:30.875 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.875 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.876 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:01:30.876 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.355576+0000", 2024-04-01T20:01:30.876 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012703599999999999 2024-04-01T20:01:30.876 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.876 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.876 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 5", 2024-04-01T20:01:30.876 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.355726+0000", 2024-04-01T20:01:30.877 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00015038700000000001 2024-04-01T20:01:30.877 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.877 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.877 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:01:30.877 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.366309+0000", 2024-04-01T20:01:30.877 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.010582754 2024-04-01T20:01:30.878 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.878 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.878 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:01:30.878 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.487134+0000", 2024-04-01T20:01:30.878 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.12082513 2024-04-01T20:01:30.878 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.878 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.878 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:01:30.878 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.487190+0000", 2024-04-01T20:01:30.878 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.6328e-05 2024-04-01T20:01:30.878 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.879 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.879 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:01:30.879 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.487246+0000", 2024-04-01T20:01:30.879 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.5392000000000001e-05 2024-04-01T20:01:30.879 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.879 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:01:30.879 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.879 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.879 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.879 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:145467 9.d 9:bf500c7a:::benchmark_data_smithi188_173515_object145466:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e764)", 2024-04-01T20:01:30.879 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:01:00.392811+0000", 2024-04-01T20:01:30.879 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 30.396767046000001, 2024-04-01T20:01:30.879 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.15090851799999999, 2024-04-01T20:01:30.879 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:01:30.880 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:01:30.880 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:01:30.880 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:01:30.880 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:01:30.880 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:01:30.880 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 145467 2024-04-01T20:01:30.880 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.880 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:01:30.880 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.880 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:01:30.880 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.392811+0000", 2024-04-01T20:01:30.880 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.880 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.880 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.880 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:01:30.880 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.392811+0000", 2024-04-01T20:01:30.881 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.881 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.881 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.881 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:01:30.881 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.392812+0000", 2024-04-01T20:01:30.881 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.95e-07 2024-04-01T20:01:30.881 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.881 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.881 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:01:30.881 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.392870+0000", 2024-04-01T20:01:30.881 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.7982000000000002e-05 2024-04-01T20:01:30.881 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.881 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.881 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:01:30.881 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.392878+0000", 2024-04-01T20:01:30.882 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.7419999999999997e-06 2024-04-01T20:01:30.882 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.882 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.882 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:01:30.882 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.392883+0000", 2024-04-01T20:01:30.882 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6859999999999997e-06 2024-04-01T20:01:30.882 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.882 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.882 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:01:30.882 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.494389+0000", 2024-04-01T20:01:30.882 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.10150577199999999 2024-04-01T20:01:30.882 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.882 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.883 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:01:30.883 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.494491+0000", 2024-04-01T20:01:30.883 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000102678 2024-04-01T20:01:30.883 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.883 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.883 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 5", 2024-04-01T20:01:30.883 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.494591+0000", 2024-04-01T20:01:30.883 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000100111 2024-04-01T20:01:30.883 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.883 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.883 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:01:30.883 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.523664+0000", 2024-04-01T20:01:30.883 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.029072938999999999 2024-04-01T20:01:30.883 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.883 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.884 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:01:30.884 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.543620+0000", 2024-04-01T20:01:30.884 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.019955285 2024-04-01T20:01:30.884 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.884 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.884 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:01:30.884 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.543668+0000", 2024-04-01T20:01:30.884 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8238000000000001e-05 2024-04-01T20:01:30.884 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.884 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.884 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:01:30.884 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.543720+0000", 2024-04-01T20:01:30.884 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.2089999999999998e-05 2024-04-01T20:01:30.884 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.884 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:01:30.885 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.885 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.885 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.885 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:145615 9.d 9:bbd6ae3a:::benchmark_data_smithi188_173515_object145614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e764)", 2024-04-01T20:01:30.885 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:01:00.555922+0000", 2024-04-01T20:01:30.885 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 30.233656916000001, 2024-04-01T20:01:30.885 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.13810402299999999, 2024-04-01T20:01:30.885 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:01:30.885 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:01:30.885 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:01:30.885 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:01:30.885 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:01:30.885 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:01:30.885 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 145615 2024-04-01T20:01:30.886 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.886 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:01:30.886 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.886 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:01:30.886 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.555922+0000", 2024-04-01T20:01:30.886 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.886 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.886 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.886 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:01:30.886 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.555922+0000", 2024-04-01T20:01:30.886 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.887 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.887 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.887 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:01:30.887 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.555923+0000", 2024-04-01T20:01:30.887 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0359999999999999e-06 2024-04-01T20:01:30.887 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.887 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.887 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:01:30.887 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.560673+0000", 2024-04-01T20:01:30.887 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0047505669999999998 2024-04-01T20:01:30.887 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.888 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.888 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:01:30.888 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.560683+0000", 2024-04-01T20:01:30.888 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.3170000000000008e-06 2024-04-01T20:01:30.888 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.888 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.888 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:01:30.888 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.560689+0000", 2024-04-01T20:01:30.888 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.7279999999999998e-06 2024-04-01T20:01:30.888 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.888 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.888 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:01:30.888 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.647003+0000", 2024-04-01T20:01:30.888 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.086313968000000005 2024-04-01T20:01:30.888 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.889 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.889 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:01:30.889 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.647151+0000", 2024-04-01T20:01:30.889 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000147725 2024-04-01T20:01:30.889 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.889 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.889 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 5", 2024-04-01T20:01:30.889 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.647292+0000", 2024-04-01T20:01:30.889 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014125800000000001 2024-04-01T20:01:30.889 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.889 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.889 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:01:30.889 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.662713+0000", 2024-04-01T20:01:30.889 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.015421284 2024-04-01T20:01:30.889 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.890 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.890 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:01:30.890 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.693904+0000", 2024-04-01T20:01:30.890 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.031190114000000001 2024-04-01T20:01:30.890 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.890 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.890 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:01:30.890 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.693963+0000", 2024-04-01T20:01:30.890 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.9168e-05 2024-04-01T20:01:30.890 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.890 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.890 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:01:30.890 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:00.694026+0000", 2024-04-01T20:01:30.891 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2858e-05 2024-04-01T20:01:30.891 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.891 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:01:30.891 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.891 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.891 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.891 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:146702 9.d 9:be6ac90e:::benchmark_data_smithi188_173515_object146701:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e764)", 2024-04-01T20:01:30.891 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:01:01.748349+0000", 2024-04-01T20:01:30.891 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 29.041229340000001, 2024-04-01T20:01:30.891 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.17493521100000001, 2024-04-01T20:01:30.891 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:01:30.891 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:01:30.891 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:01:30.891 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:01:30.891 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:01:30.892 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:01:30.892 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 146702 2024-04-01T20:01:30.892 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.892 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:01:30.892 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.892 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:01:30.892 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.748349+0000", 2024-04-01T20:01:30.892 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.892 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.892 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.892 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:01:30.892 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.748349+0000", 2024-04-01T20:01:30.892 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.892 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.893 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.893 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:01:30.893 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.748352+0000", 2024-04-01T20:01:30.893 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.5770000000000001e-06 2024-04-01T20:01:30.893 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.893 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.893 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:01:30.893 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.748406+0000", 2024-04-01T20:01:30.893 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.4738999999999999e-05 2024-04-01T20:01:30.893 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.893 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.893 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:01:30.893 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.748416+0000", 2024-04-01T20:01:30.893 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.7140000000000005e-06 2024-04-01T20:01:30.893 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.894 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.894 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:01:30.894 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.748425+0000", 2024-04-01T20:01:30.894 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.003e-06 2024-04-01T20:01:30.894 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.894 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.894 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:01:30.894 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.763472+0000", 2024-04-01T20:01:30.894 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.015046534 2024-04-01T20:01:30.894 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.894 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.894 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:01:30.894 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.763600+0000", 2024-04-01T20:01:30.895 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00012803399999999999 2024-04-01T20:01:30.895 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.895 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.895 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 5", 2024-04-01T20:01:30.895 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.763744+0000", 2024-04-01T20:01:30.895 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00014396400000000001 2024-04-01T20:01:30.895 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.895 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.895 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:01:30.895 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.768635+0000", 2024-04-01T20:01:30.895 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0048911060000000001 2024-04-01T20:01:30.895 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.895 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.895 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:01:30.895 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.923144+0000", 2024-04-01T20:01:30.896 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.15450952300000001 2024-04-01T20:01:30.896 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.896 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.896 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:01:30.896 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.923211+0000", 2024-04-01T20:01:30.896 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.6957000000000003e-05 2024-04-01T20:01:30.896 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.896 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.896 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:01:30.896 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.923284+0000", 2024-04-01T20:01:30.896 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.3059999999999995e-05 2024-04-01T20:01:30.896 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.896 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:01:30.896 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.896 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.896 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.897 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:146729 9.d 9:b03c7c27:::benchmark_data_smithi188_173515_object146728:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e764)", 2024-04-01T20:01:30.897 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:01:01.779587+0000", 2024-04-01T20:01:30.897 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 29.009991603, 2024-04-01T20:01:30.897 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.143890352, 2024-04-01T20:01:30.897 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:01:30.897 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:01:30.897 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:01:30.897 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:01:30.897 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:01:30.897 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:01:30.898 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 146729 2024-04-01T20:01:30.898 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.898 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:01:30.898 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.898 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:01:30.898 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.779587+0000", 2024-04-01T20:01:30.898 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.898 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.898 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.898 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:01:30.898 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.779587+0000", 2024-04-01T20:01:30.898 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.898 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.898 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.899 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:01:30.899 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.779589+0000", 2024-04-01T20:01:30.899 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.092e-06 2024-04-01T20:01:30.899 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.899 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.899 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:01:30.899 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.779647+0000", 2024-04-01T20:01:30.899 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.8273000000000003e-05 2024-04-01T20:01:30.899 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.899 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.899 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:01:30.899 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.779658+0000", 2024-04-01T20:01:30.899 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.0865e-05 2024-04-01T20:01:30.899 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.899 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.900 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:01:30.900 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.779666+0000", 2024-04-01T20:01:30.900 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 8.1019999999999997e-06 2024-04-01T20:01:30.900 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.900 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.900 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:01:30.900 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.779897+0000", 2024-04-01T20:01:30.900 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00023054099999999999 2024-04-01T20:01:30.900 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.900 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.900 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:01:30.900 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.780002+0000", 2024-04-01T20:01:30.900 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00010474700000000001 2024-04-01T20:01:30.900 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.901 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.901 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 5", 2024-04-01T20:01:30.901 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.780132+0000", 2024-04-01T20:01:30.901 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013088499999999999 2024-04-01T20:01:30.901 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.901 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.901 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:01:30.901 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.788800+0000", 2024-04-01T20:01:30.901 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0086674479999999995 2024-04-01T20:01:30.901 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.901 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.901 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:01:30.901 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.923351+0000", 2024-04-01T20:01:30.901 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.13455078200000001 2024-04-01T20:01:30.901 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.902 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.902 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:01:30.902 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.923415+0000", 2024-04-01T20:01:30.902 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.3948999999999994e-05 2024-04-01T20:01:30.902 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.902 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.902 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:01:30.902 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.923477+0000", 2024-04-01T20:01:30.902 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 6.2668000000000004e-05 2024-04-01T20:01:30.902 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.902 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:01:30.902 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.902 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.902 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.903 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:146770 9.d 9:b4b13c82:::benchmark_data_smithi188_173515_object146769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e764)", 2024-04-01T20:01:30.903 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:01:01.814555+0000", 2024-04-01T20:01:30.903 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 28.975023226000001, 2024-04-01T20:01:30.903 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.15049605699999999, 2024-04-01T20:01:30.903 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:01:30.903 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:01:30.903 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:01:30.903 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:01:30.903 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:01:30.903 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:01:30.903 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 146770 2024-04-01T20:01:30.903 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.903 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:01:30.903 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.903 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:01:30.904 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.814555+0000", 2024-04-01T20:01:30.904 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.904 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.904 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.904 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:01:30.904 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.814555+0000", 2024-04-01T20:01:30.904 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.904 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.904 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.904 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:01:30.904 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.814557+0000", 2024-04-01T20:01:30.904 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 2.0880000000000002e-06 2024-04-01T20:01:30.904 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.905 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.905 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:01:30.905 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.814600+0000", 2024-04-01T20:01:30.905 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.2749e-05 2024-04-01T20:01:30.905 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.905 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.906 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:30 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3693950242' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:01:30.907 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:30.907 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:30.907 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:30.907 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:30.907 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:30.907 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:30.907 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:30 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:30.907 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:30 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:01:30.907 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:30 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:01:30.907 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:01:30.907 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.814616+0000", 2024-04-01T20:01:30.907 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.5743000000000002e-05 2024-04-01T20:01:30.907 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.908 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.908 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:01:30.908 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.814625+0000", 2024-04-01T20:01:30.908 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.2690000000000005e-06 2024-04-01T20:01:30.908 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.908 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.908 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:01:30.908 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.925968+0000", 2024-04-01T20:01:30.908 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.111342434 2024-04-01T20:01:30.908 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.908 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.908 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:01:30.908 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.926099+0000", 2024-04-01T20:01:30.908 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00013114600000000001 2024-04-01T20:01:30.908 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.908 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.909 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 5", 2024-04-01T20:01:30.909 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.926260+0000", 2024-04-01T20:01:30.909 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00016132599999999999 2024-04-01T20:01:30.909 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.909 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.909 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:01:30.909 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.944111+0000", 2024-04-01T20:01:30.909 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.017850580000000001 2024-04-01T20:01:30.909 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.909 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.909 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:01:30.909 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.964953+0000", 2024-04-01T20:01:30.909 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.020841934999999999 2024-04-01T20:01:30.909 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.909 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.910 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:01:30.910 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.965005+0000", 2024-04-01T20:01:30.910 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 5.1975000000000003e-05 2024-04-01T20:01:30.910 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.910 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.910 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:01:30.910 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.965051+0000", 2024-04-01T20:01:30.911 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.6811999999999998e-05 2024-04-01T20:01:30.911 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.911 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:01:30.911 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.911 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.911 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.911 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "osd_op(client.27358.0:146780 9.d 9:b7251ee5:::benchmark_data_smithi188_173515_object146779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected e764)", 2024-04-01T20:01:30.912 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2024-04-01T20:01:01.827871+0000", 2024-04-01T20:01:30.912 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 28.961707468, 2024-04-01T20:01:30.912 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.13730827800000001, 2024-04-01T20:01:30.912 INFO:teuthology.orchestra.run.smithi062.stdout: "continuous": false, 2024-04-01T20:01:30.912 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2024-04-01T20:01:30.912 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:01:30.912 INFO:teuthology.orchestra.run.smithi062.stdout: "client_info": { 2024-04-01T20:01:30.913 INFO:teuthology.orchestra.run.smithi062.stdout: "client": "client.27358", 2024-04-01T20:01:30.913 INFO:teuthology.orchestra.run.smithi062.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:01:30.913 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 146780 2024-04-01T20:01:30.913 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.913 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2024-04-01T20:01:30.913 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.913 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated", 2024-04-01T20:01:30.914 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.827871+0000", 2024-04-01T20:01:30.914 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.914 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.914 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.914 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read", 2024-04-01T20:01:30.914 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.827871+0000", 2024-04-01T20:01:30.914 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0 2024-04-01T20:01:30.915 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.915 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.915 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled", 2024-04-01T20:01:30.915 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.827872+0000", 2024-04-01T20:01:30.915 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 7.2399999999999997e-07 2024-04-01T20:01:30.915 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.915 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.916 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read", 2024-04-01T20:01:30.916 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.827904+0000", 2024-04-01T20:01:30.916 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.1936000000000001e-05 2024-04-01T20:01:30.916 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.916 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.916 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched", 2024-04-01T20:01:30.917 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.827909+0000", 2024-04-01T20:01:30.917 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.8239999999999999e-06 2024-04-01T20:01:30.917 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.917 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.917 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "queued_for_pg", 2024-04-01T20:01:30.917 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.827912+0000", 2024-04-01T20:01:30.917 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 3.692e-06 2024-04-01T20:01:30.918 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.918 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.918 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "reached_pg", 2024-04-01T20:01:30.918 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.930441+0000", 2024-04-01T20:01:30.918 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.102528417 2024-04-01T20:01:30.918 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.918 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.918 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "started", 2024-04-01T20:01:30.919 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.930541+0000", 2024-04-01T20:01:30.919 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.000100086 2024-04-01T20:01:30.919 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.919 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.919 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "waiting for subops from 5", 2024-04-01T20:01:30.919 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.930639+0000", 2024-04-01T20:01:30.919 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 9.8259999999999998e-05 2024-04-01T20:01:30.919 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.919 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.919 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "op_commit", 2024-04-01T20:01:30.919 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.944119+0000", 2024-04-01T20:01:30.919 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.013479664000000001 2024-04-01T20:01:30.919 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.919 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.920 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:01:30.920 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.965087+0000", 2024-04-01T20:01:30.920 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.020968587 2024-04-01T20:01:30.920 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.920 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.920 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "commit_sent", 2024-04-01T20:01:30.920 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.965135+0000", 2024-04-01T20:01:30.920 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.7797000000000003e-05 2024-04-01T20:01:30.920 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-04-01T20:01:30.920 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-04-01T20:01:30.920 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done", 2024-04-01T20:01:30.920 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2024-04-01T20:01:01.965179+0000", 2024-04-01T20:01:30.920 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 4.4291e-05 2024-04-01T20:01:30.921 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.921 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:01:30.921 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.921 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-04-01T20:01:30.921 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-04-01T20:01:30.921 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T20:01:31.057 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:30 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3693950242' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:01:31.057 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:31.058 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:31.058 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:31.058 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:31.058 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:31.058 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:31.058 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:30 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:31.058 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:30 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:01:31.058 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:30 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:01:31.251 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:30 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3693950242' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:01:31.251 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:31.251 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:31.251 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:31.252 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:31.252 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:31.252 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:31.252 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:30 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:31.252 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:30 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:01:31.252 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:30 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:01:31.523 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:01:31.534 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:31.534 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:01:31.635 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:01:31.661 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_ops_in_flight 2024-04-01T20:01:31.667 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:31.700 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:01:31.707 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:31.707 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:01:31.808 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:01:31.862 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T20:01:31.870 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:31.908 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:01:31.913 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:31.913 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:01:32.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:32.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:32.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:32.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:32.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:32.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:31 smithi062 ceph-mon[44211]: osdmap e775: 12 total, 12 up, 11 in 2024-04-01T20:01:32.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:31 smithi062 ceph-mon[44211]: pgmap v2115: 17 pgs: 6 active+remapped+backfilling, 11 active+clean; 8.5 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 0 B/s wr, 833 op/s; 48643/277072 objects misplaced (17.556%); 35 MiB/s, 565 objects/s recovering 2024-04-01T20:01:32.014 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:01:32.052 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:32.078 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T20:01:32.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:32.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:32.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:32.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:32.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:32.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:31 smithi022 ceph-mon[39439]: osdmap e775: 12 total, 12 up, 11 in 2024-04-01T20:01:32.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:31 smithi022 ceph-mon[39439]: pgmap v2115: 17 pgs: 6 active+remapped+backfilling, 11 active+clean; 8.5 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 0 B/s wr, 833 op/s; 48643/277072 objects misplaced (17.556%); 35 MiB/s, 565 objects/s recovering 2024-04-01T20:01:32.128 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:32.128 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:32.128 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:32.128 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:32.128 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:32.128 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:31 smithi188 ceph-mon[43939]: osdmap e775: 12 total, 12 up, 11 in 2024-04-01T20:01:32.128 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:31 smithi188 ceph-mon[43939]: pgmap v2115: 17 pgs: 6 active+remapped+backfilling, 11 active+clean; 8.5 GiB data, 23 GiB used, 960 GiB / 983 GiB avail; 0 B/s wr, 833 op/s; 48643/277072 objects misplaced (17.556%); 35 MiB/s, 565 objects/s recovering 2024-04-01T20:01:32.527 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:01:32.534 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:32.535 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:01:32.636 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:01:32.664 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:33.122 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:01:33.469 INFO:teuthology.orchestra.run.smithi022.stderr:marked out osd.3. 2024-04-01T20:01:33.744 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:33 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/976543292' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["3"]}]: dispatch 2024-04-01T20:01:33.744 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:33 smithi188 ceph-mon[43939]: Client client.admin marked osd.3 out, while it was still marked up 2024-04-01T20:01:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:33 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/976543292' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["3"]}]: dispatch 2024-04-01T20:01:33.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:33 smithi062 ceph-mon[44211]: Client client.admin marked osd.3 out, while it was still marked up 2024-04-01T20:01:33.822 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:01:33.825 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:33.826 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:01:33.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:33 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[39416]: 2024-04-01T20:01:33.409+0000 7fd025a9f700 -1 mon.a@0(leader).osd e775 definitely_dead 0 2024-04-01T20:01:33.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:33 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/976543292' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["3"]}]: dispatch 2024-04-01T20:01:33.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:33 smithi022 ceph-mon[39439]: Client client.admin marked osd.3 out, while it was still marked up 2024-04-01T20:01:33.927 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:01:33.966 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:01:34.176 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:34.176 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:01:34.277 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:01:34.306 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:34.406 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:01:34.409 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:34.409 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:01:34.480 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T20:01:34.510 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:01:34.537 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:34.567 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:01:34.585 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:34.585 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:01:34.686 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:01:34.725 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:34.752 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:01:34.755 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:34 smithi062 ceph-mon[44211]: pgmap v2116: 17 pgs: 6 active+remapped+backfilling, 11 active+clean; 8.4 GiB data, 24 GiB used, 960 GiB / 983 GiB avail; 0 B/s wr, 771 op/s; 47571/275278 objects misplaced (17.281%); 34 MiB/s, 547 objects/s recovering 2024-04-01T20:01:34.755 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:34 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/976543292' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["3"]}]': finished 2024-04-01T20:01:34.755 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:34 smithi062 ceph-mon[44211]: osdmap e776: 12 total, 12 up, 10 in 2024-04-01T20:01:34.755 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:34 smithi062 ceph-mon[44211]: osdmap e777: 12 total, 12 up, 10 in 2024-04-01T20:01:34.756 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:34.756 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:01:34.857 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:01:34.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:34 smithi022 ceph-mon[39439]: pgmap v2116: 17 pgs: 6 active+remapped+backfilling, 11 active+clean; 8.4 GiB data, 24 GiB used, 960 GiB / 983 GiB avail; 0 B/s wr, 771 op/s; 47571/275278 objects misplaced (17.281%); 34 MiB/s, 547 objects/s recovering 2024-04-01T20:01:34.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:34 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/976543292' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["3"]}]': finished 2024-04-01T20:01:34.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:34 smithi022 ceph-mon[39439]: osdmap e776: 12 total, 12 up, 10 in 2024-04-01T20:01:34.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:34 smithi022 ceph-mon[39439]: osdmap e777: 12 total, 12 up, 10 in 2024-04-01T20:01:34.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:34 smithi188 ceph-mon[43939]: pgmap v2116: 17 pgs: 6 active+remapped+backfilling, 11 active+clean; 8.4 GiB data, 24 GiB used, 960 GiB / 983 GiB avail; 0 B/s wr, 771 op/s; 47571/275278 objects misplaced (17.281%); 34 MiB/s, 547 objects/s recovering 2024-04-01T20:01:34.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:34 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/976543292' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["3"]}]': finished 2024-04-01T20:01:34.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:34 smithi188 ceph-mon[43939]: osdmap e776: 12 total, 12 up, 10 in 2024-04-01T20:01:34.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:34 smithi188 ceph-mon[43939]: osdmap e777: 12 total, 12 up, 10 in 2024-04-01T20:01:34.891 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:35.233 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:01:35.246 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:01:35.252 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:35.253 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:01:35.353 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:01:35.383 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:35.407 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:01:35.412 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:35.412 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:01:35.513 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:01:35.548 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:35.579 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:01:35.582 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:35.583 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:01:35.683 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:01:35.721 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:36.068 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T20:01:36.068 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T20:01:36.069 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.069 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.27358.0:177376 9.f e778/772 9:fab048cb:::benchmark_data_smithi188_173515_object21291:head v 778'10869, mlcod=778'10866)", 2024-04-01T20:01:36.069 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T20:01:36.066081+0000", 2024-04-01T20:01:36.069 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.003803636, 2024-04-01T20:01:36.069 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0038340359999999999, 2024-04-01T20:01:36.069 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:01:36.069 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:01:36.069 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-01T20:01:36.069 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:01:36.069 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.069 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:01:36.069 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:01:36.066081+0000", 2024-04-01T20:01:36.069 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:01:36.069 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:01:36.069 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.070 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:01:36.070 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:01:36.066081+0000", 2024-04-01T20:01:36.070 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:01:36.070 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:01:36.070 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.070 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:01:36.070 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:01:36.066082+0000", 2024-04-01T20:01:36.070 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2890000000000001e-06 2024-04-01T20:01:36.070 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:01:36.070 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.070 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:01:36.070 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:01:36.066090+0000", 2024-04-01T20:01:36.070 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6590000000000007e-06 2024-04-01T20:01:36.071 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:01:36.071 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.071 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:01:36.071 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:01:36.066098+0000", 2024-04-01T20:01:36.071 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7639999999999994e-06 2024-04-01T20:01:36.071 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:01:36.071 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.071 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:01:36.071 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:01:36.066105+0000", 2024-04-01T20:01:36.071 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.336e-06 2024-04-01T20:01:36.071 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:01:36.071 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.071 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:01:36.071 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:01:36.066150+0000", 2024-04-01T20:01:36.071 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5422e-05 2024-04-01T20:01:36.072 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:01:36.072 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.072 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T20:01:36.072 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:01:36.066173+0000", 2024-04-01T20:01:36.072 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3146000000000002e-05 2024-04-01T20:01:36.072 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:01:36.072 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:01:36.072 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:01:36.072 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:01:36.072 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.072 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.27358.0:177385 9.2 e778/772 9:4820cf51:::benchmark_data_smithi188_173515_object21300:head v 778'11081, mlcod=778'11079)", 2024-04-01T20:01:36.072 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T20:01:36.069024+0000", 2024-04-01T20:01:36.072 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.000860738, 2024-04-01T20:01:36.072 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000967945, 2024-04-01T20:01:36.072 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:01:36.073 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:01:36.073 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-01T20:01:36.073 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:01:36.073 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.073 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:01:36.073 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:01:36.069024+0000", 2024-04-01T20:01:36.073 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:01:36.073 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:01:36.073 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.073 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:01:36.073 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:01:36.069024+0000", 2024-04-01T20:01:36.073 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:01:36.073 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:01:36.073 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.073 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:01:36.073 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:01:36.069025+0000", 2024-04-01T20:01:36.074 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.083e-06 2024-04-01T20:01:36.074 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:01:36.074 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.074 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:01:36.074 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:01:36.069032+0000", 2024-04-01T20:01:36.074 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9299999999999997e-06 2024-04-01T20:01:36.074 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:01:36.074 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.074 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:01:36.074 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:01:36.069038+0000", 2024-04-01T20:01:36.074 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8510000000000001e-06 2024-04-01T20:01:36.074 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:01:36.075 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.075 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:01:36.075 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:01:36.069045+0000", 2024-04-01T20:01:36.075 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9909999999999996e-06 2024-04-01T20:01:36.075 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:01:36.075 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.075 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:01:36.075 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:01:36.069095+0000", 2024-04-01T20:01:36.075 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9660000000000002e-05 2024-04-01T20:01:36.075 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:01:36.075 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.075 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T20:01:36.075 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:01:36.069117+0000", 2024-04-01T20:01:36.076 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1869999999999999e-05 2024-04-01T20:01:36.076 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:01:36.076 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:01:36.076 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:01:36.076 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:01:36.076 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.076 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "MOSDPGPush(9.c 778/777 [PushOp(9:302c8dd7:::benchmark_data_smithi188_173515_object135091:head, version: 761'8525, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(9:302c8dd7:::benchmark_data_smithi188_173515_object135091:head@761'8525, size: 65536, copy_subset: [(0, 65536)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 65536, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-04-01T20:01:36.076 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T20:01:36.069813+0000", 2024-04-01T20:01:36.076 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 7.1000000000000005e-05, 2024-04-01T20:01:36.076 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026252699999999998, 2024-04-01T20:01:36.076 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:01:36.076 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:01:36.076 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-01T20:01:36.076 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:01:36.076 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.077 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:01:36.077 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:01:36.069813+0000", 2024-04-01T20:01:36.077 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:01:36.077 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:01:36.077 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.077 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:01:36.077 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:01:36.069813+0000", 2024-04-01T20:01:36.077 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:01:36.077 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:01:36.077 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.077 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:01:36.077 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:01:36.069815+0000", 2024-04-01T20:01:36.077 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.714e-06 2024-04-01T20:01:36.077 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:01:36.077 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.078 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:01:36.078 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:01:36.069871+0000", 2024-04-01T20:01:36.078 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6276999999999997e-05 2024-04-01T20:01:36.078 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:01:36.078 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.078 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:01:36.078 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:01:36.069887+0000", 2024-04-01T20:01:36.078 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6257e-05 2024-04-01T20:01:36.078 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:01:36.078 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.078 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:01:36.078 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:01:36.069907+0000", 2024-04-01T20:01:36.078 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9833000000000001e-05 2024-04-01T20:01:36.078 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:01:36.079 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.079 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:01:36.079 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:01:36.070010+0000", 2024-04-01T20:01:36.079 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000102228 2024-04-01T20:01:36.079 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:01:36.079 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:01:36.079 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T20:01:36.079 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:01:36.070024+0000", 2024-04-01T20:01:36.079 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.403e-05 2024-04-01T20:01:36.079 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:01:36.079 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:01:36.079 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:01:36.079 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:01:36.079 INFO:teuthology.orchestra.run.smithi188.stdout: ], 2024-04-01T20:01:36.080 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 3 2024-04-01T20:01:36.080 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T20:01:36.377 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:01:36.382 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:36.382 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:01:36.483 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:01:36.537 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:36.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:36 smithi062 ceph-mon[44211]: pgmap v2119: 17 pgs: 1 remapped+peering, 1 peering, 6 active+remapped+backfilling, 9 active+clean; 8.3 GiB data, 21 GiB used, 873 GiB / 894 GiB avail; 0 B/s wr, 845 op/s; 43398/272224 objects misplaced (15.942%); 70 MiB/s, 1.11k objects/s recovering 2024-04-01T20:01:36.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:36 smithi062 ceph-mon[44211]: 9.3 starting backfill to osd.9 from (0'0,0'0] MAX to 775'11095 2024-04-01T20:01:36.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:36 smithi062 ceph-mon[44211]: osdmap e778: 12 total, 12 up, 10 in 2024-04-01T20:01:36.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:36 smithi062 ceph-mon[44211]: 9.c starting backfill to osd.9 from (0'0,0'0] MAX to 775'11132 2024-04-01T20:01:36.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:36 smithi062 ceph-mon[44211]: 9.7 starting backfill to osd.2 from (0'0,0'0] MAX to 775'11027 2024-04-01T20:01:36.767 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:36 smithi062 ceph-mon[44211]: 9.1 starting backfill to osd.6 from (0'0,0'0] MAX to 775'11100 2024-04-01T20:01:36.780 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:36 smithi022 ceph-mon[39439]: pgmap v2119: 17 pgs: 1 remapped+peering, 1 peering, 6 active+remapped+backfilling, 9 active+clean; 8.3 GiB data, 21 GiB used, 873 GiB / 894 GiB avail; 0 B/s wr, 845 op/s; 43398/272224 objects misplaced (15.942%); 70 MiB/s, 1.11k objects/s recovering 2024-04-01T20:01:36.780 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:36 smithi022 ceph-mon[39439]: 9.3 starting backfill to osd.9 from (0'0,0'0] MAX to 775'11095 2024-04-01T20:01:36.780 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:36 smithi022 ceph-mon[39439]: osdmap e778: 12 total, 12 up, 10 in 2024-04-01T20:01:36.780 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:36 smithi022 ceph-mon[39439]: 9.c starting backfill to osd.9 from (0'0,0'0] MAX to 775'11132 2024-04-01T20:01:36.780 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:36 smithi022 ceph-mon[39439]: 9.7 starting backfill to osd.2 from (0'0,0'0] MAX to 775'11027 2024-04-01T20:01:36.780 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:36 smithi022 ceph-mon[39439]: 9.1 starting backfill to osd.6 from (0'0,0'0] MAX to 775'11100 2024-04-01T20:01:36.817 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:36 smithi188 ceph-mon[43939]: pgmap v2119: 17 pgs: 1 remapped+peering, 1 peering, 6 active+remapped+backfilling, 9 active+clean; 8.3 GiB data, 21 GiB used, 873 GiB / 894 GiB avail; 0 B/s wr, 845 op/s; 43398/272224 objects misplaced (15.942%); 70 MiB/s, 1.11k objects/s recovering 2024-04-01T20:01:36.817 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:36 smithi188 ceph-mon[43939]: 9.3 starting backfill to osd.9 from (0'0,0'0] MAX to 775'11095 2024-04-01T20:01:36.817 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:36 smithi188 ceph-mon[43939]: osdmap e778: 12 total, 12 up, 10 in 2024-04-01T20:01:36.817 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:36 smithi188 ceph-mon[43939]: 9.c starting backfill to osd.9 from (0'0,0'0] MAX to 775'11132 2024-04-01T20:01:36.817 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:36 smithi188 ceph-mon[43939]: 9.7 starting backfill to osd.2 from (0'0,0'0] MAX to 775'11027 2024-04-01T20:01:36.817 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:36 smithi188 ceph-mon[43939]: 9.1 starting backfill to osd.6 from (0'0,0'0] MAX to 775'11100 2024-04-01T20:01:36.864 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_blocked_ops 2024-04-01T20:01:36.907 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:01:36.915 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:36.915 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:01:37.016 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:01:37.101 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:37.138 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:01:37.143 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:37.144 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:01:37.244 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:01:37.292 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:37.305 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T20:01:37.322 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:01:37.325 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:37.325 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:01:37.426 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:01:37.506 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:37.549 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:01:37.554 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:37.555 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:01:37.655 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:01:37.664 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:01:37.695 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:01:37.699 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:37.727 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:01:37.728 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:01:37.734 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:37.735 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:01:37.770 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T20:01:37.817 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:01:37.835 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:01:37.856 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:01:37.883 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:37.900 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:01:37.907 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:01:37.913 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:37.913 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:01:37.947 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:01:37.973 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:01:38.008 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:01:38.014 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:01:38.042 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T20:01:38.079 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:01:38.080 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:01:38.080 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:01:38.081 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:01:38.081 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T20:01:38.081 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:01:38.081 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:01:38.081 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:01:38.081 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:01:38.081 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:01:38.081 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:01:38.081 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T20:01:38.081 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:01:38.082 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:38.127 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:38.127 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:01:38.128 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:01:38.228 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:01:38.263 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:38.326 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:01:38.329 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:38.330 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:01:38.430 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:01:38.476 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:38.495 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:38 smithi062 ceph-mon[44211]: pgmap v2121: 17 pgs: 1 remapped+peering, 1 peering, 8 active+remapped+backfilling, 7 active+clean; 8.2 GiB data, 21 GiB used, 873 GiB / 894 GiB avail; 0 B/s wr, 634 op/s; 54706/269456 objects misplaced (20.302%); 98 MiB/s, 1.56k objects/s recovering 2024-04-01T20:01:38.495 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:38 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3020191861' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:01:38.495 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:38.495 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:38.495 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:38.495 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:38 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4280896547' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:01:38.496 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:38 smithi062 ceph-mon[44211]: from='client.37574 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:01:38.496 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:38.496 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:38.496 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:38 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:38.496 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T20:01:38.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:38 smithi022 ceph-mon[39439]: pgmap v2121: 17 pgs: 1 remapped+peering, 1 peering, 8 active+remapped+backfilling, 7 active+clean; 8.2 GiB data, 21 GiB used, 873 GiB / 894 GiB avail; 0 B/s wr, 634 op/s; 54706/269456 objects misplaced (20.302%); 98 MiB/s, 1.56k objects/s recovering 2024-04-01T20:01:38.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:38 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3020191861' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:01:38.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:38.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:38.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:38.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:38 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4280896547' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:01:38.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:38 smithi022 ceph-mon[39439]: from='client.37574 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:01:38.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:38.522 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:38.522 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:38 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:38.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:38 smithi188 ceph-mon[43939]: pgmap v2121: 17 pgs: 1 remapped+peering, 1 peering, 8 active+remapped+backfilling, 7 active+clean; 8.2 GiB data, 21 GiB used, 873 GiB / 894 GiB avail; 0 B/s wr, 634 op/s; 54706/269456 objects misplaced (20.302%); 98 MiB/s, 1.56k objects/s recovering 2024-04-01T20:01:38.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:38 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3020191861' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:01:38.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:38.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:38.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:38.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:38 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4280896547' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:01:38.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:38 smithi188 ceph-mon[43939]: from='client.37574 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:01:38.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:38.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:38.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:38 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:39.209 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 4, 5, 7, 9, 11, 8, 6, 1] out_osds: [10, 3] dead_osds: [] live_osds: [0, 2, 3, 4, 5, 7, 9, 11, 8, 6, 1, 10] 2024-04-01T20:01:39.210 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-01T20:01:39.210 INFO:tasks.thrashosds.thrasher:Removing osd 11, in_osds are: [0, 2, 4, 5, 7, 9, 11, 8, 6, 1] 2024-04-01T20:01:39.210 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd out 11 2024-04-01T20:01:39.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:39.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:39.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:39.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:39.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:39.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:39 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:39.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:39 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:01:39.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:39 smithi022 ceph-mon[39439]: from='client.37574 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T20:01:39.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:39 smithi022 ceph-mon[39439]: osdmap e779: 12 total, 12 up, 10 in 2024-04-01T20:01:39.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:39 smithi022 ceph-mon[39439]: pgmap v2123: 17 pgs: 1 remapped+peering, 9 active+remapped+backfilling, 7 active+clean; 8.2 GiB data, 21 GiB used, 873 GiB / 894 GiB avail; 0 B/s wr, 572 op/s; 59366/268436 objects misplaced (22.116%); 125 MiB/s, 2k objects/s recovering 2024-04-01T20:01:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:39.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:39.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:39.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:39.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:39 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:39.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:39 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:01:39.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:39 smithi062 ceph-mon[44211]: from='client.37574 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T20:01:39.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:39 smithi062 ceph-mon[44211]: osdmap e779: 12 total, 12 up, 10 in 2024-04-01T20:01:39.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:39 smithi062 ceph-mon[44211]: pgmap v2123: 17 pgs: 1 remapped+peering, 9 active+remapped+backfilling, 7 active+clean; 8.2 GiB data, 21 GiB used, 873 GiB / 894 GiB avail; 0 B/s wr, 572 op/s; 59366/268436 objects misplaced (22.116%); 125 MiB/s, 2k objects/s recovering 2024-04-01T20:01:39.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:39 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:39 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:01:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:39 smithi188 ceph-mon[43939]: from='client.37574 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T20:01:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:39 smithi188 ceph-mon[43939]: osdmap e779: 12 total, 12 up, 10 in 2024-04-01T20:01:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:39 smithi188 ceph-mon[43939]: pgmap v2123: 17 pgs: 1 remapped+peering, 9 active+remapped+backfilling, 7 active+clean; 8.2 GiB data, 21 GiB used, 873 GiB / 894 GiB avail; 0 B/s wr, 572 op/s; 59366/268436 objects misplaced (22.116%); 125 MiB/s, 2k objects/s recovering 2024-04-01T20:01:40.201 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:01:40.205 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:40.206 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:01:40.255 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:01:40.306 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:01:40.341 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:40.545 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:01:40.548 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:40.548 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:01:40.649 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:01:40.700 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:40.727 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:01:40.732 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:40.732 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:01:40.833 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:01:40.889 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:40.926 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:01:40.944 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:40.945 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:01:41.045 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:01:41.085 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:41.123 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:01:41.127 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:41.127 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:01:41.228 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:01:41.271 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:41.304 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:01:41.313 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:41.314 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:01:41.377 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T20:01:41.414 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:01:41.462 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:41.609 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:41 smithi022 ceph-mon[39439]: pgmap v2124: 17 pgs: 10 active+remapped+backfilling, 7 active+clean; 8.0 GiB data, 21 GiB used, 873 GiB / 894 GiB avail; 0 B/s wr, 747 op/s; 62499/263198 objects misplaced (23.746%); 129 MiB/s, 2.06k objects/s recovering 2024-04-01T20:01:41.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:41 smithi188 ceph-mon[43939]: pgmap v2124: 17 pgs: 10 active+remapped+backfilling, 7 active+clean; 8.0 GiB data, 21 GiB used, 873 GiB / 894 GiB avail; 0 B/s wr, 747 op/s; 62499/263198 objects misplaced (23.746%); 129 MiB/s, 2.06k objects/s recovering 2024-04-01T20:01:42.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:41 smithi062 ceph-mon[44211]: pgmap v2124: 17 pgs: 10 active+remapped+backfilling, 7 active+clean; 8.0 GiB data, 21 GiB used, 873 GiB / 894 GiB avail; 0 B/s wr, 747 op/s; 62499/263198 objects misplaced (23.746%); 129 MiB/s, 2.06k objects/s recovering 2024-04-01T20:01:42.023 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:01:42.296 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T20:01:42.350 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:01:42.354 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:42.355 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:01:42.456 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:01:42.500 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:42.589 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:01:42.593 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:42.594 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:01:42.695 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:01:42.749 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:42.801 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:01:42.805 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:42.806 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:01:42.907 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:01:42.979 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:42.985 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T20:01:42.985 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:01:43.010 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:01:43.014 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:43.015 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:01:43.116 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:01:43.150 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:43.805 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:01:43.808 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:43.809 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:01:43.910 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:01:43.940 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_historic_ops 2024-04-01T20:01:43.948 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:44.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:44 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[39416]: 2024-04-01T20:01:44.014+0000 7fd025a9f700 -1 mon.a@0(leader).osd e780 definitely_dead 0 2024-04-01T20:01:44.140 INFO:teuthology.orchestra.run.smithi022.stderr:marked out osd.11. 2024-04-01T20:01:44.308 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T20:01:44.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:44 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:01:44.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:44 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:01:44.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:44 smithi188 ceph-mon[43939]: osdmap e780: 12 total, 12 up, 10 in 2024-04-01T20:01:44.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:44 smithi188 ceph-mon[43939]: pgmap v2126: 17 pgs: 10 active+remapped+backfilling, 7 active+clean; 8.0 GiB data, 21 GiB used, 873 GiB / 894 GiB avail; 0 B/s wr, 631 op/s; 60925/262150 objects misplaced (23.241%); 110 MiB/s, 1.76k objects/s recovering 2024-04-01T20:01:44.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:44 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1911617898' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["11"]}]: dispatch 2024-04-01T20:01:44.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:44 smithi188 ceph-mon[43939]: Client client.admin marked osd.11 out, while it was still marked up 2024-04-01T20:01:44.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:44 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:01:44.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:44 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:01:44.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:44 smithi062 ceph-mon[44211]: osdmap e780: 12 total, 12 up, 10 in 2024-04-01T20:01:44.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:44 smithi062 ceph-mon[44211]: pgmap v2126: 17 pgs: 10 active+remapped+backfilling, 7 active+clean; 8.0 GiB data, 21 GiB used, 873 GiB / 894 GiB avail; 0 B/s wr, 631 op/s; 60925/262150 objects misplaced (23.241%); 110 MiB/s, 1.76k objects/s recovering 2024-04-01T20:01:44.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:44 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1911617898' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["11"]}]: dispatch 2024-04-01T20:01:44.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:44 smithi062 ceph-mon[44211]: Client client.admin marked osd.11 out, while it was still marked up 2024-04-01T20:01:44.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:44 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:01:44.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:44 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:01:44.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:44 smithi022 ceph-mon[39439]: osdmap e780: 12 total, 12 up, 10 in 2024-04-01T20:01:44.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:44 smithi022 ceph-mon[39439]: pgmap v2126: 17 pgs: 10 active+remapped+backfilling, 7 active+clean; 8.0 GiB data, 21 GiB used, 873 GiB / 894 GiB avail; 0 B/s wr, 631 op/s; 60925/262150 objects misplaced (23.241%); 110 MiB/s, 1.76k objects/s recovering 2024-04-01T20:01:44.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:44 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1911617898' entity='client.admin' cmd=[{"prefix": "osd out", "ids": ["11"]}]: dispatch 2024-04-01T20:01:44.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:44 smithi022 ceph-mon[39439]: Client client.admin marked osd.11 out, while it was still marked up 2024-04-01T20:01:45.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:45 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1911617898' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["11"]}]': finished 2024-04-01T20:01:45.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:45 smithi062 ceph-mon[44211]: osdmap e781: 12 total, 12 up, 9 in 2024-04-01T20:01:45.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:45 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1911617898' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["11"]}]': finished 2024-04-01T20:01:45.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:45 smithi022 ceph-mon[39439]: osdmap e781: 12 total, 12 up, 9 in 2024-04-01T20:01:45.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:45 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1911617898' entity='client.admin' cmd='[{"prefix": "osd out", "ids": ["11"]}]': finished 2024-04-01T20:01:45.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:45 smithi188 ceph-mon[43939]: osdmap e781: 12 total, 12 up, 9 in 2024-04-01T20:01:46.311 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:01:46.314 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:46.314 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:01:46.415 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:01:46.431 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:46 smithi188 ceph-mon[43939]: osdmap e782: 12 total, 12 up, 9 in 2024-04-01T20:01:46.431 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:46 smithi188 ceph-mon[43939]: pgmap v2129: 17 pgs: 10 active+remapped+backfilling, 7 active+clean; 7.9 GiB data, 19 GiB used, 786 GiB / 805 GiB avail; 0 B/s wr, 756 op/s; 55360/259352 objects misplaced (21.346%); 108 MiB/s, 1.73k objects/s recovering 2024-04-01T20:01:46.478 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:46 smithi062 ceph-mon[44211]: osdmap e782: 12 total, 12 up, 9 in 2024-04-01T20:01:46.478 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:46 smithi062 ceph-mon[44211]: pgmap v2129: 17 pgs: 10 active+remapped+backfilling, 7 active+clean; 7.9 GiB data, 19 GiB used, 786 GiB / 805 GiB avail; 0 B/s wr, 756 op/s; 55360/259352 objects misplaced (21.346%); 108 MiB/s, 1.73k objects/s recovering 2024-04-01T20:01:46.480 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:46.531 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:01:46.543 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:46.544 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:01:46.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:46 smithi022 ceph-mon[39439]: osdmap e782: 12 total, 12 up, 9 in 2024-04-01T20:01:46.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:46 smithi022 ceph-mon[39439]: pgmap v2129: 17 pgs: 10 active+remapped+backfilling, 7 active+clean; 7.9 GiB data, 19 GiB used, 786 GiB / 805 GiB avail; 0 B/s wr, 756 op/s; 55360/259352 objects misplaced (21.346%); 108 MiB/s, 1.73k objects/s recovering 2024-04-01T20:01:46.645 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:01:46.706 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:46.760 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:01:46.764 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:46.764 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:01:46.865 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:01:46.908 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:47.021 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:01:47.025 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:47.025 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:01:47.126 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:01:47.181 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:47 smithi062 ceph-mon[44211]: osdmap e783: 12 total, 12 up, 9 in 2024-04-01T20:01:47.181 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:47 smithi062 ceph-mon[44211]: 9.9 starting backfill to osd.6 from (0'0,0'0] MAX to 780'11544 2024-04-01T20:01:47.181 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:47 smithi062 ceph-mon[44211]: 9.5 starting backfill to osd.7 from (0'0,0'0] MAX to 780'11396 2024-04-01T20:01:47.181 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:47 smithi062 ceph-mon[44211]: 9.8 starting backfill to osd.5 from (0'0,0'0] MAX to 780'11336 2024-04-01T20:01:47.202 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:47.241 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:01:47.250 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:47.250 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:01:47.351 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:01:47.359 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:47 smithi188 ceph-mon[43939]: osdmap e783: 12 total, 12 up, 9 in 2024-04-01T20:01:47.359 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:47 smithi188 ceph-mon[43939]: 9.9 starting backfill to osd.6 from (0'0,0'0] MAX to 780'11544 2024-04-01T20:01:47.359 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:47 smithi188 ceph-mon[43939]: 9.5 starting backfill to osd.7 from (0'0,0'0] MAX to 780'11396 2024-04-01T20:01:47.359 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:47 smithi188 ceph-mon[43939]: 9.8 starting backfill to osd.5 from (0'0,0'0] MAX to 780'11336 2024-04-01T20:01:47.391 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:47.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:47 smithi022 ceph-mon[39439]: osdmap e783: 12 total, 12 up, 9 in 2024-04-01T20:01:47.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:47 smithi022 ceph-mon[39439]: 9.9 starting backfill to osd.6 from (0'0,0'0] MAX to 780'11544 2024-04-01T20:01:47.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:47 smithi022 ceph-mon[39439]: 9.5 starting backfill to osd.7 from (0'0,0'0] MAX to 780'11396 2024-04-01T20:01:47.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:47 smithi022 ceph-mon[39439]: 9.8 starting backfill to osd.5 from (0'0,0'0] MAX to 780'11336 2024-04-01T20:01:48.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:48 smithi062 ceph-mon[44211]: pgmap v2131: 17 pgs: 1 active+remapped+backfill_wait, 1 remapped+peering, 11 active+remapped+backfilling, 4 active+clean; 7.8 GiB data, 19 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 657 op/s; 64424/256460 objects misplaced (25.120%); 162 MiB/s, 2.59k objects/s recovering 2024-04-01T20:01:48.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:48 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:01:48.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:48 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:01:48.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:48 smithi022 ceph-mon[39439]: pgmap v2131: 17 pgs: 1 active+remapped+backfill_wait, 1 remapped+peering, 11 active+remapped+backfilling, 4 active+clean; 7.8 GiB data, 19 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 657 op/s; 64424/256460 objects misplaced (25.120%); 162 MiB/s, 2.59k objects/s recovering 2024-04-01T20:01:48.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:48 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:01:48.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:48 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:01:48.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:48 smithi188 ceph-mon[43939]: pgmap v2131: 17 pgs: 1 active+remapped+backfill_wait, 1 remapped+peering, 11 active+remapped+backfilling, 4 active+clean; 7.8 GiB data, 19 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 657 op/s; 64424/256460 objects misplaced (25.120%); 162 MiB/s, 2.59k objects/s recovering 2024-04-01T20:01:48.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:48 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:01:48.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:48 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:01:48.946 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:01:48.949 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:48.950 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:01:49.051 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:01:49.119 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:49.152 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:01:49.159 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:49.160 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:01:49.261 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:01:49.304 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:49.334 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:01:49.339 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:49.340 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:01:49.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:49 smithi022 ceph-mon[39439]: osdmap e784: 12 total, 12 up, 9 in 2024-04-01T20:01:49.380 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:49 smithi188 ceph-mon[43939]: osdmap e784: 12 total, 12 up, 9 in 2024-04-01T20:01:49.440 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:01:49.475 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:49.505 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:01:49.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:49 smithi062 ceph-mon[44211]: osdmap e784: 12 total, 12 up, 9 in 2024-04-01T20:01:49.513 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:49.513 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:01:49.551 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T20:01:49.551 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:01:49.614 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:01:49.657 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:49.687 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:01:49.692 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:49.692 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:01:49.793 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:01:49.838 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:49.869 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:01:49.872 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:49.872 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:01:49.973 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:01:50.034 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:50.083 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:01:50.094 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:50.095 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:01:50.196 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:01:50.230 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:50 smithi022 ceph-mon[39439]: pgmap v2133: 17 pgs: 1 active+remapped+backfill_wait, 1 remapped+peering, 11 active+remapped+backfilling, 4 active+clean; 7.8 GiB data, 19 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 467 op/s; 60230/255708 objects misplaced (23.554%); 147 MiB/s, 2.35k objects/s recovering 2024-04-01T20:01:50.234 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:50.339 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:01:50.343 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:50.344 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:01:50.445 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:01:50.487 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:50.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:50 smithi062 ceph-mon[44211]: pgmap v2133: 17 pgs: 1 active+remapped+backfill_wait, 1 remapped+peering, 11 active+remapped+backfilling, 4 active+clean; 7.8 GiB data, 19 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 467 op/s; 60230/255708 objects misplaced (23.554%); 147 MiB/s, 2.35k objects/s recovering 2024-04-01T20:01:50.532 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:01:50.535 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:50.536 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:01:50.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:50 smithi188 ceph-mon[43939]: pgmap v2133: 17 pgs: 1 active+remapped+backfill_wait, 1 remapped+peering, 11 active+remapped+backfilling, 4 active+clean; 7.8 GiB data, 19 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 467 op/s; 60230/255708 objects misplaced (23.554%); 147 MiB/s, 2.35k objects/s recovering 2024-04-01T20:01:50.636 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:01:50.672 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:50.862 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:01:51.076 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:01:51.106 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:01:51.138 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:01:51.179 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T20:01:51.220 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:01:51.244 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:01:51.272 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:01:51.301 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:01:51.329 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:01:51.359 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:01:51.388 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T20:01:51.413 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:01:51.415 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:01:51.415 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:01:51.415 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:01:51.416 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T20:01:51.416 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:01:51.416 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:01:51.416 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:01:51.416 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:01:51.416 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:01:51.416 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:01:51.416 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T20:01:51.416 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:01:51.442 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:51 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4156386132' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:01:51.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:51 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4156386132' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:01:51.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:51 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4156386132' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:01:52.331 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:01:52.358 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:52.359 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:01:52.460 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:01:52.497 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.497 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.497 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.497 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.497 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.497 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.497 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.497 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.497 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.497 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:52 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.497 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:52 smithi022 ceph-mon[39439]: pgmap v2134: 17 pgs: 13 active+remapped+backfilling, 4 active+clean; 7.7 GiB data, 19 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 645 op/s; 60936/251206 objects misplaced (24.257%); 164 MiB/s, 2.62k objects/s recovering 2024-04-01T20:01:52.501 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:52.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:52 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:52 smithi062 ceph-mon[44211]: pgmap v2134: 17 pgs: 13 active+remapped+backfilling, 4 active+clean; 7.7 GiB data, 19 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 645 op/s; 60936/251206 objects misplaced (24.257%); 164 MiB/s, 2.62k objects/s recovering 2024-04-01T20:01:52.609 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:01:52.613 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:52.613 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:01:52.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:52 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:52.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:52 smithi188 ceph-mon[43939]: pgmap v2134: 17 pgs: 13 active+remapped+backfilling, 4 active+clean; 7.7 GiB data, 19 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 645 op/s; 60936/251206 objects misplaced (24.257%); 164 MiB/s, 2.62k objects/s recovering 2024-04-01T20:01:52.715 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:01:52.765 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:53.473 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:53.473 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:53 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:53.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:53.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:53 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:53.589 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:53.589 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:53 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:01:53.632 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:01:53.633 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_ops_in_flight 2024-04-01T20:01:53.635 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:53.636 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:01:53.737 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:01:53.792 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:53.835 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:01:53.840 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:53.840 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:01:53.941 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:01:53.978 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:54.008 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:01:54.012 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:54.012 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:01:54.042 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T20:01:54.113 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:01:54.148 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:54.171 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:01:54.174 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:54.175 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:01:54.210 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T20:01:54.275 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:01:54.318 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:54 smithi188 ceph-mon[43939]: pgmap v2135: 17 pgs: 13 active+remapped+backfilling, 4 active+clean; 7.6 GiB data, 20 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 565 op/s; 59441/250294 objects misplaced (23.748%); 139 MiB/s, 2.22k objects/s recovering 2024-04-01T20:01:54.318 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:54 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1042995738' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:01:54.323 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:54.357 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:01:54.363 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:54.364 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:01:54.465 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:01:54.496 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:54 smithi022 ceph-mon[39439]: pgmap v2135: 17 pgs: 13 active+remapped+backfilling, 4 active+clean; 7.6 GiB data, 20 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 565 op/s; 59441/250294 objects misplaced (23.748%); 139 MiB/s, 2.22k objects/s recovering 2024-04-01T20:01:54.496 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:54 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1042995738' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:01:54.500 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:54.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:54 smithi062 ceph-mon[44211]: pgmap v2135: 17 pgs: 13 active+remapped+backfilling, 4 active+clean; 7.6 GiB data, 20 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 565 op/s; 59441/250294 objects misplaced (23.748%); 139 MiB/s, 2.22k objects/s recovering 2024-04-01T20:01:54.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:54 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1042995738' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:01:54.528 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:01:54.530 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:54.531 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:01:54.631 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:01:54.673 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:55.014 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 4, 5, 7, 9, 8, 6, 1] out_osds: [10, 3, 11] dead_osds: [] live_osds: [0, 2, 3, 4, 5, 7, 9, 11, 8, 6, 1, 10] 2024-04-01T20:01:55.015 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 0 1 2024-04-01T20:01:55.028 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:01:55.032 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:55.032 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:01:55.132 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:01:55.187 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:55.222 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:01:55.227 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:55.228 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:01:55.329 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:01:55.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:55 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:01:55.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:55 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1042995738' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T20:01:55.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:55 smithi022 ceph-mon[39439]: osdmap e785: 12 total, 12 up, 9 in 2024-04-01T20:01:55.366 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:01:55.386 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:55.420 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:01:55.428 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:55.429 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:01:55.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:55 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:01:55.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:55 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1042995738' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T20:01:55.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:55 smithi062 ceph-mon[44211]: osdmap e785: 12 total, 12 up, 9 in 2024-04-01T20:01:55.522 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T20:01:55.529 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:01:55.576 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:55 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:01:55.576 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:55 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1042995738' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T20:01:55.576 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:55 smithi188 ceph-mon[43939]: osdmap e785: 12 total, 12 up, 9 in 2024-04-01T20:01:55.596 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:56.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:56 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:01:56.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:56 smithi022 ceph-mon[39439]: pgmap v2137: 17 pgs: 13 active+remapped+backfilling, 4 active+clean; 7.6 GiB data, 20 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 556 op/s; 54690/247554 objects misplaced (22.092%); 122 MiB/s, 1.96k objects/s recovering 2024-04-01T20:01:56.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:56 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:01:56.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:56 smithi062 ceph-mon[44211]: pgmap v2137: 17 pgs: 13 active+remapped+backfilling, 4 active+clean; 7.6 GiB data, 20 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 556 op/s; 54690/247554 objects misplaced (22.092%); 122 MiB/s, 1.96k objects/s recovering 2024-04-01T20:01:56.599 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:56 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:01:56.599 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:56 smithi188 ceph-mon[43939]: pgmap v2137: 17 pgs: 13 active+remapped+backfilling, 4 active+clean; 7.6 GiB data, 20 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 556 op/s; 54690/247554 objects misplaced (22.092%); 122 MiB/s, 1.96k objects/s recovering 2024-04-01T20:01:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:01:57.031 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T20:01:57.278 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:01:57.282 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:57.282 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:01:57.383 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:01:57.423 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:57.546 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:01:57.554 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:57.555 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:01:57.656 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:01:57.729 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:57.775 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:01:57.781 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:57.781 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:01:57.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:57 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:01:57.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:57 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:01:57.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:57 smithi022 ceph-mon[39439]: osdmap e786: 12 total, 12 up, 9 in 2024-04-01T20:01:57.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:57 smithi022 ceph-mon[39439]: pgmap v2139: 17 pgs: 13 active+remapped+backfilling, 4 active+clean; 7.4 GiB data, 20 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 787 op/s; 49206/243110 objects misplaced (20.240%); 125 MiB/s, 2.00k objects/s recovering 2024-04-01T20:01:57.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:57 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:01:57.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:57 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:01:57.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:57 smithi188 ceph-mon[43939]: osdmap e786: 12 total, 12 up, 9 in 2024-04-01T20:01:57.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:57 smithi188 ceph-mon[43939]: pgmap v2139: 17 pgs: 13 active+remapped+backfilling, 4 active+clean; 7.4 GiB data, 20 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 787 op/s; 49206/243110 objects misplaced (20.240%); 125 MiB/s, 2.00k objects/s recovering 2024-04-01T20:01:57.881 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:01:57.942 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:57.943 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:57 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:01:57.943 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:57 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:01:57.943 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:57 smithi062 ceph-mon[44211]: osdmap e786: 12 total, 12 up, 9 in 2024-04-01T20:01:57.943 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:57 smithi062 ceph-mon[44211]: pgmap v2139: 17 pgs: 13 active+remapped+backfilling, 4 active+clean; 7.4 GiB data, 20 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 787 op/s; 49206/243110 objects misplaced (20.240%); 125 MiB/s, 2.00k objects/s recovering 2024-04-01T20:01:57.976 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:01:57.982 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:57.983 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:01:58.084 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:01:58.121 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:01:58.527 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T20:01:58.528 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T20:01:58.528 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-01T20:01:58.528 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T20:01:58.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:58 smithi022 ceph-mon[39439]: osdmap e787: 12 total, 12 up, 9 in 2024-04-01T20:01:58.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:58 smithi188 ceph-mon[43939]: osdmap e787: 12 total, 12 up, 9 in 2024-04-01T20:01:59.015 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:58 smithi062 ceph-mon[44211]: osdmap e787: 12 total, 12 up, 9 in 2024-04-01T20:01:59.757 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:01:59.762 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:01:59.762 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:01:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:59 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:01:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:59 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:01:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:59 smithi022 ceph-mon[39439]: osdmap e788: 12 total, 12 up, 9 in 2024-04-01T20:01:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:01:59 smithi022 ceph-mon[39439]: pgmap v2142: 17 pgs: 13 active+remapped+backfilling, 4 active+clean; 7.4 GiB data, 20 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 671 op/s; 46359/241966 objects misplaced (19.159%); 107 MiB/s, 1.71k objects/s recovering 2024-04-01T20:01:59.864 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:01:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:59 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:01:59.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:59 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:01:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:59 smithi188 ceph-mon[43939]: osdmap e788: 12 total, 12 up, 9 in 2024-04-01T20:01:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:01:59 smithi188 ceph-mon[43939]: pgmap v2142: 17 pgs: 13 active+remapped+backfilling, 4 active+clean; 7.4 GiB data, 20 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 671 op/s; 46359/241966 objects misplaced (19.159%); 107 MiB/s, 1.71k objects/s recovering 2024-04-01T20:01:59.897 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:00.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:59 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:02:00.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:59 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:02:00.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:59 smithi062 ceph-mon[44211]: osdmap e788: 12 total, 12 up, 9 in 2024-04-01T20:02:00.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:01:59 smithi062 ceph-mon[44211]: pgmap v2142: 17 pgs: 13 active+remapped+backfilling, 4 active+clean; 7.4 GiB data, 20 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 671 op/s; 46359/241966 objects misplaced (19.159%); 107 MiB/s, 1.71k objects/s recovering 2024-04-01T20:02:00.045 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_blocked_ops 2024-04-01T20:02:00.431 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T20:02:00.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:00 smithi188 ceph-mon[43939]: osdmap e789: 12 total, 12 up, 9 in 2024-04-01T20:02:00.887 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:02:00.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:00 smithi022 ceph-mon[39439]: osdmap e789: 12 total, 12 up, 9 in 2024-04-01T20:02:00.911 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:00.911 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:02:01.012 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:02:01.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:00 smithi062 ceph-mon[44211]: osdmap e789: 12 total, 12 up, 9 in 2024-04-01T20:02:01.081 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:01.127 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:02:01.131 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:01.131 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:02:01.232 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:02:01.288 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:01.328 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:02:01.340 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:01.340 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:02:01.441 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:02:01.497 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:01.548 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:02:01.559 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:01.560 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:02:01.661 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:02:01.702 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:01.944 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:01 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:02:01.944 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:01 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:02:01.944 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:01 smithi188 ceph-mon[43939]: osdmap e790: 12 total, 12 up, 9 in 2024-04-01T20:02:01.944 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:01 smithi188 ceph-mon[43939]: pgmap v2145: 17 pgs: 12 active+remapped+backfilling, 5 active+clean; 7.3 GiB data, 19 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 385 op/s; 42883/240028 objects misplaced (17.866%); 90 MiB/s, 1.44k objects/s recovering 2024-04-01T20:02:01.985 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:02:01.992 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:01 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:02:01.993 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:01 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:02:01.993 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:01 smithi022 ceph-mon[39439]: osdmap e790: 12 total, 12 up, 9 in 2024-04-01T20:02:01.993 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:01 smithi022 ceph-mon[39439]: pgmap v2145: 17 pgs: 12 active+remapped+backfilling, 5 active+clean; 7.3 GiB data, 19 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 385 op/s; 42883/240028 objects misplaced (17.866%); 90 MiB/s, 1.44k objects/s recovering 2024-04-01T20:02:01.993 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:01.993 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:02:02.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:01 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:02:02.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:01 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:02:02.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:01 smithi062 ceph-mon[44211]: osdmap e790: 12 total, 12 up, 9 in 2024-04-01T20:02:02.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:01 smithi062 ceph-mon[44211]: pgmap v2145: 17 pgs: 12 active+remapped+backfilling, 5 active+clean; 7.3 GiB data, 19 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 385 op/s; 42883/240028 objects misplaced (17.866%); 90 MiB/s, 1.44k objects/s recovering 2024-04-01T20:02:02.095 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:02:02.129 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:02.159 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:02:02.163 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:02.164 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:02:02.265 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:02:02.308 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:02.564 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:02:02.651 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.0 to 1 (10000) 2024-04-01T20:02:02.726 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:02:02.760 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:02:02.794 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:02:02.830 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T20:02:02.877 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:02:02.914 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:02:02.983 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:02:02.986 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:02.986 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:02:02.987 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:02 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:02:02.987 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:02 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:02:02.987 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:02 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1848430323' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T20:02:03.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:02 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:02:03.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:02 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:02:03.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:02 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1848430323' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T20:02:03.087 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:02:03.104 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:02:03.104 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:02:03.104 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:02:03.104 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:02:03.104 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T20:02:03.105 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:02 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:02:03.105 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:02 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:02:03.105 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:02 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1848430323' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T20:02:03.110 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:02:03.111 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:02:03.111 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:02:03.111 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:02:03.112 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T20:02:03.112 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:02:03.112 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:02:03.112 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:02:03.112 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:02:03.112 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:02:03.112 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:02:03.112 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T20:02:03.112 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:02:03.143 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:03.182 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:02:03.191 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:03.191 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:02:03.292 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:02:03.329 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:03.989 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:02:03.993 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:03.993 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:02:03.994 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:03 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1848430323' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-04-01T20:02:03.994 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:03 smithi022 ceph-mon[39439]: osdmap e791: 12 total, 12 up, 9 in 2024-04-01T20:02:03.994 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:03 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/787351804' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:02:03.994 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:03.994 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:03.994 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:03.994 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:03.994 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:03.994 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:03 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:03.994 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:03 smithi022 ceph-mon[39439]: pgmap v2147: 17 pgs: 12 active+remapped+backfilling, 5 active+clean; 7.2 GiB data, 20 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 633 op/s; 38086/236970 objects misplaced (16.072%); 129 MiB/s, 2.06k objects/s recovering 2024-04-01T20:02:04.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:03 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1848430323' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-04-01T20:02:04.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:03 smithi062 ceph-mon[44211]: osdmap e791: 12 total, 12 up, 9 in 2024-04-01T20:02:04.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:03 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/787351804' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:02:04.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:04.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:04.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:04.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:04.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:04.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:03 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:04.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:03 smithi062 ceph-mon[44211]: pgmap v2147: 17 pgs: 12 active+remapped+backfilling, 5 active+clean; 7.2 GiB data, 20 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 633 op/s; 38086/236970 objects misplaced (16.072%); 129 MiB/s, 2.06k objects/s recovering 2024-04-01T20:02:04.022 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:03 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1848430323' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-04-01T20:02:04.023 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:03 smithi188 ceph-mon[43939]: osdmap e791: 12 total, 12 up, 9 in 2024-04-01T20:02:04.023 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:03 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/787351804' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:02:04.023 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:04.023 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:04.023 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:04.023 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:04.023 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:04.023 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:03 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:04.023 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:03 smithi188 ceph-mon[43939]: pgmap v2147: 17 pgs: 12 active+remapped+backfilling, 5 active+clean; 7.2 GiB data, 20 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 633 op/s; 38086/236970 objects misplaced (16.072%); 129 MiB/s, 2.06k objects/s recovering 2024-04-01T20:02:04.094 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:02:04.129 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:04.990 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:02:04.993 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:04.993 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:04.993 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:04.993 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:04.993 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:04.993 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:04 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:04.994 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:04.994 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:02:05.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:05.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:05.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:05.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:05.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:05.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:04 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:05.094 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:02:05.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:05.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:05.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:05.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:05.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:05.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:04 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:05.127 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:05.256 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:02:05.258 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:05.259 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:02:05.359 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:02:05.397 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:05.531 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:02:05.538 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:05.538 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:02:05.639 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:02:05.716 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:05.778 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:02:05.787 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:05.787 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:02:05.827 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T20:02:05.827 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:02:05.887 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:02:05.925 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:05 smithi022 ceph-mon[39439]: pgmap v2148: 17 pgs: 12 active+remapped+backfilling, 5 active+clean; 7.1 GiB data, 20 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 645 op/s; 34407/234222 objects misplaced (14.690%); 113 MiB/s, 1.80k objects/s recovering 2024-04-01T20:02:05.929 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:05.961 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 2 1 2024-04-01T20:02:06.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:05 smithi062 ceph-mon[44211]: pgmap v2148: 17 pgs: 12 active+remapped+backfilling, 5 active+clean; 7.1 GiB data, 20 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 645 op/s; 34407/234222 objects misplaced (14.690%); 113 MiB/s, 1.80k objects/s recovering 2024-04-01T20:02:06.040 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:02:06.049 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:06.049 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:02:06.128 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:05 smithi188 ceph-mon[43939]: pgmap v2148: 17 pgs: 12 active+remapped+backfilling, 5 active+clean; 7.1 GiB data, 20 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 645 op/s; 34407/234222 objects misplaced (14.690%); 113 MiB/s, 1.80k objects/s recovering 2024-04-01T20:02:06.150 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:02:06.218 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:06.261 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:02:06.267 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:06.268 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:02:06.369 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:02:06.404 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:06.706 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T20:02:06.982 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:02:07.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:07 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T20:02:07.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:07 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T20:02:07.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:07 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:02:07.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:07 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:02:07.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:07 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T20:02:07.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:07 smithi022 ceph-mon[39439]: pgmap v2149: 17 pgs: 12 active+remapped+backfilling, 5 active+clean; 7.0 GiB data, 20 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 796 op/s; 29411/229490 objects misplaced (12.816%); 119 MiB/s, 1.91k objects/s recovering 2024-04-01T20:02:07.672 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_historic_ops 2024-04-01T20:02:07.672 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:02:07.683 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:07.684 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:02:07.785 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:02:07.831 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:07.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:07 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T20:02:07.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:07 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T20:02:07.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:07 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:02:07.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:07 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:02:07.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:07 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T20:02:07.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:07 smithi188 ceph-mon[43939]: pgmap v2149: 17 pgs: 12 active+remapped+backfilling, 5 active+clean; 7.0 GiB data, 20 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 796 op/s; 29411/229490 objects misplaced (12.816%); 119 MiB/s, 1.91k objects/s recovering 2024-04-01T20:02:08.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:07 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T20:02:08.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:07 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T20:02:08.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:07 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:02:08.015 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:07 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:02:08.015 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:07 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T20:02:08.015 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:07 smithi062 ceph-mon[44211]: pgmap v2149: 17 pgs: 12 active+remapped+backfilling, 5 active+clean; 7.0 GiB data, 20 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 796 op/s; 29411/229490 objects misplaced (12.816%); 119 MiB/s, 1.91k objects/s recovering 2024-04-01T20:02:08.122 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T20:02:08.594 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:02:08.599 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:08.600 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:02:08.701 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:02:08.734 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:08.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:08 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:02:08.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:08 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:02:08.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:08 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:02:08.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:08 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:02:08.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:08 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:02:08.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:08 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:02:08.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:08 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:02:08.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:08 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:02:09.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:08 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:02:09.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:08 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:02:09.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:08 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:02:09.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:08 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:02:09.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:09 smithi022 ceph-mon[39439]: osdmap e792: 12 total, 12 up, 9 in 2024-04-01T20:02:09.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:09 smithi022 ceph-mon[39439]: pgmap v2151: 17 pgs: 2 peering, 10 active+remapped+backfilling, 5 active+clean; 7.0 GiB data, 20 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 730 op/s; 27146/228334 objects misplaced (11.889%); 110 MiB/s, 1.75k objects/s recovering 2024-04-01T20:02:09.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:09 smithi188 ceph-mon[43939]: osdmap e792: 12 total, 12 up, 9 in 2024-04-01T20:02:09.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:09 smithi188 ceph-mon[43939]: pgmap v2151: 17 pgs: 2 peering, 10 active+remapped+backfilling, 5 active+clean; 7.0 GiB data, 20 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 730 op/s; 27146/228334 objects misplaced (11.889%); 110 MiB/s, 1.75k objects/s recovering 2024-04-01T20:02:10.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:09 smithi062 ceph-mon[44211]: osdmap e792: 12 total, 12 up, 9 in 2024-04-01T20:02:10.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:09 smithi062 ceph-mon[44211]: pgmap v2151: 17 pgs: 2 peering, 10 active+remapped+backfilling, 5 active+clean; 7.0 GiB data, 20 GiB used, 785 GiB / 805 GiB avail; 0 B/s wr, 730 op/s; 27146/228334 objects misplaced (11.889%); 110 MiB/s, 1.75k objects/s recovering 2024-04-01T20:02:10.123 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:02:10.127 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:10.127 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:02:10.153 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:02:10.229 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:02:10.266 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:10.521 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:02:10.525 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:10.525 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:02:10.584 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T20:02:10.626 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:02:10.667 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:10.695 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:10 smithi022 ceph-mon[39439]: osdmap e793: 12 total, 12 up, 9 in 2024-04-01T20:02:10.695 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:10 smithi022 ceph-mon[39439]: 9.b scrub starts 2024-04-01T20:02:10.696 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:10 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1413379339' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:02:10.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:10 smithi188 ceph-mon[43939]: osdmap e793: 12 total, 12 up, 9 in 2024-04-01T20:02:10.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:10 smithi188 ceph-mon[43939]: 9.b scrub starts 2024-04-01T20:02:10.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:10 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1413379339' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:02:11.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:10 smithi062 ceph-mon[44211]: osdmap e793: 12 total, 12 up, 9 in 2024-04-01T20:02:11.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:10 smithi062 ceph-mon[44211]: 9.b scrub starts 2024-04-01T20:02:11.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:10 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1413379339' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:02:11.328 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:02:11.332 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:11.332 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:02:11.433 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:02:11.466 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:11.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:11 smithi022 ceph-mon[39439]: 9.b scrub ok 2024-04-01T20:02:11.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:11 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T20:02:11.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:11 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T20:02:11.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:11 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1413379339' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T20:02:11.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:11 smithi022 ceph-mon[39439]: osdmap e794: 12 total, 12 up, 9 in 2024-04-01T20:02:11.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:11 smithi022 ceph-mon[39439]: pgmap v2154: 17 pgs: 3 peering, 9 active+remapped+backfilling, 5 active+clean; 6.9 GiB data, 19 GiB used, 786 GiB / 805 GiB avail; 0 B/s wr, 634 op/s; 23442/226610 objects misplaced (10.345%); 102 MiB/s, 1.63k objects/s recovering 2024-04-01T20:02:11.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:11 smithi188 ceph-mon[43939]: 9.b scrub ok 2024-04-01T20:02:11.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:11 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T20:02:11.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:11 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T20:02:11.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:11 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1413379339' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T20:02:11.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:11 smithi188 ceph-mon[43939]: osdmap e794: 12 total, 12 up, 9 in 2024-04-01T20:02:11.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:11 smithi188 ceph-mon[43939]: pgmap v2154: 17 pgs: 3 peering, 9 active+remapped+backfilling, 5 active+clean; 6.9 GiB data, 19 GiB used, 786 GiB / 805 GiB avail; 0 B/s wr, 634 op/s; 23442/226610 objects misplaced (10.345%); 102 MiB/s, 1.63k objects/s recovering 2024-04-01T20:02:12.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:11 smithi062 ceph-mon[44211]: 9.b scrub ok 2024-04-01T20:02:12.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:11 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T20:02:12.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:11 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T20:02:12.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:11 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1413379339' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T20:02:12.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:11 smithi062 ceph-mon[44211]: osdmap e794: 12 total, 12 up, 9 in 2024-04-01T20:02:12.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:11 smithi062 ceph-mon[44211]: pgmap v2154: 17 pgs: 3 peering, 9 active+remapped+backfilling, 5 active+clean; 6.9 GiB data, 19 GiB used, 786 GiB / 805 GiB avail; 0 B/s wr, 634 op/s; 23442/226610 objects misplaced (10.345%); 102 MiB/s, 1.63k objects/s recovering 2024-04-01T20:02:12.322 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:02:12.326 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:12.326 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:02:12.427 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:02:12.469 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:12.630 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:02:12.637 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:12.638 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:02:12.739 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:02:12.804 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:12.834 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:02:12.837 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:12.837 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:02:12.938 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:02:12.994 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:13.026 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:02:13.035 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:13.035 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:02:13.136 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:02:13.174 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:13.286 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:02:13.286 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:02:13.286 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:02:13.287 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T20:02:13.308 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:02:13.329 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:02:13.350 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:02:13.371 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:02:13.379 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:02:13.382 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:13.382 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:02:13.397 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:02:13.418 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:02:13.524 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:02:13.525 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T20:02:13.525 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:02:13.525 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:02:13.526 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:02:13.526 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:02:13.526 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T20:02:13.526 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:02:13.526 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:02:13.526 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:02:13.526 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:02:13.526 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:02:13.526 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:02:13.526 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T20:02:13.526 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:02:13.562 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:13.592 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:02:13.595 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:13.595 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:02:13.696 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:02:13.698 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T20:02:13.698 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-01T20:02:13.699 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-01T20:02:13.699 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T20:02:13.699 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.699 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:159025 8.7 8:ed612cfa:::benchmark_data_smithi188_161190_object19743:head [delete] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e688)", 2024-04-01T20:02:13.699 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:21.740622+0000", 2024-04-01T20:02:13.699 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 351.955857541, 2024-04-01T20:02:13.699 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.275231748, 2024-04-01T20:02:13.699 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:02:13.699 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:02:13.699 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T20:02:13.699 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T20:02:13.699 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T20:02:13.699 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:02:13.699 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 159025 2024-04-01T20:02:13.699 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.700 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:02:13.700 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.700 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:02:13.700 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.740622+0000", 2024-04-01T20:02:13.700 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.700 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.700 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.700 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:02:13.700 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.740622+0000", 2024-04-01T20:02:13.700 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.700 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.700 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.700 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:02:13.700 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.740624+0000", 2024-04-01T20:02:13.701 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5979999999999999e-06 2024-04-01T20:02:13.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.701 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.701 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:02:13.701 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.740631+0000", 2024-04-01T20:02:13.701 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1999999999999997e-06 2024-04-01T20:02:13.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.701 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.701 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:02:13.701 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.740644+0000", 2024-04-01T20:02:13.701 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2394e-05 2024-04-01T20:02:13.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.701 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.701 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:02:13.701 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.740656+0000", 2024-04-01T20:02:13.702 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2097e-05 2024-04-01T20:02:13.702 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.702 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.702 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.702 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.743814+0000", 2024-04-01T20:02:13.702 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031578510000000001 2024-04-01T20:02:13.702 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.702 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.702 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T20:02:13.702 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.743826+0000", 2024-04-01T20:02:13.702 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2238e-05 2024-04-01T20:02:13.702 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.702 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.702 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.702 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.004934+0000", 2024-04-01T20:02:13.703 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.26110845999999999 2024-04-01T20:02:13.703 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.703 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.703 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for missing object", 2024-04-01T20:02:13.703 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.005050+0000", 2024-04-01T20:02:13.703 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000115344 2024-04-01T20:02:13.703 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.703 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.703 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.703 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.015792+0000", 2024-04-01T20:02:13.703 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010742435 2024-04-01T20:02:13.703 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.703 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.703 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T20:02:13.703 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.015853+0000", 2024-04-01T20:02:13.704 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1130999999999995e-05 2024-04-01T20:02:13.704 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.704 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:02:13.704 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.704 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.704 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.704 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:159041 8.7 8:edb8ec9f:::benchmark_data_smithi188_161190_object19759:head [delete] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e688)", 2024-04-01T20:02:13.704 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:21.740783+0000", 2024-04-01T20:02:13.704 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 351.95569623400002, 2024-04-01T20:02:13.704 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.294953311, 2024-04-01T20:02:13.704 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:02:13.704 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:02:13.704 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:02:13.704 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T20:02:13.704 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T20:02:13.704 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:02:13.705 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 159041 2024-04-01T20:02:13.705 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.705 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:02:13.705 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.705 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:02:13.705 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.740783+0000", 2024-04-01T20:02:13.705 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.705 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.705 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.705 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:02:13.705 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.740783+0000", 2024-04-01T20:02:13.705 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.705 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.705 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.705 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:02:13.705 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.740784+0000", 2024-04-01T20:02:13.706 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0669999999999999e-06 2024-04-01T20:02:13.706 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.706 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.706 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:02:13.706 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.740788+0000", 2024-04-01T20:02:13.706 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3460000000000004e-06 2024-04-01T20:02:13.706 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.706 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.706 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:02:13.706 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.740796+0000", 2024-04-01T20:02:13.706 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4889999999999998e-06 2024-04-01T20:02:13.706 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.706 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.706 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:02:13.706 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.740802+0000", 2024-04-01T20:02:13.707 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4169999999999997e-06 2024-04-01T20:02:13.707 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.707 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.707 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.707 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.743856+0000", 2024-04-01T20:02:13.707 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030542630000000002 2024-04-01T20:02:13.707 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.707 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.707 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T20:02:13.707 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.743864+0000", 2024-04-01T20:02:13.707 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6990000000000003e-06 2024-04-01T20:02:13.707 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.707 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.707 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.707 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.008546+0000", 2024-04-01T20:02:13.707 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.26468152099999998 2024-04-01T20:02:13.707 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.708 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.708 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T20:02:13.708 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.009249+0000", 2024-04-01T20:02:13.708 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00070286700000000003 2024-04-01T20:02:13.708 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.708 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.708 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.708 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.023817+0000", 2024-04-01T20:02:13.708 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014568957 2024-04-01T20:02:13.708 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.708 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.708 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T20:02:13.708 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.023887+0000", 2024-04-01T20:02:13.708 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9821999999999997e-05 2024-04-01T20:02:13.708 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.708 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.709 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T20:02:13.709 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.023996+0000", 2024-04-01T20:02:13.709 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010890799999999999 2024-04-01T20:02:13.709 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.709 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.709 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T20:02:13.709 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.032873+0000", 2024-04-01T20:02:13.709 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0088766539999999994 2024-04-01T20:02:13.709 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.709 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.709 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:02:13.709 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.032923+0000", 2024-04-01T20:02:13.709 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0130000000000003e-05 2024-04-01T20:02:13.709 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.709 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.709 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T20:02:13.710 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.032961+0000", 2024-04-01T20:02:13.710 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7975999999999997e-05 2024-04-01T20:02:13.710 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.710 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.710 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T20:02:13.710 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.035736+0000", 2024-04-01T20:02:13.710 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0027751949999999998 2024-04-01T20:02:13.710 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.710 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:02:13.710 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.710 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.710 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.710 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:159013 8.6 8:6457a00e:::benchmark_data_smithi188_161190_object19731:head [delete] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e688)", 2024-04-01T20:02:13.710 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:21.745490+0000", 2024-04-01T20:02:13.710 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 351.95098899300001, 2024-04-01T20:02:13.711 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.23998613199999999, 2024-04-01T20:02:13.711 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:02:13.711 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:02:13.711 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T20:02:13.711 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T20:02:13.711 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T20:02:13.711 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:02:13.711 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 159013 2024-04-01T20:02:13.711 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.711 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:02:13.711 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.711 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:02:13.711 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745490+0000", 2024-04-01T20:02:13.711 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.711 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.712 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.712 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:02:13.712 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745490+0000", 2024-04-01T20:02:13.712 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.712 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.712 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.712 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:02:13.712 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745493+0000", 2024-04-01T20:02:13.712 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6400000000000001e-06 2024-04-01T20:02:13.712 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.712 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.712 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:02:13.712 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745500+0000", 2024-04-01T20:02:13.712 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6699999999999994e-06 2024-04-01T20:02:13.712 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.712 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.713 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:02:13.713 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745513+0000", 2024-04-01T20:02:13.713 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.225e-05 2024-04-01T20:02:13.713 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.713 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.713 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:02:13.713 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745524+0000", 2024-04-01T20:02:13.713 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1112e-05 2024-04-01T20:02:13.713 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.713 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.713 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.713 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.750014+0000", 2024-04-01T20:02:13.713 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0044899520000000002 2024-04-01T20:02:13.713 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.713 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.714 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T20:02:13.714 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.750025+0000", 2024-04-01T20:02:13.714 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1072e-05 2024-04-01T20:02:13.714 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.714 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.714 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.714 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.972680+0000", 2024-04-01T20:02:13.714 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.22265532599999999 2024-04-01T20:02:13.714 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.714 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.714 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for missing object", 2024-04-01T20:02:13.714 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.972783+0000", 2024-04-01T20:02:13.714 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000103149 2024-04-01T20:02:13.714 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.714 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.715 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.715 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.985394+0000", 2024-04-01T20:02:13.715 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.01261108 2024-04-01T20:02:13.715 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.715 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.715 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T20:02:13.715 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.985476+0000", 2024-04-01T20:02:13.715 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1880999999999998e-05 2024-04-01T20:02:13.715 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.715 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:02:13.715 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.715 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.715 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.715 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:159016 8.6 8:6d519853:::benchmark_data_smithi188_161190_object19734:head [delete] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e688)", 2024-04-01T20:02:13.715 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:21.745546+0000", 2024-04-01T20:02:13.715 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 351.95093336799999, 2024-04-01T20:02:13.716 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25014217399999999, 2024-04-01T20:02:13.716 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:02:13.716 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:02:13.716 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T20:02:13.716 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T20:02:13.716 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T20:02:13.716 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:02:13.716 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 159016 2024-04-01T20:02:13.716 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.716 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:02:13.716 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.716 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:02:13.716 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745546+0000", 2024-04-01T20:02:13.716 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.716 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.716 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.717 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:02:13.717 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745546+0000", 2024-04-01T20:02:13.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.717 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.717 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.717 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:02:13.717 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745546+0000", 2024-04-01T20:02:13.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7300000000000005e-07 2024-04-01T20:02:13.717 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.717 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.717 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:02:13.717 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745550+0000", 2024-04-01T20:02:13.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3419999999999999e-06 2024-04-01T20:02:13.717 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.717 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.717 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:02:13.718 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745555+0000", 2024-04-01T20:02:13.718 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.631e-06 2024-04-01T20:02:13.718 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.718 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.718 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:02:13.718 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745561+0000", 2024-04-01T20:02:13.718 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5500000000000002e-06 2024-04-01T20:02:13.718 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.718 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.718 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.718 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.750052+0000", 2024-04-01T20:02:13.718 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0044913280000000002 2024-04-01T20:02:13.718 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.718 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.718 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T20:02:13.719 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.750058+0000", 2024-04-01T20:02:13.719 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7450000000000001e-06 2024-04-01T20:02:13.719 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.719 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.719 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.719 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.975565+0000", 2024-04-01T20:02:13.719 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.225506969 2024-04-01T20:02:13.719 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.719 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.719 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for missing object", 2024-04-01T20:02:13.719 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.975649+0000", 2024-04-01T20:02:13.719 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3628999999999995e-05 2024-04-01T20:02:13.719 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.719 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.719 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.719 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.995600+0000", 2024-04-01T20:02:13.720 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019950862999999999 2024-04-01T20:02:13.720 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.720 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.720 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T20:02:13.720 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.995688+0000", 2024-04-01T20:02:13.720 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8344000000000007e-05 2024-04-01T20:02:13.720 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.720 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:02:13.720 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.720 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.720 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.720 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:159022 8.6 8:62ca23b9:::benchmark_data_smithi188_161190_object19740:head [delete] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e688)", 2024-04-01T20:02:13.720 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:21.745568+0000", 2024-04-01T20:02:13.720 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 351.95091118099998, 2024-04-01T20:02:13.721 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25909227699999998, 2024-04-01T20:02:13.721 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:02:13.721 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:02:13.721 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-01T20:02:13.721 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T20:02:13.721 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T20:02:13.721 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:02:13.721 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 159022 2024-04-01T20:02:13.721 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.721 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:02:13.721 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.721 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:02:13.721 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745568+0000", 2024-04-01T20:02:13.721 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.721 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.722 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.722 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:02:13.722 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745568+0000", 2024-04-01T20:02:13.722 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.722 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.722 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.722 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:02:13.722 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745569+0000", 2024-04-01T20:02:13.722 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7700000000000004e-07 2024-04-01T20:02:13.722 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.722 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.722 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:02:13.722 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745571+0000", 2024-04-01T20:02:13.722 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4719999999999998e-06 2024-04-01T20:02:13.722 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.723 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.723 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:02:13.723 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745576+0000", 2024-04-01T20:02:13.723 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8570000000000003e-06 2024-04-01T20:02:13.723 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.723 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.723 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:02:13.723 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745581+0000", 2024-04-01T20:02:13.723 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.843e-06 2024-04-01T20:02:13.723 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.723 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.723 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.723 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.750081+0000", 2024-04-01T20:02:13.723 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0045002239999999997 2024-04-01T20:02:13.724 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.724 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.724 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T20:02:13.724 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.750087+0000", 2024-04-01T20:02:13.724 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7130000000000002e-06 2024-04-01T20:02:13.724 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.724 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.724 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.724 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.975671+0000", 2024-04-01T20:02:13.724 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.225584223 2024-04-01T20:02:13.724 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.724 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.724 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for missing object", 2024-04-01T20:02:13.724 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.975733+0000", 2024-04-01T20:02:13.724 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1755999999999996e-05 2024-04-01T20:02:13.724 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.725 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.725 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.725 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.004595+0000", 2024-04-01T20:02:13.725 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028862539 2024-04-01T20:02:13.725 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.725 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.725 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T20:02:13.725 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.004660+0000", 2024-04-01T20:02:13.725 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4873e-05 2024-04-01T20:02:13.725 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.725 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:02:13.725 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.725 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.725 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.725 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:159038 8.6 8:6486510a:::benchmark_data_smithi188_161190_object19756:head [delete] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e688)", 2024-04-01T20:02:13.726 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:21.745588+0000", 2024-04-01T20:02:13.726 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 351.95089141400001, 2024-04-01T20:02:13.726 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.29499959799999997, 2024-04-01T20:02:13.726 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:02:13.726 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:02:13.726 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:02:13.726 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T20:02:13.726 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T20:02:13.726 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:02:13.726 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 159038 2024-04-01T20:02:13.726 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.726 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:02:13.726 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.726 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:02:13.726 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745588+0000", 2024-04-01T20:02:13.726 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.727 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.727 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.727 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:02:13.727 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745588+0000", 2024-04-01T20:02:13.727 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.727 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.727 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.727 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:02:13.727 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745588+0000", 2024-04-01T20:02:13.727 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2499999999999995e-07 2024-04-01T20:02:13.727 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.727 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.727 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:02:13.727 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745590+0000", 2024-04-01T20:02:13.727 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2979999999999999e-06 2024-04-01T20:02:13.727 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.728 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.728 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:02:13.728 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745595+0000", 2024-04-01T20:02:13.728 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9269999999999996e-06 2024-04-01T20:02:13.728 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.728 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.728 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:02:13.728 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.745600+0000", 2024-04-01T20:02:13.728 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5730000000000001e-06 2024-04-01T20:02:13.728 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.728 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.728 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.728 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.750113+0000", 2024-04-01T20:02:13.728 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0045133450000000002 2024-04-01T20:02:13.728 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.728 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.729 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for peered", 2024-04-01T20:02:13.729 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.750119+0000", 2024-04-01T20:02:13.729 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5679999999999999e-06 2024-04-01T20:02:13.729 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.729 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.729 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.729 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.975767+0000", 2024-04-01T20:02:13.729 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.225647713 2024-04-01T20:02:13.729 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.729 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.729 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T20:02:13.729 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:21.976480+0000", 2024-04-01T20:02:13.729 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00071369100000000002 2024-04-01T20:02:13.729 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.729 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.730 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.730 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.012603+0000", 2024-04-01T20:02:13.730 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.036122833 2024-04-01T20:02:13.730 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.730 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.730 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T20:02:13.730 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.012711+0000", 2024-04-01T20:02:13.730 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000107668 2024-04-01T20:02:13.730 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.730 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.730 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 7", 2024-04-01T20:02:13.730 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.012811+0000", 2024-04-01T20:02:13.730 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000100105 2024-04-01T20:02:13.730 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.731 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.731 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T20:02:13.731 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.035733+0000", 2024-04-01T20:02:13.731 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022922512999999999 2024-04-01T20:02:13.731 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.731 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.731 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:02:13.731 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.035782+0000", 2024-04-01T20:02:13.731 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8742000000000002e-05 2024-04-01T20:02:13.731 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.731 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.731 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T20:02:13.731 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.035861+0000", 2024-04-01T20:02:13.731 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9153999999999995e-05 2024-04-01T20:02:13.731 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.732 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.732 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T20:02:13.732 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:22.040587+0000", 2024-04-01T20:02:13.732 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0047259429999999998 2024-04-01T20:02:13.732 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.732 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:02:13.732 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.732 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.732 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.732 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:160520 8.7 8:e6e8615a:::benchmark_data_smithi188_161190_object21238:head [delete] snapc 0=[] ondisk+write+known_if_redirected e688)", 2024-04-01T20:02:13.732 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:24.508528+0000", 2024-04-01T20:02:13.732 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 349.18795120300001, 2024-04-01T20:02:13.732 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.29421895999999997, 2024-04-01T20:02:13.732 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:02:13.733 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:02:13.733 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:02:13.733 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T20:02:13.733 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T20:02:13.733 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:02:13.733 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 160520 2024-04-01T20:02:13.733 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.733 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:02:13.733 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.733 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:02:13.733 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.508528+0000", 2024-04-01T20:02:13.733 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.733 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.733 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.733 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:02:13.733 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.508528+0000", 2024-04-01T20:02:13.734 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.734 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.734 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.734 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:02:13.734 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.508530+0000", 2024-04-01T20:02:13.734 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1789999999999998e-06 2024-04-01T20:02:13.734 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.734 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.734 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:02:13.734 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.508537+0000", 2024-04-01T20:02:13.734 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9650000000000002e-06 2024-04-01T20:02:13.734 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.734 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.734 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:02:13.734 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.508549+0000", 2024-04-01T20:02:13.735 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2081e-05 2024-04-01T20:02:13.735 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.735 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:02:13.735 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.508557+0000", 2024-04-01T20:02:13.735 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2400000000000007e-06 2024-04-01T20:02:13.735 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.735 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.735 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.534744+0000", 2024-04-01T20:02:13.735 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026186437999999999 2024-04-01T20:02:13.735 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.735 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T20:02:13.735 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.534799+0000", 2024-04-01T20:02:13.735 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5692999999999997e-05 2024-04-01T20:02:13.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.736 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.749774+0000", 2024-04-01T20:02:13.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.21497492300000001 2024-04-01T20:02:13.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.736 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T20:02:13.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.749870+0000", 2024-04-01T20:02:13.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5564999999999997e-05 2024-04-01T20:02:13.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.736 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T20:02:13.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.749992+0000", 2024-04-01T20:02:13.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012204199999999999 2024-04-01T20:02:13.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.737 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T20:02:13.737 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.778855+0000", 2024-04-01T20:02:13.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028862794000000001 2024-04-01T20:02:13.737 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.737 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:02:13.737 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.798835+0000", 2024-04-01T20:02:13.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019980629999999999 2024-04-01T20:02:13.737 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.737 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T20:02:13.737 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.798902+0000", 2024-04-01T20:02:13.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6272000000000005e-05 2024-04-01T20:02:13.737 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.738 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T20:02:13.738 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:24.802747+0000", 2024-04-01T20:02:13.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0038451380000000001 2024-04-01T20:02:13.738 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.738 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:02:13.738 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.738 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:170001 8.7 8:efa1051b:::benchmark_data_smithi188_161190_object30719:head [delete] snapc 0=[] ondisk+write+known_if_redirected e690)", 2024-04-01T20:02:13.738 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:40.590584+0000", 2024-04-01T20:02:13.738 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 333.10589497199999, 2024-04-01T20:02:13.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.26288546000000002, 2024-04-01T20:02:13.738 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:02:13.738 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:02:13.738 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:02:13.739 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T20:02:13.739 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T20:02:13.739 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:02:13.739 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 170001 2024-04-01T20:02:13.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.739 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:02:13.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:02:13.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.590584+0000", 2024-04-01T20:02:13.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:02:13.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.590584+0000", 2024-04-01T20:02:13.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:02:13.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.590585+0000", 2024-04-01T20:02:13.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6000000000000003e-07 2024-04-01T20:02:13.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:02:13.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.590588+0000", 2024-04-01T20:02:13.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.96e-06 2024-04-01T20:02:13.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:02:13.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.590593+0000", 2024-04-01T20:02:13.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5799999999999999e-06 2024-04-01T20:02:13.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.741 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:02:13.741 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.590598+0000", 2024-04-01T20:02:13.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8760000000000004e-06 2024-04-01T20:02:13.741 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.741 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.741 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.642537+0000", 2024-04-01T20:02:13.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.051938627000000001 2024-04-01T20:02:13.741 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.741 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T20:02:13.741 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.642583+0000", 2024-04-01T20:02:13.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5750000000000001e-05 2024-04-01T20:02:13.741 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.741 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.742 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.810036+0000", 2024-04-01T20:02:13.742 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.16745390600000001 2024-04-01T20:02:13.742 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.742 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.742 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T20:02:13.742 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.810146+0000", 2024-04-01T20:02:13.742 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0001093 2024-04-01T20:02:13.742 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.742 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.742 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T20:02:13.742 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.810303+0000", 2024-04-01T20:02:13.742 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000157558 2024-04-01T20:02:13.742 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.742 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.742 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T20:02:13.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.839064+0000", 2024-04-01T20:02:13.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028761129999999999 2024-04-01T20:02:13.743 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.743 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:02:13.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.849700+0000", 2024-04-01T20:02:13.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010635886000000001 2024-04-01T20:02:13.743 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.743 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T20:02:13.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.849768+0000", 2024-04-01T20:02:13.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7178e-05 2024-04-01T20:02:13.743 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.743 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T20:02:13.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:40.853470+0000", 2024-04-01T20:02:13.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0037020489999999998 2024-04-01T20:02:13.744 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.744 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:02:13.744 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.744 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:171560 8.6 8:65953a38:::benchmark_data_smithi188_161190_object32278:head [delete] snapc 0=[] ondisk+write+known_if_redirected e690)", 2024-04-01T20:02:13.744 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:43.206778+0000", 2024-04-01T20:02:13.744 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 330.48970082699998, 2024-04-01T20:02:13.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.28133534199999999, 2024-04-01T20:02:13.744 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:02:13.744 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:02:13.744 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:02:13.744 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T20:02:13.744 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T20:02:13.744 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:02:13.744 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 171560 2024-04-01T20:02:13.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.745 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:02:13.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:02:13.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.206778+0000", 2024-04-01T20:02:13.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:02:13.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.206778+0000", 2024-04-01T20:02:13.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:02:13.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.206781+0000", 2024-04-01T20:02:13.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.852e-06 2024-04-01T20:02:13.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:02:13.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.206792+0000", 2024-04-01T20:02:13.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0404000000000001e-05 2024-04-01T20:02:13.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:02:13.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.206804+0000", 2024-04-01T20:02:13.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2235000000000001e-05 2024-04-01T20:02:13.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:02:13.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.206812+0000", 2024-04-01T20:02:13.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7810000000000005e-06 2024-04-01T20:02:13.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.747 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.747 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.747 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.336077+0000", 2024-04-01T20:02:13.747 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.12926535 2024-04-01T20:02:13.747 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.747 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.747 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T20:02:13.747 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.336676+0000", 2024-04-01T20:02:13.747 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00059951899999999996 2024-04-01T20:02:13.747 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.747 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.747 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.747 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.361304+0000", 2024-04-01T20:02:13.747 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.024627454999999999 2024-04-01T20:02:13.747 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.747 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T20:02:13.748 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.361383+0000", 2024-04-01T20:02:13.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8684999999999996e-05 2024-04-01T20:02:13.748 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.748 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 7", 2024-04-01T20:02:13.748 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.361491+0000", 2024-04-01T20:02:13.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010888800000000001 2024-04-01T20:02:13.748 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.748 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T20:02:13.748 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.384693+0000", 2024-04-01T20:02:13.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023201368 2024-04-01T20:02:13.748 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.748 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:02:13.749 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.483620+0000", 2024-04-01T20:02:13.749 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.098927541999999993 2024-04-01T20:02:13.749 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.749 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.749 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T20:02:13.749 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.483680+0000", 2024-04-01T20:02:13.749 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9809000000000003e-05 2024-04-01T20:02:13.749 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.749 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.749 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T20:02:13.749 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.488114+0000", 2024-04-01T20:02:13.749 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0044334539999999999 2024-04-01T20:02:13.749 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.749 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:02:13.749 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.750 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.750 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:171562 8.6 8:66be2490:::benchmark_data_smithi188_161190_object32280:head [delete] snapc 0=[] ondisk+write+known_if_redirected e690)", 2024-04-01T20:02:13.750 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:43.206867+0000", 2024-04-01T20:02:13.750 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 330.48961208200001, 2024-04-01T20:02:13.750 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.28561927799999998, 2024-04-01T20:02:13.750 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:02:13.750 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:02:13.750 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:02:13.750 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T20:02:13.750 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T20:02:13.750 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:02:13.750 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 171562 2024-04-01T20:02:13.750 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.751 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:02:13.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:02:13.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.206867+0000", 2024-04-01T20:02:13.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:02:13.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.206867+0000", 2024-04-01T20:02:13.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:02:13.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.206868+0000", 2024-04-01T20:02:13.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.186e-06 2024-04-01T20:02:13.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:02:13.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.206873+0000", 2024-04-01T20:02:13.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7029999999999997e-06 2024-04-01T20:02:13.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:02:13.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.206880+0000", 2024-04-01T20:02:13.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4070000000000004e-06 2024-04-01T20:02:13.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:02:13.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.206885+0000", 2024-04-01T20:02:13.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8720000000000001e-06 2024-04-01T20:02:13.753 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.753 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.753 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.753 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.336728+0000", 2024-04-01T20:02:13.753 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.12984235399999999 2024-04-01T20:02:13.753 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.753 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.753 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T20:02:13.753 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.337265+0000", 2024-04-01T20:02:13.753 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00053725699999999997 2024-04-01T20:02:13.753 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.753 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.753 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.753 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.372042+0000", 2024-04-01T20:02:13.753 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034777300999999997 2024-04-01T20:02:13.753 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.753 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.754 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T20:02:13.754 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.372141+0000", 2024-04-01T20:02:13.754 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9281e-05 2024-04-01T20:02:13.754 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.754 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.754 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 7", 2024-04-01T20:02:13.754 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.372291+0000", 2024-04-01T20:02:13.754 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014947100000000001 2024-04-01T20:02:13.754 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.754 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.754 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T20:02:13.754 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.388948+0000", 2024-04-01T20:02:13.754 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016657603999999999 2024-04-01T20:02:13.754 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.754 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.755 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:02:13.755 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.488178+0000", 2024-04-01T20:02:13.755 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.099229687999999996 2024-04-01T20:02:13.755 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.755 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.755 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T20:02:13.755 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.488230+0000", 2024-04-01T20:02:13.755 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1700999999999998e-05 2024-04-01T20:02:13.755 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.755 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.755 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T20:02:13.755 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.492486+0000", 2024-04-01T20:02:13.755 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0042564530000000003 2024-04-01T20:02:13.755 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.755 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:02:13.755 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.755 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.756 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.756 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:171567 8.6 8:6140cec1:::benchmark_data_smithi188_161190_object32285:head [delete] snapc 0=[] ondisk+write+known_if_redirected e690)", 2024-04-01T20:02:13.756 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:43.246544+0000", 2024-04-01T20:02:13.756 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 330.44993552900002, 2024-04-01T20:02:13.756 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.25015635600000002, 2024-04-01T20:02:13.756 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:02:13.756 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:02:13.756 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:02:13.756 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T20:02:13.756 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T20:02:13.756 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:02:13.756 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 171567 2024-04-01T20:02:13.756 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.756 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:02:13.756 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.756 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:02:13.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.246544+0000", 2024-04-01T20:02:13.757 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.757 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.757 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.757 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:02:13.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.246544+0000", 2024-04-01T20:02:13.757 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.757 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.757 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.757 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:02:13.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.246546+0000", 2024-04-01T20:02:13.757 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4310000000000001e-06 2024-04-01T20:02:13.757 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.757 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.757 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:02:13.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.246554+0000", 2024-04-01T20:02:13.758 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5299999999999999e-06 2024-04-01T20:02:13.758 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.758 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.758 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:02:13.758 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.246565+0000", 2024-04-01T20:02:13.758 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1887e-05 2024-04-01T20:02:13.758 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.758 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.758 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:02:13.758 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.246572+0000", 2024-04-01T20:02:13.758 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9210000000000003e-06 2024-04-01T20:02:13.758 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.758 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.758 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.758 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.337331+0000", 2024-04-01T20:02:13.758 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.090758491999999996 2024-04-01T20:02:13.759 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.759 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.759 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T20:02:13.759 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.337814+0000", 2024-04-01T20:02:13.759 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00048355300000000001 2024-04-01T20:02:13.759 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.759 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.759 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.759 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.384725+0000", 2024-04-01T20:02:13.759 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.046910489 2024-04-01T20:02:13.759 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.759 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.759 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T20:02:13.759 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.384796+0000", 2024-04-01T20:02:13.759 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1036000000000002e-05 2024-04-01T20:02:13.759 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.759 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.760 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 7", 2024-04-01T20:02:13.760 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.384928+0000", 2024-04-01T20:02:13.760 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000132175 2024-04-01T20:02:13.760 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.760 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.760 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T20:02:13.760 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.411587+0000", 2024-04-01T20:02:13.760 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026658602 2024-04-01T20:02:13.760 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.760 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.760 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:02:13.760 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.492533+0000", 2024-04-01T20:02:13.760 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.080946362999999993 2024-04-01T20:02:13.760 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.760 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.761 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T20:02:13.761 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.492569+0000", 2024-04-01T20:02:13.761 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6334999999999997e-05 2024-04-01T20:02:13.761 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.761 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.761 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T20:02:13.761 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.496700+0000", 2024-04-01T20:02:13.761 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0041305420000000001 2024-04-01T20:02:13.761 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.761 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:02:13.761 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.761 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.761 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.761 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:171568 8.6 8:60e68e7c:::benchmark_data_smithi188_161190_object32286:head [delete] snapc 0=[] ondisk+write+known_if_redirected e690)", 2024-04-01T20:02:13.761 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:43.246584+0000", 2024-04-01T20:02:13.761 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 330.449894712, 2024-04-01T20:02:13.762 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.253975966, 2024-04-01T20:02:13.762 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:02:13.762 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:02:13.762 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:02:13.762 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T20:02:13.762 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T20:02:13.762 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:02:13.762 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 171568 2024-04-01T20:02:13.762 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.762 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:02:13.762 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.762 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:02:13.762 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.246584+0000", 2024-04-01T20:02:13.762 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.762 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.763 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.763 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:02:13.763 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.246584+0000", 2024-04-01T20:02:13.763 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.763 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.763 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.763 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:02:13.763 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.246585+0000", 2024-04-01T20:02:13.763 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4900000000000005e-07 2024-04-01T20:02:13.763 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.763 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.763 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:02:13.763 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.246588+0000", 2024-04-01T20:02:13.763 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3129999999999999e-06 2024-04-01T20:02:13.763 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.763 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.763 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:02:13.764 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.246594+0000", 2024-04-01T20:02:13.764 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2220000000000001e-06 2024-04-01T20:02:13.764 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.764 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.764 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:02:13.764 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.246599+0000", 2024-04-01T20:02:13.764 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5890000000000002e-06 2024-04-01T20:02:13.764 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.764 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.764 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.764 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.337856+0000", 2024-04-01T20:02:13.764 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.091256867000000005 2024-04-01T20:02:13.764 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.764 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.764 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T20:02:13.765 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.338461+0000", 2024-04-01T20:02:13.765 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00060456400000000003 2024-04-01T20:02:13.765 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.765 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.765 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.765 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.396477+0000", 2024-04-01T20:02:13.765 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.058016124000000002 2024-04-01T20:02:13.765 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.765 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.765 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T20:02:13.765 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.396542+0000", 2024-04-01T20:02:13.765 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5012999999999996e-05 2024-04-01T20:02:13.765 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.765 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.765 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 7", 2024-04-01T20:02:13.765 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.396627+0000", 2024-04-01T20:02:13.766 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5668999999999996e-05 2024-04-01T20:02:13.766 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.766 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.766 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T20:02:13.766 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.422943+0000", 2024-04-01T20:02:13.766 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026315541000000001 2024-04-01T20:02:13.766 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.766 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.766 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:02:13.766 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.496776+0000", 2024-04-01T20:02:13.766 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.073832780000000001 2024-04-01T20:02:13.766 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.766 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.766 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T20:02:13.766 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.496836+0000", 2024-04-01T20:02:13.766 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0068999999999997e-05 2024-04-01T20:02:13.767 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.767 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.767 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T20:02:13.767 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.500560+0000", 2024-04-01T20:02:13.767 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0037244660000000001 2024-04-01T20:02:13.767 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.767 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:02:13.767 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.767 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.767 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.767 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:171582 8.6 8:6a291430:::benchmark_data_smithi188_161190_object32300:head [delete] snapc 0=[] ondisk+write+known_if_redirected e690)", 2024-04-01T20:02:13.767 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:43.278740+0000", 2024-04-01T20:02:13.767 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 330.41773862999997, 2024-04-01T20:02:13.767 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.22503316600000001, 2024-04-01T20:02:13.767 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:02:13.767 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:02:13.768 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:02:13.768 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T20:02:13.768 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T20:02:13.768 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:02:13.768 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 171582 2024-04-01T20:02:13.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.768 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:02:13.768 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.768 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:02:13.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.278740+0000", 2024-04-01T20:02:13.768 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.768 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.768 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:02:13.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.278740+0000", 2024-04-01T20:02:13.768 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.769 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:02:13.769 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.278743+0000", 2024-04-01T20:02:13.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.08e-06 2024-04-01T20:02:13.769 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.769 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:02:13.769 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.278749+0000", 2024-04-01T20:02:13.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6880000000000002e-06 2024-04-01T20:02:13.769 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.769 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:02:13.769 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.278761+0000", 2024-04-01T20:02:13.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1780000000000001e-05 2024-04-01T20:02:13.769 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.770 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:02:13.770 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.278768+0000", 2024-04-01T20:02:13.770 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3780000000000003e-06 2024-04-01T20:02:13.770 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.770 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.770 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.770 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.338501+0000", 2024-04-01T20:02:13.770 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.059732711000000001 2024-04-01T20:02:13.770 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.770 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.770 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T20:02:13.770 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.338977+0000", 2024-04-01T20:02:13.770 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00047590000000000002 2024-04-01T20:02:13.770 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.770 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.771 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.771 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.407542+0000", 2024-04-01T20:02:13.771 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.068565040999999993 2024-04-01T20:02:13.771 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.771 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.771 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T20:02:13.771 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.407613+0000", 2024-04-01T20:02:13.771 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1247000000000004e-05 2024-04-01T20:02:13.771 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.771 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.771 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 7", 2024-04-01T20:02:13.771 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.407715+0000", 2024-04-01T20:02:13.771 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000102216 2024-04-01T20:02:13.771 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.771 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.772 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T20:02:13.772 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.434730+0000", 2024-04-01T20:02:13.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027014251999999999 2024-04-01T20:02:13.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.772 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.772 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:02:13.772 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.500611+0000", 2024-04-01T20:02:13.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.065880843999999994 2024-04-01T20:02:13.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.772 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.772 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T20:02:13.772 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.500645+0000", 2024-04-01T20:02:13.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4582000000000002e-05 2024-04-01T20:02:13.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.772 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.772 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T20:02:13.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:43.503774+0000", 2024-04-01T20:02:13.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031284469999999999 2024-04-01T20:02:13.773 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.773 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:02:13.773 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.773 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:176236 8.6 8:619d2bb6:::benchmark_data_smithi188_161190_object36954:head [delete] snapc 0=[] ondisk+write+known_if_redirected e691)", 2024-04-01T20:02:13.773 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:50.875093+0000", 2024-04-01T20:02:13.773 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 322.821385867, 2024-04-01T20:02:13.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.24717445900000001, 2024-04-01T20:02:13.773 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:02:13.773 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:02:13.773 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:02:13.773 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T20:02:13.774 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T20:02:13.774 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:02:13.774 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 176236 2024-04-01T20:02:13.774 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.774 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:02:13.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.774 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:02:13.774 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:50.875093+0000", 2024-04-01T20:02:13.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.774 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.774 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:02:13.774 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:50.875093+0000", 2024-04-01T20:02:13.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.774 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.775 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.775 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:02:13.775 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:50.875094+0000", 2024-04-01T20:02:13.775 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.159e-06 2024-04-01T20:02:13.775 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.775 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.775 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:02:13.775 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:50.875098+0000", 2024-04-01T20:02:13.775 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0629999999999999e-06 2024-04-01T20:02:13.775 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.775 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.775 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:02:13.775 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:50.875104+0000", 2024-04-01T20:02:13.775 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.485e-06 2024-04-01T20:02:13.775 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.776 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.776 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:02:13.776 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:50.875108+0000", 2024-04-01T20:02:13.776 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4259999999999996e-06 2024-04-01T20:02:13.776 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.776 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.776 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.776 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.007440+0000", 2024-04-01T20:02:13.776 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13233178700000001 2024-04-01T20:02:13.776 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.776 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.776 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T20:02:13.776 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.007503+0000", 2024-04-01T20:02:13.776 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3343999999999995e-05 2024-04-01T20:02:13.776 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.021686+0000", 2024-04-01T20:02:13.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014182693999999999 2024-04-01T20:02:13.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T20:02:13.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.021773+0000", 2024-04-01T20:02:13.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7162000000000003e-05 2024-04-01T20:02:13.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 7", 2024-04-01T20:02:13.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.021878+0000", 2024-04-01T20:02:13.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000104706 2024-04-01T20:02:13.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.778 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T20:02:13.778 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.040696+0000", 2024-04-01T20:02:13.778 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018817758 2024-04-01T20:02:13.778 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.778 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.778 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:02:13.778 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.118762+0000", 2024-04-01T20:02:13.778 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.078065857000000002 2024-04-01T20:02:13.778 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.778 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.778 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T20:02:13.778 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.118825+0000", 2024-04-01T20:02:13.778 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2965000000000004e-05 2024-04-01T20:02:13.778 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.778 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.778 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T20:02:13.779 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.122268+0000", 2024-04-01T20:02:13.779 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0034430530000000002 2024-04-01T20:02:13.779 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.779 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:02:13.779 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.779 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.779 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.779 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:176238 8.6 8:6c718e26:::benchmark_data_smithi188_161190_object36956:head [delete] snapc 0=[] ondisk+write+known_if_redirected e691)", 2024-04-01T20:02:13.779 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:50.875306+0000", 2024-04-01T20:02:13.779 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 322.82117335200002, 2024-04-01T20:02:13.779 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.28142732799999998, 2024-04-01T20:02:13.779 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:02:13.779 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:02:13.779 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:02:13.779 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T20:02:13.779 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T20:02:13.780 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:02:13.780 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 176238 2024-04-01T20:02:13.780 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.780 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:02:13.780 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.780 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:02:13.780 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:50.875306+0000", 2024-04-01T20:02:13.780 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.780 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.780 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.780 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:02:13.780 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:50.875306+0000", 2024-04-01T20:02:13.780 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.780 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.780 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.780 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:02:13.781 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:50.875307+0000", 2024-04-01T20:02:13.781 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8100000000000002e-07 2024-04-01T20:02:13.781 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.781 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.781 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:02:13.781 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:50.875310+0000", 2024-04-01T20:02:13.781 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.433e-06 2024-04-01T20:02:13.781 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.781 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.781 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:02:13.781 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:50.875316+0000", 2024-04-01T20:02:13.781 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1249999999999998e-06 2024-04-01T20:02:13.781 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.781 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.781 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:02:13.781 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:50.875320+0000", 2024-04-01T20:02:13.782 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0040000000000001e-06 2024-04-01T20:02:13.782 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.782 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.782 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.782 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.011477+0000", 2024-04-01T20:02:13.782 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.13615714200000001 2024-04-01T20:02:13.782 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.782 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.782 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T20:02:13.782 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.012006+0000", 2024-04-01T20:02:13.782 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00052850300000000005 2024-04-01T20:02:13.782 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.782 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.782 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.782 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.061619+0000", 2024-04-01T20:02:13.782 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.049613537999999999 2024-04-01T20:02:13.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T20:02:13.783 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.061678+0000", 2024-04-01T20:02:13.783 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8711000000000001e-05 2024-04-01T20:02:13.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 7", 2024-04-01T20:02:13.783 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.061756+0000", 2024-04-01T20:02:13.783 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8207999999999994e-05 2024-04-01T20:02:13.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T20:02:13.783 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.076183+0000", 2024-04-01T20:02:13.783 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014426690000000001 2024-04-01T20:02:13.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.784 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.784 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:02:13.784 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.153064+0000", 2024-04-01T20:02:13.784 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.076881122999999996 2024-04-01T20:02:13.784 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.784 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.784 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T20:02:13.784 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.153101+0000", 2024-04-01T20:02:13.784 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6973e-05 2024-04-01T20:02:13.784 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.784 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.784 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T20:02:13.784 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.156733+0000", 2024-04-01T20:02:13.784 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036320969999999999 2024-04-01T20:02:13.784 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.784 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:02:13.784 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.785 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.785 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.785 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:176267 8.6 8:608daf81:::benchmark_data_smithi188_161190_object36985:head [delete] snapc 0=[] ondisk+write+known_if_redirected e691)", 2024-04-01T20:02:13.785 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:56:51.017714+0000", 2024-04-01T20:02:13.785 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 322.67876504200001, 2024-04-01T20:02:13.785 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.229489213, 2024-04-01T20:02:13.785 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:02:13.785 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:02:13.785 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:02:13.785 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T20:02:13.785 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T20:02:13.785 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:02:13.785 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 176267 2024-04-01T20:02:13.785 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.785 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:02:13.786 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.786 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:02:13.786 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.017714+0000", 2024-04-01T20:02:13.786 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.786 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.786 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.786 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:02:13.786 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.017714+0000", 2024-04-01T20:02:13.786 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.786 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.786 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.786 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:02:13.786 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.017716+0000", 2024-04-01T20:02:13.786 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.875e-06 2024-04-01T20:02:13.786 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.786 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.787 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:02:13.787 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.017721+0000", 2024-04-01T20:02:13.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0579999999999997e-06 2024-04-01T20:02:13.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.787 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.787 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:02:13.787 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.017731+0000", 2024-04-01T20:02:13.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7790000000000007e-06 2024-04-01T20:02:13.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.787 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.787 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:02:13.787 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.017739+0000", 2024-04-01T20:02:13.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0190000000000006e-06 2024-04-01T20:02:13.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.788 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.039279+0000", 2024-04-01T20:02:13.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.021540442 2024-04-01T20:02:13.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.788 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T20:02:13.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.039361+0000", 2024-04-01T20:02:13.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1630000000000003e-05 2024-04-01T20:02:13.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.788 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.198813+0000", 2024-04-01T20:02:13.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.15945219299999999 2024-04-01T20:02:13.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.789 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T20:02:13.789 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.198878+0000", 2024-04-01T20:02:13.789 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4586999999999997e-05 2024-04-01T20:02:13.789 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.789 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.789 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 7", 2024-04-01T20:02:13.789 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.199007+0000", 2024-04-01T20:02:13.789 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012929099999999999 2024-04-01T20:02:13.789 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.789 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.789 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T20:02:13.789 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.231533+0000", 2024-04-01T20:02:13.789 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.032525652000000002 2024-04-01T20:02:13.789 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.789 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.789 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:02:13.790 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.243876+0000", 2024-04-01T20:02:13.790 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012342937999999999 2024-04-01T20:02:13.790 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.790 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.790 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T20:02:13.790 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.243912+0000", 2024-04-01T20:02:13.790 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6125999999999999e-05 2024-04-01T20:02:13.790 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.790 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.790 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T20:02:13.790 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:56:51.247203+0000", 2024-04-01T20:02:13.790 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.003291623 2024-04-01T20:02:13.790 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.790 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:02:13.790 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.791 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.791 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.791 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:188437 8.7 8:e49277ca:::benchmark_data_smithi188_161190_object49155:head [delete] snapc 0=[] ondisk+write+known_if_redirected e696)", 2024-04-01T20:02:13.791 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:57:09.999899+0000", 2024-04-01T20:02:13.791 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 303.69657979900001, 2024-04-01T20:02:13.791 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.23475475900000001, 2024-04-01T20:02:13.791 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:02:13.791 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:02:13.791 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:02:13.791 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T20:02:13.791 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T20:02:13.791 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:02:13.791 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 188437 2024-04-01T20:02:13.791 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.791 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:02:13.792 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.792 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:02:13.792 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:09.999899+0000", 2024-04-01T20:02:13.792 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.792 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.792 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.792 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:02:13.792 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:09.999899+0000", 2024-04-01T20:02:13.792 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.792 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.792 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.792 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:02:13.792 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:09.999903+0000", 2024-04-01T20:02:13.792 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.393e-06 2024-04-01T20:02:13.792 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.792 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.793 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:02:13.793 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:09.999910+0000", 2024-04-01T20:02:13.793 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6140000000000003e-06 2024-04-01T20:02:13.793 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.793 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.793 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:02:13.793 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:09.999927+0000", 2024-04-01T20:02:13.793 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6875999999999999e-05 2024-04-01T20:02:13.793 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.793 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.793 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:02:13.793 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:09.999936+0000", 2024-04-01T20:02:13.793 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9400000000000008e-06 2024-04-01T20:02:13.793 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.793 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.793 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.794 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:10.068312+0000", 2024-04-01T20:02:13.794 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.068375936999999998 2024-04-01T20:02:13.794 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.794 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.794 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T20:02:13.794 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:10.068383+0000", 2024-04-01T20:02:13.794 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0982999999999994e-05 2024-04-01T20:02:13.794 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.794 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.794 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.794 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:10.184430+0000", 2024-04-01T20:02:13.794 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.11604685100000001 2024-04-01T20:02:13.794 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.794 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.794 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T20:02:13.795 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:10.184490+0000", 2024-04-01T20:02:13.795 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9809999999999998e-05 2024-04-01T20:02:13.795 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.795 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.795 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T20:02:13.795 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:10.184566+0000", 2024-04-01T20:02:13.795 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6292999999999996e-05 2024-04-01T20:02:13.795 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.795 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.795 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T20:02:13.795 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:10.213308+0000", 2024-04-01T20:02:13.795 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028741791999999999 2024-04-01T20:02:13.795 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.795 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.795 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:02:13.795 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:10.231824+0000", 2024-04-01T20:02:13.795 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018516583 2024-04-01T20:02:13.796 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.796 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.796 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T20:02:13.796 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:10.231862+0000", 2024-04-01T20:02:13.796 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.765e-05 2024-04-01T20:02:13.796 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.796 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.796 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T20:02:13.796 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:10.234654+0000", 2024-04-01T20:02:13.796 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0027920369999999998 2024-04-01T20:02:13.796 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.796 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:02:13.796 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.796 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.796 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.796 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:193057 8.7 8:e026767a:::benchmark_data_smithi188_161190_object53775:head [delete] snapc 0=[] ondisk+write+known_if_redirected e699)", 2024-04-01T20:02:13.797 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:57:16.924519+0000", 2024-04-01T20:02:13.797 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 296.77196005600001, 2024-04-01T20:02:13.797 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.263612285, 2024-04-01T20:02:13.797 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:02:13.797 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:02:13.797 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:02:13.797 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T20:02:13.797 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T20:02:13.797 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:02:13.797 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 193057 2024-04-01T20:02:13.797 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.797 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:02:13.797 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.797 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:02:13.797 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.924519+0000", 2024-04-01T20:02:13.797 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.798 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.798 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.798 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:02:13.798 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.924519+0000", 2024-04-01T20:02:13.798 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.798 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.798 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.798 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:02:13.798 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.924522+0000", 2024-04-01T20:02:13.798 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0620000000000001e-06 2024-04-01T20:02:13.798 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.798 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.798 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:02:13.798 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.924530+0000", 2024-04-01T20:02:13.798 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3119999999999994e-06 2024-04-01T20:02:13.798 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.799 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.799 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:02:13.799 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.924544+0000", 2024-04-01T20:02:13.799 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3675e-05 2024-04-01T20:02:13.799 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.799 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.799 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:02:13.799 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.924555+0000", 2024-04-01T20:02:13.799 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0514e-05 2024-04-01T20:02:13.799 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.799 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.799 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.799 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.927622+0000", 2024-04-01T20:02:13.799 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030675609999999999 2024-04-01T20:02:13.799 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.800 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.800 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T20:02:13.800 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:16.927687+0000", 2024-04-01T20:02:13.800 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4517999999999995e-05 2024-04-01T20:02:13.800 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.800 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.800 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.800 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:17.166978+0000", 2024-04-01T20:02:13.800 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.23929161400000001 2024-04-01T20:02:13.800 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.800 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.800 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T20:02:13.800 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:17.167088+0000", 2024-04-01T20:02:13.800 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010994599999999999 2024-04-01T20:02:13.800 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.801 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.801 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T20:02:13.801 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:17.167246+0000", 2024-04-01T20:02:13.801 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015796399999999999 2024-04-01T20:02:13.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.801 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.801 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T20:02:13.801 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:17.186228+0000", 2024-04-01T20:02:13.801 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018981326 2024-04-01T20:02:13.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.801 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.801 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:02:13.801 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:17.186270+0000", 2024-04-01T20:02:13.801 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2123000000000003e-05 2024-04-01T20:02:13.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.802 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.802 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T20:02:13.802 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:17.186332+0000", 2024-04-01T20:02:13.802 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2501000000000003e-05 2024-04-01T20:02:13.802 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.802 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.802 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T20:02:13.802 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:57:17.188131+0000", 2024-04-01T20:02:13.802 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001799169 2024-04-01T20:02:13.802 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.802 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:02:13.802 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.802 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.802 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.802 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:245414 8.7 8:e8102682:::benchmark_data_smithi188_161190_object106132:head [delete] snapc 0=[] ondisk+write+known_if_redirected e714)", 2024-04-01T20:02:13.802 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:58:26.717628+0000", 2024-04-01T20:02:13.803 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 226.97885101, 2024-04-01T20:02:13.803 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.23649979300000001, 2024-04-01T20:02:13.803 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:02:13.803 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:02:13.803 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:02:13.803 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T20:02:13.803 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T20:02:13.803 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:02:13.803 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 245414 2024-04-01T20:02:13.803 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.803 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:02:13.803 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.803 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:02:13.803 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:26.717628+0000", 2024-04-01T20:02:13.803 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.803 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.804 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.804 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:02:13.804 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:26.717628+0000", 2024-04-01T20:02:13.804 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.804 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.804 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.804 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:02:13.804 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:26.717630+0000", 2024-04-01T20:02:13.804 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.672e-06 2024-04-01T20:02:13.804 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.804 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.804 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:02:13.804 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:26.717635+0000", 2024-04-01T20:02:13.804 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2970000000000003e-06 2024-04-01T20:02:13.804 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.804 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.804 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:02:13.805 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:26.717647+0000", 2024-04-01T20:02:13.805 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2232000000000001e-05 2024-04-01T20:02:13.805 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.805 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.805 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:02:13.805 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:26.717655+0000", 2024-04-01T20:02:13.805 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5299999999999999e-06 2024-04-01T20:02:13.805 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.805 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.805 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.805 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:26.717713+0000", 2024-04-01T20:02:13.805 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7862000000000003e-05 2024-04-01T20:02:13.805 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.805 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.805 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T20:02:13.805 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:26.717809+0000", 2024-04-01T20:02:13.806 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.6608999999999996e-05 2024-04-01T20:02:13.806 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.806 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.806 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T20:02:13.806 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:26.717934+0000", 2024-04-01T20:02:13.806 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012496299999999999 2024-04-01T20:02:13.806 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.806 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.806 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T20:02:13.806 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:26.723941+0000", 2024-04-01T20:02:13.806 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060070399999999999 2024-04-01T20:02:13.806 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.806 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.806 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:02:13.806 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:26.952384+0000", 2024-04-01T20:02:13.806 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.228443173 2024-04-01T20:02:13.807 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.807 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.807 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T20:02:13.807 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:26.952459+0000", 2024-04-01T20:02:13.807 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4369000000000006e-05 2024-04-01T20:02:13.807 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.807 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.807 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T20:02:13.807 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:26.954128+0000", 2024-04-01T20:02:13.807 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001669046 2024-04-01T20:02:13.807 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.807 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:02:13.807 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.807 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.807 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.807 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.26983.0:245460 8.7 8:ec045bd1:::benchmark_data_smithi188_161190_object106178:head [delete] snapc 0=[] ondisk+write+known_if_redirected e714)", 2024-04-01T20:02:13.807 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T19:58:26.772946+0000", 2024-04-01T20:02:13.808 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 226.92353328999999, 2024-04-01T20:02:13.808 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.23367413200000001, 2024-04-01T20:02:13.808 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:02:13.808 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:02:13.808 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:02:13.808 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T20:02:13.808 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.26983", 2024-04-01T20:02:13.808 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/2668161221", 2024-04-01T20:02:13.808 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 245460 2024-04-01T20:02:13.808 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.808 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:02:13.808 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.808 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:02:13.808 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:26.772946+0000", 2024-04-01T20:02:13.808 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.808 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.809 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.809 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:02:13.809 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:26.772946+0000", 2024-04-01T20:02:13.809 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:13.809 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.809 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.809 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:02:13.809 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:26.772947+0000", 2024-04-01T20:02:13.809 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4200000000000004e-07 2024-04-01T20:02:13.809 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.809 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.809 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:02:13.809 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:26.772951+0000", 2024-04-01T20:02:13.809 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0110000000000002e-06 2024-04-01T20:02:13.809 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.809 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.810 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:02:13.810 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:26.772957+0000", 2024-04-01T20:02:13.810 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7159999999999997e-06 2024-04-01T20:02:13.810 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.810 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.810 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:02:13.810 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:26.772964+0000", 2024-04-01T20:02:13.810 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0519999999999998e-06 2024-04-01T20:02:13.810 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.810 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.810 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.810 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:26.773035+0000", 2024-04-01T20:02:13.810 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1928000000000007e-05 2024-04-01T20:02:13.810 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.810 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.811 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for degraded object", 2024-04-01T20:02:13.811 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:26.773095+0000", 2024-04-01T20:02:13.811 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9497999999999999e-05 2024-04-01T20:02:13.811 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.811 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.811 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:13.811 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:26.990873+0000", 2024-04-01T20:02:13.811 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.21777816899999999 2024-04-01T20:02:13.811 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.811 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.811 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T20:02:13.811 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:26.990992+0000", 2024-04-01T20:02:13.811 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119317 2024-04-01T20:02:13.811 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.811 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.812 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 2", 2024-04-01T20:02:13.812 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:26.991175+0000", 2024-04-01T20:02:13.812 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018255699999999999 2024-04-01T20:02:13.812 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.812 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.812 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-01T20:02:13.812 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:27.005056+0000", 2024-04-01T20:02:13.812 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013880612000000001 2024-04-01T20:02:13.812 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.812 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.812 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T20:02:13.812 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:27.005063+0000", 2024-04-01T20:02:13.812 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8560000000000007e-06 2024-04-01T20:02:13.812 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.812 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.812 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-01T20:02:13.812 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:27.005094+0000", 2024-04-01T20:02:13.813 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0341999999999999e-05 2024-04-01T20:02:13.813 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:13.813 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:13.813 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-01T20:02:13.813 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T19:58:27.006620+0000", 2024-04-01T20:02:13.813 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015261319999999999 2024-04-01T20:02:13.813 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.813 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:02:13.813 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.813 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:13.813 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:02:13.813 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T20:02:13.814 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:13.815 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:13.815 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:02:13.815 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:02:13.875 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.2 to 1 (10000) 2024-04-01T20:02:13.916 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:02:13.954 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:14.001 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:02:14.006 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:13 smithi062 ceph-mon[44211]: 9.3 scrub starts 2024-04-01T20:02:14.007 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:13 smithi062 ceph-mon[44211]: osdmap e795: 12 total, 12 up, 9 in 2024-04-01T20:02:14.007 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:13 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2717234299' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:02:14.007 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:14.007 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:14.007 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:14.007 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:13 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3156856354' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T20:02:14.007 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:14.007 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:14.007 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:14.007 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:14.007 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:14.007 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:13 smithi062 ceph-mon[44211]: pgmap v2156: 17 pgs: 3 peering, 6 active+remapped+backfilling, 8 active+clean; 6.8 GiB data, 19 GiB used, 786 GiB / 805 GiB avail; 0 B/s wr, 543 op/s; 18766/224168 objects misplaced (8.371%); 129 MiB/s, 2.06k objects/s recovering 2024-04-01T20:02:14.008 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:14.008 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:02:14.109 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:02:14.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:13 smithi188 ceph-mon[43939]: 9.3 scrub starts 2024-04-01T20:02:14.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:13 smithi188 ceph-mon[43939]: osdmap e795: 12 total, 12 up, 9 in 2024-04-01T20:02:14.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:13 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2717234299' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:02:14.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:14.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:14.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:14.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:13 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3156856354' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T20:02:14.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:14.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:14.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:14.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:14.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:14.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:13 smithi188 ceph-mon[43939]: pgmap v2156: 17 pgs: 3 peering, 6 active+remapped+backfilling, 8 active+clean; 6.8 GiB data, 19 GiB used, 786 GiB / 805 GiB avail; 0 B/s wr, 543 op/s; 18766/224168 objects misplaced (8.371%); 129 MiB/s, 2.06k objects/s recovering 2024-04-01T20:02:14.167 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:14.175 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:13 smithi022 ceph-mon[39439]: 9.3 scrub starts 2024-04-01T20:02:14.175 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:13 smithi022 ceph-mon[39439]: osdmap e795: 12 total, 12 up, 9 in 2024-04-01T20:02:14.175 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:13 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2717234299' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:02:14.175 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:14.175 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:14.175 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:14.176 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:13 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3156856354' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T20:02:14.176 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:14.176 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:14.176 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:14.176 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:14.176 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:14.176 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:13 smithi022 ceph-mon[39439]: pgmap v2156: 17 pgs: 3 peering, 6 active+remapped+backfilling, 8 active+clean; 6.8 GiB data, 19 GiB used, 786 GiB / 805 GiB avail; 0 B/s wr, 543 op/s; 18766/224168 objects misplaced (8.371%); 129 MiB/s, 2.06k objects/s recovering 2024-04-01T20:02:14.208 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:02:14.216 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:14.217 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:02:14.318 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:02:14.354 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:14.376 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:02:14.378 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:14.378 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:02:14.479 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:02:14.555 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:14.601 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:02:14.604 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:14.604 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:02:14.705 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:02:14.747 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:15.106 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:02:15.108 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:15.108 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:15.109 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:15.109 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:14 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:15.109 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:14 smithi188 ceph-mon[43939]: 9.3 scrub ok 2024-04-01T20:02:15.109 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:14 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3156856354' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-04-01T20:02:15.109 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:14 smithi188 ceph-mon[43939]: osdmap e796: 12 total, 12 up, 9 in 2024-04-01T20:02:15.109 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:14 smithi188 ceph-mon[43939]: 9.4 scrub starts 2024-04-01T20:02:15.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:15.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:15.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:15.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:14 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:15.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:14 smithi022 ceph-mon[39439]: 9.3 scrub ok 2024-04-01T20:02:15.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:14 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3156856354' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-04-01T20:02:15.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:14 smithi022 ceph-mon[39439]: osdmap e796: 12 total, 12 up, 9 in 2024-04-01T20:02:15.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:14 smithi022 ceph-mon[39439]: 9.4 scrub starts 2024-04-01T20:02:15.132 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:15.133 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:02:15.234 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:02:15.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:15.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:15.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:15.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:14 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:15.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:14 smithi062 ceph-mon[44211]: 9.3 scrub ok 2024-04-01T20:02:15.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:14 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3156856354' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-04-01T20:02:15.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:14 smithi062 ceph-mon[44211]: osdmap e796: 12 total, 12 up, 9 in 2024-04-01T20:02:15.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:14 smithi062 ceph-mon[44211]: 9.4 scrub starts 2024-04-01T20:02:15.309 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:15.362 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:02:15.367 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:15.368 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:02:15.469 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:02:15.499 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:15.559 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:02:15.562 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:15.563 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:02:15.578 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_ops_in_flight 2024-04-01T20:02:15.595 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 4 1 2024-04-01T20:02:15.664 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:02:15.711 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:15.747 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:02:15.757 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:15.757 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:02:15.858 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:02:15.908 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:15.943 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:02:15.947 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:15.947 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:02:15.966 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:02:15.984 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T20:02:16.048 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:02:16.118 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:16.159 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:02:16.166 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:16.166 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:02:16.167 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:15 smithi062 ceph-mon[44211]: 9.2 scrub starts 2024-04-01T20:02:16.167 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:15 smithi062 ceph-mon[44211]: 9.4 scrub ok 2024-04-01T20:02:16.167 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:15 smithi062 ceph-mon[44211]: pgmap v2158: 17 pgs: 5 active+remapped+backfilling, 12 active+clean; 6.8 GiB data, 19 GiB used, 786 GiB / 805 GiB avail; 0 B/s wr, 527 op/s; 17702/222126 objects misplaced (7.969%); 95 MiB/s, 1.52k objects/s recovering 2024-04-01T20:02:16.210 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T20:02:16.236 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:15 smithi022 ceph-mon[39439]: 9.2 scrub starts 2024-04-01T20:02:16.236 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:15 smithi022 ceph-mon[39439]: 9.4 scrub ok 2024-04-01T20:02:16.236 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:15 smithi022 ceph-mon[39439]: pgmap v2158: 17 pgs: 5 active+remapped+backfilling, 12 active+clean; 6.8 GiB data, 19 GiB used, 786 GiB / 805 GiB avail; 0 B/s wr, 527 op/s; 17702/222126 objects misplaced (7.969%); 95 MiB/s, 1.52k objects/s recovering 2024-04-01T20:02:16.267 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:02:16.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:15 smithi188 ceph-mon[43939]: 9.2 scrub starts 2024-04-01T20:02:16.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:15 smithi188 ceph-mon[43939]: 9.4 scrub ok 2024-04-01T20:02:16.298 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:15 smithi188 ceph-mon[43939]: pgmap v2158: 17 pgs: 5 active+remapped+backfilling, 12 active+clean; 6.8 GiB data, 19 GiB used, 786 GiB / 805 GiB avail; 0 B/s wr, 527 op/s; 17702/222126 objects misplaced (7.969%); 95 MiB/s, 1.52k objects/s recovering 2024-04-01T20:02:16.306 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:16.349 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:02:16.356 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:16.356 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:02:16.457 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:02:16.531 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:16.572 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:02:16.576 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:16.576 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:02:16.677 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:02:16.710 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:16.912 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:16 smithi062 ceph-mon[44211]: 9.2 scrub ok 2024-04-01T20:02:16.912 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:16 smithi188 ceph-mon[43939]: 9.2 scrub ok 2024-04-01T20:02:17.269 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T20:02:17.300 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:16 smithi022 ceph-mon[39439]: 9.2 scrub ok 2024-04-01T20:02:17.465 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:02:17.993 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:17 smithi022 ceph-mon[39439]: pgmap v2159: 17 pgs: 5 active+remapped+backfilling, 12 active+clean; 6.6 GiB data, 18 GiB used, 786 GiB / 805 GiB avail; 0 B/s wr, 722 op/s; 13197/217304 objects misplaced (6.073%); 106 MiB/s, 1.69k objects/s recovering 2024-04-01T20:02:18.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:17 smithi062 ceph-mon[44211]: pgmap v2159: 17 pgs: 5 active+remapped+backfilling, 12 active+clean; 6.6 GiB data, 18 GiB used, 786 GiB / 805 GiB avail; 0 B/s wr, 722 op/s; 13197/217304 objects misplaced (6.073%); 106 MiB/s, 1.69k objects/s recovering 2024-04-01T20:02:18.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:17 smithi188 ceph-mon[43939]: pgmap v2159: 17 pgs: 5 active+remapped+backfilling, 12 active+clean; 6.6 GiB data, 18 GiB used, 786 GiB / 805 GiB avail; 0 B/s wr, 722 op/s; 13197/217304 objects misplaced (6.073%); 106 MiB/s, 1.69k objects/s recovering 2024-04-01T20:02:19.329 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:02:19.337 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:19.337 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:02:19.438 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:02:19.498 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:19.538 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:02:19.541 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:19.541 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:02:19.624 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:19 smithi188 ceph-mon[43939]: pgmap v2160: 17 pgs: 5 active+remapped+backfilling, 12 active+clean; 6.6 GiB data, 18 GiB used, 786 GiB / 805 GiB avail; 0 B/s wr, 686 op/s; 13197/215614 objects misplaced (6.121%); 74 MiB/s, 1.18k objects/s recovering 2024-04-01T20:02:19.642 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:02:19.678 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:19.708 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:02:19.714 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:19.714 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:02:19.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:19 smithi062 ceph-mon[44211]: pgmap v2160: 17 pgs: 5 active+remapped+backfilling, 12 active+clean; 6.6 GiB data, 18 GiB used, 786 GiB / 805 GiB avail; 0 B/s wr, 686 op/s; 13197/215614 objects misplaced (6.121%); 74 MiB/s, 1.18k objects/s recovering 2024-04-01T20:02:19.814 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:02:19.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:19 smithi022 ceph-mon[39439]: pgmap v2160: 17 pgs: 5 active+remapped+backfilling, 12 active+clean; 6.6 GiB data, 18 GiB used, 786 GiB / 805 GiB avail; 0 B/s wr, 686 op/s; 13197/215614 objects misplaced (6.121%); 74 MiB/s, 1.18k objects/s recovering 2024-04-01T20:02:19.887 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:19.924 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:19.924 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:02:19.924 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:02:20.025 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:02:20.059 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:20.102 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:02:20.106 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:20.106 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:02:20.207 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:02:20.214 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T20:02:20.214 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-01T20:02:20.214 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.214 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.27358.0:207689 9.b 9:dd7afb40:::benchmark_data_smithi188_173515_object51604:head [delete] snapc 0=[] ondisk+write+known_if_redirected e796)", 2024-04-01T20:02:20.214 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T20:02:20.205788+0000", 2024-04-01T20:02:20.215 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0074083589999999998, 2024-04-01T20:02:20.215 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074317280000000003, 2024-04-01T20:02:20.215 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:02:20.215 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:02:20.215 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "waiting for sub ops", 2024-04-01T20:02:20.215 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T20:02:20.215 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.27358", 2024-04-01T20:02:20.215 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:02:20.215 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 207689 2024-04-01T20:02:20.215 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:20.215 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:02:20.215 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.215 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:02:20.215 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:02:20.205788+0000", 2024-04-01T20:02:20.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:20.216 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:20.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:02:20.216 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:02:20.205788+0000", 2024-04-01T20:02:20.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:20.216 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:20.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:02:20.216 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:02:20.205789+0000", 2024-04-01T20:02:20.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.181e-06 2024-04-01T20:02:20.216 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:20.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:02:20.217 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:02:20.205793+0000", 2024-04-01T20:02:20.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5109999999999997e-06 2024-04-01T20:02:20.217 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:20.217 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.217 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:02:20.217 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:02:20.205800+0000", 2024-04-01T20:02:20.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0690000000000004e-06 2024-04-01T20:02:20.217 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:20.217 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.217 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:02:20.217 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:02:20.205808+0000", 2024-04-01T20:02:20.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2309999999999999e-06 2024-04-01T20:02:20.217 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:20.217 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.218 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:20.218 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:02:20.205859+0000", 2024-04-01T20:02:20.218 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1072000000000002e-05 2024-04-01T20:02:20.218 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:20.218 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.218 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T20:02:20.218 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:02:20.205959+0000", 2024-04-01T20:02:20.218 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000100713 2024-04-01T20:02:20.218 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:20.218 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.218 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 5", 2024-04-01T20:02:20.218 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:02:20.206063+0000", 2024-04-01T20:02:20.218 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000103273 2024-04-01T20:02:20.219 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:20.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-01T20:02:20.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:02:20.210933+0000", 2024-04-01T20:02:20.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0048702579999999997 2024-04-01T20:02:20.219 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:20.219 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:02:20.219 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:20.219 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:20.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.219 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.27358.0:207688 9.a e796/735 9:52c876d4:::benchmark_data_smithi188_173515_object51603:head v 796'13126, mlcod=796'13124)", 2024-04-01T20:02:20.219 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T20:02:20.213005+0000", 2024-04-01T20:02:20.219 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.00019105700000000001, 2024-04-01T20:02:20.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026827600000000002, 2024-04-01T20:02:20.219 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:02:20.220 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:02:20.220 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-01T20:02:20.220 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:02:20.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.220 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:02:20.220 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:02:20.213005+0000", 2024-04-01T20:02:20.220 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:20.220 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:20.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.220 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:02:20.220 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:02:20.213005+0000", 2024-04-01T20:02:20.220 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:20.220 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:20.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.220 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:02:20.221 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:02:20.213006+0000", 2024-04-01T20:02:20.221 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5239999999999999e-06 2024-04-01T20:02:20.221 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:20.221 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.221 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:02:20.221 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:02:20.213015+0000", 2024-04-01T20:02:20.221 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2709999999999992e-06 2024-04-01T20:02:20.221 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:20.221 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.221 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:02:20.221 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:02:20.213027+0000", 2024-04-01T20:02:20.221 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1914e-05 2024-04-01T20:02:20.221 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:20.221 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.221 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:02:20.222 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:02:20.213034+0000", 2024-04-01T20:02:20.222 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6299999999999998e-06 2024-04-01T20:02:20.222 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:20.222 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.222 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-01T20:02:20.222 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:02:20.213085+0000", 2024-04-01T20:02:20.222 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0841000000000003e-05 2024-04-01T20:02:20.222 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:20.222 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.222 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-01T20:02:20.222 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:02:20.213106+0000", 2024-04-01T20:02:20.222 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1288999999999999e-05 2024-04-01T20:02:20.222 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:20.223 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:02:20.223 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:20.223 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:20.223 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.223 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.27358.0:207698 9.b 9.a5c240bb (undecoded) ondisk+write+known_if_redirected e796)", 2024-04-01T20:02:20.223 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-01T20:02:20.213271+0000", 2024-04-01T20:02:20.223 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4294967295.9999247, 2024-04-01T20:02:20.223 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8300999999999998e-05, 2024-04-01T20:02:20.223 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-01T20:02:20.223 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-01T20:02:20.223 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "queued for pg", 2024-04-01T20:02:20.223 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-01T20:02:20.223 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.27358", 2024-04-01T20:02:20.223 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "v1:172.21.15.188:0/245006557", 2024-04-01T20:02:20.223 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 207698 2024-04-01T20:02:20.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:20.224 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-01T20:02:20.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-01T20:02:20.224 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:02:20.213271+0000", 2024-04-01T20:02:20.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:20.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:20.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-01T20:02:20.224 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:02:20.213271+0000", 2024-04-01T20:02:20.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-01T20:02:20.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:20.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-01T20:02:20.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:02:20.213273+0000", 2024-04-01T20:02:20.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0839999999999999e-06 2024-04-01T20:02:20.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:20.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-01T20:02:20.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:02:20.213279+0000", 2024-04-01T20:02:20.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0279999999999997e-06 2024-04-01T20:02:20.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:20.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-01T20:02:20.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:02:20.213290+0000", 2024-04-01T20:02:20.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1236999999999999e-05 2024-04-01T20:02:20.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-01T20:02:20.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-01T20:02:20.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-01T20:02:20.226 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-01T20:02:20.213298+0000", 2024-04-01T20:02:20.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9829999999999996e-06 2024-04-01T20:02:20.226 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:20.226 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-01T20:02:20.226 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:20.226 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-01T20:02:20.226 INFO:teuthology.orchestra.run.smithi188.stdout: ], 2024-04-01T20:02:20.226 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 3 2024-04-01T20:02:20.226 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T20:02:20.270 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:20.316 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:02:20.326 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:20.326 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:02:20.377 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:02:20.427 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:02:20.461 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:20.554 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.4 to 1 (10000) 2024-04-01T20:02:20.557 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:20 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4100937094' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T20:02:20.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:20 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4100937094' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T20:02:21.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:20 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4100937094' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T20:02:21.605 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_blocked_ops 2024-04-01T20:02:21.610 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T20:02:21.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:21 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4100937094' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-04-01T20:02:21.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:21 smithi022 ceph-mon[39439]: osdmap e797: 12 total, 12 up, 9 in 2024-04-01T20:02:21.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:21 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2272085307' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:02:21.636 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:21 smithi022 ceph-mon[39439]: pgmap v2162: 17 pgs: 5 active+remapped+backfilling, 12 active+clean; 6.5 GiB data, 18 GiB used, 787 GiB / 805 GiB avail; 0 B/s wr, 712 op/s; 11906/212766 objects misplaced (5.596%); 48 MiB/s, 769 objects/s recovering 2024-04-01T20:02:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:21 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4100937094' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-04-01T20:02:21.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:21 smithi188 ceph-mon[43939]: osdmap e797: 12 total, 12 up, 9 in 2024-04-01T20:02:21.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:21 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2272085307' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:02:21.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:21 smithi188 ceph-mon[43939]: pgmap v2162: 17 pgs: 5 active+remapped+backfilling, 12 active+clean; 6.5 GiB data, 18 GiB used, 787 GiB / 805 GiB avail; 0 B/s wr, 712 op/s; 11906/212766 objects misplaced (5.596%); 48 MiB/s, 769 objects/s recovering 2024-04-01T20:02:21.974 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T20:02:22.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:21 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4100937094' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-04-01T20:02:22.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:21 smithi062 ceph-mon[44211]: osdmap e797: 12 total, 12 up, 9 in 2024-04-01T20:02:22.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:21 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2272085307' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:02:22.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:21 smithi062 ceph-mon[44211]: pgmap v2162: 17 pgs: 5 active+remapped+backfilling, 12 active+clean; 6.5 GiB data, 18 GiB used, 787 GiB / 805 GiB avail; 0 B/s wr, 712 op/s; 11906/212766 objects misplaced (5.596%); 48 MiB/s, 769 objects/s recovering 2024-04-01T20:02:22.519 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:02:22.524 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:22.525 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:02:22.626 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:02:22.660 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:22.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:22 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:02:22.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:22 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:02:22.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:22 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:02:22.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:22 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2272085307' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T20:02:22.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:22 smithi022 ceph-mon[39439]: osdmap e798: 12 total, 12 up, 9 in 2024-04-01T20:02:22.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:22 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:02:22.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:22 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:02:22.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:22 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:02:22.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:22 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2272085307' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T20:02:22.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:22 smithi188 ceph-mon[43939]: osdmap e798: 12 total, 12 up, 9 in 2024-04-01T20:02:23.017 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:22 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:02:23.017 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:22 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:02:23.017 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:22 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:02:23.017 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:22 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2272085307' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T20:02:23.017 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:22 smithi062 ceph-mon[44211]: osdmap e798: 12 total, 12 up, 9 in 2024-04-01T20:02:23.429 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 5 1 2024-04-01T20:02:23.816 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:02:23.822 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:23.823 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:02:23.823 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:23 smithi188 ceph-mon[43939]: pgmap v2164: 17 pgs: 5 active+remapped+backfilling, 12 active+clean; 6.3 GiB data, 18 GiB used, 787 GiB / 805 GiB avail; 0 B/s wr, 895 op/s; 10031/207790 objects misplaced (4.827%); 52 MiB/s, 829 objects/s recovering 2024-04-01T20:02:23.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:23 smithi022 ceph-mon[39439]: pgmap v2164: 17 pgs: 5 active+remapped+backfilling, 12 active+clean; 6.3 GiB data, 18 GiB used, 787 GiB / 805 GiB avail; 0 B/s wr, 895 op/s; 10031/207790 objects misplaced (4.827%); 52 MiB/s, 829 objects/s recovering 2024-04-01T20:02:23.924 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:02:23.971 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:02:24.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:23 smithi062 ceph-mon[44211]: pgmap v2164: 17 pgs: 5 active+remapped+backfilling, 12 active+clean; 6.3 GiB data, 18 GiB used, 787 GiB / 805 GiB avail; 0 B/s wr, 895 op/s; 10031/207790 objects misplaced (4.827%); 52 MiB/s, 829 objects/s recovering 2024-04-01T20:02:24.338 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:02:24.343 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:24.344 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:02:24.445 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:02:24.512 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:24.545 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T20:02:24.651 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:02:24.657 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:24.657 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:02:24.758 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:02:24.803 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:24.854 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:02:24.857 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:24.858 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:02:24.959 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:02:25.005 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:25.046 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:02:25.054 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:25.055 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:02:25.091 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T20:02:25.091 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:02:25.115 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:24 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/660867847' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:02:25.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:24 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/660867847' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:02:25.155 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:02:25.199 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:24 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/660867847' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:02:25.201 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:25.234 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:02:25.240 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:25.240 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:02:25.243 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:02:25.243 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:02:25.243 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:02:25.243 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T20:02:25.243 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:02:25.243 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:02:25.243 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:02:25.243 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:02:25.243 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:02:25.243 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:02:25.243 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T20:02:25.243 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:02:25.244 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:02:25.244 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:02:25.244 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:02:25.244 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T20:02:25.244 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:02:25.244 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:02:25.244 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:02:25.244 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:02:25.244 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:02:25.244 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:02:25.244 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T20:02:25.244 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:02:25.341 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:02:25.425 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:25.456 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:02:25.459 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:25.460 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:02:25.560 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:02:25.596 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:25.868 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_historic_ops 2024-04-01T20:02:25.947 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:02:25.951 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:25.952 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:02:26.053 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:02:26.083 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:26.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:25 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:25 smithi188 ceph-mon[43939]: pgmap v2165: 17 pgs: 5 active+remapped+backfilling, 12 active+clean; 6.2 GiB data, 18 GiB used, 787 GiB / 805 GiB avail; 0 B/s wr, 818 op/s; 10031/204194 objects misplaced (4.912%); 21 MiB/s, 330 objects/s recovering 2024-04-01T20:02:26.236 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T20:02:26.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.266 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.266 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:25 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.266 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:25 smithi062 ceph-mon[44211]: pgmap v2165: 17 pgs: 5 active+remapped+backfilling, 12 active+clean; 6.2 GiB data, 18 GiB used, 787 GiB / 805 GiB avail; 0 B/s wr, 818 op/s; 10031/204194 objects misplaced (4.912%); 21 MiB/s, 330 objects/s recovering 2024-04-01T20:02:26.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:25 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:26.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:25 smithi022 ceph-mon[39439]: pgmap v2165: 17 pgs: 5 active+remapped+backfilling, 12 active+clean; 6.2 GiB data, 18 GiB used, 787 GiB / 805 GiB avail; 0 B/s wr, 818 op/s; 10031/204194 objects misplaced (4.912%); 21 MiB/s, 330 objects/s recovering 2024-04-01T20:02:26.622 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:02:26.637 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:02:26.640 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:26.640 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:02:26.741 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:02:26.806 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:26.837 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:02:26.843 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:26.844 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:02:26.945 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:02:26.978 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:27.240 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:02:27.247 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:27.248 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:02:27.348 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:02:27.416 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:27.448 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:02:27.451 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:27.451 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:02:27.552 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:02:27.589 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:27.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:27 smithi062 ceph-mon[44211]: pgmap v2166: 17 pgs: 5 active+remapped+backfilling, 12 active+clean; 6.0 GiB data, 17 GiB used, 787 GiB / 805 GiB avail; 0 B/s wr, 1.10k op/s; 7156/198024 objects misplaced (3.614%); 40 MiB/s, 637 objects/s recovering 2024-04-01T20:02:27.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:27 smithi022 ceph-mon[39439]: pgmap v2166: 17 pgs: 5 active+remapped+backfilling, 12 active+clean; 6.0 GiB data, 17 GiB used, 787 GiB / 805 GiB avail; 0 B/s wr, 1.10k op/s; 7156/198024 objects misplaced (3.614%); 40 MiB/s, 637 objects/s recovering 2024-04-01T20:02:27.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:27 smithi188 ceph-mon[43939]: pgmap v2166: 17 pgs: 5 active+remapped+backfilling, 12 active+clean; 6.0 GiB data, 17 GiB used, 787 GiB / 805 GiB avail; 0 B/s wr, 1.10k op/s; 7156/198024 objects misplaced (3.614%); 40 MiB/s, 637 objects/s recovering 2024-04-01T20:02:27.954 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T20:02:28.568 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.5 to 1 (10000) 2024-04-01T20:02:28.747 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:02:28.751 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:28.752 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:02:28.853 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:02:28.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:28 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2697140279' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T20:02:28.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:28 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2697140279' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T20:02:28.881 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:29.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:28 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2697140279' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T20:02:29.210 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:02:29.213 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:29.213 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:02:29.314 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:02:29.341 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:29.370 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:02:29.407 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 7 1 2024-04-01T20:02:29.441 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:02:29.445 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:29.446 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:02:29.547 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:02:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T20:02:29.578 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:29.674 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:29 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2697140279' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-04-01T20:02:29.674 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:29 smithi022 ceph-mon[39439]: osdmap e799: 12 total, 12 up, 9 in 2024-04-01T20:02:29.674 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:29 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/768376504' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:02:29.674 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:29 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:02:29.674 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:29 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:02:29.674 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:29 smithi022 ceph-mon[39439]: pgmap v2168: 17 pgs: 5 active+remapped+backfilling, 12 active+clean; 6.0 GiB data, 17 GiB used, 787 GiB / 805 GiB avail; 0 B/s wr, 1.02k op/s; 7156/196422 objects misplaced (3.643%); 31 MiB/s, 498 objects/s recovering 2024-04-01T20:02:29.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:29 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2697140279' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-04-01T20:02:29.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:29 smithi188 ceph-mon[43939]: osdmap e799: 12 total, 12 up, 9 in 2024-04-01T20:02:29.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:29 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/768376504' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:02:29.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:29 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:02:29.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:29 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:02:29.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:29 smithi188 ceph-mon[43939]: pgmap v2168: 17 pgs: 5 active+remapped+backfilling, 12 active+clean; 6.0 GiB data, 17 GiB used, 787 GiB / 805 GiB avail; 0 B/s wr, 1.02k op/s; 7156/196422 objects misplaced (3.643%); 31 MiB/s, 498 objects/s recovering 2024-04-01T20:02:30.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:29 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2697140279' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-04-01T20:02:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:29 smithi062 ceph-mon[44211]: osdmap e799: 12 total, 12 up, 9 in 2024-04-01T20:02:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:29 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/768376504' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:02:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:29 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:02:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:29 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:02:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:29 smithi062 ceph-mon[44211]: pgmap v2168: 17 pgs: 5 active+remapped+backfilling, 12 active+clean; 6.0 GiB data, 17 GiB used, 787 GiB / 805 GiB avail; 0 B/s wr, 1.02k op/s; 7156/196422 objects misplaced (3.643%); 31 MiB/s, 498 objects/s recovering 2024-04-01T20:02:30.225 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T20:02:30.225 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:02:30.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:30 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:02:30.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:30 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/768376504' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T20:02:30.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:30 smithi022 ceph-mon[39439]: osdmap e800: 12 total, 12 up, 9 in 2024-04-01T20:02:30.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:30 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:02:30.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:30 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/768376504' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T20:02:30.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:30 smithi188 ceph-mon[43939]: osdmap e800: 12 total, 12 up, 9 in 2024-04-01T20:02:30.998 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_ops_in_flight 2024-04-01T20:02:31.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:30 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:02:31.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:30 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/768376504' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T20:02:31.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:30 smithi062 ceph-mon[44211]: osdmap e800: 12 total, 12 up, 9 in 2024-04-01T20:02:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:02:31.040 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:31.041 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:02:31.142 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:02:31.174 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:31.485 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T20:02:31.523 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:02:31.526 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:31.527 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:02:31.550 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:02:31.627 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:02:31.657 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:31.681 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:02:31.685 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:31.686 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:02:31.787 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:02:31.801 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:31 smithi022 ceph-mon[39439]: osdmap e801: 12 total, 12 up, 9 in 2024-04-01T20:02:31.801 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:31 smithi022 ceph-mon[39439]: pgmap v2171: 17 pgs: 4 active+remapped+backfilling, 13 active+clean; 5.9 GiB data, 17 GiB used, 787 GiB / 805 GiB avail; 0 B/s wr, 840 op/s; 5637/194112 objects misplaced (2.904%); 41 MiB/s, 651 objects/s recovering 2024-04-01T20:02:31.846 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:31 smithi062 ceph-mon[44211]: osdmap e801: 12 total, 12 up, 9 in 2024-04-01T20:02:31.846 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:31 smithi062 ceph-mon[44211]: pgmap v2171: 17 pgs: 4 active+remapped+backfilling, 13 active+clean; 5.9 GiB data, 17 GiB used, 787 GiB / 805 GiB avail; 0 B/s wr, 840 op/s; 5637/194112 objects misplaced (2.904%); 41 MiB/s, 651 objects/s recovering 2024-04-01T20:02:31.859 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:31.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:31 smithi188 ceph-mon[43939]: osdmap e801: 12 total, 12 up, 9 in 2024-04-01T20:02:31.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:31 smithi188 ceph-mon[43939]: pgmap v2171: 17 pgs: 4 active+remapped+backfilling, 13 active+clean; 5.9 GiB data, 17 GiB used, 787 GiB / 805 GiB avail; 0 B/s wr, 840 op/s; 5637/194112 objects misplaced (2.904%); 41 MiB/s, 651 objects/s recovering 2024-04-01T20:02:31.903 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:02:31.911 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:31.911 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:02:32.012 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:02:32.069 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:32.196 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:02:32.199 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:32.199 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:02:32.300 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:02:32.331 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:33.181 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:02:33.185 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {auth=28,config=2,health=12,kv=58} crc {auth=1187211710,config=2353167246,health=603722711,kv=1913330716}) 2024-04-01T20:02:33.185 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1006737211}) 2024-04-01T20:02:33.185 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=451211950}) 2024-04-01T20:02:33.185 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3618904497}) 2024-04-01T20:02:33.185 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=680179507}) 2024-04-01T20:02:33.186 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=738681808}) 2024-04-01T20:02:33.186 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1915044640}) 2024-04-01T20:02:33.186 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1291698550}) 2024-04-01T20:02:33.186 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3599304455}) 2024-04-01T20:02:33.186 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2310642587}) 2024-04-01T20:02:33.186 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1005095737}) 2024-04-01T20:02:33.186 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3747255230}) 2024-04-01T20:02:33.186 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2515204240}) 2024-04-01T20:02:33.186 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2876262264}) 2024-04-01T20:02:33.186 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=483723996}) 2024-04-01T20:02:33.186 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3982261355}) 2024-04-01T20:02:33.186 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2368118585}) 2024-04-01T20:02:33.186 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3565718030}) 2024-04-01T20:02:33.186 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=485765764}) 2024-04-01T20:02:33.187 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3649554039}) 2024-04-01T20:02:33.187 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2161360177}) 2024-04-01T20:02:33.187 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=399141014}) 2024-04-01T20:02:33.187 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1091221180}) 2024-04-01T20:02:33.187 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1754938162}) 2024-04-01T20:02:33.187 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2435479242}) 2024-04-01T20:02:33.187 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2335090016}) 2024-04-01T20:02:33.187 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1036858815}) 2024-04-01T20:02:33.187 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4158028960}) 2024-04-01T20:02:33.187 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=373942629}) 2024-04-01T20:02:33.187 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3922165942}) 2024-04-01T20:02:33.187 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=542743826}) 2024-04-01T20:02:33.187 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1044573864}) 2024-04-01T20:02:33.187 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4220120596}) 2024-04-01T20:02:33.188 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3234307138}) 2024-04-01T20:02:33.188 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1716670213}) 2024-04-01T20:02:33.188 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3085562919}) 2024-04-01T20:02:33.188 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1914461896}) 2024-04-01T20:02:33.188 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1387485979}) 2024-04-01T20:02:33.188 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1617791551}) 2024-04-01T20:02:33.188 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2072561229}) 2024-04-01T20:02:33.188 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1908635193}) 2024-04-01T20:02:33.188 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:32 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=750825493}) 2024-04-01T20:02:33.188 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:33.189 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:02:33.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {auth=28,config=2,health=12,kv=58} crc {auth=1187211710,config=2353167246,health=603722711,kv=1913330716}) 2024-04-01T20:02:33.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1006737211}) 2024-04-01T20:02:33.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=451211950}) 2024-04-01T20:02:33.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3618904497}) 2024-04-01T20:02:33.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=680179507}) 2024-04-01T20:02:33.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=738681808}) 2024-04-01T20:02:33.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1915044640}) 2024-04-01T20:02:33.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1291698550}) 2024-04-01T20:02:33.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3599304455}) 2024-04-01T20:02:33.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2310642587}) 2024-04-01T20:02:33.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1005095737}) 2024-04-01T20:02:33.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3747255230}) 2024-04-01T20:02:33.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2515204240}) 2024-04-01T20:02:33.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2876262264}) 2024-04-01T20:02:33.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=483723996}) 2024-04-01T20:02:33.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3982261355}) 2024-04-01T20:02:33.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2368118585}) 2024-04-01T20:02:33.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3565718030}) 2024-04-01T20:02:33.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=485765764}) 2024-04-01T20:02:33.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3649554039}) 2024-04-01T20:02:33.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2161360177}) 2024-04-01T20:02:33.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=399141014}) 2024-04-01T20:02:33.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1091221180}) 2024-04-01T20:02:33.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1754938162}) 2024-04-01T20:02:33.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2435479242}) 2024-04-01T20:02:33.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2335090016}) 2024-04-01T20:02:33.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1036858815}) 2024-04-01T20:02:33.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4158028960}) 2024-04-01T20:02:33.266 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=373942629}) 2024-04-01T20:02:33.266 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3922165942}) 2024-04-01T20:02:33.266 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=542743826}) 2024-04-01T20:02:33.266 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1044573864}) 2024-04-01T20:02:33.266 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4220120596}) 2024-04-01T20:02:33.266 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3234307138}) 2024-04-01T20:02:33.267 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1716670213}) 2024-04-01T20:02:33.267 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3085562919}) 2024-04-01T20:02:33.267 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1914461896}) 2024-04-01T20:02:33.267 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1387485979}) 2024-04-01T20:02:33.267 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1617791551}) 2024-04-01T20:02:33.267 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2072561229}) 2024-04-01T20:02:33.267 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1908635193}) 2024-04-01T20:02:33.267 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:32 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=750825493}) 2024-04-01T20:02:33.289 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:02:33.320 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {auth=28,config=2,health=12,kv=58} crc {auth=1187211710,config=2353167246,health=603722711,kv=1913330716}) 2024-04-01T20:02:33.320 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1006737211}) 2024-04-01T20:02:33.320 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=451211950}) 2024-04-01T20:02:33.320 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3618904497}) 2024-04-01T20:02:33.320 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=680179507}) 2024-04-01T20:02:33.320 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=738681808}) 2024-04-01T20:02:33.320 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1915044640}) 2024-04-01T20:02:33.321 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1291698550}) 2024-04-01T20:02:33.321 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3599304455}) 2024-04-01T20:02:33.321 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2310642587}) 2024-04-01T20:02:33.321 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1005095737}) 2024-04-01T20:02:33.321 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3747255230}) 2024-04-01T20:02:33.321 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2515204240}) 2024-04-01T20:02:33.321 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2876262264}) 2024-04-01T20:02:33.321 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=483723996}) 2024-04-01T20:02:33.321 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3982261355}) 2024-04-01T20:02:33.321 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2368118585}) 2024-04-01T20:02:33.321 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3565718030}) 2024-04-01T20:02:33.321 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=485765764}) 2024-04-01T20:02:33.321 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3649554039}) 2024-04-01T20:02:33.321 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2161360177}) 2024-04-01T20:02:33.321 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=399141014}) 2024-04-01T20:02:33.322 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1091221180}) 2024-04-01T20:02:33.322 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1754938162}) 2024-04-01T20:02:33.322 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2435479242}) 2024-04-01T20:02:33.322 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2335090016}) 2024-04-01T20:02:33.322 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1036858815}) 2024-04-01T20:02:33.322 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4158028960}) 2024-04-01T20:02:33.322 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=373942629}) 2024-04-01T20:02:33.322 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3922165942}) 2024-04-01T20:02:33.322 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=542743826}) 2024-04-01T20:02:33.322 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1044573864}) 2024-04-01T20:02:33.322 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4220120596}) 2024-04-01T20:02:33.322 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3234307138}) 2024-04-01T20:02:33.322 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1716670213}) 2024-04-01T20:02:33.322 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3085562919}) 2024-04-01T20:02:33.323 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1914461896}) 2024-04-01T20:02:33.323 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1387485979}) 2024-04-01T20:02:33.323 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1617791551}) 2024-04-01T20:02:33.323 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2072561229}) 2024-04-01T20:02:33.323 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1908635193}) 2024-04-01T20:02:33.323 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:32 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=750825493}) 2024-04-01T20:02:33.323 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:33.344 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:02:33.357 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:33.357 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:02:33.458 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:02:33.492 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:33.540 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T20:02:33.693 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:02:33.696 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:33.697 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:02:33.798 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:02:33.860 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:02:33.863 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:33.883 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:02:33.904 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:02:33.927 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T20:02:33.957 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:02:33.989 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:02:34.012 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:02:34.043 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:02:34.070 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:02:34.099 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:02:34.127 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:02:34.131 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T20:02:34.161 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:02:34.162 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:02:34.162 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:02:34.163 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:02:34.163 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T20:02:34.163 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:02:34.163 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:02:34.163 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:02:34.163 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:02:34.163 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:02:34.163 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:02:34.163 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T20:02:34.163 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:02:34.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1865891714}) 2024-04-01T20:02:34.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3133867073}) 2024-04-01T20:02:34.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3746867012}) 2024-04-01T20:02:34.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1398889431}) 2024-04-01T20:02:34.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3387498810}) 2024-04-01T20:02:34.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=750785207}) 2024-04-01T20:02:34.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1572901362}) 2024-04-01T20:02:34.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2883515341}) 2024-04-01T20:02:34.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2658235220}) 2024-04-01T20:02:34.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=832638558}) 2024-04-01T20:02:34.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2851344417}) 2024-04-01T20:02:34.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=503087285}) 2024-04-01T20:02:34.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1963767478}) 2024-04-01T20:02:34.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3335929644}) 2024-04-01T20:02:34.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=463212200}) 2024-04-01T20:02:34.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=840429516}) 2024-04-01T20:02:34.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1385750}) 2024-04-01T20:02:34.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3401271254}) 2024-04-01T20:02:34.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3573113139}) 2024-04-01T20:02:34.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3045416448}) 2024-04-01T20:02:34.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2508368986}) 2024-04-01T20:02:34.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1708708594}) 2024-04-01T20:02:34.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2999658096}) 2024-04-01T20:02:34.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2244642174}) 2024-04-01T20:02:34.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=652121354}) 2024-04-01T20:02:34.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3520076743}) 2024-04-01T20:02:34.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1826888186}) 2024-04-01T20:02:34.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3213422122}) 2024-04-01T20:02:34.265 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2361050274}) 2024-04-01T20:02:34.266 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1755139437}) 2024-04-01T20:02:34.266 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2743979672}) 2024-04-01T20:02:34.266 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3531731764}) 2024-04-01T20:02:34.266 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2797466368}) 2024-04-01T20:02:34.266 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2037692196}) 2024-04-01T20:02:34.266 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3168800340}) 2024-04-01T20:02:34.266 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4217022712}) 2024-04-01T20:02:34.266 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3874079791}) 2024-04-01T20:02:34.266 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1847986334}) 2024-04-01T20:02:34.266 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=889289948}) 2024-04-01T20:02:34.266 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3697343533}) 2024-04-01T20:02:34.267 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2304755941}) 2024-04-01T20:02:34.267 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1384977511}) 2024-04-01T20:02:34.267 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3177477909}) 2024-04-01T20:02:34.267 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2893910418}) 2024-04-01T20:02:34.267 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1547751292}) 2024-04-01T20:02:34.267 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=323597147}) 2024-04-01T20:02:34.267 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2805038081}) 2024-04-01T20:02:34.267 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1897179883}) 2024-04-01T20:02:34.267 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3625857564}) 2024-04-01T20:02:34.267 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1566440103}) 2024-04-01T20:02:34.267 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1945235934}) 2024-04-01T20:02:34.267 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2895163812}) 2024-04-01T20:02:34.267 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1535515773}) 2024-04-01T20:02:34.267 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=658870304}) 2024-04-01T20:02:34.267 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=907691862}) 2024-04-01T20:02:34.268 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1732769153}) 2024-04-01T20:02:34.268 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=86,mdsmap=3,mgr=11} crc {logm=2686390563,mdsmap=2840952586,mgr=312614122}) 2024-04-01T20:02:34.268 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mgr=7,mgr_command_descs=1,mgr_metadata=2,mgrstat=14,mon_config_key=76} crc {mgr=4238866914,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=1653152480,mon_config_key=1100688153}) 2024-04-01T20:02:34.268 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=365329953}) 2024-04-01T20:02:34.268 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=4233840481}) 2024-04-01T20:02:34.268 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=13,monmap=5,osd_metadata=12,osd_pg_creating=1,osdmap=69} crc {mon_config_key=1658952679,monmap=3338646291,osd_metadata=2378895694,osd_pg_creating=2208182101,osdmap=1448370302}) 2024-04-01T20:02:34.268 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=38} crc {osdmap=600450307}) 2024-04-01T20:02:34.268 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: pgmap v2172: 17 pgs: 3 active+remapped+backfilling, 14 active+clean; 5.8 GiB data, 17 GiB used, 787 GiB / 805 GiB avail; 0 B/s wr, 606 op/s; 3017/190744 objects misplaced (1.582%); 41 MiB/s, 656 objects/s recovering 2024-04-01T20:02:34.268 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:34 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1450368960' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:02:34.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1865891714}) 2024-04-01T20:02:34.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3133867073}) 2024-04-01T20:02:34.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3746867012}) 2024-04-01T20:02:34.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1398889431}) 2024-04-01T20:02:34.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3387498810}) 2024-04-01T20:02:34.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=750785207}) 2024-04-01T20:02:34.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1572901362}) 2024-04-01T20:02:34.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2883515341}) 2024-04-01T20:02:34.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2658235220}) 2024-04-01T20:02:34.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=832638558}) 2024-04-01T20:02:34.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2851344417}) 2024-04-01T20:02:34.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=503087285}) 2024-04-01T20:02:34.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1963767478}) 2024-04-01T20:02:34.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3335929644}) 2024-04-01T20:02:34.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=463212200}) 2024-04-01T20:02:34.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=840429516}) 2024-04-01T20:02:34.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1385750}) 2024-04-01T20:02:34.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3401271254}) 2024-04-01T20:02:34.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3573113139}) 2024-04-01T20:02:34.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3045416448}) 2024-04-01T20:02:34.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2508368986}) 2024-04-01T20:02:34.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1708708594}) 2024-04-01T20:02:34.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2999658096}) 2024-04-01T20:02:34.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2244642174}) 2024-04-01T20:02:34.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=652121354}) 2024-04-01T20:02:34.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3520076743}) 2024-04-01T20:02:34.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1826888186}) 2024-04-01T20:02:34.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3213422122}) 2024-04-01T20:02:34.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2361050274}) 2024-04-01T20:02:34.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1755139437}) 2024-04-01T20:02:34.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2743979672}) 2024-04-01T20:02:34.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3531731764}) 2024-04-01T20:02:34.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2797466368}) 2024-04-01T20:02:34.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2037692196}) 2024-04-01T20:02:34.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3168800340}) 2024-04-01T20:02:34.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4217022712}) 2024-04-01T20:02:34.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3874079791}) 2024-04-01T20:02:34.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1847986334}) 2024-04-01T20:02:34.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=889289948}) 2024-04-01T20:02:34.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3697343533}) 2024-04-01T20:02:34.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2304755941}) 2024-04-01T20:02:34.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1384977511}) 2024-04-01T20:02:34.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3177477909}) 2024-04-01T20:02:34.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2893910418}) 2024-04-01T20:02:34.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1547751292}) 2024-04-01T20:02:34.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=323597147}) 2024-04-01T20:02:34.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2805038081}) 2024-04-01T20:02:34.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1897179883}) 2024-04-01T20:02:34.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3625857564}) 2024-04-01T20:02:34.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1566440103}) 2024-04-01T20:02:34.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1945235934}) 2024-04-01T20:02:34.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2895163812}) 2024-04-01T20:02:34.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1535515773}) 2024-04-01T20:02:34.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=658870304}) 2024-04-01T20:02:34.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=907691862}) 2024-04-01T20:02:34.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1732769153}) 2024-04-01T20:02:34.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=86,mdsmap=3,mgr=11} crc {logm=2686390563,mdsmap=2840952586,mgr=312614122}) 2024-04-01T20:02:34.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mgr=7,mgr_command_descs=1,mgr_metadata=2,mgrstat=14,mon_config_key=76} crc {mgr=4238866914,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=1653152480,mon_config_key=1100688153}) 2024-04-01T20:02:34.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=365329953}) 2024-04-01T20:02:34.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=4233840481}) 2024-04-01T20:02:34.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=13,monmap=5,osd_metadata=12,osd_pg_creating=1,osdmap=69} crc {mon_config_key=1658952679,monmap=3338646291,osd_metadata=2378895694,osd_pg_creating=2208182101,osdmap=1448370302}) 2024-04-01T20:02:34.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=38} crc {osdmap=600450307}) 2024-04-01T20:02:34.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: pgmap v2172: 17 pgs: 3 active+remapped+backfilling, 14 active+clean; 5.8 GiB data, 17 GiB used, 787 GiB / 805 GiB avail; 0 B/s wr, 606 op/s; 3017/190744 objects misplaced (1.582%); 41 MiB/s, 656 objects/s recovering 2024-04-01T20:02:34.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:34 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1450368960' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:02:34.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1865891714}) 2024-04-01T20:02:34.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3133867073}) 2024-04-01T20:02:34.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3746867012}) 2024-04-01T20:02:34.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1398889431}) 2024-04-01T20:02:34.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3387498810}) 2024-04-01T20:02:34.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=750785207}) 2024-04-01T20:02:34.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1572901362}) 2024-04-01T20:02:34.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2883515341}) 2024-04-01T20:02:34.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2658235220}) 2024-04-01T20:02:34.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=832638558}) 2024-04-01T20:02:34.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2851344417}) 2024-04-01T20:02:34.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=503087285}) 2024-04-01T20:02:34.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1963767478}) 2024-04-01T20:02:34.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3335929644}) 2024-04-01T20:02:34.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=463212200}) 2024-04-01T20:02:34.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=840429516}) 2024-04-01T20:02:34.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1385750}) 2024-04-01T20:02:34.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3401271254}) 2024-04-01T20:02:34.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3573113139}) 2024-04-01T20:02:34.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3045416448}) 2024-04-01T20:02:34.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2508368986}) 2024-04-01T20:02:34.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1708708594}) 2024-04-01T20:02:34.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2999658096}) 2024-04-01T20:02:34.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2244642174}) 2024-04-01T20:02:34.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=652121354}) 2024-04-01T20:02:34.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3520076743}) 2024-04-01T20:02:34.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1826888186}) 2024-04-01T20:02:34.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3213422122}) 2024-04-01T20:02:34.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2361050274}) 2024-04-01T20:02:34.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1755139437}) 2024-04-01T20:02:34.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2743979672}) 2024-04-01T20:02:34.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3531731764}) 2024-04-01T20:02:34.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2797466368}) 2024-04-01T20:02:34.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2037692196}) 2024-04-01T20:02:34.377 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3168800340}) 2024-04-01T20:02:34.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4217022712}) 2024-04-01T20:02:34.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3874079791}) 2024-04-01T20:02:34.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1847986334}) 2024-04-01T20:02:34.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=889289948}) 2024-04-01T20:02:34.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3697343533}) 2024-04-01T20:02:34.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2304755941}) 2024-04-01T20:02:34.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1384977511}) 2024-04-01T20:02:34.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3177477909}) 2024-04-01T20:02:34.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2893910418}) 2024-04-01T20:02:34.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1547751292}) 2024-04-01T20:02:34.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=323597147}) 2024-04-01T20:02:34.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2805038081}) 2024-04-01T20:02:34.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1897179883}) 2024-04-01T20:02:34.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3625857564}) 2024-04-01T20:02:34.378 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1566440103}) 2024-04-01T20:02:34.379 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1945235934}) 2024-04-01T20:02:34.379 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2895163812}) 2024-04-01T20:02:34.379 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1535515773}) 2024-04-01T20:02:34.379 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=658870304}) 2024-04-01T20:02:34.379 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=907691862}) 2024-04-01T20:02:34.379 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1732769153}) 2024-04-01T20:02:34.379 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=86,mdsmap=3,mgr=11} crc {logm=2686390563,mdsmap=2840952586,mgr=312614122}) 2024-04-01T20:02:34.379 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mgr=7,mgr_command_descs=1,mgr_metadata=2,mgrstat=14,mon_config_key=76} crc {mgr=4238866914,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=1653152480,mon_config_key=1100688153}) 2024-04-01T20:02:34.379 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=365329953}) 2024-04-01T20:02:34.379 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=4233840481}) 2024-04-01T20:02:34.379 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=13,monmap=5,osd_metadata=12,osd_pg_creating=1,osdmap=69} crc {mon_config_key=1658952679,monmap=3338646291,osd_metadata=2378895694,osd_pg_creating=2208182101,osdmap=1448370302}) 2024-04-01T20:02:34.379 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=38} crc {osdmap=600450307}) 2024-04-01T20:02:34.379 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: pgmap v2172: 17 pgs: 3 active+remapped+backfilling, 14 active+clean; 5.8 GiB data, 17 GiB used, 787 GiB / 805 GiB avail; 0 B/s wr, 606 op/s; 3017/190744 objects misplaced (1.582%); 41 MiB/s, 656 objects/s recovering 2024-04-01T20:02:34.379 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:34 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1450368960' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:02:35.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:35 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T20:02:35.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T20:02:35.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T20:02:35.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:02:35.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:02:35.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:02:35.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:35 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:02:35.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:35 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T20:02:35.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T20:02:35.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T20:02:35.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:02:35.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:02:35.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:02:35.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:35 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:02:35.511 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:35 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T20:02:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T20:02:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T20:02:35.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:02:35.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:02:35.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:02:35.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:35 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:02:36.058 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.7 to 1 (10000) 2024-04-01T20:02:36.195 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:36 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2288884818' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T20:02:36.195 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:36 smithi022 ceph-mon[39439]: pgmap v2173: 17 pgs: 3 active+remapped+backfilling, 14 active+clean; 5.7 GiB data, 17 GiB used, 787 GiB / 805 GiB avail; 0 B/s wr, 749 op/s; 3017/187688 objects misplaced (1.607%); 36 MiB/s, 571 objects/s recovering 2024-04-01T20:02:36.274 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:02:36.285 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:36.286 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:02:36.286 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:36 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2288884818' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T20:02:36.286 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:36 smithi062 ceph-mon[44211]: pgmap v2173: 17 pgs: 3 active+remapped+backfilling, 14 active+clean; 5.7 GiB data, 17 GiB used, 787 GiB / 805 GiB avail; 0 B/s wr, 749 op/s; 3017/187688 objects misplaced (1.607%); 36 MiB/s, 571 objects/s recovering 2024-04-01T20:02:36.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:36 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2288884818' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T20:02:36.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:36 smithi188 ceph-mon[43939]: pgmap v2173: 17 pgs: 3 active+remapped+backfilling, 14 active+clean; 5.7 GiB data, 17 GiB used, 787 GiB / 805 GiB avail; 0 B/s wr, 749 op/s; 3017/187688 objects misplaced (1.607%); 36 MiB/s, 571 objects/s recovering 2024-04-01T20:02:36.387 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:02:36.428 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:36.554 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:02:36.567 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:36.568 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:02:36.669 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:02:36.703 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:36.726 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:02:36.729 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:36.729 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:02:36.830 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:02:36.865 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:37.016 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:02:37.018 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:37.019 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:02:37.120 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:02:37.150 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:37.174 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:02:37.180 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:37.180 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:02:37.252 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-01T20:02:37.253 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [], 2024-04-01T20:02:37.253 INFO:teuthology.orchestra.run.smithi062.stdout: "num_ops": 0 2024-04-01T20:02:37.253 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-01T20:02:37.281 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:02:37.309 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:37 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2288884818' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-04-01T20:02:37.309 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:37 smithi188 ceph-mon[43939]: osdmap e802: 12 total, 12 up, 9 in 2024-04-01T20:02:37.311 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:37.338 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:02:37.342 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:37.342 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:02:37.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:37 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2288884818' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-04-01T20:02:37.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:37 smithi022 ceph-mon[39439]: osdmap e802: 12 total, 12 up, 9 in 2024-04-01T20:02:37.443 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:02:37.478 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:37.505 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:02:37.511 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:37.511 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:02:37.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:37 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2288884818' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-04-01T20:02:37.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:37 smithi062 ceph-mon[44211]: osdmap e802: 12 total, 12 up, 9 in 2024-04-01T20:02:37.612 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:02:37.650 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:37.681 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:02:37.684 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:37.684 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:02:37.732 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 9 1 2024-04-01T20:02:37.785 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:02:37.851 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:38.020 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:02:38.026 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:38.026 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:02:38.069 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_blocked_ops 2024-04-01T20:02:38.127 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:02:38.215 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:38.255 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:02:38.278 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:02:38.285 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:38.286 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:38 smithi062 ceph-mon[44211]: pgmap v2175: 17 pgs: 3 active+remapped+backfilling, 14 active+clean; 5.5 GiB data, 17 GiB used, 788 GiB / 805 GiB avail; 0 B/s wr, 953 op/s; 1645/181362 objects misplaced (0.907%); 41 MiB/s, 657 objects/s recovering 2024-04-01T20:02:38.286 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:02:38.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:38 smithi022 ceph-mon[39439]: pgmap v2175: 17 pgs: 3 active+remapped+backfilling, 14 active+clean; 5.5 GiB data, 17 GiB used, 788 GiB / 805 GiB avail; 0 B/s wr, 953 op/s; 1645/181362 objects misplaced (0.907%); 41 MiB/s, 657 objects/s recovering 2024-04-01T20:02:38.374 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:38 smithi188 ceph-mon[43939]: pgmap v2175: 17 pgs: 3 active+remapped+backfilling, 14 active+clean; 5.5 GiB data, 17 GiB used, 788 GiB / 805 GiB avail; 0 B/s wr, 953 op/s; 1645/181362 objects misplaced (0.907%); 41 MiB/s, 657 objects/s recovering 2024-04-01T20:02:38.387 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:02:38.445 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:38.483 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:02:38.486 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:38.487 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:02:38.587 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:02:38.594 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T20:02:38.620 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:38.651 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:02:38.654 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:38.655 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:02:38.685 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T20:02:38.755 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:02:38.787 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:39.093 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T20:02:39.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:39 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/599412933' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:02:39.317 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:02:39.322 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:39.322 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:02:39.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:39 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/599412933' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:02:39.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:39 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/599412933' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:02:39.423 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:02:39.489 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:39.629 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:02:39.637 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:39.638 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:02:39.739 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:02:39.766 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:39.787 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:02:39.790 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:39.790 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:02:39.891 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:02:39.925 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:40.074 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:40 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:02:40.074 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:40 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/599412933' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T20:02:40.074 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:40 smithi188 ceph-mon[43939]: osdmap e803: 12 total, 12 up, 9 in 2024-04-01T20:02:40.074 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:40 smithi188 ceph-mon[43939]: pgmap v2177: 17 pgs: 3 active+remapped+backfilling, 14 active+clean; 5.5 GiB data, 17 GiB used, 788 GiB / 805 GiB avail; 0 B/s wr, 909 op/s; 1645/179558 objects misplaced (0.916%); 29 MiB/s, 466 objects/s recovering 2024-04-01T20:02:40.356 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:02:40.360 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:40 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:02:40.360 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:40 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/599412933' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T20:02:40.360 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:40 smithi022 ceph-mon[39439]: osdmap e803: 12 total, 12 up, 9 in 2024-04-01T20:02:40.360 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:40 smithi022 ceph-mon[39439]: pgmap v2177: 17 pgs: 3 active+remapped+backfilling, 14 active+clean; 5.5 GiB data, 17 GiB used, 788 GiB / 805 GiB avail; 0 B/s wr, 909 op/s; 1645/179558 objects misplaced (0.916%); 29 MiB/s, 466 objects/s recovering 2024-04-01T20:02:40.361 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:02:40.363 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:40.363 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:02:40.464 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:02:40.490 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:40.508 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:02:40.511 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:40.511 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:02:40.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:40 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:02:40.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:40 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/599412933' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T20:02:40.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:40 smithi062 ceph-mon[44211]: osdmap e803: 12 total, 12 up, 9 in 2024-04-01T20:02:40.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:40 smithi062 ceph-mon[44211]: pgmap v2177: 17 pgs: 3 active+remapped+backfilling, 14 active+clean; 5.5 GiB data, 17 GiB used, 788 GiB / 805 GiB avail; 0 B/s wr, 909 op/s; 1645/179558 objects misplaced (0.916%); 29 MiB/s, 466 objects/s recovering 2024-04-01T20:02:40.612 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:02:40.638 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:40.664 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:02:40.669 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:40.669 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:02:40.770 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:02:40.806 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:40.837 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:02:40.843 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:40.843 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:02:40.944 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:02:40.975 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:41.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:41 smithi022 ceph-mon[39439]: osdmap e804: 12 total, 12 up, 9 in 2024-04-01T20:02:41.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:41 smithi022 ceph-mon[39439]: osdmap e805: 12 total, 12 up, 9 in 2024-04-01T20:02:41.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:41 smithi062 ceph-mon[44211]: osdmap e804: 12 total, 12 up, 9 in 2024-04-01T20:02:41.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:41 smithi062 ceph-mon[44211]: osdmap e805: 12 total, 12 up, 9 in 2024-04-01T20:02:41.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:41 smithi188 ceph-mon[43939]: osdmap e804: 12 total, 12 up, 9 in 2024-04-01T20:02:41.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:41 smithi188 ceph-mon[43939]: osdmap e805: 12 total, 12 up, 9 in 2024-04-01T20:02:41.601 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.9 to 1 (10000) 2024-04-01T20:02:41.941 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T20:02:42.297 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:42 smithi022 ceph-mon[39439]: 9.8 scrub starts 2024-04-01T20:02:42.297 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:42 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:02:42.297 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:42 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:02:42.297 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:42 smithi022 ceph-mon[39439]: 9.8 scrub ok 2024-04-01T20:02:42.297 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:42 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3770329225' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T20:02:42.297 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:42 smithi022 ceph-mon[39439]: pgmap v2180: 17 pgs: 1 active+clean+scrubbing, 2 active+remapped+backfilling, 14 active+clean; 5.4 GiB data, 16 GiB used, 788 GiB / 805 GiB avail; 0 B/s wr, 904 op/s; 1311/176570 objects misplaced (0.742%); 13 MiB/s, 212 objects/s recovering 2024-04-01T20:02:42.297 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:42 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3770329225' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]': finished 2024-04-01T20:02:42.297 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:42 smithi022 ceph-mon[39439]: osdmap e806: 12 total, 12 up, 9 in 2024-04-01T20:02:42.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:42 smithi188 ceph-mon[43939]: 9.8 scrub starts 2024-04-01T20:02:42.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:42 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:02:42.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:42 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:02:42.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:42 smithi188 ceph-mon[43939]: 9.8 scrub ok 2024-04-01T20:02:42.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:42 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3770329225' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T20:02:42.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:42 smithi188 ceph-mon[43939]: pgmap v2180: 17 pgs: 1 active+clean+scrubbing, 2 active+remapped+backfilling, 14 active+clean; 5.4 GiB data, 16 GiB used, 788 GiB / 805 GiB avail; 0 B/s wr, 904 op/s; 1311/176570 objects misplaced (0.742%); 13 MiB/s, 212 objects/s recovering 2024-04-01T20:02:42.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:42 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3770329225' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]': finished 2024-04-01T20:02:42.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:42 smithi188 ceph-mon[43939]: osdmap e806: 12 total, 12 up, 9 in 2024-04-01T20:02:42.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:42 smithi062 ceph-mon[44211]: 9.8 scrub starts 2024-04-01T20:02:42.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:42 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:02:42.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:42 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:02:42.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:42 smithi062 ceph-mon[44211]: 9.8 scrub ok 2024-04-01T20:02:42.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:42 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3770329225' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T20:02:42.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:42 smithi062 ceph-mon[44211]: pgmap v2180: 17 pgs: 1 active+clean+scrubbing, 2 active+remapped+backfilling, 14 active+clean; 5.4 GiB data, 16 GiB used, 788 GiB / 805 GiB avail; 0 B/s wr, 904 op/s; 1311/176570 objects misplaced (0.742%); 13 MiB/s, 212 objects/s recovering 2024-04-01T20:02:42.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:42 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3770329225' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]': finished 2024-04-01T20:02:42.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:42 smithi062 ceph-mon[44211]: osdmap e806: 12 total, 12 up, 9 in 2024-04-01T20:02:42.829 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 8 1 2024-04-01T20:02:43.296 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:02:43.354 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:02:43.385 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:02:43.409 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:02:43.429 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:02:43.452 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T20:02:43.478 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:02:43.520 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:02:43.548 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:02:43.571 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:02:43.594 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:02:43.618 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:02:43.648 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T20:02:43.677 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:02:43.678 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:02:43.678 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:02:43.678 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:02:43.678 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T20:02:43.678 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:02:43.678 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:02:43.678 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:02:43.678 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:02:43.679 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:02:43.679 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:02:43.679 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T20:02:43.679 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:02:43.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:43 smithi022 ceph-mon[39439]: osdmap e807: 12 total, 12 up, 9 in 2024-04-01T20:02:43.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:43 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1977324053' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:02:43.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:43 smithi022 ceph-mon[39439]: pgmap v2183: 17 pgs: 1 peering, 1 active+clean+scrubbing, 15 active+clean; 5.3 GiB data, 16 GiB used, 788 GiB / 805 GiB avail; 0 B/s wr, 837 op/s; 25 MiB/s, 399 objects/s recovering 2024-04-01T20:02:43.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:43 smithi188 ceph-mon[43939]: osdmap e807: 12 total, 12 up, 9 in 2024-04-01T20:02:43.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:43 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1977324053' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:02:43.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:43 smithi188 ceph-mon[43939]: pgmap v2183: 17 pgs: 1 peering, 1 active+clean+scrubbing, 15 active+clean; 5.3 GiB data, 16 GiB used, 788 GiB / 805 GiB avail; 0 B/s wr, 837 op/s; 25 MiB/s, 399 objects/s recovering 2024-04-01T20:02:43.923 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:43 smithi062 ceph-mon[44211]: osdmap e807: 12 total, 12 up, 9 in 2024-04-01T20:02:43.923 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:43 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1977324053' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:02:43.924 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:43 smithi062 ceph-mon[44211]: pgmap v2183: 17 pgs: 1 peering, 1 active+clean+scrubbing, 15 active+clean; 5.3 GiB data, 16 GiB used, 788 GiB / 805 GiB avail; 0 B/s wr, 837 op/s; 25 MiB/s, 399 objects/s recovering 2024-04-01T20:02:44.012 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:02:44.014 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:44.015 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:02:44.116 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:02:44.146 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:44.211 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:44.211 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:02:44.212 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:02:44.312 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:02:44.379 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:44.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:44 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:44 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:44 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:44 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:44 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:44 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:44 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:44 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:44 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:44 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:44 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:44 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:44 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:44 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:44 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:44 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:44 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:44 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:44 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:44 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:44 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:44 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:44 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:44 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:44 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:44 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:44 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:44 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:44 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:44 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:44 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:44 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:44 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:44 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:44 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:44.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:44 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:46.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:45 smithi062 ceph-mon[44211]: pgmap v2184: 17 pgs: 1 peering, 1 active+clean+scrubbing, 15 active+clean; 5.2 GiB data, 16 GiB used, 788 GiB / 805 GiB avail; 0 B/s wr, 679 op/s; 19 MiB/s, 297 objects/s recovering 2024-04-01T20:02:46.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:45 smithi022 ceph-mon[39439]: pgmap v2184: 17 pgs: 1 peering, 1 active+clean+scrubbing, 15 active+clean; 5.2 GiB data, 16 GiB used, 788 GiB / 805 GiB avail; 0 B/s wr, 679 op/s; 19 MiB/s, 297 objects/s recovering 2024-04-01T20:02:46.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:45 smithi188 ceph-mon[43939]: pgmap v2184: 17 pgs: 1 peering, 1 active+clean+scrubbing, 15 active+clean; 5.2 GiB data, 16 GiB used, 788 GiB / 805 GiB avail; 0 B/s wr, 679 op/s; 19 MiB/s, 297 objects/s recovering 2024-04-01T20:02:46.145 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:02:46.152 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:46.152 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:02:46.253 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:02:46.308 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:46.374 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:02:46.391 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:46.391 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:02:46.492 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:02:46.520 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:46.545 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:02:46.551 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:46.551 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:02:46.652 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:02:46.685 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:46.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:46 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T20:02:46.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:46 smithi062 ceph-mon[44211]: 9.c scrub starts 2024-04-01T20:02:46.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:46 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T20:02:46.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:46 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T20:02:46.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:46 smithi022 ceph-mon[39439]: 9.c scrub starts 2024-04-01T20:02:46.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:46 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T20:02:46.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:46 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T20:02:46.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:46 smithi188 ceph-mon[43939]: 9.c scrub starts 2024-04-01T20:02:46.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:46 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T20:02:46.935 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:02:46.942 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:46.942 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:02:47.043 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:02:47.071 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:47.094 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:02:47.097 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T20:02:47.097 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:02:47.097 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:47.098 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:02:47.198 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:02:47.226 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:47.248 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:02:47.252 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:47.253 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:02:47.353 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:02:47.384 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:47.404 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:02:47.409 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:47.409 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:02:47.510 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:02:47.558 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:47.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:47 smithi022 ceph-mon[39439]: 9.7 scrub starts 2024-04-01T20:02:47.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:47 smithi022 ceph-mon[39439]: 9.c scrub ok 2024-04-01T20:02:47.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:47 smithi022 ceph-mon[39439]: pgmap v2185: 17 pgs: 17 active+clean; 5.0 GiB data, 16 GiB used, 789 GiB / 805 GiB avail; 0 B/s wr, 903 op/s; 15 MiB/s, 232 objects/s recovering 2024-04-01T20:02:47.962 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:47 smithi062 ceph-mon[44211]: 9.7 scrub starts 2024-04-01T20:02:47.962 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:47 smithi062 ceph-mon[44211]: 9.c scrub ok 2024-04-01T20:02:47.963 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:47 smithi062 ceph-mon[44211]: pgmap v2185: 17 pgs: 17 active+clean; 5.0 GiB data, 16 GiB used, 789 GiB / 805 GiB avail; 0 B/s wr, 903 op/s; 15 MiB/s, 232 objects/s recovering 2024-04-01T20:02:47.968 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:02:47.977 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:47.977 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:02:48.014 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_historic_ops 2024-04-01T20:02:48.078 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:02:48.123 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:48.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:47 smithi188 ceph-mon[43939]: 9.7 scrub starts 2024-04-01T20:02:48.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:47 smithi188 ceph-mon[43939]: 9.c scrub ok 2024-04-01T20:02:48.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:47 smithi188 ceph-mon[43939]: pgmap v2185: 17 pgs: 17 active+clean; 5.0 GiB data, 16 GiB used, 789 GiB / 805 GiB avail; 0 B/s wr, 903 op/s; 15 MiB/s, 232 objects/s recovering 2024-04-01T20:02:48.151 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:02:48.153 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:48.154 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:02:48.255 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:02:48.331 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:48.401 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:02:48.407 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:48.407 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:02:48.509 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:02:48.562 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T20:02:48.585 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:48.618 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:02:48.618 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T20:02:48.622 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:48.622 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:02:48.644 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T20:02:48.655 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.8 to 1 (10000) 2024-04-01T20:02:48.723 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:02:48.783 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:48.874 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:02:48.879 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:48 smithi062 ceph-mon[44211]: 9.7 scrub ok 2024-04-01T20:02:48.879 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:48 smithi062 ceph-mon[44211]: 9.1 scrub starts 2024-04-01T20:02:48.879 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:48 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1772288895' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T20:02:48.879 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:48 smithi062 ceph-mon[44211]: from='client.37652 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T20:02:48.879 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:48 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2767141694' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:02:48.880 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:48.880 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:02:48.981 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:02:49.057 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:49.081 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:48 smithi022 ceph-mon[39439]: 9.7 scrub ok 2024-04-01T20:02:49.081 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:48 smithi022 ceph-mon[39439]: 9.1 scrub starts 2024-04-01T20:02:49.081 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:48 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1772288895' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T20:02:49.081 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:48 smithi022 ceph-mon[39439]: from='client.37652 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T20:02:49.081 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:48 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2767141694' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:02:49.089 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:02:49.099 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:49.100 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:02:49.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:48 smithi188 ceph-mon[43939]: 9.7 scrub ok 2024-04-01T20:02:49.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:48 smithi188 ceph-mon[43939]: 9.1 scrub starts 2024-04-01T20:02:49.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:48 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1772288895' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T20:02:49.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:48 smithi188 ceph-mon[43939]: from='client.37652 ' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T20:02:49.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:48 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2767141694' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:02:49.201 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:02:49.229 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:49.251 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:02:49.253 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:49.254 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:02:49.355 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:02:49.384 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:49.413 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:02:49.418 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:49.418 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:02:49.519 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:02:49.593 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:49.625 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:02:49.626 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:49.626 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:02:49.727 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:02:49.760 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:50.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:49 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T20:02:50.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:49 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T20:02:50.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:49 smithi062 ceph-mon[44211]: from='client.37652 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]': finished 2024-04-01T20:02:50.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:49 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2767141694' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T20:02:50.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:49 smithi062 ceph-mon[44211]: osdmap e808: 12 total, 12 up, 9 in 2024-04-01T20:02:50.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:49 smithi062 ceph-mon[44211]: 9.1 scrub ok 2024-04-01T20:02:50.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:49 smithi062 ceph-mon[44211]: pgmap v2187: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.0 GiB data, 16 GiB used, 789 GiB / 805 GiB avail; 0 B/s wr, 831 op/s; 10 MiB/s, 162 objects/s recovering 2024-04-01T20:02:50.051 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:49 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T20:02:50.051 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:49 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T20:02:50.051 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:49 smithi022 ceph-mon[39439]: from='client.37652 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]': finished 2024-04-01T20:02:50.051 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:49 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2767141694' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T20:02:50.051 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:49 smithi022 ceph-mon[39439]: osdmap e808: 12 total, 12 up, 9 in 2024-04-01T20:02:50.051 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:49 smithi022 ceph-mon[39439]: 9.1 scrub ok 2024-04-01T20:02:50.052 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:49 smithi022 ceph-mon[39439]: pgmap v2187: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.0 GiB data, 16 GiB used, 789 GiB / 805 GiB avail; 0 B/s wr, 831 op/s; 10 MiB/s, 162 objects/s recovering 2024-04-01T20:02:50.083 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 6 1 2024-04-01T20:02:50.112 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:02:50.114 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:50.115 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:02:50.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:49 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T20:02:50.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:49 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T20:02:50.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:49 smithi188 ceph-mon[43939]: from='client.37652 ' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]': finished 2024-04-01T20:02:50.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:49 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2767141694' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T20:02:50.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:49 smithi188 ceph-mon[43939]: osdmap e808: 12 total, 12 up, 9 in 2024-04-01T20:02:50.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:49 smithi188 ceph-mon[43939]: 9.1 scrub ok 2024-04-01T20:02:50.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:49 smithi188 ceph-mon[43939]: pgmap v2187: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 5.0 GiB data, 16 GiB used, 789 GiB / 805 GiB avail; 0 B/s wr, 831 op/s; 10 MiB/s, 162 objects/s recovering 2024-04-01T20:02:50.215 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:02:50.243 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:50.267 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:02:50.273 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:50.273 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:02:50.277 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:02:50.374 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:02:50.402 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:50.555 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:02:50.558 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:50.558 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:02:50.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:50 smithi022 ceph-mon[39439]: 9.e scrub starts 2024-04-01T20:02:50.659 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:02:50.692 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:50.791 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:02:50.793 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:50.794 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:02:50.895 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:02:50.926 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:51.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:50 smithi062 ceph-mon[44211]: 9.e scrub starts 2024-04-01T20:02:51.062 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T20:02:51.062 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:02:51.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:50 smithi188 ceph-mon[43939]: 9.e scrub starts 2024-04-01T20:02:51.257 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:02:51.678 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:02:51.682 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:51.683 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:02:51.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:51 smithi062 ceph-mon[44211]: 9.e scrub ok 2024-04-01T20:02:51.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:51 smithi062 ceph-mon[44211]: 9.d scrub starts 2024-04-01T20:02:51.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:51 smithi062 ceph-mon[44211]: 9.6 scrub starts 2024-04-01T20:02:51.764 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:51 smithi062 ceph-mon[44211]: pgmap v2188: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.9 GiB data, 16 GiB used, 789 GiB / 805 GiB avail; 0 B/s wr, 704 op/s 2024-04-01T20:02:51.783 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:02:51.812 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:51.831 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:02:51.834 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:51.834 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:02:51.886 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_ops_in_flight 2024-04-01T20:02:51.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:51 smithi022 ceph-mon[39439]: 9.e scrub ok 2024-04-01T20:02:51.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:51 smithi022 ceph-mon[39439]: 9.d scrub starts 2024-04-01T20:02:51.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:51 smithi022 ceph-mon[39439]: 9.6 scrub starts 2024-04-01T20:02:51.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:51 smithi022 ceph-mon[39439]: pgmap v2188: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.9 GiB data, 16 GiB used, 789 GiB / 805 GiB avail; 0 B/s wr, 704 op/s 2024-04-01T20:02:51.935 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:02:51.966 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:52.025 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:02:52.028 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:52.028 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:02:52.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:51 smithi188 ceph-mon[43939]: 9.e scrub ok 2024-04-01T20:02:52.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:51 smithi188 ceph-mon[43939]: 9.d scrub starts 2024-04-01T20:02:52.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:51 smithi188 ceph-mon[43939]: 9.6 scrub starts 2024-04-01T20:02:52.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:51 smithi188 ceph-mon[43939]: pgmap v2188: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 4.9 GiB data, 16 GiB used, 789 GiB / 805 GiB avail; 0 B/s wr, 704 op/s 2024-04-01T20:02:52.128 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:02:52.167 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:52.273 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T20:02:52.318 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:02:52.321 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:52.322 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:02:52.423 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:02:52.451 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:52.476 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:02:52.482 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:52.483 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:02:52.583 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:02:52.612 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:52.634 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:02:52.637 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:52.638 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:02:52.739 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:02:52.769 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:52 smithi022 ceph-mon[39439]: 9.d scrub ok 2024-04-01T20:02:52.769 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:52 smithi022 ceph-mon[39439]: 9.f deep-scrub starts 2024-04-01T20:02:52.769 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:52 smithi022 ceph-mon[39439]: 9.6 scrub ok 2024-04-01T20:02:52.769 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:52 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:02:52.769 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:52 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:02:52.773 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:52.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:52 smithi188 ceph-mon[43939]: 9.d scrub ok 2024-04-01T20:02:52.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:52 smithi188 ceph-mon[43939]: 9.f deep-scrub starts 2024-04-01T20:02:52.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:52 smithi188 ceph-mon[43939]: 9.6 scrub ok 2024-04-01T20:02:52.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:52 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:02:52.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:52 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:02:53.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:52 smithi062 ceph-mon[44211]: 9.d scrub ok 2024-04-01T20:02:53.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:52 smithi062 ceph-mon[44211]: 9.f deep-scrub starts 2024-04-01T20:02:53.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:52 smithi062 ceph-mon[44211]: 9.6 scrub ok 2024-04-01T20:02:53.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:52 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:02:53.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:52 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:02:53.964 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:53 smithi022 ceph-mon[39439]: osdmap e809: 12 total, 12 up, 9 in 2024-04-01T20:02:53.964 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:53 smithi022 ceph-mon[39439]: pgmap v2190: 17 pgs: 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 15 active+clean; 4.7 GiB data, 15 GiB used, 789 GiB / 805 GiB avail; 0 B/s wr, 933 op/s 2024-04-01T20:02:53.964 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:53 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2856345100' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:02:54.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:53 smithi062 ceph-mon[44211]: osdmap e809: 12 total, 12 up, 9 in 2024-04-01T20:02:54.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:53 smithi062 ceph-mon[44211]: pgmap v2190: 17 pgs: 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 15 active+clean; 4.7 GiB data, 15 GiB used, 789 GiB / 805 GiB avail; 0 B/s wr, 933 op/s 2024-04-01T20:02:54.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:53 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2856345100' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:02:54.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:53 smithi188 ceph-mon[43939]: osdmap e809: 12 total, 12 up, 9 in 2024-04-01T20:02:54.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:53 smithi188 ceph-mon[43939]: pgmap v2190: 17 pgs: 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 15 active+clean; 4.7 GiB data, 15 GiB used, 789 GiB / 805 GiB avail; 0 B/s wr, 933 op/s 2024-04-01T20:02:54.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:53 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2856345100' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:02:54.525 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:02:54.529 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:54.529 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:02:54.633 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:02:54.664 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:54.690 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:02:54.693 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:54.693 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:02:54.788 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:54 smithi022 ceph-mon[39439]: 9.5 deep-scrub starts 2024-04-01T20:02:54.788 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:54.788 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:54.789 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:54.789 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:54.789 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:54.789 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:54.789 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:54.789 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:54.789 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:54.789 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:54 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:54.793 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:02:54.822 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:54.841 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:02:54.845 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:54.845 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:02:54.946 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:02:54.971 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:54 smithi188 ceph-mon[43939]: 9.5 deep-scrub starts 2024-04-01T20:02:54.971 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:54.971 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:54.971 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:54.971 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:54.971 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:54.971 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:54.971 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:54.971 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:54.971 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:54.972 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:54 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:54.973 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:54.997 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:02:55.001 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:55.001 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:02:55.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:54 smithi062 ceph-mon[44211]: 9.5 deep-scrub starts 2024-04-01T20:02:55.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:55.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:55.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:55.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:55.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:55.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:55.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:55.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:55.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:55.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:54 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:55.102 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:02:55.168 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:55.211 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:02:55.225 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:55.226 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:02:55.255 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:02:55.255 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:02:55.255 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:02:55.255 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T20:02:55.255 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:02:55.255 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:02:55.255 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:02:55.255 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:02:55.255 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:02:55.255 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:02:55.256 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T20:02:55.256 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:02:55.256 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:02:55.256 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:02:55.256 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:02:55.256 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T20:02:55.256 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:02:55.256 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:02:55.256 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:02:55.256 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:02:55.256 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:02:55.256 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:02:55.256 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T20:02:55.257 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:02:55.326 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:02:55.354 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:55.375 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:02:55.378 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:55.379 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:02:55.480 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:02:55.512 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:55.641 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:02:55.662 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:55.662 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:02:55.702 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.6 to 1 (10000) 2024-04-01T20:02:55.763 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:02:55.791 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:55.813 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:02:55.817 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:55.818 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:02:55.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:55 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:55.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:55 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:55.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:55 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1429214440' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T20:02:55.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:55 smithi022 ceph-mon[39439]: pgmap v2191: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 4.6 GiB data, 15 GiB used, 790 GiB / 805 GiB avail; 0 B/s wr, 823 op/s 2024-04-01T20:02:55.918 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:02:55.945 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:55.965 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:02:55.967 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:55 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:55.967 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:55 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:55.967 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:55 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1429214440' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T20:02:55.967 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:55 smithi188 ceph-mon[43939]: pgmap v2191: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 4.6 GiB data, 15 GiB used, 790 GiB / 805 GiB avail; 0 B/s wr, 823 op/s 2024-04-01T20:02:55.968 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:55.968 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:02:56.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:55 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:56.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:55 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:02:56.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:55 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1429214440' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T20:02:56.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:55 smithi062 ceph-mon[44211]: pgmap v2191: 17 pgs: 1 active+clean+scrubbing+deep, 16 active+clean; 4.6 GiB data, 15 GiB used, 790 GiB / 805 GiB avail; 0 B/s wr, 823 op/s 2024-04-01T20:02:56.068 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:02:56.121 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:56.160 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:02:56.167 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:56.168 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:02:56.269 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:02:56.297 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:56.320 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:02:56.324 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:56.324 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:02:56.424 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:02:56.475 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:56.578 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:02:56.580 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:56.581 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:02:56.603 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:02:56.604 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:02:56.682 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:02:56.711 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:57.009 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:56 smithi022 ceph-mon[39439]: 9.a deep-scrub starts 2024-04-01T20:02:57.009 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:56 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1429214440' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-04-01T20:02:57.009 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:56 smithi022 ceph-mon[39439]: osdmap e810: 12 total, 12 up, 9 in 2024-04-01T20:02:57.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:56 smithi062 ceph-mon[44211]: 9.a deep-scrub starts 2024-04-01T20:02:57.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:56 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1429214440' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-04-01T20:02:57.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:56 smithi062 ceph-mon[44211]: osdmap e810: 12 total, 12 up, 9 in 2024-04-01T20:02:57.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:56 smithi188 ceph-mon[43939]: 9.a deep-scrub starts 2024-04-01T20:02:57.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:56 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1429214440' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-04-01T20:02:57.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:56 smithi188 ceph-mon[43939]: osdmap e810: 12 total, 12 up, 9 in 2024-04-01T20:02:57.355 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 1 1 2024-04-01T20:02:57.863 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:02:57.866 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:57.867 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:02:57.968 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:02:57.973 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:57 smithi022 ceph-mon[39439]: pgmap v2193: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 4.5 GiB data, 15 GiB used, 790 GiB / 805 GiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T20:02:57.993 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:57 smithi188 ceph-mon[43939]: pgmap v2193: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 4.5 GiB data, 15 GiB used, 790 GiB / 805 GiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T20:02:57.995 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:58.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:57 smithi062 ceph-mon[44211]: pgmap v2193: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 4.5 GiB data, 15 GiB used, 790 GiB / 805 GiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T20:02:58.019 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:02:58.021 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:58.021 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:02:58.122 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:02:58.151 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:58.303 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:02:58.307 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:58.310 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:02:58.317 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:02:58.405 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T20:02:58.411 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:02:58.439 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:58.461 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:02:58.463 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:58.464 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:02:58.564 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:02:58.591 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:58.611 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:02:58.614 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:58.614 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:02:58.715 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:02:58.748 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:58.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:58 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:02:58.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:58 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:02:59.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:58 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:02:59.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:58 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:02:59.075 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:02:59.078 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:59.079 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:02:59.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:58 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:02:59.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:58 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:02:59.179 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:02:59.246 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:02:59.279 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:02:59.288 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:02:59.288 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:02:59.389 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:02:59.420 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:00.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:59 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:03:00.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:59 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:03:00.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:59 smithi062 ceph-mon[44211]: osdmap e811: 12 total, 12 up, 9 in 2024-04-01T20:03:00.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:02:59 smithi062 ceph-mon[44211]: pgmap v2195: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 4.5 GiB data, 15 GiB used, 790 GiB / 805 GiB avail; 0 B/s wr, 705 op/s 2024-04-01T20:03:00.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:59 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:03:00.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:59 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:03:00.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:59 smithi022 ceph-mon[39439]: osdmap e811: 12 total, 12 up, 9 in 2024-04-01T20:03:00.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:02:59 smithi022 ceph-mon[39439]: pgmap v2195: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 4.5 GiB data, 15 GiB used, 790 GiB / 805 GiB avail; 0 B/s wr, 705 op/s 2024-04-01T20:03:00.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:59 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:03:00.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:59 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:03:00.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:59 smithi188 ceph-mon[43939]: osdmap e811: 12 total, 12 up, 9 in 2024-04-01T20:03:00.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:02:59 smithi188 ceph-mon[43939]: pgmap v2195: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 4.5 GiB data, 15 GiB used, 790 GiB / 805 GiB avail; 0 B/s wr, 705 op/s 2024-04-01T20:03:00.425 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:03:00.430 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:00.431 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:03:00.532 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:03:00.581 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:00.610 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:03:00.616 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:00.616 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:03:00.717 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:03:00.743 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:00 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/61036854' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:03:00.747 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:00.753 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T20:03:00.768 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:03:00.774 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:00.775 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:03:00.876 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:03:00.927 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:00 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/61036854' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:03:00.930 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:01.004 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:03:01.008 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:01.008 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:03:01.109 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:03:01.124 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:00 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/61036854' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:03:01.172 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:01.210 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:03:01.219 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:01.219 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:03:01.320 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:03:01.393 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:01.429 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:03:01.437 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:01.437 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:03:01.538 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:03:01.566 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:01.592 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:03:01.594 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:01.595 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:03:01.696 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:03:01.734 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:01.758 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.1 to 1 (10000) 2024-04-01T20:03:01.781 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:03:01.786 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:01.787 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:03:01.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:01 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:03:01.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:01 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/61036854' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T20:03:01.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:01 smithi188 ceph-mon[43939]: osdmap e812: 12 total, 12 up, 9 in 2024-04-01T20:03:01.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:01 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/303493590' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T20:03:01.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:01 smithi188 ceph-mon[43939]: pgmap v2197: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 4.4 GiB data, 15 GiB used, 790 GiB / 805 GiB avail; 0 B/s wr, 679 op/s 2024-04-01T20:03:01.887 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:03:01.923 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:02.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:01 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:03:02.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:01 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/61036854' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T20:03:02.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:01 smithi062 ceph-mon[44211]: osdmap e812: 12 total, 12 up, 9 in 2024-04-01T20:03:02.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:01 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/303493590' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T20:03:02.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:01 smithi062 ceph-mon[44211]: pgmap v2197: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 4.4 GiB data, 15 GiB used, 790 GiB / 805 GiB avail; 0 B/s wr, 679 op/s 2024-04-01T20:03:02.049 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:03:02.051 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:01 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:03:02.051 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:01 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/61036854' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T20:03:02.051 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:01 smithi022 ceph-mon[39439]: osdmap e812: 12 total, 12 up, 9 in 2024-04-01T20:03:02.051 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:01 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/303493590' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T20:03:02.051 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:01 smithi022 ceph-mon[39439]: pgmap v2197: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 4.4 GiB data, 15 GiB used, 790 GiB / 805 GiB avail; 0 B/s wr, 679 op/s 2024-04-01T20:03:02.052 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:02.052 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:03:02.153 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:03:02.225 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:02.272 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:03:02.280 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:02.280 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:03:02.381 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:03:02.411 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:02.739 INFO:tasks.thrashosds.thrasher:test_map_discontinuity 2024-04-01T20:03:02.739 INFO:tasks.thrashosds.thrasher:Waiting for recovery 2024-04-01T20:03:02.739 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-01T20:03:02.739 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-04-01T20:03:03.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:02 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/303493590' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-04-01T20:03:03.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:02 smithi062 ceph-mon[44211]: osdmap e813: 12 total, 12 up, 9 in 2024-04-01T20:03:03.086 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:02 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/303493590' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-04-01T20:03:03.086 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:02 smithi022 ceph-mon[39439]: osdmap e813: 12 total, 12 up, 9 in 2024-04-01T20:03:03.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:02 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/303493590' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-04-01T20:03:03.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:02 smithi188 ceph-mon[43939]: osdmap e813: 12 total, 12 up, 9 in 2024-04-01T20:03:03.776 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:03:03.814 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:03:04.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:03 smithi062 ceph-mon[44211]: pgmap v2199: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 4.3 GiB data, 14 GiB used, 790 GiB / 805 GiB avail; 0 B/s wr, 512 op/s 2024-04-01T20:03:04.037 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:03 smithi022 ceph-mon[39439]: pgmap v2199: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 4.3 GiB data, 14 GiB used, 790 GiB / 805 GiB avail; 0 B/s wr, 512 op/s 2024-04-01T20:03:04.064 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:03:04.069 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:04.070 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:03:04.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:03 smithi188 ceph-mon[43939]: pgmap v2199: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 4.3 GiB data, 14 GiB used, 790 GiB / 805 GiB avail; 0 B/s wr, 512 op/s 2024-04-01T20:03:04.170 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:03:04.198 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:04.221 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:03:04.224 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:04.224 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:03:04.325 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:03:04.356 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:04.380 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:03:04.383 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:04.383 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:03:04.485 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:03:04.512 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:04.533 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:03:04.536 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:04.536 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:03:04.637 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:03:04.673 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:05.058 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T20:03:05.058 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T20:03:05.058 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 0 2024-04-01T20:03:05.058 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T20:03:05.128 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T20:03:05.528 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:03:05.531 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:05.531 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:03:05.632 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:03:05.660 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:05.685 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:03:05.688 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:05.689 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:03:05.789 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:03:05.839 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:05 smithi062 ceph-mon[44211]: pgmap v2200: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 4.2 GiB data, 14 GiB used, 790 GiB / 805 GiB avail; 0 B/s wr, 617 op/s 2024-04-01T20:03:05.847 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:05.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:05 smithi022 ceph-mon[39439]: pgmap v2200: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 4.2 GiB data, 14 GiB used, 790 GiB / 805 GiB avail; 0 B/s wr, 617 op/s 2024-04-01T20:03:05.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:05 smithi188 ceph-mon[43939]: pgmap v2200: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 4.2 GiB data, 14 GiB used, 790 GiB / 805 GiB avail; 0 B/s wr, 617 op/s 2024-04-01T20:03:05.882 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:03:05.893 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:05.893 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:03:05.994 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:03:06.021 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:06.041 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:03:06.045 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:06.045 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:03:06.146 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:03:06.175 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:06.817 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_blocked_ops 2024-04-01T20:03:07.125 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:03:07.129 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:07.129 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:03:07.230 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:03:07.261 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:07.612 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:03:07.618 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:03:07.622 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:07.622 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:03:07.654 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:03:07.723 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:03:07.752 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:07.776 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:03:07.778 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:07.779 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:03:07.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:07 smithi022 ceph-mon[39439]: pgmap v2201: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 4.2 GiB data, 14 GiB used, 790 GiB / 805 GiB avail; 0 B/s wr, 533 op/s 2024-04-01T20:03:07.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:07 smithi188 ceph-mon[43939]: pgmap v2201: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 4.2 GiB data, 14 GiB used, 790 GiB / 805 GiB avail; 0 B/s wr, 533 op/s 2024-04-01T20:03:07.879 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:03:07.910 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:07.932 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:03:07.935 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:07.935 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:03:08.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:07 smithi062 ceph-mon[44211]: pgmap v2201: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 4.2 GiB data, 14 GiB used, 790 GiB / 805 GiB avail; 0 B/s wr, 533 op/s 2024-04-01T20:03:08.036 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:03:08.069 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:08.170 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:03:08.175 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:08.176 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:03:08.277 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:03:08.310 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:09.210 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T20:03:09.210 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":814,"fsid":"09f6b846-f05c-11ee-b647-cb9ed24678a4","created":"2024-04-01T19:15:34.344221+0000","modified":"2024-04-01T20:03:08.974670+0000","last_up_change":"2024-04-01T20:00:48.888090+0000","last_in_change":"2024-04-01T20:01:44.118640+0000","flags":"noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5801984,"flags_set":["noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":33,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T19:18:34.605751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.94866174459457397,"average_primary_affinity":0.94999998807907104,"average_primary_affinity_weighted":0.94999998807907104}},{"pool":9,"pool_name":"unique_pool_7","create_time":"2024-04-01T19:59:26.592829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"741","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.4800000190734863,"score_stable":4.4800000190734863,"optimal_score":0.67000001668930054,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.94866174459457397,"average_primary_affinity":0.94999998807907104,"average_primary_affinity_weighted":0.94999998807907104}}],"osds":[{"osd":0,"uuid":"cfd4aa7e-a933-42e2-aac8-f93a3d9fcc3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":687,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":1419201649}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":1419201649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":1419201649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":1419201649}]},"public_addr":"172.21.15.22:6801/1419201649","cluster_addr":"172.21.15.22:6802/1419201649","heartbeat_back_addr":"172.21.15.22:6804/1419201649","heartbeat_front_addr":"172.21.15.22:6803/1419201649","state":["exists","up"]},{"osd":1,"uuid":"6ddadf19-2b4e-4c01-8918-9d51c323925b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":534,"up_from":571,"up_thru":793,"down_at":535,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":3304599570}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":3304599570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6808","nonce":3304599570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":3304599570}]},"public_addr":"172.21.15.22:6805/3304599570","cluster_addr":"172.21.15.22:6806/3304599570","heartbeat_back_addr":"172.21.15.22:6808/3304599570","heartbeat_front_addr":"172.21.15.22:6807/3304599570","state":["exists","up"]},{"osd":2,"uuid":"4af1f44c-f47c-4ce6-87ba-1aeec3960969","up":1,"in":1,"weight":1,"primary_affinity":0.383941650390625,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":560,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":835455757}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":835455757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":835455757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":835455757}]},"public_addr":"172.21.15.22:6809/835455757","cluster_addr":"172.21.15.22:6810/835455757","heartbeat_back_addr":"172.21.15.22:6812/835455757","heartbeat_front_addr":"172.21.15.22:6811/835455757","state":["exists","up"]},{"osd":3,"uuid":"c399f336-23c7-414a-822e-63793daf85c1","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":735,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":90988887}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":90988887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":90988887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":90988887}]},"public_addr":"172.21.15.22:6813/90988887","cluster_addr":"172.21.15.22:6814/90988887","heartbeat_back_addr":"172.21.15.22:6816/90988887","heartbeat_front_addr":"172.21.15.22:6815/90988887","state":["exists","up"]},{"osd":4,"uuid":"0a2690dc-e5b6-4d29-b517-980018519d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":800,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6800","nonce":2408168690}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6801","nonce":2408168690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6803","nonce":2408168690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6802","nonce":2408168690}]},"public_addr":"172.21.15.62:6800/2408168690","cluster_addr":"172.21.15.62:6801/2408168690","heartbeat_back_addr":"172.21.15.62:6803/2408168690","heartbeat_front_addr":"172.21.15.62:6802/2408168690","state":["exists","up"]},{"osd":5,"uuid":"c6830412-959a-4f1e-8c3d-f4b2d88673e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":806,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6804","nonce":386874616}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6805","nonce":386874616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6807","nonce":386874616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6806","nonce":386874616}]},"public_addr":"172.21.15.62:6804/386874616","cluster_addr":"172.21.15.62:6805/386874616","heartbeat_back_addr":"172.21.15.62:6807/386874616","heartbeat_front_addr":"172.21.15.62:6806/386874616","state":["exists","up"]},{"osd":6,"uuid":"f646310b-91a4-4259-a51f-6a0e92b7cba8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":335,"last_clean_end":421,"up_from":457,"up_thru":560,"down_at":422,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6808","nonce":2644974032}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6809","nonce":2644974032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6811","nonce":2644974032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6810","nonce":2644974032}]},"public_addr":"172.21.15.62:6808/2644974032","cluster_addr":"172.21.15.62:6809/2644974032","heartbeat_back_addr":"172.21.15.62:6811/2644974032","heartbeat_front_addr":"172.21.15.62:6810/2644974032","state":["exists","up"]},{"osd":7,"uuid":"afe5f371-c892-43e9-b82e-c2d911354e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":795,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6812","nonce":2055487337}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6813","nonce":2055487337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6815","nonce":2055487337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6814","nonce":2055487337}]},"public_addr":"172.21.15.62:6812/2055487337","cluster_addr":"172.21.15.62:6813/2055487337","heartbeat_back_addr":"172.21.15.62:6815/2055487337","heartbeat_front_addr":"172.21.15.62:6814/2055487337","state":["exists","up"]},{"osd":8,"uuid":"b7eb6461-f6fa-4a12-864c-6e6748e6337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":63,"last_clean_end":159,"up_from":197,"up_thru":793,"down_at":160,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6800","nonce":1873408265}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6801","nonce":1873408265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6803","nonce":1873408265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6802","nonce":1873408265}]},"public_addr":"172.21.15.188:6800/1873408265","cluster_addr":"172.21.15.188:6801/1873408265","heartbeat_back_addr":"172.21.15.188:6803/1873408265","heartbeat_front_addr":"172.21.15.188:6802/1873408265","state":["exists","up"]},{"osd":9,"uuid":"7d496ad5-46bf-485a-81d9-2b9da2a59882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":804,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6804","nonce":1755990887}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6805","nonce":1755990887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6807","nonce":1755990887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6806","nonce":1755990887}]},"public_addr":"172.21.15.188:6804/1755990887","cluster_addr":"172.21.15.188:6805/1755990887","heartbeat_back_addr":"172.21.15.188:6807/1755990887","heartbeat_front_addr":"172.21.15.188:6806/1755990887","state":["exists","up"]},{"osd":10,"uuid":"6cbb80ce-37f7-48df-9090-09a6068e4490","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":77,"last_clean_end":679,"up_from":762,"up_thru":644,"down_at":680,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6808","nonce":260531768}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6809","nonce":260531768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6811","nonce":260531768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6810","nonce":260531768}]},"public_addr":"172.21.15.188:6808/260531768","cluster_addr":"172.21.15.188:6809/260531768","heartbeat_back_addr":"172.21.15.188:6811/260531768","heartbeat_front_addr":"172.21.15.188:6810/260531768","state":["exists","up"]},{"osd":11,"uuid":"c03517c4-fdb0-4587-96c1-b959041c4344","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":735,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6812","nonce":3987199514}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6813","nonce":3987199514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6815","nonce":3987199514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6814","nonce":3987199514}]},"public_addr":"172.21.15.188:6812/3987199514","cluster_addr":"172.21.15.188:6813/3987199514","heartbeat_back_addr":"172.21.15.188:6815/3987199514","heartbeat_front_addr":"172.21.15.188:6814/3987199514","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:02:41.008437+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:02:07.731950+0000","dead_epoch":534},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:02:07.625337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":65536,"last_purged_snaps_scrub":"2024-04-01T20:02:51.682307+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:02:21.229028+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:02:57.882868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:02:29.019018+0000","dead_epoch":421},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:03:08.921849+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:01:47.538430+0000","dead_epoch":159},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:02:58.101558+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":65536,"last_purged_snaps_scrub":"2024-04-01T20:01:59.954525+0000","dead_epoch":679},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":65536,"last_purged_snaps_scrub":"2024-04-01T20:01:58.609627+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/3735983556":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/3575578250":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/2493529775":"2024-04-02T19:16:02.302343+0000","172.21.15.22:6800/2678666836":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/2389537847":"2024-04-02T19:16:02.302343+0000","172.21.15.22:0/798807675":"2024-04-02T19:16:02.302343+0000","172.21.15.22:6800/1090179981":"2024-04-02T19:16:02.302343+0000","172.21.15.22:0/51907384":"2024-04-02T19:16:30.513384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T20:03:09.963 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:03:09.966 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:09.967 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:03:10.068 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:03:10.109 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:10.139 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:03:10.143 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:10.143 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:03:10.244 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:03:10.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:09 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:03:10.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:09 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:03:10.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:09 smithi062 ceph-mon[44211]: osdmap e814: 12 total, 12 up, 9 in 2024-04-01T20:03:10.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:09 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2053759229' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T20:03:10.264 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:09 smithi062 ceph-mon[44211]: pgmap v2203: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 4.1 GiB data, 14 GiB used, 791 GiB / 805 GiB avail; 0 B/s wr, 636 op/s 2024-04-01T20:03:10.312 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:10.349 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:03:10.355 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:10.356 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:03:10.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:09 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:03:10.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:09 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:03:10.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:09 smithi022 ceph-mon[39439]: osdmap e814: 12 total, 12 up, 9 in 2024-04-01T20:03:10.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:09 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2053759229' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T20:03:10.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:09 smithi022 ceph-mon[39439]: pgmap v2203: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 4.1 GiB data, 14 GiB used, 791 GiB / 805 GiB avail; 0 B/s wr, 636 op/s 2024-04-01T20:03:10.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:09 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:03:10.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:09 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:03:10.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:09 smithi188 ceph-mon[43939]: osdmap e814: 12 total, 12 up, 9 in 2024-04-01T20:03:10.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:09 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2053759229' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T20:03:10.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:09 smithi188 ceph-mon[43939]: pgmap v2203: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 4.1 GiB data, 14 GiB used, 791 GiB / 805 GiB avail; 0 B/s wr, 636 op/s 2024-04-01T20:03:10.456 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:03:10.527 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:10.572 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:03:10.578 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:10.578 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:03:10.679 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:03:10.728 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:10.766 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:03:10.778 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:10.779 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:03:10.880 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:03:10.910 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:10.933 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:03:10.936 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:10.936 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:03:10.955 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-01T20:03:11.037 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:03:11.065 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:11.092 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:03:11.098 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:11.099 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:03:11.200 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:03:11.243 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:11.273 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:03:11.280 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:11.280 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:03:11.381 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:03:11.443 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:11.482 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:03:11.488 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:11.489 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:03:11.590 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:03:11.649 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:11.678 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:03:11.687 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:11.687 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:03:11.788 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:03:11.854 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:11 smithi062 ceph-mon[44211]: pgmap v2204: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 4.0 GiB data, 14 GiB used, 791 GiB / 805 GiB avail; 0 B/s wr, 614 op/s 2024-04-01T20:03:11.856 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:11.864 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:11 smithi022 ceph-mon[39439]: pgmap v2204: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 4.0 GiB data, 14 GiB used, 791 GiB / 805 GiB avail; 0 B/s wr, 614 op/s 2024-04-01T20:03:11.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:11 smithi188 ceph-mon[43939]: pgmap v2204: 17 pgs: 3 active+clean+scrubbing+deep, 14 active+clean; 4.0 GiB data, 14 GiB used, 791 GiB / 805 GiB avail; 0 B/s wr, 614 op/s 2024-04-01T20:03:11.892 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:03:11.896 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:11.896 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:03:11.997 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:03:12.024 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:12.047 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:03:12.050 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:12.051 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:03:12.152 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:03:12.179 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:12.200 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:03:12.203 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:12.204 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:03:12.223 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:03:12.263 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:03:12.284 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:03:12.304 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:03:12.310 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T20:03:12.343 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:03:12.351 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:12.370 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:03:12.400 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:03:12.427 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:03:12.451 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:03:12.474 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:03:12.498 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T20:03:12.521 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:03:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:03:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:03:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:03:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T20:03:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:03:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:03:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:03:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:03:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:03:12.524 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:03:12.524 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T20:03:12.524 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:03:12.562 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:03:12.566 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:12.566 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:03:12.667 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:03:12.698 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:12.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:12 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3653363967' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:03:12.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:12 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:12.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:12 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4292430439' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:03:12.874 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:12 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3653363967' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:03:12.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:12 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:12.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:12 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4292430439' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:03:13.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:12 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3653363967' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:03:13.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:12 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:13.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:12 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4292430439' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:03:13.545 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T20:03:13.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:13.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:13.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:13.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:13.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:13.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:13.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:13.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:13.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:13.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:13.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:13 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:13.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:13 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:03:13.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:13 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4292430439' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T20:03:13.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:13 smithi022 ceph-mon[39439]: osdmap e815: 12 total, 12 up, 9 in 2024-04-01T20:03:13.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:13 smithi022 ceph-mon[39439]: pgmap v2206: 17 pgs: 17 active+clean; 3.9 GiB data, 14 GiB used, 791 GiB / 805 GiB avail; 0 B/s wr, 605 op/s 2024-04-01T20:03:13.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:13.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:13.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:13.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:13.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:13.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:13.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:13.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:13.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:13.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:13.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:13 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:13.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:13 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:03:13.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:13 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4292430439' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T20:03:13.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:13 smithi188 ceph-mon[43939]: osdmap e815: 12 total, 12 up, 9 in 2024-04-01T20:03:13.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:13 smithi188 ceph-mon[43939]: pgmap v2206: 17 pgs: 17 active+clean; 3.9 GiB data, 14 GiB used, 791 GiB / 805 GiB avail; 0 B/s wr, 605 op/s 2024-04-01T20:03:14.019 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:14.019 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:14.019 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:14.019 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:14.019 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:14.019 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:14.020 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:14.020 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:14.020 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:14.020 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:14.020 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:13 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:14.020 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:13 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:03:14.020 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:13 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4292430439' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T20:03:14.020 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:13 smithi062 ceph-mon[44211]: osdmap e815: 12 total, 12 up, 9 in 2024-04-01T20:03:14.020 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:13 smithi062 ceph-mon[44211]: pgmap v2206: 17 pgs: 17 active+clean; 3.9 GiB data, 14 GiB used, 791 GiB / 805 GiB avail; 0 B/s wr, 605 op/s 2024-04-01T20:03:14.850 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:03:14.874 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:14.874 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:03:14.975 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:03:15.009 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:15.033 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:03:15.039 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:15.040 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:03:15.140 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:03:15.179 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:15.214 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:03:15.228 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:15.229 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:03:15.302 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T20:03:15.330 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:03:15.357 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:15.379 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:03:15.382 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:15.383 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:03:15.474 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T20:03:15.474 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:03:15.483 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:03:15.517 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:15.722 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:03:15.725 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:15.726 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:03:15.826 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:03:15.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:15 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:03:15.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:15 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:03:15.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:15 smithi022 ceph-mon[39439]: osdmap e816: 12 total, 12 up, 9 in 2024-04-01T20:03:15.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:15 smithi022 ceph-mon[39439]: pgmap v2208: 17 pgs: 17 active+clean; 3.8 GiB data, 14 GiB used, 791 GiB / 805 GiB avail; 0 B/s wr, 683 op/s 2024-04-01T20:03:15.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:15 smithi022 ceph-mon[39439]: osdmap e817: 12 total, 12 up, 9 in 2024-04-01T20:03:15.888 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:15.926 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:03:15.932 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:15.932 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:03:16.033 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:03:16.061 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:16.088 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:03:16.091 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:16.091 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:03:16.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:15 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:03:16.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:15 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:03:16.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:15 smithi188 ceph-mon[43939]: osdmap e816: 12 total, 12 up, 9 in 2024-04-01T20:03:16.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:15 smithi188 ceph-mon[43939]: pgmap v2208: 17 pgs: 17 active+clean; 3.8 GiB data, 14 GiB used, 791 GiB / 805 GiB avail; 0 B/s wr, 683 op/s 2024-04-01T20:03:16.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:15 smithi188 ceph-mon[43939]: osdmap e817: 12 total, 12 up, 9 in 2024-04-01T20:03:16.193 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:03:16.238 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_historic_ops 2024-04-01T20:03:16.250 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:15 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:03:16.250 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:15 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:03:16.250 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:15 smithi062 ceph-mon[44211]: osdmap e816: 12 total, 12 up, 9 in 2024-04-01T20:03:16.250 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:15 smithi062 ceph-mon[44211]: pgmap v2208: 17 pgs: 17 active+clean; 3.8 GiB data, 14 GiB used, 791 GiB / 805 GiB avail; 0 B/s wr, 683 op/s 2024-04-01T20:03:16.250 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:15 smithi062 ceph-mon[44211]: osdmap e817: 12 total, 12 up, 9 in 2024-04-01T20:03:16.255 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:16.292 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:03:16.295 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:16.296 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:03:16.319 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:03:16.396 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:03:16.403 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T20:03:16.424 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:16.448 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:03:16.450 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:16.451 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:03:16.552 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:03:16.612 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:16.641 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:03:16.652 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:16.652 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:03:16.753 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:03:16.809 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:16.845 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:03:16.848 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:16.849 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:03:16.949 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:03:16.981 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:17.002 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:03:17.006 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:17.006 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:03:17.107 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:03:17.178 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:17.224 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:03:17.230 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:17.230 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:03:17.253 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:03:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:03:17.331 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:03:17.361 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:17.512 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:03:17.516 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:17.516 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:03:17.617 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:03:17.645 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:17.666 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:03:17.669 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:17.670 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:03:17.771 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:03:17.809 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:18.051 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:17 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:03:18.051 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:17 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:03:18.051 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:17 smithi022 ceph-mon[39439]: osdmap e818: 12 total, 12 up, 9 in 2024-04-01T20:03:18.051 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:17 smithi022 ceph-mon[39439]: pgmap v2211: 17 pgs: 17 active+clean; 3.8 GiB data, 13 GiB used, 791 GiB / 805 GiB avail; 0 B/s wr, 784 op/s 2024-04-01T20:03:18.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:17 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:03:18.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:17 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:03:18.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:17 smithi188 ceph-mon[43939]: osdmap e818: 12 total, 12 up, 9 in 2024-04-01T20:03:18.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:17 smithi188 ceph-mon[43939]: pgmap v2211: 17 pgs: 17 active+clean; 3.8 GiB data, 13 GiB used, 791 GiB / 805 GiB avail; 0 B/s wr, 784 op/s 2024-04-01T20:03:18.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:17 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:03:18.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:17 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:03:18.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:17 smithi062 ceph-mon[44211]: osdmap e818: 12 total, 12 up, 9 in 2024-04-01T20:03:18.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:17 smithi062 ceph-mon[44211]: pgmap v2211: 17 pgs: 17 active+clean; 3.8 GiB data, 13 GiB used, 791 GiB / 805 GiB avail; 0 B/s wr, 784 op/s 2024-04-01T20:03:19.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:19 smithi022 ceph-mon[39439]: pgmap v2212: 17 pgs: 17 active+clean; 3.6 GiB data, 13 GiB used, 792 GiB / 805 GiB avail; 0 B/s wr, 966 op/s 2024-04-01T20:03:19.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:19 smithi188 ceph-mon[43939]: pgmap v2212: 17 pgs: 17 active+clean; 3.6 GiB data, 13 GiB used, 792 GiB / 805 GiB avail; 0 B/s wr, 966 op/s 2024-04-01T20:03:20.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:19 smithi062 ceph-mon[44211]: pgmap v2212: 17 pgs: 17 active+clean; 3.6 GiB data, 13 GiB used, 792 GiB / 805 GiB avail; 0 B/s wr, 966 op/s 2024-04-01T20:03:21.628 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T20:03:21.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:21 smithi022 ceph-mon[39439]: osdmap e819: 12 total, 12 up, 9 in 2024-04-01T20:03:21.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:21 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3170874255' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:03:21.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:21 smithi022 ceph-mon[39439]: from='client.27622 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:03:21.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:21 smithi022 ceph-mon[39439]: pgmap v2214: 17 pgs: 17 active+clean; 3.5 GiB data, 13 GiB used, 792 GiB / 805 GiB avail; 0 B/s wr, 995 op/s 2024-04-01T20:03:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:21 smithi188 ceph-mon[43939]: osdmap e819: 12 total, 12 up, 9 in 2024-04-01T20:03:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:21 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3170874255' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:03:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:21 smithi188 ceph-mon[43939]: from='client.27622 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:03:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:21 smithi188 ceph-mon[43939]: pgmap v2214: 17 pgs: 17 active+clean; 3.5 GiB data, 13 GiB used, 792 GiB / 805 GiB avail; 0 B/s wr, 995 op/s 2024-04-01T20:03:22.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:21 smithi062 ceph-mon[44211]: osdmap e819: 12 total, 12 up, 9 in 2024-04-01T20:03:22.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:21 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3170874255' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:03:22.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:21 smithi062 ceph-mon[44211]: from='client.27622 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:03:22.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:21 smithi062 ceph-mon[44211]: pgmap v2214: 17 pgs: 17 active+clean; 3.5 GiB data, 13 GiB used, 792 GiB / 805 GiB avail; 0 B/s wr, 995 op/s 2024-04-01T20:03:22.197 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:03:22.200 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:22.201 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:03:22.301 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:03:22.337 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:22.361 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:03:22.365 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:22.365 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:03:22.466 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:03:22.496 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:22.526 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:03:22.529 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:22.529 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:03:22.580 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:03:22.604 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:03:22.629 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:03:22.630 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:03:22.635 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T20:03:22.635 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:03:22.652 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T20:03:22.657 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:22.679 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:03:22.684 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:22.685 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:03:22.690 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:03:22.723 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:03:22.749 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:03:22.778 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:03:22.786 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:03:22.799 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:03:22.821 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:03:22.842 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:22.845 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T20:03:22.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:22 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:03:22.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:22 smithi022 ceph-mon[39439]: from='client.27622 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T20:03:22.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:22 smithi022 ceph-mon[39439]: osdmap e820: 12 total, 12 up, 9 in 2024-04-01T20:03:22.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:22 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:03:22.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:22 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:03:22.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:22 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1605697039' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:03:22.867 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:03:22.870 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:03:22.870 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:03:22.870 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:03:22.870 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T20:03:22.871 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:03:22.871 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:03:22.871 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:03:22.871 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:03:22.871 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:03:22.871 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:03:22.871 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T20:03:22.871 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:03:22.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:22 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:03:22.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:22 smithi188 ceph-mon[43939]: from='client.27622 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T20:03:22.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:22 smithi188 ceph-mon[43939]: osdmap e820: 12 total, 12 up, 9 in 2024-04-01T20:03:22.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:22 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:03:22.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:22 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:03:22.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:22 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1605697039' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:03:22.888 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:03:22.898 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:22.898 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:22 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:03:22.898 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:22 smithi062 ceph-mon[44211]: from='client.27622 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T20:03:22.898 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:22 smithi062 ceph-mon[44211]: osdmap e820: 12 total, 12 up, 9 in 2024-04-01T20:03:22.898 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:22 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:03:22.898 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:22 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:03:22.898 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:22 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1605697039' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:03:22.899 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:03:23.000 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:03:23.029 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:23.130 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:03:23.132 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:23.133 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:03:23.233 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:03:23.260 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:23.283 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:03:23.289 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:23.290 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:03:23.391 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:03:23.464 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:23.502 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:03:23.505 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:23.506 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:03:23.607 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:03:23.634 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:23.658 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:03:23.663 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:23.664 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:03:23.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:23.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:23.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:23 smithi062 ceph-mon[44211]: osdmap e821: 12 total, 12 up, 9 in 2024-04-01T20:03:23.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:23.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:23.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:23.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:23.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:23.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:23.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:23.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:23.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:23.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:23 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:23.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:23 smithi062 ceph-mon[44211]: pgmap v2217: 17 pgs: 17 active+clean; 3.3 GiB data, 12 GiB used, 792 GiB / 805 GiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T20:03:23.764 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:03:23.850 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:23.899 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:03:23.904 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:23.905 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:03:24.006 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:03:24.036 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:24.038 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:24.038 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:24.038 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:23 smithi188 ceph-mon[43939]: osdmap e821: 12 total, 12 up, 9 in 2024-04-01T20:03:24.038 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:24.038 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:24.038 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:24.038 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:24.039 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:24.039 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:24.039 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:24.039 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:24.039 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:24.039 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:23 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:24.039 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:23 smithi188 ceph-mon[43939]: pgmap v2217: 17 pgs: 17 active+clean; 3.3 GiB data, 12 GiB used, 792 GiB / 805 GiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T20:03:24.060 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:03:24.064 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:24.064 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:03:24.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:24.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:24.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:23 smithi022 ceph-mon[39439]: osdmap e821: 12 total, 12 up, 9 in 2024-04-01T20:03:24.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:24.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:24.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:24.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:24.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:24.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:24.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:24.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:24.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:24.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:23 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:24.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:23 smithi022 ceph-mon[39439]: pgmap v2217: 17 pgs: 17 active+clean; 3.3 GiB data, 12 GiB used, 792 GiB / 805 GiB avail; 0 B/s wr, 1.25k op/s 2024-04-01T20:03:24.164 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:03:24.198 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_ops_in_flight 2024-04-01T20:03:24.238 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:24.273 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:03:24.276 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:24.276 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:03:24.377 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:03:24.406 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:24.429 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:03:24.435 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:24.436 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:03:24.536 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:03:24.542 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T20:03:24.566 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:24.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:24 smithi022 ceph-mon[39439]: 9.f scrub starts 2024-04-01T20:03:24.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:24 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:03:24.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:24 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:03:24.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:24 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:03:24.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:24 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:03:24.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:24 smithi022 ceph-mon[39439]: osdmap e822: 12 total, 12 up, 9 in 2024-04-01T20:03:24.870 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:24 smithi188 ceph-mon[43939]: 9.f scrub starts 2024-04-01T20:03:24.871 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:24 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:03:24.871 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:24 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:03:24.871 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:24 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:03:24.871 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:24 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:03:24.871 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:24 smithi188 ceph-mon[43939]: osdmap e822: 12 total, 12 up, 9 in 2024-04-01T20:03:24.918 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:03:24.921 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:24.921 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:03:25.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:24 smithi062 ceph-mon[44211]: 9.f scrub starts 2024-04-01T20:03:25.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:24 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:03:25.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:24 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:03:25.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:24 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:03:25.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:24 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:03:25.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:24 smithi062 ceph-mon[44211]: osdmap e822: 12 total, 12 up, 9 in 2024-04-01T20:03:25.022 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:03:25.055 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:25.114 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:03:25.117 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:25.117 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:03:25.218 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:03:25.249 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:25.685 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T20:03:25.996 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:03:26.019 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:25 smithi062 ceph-mon[44211]: 9.f scrub ok 2024-04-01T20:03:26.019 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:25 smithi062 ceph-mon[44211]: pgmap v2219: 17 pgs: 17 active+clean; 3.2 GiB data, 12 GiB used, 792 GiB / 805 GiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T20:03:26.019 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:25 smithi062 ceph-mon[44211]: osdmap e823: 12 total, 12 up, 9 in 2024-04-01T20:03:26.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:25 smithi022 ceph-mon[39439]: 9.f scrub ok 2024-04-01T20:03:26.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:25 smithi022 ceph-mon[39439]: pgmap v2219: 17 pgs: 17 active+clean; 3.2 GiB data, 12 GiB used, 792 GiB / 805 GiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T20:03:26.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:25 smithi022 ceph-mon[39439]: osdmap e823: 12 total, 12 up, 9 in 2024-04-01T20:03:26.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:25 smithi188 ceph-mon[43939]: 9.f scrub ok 2024-04-01T20:03:26.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:25 smithi188 ceph-mon[43939]: pgmap v2219: 17 pgs: 17 active+clean; 3.2 GiB data, 12 GiB used, 792 GiB / 805 GiB avail; 0 B/s wr, 1.14k op/s 2024-04-01T20:03:26.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:25 smithi188 ceph-mon[43939]: osdmap e823: 12 total, 12 up, 9 in 2024-04-01T20:03:26.236 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:03:26.239 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:26.240 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:03:26.340 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:03:26.398 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:26.434 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:03:26.438 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:26.438 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:03:26.539 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:03:26.570 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:26.674 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:26 smithi062 ceph-mon[44211]: 9.5 scrub starts 2024-04-01T20:03:26.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:26 smithi022 ceph-mon[39439]: 9.5 scrub starts 2024-04-01T20:03:26.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:26 smithi188 ceph-mon[43939]: 9.5 scrub starts 2024-04-01T20:03:26.904 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T20:03:27.016 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T20:03:27.016 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T20:03:27.016 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-01T20:03:27.016 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T20:03:27.025 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:03:27.031 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:27.031 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:03:27.132 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:03:27.165 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:27.317 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:03:27.323 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:27.324 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:03:27.425 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:03:27.456 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:27.776 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_blocked_ops 2024-04-01T20:03:27.810 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:03:27.813 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:27.813 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:03:27.839 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:27 smithi022 ceph-mon[39439]: 9.5 scrub ok 2024-04-01T20:03:27.839 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:27 smithi022 ceph-mon[39439]: pgmap v2221: 17 pgs: 17 active+clean; 3.1 GiB data, 12 GiB used, 793 GiB / 805 GiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T20:03:27.914 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:03:27.948 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:27 smithi188 ceph-mon[43939]: 9.5 scrub ok 2024-04-01T20:03:27.948 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:27 smithi188 ceph-mon[43939]: pgmap v2221: 17 pgs: 17 active+clean; 3.1 GiB data, 12 GiB used, 793 GiB / 805 GiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T20:03:27.950 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:27.974 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:03:27.978 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:27.979 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:03:28.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:27 smithi062 ceph-mon[44211]: 9.5 scrub ok 2024-04-01T20:03:28.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:27 smithi062 ceph-mon[44211]: pgmap v2221: 17 pgs: 17 active+clean; 3.1 GiB data, 12 GiB used, 793 GiB / 805 GiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T20:03:28.079 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:03:28.108 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:03:28.146 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T20:03:28.150 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:28.186 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:03:28.195 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:28.195 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:03:28.296 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:03:28.372 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:28.414 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:03:28.418 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:28.418 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:03:28.519 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:03:28.577 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:28.624 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:03:28.627 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:28.627 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:03:28.694 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:28 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3366218551' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:03:28.709 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T20:03:28.728 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:03:28.758 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:28 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3366218551' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:03:28.761 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:29.017 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:28 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3366218551' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:03:29.112 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:03:29.121 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:29.121 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:03:29.222 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:03:29.289 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:29.319 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:03:29.321 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:29.322 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:03:29.423 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:03:29.452 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:29.710 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:03:29.716 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:29 smithi188 ceph-mon[43939]: 9.a scrub starts 2024-04-01T20:03:29.716 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:29 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T20:03:29.716 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:29 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T20:03:29.716 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:29 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3366218551' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T20:03:29.716 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:29 smithi188 ceph-mon[43939]: osdmap e824: 12 total, 12 up, 9 in 2024-04-01T20:03:29.716 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:29 smithi188 ceph-mon[43939]: pgmap v2223: 17 pgs: 17 active+clean; 2.9 GiB data, 12 GiB used, 793 GiB / 805 GiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T20:03:29.716 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:29.717 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:03:29.818 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:03:29.847 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:29.954 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:29 smithi022 ceph-mon[39439]: 9.a scrub starts 2024-04-01T20:03:29.954 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:29 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T20:03:29.954 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:29 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T20:03:29.954 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:29 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3366218551' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T20:03:29.954 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:29 smithi022 ceph-mon[39439]: osdmap e824: 12 total, 12 up, 9 in 2024-04-01T20:03:29.954 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:29 smithi022 ceph-mon[39439]: pgmap v2223: 17 pgs: 17 active+clean; 2.9 GiB data, 12 GiB used, 793 GiB / 805 GiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T20:03:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:29 smithi062 ceph-mon[44211]: 9.a scrub starts 2024-04-01T20:03:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:29 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T20:03:30.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:29 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T20:03:30.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:29 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3366218551' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T20:03:30.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:29 smithi062 ceph-mon[44211]: osdmap e824: 12 total, 12 up, 9 in 2024-04-01T20:03:30.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:29 smithi062 ceph-mon[44211]: pgmap v2223: 17 pgs: 17 active+clean; 2.9 GiB data, 12 GiB used, 793 GiB / 805 GiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T20:03:30.056 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:03:30.060 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:30.060 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:03:30.161 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:03:30.218 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:30.248 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:03:30.255 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:30.255 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:03:30.356 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:03:30.395 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:30.399 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-01T20:03:30.399 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-01T20:03:30.399 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-01T20:03:30.400 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-01T20:03:30.400 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-01T20:03:30.424 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:03:30.427 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:30.427 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:03:30.528 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:03:30.561 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:30.709 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:30 smithi022 ceph-mon[39439]: 9.a scrub ok 2024-04-01T20:03:30.710 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:30 smithi022 ceph-mon[39439]: 9.9 scrub starts 2024-04-01T20:03:30.710 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:30 smithi022 ceph-mon[39439]: osdmap e825: 12 total, 12 up, 9 in 2024-04-01T20:03:30.720 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:03:30.723 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:30.724 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:03:30.824 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:03:30.873 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:30.912 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:03:30.918 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:30.919 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:03:30.956 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-01T20:03:30.957 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T20:03:31.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:30 smithi062 ceph-mon[44211]: 9.a scrub ok 2024-04-01T20:03:31.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:30 smithi062 ceph-mon[44211]: 9.9 scrub starts 2024-04-01T20:03:31.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:30 smithi062 ceph-mon[44211]: osdmap e825: 12 total, 12 up, 9 in 2024-04-01T20:03:31.020 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:03:31.046 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:03:31.047 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:30 smithi188 ceph-mon[43939]: 9.a scrub ok 2024-04-01T20:03:31.047 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:30 smithi188 ceph-mon[43939]: 9.9 scrub starts 2024-04-01T20:03:31.047 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:30 smithi188 ceph-mon[43939]: osdmap e825: 12 total, 12 up, 9 in 2024-04-01T20:03:31.049 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:31.069 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:03:31.097 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:03:31.120 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T20:03:31.128 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:03:31.133 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:31.134 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:03:31.150 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:03:31.168 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_historic_ops 2024-04-01T20:03:31.175 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:03:31.202 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:03:31.235 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:03:31.237 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:03:31.262 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:03:31.286 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:03:31.290 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:31.291 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:03:31.311 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T20:03:31.337 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:03:31.339 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:03:31.339 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:03:31.339 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:03:31.339 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T20:03:31.339 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:03:31.339 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:03:31.339 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:03:31.339 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:03:31.339 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:03:31.339 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:03:31.340 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T20:03:31.340 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:03:31.342 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:03:31.347 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:31.347 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:03:31.448 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:03:31.482 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:31.505 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:03:31.510 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:31.510 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:03:31.530 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T20:03:31.611 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:03:31.664 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:31.707 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:03:31.714 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:31.715 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:03:31.781 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T20:03:31.815 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:03:31.821 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:31 smithi188 ceph-mon[43939]: 9.9 scrub ok 2024-04-01T20:03:31.821 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:31 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:03:31.821 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:31 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:03:31.821 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:31 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3826854077' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:03:31.822 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:31.822 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:31 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:31.822 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:31 smithi188 ceph-mon[43939]: pgmap v2225: 17 pgs: 17 active+clean; 2.8 GiB data, 12 GiB used, 793 GiB / 805 GiB avail; 0 B/s wr, 974 op/s 2024-04-01T20:03:31.859 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:31.894 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:03:31.897 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:31.897 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:03:31.934 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:31 smithi022 ceph-mon[39439]: 9.9 scrub ok 2024-04-01T20:03:31.934 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:31 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:03:31.935 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:31 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:03:31.935 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:31 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3826854077' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:03:31.935 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:31.935 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:31 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:31.935 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:31 smithi022 ceph-mon[39439]: pgmap v2225: 17 pgs: 17 active+clean; 2.8 GiB data, 12 GiB used, 793 GiB / 805 GiB avail; 0 B/s wr, 974 op/s 2024-04-01T20:03:31.998 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:03:32.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:31 smithi062 ceph-mon[44211]: 9.9 scrub ok 2024-04-01T20:03:32.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:31 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:03:32.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:31 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:03:32.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:31 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3826854077' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:03:32.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:32.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:31 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:32.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:31 smithi062 ceph-mon[44211]: pgmap v2225: 17 pgs: 17 active+clean; 2.8 GiB data, 12 GiB used, 793 GiB / 805 GiB avail; 0 B/s wr, 974 op/s 2024-04-01T20:03:32.059 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:32.091 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:03:32.102 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:32.103 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:03:32.204 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:03:32.241 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:33.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:32 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:32 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:32 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:33.397 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:03:33.399 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:33.400 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:03:33.501 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:03:33.531 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:33.739 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:33 smithi188 ceph-mon[43939]: 9.b scrub starts 2024-04-01T20:03:33.739 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:33 smithi188 ceph-mon[43939]: pgmap v2226: 17 pgs: 17 active+clean; 2.7 GiB data, 11 GiB used, 793 GiB / 805 GiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T20:03:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:33 smithi062 ceph-mon[44211]: 9.b scrub starts 2024-04-01T20:03:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:33 smithi062 ceph-mon[44211]: pgmap v2226: 17 pgs: 17 active+clean; 2.7 GiB data, 11 GiB used, 793 GiB / 805 GiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T20:03:34.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:33 smithi022 ceph-mon[39439]: 9.b scrub starts 2024-04-01T20:03:34.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:33 smithi022 ceph-mon[39439]: pgmap v2226: 17 pgs: 17 active+clean; 2.7 GiB data, 11 GiB used, 793 GiB / 805 GiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T20:03:34.208 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:03:35.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:34 smithi062 ceph-mon[44211]: 9.b scrub ok 2024-04-01T20:03:35.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:34 smithi022 ceph-mon[39439]: 9.b scrub ok 2024-04-01T20:03:35.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:34 smithi188 ceph-mon[43939]: 9.b scrub ok 2024-04-01T20:03:35.654 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T20:03:35.656 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T20:03:35.658 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T20:03:35.682 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:03:35.686 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:35.686 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:03:35.787 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:03:35.831 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:35 smithi062 ceph-mon[44211]: 9.0 scrub starts 2024-04-01T20:03:36.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:35 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:03:36.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:35 smithi062 ceph-mon[44211]: pgmap v2227: 17 pgs: 17 active+clean; 2.5 GiB data, 11 GiB used, 794 GiB / 805 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T20:03:36.027 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:35 smithi188 ceph-mon[43939]: 9.0 scrub starts 2024-04-01T20:03:36.028 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:35 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:03:36.028 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:35 smithi188 ceph-mon[43939]: pgmap v2227: 17 pgs: 17 active+clean; 2.5 GiB data, 11 GiB used, 794 GiB / 805 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T20:03:36.049 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:35 smithi022 ceph-mon[39439]: 9.0 scrub starts 2024-04-01T20:03:36.049 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:35 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:03:36.049 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:35 smithi022 ceph-mon[39439]: pgmap v2227: 17 pgs: 17 active+clean; 2.5 GiB data, 11 GiB used, 794 GiB / 805 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T20:03:36.390 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:03:36.393 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:36.393 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:03:36.494 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:03:36.528 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:36.533 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T20:03:36.533 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:03:36.609 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:03:36.612 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:36.612 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:03:36.713 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:03:36.747 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:36.776 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:03:36.779 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:36.779 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:03:36.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:36 smithi188 ceph-mon[43939]: 9.0 scrub ok 2024-04-01T20:03:36.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:36 smithi188 ceph-mon[43939]: from='client.37685 v1:172.21.15.22:0/2926781628' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T20:03:36.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:36 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:03:36.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:36 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:03:36.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:36 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:03:36.880 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:03:36.940 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:36.975 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:03:36.983 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:36.983 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:03:37.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:36 smithi062 ceph-mon[44211]: 9.0 scrub ok 2024-04-01T20:03:37.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:36 smithi062 ceph-mon[44211]: from='client.37685 v1:172.21.15.22:0/2926781628' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T20:03:37.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:36 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:03:37.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:36 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:03:37.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:36 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:03:37.085 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:03:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:36 smithi022 ceph-mon[39439]: 9.0 scrub ok 2024-04-01T20:03:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:36 smithi022 ceph-mon[39439]: from='client.37685 v1:172.21.15.22:0/2926781628' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T20:03:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:36 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:03:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:36 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:03:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:36 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:03:37.148 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:37.157 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":2227,"stamp":"2024-04-01T20:03:35.471717+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2731672120,"num_objects":41676,"num_object_clones":0,"num_object_copies":83352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41676,"num_whiteouts":0,"num_read":127,"num_read_kb":110,"num_write":270673,"num_write_kb":9992187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97544,"num_bytes_recovered":6394501816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160902,"ondisk_log_size":160902,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":9,"num_per_pool_osds":9,"num_per_pool_omap_osds":8,"kb":843706368,"kb_used":11626280,"kb_used_data":5805708,"kb_used_omap":967,"kb_used_meta":5819256,"kb_avail":832080088,"statfs":{"total":863955320832,"available":852050010112,"internally_reserved":0,"allocated":5945044992,"data_stored":5940712866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":990537,"internal_metadata":5958918839},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,1,1,2,3,6],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-601817088,"num_objects":-9183,"num_object_clones":0,"num_object_copies":-18366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-9183,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9183,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001259"},"pg_stats":[{"pgid":"9.f","version":"825'19595","reported_seq":35850,"reported_epoch":825,"state":"active+clean","last_fresh":"2024-04-01T20:03:32.956753+0000","last_change":"2024-04-01T20:03:23.875213+0000","last_active":"2024-04-01T20:03:32.956753+0000","last_peered":"2024-04-01T20:03:32.956753+0000","last_clean":"2024-04-01T20:03:32.956753+0000","last_became_active":"2024-04-01T20:02:09.581338+0000","last_became_peered":"2024-04-01T20:02:09.581338+0000","last_unstale":"2024-04-01T20:03:32.956753+0000","last_undegraded":"2024-04-01T20:03:32.956753+0000","last_fullsized":"2024-04-01T20:03:32.956753+0000","mapping_epoch":792,"log_start":"765'9500","ondisk_log_start":"765'9500","created":735,"last_epoch_clean":793,"parent":"0.0","parent_split_bits":0,"last_scrub":"822'18986","last_scrub_stamp":"2024-04-01T20:03:23.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:03:23.875104+0000","objects_scrubbed":3224,"log_size":10095,"log_dups_size":0,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:04:28.234545+0000","scrub_duration":766,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169934848,"num_objects":2593,"num_object_clones":0,"num_object_copies":5186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2593,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16617,"num_write_kb":614720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7900,"num_bytes_recovered":517734400,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.e","version":"825'16904","reported_seq":33080,"reported_epoch":825,"state":"active+clean","last_fresh":"2024-04-01T20:03:34.219230+0000","last_change":"2024-04-01T20:02:49.912057+0000","last_active":"2024-04-01T20:03:34.219230+0000","last_peered":"2024-04-01T20:03:34.219230+0000","last_clean":"2024-04-01T20:03:34.219230+0000","last_became_active":"2024-04-01T20:02:09.584558+0000","last_became_peered":"2024-04-01T20:02:09.584558+0000","last_unstale":"2024-04-01T20:03:34.219230+0000","last_undegraded":"2024-04-01T20:03:34.219230+0000","last_fullsized":"2024-04-01T20:03:34.219230+0000","mapping_epoch":792,"log_start":"754'6900","ondisk_log_start":"754'6900","created":735,"last_epoch_clean":793,"parent":"0.0","parent_split_bits":0,"last_scrub":"808'14447","last_scrub_stamp":"2024-04-01T20:02:49.911940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:02:49.911940+0000","objects_scrubbed":5008,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:04:06.972154+0000","scrub_duration":1016,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165806080,"num_objects":2530,"num_object_clones":0,"num_object_copies":5060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2530,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16904,"num_write_kb":621888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7913,"num_bytes_recovered":518586368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"825'18521","reported_seq":34905,"reported_epoch":825,"state":"active+clean","last_fresh":"2024-04-01T20:03:34.214887+0000","last_change":"2024-04-01T20:02:51.099917+0000","last_active":"2024-04-01T20:03:34.214887+0000","last_peered":"2024-04-01T20:03:34.214887+0000","last_clean":"2024-04-01T20:03:34.214887+0000","last_became_active":"2024-04-01T20:02:09.584645+0000","last_became_peered":"2024-04-01T20:02:09.584645+0000","last_unstale":"2024-04-01T20:03:34.214887+0000","last_undegraded":"2024-04-01T20:03:34.214887+0000","last_fullsized":"2024-04-01T20:03:34.214887+0000","mapping_epoch":792,"log_start":"762'8500","ondisk_log_start":"762'8500","created":735,"last_epoch_clean":793,"parent":"0.0","parent_split_bits":0,"last_scrub":"808'16193","last_scrub_stamp":"2024-04-01T20:02:51.099658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:02:51.099658+0000","objects_scrubbed":4932,"log_size":10021,"log_dups_size":0,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:04:16.107590+0000","scrub_duration":1154,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169082904,"num_objects":2581,"num_object_clones":0,"num_object_copies":5162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2581,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":16935,"num_write_kb":624449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7964,"num_bytes_recovered":521797656,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.c","version":"825'16922","reported_seq":31878,"reported_epoch":825,"state":"active+clean","last_fresh":"2024-04-01T20:03:31.880188+0000","last_change":"2024-04-01T20:02:46.473018+0000","last_active":"2024-04-01T20:03:31.880188+0000","last_peered":"2024-04-01T20:03:31.880188+0000","last_clean":"2024-04-01T20:03:31.880188+0000","last_became_active":"2024-04-01T20:02:30.575805+0000","last_became_peered":"2024-04-01T20:02:30.575805+0000","last_unstale":"2024-04-01T20:03:31.880188+0000","last_undegraded":"2024-04-01T20:03:31.880188+0000","last_fullsized":"2024-04-01T20:03:31.880188+0000","mapping_epoch":800,"log_start":"753'6900","ondisk_log_start":"753'6900","created":735,"last_epoch_clean":801,"parent":"0.0","parent_split_bits":0,"last_scrub":"807'14517","last_scrub_stamp":"2024-04-01T20:02:46.472768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:02:46.472768+0000","objects_scrubbed":5197,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:04:05.104151+0000","scrub_duration":1473,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179699712,"num_objects":2742,"num_object_clones":0,"num_object_copies":5484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2742,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16922,"num_write_kb":629248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7295,"num_bytes_recovered":478085120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"825'16972","reported_seq":17361,"reported_epoch":825,"state":"active+clean","last_fresh":"2024-04-01T20:03:34.750141+0000","last_change":"2024-04-01T20:03:33.426766+0000","last_active":"2024-04-01T20:03:34.750141+0000","last_peered":"2024-04-01T20:03:34.750141+0000","last_clean":"2024-04-01T20:03:34.750141+0000","last_became_active":"2024-04-01T19:59:28.153409+0000","last_became_peered":"2024-04-01T19:59:28.153409+0000","last_unstale":"2024-04-01T20:03:34.750141+0000","last_undegraded":"2024-04-01T20:03:34.750141+0000","last_fullsized":"2024-04-01T20:03:34.750141+0000","mapping_epoch":735,"log_start":"753'6900","ondisk_log_start":"753'6900","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"825'16879","last_scrub_stamp":"2024-04-01T20:03:33.426616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:03:33.426616+0000","objects_scrubbed":2631,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:04:53.597942+0000","scrub_duration":557,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165019648,"num_objects":2518,"num_object_clones":0,"num_object_copies":5036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2518,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16972,"num_write_kb":623680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"9.a","version":"825'19529","reported_seq":19954,"reported_epoch":825,"state":"active+clean","last_fresh":"2024-04-01T20:03:32.951000+0000","last_change":"2024-04-01T20:03:28.861684+0000","last_active":"2024-04-01T20:03:32.951000+0000","last_peered":"2024-04-01T20:03:32.951000+0000","last_clean":"2024-04-01T20:03:32.951000+0000","last_became_active":"2024-04-01T19:59:28.153559+0000","last_became_peered":"2024-04-01T19:59:28.153559+0000","last_unstale":"2024-04-01T20:03:32.951000+0000","last_undegraded":"2024-04-01T20:03:32.951000+0000","last_fullsized":"2024-04-01T20:03:32.951000+0000","mapping_epoch":735,"log_start":"765'9500","ondisk_log_start":"765'9500","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"824'19251","last_scrub_stamp":"2024-04-01T20:03:28.861408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:03:28.861408+0000","objects_scrubbed":2871,"log_size":10029,"log_dups_size":0,"ondisk_log_size":10029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:04:49.044887+0000","scrub_duration":745,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168361984,"num_objects":2569,"num_object_clones":0,"num_object_copies":5138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2569,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17081,"num_write_kb":628800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"825'16931","reported_seq":30677,"reported_epoch":825,"state":"active+clean","last_fresh":"2024-04-01T20:03:32.955512+0000","last_change":"2024-04-01T20:03:29.871291+0000","last_active":"2024-04-01T20:03:32.955512+0000","last_peered":"2024-04-01T20:03:32.955512+0000","last_clean":"2024-04-01T20:03:32.955512+0000","last_became_active":"2024-04-01T20:02:41.604819+0000","last_became_peered":"2024-04-01T20:02:41.604819+0000","last_unstale":"2024-04-01T20:03:32.955512+0000","last_undegraded":"2024-04-01T20:03:32.955512+0000","last_fullsized":"2024-04-01T20:03:32.955512+0000","mapping_epoch":805,"log_start":"753'6900","ondisk_log_start":"753'6900","created":735,"last_epoch_clean":806,"parent":"0.0","parent_split_bits":0,"last_scrub":"824'16723","last_scrub_stamp":"2024-04-01T20:03:29.871150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:03:29.871150+0000","objects_scrubbed":2908,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:04:53.337783+0000","scrub_duration":778,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175570944,"num_objects":2679,"num_object_clones":0,"num_object_copies":5358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2679,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16931,"num_write_kb":627520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6703,"num_bytes_recovered":439287808,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.7","version":"825'16898","reported_seq":32507,"reported_epoch":825,"state":"active+clean","last_fresh":"2024-04-01T20:03:34.182656+0000","last_change":"2024-04-01T20:02:47.062182+0000","last_active":"2024-04-01T20:03:34.182656+0000","last_peered":"2024-04-01T20:03:34.182656+0000","last_clean":"2024-04-01T20:03:34.182656+0000","last_became_active":"2024-04-01T20:02:13.883921+0000","last_became_peered":"2024-04-01T20:02:13.883921+0000","last_unstale":"2024-04-01T20:03:34.182656+0000","last_undegraded":"2024-04-01T20:03:34.182656+0000","last_fullsized":"2024-04-01T20:03:34.182656+0000","mapping_epoch":795,"log_start":"753'6800","ondisk_log_start":"753'6800","created":735,"last_epoch_clean":796,"parent":"0.0","parent_split_bits":0,"last_scrub":"807'14327","last_scrub_stamp":"2024-04-01T20:02:47.062015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:02:47.062015+0000","objects_scrubbed":5175,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:03:50.497137+0000","scrub_duration":1129,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168165376,"num_objects":2566,"num_object_clones":0,"num_object_copies":5132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16898,"num_write_kb":622848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7628,"num_bytes_recovered":499908608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"825'16931","reported_seq":33216,"reported_epoch":825,"state":"active+clean","last_fresh":"2024-04-01T20:03:32.971140+0000","last_change":"2024-04-01T20:02:51.604983+0000","last_active":"2024-04-01T20:03:32.971140+0000","last_peered":"2024-04-01T20:03:32.971140+0000","last_clean":"2024-04-01T20:03:32.971140+0000","last_became_active":"2024-04-01T20:02:10.586686+0000","last_became_peered":"2024-04-01T20:02:10.586686+0000","last_unstale":"2024-04-01T20:03:32.971140+0000","last_undegraded":"2024-04-01T20:03:32.971140+0000","last_fullsized":"2024-04-01T20:03:32.971140+0000","mapping_epoch":793,"log_start":"753'6900","ondisk_log_start":"753'6900","created":735,"last_epoch_clean":794,"parent":"0.0","parent_split_bits":0,"last_scrub":"808'14733","last_scrub_stamp":"2024-04-01T20:02:51.604792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:02:51.604792+0000","objects_scrubbed":4874,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:03:51.915581+0000","scrub_duration":1194,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173604864,"num_objects":2649,"num_object_clones":0,"num_object_copies":5298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2649,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16931,"num_write_kb":626560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7984,"num_bytes_recovered":523239424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"825'19282","reported_seq":32770,"reported_epoch":825,"state":"active+clean","last_fresh":"2024-04-01T20:03:32.947970+0000","last_change":"2024-04-01T20:03:26.123194+0000","last_active":"2024-04-01T20:03:32.947970+0000","last_peered":"2024-04-01T20:03:32.947970+0000","last_clean":"2024-04-01T20:03:32.947970+0000","last_became_active":"2024-04-01T20:02:42.608420+0000","last_became_peered":"2024-04-01T20:02:42.608420+0000","last_unstale":"2024-04-01T20:03:32.947970+0000","last_undegraded":"2024-04-01T20:03:32.947970+0000","last_fullsized":"2024-04-01T20:03:32.947970+0000","mapping_epoch":806,"log_start":"765'9201","ondisk_log_start":"765'9201","created":735,"last_epoch_clean":807,"parent":"0.0","parent_split_bits":0,"last_scrub":"823'18832","last_scrub_stamp":"2024-04-01T20:03:26.122905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:03:26.122905+0000","objects_scrubbed":3091,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:04:54.987461+0000","scrub_duration":1037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171048960,"num_objects":2610,"num_object_clones":0,"num_object_copies":5220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2610,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16722,"num_write_kb":618624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6522,"num_bytes_recovered":427425792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.4","version":"825'16956","reported_seq":33388,"reported_epoch":825,"state":"active+clean","last_fresh":"2024-04-01T20:03:32.114328+0000","last_change":"2024-04-01T20:02:15.175330+0000","last_active":"2024-04-01T20:03:32.114328+0000","last_peered":"2024-04-01T20:03:32.114328+0000","last_clean":"2024-04-01T20:03:32.114328+0000","last_became_active":"2024-04-01T20:02:10.589045+0000","last_became_peered":"2024-04-01T20:02:10.589045+0000","last_unstale":"2024-04-01T20:03:32.114328+0000","last_undegraded":"2024-04-01T20:03:32.114328+0000","last_fullsized":"2024-04-01T20:03:32.114328+0000","mapping_epoch":793,"log_start":"753'6900","ondisk_log_start":"753'6900","created":735,"last_epoch_clean":794,"parent":"0.0","parent_split_bits":0,"last_scrub":"796'12769","last_scrub_stamp":"2024-04-01T20:02:15.175214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:02:15.175214+0000","objects_scrubbed":6938,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:03:38.475762+0000","scrub_duration":1293,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177602560,"num_objects":2710,"num_object_clones":0,"num_object_copies":5420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2710,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16956,"num_write_kb":629312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8034,"num_bytes_recovered":526516224,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"825'17080","reported_seq":32778,"reported_epoch":825,"state":"active+clean","last_fresh":"2024-04-01T20:03:34.796437+0000","last_change":"2024-04-01T20:02:13.639856+0000","last_active":"2024-04-01T20:03:34.796437+0000","last_peered":"2024-04-01T20:03:34.796437+0000","last_clean":"2024-04-01T20:03:34.796437+0000","last_became_active":"2024-04-01T20:02:10.584240+0000","last_became_peered":"2024-04-01T20:02:10.584240+0000","last_unstale":"2024-04-01T20:03:34.796437+0000","last_undegraded":"2024-04-01T20:03:34.796437+0000","last_fullsized":"2024-04-01T20:03:34.796437+0000","mapping_epoch":793,"log_start":"753'7000","ondisk_log_start":"753'7000","created":735,"last_epoch_clean":794,"parent":"0.0","parent_split_bits":0,"last_scrub":"795'12681","last_scrub_stamp":"2024-04-01T20:02:13.639679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:02:13.639679+0000","objects_scrubbed":6862,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":848,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161349632,"num_objects":2462,"num_object_clones":0,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17080,"num_write_kb":625344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7662,"num_bytes_recovered":502136832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"9.2","version":"825'17015","reported_seq":33809,"reported_epoch":825,"state":"active+clean","last_fresh":"2024-04-01T20:03:34.772085+0000","last_change":"2024-04-01T20:02:15.854326+0000","last_active":"2024-04-01T20:03:34.772085+0000","last_peered":"2024-04-01T20:03:34.772085+0000","last_clean":"2024-04-01T20:03:34.772085+0000","last_became_active":"2024-04-01T20:01:58.613523+0000","last_became_peered":"2024-04-01T20:01:58.613523+0000","last_unstale":"2024-04-01T20:03:34.772085+0000","last_undegraded":"2024-04-01T20:03:34.772085+0000","last_fullsized":"2024-04-01T20:03:34.772085+0000","mapping_epoch":787,"log_start":"754'7000","ondisk_log_start":"754'7000","created":735,"last_epoch_clean":788,"parent":"0.0","parent_split_bits":0,"last_scrub":"796'12678","last_scrub_stamp":"2024-04-01T20:02:15.854222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:02:15.854222+0000","objects_scrubbed":6834,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:03:43.411663+0000","scrub_duration":1045,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161808384,"num_objects":2469,"num_object_clones":0,"num_object_copies":4938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2469,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17015,"num_write_kb":623488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8210,"num_bytes_recovered":538050560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"9.1","version":"825'16746","reported_seq":31391,"reported_epoch":825,"state":"active+clean","last_fresh":"2024-04-01T20:03:31.009088+0000","last_change":"2024-04-01T20:02:48.750783+0000","last_active":"2024-04-01T20:03:31.009088+0000","last_peered":"2024-04-01T20:03:31.009088+0000","last_clean":"2024-04-01T20:03:31.009088+0000","last_became_active":"2024-04-01T20:02:29.571477+0000","last_became_peered":"2024-04-01T20:02:29.571477+0000","last_unstale":"2024-04-01T20:03:31.009088+0000","last_undegraded":"2024-04-01T20:03:31.009088+0000","last_fullsized":"2024-04-01T20:03:31.009088+0000","mapping_epoch":799,"log_start":"752'6700","ondisk_log_start":"752'6700","created":735,"last_epoch_clean":800,"parent":"0.0","parent_split_bits":0,"last_scrub":"808'14613","last_scrub_stamp":"2024-04-01T20:02:48.750518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:02:48.750518+0000","objects_scrubbed":4868,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:04:02.336859+0000","scrub_duration":984,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176291840,"num_objects":2690,"num_object_clones":0,"num_object_copies":5380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2690,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16746,"num_write_kb":621952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7149,"num_bytes_recovered":468516864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"9.0","version":"825'17112","reported_seq":17488,"reported_epoch":825,"state":"active+clean","last_fresh":"2024-04-01T20:03:32.955381+0000","last_change":"2024-04-01T20:01:18.579514+0000","last_active":"2024-04-01T20:03:32.955381+0000","last_peered":"2024-04-01T20:03:32.955381+0000","last_clean":"2024-04-01T20:03:32.955381+0000","last_became_active":"2024-04-01T19:59:28.244137+0000","last_became_peered":"2024-04-01T19:59:28.244137+0000","last_unstale":"2024-04-01T20:03:32.955381+0000","last_undegraded":"2024-04-01T20:03:32.955381+0000","last_fullsized":"2024-04-01T20:03:32.955381+0000","mapping_epoch":735,"log_start":"754'7100","ondisk_log_start":"754'7100","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"769'10438","last_scrub_stamp":"2024-04-01T20:01:18.579347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:01:18.579347+0000","objects_scrubbed":9428,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"queued for scrub","scrub_duration":2022,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177209344,"num_objects":2704,"num_object_clones":0,"num_object_copies":5408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2704,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17112,"num_write_kb":634112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"825'16670","reported_seq":30163,"reported_epoch":825,"state":"active+clean","last_fresh":"2024-04-01T20:03:30.996052+0000","last_change":"2024-04-01T20:02:41.241164+0000","last_active":"2024-04-01T20:03:30.996052+0000","last_peered":"2024-04-01T20:03:30.996052+0000","last_clean":"2024-04-01T20:03:30.996052+0000","last_became_active":"2024-04-01T20:02:40.600605+0000","last_became_peered":"2024-04-01T20:02:40.600605+0000","last_unstale":"2024-04-01T20:03:30.996052+0000","last_undegraded":"2024-04-01T20:03:30.996052+0000","last_fullsized":"2024-04-01T20:03:30.996052+0000","mapping_epoch":804,"log_start":"752'6600","ondisk_log_start":"752'6600","created":735,"last_epoch_clean":805,"parent":"0.0","parent_split_bits":0,"last_scrub":"805'14032","last_scrub_stamp":"2024-04-01T20:02:41.241040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:02:41.241040+0000","objects_scrubbed":5241,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:04:06.721416+0000","scrub_duration":506,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170524672,"num_objects":2602,"num_object_clones":0,"num_object_copies":5204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2602,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16670,"num_write_kb":616704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6570,"num_bytes_recovered":430571520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5],"acting":[9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":2014,"reported_epoch":825,"state":"active+clean","last_fresh":"2024-04-01T20:03:30.611097+0000","last_change":"2024-04-01T20:02:45.191659+0000","last_active":"2024-04-01T20:03:30.611097+0000","last_peered":"2024-04-01T20:03:30.611097+0000","last_clean":"2024-04-01T20:03:30.611097+0000","last_became_active":"2024-04-01T20:01:45.155357+0000","last_became_peered":"2024-04-01T20:01:45.155357+0000","last_unstale":"2024-04-01T20:03:30.611097+0000","last_undegraded":"2024-04-01T20:03:30.611097+0000","last_fullsized":"2024-04-01T20:03:30.611097+0000","mapping_epoch":781,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":782,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T20:02:45.191520+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T20:02:45.191520+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:03:57.475652+0000","scrub_duration":272,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2644640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":2731081752,"num_objects":41674,"num_object_clones":0,"num_object_copies":83348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41674,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":270492,"num_write_kb":9989249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97534,"num_bytes_recovered":6391857176,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7673950208,"data_stored":7673937992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160763,"ondisk_log_size":160763,"up":32,"acting":32,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2644640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":0,"seq":365072220651,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":0,"seq":3272765079586,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678519,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1564272,"kb_used_data":707048,"kb_used_omap":1,"kb_used_meta":857214,"kb_avail":92180880,"statfs":{"total":95995035648,"available":94393221120,"internally_reserved":0,"allocated":724017152,"data_stored":723541954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":877787584},"hb_peers":[1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557716,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1037436,"kb_used_data":648564,"kb_used_omap":132,"kb_used_meta":388731,"kb_avail":92707716,"statfs":{"total":95995035648,"available":94932701184,"internally_reserved":0,"allocated":664129536,"data_stored":663648334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":398061287},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234497,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1400392,"kb_used_data":660928,"kb_used_omap":1,"kb_used_meta":739198,"kb_avail":92344760,"statfs":{"total":95995035648,"available":94561034240,"internally_reserved":0,"allocated":676790272,"data_stored":676301446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":756939210},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":457,"seq":1962800054508,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":915064,"kb_used_data":549744,"kb_used_omap":744,"kb_used_meta":364567,"kb_avail":92830088,"statfs":{"total":95995035648,"available":95058010112,"internally_reserved":0,"allocated":562937856,"data_stored":562459106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":762131,"internal_metadata":373317357},"hb_peers":[1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":571,"seq":2452426326176,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1396740,"kb_used_data":1038008,"kb_used_omap":81,"kb_used_meta":358638,"kb_avail":92348412,"statfs":{"total":95995035648,"available":94564773888,"internally_reserved":0,"allocated":1062920192,"data_stored":1062434918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":83387,"internal_metadata":367245893},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":749876,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":748926,"kb_avail":92995276,"statfs":{"total":95995035648,"available":95227162624,"internally_reserved":0,"allocated":958464,"data_stored":483266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":766900677},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":809340,"kb_used_data":178420,"kb_used_omap":1,"kb_used_meta":630910,"kb_avail":92935812,"statfs":{"total":95995035648,"available":95166271488,"internally_reserved":0,"allocated":182702080,"data_stored":182220878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":646052293},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":0,"seq":111669150228,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953998,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1111236,"kb_used_data":358132,"kb_used_omap":1,"kb_used_meta":753086,"kb_avail":92633916,"statfs":{"total":95995035648,"available":94857129984,"internally_reserved":0,"allocated":366727168,"data_stored":366245966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":771160517},"hb_peers":[0,1,2,3,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,2,1,6],"upper_bound":128},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790474,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2641924,"kb_used_data":1663928,"kb_used_omap":1,"kb_used_meta":977982,"kb_avail":91103228,"statfs":{"total":95995035648,"available":93289705472,"internally_reserved":0,"allocated":1703862272,"data_stored":1703376998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1001454021},"hb_peers":[0,1,2,3,4,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1055985664,"data_stored":1055981592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":179306496,"data_stored":179306496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1127088128,"data_stored":1127088128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":358416384,"data_stored":358416384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1671368704,"data_stored":1671364632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":548601856,"data_stored":548601856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":668667904,"data_stored":668663832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":647954432,"data_stored":647954432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":705822720,"data_stored":705822720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":710737920,"data_stored":710737920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T20:03:37.158 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T20:03:37.189 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:03:37.199 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:37.199 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:03:37.217 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:03:37.296 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_ops_in_flight 2024-04-01T20:03:37.300 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:03:37.391 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:37.434 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:03:37.436 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:37.437 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:03:37.538 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:03:37.604 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:37.634 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:03:37.641 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:37.642 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:03:37.743 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:03:37.779 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:37.805 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:03:37.809 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:37.810 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:03:37.910 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:03:37.940 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:37.965 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:03:37.971 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:37.971 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:03:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:37 smithi062 ceph-mon[44211]: 9.3 scrub starts 2024-04-01T20:03:38.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:37 smithi062 ceph-mon[44211]: 9.3 scrub ok 2024-04-01T20:03:38.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:37 smithi062 ceph-mon[44211]: pgmap v2228: 17 pgs: 17 active+clean; 2.5 GiB data, 11 GiB used, 794 GiB / 805 GiB avail; 0 B/s wr, 966 op/s 2024-04-01T20:03:38.072 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:03:38.097 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:37 smithi188 ceph-mon[43939]: 9.3 scrub starts 2024-04-01T20:03:38.097 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:37 smithi188 ceph-mon[43939]: 9.3 scrub ok 2024-04-01T20:03:38.097 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:37 smithi188 ceph-mon[43939]: pgmap v2228: 17 pgs: 17 active+clean; 2.5 GiB data, 11 GiB used, 794 GiB / 805 GiB avail; 0 B/s wr, 966 op/s 2024-04-01T20:03:38.099 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:38.106 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:37 smithi022 ceph-mon[39439]: 9.3 scrub starts 2024-04-01T20:03:38.106 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:37 smithi022 ceph-mon[39439]: 9.3 scrub ok 2024-04-01T20:03:38.106 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:37 smithi022 ceph-mon[39439]: pgmap v2228: 17 pgs: 17 active+clean; 2.5 GiB data, 11 GiB used, 794 GiB / 805 GiB avail; 0 B/s wr, 966 op/s 2024-04-01T20:03:38.120 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:03:38.125 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:38.125 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:03:38.226 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:03:38.255 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:38.282 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:03:38.287 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:38.287 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:03:38.388 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:03:38.415 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:38.435 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:03:38.438 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:38.439 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:03:38.541 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:03:38.603 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:38.631 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:03:38.634 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:38.635 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:03:38.735 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:03:38.770 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:38.789 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T20:03:39.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:38 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/836051502' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:03:39.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:38 smithi062 ceph-mon[44211]: from='client.27646 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:03:39.100 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:03:39.104 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:03:39.106 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:38 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/836051502' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:03:39.106 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:38 smithi022 ceph-mon[39439]: from='client.27646 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:03:39.107 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:39.107 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:03:39.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:38 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/836051502' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:03:39.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:38 smithi188 ceph-mon[43939]: from='client.27646 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:03:39.208 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:03:39.274 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:39.309 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:03:39.316 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:39.317 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:03:39.418 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:03:39.449 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:39.473 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:03:39.476 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:39.477 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:03:39.578 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:03:39.608 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:39.686 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:03:39.689 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:39.690 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:03:39.791 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:03:39.822 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:39 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:03:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:39 smithi022 ceph-mon[39439]: from='client.27646 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T20:03:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:39 smithi022 ceph-mon[39439]: osdmap e826: 12 total, 12 up, 9 in 2024-04-01T20:03:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:39 smithi022 ceph-mon[39439]: pgmap v2230: 17 pgs: 17 active+clean; 2.3 GiB data, 11 GiB used, 794 GiB / 805 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T20:03:40.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:39 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:03:40.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:39 smithi188 ceph-mon[43939]: from='client.27646 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T20:03:40.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:39 smithi188 ceph-mon[43939]: osdmap e826: 12 total, 12 up, 9 in 2024-04-01T20:03:40.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:39 smithi188 ceph-mon[43939]: pgmap v2230: 17 pgs: 17 active+clean; 2.3 GiB data, 11 GiB used, 794 GiB / 805 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T20:03:40.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:39 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:03:40.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:39 smithi062 ceph-mon[44211]: from='client.27646 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T20:03:40.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:39 smithi062 ceph-mon[44211]: osdmap e826: 12 total, 12 up, 9 in 2024-04-01T20:03:40.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:39 smithi062 ceph-mon[44211]: pgmap v2230: 17 pgs: 17 active+clean; 2.3 GiB data, 11 GiB used, 794 GiB / 805 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T20:03:40.274 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:03:40.282 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:40.282 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:03:40.383 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:03:40.417 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:40.441 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:03:40.444 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:40.444 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:03:40.545 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:03:40.577 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:40.598 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:03:40.601 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:40.601 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:03:40.636 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:03:40.702 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:03:40.742 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:41.718 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set nodeep-scrub 2024-04-01T20:03:41.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:41 smithi022 ceph-mon[39439]: pgmap v2231: 17 pgs: 17 active+clean; 2.2 GiB data, 10 GiB used, 794 GiB / 805 GiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T20:03:41.900 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:03:41.905 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:41.905 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:03:42.006 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:03:42.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:41 smithi062 ceph-mon[44211]: pgmap v2231: 17 pgs: 17 active+clean; 2.2 GiB data, 10 GiB used, 794 GiB / 805 GiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T20:03:42.032 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:41 smithi188 ceph-mon[43939]: pgmap v2231: 17 pgs: 17 active+clean; 2.2 GiB data, 10 GiB used, 794 GiB / 805 GiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T20:03:42.033 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:42.060 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:03:42.070 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:42.071 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:03:42.172 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:03:42.199 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:42.231 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:03:42.233 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:42.234 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:03:42.335 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:03:42.398 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:42.421 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:03:42.425 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:42.426 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:03:42.527 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:03:42.555 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:42.575 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:03:42.577 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:42.578 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:03:42.679 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:03:42.742 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:42.776 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:03:42.779 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:42.779 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:03:42.880 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:03:42.912 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:42.938 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:03:42.941 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:42.941 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:03:43.042 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:03:43.075 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:44.573 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:03:44.573 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:03:44.573 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:03:44.573 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T20:03:44.573 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:03:44.573 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:03:44.573 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:03:44.573 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:03:44.573 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:03:44.573 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:03:44.573 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T20:03:44.574 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:03:44.574 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:03:44.574 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:03:44.574 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:03:44.574 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T20:03:44.574 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:03:44.574 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:03:44.574 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:03:44.574 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:03:44.575 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:03:44.575 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:03:44.575 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T20:03:44.575 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:03:44.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:44 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:03:44.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:44 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:03:44.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:44 smithi062 ceph-mon[44211]: pgmap v2232: 17 pgs: 17 active+clean; 2.0 GiB data, 10 GiB used, 795 GiB / 805 GiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T20:03:44.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:44 smithi062 ceph-mon[44211]: osdmap e827: 12 total, 12 up, 9 in 2024-04-01T20:03:44.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:44 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/382263686' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:03:44.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:44 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:44.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:44 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:44.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:44 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:44.763 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:44 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:44.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:44 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:03:44.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:44 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:03:44.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:44 smithi022 ceph-mon[39439]: pgmap v2232: 17 pgs: 17 active+clean; 2.0 GiB data, 10 GiB used, 795 GiB / 805 GiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T20:03:44.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:44 smithi022 ceph-mon[39439]: osdmap e827: 12 total, 12 up, 9 in 2024-04-01T20:03:44.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:44 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/382263686' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:03:44.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:44 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:44.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:44 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:44.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:44 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:44.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:44 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:44.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:44 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:03:44.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:44 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:03:44.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:44 smithi188 ceph-mon[43939]: pgmap v2232: 17 pgs: 17 active+clean; 2.0 GiB data, 10 GiB used, 795 GiB / 805 GiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T20:03:44.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:44 smithi188 ceph-mon[43939]: osdmap e827: 12 total, 12 up, 9 in 2024-04-01T20:03:44.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:44 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/382263686' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:03:44.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:44 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:44.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:44 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:44.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:44 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:44.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:44 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:45.232 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:03:45.236 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:45.236 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:03:45.338 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:03:45.368 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:45.389 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:03:45.395 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:45.396 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:03:45.497 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:03:45.526 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:45.527 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T20:03:45.528 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T20:03:45.548 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:03:45.551 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:45.551 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:03:45.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:45 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:45.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:45 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:45.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:45 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:45.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:45 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:45.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:45 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:45.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:45 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:45.553 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:45 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:45.554 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:45 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:45.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:45 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:45.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:45 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:45.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:45 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:45.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:45 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:45.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:45 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:45.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:45 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:45.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:45 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:45.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:45 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:45.647 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T20:03:45.648 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T20:03:45.648 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 0 2024-04-01T20:03:45.648 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T20:03:45.652 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:03:45.724 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:45.752 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:03:45.758 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:45 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:45.758 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:45 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:45.758 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:45 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:45.758 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:45 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:45.759 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:45 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:45.759 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:45 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:45.759 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:45 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:45.759 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:45 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:45.763 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:45.764 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:03:45.865 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:03:45.901 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:45.923 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:03:45.925 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:45.926 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:03:46.027 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:03:46.064 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:46.120 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:03:46.131 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:46.131 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:03:46.232 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:03:46.268 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:46.291 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:03:46.293 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:46.293 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:03:46.394 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:03:46.425 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:46.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:46 smithi188 ceph-mon[43939]: pgmap v2234: 17 pgs: 17 active+clean; 1.9 GiB data, 9.8 GiB used, 795 GiB / 805 GiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T20:03:46.704 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:46 smithi022 ceph-mon[39439]: pgmap v2234: 17 pgs: 17 active+clean; 1.9 GiB data, 9.8 GiB used, 795 GiB / 805 GiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T20:03:46.734 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_blocked_ops 2024-04-01T20:03:46.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:46 smithi062 ceph-mon[44211]: pgmap v2234: 17 pgs: 17 active+clean; 1.9 GiB data, 9.8 GiB used, 795 GiB / 805 GiB avail; 0 B/s wr, 1.17k op/s 2024-04-01T20:03:47.100 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":2234,"stamp":"2024-04-01T20:03:45.473629+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2037121592,"num_objects":31078,"num_object_clones":0,"num_object_copies":62156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31078,"num_whiteouts":0,"num_read":127,"num_read_kb":110,"num_write":281271,"num_write_kb":9992187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97544,"num_bytes_recovered":6394501816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161100,"ondisk_log_size":161100,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":9,"num_per_pool_osds":9,"num_per_pool_omap_osds":8,"kb":843706368,"kb_used":10251032,"kb_used_data":4402032,"kb_used_omap":967,"kb_used_meta":5847032,"kb_avail":833455336,"statfs":{"total":863955320832,"available":853458264064,"internally_reserved":0,"allocated":4507680768,"data_stored":4504180916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":990537,"internal_metadata":5987361463},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-613416960,"num_objects":-9360,"num_object_clones":0,"num_object_copies":-18720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-9360,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9360,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001500"},"pg_stats":[{"pgid":"9.f","version":"826'20251","reported_seq":36509,"reported_epoch":826,"state":"active+clean","last_fresh":"2024-04-01T20:03:42.937266+0000","last_change":"2024-04-01T20:03:23.875213+0000","last_active":"2024-04-01T20:03:42.937266+0000","last_peered":"2024-04-01T20:03:42.937266+0000","last_clean":"2024-04-01T20:03:42.937266+0000","last_became_active":"2024-04-01T20:02:09.581338+0000","last_became_peered":"2024-04-01T20:02:09.581338+0000","last_unstale":"2024-04-01T20:03:42.937266+0000","last_undegraded":"2024-04-01T20:03:42.937266+0000","last_fullsized":"2024-04-01T20:03:42.937266+0000","mapping_epoch":792,"log_start":"770'10200","ondisk_log_start":"770'10200","created":735,"last_epoch_clean":793,"parent":"0.0","parent_split_bits":0,"last_scrub":"822'18986","last_scrub_stamp":"2024-04-01T20:03:23.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:03:23.875104+0000","objects_scrubbed":3224,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:04:28.234545+0000","scrub_duration":766,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126943232,"num_objects":1937,"num_object_clones":0,"num_object_copies":3874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1937,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17273,"num_write_kb":614720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7900,"num_bytes_recovered":517734400,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.e","version":"827'17567","reported_seq":33748,"reported_epoch":827,"state":"active+clean","last_fresh":"2024-04-01T20:03:44.182472+0000","last_change":"2024-04-01T20:02:49.912057+0000","last_active":"2024-04-01T20:03:44.182472+0000","last_peered":"2024-04-01T20:03:44.182472+0000","last_clean":"2024-04-01T20:03:44.182472+0000","last_became_active":"2024-04-01T20:02:09.584558+0000","last_became_peered":"2024-04-01T20:02:09.584558+0000","last_unstale":"2024-04-01T20:03:44.182472+0000","last_undegraded":"2024-04-01T20:03:44.182472+0000","last_fullsized":"2024-04-01T20:03:44.182472+0000","mapping_epoch":792,"log_start":"756'7500","ondisk_log_start":"756'7500","created":735,"last_epoch_clean":793,"parent":"0.0","parent_split_bits":0,"last_scrub":"808'14447","last_scrub_stamp":"2024-04-01T20:02:49.911940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:02:49.911940+0000","objects_scrubbed":5008,"log_size":10067,"log_dups_size":0,"ondisk_log_size":10067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:04:06.972154+0000","scrub_duration":1016,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122355712,"num_objects":1867,"num_object_clones":0,"num_object_copies":3734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1867,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17567,"num_write_kb":621888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7913,"num_bytes_recovered":518586368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"827'19193","reported_seq":35581,"reported_epoch":827,"state":"active+clean","last_fresh":"2024-04-01T20:03:44.200681+0000","last_change":"2024-04-01T20:02:51.099917+0000","last_active":"2024-04-01T20:03:44.200681+0000","last_peered":"2024-04-01T20:03:44.200681+0000","last_clean":"2024-04-01T20:03:44.200681+0000","last_became_active":"2024-04-01T20:02:09.584645+0000","last_became_peered":"2024-04-01T20:02:09.584645+0000","last_unstale":"2024-04-01T20:03:44.200681+0000","last_undegraded":"2024-04-01T20:03:44.200681+0000","last_fullsized":"2024-04-01T20:03:44.200681+0000","mapping_epoch":792,"log_start":"763'9100","ondisk_log_start":"763'9100","created":735,"last_epoch_clean":793,"parent":"0.0","parent_split_bits":0,"last_scrub":"808'16193","last_scrub_stamp":"2024-04-01T20:02:51.099658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:02:51.099658+0000","objects_scrubbed":4932,"log_size":10093,"log_dups_size":0,"ondisk_log_size":10093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:04:16.107590+0000","scrub_duration":1154,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125042712,"num_objects":1909,"num_object_clones":0,"num_object_copies":3818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1909,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":17607,"num_write_kb":624449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7964,"num_bytes_recovered":521797656,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.c","version":"826'17587","reported_seq":32545,"reported_epoch":826,"state":"active+clean","last_fresh":"2024-04-01T20:03:41.890318+0000","last_change":"2024-04-01T20:02:46.473018+0000","last_active":"2024-04-01T20:03:41.890318+0000","last_peered":"2024-04-01T20:03:41.890318+0000","last_clean":"2024-04-01T20:03:41.890318+0000","last_became_active":"2024-04-01T20:02:30.575805+0000","last_became_peered":"2024-04-01T20:02:30.575805+0000","last_unstale":"2024-04-01T20:03:41.890318+0000","last_undegraded":"2024-04-01T20:03:41.890318+0000","last_fullsized":"2024-04-01T20:03:41.890318+0000","mapping_epoch":800,"log_start":"756'7500","ondisk_log_start":"756'7500","created":735,"last_epoch_clean":801,"parent":"0.0","parent_split_bits":0,"last_scrub":"807'14517","last_scrub_stamp":"2024-04-01T20:02:46.472768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:02:46.472768+0000","objects_scrubbed":5197,"log_size":10087,"log_dups_size":0,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:04:05.104151+0000","scrub_duration":1473,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136118272,"num_objects":2077,"num_object_clones":0,"num_object_copies":4154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2077,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17587,"num_write_kb":629248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7295,"num_bytes_recovered":478085120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"827'17664","reported_seq":18057,"reported_epoch":827,"state":"active+clean","last_fresh":"2024-04-01T20:03:44.784561+0000","last_change":"2024-04-01T20:03:33.426766+0000","last_active":"2024-04-01T20:03:44.784561+0000","last_peered":"2024-04-01T20:03:44.784561+0000","last_clean":"2024-04-01T20:03:44.784561+0000","last_became_active":"2024-04-01T19:59:28.153409+0000","last_became_peered":"2024-04-01T19:59:28.153409+0000","last_unstale":"2024-04-01T20:03:44.784561+0000","last_undegraded":"2024-04-01T20:03:44.784561+0000","last_fullsized":"2024-04-01T20:03:44.784561+0000","mapping_epoch":735,"log_start":"757'7600","ondisk_log_start":"757'7600","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"825'16879","last_scrub_stamp":"2024-04-01T20:03:33.426616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:03:33.426616+0000","objects_scrubbed":2631,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:04:53.597942+0000","scrub_duration":557,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119668736,"num_objects":1826,"num_object_clones":0,"num_object_copies":3652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1826,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17664,"num_write_kb":623680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"9.a","version":"826'20186","reported_seq":20613,"reported_epoch":826,"state":"active+clean","last_fresh":"2024-04-01T20:03:42.935882+0000","last_change":"2024-04-01T20:03:28.861684+0000","last_active":"2024-04-01T20:03:42.935882+0000","last_peered":"2024-04-01T20:03:42.935882+0000","last_clean":"2024-04-01T20:03:42.935882+0000","last_became_active":"2024-04-01T19:59:28.153559+0000","last_became_peered":"2024-04-01T19:59:28.153559+0000","last_unstale":"2024-04-01T20:03:42.935882+0000","last_undegraded":"2024-04-01T20:03:42.935882+0000","last_fullsized":"2024-04-01T20:03:42.935882+0000","mapping_epoch":735,"log_start":"767'10100","ondisk_log_start":"767'10100","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"824'19251","last_scrub_stamp":"2024-04-01T20:03:28.861408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:03:28.861408+0000","objects_scrubbed":2871,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:04:49.044887+0000","scrub_duration":745,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125304832,"num_objects":1912,"num_object_clones":0,"num_object_copies":3824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1912,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17738,"num_write_kb":628800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"826'17623","reported_seq":31371,"reported_epoch":826,"state":"active+clean","last_fresh":"2024-04-01T20:03:42.937340+0000","last_change":"2024-04-01T20:03:29.871291+0000","last_active":"2024-04-01T20:03:42.937340+0000","last_peered":"2024-04-01T20:03:42.937340+0000","last_clean":"2024-04-01T20:03:42.937340+0000","last_became_active":"2024-04-01T20:02:41.604819+0000","last_became_peered":"2024-04-01T20:02:41.604819+0000","last_unstale":"2024-04-01T20:03:42.937340+0000","last_undegraded":"2024-04-01T20:03:42.937340+0000","last_fullsized":"2024-04-01T20:03:42.937340+0000","mapping_epoch":805,"log_start":"756'7600","ondisk_log_start":"756'7600","created":735,"last_epoch_clean":806,"parent":"0.0","parent_split_bits":0,"last_scrub":"824'16723","last_scrub_stamp":"2024-04-01T20:03:29.871150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:03:29.871150+0000","objects_scrubbed":2908,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:04:53.337783+0000","scrub_duration":778,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130220032,"num_objects":1987,"num_object_clones":0,"num_object_copies":3974,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1987,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17623,"num_write_kb":627520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6703,"num_bytes_recovered":439287808,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.7","version":"827'17567","reported_seq":33180,"reported_epoch":827,"state":"active+clean","last_fresh":"2024-04-01T20:03:44.192776+0000","last_change":"2024-04-01T20:02:47.062182+0000","last_active":"2024-04-01T20:03:44.192776+0000","last_peered":"2024-04-01T20:03:44.192776+0000","last_clean":"2024-04-01T20:03:44.192776+0000","last_became_active":"2024-04-01T20:02:13.883921+0000","last_became_peered":"2024-04-01T20:02:13.883921+0000","last_unstale":"2024-04-01T20:03:44.192776+0000","last_undegraded":"2024-04-01T20:03:44.192776+0000","last_fullsized":"2024-04-01T20:03:44.192776+0000","mapping_epoch":795,"log_start":"756'7500","ondisk_log_start":"756'7500","created":735,"last_epoch_clean":796,"parent":"0.0","parent_split_bits":0,"last_scrub":"807'14327","last_scrub_stamp":"2024-04-01T20:02:47.062015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:02:47.062015+0000","objects_scrubbed":5175,"log_size":10067,"log_dups_size":0,"ondisk_log_size":10067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:03:50.497137+0000","scrub_duration":1129,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124321792,"num_objects":1897,"num_object_clones":0,"num_object_copies":3794,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1897,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17567,"num_write_kb":622848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7628,"num_bytes_recovered":499908608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"826'17597","reported_seq":33884,"reported_epoch":826,"state":"active+clean","last_fresh":"2024-04-01T20:03:42.975866+0000","last_change":"2024-04-01T20:02:51.604983+0000","last_active":"2024-04-01T20:03:42.975866+0000","last_peered":"2024-04-01T20:03:42.975866+0000","last_clean":"2024-04-01T20:03:42.975866+0000","last_became_active":"2024-04-01T20:02:10.586686+0000","last_became_peered":"2024-04-01T20:02:10.586686+0000","last_unstale":"2024-04-01T20:03:42.975866+0000","last_undegraded":"2024-04-01T20:03:42.975866+0000","last_fullsized":"2024-04-01T20:03:42.975866+0000","mapping_epoch":793,"log_start":"756'7500","ondisk_log_start":"756'7500","created":735,"last_epoch_clean":794,"parent":"0.0","parent_split_bits":0,"last_scrub":"808'14733","last_scrub_stamp":"2024-04-01T20:02:51.604792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:02:51.604792+0000","objects_scrubbed":4874,"log_size":10097,"log_dups_size":0,"ondisk_log_size":10097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:03:51.915581+0000","scrub_duration":1194,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129957888,"num_objects":1983,"num_object_clones":0,"num_object_copies":3966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1983,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17597,"num_write_kb":626560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7984,"num_bytes_recovered":523239424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"826'19934","reported_seq":33425,"reported_epoch":826,"state":"active+clean","last_fresh":"2024-04-01T20:03:42.937341+0000","last_change":"2024-04-01T20:03:26.123194+0000","last_active":"2024-04-01T20:03:42.937341+0000","last_peered":"2024-04-01T20:03:42.937341+0000","last_clean":"2024-04-01T20:03:42.937341+0000","last_became_active":"2024-04-01T20:02:42.608420+0000","last_became_peered":"2024-04-01T20:02:42.608420+0000","last_unstale":"2024-04-01T20:03:42.937341+0000","last_undegraded":"2024-04-01T20:03:42.937341+0000","last_fullsized":"2024-04-01T20:03:42.937341+0000","mapping_epoch":806,"log_start":"767'9901","ondisk_log_start":"767'9901","created":735,"last_epoch_clean":807,"parent":"0.0","parent_split_bits":0,"last_scrub":"823'18832","last_scrub_stamp":"2024-04-01T20:03:26.122905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:03:26.122905+0000","objects_scrubbed":3091,"log_size":10033,"log_dups_size":0,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:04:54.987461+0000","scrub_duration":1037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128319488,"num_objects":1958,"num_object_clones":0,"num_object_copies":3916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1958,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17374,"num_write_kb":618624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6522,"num_bytes_recovered":427425792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.4","version":"826'17610","reported_seq":34047,"reported_epoch":826,"state":"active+clean","last_fresh":"2024-04-01T20:03:42.128336+0000","last_change":"2024-04-01T20:02:15.175330+0000","last_active":"2024-04-01T20:03:42.128336+0000","last_peered":"2024-04-01T20:03:42.128336+0000","last_clean":"2024-04-01T20:03:42.128336+0000","last_became_active":"2024-04-01T20:02:10.589045+0000","last_became_peered":"2024-04-01T20:02:10.589045+0000","last_unstale":"2024-04-01T20:03:42.128336+0000","last_undegraded":"2024-04-01T20:03:42.128336+0000","last_fullsized":"2024-04-01T20:03:42.128336+0000","mapping_epoch":793,"log_start":"756'7600","ondisk_log_start":"756'7600","created":735,"last_epoch_clean":794,"parent":"0.0","parent_split_bits":0,"last_scrub":"796'12769","last_scrub_stamp":"2024-04-01T20:02:15.175214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:02:15.175214+0000","objects_scrubbed":6938,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:03:45.952320+0000","scrub_duration":1293,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134742016,"num_objects":2056,"num_object_clones":0,"num_object_copies":4112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2056,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17610,"num_write_kb":629312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8034,"num_bytes_recovered":526516224,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"827'17760","reported_seq":33494,"reported_epoch":827,"state":"active+clean","last_fresh":"2024-04-01T20:03:44.799530+0000","last_change":"2024-04-01T20:03:36.340673+0000","last_active":"2024-04-01T20:03:44.799530+0000","last_peered":"2024-04-01T20:03:44.799530+0000","last_clean":"2024-04-01T20:03:44.799530+0000","last_became_active":"2024-04-01T20:02:10.584240+0000","last_became_peered":"2024-04-01T20:02:10.584240+0000","last_unstale":"2024-04-01T20:03:44.799530+0000","last_undegraded":"2024-04-01T20:03:44.799530+0000","last_fullsized":"2024-04-01T20:03:44.799530+0000","mapping_epoch":793,"log_start":"757'7700","ondisk_log_start":"757'7700","created":735,"last_epoch_clean":794,"parent":"0.0","parent_split_bits":0,"last_scrub":"825'17185","last_scrub_stamp":"2024-04-01T20:03:36.340446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:03:36.340446+0000","objects_scrubbed":2370,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:04:41.696316+0000","scrub_duration":434,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116785152,"num_objects":1782,"num_object_clones":0,"num_object_copies":3564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1782,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17760,"num_write_kb":625344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7662,"num_bytes_recovered":502136832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"9.2","version":"827'17681","reported_seq":34479,"reported_epoch":827,"state":"active+clean","last_fresh":"2024-04-01T20:03:44.771082+0000","last_change":"2024-04-01T20:02:15.854326+0000","last_active":"2024-04-01T20:03:44.771082+0000","last_peered":"2024-04-01T20:03:44.771082+0000","last_clean":"2024-04-01T20:03:44.771082+0000","last_became_active":"2024-04-01T20:01:58.613523+0000","last_became_peered":"2024-04-01T20:01:58.613523+0000","last_unstale":"2024-04-01T20:03:44.771082+0000","last_undegraded":"2024-04-01T20:03:44.771082+0000","last_fullsized":"2024-04-01T20:03:44.771082+0000","mapping_epoch":787,"log_start":"756'7600","ondisk_log_start":"756'7600","created":735,"last_epoch_clean":788,"parent":"0.0","parent_split_bits":0,"last_scrub":"796'12678","last_scrub_stamp":"2024-04-01T20:02:15.854222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:02:15.854222+0000","objects_scrubbed":6834,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1045,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118161408,"num_objects":1803,"num_object_clones":0,"num_object_copies":3606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1803,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17681,"num_write_kb":623488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8210,"num_bytes_recovered":538050560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"9.1","version":"826'17357","reported_seq":32004,"reported_epoch":826,"state":"active+clean","last_fresh":"2024-04-01T20:03:41.014894+0000","last_change":"2024-04-01T20:02:48.750783+0000","last_active":"2024-04-01T20:03:41.014894+0000","last_peered":"2024-04-01T20:03:41.014894+0000","last_clean":"2024-04-01T20:03:41.014894+0000","last_became_active":"2024-04-01T20:02:29.571477+0000","last_became_peered":"2024-04-01T20:02:29.571477+0000","last_unstale":"2024-04-01T20:03:41.014894+0000","last_undegraded":"2024-04-01T20:03:41.014894+0000","last_fullsized":"2024-04-01T20:03:41.014894+0000","mapping_epoch":799,"log_start":"756'7300","ondisk_log_start":"756'7300","created":735,"last_epoch_clean":800,"parent":"0.0","parent_split_bits":0,"last_scrub":"808'14613","last_scrub_stamp":"2024-04-01T20:02:48.750518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:02:48.750518+0000","objects_scrubbed":4868,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:04:02.336859+0000","scrub_duration":984,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136249344,"num_objects":2079,"num_object_clones":0,"num_object_copies":4158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2079,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17357,"num_write_kb":621952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7149,"num_bytes_recovered":468516864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"9.0","version":"826'17804","reported_seq":18217,"reported_epoch":826,"state":"active+clean","last_fresh":"2024-04-01T20:03:42.971299+0000","last_change":"2024-04-01T20:03:34.980275+0000","last_active":"2024-04-01T20:03:42.971299+0000","last_peered":"2024-04-01T20:03:42.971299+0000","last_clean":"2024-04-01T20:03:42.971299+0000","last_became_active":"2024-04-01T19:59:28.244137+0000","last_became_peered":"2024-04-01T19:59:28.244137+0000","last_unstale":"2024-04-01T20:03:42.971299+0000","last_undegraded":"2024-04-01T20:03:42.971299+0000","last_fullsized":"2024-04-01T20:03:42.971299+0000","mapping_epoch":735,"log_start":"757'7800","ondisk_log_start":"757'7800","created":735,"last_epoch_clean":736,"parent":"0.0","parent_split_bits":0,"last_scrub":"825'17254","last_scrub_stamp":"2024-04-01T20:03:34.980024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:03:34.980024+0000","objects_scrubbed":2590,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:05:02.355635+0000","scrub_duration":795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131858432,"num_objects":2012,"num_object_clones":0,"num_object_copies":4024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2012,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17804,"num_write_kb":634112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"826'17281","reported_seq":30776,"reported_epoch":826,"state":"active+clean","last_fresh":"2024-04-01T20:03:41.003837+0000","last_change":"2024-04-01T20:02:41.241164+0000","last_active":"2024-04-01T20:03:41.003837+0000","last_peered":"2024-04-01T20:03:41.003837+0000","last_clean":"2024-04-01T20:03:41.003837+0000","last_became_active":"2024-04-01T20:02:40.600605+0000","last_became_peered":"2024-04-01T20:02:40.600605+0000","last_unstale":"2024-04-01T20:03:41.003837+0000","last_undegraded":"2024-04-01T20:03:41.003837+0000","last_fullsized":"2024-04-01T20:03:41.003837+0000","mapping_epoch":804,"log_start":"756'7200","ondisk_log_start":"756'7200","created":735,"last_epoch_clean":805,"parent":"0.0","parent_split_bits":0,"last_scrub":"805'14032","last_scrub_stamp":"2024-04-01T20:02:41.241040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T19:59:27.133854+0000","last_clean_scrub_stamp":"2024-04-01T20:02:41.241040+0000","objects_scrubbed":5241,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:04:06.721416+0000","scrub_duration":506,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130482176,"num_objects":1991,"num_object_clones":0,"num_object_copies":3982,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1991,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17281,"num_write_kb":616704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6570,"num_bytes_recovered":430571520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5],"acting":[9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.0","version":"156'139","reported_seq":2018,"reported_epoch":827,"state":"active+clean","last_fresh":"2024-04-01T20:03:43.480818+0000","last_change":"2024-04-01T20:02:45.191659+0000","last_active":"2024-04-01T20:03:43.480818+0000","last_peered":"2024-04-01T20:03:43.480818+0000","last_clean":"2024-04-01T20:03:43.480818+0000","last_became_active":"2024-04-01T20:01:45.155357+0000","last_became_peered":"2024-04-01T20:01:45.155357+0000","last_unstale":"2024-04-01T20:03:43.480818+0000","last_undegraded":"2024-04-01T20:03:43.480818+0000","last_fullsized":"2024-04-01T20:03:43.480818+0000","mapping_epoch":781,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":782,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T20:02:45.191520+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T20:02:45.191520+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:03:57.475652+0000","scrub_duration":272,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2644640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":2036531224,"num_objects":31076,"num_object_clones":0,"num_object_copies":62152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31076,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":281090,"num_write_kb":9989249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97534,"num_bytes_recovered":6391857176,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6189887488,"data_stored":6189875272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160961,"ondisk_log_size":160961,"up":32,"acting":32,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2644640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":0,"seq":365072220653,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":0,"seq":3272765079588,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678521,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1395852,"kb_used_data":530124,"kb_used_omap":1,"kb_used_meta":865534,"kb_avail":92349300,"statfs":{"total":95995035648,"available":94565683200,"internally_reserved":0,"allocated":542846976,"data_stored":542448376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":886307264},"hb_peers":[1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557718,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":878436,"kb_used_data":475552,"kb_used_omap":132,"kb_used_meta":402619,"kb_avail":92866716,"statfs":{"total":95995035648,"available":95095517184,"internally_reserved":0,"allocated":486965248,"data_stored":486620082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":412282599},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234499,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1222064,"kb_used_data":491052,"kb_used_omap":1,"kb_used_meta":730878,"kb_avail":92523088,"statfs":{"total":95995035648,"available":94743642112,"internally_reserved":0,"allocated":502837248,"data_stored":502484458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":748419530},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":457,"seq":1962800054510,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":769172,"kb_used_data":411924,"kb_used_omap":744,"kb_used_meta":356247,"kb_avail":92975980,"statfs":{"total":95995035648,"available":95207403520,"internally_reserved":0,"allocated":421810176,"data_stored":421408024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":762131,"internal_metadata":364797677},"hb_peers":[1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":571,"seq":2452426326178,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1141720,"kb_used_data":782992,"kb_used_omap":81,"kb_used_meta":358638,"kb_avail":92603432,"statfs":{"total":95995035648,"available":94825914368,"internally_reserved":0,"allocated":801783808,"data_stored":801381136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":83387,"internal_metadata":367245893},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":749900,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":748926,"kb_avail":92995252,"statfs":{"total":95995035648,"available":95227138048,"internally_reserved":0,"allocated":798720,"data_stored":400120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":766900677},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346460,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":766356,"kb_used_data":135436,"kb_used_omap":1,"kb_used_meta":630910,"kb_avail":92978796,"statfs":{"total":95995035648,"available":95210287104,"internally_reserved":0,"allocated":138686464,"data_stored":138287864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":646052293},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":0,"seq":111669150230,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438954000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1030868,"kb_used_data":273612,"kb_used_omap":1,"kb_used_meta":757246,"kb_avail":92714284,"statfs":{"total":95995035648,"available":94939426816,"internally_reserved":0,"allocated":280178688,"data_stored":279780088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":775420357},"hb_peers":[0,1,2,3,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790476,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":2296664,"kb_used_data":1300560,"kb_used_omap":1,"kb_used_meta":996030,"kb_avail":91448488,"statfs":{"total":95995035648,"available":93643251712,"internally_reserved":0,"allocated":1331773440,"data_stored":1331370768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1019935173},"hb_peers":[0,1,2,3,4,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":794365952,"data_stored":794361880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":134610944,"data_stored":134610944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1048444928,"data_stored":1048444928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":272302080,"data_stored":272302080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1303187456,"data_stored":1303183384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":420085760,"data_stored":420085760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":494997504,"data_stored":494993432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":470941696,"data_stored":470941696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":540213248,"data_stored":540213248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":710737920,"data_stored":710737920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T20:03:47.101 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-01T20:03:47.503 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:03:47.508 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:03:47.514 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:47.515 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:03:47.546 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:03:47.616 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:03:47.645 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:47.669 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:03:47.672 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:47.673 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:03:47.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:47 smithi062 ceph-mon[44211]: from='client.17772 v1:172.21.15.22:0/2547536916' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T20:03:47.773 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:03:47.779 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:47 smithi022 ceph-mon[39439]: from='client.17772 v1:172.21.15.22:0/2547536916' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T20:03:47.800 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:47 smithi188 ceph-mon[43939]: from='client.17772 v1:172.21.15.22:0/2547536916' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T20:03:47.802 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:47.827 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:03:47.830 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:47.830 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:03:47.931 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:03:47.962 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:47.988 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:03:47.992 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:47.993 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:03:48.093 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:03:48.145 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:48.185 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:03:48.192 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:48.192 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:03:48.293 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:03:48.353 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:48.389 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:03:48.397 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:48.397 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:03:48.498 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:03:48.529 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:48.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:48 smithi062 ceph-mon[44211]: pgmap v2235: 17 pgs: 17 active+clean; 1.8 GiB data, 9.5 GiB used, 795 GiB / 805 GiB avail; 0 B/s wr, 1.00k op/s 2024-04-01T20:03:48.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:48 smithi022 ceph-mon[39439]: pgmap v2235: 17 pgs: 17 active+clean; 1.8 GiB data, 9.5 GiB used, 795 GiB / 805 GiB avail; 0 B/s wr, 1.00k op/s 2024-04-01T20:03:48.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:48 smithi188 ceph-mon[43939]: pgmap v2235: 17 pgs: 17 active+clean; 1.8 GiB data, 9.5 GiB used, 795 GiB / 805 GiB avail; 0 B/s wr, 1.00k op/s 2024-04-01T20:03:49.492 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T20:03:49.581 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:03:49.587 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:49.587 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:03:49.688 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:03:49.716 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:49.753 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:03:49.756 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:49.756 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:03:49.857 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:03:49.886 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:49.908 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:03:49.912 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:49.912 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:03:50.013 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:03:50.044 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:50.101 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:03:50.106 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:50.107 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:03:50.208 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:03:50.237 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:03:50.400 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:50.400 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:03:50.502 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:03:50.535 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:50.640 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:03:50.643 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:50 smithi022 ceph-mon[39439]: pgmap v2236: 17 pgs: 17 active+clean; 1.6 GiB data, 9.2 GiB used, 795 GiB / 805 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T20:03:50.643 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:50.644 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:03:50.745 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:03:50.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:50 smithi062 ceph-mon[44211]: pgmap v2236: 17 pgs: 17 active+clean; 1.6 GiB data, 9.2 GiB used, 795 GiB / 805 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T20:03:50.769 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:50 smithi188 ceph-mon[43939]: pgmap v2236: 17 pgs: 17 active+clean; 1.6 GiB data, 9.2 GiB used, 795 GiB / 805 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T20:03:50.772 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:50.792 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:03:50.797 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:50.797 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:03:50.898 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:03:50.944 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:50.973 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:03:50.979 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:50.980 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:03:51.009 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T20:03:51.009 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T20:03:51.009 INFO:teuthology.orchestra.run.smithi022.stdout: "complaint_time": 30, 2024-04-01T20:03:51.009 INFO:teuthology.orchestra.run.smithi022.stdout: "num_blocked_ops": 0 2024-04-01T20:03:51.009 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T20:03:51.080 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:03:51.138 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:51.184 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:03:51.190 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:51.191 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:03:51.291 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:03:51.319 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:51.346 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:03:51.349 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:51.349 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:03:51.450 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:03:51.518 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:51.549 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:03:51.557 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:51.557 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:03:51.658 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:03:51.688 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:51.715 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:03:51.718 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:51.718 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:03:51.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:51 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3807819713' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:03:51.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:51 smithi062 ceph-mon[44211]: from='client.27664 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:03:51.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:51 smithi062 ceph-mon[44211]: pgmap v2237: 17 pgs: 17 active+clean; 1.5 GiB data, 9.0 GiB used, 796 GiB / 805 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T20:03:51.819 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:03:51.855 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:51 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3807819713' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:03:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:51 smithi188 ceph-mon[43939]: from='client.27664 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:03:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:51 smithi188 ceph-mon[43939]: pgmap v2237: 17 pgs: 17 active+clean; 1.5 GiB data, 9.0 GiB used, 796 GiB / 805 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T20:03:51.879 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:03:51.882 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:51 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3807819713' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:03:51.882 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:51 smithi022 ceph-mon[39439]: from='client.27664 ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:03:51.882 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:51 smithi022 ceph-mon[39439]: pgmap v2237: 17 pgs: 17 active+clean; 1.5 GiB data, 9.0 GiB used, 796 GiB / 805 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T20:03:51.883 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:51.883 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:03:51.891 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.0 dump_historic_ops 2024-04-01T20:03:51.984 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:03:52.002 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is set 2024-04-01T20:03:52.034 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:52.082 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:03:52.086 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:52.086 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:03:52.187 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:03:52.246 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:52.306 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:03:52.316 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:52.317 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:03:52.417 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:03:52.457 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:52.501 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:03:52.505 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:52.505 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:03:52.606 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:03:52.638 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:52.767 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:03:52.770 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:52.770 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:03:52.846 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:03:52.872 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:03:52.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:52 smithi188 ceph-mon[43939]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:03:52.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:52 smithi188 ceph-mon[43939]: from='client.27664 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T20:03:52.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:52 smithi188 ceph-mon[43939]: osdmap e828: 12 total, 12 up, 9 in 2024-04-01T20:03:52.886 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:03:52.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:52 smithi022 ceph-mon[39439]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:03:52.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:52 smithi022 ceph-mon[39439]: from='client.27664 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T20:03:52.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:52 smithi022 ceph-mon[39439]: osdmap e828: 12 total, 12 up, 9 in 2024-04-01T20:03:52.914 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:53.016 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:52 smithi062 ceph-mon[44211]: Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:03:53.016 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:52 smithi062 ceph-mon[44211]: from='client.27664 ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "nodeep-scrub"}]': finished 2024-04-01T20:03:53.016 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:52 smithi062 ceph-mon[44211]: osdmap e828: 12 total, 12 up, 9 in 2024-04-01T20:03:53.464 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:03:53.467 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:53.468 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:03:53.569 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:03:53.632 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:53.695 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:03:53.700 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:53.701 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:03:53.802 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:03:53.832 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:53.891 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:53 smithi022 ceph-mon[39439]: pgmap v2239: 17 pgs: 17 active+clean; 1.4 GiB data, 8.7 GiB used, 796 GiB / 805 GiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T20:03:54.016 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:53 smithi062 ceph-mon[44211]: pgmap v2239: 17 pgs: 17 active+clean; 1.4 GiB data, 8.7 GiB used, 796 GiB / 805 GiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T20:03:54.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:53 smithi188 ceph-mon[43939]: pgmap v2239: 17 pgs: 17 active+clean; 1.4 GiB data, 8.7 GiB used, 796 GiB / 805 GiB avail; 0 B/s wr, 1.08k op/s 2024-04-01T20:03:54.484 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:03:54.487 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:54.488 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:03:54.589 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:03:54.622 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:54.800 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T20:03:55.377 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:03:55.381 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:55.381 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:03:55.482 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:03:55.516 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:55.645 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:03:55.649 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:55.650 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:03:55.751 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:03:55.810 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:55.860 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:03:55.868 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:55.869 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:03:55.949 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:03:55.970 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:03:55.973 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:03:55.994 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:03:56.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:55 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:03:56.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:55 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:03:56.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:55 smithi062 ceph-mon[44211]: osdmap e829: 12 total, 12 up, 9 in 2024-04-01T20:03:56.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:55 smithi062 ceph-mon[44211]: pgmap v2241: 17 pgs: 17 active+clean; 1.3 GiB data, 8.5 GiB used, 796 GiB / 805 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T20:03:56.017 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T20:03:56.029 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:56.041 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:03:56.075 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:03:56.076 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:03:56.083 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:56.084 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:03:56.102 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:03:56.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:55 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:03:56.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:55 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:03:56.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:55 smithi022 ceph-mon[39439]: osdmap e829: 12 total, 12 up, 9 in 2024-04-01T20:03:56.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:55 smithi022 ceph-mon[39439]: pgmap v2241: 17 pgs: 17 active+clean; 1.3 GiB data, 8.5 GiB used, 796 GiB / 805 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T20:03:56.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:55 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:03:56.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:55 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:03:56.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:55 smithi188 ceph-mon[43939]: osdmap e829: 12 total, 12 up, 9 in 2024-04-01T20:03:56.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:55 smithi188 ceph-mon[43939]: pgmap v2241: 17 pgs: 17 active+clean; 1.3 GiB data, 8.5 GiB used, 796 GiB / 805 GiB avail; 0 B/s wr, 1.15k op/s 2024-04-01T20:03:56.130 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:03:56.154 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:03:56.178 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:03:56.185 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:03:56.207 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T20:03:56.212 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:56.228 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:03:56.230 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:03:56.230 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:03:56.231 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:03:56.231 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T20:03:56.231 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:03:56.231 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:03:56.231 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:03:56.231 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:03:56.231 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:03:56.231 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:03:56.231 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T20:03:56.231 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:03:56.238 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:03:56.244 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:56.244 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:03:56.345 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:03:56.385 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:57.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:56 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1566587438' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:03:57.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:56 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:57.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:56 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:57.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:56 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:57.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:56 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:57.091 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:56 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1566587438' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:03:57.091 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:56 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:57.092 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:56 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:57.092 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:56 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:57.092 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:56 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:57.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:56 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1566587438' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:03:57.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:56 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:57.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:56 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:57.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:56 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:57.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:56 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:57.346 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:03:57.350 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:57.350 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:03:57.451 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:03:57.482 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:57.666 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T20:03:57.666 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:03:58.015 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:58.016 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:58.016 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:58.016 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:58.016 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:58.016 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:58.016 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:58.016 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:57 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:58.016 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:57 smithi062 ceph-mon[44211]: pgmap v2242: 17 pgs: 17 active+clean; 1.2 GiB data, 8.2 GiB used, 796 GiB / 805 GiB avail; 0 B/s wr, 947 op/s 2024-04-01T20:03:58.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:58.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:58.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:58.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:58.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:58.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:58.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:58.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:57 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:58.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:57 smithi022 ceph-mon[39439]: pgmap v2242: 17 pgs: 17 active+clean; 1.2 GiB data, 8.2 GiB used, 796 GiB / 805 GiB avail; 0 B/s wr, 947 op/s 2024-04-01T20:03:58.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:58.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:58.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:58.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:58.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:58.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:58.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:58.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:57 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:03:58.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:57 smithi188 ceph-mon[43939]: pgmap v2242: 17 pgs: 17 active+clean; 1.2 GiB data, 8.2 GiB used, 796 GiB / 805 GiB avail; 0 B/s wr, 947 op/s 2024-04-01T20:03:58.742 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_ops_in_flight 2024-04-01T20:03:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:03:59.235 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:03:59.239 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:59.239 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:03:59.251 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:03:59.340 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:03:59.368 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:59.389 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:03:59.395 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:59.396 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:03:59.497 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:03:59.541 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:59.589 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:03:59.593 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:59.593 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:03:59.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:03:59 smithi188 ceph-mon[43939]: pgmap v2243: 17 pgs: 17 active+clean; 1007 MiB data, 7.9 GiB used, 797 GiB / 805 GiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T20:03:59.693 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:03:59.720 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:59.748 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:03:59.756 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:59.757 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:03:59.838 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:03:59 smithi022 ceph-mon[39439]: pgmap v2243: 17 pgs: 17 active+clean; 1007 MiB data, 7.9 GiB used, 797 GiB / 805 GiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T20:03:59.857 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:03:59.887 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:03:59.909 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:03:59.912 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:03:59.912 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:04:00.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:03:59 smithi062 ceph-mon[44211]: pgmap v2243: 17 pgs: 17 active+clean; 1007 MiB data, 7.9 GiB used, 797 GiB / 805 GiB avail; 0 B/s wr, 1.13k op/s 2024-04-01T20:04:00.013 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:04:00.045 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:00.171 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:04:00.174 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:00.174 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:04:00.275 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:04:00.306 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:00.330 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:04:00.333 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:00.334 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:04:00.435 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:04:00.464 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:00.524 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:04:00.526 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:00.527 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:04:00.627 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:04:00.654 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:00.673 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:04:00.675 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:00.676 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:04:00.777 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:04:00.843 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:00.876 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:04:00.882 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:00.883 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:04:00.983 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:04:01.039 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:01.071 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:04:01.078 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:01.078 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:04:01.179 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:04:01.199 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-01T20:04:01.209 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:01.236 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:04:01.239 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:01.240 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:04:01.341 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:04:01.368 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:01.388 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:04:01.391 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:01.392 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:04:01.493 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:04:01.539 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:01.578 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:04:01.584 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:01.584 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:04:01.685 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:04:01.714 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:01.736 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:04:01.740 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:01.741 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:04:01.842 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:04:01.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:01 smithi188 ceph-mon[43939]: pgmap v2244: 17 pgs: 17 active+clean; 902 MiB data, 7.7 GiB used, 797 GiB / 805 GiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T20:04:01.906 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:01 smithi062 ceph-mon[44211]: pgmap v2244: 17 pgs: 17 active+clean; 902 MiB data, 7.7 GiB used, 797 GiB / 805 GiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T20:04:01.909 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:01.946 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:04:01.953 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:01.954 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:04:02.055 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:04:02.107 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:02.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:01 smithi022 ceph-mon[39439]: pgmap v2244: 17 pgs: 17 active+clean; 902 MiB data, 7.7 GiB used, 797 GiB / 805 GiB avail; 0 B/s wr, 1.09k op/s 2024-04-01T20:04:02.144 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:04:02.149 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:02.150 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:04:02.251 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:04:02.293 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:02.321 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:04:02.323 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:02.324 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:04:02.361 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T20:04:02.361 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:04:02.425 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:04:02.457 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:02.481 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:04:02.486 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:02.487 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:04:02.588 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:04:02.621 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:02.698 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:04:02.704 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:02.704 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:04:02.805 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:04:02.837 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:02.990 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:04:02.995 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:02.995 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:04:03.096 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:04:03.162 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:03.203 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:04:03.207 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:03.207 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:04:03.308 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:04:03.340 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:03.491 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:04:03.494 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:03.494 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:04:03.507 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_blocked_ops 2024-04-01T20:04:03.596 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:04:03.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:03 smithi022 ceph-mon[39439]: pgmap v2245: 17 pgs: 17 active+clean; 733 MiB data, 7.4 GiB used, 797 GiB / 805 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T20:04:03.623 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:03.646 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:04:03.649 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:03.649 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:04:03.750 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:04:03.777 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:03.801 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:04:03.803 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:03.803 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:04:03.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:03 smithi188 ceph-mon[43939]: pgmap v2245: 17 pgs: 17 active+clean; 733 MiB data, 7.4 GiB used, 797 GiB / 805 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T20:04:03.904 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:04:03.933 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:03.959 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:04:03.961 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:03.962 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:04:04.016 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:03 smithi062 ceph-mon[44211]: pgmap v2245: 17 pgs: 17 active+clean; 733 MiB data, 7.4 GiB used, 797 GiB / 805 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T20:04:04.058 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:04:04.062 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:04:04.105 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:04:04.119 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:04.156 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:04:04.165 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:04.165 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:04:04.266 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:04:04.299 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:04.454 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:04:04.458 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:04.458 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:04:04.559 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:04:04.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:04 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1830644044' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:04:04.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:04 smithi022 ceph-mon[39439]: from='client.27673 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:04:04.587 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T20:04:04.596 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:04.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:04 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1830644044' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:04:04.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:04 smithi188 ceph-mon[43939]: from='client.27673 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:04:04.952 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:04:04.955 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:04.955 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:04:05.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:04 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1830644044' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:04:05.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:04 smithi062 ceph-mon[44211]: from='client.27673 ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:04:05.056 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:04:05.090 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:05.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:05 smithi022 ceph-mon[39439]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:04:05.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:05 smithi022 ceph-mon[39439]: from='client.27673 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T20:04:05.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:05 smithi022 ceph-mon[39439]: osdmap e830: 12 total, 12 up, 9 in 2024-04-01T20:04:05.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:05 smithi022 ceph-mon[39439]: 9.1 scrub starts 2024-04-01T20:04:05.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:05 smithi022 ceph-mon[39439]: 9.1 scrub ok 2024-04-01T20:04:05.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:05 smithi022 ceph-mon[39439]: pgmap v2247: 17 pgs: 17 active+clean; 612 MiB data, 7.2 GiB used, 797 GiB / 805 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T20:04:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:05 smithi188 ceph-mon[43939]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:04:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:05 smithi188 ceph-mon[43939]: from='client.27673 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T20:04:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:05 smithi188 ceph-mon[43939]: osdmap e830: 12 total, 12 up, 9 in 2024-04-01T20:04:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:05 smithi188 ceph-mon[43939]: 9.1 scrub starts 2024-04-01T20:04:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:05 smithi188 ceph-mon[43939]: 9.1 scrub ok 2024-04-01T20:04:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:05 smithi188 ceph-mon[43939]: pgmap v2247: 17 pgs: 17 active+clean; 612 MiB data, 7.2 GiB used, 797 GiB / 805 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T20:04:06.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:05 smithi062 ceph-mon[44211]: Health check update: nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:04:06.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:05 smithi062 ceph-mon[44211]: from='client.27673 ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T20:04:06.015 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:05 smithi062 ceph-mon[44211]: osdmap e830: 12 total, 12 up, 9 in 2024-04-01T20:04:06.015 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:05 smithi062 ceph-mon[44211]: 9.1 scrub starts 2024-04-01T20:04:06.015 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:05 smithi062 ceph-mon[44211]: 9.1 scrub ok 2024-04-01T20:04:06.015 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:05 smithi062 ceph-mon[44211]: pgmap v2247: 17 pgs: 17 active+clean; 612 MiB data, 7.2 GiB used, 797 GiB / 805 GiB avail; 0 B/s wr, 1.07k op/s 2024-04-01T20:04:06.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:06 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:04:06.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:06 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:04:06.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:06 smithi022 ceph-mon[39439]: osdmap e831: 12 total, 12 up, 9 in 2024-04-01T20:04:06.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:06 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:04:06.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:06 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:04:06.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:06 smithi022 ceph-mon[39439]: 9.2 scrub starts 2024-04-01T20:04:06.743 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:04:06.747 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:06.748 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:04:06.849 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3 2024-04-01T20:04:06.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:06 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:04:06.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:06 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:04:06.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:06 smithi188 ceph-mon[43939]: osdmap e831: 12 total, 12 up, 9 in 2024-04-01T20:04:06.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:06 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:04:06.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:06 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:04:06.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:06 smithi188 ceph-mon[43939]: 9.2 scrub starts 2024-04-01T20:04:06.880 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:07.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:06 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:04:07.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:06 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:04:07.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:06 smithi062 ceph-mon[44211]: osdmap e831: 12 total, 12 up, 9 in 2024-04-01T20:04:07.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:06 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:04:07.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:06 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:04:07.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:06 smithi062 ceph-mon[44211]: 9.2 scrub starts 2024-04-01T20:04:07.102 INFO:tasks.thrashosds.thrasher:Recovered, killing an osd 2024-04-01T20:04:07.102 INFO:tasks.thrashosds.thrasher:Killing osd 3, live_osds are [0, 2, 3, 4, 5, 7, 9, 11, 8, 6, 1, 10] 2024-04-01T20:04:07.102 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-01T20:04:07.102 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.3 2024-04-01T20:04:07.406 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:04:07 smithi022 systemd[1]: Stopping Ceph osd.3 for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T20:04:07.790 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:07 smithi022 ceph-mon[39439]: 9.2 scrub ok 2024-04-01T20:04:07.790 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:07 smithi022 ceph-mon[39439]: 9.c scrub starts 2024-04-01T20:04:07.790 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:07 smithi022 ceph-mon[39439]: 9.c scrub ok 2024-04-01T20:04:07.790 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:07 smithi022 ceph-mon[39439]: osdmap e832: 12 total, 12 up, 9 in 2024-04-01T20:04:07.790 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:07 smithi022 ceph-mon[39439]: 9.8 scrub starts 2024-04-01T20:04:07.790 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:07 smithi022 ceph-mon[39439]: 9.8 scrub ok 2024-04-01T20:04:07.790 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:07 smithi022 ceph-mon[39439]: pgmap v2250: 17 pgs: 17 active+clean; 531 MiB data, 6.9 GiB used, 798 GiB / 805 GiB avail; 0 B/s wr, 987 op/s 2024-04-01T20:04:07.833 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3" found: no such container 2024-04-01T20:04:07.837 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:07.837 INFO:tasks.cephadm.osd.3:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.3' 2024-04-01T20:04:07.938 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:04:07.957 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T20:04:07.970 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:08.018 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:07 smithi062 ceph-mon[44211]: 9.2 scrub ok 2024-04-01T20:04:08.018 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:07 smithi062 ceph-mon[44211]: 9.c scrub starts 2024-04-01T20:04:08.018 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:07 smithi062 ceph-mon[44211]: 9.c scrub ok 2024-04-01T20:04:08.018 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:07 smithi062 ceph-mon[44211]: osdmap e832: 12 total, 12 up, 9 in 2024-04-01T20:04:08.018 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:07 smithi062 ceph-mon[44211]: 9.8 scrub starts 2024-04-01T20:04:08.018 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:07 smithi062 ceph-mon[44211]: 9.8 scrub ok 2024-04-01T20:04:08.018 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:07 smithi062 ceph-mon[44211]: pgmap v2250: 17 pgs: 17 active+clean; 531 MiB data, 6.9 GiB used, 798 GiB / 805 GiB avail; 0 B/s wr, 987 op/s 2024-04-01T20:04:08.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:07 smithi188 ceph-mon[43939]: 9.2 scrub ok 2024-04-01T20:04:08.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:07 smithi188 ceph-mon[43939]: 9.c scrub starts 2024-04-01T20:04:08.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:07 smithi188 ceph-mon[43939]: 9.c scrub ok 2024-04-01T20:04:08.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:07 smithi188 ceph-mon[43939]: osdmap e832: 12 total, 12 up, 9 in 2024-04-01T20:04:08.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:07 smithi188 ceph-mon[43939]: 9.8 scrub starts 2024-04-01T20:04:08.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:07 smithi188 ceph-mon[43939]: 9.8 scrub ok 2024-04-01T20:04:08.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:07 smithi188 ceph-mon[43939]: pgmap v2250: 17 pgs: 17 active+clean; 531 MiB data, 6.9 GiB used, 798 GiB / 805 GiB avail; 0 B/s wr, 987 op/s 2024-04-01T20:04:08.203 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:04:08.207 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:08.208 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:04:08.309 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:04:08.372 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:08.434 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:04:08.443 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:08.444 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:04:08.545 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:04:08.573 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:08.594 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:04:08.597 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:08.597 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:04:08.645 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:08 smithi062 ceph-mon[44211]: 9.6 scrub starts 2024-04-01T20:04:08.645 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:08 smithi062 ceph-mon[44211]: 9.6 scrub ok 2024-04-01T20:04:08.698 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:04:08.727 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:08.752 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:04:08.755 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:08.756 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:04:08.857 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10 2024-04-01T20:04:08.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:08 smithi022 ceph-mon[39439]: 9.6 scrub starts 2024-04-01T20:04:08.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:08 smithi022 ceph-mon[39439]: 9.6 scrub ok 2024-04-01T20:04:08.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:08 smithi188 ceph-mon[43939]: 9.6 scrub starts 2024-04-01T20:04:08.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:08 smithi188 ceph-mon[43939]: 9.6 scrub ok 2024-04-01T20:04:08.888 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:08.908 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10" found: no such container 2024-04-01T20:04:08.912 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:08.912 INFO:tasks.cephadm.osd.10:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.10' 2024-04-01T20:04:09.013 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:04:09.045 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:09.066 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:04:09.069 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:09.069 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:04:09.170 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:04:09.202 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:09.245 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:04:09.271 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:04:09.294 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:04:09.320 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3: {} 2024-04-01T20:04:09.344 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:04:09.377 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:04:09.401 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:04:09.431 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:04:09.458 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:04:09.484 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:04:09.506 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T20:04:09.531 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:04:09.532 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:04:09.532 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:04:09.533 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:04:09.533 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-01T20:04:09.533 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:04:09.533 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:04:09.533 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:04:09.533 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:04:09.533 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:04:09.533 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:04:09.533 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T20:04:09.533 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:04:09.628 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T20:04:09.628 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T20:04:09.628 INFO:teuthology.orchestra.run.smithi022.stdout: "complaint_time": 30, 2024-04-01T20:04:09.628 INFO:teuthology.orchestra.run.smithi022.stdout: "num_blocked_ops": 0 2024-04-01T20:04:09.629 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T20:04:09.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:09 smithi022 ceph-mon[39439]: 9.4 scrub starts 2024-04-01T20:04:09.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:09 smithi022 ceph-mon[39439]: 9.4 scrub ok 2024-04-01T20:04:09.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:09 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2458931208' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:04:09.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:09 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:09.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:09 smithi022 ceph-mon[39439]: pgmap v2251: 17 pgs: 17 active+clean; 340 MiB data, 6.6 GiB used, 798 GiB / 805 GiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T20:04:10.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:09 smithi062 ceph-mon[44211]: 9.4 scrub starts 2024-04-01T20:04:10.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:09 smithi062 ceph-mon[44211]: 9.4 scrub ok 2024-04-01T20:04:10.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:09 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2458931208' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:04:10.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:09 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:10.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:09 smithi062 ceph-mon[44211]: pgmap v2251: 17 pgs: 17 active+clean; 340 MiB data, 6.6 GiB used, 798 GiB / 805 GiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T20:04:10.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:09 smithi188 ceph-mon[43939]: 9.4 scrub starts 2024-04-01T20:04:10.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:09 smithi188 ceph-mon[43939]: 9.4 scrub ok 2024-04-01T20:04:10.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:09 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2458931208' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:04:10.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:09 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:10.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:09 smithi188 ceph-mon[43939]: pgmap v2251: 17 pgs: 17 active+clean; 340 MiB data, 6.6 GiB used, 798 GiB / 805 GiB avail; 0 B/s wr, 1.05k op/s 2024-04-01T20:04:10.228 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:04:09 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-3[80363]: 2024-04-01T20:04:09.935+0000 7f79cb601700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T20:04:10.228 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:04:09 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-3[80363]: 2024-04-01T20:04:09.935+0000 7f79cb601700 -1 osd.3 832 *** Got signal Terminated *** 2024-04-01T20:04:10.228 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:04:09 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-3[80363]: 2024-04-01T20:04:09.935+0000 7f79cb601700 -1 osd.3 832 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T20:04:10.719 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.2 dump_historic_ops 2024-04-01T20:04:10.945 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:04:10.968 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:04:10.973 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:10.974 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:04:10.978 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:10.978 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:10.978 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:10.979 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:10.979 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:10.979 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:10.979 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:10.979 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:10.979 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:10.979 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:10.979 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:10 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:10.979 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:10 smithi022 ceph-mon[39439]: osd.3 marked itself down and dead 2024-04-01T20:04:11.017 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:11.017 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:11.017 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:11.018 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:11.018 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:11.018 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:11.018 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:11.018 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:11.019 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:11.019 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:11.019 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:10 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:11.019 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:10 smithi062 ceph-mon[44211]: osd.3 marked itself down and dead 2024-04-01T20:04:11.075 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:04:11.110 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:11.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:11.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:11.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:11.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:11.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:11.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:11.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:11.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:11.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:11.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:11.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:10 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:11.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:10 smithi188 ceph-mon[43939]: osd.3 marked itself down and dead 2024-04-01T20:04:11.262 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:04:11.269 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:11.270 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:04:11.371 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:04:11.404 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:12.017 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:11 smithi062 ceph-mon[44211]: osdmap e833: 12 total, 11 up, 9 in 2024-04-01T20:04:12.018 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:11 smithi062 ceph-mon[44211]: pgmap v2253: 17 pgs: 17 active+clean; 242 MiB data, 6.4 GiB used, 798 GiB / 805 GiB avail; 0 B/s wr, 984 op/s 2024-04-01T20:04:12.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:11 smithi022 ceph-mon[39439]: osdmap e833: 12 total, 11 up, 9 in 2024-04-01T20:04:12.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:11 smithi022 ceph-mon[39439]: pgmap v2253: 17 pgs: 17 active+clean; 242 MiB data, 6.4 GiB used, 798 GiB / 805 GiB avail; 0 B/s wr, 984 op/s 2024-04-01T20:04:12.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:11 smithi188 ceph-mon[43939]: osdmap e833: 12 total, 11 up, 9 in 2024-04-01T20:04:12.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:11 smithi188 ceph-mon[43939]: pgmap v2253: 17 pgs: 17 active+clean; 242 MiB data, 6.4 GiB used, 798 GiB / 805 GiB avail; 0 B/s wr, 984 op/s 2024-04-01T20:04:12.392 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:04:12.396 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:12.397 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:04:12.437 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Removed 156082 objects 2024-04-01T20:04:12.437 INFO:tasks.radosbench.radosbench.2.smithi188.stdout:Clean up completed and total clean up time :181.93 2024-04-01T20:04:12.498 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:04:12.524 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:04:12 smithi022 bash[325317]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-3 2024-04-01T20:04:12.527 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:12.625 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:04:12.638 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:12.639 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:04:12.740 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:04:12.766 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:12.786 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:04:12.789 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:12.790 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:04:12.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:12 smithi022 ceph-mon[39439]: 9.7 scrub starts 2024-04-01T20:04:12.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:12 smithi022 ceph-mon[39439]: 9.7 scrub ok 2024-04-01T20:04:12.890 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:04:12.917 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:12 smithi062 ceph-mon[44211]: 9.7 scrub starts 2024-04-01T20:04:12.917 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:12 smithi062 ceph-mon[44211]: 9.7 scrub ok 2024-04-01T20:04:12.919 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:12.940 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:04:12.942 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:12.943 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:04:13.043 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:04:13.077 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:13.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:12 smithi188 ceph-mon[43939]: 9.7 scrub starts 2024-04-01T20:04:13.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:12 smithi188 ceph-mon[43939]: 9.7 scrub ok 2024-04-01T20:04:13.530 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:04:13.533 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:13.533 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:04:13.547 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:04:13.635 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:04:13.668 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:13.769 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:04:13.771 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:13 smithi022 ceph-mon[39439]: pgmap v2254: 17 pgs: 17 active+clean; 90 MiB data, 6.1 GiB used, 799 GiB / 805 GiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T20:04:13.772 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:13.772 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:04:13.873 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:04:13.903 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:14.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:13 smithi062 ceph-mon[44211]: pgmap v2254: 17 pgs: 17 active+clean; 90 MiB data, 6.1 GiB used, 799 GiB / 805 GiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T20:04:14.029 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:04:14.032 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:14.033 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:04:14.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:13 smithi188 ceph-mon[43939]: pgmap v2254: 17 pgs: 17 active+clean; 90 MiB data, 6.1 GiB used, 799 GiB / 805 GiB avail; 0 B/s wr, 1.06k op/s 2024-04-01T20:04:14.133 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:04:14.166 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:14.189 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:04:14.191 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:14.192 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:04:14.293 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:04:14.322 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:14.397 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:04:14.400 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:14.400 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:04:14.501 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:04:14.535 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:14.557 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:04:14.560 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:14.560 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:04:14.661 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:04:14.674 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T20:04:14.693 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:14.715 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:04:14.719 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:14.719 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:04:14.820 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:04:14.849 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:14.915 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_7 2024-04-01T20:04:14.915 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd pool rm unique_pool_7 unique_pool_7 --yes-i-really-really-mean-it 2024-04-01T20:04:14.942 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:14 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/190699279' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:04:15.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:14 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/190699279' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:04:15.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:14 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/190699279' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:04:15.227 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:04:15.230 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:15.231 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:04:15.331 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:04:15.363 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:15.385 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:04:15.388 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:15.388 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:04:15.489 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:04:15.521 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:15.541 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-01T20:04:15.619 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:04:15.624 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:15.624 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:04:15.725 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8 2024-04-01T20:04:15.757 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:15.778 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8" found: no such container 2024-04-01T20:04:15.781 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:15.782 INFO:tasks.cephadm.osd.8:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.8' 2024-04-01T20:04:15.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:15 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T20:04:15.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:15 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T20:04:15.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:15 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/190699279' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T20:04:15.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:15 smithi022 ceph-mon[39439]: osdmap e834: 12 total, 11 up, 9 in 2024-04-01T20:04:15.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:15 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T20:04:15.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:15 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T20:04:15.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:15 smithi022 ceph-mon[39439]: pgmap v2256: 17 pgs: 17 active+clean; 14 MiB data, 6.0 GiB used, 799 GiB / 805 GiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T20:04:15.882 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:04:15.915 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:15.935 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T20:04:15.935 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 20, 2024-04-01T20:04:15.935 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 600, 2024-04-01T20:04:15.935 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [ 2024-04-01T20:04:15.935 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.935 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.26983.0:193021 8.7 e699/687 8:ee0f5235:::benchmark_data_smithi188_161190_object53739:head v 699'12004, mlcod=650'3341)", 2024-04-01T20:04:15.935 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:57:16.908543+0000", 2024-04-01T20:04:15.935 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 419.02595680100001, 2024-04-01T20:04:15.935 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.094493299000000003, 2024-04-01T20:04:15.935 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:04:15.935 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:04:15.935 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:04:15.936 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:04:15.936 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.936 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:04:15.936 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.908543+0000", 2024-04-01T20:04:15.936 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.936 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.936 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.936 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:04:15.936 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.908543+0000", 2024-04-01T20:04:15.936 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.936 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.936 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.936 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:04:15.936 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.908545+0000", 2024-04-01T20:04:15.937 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.83e-06 2024-04-01T20:04:15.937 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.937 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.937 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:04:15.937 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.908558+0000", 2024-04-01T20:04:15.937 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2894000000000001e-05 2024-04-01T20:04:15.937 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.937 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.937 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:04:15.937 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.908571+0000", 2024-04-01T20:04:15.937 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3009e-05 2024-04-01T20:04:15.937 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.937 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.937 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:04:15.938 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.908579+0000", 2024-04-01T20:04:15.938 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.2180000000000002e-06 2024-04-01T20:04:15.938 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.938 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.938 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:04:15.938 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.908644+0000", 2024-04-01T20:04:15.938 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5699999999999998e-05 2024-04-01T20:04:15.938 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.938 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.938 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:04:15.938 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.908672+0000", 2024-04-01T20:04:15.938 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.7549999999999999e-05 2024-04-01T20:04:15.939 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.939 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.939 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:04:15.939 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:17.002976+0000", 2024-04-01T20:04:15.939 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.094303989000000005 2024-04-01T20:04:15.939 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.939 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.939 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:04:15.939 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:17.003036+0000", 2024-04-01T20:04:15.939 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0109000000000003e-05 2024-04-01T20:04:15.939 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.939 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:04:15.939 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.939 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.940 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.940 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "MOSDPGPush(8.7 699/687 [PushOp(8:e5203172:::benchmark_data_smithi188_161190_object53766:head, version: 650'3344, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(8:e5203172:::benchmark_data_smithi188_161190_object53766:head@650'3344, size: 65536, copy_subset: [(0, 65536)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 65536, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-04-01T20:04:15.940 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:57:16.917487+0000", 2024-04-01T20:04:15.940 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 419.017012583, 2024-04-01T20:04:15.940 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.085559417999999998, 2024-04-01T20:04:15.940 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:04:15.940 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:04:15.940 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "started", 2024-04-01T20:04:15.940 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:04:15.940 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.940 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:04:15.940 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.917487+0000", 2024-04-01T20:04:15.940 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.941 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.941 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.941 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:04:15.941 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.917487+0000", 2024-04-01T20:04:15.941 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.941 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.941 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.941 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:04:15.941 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.917488+0000", 2024-04-01T20:04:15.941 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1620000000000001e-06 2024-04-01T20:04:15.941 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.941 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.941 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:04:15.942 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.917563+0000", 2024-04-01T20:04:15.942 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5240999999999993e-05 2024-04-01T20:04:15.942 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.942 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.942 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:04:15.942 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.917579+0000", 2024-04-01T20:04:15.942 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5517999999999999e-05 2024-04-01T20:04:15.942 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.942 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.942 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:04:15.942 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.917593+0000", 2024-04-01T20:04:15.942 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.4450999999999999e-05 2024-04-01T20:04:15.942 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.942 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.942 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:04:15.943 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.922683+0000", 2024-04-01T20:04:15.943 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0050897410000000001 2024-04-01T20:04:15.943 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.943 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.943 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:04:15.943 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.922696+0000", 2024-04-01T20:04:15.943 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2782000000000001e-05 2024-04-01T20:04:15.943 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.943 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.943 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:04:15.943 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:17.003046+0000", 2024-04-01T20:04:15.943 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.080350522999999993 2024-04-01T20:04:15.943 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.943 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:04:15.943 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.943 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.944 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.944 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.26983.0:193052 8.f e699/629 8:f81309d7:::benchmark_data_smithi188_161190_object53770:head v 699'12218, mlcod=699'12216)", 2024-04-01T20:04:15.944 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T19:57:16.917794+0000", 2024-04-01T20:04:15.944 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 419.01670525999998, 2024-04-01T20:04:15.944 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.092198751999999995, 2024-04-01T20:04:15.944 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:04:15.944 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:04:15.944 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:04:15.944 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:04:15.944 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.944 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:04:15.944 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.917794+0000", 2024-04-01T20:04:15.944 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.944 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.945 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.945 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:04:15.945 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.917794+0000", 2024-04-01T20:04:15.945 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.945 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.945 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.945 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:04:15.945 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.917795+0000", 2024-04-01T20:04:15.945 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.9099999999999991e-07 2024-04-01T20:04:15.945 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.945 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.945 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:04:15.945 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.917805+0000", 2024-04-01T20:04:15.945 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.9559999999999992e-06 2024-04-01T20:04:15.945 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.946 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.946 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:04:15.946 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.917812+0000", 2024-04-01T20:04:15.946 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0890000000000002e-06 2024-04-01T20:04:15.946 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.946 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.946 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:04:15.946 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.917818+0000", 2024-04-01T20:04:15.946 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3109999999999996e-06 2024-04-01T20:04:15.946 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.946 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.946 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:04:15.946 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.922632+0000", 2024-04-01T20:04:15.947 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0048140149999999996 2024-04-01T20:04:15.947 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.947 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.947 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:04:15.947 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:16.922654+0000", 2024-04-01T20:04:15.947 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2240000000000001e-05 2024-04-01T20:04:15.947 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.947 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.947 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:04:15.947 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:17.009959+0000", 2024-04-01T20:04:15.947 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.087305383 2024-04-01T20:04:15.947 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.947 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.947 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:04:15.948 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T19:57:17.009993+0000", 2024-04-01T20:04:15.948 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.3766999999999997e-05 2024-04-01T20:04:15.948 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.948 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:04:15.948 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.948 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.948 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.948 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.27358.0:178726 9.7 e778/777 9:efc92121:::benchmark_data_smithi188_173515_object22641:head v 778'11132, mlcod=778'11130)", 2024-04-01T20:04:15.948 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T20:01:37.701470+0000", 2024-04-01T20:04:15.948 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 158.233029321, 2024-04-01T20:04:15.948 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.013160471, 2024-04-01T20:04:15.948 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:04:15.948 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:04:15.948 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:04:15.949 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:04:15.949 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.949 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:04:15.949 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:37.701470+0000", 2024-04-01T20:04:15.949 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.949 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.949 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.949 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:04:15.949 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:37.701470+0000", 2024-04-01T20:04:15.949 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.949 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.949 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.949 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:04:15.949 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:37.701471+0000", 2024-04-01T20:04:15.950 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2100000000000001e-06 2024-04-01T20:04:15.950 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.950 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.950 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:04:15.950 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:37.701478+0000", 2024-04-01T20:04:15.950 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.9689999999999997e-06 2024-04-01T20:04:15.950 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.950 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.950 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:04:15.950 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:37.701490+0000", 2024-04-01T20:04:15.950 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1252e-05 2024-04-01T20:04:15.950 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.950 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.951 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:04:15.951 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:37.701497+0000", 2024-04-01T20:04:15.951 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.5939999999999996e-06 2024-04-01T20:04:15.951 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.951 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.951 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:04:15.951 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:37.701561+0000", 2024-04-01T20:04:15.951 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.4224e-05 2024-04-01T20:04:15.951 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.951 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.951 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:04:15.951 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:37.701582+0000", 2024-04-01T20:04:15.951 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0885000000000001e-05 2024-04-01T20:04:15.951 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.951 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.952 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:04:15.952 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:37.714601+0000", 2024-04-01T20:04:15.952 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.013018605000000001 2024-04-01T20:04:15.952 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.952 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.952 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:04:15.952 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:37.714631+0000", 2024-04-01T20:04:15.952 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.9731999999999999e-05 2024-04-01T20:04:15.952 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.952 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:04:15.952 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.952 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.952 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.952 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.27358.0:190739 9.7 e785/777 9:ed5c7905:::benchmark_data_smithi188_173515_object34654:head v 785'11849, mlcod=785'11847)", 2024-04-01T20:04:15.953 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T20:01:55.800345+0000", 2024-04-01T20:04:15.953 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 140.13415472299999, 2024-04-01T20:04:15.953 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.012916502, 2024-04-01T20:04:15.953 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:04:15.953 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:04:15.953 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:04:15.953 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:04:15.953 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.953 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:04:15.953 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:55.800345+0000", 2024-04-01T20:04:15.953 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.953 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.953 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.953 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:04:15.954 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:55.800345+0000", 2024-04-01T20:04:15.954 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.954 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.954 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.954 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:04:15.954 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:55.800348+0000", 2024-04-01T20:04:15.954 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.9270000000000001e-06 2024-04-01T20:04:15.954 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.954 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.954 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:04:15.954 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:55.800364+0000", 2024-04-01T20:04:15.954 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6157000000000001e-05 2024-04-01T20:04:15.954 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.954 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.955 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:04:15.955 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:55.800385+0000", 2024-04-01T20:04:15.955 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0792999999999999e-05 2024-04-01T20:04:15.955 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.955 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.955 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:04:15.955 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:55.800394+0000", 2024-04-01T20:04:15.955 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.6029999999999994e-06 2024-04-01T20:04:15.955 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.955 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.955 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:04:15.955 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:55.800487+0000", 2024-04-01T20:04:15.955 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.2995e-05 2024-04-01T20:04:15.955 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.956 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.956 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:04:15.956 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:55.800529+0000", 2024-04-01T20:04:15.956 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1817999999999998e-05 2024-04-01T20:04:15.956 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.956 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.956 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:04:15.956 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:55.813200+0000", 2024-04-01T20:04:15.956 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.012670969000000001 2024-04-01T20:04:15.956 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.956 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.956 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:04:15.956 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:55.813261+0000", 2024-04-01T20:04:15.956 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1240000000000003e-05 2024-04-01T20:04:15.956 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.957 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:04:15.957 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.957 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.957 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.957 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.27358.0:191232 9.7 e785/777 9:ec08aa0b:::benchmark_data_smithi188_173515_object35147:head v 785'11893, mlcod=785'11891)", 2024-04-01T20:04:15.957 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T20:01:56.548363+0000", 2024-04-01T20:04:15.957 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 139.386136513, 2024-04-01T20:04:15.957 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.012205202, 2024-04-01T20:04:15.957 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:04:15.957 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:04:15.957 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:04:15.957 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:04:15.957 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.957 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:04:15.958 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:56.548363+0000", 2024-04-01T20:04:15.958 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.958 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.958 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.958 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:04:15.958 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:56.548363+0000", 2024-04-01T20:04:15.958 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.958 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.958 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.958 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:04:15.958 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:56.548364+0000", 2024-04-01T20:04:15.958 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1399999999999997e-07 2024-04-01T20:04:15.958 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.958 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.959 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:04:15.959 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:56.548377+0000", 2024-04-01T20:04:15.959 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3025e-05 2024-04-01T20:04:15.959 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.959 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.959 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:04:15.959 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:56.548383+0000", 2024-04-01T20:04:15.959 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.1310000000000003e-06 2024-04-01T20:04:15.959 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.959 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.959 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:04:15.959 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:56.548390+0000", 2024-04-01T20:04:15.959 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.7950000000000008e-06 2024-04-01T20:04:15.960 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.960 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.960 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:04:15.960 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:56.548528+0000", 2024-04-01T20:04:15.960 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00013774100000000001 2024-04-01T20:04:15.960 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.960 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.960 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:04:15.960 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:56.548550+0000", 2024-04-01T20:04:15.960 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.158e-05 2024-04-01T20:04:15.960 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.960 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.960 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:04:15.960 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:56.560527+0000", 2024-04-01T20:04:15.960 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.011977092 2024-04-01T20:04:15.961 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.961 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.961 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:04:15.961 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:01:56.560568+0000", 2024-04-01T20:04:15.961 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.1223999999999997e-05 2024-04-01T20:04:15.961 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.961 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:04:15.961 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.961 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.961 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.961 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.27358.0:205378 9.7 e796/795 9:ea33c98b:::benchmark_data_smithi188_173515_object49293:head v 796'12753, mlcod=796'12751)", 2024-04-01T20:04:15.961 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T20:02:17.727002+0000", 2024-04-01T20:04:15.961 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 118.207497828, 2024-04-01T20:04:15.961 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.019719467000000001, 2024-04-01T20:04:15.961 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:04:15.962 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:04:15.962 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:04:15.962 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:04:15.962 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.962 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:04:15.962 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:17.727002+0000", 2024-04-01T20:04:15.962 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.962 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.962 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.962 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:04:15.962 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:17.727002+0000", 2024-04-01T20:04:15.962 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.962 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.962 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.962 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:04:15.963 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:17.727004+0000", 2024-04-01T20:04:15.963 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3779999999999999e-06 2024-04-01T20:04:15.963 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.963 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.963 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:04:15.963 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:17.727016+0000", 2024-04-01T20:04:15.963 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1986e-05 2024-04-01T20:04:15.963 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.963 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.963 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:04:15.963 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:17.727037+0000", 2024-04-01T20:04:15.963 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.1395000000000001e-05 2024-04-01T20:04:15.963 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.963 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.963 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:04:15.964 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:17.727047+0000", 2024-04-01T20:04:15.964 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.9159999999999996e-06 2024-04-01T20:04:15.964 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.964 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.964 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:04:15.964 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:17.727128+0000", 2024-04-01T20:04:15.964 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.1001000000000006e-05 2024-04-01T20:04:15.964 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.964 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.964 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:04:15.964 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:17.727151+0000", 2024-04-01T20:04:15.964 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2836999999999998e-05 2024-04-01T20:04:15.964 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.964 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.964 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:04:15.965 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:17.746652+0000", 2024-04-01T20:04:15.965 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.019501025000000002 2024-04-01T20:04:15.965 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.965 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.965 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:04:15.965 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:17.746721+0000", 2024-04-01T20:04:15.965 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8929000000000004e-05 2024-04-01T20:04:15.965 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.965 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:04:15.965 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.965 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.965 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.966 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.27358.0:205387 9.7 e796/795 9:e7188c91:::benchmark_data_smithi188_173515_object49302:head v 796'12754, mlcod=796'12751)", 2024-04-01T20:04:15.966 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T20:02:17.731763+0000", 2024-04-01T20:04:15.966 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 118.202736214, 2024-04-01T20:04:15.966 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014987498, 2024-04-01T20:04:15.966 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:04:15.966 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:04:15.966 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:04:15.966 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:04:15.966 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.966 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:04:15.966 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:17.731763+0000", 2024-04-01T20:04:15.966 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.966 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.966 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.967 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:04:15.967 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:17.731763+0000", 2024-04-01T20:04:15.967 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.967 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.967 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.967 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:04:15.967 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:17.731766+0000", 2024-04-01T20:04:15.967 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3870000000000002e-06 2024-04-01T20:04:15.967 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.967 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.967 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:04:15.967 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:17.731778+0000", 2024-04-01T20:04:15.967 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2140000000000001e-05 2024-04-01T20:04:15.967 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.968 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.968 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:04:15.968 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:17.731795+0000", 2024-04-01T20:04:15.968 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.7486000000000002e-05 2024-04-01T20:04:15.968 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.968 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.968 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:04:15.968 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:17.731805+0000", 2024-04-01T20:04:15.968 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.009e-05 2024-04-01T20:04:15.968 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.968 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.968 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:04:15.968 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:17.732048+0000", 2024-04-01T20:04:15.969 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.00024301600000000001 2024-04-01T20:04:15.969 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.969 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.969 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:04:15.969 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:17.732069+0000", 2024-04-01T20:04:15.969 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0579000000000001e-05 2024-04-01T20:04:15.969 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.969 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.969 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:04:15.969 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:17.746727+0000", 2024-04-01T20:04:15.969 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014657781 2024-04-01T20:04:15.969 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.969 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.969 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:04:15.969 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:17.746751+0000", 2024-04-01T20:04:15.970 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4019000000000002e-05 2024-04-01T20:04:15.970 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.970 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:04:15.970 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.970 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.970 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.970 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.27358.0:208832 9.7 e797/795 9:e26a2fa3:::benchmark_data_smithi188_173515_object52747:head v 797'12982, mlcod=797'12979)", 2024-04-01T20:04:15.970 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T20:02:21.395905+0000", 2024-04-01T20:04:15.970 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 114.53859454000001, 2024-04-01T20:04:15.970 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014017936999999999, 2024-04-01T20:04:15.970 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:04:15.970 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:04:15.970 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:04:15.970 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:04:15.971 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.971 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:04:15.971 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:21.395905+0000", 2024-04-01T20:04:15.971 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.971 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.971 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.971 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:04:15.971 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:21.395905+0000", 2024-04-01T20:04:15.971 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.971 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.971 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.971 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:04:15.971 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:21.395906+0000", 2024-04-01T20:04:15.971 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2249999999999999e-06 2024-04-01T20:04:15.972 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.972 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.972 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:04:15.972 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:21.395913+0000", 2024-04-01T20:04:15.972 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.1269999999999997e-06 2024-04-01T20:04:15.972 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.972 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.972 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:04:15.972 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:21.395926+0000", 2024-04-01T20:04:15.972 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2986999999999999e-05 2024-04-01T20:04:15.972 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.972 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.972 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:04:15.972 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:21.395933+0000", 2024-04-01T20:04:15.973 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0559999999999999e-06 2024-04-01T20:04:15.973 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.973 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.973 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:04:15.973 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:21.399427+0000", 2024-04-01T20:04:15.973 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.003494175 2024-04-01T20:04:15.973 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.973 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.973 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:04:15.973 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:21.399444+0000", 2024-04-01T20:04:15.973 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6130999999999999e-05 2024-04-01T20:04:15.973 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.973 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.973 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:04:15.973 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:21.409856+0000", 2024-04-01T20:04:15.974 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010412848000000001 2024-04-01T20:04:15.974 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.974 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.974 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:04:15.974 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:21.409923+0000", 2024-04-01T20:04:15.974 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.6388000000000002e-05 2024-04-01T20:04:15.974 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.974 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:04:15.974 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.974 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.974 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.974 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.27358.0:211437 9.7 e798/795 9:e298f6e8:::benchmark_data_smithi188_173515_object55352:head v 798'13147, mlcod=798'13145)", 2024-04-01T20:04:15.974 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T20:02:23.991558+0000", 2024-04-01T20:04:15.974 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 111.94294143400001, 2024-04-01T20:04:15.975 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.012278476, 2024-04-01T20:04:15.975 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:04:15.975 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:04:15.975 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:04:15.975 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:04:15.975 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.975 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:04:15.975 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:23.991558+0000", 2024-04-01T20:04:15.975 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.975 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.975 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.975 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:04:15.975 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:23.991558+0000", 2024-04-01T20:04:15.975 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.976 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.976 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.976 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:04:15.976 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:23.991562+0000", 2024-04-01T20:04:15.976 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.8210000000000003e-06 2024-04-01T20:04:15.976 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.976 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.976 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:04:15.976 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:23.991578+0000", 2024-04-01T20:04:15.976 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6259000000000001e-05 2024-04-01T20:04:15.976 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.976 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.976 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:04:15.976 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:23.991597+0000", 2024-04-01T20:04:15.977 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.9131999999999999e-05 2024-04-01T20:04:15.977 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.977 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.977 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:04:15.977 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:23.991610+0000", 2024-04-01T20:04:15.977 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2292e-05 2024-04-01T20:04:15.977 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.977 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.977 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:04:15.977 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:23.991678+0000", 2024-04-01T20:04:15.977 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8313999999999997e-05 2024-04-01T20:04:15.977 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.977 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.978 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:04:15.978 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:23.991698+0000", 2024-04-01T20:04:15.978 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.0095e-05 2024-04-01T20:04:15.978 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.978 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.978 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:04:15.978 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:24.003781+0000", 2024-04-01T20:04:15.978 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.012083061000000001 2024-04-01T20:04:15.978 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.978 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.978 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:04:15.978 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:24.003836+0000", 2024-04-01T20:04:15.978 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.5501999999999998e-05 2024-04-01T20:04:15.978 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.979 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:04:15.979 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.979 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.979 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.979 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.27358.0:227006 9.7 e807/795 9:e672ccf5:::benchmark_data_smithi188_173515_object70921:head v 807'14078, mlcod=807'14075)", 2024-04-01T20:04:15.979 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T20:02:43.301386+0000", 2024-04-01T20:04:15.979 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 92.633113073999994, 2024-04-01T20:04:15.979 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.013663435, 2024-04-01T20:04:15.979 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:04:15.979 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:04:15.979 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:04:15.979 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:04:15.979 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.980 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:04:15.980 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:43.301386+0000", 2024-04-01T20:04:15.980 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.980 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.980 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.980 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:04:15.980 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:43.301386+0000", 2024-04-01T20:04:15.980 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.980 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.980 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.980 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:04:15.980 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:43.301387+0000", 2024-04-01T20:04:15.980 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.009e-06 2024-04-01T20:04:15.980 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.981 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.981 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:04:15.981 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:43.301393+0000", 2024-04-01T20:04:15.981 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9909999999999999e-06 2024-04-01T20:04:15.981 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.981 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.981 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:04:15.981 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:43.301402+0000", 2024-04-01T20:04:15.981 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.0550000000000005e-06 2024-04-01T20:04:15.981 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.981 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.981 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:04:15.981 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:43.301409+0000", 2024-04-01T20:04:15.981 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.8419999999999999e-06 2024-04-01T20:04:15.981 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.982 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.982 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:04:15.982 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:43.305927+0000", 2024-04-01T20:04:15.982 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0045174869999999997 2024-04-01T20:04:15.982 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.982 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.982 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:04:15.982 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:43.305954+0000", 2024-04-01T20:04:15.982 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.7389000000000002e-05 2024-04-01T20:04:15.982 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.982 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.982 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:04:15.982 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:43.314985+0000", 2024-04-01T20:04:15.982 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0090306569999999992 2024-04-01T20:04:15.983 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.983 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.983 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:04:15.983 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:43.315050+0000", 2024-04-01T20:04:15.983 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.5005000000000005e-05 2024-04-01T20:04:15.983 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.983 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:04:15.983 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.983 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.983 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.983 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.27358.0:227011 9.7 e807/795 9:e94a97c6:::benchmark_data_smithi188_173515_object70926:head v 807'14079, mlcod=807'14075)", 2024-04-01T20:04:15.983 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T20:02:43.301419+0000", 2024-04-01T20:04:15.983 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 92.633080499000002, 2024-04-01T20:04:15.983 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.014634463, 2024-04-01T20:04:15.983 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:04:15.984 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:04:15.984 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:04:15.984 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:04:15.984 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.984 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:04:15.984 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:43.301419+0000", 2024-04-01T20:04:15.984 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.984 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.984 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.984 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:04:15.984 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:43.301419+0000", 2024-04-01T20:04:15.984 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.984 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.984 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.984 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:04:15.984 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:43.301419+0000", 2024-04-01T20:04:15.985 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2799999999999996e-07 2024-04-01T20:04:15.985 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.985 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.985 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:04:15.985 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:43.301429+0000", 2024-04-01T20:04:15.985 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.7829999999999993e-06 2024-04-01T20:04:15.985 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.985 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.985 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:04:15.985 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:43.301436+0000", 2024-04-01T20:04:15.985 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.6499999999999999e-06 2024-04-01T20:04:15.985 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.985 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.985 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:04:15.985 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:43.301441+0000", 2024-04-01T20:04:15.985 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4380000000000003e-06 2024-04-01T20:04:15.986 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.986 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.986 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:04:15.986 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:43.310470+0000", 2024-04-01T20:04:15.986 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0090287130000000007 2024-04-01T20:04:15.986 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.986 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.986 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:04:15.986 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:43.310496+0000", 2024-04-01T20:04:15.986 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6109999999999999e-05 2024-04-01T20:04:15.986 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.986 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.987 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:04:15.987 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:43.316010+0000", 2024-04-01T20:04:15.987 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0055136580000000003 2024-04-01T20:04:15.987 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.987 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.987 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:04:15.987 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:43.316053+0000", 2024-04-01T20:04:15.987 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.3582999999999999e-05 2024-04-01T20:04:15.987 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.987 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:04:15.987 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.987 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.987 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.987 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.27358.0:238253 9.7 e809/795 9:e9d89783:::benchmark_data_smithi188_173515_object82168:head v 809'14809, mlcod=809'14806)", 2024-04-01T20:04:15.987 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T20:02:55.216068+0000", 2024-04-01T20:04:15.987 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 80.718431808999995, 2024-04-01T20:04:15.988 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.012834125, 2024-04-01T20:04:15.988 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:04:15.988 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:04:15.988 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:04:15.988 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:04:15.988 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.988 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:04:15.988 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:55.216068+0000", 2024-04-01T20:04:15.988 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.988 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.988 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.988 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:04:15.988 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:55.216068+0000", 2024-04-01T20:04:15.988 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.989 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.989 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.989 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:04:15.989 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:55.216069+0000", 2024-04-01T20:04:15.989 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.64e-07 2024-04-01T20:04:15.989 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.989 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.989 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:04:15.989 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:55.216074+0000", 2024-04-01T20:04:15.989 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4149999999999998e-06 2024-04-01T20:04:15.989 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.989 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.989 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:04:15.990 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:55.216081+0000", 2024-04-01T20:04:15.990 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.1439999999999997e-06 2024-04-01T20:04:15.990 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.990 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.990 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:04:15.990 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:55.216087+0000", 2024-04-01T20:04:15.990 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9499999999999998e-06 2024-04-01T20:04:15.990 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.990 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.990 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:04:15.990 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:55.220142+0000", 2024-04-01T20:04:15.990 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0040547300000000003 2024-04-01T20:04:15.990 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.990 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.991 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:04:15.991 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:55.220166+0000", 2024-04-01T20:04:15.991 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.3808e-05 2024-04-01T20:04:15.991 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.991 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.991 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:04:15.991 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:55.228852+0000", 2024-04-01T20:04:15.991 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0086867950000000006 2024-04-01T20:04:15.991 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.991 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.991 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:04:15.991 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:02:55.228902+0000", 2024-04-01T20:04:15.991 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.9319e-05 2024-04-01T20:04:15.991 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.992 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:04:15.992 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.992 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.992 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.992 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.27358.0:265739 9.7 e823/795 9:ec037920:::benchmark_data_smithi188_173515_object109654:head v 823'16504, mlcod=823'16500)", 2024-04-01T20:04:15.992 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T20:03:28.685270+0000", 2024-04-01T20:04:15.992 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 47.249229559, 2024-04-01T20:04:15.992 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.013451621, 2024-04-01T20:04:15.992 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:04:15.992 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:04:15.992 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:04:15.992 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:04:15.992 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.992 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:04:15.992 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:28.685270+0000", 2024-04-01T20:04:15.993 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.993 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.993 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.993 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:04:15.993 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:28.685270+0000", 2024-04-01T20:04:15.993 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.993 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.993 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.993 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:04:15.993 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:28.685271+0000", 2024-04-01T20:04:15.993 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0610000000000001e-06 2024-04-01T20:04:15.993 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.993 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.993 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:04:15.993 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:28.685277+0000", 2024-04-01T20:04:15.994 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.2709999999999998e-06 2024-04-01T20:04:15.994 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.994 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.994 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:04:15.994 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:28.685285+0000", 2024-04-01T20:04:15.994 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2360000000000004e-06 2024-04-01T20:04:15.994 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.994 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.994 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:04:15.994 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:28.685291+0000", 2024-04-01T20:04:15.994 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.9039999999999997e-06 2024-04-01T20:04:15.994 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.994 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.994 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:04:15.995 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:28.687725+0000", 2024-04-01T20:04:15.995 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0024340289999999999 2024-04-01T20:04:15.995 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.995 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.995 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:04:15.995 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:28.687750+0000", 2024-04-01T20:04:15.995 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4283000000000001e-05 2024-04-01T20:04:15.995 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.995 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.995 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:04:15.995 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:28.698669+0000", 2024-04-01T20:04:15.995 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010919589 2024-04-01T20:04:15.995 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.995 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.996 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:04:15.996 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:28.698722+0000", 2024-04-01T20:04:15.996 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.2247999999999998e-05 2024-04-01T20:04:15.996 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.996 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:04:15.996 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:15.996 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.996 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.996 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.27358.0:286000 9.7 e827/795 9:eca6961d:::benchmark_data_smithi188_173515_object129915:head v 827'17790, mlcod=827'17788)", 2024-04-01T20:04:15.996 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T20:03:47.796732+0000", 2024-04-01T20:04:15.996 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 28.137767031999999, 2024-04-01T20:04:15.996 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.015588942999999999, 2024-04-01T20:04:15.996 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:04:15.996 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:04:15.997 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:04:15.997 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:04:15.997 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.997 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:04:15.997 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:47.796732+0000", 2024-04-01T20:04:15.997 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.997 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.997 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.997 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:04:15.997 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:47.796732+0000", 2024-04-01T20:04:15.997 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:15.997 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.997 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.997 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:04:15.997 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:47.796736+0000", 2024-04-01T20:04:15.998 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.8299999999999998e-06 2024-04-01T20:04:15.998 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.998 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.998 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:04:15.998 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:47.796754+0000", 2024-04-01T20:04:15.998 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.8170000000000001e-05 2024-04-01T20:04:15.998 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.998 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.998 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:04:15.998 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:47.796789+0000", 2024-04-01T20:04:15.998 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 3.4462999999999999e-05 2024-04-01T20:04:15.998 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.998 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.999 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:04:15.999 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:47.796797+0000", 2024-04-01T20:04:15.999 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.9019999999999999e-06 2024-04-01T20:04:15.999 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.999 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.999 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:04:15.999 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:47.796851+0000", 2024-04-01T20:04:15.999 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.4698999999999999e-05 2024-04-01T20:04:15.999 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:15.999 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:15.999 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:04:15.999 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:47.796867+0000", 2024-04-01T20:04:15.999 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.5735000000000001e-05 2024-04-01T20:04:16.000 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.000 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.000 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:04:16.000 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:47.812258+0000", 2024-04-01T20:04:16.000 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.015391059 2024-04-01T20:04:16.000 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.000 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.000 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:04:16.000 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:47.812321+0000", 2024-04-01T20:04:16.000 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3084999999999997e-05 2024-04-01T20:04:16.000 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:16.000 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:04:16.000 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:16.000 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.000 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.000 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.27358.0:286001 9.7 e827/795 9:e8228073:::benchmark_data_smithi188_173515_object129916:head v 827'17791, mlcod=827'17788)", 2024-04-01T20:04:16.001 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T20:03:47.797217+0000", 2024-04-01T20:04:16.001 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 28.137282541000001, 2024-04-01T20:04:16.001 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.015154066000000001, 2024-04-01T20:04:16.001 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:04:16.001 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:04:16.001 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:04:16.001 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:04:16.001 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.001 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:04:16.001 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:47.797217+0000", 2024-04-01T20:04:16.001 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:16.001 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.001 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.001 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:04:16.002 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:47.797217+0000", 2024-04-01T20:04:16.002 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:16.002 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.002 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.002 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:04:16.002 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:47.797218+0000", 2024-04-01T20:04:16.002 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.114e-06 2024-04-01T20:04:16.002 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.002 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.002 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:04:16.002 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:47.797225+0000", 2024-04-01T20:04:16.002 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.0759999999999997e-06 2024-04-01T20:04:16.002 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.002 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.003 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:04:16.003 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:47.797235+0000", 2024-04-01T20:04:16.003 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.9170000000000001e-06 2024-04-01T20:04:16.003 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.003 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.003 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:04:16.003 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:47.797241+0000", 2024-04-01T20:04:16.003 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.3620000000000002e-06 2024-04-01T20:04:16.003 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.003 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.003 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:04:16.003 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:47.800105+0000", 2024-04-01T20:04:16.003 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0028633949999999999 2024-04-01T20:04:16.003 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.003 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.004 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:04:16.004 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:47.800131+0000", 2024-04-01T20:04:16.004 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6480999999999999e-05 2024-04-01T20:04:16.004 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.004 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.004 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:04:16.004 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:47.812327+0000", 2024-04-01T20:04:16.004 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.012195938 2024-04-01T20:04:16.004 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.004 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.004 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:04:16.004 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:47.812371+0000", 2024-04-01T20:04:16.004 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.3782999999999997e-05 2024-04-01T20:04:16.004 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:16.005 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:04:16.005 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:16.005 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.005 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.005 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.27358.0:288177 9.7 e827/795 9:efa0b834:::benchmark_data_smithi188_173515_object132092:head v 827'17931, mlcod=827'17928)", 2024-04-01T20:04:16.005 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T20:03:49.859563+0000", 2024-04-01T20:04:16.005 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 26.074936233999999, 2024-04-01T20:04:16.005 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.013761845, 2024-04-01T20:04:16.005 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:04:16.005 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:04:16.005 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:04:16.005 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:04:16.005 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.006 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:04:16.006 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:49.859563+0000", 2024-04-01T20:04:16.006 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:16.006 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.006 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.006 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:04:16.006 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:49.859563+0000", 2024-04-01T20:04:16.006 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:16.006 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.006 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.006 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:04:16.006 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:49.859565+0000", 2024-04-01T20:04:16.006 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.646e-06 2024-04-01T20:04:16.007 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.007 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.007 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:04:16.007 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:49.859574+0000", 2024-04-01T20:04:16.007 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 9.1630000000000002e-06 2024-04-01T20:04:16.007 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.007 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.007 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:04:16.007 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:49.859587+0000", 2024-04-01T20:04:16.007 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.2574e-05 2024-04-01T20:04:16.007 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.007 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.007 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:04:16.007 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:49.859595+0000", 2024-04-01T20:04:16.007 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.568e-06 2024-04-01T20:04:16.007 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.008 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.008 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:04:16.008 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:49.863252+0000", 2024-04-01T20:04:16.008 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0036565880000000001 2024-04-01T20:04:16.008 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.008 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.008 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:04:16.008 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:49.863276+0000", 2024-04-01T20:04:16.008 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4179e-05 2024-04-01T20:04:16.008 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.008 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.008 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:04:16.008 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:49.873277+0000", 2024-04-01T20:04:16.008 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010001416000000001 2024-04-01T20:04:16.008 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.009 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.009 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:04:16.009 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:49.873325+0000", 2024-04-01T20:04:16.009 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7710999999999998e-05 2024-04-01T20:04:16.009 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:16.009 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:04:16.009 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:16.009 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.009 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.009 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.27358.0:293897 9.7 e829/795 9:e2c65fb8:::benchmark_data_smithi188_173515_object137812:head v 829'18283, mlcod=829'18277)", 2024-04-01T20:04:16.009 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T20:03:55.233839+0000", 2024-04-01T20:04:16.009 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 20.700660889000002, 2024-04-01T20:04:16.009 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.012453294, 2024-04-01T20:04:16.009 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:04:16.009 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:04:16.010 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:04:16.010 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:04:16.010 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.010 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:04:16.010 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:55.233839+0000", 2024-04-01T20:04:16.010 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:16.010 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.010 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.010 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:04:16.010 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:55.233839+0000", 2024-04-01T20:04:16.010 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:16.010 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.010 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.011 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:04:16.011 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:55.233839+0000", 2024-04-01T20:04:16.011 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.2600000000000001e-07 2024-04-01T20:04:16.011 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.011 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.011 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:04:16.011 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:55.233844+0000", 2024-04-01T20:04:16.011 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.8679999999999998e-06 2024-04-01T20:04:16.011 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.011 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.011 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:04:16.011 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:55.233852+0000", 2024-04-01T20:04:16.011 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.3189999999999997e-06 2024-04-01T20:04:16.011 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.012 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.012 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:04:16.012 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:55.233858+0000", 2024-04-01T20:04:16.012 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 6.0519999999999998e-06 2024-04-01T20:04:16.012 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.012 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.012 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:04:16.012 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:55.239648+0000", 2024-04-01T20:04:16.012 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0057907109999999996 2024-04-01T20:04:16.012 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.012 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.012 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:04:16.012 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:55.239673+0000", 2024-04-01T20:04:16.013 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.4433000000000001e-05 2024-04-01T20:04:16.013 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.013 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.013 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:04:16.013 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:55.246244+0000", 2024-04-01T20:04:16.013 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0065716639999999996 2024-04-01T20:04:16.013 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.013 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.013 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:04:16.013 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:03:55.246292+0000", 2024-04-01T20:04:16.013 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 4.7420999999999999e-05 2024-04-01T20:04:16.013 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:16.013 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:04:16.013 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:16.014 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.014 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.014 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.27358.0:309100 9.7 e832/795 9:e66f6202:::benchmark_data_smithi188_173515_object153015:head v 832'19271, mlcod=832'19268)", 2024-04-01T20:04:16.014 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T20:04:09.593057+0000", 2024-04-01T20:04:16.014 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 6.3414427059999996, 2024-04-01T20:04:16.014 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.012588688000000001, 2024-04-01T20:04:16.014 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:04:16.014 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:04:16.014 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:04:16.014 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:04:16.014 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.014 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:04:16.014 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:04:09.593057+0000", 2024-04-01T20:04:16.014 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:16.015 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.015 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.015 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:04:16.015 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:04:09.593057+0000", 2024-04-01T20:04:16.015 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:16.015 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.015 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.015 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:04:16.015 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:04:09.593059+0000", 2024-04-01T20:04:16.015 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.807e-06 2024-04-01T20:04:16.015 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.015 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.015 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:04:16.015 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:04:09.593067+0000", 2024-04-01T20:04:16.016 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.6219999999999998e-06 2024-04-01T20:04:16.016 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.016 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.016 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:04:16.016 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:04:09.593081+0000", 2024-04-01T20:04:16.016 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.3679999999999999e-05 2024-04-01T20:04:16.016 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.016 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.016 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:04:16.016 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:04:09.593089+0000", 2024-04-01T20:04:16.016 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 8.0970000000000006e-06 2024-04-01T20:04:16.016 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.016 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.016 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:04:16.017 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:04:09.595351+0000", 2024-04-01T20:04:16.017 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.0022620240000000001 2024-04-01T20:04:16.017 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.017 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.017 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:04:16.017 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:04:09.595378+0000", 2024-04-01T20:04:16.017 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.7348999999999999e-05 2024-04-01T20:04:16.017 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.017 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.017 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:04:16.017 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:04:09.605592+0000", 2024-04-01T20:04:16.017 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.010213336999999999 2024-04-01T20:04:16.017 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.017 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.017 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:04:16.018 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:04:09.605645+0000", 2024-04-01T20:04:16.018 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.3771999999999999e-05 2024-04-01T20:04:16.018 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:16.018 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:04:16.018 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:16.018 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.018 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.018 INFO:teuthology.orchestra.run.smithi022.stdout: "description": "osd_repop(client.27358.0:310497 9.7 e833/795 9:eb88ac20:::benchmark_data_smithi188_173515_object154412:head v 833'19353, mlcod=833'19351)", 2024-04-01T20:04:16.018 INFO:teuthology.orchestra.run.smithi022.stdout: "initiated_at": "2024-04-01T20:04:10.901877+0000", 2024-04-01T20:04:16.018 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 5.032622699, 2024-04-01T20:04:16.018 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.012543851, 2024-04-01T20:04:16.018 INFO:teuthology.orchestra.run.smithi022.stdout: "continuous": false, 2024-04-01T20:04:16.018 INFO:teuthology.orchestra.run.smithi022.stdout: "type_data": { 2024-04-01T20:04:16.018 INFO:teuthology.orchestra.run.smithi022.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-01T20:04:16.019 INFO:teuthology.orchestra.run.smithi022.stdout: "events": [ 2024-04-01T20:04:16.019 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.019 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "initiated", 2024-04-01T20:04:16.019 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:04:10.901877+0000", 2024-04-01T20:04:16.019 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:16.019 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.019 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.019 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "header_read", 2024-04-01T20:04:16.019 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:04:10.901877+0000", 2024-04-01T20:04:16.019 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0 2024-04-01T20:04:16.019 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.019 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.019 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "throttled", 2024-04-01T20:04:16.019 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:04:10.901879+0000", 2024-04-01T20:04:16.020 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.2000000000000001e-06 2024-04-01T20:04:16.020 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.020 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.020 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "all_read", 2024-04-01T20:04:16.020 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:04:10.901890+0000", 2024-04-01T20:04:16.020 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.1192999999999999e-05 2024-04-01T20:04:16.020 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.020 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.020 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "dispatched", 2024-04-01T20:04:16.020 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:04:10.901906+0000", 2024-04-01T20:04:16.020 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.6087999999999999e-05 2024-04-01T20:04:16.020 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.020 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.020 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "queued_for_pg", 2024-04-01T20:04:16.021 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:04:10.901917+0000", 2024-04-01T20:04:16.021 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 1.0368e-05 2024-04-01T20:04:16.021 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.021 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.021 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "reached_pg", 2024-04-01T20:04:16.021 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:04:10.901988+0000", 2024-04-01T20:04:16.021 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 7.1223999999999994e-05 2024-04-01T20:04:16.021 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.021 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.021 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "started", 2024-04-01T20:04:16.021 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:04:10.902014+0000", 2024-04-01T20:04:16.021 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 2.6406000000000001e-05 2024-04-01T20:04:16.021 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.021 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.021 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "commit_sent", 2024-04-01T20:04:16.021 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:04:10.914369+0000", 2024-04-01T20:04:16.022 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 0.012355184 2024-04-01T20:04:16.022 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-04-01T20:04:16.022 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-04-01T20:04:16.022 INFO:teuthology.orchestra.run.smithi022.stdout: "event": "done", 2024-04-01T20:04:16.022 INFO:teuthology.orchestra.run.smithi022.stdout: "time": "2024-04-01T20:04:10.914421+0000", 2024-04-01T20:04:16.022 INFO:teuthology.orchestra.run.smithi022.stdout: "duration": 5.1187999999999998e-05 2024-04-01T20:04:16.022 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:16.022 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:04:16.022 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:16.022 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-04-01T20:04:16.022 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-04-01T20:04:16.022 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T20:04:16.023 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:04:16.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:15 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T20:04:16.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:15 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T20:04:16.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:15 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/190699279' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T20:04:16.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:15 smithi062 ceph-mon[44211]: osdmap e834: 12 total, 11 up, 9 in 2024-04-01T20:04:16.024 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:15 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T20:04:16.024 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:15 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T20:04:16.024 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:15 smithi062 ceph-mon[44211]: pgmap v2256: 17 pgs: 17 active+clean; 14 MiB data, 6.0 GiB used, 799 GiB / 805 GiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T20:04:16.024 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:16.024 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:04:16.125 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:04:16.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:15 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: nodeep-scrub flag(s) set) 2024-04-01T20:04:16.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:15 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T20:04:16.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:15 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/190699279' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T20:04:16.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:15 smithi188 ceph-mon[43939]: osdmap e834: 12 total, 11 up, 9 in 2024-04-01T20:04:16.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:15 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T20:04:16.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:15 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T20:04:16.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:15 smithi188 ceph-mon[43939]: pgmap v2256: 17 pgs: 17 active+clean; 14 MiB data, 6.0 GiB used, 799 GiB / 805 GiB avail; 0 B/s wr, 1.03k op/s 2024-04-01T20:04:16.156 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:16.188 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:04:16.195 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:16.195 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:04:16.296 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:04:16.393 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:16.414 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:04:16.417 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:16.418 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:04:16.518 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0 2024-04-01T20:04:16.548 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:17.179 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:04:17.198 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0" found: no such container 2024-04-01T20:04:17.203 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:17.203 INFO:tasks.cephadm.osd.0:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.0' 2024-04-01T20:04:17.218 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:04:17.223 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_ops_in_flight 2024-04-01T20:04:17.304 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:04:17.334 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:17.355 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:04:17.358 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:17.359 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:04:17.459 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:04:17.489 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:17.508 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:04:17.511 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:17.511 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:04:17.517 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T20:04:17.613 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:04:17.642 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:17.723 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:17 smithi022 ceph-mon[39439]: pgmap v2257: 17 pgs: 17 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail; 0 B/s wr, 678 op/s 2024-04-01T20:04:17.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:17 smithi062 ceph-mon[44211]: pgmap v2257: 17 pgs: 17 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail; 0 B/s wr, 678 op/s 2024-04-01T20:04:17.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:17 smithi188 ceph-mon[43939]: pgmap v2257: 17 pgs: 17 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail; 0 B/s wr, 678 op/s 2024-04-01T20:04:18.125 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:04:18.128 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:18.128 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:04:18.229 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9 2024-04-01T20:04:18.262 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:18.283 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9" found: no such container 2024-04-01T20:04:18.287 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:18.287 INFO:tasks.cephadm.osd.9:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.9' 2024-04-01T20:04:18.388 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:04:18.421 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:18.763 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd set noscrub 2024-04-01T20:04:19.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:18 smithi022 ceph-mon[39439]: 9.e scrub starts 2024-04-01T20:04:19.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:18 smithi022 ceph-mon[39439]: 9.e scrub ok 2024-04-01T20:04:19.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:18 smithi062 ceph-mon[44211]: 9.e scrub starts 2024-04-01T20:04:19.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:18 smithi062 ceph-mon[44211]: 9.e scrub ok 2024-04-01T20:04:19.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:18 smithi188 ceph-mon[43939]: 9.e scrub starts 2024-04-01T20:04:19.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:18 smithi188 ceph-mon[43939]: 9.e scrub ok 2024-04-01T20:04:19.774 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:04:19.777 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:19.777 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:04:19.878 DEBUG:teuthology.orchestra.run.smithi188:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11 2024-04-01T20:04:19.910 INFO:teuthology.orchestra.run.smithi188.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:19.932 INFO:teuthology.orchestra.run.smithi188.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11" found: no such container 2024-04-01T20:04:19.934 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:19.935 INFO:tasks.cephadm.osd.11:Ignoring exception while sending signal: Command failed on smithi188 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.11' 2024-04-01T20:04:20.036 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:04:20.066 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:20.094 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:04:20.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:20 smithi022 ceph-mon[39439]: pgmap v2258: 17 pgs: 17 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail; 0 B/s wr, 507 op/s 2024-04-01T20:04:20.116 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:20.116 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:04:20.218 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:04:20.245 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:20.261 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:20 smithi062 ceph-mon[44211]: pgmap v2258: 17 pgs: 17 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail; 0 B/s wr, 507 op/s 2024-04-01T20:04:20.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:20 smithi188 ceph-mon[43939]: pgmap v2258: 17 pgs: 17 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail; 0 B/s wr, 507 op/s 2024-04-01T20:04:21.661 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0: {} 2024-04-01T20:04:21.661 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1: {} 2024-04-01T20:04:21.661 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2: {} 2024-04-01T20:04:21.664 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4: {} 2024-04-01T20:04:21.685 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5: {} 2024-04-01T20:04:21.694 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:04:21.699 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:21.699 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:04:21.706 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6: {} 2024-04-01T20:04:21.726 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7: {} 2024-04-01T20:04:21.747 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8: {} 2024-04-01T20:04:21.767 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9: {} 2024-04-01T20:04:21.785 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T20:04:21.786 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:04:21.788 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10: {} 2024-04-01T20:04:21.800 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:04:21.808 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11: {} 2024-04-01T20:04:21.809 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-01T20:04:21.809 INFO:teuthology.orchestra.run.smithi022.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-01T20:04:21.809 INFO:teuthology.orchestra.run.smithi022.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-01T20:04:21.809 INFO:teuthology.orchestra.run.smithi022.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-01T20:04:21.809 INFO:teuthology.orchestra.run.smithi022.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-01T20:04:21.809 INFO:teuthology.orchestra.run.smithi022.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-01T20:04:21.809 INFO:teuthology.orchestra.run.smithi022.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-01T20:04:21.809 INFO:teuthology.orchestra.run.smithi022.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-01T20:04:21.809 INFO:teuthology.orchestra.run.smithi022.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-01T20:04:21.809 INFO:teuthology.orchestra.run.smithi022.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-01T20:04:21.809 INFO:teuthology.orchestra.run.smithi022.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-01T20:04:21.809 INFO:teuthology.orchestra.run.smithi022.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-01T20:04:21.832 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:21 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:04:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:21 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:04:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:21 smithi188 ceph-mon[43939]: 9.d scrub starts 2024-04-01T20:04:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:21 smithi188 ceph-mon[43939]: 9.d scrub ok 2024-04-01T20:04:21.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:21 smithi188 ceph-mon[43939]: osdmap e835: 12 total, 11 up, 9 in 2024-04-01T20:04:21.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:21 smithi188 ceph-mon[43939]: pgmap v2260: 17 pgs: 17 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail; 0 B/s wr, 177 op/s 2024-04-01T20:04:21.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:21 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/648528174' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:04:22.002 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:04:22.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:21 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:04:22.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:21 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:04:22.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:21 smithi062 ceph-mon[44211]: 9.d scrub starts 2024-04-01T20:04:22.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:21 smithi062 ceph-mon[44211]: 9.d scrub ok 2024-04-01T20:04:22.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:21 smithi062 ceph-mon[44211]: osdmap e835: 12 total, 11 up, 9 in 2024-04-01T20:04:22.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:21 smithi062 ceph-mon[44211]: pgmap v2260: 17 pgs: 17 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail; 0 B/s wr, 177 op/s 2024-04-01T20:04:22.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:21 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/648528174' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:04:22.081 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:21 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:04:22.081 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:21 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:04:22.081 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:21 smithi022 ceph-mon[39439]: 9.d scrub starts 2024-04-01T20:04:22.082 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:21 smithi022 ceph-mon[39439]: 9.d scrub ok 2024-04-01T20:04:22.082 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:21 smithi022 ceph-mon[39439]: osdmap e835: 12 total, 11 up, 9 in 2024-04-01T20:04:22.082 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:21 smithi022 ceph-mon[39439]: pgmap v2260: 17 pgs: 17 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail; 0 B/s wr, 177 op/s 2024-04-01T20:04:22.082 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:21 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/648528174' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2024-04-01T20:04:22.579 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_blocked_ops 2024-04-01T20:04:22.586 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:04:22.589 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:22.590 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:04:22.634 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'unique_pool_7' removed 2024-04-01T20:04:22.690 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6 2024-04-01T20:04:22.730 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:22.743 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.3.service' 2024-04-01T20:04:22.752 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6" found: no such container 2024-04-01T20:04:22.756 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:22.756 INFO:tasks.cephadm.osd.6:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.6' 2024-04-01T20:04:22.828 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T20:04:22.828 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-01T20:04:22.828 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd down 3 2024-04-01T20:04:22.857 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4 2024-04-01T20:04:22.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:22 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3280889578' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_7", "pool2": "unique_pool_7", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T20:04:22.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:22 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.883 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.883 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.884 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.884 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.884 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.884 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.884 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:22 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3280889578' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_7", "pool2": "unique_pool_7", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T20:04:22.884 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.884 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.884 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.884 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.884 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:22 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.886 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:22.893 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.894 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.894 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.894 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.894 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.894 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.894 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:22 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3280889578' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_7", "pool2": "unique_pool_7", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T20:04:22.894 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.894 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.894 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.894 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.894 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:22 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:04:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T20:04:22.907 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4" found: no such container 2024-04-01T20:04:22.910 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:22.910 INFO:tasks.cephadm.osd.4:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.4' 2024-04-01T20:04:23.011 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2 2024-04-01T20:04:23.039 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:23.188 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2" found: no such container 2024-04-01T20:04:23.191 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:23.192 INFO:tasks.cephadm.osd.2:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.2' 2024-04-01T20:04:23.293 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5 2024-04-01T20:04:23.321 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:23.394 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5" found: no such container 2024-04-01T20:04:23.398 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:23.398 INFO:tasks.cephadm.osd.5:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.5' 2024-04-01T20:04:23.499 DEBUG:teuthology.orchestra.run.smithi022:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1 2024-04-01T20:04:23.529 INFO:teuthology.orchestra.run.smithi022.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:23.730 INFO:teuthology.orchestra.run.smithi022.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1" found: no such container 2024-04-01T20:04:23.732 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:23.733 INFO:tasks.cephadm.osd.1:Ignoring exception while sending signal: Command failed on smithi022 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.1' 2024-04-01T20:04:23.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:23 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3280889578' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_7", "pool2": "unique_pool_7", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T20:04:23.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:23 smithi062 ceph-mon[44211]: osdmap e836: 12 total, 11 up, 9 in 2024-04-01T20:04:23.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:23 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:04:23.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:23 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:04:23.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:23 smithi062 ceph-mon[44211]: pgmap v2262: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:23.834 DEBUG:teuthology.orchestra.run.smithi062:> sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7 2024-04-01T20:04:23.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:23 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3280889578' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_7", "pool2": "unique_pool_7", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T20:04:23.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:23 smithi022 ceph-mon[39439]: osdmap e836: 12 total, 11 up, 9 in 2024-04-01T20:04:23.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:23 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:04:23.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:23 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:04:23.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:23 smithi022 ceph-mon[39439]: pgmap v2262: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:23.863 INFO:teuthology.orchestra.run.smithi062.stderr:Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg. 2024-04-01T20:04:24.063 INFO:teuthology.orchestra.run.smithi062.stderr:Error: no container with name or ID "ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7" found: no such container 2024-04-01T20:04:24.066 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-01T20:04:24.066 INFO:tasks.cephadm.osd.7:Ignoring exception while sending signal: Command failed on smithi062 with status 125: 'sudo docker kill -s 1 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd.7' 2024-04-01T20:04:24.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:23 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3280889578' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_7", "pool2": "unique_pool_7", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T20:04:24.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:23 smithi188 ceph-mon[43939]: osdmap e836: 12 total, 11 up, 9 in 2024-04-01T20:04:24.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:23 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:04:24.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:23 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:04:24.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:23 smithi188 ceph-mon[43939]: pgmap v2262: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:24.134 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-01T20:04:24.144 INFO:tasks.thrashosds:joining thrashosds 2024-04-01T20:04:24.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:24 smithi062 ceph-mon[44211]: osdmap e837: 12 total, 11 up, 9 in 2024-04-01T20:04:24.819 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T20:04:24.819 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:04:24.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:24 smithi022 ceph-mon[39439]: osdmap e837: 12 total, 11 up, 9 in 2024-04-01T20:04:25.079 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:04:25.119 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T20:04:25.119 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-01T20:04:25.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:24 smithi188 ceph-mon[43939]: osdmap e837: 12 total, 11 up, 9 in 2024-04-01T20:04:25.520 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.4 dump_historic_ops 2024-04-01T20:04:25.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:25 smithi062 ceph-mon[44211]: pgmap v2264: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:25.798 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T20:04:25.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:25 smithi022 ceph-mon[39439]: pgmap v2264: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:26.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:25 smithi188 ceph-mon[43939]: pgmap v2264: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:26.657 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is set 2024-04-01T20:04:26.880 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:26 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:04:26.881 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:26 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:04:26.881 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:26 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3138578475' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:04:27.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:26 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:04:27.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:26 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:04:27.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:26 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3138578475' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:04:27.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:26 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:04:27.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:26 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:04:27.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:26 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3138578475' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noscrub"}]: dispatch 2024-04-01T20:04:27.463 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T20:04:27.463 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:04:27.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:27 smithi062 ceph-mon[44211]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:04:27.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:27 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3138578475' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T20:04:27.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:27 smithi062 ceph-mon[44211]: osdmap e838: 12 total, 11 up, 9 in 2024-04-01T20:04:27.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:27 smithi062 ceph-mon[44211]: pgmap v2266: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:28.033 INFO:teuthology.orchestra.run.smithi022.stderr:osd.3 is already down. 2024-04-01T20:04:28.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:27 smithi022 ceph-mon[39439]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:04:28.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:27 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3138578475' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T20:04:28.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:27 smithi022 ceph-mon[39439]: osdmap e838: 12 total, 11 up, 9 in 2024-04-01T20:04:28.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:27 smithi022 ceph-mon[39439]: pgmap v2266: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:28.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:27 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[39416]: 2024-04-01T20:04:27.841+0000 7fd025a9f700 -1 mon.a@0(leader).osd e839 definitely_dead 0 2024-04-01T20:04:28.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:27 smithi188 ceph-mon[43939]: Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2024-04-01T20:04:28.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:27 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3138578475' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noscrub"}]': finished 2024-04-01T20:04:28.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:27 smithi188 ceph-mon[43939]: osdmap e838: 12 total, 11 up, 9 in 2024-04-01T20:04:28.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:27 smithi188 ceph-mon[43939]: pgmap v2266: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:28.189 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_ops_in_flight 2024-04-01T20:04:28.464 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T20:04:28.581 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.3 2024-04-01T20:04:28.581 INFO:tasks.thrashosds.thrasher:remote for osd 3 is ubuntu@smithi022.front.sepia.ceph.com 2024-04-01T20:04:28.581 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -n osd.3 --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-3 --journal-path /var/lib/ceph/osd/ceph-3/journal --op list-pgs 2024-04-01T20:04:28.804 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/osd.3/config 2024-04-01T20:04:28.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:28 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:04:28.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:28 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:04:28.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:28 smithi022 ceph-mon[39439]: osdmap e839: 12 total, 11 up, 9 in 2024-04-01T20:04:28.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:28 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3968205657' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["3"]}]: dispatch 2024-04-01T20:04:28.999 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:28 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:04:28.999 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:28 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:04:28.999 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:28 smithi062 ceph-mon[44211]: osdmap e839: 12 total, 11 up, 9 in 2024-04-01T20:04:28.999 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:28 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3968205657' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["3"]}]: dispatch 2024-04-01T20:04:29.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:28 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:04:29.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:28 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:04:29.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:28 smithi188 ceph-mon[43939]: osdmap e839: 12 total, 11 up, 9 in 2024-04-01T20:04:29.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:28 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3968205657' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["3"]}]: dispatch 2024-04-01T20:04:29.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:29 smithi062 ceph-mon[44211]: pgmap v2268: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:29.888 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset noscrub 2024-04-01T20:04:29.922 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:29 smithi022 ceph-mon[39439]: pgmap v2268: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:30.082 INFO:teuthology.orchestra.run.smithi022.stderr:Creating an OSD daemon form without an OSD FSID value 2024-04-01T20:04:30.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:29 smithi188 ceph-mon[43939]: pgmap v2268: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:30.313 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T20:04:30.313 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:04:30.650 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:04:31.080 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_blocked_ops 2024-04-01T20:04:31.359 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T20:04:32.550 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:32 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:04:32.551 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:32 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:04:32.551 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:32 smithi062 ceph-mon[44211]: osdmap e840: 12 total, 11 up, 9 in 2024-04-01T20:04:32.551 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:32 smithi062 ceph-mon[44211]: pgmap v2270: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:32.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:32 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:04:32.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:32 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:04:32.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:32 smithi022 ceph-mon[39439]: osdmap e840: 12 total, 11 up, 9 in 2024-04-01T20:04:32.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:32 smithi022 ceph-mon[39439]: pgmap v2270: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:32 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:04:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:32 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:04:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:32 smithi188 ceph-mon[43939]: osdmap e840: 12 total, 11 up, 9 in 2024-04-01T20:04:32.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:32 smithi188 ceph-mon[43939]: pgmap v2270: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:33.186 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T20:04:33.186 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:04:33.834 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:33 smithi062 ceph-mon[44211]: pgmap v2271: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:33.835 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.5 dump_historic_ops 2024-04-01T20:04:33.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:33 smithi022 ceph-mon[39439]: pgmap v2271: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:33.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:33 smithi188 ceph-mon[43939]: pgmap v2271: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T20:04:34.569 INFO:teuthology.orchestra.run.smithi022.stderr:noscrub is unset 2024-04-01T20:04:34.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:34 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/826908153' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:04:34.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:34 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/826908153' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:04:34.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:34 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/826908153' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noscrub"}]: dispatch 2024-04-01T20:04:35.379 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd unset nodeep-scrub 2024-04-01T20:04:35.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:35 smithi022 ceph-mon[39439]: Health check cleared: OSDMAP_FLAGS (was: noscrub flag(s) set) 2024-04-01T20:04:35.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:35 smithi022 ceph-mon[39439]: Cluster is now healthy 2024-04-01T20:04:35.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:35 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/826908153' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T20:04:35.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:35 smithi022 ceph-mon[39439]: osdmap e841: 12 total, 11 up, 9 in 2024-04-01T20:04:35.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:35 smithi022 ceph-mon[39439]: pgmap v2273: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:35.647 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:35 smithi062 ceph-mon[44211]: Health check cleared: OSDMAP_FLAGS (was: noscrub flag(s) set) 2024-04-01T20:04:35.647 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:35 smithi062 ceph-mon[44211]: Cluster is now healthy 2024-04-01T20:04:35.647 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:35 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/826908153' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T20:04:35.647 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:35 smithi062 ceph-mon[44211]: osdmap e841: 12 total, 11 up, 9 in 2024-04-01T20:04:35.647 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:35 smithi062 ceph-mon[44211]: pgmap v2273: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:35.751 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:04:35.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:35 smithi188 ceph-mon[43939]: Health check cleared: OSDMAP_FLAGS (was: noscrub flag(s) set) 2024-04-01T20:04:35.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:35 smithi188 ceph-mon[43939]: Cluster is now healthy 2024-04-01T20:04:35.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:35 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/826908153' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noscrub"}]': finished 2024-04-01T20:04:35.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:35 smithi188 ceph-mon[43939]: osdmap e841: 12 total, 11 up, 9 in 2024-04-01T20:04:35.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:35 smithi188 ceph-mon[43939]: pgmap v2273: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:35.906 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T20:04:35.906 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:04:36.647 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_ops_in_flight 2024-04-01T20:04:36.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:36 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:04:36.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:36 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:04:37.009 INFO:teuthology.orchestra.run.smithi022.stdout:9.c 2024-04-01T20:04:37.010 INFO:teuthology.orchestra.run.smithi022.stdout:9.7 2024-04-01T20:04:37.010 INFO:teuthology.orchestra.run.smithi022.stdout:9.1 2024-04-01T20:04:37.010 INFO:teuthology.orchestra.run.smithi022.stdout:9.3 2024-04-01T20:04:37.011 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:36 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:04:37.473 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T20:04:38.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:38 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:04:38.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:38 smithi022 ceph-mon[39439]: pgmap v2274: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:38.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:38 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:04:38.688 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:38 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:04:38.688 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:38 smithi062 ceph-mon[44211]: pgmap v2274: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:38.688 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:38 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:04:38.725 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -n osd.3 --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-3 --journal-path /var/lib/ceph/osd/ceph-3/journal --op export --pgid 9.7 --file /var/log/ceph/exp.9.7.3 2024-04-01T20:04:38.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:38 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:04:38.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:38 smithi188 ceph-mon[43939]: pgmap v2274: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:38.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:38 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:04:38.942 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/osd.3/config 2024-04-01T20:04:39.311 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T20:04:39.311 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:04:39.493 INFO:teuthology.orchestra.run.smithi022.stderr:nodeep-scrub is unset 2024-04-01T20:04:39.731 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:39 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1209014695' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:04:39.731 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:39 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:04:39.731 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:39 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:04:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:39 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1209014695' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:04:39.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:39 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:04:39.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:39 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:04:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:39 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1209014695' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "nodeep-scrub"}]: dispatch 2024-04-01T20:04:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:39 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:04:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:39 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:04:40.129 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_blocked_ops 2024-04-01T20:04:40.403 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T20:04:40.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:40 smithi022 ceph-mon[39439]: pgmap v2275: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:40.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:40 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1209014695' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T20:04:40.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:40 smithi022 ceph-mon[39439]: osdmap e842: 12 total, 11 up, 9 in 2024-04-01T20:04:40.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:40 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:04:40.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:40 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:04:40.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:40 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:04:40.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:40 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:04:40.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:40 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:04:40.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:40 smithi062 ceph-mon[44211]: pgmap v2275: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:40.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:40 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1209014695' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T20:04:40.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:40 smithi062 ceph-mon[44211]: osdmap e842: 12 total, 11 up, 9 in 2024-04-01T20:04:40.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:40 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:04:40.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:40 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:04:40.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:40 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:04:40.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:40 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:04:40.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:40 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:04:40.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:40 smithi188 ceph-mon[43939]: pgmap v2275: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:40.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:40 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1209014695' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "nodeep-scrub"}]': finished 2024-04-01T20:04:40.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:40 smithi188 ceph-mon[43939]: osdmap e842: 12 total, 11 up, 9 in 2024-04-01T20:04:40.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:40 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:04:40.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:40 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:04:40.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:40 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:04:40.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:40 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:04:40.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:40 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:04:41.016 INFO:teuthology.orchestra.run.smithi022.stderr:Creating an OSD daemon form without an OSD FSID value 2024-04-01T20:04:41.612 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:41 smithi062 ceph-mon[44211]: osdmap e843: 12 total, 11 up, 9 in 2024-04-01T20:04:41.772 INFO:teuthology.orchestra.run.smithi022.stderr:Exporting 9.7 info 9.7( v 794'12516 (744'2500,794'12516] lb MIN local-lis/les=777/778 n=6948 ec=735/735 lis/c=777/777 les/c/f=778/794/0 sis=795 pruub=10.058040619s) 2024-04-01T20:04:41.843 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e81cd023:::benchmark_data_smithi188_173515_object69857:head# 2024-04-01T20:04:41.843 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e81ce25d:::benchmark_data_smithi188_173515_object133656:head# 2024-04-01T20:04:41.843 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e81e2124:::benchmark_data_smithi188_173515_object118168:head# 2024-04-01T20:04:41.843 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e81ea9c4:::benchmark_data_smithi188_173515_object152434:head# 2024-04-01T20:04:41.843 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e81f2df8:::benchmark_data_smithi188_173515_object46630:head# 2024-04-01T20:04:41.843 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8208d4e:::benchmark_data_smithi188_173515_object127423:head# 2024-04-01T20:04:41.843 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e820b478:::benchmark_data_smithi188_173515_object156005:head# 2024-04-01T20:04:41.843 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e821153e:::benchmark_data_smithi188_173515_object155315:head# 2024-04-01T20:04:41.843 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e821fdc1:::benchmark_data_smithi188_173515_object91577:head# 2024-04-01T20:04:41.843 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8228073:::benchmark_data_smithi188_173515_object129916:head# 2024-04-01T20:04:41.844 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e82338e9:::benchmark_data_smithi188_173515_object53231:head# 2024-04-01T20:04:41.845 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8241ad4:::benchmark_data_smithi188_173515_object51163:head# 2024-04-01T20:04:41.845 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8245e69:::benchmark_data_smithi188_173515_object46869:head# 2024-04-01T20:04:41.845 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e824acc4:::benchmark_data_smithi188_173515_object141174:head# 2024-04-01T20:04:41.845 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e825912f:::benchmark_data_smithi188_173515_object51661:head# 2024-04-01T20:04:41.856 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e82646eb:::benchmark_data_smithi188_173515_object84776:head# 2024-04-01T20:04:41.857 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e82728e1:::benchmark_data_smithi188_173515_object53405:head# 2024-04-01T20:04:41.857 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8272af6:::benchmark_data_smithi188_173515_object137424:head# 2024-04-01T20:04:41.857 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8275052:::benchmark_data_smithi188_173515_object53172:head# 2024-04-01T20:04:41.857 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8282417:::benchmark_data_smithi188_173515_object47809:head# 2024-04-01T20:04:41.857 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e828ba0b:::benchmark_data_smithi188_173515_object65249:head# 2024-04-01T20:04:41.857 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e828fa62:::benchmark_data_smithi188_173515_object110285:head# 2024-04-01T20:04:41.857 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8298b52:::benchmark_data_smithi188_173515_object118818:head# 2024-04-01T20:04:41.857 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e82a418f:::benchmark_data_smithi188_173515_object155526:head# 2024-04-01T20:04:41.857 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e82b4acf:::benchmark_data_smithi188_173515_object89419:head# 2024-04-01T20:04:41.857 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e82bc72f:::benchmark_data_smithi188_173515_object99950:head# 2024-04-01T20:04:41.857 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e82c57a8:::benchmark_data_smithi188_173515_object138933:head# 2024-04-01T20:04:41.857 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e82c83cc:::benchmark_data_smithi188_173515_object124867:head# 2024-04-01T20:04:41.857 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e82c9744:::benchmark_data_smithi188_173515_object151101:head# 2024-04-01T20:04:41.857 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e82d63a7:::benchmark_data_smithi188_173515_object155030:head# 2024-04-01T20:04:41.858 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e82e6d48:::benchmark_data_smithi188_173515_object140039:head# 2024-04-01T20:04:41.858 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e82f17b5:::benchmark_data_smithi188_173515_object46509:head# 2024-04-01T20:04:41.858 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e82fe115:::benchmark_data_smithi188_173515_object109221:head# 2024-04-01T20:04:41.858 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8305f07:::benchmark_data_smithi188_173515_object117240:head# 2024-04-01T20:04:41.858 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e830b605:::benchmark_data_smithi188_173515_object128513:head# 2024-04-01T20:04:41.858 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e831f728:::benchmark_data_smithi188_173515_object63187:head# 2024-04-01T20:04:41.858 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e833330c:::benchmark_data_smithi188_173515_object90389:head# 2024-04-01T20:04:41.858 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e833489c:::benchmark_data_smithi188_173515_object92610:head# 2024-04-01T20:04:41.858 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e83535ed:::benchmark_data_smithi188_173515_object111762:head# 2024-04-01T20:04:41.858 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8354c78:::benchmark_data_smithi188_173515_object92569:head# 2024-04-01T20:04:41.858 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e835eab4:::benchmark_data_smithi188_173515_object62593:head# 2024-04-01T20:04:41.858 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e836e2e1:::benchmark_data_smithi188_173515_object143715:head# 2024-04-01T20:04:41.858 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8372d7c:::benchmark_data_smithi188_173515_object144847:head# 2024-04-01T20:04:41.859 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e83777e1:::benchmark_data_smithi188_173515_object68936:head# 2024-04-01T20:04:41.859 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e838892d:::benchmark_data_smithi188_173515_object116638:head# 2024-04-01T20:04:41.859 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e838c91a:::benchmark_data_smithi188_173515_object77124:head# 2024-04-01T20:04:41.859 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e839458c:::benchmark_data_smithi188_173515_object154010:head# 2024-04-01T20:04:41.859 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e839550c:::benchmark_data_smithi188_173515_object63329:head# 2024-04-01T20:04:41.859 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e839ecb6:::benchmark_data_smithi188_173515_object122573:head# 2024-04-01T20:04:41.859 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e83a9f33:::benchmark_data_smithi188_173515_object66888:head# 2024-04-01T20:04:41.859 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e83b79d2:::benchmark_data_smithi188_173515_object118884:head# 2024-04-01T20:04:41.859 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e83b847d:::benchmark_data_smithi188_173515_object87899:head# 2024-04-01T20:04:41.859 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e83c7d89:::benchmark_data_smithi188_173515_object86654:head# 2024-04-01T20:04:41.859 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e83d7a5a:::benchmark_data_smithi188_173515_object46511:head# 2024-04-01T20:04:41.859 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e83d824e:::benchmark_data_smithi188_173515_object136959:head# 2024-04-01T20:04:41.859 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e83d9cf1:::benchmark_data_smithi188_173515_object132037:head# 2024-04-01T20:04:41.859 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e83dc310:::benchmark_data_smithi188_173515_object118147:head# 2024-04-01T20:04:41.859 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e83e1811:::benchmark_data_smithi188_173515_object90048:head# 2024-04-01T20:04:41.860 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e83ea58d:::benchmark_data_smithi188_173515_object57180:head# 2024-04-01T20:04:41.860 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e83f66fb:::benchmark_data_smithi188_173515_object81812:head# 2024-04-01T20:04:41.860 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e83f6d6e:::benchmark_data_smithi188_173515_object148417:head# 2024-04-01T20:04:41.860 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e83f99b4:::benchmark_data_smithi188_173515_object80706:head# 2024-04-01T20:04:41.860 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e83fbc6c:::benchmark_data_smithi188_173515_object115790:head# 2024-04-01T20:04:41.860 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e83fbcbe:::benchmark_data_smithi188_173515_object78062:head# 2024-04-01T20:04:41.860 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8402193:::benchmark_data_smithi188_173515_object120473:head# 2024-04-01T20:04:41.860 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8408770:::benchmark_data_smithi188_173515_object140438:head# 2024-04-01T20:04:41.860 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8414249:::benchmark_data_smithi188_173515_object50708:head# 2024-04-01T20:04:41.860 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8416ee2:::benchmark_data_smithi188_173515_object118615:head# 2024-04-01T20:04:41.860 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e841aa18:::benchmark_data_smithi188_173515_object76351:head# 2024-04-01T20:04:41.860 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e841b314:::benchmark_data_smithi188_173515_object56710:head# 2024-04-01T20:04:41.860 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e841ecac:::benchmark_data_smithi188_173515_object48040:head# 2024-04-01T20:04:41.861 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e841f822:::benchmark_data_smithi188_173515_object114519:head# 2024-04-01T20:04:41.861 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e842b9c4:::benchmark_data_smithi188_173515_object59147:head# 2024-04-01T20:04:41.861 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e843bfa1:::benchmark_data_smithi188_173515_object127419:head# 2024-04-01T20:04:41.861 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e843dfb7:::benchmark_data_smithi188_173515_object115979:head# 2024-04-01T20:04:41.861 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e84403f5:::benchmark_data_smithi188_173515_object93639:head# 2024-04-01T20:04:41.861 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e844c539:::benchmark_data_smithi188_173515_object97742:head# 2024-04-01T20:04:41.861 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e844d3a3:::benchmark_data_smithi188_173515_object148134:head# 2024-04-01T20:04:41.861 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e84554af:::benchmark_data_smithi188_173515_object154798:head# 2024-04-01T20:04:41.861 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e845e393:::benchmark_data_smithi188_173515_object138863:head# 2024-04-01T20:04:41.861 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e846200e:::benchmark_data_smithi188_173515_object106065:head# 2024-04-01T20:04:41.861 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e84633b8:::benchmark_data_smithi188_173515_object132356:head# 2024-04-01T20:04:41.861 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8479e9c:::benchmark_data_smithi188_173515_object140430:head# 2024-04-01T20:04:41.862 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e847d248:::benchmark_data_smithi188_173515_object141271:head# 2024-04-01T20:04:41.862 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e849a07b:::benchmark_data_smithi188_173515_object53066:head# 2024-04-01T20:04:41.862 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e849d983:::benchmark_data_smithi188_173515_object129934:head# 2024-04-01T20:04:41.862 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e84a09cc:::benchmark_data_smithi188_173515_object69518:head# 2024-04-01T20:04:41.865 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e84af557:::benchmark_data_smithi188_173515_object77355:head# 2024-04-01T20:04:41.865 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e84bee75:::benchmark_data_smithi188_173515_object57246:head# 2024-04-01T20:04:41.865 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e84bf397:::benchmark_data_smithi188_173515_object66227:head# 2024-04-01T20:04:41.865 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e84e4260:::benchmark_data_smithi188_173515_object48782:head# 2024-04-01T20:04:41.865 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e84f7cde:::benchmark_data_smithi188_173515_object65067:head# 2024-04-01T20:04:41.865 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8500e62:::benchmark_data_smithi188_173515_object55638:head# 2024-04-01T20:04:41.865 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8502b8c:::benchmark_data_smithi188_173515_object149692:head# 2024-04-01T20:04:41.865 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e85066ad:::benchmark_data_smithi188_173515_object51247:head# 2024-04-01T20:04:41.866 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e850934f:::benchmark_data_smithi188_173515_object82942:head# 2024-04-01T20:04:41.866 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e851e64a:::benchmark_data_smithi188_173515_object75061:head# 2024-04-01T20:04:41.866 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8523fd9:::benchmark_data_smithi188_173515_object134639:head# 2024-04-01T20:04:41.866 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e852df2d:::benchmark_data_smithi188_173515_object50482:head# 2024-04-01T20:04:41.866 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e853efaf:::benchmark_data_smithi188_173515_object146527:head# 2024-04-01T20:04:41.866 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8558a34:::benchmark_data_smithi188_173515_object49662:head# 2024-04-01T20:04:41.866 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8568f85:::benchmark_data_smithi188_173515_object76750:head# 2024-04-01T20:04:41.866 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e856958d:::benchmark_data_smithi188_173515_object86500:head# 2024-04-01T20:04:41.866 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e856bec5:::benchmark_data_smithi188_173515_object151580:head# 2024-04-01T20:04:41.866 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8572d8f:::benchmark_data_smithi188_173515_object108774:head# 2024-04-01T20:04:41.866 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e85802dc:::benchmark_data_smithi188_173515_object111469:head# 2024-04-01T20:04:41.866 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e85b16c5:::benchmark_data_smithi188_173515_object123132:head# 2024-04-01T20:04:41.866 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e85b29ff:::benchmark_data_smithi188_173515_object76340:head# 2024-04-01T20:04:41.867 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e85c0fd3:::benchmark_data_smithi188_173515_object147313:head# 2024-04-01T20:04:41.867 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e85c1233:::benchmark_data_smithi188_173515_object155287:head# 2024-04-01T20:04:41.867 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e85ca5b4:::benchmark_data_smithi188_173515_object150541:head# 2024-04-01T20:04:41.867 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e85cd94e:::benchmark_data_smithi188_173515_object75803:head# 2024-04-01T20:04:41.867 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e85d1d59:::benchmark_data_smithi188_173515_object143098:head# 2024-04-01T20:04:41.867 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e85e0474:::benchmark_data_smithi188_173515_object75872:head# 2024-04-01T20:04:41.867 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e85e5c28:::benchmark_data_smithi188_173515_object79128:head# 2024-04-01T20:04:41.867 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e85e7ac3:::benchmark_data_smithi188_173515_object120112:head# 2024-04-01T20:04:41.867 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e85eb326:::benchmark_data_smithi188_173515_object88045:head# 2024-04-01T20:04:41.867 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:41 smithi022 ceph-mon[39439]: osdmap e843: 12 total, 11 up, 9 in 2024-04-01T20:04:41.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e85fc5f2:::benchmark_data_smithi188_173515_object46853:head# 2024-04-01T20:04:41.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e860ec8f:::benchmark_data_smithi188_173515_object149028:head# 2024-04-01T20:04:41.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e86153f7:::benchmark_data_smithi188_173515_object56026:head# 2024-04-01T20:04:41.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e861864f:::benchmark_data_smithi188_173515_object108238:head# 2024-04-01T20:04:41.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e863b746:::benchmark_data_smithi188_173515_object145173:head# 2024-04-01T20:04:41.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e863c3c3:::benchmark_data_smithi188_173515_object92241:head# 2024-04-01T20:04:41.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8646787:::benchmark_data_smithi188_173515_object48407:head# 2024-04-01T20:04:41.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e864c0e2:::benchmark_data_smithi188_173515_object127642:head# 2024-04-01T20:04:41.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e865308f:::benchmark_data_smithi188_173515_object119554:head# 2024-04-01T20:04:41.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e86569da:::benchmark_data_smithi188_173515_object63179:head# 2024-04-01T20:04:41.872 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8657b32:::benchmark_data_smithi188_173515_object77425:head# 2024-04-01T20:04:41.873 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e866e684:::benchmark_data_smithi188_173515_object113576:head# 2024-04-01T20:04:41.873 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8688117:::benchmark_data_smithi188_173515_object115255:head# 2024-04-01T20:04:41.873 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e868d4d8:::benchmark_data_smithi188_173515_object75189:head# 2024-04-01T20:04:41.873 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e86aec1c:::benchmark_data_smithi188_173515_object87514:head# 2024-04-01T20:04:41.873 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e86bb063:::benchmark_data_smithi188_173515_object126625:head# 2024-04-01T20:04:41.873 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e86bc1c0:::benchmark_data_smithi188_173515_object96399:head# 2024-04-01T20:04:41.873 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e86c18df:::benchmark_data_smithi188_173515_object83116:head# 2024-04-01T20:04:41.873 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e86eaed2:::benchmark_data_smithi188_173515_object147295:head# 2024-04-01T20:04:41.873 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e86f95fa:::benchmark_data_smithi188_173515_object69574:head# 2024-04-01T20:04:41.873 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e86fcc24:::benchmark_data_smithi188_173515_object91621:head# 2024-04-01T20:04:41.873 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8701a3b:::benchmark_data_smithi188_173515_object80321:head# 2024-04-01T20:04:41.873 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e870f7e5:::benchmark_data_smithi188_173515_object52371:head# 2024-04-01T20:04:41.873 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e871a5b4:::benchmark_data_smithi188_173515_object128630:head# 2024-04-01T20:04:41.873 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8728d9d:::benchmark_data_smithi188_173515_object118034:head# 2024-04-01T20:04:41.873 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e872c48e:::benchmark_data_smithi188_173515_object107387:head# 2024-04-01T20:04:41.874 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8751664:::benchmark_data_smithi188_173515_object76360:head# 2024-04-01T20:04:41.874 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e879d75e:::benchmark_data_smithi188_173515_object141587:head# 2024-04-01T20:04:41.874 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e87a178d:::benchmark_data_smithi188_173515_object151102:head# 2024-04-01T20:04:41.874 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e87a21aa:::benchmark_data_smithi188_173515_object68327:head# 2024-04-01T20:04:41.874 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e87a4f94:::benchmark_data_smithi188_173515_object109554:head# 2024-04-01T20:04:41.874 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e87b12af:::benchmark_data_smithi188_173515_object72099:head# 2024-04-01T20:04:41.874 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e87c5e0e:::benchmark_data_smithi188_173515_object109242:head# 2024-04-01T20:04:41.874 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e87c6157:::benchmark_data_smithi188_173515_object53474:head# 2024-04-01T20:04:41.874 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e87ce06a:::benchmark_data_smithi188_173515_object121672:head# 2024-04-01T20:04:41.874 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e87d915e:::benchmark_data_smithi188_173515_object96832:head# 2024-04-01T20:04:41.874 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e87daf3a:::benchmark_data_smithi188_173515_object131591:head# 2024-04-01T20:04:41.874 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e87ec3ac:::benchmark_data_smithi188_173515_object113990:head# 2024-04-01T20:04:41.874 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e87ed3d2:::benchmark_data_smithi188_173515_object100687:head# 2024-04-01T20:04:41.875 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e87ff2ff:::benchmark_data_smithi188_173515_object108495:head# 2024-04-01T20:04:41.875 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e881230a:::benchmark_data_smithi188_173515_object114105:head# 2024-04-01T20:04:41.875 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8820760:::benchmark_data_smithi188_173515_object145602:head# 2024-04-01T20:04:41.875 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8823b66:::benchmark_data_smithi188_173515_object72134:head# 2024-04-01T20:04:41.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:41 smithi188 ceph-mon[43939]: osdmap e843: 12 total, 11 up, 9 in 2024-04-01T20:04:41.879 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e882cc4a:::benchmark_data_smithi188_173515_object72054:head# 2024-04-01T20:04:41.879 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8836446:::benchmark_data_smithi188_173515_object59956:head# 2024-04-01T20:04:41.879 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e884e914:::benchmark_data_smithi188_173515_object90748:head# 2024-04-01T20:04:41.879 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e885d18f:::benchmark_data_smithi188_173515_object81410:head# 2024-04-01T20:04:41.879 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8868827:::benchmark_data_smithi188_173515_object102699:head# 2024-04-01T20:04:41.879 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e886a1d8:::benchmark_data_smithi188_173515_object129317:head# 2024-04-01T20:04:41.879 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e887b852:::benchmark_data_smithi188_173515_object49486:head# 2024-04-01T20:04:41.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e887dd46:::benchmark_data_smithi188_173515_object115862:head# 2024-04-01T20:04:41.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e888aa44:::benchmark_data_smithi188_173515_object147266:head# 2024-04-01T20:04:41.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e88d0aa6:::benchmark_data_smithi188_173515_object152990:head# 2024-04-01T20:04:41.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e88d10b2:::benchmark_data_smithi188_173515_object80118:head# 2024-04-01T20:04:41.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e88d1fb3:::benchmark_data_smithi188_173515_object152841:head# 2024-04-01T20:04:41.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e88f0a29:::benchmark_data_smithi188_173515_object153241:head# 2024-04-01T20:04:41.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e88f5f3c:::benchmark_data_smithi188_173515_object121474:head# 2024-04-01T20:04:41.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e88f6d93:::benchmark_data_smithi188_173515_object50184:head# 2024-04-01T20:04:41.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e88f88eb:::benchmark_data_smithi188_173515_object81851:head# 2024-04-01T20:04:41.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e88f9843:::benchmark_data_smithi188_173515_object59119:head# 2024-04-01T20:04:41.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e88ff2e3:::benchmark_data_smithi188_173515_object107825:head# 2024-04-01T20:04:41.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e89130d4:::benchmark_data_smithi188_173515_object76037:head# 2024-04-01T20:04:41.880 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8930298:::benchmark_data_smithi188_173515_object122960:head# 2024-04-01T20:04:41.881 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8933e28:::benchmark_data_smithi188_173515_object126248:head# 2024-04-01T20:04:41.881 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8941fdf:::benchmark_data_smithi188_173515_object98836:head# 2024-04-01T20:04:41.881 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e89496ae:::benchmark_data_smithi188_173515_object144807:head# 2024-04-01T20:04:41.881 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e89499a5:::benchmark_data_smithi188_173515_object65292:head# 2024-04-01T20:04:41.881 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8949cfc:::benchmark_data_smithi188_173515_object128151:head# 2024-04-01T20:04:41.881 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e895e5df:::benchmark_data_smithi188_173515_object58940:head# 2024-04-01T20:04:41.881 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8970564:::benchmark_data_smithi188_173515_object120355:head# 2024-04-01T20:04:41.881 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e897e5f6:::benchmark_data_smithi188_173515_object77382:head# 2024-04-01T20:04:41.881 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e89853c3:::benchmark_data_smithi188_173515_object64989:head# 2024-04-01T20:04:41.881 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e898655a:::benchmark_data_smithi188_173515_object69449:head# 2024-04-01T20:04:41.881 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8996f6f:::benchmark_data_smithi188_173515_object76142:head# 2024-04-01T20:04:41.881 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e89b3607:::benchmark_data_smithi188_173515_object105616:head# 2024-04-01T20:04:41.883 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e89b3f0c:::benchmark_data_smithi188_173515_object68897:head# 2024-04-01T20:04:41.884 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e89c3678:::benchmark_data_smithi188_173515_object139716:head# 2024-04-01T20:04:41.884 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e89cddb5:::benchmark_data_smithi188_173515_object59487:head# 2024-04-01T20:04:41.884 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e89d628f:::benchmark_data_smithi188_173515_object52976:head# 2024-04-01T20:04:41.884 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e89db68d:::benchmark_data_smithi188_173515_object45646:head# 2024-04-01T20:04:41.884 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e89ecdbe:::benchmark_data_smithi188_173515_object82920:head# 2024-04-01T20:04:41.884 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e89ee64b:::benchmark_data_smithi188_173515_object67888:head# 2024-04-01T20:04:41.884 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e89fb5eb:::benchmark_data_smithi188_173515_object79334:head# 2024-04-01T20:04:41.884 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e89fe87a:::benchmark_data_smithi188_173515_object63114:head# 2024-04-01T20:04:41.884 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8a04387:::benchmark_data_smithi188_173515_object136980:head# 2024-04-01T20:04:41.884 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8a0b6f8:::benchmark_data_smithi188_173515_object132448:head# 2024-04-01T20:04:41.884 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8a16efe:::benchmark_data_smithi188_173515_object75720:head# 2024-04-01T20:04:41.884 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8a17b08:::benchmark_data_smithi188_173515_object98145:head# 2024-04-01T20:04:41.884 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8a1d58b:::benchmark_data_smithi188_173515_object127481:head# 2024-04-01T20:04:41.884 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8a2d694:::benchmark_data_smithi188_173515_object142970:head# 2024-04-01T20:04:41.885 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8a34c11:::benchmark_data_smithi188_173515_object143843:head# 2024-04-01T20:04:41.885 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8a3d656:::benchmark_data_smithi188_173515_object78312:head# 2024-04-01T20:04:41.885 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8a72f05:::benchmark_data_smithi188_173515_object112712:head# 2024-04-01T20:04:41.885 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8a7d00b:::benchmark_data_smithi188_173515_object94888:head# 2024-04-01T20:04:41.886 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8a7e39d:::benchmark_data_smithi188_173515_object94921:head# 2024-04-01T20:04:41.886 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8a9a77a:::benchmark_data_smithi188_173515_object147821:head# 2024-04-01T20:04:41.886 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8ab504b:::benchmark_data_smithi188_173515_object116349:head# 2024-04-01T20:04:41.886 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8ad3d01:::benchmark_data_smithi188_173515_object63358:head# 2024-04-01T20:04:41.886 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8ad48b8:::benchmark_data_smithi188_173515_object132812:head# 2024-04-01T20:04:41.886 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8ad8e17:::benchmark_data_smithi188_173515_object65406:head# 2024-04-01T20:04:41.887 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8adaf29:::benchmark_data_smithi188_173515_object120640:head# 2024-04-01T20:04:41.887 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8ae4815:::benchmark_data_smithi188_173515_object73662:head# 2024-04-01T20:04:41.887 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8ae6636:::benchmark_data_smithi188_173515_object125663:head# 2024-04-01T20:04:41.887 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8ae7892:::benchmark_data_smithi188_173515_object66586:head# 2024-04-01T20:04:41.887 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8ae85e4:::benchmark_data_smithi188_173515_object86979:head# 2024-04-01T20:04:41.888 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8b13890:::benchmark_data_smithi188_173515_object76108:head# 2024-04-01T20:04:41.888 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8b1d4eb:::benchmark_data_smithi188_173515_object129532:head# 2024-04-01T20:04:41.888 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8b22864:::benchmark_data_smithi188_173515_object82176:head# 2024-04-01T20:04:41.888 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8b3e572:::benchmark_data_smithi188_173515_object86969:head# 2024-04-01T20:04:41.888 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8b4d01d:::benchmark_data_smithi188_173515_object123593:head# 2024-04-01T20:04:41.888 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8b54d9c:::benchmark_data_smithi188_173515_object77580:head# 2024-04-01T20:04:41.889 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8b589d4:::benchmark_data_smithi188_173515_object54559:head# 2024-04-01T20:04:41.889 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8b6509e:::benchmark_data_smithi188_173515_object100283:head# 2024-04-01T20:04:41.889 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8b68c31:::benchmark_data_smithi188_173515_object48057:head# 2024-04-01T20:04:41.890 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8b6a2a8:::benchmark_data_smithi188_173515_object111498:head# 2024-04-01T20:04:41.890 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8b6b9a4:::benchmark_data_smithi188_173515_object86272:head# 2024-04-01T20:04:41.890 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8b6f76f:::benchmark_data_smithi188_173515_object147239:head# 2024-04-01T20:04:41.890 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8b78352:::benchmark_data_smithi188_173515_object65792:head# 2024-04-01T20:04:41.890 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8b7d531:::benchmark_data_smithi188_173515_object105723:head# 2024-04-01T20:04:41.890 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8b94629:::benchmark_data_smithi188_173515_object76905:head# 2024-04-01T20:04:41.890 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8b9562b:::benchmark_data_smithi188_173515_object114446:head# 2024-04-01T20:04:41.896 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8b99e81:::benchmark_data_smithi188_173515_object77183:head# 2024-04-01T20:04:41.896 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8bb20ae:::benchmark_data_smithi188_173515_object72619:head# 2024-04-01T20:04:41.896 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8bba525:::benchmark_data_smithi188_173515_object67909:head# 2024-04-01T20:04:41.896 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8bc2a1e:::benchmark_data_smithi188_173515_object130756:head# 2024-04-01T20:04:41.896 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8bdff59:::benchmark_data_smithi188_173515_object71001:head# 2024-04-01T20:04:41.896 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8be0ece:::benchmark_data_smithi188_173515_object112170:head# 2024-04-01T20:04:41.896 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8be787e:::benchmark_data_smithi188_173515_object82142:head# 2024-04-01T20:04:41.896 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8befa87:::benchmark_data_smithi188_173515_object86591:head# 2024-04-01T20:04:41.896 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8c0035f:::benchmark_data_smithi188_173515_object73913:head# 2024-04-01T20:04:41.896 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8c30e1f:::benchmark_data_smithi188_173515_object115561:head# 2024-04-01T20:04:41.896 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8c367f4:::benchmark_data_smithi188_173515_object130876:head# 2024-04-01T20:04:41.896 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8c44244:::benchmark_data_smithi188_173515_object94745:head# 2024-04-01T20:04:41.897 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8c57dee:::benchmark_data_smithi188_173515_object54862:head# 2024-04-01T20:04:41.897 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8c83573:::benchmark_data_smithi188_173515_object124416:head# 2024-04-01T20:04:41.897 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8c8440f:::benchmark_data_smithi188_173515_object117557:head# 2024-04-01T20:04:41.897 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8c88f02:::benchmark_data_smithi188_173515_object80391:head# 2024-04-01T20:04:41.897 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8c98adf:::benchmark_data_smithi188_173515_object126624:head# 2024-04-01T20:04:41.897 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8c9c98c:::benchmark_data_smithi188_173515_object61354:head# 2024-04-01T20:04:41.897 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8ca1da9:::benchmark_data_smithi188_173515_object98529:head# 2024-04-01T20:04:41.897 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8cb9cea:::benchmark_data_smithi188_173515_object48483:head# 2024-04-01T20:04:41.897 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8cd16f9:::benchmark_data_smithi188_173515_object139812:head# 2024-04-01T20:04:41.897 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8cd958a:::benchmark_data_smithi188_173515_object90559:head# 2024-04-01T20:04:41.897 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8ceba58:::benchmark_data_smithi188_173515_object96185:head# 2024-04-01T20:04:41.897 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8cec613:::benchmark_data_smithi188_173515_object93101:head# 2024-04-01T20:04:41.897 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8cf28bc:::benchmark_data_smithi188_173515_object60215:head# 2024-04-01T20:04:41.897 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8cf2dc7:::benchmark_data_smithi188_173515_object102115:head# 2024-04-01T20:04:41.898 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8cfca88:::benchmark_data_smithi188_173515_object117877:head# 2024-04-01T20:04:41.898 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8cfd57c:::benchmark_data_smithi188_173515_object151410:head# 2024-04-01T20:04:41.898 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8d0c286:::benchmark_data_smithi188_173515_object78360:head# 2024-04-01T20:04:41.898 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8d0d898:::benchmark_data_smithi188_173515_object84427:head# 2024-04-01T20:04:41.898 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8d159d3:::benchmark_data_smithi188_173515_object119585:head# 2024-04-01T20:04:41.898 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8d2d0f2:::benchmark_data_smithi188_173515_object104639:head# 2024-04-01T20:04:41.898 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8d61841:::benchmark_data_smithi188_173515_object127283:head# 2024-04-01T20:04:41.901 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8d61bb3:::benchmark_data_smithi188_173515_object91776:head# 2024-04-01T20:04:41.901 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8d6bc18:::benchmark_data_smithi188_173515_object49328:head# 2024-04-01T20:04:41.901 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8d7aab7:::benchmark_data_smithi188_173515_object144065:head# 2024-04-01T20:04:41.901 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8d93d01:::benchmark_data_smithi188_173515_object128229:head# 2024-04-01T20:04:41.901 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8d9a8b9:::benchmark_data_smithi188_173515_object152552:head# 2024-04-01T20:04:41.901 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8dad877:::benchmark_data_smithi188_173515_object85347:head# 2024-04-01T20:04:41.901 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8dc7d99:::benchmark_data_smithi188_173515_object125955:head# 2024-04-01T20:04:41.901 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8dcab32:::benchmark_data_smithi188_173515_object120820:head# 2024-04-01T20:04:41.902 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8de0d59:::benchmark_data_smithi188_173515_object61980:head# 2024-04-01T20:04:41.902 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8df0266:::benchmark_data_smithi188_173515_object144025:head# 2024-04-01T20:04:41.902 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8df8e60:::benchmark_data_smithi188_173515_object65466:head# 2024-04-01T20:04:41.902 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8dfa888:::benchmark_data_smithi188_173515_object127459:head# 2024-04-01T20:04:41.902 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8e074c5:::benchmark_data_smithi188_173515_object84944:head# 2024-04-01T20:04:41.902 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8e21fcf:::benchmark_data_smithi188_173515_object153622:head# 2024-04-01T20:04:41.902 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8e32d7c:::benchmark_data_smithi188_173515_object75138:head# 2024-04-01T20:04:41.902 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8e36d22:::benchmark_data_smithi188_173515_object97667:head# 2024-04-01T20:04:41.902 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8e3a158:::benchmark_data_smithi188_173515_object60750:head# 2024-04-01T20:04:41.902 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8e3e286:::benchmark_data_smithi188_173515_object58651:head# 2024-04-01T20:04:41.902 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8e3ed55:::benchmark_data_smithi188_173515_object128201:head# 2024-04-01T20:04:41.902 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8e409d4:::benchmark_data_smithi188_173515_object55209:head# 2024-04-01T20:04:41.902 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8e56c5f:::benchmark_data_smithi188_173515_object123178:head# 2024-04-01T20:04:41.903 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8e64ab9:::benchmark_data_smithi188_173515_object144447:head# 2024-04-01T20:04:41.903 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8e696a1:::benchmark_data_smithi188_173515_object84310:head# 2024-04-01T20:04:41.903 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8e761d5:::benchmark_data_smithi188_173515_object141459:head# 2024-04-01T20:04:41.903 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8e767df:::benchmark_data_smithi188_173515_object139688:head# 2024-04-01T20:04:41.903 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8e8f81f:::benchmark_data_smithi188_173515_object115171:head# 2024-04-01T20:04:41.903 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8e93757:::benchmark_data_smithi188_173515_object84578:head# 2024-04-01T20:04:41.903 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8ec0126:::benchmark_data_smithi188_173515_object128949:head# 2024-04-01T20:04:41.913 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8ee8de1:::benchmark_data_smithi188_173515_object89689:head# 2024-04-01T20:04:41.913 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8ef6988:::benchmark_data_smithi188_173515_object113879:head# 2024-04-01T20:04:41.913 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8efe2cf:::benchmark_data_smithi188_173515_object136988:head# 2024-04-01T20:04:41.913 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8f0ab8c:::benchmark_data_smithi188_173515_object68247:head# 2024-04-01T20:04:41.913 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8f0b492:::benchmark_data_smithi188_173515_object76116:head# 2024-04-01T20:04:41.914 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8f0cc6a:::benchmark_data_smithi188_173515_object79932:head# 2024-04-01T20:04:41.914 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8f172e4:::benchmark_data_smithi188_173515_object138166:head# 2024-04-01T20:04:41.914 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8f1b4f4:::benchmark_data_smithi188_173515_object120018:head# 2024-04-01T20:04:41.914 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8f29574:::benchmark_data_smithi188_173515_object155226:head# 2024-04-01T20:04:41.914 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8f2b5d4:::benchmark_data_smithi188_173515_object97624:head# 2024-04-01T20:04:41.914 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8f3b84c:::benchmark_data_smithi188_173515_object155225:head# 2024-04-01T20:04:41.914 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8f3c8d7:::benchmark_data_smithi188_173515_object141890:head# 2024-04-01T20:04:41.914 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8f47636:::benchmark_data_smithi188_173515_object71081:head# 2024-04-01T20:04:41.914 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8f4b585:::benchmark_data_smithi188_173515_object105819:head# 2024-04-01T20:04:41.914 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8f8dfb4:::benchmark_data_smithi188_173515_object126818:head# 2024-04-01T20:04:41.914 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8f9c3e8:::benchmark_data_smithi188_173515_object120191:head# 2024-04-01T20:04:41.914 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8fa115a:::benchmark_data_smithi188_173515_object125397:head# 2024-04-01T20:04:41.915 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8fa17c7:::benchmark_data_smithi188_173515_object143416:head# 2024-04-01T20:04:41.915 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8fa99ff:::benchmark_data_smithi188_173515_object66307:head# 2024-04-01T20:04:41.915 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8fa9a1b:::benchmark_data_smithi188_173515_object155321:head# 2024-04-01T20:04:41.915 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8fabab4:::benchmark_data_smithi188_173515_object139872:head# 2024-04-01T20:04:41.915 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8fbc20e:::benchmark_data_smithi188_173515_object81314:head# 2024-04-01T20:04:41.915 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8fc83e9:::benchmark_data_smithi188_173515_object121931:head# 2024-04-01T20:04:41.915 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8fd8114:::benchmark_data_smithi188_173515_object148721:head# 2024-04-01T20:04:41.915 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8fd9ab5:::benchmark_data_smithi188_173515_object80113:head# 2024-04-01T20:04:41.915 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8fe22da:::benchmark_data_smithi188_173515_object140544:head# 2024-04-01T20:04:41.915 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8fe2b92:::benchmark_data_smithi188_173515_object109278:head# 2024-04-01T20:04:41.915 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8ff673f:::benchmark_data_smithi188_173515_object74407:head# 2024-04-01T20:04:41.915 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e8ff93a5:::benchmark_data_smithi188_173515_object139006:head# 2024-04-01T20:04:41.915 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9000046:::benchmark_data_smithi188_173515_object74841:head# 2024-04-01T20:04:41.915 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9011749:::benchmark_data_smithi188_173515_object74499:head# 2024-04-01T20:04:41.915 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e901ceed:::benchmark_data_smithi188_173515_object52783:head# 2024-04-01T20:04:41.916 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9029192:::benchmark_data_smithi188_173515_object48972:head# 2024-04-01T20:04:41.916 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9030516:::benchmark_data_smithi188_173515_object49434:head# 2024-04-01T20:04:41.916 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e903a0be:::benchmark_data_smithi188_173515_object50987:head# 2024-04-01T20:04:41.916 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e903dcfe:::benchmark_data_smithi188_173515_object80341:head# 2024-04-01T20:04:41.916 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9042e23:::benchmark_data_smithi188_173515_object47105:head# 2024-04-01T20:04:41.916 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9049618:::benchmark_data_smithi188_173515_object124599:head# 2024-04-01T20:04:41.916 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e905f26c:::benchmark_data_smithi188_173515_object141920:head# 2024-04-01T20:04:41.916 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e90636bd:::benchmark_data_smithi188_173515_object78340:head# 2024-04-01T20:04:41.916 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e906dcbb:::benchmark_data_smithi188_173515_object149537:head# 2024-04-01T20:04:41.916 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9076cb6:::benchmark_data_smithi188_173515_object91936:head# 2024-04-01T20:04:41.916 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e908f797:::benchmark_data_smithi188_173515_object125749:head# 2024-04-01T20:04:41.916 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e90b4f07:::benchmark_data_smithi188_173515_object126835:head# 2024-04-01T20:04:41.916 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e90b8c95:::benchmark_data_smithi188_173515_object59704:head# 2024-04-01T20:04:41.916 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e90c513b:::benchmark_data_smithi188_173515_object116338:head# 2024-04-01T20:04:41.917 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e90c9253:::benchmark_data_smithi188_173515_object99365:head# 2024-04-01T20:04:41.917 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e90d8f45:::benchmark_data_smithi188_173515_object118624:head# 2024-04-01T20:04:41.917 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e90ec42a:::benchmark_data_smithi188_173515_object64312:head# 2024-04-01T20:04:41.917 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e90f204a:::benchmark_data_smithi188_173515_object97600:head# 2024-04-01T20:04:41.917 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e90f8d68:::benchmark_data_smithi188_173515_object125880:head# 2024-04-01T20:04:41.917 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e90fc6a6:::benchmark_data_smithi188_173515_object120185:head# 2024-04-01T20:04:41.917 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9106e03:::benchmark_data_smithi188_173515_object106727:head# 2024-04-01T20:04:41.917 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e91078c1:::benchmark_data_smithi188_173515_object108967:head# 2024-04-01T20:04:41.917 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e910c052:::benchmark_data_smithi188_173515_object155086:head# 2024-04-01T20:04:41.917 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9126a50:::benchmark_data_smithi188_173515_object125416:head# 2024-04-01T20:04:41.917 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e912a1f0:::benchmark_data_smithi188_173515_object57074:head# 2024-04-01T20:04:41.917 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e91343dd:::benchmark_data_smithi188_173515_object144862:head# 2024-04-01T20:04:41.917 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9154838:::benchmark_data_smithi188_173515_object52967:head# 2024-04-01T20:04:41.917 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9157918:::benchmark_data_smithi188_173515_object47049:head# 2024-04-01T20:04:41.918 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e915df78:::benchmark_data_smithi188_173515_object131674:head# 2024-04-01T20:04:41.918 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9163dbd:::benchmark_data_smithi188_173515_object104780:head# 2024-04-01T20:04:41.918 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e91655bb:::benchmark_data_smithi188_173515_object138056:head# 2024-04-01T20:04:41.923 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9166725:::benchmark_data_smithi188_173515_object89850:head# 2024-04-01T20:04:41.923 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e916a929:::benchmark_data_smithi188_173515_object88659:head# 2024-04-01T20:04:41.923 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e916b8dd:::benchmark_data_smithi188_173515_object145435:head# 2024-04-01T20:04:41.923 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9174aa0:::benchmark_data_smithi188_173515_object93348:head# 2024-04-01T20:04:41.923 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e918acfe:::benchmark_data_smithi188_173515_object110197:head# 2024-04-01T20:04:41.923 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9198500:::benchmark_data_smithi188_173515_object102979:head# 2024-04-01T20:04:41.924 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e91adc0d:::benchmark_data_smithi188_173515_object54668:head# 2024-04-01T20:04:41.924 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e91b1fab:::benchmark_data_smithi188_173515_object154914:head# 2024-04-01T20:04:41.924 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e91c0c98:::benchmark_data_smithi188_173515_object111033:head# 2024-04-01T20:04:41.924 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e91c8e3e:::benchmark_data_smithi188_173515_object73900:head# 2024-04-01T20:04:41.924 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e91cd85a:::benchmark_data_smithi188_173515_object115242:head# 2024-04-01T20:04:41.924 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e91ce596:::benchmark_data_smithi188_173515_object137799:head# 2024-04-01T20:04:41.924 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e91f5007:::benchmark_data_smithi188_173515_object111642:head# 2024-04-01T20:04:41.924 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e91fc38b:::benchmark_data_smithi188_173515_object90419:head# 2024-04-01T20:04:41.924 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e91fe6f6:::benchmark_data_smithi188_173515_object107736:head# 2024-04-01T20:04:41.924 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e920ecbf:::benchmark_data_smithi188_173515_object137972:head# 2024-04-01T20:04:41.924 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e920fec0:::benchmark_data_smithi188_173515_object138147:head# 2024-04-01T20:04:41.924 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9212f13:::benchmark_data_smithi188_173515_object97705:head# 2024-04-01T20:04:41.924 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9214932:::benchmark_data_smithi188_173515_object96075:head# 2024-04-01T20:04:41.925 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9216525:::benchmark_data_smithi188_173515_object100057:head# 2024-04-01T20:04:41.925 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9233085:::benchmark_data_smithi188_173515_object151178:head# 2024-04-01T20:04:41.925 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e924aaf3:::benchmark_data_smithi188_173515_object56752:head# 2024-04-01T20:04:41.925 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e924ab39:::benchmark_data_smithi188_173515_object151556:head# 2024-04-01T20:04:41.925 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e924c120:::benchmark_data_smithi188_173515_object70945:head# 2024-04-01T20:04:41.925 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e924e18d:::benchmark_data_smithi188_173515_object102049:head# 2024-04-01T20:04:41.925 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e924ed69:::benchmark_data_smithi188_173515_object114823:head# 2024-04-01T20:04:41.925 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e924f780:::benchmark_data_smithi188_173515_object59064:head# 2024-04-01T20:04:41.925 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e925035c:::benchmark_data_smithi188_173515_object112735:head# 2024-04-01T20:04:41.925 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9255261:::benchmark_data_smithi188_173515_object138473:head# 2024-04-01T20:04:41.925 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e925571c:::benchmark_data_smithi188_173515_object98824:head# 2024-04-01T20:04:41.925 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9256c4d:::benchmark_data_smithi188_173515_object136377:head# 2024-04-01T20:04:41.925 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9272233:::benchmark_data_smithi188_173515_object61956:head# 2024-04-01T20:04:41.925 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e927f1ca:::benchmark_data_smithi188_173515_object68730:head# 2024-04-01T20:04:41.926 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e927f8d4:::benchmark_data_smithi188_173515_object56996:head# 2024-04-01T20:04:41.926 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9285932:::benchmark_data_smithi188_173515_object71254:head# 2024-04-01T20:04:41.926 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e929d9fa:::benchmark_data_smithi188_173515_object112763:head# 2024-04-01T20:04:41.926 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e929ea6d:::benchmark_data_smithi188_173515_object100081:head# 2024-04-01T20:04:41.926 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e92aaaa8:::benchmark_data_smithi188_173515_object54492:head# 2024-04-01T20:04:41.926 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e92ba62a:::benchmark_data_smithi188_173515_object100541:head# 2024-04-01T20:04:41.926 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e92ba815:::benchmark_data_smithi188_173515_object109314:head# 2024-04-01T20:04:41.926 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e92c3971:::benchmark_data_smithi188_173515_object142130:head# 2024-04-01T20:04:41.926 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e92caf14:::benchmark_data_smithi188_173515_object123185:head# 2024-04-01T20:04:41.926 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e92cf96f:::benchmark_data_smithi188_173515_object135986:head# 2024-04-01T20:04:41.926 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e92d7880:::benchmark_data_smithi188_173515_object84405:head# 2024-04-01T20:04:41.926 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e92dca34:::benchmark_data_smithi188_173515_object126182:head# 2024-04-01T20:04:41.926 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e92e4bee:::benchmark_data_smithi188_173515_object59568:head# 2024-04-01T20:04:41.927 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e930573b:::benchmark_data_smithi188_173515_object155596:head# 2024-04-01T20:04:41.927 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9316810:::benchmark_data_smithi188_173515_object65193:head# 2024-04-01T20:04:41.927 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e931743e:::benchmark_data_smithi188_173515_object126570:head# 2024-04-01T20:04:41.927 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e93219d8:::benchmark_data_smithi188_173515_object74405:head# 2024-04-01T20:04:41.927 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e932b98d:::benchmark_data_smithi188_173515_object92061:head# 2024-04-01T20:04:41.927 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e932fd3f:::benchmark_data_smithi188_173515_object66732:head# 2024-04-01T20:04:41.927 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9335cda:::benchmark_data_smithi188_173515_object56886:head# 2024-04-01T20:04:41.927 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9337820:::benchmark_data_smithi188_173515_object136906:head# 2024-04-01T20:04:41.951 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9338d5c:::benchmark_data_smithi188_173515_object136359:head# 2024-04-01T20:04:41.951 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e933a028:::benchmark_data_smithi188_173515_object82087:head# 2024-04-01T20:04:41.952 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9347a10:::benchmark_data_smithi188_173515_object80311:head# 2024-04-01T20:04:41.952 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e935f26b:::benchmark_data_smithi188_173515_object111375:head# 2024-04-01T20:04:41.952 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e937312e:::benchmark_data_smithi188_173515_object132395:head# 2024-04-01T20:04:41.952 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9374ea3:::benchmark_data_smithi188_173515_object70132:head# 2024-04-01T20:04:41.952 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e937d3df:::benchmark_data_smithi188_173515_object113453:head# 2024-04-01T20:04:41.952 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e937f8ae:::benchmark_data_smithi188_173515_object128766:head# 2024-04-01T20:04:41.952 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e938d779:::benchmark_data_smithi188_173515_object140905:head# 2024-04-01T20:04:41.952 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9395bbd:::benchmark_data_smithi188_173515_object86677:head# 2024-04-01T20:04:41.952 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e939d230:::benchmark_data_smithi188_173515_object129472:head# 2024-04-01T20:04:41.952 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e93a4f5c:::benchmark_data_smithi188_173515_object48724:head# 2024-04-01T20:04:41.952 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e93a505d:::benchmark_data_smithi188_173515_object96661:head# 2024-04-01T20:04:41.952 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e93c370c:::benchmark_data_smithi188_173515_object152146:head# 2024-04-01T20:04:41.952 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e93c6f83:::benchmark_data_smithi188_173515_object136004:head# 2024-04-01T20:04:41.953 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e93cb2c1:::benchmark_data_smithi188_173515_object92607:head# 2024-04-01T20:04:41.953 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e93cfb3b:::benchmark_data_smithi188_173515_object153572:head# 2024-04-01T20:04:41.953 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e93f0ba5:::benchmark_data_smithi188_173515_object121124:head# 2024-04-01T20:04:41.953 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e93f0f92:::benchmark_data_smithi188_173515_object125223:head# 2024-04-01T20:04:41.953 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e93f5f86:::benchmark_data_smithi188_173515_object63732:head# 2024-04-01T20:04:41.953 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e93fb1b8:::benchmark_data_smithi188_173515_object113559:head# 2024-04-01T20:04:41.953 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e93fdc42:::benchmark_data_smithi188_173515_object140533:head# 2024-04-01T20:04:41.953 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9403779:::benchmark_data_smithi188_173515_object132818:head# 2024-04-01T20:04:41.953 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e940c16a:::benchmark_data_smithi188_173515_object56569:head# 2024-04-01T20:04:41.953 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e941db75:::benchmark_data_smithi188_173515_object55793:head# 2024-04-01T20:04:41.953 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9428752:::benchmark_data_smithi188_173515_object55659:head# 2024-04-01T20:04:41.953 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9429ade:::benchmark_data_smithi188_173515_object107867:head# 2024-04-01T20:04:41.953 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9434bdd:::benchmark_data_smithi188_173515_object134219:head# 2024-04-01T20:04:41.954 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e943881f:::benchmark_data_smithi188_173515_object104915:head# 2024-04-01T20:04:41.954 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9446bf9:::benchmark_data_smithi188_173515_object122890:head# 2024-04-01T20:04:41.954 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e944a86f:::benchmark_data_smithi188_173515_object70737:head# 2024-04-01T20:04:41.954 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e944cedc:::benchmark_data_smithi188_173515_object52086:head# 2024-04-01T20:04:41.954 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e944ed15:::benchmark_data_smithi188_173515_object122543:head# 2024-04-01T20:04:41.954 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e946dc8c:::benchmark_data_smithi188_173515_object89047:head# 2024-04-01T20:04:41.954 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e94741ad:::benchmark_data_smithi188_173515_object64608:head# 2024-04-01T20:04:41.954 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e947b12d:::benchmark_data_smithi188_173515_object132046:head# 2024-04-01T20:04:41.954 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e947bad0:::benchmark_data_smithi188_173515_object146575:head# 2024-04-01T20:04:41.954 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9480f6b:::benchmark_data_smithi188_173515_object71066:head# 2024-04-01T20:04:41.954 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e948d39a:::benchmark_data_smithi188_173515_object119260:head# 2024-04-01T20:04:41.954 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9492fc5:::benchmark_data_smithi188_173515_object115022:head# 2024-04-01T20:04:41.954 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9493d7f:::benchmark_data_smithi188_173515_object54227:head# 2024-04-01T20:04:41.955 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9498987:::benchmark_data_smithi188_173515_object81329:head# 2024-04-01T20:04:41.955 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9498bff:::benchmark_data_smithi188_173515_object127814:head# 2024-04-01T20:04:41.955 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e949f04e:::benchmark_data_smithi188_173515_object64623:head# 2024-04-01T20:04:41.955 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e94a97c6:::benchmark_data_smithi188_173515_object70926:head# 2024-04-01T20:04:41.955 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e94ad3f9:::benchmark_data_smithi188_173515_object86005:head# 2024-04-01T20:04:41.955 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e94c2c96:::benchmark_data_smithi188_173515_object75864:head# 2024-04-01T20:04:41.955 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e94d230d:::benchmark_data_smithi188_173515_object79804:head# 2024-04-01T20:04:41.955 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e94e4019:::benchmark_data_smithi188_173515_object105296:head# 2024-04-01T20:04:41.955 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e94f247b:::benchmark_data_smithi188_173515_object57363:head# 2024-04-01T20:04:41.955 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e95015bd:::benchmark_data_smithi188_173515_object98748:head# 2024-04-01T20:04:41.955 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9504139:::benchmark_data_smithi188_173515_object87007:head# 2024-04-01T20:04:41.955 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e951eda7:::benchmark_data_smithi188_173515_object109766:head# 2024-04-01T20:04:41.955 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9537dde:::benchmark_data_smithi188_173515_object64571:head# 2024-04-01T20:04:41.955 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9540a94:::benchmark_data_smithi188_173515_object150906:head# 2024-04-01T20:04:41.956 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e95589ad:::benchmark_data_smithi188_173515_object79433:head# 2024-04-01T20:04:41.956 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9558fa1:::benchmark_data_smithi188_173515_object136407:head# 2024-04-01T20:04:41.956 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e95675a9:::benchmark_data_smithi188_173515_object50373:head# 2024-04-01T20:04:41.956 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9575739:::benchmark_data_smithi188_173515_object95138:head# 2024-04-01T20:04:41.956 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e957a965:::benchmark_data_smithi188_173515_object145275:head# 2024-04-01T20:04:41.956 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9581710:::benchmark_data_smithi188_173515_object52948:head# 2024-04-01T20:04:41.956 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e95921f2:::benchmark_data_smithi188_173515_object76011:head# 2024-04-01T20:04:41.956 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e959b860:::benchmark_data_smithi188_173515_object133776:head# 2024-04-01T20:04:41.956 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e95a0550:::benchmark_data_smithi188_173515_object128852:head# 2024-04-01T20:04:41.956 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e95b1954:::benchmark_data_smithi188_173515_object95686:head# 2024-04-01T20:04:41.956 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e95b208c:::benchmark_data_smithi188_173515_object135848:head# 2024-04-01T20:04:41.956 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e95b2aee:::benchmark_data_smithi188_173515_object51748:head# 2024-04-01T20:04:41.956 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e95b4ea2:::benchmark_data_smithi188_173515_object85340:head# 2024-04-01T20:04:41.956 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e95ba8ca:::benchmark_data_smithi188_173515_object76003:head# 2024-04-01T20:04:41.957 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e95bde7a:::benchmark_data_smithi188_173515_object95955:head# 2024-04-01T20:04:41.957 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e95d1fab:::benchmark_data_smithi188_173515_object95928:head# 2024-04-01T20:04:41.957 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e95d9e46:::benchmark_data_smithi188_173515_object74354:head# 2024-04-01T20:04:41.957 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e95e2fa5:::benchmark_data_smithi188_173515_object123176:head# 2024-04-01T20:04:41.957 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e95e560d:::benchmark_data_smithi188_173515_object91764:head# 2024-04-01T20:04:41.957 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e95e7e02:::benchmark_data_smithi188_173515_object149650:head# 2024-04-01T20:04:41.957 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e95f0bc6:::benchmark_data_smithi188_173515_object95008:head# 2024-04-01T20:04:41.957 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e95f5061:::benchmark_data_smithi188_173515_object83641:head# 2024-04-01T20:04:41.957 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e95fcd53:::benchmark_data_smithi188_173515_object130438:head# 2024-04-01T20:04:41.957 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9603d83:::benchmark_data_smithi188_173515_object78605:head# 2024-04-01T20:04:41.957 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9610bd2:::benchmark_data_smithi188_173515_object49954:head# 2024-04-01T20:04:41.957 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9630225:::benchmark_data_smithi188_173515_object96474:head# 2024-04-01T20:04:41.957 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9648499:::benchmark_data_smithi188_173515_object80814:head# 2024-04-01T20:04:41.957 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e964ca51:::benchmark_data_smithi188_173515_object77853:head# 2024-04-01T20:04:41.957 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e964efe8:::benchmark_data_smithi188_173515_object99210:head# 2024-04-01T20:04:41.958 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e965ad4f:::benchmark_data_smithi188_173515_object75421:head# 2024-04-01T20:04:41.958 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e967b2b4:::benchmark_data_smithi188_173515_object144521:head# 2024-04-01T20:04:41.958 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e96899ec:::benchmark_data_smithi188_173515_object114522:head# 2024-04-01T20:04:41.958 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e969ecf9:::benchmark_data_smithi188_173515_object71629:head# 2024-04-01T20:04:41.958 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e96a18ad:::benchmark_data_smithi188_173515_object59182:head# 2024-04-01T20:04:41.958 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e96a19eb:::benchmark_data_smithi188_173515_object126246:head# 2024-04-01T20:04:41.958 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e96aa34e:::benchmark_data_smithi188_173515_object140769:head# 2024-04-01T20:04:41.958 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e96aad9a:::benchmark_data_smithi188_173515_object47082:head# 2024-04-01T20:04:41.958 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e96aba50:::benchmark_data_smithi188_173515_object136064:head# 2024-04-01T20:04:41.958 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e96b6829:::benchmark_data_smithi188_173515_object111339:head# 2024-04-01T20:04:41.958 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e96c14a0:::benchmark_data_smithi188_173515_object122699:head# 2024-04-01T20:04:41.958 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e96c4a9b:::benchmark_data_smithi188_173515_object53158:head# 2024-04-01T20:04:41.958 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e96cea27:::benchmark_data_smithi188_173515_object55556:head# 2024-04-01T20:04:41.959 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e96d5659:::benchmark_data_smithi188_173515_object145407:head# 2024-04-01T20:04:41.959 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e96e208c:::benchmark_data_smithi188_173515_object91931:head# 2024-04-01T20:04:41.959 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e96e28ec:::benchmark_data_smithi188_173515_object96946:head# 2024-04-01T20:04:41.959 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e96e4d5b:::benchmark_data_smithi188_173515_object95116:head# 2024-04-01T20:04:41.959 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e96f3e57:::benchmark_data_smithi188_173515_object66590:head# 2024-04-01T20:04:41.959 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e96f69f8:::benchmark_data_smithi188_173515_object72901:head# 2024-04-01T20:04:41.959 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e970f568:::benchmark_data_smithi188_173515_object106736:head# 2024-04-01T20:04:41.959 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e973230f:::benchmark_data_smithi188_173515_object64730:head# 2024-04-01T20:04:41.959 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e97327a4:::benchmark_data_smithi188_173515_object131829:head# 2024-04-01T20:04:41.959 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e973c1ee:::benchmark_data_smithi188_173515_object152915:head# 2024-04-01T20:04:41.959 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9745709:::benchmark_data_smithi188_173515_object137547:head# 2024-04-01T20:04:41.959 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e974d944:::benchmark_data_smithi188_173515_object140645:head# 2024-04-01T20:04:41.959 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e97590be:::benchmark_data_smithi188_173515_object123367:head# 2024-04-01T20:04:41.959 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9783749:::benchmark_data_smithi188_173515_object153210:head# 2024-04-01T20:04:41.960 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9783f4d:::benchmark_data_smithi188_173515_object118065:head# 2024-04-01T20:04:41.960 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e978d13c:::benchmark_data_smithi188_173515_object85015:head# 2024-04-01T20:04:41.960 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e978d970:::benchmark_data_smithi188_173515_object120755:head# 2024-04-01T20:04:41.960 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e979781c:::benchmark_data_smithi188_173515_object111385:head# 2024-04-01T20:04:41.960 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9797cb9:::benchmark_data_smithi188_173515_object111638:head# 2024-04-01T20:04:41.960 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e97aef4f:::benchmark_data_smithi188_173515_object108975:head# 2024-04-01T20:04:41.960 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e97b645e:::benchmark_data_smithi188_173515_object79873:head# 2024-04-01T20:04:41.960 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e97b83a5:::benchmark_data_smithi188_173515_object142965:head# 2024-04-01T20:04:41.960 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e97ba766:::benchmark_data_smithi188_173515_object93646:head# 2024-04-01T20:04:41.960 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e97cba79:::benchmark_data_smithi188_173515_object121329:head# 2024-04-01T20:04:41.960 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e97dd3c4:::benchmark_data_smithi188_173515_object117036:head# 2024-04-01T20:04:41.960 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e97e41c6:::benchmark_data_smithi188_173515_object119482:head# 2024-04-01T20:04:41.960 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e97e7563:::benchmark_data_smithi188_173515_object118115:head# 2024-04-01T20:04:41.960 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e97ea469:::benchmark_data_smithi188_173515_object117486:head# 2024-04-01T20:04:41.961 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e97ee26d:::benchmark_data_smithi188_173515_object82240:head# 2024-04-01T20:04:41.961 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e98097af:::benchmark_data_smithi188_173515_object52200:head# 2024-04-01T20:04:41.961 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e981a10a:::benchmark_data_smithi188_173515_object59305:head# 2024-04-01T20:04:41.961 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e981f29f:::benchmark_data_smithi188_173515_object88311:head# 2024-04-01T20:04:41.961 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9822fe6:::benchmark_data_smithi188_173515_object140087:head# 2024-04-01T20:04:41.961 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9829c55:::benchmark_data_smithi188_173515_object55695:head# 2024-04-01T20:04:41.961 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e984b61d:::benchmark_data_smithi188_173515_object51783:head# 2024-04-01T20:04:41.961 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9854bbc:::benchmark_data_smithi188_173515_object89676:head# 2024-04-01T20:04:41.961 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e985ccff:::benchmark_data_smithi188_173515_object139559:head# 2024-04-01T20:04:41.961 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9866337:::benchmark_data_smithi188_173515_object107293:head# 2024-04-01T20:04:41.961 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e986bdd1:::benchmark_data_smithi188_173515_object60604:head# 2024-04-01T20:04:41.961 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e986c239:::benchmark_data_smithi188_173515_object76406:head# 2024-04-01T20:04:41.961 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e986da0a:::benchmark_data_smithi188_173515_object88527:head# 2024-04-01T20:04:41.961 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e986efc9:::benchmark_data_smithi188_173515_object63641:head# 2024-04-01T20:04:41.962 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e987bc66:::benchmark_data_smithi188_173515_object155353:head# 2024-04-01T20:04:41.962 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9886f0b:::benchmark_data_smithi188_173515_object58387:head# 2024-04-01T20:04:41.962 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e989497e:::benchmark_data_smithi188_173515_object142076:head# 2024-04-01T20:04:41.962 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e98af02a:::benchmark_data_smithi188_173515_object51844:head# 2024-04-01T20:04:41.962 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e98b64ea:::benchmark_data_smithi188_173515_object50466:head# 2024-04-01T20:04:41.962 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e98c0b70:::benchmark_data_smithi188_173515_object52573:head# 2024-04-01T20:04:41.962 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e98c2414:::benchmark_data_smithi188_173515_object67857:head# 2024-04-01T20:04:41.962 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e98cade2:::benchmark_data_smithi188_173515_object88755:head# 2024-04-01T20:04:41.962 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e98cc9af:::benchmark_data_smithi188_173515_object71279:head# 2024-04-01T20:04:41.962 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e98d9330:::benchmark_data_smithi188_173515_object142007:head# 2024-04-01T20:04:41.962 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e98ee174:::benchmark_data_smithi188_173515_object86484:head# 2024-04-01T20:04:41.962 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e98ee863:::benchmark_data_smithi188_173515_object124045:head# 2024-04-01T20:04:41.962 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e98f00d4:::benchmark_data_smithi188_173515_object102719:head# 2024-04-01T20:04:41.963 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e98f1da5:::benchmark_data_smithi188_173515_object119545:head# 2024-04-01T20:04:41.976 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e98f890b:::benchmark_data_smithi188_173515_object108415:head# 2024-04-01T20:04:41.976 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e990a2a3:::benchmark_data_smithi188_173515_object84735:head# 2024-04-01T20:04:41.976 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e990e08a:::benchmark_data_smithi188_173515_object82769:head# 2024-04-01T20:04:41.976 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e992163b:::benchmark_data_smithi188_173515_object132633:head# 2024-04-01T20:04:41.976 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e992cab8:::benchmark_data_smithi188_173515_object134459:head# 2024-04-01T20:04:41.976 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e99326db:::benchmark_data_smithi188_173515_object118601:head# 2024-04-01T20:04:41.977 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e993583f:::benchmark_data_smithi188_173515_object47369:head# 2024-04-01T20:04:41.977 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9937ec7:::benchmark_data_smithi188_173515_object77558:head# 2024-04-01T20:04:41.977 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e993b79e:::benchmark_data_smithi188_173515_object83124:head# 2024-04-01T20:04:41.977 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e993fa5a:::benchmark_data_smithi188_173515_object78633:head# 2024-04-01T20:04:41.977 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e99452a4:::benchmark_data_smithi188_173515_object108543:head# 2024-04-01T20:04:41.977 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9952c8e:::benchmark_data_smithi188_173515_object84807:head# 2024-04-01T20:04:41.977 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e996b31e:::benchmark_data_smithi188_173515_object116996:head# 2024-04-01T20:04:41.977 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e996b994:::benchmark_data_smithi188_173515_object129257:head# 2024-04-01T20:04:41.977 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9971a71:::benchmark_data_smithi188_173515_object47188:head# 2024-04-01T20:04:41.977 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e99a0a45:::benchmark_data_smithi188_173515_object81469:head# 2024-04-01T20:04:41.977 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e99a4415:::benchmark_data_smithi188_173515_object120521:head# 2024-04-01T20:04:41.977 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e99ab659:::benchmark_data_smithi188_173515_object48947:head# 2024-04-01T20:04:41.977 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e99ac5ff:::benchmark_data_smithi188_173515_object115671:head# 2024-04-01T20:04:41.977 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e99ae5a4:::benchmark_data_smithi188_173515_object144594:head# 2024-04-01T20:04:41.978 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e99b1c8e:::benchmark_data_smithi188_173515_object62888:head# 2024-04-01T20:04:41.978 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e99bd903:::benchmark_data_smithi188_173515_object112774:head# 2024-04-01T20:04:41.978 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e99cb9e6:::benchmark_data_smithi188_173515_object151209:head# 2024-04-01T20:04:41.978 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e99d687a:::benchmark_data_smithi188_173515_object143650:head# 2024-04-01T20:04:41.978 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e99eced1:::benchmark_data_smithi188_173515_object150154:head# 2024-04-01T20:04:41.978 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9a0b8cb:::benchmark_data_smithi188_173515_object139086:head# 2024-04-01T20:04:41.978 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9a0f10b:::benchmark_data_smithi188_173515_object107165:head# 2024-04-01T20:04:41.978 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9a162d6:::benchmark_data_smithi188_173515_object101366:head# 2024-04-01T20:04:41.978 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9a1cb42:::benchmark_data_smithi188_173515_object128234:head# 2024-04-01T20:04:41.978 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9a36337:::benchmark_data_smithi188_173515_object69275:head# 2024-04-01T20:04:41.978 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9a37b0b:::benchmark_data_smithi188_173515_object136476:head# 2024-04-01T20:04:41.978 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9a3f7b3:::benchmark_data_smithi188_173515_object86530:head# 2024-04-01T20:04:41.978 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9a491f2:::benchmark_data_smithi188_173515_object137212:head# 2024-04-01T20:04:41.979 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9a5018c:::benchmark_data_smithi188_173515_object101692:head# 2024-04-01T20:04:41.979 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9a6e232:::benchmark_data_smithi188_173515_object107283:head# 2024-04-01T20:04:41.979 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9a7ae43:::benchmark_data_smithi188_173515_object88665:head# 2024-04-01T20:04:41.979 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9a7b582:::benchmark_data_smithi188_173515_object76894:head# 2024-04-01T20:04:41.979 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9a86910:::benchmark_data_smithi188_173515_object77774:head# 2024-04-01T20:04:41.979 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9a86bcc:::benchmark_data_smithi188_173515_object52075:head# 2024-04-01T20:04:41.979 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9a9ce21:::benchmark_data_smithi188_173515_object103597:head# 2024-04-01T20:04:41.979 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9aa98ce:::benchmark_data_smithi188_173515_object151463:head# 2024-04-01T20:04:41.979 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9aaa4a7:::benchmark_data_smithi188_173515_object70996:head# 2024-04-01T20:04:41.979 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9aab010:::benchmark_data_smithi188_173515_object100595:head# 2024-04-01T20:04:41.979 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9ac4bb3:::benchmark_data_smithi188_173515_object56178:head# 2024-04-01T20:04:41.979 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9acf5e4:::benchmark_data_smithi188_173515_object124237:head# 2024-04-01T20:04:41.979 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9ae6356:::benchmark_data_smithi188_173515_object48844:head# 2024-04-01T20:04:41.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9aebca0:::benchmark_data_smithi188_173515_object139823:head# 2024-04-01T20:04:41.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9aec6d0:::benchmark_data_smithi188_173515_object91316:head# 2024-04-01T20:04:41.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9af36bf:::benchmark_data_smithi188_173515_object142366:head# 2024-04-01T20:04:41.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9af66f3:::benchmark_data_smithi188_173515_object146918:head# 2024-04-01T20:04:41.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9afdb0a:::benchmark_data_smithi188_173515_object106034:head# 2024-04-01T20:04:41.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9b01fea:::benchmark_data_smithi188_173515_object52388:head# 2024-04-01T20:04:41.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9b0b354:::benchmark_data_smithi188_173515_object52524:head# 2024-04-01T20:04:41.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9b15816:::benchmark_data_smithi188_173515_object63985:head# 2024-04-01T20:04:41.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9b18c24:::benchmark_data_smithi188_173515_object125238:head# 2024-04-01T20:04:41.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9b19b47:::benchmark_data_smithi188_173515_object84339:head# 2024-04-01T20:04:41.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9b1d3d4:::benchmark_data_smithi188_173515_object102120:head# 2024-04-01T20:04:41.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9b3daea:::benchmark_data_smithi188_173515_object110072:head# 2024-04-01T20:04:41.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9b491e3:::benchmark_data_smithi188_173515_object95278:head# 2024-04-01T20:04:41.980 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9b5227b:::benchmark_data_smithi188_173515_object147314:head# 2024-04-01T20:04:41.981 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9b5ea4b:::benchmark_data_smithi188_173515_object60969:head# 2024-04-01T20:04:41.981 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9b672da:::benchmark_data_smithi188_173515_object86148:head# 2024-04-01T20:04:41.981 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9b6b565:::benchmark_data_smithi188_173515_object119490:head# 2024-04-01T20:04:41.981 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9b805c0:::benchmark_data_smithi188_173515_object127272:head# 2024-04-01T20:04:41.981 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9b81723:::benchmark_data_smithi188_173515_object101036:head# 2024-04-01T20:04:41.981 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9b97325:::benchmark_data_smithi188_173515_object72153:head# 2024-04-01T20:04:41.981 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9b9e870:::benchmark_data_smithi188_173515_object122779:head# 2024-04-01T20:04:41.981 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9ba3331:::benchmark_data_smithi188_173515_object140418:head# 2024-04-01T20:04:41.981 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9bb4b47:::benchmark_data_smithi188_173515_object52626:head# 2024-04-01T20:04:41.981 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9bc0ddb:::benchmark_data_smithi188_173515_object98473:head# 2024-04-01T20:04:41.981 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9bd701b:::benchmark_data_smithi188_173515_object68741:head# 2024-04-01T20:04:41.981 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9be3c18:::benchmark_data_smithi188_173515_object94093:head# 2024-04-01T20:04:41.981 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9becbde:::benchmark_data_smithi188_173515_object53150:head# 2024-04-01T20:04:41.981 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9bf2667:::benchmark_data_smithi188_173515_object135871:head# 2024-04-01T20:04:41.982 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9c05073:::benchmark_data_smithi188_173515_object75609:head# 2024-04-01T20:04:41.982 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9c09b3b:::benchmark_data_smithi188_173515_object81053:head# 2024-04-01T20:04:41.982 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9c0ab37:::benchmark_data_smithi188_173515_object144746:head# 2024-04-01T20:04:41.982 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9c217e9:::benchmark_data_smithi188_173515_object89830:head# 2024-04-01T20:04:41.982 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9c27467:::benchmark_data_smithi188_173515_object70795:head# 2024-04-01T20:04:41.982 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9c2acf9:::benchmark_data_smithi188_173515_object147698:head# 2024-04-01T20:04:41.982 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9c2e72f:::benchmark_data_smithi188_173515_object121325:head# 2024-04-01T20:04:41.982 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9c39bf1:::benchmark_data_smithi188_173515_object59836:head# 2024-04-01T20:04:41.982 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9c41ba2:::benchmark_data_smithi188_173515_object149965:head# 2024-04-01T20:04:41.982 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9c43771:::benchmark_data_smithi188_173515_object136919:head# 2024-04-01T20:04:41.982 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9c4a602:::benchmark_data_smithi188_173515_object150371:head# 2024-04-01T20:04:41.982 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9c54cac:::benchmark_data_smithi188_173515_object93411:head# 2024-04-01T20:04:41.982 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9c563ec:::benchmark_data_smithi188_173515_object151521:head# 2024-04-01T20:04:41.983 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9c5cde2:::benchmark_data_smithi188_173515_object46807:head# 2024-04-01T20:04:41.983 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9c63ca7:::benchmark_data_smithi188_173515_object63840:head# 2024-04-01T20:04:41.983 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9c732bf:::benchmark_data_smithi188_173515_object71243:head# 2024-04-01T20:04:41.983 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9c7489e:::benchmark_data_smithi188_173515_object117863:head# 2024-04-01T20:04:41.983 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9c796eb:::benchmark_data_smithi188_173515_object106456:head# 2024-04-01T20:04:41.983 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9c7d670:::benchmark_data_smithi188_173515_object140680:head# 2024-04-01T20:04:41.983 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9c8c718:::benchmark_data_smithi188_173515_object86107:head# 2024-04-01T20:04:41.983 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9ca012b:::benchmark_data_smithi188_173515_object145140:head# 2024-04-01T20:04:41.983 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9ca31f1:::benchmark_data_smithi188_173515_object102068:head# 2024-04-01T20:04:41.983 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9cb054e:::benchmark_data_smithi188_173515_object83987:head# 2024-04-01T20:04:41.983 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9cc6fb3:::benchmark_data_smithi188_173515_object88290:head# 2024-04-01T20:04:41.983 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9cd3a44:::benchmark_data_smithi188_173515_object68808:head# 2024-04-01T20:04:41.983 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9cdf3bb:::benchmark_data_smithi188_173515_object126121:head# 2024-04-01T20:04:41.983 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9ceaa8f:::benchmark_data_smithi188_173515_object154400:head# 2024-04-01T20:04:41.984 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9cec3db:::benchmark_data_smithi188_173515_object134684:head# 2024-04-01T20:04:41.984 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9cf5777:::benchmark_data_smithi188_173515_object134760:head# 2024-04-01T20:04:41.984 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9d0a24e:::benchmark_data_smithi188_173515_object50843:head# 2024-04-01T20:04:41.984 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9d14c79:::benchmark_data_smithi188_173515_object76528:head# 2024-04-01T20:04:41.984 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9d16e71:::benchmark_data_smithi188_173515_object107183:head# 2024-04-01T20:04:41.984 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9d172df:::benchmark_data_smithi188_173515_object139255:head# 2024-04-01T20:04:41.984 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9d20de2:::benchmark_data_smithi188_173515_object78611:head# 2024-04-01T20:04:41.984 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9d20e7a:::benchmark_data_smithi188_173515_object141390:head# 2024-04-01T20:04:41.984 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9d2355f:::benchmark_data_smithi188_173515_object63015:head# 2024-04-01T20:04:41.984 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9d29595:::benchmark_data_smithi188_173515_object48485:head# 2024-04-01T20:04:41.984 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9d2be0d:::benchmark_data_smithi188_173515_object146330:head# 2024-04-01T20:04:41.984 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9d33cf7:::benchmark_data_smithi188_173515_object65959:head# 2024-04-01T20:04:41.984 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9d359c4:::benchmark_data_smithi188_173515_object63773:head# 2024-04-01T20:04:41.984 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9d3debb:::benchmark_data_smithi188_173515_object141185:head# 2024-04-01T20:04:41.984 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9d4f7b9:::benchmark_data_smithi188_173515_object119095:head# 2024-04-01T20:04:41.985 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9d54283:::benchmark_data_smithi188_173515_object67899:head# 2024-04-01T20:04:41.985 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9d588f9:::benchmark_data_smithi188_173515_object120401:head# 2024-04-01T20:04:41.985 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9d5b00a:::benchmark_data_smithi188_173515_object149385:head# 2024-04-01T20:04:41.985 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9d5dc6f:::benchmark_data_smithi188_173515_object135070:head# 2024-04-01T20:04:41.985 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9d68d1d:::benchmark_data_smithi188_173515_object148614:head# 2024-04-01T20:04:41.985 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9d7650c:::benchmark_data_smithi188_173515_object59746:head# 2024-04-01T20:04:41.985 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9d7aad4:::benchmark_data_smithi188_173515_object116691:head# 2024-04-01T20:04:41.985 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9d87a19:::benchmark_data_smithi188_173515_object127728:head# 2024-04-01T20:04:41.985 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9d89783:::benchmark_data_smithi188_173515_object82168:head# 2024-04-01T20:04:41.985 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9d8ae78:::benchmark_data_smithi188_173515_object119431:head# 2024-04-01T20:04:41.985 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9d97444:::benchmark_data_smithi188_173515_object87572:head# 2024-04-01T20:04:41.985 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9d9d166:::benchmark_data_smithi188_173515_object103557:head# 2024-04-01T20:04:41.985 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9da94be:::benchmark_data_smithi188_173515_object86784:head# 2024-04-01T20:04:41.985 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9dacf54:::benchmark_data_smithi188_173515_object151702:head# 2024-04-01T20:04:41.985 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9daed9a:::benchmark_data_smithi188_173515_object72744:head# 2024-04-01T20:04:41.986 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9dc5f5e:::benchmark_data_smithi188_173515_object129239:head# 2024-04-01T20:04:41.986 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9df111e:::benchmark_data_smithi188_173515_object50734:head# 2024-04-01T20:04:41.986 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9df3ad1:::benchmark_data_smithi188_173515_object97263:head# 2024-04-01T20:04:41.986 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9e0bff7:::benchmark_data_smithi188_173515_object154151:head# 2024-04-01T20:04:41.986 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9e17489:::benchmark_data_smithi188_173515_object148254:head# 2024-04-01T20:04:41.986 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9e1862f:::benchmark_data_smithi188_173515_object69453:head# 2024-04-01T20:04:41.986 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9e2b5aa:::benchmark_data_smithi188_173515_object67755:head# 2024-04-01T20:04:41.986 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9e36019:::benchmark_data_smithi188_173515_object88062:head# 2024-04-01T20:04:41.986 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9e46f61:::benchmark_data_smithi188_173515_object82642:head# 2024-04-01T20:04:42.009 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9e48a75:::benchmark_data_smithi188_173515_object149521:head# 2024-04-01T20:04:42.009 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9e7cb87:::benchmark_data_smithi188_173515_object117656:head# 2024-04-01T20:04:42.009 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9e82f1f:::benchmark_data_smithi188_173515_object115932:head# 2024-04-01T20:04:42.009 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9e96785:::benchmark_data_smithi188_173515_object72083:head# 2024-04-01T20:04:42.009 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9e9bbdb:::benchmark_data_smithi188_173515_object55272:head# 2024-04-01T20:04:42.009 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9e9f847:::benchmark_data_smithi188_173515_object150362:head# 2024-04-01T20:04:42.009 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9ea089d:::benchmark_data_smithi188_173515_object109171:head# 2024-04-01T20:04:42.009 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9ea1426:::benchmark_data_smithi188_173515_object153387:head# 2024-04-01T20:04:42.009 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9ea611e:::benchmark_data_smithi188_173515_object81054:head# 2024-04-01T20:04:42.010 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9eb7572:::benchmark_data_smithi188_173515_object107434:head# 2024-04-01T20:04:42.010 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9ec5ff1:::benchmark_data_smithi188_173515_object112211:head# 2024-04-01T20:04:42.010 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9ed33cd:::benchmark_data_smithi188_173515_object137959:head# 2024-04-01T20:04:42.010 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9ed926f:::benchmark_data_smithi188_173515_object128169:head# 2024-04-01T20:04:42.010 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9ee53cd:::benchmark_data_smithi188_173515_object100338:head# 2024-04-01T20:04:42.010 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9ee64da:::benchmark_data_smithi188_173515_object86819:head# 2024-04-01T20:04:42.010 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9ee8b84:::benchmark_data_smithi188_173515_object130894:head# 2024-04-01T20:04:42.010 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9ef1ecb:::benchmark_data_smithi188_173515_object109342:head# 2024-04-01T20:04:42.010 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9ef9cab:::benchmark_data_smithi188_173515_object117323:head# 2024-04-01T20:04:42.010 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9f03d83:::benchmark_data_smithi188_173515_object87273:head# 2024-04-01T20:04:42.010 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9f0442f:::benchmark_data_smithi188_173515_object122702:head# 2024-04-01T20:04:42.010 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9f06109:::benchmark_data_smithi188_173515_object101179:head# 2024-04-01T20:04:42.010 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9f1859c:::benchmark_data_smithi188_173515_object126273:head# 2024-04-01T20:04:42.010 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9f311b5:::benchmark_data_smithi188_173515_object59723:head# 2024-04-01T20:04:42.011 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9f358f8:::benchmark_data_smithi188_173515_object69781:head# 2024-04-01T20:04:42.011 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9f586b3:::benchmark_data_smithi188_173515_object68220:head# 2024-04-01T20:04:42.011 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9f608d4:::benchmark_data_smithi188_173515_object59085:head# 2024-04-01T20:04:42.011 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9f60e31:::benchmark_data_smithi188_173515_object103959:head# 2024-04-01T20:04:42.011 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9f7f15a:::benchmark_data_smithi188_173515_object66004:head# 2024-04-01T20:04:42.011 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9f82b71:::benchmark_data_smithi188_173515_object86157:head# 2024-04-01T20:04:42.011 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9fb160b:::benchmark_data_smithi188_173515_object146922:head# 2024-04-01T20:04:42.011 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9fb38b1:::benchmark_data_smithi188_173515_object156075:head# 2024-04-01T20:04:42.011 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9fc718d:::benchmark_data_smithi188_173515_object112130:head# 2024-04-01T20:04:42.011 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9fcebe1:::benchmark_data_smithi188_173515_object144330:head# 2024-04-01T20:04:42.011 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9fd8d56:::benchmark_data_smithi188_173515_object68501:head# 2024-04-01T20:04:42.011 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9fdfe04:::benchmark_data_smithi188_173515_object67801:head# 2024-04-01T20:04:42.011 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9fe6a13:::benchmark_data_smithi188_173515_object136396:head# 2024-04-01T20:04:42.012 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9feda04:::benchmark_data_smithi188_173515_object67680:head# 2024-04-01T20:04:42.012 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:e9ff103c:::benchmark_data_smithi188_173515_object134423:head# 2024-04-01T20:04:42.012 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea005826:::benchmark_data_smithi188_173515_object65491:head# 2024-04-01T20:04:42.012 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea005d01:::benchmark_data_smithi188_173515_object62297:head# 2024-04-01T20:04:42.012 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea007dbc:::benchmark_data_smithi188_173515_object133175:head# 2024-04-01T20:04:42.012 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea00db8a:::benchmark_data_smithi188_173515_object81642:head# 2024-04-01T20:04:42.012 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea033d8e:::benchmark_data_smithi188_173515_object118284:head# 2024-04-01T20:04:42.012 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea038141:::benchmark_data_smithi188_173515_object64358:head# 2024-04-01T20:04:42.012 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea03b6ba:::benchmark_data_smithi188_173515_object99525:head# 2024-04-01T20:04:42.012 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea052227:::benchmark_data_smithi188_173515_object152444:head# 2024-04-01T20:04:42.012 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea0574f4:::benchmark_data_smithi188_173515_object117261:head# 2024-04-01T20:04:42.012 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea06109b:::benchmark_data_smithi188_173515_object143496:head# 2024-04-01T20:04:42.012 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea062cbb:::benchmark_data_smithi188_173515_object56610:head# 2024-04-01T20:04:42.012 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea0831a1:::benchmark_data_smithi188_173515_object56590:head# 2024-04-01T20:04:42.013 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea09575e:::benchmark_data_smithi188_173515_object104347:head# 2024-04-01T20:04:42.013 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea0c9f83:::benchmark_data_smithi188_173515_object97459:head# 2024-04-01T20:04:42.013 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea0dcb8e:::benchmark_data_smithi188_173515_object78330:head# 2024-04-01T20:04:42.013 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea0f7ab7:::benchmark_data_smithi188_173515_object130988:head# 2024-04-01T20:04:42.013 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea115b3d:::benchmark_data_smithi188_173515_object70248:head# 2024-04-01T20:04:42.013 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea125a3c:::benchmark_data_smithi188_173515_object120909:head# 2024-04-01T20:04:42.013 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea13867e:::benchmark_data_smithi188_173515_object70674:head# 2024-04-01T20:04:42.013 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea139eb6:::benchmark_data_smithi188_173515_object68158:head# 2024-04-01T20:04:42.013 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea13e0c3:::benchmark_data_smithi188_173515_object118413:head# 2024-04-01T20:04:42.013 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea145c00:::benchmark_data_smithi188_173515_object149764:head# 2024-04-01T20:04:42.013 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea14e82e:::benchmark_data_smithi188_173515_object145072:head# 2024-04-01T20:04:42.013 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea153532:::benchmark_data_smithi188_173515_object58725:head# 2024-04-01T20:04:42.013 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea15ba72:::benchmark_data_smithi188_173515_object78830:head# 2024-04-01T20:04:42.013 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea15dc6f:::benchmark_data_smithi188_173515_object75473:head# 2024-04-01T20:04:42.014 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea17cb08:::benchmark_data_smithi188_173515_object112628:head# 2024-04-01T20:04:42.014 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea17ee76:::benchmark_data_smithi188_173515_object65147:head# 2024-04-01T20:04:42.014 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea17f926:::benchmark_data_smithi188_173515_object80052:head# 2024-04-01T20:04:42.014 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea1837ff:::benchmark_data_smithi188_173515_object133488:head# 2024-04-01T20:04:42.014 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea188663:::benchmark_data_smithi188_173515_object112001:head# 2024-04-01T20:04:42.014 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea18e94a:::benchmark_data_smithi188_173515_object83151:head# 2024-04-01T20:04:42.014 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea1ae950:::benchmark_data_smithi188_173515_object68427:head# 2024-04-01T20:04:42.014 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea1c5b3b:::benchmark_data_smithi188_173515_object53470:head# 2024-04-01T20:04:42.014 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea1cb6ce:::benchmark_data_smithi188_173515_object74548:head# 2024-04-01T20:04:42.014 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea1ccc9b:::benchmark_data_smithi188_173515_object60192:head# 2024-04-01T20:04:42.014 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea1e1a87:::benchmark_data_smithi188_173515_object71130:head# 2024-04-01T20:04:42.014 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea1e75c9:::benchmark_data_smithi188_173515_object114726:head# 2024-04-01T20:04:42.014 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea1e7f10:::benchmark_data_smithi188_173515_object82251:head# 2024-04-01T20:04:42.014 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea1f5c43:::benchmark_data_smithi188_173515_object63149:head# 2024-04-01T20:04:42.015 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea1ff8bd:::benchmark_data_smithi188_173515_object120031:head# 2024-04-01T20:04:42.015 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea20bec2:::benchmark_data_smithi188_173515_object75315:head# 2024-04-01T20:04:42.015 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea20eeb5:::benchmark_data_smithi188_173515_object90773:head# 2024-04-01T20:04:42.015 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea21c3e0:::benchmark_data_smithi188_173515_object115917:head# 2024-04-01T20:04:42.015 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea22d9a8:::benchmark_data_smithi188_173515_object99488:head# 2024-04-01T20:04:42.015 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea22f3f3:::benchmark_data_smithi188_173515_object126745:head# 2024-04-01T20:04:42.015 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea23371d:::benchmark_data_smithi188_173515_object117915:head# 2024-04-01T20:04:42.015 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea235c41:::benchmark_data_smithi188_173515_object90606:head# 2024-04-01T20:04:42.015 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea23d088:::benchmark_data_smithi188_173515_object50216:head# 2024-04-01T20:04:42.015 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea244cc3:::benchmark_data_smithi188_173515_object47837:head# 2024-04-01T20:04:42.015 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea248da9:::benchmark_data_smithi188_173515_object104353:head# 2024-04-01T20:04:42.015 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea2498a3:::benchmark_data_smithi188_173515_object74853:head# 2024-04-01T20:04:42.015 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea25ecb9:::benchmark_data_smithi188_173515_object147054:head# 2024-04-01T20:04:42.015 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea25eced:::benchmark_data_smithi188_173515_object122583:head# 2024-04-01T20:04:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea262310:::benchmark_data_smithi188_173515_object133223:head# 2024-04-01T20:04:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea26ef1d:::benchmark_data_smithi188_173515_object62786:head# 2024-04-01T20:04:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea270f43:::benchmark_data_smithi188_173515_object126802:head# 2024-04-01T20:04:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea296bad:::benchmark_data_smithi188_173515_object109089:head# 2024-04-01T20:04:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea298c37:::benchmark_data_smithi188_173515_object45571:head# 2024-04-01T20:04:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea2a6a38:::benchmark_data_smithi188_173515_object141410:head# 2024-04-01T20:04:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea2abac5:::benchmark_data_smithi188_173515_object58056:head# 2024-04-01T20:04:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea2b6054:::benchmark_data_smithi188_173515_object64783:head# 2024-04-01T20:04:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea2bb1f5:::benchmark_data_smithi188_173515_object151368:head# 2024-04-01T20:04:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea2c4290:::benchmark_data_smithi188_173515_object139338:head# 2024-04-01T20:04:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea2f47d6:::benchmark_data_smithi188_173515_object64185:head# 2024-04-01T20:04:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea2f5f05:::benchmark_data_smithi188_173515_object104343:head# 2024-04-01T20:04:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea30d6c7:::benchmark_data_smithi188_173515_object101363:head# 2024-04-01T20:04:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea310534:::benchmark_data_smithi188_173515_object94498:head# 2024-04-01T20:04:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea3129fa:::benchmark_data_smithi188_173515_object58155:head# 2024-04-01T20:04:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea31a2d7:::benchmark_data_smithi188_173515_object62578:head# 2024-04-01T20:04:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea31a973:::benchmark_data_smithi188_173515_object63086:head# 2024-04-01T20:04:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea31aa4d:::benchmark_data_smithi188_173515_object127324:head# 2024-04-01T20:04:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea31cb07:::benchmark_data_smithi188_173515_object85406:head# 2024-04-01T20:04:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea32819b:::benchmark_data_smithi188_173515_object111558:head# 2024-04-01T20:04:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea32bbea:::benchmark_data_smithi188_173515_object76519:head# 2024-04-01T20:04:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea32c029:::benchmark_data_smithi188_173515_object74513:head# 2024-04-01T20:04:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea3357f2:::benchmark_data_smithi188_173515_object59533:head# 2024-04-01T20:04:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea33c98b:::benchmark_data_smithi188_173515_object49293:head# 2024-04-01T20:04:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea34762a:::benchmark_data_smithi188_173515_object97299:head# 2024-04-01T20:04:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea3481fc:::benchmark_data_smithi188_173515_object114326:head# 2024-04-01T20:04:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea349ebb:::benchmark_data_smithi188_173515_object88346:head# 2024-04-01T20:04:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea34e38c:::benchmark_data_smithi188_173515_object148764:head# 2024-04-01T20:04:42.018 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea359a40:::benchmark_data_smithi188_173515_object67561:head# 2024-04-01T20:04:42.018 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea35cc53:::benchmark_data_smithi188_173515_object62215:head# 2024-04-01T20:04:42.018 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea363a09:::benchmark_data_smithi188_173515_object106059:head# 2024-04-01T20:04:42.018 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea37755d:::benchmark_data_smithi188_173515_object99812:head# 2024-04-01T20:04:42.018 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea37aef7:::benchmark_data_smithi188_173515_object129742:head# 2024-04-01T20:04:42.018 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea381597:::benchmark_data_smithi188_173515_object126439:head# 2024-04-01T20:04:42.018 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea3a4117:::benchmark_data_smithi188_173515_object113931:head# 2024-04-01T20:04:42.018 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea3a7aac:::benchmark_data_smithi188_173515_object48675:head# 2024-04-01T20:04:42.018 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea3ab20a:::benchmark_data_smithi188_173515_object126257:head# 2024-04-01T20:04:42.018 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea3abfa3:::benchmark_data_smithi188_173515_object95130:head# 2024-04-01T20:04:42.018 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea3b27c7:::benchmark_data_smithi188_173515_object132598:head# 2024-04-01T20:04:42.018 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea3c54b8:::benchmark_data_smithi188_173515_object89122:head# 2024-04-01T20:04:42.018 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea3c75c3:::benchmark_data_smithi188_173515_object85244:head# 2024-04-01T20:04:42.018 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea3ce0df:::benchmark_data_smithi188_173515_object153018:head# 2024-04-01T20:04:42.019 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea3d5e3b:::benchmark_data_smithi188_173515_object59320:head# 2024-04-01T20:04:42.019 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea3df071:::benchmark_data_smithi188_173515_object143303:head# 2024-04-01T20:04:42.019 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea3e03c3:::benchmark_data_smithi188_173515_object63365:head# 2024-04-01T20:04:42.019 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea3e3309:::benchmark_data_smithi188_173515_object102338:head# 2024-04-01T20:04:42.019 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea3eaf4c:::benchmark_data_smithi188_173515_object125264:head# 2024-04-01T20:04:42.019 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea402d57:::benchmark_data_smithi188_173515_object131463:head# 2024-04-01T20:04:42.019 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea404b4d:::benchmark_data_smithi188_173515_object108149:head# 2024-04-01T20:04:42.019 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea4082c6:::benchmark_data_smithi188_173515_object105618:head# 2024-04-01T20:04:42.019 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea418abf:::benchmark_data_smithi188_173515_object84971:head# 2024-04-01T20:04:42.019 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea420764:::benchmark_data_smithi188_173515_object155671:head# 2024-04-01T20:04:42.019 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea420c83:::benchmark_data_smithi188_173515_object73195:head# 2024-04-01T20:04:42.019 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea43a299:::benchmark_data_smithi188_173515_object50870:head# 2024-04-01T20:04:42.019 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea43e08b:::benchmark_data_smithi188_173515_object151681:head# 2024-04-01T20:04:42.019 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea44866a:::benchmark_data_smithi188_173515_object143067:head# 2024-04-01T20:04:42.020 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea44e5d1:::benchmark_data_smithi188_173515_object45575:head# 2024-04-01T20:04:42.020 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea45fc5c:::benchmark_data_smithi188_173515_object55491:head# 2024-04-01T20:04:42.020 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea46fe63:::benchmark_data_smithi188_173515_object112477:head# 2024-04-01T20:04:42.020 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea46fe9b:::benchmark_data_smithi188_173515_object46117:head# 2024-04-01T20:04:42.020 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea48057d:::benchmark_data_smithi188_173515_object113888:head# 2024-04-01T20:04:42.020 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea48b157:::benchmark_data_smithi188_173515_object49714:head# 2024-04-01T20:04:42.020 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea4954ad:::benchmark_data_smithi188_173515_object51071:head# 2024-04-01T20:04:42.020 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea49b8bc:::benchmark_data_smithi188_173515_object86436:head# 2024-04-01T20:04:42.020 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea49cdb2:::benchmark_data_smithi188_173515_object62466:head# 2024-04-01T20:04:42.020 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea4bd471:::benchmark_data_smithi188_173515_object77605:head# 2024-04-01T20:04:42.020 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea4c3f25:::benchmark_data_smithi188_173515_object111274:head# 2024-04-01T20:04:42.020 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea4f3554:::benchmark_data_smithi188_173515_object94980:head# 2024-04-01T20:04:42.020 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea4f61b0:::benchmark_data_smithi188_173515_object122991:head# 2024-04-01T20:04:42.020 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea4fbe17:::benchmark_data_smithi188_173515_object153075:head# 2024-04-01T20:04:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea505dbe:::benchmark_data_smithi188_173515_object134798:head# 2024-04-01T20:04:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea508e52:::benchmark_data_smithi188_173515_object85734:head# 2024-04-01T20:04:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea514a65:::benchmark_data_smithi188_173515_object83955:head# 2024-04-01T20:04:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea52709c:::benchmark_data_smithi188_173515_object51893:head# 2024-04-01T20:04:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea534790:::benchmark_data_smithi188_173515_object47866:head# 2024-04-01T20:04:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea54b501:::benchmark_data_smithi188_173515_object72223:head# 2024-04-01T20:04:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea55542a:::benchmark_data_smithi188_173515_object137591:head# 2024-04-01T20:04:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea559be9:::benchmark_data_smithi188_173515_object83044:head# 2024-04-01T20:04:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea559c68:::benchmark_data_smithi188_173515_object57601:head# 2024-04-01T20:04:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea573d3c:::benchmark_data_smithi188_173515_object146653:head# 2024-04-01T20:04:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea5745ae:::benchmark_data_smithi188_173515_object47414:head# 2024-04-01T20:04:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea581144:::benchmark_data_smithi188_173515_object145979:head# 2024-04-01T20:04:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea589470:::benchmark_data_smithi188_173515_object151748:head# 2024-04-01T20:04:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea589635:::benchmark_data_smithi188_173515_object81653:head# 2024-04-01T20:04:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea58de7b:::benchmark_data_smithi188_173515_object113123:head# 2024-04-01T20:04:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea596de2:::benchmark_data_smithi188_173515_object49084:head# 2024-04-01T20:04:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea5bfc15:::benchmark_data_smithi188_173515_object103807:head# 2024-04-01T20:04:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea5c848e:::benchmark_data_smithi188_173515_object74380:head# 2024-04-01T20:04:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea5ca718:::benchmark_data_smithi188_173515_object143042:head# 2024-04-01T20:04:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea5ccd10:::benchmark_data_smithi188_173515_object52124:head# 2024-04-01T20:04:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea5dc7d4:::benchmark_data_smithi188_173515_object152944:head# 2024-04-01T20:04:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea5e258b:::benchmark_data_smithi188_173515_object96396:head# 2024-04-01T20:04:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea5e7b4d:::benchmark_data_smithi188_173515_object91677:head# 2024-04-01T20:04:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea5e9680:::benchmark_data_smithi188_173515_object63145:head# 2024-04-01T20:04:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea5edb94:::benchmark_data_smithi188_173515_object87199:head# 2024-04-01T20:04:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea5f79ce:::benchmark_data_smithi188_173515_object101683:head# 2024-04-01T20:04:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea5f80de:::benchmark_data_smithi188_173515_object152150:head# 2024-04-01T20:04:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea5fe8c8:::benchmark_data_smithi188_173515_object64472:head# 2024-04-01T20:04:42.050 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea612dc0:::benchmark_data_smithi188_173515_object99130:head# 2024-04-01T20:04:42.050 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea61ac5e:::benchmark_data_smithi188_173515_object64499:head# 2024-04-01T20:04:42.050 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea61f116:::benchmark_data_smithi188_173515_object94839:head# 2024-04-01T20:04:42.050 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea6330cd:::benchmark_data_smithi188_173515_object92291:head# 2024-04-01T20:04:42.051 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea63c1bf:::benchmark_data_smithi188_173515_object69030:head# 2024-04-01T20:04:42.051 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea6508bc:::benchmark_data_smithi188_173515_object46749:head# 2024-04-01T20:04:42.051 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea662af9:::benchmark_data_smithi188_173515_object56300:head# 2024-04-01T20:04:42.051 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea67366b:::benchmark_data_smithi188_173515_object48978:head# 2024-04-01T20:04:42.051 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea675fce:::benchmark_data_smithi188_173515_object131651:head# 2024-04-01T20:04:42.051 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea677f24:::benchmark_data_smithi188_173515_object111627:head# 2024-04-01T20:04:42.051 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea688227:::benchmark_data_smithi188_173515_object49966:head# 2024-04-01T20:04:42.051 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea68afb6:::benchmark_data_smithi188_173515_object153350:head# 2024-04-01T20:04:42.051 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea691ee6:::benchmark_data_smithi188_173515_object84667:head# 2024-04-01T20:04:42.051 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea6a6b44:::benchmark_data_smithi188_173515_object53649:head# 2024-04-01T20:04:42.051 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea6a8413:::benchmark_data_smithi188_173515_object151932:head# 2024-04-01T20:04:42.051 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea6a955e:::benchmark_data_smithi188_173515_object97042:head# 2024-04-01T20:04:42.052 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea6ab85f:::benchmark_data_smithi188_173515_object97027:head# 2024-04-01T20:04:42.052 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea6b32b6:::benchmark_data_smithi188_173515_object108197:head# 2024-04-01T20:04:42.052 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea6daf25:::benchmark_data_smithi188_173515_object61386:head# 2024-04-01T20:04:42.052 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea6eaf28:::benchmark_data_smithi188_173515_object97378:head# 2024-04-01T20:04:42.052 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea6eefbf:::benchmark_data_smithi188_173515_object154692:head# 2024-04-01T20:04:42.052 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea6f8640:::benchmark_data_smithi188_173515_object80602:head# 2024-04-01T20:04:42.052 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea7106b0:::benchmark_data_smithi188_173515_object153182:head# 2024-04-01T20:04:42.052 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea7164a4:::benchmark_data_smithi188_173515_object69514:head# 2024-04-01T20:04:42.052 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea722bdc:::benchmark_data_smithi188_173515_object96654:head# 2024-04-01T20:04:42.052 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea72a9a1:::benchmark_data_smithi188_173515_object72640:head# 2024-04-01T20:04:42.052 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea732895:::benchmark_data_smithi188_173515_object99552:head# 2024-04-01T20:04:42.052 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea732bb9:::benchmark_data_smithi188_173515_object78300:head# 2024-04-01T20:04:42.052 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea732f8f:::benchmark_data_smithi188_173515_object125515:head# 2024-04-01T20:04:42.052 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea74ec79:::benchmark_data_smithi188_173515_object130581:head# 2024-04-01T20:04:42.053 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea750538:::benchmark_data_smithi188_173515_object154693:head# 2024-04-01T20:04:42.053 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea757e92:::benchmark_data_smithi188_173515_object67482:head# 2024-04-01T20:04:42.053 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea7609ca:::benchmark_data_smithi188_173515_object79642:head# 2024-04-01T20:04:42.053 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea760cd8:::benchmark_data_smithi188_173515_object134664:head# 2024-04-01T20:04:42.053 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea774bd2:::benchmark_data_smithi188_173515_object133258:head# 2024-04-01T20:04:42.053 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea77dd5d:::benchmark_data_smithi188_173515_object88219:head# 2024-04-01T20:04:42.053 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea77f2b7:::benchmark_data_smithi188_173515_object65690:head# 2024-04-01T20:04:42.053 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea785f18:::benchmark_data_smithi188_173515_object82793:head# 2024-04-01T20:04:42.053 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea78dd7c:::benchmark_data_smithi188_173515_object77585:head# 2024-04-01T20:04:42.053 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea78ec79:::benchmark_data_smithi188_173515_object113663:head# 2024-04-01T20:04:42.053 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea794a09:::benchmark_data_smithi188_173515_object72566:head# 2024-04-01T20:04:42.053 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea7a3f97:::benchmark_data_smithi188_173515_object147912:head# 2024-04-01T20:04:42.053 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea7a8f24:::benchmark_data_smithi188_173515_object139687:head# 2024-04-01T20:04:42.054 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea7ba4f0:::benchmark_data_smithi188_173515_object98953:head# 2024-04-01T20:04:42.054 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea7c0908:::benchmark_data_smithi188_173515_object82548:head# 2024-04-01T20:04:42.054 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea7c7669:::benchmark_data_smithi188_173515_object75594:head# 2024-04-01T20:04:42.054 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea7e4ea8:::benchmark_data_smithi188_173515_object129348:head# 2024-04-01T20:04:42.054 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea7f583c:::benchmark_data_smithi188_173515_object109765:head# 2024-04-01T20:04:42.054 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea7fd3ec:::benchmark_data_smithi188_173515_object129561:head# 2024-04-01T20:04:42.054 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea81ca62:::benchmark_data_smithi188_173515_object48424:head# 2024-04-01T20:04:42.054 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea820784:::benchmark_data_smithi188_173515_object133649:head# 2024-04-01T20:04:42.054 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea823ba0:::benchmark_data_smithi188_173515_object134907:head# 2024-04-01T20:04:42.054 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea833424:::benchmark_data_smithi188_173515_object83471:head# 2024-04-01T20:04:42.054 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea847516:::benchmark_data_smithi188_173515_object151975:head# 2024-04-01T20:04:42.054 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea84b661:::benchmark_data_smithi188_173515_object139857:head# 2024-04-01T20:04:42.054 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea855a4a:::benchmark_data_smithi188_173515_object146213:head# 2024-04-01T20:04:42.055 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea857f53:::benchmark_data_smithi188_173515_object98441:head# 2024-04-01T20:04:42.055 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea859698:::benchmark_data_smithi188_173515_object132648:head# 2024-04-01T20:04:42.055 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea85a3e9:::benchmark_data_smithi188_173515_object98816:head# 2024-04-01T20:04:42.055 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea863342:::benchmark_data_smithi188_173515_object118067:head# 2024-04-01T20:04:42.055 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea86a864:::benchmark_data_smithi188_173515_object91693:head# 2024-04-01T20:04:42.055 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea86b36d:::benchmark_data_smithi188_173515_object155962:head# 2024-04-01T20:04:42.055 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea8773be:::benchmark_data_smithi188_173515_object155913:head# 2024-04-01T20:04:42.055 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea878c84:::benchmark_data_smithi188_173515_object80694:head# 2024-04-01T20:04:42.055 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea87e2a3:::benchmark_data_smithi188_173515_object97181:head# 2024-04-01T20:04:42.055 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea884b3c:::benchmark_data_smithi188_173515_object74263:head# 2024-04-01T20:04:42.055 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea888947:::benchmark_data_smithi188_173515_object108782:head# 2024-04-01T20:04:42.055 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea88a11a:::benchmark_data_smithi188_173515_object155760:head# 2024-04-01T20:04:42.055 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea893863:::benchmark_data_smithi188_173515_object116572:head# 2024-04-01T20:04:42.056 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea89b82b:::benchmark_data_smithi188_173515_object113921:head# 2024-04-01T20:04:42.056 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea89c18d:::benchmark_data_smithi188_173515_object63628:head# 2024-04-01T20:04:42.056 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea89c2c3:::benchmark_data_smithi188_173515_object114216:head# 2024-04-01T20:04:42.056 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea89d130:::benchmark_data_smithi188_173515_object146093:head# 2024-04-01T20:04:42.056 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea89e283:::benchmark_data_smithi188_173515_object67468:head# 2024-04-01T20:04:42.056 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea8ad353:::benchmark_data_smithi188_173515_object125674:head# 2024-04-01T20:04:42.056 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea8b723d:::benchmark_data_smithi188_173515_object63001:head# 2024-04-01T20:04:42.056 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea8b85f7:::benchmark_data_smithi188_173515_object147324:head# 2024-04-01T20:04:42.056 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea8bc737:::benchmark_data_smithi188_173515_object102505:head# 2024-04-01T20:04:42.056 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea8c589e:::benchmark_data_smithi188_173515_object134994:head# 2024-04-01T20:04:42.056 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea8cff2c:::benchmark_data_smithi188_173515_object123949:head# 2024-04-01T20:04:42.056 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea8e6939:::benchmark_data_smithi188_173515_object126787:head# 2024-04-01T20:04:42.056 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea8e7e49:::benchmark_data_smithi188_173515_object155173:head# 2024-04-01T20:04:42.056 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea8f1933:::benchmark_data_smithi188_173515_object90594:head# 2024-04-01T20:04:42.056 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea8f75ae:::benchmark_data_smithi188_173515_object140433:head# 2024-04-01T20:04:42.057 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea8f8c63:::benchmark_data_smithi188_173515_object126222:head# 2024-04-01T20:04:42.057 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea8fffe1:::benchmark_data_smithi188_173515_object78705:head# 2024-04-01T20:04:42.057 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea911bfb:::benchmark_data_smithi188_173515_object100073:head# 2024-04-01T20:04:42.057 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea914014:::benchmark_data_smithi188_173515_object79823:head# 2024-04-01T20:04:42.057 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea91ed69:::benchmark_data_smithi188_173515_object77040:head# 2024-04-01T20:04:42.057 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea923ad1:::benchmark_data_smithi188_173515_object51222:head# 2024-04-01T20:04:42.057 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea925130:::benchmark_data_smithi188_173515_object52041:head# 2024-04-01T20:04:42.057 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea92618a:::benchmark_data_smithi188_173515_object95235:head# 2024-04-01T20:04:42.057 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea92aba8:::benchmark_data_smithi188_173515_object128661:head# 2024-04-01T20:04:42.057 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea92f013:::benchmark_data_smithi188_173515_object106106:head# 2024-04-01T20:04:42.057 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea9301a6:::benchmark_data_smithi188_173515_object49653:head# 2024-04-01T20:04:42.057 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea936057:::benchmark_data_smithi188_173515_object154123:head# 2024-04-01T20:04:42.057 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea939b5e:::benchmark_data_smithi188_173515_object135798:head# 2024-04-01T20:04:42.057 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea94e70c:::benchmark_data_smithi188_173515_object75443:head# 2024-04-01T20:04:42.058 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea95914c:::benchmark_data_smithi188_173515_object133945:head# 2024-04-01T20:04:42.058 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea95cf1a:::benchmark_data_smithi188_173515_object92627:head# 2024-04-01T20:04:42.058 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea970a66:::benchmark_data_smithi188_173515_object53057:head# 2024-04-01T20:04:42.058 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea976458:::benchmark_data_smithi188_173515_object99924:head# 2024-04-01T20:04:42.058 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea9775aa:::benchmark_data_smithi188_173515_object103605:head# 2024-04-01T20:04:42.058 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea97edd3:::benchmark_data_smithi188_173515_object121561:head# 2024-04-01T20:04:42.058 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea985b58:::benchmark_data_smithi188_173515_object72080:head# 2024-04-01T20:04:42.058 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea986263:::benchmark_data_smithi188_173515_object47156:head# 2024-04-01T20:04:42.058 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea99ab7a:::benchmark_data_smithi188_173515_object136847:head# 2024-04-01T20:04:42.058 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea99cf2f:::benchmark_data_smithi188_173515_object92332:head# 2024-04-01T20:04:42.058 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea99d187:::benchmark_data_smithi188_173515_object107255:head# 2024-04-01T20:04:42.058 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea99dcba:::benchmark_data_smithi188_173515_object80444:head# 2024-04-01T20:04:42.058 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea9bbc5c:::benchmark_data_smithi188_173515_object114904:head# 2024-04-01T20:04:42.059 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea9c2a21:::benchmark_data_smithi188_173515_object57330:head# 2024-04-01T20:04:42.059 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea9d52d2:::benchmark_data_smithi188_173515_object67321:head# 2024-04-01T20:04:42.059 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea9d5d9b:::benchmark_data_smithi188_173515_object130420:head# 2024-04-01T20:04:42.059 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea9d5f3a:::benchmark_data_smithi188_173515_object143183:head# 2024-04-01T20:04:42.059 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea9dfca7:::benchmark_data_smithi188_173515_object122772:head# 2024-04-01T20:04:42.059 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea9e9187:::benchmark_data_smithi188_173515_object103230:head# 2024-04-01T20:04:42.059 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea9ea81a:::benchmark_data_smithi188_173515_object124555:head# 2024-04-01T20:04:42.059 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea9f532b:::benchmark_data_smithi188_173515_object77295:head# 2024-04-01T20:04:42.059 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ea9ff4f6:::benchmark_data_smithi188_173515_object141007:head# 2024-04-01T20:04:42.059 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaa01f10:::benchmark_data_smithi188_173515_object110295:head# 2024-04-01T20:04:42.059 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaa08b91:::benchmark_data_smithi188_173515_object121425:head# 2024-04-01T20:04:42.059 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaa0b4cb:::benchmark_data_smithi188_173515_object111153:head# 2024-04-01T20:04:42.059 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaa1a31a:::benchmark_data_smithi188_173515_object136408:head# 2024-04-01T20:04:42.059 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaa2fa35:::benchmark_data_smithi188_173515_object139777:head# 2024-04-01T20:04:42.059 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaa48580:::benchmark_data_smithi188_173515_object69161:head# 2024-04-01T20:04:42.060 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaa48dc2:::benchmark_data_smithi188_173515_object87757:head# 2024-04-01T20:04:42.060 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaa4d088:::benchmark_data_smithi188_173515_object133139:head# 2024-04-01T20:04:42.060 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaa5adc6:::benchmark_data_smithi188_173515_object102871:head# 2024-04-01T20:04:42.060 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaa6c35b:::benchmark_data_smithi188_173515_object98089:head# 2024-04-01T20:04:42.060 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaa709bb:::benchmark_data_smithi188_173515_object101991:head# 2024-04-01T20:04:42.060 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaa725c9:::benchmark_data_smithi188_173515_object139461:head# 2024-04-01T20:04:42.060 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaa76213:::benchmark_data_smithi188_173515_object120880:head# 2024-04-01T20:04:42.060 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaa7e6a9:::benchmark_data_smithi188_173515_object125830:head# 2024-04-01T20:04:42.060 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaa80d81:::benchmark_data_smithi188_173515_object133229:head# 2024-04-01T20:04:42.060 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaa8a706:::benchmark_data_smithi188_173515_object154872:head# 2024-04-01T20:04:42.060 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaa8c906:::benchmark_data_smithi188_173515_object65135:head# 2024-04-01T20:04:42.060 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaa97e4f:::benchmark_data_smithi188_173515_object139853:head# 2024-04-01T20:04:42.060 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaaa4d42:::benchmark_data_smithi188_173515_object89010:head# 2024-04-01T20:04:42.061 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaaa7878:::benchmark_data_smithi188_173515_object72417:head# 2024-04-01T20:04:42.061 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaaae1f4:::benchmark_data_smithi188_173515_object86858:head# 2024-04-01T20:04:42.061 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaab6200:::benchmark_data_smithi188_173515_object144256:head# 2024-04-01T20:04:42.061 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaabc0d7:::benchmark_data_smithi188_173515_object53027:head# 2024-04-01T20:04:42.061 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaac954e:::benchmark_data_smithi188_173515_object57883:head# 2024-04-01T20:04:42.061 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaaec75b:::benchmark_data_smithi188_173515_object150895:head# 2024-04-01T20:04:42.061 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eab03aec:::benchmark_data_smithi188_173515_object77370:head# 2024-04-01T20:04:42.061 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eab05acc:::benchmark_data_smithi188_173515_object76801:head# 2024-04-01T20:04:42.061 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eab1ce34:::benchmark_data_smithi188_173515_object137321:head# 2024-04-01T20:04:42.061 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eab257dd:::benchmark_data_smithi188_173515_object53408:head# 2024-04-01T20:04:42.061 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eab2d6e1:::benchmark_data_smithi188_173515_object97658:head# 2024-04-01T20:04:42.061 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eab34e55:::benchmark_data_smithi188_173515_object153424:head# 2024-04-01T20:04:42.061 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eab3b7eb:::benchmark_data_smithi188_173515_object100376:head# 2024-04-01T20:04:42.061 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eab4a475:::benchmark_data_smithi188_173515_object84952:head# 2024-04-01T20:04:42.062 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eab5a966:::benchmark_data_smithi188_173515_object74201:head# 2024-04-01T20:04:42.062 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eab5b79b:::benchmark_data_smithi188_173515_object116731:head# 2024-04-01T20:04:42.062 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eab79723:::benchmark_data_smithi188_173515_object53738:head# 2024-04-01T20:04:42.062 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eab81a03:::benchmark_data_smithi188_173515_object45703:head# 2024-04-01T20:04:42.062 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eab8ddea:::benchmark_data_smithi188_173515_object149079:head# 2024-04-01T20:04:42.062 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eabacd97:::benchmark_data_smithi188_173515_object124607:head# 2024-04-01T20:04:42.062 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eabbb572:::benchmark_data_smithi188_173515_object78375:head# 2024-04-01T20:04:42.062 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eabebdf7:::benchmark_data_smithi188_173515_object80145:head# 2024-04-01T20:04:42.062 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eabf51be:::benchmark_data_smithi188_173515_object58620:head# 2024-04-01T20:04:42.062 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eabf6fed:::benchmark_data_smithi188_173515_object86660:head# 2024-04-01T20:04:42.062 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eac024ff:::benchmark_data_smithi188_173515_object90650:head# 2024-04-01T20:04:42.062 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eac06774:::benchmark_data_smithi188_173515_object100078:head# 2024-04-01T20:04:42.062 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eac1a1b3:::benchmark_data_smithi188_173515_object111889:head# 2024-04-01T20:04:42.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eac35ea7:::benchmark_data_smithi188_173515_object100149:head# 2024-04-01T20:04:42.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eac3c9c7:::benchmark_data_smithi188_173515_object54486:head# 2024-04-01T20:04:42.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eac48214:::benchmark_data_smithi188_173515_object85786:head# 2024-04-01T20:04:42.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eac50551:::benchmark_data_smithi188_173515_object89860:head# 2024-04-01T20:04:42.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eac522af:::benchmark_data_smithi188_173515_object63320:head# 2024-04-01T20:04:42.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eac6418b:::benchmark_data_smithi188_173515_object83707:head# 2024-04-01T20:04:42.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eac6a48f:::benchmark_data_smithi188_173515_object123621:head# 2024-04-01T20:04:42.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eac8bfea:::benchmark_data_smithi188_173515_object138656:head# 2024-04-01T20:04:42.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eac8f89c:::benchmark_data_smithi188_173515_object89105:head# 2024-04-01T20:04:42.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eac9a2cd:::benchmark_data_smithi188_173515_object64892:head# 2024-04-01T20:04:42.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eacb7ba1:::benchmark_data_smithi188_173515_object112508:head# 2024-04-01T20:04:42.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eacc140e:::benchmark_data_smithi188_173515_object151885:head# 2024-04-01T20:04:42.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eacc4101:::benchmark_data_smithi188_173515_object66693:head# 2024-04-01T20:04:42.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eacc5f58:::benchmark_data_smithi188_173515_object45878:head# 2024-04-01T20:04:42.063 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eacd030b:::benchmark_data_smithi188_173515_object141180:head# 2024-04-01T20:04:42.064 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eacd3f4a:::benchmark_data_smithi188_173515_object92660:head# 2024-04-01T20:04:42.064 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eacd73c6:::benchmark_data_smithi188_173515_object96971:head# 2024-04-01T20:04:42.064 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eacd7f12:::benchmark_data_smithi188_173515_object149881:head# 2024-04-01T20:04:42.064 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eacfd5d5:::benchmark_data_smithi188_173515_object71110:head# 2024-04-01T20:04:42.064 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eacfd775:::benchmark_data_smithi188_173515_object95711:head# 2024-04-01T20:04:42.064 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ead1aedc:::benchmark_data_smithi188_173515_object79884:head# 2024-04-01T20:04:42.064 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ead2034e:::benchmark_data_smithi188_173515_object54730:head# 2024-04-01T20:04:42.064 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ead2c594:::benchmark_data_smithi188_173515_object154107:head# 2024-04-01T20:04:42.064 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ead36358:::benchmark_data_smithi188_173515_object68726:head# 2024-04-01T20:04:42.064 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ead36fc0:::benchmark_data_smithi188_173515_object150423:head# 2024-04-01T20:04:42.064 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ead40944:::benchmark_data_smithi188_173515_object50495:head# 2024-04-01T20:04:42.064 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ead558cb:::benchmark_data_smithi188_173515_object85985:head# 2024-04-01T20:04:42.064 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ead57750:::benchmark_data_smithi188_173515_object142494:head# 2024-04-01T20:04:42.064 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ead6a201:::benchmark_data_smithi188_173515_object75059:head# 2024-04-01T20:04:42.065 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ead75f76:::benchmark_data_smithi188_173515_object154327:head# 2024-04-01T20:04:42.065 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ead76677:::benchmark_data_smithi188_173515_object60023:head# 2024-04-01T20:04:42.065 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ead78741:::benchmark_data_smithi188_173515_object61004:head# 2024-04-01T20:04:42.065 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ead7ee0f:::benchmark_data_smithi188_173515_object112627:head# 2024-04-01T20:04:42.065 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ead8b61f:::benchmark_data_smithi188_173515_object147259:head# 2024-04-01T20:04:42.065 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ead912af:::benchmark_data_smithi188_173515_object71651:head# 2024-04-01T20:04:42.065 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ead95434:::benchmark_data_smithi188_173515_object139049:head# 2024-04-01T20:04:42.065 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ead98190:::benchmark_data_smithi188_173515_object104670:head# 2024-04-01T20:04:42.065 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ead9eb40:::benchmark_data_smithi188_173515_object50254:head# 2024-04-01T20:04:42.065 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eada0d06:::benchmark_data_smithi188_173515_object151261:head# 2024-04-01T20:04:42.065 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eada6b83:::benchmark_data_smithi188_173515_object118881:head# 2024-04-01T20:04:42.065 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eadb43f6:::benchmark_data_smithi188_173515_object118724:head# 2024-04-01T20:04:42.065 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eadc293f:::benchmark_data_smithi188_173515_object82673:head# 2024-04-01T20:04:42.065 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eadc3b31:::benchmark_data_smithi188_173515_object50203:head# 2024-04-01T20:04:42.066 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eadc778e:::benchmark_data_smithi188_173515_object96460:head# 2024-04-01T20:04:42.066 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eadd1785:::benchmark_data_smithi188_173515_object80605:head# 2024-04-01T20:04:42.066 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eadd357a:::benchmark_data_smithi188_173515_object76628:head# 2024-04-01T20:04:42.066 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eadd5980:::benchmark_data_smithi188_173515_object48457:head# 2024-04-01T20:04:42.066 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaddc460:::benchmark_data_smithi188_173515_object124223:head# 2024-04-01T20:04:42.066 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eade280a:::benchmark_data_smithi188_173515_object94602:head# 2024-04-01T20:04:42.066 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eade629d:::benchmark_data_smithi188_173515_object69507:head# 2024-04-01T20:04:42.066 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eadeb23e:::benchmark_data_smithi188_173515_object118512:head# 2024-04-01T20:04:42.066 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eadf1b5e:::benchmark_data_smithi188_173515_object139395:head# 2024-04-01T20:04:42.066 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eadf23cc:::benchmark_data_smithi188_173515_object68815:head# 2024-04-01T20:04:42.066 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eadf4771:::benchmark_data_smithi188_173515_object144769:head# 2024-04-01T20:04:42.066 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eadf667e:::benchmark_data_smithi188_173515_object146737:head# 2024-04-01T20:04:42.066 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eae10135:::benchmark_data_smithi188_173515_object66507:head# 2024-04-01T20:04:42.066 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eae10def:::benchmark_data_smithi188_173515_object118594:head# 2024-04-01T20:04:42.067 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eae113c1:::benchmark_data_smithi188_173515_object58622:head# 2024-04-01T20:04:42.067 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eae18cc4:::benchmark_data_smithi188_173515_object53370:head# 2024-04-01T20:04:42.094 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eae1d1cc:::benchmark_data_smithi188_173515_object144204:head# 2024-04-01T20:04:42.094 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eae2a9e9:::benchmark_data_smithi188_173515_object138642:head# 2024-04-01T20:04:42.094 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eae406b3:::benchmark_data_smithi188_173515_object139572:head# 2024-04-01T20:04:42.095 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eae41c7f:::benchmark_data_smithi188_173515_object122913:head# 2024-04-01T20:04:42.095 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eae44723:::benchmark_data_smithi188_173515_object59883:head# 2024-04-01T20:04:42.095 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eae4654e:::benchmark_data_smithi188_173515_object49737:head# 2024-04-01T20:04:42.095 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eae46f14:::benchmark_data_smithi188_173515_object77093:head# 2024-04-01T20:04:42.095 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eae60beb:::benchmark_data_smithi188_173515_object52375:head# 2024-04-01T20:04:42.095 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eae615bc:::benchmark_data_smithi188_173515_object49611:head# 2024-04-01T20:04:42.095 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eae6180b:::benchmark_data_smithi188_173515_object132758:head# 2024-04-01T20:04:42.095 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eae74337:::benchmark_data_smithi188_173515_object104810:head# 2024-04-01T20:04:42.095 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eae7e575:::benchmark_data_smithi188_173515_object133805:head# 2024-04-01T20:04:42.095 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eae87312:::benchmark_data_smithi188_173515_object64326:head# 2024-04-01T20:04:42.095 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaea39cf:::benchmark_data_smithi188_173515_object97468:head# 2024-04-01T20:04:42.095 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaea51af:::benchmark_data_smithi188_173515_object99341:head# 2024-04-01T20:04:42.095 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaeb68f5:::benchmark_data_smithi188_173515_object99055:head# 2024-04-01T20:04:42.095 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaebb047:::benchmark_data_smithi188_173515_object148817:head# 2024-04-01T20:04:42.095 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaec889f:::benchmark_data_smithi188_173515_object96788:head# 2024-04-01T20:04:42.096 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaeccf6e:::benchmark_data_smithi188_173515_object125335:head# 2024-04-01T20:04:42.096 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaed1f61:::benchmark_data_smithi188_173515_object113730:head# 2024-04-01T20:04:42.096 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaee7d3f:::benchmark_data_smithi188_173515_object92617:head# 2024-04-01T20:04:42.096 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaeeb32c:::benchmark_data_smithi188_173515_object70456:head# 2024-04-01T20:04:42.096 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaef2f69:::benchmark_data_smithi188_173515_object47005:head# 2024-04-01T20:04:42.096 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf06de8:::benchmark_data_smithi188_173515_object105328:head# 2024-04-01T20:04:42.096 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf0761b:::benchmark_data_smithi188_173515_object94536:head# 2024-04-01T20:04:42.096 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf089b7:::benchmark_data_smithi188_173515_object60084:head# 2024-04-01T20:04:42.096 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf0b892:::benchmark_data_smithi188_173515_object65102:head# 2024-04-01T20:04:42.096 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf22591:::benchmark_data_smithi188_173515_object74403:head# 2024-04-01T20:04:42.096 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf2c508:::benchmark_data_smithi188_173515_object56200:head# 2024-04-01T20:04:42.096 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf2db57:::benchmark_data_smithi188_173515_object123002:head# 2024-04-01T20:04:42.096 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf30210:::benchmark_data_smithi188_173515_object50730:head# 2024-04-01T20:04:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf373f6:::benchmark_data_smithi188_173515_object99699:head# 2024-04-01T20:04:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf37d9e:::benchmark_data_smithi188_173515_object85598:head# 2024-04-01T20:04:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf40adf:::benchmark_data_smithi188_173515_object151589:head# 2024-04-01T20:04:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf47b73:::benchmark_data_smithi188_173515_object53558:head# 2024-04-01T20:04:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf53b9f:::benchmark_data_smithi188_173515_object97430:head# 2024-04-01T20:04:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf5991a:::benchmark_data_smithi188_173515_object108953:head# 2024-04-01T20:04:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf5a8b3:::benchmark_data_smithi188_173515_object154603:head# 2024-04-01T20:04:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf5d828:::benchmark_data_smithi188_173515_object69827:head# 2024-04-01T20:04:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf617a7:::benchmark_data_smithi188_173515_object81640:head# 2024-04-01T20:04:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf61a2e:::benchmark_data_smithi188_173515_object146365:head# 2024-04-01T20:04:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf79236:::benchmark_data_smithi188_173515_object61135:head# 2024-04-01T20:04:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf7b1a1:::benchmark_data_smithi188_173515_object155058:head# 2024-04-01T20:04:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf86947:::benchmark_data_smithi188_173515_object81666:head# 2024-04-01T20:04:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf89a07:::benchmark_data_smithi188_173515_object123663:head# 2024-04-01T20:04:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf8c7f6:::benchmark_data_smithi188_173515_object119648:head# 2024-04-01T20:04:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf8d542:::benchmark_data_smithi188_173515_object127497:head# 2024-04-01T20:04:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf91637:::benchmark_data_smithi188_173515_object119538:head# 2024-04-01T20:04:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf996a8:::benchmark_data_smithi188_173515_object143789:head# 2024-04-01T20:04:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaf9aa9a:::benchmark_data_smithi188_173515_object89205:head# 2024-04-01T20:04:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eafa201d:::benchmark_data_smithi188_173515_object130630:head# 2024-04-01T20:04:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eafa3d7f:::benchmark_data_smithi188_173515_object99419:head# 2024-04-01T20:04:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eafa40a1:::benchmark_data_smithi188_173515_object54883:head# 2024-04-01T20:04:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eafa66a4:::benchmark_data_smithi188_173515_object149095:head# 2024-04-01T20:04:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eafade6c:::benchmark_data_smithi188_173515_object72772:head# 2024-04-01T20:04:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eafbcdc3:::benchmark_data_smithi188_173515_object72645:head# 2024-04-01T20:04:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eafc2c17:::benchmark_data_smithi188_173515_object133882:head# 2024-04-01T20:04:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eafc2e98:::benchmark_data_smithi188_173515_object117773:head# 2024-04-01T20:04:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eafc50f8:::benchmark_data_smithi188_173515_object89204:head# 2024-04-01T20:04:42.099 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eafcf6b7:::benchmark_data_smithi188_173515_object115436:head# 2024-04-01T20:04:42.099 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eafd2d3b:::benchmark_data_smithi188_173515_object79528:head# 2024-04-01T20:04:42.099 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eafddd1e:::benchmark_data_smithi188_173515_object72648:head# 2024-04-01T20:04:42.099 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eafec6f7:::benchmark_data_smithi188_173515_object150635:head# 2024-04-01T20:04:42.099 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaff2586:::benchmark_data_smithi188_173515_object95825:head# 2024-04-01T20:04:42.099 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaff4cfb:::benchmark_data_smithi188_173515_object67670:head# 2024-04-01T20:04:42.099 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eaffcca2:::benchmark_data_smithi188_173515_object87334:head# 2024-04-01T20:04:42.099 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb008c40:::benchmark_data_smithi188_173515_object90233:head# 2024-04-01T20:04:42.099 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb01c612:::benchmark_data_smithi188_173515_object94275:head# 2024-04-01T20:04:42.099 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb0252d7:::benchmark_data_smithi188_173515_object154799:head# 2024-04-01T20:04:42.099 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb0331ed:::benchmark_data_smithi188_173515_object80640:head# 2024-04-01T20:04:42.099 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb03a5e7:::benchmark_data_smithi188_173515_object125566:head# 2024-04-01T20:04:42.099 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb03b9a6:::benchmark_data_smithi188_173515_object144915:head# 2024-04-01T20:04:42.099 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb0488e6:::benchmark_data_smithi188_173515_object71185:head# 2024-04-01T20:04:42.100 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb04e527:::benchmark_data_smithi188_173515_object57403:head# 2024-04-01T20:04:42.100 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb0516c3:::benchmark_data_smithi188_173515_object87308:head# 2024-04-01T20:04:42.100 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb055cce:::benchmark_data_smithi188_173515_object140101:head# 2024-04-01T20:04:42.100 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb0575ab:::benchmark_data_smithi188_173515_object77479:head# 2024-04-01T20:04:42.100 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb066dbb:::benchmark_data_smithi188_173515_object54360:head# 2024-04-01T20:04:42.100 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb072708:::benchmark_data_smithi188_173515_object46075:head# 2024-04-01T20:04:42.100 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb073108:::benchmark_data_smithi188_173515_object75049:head# 2024-04-01T20:04:42.100 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb078b4c:::benchmark_data_smithi188_173515_object148523:head# 2024-04-01T20:04:42.100 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb083205:::benchmark_data_smithi188_173515_object139251:head# 2024-04-01T20:04:42.100 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb09e1dd:::benchmark_data_smithi188_173515_object112478:head# 2024-04-01T20:04:42.100 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb09e342:::benchmark_data_smithi188_173515_object86294:head# 2024-04-01T20:04:42.100 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb0aa7ea:::benchmark_data_smithi188_173515_object96908:head# 2024-04-01T20:04:42.100 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb0aa981:::benchmark_data_smithi188_173515_object86414:head# 2024-04-01T20:04:42.100 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb0ae1c5:::benchmark_data_smithi188_173515_object109284:head# 2024-04-01T20:04:42.101 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb0afed9:::benchmark_data_smithi188_173515_object54005:head# 2024-04-01T20:04:42.101 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb0b2db7:::benchmark_data_smithi188_173515_object112585:head# 2024-04-01T20:04:42.101 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb0bf7dd:::benchmark_data_smithi188_173515_object63135:head# 2024-04-01T20:04:42.101 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb0c061f:::benchmark_data_smithi188_173515_object150206:head# 2024-04-01T20:04:42.101 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb0c1749:::benchmark_data_smithi188_173515_object54136:head# 2024-04-01T20:04:42.101 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb0db0a0:::benchmark_data_smithi188_173515_object108894:head# 2024-04-01T20:04:42.101 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb0e23c9:::benchmark_data_smithi188_173515_object144997:head# 2024-04-01T20:04:42.101 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb0e77cb:::benchmark_data_smithi188_173515_object147539:head# 2024-04-01T20:04:42.101 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb0ef7a0:::benchmark_data_smithi188_173515_object74724:head# 2024-04-01T20:04:42.101 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb0f5ad3:::benchmark_data_smithi188_173515_object108398:head# 2024-04-01T20:04:42.101 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb0fdf8f:::benchmark_data_smithi188_173515_object67624:head# 2024-04-01T20:04:42.101 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb101e1e:::benchmark_data_smithi188_173515_object49577:head# 2024-04-01T20:04:42.101 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb107558:::benchmark_data_smithi188_173515_object70649:head# 2024-04-01T20:04:42.101 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb107c7c:::benchmark_data_smithi188_173515_object85738:head# 2024-04-01T20:04:42.102 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb1131cf:::benchmark_data_smithi188_173515_object95097:head# 2024-04-01T20:04:42.102 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb113646:::benchmark_data_smithi188_173515_object69327:head# 2024-04-01T20:04:42.102 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb121dc3:::benchmark_data_smithi188_173515_object149874:head# 2024-04-01T20:04:42.102 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb1361fd:::benchmark_data_smithi188_173515_object112969:head# 2024-04-01T20:04:42.102 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb1398bf:::benchmark_data_smithi188_173515_object68948:head# 2024-04-01T20:04:42.102 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb139f14:::benchmark_data_smithi188_173515_object66449:head# 2024-04-01T20:04:42.102 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb13cced:::benchmark_data_smithi188_173515_object80224:head# 2024-04-01T20:04:42.102 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb1434a8:::benchmark_data_smithi188_173515_object59378:head# 2024-04-01T20:04:42.102 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb15b3c8:::benchmark_data_smithi188_173515_object55376:head# 2024-04-01T20:04:42.102 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb16af04:::benchmark_data_smithi188_173515_object134774:head# 2024-04-01T20:04:42.102 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb16b087:::benchmark_data_smithi188_173515_object96623:head# 2024-04-01T20:04:42.102 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb16d5f3:::benchmark_data_smithi188_173515_object67491:head# 2024-04-01T20:04:42.102 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb17f3c6:::benchmark_data_smithi188_173515_object46276:head# 2024-04-01T20:04:42.103 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb18943e:::benchmark_data_smithi188_173515_object123958:head# 2024-04-01T20:04:42.103 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb192923:::benchmark_data_smithi188_173515_object125353:head# 2024-04-01T20:04:42.103 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb1946fb:::benchmark_data_smithi188_173515_object82282:head# 2024-04-01T20:04:42.103 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb19a3f3:::benchmark_data_smithi188_173515_object60039:head# 2024-04-01T20:04:42.103 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb19e7f7:::benchmark_data_smithi188_173515_object78836:head# 2024-04-01T20:04:42.103 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb1a13c2:::benchmark_data_smithi188_173515_object47770:head# 2024-04-01T20:04:42.103 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb1b8bd1:::benchmark_data_smithi188_173515_object147971:head# 2024-04-01T20:04:42.103 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb1b8be9:::benchmark_data_smithi188_173515_object141467:head# 2024-04-01T20:04:42.103 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb1b9b4e:::benchmark_data_smithi188_173515_object54041:head# 2024-04-01T20:04:42.103 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb1cb6fa:::benchmark_data_smithi188_173515_object57020:head# 2024-04-01T20:04:42.103 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb1e45f4:::benchmark_data_smithi188_173515_object92235:head# 2024-04-01T20:04:42.103 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb1f9208:::benchmark_data_smithi188_173515_object60597:head# 2024-04-01T20:04:42.103 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb207432:::benchmark_data_smithi188_173515_object144524:head# 2024-04-01T20:04:42.103 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb211675:::benchmark_data_smithi188_173515_object78110:head# 2024-04-01T20:04:42.104 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb214ed5:::benchmark_data_smithi188_173515_object144836:head# 2024-04-01T20:04:42.104 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb2156ef:::benchmark_data_smithi188_173515_object90958:head# 2024-04-01T20:04:42.104 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb21e04f:::benchmark_data_smithi188_173515_object140880:head# 2024-04-01T20:04:42.104 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb246f2a:::benchmark_data_smithi188_173515_object55928:head# 2024-04-01T20:04:42.104 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb249133:::benchmark_data_smithi188_173515_object66320:head# 2024-04-01T20:04:42.104 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb249829:::benchmark_data_smithi188_173515_object110897:head# 2024-04-01T20:04:42.104 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb25426a:::benchmark_data_smithi188_173515_object141367:head# 2024-04-01T20:04:42.104 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb257ec6:::benchmark_data_smithi188_173515_object65640:head# 2024-04-01T20:04:42.104 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb25a06d:::benchmark_data_smithi188_173515_object81841:head# 2024-04-01T20:04:42.104 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb25aa8d:::benchmark_data_smithi188_173515_object151740:head# 2024-04-01T20:04:42.104 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb26c83f:::benchmark_data_smithi188_173515_object93535:head# 2024-04-01T20:04:42.104 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb2737b5:::benchmark_data_smithi188_173515_object56492:head# 2024-04-01T20:04:42.104 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb27c2f4:::benchmark_data_smithi188_173515_object91525:head# 2024-04-01T20:04:42.104 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb284a95:::benchmark_data_smithi188_173515_object131795:head# 2024-04-01T20:04:42.105 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb28872f:::benchmark_data_smithi188_173515_object49466:head# 2024-04-01T20:04:42.105 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb291fc1:::benchmark_data_smithi188_173515_object74185:head# 2024-04-01T20:04:42.105 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb2a2be9:::benchmark_data_smithi188_173515_object133457:head# 2024-04-01T20:04:42.105 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb2a2cf1:::benchmark_data_smithi188_173515_object65256:head# 2024-04-01T20:04:42.105 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb2a73d7:::benchmark_data_smithi188_173515_object121702:head# 2024-04-01T20:04:42.105 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb2a8ffd:::benchmark_data_smithi188_173515_object150259:head# 2024-04-01T20:04:42.105 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb2c5c9f:::benchmark_data_smithi188_173515_object152484:head# 2024-04-01T20:04:42.105 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb2c83cf:::benchmark_data_smithi188_173515_object94903:head# 2024-04-01T20:04:42.105 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb2c9ca2:::benchmark_data_smithi188_173515_object58635:head# 2024-04-01T20:04:42.105 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb2ce66c:::benchmark_data_smithi188_173515_object155481:head# 2024-04-01T20:04:42.105 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb2dc731:::benchmark_data_smithi188_173515_object153713:head# 2024-04-01T20:04:42.105 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb2dd072:::benchmark_data_smithi188_173515_object73229:head# 2024-04-01T20:04:42.105 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb2ed589:::benchmark_data_smithi188_173515_object46440:head# 2024-04-01T20:04:42.105 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb2ee20e:::benchmark_data_smithi188_173515_object49852:head# 2024-04-01T20:04:42.105 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb2f0eb7:::benchmark_data_smithi188_173515_object93173:head# 2024-04-01T20:04:42.105 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb2f7ac7:::benchmark_data_smithi188_173515_object111784:head# 2024-04-01T20:04:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb2faaef:::benchmark_data_smithi188_173515_object62708:head# 2024-04-01T20:04:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb2fd80c:::benchmark_data_smithi188_173515_object46846:head# 2024-04-01T20:04:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb306601:::benchmark_data_smithi188_173515_object61504:head# 2024-04-01T20:04:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb307f2d:::benchmark_data_smithi188_173515_object101241:head# 2024-04-01T20:04:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb30a02d:::benchmark_data_smithi188_173515_object114047:head# 2024-04-01T20:04:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb32606b:::benchmark_data_smithi188_173515_object88193:head# 2024-04-01T20:04:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb32a304:::benchmark_data_smithi188_173515_object51504:head# 2024-04-01T20:04:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb337b3c:::benchmark_data_smithi188_173515_object97544:head# 2024-04-01T20:04:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb34a8b4:::benchmark_data_smithi188_173515_object137089:head# 2024-04-01T20:04:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb359dcb:::benchmark_data_smithi188_173515_object126091:head# 2024-04-01T20:04:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb369faa:::benchmark_data_smithi188_173515_object140138:head# 2024-04-01T20:04:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb36dabc:::benchmark_data_smithi188_173515_object107244:head# 2024-04-01T20:04:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb38fb5a:::benchmark_data_smithi188_173515_object104214:head# 2024-04-01T20:04:42.106 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb390826:::benchmark_data_smithi188_173515_object61523:head# 2024-04-01T20:04:42.107 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb391301:::benchmark_data_smithi188_173515_object118412:head# 2024-04-01T20:04:42.107 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb399446:::benchmark_data_smithi188_173515_object148656:head# 2024-04-01T20:04:42.107 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb3a030d:::benchmark_data_smithi188_173515_object112290:head# 2024-04-01T20:04:42.107 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb3a4dfe:::benchmark_data_smithi188_173515_object97636:head# 2024-04-01T20:04:42.107 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb3af487:::benchmark_data_smithi188_173515_object98991:head# 2024-04-01T20:04:42.107 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb3ba1ef:::benchmark_data_smithi188_173515_object88321:head# 2024-04-01T20:04:42.107 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb3c53b9:::benchmark_data_smithi188_173515_object121257:head# 2024-04-01T20:04:42.107 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb3c5633:::benchmark_data_smithi188_173515_object109156:head# 2024-04-01T20:04:42.107 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb3c5fc3:::benchmark_data_smithi188_173515_object72883:head# 2024-04-01T20:04:42.107 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb3c9bce:::benchmark_data_smithi188_173515_object150992:head# 2024-04-01T20:04:42.107 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb3ca388:::benchmark_data_smithi188_173515_object110080:head# 2024-04-01T20:04:42.107 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb3ceb28:::benchmark_data_smithi188_173515_object130207:head# 2024-04-01T20:04:42.107 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb3d9174:::benchmark_data_smithi188_173515_object150755:head# 2024-04-01T20:04:42.107 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb3e1479:::benchmark_data_smithi188_173515_object67463:head# 2024-04-01T20:04:42.107 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb3f3ab7:::benchmark_data_smithi188_173515_object127834:head# 2024-04-01T20:04:42.108 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb3f4325:::benchmark_data_smithi188_173515_object110297:head# 2024-04-01T20:04:42.108 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb4042a1:::benchmark_data_smithi188_173515_object132481:head# 2024-04-01T20:04:42.108 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb406513:::benchmark_data_smithi188_173515_object117006:head# 2024-04-01T20:04:42.108 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb422de7:::benchmark_data_smithi188_173515_object58645:head# 2024-04-01T20:04:42.108 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb434196:::benchmark_data_smithi188_173515_object75025:head# 2024-04-01T20:04:42.108 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb439be3:::benchmark_data_smithi188_173515_object82688:head# 2024-04-01T20:04:42.108 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb43ae29:::benchmark_data_smithi188_173515_object100656:head# 2024-04-01T20:04:42.108 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb440afa:::benchmark_data_smithi188_173515_object93425:head# 2024-04-01T20:04:42.108 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb443737:::benchmark_data_smithi188_173515_object82883:head# 2024-04-01T20:04:42.108 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb4442ec:::benchmark_data_smithi188_173515_object88852:head# 2024-04-01T20:04:42.108 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb45b593:::benchmark_data_smithi188_173515_object154610:head# 2024-04-01T20:04:42.108 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb4625de:::benchmark_data_smithi188_173515_object114439:head# 2024-04-01T20:04:42.108 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb464743:::benchmark_data_smithi188_173515_object54929:head# 2024-04-01T20:04:42.108 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb465686:::benchmark_data_smithi188_173515_object96542:head# 2024-04-01T20:04:42.108 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb46f295:::benchmark_data_smithi188_173515_object66158:head# 2024-04-01T20:04:42.109 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb485171:::benchmark_data_smithi188_173515_object72070:head# 2024-04-01T20:04:42.109 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb4932d6:::benchmark_data_smithi188_173515_object101143:head# 2024-04-01T20:04:42.109 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb499745:::benchmark_data_smithi188_173515_object114331:head# 2024-04-01T20:04:42.109 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb4b15ac:::benchmark_data_smithi188_173515_object54705:head# 2024-04-01T20:04:42.109 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb4b6b74:::benchmark_data_smithi188_173515_object132060:head# 2024-04-01T20:04:42.109 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb4c331c:::benchmark_data_smithi188_173515_object62523:head# 2024-04-01T20:04:42.109 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb4c7145:::benchmark_data_smithi188_173515_object85860:head# 2024-04-01T20:04:42.109 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb4cbe0b:::benchmark_data_smithi188_173515_object67734:head# 2024-04-01T20:04:42.109 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb4cc314:::benchmark_data_smithi188_173515_object138503:head# 2024-04-01T20:04:42.109 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb4e0857:::benchmark_data_smithi188_173515_object46388:head# 2024-04-01T20:04:42.109 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb4eabb5:::benchmark_data_smithi188_173515_object69638:head# 2024-04-01T20:04:42.109 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb4ee44d:::benchmark_data_smithi188_173515_object143923:head# 2024-04-01T20:04:42.109 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb4ff632:::benchmark_data_smithi188_173515_object112509:head# 2024-04-01T20:04:42.109 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb5049ff:::benchmark_data_smithi188_173515_object105435:head# 2024-04-01T20:04:42.109 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb509937:::benchmark_data_smithi188_173515_object115756:head# 2024-04-01T20:04:42.110 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb512acd:::benchmark_data_smithi188_173515_object133011:head# 2024-04-01T20:04:42.110 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb51c19c:::benchmark_data_smithi188_173515_object107521:head# 2024-04-01T20:04:42.110 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb520261:::benchmark_data_smithi188_173515_object99833:head# 2024-04-01T20:04:42.110 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb522265:::benchmark_data_smithi188_173515_object66414:head# 2024-04-01T20:04:42.110 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb525c34:::benchmark_data_smithi188_173515_object70512:head# 2024-04-01T20:04:42.110 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb53160f:::benchmark_data_smithi188_173515_object124561:head# 2024-04-01T20:04:42.110 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb55042d:::benchmark_data_smithi188_173515_object131526:head# 2024-04-01T20:04:42.110 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb554c66:::benchmark_data_smithi188_173515_object81625:head# 2024-04-01T20:04:42.110 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb5616ca:::benchmark_data_smithi188_173515_object141173:head# 2024-04-01T20:04:42.110 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb56398d:::benchmark_data_smithi188_173515_object130750:head# 2024-04-01T20:04:42.110 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb571202:::benchmark_data_smithi188_173515_object116977:head# 2024-04-01T20:04:42.110 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb5813d3:::benchmark_data_smithi188_173515_object80606:head# 2024-04-01T20:04:42.110 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb583d36:::benchmark_data_smithi188_173515_object107656:head# 2024-04-01T20:04:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb59dd34:::benchmark_data_smithi188_173515_object137785:head# 2024-04-01T20:04:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb5a424f:::benchmark_data_smithi188_173515_object106643:head# 2024-04-01T20:04:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb5a4ca3:::benchmark_data_smithi188_173515_object50966:head# 2024-04-01T20:04:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb5b9703:::benchmark_data_smithi188_173515_object153837:head# 2024-04-01T20:04:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb5bf7f0:::benchmark_data_smithi188_173515_object105972:head# 2024-04-01T20:04:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb5d7d30:::benchmark_data_smithi188_173515_object131054:head# 2024-04-01T20:04:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb5deb7f:::benchmark_data_smithi188_173515_object84012:head# 2024-04-01T20:04:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb5eae8f:::benchmark_data_smithi188_173515_object138701:head# 2024-04-01T20:04:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb5efd54:::benchmark_data_smithi188_173515_object109514:head# 2024-04-01T20:04:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb5f1b06:::benchmark_data_smithi188_173515_object150012:head# 2024-04-01T20:04:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb5f56ef:::benchmark_data_smithi188_173515_object139375:head# 2024-04-01T20:04:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb5fd677:::benchmark_data_smithi188_173515_object82501:head# 2024-04-01T20:04:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb6038b2:::benchmark_data_smithi188_173515_object74675:head# 2024-04-01T20:04:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb605de3:::benchmark_data_smithi188_173515_object64208:head# 2024-04-01T20:04:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb6127b1:::benchmark_data_smithi188_173515_object69284:head# 2024-04-01T20:04:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb61f1b6:::benchmark_data_smithi188_173515_object131792:head# 2024-04-01T20:04:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb62282c:::benchmark_data_smithi188_173515_object112709:head# 2024-04-01T20:04:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb62bc62:::benchmark_data_smithi188_173515_object69487:head# 2024-04-01T20:04:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb636478:::benchmark_data_smithi188_173515_object115011:head# 2024-04-01T20:04:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb63b286:::benchmark_data_smithi188_173515_object92432:head# 2024-04-01T20:04:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb63eef6:::benchmark_data_smithi188_173515_object48803:head# 2024-04-01T20:04:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb645f36:::benchmark_data_smithi188_173515_object69888:head# 2024-04-01T20:04:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb64fe22:::benchmark_data_smithi188_173515_object65687:head# 2024-04-01T20:04:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb65cb14:::benchmark_data_smithi188_173515_object71674:head# 2024-04-01T20:04:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb669ab3:::benchmark_data_smithi188_173515_object73694:head# 2024-04-01T20:04:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb66d5dc:::benchmark_data_smithi188_173515_object139136:head# 2024-04-01T20:04:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb66f4fb:::benchmark_data_smithi188_173515_object142761:head# 2024-04-01T20:04:42.141 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb683657:::benchmark_data_smithi188_173515_object123374:head# 2024-04-01T20:04:42.141 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb684c0b:::benchmark_data_smithi188_173515_object69429:head# 2024-04-01T20:04:42.141 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb68dc87:::benchmark_data_smithi188_173515_object67510:head# 2024-04-01T20:04:42.142 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb69367f:::benchmark_data_smithi188_173515_object90319:head# 2024-04-01T20:04:42.142 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb698165:::benchmark_data_smithi188_173515_object146643:head# 2024-04-01T20:04:42.142 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb69a2b5:::benchmark_data_smithi188_173515_object134592:head# 2024-04-01T20:04:42.142 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb69b702:::benchmark_data_smithi188_173515_object71311:head# 2024-04-01T20:04:42.142 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb69bf63:::benchmark_data_smithi188_173515_object155252:head# 2024-04-01T20:04:42.142 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb6a22f6:::benchmark_data_smithi188_173515_object96985:head# 2024-04-01T20:04:42.142 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb6ace5f:::benchmark_data_smithi188_173515_object103744:head# 2024-04-01T20:04:42.142 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb6b04af:::benchmark_data_smithi188_173515_object70633:head# 2024-04-01T20:04:42.142 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb6b6fe4:::benchmark_data_smithi188_173515_object90800:head# 2024-04-01T20:04:42.142 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb6be8c7:::benchmark_data_smithi188_173515_object155883:head# 2024-04-01T20:04:42.142 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb6c93ef:::benchmark_data_smithi188_173515_object74835:head# 2024-04-01T20:04:42.142 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb6d7150:::benchmark_data_smithi188_173515_object103469:head# 2024-04-01T20:04:42.142 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb6d9403:::benchmark_data_smithi188_173515_object136587:head# 2024-04-01T20:04:42.143 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb6ddb8a:::benchmark_data_smithi188_173515_object121023:head# 2024-04-01T20:04:42.143 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb6ebb8b:::benchmark_data_smithi188_173515_object106099:head# 2024-04-01T20:04:42.143 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb6ec704:::benchmark_data_smithi188_173515_object153407:head# 2024-04-01T20:04:42.143 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb70779f:::benchmark_data_smithi188_173515_object87727:head# 2024-04-01T20:04:42.143 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb7164fd:::benchmark_data_smithi188_173515_object76386:head# 2024-04-01T20:04:42.143 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb719475:::benchmark_data_smithi188_173515_object118086:head# 2024-04-01T20:04:42.143 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb71a965:::benchmark_data_smithi188_173515_object123754:head# 2024-04-01T20:04:42.143 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb7289c5:::benchmark_data_smithi188_173515_object147607:head# 2024-04-01T20:04:42.143 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb72f81b:::benchmark_data_smithi188_173515_object130325:head# 2024-04-01T20:04:42.143 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb73144b:::benchmark_data_smithi188_173515_object86747:head# 2024-04-01T20:04:42.143 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb737014:::benchmark_data_smithi188_173515_object74643:head# 2024-04-01T20:04:42.143 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb751104:::benchmark_data_smithi188_173515_object82272:head# 2024-04-01T20:04:42.143 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb75a94c:::benchmark_data_smithi188_173515_object130148:head# 2024-04-01T20:04:42.143 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb75c015:::benchmark_data_smithi188_173515_object99796:head# 2024-04-01T20:04:42.143 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb791ad0:::benchmark_data_smithi188_173515_object47549:head# 2024-04-01T20:04:42.144 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb7920a5:::benchmark_data_smithi188_173515_object99901:head# 2024-04-01T20:04:42.144 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb798944:::benchmark_data_smithi188_173515_object155855:head# 2024-04-01T20:04:42.144 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb7a0016:::benchmark_data_smithi188_173515_object62878:head# 2024-04-01T20:04:42.144 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb7aed64:::benchmark_data_smithi188_173515_object64373:head# 2024-04-01T20:04:42.144 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb7b0958:::benchmark_data_smithi188_173515_object84076:head# 2024-04-01T20:04:42.144 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb7c17bc:::benchmark_data_smithi188_173515_object133429:head# 2024-04-01T20:04:42.144 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb7cbb67:::benchmark_data_smithi188_173515_object72398:head# 2024-04-01T20:04:42.144 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb7cdfcb:::benchmark_data_smithi188_173515_object65839:head# 2024-04-01T20:04:42.144 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb7db711:::benchmark_data_smithi188_173515_object153276:head# 2024-04-01T20:04:42.144 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb7dc253:::benchmark_data_smithi188_173515_object137868:head# 2024-04-01T20:04:42.144 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb7e85d8:::benchmark_data_smithi188_173515_object125427:head# 2024-04-01T20:04:42.144 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb7ecbc5:::benchmark_data_smithi188_173515_object116865:head# 2024-04-01T20:04:42.144 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb7eedb4:::benchmark_data_smithi188_173515_object88233:head# 2024-04-01T20:04:42.144 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb7f1ad6:::benchmark_data_smithi188_173515_object135305:head# 2024-04-01T20:04:42.144 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb7f77dd:::benchmark_data_smithi188_173515_object114617:head# 2024-04-01T20:04:42.145 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb804c23:::benchmark_data_smithi188_173515_object94421:head# 2024-04-01T20:04:42.145 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb809d8b:::benchmark_data_smithi188_173515_object152596:head# 2024-04-01T20:04:42.145 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb817f2a:::benchmark_data_smithi188_173515_object153610:head# 2024-04-01T20:04:42.145 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb81ebbf:::benchmark_data_smithi188_173515_object109134:head# 2024-04-01T20:04:42.145 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb83d15d:::benchmark_data_smithi188_173515_object131363:head# 2024-04-01T20:04:42.145 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb83f677:::benchmark_data_smithi188_173515_object146706:head# 2024-04-01T20:04:42.145 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb848f86:::benchmark_data_smithi188_173515_object137092:head# 2024-04-01T20:04:42.145 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb84ac3e:::benchmark_data_smithi188_173515_object148227:head# 2024-04-01T20:04:42.145 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb858d2c:::benchmark_data_smithi188_173515_object137962:head# 2024-04-01T20:04:42.145 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb873296:::benchmark_data_smithi188_173515_object106594:head# 2024-04-01T20:04:42.145 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb883311:::benchmark_data_smithi188_173515_object79619:head# 2024-04-01T20:04:42.145 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb8892d7:::benchmark_data_smithi188_173515_object144911:head# 2024-04-01T20:04:42.145 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb88ac20:::benchmark_data_smithi188_173515_object154412:head# 2024-04-01T20:04:42.145 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb89441e:::benchmark_data_smithi188_173515_object50020:head# 2024-04-01T20:04:42.146 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb897385:::benchmark_data_smithi188_173515_object115560:head# 2024-04-01T20:04:42.146 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb8a4ca4:::benchmark_data_smithi188_173515_object47685:head# 2024-04-01T20:04:42.146 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb8a8c6f:::benchmark_data_smithi188_173515_object155178:head# 2024-04-01T20:04:42.146 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb8ad9b5:::benchmark_data_smithi188_173515_object100776:head# 2024-04-01T20:04:42.146 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb8b31b5:::benchmark_data_smithi188_173515_object89121:head# 2024-04-01T20:04:42.146 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb8b9815:::benchmark_data_smithi188_173515_object101183:head# 2024-04-01T20:04:42.146 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb8bfeb7:::benchmark_data_smithi188_173515_object50680:head# 2024-04-01T20:04:42.146 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb8da80c:::benchmark_data_smithi188_173515_object86999:head# 2024-04-01T20:04:42.146 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb8e0127:::benchmark_data_smithi188_173515_object155214:head# 2024-04-01T20:04:42.146 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb8e2057:::benchmark_data_smithi188_173515_object153234:head# 2024-04-01T20:04:42.146 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb8f4df9:::benchmark_data_smithi188_173515_object59915:head# 2024-04-01T20:04:42.146 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb8fd464:::benchmark_data_smithi188_173515_object114740:head# 2024-04-01T20:04:42.146 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb9053f1:::benchmark_data_smithi188_173515_object81479:head# 2024-04-01T20:04:42.146 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb914a39:::benchmark_data_smithi188_173515_object107557:head# 2024-04-01T20:04:42.147 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb92780d:::benchmark_data_smithi188_173515_object146299:head# 2024-04-01T20:04:42.147 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb92ffe4:::benchmark_data_smithi188_173515_object97155:head# 2024-04-01T20:04:42.147 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb93634e:::benchmark_data_smithi188_173515_object68807:head# 2024-04-01T20:04:42.147 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb938027:::benchmark_data_smithi188_173515_object132771:head# 2024-04-01T20:04:42.147 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb941736:::benchmark_data_smithi188_173515_object66811:head# 2024-04-01T20:04:42.147 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb949fb7:::benchmark_data_smithi188_173515_object117606:head# 2024-04-01T20:04:42.147 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb94d7ec:::benchmark_data_smithi188_173515_object55845:head# 2024-04-01T20:04:42.147 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb950ec3:::benchmark_data_smithi188_173515_object58233:head# 2024-04-01T20:04:42.147 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb9581a2:::benchmark_data_smithi188_173515_object133332:head# 2024-04-01T20:04:42.147 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb96ba39:::benchmark_data_smithi188_173515_object51797:head# 2024-04-01T20:04:42.147 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb97957f:::benchmark_data_smithi188_173515_object46874:head# 2024-04-01T20:04:42.147 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb987601:::benchmark_data_smithi188_173515_object114851:head# 2024-04-01T20:04:42.147 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb990455:::benchmark_data_smithi188_173515_object98765:head# 2024-04-01T20:04:42.147 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb9905a5:::benchmark_data_smithi188_173515_object104549:head# 2024-04-01T20:04:42.148 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb9a295e:::benchmark_data_smithi188_173515_object105210:head# 2024-04-01T20:04:42.148 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb9a54e6:::benchmark_data_smithi188_173515_object128158:head# 2024-04-01T20:04:42.148 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb9b4da1:::benchmark_data_smithi188_173515_object76781:head# 2024-04-01T20:04:42.148 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb9b6c64:::benchmark_data_smithi188_173515_object97232:head# 2024-04-01T20:04:42.148 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb9bcfef:::benchmark_data_smithi188_173515_object77143:head# 2024-04-01T20:04:42.148 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb9bde12:::benchmark_data_smithi188_173515_object66815:head# 2024-04-01T20:04:42.148 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb9bf4f0:::benchmark_data_smithi188_173515_object151831:head# 2024-04-01T20:04:42.148 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb9c228e:::benchmark_data_smithi188_173515_object61604:head# 2024-04-01T20:04:42.148 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb9caca8:::benchmark_data_smithi188_173515_object106198:head# 2024-04-01T20:04:42.148 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb9ef146:::benchmark_data_smithi188_173515_object103201:head# 2024-04-01T20:04:42.148 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eb9f7d21:::benchmark_data_smithi188_173515_object140449:head# 2024-04-01T20:04:42.148 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eba02121:::benchmark_data_smithi188_173515_object129368:head# 2024-04-01T20:04:42.148 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eba04ae9:::benchmark_data_smithi188_173515_object138648:head# 2024-04-01T20:04:42.148 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eba0e02f:::benchmark_data_smithi188_173515_object126553:head# 2024-04-01T20:04:42.149 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eba1f51c:::benchmark_data_smithi188_173515_object150761:head# 2024-04-01T20:04:42.149 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eba35086:::benchmark_data_smithi188_173515_object148257:head# 2024-04-01T20:04:42.149 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eba35be9:::benchmark_data_smithi188_173515_object47990:head# 2024-04-01T20:04:42.149 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eba36296:::benchmark_data_smithi188_173515_object87771:head# 2024-04-01T20:04:42.149 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eba4e5b1:::benchmark_data_smithi188_173515_object121292:head# 2024-04-01T20:04:42.149 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eba5b178:::benchmark_data_smithi188_173515_object102247:head# 2024-04-01T20:04:42.149 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eba61080:::benchmark_data_smithi188_173515_object70141:head# 2024-04-01T20:04:42.149 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eba6a439:::benchmark_data_smithi188_173515_object81135:head# 2024-04-01T20:04:42.149 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eba6c301:::benchmark_data_smithi188_173515_object112380:head# 2024-04-01T20:04:42.149 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eba73525:::benchmark_data_smithi188_173515_object50321:head# 2024-04-01T20:04:42.149 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eba78a39:::benchmark_data_smithi188_173515_object51352:head# 2024-04-01T20:04:42.149 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eba84274:::benchmark_data_smithi188_173515_object61957:head# 2024-04-01T20:04:42.149 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eba89ae4:::benchmark_data_smithi188_173515_object124420:head# 2024-04-01T20:04:42.149 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eba8bbcb:::benchmark_data_smithi188_173515_object145871:head# 2024-04-01T20:04:42.149 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eba93fbb:::benchmark_data_smithi188_173515_object47389:head# 2024-04-01T20:04:42.150 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eba94029:::benchmark_data_smithi188_173515_object57698:head# 2024-04-01T20:04:42.150 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebaa26d1:::benchmark_data_smithi188_173515_object79054:head# 2024-04-01T20:04:42.150 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebaae6a7:::benchmark_data_smithi188_173515_object140353:head# 2024-04-01T20:04:42.150 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebab1c47:::benchmark_data_smithi188_173515_object128061:head# 2024-04-01T20:04:42.150 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebabeb3e:::benchmark_data_smithi188_173515_object72549:head# 2024-04-01T20:04:42.150 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebac8a96:::benchmark_data_smithi188_173515_object48490:head# 2024-04-01T20:04:42.150 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebad15df:::benchmark_data_smithi188_173515_object131657:head# 2024-04-01T20:04:42.150 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebad872e:::benchmark_data_smithi188_173515_object119432:head# 2024-04-01T20:04:42.150 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebada35b:::benchmark_data_smithi188_173515_object122184:head# 2024-04-01T20:04:42.150 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebaddede:::benchmark_data_smithi188_173515_object132278:head# 2024-04-01T20:04:42.150 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebae304f:::benchmark_data_smithi188_173515_object152084:head# 2024-04-01T20:04:42.151 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebaef92b:::benchmark_data_smithi188_173515_object102821:head# 2024-04-01T20:04:42.151 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebaf36c6:::benchmark_data_smithi188_173515_object91500:head# 2024-04-01T20:04:42.151 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebb03c18:::benchmark_data_smithi188_173515_object62526:head# 2024-04-01T20:04:42.151 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebb03e96:::benchmark_data_smithi188_173515_object104533:head# 2024-04-01T20:04:42.151 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebb06ae1:::benchmark_data_smithi188_173515_object80462:head# 2024-04-01T20:04:42.151 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebb075c4:::benchmark_data_smithi188_173515_object52397:head# 2024-04-01T20:04:42.151 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebb0b88c:::benchmark_data_smithi188_173515_object106110:head# 2024-04-01T20:04:42.151 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebb33692:::benchmark_data_smithi188_173515_object128004:head# 2024-04-01T20:04:42.151 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebb392ae:::benchmark_data_smithi188_173515_object121787:head# 2024-04-01T20:04:42.151 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebb395fe:::benchmark_data_smithi188_173515_object125276:head# 2024-04-01T20:04:42.151 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebb43759:::benchmark_data_smithi188_173515_object54809:head# 2024-04-01T20:04:42.151 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebb5c78a:::benchmark_data_smithi188_173515_object105761:head# 2024-04-01T20:04:42.151 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebb672ca:::benchmark_data_smithi188_173515_object84484:head# 2024-04-01T20:04:42.151 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebb6fa01:::benchmark_data_smithi188_173515_object125015:head# 2024-04-01T20:04:42.152 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebb71767:::benchmark_data_smithi188_173515_object98874:head# 2024-04-01T20:04:42.152 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebb721ed:::benchmark_data_smithi188_173515_object121382:head# 2024-04-01T20:04:42.152 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebb7677a:::benchmark_data_smithi188_173515_object55989:head# 2024-04-01T20:04:42.152 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebb838d9:::benchmark_data_smithi188_173515_object71417:head# 2024-04-01T20:04:42.152 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebb83b11:::benchmark_data_smithi188_173515_object104767:head# 2024-04-01T20:04:42.152 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebb84a5b:::benchmark_data_smithi188_173515_object148305:head# 2024-04-01T20:04:42.152 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebb864d6:::benchmark_data_smithi188_173515_object102634:head# 2024-04-01T20:04:42.152 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebb91d90:::benchmark_data_smithi188_173515_object79684:head# 2024-04-01T20:04:42.152 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebb9aac6:::benchmark_data_smithi188_173515_object60835:head# 2024-04-01T20:04:42.152 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebba6185:::benchmark_data_smithi188_173515_object105920:head# 2024-04-01T20:04:42.152 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebba6c7f:::benchmark_data_smithi188_173515_object77900:head# 2024-04-01T20:04:42.152 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebbb09d0:::benchmark_data_smithi188_173515_object153591:head# 2024-04-01T20:04:42.152 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebbb7831:::benchmark_data_smithi188_173515_object66500:head# 2024-04-01T20:04:42.152 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebbbc3d4:::benchmark_data_smithi188_173515_object63866:head# 2024-04-01T20:04:42.153 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebbc57c3:::benchmark_data_smithi188_173515_object147976:head# 2024-04-01T20:04:42.153 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebbd0800:::benchmark_data_smithi188_173515_object77269:head# 2024-04-01T20:04:42.153 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebbd2144:::benchmark_data_smithi188_173515_object136793:head# 2024-04-01T20:04:42.153 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebbe6dbb:::benchmark_data_smithi188_173515_object88870:head# 2024-04-01T20:04:42.153 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebbf063e:::benchmark_data_smithi188_173515_object74505:head# 2024-04-01T20:04:42.153 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebc0219a:::benchmark_data_smithi188_173515_object46492:head# 2024-04-01T20:04:42.153 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebc13137:::benchmark_data_smithi188_173515_object94180:head# 2024-04-01T20:04:42.153 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebc1536a:::benchmark_data_smithi188_173515_object68766:head# 2024-04-01T20:04:42.153 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebc162d5:::benchmark_data_smithi188_173515_object50929:head# 2024-04-01T20:04:42.153 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebc1989f:::benchmark_data_smithi188_173515_object135750:head# 2024-04-01T20:04:42.153 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebc30015:::benchmark_data_smithi188_173515_object114547:head# 2024-04-01T20:04:42.153 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebc39555:::benchmark_data_smithi188_173515_object118329:head# 2024-04-01T20:04:42.153 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebc3b659:::benchmark_data_smithi188_173515_object71536:head# 2024-04-01T20:04:42.153 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebc3de5f:::benchmark_data_smithi188_173515_object103424:head# 2024-04-01T20:04:42.154 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebc40956:::benchmark_data_smithi188_173515_object74208:head# 2024-04-01T20:04:42.154 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebc47dcb:::benchmark_data_smithi188_173515_object80571:head# 2024-04-01T20:04:42.154 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebc65dcf:::benchmark_data_smithi188_173515_object106195:head# 2024-04-01T20:04:42.154 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebc660b5:::benchmark_data_smithi188_173515_object137749:head# 2024-04-01T20:04:42.154 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebc72552:::benchmark_data_smithi188_173515_object77223:head# 2024-04-01T20:04:42.154 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebc7c2e2:::benchmark_data_smithi188_173515_object89109:head# 2024-04-01T20:04:42.154 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebc81f77:::benchmark_data_smithi188_173515_object119684:head# 2024-04-01T20:04:42.154 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebc84328:::benchmark_data_smithi188_173515_object111258:head# 2024-04-01T20:04:42.154 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebc8b449:::benchmark_data_smithi188_173515_object93935:head# 2024-04-01T20:04:42.154 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebc9270b:::benchmark_data_smithi188_173515_object55303:head# 2024-04-01T20:04:42.154 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebc9ef3d:::benchmark_data_smithi188_173515_object146228:head# 2024-04-01T20:04:42.154 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebcaeb82:::benchmark_data_smithi188_173515_object87644:head# 2024-04-01T20:04:42.154 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebcaef85:::benchmark_data_smithi188_173515_object71373:head# 2024-04-01T20:04:42.154 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebcbae92:::benchmark_data_smithi188_173515_object123387:head# 2024-04-01T20:04:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebcbcdcf:::benchmark_data_smithi188_173515_object55971:head# 2024-04-01T20:04:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebcd7763:::benchmark_data_smithi188_173515_object127223:head# 2024-04-01T20:04:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebcda1c7:::benchmark_data_smithi188_173515_object144056:head# 2024-04-01T20:04:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebce0c6f:::benchmark_data_smithi188_173515_object107334:head# 2024-04-01T20:04:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebce4c9e:::benchmark_data_smithi188_173515_object134631:head# 2024-04-01T20:04:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebcea332:::benchmark_data_smithi188_173515_object92846:head# 2024-04-01T20:04:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebd030d8:::benchmark_data_smithi188_173515_object79818:head# 2024-04-01T20:04:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebd05bf9:::benchmark_data_smithi188_173515_object89703:head# 2024-04-01T20:04:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebd15336:::benchmark_data_smithi188_173515_object47984:head# 2024-04-01T20:04:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebd167e5:::benchmark_data_smithi188_173515_object139262:head# 2024-04-01T20:04:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebd40ff9:::benchmark_data_smithi188_173515_object139542:head# 2024-04-01T20:04:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebd42def:::benchmark_data_smithi188_173515_object132539:head# 2024-04-01T20:04:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebd4a241:::benchmark_data_smithi188_173515_object95650:head# 2024-04-01T20:04:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebd4da3c:::benchmark_data_smithi188_173515_object65007:head# 2024-04-01T20:04:42.155 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebd546c5:::benchmark_data_smithi188_173515_object90530:head# 2024-04-01T20:04:42.156 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebd5ce47:::benchmark_data_smithi188_173515_object117971:head# 2024-04-01T20:04:42.156 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebd60a4d:::benchmark_data_smithi188_173515_object151469:head# 2024-04-01T20:04:42.156 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebd680ea:::benchmark_data_smithi188_173515_object139599:head# 2024-04-01T20:04:42.156 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebd74c15:::benchmark_data_smithi188_173515_object151273:head# 2024-04-01T20:04:42.156 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebd750ed:::benchmark_data_smithi188_173515_object131791:head# 2024-04-01T20:04:42.156 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebd7c5c1:::benchmark_data_smithi188_173515_object147262:head# 2024-04-01T20:04:42.156 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebd7f24a:::benchmark_data_smithi188_173515_object60917:head# 2024-04-01T20:04:42.156 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebd84be8:::benchmark_data_smithi188_173515_object124366:head# 2024-04-01T20:04:42.156 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebd9c7d2:::benchmark_data_smithi188_173515_object131232:head# 2024-04-01T20:04:42.156 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebd9ec2d:::benchmark_data_smithi188_173515_object84707:head# 2024-04-01T20:04:42.156 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebda5423:::benchmark_data_smithi188_173515_object60941:head# 2024-04-01T20:04:42.156 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebda5f8d:::benchmark_data_smithi188_173515_object139378:head# 2024-04-01T20:04:42.156 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebdad511:::benchmark_data_smithi188_173515_object139263:head# 2024-04-01T20:04:42.156 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebdb127d:::benchmark_data_smithi188_173515_object129089:head# 2024-04-01T20:04:42.157 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebdb19b7:::benchmark_data_smithi188_173515_object146470:head# 2024-04-01T20:04:42.157 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebdb7946:::benchmark_data_smithi188_173515_object55079:head# 2024-04-01T20:04:42.157 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebdc5485:::benchmark_data_smithi188_173515_object97851:head# 2024-04-01T20:04:42.157 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebdc90c0:::benchmark_data_smithi188_173515_object111003:head# 2024-04-01T20:04:42.157 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebdd378b:::benchmark_data_smithi188_173515_object98783:head# 2024-04-01T20:04:42.157 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebdd99c7:::benchmark_data_smithi188_173515_object103682:head# 2024-04-01T20:04:42.157 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebdec119:::benchmark_data_smithi188_173515_object146437:head# 2024-04-01T20:04:42.157 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebdece2e:::benchmark_data_smithi188_173515_object76430:head# 2024-04-01T20:04:42.157 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebdf16bc:::benchmark_data_smithi188_173515_object132603:head# 2024-04-01T20:04:42.157 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebdf2c62:::benchmark_data_smithi188_173515_object92227:head# 2024-04-01T20:04:42.157 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebdf6030:::benchmark_data_smithi188_173515_object155579:head# 2024-04-01T20:04:42.157 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebe0d601:::benchmark_data_smithi188_173515_object63297:head# 2024-04-01T20:04:42.157 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebe1020e:::benchmark_data_smithi188_173515_object152737:head# 2024-04-01T20:04:42.157 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebe1441a:::benchmark_data_smithi188_173515_object51172:head# 2024-04-01T20:04:42.157 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebe1526d:::benchmark_data_smithi188_173515_object151971:head# 2024-04-01T20:04:42.157 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebe28851:::benchmark_data_smithi188_173515_object101986:head# 2024-04-01T20:04:42.158 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebe3b117:::benchmark_data_smithi188_173515_object140971:head# 2024-04-01T20:04:42.158 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebe3e9d6:::benchmark_data_smithi188_173515_object63080:head# 2024-04-01T20:04:42.158 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebe50406:::benchmark_data_smithi188_173515_object121895:head# 2024-04-01T20:04:42.158 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebe512ba:::benchmark_data_smithi188_173515_object64180:head# 2024-04-01T20:04:42.158 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebe54e05:::benchmark_data_smithi188_173515_object125813:head# 2024-04-01T20:04:42.158 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebe78c5e:::benchmark_data_smithi188_173515_object64645:head# 2024-04-01T20:04:42.158 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebe9f35f:::benchmark_data_smithi188_173515_object74344:head# 2024-04-01T20:04:42.158 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebea7796:::benchmark_data_smithi188_173515_object131508:head# 2024-04-01T20:04:42.158 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebec8b37:::benchmark_data_smithi188_173515_object75017:head# 2024-04-01T20:04:42.158 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebed17c4:::benchmark_data_smithi188_173515_object120744:head# 2024-04-01T20:04:42.158 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebed5cae:::benchmark_data_smithi188_173515_object108167:head# 2024-04-01T20:04:42.158 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebeda0d2:::benchmark_data_smithi188_173515_object91205:head# 2024-04-01T20:04:42.158 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebedfa44:::benchmark_data_smithi188_173515_object129671:head# 2024-04-01T20:04:42.158 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebee59d9:::benchmark_data_smithi188_173515_object111298:head# 2024-04-01T20:04:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebee65c5:::benchmark_data_smithi188_173515_object54137:head# 2024-04-01T20:04:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebee8cf7:::benchmark_data_smithi188_173515_object83585:head# 2024-04-01T20:04:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebefa210:::benchmark_data_smithi188_173515_object97970:head# 2024-04-01T20:04:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebeff1ca:::benchmark_data_smithi188_173515_object142181:head# 2024-04-01T20:04:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebf1de99:::benchmark_data_smithi188_173515_object155692:head# 2024-04-01T20:04:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebf21e7f:::benchmark_data_smithi188_173515_object132112:head# 2024-04-01T20:04:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebf29450:::benchmark_data_smithi188_173515_object67111:head# 2024-04-01T20:04:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebf2d208:::benchmark_data_smithi188_173515_object112596:head# 2024-04-01T20:04:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebf2d5bf:::benchmark_data_smithi188_173515_object107631:head# 2024-04-01T20:04:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebf4a9ec:::benchmark_data_smithi188_173515_object48306:head# 2024-04-01T20:04:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebf62976:::benchmark_data_smithi188_173515_object48985:head# 2024-04-01T20:04:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebf6d1d3:::benchmark_data_smithi188_173515_object78233:head# 2024-04-01T20:04:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebf71cc8:::benchmark_data_smithi188_173515_object78616:head# 2024-04-01T20:04:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebf90be6:::benchmark_data_smithi188_173515_object94678:head# 2024-04-01T20:04:42.159 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebf94f5e:::benchmark_data_smithi188_173515_object94354:head# 2024-04-01T20:04:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebf97430:::benchmark_data_smithi188_173515_object103738:head# 2024-04-01T20:04:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebfa7a09:::benchmark_data_smithi188_173515_object129424:head# 2024-04-01T20:04:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebfacd13:::benchmark_data_smithi188_173515_object93986:head# 2024-04-01T20:04:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebfafdba:::benchmark_data_smithi188_173515_object125988:head# 2024-04-01T20:04:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebfb4230:::benchmark_data_smithi188_173515_object111072:head# 2024-04-01T20:04:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebfc7c41:::benchmark_data_smithi188_173515_object145917:head# 2024-04-01T20:04:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebfc7fc1:::benchmark_data_smithi188_173515_object131212:head# 2024-04-01T20:04:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebfcc693:::benchmark_data_smithi188_173515_object149547:head# 2024-04-01T20:04:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebfcd2a6:::benchmark_data_smithi188_173515_object124575:head# 2024-04-01T20:04:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebfd41a7:::benchmark_data_smithi188_173515_object70536:head# 2024-04-01T20:04:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebfd6bcc:::benchmark_data_smithi188_173515_object73448:head# 2024-04-01T20:04:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebfea5c0:::benchmark_data_smithi188_173515_object69022:head# 2024-04-01T20:04:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebfed0ca:::benchmark_data_smithi188_173515_object71360:head# 2024-04-01T20:04:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ebfed913:::benchmark_data_smithi188_173515_object91804:head# 2024-04-01T20:04:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec00c27d:::benchmark_data_smithi188_173515_object112295:head# 2024-04-01T20:04:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec01183e:::benchmark_data_smithi188_173515_object61940:head# 2024-04-01T20:04:42.161 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec0131bb:::benchmark_data_smithi188_173515_object79730:head# 2024-04-01T20:04:42.161 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec0169f4:::benchmark_data_smithi188_173515_object55517:head# 2024-04-01T20:04:42.161 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec020405:::benchmark_data_smithi188_173515_object117389:head# 2024-04-01T20:04:42.161 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec0247f1:::benchmark_data_smithi188_173515_object93707:head# 2024-04-01T20:04:42.161 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec031fc9:::benchmark_data_smithi188_173515_object149354:head# 2024-04-01T20:04:42.214 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T20:04:42.214 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:04:42.271 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec037920:::benchmark_data_smithi188_173515_object109654:head# 2024-04-01T20:04:42.272 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec03a499:::benchmark_data_smithi188_173515_object139202:head# 2024-04-01T20:04:42.272 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec03c432:::benchmark_data_smithi188_173515_object66472:head# 2024-04-01T20:04:42.272 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec046d8b:::benchmark_data_smithi188_173515_object91207:head# 2024-04-01T20:04:42.272 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec069a7f:::benchmark_data_smithi188_173515_object113236:head# 2024-04-01T20:04:42.272 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec0720a3:::benchmark_data_smithi188_173515_object147358:head# 2024-04-01T20:04:42.272 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec073d6b:::benchmark_data_smithi188_173515_object57604:head# 2024-04-01T20:04:42.272 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec07995e:::benchmark_data_smithi188_173515_object130801:head# 2024-04-01T20:04:42.272 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec0b6ec7:::benchmark_data_smithi188_173515_object111551:head# 2024-04-01T20:04:42.272 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec0bb7be:::benchmark_data_smithi188_173515_object151890:head# 2024-04-01T20:04:42.272 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec0bdb71:::benchmark_data_smithi188_173515_object57692:head# 2024-04-01T20:04:42.272 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec0beb5f:::benchmark_data_smithi188_173515_object63164:head# 2024-04-01T20:04:42.272 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec0bf539:::benchmark_data_smithi188_173515_object111283:head# 2024-04-01T20:04:42.272 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec0c506e:::benchmark_data_smithi188_173515_object92527:head# 2024-04-01T20:04:42.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec0c7580:::benchmark_data_smithi188_173515_object124811:head# 2024-04-01T20:04:42.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec0d2f9b:::benchmark_data_smithi188_173515_object140642:head# 2024-04-01T20:04:42.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec0e028e:::benchmark_data_smithi188_173515_object108660:head# 2024-04-01T20:04:42.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec0fca8b:::benchmark_data_smithi188_173515_object58754:head# 2024-04-01T20:04:42.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec10bf74:::benchmark_data_smithi188_173515_object75577:head# 2024-04-01T20:04:42.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec1153ba:::benchmark_data_smithi188_173515_object126020:head# 2024-04-01T20:04:42.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec124824:::benchmark_data_smithi188_173515_object45674:head# 2024-04-01T20:04:42.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec12f64a:::benchmark_data_smithi188_173515_object151226:head# 2024-04-01T20:04:42.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec132ceb:::benchmark_data_smithi188_173515_object46614:head# 2024-04-01T20:04:42.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec147be5:::benchmark_data_smithi188_173515_object82201:head# 2024-04-01T20:04:42.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec14921c:::benchmark_data_smithi188_173515_object155242:head# 2024-04-01T20:04:42.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec1574f7:::benchmark_data_smithi188_173515_object66562:head# 2024-04-01T20:04:42.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec160245:::benchmark_data_smithi188_173515_object54832:head# 2024-04-01T20:04:42.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec1750d0:::benchmark_data_smithi188_173515_object63661:head# 2024-04-01T20:04:42.273 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec17b87d:::benchmark_data_smithi188_173515_object60268:head# 2024-04-01T20:04:42.274 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec18b016:::benchmark_data_smithi188_173515_object70281:head# 2024-04-01T20:04:42.274 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec18d6fb:::benchmark_data_smithi188_173515_object78581:head# 2024-04-01T20:04:42.274 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec1913fa:::benchmark_data_smithi188_173515_object115702:head# 2024-04-01T20:04:42.274 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec195687:::benchmark_data_smithi188_173515_object93393:head# 2024-04-01T20:04:42.274 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec19e49e:::benchmark_data_smithi188_173515_object63471:head# 2024-04-01T20:04:42.274 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec1a8431:::benchmark_data_smithi188_173515_object126230:head# 2024-04-01T20:04:42.274 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec1ba3c8:::benchmark_data_smithi188_173515_object60627:head# 2024-04-01T20:04:42.274 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec1bc806:::benchmark_data_smithi188_173515_object150134:head# 2024-04-01T20:04:42.274 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec1c81c0:::benchmark_data_smithi188_173515_object73915:head# 2024-04-01T20:04:42.274 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec1cc6f2:::benchmark_data_smithi188_173515_object87279:head# 2024-04-01T20:04:42.274 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec1d29a0:::benchmark_data_smithi188_173515_object67187:head# 2024-04-01T20:04:42.274 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec1d41fd:::benchmark_data_smithi188_173515_object83395:head# 2024-04-01T20:04:42.274 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec1d5caa:::benchmark_data_smithi188_173515_object99371:head# 2024-04-01T20:04:42.274 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec1da626:::benchmark_data_smithi188_173515_object107965:head# 2024-04-01T20:04:42.275 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec1dd503:::benchmark_data_smithi188_173515_object64638:head# 2024-04-01T20:04:42.275 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec1e5cf9:::benchmark_data_smithi188_173515_object51525:head# 2024-04-01T20:04:42.275 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec1e8345:::benchmark_data_smithi188_173515_object131024:head# 2024-04-01T20:04:42.275 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec1edbd0:::benchmark_data_smithi188_173515_object65858:head# 2024-04-01T20:04:42.275 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec207171:::benchmark_data_smithi188_173515_object94405:head# 2024-04-01T20:04:42.275 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec20b0bc:::benchmark_data_smithi188_173515_object144869:head# 2024-04-01T20:04:42.275 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec21020d:::benchmark_data_smithi188_173515_object110264:head# 2024-04-01T20:04:42.275 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec21166e:::benchmark_data_smithi188_173515_object134831:head# 2024-04-01T20:04:42.275 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec21da98:::benchmark_data_smithi188_173515_object101446:head# 2024-04-01T20:04:42.275 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec23266b:::benchmark_data_smithi188_173515_object125111:head# 2024-04-01T20:04:42.275 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec232e2a:::benchmark_data_smithi188_173515_object113783:head# 2024-04-01T20:04:42.275 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec23aae6:::benchmark_data_smithi188_173515_object122277:head# 2024-04-01T20:04:42.275 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec246590:::benchmark_data_smithi188_173515_object147645:head# 2024-04-01T20:04:42.275 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec2478ba:::benchmark_data_smithi188_173515_object56131:head# 2024-04-01T20:04:42.275 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec248ec7:::benchmark_data_smithi188_173515_object76409:head# 2024-04-01T20:04:42.276 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec24ad63:::benchmark_data_smithi188_173515_object138251:head# 2024-04-01T20:04:42.276 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec24bee6:::benchmark_data_smithi188_173515_object128355:head# 2024-04-01T20:04:42.276 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec251a3f:::benchmark_data_smithi188_173515_object71138:head# 2024-04-01T20:04:42.276 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec252e94:::benchmark_data_smithi188_173515_object46806:head# 2024-04-01T20:04:42.276 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec256f35:::benchmark_data_smithi188_173515_object110298:head# 2024-04-01T20:04:42.276 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec2593f9:::benchmark_data_smithi188_173515_object122418:head# 2024-04-01T20:04:42.276 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec25dd5c:::benchmark_data_smithi188_173515_object151481:head# 2024-04-01T20:04:42.276 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec262f7a:::benchmark_data_smithi188_173515_object96621:head# 2024-04-01T20:04:42.276 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec266a2d:::benchmark_data_smithi188_173515_object111945:head# 2024-04-01T20:04:42.276 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec2692bb:::benchmark_data_smithi188_173515_object142409:head# 2024-04-01T20:04:42.276 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec2699ad:::benchmark_data_smithi188_173515_object48076:head# 2024-04-01T20:04:42.276 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec27c12f:::benchmark_data_smithi188_173515_object63739:head# 2024-04-01T20:04:42.276 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec28a6e6:::benchmark_data_smithi188_173515_object112476:head# 2024-04-01T20:04:42.276 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec28d2eb:::benchmark_data_smithi188_173515_object101510:head# 2024-04-01T20:04:42.277 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec294788:::benchmark_data_smithi188_173515_object150736:head# 2024-04-01T20:04:42.277 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec29bc30:::benchmark_data_smithi188_173515_object62126:head# 2024-04-01T20:04:42.277 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec29cef3:::benchmark_data_smithi188_173515_object78802:head# 2024-04-01T20:04:42.277 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec2a52fb:::benchmark_data_smithi188_173515_object53182:head# 2024-04-01T20:04:42.277 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec2b7af3:::benchmark_data_smithi188_173515_object115364:head# 2024-04-01T20:04:42.277 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec2bb6ab:::benchmark_data_smithi188_173515_object90226:head# 2024-04-01T20:04:42.277 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec2bdd1f:::benchmark_data_smithi188_173515_object61931:head# 2024-04-01T20:04:42.277 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec2c456e:::benchmark_data_smithi188_173515_object54340:head# 2024-04-01T20:04:42.277 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec2cc214:::benchmark_data_smithi188_173515_object70834:head# 2024-04-01T20:04:42.277 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec2cef79:::benchmark_data_smithi188_173515_object80359:head# 2024-04-01T20:04:42.277 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec2e604d:::benchmark_data_smithi188_173515_object94768:head# 2024-04-01T20:04:42.277 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec2f1f5c:::benchmark_data_smithi188_173515_object75613:head# 2024-04-01T20:04:42.277 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec2f31c9:::benchmark_data_smithi188_173515_object89197:head# 2024-04-01T20:04:42.277 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec2f9864:::benchmark_data_smithi188_173515_object89134:head# 2024-04-01T20:04:42.277 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec31990e:::benchmark_data_smithi188_173515_object93804:head# 2024-04-01T20:04:42.277 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec31b636:::benchmark_data_smithi188_173515_object142164:head# 2024-04-01T20:04:42.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec31f534:::benchmark_data_smithi188_173515_object149819:head# 2024-04-01T20:04:42.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec327fc3:::benchmark_data_smithi188_173515_object79835:head# 2024-04-01T20:04:42.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec328cbe:::benchmark_data_smithi188_173515_object128338:head# 2024-04-01T20:04:42.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec332c57:::benchmark_data_smithi188_173515_object80742:head# 2024-04-01T20:04:42.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec337098:::benchmark_data_smithi188_173515_object122010:head# 2024-04-01T20:04:42.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec33ea27:::benchmark_data_smithi188_173515_object123146:head# 2024-04-01T20:04:42.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec33ec33:::benchmark_data_smithi188_173515_object151251:head# 2024-04-01T20:04:42.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec3435a0:::benchmark_data_smithi188_173515_object61831:head# 2024-04-01T20:04:42.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec3484a5:::benchmark_data_smithi188_173515_object90263:head# 2024-04-01T20:04:42.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec3499c3:::benchmark_data_smithi188_173515_object154449:head# 2024-04-01T20:04:42.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec34c7f2:::benchmark_data_smithi188_173515_object93466:head# 2024-04-01T20:04:42.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec34daca:::benchmark_data_smithi188_173515_object141475:head# 2024-04-01T20:04:42.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec354351:::benchmark_data_smithi188_173515_object138692:head# 2024-04-01T20:04:42.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec355bb4:::benchmark_data_smithi188_173515_object155507:head# 2024-04-01T20:04:42.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec359ec8:::benchmark_data_smithi188_173515_object48584:head# 2024-04-01T20:04:42.278 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec35c2ff:::benchmark_data_smithi188_173515_object100950:head# 2024-04-01T20:04:42.279 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec35e1c9:::benchmark_data_smithi188_173515_object59521:head# 2024-04-01T20:04:42.279 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec375368:::benchmark_data_smithi188_173515_object153495:head# 2024-04-01T20:04:42.279 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec390475:::benchmark_data_smithi188_173515_object115503:head# 2024-04-01T20:04:42.279 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec391782:::benchmark_data_smithi188_173515_object70707:head# 2024-04-01T20:04:42.279 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec3a58b9:::benchmark_data_smithi188_173515_object45992:head# 2024-04-01T20:04:42.279 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec3b0839:::benchmark_data_smithi188_173515_object135406:head# 2024-04-01T20:04:42.279 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec3b2899:::benchmark_data_smithi188_173515_object65238:head# 2024-04-01T20:04:42.279 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec3bc903:::benchmark_data_smithi188_173515_object86341:head# 2024-04-01T20:04:42.279 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec3c8e89:::benchmark_data_smithi188_173515_object79370:head# 2024-04-01T20:04:42.279 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec3db4be:::benchmark_data_smithi188_173515_object71343:head# 2024-04-01T20:04:42.279 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec3ed47d:::benchmark_data_smithi188_173515_object66561:head# 2024-04-01T20:04:42.279 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec40b5b0:::benchmark_data_smithi188_173515_object46852:head# 2024-04-01T20:04:42.279 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec41045c:::benchmark_data_smithi188_173515_object81899:head# 2024-04-01T20:04:42.279 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec416730:::benchmark_data_smithi188_173515_object75009:head# 2024-04-01T20:04:42.279 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec41812d:::benchmark_data_smithi188_173515_object56564:head# 2024-04-01T20:04:42.280 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec4293b4:::benchmark_data_smithi188_173515_object105376:head# 2024-04-01T20:04:42.280 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec436f71:::benchmark_data_smithi188_173515_object129786:head# 2024-04-01T20:04:42.280 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec4527ee:::benchmark_data_smithi188_173515_object90289:head# 2024-04-01T20:04:42.280 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec45ba25:::benchmark_data_smithi188_173515_object136993:head# 2024-04-01T20:04:42.280 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec45e554:::benchmark_data_smithi188_173515_object125451:head# 2024-04-01T20:04:42.280 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec4620cf:::benchmark_data_smithi188_173515_object64771:head# 2024-04-01T20:04:42.280 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec471c8f:::benchmark_data_smithi188_173515_object146434:head# 2024-04-01T20:04:42.280 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec472f6e:::benchmark_data_smithi188_173515_object101799:head# 2024-04-01T20:04:42.280 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec477875:::benchmark_data_smithi188_173515_object85130:head# 2024-04-01T20:04:42.280 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec4a1cd3:::benchmark_data_smithi188_173515_object109981:head# 2024-04-01T20:04:42.280 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec4a9d5a:::benchmark_data_smithi188_173515_object62636:head# 2024-04-01T20:04:42.280 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec4c0595:::benchmark_data_smithi188_173515_object73338:head# 2024-04-01T20:04:42.280 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec4c0949:::benchmark_data_smithi188_173515_object71845:head# 2024-04-01T20:04:42.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec4c23b8:::benchmark_data_smithi188_173515_object75006:head# 2024-04-01T20:04:42.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec4c3ea2:::benchmark_data_smithi188_173515_object92120:head# 2024-04-01T20:04:42.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec4c4482:::benchmark_data_smithi188_173515_object133082:head# 2024-04-01T20:04:42.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec4c4c14:::benchmark_data_smithi188_173515_object96205:head# 2024-04-01T20:04:42.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec4c8ecd:::benchmark_data_smithi188_173515_object146264:head# 2024-04-01T20:04:42.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec4cb7fe:::benchmark_data_smithi188_173515_object129732:head# 2024-04-01T20:04:42.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec4cd489:::benchmark_data_smithi188_173515_object147101:head# 2024-04-01T20:04:42.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec4cfd1f:::benchmark_data_smithi188_173515_object83351:head# 2024-04-01T20:04:42.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec4d8cc2:::benchmark_data_smithi188_173515_object111318:head# 2024-04-01T20:04:42.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec4e00b4:::benchmark_data_smithi188_173515_object129375:head# 2024-04-01T20:04:42.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec4ed2e1:::benchmark_data_smithi188_173515_object54876:head# 2024-04-01T20:04:42.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec4f7abb:::benchmark_data_smithi188_173515_object147046:head# 2024-04-01T20:04:42.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec4fb631:::benchmark_data_smithi188_173515_object71989:head# 2024-04-01T20:04:42.281 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec4febd7:::benchmark_data_smithi188_173515_object134487:head# 2024-04-01T20:04:42.282 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec503ac5:::benchmark_data_smithi188_173515_object84245:head# 2024-04-01T20:04:42.282 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec505265:::benchmark_data_smithi188_173515_object61786:head# 2024-04-01T20:04:42.282 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec50c1cc:::benchmark_data_smithi188_173515_object84784:head# 2024-04-01T20:04:42.282 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec5112b2:::benchmark_data_smithi188_173515_object51243:head# 2024-04-01T20:04:42.282 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec514bd1:::benchmark_data_smithi188_173515_object59120:head# 2024-04-01T20:04:42.282 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec51655b:::benchmark_data_smithi188_173515_object138790:head# 2024-04-01T20:04:42.282 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec51b51d:::benchmark_data_smithi188_173515_object146232:head# 2024-04-01T20:04:42.282 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec53069c:::benchmark_data_smithi188_173515_object66092:head# 2024-04-01T20:04:42.282 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec5370b1:::benchmark_data_smithi188_173515_object100363:head# 2024-04-01T20:04:42.282 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec5412f7:::benchmark_data_smithi188_173515_object122848:head# 2024-04-01T20:04:42.282 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec5427a5:::benchmark_data_smithi188_173515_object101557:head# 2024-04-01T20:04:42.282 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec545d6a:::benchmark_data_smithi188_173515_object77556:head# 2024-04-01T20:04:42.282 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec548243:::benchmark_data_smithi188_173515_object80443:head# 2024-04-01T20:04:42.282 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec54a94c:::benchmark_data_smithi188_173515_object151474:head# 2024-04-01T20:04:42.283 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec54d742:::benchmark_data_smithi188_173515_object129362:head# 2024-04-01T20:04:42.283 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec56706c:::benchmark_data_smithi188_173515_object101780:head# 2024-04-01T20:04:42.283 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec5806b6:::benchmark_data_smithi188_173515_object57531:head# 2024-04-01T20:04:42.283 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec5816be:::benchmark_data_smithi188_173515_object118016:head# 2024-04-01T20:04:42.283 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec593a45:::benchmark_data_smithi188_173515_object127074:head# 2024-04-01T20:04:42.283 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec59d16e:::benchmark_data_smithi188_173515_object51836:head# 2024-04-01T20:04:42.283 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec59e0cf:::benchmark_data_smithi188_173515_object80075:head# 2024-04-01T20:04:42.283 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec5ab4ab:::benchmark_data_smithi188_173515_object93391:head# 2024-04-01T20:04:42.283 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec5ae543:::benchmark_data_smithi188_173515_object154937:head# 2024-04-01T20:04:42.283 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec5af07c:::benchmark_data_smithi188_173515_object60362:head# 2024-04-01T20:04:42.283 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec5c1bcb:::benchmark_data_smithi188_173515_object65124:head# 2024-04-01T20:04:42.283 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec5e0961:::benchmark_data_smithi188_173515_object100601:head# 2024-04-01T20:04:42.283 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec5ea7a2:::benchmark_data_smithi188_173515_object126486:head# 2024-04-01T20:04:42.283 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec5eacc5:::benchmark_data_smithi188_173515_object120858:head# 2024-04-01T20:04:42.283 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec5f1f1d:::benchmark_data_smithi188_173515_object142629:head# 2024-04-01T20:04:42.283 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec604761:::benchmark_data_smithi188_173515_object120487:head# 2024-04-01T20:04:42.284 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec604d29:::benchmark_data_smithi188_173515_object96187:head# 2024-04-01T20:04:42.284 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec616dad:::benchmark_data_smithi188_173515_object112780:head# 2024-04-01T20:04:42.284 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec61e73f:::benchmark_data_smithi188_173515_object64603:head# 2024-04-01T20:04:42.284 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec61efd3:::benchmark_data_smithi188_173515_object74768:head# 2024-04-01T20:04:42.284 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec61fe10:::benchmark_data_smithi188_173515_object83725:head# 2024-04-01T20:04:42.284 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec622ffd:::benchmark_data_smithi188_173515_object102307:head# 2024-04-01T20:04:42.284 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec6312f6:::benchmark_data_smithi188_173515_object145201:head# 2024-04-01T20:04:42.284 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec63d6f4:::benchmark_data_smithi188_173515_object49046:head# 2024-04-01T20:04:42.284 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec63e7d9:::benchmark_data_smithi188_173515_object51636:head# 2024-04-01T20:04:42.284 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec644829:::benchmark_data_smithi188_173515_object96375:head# 2024-04-01T20:04:42.284 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec65176e:::benchmark_data_smithi188_173515_object70718:head# 2024-04-01T20:04:42.284 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec66a3d0:::benchmark_data_smithi188_173515_object112662:head# 2024-04-01T20:04:42.284 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec66a7b8:::benchmark_data_smithi188_173515_object154637:head# 2024-04-01T20:04:42.284 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec677d9e:::benchmark_data_smithi188_173515_object49840:head# 2024-04-01T20:04:42.284 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec6824ae:::benchmark_data_smithi188_173515_object140801:head# 2024-04-01T20:04:42.285 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec685d25:::benchmark_data_smithi188_173515_object118079:head# 2024-04-01T20:04:42.285 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec6a200a:::benchmark_data_smithi188_173515_object115437:head# 2024-04-01T20:04:42.285 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec6af2d0:::benchmark_data_smithi188_173515_object142012:head# 2024-04-01T20:04:42.285 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec6af6e5:::benchmark_data_smithi188_173515_object55805:head# 2024-04-01T20:04:42.285 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec6b64d1:::benchmark_data_smithi188_173515_object134135:head# 2024-04-01T20:04:42.285 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec6ba18e:::benchmark_data_smithi188_173515_object101050:head# 2024-04-01T20:04:42.285 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec6cec9f:::benchmark_data_smithi188_173515_object93836:head# 2024-04-01T20:04:42.285 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec6debc5:::benchmark_data_smithi188_173515_object57416:head# 2024-04-01T20:04:42.285 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec6e0cd9:::benchmark_data_smithi188_173515_object109740:head# 2024-04-01T20:04:42.285 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec6eb1f8:::benchmark_data_smithi188_173515_object102652:head# 2024-04-01T20:04:42.285 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec6edc5a:::benchmark_data_smithi188_173515_object61470:head# 2024-04-01T20:04:42.285 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec7089bc:::benchmark_data_smithi188_173515_object140864:head# 2024-04-01T20:04:42.285 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec70efd3:::benchmark_data_smithi188_173515_object122725:head# 2024-04-01T20:04:42.285 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec710704:::benchmark_data_smithi188_173515_object71270:head# 2024-04-01T20:04:42.285 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec7264c7:::benchmark_data_smithi188_173515_object124127:head# 2024-04-01T20:04:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec732160:::benchmark_data_smithi188_173515_object89742:head# 2024-04-01T20:04:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec73543d:::benchmark_data_smithi188_173515_object83602:head# 2024-04-01T20:04:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec7395f4:::benchmark_data_smithi188_173515_object151966:head# 2024-04-01T20:04:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec74535e:::benchmark_data_smithi188_173515_object86192:head# 2024-04-01T20:04:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec74a987:::benchmark_data_smithi188_173515_object86824:head# 2024-04-01T20:04:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec74b0b8:::benchmark_data_smithi188_173515_object46839:head# 2024-04-01T20:04:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec77a33f:::benchmark_data_smithi188_173515_object87904:head# 2024-04-01T20:04:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec77c95c:::benchmark_data_smithi188_173515_object140163:head# 2024-04-01T20:04:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec782c3c:::benchmark_data_smithi188_173515_object106851:head# 2024-04-01T20:04:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec79a9a7:::benchmark_data_smithi188_173515_object132044:head# 2024-04-01T20:04:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec7a81a4:::benchmark_data_smithi188_173515_object66989:head# 2024-04-01T20:04:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec7adff3:::benchmark_data_smithi188_173515_object47396:head# 2024-04-01T20:04:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec7b2d34:::benchmark_data_smithi188_173515_object114640:head# 2024-04-01T20:04:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec7b4329:::benchmark_data_smithi188_173515_object128586:head# 2024-04-01T20:04:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec7bf31b:::benchmark_data_smithi188_173515_object150769:head# 2024-04-01T20:04:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec7cf17a:::benchmark_data_smithi188_173515_object119452:head# 2024-04-01T20:04:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec7dc993:::benchmark_data_smithi188_173515_object62703:head# 2024-04-01T20:04:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec7e5c6c:::benchmark_data_smithi188_173515_object57156:head# 2024-04-01T20:04:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec7e7cc5:::benchmark_data_smithi188_173515_object105106:head# 2024-04-01T20:04:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec7f0596:::benchmark_data_smithi188_173515_object125082:head# 2024-04-01T20:04:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec7f4fe9:::benchmark_data_smithi188_173515_object77963:head# 2024-04-01T20:04:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec7f6562:::benchmark_data_smithi188_173515_object155931:head# 2024-04-01T20:04:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec7fdf0a:::benchmark_data_smithi188_173515_object110379:head# 2024-04-01T20:04:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec803a65:::benchmark_data_smithi188_173515_object150105:head# 2024-04-01T20:04:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec81ba64:::benchmark_data_smithi188_173515_object121211:head# 2024-04-01T20:04:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec820fac:::benchmark_data_smithi188_173515_object72292:head# 2024-04-01T20:04:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec82cad1:::benchmark_data_smithi188_173515_object129895:head# 2024-04-01T20:04:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec82ea60:::benchmark_data_smithi188_173515_object126390:head# 2024-04-01T20:04:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec8378e5:::benchmark_data_smithi188_173515_object58030:head# 2024-04-01T20:04:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec839205:::benchmark_data_smithi188_173515_object59098:head# 2024-04-01T20:04:42.288 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec83a983:::benchmark_data_smithi188_173515_object63555:head# 2024-04-01T20:04:42.288 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec83f5f8:::benchmark_data_smithi188_173515_object151304:head# 2024-04-01T20:04:42.288 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec840b38:::benchmark_data_smithi188_173515_object64547:head# 2024-04-01T20:04:42.288 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec84a5f8:::benchmark_data_smithi188_173515_object94874:head# 2024-04-01T20:04:42.288 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec853177:::benchmark_data_smithi188_173515_object142568:head# 2024-04-01T20:04:42.288 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec85a5c0:::benchmark_data_smithi188_173515_object61579:head# 2024-04-01T20:04:42.288 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec85e453:::benchmark_data_smithi188_173515_object93336:head# 2024-04-01T20:04:42.288 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec85fe29:::benchmark_data_smithi188_173515_object66477:head# 2024-04-01T20:04:42.288 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec869ca9:::benchmark_data_smithi188_173515_object145669:head# 2024-04-01T20:04:42.288 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec86a938:::benchmark_data_smithi188_173515_object139795:head# 2024-04-01T20:04:42.288 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec87802c:::benchmark_data_smithi188_173515_object135059:head# 2024-04-01T20:04:42.288 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec87864e:::benchmark_data_smithi188_173515_object114142:head# 2024-04-01T20:04:42.288 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec895d1a:::benchmark_data_smithi188_173515_object134868:head# 2024-04-01T20:04:42.288 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec8a5597:::benchmark_data_smithi188_173515_object51395:head# 2024-04-01T20:04:42.288 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec8ab833:::benchmark_data_smithi188_173515_object123655:head# 2024-04-01T20:04:42.289 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec8ac36c:::benchmark_data_smithi188_173515_object111184:head# 2024-04-01T20:04:42.289 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec8b484d:::benchmark_data_smithi188_173515_object154078:head# 2024-04-01T20:04:42.289 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec8b4e22:::benchmark_data_smithi188_173515_object152427:head# 2024-04-01T20:04:42.289 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec8b5fe2:::benchmark_data_smithi188_173515_object137292:head# 2024-04-01T20:04:42.289 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec8b7c98:::benchmark_data_smithi188_173515_object130589:head# 2024-04-01T20:04:42.289 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec8d6163:::benchmark_data_smithi188_173515_object61362:head# 2024-04-01T20:04:42.289 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec8deeb9:::benchmark_data_smithi188_173515_object114916:head# 2024-04-01T20:04:42.289 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec8e1be2:::benchmark_data_smithi188_173515_object91870:head# 2024-04-01T20:04:42.289 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec8fb6a0:::benchmark_data_smithi188_173515_object124941:head# 2024-04-01T20:04:42.289 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec9056c8:::benchmark_data_smithi188_173515_object84358:head# 2024-04-01T20:04:42.289 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec913f54:::benchmark_data_smithi188_173515_object148524:head# 2024-04-01T20:04:42.289 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec929135:::benchmark_data_smithi188_173515_object52863:head# 2024-04-01T20:04:42.289 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec9419eb:::benchmark_data_smithi188_173515_object50036:head# 2024-04-01T20:04:42.289 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec948fa8:::benchmark_data_smithi188_173515_object120570:head# 2024-04-01T20:04:42.290 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec9518fa:::benchmark_data_smithi188_173515_object84895:head# 2024-04-01T20:04:42.290 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec95667b:::benchmark_data_smithi188_173515_object151602:head# 2024-04-01T20:04:42.290 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec95f6ec:::benchmark_data_smithi188_173515_object137792:head# 2024-04-01T20:04:42.290 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec967080:::benchmark_data_smithi188_173515_object107312:head# 2024-04-01T20:04:42.290 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec96bef2:::benchmark_data_smithi188_173515_object110780:head# 2024-04-01T20:04:42.290 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec9770d3:::benchmark_data_smithi188_173515_object104578:head# 2024-04-01T20:04:42.290 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec97eb3e:::benchmark_data_smithi188_173515_object98132:head# 2024-04-01T20:04:42.290 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec987b70:::benchmark_data_smithi188_173515_object115798:head# 2024-04-01T20:04:42.290 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec98b03d:::benchmark_data_smithi188_173515_object136028:head# 2024-04-01T20:04:42.290 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec997f76:::benchmark_data_smithi188_173515_object106920:head# 2024-04-01T20:04:42.290 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec9a51f6:::benchmark_data_smithi188_173515_object85910:head# 2024-04-01T20:04:42.290 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec9a91b2:::benchmark_data_smithi188_173515_object155967:head# 2024-04-01T20:04:42.290 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec9aa925:::benchmark_data_smithi188_173515_object48663:head# 2024-04-01T20:04:42.290 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec9bcfc5:::benchmark_data_smithi188_173515_object95853:head# 2024-04-01T20:04:42.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec9dd87f:::benchmark_data_smithi188_173515_object92811:head# 2024-04-01T20:04:42.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec9de4cf:::benchmark_data_smithi188_173515_object142866:head# 2024-04-01T20:04:42.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec9e4373:::benchmark_data_smithi188_173515_object121369:head# 2024-04-01T20:04:42.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec9e4fbc:::benchmark_data_smithi188_173515_object81927:head# 2024-04-01T20:04:42.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec9ea53b:::benchmark_data_smithi188_173515_object72948:head# 2024-04-01T20:04:42.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec9f4b3a:::benchmark_data_smithi188_173515_object48302:head# 2024-04-01T20:04:42.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ec9f6f7c:::benchmark_data_smithi188_173515_object75303:head# 2024-04-01T20:04:42.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eca0fe49:::benchmark_data_smithi188_173515_object126784:head# 2024-04-01T20:04:42.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eca21ebb:::benchmark_data_smithi188_173515_object88336:head# 2024-04-01T20:04:42.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eca2a6ff:::benchmark_data_smithi188_173515_object114593:head# 2024-04-01T20:04:42.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eca2d561:::benchmark_data_smithi188_173515_object110303:head# 2024-04-01T20:04:42.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eca38865:::benchmark_data_smithi188_173515_object92127:head# 2024-04-01T20:04:42.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eca39b70:::benchmark_data_smithi188_173515_object78229:head# 2024-04-01T20:04:42.291 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eca48985:::benchmark_data_smithi188_173515_object148844:head# 2024-04-01T20:04:42.292 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eca560d2:::benchmark_data_smithi188_173515_object62678:head# 2024-04-01T20:04:42.292 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eca63bcd:::benchmark_data_smithi188_173515_object115080:head# 2024-04-01T20:04:42.292 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eca68939:::benchmark_data_smithi188_173515_object107649:head# 2024-04-01T20:04:42.292 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eca6961d:::benchmark_data_smithi188_173515_object129915:head# 2024-04-01T20:04:42.292 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eca73567:::benchmark_data_smithi188_173515_object80041:head# 2024-04-01T20:04:42.292 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eca89035:::benchmark_data_smithi188_173515_object141763:head# 2024-04-01T20:04:42.292 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eca8b6dc:::benchmark_data_smithi188_173515_object148105:head# 2024-04-01T20:04:42.292 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eca8e667:::benchmark_data_smithi188_173515_object126169:head# 2024-04-01T20:04:42.292 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eca98252:::benchmark_data_smithi188_173515_object136191:head# 2024-04-01T20:04:42.292 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecaa1530:::benchmark_data_smithi188_173515_object93967:head# 2024-04-01T20:04:42.292 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecaa9ffd:::benchmark_data_smithi188_173515_object104282:head# 2024-04-01T20:04:42.292 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecaaab6b:::benchmark_data_smithi188_173515_object102947:head# 2024-04-01T20:04:42.292 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecaae7b5:::benchmark_data_smithi188_173515_object149131:head# 2024-04-01T20:04:42.292 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecac2791:::benchmark_data_smithi188_173515_object47417:head# 2024-04-01T20:04:42.293 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecac3c9b:::benchmark_data_smithi188_173515_object141028:head# 2024-04-01T20:04:42.293 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecaccda5:::benchmark_data_smithi188_173515_object142396:head# 2024-04-01T20:04:42.293 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecacfc47:::benchmark_data_smithi188_173515_object137098:head# 2024-04-01T20:04:42.293 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecadf953:::benchmark_data_smithi188_173515_object145949:head# 2024-04-01T20:04:42.293 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecae9f49:::benchmark_data_smithi188_173515_object90475:head# 2024-04-01T20:04:42.293 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecaf7e55:::benchmark_data_smithi188_173515_object147309:head# 2024-04-01T20:04:42.293 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecaf7e93:::benchmark_data_smithi188_173515_object60367:head# 2024-04-01T20:04:42.293 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecaf90e0:::benchmark_data_smithi188_173515_object116747:head# 2024-04-01T20:04:42.293 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecb07ac8:::benchmark_data_smithi188_173515_object64172:head# 2024-04-01T20:04:42.293 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecb0f8f9:::benchmark_data_smithi188_173515_object151586:head# 2024-04-01T20:04:42.293 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecb10a93:::benchmark_data_smithi188_173515_object131870:head# 2024-04-01T20:04:42.293 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecb10c67:::benchmark_data_smithi188_173515_object77887:head# 2024-04-01T20:04:42.293 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecb11eef:::benchmark_data_smithi188_173515_object129026:head# 2024-04-01T20:04:42.293 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecb167ed:::benchmark_data_smithi188_173515_object63610:head# 2024-04-01T20:04:42.293 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecb16e59:::benchmark_data_smithi188_173515_object124351:head# 2024-04-01T20:04:42.294 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecb1f155:::benchmark_data_smithi188_173515_object108239:head# 2024-04-01T20:04:42.294 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecb20766:::benchmark_data_smithi188_173515_object48198:head# 2024-04-01T20:04:42.294 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecb2168e:::benchmark_data_smithi188_173515_object135921:head# 2024-04-01T20:04:42.294 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecb37d4e:::benchmark_data_smithi188_173515_object115765:head# 2024-04-01T20:04:42.294 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecb41a67:::benchmark_data_smithi188_173515_object53094:head# 2024-04-01T20:04:42.294 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecb57bd6:::benchmark_data_smithi188_173515_object147367:head# 2024-04-01T20:04:42.294 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecb59c72:::benchmark_data_smithi188_173515_object105486:head# 2024-04-01T20:04:42.294 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecb5f405:::benchmark_data_smithi188_173515_object108286:head# 2024-04-01T20:04:42.294 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecb62aca:::benchmark_data_smithi188_173515_object57016:head# 2024-04-01T20:04:42.294 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecb8e49c:::benchmark_data_smithi188_173515_object104141:head# 2024-04-01T20:04:42.294 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecb90e68:::benchmark_data_smithi188_173515_object94796:head# 2024-04-01T20:04:42.294 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecb9e7d8:::benchmark_data_smithi188_173515_object105154:head# 2024-04-01T20:04:42.294 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecba234b:::benchmark_data_smithi188_173515_object107091:head# 2024-04-01T20:04:42.294 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecbc1631:::benchmark_data_smithi188_173515_object76488:head# 2024-04-01T20:04:42.294 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecbc52e0:::benchmark_data_smithi188_173515_object111229:head# 2024-04-01T20:04:42.295 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecbcbb73:::benchmark_data_smithi188_173515_object148837:head# 2024-04-01T20:04:42.295 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecbcfb55:::benchmark_data_smithi188_173515_object119036:head# 2024-04-01T20:04:42.295 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecbd3647:::benchmark_data_smithi188_173515_object77209:head# 2024-04-01T20:04:42.295 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecbdc936:::benchmark_data_smithi188_173515_object145497:head# 2024-04-01T20:04:42.295 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecbe3108:::benchmark_data_smithi188_173515_object101511:head# 2024-04-01T20:04:42.295 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecbe3243:::benchmark_data_smithi188_173515_object155294:head# 2024-04-01T20:04:42.295 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecbe9282:::benchmark_data_smithi188_173515_object84790:head# 2024-04-01T20:04:42.295 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecbe9eab:::benchmark_data_smithi188_173515_object136494:head# 2024-04-01T20:04:42.295 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecbea1d6:::benchmark_data_smithi188_173515_object49104:head# 2024-04-01T20:04:42.295 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecbeb160:::benchmark_data_smithi188_173515_object79649:head# 2024-04-01T20:04:42.295 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecbeb1e4:::benchmark_data_smithi188_173515_object111697:head# 2024-04-01T20:04:42.295 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecbee32e:::benchmark_data_smithi188_173515_object94119:head# 2024-04-01T20:04:42.295 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecbf8a62:::benchmark_data_smithi188_173515_object46303:head# 2024-04-01T20:04:42.295 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecc0047e:::benchmark_data_smithi188_173515_object142172:head# 2024-04-01T20:04:42.295 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecc046e4:::benchmark_data_smithi188_173515_object136427:head# 2024-04-01T20:04:42.296 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecc12c63:::benchmark_data_smithi188_173515_object154040:head# 2024-04-01T20:04:42.296 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecc2355c:::benchmark_data_smithi188_173515_object76131:head# 2024-04-01T20:04:42.296 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecc28cc4:::benchmark_data_smithi188_173515_object74496:head# 2024-04-01T20:04:42.296 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecc2b6bc:::benchmark_data_smithi188_173515_object140578:head# 2024-04-01T20:04:42.296 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecc3154d:::benchmark_data_smithi188_173515_object123036:head# 2024-04-01T20:04:42.296 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecc48927:::benchmark_data_smithi188_173515_object100794:head# 2024-04-01T20:04:42.296 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecc5560e:::benchmark_data_smithi188_173515_object97672:head# 2024-04-01T20:04:42.296 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecc5b459:::benchmark_data_smithi188_173515_object148129:head# 2024-04-01T20:04:42.296 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecc608b5:::benchmark_data_smithi188_173515_object133128:head# 2024-04-01T20:04:42.296 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecc67e9b:::benchmark_data_smithi188_173515_object134271:head# 2024-04-01T20:04:42.296 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecc752e4:::benchmark_data_smithi188_173515_object88432:head# 2024-04-01T20:04:42.296 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecc90f89:::benchmark_data_smithi188_173515_object68367:head# 2024-04-01T20:04:42.296 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecc9cf79:::benchmark_data_smithi188_173515_object72930:head# 2024-04-01T20:04:42.296 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecca25d0:::benchmark_data_smithi188_173515_object85839:head# 2024-04-01T20:04:42.297 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecca53dd:::benchmark_data_smithi188_173515_object123572:head# 2024-04-01T20:04:42.297 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecca78ad:::benchmark_data_smithi188_173515_object138023:head# 2024-04-01T20:04:42.297 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eccb0411:::benchmark_data_smithi188_173515_object126208:head# 2024-04-01T20:04:42.297 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eccbfe72:::benchmark_data_smithi188_173515_object112501:head# 2024-04-01T20:04:42.297 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eccc06cf:::benchmark_data_smithi188_173515_object82503:head# 2024-04-01T20:04:42.297 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eccc6e26:::benchmark_data_smithi188_173515_object100539:head# 2024-04-01T20:04:42.297 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eccc8209:::benchmark_data_smithi188_173515_object107950:head# 2024-04-01T20:04:42.297 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecccf2bb:::benchmark_data_smithi188_173515_object113084:head# 2024-04-01T20:04:42.297 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eccd2299:::benchmark_data_smithi188_173515_object48397:head# 2024-04-01T20:04:42.297 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eccd703c:::benchmark_data_smithi188_173515_object76381:head# 2024-04-01T20:04:42.297 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eccd9ae6:::benchmark_data_smithi188_173515_object61496:head# 2024-04-01T20:04:42.297 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecce474e:::benchmark_data_smithi188_173515_object85768:head# 2024-04-01T20:04:42.297 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecceddf7:::benchmark_data_smithi188_173515_object67071:head# 2024-04-01T20:04:42.297 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eccf2e01:::benchmark_data_smithi188_173515_object113645:head# 2024-04-01T20:04:42.297 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eccf75b2:::benchmark_data_smithi188_173515_object50149:head# 2024-04-01T20:04:42.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eccfd362:::benchmark_data_smithi188_173515_object126627:head# 2024-04-01T20:04:42.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecd037e3:::benchmark_data_smithi188_173515_object52606:head# 2024-04-01T20:04:42.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecd1f971:::benchmark_data_smithi188_173515_object95884:head# 2024-04-01T20:04:42.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecd24d93:::benchmark_data_smithi188_173515_object68260:head# 2024-04-01T20:04:42.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecd2b0f5:::benchmark_data_smithi188_173515_object75063:head# 2024-04-01T20:04:42.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecd41444:::benchmark_data_smithi188_173515_object135815:head# 2024-04-01T20:04:42.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecd43545:::benchmark_data_smithi188_173515_object126300:head# 2024-04-01T20:04:42.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecd4ed84:::benchmark_data_smithi188_173515_object76289:head# 2024-04-01T20:04:42.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecd613cd:::benchmark_data_smithi188_173515_object54197:head# 2024-04-01T20:04:42.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecd66e3e:::benchmark_data_smithi188_173515_object57823:head# 2024-04-01T20:04:42.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecd6d5ce:::benchmark_data_smithi188_173515_object106475:head# 2024-04-01T20:04:42.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecd7a674:::benchmark_data_smithi188_173515_object105190:head# 2024-04-01T20:04:42.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecd92d31:::benchmark_data_smithi188_173515_object101725:head# 2024-04-01T20:04:42.298 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecd93436:::benchmark_data_smithi188_173515_object123505:head# 2024-04-01T20:04:42.299 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecd9e0b2:::benchmark_data_smithi188_173515_object108225:head# 2024-04-01T20:04:42.299 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecdb5836:::benchmark_data_smithi188_173515_object112540:head# 2024-04-01T20:04:42.299 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecdbbc19:::benchmark_data_smithi188_173515_object145532:head# 2024-04-01T20:04:42.299 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecdce5eb:::benchmark_data_smithi188_173515_object119981:head# 2024-04-01T20:04:42.299 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecdda1a4:::benchmark_data_smithi188_173515_object133290:head# 2024-04-01T20:04:42.299 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecddbb0d:::benchmark_data_smithi188_173515_object55652:head# 2024-04-01T20:04:42.299 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecdf8568:::benchmark_data_smithi188_173515_object97479:head# 2024-04-01T20:04:42.299 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ece01ff1:::benchmark_data_smithi188_173515_object90792:head# 2024-04-01T20:04:42.299 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ece07589:::benchmark_data_smithi188_173515_object63981:head# 2024-04-01T20:04:42.299 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ece1b63e:::benchmark_data_smithi188_173515_object146529:head# 2024-04-01T20:04:42.299 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ece1eff6:::benchmark_data_smithi188_173515_object51080:head# 2024-04-01T20:04:42.299 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ece1f969:::benchmark_data_smithi188_173515_object64350:head# 2024-04-01T20:04:42.299 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ece21e99:::benchmark_data_smithi188_173515_object77923:head# 2024-04-01T20:04:42.299 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ece31be9:::benchmark_data_smithi188_173515_object150436:head# 2024-04-01T20:04:42.299 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ece381d0:::benchmark_data_smithi188_173515_object123962:head# 2024-04-01T20:04:42.300 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ece47bca:::benchmark_data_smithi188_173515_object152886:head# 2024-04-01T20:04:42.300 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ece47c7d:::benchmark_data_smithi188_173515_object52846:head# 2024-04-01T20:04:42.300 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ece494ad:::benchmark_data_smithi188_173515_object71162:head# 2024-04-01T20:04:42.300 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ece4ddff:::benchmark_data_smithi188_173515_object95237:head# 2024-04-01T20:04:42.300 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ece5ae8b:::benchmark_data_smithi188_173515_object70977:head# 2024-04-01T20:04:42.300 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ece5c279:::benchmark_data_smithi188_173515_object140760:head# 2024-04-01T20:04:42.300 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ece718de:::benchmark_data_smithi188_173515_object93751:head# 2024-04-01T20:04:42.300 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ece7c3a8:::benchmark_data_smithi188_173515_object122226:head# 2024-04-01T20:04:42.300 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ece819c2:::benchmark_data_smithi188_173515_object115453:head# 2024-04-01T20:04:42.300 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ece9c96e:::benchmark_data_smithi188_173515_object117238:head# 2024-04-01T20:04:42.300 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecebead3:::benchmark_data_smithi188_173515_object56733:head# 2024-04-01T20:04:42.300 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecebfb36:::benchmark_data_smithi188_173515_object93301:head# 2024-04-01T20:04:42.300 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecec2a21:::benchmark_data_smithi188_173515_object113152:head# 2024-04-01T20:04:42.300 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eced099f:::benchmark_data_smithi188_173515_object76272:head# 2024-04-01T20:04:42.300 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eced36c3:::benchmark_data_smithi188_173515_object86662:head# 2024-04-01T20:04:42.301 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eced70d1:::benchmark_data_smithi188_173515_object77961:head# 2024-04-01T20:04:42.301 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eceeb7ef:::benchmark_data_smithi188_173515_object137190:head# 2024-04-01T20:04:42.301 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecef293d:::benchmark_data_smithi188_173515_object141549:head# 2024-04-01T20:04:42.301 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecef9f7e:::benchmark_data_smithi188_173515_object134726:head# 2024-04-01T20:04:42.301 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecefa77d:::benchmark_data_smithi188_173515_object59129:head# 2024-04-01T20:04:42.301 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecf00a53:::benchmark_data_smithi188_173515_object109973:head# 2024-04-01T20:04:42.301 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecf00fd3:::benchmark_data_smithi188_173515_object111489:head# 2024-04-01T20:04:42.301 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecf04a00:::benchmark_data_smithi188_173515_object149133:head# 2024-04-01T20:04:42.301 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecf06660:::benchmark_data_smithi188_173515_object84860:head# 2024-04-01T20:04:42.301 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecf07413:::benchmark_data_smithi188_173515_object152554:head# 2024-04-01T20:04:42.301 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecf218ae:::benchmark_data_smithi188_173515_object69303:head# 2024-04-01T20:04:42.301 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecf2267b:::benchmark_data_smithi188_173515_object151374:head# 2024-04-01T20:04:42.301 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecf350e8:::benchmark_data_smithi188_173515_object136503:head# 2024-04-01T20:04:42.301 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecf36580:::benchmark_data_smithi188_173515_object107569:head# 2024-04-01T20:04:42.302 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecf3851a:::benchmark_data_smithi188_173515_object78812:head# 2024-04-01T20:04:42.302 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecf459f7:::benchmark_data_smithi188_173515_object113585:head# 2024-04-01T20:04:42.302 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecf4eec3:::benchmark_data_smithi188_173515_object97935:head# 2024-04-01T20:04:42.302 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecf51dfd:::benchmark_data_smithi188_173515_object136102:head# 2024-04-01T20:04:42.302 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecf681e6:::benchmark_data_smithi188_173515_object71230:head# 2024-04-01T20:04:42.302 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecf7b547:::benchmark_data_smithi188_173515_object64502:head# 2024-04-01T20:04:42.302 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecf7ed75:::benchmark_data_smithi188_173515_object147372:head# 2024-04-01T20:04:42.302 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecf9af14:::benchmark_data_smithi188_173515_object150028:head# 2024-04-01T20:04:42.302 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecf9b0f3:::benchmark_data_smithi188_173515_object115678:head# 2024-04-01T20:04:42.302 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecf9dc93:::benchmark_data_smithi188_173515_object143631:head# 2024-04-01T20:04:42.302 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecfa96e6:::benchmark_data_smithi188_173515_object59724:head# 2024-04-01T20:04:42.302 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecfa9a87:::benchmark_data_smithi188_173515_object74189:head# 2024-04-01T20:04:42.302 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecfafb16:::benchmark_data_smithi188_173515_object121397:head# 2024-04-01T20:04:42.302 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecfb0f16:::benchmark_data_smithi188_173515_object77333:head# 2024-04-01T20:04:42.302 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecfb6fd4:::benchmark_data_smithi188_173515_object113212:head# 2024-04-01T20:04:42.302 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecfb86b9:::benchmark_data_smithi188_173515_object112936:head# 2024-04-01T20:04:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecfc2fe6:::benchmark_data_smithi188_173515_object50099:head# 2024-04-01T20:04:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecfc769f:::benchmark_data_smithi188_173515_object114977:head# 2024-04-01T20:04:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecfc9858:::benchmark_data_smithi188_173515_object148465:head# 2024-04-01T20:04:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecfd6be5:::benchmark_data_smithi188_173515_object141226:head# 2024-04-01T20:04:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecfe343f:::benchmark_data_smithi188_173515_object65125:head# 2024-04-01T20:04:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecfef831:::benchmark_data_smithi188_173515_object78260:head# 2024-04-01T20:04:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecff550d:::benchmark_data_smithi188_173515_object87314:head# 2024-04-01T20:04:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecff57d5:::benchmark_data_smithi188_173515_object82661:head# 2024-04-01T20:04:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ecffa682:::benchmark_data_smithi188_173515_object130047:head# 2024-04-01T20:04:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed00d7f9:::benchmark_data_smithi188_173515_object95482:head# 2024-04-01T20:04:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed01abd8:::benchmark_data_smithi188_173515_object128761:head# 2024-04-01T20:04:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed028772:::benchmark_data_smithi188_173515_object134826:head# 2024-04-01T20:04:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed02e5b3:::benchmark_data_smithi188_173515_object76156:head# 2024-04-01T20:04:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed02fd10:::benchmark_data_smithi188_173515_object76039:head# 2024-04-01T20:04:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed03fac0:::benchmark_data_smithi188_173515_object97955:head# 2024-04-01T20:04:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed046018:::benchmark_data_smithi188_173515_object85684:head# 2024-04-01T20:04:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed048dad:::benchmark_data_smithi188_173515_object53041:head# 2024-04-01T20:04:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed065332:::benchmark_data_smithi188_173515_object108176:head# 2024-04-01T20:04:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed06c6f7:::benchmark_data_smithi188_173515_object62598:head# 2024-04-01T20:04:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed082d25:::benchmark_data_smithi188_173515_object54965:head# 2024-04-01T20:04:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed083fd3:::benchmark_data_smithi188_173515_object138526:head# 2024-04-01T20:04:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed08fad3:::benchmark_data_smithi188_173515_object50059:head# 2024-04-01T20:04:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed098b59:::benchmark_data_smithi188_173515_object154145:head# 2024-04-01T20:04:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed09d933:::benchmark_data_smithi188_173515_object131124:head# 2024-04-01T20:04:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed0a97f7:::benchmark_data_smithi188_173515_object147803:head# 2024-04-01T20:04:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed0bcac5:::benchmark_data_smithi188_173515_object144104:head# 2024-04-01T20:04:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed0d7f0e:::benchmark_data_smithi188_173515_object154001:head# 2024-04-01T20:04:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed0e079d:::benchmark_data_smithi188_173515_object134888:head# 2024-04-01T20:04:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed0e0be4:::benchmark_data_smithi188_173515_object153589:head# 2024-04-01T20:04:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed0e700d:::benchmark_data_smithi188_173515_object136462:head# 2024-04-01T20:04:42.305 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed0f455d:::benchmark_data_smithi188_173515_object47694:head# 2024-04-01T20:04:42.305 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed0f541c:::benchmark_data_smithi188_173515_object101079:head# 2024-04-01T20:04:42.305 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed0f7826:::benchmark_data_smithi188_173515_object77396:head# 2024-04-01T20:04:42.305 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed0fdc21:::benchmark_data_smithi188_173515_object124870:head# 2024-04-01T20:04:42.305 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed0ffc37:::benchmark_data_smithi188_173515_object74631:head# 2024-04-01T20:04:42.305 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed104eb2:::benchmark_data_smithi188_173515_object77522:head# 2024-04-01T20:04:42.305 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed10ac90:::benchmark_data_smithi188_173515_object138467:head# 2024-04-01T20:04:42.305 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed112526:::benchmark_data_smithi188_173515_object133601:head# 2024-04-01T20:04:42.305 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed112f68:::benchmark_data_smithi188_173515_object123028:head# 2024-04-01T20:04:42.305 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed116265:::benchmark_data_smithi188_173515_object105156:head# 2024-04-01T20:04:42.305 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed13a38f:::benchmark_data_smithi188_173515_object132058:head# 2024-04-01T20:04:42.305 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed1403af:::benchmark_data_smithi188_173515_object107571:head# 2024-04-01T20:04:42.305 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed14ec7c:::benchmark_data_smithi188_173515_object116557:head# 2024-04-01T20:04:42.305 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed152b56:::benchmark_data_smithi188_173515_object78367:head# 2024-04-01T20:04:42.306 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed159b83:::benchmark_data_smithi188_173515_object57686:head# 2024-04-01T20:04:42.306 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed15ad09:::benchmark_data_smithi188_173515_object93483:head# 2024-04-01T20:04:42.306 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed16bdb4:::benchmark_data_smithi188_173515_object126147:head# 2024-04-01T20:04:42.306 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed172794:::benchmark_data_smithi188_173515_object142452:head# 2024-04-01T20:04:42.306 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed17379d:::benchmark_data_smithi188_173515_object68748:head# 2024-04-01T20:04:42.306 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed17629b:::benchmark_data_smithi188_173515_object46115:head# 2024-04-01T20:04:42.306 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed18a3e3:::benchmark_data_smithi188_173515_object113689:head# 2024-04-01T20:04:42.306 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed1918ce:::benchmark_data_smithi188_173515_object110586:head# 2024-04-01T20:04:42.306 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed198a07:::benchmark_data_smithi188_173515_object152482:head# 2024-04-01T20:04:42.306 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed19f109:::benchmark_data_smithi188_173515_object69428:head# 2024-04-01T20:04:42.306 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed1a1e05:::benchmark_data_smithi188_173515_object56462:head# 2024-04-01T20:04:42.306 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed1a4154:::benchmark_data_smithi188_173515_object114347:head# 2024-04-01T20:04:42.306 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed1abe39:::benchmark_data_smithi188_173515_object49248:head# 2024-04-01T20:04:42.306 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed1aeef9:::benchmark_data_smithi188_173515_object101316:head# 2024-04-01T20:04:42.307 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed1b3203:::benchmark_data_smithi188_173515_object109595:head# 2024-04-01T20:04:42.307 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed1c2933:::benchmark_data_smithi188_173515_object137070:head# 2024-04-01T20:04:42.307 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed1c2b30:::benchmark_data_smithi188_173515_object106749:head# 2024-04-01T20:04:42.307 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed1e235d:::benchmark_data_smithi188_173515_object67224:head# 2024-04-01T20:04:42.307 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed1e480e:::benchmark_data_smithi188_173515_object146455:head# 2024-04-01T20:04:42.307 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed1e8543:::benchmark_data_smithi188_173515_object113669:head# 2024-04-01T20:04:42.307 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed1fe193:::benchmark_data_smithi188_173515_object89498:head# 2024-04-01T20:04:42.307 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed207d7f:::benchmark_data_smithi188_173515_object146396:head# 2024-04-01T20:04:42.307 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed20b35d:::benchmark_data_smithi188_173515_object130021:head# 2024-04-01T20:04:42.307 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed21b663:::benchmark_data_smithi188_173515_object151997:head# 2024-04-01T20:04:42.307 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed21ba3d:::benchmark_data_smithi188_173515_object131598:head# 2024-04-01T20:04:42.307 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed21edd8:::benchmark_data_smithi188_173515_object113957:head# 2024-04-01T20:04:42.307 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed2280a8:::benchmark_data_smithi188_173515_object68986:head# 2024-04-01T20:04:42.307 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed236943:::benchmark_data_smithi188_173515_object143721:head# 2024-04-01T20:04:42.307 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed23a304:::benchmark_data_smithi188_173515_object112494:head# 2024-04-01T20:04:42.308 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed244538:::benchmark_data_smithi188_173515_object126336:head# 2024-04-01T20:04:42.308 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed24e6aa:::benchmark_data_smithi188_173515_object47309:head# 2024-04-01T20:04:42.308 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed2508b2:::benchmark_data_smithi188_173515_object90109:head# 2024-04-01T20:04:42.308 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed26115c:::benchmark_data_smithi188_173515_object146925:head# 2024-04-01T20:04:42.308 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed26b2fd:::benchmark_data_smithi188_173515_object75793:head# 2024-04-01T20:04:42.308 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed26da63:::benchmark_data_smithi188_173515_object86575:head# 2024-04-01T20:04:42.308 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed27375c:::benchmark_data_smithi188_173515_object149020:head# 2024-04-01T20:04:42.308 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed27b3d8:::benchmark_data_smithi188_173515_object92509:head# 2024-04-01T20:04:42.308 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed2803f0:::benchmark_data_smithi188_173515_object95174:head# 2024-04-01T20:04:42.308 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed281f42:::benchmark_data_smithi188_173515_object84870:head# 2024-04-01T20:04:42.308 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed282051:::benchmark_data_smithi188_173515_object88817:head# 2024-04-01T20:04:42.308 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed28771e:::benchmark_data_smithi188_173515_object83700:head# 2024-04-01T20:04:42.308 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed28aae1:::benchmark_data_smithi188_173515_object104532:head# 2024-04-01T20:04:42.308 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed29c6fb:::benchmark_data_smithi188_173515_object88477:head# 2024-04-01T20:04:42.309 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed29dcfb:::benchmark_data_smithi188_173515_object92681:head# 2024-04-01T20:04:42.309 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed29eae0:::benchmark_data_smithi188_173515_object85299:head# 2024-04-01T20:04:42.309 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed2ae2c7:::benchmark_data_smithi188_173515_object85807:head# 2024-04-01T20:04:42.309 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed2af160:::benchmark_data_smithi188_173515_object127789:head# 2024-04-01T20:04:42.309 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed2d632c:::benchmark_data_smithi188_173515_object70835:head# 2024-04-01T20:04:42.309 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed2f762a:::benchmark_data_smithi188_173515_object100789:head# 2024-04-01T20:04:42.309 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed30f5d2:::benchmark_data_smithi188_173515_object137067:head# 2024-04-01T20:04:42.309 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed311650:::benchmark_data_smithi188_173515_object151699:head# 2024-04-01T20:04:42.309 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed317013:::benchmark_data_smithi188_173515_object101147:head# 2024-04-01T20:04:42.309 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed31f396:::benchmark_data_smithi188_173515_object116190:head# 2024-04-01T20:04:42.309 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed32469b:::benchmark_data_smithi188_173515_object112830:head# 2024-04-01T20:04:42.309 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed328ec7:::benchmark_data_smithi188_173515_object101914:head# 2024-04-01T20:04:42.309 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed349abc:::benchmark_data_smithi188_173515_object113194:head# 2024-04-01T20:04:42.309 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed359597:::benchmark_data_smithi188_173515_object150469:head# 2024-04-01T20:04:42.309 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed362359:::benchmark_data_smithi188_173515_object155965:head# 2024-04-01T20:04:42.310 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed3741fc:::benchmark_data_smithi188_173515_object145208:head# 2024-04-01T20:04:42.310 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed374aea:::benchmark_data_smithi188_173515_object83956:head# 2024-04-01T20:04:42.310 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed376637:::benchmark_data_smithi188_173515_object75633:head# 2024-04-01T20:04:42.310 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed378e3e:::benchmark_data_smithi188_173515_object58163:head# 2024-04-01T20:04:42.310 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed3834e8:::benchmark_data_smithi188_173515_object83731:head# 2024-04-01T20:04:42.310 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed38bf79:::benchmark_data_smithi188_173515_object94943:head# 2024-04-01T20:04:42.310 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed396e50:::benchmark_data_smithi188_173515_object101645:head# 2024-04-01T20:04:42.310 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed39b0e0:::benchmark_data_smithi188_173515_object58276:head# 2024-04-01T20:04:42.310 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed3ab22d:::benchmark_data_smithi188_173515_object64574:head# 2024-04-01T20:04:42.310 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed3b24aa:::benchmark_data_smithi188_173515_object92511:head# 2024-04-01T20:04:42.310 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed3b5a0f:::benchmark_data_smithi188_173515_object61531:head# 2024-04-01T20:04:42.310 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed3bcf54:::benchmark_data_smithi188_173515_object68583:head# 2024-04-01T20:04:42.310 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed3e3704:::benchmark_data_smithi188_173515_object116703:head# 2024-04-01T20:04:42.310 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed3e5e98:::benchmark_data_smithi188_173515_object68376:head# 2024-04-01T20:04:42.311 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed3e75e8:::benchmark_data_smithi188_173515_object93865:head# 2024-04-01T20:04:42.311 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed3fe6ac:::benchmark_data_smithi188_173515_object118827:head# 2024-04-01T20:04:42.311 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed403fc3:::benchmark_data_smithi188_173515_object121260:head# 2024-04-01T20:04:42.311 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed40d3d9:::benchmark_data_smithi188_173515_object94716:head# 2024-04-01T20:04:42.311 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed412278:::benchmark_data_smithi188_173515_object58921:head# 2024-04-01T20:04:42.311 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed413f33:::benchmark_data_smithi188_173515_object152364:head# 2024-04-01T20:04:42.311 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed41437d:::benchmark_data_smithi188_173515_object120792:head# 2024-04-01T20:04:42.311 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed42d226:::benchmark_data_smithi188_173515_object130195:head# 2024-04-01T20:04:42.311 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed433ad2:::benchmark_data_smithi188_173515_object115725:head# 2024-04-01T20:04:42.311 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed441c42:::benchmark_data_smithi188_173515_object79053:head# 2024-04-01T20:04:42.311 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed4445fe:::benchmark_data_smithi188_173515_object100440:head# 2024-04-01T20:04:42.311 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed445e6b:::benchmark_data_smithi188_173515_object114391:head# 2024-04-01T20:04:42.311 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed454c47:::benchmark_data_smithi188_173515_object99957:head# 2024-04-01T20:04:42.311 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed45cd12:::benchmark_data_smithi188_173515_object138419:head# 2024-04-01T20:04:42.312 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed487fc6:::benchmark_data_smithi188_173515_object78358:head# 2024-04-01T20:04:42.312 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed488217:::benchmark_data_smithi188_173515_object114507:head# 2024-04-01T20:04:42.312 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed4942ad:::benchmark_data_smithi188_173515_object116975:head# 2024-04-01T20:04:42.312 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed496810:::benchmark_data_smithi188_173515_object62371:head# 2024-04-01T20:04:42.312 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed4a1b8c:::benchmark_data_smithi188_173515_object82880:head# 2024-04-01T20:04:42.312 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed4a2724:::benchmark_data_smithi188_173515_object152342:head# 2024-04-01T20:04:42.312 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed4a7496:::benchmark_data_smithi188_173515_object64775:head# 2024-04-01T20:04:42.312 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed4bfc18:::benchmark_data_smithi188_173515_object144967:head# 2024-04-01T20:04:42.312 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed4cfc45:::benchmark_data_smithi188_173515_object149145:head# 2024-04-01T20:04:42.312 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed4d166e:::benchmark_data_smithi188_173515_object149872:head# 2024-04-01T20:04:42.312 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed4d2f98:::benchmark_data_smithi188_173515_object61244:head# 2024-04-01T20:04:42.312 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed4f8ee7:::benchmark_data_smithi188_173515_object46564:head# 2024-04-01T20:04:42.312 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed4f8fc4:::benchmark_data_smithi188_173515_object89928:head# 2024-04-01T20:04:42.312 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed4ff84e:::benchmark_data_smithi188_173515_object62268:head# 2024-04-01T20:04:42.313 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5042ad:::benchmark_data_smithi188_173515_object155208:head# 2024-04-01T20:04:42.313 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed519842:::benchmark_data_smithi188_173515_object102695:head# 2024-04-01T20:04:42.313 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed519a97:::benchmark_data_smithi188_173515_object118748:head# 2024-04-01T20:04:42.313 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed51e065:::benchmark_data_smithi188_173515_object73638:head# 2024-04-01T20:04:42.313 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed51e544:::benchmark_data_smithi188_173515_object98273:head# 2024-04-01T20:04:42.313 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed52ef45:::benchmark_data_smithi188_173515_object129954:head# 2024-04-01T20:04:42.313 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5341dd:::benchmark_data_smithi188_173515_object122044:head# 2024-04-01T20:04:42.313 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed558e24:::benchmark_data_smithi188_173515_object154584:head# 2024-04-01T20:04:42.313 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5605a4:::benchmark_data_smithi188_173515_object85989:head# 2024-04-01T20:04:42.313 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed57ff1f:::benchmark_data_smithi188_173515_object78536:head# 2024-04-01T20:04:42.313 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed582106:::benchmark_data_smithi188_173515_object134956:head# 2024-04-01T20:04:42.313 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed58a5a0:::benchmark_data_smithi188_173515_object110104:head# 2024-04-01T20:04:42.313 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5978e4:::benchmark_data_smithi188_173515_object77253:head# 2024-04-01T20:04:42.313 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed597d79:::benchmark_data_smithi188_173515_object128894:head# 2024-04-01T20:04:42.314 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5a03df:::benchmark_data_smithi188_173515_object136306:head# 2024-04-01T20:04:42.314 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5a0c04:::benchmark_data_smithi188_173515_object110857:head# 2024-04-01T20:04:42.314 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5a5e55:::benchmark_data_smithi188_173515_object146710:head# 2024-04-01T20:04:42.314 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5a708d:::benchmark_data_smithi188_173515_object71768:head# 2024-04-01T20:04:42.314 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5a7115:::benchmark_data_smithi188_173515_object70093:head# 2024-04-01T20:04:42.314 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5ab8f2:::benchmark_data_smithi188_173515_object82516:head# 2024-04-01T20:04:42.314 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5b3981:::benchmark_data_smithi188_173515_object58377:head# 2024-04-01T20:04:42.314 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5b4c76:::benchmark_data_smithi188_173515_object50715:head# 2024-04-01T20:04:42.314 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5b6a08:::benchmark_data_smithi188_173515_object143428:head# 2024-04-01T20:04:42.314 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5b8c7d:::benchmark_data_smithi188_173515_object70751:head# 2024-04-01T20:04:42.314 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5baef2:::benchmark_data_smithi188_173515_object107364:head# 2024-04-01T20:04:42.314 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5bc3ec:::benchmark_data_smithi188_173515_object99000:head# 2024-04-01T20:04:42.314 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5be57a:::benchmark_data_smithi188_173515_object60486:head# 2024-04-01T20:04:42.315 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5c740e:::benchmark_data_smithi188_173515_object120117:head# 2024-04-01T20:04:42.315 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5cedcd:::benchmark_data_smithi188_173515_object79875:head# 2024-04-01T20:04:42.315 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5cf629:::benchmark_data_smithi188_173515_object150569:head# 2024-04-01T20:04:42.315 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5d1ace:::benchmark_data_smithi188_173515_object120513:head# 2024-04-01T20:04:42.315 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5d2ccb:::benchmark_data_smithi188_173515_object121496:head# 2024-04-01T20:04:42.315 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5dca46:::benchmark_data_smithi188_173515_object80264:head# 2024-04-01T20:04:42.315 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5e045a:::benchmark_data_smithi188_173515_object132738:head# 2024-04-01T20:04:42.315 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5e2eca:::benchmark_data_smithi188_173515_object61865:head# 2024-04-01T20:04:42.315 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5e4626:::benchmark_data_smithi188_173515_object53339:head# 2024-04-01T20:04:42.315 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5e9c6b:::benchmark_data_smithi188_173515_object105634:head# 2024-04-01T20:04:42.315 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5eba83:::benchmark_data_smithi188_173515_object72324:head# 2024-04-01T20:04:42.315 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5ee800:::benchmark_data_smithi188_173515_object52405:head# 2024-04-01T20:04:42.315 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed5efd9c:::benchmark_data_smithi188_173515_object128015:head# 2024-04-01T20:04:42.315 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed601eae:::benchmark_data_smithi188_173515_object58476:head# 2024-04-01T20:04:42.315 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed6093b7:::benchmark_data_smithi188_173515_object150278:head# 2024-04-01T20:04:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed60bf28:::benchmark_data_smithi188_173515_object107498:head# 2024-04-01T20:04:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed60d643:::benchmark_data_smithi188_173515_object75735:head# 2024-04-01T20:04:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed618951:::benchmark_data_smithi188_173515_object141468:head# 2024-04-01T20:04:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed62945a:::benchmark_data_smithi188_173515_object138184:head# 2024-04-01T20:04:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed6382a5:::benchmark_data_smithi188_173515_object70592:head# 2024-04-01T20:04:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed64ca0f:::benchmark_data_smithi188_173515_object126365:head# 2024-04-01T20:04:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed658c81:::benchmark_data_smithi188_173515_object94543:head# 2024-04-01T20:04:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed667ae3:::benchmark_data_smithi188_173515_object93526:head# 2024-04-01T20:04:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed66b49f:::benchmark_data_smithi188_173515_object122944:head# 2024-04-01T20:04:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed66dee7:::benchmark_data_smithi188_173515_object82487:head# 2024-04-01T20:04:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed66ff80:::benchmark_data_smithi188_173515_object121889:head# 2024-04-01T20:04:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed67d7e9:::benchmark_data_smithi188_173515_object97225:head# 2024-04-01T20:04:42.316 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed68018d:::benchmark_data_smithi188_173515_object152578:head# 2024-04-01T20:04:42.317 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed68351e:::benchmark_data_smithi188_173515_object148123:head# 2024-04-01T20:04:42.317 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed6866b8:::benchmark_data_smithi188_173515_object52911:head# 2024-04-01T20:04:42.317 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed68f65b:::benchmark_data_smithi188_173515_object128377:head# 2024-04-01T20:04:42.317 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed6a0dec:::benchmark_data_smithi188_173515_object149392:head# 2024-04-01T20:04:42.317 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed6bb0e2:::benchmark_data_smithi188_173515_object135203:head# 2024-04-01T20:04:42.317 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed6bdbf5:::benchmark_data_smithi188_173515_object79277:head# 2024-04-01T20:04:42.317 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed6d4653:::benchmark_data_smithi188_173515_object119006:head# 2024-04-01T20:04:42.317 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed6ddcfc:::benchmark_data_smithi188_173515_object64264:head# 2024-04-01T20:04:42.317 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed6e2639:::benchmark_data_smithi188_173515_object148322:head# 2024-04-01T20:04:42.317 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed6e3d33:::benchmark_data_smithi188_173515_object125808:head# 2024-04-01T20:04:42.317 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed6fe088:::benchmark_data_smithi188_173515_object127032:head# 2024-04-01T20:04:42.317 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed7063c7:::benchmark_data_smithi188_173515_object135400:head# 2024-04-01T20:04:42.317 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed707805:::benchmark_data_smithi188_173515_object87936:head# 2024-04-01T20:04:42.317 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed70fbc2:::benchmark_data_smithi188_173515_object78543:head# 2024-04-01T20:04:42.317 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed71ab67:::benchmark_data_smithi188_173515_object98562:head# 2024-04-01T20:04:42.318 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed723539:::benchmark_data_smithi188_173515_object78076:head# 2024-04-01T20:04:42.318 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed73586e:::benchmark_data_smithi188_173515_object150716:head# 2024-04-01T20:04:42.318 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed73a1ca:::benchmark_data_smithi188_173515_object111212:head# 2024-04-01T20:04:42.318 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed73cc1e:::benchmark_data_smithi188_173515_object90708:head# 2024-04-01T20:04:42.318 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed743127:::benchmark_data_smithi188_173515_object142554:head# 2024-04-01T20:04:42.318 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed748bfe:::benchmark_data_smithi188_173515_object146777:head# 2024-04-01T20:04:42.318 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed75d0db:::benchmark_data_smithi188_173515_object101372:head# 2024-04-01T20:04:42.318 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed7603fe:::benchmark_data_smithi188_173515_object105962:head# 2024-04-01T20:04:42.318 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed771f41:::benchmark_data_smithi188_173515_object119369:head# 2024-04-01T20:04:42.318 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed775a4b:::benchmark_data_smithi188_173515_object142875:head# 2024-04-01T20:04:42.318 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed777ce3:::benchmark_data_smithi188_173515_object124297:head# 2024-04-01T20:04:42.318 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed78843a:::benchmark_data_smithi188_173515_object110431:head# 2024-04-01T20:04:42.318 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed78edee:::benchmark_data_smithi188_173515_object129578:head# 2024-04-01T20:04:42.318 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed793ea4:::benchmark_data_smithi188_173515_object117873:head# 2024-04-01T20:04:42.319 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed79bac4:::benchmark_data_smithi188_173515_object63709:head# 2024-04-01T20:04:42.319 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed7a12e7:::benchmark_data_smithi188_173515_object60245:head# 2024-04-01T20:04:42.319 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed7af4d1:::benchmark_data_smithi188_173515_object116097:head# 2024-04-01T20:04:42.319 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed7b8d8f:::benchmark_data_smithi188_173515_object70946:head# 2024-04-01T20:04:42.319 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed7ce05a:::benchmark_data_smithi188_173515_object73047:head# 2024-04-01T20:04:42.319 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed7cf9da:::benchmark_data_smithi188_173515_object104597:head# 2024-04-01T20:04:42.319 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed7d71df:::benchmark_data_smithi188_173515_object119716:head# 2024-04-01T20:04:42.319 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed7d83ea:::benchmark_data_smithi188_173515_object136481:head# 2024-04-01T20:04:42.319 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed7dae35:::benchmark_data_smithi188_173515_object64067:head# 2024-04-01T20:04:42.319 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed7e5cea:::benchmark_data_smithi188_173515_object82327:head# 2024-04-01T20:04:42.319 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed7e7ebc:::benchmark_data_smithi188_173515_object50226:head# 2024-04-01T20:04:42.319 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed7e85ff:::benchmark_data_smithi188_173515_object50684:head# 2024-04-01T20:04:42.319 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed7f98ef:::benchmark_data_smithi188_173515_object88248:head# 2024-04-01T20:04:42.319 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed80a402:::benchmark_data_smithi188_173515_object55241:head# 2024-04-01T20:04:42.319 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed80af81:::benchmark_data_smithi188_173515_object48696:head# 2024-04-01T20:04:42.320 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed81d171:::benchmark_data_smithi188_173515_object94522:head# 2024-04-01T20:04:42.320 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed831856:::benchmark_data_smithi188_173515_object76991:head# 2024-04-01T20:04:42.320 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed835374:::benchmark_data_smithi188_173515_object53854:head# 2024-04-01T20:04:42.320 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed839b66:::benchmark_data_smithi188_173515_object122967:head# 2024-04-01T20:04:42.320 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed83cd1b:::benchmark_data_smithi188_173515_object51923:head# 2024-04-01T20:04:42.320 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed83e0df:::benchmark_data_smithi188_173515_object79200:head# 2024-04-01T20:04:42.320 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed83eda8:::benchmark_data_smithi188_173515_object108350:head# 2024-04-01T20:04:42.320 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed844035:::benchmark_data_smithi188_173515_object85381:head# 2024-04-01T20:04:42.320 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed862661:::benchmark_data_smithi188_173515_object59398:head# 2024-04-01T20:04:42.320 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed868f21:::benchmark_data_smithi188_173515_object155341:head# 2024-04-01T20:04:42.320 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed894ef3:::benchmark_data_smithi188_173515_object96603:head# 2024-04-01T20:04:42.320 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed89b4b3:::benchmark_data_smithi188_173515_object88965:head# 2024-04-01T20:04:42.320 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed8a6fa2:::benchmark_data_smithi188_173515_object139910:head# 2024-04-01T20:04:42.320 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed8ad82a:::benchmark_data_smithi188_173515_object134906:head# 2024-04-01T20:04:42.320 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed8b96b2:::benchmark_data_smithi188_173515_object120668:head# 2024-04-01T20:04:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed8cd51c:::benchmark_data_smithi188_173515_object109665:head# 2024-04-01T20:04:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed8cddef:::benchmark_data_smithi188_173515_object145906:head# 2024-04-01T20:04:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed8da31e:::benchmark_data_smithi188_173515_object96181:head# 2024-04-01T20:04:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed8f246a:::benchmark_data_smithi188_173515_object49657:head# 2024-04-01T20:04:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed90388c:::benchmark_data_smithi188_173515_object136538:head# 2024-04-01T20:04:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed904db3:::benchmark_data_smithi188_173515_object135168:head# 2024-04-01T20:04:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed90b0b3:::benchmark_data_smithi188_173515_object115027:head# 2024-04-01T20:04:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed90b0eb:::benchmark_data_smithi188_173515_object59808:head# 2024-04-01T20:04:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed9196fb:::benchmark_data_smithi188_173515_object82143:head# 2024-04-01T20:04:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed92c1de:::benchmark_data_smithi188_173515_object90566:head# 2024-04-01T20:04:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed93684c:::benchmark_data_smithi188_173515_object140285:head# 2024-04-01T20:04:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed950773:::benchmark_data_smithi188_173515_object129697:head# 2024-04-01T20:04:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed953db4:::benchmark_data_smithi188_173515_object121444:head# 2024-04-01T20:04:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed95631b:::benchmark_data_smithi188_173515_object142013:head# 2024-04-01T20:04:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed956ff9:::benchmark_data_smithi188_173515_object149770:head# 2024-04-01T20:04:42.322 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed95ea3c:::benchmark_data_smithi188_173515_object79918:head# 2024-04-01T20:04:42.322 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed9760f7:::benchmark_data_smithi188_173515_object152188:head# 2024-04-01T20:04:42.322 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed97d0ba:::benchmark_data_smithi188_173515_object133658:head# 2024-04-01T20:04:42.322 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed992f99:::benchmark_data_smithi188_173515_object81319:head# 2024-04-01T20:04:42.322 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed999307:::benchmark_data_smithi188_173515_object95004:head# 2024-04-01T20:04:42.322 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed999a75:::benchmark_data_smithi188_173515_object61602:head# 2024-04-01T20:04:42.322 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed9a507d:::benchmark_data_smithi188_173515_object137739:head# 2024-04-01T20:04:42.322 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed9ac0f4:::benchmark_data_smithi188_173515_object128612:head# 2024-04-01T20:04:42.322 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed9ae5a3:::benchmark_data_smithi188_173515_object110626:head# 2024-04-01T20:04:42.322 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed9b1815:::benchmark_data_smithi188_173515_object68896:head# 2024-04-01T20:04:42.322 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed9b2bff:::benchmark_data_smithi188_173515_object103585:head# 2024-04-01T20:04:42.483 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed9b5571:::benchmark_data_smithi188_173515_object123603:head# 2024-04-01T20:04:42.483 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed9ba315:::benchmark_data_smithi188_173515_object101626:head# 2024-04-01T20:04:42.483 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed9bd1b7:::benchmark_data_smithi188_173515_object102769:head# 2024-04-01T20:04:42.483 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed9c2f80:::benchmark_data_smithi188_173515_object125654:head# 2024-04-01T20:04:42.483 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed9d03a5:::benchmark_data_smithi188_173515_object91310:head# 2024-04-01T20:04:42.483 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed9e3908:::benchmark_data_smithi188_173515_object76048:head# 2024-04-01T20:04:42.483 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed9e677b:::benchmark_data_smithi188_173515_object104124:head# 2024-04-01T20:04:42.483 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ed9f59dc:::benchmark_data_smithi188_173515_object91128:head# 2024-04-01T20:04:42.483 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eda07180:::benchmark_data_smithi188_173515_object105872:head# 2024-04-01T20:04:42.484 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eda0bcfa:::benchmark_data_smithi188_173515_object67448:head# 2024-04-01T20:04:42.484 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eda11a0d:::benchmark_data_smithi188_173515_object155164:head# 2024-04-01T20:04:42.484 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eda13956:::benchmark_data_smithi188_173515_object48042:head# 2024-04-01T20:04:42.484 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eda165f6:::benchmark_data_smithi188_173515_object124871:head# 2024-04-01T20:04:42.484 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eda1ba22:::benchmark_data_smithi188_173515_object92108:head# 2024-04-01T20:04:42.484 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eda20a50:::benchmark_data_smithi188_173515_object86040:head# 2024-04-01T20:04:42.484 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eda33308:::benchmark_data_smithi188_173515_object87949:head# 2024-04-01T20:04:42.484 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eda40407:::benchmark_data_smithi188_173515_object135126:head# 2024-04-01T20:04:42.484 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eda40e4b:::benchmark_data_smithi188_173515_object141740:head# 2024-04-01T20:04:42.484 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eda43a3e:::benchmark_data_smithi188_173515_object126810:head# 2024-04-01T20:04:42.484 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eda45027:::benchmark_data_smithi188_173515_object142919:head# 2024-04-01T20:04:42.484 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eda474ef:::benchmark_data_smithi188_173515_object123460:head# 2024-04-01T20:04:42.484 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eda4843f:::benchmark_data_smithi188_173515_object113933:head# 2024-04-01T20:04:42.484 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eda549a0:::benchmark_data_smithi188_173515_object115738:head# 2024-04-01T20:04:42.484 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eda550af:::benchmark_data_smithi188_173515_object144701:head# 2024-04-01T20:04:42.485 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eda5db4d:::benchmark_data_smithi188_173515_object61501:head# 2024-04-01T20:04:42.485 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eda5df7d:::benchmark_data_smithi188_173515_object83125:head# 2024-04-01T20:04:42.485 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eda6f66a:::benchmark_data_smithi188_173515_object113817:head# 2024-04-01T20:04:42.485 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eda7b336:::benchmark_data_smithi188_173515_object64679:head# 2024-04-01T20:04:42.485 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eda80c1e:::benchmark_data_smithi188_173515_object99431:head# 2024-04-01T20:04:42.485 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eda83e15:::benchmark_data_smithi188_173515_object77958:head# 2024-04-01T20:04:42.485 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eda8d1d2:::benchmark_data_smithi188_173515_object76203:head# 2024-04-01T20:04:42.485 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edaa64bd:::benchmark_data_smithi188_173515_object81728:head# 2024-04-01T20:04:42.485 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edab93b7:::benchmark_data_smithi188_173515_object48656:head# 2024-04-01T20:04:42.485 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edac38fc:::benchmark_data_smithi188_173515_object59556:head# 2024-04-01T20:04:42.485 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edad7c21:::benchmark_data_smithi188_173515_object68342:head# 2024-04-01T20:04:42.485 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edadae63:::benchmark_data_smithi188_173515_object150000:head# 2024-04-01T20:04:42.485 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edae1413:::benchmark_data_smithi188_173515_object121248:head# 2024-04-01T20:04:42.485 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edae2011:::benchmark_data_smithi188_173515_object127640:head# 2024-04-01T20:04:42.486 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edae678a:::benchmark_data_smithi188_173515_object150087:head# 2024-04-01T20:04:42.486 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edaf8ed2:::benchmark_data_smithi188_173515_object55251:head# 2024-04-01T20:04:42.486 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb01c53:::benchmark_data_smithi188_173515_object130362:head# 2024-04-01T20:04:42.486 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb0677e:::benchmark_data_smithi188_173515_object53215:head# 2024-04-01T20:04:42.486 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb1654e:::benchmark_data_smithi188_173515_object53696:head# 2024-04-01T20:04:42.486 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb1be2e:::benchmark_data_smithi188_173515_object56647:head# 2024-04-01T20:04:42.486 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb22409:::benchmark_data_smithi188_173515_object124634:head# 2024-04-01T20:04:42.486 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb250c6:::benchmark_data_smithi188_173515_object143162:head# 2024-04-01T20:04:42.486 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb28450:::benchmark_data_smithi188_173515_object139579:head# 2024-04-01T20:04:42.486 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb2d044:::benchmark_data_smithi188_173515_object129509:head# 2024-04-01T20:04:42.486 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb2e960:::benchmark_data_smithi188_173515_object90117:head# 2024-04-01T20:04:42.486 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb3ecd2:::benchmark_data_smithi188_173515_object90765:head# 2024-04-01T20:04:42.486 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb407dc:::benchmark_data_smithi188_173515_object123202:head# 2024-04-01T20:04:42.486 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb57cbe:::benchmark_data_smithi188_173515_object54075:head# 2024-04-01T20:04:42.487 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb5de60:::benchmark_data_smithi188_173515_object88671:head# 2024-04-01T20:04:42.487 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb62461:::benchmark_data_smithi188_173515_object78857:head# 2024-04-01T20:04:42.487 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb68176:::benchmark_data_smithi188_173515_object122564:head# 2024-04-01T20:04:42.487 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb6d7ea:::benchmark_data_smithi188_173515_object105260:head# 2024-04-01T20:04:42.487 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb720e4:::benchmark_data_smithi188_173515_object141341:head# 2024-04-01T20:04:42.487 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb740c3:::benchmark_data_smithi188_173515_object67868:head# 2024-04-01T20:04:42.487 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb78fed:::benchmark_data_smithi188_173515_object60845:head# 2024-04-01T20:04:42.487 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb7e111:::benchmark_data_smithi188_173515_object62527:head# 2024-04-01T20:04:42.487 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb88128:::benchmark_data_smithi188_173515_object144241:head# 2024-04-01T20:04:42.487 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb882ee:::benchmark_data_smithi188_173515_object92944:head# 2024-04-01T20:04:42.487 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb8e11f:::benchmark_data_smithi188_173515_object151972:head# 2024-04-01T20:04:42.487 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb8e9b5:::benchmark_data_smithi188_173515_object68168:head# 2024-04-01T20:04:42.487 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb9189b:::benchmark_data_smithi188_173515_object88366:head# 2024-04-01T20:04:42.487 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb9318d:::benchmark_data_smithi188_173515_object59951:head# 2024-04-01T20:04:42.487 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb93526:::benchmark_data_smithi188_173515_object153489:head# 2024-04-01T20:04:42.488 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edb9e852:::benchmark_data_smithi188_173515_object69328:head# 2024-04-01T20:04:42.488 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edba52de:::benchmark_data_smithi188_173515_object112792:head# 2024-04-01T20:04:42.488 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edba7d5f:::benchmark_data_smithi188_173515_object129104:head# 2024-04-01T20:04:42.488 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edbb76ff:::benchmark_data_smithi188_173515_object102174:head# 2024-04-01T20:04:42.488 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edbb80a4:::benchmark_data_smithi188_173515_object52805:head# 2024-04-01T20:04:42.488 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edbe5bc1:::benchmark_data_smithi188_173515_object143526:head# 2024-04-01T20:04:42.488 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edbe9676:::benchmark_data_smithi188_173515_object73252:head# 2024-04-01T20:04:42.488 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edbed8ca:::benchmark_data_smithi188_173515_object139808:head# 2024-04-01T20:04:42.488 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edc0705f:::benchmark_data_smithi188_173515_object142091:head# 2024-04-01T20:04:42.488 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edc0fa23:::benchmark_data_smithi188_173515_object82974:head# 2024-04-01T20:04:42.488 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edc15871:::benchmark_data_smithi188_173515_object49508:head# 2024-04-01T20:04:42.488 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edc307b9:::benchmark_data_smithi188_173515_object133059:head# 2024-04-01T20:04:42.488 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edc35902:::benchmark_data_smithi188_173515_object129496:head# 2024-04-01T20:04:42.488 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edc36e4a:::benchmark_data_smithi188_173515_object91492:head# 2024-04-01T20:04:42.488 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edc441fa:::benchmark_data_smithi188_173515_object134361:head# 2024-04-01T20:04:42.488 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edc48c92:::benchmark_data_smithi188_173515_object60428:head# 2024-04-01T20:04:42.489 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edc5c208:::benchmark_data_smithi188_173515_object58250:head# 2024-04-01T20:04:42.489 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edc79775:::benchmark_data_smithi188_173515_object121936:head# 2024-04-01T20:04:42.489 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edc803b6:::benchmark_data_smithi188_173515_object95274:head# 2024-04-01T20:04:42.489 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edc83cd4:::benchmark_data_smithi188_173515_object51437:head# 2024-04-01T20:04:42.489 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edc8b602:::benchmark_data_smithi188_173515_object61673:head# 2024-04-01T20:04:42.489 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edc8bb95:::benchmark_data_smithi188_173515_object128077:head# 2024-04-01T20:04:42.489 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edc92797:::benchmark_data_smithi188_173515_object79717:head# 2024-04-01T20:04:42.489 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edc9cbcc:::benchmark_data_smithi188_173515_object100790:head# 2024-04-01T20:04:42.489 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edcbfd94:::benchmark_data_smithi188_173515_object120560:head# 2024-04-01T20:04:42.489 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edcd7bb4:::benchmark_data_smithi188_173515_object140373:head# 2024-04-01T20:04:42.489 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edd02b51:::benchmark_data_smithi188_173515_object103120:head# 2024-04-01T20:04:42.489 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edd1fb1d:::benchmark_data_smithi188_173515_object127211:head# 2024-04-01T20:04:42.489 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edd213dd:::benchmark_data_smithi188_173515_object55498:head# 2024-04-01T20:04:42.489 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edd23225:::benchmark_data_smithi188_173515_object99292:head# 2024-04-01T20:04:42.490 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edd32742:::benchmark_data_smithi188_173515_object77452:head# 2024-04-01T20:04:42.490 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edd32cd7:::benchmark_data_smithi188_173515_object112557:head# 2024-04-01T20:04:42.490 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edd4f6aa:::benchmark_data_smithi188_173515_object152089:head# 2024-04-01T20:04:42.490 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edd51431:::benchmark_data_smithi188_173515_object68907:head# 2024-04-01T20:04:42.490 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edd65ca0:::benchmark_data_smithi188_173515_object132096:head# 2024-04-01T20:04:42.490 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edd66972:::benchmark_data_smithi188_173515_object48919:head# 2024-04-01T20:04:42.490 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edd79778:::benchmark_data_smithi188_173515_object144814:head# 2024-04-01T20:04:42.490 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edd7ce34:::benchmark_data_smithi188_173515_object111919:head# 2024-04-01T20:04:42.490 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edd7fbf7:::benchmark_data_smithi188_173515_object65724:head# 2024-04-01T20:04:42.490 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edd82460:::benchmark_data_smithi188_173515_object78059:head# 2024-04-01T20:04:42.490 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edd87d18:::benchmark_data_smithi188_173515_object60435:head# 2024-04-01T20:04:42.490 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edd89d1d:::benchmark_data_smithi188_173515_object152919:head# 2024-04-01T20:04:42.490 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edd9265f:::benchmark_data_smithi188_173515_object150825:head# 2024-04-01T20:04:42.491 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edd9f6f6:::benchmark_data_smithi188_173515_object131533:head# 2024-04-01T20:04:42.491 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edda19e3:::benchmark_data_smithi188_173515_object104851:head# 2024-04-01T20:04:42.491 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edda58c2:::benchmark_data_smithi188_173515_object147616:head# 2024-04-01T20:04:42.491 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eddd5980:::benchmark_data_smithi188_173515_object59580:head# 2024-04-01T20:04:42.491 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eddd7840:::benchmark_data_smithi188_173515_object115476:head# 2024-04-01T20:04:42.491 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edddd314:::benchmark_data_smithi188_173515_object106052:head# 2024-04-01T20:04:42.491 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edde4608:::benchmark_data_smithi188_173515_object56804:head# 2024-04-01T20:04:42.491 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edde6878:::benchmark_data_smithi188_173515_object146657:head# 2024-04-01T20:04:42.491 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edde79f8:::benchmark_data_smithi188_173515_object52578:head# 2024-04-01T20:04:42.491 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edde8b8b:::benchmark_data_smithi188_173515_object128602:head# 2024-04-01T20:04:42.491 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eddf45df:::benchmark_data_smithi188_173515_object56836:head# 2024-04-01T20:04:42.491 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eddf4d40:::benchmark_data_smithi188_173515_object78417:head# 2024-04-01T20:04:42.491 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ede07949:::benchmark_data_smithi188_173515_object132493:head# 2024-04-01T20:04:42.493 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ede09255:::benchmark_data_smithi188_173515_object95659:head# 2024-04-01T20:04:42.493 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ede0a05c:::benchmark_data_smithi188_173515_object148563:head# 2024-04-01T20:04:42.493 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ede0e4aa:::benchmark_data_smithi188_173515_object96025:head# 2024-04-01T20:04:42.493 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ede1a1a8:::benchmark_data_smithi188_173515_object77134:head# 2024-04-01T20:04:42.493 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ede1db61:::benchmark_data_smithi188_173515_object72174:head# 2024-04-01T20:04:42.493 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ede2914b:::benchmark_data_smithi188_173515_object91406:head# 2024-04-01T20:04:42.493 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ede2d467:::benchmark_data_smithi188_173515_object73064:head# 2024-04-01T20:04:42.493 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ede359fb:::benchmark_data_smithi188_173515_object60947:head# 2024-04-01T20:04:42.493 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ede4ab76:::benchmark_data_smithi188_173515_object97119:head# 2024-04-01T20:04:42.493 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ede4f037:::benchmark_data_smithi188_173515_object139734:head# 2024-04-01T20:04:42.493 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ede5bd3b:::benchmark_data_smithi188_173515_object109640:head# 2024-04-01T20:04:42.494 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ede86cad:::benchmark_data_smithi188_173515_object45905:head# 2024-04-01T20:04:42.494 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ede8c045:::benchmark_data_smithi188_173515_object154318:head# 2024-04-01T20:04:42.494 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ede991a1:::benchmark_data_smithi188_173515_object76550:head# 2024-04-01T20:04:42.494 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edea1ec2:::benchmark_data_smithi188_173515_object114449:head# 2024-04-01T20:04:42.494 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edea3f59:::benchmark_data_smithi188_173515_object50483:head# 2024-04-01T20:04:42.494 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edec0313:::benchmark_data_smithi188_173515_object118319:head# 2024-04-01T20:04:42.494 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edec7f39:::benchmark_data_smithi188_173515_object91606:head# 2024-04-01T20:04:42.494 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edecc000:::benchmark_data_smithi188_173515_object115817:head# 2024-04-01T20:04:42.494 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ededc4b7:::benchmark_data_smithi188_173515_object127314:head# 2024-04-01T20:04:42.494 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ededda22:::benchmark_data_smithi188_173515_object70421:head# 2024-04-01T20:04:42.494 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edede512:::benchmark_data_smithi188_173515_object114830:head# 2024-04-01T20:04:42.494 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edef3fe0:::benchmark_data_smithi188_173515_object151893:head# 2024-04-01T20:04:42.495 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edef50c8:::benchmark_data_smithi188_173515_object130627:head# 2024-04-01T20:04:42.495 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edefc5a1:::benchmark_data_smithi188_173515_object84141:head# 2024-04-01T20:04:42.495 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edf073f9:::benchmark_data_smithi188_173515_object83996:head# 2024-04-01T20:04:42.495 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edf0e0f1:::benchmark_data_smithi188_173515_object121414:head# 2024-04-01T20:04:42.495 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edf17585:::benchmark_data_smithi188_173515_object101885:head# 2024-04-01T20:04:42.495 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edf17c5d:::benchmark_data_smithi188_173515_object101419:head# 2024-04-01T20:04:42.495 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edf41dce:::benchmark_data_smithi188_173515_object97783:head# 2024-04-01T20:04:42.495 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edf43c86:::benchmark_data_smithi188_173515_object100636:head# 2024-04-01T20:04:42.495 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edf49509:::benchmark_data_smithi188_173515_object88217:head# 2024-04-01T20:04:42.495 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edf4d068:::benchmark_data_smithi188_173515_object107324:head# 2024-04-01T20:04:42.496 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edf68ac3:::benchmark_data_smithi188_173515_object95115:head# 2024-04-01T20:04:42.496 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edf6a426:::benchmark_data_smithi188_173515_object155451:head# 2024-04-01T20:04:42.496 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edf6d0b2:::benchmark_data_smithi188_173515_object64749:head# 2024-04-01T20:04:42.496 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edf6de38:::benchmark_data_smithi188_173515_object77834:head# 2024-04-01T20:04:42.496 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edf74bca:::benchmark_data_smithi188_173515_object119843:head# 2024-04-01T20:04:42.496 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edf759b7:::benchmark_data_smithi188_173515_object107512:head# 2024-04-01T20:04:42.496 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edfaae1a:::benchmark_data_smithi188_173515_object111273:head# 2024-04-01T20:04:42.496 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edfacea8:::benchmark_data_smithi188_173515_object58258:head# 2024-04-01T20:04:42.496 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edfaf0ac:::benchmark_data_smithi188_173515_object119557:head# 2024-04-01T20:04:42.496 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edfba265:::benchmark_data_smithi188_173515_object91971:head# 2024-04-01T20:04:42.496 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edfc4af6:::benchmark_data_smithi188_173515_object131139:head# 2024-04-01T20:04:42.496 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edfd4257:::benchmark_data_smithi188_173515_object83359:head# 2024-04-01T20:04:42.496 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edfd80fe:::benchmark_data_smithi188_173515_object118806:head# 2024-04-01T20:04:42.497 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edfdce9c:::benchmark_data_smithi188_173515_object126425:head# 2024-04-01T20:04:42.497 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edfe722e:::benchmark_data_smithi188_173515_object49609:head# 2024-04-01T20:04:42.497 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edfeab0b:::benchmark_data_smithi188_173515_object46757:head# 2024-04-01T20:04:42.497 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edfeb6ee:::benchmark_data_smithi188_173515_object89193:head# 2024-04-01T20:04:42.497 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:edfebbd3:::benchmark_data_smithi188_173515_object73882:head# 2024-04-01T20:04:42.497 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee0008e6:::benchmark_data_smithi188_173515_object145304:head# 2024-04-01T20:04:42.497 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee001963:::benchmark_data_smithi188_173515_object66937:head# 2024-04-01T20:04:42.497 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee00d358:::benchmark_data_smithi188_173515_object91605:head# 2024-04-01T20:04:42.497 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee010afa:::benchmark_data_smithi188_173515_object85280:head# 2024-04-01T20:04:42.497 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee021414:::benchmark_data_smithi188_173515_object62030:head# 2024-04-01T20:04:42.497 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee029eaa:::benchmark_data_smithi188_173515_object96695:head# 2024-04-01T20:04:42.497 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee02a53b:::benchmark_data_smithi188_173515_object134723:head# 2024-04-01T20:04:42.497 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee04aae4:::benchmark_data_smithi188_173515_object151098:head# 2024-04-01T20:04:42.498 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee04c37d:::benchmark_data_smithi188_173515_object104241:head# 2024-04-01T20:04:42.498 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee04e0ec:::benchmark_data_smithi188_173515_object136812:head# 2024-04-01T20:04:42.498 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee0518b0:::benchmark_data_smithi188_173515_object95178:head# 2024-04-01T20:04:42.498 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee052db7:::benchmark_data_smithi188_173515_object136193:head# 2024-04-01T20:04:42.498 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee053fd7:::benchmark_data_smithi188_173515_object121430:head# 2024-04-01T20:04:42.498 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee0605a7:::benchmark_data_smithi188_173515_object71905:head# 2024-04-01T20:04:42.498 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee073890:::benchmark_data_smithi188_173515_object106153:head# 2024-04-01T20:04:42.498 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee08a16d:::benchmark_data_smithi188_173515_object80238:head# 2024-04-01T20:04:42.498 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee09c204:::benchmark_data_smithi188_173515_object110238:head# 2024-04-01T20:04:42.498 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee0a0f26:::benchmark_data_smithi188_173515_object59281:head# 2024-04-01T20:04:42.498 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee0a1b64:::benchmark_data_smithi188_173515_object78644:head# 2024-04-01T20:04:42.498 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee0ac72b:::benchmark_data_smithi188_173515_object121069:head# 2024-04-01T20:04:42.499 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee0b7267:::benchmark_data_smithi188_173515_object54831:head# 2024-04-01T20:04:42.499 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee0b8337:::benchmark_data_smithi188_173515_object118903:head# 2024-04-01T20:04:42.499 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee0c6138:::benchmark_data_smithi188_173515_object144249:head# 2024-04-01T20:04:42.499 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee0e182b:::benchmark_data_smithi188_173515_object129727:head# 2024-04-01T20:04:42.499 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee0e38b3:::benchmark_data_smithi188_173515_object73744:head# 2024-04-01T20:04:42.499 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee0e4124:::benchmark_data_smithi188_173515_object114759:head# 2024-04-01T20:04:42.499 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee0eac8e:::benchmark_data_smithi188_173515_object94111:head# 2024-04-01T20:04:42.499 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee0fc672:::benchmark_data_smithi188_173515_object97278:head# 2024-04-01T20:04:42.499 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee10631a:::benchmark_data_smithi188_173515_object149205:head# 2024-04-01T20:04:42.499 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee11f4cd:::benchmark_data_smithi188_173515_object107730:head# 2024-04-01T20:04:42.499 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee1220c7:::benchmark_data_smithi188_173515_object77862:head# 2024-04-01T20:04:42.499 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee12e7ca:::benchmark_data_smithi188_173515_object47395:head# 2024-04-01T20:04:42.500 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee1303f4:::benchmark_data_smithi188_173515_object113089:head# 2024-04-01T20:04:42.500 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee131c61:::benchmark_data_smithi188_173515_object77876:head# 2024-04-01T20:04:42.500 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee135b30:::benchmark_data_smithi188_173515_object91362:head# 2024-04-01T20:04:42.500 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee13646d:::benchmark_data_smithi188_173515_object116944:head# 2024-04-01T20:04:42.500 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee13f571:::benchmark_data_smithi188_173515_object119563:head# 2024-04-01T20:04:42.500 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee14943d:::benchmark_data_smithi188_173515_object72615:head# 2024-04-01T20:04:42.500 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee149c22:::benchmark_data_smithi188_173515_object105948:head# 2024-04-01T20:04:42.500 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee1617d8:::benchmark_data_smithi188_173515_object85038:head# 2024-04-01T20:04:42.500 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee170cfe:::benchmark_data_smithi188_173515_object83473:head# 2024-04-01T20:04:42.500 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee17c2b4:::benchmark_data_smithi188_173515_object101895:head# 2024-04-01T20:04:42.500 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee190467:::benchmark_data_smithi188_173515_object151611:head# 2024-04-01T20:04:42.500 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee1a11bc:::benchmark_data_smithi188_173515_object86955:head# 2024-04-01T20:04:42.500 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee1a9096:::benchmark_data_smithi188_173515_object48637:head# 2024-04-01T20:04:42.500 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee1aabcf:::benchmark_data_smithi188_173515_object82167:head# 2024-04-01T20:04:42.501 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee1b7e70:::benchmark_data_smithi188_173515_object99668:head# 2024-04-01T20:04:42.501 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee1c4c3c:::benchmark_data_smithi188_173515_object67890:head# 2024-04-01T20:04:42.501 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee1daad6:::benchmark_data_smithi188_173515_object99312:head# 2024-04-01T20:04:42.501 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee1e0b62:::benchmark_data_smithi188_173515_object127986:head# 2024-04-01T20:04:42.501 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee1e73a6:::benchmark_data_smithi188_173515_object73183:head# 2024-04-01T20:04:42.501 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee1f20c1:::benchmark_data_smithi188_173515_object141403:head# 2024-04-01T20:04:42.501 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee1ff46e:::benchmark_data_smithi188_173515_object62567:head# 2024-04-01T20:04:42.501 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee20a1de:::benchmark_data_smithi188_173515_object109835:head# 2024-04-01T20:04:42.501 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee233637:::benchmark_data_smithi188_173515_object94969:head# 2024-04-01T20:04:42.501 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee2336d2:::benchmark_data_smithi188_173515_object129906:head# 2024-04-01T20:04:42.501 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee2389df:::benchmark_data_smithi188_173515_object114913:head# 2024-04-01T20:04:42.501 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee2450cb:::benchmark_data_smithi188_173515_object150480:head# 2024-04-01T20:04:42.501 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee24c594:::benchmark_data_smithi188_173515_object112264:head# 2024-04-01T20:04:42.502 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee24c94e:::benchmark_data_smithi188_173515_object77030:head# 2024-04-01T20:04:42.502 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee253f82:::benchmark_data_smithi188_173515_object123623:head# 2024-04-01T20:04:42.502 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee25a80e:::benchmark_data_smithi188_173515_object151392:head# 2024-04-01T20:04:42.502 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee27313e:::benchmark_data_smithi188_173515_object96883:head# 2024-04-01T20:04:42.502 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee28697b:::benchmark_data_smithi188_173515_object98256:head# 2024-04-01T20:04:42.502 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee286d74:::benchmark_data_smithi188_173515_object55236:head# 2024-04-01T20:04:42.502 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee28aef1:::benchmark_data_smithi188_173515_object49680:head# 2024-04-01T20:04:42.502 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee2bdd44:::benchmark_data_smithi188_173515_object111460:head# 2024-04-01T20:04:42.502 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee2c54e9:::benchmark_data_smithi188_173515_object71294:head# 2024-04-01T20:04:42.502 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee2c9be0:::benchmark_data_smithi188_173515_object53717:head# 2024-04-01T20:04:42.503 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee2cfa79:::benchmark_data_smithi188_173515_object81588:head# 2024-04-01T20:04:42.503 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee2e34bc:::benchmark_data_smithi188_173515_object88954:head# 2024-04-01T20:04:42.503 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee2e7b9d:::benchmark_data_smithi188_173515_object123721:head# 2024-04-01T20:04:42.503 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee2f7a73:::benchmark_data_smithi188_173515_object113285:head# 2024-04-01T20:04:42.503 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee2f83f3:::benchmark_data_smithi188_173515_object114623:head# 2024-04-01T20:04:42.503 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee3029bc:::benchmark_data_smithi188_173515_object119978:head# 2024-04-01T20:04:42.503 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee305571:::benchmark_data_smithi188_173515_object130381:head# 2024-04-01T20:04:42.503 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee308544:::benchmark_data_smithi188_173515_object62803:head# 2024-04-01T20:04:42.503 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee30f164:::benchmark_data_smithi188_173515_object55741:head# 2024-04-01T20:04:42.503 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee328789:::benchmark_data_smithi188_173515_object128571:head# 2024-04-01T20:04:42.503 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee33481d:::benchmark_data_smithi188_173515_object140277:head# 2024-04-01T20:04:42.503 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee340d41:::benchmark_data_smithi188_173515_object76916:head# 2024-04-01T20:04:42.503 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee35677e:::benchmark_data_smithi188_173515_object88752:head# 2024-04-01T20:04:42.504 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee35b4e4:::benchmark_data_smithi188_173515_object117986:head# 2024-04-01T20:04:42.504 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee388cb4:::benchmark_data_smithi188_173515_object50322:head# 2024-04-01T20:04:42.504 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee3ab119:::benchmark_data_smithi188_173515_object91944:head# 2024-04-01T20:04:42.504 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee3adda4:::benchmark_data_smithi188_173515_object131619:head# 2024-04-01T20:04:42.504 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee3c23a2:::benchmark_data_smithi188_173515_object89291:head# 2024-04-01T20:04:42.504 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee3c6c01:::benchmark_data_smithi188_173515_object78637:head# 2024-04-01T20:04:42.504 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee3cc918:::benchmark_data_smithi188_173515_object142917:head# 2024-04-01T20:04:42.504 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee3d0e28:::benchmark_data_smithi188_173515_object106500:head# 2024-04-01T20:04:42.504 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee3dd533:::benchmark_data_smithi188_173515_object86671:head# 2024-04-01T20:04:42.504 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee3f8f7e:::benchmark_data_smithi188_173515_object123435:head# 2024-04-01T20:04:42.504 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee40268e:::benchmark_data_smithi188_173515_object146272:head# 2024-04-01T20:04:42.504 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee409c84:::benchmark_data_smithi188_173515_object121848:head# 2024-04-01T20:04:42.504 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee40cbcd:::benchmark_data_smithi188_173515_object53166:head# 2024-04-01T20:04:42.505 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee43181b:::benchmark_data_smithi188_173515_object140462:head# 2024-04-01T20:04:42.505 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee43fbc0:::benchmark_data_smithi188_173515_object89983:head# 2024-04-01T20:04:42.505 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee4497a5:::benchmark_data_smithi188_173515_object77560:head# 2024-04-01T20:04:42.505 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee44bae7:::benchmark_data_smithi188_173515_object60254:head# 2024-04-01T20:04:42.505 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee44f807:::benchmark_data_smithi188_173515_object146783:head# 2024-04-01T20:04:42.505 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee456327:::benchmark_data_smithi188_173515_object73228:head# 2024-04-01T20:04:42.505 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee457677:::benchmark_data_smithi188_173515_object119525:head# 2024-04-01T20:04:42.505 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee4593b8:::benchmark_data_smithi188_173515_object66908:head# 2024-04-01T20:04:42.505 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee45c5b5:::benchmark_data_smithi188_173515_object96407:head# 2024-04-01T20:04:42.505 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee46851c:::benchmark_data_smithi188_173515_object90126:head# 2024-04-01T20:04:42.505 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee469527:::benchmark_data_smithi188_173515_object47055:head# 2024-04-01T20:04:42.506 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee469f4c:::benchmark_data_smithi188_173515_object121880:head# 2024-04-01T20:04:42.506 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee496288:::benchmark_data_smithi188_173515_object110737:head# 2024-04-01T20:04:42.506 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee4a9121:::benchmark_data_smithi188_173515_object71285:head# 2024-04-01T20:04:42.506 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee4b0329:::benchmark_data_smithi188_173515_object59195:head# 2024-04-01T20:04:42.506 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee4b15b1:::benchmark_data_smithi188_173515_object154358:head# 2024-04-01T20:04:42.506 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee4b26d1:::benchmark_data_smithi188_173515_object93842:head# 2024-04-01T20:04:42.506 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee4b4242:::benchmark_data_smithi188_173515_object65025:head# 2024-04-01T20:04:42.506 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee4b7376:::benchmark_data_smithi188_173515_object78606:head# 2024-04-01T20:04:42.506 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee4ce2aa:::benchmark_data_smithi188_173515_object83509:head# 2024-04-01T20:04:42.506 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee4d4492:::benchmark_data_smithi188_173515_object146608:head# 2024-04-01T20:04:42.506 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee4d62d2:::benchmark_data_smithi188_173515_object85770:head# 2024-04-01T20:04:42.506 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee4e8d56:::benchmark_data_smithi188_173515_object85374:head# 2024-04-01T20:04:42.507 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee4ed3ff:::benchmark_data_smithi188_173515_object71789:head# 2024-04-01T20:04:42.507 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee4f9981:::benchmark_data_smithi188_173515_object145662:head# 2024-04-01T20:04:42.507 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee4fc114:::benchmark_data_smithi188_173515_object89555:head# 2024-04-01T20:04:42.507 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee50eb8b:::benchmark_data_smithi188_173515_object96322:head# 2024-04-01T20:04:42.507 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee50fc79:::benchmark_data_smithi188_173515_object84590:head# 2024-04-01T20:04:42.507 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee526706:::benchmark_data_smithi188_173515_object141354:head# 2024-04-01T20:04:42.507 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee526757:::benchmark_data_smithi188_173515_object117043:head# 2024-04-01T20:04:42.507 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee529232:::benchmark_data_smithi188_173515_object63954:head# 2024-04-01T20:04:42.507 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee52d5cd:::benchmark_data_smithi188_173515_object132565:head# 2024-04-01T20:04:42.507 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee52e933:::benchmark_data_smithi188_173515_object52166:head# 2024-04-01T20:04:42.507 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee536796:::benchmark_data_smithi188_173515_object118093:head# 2024-04-01T20:04:42.507 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee53c90d:::benchmark_data_smithi188_173515_object70688:head# 2024-04-01T20:04:42.508 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee53f9d0:::benchmark_data_smithi188_173515_object134098:head# 2024-04-01T20:04:42.508 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee564020:::benchmark_data_smithi188_173515_object141907:head# 2024-04-01T20:04:42.508 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee578f2f:::benchmark_data_smithi188_173515_object63338:head# 2024-04-01T20:04:42.508 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee580e20:::benchmark_data_smithi188_173515_object94609:head# 2024-04-01T20:04:42.508 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee592974:::benchmark_data_smithi188_173515_object82399:head# 2024-04-01T20:04:42.508 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee59f3ee:::benchmark_data_smithi188_173515_object82249:head# 2024-04-01T20:04:42.508 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee59ff72:::benchmark_data_smithi188_173515_object53798:head# 2024-04-01T20:04:42.508 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee5a719a:::benchmark_data_smithi188_173515_object68757:head# 2024-04-01T20:04:42.508 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee5a9ba9:::benchmark_data_smithi188_173515_object84930:head# 2024-04-01T20:04:42.508 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee5afbce:::benchmark_data_smithi188_173515_object81884:head# 2024-04-01T20:04:42.508 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee5c876b:::benchmark_data_smithi188_173515_object103645:head# 2024-04-01T20:04:42.509 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee5cb963:::benchmark_data_smithi188_173515_object86705:head# 2024-04-01T20:04:42.509 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee5d2008:::benchmark_data_smithi188_173515_object124391:head# 2024-04-01T20:04:42.509 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee5da10e:::benchmark_data_smithi188_173515_object91617:head# 2024-04-01T20:04:42.509 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee5de3de:::benchmark_data_smithi188_173515_object96175:head# 2024-04-01T20:04:42.509 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee5e984e:::benchmark_data_smithi188_173515_object54654:head# 2024-04-01T20:04:42.509 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee5e9ee1:::benchmark_data_smithi188_173515_object139040:head# 2024-04-01T20:04:42.509 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee5ea61a:::benchmark_data_smithi188_173515_object74942:head# 2024-04-01T20:04:42.509 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee5eae1f:::benchmark_data_smithi188_173515_object141321:head# 2024-04-01T20:04:42.509 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee5f29ed:::benchmark_data_smithi188_173515_object109530:head# 2024-04-01T20:04:42.509 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee5f625d:::benchmark_data_smithi188_173515_object154413:head# 2024-04-01T20:04:42.509 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee6209ee:::benchmark_data_smithi188_173515_object152560:head# 2024-04-01T20:04:42.510 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee624ed5:::benchmark_data_smithi188_173515_object52089:head# 2024-04-01T20:04:42.510 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee627549:::benchmark_data_smithi188_173515_object67374:head# 2024-04-01T20:04:42.510 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee63c56e:::benchmark_data_smithi188_173515_object115312:head# 2024-04-01T20:04:42.510 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee651fdf:::benchmark_data_smithi188_173515_object62240:head# 2024-04-01T20:04:42.510 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee65bff7:::benchmark_data_smithi188_173515_object147817:head# 2024-04-01T20:04:42.510 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee6662a1:::benchmark_data_smithi188_173515_object146158:head# 2024-04-01T20:04:42.510 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee666ba5:::benchmark_data_smithi188_173515_object73411:head# 2024-04-01T20:04:42.510 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee679e23:::benchmark_data_smithi188_173515_object104876:head# 2024-04-01T20:04:42.510 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee6835a1:::benchmark_data_smithi188_173515_object65315:head# 2024-04-01T20:04:42.510 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee683f30:::benchmark_data_smithi188_173515_object51233:head# 2024-04-01T20:04:42.510 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee6850c0:::benchmark_data_smithi188_173515_object100024:head# 2024-04-01T20:04:42.510 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee692ce2:::benchmark_data_smithi188_173515_object148982:head# 2024-04-01T20:04:42.511 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee694d52:::benchmark_data_smithi188_173515_object55353:head# 2024-04-01T20:04:42.511 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee6961bc:::benchmark_data_smithi188_173515_object96774:head# 2024-04-01T20:04:42.511 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee69ec02:::benchmark_data_smithi188_173515_object124930:head# 2024-04-01T20:04:42.511 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee6ac4aa:::benchmark_data_smithi188_173515_object100520:head# 2024-04-01T20:04:42.511 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee6ad0f6:::benchmark_data_smithi188_173515_object151212:head# 2024-04-01T20:04:42.511 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee6add6c:::benchmark_data_smithi188_173515_object85548:head# 2024-04-01T20:04:42.511 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee6c9f66:::benchmark_data_smithi188_173515_object62356:head# 2024-04-01T20:04:42.511 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee6ce824:::benchmark_data_smithi188_173515_object51895:head# 2024-04-01T20:04:42.511 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee6d36c5:::benchmark_data_smithi188_173515_object78531:head# 2024-04-01T20:04:42.511 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee6da4f1:::benchmark_data_smithi188_173515_object52611:head# 2024-04-01T20:04:42.511 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee6dedb7:::benchmark_data_smithi188_173515_object121687:head# 2024-04-01T20:04:42.511 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee6e19d6:::benchmark_data_smithi188_173515_object150623:head# 2024-04-01T20:04:42.512 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee6e499b:::benchmark_data_smithi188_173515_object129537:head# 2024-04-01T20:04:42.512 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee6e5dc1:::benchmark_data_smithi188_173515_object129577:head# 2024-04-01T20:04:42.512 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee6e917e:::benchmark_data_smithi188_173515_object112800:head# 2024-04-01T20:04:42.512 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee6eac2a:::benchmark_data_smithi188_173515_object87076:head# 2024-04-01T20:04:42.512 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee6ead17:::benchmark_data_smithi188_173515_object112489:head# 2024-04-01T20:04:42.512 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee6fd264:::benchmark_data_smithi188_173515_object98067:head# 2024-04-01T20:04:42.512 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee704454:::benchmark_data_smithi188_173515_object143001:head# 2024-04-01T20:04:42.512 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee70f659:::benchmark_data_smithi188_173515_object67342:head# 2024-04-01T20:04:42.512 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee71401a:::benchmark_data_smithi188_173515_object82035:head# 2024-04-01T20:04:42.512 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee732a03:::benchmark_data_smithi188_173515_object149077:head# 2024-04-01T20:04:42.512 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee7349a9:::benchmark_data_smithi188_173515_object138127:head# 2024-04-01T20:04:42.512 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee7354bc:::benchmark_data_smithi188_173515_object133807:head# 2024-04-01T20:04:42.513 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee73b80d:::benchmark_data_smithi188_173515_object133052:head# 2024-04-01T20:04:42.513 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee73d164:::benchmark_data_smithi188_173515_object48008:head# 2024-04-01T20:04:42.513 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee73e3fd:::benchmark_data_smithi188_173515_object147255:head# 2024-04-01T20:04:42.513 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee748293:::benchmark_data_smithi188_173515_object72677:head# 2024-04-01T20:04:42.513 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee750e84:::benchmark_data_smithi188_173515_object103339:head# 2024-04-01T20:04:42.513 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee753223:::benchmark_data_smithi188_173515_object62426:head# 2024-04-01T20:04:42.513 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee75a241:::benchmark_data_smithi188_173515_object147000:head# 2024-04-01T20:04:42.513 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee773d91:::benchmark_data_smithi188_173515_object101374:head# 2024-04-01T20:04:42.513 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee778c75:::benchmark_data_smithi188_173515_object151607:head# 2024-04-01T20:04:42.513 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee78f24b:::benchmark_data_smithi188_173515_object73925:head# 2024-04-01T20:04:42.513 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee799137:::benchmark_data_smithi188_173515_object102712:head# 2024-04-01T20:04:42.513 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee79d0b6:::benchmark_data_smithi188_173515_object108246:head# 2024-04-01T20:04:42.513 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee7a69ba:::benchmark_data_smithi188_173515_object96510:head# 2024-04-01T20:04:42.514 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee7b4179:::benchmark_data_smithi188_173515_object76763:head# 2024-04-01T20:04:42.514 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee7b53a4:::benchmark_data_smithi188_173515_object56627:head# 2024-04-01T20:04:42.514 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee7b68c1:::benchmark_data_smithi188_173515_object79373:head# 2024-04-01T20:04:42.514 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee7bd2b3:::benchmark_data_smithi188_173515_object109098:head# 2024-04-01T20:04:42.514 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee7be70c:::benchmark_data_smithi188_173515_object84219:head# 2024-04-01T20:04:42.514 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee7c1c20:::benchmark_data_smithi188_173515_object65868:head# 2024-04-01T20:04:42.514 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee7e1055:::benchmark_data_smithi188_173515_object105764:head# 2024-04-01T20:04:42.514 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee7e4d13:::benchmark_data_smithi188_173515_object136138:head# 2024-04-01T20:04:42.514 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee7ee68f:::benchmark_data_smithi188_173515_object121922:head# 2024-04-01T20:04:42.514 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee7ef6bd:::benchmark_data_smithi188_173515_object108456:head# 2024-04-01T20:04:42.514 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee7ef6d9:::benchmark_data_smithi188_173515_object98073:head# 2024-04-01T20:04:42.514 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee7f8666:::benchmark_data_smithi188_173515_object56850:head# 2024-04-01T20:04:42.515 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee809ff5:::benchmark_data_smithi188_173515_object88604:head# 2024-04-01T20:04:42.515 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee825cce:::benchmark_data_smithi188_173515_object148248:head# 2024-04-01T20:04:42.515 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee825f4e:::benchmark_data_smithi188_173515_object53917:head# 2024-04-01T20:04:42.515 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee8395eb:::benchmark_data_smithi188_173515_object125247:head# 2024-04-01T20:04:42.515 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee83ef93:::benchmark_data_smithi188_173515_object85417:head# 2024-04-01T20:04:42.515 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee8470b2:::benchmark_data_smithi188_173515_object127304:head# 2024-04-01T20:04:42.515 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee850f01:::benchmark_data_smithi188_173515_object84088:head# 2024-04-01T20:04:42.515 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee85b5aa:::benchmark_data_smithi188_173515_object77270:head# 2024-04-01T20:04:42.515 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee85c991:::benchmark_data_smithi188_173515_object102277:head# 2024-04-01T20:04:42.515 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee86c838:::benchmark_data_smithi188_173515_object84932:head# 2024-04-01T20:04:42.515 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee86fe82:::benchmark_data_smithi188_173515_object136517:head# 2024-04-01T20:04:42.515 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee878f5a:::benchmark_data_smithi188_173515_object58191:head# 2024-04-01T20:04:42.516 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee8810fe:::benchmark_data_smithi188_173515_object80933:head# 2024-04-01T20:04:42.516 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee8844ca:::benchmark_data_smithi188_173515_object134125:head# 2024-04-01T20:04:42.516 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee888ec6:::benchmark_data_smithi188_173515_object71324:head# 2024-04-01T20:04:42.516 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee8aacc5:::benchmark_data_smithi188_173515_object82789:head# 2024-04-01T20:04:42.516 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee8b550a:::benchmark_data_smithi188_173515_object140494:head# 2024-04-01T20:04:42.516 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee8bdb25:::benchmark_data_smithi188_173515_object112870:head# 2024-04-01T20:04:42.516 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee8c3902:::benchmark_data_smithi188_173515_object48701:head# 2024-04-01T20:04:42.516 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee8cab9a:::benchmark_data_smithi188_173515_object149689:head# 2024-04-01T20:04:42.516 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee8ddc7c:::benchmark_data_smithi188_173515_object46067:head# 2024-04-01T20:04:42.516 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee8e0bd8:::benchmark_data_smithi188_173515_object116227:head# 2024-04-01T20:04:42.516 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee8e58ec:::benchmark_data_smithi188_173515_object144427:head# 2024-04-01T20:04:42.516 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee8e6cdc:::benchmark_data_smithi188_173515_object105689:head# 2024-04-01T20:04:42.517 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee8e99bb:::benchmark_data_smithi188_173515_object139659:head# 2024-04-01T20:04:42.517 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee8f785a:::benchmark_data_smithi188_173515_object152076:head# 2024-04-01T20:04:42.517 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee8f8515:::benchmark_data_smithi188_173515_object117927:head# 2024-04-01T20:04:42.517 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee8fbbf0:::benchmark_data_smithi188_173515_object152661:head# 2024-04-01T20:04:42.517 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee910446:::benchmark_data_smithi188_173515_object114562:head# 2024-04-01T20:04:42.517 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee914875:::benchmark_data_smithi188_173515_object84701:head# 2024-04-01T20:04:42.517 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee919c0c:::benchmark_data_smithi188_173515_object56441:head# 2024-04-01T20:04:42.517 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee93ccae:::benchmark_data_smithi188_173515_object153893:head# 2024-04-01T20:04:42.517 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee94a55b:::benchmark_data_smithi188_173515_object151231:head# 2024-04-01T20:04:42.517 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee952bf2:::benchmark_data_smithi188_173515_object78210:head# 2024-04-01T20:04:42.517 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee9590d4:::benchmark_data_smithi188_173515_object80302:head# 2024-04-01T20:04:42.517 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee9593d2:::benchmark_data_smithi188_173515_object109653:head# 2024-04-01T20:04:42.517 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee95fa1f:::benchmark_data_smithi188_173515_object75556:head# 2024-04-01T20:04:42.518 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee9761ce:::benchmark_data_smithi188_173515_object48882:head# 2024-04-01T20:04:42.518 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee97c816:::benchmark_data_smithi188_173515_object56597:head# 2024-04-01T20:04:42.518 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee97d6bc:::benchmark_data_smithi188_173515_object141569:head# 2024-04-01T20:04:42.518 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee97eba8:::benchmark_data_smithi188_173515_object120806:head# 2024-04-01T20:04:42.518 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee98e920:::benchmark_data_smithi188_173515_object68607:head# 2024-04-01T20:04:42.518 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee9a7803:::benchmark_data_smithi188_173515_object63483:head# 2024-04-01T20:04:42.518 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee9ad9bb:::benchmark_data_smithi188_173515_object84609:head# 2024-04-01T20:04:42.518 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee9b992f:::benchmark_data_smithi188_173515_object57282:head# 2024-04-01T20:04:42.518 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee9bf47c:::benchmark_data_smithi188_173515_object114559:head# 2024-04-01T20:04:42.518 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee9cb280:::benchmark_data_smithi188_173515_object48445:head# 2024-04-01T20:04:42.518 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee9dcb9b:::benchmark_data_smithi188_173515_object111107:head# 2024-04-01T20:04:42.519 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee9dec46:::benchmark_data_smithi188_173515_object69481:head# 2024-04-01T20:04:42.519 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee9e05a1:::benchmark_data_smithi188_173515_object137252:head# 2024-04-01T20:04:42.519 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee9e59ee:::benchmark_data_smithi188_173515_object60878:head# 2024-04-01T20:04:42.519 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee9f5057:::benchmark_data_smithi188_173515_object84324:head# 2024-04-01T20:04:42.519 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee9f7cb8:::benchmark_data_smithi188_173515_object69694:head# 2024-04-01T20:04:42.519 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ee9fdfc7:::benchmark_data_smithi188_173515_object71954:head# 2024-04-01T20:04:42.519 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eea0313f:::benchmark_data_smithi188_173515_object57545:head# 2024-04-01T20:04:42.519 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eea0357f:::benchmark_data_smithi188_173515_object140541:head# 2024-04-01T20:04:42.519 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eea03e67:::benchmark_data_smithi188_173515_object62778:head# 2024-04-01T20:04:42.519 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eea14d63:::benchmark_data_smithi188_173515_object148431:head# 2024-04-01T20:04:42.519 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eea1f9c8:::benchmark_data_smithi188_173515_object81125:head# 2024-04-01T20:04:42.519 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eea21268:::benchmark_data_smithi188_173515_object121986:head# 2024-04-01T20:04:42.519 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eea29883:::benchmark_data_smithi188_173515_object108815:head# 2024-04-01T20:04:42.520 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eea2c868:::benchmark_data_smithi188_173515_object121230:head# 2024-04-01T20:04:42.520 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eea31a38:::benchmark_data_smithi188_173515_object49894:head# 2024-04-01T20:04:42.520 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eea37af5:::benchmark_data_smithi188_173515_object94878:head# 2024-04-01T20:04:42.520 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eea3d1ed:::benchmark_data_smithi188_173515_object150391:head# 2024-04-01T20:04:42.520 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eea3f3e5:::benchmark_data_smithi188_173515_object95969:head# 2024-04-01T20:04:42.520 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eea4915b:::benchmark_data_smithi188_173515_object70678:head# 2024-04-01T20:04:42.520 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eea4997b:::benchmark_data_smithi188_173515_object106401:head# 2024-04-01T20:04:42.520 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eea50319:::benchmark_data_smithi188_173515_object142039:head# 2024-04-01T20:04:42.520 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eea522a4:::benchmark_data_smithi188_173515_object75170:head# 2024-04-01T20:04:42.520 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eea53b37:::benchmark_data_smithi188_173515_object63941:head# 2024-04-01T20:04:42.520 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eea5b478:::benchmark_data_smithi188_173515_object80361:head# 2024-04-01T20:04:42.520 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eea66fb5:::benchmark_data_smithi188_173515_object77617:head# 2024-04-01T20:04:42.520 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eea6c63a:::benchmark_data_smithi188_173515_object153024:head# 2024-04-01T20:04:42.521 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eea81e7c:::benchmark_data_smithi188_173515_object139164:head# 2024-04-01T20:04:42.521 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eea85f17:::benchmark_data_smithi188_173515_object104048:head# 2024-04-01T20:04:42.521 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eea8ece5:::benchmark_data_smithi188_173515_object57237:head# 2024-04-01T20:04:42.521 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eea95b49:::benchmark_data_smithi188_173515_object138067:head# 2024-04-01T20:04:42.521 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeab46de:::benchmark_data_smithi188_173515_object52616:head# 2024-04-01T20:04:42.521 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeab607f:::benchmark_data_smithi188_173515_object66469:head# 2024-04-01T20:04:42.521 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeac349d:::benchmark_data_smithi188_173515_object137598:head# 2024-04-01T20:04:42.521 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeac7785:::benchmark_data_smithi188_173515_object95064:head# 2024-04-01T20:04:42.521 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eead135e:::benchmark_data_smithi188_173515_object117444:head# 2024-04-01T20:04:42.521 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eead9d0b:::benchmark_data_smithi188_173515_object47748:head# 2024-04-01T20:04:42.521 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeadf47e:::benchmark_data_smithi188_173515_object60587:head# 2024-04-01T20:04:42.521 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeaee603:::benchmark_data_smithi188_173515_object100486:head# 2024-04-01T20:04:42.521 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeaf1a12:::benchmark_data_smithi188_173515_object154720:head# 2024-04-01T20:04:42.522 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeaf3e97:::benchmark_data_smithi188_173515_object76618:head# 2024-04-01T20:04:42.522 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeafe516:::benchmark_data_smithi188_173515_object131155:head# 2024-04-01T20:04:42.522 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeb0f50f:::benchmark_data_smithi188_173515_object113753:head# 2024-04-01T20:04:42.522 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeb17448:::benchmark_data_smithi188_173515_object69580:head# 2024-04-01T20:04:42.522 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeb23fec:::benchmark_data_smithi188_173515_object103203:head# 2024-04-01T20:04:42.522 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeb24458:::benchmark_data_smithi188_173515_object148575:head# 2024-04-01T20:04:42.522 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeb2e067:::benchmark_data_smithi188_173515_object154671:head# 2024-04-01T20:04:42.522 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeb30473:::benchmark_data_smithi188_173515_object109983:head# 2024-04-01T20:04:42.522 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeb39246:::benchmark_data_smithi188_173515_object134127:head# 2024-04-01T20:04:42.522 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeb3d6a9:::benchmark_data_smithi188_173515_object89424:head# 2024-04-01T20:04:42.522 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeb421ba:::benchmark_data_smithi188_173515_object117435:head# 2024-04-01T20:04:42.523 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeb4a387:::benchmark_data_smithi188_173515_object76530:head# 2024-04-01T20:04:42.523 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeb4d866:::benchmark_data_smithi188_173515_object118359:head# 2024-04-01T20:04:42.523 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeb57682:::benchmark_data_smithi188_173515_object144600:head# 2024-04-01T20:04:42.523 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeb5dd5b:::benchmark_data_smithi188_173515_object97103:head# 2024-04-01T20:04:42.523 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeb76270:::benchmark_data_smithi188_173515_object54310:head# 2024-04-01T20:04:42.523 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeb7ba50:::benchmark_data_smithi188_173515_object57596:head# 2024-04-01T20:04:42.523 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeb7c474:::benchmark_data_smithi188_173515_object120261:head# 2024-04-01T20:04:42.523 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeb86fa7:::benchmark_data_smithi188_173515_object143275:head# 2024-04-01T20:04:42.523 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeb8f263:::benchmark_data_smithi188_173515_object115712:head# 2024-04-01T20:04:42.523 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeb97fe5:::benchmark_data_smithi188_173515_object49968:head# 2024-04-01T20:04:42.523 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeba1f08:::benchmark_data_smithi188_173515_object103288:head# 2024-04-01T20:04:42.523 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeba813b:::benchmark_data_smithi188_173515_object121615:head# 2024-04-01T20:04:42.524 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eebb9d39:::benchmark_data_smithi188_173515_object138333:head# 2024-04-01T20:04:42.524 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eebbfae9:::benchmark_data_smithi188_173515_object49060:head# 2024-04-01T20:04:42.524 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eebc0dc3:::benchmark_data_smithi188_173515_object154718:head# 2024-04-01T20:04:42.524 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eebc62b7:::benchmark_data_smithi188_173515_object134482:head# 2024-04-01T20:04:42.524 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eec14b77:::benchmark_data_smithi188_173515_object114560:head# 2024-04-01T20:04:42.524 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eec1e4fb:::benchmark_data_smithi188_173515_object84295:head# 2024-04-01T20:04:42.524 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eec2339e:::benchmark_data_smithi188_173515_object154678:head# 2024-04-01T20:04:42.524 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eec241b5:::benchmark_data_smithi188_173515_object49502:head# 2024-04-01T20:04:42.524 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eec273b3:::benchmark_data_smithi188_173515_object97939:head# 2024-04-01T20:04:42.524 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eec564b5:::benchmark_data_smithi188_173515_object86768:head# 2024-04-01T20:04:42.524 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eec57bd5:::benchmark_data_smithi188_173515_object147018:head# 2024-04-01T20:04:42.524 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eec5eaed:::benchmark_data_smithi188_173515_object134097:head# 2024-04-01T20:04:42.525 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eec63f0c:::benchmark_data_smithi188_173515_object60512:head# 2024-04-01T20:04:42.525 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eec698b4:::benchmark_data_smithi188_173515_object48848:head# 2024-04-01T20:04:42.525 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eec69d6a:::benchmark_data_smithi188_173515_object152925:head# 2024-04-01T20:04:42.525 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eec6ff69:::benchmark_data_smithi188_173515_object144214:head# 2024-04-01T20:04:42.525 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eec7047a:::benchmark_data_smithi188_173515_object108192:head# 2024-04-01T20:04:42.525 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eec80a42:::benchmark_data_smithi188_173515_object69082:head# 2024-04-01T20:04:42.525 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eecada11:::benchmark_data_smithi188_173515_object80241:head# 2024-04-01T20:04:42.525 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eecba305:::benchmark_data_smithi188_173515_object64980:head# 2024-04-01T20:04:42.525 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eecccdc8:::benchmark_data_smithi188_173515_object83250:head# 2024-04-01T20:04:42.525 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeccfb9f:::benchmark_data_smithi188_173515_object141008:head# 2024-04-01T20:04:42.525 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeccfed2:::benchmark_data_smithi188_173515_object152715:head# 2024-04-01T20:04:42.525 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eecd8efd:::benchmark_data_smithi188_173515_object148915:head# 2024-04-01T20:04:42.526 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eecde39a:::benchmark_data_smithi188_173515_object62171:head# 2024-04-01T20:04:42.526 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eecec517:::benchmark_data_smithi188_173515_object48446:head# 2024-04-01T20:04:42.526 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eecec928:::benchmark_data_smithi188_173515_object70854:head# 2024-04-01T20:04:42.526 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eecf516e:::benchmark_data_smithi188_173515_object72877:head# 2024-04-01T20:04:42.526 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eecf60c2:::benchmark_data_smithi188_173515_object97342:head# 2024-04-01T20:04:42.526 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eecf995c:::benchmark_data_smithi188_173515_object134327:head# 2024-04-01T20:04:42.526 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eecfc2a9:::benchmark_data_smithi188_173515_object106642:head# 2024-04-01T20:04:42.526 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eed036d9:::benchmark_data_smithi188_173515_object74727:head# 2024-04-01T20:04:42.526 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eed0d128:::benchmark_data_smithi188_173515_object148446:head# 2024-04-01T20:04:42.526 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eed1f750:::benchmark_data_smithi188_173515_object109233:head# 2024-04-01T20:04:42.526 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eed2ceea:::benchmark_data_smithi188_173515_object67160:head# 2024-04-01T20:04:42.526 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eed33b9b:::benchmark_data_smithi188_173515_object119003:head# 2024-04-01T20:04:42.527 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eed3ba15:::benchmark_data_smithi188_173515_object64928:head# 2024-04-01T20:04:42.527 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eed44061:::benchmark_data_smithi188_173515_object138102:head# 2024-04-01T20:04:42.527 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eed4d4fc:::benchmark_data_smithi188_173515_object95800:head# 2024-04-01T20:04:42.527 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eed51922:::benchmark_data_smithi188_173515_object154731:head# 2024-04-01T20:04:42.527 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eed5b62b:::benchmark_data_smithi188_173515_object87986:head# 2024-04-01T20:04:42.527 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eed5bba8:::benchmark_data_smithi188_173515_object116233:head# 2024-04-01T20:04:42.527 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eed5bca1:::benchmark_data_smithi188_173515_object55402:head# 2024-04-01T20:04:42.527 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eed60e0c:::benchmark_data_smithi188_173515_object91698:head# 2024-04-01T20:04:42.527 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eed62aa9:::benchmark_data_smithi188_173515_object146135:head# 2024-04-01T20:04:42.527 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eed635fc:::benchmark_data_smithi188_173515_object64138:head# 2024-04-01T20:04:42.527 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eed79e7c:::benchmark_data_smithi188_173515_object155615:head# 2024-04-01T20:04:42.527 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eed7ae06:::benchmark_data_smithi188_173515_object81925:head# 2024-04-01T20:04:42.527 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eed84965:::benchmark_data_smithi188_173515_object85089:head# 2024-04-01T20:04:42.527 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eed8e6ae:::benchmark_data_smithi188_173515_object86307:head# 2024-04-01T20:04:42.528 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eed99d10:::benchmark_data_smithi188_173515_object75222:head# 2024-04-01T20:04:42.528 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eed9b671:::benchmark_data_smithi188_173515_object87911:head# 2024-04-01T20:04:42.528 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eedc969e:::benchmark_data_smithi188_173515_object125137:head# 2024-04-01T20:04:42.528 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eedd0f18:::benchmark_data_smithi188_173515_object51339:head# 2024-04-01T20:04:42.528 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeddb1e9:::benchmark_data_smithi188_173515_object137643:head# 2024-04-01T20:04:42.528 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eede4473:::benchmark_data_smithi188_173515_object55440:head# 2024-04-01T20:04:42.528 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eedf21a8:::benchmark_data_smithi188_173515_object139596:head# 2024-04-01T20:04:42.528 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eedf6c72:::benchmark_data_smithi188_173515_object46221:head# 2024-04-01T20:04:42.528 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eee027fe:::benchmark_data_smithi188_173515_object83157:head# 2024-04-01T20:04:42.528 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eee07c9a:::benchmark_data_smithi188_173515_object54678:head# 2024-04-01T20:04:42.528 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eee0decf:::benchmark_data_smithi188_173515_object49884:head# 2024-04-01T20:04:42.528 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eee22199:::benchmark_data_smithi188_173515_object54605:head# 2024-04-01T20:04:42.529 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eee23f73:::benchmark_data_smithi188_173515_object71847:head# 2024-04-01T20:04:42.529 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eee273fb:::benchmark_data_smithi188_173515_object138950:head# 2024-04-01T20:04:42.529 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eee28a27:::benchmark_data_smithi188_173515_object63777:head# 2024-04-01T20:04:42.529 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eee2d402:::benchmark_data_smithi188_173515_object136001:head# 2024-04-01T20:04:42.529 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eee38adb:::benchmark_data_smithi188_173515_object116902:head# 2024-04-01T20:04:42.529 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eee393e2:::benchmark_data_smithi188_173515_object90201:head# 2024-04-01T20:04:42.529 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eee54d14:::benchmark_data_smithi188_173515_object141238:head# 2024-04-01T20:04:42.529 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eee67cb4:::benchmark_data_smithi188_173515_object68289:head# 2024-04-01T20:04:42.529 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eee6a3c7:::benchmark_data_smithi188_173515_object80010:head# 2024-04-01T20:04:42.529 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eee7a529:::benchmark_data_smithi188_173515_object148456:head# 2024-04-01T20:04:42.529 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eee7bd8d:::benchmark_data_smithi188_173515_object84801:head# 2024-04-01T20:04:42.530 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eee89412:::benchmark_data_smithi188_173515_object58257:head# 2024-04-01T20:04:42.530 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eee918d9:::benchmark_data_smithi188_173515_object114673:head# 2024-04-01T20:04:42.530 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeea7e4e:::benchmark_data_smithi188_173515_object121249:head# 2024-04-01T20:04:42.530 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeead34f:::benchmark_data_smithi188_173515_object64512:head# 2024-04-01T20:04:42.530 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeeaf9fc:::benchmark_data_smithi188_173515_object127500:head# 2024-04-01T20:04:42.530 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeeb5cd4:::benchmark_data_smithi188_173515_object116591:head# 2024-04-01T20:04:42.530 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeecd68b:::benchmark_data_smithi188_173515_object147148:head# 2024-04-01T20:04:42.530 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeed4a15:::benchmark_data_smithi188_173515_object111501:head# 2024-04-01T20:04:42.530 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeeda1f4:::benchmark_data_smithi188_173515_object109277:head# 2024-04-01T20:04:42.530 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeee8c33:::benchmark_data_smithi188_173515_object122899:head# 2024-04-01T20:04:42.530 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeeef9cf:::benchmark_data_smithi188_173515_object110234:head# 2024-04-01T20:04:42.531 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeef2b7e:::benchmark_data_smithi188_173515_object74828:head# 2024-04-01T20:04:42.531 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeefafd8:::benchmark_data_smithi188_173515_object135189:head# 2024-04-01T20:04:42.531 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eef0c571:::benchmark_data_smithi188_173515_object152952:head# 2024-04-01T20:04:42.531 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eef23dd7:::benchmark_data_smithi188_173515_object57422:head# 2024-04-01T20:04:42.531 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eef241d3:::benchmark_data_smithi188_173515_object69846:head# 2024-04-01T20:04:42.531 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eef27d2c:::benchmark_data_smithi188_173515_object133888:head# 2024-04-01T20:04:42.531 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eef3aa97:::benchmark_data_smithi188_173515_object88352:head# 2024-04-01T20:04:42.531 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eef3e51b:::benchmark_data_smithi188_173515_object73145:head# 2024-04-01T20:04:42.532 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eef4384d:::benchmark_data_smithi188_173515_object139601:head# 2024-04-01T20:04:42.532 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eef47b68:::benchmark_data_smithi188_173515_object69470:head# 2024-04-01T20:04:42.532 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eef5e064:::benchmark_data_smithi188_173515_object141809:head# 2024-04-01T20:04:42.532 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eef61618:::benchmark_data_smithi188_173515_object52724:head# 2024-04-01T20:04:42.532 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eef6c080:::benchmark_data_smithi188_173515_object126010:head# 2024-04-01T20:04:42.532 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eef765ef:::benchmark_data_smithi188_173515_object135659:head# 2024-04-01T20:04:42.532 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eef7738d:::benchmark_data_smithi188_173515_object150074:head# 2024-04-01T20:04:42.532 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eef82a92:::benchmark_data_smithi188_173515_object119351:head# 2024-04-01T20:04:42.532 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eef8fdf3:::benchmark_data_smithi188_173515_object99149:head# 2024-04-01T20:04:42.532 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eef98301:::benchmark_data_smithi188_173515_object63518:head# 2024-04-01T20:04:42.533 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eef9a80d:::benchmark_data_smithi188_173515_object107167:head# 2024-04-01T20:04:42.533 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eef9f96c:::benchmark_data_smithi188_173515_object153903:head# 2024-04-01T20:04:42.533 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eefb3284:::benchmark_data_smithi188_173515_object146115:head# 2024-04-01T20:04:42.533 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eefbc1c0:::benchmark_data_smithi188_173515_object64634:head# 2024-04-01T20:04:42.533 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eefd92b6:::benchmark_data_smithi188_173515_object71495:head# 2024-04-01T20:04:42.533 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eefe20c8:::benchmark_data_smithi188_173515_object51802:head# 2024-04-01T20:04:42.533 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eefe699f:::benchmark_data_smithi188_173515_object74809:head# 2024-04-01T20:04:42.533 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eefe7a11:::benchmark_data_smithi188_173515_object114416:head# 2024-04-01T20:04:42.533 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eeffba04:::benchmark_data_smithi188_173515_object46667:head# 2024-04-01T20:04:42.533 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef004d9e:::benchmark_data_smithi188_173515_object93721:head# 2024-04-01T20:04:42.533 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef015bd9:::benchmark_data_smithi188_173515_object57659:head# 2024-04-01T20:04:42.533 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef01cb83:::benchmark_data_smithi188_173515_object77789:head# 2024-04-01T20:04:42.534 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef02ac7d:::benchmark_data_smithi188_173515_object98042:head# 2024-04-01T20:04:42.534 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef02da48:::benchmark_data_smithi188_173515_object52547:head# 2024-04-01T20:04:42.534 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef034cc4:::benchmark_data_smithi188_173515_object86052:head# 2024-04-01T20:04:42.534 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef03594d:::benchmark_data_smithi188_173515_object79335:head# 2024-04-01T20:04:42.534 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef03a44b:::benchmark_data_smithi188_173515_object111914:head# 2024-04-01T20:04:42.534 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef03ed1f:::benchmark_data_smithi188_173515_object155365:head# 2024-04-01T20:04:42.534 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef05063a:::benchmark_data_smithi188_173515_object79009:head# 2024-04-01T20:04:42.534 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef053c00:::benchmark_data_smithi188_173515_object151485:head# 2024-04-01T20:04:42.534 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef068f2d:::benchmark_data_smithi188_173515_object46557:head# 2024-04-01T20:04:42.534 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef085a37:::benchmark_data_smithi188_173515_object136214:head# 2024-04-01T20:04:42.534 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef0979cd:::benchmark_data_smithi188_173515_object69844:head# 2024-04-01T20:04:42.535 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef09ae1a:::benchmark_data_smithi188_173515_object73258:head# 2024-04-01T20:04:42.535 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef09f3ff:::benchmark_data_smithi188_173515_object93270:head# 2024-04-01T20:04:42.535 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef0a5823:::benchmark_data_smithi188_173515_object62251:head# 2024-04-01T20:04:42.535 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef0a97d3:::benchmark_data_smithi188_173515_object154478:head# 2024-04-01T20:04:42.535 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef0ae426:::benchmark_data_smithi188_173515_object122992:head# 2024-04-01T20:04:42.535 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef0ae472:::benchmark_data_smithi188_173515_object87493:head# 2024-04-01T20:04:42.535 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef0b406f:::benchmark_data_smithi188_173515_object100880:head# 2024-04-01T20:04:42.535 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef0cf91a:::benchmark_data_smithi188_173515_object71619:head# 2024-04-01T20:04:42.535 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef0d262a:::benchmark_data_smithi188_173515_object91847:head# 2024-04-01T20:04:42.535 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef0da821:::benchmark_data_smithi188_173515_object87034:head# 2024-04-01T20:04:42.535 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef10225c:::benchmark_data_smithi188_173515_object67638:head# 2024-04-01T20:04:42.535 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef112419:::benchmark_data_smithi188_173515_object111591:head# 2024-04-01T20:04:42.536 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef11732b:::benchmark_data_smithi188_173515_object106904:head# 2024-04-01T20:04:42.536 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef11bfcc:::benchmark_data_smithi188_173515_object102693:head# 2024-04-01T20:04:42.536 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef11d74e:::benchmark_data_smithi188_173515_object71970:head# 2024-04-01T20:04:42.536 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef1232d6:::benchmark_data_smithi188_173515_object148564:head# 2024-04-01T20:04:42.536 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef126dd5:::benchmark_data_smithi188_173515_object121417:head# 2024-04-01T20:04:42.536 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef12d79e:::benchmark_data_smithi188_173515_object150617:head# 2024-04-01T20:04:42.536 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef135f17:::benchmark_data_smithi188_173515_object132025:head# 2024-04-01T20:04:42.536 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef13ecad:::benchmark_data_smithi188_173515_object139616:head# 2024-04-01T20:04:42.536 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef144073:::benchmark_data_smithi188_173515_object96081:head# 2024-04-01T20:04:42.536 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef1534a9:::benchmark_data_smithi188_173515_object150630:head# 2024-04-01T20:04:42.536 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef15b339:::benchmark_data_smithi188_173515_object122170:head# 2024-04-01T20:04:42.536 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef160b76:::benchmark_data_smithi188_173515_object85721:head# 2024-04-01T20:04:42.537 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef17344a:::benchmark_data_smithi188_173515_object102173:head# 2024-04-01T20:04:42.537 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef18d4f7:::benchmark_data_smithi188_173515_object151866:head# 2024-04-01T20:04:42.537 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef19cb46:::benchmark_data_smithi188_173515_object131616:head# 2024-04-01T20:04:42.537 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef1a0279:::benchmark_data_smithi188_173515_object122072:head# 2024-04-01T20:04:42.537 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef1ab80f:::benchmark_data_smithi188_173515_object119785:head# 2024-04-01T20:04:42.537 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef1b643f:::benchmark_data_smithi188_173515_object107768:head# 2024-04-01T20:04:42.537 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef1c39fd:::benchmark_data_smithi188_173515_object91184:head# 2024-04-01T20:04:42.537 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef1c45cd:::benchmark_data_smithi188_173515_object116060:head# 2024-04-01T20:04:42.537 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef1c669e:::benchmark_data_smithi188_173515_object143234:head# 2024-04-01T20:04:42.537 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef1d1ea8:::benchmark_data_smithi188_173515_object137219:head# 2024-04-01T20:04:42.537 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef1e13a3:::benchmark_data_smithi188_173515_object137804:head# 2024-04-01T20:04:42.537 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef1eaaff:::benchmark_data_smithi188_173515_object79248:head# 2024-04-01T20:04:42.537 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef1ef2da:::benchmark_data_smithi188_173515_object126796:head# 2024-04-01T20:04:42.538 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef1f18c8:::benchmark_data_smithi188_173515_object153524:head# 2024-04-01T20:04:42.538 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef206cce:::benchmark_data_smithi188_173515_object111586:head# 2024-04-01T20:04:42.538 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef20cea8:::benchmark_data_smithi188_173515_object142837:head# 2024-04-01T20:04:42.538 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef20d3a5:::benchmark_data_smithi188_173515_object123428:head# 2024-04-01T20:04:42.538 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef21bf5e:::benchmark_data_smithi188_173515_object101640:head# 2024-04-01T20:04:42.538 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef221dbf:::benchmark_data_smithi188_173515_object155393:head# 2024-04-01T20:04:42.538 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef222768:::benchmark_data_smithi188_173515_object140753:head# 2024-04-01T20:04:42.538 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef236c4f:::benchmark_data_smithi188_173515_object97438:head# 2024-04-01T20:04:42.538 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef23cd6f:::benchmark_data_smithi188_173515_object136005:head# 2024-04-01T20:04:42.538 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef2416e6:::benchmark_data_smithi188_173515_object68915:head# 2024-04-01T20:04:42.538 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef259f56:::benchmark_data_smithi188_173515_object95983:head# 2024-04-01T20:04:42.538 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef25c6db:::benchmark_data_smithi188_173515_object62450:head# 2024-04-01T20:04:42.539 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef25df3a:::benchmark_data_smithi188_173515_object136215:head# 2024-04-01T20:04:42.539 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef279696:::benchmark_data_smithi188_173515_object120613:head# 2024-04-01T20:04:42.539 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef279bfa:::benchmark_data_smithi188_173515_object150845:head# 2024-04-01T20:04:42.539 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef27fd80:::benchmark_data_smithi188_173515_object65499:head# 2024-04-01T20:04:42.539 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef290309:::benchmark_data_smithi188_173515_object153684:head# 2024-04-01T20:04:42.539 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef291311:::benchmark_data_smithi188_173515_object121634:head# 2024-04-01T20:04:42.539 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef2b0c7b:::benchmark_data_smithi188_173515_object73123:head# 2024-04-01T20:04:42.539 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef2b3ab6:::benchmark_data_smithi188_173515_object135912:head# 2024-04-01T20:04:42.539 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef2b442d:::benchmark_data_smithi188_173515_object121067:head# 2024-04-01T20:04:42.539 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef2b7525:::benchmark_data_smithi188_173515_object142883:head# 2024-04-01T20:04:42.539 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef2ce81b:::benchmark_data_smithi188_173515_object93154:head# 2024-04-01T20:04:42.539 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef2d7fa1:::benchmark_data_smithi188_173515_object84167:head# 2024-04-01T20:04:42.539 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef2dad6b:::benchmark_data_smithi188_173515_object107835:head# 2024-04-01T20:04:42.540 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef2e1bbe:::benchmark_data_smithi188_173515_object104439:head# 2024-04-01T20:04:42.540 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef2e258a:::benchmark_data_smithi188_173515_object101453:head# 2024-04-01T20:04:42.540 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef2e6d8f:::benchmark_data_smithi188_173515_object76392:head# 2024-04-01T20:04:42.540 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef2e7f11:::benchmark_data_smithi188_173515_object142169:head# 2024-04-01T20:04:42.540 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef2e974b:::benchmark_data_smithi188_173515_object151584:head# 2024-04-01T20:04:42.540 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef2ebdc3:::benchmark_data_smithi188_173515_object137706:head# 2024-04-01T20:04:42.540 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef2f0509:::benchmark_data_smithi188_173515_object153801:head# 2024-04-01T20:04:42.540 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef2f57e1:::benchmark_data_smithi188_173515_object96958:head# 2024-04-01T20:04:42.540 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef301278:::benchmark_data_smithi188_173515_object97974:head# 2024-04-01T20:04:42.540 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef308906:::benchmark_data_smithi188_173515_object148703:head# 2024-04-01T20:04:42.540 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef30b3e1:::benchmark_data_smithi188_173515_object62789:head# 2024-04-01T20:04:42.540 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef312872:::benchmark_data_smithi188_173515_object67440:head# 2024-04-01T20:04:42.541 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef318b70:::benchmark_data_smithi188_173515_object88801:head# 2024-04-01T20:04:42.541 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef32e40a:::benchmark_data_smithi188_173515_object61823:head# 2024-04-01T20:04:42.541 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef32f225:::benchmark_data_smithi188_173515_object105546:head# 2024-04-01T20:04:42.541 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef363d5f:::benchmark_data_smithi188_173515_object74515:head# 2024-04-01T20:04:42.541 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef368ce6:::benchmark_data_smithi188_173515_object50661:head# 2024-04-01T20:04:42.541 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef36c55e:::benchmark_data_smithi188_173515_object75602:head# 2024-04-01T20:04:42.541 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef382b9d:::benchmark_data_smithi188_173515_object52811:head# 2024-04-01T20:04:42.541 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef384dfd:::benchmark_data_smithi188_173515_object74661:head# 2024-04-01T20:04:42.541 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef388832:::benchmark_data_smithi188_173515_object131882:head# 2024-04-01T20:04:42.541 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef38cb72:::benchmark_data_smithi188_173515_object145878:head# 2024-04-01T20:04:42.541 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef3b14a8:::benchmark_data_smithi188_173515_object55090:head# 2024-04-01T20:04:42.541 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef3b8c8e:::benchmark_data_smithi188_173515_object117274:head# 2024-04-01T20:04:42.542 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef3bd74b:::benchmark_data_smithi188_173515_object150584:head# 2024-04-01T20:04:42.542 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef3c1592:::benchmark_data_smithi188_173515_object92860:head# 2024-04-01T20:04:42.542 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef3c453a:::benchmark_data_smithi188_173515_object85032:head# 2024-04-01T20:04:42.542 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef3c4c2b:::benchmark_data_smithi188_173515_object101065:head# 2024-04-01T20:04:42.542 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef3c9dcf:::benchmark_data_smithi188_173515_object52539:head# 2024-04-01T20:04:42.542 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef3d8e7e:::benchmark_data_smithi188_173515_object132299:head# 2024-04-01T20:04:42.542 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef3e4132:::benchmark_data_smithi188_173515_object132891:head# 2024-04-01T20:04:42.542 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef3f21d0:::benchmark_data_smithi188_173515_object137130:head# 2024-04-01T20:04:42.542 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef409d72:::benchmark_data_smithi188_173515_object144317:head# 2024-04-01T20:04:42.542 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef414d6d:::benchmark_data_smithi188_173515_object151134:head# 2024-04-01T20:04:42.542 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef414e93:::benchmark_data_smithi188_173515_object49346:head# 2024-04-01T20:04:42.543 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef429959:::benchmark_data_smithi188_173515_object95224:head# 2024-04-01T20:04:42.543 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef429e95:::benchmark_data_smithi188_173515_object116021:head# 2024-04-01T20:04:42.543 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef43991b:::benchmark_data_smithi188_173515_object115077:head# 2024-04-01T20:04:42.543 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef4411bb:::benchmark_data_smithi188_173515_object151941:head# 2024-04-01T20:04:42.543 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef447905:::benchmark_data_smithi188_173515_object142472:head# 2024-04-01T20:04:42.543 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef44b7a9:::benchmark_data_smithi188_173515_object143572:head# 2024-04-01T20:04:42.543 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef44d31c:::benchmark_data_smithi188_173515_object110074:head# 2024-04-01T20:04:42.543 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef450f33:::benchmark_data_smithi188_173515_object137411:head# 2024-04-01T20:04:42.543 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef452c16:::benchmark_data_smithi188_173515_object132996:head# 2024-04-01T20:04:42.543 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef458495:::benchmark_data_smithi188_173515_object48244:head# 2024-04-01T20:04:42.543 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef473b29:::benchmark_data_smithi188_173515_object100128:head# 2024-04-01T20:04:42.543 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef478437:::benchmark_data_smithi188_173515_object155227:head# 2024-04-01T20:04:42.543 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef491c3f:::benchmark_data_smithi188_173515_object152368:head# 2024-04-01T20:04:42.544 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef49a0f5:::benchmark_data_smithi188_173515_object66333:head# 2024-04-01T20:04:42.544 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef49a65a:::benchmark_data_smithi188_173515_object54847:head# 2024-04-01T20:04:42.544 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef4d0490:::benchmark_data_smithi188_173515_object105241:head# 2024-04-01T20:04:42.544 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef4da297:::benchmark_data_smithi188_173515_object98883:head# 2024-04-01T20:04:42.544 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef4ef3b9:::benchmark_data_smithi188_173515_object126652:head# 2024-04-01T20:04:42.544 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef4f29c8:::benchmark_data_smithi188_173515_object60518:head# 2024-04-01T20:04:42.544 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef4f3072:::benchmark_data_smithi188_173515_object105100:head# 2024-04-01T20:04:42.544 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef4f4134:::benchmark_data_smithi188_173515_object53882:head# 2024-04-01T20:04:42.544 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef4f5dbc:::benchmark_data_smithi188_173515_object152162:head# 2024-04-01T20:04:42.544 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef51c75d:::benchmark_data_smithi188_173515_object72847:head# 2024-04-01T20:04:42.544 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef51ecc9:::benchmark_data_smithi188_173515_object60551:head# 2024-04-01T20:04:42.544 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef524197:::benchmark_data_smithi188_173515_object79389:head# 2024-04-01T20:04:42.544 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef52924a:::benchmark_data_smithi188_173515_object87721:head# 2024-04-01T20:04:42.545 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef5337ef:::benchmark_data_smithi188_173515_object151174:head# 2024-04-01T20:04:42.545 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef53733d:::benchmark_data_smithi188_173515_object110397:head# 2024-04-01T20:04:42.545 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef53fd0c:::benchmark_data_smithi188_173515_object88181:head# 2024-04-01T20:04:42.545 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef546185:::benchmark_data_smithi188_173515_object104167:head# 2024-04-01T20:04:42.545 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef547235:::benchmark_data_smithi188_173515_object70133:head# 2024-04-01T20:04:42.545 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef55aef3:::benchmark_data_smithi188_173515_object132507:head# 2024-04-01T20:04:42.545 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef57c7a6:::benchmark_data_smithi188_173515_object73835:head# 2024-04-01T20:04:42.545 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef57dab8:::benchmark_data_smithi188_173515_object75197:head# 2024-04-01T20:04:42.545 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef57ffa6:::benchmark_data_smithi188_173515_object73241:head# 2024-04-01T20:04:42.545 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef5889b5:::benchmark_data_smithi188_173515_object154896:head# 2024-04-01T20:04:42.545 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef589fc1:::benchmark_data_smithi188_173515_object125689:head# 2024-04-01T20:04:42.545 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef58b603:::benchmark_data_smithi188_173515_object69979:head# 2024-04-01T20:04:42.545 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef58bde3:::benchmark_data_smithi188_173515_object113328:head# 2024-04-01T20:04:42.546 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef5a2b13:::benchmark_data_smithi188_173515_object139022:head# 2024-04-01T20:04:42.546 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef5a6e15:::benchmark_data_smithi188_173515_object122129:head# 2024-04-01T20:04:42.546 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef5d5d44:::benchmark_data_smithi188_173515_object101612:head# 2024-04-01T20:04:42.546 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef5dc24a:::benchmark_data_smithi188_173515_object102111:head# 2024-04-01T20:04:42.546 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef5e8c35:::benchmark_data_smithi188_173515_object46837:head# 2024-04-01T20:04:42.546 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef5ed4de:::benchmark_data_smithi188_173515_object152348:head# 2024-04-01T20:04:42.546 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef5f2b89:::benchmark_data_smithi188_173515_object103273:head# 2024-04-01T20:04:42.546 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef5f2d62:::benchmark_data_smithi188_173515_object51227:head# 2024-04-01T20:04:42.546 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef5f4a4b:::benchmark_data_smithi188_173515_object89918:head# 2024-04-01T20:04:42.546 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef5f6264:::benchmark_data_smithi188_173515_object76447:head# 2024-04-01T20:04:42.546 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef5f9c4a:::benchmark_data_smithi188_173515_object54735:head# 2024-04-01T20:04:42.547 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef5fa45c:::benchmark_data_smithi188_173515_object98455:head# 2024-04-01T20:04:42.547 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef603290:::benchmark_data_smithi188_173515_object76850:head# 2024-04-01T20:04:42.547 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef61b576:::benchmark_data_smithi188_173515_object143545:head# 2024-04-01T20:04:42.547 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef6282bd:::benchmark_data_smithi188_173515_object62447:head# 2024-04-01T20:04:42.547 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef628a07:::benchmark_data_smithi188_173515_object65465:head# 2024-04-01T20:04:42.547 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef638256:::benchmark_data_smithi188_173515_object116889:head# 2024-04-01T20:04:42.547 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef63b170:::benchmark_data_smithi188_173515_object86298:head# 2024-04-01T20:04:42.547 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef63d17c:::benchmark_data_smithi188_173515_object48739:head# 2024-04-01T20:04:42.547 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef65ccdb:::benchmark_data_smithi188_173515_object49372:head# 2024-04-01T20:04:42.547 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef665e14:::benchmark_data_smithi188_173515_object57867:head# 2024-04-01T20:04:42.547 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef66675b:::benchmark_data_smithi188_173515_object90085:head# 2024-04-01T20:04:42.547 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef66c290:::benchmark_data_smithi188_173515_object63813:head# 2024-04-01T20:04:42.547 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef66fe5c:::benchmark_data_smithi188_173515_object49016:head# 2024-04-01T20:04:42.547 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef67e0b5:::benchmark_data_smithi188_173515_object112785:head# 2024-04-01T20:04:42.548 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef685167:::benchmark_data_smithi188_173515_object116427:head# 2024-04-01T20:04:42.548 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef687e1a:::benchmark_data_smithi188_173515_object118685:head# 2024-04-01T20:04:42.548 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef68d743:::benchmark_data_smithi188_173515_object114671:head# 2024-04-01T20:04:42.548 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef69f118:::benchmark_data_smithi188_173515_object111037:head# 2024-04-01T20:04:42.548 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef6a46ae:::benchmark_data_smithi188_173515_object109175:head# 2024-04-01T20:04:42.548 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef6c2ae2:::benchmark_data_smithi188_173515_object56714:head# 2024-04-01T20:04:42.548 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef6c310e:::benchmark_data_smithi188_173515_object78236:head# 2024-04-01T20:04:42.548 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef6c33c4:::benchmark_data_smithi188_173515_object104634:head# 2024-04-01T20:04:42.548 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef6cb503:::benchmark_data_smithi188_173515_object62260:head# 2024-04-01T20:04:42.548 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef6cd873:::benchmark_data_smithi188_173515_object86393:head# 2024-04-01T20:04:42.548 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef6d8143:::benchmark_data_smithi188_173515_object61279:head# 2024-04-01T20:04:42.548 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef6de523:::benchmark_data_smithi188_173515_object142552:head# 2024-04-01T20:04:42.549 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef6e7ad5:::benchmark_data_smithi188_173515_object114392:head# 2024-04-01T20:04:42.549 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef6e9eb8:::benchmark_data_smithi188_173515_object62119:head# 2024-04-01T20:04:42.549 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef6eaa4b:::benchmark_data_smithi188_173515_object124294:head# 2024-04-01T20:04:42.549 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef70685e:::benchmark_data_smithi188_173515_object85810:head# 2024-04-01T20:04:42.549 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef713092:::benchmark_data_smithi188_173515_object74176:head# 2024-04-01T20:04:42.549 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef71e342:::benchmark_data_smithi188_173515_object83872:head# 2024-04-01T20:04:42.549 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef729f73:::benchmark_data_smithi188_173515_object49945:head# 2024-04-01T20:04:42.549 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef72a818:::benchmark_data_smithi188_173515_object131287:head# 2024-04-01T20:04:42.549 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef72e9c6:::benchmark_data_smithi188_173515_object86887:head# 2024-04-01T20:04:42.549 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef72ed24:::benchmark_data_smithi188_173515_object73958:head# 2024-04-01T20:04:42.549 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef733fd7:::benchmark_data_smithi188_173515_object52399:head# 2024-04-01T20:04:42.549 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef73ad28:::benchmark_data_smithi188_173515_object128635:head# 2024-04-01T20:04:42.550 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef73dd09:::benchmark_data_smithi188_173515_object94806:head# 2024-04-01T20:04:42.550 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef73eba5:::benchmark_data_smithi188_173515_object150147:head# 2024-04-01T20:04:42.550 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef742504:::benchmark_data_smithi188_173515_object118372:head# 2024-04-01T20:04:42.550 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef74a3ed:::benchmark_data_smithi188_173515_object89780:head# 2024-04-01T20:04:42.550 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef74c5d0:::benchmark_data_smithi188_173515_object151833:head# 2024-04-01T20:04:42.550 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef750326:::benchmark_data_smithi188_173515_object116141:head# 2024-04-01T20:04:42.550 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef756a08:::benchmark_data_smithi188_173515_object154934:head# 2024-04-01T20:04:42.550 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef759c68:::benchmark_data_smithi188_173515_object122165:head# 2024-04-01T20:04:42.550 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef75ae47:::benchmark_data_smithi188_173515_object77012:head# 2024-04-01T20:04:42.550 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef75e72a:::benchmark_data_smithi188_173515_object83614:head# 2024-04-01T20:04:42.550 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef76e490:::benchmark_data_smithi188_173515_object94705:head# 2024-04-01T20:04:42.550 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef7723ba:::benchmark_data_smithi188_173515_object78055:head# 2024-04-01T20:04:42.551 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef78381a:::benchmark_data_smithi188_173515_object92682:head# 2024-04-01T20:04:42.551 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef7839f7:::benchmark_data_smithi188_173515_object133629:head# 2024-04-01T20:04:42.551 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef788146:::benchmark_data_smithi188_173515_object79699:head# 2024-04-01T20:04:42.551 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef78dd5d:::benchmark_data_smithi188_173515_object49126:head# 2024-04-01T20:04:42.551 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef78e90c:::benchmark_data_smithi188_173515_object49833:head# 2024-04-01T20:04:42.551 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef798885:::benchmark_data_smithi188_173515_object121950:head# 2024-04-01T20:04:42.551 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef7a2960:::benchmark_data_smithi188_173515_object50172:head# 2024-04-01T20:04:42.551 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef7b31e3:::benchmark_data_smithi188_173515_object102711:head# 2024-04-01T20:04:42.551 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef7b7a6b:::benchmark_data_smithi188_173515_object138785:head# 2024-04-01T20:04:42.551 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef7ba964:::benchmark_data_smithi188_173515_object88660:head# 2024-04-01T20:04:42.551 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef7d9a1b:::benchmark_data_smithi188_173515_object134707:head# 2024-04-01T20:04:42.551 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef7dee98:::benchmark_data_smithi188_173515_object89985:head# 2024-04-01T20:04:42.552 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef7e090c:::benchmark_data_smithi188_173515_object66548:head# 2024-04-01T20:04:42.552 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef7f645a:::benchmark_data_smithi188_173515_object99733:head# 2024-04-01T20:04:42.552 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef7fee91:::benchmark_data_smithi188_173515_object99085:head# 2024-04-01T20:04:42.552 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef801a61:::benchmark_data_smithi188_173515_object105009:head# 2024-04-01T20:04:42.552 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef8213c7:::benchmark_data_smithi188_173515_object127799:head# 2024-04-01T20:04:42.552 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef825217:::benchmark_data_smithi188_173515_object88230:head# 2024-04-01T20:04:42.552 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef825e90:::benchmark_data_smithi188_173515_object121297:head# 2024-04-01T20:04:42.552 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef8263a6:::benchmark_data_smithi188_173515_object77800:head# 2024-04-01T20:04:42.552 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef82abf5:::benchmark_data_smithi188_173515_object154133:head# 2024-04-01T20:04:42.552 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef832356:::benchmark_data_smithi188_173515_object116003:head# 2024-04-01T20:04:42.552 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef845702:::benchmark_data_smithi188_173515_object146443:head# 2024-04-01T20:04:42.552 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef856d94:::benchmark_data_smithi188_173515_object101001:head# 2024-04-01T20:04:42.553 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef86283d:::benchmark_data_smithi188_173515_object149742:head# 2024-04-01T20:04:42.553 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef86acdf:::benchmark_data_smithi188_173515_object128165:head# 2024-04-01T20:04:42.553 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef8730e1:::benchmark_data_smithi188_173515_object132035:head# 2024-04-01T20:04:42.553 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef87f765:::benchmark_data_smithi188_173515_object98811:head# 2024-04-01T20:04:42.553 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef88c878:::benchmark_data_smithi188_173515_object152278:head# 2024-04-01T20:04:42.553 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef898b87:::benchmark_data_smithi188_173515_object107419:head# 2024-04-01T20:04:42.553 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef8a0149:::benchmark_data_smithi188_173515_object136660:head# 2024-04-01T20:04:42.553 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef8cf53c:::benchmark_data_smithi188_173515_object155095:head# 2024-04-01T20:04:42.553 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef8eff95:::benchmark_data_smithi188_173515_object57979:head# 2024-04-01T20:04:42.553 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef8ffec5:::benchmark_data_smithi188_173515_object150580:head# 2024-04-01T20:04:42.553 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef905a4a:::benchmark_data_smithi188_173515_object68762:head# 2024-04-01T20:04:42.553 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef9099f2:::benchmark_data_smithi188_173515_object114464:head# 2024-04-01T20:04:42.554 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef90b988:::benchmark_data_smithi188_173515_object74611:head# 2024-04-01T20:04:42.554 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef91b6ea:::benchmark_data_smithi188_173515_object141400:head# 2024-04-01T20:04:42.554 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef931e53:::benchmark_data_smithi188_173515_object149326:head# 2024-04-01T20:04:42.554 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef943460:::benchmark_data_smithi188_173515_object46254:head# 2024-04-01T20:04:42.554 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef9529ab:::benchmark_data_smithi188_173515_object149887:head# 2024-04-01T20:04:42.554 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef954d60:::benchmark_data_smithi188_173515_object121340:head# 2024-04-01T20:04:42.554 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef956c23:::benchmark_data_smithi188_173515_object83387:head# 2024-04-01T20:04:42.554 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef973150:::benchmark_data_smithi188_173515_object55037:head# 2024-04-01T20:04:42.554 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef977480:::benchmark_data_smithi188_173515_object81753:head# 2024-04-01T20:04:42.554 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef982b09:::benchmark_data_smithi188_173515_object98992:head# 2024-04-01T20:04:42.554 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef985fa2:::benchmark_data_smithi188_173515_object87664:head# 2024-04-01T20:04:42.555 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef986ae8:::benchmark_data_smithi188_173515_object51488:head# 2024-04-01T20:04:42.555 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef98bc9f:::benchmark_data_smithi188_173515_object154853:head# 2024-04-01T20:04:42.555 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef9a4163:::benchmark_data_smithi188_173515_object104137:head# 2024-04-01T20:04:42.555 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef9a9cf2:::benchmark_data_smithi188_173515_object137283:head# 2024-04-01T20:04:42.555 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef9ad821:::benchmark_data_smithi188_173515_object50787:head# 2024-04-01T20:04:42.555 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef9b0206:::benchmark_data_smithi188_173515_object91769:head# 2024-04-01T20:04:42.555 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef9d6732:::benchmark_data_smithi188_173515_object58825:head# 2024-04-01T20:04:42.555 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef9e642c:::benchmark_data_smithi188_173515_object105514:head# 2024-04-01T20:04:42.555 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef9ea15a:::benchmark_data_smithi188_173515_object84616:head# 2024-04-01T20:04:42.555 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef9eb8df:::benchmark_data_smithi188_173515_object117670:head# 2024-04-01T20:04:42.555 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef9f1539:::benchmark_data_smithi188_173515_object120430:head# 2024-04-01T20:04:42.555 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:ef9f500f:::benchmark_data_smithi188_173515_object123370:head# 2024-04-01T20:04:42.556 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efa06867:::benchmark_data_smithi188_173515_object66015:head# 2024-04-01T20:04:42.556 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efa0b834:::benchmark_data_smithi188_173515_object132092:head# 2024-04-01T20:04:42.556 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efa15d33:::benchmark_data_smithi188_173515_object47420:head# 2024-04-01T20:04:42.556 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efa1fd68:::benchmark_data_smithi188_173515_object71499:head# 2024-04-01T20:04:42.556 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efa25e99:::benchmark_data_smithi188_173515_object104570:head# 2024-04-01T20:04:42.556 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efa344d8:::benchmark_data_smithi188_173515_object96104:head# 2024-04-01T20:04:42.556 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efa3cc7f:::benchmark_data_smithi188_173515_object117487:head# 2024-04-01T20:04:42.556 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efa4bbbb:::benchmark_data_smithi188_173515_object48732:head# 2024-04-01T20:04:42.556 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efa56888:::benchmark_data_smithi188_173515_object70567:head# 2024-04-01T20:04:42.556 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efa5c8e3:::benchmark_data_smithi188_173515_object51384:head# 2024-04-01T20:04:42.556 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efa63ad8:::benchmark_data_smithi188_173515_object58714:head# 2024-04-01T20:04:42.556 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efa6b372:::benchmark_data_smithi188_173515_object110774:head# 2024-04-01T20:04:42.557 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efa73c1b:::benchmark_data_smithi188_173515_object110609:head# 2024-04-01T20:04:42.557 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efa8b5e2:::benchmark_data_smithi188_173515_object103825:head# 2024-04-01T20:04:42.557 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efa94d50:::benchmark_data_smithi188_173515_object77565:head# 2024-04-01T20:04:42.557 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efa955b8:::benchmark_data_smithi188_173515_object51794:head# 2024-04-01T20:04:42.557 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efa9b5f4:::benchmark_data_smithi188_173515_object89887:head# 2024-04-01T20:04:42.557 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efabc1e7:::benchmark_data_smithi188_173515_object48581:head# 2024-04-01T20:04:42.557 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efabed00:::benchmark_data_smithi188_173515_object78217:head# 2024-04-01T20:04:42.557 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efac703c:::benchmark_data_smithi188_173515_object90919:head# 2024-04-01T20:04:42.557 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efad19ec:::benchmark_data_smithi188_173515_object110602:head# 2024-04-01T20:04:42.557 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efadffdc:::benchmark_data_smithi188_173515_object143490:head# 2024-04-01T20:04:42.557 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efae4830:::benchmark_data_smithi188_173515_object82595:head# 2024-04-01T20:04:42.557 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efafb502:::benchmark_data_smithi188_173515_object83805:head# 2024-04-01T20:04:42.558 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efb04e43:::benchmark_data_smithi188_173515_object101457:head# 2024-04-01T20:04:42.558 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efb10d6f:::benchmark_data_smithi188_173515_object81989:head# 2024-04-01T20:04:42.558 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efb172b9:::benchmark_data_smithi188_173515_object144132:head# 2024-04-01T20:04:42.558 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efb2163b:::benchmark_data_smithi188_173515_object124747:head# 2024-04-01T20:04:42.558 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efb2d660:::benchmark_data_smithi188_173515_object73470:head# 2024-04-01T20:04:42.558 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efb35e27:::benchmark_data_smithi188_173515_object51173:head# 2024-04-01T20:04:42.558 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efb3e2a2:::benchmark_data_smithi188_173515_object106527:head# 2024-04-01T20:04:42.558 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efb40177:::benchmark_data_smithi188_173515_object100686:head# 2024-04-01T20:04:42.558 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efb50e05:::benchmark_data_smithi188_173515_object137353:head# 2024-04-01T20:04:42.558 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efb58f79:::benchmark_data_smithi188_173515_object123210:head# 2024-04-01T20:04:42.558 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efb6c7ef:::benchmark_data_smithi188_173515_object51160:head# 2024-04-01T20:04:42.558 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efb73f23:::benchmark_data_smithi188_173515_object71238:head# 2024-04-01T20:04:42.559 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efb7b3d9:::benchmark_data_smithi188_173515_object148574:head# 2024-04-01T20:04:42.559 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efb85170:::benchmark_data_smithi188_173515_object92474:head# 2024-04-01T20:04:42.559 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efb95fba:::benchmark_data_smithi188_173515_object61185:head# 2024-04-01T20:04:42.559 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efb9f3d2:::benchmark_data_smithi188_173515_object136932:head# 2024-04-01T20:04:42.559 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efba3513:::benchmark_data_smithi188_173515_object149730:head# 2024-04-01T20:04:42.559 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efbb8cc6:::benchmark_data_smithi188_173515_object101181:head# 2024-04-01T20:04:42.559 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efbc7f9b:::benchmark_data_smithi188_173515_object45620:head# 2024-04-01T20:04:42.559 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efbde00c:::benchmark_data_smithi188_173515_object109496:head# 2024-04-01T20:04:42.559 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efbde5a6:::benchmark_data_smithi188_173515_object129185:head# 2024-04-01T20:04:42.559 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efbe393f:::benchmark_data_smithi188_173515_object135466:head# 2024-04-01T20:04:42.559 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efbe3b76:::benchmark_data_smithi188_173515_object138565:head# 2024-04-01T20:04:42.559 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efbef079:::benchmark_data_smithi188_173515_object106568:head# 2024-04-01T20:04:42.559 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efbfb5cc:::benchmark_data_smithi188_173515_object109437:head# 2024-04-01T20:04:42.560 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efbfd1db:::benchmark_data_smithi188_173515_object93638:head# 2024-04-01T20:04:42.560 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efbfe051:::benchmark_data_smithi188_173515_object138470:head# 2024-04-01T20:04:42.560 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efc01681:::benchmark_data_smithi188_173515_object48214:head# 2024-04-01T20:04:42.560 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efc0a290:::benchmark_data_smithi188_173515_object119513:head# 2024-04-01T20:04:42.560 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efc0af9d:::benchmark_data_smithi188_173515_object61971:head# 2024-04-01T20:04:42.560 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efc0c805:::benchmark_data_smithi188_173515_object117040:head# 2024-04-01T20:04:42.560 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efc121fe:::benchmark_data_smithi188_173515_object111099:head# 2024-04-01T20:04:42.560 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efc12997:::benchmark_data_smithi188_173515_object63279:head# 2024-04-01T20:04:42.560 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efc2669f:::benchmark_data_smithi188_173515_object126342:head# 2024-04-01T20:04:42.560 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efc28694:::benchmark_data_smithi188_173515_object48126:head# 2024-04-01T20:04:42.560 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efc3b39c:::benchmark_data_smithi188_173515_object79901:head# 2024-04-01T20:04:42.560 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efc49d80:::benchmark_data_smithi188_173515_object98166:head# 2024-04-01T20:04:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efc5181b:::benchmark_data_smithi188_173515_object86985:head# 2024-04-01T20:04:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efc529ee:::benchmark_data_smithi188_173515_object121939:head# 2024-04-01T20:04:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efc6eba9:::benchmark_data_smithi188_173515_object118640:head# 2024-04-01T20:04:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efc7249b:::benchmark_data_smithi188_173515_object105859:head# 2024-04-01T20:04:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efc72bb0:::benchmark_data_smithi188_173515_object73458:head# 2024-04-01T20:04:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efc7c2ce:::benchmark_data_smithi188_173515_object124863:head# 2024-04-01T20:04:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efc7dfa4:::benchmark_data_smithi188_173515_object45542:head# 2024-04-01T20:04:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efc977e1:::benchmark_data_smithi188_173515_object150121:head# 2024-04-01T20:04:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efca28a1:::benchmark_data_smithi188_173515_object121985:head# 2024-04-01T20:04:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efca4110:::benchmark_data_smithi188_173515_object51097:head# 2024-04-01T20:04:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efca41b1:::benchmark_data_smithi188_173515_object73230:head# 2024-04-01T20:04:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efcad682:::benchmark_data_smithi188_173515_object85397:head# 2024-04-01T20:04:42.562 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efcb7404:::benchmark_data_smithi188_173515_object119668:head# 2024-04-01T20:04:42.562 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efcb9d5e:::benchmark_data_smithi188_173515_object60951:head# 2024-04-01T20:04:42.562 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efcba497:::benchmark_data_smithi188_173515_object89605:head# 2024-04-01T20:04:42.562 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efcbf2bb:::benchmark_data_smithi188_173515_object103204:head# 2024-04-01T20:04:42.562 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efcbf93a:::benchmark_data_smithi188_173515_object82355:head# 2024-04-01T20:04:42.562 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efcca2d2:::benchmark_data_smithi188_173515_object103190:head# 2024-04-01T20:04:42.562 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efccc40b:::benchmark_data_smithi188_173515_object121077:head# 2024-04-01T20:04:42.562 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efcd9659:::benchmark_data_smithi188_173515_object102835:head# 2024-04-01T20:04:42.562 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efcdfc43:::benchmark_data_smithi188_173515_object89175:head# 2024-04-01T20:04:42.562 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efce833a:::benchmark_data_smithi188_173515_object57860:head# 2024-04-01T20:04:42.562 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efce9c54:::benchmark_data_smithi188_173515_object110017:head# 2024-04-01T20:04:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efd0fd84:::benchmark_data_smithi188_173515_object80885:head# 2024-04-01T20:04:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efd28527:::benchmark_data_smithi188_173515_object120211:head# 2024-04-01T20:04:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efd2c889:::benchmark_data_smithi188_173515_object98342:head# 2024-04-01T20:04:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efd322bb:::benchmark_data_smithi188_173515_object125183:head# 2024-04-01T20:04:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efd35044:::benchmark_data_smithi188_173515_object57017:head# 2024-04-01T20:04:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efd48d23:::benchmark_data_smithi188_173515_object57273:head# 2024-04-01T20:04:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efd5007b:::benchmark_data_smithi188_173515_object59094:head# 2024-04-01T20:04:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efd503c9:::benchmark_data_smithi188_173515_object154890:head# 2024-04-01T20:04:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efd53af9:::benchmark_data_smithi188_173515_object68084:head# 2024-04-01T20:04:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efd5c90f:::benchmark_data_smithi188_173515_object80945:head# 2024-04-01T20:04:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efd5ebbc:::benchmark_data_smithi188_173515_object131125:head# 2024-04-01T20:04:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efd643bd:::benchmark_data_smithi188_173515_object65935:head# 2024-04-01T20:04:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efd7311d:::benchmark_data_smithi188_173515_object155909:head# 2024-04-01T20:04:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efd801f0:::benchmark_data_smithi188_173515_object99211:head# 2024-04-01T20:04:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efd8f1b6:::benchmark_data_smithi188_173515_object106746:head# 2024-04-01T20:04:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efd8fd36:::benchmark_data_smithi188_173515_object64289:head# 2024-04-01T20:04:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efd90ea0:::benchmark_data_smithi188_173515_object144411:head# 2024-04-01T20:04:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efda1c14:::benchmark_data_smithi188_173515_object78199:head# 2024-04-01T20:04:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efdac0e8:::benchmark_data_smithi188_173515_object68585:head# 2024-04-01T20:04:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efdb0bce:::benchmark_data_smithi188_173515_object146145:head# 2024-04-01T20:04:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efdb2d85:::benchmark_data_smithi188_173515_object130139:head# 2024-04-01T20:04:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efdb4c24:::benchmark_data_smithi188_173515_object118112:head# 2024-04-01T20:04:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efdbf5ab:::benchmark_data_smithi188_173515_object114533:head# 2024-04-01T20:04:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efdc20f0:::benchmark_data_smithi188_173515_object80586:head# 2024-04-01T20:04:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efdd0cb3:::benchmark_data_smithi188_173515_object67847:head# 2024-04-01T20:04:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efdd94f9:::benchmark_data_smithi188_173515_object80610:head# 2024-04-01T20:04:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efdd999b:::benchmark_data_smithi188_173515_object148504:head# 2024-04-01T20:04:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efdfacde:::benchmark_data_smithi188_173515_object140924:head# 2024-04-01T20:04:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efe075cd:::benchmark_data_smithi188_173515_object138471:head# 2024-04-01T20:04:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efe0e9f0:::benchmark_data_smithi188_173515_object94479:head# 2024-04-01T20:04:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efe10514:::benchmark_data_smithi188_173515_object72821:head# 2024-04-01T20:04:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efe10a82:::benchmark_data_smithi188_173515_object139738:head# 2024-04-01T20:04:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efe13b1b:::benchmark_data_smithi188_173515_object103694:head# 2024-04-01T20:04:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efe141d8:::benchmark_data_smithi188_173515_object137525:head# 2024-04-01T20:04:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efe51408:::benchmark_data_smithi188_173515_object80294:head# 2024-04-01T20:04:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efe6418b:::benchmark_data_smithi188_173515_object153982:head# 2024-04-01T20:04:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efe7e306:::benchmark_data_smithi188_173515_object54383:head# 2024-04-01T20:04:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efe88f72:::benchmark_data_smithi188_173515_object116171:head# 2024-04-01T20:04:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efe9d9f4:::benchmark_data_smithi188_173515_object108119:head# 2024-04-01T20:04:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efea36ce:::benchmark_data_smithi188_173515_object103878:head# 2024-04-01T20:04:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efeaa8f6:::benchmark_data_smithi188_173515_object48878:head# 2024-04-01T20:04:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efebe864:::benchmark_data_smithi188_173515_object152126:head# 2024-04-01T20:04:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efec12b1:::benchmark_data_smithi188_173515_object140451:head# 2024-04-01T20:04:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efec4c70:::benchmark_data_smithi188_173515_object98243:head# 2024-04-01T20:04:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efed083b:::benchmark_data_smithi188_173515_object146182:head# 2024-04-01T20:04:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efede302:::benchmark_data_smithi188_173515_object107925:head# 2024-04-01T20:04:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efee048b:::benchmark_data_smithi188_173515_object86033:head# 2024-04-01T20:04:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efee1b80:::benchmark_data_smithi188_173515_object54884:head# 2024-04-01T20:04:42.567 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efeef9d1:::benchmark_data_smithi188_173515_object62233:head# 2024-04-01T20:04:42.567 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efef8a2e:::benchmark_data_smithi188_173515_object90119:head# 2024-04-01T20:04:42.567 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efefc5ba:::benchmark_data_smithi188_173515_object99477:head# 2024-04-01T20:04:42.567 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eff12ae7:::benchmark_data_smithi188_173515_object152077:head# 2024-04-01T20:04:42.567 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eff16ace:::benchmark_data_smithi188_173515_object148522:head# 2024-04-01T20:04:42.567 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eff2a7e1:::benchmark_data_smithi188_173515_object77185:head# 2024-04-01T20:04:42.567 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eff366c9:::benchmark_data_smithi188_173515_object59576:head# 2024-04-01T20:04:42.567 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eff4502a:::benchmark_data_smithi188_173515_object101825:head# 2024-04-01T20:04:42.567 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eff4e74e:::benchmark_data_smithi188_173515_object83122:head# 2024-04-01T20:04:42.567 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eff51961:::benchmark_data_smithi188_173515_object122570:head# 2024-04-01T20:04:42.567 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eff5921a:::benchmark_data_smithi188_173515_object144446:head# 2024-04-01T20:04:42.567 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eff5ad46:::benchmark_data_smithi188_173515_object62024:head# 2024-04-01T20:04:42.568 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eff651fd:::benchmark_data_smithi188_173515_object117330:head# 2024-04-01T20:04:42.568 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eff6e8ad:::benchmark_data_smithi188_173515_object46106:head# 2024-04-01T20:04:42.568 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eff8ba90:::benchmark_data_smithi188_173515_object149457:head# 2024-04-01T20:04:42.568 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eff9292c:::benchmark_data_smithi188_173515_object88736:head# 2024-04-01T20:04:42.568 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:eff935ca:::benchmark_data_smithi188_173515_object80123:head# 2024-04-01T20:04:42.568 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:effa37d5:::benchmark_data_smithi188_173515_object153635:head# 2024-04-01T20:04:42.568 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:effa5ac6:::benchmark_data_smithi188_173515_object103015:head# 2024-04-01T20:04:42.568 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:effa6012:::benchmark_data_smithi188_173515_object107983:head# 2024-04-01T20:04:42.568 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:effa79e8:::benchmark_data_smithi188_173515_object70175:head# 2024-04-01T20:04:42.568 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:effb07d2:::benchmark_data_smithi188_173515_object52743:head# 2024-04-01T20:04:42.568 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:effbbd7e:::benchmark_data_smithi188_173515_object74738:head# 2024-04-01T20:04:42.568 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:effc0a07:::benchmark_data_smithi188_173515_object152395:head# 2024-04-01T20:04:42.569 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:effcc926:::benchmark_data_smithi188_173515_object88203:head# 2024-04-01T20:04:42.569 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:effe3783:::benchmark_data_smithi188_173515_object122861:head# 2024-04-01T20:04:42.569 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:effe5dc0:::benchmark_data_smithi188_173515_object111409:head# 2024-04-01T20:04:42.569 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:effe836f:::benchmark_data_smithi188_173515_object91089:head# 2024-04-01T20:04:42.569 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efff30cc:::benchmark_data_smithi188_173515_object53114:head# 2024-04-01T20:04:42.569 INFO:teuthology.orchestra.run.smithi022.stderr:Read #9:efff5d52:::benchmark_data_smithi188_173515_object137935:head# 2024-04-01T20:04:42.569 INFO:teuthology.orchestra.run.smithi022.stderr:Export successful 2024-04-01T20:04:42.761 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:42 smithi062 ceph-mon[44211]: pgmap v2278: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:42.810 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.7 dump_historic_ops 2024-04-01T20:04:42.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:42 smithi022 ceph-mon[39439]: pgmap v2278: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:42.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:42 smithi188 ceph-mon[43939]: pgmap v2278: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:43.085 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T20:04:43.793 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -n osd.3 --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-3 --journal-path /var/lib/ceph/osd/ceph-3/journal --force --op remove --pgid 9.7 2024-04-01T20:04:44.017 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/osd.3/config 2024-04-01T20:04:44.657 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:44 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:04:44.657 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:44 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:04:44.657 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:44 smithi062 ceph-mon[44211]: pgmap v2279: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:44.657 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:44 smithi062 ceph-mon[44211]: osdmap e844: 12 total, 11 up, 9 in 2024-04-01T20:04:44.834 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:44 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:04:44.835 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:44 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:04:44.835 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:44 smithi022 ceph-mon[39439]: pgmap v2279: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:44.835 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:44 smithi022 ceph-mon[39439]: osdmap e844: 12 total, 11 up, 9 in 2024-04-01T20:04:44.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:44 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:04:44.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:44 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:04:44.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:44 smithi188 ceph-mon[43939]: pgmap v2279: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:44.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:44 smithi188 ceph-mon[43939]: osdmap e844: 12 total, 11 up, 9 in 2024-04-01T20:04:44.915 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T20:04:44.915 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:04:45.254 INFO:teuthology.orchestra.run.smithi022.stderr:Creating an OSD daemon form without an OSD FSID value 2024-04-01T20:04:45.806 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_ops_in_flight 2024-04-01T20:04:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: marking collection for removal 2024-04-01T20:04:45.926 INFO:teuthology.orchestra.run.smithi022.stdout:setting '_remove' omap key 2024-04-01T20:04:45.926 INFO:teuthology.orchestra.run.smithi022.stdout:finish_remove_pgs 9.7_head removing 9.7 2024-04-01T20:04:45.979 INFO:teuthology.orchestra.run.smithi022.stdout:Remove successful 2024-04-01T20:04:46.081 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T20:04:46.619 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:46 smithi188 ceph-mon[43939]: pgmap v2281: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:46.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:46 smithi062 ceph-mon[44211]: pgmap v2281: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:46.860 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:46 smithi022 ceph-mon[39439]: pgmap v2281: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:47.191 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell -n osd.3 --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-3 --journal-path /var/lib/ceph/osd/ceph-3/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.9.7.3 2024-04-01T20:04:47.415 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/osd.3/config 2024-04-01T20:04:47.837 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T20:04:47.837 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:04:48.509 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_blocked_ops 2024-04-01T20:04:48.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:48 smithi062 ceph-mon[44211]: pgmap v2282: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:48.770 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T20:04:48.781 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:48 smithi022 ceph-mon[39439]: pgmap v2282: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:48.828 INFO:teuthology.orchestra.run.smithi022.stderr:Creating an OSD daemon form without an OSD FSID value 2024-04-01T20:04:48.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:48 smithi188 ceph-mon[43939]: pgmap v2282: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:49.572 INFO:teuthology.orchestra.run.smithi022.stdout:get_pg_num_history pg_num_history pg_num_history(e832 pg_nums {1={14=1},9={735=16}} deleted_pools ) 2024-04-01T20:04:49.572 INFO:teuthology.orchestra.run.smithi022.stdout:Importing pgid 9.7 2024-04-01T20:04:49.602 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e81cd023:::benchmark_data_smithi188_173515_object69857:head# 2024-04-01T20:04:49.602 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.616 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e81ce25d:::benchmark_data_smithi188_173515_object133656:head# 2024-04-01T20:04:49.616 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.617 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e81e2124:::benchmark_data_smithi188_173515_object118168:head# 2024-04-01T20:04:49.617 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.617 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e81ea9c4:::benchmark_data_smithi188_173515_object152434:head# 2024-04-01T20:04:49.617 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.618 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e81f2df8:::benchmark_data_smithi188_173515_object46630:head# 2024-04-01T20:04:49.618 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.618 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8208d4e:::benchmark_data_smithi188_173515_object127423:head# 2024-04-01T20:04:49.618 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.619 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e820b478:::benchmark_data_smithi188_173515_object156005:head# 2024-04-01T20:04:49.619 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.619 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e821153e:::benchmark_data_smithi188_173515_object155315:head# 2024-04-01T20:04:49.619 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.619 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e821fdc1:::benchmark_data_smithi188_173515_object91577:head# 2024-04-01T20:04:49.619 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.620 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8228073:::benchmark_data_smithi188_173515_object129916:head# 2024-04-01T20:04:49.620 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.620 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e82338e9:::benchmark_data_smithi188_173515_object53231:head# 2024-04-01T20:04:49.620 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.620 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8241ad4:::benchmark_data_smithi188_173515_object51163:head# 2024-04-01T20:04:49.620 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.622 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8245e69:::benchmark_data_smithi188_173515_object46869:head# 2024-04-01T20:04:49.622 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.623 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e824acc4:::benchmark_data_smithi188_173515_object141174:head# 2024-04-01T20:04:49.623 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.623 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e825912f:::benchmark_data_smithi188_173515_object51661:head# 2024-04-01T20:04:49.623 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.623 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e82646eb:::benchmark_data_smithi188_173515_object84776:head# 2024-04-01T20:04:49.623 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.623 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e82728e1:::benchmark_data_smithi188_173515_object53405:head# 2024-04-01T20:04:49.623 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.623 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8272af6:::benchmark_data_smithi188_173515_object137424:head# 2024-04-01T20:04:49.623 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.623 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8275052:::benchmark_data_smithi188_173515_object53172:head# 2024-04-01T20:04:49.623 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.623 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8282417:::benchmark_data_smithi188_173515_object47809:head# 2024-04-01T20:04:49.623 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.623 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e828ba0b:::benchmark_data_smithi188_173515_object65249:head# 2024-04-01T20:04:49.624 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.624 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e828fa62:::benchmark_data_smithi188_173515_object110285:head# 2024-04-01T20:04:49.624 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.624 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8298b52:::benchmark_data_smithi188_173515_object118818:head# 2024-04-01T20:04:49.624 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.624 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e82a418f:::benchmark_data_smithi188_173515_object155526:head# 2024-04-01T20:04:49.624 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.628 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e82b4acf:::benchmark_data_smithi188_173515_object89419:head# 2024-04-01T20:04:49.628 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.628 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e82bc72f:::benchmark_data_smithi188_173515_object99950:head# 2024-04-01T20:04:49.628 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.628 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e82c57a8:::benchmark_data_smithi188_173515_object138933:head# 2024-04-01T20:04:49.628 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.628 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e82c83cc:::benchmark_data_smithi188_173515_object124867:head# 2024-04-01T20:04:49.628 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.628 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e82c9744:::benchmark_data_smithi188_173515_object151101:head# 2024-04-01T20:04:49.628 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.628 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e82d63a7:::benchmark_data_smithi188_173515_object155030:head# 2024-04-01T20:04:49.628 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.628 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e82e6d48:::benchmark_data_smithi188_173515_object140039:head# 2024-04-01T20:04:49.628 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.629 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e82f17b5:::benchmark_data_smithi188_173515_object46509:head# 2024-04-01T20:04:49.629 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.629 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e82fe115:::benchmark_data_smithi188_173515_object109221:head# 2024-04-01T20:04:49.629 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.629 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8305f07:::benchmark_data_smithi188_173515_object117240:head# 2024-04-01T20:04:49.629 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.629 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e830b605:::benchmark_data_smithi188_173515_object128513:head# 2024-04-01T20:04:49.629 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.629 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e831f728:::benchmark_data_smithi188_173515_object63187:head# 2024-04-01T20:04:49.629 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.629 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e833330c:::benchmark_data_smithi188_173515_object90389:head# 2024-04-01T20:04:49.629 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.629 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e833489c:::benchmark_data_smithi188_173515_object92610:head# 2024-04-01T20:04:49.629 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.629 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e83535ed:::benchmark_data_smithi188_173515_object111762:head# 2024-04-01T20:04:49.629 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.630 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8354c78:::benchmark_data_smithi188_173515_object92569:head# 2024-04-01T20:04:49.630 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.630 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e835eab4:::benchmark_data_smithi188_173515_object62593:head# 2024-04-01T20:04:49.630 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.630 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e836e2e1:::benchmark_data_smithi188_173515_object143715:head# 2024-04-01T20:04:49.630 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.630 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8372d7c:::benchmark_data_smithi188_173515_object144847:head# 2024-04-01T20:04:49.630 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.642 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e83777e1:::benchmark_data_smithi188_173515_object68936:head# 2024-04-01T20:04:49.642 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.642 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e838892d:::benchmark_data_smithi188_173515_object116638:head# 2024-04-01T20:04:49.642 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.642 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e838c91a:::benchmark_data_smithi188_173515_object77124:head# 2024-04-01T20:04:49.642 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.642 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e839458c:::benchmark_data_smithi188_173515_object154010:head# 2024-04-01T20:04:49.643 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.643 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e839550c:::benchmark_data_smithi188_173515_object63329:head# 2024-04-01T20:04:49.643 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.643 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e839ecb6:::benchmark_data_smithi188_173515_object122573:head# 2024-04-01T20:04:49.643 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.643 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e83a9f33:::benchmark_data_smithi188_173515_object66888:head# 2024-04-01T20:04:49.643 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.643 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e83b79d2:::benchmark_data_smithi188_173515_object118884:head# 2024-04-01T20:04:49.643 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.643 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e83b847d:::benchmark_data_smithi188_173515_object87899:head# 2024-04-01T20:04:49.643 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.643 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e83c7d89:::benchmark_data_smithi188_173515_object86654:head# 2024-04-01T20:04:49.643 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.644 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e83d7a5a:::benchmark_data_smithi188_173515_object46511:head# 2024-04-01T20:04:49.644 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.644 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e83d824e:::benchmark_data_smithi188_173515_object136959:head# 2024-04-01T20:04:49.644 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.644 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e83d9cf1:::benchmark_data_smithi188_173515_object132037:head# 2024-04-01T20:04:49.644 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.644 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e83dc310:::benchmark_data_smithi188_173515_object118147:head# 2024-04-01T20:04:49.644 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.644 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e83e1811:::benchmark_data_smithi188_173515_object90048:head# 2024-04-01T20:04:49.644 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.644 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e83ea58d:::benchmark_data_smithi188_173515_object57180:head# 2024-04-01T20:04:49.644 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.644 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e83f66fb:::benchmark_data_smithi188_173515_object81812:head# 2024-04-01T20:04:49.644 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.644 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e83f6d6e:::benchmark_data_smithi188_173515_object148417:head# 2024-04-01T20:04:49.645 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.645 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e83f99b4:::benchmark_data_smithi188_173515_object80706:head# 2024-04-01T20:04:49.645 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.645 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e83fbc6c:::benchmark_data_smithi188_173515_object115790:head# 2024-04-01T20:04:49.645 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.645 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e83fbcbe:::benchmark_data_smithi188_173515_object78062:head# 2024-04-01T20:04:49.645 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.645 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8402193:::benchmark_data_smithi188_173515_object120473:head# 2024-04-01T20:04:49.645 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.645 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8408770:::benchmark_data_smithi188_173515_object140438:head# 2024-04-01T20:04:49.645 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.645 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8414249:::benchmark_data_smithi188_173515_object50708:head# 2024-04-01T20:04:49.645 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.645 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8416ee2:::benchmark_data_smithi188_173515_object118615:head# 2024-04-01T20:04:49.646 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.646 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e841aa18:::benchmark_data_smithi188_173515_object76351:head# 2024-04-01T20:04:49.646 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.646 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e841b314:::benchmark_data_smithi188_173515_object56710:head# 2024-04-01T20:04:49.646 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.646 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e841ecac:::benchmark_data_smithi188_173515_object48040:head# 2024-04-01T20:04:49.646 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.646 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e841f822:::benchmark_data_smithi188_173515_object114519:head# 2024-04-01T20:04:49.646 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.646 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e842b9c4:::benchmark_data_smithi188_173515_object59147:head# 2024-04-01T20:04:49.646 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.646 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e843bfa1:::benchmark_data_smithi188_173515_object127419:head# 2024-04-01T20:04:49.646 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.647 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e843dfb7:::benchmark_data_smithi188_173515_object115979:head# 2024-04-01T20:04:49.647 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.647 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e84403f5:::benchmark_data_smithi188_173515_object93639:head# 2024-04-01T20:04:49.647 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.647 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e844c539:::benchmark_data_smithi188_173515_object97742:head# 2024-04-01T20:04:49.647 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.647 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e844d3a3:::benchmark_data_smithi188_173515_object148134:head# 2024-04-01T20:04:49.647 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.647 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e84554af:::benchmark_data_smithi188_173515_object154798:head# 2024-04-01T20:04:49.647 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.647 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e845e393:::benchmark_data_smithi188_173515_object138863:head# 2024-04-01T20:04:49.647 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.647 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e846200e:::benchmark_data_smithi188_173515_object106065:head# 2024-04-01T20:04:49.647 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.647 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e84633b8:::benchmark_data_smithi188_173515_object132356:head# 2024-04-01T20:04:49.648 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.648 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8479e9c:::benchmark_data_smithi188_173515_object140430:head# 2024-04-01T20:04:49.648 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.648 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e847d248:::benchmark_data_smithi188_173515_object141271:head# 2024-04-01T20:04:49.648 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.648 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e849a07b:::benchmark_data_smithi188_173515_object53066:head# 2024-04-01T20:04:49.648 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.648 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e849d983:::benchmark_data_smithi188_173515_object129934:head# 2024-04-01T20:04:49.648 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.648 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e84a09cc:::benchmark_data_smithi188_173515_object69518:head# 2024-04-01T20:04:49.648 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.648 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e84af557:::benchmark_data_smithi188_173515_object77355:head# 2024-04-01T20:04:49.648 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.648 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e84bee75:::benchmark_data_smithi188_173515_object57246:head# 2024-04-01T20:04:49.649 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.649 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e84bf397:::benchmark_data_smithi188_173515_object66227:head# 2024-04-01T20:04:49.649 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.649 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e84e4260:::benchmark_data_smithi188_173515_object48782:head# 2024-04-01T20:04:49.649 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.649 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e84f7cde:::benchmark_data_smithi188_173515_object65067:head# 2024-04-01T20:04:49.649 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.649 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8500e62:::benchmark_data_smithi188_173515_object55638:head# 2024-04-01T20:04:49.649 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.649 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8502b8c:::benchmark_data_smithi188_173515_object149692:head# 2024-04-01T20:04:49.649 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.649 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e85066ad:::benchmark_data_smithi188_173515_object51247:head# 2024-04-01T20:04:49.649 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.649 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e850934f:::benchmark_data_smithi188_173515_object82942:head# 2024-04-01T20:04:49.650 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.650 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e851e64a:::benchmark_data_smithi188_173515_object75061:head# 2024-04-01T20:04:49.650 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.668 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8523fd9:::benchmark_data_smithi188_173515_object134639:head# 2024-04-01T20:04:49.668 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.668 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e852df2d:::benchmark_data_smithi188_173515_object50482:head# 2024-04-01T20:04:49.668 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.668 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e853efaf:::benchmark_data_smithi188_173515_object146527:head# 2024-04-01T20:04:49.668 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.668 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8558a34:::benchmark_data_smithi188_173515_object49662:head# 2024-04-01T20:04:49.668 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.668 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8568f85:::benchmark_data_smithi188_173515_object76750:head# 2024-04-01T20:04:49.668 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.668 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e856958d:::benchmark_data_smithi188_173515_object86500:head# 2024-04-01T20:04:49.668 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.669 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e856bec5:::benchmark_data_smithi188_173515_object151580:head# 2024-04-01T20:04:49.669 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.669 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8572d8f:::benchmark_data_smithi188_173515_object108774:head# 2024-04-01T20:04:49.669 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.669 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e85802dc:::benchmark_data_smithi188_173515_object111469:head# 2024-04-01T20:04:49.669 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.669 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e85b16c5:::benchmark_data_smithi188_173515_object123132:head# 2024-04-01T20:04:49.669 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.669 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e85b29ff:::benchmark_data_smithi188_173515_object76340:head# 2024-04-01T20:04:49.669 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.669 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e85c0fd3:::benchmark_data_smithi188_173515_object147313:head# 2024-04-01T20:04:49.669 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.669 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e85c1233:::benchmark_data_smithi188_173515_object155287:head# 2024-04-01T20:04:49.670 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.670 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e85ca5b4:::benchmark_data_smithi188_173515_object150541:head# 2024-04-01T20:04:49.670 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.670 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e85cd94e:::benchmark_data_smithi188_173515_object75803:head# 2024-04-01T20:04:49.670 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.670 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e85d1d59:::benchmark_data_smithi188_173515_object143098:head# 2024-04-01T20:04:49.670 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.670 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e85e0474:::benchmark_data_smithi188_173515_object75872:head# 2024-04-01T20:04:49.670 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.670 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e85e5c28:::benchmark_data_smithi188_173515_object79128:head# 2024-04-01T20:04:49.670 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.670 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e85e7ac3:::benchmark_data_smithi188_173515_object120112:head# 2024-04-01T20:04:49.670 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.671 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e85eb326:::benchmark_data_smithi188_173515_object88045:head# 2024-04-01T20:04:49.671 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.671 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e85fc5f2:::benchmark_data_smithi188_173515_object46853:head# 2024-04-01T20:04:49.671 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.671 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e860ec8f:::benchmark_data_smithi188_173515_object149028:head# 2024-04-01T20:04:49.671 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.671 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e86153f7:::benchmark_data_smithi188_173515_object56026:head# 2024-04-01T20:04:49.671 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.671 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e861864f:::benchmark_data_smithi188_173515_object108238:head# 2024-04-01T20:04:49.671 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.671 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e863b746:::benchmark_data_smithi188_173515_object145173:head# 2024-04-01T20:04:49.671 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.671 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e863c3c3:::benchmark_data_smithi188_173515_object92241:head# 2024-04-01T20:04:49.672 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.672 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8646787:::benchmark_data_smithi188_173515_object48407:head# 2024-04-01T20:04:49.672 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.672 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e864c0e2:::benchmark_data_smithi188_173515_object127642:head# 2024-04-01T20:04:49.672 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.672 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e865308f:::benchmark_data_smithi188_173515_object119554:head# 2024-04-01T20:04:49.672 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.672 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e86569da:::benchmark_data_smithi188_173515_object63179:head# 2024-04-01T20:04:49.672 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.672 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8657b32:::benchmark_data_smithi188_173515_object77425:head# 2024-04-01T20:04:49.672 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.672 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e866e684:::benchmark_data_smithi188_173515_object113576:head# 2024-04-01T20:04:49.672 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.673 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8688117:::benchmark_data_smithi188_173515_object115255:head# 2024-04-01T20:04:49.673 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.673 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e868d4d8:::benchmark_data_smithi188_173515_object75189:head# 2024-04-01T20:04:49.673 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.673 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e86aec1c:::benchmark_data_smithi188_173515_object87514:head# 2024-04-01T20:04:49.673 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.673 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e86bb063:::benchmark_data_smithi188_173515_object126625:head# 2024-04-01T20:04:49.673 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.673 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e86bc1c0:::benchmark_data_smithi188_173515_object96399:head# 2024-04-01T20:04:49.673 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.673 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e86c18df:::benchmark_data_smithi188_173515_object83116:head# 2024-04-01T20:04:49.673 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.673 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e86eaed2:::benchmark_data_smithi188_173515_object147295:head# 2024-04-01T20:04:49.674 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.674 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e86f95fa:::benchmark_data_smithi188_173515_object69574:head# 2024-04-01T20:04:49.674 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.674 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e86fcc24:::benchmark_data_smithi188_173515_object91621:head# 2024-04-01T20:04:49.674 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.674 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8701a3b:::benchmark_data_smithi188_173515_object80321:head# 2024-04-01T20:04:49.674 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.674 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e870f7e5:::benchmark_data_smithi188_173515_object52371:head# 2024-04-01T20:04:49.674 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.674 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e871a5b4:::benchmark_data_smithi188_173515_object128630:head# 2024-04-01T20:04:49.674 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.674 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8728d9d:::benchmark_data_smithi188_173515_object118034:head# 2024-04-01T20:04:49.674 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.675 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e872c48e:::benchmark_data_smithi188_173515_object107387:head# 2024-04-01T20:04:49.675 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.675 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8751664:::benchmark_data_smithi188_173515_object76360:head# 2024-04-01T20:04:49.675 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.675 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e879d75e:::benchmark_data_smithi188_173515_object141587:head# 2024-04-01T20:04:49.675 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.675 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e87a178d:::benchmark_data_smithi188_173515_object151102:head# 2024-04-01T20:04:49.675 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.675 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e87a21aa:::benchmark_data_smithi188_173515_object68327:head# 2024-04-01T20:04:49.675 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.675 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e87a4f94:::benchmark_data_smithi188_173515_object109554:head# 2024-04-01T20:04:49.675 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.675 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e87b12af:::benchmark_data_smithi188_173515_object72099:head# 2024-04-01T20:04:49.675 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.675 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e87c5e0e:::benchmark_data_smithi188_173515_object109242:head# 2024-04-01T20:04:49.676 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.676 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e87c6157:::benchmark_data_smithi188_173515_object53474:head# 2024-04-01T20:04:49.676 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.676 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e87ce06a:::benchmark_data_smithi188_173515_object121672:head# 2024-04-01T20:04:49.676 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.676 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e87d915e:::benchmark_data_smithi188_173515_object96832:head# 2024-04-01T20:04:49.676 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.676 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e87daf3a:::benchmark_data_smithi188_173515_object131591:head# 2024-04-01T20:04:49.676 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.676 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e87ec3ac:::benchmark_data_smithi188_173515_object113990:head# 2024-04-01T20:04:49.676 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.676 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e87ed3d2:::benchmark_data_smithi188_173515_object100687:head# 2024-04-01T20:04:49.676 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.676 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e87ff2ff:::benchmark_data_smithi188_173515_object108495:head# 2024-04-01T20:04:49.677 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.677 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e881230a:::benchmark_data_smithi188_173515_object114105:head# 2024-04-01T20:04:49.677 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.677 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8820760:::benchmark_data_smithi188_173515_object145602:head# 2024-04-01T20:04:49.677 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.677 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8823b66:::benchmark_data_smithi188_173515_object72134:head# 2024-04-01T20:04:49.677 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.677 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e882cc4a:::benchmark_data_smithi188_173515_object72054:head# 2024-04-01T20:04:49.677 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.677 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8836446:::benchmark_data_smithi188_173515_object59956:head# 2024-04-01T20:04:49.677 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.677 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e884e914:::benchmark_data_smithi188_173515_object90748:head# 2024-04-01T20:04:49.677 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.677 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e885d18f:::benchmark_data_smithi188_173515_object81410:head# 2024-04-01T20:04:49.678 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.678 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8868827:::benchmark_data_smithi188_173515_object102699:head# 2024-04-01T20:04:49.678 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.678 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e886a1d8:::benchmark_data_smithi188_173515_object129317:head# 2024-04-01T20:04:49.678 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.678 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e887b852:::benchmark_data_smithi188_173515_object49486:head# 2024-04-01T20:04:49.678 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.678 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e887dd46:::benchmark_data_smithi188_173515_object115862:head# 2024-04-01T20:04:49.678 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.678 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e888aa44:::benchmark_data_smithi188_173515_object147266:head# 2024-04-01T20:04:49.678 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.678 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e88d0aa6:::benchmark_data_smithi188_173515_object152990:head# 2024-04-01T20:04:49.678 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.679 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e88d10b2:::benchmark_data_smithi188_173515_object80118:head# 2024-04-01T20:04:49.679 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.679 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e88d1fb3:::benchmark_data_smithi188_173515_object152841:head# 2024-04-01T20:04:49.679 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.679 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e88f0a29:::benchmark_data_smithi188_173515_object153241:head# 2024-04-01T20:04:49.679 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.679 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e88f5f3c:::benchmark_data_smithi188_173515_object121474:head# 2024-04-01T20:04:49.679 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.679 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e88f6d93:::benchmark_data_smithi188_173515_object50184:head# 2024-04-01T20:04:49.679 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.679 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e88f88eb:::benchmark_data_smithi188_173515_object81851:head# 2024-04-01T20:04:49.679 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.679 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e88f9843:::benchmark_data_smithi188_173515_object59119:head# 2024-04-01T20:04:49.679 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.680 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e88ff2e3:::benchmark_data_smithi188_173515_object107825:head# 2024-04-01T20:04:49.680 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.680 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e89130d4:::benchmark_data_smithi188_173515_object76037:head# 2024-04-01T20:04:49.680 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.680 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8930298:::benchmark_data_smithi188_173515_object122960:head# 2024-04-01T20:04:49.680 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.680 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8933e28:::benchmark_data_smithi188_173515_object126248:head# 2024-04-01T20:04:49.680 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.680 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8941fdf:::benchmark_data_smithi188_173515_object98836:head# 2024-04-01T20:04:49.680 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.680 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e89496ae:::benchmark_data_smithi188_173515_object144807:head# 2024-04-01T20:04:49.680 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.680 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e89499a5:::benchmark_data_smithi188_173515_object65292:head# 2024-04-01T20:04:49.680 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.681 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8949cfc:::benchmark_data_smithi188_173515_object128151:head# 2024-04-01T20:04:49.681 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.681 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e895e5df:::benchmark_data_smithi188_173515_object58940:head# 2024-04-01T20:04:49.681 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.681 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8970564:::benchmark_data_smithi188_173515_object120355:head# 2024-04-01T20:04:49.681 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.681 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e897e5f6:::benchmark_data_smithi188_173515_object77382:head# 2024-04-01T20:04:49.681 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.681 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e89853c3:::benchmark_data_smithi188_173515_object64989:head# 2024-04-01T20:04:49.681 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.681 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e898655a:::benchmark_data_smithi188_173515_object69449:head# 2024-04-01T20:04:49.681 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.681 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8996f6f:::benchmark_data_smithi188_173515_object76142:head# 2024-04-01T20:04:49.681 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.681 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e89b3607:::benchmark_data_smithi188_173515_object105616:head# 2024-04-01T20:04:49.682 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.682 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e89b3f0c:::benchmark_data_smithi188_173515_object68897:head# 2024-04-01T20:04:49.682 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.682 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e89c3678:::benchmark_data_smithi188_173515_object139716:head# 2024-04-01T20:04:49.682 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.682 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e89cddb5:::benchmark_data_smithi188_173515_object59487:head# 2024-04-01T20:04:49.682 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.682 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e89d628f:::benchmark_data_smithi188_173515_object52976:head# 2024-04-01T20:04:49.682 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.682 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e89db68d:::benchmark_data_smithi188_173515_object45646:head# 2024-04-01T20:04:49.682 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.682 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e89ecdbe:::benchmark_data_smithi188_173515_object82920:head# 2024-04-01T20:04:49.683 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.683 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e89ee64b:::benchmark_data_smithi188_173515_object67888:head# 2024-04-01T20:04:49.683 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.683 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e89fb5eb:::benchmark_data_smithi188_173515_object79334:head# 2024-04-01T20:04:49.683 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.683 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e89fe87a:::benchmark_data_smithi188_173515_object63114:head# 2024-04-01T20:04:49.683 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.683 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8a04387:::benchmark_data_smithi188_173515_object136980:head# 2024-04-01T20:04:49.683 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.693 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8a0b6f8:::benchmark_data_smithi188_173515_object132448:head# 2024-04-01T20:04:49.693 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.693 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8a16efe:::benchmark_data_smithi188_173515_object75720:head# 2024-04-01T20:04:49.694 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.694 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8a17b08:::benchmark_data_smithi188_173515_object98145:head# 2024-04-01T20:04:49.694 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.694 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8a1d58b:::benchmark_data_smithi188_173515_object127481:head# 2024-04-01T20:04:49.694 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.694 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8a2d694:::benchmark_data_smithi188_173515_object142970:head# 2024-04-01T20:04:49.694 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.694 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8a34c11:::benchmark_data_smithi188_173515_object143843:head# 2024-04-01T20:04:49.694 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.694 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8a3d656:::benchmark_data_smithi188_173515_object78312:head# 2024-04-01T20:04:49.694 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.694 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8a72f05:::benchmark_data_smithi188_173515_object112712:head# 2024-04-01T20:04:49.694 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.695 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8a7d00b:::benchmark_data_smithi188_173515_object94888:head# 2024-04-01T20:04:49.695 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.695 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8a7e39d:::benchmark_data_smithi188_173515_object94921:head# 2024-04-01T20:04:49.695 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.695 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8a9a77a:::benchmark_data_smithi188_173515_object147821:head# 2024-04-01T20:04:49.695 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.695 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8ab504b:::benchmark_data_smithi188_173515_object116349:head# 2024-04-01T20:04:49.695 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.695 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8ad3d01:::benchmark_data_smithi188_173515_object63358:head# 2024-04-01T20:04:49.695 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.695 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8ad48b8:::benchmark_data_smithi188_173515_object132812:head# 2024-04-01T20:04:49.695 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.695 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8ad8e17:::benchmark_data_smithi188_173515_object65406:head# 2024-04-01T20:04:49.695 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.695 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8adaf29:::benchmark_data_smithi188_173515_object120640:head# 2024-04-01T20:04:49.696 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.696 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8ae4815:::benchmark_data_smithi188_173515_object73662:head# 2024-04-01T20:04:49.696 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.696 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8ae6636:::benchmark_data_smithi188_173515_object125663:head# 2024-04-01T20:04:49.696 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.696 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8ae7892:::benchmark_data_smithi188_173515_object66586:head# 2024-04-01T20:04:49.696 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.696 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8ae85e4:::benchmark_data_smithi188_173515_object86979:head# 2024-04-01T20:04:49.696 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.696 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8b13890:::benchmark_data_smithi188_173515_object76108:head# 2024-04-01T20:04:49.696 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.696 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8b1d4eb:::benchmark_data_smithi188_173515_object129532:head# 2024-04-01T20:04:49.696 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.696 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8b22864:::benchmark_data_smithi188_173515_object82176:head# 2024-04-01T20:04:49.696 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.697 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8b3e572:::benchmark_data_smithi188_173515_object86969:head# 2024-04-01T20:04:49.697 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.697 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8b4d01d:::benchmark_data_smithi188_173515_object123593:head# 2024-04-01T20:04:49.697 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.697 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8b54d9c:::benchmark_data_smithi188_173515_object77580:head# 2024-04-01T20:04:49.697 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.697 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8b589d4:::benchmark_data_smithi188_173515_object54559:head# 2024-04-01T20:04:49.697 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.697 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8b6509e:::benchmark_data_smithi188_173515_object100283:head# 2024-04-01T20:04:49.697 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.697 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8b68c31:::benchmark_data_smithi188_173515_object48057:head# 2024-04-01T20:04:49.697 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.697 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8b6a2a8:::benchmark_data_smithi188_173515_object111498:head# 2024-04-01T20:04:49.697 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.698 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8b6b9a4:::benchmark_data_smithi188_173515_object86272:head# 2024-04-01T20:04:49.698 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.698 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8b6f76f:::benchmark_data_smithi188_173515_object147239:head# 2024-04-01T20:04:49.698 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.698 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8b78352:::benchmark_data_smithi188_173515_object65792:head# 2024-04-01T20:04:49.698 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.698 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8b7d531:::benchmark_data_smithi188_173515_object105723:head# 2024-04-01T20:04:49.698 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.698 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8b94629:::benchmark_data_smithi188_173515_object76905:head# 2024-04-01T20:04:49.698 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.698 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8b9562b:::benchmark_data_smithi188_173515_object114446:head# 2024-04-01T20:04:49.698 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.698 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8b99e81:::benchmark_data_smithi188_173515_object77183:head# 2024-04-01T20:04:49.698 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.699 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8bb20ae:::benchmark_data_smithi188_173515_object72619:head# 2024-04-01T20:04:49.699 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.699 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8bba525:::benchmark_data_smithi188_173515_object67909:head# 2024-04-01T20:04:49.699 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.699 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8bc2a1e:::benchmark_data_smithi188_173515_object130756:head# 2024-04-01T20:04:49.699 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.699 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8bdff59:::benchmark_data_smithi188_173515_object71001:head# 2024-04-01T20:04:49.699 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.699 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8be0ece:::benchmark_data_smithi188_173515_object112170:head# 2024-04-01T20:04:49.699 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.699 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8be787e:::benchmark_data_smithi188_173515_object82142:head# 2024-04-01T20:04:49.699 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.699 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8befa87:::benchmark_data_smithi188_173515_object86591:head# 2024-04-01T20:04:49.699 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.699 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8c0035f:::benchmark_data_smithi188_173515_object73913:head# 2024-04-01T20:04:49.700 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.700 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8c30e1f:::benchmark_data_smithi188_173515_object115561:head# 2024-04-01T20:04:49.700 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.700 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8c367f4:::benchmark_data_smithi188_173515_object130876:head# 2024-04-01T20:04:49.700 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.700 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8c44244:::benchmark_data_smithi188_173515_object94745:head# 2024-04-01T20:04:49.700 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.700 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8c57dee:::benchmark_data_smithi188_173515_object54862:head# 2024-04-01T20:04:49.700 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.700 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8c83573:::benchmark_data_smithi188_173515_object124416:head# 2024-04-01T20:04:49.700 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.700 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8c8440f:::benchmark_data_smithi188_173515_object117557:head# 2024-04-01T20:04:49.700 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.700 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8c88f02:::benchmark_data_smithi188_173515_object80391:head# 2024-04-01T20:04:49.700 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.700 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8c98adf:::benchmark_data_smithi188_173515_object126624:head# 2024-04-01T20:04:49.701 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.701 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8c9c98c:::benchmark_data_smithi188_173515_object61354:head# 2024-04-01T20:04:49.701 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.701 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8ca1da9:::benchmark_data_smithi188_173515_object98529:head# 2024-04-01T20:04:49.701 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.701 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8cb9cea:::benchmark_data_smithi188_173515_object48483:head# 2024-04-01T20:04:49.701 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.701 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8cd16f9:::benchmark_data_smithi188_173515_object139812:head# 2024-04-01T20:04:49.701 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.701 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8cd958a:::benchmark_data_smithi188_173515_object90559:head# 2024-04-01T20:04:49.701 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.701 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8ceba58:::benchmark_data_smithi188_173515_object96185:head# 2024-04-01T20:04:49.701 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.701 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8cec613:::benchmark_data_smithi188_173515_object93101:head# 2024-04-01T20:04:49.702 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.702 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8cf28bc:::benchmark_data_smithi188_173515_object60215:head# 2024-04-01T20:04:49.702 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.702 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8cf2dc7:::benchmark_data_smithi188_173515_object102115:head# 2024-04-01T20:04:49.702 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.702 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8cfca88:::benchmark_data_smithi188_173515_object117877:head# 2024-04-01T20:04:49.702 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.702 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8cfd57c:::benchmark_data_smithi188_173515_object151410:head# 2024-04-01T20:04:49.702 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.702 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8d0c286:::benchmark_data_smithi188_173515_object78360:head# 2024-04-01T20:04:49.702 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.702 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8d0d898:::benchmark_data_smithi188_173515_object84427:head# 2024-04-01T20:04:49.702 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.702 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8d159d3:::benchmark_data_smithi188_173515_object119585:head# 2024-04-01T20:04:49.703 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.703 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8d2d0f2:::benchmark_data_smithi188_173515_object104639:head# 2024-04-01T20:04:49.703 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.703 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8d61841:::benchmark_data_smithi188_173515_object127283:head# 2024-04-01T20:04:49.703 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.703 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8d61bb3:::benchmark_data_smithi188_173515_object91776:head# 2024-04-01T20:04:49.703 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.703 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8d6bc18:::benchmark_data_smithi188_173515_object49328:head# 2024-04-01T20:04:49.703 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.703 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8d7aab7:::benchmark_data_smithi188_173515_object144065:head# 2024-04-01T20:04:49.703 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.703 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8d93d01:::benchmark_data_smithi188_173515_object128229:head# 2024-04-01T20:04:49.703 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.703 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8d9a8b9:::benchmark_data_smithi188_173515_object152552:head# 2024-04-01T20:04:49.704 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.704 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8dad877:::benchmark_data_smithi188_173515_object85347:head# 2024-04-01T20:04:49.704 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.704 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8dc7d99:::benchmark_data_smithi188_173515_object125955:head# 2024-04-01T20:04:49.704 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.704 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8dcab32:::benchmark_data_smithi188_173515_object120820:head# 2024-04-01T20:04:49.704 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.704 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8de0d59:::benchmark_data_smithi188_173515_object61980:head# 2024-04-01T20:04:49.704 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.704 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8df0266:::benchmark_data_smithi188_173515_object144025:head# 2024-04-01T20:04:49.704 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.704 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8df8e60:::benchmark_data_smithi188_173515_object65466:head# 2024-04-01T20:04:49.704 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.704 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8dfa888:::benchmark_data_smithi188_173515_object127459:head# 2024-04-01T20:04:49.704 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.705 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8e074c5:::benchmark_data_smithi188_173515_object84944:head# 2024-04-01T20:04:49.705 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.705 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8e21fcf:::benchmark_data_smithi188_173515_object153622:head# 2024-04-01T20:04:49.705 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.705 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8e32d7c:::benchmark_data_smithi188_173515_object75138:head# 2024-04-01T20:04:49.705 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.705 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8e36d22:::benchmark_data_smithi188_173515_object97667:head# 2024-04-01T20:04:49.705 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.705 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8e3a158:::benchmark_data_smithi188_173515_object60750:head# 2024-04-01T20:04:49.705 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.705 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8e3e286:::benchmark_data_smithi188_173515_object58651:head# 2024-04-01T20:04:49.705 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.705 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8e3ed55:::benchmark_data_smithi188_173515_object128201:head# 2024-04-01T20:04:49.705 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.705 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8e409d4:::benchmark_data_smithi188_173515_object55209:head# 2024-04-01T20:04:49.705 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.706 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8e56c5f:::benchmark_data_smithi188_173515_object123178:head# 2024-04-01T20:04:49.706 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.706 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8e64ab9:::benchmark_data_smithi188_173515_object144447:head# 2024-04-01T20:04:49.706 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.706 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8e696a1:::benchmark_data_smithi188_173515_object84310:head# 2024-04-01T20:04:49.706 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.706 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8e761d5:::benchmark_data_smithi188_173515_object141459:head# 2024-04-01T20:04:49.706 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.706 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8e767df:::benchmark_data_smithi188_173515_object139688:head# 2024-04-01T20:04:49.706 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.706 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8e8f81f:::benchmark_data_smithi188_173515_object115171:head# 2024-04-01T20:04:49.706 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.706 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8e93757:::benchmark_data_smithi188_173515_object84578:head# 2024-04-01T20:04:49.706 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.707 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8ec0126:::benchmark_data_smithi188_173515_object128949:head# 2024-04-01T20:04:49.707 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.707 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8ee8de1:::benchmark_data_smithi188_173515_object89689:head# 2024-04-01T20:04:49.707 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.707 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8ef6988:::benchmark_data_smithi188_173515_object113879:head# 2024-04-01T20:04:49.707 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.707 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8efe2cf:::benchmark_data_smithi188_173515_object136988:head# 2024-04-01T20:04:49.707 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.707 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8f0ab8c:::benchmark_data_smithi188_173515_object68247:head# 2024-04-01T20:04:49.707 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.707 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8f0b492:::benchmark_data_smithi188_173515_object76116:head# 2024-04-01T20:04:49.707 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.707 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8f0cc6a:::benchmark_data_smithi188_173515_object79932:head# 2024-04-01T20:04:49.707 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.707 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8f172e4:::benchmark_data_smithi188_173515_object138166:head# 2024-04-01T20:04:49.707 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.707 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8f1b4f4:::benchmark_data_smithi188_173515_object120018:head# 2024-04-01T20:04:49.708 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.718 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8f29574:::benchmark_data_smithi188_173515_object155226:head# 2024-04-01T20:04:49.718 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.718 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8f2b5d4:::benchmark_data_smithi188_173515_object97624:head# 2024-04-01T20:04:49.718 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.718 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8f3b84c:::benchmark_data_smithi188_173515_object155225:head# 2024-04-01T20:04:49.718 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.718 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8f3c8d7:::benchmark_data_smithi188_173515_object141890:head# 2024-04-01T20:04:49.718 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.718 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8f47636:::benchmark_data_smithi188_173515_object71081:head# 2024-04-01T20:04:49.718 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.719 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8f4b585:::benchmark_data_smithi188_173515_object105819:head# 2024-04-01T20:04:49.719 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.719 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8f8dfb4:::benchmark_data_smithi188_173515_object126818:head# 2024-04-01T20:04:49.719 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.719 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8f9c3e8:::benchmark_data_smithi188_173515_object120191:head# 2024-04-01T20:04:49.719 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.719 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8fa115a:::benchmark_data_smithi188_173515_object125397:head# 2024-04-01T20:04:49.719 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.719 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8fa17c7:::benchmark_data_smithi188_173515_object143416:head# 2024-04-01T20:04:49.719 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.719 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8fa99ff:::benchmark_data_smithi188_173515_object66307:head# 2024-04-01T20:04:49.719 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.719 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8fa9a1b:::benchmark_data_smithi188_173515_object155321:head# 2024-04-01T20:04:49.719 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.719 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8fabab4:::benchmark_data_smithi188_173515_object139872:head# 2024-04-01T20:04:49.720 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.720 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8fbc20e:::benchmark_data_smithi188_173515_object81314:head# 2024-04-01T20:04:49.720 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.720 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8fc83e9:::benchmark_data_smithi188_173515_object121931:head# 2024-04-01T20:04:49.720 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.720 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8fd8114:::benchmark_data_smithi188_173515_object148721:head# 2024-04-01T20:04:49.720 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.720 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8fd9ab5:::benchmark_data_smithi188_173515_object80113:head# 2024-04-01T20:04:49.720 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.720 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8fe22da:::benchmark_data_smithi188_173515_object140544:head# 2024-04-01T20:04:49.720 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.720 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8fe2b92:::benchmark_data_smithi188_173515_object109278:head# 2024-04-01T20:04:49.720 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.720 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8ff673f:::benchmark_data_smithi188_173515_object74407:head# 2024-04-01T20:04:49.720 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.721 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e8ff93a5:::benchmark_data_smithi188_173515_object139006:head# 2024-04-01T20:04:49.721 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.721 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9000046:::benchmark_data_smithi188_173515_object74841:head# 2024-04-01T20:04:49.721 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.721 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9011749:::benchmark_data_smithi188_173515_object74499:head# 2024-04-01T20:04:49.721 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.721 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e901ceed:::benchmark_data_smithi188_173515_object52783:head# 2024-04-01T20:04:49.721 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.721 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9029192:::benchmark_data_smithi188_173515_object48972:head# 2024-04-01T20:04:49.721 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.721 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9030516:::benchmark_data_smithi188_173515_object49434:head# 2024-04-01T20:04:49.721 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.721 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e903a0be:::benchmark_data_smithi188_173515_object50987:head# 2024-04-01T20:04:49.721 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.722 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e903dcfe:::benchmark_data_smithi188_173515_object80341:head# 2024-04-01T20:04:49.722 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.722 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9042e23:::benchmark_data_smithi188_173515_object47105:head# 2024-04-01T20:04:49.722 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.722 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9049618:::benchmark_data_smithi188_173515_object124599:head# 2024-04-01T20:04:49.722 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.722 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e905f26c:::benchmark_data_smithi188_173515_object141920:head# 2024-04-01T20:04:49.722 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.722 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e90636bd:::benchmark_data_smithi188_173515_object78340:head# 2024-04-01T20:04:49.722 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.722 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e906dcbb:::benchmark_data_smithi188_173515_object149537:head# 2024-04-01T20:04:49.722 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.722 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9076cb6:::benchmark_data_smithi188_173515_object91936:head# 2024-04-01T20:04:49.722 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.723 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e908f797:::benchmark_data_smithi188_173515_object125749:head# 2024-04-01T20:04:49.723 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.723 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e90b4f07:::benchmark_data_smithi188_173515_object126835:head# 2024-04-01T20:04:49.723 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.723 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e90b8c95:::benchmark_data_smithi188_173515_object59704:head# 2024-04-01T20:04:49.723 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.723 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e90c513b:::benchmark_data_smithi188_173515_object116338:head# 2024-04-01T20:04:49.723 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.723 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e90c9253:::benchmark_data_smithi188_173515_object99365:head# 2024-04-01T20:04:49.723 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.723 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e90d8f45:::benchmark_data_smithi188_173515_object118624:head# 2024-04-01T20:04:49.723 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.723 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e90ec42a:::benchmark_data_smithi188_173515_object64312:head# 2024-04-01T20:04:49.723 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.723 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e90f204a:::benchmark_data_smithi188_173515_object97600:head# 2024-04-01T20:04:49.723 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.724 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e90f8d68:::benchmark_data_smithi188_173515_object125880:head# 2024-04-01T20:04:49.724 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.724 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e90fc6a6:::benchmark_data_smithi188_173515_object120185:head# 2024-04-01T20:04:49.724 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.724 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9106e03:::benchmark_data_smithi188_173515_object106727:head# 2024-04-01T20:04:49.724 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.724 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e91078c1:::benchmark_data_smithi188_173515_object108967:head# 2024-04-01T20:04:49.724 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.724 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e910c052:::benchmark_data_smithi188_173515_object155086:head# 2024-04-01T20:04:49.724 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.724 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9126a50:::benchmark_data_smithi188_173515_object125416:head# 2024-04-01T20:04:49.724 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.724 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e912a1f0:::benchmark_data_smithi188_173515_object57074:head# 2024-04-01T20:04:49.724 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.724 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e91343dd:::benchmark_data_smithi188_173515_object144862:head# 2024-04-01T20:04:49.725 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.725 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9154838:::benchmark_data_smithi188_173515_object52967:head# 2024-04-01T20:04:49.725 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.725 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9157918:::benchmark_data_smithi188_173515_object47049:head# 2024-04-01T20:04:49.725 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.725 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e915df78:::benchmark_data_smithi188_173515_object131674:head# 2024-04-01T20:04:49.725 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.725 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9163dbd:::benchmark_data_smithi188_173515_object104780:head# 2024-04-01T20:04:49.725 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.725 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e91655bb:::benchmark_data_smithi188_173515_object138056:head# 2024-04-01T20:04:49.725 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.725 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9166725:::benchmark_data_smithi188_173515_object89850:head# 2024-04-01T20:04:49.725 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.725 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e916a929:::benchmark_data_smithi188_173515_object88659:head# 2024-04-01T20:04:49.726 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.726 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e916b8dd:::benchmark_data_smithi188_173515_object145435:head# 2024-04-01T20:04:49.726 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.726 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9174aa0:::benchmark_data_smithi188_173515_object93348:head# 2024-04-01T20:04:49.726 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.726 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e918acfe:::benchmark_data_smithi188_173515_object110197:head# 2024-04-01T20:04:49.726 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.726 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9198500:::benchmark_data_smithi188_173515_object102979:head# 2024-04-01T20:04:49.726 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.726 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e91adc0d:::benchmark_data_smithi188_173515_object54668:head# 2024-04-01T20:04:49.726 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.726 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e91b1fab:::benchmark_data_smithi188_173515_object154914:head# 2024-04-01T20:04:49.726 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.727 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e91c0c98:::benchmark_data_smithi188_173515_object111033:head# 2024-04-01T20:04:49.727 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.727 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e91c8e3e:::benchmark_data_smithi188_173515_object73900:head# 2024-04-01T20:04:49.727 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.727 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e91cd85a:::benchmark_data_smithi188_173515_object115242:head# 2024-04-01T20:04:49.727 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.727 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e91ce596:::benchmark_data_smithi188_173515_object137799:head# 2024-04-01T20:04:49.727 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.727 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e91f5007:::benchmark_data_smithi188_173515_object111642:head# 2024-04-01T20:04:49.727 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.727 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e91fc38b:::benchmark_data_smithi188_173515_object90419:head# 2024-04-01T20:04:49.727 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.727 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e91fe6f6:::benchmark_data_smithi188_173515_object107736:head# 2024-04-01T20:04:49.727 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.727 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e920ecbf:::benchmark_data_smithi188_173515_object137972:head# 2024-04-01T20:04:49.727 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.728 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e920fec0:::benchmark_data_smithi188_173515_object138147:head# 2024-04-01T20:04:49.728 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.728 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9212f13:::benchmark_data_smithi188_173515_object97705:head# 2024-04-01T20:04:49.728 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.728 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9214932:::benchmark_data_smithi188_173515_object96075:head# 2024-04-01T20:04:49.728 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.728 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9216525:::benchmark_data_smithi188_173515_object100057:head# 2024-04-01T20:04:49.728 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.728 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9233085:::benchmark_data_smithi188_173515_object151178:head# 2024-04-01T20:04:49.728 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.728 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e924aaf3:::benchmark_data_smithi188_173515_object56752:head# 2024-04-01T20:04:49.728 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.728 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e924ab39:::benchmark_data_smithi188_173515_object151556:head# 2024-04-01T20:04:49.728 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.728 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e924c120:::benchmark_data_smithi188_173515_object70945:head# 2024-04-01T20:04:49.728 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.729 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e924e18d:::benchmark_data_smithi188_173515_object102049:head# 2024-04-01T20:04:49.729 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.729 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e924ed69:::benchmark_data_smithi188_173515_object114823:head# 2024-04-01T20:04:49.729 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.729 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e924f780:::benchmark_data_smithi188_173515_object59064:head# 2024-04-01T20:04:49.729 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.729 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e925035c:::benchmark_data_smithi188_173515_object112735:head# 2024-04-01T20:04:49.729 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.729 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9255261:::benchmark_data_smithi188_173515_object138473:head# 2024-04-01T20:04:49.729 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.729 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e925571c:::benchmark_data_smithi188_173515_object98824:head# 2024-04-01T20:04:49.729 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.729 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9256c4d:::benchmark_data_smithi188_173515_object136377:head# 2024-04-01T20:04:49.729 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.729 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9272233:::benchmark_data_smithi188_173515_object61956:head# 2024-04-01T20:04:49.729 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.730 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e927f1ca:::benchmark_data_smithi188_173515_object68730:head# 2024-04-01T20:04:49.730 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.730 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e927f8d4:::benchmark_data_smithi188_173515_object56996:head# 2024-04-01T20:04:49.730 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.730 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9285932:::benchmark_data_smithi188_173515_object71254:head# 2024-04-01T20:04:49.730 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.730 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e929d9fa:::benchmark_data_smithi188_173515_object112763:head# 2024-04-01T20:04:49.730 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.730 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e929ea6d:::benchmark_data_smithi188_173515_object100081:head# 2024-04-01T20:04:49.730 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.730 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e92aaaa8:::benchmark_data_smithi188_173515_object54492:head# 2024-04-01T20:04:49.730 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.730 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e92ba62a:::benchmark_data_smithi188_173515_object100541:head# 2024-04-01T20:04:49.730 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.730 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e92ba815:::benchmark_data_smithi188_173515_object109314:head# 2024-04-01T20:04:49.731 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.731 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e92c3971:::benchmark_data_smithi188_173515_object142130:head# 2024-04-01T20:04:49.731 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.731 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e92caf14:::benchmark_data_smithi188_173515_object123185:head# 2024-04-01T20:04:49.731 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.731 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e92cf96f:::benchmark_data_smithi188_173515_object135986:head# 2024-04-01T20:04:49.731 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.731 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e92d7880:::benchmark_data_smithi188_173515_object84405:head# 2024-04-01T20:04:49.731 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.731 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e92dca34:::benchmark_data_smithi188_173515_object126182:head# 2024-04-01T20:04:49.731 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.731 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e92e4bee:::benchmark_data_smithi188_173515_object59568:head# 2024-04-01T20:04:49.731 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.731 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e930573b:::benchmark_data_smithi188_173515_object155596:head# 2024-04-01T20:04:49.731 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.732 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9316810:::benchmark_data_smithi188_173515_object65193:head# 2024-04-01T20:04:49.732 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.732 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e931743e:::benchmark_data_smithi188_173515_object126570:head# 2024-04-01T20:04:49.732 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.732 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e93219d8:::benchmark_data_smithi188_173515_object74405:head# 2024-04-01T20:04:49.732 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.732 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e932b98d:::benchmark_data_smithi188_173515_object92061:head# 2024-04-01T20:04:49.732 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.750 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e932fd3f:::benchmark_data_smithi188_173515_object66732:head# 2024-04-01T20:04:49.750 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.750 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9335cda:::benchmark_data_smithi188_173515_object56886:head# 2024-04-01T20:04:49.750 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.750 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9337820:::benchmark_data_smithi188_173515_object136906:head# 2024-04-01T20:04:49.750 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.750 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9338d5c:::benchmark_data_smithi188_173515_object136359:head# 2024-04-01T20:04:49.750 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.750 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e933a028:::benchmark_data_smithi188_173515_object82087:head# 2024-04-01T20:04:49.751 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.751 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9347a10:::benchmark_data_smithi188_173515_object80311:head# 2024-04-01T20:04:49.751 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.751 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e935f26b:::benchmark_data_smithi188_173515_object111375:head# 2024-04-01T20:04:49.751 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.751 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e937312e:::benchmark_data_smithi188_173515_object132395:head# 2024-04-01T20:04:49.751 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.751 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9374ea3:::benchmark_data_smithi188_173515_object70132:head# 2024-04-01T20:04:49.751 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.751 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e937d3df:::benchmark_data_smithi188_173515_object113453:head# 2024-04-01T20:04:49.751 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.751 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e937f8ae:::benchmark_data_smithi188_173515_object128766:head# 2024-04-01T20:04:49.751 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.751 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e938d779:::benchmark_data_smithi188_173515_object140905:head# 2024-04-01T20:04:49.752 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.752 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9395bbd:::benchmark_data_smithi188_173515_object86677:head# 2024-04-01T20:04:49.752 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.752 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e939d230:::benchmark_data_smithi188_173515_object129472:head# 2024-04-01T20:04:49.752 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.752 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e93a4f5c:::benchmark_data_smithi188_173515_object48724:head# 2024-04-01T20:04:49.752 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.752 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e93a505d:::benchmark_data_smithi188_173515_object96661:head# 2024-04-01T20:04:49.752 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.752 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e93c370c:::benchmark_data_smithi188_173515_object152146:head# 2024-04-01T20:04:49.752 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.752 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e93c6f83:::benchmark_data_smithi188_173515_object136004:head# 2024-04-01T20:04:49.752 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.752 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e93cb2c1:::benchmark_data_smithi188_173515_object92607:head# 2024-04-01T20:04:49.753 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.753 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e93cfb3b:::benchmark_data_smithi188_173515_object153572:head# 2024-04-01T20:04:49.753 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.753 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e93f0ba5:::benchmark_data_smithi188_173515_object121124:head# 2024-04-01T20:04:49.753 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.753 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e93f0f92:::benchmark_data_smithi188_173515_object125223:head# 2024-04-01T20:04:49.753 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.753 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e93f5f86:::benchmark_data_smithi188_173515_object63732:head# 2024-04-01T20:04:49.753 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.753 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e93fb1b8:::benchmark_data_smithi188_173515_object113559:head# 2024-04-01T20:04:49.753 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.753 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e93fdc42:::benchmark_data_smithi188_173515_object140533:head# 2024-04-01T20:04:49.753 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.753 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9403779:::benchmark_data_smithi188_173515_object132818:head# 2024-04-01T20:04:49.754 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.754 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e940c16a:::benchmark_data_smithi188_173515_object56569:head# 2024-04-01T20:04:49.754 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.754 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e941db75:::benchmark_data_smithi188_173515_object55793:head# 2024-04-01T20:04:49.754 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.754 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9428752:::benchmark_data_smithi188_173515_object55659:head# 2024-04-01T20:04:49.754 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.754 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9429ade:::benchmark_data_smithi188_173515_object107867:head# 2024-04-01T20:04:49.754 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.754 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9434bdd:::benchmark_data_smithi188_173515_object134219:head# 2024-04-01T20:04:49.754 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.754 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e943881f:::benchmark_data_smithi188_173515_object104915:head# 2024-04-01T20:04:49.754 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.755 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9446bf9:::benchmark_data_smithi188_173515_object122890:head# 2024-04-01T20:04:49.755 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.755 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e944a86f:::benchmark_data_smithi188_173515_object70737:head# 2024-04-01T20:04:49.755 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.755 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e944cedc:::benchmark_data_smithi188_173515_object52086:head# 2024-04-01T20:04:49.755 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.755 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e944ed15:::benchmark_data_smithi188_173515_object122543:head# 2024-04-01T20:04:49.755 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.755 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e946dc8c:::benchmark_data_smithi188_173515_object89047:head# 2024-04-01T20:04:49.755 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.755 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e94741ad:::benchmark_data_smithi188_173515_object64608:head# 2024-04-01T20:04:49.755 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.755 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e947b12d:::benchmark_data_smithi188_173515_object132046:head# 2024-04-01T20:04:49.755 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.755 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e947bad0:::benchmark_data_smithi188_173515_object146575:head# 2024-04-01T20:04:49.756 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.756 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9480f6b:::benchmark_data_smithi188_173515_object71066:head# 2024-04-01T20:04:49.756 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.756 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e948d39a:::benchmark_data_smithi188_173515_object119260:head# 2024-04-01T20:04:49.756 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.756 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9492fc5:::benchmark_data_smithi188_173515_object115022:head# 2024-04-01T20:04:49.756 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.756 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9493d7f:::benchmark_data_smithi188_173515_object54227:head# 2024-04-01T20:04:49.756 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.756 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9498987:::benchmark_data_smithi188_173515_object81329:head# 2024-04-01T20:04:49.756 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.756 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9498bff:::benchmark_data_smithi188_173515_object127814:head# 2024-04-01T20:04:49.756 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.756 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e949f04e:::benchmark_data_smithi188_173515_object64623:head# 2024-04-01T20:04:49.756 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.757 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e94a97c6:::benchmark_data_smithi188_173515_object70926:head# 2024-04-01T20:04:49.757 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.757 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e94ad3f9:::benchmark_data_smithi188_173515_object86005:head# 2024-04-01T20:04:49.757 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.757 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e94c2c96:::benchmark_data_smithi188_173515_object75864:head# 2024-04-01T20:04:49.757 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.757 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e94d230d:::benchmark_data_smithi188_173515_object79804:head# 2024-04-01T20:04:49.757 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.757 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e94e4019:::benchmark_data_smithi188_173515_object105296:head# 2024-04-01T20:04:49.757 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.757 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e94f247b:::benchmark_data_smithi188_173515_object57363:head# 2024-04-01T20:04:49.757 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.757 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e95015bd:::benchmark_data_smithi188_173515_object98748:head# 2024-04-01T20:04:49.757 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.758 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9504139:::benchmark_data_smithi188_173515_object87007:head# 2024-04-01T20:04:49.758 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.758 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e951eda7:::benchmark_data_smithi188_173515_object109766:head# 2024-04-01T20:04:49.758 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.758 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9537dde:::benchmark_data_smithi188_173515_object64571:head# 2024-04-01T20:04:49.758 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.758 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9540a94:::benchmark_data_smithi188_173515_object150906:head# 2024-04-01T20:04:49.758 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.758 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e95589ad:::benchmark_data_smithi188_173515_object79433:head# 2024-04-01T20:04:49.758 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.758 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9558fa1:::benchmark_data_smithi188_173515_object136407:head# 2024-04-01T20:04:49.758 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.758 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e95675a9:::benchmark_data_smithi188_173515_object50373:head# 2024-04-01T20:04:49.758 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.759 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9575739:::benchmark_data_smithi188_173515_object95138:head# 2024-04-01T20:04:49.759 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.759 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e957a965:::benchmark_data_smithi188_173515_object145275:head# 2024-04-01T20:04:49.759 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.759 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9581710:::benchmark_data_smithi188_173515_object52948:head# 2024-04-01T20:04:49.759 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.759 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e95921f2:::benchmark_data_smithi188_173515_object76011:head# 2024-04-01T20:04:49.759 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.759 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e959b860:::benchmark_data_smithi188_173515_object133776:head# 2024-04-01T20:04:49.759 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.759 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e95a0550:::benchmark_data_smithi188_173515_object128852:head# 2024-04-01T20:04:49.759 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.759 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e95b1954:::benchmark_data_smithi188_173515_object95686:head# 2024-04-01T20:04:49.759 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.760 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e95b208c:::benchmark_data_smithi188_173515_object135848:head# 2024-04-01T20:04:49.760 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.760 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e95b2aee:::benchmark_data_smithi188_173515_object51748:head# 2024-04-01T20:04:49.760 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.760 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e95b4ea2:::benchmark_data_smithi188_173515_object85340:head# 2024-04-01T20:04:49.760 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.760 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e95ba8ca:::benchmark_data_smithi188_173515_object76003:head# 2024-04-01T20:04:49.760 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.760 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e95bde7a:::benchmark_data_smithi188_173515_object95955:head# 2024-04-01T20:04:49.760 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.760 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e95d1fab:::benchmark_data_smithi188_173515_object95928:head# 2024-04-01T20:04:49.760 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.760 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e95d9e46:::benchmark_data_smithi188_173515_object74354:head# 2024-04-01T20:04:49.760 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.761 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e95e2fa5:::benchmark_data_smithi188_173515_object123176:head# 2024-04-01T20:04:49.761 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.761 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e95e560d:::benchmark_data_smithi188_173515_object91764:head# 2024-04-01T20:04:49.761 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.761 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e95e7e02:::benchmark_data_smithi188_173515_object149650:head# 2024-04-01T20:04:49.761 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.761 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e95f0bc6:::benchmark_data_smithi188_173515_object95008:head# 2024-04-01T20:04:49.761 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.761 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e95f5061:::benchmark_data_smithi188_173515_object83641:head# 2024-04-01T20:04:49.761 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.761 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e95fcd53:::benchmark_data_smithi188_173515_object130438:head# 2024-04-01T20:04:49.761 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.761 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9603d83:::benchmark_data_smithi188_173515_object78605:head# 2024-04-01T20:04:49.761 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.761 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9610bd2:::benchmark_data_smithi188_173515_object49954:head# 2024-04-01T20:04:49.762 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.762 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9630225:::benchmark_data_smithi188_173515_object96474:head# 2024-04-01T20:04:49.762 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.762 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9648499:::benchmark_data_smithi188_173515_object80814:head# 2024-04-01T20:04:49.762 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.762 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e964ca51:::benchmark_data_smithi188_173515_object77853:head# 2024-04-01T20:04:49.762 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.762 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e964efe8:::benchmark_data_smithi188_173515_object99210:head# 2024-04-01T20:04:49.762 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.762 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e965ad4f:::benchmark_data_smithi188_173515_object75421:head# 2024-04-01T20:04:49.762 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.762 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e967b2b4:::benchmark_data_smithi188_173515_object144521:head# 2024-04-01T20:04:49.762 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.762 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e96899ec:::benchmark_data_smithi188_173515_object114522:head# 2024-04-01T20:04:49.763 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.763 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e969ecf9:::benchmark_data_smithi188_173515_object71629:head# 2024-04-01T20:04:49.763 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.763 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e96a18ad:::benchmark_data_smithi188_173515_object59182:head# 2024-04-01T20:04:49.763 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.763 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e96a19eb:::benchmark_data_smithi188_173515_object126246:head# 2024-04-01T20:04:49.763 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.763 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e96aa34e:::benchmark_data_smithi188_173515_object140769:head# 2024-04-01T20:04:49.763 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.763 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e96aad9a:::benchmark_data_smithi188_173515_object47082:head# 2024-04-01T20:04:49.763 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.763 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e96aba50:::benchmark_data_smithi188_173515_object136064:head# 2024-04-01T20:04:49.763 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.763 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e96b6829:::benchmark_data_smithi188_173515_object111339:head# 2024-04-01T20:04:49.763 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.764 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e96c14a0:::benchmark_data_smithi188_173515_object122699:head# 2024-04-01T20:04:49.764 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.764 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e96c4a9b:::benchmark_data_smithi188_173515_object53158:head# 2024-04-01T20:04:49.764 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.764 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e96cea27:::benchmark_data_smithi188_173515_object55556:head# 2024-04-01T20:04:49.764 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.764 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e96d5659:::benchmark_data_smithi188_173515_object145407:head# 2024-04-01T20:04:49.764 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.764 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e96e208c:::benchmark_data_smithi188_173515_object91931:head# 2024-04-01T20:04:49.764 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.764 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e96e28ec:::benchmark_data_smithi188_173515_object96946:head# 2024-04-01T20:04:49.764 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.764 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e96e4d5b:::benchmark_data_smithi188_173515_object95116:head# 2024-04-01T20:04:49.764 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.764 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e96f3e57:::benchmark_data_smithi188_173515_object66590:head# 2024-04-01T20:04:49.765 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.765 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e96f69f8:::benchmark_data_smithi188_173515_object72901:head# 2024-04-01T20:04:49.765 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.765 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e970f568:::benchmark_data_smithi188_173515_object106736:head# 2024-04-01T20:04:49.765 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.765 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e973230f:::benchmark_data_smithi188_173515_object64730:head# 2024-04-01T20:04:49.765 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.765 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e97327a4:::benchmark_data_smithi188_173515_object131829:head# 2024-04-01T20:04:49.765 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.765 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e973c1ee:::benchmark_data_smithi188_173515_object152915:head# 2024-04-01T20:04:49.765 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.765 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9745709:::benchmark_data_smithi188_173515_object137547:head# 2024-04-01T20:04:49.765 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.765 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e974d944:::benchmark_data_smithi188_173515_object140645:head# 2024-04-01T20:04:49.766 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.766 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e97590be:::benchmark_data_smithi188_173515_object123367:head# 2024-04-01T20:04:49.766 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.766 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9783749:::benchmark_data_smithi188_173515_object153210:head# 2024-04-01T20:04:49.766 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.766 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9783f4d:::benchmark_data_smithi188_173515_object118065:head# 2024-04-01T20:04:49.766 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.766 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e978d13c:::benchmark_data_smithi188_173515_object85015:head# 2024-04-01T20:04:49.766 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.766 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e978d970:::benchmark_data_smithi188_173515_object120755:head# 2024-04-01T20:04:49.766 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.766 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e979781c:::benchmark_data_smithi188_173515_object111385:head# 2024-04-01T20:04:49.766 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.766 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9797cb9:::benchmark_data_smithi188_173515_object111638:head# 2024-04-01T20:04:49.767 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.767 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e97aef4f:::benchmark_data_smithi188_173515_object108975:head# 2024-04-01T20:04:49.767 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.767 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e97b645e:::benchmark_data_smithi188_173515_object79873:head# 2024-04-01T20:04:49.767 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.767 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e97b83a5:::benchmark_data_smithi188_173515_object142965:head# 2024-04-01T20:04:49.767 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.767 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e97ba766:::benchmark_data_smithi188_173515_object93646:head# 2024-04-01T20:04:49.767 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.767 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e97cba79:::benchmark_data_smithi188_173515_object121329:head# 2024-04-01T20:04:49.767 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.767 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e97dd3c4:::benchmark_data_smithi188_173515_object117036:head# 2024-04-01T20:04:49.767 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.767 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e97e41c6:::benchmark_data_smithi188_173515_object119482:head# 2024-04-01T20:04:49.767 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.768 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e97e7563:::benchmark_data_smithi188_173515_object118115:head# 2024-04-01T20:04:49.768 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.768 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e97ea469:::benchmark_data_smithi188_173515_object117486:head# 2024-04-01T20:04:49.768 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.768 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e97ee26d:::benchmark_data_smithi188_173515_object82240:head# 2024-04-01T20:04:49.768 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.768 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e98097af:::benchmark_data_smithi188_173515_object52200:head# 2024-04-01T20:04:49.768 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.768 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e981a10a:::benchmark_data_smithi188_173515_object59305:head# 2024-04-01T20:04:49.768 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.768 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e981f29f:::benchmark_data_smithi188_173515_object88311:head# 2024-04-01T20:04:49.768 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.768 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9822fe6:::benchmark_data_smithi188_173515_object140087:head# 2024-04-01T20:04:49.768 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.769 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9829c55:::benchmark_data_smithi188_173515_object55695:head# 2024-04-01T20:04:49.769 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.769 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e984b61d:::benchmark_data_smithi188_173515_object51783:head# 2024-04-01T20:04:49.769 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.769 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9854bbc:::benchmark_data_smithi188_173515_object89676:head# 2024-04-01T20:04:49.769 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.769 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e985ccff:::benchmark_data_smithi188_173515_object139559:head# 2024-04-01T20:04:49.769 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.769 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9866337:::benchmark_data_smithi188_173515_object107293:head# 2024-04-01T20:04:49.769 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.769 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e986bdd1:::benchmark_data_smithi188_173515_object60604:head# 2024-04-01T20:04:49.769 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.769 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e986c239:::benchmark_data_smithi188_173515_object76406:head# 2024-04-01T20:04:49.769 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.801 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e986da0a:::benchmark_data_smithi188_173515_object88527:head# 2024-04-01T20:04:49.801 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.801 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e986efc9:::benchmark_data_smithi188_173515_object63641:head# 2024-04-01T20:04:49.801 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.801 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e987bc66:::benchmark_data_smithi188_173515_object155353:head# 2024-04-01T20:04:49.801 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.802 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9886f0b:::benchmark_data_smithi188_173515_object58387:head# 2024-04-01T20:04:49.802 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.802 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e989497e:::benchmark_data_smithi188_173515_object142076:head# 2024-04-01T20:04:49.802 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.802 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e98af02a:::benchmark_data_smithi188_173515_object51844:head# 2024-04-01T20:04:49.802 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.802 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e98b64ea:::benchmark_data_smithi188_173515_object50466:head# 2024-04-01T20:04:49.802 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.802 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e98c0b70:::benchmark_data_smithi188_173515_object52573:head# 2024-04-01T20:04:49.802 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.802 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e98c2414:::benchmark_data_smithi188_173515_object67857:head# 2024-04-01T20:04:49.802 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.803 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e98cade2:::benchmark_data_smithi188_173515_object88755:head# 2024-04-01T20:04:49.803 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.803 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e98cc9af:::benchmark_data_smithi188_173515_object71279:head# 2024-04-01T20:04:49.803 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.803 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e98d9330:::benchmark_data_smithi188_173515_object142007:head# 2024-04-01T20:04:49.803 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.803 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e98ee174:::benchmark_data_smithi188_173515_object86484:head# 2024-04-01T20:04:49.803 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.803 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e98ee863:::benchmark_data_smithi188_173515_object124045:head# 2024-04-01T20:04:49.803 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.803 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e98f00d4:::benchmark_data_smithi188_173515_object102719:head# 2024-04-01T20:04:49.803 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.803 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e98f1da5:::benchmark_data_smithi188_173515_object119545:head# 2024-04-01T20:04:49.803 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.803 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e98f890b:::benchmark_data_smithi188_173515_object108415:head# 2024-04-01T20:04:49.804 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.804 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e990a2a3:::benchmark_data_smithi188_173515_object84735:head# 2024-04-01T20:04:49.804 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.804 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e990e08a:::benchmark_data_smithi188_173515_object82769:head# 2024-04-01T20:04:49.804 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.804 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e992163b:::benchmark_data_smithi188_173515_object132633:head# 2024-04-01T20:04:49.804 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.804 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e992cab8:::benchmark_data_smithi188_173515_object134459:head# 2024-04-01T20:04:49.804 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.804 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e99326db:::benchmark_data_smithi188_173515_object118601:head# 2024-04-01T20:04:49.804 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.804 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e993583f:::benchmark_data_smithi188_173515_object47369:head# 2024-04-01T20:04:49.804 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.804 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9937ec7:::benchmark_data_smithi188_173515_object77558:head# 2024-04-01T20:04:49.805 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.805 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e993b79e:::benchmark_data_smithi188_173515_object83124:head# 2024-04-01T20:04:49.805 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.805 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e993fa5a:::benchmark_data_smithi188_173515_object78633:head# 2024-04-01T20:04:49.805 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.805 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e99452a4:::benchmark_data_smithi188_173515_object108543:head# 2024-04-01T20:04:49.805 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.805 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9952c8e:::benchmark_data_smithi188_173515_object84807:head# 2024-04-01T20:04:49.805 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.805 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e996b31e:::benchmark_data_smithi188_173515_object116996:head# 2024-04-01T20:04:49.805 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.805 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e996b994:::benchmark_data_smithi188_173515_object129257:head# 2024-04-01T20:04:49.805 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.805 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9971a71:::benchmark_data_smithi188_173515_object47188:head# 2024-04-01T20:04:49.805 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.806 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e99a0a45:::benchmark_data_smithi188_173515_object81469:head# 2024-04-01T20:04:49.806 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.806 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e99a4415:::benchmark_data_smithi188_173515_object120521:head# 2024-04-01T20:04:49.806 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.806 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e99ab659:::benchmark_data_smithi188_173515_object48947:head# 2024-04-01T20:04:49.806 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.806 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e99ac5ff:::benchmark_data_smithi188_173515_object115671:head# 2024-04-01T20:04:49.806 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.806 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e99ae5a4:::benchmark_data_smithi188_173515_object144594:head# 2024-04-01T20:04:49.806 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.806 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e99b1c8e:::benchmark_data_smithi188_173515_object62888:head# 2024-04-01T20:04:49.806 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.806 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e99bd903:::benchmark_data_smithi188_173515_object112774:head# 2024-04-01T20:04:49.806 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.807 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e99cb9e6:::benchmark_data_smithi188_173515_object151209:head# 2024-04-01T20:04:49.807 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.807 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e99d687a:::benchmark_data_smithi188_173515_object143650:head# 2024-04-01T20:04:49.807 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.807 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e99eced1:::benchmark_data_smithi188_173515_object150154:head# 2024-04-01T20:04:49.807 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.807 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9a0b8cb:::benchmark_data_smithi188_173515_object139086:head# 2024-04-01T20:04:49.807 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.807 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9a0f10b:::benchmark_data_smithi188_173515_object107165:head# 2024-04-01T20:04:49.807 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.807 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9a162d6:::benchmark_data_smithi188_173515_object101366:head# 2024-04-01T20:04:49.807 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.807 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9a1cb42:::benchmark_data_smithi188_173515_object128234:head# 2024-04-01T20:04:49.807 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.807 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9a36337:::benchmark_data_smithi188_173515_object69275:head# 2024-04-01T20:04:49.808 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.808 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9a37b0b:::benchmark_data_smithi188_173515_object136476:head# 2024-04-01T20:04:49.808 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.808 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9a3f7b3:::benchmark_data_smithi188_173515_object86530:head# 2024-04-01T20:04:49.808 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.808 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9a491f2:::benchmark_data_smithi188_173515_object137212:head# 2024-04-01T20:04:49.808 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.808 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9a5018c:::benchmark_data_smithi188_173515_object101692:head# 2024-04-01T20:04:49.808 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.808 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9a6e232:::benchmark_data_smithi188_173515_object107283:head# 2024-04-01T20:04:49.808 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.808 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9a7ae43:::benchmark_data_smithi188_173515_object88665:head# 2024-04-01T20:04:49.808 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.808 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9a7b582:::benchmark_data_smithi188_173515_object76894:head# 2024-04-01T20:04:49.808 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.809 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9a86910:::benchmark_data_smithi188_173515_object77774:head# 2024-04-01T20:04:49.809 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.809 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9a86bcc:::benchmark_data_smithi188_173515_object52075:head# 2024-04-01T20:04:49.809 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.809 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9a9ce21:::benchmark_data_smithi188_173515_object103597:head# 2024-04-01T20:04:49.809 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.809 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9aa98ce:::benchmark_data_smithi188_173515_object151463:head# 2024-04-01T20:04:49.809 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.809 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9aaa4a7:::benchmark_data_smithi188_173515_object70996:head# 2024-04-01T20:04:49.809 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.809 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9aab010:::benchmark_data_smithi188_173515_object100595:head# 2024-04-01T20:04:49.809 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.809 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9ac4bb3:::benchmark_data_smithi188_173515_object56178:head# 2024-04-01T20:04:49.809 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.810 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9acf5e4:::benchmark_data_smithi188_173515_object124237:head# 2024-04-01T20:04:49.810 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.810 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9ae6356:::benchmark_data_smithi188_173515_object48844:head# 2024-04-01T20:04:49.810 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.810 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9aebca0:::benchmark_data_smithi188_173515_object139823:head# 2024-04-01T20:04:49.810 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.810 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9aec6d0:::benchmark_data_smithi188_173515_object91316:head# 2024-04-01T20:04:49.810 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.810 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9af36bf:::benchmark_data_smithi188_173515_object142366:head# 2024-04-01T20:04:49.810 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.810 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9af66f3:::benchmark_data_smithi188_173515_object146918:head# 2024-04-01T20:04:49.810 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.810 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9afdb0a:::benchmark_data_smithi188_173515_object106034:head# 2024-04-01T20:04:49.810 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.811 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9b01fea:::benchmark_data_smithi188_173515_object52388:head# 2024-04-01T20:04:49.811 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.811 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9b0b354:::benchmark_data_smithi188_173515_object52524:head# 2024-04-01T20:04:49.811 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.811 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9b15816:::benchmark_data_smithi188_173515_object63985:head# 2024-04-01T20:04:49.811 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.811 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9b18c24:::benchmark_data_smithi188_173515_object125238:head# 2024-04-01T20:04:49.811 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.811 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9b19b47:::benchmark_data_smithi188_173515_object84339:head# 2024-04-01T20:04:49.811 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.811 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9b1d3d4:::benchmark_data_smithi188_173515_object102120:head# 2024-04-01T20:04:49.811 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.811 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9b3daea:::benchmark_data_smithi188_173515_object110072:head# 2024-04-01T20:04:49.811 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.811 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9b491e3:::benchmark_data_smithi188_173515_object95278:head# 2024-04-01T20:04:49.812 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.812 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9b5227b:::benchmark_data_smithi188_173515_object147314:head# 2024-04-01T20:04:49.812 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.812 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9b5ea4b:::benchmark_data_smithi188_173515_object60969:head# 2024-04-01T20:04:49.812 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.812 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9b672da:::benchmark_data_smithi188_173515_object86148:head# 2024-04-01T20:04:49.812 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.812 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9b6b565:::benchmark_data_smithi188_173515_object119490:head# 2024-04-01T20:04:49.812 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.812 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9b805c0:::benchmark_data_smithi188_173515_object127272:head# 2024-04-01T20:04:49.812 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.812 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9b81723:::benchmark_data_smithi188_173515_object101036:head# 2024-04-01T20:04:49.812 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.812 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9b97325:::benchmark_data_smithi188_173515_object72153:head# 2024-04-01T20:04:49.812 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.813 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9b9e870:::benchmark_data_smithi188_173515_object122779:head# 2024-04-01T20:04:49.813 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.813 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9ba3331:::benchmark_data_smithi188_173515_object140418:head# 2024-04-01T20:04:49.813 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.813 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9bb4b47:::benchmark_data_smithi188_173515_object52626:head# 2024-04-01T20:04:49.813 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.813 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9bc0ddb:::benchmark_data_smithi188_173515_object98473:head# 2024-04-01T20:04:49.813 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.813 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9bd701b:::benchmark_data_smithi188_173515_object68741:head# 2024-04-01T20:04:49.813 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.813 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9be3c18:::benchmark_data_smithi188_173515_object94093:head# 2024-04-01T20:04:49.813 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.813 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9becbde:::benchmark_data_smithi188_173515_object53150:head# 2024-04-01T20:04:49.813 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.814 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9bf2667:::benchmark_data_smithi188_173515_object135871:head# 2024-04-01T20:04:49.814 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.814 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9c05073:::benchmark_data_smithi188_173515_object75609:head# 2024-04-01T20:04:49.814 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.814 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9c09b3b:::benchmark_data_smithi188_173515_object81053:head# 2024-04-01T20:04:49.814 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.814 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9c0ab37:::benchmark_data_smithi188_173515_object144746:head# 2024-04-01T20:04:49.814 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.814 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9c217e9:::benchmark_data_smithi188_173515_object89830:head# 2024-04-01T20:04:49.814 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.814 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9c27467:::benchmark_data_smithi188_173515_object70795:head# 2024-04-01T20:04:49.814 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.814 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9c2acf9:::benchmark_data_smithi188_173515_object147698:head# 2024-04-01T20:04:49.815 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.815 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9c2e72f:::benchmark_data_smithi188_173515_object121325:head# 2024-04-01T20:04:49.815 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.815 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9c39bf1:::benchmark_data_smithi188_173515_object59836:head# 2024-04-01T20:04:49.815 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.815 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9c41ba2:::benchmark_data_smithi188_173515_object149965:head# 2024-04-01T20:04:49.815 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.815 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9c43771:::benchmark_data_smithi188_173515_object136919:head# 2024-04-01T20:04:49.815 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.815 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9c4a602:::benchmark_data_smithi188_173515_object150371:head# 2024-04-01T20:04:49.815 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.815 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9c54cac:::benchmark_data_smithi188_173515_object93411:head# 2024-04-01T20:04:49.815 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.815 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9c563ec:::benchmark_data_smithi188_173515_object151521:head# 2024-04-01T20:04:49.815 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.815 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9c5cde2:::benchmark_data_smithi188_173515_object46807:head# 2024-04-01T20:04:49.816 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.816 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9c63ca7:::benchmark_data_smithi188_173515_object63840:head# 2024-04-01T20:04:49.816 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.816 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9c732bf:::benchmark_data_smithi188_173515_object71243:head# 2024-04-01T20:04:49.816 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.816 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9c7489e:::benchmark_data_smithi188_173515_object117863:head# 2024-04-01T20:04:49.816 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.816 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9c796eb:::benchmark_data_smithi188_173515_object106456:head# 2024-04-01T20:04:49.816 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.816 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9c7d670:::benchmark_data_smithi188_173515_object140680:head# 2024-04-01T20:04:49.816 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.816 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9c8c718:::benchmark_data_smithi188_173515_object86107:head# 2024-04-01T20:04:49.816 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.816 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9ca012b:::benchmark_data_smithi188_173515_object145140:head# 2024-04-01T20:04:49.817 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.817 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9ca31f1:::benchmark_data_smithi188_173515_object102068:head# 2024-04-01T20:04:49.817 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.817 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9cb054e:::benchmark_data_smithi188_173515_object83987:head# 2024-04-01T20:04:49.817 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.817 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9cc6fb3:::benchmark_data_smithi188_173515_object88290:head# 2024-04-01T20:04:49.817 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.817 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9cd3a44:::benchmark_data_smithi188_173515_object68808:head# 2024-04-01T20:04:49.817 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.817 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9cdf3bb:::benchmark_data_smithi188_173515_object126121:head# 2024-04-01T20:04:49.817 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.817 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9ceaa8f:::benchmark_data_smithi188_173515_object154400:head# 2024-04-01T20:04:49.817 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.817 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9cec3db:::benchmark_data_smithi188_173515_object134684:head# 2024-04-01T20:04:49.817 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.817 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9cf5777:::benchmark_data_smithi188_173515_object134760:head# 2024-04-01T20:04:49.818 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.818 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9d0a24e:::benchmark_data_smithi188_173515_object50843:head# 2024-04-01T20:04:49.818 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.818 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9d14c79:::benchmark_data_smithi188_173515_object76528:head# 2024-04-01T20:04:49.818 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.818 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9d16e71:::benchmark_data_smithi188_173515_object107183:head# 2024-04-01T20:04:49.818 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.818 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9d172df:::benchmark_data_smithi188_173515_object139255:head# 2024-04-01T20:04:49.818 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.818 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9d20de2:::benchmark_data_smithi188_173515_object78611:head# 2024-04-01T20:04:49.818 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.818 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9d20e7a:::benchmark_data_smithi188_173515_object141390:head# 2024-04-01T20:04:49.818 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.819 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9d2355f:::benchmark_data_smithi188_173515_object63015:head# 2024-04-01T20:04:49.819 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.819 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9d29595:::benchmark_data_smithi188_173515_object48485:head# 2024-04-01T20:04:49.819 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.819 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9d2be0d:::benchmark_data_smithi188_173515_object146330:head# 2024-04-01T20:04:49.819 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.819 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9d33cf7:::benchmark_data_smithi188_173515_object65959:head# 2024-04-01T20:04:49.819 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.819 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9d359c4:::benchmark_data_smithi188_173515_object63773:head# 2024-04-01T20:04:49.819 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.819 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9d3debb:::benchmark_data_smithi188_173515_object141185:head# 2024-04-01T20:04:49.819 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.819 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9d4f7b9:::benchmark_data_smithi188_173515_object119095:head# 2024-04-01T20:04:49.819 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.819 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9d54283:::benchmark_data_smithi188_173515_object67899:head# 2024-04-01T20:04:49.819 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.820 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9d588f9:::benchmark_data_smithi188_173515_object120401:head# 2024-04-01T20:04:49.820 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.820 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9d5b00a:::benchmark_data_smithi188_173515_object149385:head# 2024-04-01T20:04:49.820 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.820 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9d5dc6f:::benchmark_data_smithi188_173515_object135070:head# 2024-04-01T20:04:49.820 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.820 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9d68d1d:::benchmark_data_smithi188_173515_object148614:head# 2024-04-01T20:04:49.820 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.820 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9d7650c:::benchmark_data_smithi188_173515_object59746:head# 2024-04-01T20:04:49.820 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.820 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9d7aad4:::benchmark_data_smithi188_173515_object116691:head# 2024-04-01T20:04:49.820 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.820 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9d87a19:::benchmark_data_smithi188_173515_object127728:head# 2024-04-01T20:04:49.820 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.820 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9d89783:::benchmark_data_smithi188_173515_object82168:head# 2024-04-01T20:04:49.821 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.821 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9d8ae78:::benchmark_data_smithi188_173515_object119431:head# 2024-04-01T20:04:49.821 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.821 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9d97444:::benchmark_data_smithi188_173515_object87572:head# 2024-04-01T20:04:49.821 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.821 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9d9d166:::benchmark_data_smithi188_173515_object103557:head# 2024-04-01T20:04:49.821 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.821 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9da94be:::benchmark_data_smithi188_173515_object86784:head# 2024-04-01T20:04:49.821 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.821 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9dacf54:::benchmark_data_smithi188_173515_object151702:head# 2024-04-01T20:04:49.821 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.821 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9daed9a:::benchmark_data_smithi188_173515_object72744:head# 2024-04-01T20:04:49.821 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.821 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9dc5f5e:::benchmark_data_smithi188_173515_object129239:head# 2024-04-01T20:04:49.821 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.821 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9df111e:::benchmark_data_smithi188_173515_object50734:head# 2024-04-01T20:04:49.822 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.822 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9df3ad1:::benchmark_data_smithi188_173515_object97263:head# 2024-04-01T20:04:49.822 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.822 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9e0bff7:::benchmark_data_smithi188_173515_object154151:head# 2024-04-01T20:04:49.822 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.822 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9e17489:::benchmark_data_smithi188_173515_object148254:head# 2024-04-01T20:04:49.822 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.822 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9e1862f:::benchmark_data_smithi188_173515_object69453:head# 2024-04-01T20:04:49.822 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.822 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9e2b5aa:::benchmark_data_smithi188_173515_object67755:head# 2024-04-01T20:04:49.822 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.822 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9e36019:::benchmark_data_smithi188_173515_object88062:head# 2024-04-01T20:04:49.823 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.823 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9e46f61:::benchmark_data_smithi188_173515_object82642:head# 2024-04-01T20:04:49.823 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.823 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9e48a75:::benchmark_data_smithi188_173515_object149521:head# 2024-04-01T20:04:49.823 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.823 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9e7cb87:::benchmark_data_smithi188_173515_object117656:head# 2024-04-01T20:04:49.823 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.823 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9e82f1f:::benchmark_data_smithi188_173515_object115932:head# 2024-04-01T20:04:49.823 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.823 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9e96785:::benchmark_data_smithi188_173515_object72083:head# 2024-04-01T20:04:49.823 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.823 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9e9bbdb:::benchmark_data_smithi188_173515_object55272:head# 2024-04-01T20:04:49.823 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.823 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9e9f847:::benchmark_data_smithi188_173515_object150362:head# 2024-04-01T20:04:49.823 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.823 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9ea089d:::benchmark_data_smithi188_173515_object109171:head# 2024-04-01T20:04:49.824 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.824 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9ea1426:::benchmark_data_smithi188_173515_object153387:head# 2024-04-01T20:04:49.824 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.824 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9ea611e:::benchmark_data_smithi188_173515_object81054:head# 2024-04-01T20:04:49.824 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.824 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9eb7572:::benchmark_data_smithi188_173515_object107434:head# 2024-04-01T20:04:49.824 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.824 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9ec5ff1:::benchmark_data_smithi188_173515_object112211:head# 2024-04-01T20:04:49.824 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.824 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9ed33cd:::benchmark_data_smithi188_173515_object137959:head# 2024-04-01T20:04:49.824 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.824 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9ed926f:::benchmark_data_smithi188_173515_object128169:head# 2024-04-01T20:04:49.824 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.824 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9ee53cd:::benchmark_data_smithi188_173515_object100338:head# 2024-04-01T20:04:49.824 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.825 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9ee64da:::benchmark_data_smithi188_173515_object86819:head# 2024-04-01T20:04:49.825 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.825 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9ee8b84:::benchmark_data_smithi188_173515_object130894:head# 2024-04-01T20:04:49.825 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.825 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9ef1ecb:::benchmark_data_smithi188_173515_object109342:head# 2024-04-01T20:04:49.825 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.825 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9ef9cab:::benchmark_data_smithi188_173515_object117323:head# 2024-04-01T20:04:49.825 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.825 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9f03d83:::benchmark_data_smithi188_173515_object87273:head# 2024-04-01T20:04:49.825 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.825 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9f0442f:::benchmark_data_smithi188_173515_object122702:head# 2024-04-01T20:04:49.825 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.825 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9f06109:::benchmark_data_smithi188_173515_object101179:head# 2024-04-01T20:04:49.825 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.825 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9f1859c:::benchmark_data_smithi188_173515_object126273:head# 2024-04-01T20:04:49.825 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.826 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9f311b5:::benchmark_data_smithi188_173515_object59723:head# 2024-04-01T20:04:49.826 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.826 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9f358f8:::benchmark_data_smithi188_173515_object69781:head# 2024-04-01T20:04:49.826 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.826 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9f586b3:::benchmark_data_smithi188_173515_object68220:head# 2024-04-01T20:04:49.826 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.826 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9f608d4:::benchmark_data_smithi188_173515_object59085:head# 2024-04-01T20:04:49.826 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.826 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9f60e31:::benchmark_data_smithi188_173515_object103959:head# 2024-04-01T20:04:49.826 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.826 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9f7f15a:::benchmark_data_smithi188_173515_object66004:head# 2024-04-01T20:04:49.826 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.826 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9f82b71:::benchmark_data_smithi188_173515_object86157:head# 2024-04-01T20:04:49.826 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.827 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9fb160b:::benchmark_data_smithi188_173515_object146922:head# 2024-04-01T20:04:49.827 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.827 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9fb38b1:::benchmark_data_smithi188_173515_object156075:head# 2024-04-01T20:04:49.827 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.827 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9fc718d:::benchmark_data_smithi188_173515_object112130:head# 2024-04-01T20:04:49.827 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.827 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9fcebe1:::benchmark_data_smithi188_173515_object144330:head# 2024-04-01T20:04:49.827 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.827 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9fd8d56:::benchmark_data_smithi188_173515_object68501:head# 2024-04-01T20:04:49.827 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.827 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9fdfe04:::benchmark_data_smithi188_173515_object67801:head# 2024-04-01T20:04:49.827 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.827 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9fe6a13:::benchmark_data_smithi188_173515_object136396:head# 2024-04-01T20:04:49.827 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.827 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9feda04:::benchmark_data_smithi188_173515_object67680:head# 2024-04-01T20:04:49.827 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.828 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:e9ff103c:::benchmark_data_smithi188_173515_object134423:head# 2024-04-01T20:04:49.828 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.828 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea005826:::benchmark_data_smithi188_173515_object65491:head# 2024-04-01T20:04:49.828 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.828 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea005d01:::benchmark_data_smithi188_173515_object62297:head# 2024-04-01T20:04:49.828 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.828 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea007dbc:::benchmark_data_smithi188_173515_object133175:head# 2024-04-01T20:04:49.828 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.828 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea00db8a:::benchmark_data_smithi188_173515_object81642:head# 2024-04-01T20:04:49.828 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.828 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea033d8e:::benchmark_data_smithi188_173515_object118284:head# 2024-04-01T20:04:49.828 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.828 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea038141:::benchmark_data_smithi188_173515_object64358:head# 2024-04-01T20:04:49.828 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.828 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea03b6ba:::benchmark_data_smithi188_173515_object99525:head# 2024-04-01T20:04:49.829 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.829 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea052227:::benchmark_data_smithi188_173515_object152444:head# 2024-04-01T20:04:49.829 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.829 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea0574f4:::benchmark_data_smithi188_173515_object117261:head# 2024-04-01T20:04:49.829 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.829 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea06109b:::benchmark_data_smithi188_173515_object143496:head# 2024-04-01T20:04:49.829 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.829 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea062cbb:::benchmark_data_smithi188_173515_object56610:head# 2024-04-01T20:04:49.829 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.829 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea0831a1:::benchmark_data_smithi188_173515_object56590:head# 2024-04-01T20:04:49.829 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.829 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea09575e:::benchmark_data_smithi188_173515_object104347:head# 2024-04-01T20:04:49.829 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.829 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea0c9f83:::benchmark_data_smithi188_173515_object97459:head# 2024-04-01T20:04:49.829 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.829 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea0dcb8e:::benchmark_data_smithi188_173515_object78330:head# 2024-04-01T20:04:49.830 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.830 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea0f7ab7:::benchmark_data_smithi188_173515_object130988:head# 2024-04-01T20:04:49.830 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.830 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea115b3d:::benchmark_data_smithi188_173515_object70248:head# 2024-04-01T20:04:49.830 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.830 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea125a3c:::benchmark_data_smithi188_173515_object120909:head# 2024-04-01T20:04:49.830 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.830 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea13867e:::benchmark_data_smithi188_173515_object70674:head# 2024-04-01T20:04:49.830 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.830 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea139eb6:::benchmark_data_smithi188_173515_object68158:head# 2024-04-01T20:04:49.830 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.830 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea13e0c3:::benchmark_data_smithi188_173515_object118413:head# 2024-04-01T20:04:49.830 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.830 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea145c00:::benchmark_data_smithi188_173515_object149764:head# 2024-04-01T20:04:49.831 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.831 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea14e82e:::benchmark_data_smithi188_173515_object145072:head# 2024-04-01T20:04:49.831 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.831 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea153532:::benchmark_data_smithi188_173515_object58725:head# 2024-04-01T20:04:49.831 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.831 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea15ba72:::benchmark_data_smithi188_173515_object78830:head# 2024-04-01T20:04:49.831 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.865 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea15dc6f:::benchmark_data_smithi188_173515_object75473:head# 2024-04-01T20:04:49.865 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.865 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea17cb08:::benchmark_data_smithi188_173515_object112628:head# 2024-04-01T20:04:49.866 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.866 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea17ee76:::benchmark_data_smithi188_173515_object65147:head# 2024-04-01T20:04:49.866 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.866 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea17f926:::benchmark_data_smithi188_173515_object80052:head# 2024-04-01T20:04:49.866 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.866 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea1837ff:::benchmark_data_smithi188_173515_object133488:head# 2024-04-01T20:04:49.866 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.866 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea188663:::benchmark_data_smithi188_173515_object112001:head# 2024-04-01T20:04:49.866 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.866 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea18e94a:::benchmark_data_smithi188_173515_object83151:head# 2024-04-01T20:04:49.866 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.866 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea1ae950:::benchmark_data_smithi188_173515_object68427:head# 2024-04-01T20:04:49.866 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.867 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea1c5b3b:::benchmark_data_smithi188_173515_object53470:head# 2024-04-01T20:04:49.867 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.867 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea1cb6ce:::benchmark_data_smithi188_173515_object74548:head# 2024-04-01T20:04:49.867 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.867 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea1ccc9b:::benchmark_data_smithi188_173515_object60192:head# 2024-04-01T20:04:49.867 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.867 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea1e1a87:::benchmark_data_smithi188_173515_object71130:head# 2024-04-01T20:04:49.867 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.867 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea1e75c9:::benchmark_data_smithi188_173515_object114726:head# 2024-04-01T20:04:49.867 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.867 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea1e7f10:::benchmark_data_smithi188_173515_object82251:head# 2024-04-01T20:04:49.867 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.867 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea1f5c43:::benchmark_data_smithi188_173515_object63149:head# 2024-04-01T20:04:49.867 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.867 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea1ff8bd:::benchmark_data_smithi188_173515_object120031:head# 2024-04-01T20:04:49.868 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.868 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea20bec2:::benchmark_data_smithi188_173515_object75315:head# 2024-04-01T20:04:49.868 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.868 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea20eeb5:::benchmark_data_smithi188_173515_object90773:head# 2024-04-01T20:04:49.868 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.868 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea21c3e0:::benchmark_data_smithi188_173515_object115917:head# 2024-04-01T20:04:49.868 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.868 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea22d9a8:::benchmark_data_smithi188_173515_object99488:head# 2024-04-01T20:04:49.868 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.868 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea22f3f3:::benchmark_data_smithi188_173515_object126745:head# 2024-04-01T20:04:49.868 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.868 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea23371d:::benchmark_data_smithi188_173515_object117915:head# 2024-04-01T20:04:49.868 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.868 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea235c41:::benchmark_data_smithi188_173515_object90606:head# 2024-04-01T20:04:49.868 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.869 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea23d088:::benchmark_data_smithi188_173515_object50216:head# 2024-04-01T20:04:49.869 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.869 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea244cc3:::benchmark_data_smithi188_173515_object47837:head# 2024-04-01T20:04:49.869 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.869 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea248da9:::benchmark_data_smithi188_173515_object104353:head# 2024-04-01T20:04:49.869 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.869 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea2498a3:::benchmark_data_smithi188_173515_object74853:head# 2024-04-01T20:04:49.869 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.869 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea25ecb9:::benchmark_data_smithi188_173515_object147054:head# 2024-04-01T20:04:49.869 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.869 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea25eced:::benchmark_data_smithi188_173515_object122583:head# 2024-04-01T20:04:49.869 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.869 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea262310:::benchmark_data_smithi188_173515_object133223:head# 2024-04-01T20:04:49.869 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.869 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea26ef1d:::benchmark_data_smithi188_173515_object62786:head# 2024-04-01T20:04:49.870 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.870 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea270f43:::benchmark_data_smithi188_173515_object126802:head# 2024-04-01T20:04:49.870 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.870 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea296bad:::benchmark_data_smithi188_173515_object109089:head# 2024-04-01T20:04:49.870 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.870 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea298c37:::benchmark_data_smithi188_173515_object45571:head# 2024-04-01T20:04:49.870 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.870 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea2a6a38:::benchmark_data_smithi188_173515_object141410:head# 2024-04-01T20:04:49.870 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.870 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea2abac5:::benchmark_data_smithi188_173515_object58056:head# 2024-04-01T20:04:49.870 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.870 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea2b6054:::benchmark_data_smithi188_173515_object64783:head# 2024-04-01T20:04:49.870 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.870 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea2bb1f5:::benchmark_data_smithi188_173515_object151368:head# 2024-04-01T20:04:49.870 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.871 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea2c4290:::benchmark_data_smithi188_173515_object139338:head# 2024-04-01T20:04:49.871 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.871 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea2f47d6:::benchmark_data_smithi188_173515_object64185:head# 2024-04-01T20:04:49.871 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.871 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea2f5f05:::benchmark_data_smithi188_173515_object104343:head# 2024-04-01T20:04:49.871 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.871 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea30d6c7:::benchmark_data_smithi188_173515_object101363:head# 2024-04-01T20:04:49.871 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.871 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea310534:::benchmark_data_smithi188_173515_object94498:head# 2024-04-01T20:04:49.871 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.871 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea3129fa:::benchmark_data_smithi188_173515_object58155:head# 2024-04-01T20:04:49.871 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.871 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea31a2d7:::benchmark_data_smithi188_173515_object62578:head# 2024-04-01T20:04:49.871 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.872 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea31a973:::benchmark_data_smithi188_173515_object63086:head# 2024-04-01T20:04:49.872 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.872 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea31aa4d:::benchmark_data_smithi188_173515_object127324:head# 2024-04-01T20:04:49.872 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.872 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea31cb07:::benchmark_data_smithi188_173515_object85406:head# 2024-04-01T20:04:49.872 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.872 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea32819b:::benchmark_data_smithi188_173515_object111558:head# 2024-04-01T20:04:49.872 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.872 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea32bbea:::benchmark_data_smithi188_173515_object76519:head# 2024-04-01T20:04:49.872 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.872 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea32c029:::benchmark_data_smithi188_173515_object74513:head# 2024-04-01T20:04:49.872 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.872 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea3357f2:::benchmark_data_smithi188_173515_object59533:head# 2024-04-01T20:04:49.872 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.872 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea33c98b:::benchmark_data_smithi188_173515_object49293:head# 2024-04-01T20:04:49.873 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.873 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea34762a:::benchmark_data_smithi188_173515_object97299:head# 2024-04-01T20:04:49.873 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.873 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea3481fc:::benchmark_data_smithi188_173515_object114326:head# 2024-04-01T20:04:49.873 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.873 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea349ebb:::benchmark_data_smithi188_173515_object88346:head# 2024-04-01T20:04:49.873 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.873 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea34e38c:::benchmark_data_smithi188_173515_object148764:head# 2024-04-01T20:04:49.873 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.873 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea359a40:::benchmark_data_smithi188_173515_object67561:head# 2024-04-01T20:04:49.873 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.873 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea35cc53:::benchmark_data_smithi188_173515_object62215:head# 2024-04-01T20:04:49.873 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.873 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea363a09:::benchmark_data_smithi188_173515_object106059:head# 2024-04-01T20:04:49.873 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.874 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea37755d:::benchmark_data_smithi188_173515_object99812:head# 2024-04-01T20:04:49.874 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.874 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea37aef7:::benchmark_data_smithi188_173515_object129742:head# 2024-04-01T20:04:49.874 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.874 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea381597:::benchmark_data_smithi188_173515_object126439:head# 2024-04-01T20:04:49.874 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.874 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea3a4117:::benchmark_data_smithi188_173515_object113931:head# 2024-04-01T20:04:49.874 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.874 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea3a7aac:::benchmark_data_smithi188_173515_object48675:head# 2024-04-01T20:04:49.874 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.874 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea3ab20a:::benchmark_data_smithi188_173515_object126257:head# 2024-04-01T20:04:49.874 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.874 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea3abfa3:::benchmark_data_smithi188_173515_object95130:head# 2024-04-01T20:04:49.874 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.874 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea3b27c7:::benchmark_data_smithi188_173515_object132598:head# 2024-04-01T20:04:49.875 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.875 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea3c54b8:::benchmark_data_smithi188_173515_object89122:head# 2024-04-01T20:04:49.875 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.875 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea3c75c3:::benchmark_data_smithi188_173515_object85244:head# 2024-04-01T20:04:49.875 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.875 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea3ce0df:::benchmark_data_smithi188_173515_object153018:head# 2024-04-01T20:04:49.875 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.875 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea3d5e3b:::benchmark_data_smithi188_173515_object59320:head# 2024-04-01T20:04:49.875 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.875 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea3df071:::benchmark_data_smithi188_173515_object143303:head# 2024-04-01T20:04:49.875 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.875 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea3e03c3:::benchmark_data_smithi188_173515_object63365:head# 2024-04-01T20:04:49.875 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.875 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea3e3309:::benchmark_data_smithi188_173515_object102338:head# 2024-04-01T20:04:49.875 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.876 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea3eaf4c:::benchmark_data_smithi188_173515_object125264:head# 2024-04-01T20:04:49.876 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.876 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea402d57:::benchmark_data_smithi188_173515_object131463:head# 2024-04-01T20:04:49.876 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.876 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea404b4d:::benchmark_data_smithi188_173515_object108149:head# 2024-04-01T20:04:49.876 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.876 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea4082c6:::benchmark_data_smithi188_173515_object105618:head# 2024-04-01T20:04:49.876 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.876 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea418abf:::benchmark_data_smithi188_173515_object84971:head# 2024-04-01T20:04:49.876 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.876 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea420764:::benchmark_data_smithi188_173515_object155671:head# 2024-04-01T20:04:49.876 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.876 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea420c83:::benchmark_data_smithi188_173515_object73195:head# 2024-04-01T20:04:49.876 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.876 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea43a299:::benchmark_data_smithi188_173515_object50870:head# 2024-04-01T20:04:49.876 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.877 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea43e08b:::benchmark_data_smithi188_173515_object151681:head# 2024-04-01T20:04:49.877 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.877 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea44866a:::benchmark_data_smithi188_173515_object143067:head# 2024-04-01T20:04:49.877 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.877 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea44e5d1:::benchmark_data_smithi188_173515_object45575:head# 2024-04-01T20:04:49.877 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.877 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea45fc5c:::benchmark_data_smithi188_173515_object55491:head# 2024-04-01T20:04:49.877 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.877 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea46fe63:::benchmark_data_smithi188_173515_object112477:head# 2024-04-01T20:04:49.877 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.877 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea46fe9b:::benchmark_data_smithi188_173515_object46117:head# 2024-04-01T20:04:49.877 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.877 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea48057d:::benchmark_data_smithi188_173515_object113888:head# 2024-04-01T20:04:49.877 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.877 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea48b157:::benchmark_data_smithi188_173515_object49714:head# 2024-04-01T20:04:49.877 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.878 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea4954ad:::benchmark_data_smithi188_173515_object51071:head# 2024-04-01T20:04:49.878 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.878 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea49b8bc:::benchmark_data_smithi188_173515_object86436:head# 2024-04-01T20:04:49.878 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.878 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea49cdb2:::benchmark_data_smithi188_173515_object62466:head# 2024-04-01T20:04:49.878 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.878 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea4bd471:::benchmark_data_smithi188_173515_object77605:head# 2024-04-01T20:04:49.878 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.878 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea4c3f25:::benchmark_data_smithi188_173515_object111274:head# 2024-04-01T20:04:49.878 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.878 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea4f3554:::benchmark_data_smithi188_173515_object94980:head# 2024-04-01T20:04:49.878 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.878 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea4f61b0:::benchmark_data_smithi188_173515_object122991:head# 2024-04-01T20:04:49.878 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.878 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea4fbe17:::benchmark_data_smithi188_173515_object153075:head# 2024-04-01T20:04:49.879 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.879 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea505dbe:::benchmark_data_smithi188_173515_object134798:head# 2024-04-01T20:04:49.879 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.879 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea508e52:::benchmark_data_smithi188_173515_object85734:head# 2024-04-01T20:04:49.879 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.879 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea514a65:::benchmark_data_smithi188_173515_object83955:head# 2024-04-01T20:04:49.879 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.879 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea52709c:::benchmark_data_smithi188_173515_object51893:head# 2024-04-01T20:04:49.879 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.879 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea534790:::benchmark_data_smithi188_173515_object47866:head# 2024-04-01T20:04:49.879 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.879 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea54b501:::benchmark_data_smithi188_173515_object72223:head# 2024-04-01T20:04:49.879 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.879 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea55542a:::benchmark_data_smithi188_173515_object137591:head# 2024-04-01T20:04:49.879 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.880 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea559be9:::benchmark_data_smithi188_173515_object83044:head# 2024-04-01T20:04:49.880 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.880 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea559c68:::benchmark_data_smithi188_173515_object57601:head# 2024-04-01T20:04:49.880 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.880 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea573d3c:::benchmark_data_smithi188_173515_object146653:head# 2024-04-01T20:04:49.880 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.880 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea5745ae:::benchmark_data_smithi188_173515_object47414:head# 2024-04-01T20:04:49.880 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.880 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea581144:::benchmark_data_smithi188_173515_object145979:head# 2024-04-01T20:04:49.880 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.880 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea589470:::benchmark_data_smithi188_173515_object151748:head# 2024-04-01T20:04:49.880 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.880 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea589635:::benchmark_data_smithi188_173515_object81653:head# 2024-04-01T20:04:49.880 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.880 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea58de7b:::benchmark_data_smithi188_173515_object113123:head# 2024-04-01T20:04:49.881 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.881 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea596de2:::benchmark_data_smithi188_173515_object49084:head# 2024-04-01T20:04:49.881 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.881 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea5bfc15:::benchmark_data_smithi188_173515_object103807:head# 2024-04-01T20:04:49.881 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.881 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea5c848e:::benchmark_data_smithi188_173515_object74380:head# 2024-04-01T20:04:49.881 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.881 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea5ca718:::benchmark_data_smithi188_173515_object143042:head# 2024-04-01T20:04:49.881 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.881 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea5ccd10:::benchmark_data_smithi188_173515_object52124:head# 2024-04-01T20:04:49.881 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.881 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea5dc7d4:::benchmark_data_smithi188_173515_object152944:head# 2024-04-01T20:04:49.881 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.881 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea5e258b:::benchmark_data_smithi188_173515_object96396:head# 2024-04-01T20:04:49.881 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.881 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea5e7b4d:::benchmark_data_smithi188_173515_object91677:head# 2024-04-01T20:04:49.882 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.882 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea5e9680:::benchmark_data_smithi188_173515_object63145:head# 2024-04-01T20:04:49.882 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.882 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea5edb94:::benchmark_data_smithi188_173515_object87199:head# 2024-04-01T20:04:49.882 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.882 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea5f79ce:::benchmark_data_smithi188_173515_object101683:head# 2024-04-01T20:04:49.882 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.882 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea5f80de:::benchmark_data_smithi188_173515_object152150:head# 2024-04-01T20:04:49.882 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.882 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea5fe8c8:::benchmark_data_smithi188_173515_object64472:head# 2024-04-01T20:04:49.882 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.882 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea612dc0:::benchmark_data_smithi188_173515_object99130:head# 2024-04-01T20:04:49.882 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.882 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea61ac5e:::benchmark_data_smithi188_173515_object64499:head# 2024-04-01T20:04:49.883 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.883 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea61f116:::benchmark_data_smithi188_173515_object94839:head# 2024-04-01T20:04:49.883 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.883 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea6330cd:::benchmark_data_smithi188_173515_object92291:head# 2024-04-01T20:04:49.883 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.883 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea63c1bf:::benchmark_data_smithi188_173515_object69030:head# 2024-04-01T20:04:49.883 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.883 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea6508bc:::benchmark_data_smithi188_173515_object46749:head# 2024-04-01T20:04:49.883 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.883 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea662af9:::benchmark_data_smithi188_173515_object56300:head# 2024-04-01T20:04:49.883 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.883 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea67366b:::benchmark_data_smithi188_173515_object48978:head# 2024-04-01T20:04:49.883 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.883 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea675fce:::benchmark_data_smithi188_173515_object131651:head# 2024-04-01T20:04:49.883 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.883 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea677f24:::benchmark_data_smithi188_173515_object111627:head# 2024-04-01T20:04:49.884 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.884 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea688227:::benchmark_data_smithi188_173515_object49966:head# 2024-04-01T20:04:49.884 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.884 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea68afb6:::benchmark_data_smithi188_173515_object153350:head# 2024-04-01T20:04:49.884 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.884 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea691ee6:::benchmark_data_smithi188_173515_object84667:head# 2024-04-01T20:04:49.884 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.884 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea6a6b44:::benchmark_data_smithi188_173515_object53649:head# 2024-04-01T20:04:49.884 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.884 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea6a8413:::benchmark_data_smithi188_173515_object151932:head# 2024-04-01T20:04:49.884 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.884 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea6a955e:::benchmark_data_smithi188_173515_object97042:head# 2024-04-01T20:04:49.884 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.884 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea6ab85f:::benchmark_data_smithi188_173515_object97027:head# 2024-04-01T20:04:49.884 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.885 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea6b32b6:::benchmark_data_smithi188_173515_object108197:head# 2024-04-01T20:04:49.885 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.885 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea6daf25:::benchmark_data_smithi188_173515_object61386:head# 2024-04-01T20:04:49.885 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.885 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea6eaf28:::benchmark_data_smithi188_173515_object97378:head# 2024-04-01T20:04:49.885 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.885 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea6eefbf:::benchmark_data_smithi188_173515_object154692:head# 2024-04-01T20:04:49.885 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.885 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea6f8640:::benchmark_data_smithi188_173515_object80602:head# 2024-04-01T20:04:49.885 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.885 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea7106b0:::benchmark_data_smithi188_173515_object153182:head# 2024-04-01T20:04:49.885 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.885 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea7164a4:::benchmark_data_smithi188_173515_object69514:head# 2024-04-01T20:04:49.885 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.885 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea722bdc:::benchmark_data_smithi188_173515_object96654:head# 2024-04-01T20:04:49.885 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.886 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea72a9a1:::benchmark_data_smithi188_173515_object72640:head# 2024-04-01T20:04:49.886 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.886 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea732895:::benchmark_data_smithi188_173515_object99552:head# 2024-04-01T20:04:49.886 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.886 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea732bb9:::benchmark_data_smithi188_173515_object78300:head# 2024-04-01T20:04:49.886 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.886 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea732f8f:::benchmark_data_smithi188_173515_object125515:head# 2024-04-01T20:04:49.886 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.886 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea74ec79:::benchmark_data_smithi188_173515_object130581:head# 2024-04-01T20:04:49.886 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.886 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea750538:::benchmark_data_smithi188_173515_object154693:head# 2024-04-01T20:04:49.886 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.886 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea757e92:::benchmark_data_smithi188_173515_object67482:head# 2024-04-01T20:04:49.886 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.886 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea7609ca:::benchmark_data_smithi188_173515_object79642:head# 2024-04-01T20:04:49.887 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.887 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea760cd8:::benchmark_data_smithi188_173515_object134664:head# 2024-04-01T20:04:49.887 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.887 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea774bd2:::benchmark_data_smithi188_173515_object133258:head# 2024-04-01T20:04:49.887 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.887 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea77dd5d:::benchmark_data_smithi188_173515_object88219:head# 2024-04-01T20:04:49.887 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.887 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea77f2b7:::benchmark_data_smithi188_173515_object65690:head# 2024-04-01T20:04:49.887 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.887 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea785f18:::benchmark_data_smithi188_173515_object82793:head# 2024-04-01T20:04:49.887 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.887 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea78dd7c:::benchmark_data_smithi188_173515_object77585:head# 2024-04-01T20:04:49.887 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.887 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea78ec79:::benchmark_data_smithi188_173515_object113663:head# 2024-04-01T20:04:49.887 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.887 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea794a09:::benchmark_data_smithi188_173515_object72566:head# 2024-04-01T20:04:49.888 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.888 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea7a3f97:::benchmark_data_smithi188_173515_object147912:head# 2024-04-01T20:04:49.888 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.888 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea7a8f24:::benchmark_data_smithi188_173515_object139687:head# 2024-04-01T20:04:49.888 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.888 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea7ba4f0:::benchmark_data_smithi188_173515_object98953:head# 2024-04-01T20:04:49.888 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.888 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea7c0908:::benchmark_data_smithi188_173515_object82548:head# 2024-04-01T20:04:49.888 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.888 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea7c7669:::benchmark_data_smithi188_173515_object75594:head# 2024-04-01T20:04:49.888 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.888 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea7e4ea8:::benchmark_data_smithi188_173515_object129348:head# 2024-04-01T20:04:49.888 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.888 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea7f583c:::benchmark_data_smithi188_173515_object109765:head# 2024-04-01T20:04:49.888 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.888 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea7fd3ec:::benchmark_data_smithi188_173515_object129561:head# 2024-04-01T20:04:49.889 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.889 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea81ca62:::benchmark_data_smithi188_173515_object48424:head# 2024-04-01T20:04:49.889 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.889 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea820784:::benchmark_data_smithi188_173515_object133649:head# 2024-04-01T20:04:49.889 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.889 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea823ba0:::benchmark_data_smithi188_173515_object134907:head# 2024-04-01T20:04:49.889 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.889 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea833424:::benchmark_data_smithi188_173515_object83471:head# 2024-04-01T20:04:49.889 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.889 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea847516:::benchmark_data_smithi188_173515_object151975:head# 2024-04-01T20:04:49.889 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.889 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea84b661:::benchmark_data_smithi188_173515_object139857:head# 2024-04-01T20:04:49.889 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.889 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea855a4a:::benchmark_data_smithi188_173515_object146213:head# 2024-04-01T20:04:49.889 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.889 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea857f53:::benchmark_data_smithi188_173515_object98441:head# 2024-04-01T20:04:49.890 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.890 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea859698:::benchmark_data_smithi188_173515_object132648:head# 2024-04-01T20:04:49.890 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.890 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea85a3e9:::benchmark_data_smithi188_173515_object98816:head# 2024-04-01T20:04:49.890 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.890 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea863342:::benchmark_data_smithi188_173515_object118067:head# 2024-04-01T20:04:49.890 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.890 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea86a864:::benchmark_data_smithi188_173515_object91693:head# 2024-04-01T20:04:49.890 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.890 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea86b36d:::benchmark_data_smithi188_173515_object155962:head# 2024-04-01T20:04:49.890 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.890 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea8773be:::benchmark_data_smithi188_173515_object155913:head# 2024-04-01T20:04:49.890 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.890 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea878c84:::benchmark_data_smithi188_173515_object80694:head# 2024-04-01T20:04:49.890 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.891 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea87e2a3:::benchmark_data_smithi188_173515_object97181:head# 2024-04-01T20:04:49.891 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.891 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea884b3c:::benchmark_data_smithi188_173515_object74263:head# 2024-04-01T20:04:49.891 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.891 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea888947:::benchmark_data_smithi188_173515_object108782:head# 2024-04-01T20:04:49.891 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.891 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea88a11a:::benchmark_data_smithi188_173515_object155760:head# 2024-04-01T20:04:49.891 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.891 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea893863:::benchmark_data_smithi188_173515_object116572:head# 2024-04-01T20:04:49.891 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.891 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea89b82b:::benchmark_data_smithi188_173515_object113921:head# 2024-04-01T20:04:49.891 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.891 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea89c18d:::benchmark_data_smithi188_173515_object63628:head# 2024-04-01T20:04:49.891 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.891 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea89c2c3:::benchmark_data_smithi188_173515_object114216:head# 2024-04-01T20:04:49.892 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.892 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea89d130:::benchmark_data_smithi188_173515_object146093:head# 2024-04-01T20:04:49.892 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.892 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea89e283:::benchmark_data_smithi188_173515_object67468:head# 2024-04-01T20:04:49.892 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.892 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea8ad353:::benchmark_data_smithi188_173515_object125674:head# 2024-04-01T20:04:49.892 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.892 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea8b723d:::benchmark_data_smithi188_173515_object63001:head# 2024-04-01T20:04:49.892 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.892 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea8b85f7:::benchmark_data_smithi188_173515_object147324:head# 2024-04-01T20:04:49.892 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.892 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea8bc737:::benchmark_data_smithi188_173515_object102505:head# 2024-04-01T20:04:49.892 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.892 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea8c589e:::benchmark_data_smithi188_173515_object134994:head# 2024-04-01T20:04:49.892 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.892 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea8cff2c:::benchmark_data_smithi188_173515_object123949:head# 2024-04-01T20:04:49.893 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.893 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea8e6939:::benchmark_data_smithi188_173515_object126787:head# 2024-04-01T20:04:49.893 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.893 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea8e7e49:::benchmark_data_smithi188_173515_object155173:head# 2024-04-01T20:04:49.893 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.893 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea8f1933:::benchmark_data_smithi188_173515_object90594:head# 2024-04-01T20:04:49.893 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.893 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea8f75ae:::benchmark_data_smithi188_173515_object140433:head# 2024-04-01T20:04:49.893 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.893 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea8f8c63:::benchmark_data_smithi188_173515_object126222:head# 2024-04-01T20:04:49.893 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.893 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea8fffe1:::benchmark_data_smithi188_173515_object78705:head# 2024-04-01T20:04:49.893 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.893 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea911bfb:::benchmark_data_smithi188_173515_object100073:head# 2024-04-01T20:04:49.893 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.893 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea914014:::benchmark_data_smithi188_173515_object79823:head# 2024-04-01T20:04:49.894 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.894 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea91ed69:::benchmark_data_smithi188_173515_object77040:head# 2024-04-01T20:04:49.894 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.894 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea923ad1:::benchmark_data_smithi188_173515_object51222:head# 2024-04-01T20:04:49.894 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.894 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea925130:::benchmark_data_smithi188_173515_object52041:head# 2024-04-01T20:04:49.894 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.894 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea92618a:::benchmark_data_smithi188_173515_object95235:head# 2024-04-01T20:04:49.894 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.894 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea92aba8:::benchmark_data_smithi188_173515_object128661:head# 2024-04-01T20:04:49.894 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.894 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea92f013:::benchmark_data_smithi188_173515_object106106:head# 2024-04-01T20:04:49.894 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.894 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea9301a6:::benchmark_data_smithi188_173515_object49653:head# 2024-04-01T20:04:49.894 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.895 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea936057:::benchmark_data_smithi188_173515_object154123:head# 2024-04-01T20:04:49.895 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.895 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea939b5e:::benchmark_data_smithi188_173515_object135798:head# 2024-04-01T20:04:49.895 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.895 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea94e70c:::benchmark_data_smithi188_173515_object75443:head# 2024-04-01T20:04:49.895 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.895 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea95914c:::benchmark_data_smithi188_173515_object133945:head# 2024-04-01T20:04:49.895 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.895 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea95cf1a:::benchmark_data_smithi188_173515_object92627:head# 2024-04-01T20:04:49.895 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.895 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea970a66:::benchmark_data_smithi188_173515_object53057:head# 2024-04-01T20:04:49.895 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.895 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea976458:::benchmark_data_smithi188_173515_object99924:head# 2024-04-01T20:04:49.895 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.895 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea9775aa:::benchmark_data_smithi188_173515_object103605:head# 2024-04-01T20:04:49.895 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.896 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea97edd3:::benchmark_data_smithi188_173515_object121561:head# 2024-04-01T20:04:49.896 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.896 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea985b58:::benchmark_data_smithi188_173515_object72080:head# 2024-04-01T20:04:49.896 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.896 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea986263:::benchmark_data_smithi188_173515_object47156:head# 2024-04-01T20:04:49.896 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.896 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea99ab7a:::benchmark_data_smithi188_173515_object136847:head# 2024-04-01T20:04:49.896 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.896 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea99cf2f:::benchmark_data_smithi188_173515_object92332:head# 2024-04-01T20:04:49.896 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.896 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea99d187:::benchmark_data_smithi188_173515_object107255:head# 2024-04-01T20:04:49.896 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.896 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea99dcba:::benchmark_data_smithi188_173515_object80444:head# 2024-04-01T20:04:49.896 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.897 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea9bbc5c:::benchmark_data_smithi188_173515_object114904:head# 2024-04-01T20:04:49.897 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.897 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea9c2a21:::benchmark_data_smithi188_173515_object57330:head# 2024-04-01T20:04:49.897 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.897 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea9d52d2:::benchmark_data_smithi188_173515_object67321:head# 2024-04-01T20:04:49.897 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.897 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea9d5d9b:::benchmark_data_smithi188_173515_object130420:head# 2024-04-01T20:04:49.897 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.897 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea9d5f3a:::benchmark_data_smithi188_173515_object143183:head# 2024-04-01T20:04:49.897 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.897 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea9dfca7:::benchmark_data_smithi188_173515_object122772:head# 2024-04-01T20:04:49.897 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.897 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea9e9187:::benchmark_data_smithi188_173515_object103230:head# 2024-04-01T20:04:49.897 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.897 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea9ea81a:::benchmark_data_smithi188_173515_object124555:head# 2024-04-01T20:04:49.898 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.898 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea9f532b:::benchmark_data_smithi188_173515_object77295:head# 2024-04-01T20:04:49.898 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.898 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ea9ff4f6:::benchmark_data_smithi188_173515_object141007:head# 2024-04-01T20:04:49.898 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.898 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaa01f10:::benchmark_data_smithi188_173515_object110295:head# 2024-04-01T20:04:49.898 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.898 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaa08b91:::benchmark_data_smithi188_173515_object121425:head# 2024-04-01T20:04:49.898 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.898 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaa0b4cb:::benchmark_data_smithi188_173515_object111153:head# 2024-04-01T20:04:49.898 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.898 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaa1a31a:::benchmark_data_smithi188_173515_object136408:head# 2024-04-01T20:04:49.898 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.898 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaa2fa35:::benchmark_data_smithi188_173515_object139777:head# 2024-04-01T20:04:49.898 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.899 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaa48580:::benchmark_data_smithi188_173515_object69161:head# 2024-04-01T20:04:49.899 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.899 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaa48dc2:::benchmark_data_smithi188_173515_object87757:head# 2024-04-01T20:04:49.899 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.899 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaa4d088:::benchmark_data_smithi188_173515_object133139:head# 2024-04-01T20:04:49.899 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.899 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaa5adc6:::benchmark_data_smithi188_173515_object102871:head# 2024-04-01T20:04:49.899 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.899 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaa6c35b:::benchmark_data_smithi188_173515_object98089:head# 2024-04-01T20:04:49.899 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.899 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaa709bb:::benchmark_data_smithi188_173515_object101991:head# 2024-04-01T20:04:49.899 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.899 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaa725c9:::benchmark_data_smithi188_173515_object139461:head# 2024-04-01T20:04:49.899 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.899 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaa76213:::benchmark_data_smithi188_173515_object120880:head# 2024-04-01T20:04:49.900 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.900 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaa7e6a9:::benchmark_data_smithi188_173515_object125830:head# 2024-04-01T20:04:49.900 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.900 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaa80d81:::benchmark_data_smithi188_173515_object133229:head# 2024-04-01T20:04:49.900 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.900 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaa8a706:::benchmark_data_smithi188_173515_object154872:head# 2024-04-01T20:04:49.900 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.900 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaa8c906:::benchmark_data_smithi188_173515_object65135:head# 2024-04-01T20:04:49.900 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.900 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaa97e4f:::benchmark_data_smithi188_173515_object139853:head# 2024-04-01T20:04:49.900 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.900 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaaa4d42:::benchmark_data_smithi188_173515_object89010:head# 2024-04-01T20:04:49.900 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.900 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaaa7878:::benchmark_data_smithi188_173515_object72417:head# 2024-04-01T20:04:49.900 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.901 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaaae1f4:::benchmark_data_smithi188_173515_object86858:head# 2024-04-01T20:04:49.901 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.901 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaab6200:::benchmark_data_smithi188_173515_object144256:head# 2024-04-01T20:04:49.901 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.901 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaabc0d7:::benchmark_data_smithi188_173515_object53027:head# 2024-04-01T20:04:49.901 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.901 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaac954e:::benchmark_data_smithi188_173515_object57883:head# 2024-04-01T20:04:49.901 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.901 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaaec75b:::benchmark_data_smithi188_173515_object150895:head# 2024-04-01T20:04:49.901 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.901 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eab03aec:::benchmark_data_smithi188_173515_object77370:head# 2024-04-01T20:04:49.901 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.901 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eab05acc:::benchmark_data_smithi188_173515_object76801:head# 2024-04-01T20:04:49.901 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.901 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eab1ce34:::benchmark_data_smithi188_173515_object137321:head# 2024-04-01T20:04:49.901 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.902 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eab257dd:::benchmark_data_smithi188_173515_object53408:head# 2024-04-01T20:04:49.902 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.902 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eab2d6e1:::benchmark_data_smithi188_173515_object97658:head# 2024-04-01T20:04:49.902 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.902 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eab34e55:::benchmark_data_smithi188_173515_object153424:head# 2024-04-01T20:04:49.902 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.902 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eab3b7eb:::benchmark_data_smithi188_173515_object100376:head# 2024-04-01T20:04:49.902 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.902 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eab4a475:::benchmark_data_smithi188_173515_object84952:head# 2024-04-01T20:04:49.902 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.902 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eab5a966:::benchmark_data_smithi188_173515_object74201:head# 2024-04-01T20:04:49.902 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.902 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eab5b79b:::benchmark_data_smithi188_173515_object116731:head# 2024-04-01T20:04:49.903 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.903 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eab79723:::benchmark_data_smithi188_173515_object53738:head# 2024-04-01T20:04:49.903 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.903 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eab81a03:::benchmark_data_smithi188_173515_object45703:head# 2024-04-01T20:04:49.903 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.903 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eab8ddea:::benchmark_data_smithi188_173515_object149079:head# 2024-04-01T20:04:49.903 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.903 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eabacd97:::benchmark_data_smithi188_173515_object124607:head# 2024-04-01T20:04:49.903 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.903 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eabbb572:::benchmark_data_smithi188_173515_object78375:head# 2024-04-01T20:04:49.903 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.903 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eabebdf7:::benchmark_data_smithi188_173515_object80145:head# 2024-04-01T20:04:49.903 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.903 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eabf51be:::benchmark_data_smithi188_173515_object58620:head# 2024-04-01T20:04:49.903 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.904 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eabf6fed:::benchmark_data_smithi188_173515_object86660:head# 2024-04-01T20:04:49.904 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.998 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eac024ff:::benchmark_data_smithi188_173515_object90650:head# 2024-04-01T20:04:49.998 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.999 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eac06774:::benchmark_data_smithi188_173515_object100078:head# 2024-04-01T20:04:49.999 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.999 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eac1a1b3:::benchmark_data_smithi188_173515_object111889:head# 2024-04-01T20:04:49.999 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.999 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eac35ea7:::benchmark_data_smithi188_173515_object100149:head# 2024-04-01T20:04:49.999 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.999 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eac3c9c7:::benchmark_data_smithi188_173515_object54486:head# 2024-04-01T20:04:49.999 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.999 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eac48214:::benchmark_data_smithi188_173515_object85786:head# 2024-04-01T20:04:49.999 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.999 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eac50551:::benchmark_data_smithi188_173515_object89860:head# 2024-04-01T20:04:49.999 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:49.999 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eac522af:::benchmark_data_smithi188_173515_object63320:head# 2024-04-01T20:04:50.000 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.000 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eac6418b:::benchmark_data_smithi188_173515_object83707:head# 2024-04-01T20:04:50.000 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.000 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eac6a48f:::benchmark_data_smithi188_173515_object123621:head# 2024-04-01T20:04:50.000 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.000 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eac8bfea:::benchmark_data_smithi188_173515_object138656:head# 2024-04-01T20:04:50.000 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.000 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eac8f89c:::benchmark_data_smithi188_173515_object89105:head# 2024-04-01T20:04:50.000 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.000 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eac9a2cd:::benchmark_data_smithi188_173515_object64892:head# 2024-04-01T20:04:50.000 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.000 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eacb7ba1:::benchmark_data_smithi188_173515_object112508:head# 2024-04-01T20:04:50.000 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.000 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eacc140e:::benchmark_data_smithi188_173515_object151885:head# 2024-04-01T20:04:50.000 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.001 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eacc4101:::benchmark_data_smithi188_173515_object66693:head# 2024-04-01T20:04:50.001 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.001 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eacc5f58:::benchmark_data_smithi188_173515_object45878:head# 2024-04-01T20:04:50.001 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.001 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eacd030b:::benchmark_data_smithi188_173515_object141180:head# 2024-04-01T20:04:50.001 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.001 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eacd3f4a:::benchmark_data_smithi188_173515_object92660:head# 2024-04-01T20:04:50.001 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.001 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eacd73c6:::benchmark_data_smithi188_173515_object96971:head# 2024-04-01T20:04:50.001 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.001 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eacd7f12:::benchmark_data_smithi188_173515_object149881:head# 2024-04-01T20:04:50.001 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.001 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eacfd5d5:::benchmark_data_smithi188_173515_object71110:head# 2024-04-01T20:04:50.001 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.001 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eacfd775:::benchmark_data_smithi188_173515_object95711:head# 2024-04-01T20:04:50.002 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.002 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ead1aedc:::benchmark_data_smithi188_173515_object79884:head# 2024-04-01T20:04:50.002 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.002 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ead2034e:::benchmark_data_smithi188_173515_object54730:head# 2024-04-01T20:04:50.002 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.002 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ead2c594:::benchmark_data_smithi188_173515_object154107:head# 2024-04-01T20:04:50.002 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.002 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ead36358:::benchmark_data_smithi188_173515_object68726:head# 2024-04-01T20:04:50.002 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.002 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ead36fc0:::benchmark_data_smithi188_173515_object150423:head# 2024-04-01T20:04:50.002 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.002 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ead40944:::benchmark_data_smithi188_173515_object50495:head# 2024-04-01T20:04:50.002 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.003 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ead558cb:::benchmark_data_smithi188_173515_object85985:head# 2024-04-01T20:04:50.003 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.003 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ead57750:::benchmark_data_smithi188_173515_object142494:head# 2024-04-01T20:04:50.003 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.003 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ead6a201:::benchmark_data_smithi188_173515_object75059:head# 2024-04-01T20:04:50.003 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.003 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ead75f76:::benchmark_data_smithi188_173515_object154327:head# 2024-04-01T20:04:50.003 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.003 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ead76677:::benchmark_data_smithi188_173515_object60023:head# 2024-04-01T20:04:50.003 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.003 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ead78741:::benchmark_data_smithi188_173515_object61004:head# 2024-04-01T20:04:50.003 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.003 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ead7ee0f:::benchmark_data_smithi188_173515_object112627:head# 2024-04-01T20:04:50.003 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.004 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ead8b61f:::benchmark_data_smithi188_173515_object147259:head# 2024-04-01T20:04:50.004 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.004 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ead912af:::benchmark_data_smithi188_173515_object71651:head# 2024-04-01T20:04:50.004 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.004 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ead95434:::benchmark_data_smithi188_173515_object139049:head# 2024-04-01T20:04:50.004 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.004 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ead98190:::benchmark_data_smithi188_173515_object104670:head# 2024-04-01T20:04:50.004 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.004 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ead9eb40:::benchmark_data_smithi188_173515_object50254:head# 2024-04-01T20:04:50.004 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.004 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eada0d06:::benchmark_data_smithi188_173515_object151261:head# 2024-04-01T20:04:50.004 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.004 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eada6b83:::benchmark_data_smithi188_173515_object118881:head# 2024-04-01T20:04:50.004 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.004 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eadb43f6:::benchmark_data_smithi188_173515_object118724:head# 2024-04-01T20:04:50.005 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.005 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eadc293f:::benchmark_data_smithi188_173515_object82673:head# 2024-04-01T20:04:50.005 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.005 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eadc3b31:::benchmark_data_smithi188_173515_object50203:head# 2024-04-01T20:04:50.005 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.005 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eadc778e:::benchmark_data_smithi188_173515_object96460:head# 2024-04-01T20:04:50.005 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.005 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eadd1785:::benchmark_data_smithi188_173515_object80605:head# 2024-04-01T20:04:50.005 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.005 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eadd357a:::benchmark_data_smithi188_173515_object76628:head# 2024-04-01T20:04:50.005 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.005 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eadd5980:::benchmark_data_smithi188_173515_object48457:head# 2024-04-01T20:04:50.005 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.005 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaddc460:::benchmark_data_smithi188_173515_object124223:head# 2024-04-01T20:04:50.006 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.006 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eade280a:::benchmark_data_smithi188_173515_object94602:head# 2024-04-01T20:04:50.006 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.006 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eade629d:::benchmark_data_smithi188_173515_object69507:head# 2024-04-01T20:04:50.006 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.006 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eadeb23e:::benchmark_data_smithi188_173515_object118512:head# 2024-04-01T20:04:50.006 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.006 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eadf1b5e:::benchmark_data_smithi188_173515_object139395:head# 2024-04-01T20:04:50.006 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.006 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eadf23cc:::benchmark_data_smithi188_173515_object68815:head# 2024-04-01T20:04:50.006 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.006 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eadf4771:::benchmark_data_smithi188_173515_object144769:head# 2024-04-01T20:04:50.006 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.007 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eadf667e:::benchmark_data_smithi188_173515_object146737:head# 2024-04-01T20:04:50.007 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.007 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eae10135:::benchmark_data_smithi188_173515_object66507:head# 2024-04-01T20:04:50.007 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.007 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eae10def:::benchmark_data_smithi188_173515_object118594:head# 2024-04-01T20:04:50.007 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.007 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eae113c1:::benchmark_data_smithi188_173515_object58622:head# 2024-04-01T20:04:50.007 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.007 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eae18cc4:::benchmark_data_smithi188_173515_object53370:head# 2024-04-01T20:04:50.007 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.007 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eae1d1cc:::benchmark_data_smithi188_173515_object144204:head# 2024-04-01T20:04:50.007 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.007 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eae2a9e9:::benchmark_data_smithi188_173515_object138642:head# 2024-04-01T20:04:50.007 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.007 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eae406b3:::benchmark_data_smithi188_173515_object139572:head# 2024-04-01T20:04:50.008 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.008 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eae41c7f:::benchmark_data_smithi188_173515_object122913:head# 2024-04-01T20:04:50.008 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.008 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eae44723:::benchmark_data_smithi188_173515_object59883:head# 2024-04-01T20:04:50.008 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.008 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eae4654e:::benchmark_data_smithi188_173515_object49737:head# 2024-04-01T20:04:50.008 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.008 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eae46f14:::benchmark_data_smithi188_173515_object77093:head# 2024-04-01T20:04:50.008 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.008 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eae60beb:::benchmark_data_smithi188_173515_object52375:head# 2024-04-01T20:04:50.008 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.008 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eae615bc:::benchmark_data_smithi188_173515_object49611:head# 2024-04-01T20:04:50.008 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.008 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eae6180b:::benchmark_data_smithi188_173515_object132758:head# 2024-04-01T20:04:50.009 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.009 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eae74337:::benchmark_data_smithi188_173515_object104810:head# 2024-04-01T20:04:50.009 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.009 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eae7e575:::benchmark_data_smithi188_173515_object133805:head# 2024-04-01T20:04:50.009 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.009 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eae87312:::benchmark_data_smithi188_173515_object64326:head# 2024-04-01T20:04:50.009 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.009 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaea39cf:::benchmark_data_smithi188_173515_object97468:head# 2024-04-01T20:04:50.009 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.009 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaea51af:::benchmark_data_smithi188_173515_object99341:head# 2024-04-01T20:04:50.009 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.009 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaeb68f5:::benchmark_data_smithi188_173515_object99055:head# 2024-04-01T20:04:50.009 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.009 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaebb047:::benchmark_data_smithi188_173515_object148817:head# 2024-04-01T20:04:50.010 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.010 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaec889f:::benchmark_data_smithi188_173515_object96788:head# 2024-04-01T20:04:50.010 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.010 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaeccf6e:::benchmark_data_smithi188_173515_object125335:head# 2024-04-01T20:04:50.010 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.010 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaed1f61:::benchmark_data_smithi188_173515_object113730:head# 2024-04-01T20:04:50.010 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.010 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaee7d3f:::benchmark_data_smithi188_173515_object92617:head# 2024-04-01T20:04:50.010 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.010 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaeeb32c:::benchmark_data_smithi188_173515_object70456:head# 2024-04-01T20:04:50.010 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.010 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaef2f69:::benchmark_data_smithi188_173515_object47005:head# 2024-04-01T20:04:50.010 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.010 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf06de8:::benchmark_data_smithi188_173515_object105328:head# 2024-04-01T20:04:50.011 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.011 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf0761b:::benchmark_data_smithi188_173515_object94536:head# 2024-04-01T20:04:50.011 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.011 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf089b7:::benchmark_data_smithi188_173515_object60084:head# 2024-04-01T20:04:50.011 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.011 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf0b892:::benchmark_data_smithi188_173515_object65102:head# 2024-04-01T20:04:50.011 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.011 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf22591:::benchmark_data_smithi188_173515_object74403:head# 2024-04-01T20:04:50.011 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.011 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf2c508:::benchmark_data_smithi188_173515_object56200:head# 2024-04-01T20:04:50.011 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.011 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf2db57:::benchmark_data_smithi188_173515_object123002:head# 2024-04-01T20:04:50.011 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.011 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf30210:::benchmark_data_smithi188_173515_object50730:head# 2024-04-01T20:04:50.011 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.012 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf373f6:::benchmark_data_smithi188_173515_object99699:head# 2024-04-01T20:04:50.012 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.012 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf37d9e:::benchmark_data_smithi188_173515_object85598:head# 2024-04-01T20:04:50.012 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.012 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf40adf:::benchmark_data_smithi188_173515_object151589:head# 2024-04-01T20:04:50.012 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.012 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf47b73:::benchmark_data_smithi188_173515_object53558:head# 2024-04-01T20:04:50.012 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.012 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf53b9f:::benchmark_data_smithi188_173515_object97430:head# 2024-04-01T20:04:50.012 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.012 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf5991a:::benchmark_data_smithi188_173515_object108953:head# 2024-04-01T20:04:50.012 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.012 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf5a8b3:::benchmark_data_smithi188_173515_object154603:head# 2024-04-01T20:04:50.012 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.013 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf5d828:::benchmark_data_smithi188_173515_object69827:head# 2024-04-01T20:04:50.013 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.013 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf617a7:::benchmark_data_smithi188_173515_object81640:head# 2024-04-01T20:04:50.013 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.013 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf61a2e:::benchmark_data_smithi188_173515_object146365:head# 2024-04-01T20:04:50.013 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.013 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf79236:::benchmark_data_smithi188_173515_object61135:head# 2024-04-01T20:04:50.013 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.013 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf7b1a1:::benchmark_data_smithi188_173515_object155058:head# 2024-04-01T20:04:50.013 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.013 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf86947:::benchmark_data_smithi188_173515_object81666:head# 2024-04-01T20:04:50.013 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.013 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf89a07:::benchmark_data_smithi188_173515_object123663:head# 2024-04-01T20:04:50.013 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.014 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf8c7f6:::benchmark_data_smithi188_173515_object119648:head# 2024-04-01T20:04:50.014 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.014 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf8d542:::benchmark_data_smithi188_173515_object127497:head# 2024-04-01T20:04:50.014 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.014 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf91637:::benchmark_data_smithi188_173515_object119538:head# 2024-04-01T20:04:50.014 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.014 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf996a8:::benchmark_data_smithi188_173515_object143789:head# 2024-04-01T20:04:50.014 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.014 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaf9aa9a:::benchmark_data_smithi188_173515_object89205:head# 2024-04-01T20:04:50.014 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.014 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eafa201d:::benchmark_data_smithi188_173515_object130630:head# 2024-04-01T20:04:50.014 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.014 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eafa3d7f:::benchmark_data_smithi188_173515_object99419:head# 2024-04-01T20:04:50.015 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.015 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eafa40a1:::benchmark_data_smithi188_173515_object54883:head# 2024-04-01T20:04:50.015 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.015 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eafa66a4:::benchmark_data_smithi188_173515_object149095:head# 2024-04-01T20:04:50.015 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.015 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eafade6c:::benchmark_data_smithi188_173515_object72772:head# 2024-04-01T20:04:50.015 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.015 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eafbcdc3:::benchmark_data_smithi188_173515_object72645:head# 2024-04-01T20:04:50.015 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.015 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eafc2c17:::benchmark_data_smithi188_173515_object133882:head# 2024-04-01T20:04:50.015 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.015 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eafc2e98:::benchmark_data_smithi188_173515_object117773:head# 2024-04-01T20:04:50.015 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.015 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eafc50f8:::benchmark_data_smithi188_173515_object89204:head# 2024-04-01T20:04:50.015 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.016 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eafcf6b7:::benchmark_data_smithi188_173515_object115436:head# 2024-04-01T20:04:50.016 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.016 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eafd2d3b:::benchmark_data_smithi188_173515_object79528:head# 2024-04-01T20:04:50.016 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.016 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eafddd1e:::benchmark_data_smithi188_173515_object72648:head# 2024-04-01T20:04:50.016 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.016 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eafec6f7:::benchmark_data_smithi188_173515_object150635:head# 2024-04-01T20:04:50.016 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.016 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaff2586:::benchmark_data_smithi188_173515_object95825:head# 2024-04-01T20:04:50.016 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.016 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaff4cfb:::benchmark_data_smithi188_173515_object67670:head# 2024-04-01T20:04:50.016 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.016 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eaffcca2:::benchmark_data_smithi188_173515_object87334:head# 2024-04-01T20:04:50.016 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.016 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb008c40:::benchmark_data_smithi188_173515_object90233:head# 2024-04-01T20:04:50.017 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.017 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb01c612:::benchmark_data_smithi188_173515_object94275:head# 2024-04-01T20:04:50.017 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.017 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb0252d7:::benchmark_data_smithi188_173515_object154799:head# 2024-04-01T20:04:50.017 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.017 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb0331ed:::benchmark_data_smithi188_173515_object80640:head# 2024-04-01T20:04:50.017 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.017 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb03a5e7:::benchmark_data_smithi188_173515_object125566:head# 2024-04-01T20:04:50.017 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.017 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb03b9a6:::benchmark_data_smithi188_173515_object144915:head# 2024-04-01T20:04:50.017 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.017 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb0488e6:::benchmark_data_smithi188_173515_object71185:head# 2024-04-01T20:04:50.017 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.017 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb04e527:::benchmark_data_smithi188_173515_object57403:head# 2024-04-01T20:04:50.018 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.018 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb0516c3:::benchmark_data_smithi188_173515_object87308:head# 2024-04-01T20:04:50.018 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.018 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb055cce:::benchmark_data_smithi188_173515_object140101:head# 2024-04-01T20:04:50.018 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.018 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb0575ab:::benchmark_data_smithi188_173515_object77479:head# 2024-04-01T20:04:50.018 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.018 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb066dbb:::benchmark_data_smithi188_173515_object54360:head# 2024-04-01T20:04:50.018 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.018 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb072708:::benchmark_data_smithi188_173515_object46075:head# 2024-04-01T20:04:50.018 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.018 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb073108:::benchmark_data_smithi188_173515_object75049:head# 2024-04-01T20:04:50.018 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.019 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb078b4c:::benchmark_data_smithi188_173515_object148523:head# 2024-04-01T20:04:50.019 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.019 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb083205:::benchmark_data_smithi188_173515_object139251:head# 2024-04-01T20:04:50.019 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.019 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb09e1dd:::benchmark_data_smithi188_173515_object112478:head# 2024-04-01T20:04:50.019 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.019 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb09e342:::benchmark_data_smithi188_173515_object86294:head# 2024-04-01T20:04:50.019 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.019 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb0aa7ea:::benchmark_data_smithi188_173515_object96908:head# 2024-04-01T20:04:50.019 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.019 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb0aa981:::benchmark_data_smithi188_173515_object86414:head# 2024-04-01T20:04:50.019 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.019 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb0ae1c5:::benchmark_data_smithi188_173515_object109284:head# 2024-04-01T20:04:50.020 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.020 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb0afed9:::benchmark_data_smithi188_173515_object54005:head# 2024-04-01T20:04:50.020 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.020 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb0b2db7:::benchmark_data_smithi188_173515_object112585:head# 2024-04-01T20:04:50.020 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.020 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb0bf7dd:::benchmark_data_smithi188_173515_object63135:head# 2024-04-01T20:04:50.020 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.020 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb0c061f:::benchmark_data_smithi188_173515_object150206:head# 2024-04-01T20:04:50.020 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.020 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb0c1749:::benchmark_data_smithi188_173515_object54136:head# 2024-04-01T20:04:50.020 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.020 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb0db0a0:::benchmark_data_smithi188_173515_object108894:head# 2024-04-01T20:04:50.020 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.021 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb0e23c9:::benchmark_data_smithi188_173515_object144997:head# 2024-04-01T20:04:50.021 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.021 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb0e77cb:::benchmark_data_smithi188_173515_object147539:head# 2024-04-01T20:04:50.021 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.021 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb0ef7a0:::benchmark_data_smithi188_173515_object74724:head# 2024-04-01T20:04:50.021 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.021 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb0f5ad3:::benchmark_data_smithi188_173515_object108398:head# 2024-04-01T20:04:50.021 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.021 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb0fdf8f:::benchmark_data_smithi188_173515_object67624:head# 2024-04-01T20:04:50.021 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.021 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb101e1e:::benchmark_data_smithi188_173515_object49577:head# 2024-04-01T20:04:50.021 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.021 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb107558:::benchmark_data_smithi188_173515_object70649:head# 2024-04-01T20:04:50.021 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.022 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb107c7c:::benchmark_data_smithi188_173515_object85738:head# 2024-04-01T20:04:50.022 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.022 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb1131cf:::benchmark_data_smithi188_173515_object95097:head# 2024-04-01T20:04:50.022 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.022 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb113646:::benchmark_data_smithi188_173515_object69327:head# 2024-04-01T20:04:50.022 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.022 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb121dc3:::benchmark_data_smithi188_173515_object149874:head# 2024-04-01T20:04:50.022 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.022 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb1361fd:::benchmark_data_smithi188_173515_object112969:head# 2024-04-01T20:04:50.022 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.022 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb1398bf:::benchmark_data_smithi188_173515_object68948:head# 2024-04-01T20:04:50.022 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.023 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb139f14:::benchmark_data_smithi188_173515_object66449:head# 2024-04-01T20:04:50.023 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.023 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb13cced:::benchmark_data_smithi188_173515_object80224:head# 2024-04-01T20:04:50.023 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.023 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb1434a8:::benchmark_data_smithi188_173515_object59378:head# 2024-04-01T20:04:50.023 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.023 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb15b3c8:::benchmark_data_smithi188_173515_object55376:head# 2024-04-01T20:04:50.023 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.023 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb16af04:::benchmark_data_smithi188_173515_object134774:head# 2024-04-01T20:04:50.023 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.023 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb16b087:::benchmark_data_smithi188_173515_object96623:head# 2024-04-01T20:04:50.023 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.023 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb16d5f3:::benchmark_data_smithi188_173515_object67491:head# 2024-04-01T20:04:50.023 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.024 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb17f3c6:::benchmark_data_smithi188_173515_object46276:head# 2024-04-01T20:04:50.024 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.024 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb18943e:::benchmark_data_smithi188_173515_object123958:head# 2024-04-01T20:04:50.024 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.024 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb192923:::benchmark_data_smithi188_173515_object125353:head# 2024-04-01T20:04:50.024 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.024 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb1946fb:::benchmark_data_smithi188_173515_object82282:head# 2024-04-01T20:04:50.024 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.024 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb19a3f3:::benchmark_data_smithi188_173515_object60039:head# 2024-04-01T20:04:50.024 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.024 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb19e7f7:::benchmark_data_smithi188_173515_object78836:head# 2024-04-01T20:04:50.024 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.024 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb1a13c2:::benchmark_data_smithi188_173515_object47770:head# 2024-04-01T20:04:50.024 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.025 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb1b8bd1:::benchmark_data_smithi188_173515_object147971:head# 2024-04-01T20:04:50.025 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.025 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb1b8be9:::benchmark_data_smithi188_173515_object141467:head# 2024-04-01T20:04:50.025 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.025 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb1b9b4e:::benchmark_data_smithi188_173515_object54041:head# 2024-04-01T20:04:50.025 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.025 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb1cb6fa:::benchmark_data_smithi188_173515_object57020:head# 2024-04-01T20:04:50.025 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.025 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb1e45f4:::benchmark_data_smithi188_173515_object92235:head# 2024-04-01T20:04:50.025 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.025 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb1f9208:::benchmark_data_smithi188_173515_object60597:head# 2024-04-01T20:04:50.025 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.025 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb207432:::benchmark_data_smithi188_173515_object144524:head# 2024-04-01T20:04:50.025 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.025 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb211675:::benchmark_data_smithi188_173515_object78110:head# 2024-04-01T20:04:50.026 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.026 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb214ed5:::benchmark_data_smithi188_173515_object144836:head# 2024-04-01T20:04:50.026 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.026 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb2156ef:::benchmark_data_smithi188_173515_object90958:head# 2024-04-01T20:04:50.026 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.026 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb21e04f:::benchmark_data_smithi188_173515_object140880:head# 2024-04-01T20:04:50.026 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.026 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb246f2a:::benchmark_data_smithi188_173515_object55928:head# 2024-04-01T20:04:50.026 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.026 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb249133:::benchmark_data_smithi188_173515_object66320:head# 2024-04-01T20:04:50.026 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.026 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb249829:::benchmark_data_smithi188_173515_object110897:head# 2024-04-01T20:04:50.026 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.027 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb25426a:::benchmark_data_smithi188_173515_object141367:head# 2024-04-01T20:04:50.027 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.027 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb257ec6:::benchmark_data_smithi188_173515_object65640:head# 2024-04-01T20:04:50.027 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.027 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb25a06d:::benchmark_data_smithi188_173515_object81841:head# 2024-04-01T20:04:50.027 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.027 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb25aa8d:::benchmark_data_smithi188_173515_object151740:head# 2024-04-01T20:04:50.027 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.027 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb26c83f:::benchmark_data_smithi188_173515_object93535:head# 2024-04-01T20:04:50.027 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.027 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb2737b5:::benchmark_data_smithi188_173515_object56492:head# 2024-04-01T20:04:50.027 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.027 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb27c2f4:::benchmark_data_smithi188_173515_object91525:head# 2024-04-01T20:04:50.027 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.028 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb284a95:::benchmark_data_smithi188_173515_object131795:head# 2024-04-01T20:04:50.028 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.028 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb28872f:::benchmark_data_smithi188_173515_object49466:head# 2024-04-01T20:04:50.028 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.028 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb291fc1:::benchmark_data_smithi188_173515_object74185:head# 2024-04-01T20:04:50.028 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.028 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb2a2be9:::benchmark_data_smithi188_173515_object133457:head# 2024-04-01T20:04:50.028 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.028 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb2a2cf1:::benchmark_data_smithi188_173515_object65256:head# 2024-04-01T20:04:50.028 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.028 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb2a73d7:::benchmark_data_smithi188_173515_object121702:head# 2024-04-01T20:04:50.028 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.028 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb2a8ffd:::benchmark_data_smithi188_173515_object150259:head# 2024-04-01T20:04:50.028 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.028 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb2c5c9f:::benchmark_data_smithi188_173515_object152484:head# 2024-04-01T20:04:50.029 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.029 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb2c83cf:::benchmark_data_smithi188_173515_object94903:head# 2024-04-01T20:04:50.029 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.029 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb2c9ca2:::benchmark_data_smithi188_173515_object58635:head# 2024-04-01T20:04:50.029 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.029 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb2ce66c:::benchmark_data_smithi188_173515_object155481:head# 2024-04-01T20:04:50.029 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.029 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb2dc731:::benchmark_data_smithi188_173515_object153713:head# 2024-04-01T20:04:50.029 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.029 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb2dd072:::benchmark_data_smithi188_173515_object73229:head# 2024-04-01T20:04:50.029 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.029 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb2ed589:::benchmark_data_smithi188_173515_object46440:head# 2024-04-01T20:04:50.029 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.029 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb2ee20e:::benchmark_data_smithi188_173515_object49852:head# 2024-04-01T20:04:50.029 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.029 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb2f0eb7:::benchmark_data_smithi188_173515_object93173:head# 2024-04-01T20:04:50.030 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.030 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb2f7ac7:::benchmark_data_smithi188_173515_object111784:head# 2024-04-01T20:04:50.030 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.030 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb2faaef:::benchmark_data_smithi188_173515_object62708:head# 2024-04-01T20:04:50.030 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.030 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb2fd80c:::benchmark_data_smithi188_173515_object46846:head# 2024-04-01T20:04:50.030 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.030 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb306601:::benchmark_data_smithi188_173515_object61504:head# 2024-04-01T20:04:50.030 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.030 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb307f2d:::benchmark_data_smithi188_173515_object101241:head# 2024-04-01T20:04:50.030 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.030 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb30a02d:::benchmark_data_smithi188_173515_object114047:head# 2024-04-01T20:04:50.030 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.030 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb32606b:::benchmark_data_smithi188_173515_object88193:head# 2024-04-01T20:04:50.031 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.031 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb32a304:::benchmark_data_smithi188_173515_object51504:head# 2024-04-01T20:04:50.031 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.031 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb337b3c:::benchmark_data_smithi188_173515_object97544:head# 2024-04-01T20:04:50.031 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.031 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb34a8b4:::benchmark_data_smithi188_173515_object137089:head# 2024-04-01T20:04:50.031 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.031 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb359dcb:::benchmark_data_smithi188_173515_object126091:head# 2024-04-01T20:04:50.031 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.031 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb369faa:::benchmark_data_smithi188_173515_object140138:head# 2024-04-01T20:04:50.031 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.031 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb36dabc:::benchmark_data_smithi188_173515_object107244:head# 2024-04-01T20:04:50.031 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.032 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb38fb5a:::benchmark_data_smithi188_173515_object104214:head# 2024-04-01T20:04:50.032 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.032 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb390826:::benchmark_data_smithi188_173515_object61523:head# 2024-04-01T20:04:50.032 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.032 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb391301:::benchmark_data_smithi188_173515_object118412:head# 2024-04-01T20:04:50.032 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.032 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb399446:::benchmark_data_smithi188_173515_object148656:head# 2024-04-01T20:04:50.032 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.032 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb3a030d:::benchmark_data_smithi188_173515_object112290:head# 2024-04-01T20:04:50.032 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.032 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb3a4dfe:::benchmark_data_smithi188_173515_object97636:head# 2024-04-01T20:04:50.032 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.032 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb3af487:::benchmark_data_smithi188_173515_object98991:head# 2024-04-01T20:04:50.032 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.033 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb3ba1ef:::benchmark_data_smithi188_173515_object88321:head# 2024-04-01T20:04:50.033 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.033 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb3c53b9:::benchmark_data_smithi188_173515_object121257:head# 2024-04-01T20:04:50.033 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.033 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb3c5633:::benchmark_data_smithi188_173515_object109156:head# 2024-04-01T20:04:50.033 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.033 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb3c5fc3:::benchmark_data_smithi188_173515_object72883:head# 2024-04-01T20:04:50.033 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.033 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb3c9bce:::benchmark_data_smithi188_173515_object150992:head# 2024-04-01T20:04:50.033 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.033 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb3ca388:::benchmark_data_smithi188_173515_object110080:head# 2024-04-01T20:04:50.033 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.033 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb3ceb28:::benchmark_data_smithi188_173515_object130207:head# 2024-04-01T20:04:50.033 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.033 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb3d9174:::benchmark_data_smithi188_173515_object150755:head# 2024-04-01T20:04:50.034 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.034 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb3e1479:::benchmark_data_smithi188_173515_object67463:head# 2024-04-01T20:04:50.034 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.034 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb3f3ab7:::benchmark_data_smithi188_173515_object127834:head# 2024-04-01T20:04:50.034 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.034 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb3f4325:::benchmark_data_smithi188_173515_object110297:head# 2024-04-01T20:04:50.034 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.034 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb4042a1:::benchmark_data_smithi188_173515_object132481:head# 2024-04-01T20:04:50.034 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.034 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb406513:::benchmark_data_smithi188_173515_object117006:head# 2024-04-01T20:04:50.034 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.034 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb422de7:::benchmark_data_smithi188_173515_object58645:head# 2024-04-01T20:04:50.034 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.034 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb434196:::benchmark_data_smithi188_173515_object75025:head# 2024-04-01T20:04:50.035 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.035 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb439be3:::benchmark_data_smithi188_173515_object82688:head# 2024-04-01T20:04:50.035 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.035 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb43ae29:::benchmark_data_smithi188_173515_object100656:head# 2024-04-01T20:04:50.035 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.035 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb440afa:::benchmark_data_smithi188_173515_object93425:head# 2024-04-01T20:04:50.035 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.035 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb443737:::benchmark_data_smithi188_173515_object82883:head# 2024-04-01T20:04:50.035 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.035 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb4442ec:::benchmark_data_smithi188_173515_object88852:head# 2024-04-01T20:04:50.035 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.035 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb45b593:::benchmark_data_smithi188_173515_object154610:head# 2024-04-01T20:04:50.035 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.035 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb4625de:::benchmark_data_smithi188_173515_object114439:head# 2024-04-01T20:04:50.036 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.036 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb464743:::benchmark_data_smithi188_173515_object54929:head# 2024-04-01T20:04:50.036 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.036 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb465686:::benchmark_data_smithi188_173515_object96542:head# 2024-04-01T20:04:50.036 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.036 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb46f295:::benchmark_data_smithi188_173515_object66158:head# 2024-04-01T20:04:50.036 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.036 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb485171:::benchmark_data_smithi188_173515_object72070:head# 2024-04-01T20:04:50.036 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.036 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb4932d6:::benchmark_data_smithi188_173515_object101143:head# 2024-04-01T20:04:50.036 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.036 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb499745:::benchmark_data_smithi188_173515_object114331:head# 2024-04-01T20:04:50.036 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.036 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb4b15ac:::benchmark_data_smithi188_173515_object54705:head# 2024-04-01T20:04:50.037 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.037 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb4b6b74:::benchmark_data_smithi188_173515_object132060:head# 2024-04-01T20:04:50.037 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.037 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb4c331c:::benchmark_data_smithi188_173515_object62523:head# 2024-04-01T20:04:50.037 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.037 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb4c7145:::benchmark_data_smithi188_173515_object85860:head# 2024-04-01T20:04:50.037 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.037 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb4cbe0b:::benchmark_data_smithi188_173515_object67734:head# 2024-04-01T20:04:50.037 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.037 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb4cc314:::benchmark_data_smithi188_173515_object138503:head# 2024-04-01T20:04:50.037 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.037 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb4e0857:::benchmark_data_smithi188_173515_object46388:head# 2024-04-01T20:04:50.037 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.037 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb4eabb5:::benchmark_data_smithi188_173515_object69638:head# 2024-04-01T20:04:50.037 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.037 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb4ee44d:::benchmark_data_smithi188_173515_object143923:head# 2024-04-01T20:04:50.038 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.038 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb4ff632:::benchmark_data_smithi188_173515_object112509:head# 2024-04-01T20:04:50.038 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.038 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb5049ff:::benchmark_data_smithi188_173515_object105435:head# 2024-04-01T20:04:50.038 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.038 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb509937:::benchmark_data_smithi188_173515_object115756:head# 2024-04-01T20:04:50.038 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.038 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb512acd:::benchmark_data_smithi188_173515_object133011:head# 2024-04-01T20:04:50.038 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.038 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb51c19c:::benchmark_data_smithi188_173515_object107521:head# 2024-04-01T20:04:50.038 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.038 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb520261:::benchmark_data_smithi188_173515_object99833:head# 2024-04-01T20:04:50.038 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.038 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb522265:::benchmark_data_smithi188_173515_object66414:head# 2024-04-01T20:04:50.039 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.039 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb525c34:::benchmark_data_smithi188_173515_object70512:head# 2024-04-01T20:04:50.039 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.039 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb53160f:::benchmark_data_smithi188_173515_object124561:head# 2024-04-01T20:04:50.039 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.039 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb55042d:::benchmark_data_smithi188_173515_object131526:head# 2024-04-01T20:04:50.039 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.039 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb554c66:::benchmark_data_smithi188_173515_object81625:head# 2024-04-01T20:04:50.039 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.039 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb5616ca:::benchmark_data_smithi188_173515_object141173:head# 2024-04-01T20:04:50.039 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.039 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb56398d:::benchmark_data_smithi188_173515_object130750:head# 2024-04-01T20:04:50.039 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.039 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb571202:::benchmark_data_smithi188_173515_object116977:head# 2024-04-01T20:04:50.040 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.040 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb5813d3:::benchmark_data_smithi188_173515_object80606:head# 2024-04-01T20:04:50.040 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.040 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb583d36:::benchmark_data_smithi188_173515_object107656:head# 2024-04-01T20:04:50.040 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.040 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb59dd34:::benchmark_data_smithi188_173515_object137785:head# 2024-04-01T20:04:50.040 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.040 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb5a424f:::benchmark_data_smithi188_173515_object106643:head# 2024-04-01T20:04:50.040 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.040 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb5a4ca3:::benchmark_data_smithi188_173515_object50966:head# 2024-04-01T20:04:50.040 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.040 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb5b9703:::benchmark_data_smithi188_173515_object153837:head# 2024-04-01T20:04:50.040 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.040 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb5bf7f0:::benchmark_data_smithi188_173515_object105972:head# 2024-04-01T20:04:50.041 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.041 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb5d7d30:::benchmark_data_smithi188_173515_object131054:head# 2024-04-01T20:04:50.041 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.041 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb5deb7f:::benchmark_data_smithi188_173515_object84012:head# 2024-04-01T20:04:50.041 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.041 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb5eae8f:::benchmark_data_smithi188_173515_object138701:head# 2024-04-01T20:04:50.041 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.041 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb5efd54:::benchmark_data_smithi188_173515_object109514:head# 2024-04-01T20:04:50.041 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.041 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb5f1b06:::benchmark_data_smithi188_173515_object150012:head# 2024-04-01T20:04:50.041 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.041 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb5f56ef:::benchmark_data_smithi188_173515_object139375:head# 2024-04-01T20:04:50.041 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.041 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb5fd677:::benchmark_data_smithi188_173515_object82501:head# 2024-04-01T20:04:50.042 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.042 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb6038b2:::benchmark_data_smithi188_173515_object74675:head# 2024-04-01T20:04:50.042 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.042 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb605de3:::benchmark_data_smithi188_173515_object64208:head# 2024-04-01T20:04:50.042 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.042 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb6127b1:::benchmark_data_smithi188_173515_object69284:head# 2024-04-01T20:04:50.042 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.042 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb61f1b6:::benchmark_data_smithi188_173515_object131792:head# 2024-04-01T20:04:50.042 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.042 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb62282c:::benchmark_data_smithi188_173515_object112709:head# 2024-04-01T20:04:50.042 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.042 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb62bc62:::benchmark_data_smithi188_173515_object69487:head# 2024-04-01T20:04:50.042 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.043 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb636478:::benchmark_data_smithi188_173515_object115011:head# 2024-04-01T20:04:50.043 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.043 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb63b286:::benchmark_data_smithi188_173515_object92432:head# 2024-04-01T20:04:50.043 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.043 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb63eef6:::benchmark_data_smithi188_173515_object48803:head# 2024-04-01T20:04:50.043 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.043 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb645f36:::benchmark_data_smithi188_173515_object69888:head# 2024-04-01T20:04:50.043 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.043 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb64fe22:::benchmark_data_smithi188_173515_object65687:head# 2024-04-01T20:04:50.043 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.043 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb65cb14:::benchmark_data_smithi188_173515_object71674:head# 2024-04-01T20:04:50.043 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.043 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb669ab3:::benchmark_data_smithi188_173515_object73694:head# 2024-04-01T20:04:50.043 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.044 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb66d5dc:::benchmark_data_smithi188_173515_object139136:head# 2024-04-01T20:04:50.044 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.044 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb66f4fb:::benchmark_data_smithi188_173515_object142761:head# 2024-04-01T20:04:50.044 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.044 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb683657:::benchmark_data_smithi188_173515_object123374:head# 2024-04-01T20:04:50.044 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.044 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb684c0b:::benchmark_data_smithi188_173515_object69429:head# 2024-04-01T20:04:50.044 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.045 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb68dc87:::benchmark_data_smithi188_173515_object67510:head# 2024-04-01T20:04:50.045 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.045 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb69367f:::benchmark_data_smithi188_173515_object90319:head# 2024-04-01T20:04:50.045 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.045 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb698165:::benchmark_data_smithi188_173515_object146643:head# 2024-04-01T20:04:50.046 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.046 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb69a2b5:::benchmark_data_smithi188_173515_object134592:head# 2024-04-01T20:04:50.046 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.046 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb69b702:::benchmark_data_smithi188_173515_object71311:head# 2024-04-01T20:04:50.046 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.046 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb69bf63:::benchmark_data_smithi188_173515_object155252:head# 2024-04-01T20:04:50.046 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.046 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb6a22f6:::benchmark_data_smithi188_173515_object96985:head# 2024-04-01T20:04:50.046 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.046 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb6ace5f:::benchmark_data_smithi188_173515_object103744:head# 2024-04-01T20:04:50.046 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.046 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb6b04af:::benchmark_data_smithi188_173515_object70633:head# 2024-04-01T20:04:50.046 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.047 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb6b6fe4:::benchmark_data_smithi188_173515_object90800:head# 2024-04-01T20:04:50.047 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.047 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb6be8c7:::benchmark_data_smithi188_173515_object155883:head# 2024-04-01T20:04:50.047 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.047 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb6c93ef:::benchmark_data_smithi188_173515_object74835:head# 2024-04-01T20:04:50.047 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.047 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb6d7150:::benchmark_data_smithi188_173515_object103469:head# 2024-04-01T20:04:50.047 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.047 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb6d9403:::benchmark_data_smithi188_173515_object136587:head# 2024-04-01T20:04:50.047 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.047 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb6ddb8a:::benchmark_data_smithi188_173515_object121023:head# 2024-04-01T20:04:50.047 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.047 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb6ebb8b:::benchmark_data_smithi188_173515_object106099:head# 2024-04-01T20:04:50.047 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.047 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb6ec704:::benchmark_data_smithi188_173515_object153407:head# 2024-04-01T20:04:50.048 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.048 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb70779f:::benchmark_data_smithi188_173515_object87727:head# 2024-04-01T20:04:50.048 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.048 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb7164fd:::benchmark_data_smithi188_173515_object76386:head# 2024-04-01T20:04:50.048 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.048 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb719475:::benchmark_data_smithi188_173515_object118086:head# 2024-04-01T20:04:50.048 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.048 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb71a965:::benchmark_data_smithi188_173515_object123754:head# 2024-04-01T20:04:50.048 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.048 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb7289c5:::benchmark_data_smithi188_173515_object147607:head# 2024-04-01T20:04:50.048 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.048 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb72f81b:::benchmark_data_smithi188_173515_object130325:head# 2024-04-01T20:04:50.048 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.048 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb73144b:::benchmark_data_smithi188_173515_object86747:head# 2024-04-01T20:04:50.049 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.049 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb737014:::benchmark_data_smithi188_173515_object74643:head# 2024-04-01T20:04:50.049 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.049 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb751104:::benchmark_data_smithi188_173515_object82272:head# 2024-04-01T20:04:50.049 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.049 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb75a94c:::benchmark_data_smithi188_173515_object130148:head# 2024-04-01T20:04:50.049 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.049 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb75c015:::benchmark_data_smithi188_173515_object99796:head# 2024-04-01T20:04:50.049 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.049 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb791ad0:::benchmark_data_smithi188_173515_object47549:head# 2024-04-01T20:04:50.049 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.049 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb7920a5:::benchmark_data_smithi188_173515_object99901:head# 2024-04-01T20:04:50.049 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.049 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb798944:::benchmark_data_smithi188_173515_object155855:head# 2024-04-01T20:04:50.049 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.050 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb7a0016:::benchmark_data_smithi188_173515_object62878:head# 2024-04-01T20:04:50.050 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.050 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb7aed64:::benchmark_data_smithi188_173515_object64373:head# 2024-04-01T20:04:50.050 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.050 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb7b0958:::benchmark_data_smithi188_173515_object84076:head# 2024-04-01T20:04:50.050 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.050 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb7c17bc:::benchmark_data_smithi188_173515_object133429:head# 2024-04-01T20:04:50.050 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.050 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb7cbb67:::benchmark_data_smithi188_173515_object72398:head# 2024-04-01T20:04:50.050 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.050 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb7cdfcb:::benchmark_data_smithi188_173515_object65839:head# 2024-04-01T20:04:50.050 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.050 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb7db711:::benchmark_data_smithi188_173515_object153276:head# 2024-04-01T20:04:50.051 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.051 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb7dc253:::benchmark_data_smithi188_173515_object137868:head# 2024-04-01T20:04:50.051 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.051 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb7e85d8:::benchmark_data_smithi188_173515_object125427:head# 2024-04-01T20:04:50.051 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.051 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb7ecbc5:::benchmark_data_smithi188_173515_object116865:head# 2024-04-01T20:04:50.051 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.051 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb7eedb4:::benchmark_data_smithi188_173515_object88233:head# 2024-04-01T20:04:50.051 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.051 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb7f1ad6:::benchmark_data_smithi188_173515_object135305:head# 2024-04-01T20:04:50.051 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.051 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb7f77dd:::benchmark_data_smithi188_173515_object114617:head# 2024-04-01T20:04:50.051 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.051 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb804c23:::benchmark_data_smithi188_173515_object94421:head# 2024-04-01T20:04:50.052 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.052 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb809d8b:::benchmark_data_smithi188_173515_object152596:head# 2024-04-01T20:04:50.052 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.052 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb817f2a:::benchmark_data_smithi188_173515_object153610:head# 2024-04-01T20:04:50.052 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.052 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb81ebbf:::benchmark_data_smithi188_173515_object109134:head# 2024-04-01T20:04:50.052 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.052 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb83d15d:::benchmark_data_smithi188_173515_object131363:head# 2024-04-01T20:04:50.052 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.052 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb83f677:::benchmark_data_smithi188_173515_object146706:head# 2024-04-01T20:04:50.052 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.052 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb848f86:::benchmark_data_smithi188_173515_object137092:head# 2024-04-01T20:04:50.052 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.052 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb84ac3e:::benchmark_data_smithi188_173515_object148227:head# 2024-04-01T20:04:50.053 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.053 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb858d2c:::benchmark_data_smithi188_173515_object137962:head# 2024-04-01T20:04:50.053 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.053 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb873296:::benchmark_data_smithi188_173515_object106594:head# 2024-04-01T20:04:50.053 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.053 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb883311:::benchmark_data_smithi188_173515_object79619:head# 2024-04-01T20:04:50.053 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.053 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb8892d7:::benchmark_data_smithi188_173515_object144911:head# 2024-04-01T20:04:50.053 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.053 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb88ac20:::benchmark_data_smithi188_173515_object154412:head# 2024-04-01T20:04:50.053 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.053 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb89441e:::benchmark_data_smithi188_173515_object50020:head# 2024-04-01T20:04:50.053 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.053 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb897385:::benchmark_data_smithi188_173515_object115560:head# 2024-04-01T20:04:50.054 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.054 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb8a4ca4:::benchmark_data_smithi188_173515_object47685:head# 2024-04-01T20:04:50.054 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.054 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb8a8c6f:::benchmark_data_smithi188_173515_object155178:head# 2024-04-01T20:04:50.054 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.054 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb8ad9b5:::benchmark_data_smithi188_173515_object100776:head# 2024-04-01T20:04:50.054 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.054 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb8b31b5:::benchmark_data_smithi188_173515_object89121:head# 2024-04-01T20:04:50.054 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.054 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb8b9815:::benchmark_data_smithi188_173515_object101183:head# 2024-04-01T20:04:50.054 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.054 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb8bfeb7:::benchmark_data_smithi188_173515_object50680:head# 2024-04-01T20:04:50.054 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.054 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb8da80c:::benchmark_data_smithi188_173515_object86999:head# 2024-04-01T20:04:50.055 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.055 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb8e0127:::benchmark_data_smithi188_173515_object155214:head# 2024-04-01T20:04:50.055 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.055 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb8e2057:::benchmark_data_smithi188_173515_object153234:head# 2024-04-01T20:04:50.055 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.055 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb8f4df9:::benchmark_data_smithi188_173515_object59915:head# 2024-04-01T20:04:50.055 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.055 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb8fd464:::benchmark_data_smithi188_173515_object114740:head# 2024-04-01T20:04:50.055 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.055 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb9053f1:::benchmark_data_smithi188_173515_object81479:head# 2024-04-01T20:04:50.055 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.055 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb914a39:::benchmark_data_smithi188_173515_object107557:head# 2024-04-01T20:04:50.055 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.055 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb92780d:::benchmark_data_smithi188_173515_object146299:head# 2024-04-01T20:04:50.056 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.056 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb92ffe4:::benchmark_data_smithi188_173515_object97155:head# 2024-04-01T20:04:50.056 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.056 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb93634e:::benchmark_data_smithi188_173515_object68807:head# 2024-04-01T20:04:50.056 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.056 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb938027:::benchmark_data_smithi188_173515_object132771:head# 2024-04-01T20:04:50.056 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.056 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb941736:::benchmark_data_smithi188_173515_object66811:head# 2024-04-01T20:04:50.056 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.056 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb949fb7:::benchmark_data_smithi188_173515_object117606:head# 2024-04-01T20:04:50.056 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.056 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb94d7ec:::benchmark_data_smithi188_173515_object55845:head# 2024-04-01T20:04:50.056 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.056 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb950ec3:::benchmark_data_smithi188_173515_object58233:head# 2024-04-01T20:04:50.056 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.057 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb9581a2:::benchmark_data_smithi188_173515_object133332:head# 2024-04-01T20:04:50.057 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.057 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb96ba39:::benchmark_data_smithi188_173515_object51797:head# 2024-04-01T20:04:50.057 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.057 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb97957f:::benchmark_data_smithi188_173515_object46874:head# 2024-04-01T20:04:50.057 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.057 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb987601:::benchmark_data_smithi188_173515_object114851:head# 2024-04-01T20:04:50.057 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.057 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb990455:::benchmark_data_smithi188_173515_object98765:head# 2024-04-01T20:04:50.057 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.057 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb9905a5:::benchmark_data_smithi188_173515_object104549:head# 2024-04-01T20:04:50.057 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.057 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb9a295e:::benchmark_data_smithi188_173515_object105210:head# 2024-04-01T20:04:50.057 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.058 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb9a54e6:::benchmark_data_smithi188_173515_object128158:head# 2024-04-01T20:04:50.058 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.058 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb9b4da1:::benchmark_data_smithi188_173515_object76781:head# 2024-04-01T20:04:50.058 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.058 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb9b6c64:::benchmark_data_smithi188_173515_object97232:head# 2024-04-01T20:04:50.058 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.058 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb9bcfef:::benchmark_data_smithi188_173515_object77143:head# 2024-04-01T20:04:50.058 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.058 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb9bde12:::benchmark_data_smithi188_173515_object66815:head# 2024-04-01T20:04:50.058 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.058 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb9bf4f0:::benchmark_data_smithi188_173515_object151831:head# 2024-04-01T20:04:50.058 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.058 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb9c228e:::benchmark_data_smithi188_173515_object61604:head# 2024-04-01T20:04:50.058 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.059 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb9caca8:::benchmark_data_smithi188_173515_object106198:head# 2024-04-01T20:04:50.059 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.059 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb9ef146:::benchmark_data_smithi188_173515_object103201:head# 2024-04-01T20:04:50.059 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.059 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eb9f7d21:::benchmark_data_smithi188_173515_object140449:head# 2024-04-01T20:04:50.059 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.059 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eba02121:::benchmark_data_smithi188_173515_object129368:head# 2024-04-01T20:04:50.059 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.059 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eba04ae9:::benchmark_data_smithi188_173515_object138648:head# 2024-04-01T20:04:50.059 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.059 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eba0e02f:::benchmark_data_smithi188_173515_object126553:head# 2024-04-01T20:04:50.059 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.059 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eba1f51c:::benchmark_data_smithi188_173515_object150761:head# 2024-04-01T20:04:50.059 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.060 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eba35086:::benchmark_data_smithi188_173515_object148257:head# 2024-04-01T20:04:50.060 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.060 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eba35be9:::benchmark_data_smithi188_173515_object47990:head# 2024-04-01T20:04:50.060 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.060 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eba36296:::benchmark_data_smithi188_173515_object87771:head# 2024-04-01T20:04:50.060 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.060 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eba4e5b1:::benchmark_data_smithi188_173515_object121292:head# 2024-04-01T20:04:50.060 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.060 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eba5b178:::benchmark_data_smithi188_173515_object102247:head# 2024-04-01T20:04:50.060 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.060 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eba61080:::benchmark_data_smithi188_173515_object70141:head# 2024-04-01T20:04:50.060 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.060 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eba6a439:::benchmark_data_smithi188_173515_object81135:head# 2024-04-01T20:04:50.060 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.061 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eba6c301:::benchmark_data_smithi188_173515_object112380:head# 2024-04-01T20:04:50.061 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.061 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eba73525:::benchmark_data_smithi188_173515_object50321:head# 2024-04-01T20:04:50.061 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.061 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eba78a39:::benchmark_data_smithi188_173515_object51352:head# 2024-04-01T20:04:50.061 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.061 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eba84274:::benchmark_data_smithi188_173515_object61957:head# 2024-04-01T20:04:50.061 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.061 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eba89ae4:::benchmark_data_smithi188_173515_object124420:head# 2024-04-01T20:04:50.061 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.061 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eba8bbcb:::benchmark_data_smithi188_173515_object145871:head# 2024-04-01T20:04:50.061 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.061 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eba93fbb:::benchmark_data_smithi188_173515_object47389:head# 2024-04-01T20:04:50.061 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.061 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eba94029:::benchmark_data_smithi188_173515_object57698:head# 2024-04-01T20:04:50.062 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.062 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebaa26d1:::benchmark_data_smithi188_173515_object79054:head# 2024-04-01T20:04:50.062 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.062 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebaae6a7:::benchmark_data_smithi188_173515_object140353:head# 2024-04-01T20:04:50.062 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.062 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebab1c47:::benchmark_data_smithi188_173515_object128061:head# 2024-04-01T20:04:50.062 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.062 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebabeb3e:::benchmark_data_smithi188_173515_object72549:head# 2024-04-01T20:04:50.062 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.062 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebac8a96:::benchmark_data_smithi188_173515_object48490:head# 2024-04-01T20:04:50.062 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.062 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebad15df:::benchmark_data_smithi188_173515_object131657:head# 2024-04-01T20:04:50.062 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.063 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebad872e:::benchmark_data_smithi188_173515_object119432:head# 2024-04-01T20:04:50.063 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.063 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebada35b:::benchmark_data_smithi188_173515_object122184:head# 2024-04-01T20:04:50.063 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.063 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebaddede:::benchmark_data_smithi188_173515_object132278:head# 2024-04-01T20:04:50.063 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.063 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebae304f:::benchmark_data_smithi188_173515_object152084:head# 2024-04-01T20:04:50.063 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.063 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebaef92b:::benchmark_data_smithi188_173515_object102821:head# 2024-04-01T20:04:50.063 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.063 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebaf36c6:::benchmark_data_smithi188_173515_object91500:head# 2024-04-01T20:04:50.063 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.063 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebb03c18:::benchmark_data_smithi188_173515_object62526:head# 2024-04-01T20:04:50.063 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.063 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebb03e96:::benchmark_data_smithi188_173515_object104533:head# 2024-04-01T20:04:50.064 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.064 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebb06ae1:::benchmark_data_smithi188_173515_object80462:head# 2024-04-01T20:04:50.064 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.064 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebb075c4:::benchmark_data_smithi188_173515_object52397:head# 2024-04-01T20:04:50.064 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.064 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebb0b88c:::benchmark_data_smithi188_173515_object106110:head# 2024-04-01T20:04:50.064 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.064 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebb33692:::benchmark_data_smithi188_173515_object128004:head# 2024-04-01T20:04:50.064 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.064 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebb392ae:::benchmark_data_smithi188_173515_object121787:head# 2024-04-01T20:04:50.064 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.064 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebb395fe:::benchmark_data_smithi188_173515_object125276:head# 2024-04-01T20:04:50.064 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.064 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebb43759:::benchmark_data_smithi188_173515_object54809:head# 2024-04-01T20:04:50.065 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.065 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebb5c78a:::benchmark_data_smithi188_173515_object105761:head# 2024-04-01T20:04:50.065 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.065 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebb672ca:::benchmark_data_smithi188_173515_object84484:head# 2024-04-01T20:04:50.065 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.065 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebb6fa01:::benchmark_data_smithi188_173515_object125015:head# 2024-04-01T20:04:50.065 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.065 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebb71767:::benchmark_data_smithi188_173515_object98874:head# 2024-04-01T20:04:50.065 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.065 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebb721ed:::benchmark_data_smithi188_173515_object121382:head# 2024-04-01T20:04:50.065 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.065 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebb7677a:::benchmark_data_smithi188_173515_object55989:head# 2024-04-01T20:04:50.065 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.065 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebb838d9:::benchmark_data_smithi188_173515_object71417:head# 2024-04-01T20:04:50.065 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.066 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebb83b11:::benchmark_data_smithi188_173515_object104767:head# 2024-04-01T20:04:50.066 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.066 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebb84a5b:::benchmark_data_smithi188_173515_object148305:head# 2024-04-01T20:04:50.066 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.066 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebb864d6:::benchmark_data_smithi188_173515_object102634:head# 2024-04-01T20:04:50.066 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.066 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebb91d90:::benchmark_data_smithi188_173515_object79684:head# 2024-04-01T20:04:50.066 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.066 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebb9aac6:::benchmark_data_smithi188_173515_object60835:head# 2024-04-01T20:04:50.066 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.066 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebba6185:::benchmark_data_smithi188_173515_object105920:head# 2024-04-01T20:04:50.066 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.066 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebba6c7f:::benchmark_data_smithi188_173515_object77900:head# 2024-04-01T20:04:50.067 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.067 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebbb09d0:::benchmark_data_smithi188_173515_object153591:head# 2024-04-01T20:04:50.067 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.067 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebbb7831:::benchmark_data_smithi188_173515_object66500:head# 2024-04-01T20:04:50.067 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.067 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebbbc3d4:::benchmark_data_smithi188_173515_object63866:head# 2024-04-01T20:04:50.067 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.067 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebbc57c3:::benchmark_data_smithi188_173515_object147976:head# 2024-04-01T20:04:50.067 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.067 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebbd0800:::benchmark_data_smithi188_173515_object77269:head# 2024-04-01T20:04:50.067 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.067 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebbd2144:::benchmark_data_smithi188_173515_object136793:head# 2024-04-01T20:04:50.067 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.067 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebbe6dbb:::benchmark_data_smithi188_173515_object88870:head# 2024-04-01T20:04:50.068 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.068 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebbf063e:::benchmark_data_smithi188_173515_object74505:head# 2024-04-01T20:04:50.068 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.068 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebc0219a:::benchmark_data_smithi188_173515_object46492:head# 2024-04-01T20:04:50.068 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.068 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebc13137:::benchmark_data_smithi188_173515_object94180:head# 2024-04-01T20:04:50.068 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.068 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebc1536a:::benchmark_data_smithi188_173515_object68766:head# 2024-04-01T20:04:50.068 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.068 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebc162d5:::benchmark_data_smithi188_173515_object50929:head# 2024-04-01T20:04:50.068 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.068 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebc1989f:::benchmark_data_smithi188_173515_object135750:head# 2024-04-01T20:04:50.068 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.068 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebc30015:::benchmark_data_smithi188_173515_object114547:head# 2024-04-01T20:04:50.069 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.069 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebc39555:::benchmark_data_smithi188_173515_object118329:head# 2024-04-01T20:04:50.069 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.069 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebc3b659:::benchmark_data_smithi188_173515_object71536:head# 2024-04-01T20:04:50.069 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.069 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebc3de5f:::benchmark_data_smithi188_173515_object103424:head# 2024-04-01T20:04:50.069 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.069 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebc40956:::benchmark_data_smithi188_173515_object74208:head# 2024-04-01T20:04:50.069 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.069 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebc47dcb:::benchmark_data_smithi188_173515_object80571:head# 2024-04-01T20:04:50.069 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.069 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebc65dcf:::benchmark_data_smithi188_173515_object106195:head# 2024-04-01T20:04:50.069 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.069 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebc660b5:::benchmark_data_smithi188_173515_object137749:head# 2024-04-01T20:04:50.069 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.070 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebc72552:::benchmark_data_smithi188_173515_object77223:head# 2024-04-01T20:04:50.070 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.070 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebc7c2e2:::benchmark_data_smithi188_173515_object89109:head# 2024-04-01T20:04:50.070 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.070 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebc81f77:::benchmark_data_smithi188_173515_object119684:head# 2024-04-01T20:04:50.070 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.070 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebc84328:::benchmark_data_smithi188_173515_object111258:head# 2024-04-01T20:04:50.070 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.070 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebc8b449:::benchmark_data_smithi188_173515_object93935:head# 2024-04-01T20:04:50.070 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.070 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebc9270b:::benchmark_data_smithi188_173515_object55303:head# 2024-04-01T20:04:50.070 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.070 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebc9ef3d:::benchmark_data_smithi188_173515_object146228:head# 2024-04-01T20:04:50.071 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.071 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebcaeb82:::benchmark_data_smithi188_173515_object87644:head# 2024-04-01T20:04:50.071 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.071 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebcaef85:::benchmark_data_smithi188_173515_object71373:head# 2024-04-01T20:04:50.071 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.071 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebcbae92:::benchmark_data_smithi188_173515_object123387:head# 2024-04-01T20:04:50.071 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.071 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebcbcdcf:::benchmark_data_smithi188_173515_object55971:head# 2024-04-01T20:04:50.071 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.071 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebcd7763:::benchmark_data_smithi188_173515_object127223:head# 2024-04-01T20:04:50.071 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.071 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebcda1c7:::benchmark_data_smithi188_173515_object144056:head# 2024-04-01T20:04:50.071 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.071 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebce0c6f:::benchmark_data_smithi188_173515_object107334:head# 2024-04-01T20:04:50.071 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.072 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebce4c9e:::benchmark_data_smithi188_173515_object134631:head# 2024-04-01T20:04:50.072 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.072 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebcea332:::benchmark_data_smithi188_173515_object92846:head# 2024-04-01T20:04:50.072 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.072 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebd030d8:::benchmark_data_smithi188_173515_object79818:head# 2024-04-01T20:04:50.072 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.072 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebd05bf9:::benchmark_data_smithi188_173515_object89703:head# 2024-04-01T20:04:50.072 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.072 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebd15336:::benchmark_data_smithi188_173515_object47984:head# 2024-04-01T20:04:50.072 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.072 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebd167e5:::benchmark_data_smithi188_173515_object139262:head# 2024-04-01T20:04:50.072 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.072 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebd40ff9:::benchmark_data_smithi188_173515_object139542:head# 2024-04-01T20:04:50.072 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.073 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebd42def:::benchmark_data_smithi188_173515_object132539:head# 2024-04-01T20:04:50.073 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.073 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebd4a241:::benchmark_data_smithi188_173515_object95650:head# 2024-04-01T20:04:50.073 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.073 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebd4da3c:::benchmark_data_smithi188_173515_object65007:head# 2024-04-01T20:04:50.073 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.073 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebd546c5:::benchmark_data_smithi188_173515_object90530:head# 2024-04-01T20:04:50.073 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.073 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebd5ce47:::benchmark_data_smithi188_173515_object117971:head# 2024-04-01T20:04:50.073 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.073 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebd60a4d:::benchmark_data_smithi188_173515_object151469:head# 2024-04-01T20:04:50.073 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.073 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebd680ea:::benchmark_data_smithi188_173515_object139599:head# 2024-04-01T20:04:50.073 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.074 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebd74c15:::benchmark_data_smithi188_173515_object151273:head# 2024-04-01T20:04:50.074 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.074 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebd750ed:::benchmark_data_smithi188_173515_object131791:head# 2024-04-01T20:04:50.074 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.074 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebd7c5c1:::benchmark_data_smithi188_173515_object147262:head# 2024-04-01T20:04:50.074 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.074 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebd7f24a:::benchmark_data_smithi188_173515_object60917:head# 2024-04-01T20:04:50.074 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.074 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebd84be8:::benchmark_data_smithi188_173515_object124366:head# 2024-04-01T20:04:50.074 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.074 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebd9c7d2:::benchmark_data_smithi188_173515_object131232:head# 2024-04-01T20:04:50.074 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.074 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebd9ec2d:::benchmark_data_smithi188_173515_object84707:head# 2024-04-01T20:04:50.074 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.075 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebda5423:::benchmark_data_smithi188_173515_object60941:head# 2024-04-01T20:04:50.075 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.075 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebda5f8d:::benchmark_data_smithi188_173515_object139378:head# 2024-04-01T20:04:50.075 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.075 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebdad511:::benchmark_data_smithi188_173515_object139263:head# 2024-04-01T20:04:50.075 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.075 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebdb127d:::benchmark_data_smithi188_173515_object129089:head# 2024-04-01T20:04:50.075 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.075 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebdb19b7:::benchmark_data_smithi188_173515_object146470:head# 2024-04-01T20:04:50.075 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.075 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebdb7946:::benchmark_data_smithi188_173515_object55079:head# 2024-04-01T20:04:50.075 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.075 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebdc5485:::benchmark_data_smithi188_173515_object97851:head# 2024-04-01T20:04:50.075 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.075 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebdc90c0:::benchmark_data_smithi188_173515_object111003:head# 2024-04-01T20:04:50.076 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.076 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebdd378b:::benchmark_data_smithi188_173515_object98783:head# 2024-04-01T20:04:50.076 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.076 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebdd99c7:::benchmark_data_smithi188_173515_object103682:head# 2024-04-01T20:04:50.076 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.076 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebdec119:::benchmark_data_smithi188_173515_object146437:head# 2024-04-01T20:04:50.076 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.076 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebdece2e:::benchmark_data_smithi188_173515_object76430:head# 2024-04-01T20:04:50.076 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.076 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebdf16bc:::benchmark_data_smithi188_173515_object132603:head# 2024-04-01T20:04:50.076 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.076 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebdf2c62:::benchmark_data_smithi188_173515_object92227:head# 2024-04-01T20:04:50.076 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.076 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebdf6030:::benchmark_data_smithi188_173515_object155579:head# 2024-04-01T20:04:50.077 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.077 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebe0d601:::benchmark_data_smithi188_173515_object63297:head# 2024-04-01T20:04:50.077 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.077 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebe1020e:::benchmark_data_smithi188_173515_object152737:head# 2024-04-01T20:04:50.077 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.077 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebe1441a:::benchmark_data_smithi188_173515_object51172:head# 2024-04-01T20:04:50.077 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.077 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebe1526d:::benchmark_data_smithi188_173515_object151971:head# 2024-04-01T20:04:50.077 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.077 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebe28851:::benchmark_data_smithi188_173515_object101986:head# 2024-04-01T20:04:50.077 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.077 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebe3b117:::benchmark_data_smithi188_173515_object140971:head# 2024-04-01T20:04:50.077 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.077 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebe3e9d6:::benchmark_data_smithi188_173515_object63080:head# 2024-04-01T20:04:50.078 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.078 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebe50406:::benchmark_data_smithi188_173515_object121895:head# 2024-04-01T20:04:50.078 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.078 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebe512ba:::benchmark_data_smithi188_173515_object64180:head# 2024-04-01T20:04:50.078 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.078 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebe54e05:::benchmark_data_smithi188_173515_object125813:head# 2024-04-01T20:04:50.078 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.078 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebe78c5e:::benchmark_data_smithi188_173515_object64645:head# 2024-04-01T20:04:50.078 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.078 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebe9f35f:::benchmark_data_smithi188_173515_object74344:head# 2024-04-01T20:04:50.078 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.078 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebea7796:::benchmark_data_smithi188_173515_object131508:head# 2024-04-01T20:04:50.078 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.078 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebec8b37:::benchmark_data_smithi188_173515_object75017:head# 2024-04-01T20:04:50.079 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.079 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebed17c4:::benchmark_data_smithi188_173515_object120744:head# 2024-04-01T20:04:50.079 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.079 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebed5cae:::benchmark_data_smithi188_173515_object108167:head# 2024-04-01T20:04:50.079 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.079 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebeda0d2:::benchmark_data_smithi188_173515_object91205:head# 2024-04-01T20:04:50.079 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.079 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebedfa44:::benchmark_data_smithi188_173515_object129671:head# 2024-04-01T20:04:50.079 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.079 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebee59d9:::benchmark_data_smithi188_173515_object111298:head# 2024-04-01T20:04:50.079 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.079 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebee65c5:::benchmark_data_smithi188_173515_object54137:head# 2024-04-01T20:04:50.079 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.079 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebee8cf7:::benchmark_data_smithi188_173515_object83585:head# 2024-04-01T20:04:50.079 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.080 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebefa210:::benchmark_data_smithi188_173515_object97970:head# 2024-04-01T20:04:50.080 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.080 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebeff1ca:::benchmark_data_smithi188_173515_object142181:head# 2024-04-01T20:04:50.080 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.080 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebf1de99:::benchmark_data_smithi188_173515_object155692:head# 2024-04-01T20:04:50.080 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.080 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebf21e7f:::benchmark_data_smithi188_173515_object132112:head# 2024-04-01T20:04:50.080 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.080 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebf29450:::benchmark_data_smithi188_173515_object67111:head# 2024-04-01T20:04:50.080 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.080 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebf2d208:::benchmark_data_smithi188_173515_object112596:head# 2024-04-01T20:04:50.080 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.080 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebf2d5bf:::benchmark_data_smithi188_173515_object107631:head# 2024-04-01T20:04:50.080 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.081 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebf4a9ec:::benchmark_data_smithi188_173515_object48306:head# 2024-04-01T20:04:50.081 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.081 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebf62976:::benchmark_data_smithi188_173515_object48985:head# 2024-04-01T20:04:50.081 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.081 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebf6d1d3:::benchmark_data_smithi188_173515_object78233:head# 2024-04-01T20:04:50.081 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.244 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebf71cc8:::benchmark_data_smithi188_173515_object78616:head# 2024-04-01T20:04:50.245 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.245 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebf90be6:::benchmark_data_smithi188_173515_object94678:head# 2024-04-01T20:04:50.245 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.245 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebf94f5e:::benchmark_data_smithi188_173515_object94354:head# 2024-04-01T20:04:50.245 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.245 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebf97430:::benchmark_data_smithi188_173515_object103738:head# 2024-04-01T20:04:50.245 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.245 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebfa7a09:::benchmark_data_smithi188_173515_object129424:head# 2024-04-01T20:04:50.245 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.245 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebfacd13:::benchmark_data_smithi188_173515_object93986:head# 2024-04-01T20:04:50.245 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.245 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebfafdba:::benchmark_data_smithi188_173515_object125988:head# 2024-04-01T20:04:50.245 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.245 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebfb4230:::benchmark_data_smithi188_173515_object111072:head# 2024-04-01T20:04:50.245 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.246 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebfc7c41:::benchmark_data_smithi188_173515_object145917:head# 2024-04-01T20:04:50.246 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.246 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebfc7fc1:::benchmark_data_smithi188_173515_object131212:head# 2024-04-01T20:04:50.246 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.246 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebfcc693:::benchmark_data_smithi188_173515_object149547:head# 2024-04-01T20:04:50.246 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.246 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebfcd2a6:::benchmark_data_smithi188_173515_object124575:head# 2024-04-01T20:04:50.246 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.246 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebfd41a7:::benchmark_data_smithi188_173515_object70536:head# 2024-04-01T20:04:50.246 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.246 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebfd6bcc:::benchmark_data_smithi188_173515_object73448:head# 2024-04-01T20:04:50.246 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.246 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebfea5c0:::benchmark_data_smithi188_173515_object69022:head# 2024-04-01T20:04:50.246 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.247 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebfed0ca:::benchmark_data_smithi188_173515_object71360:head# 2024-04-01T20:04:50.247 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.247 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ebfed913:::benchmark_data_smithi188_173515_object91804:head# 2024-04-01T20:04:50.247 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.247 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec00c27d:::benchmark_data_smithi188_173515_object112295:head# 2024-04-01T20:04:50.247 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.247 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec01183e:::benchmark_data_smithi188_173515_object61940:head# 2024-04-01T20:04:50.247 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.247 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec0131bb:::benchmark_data_smithi188_173515_object79730:head# 2024-04-01T20:04:50.247 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.247 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec0169f4:::benchmark_data_smithi188_173515_object55517:head# 2024-04-01T20:04:50.247 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.247 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec020405:::benchmark_data_smithi188_173515_object117389:head# 2024-04-01T20:04:50.248 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.248 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec0247f1:::benchmark_data_smithi188_173515_object93707:head# 2024-04-01T20:04:50.248 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.248 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec031fc9:::benchmark_data_smithi188_173515_object149354:head# 2024-04-01T20:04:50.248 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.248 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec037920:::benchmark_data_smithi188_173515_object109654:head# 2024-04-01T20:04:50.248 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.248 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec03a499:::benchmark_data_smithi188_173515_object139202:head# 2024-04-01T20:04:50.248 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.248 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec03c432:::benchmark_data_smithi188_173515_object66472:head# 2024-04-01T20:04:50.248 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.248 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec046d8b:::benchmark_data_smithi188_173515_object91207:head# 2024-04-01T20:04:50.248 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.248 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec069a7f:::benchmark_data_smithi188_173515_object113236:head# 2024-04-01T20:04:50.248 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.249 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec0720a3:::benchmark_data_smithi188_173515_object147358:head# 2024-04-01T20:04:50.249 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.249 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec073d6b:::benchmark_data_smithi188_173515_object57604:head# 2024-04-01T20:04:50.249 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.249 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec07995e:::benchmark_data_smithi188_173515_object130801:head# 2024-04-01T20:04:50.249 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.249 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec0b6ec7:::benchmark_data_smithi188_173515_object111551:head# 2024-04-01T20:04:50.249 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.249 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec0bb7be:::benchmark_data_smithi188_173515_object151890:head# 2024-04-01T20:04:50.249 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.249 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec0bdb71:::benchmark_data_smithi188_173515_object57692:head# 2024-04-01T20:04:50.249 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.249 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec0beb5f:::benchmark_data_smithi188_173515_object63164:head# 2024-04-01T20:04:50.250 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.250 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec0bf539:::benchmark_data_smithi188_173515_object111283:head# 2024-04-01T20:04:50.250 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.250 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec0c506e:::benchmark_data_smithi188_173515_object92527:head# 2024-04-01T20:04:50.250 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.250 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec0c7580:::benchmark_data_smithi188_173515_object124811:head# 2024-04-01T20:04:50.250 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.250 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec0d2f9b:::benchmark_data_smithi188_173515_object140642:head# 2024-04-01T20:04:50.250 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.250 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec0e028e:::benchmark_data_smithi188_173515_object108660:head# 2024-04-01T20:04:50.250 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.250 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec0fca8b:::benchmark_data_smithi188_173515_object58754:head# 2024-04-01T20:04:50.250 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.250 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec10bf74:::benchmark_data_smithi188_173515_object75577:head# 2024-04-01T20:04:50.251 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.251 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec1153ba:::benchmark_data_smithi188_173515_object126020:head# 2024-04-01T20:04:50.251 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.251 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec124824:::benchmark_data_smithi188_173515_object45674:head# 2024-04-01T20:04:50.251 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.251 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec12f64a:::benchmark_data_smithi188_173515_object151226:head# 2024-04-01T20:04:50.251 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.251 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec132ceb:::benchmark_data_smithi188_173515_object46614:head# 2024-04-01T20:04:50.251 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.251 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec147be5:::benchmark_data_smithi188_173515_object82201:head# 2024-04-01T20:04:50.251 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.251 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec14921c:::benchmark_data_smithi188_173515_object155242:head# 2024-04-01T20:04:50.251 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.251 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec1574f7:::benchmark_data_smithi188_173515_object66562:head# 2024-04-01T20:04:50.251 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.252 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec160245:::benchmark_data_smithi188_173515_object54832:head# 2024-04-01T20:04:50.252 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.252 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec1750d0:::benchmark_data_smithi188_173515_object63661:head# 2024-04-01T20:04:50.252 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.252 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec17b87d:::benchmark_data_smithi188_173515_object60268:head# 2024-04-01T20:04:50.252 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.252 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec18b016:::benchmark_data_smithi188_173515_object70281:head# 2024-04-01T20:04:50.252 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.252 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec18d6fb:::benchmark_data_smithi188_173515_object78581:head# 2024-04-01T20:04:50.252 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.252 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec1913fa:::benchmark_data_smithi188_173515_object115702:head# 2024-04-01T20:04:50.252 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.252 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec195687:::benchmark_data_smithi188_173515_object93393:head# 2024-04-01T20:04:50.252 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.252 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec19e49e:::benchmark_data_smithi188_173515_object63471:head# 2024-04-01T20:04:50.253 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.253 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec1a8431:::benchmark_data_smithi188_173515_object126230:head# 2024-04-01T20:04:50.253 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.253 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec1ba3c8:::benchmark_data_smithi188_173515_object60627:head# 2024-04-01T20:04:50.253 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.253 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec1bc806:::benchmark_data_smithi188_173515_object150134:head# 2024-04-01T20:04:50.253 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.253 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec1c81c0:::benchmark_data_smithi188_173515_object73915:head# 2024-04-01T20:04:50.253 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.253 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec1cc6f2:::benchmark_data_smithi188_173515_object87279:head# 2024-04-01T20:04:50.253 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.253 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec1d29a0:::benchmark_data_smithi188_173515_object67187:head# 2024-04-01T20:04:50.253 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.253 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec1d41fd:::benchmark_data_smithi188_173515_object83395:head# 2024-04-01T20:04:50.254 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.254 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec1d5caa:::benchmark_data_smithi188_173515_object99371:head# 2024-04-01T20:04:50.254 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.254 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec1da626:::benchmark_data_smithi188_173515_object107965:head# 2024-04-01T20:04:50.254 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.254 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec1dd503:::benchmark_data_smithi188_173515_object64638:head# 2024-04-01T20:04:50.254 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.254 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec1e5cf9:::benchmark_data_smithi188_173515_object51525:head# 2024-04-01T20:04:50.254 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.254 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec1e8345:::benchmark_data_smithi188_173515_object131024:head# 2024-04-01T20:04:50.254 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.254 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec1edbd0:::benchmark_data_smithi188_173515_object65858:head# 2024-04-01T20:04:50.254 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.254 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec207171:::benchmark_data_smithi188_173515_object94405:head# 2024-04-01T20:04:50.255 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.255 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec20b0bc:::benchmark_data_smithi188_173515_object144869:head# 2024-04-01T20:04:50.255 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.255 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec21020d:::benchmark_data_smithi188_173515_object110264:head# 2024-04-01T20:04:50.255 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.255 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec21166e:::benchmark_data_smithi188_173515_object134831:head# 2024-04-01T20:04:50.255 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.255 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec21da98:::benchmark_data_smithi188_173515_object101446:head# 2024-04-01T20:04:50.255 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.255 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec23266b:::benchmark_data_smithi188_173515_object125111:head# 2024-04-01T20:04:50.255 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.255 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec232e2a:::benchmark_data_smithi188_173515_object113783:head# 2024-04-01T20:04:50.255 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.255 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec23aae6:::benchmark_data_smithi188_173515_object122277:head# 2024-04-01T20:04:50.256 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.256 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec246590:::benchmark_data_smithi188_173515_object147645:head# 2024-04-01T20:04:50.256 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.256 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec2478ba:::benchmark_data_smithi188_173515_object56131:head# 2024-04-01T20:04:50.256 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.256 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec248ec7:::benchmark_data_smithi188_173515_object76409:head# 2024-04-01T20:04:50.256 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.256 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec24ad63:::benchmark_data_smithi188_173515_object138251:head# 2024-04-01T20:04:50.256 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.256 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec24bee6:::benchmark_data_smithi188_173515_object128355:head# 2024-04-01T20:04:50.256 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.256 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec251a3f:::benchmark_data_smithi188_173515_object71138:head# 2024-04-01T20:04:50.256 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.256 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec252e94:::benchmark_data_smithi188_173515_object46806:head# 2024-04-01T20:04:50.256 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.256 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec256f35:::benchmark_data_smithi188_173515_object110298:head# 2024-04-01T20:04:50.257 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.257 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec2593f9:::benchmark_data_smithi188_173515_object122418:head# 2024-04-01T20:04:50.257 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.257 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec25dd5c:::benchmark_data_smithi188_173515_object151481:head# 2024-04-01T20:04:50.257 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.257 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec262f7a:::benchmark_data_smithi188_173515_object96621:head# 2024-04-01T20:04:50.257 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.257 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec266a2d:::benchmark_data_smithi188_173515_object111945:head# 2024-04-01T20:04:50.257 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.257 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec2692bb:::benchmark_data_smithi188_173515_object142409:head# 2024-04-01T20:04:50.257 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.257 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec2699ad:::benchmark_data_smithi188_173515_object48076:head# 2024-04-01T20:04:50.257 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.257 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec27c12f:::benchmark_data_smithi188_173515_object63739:head# 2024-04-01T20:04:50.257 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.258 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec28a6e6:::benchmark_data_smithi188_173515_object112476:head# 2024-04-01T20:04:50.258 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.258 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec28d2eb:::benchmark_data_smithi188_173515_object101510:head# 2024-04-01T20:04:50.258 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.258 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec294788:::benchmark_data_smithi188_173515_object150736:head# 2024-04-01T20:04:50.258 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.258 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec29bc30:::benchmark_data_smithi188_173515_object62126:head# 2024-04-01T20:04:50.258 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.258 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec29cef3:::benchmark_data_smithi188_173515_object78802:head# 2024-04-01T20:04:50.258 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.258 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec2a52fb:::benchmark_data_smithi188_173515_object53182:head# 2024-04-01T20:04:50.258 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.258 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec2b7af3:::benchmark_data_smithi188_173515_object115364:head# 2024-04-01T20:04:50.258 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.259 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec2bb6ab:::benchmark_data_smithi188_173515_object90226:head# 2024-04-01T20:04:50.259 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.259 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec2bdd1f:::benchmark_data_smithi188_173515_object61931:head# 2024-04-01T20:04:50.259 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.259 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec2c456e:::benchmark_data_smithi188_173515_object54340:head# 2024-04-01T20:04:50.259 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.259 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec2cc214:::benchmark_data_smithi188_173515_object70834:head# 2024-04-01T20:04:50.259 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.259 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec2cef79:::benchmark_data_smithi188_173515_object80359:head# 2024-04-01T20:04:50.259 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.259 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec2e604d:::benchmark_data_smithi188_173515_object94768:head# 2024-04-01T20:04:50.259 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.259 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec2f1f5c:::benchmark_data_smithi188_173515_object75613:head# 2024-04-01T20:04:50.259 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.259 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec2f31c9:::benchmark_data_smithi188_173515_object89197:head# 2024-04-01T20:04:50.259 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.260 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec2f9864:::benchmark_data_smithi188_173515_object89134:head# 2024-04-01T20:04:50.260 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.260 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec31990e:::benchmark_data_smithi188_173515_object93804:head# 2024-04-01T20:04:50.260 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.260 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec31b636:::benchmark_data_smithi188_173515_object142164:head# 2024-04-01T20:04:50.260 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.260 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec31f534:::benchmark_data_smithi188_173515_object149819:head# 2024-04-01T20:04:50.260 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.260 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec327fc3:::benchmark_data_smithi188_173515_object79835:head# 2024-04-01T20:04:50.260 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.260 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec328cbe:::benchmark_data_smithi188_173515_object128338:head# 2024-04-01T20:04:50.260 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.260 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec332c57:::benchmark_data_smithi188_173515_object80742:head# 2024-04-01T20:04:50.260 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.260 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec337098:::benchmark_data_smithi188_173515_object122010:head# 2024-04-01T20:04:50.261 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.261 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec33ea27:::benchmark_data_smithi188_173515_object123146:head# 2024-04-01T20:04:50.261 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.261 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec33ec33:::benchmark_data_smithi188_173515_object151251:head# 2024-04-01T20:04:50.261 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.261 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec3435a0:::benchmark_data_smithi188_173515_object61831:head# 2024-04-01T20:04:50.261 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.261 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec3484a5:::benchmark_data_smithi188_173515_object90263:head# 2024-04-01T20:04:50.261 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.261 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec3499c3:::benchmark_data_smithi188_173515_object154449:head# 2024-04-01T20:04:50.261 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.261 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec34c7f2:::benchmark_data_smithi188_173515_object93466:head# 2024-04-01T20:04:50.261 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.261 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec34daca:::benchmark_data_smithi188_173515_object141475:head# 2024-04-01T20:04:50.261 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.262 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec354351:::benchmark_data_smithi188_173515_object138692:head# 2024-04-01T20:04:50.262 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.262 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec355bb4:::benchmark_data_smithi188_173515_object155507:head# 2024-04-01T20:04:50.262 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.262 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec359ec8:::benchmark_data_smithi188_173515_object48584:head# 2024-04-01T20:04:50.262 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.262 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec35c2ff:::benchmark_data_smithi188_173515_object100950:head# 2024-04-01T20:04:50.262 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.262 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec35e1c9:::benchmark_data_smithi188_173515_object59521:head# 2024-04-01T20:04:50.262 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.262 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec375368:::benchmark_data_smithi188_173515_object153495:head# 2024-04-01T20:04:50.262 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.262 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec390475:::benchmark_data_smithi188_173515_object115503:head# 2024-04-01T20:04:50.262 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.263 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec391782:::benchmark_data_smithi188_173515_object70707:head# 2024-04-01T20:04:50.263 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.263 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec3a58b9:::benchmark_data_smithi188_173515_object45992:head# 2024-04-01T20:04:50.263 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.263 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec3b0839:::benchmark_data_smithi188_173515_object135406:head# 2024-04-01T20:04:50.263 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.263 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec3b2899:::benchmark_data_smithi188_173515_object65238:head# 2024-04-01T20:04:50.263 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.263 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec3bc903:::benchmark_data_smithi188_173515_object86341:head# 2024-04-01T20:04:50.263 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.263 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec3c8e89:::benchmark_data_smithi188_173515_object79370:head# 2024-04-01T20:04:50.263 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.263 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec3db4be:::benchmark_data_smithi188_173515_object71343:head# 2024-04-01T20:04:50.263 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.263 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec3ed47d:::benchmark_data_smithi188_173515_object66561:head# 2024-04-01T20:04:50.263 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.264 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec40b5b0:::benchmark_data_smithi188_173515_object46852:head# 2024-04-01T20:04:50.264 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.264 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec41045c:::benchmark_data_smithi188_173515_object81899:head# 2024-04-01T20:04:50.264 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.264 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec416730:::benchmark_data_smithi188_173515_object75009:head# 2024-04-01T20:04:50.264 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.264 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec41812d:::benchmark_data_smithi188_173515_object56564:head# 2024-04-01T20:04:50.264 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.264 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec4293b4:::benchmark_data_smithi188_173515_object105376:head# 2024-04-01T20:04:50.264 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.264 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec436f71:::benchmark_data_smithi188_173515_object129786:head# 2024-04-01T20:04:50.264 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.264 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec4527ee:::benchmark_data_smithi188_173515_object90289:head# 2024-04-01T20:04:50.264 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.264 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec45ba25:::benchmark_data_smithi188_173515_object136993:head# 2024-04-01T20:04:50.264 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.265 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec45e554:::benchmark_data_smithi188_173515_object125451:head# 2024-04-01T20:04:50.265 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.265 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec4620cf:::benchmark_data_smithi188_173515_object64771:head# 2024-04-01T20:04:50.265 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.265 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec471c8f:::benchmark_data_smithi188_173515_object146434:head# 2024-04-01T20:04:50.265 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.265 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec472f6e:::benchmark_data_smithi188_173515_object101799:head# 2024-04-01T20:04:50.265 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.265 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec477875:::benchmark_data_smithi188_173515_object85130:head# 2024-04-01T20:04:50.265 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.265 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec4a1cd3:::benchmark_data_smithi188_173515_object109981:head# 2024-04-01T20:04:50.265 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.265 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec4a9d5a:::benchmark_data_smithi188_173515_object62636:head# 2024-04-01T20:04:50.265 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.265 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec4c0595:::benchmark_data_smithi188_173515_object73338:head# 2024-04-01T20:04:50.265 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.266 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec4c0949:::benchmark_data_smithi188_173515_object71845:head# 2024-04-01T20:04:50.266 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.266 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec4c23b8:::benchmark_data_smithi188_173515_object75006:head# 2024-04-01T20:04:50.266 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.266 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec4c3ea2:::benchmark_data_smithi188_173515_object92120:head# 2024-04-01T20:04:50.266 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.266 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec4c4482:::benchmark_data_smithi188_173515_object133082:head# 2024-04-01T20:04:50.266 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.266 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec4c4c14:::benchmark_data_smithi188_173515_object96205:head# 2024-04-01T20:04:50.266 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.266 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec4c8ecd:::benchmark_data_smithi188_173515_object146264:head# 2024-04-01T20:04:50.266 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.266 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec4cb7fe:::benchmark_data_smithi188_173515_object129732:head# 2024-04-01T20:04:50.266 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.266 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec4cd489:::benchmark_data_smithi188_173515_object147101:head# 2024-04-01T20:04:50.267 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.267 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec4cfd1f:::benchmark_data_smithi188_173515_object83351:head# 2024-04-01T20:04:50.267 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.267 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec4d8cc2:::benchmark_data_smithi188_173515_object111318:head# 2024-04-01T20:04:50.267 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.267 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec4e00b4:::benchmark_data_smithi188_173515_object129375:head# 2024-04-01T20:04:50.267 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.267 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec4ed2e1:::benchmark_data_smithi188_173515_object54876:head# 2024-04-01T20:04:50.267 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.267 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec4f7abb:::benchmark_data_smithi188_173515_object147046:head# 2024-04-01T20:04:50.267 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.267 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec4fb631:::benchmark_data_smithi188_173515_object71989:head# 2024-04-01T20:04:50.267 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.267 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec4febd7:::benchmark_data_smithi188_173515_object134487:head# 2024-04-01T20:04:50.267 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.268 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec503ac5:::benchmark_data_smithi188_173515_object84245:head# 2024-04-01T20:04:50.268 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.268 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec505265:::benchmark_data_smithi188_173515_object61786:head# 2024-04-01T20:04:50.268 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.268 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec50c1cc:::benchmark_data_smithi188_173515_object84784:head# 2024-04-01T20:04:50.268 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.268 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec5112b2:::benchmark_data_smithi188_173515_object51243:head# 2024-04-01T20:04:50.268 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.268 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec514bd1:::benchmark_data_smithi188_173515_object59120:head# 2024-04-01T20:04:50.268 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.268 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec51655b:::benchmark_data_smithi188_173515_object138790:head# 2024-04-01T20:04:50.268 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.268 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec51b51d:::benchmark_data_smithi188_173515_object146232:head# 2024-04-01T20:04:50.268 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.268 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec53069c:::benchmark_data_smithi188_173515_object66092:head# 2024-04-01T20:04:50.268 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.269 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec5370b1:::benchmark_data_smithi188_173515_object100363:head# 2024-04-01T20:04:50.269 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.269 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec5412f7:::benchmark_data_smithi188_173515_object122848:head# 2024-04-01T20:04:50.269 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.269 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec5427a5:::benchmark_data_smithi188_173515_object101557:head# 2024-04-01T20:04:50.269 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.269 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec545d6a:::benchmark_data_smithi188_173515_object77556:head# 2024-04-01T20:04:50.269 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.269 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec548243:::benchmark_data_smithi188_173515_object80443:head# 2024-04-01T20:04:50.269 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.269 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec54a94c:::benchmark_data_smithi188_173515_object151474:head# 2024-04-01T20:04:50.269 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.269 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec54d742:::benchmark_data_smithi188_173515_object129362:head# 2024-04-01T20:04:50.269 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.269 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec56706c:::benchmark_data_smithi188_173515_object101780:head# 2024-04-01T20:04:50.269 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.270 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec5806b6:::benchmark_data_smithi188_173515_object57531:head# 2024-04-01T20:04:50.270 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.270 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec5816be:::benchmark_data_smithi188_173515_object118016:head# 2024-04-01T20:04:50.270 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.270 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec593a45:::benchmark_data_smithi188_173515_object127074:head# 2024-04-01T20:04:50.270 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.270 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec59d16e:::benchmark_data_smithi188_173515_object51836:head# 2024-04-01T20:04:50.270 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.270 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec59e0cf:::benchmark_data_smithi188_173515_object80075:head# 2024-04-01T20:04:50.270 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.270 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec5ab4ab:::benchmark_data_smithi188_173515_object93391:head# 2024-04-01T20:04:50.270 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.270 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec5ae543:::benchmark_data_smithi188_173515_object154937:head# 2024-04-01T20:04:50.271 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.271 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec5af07c:::benchmark_data_smithi188_173515_object60362:head# 2024-04-01T20:04:50.271 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.271 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec5c1bcb:::benchmark_data_smithi188_173515_object65124:head# 2024-04-01T20:04:50.271 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.271 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec5e0961:::benchmark_data_smithi188_173515_object100601:head# 2024-04-01T20:04:50.271 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.271 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec5ea7a2:::benchmark_data_smithi188_173515_object126486:head# 2024-04-01T20:04:50.271 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.271 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec5eacc5:::benchmark_data_smithi188_173515_object120858:head# 2024-04-01T20:04:50.271 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.271 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec5f1f1d:::benchmark_data_smithi188_173515_object142629:head# 2024-04-01T20:04:50.271 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.271 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec604761:::benchmark_data_smithi188_173515_object120487:head# 2024-04-01T20:04:50.271 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.272 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec604d29:::benchmark_data_smithi188_173515_object96187:head# 2024-04-01T20:04:50.272 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.272 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec616dad:::benchmark_data_smithi188_173515_object112780:head# 2024-04-01T20:04:50.272 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.272 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec61e73f:::benchmark_data_smithi188_173515_object64603:head# 2024-04-01T20:04:50.272 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.272 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec61efd3:::benchmark_data_smithi188_173515_object74768:head# 2024-04-01T20:04:50.272 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.272 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec61fe10:::benchmark_data_smithi188_173515_object83725:head# 2024-04-01T20:04:50.272 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.272 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec622ffd:::benchmark_data_smithi188_173515_object102307:head# 2024-04-01T20:04:50.272 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.272 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec6312f6:::benchmark_data_smithi188_173515_object145201:head# 2024-04-01T20:04:50.272 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.272 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec63d6f4:::benchmark_data_smithi188_173515_object49046:head# 2024-04-01T20:04:50.272 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.273 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec63e7d9:::benchmark_data_smithi188_173515_object51636:head# 2024-04-01T20:04:50.273 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.273 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec644829:::benchmark_data_smithi188_173515_object96375:head# 2024-04-01T20:04:50.273 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.273 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec65176e:::benchmark_data_smithi188_173515_object70718:head# 2024-04-01T20:04:50.273 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.273 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec66a3d0:::benchmark_data_smithi188_173515_object112662:head# 2024-04-01T20:04:50.273 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.273 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec66a7b8:::benchmark_data_smithi188_173515_object154637:head# 2024-04-01T20:04:50.273 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.273 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec677d9e:::benchmark_data_smithi188_173515_object49840:head# 2024-04-01T20:04:50.273 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.273 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec6824ae:::benchmark_data_smithi188_173515_object140801:head# 2024-04-01T20:04:50.273 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.273 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec685d25:::benchmark_data_smithi188_173515_object118079:head# 2024-04-01T20:04:50.274 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.274 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec6a200a:::benchmark_data_smithi188_173515_object115437:head# 2024-04-01T20:04:50.274 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.274 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec6af2d0:::benchmark_data_smithi188_173515_object142012:head# 2024-04-01T20:04:50.274 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.274 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec6af6e5:::benchmark_data_smithi188_173515_object55805:head# 2024-04-01T20:04:50.274 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.274 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec6b64d1:::benchmark_data_smithi188_173515_object134135:head# 2024-04-01T20:04:50.274 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.274 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec6ba18e:::benchmark_data_smithi188_173515_object101050:head# 2024-04-01T20:04:50.274 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.274 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec6cec9f:::benchmark_data_smithi188_173515_object93836:head# 2024-04-01T20:04:50.274 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.274 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec6debc5:::benchmark_data_smithi188_173515_object57416:head# 2024-04-01T20:04:50.275 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.275 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec6e0cd9:::benchmark_data_smithi188_173515_object109740:head# 2024-04-01T20:04:50.275 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.275 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec6eb1f8:::benchmark_data_smithi188_173515_object102652:head# 2024-04-01T20:04:50.275 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.275 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec6edc5a:::benchmark_data_smithi188_173515_object61470:head# 2024-04-01T20:04:50.275 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.275 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec7089bc:::benchmark_data_smithi188_173515_object140864:head# 2024-04-01T20:04:50.275 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.275 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec70efd3:::benchmark_data_smithi188_173515_object122725:head# 2024-04-01T20:04:50.275 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.275 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec710704:::benchmark_data_smithi188_173515_object71270:head# 2024-04-01T20:04:50.275 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.275 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec7264c7:::benchmark_data_smithi188_173515_object124127:head# 2024-04-01T20:04:50.275 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.276 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec732160:::benchmark_data_smithi188_173515_object89742:head# 2024-04-01T20:04:50.276 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.276 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec73543d:::benchmark_data_smithi188_173515_object83602:head# 2024-04-01T20:04:50.276 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.276 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec7395f4:::benchmark_data_smithi188_173515_object151966:head# 2024-04-01T20:04:50.276 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.276 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec74535e:::benchmark_data_smithi188_173515_object86192:head# 2024-04-01T20:04:50.276 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.276 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec74a987:::benchmark_data_smithi188_173515_object86824:head# 2024-04-01T20:04:50.276 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.276 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec74b0b8:::benchmark_data_smithi188_173515_object46839:head# 2024-04-01T20:04:50.276 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.276 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec77a33f:::benchmark_data_smithi188_173515_object87904:head# 2024-04-01T20:04:50.276 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.276 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec77c95c:::benchmark_data_smithi188_173515_object140163:head# 2024-04-01T20:04:50.277 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.277 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec782c3c:::benchmark_data_smithi188_173515_object106851:head# 2024-04-01T20:04:50.277 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.277 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec79a9a7:::benchmark_data_smithi188_173515_object132044:head# 2024-04-01T20:04:50.277 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.277 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec7a81a4:::benchmark_data_smithi188_173515_object66989:head# 2024-04-01T20:04:50.277 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.277 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec7adff3:::benchmark_data_smithi188_173515_object47396:head# 2024-04-01T20:04:50.277 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.277 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec7b2d34:::benchmark_data_smithi188_173515_object114640:head# 2024-04-01T20:04:50.277 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.277 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec7b4329:::benchmark_data_smithi188_173515_object128586:head# 2024-04-01T20:04:50.277 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.277 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec7bf31b:::benchmark_data_smithi188_173515_object150769:head# 2024-04-01T20:04:50.277 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.277 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec7cf17a:::benchmark_data_smithi188_173515_object119452:head# 2024-04-01T20:04:50.278 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.278 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec7dc993:::benchmark_data_smithi188_173515_object62703:head# 2024-04-01T20:04:50.278 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.278 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec7e5c6c:::benchmark_data_smithi188_173515_object57156:head# 2024-04-01T20:04:50.278 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.278 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec7e7cc5:::benchmark_data_smithi188_173515_object105106:head# 2024-04-01T20:04:50.278 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.278 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec7f0596:::benchmark_data_smithi188_173515_object125082:head# 2024-04-01T20:04:50.278 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.278 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec7f4fe9:::benchmark_data_smithi188_173515_object77963:head# 2024-04-01T20:04:50.278 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.278 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec7f6562:::benchmark_data_smithi188_173515_object155931:head# 2024-04-01T20:04:50.278 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.278 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec7fdf0a:::benchmark_data_smithi188_173515_object110379:head# 2024-04-01T20:04:50.279 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.279 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec803a65:::benchmark_data_smithi188_173515_object150105:head# 2024-04-01T20:04:50.279 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.279 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec81ba64:::benchmark_data_smithi188_173515_object121211:head# 2024-04-01T20:04:50.279 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.279 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec820fac:::benchmark_data_smithi188_173515_object72292:head# 2024-04-01T20:04:50.279 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.279 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec82cad1:::benchmark_data_smithi188_173515_object129895:head# 2024-04-01T20:04:50.279 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.279 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec82ea60:::benchmark_data_smithi188_173515_object126390:head# 2024-04-01T20:04:50.279 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.279 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec8378e5:::benchmark_data_smithi188_173515_object58030:head# 2024-04-01T20:04:50.279 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.279 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec839205:::benchmark_data_smithi188_173515_object59098:head# 2024-04-01T20:04:50.279 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.279 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec83a983:::benchmark_data_smithi188_173515_object63555:head# 2024-04-01T20:04:50.280 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.280 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec83f5f8:::benchmark_data_smithi188_173515_object151304:head# 2024-04-01T20:04:50.280 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.280 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec840b38:::benchmark_data_smithi188_173515_object64547:head# 2024-04-01T20:04:50.280 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.280 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec84a5f8:::benchmark_data_smithi188_173515_object94874:head# 2024-04-01T20:04:50.280 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.280 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec853177:::benchmark_data_smithi188_173515_object142568:head# 2024-04-01T20:04:50.280 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.280 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec85a5c0:::benchmark_data_smithi188_173515_object61579:head# 2024-04-01T20:04:50.280 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.280 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec85e453:::benchmark_data_smithi188_173515_object93336:head# 2024-04-01T20:04:50.280 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.280 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec85fe29:::benchmark_data_smithi188_173515_object66477:head# 2024-04-01T20:04:50.281 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.281 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec869ca9:::benchmark_data_smithi188_173515_object145669:head# 2024-04-01T20:04:50.281 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.281 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec86a938:::benchmark_data_smithi188_173515_object139795:head# 2024-04-01T20:04:50.281 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.281 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec87802c:::benchmark_data_smithi188_173515_object135059:head# 2024-04-01T20:04:50.281 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.281 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec87864e:::benchmark_data_smithi188_173515_object114142:head# 2024-04-01T20:04:50.281 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.281 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec895d1a:::benchmark_data_smithi188_173515_object134868:head# 2024-04-01T20:04:50.281 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.281 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec8a5597:::benchmark_data_smithi188_173515_object51395:head# 2024-04-01T20:04:50.281 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.281 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec8ab833:::benchmark_data_smithi188_173515_object123655:head# 2024-04-01T20:04:50.281 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.282 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec8ac36c:::benchmark_data_smithi188_173515_object111184:head# 2024-04-01T20:04:50.282 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.282 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec8b484d:::benchmark_data_smithi188_173515_object154078:head# 2024-04-01T20:04:50.282 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.282 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec8b4e22:::benchmark_data_smithi188_173515_object152427:head# 2024-04-01T20:04:50.282 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.282 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec8b5fe2:::benchmark_data_smithi188_173515_object137292:head# 2024-04-01T20:04:50.282 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.282 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec8b7c98:::benchmark_data_smithi188_173515_object130589:head# 2024-04-01T20:04:50.282 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.282 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec8d6163:::benchmark_data_smithi188_173515_object61362:head# 2024-04-01T20:04:50.282 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.282 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec8deeb9:::benchmark_data_smithi188_173515_object114916:head# 2024-04-01T20:04:50.282 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.282 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec8e1be2:::benchmark_data_smithi188_173515_object91870:head# 2024-04-01T20:04:50.283 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.283 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec8fb6a0:::benchmark_data_smithi188_173515_object124941:head# 2024-04-01T20:04:50.283 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.283 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec9056c8:::benchmark_data_smithi188_173515_object84358:head# 2024-04-01T20:04:50.283 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.283 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec913f54:::benchmark_data_smithi188_173515_object148524:head# 2024-04-01T20:04:50.283 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.283 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec929135:::benchmark_data_smithi188_173515_object52863:head# 2024-04-01T20:04:50.283 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.283 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec9419eb:::benchmark_data_smithi188_173515_object50036:head# 2024-04-01T20:04:50.283 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.283 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec948fa8:::benchmark_data_smithi188_173515_object120570:head# 2024-04-01T20:04:50.283 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.283 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec9518fa:::benchmark_data_smithi188_173515_object84895:head# 2024-04-01T20:04:50.283 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.283 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec95667b:::benchmark_data_smithi188_173515_object151602:head# 2024-04-01T20:04:50.284 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.284 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec95f6ec:::benchmark_data_smithi188_173515_object137792:head# 2024-04-01T20:04:50.284 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.284 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec967080:::benchmark_data_smithi188_173515_object107312:head# 2024-04-01T20:04:50.284 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.284 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec96bef2:::benchmark_data_smithi188_173515_object110780:head# 2024-04-01T20:04:50.284 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.284 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec9770d3:::benchmark_data_smithi188_173515_object104578:head# 2024-04-01T20:04:50.284 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.284 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec97eb3e:::benchmark_data_smithi188_173515_object98132:head# 2024-04-01T20:04:50.284 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.284 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec987b70:::benchmark_data_smithi188_173515_object115798:head# 2024-04-01T20:04:50.284 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.284 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec98b03d:::benchmark_data_smithi188_173515_object136028:head# 2024-04-01T20:04:50.284 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.285 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec997f76:::benchmark_data_smithi188_173515_object106920:head# 2024-04-01T20:04:50.285 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.285 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec9a51f6:::benchmark_data_smithi188_173515_object85910:head# 2024-04-01T20:04:50.285 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.285 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec9a91b2:::benchmark_data_smithi188_173515_object155967:head# 2024-04-01T20:04:50.285 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.285 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec9aa925:::benchmark_data_smithi188_173515_object48663:head# 2024-04-01T20:04:50.285 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.285 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec9bcfc5:::benchmark_data_smithi188_173515_object95853:head# 2024-04-01T20:04:50.285 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.285 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec9dd87f:::benchmark_data_smithi188_173515_object92811:head# 2024-04-01T20:04:50.285 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.285 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec9de4cf:::benchmark_data_smithi188_173515_object142866:head# 2024-04-01T20:04:50.285 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.285 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec9e4373:::benchmark_data_smithi188_173515_object121369:head# 2024-04-01T20:04:50.286 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.286 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec9e4fbc:::benchmark_data_smithi188_173515_object81927:head# 2024-04-01T20:04:50.286 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.286 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec9ea53b:::benchmark_data_smithi188_173515_object72948:head# 2024-04-01T20:04:50.286 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.286 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec9f4b3a:::benchmark_data_smithi188_173515_object48302:head# 2024-04-01T20:04:50.286 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.286 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ec9f6f7c:::benchmark_data_smithi188_173515_object75303:head# 2024-04-01T20:04:50.286 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.286 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eca0fe49:::benchmark_data_smithi188_173515_object126784:head# 2024-04-01T20:04:50.286 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.286 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eca21ebb:::benchmark_data_smithi188_173515_object88336:head# 2024-04-01T20:04:50.286 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.287 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eca2a6ff:::benchmark_data_smithi188_173515_object114593:head# 2024-04-01T20:04:50.287 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.287 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eca2d561:::benchmark_data_smithi188_173515_object110303:head# 2024-04-01T20:04:50.287 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.287 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eca38865:::benchmark_data_smithi188_173515_object92127:head# 2024-04-01T20:04:50.287 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.287 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eca39b70:::benchmark_data_smithi188_173515_object78229:head# 2024-04-01T20:04:50.287 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.287 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eca48985:::benchmark_data_smithi188_173515_object148844:head# 2024-04-01T20:04:50.287 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.287 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eca560d2:::benchmark_data_smithi188_173515_object62678:head# 2024-04-01T20:04:50.287 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.287 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eca63bcd:::benchmark_data_smithi188_173515_object115080:head# 2024-04-01T20:04:50.287 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.287 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eca68939:::benchmark_data_smithi188_173515_object107649:head# 2024-04-01T20:04:50.287 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.288 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eca6961d:::benchmark_data_smithi188_173515_object129915:head# 2024-04-01T20:04:50.288 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.288 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eca73567:::benchmark_data_smithi188_173515_object80041:head# 2024-04-01T20:04:50.288 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.288 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eca89035:::benchmark_data_smithi188_173515_object141763:head# 2024-04-01T20:04:50.288 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.288 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eca8b6dc:::benchmark_data_smithi188_173515_object148105:head# 2024-04-01T20:04:50.288 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.288 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eca8e667:::benchmark_data_smithi188_173515_object126169:head# 2024-04-01T20:04:50.288 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.288 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eca98252:::benchmark_data_smithi188_173515_object136191:head# 2024-04-01T20:04:50.288 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.288 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecaa1530:::benchmark_data_smithi188_173515_object93967:head# 2024-04-01T20:04:50.288 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.288 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecaa9ffd:::benchmark_data_smithi188_173515_object104282:head# 2024-04-01T20:04:50.289 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.289 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecaaab6b:::benchmark_data_smithi188_173515_object102947:head# 2024-04-01T20:04:50.289 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.289 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecaae7b5:::benchmark_data_smithi188_173515_object149131:head# 2024-04-01T20:04:50.289 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.289 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecac2791:::benchmark_data_smithi188_173515_object47417:head# 2024-04-01T20:04:50.289 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.289 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecac3c9b:::benchmark_data_smithi188_173515_object141028:head# 2024-04-01T20:04:50.289 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.289 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecaccda5:::benchmark_data_smithi188_173515_object142396:head# 2024-04-01T20:04:50.289 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.289 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecacfc47:::benchmark_data_smithi188_173515_object137098:head# 2024-04-01T20:04:50.289 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.289 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecadf953:::benchmark_data_smithi188_173515_object145949:head# 2024-04-01T20:04:50.289 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.289 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecae9f49:::benchmark_data_smithi188_173515_object90475:head# 2024-04-01T20:04:50.290 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.290 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecaf7e55:::benchmark_data_smithi188_173515_object147309:head# 2024-04-01T20:04:50.290 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.290 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecaf7e93:::benchmark_data_smithi188_173515_object60367:head# 2024-04-01T20:04:50.290 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.290 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecaf90e0:::benchmark_data_smithi188_173515_object116747:head# 2024-04-01T20:04:50.290 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.290 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecb07ac8:::benchmark_data_smithi188_173515_object64172:head# 2024-04-01T20:04:50.290 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.290 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecb0f8f9:::benchmark_data_smithi188_173515_object151586:head# 2024-04-01T20:04:50.290 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.290 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecb10a93:::benchmark_data_smithi188_173515_object131870:head# 2024-04-01T20:04:50.290 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.291 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecb10c67:::benchmark_data_smithi188_173515_object77887:head# 2024-04-01T20:04:50.291 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.291 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecb11eef:::benchmark_data_smithi188_173515_object129026:head# 2024-04-01T20:04:50.291 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.291 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecb167ed:::benchmark_data_smithi188_173515_object63610:head# 2024-04-01T20:04:50.291 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.291 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecb16e59:::benchmark_data_smithi188_173515_object124351:head# 2024-04-01T20:04:50.291 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.291 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecb1f155:::benchmark_data_smithi188_173515_object108239:head# 2024-04-01T20:04:50.291 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.291 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecb20766:::benchmark_data_smithi188_173515_object48198:head# 2024-04-01T20:04:50.291 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.291 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecb2168e:::benchmark_data_smithi188_173515_object135921:head# 2024-04-01T20:04:50.291 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.291 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecb37d4e:::benchmark_data_smithi188_173515_object115765:head# 2024-04-01T20:04:50.292 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.292 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecb41a67:::benchmark_data_smithi188_173515_object53094:head# 2024-04-01T20:04:50.292 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.292 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecb57bd6:::benchmark_data_smithi188_173515_object147367:head# 2024-04-01T20:04:50.292 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.292 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecb59c72:::benchmark_data_smithi188_173515_object105486:head# 2024-04-01T20:04:50.292 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.292 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecb5f405:::benchmark_data_smithi188_173515_object108286:head# 2024-04-01T20:04:50.292 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.292 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecb62aca:::benchmark_data_smithi188_173515_object57016:head# 2024-04-01T20:04:50.292 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.292 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecb8e49c:::benchmark_data_smithi188_173515_object104141:head# 2024-04-01T20:04:50.292 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.292 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecb90e68:::benchmark_data_smithi188_173515_object94796:head# 2024-04-01T20:04:50.292 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.293 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecb9e7d8:::benchmark_data_smithi188_173515_object105154:head# 2024-04-01T20:04:50.293 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.293 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecba234b:::benchmark_data_smithi188_173515_object107091:head# 2024-04-01T20:04:50.293 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.293 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecbc1631:::benchmark_data_smithi188_173515_object76488:head# 2024-04-01T20:04:50.293 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.293 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecbc52e0:::benchmark_data_smithi188_173515_object111229:head# 2024-04-01T20:04:50.293 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.293 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecbcbb73:::benchmark_data_smithi188_173515_object148837:head# 2024-04-01T20:04:50.293 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.293 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecbcfb55:::benchmark_data_smithi188_173515_object119036:head# 2024-04-01T20:04:50.293 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.293 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecbd3647:::benchmark_data_smithi188_173515_object77209:head# 2024-04-01T20:04:50.293 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.293 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecbdc936:::benchmark_data_smithi188_173515_object145497:head# 2024-04-01T20:04:50.293 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.294 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecbe3108:::benchmark_data_smithi188_173515_object101511:head# 2024-04-01T20:04:50.294 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.294 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecbe3243:::benchmark_data_smithi188_173515_object155294:head# 2024-04-01T20:04:50.294 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.294 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecbe9282:::benchmark_data_smithi188_173515_object84790:head# 2024-04-01T20:04:50.294 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.294 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecbe9eab:::benchmark_data_smithi188_173515_object136494:head# 2024-04-01T20:04:50.294 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.294 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecbea1d6:::benchmark_data_smithi188_173515_object49104:head# 2024-04-01T20:04:50.294 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.294 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecbeb160:::benchmark_data_smithi188_173515_object79649:head# 2024-04-01T20:04:50.294 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.294 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecbeb1e4:::benchmark_data_smithi188_173515_object111697:head# 2024-04-01T20:04:50.294 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.295 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecbee32e:::benchmark_data_smithi188_173515_object94119:head# 2024-04-01T20:04:50.295 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.295 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecbf8a62:::benchmark_data_smithi188_173515_object46303:head# 2024-04-01T20:04:50.295 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.295 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecc0047e:::benchmark_data_smithi188_173515_object142172:head# 2024-04-01T20:04:50.295 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.295 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecc046e4:::benchmark_data_smithi188_173515_object136427:head# 2024-04-01T20:04:50.295 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.295 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecc12c63:::benchmark_data_smithi188_173515_object154040:head# 2024-04-01T20:04:50.295 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.295 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecc2355c:::benchmark_data_smithi188_173515_object76131:head# 2024-04-01T20:04:50.295 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.295 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecc28cc4:::benchmark_data_smithi188_173515_object74496:head# 2024-04-01T20:04:50.295 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.295 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecc2b6bc:::benchmark_data_smithi188_173515_object140578:head# 2024-04-01T20:04:50.296 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.296 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecc3154d:::benchmark_data_smithi188_173515_object123036:head# 2024-04-01T20:04:50.296 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.296 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecc48927:::benchmark_data_smithi188_173515_object100794:head# 2024-04-01T20:04:50.296 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.296 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecc5560e:::benchmark_data_smithi188_173515_object97672:head# 2024-04-01T20:04:50.296 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.296 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecc5b459:::benchmark_data_smithi188_173515_object148129:head# 2024-04-01T20:04:50.296 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.296 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecc608b5:::benchmark_data_smithi188_173515_object133128:head# 2024-04-01T20:04:50.296 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.296 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecc67e9b:::benchmark_data_smithi188_173515_object134271:head# 2024-04-01T20:04:50.296 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.296 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecc752e4:::benchmark_data_smithi188_173515_object88432:head# 2024-04-01T20:04:50.296 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.297 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecc90f89:::benchmark_data_smithi188_173515_object68367:head# 2024-04-01T20:04:50.297 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.297 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecc9cf79:::benchmark_data_smithi188_173515_object72930:head# 2024-04-01T20:04:50.297 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.297 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecca25d0:::benchmark_data_smithi188_173515_object85839:head# 2024-04-01T20:04:50.297 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.297 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecca53dd:::benchmark_data_smithi188_173515_object123572:head# 2024-04-01T20:04:50.297 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.297 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecca78ad:::benchmark_data_smithi188_173515_object138023:head# 2024-04-01T20:04:50.297 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.297 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eccb0411:::benchmark_data_smithi188_173515_object126208:head# 2024-04-01T20:04:50.297 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.297 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eccbfe72:::benchmark_data_smithi188_173515_object112501:head# 2024-04-01T20:04:50.297 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.298 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eccc06cf:::benchmark_data_smithi188_173515_object82503:head# 2024-04-01T20:04:50.298 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.298 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eccc6e26:::benchmark_data_smithi188_173515_object100539:head# 2024-04-01T20:04:50.298 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.298 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eccc8209:::benchmark_data_smithi188_173515_object107950:head# 2024-04-01T20:04:50.298 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.298 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecccf2bb:::benchmark_data_smithi188_173515_object113084:head# 2024-04-01T20:04:50.298 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.298 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eccd2299:::benchmark_data_smithi188_173515_object48397:head# 2024-04-01T20:04:50.298 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.298 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eccd703c:::benchmark_data_smithi188_173515_object76381:head# 2024-04-01T20:04:50.298 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.298 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eccd9ae6:::benchmark_data_smithi188_173515_object61496:head# 2024-04-01T20:04:50.298 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.299 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecce474e:::benchmark_data_smithi188_173515_object85768:head# 2024-04-01T20:04:50.299 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.299 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecceddf7:::benchmark_data_smithi188_173515_object67071:head# 2024-04-01T20:04:50.299 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.299 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eccf2e01:::benchmark_data_smithi188_173515_object113645:head# 2024-04-01T20:04:50.299 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.299 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eccf75b2:::benchmark_data_smithi188_173515_object50149:head# 2024-04-01T20:04:50.299 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.299 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eccfd362:::benchmark_data_smithi188_173515_object126627:head# 2024-04-01T20:04:50.299 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.299 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecd037e3:::benchmark_data_smithi188_173515_object52606:head# 2024-04-01T20:04:50.299 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.299 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecd1f971:::benchmark_data_smithi188_173515_object95884:head# 2024-04-01T20:04:50.299 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.300 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecd24d93:::benchmark_data_smithi188_173515_object68260:head# 2024-04-01T20:04:50.300 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.300 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecd2b0f5:::benchmark_data_smithi188_173515_object75063:head# 2024-04-01T20:04:50.300 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.300 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecd41444:::benchmark_data_smithi188_173515_object135815:head# 2024-04-01T20:04:50.300 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.300 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecd43545:::benchmark_data_smithi188_173515_object126300:head# 2024-04-01T20:04:50.300 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.300 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecd4ed84:::benchmark_data_smithi188_173515_object76289:head# 2024-04-01T20:04:50.300 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.300 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecd613cd:::benchmark_data_smithi188_173515_object54197:head# 2024-04-01T20:04:50.300 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.300 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecd66e3e:::benchmark_data_smithi188_173515_object57823:head# 2024-04-01T20:04:50.300 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.300 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecd6d5ce:::benchmark_data_smithi188_173515_object106475:head# 2024-04-01T20:04:50.301 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.301 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecd7a674:::benchmark_data_smithi188_173515_object105190:head# 2024-04-01T20:04:50.301 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.301 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecd92d31:::benchmark_data_smithi188_173515_object101725:head# 2024-04-01T20:04:50.301 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.301 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecd93436:::benchmark_data_smithi188_173515_object123505:head# 2024-04-01T20:04:50.301 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.301 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecd9e0b2:::benchmark_data_smithi188_173515_object108225:head# 2024-04-01T20:04:50.301 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.301 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecdb5836:::benchmark_data_smithi188_173515_object112540:head# 2024-04-01T20:04:50.301 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.301 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecdbbc19:::benchmark_data_smithi188_173515_object145532:head# 2024-04-01T20:04:50.301 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.301 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecdce5eb:::benchmark_data_smithi188_173515_object119981:head# 2024-04-01T20:04:50.301 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.302 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecdda1a4:::benchmark_data_smithi188_173515_object133290:head# 2024-04-01T20:04:50.302 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.302 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecddbb0d:::benchmark_data_smithi188_173515_object55652:head# 2024-04-01T20:04:50.302 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.302 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecdf8568:::benchmark_data_smithi188_173515_object97479:head# 2024-04-01T20:04:50.302 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.302 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ece01ff1:::benchmark_data_smithi188_173515_object90792:head# 2024-04-01T20:04:50.302 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.302 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ece07589:::benchmark_data_smithi188_173515_object63981:head# 2024-04-01T20:04:50.302 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.302 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ece1b63e:::benchmark_data_smithi188_173515_object146529:head# 2024-04-01T20:04:50.302 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.302 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ece1eff6:::benchmark_data_smithi188_173515_object51080:head# 2024-04-01T20:04:50.302 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.302 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ece1f969:::benchmark_data_smithi188_173515_object64350:head# 2024-04-01T20:04:50.303 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.303 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ece21e99:::benchmark_data_smithi188_173515_object77923:head# 2024-04-01T20:04:50.303 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.303 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ece31be9:::benchmark_data_smithi188_173515_object150436:head# 2024-04-01T20:04:50.303 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.303 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ece381d0:::benchmark_data_smithi188_173515_object123962:head# 2024-04-01T20:04:50.303 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.303 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ece47bca:::benchmark_data_smithi188_173515_object152886:head# 2024-04-01T20:04:50.303 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.303 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ece47c7d:::benchmark_data_smithi188_173515_object52846:head# 2024-04-01T20:04:50.303 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.303 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ece494ad:::benchmark_data_smithi188_173515_object71162:head# 2024-04-01T20:04:50.303 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.303 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ece4ddff:::benchmark_data_smithi188_173515_object95237:head# 2024-04-01T20:04:50.303 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.304 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ece5ae8b:::benchmark_data_smithi188_173515_object70977:head# 2024-04-01T20:04:50.304 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.304 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ece5c279:::benchmark_data_smithi188_173515_object140760:head# 2024-04-01T20:04:50.304 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.304 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ece718de:::benchmark_data_smithi188_173515_object93751:head# 2024-04-01T20:04:50.304 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.304 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ece7c3a8:::benchmark_data_smithi188_173515_object122226:head# 2024-04-01T20:04:50.304 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.304 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ece819c2:::benchmark_data_smithi188_173515_object115453:head# 2024-04-01T20:04:50.304 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.304 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ece9c96e:::benchmark_data_smithi188_173515_object117238:head# 2024-04-01T20:04:50.304 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.304 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecebead3:::benchmark_data_smithi188_173515_object56733:head# 2024-04-01T20:04:50.304 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.304 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecebfb36:::benchmark_data_smithi188_173515_object93301:head# 2024-04-01T20:04:50.305 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.305 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecec2a21:::benchmark_data_smithi188_173515_object113152:head# 2024-04-01T20:04:50.305 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.305 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eced099f:::benchmark_data_smithi188_173515_object76272:head# 2024-04-01T20:04:50.305 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.305 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eced36c3:::benchmark_data_smithi188_173515_object86662:head# 2024-04-01T20:04:50.305 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.305 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eced70d1:::benchmark_data_smithi188_173515_object77961:head# 2024-04-01T20:04:50.305 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.305 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eceeb7ef:::benchmark_data_smithi188_173515_object137190:head# 2024-04-01T20:04:50.305 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.305 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecef293d:::benchmark_data_smithi188_173515_object141549:head# 2024-04-01T20:04:50.305 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.305 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecef9f7e:::benchmark_data_smithi188_173515_object134726:head# 2024-04-01T20:04:50.305 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.306 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecefa77d:::benchmark_data_smithi188_173515_object59129:head# 2024-04-01T20:04:50.306 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.306 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecf00a53:::benchmark_data_smithi188_173515_object109973:head# 2024-04-01T20:04:50.306 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.306 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecf00fd3:::benchmark_data_smithi188_173515_object111489:head# 2024-04-01T20:04:50.306 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.306 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecf04a00:::benchmark_data_smithi188_173515_object149133:head# 2024-04-01T20:04:50.306 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.306 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecf06660:::benchmark_data_smithi188_173515_object84860:head# 2024-04-01T20:04:50.306 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.306 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecf07413:::benchmark_data_smithi188_173515_object152554:head# 2024-04-01T20:04:50.306 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.306 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecf218ae:::benchmark_data_smithi188_173515_object69303:head# 2024-04-01T20:04:50.306 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.307 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecf2267b:::benchmark_data_smithi188_173515_object151374:head# 2024-04-01T20:04:50.307 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.307 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecf350e8:::benchmark_data_smithi188_173515_object136503:head# 2024-04-01T20:04:50.307 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.307 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecf36580:::benchmark_data_smithi188_173515_object107569:head# 2024-04-01T20:04:50.307 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.307 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecf3851a:::benchmark_data_smithi188_173515_object78812:head# 2024-04-01T20:04:50.307 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.307 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecf459f7:::benchmark_data_smithi188_173515_object113585:head# 2024-04-01T20:04:50.307 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.307 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecf4eec3:::benchmark_data_smithi188_173515_object97935:head# 2024-04-01T20:04:50.307 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.307 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecf51dfd:::benchmark_data_smithi188_173515_object136102:head# 2024-04-01T20:04:50.307 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.307 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecf681e6:::benchmark_data_smithi188_173515_object71230:head# 2024-04-01T20:04:50.307 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.308 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecf7b547:::benchmark_data_smithi188_173515_object64502:head# 2024-04-01T20:04:50.308 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.308 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecf7ed75:::benchmark_data_smithi188_173515_object147372:head# 2024-04-01T20:04:50.308 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.308 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecf9af14:::benchmark_data_smithi188_173515_object150028:head# 2024-04-01T20:04:50.308 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.308 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecf9b0f3:::benchmark_data_smithi188_173515_object115678:head# 2024-04-01T20:04:50.308 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.308 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecf9dc93:::benchmark_data_smithi188_173515_object143631:head# 2024-04-01T20:04:50.308 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.308 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecfa96e6:::benchmark_data_smithi188_173515_object59724:head# 2024-04-01T20:04:50.308 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.308 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecfa9a87:::benchmark_data_smithi188_173515_object74189:head# 2024-04-01T20:04:50.308 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.308 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecfafb16:::benchmark_data_smithi188_173515_object121397:head# 2024-04-01T20:04:50.309 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.309 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecfb0f16:::benchmark_data_smithi188_173515_object77333:head# 2024-04-01T20:04:50.309 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.309 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecfb6fd4:::benchmark_data_smithi188_173515_object113212:head# 2024-04-01T20:04:50.309 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.309 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecfb86b9:::benchmark_data_smithi188_173515_object112936:head# 2024-04-01T20:04:50.309 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.309 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecfc2fe6:::benchmark_data_smithi188_173515_object50099:head# 2024-04-01T20:04:50.309 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.309 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecfc769f:::benchmark_data_smithi188_173515_object114977:head# 2024-04-01T20:04:50.309 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.309 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecfc9858:::benchmark_data_smithi188_173515_object148465:head# 2024-04-01T20:04:50.309 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.309 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecfd6be5:::benchmark_data_smithi188_173515_object141226:head# 2024-04-01T20:04:50.309 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.310 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecfe343f:::benchmark_data_smithi188_173515_object65125:head# 2024-04-01T20:04:50.310 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.310 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecfef831:::benchmark_data_smithi188_173515_object78260:head# 2024-04-01T20:04:50.310 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.310 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecff550d:::benchmark_data_smithi188_173515_object87314:head# 2024-04-01T20:04:50.310 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.310 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecff57d5:::benchmark_data_smithi188_173515_object82661:head# 2024-04-01T20:04:50.310 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.310 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ecffa682:::benchmark_data_smithi188_173515_object130047:head# 2024-04-01T20:04:50.310 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.310 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed00d7f9:::benchmark_data_smithi188_173515_object95482:head# 2024-04-01T20:04:50.310 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.310 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed01abd8:::benchmark_data_smithi188_173515_object128761:head# 2024-04-01T20:04:50.310 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.310 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed028772:::benchmark_data_smithi188_173515_object134826:head# 2024-04-01T20:04:50.311 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.311 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed02e5b3:::benchmark_data_smithi188_173515_object76156:head# 2024-04-01T20:04:50.311 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.311 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed02fd10:::benchmark_data_smithi188_173515_object76039:head# 2024-04-01T20:04:50.311 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.311 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed03fac0:::benchmark_data_smithi188_173515_object97955:head# 2024-04-01T20:04:50.311 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.311 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed046018:::benchmark_data_smithi188_173515_object85684:head# 2024-04-01T20:04:50.311 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.311 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed048dad:::benchmark_data_smithi188_173515_object53041:head# 2024-04-01T20:04:50.311 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.311 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed065332:::benchmark_data_smithi188_173515_object108176:head# 2024-04-01T20:04:50.311 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.311 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed06c6f7:::benchmark_data_smithi188_173515_object62598:head# 2024-04-01T20:04:50.312 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.312 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed082d25:::benchmark_data_smithi188_173515_object54965:head# 2024-04-01T20:04:50.312 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.312 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed083fd3:::benchmark_data_smithi188_173515_object138526:head# 2024-04-01T20:04:50.312 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.312 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed08fad3:::benchmark_data_smithi188_173515_object50059:head# 2024-04-01T20:04:50.312 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.312 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed098b59:::benchmark_data_smithi188_173515_object154145:head# 2024-04-01T20:04:50.312 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.312 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed09d933:::benchmark_data_smithi188_173515_object131124:head# 2024-04-01T20:04:50.312 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.312 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed0a97f7:::benchmark_data_smithi188_173515_object147803:head# 2024-04-01T20:04:50.312 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.312 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed0bcac5:::benchmark_data_smithi188_173515_object144104:head# 2024-04-01T20:04:50.312 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.313 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed0d7f0e:::benchmark_data_smithi188_173515_object154001:head# 2024-04-01T20:04:50.313 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.313 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed0e079d:::benchmark_data_smithi188_173515_object134888:head# 2024-04-01T20:04:50.313 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.313 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed0e0be4:::benchmark_data_smithi188_173515_object153589:head# 2024-04-01T20:04:50.313 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.313 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed0e700d:::benchmark_data_smithi188_173515_object136462:head# 2024-04-01T20:04:50.313 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.313 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed0f455d:::benchmark_data_smithi188_173515_object47694:head# 2024-04-01T20:04:50.313 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.313 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed0f541c:::benchmark_data_smithi188_173515_object101079:head# 2024-04-01T20:04:50.313 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.313 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed0f7826:::benchmark_data_smithi188_173515_object77396:head# 2024-04-01T20:04:50.313 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.314 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed0fdc21:::benchmark_data_smithi188_173515_object124870:head# 2024-04-01T20:04:50.314 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.314 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed0ffc37:::benchmark_data_smithi188_173515_object74631:head# 2024-04-01T20:04:50.314 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.314 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed104eb2:::benchmark_data_smithi188_173515_object77522:head# 2024-04-01T20:04:50.314 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.314 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed10ac90:::benchmark_data_smithi188_173515_object138467:head# 2024-04-01T20:04:50.314 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.314 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed112526:::benchmark_data_smithi188_173515_object133601:head# 2024-04-01T20:04:50.314 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.314 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed112f68:::benchmark_data_smithi188_173515_object123028:head# 2024-04-01T20:04:50.314 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.314 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed116265:::benchmark_data_smithi188_173515_object105156:head# 2024-04-01T20:04:50.315 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.315 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed13a38f:::benchmark_data_smithi188_173515_object132058:head# 2024-04-01T20:04:50.315 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.315 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed1403af:::benchmark_data_smithi188_173515_object107571:head# 2024-04-01T20:04:50.315 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.315 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed14ec7c:::benchmark_data_smithi188_173515_object116557:head# 2024-04-01T20:04:50.315 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.315 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed152b56:::benchmark_data_smithi188_173515_object78367:head# 2024-04-01T20:04:50.315 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.315 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed159b83:::benchmark_data_smithi188_173515_object57686:head# 2024-04-01T20:04:50.315 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.315 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed15ad09:::benchmark_data_smithi188_173515_object93483:head# 2024-04-01T20:04:50.315 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.315 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed16bdb4:::benchmark_data_smithi188_173515_object126147:head# 2024-04-01T20:04:50.315 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.316 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed172794:::benchmark_data_smithi188_173515_object142452:head# 2024-04-01T20:04:50.316 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.316 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed17379d:::benchmark_data_smithi188_173515_object68748:head# 2024-04-01T20:04:50.316 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.316 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed17629b:::benchmark_data_smithi188_173515_object46115:head# 2024-04-01T20:04:50.316 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.316 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed18a3e3:::benchmark_data_smithi188_173515_object113689:head# 2024-04-01T20:04:50.316 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.316 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed1918ce:::benchmark_data_smithi188_173515_object110586:head# 2024-04-01T20:04:50.316 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.316 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed198a07:::benchmark_data_smithi188_173515_object152482:head# 2024-04-01T20:04:50.316 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.316 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed19f109:::benchmark_data_smithi188_173515_object69428:head# 2024-04-01T20:04:50.317 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.317 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed1a1e05:::benchmark_data_smithi188_173515_object56462:head# 2024-04-01T20:04:50.317 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.317 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed1a4154:::benchmark_data_smithi188_173515_object114347:head# 2024-04-01T20:04:50.317 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.317 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed1abe39:::benchmark_data_smithi188_173515_object49248:head# 2024-04-01T20:04:50.317 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.317 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed1aeef9:::benchmark_data_smithi188_173515_object101316:head# 2024-04-01T20:04:50.317 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.317 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed1b3203:::benchmark_data_smithi188_173515_object109595:head# 2024-04-01T20:04:50.317 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.317 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed1c2933:::benchmark_data_smithi188_173515_object137070:head# 2024-04-01T20:04:50.317 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.317 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed1c2b30:::benchmark_data_smithi188_173515_object106749:head# 2024-04-01T20:04:50.317 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.318 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed1e235d:::benchmark_data_smithi188_173515_object67224:head# 2024-04-01T20:04:50.318 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.318 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed1e480e:::benchmark_data_smithi188_173515_object146455:head# 2024-04-01T20:04:50.318 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.318 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed1e8543:::benchmark_data_smithi188_173515_object113669:head# 2024-04-01T20:04:50.318 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.318 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed1fe193:::benchmark_data_smithi188_173515_object89498:head# 2024-04-01T20:04:50.318 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.318 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed207d7f:::benchmark_data_smithi188_173515_object146396:head# 2024-04-01T20:04:50.318 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.318 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed20b35d:::benchmark_data_smithi188_173515_object130021:head# 2024-04-01T20:04:50.318 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.318 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed21b663:::benchmark_data_smithi188_173515_object151997:head# 2024-04-01T20:04:50.319 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.319 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed21ba3d:::benchmark_data_smithi188_173515_object131598:head# 2024-04-01T20:04:50.319 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.319 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed21edd8:::benchmark_data_smithi188_173515_object113957:head# 2024-04-01T20:04:50.319 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.319 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed2280a8:::benchmark_data_smithi188_173515_object68986:head# 2024-04-01T20:04:50.319 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.319 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed236943:::benchmark_data_smithi188_173515_object143721:head# 2024-04-01T20:04:50.319 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.319 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed23a304:::benchmark_data_smithi188_173515_object112494:head# 2024-04-01T20:04:50.319 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.319 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed244538:::benchmark_data_smithi188_173515_object126336:head# 2024-04-01T20:04:50.319 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.319 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed24e6aa:::benchmark_data_smithi188_173515_object47309:head# 2024-04-01T20:04:50.320 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.320 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed2508b2:::benchmark_data_smithi188_173515_object90109:head# 2024-04-01T20:04:50.320 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.320 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed26115c:::benchmark_data_smithi188_173515_object146925:head# 2024-04-01T20:04:50.320 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.320 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed26b2fd:::benchmark_data_smithi188_173515_object75793:head# 2024-04-01T20:04:50.320 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.320 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed26da63:::benchmark_data_smithi188_173515_object86575:head# 2024-04-01T20:04:50.320 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.320 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed27375c:::benchmark_data_smithi188_173515_object149020:head# 2024-04-01T20:04:50.320 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.320 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed27b3d8:::benchmark_data_smithi188_173515_object92509:head# 2024-04-01T20:04:50.320 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.320 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed2803f0:::benchmark_data_smithi188_173515_object95174:head# 2024-04-01T20:04:50.320 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.321 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed281f42:::benchmark_data_smithi188_173515_object84870:head# 2024-04-01T20:04:50.321 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.321 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed282051:::benchmark_data_smithi188_173515_object88817:head# 2024-04-01T20:04:50.321 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.321 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed28771e:::benchmark_data_smithi188_173515_object83700:head# 2024-04-01T20:04:50.321 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.321 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed28aae1:::benchmark_data_smithi188_173515_object104532:head# 2024-04-01T20:04:50.321 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.321 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed29c6fb:::benchmark_data_smithi188_173515_object88477:head# 2024-04-01T20:04:50.321 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.321 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed29dcfb:::benchmark_data_smithi188_173515_object92681:head# 2024-04-01T20:04:50.321 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.321 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed29eae0:::benchmark_data_smithi188_173515_object85299:head# 2024-04-01T20:04:50.321 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.322 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed2ae2c7:::benchmark_data_smithi188_173515_object85807:head# 2024-04-01T20:04:50.322 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.322 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed2af160:::benchmark_data_smithi188_173515_object127789:head# 2024-04-01T20:04:50.322 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.322 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed2d632c:::benchmark_data_smithi188_173515_object70835:head# 2024-04-01T20:04:50.322 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.322 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed2f762a:::benchmark_data_smithi188_173515_object100789:head# 2024-04-01T20:04:50.322 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.322 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed30f5d2:::benchmark_data_smithi188_173515_object137067:head# 2024-04-01T20:04:50.322 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.322 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed311650:::benchmark_data_smithi188_173515_object151699:head# 2024-04-01T20:04:50.322 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.322 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed317013:::benchmark_data_smithi188_173515_object101147:head# 2024-04-01T20:04:50.323 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.323 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed31f396:::benchmark_data_smithi188_173515_object116190:head# 2024-04-01T20:04:50.323 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.323 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed32469b:::benchmark_data_smithi188_173515_object112830:head# 2024-04-01T20:04:50.323 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.323 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed328ec7:::benchmark_data_smithi188_173515_object101914:head# 2024-04-01T20:04:50.323 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.323 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed349abc:::benchmark_data_smithi188_173515_object113194:head# 2024-04-01T20:04:50.323 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.323 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed359597:::benchmark_data_smithi188_173515_object150469:head# 2024-04-01T20:04:50.323 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.323 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed362359:::benchmark_data_smithi188_173515_object155965:head# 2024-04-01T20:04:50.323 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.323 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed3741fc:::benchmark_data_smithi188_173515_object145208:head# 2024-04-01T20:04:50.323 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.324 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed374aea:::benchmark_data_smithi188_173515_object83956:head# 2024-04-01T20:04:50.324 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.324 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed376637:::benchmark_data_smithi188_173515_object75633:head# 2024-04-01T20:04:50.324 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.324 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed378e3e:::benchmark_data_smithi188_173515_object58163:head# 2024-04-01T20:04:50.324 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.324 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed3834e8:::benchmark_data_smithi188_173515_object83731:head# 2024-04-01T20:04:50.324 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.324 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed38bf79:::benchmark_data_smithi188_173515_object94943:head# 2024-04-01T20:04:50.324 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.324 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed396e50:::benchmark_data_smithi188_173515_object101645:head# 2024-04-01T20:04:50.324 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.324 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed39b0e0:::benchmark_data_smithi188_173515_object58276:head# 2024-04-01T20:04:50.324 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.325 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed3ab22d:::benchmark_data_smithi188_173515_object64574:head# 2024-04-01T20:04:50.325 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.325 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed3b24aa:::benchmark_data_smithi188_173515_object92511:head# 2024-04-01T20:04:50.325 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.325 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed3b5a0f:::benchmark_data_smithi188_173515_object61531:head# 2024-04-01T20:04:50.325 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.325 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed3bcf54:::benchmark_data_smithi188_173515_object68583:head# 2024-04-01T20:04:50.325 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.325 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed3e3704:::benchmark_data_smithi188_173515_object116703:head# 2024-04-01T20:04:50.325 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.325 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed3e5e98:::benchmark_data_smithi188_173515_object68376:head# 2024-04-01T20:04:50.325 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.325 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed3e75e8:::benchmark_data_smithi188_173515_object93865:head# 2024-04-01T20:04:50.325 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.326 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed3fe6ac:::benchmark_data_smithi188_173515_object118827:head# 2024-04-01T20:04:50.326 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.326 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed403fc3:::benchmark_data_smithi188_173515_object121260:head# 2024-04-01T20:04:50.326 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.326 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed40d3d9:::benchmark_data_smithi188_173515_object94716:head# 2024-04-01T20:04:50.326 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.326 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed412278:::benchmark_data_smithi188_173515_object58921:head# 2024-04-01T20:04:50.326 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.326 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed413f33:::benchmark_data_smithi188_173515_object152364:head# 2024-04-01T20:04:50.326 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.326 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed41437d:::benchmark_data_smithi188_173515_object120792:head# 2024-04-01T20:04:50.326 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.326 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed42d226:::benchmark_data_smithi188_173515_object130195:head# 2024-04-01T20:04:50.327 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.327 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed433ad2:::benchmark_data_smithi188_173515_object115725:head# 2024-04-01T20:04:50.327 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.327 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed441c42:::benchmark_data_smithi188_173515_object79053:head# 2024-04-01T20:04:50.327 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.327 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed4445fe:::benchmark_data_smithi188_173515_object100440:head# 2024-04-01T20:04:50.327 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.327 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed445e6b:::benchmark_data_smithi188_173515_object114391:head# 2024-04-01T20:04:50.327 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.327 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed454c47:::benchmark_data_smithi188_173515_object99957:head# 2024-04-01T20:04:50.327 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.327 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed45cd12:::benchmark_data_smithi188_173515_object138419:head# 2024-04-01T20:04:50.327 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.327 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed487fc6:::benchmark_data_smithi188_173515_object78358:head# 2024-04-01T20:04:50.327 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.328 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed488217:::benchmark_data_smithi188_173515_object114507:head# 2024-04-01T20:04:50.328 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.328 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed4942ad:::benchmark_data_smithi188_173515_object116975:head# 2024-04-01T20:04:50.328 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.328 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed496810:::benchmark_data_smithi188_173515_object62371:head# 2024-04-01T20:04:50.328 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.328 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed4a1b8c:::benchmark_data_smithi188_173515_object82880:head# 2024-04-01T20:04:50.328 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.328 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed4a2724:::benchmark_data_smithi188_173515_object152342:head# 2024-04-01T20:04:50.328 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.328 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed4a7496:::benchmark_data_smithi188_173515_object64775:head# 2024-04-01T20:04:50.328 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.328 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed4bfc18:::benchmark_data_smithi188_173515_object144967:head# 2024-04-01T20:04:50.328 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.329 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed4cfc45:::benchmark_data_smithi188_173515_object149145:head# 2024-04-01T20:04:50.329 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.329 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed4d166e:::benchmark_data_smithi188_173515_object149872:head# 2024-04-01T20:04:50.329 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.329 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed4d2f98:::benchmark_data_smithi188_173515_object61244:head# 2024-04-01T20:04:50.329 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.329 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed4f8ee7:::benchmark_data_smithi188_173515_object46564:head# 2024-04-01T20:04:50.329 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.329 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed4f8fc4:::benchmark_data_smithi188_173515_object89928:head# 2024-04-01T20:04:50.329 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.329 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed4ff84e:::benchmark_data_smithi188_173515_object62268:head# 2024-04-01T20:04:50.329 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.329 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5042ad:::benchmark_data_smithi188_173515_object155208:head# 2024-04-01T20:04:50.329 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.330 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed519842:::benchmark_data_smithi188_173515_object102695:head# 2024-04-01T20:04:50.330 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.330 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed519a97:::benchmark_data_smithi188_173515_object118748:head# 2024-04-01T20:04:50.330 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.330 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed51e065:::benchmark_data_smithi188_173515_object73638:head# 2024-04-01T20:04:50.330 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.330 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed51e544:::benchmark_data_smithi188_173515_object98273:head# 2024-04-01T20:04:50.330 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.330 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed52ef45:::benchmark_data_smithi188_173515_object129954:head# 2024-04-01T20:04:50.330 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.330 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5341dd:::benchmark_data_smithi188_173515_object122044:head# 2024-04-01T20:04:50.330 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.330 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed558e24:::benchmark_data_smithi188_173515_object154584:head# 2024-04-01T20:04:50.331 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.331 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5605a4:::benchmark_data_smithi188_173515_object85989:head# 2024-04-01T20:04:50.331 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.331 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed57ff1f:::benchmark_data_smithi188_173515_object78536:head# 2024-04-01T20:04:50.331 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.331 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed582106:::benchmark_data_smithi188_173515_object134956:head# 2024-04-01T20:04:50.331 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.331 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed58a5a0:::benchmark_data_smithi188_173515_object110104:head# 2024-04-01T20:04:50.331 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.331 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5978e4:::benchmark_data_smithi188_173515_object77253:head# 2024-04-01T20:04:50.331 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.331 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed597d79:::benchmark_data_smithi188_173515_object128894:head# 2024-04-01T20:04:50.331 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.331 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5a03df:::benchmark_data_smithi188_173515_object136306:head# 2024-04-01T20:04:50.332 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.332 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5a0c04:::benchmark_data_smithi188_173515_object110857:head# 2024-04-01T20:04:50.332 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.332 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5a5e55:::benchmark_data_smithi188_173515_object146710:head# 2024-04-01T20:04:50.332 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.332 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5a708d:::benchmark_data_smithi188_173515_object71768:head# 2024-04-01T20:04:50.332 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.332 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5a7115:::benchmark_data_smithi188_173515_object70093:head# 2024-04-01T20:04:50.332 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.332 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5ab8f2:::benchmark_data_smithi188_173515_object82516:head# 2024-04-01T20:04:50.332 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.332 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5b3981:::benchmark_data_smithi188_173515_object58377:head# 2024-04-01T20:04:50.332 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.332 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5b4c76:::benchmark_data_smithi188_173515_object50715:head# 2024-04-01T20:04:50.332 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.333 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5b6a08:::benchmark_data_smithi188_173515_object143428:head# 2024-04-01T20:04:50.333 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.333 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5b8c7d:::benchmark_data_smithi188_173515_object70751:head# 2024-04-01T20:04:50.333 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.333 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5baef2:::benchmark_data_smithi188_173515_object107364:head# 2024-04-01T20:04:50.333 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.333 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5bc3ec:::benchmark_data_smithi188_173515_object99000:head# 2024-04-01T20:04:50.333 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.333 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5be57a:::benchmark_data_smithi188_173515_object60486:head# 2024-04-01T20:04:50.333 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.333 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5c740e:::benchmark_data_smithi188_173515_object120117:head# 2024-04-01T20:04:50.333 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.333 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5cedcd:::benchmark_data_smithi188_173515_object79875:head# 2024-04-01T20:04:50.333 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.333 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5cf629:::benchmark_data_smithi188_173515_object150569:head# 2024-04-01T20:04:50.334 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.334 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5d1ace:::benchmark_data_smithi188_173515_object120513:head# 2024-04-01T20:04:50.334 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.334 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5d2ccb:::benchmark_data_smithi188_173515_object121496:head# 2024-04-01T20:04:50.334 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.334 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5dca46:::benchmark_data_smithi188_173515_object80264:head# 2024-04-01T20:04:50.334 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.334 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5e045a:::benchmark_data_smithi188_173515_object132738:head# 2024-04-01T20:04:50.334 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.334 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5e2eca:::benchmark_data_smithi188_173515_object61865:head# 2024-04-01T20:04:50.334 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.334 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5e4626:::benchmark_data_smithi188_173515_object53339:head# 2024-04-01T20:04:50.335 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.335 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5e9c6b:::benchmark_data_smithi188_173515_object105634:head# 2024-04-01T20:04:50.335 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.335 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5eba83:::benchmark_data_smithi188_173515_object72324:head# 2024-04-01T20:04:50.335 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.335 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5ee800:::benchmark_data_smithi188_173515_object52405:head# 2024-04-01T20:04:50.335 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.335 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed5efd9c:::benchmark_data_smithi188_173515_object128015:head# 2024-04-01T20:04:50.335 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.335 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed601eae:::benchmark_data_smithi188_173515_object58476:head# 2024-04-01T20:04:50.335 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.335 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed6093b7:::benchmark_data_smithi188_173515_object150278:head# 2024-04-01T20:04:50.335 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.335 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed60bf28:::benchmark_data_smithi188_173515_object107498:head# 2024-04-01T20:04:50.335 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.336 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed60d643:::benchmark_data_smithi188_173515_object75735:head# 2024-04-01T20:04:50.336 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.336 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed618951:::benchmark_data_smithi188_173515_object141468:head# 2024-04-01T20:04:50.336 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.336 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed62945a:::benchmark_data_smithi188_173515_object138184:head# 2024-04-01T20:04:50.336 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.336 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed6382a5:::benchmark_data_smithi188_173515_object70592:head# 2024-04-01T20:04:50.336 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.336 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed64ca0f:::benchmark_data_smithi188_173515_object126365:head# 2024-04-01T20:04:50.336 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.336 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed658c81:::benchmark_data_smithi188_173515_object94543:head# 2024-04-01T20:04:50.336 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.336 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed667ae3:::benchmark_data_smithi188_173515_object93526:head# 2024-04-01T20:04:50.336 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.337 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed66b49f:::benchmark_data_smithi188_173515_object122944:head# 2024-04-01T20:04:50.337 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.337 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed66dee7:::benchmark_data_smithi188_173515_object82487:head# 2024-04-01T20:04:50.337 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.337 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed66ff80:::benchmark_data_smithi188_173515_object121889:head# 2024-04-01T20:04:50.337 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.337 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed67d7e9:::benchmark_data_smithi188_173515_object97225:head# 2024-04-01T20:04:50.337 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.337 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed68018d:::benchmark_data_smithi188_173515_object152578:head# 2024-04-01T20:04:50.337 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.337 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed68351e:::benchmark_data_smithi188_173515_object148123:head# 2024-04-01T20:04:50.337 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.337 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed6866b8:::benchmark_data_smithi188_173515_object52911:head# 2024-04-01T20:04:50.337 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.338 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed68f65b:::benchmark_data_smithi188_173515_object128377:head# 2024-04-01T20:04:50.338 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.338 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed6a0dec:::benchmark_data_smithi188_173515_object149392:head# 2024-04-01T20:04:50.338 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.338 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed6bb0e2:::benchmark_data_smithi188_173515_object135203:head# 2024-04-01T20:04:50.338 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.338 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed6bdbf5:::benchmark_data_smithi188_173515_object79277:head# 2024-04-01T20:04:50.338 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.338 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed6d4653:::benchmark_data_smithi188_173515_object119006:head# 2024-04-01T20:04:50.338 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.338 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed6ddcfc:::benchmark_data_smithi188_173515_object64264:head# 2024-04-01T20:04:50.338 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.338 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed6e2639:::benchmark_data_smithi188_173515_object148322:head# 2024-04-01T20:04:50.338 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.339 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed6e3d33:::benchmark_data_smithi188_173515_object125808:head# 2024-04-01T20:04:50.339 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.339 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed6fe088:::benchmark_data_smithi188_173515_object127032:head# 2024-04-01T20:04:50.339 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.339 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed7063c7:::benchmark_data_smithi188_173515_object135400:head# 2024-04-01T20:04:50.339 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.339 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed707805:::benchmark_data_smithi188_173515_object87936:head# 2024-04-01T20:04:50.339 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.339 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed70fbc2:::benchmark_data_smithi188_173515_object78543:head# 2024-04-01T20:04:50.339 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.339 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed71ab67:::benchmark_data_smithi188_173515_object98562:head# 2024-04-01T20:04:50.339 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.339 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed723539:::benchmark_data_smithi188_173515_object78076:head# 2024-04-01T20:04:50.339 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.340 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed73586e:::benchmark_data_smithi188_173515_object150716:head# 2024-04-01T20:04:50.340 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.340 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed73a1ca:::benchmark_data_smithi188_173515_object111212:head# 2024-04-01T20:04:50.340 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.340 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed73cc1e:::benchmark_data_smithi188_173515_object90708:head# 2024-04-01T20:04:50.340 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.340 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed743127:::benchmark_data_smithi188_173515_object142554:head# 2024-04-01T20:04:50.340 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.340 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed748bfe:::benchmark_data_smithi188_173515_object146777:head# 2024-04-01T20:04:50.340 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.340 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed75d0db:::benchmark_data_smithi188_173515_object101372:head# 2024-04-01T20:04:50.340 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.340 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed7603fe:::benchmark_data_smithi188_173515_object105962:head# 2024-04-01T20:04:50.340 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.341 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed771f41:::benchmark_data_smithi188_173515_object119369:head# 2024-04-01T20:04:50.341 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.341 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed775a4b:::benchmark_data_smithi188_173515_object142875:head# 2024-04-01T20:04:50.341 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.341 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed777ce3:::benchmark_data_smithi188_173515_object124297:head# 2024-04-01T20:04:50.341 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.341 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed78843a:::benchmark_data_smithi188_173515_object110431:head# 2024-04-01T20:04:50.341 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.341 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed78edee:::benchmark_data_smithi188_173515_object129578:head# 2024-04-01T20:04:50.341 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.341 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed793ea4:::benchmark_data_smithi188_173515_object117873:head# 2024-04-01T20:04:50.341 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.341 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed79bac4:::benchmark_data_smithi188_173515_object63709:head# 2024-04-01T20:04:50.341 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.341 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed7a12e7:::benchmark_data_smithi188_173515_object60245:head# 2024-04-01T20:04:50.342 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.342 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed7af4d1:::benchmark_data_smithi188_173515_object116097:head# 2024-04-01T20:04:50.342 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.342 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed7b8d8f:::benchmark_data_smithi188_173515_object70946:head# 2024-04-01T20:04:50.342 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.342 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed7ce05a:::benchmark_data_smithi188_173515_object73047:head# 2024-04-01T20:04:50.342 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.342 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed7cf9da:::benchmark_data_smithi188_173515_object104597:head# 2024-04-01T20:04:50.342 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.342 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed7d71df:::benchmark_data_smithi188_173515_object119716:head# 2024-04-01T20:04:50.342 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.342 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed7d83ea:::benchmark_data_smithi188_173515_object136481:head# 2024-04-01T20:04:50.342 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.343 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed7dae35:::benchmark_data_smithi188_173515_object64067:head# 2024-04-01T20:04:50.343 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.343 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed7e5cea:::benchmark_data_smithi188_173515_object82327:head# 2024-04-01T20:04:50.343 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.343 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed7e7ebc:::benchmark_data_smithi188_173515_object50226:head# 2024-04-01T20:04:50.343 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.343 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed7e85ff:::benchmark_data_smithi188_173515_object50684:head# 2024-04-01T20:04:50.343 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.343 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed7f98ef:::benchmark_data_smithi188_173515_object88248:head# 2024-04-01T20:04:50.343 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.343 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed80a402:::benchmark_data_smithi188_173515_object55241:head# 2024-04-01T20:04:50.343 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.343 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed80af81:::benchmark_data_smithi188_173515_object48696:head# 2024-04-01T20:04:50.343 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.343 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed81d171:::benchmark_data_smithi188_173515_object94522:head# 2024-04-01T20:04:50.344 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.344 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed831856:::benchmark_data_smithi188_173515_object76991:head# 2024-04-01T20:04:50.344 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.344 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed835374:::benchmark_data_smithi188_173515_object53854:head# 2024-04-01T20:04:50.344 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.344 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed839b66:::benchmark_data_smithi188_173515_object122967:head# 2024-04-01T20:04:50.344 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.344 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed83cd1b:::benchmark_data_smithi188_173515_object51923:head# 2024-04-01T20:04:50.344 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.344 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed83e0df:::benchmark_data_smithi188_173515_object79200:head# 2024-04-01T20:04:50.344 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.344 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed83eda8:::benchmark_data_smithi188_173515_object108350:head# 2024-04-01T20:04:50.344 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.344 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed844035:::benchmark_data_smithi188_173515_object85381:head# 2024-04-01T20:04:50.344 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.345 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed862661:::benchmark_data_smithi188_173515_object59398:head# 2024-04-01T20:04:50.345 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.345 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed868f21:::benchmark_data_smithi188_173515_object155341:head# 2024-04-01T20:04:50.345 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.345 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed894ef3:::benchmark_data_smithi188_173515_object96603:head# 2024-04-01T20:04:50.345 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.345 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed89b4b3:::benchmark_data_smithi188_173515_object88965:head# 2024-04-01T20:04:50.345 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.345 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed8a6fa2:::benchmark_data_smithi188_173515_object139910:head# 2024-04-01T20:04:50.345 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.345 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed8ad82a:::benchmark_data_smithi188_173515_object134906:head# 2024-04-01T20:04:50.345 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.345 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed8b96b2:::benchmark_data_smithi188_173515_object120668:head# 2024-04-01T20:04:50.345 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.345 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed8cd51c:::benchmark_data_smithi188_173515_object109665:head# 2024-04-01T20:04:50.345 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.346 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed8cddef:::benchmark_data_smithi188_173515_object145906:head# 2024-04-01T20:04:50.346 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.346 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed8da31e:::benchmark_data_smithi188_173515_object96181:head# 2024-04-01T20:04:50.346 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.346 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed8f246a:::benchmark_data_smithi188_173515_object49657:head# 2024-04-01T20:04:50.346 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.346 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed90388c:::benchmark_data_smithi188_173515_object136538:head# 2024-04-01T20:04:50.346 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.346 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed904db3:::benchmark_data_smithi188_173515_object135168:head# 2024-04-01T20:04:50.346 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.346 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed90b0b3:::benchmark_data_smithi188_173515_object115027:head# 2024-04-01T20:04:50.346 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.346 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed90b0eb:::benchmark_data_smithi188_173515_object59808:head# 2024-04-01T20:04:50.346 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.347 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed9196fb:::benchmark_data_smithi188_173515_object82143:head# 2024-04-01T20:04:50.347 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.347 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed92c1de:::benchmark_data_smithi188_173515_object90566:head# 2024-04-01T20:04:50.347 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.347 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed93684c:::benchmark_data_smithi188_173515_object140285:head# 2024-04-01T20:04:50.347 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.347 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed950773:::benchmark_data_smithi188_173515_object129697:head# 2024-04-01T20:04:50.347 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.347 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed953db4:::benchmark_data_smithi188_173515_object121444:head# 2024-04-01T20:04:50.347 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.347 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed95631b:::benchmark_data_smithi188_173515_object142013:head# 2024-04-01T20:04:50.347 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.347 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed956ff9:::benchmark_data_smithi188_173515_object149770:head# 2024-04-01T20:04:50.347 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.347 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed95ea3c:::benchmark_data_smithi188_173515_object79918:head# 2024-04-01T20:04:50.347 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.348 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed9760f7:::benchmark_data_smithi188_173515_object152188:head# 2024-04-01T20:04:50.348 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.348 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed97d0ba:::benchmark_data_smithi188_173515_object133658:head# 2024-04-01T20:04:50.348 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.348 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed992f99:::benchmark_data_smithi188_173515_object81319:head# 2024-04-01T20:04:50.348 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.348 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed999307:::benchmark_data_smithi188_173515_object95004:head# 2024-04-01T20:04:50.348 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.348 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed999a75:::benchmark_data_smithi188_173515_object61602:head# 2024-04-01T20:04:50.348 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.348 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed9a507d:::benchmark_data_smithi188_173515_object137739:head# 2024-04-01T20:04:50.348 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.349 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed9ac0f4:::benchmark_data_smithi188_173515_object128612:head# 2024-04-01T20:04:50.349 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.349 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed9ae5a3:::benchmark_data_smithi188_173515_object110626:head# 2024-04-01T20:04:50.349 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.349 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed9b1815:::benchmark_data_smithi188_173515_object68896:head# 2024-04-01T20:04:50.349 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.349 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed9b2bff:::benchmark_data_smithi188_173515_object103585:head# 2024-04-01T20:04:50.349 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.349 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed9b5571:::benchmark_data_smithi188_173515_object123603:head# 2024-04-01T20:04:50.349 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.349 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed9ba315:::benchmark_data_smithi188_173515_object101626:head# 2024-04-01T20:04:50.349 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.349 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed9bd1b7:::benchmark_data_smithi188_173515_object102769:head# 2024-04-01T20:04:50.349 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.349 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed9c2f80:::benchmark_data_smithi188_173515_object125654:head# 2024-04-01T20:04:50.350 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.350 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed9d03a5:::benchmark_data_smithi188_173515_object91310:head# 2024-04-01T20:04:50.350 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.350 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed9e3908:::benchmark_data_smithi188_173515_object76048:head# 2024-04-01T20:04:50.350 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.350 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed9e677b:::benchmark_data_smithi188_173515_object104124:head# 2024-04-01T20:04:50.350 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.350 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ed9f59dc:::benchmark_data_smithi188_173515_object91128:head# 2024-04-01T20:04:50.350 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.350 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eda07180:::benchmark_data_smithi188_173515_object105872:head# 2024-04-01T20:04:50.350 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.350 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eda0bcfa:::benchmark_data_smithi188_173515_object67448:head# 2024-04-01T20:04:50.351 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.351 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eda11a0d:::benchmark_data_smithi188_173515_object155164:head# 2024-04-01T20:04:50.351 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.351 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eda13956:::benchmark_data_smithi188_173515_object48042:head# 2024-04-01T20:04:50.351 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.351 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eda165f6:::benchmark_data_smithi188_173515_object124871:head# 2024-04-01T20:04:50.351 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.351 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eda1ba22:::benchmark_data_smithi188_173515_object92108:head# 2024-04-01T20:04:50.351 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.351 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eda20a50:::benchmark_data_smithi188_173515_object86040:head# 2024-04-01T20:04:50.351 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.351 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eda33308:::benchmark_data_smithi188_173515_object87949:head# 2024-04-01T20:04:50.351 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.351 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eda40407:::benchmark_data_smithi188_173515_object135126:head# 2024-04-01T20:04:50.351 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.352 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eda40e4b:::benchmark_data_smithi188_173515_object141740:head# 2024-04-01T20:04:50.352 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.352 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eda43a3e:::benchmark_data_smithi188_173515_object126810:head# 2024-04-01T20:04:50.352 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.352 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eda45027:::benchmark_data_smithi188_173515_object142919:head# 2024-04-01T20:04:50.352 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.352 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eda474ef:::benchmark_data_smithi188_173515_object123460:head# 2024-04-01T20:04:50.352 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.352 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eda4843f:::benchmark_data_smithi188_173515_object113933:head# 2024-04-01T20:04:50.352 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.352 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eda549a0:::benchmark_data_smithi188_173515_object115738:head# 2024-04-01T20:04:50.352 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.352 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eda550af:::benchmark_data_smithi188_173515_object144701:head# 2024-04-01T20:04:50.352 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.353 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eda5db4d:::benchmark_data_smithi188_173515_object61501:head# 2024-04-01T20:04:50.353 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.353 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eda5df7d:::benchmark_data_smithi188_173515_object83125:head# 2024-04-01T20:04:50.353 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.353 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eda6f66a:::benchmark_data_smithi188_173515_object113817:head# 2024-04-01T20:04:50.353 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.353 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eda7b336:::benchmark_data_smithi188_173515_object64679:head# 2024-04-01T20:04:50.353 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.353 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eda80c1e:::benchmark_data_smithi188_173515_object99431:head# 2024-04-01T20:04:50.353 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.353 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eda83e15:::benchmark_data_smithi188_173515_object77958:head# 2024-04-01T20:04:50.353 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.353 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eda8d1d2:::benchmark_data_smithi188_173515_object76203:head# 2024-04-01T20:04:50.353 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.353 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edaa64bd:::benchmark_data_smithi188_173515_object81728:head# 2024-04-01T20:04:50.354 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.354 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edab93b7:::benchmark_data_smithi188_173515_object48656:head# 2024-04-01T20:04:50.354 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.354 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edac38fc:::benchmark_data_smithi188_173515_object59556:head# 2024-04-01T20:04:50.354 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.354 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edad7c21:::benchmark_data_smithi188_173515_object68342:head# 2024-04-01T20:04:50.354 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.354 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edadae63:::benchmark_data_smithi188_173515_object150000:head# 2024-04-01T20:04:50.354 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.354 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edae1413:::benchmark_data_smithi188_173515_object121248:head# 2024-04-01T20:04:50.354 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.354 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edae2011:::benchmark_data_smithi188_173515_object127640:head# 2024-04-01T20:04:50.354 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.354 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edae678a:::benchmark_data_smithi188_173515_object150087:head# 2024-04-01T20:04:50.355 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.355 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edaf8ed2:::benchmark_data_smithi188_173515_object55251:head# 2024-04-01T20:04:50.355 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.355 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb01c53:::benchmark_data_smithi188_173515_object130362:head# 2024-04-01T20:04:50.355 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.355 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb0677e:::benchmark_data_smithi188_173515_object53215:head# 2024-04-01T20:04:50.355 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.355 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb1654e:::benchmark_data_smithi188_173515_object53696:head# 2024-04-01T20:04:50.355 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.355 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb1be2e:::benchmark_data_smithi188_173515_object56647:head# 2024-04-01T20:04:50.355 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.355 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb22409:::benchmark_data_smithi188_173515_object124634:head# 2024-04-01T20:04:50.355 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.355 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb250c6:::benchmark_data_smithi188_173515_object143162:head# 2024-04-01T20:04:50.355 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.356 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb28450:::benchmark_data_smithi188_173515_object139579:head# 2024-04-01T20:04:50.356 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.356 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb2d044:::benchmark_data_smithi188_173515_object129509:head# 2024-04-01T20:04:50.356 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.356 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb2e960:::benchmark_data_smithi188_173515_object90117:head# 2024-04-01T20:04:50.356 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.356 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb3ecd2:::benchmark_data_smithi188_173515_object90765:head# 2024-04-01T20:04:50.356 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.356 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb407dc:::benchmark_data_smithi188_173515_object123202:head# 2024-04-01T20:04:50.356 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.356 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb57cbe:::benchmark_data_smithi188_173515_object54075:head# 2024-04-01T20:04:50.356 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.356 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb5de60:::benchmark_data_smithi188_173515_object88671:head# 2024-04-01T20:04:50.356 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.356 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb62461:::benchmark_data_smithi188_173515_object78857:head# 2024-04-01T20:04:50.357 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.357 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb68176:::benchmark_data_smithi188_173515_object122564:head# 2024-04-01T20:04:50.357 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.357 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb6d7ea:::benchmark_data_smithi188_173515_object105260:head# 2024-04-01T20:04:50.357 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.357 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb720e4:::benchmark_data_smithi188_173515_object141341:head# 2024-04-01T20:04:50.357 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.357 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb740c3:::benchmark_data_smithi188_173515_object67868:head# 2024-04-01T20:04:50.357 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.357 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb78fed:::benchmark_data_smithi188_173515_object60845:head# 2024-04-01T20:04:50.357 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.357 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb7e111:::benchmark_data_smithi188_173515_object62527:head# 2024-04-01T20:04:50.357 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.357 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb88128:::benchmark_data_smithi188_173515_object144241:head# 2024-04-01T20:04:50.357 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.358 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb882ee:::benchmark_data_smithi188_173515_object92944:head# 2024-04-01T20:04:50.358 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.358 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb8e11f:::benchmark_data_smithi188_173515_object151972:head# 2024-04-01T20:04:50.358 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.358 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb8e9b5:::benchmark_data_smithi188_173515_object68168:head# 2024-04-01T20:04:50.358 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.358 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb9189b:::benchmark_data_smithi188_173515_object88366:head# 2024-04-01T20:04:50.358 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.358 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb9318d:::benchmark_data_smithi188_173515_object59951:head# 2024-04-01T20:04:50.358 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.358 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb93526:::benchmark_data_smithi188_173515_object153489:head# 2024-04-01T20:04:50.358 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.358 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edb9e852:::benchmark_data_smithi188_173515_object69328:head# 2024-04-01T20:04:50.359 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.359 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edba52de:::benchmark_data_smithi188_173515_object112792:head# 2024-04-01T20:04:50.359 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.359 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edba7d5f:::benchmark_data_smithi188_173515_object129104:head# 2024-04-01T20:04:50.359 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.359 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edbb76ff:::benchmark_data_smithi188_173515_object102174:head# 2024-04-01T20:04:50.359 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.359 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edbb80a4:::benchmark_data_smithi188_173515_object52805:head# 2024-04-01T20:04:50.359 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.359 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edbe5bc1:::benchmark_data_smithi188_173515_object143526:head# 2024-04-01T20:04:50.359 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.359 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edbe9676:::benchmark_data_smithi188_173515_object73252:head# 2024-04-01T20:04:50.359 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.359 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edbed8ca:::benchmark_data_smithi188_173515_object139808:head# 2024-04-01T20:04:50.359 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.359 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edc0705f:::benchmark_data_smithi188_173515_object142091:head# 2024-04-01T20:04:50.360 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.360 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edc0fa23:::benchmark_data_smithi188_173515_object82974:head# 2024-04-01T20:04:50.360 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.360 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edc15871:::benchmark_data_smithi188_173515_object49508:head# 2024-04-01T20:04:50.360 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.360 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edc307b9:::benchmark_data_smithi188_173515_object133059:head# 2024-04-01T20:04:50.360 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.360 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edc35902:::benchmark_data_smithi188_173515_object129496:head# 2024-04-01T20:04:50.360 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.360 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edc36e4a:::benchmark_data_smithi188_173515_object91492:head# 2024-04-01T20:04:50.360 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.360 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edc441fa:::benchmark_data_smithi188_173515_object134361:head# 2024-04-01T20:04:50.360 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.360 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edc48c92:::benchmark_data_smithi188_173515_object60428:head# 2024-04-01T20:04:50.360 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.360 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edc5c208:::benchmark_data_smithi188_173515_object58250:head# 2024-04-01T20:04:50.361 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.361 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edc79775:::benchmark_data_smithi188_173515_object121936:head# 2024-04-01T20:04:50.361 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.361 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edc803b6:::benchmark_data_smithi188_173515_object95274:head# 2024-04-01T20:04:50.361 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.361 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edc83cd4:::benchmark_data_smithi188_173515_object51437:head# 2024-04-01T20:04:50.361 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.361 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edc8b602:::benchmark_data_smithi188_173515_object61673:head# 2024-04-01T20:04:50.361 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.361 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edc8bb95:::benchmark_data_smithi188_173515_object128077:head# 2024-04-01T20:04:50.361 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.361 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edc92797:::benchmark_data_smithi188_173515_object79717:head# 2024-04-01T20:04:50.361 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.361 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edc9cbcc:::benchmark_data_smithi188_173515_object100790:head# 2024-04-01T20:04:50.361 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.361 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edcbfd94:::benchmark_data_smithi188_173515_object120560:head# 2024-04-01T20:04:50.362 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.362 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edcd7bb4:::benchmark_data_smithi188_173515_object140373:head# 2024-04-01T20:04:50.362 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.362 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edd02b51:::benchmark_data_smithi188_173515_object103120:head# 2024-04-01T20:04:50.362 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.362 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edd1fb1d:::benchmark_data_smithi188_173515_object127211:head# 2024-04-01T20:04:50.362 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.362 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edd213dd:::benchmark_data_smithi188_173515_object55498:head# 2024-04-01T20:04:50.362 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.362 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edd23225:::benchmark_data_smithi188_173515_object99292:head# 2024-04-01T20:04:50.362 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.362 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edd32742:::benchmark_data_smithi188_173515_object77452:head# 2024-04-01T20:04:50.362 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.363 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edd32cd7:::benchmark_data_smithi188_173515_object112557:head# 2024-04-01T20:04:50.363 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.363 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edd4f6aa:::benchmark_data_smithi188_173515_object152089:head# 2024-04-01T20:04:50.363 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.363 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edd51431:::benchmark_data_smithi188_173515_object68907:head# 2024-04-01T20:04:50.363 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.363 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edd65ca0:::benchmark_data_smithi188_173515_object132096:head# 2024-04-01T20:04:50.363 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.363 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edd66972:::benchmark_data_smithi188_173515_object48919:head# 2024-04-01T20:04:50.363 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.363 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edd79778:::benchmark_data_smithi188_173515_object144814:head# 2024-04-01T20:04:50.363 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.363 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edd7ce34:::benchmark_data_smithi188_173515_object111919:head# 2024-04-01T20:04:50.363 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.363 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edd7fbf7:::benchmark_data_smithi188_173515_object65724:head# 2024-04-01T20:04:50.364 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.364 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edd82460:::benchmark_data_smithi188_173515_object78059:head# 2024-04-01T20:04:50.364 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.364 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edd87d18:::benchmark_data_smithi188_173515_object60435:head# 2024-04-01T20:04:50.364 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.364 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edd89d1d:::benchmark_data_smithi188_173515_object152919:head# 2024-04-01T20:04:50.364 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.364 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edd9265f:::benchmark_data_smithi188_173515_object150825:head# 2024-04-01T20:04:50.364 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.364 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edd9f6f6:::benchmark_data_smithi188_173515_object131533:head# 2024-04-01T20:04:50.364 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.364 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edda19e3:::benchmark_data_smithi188_173515_object104851:head# 2024-04-01T20:04:50.364 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.364 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edda58c2:::benchmark_data_smithi188_173515_object147616:head# 2024-04-01T20:04:50.364 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.364 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eddd5980:::benchmark_data_smithi188_173515_object59580:head# 2024-04-01T20:04:50.365 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.365 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eddd7840:::benchmark_data_smithi188_173515_object115476:head# 2024-04-01T20:04:50.365 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.365 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edddd314:::benchmark_data_smithi188_173515_object106052:head# 2024-04-01T20:04:50.365 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.365 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edde4608:::benchmark_data_smithi188_173515_object56804:head# 2024-04-01T20:04:50.365 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.365 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edde6878:::benchmark_data_smithi188_173515_object146657:head# 2024-04-01T20:04:50.365 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.365 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edde79f8:::benchmark_data_smithi188_173515_object52578:head# 2024-04-01T20:04:50.365 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.365 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edde8b8b:::benchmark_data_smithi188_173515_object128602:head# 2024-04-01T20:04:50.365 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.366 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eddf45df:::benchmark_data_smithi188_173515_object56836:head# 2024-04-01T20:04:50.366 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.366 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eddf4d40:::benchmark_data_smithi188_173515_object78417:head# 2024-04-01T20:04:50.366 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.366 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ede07949:::benchmark_data_smithi188_173515_object132493:head# 2024-04-01T20:04:50.366 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.366 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ede09255:::benchmark_data_smithi188_173515_object95659:head# 2024-04-01T20:04:50.366 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.366 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ede0a05c:::benchmark_data_smithi188_173515_object148563:head# 2024-04-01T20:04:50.366 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.366 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ede0e4aa:::benchmark_data_smithi188_173515_object96025:head# 2024-04-01T20:04:50.366 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.366 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ede1a1a8:::benchmark_data_smithi188_173515_object77134:head# 2024-04-01T20:04:50.366 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.367 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ede1db61:::benchmark_data_smithi188_173515_object72174:head# 2024-04-01T20:04:50.367 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.367 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ede2914b:::benchmark_data_smithi188_173515_object91406:head# 2024-04-01T20:04:50.367 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.367 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ede2d467:::benchmark_data_smithi188_173515_object73064:head# 2024-04-01T20:04:50.367 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.367 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ede359fb:::benchmark_data_smithi188_173515_object60947:head# 2024-04-01T20:04:50.367 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.367 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ede4ab76:::benchmark_data_smithi188_173515_object97119:head# 2024-04-01T20:04:50.367 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.367 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ede4f037:::benchmark_data_smithi188_173515_object139734:head# 2024-04-01T20:04:50.367 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.367 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ede5bd3b:::benchmark_data_smithi188_173515_object109640:head# 2024-04-01T20:04:50.367 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.367 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ede86cad:::benchmark_data_smithi188_173515_object45905:head# 2024-04-01T20:04:50.367 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.368 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ede8c045:::benchmark_data_smithi188_173515_object154318:head# 2024-04-01T20:04:50.368 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.368 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ede991a1:::benchmark_data_smithi188_173515_object76550:head# 2024-04-01T20:04:50.368 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.368 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edea1ec2:::benchmark_data_smithi188_173515_object114449:head# 2024-04-01T20:04:50.368 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.368 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edea3f59:::benchmark_data_smithi188_173515_object50483:head# 2024-04-01T20:04:50.368 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.368 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edec0313:::benchmark_data_smithi188_173515_object118319:head# 2024-04-01T20:04:50.368 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.368 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edec7f39:::benchmark_data_smithi188_173515_object91606:head# 2024-04-01T20:04:50.368 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.368 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edecc000:::benchmark_data_smithi188_173515_object115817:head# 2024-04-01T20:04:50.368 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.368 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ededc4b7:::benchmark_data_smithi188_173515_object127314:head# 2024-04-01T20:04:50.369 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.369 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ededda22:::benchmark_data_smithi188_173515_object70421:head# 2024-04-01T20:04:50.369 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.369 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edede512:::benchmark_data_smithi188_173515_object114830:head# 2024-04-01T20:04:50.369 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.369 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edef3fe0:::benchmark_data_smithi188_173515_object151893:head# 2024-04-01T20:04:50.369 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.369 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edef50c8:::benchmark_data_smithi188_173515_object130627:head# 2024-04-01T20:04:50.369 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.369 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edefc5a1:::benchmark_data_smithi188_173515_object84141:head# 2024-04-01T20:04:50.369 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.369 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edf073f9:::benchmark_data_smithi188_173515_object83996:head# 2024-04-01T20:04:50.369 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.369 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edf0e0f1:::benchmark_data_smithi188_173515_object121414:head# 2024-04-01T20:04:50.369 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.369 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edf17585:::benchmark_data_smithi188_173515_object101885:head# 2024-04-01T20:04:50.370 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.370 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edf17c5d:::benchmark_data_smithi188_173515_object101419:head# 2024-04-01T20:04:50.370 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.370 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edf41dce:::benchmark_data_smithi188_173515_object97783:head# 2024-04-01T20:04:50.370 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.370 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edf43c86:::benchmark_data_smithi188_173515_object100636:head# 2024-04-01T20:04:50.370 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.370 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edf49509:::benchmark_data_smithi188_173515_object88217:head# 2024-04-01T20:04:50.370 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.370 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edf4d068:::benchmark_data_smithi188_173515_object107324:head# 2024-04-01T20:04:50.370 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.370 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edf68ac3:::benchmark_data_smithi188_173515_object95115:head# 2024-04-01T20:04:50.370 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.371 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edf6a426:::benchmark_data_smithi188_173515_object155451:head# 2024-04-01T20:04:50.371 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.371 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edf6d0b2:::benchmark_data_smithi188_173515_object64749:head# 2024-04-01T20:04:50.371 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.371 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edf6de38:::benchmark_data_smithi188_173515_object77834:head# 2024-04-01T20:04:50.371 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.371 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edf74bca:::benchmark_data_smithi188_173515_object119843:head# 2024-04-01T20:04:50.371 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.371 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edf759b7:::benchmark_data_smithi188_173515_object107512:head# 2024-04-01T20:04:50.371 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.371 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edfaae1a:::benchmark_data_smithi188_173515_object111273:head# 2024-04-01T20:04:50.371 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.371 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edfacea8:::benchmark_data_smithi188_173515_object58258:head# 2024-04-01T20:04:50.371 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.371 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edfaf0ac:::benchmark_data_smithi188_173515_object119557:head# 2024-04-01T20:04:50.372 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.372 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edfba265:::benchmark_data_smithi188_173515_object91971:head# 2024-04-01T20:04:50.372 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.372 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edfc4af6:::benchmark_data_smithi188_173515_object131139:head# 2024-04-01T20:04:50.372 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.372 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edfd4257:::benchmark_data_smithi188_173515_object83359:head# 2024-04-01T20:04:50.372 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.372 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edfd80fe:::benchmark_data_smithi188_173515_object118806:head# 2024-04-01T20:04:50.372 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.372 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edfdce9c:::benchmark_data_smithi188_173515_object126425:head# 2024-04-01T20:04:50.372 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.372 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edfe722e:::benchmark_data_smithi188_173515_object49609:head# 2024-04-01T20:04:50.372 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.372 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edfeab0b:::benchmark_data_smithi188_173515_object46757:head# 2024-04-01T20:04:50.372 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.373 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edfeb6ee:::benchmark_data_smithi188_173515_object89193:head# 2024-04-01T20:04:50.373 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.373 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:edfebbd3:::benchmark_data_smithi188_173515_object73882:head# 2024-04-01T20:04:50.373 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.373 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee0008e6:::benchmark_data_smithi188_173515_object145304:head# 2024-04-01T20:04:50.373 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.373 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee001963:::benchmark_data_smithi188_173515_object66937:head# 2024-04-01T20:04:50.373 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.373 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee00d358:::benchmark_data_smithi188_173515_object91605:head# 2024-04-01T20:04:50.373 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.373 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee010afa:::benchmark_data_smithi188_173515_object85280:head# 2024-04-01T20:04:50.373 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.373 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee021414:::benchmark_data_smithi188_173515_object62030:head# 2024-04-01T20:04:50.373 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.373 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee029eaa:::benchmark_data_smithi188_173515_object96695:head# 2024-04-01T20:04:50.373 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.374 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee02a53b:::benchmark_data_smithi188_173515_object134723:head# 2024-04-01T20:04:50.374 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.374 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee04aae4:::benchmark_data_smithi188_173515_object151098:head# 2024-04-01T20:04:50.374 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.374 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee04c37d:::benchmark_data_smithi188_173515_object104241:head# 2024-04-01T20:04:50.374 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.374 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee04e0ec:::benchmark_data_smithi188_173515_object136812:head# 2024-04-01T20:04:50.374 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.374 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee0518b0:::benchmark_data_smithi188_173515_object95178:head# 2024-04-01T20:04:50.374 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.374 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee052db7:::benchmark_data_smithi188_173515_object136193:head# 2024-04-01T20:04:50.374 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.375 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee053fd7:::benchmark_data_smithi188_173515_object121430:head# 2024-04-01T20:04:50.375 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.375 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee0605a7:::benchmark_data_smithi188_173515_object71905:head# 2024-04-01T20:04:50.375 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.375 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee073890:::benchmark_data_smithi188_173515_object106153:head# 2024-04-01T20:04:50.375 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.375 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee08a16d:::benchmark_data_smithi188_173515_object80238:head# 2024-04-01T20:04:50.375 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.375 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee09c204:::benchmark_data_smithi188_173515_object110238:head# 2024-04-01T20:04:50.375 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.375 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee0a0f26:::benchmark_data_smithi188_173515_object59281:head# 2024-04-01T20:04:50.375 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.375 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee0a1b64:::benchmark_data_smithi188_173515_object78644:head# 2024-04-01T20:04:50.375 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.376 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee0ac72b:::benchmark_data_smithi188_173515_object121069:head# 2024-04-01T20:04:50.376 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.376 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee0b7267:::benchmark_data_smithi188_173515_object54831:head# 2024-04-01T20:04:50.376 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.376 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee0b8337:::benchmark_data_smithi188_173515_object118903:head# 2024-04-01T20:04:50.376 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.376 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee0c6138:::benchmark_data_smithi188_173515_object144249:head# 2024-04-01T20:04:50.376 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.376 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee0e182b:::benchmark_data_smithi188_173515_object129727:head# 2024-04-01T20:04:50.376 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.376 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee0e38b3:::benchmark_data_smithi188_173515_object73744:head# 2024-04-01T20:04:50.376 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.376 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee0e4124:::benchmark_data_smithi188_173515_object114759:head# 2024-04-01T20:04:50.376 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.376 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee0eac8e:::benchmark_data_smithi188_173515_object94111:head# 2024-04-01T20:04:50.377 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.377 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee0fc672:::benchmark_data_smithi188_173515_object97278:head# 2024-04-01T20:04:50.377 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.377 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee10631a:::benchmark_data_smithi188_173515_object149205:head# 2024-04-01T20:04:50.377 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.377 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee11f4cd:::benchmark_data_smithi188_173515_object107730:head# 2024-04-01T20:04:50.377 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.377 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee1220c7:::benchmark_data_smithi188_173515_object77862:head# 2024-04-01T20:04:50.377 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.377 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee12e7ca:::benchmark_data_smithi188_173515_object47395:head# 2024-04-01T20:04:50.377 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.377 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee1303f4:::benchmark_data_smithi188_173515_object113089:head# 2024-04-01T20:04:50.377 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.378 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee131c61:::benchmark_data_smithi188_173515_object77876:head# 2024-04-01T20:04:50.378 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.378 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee135b30:::benchmark_data_smithi188_173515_object91362:head# 2024-04-01T20:04:50.378 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.378 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee13646d:::benchmark_data_smithi188_173515_object116944:head# 2024-04-01T20:04:50.378 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.378 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee13f571:::benchmark_data_smithi188_173515_object119563:head# 2024-04-01T20:04:50.378 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.378 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee14943d:::benchmark_data_smithi188_173515_object72615:head# 2024-04-01T20:04:50.378 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.378 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee149c22:::benchmark_data_smithi188_173515_object105948:head# 2024-04-01T20:04:50.378 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.378 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee1617d8:::benchmark_data_smithi188_173515_object85038:head# 2024-04-01T20:04:50.378 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.379 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee170cfe:::benchmark_data_smithi188_173515_object83473:head# 2024-04-01T20:04:50.379 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.379 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee17c2b4:::benchmark_data_smithi188_173515_object101895:head# 2024-04-01T20:04:50.379 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.379 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee190467:::benchmark_data_smithi188_173515_object151611:head# 2024-04-01T20:04:50.379 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.379 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee1a11bc:::benchmark_data_smithi188_173515_object86955:head# 2024-04-01T20:04:50.379 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.379 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee1a9096:::benchmark_data_smithi188_173515_object48637:head# 2024-04-01T20:04:50.379 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.379 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee1aabcf:::benchmark_data_smithi188_173515_object82167:head# 2024-04-01T20:04:50.379 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.379 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee1b7e70:::benchmark_data_smithi188_173515_object99668:head# 2024-04-01T20:04:50.379 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.380 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee1c4c3c:::benchmark_data_smithi188_173515_object67890:head# 2024-04-01T20:04:50.380 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.380 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee1daad6:::benchmark_data_smithi188_173515_object99312:head# 2024-04-01T20:04:50.380 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.380 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee1e0b62:::benchmark_data_smithi188_173515_object127986:head# 2024-04-01T20:04:50.380 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.380 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee1e73a6:::benchmark_data_smithi188_173515_object73183:head# 2024-04-01T20:04:50.380 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.380 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee1f20c1:::benchmark_data_smithi188_173515_object141403:head# 2024-04-01T20:04:50.380 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.380 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee1ff46e:::benchmark_data_smithi188_173515_object62567:head# 2024-04-01T20:04:50.380 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.381 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee20a1de:::benchmark_data_smithi188_173515_object109835:head# 2024-04-01T20:04:50.381 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.381 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee233637:::benchmark_data_smithi188_173515_object94969:head# 2024-04-01T20:04:50.381 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.381 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee2336d2:::benchmark_data_smithi188_173515_object129906:head# 2024-04-01T20:04:50.381 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.381 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee2389df:::benchmark_data_smithi188_173515_object114913:head# 2024-04-01T20:04:50.381 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.381 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee2450cb:::benchmark_data_smithi188_173515_object150480:head# 2024-04-01T20:04:50.381 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.381 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee24c594:::benchmark_data_smithi188_173515_object112264:head# 2024-04-01T20:04:50.381 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.381 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee24c94e:::benchmark_data_smithi188_173515_object77030:head# 2024-04-01T20:04:50.381 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.381 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee253f82:::benchmark_data_smithi188_173515_object123623:head# 2024-04-01T20:04:50.382 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.382 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee25a80e:::benchmark_data_smithi188_173515_object151392:head# 2024-04-01T20:04:50.382 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.382 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee27313e:::benchmark_data_smithi188_173515_object96883:head# 2024-04-01T20:04:50.382 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.382 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee28697b:::benchmark_data_smithi188_173515_object98256:head# 2024-04-01T20:04:50.382 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.382 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee286d74:::benchmark_data_smithi188_173515_object55236:head# 2024-04-01T20:04:50.382 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.382 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee28aef1:::benchmark_data_smithi188_173515_object49680:head# 2024-04-01T20:04:50.382 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.382 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee2bdd44:::benchmark_data_smithi188_173515_object111460:head# 2024-04-01T20:04:50.382 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.383 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee2c54e9:::benchmark_data_smithi188_173515_object71294:head# 2024-04-01T20:04:50.383 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.383 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee2c9be0:::benchmark_data_smithi188_173515_object53717:head# 2024-04-01T20:04:50.383 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.383 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee2cfa79:::benchmark_data_smithi188_173515_object81588:head# 2024-04-01T20:04:50.383 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.383 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee2e34bc:::benchmark_data_smithi188_173515_object88954:head# 2024-04-01T20:04:50.383 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.383 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee2e7b9d:::benchmark_data_smithi188_173515_object123721:head# 2024-04-01T20:04:50.383 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.383 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee2f7a73:::benchmark_data_smithi188_173515_object113285:head# 2024-04-01T20:04:50.383 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.383 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee2f83f3:::benchmark_data_smithi188_173515_object114623:head# 2024-04-01T20:04:50.383 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.384 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee3029bc:::benchmark_data_smithi188_173515_object119978:head# 2024-04-01T20:04:50.384 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.384 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee305571:::benchmark_data_smithi188_173515_object130381:head# 2024-04-01T20:04:50.384 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.384 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee308544:::benchmark_data_smithi188_173515_object62803:head# 2024-04-01T20:04:50.384 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.384 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee30f164:::benchmark_data_smithi188_173515_object55741:head# 2024-04-01T20:04:50.384 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.384 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee328789:::benchmark_data_smithi188_173515_object128571:head# 2024-04-01T20:04:50.384 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.384 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee33481d:::benchmark_data_smithi188_173515_object140277:head# 2024-04-01T20:04:50.384 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.384 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee340d41:::benchmark_data_smithi188_173515_object76916:head# 2024-04-01T20:04:50.385 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.385 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee35677e:::benchmark_data_smithi188_173515_object88752:head# 2024-04-01T20:04:50.385 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.385 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee35b4e4:::benchmark_data_smithi188_173515_object117986:head# 2024-04-01T20:04:50.385 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.385 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee388cb4:::benchmark_data_smithi188_173515_object50322:head# 2024-04-01T20:04:50.385 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.385 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee3ab119:::benchmark_data_smithi188_173515_object91944:head# 2024-04-01T20:04:50.385 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.385 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee3adda4:::benchmark_data_smithi188_173515_object131619:head# 2024-04-01T20:04:50.385 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.385 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee3c23a2:::benchmark_data_smithi188_173515_object89291:head# 2024-04-01T20:04:50.385 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.385 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee3c6c01:::benchmark_data_smithi188_173515_object78637:head# 2024-04-01T20:04:50.386 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.386 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee3cc918:::benchmark_data_smithi188_173515_object142917:head# 2024-04-01T20:04:50.386 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.386 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee3d0e28:::benchmark_data_smithi188_173515_object106500:head# 2024-04-01T20:04:50.386 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.386 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee3dd533:::benchmark_data_smithi188_173515_object86671:head# 2024-04-01T20:04:50.386 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.386 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee3f8f7e:::benchmark_data_smithi188_173515_object123435:head# 2024-04-01T20:04:50.386 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.386 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee40268e:::benchmark_data_smithi188_173515_object146272:head# 2024-04-01T20:04:50.386 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.386 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee409c84:::benchmark_data_smithi188_173515_object121848:head# 2024-04-01T20:04:50.386 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.386 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee40cbcd:::benchmark_data_smithi188_173515_object53166:head# 2024-04-01T20:04:50.387 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.387 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee43181b:::benchmark_data_smithi188_173515_object140462:head# 2024-04-01T20:04:50.387 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.387 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee43fbc0:::benchmark_data_smithi188_173515_object89983:head# 2024-04-01T20:04:50.387 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.387 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee4497a5:::benchmark_data_smithi188_173515_object77560:head# 2024-04-01T20:04:50.387 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.387 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee44bae7:::benchmark_data_smithi188_173515_object60254:head# 2024-04-01T20:04:50.387 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.387 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee44f807:::benchmark_data_smithi188_173515_object146783:head# 2024-04-01T20:04:50.387 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.387 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee456327:::benchmark_data_smithi188_173515_object73228:head# 2024-04-01T20:04:50.387 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.387 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee457677:::benchmark_data_smithi188_173515_object119525:head# 2024-04-01T20:04:50.388 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.388 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee4593b8:::benchmark_data_smithi188_173515_object66908:head# 2024-04-01T20:04:50.388 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.388 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee45c5b5:::benchmark_data_smithi188_173515_object96407:head# 2024-04-01T20:04:50.388 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.388 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee46851c:::benchmark_data_smithi188_173515_object90126:head# 2024-04-01T20:04:50.388 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.388 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee469527:::benchmark_data_smithi188_173515_object47055:head# 2024-04-01T20:04:50.388 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.388 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee469f4c:::benchmark_data_smithi188_173515_object121880:head# 2024-04-01T20:04:50.388 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.388 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee496288:::benchmark_data_smithi188_173515_object110737:head# 2024-04-01T20:04:50.388 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.388 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee4a9121:::benchmark_data_smithi188_173515_object71285:head# 2024-04-01T20:04:50.389 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.389 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee4b0329:::benchmark_data_smithi188_173515_object59195:head# 2024-04-01T20:04:50.389 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.389 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee4b15b1:::benchmark_data_smithi188_173515_object154358:head# 2024-04-01T20:04:50.389 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.389 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee4b26d1:::benchmark_data_smithi188_173515_object93842:head# 2024-04-01T20:04:50.389 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.389 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee4b4242:::benchmark_data_smithi188_173515_object65025:head# 2024-04-01T20:04:50.389 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.389 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee4b7376:::benchmark_data_smithi188_173515_object78606:head# 2024-04-01T20:04:50.389 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.389 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee4ce2aa:::benchmark_data_smithi188_173515_object83509:head# 2024-04-01T20:04:50.389 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.390 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee4d4492:::benchmark_data_smithi188_173515_object146608:head# 2024-04-01T20:04:50.390 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.390 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee4d62d2:::benchmark_data_smithi188_173515_object85770:head# 2024-04-01T20:04:50.390 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.390 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee4e8d56:::benchmark_data_smithi188_173515_object85374:head# 2024-04-01T20:04:50.390 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.390 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee4ed3ff:::benchmark_data_smithi188_173515_object71789:head# 2024-04-01T20:04:50.390 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.390 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee4f9981:::benchmark_data_smithi188_173515_object145662:head# 2024-04-01T20:04:50.390 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.390 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee4fc114:::benchmark_data_smithi188_173515_object89555:head# 2024-04-01T20:04:50.390 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.390 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee50eb8b:::benchmark_data_smithi188_173515_object96322:head# 2024-04-01T20:04:50.390 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.391 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee50fc79:::benchmark_data_smithi188_173515_object84590:head# 2024-04-01T20:04:50.391 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.391 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee526706:::benchmark_data_smithi188_173515_object141354:head# 2024-04-01T20:04:50.391 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.391 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee526757:::benchmark_data_smithi188_173515_object117043:head# 2024-04-01T20:04:50.391 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.391 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee529232:::benchmark_data_smithi188_173515_object63954:head# 2024-04-01T20:04:50.391 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.391 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee52d5cd:::benchmark_data_smithi188_173515_object132565:head# 2024-04-01T20:04:50.391 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.391 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee52e933:::benchmark_data_smithi188_173515_object52166:head# 2024-04-01T20:04:50.391 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.391 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee536796:::benchmark_data_smithi188_173515_object118093:head# 2024-04-01T20:04:50.391 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.391 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee53c90d:::benchmark_data_smithi188_173515_object70688:head# 2024-04-01T20:04:50.392 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.392 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee53f9d0:::benchmark_data_smithi188_173515_object134098:head# 2024-04-01T20:04:50.392 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.392 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee564020:::benchmark_data_smithi188_173515_object141907:head# 2024-04-01T20:04:50.392 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.392 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee578f2f:::benchmark_data_smithi188_173515_object63338:head# 2024-04-01T20:04:50.392 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.392 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee580e20:::benchmark_data_smithi188_173515_object94609:head# 2024-04-01T20:04:50.392 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.392 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee592974:::benchmark_data_smithi188_173515_object82399:head# 2024-04-01T20:04:50.392 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.392 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee59f3ee:::benchmark_data_smithi188_173515_object82249:head# 2024-04-01T20:04:50.392 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.392 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee59ff72:::benchmark_data_smithi188_173515_object53798:head# 2024-04-01T20:04:50.393 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.393 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee5a719a:::benchmark_data_smithi188_173515_object68757:head# 2024-04-01T20:04:50.393 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.393 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee5a9ba9:::benchmark_data_smithi188_173515_object84930:head# 2024-04-01T20:04:50.393 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.497 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T20:04:50.498 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:04:50.513 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee5afbce:::benchmark_data_smithi188_173515_object81884:head# 2024-04-01T20:04:50.513 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.514 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee5c876b:::benchmark_data_smithi188_173515_object103645:head# 2024-04-01T20:04:50.514 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.514 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee5cb963:::benchmark_data_smithi188_173515_object86705:head# 2024-04-01T20:04:50.514 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.514 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee5d2008:::benchmark_data_smithi188_173515_object124391:head# 2024-04-01T20:04:50.514 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.514 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee5da10e:::benchmark_data_smithi188_173515_object91617:head# 2024-04-01T20:04:50.514 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.514 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee5de3de:::benchmark_data_smithi188_173515_object96175:head# 2024-04-01T20:04:50.514 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.514 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee5e984e:::benchmark_data_smithi188_173515_object54654:head# 2024-04-01T20:04:50.514 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.514 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee5e9ee1:::benchmark_data_smithi188_173515_object139040:head# 2024-04-01T20:04:50.514 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.515 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee5ea61a:::benchmark_data_smithi188_173515_object74942:head# 2024-04-01T20:04:50.515 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.515 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee5eae1f:::benchmark_data_smithi188_173515_object141321:head# 2024-04-01T20:04:50.515 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.515 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee5f29ed:::benchmark_data_smithi188_173515_object109530:head# 2024-04-01T20:04:50.515 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.515 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee5f625d:::benchmark_data_smithi188_173515_object154413:head# 2024-04-01T20:04:50.515 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.515 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee6209ee:::benchmark_data_smithi188_173515_object152560:head# 2024-04-01T20:04:50.515 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.515 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee624ed5:::benchmark_data_smithi188_173515_object52089:head# 2024-04-01T20:04:50.515 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.515 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee627549:::benchmark_data_smithi188_173515_object67374:head# 2024-04-01T20:04:50.515 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.515 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee63c56e:::benchmark_data_smithi188_173515_object115312:head# 2024-04-01T20:04:50.516 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.516 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee651fdf:::benchmark_data_smithi188_173515_object62240:head# 2024-04-01T20:04:50.516 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.516 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee65bff7:::benchmark_data_smithi188_173515_object147817:head# 2024-04-01T20:04:50.516 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.516 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee6662a1:::benchmark_data_smithi188_173515_object146158:head# 2024-04-01T20:04:50.516 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.516 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee666ba5:::benchmark_data_smithi188_173515_object73411:head# 2024-04-01T20:04:50.516 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.516 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee679e23:::benchmark_data_smithi188_173515_object104876:head# 2024-04-01T20:04:50.516 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.516 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee6835a1:::benchmark_data_smithi188_173515_object65315:head# 2024-04-01T20:04:50.516 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.516 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee683f30:::benchmark_data_smithi188_173515_object51233:head# 2024-04-01T20:04:50.516 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.516 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee6850c0:::benchmark_data_smithi188_173515_object100024:head# 2024-04-01T20:04:50.517 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.517 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee692ce2:::benchmark_data_smithi188_173515_object148982:head# 2024-04-01T20:04:50.517 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.517 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee694d52:::benchmark_data_smithi188_173515_object55353:head# 2024-04-01T20:04:50.517 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.517 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee6961bc:::benchmark_data_smithi188_173515_object96774:head# 2024-04-01T20:04:50.517 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.517 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee69ec02:::benchmark_data_smithi188_173515_object124930:head# 2024-04-01T20:04:50.517 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.517 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee6ac4aa:::benchmark_data_smithi188_173515_object100520:head# 2024-04-01T20:04:50.517 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.517 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee6ad0f6:::benchmark_data_smithi188_173515_object151212:head# 2024-04-01T20:04:50.517 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.517 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee6add6c:::benchmark_data_smithi188_173515_object85548:head# 2024-04-01T20:04:50.517 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.518 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee6c9f66:::benchmark_data_smithi188_173515_object62356:head# 2024-04-01T20:04:50.518 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.518 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee6ce824:::benchmark_data_smithi188_173515_object51895:head# 2024-04-01T20:04:50.518 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.518 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee6d36c5:::benchmark_data_smithi188_173515_object78531:head# 2024-04-01T20:04:50.518 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.518 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee6da4f1:::benchmark_data_smithi188_173515_object52611:head# 2024-04-01T20:04:50.518 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.518 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee6dedb7:::benchmark_data_smithi188_173515_object121687:head# 2024-04-01T20:04:50.518 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.518 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee6e19d6:::benchmark_data_smithi188_173515_object150623:head# 2024-04-01T20:04:50.518 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.518 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee6e499b:::benchmark_data_smithi188_173515_object129537:head# 2024-04-01T20:04:50.518 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.519 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee6e5dc1:::benchmark_data_smithi188_173515_object129577:head# 2024-04-01T20:04:50.519 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.519 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee6e917e:::benchmark_data_smithi188_173515_object112800:head# 2024-04-01T20:04:50.519 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.519 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee6eac2a:::benchmark_data_smithi188_173515_object87076:head# 2024-04-01T20:04:50.519 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.519 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee6ead17:::benchmark_data_smithi188_173515_object112489:head# 2024-04-01T20:04:50.519 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.519 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee6fd264:::benchmark_data_smithi188_173515_object98067:head# 2024-04-01T20:04:50.519 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.519 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee704454:::benchmark_data_smithi188_173515_object143001:head# 2024-04-01T20:04:50.519 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.519 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee70f659:::benchmark_data_smithi188_173515_object67342:head# 2024-04-01T20:04:50.519 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.519 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee71401a:::benchmark_data_smithi188_173515_object82035:head# 2024-04-01T20:04:50.520 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.520 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee732a03:::benchmark_data_smithi188_173515_object149077:head# 2024-04-01T20:04:50.520 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.520 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee7349a9:::benchmark_data_smithi188_173515_object138127:head# 2024-04-01T20:04:50.520 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.520 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee7354bc:::benchmark_data_smithi188_173515_object133807:head# 2024-04-01T20:04:50.520 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.520 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee73b80d:::benchmark_data_smithi188_173515_object133052:head# 2024-04-01T20:04:50.520 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.520 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee73d164:::benchmark_data_smithi188_173515_object48008:head# 2024-04-01T20:04:50.520 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.520 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee73e3fd:::benchmark_data_smithi188_173515_object147255:head# 2024-04-01T20:04:50.520 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.520 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee748293:::benchmark_data_smithi188_173515_object72677:head# 2024-04-01T20:04:50.520 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.521 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee750e84:::benchmark_data_smithi188_173515_object103339:head# 2024-04-01T20:04:50.521 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.521 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee753223:::benchmark_data_smithi188_173515_object62426:head# 2024-04-01T20:04:50.521 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.521 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee75a241:::benchmark_data_smithi188_173515_object147000:head# 2024-04-01T20:04:50.521 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.521 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee773d91:::benchmark_data_smithi188_173515_object101374:head# 2024-04-01T20:04:50.521 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.521 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee778c75:::benchmark_data_smithi188_173515_object151607:head# 2024-04-01T20:04:50.521 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.521 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee78f24b:::benchmark_data_smithi188_173515_object73925:head# 2024-04-01T20:04:50.521 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.521 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee799137:::benchmark_data_smithi188_173515_object102712:head# 2024-04-01T20:04:50.521 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.521 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee79d0b6:::benchmark_data_smithi188_173515_object108246:head# 2024-04-01T20:04:50.521 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.522 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee7a69ba:::benchmark_data_smithi188_173515_object96510:head# 2024-04-01T20:04:50.522 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.522 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee7b4179:::benchmark_data_smithi188_173515_object76763:head# 2024-04-01T20:04:50.522 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.522 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee7b53a4:::benchmark_data_smithi188_173515_object56627:head# 2024-04-01T20:04:50.522 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.522 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee7b68c1:::benchmark_data_smithi188_173515_object79373:head# 2024-04-01T20:04:50.522 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.522 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee7bd2b3:::benchmark_data_smithi188_173515_object109098:head# 2024-04-01T20:04:50.522 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.522 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee7be70c:::benchmark_data_smithi188_173515_object84219:head# 2024-04-01T20:04:50.522 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.522 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee7c1c20:::benchmark_data_smithi188_173515_object65868:head# 2024-04-01T20:04:50.522 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.523 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee7e1055:::benchmark_data_smithi188_173515_object105764:head# 2024-04-01T20:04:50.523 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.523 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee7e4d13:::benchmark_data_smithi188_173515_object136138:head# 2024-04-01T20:04:50.523 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.523 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee7ee68f:::benchmark_data_smithi188_173515_object121922:head# 2024-04-01T20:04:50.523 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.523 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee7ef6bd:::benchmark_data_smithi188_173515_object108456:head# 2024-04-01T20:04:50.523 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.523 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee7ef6d9:::benchmark_data_smithi188_173515_object98073:head# 2024-04-01T20:04:50.523 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.523 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee7f8666:::benchmark_data_smithi188_173515_object56850:head# 2024-04-01T20:04:50.523 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.523 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee809ff5:::benchmark_data_smithi188_173515_object88604:head# 2024-04-01T20:04:50.523 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.523 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee825cce:::benchmark_data_smithi188_173515_object148248:head# 2024-04-01T20:04:50.523 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.524 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee825f4e:::benchmark_data_smithi188_173515_object53917:head# 2024-04-01T20:04:50.524 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.524 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee8395eb:::benchmark_data_smithi188_173515_object125247:head# 2024-04-01T20:04:50.524 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.524 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee83ef93:::benchmark_data_smithi188_173515_object85417:head# 2024-04-01T20:04:50.524 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.524 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee8470b2:::benchmark_data_smithi188_173515_object127304:head# 2024-04-01T20:04:50.524 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.524 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee850f01:::benchmark_data_smithi188_173515_object84088:head# 2024-04-01T20:04:50.524 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.524 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee85b5aa:::benchmark_data_smithi188_173515_object77270:head# 2024-04-01T20:04:50.524 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.524 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee85c991:::benchmark_data_smithi188_173515_object102277:head# 2024-04-01T20:04:50.524 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.524 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee86c838:::benchmark_data_smithi188_173515_object84932:head# 2024-04-01T20:04:50.524 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.525 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee86fe82:::benchmark_data_smithi188_173515_object136517:head# 2024-04-01T20:04:50.525 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.525 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee878f5a:::benchmark_data_smithi188_173515_object58191:head# 2024-04-01T20:04:50.525 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.525 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee8810fe:::benchmark_data_smithi188_173515_object80933:head# 2024-04-01T20:04:50.525 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.525 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee8844ca:::benchmark_data_smithi188_173515_object134125:head# 2024-04-01T20:04:50.525 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.525 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee888ec6:::benchmark_data_smithi188_173515_object71324:head# 2024-04-01T20:04:50.525 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.525 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee8aacc5:::benchmark_data_smithi188_173515_object82789:head# 2024-04-01T20:04:50.525 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.525 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee8b550a:::benchmark_data_smithi188_173515_object140494:head# 2024-04-01T20:04:50.525 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.525 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee8bdb25:::benchmark_data_smithi188_173515_object112870:head# 2024-04-01T20:04:50.525 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.526 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee8c3902:::benchmark_data_smithi188_173515_object48701:head# 2024-04-01T20:04:50.526 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.526 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee8cab9a:::benchmark_data_smithi188_173515_object149689:head# 2024-04-01T20:04:50.526 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.526 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee8ddc7c:::benchmark_data_smithi188_173515_object46067:head# 2024-04-01T20:04:50.526 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.526 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee8e0bd8:::benchmark_data_smithi188_173515_object116227:head# 2024-04-01T20:04:50.526 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.526 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee8e58ec:::benchmark_data_smithi188_173515_object144427:head# 2024-04-01T20:04:50.526 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.526 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee8e6cdc:::benchmark_data_smithi188_173515_object105689:head# 2024-04-01T20:04:50.526 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.526 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee8e99bb:::benchmark_data_smithi188_173515_object139659:head# 2024-04-01T20:04:50.526 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.527 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee8f785a:::benchmark_data_smithi188_173515_object152076:head# 2024-04-01T20:04:50.527 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.527 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee8f8515:::benchmark_data_smithi188_173515_object117927:head# 2024-04-01T20:04:50.527 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.527 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee8fbbf0:::benchmark_data_smithi188_173515_object152661:head# 2024-04-01T20:04:50.527 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.527 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee910446:::benchmark_data_smithi188_173515_object114562:head# 2024-04-01T20:04:50.527 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.527 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee914875:::benchmark_data_smithi188_173515_object84701:head# 2024-04-01T20:04:50.527 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.527 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee919c0c:::benchmark_data_smithi188_173515_object56441:head# 2024-04-01T20:04:50.527 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.527 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee93ccae:::benchmark_data_smithi188_173515_object153893:head# 2024-04-01T20:04:50.527 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.527 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee94a55b:::benchmark_data_smithi188_173515_object151231:head# 2024-04-01T20:04:50.528 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.528 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee952bf2:::benchmark_data_smithi188_173515_object78210:head# 2024-04-01T20:04:50.528 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.528 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee9590d4:::benchmark_data_smithi188_173515_object80302:head# 2024-04-01T20:04:50.528 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.528 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee9593d2:::benchmark_data_smithi188_173515_object109653:head# 2024-04-01T20:04:50.528 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.528 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee95fa1f:::benchmark_data_smithi188_173515_object75556:head# 2024-04-01T20:04:50.528 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.528 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee9761ce:::benchmark_data_smithi188_173515_object48882:head# 2024-04-01T20:04:50.528 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.528 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee97c816:::benchmark_data_smithi188_173515_object56597:head# 2024-04-01T20:04:50.528 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.528 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee97d6bc:::benchmark_data_smithi188_173515_object141569:head# 2024-04-01T20:04:50.528 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.528 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee97eba8:::benchmark_data_smithi188_173515_object120806:head# 2024-04-01T20:04:50.529 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.529 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee98e920:::benchmark_data_smithi188_173515_object68607:head# 2024-04-01T20:04:50.529 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.529 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee9a7803:::benchmark_data_smithi188_173515_object63483:head# 2024-04-01T20:04:50.529 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.529 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee9ad9bb:::benchmark_data_smithi188_173515_object84609:head# 2024-04-01T20:04:50.529 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.529 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee9b992f:::benchmark_data_smithi188_173515_object57282:head# 2024-04-01T20:04:50.529 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.529 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee9bf47c:::benchmark_data_smithi188_173515_object114559:head# 2024-04-01T20:04:50.529 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.529 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee9cb280:::benchmark_data_smithi188_173515_object48445:head# 2024-04-01T20:04:50.529 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.529 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee9dcb9b:::benchmark_data_smithi188_173515_object111107:head# 2024-04-01T20:04:50.529 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.530 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee9dec46:::benchmark_data_smithi188_173515_object69481:head# 2024-04-01T20:04:50.530 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.530 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee9e05a1:::benchmark_data_smithi188_173515_object137252:head# 2024-04-01T20:04:50.530 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.530 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee9e59ee:::benchmark_data_smithi188_173515_object60878:head# 2024-04-01T20:04:50.530 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.530 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee9f5057:::benchmark_data_smithi188_173515_object84324:head# 2024-04-01T20:04:50.530 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.530 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee9f7cb8:::benchmark_data_smithi188_173515_object69694:head# 2024-04-01T20:04:50.530 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.530 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ee9fdfc7:::benchmark_data_smithi188_173515_object71954:head# 2024-04-01T20:04:50.530 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.530 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eea0313f:::benchmark_data_smithi188_173515_object57545:head# 2024-04-01T20:04:50.530 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.531 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eea0357f:::benchmark_data_smithi188_173515_object140541:head# 2024-04-01T20:04:50.531 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.531 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eea03e67:::benchmark_data_smithi188_173515_object62778:head# 2024-04-01T20:04:50.531 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.531 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eea14d63:::benchmark_data_smithi188_173515_object148431:head# 2024-04-01T20:04:50.531 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.531 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eea1f9c8:::benchmark_data_smithi188_173515_object81125:head# 2024-04-01T20:04:50.531 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.531 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eea21268:::benchmark_data_smithi188_173515_object121986:head# 2024-04-01T20:04:50.531 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.531 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eea29883:::benchmark_data_smithi188_173515_object108815:head# 2024-04-01T20:04:50.531 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.531 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eea2c868:::benchmark_data_smithi188_173515_object121230:head# 2024-04-01T20:04:50.531 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.531 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eea31a38:::benchmark_data_smithi188_173515_object49894:head# 2024-04-01T20:04:50.532 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.532 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eea37af5:::benchmark_data_smithi188_173515_object94878:head# 2024-04-01T20:04:50.532 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.532 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eea3d1ed:::benchmark_data_smithi188_173515_object150391:head# 2024-04-01T20:04:50.532 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.532 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eea3f3e5:::benchmark_data_smithi188_173515_object95969:head# 2024-04-01T20:04:50.532 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.532 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eea4915b:::benchmark_data_smithi188_173515_object70678:head# 2024-04-01T20:04:50.532 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.532 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eea4997b:::benchmark_data_smithi188_173515_object106401:head# 2024-04-01T20:04:50.532 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.532 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eea50319:::benchmark_data_smithi188_173515_object142039:head# 2024-04-01T20:04:50.532 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.532 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eea522a4:::benchmark_data_smithi188_173515_object75170:head# 2024-04-01T20:04:50.532 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.532 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eea53b37:::benchmark_data_smithi188_173515_object63941:head# 2024-04-01T20:04:50.533 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.533 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eea5b478:::benchmark_data_smithi188_173515_object80361:head# 2024-04-01T20:04:50.533 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.533 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eea66fb5:::benchmark_data_smithi188_173515_object77617:head# 2024-04-01T20:04:50.533 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.533 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eea6c63a:::benchmark_data_smithi188_173515_object153024:head# 2024-04-01T20:04:50.533 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.533 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eea81e7c:::benchmark_data_smithi188_173515_object139164:head# 2024-04-01T20:04:50.533 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.533 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eea85f17:::benchmark_data_smithi188_173515_object104048:head# 2024-04-01T20:04:50.533 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.533 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eea8ece5:::benchmark_data_smithi188_173515_object57237:head# 2024-04-01T20:04:50.533 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.533 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eea95b49:::benchmark_data_smithi188_173515_object138067:head# 2024-04-01T20:04:50.533 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.534 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeab46de:::benchmark_data_smithi188_173515_object52616:head# 2024-04-01T20:04:50.534 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.534 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeab607f:::benchmark_data_smithi188_173515_object66469:head# 2024-04-01T20:04:50.534 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.534 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeac349d:::benchmark_data_smithi188_173515_object137598:head# 2024-04-01T20:04:50.534 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.534 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeac7785:::benchmark_data_smithi188_173515_object95064:head# 2024-04-01T20:04:50.534 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.534 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eead135e:::benchmark_data_smithi188_173515_object117444:head# 2024-04-01T20:04:50.534 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.534 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eead9d0b:::benchmark_data_smithi188_173515_object47748:head# 2024-04-01T20:04:50.534 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.534 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeadf47e:::benchmark_data_smithi188_173515_object60587:head# 2024-04-01T20:04:50.534 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.535 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeaee603:::benchmark_data_smithi188_173515_object100486:head# 2024-04-01T20:04:50.535 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.535 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeaf1a12:::benchmark_data_smithi188_173515_object154720:head# 2024-04-01T20:04:50.535 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.535 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeaf3e97:::benchmark_data_smithi188_173515_object76618:head# 2024-04-01T20:04:50.535 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.535 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeafe516:::benchmark_data_smithi188_173515_object131155:head# 2024-04-01T20:04:50.535 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.535 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeb0f50f:::benchmark_data_smithi188_173515_object113753:head# 2024-04-01T20:04:50.535 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.535 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeb17448:::benchmark_data_smithi188_173515_object69580:head# 2024-04-01T20:04:50.535 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.535 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeb23fec:::benchmark_data_smithi188_173515_object103203:head# 2024-04-01T20:04:50.535 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.535 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeb24458:::benchmark_data_smithi188_173515_object148575:head# 2024-04-01T20:04:50.536 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.536 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeb2e067:::benchmark_data_smithi188_173515_object154671:head# 2024-04-01T20:04:50.536 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.536 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeb30473:::benchmark_data_smithi188_173515_object109983:head# 2024-04-01T20:04:50.536 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.536 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeb39246:::benchmark_data_smithi188_173515_object134127:head# 2024-04-01T20:04:50.536 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.536 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeb3d6a9:::benchmark_data_smithi188_173515_object89424:head# 2024-04-01T20:04:50.536 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.536 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeb421ba:::benchmark_data_smithi188_173515_object117435:head# 2024-04-01T20:04:50.536 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.536 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeb4a387:::benchmark_data_smithi188_173515_object76530:head# 2024-04-01T20:04:50.536 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.536 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeb4d866:::benchmark_data_smithi188_173515_object118359:head# 2024-04-01T20:04:50.536 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.536 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeb57682:::benchmark_data_smithi188_173515_object144600:head# 2024-04-01T20:04:50.537 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.537 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeb5dd5b:::benchmark_data_smithi188_173515_object97103:head# 2024-04-01T20:04:50.537 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.537 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeb76270:::benchmark_data_smithi188_173515_object54310:head# 2024-04-01T20:04:50.537 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.537 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeb7ba50:::benchmark_data_smithi188_173515_object57596:head# 2024-04-01T20:04:50.537 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.537 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeb7c474:::benchmark_data_smithi188_173515_object120261:head# 2024-04-01T20:04:50.537 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.537 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeb86fa7:::benchmark_data_smithi188_173515_object143275:head# 2024-04-01T20:04:50.537 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.537 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeb8f263:::benchmark_data_smithi188_173515_object115712:head# 2024-04-01T20:04:50.537 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.537 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeb97fe5:::benchmark_data_smithi188_173515_object49968:head# 2024-04-01T20:04:50.537 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.537 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeba1f08:::benchmark_data_smithi188_173515_object103288:head# 2024-04-01T20:04:50.538 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.538 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeba813b:::benchmark_data_smithi188_173515_object121615:head# 2024-04-01T20:04:50.538 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.538 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eebb9d39:::benchmark_data_smithi188_173515_object138333:head# 2024-04-01T20:04:50.538 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.538 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eebbfae9:::benchmark_data_smithi188_173515_object49060:head# 2024-04-01T20:04:50.538 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.538 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eebc0dc3:::benchmark_data_smithi188_173515_object154718:head# 2024-04-01T20:04:50.538 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.538 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eebc62b7:::benchmark_data_smithi188_173515_object134482:head# 2024-04-01T20:04:50.538 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.538 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eec14b77:::benchmark_data_smithi188_173515_object114560:head# 2024-04-01T20:04:50.538 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.539 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eec1e4fb:::benchmark_data_smithi188_173515_object84295:head# 2024-04-01T20:04:50.539 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.539 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eec2339e:::benchmark_data_smithi188_173515_object154678:head# 2024-04-01T20:04:50.539 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.539 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eec241b5:::benchmark_data_smithi188_173515_object49502:head# 2024-04-01T20:04:50.539 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.539 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eec273b3:::benchmark_data_smithi188_173515_object97939:head# 2024-04-01T20:04:50.539 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.539 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eec564b5:::benchmark_data_smithi188_173515_object86768:head# 2024-04-01T20:04:50.539 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.539 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eec57bd5:::benchmark_data_smithi188_173515_object147018:head# 2024-04-01T20:04:50.539 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.539 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eec5eaed:::benchmark_data_smithi188_173515_object134097:head# 2024-04-01T20:04:50.539 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.539 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eec63f0c:::benchmark_data_smithi188_173515_object60512:head# 2024-04-01T20:04:50.539 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.540 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eec698b4:::benchmark_data_smithi188_173515_object48848:head# 2024-04-01T20:04:50.540 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.540 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eec69d6a:::benchmark_data_smithi188_173515_object152925:head# 2024-04-01T20:04:50.540 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.540 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eec6ff69:::benchmark_data_smithi188_173515_object144214:head# 2024-04-01T20:04:50.540 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.540 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eec7047a:::benchmark_data_smithi188_173515_object108192:head# 2024-04-01T20:04:50.540 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.540 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eec80a42:::benchmark_data_smithi188_173515_object69082:head# 2024-04-01T20:04:50.540 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.540 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eecada11:::benchmark_data_smithi188_173515_object80241:head# 2024-04-01T20:04:50.540 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.540 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eecba305:::benchmark_data_smithi188_173515_object64980:head# 2024-04-01T20:04:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eecccdc8:::benchmark_data_smithi188_173515_object83250:head# 2024-04-01T20:04:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeccfb9f:::benchmark_data_smithi188_173515_object141008:head# 2024-04-01T20:04:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeccfed2:::benchmark_data_smithi188_173515_object152715:head# 2024-04-01T20:04:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eecd8efd:::benchmark_data_smithi188_173515_object148915:head# 2024-04-01T20:04:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eecde39a:::benchmark_data_smithi188_173515_object62171:head# 2024-04-01T20:04:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eecec517:::benchmark_data_smithi188_173515_object48446:head# 2024-04-01T20:04:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eecec928:::benchmark_data_smithi188_173515_object70854:head# 2024-04-01T20:04:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.541 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eecf516e:::benchmark_data_smithi188_173515_object72877:head# 2024-04-01T20:04:50.542 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.542 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eecf60c2:::benchmark_data_smithi188_173515_object97342:head# 2024-04-01T20:04:50.542 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.542 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eecf995c:::benchmark_data_smithi188_173515_object134327:head# 2024-04-01T20:04:50.542 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.542 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eecfc2a9:::benchmark_data_smithi188_173515_object106642:head# 2024-04-01T20:04:50.542 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.542 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eed036d9:::benchmark_data_smithi188_173515_object74727:head# 2024-04-01T20:04:50.542 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.542 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eed0d128:::benchmark_data_smithi188_173515_object148446:head# 2024-04-01T20:04:50.542 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.542 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eed1f750:::benchmark_data_smithi188_173515_object109233:head# 2024-04-01T20:04:50.542 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.543 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eed2ceea:::benchmark_data_smithi188_173515_object67160:head# 2024-04-01T20:04:50.543 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.543 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eed33b9b:::benchmark_data_smithi188_173515_object119003:head# 2024-04-01T20:04:50.543 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.543 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eed3ba15:::benchmark_data_smithi188_173515_object64928:head# 2024-04-01T20:04:50.543 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.543 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eed44061:::benchmark_data_smithi188_173515_object138102:head# 2024-04-01T20:04:50.543 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.543 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eed4d4fc:::benchmark_data_smithi188_173515_object95800:head# 2024-04-01T20:04:50.543 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.543 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eed51922:::benchmark_data_smithi188_173515_object154731:head# 2024-04-01T20:04:50.543 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.543 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eed5b62b:::benchmark_data_smithi188_173515_object87986:head# 2024-04-01T20:04:50.543 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.543 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eed5bba8:::benchmark_data_smithi188_173515_object116233:head# 2024-04-01T20:04:50.544 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.544 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eed5bca1:::benchmark_data_smithi188_173515_object55402:head# 2024-04-01T20:04:50.544 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.544 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eed60e0c:::benchmark_data_smithi188_173515_object91698:head# 2024-04-01T20:04:50.544 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.544 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eed62aa9:::benchmark_data_smithi188_173515_object146135:head# 2024-04-01T20:04:50.544 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.544 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eed635fc:::benchmark_data_smithi188_173515_object64138:head# 2024-04-01T20:04:50.544 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.544 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eed79e7c:::benchmark_data_smithi188_173515_object155615:head# 2024-04-01T20:04:50.544 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.544 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eed7ae06:::benchmark_data_smithi188_173515_object81925:head# 2024-04-01T20:04:50.544 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.544 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eed84965:::benchmark_data_smithi188_173515_object85089:head# 2024-04-01T20:04:50.545 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.545 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eed8e6ae:::benchmark_data_smithi188_173515_object86307:head# 2024-04-01T20:04:50.545 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.545 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eed99d10:::benchmark_data_smithi188_173515_object75222:head# 2024-04-01T20:04:50.545 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.545 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eed9b671:::benchmark_data_smithi188_173515_object87911:head# 2024-04-01T20:04:50.545 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.545 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eedc969e:::benchmark_data_smithi188_173515_object125137:head# 2024-04-01T20:04:50.545 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.545 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eedd0f18:::benchmark_data_smithi188_173515_object51339:head# 2024-04-01T20:04:50.545 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.545 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeddb1e9:::benchmark_data_smithi188_173515_object137643:head# 2024-04-01T20:04:50.545 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.545 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eede4473:::benchmark_data_smithi188_173515_object55440:head# 2024-04-01T20:04:50.545 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.546 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eedf21a8:::benchmark_data_smithi188_173515_object139596:head# 2024-04-01T20:04:50.546 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.546 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eedf6c72:::benchmark_data_smithi188_173515_object46221:head# 2024-04-01T20:04:50.546 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.546 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eee027fe:::benchmark_data_smithi188_173515_object83157:head# 2024-04-01T20:04:50.546 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.546 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eee07c9a:::benchmark_data_smithi188_173515_object54678:head# 2024-04-01T20:04:50.546 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.546 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eee0decf:::benchmark_data_smithi188_173515_object49884:head# 2024-04-01T20:04:50.546 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.546 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eee22199:::benchmark_data_smithi188_173515_object54605:head# 2024-04-01T20:04:50.546 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.546 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eee23f73:::benchmark_data_smithi188_173515_object71847:head# 2024-04-01T20:04:50.546 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.547 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eee273fb:::benchmark_data_smithi188_173515_object138950:head# 2024-04-01T20:04:50.547 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.547 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eee28a27:::benchmark_data_smithi188_173515_object63777:head# 2024-04-01T20:04:50.547 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.547 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eee2d402:::benchmark_data_smithi188_173515_object136001:head# 2024-04-01T20:04:50.547 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.547 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eee38adb:::benchmark_data_smithi188_173515_object116902:head# 2024-04-01T20:04:50.547 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.547 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eee393e2:::benchmark_data_smithi188_173515_object90201:head# 2024-04-01T20:04:50.547 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.547 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eee54d14:::benchmark_data_smithi188_173515_object141238:head# 2024-04-01T20:04:50.547 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.547 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eee67cb4:::benchmark_data_smithi188_173515_object68289:head# 2024-04-01T20:04:50.547 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.547 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eee6a3c7:::benchmark_data_smithi188_173515_object80010:head# 2024-04-01T20:04:50.547 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.548 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eee7a529:::benchmark_data_smithi188_173515_object148456:head# 2024-04-01T20:04:50.548 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.548 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eee7bd8d:::benchmark_data_smithi188_173515_object84801:head# 2024-04-01T20:04:50.548 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.548 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eee89412:::benchmark_data_smithi188_173515_object58257:head# 2024-04-01T20:04:50.548 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.548 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eee918d9:::benchmark_data_smithi188_173515_object114673:head# 2024-04-01T20:04:50.548 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.548 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeea7e4e:::benchmark_data_smithi188_173515_object121249:head# 2024-04-01T20:04:50.548 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.548 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeead34f:::benchmark_data_smithi188_173515_object64512:head# 2024-04-01T20:04:50.548 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.548 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeeaf9fc:::benchmark_data_smithi188_173515_object127500:head# 2024-04-01T20:04:50.548 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.548 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeeb5cd4:::benchmark_data_smithi188_173515_object116591:head# 2024-04-01T20:04:50.549 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.549 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeecd68b:::benchmark_data_smithi188_173515_object147148:head# 2024-04-01T20:04:50.549 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.549 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeed4a15:::benchmark_data_smithi188_173515_object111501:head# 2024-04-01T20:04:50.549 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.549 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeeda1f4:::benchmark_data_smithi188_173515_object109277:head# 2024-04-01T20:04:50.549 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.549 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeee8c33:::benchmark_data_smithi188_173515_object122899:head# 2024-04-01T20:04:50.549 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.549 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeeef9cf:::benchmark_data_smithi188_173515_object110234:head# 2024-04-01T20:04:50.549 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.549 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeef2b7e:::benchmark_data_smithi188_173515_object74828:head# 2024-04-01T20:04:50.549 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.549 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeefafd8:::benchmark_data_smithi188_173515_object135189:head# 2024-04-01T20:04:50.549 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.550 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eef0c571:::benchmark_data_smithi188_173515_object152952:head# 2024-04-01T20:04:50.550 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.550 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eef23dd7:::benchmark_data_smithi188_173515_object57422:head# 2024-04-01T20:04:50.550 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.550 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eef241d3:::benchmark_data_smithi188_173515_object69846:head# 2024-04-01T20:04:50.550 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.550 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eef27d2c:::benchmark_data_smithi188_173515_object133888:head# 2024-04-01T20:04:50.550 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.550 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eef3aa97:::benchmark_data_smithi188_173515_object88352:head# 2024-04-01T20:04:50.550 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.550 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eef3e51b:::benchmark_data_smithi188_173515_object73145:head# 2024-04-01T20:04:50.550 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.550 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eef4384d:::benchmark_data_smithi188_173515_object139601:head# 2024-04-01T20:04:50.550 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.551 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eef47b68:::benchmark_data_smithi188_173515_object69470:head# 2024-04-01T20:04:50.551 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.551 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eef5e064:::benchmark_data_smithi188_173515_object141809:head# 2024-04-01T20:04:50.551 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.551 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eef61618:::benchmark_data_smithi188_173515_object52724:head# 2024-04-01T20:04:50.551 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.551 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eef6c080:::benchmark_data_smithi188_173515_object126010:head# 2024-04-01T20:04:50.551 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.551 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eef765ef:::benchmark_data_smithi188_173515_object135659:head# 2024-04-01T20:04:50.551 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.551 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eef7738d:::benchmark_data_smithi188_173515_object150074:head# 2024-04-01T20:04:50.551 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.551 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eef82a92:::benchmark_data_smithi188_173515_object119351:head# 2024-04-01T20:04:50.551 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.552 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eef8fdf3:::benchmark_data_smithi188_173515_object99149:head# 2024-04-01T20:04:50.552 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.552 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eef98301:::benchmark_data_smithi188_173515_object63518:head# 2024-04-01T20:04:50.552 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.552 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eef9a80d:::benchmark_data_smithi188_173515_object107167:head# 2024-04-01T20:04:50.552 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.552 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eef9f96c:::benchmark_data_smithi188_173515_object153903:head# 2024-04-01T20:04:50.552 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.552 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eefb3284:::benchmark_data_smithi188_173515_object146115:head# 2024-04-01T20:04:50.552 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.552 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eefbc1c0:::benchmark_data_smithi188_173515_object64634:head# 2024-04-01T20:04:50.552 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.552 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eefd92b6:::benchmark_data_smithi188_173515_object71495:head# 2024-04-01T20:04:50.552 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.553 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eefe20c8:::benchmark_data_smithi188_173515_object51802:head# 2024-04-01T20:04:50.553 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.553 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eefe699f:::benchmark_data_smithi188_173515_object74809:head# 2024-04-01T20:04:50.553 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.553 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eefe7a11:::benchmark_data_smithi188_173515_object114416:head# 2024-04-01T20:04:50.553 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.553 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eeffba04:::benchmark_data_smithi188_173515_object46667:head# 2024-04-01T20:04:50.553 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.553 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef004d9e:::benchmark_data_smithi188_173515_object93721:head# 2024-04-01T20:04:50.553 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.553 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef015bd9:::benchmark_data_smithi188_173515_object57659:head# 2024-04-01T20:04:50.553 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.553 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef01cb83:::benchmark_data_smithi188_173515_object77789:head# 2024-04-01T20:04:50.553 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.554 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef02ac7d:::benchmark_data_smithi188_173515_object98042:head# 2024-04-01T20:04:50.554 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.554 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef02da48:::benchmark_data_smithi188_173515_object52547:head# 2024-04-01T20:04:50.554 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.554 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef034cc4:::benchmark_data_smithi188_173515_object86052:head# 2024-04-01T20:04:50.554 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.554 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef03594d:::benchmark_data_smithi188_173515_object79335:head# 2024-04-01T20:04:50.554 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.554 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef03a44b:::benchmark_data_smithi188_173515_object111914:head# 2024-04-01T20:04:50.554 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.554 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef03ed1f:::benchmark_data_smithi188_173515_object155365:head# 2024-04-01T20:04:50.554 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.554 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef05063a:::benchmark_data_smithi188_173515_object79009:head# 2024-04-01T20:04:50.555 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.555 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef053c00:::benchmark_data_smithi188_173515_object151485:head# 2024-04-01T20:04:50.555 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.555 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef068f2d:::benchmark_data_smithi188_173515_object46557:head# 2024-04-01T20:04:50.555 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.555 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef085a37:::benchmark_data_smithi188_173515_object136214:head# 2024-04-01T20:04:50.555 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.555 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef0979cd:::benchmark_data_smithi188_173515_object69844:head# 2024-04-01T20:04:50.555 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.555 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef09ae1a:::benchmark_data_smithi188_173515_object73258:head# 2024-04-01T20:04:50.555 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.555 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef09f3ff:::benchmark_data_smithi188_173515_object93270:head# 2024-04-01T20:04:50.555 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.555 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef0a5823:::benchmark_data_smithi188_173515_object62251:head# 2024-04-01T20:04:50.556 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.556 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef0a97d3:::benchmark_data_smithi188_173515_object154478:head# 2024-04-01T20:04:50.556 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.556 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef0ae426:::benchmark_data_smithi188_173515_object122992:head# 2024-04-01T20:04:50.556 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.556 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef0ae472:::benchmark_data_smithi188_173515_object87493:head# 2024-04-01T20:04:50.556 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.556 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef0b406f:::benchmark_data_smithi188_173515_object100880:head# 2024-04-01T20:04:50.556 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.556 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef0cf91a:::benchmark_data_smithi188_173515_object71619:head# 2024-04-01T20:04:50.556 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.556 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef0d262a:::benchmark_data_smithi188_173515_object91847:head# 2024-04-01T20:04:50.556 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.556 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef0da821:::benchmark_data_smithi188_173515_object87034:head# 2024-04-01T20:04:50.556 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.557 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef10225c:::benchmark_data_smithi188_173515_object67638:head# 2024-04-01T20:04:50.557 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.557 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef112419:::benchmark_data_smithi188_173515_object111591:head# 2024-04-01T20:04:50.557 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.557 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef11732b:::benchmark_data_smithi188_173515_object106904:head# 2024-04-01T20:04:50.557 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.557 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef11bfcc:::benchmark_data_smithi188_173515_object102693:head# 2024-04-01T20:04:50.557 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.557 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef11d74e:::benchmark_data_smithi188_173515_object71970:head# 2024-04-01T20:04:50.557 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.557 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef1232d6:::benchmark_data_smithi188_173515_object148564:head# 2024-04-01T20:04:50.557 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.557 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef126dd5:::benchmark_data_smithi188_173515_object121417:head# 2024-04-01T20:04:50.557 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.558 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef12d79e:::benchmark_data_smithi188_173515_object150617:head# 2024-04-01T20:04:50.558 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.558 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef135f17:::benchmark_data_smithi188_173515_object132025:head# 2024-04-01T20:04:50.558 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.558 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef13ecad:::benchmark_data_smithi188_173515_object139616:head# 2024-04-01T20:04:50.558 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.558 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef144073:::benchmark_data_smithi188_173515_object96081:head# 2024-04-01T20:04:50.558 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.558 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef1534a9:::benchmark_data_smithi188_173515_object150630:head# 2024-04-01T20:04:50.558 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.558 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef15b339:::benchmark_data_smithi188_173515_object122170:head# 2024-04-01T20:04:50.558 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.558 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef160b76:::benchmark_data_smithi188_173515_object85721:head# 2024-04-01T20:04:50.558 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.559 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef17344a:::benchmark_data_smithi188_173515_object102173:head# 2024-04-01T20:04:50.559 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.559 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef18d4f7:::benchmark_data_smithi188_173515_object151866:head# 2024-04-01T20:04:50.559 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.559 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef19cb46:::benchmark_data_smithi188_173515_object131616:head# 2024-04-01T20:04:50.559 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.559 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef1a0279:::benchmark_data_smithi188_173515_object122072:head# 2024-04-01T20:04:50.559 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.559 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef1ab80f:::benchmark_data_smithi188_173515_object119785:head# 2024-04-01T20:04:50.559 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.559 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef1b643f:::benchmark_data_smithi188_173515_object107768:head# 2024-04-01T20:04:50.559 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.559 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef1c39fd:::benchmark_data_smithi188_173515_object91184:head# 2024-04-01T20:04:50.559 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.559 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef1c45cd:::benchmark_data_smithi188_173515_object116060:head# 2024-04-01T20:04:50.560 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.560 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef1c669e:::benchmark_data_smithi188_173515_object143234:head# 2024-04-01T20:04:50.560 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.560 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef1d1ea8:::benchmark_data_smithi188_173515_object137219:head# 2024-04-01T20:04:50.560 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.560 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef1e13a3:::benchmark_data_smithi188_173515_object137804:head# 2024-04-01T20:04:50.560 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.560 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef1eaaff:::benchmark_data_smithi188_173515_object79248:head# 2024-04-01T20:04:50.560 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.560 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef1ef2da:::benchmark_data_smithi188_173515_object126796:head# 2024-04-01T20:04:50.560 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.560 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef1f18c8:::benchmark_data_smithi188_173515_object153524:head# 2024-04-01T20:04:50.560 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.560 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef206cce:::benchmark_data_smithi188_173515_object111586:head# 2024-04-01T20:04:50.560 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.561 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef20cea8:::benchmark_data_smithi188_173515_object142837:head# 2024-04-01T20:04:50.561 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.561 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef20d3a5:::benchmark_data_smithi188_173515_object123428:head# 2024-04-01T20:04:50.561 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.561 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef21bf5e:::benchmark_data_smithi188_173515_object101640:head# 2024-04-01T20:04:50.561 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.561 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef221dbf:::benchmark_data_smithi188_173515_object155393:head# 2024-04-01T20:04:50.561 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.561 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef222768:::benchmark_data_smithi188_173515_object140753:head# 2024-04-01T20:04:50.561 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.561 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef236c4f:::benchmark_data_smithi188_173515_object97438:head# 2024-04-01T20:04:50.561 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.561 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef23cd6f:::benchmark_data_smithi188_173515_object136005:head# 2024-04-01T20:04:50.561 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.561 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef2416e6:::benchmark_data_smithi188_173515_object68915:head# 2024-04-01T20:04:50.561 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.562 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef259f56:::benchmark_data_smithi188_173515_object95983:head# 2024-04-01T20:04:50.562 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.562 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef25c6db:::benchmark_data_smithi188_173515_object62450:head# 2024-04-01T20:04:50.562 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.562 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef25df3a:::benchmark_data_smithi188_173515_object136215:head# 2024-04-01T20:04:50.562 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.562 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef279696:::benchmark_data_smithi188_173515_object120613:head# 2024-04-01T20:04:50.562 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.562 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef279bfa:::benchmark_data_smithi188_173515_object150845:head# 2024-04-01T20:04:50.562 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.562 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef27fd80:::benchmark_data_smithi188_173515_object65499:head# 2024-04-01T20:04:50.562 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.562 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef290309:::benchmark_data_smithi188_173515_object153684:head# 2024-04-01T20:04:50.562 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.562 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef291311:::benchmark_data_smithi188_173515_object121634:head# 2024-04-01T20:04:50.563 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.563 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef2b0c7b:::benchmark_data_smithi188_173515_object73123:head# 2024-04-01T20:04:50.563 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.563 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef2b3ab6:::benchmark_data_smithi188_173515_object135912:head# 2024-04-01T20:04:50.563 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.563 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef2b442d:::benchmark_data_smithi188_173515_object121067:head# 2024-04-01T20:04:50.563 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.563 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef2b7525:::benchmark_data_smithi188_173515_object142883:head# 2024-04-01T20:04:50.563 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.563 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef2ce81b:::benchmark_data_smithi188_173515_object93154:head# 2024-04-01T20:04:50.563 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.563 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef2d7fa1:::benchmark_data_smithi188_173515_object84167:head# 2024-04-01T20:04:50.563 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.563 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef2dad6b:::benchmark_data_smithi188_173515_object107835:head# 2024-04-01T20:04:50.563 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.564 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef2e1bbe:::benchmark_data_smithi188_173515_object104439:head# 2024-04-01T20:04:50.564 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.564 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef2e258a:::benchmark_data_smithi188_173515_object101453:head# 2024-04-01T20:04:50.564 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.564 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef2e6d8f:::benchmark_data_smithi188_173515_object76392:head# 2024-04-01T20:04:50.564 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.564 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef2e7f11:::benchmark_data_smithi188_173515_object142169:head# 2024-04-01T20:04:50.564 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.564 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef2e974b:::benchmark_data_smithi188_173515_object151584:head# 2024-04-01T20:04:50.564 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.564 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef2ebdc3:::benchmark_data_smithi188_173515_object137706:head# 2024-04-01T20:04:50.564 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.564 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef2f0509:::benchmark_data_smithi188_173515_object153801:head# 2024-04-01T20:04:50.564 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.565 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef2f57e1:::benchmark_data_smithi188_173515_object96958:head# 2024-04-01T20:04:50.565 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.565 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef301278:::benchmark_data_smithi188_173515_object97974:head# 2024-04-01T20:04:50.565 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.565 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef308906:::benchmark_data_smithi188_173515_object148703:head# 2024-04-01T20:04:50.565 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.565 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef30b3e1:::benchmark_data_smithi188_173515_object62789:head# 2024-04-01T20:04:50.565 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.565 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef312872:::benchmark_data_smithi188_173515_object67440:head# 2024-04-01T20:04:50.565 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.565 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef318b70:::benchmark_data_smithi188_173515_object88801:head# 2024-04-01T20:04:50.565 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.565 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef32e40a:::benchmark_data_smithi188_173515_object61823:head# 2024-04-01T20:04:50.565 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.566 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef32f225:::benchmark_data_smithi188_173515_object105546:head# 2024-04-01T20:04:50.566 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.566 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef363d5f:::benchmark_data_smithi188_173515_object74515:head# 2024-04-01T20:04:50.566 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.566 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef368ce6:::benchmark_data_smithi188_173515_object50661:head# 2024-04-01T20:04:50.566 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.566 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef36c55e:::benchmark_data_smithi188_173515_object75602:head# 2024-04-01T20:04:50.566 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.566 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef382b9d:::benchmark_data_smithi188_173515_object52811:head# 2024-04-01T20:04:50.566 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.566 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef384dfd:::benchmark_data_smithi188_173515_object74661:head# 2024-04-01T20:04:50.566 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.566 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef388832:::benchmark_data_smithi188_173515_object131882:head# 2024-04-01T20:04:50.566 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.567 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef38cb72:::benchmark_data_smithi188_173515_object145878:head# 2024-04-01T20:04:50.567 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.567 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef3b14a8:::benchmark_data_smithi188_173515_object55090:head# 2024-04-01T20:04:50.567 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.567 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef3b8c8e:::benchmark_data_smithi188_173515_object117274:head# 2024-04-01T20:04:50.567 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.567 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef3bd74b:::benchmark_data_smithi188_173515_object150584:head# 2024-04-01T20:04:50.567 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.567 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef3c1592:::benchmark_data_smithi188_173515_object92860:head# 2024-04-01T20:04:50.567 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.567 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef3c453a:::benchmark_data_smithi188_173515_object85032:head# 2024-04-01T20:04:50.567 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.567 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef3c4c2b:::benchmark_data_smithi188_173515_object101065:head# 2024-04-01T20:04:50.567 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.567 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef3c9dcf:::benchmark_data_smithi188_173515_object52539:head# 2024-04-01T20:04:50.568 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.568 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef3d8e7e:::benchmark_data_smithi188_173515_object132299:head# 2024-04-01T20:04:50.568 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.568 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef3e4132:::benchmark_data_smithi188_173515_object132891:head# 2024-04-01T20:04:50.568 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.568 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef3f21d0:::benchmark_data_smithi188_173515_object137130:head# 2024-04-01T20:04:50.568 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.568 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef409d72:::benchmark_data_smithi188_173515_object144317:head# 2024-04-01T20:04:50.568 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.568 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef414d6d:::benchmark_data_smithi188_173515_object151134:head# 2024-04-01T20:04:50.568 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.568 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef414e93:::benchmark_data_smithi188_173515_object49346:head# 2024-04-01T20:04:50.568 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.568 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef429959:::benchmark_data_smithi188_173515_object95224:head# 2024-04-01T20:04:50.568 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.568 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef429e95:::benchmark_data_smithi188_173515_object116021:head# 2024-04-01T20:04:50.569 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.569 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef43991b:::benchmark_data_smithi188_173515_object115077:head# 2024-04-01T20:04:50.569 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.569 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef4411bb:::benchmark_data_smithi188_173515_object151941:head# 2024-04-01T20:04:50.569 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.569 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef447905:::benchmark_data_smithi188_173515_object142472:head# 2024-04-01T20:04:50.569 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.569 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef44b7a9:::benchmark_data_smithi188_173515_object143572:head# 2024-04-01T20:04:50.569 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.569 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef44d31c:::benchmark_data_smithi188_173515_object110074:head# 2024-04-01T20:04:50.569 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.569 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef450f33:::benchmark_data_smithi188_173515_object137411:head# 2024-04-01T20:04:50.569 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.569 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef452c16:::benchmark_data_smithi188_173515_object132996:head# 2024-04-01T20:04:50.570 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.570 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef458495:::benchmark_data_smithi188_173515_object48244:head# 2024-04-01T20:04:50.570 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.570 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef473b29:::benchmark_data_smithi188_173515_object100128:head# 2024-04-01T20:04:50.570 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.570 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef478437:::benchmark_data_smithi188_173515_object155227:head# 2024-04-01T20:04:50.570 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.570 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef491c3f:::benchmark_data_smithi188_173515_object152368:head# 2024-04-01T20:04:50.570 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.570 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef49a0f5:::benchmark_data_smithi188_173515_object66333:head# 2024-04-01T20:04:50.570 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.570 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef49a65a:::benchmark_data_smithi188_173515_object54847:head# 2024-04-01T20:04:50.570 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.570 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef4d0490:::benchmark_data_smithi188_173515_object105241:head# 2024-04-01T20:04:50.571 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.571 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef4da297:::benchmark_data_smithi188_173515_object98883:head# 2024-04-01T20:04:50.571 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.571 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef4ef3b9:::benchmark_data_smithi188_173515_object126652:head# 2024-04-01T20:04:50.571 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.571 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef4f29c8:::benchmark_data_smithi188_173515_object60518:head# 2024-04-01T20:04:50.571 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.571 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef4f3072:::benchmark_data_smithi188_173515_object105100:head# 2024-04-01T20:04:50.571 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.571 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef4f4134:::benchmark_data_smithi188_173515_object53882:head# 2024-04-01T20:04:50.571 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.571 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef4f5dbc:::benchmark_data_smithi188_173515_object152162:head# 2024-04-01T20:04:50.571 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.571 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef51c75d:::benchmark_data_smithi188_173515_object72847:head# 2024-04-01T20:04:50.572 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.572 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef51ecc9:::benchmark_data_smithi188_173515_object60551:head# 2024-04-01T20:04:50.572 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.572 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef524197:::benchmark_data_smithi188_173515_object79389:head# 2024-04-01T20:04:50.572 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.572 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef52924a:::benchmark_data_smithi188_173515_object87721:head# 2024-04-01T20:04:50.572 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.572 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef5337ef:::benchmark_data_smithi188_173515_object151174:head# 2024-04-01T20:04:50.572 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.572 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef53733d:::benchmark_data_smithi188_173515_object110397:head# 2024-04-01T20:04:50.572 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.572 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef53fd0c:::benchmark_data_smithi188_173515_object88181:head# 2024-04-01T20:04:50.572 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.572 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef546185:::benchmark_data_smithi188_173515_object104167:head# 2024-04-01T20:04:50.572 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.572 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef547235:::benchmark_data_smithi188_173515_object70133:head# 2024-04-01T20:04:50.573 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.573 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef55aef3:::benchmark_data_smithi188_173515_object132507:head# 2024-04-01T20:04:50.573 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.573 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef57c7a6:::benchmark_data_smithi188_173515_object73835:head# 2024-04-01T20:04:50.573 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.573 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef57dab8:::benchmark_data_smithi188_173515_object75197:head# 2024-04-01T20:04:50.573 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.573 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef57ffa6:::benchmark_data_smithi188_173515_object73241:head# 2024-04-01T20:04:50.573 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.573 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef5889b5:::benchmark_data_smithi188_173515_object154896:head# 2024-04-01T20:04:50.573 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.573 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef589fc1:::benchmark_data_smithi188_173515_object125689:head# 2024-04-01T20:04:50.573 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.573 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef58b603:::benchmark_data_smithi188_173515_object69979:head# 2024-04-01T20:04:50.573 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.574 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef58bde3:::benchmark_data_smithi188_173515_object113328:head# 2024-04-01T20:04:50.574 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.574 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef5a2b13:::benchmark_data_smithi188_173515_object139022:head# 2024-04-01T20:04:50.574 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.574 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef5a6e15:::benchmark_data_smithi188_173515_object122129:head# 2024-04-01T20:04:50.574 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.574 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef5d5d44:::benchmark_data_smithi188_173515_object101612:head# 2024-04-01T20:04:50.574 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.574 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef5dc24a:::benchmark_data_smithi188_173515_object102111:head# 2024-04-01T20:04:50.574 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.574 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef5e8c35:::benchmark_data_smithi188_173515_object46837:head# 2024-04-01T20:04:50.574 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.574 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef5ed4de:::benchmark_data_smithi188_173515_object152348:head# 2024-04-01T20:04:50.574 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.575 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef5f2b89:::benchmark_data_smithi188_173515_object103273:head# 2024-04-01T20:04:50.575 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.575 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef5f2d62:::benchmark_data_smithi188_173515_object51227:head# 2024-04-01T20:04:50.575 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.575 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef5f4a4b:::benchmark_data_smithi188_173515_object89918:head# 2024-04-01T20:04:50.575 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.575 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef5f6264:::benchmark_data_smithi188_173515_object76447:head# 2024-04-01T20:04:50.575 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.575 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef5f9c4a:::benchmark_data_smithi188_173515_object54735:head# 2024-04-01T20:04:50.575 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.575 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef5fa45c:::benchmark_data_smithi188_173515_object98455:head# 2024-04-01T20:04:50.575 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.575 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef603290:::benchmark_data_smithi188_173515_object76850:head# 2024-04-01T20:04:50.576 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.576 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef61b576:::benchmark_data_smithi188_173515_object143545:head# 2024-04-01T20:04:50.576 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.576 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef6282bd:::benchmark_data_smithi188_173515_object62447:head# 2024-04-01T20:04:50.576 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.576 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef628a07:::benchmark_data_smithi188_173515_object65465:head# 2024-04-01T20:04:50.576 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.576 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef638256:::benchmark_data_smithi188_173515_object116889:head# 2024-04-01T20:04:50.576 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.576 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef63b170:::benchmark_data_smithi188_173515_object86298:head# 2024-04-01T20:04:50.576 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.576 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef63d17c:::benchmark_data_smithi188_173515_object48739:head# 2024-04-01T20:04:50.576 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.576 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef65ccdb:::benchmark_data_smithi188_173515_object49372:head# 2024-04-01T20:04:50.576 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.577 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef665e14:::benchmark_data_smithi188_173515_object57867:head# 2024-04-01T20:04:50.577 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.577 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef66675b:::benchmark_data_smithi188_173515_object90085:head# 2024-04-01T20:04:50.577 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.577 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef66c290:::benchmark_data_smithi188_173515_object63813:head# 2024-04-01T20:04:50.577 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.577 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef66fe5c:::benchmark_data_smithi188_173515_object49016:head# 2024-04-01T20:04:50.577 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.577 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef67e0b5:::benchmark_data_smithi188_173515_object112785:head# 2024-04-01T20:04:50.577 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.577 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef685167:::benchmark_data_smithi188_173515_object116427:head# 2024-04-01T20:04:50.577 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.577 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef687e1a:::benchmark_data_smithi188_173515_object118685:head# 2024-04-01T20:04:50.577 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.577 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef68d743:::benchmark_data_smithi188_173515_object114671:head# 2024-04-01T20:04:50.578 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.578 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef69f118:::benchmark_data_smithi188_173515_object111037:head# 2024-04-01T20:04:50.578 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.578 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef6a46ae:::benchmark_data_smithi188_173515_object109175:head# 2024-04-01T20:04:50.578 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.578 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef6c2ae2:::benchmark_data_smithi188_173515_object56714:head# 2024-04-01T20:04:50.578 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.578 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef6c310e:::benchmark_data_smithi188_173515_object78236:head# 2024-04-01T20:04:50.578 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.578 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef6c33c4:::benchmark_data_smithi188_173515_object104634:head# 2024-04-01T20:04:50.578 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.578 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef6cb503:::benchmark_data_smithi188_173515_object62260:head# 2024-04-01T20:04:50.578 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.579 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef6cd873:::benchmark_data_smithi188_173515_object86393:head# 2024-04-01T20:04:50.579 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.579 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef6d8143:::benchmark_data_smithi188_173515_object61279:head# 2024-04-01T20:04:50.579 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.579 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef6de523:::benchmark_data_smithi188_173515_object142552:head# 2024-04-01T20:04:50.579 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.579 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef6e7ad5:::benchmark_data_smithi188_173515_object114392:head# 2024-04-01T20:04:50.579 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.579 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef6e9eb8:::benchmark_data_smithi188_173515_object62119:head# 2024-04-01T20:04:50.579 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.579 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef6eaa4b:::benchmark_data_smithi188_173515_object124294:head# 2024-04-01T20:04:50.579 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.579 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef70685e:::benchmark_data_smithi188_173515_object85810:head# 2024-04-01T20:04:50.579 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.579 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef713092:::benchmark_data_smithi188_173515_object74176:head# 2024-04-01T20:04:50.580 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.580 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef71e342:::benchmark_data_smithi188_173515_object83872:head# 2024-04-01T20:04:50.580 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.580 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef729f73:::benchmark_data_smithi188_173515_object49945:head# 2024-04-01T20:04:50.580 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.580 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef72a818:::benchmark_data_smithi188_173515_object131287:head# 2024-04-01T20:04:50.580 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.580 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef72e9c6:::benchmark_data_smithi188_173515_object86887:head# 2024-04-01T20:04:50.580 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.580 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef72ed24:::benchmark_data_smithi188_173515_object73958:head# 2024-04-01T20:04:50.580 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.580 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef733fd7:::benchmark_data_smithi188_173515_object52399:head# 2024-04-01T20:04:50.580 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.581 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef73ad28:::benchmark_data_smithi188_173515_object128635:head# 2024-04-01T20:04:50.581 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.581 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef73dd09:::benchmark_data_smithi188_173515_object94806:head# 2024-04-01T20:04:50.581 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.581 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef73eba5:::benchmark_data_smithi188_173515_object150147:head# 2024-04-01T20:04:50.581 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.581 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef742504:::benchmark_data_smithi188_173515_object118372:head# 2024-04-01T20:04:50.581 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.581 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef74a3ed:::benchmark_data_smithi188_173515_object89780:head# 2024-04-01T20:04:50.581 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.581 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef74c5d0:::benchmark_data_smithi188_173515_object151833:head# 2024-04-01T20:04:50.581 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.581 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef750326:::benchmark_data_smithi188_173515_object116141:head# 2024-04-01T20:04:50.582 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.582 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef756a08:::benchmark_data_smithi188_173515_object154934:head# 2024-04-01T20:04:50.582 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.582 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef759c68:::benchmark_data_smithi188_173515_object122165:head# 2024-04-01T20:04:50.582 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.582 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef75ae47:::benchmark_data_smithi188_173515_object77012:head# 2024-04-01T20:04:50.582 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.582 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef75e72a:::benchmark_data_smithi188_173515_object83614:head# 2024-04-01T20:04:50.582 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.582 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef76e490:::benchmark_data_smithi188_173515_object94705:head# 2024-04-01T20:04:50.582 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.582 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef7723ba:::benchmark_data_smithi188_173515_object78055:head# 2024-04-01T20:04:50.582 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.582 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef78381a:::benchmark_data_smithi188_173515_object92682:head# 2024-04-01T20:04:50.583 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.583 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef7839f7:::benchmark_data_smithi188_173515_object133629:head# 2024-04-01T20:04:50.583 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.583 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef788146:::benchmark_data_smithi188_173515_object79699:head# 2024-04-01T20:04:50.583 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.583 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef78dd5d:::benchmark_data_smithi188_173515_object49126:head# 2024-04-01T20:04:50.583 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.583 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef78e90c:::benchmark_data_smithi188_173515_object49833:head# 2024-04-01T20:04:50.583 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.583 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef798885:::benchmark_data_smithi188_173515_object121950:head# 2024-04-01T20:04:50.583 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.583 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef7a2960:::benchmark_data_smithi188_173515_object50172:head# 2024-04-01T20:04:50.583 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.583 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef7b31e3:::benchmark_data_smithi188_173515_object102711:head# 2024-04-01T20:04:50.583 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.583 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef7b7a6b:::benchmark_data_smithi188_173515_object138785:head# 2024-04-01T20:04:50.584 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.584 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef7ba964:::benchmark_data_smithi188_173515_object88660:head# 2024-04-01T20:04:50.584 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.584 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef7d9a1b:::benchmark_data_smithi188_173515_object134707:head# 2024-04-01T20:04:50.584 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.584 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef7dee98:::benchmark_data_smithi188_173515_object89985:head# 2024-04-01T20:04:50.584 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.584 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef7e090c:::benchmark_data_smithi188_173515_object66548:head# 2024-04-01T20:04:50.584 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.584 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef7f645a:::benchmark_data_smithi188_173515_object99733:head# 2024-04-01T20:04:50.584 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.584 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef7fee91:::benchmark_data_smithi188_173515_object99085:head# 2024-04-01T20:04:50.584 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.584 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef801a61:::benchmark_data_smithi188_173515_object105009:head# 2024-04-01T20:04:50.584 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.584 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef8213c7:::benchmark_data_smithi188_173515_object127799:head# 2024-04-01T20:04:50.585 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.585 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef825217:::benchmark_data_smithi188_173515_object88230:head# 2024-04-01T20:04:50.585 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.585 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef825e90:::benchmark_data_smithi188_173515_object121297:head# 2024-04-01T20:04:50.585 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.585 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef8263a6:::benchmark_data_smithi188_173515_object77800:head# 2024-04-01T20:04:50.585 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.585 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef82abf5:::benchmark_data_smithi188_173515_object154133:head# 2024-04-01T20:04:50.585 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.585 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef832356:::benchmark_data_smithi188_173515_object116003:head# 2024-04-01T20:04:50.585 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.585 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef845702:::benchmark_data_smithi188_173515_object146443:head# 2024-04-01T20:04:50.585 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.585 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef856d94:::benchmark_data_smithi188_173515_object101001:head# 2024-04-01T20:04:50.585 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.585 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef86283d:::benchmark_data_smithi188_173515_object149742:head# 2024-04-01T20:04:50.586 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.586 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef86acdf:::benchmark_data_smithi188_173515_object128165:head# 2024-04-01T20:04:50.586 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.586 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef8730e1:::benchmark_data_smithi188_173515_object132035:head# 2024-04-01T20:04:50.586 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.586 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef87f765:::benchmark_data_smithi188_173515_object98811:head# 2024-04-01T20:04:50.586 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.586 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef88c878:::benchmark_data_smithi188_173515_object152278:head# 2024-04-01T20:04:50.586 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.586 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef898b87:::benchmark_data_smithi188_173515_object107419:head# 2024-04-01T20:04:50.586 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.586 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef8a0149:::benchmark_data_smithi188_173515_object136660:head# 2024-04-01T20:04:50.586 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.586 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef8cf53c:::benchmark_data_smithi188_173515_object155095:head# 2024-04-01T20:04:50.587 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.587 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef8eff95:::benchmark_data_smithi188_173515_object57979:head# 2024-04-01T20:04:50.587 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.587 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef8ffec5:::benchmark_data_smithi188_173515_object150580:head# 2024-04-01T20:04:50.587 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.587 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef905a4a:::benchmark_data_smithi188_173515_object68762:head# 2024-04-01T20:04:50.587 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.587 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef9099f2:::benchmark_data_smithi188_173515_object114464:head# 2024-04-01T20:04:50.587 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.587 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef90b988:::benchmark_data_smithi188_173515_object74611:head# 2024-04-01T20:04:50.587 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.587 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef91b6ea:::benchmark_data_smithi188_173515_object141400:head# 2024-04-01T20:04:50.587 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.587 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef931e53:::benchmark_data_smithi188_173515_object149326:head# 2024-04-01T20:04:50.587 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.587 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef943460:::benchmark_data_smithi188_173515_object46254:head# 2024-04-01T20:04:50.588 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.588 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef9529ab:::benchmark_data_smithi188_173515_object149887:head# 2024-04-01T20:04:50.588 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.588 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef954d60:::benchmark_data_smithi188_173515_object121340:head# 2024-04-01T20:04:50.588 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.588 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef956c23:::benchmark_data_smithi188_173515_object83387:head# 2024-04-01T20:04:50.588 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.588 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef973150:::benchmark_data_smithi188_173515_object55037:head# 2024-04-01T20:04:50.588 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.588 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef977480:::benchmark_data_smithi188_173515_object81753:head# 2024-04-01T20:04:50.588 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.588 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef982b09:::benchmark_data_smithi188_173515_object98992:head# 2024-04-01T20:04:50.588 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.588 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef985fa2:::benchmark_data_smithi188_173515_object87664:head# 2024-04-01T20:04:50.588 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.588 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef986ae8:::benchmark_data_smithi188_173515_object51488:head# 2024-04-01T20:04:50.589 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.589 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef98bc9f:::benchmark_data_smithi188_173515_object154853:head# 2024-04-01T20:04:50.589 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.589 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef9a4163:::benchmark_data_smithi188_173515_object104137:head# 2024-04-01T20:04:50.589 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.589 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef9a9cf2:::benchmark_data_smithi188_173515_object137283:head# 2024-04-01T20:04:50.589 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.589 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef9ad821:::benchmark_data_smithi188_173515_object50787:head# 2024-04-01T20:04:50.589 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.589 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef9b0206:::benchmark_data_smithi188_173515_object91769:head# 2024-04-01T20:04:50.589 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.589 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef9d6732:::benchmark_data_smithi188_173515_object58825:head# 2024-04-01T20:04:50.589 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.589 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef9e642c:::benchmark_data_smithi188_173515_object105514:head# 2024-04-01T20:04:50.589 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.589 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef9ea15a:::benchmark_data_smithi188_173515_object84616:head# 2024-04-01T20:04:50.590 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.590 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef9eb8df:::benchmark_data_smithi188_173515_object117670:head# 2024-04-01T20:04:50.590 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.590 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef9f1539:::benchmark_data_smithi188_173515_object120430:head# 2024-04-01T20:04:50.590 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.590 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:ef9f500f:::benchmark_data_smithi188_173515_object123370:head# 2024-04-01T20:04:50.590 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.590 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efa06867:::benchmark_data_smithi188_173515_object66015:head# 2024-04-01T20:04:50.590 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.590 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efa0b834:::benchmark_data_smithi188_173515_object132092:head# 2024-04-01T20:04:50.590 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.590 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efa15d33:::benchmark_data_smithi188_173515_object47420:head# 2024-04-01T20:04:50.590 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.590 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efa1fd68:::benchmark_data_smithi188_173515_object71499:head# 2024-04-01T20:04:50.591 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.591 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efa25e99:::benchmark_data_smithi188_173515_object104570:head# 2024-04-01T20:04:50.591 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.591 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efa344d8:::benchmark_data_smithi188_173515_object96104:head# 2024-04-01T20:04:50.591 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.591 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efa3cc7f:::benchmark_data_smithi188_173515_object117487:head# 2024-04-01T20:04:50.591 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.591 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efa4bbbb:::benchmark_data_smithi188_173515_object48732:head# 2024-04-01T20:04:50.591 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.591 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efa56888:::benchmark_data_smithi188_173515_object70567:head# 2024-04-01T20:04:50.591 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.591 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efa5c8e3:::benchmark_data_smithi188_173515_object51384:head# 2024-04-01T20:04:50.591 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.591 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efa63ad8:::benchmark_data_smithi188_173515_object58714:head# 2024-04-01T20:04:50.591 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.592 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efa6b372:::benchmark_data_smithi188_173515_object110774:head# 2024-04-01T20:04:50.592 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.592 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efa73c1b:::benchmark_data_smithi188_173515_object110609:head# 2024-04-01T20:04:50.592 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.592 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efa8b5e2:::benchmark_data_smithi188_173515_object103825:head# 2024-04-01T20:04:50.592 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.592 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efa94d50:::benchmark_data_smithi188_173515_object77565:head# 2024-04-01T20:04:50.592 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.592 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efa955b8:::benchmark_data_smithi188_173515_object51794:head# 2024-04-01T20:04:50.592 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.592 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efa9b5f4:::benchmark_data_smithi188_173515_object89887:head# 2024-04-01T20:04:50.592 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.592 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efabc1e7:::benchmark_data_smithi188_173515_object48581:head# 2024-04-01T20:04:50.592 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.592 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efabed00:::benchmark_data_smithi188_173515_object78217:head# 2024-04-01T20:04:50.592 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.593 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efac703c:::benchmark_data_smithi188_173515_object90919:head# 2024-04-01T20:04:50.593 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.593 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efad19ec:::benchmark_data_smithi188_173515_object110602:head# 2024-04-01T20:04:50.593 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.593 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efadffdc:::benchmark_data_smithi188_173515_object143490:head# 2024-04-01T20:04:50.593 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.593 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efae4830:::benchmark_data_smithi188_173515_object82595:head# 2024-04-01T20:04:50.593 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.593 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efafb502:::benchmark_data_smithi188_173515_object83805:head# 2024-04-01T20:04:50.593 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.593 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efb04e43:::benchmark_data_smithi188_173515_object101457:head# 2024-04-01T20:04:50.593 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.593 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efb10d6f:::benchmark_data_smithi188_173515_object81989:head# 2024-04-01T20:04:50.593 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.593 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efb172b9:::benchmark_data_smithi188_173515_object144132:head# 2024-04-01T20:04:50.594 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.594 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efb2163b:::benchmark_data_smithi188_173515_object124747:head# 2024-04-01T20:04:50.594 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.594 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efb2d660:::benchmark_data_smithi188_173515_object73470:head# 2024-04-01T20:04:50.594 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.594 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efb35e27:::benchmark_data_smithi188_173515_object51173:head# 2024-04-01T20:04:50.594 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.594 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efb3e2a2:::benchmark_data_smithi188_173515_object106527:head# 2024-04-01T20:04:50.594 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.594 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efb40177:::benchmark_data_smithi188_173515_object100686:head# 2024-04-01T20:04:50.594 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.594 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efb50e05:::benchmark_data_smithi188_173515_object137353:head# 2024-04-01T20:04:50.594 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.594 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efb58f79:::benchmark_data_smithi188_173515_object123210:head# 2024-04-01T20:04:50.595 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.595 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efb6c7ef:::benchmark_data_smithi188_173515_object51160:head# 2024-04-01T20:04:50.595 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.595 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efb73f23:::benchmark_data_smithi188_173515_object71238:head# 2024-04-01T20:04:50.595 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.595 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efb7b3d9:::benchmark_data_smithi188_173515_object148574:head# 2024-04-01T20:04:50.595 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.595 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efb85170:::benchmark_data_smithi188_173515_object92474:head# 2024-04-01T20:04:50.595 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.595 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efb95fba:::benchmark_data_smithi188_173515_object61185:head# 2024-04-01T20:04:50.595 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.595 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efb9f3d2:::benchmark_data_smithi188_173515_object136932:head# 2024-04-01T20:04:50.595 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.595 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efba3513:::benchmark_data_smithi188_173515_object149730:head# 2024-04-01T20:04:50.595 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.596 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efbb8cc6:::benchmark_data_smithi188_173515_object101181:head# 2024-04-01T20:04:50.596 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.596 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efbc7f9b:::benchmark_data_smithi188_173515_object45620:head# 2024-04-01T20:04:50.596 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.596 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efbde00c:::benchmark_data_smithi188_173515_object109496:head# 2024-04-01T20:04:50.596 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.596 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efbde5a6:::benchmark_data_smithi188_173515_object129185:head# 2024-04-01T20:04:50.596 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.596 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efbe393f:::benchmark_data_smithi188_173515_object135466:head# 2024-04-01T20:04:50.596 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.596 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efbe3b76:::benchmark_data_smithi188_173515_object138565:head# 2024-04-01T20:04:50.596 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.596 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efbef079:::benchmark_data_smithi188_173515_object106568:head# 2024-04-01T20:04:50.596 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.597 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efbfb5cc:::benchmark_data_smithi188_173515_object109437:head# 2024-04-01T20:04:50.597 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.597 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efbfd1db:::benchmark_data_smithi188_173515_object93638:head# 2024-04-01T20:04:50.597 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.597 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efbfe051:::benchmark_data_smithi188_173515_object138470:head# 2024-04-01T20:04:50.597 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.597 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efc01681:::benchmark_data_smithi188_173515_object48214:head# 2024-04-01T20:04:50.597 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.597 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efc0a290:::benchmark_data_smithi188_173515_object119513:head# 2024-04-01T20:04:50.597 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.597 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efc0af9d:::benchmark_data_smithi188_173515_object61971:head# 2024-04-01T20:04:50.597 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.597 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efc0c805:::benchmark_data_smithi188_173515_object117040:head# 2024-04-01T20:04:50.597 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.597 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efc121fe:::benchmark_data_smithi188_173515_object111099:head# 2024-04-01T20:04:50.597 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.598 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efc12997:::benchmark_data_smithi188_173515_object63279:head# 2024-04-01T20:04:50.598 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.598 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efc2669f:::benchmark_data_smithi188_173515_object126342:head# 2024-04-01T20:04:50.598 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.598 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efc28694:::benchmark_data_smithi188_173515_object48126:head# 2024-04-01T20:04:50.598 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.598 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efc3b39c:::benchmark_data_smithi188_173515_object79901:head# 2024-04-01T20:04:50.598 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.598 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efc49d80:::benchmark_data_smithi188_173515_object98166:head# 2024-04-01T20:04:50.598 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.598 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efc5181b:::benchmark_data_smithi188_173515_object86985:head# 2024-04-01T20:04:50.598 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.598 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efc529ee:::benchmark_data_smithi188_173515_object121939:head# 2024-04-01T20:04:50.598 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.598 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efc6eba9:::benchmark_data_smithi188_173515_object118640:head# 2024-04-01T20:04:50.599 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.599 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efc7249b:::benchmark_data_smithi188_173515_object105859:head# 2024-04-01T20:04:50.599 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.599 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efc72bb0:::benchmark_data_smithi188_173515_object73458:head# 2024-04-01T20:04:50.599 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.599 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efc7c2ce:::benchmark_data_smithi188_173515_object124863:head# 2024-04-01T20:04:50.599 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.599 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efc7dfa4:::benchmark_data_smithi188_173515_object45542:head# 2024-04-01T20:04:50.599 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.599 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efc977e1:::benchmark_data_smithi188_173515_object150121:head# 2024-04-01T20:04:50.599 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.599 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efca28a1:::benchmark_data_smithi188_173515_object121985:head# 2024-04-01T20:04:50.599 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.599 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efca4110:::benchmark_data_smithi188_173515_object51097:head# 2024-04-01T20:04:50.599 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.599 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efca41b1:::benchmark_data_smithi188_173515_object73230:head# 2024-04-01T20:04:50.600 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.600 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efcad682:::benchmark_data_smithi188_173515_object85397:head# 2024-04-01T20:04:50.600 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.600 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efcb7404:::benchmark_data_smithi188_173515_object119668:head# 2024-04-01T20:04:50.600 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.600 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efcb9d5e:::benchmark_data_smithi188_173515_object60951:head# 2024-04-01T20:04:50.600 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.600 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efcba497:::benchmark_data_smithi188_173515_object89605:head# 2024-04-01T20:04:50.600 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.600 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efcbf2bb:::benchmark_data_smithi188_173515_object103204:head# 2024-04-01T20:04:50.600 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.600 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efcbf93a:::benchmark_data_smithi188_173515_object82355:head# 2024-04-01T20:04:50.600 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.600 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efcca2d2:::benchmark_data_smithi188_173515_object103190:head# 2024-04-01T20:04:50.600 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.600 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efccc40b:::benchmark_data_smithi188_173515_object121077:head# 2024-04-01T20:04:50.601 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.601 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efcd9659:::benchmark_data_smithi188_173515_object102835:head# 2024-04-01T20:04:50.601 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.601 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efcdfc43:::benchmark_data_smithi188_173515_object89175:head# 2024-04-01T20:04:50.601 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.601 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efce833a:::benchmark_data_smithi188_173515_object57860:head# 2024-04-01T20:04:50.601 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.601 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efce9c54:::benchmark_data_smithi188_173515_object110017:head# 2024-04-01T20:04:50.601 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.601 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efd0fd84:::benchmark_data_smithi188_173515_object80885:head# 2024-04-01T20:04:50.601 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.601 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efd28527:::benchmark_data_smithi188_173515_object120211:head# 2024-04-01T20:04:50.601 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.601 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efd2c889:::benchmark_data_smithi188_173515_object98342:head# 2024-04-01T20:04:50.601 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.602 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efd322bb:::benchmark_data_smithi188_173515_object125183:head# 2024-04-01T20:04:50.602 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.602 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efd35044:::benchmark_data_smithi188_173515_object57017:head# 2024-04-01T20:04:50.602 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.602 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efd48d23:::benchmark_data_smithi188_173515_object57273:head# 2024-04-01T20:04:50.602 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.602 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efd5007b:::benchmark_data_smithi188_173515_object59094:head# 2024-04-01T20:04:50.602 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.602 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efd503c9:::benchmark_data_smithi188_173515_object154890:head# 2024-04-01T20:04:50.602 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.602 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efd53af9:::benchmark_data_smithi188_173515_object68084:head# 2024-04-01T20:04:50.603 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.603 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efd5c90f:::benchmark_data_smithi188_173515_object80945:head# 2024-04-01T20:04:50.603 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.603 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efd5ebbc:::benchmark_data_smithi188_173515_object131125:head# 2024-04-01T20:04:50.603 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.603 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efd643bd:::benchmark_data_smithi188_173515_object65935:head# 2024-04-01T20:04:50.603 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.603 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efd7311d:::benchmark_data_smithi188_173515_object155909:head# 2024-04-01T20:04:50.603 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.603 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efd801f0:::benchmark_data_smithi188_173515_object99211:head# 2024-04-01T20:04:50.603 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.603 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efd8f1b6:::benchmark_data_smithi188_173515_object106746:head# 2024-04-01T20:04:50.603 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.603 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efd8fd36:::benchmark_data_smithi188_173515_object64289:head# 2024-04-01T20:04:50.603 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.604 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efd90ea0:::benchmark_data_smithi188_173515_object144411:head# 2024-04-01T20:04:50.604 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.604 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efda1c14:::benchmark_data_smithi188_173515_object78199:head# 2024-04-01T20:04:50.604 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.604 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efdac0e8:::benchmark_data_smithi188_173515_object68585:head# 2024-04-01T20:04:50.604 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.604 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efdb0bce:::benchmark_data_smithi188_173515_object146145:head# 2024-04-01T20:04:50.604 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.604 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efdb2d85:::benchmark_data_smithi188_173515_object130139:head# 2024-04-01T20:04:50.604 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.604 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efdb4c24:::benchmark_data_smithi188_173515_object118112:head# 2024-04-01T20:04:50.604 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.604 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efdbf5ab:::benchmark_data_smithi188_173515_object114533:head# 2024-04-01T20:04:50.604 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.604 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efdc20f0:::benchmark_data_smithi188_173515_object80586:head# 2024-04-01T20:04:50.604 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.605 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efdd0cb3:::benchmark_data_smithi188_173515_object67847:head# 2024-04-01T20:04:50.605 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.605 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efdd94f9:::benchmark_data_smithi188_173515_object80610:head# 2024-04-01T20:04:50.605 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.605 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efdd999b:::benchmark_data_smithi188_173515_object148504:head# 2024-04-01T20:04:50.605 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.605 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efdfacde:::benchmark_data_smithi188_173515_object140924:head# 2024-04-01T20:04:50.605 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.605 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efe075cd:::benchmark_data_smithi188_173515_object138471:head# 2024-04-01T20:04:50.605 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.605 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efe0e9f0:::benchmark_data_smithi188_173515_object94479:head# 2024-04-01T20:04:50.605 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.605 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efe10514:::benchmark_data_smithi188_173515_object72821:head# 2024-04-01T20:04:50.605 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.605 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efe10a82:::benchmark_data_smithi188_173515_object139738:head# 2024-04-01T20:04:50.606 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.606 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efe13b1b:::benchmark_data_smithi188_173515_object103694:head# 2024-04-01T20:04:50.606 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.606 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efe141d8:::benchmark_data_smithi188_173515_object137525:head# 2024-04-01T20:04:50.606 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.606 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efe51408:::benchmark_data_smithi188_173515_object80294:head# 2024-04-01T20:04:50.606 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.606 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efe6418b:::benchmark_data_smithi188_173515_object153982:head# 2024-04-01T20:04:50.606 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.606 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efe7e306:::benchmark_data_smithi188_173515_object54383:head# 2024-04-01T20:04:50.606 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.606 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efe88f72:::benchmark_data_smithi188_173515_object116171:head# 2024-04-01T20:04:50.606 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.606 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efe9d9f4:::benchmark_data_smithi188_173515_object108119:head# 2024-04-01T20:04:50.606 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.607 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efea36ce:::benchmark_data_smithi188_173515_object103878:head# 2024-04-01T20:04:50.607 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.607 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efeaa8f6:::benchmark_data_smithi188_173515_object48878:head# 2024-04-01T20:04:50.607 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.607 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efebe864:::benchmark_data_smithi188_173515_object152126:head# 2024-04-01T20:04:50.607 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.607 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efec12b1:::benchmark_data_smithi188_173515_object140451:head# 2024-04-01T20:04:50.607 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.607 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efec4c70:::benchmark_data_smithi188_173515_object98243:head# 2024-04-01T20:04:50.607 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.607 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efed083b:::benchmark_data_smithi188_173515_object146182:head# 2024-04-01T20:04:50.607 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.607 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efede302:::benchmark_data_smithi188_173515_object107925:head# 2024-04-01T20:04:50.607 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.607 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efee048b:::benchmark_data_smithi188_173515_object86033:head# 2024-04-01T20:04:50.607 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.608 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efee1b80:::benchmark_data_smithi188_173515_object54884:head# 2024-04-01T20:04:50.608 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.608 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efeef9d1:::benchmark_data_smithi188_173515_object62233:head# 2024-04-01T20:04:50.608 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.608 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efef8a2e:::benchmark_data_smithi188_173515_object90119:head# 2024-04-01T20:04:50.608 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.608 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efefc5ba:::benchmark_data_smithi188_173515_object99477:head# 2024-04-01T20:04:50.608 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.608 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eff12ae7:::benchmark_data_smithi188_173515_object152077:head# 2024-04-01T20:04:50.608 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.608 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eff16ace:::benchmark_data_smithi188_173515_object148522:head# 2024-04-01T20:04:50.608 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.608 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eff2a7e1:::benchmark_data_smithi188_173515_object77185:head# 2024-04-01T20:04:50.608 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.608 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eff366c9:::benchmark_data_smithi188_173515_object59576:head# 2024-04-01T20:04:50.609 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.609 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eff4502a:::benchmark_data_smithi188_173515_object101825:head# 2024-04-01T20:04:50.609 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.609 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eff4e74e:::benchmark_data_smithi188_173515_object83122:head# 2024-04-01T20:04:50.609 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.609 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eff51961:::benchmark_data_smithi188_173515_object122570:head# 2024-04-01T20:04:50.609 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.609 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eff5921a:::benchmark_data_smithi188_173515_object144446:head# 2024-04-01T20:04:50.609 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.609 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eff5ad46:::benchmark_data_smithi188_173515_object62024:head# 2024-04-01T20:04:50.609 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.609 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eff651fd:::benchmark_data_smithi188_173515_object117330:head# 2024-04-01T20:04:50.609 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.609 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eff6e8ad:::benchmark_data_smithi188_173515_object46106:head# 2024-04-01T20:04:50.609 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.610 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eff8ba90:::benchmark_data_smithi188_173515_object149457:head# 2024-04-01T20:04:50.610 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.610 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eff9292c:::benchmark_data_smithi188_173515_object88736:head# 2024-04-01T20:04:50.610 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.610 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:eff935ca:::benchmark_data_smithi188_173515_object80123:head# 2024-04-01T20:04:50.610 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.610 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:effa37d5:::benchmark_data_smithi188_173515_object153635:head# 2024-04-01T20:04:50.610 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.610 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:effa5ac6:::benchmark_data_smithi188_173515_object103015:head# 2024-04-01T20:04:50.610 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.610 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:effa6012:::benchmark_data_smithi188_173515_object107983:head# 2024-04-01T20:04:50.610 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.610 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:effa79e8:::benchmark_data_smithi188_173515_object70175:head# 2024-04-01T20:04:50.611 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.611 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:effb07d2:::benchmark_data_smithi188_173515_object52743:head# 2024-04-01T20:04:50.611 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.611 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:effbbd7e:::benchmark_data_smithi188_173515_object74738:head# 2024-04-01T20:04:50.611 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.611 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:effc0a07:::benchmark_data_smithi188_173515_object152395:head# 2024-04-01T20:04:50.611 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.611 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:effcc926:::benchmark_data_smithi188_173515_object88203:head# 2024-04-01T20:04:50.611 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.611 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:effe3783:::benchmark_data_smithi188_173515_object122861:head# 2024-04-01T20:04:50.611 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.611 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:effe5dc0:::benchmark_data_smithi188_173515_object111409:head# 2024-04-01T20:04:50.611 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.611 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:effe836f:::benchmark_data_smithi188_173515_object91089:head# 2024-04-01T20:04:50.612 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.612 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efff30cc:::benchmark_data_smithi188_173515_object53114:head# 2024-04-01T20:04:50.612 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.612 INFO:teuthology.orchestra.run.smithi022.stdout:Write #9:efff5d52:::benchmark_data_smithi188_173515_object137935:head# 2024-04-01T20:04:50.612 INFO:teuthology.orchestra.run.smithi022.stdout:snapset 0=[]:{} 2024-04-01T20:04:50.612 INFO:teuthology.orchestra.run.smithi022.stdout:write_pg epoch 796 info 9.7( v 794'12516 (744'2500,794'12516] lb MIN local-lis/les=777/778 n=6948 ec=735/735 lis/c=777/777 les/c/f=778/794/0 sis=795 pruub=10.058040619s) 2024-04-01T20:04:50.612 INFO:teuthology.orchestra.run.smithi022.stdout:Import successful 2024-04-01T20:04:50.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:50 smithi062 ceph-mon[44211]: pgmap v2283: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:50.814 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:50 smithi188 ceph-mon[43939]: pgmap v2283: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:50.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:50 smithi022 ceph-mon[39439]: pgmap v2283: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:51.158 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.9 dump_historic_ops 2024-04-01T20:04:51.422 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T20:04:51.772 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/exp.9.7.3 2024-04-01T20:04:51.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:51 smithi022 ceph-mon[39439]: pgmap v2284: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:51.887 INFO:tasks.thrashosds.thrasher:Waiting for clean again 2024-04-01T20:04:51.887 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-01T20:04:51.888 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T20:04:51.901 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:51 smithi188 ceph-mon[43939]: pgmap v2284: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:52.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:51 smithi062 ceph-mon[44211]: pgmap v2284: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:52.161 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:04:53.102 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T20:04:53.102 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:04:53.817 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:53 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:04:53.817 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:53 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:04:53.817 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:53 smithi188 ceph-mon[43939]: osdmap e845: 12 total, 11 up, 9 in 2024-04-01T20:04:53.817 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:53 smithi188 ceph-mon[43939]: pgmap v2286: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:53.841 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_ops_in_flight 2024-04-01T20:04:54.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:53 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:04:54.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:53 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:04:54.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:53 smithi062 ceph-mon[44211]: osdmap e845: 12 total, 11 up, 9 in 2024-04-01T20:04:54.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:53 smithi062 ceph-mon[44211]: pgmap v2286: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:54.104 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T20:04:54.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:53 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:04:54.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:53 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:04:54.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:53 smithi022 ceph-mon[39439]: osdmap e845: 12 total, 11 up, 9 in 2024-04-01T20:04:54.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:53 smithi022 ceph-mon[39439]: pgmap v2286: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:54.146 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T20:04:54.147 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T20:04:54.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:54 smithi022 ceph-mon[39439]: from='client.17841 v1:172.21.15.22:0/3402903377' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T20:04:54.941 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:54 smithi188 ceph-mon[43939]: from='client.17841 v1:172.21.15.22:0/3402903377' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T20:04:55.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:54 smithi062 ceph-mon[44211]: from='client.17841 v1:172.21.15.22:0/3402903377' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T20:04:55.043 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":2286,"stamp":"2024-04-01T20:04:53.486798+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2644640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":9,"num_per_pool_osds":9,"num_per_pool_omap_osds":3,"kb":843706368,"kb_used":6120024,"kb_used_data":151152,"kb_used_omap":967,"kb_used_meta":5967800,"kb_avail":837586344,"statfs":{"total":863955320832,"available":857688416256,"internally_reserved":0,"allocated":154779648,"data_stored":151295304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":990537,"internal_metadata":6111027895},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.983488"},"pg_stats":[{"pgid":"1.0","version":"156'139","reported_seq":2061,"reported_epoch":844,"state":"active+clean","last_fresh":"2024-04-01T20:04:43.503567+0000","last_change":"2024-04-01T20:04:14.936144+0000","last_active":"2024-04-01T20:04:43.503567+0000","last_peered":"2024-04-01T20:04:43.503567+0000","last_clean":"2024-04-01T20:04:43.503567+0000","last_became_active":"2024-04-01T20:01:45.155357+0000","last_became_peered":"2024-04-01T20:01:45.155357+0000","last_unstale":"2024-04-01T20:04:43.503567+0000","last_undegraded":"2024-04-01T20:04:43.503567+0000","last_fullsized":"2024-04-01T20:04:43.503567+0000","mapping_epoch":781,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":782,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T20:04:14.936001+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T20:04:14.936001+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:05:34.708670+0000","scrub_duration":159,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2644640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2644640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":0,"seq":365072220667,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":0,"seq":3272765079601,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678535,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":870444,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":869694,"kb_avail":92874708,"statfs":{"total":95995035648,"available":95103700992,"internally_reserved":0,"allocated":753664,"data_stored":367304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":890567104},"hb_peers":[0,1,2,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557731,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":399340,"kb_used_data":736,"kb_used_omap":132,"kb_used_meta":398459,"kb_avail":93345812,"statfs":{"total":95995035648,"available":95586111488,"internally_reserved":0,"allocated":753664,"data_stored":367304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":408022759},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234512,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":740468,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":739198,"kb_avail":93004684,"statfs":{"total":95995035648,"available":95236796416,"internally_reserved":0,"allocated":1286144,"data_stored":896232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":756939210},"hb_peers":[0,1,2,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":457,"seq":1962800054524,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":402676,"kb_used_data":1256,"kb_used_omap":744,"kb_used_meta":400663,"kb_avail":93342476,"statfs":{"total":95995035648,"available":95582695424,"internally_reserved":0,"allocated":1286144,"data_stored":896232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":762131,"internal_metadata":410279661},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":571,"seq":2452426326192,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":377516,"kb_used_data":736,"kb_used_omap":81,"kb_used_meta":376686,"kb_avail":93367636,"statfs":{"total":95995035648,"available":95608459264,"internally_reserved":0,"allocated":753664,"data_stored":367304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":83387,"internal_metadata":385727045},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":749676,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":748926,"kb_avail":92995476,"statfs":{"total":95995035648,"available":95227367424,"internally_reserved":0,"allocated":753664,"data_stored":367304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":766900677},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":627500,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":626750,"kb_avail":93117652,"statfs":{"total":95995035648,"available":95352475648,"internally_reserved":0,"allocated":753664,"data_stored":367304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":641792453},"hb_peers":[0,1,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":0,"seq":111669150235,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438954014,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":776044,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":775294,"kb_avail":92969108,"statfs":{"total":95995035648,"available":95200366592,"internally_reserved":0,"allocated":753664,"data_stored":367304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":793901509},"hb_peers":[0,1,2,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790490,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1176360,"kb_used_data":144224,"kb_used_omap":1,"kb_used_meta":1032126,"kb_avail":92568792,"statfs":{"total":95995035648,"available":94790443008,"internally_reserved":0,"allocated":147685376,"data_stored":147299016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1056897477},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T20:04:55.043 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T20:04:55.323 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:04:55.781 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T20:04:55.781 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:04:55.802 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:55 smithi188 ceph-mon[43939]: pgmap v2287: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:55.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:55 smithi022 ceph-mon[39439]: pgmap v2287: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:56.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:55 smithi062 ceph-mon[44211]: pgmap v2287: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:56.475 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_blocked_ops 2024-04-01T20:04:56.739 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T20:04:57.310 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T20:04:57.312 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T20:04:57.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:57 smithi022 ceph-mon[39439]: from='client.17844 v1:172.21.15.22:0/3587298164' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T20:04:57.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:57 smithi022 ceph-mon[39439]: pgmap v2288: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:57.869 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:57 smithi188 ceph-mon[43939]: from='client.17844 v1:172.21.15.22:0/3587298164' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T20:04:57.869 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:57 smithi188 ceph-mon[43939]: pgmap v2288: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:58.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:57 smithi062 ceph-mon[44211]: from='client.17844 v1:172.21.15.22:0/3587298164' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T20:04:58.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:57 smithi062 ceph-mon[44211]: pgmap v2288: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:58.025 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":2287,"stamp":"2024-04-01T20:04:55.487195+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2644640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":9,"num_per_pool_osds":9,"num_per_pool_omap_osds":3,"kb":843706368,"kb_used":6120048,"kb_used_data":151176,"kb_used_omap":967,"kb_used_meta":5967800,"kb_avail":837586320,"statfs":{"total":863955320832,"available":857688391680,"internally_reserved":0,"allocated":154804224,"data_stored":151307142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":990537,"internal_metadata":6111027895},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002268"},"pg_stats":[{"pgid":"1.0","version":"156'139","reported_seq":2063,"reported_epoch":845,"state":"active+clean","last_fresh":"2024-04-01T20:04:52.637829+0000","last_change":"2024-04-01T20:04:14.936144+0000","last_active":"2024-04-01T20:04:52.637829+0000","last_peered":"2024-04-01T20:04:52.637829+0000","last_clean":"2024-04-01T20:04:52.637829+0000","last_became_active":"2024-04-01T20:01:45.155357+0000","last_became_peered":"2024-04-01T20:01:45.155357+0000","last_unstale":"2024-04-01T20:04:52.637829+0000","last_undegraded":"2024-04-01T20:04:52.637829+0000","last_fullsized":"2024-04-01T20:04:52.637829+0000","mapping_epoch":781,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":782,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T20:04:14.936001+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T20:04:14.936001+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:05:34.708670+0000","scrub_duration":159,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2644640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2644640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":0,"seq":365072220667,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":0,"seq":3272765079602,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678535,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":870444,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":869694,"kb_avail":92874708,"statfs":{"total":95995035648,"available":95103700992,"internally_reserved":0,"allocated":753664,"data_stored":367304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":890567104},"hb_peers":[0,1,2,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557732,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":399352,"kb_used_data":748,"kb_used_omap":132,"kb_used_meta":398459,"kb_avail":93345800,"statfs":{"total":95995035648,"available":95586099200,"internally_reserved":0,"allocated":765952,"data_stored":373223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":408022759},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234513,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":740480,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":739198,"kb_avail":93004672,"statfs":{"total":95995035648,"available":95236784128,"internally_reserved":0,"allocated":1298432,"data_stored":902151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":756939210},"hb_peers":[0,1,2,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":457,"seq":1962800054524,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":402676,"kb_used_data":1256,"kb_used_omap":744,"kb_used_meta":400663,"kb_avail":93342476,"statfs":{"total":95995035648,"available":95582695424,"internally_reserved":0,"allocated":1286144,"data_stored":896232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":762131,"internal_metadata":410279661},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":571,"seq":2452426326192,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":377516,"kb_used_data":736,"kb_used_omap":81,"kb_used_meta":376686,"kb_avail":93367636,"statfs":{"total":95995035648,"available":95608459264,"internally_reserved":0,"allocated":753664,"data_stored":367304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":83387,"internal_metadata":385727045},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":749676,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":748926,"kb_avail":92995476,"statfs":{"total":95995035648,"available":95227367424,"internally_reserved":0,"allocated":753664,"data_stored":367304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":766900677},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":627500,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":626750,"kb_avail":93117652,"statfs":{"total":95995035648,"available":95352475648,"internally_reserved":0,"allocated":753664,"data_stored":367304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":641792453},"hb_peers":[0,1,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":0,"seq":111669150235,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438954014,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":776044,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":775294,"kb_avail":92969108,"statfs":{"total":95995035648,"available":95200366592,"internally_reserved":0,"allocated":753664,"data_stored":367304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":793901509},"hb_peers":[0,1,2,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790490,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1176360,"kb_used_data":144224,"kb_used_omap":1,"kb_used_meta":1032126,"kb_avail":92568792,"statfs":{"total":95995035648,"available":94790443008,"internally_reserved":0,"allocated":147685376,"data_stored":147299016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1056897477},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T20:04:58.026 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-01T20:04:58.026 INFO:tasks.thrashosds.thrasher:Waiting for trim 2024-04-01T20:04:58.438 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T20:04:58.438 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:04:58.986 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.11 dump_historic_ops 2024-04-01T20:04:59.249 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T20:04:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:04:59 smithi022 ceph-mon[39439]: pgmap v2289: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:04:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:04:59 smithi188 ceph-mon[43939]: pgmap v2289: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:00.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:04:59 smithi062 ceph-mon[44211]: pgmap v2289: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:00.921 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T20:05:00.921 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:05:01.609 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_ops_in_flight 2024-04-01T20:05:01.870 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T20:05:01.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:01 smithi188 ceph-mon[43939]: pgmap v2290: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:02.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:01 smithi062 ceph-mon[44211]: pgmap v2290: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:02.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:01 smithi022 ceph-mon[39439]: pgmap v2290: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:03.539 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T20:05:03.539 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:05:03.862 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:03 smithi188 ceph-mon[43939]: pgmap v2291: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:03.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:03 smithi022 ceph-mon[39439]: pgmap v2291: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:04.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:03 smithi062 ceph-mon[44211]: pgmap v2291: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:04.201 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_blocked_ops 2024-04-01T20:05:04.469 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T20:05:05.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:05 smithi188 ceph-mon[43939]: pgmap v2292: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:05.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:05 smithi022 ceph-mon[39439]: pgmap v2292: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:06.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:05 smithi062 ceph-mon[44211]: pgmap v2292: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:06.480 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T20:05:06.480 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:05:07.160 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.8 dump_historic_ops 2024-04-01T20:05:07.426 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T20:05:07.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:07 smithi022 ceph-mon[39439]: pgmap v2293: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:07.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:07 smithi188 ceph-mon[43939]: pgmap v2293: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:08.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:07 smithi062 ceph-mon[44211]: pgmap v2293: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:09.157 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T20:05:09.157 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:05:09.812 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:09 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:05:09.812 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:09 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:05:09.812 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:09 smithi188 ceph-mon[43939]: osdmap e846: 12 total, 11 up, 9 in 2024-04-01T20:05:09.812 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:09 smithi188 ceph-mon[43939]: pgmap v2295: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:09.839 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_ops_in_flight 2024-04-01T20:05:10.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:09 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:05:10.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:09 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:05:10.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:09 smithi062 ceph-mon[44211]: osdmap e846: 12 total, 11 up, 9 in 2024-04-01T20:05:10.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:09 smithi062 ceph-mon[44211]: pgmap v2295: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:10.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:09 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:05:10.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:09 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:05:10.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:09 smithi022 ceph-mon[39439]: osdmap e846: 12 total, 11 up, 9 in 2024-04-01T20:05:10.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:09 smithi022 ceph-mon[39439]: pgmap v2295: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:10.132 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T20:05:11.978 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:11 smithi062 ceph-mon[44211]: pgmap v2296: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:12.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:11 smithi022 ceph-mon[39439]: pgmap v2296: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:12.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:11 smithi188 ceph-mon[43939]: pgmap v2296: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:12.282 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T20:05:12.282 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:05:12.937 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_blocked_ops 2024-04-01T20:05:13.215 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T20:05:13.716 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:13 smithi062 ceph-mon[44211]: pgmap v2297: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:13.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:13 smithi022 ceph-mon[39439]: pgmap v2297: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:13.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:13 smithi188 ceph-mon[43939]: pgmap v2297: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:14.849 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:14 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:05:14.849 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:14 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:05:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:14 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:05:14.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:14 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:05:14.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:14 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:05:14.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:14 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:05:15.146 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T20:05:15.146 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:05:15.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:15 smithi062 ceph-mon[44211]: osdmap e847: 12 total, 11 up, 9 in 2024-04-01T20:05:15.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:15 smithi062 ceph-mon[44211]: pgmap v2299: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:15.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:15 smithi022 ceph-mon[39439]: osdmap e847: 12 total, 11 up, 9 in 2024-04-01T20:05:15.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:15 smithi022 ceph-mon[39439]: pgmap v2299: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:15 smithi188 ceph-mon[43939]: osdmap e847: 12 total, 11 up, 9 in 2024-04-01T20:05:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:15 smithi188 ceph-mon[43939]: pgmap v2299: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:15.886 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.6 dump_historic_ops 2024-04-01T20:05:16.163 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T20:05:17.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:17 smithi022 ceph-mon[39439]: pgmap v2300: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:17.863 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:17 smithi062 ceph-mon[44211]: pgmap v2300: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:17.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:17 smithi188 ceph-mon[43939]: pgmap v2300: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:18.177 INFO:teuthology.orchestra.run.smithi062.stdout:ERROR: (22) Invalid argument 2024-04-01T20:05:18.177 INFO:teuthology.orchestra.run.smithi062.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:05:18.866 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_ops_in_flight 2024-04-01T20:05:19.161 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:05:19.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:19 smithi022 ceph-mon[39439]: pgmap v2301: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:19.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:19 smithi188 ceph-mon[43939]: pgmap v2301: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:20.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:19 smithi062 ceph-mon[44211]: pgmap v2301: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:21.062 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T20:05:21.062 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:05:21.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:21 smithi022 ceph-mon[39439]: pgmap v2302: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:21.700 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_blocked_ops 2024-04-01T20:05:21.977 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:05:22.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:21 smithi062 ceph-mon[44211]: pgmap v2302: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:22.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:21 smithi188 ceph-mon[43939]: pgmap v2302: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:22.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:22 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:05:22.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:22 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:05:22.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:22 smithi022 ceph-mon[39439]: osdmap e848: 12 total, 11 up, 9 in 2024-04-01T20:05:23.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:22 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:05:23.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:22 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:05:23.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:22 smithi062 ceph-mon[44211]: osdmap e848: 12 total, 11 up, 9 in 2024-04-01T20:05:23.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:22 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:05:23.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:22 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:05:23.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:22 smithi188 ceph-mon[43939]: osdmap e848: 12 total, 11 up, 9 in 2024-04-01T20:05:23.913 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T20:05:23.913 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:05:23.932 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:23 smithi022 ceph-mon[39439]: pgmap v2304: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:24.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:23 smithi062 ceph-mon[44211]: pgmap v2304: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:24.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:23 smithi188 ceph-mon[43939]: pgmap v2304: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:24.626 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.1 dump_historic_ops 2024-04-01T20:05:24.905 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:05:25.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:25 smithi022 ceph-mon[39439]: pgmap v2305: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:25.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:25 smithi188 ceph-mon[43939]: pgmap v2305: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:26.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:25 smithi062 ceph-mon[44211]: pgmap v2305: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:26.631 INFO:teuthology.orchestra.run.smithi022.stdout:ERROR: (22) Invalid argument 2024-04-01T20:05:26.632 INFO:teuthology.orchestra.run.smithi022.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:05:27.345 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_ops_in_flight 2024-04-01T20:05:27.623 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T20:05:27.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:27 smithi022 ceph-mon[39439]: pgmap v2306: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:27.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:27 smithi188 ceph-mon[43939]: pgmap v2306: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:28.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:27 smithi062 ceph-mon[44211]: pgmap v2306: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:29.435 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T20:05:29.435 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:05:29.791 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:29 smithi188 ceph-mon[43939]: pgmap v2307: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:29.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:29 smithi022 ceph-mon[39439]: pgmap v2307: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:29 smithi062 ceph-mon[44211]: pgmap v2307: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:30.142 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_blocked_ops 2024-04-01T20:05:30.404 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T20:05:32.103 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T20:05:32.103 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:05:32.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:31 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:05:32.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:31 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:05:32.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:31 smithi022 ceph-mon[39439]: osdmap e849: 12 total, 11 up, 9 in 2024-04-01T20:05:32.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:31 smithi022 ceph-mon[39439]: pgmap v2309: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:32.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:31 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:05:32.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:31 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:05:32.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:31 smithi188 ceph-mon[43939]: osdmap e849: 12 total, 11 up, 9 in 2024-04-01T20:05:32.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:31 smithi188 ceph-mon[43939]: pgmap v2309: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:32.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:31 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:05:32.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:31 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:05:32.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:31 smithi062 ceph-mon[44211]: osdmap e849: 12 total, 11 up, 9 in 2024-04-01T20:05:32.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:31 smithi062 ceph-mon[44211]: pgmap v2309: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:32.804 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.10 dump_historic_ops 2024-04-01T20:05:33.068 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T20:05:34.259 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:33 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:05:34.259 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:33 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:05:34.259 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:33 smithi188 ceph-mon[43939]: osdmap e850: 12 total, 11 up, 9 in 2024-04-01T20:05:34.259 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:33 smithi188 ceph-mon[43939]: pgmap v2311: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:34.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:33 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:05:34.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:33 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:05:34.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:33 smithi062 ceph-mon[44211]: osdmap e850: 12 total, 11 up, 9 in 2024-04-01T20:05:34.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:33 smithi062 ceph-mon[44211]: pgmap v2311: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:34.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:33 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:05:34.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:33 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:05:34.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:33 smithi022 ceph-mon[39439]: osdmap e850: 12 total, 11 up, 9 in 2024-04-01T20:05:34.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:33 smithi022 ceph-mon[39439]: pgmap v2311: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:34.809 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-01T20:05:34.809 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-01T20:05:36.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:35 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:05:36.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:35 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:05:36.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:35 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T20:05:36.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:35 smithi062 ceph-mon[44211]: osdmap e851: 12 total, 11 up, 9 in 2024-04-01T20:05:36.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:35 smithi062 ceph-mon[44211]: pgmap v2313: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:36.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:35 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:05:36.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:35 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:05:36.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:35 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T20:05:36.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:35 smithi022 ceph-mon[39439]: osdmap e851: 12 total, 11 up, 9 in 2024-04-01T20:05:36.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:35 smithi022 ceph-mon[39439]: pgmap v2313: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:36.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:35 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:05:36.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:35 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:05:36.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:35 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T20:05:36.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:35 smithi188 ceph-mon[43939]: osdmap e851: 12 total, 11 up, 9 in 2024-04-01T20:05:36.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:35 smithi188 ceph-mon[43939]: pgmap v2313: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:37.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:36 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T20:05:37.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:36 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T20:05:37.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:36 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T20:05:38.027 INFO:tasks.thrashosds.thrasher:Reviving osd 3 2024-04-01T20:05:38.027 INFO:tasks.cephadm.osd.3:Restarting osd.3 (starting--it wasn't running)... 2024-04-01T20:05:38.028 DEBUG:teuthology.orchestra.run.smithi022:osd.3> sudo journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.3.service 2024-04-01T20:05:38.031 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl start ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.3 2024-04-01T20:05:38.068 INFO:journalctl@ceph.osd.3.smithi022.stdout:-- Logs begin at Mon 2024-04-01 19:04:04 UTC. -- 2024-04-01T20:05:38.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:37 smithi062 ceph-mon[44211]: pgmap v2314: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:38.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:37 smithi022 ceph-mon[39439]: pgmap v2314: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:38.363 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:05:38 smithi022 systemd[1]: Starting Ceph osd.3 for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T20:05:38.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:37 smithi188 ceph-mon[43939]: pgmap v2314: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:39.613 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:05:39 smithi022 bash[331486]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-01T20:05:39.614 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:05:39 smithi022 bash[331486]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-04-01T20:05:39.614 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:05:39 smithi022 bash[331486]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-04-01T20:05:39.614 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:05:39 smithi022 bash[331486]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-04-01T20:05:39.614 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:05:39 smithi022 bash[331486]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-3/block 2024-04-01T20:05:39.614 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:05:39 smithi022 bash[331486]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-01T20:05:39.614 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:05:39 smithi022 bash[331486]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-01T20:05:40.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:40 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:05:40.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:40 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:05:40.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:40 smithi022 ceph-mon[39439]: osdmap e852: 12 total, 11 up, 9 in 2024-04-01T20:05:40.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:40 smithi022 ceph-mon[39439]: pgmap v2316: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:40.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:40 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:05:40.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:40 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:05:40.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:40 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:05:40.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:40 smithi188 ceph-mon[43939]: osdmap e852: 12 total, 11 up, 9 in 2024-04-01T20:05:40.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:40 smithi188 ceph-mon[43939]: pgmap v2316: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:40.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:40 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:05:40.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:40 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:05:40.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:40 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:05:40.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:40 smithi062 ceph-mon[44211]: osdmap e852: 12 total, 11 up, 9 in 2024-04-01T20:05:40.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:40 smithi062 ceph-mon[44211]: pgmap v2316: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:40.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:40 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:05:40.840 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_ops_in_flight 2024-04-01T20:05:41.112 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:05:40 smithi022 bash[331828]: 45219413153d64e797e09bbd17a4b6ffbe3f4c547e13a9a5029cf5aa4ce9f414 2024-04-01T20:05:41.112 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:05:40 smithi022 systemd[1]: Started Ceph osd.3 for 09f6b846-f05c-11ee-b647-cb9ed24678a4. 2024-04-01T20:05:41.117 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:05:41.613 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:05:41 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-3[331894]: 2024-04-01T20:05:41.284+0000 7f76d0e467c0 -1 Falling back to public interface 2024-04-01T20:05:41.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:41 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:05:41.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:41 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:05:41.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:41 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:05:41.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:41 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:05:41.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:41 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:05:41.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:41 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:05:41.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:41 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:05:41.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:41 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:05:41.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:41 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:05:42.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:42 smithi022 ceph-mon[39439]: pgmap v2317: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:42.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:42 smithi188 ceph-mon[43939]: pgmap v2317: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:42.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:42 smithi062 ceph-mon[44211]: pgmap v2317: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:42.962 INFO:teuthology.orchestra.run.smithi022.stderr:no valid command found; 10 closest matches: 2024-04-01T20:05:42.962 INFO:teuthology.orchestra.run.smithi022.stderr:0 2024-04-01T20:05:42.962 INFO:teuthology.orchestra.run.smithi022.stderr:1 2024-04-01T20:05:42.962 INFO:teuthology.orchestra.run.smithi022.stderr:2 2024-04-01T20:05:42.962 INFO:teuthology.orchestra.run.smithi022.stderr:abort 2024-04-01T20:05:42.962 INFO:teuthology.orchestra.run.smithi022.stderr:assert 2024-04-01T20:05:42.962 INFO:teuthology.orchestra.run.smithi022.stderr:config diff 2024-04-01T20:05:42.962 INFO:teuthology.orchestra.run.smithi022.stderr:config diff get 2024-04-01T20:05:42.962 INFO:teuthology.orchestra.run.smithi022.stderr:config get 2024-04-01T20:05:42.963 INFO:teuthology.orchestra.run.smithi022.stderr:config help [] 2024-04-01T20:05:42.963 INFO:teuthology.orchestra.run.smithi022.stderr:config set ... 2024-04-01T20:05:42.963 INFO:teuthology.orchestra.run.smithi022.stderr:admin_socket: invalid command 2024-04-01T20:05:43.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:43 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:05:43.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:43 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:05:43.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:43 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:05:43.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:43 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:05:43.736 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-01T20:05:43.736 INFO:tasks.cephadm.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2024-04-01T20:05:43.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:43 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:05:43.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:43 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:05:44.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:44 smithi022 ceph-mon[39439]: osdmap e853: 12 total, 11 up, 9 in 2024-04-01T20:05:44.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:44 smithi022 ceph-mon[39439]: pgmap v2319: 1 pgs: 1 active+clean; 577 KiB data, 5.7 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:44.613 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:05:44 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-3[331894]: 2024-04-01T20:05:44.438+0000 7f76d0e467c0 -1 osd.3 832 log_to_monitors true 2024-04-01T20:05:44.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:44 smithi188 ceph-mon[43939]: osdmap e853: 12 total, 11 up, 9 in 2024-04-01T20:05:44.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:44 smithi188 ceph-mon[43939]: pgmap v2319: 1 pgs: 1 active+clean; 577 KiB data, 5.7 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:44.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:44 smithi062 ceph-mon[44211]: osdmap e853: 12 total, 11 up, 9 in 2024-04-01T20:05:44.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:44 smithi062 ceph-mon[44211]: pgmap v2319: 1 pgs: 1 active+clean; 577 KiB data, 5.7 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:45.584 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:45 smithi022 ceph-mon[39439]: from='osd.3 v1:172.21.15.22:6813/1381750921' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-01T20:05:45.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:45 smithi188 ceph-mon[43939]: from='osd.3 v1:172.21.15.22:6813/1381750921' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-01T20:05:45.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:45 smithi062 ceph-mon[44211]: from='osd.3 v1:172.21.15.22:6813/1381750921' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-01T20:05:45.862 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:05:45 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-3[331894]: 2024-04-01T20:05:45.585+0000 7f76be296700 -1 osd.3 854 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T20:05:46.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:46 smithi022 ceph-mon[39439]: from='osd.3 v1:172.21.15.22:6813/1381750921' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-01T20:05:46.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:46 smithi022 ceph-mon[39439]: osdmap e854: 12 total, 11 up, 9 in 2024-04-01T20:05:46.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:46 smithi022 ceph-mon[39439]: from='osd.3 v1:172.21.15.22:6813/1381750921' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-04-01T20:05:46.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:46 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T20:05:46.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:46 smithi022 ceph-mon[39439]: pgmap v2321: 1 pgs: 1 active+clean; 577 KiB data, 5.7 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:46.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:46 smithi022 ceph-mon[39439]: from='osd.3 v1:172.21.15.22:6813/1381750921' entity='osd.3' 2024-04-01T20:05:46.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:46 smithi188 ceph-mon[43939]: from='osd.3 v1:172.21.15.22:6813/1381750921' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-01T20:05:46.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:46 smithi188 ceph-mon[43939]: osdmap e854: 12 total, 11 up, 9 in 2024-04-01T20:05:46.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:46 smithi188 ceph-mon[43939]: from='osd.3 v1:172.21.15.22:6813/1381750921' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-04-01T20:05:46.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:46 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T20:05:46.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:46 smithi188 ceph-mon[43939]: pgmap v2321: 1 pgs: 1 active+clean; 577 KiB data, 5.7 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:46.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:46 smithi188 ceph-mon[43939]: from='osd.3 v1:172.21.15.22:6813/1381750921' entity='osd.3' 2024-04-01T20:05:46.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:46 smithi062 ceph-mon[44211]: from='osd.3 v1:172.21.15.22:6813/1381750921' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-01T20:05:46.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:46 smithi062 ceph-mon[44211]: osdmap e854: 12 total, 11 up, 9 in 2024-04-01T20:05:46.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:46 smithi062 ceph-mon[44211]: from='osd.3 v1:172.21.15.22:6813/1381750921' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-04-01T20:05:46.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:46 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T20:05:46.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:46 smithi062 ceph-mon[44211]: pgmap v2321: 1 pgs: 1 active+clean; 577 KiB data, 5.7 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:46.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:46 smithi062 ceph-mon[44211]: from='osd.3 v1:172.21.15.22:6813/1381750921' entity='osd.3' 2024-04-01T20:05:47.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:05:47.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:47 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:05:47.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:47 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:05:47.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:47 smithi022 ceph-mon[39439]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:05:47.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:47 smithi022 ceph-mon[39439]: osd.3 v1:172.21.15.22:6813/1381750921 boot 2024-04-01T20:05:47.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:47 smithi022 ceph-mon[39439]: osdmap e855: 12 total, 12 up, 9 in 2024-04-01T20:05:47.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T20:05:47.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:47 smithi022 ceph-mon[39439]: pgmap v2323: 1 pgs: 1 active+clean; 577 KiB data, 5.7 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:47.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:05:47.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:47 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:05:47.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:47 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:05:47.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:47 smithi188 ceph-mon[43939]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:05:47.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:47 smithi188 ceph-mon[43939]: osd.3 v1:172.21.15.22:6813/1381750921 boot 2024-04-01T20:05:47.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:47 smithi188 ceph-mon[43939]: osdmap e855: 12 total, 12 up, 9 in 2024-04-01T20:05:47.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T20:05:47.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:47 smithi188 ceph-mon[43939]: pgmap v2323: 1 pgs: 1 active+clean; 577 KiB data, 5.7 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:48.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:05:48.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:47 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:05:48.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:47 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:05:48.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:47 smithi062 ceph-mon[44211]: osd_map_cache_size (1) is not > osd_pg_epoch_persisted_max_stale (40) 2024-04-01T20:05:48.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:47 smithi062 ceph-mon[44211]: osd.3 v1:172.21.15.22:6813/1381750921 boot 2024-04-01T20:05:48.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:47 smithi062 ceph-mon[44211]: osdmap e855: 12 total, 12 up, 9 in 2024-04-01T20:05:48.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T20:05:48.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:47 smithi062 ceph-mon[44211]: pgmap v2323: 1 pgs: 1 active+clean; 577 KiB data, 5.7 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:48.737 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph daemon osd.3 dump_ops_in_flight 2024-04-01T20:05:48.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:48 smithi022 ceph-mon[39439]: osdmap e856: 12 total, 12 up, 9 in 2024-04-01T20:05:48.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:48 smithi188 ceph-mon[43939]: osdmap e856: 12 total, 12 up, 9 in 2024-04-01T20:05:49.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:48 smithi062 ceph-mon[44211]: osdmap e856: 12 total, 12 up, 9 in 2024-04-01T20:05:49.033 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:05:49.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:49 smithi022 ceph-mon[39439]: pgmap v2325: 1 pgs: 1 active+clean; 577 KiB data, 5.7 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:49.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:49 smithi188 ceph-mon[43939]: pgmap v2325: 1 pgs: 1 active+clean; 577 KiB data, 5.7 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:50.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:49 smithi062 ceph-mon[44211]: pgmap v2325: 1 pgs: 1 active+clean; 577 KiB data, 5.7 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:50.968 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-04-01T20:05:50.968 INFO:teuthology.orchestra.run.smithi022.stdout: "ops": [], 2024-04-01T20:05:50.968 INFO:teuthology.orchestra.run.smithi022.stdout: "num_ops": 0 2024-04-01T20:05:50.968 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-04-01T20:05:51.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:51 smithi022 ceph-mon[39439]: pgmap v2326: 1 pgs: 1 active+clean; 577 KiB data, 5.7 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:51.741 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-01T20:05:51.741 INFO:tasks.thrashosds.thrasher:Adding osd 10 2024-04-01T20:05:51.742 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd in 10 2024-04-01T20:05:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:51 smithi188 ceph-mon[43939]: pgmap v2326: 1 pgs: 1 active+clean; 577 KiB data, 5.7 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:52.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:51 smithi062 ceph-mon[44211]: pgmap v2326: 1 pgs: 1 active+clean; 577 KiB data, 5.7 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:52.021 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:05:53.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:53 smithi022 ceph-mon[39439]: pgmap v2327: 1 pgs: 1 active+clean; 577 KiB data, 5.7 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:53.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:53 smithi188 ceph-mon[43939]: pgmap v2327: 1 pgs: 1 active+clean; 577 KiB data, 5.7 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:54.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:53 smithi062 ceph-mon[44211]: pgmap v2327: 1 pgs: 1 active+clean; 577 KiB data, 5.7 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:54.576 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:54 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[39416]: 2024-04-01T20:05:54.126+0000 7fd025a9f700 -1 mon.a@0(leader).osd e856 definitely_dead 0 2024-04-01T20:05:54.583 INFO:teuthology.orchestra.run.smithi022.stderr:marked in osd.10. 2024-04-01T20:05:54.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:54 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2516316339' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["10"]}]: dispatch 2024-04-01T20:05:54.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:54 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2516316339' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["10"]}]: dispatch 2024-04-01T20:05:55.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:54 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2516316339' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["10"]}]: dispatch 2024-04-01T20:05:55.322 INFO:tasks.thrashosds.thrasher:Added osd 10 2024-04-01T20:05:55.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:55 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2516316339' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["10"]}]': finished 2024-04-01T20:05:55.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:55 smithi022 ceph-mon[39439]: osdmap e857: 12 total, 12 up, 10 in 2024-04-01T20:05:55.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:55 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:05:55.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:55 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:05:55.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:55 smithi022 ceph-mon[39439]: pgmap v2329: 1 pgs: 1 active+clean; 577 KiB data, 5.7 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:55.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:55 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2516316339' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["10"]}]': finished 2024-04-01T20:05:55.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:55 smithi188 ceph-mon[43939]: osdmap e857: 12 total, 12 up, 10 in 2024-04-01T20:05:55.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:55 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:05:55.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:55 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:05:55.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:55 smithi188 ceph-mon[43939]: pgmap v2329: 1 pgs: 1 active+clean; 577 KiB data, 5.7 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:56.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:55 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2516316339' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["10"]}]': finished 2024-04-01T20:05:56.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:55 smithi062 ceph-mon[44211]: osdmap e857: 12 total, 12 up, 10 in 2024-04-01T20:05:56.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:55 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:05:56.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:55 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:05:56.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:55 smithi062 ceph-mon[44211]: pgmap v2329: 1 pgs: 1 active+clean; 577 KiB data, 5.7 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:56.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:56 smithi022 ceph-mon[39439]: osdmap e858: 12 total, 12 up, 10 in 2024-04-01T20:05:56.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:56 smithi188 ceph-mon[43939]: osdmap e858: 12 total, 12 up, 10 in 2024-04-01T20:05:57.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:56 smithi062 ceph-mon[44211]: osdmap e858: 12 total, 12 up, 10 in 2024-04-01T20:05:58.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:57 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:05:58.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:57 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:05:58.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:57 smithi062 ceph-mon[44211]: osdmap e859: 12 total, 12 up, 10 in 2024-04-01T20:05:58.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:57 smithi062 ceph-mon[44211]: pgmap v2332: 1 pgs: 1 active+clean; 577 KiB data, 5.7 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:58.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:57 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:05:58.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:57 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:05:58.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:57 smithi022 ceph-mon[39439]: osdmap e859: 12 total, 12 up, 10 in 2024-04-01T20:05:58.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:57 smithi022 ceph-mon[39439]: pgmap v2332: 1 pgs: 1 active+clean; 577 KiB data, 5.7 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:58.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:57 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:05:58.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:57 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:05:58.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:57 smithi188 ceph-mon[43939]: osdmap e859: 12 total, 12 up, 10 in 2024-04-01T20:05:58.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:57 smithi188 ceph-mon[43939]: pgmap v2332: 1 pgs: 1 active+clean; 577 KiB data, 5.7 GiB used, 799 GiB / 805 GiB avail 2024-04-01T20:05:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:05:59 smithi022 ceph-mon[39439]: pgmap v2333: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T20:05:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:05:59 smithi188 ceph-mon[43939]: pgmap v2333: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T20:06:00.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:05:59 smithi062 ceph-mon[44211]: pgmap v2333: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T20:06:00.323 INFO:tasks.thrashosds.thrasher:inning osd 2024-04-01T20:06:00.323 INFO:tasks.thrashosds.thrasher:Adding osd 3 2024-04-01T20:06:00.323 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd in 3 2024-04-01T20:06:00.616 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:06:01.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:01 smithi022 ceph-mon[39439]: pgmap v2334: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T20:06:02.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:01 smithi062 ceph-mon[44211]: pgmap v2334: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T20:06:02.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:01 smithi188 ceph-mon[43939]: pgmap v2334: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T20:06:02.841 INFO:teuthology.orchestra.run.smithi022.stderr:marked in osd.3. 2024-04-01T20:06:03.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:02 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[39416]: 2024-04-01T20:06:02.786+0000 7fd025a9f700 -1 mon.a@0(leader).osd e859 definitely_dead 0 2024-04-01T20:06:03.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:02 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1044092136' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["3"]}]: dispatch 2024-04-01T20:06:03.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:02 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1044092136' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["3"]}]: dispatch 2024-04-01T20:06:03.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:02 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1044092136' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["3"]}]: dispatch 2024-04-01T20:06:03.662 INFO:tasks.thrashosds.thrasher:Added osd 3 2024-04-01T20:06:03.662 INFO:tasks.thrashosds.thrasher:inning osd 2024-04-01T20:06:03.662 INFO:tasks.thrashosds.thrasher:Adding osd 11 2024-04-01T20:06:03.662 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd in 11 2024-04-01T20:06:03.944 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:06:04.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:03 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1044092136' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["3"]}]': finished 2024-04-01T20:06:04.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:03 smithi022 ceph-mon[39439]: osdmap e860: 12 total, 12 up, 11 in 2024-04-01T20:06:04.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:03 smithi022 ceph-mon[39439]: pgmap v2336: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T20:06:04.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:03 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1044092136' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["3"]}]': finished 2024-04-01T20:06:04.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:03 smithi188 ceph-mon[43939]: osdmap e860: 12 total, 12 up, 11 in 2024-04-01T20:06:04.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:03 smithi188 ceph-mon[43939]: pgmap v2336: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T20:06:04.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:03 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1044092136' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["3"]}]': finished 2024-04-01T20:06:04.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:03 smithi062 ceph-mon[44211]: osdmap e860: 12 total, 12 up, 11 in 2024-04-01T20:06:04.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:03 smithi062 ceph-mon[44211]: pgmap v2336: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T20:06:05.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:04 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:06:05.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:04 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:06:05.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:04 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:06:05.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:04 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:06:05.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:04 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:06:05.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:04 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:06:06.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:05 smithi022 ceph-mon[39439]: osdmap e861: 12 total, 12 up, 11 in 2024-04-01T20:06:06.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:05 smithi022 ceph-mon[39439]: pgmap v2338: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T20:06:06.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:06 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[39416]: 2024-04-01T20:06:06.101+0000 7fd025a9f700 -1 mon.a@0(leader).osd e861 definitely_dead 0 2024-04-01T20:06:06.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:05 smithi188 ceph-mon[43939]: osdmap e861: 12 total, 12 up, 11 in 2024-04-01T20:06:06.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:05 smithi188 ceph-mon[43939]: pgmap v2338: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T20:06:06.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:05 smithi062 ceph-mon[44211]: osdmap e861: 12 total, 12 up, 11 in 2024-04-01T20:06:06.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:05 smithi062 ceph-mon[44211]: pgmap v2338: 1 pgs: 1 active+clean; 577 KiB data, 5.8 GiB used, 888 GiB / 894 GiB avail 2024-04-01T20:06:06.870 INFO:teuthology.orchestra.run.smithi022.stderr:marked in osd.11. 2024-04-01T20:06:07.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:06 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2198510904' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["11"]}]: dispatch 2024-04-01T20:06:07.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:06 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2198510904' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["11"]}]: dispatch 2024-04-01T20:06:07.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:06 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2198510904' entity='client.admin' cmd=[{"prefix": "osd in", "ids": ["11"]}]: dispatch 2024-04-01T20:06:07.635 INFO:tasks.thrashosds.thrasher:Added osd 11 2024-04-01T20:06:07.635 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-01T20:06:07.917 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:06:08.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:07 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2198510904' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["11"]}]': finished 2024-04-01T20:06:08.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:07 smithi188 ceph-mon[43939]: osdmap e862: 12 total, 12 up, 12 in 2024-04-01T20:06:08.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:07 smithi188 ceph-mon[43939]: pgmap v2340: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 978 GiB / 983 GiB avail 2024-04-01T20:06:08.214 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:07 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2198510904' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["11"]}]': finished 2024-04-01T20:06:08.215 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:07 smithi022 ceph-mon[39439]: osdmap e862: 12 total, 12 up, 12 in 2024-04-01T20:06:08.215 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:07 smithi022 ceph-mon[39439]: pgmap v2340: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 978 GiB / 983 GiB avail 2024-04-01T20:06:08.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:07 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2198510904' entity='client.admin' cmd='[{"prefix": "osd in", "ids": ["11"]}]': finished 2024-04-01T20:06:08.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:07 smithi062 ceph-mon[44211]: osdmap e862: 12 total, 12 up, 12 in 2024-04-01T20:06:08.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:07 smithi062 ceph-mon[44211]: pgmap v2340: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 978 GiB / 983 GiB avail 2024-04-01T20:06:09.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:08 smithi188 ceph-mon[43939]: osdmap e863: 12 total, 12 up, 12 in 2024-04-01T20:06:09.192 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:08 smithi022 ceph-mon[39439]: osdmap e863: 12 total, 12 up, 12 in 2024-04-01T20:06:09.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:08 smithi062 ceph-mon[44211]: osdmap e863: 12 total, 12 up, 12 in 2024-04-01T20:06:09.780 INFO:teuthology.orchestra.run.smithi022.stdout:mon.a: {} 2024-04-01T20:06:09.791 INFO:teuthology.orchestra.run.smithi022.stdout:mon.c: {} 2024-04-01T20:06:09.802 INFO:teuthology.orchestra.run.smithi022.stdout:mon.b: {} 2024-04-01T20:06:09.803 INFO:teuthology.orchestra.run.smithi022.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-01T20:06:09.804 INFO:teuthology.orchestra.run.smithi022.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-01T20:06:09.804 INFO:teuthology.orchestra.run.smithi022.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-01T20:06:10.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:09 smithi022 ceph-mon[39439]: pgmap v2342: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 978 GiB / 983 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-01T20:06:10.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:09 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3022608023' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-01T20:06:10.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:09 smithi062 ceph-mon[44211]: pgmap v2342: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 978 GiB / 983 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-01T20:06:10.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:09 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3022608023' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-01T20:06:10.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:09 smithi188 ceph-mon[43939]: pgmap v2342: 1 pgs: 1 active+clean; 577 KiB data, 5.9 GiB used, 978 GiB / 983 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-01T20:06:10.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:09 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3022608023' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-01T20:06:10.501 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 0 1 2024-04-01T20:06:10.779 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:06:11.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:11 smithi022 ceph-mon[39439]: pgmap v2343: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s, 0 objects/s recovering 2024-04-01T20:06:11.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:11 smithi188 ceph-mon[43939]: pgmap v2343: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s, 0 objects/s recovering 2024-04-01T20:06:12.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:11 smithi062 ceph-mon[44211]: pgmap v2343: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s, 0 objects/s recovering 2024-04-01T20:06:12.908 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.0 to 1 (10000) 2024-04-01T20:06:13.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:12 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/286872274' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T20:06:13.264 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:12 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/286872274' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T20:06:13.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:12 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/286872274' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T20:06:13.695 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd primary-affinity 0 1 2024-04-01T20:06:13.977 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:06:14.216 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:13 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/286872274' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-04-01T20:06:14.216 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:13 smithi022 ceph-mon[39439]: osdmap e864: 12 total, 12 up, 12 in 2024-04-01T20:06:14.216 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:13 smithi022 ceph-mon[39439]: pgmap v2345: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s, 0 objects/s recovering 2024-04-01T20:06:14.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:13 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/286872274' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-04-01T20:06:14.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:13 smithi062 ceph-mon[44211]: osdmap e864: 12 total, 12 up, 12 in 2024-04-01T20:06:14.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:13 smithi062 ceph-mon[44211]: pgmap v2345: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s, 0 objects/s recovering 2024-04-01T20:06:14.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:13 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/286872274' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2024-04-01T20:06:14.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:13 smithi188 ceph-mon[43939]: osdmap e864: 12 total, 12 up, 12 in 2024-04-01T20:06:14.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:13 smithi188 ceph-mon[43939]: pgmap v2345: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s, 0 objects/s recovering 2024-04-01T20:06:15.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:15 smithi022 ceph-mon[39439]: pgmap v2346: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s, 0 objects/s recovering 2024-04-01T20:06:15.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:15 smithi188 ceph-mon[43939]: pgmap v2346: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s, 0 objects/s recovering 2024-04-01T20:06:16.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:15 smithi062 ceph-mon[44211]: pgmap v2346: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s, 0 objects/s recovering 2024-04-01T20:06:16.657 INFO:teuthology.orchestra.run.smithi022.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-01T20:06:17.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:16 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1915465064' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T20:06:17.029 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:16 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1915465064' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T20:06:17.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:16 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1915465064' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]: dispatch 2024-04-01T20:06:17.434 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 2 1 2024-04-01T20:06:17.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:17 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1915465064' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]': finished 2024-04-01T20:06:17.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:17 smithi022 ceph-mon[39439]: osdmap e865: 12 total, 12 up, 12 in 2024-04-01T20:06:17.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:17 smithi022 ceph-mon[39439]: pgmap v2348: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:17.716 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:06:18.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:17 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1915465064' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]': finished 2024-04-01T20:06:18.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:17 smithi062 ceph-mon[44211]: osdmap e865: 12 total, 12 up, 12 in 2024-04-01T20:06:18.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:17 smithi062 ceph-mon[44211]: pgmap v2348: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:18.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:17 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1915465064' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]': finished 2024-04-01T20:06:18.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:17 smithi188 ceph-mon[43939]: osdmap e865: 12 total, 12 up, 12 in 2024-04-01T20:06:18.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:17 smithi188 ceph-mon[43939]: pgmap v2348: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:19.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:19 smithi022 ceph-mon[39439]: pgmap v2349: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:19.878 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:19 smithi188 ceph-mon[43939]: pgmap v2349: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:20.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:19 smithi062 ceph-mon[44211]: pgmap v2349: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:20.587 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.2 to 1 (10000) 2024-04-01T20:06:20.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:20 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3420358547' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T20:06:20.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:20 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3420358547' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T20:06:21.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:20 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3420358547' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T20:06:21.446 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd primary-affinity 2 1 2024-04-01T20:06:21.730 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:06:21.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:21 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3420358547' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-04-01T20:06:21.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:21 smithi022 ceph-mon[39439]: osdmap e866: 12 total, 12 up, 12 in 2024-04-01T20:06:21.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:21 smithi022 ceph-mon[39439]: pgmap v2351: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:21 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3420358547' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-04-01T20:06:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:21 smithi188 ceph-mon[43939]: osdmap e866: 12 total, 12 up, 12 in 2024-04-01T20:06:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:21 smithi188 ceph-mon[43939]: pgmap v2351: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:22.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:21 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3420358547' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2024-04-01T20:06:22.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:21 smithi062 ceph-mon[44211]: osdmap e866: 12 total, 12 up, 12 in 2024-04-01T20:06:22.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:21 smithi062 ceph-mon[44211]: pgmap v2351: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:23.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:23 smithi022 ceph-mon[39439]: pgmap v2352: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:23.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:23 smithi188 ceph-mon[43939]: pgmap v2352: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:24.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:23 smithi062 ceph-mon[44211]: pgmap v2352: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:24.591 INFO:teuthology.orchestra.run.smithi022.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-01T20:06:24.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:24 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3322269791' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T20:06:24.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:24 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3322269791' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T20:06:25.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:24 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3322269791' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]: dispatch 2024-04-01T20:06:25.385 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 4 1 2024-04-01T20:06:25.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:25 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3322269791' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]': finished 2024-04-01T20:06:25.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:25 smithi022 ceph-mon[39439]: osdmap e867: 12 total, 12 up, 12 in 2024-04-01T20:06:25.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:25 smithi022 ceph-mon[39439]: pgmap v2354: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:25.667 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:06:25.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:25 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3322269791' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]': finished 2024-04-01T20:06:25.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:25 smithi188 ceph-mon[43939]: osdmap e867: 12 total, 12 up, 12 in 2024-04-01T20:06:25.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:25 smithi188 ceph-mon[43939]: pgmap v2354: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:26.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:25 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3322269791' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]': finished 2024-04-01T20:06:26.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:25 smithi062 ceph-mon[44211]: osdmap e867: 12 total, 12 up, 12 in 2024-04-01T20:06:26.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:25 smithi062 ceph-mon[44211]: pgmap v2354: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:27.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:27 smithi022 ceph-mon[39439]: pgmap v2355: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:27.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:27 smithi188 ceph-mon[43939]: pgmap v2355: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:28.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:27 smithi062 ceph-mon[44211]: pgmap v2355: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:28.587 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.4 to 1 (10000) 2024-04-01T20:06:28.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:28 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1898015601' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T20:06:28.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:28 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1898015601' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T20:06:29.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:28 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1898015601' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T20:06:29.402 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd primary-affinity 4 1 2024-04-01T20:06:29.689 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:06:29.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:29 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1898015601' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-04-01T20:06:29.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:29 smithi022 ceph-mon[39439]: osdmap e868: 12 total, 12 up, 12 in 2024-04-01T20:06:29.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:29 smithi022 ceph-mon[39439]: pgmap v2357: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:29.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:29 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1898015601' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-04-01T20:06:29.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:29 smithi188 ceph-mon[43939]: osdmap e868: 12 total, 12 up, 12 in 2024-04-01T20:06:29.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:29 smithi188 ceph-mon[43939]: pgmap v2357: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:29 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1898015601' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 4, "weight": 1.0}]': finished 2024-04-01T20:06:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:29 smithi062 ceph-mon[44211]: osdmap e868: 12 total, 12 up, 12 in 2024-04-01T20:06:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:29 smithi062 ceph-mon[44211]: pgmap v2357: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:32.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:31 smithi062 ceph-mon[44211]: pgmap v2358: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:32.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:31 smithi022 ceph-mon[39439]: pgmap v2358: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:32.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:31 smithi188 ceph-mon[43939]: pgmap v2358: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:32.670 INFO:teuthology.orchestra.run.smithi022.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-04-01T20:06:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:32 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1983279583' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T20:06:33.057 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:32 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1983279583' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T20:06:33.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:32 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1983279583' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]: dispatch 2024-04-01T20:06:33.411 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 5 1 2024-04-01T20:06:33.695 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:06:33.929 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:33 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1983279583' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]': finished 2024-04-01T20:06:33.930 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:33 smithi022 ceph-mon[39439]: osdmap e869: 12 total, 12 up, 12 in 2024-04-01T20:06:33.930 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:33 smithi022 ceph-mon[39439]: pgmap v2360: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:33 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1983279583' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]': finished 2024-04-01T20:06:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:33 smithi062 ceph-mon[44211]: osdmap e869: 12 total, 12 up, 12 in 2024-04-01T20:06:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:33 smithi062 ceph-mon[44211]: pgmap v2360: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:34.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:33 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1983279583' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]': finished 2024-04-01T20:06:34.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:33 smithi188 ceph-mon[43939]: osdmap e869: 12 total, 12 up, 12 in 2024-04-01T20:06:34.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:33 smithi188 ceph-mon[43939]: pgmap v2360: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:35.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:35 smithi022 ceph-mon[39439]: pgmap v2361: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:35.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:35 smithi188 ceph-mon[43939]: pgmap v2361: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:36.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:35 smithi062 ceph-mon[44211]: pgmap v2361: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:36.586 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.5 to 1 (10000) 2024-04-01T20:06:36.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:36 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/63953627' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T20:06:36.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:36 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/63953627' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T20:06:37.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:36 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/63953627' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T20:06:37.484 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd primary-affinity 5 1 2024-04-01T20:06:37.767 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:06:37.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:37 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/63953627' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-04-01T20:06:37.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:37 smithi022 ceph-mon[39439]: osdmap e870: 12 total, 12 up, 12 in 2024-04-01T20:06:37.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:37 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:06:37.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:37 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:06:37.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:37 smithi022 ceph-mon[39439]: pgmap v2363: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:37.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:37 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/63953627' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-04-01T20:06:37.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:37 smithi188 ceph-mon[43939]: osdmap e870: 12 total, 12 up, 12 in 2024-04-01T20:06:37.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:37 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:06:37.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:37 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:06:37.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:37 smithi188 ceph-mon[43939]: pgmap v2363: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:38.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:37 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/63953627' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 5, "weight": 1.0}]': finished 2024-04-01T20:06:38.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:37 smithi062 ceph-mon[44211]: osdmap e870: 12 total, 12 up, 12 in 2024-04-01T20:06:38.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:37 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:06:38.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:37 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:06:38.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:37 smithi062 ceph-mon[44211]: pgmap v2363: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:38.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:38 smithi022 ceph-mon[39439]: osdmap e871: 12 total, 12 up, 12 in 2024-04-01T20:06:38.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:38 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:06:38.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:38 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:06:38.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:38 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:06:38.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:38 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:06:38.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:38 smithi188 ceph-mon[43939]: osdmap e871: 12 total, 12 up, 12 in 2024-04-01T20:06:38.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:38 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:06:38.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:38 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:06:38.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:38 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:06:38.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:38 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:06:39.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:38 smithi062 ceph-mon[44211]: osdmap e871: 12 total, 12 up, 12 in 2024-04-01T20:06:39.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:38 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:06:39.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:38 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:06:39.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:38 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:06:39.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:38 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:06:39.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:39 smithi022 ceph-mon[39439]: osdmap e872: 12 total, 12 up, 12 in 2024-04-01T20:06:39.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:39 smithi022 ceph-mon[39439]: pgmap v2366: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:39 smithi188 ceph-mon[43939]: osdmap e872: 12 total, 12 up, 12 in 2024-04-01T20:06:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:39 smithi188 ceph-mon[43939]: pgmap v2366: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:40.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:39 smithi062 ceph-mon[44211]: osdmap e872: 12 total, 12 up, 12 in 2024-04-01T20:06:40.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:39 smithi062 ceph-mon[44211]: pgmap v2366: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:40.608 INFO:teuthology.orchestra.run.smithi022.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-04-01T20:06:40.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:40 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:06:40.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:40 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:06:40.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:40 smithi022 ceph-mon[39439]: osdmap e873: 12 total, 12 up, 12 in 2024-04-01T20:06:40.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:40 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1140707498' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T20:06:40.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:40 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:06:40.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:40 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:06:40.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:40 smithi188 ceph-mon[43939]: osdmap e873: 12 total, 12 up, 12 in 2024-04-01T20:06:40.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:40 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1140707498' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T20:06:41.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:40 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:06:41.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:40 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:06:41.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:40 smithi062 ceph-mon[44211]: osdmap e873: 12 total, 12 up, 12 in 2024-04-01T20:06:41.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:40 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1140707498' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]: dispatch 2024-04-01T20:06:41.433 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 7 1 2024-04-01T20:06:41.707 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:06:41.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:41 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1140707498' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]': finished 2024-04-01T20:06:41.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:41 smithi022 ceph-mon[39439]: osdmap e874: 12 total, 12 up, 12 in 2024-04-01T20:06:41.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:41 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:06:41.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:41 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:06:41.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:41 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:06:41.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:41 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:06:41.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:41 smithi022 ceph-mon[39439]: pgmap v2369: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:41.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:41 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1140707498' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]': finished 2024-04-01T20:06:41.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:41 smithi188 ceph-mon[43939]: osdmap e874: 12 total, 12 up, 12 in 2024-04-01T20:06:41.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:41 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:06:41.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:41 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:06:41.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:41 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:06:41.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:41 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:06:41.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:41 smithi188 ceph-mon[43939]: pgmap v2369: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:42.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:41 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1140707498' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]': finished 2024-04-01T20:06:42.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:41 smithi062 ceph-mon[44211]: osdmap e874: 12 total, 12 up, 12 in 2024-04-01T20:06:42.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:41 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:06:42.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:41 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:06:42.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:41 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:06:42.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:41 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:06:42.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:41 smithi062 ceph-mon[44211]: pgmap v2369: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:43.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:43 smithi022 ceph-mon[39439]: pgmap v2370: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:43.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:43 smithi188 ceph-mon[43939]: pgmap v2370: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:44.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:43 smithi062 ceph-mon[44211]: pgmap v2370: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:44.591 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.7 to 1 (10000) 2024-04-01T20:06:44.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:44 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/620589138' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T20:06:44.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:44 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/620589138' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T20:06:45.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:44 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/620589138' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T20:06:45.381 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd primary-affinity 7 1 2024-04-01T20:06:45.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:45 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:06:45.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:45 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:06:45.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:45 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/620589138' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-04-01T20:06:45.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:45 smithi022 ceph-mon[39439]: osdmap e875: 12 total, 12 up, 12 in 2024-04-01T20:06:45.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:45 smithi022 ceph-mon[39439]: pgmap v2372: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:45.664 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:06:45.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:45 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:06:45.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:45 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:06:45.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:45 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/620589138' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-04-01T20:06:45.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:45 smithi188 ceph-mon[43939]: osdmap e875: 12 total, 12 up, 12 in 2024-04-01T20:06:45.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:45 smithi188 ceph-mon[43939]: pgmap v2372: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:46.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:45 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:06:46.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:45 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:06:46.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:45 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/620589138' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 7, "weight": 1.0}]': finished 2024-04-01T20:06:46.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:45 smithi062 ceph-mon[44211]: osdmap e875: 12 total, 12 up, 12 in 2024-04-01T20:06:46.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:45 smithi062 ceph-mon[44211]: pgmap v2372: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:47.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:47 smithi022 ceph-mon[39439]: pgmap v2373: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:47.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:47 smithi188 ceph-mon[43939]: pgmap v2373: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:48.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:47 smithi062 ceph-mon[44211]: pgmap v2373: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:48.591 INFO:teuthology.orchestra.run.smithi022.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-04-01T20:06:48.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:48 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1757997134' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T20:06:48.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:48 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1757997134' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T20:06:49.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:48 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1757997134' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]: dispatch 2024-04-01T20:06:49.329 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 9 1 2024-04-01T20:06:49.592 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:49 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1757997134' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]': finished 2024-04-01T20:06:49.593 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:49 smithi022 ceph-mon[39439]: osdmap e876: 12 total, 12 up, 12 in 2024-04-01T20:06:49.593 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:49 smithi022 ceph-mon[39439]: pgmap v2375: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:49.609 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:06:49.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:49 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1757997134' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]': finished 2024-04-01T20:06:49.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:49 smithi188 ceph-mon[43939]: osdmap e876: 12 total, 12 up, 12 in 2024-04-01T20:06:49.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:49 smithi188 ceph-mon[43939]: pgmap v2375: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:50.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:49 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1757997134' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]': finished 2024-04-01T20:06:50.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:49 smithi062 ceph-mon[44211]: osdmap e876: 12 total, 12 up, 12 in 2024-04-01T20:06:50.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:49 smithi062 ceph-mon[44211]: pgmap v2375: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:51.747 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.9 to 1 (10000) 2024-04-01T20:06:52.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:51 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:06:52.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:51 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:06:52.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:51 smithi062 ceph-mon[44211]: osdmap e877: 12 total, 12 up, 12 in 2024-04-01T20:06:52.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:51 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:06:52.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:51 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:06:52.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:51 smithi062 ceph-mon[44211]: pgmap v2377: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:52.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:51 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1325789448' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T20:06:52.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:51 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:06:52.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:51 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:06:52.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:51 smithi022 ceph-mon[39439]: osdmap e877: 12 total, 12 up, 12 in 2024-04-01T20:06:52.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:51 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:06:52.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:51 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:06:52.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:51 smithi022 ceph-mon[39439]: pgmap v2377: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:52.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:51 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1325789448' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T20:06:52.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:51 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:06:52.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:51 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:06:52.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:51 smithi188 ceph-mon[43939]: osdmap e877: 12 total, 12 up, 12 in 2024-04-01T20:06:52.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:51 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:06:52.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:51 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:06:52.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:51 smithi188 ceph-mon[43939]: pgmap v2377: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:52.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:51 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1325789448' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T20:06:52.490 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd primary-affinity 9 1 2024-04-01T20:06:52.770 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:06:53.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:52 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1325789448' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]': finished 2024-04-01T20:06:53.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:52 smithi062 ceph-mon[44211]: osdmap e878: 12 total, 12 up, 12 in 2024-04-01T20:06:53.022 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:52 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1325789448' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]': finished 2024-04-01T20:06:53.022 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:52 smithi022 ceph-mon[39439]: osdmap e878: 12 total, 12 up, 12 in 2024-04-01T20:06:53.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:52 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1325789448' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 9, "weight": 1.0}]': finished 2024-04-01T20:06:53.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:52 smithi188 ceph-mon[43939]: osdmap e878: 12 total, 12 up, 12 in 2024-04-01T20:06:53.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:53 smithi022 ceph-mon[39439]: pgmap v2379: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:54.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:53 smithi062 ceph-mon[44211]: pgmap v2379: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:54.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:53 smithi188 ceph-mon[43939]: pgmap v2379: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:set osd.9 primary-affinity to 1 (8655362) 2024-04-01T20:06:55.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:54 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/167045540' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T20:06:55.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:54 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/167045540' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T20:06:55.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:54 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/167045540' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 9, "weight": 1.0}]: dispatch 2024-04-01T20:06:55.532 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 11 1 2024-04-01T20:06:55.814 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:06:56.079 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:55 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/167045540' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 9, "weight": 1.0}]': finished 2024-04-01T20:06:56.079 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:55 smithi022 ceph-mon[39439]: osdmap e879: 12 total, 12 up, 12 in 2024-04-01T20:06:56.079 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:55 smithi022 ceph-mon[39439]: pgmap v2381: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:56.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:55 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/167045540' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 9, "weight": 1.0}]': finished 2024-04-01T20:06:56.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:55 smithi188 ceph-mon[43939]: osdmap e879: 12 total, 12 up, 12 in 2024-04-01T20:06:56.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:55 smithi188 ceph-mon[43939]: pgmap v2381: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:56.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:55 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/167045540' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 9, "weight": 1.0}]': finished 2024-04-01T20:06:56.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:55 smithi062 ceph-mon[44211]: osdmap e879: 12 total, 12 up, 12 in 2024-04-01T20:06:56.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:55 smithi062 ceph-mon[44211]: pgmap v2381: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:57.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:57 smithi022 ceph-mon[39439]: pgmap v2382: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:57.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:57 smithi188 ceph-mon[43939]: pgmap v2382: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:58.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:57 smithi062 ceph-mon[44211]: pgmap v2382: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:58.593 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.11 to 1 (10000) 2024-04-01T20:06:58.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:58 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3518165236' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T20:06:58.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:58 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3518165236' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T20:06:59.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:58 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3518165236' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T20:06:59.373 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd primary-affinity 11 1 2024-04-01T20:06:59.661 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:06:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:59 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3518165236' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]': finished 2024-04-01T20:06:59.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:59 smithi022 ceph-mon[39439]: osdmap e880: 12 total, 12 up, 12 in 2024-04-01T20:06:59.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:06:59 smithi022 ceph-mon[39439]: pgmap v2384: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:06:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:59 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3518165236' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]': finished 2024-04-01T20:06:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:59 smithi188 ceph-mon[43939]: osdmap e880: 12 total, 12 up, 12 in 2024-04-01T20:06:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:06:59 smithi188 ceph-mon[43939]: pgmap v2384: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:00.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:59 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3518165236' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 11, "weight": 1.0}]': finished 2024-04-01T20:07:00.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:59 smithi062 ceph-mon[44211]: osdmap e880: 12 total, 12 up, 12 in 2024-04-01T20:07:00.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:06:59 smithi062 ceph-mon[44211]: pgmap v2384: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:00.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:00 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:07:00.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:00 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:07:00.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:00 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T20:07:00.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:00 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:07:00.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:00 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:07:00.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:00 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T20:07:01.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:00 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:07:01.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:00 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:07:01.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:00 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T20:07:01.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:01 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T20:07:01.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:01 smithi022 ceph-mon[39439]: osdmap e881: 12 total, 12 up, 12 in 2024-04-01T20:07:01.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:01 smithi022 ceph-mon[39439]: pgmap v2386: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:01.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:01 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T20:07:01.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:01 smithi188 ceph-mon[43939]: osdmap e881: 12 total, 12 up, 12 in 2024-04-01T20:07:01.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:01 smithi188 ceph-mon[43939]: pgmap v2386: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:02.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:01 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T20:07:02.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:01 smithi062 ceph-mon[44211]: osdmap e881: 12 total, 12 up, 12 in 2024-04-01T20:07:02.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:01 smithi062 ceph-mon[44211]: pgmap v2386: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:02.672 INFO:teuthology.orchestra.run.smithi022.stderr:set osd.11 primary-affinity to 1 (8655362) 2024-04-01T20:07:03.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:02 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:07:03.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:02 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:07:03.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:02 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:07:03.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:02 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:07:03.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:02 smithi062 ceph-mon[44211]: osdmap e882: 12 total, 12 up, 12 in 2024-04-01T20:07:03.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:02 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1824529909' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T20:07:03.098 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:02 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:07:03.098 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:02 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:07:03.098 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:02 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:07:03.098 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:02 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:07:03.098 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:02 smithi022 ceph-mon[39439]: osdmap e882: 12 total, 12 up, 12 in 2024-04-01T20:07:03.098 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:02 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1824529909' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T20:07:03.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:02 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:07:03.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:02 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:07:03.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:02 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:07:03.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:02 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:07:03.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:02 smithi188 ceph-mon[43939]: osdmap e882: 12 total, 12 up, 12 in 2024-04-01T20:07:03.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:02 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1824529909' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 11, "weight": 1.0}]: dispatch 2024-04-01T20:07:03.501 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 8 1 2024-04-01T20:07:03.783 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:07:03.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:03 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1824529909' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 11, "weight": 1.0}]': finished 2024-04-01T20:07:03.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:03 smithi022 ceph-mon[39439]: osdmap e883: 12 total, 12 up, 12 in 2024-04-01T20:07:03.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:03 smithi022 ceph-mon[39439]: pgmap v2389: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:04.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:03 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1824529909' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 11, "weight": 1.0}]': finished 2024-04-01T20:07:04.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:03 smithi062 ceph-mon[44211]: osdmap e883: 12 total, 12 up, 12 in 2024-04-01T20:07:04.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:03 smithi062 ceph-mon[44211]: pgmap v2389: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:04.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:03 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1824529909' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 11, "weight": 1.0}]': finished 2024-04-01T20:07:04.127 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:03 smithi188 ceph-mon[43939]: osdmap e883: 12 total, 12 up, 12 in 2024-04-01T20:07:04.127 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:03 smithi188 ceph-mon[43939]: pgmap v2389: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:05.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:05 smithi022 ceph-mon[39439]: pgmap v2390: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:05 smithi188 ceph-mon[43939]: pgmap v2390: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:06.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:05 smithi062 ceph-mon[44211]: pgmap v2390: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:06.591 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.8 to 1 (10000) 2024-04-01T20:07:06.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:06 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/991809534' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T20:07:06.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:06 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/991809534' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T20:07:07.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:06 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/991809534' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T20:07:07.327 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd primary-affinity 8 1 2024-04-01T20:07:07.598 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:07 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/991809534' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]': finished 2024-04-01T20:07:07.598 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:07 smithi022 ceph-mon[39439]: osdmap e884: 12 total, 12 up, 12 in 2024-04-01T20:07:07.598 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:07 smithi022 ceph-mon[39439]: pgmap v2392: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:07.608 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:07:07.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:07 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/991809534' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]': finished 2024-04-01T20:07:07.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:07 smithi188 ceph-mon[43939]: osdmap e884: 12 total, 12 up, 12 in 2024-04-01T20:07:07.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:07 smithi188 ceph-mon[43939]: pgmap v2392: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:08.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:07 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/991809534' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 8, "weight": 1.0}]': finished 2024-04-01T20:07:08.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:07 smithi062 ceph-mon[44211]: osdmap e884: 12 total, 12 up, 12 in 2024-04-01T20:07:08.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:07 smithi062 ceph-mon[44211]: pgmap v2392: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:09.888 INFO:teuthology.orchestra.run.smithi022.stderr:set osd.8 primary-affinity to 1 (8655362) 2024-04-01T20:07:10.226 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:09 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:07:10.226 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:09 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:07:10.226 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:09 smithi022 ceph-mon[39439]: osdmap e885: 12 total, 12 up, 12 in 2024-04-01T20:07:10.226 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:09 smithi022 ceph-mon[39439]: pgmap v2394: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:10.227 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:09 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1483277832' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T20:07:10.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:09 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:07:10.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:09 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:07:10.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:09 smithi062 ceph-mon[44211]: osdmap e885: 12 total, 12 up, 12 in 2024-04-01T20:07:10.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:09 smithi062 ceph-mon[44211]: pgmap v2394: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:10.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:09 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1483277832' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T20:07:10.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:09 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:07:10.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:09 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:07:10.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:09 smithi188 ceph-mon[43939]: osdmap e885: 12 total, 12 up, 12 in 2024-04-01T20:07:10.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:09 smithi188 ceph-mon[43939]: pgmap v2394: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:10.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:09 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1483277832' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 8, "weight": 1.0}]: dispatch 2024-04-01T20:07:10.680 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 6 1 2024-04-01T20:07:10.961 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:07:11.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:10 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1483277832' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 8, "weight": 1.0}]': finished 2024-04-01T20:07:11.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:10 smithi022 ceph-mon[39439]: osdmap e886: 12 total, 12 up, 12 in 2024-04-01T20:07:11.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:10 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1483277832' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 8, "weight": 1.0}]': finished 2024-04-01T20:07:11.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:10 smithi062 ceph-mon[44211]: osdmap e886: 12 total, 12 up, 12 in 2024-04-01T20:07:11.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:10 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1483277832' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 8, "weight": 1.0}]': finished 2024-04-01T20:07:11.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:10 smithi188 ceph-mon[43939]: osdmap e886: 12 total, 12 up, 12 in 2024-04-01T20:07:12.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:11 smithi022 ceph-mon[39439]: pgmap v2396: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:12.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:11 smithi062 ceph-mon[44211]: pgmap v2396: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:12.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:11 smithi188 ceph-mon[43939]: pgmap v2396: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:13.162 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.6 to 1 (10000) 2024-04-01T20:07:13.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:13 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/136624483' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T20:07:13.531 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:13 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/136624483' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T20:07:13.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:13 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/136624483' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T20:07:13.773 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd primary-affinity 6 1 2024-04-01T20:07:14.050 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:07:14.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:14 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/136624483' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-04-01T20:07:14.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:14 smithi062 ceph-mon[44211]: osdmap e887: 12 total, 12 up, 12 in 2024-04-01T20:07:14.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:14 smithi062 ceph-mon[44211]: pgmap v2398: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:14.579 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:14 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/136624483' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-04-01T20:07:14.579 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:14 smithi022 ceph-mon[39439]: osdmap e887: 12 total, 12 up, 12 in 2024-04-01T20:07:14.579 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:14 smithi022 ceph-mon[39439]: pgmap v2398: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:14.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:14 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/136624483' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 6, "weight": 1.0}]': finished 2024-04-01T20:07:14.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:14 smithi188 ceph-mon[43939]: osdmap e887: 12 total, 12 up, 12 in 2024-04-01T20:07:14.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:14 smithi188 ceph-mon[43939]: pgmap v2398: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:16.665 INFO:teuthology.orchestra.run.smithi022.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-04-01T20:07:16.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:16 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:07:16.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:16 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:07:16.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:16 smithi022 ceph-mon[39439]: pgmap v2399: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:16.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:16 smithi022 ceph-mon[39439]: osdmap e888: 12 total, 12 up, 12 in 2024-04-01T20:07:16.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:16 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2047062757' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T20:07:16.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:16 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:07:16.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:16 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:07:16.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:16 smithi188 ceph-mon[43939]: pgmap v2399: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:16.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:16 smithi188 ceph-mon[43939]: osdmap e888: 12 total, 12 up, 12 in 2024-04-01T20:07:16.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:16 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2047062757' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T20:07:17.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:16 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:07:17.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:16 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:07:17.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:16 smithi062 ceph-mon[44211]: pgmap v2399: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:17.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:16 smithi062 ceph-mon[44211]: osdmap e888: 12 total, 12 up, 12 in 2024-04-01T20:07:17.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:16 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2047062757' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]: dispatch 2024-04-01T20:07:17.334 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 1 1 2024-04-01T20:07:17.615 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:07:18.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:17 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2047062757' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]': finished 2024-04-01T20:07:18.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:17 smithi062 ceph-mon[44211]: osdmap e889: 12 total, 12 up, 12 in 2024-04-01T20:07:18.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:17 smithi062 ceph-mon[44211]: pgmap v2402: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:18.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:17 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2047062757' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]': finished 2024-04-01T20:07:18.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:17 smithi022 ceph-mon[39439]: osdmap e889: 12 total, 12 up, 12 in 2024-04-01T20:07:18.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:17 smithi022 ceph-mon[39439]: pgmap v2402: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:18.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:17 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2047062757' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]': finished 2024-04-01T20:07:18.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:17 smithi188 ceph-mon[43939]: osdmap e889: 12 total, 12 up, 12 in 2024-04-01T20:07:18.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:17 smithi188 ceph-mon[43939]: pgmap v2402: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:19.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:19 smithi022 ceph-mon[39439]: pgmap v2403: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:19.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:19 smithi188 ceph-mon[43939]: pgmap v2403: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:20.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:19 smithi062 ceph-mon[44211]: pgmap v2403: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:20.591 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.1 to 1 (10000) 2024-04-01T20:07:20.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:20 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2498369208' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T20:07:20.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:20 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2498369208' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T20:07:21.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:20 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2498369208' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T20:07:21.412 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd primary-affinity 1 1 2024-04-01T20:07:21.695 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:07:21.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:21 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2498369208' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-04-01T20:07:21.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:21 smithi022 ceph-mon[39439]: osdmap e890: 12 total, 12 up, 12 in 2024-04-01T20:07:21.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:21 smithi022 ceph-mon[39439]: pgmap v2405: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:21 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2498369208' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-04-01T20:07:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:21 smithi188 ceph-mon[43939]: osdmap e890: 12 total, 12 up, 12 in 2024-04-01T20:07:21.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:21 smithi188 ceph-mon[43939]: pgmap v2405: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:22.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:21 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2498369208' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2024-04-01T20:07:22.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:21 smithi062 ceph-mon[44211]: osdmap e890: 12 total, 12 up, 12 in 2024-04-01T20:07:22.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:21 smithi062 ceph-mon[44211]: pgmap v2405: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:23.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:23 smithi022 ceph-mon[39439]: pgmap v2406: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:23.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:23 smithi188 ceph-mon[43939]: pgmap v2406: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:24.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:23 smithi062 ceph-mon[44211]: pgmap v2406: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:24.596 INFO:teuthology.orchestra.run.smithi022.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-01T20:07:24.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:24 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1799126817' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T20:07:24.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:24 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1799126817' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T20:07:25.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:24 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1799126817' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]: dispatch 2024-04-01T20:07:25.407 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 10 1 2024-04-01T20:07:25.689 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:07:25.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:25 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1799126817' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]': finished 2024-04-01T20:07:25.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:25 smithi022 ceph-mon[39439]: osdmap e891: 12 total, 12 up, 12 in 2024-04-01T20:07:25.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:25 smithi022 ceph-mon[39439]: pgmap v2408: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:25.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:25 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1799126817' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]': finished 2024-04-01T20:07:25.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:25 smithi188 ceph-mon[43939]: osdmap e891: 12 total, 12 up, 12 in 2024-04-01T20:07:25.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:25 smithi188 ceph-mon[43939]: pgmap v2408: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:26.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:25 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1799126817' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]': finished 2024-04-01T20:07:26.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:25 smithi062 ceph-mon[44211]: osdmap e891: 12 total, 12 up, 12 in 2024-04-01T20:07:26.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:25 smithi062 ceph-mon[44211]: pgmap v2408: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:27.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:27 smithi022 ceph-mon[39439]: pgmap v2409: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:27.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:27 smithi188 ceph-mon[43939]: pgmap v2409: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:28.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:27 smithi062 ceph-mon[44211]: pgmap v2409: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:28.597 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.10 to 1 (10000) 2024-04-01T20:07:28.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:28 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2871973191' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T20:07:28.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:28 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2871973191' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T20:07:29.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:28 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2871973191' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T20:07:29.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:29 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2871973191' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]': finished 2024-04-01T20:07:29.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:29 smithi022 ceph-mon[39439]: osdmap e892: 12 total, 12 up, 12 in 2024-04-01T20:07:29.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:29 smithi022 ceph-mon[39439]: pgmap v2411: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:29.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:29 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2871973191' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]': finished 2024-04-01T20:07:29.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:29 smithi188 ceph-mon[43939]: osdmap e892: 12 total, 12 up, 12 in 2024-04-01T20:07:29.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:29 smithi188 ceph-mon[43939]: pgmap v2411: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:29 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2871973191' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 10, "weight": 1.0}]': finished 2024-04-01T20:07:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:29 smithi062 ceph-mon[44211]: osdmap e892: 12 total, 12 up, 12 in 2024-04-01T20:07:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:29 smithi062 ceph-mon[44211]: pgmap v2411: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:31.113 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd primary-affinity 10 1 2024-04-01T20:07:31.393 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:07:32.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:31 smithi062 ceph-mon[44211]: pgmap v2412: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:32.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:31 smithi022 ceph-mon[39439]: pgmap v2412: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:32.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:31 smithi188 ceph-mon[43939]: pgmap v2412: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:33.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {auth=29,config=2,health=12,kv=56,logm=1} crc {auth=1438603807,config=1460075751,health=861809967,kv=2032210306,logm=2628414911}) 2024-04-01T20:07:33.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1374638447}) 2024-04-01T20:07:33.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1074149002}) 2024-04-01T20:07:33.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3066310164}) 2024-04-01T20:07:33.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=89645995}) 2024-04-01T20:07:33.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2596037964}) 2024-04-01T20:07:33.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3741035731}) 2024-04-01T20:07:33.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=947555844}) 2024-04-01T20:07:33.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3216708208}) 2024-04-01T20:07:33.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2740123125}) 2024-04-01T20:07:33.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1967379794}) 2024-04-01T20:07:33.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2838075376}) 2024-04-01T20:07:33.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2869836094}) 2024-04-01T20:07:33.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=386439358}) 2024-04-01T20:07:33.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3549130550}) 2024-04-01T20:07:33.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3629132911}) 2024-04-01T20:07:33.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=854555917}) 2024-04-01T20:07:33.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1587902432}) 2024-04-01T20:07:33.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2678737538}) 2024-04-01T20:07:33.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1096604369}) 2024-04-01T20:07:33.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1121480872}) 2024-04-01T20:07:33.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1029040658}) 2024-04-01T20:07:33.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=589872464}) 2024-04-01T20:07:33.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4196874059}) 2024-04-01T20:07:33.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4174913435}) 2024-04-01T20:07:33.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2370870431}) 2024-04-01T20:07:33.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1518329369}) 2024-04-01T20:07:33.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=552493305}) 2024-04-01T20:07:33.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1519987473}) 2024-04-01T20:07:33.365 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1610903898}) 2024-04-01T20:07:33.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1887190167}) 2024-04-01T20:07:33.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1242486115}) 2024-04-01T20:07:33.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4107270505}) 2024-04-01T20:07:33.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2189983904}) 2024-04-01T20:07:33.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1334148079}) 2024-04-01T20:07:33.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=763144442}) 2024-04-01T20:07:33.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3429357974}) 2024-04-01T20:07:33.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=453803444}) 2024-04-01T20:07:33.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=804639289}) 2024-04-01T20:07:33.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3800816694}) 2024-04-01T20:07:33.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2629982753}) 2024-04-01T20:07:33.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2578038950}) 2024-04-01T20:07:33.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4078196292}) 2024-04-01T20:07:33.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=997405498}) 2024-04-01T20:07:33.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1130031115}) 2024-04-01T20:07:33.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3507105988}) 2024-04-01T20:07:33.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1085013431}) 2024-04-01T20:07:33.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1605112557}) 2024-04-01T20:07:33.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=686113726}) 2024-04-01T20:07:33.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=173650121}) 2024-04-01T20:07:33.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3653198933}) 2024-04-01T20:07:33.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4129560820}) 2024-04-01T20:07:33.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3197053429}) 2024-04-01T20:07:33.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3751727433}) 2024-04-01T20:07:33.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4194387222}) 2024-04-01T20:07:33.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1368130453}) 2024-04-01T20:07:33.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3102042521}) 2024-04-01T20:07:33.368 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1478983986}) 2024-04-01T20:07:33.368 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1723422970}) 2024-04-01T20:07:33.368 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2390385477}) 2024-04-01T20:07:33.368 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1616925139}) 2024-04-01T20:07:33.368 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3425122808}) 2024-04-01T20:07:33.368 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4068152948}) 2024-04-01T20:07:33.368 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4163614966}) 2024-04-01T20:07:33.368 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3539225410}) 2024-04-01T20:07:33.368 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1265015240}) 2024-04-01T20:07:33.368 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1738234181}) 2024-04-01T20:07:33.368 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=631689716}) 2024-04-01T20:07:33.368 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2518278256}) 2024-04-01T20:07:33.368 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1092118325}) 2024-04-01T20:07:33.368 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2039299480}) 2024-04-01T20:07:33.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2050171550}) 2024-04-01T20:07:33.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1774364517}) 2024-04-01T20:07:33.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3211950651}) 2024-04-01T20:07:33.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4272082154}) 2024-04-01T20:07:33.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1746346480}) 2024-04-01T20:07:33.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=318994797}) 2024-04-01T20:07:33.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=398672793}) 2024-04-01T20:07:33.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:33 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1284724762}) 2024-04-01T20:07:33.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {auth=29,config=2,health=12,kv=56,logm=1} crc {auth=1438603807,config=1460075751,health=861809967,kv=2032210306,logm=2628414911}) 2024-04-01T20:07:33.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1374638447}) 2024-04-01T20:07:33.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1074149002}) 2024-04-01T20:07:33.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3066310164}) 2024-04-01T20:07:33.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=89645995}) 2024-04-01T20:07:33.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2596037964}) 2024-04-01T20:07:33.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3741035731}) 2024-04-01T20:07:33.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=947555844}) 2024-04-01T20:07:33.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3216708208}) 2024-04-01T20:07:33.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2740123125}) 2024-04-01T20:07:33.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1967379794}) 2024-04-01T20:07:33.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2838075376}) 2024-04-01T20:07:33.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2869836094}) 2024-04-01T20:07:33.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=386439358}) 2024-04-01T20:07:33.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3549130550}) 2024-04-01T20:07:33.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3629132911}) 2024-04-01T20:07:33.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=854555917}) 2024-04-01T20:07:33.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1587902432}) 2024-04-01T20:07:33.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2678737538}) 2024-04-01T20:07:33.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1096604369}) 2024-04-01T20:07:33.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1121480872}) 2024-04-01T20:07:33.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1029040658}) 2024-04-01T20:07:33.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=589872464}) 2024-04-01T20:07:33.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4196874059}) 2024-04-01T20:07:33.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4174913435}) 2024-04-01T20:07:33.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2370870431}) 2024-04-01T20:07:33.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1518329369}) 2024-04-01T20:07:33.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=552493305}) 2024-04-01T20:07:33.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1519987473}) 2024-04-01T20:07:33.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1610903898}) 2024-04-01T20:07:33.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1887190167}) 2024-04-01T20:07:33.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1242486115}) 2024-04-01T20:07:33.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4107270505}) 2024-04-01T20:07:33.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2189983904}) 2024-04-01T20:07:33.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1334148079}) 2024-04-01T20:07:33.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=763144442}) 2024-04-01T20:07:33.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3429357974}) 2024-04-01T20:07:33.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=453803444}) 2024-04-01T20:07:33.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=804639289}) 2024-04-01T20:07:33.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3800816694}) 2024-04-01T20:07:33.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2629982753}) 2024-04-01T20:07:33.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2578038950}) 2024-04-01T20:07:33.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4078196292}) 2024-04-01T20:07:33.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=997405498}) 2024-04-01T20:07:33.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1130031115}) 2024-04-01T20:07:33.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3507105988}) 2024-04-01T20:07:33.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1085013431}) 2024-04-01T20:07:33.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1605112557}) 2024-04-01T20:07:33.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=686113726}) 2024-04-01T20:07:33.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=173650121}) 2024-04-01T20:07:33.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3653198933}) 2024-04-01T20:07:33.516 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4129560820}) 2024-04-01T20:07:33.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3197053429}) 2024-04-01T20:07:33.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3751727433}) 2024-04-01T20:07:33.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4194387222}) 2024-04-01T20:07:33.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1368130453}) 2024-04-01T20:07:33.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3102042521}) 2024-04-01T20:07:33.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1478983986}) 2024-04-01T20:07:33.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1723422970}) 2024-04-01T20:07:33.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2390385477}) 2024-04-01T20:07:33.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1616925139}) 2024-04-01T20:07:33.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3425122808}) 2024-04-01T20:07:33.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4068152948}) 2024-04-01T20:07:33.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4163614966}) 2024-04-01T20:07:33.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3539225410}) 2024-04-01T20:07:33.517 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1265015240}) 2024-04-01T20:07:33.518 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1738234181}) 2024-04-01T20:07:33.518 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=631689716}) 2024-04-01T20:07:33.518 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2518278256}) 2024-04-01T20:07:33.518 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1092118325}) 2024-04-01T20:07:33.518 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2039299480}) 2024-04-01T20:07:33.518 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2050171550}) 2024-04-01T20:07:33.518 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1774364517}) 2024-04-01T20:07:33.518 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3211950651}) 2024-04-01T20:07:33.518 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4272082154}) 2024-04-01T20:07:33.518 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1746346480}) 2024-04-01T20:07:33.518 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=318994797}) 2024-04-01T20:07:33.518 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=398672793}) 2024-04-01T20:07:33.518 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:33 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1284724762}) 2024-04-01T20:07:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {auth=29,config=2,health=12,kv=56,logm=1} crc {auth=1438603807,config=1460075751,health=861809967,kv=2032210306,logm=2628414911}) 2024-04-01T20:07:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1374638447}) 2024-04-01T20:07:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1074149002}) 2024-04-01T20:07:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3066310164}) 2024-04-01T20:07:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=89645995}) 2024-04-01T20:07:33.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2596037964}) 2024-04-01T20:07:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3741035731}) 2024-04-01T20:07:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=947555844}) 2024-04-01T20:07:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3216708208}) 2024-04-01T20:07:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2740123125}) 2024-04-01T20:07:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1967379794}) 2024-04-01T20:07:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2838075376}) 2024-04-01T20:07:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2869836094}) 2024-04-01T20:07:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=386439358}) 2024-04-01T20:07:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3549130550}) 2024-04-01T20:07:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3629132911}) 2024-04-01T20:07:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=854555917}) 2024-04-01T20:07:33.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1587902432}) 2024-04-01T20:07:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2678737538}) 2024-04-01T20:07:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1096604369}) 2024-04-01T20:07:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1121480872}) 2024-04-01T20:07:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1029040658}) 2024-04-01T20:07:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=589872464}) 2024-04-01T20:07:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4196874059}) 2024-04-01T20:07:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4174913435}) 2024-04-01T20:07:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2370870431}) 2024-04-01T20:07:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1518329369}) 2024-04-01T20:07:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=552493305}) 2024-04-01T20:07:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1519987473}) 2024-04-01T20:07:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1610903898}) 2024-04-01T20:07:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1887190167}) 2024-04-01T20:07:33.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1242486115}) 2024-04-01T20:07:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4107270505}) 2024-04-01T20:07:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2189983904}) 2024-04-01T20:07:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1334148079}) 2024-04-01T20:07:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=763144442}) 2024-04-01T20:07:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3429357974}) 2024-04-01T20:07:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=453803444}) 2024-04-01T20:07:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=804639289}) 2024-04-01T20:07:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3800816694}) 2024-04-01T20:07:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2629982753}) 2024-04-01T20:07:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2578038950}) 2024-04-01T20:07:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4078196292}) 2024-04-01T20:07:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=997405498}) 2024-04-01T20:07:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1130031115}) 2024-04-01T20:07:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3507105988}) 2024-04-01T20:07:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1085013431}) 2024-04-01T20:07:33.629 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1605112557}) 2024-04-01T20:07:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=686113726}) 2024-04-01T20:07:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=173650121}) 2024-04-01T20:07:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3653198933}) 2024-04-01T20:07:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4129560820}) 2024-04-01T20:07:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3197053429}) 2024-04-01T20:07:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3751727433}) 2024-04-01T20:07:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4194387222}) 2024-04-01T20:07:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1368130453}) 2024-04-01T20:07:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3102042521}) 2024-04-01T20:07:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1478983986}) 2024-04-01T20:07:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1723422970}) 2024-04-01T20:07:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2390385477}) 2024-04-01T20:07:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1616925139}) 2024-04-01T20:07:33.630 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3425122808}) 2024-04-01T20:07:33.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4068152948}) 2024-04-01T20:07:33.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4163614966}) 2024-04-01T20:07:33.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3539225410}) 2024-04-01T20:07:33.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1265015240}) 2024-04-01T20:07:33.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1738234181}) 2024-04-01T20:07:33.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=631689716}) 2024-04-01T20:07:33.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2518278256}) 2024-04-01T20:07:33.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1092118325}) 2024-04-01T20:07:33.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2039299480}) 2024-04-01T20:07:33.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2050171550}) 2024-04-01T20:07:33.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1774364517}) 2024-04-01T20:07:33.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3211950651}) 2024-04-01T20:07:33.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=4272082154}) 2024-04-01T20:07:33.631 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1746346480}) 2024-04-01T20:07:33.632 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=318994797}) 2024-04-01T20:07:33.632 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=398672793}) 2024-04-01T20:07:33.632 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:33 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1284724762}) 2024-04-01T20:07:34.136 INFO:teuthology.orchestra.run.smithi022.stderr:set osd.10 primary-affinity to 1 (8655362) 2024-04-01T20:07:34.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3685125200}) 2024-04-01T20:07:34.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3054646746}) 2024-04-01T20:07:34.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1888254768}) 2024-04-01T20:07:34.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2340377874}) 2024-04-01T20:07:34.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2497803192}) 2024-04-01T20:07:34.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1676713163}) 2024-04-01T20:07:34.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=93445499}) 2024-04-01T20:07:34.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3950795759}) 2024-04-01T20:07:34.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3171487275}) 2024-04-01T20:07:34.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1166738969}) 2024-04-01T20:07:34.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2156234474}) 2024-04-01T20:07:34.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3522211601}) 2024-04-01T20:07:34.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=499903826}) 2024-04-01T20:07:34.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2640288749}) 2024-04-01T20:07:34.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2674817298}) 2024-04-01T20:07:34.513 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1644294903}) 2024-04-01T20:07:34.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2934745339}) 2024-04-01T20:07:34.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1508650859}) 2024-04-01T20:07:34.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2959956}) 2024-04-01T20:07:34.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2611693002}) 2024-04-01T20:07:34.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3182493672}) 2024-04-01T20:07:34.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2882883505}) 2024-04-01T20:07:34.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=19097217}) 2024-04-01T20:07:34.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3653890953}) 2024-04-01T20:07:34.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3236060651}) 2024-04-01T20:07:34.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3111497800}) 2024-04-01T20:07:34.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1112560639}) 2024-04-01T20:07:34.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {logm=93,mdsmap=3,mgr=4} crc {logm=1635420475,mdsmap=2840952586,mgr=136155593}) 2024-04-01T20:07:34.514 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mgr=14,mgr_command_descs=1,mgr_metadata=2,mgrstat=14,mon_config_key=69} crc {mgr=560168232,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=3581756870,mon_config_key=2999758455}) 2024-04-01T20:07:34.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=2104156730}) 2024-04-01T20:07:34.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=594769403}) 2024-04-01T20:07:34.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=23,monmap=5,osd_metadata=12,osd_pg_creating=1,osdmap=59} crc {mon_config_key=3023547459,monmap=3338646291,osd_metadata=1655558010,osd_pg_creating=242733651,osdmap=2972938392}) 2024-04-01T20:07:34.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=50} crc {osdmap=1393503491}) 2024-04-01T20:07:34.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/378214931' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T20:07:34.515 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:34 smithi062 ceph-mon[44211]: pgmap v2413: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:34.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3685125200}) 2024-04-01T20:07:34.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3054646746}) 2024-04-01T20:07:34.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1888254768}) 2024-04-01T20:07:34.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2340377874}) 2024-04-01T20:07:34.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2497803192}) 2024-04-01T20:07:34.556 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1676713163}) 2024-04-01T20:07:34.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=93445499}) 2024-04-01T20:07:34.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3950795759}) 2024-04-01T20:07:34.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3171487275}) 2024-04-01T20:07:34.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1166738969}) 2024-04-01T20:07:34.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2156234474}) 2024-04-01T20:07:34.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3522211601}) 2024-04-01T20:07:34.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=499903826}) 2024-04-01T20:07:34.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2640288749}) 2024-04-01T20:07:34.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2674817298}) 2024-04-01T20:07:34.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1644294903}) 2024-04-01T20:07:34.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2934745339}) 2024-04-01T20:07:34.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1508650859}) 2024-04-01T20:07:34.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2959956}) 2024-04-01T20:07:34.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2611693002}) 2024-04-01T20:07:34.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3182493672}) 2024-04-01T20:07:34.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2882883505}) 2024-04-01T20:07:34.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=19097217}) 2024-04-01T20:07:34.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3653890953}) 2024-04-01T20:07:34.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3236060651}) 2024-04-01T20:07:34.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3111497800}) 2024-04-01T20:07:34.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1112560639}) 2024-04-01T20:07:34.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {logm=93,mdsmap=3,mgr=4} crc {logm=1635420475,mdsmap=2840952586,mgr=136155593}) 2024-04-01T20:07:34.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mgr=14,mgr_command_descs=1,mgr_metadata=2,mgrstat=14,mon_config_key=69} crc {mgr=560168232,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=3581756870,mon_config_key=2999758455}) 2024-04-01T20:07:34.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=2104156730}) 2024-04-01T20:07:34.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=594769403}) 2024-04-01T20:07:34.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=23,monmap=5,osd_metadata=12,osd_pg_creating=1,osdmap=59} crc {mon_config_key=3023547459,monmap=3338646291,osd_metadata=1655558010,osd_pg_creating=242733651,osdmap=2972938392}) 2024-04-01T20:07:34.558 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=50} crc {osdmap=1393503491}) 2024-04-01T20:07:34.559 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/378214931' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T20:07:34.559 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:34 smithi022 ceph-mon[39439]: pgmap v2413: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:34.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3685125200}) 2024-04-01T20:07:34.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3054646746}) 2024-04-01T20:07:34.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1888254768}) 2024-04-01T20:07:34.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2340377874}) 2024-04-01T20:07:34.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2497803192}) 2024-04-01T20:07:34.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1676713163}) 2024-04-01T20:07:34.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=93445499}) 2024-04-01T20:07:34.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3950795759}) 2024-04-01T20:07:34.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3171487275}) 2024-04-01T20:07:34.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1166738969}) 2024-04-01T20:07:34.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2156234474}) 2024-04-01T20:07:34.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3522211601}) 2024-04-01T20:07:34.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=499903826}) 2024-04-01T20:07:34.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2640288749}) 2024-04-01T20:07:34.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2674817298}) 2024-04-01T20:07:34.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1644294903}) 2024-04-01T20:07:34.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2934745339}) 2024-04-01T20:07:34.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1508650859}) 2024-04-01T20:07:34.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2959956}) 2024-04-01T20:07:34.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2611693002}) 2024-04-01T20:07:34.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3182493672}) 2024-04-01T20:07:34.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=2882883505}) 2024-04-01T20:07:34.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=19097217}) 2024-04-01T20:07:34.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3653890953}) 2024-04-01T20:07:34.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3236060651}) 2024-04-01T20:07:34.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=3111497800}) 2024-04-01T20:07:34.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=100} crc {logm=1112560639}) 2024-04-01T20:07:34.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {logm=93,mdsmap=3,mgr=4} crc {logm=1635420475,mdsmap=2840952586,mgr=136155593}) 2024-04-01T20:07:34.627 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mgr=14,mgr_command_descs=1,mgr_metadata=2,mgrstat=14,mon_config_key=69} crc {mgr=560168232,mgr_command_descs=4048473490,mgr_metadata=3075114321,mgrstat=3581756870,mon_config_key=2999758455}) 2024-04-01T20:07:34.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=2104156730}) 2024-04-01T20:07:34.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=100} crc {mon_config_key=594769403}) 2024-04-01T20:07:34.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {mon_config_key=23,monmap=5,osd_metadata=12,osd_pg_creating=1,osdmap=59} crc {mon_config_key=3023547459,monmap=3338646291,osd_metadata=1655558010,osd_pg_creating=242733651,osdmap=2972938392}) 2024-04-01T20:07:34.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: scrub ok on 0,1,2: ScrubResult(keys {osdmap=50} crc {osdmap=1393503491}) 2024-04-01T20:07:34.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/378214931' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 10, "weight": 1.0}]: dispatch 2024-04-01T20:07:34.628 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:34 smithi188 ceph-mon[43939]: pgmap v2413: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:34.867 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd reweight 3 1 2024-04-01T20:07:35.151 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:07:35.391 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:35 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/378214931' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 10, "weight": 1.0}]': finished 2024-04-01T20:07:35.391 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:35 smithi022 ceph-mon[39439]: osdmap e893: 12 total, 12 up, 12 in 2024-04-01T20:07:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:35 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/378214931' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 10, "weight": 1.0}]': finished 2024-04-01T20:07:35.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:35 smithi062 ceph-mon[44211]: osdmap e893: 12 total, 12 up, 12 in 2024-04-01T20:07:35.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:35 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/378214931' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 10, "weight": 1.0}]': finished 2024-04-01T20:07:35.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:35 smithi188 ceph-mon[43939]: osdmap e893: 12 total, 12 up, 12 in 2024-04-01T20:07:36.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:36 smithi022 ceph-mon[39439]: pgmap v2415: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:36.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:36 smithi062 ceph-mon[44211]: pgmap v2415: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:36.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:36 smithi188 ceph-mon[43939]: pgmap v2415: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:37.332 INFO:teuthology.orchestra.run.smithi022.stderr:reweighted osd.3 to 1 (10000) 2024-04-01T20:07:37.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:37 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1880155212' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T20:07:37.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:37 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1880155212' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T20:07:37.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:37 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1880155212' entity='client.admin' cmd=[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T20:07:38.231 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd primary-affinity 3 1 2024-04-01T20:07:38.514 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:07:38.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:38 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1880155212' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-04-01T20:07:38.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:38 smithi022 ceph-mon[39439]: osdmap e894: 12 total, 12 up, 12 in 2024-04-01T20:07:38.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:38 smithi022 ceph-mon[39439]: pgmap v2417: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:38.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:38 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1880155212' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-04-01T20:07:38.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:38 smithi188 ceph-mon[43939]: osdmap e894: 12 total, 12 up, 12 in 2024-04-01T20:07:38.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:38 smithi188 ceph-mon[43939]: pgmap v2417: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:38.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:38 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1880155212' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2024-04-01T20:07:38.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:38 smithi062 ceph-mon[44211]: osdmap e894: 12 total, 12 up, 12 in 2024-04-01T20:07:38.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:38 smithi062 ceph-mon[44211]: pgmap v2417: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:39.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:39 smithi022 ceph-mon[39439]: pgmap v2418: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:39 smithi188 ceph-mon[43939]: pgmap v2418: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:40.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:39 smithi062 ceph-mon[44211]: pgmap v2418: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:40.600 INFO:teuthology.orchestra.run.smithi022.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-04-01T20:07:40.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:40 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2418550628' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T20:07:40.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:40 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2418550628' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T20:07:41.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:40 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2418550628' entity='client.admin' cmd=[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]: dispatch 2024-04-01T20:07:41.390 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-01T20:07:41.390 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-01T20:07:41.391 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-01T20:07:41.391 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-01T20:07:41.391 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-01T20:07:41.391 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-04-01T20:07:41.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:41 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2418550628' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]': finished 2024-04-01T20:07:41.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:41 smithi022 ceph-mon[39439]: osdmap e895: 12 total, 12 up, 12 in 2024-04-01T20:07:41.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:41 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:07:41.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:41 smithi022 ceph-mon[39439]: pgmap v2420: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:41.684 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:07:41.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:41 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2418550628' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]': finished 2024-04-01T20:07:41.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:41 smithi188 ceph-mon[43939]: osdmap e895: 12 total, 12 up, 12 in 2024-04-01T20:07:41.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:41 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:07:41.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:41 smithi188 ceph-mon[43939]: pgmap v2420: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:42.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:41 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2418550628' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]': finished 2024-04-01T20:07:42.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:41 smithi062 ceph-mon[44211]: osdmap e895: 12 total, 12 up, 12 in 2024-04-01T20:07:42.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:41 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:07:42.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:41 smithi062 ceph-mon[44211]: pgmap v2420: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:42.941 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:42 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:07:42.941 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:42 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:07:42.941 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:42 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:07:43.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:42 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:07:43.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:42 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:07:43.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:42 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:07:43.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:42 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:07:43.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:42 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:07:43.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:42 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:07:43.861 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T20:07:43.861 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":895,"fsid":"09f6b846-f05c-11ee-b647-cb9ed24678a4","created":"2024-04-01T19:15:34.344221+0000","modified":"2024-04-01T20:07:40.590719+0000","last_up_change":"2024-04-01T20:05:46.586550+0000","last_in_change":"2024-04-01T20:06:06.861401+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":34,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T19:18:34.605751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfd4aa7e-a933-42e2-aac8-f93a3d9fcc3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":687,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":1419201649}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":1419201649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":1419201649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":1419201649}]},"public_addr":"172.21.15.22:6801/1419201649","cluster_addr":"172.21.15.22:6802/1419201649","heartbeat_back_addr":"172.21.15.22:6804/1419201649","heartbeat_front_addr":"172.21.15.22:6803/1419201649","state":["exists","up"]},{"osd":1,"uuid":"6ddadf19-2b4e-4c01-8918-9d51c323925b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":534,"up_from":571,"up_thru":793,"down_at":535,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":3304599570}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":3304599570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6808","nonce":3304599570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":3304599570}]},"public_addr":"172.21.15.22:6805/3304599570","cluster_addr":"172.21.15.22:6806/3304599570","heartbeat_back_addr":"172.21.15.22:6808/3304599570","heartbeat_front_addr":"172.21.15.22:6807/3304599570","state":["exists","up"]},{"osd":2,"uuid":"4af1f44c-f47c-4ce6-87ba-1aeec3960969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":560,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":835455757}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":835455757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":835455757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":835455757}]},"public_addr":"172.21.15.22:6809/835455757","cluster_addr":"172.21.15.22:6810/835455757","heartbeat_back_addr":"172.21.15.22:6812/835455757","heartbeat_front_addr":"172.21.15.22:6811/835455757","state":["exists","up"]},{"osd":3,"uuid":"c399f336-23c7-414a-822e-63793daf85c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":832,"up_from":855,"up_thru":735,"down_at":833,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":1381750921}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":1381750921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":1381750921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":1381750921}]},"public_addr":"172.21.15.22:6813/1381750921","cluster_addr":"172.21.15.22:6814/1381750921","heartbeat_back_addr":"172.21.15.22:6816/1381750921","heartbeat_front_addr":"172.21.15.22:6815/1381750921","state":["exists","up"]},{"osd":4,"uuid":"0a2690dc-e5b6-4d29-b517-980018519d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":800,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6800","nonce":2408168690}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6801","nonce":2408168690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6803","nonce":2408168690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6802","nonce":2408168690}]},"public_addr":"172.21.15.62:6800/2408168690","cluster_addr":"172.21.15.62:6801/2408168690","heartbeat_back_addr":"172.21.15.62:6803/2408168690","heartbeat_front_addr":"172.21.15.62:6802/2408168690","state":["exists","up"]},{"osd":5,"uuid":"c6830412-959a-4f1e-8c3d-f4b2d88673e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":806,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6804","nonce":386874616}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6805","nonce":386874616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6807","nonce":386874616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6806","nonce":386874616}]},"public_addr":"172.21.15.62:6804/386874616","cluster_addr":"172.21.15.62:6805/386874616","heartbeat_back_addr":"172.21.15.62:6807/386874616","heartbeat_front_addr":"172.21.15.62:6806/386874616","state":["exists","up"]},{"osd":6,"uuid":"f646310b-91a4-4259-a51f-6a0e92b7cba8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":335,"last_clean_end":421,"up_from":457,"up_thru":560,"down_at":422,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6808","nonce":2644974032}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6809","nonce":2644974032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6811","nonce":2644974032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6810","nonce":2644974032}]},"public_addr":"172.21.15.62:6808/2644974032","cluster_addr":"172.21.15.62:6809/2644974032","heartbeat_back_addr":"172.21.15.62:6811/2644974032","heartbeat_front_addr":"172.21.15.62:6810/2644974032","state":["exists","up"]},{"osd":7,"uuid":"afe5f371-c892-43e9-b82e-c2d911354e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":862,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6812","nonce":2055487337}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6813","nonce":2055487337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6815","nonce":2055487337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6814","nonce":2055487337}]},"public_addr":"172.21.15.62:6812/2055487337","cluster_addr":"172.21.15.62:6813/2055487337","heartbeat_back_addr":"172.21.15.62:6815/2055487337","heartbeat_front_addr":"172.21.15.62:6814/2055487337","state":["exists","up"]},{"osd":8,"uuid":"b7eb6461-f6fa-4a12-864c-6e6748e6337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":63,"last_clean_end":159,"up_from":197,"up_thru":793,"down_at":160,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6800","nonce":1873408265}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6801","nonce":1873408265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6803","nonce":1873408265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6802","nonce":1873408265}]},"public_addr":"172.21.15.188:6800/1873408265","cluster_addr":"172.21.15.188:6801/1873408265","heartbeat_back_addr":"172.21.15.188:6803/1873408265","heartbeat_front_addr":"172.21.15.188:6802/1873408265","state":["exists","up"]},{"osd":9,"uuid":"7d496ad5-46bf-485a-81d9-2b9da2a59882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":804,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6804","nonce":1755990887}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6805","nonce":1755990887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6807","nonce":1755990887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6806","nonce":1755990887}]},"public_addr":"172.21.15.188:6804/1755990887","cluster_addr":"172.21.15.188:6805/1755990887","heartbeat_back_addr":"172.21.15.188:6807/1755990887","heartbeat_front_addr":"172.21.15.188:6806/1755990887","state":["exists","up"]},{"osd":10,"uuid":"6cbb80ce-37f7-48df-9090-09a6068e4490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":77,"last_clean_end":679,"up_from":762,"up_thru":644,"down_at":680,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6808","nonce":260531768}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6809","nonce":260531768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6811","nonce":260531768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6810","nonce":260531768}]},"public_addr":"172.21.15.188:6808/260531768","cluster_addr":"172.21.15.188:6809/260531768","heartbeat_back_addr":"172.21.15.188:6811/260531768","heartbeat_front_addr":"172.21.15.188:6810/260531768","state":["exists","up"]},{"osd":11,"uuid":"c03517c4-fdb0-4587-96c1-b959041c4344","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":735,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6812","nonce":3987199514}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6813","nonce":3987199514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6815","nonce":3987199514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6814","nonce":3987199514}]},"public_addr":"172.21.15.188:6812/3987199514","cluster_addr":"172.21.15.188:6813/3987199514","heartbeat_back_addr":"172.21.15.188:6815/3987199514","heartbeat_front_addr":"172.21.15.188:6814/3987199514","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:06:38.845923+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:06:37.711908+0000","dead_epoch":534},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:07:08.832164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:07:15.481968+0000","dead_epoch":832},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:06:50.687956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:06:37.779534+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:06:36.615291+0000","dead_epoch":421},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:07:01.092430+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:06:44.012637+0000","dead_epoch":159},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:06:50.868765+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:07:01.499956+0000","dead_epoch":679},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:06:59.651485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/3735983556":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/3575578250":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/2493529775":"2024-04-02T19:16:02.302343+0000","172.21.15.22:6800/2678666836":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/2389537847":"2024-04-02T19:16:02.302343+0000","172.21.15.22:0/798807675":"2024-04-02T19:16:02.302343+0000","172.21.15.22:6800/1090179981":"2024-04-02T19:16:02.302343+0000","172.21.15.22:0/51907384":"2024-04-02T19:16:30.513384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T20:07:44.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:43 smithi062 ceph-mon[44211]: pgmap v2421: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:44.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:43 smithi022 ceph-mon[39439]: pgmap v2421: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:44.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:43 smithi188 ceph-mon[43939]: pgmap v2421: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:44.634 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-01T20:07:44.635 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-04-01T20:07:44.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:44 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2745625963' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T20:07:44.912 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:07:45.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:44 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2745625963' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T20:07:45.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:44 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2745625963' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T20:07:45.857 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:45 smithi022 ceph-mon[39439]: pgmap v2422: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:46.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:45 smithi062 ceph-mon[44211]: pgmap v2422: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:46.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:45 smithi188 ceph-mon[43939]: pgmap v2422: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:47.095 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T20:07:47.096 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":895,"fsid":"09f6b846-f05c-11ee-b647-cb9ed24678a4","created":"2024-04-01T19:15:34.344221+0000","modified":"2024-04-01T20:07:40.590719+0000","last_up_change":"2024-04-01T20:05:46.586550+0000","last_in_change":"2024-04-01T20:06:06.861401+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":34,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T19:18:34.605751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfd4aa7e-a933-42e2-aac8-f93a3d9fcc3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":687,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":1419201649}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":1419201649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":1419201649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":1419201649}]},"public_addr":"172.21.15.22:6801/1419201649","cluster_addr":"172.21.15.22:6802/1419201649","heartbeat_back_addr":"172.21.15.22:6804/1419201649","heartbeat_front_addr":"172.21.15.22:6803/1419201649","state":["exists","up"]},{"osd":1,"uuid":"6ddadf19-2b4e-4c01-8918-9d51c323925b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":534,"up_from":571,"up_thru":793,"down_at":535,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":3304599570}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":3304599570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6808","nonce":3304599570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":3304599570}]},"public_addr":"172.21.15.22:6805/3304599570","cluster_addr":"172.21.15.22:6806/3304599570","heartbeat_back_addr":"172.21.15.22:6808/3304599570","heartbeat_front_addr":"172.21.15.22:6807/3304599570","state":["exists","up"]},{"osd":2,"uuid":"4af1f44c-f47c-4ce6-87ba-1aeec3960969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":560,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":835455757}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":835455757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":835455757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":835455757}]},"public_addr":"172.21.15.22:6809/835455757","cluster_addr":"172.21.15.22:6810/835455757","heartbeat_back_addr":"172.21.15.22:6812/835455757","heartbeat_front_addr":"172.21.15.22:6811/835455757","state":["exists","up"]},{"osd":3,"uuid":"c399f336-23c7-414a-822e-63793daf85c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":832,"up_from":855,"up_thru":735,"down_at":833,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":1381750921}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":1381750921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":1381750921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":1381750921}]},"public_addr":"172.21.15.22:6813/1381750921","cluster_addr":"172.21.15.22:6814/1381750921","heartbeat_back_addr":"172.21.15.22:6816/1381750921","heartbeat_front_addr":"172.21.15.22:6815/1381750921","state":["exists","up"]},{"osd":4,"uuid":"0a2690dc-e5b6-4d29-b517-980018519d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":800,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6800","nonce":2408168690}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6801","nonce":2408168690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6803","nonce":2408168690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6802","nonce":2408168690}]},"public_addr":"172.21.15.62:6800/2408168690","cluster_addr":"172.21.15.62:6801/2408168690","heartbeat_back_addr":"172.21.15.62:6803/2408168690","heartbeat_front_addr":"172.21.15.62:6802/2408168690","state":["exists","up"]},{"osd":5,"uuid":"c6830412-959a-4f1e-8c3d-f4b2d88673e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":806,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6804","nonce":386874616}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6805","nonce":386874616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6807","nonce":386874616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6806","nonce":386874616}]},"public_addr":"172.21.15.62:6804/386874616","cluster_addr":"172.21.15.62:6805/386874616","heartbeat_back_addr":"172.21.15.62:6807/386874616","heartbeat_front_addr":"172.21.15.62:6806/386874616","state":["exists","up"]},{"osd":6,"uuid":"f646310b-91a4-4259-a51f-6a0e92b7cba8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":335,"last_clean_end":421,"up_from":457,"up_thru":560,"down_at":422,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6808","nonce":2644974032}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6809","nonce":2644974032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6811","nonce":2644974032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6810","nonce":2644974032}]},"public_addr":"172.21.15.62:6808/2644974032","cluster_addr":"172.21.15.62:6809/2644974032","heartbeat_back_addr":"172.21.15.62:6811/2644974032","heartbeat_front_addr":"172.21.15.62:6810/2644974032","state":["exists","up"]},{"osd":7,"uuid":"afe5f371-c892-43e9-b82e-c2d911354e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":862,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6812","nonce":2055487337}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6813","nonce":2055487337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6815","nonce":2055487337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6814","nonce":2055487337}]},"public_addr":"172.21.15.62:6812/2055487337","cluster_addr":"172.21.15.62:6813/2055487337","heartbeat_back_addr":"172.21.15.62:6815/2055487337","heartbeat_front_addr":"172.21.15.62:6814/2055487337","state":["exists","up"]},{"osd":8,"uuid":"b7eb6461-f6fa-4a12-864c-6e6748e6337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":63,"last_clean_end":159,"up_from":197,"up_thru":793,"down_at":160,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6800","nonce":1873408265}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6801","nonce":1873408265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6803","nonce":1873408265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6802","nonce":1873408265}]},"public_addr":"172.21.15.188:6800/1873408265","cluster_addr":"172.21.15.188:6801/1873408265","heartbeat_back_addr":"172.21.15.188:6803/1873408265","heartbeat_front_addr":"172.21.15.188:6802/1873408265","state":["exists","up"]},{"osd":9,"uuid":"7d496ad5-46bf-485a-81d9-2b9da2a59882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":804,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6804","nonce":1755990887}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6805","nonce":1755990887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6807","nonce":1755990887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6806","nonce":1755990887}]},"public_addr":"172.21.15.188:6804/1755990887","cluster_addr":"172.21.15.188:6805/1755990887","heartbeat_back_addr":"172.21.15.188:6807/1755990887","heartbeat_front_addr":"172.21.15.188:6806/1755990887","state":["exists","up"]},{"osd":10,"uuid":"6cbb80ce-37f7-48df-9090-09a6068e4490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":77,"last_clean_end":679,"up_from":762,"up_thru":644,"down_at":680,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6808","nonce":260531768}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6809","nonce":260531768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6811","nonce":260531768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6810","nonce":260531768}]},"public_addr":"172.21.15.188:6808/260531768","cluster_addr":"172.21.15.188:6809/260531768","heartbeat_back_addr":"172.21.15.188:6811/260531768","heartbeat_front_addr":"172.21.15.188:6810/260531768","state":["exists","up"]},{"osd":11,"uuid":"c03517c4-fdb0-4587-96c1-b959041c4344","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":735,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6812","nonce":3987199514}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6813","nonce":3987199514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6815","nonce":3987199514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6814","nonce":3987199514}]},"public_addr":"172.21.15.188:6812/3987199514","cluster_addr":"172.21.15.188:6813/3987199514","heartbeat_back_addr":"172.21.15.188:6815/3987199514","heartbeat_front_addr":"172.21.15.188:6814/3987199514","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:06:38.845923+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:06:37.711908+0000","dead_epoch":534},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:07:08.832164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:07:15.481968+0000","dead_epoch":832},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:06:50.687956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:06:37.779534+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:06:36.615291+0000","dead_epoch":421},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:07:01.092430+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:06:44.012637+0000","dead_epoch":159},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:06:50.868765+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:07:01.499956+0000","dead_epoch":679},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T20:06:59.651485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/3735983556":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/3575578250":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/2493529775":"2024-04-02T19:16:02.302343+0000","172.21.15.22:6800/2678666836":"2024-04-02T19:16:30.513384+0000","172.21.15.22:0/2389537847":"2024-04-02T19:16:02.302343+0000","172.21.15.22:0/798807675":"2024-04-02T19:16:02.302343+0000","172.21.15.22:6800/1090179981":"2024-04-02T19:16:02.302343+0000","172.21.15.22:0/51907384":"2024-04-02T19:16:30.513384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T20:07:47.481 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:47 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/317300398' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T20:07:47.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:47 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/317300398' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T20:07:47.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:47 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/317300398' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T20:07:47.779 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.0 flush_pg_stats 2024-04-01T20:07:47.779 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.1 flush_pg_stats 2024-04-01T20:07:47.780 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.2 flush_pg_stats 2024-04-01T20:07:47.780 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.3 flush_pg_stats 2024-04-01T20:07:47.780 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.4 flush_pg_stats 2024-04-01T20:07:47.781 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.5 flush_pg_stats 2024-04-01T20:07:47.781 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.6 flush_pg_stats 2024-04-01T20:07:47.782 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.7 flush_pg_stats 2024-04-01T20:07:47.782 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.8 flush_pg_stats 2024-04-01T20:07:47.783 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.9 flush_pg_stats 2024-04-01T20:07:47.783 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.10 flush_pg_stats 2024-04-01T20:07:47.784 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph tell osd.11 flush_pg_stats 2024-04-01T20:07:48.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:48 smithi062 ceph-mon[44211]: pgmap v2423: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:48.532 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:07:48.540 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:07:48.549 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:07:48.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:48 smithi022 ceph-mon[39439]: pgmap v2423: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:48.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:48 smithi188 ceph-mon[43939]: pgmap v2423: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:49.162 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:07:49.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:49 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:07:49.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:49 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:07:49.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:49 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:07:49.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:49 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:07:49.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:49 smithi062 ceph-mon[44211]: osdmap e896: 12 total, 12 up, 12 in 2024-04-01T20:07:49.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:49 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:07:49.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:49 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:07:49.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:49 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:07:49.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:49 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:07:49.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:49 smithi022 ceph-mon[39439]: osdmap e896: 12 total, 12 up, 12 in 2024-04-01T20:07:49.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:49 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:07:49.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:49 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:07:49.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:49 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:07:49.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:49 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:07:49.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:49 smithi188 ceph-mon[43939]: osdmap e896: 12 total, 12 up, 12 in 2024-04-01T20:07:50.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:50 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:07:50.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:50 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:07:50.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:50 smithi022 ceph-mon[39439]: osdmap e897: 12 total, 12 up, 12 in 2024-04-01T20:07:50.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:50 smithi022 ceph-mon[39439]: pgmap v2426: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:50.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:50 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:07:50.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:50 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:07:50.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:50 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:07:50.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:50 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:07:50.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:50 smithi062 ceph-mon[44211]: osdmap e897: 12 total, 12 up, 12 in 2024-04-01T20:07:50.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:50 smithi062 ceph-mon[44211]: pgmap v2426: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:50.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:50 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:07:50.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:50 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:07:50.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:50 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:07:50.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:50 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:07:50.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:50 smithi188 ceph-mon[43939]: osdmap e897: 12 total, 12 up, 12 in 2024-04-01T20:07:50.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:50 smithi188 ceph-mon[43939]: pgmap v2426: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:50.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:50 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:07:50.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:50 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:07:51.091 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:07:51.092 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:07:51.092 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:07:51.092 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:07:51.093 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:07:51.093 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:07:51.096 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:07:51.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:51 smithi062 ceph-mon[44211]: osdmap e898: 12 total, 12 up, 12 in 2024-04-01T20:07:51.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:51 smithi022 ceph-mon[39439]: osdmap e898: 12 total, 12 up, 12 in 2024-04-01T20:07:51.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:51 smithi188 ceph-mon[43939]: osdmap e898: 12 total, 12 up, 12 in 2024-04-01T20:07:52.522 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:52 smithi022 ceph-mon[39439]: pgmap v2428: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:52.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:52 smithi188 ceph-mon[43939]: pgmap v2428: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:52.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:52 smithi062 ceph-mon[44211]: pgmap v2428: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:53.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:53 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:07:53.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:53 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:07:53.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:53 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:07:53.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:53 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:07:53.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:53 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:07:53.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:53 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:07:54.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:54 smithi022 ceph-mon[39439]: osdmap e899: 12 total, 12 up, 12 in 2024-04-01T20:07:54.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:54 smithi022 ceph-mon[39439]: pgmap v2430: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:54.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:54 smithi188 ceph-mon[43939]: osdmap e899: 12 total, 12 up, 12 in 2024-04-01T20:07:54.626 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:54 smithi188 ceph-mon[43939]: pgmap v2430: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:54.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:54 smithi062 ceph-mon[44211]: osdmap e899: 12 total, 12 up, 12 in 2024-04-01T20:07:54.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:54 smithi062 ceph-mon[44211]: pgmap v2430: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:55.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:55 smithi022 ceph-mon[39439]: pgmap v2431: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:55.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:55 smithi188 ceph-mon[43939]: pgmap v2431: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:56.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:55 smithi062 ceph-mon[44211]: pgmap v2431: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:58.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:57 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:07:58.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:57 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:07:58.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:57 smithi062 ceph-mon[44211]: osdmap e900: 12 total, 12 up, 12 in 2024-04-01T20:07:58.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:57 smithi062 ceph-mon[44211]: pgmap v2433: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:58.035 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:57 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:07:58.035 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:57 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:07:58.035 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:57 smithi022 ceph-mon[39439]: osdmap e900: 12 total, 12 up, 12 in 2024-04-01T20:07:58.035 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:57 smithi022 ceph-mon[39439]: pgmap v2433: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:58.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:57 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:07:58.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:57 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:07:58.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:57 smithi188 ceph-mon[43939]: osdmap e900: 12 total, 12 up, 12 in 2024-04-01T20:07:58.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:57 smithi188 ceph-mon[43939]: pgmap v2433: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:58.406 INFO:teuthology.orchestra.run.smithi022.stdout:1962800054562 2024-04-01T20:07:58.407 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.6 2024-04-01T20:07:58.709 INFO:teuthology.orchestra.run.smithi022.stdout:85899346511 2024-04-01T20:07:58.710 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.2 2024-04-01T20:07:59.584 INFO:teuthology.orchestra.run.smithi022.stdout:34359738971 2024-04-01T20:07:59.585 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.0 2024-04-01T20:07:59.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:07:59 smithi022 ceph-mon[39439]: pgmap v2434: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:07:59.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:07:59 smithi188 ceph-mon[43939]: pgmap v2434: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:00.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:07:59 smithi062 ceph-mon[44211]: pgmap v2434: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:01.411 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:08:01.906 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:01 smithi022 ceph-mon[39439]: pgmap v2435: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:02.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:01 smithi062 ceph-mon[44211]: pgmap v2435: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:02.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:01 smithi188 ceph-mon[43939]: pgmap v2435: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:03.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:03 smithi022 ceph-mon[39439]: pgmap v2436: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:03.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:03 smithi188 ceph-mon[43939]: pgmap v2436: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:04.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:03 smithi062 ceph-mon[44211]: pgmap v2436: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:05.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:05 smithi022 ceph-mon[39439]: pgmap v2437: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:05.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:05 smithi188 ceph-mon[43939]: pgmap v2437: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:06.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:05 smithi062 ceph-mon[44211]: pgmap v2437: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:06.951 INFO:teuthology.orchestra.run.smithi022.stdout:137438954053 2024-04-01T20:08:06.952 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.4 2024-04-01T20:08:07.719 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:07 smithi022 ceph-mon[39439]: pgmap v2438: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:07.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:07 smithi188 ceph-mon[43939]: pgmap v2438: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:08.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:07 smithi062 ceph-mon[44211]: pgmap v2438: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:08.043 INFO:teuthology.orchestra.run.smithi022.stdout:3272765079640 2024-04-01T20:08:08.044 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.10 2024-04-01T20:08:08.977 INFO:teuthology.orchestra.run.smithi022.stdout:3672197038109 2024-04-01T20:08:08.978 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.3 2024-04-01T20:08:09.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:09 smithi022 ceph-mon[39439]: pgmap v2439: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:09.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:09 smithi188 ceph-mon[43939]: pgmap v2439: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:10.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:09 smithi062 ceph-mon[44211]: pgmap v2439: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:11.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:11 smithi022 ceph-mon[39439]: pgmap v2440: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:11.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:11 smithi188 ceph-mon[43939]: pgmap v2440: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:12.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:11 smithi062 ceph-mon[44211]: pgmap v2440: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:12.111 INFO:teuthology.orchestra.run.smithi022.stdout:231928234552 2024-04-01T20:08:12.112 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.7 2024-04-01T20:08:12.521 INFO:teuthology.orchestra.run.smithi022.stdout:365072220707 2024-04-01T20:08:12.521 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.11 2024-04-01T20:08:12.560 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:08:13.109 INFO:teuthology.orchestra.run.smithi022.stdout:846108557771 2024-04-01T20:08:13.109 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.8 2024-04-01T20:08:13.854 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:13 smithi022 ceph-mon[39439]: pgmap v2441: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:13.855 INFO:teuthology.orchestra.run.smithi022.stdout:2452426326232 2024-04-01T20:08:13.855 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.1 2024-04-01T20:08:13.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:13 smithi188 ceph-mon[43939]: pgmap v2441: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:14.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:13 smithi062 ceph-mon[44211]: pgmap v2441: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:14.345 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:08:14.364 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:08:14.397 INFO:teuthology.orchestra.run.smithi022.stdout:304942678575 2024-04-01T20:08:14.397 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.9 2024-04-01T20:08:14.587 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:08:14.588 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:08:14.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:14 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:08:14.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:14 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:08:14.622 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:08:14.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:14 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:08:14.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:14 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:08:15.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:14 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:08:15.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:14 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:08:15.423 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:08:15.881 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:15 smithi022 ceph-mon[39439]: osdmap e901: 12 total, 12 up, 12 in 2024-04-01T20:08:15.881 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:15 smithi022 ceph-mon[39439]: pgmap v2443: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:16.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:15 smithi062 ceph-mon[44211]: osdmap e901: 12 total, 12 up, 12 in 2024-04-01T20:08:16.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:15 smithi062 ceph-mon[44211]: pgmap v2443: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:16.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:15 smithi188 ceph-mon[43939]: osdmap e901: 12 total, 12 up, 12 in 2024-04-01T20:08:16.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:15 smithi188 ceph-mon[43939]: pgmap v2443: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:16.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:16 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:08:16.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:16 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:08:17.003 INFO:teuthology.orchestra.run.smithi022.stdout:158913790531 2024-04-01T20:08:17.004 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.5 2024-04-01T20:08:17.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:16 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:08:17.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:16 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:08:17.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:16 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:08:17.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:16 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:08:17.439 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:08:18.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:17 smithi062 ceph-mon[44211]: 1.0 scrub starts 2024-04-01T20:08:18.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:17 smithi062 ceph-mon[44211]: osdmap e902: 12 total, 12 up, 12 in 2024-04-01T20:08:18.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:17 smithi062 ceph-mon[44211]: 1.0 scrub ok 2024-04-01T20:08:18.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:17 smithi062 ceph-mon[44211]: pgmap v2445: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:18.038 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:17 smithi022 ceph-mon[39439]: 1.0 scrub starts 2024-04-01T20:08:18.038 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:17 smithi022 ceph-mon[39439]: osdmap e902: 12 total, 12 up, 12 in 2024-04-01T20:08:18.038 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:17 smithi022 ceph-mon[39439]: 1.0 scrub ok 2024-04-01T20:08:18.038 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:17 smithi022 ceph-mon[39439]: pgmap v2445: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:18.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:17 smithi188 ceph-mon[43939]: 1.0 scrub starts 2024-04-01T20:08:18.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:17 smithi188 ceph-mon[43939]: osdmap e902: 12 total, 12 up, 12 in 2024-04-01T20:08:18.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:17 smithi188 ceph-mon[43939]: 1.0 scrub ok 2024-04-01T20:08:18.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:17 smithi188 ceph-mon[43939]: pgmap v2445: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:19.823 INFO:teuthology.orchestra.run.smithi022.stdout:85899346516 2024-04-01T20:08:19.948 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:19 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:08:19.948 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:19 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:08:19.948 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:19 smithi022 ceph-mon[39439]: osdmap e903: 12 total, 12 up, 12 in 2024-04-01T20:08:19.948 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:19 smithi022 ceph-mon[39439]: pgmap v2447: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:20.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:19 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:08:20.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:19 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:08:20.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:19 smithi062 ceph-mon[44211]: osdmap e903: 12 total, 12 up, 12 in 2024-04-01T20:08:20.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:19 smithi062 ceph-mon[44211]: pgmap v2447: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:20.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:19 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:08:20.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:19 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:08:20.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:19 smithi188 ceph-mon[43939]: osdmap e903: 12 total, 12 up, 12 in 2024-04-01T20:08:20.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:19 smithi188 ceph-mon[43939]: pgmap v2447: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:20.668 INFO:tasks.cephadm.ceph_manager.ceph:need seq 85899346511 got 85899346516 for osd.2 2024-04-01T20:08:20.668 DEBUG:teuthology.parallel:result is None 2024-04-01T20:08:20.954 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:20 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1049215503' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-01T20:08:21.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:20 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1049215503' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-01T20:08:21.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:20 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1049215503' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-01T20:08:22.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:21 smithi062 ceph-mon[44211]: pgmap v2448: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:22.019 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:21 smithi022 ceph-mon[39439]: pgmap v2448: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:22.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:21 smithi188 ceph-mon[43939]: pgmap v2448: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:23.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:22 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1670847662' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-01T20:08:23.363 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:22 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1670847662' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-01T20:08:23.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:22 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1670847662' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-01T20:08:24.092 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:23 smithi022 ceph-mon[39439]: pgmap v2449: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:24.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:23 smithi062 ceph-mon[44211]: pgmap v2449: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:24.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:23 smithi188 ceph-mon[43939]: pgmap v2449: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:25.626 INFO:teuthology.orchestra.run.smithi022.stdout:231928234555 2024-04-01T20:08:25.712 INFO:teuthology.orchestra.run.smithi022.stdout:137438954057 2024-04-01T20:08:25.823 INFO:teuthology.orchestra.run.smithi022.stdout:34359738977 2024-04-01T20:08:26.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:25 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:08:26.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:25 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:08:26.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:25 smithi062 ceph-mon[44211]: osdmap e904: 12 total, 12 up, 12 in 2024-04-01T20:08:26.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:25 smithi062 ceph-mon[44211]: pgmap v2451: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:26.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:25 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2598834843' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-01T20:08:26.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:25 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/1646066407' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-01T20:08:26.293 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:25 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:08:26.293 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:25 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:08:26.293 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:25 smithi022 ceph-mon[39439]: osdmap e904: 12 total, 12 up, 12 in 2024-04-01T20:08:26.293 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:25 smithi022 ceph-mon[39439]: pgmap v2451: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:26.293 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:25 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2598834843' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-01T20:08:26.293 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:25 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/1646066407' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-01T20:08:26.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:25 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:08:26.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:25 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:08:26.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:25 smithi188 ceph-mon[43939]: osdmap e904: 12 total, 12 up, 12 in 2024-04-01T20:08:26.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:25 smithi188 ceph-mon[43939]: pgmap v2451: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:26.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:25 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2598834843' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-01T20:08:26.376 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:25 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/1646066407' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-01T20:08:27.152 INFO:teuthology.orchestra.run.smithi022.stdout:3672197038113 2024-04-01T20:08:27.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:27 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/2815221949' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-01T20:08:27.595 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:27 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/2815221949' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-01T20:08:27.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:27 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/2815221949' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-01T20:08:28.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:28 smithi062 ceph-mon[44211]: pgmap v2452: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:28.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:28 smithi022 ceph-mon[39439]: pgmap v2452: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:28.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:28 smithi188 ceph-mon[43939]: pgmap v2452: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:29.169 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438954053 got 137438954057 for osd.4 2024-04-01T20:08:29.169 DEBUG:teuthology.parallel:result is None 2024-04-01T20:08:29.574 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738971 got 34359738977 for osd.0 2024-04-01T20:08:29.574 DEBUG:teuthology.parallel:result is None 2024-04-01T20:08:29.818 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:29 smithi022 ceph-mon[39439]: pgmap v2453: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:29.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:29 smithi188 ceph-mon[43939]: pgmap v2453: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:30.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:29 smithi062 ceph-mon[44211]: pgmap v2453: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:30.230 INFO:teuthology.orchestra.run.smithi022.stdout:1962800054568 2024-04-01T20:08:30.298 INFO:teuthology.orchestra.run.smithi022.stdout:365072220711 2024-04-01T20:08:30.540 INFO:tasks.cephadm.ceph_manager.ceph:need seq 3672197038109 got 3672197038113 for osd.3 2024-04-01T20:08:30.541 DEBUG:teuthology.parallel:result is None 2024-04-01T20:08:30.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:30 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/20859075' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-01T20:08:30.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:30 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4196532156' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-01T20:08:30.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:30 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/20859075' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-01T20:08:30.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:30 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4196532156' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-01T20:08:31.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:30 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/20859075' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-01T20:08:31.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:30 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4196532156' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-01T20:08:31.587 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:08:31.588 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:08:31.588 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:08:31.588 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:08:31.635 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234552 got 231928234555 for osd.7 2024-04-01T20:08:31.636 DEBUG:teuthology.parallel:result is None 2024-04-01T20:08:31.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:31 smithi022 ceph-mon[39439]: pgmap v2454: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:32.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:31 smithi062 ceph-mon[44211]: pgmap v2454: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:32.016 INFO:teuthology.orchestra.run.smithi022.stdout:3272765079646 2024-04-01T20:08:32.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:31 smithi188 ceph-mon[43939]: pgmap v2454: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:32.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:32 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3297918417' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-01T20:08:33.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:32 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3297918417' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-01T20:08:33.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:32 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3297918417' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-01T20:08:33.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:33 smithi022 ceph-mon[39439]: pgmap v2455: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:34.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:33 smithi062 ceph-mon[44211]: pgmap v2455: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:34.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:33 smithi188 ceph-mon[43939]: pgmap v2455: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:34.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:34 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:08:34.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:34 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:08:34.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:34 smithi022 ceph-mon[39439]: osdmap e905: 12 total, 12 up, 12 in 2024-04-01T20:08:35.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:34 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:08:35.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:34 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:08:35.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:34 smithi062 ceph-mon[44211]: osdmap e905: 12 total, 12 up, 12 in 2024-04-01T20:08:35.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:34 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:08:35.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:34 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:08:35.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:34 smithi188 ceph-mon[43939]: osdmap e905: 12 total, 12 up, 12 in 2024-04-01T20:08:35.470 INFO:tasks.cephadm.ceph_manager.ceph:need seq 1962800054562 got 1962800054568 for osd.6 2024-04-01T20:08:35.470 DEBUG:teuthology.parallel:result is None 2024-04-01T20:08:35.819 INFO:tasks.cephadm.ceph_manager.ceph:need seq 365072220707 got 365072220711 for osd.11 2024-04-01T20:08:35.820 DEBUG:teuthology.parallel:result is None 2024-04-01T20:08:35.987 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:35 smithi022 ceph-mon[39439]: pgmap v2457: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:36.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:35 smithi062 ceph-mon[44211]: pgmap v2457: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:36.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:35 smithi188 ceph-mon[43939]: pgmap v2457: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:36.579 INFO:tasks.cephadm.ceph_manager.ceph:need seq 3272765079640 got 3272765079646 for osd.10 2024-04-01T20:08:36.580 DEBUG:teuthology.parallel:result is None 2024-04-01T20:08:37.786 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:37 smithi022 ceph-mon[39439]: pgmap v2458: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:37.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:37 smithi188 ceph-mon[43939]: pgmap v2458: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:38.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:37 smithi062 ceph-mon[44211]: pgmap v2458: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:38.712 INFO:teuthology.orchestra.run.smithi022.stdout:304942678581 2024-04-01T20:08:38.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:38 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/4156148106' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-01T20:08:38.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:38 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/4156148106' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-01T20:08:38.905 INFO:teuthology.orchestra.run.smithi022.stdout:158913790535 2024-04-01T20:08:39.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:38 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/4156148106' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-01T20:08:39.248 INFO:teuthology.orchestra.run.smithi022.stdout:2452426326238 2024-04-01T20:08:39.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:39 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/448882162' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-01T20:08:39.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:39 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/854598696' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-01T20:08:39.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:39 smithi022 ceph-mon[39439]: pgmap v2459: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:39 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/448882162' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-01T20:08:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:39 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/854598696' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-01T20:08:39.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:39 smithi188 ceph-mon[43939]: pgmap v2459: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:40.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:39 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/448882162' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-01T20:08:40.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:39 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/854598696' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-01T20:08:40.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:39 smithi062 ceph-mon[44211]: pgmap v2459: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:40.310 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790531 got 158913790535 for osd.5 2024-04-01T20:08:40.310 DEBUG:teuthology.parallel:result is None 2024-04-01T20:08:40.821 INFO:tasks.cephadm.ceph_manager.ceph:need seq 2452426326232 got 2452426326238 for osd.1 2024-04-01T20:08:40.821 DEBUG:teuthology.parallel:result is None 2024-04-01T20:08:41.569 INFO:teuthology.orchestra.run.smithi022.stdout:846108557777 2024-04-01T20:08:41.818 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:41 smithi022 ceph-mon[39439]: pgmap v2460: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:41.818 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:41 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/147952383' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-01T20:08:41.843 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678575 got 304942678581 for osd.9 2024-04-01T20:08:41.843 DEBUG:teuthology.parallel:result is None 2024-04-01T20:08:42.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:41 smithi062 ceph-mon[44211]: pgmap v2460: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:42.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:41 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/147952383' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-01T20:08:42.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:41 smithi188 ceph-mon[43939]: pgmap v2460: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:42.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:41 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/147952383' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-01T20:08:42.520 INFO:tasks.cephadm.ceph_manager.ceph:need seq 846108557771 got 846108557777 for osd.8 2024-04-01T20:08:42.521 DEBUG:teuthology.parallel:result is None 2024-04-01T20:08:42.521 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2024-04-01T20:08:42.521 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T20:08:42.810 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:08:42.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:42 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:08:42.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:42 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:08:42.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:42 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:08:42.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:42 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:08:42.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:42 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:08:42.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:42 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:08:42.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:42 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:08:43.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:42 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:08:43.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:42 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:08:43.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:42 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:08:43.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:42 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:08:43.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:42 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:08:43.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:42 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:08:43.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:42 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:08:43.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:42 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:08:43.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:42 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:08:43.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:42 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:08:43.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:42 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:08:43.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:42 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:08:43.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:42 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:08:43.126 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:42 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:08:44.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:43 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:08:44.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:43 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:08:44.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:43 smithi062 ceph-mon[44211]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:08:44.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:43 smithi062 ceph-mon[44211]: pgmap v2461: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:44.096 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:43 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:08:44.096 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:43 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:08:44.096 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:43 smithi022 ceph-mon[39439]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:08:44.096 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:43 smithi022 ceph-mon[39439]: pgmap v2461: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:44.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:43 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:08:44.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:43 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:08:44.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:43 smithi188 ceph-mon[43939]: from='mgr.14151 ' entity='mgr.y' 2024-04-01T20:08:44.125 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:43 smithi188 ceph-mon[43939]: pgmap v2461: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:44.851 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T20:08:44.853 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T20:08:45.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:45 smithi022 ceph-mon[39439]: purged_snaps scrub starts 2024-04-01T20:08:45.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:45 smithi022 ceph-mon[39439]: purged_snaps scrub ok 2024-04-01T20:08:45.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:45 smithi022 ceph-mon[39439]: osdmap e906: 12 total, 12 up, 12 in 2024-04-01T20:08:45.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:45 smithi188 ceph-mon[43939]: purged_snaps scrub starts 2024-04-01T20:08:45.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:45 smithi188 ceph-mon[43939]: purged_snaps scrub ok 2024-04-01T20:08:45.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:45 smithi188 ceph-mon[43939]: osdmap e906: 12 total, 12 up, 12 in 2024-04-01T20:08:45.682 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":2462,"stamp":"2024-04-01T20:08:44.692681+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":3173568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":2,"kb":1124941824,"kb_used":7130944,"kb_used_data":9584,"kb_used_omap":1296,"kb_used_meta":7119919,"kb_avail":1117810880,"statfs":{"total":1151940427776,"available":1144638341120,"internally_reserved":0,"allocated":9814016,"data_stored":5087196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1327618,"internal_metadata":7290797566},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.000658"},"pg_stats":[{"pgid":"1.0","version":"156'139","reported_seq":2220,"reported_epoch":905,"state":"active+clean","last_fresh":"2024-04-01T20:08:34.366098+0000","last_change":"2024-04-01T20:08:16.828852+0000","last_active":"2024-04-01T20:08:34.366098+0000","last_peered":"2024-04-01T20:08:34.366098+0000","last_clean":"2024-04-01T20:08:34.366098+0000","last_became_active":"2024-04-01T20:06:07.901089+0000","last_became_peered":"2024-04-01T20:06:07.901089+0000","last_unstale":"2024-04-01T20:08:34.366098+0000","last_undegraded":"2024-04-01T20:08:34.366098+0000","last_fullsized":"2024-04-01T20:08:34.366098+0000","mapping_epoch":862,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":863,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T20:08:16.828740+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T20:08:16.828740+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:09:18.584988+0000","scrub_duration":206,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":3173568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":3173568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220714,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":983388,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":982142,"kb_avail":92761764,"statfs":{"total":95995035648,"available":94988046336,"internally_reserved":0,"allocated":1261568,"data_stored":864689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":1005713860},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":762,"seq":3272765079649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":68628,"kb_used_data":712,"kb_used_omap":222,"kb_used_meta":67681,"kb_avail":93676524,"statfs":{"total":95995035648,"available":95924760576,"internally_reserved":0,"allocated":729088,"data_stored":335769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":228007,"internal_metadata":69305689},"hb_peers":[0,1,2,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678582,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":870420,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":869694,"kb_avail":92874732,"statfs":{"total":95995035648,"available":95103725568,"internally_reserved":0,"allocated":729088,"data_stored":335781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":890567104},"hb_peers":[0,1,2,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557778,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":399316,"kb_used_data":712,"kb_used_omap":132,"kb_used_meta":398459,"kb_avail":93345836,"statfs":{"total":95995035648,"available":95586136064,"internally_reserved":0,"allocated":729088,"data_stored":335781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":408022759},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234560,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":744604,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":743358,"kb_avail":93000548,"statfs":{"total":95995035648,"available":95232561152,"internally_reserved":0,"allocated":1261568,"data_stored":864709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":761199050},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":457,"seq":1962800054571,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":402132,"kb_used_data":712,"kb_used_omap":744,"kb_used_meta":400663,"kb_avail":93343020,"statfs":{"total":95995035648,"available":95583252480,"internally_reserved":0,"allocated":729088,"data_stored":335781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":762131,"internal_metadata":410279661},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":571,"seq":2452426326239,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":377492,"kb_used_data":712,"kb_used_omap":81,"kb_used_meta":376686,"kb_avail":93367660,"statfs":{"total":95995035648,"available":95608483840,"internally_reserved":0,"allocated":729088,"data_stored":335781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":83387,"internal_metadata":385727045},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738981,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":749652,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":748926,"kb_avail":92995500,"statfs":{"total":95995035648,"available":95227392000,"internally_reserved":0,"allocated":729088,"data_stored":335781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":766900677},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346521,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":627476,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":626750,"kb_avail":93117676,"statfs":{"total":95995035648,"available":95352500224,"internally_reserved":0,"allocated":729088,"data_stored":335781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":641792453},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":855,"seq":3672197038117,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":98964,"kb_used_data":712,"kb_used_omap":104,"kb_used_meta":98135,"kb_avail":93646188,"statfs":{"total":95995035648,"available":95893696512,"internally_reserved":0,"allocated":729088,"data_stored":335781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":107478,"internal_metadata":100490282},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438954061,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":776020,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":775294,"kb_avail":92969132,"statfs":{"total":95995035648,"available":95200391168,"internally_reserved":0,"allocated":729088,"data_stored":335781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":793901509},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1032852,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":1032126,"kb_avail":92712300,"statfs":{"total":95995035648,"available":94937395200,"internally_reserved":0,"allocated":729088,"data_stored":335781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1056897477},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T20:08:45.683 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T20:08:45.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:45 smithi062 ceph-mon[44211]: purged_snaps scrub starts 2024-04-01T20:08:45.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:45 smithi062 ceph-mon[44211]: purged_snaps scrub ok 2024-04-01T20:08:45.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:45 smithi062 ceph-mon[44211]: osdmap e906: 12 total, 12 up, 12 in 2024-04-01T20:08:45.963 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:08:46.443 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:46 smithi022 ceph-mon[39439]: from='client.18186 v1:172.21.15.22:0/2903370653' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T20:08:46.444 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:46 smithi022 ceph-mon[39439]: pgmap v2463: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:46.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:46 smithi188 ceph-mon[43939]: from='client.18186 v1:172.21.15.22:0/2903370653' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T20:08:46.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:46 smithi188 ceph-mon[43939]: pgmap v2463: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:46.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:46 smithi062 ceph-mon[44211]: from='client.18186 v1:172.21.15.22:0/2903370653' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T20:08:46.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:46 smithi062 ceph-mon[44211]: pgmap v2463: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:47.862 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T20:08:47.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T20:08:47.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T20:08:47.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:08:47.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:08:47.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:08:47.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:47 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T20:08:47.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T20:08:47.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T20:08:47.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T20:08:47.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:08:47.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:08:47.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:08:47.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:47 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T20:08:48.013 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T20:08:48.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T20:08:48.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T20:08:48.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:08:48.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:08:48.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:08:48.014 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:47 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T20:08:48.081 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-01T20:08:48.084 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-04-01T20:08:48.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:48 smithi022 ceph-mon[39439]: from='client.18192 v1:172.21.15.22:0/2818027721' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T20:08:48.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:48 smithi188 ceph-mon[43939]: from='client.18192 v1:172.21.15.22:0/2818027721' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T20:08:48.898 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":2464,"stamp":"2024-04-01T20:08:47.532614+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":3173568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":2,"kb":1124941824,"kb_used":7131040,"kb_used_data":9680,"kb_used_omap":1296,"kb_used_meta":7119919,"kb_avail":1117810784,"statfs":{"total":1151940427776,"available":1144638242816,"internally_reserved":0,"allocated":9912320,"data_stored":5134548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1327618,"internal_metadata":7290797566},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001838"},"pg_stats":[{"pgid":"1.0","version":"156'139","reported_seq":2220,"reported_epoch":905,"state":"active+clean","last_fresh":"2024-04-01T20:08:34.366098+0000","last_change":"2024-04-01T20:08:16.828852+0000","last_active":"2024-04-01T20:08:34.366098+0000","last_peered":"2024-04-01T20:08:34.366098+0000","last_clean":"2024-04-01T20:08:34.366098+0000","last_became_active":"2024-04-01T20:06:07.901089+0000","last_became_peered":"2024-04-01T20:06:07.901089+0000","last_unstale":"2024-04-01T20:08:34.366098+0000","last_undegraded":"2024-04-01T20:08:34.366098+0000","last_fullsized":"2024-04-01T20:08:34.366098+0000","mapping_epoch":862,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":863,"parent":"0.0","parent_split_bits":0,"last_scrub":"156'139","last_scrub_stamp":"2024-04-01T20:08:16.828740+0000","last_deep_scrub":"156'139","last_deep_scrub_stamp":"2024-04-01T19:27:41.709127+0000","last_clean_scrub_stamp":"2024-04-01T20:08:16.828740+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:09:18.584988+0000","scrub_duration":206,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":3173568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":3173568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3194880,"data_stored":3173568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220715,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":983400,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":982142,"kb_avail":92761752,"statfs":{"total":95995035648,"available":94988034048,"internally_reserved":0,"allocated":1273856,"data_stored":870608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":1005713860},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":762,"seq":3272765079649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":68628,"kb_used_data":712,"kb_used_omap":222,"kb_used_meta":67681,"kb_avail":93676524,"statfs":{"total":95995035648,"available":95924760576,"internally_reserved":0,"allocated":729088,"data_stored":335769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":228007,"internal_metadata":69305689},"hb_peers":[0,1,2,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678583,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":870432,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":869694,"kb_avail":92874720,"statfs":{"total":95995035648,"available":95103713280,"internally_reserved":0,"allocated":741376,"data_stored":341700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":890567104},"hb_peers":[0,1,2,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":197,"seq":846108557779,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":399316,"kb_used_data":712,"kb_used_omap":132,"kb_used_meta":398459,"kb_avail":93345836,"statfs":{"total":95995035648,"available":95586136064,"internally_reserved":0,"allocated":729088,"data_stored":335781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135449,"internal_metadata":408022759},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234560,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":744604,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":743358,"kb_avail":93000548,"statfs":{"total":95995035648,"available":95232561152,"internally_reserved":0,"allocated":1261568,"data_stored":864709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":761199050},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":457,"seq":1962800054572,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":402144,"kb_used_data":724,"kb_used_omap":744,"kb_used_meta":400663,"kb_avail":93343008,"statfs":{"total":95995035648,"available":95583240192,"internally_reserved":0,"allocated":741376,"data_stored":341700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":762131,"internal_metadata":410279661},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":571,"seq":2452426326240,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":377504,"kb_used_data":724,"kb_used_omap":81,"kb_used_meta":376686,"kb_avail":93367648,"statfs":{"total":95995035648,"available":95608471552,"internally_reserved":0,"allocated":741376,"data_stored":341700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":83387,"internal_metadata":385727045},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":749664,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":748926,"kb_avail":92995488,"statfs":{"total":95995035648,"available":95227379712,"internally_reserved":0,"allocated":741376,"data_stored":341700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":766900677},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899346522,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":627488,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":626750,"kb_avail":93117664,"statfs":{"total":95995035648,"available":95352487936,"internally_reserved":0,"allocated":741376,"data_stored":341700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":641792453},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":855,"seq":3672197038118,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":98976,"kb_used_data":724,"kb_used_omap":104,"kb_used_meta":98135,"kb_avail":93646176,"statfs":{"total":95995035648,"available":95893684224,"internally_reserved":0,"allocated":741376,"data_stored":341700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":107478,"internal_metadata":100490282},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438954062,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":776032,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":775294,"kb_avail":92969120,"statfs":{"total":95995035648,"available":95200378880,"internally_reserved":0,"allocated":741376,"data_stored":341700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":793901509},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1032852,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":1032126,"kb_avail":92712300,"statfs":{"total":95995035648,"available":94937395200,"internally_reserved":0,"allocated":729088,"data_stored":335781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1056897477},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T20:08:48.899 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2024-04-01T20:08:48.899 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e142085d06ebbedb32196116c9f19e2d28f93430 shell --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 -- ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-01T20:08:49.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:48 smithi062 ceph-mon[44211]: from='client.18192 v1:172.21.15.22:0/2818027721' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T20:08:49.178 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T20:08:49.698 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:49 smithi022 ceph-mon[39439]: pgmap v2465: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:49.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:49 smithi188 ceph-mon[43939]: pgmap v2465: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:50.012 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:49 smithi062 ceph-mon[44211]: pgmap v2465: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:51.691 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:51 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3516200600' entity='client.admin' cmd=[{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]: dispatch 2024-04-01T20:08:51.691 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:51 smithi022 ceph-mon[39439]: from='client.? v1:172.21.15.22:0/3516200600' entity='client.admin' cmd='[{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]': finished 2024-04-01T20:08:51.691 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:51 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:08:51.691 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:51 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:08:51.691 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:51 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:08:51.691 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:51 smithi022 ceph-mon[39439]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T20:08:51.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:51 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3516200600' entity='client.admin' cmd=[{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]: dispatch 2024-04-01T20:08:51.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:51 smithi062 ceph-mon[44211]: from='client.? v1:172.21.15.22:0/3516200600' entity='client.admin' cmd='[{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]': finished 2024-04-01T20:08:51.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:51 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:08:51.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:51 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:08:51.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:51 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:08:51.762 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:51 smithi062 ceph-mon[44211]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T20:08:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:51 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3516200600' entity='client.admin' cmd=[{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]: dispatch 2024-04-01T20:08:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:51 smithi188 ceph-mon[43939]: from='client.? v1:172.21.15.22:0/3516200600' entity='client.admin' cmd='[{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]': finished 2024-04-01T20:08:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:51 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T20:08:51.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:51 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T20:08:51.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:51 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T20:08:51.876 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:51 smithi188 ceph-mon[43939]: from='mgr.14151 v1:172.21.15.22:0/1281997603' entity='mgr.y' 2024-04-01T20:08:52.118 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-01T20:08:52.131 INFO:tasks.cephadm:Teardown begin 2024-04-01T20:08:52.131 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-01T20:08:52.203 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-01T20:08:52.294 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-01T20:08:52.346 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-01T20:08:52.346 DEBUG:teuthology.orchestra.run.smithi022:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-01T20:08:52.379 DEBUG:teuthology.orchestra.run.smithi062:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-01T20:08:52.422 DEBUG:teuthology.orchestra.run.smithi188:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-01T20:08:52.447 INFO:tasks.cephadm:Stopping all daemons... 2024-04-01T20:08:52.448 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-04-01T20:08:52.448 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mon.a 2024-04-01T20:08:52.512 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:52 smithi062 ceph-mon[44211]: pgmap v2466: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:52.625 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:52 smithi188 ceph-mon[43939]: pgmap v2466: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:52.727 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:52 smithi022 ceph-mon[39439]: pgmap v2466: 1 pgs: 1 active+clean; 577 KiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T20:08:52.727 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:52 smithi022 systemd[1]: Stopping Ceph mon.a for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T20:08:53.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:52 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[39416]: 2024-04-01T20:08:52.726+0000 7fd02b2aa700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T20:08:53.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:52 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a[39416]: 2024-04-01T20:08:52.726+0000 7fd02b2aa700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-04-01T20:08:53.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Apr 01 20:08:53 smithi022 bash[345929]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-a 2024-04-01T20:08:53.874 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mon.a.service' 2024-04-01T20:08:53.916 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T20:08:53.916 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-04-01T20:08:53.916 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-04-01T20:08:53.916 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mon.b 2024-04-01T20:08:54.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:53 smithi062 systemd[1]: Stopping Ceph mon.b for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T20:08:54.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:54 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-b[44188]: 2024-04-01T20:08:54.194+0000 7fe17c1ef700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T20:08:54.263 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:54 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-b[44188]: 2024-04-01T20:08:54.194+0000 7fe17c1ef700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-04-01T20:08:55.262 INFO:journalctl@ceph.mon.b.smithi062.stdout:Apr 01 20:08:54 smithi062 bash[192141]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-b 2024-04-01T20:08:55.598 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mon.b.service' 2024-04-01T20:08:55.642 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T20:08:55.642 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-04-01T20:08:55.642 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-04-01T20:08:55.642 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mon.c 2024-04-01T20:08:56.006 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:55 smithi188 systemd[1]: Stopping Ceph mon.c for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T20:08:56.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:56 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-c[43909]: 2024-04-01T20:08:56.006+0000 7f4323fff700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T20:08:56.375 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:56 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-c[43909]: 2024-04-01T20:08:56.006+0000 7f4323fff700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-04-01T20:08:56.875 INFO:journalctl@ceph.mon.c.smithi188.stdout:Apr 01 20:08:56 smithi188 bash[188986]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mon-c 2024-04-01T20:08:56.937 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mon.c.service' 2024-04-01T20:08:56.978 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T20:08:56.979 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-04-01T20:08:56.979 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-04-01T20:08:56.979 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mgr.y 2024-04-01T20:08:57.314 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 20:08:57 smithi022 systemd[1]: Stopping Ceph mgr.y for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T20:08:57.613 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 20:08:57 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T20:08:57.312+0000 7f98d2be5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T20:08:57.613 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 20:08:57 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y[39687]: 2024-04-01T20:08:57.313+0000 7f98d2be5700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-04-01T20:08:58.112 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Apr 01 20:08:57 smithi022 bash[346075]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-y 2024-04-01T20:08:58.245 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mgr.y.service' 2024-04-01T20:08:58.281 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T20:08:58.281 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-04-01T20:08:58.281 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-04-01T20:08:58.281 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mgr.x 2024-04-01T20:08:58.762 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 20:08:58 smithi062 systemd[1]: Stopping Ceph mgr.x for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T20:08:59.229 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 20:08:59 smithi062 bash[192309]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-mgr-x 2024-04-01T20:08:59.374 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 20:08:59 smithi062 systemd[1]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-04-01T20:08:59.374 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Apr 01 20:08:59 smithi062 systemd[1]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mgr.x.service: Failed with result 'exit-code'. 2024-04-01T20:08:59.377 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@mgr.x.service' 2024-04-01T20:08:59.414 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T20:08:59.415 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-04-01T20:08:59.415 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-01T20:08:59.415 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.0 2024-04-01T20:08:59.718 INFO:journalctl@ceph.osd.0.smithi022.stdout:Apr 01 20:08:59 smithi022 systemd[1]: Stopping Ceph osd.0 for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T20:09:00.112 INFO:journalctl@ceph.osd.0.smithi022.stdout:Apr 01 20:08:59 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-0[58221]: 2024-04-01T20:08:59.717+0000 7f88e9596700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T20:09:00.112 INFO:journalctl@ceph.osd.0.smithi022.stdout:Apr 01 20:08:59 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-0[58221]: 2024-04-01T20:08:59.717+0000 7f88e9596700 -1 osd.0 906 *** Got signal Terminated *** 2024-04-01T20:09:00.113 INFO:journalctl@ceph.osd.0.smithi022.stdout:Apr 01 20:08:59 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-0[58221]: 2024-04-01T20:08:59.717+0000 7f88e9596700 -1 osd.0 906 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T20:09:06.112 INFO:journalctl@ceph.osd.0.smithi022.stdout:Apr 01 20:09:05 smithi022 bash[346222]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-0 2024-04-01T20:09:07.828 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.0.service' 2024-04-01T20:09:07.869 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T20:09:07.869 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-01T20:09:07.870 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-01T20:09:07.870 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.1 2024-04-01T20:09:08.112 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 20:09:07 smithi022 systemd[1]: Stopping Ceph osd.1 for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T20:09:08.612 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 20:09:08 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-1[248149]: 2024-04-01T20:09:08.167+0000 7fad78057700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T20:09:08.613 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 20:09:08 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-1[248149]: 2024-04-01T20:09:08.167+0000 7fad78057700 -1 osd.1 906 *** Got signal Terminated *** 2024-04-01T20:09:08.613 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 20:09:08 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-1[248149]: 2024-04-01T20:09:08.167+0000 7fad78057700 -1 osd.1 906 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T20:09:14.363 INFO:journalctl@ceph.osd.1.smithi022.stdout:Apr 01 20:09:14 smithi022 bash[346488]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-1 2024-04-01T20:09:16.316 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.1.service' 2024-04-01T20:09:16.365 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T20:09:16.366 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-01T20:09:16.366 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-01T20:09:16.366 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.2 2024-04-01T20:09:16.613 INFO:journalctl@ceph.osd.2.smithi022.stdout:Apr 01 20:09:16 smithi022 systemd[1]: Stopping Ceph osd.2 for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T20:09:17.113 INFO:journalctl@ceph.osd.2.smithi022.stdout:Apr 01 20:09:16 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-2[73101]: 2024-04-01T20:09:16.655+0000 7fbcd8952700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T20:09:17.113 INFO:journalctl@ceph.osd.2.smithi022.stdout:Apr 01 20:09:16 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-2[73101]: 2024-04-01T20:09:16.655+0000 7fbcd8952700 -1 osd.2 906 *** Got signal Terminated *** 2024-04-01T20:09:17.113 INFO:journalctl@ceph.osd.2.smithi022.stdout:Apr 01 20:09:16 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-2[73101]: 2024-04-01T20:09:16.655+0000 7fbcd8952700 -1 osd.2 906 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T20:09:22.863 INFO:journalctl@ceph.osd.2.smithi022.stdout:Apr 01 20:09:22 smithi022 bash[346763]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-2 2024-04-01T20:09:24.517 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.2.service' 2024-04-01T20:09:24.565 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T20:09:24.566 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-01T20:09:24.566 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-01T20:09:24.566 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.3 2024-04-01T20:09:24.823 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:09:24 smithi022 systemd[1]: Stopping Ceph osd.3 for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T20:09:25.112 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:09:24 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-3[331894]: 2024-04-01T20:09:24.822+0000 7f76c74ad700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T20:09:25.113 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:09:24 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-3[331894]: 2024-04-01T20:09:24.822+0000 7f76c74ad700 -1 osd.3 906 *** Got signal Terminated *** 2024-04-01T20:09:25.113 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:09:24 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-3[331894]: 2024-04-01T20:09:24.822+0000 7f76c74ad700 -1 osd.3 906 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T20:09:26.512 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:26 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:26.190+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.605909+0000 front 2024-04-01T20:09:01.606000+0000 (oldest deadline 2024-04-01T20:09:25.705644+0000) 2024-04-01T20:09:27.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:26 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:26.754+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:27.512 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:27 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:27.147+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.605909+0000 front 2024-04-01T20:09:01.606000+0000 (oldest deadline 2024-04-01T20:09:25.705644+0000) 2024-04-01T20:09:27.612 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:09:27 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-3[331894]: 2024-04-01T20:09:27.322+0000 7f76bfa99700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.874876+0000 front 2024-04-01T20:09:03.874996+0000 (oldest deadline 2024-04-01T20:09:26.775006+0000) 2024-04-01T20:09:27.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:27 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:27.201+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:27.625 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:27 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:27.400+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:27.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:27 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:27.259+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:28.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:27 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:27.799+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:28.512 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:28 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:28.172+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.605909+0000 front 2024-04-01T20:09:01.606000+0000 (oldest deadline 2024-04-01T20:09:25.705644+0000) 2024-04-01T20:09:28.612 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:09:28 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-3[331894]: 2024-04-01T20:09:28.335+0000 7f76bfa99700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.874876+0000 front 2024-04-01T20:09:03.874996+0000 (oldest deadline 2024-04-01T20:09:26.775006+0000) 2024-04-01T20:09:28.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:28 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:28.217+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:28.625 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:28 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:28.441+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:28.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:28 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:28.258+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:29.126 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:28 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:28.768+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:29.512 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:29 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:29.196+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.605909+0000 front 2024-04-01T20:09:01.606000+0000 (oldest deadline 2024-04-01T20:09:25.705644+0000) 2024-04-01T20:09:29.613 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:09:29 smithi022 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-3[331894]: 2024-04-01T20:09:29.361+0000 7f76bfa99700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.874876+0000 front 2024-04-01T20:09:03.874996+0000 (oldest deadline 2024-04-01T20:09:26.775006+0000) 2024-04-01T20:09:29.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:29 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:29.212+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:29.625 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:29 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:29.414+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:29.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:29 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:29.278+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:30.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:29 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:29.799+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:30.241 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:29 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:29.972+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:30.512 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:30 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:30.241+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.605909+0000 front 2024-04-01T20:09:01.606000+0000 (oldest deadline 2024-04-01T20:09:25.705644+0000) 2024-04-01T20:09:30.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:30 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:30.209+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:30.625 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:30 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:30.403+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:30.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:30 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:30.315+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:30.862 INFO:journalctl@ceph.osd.3.smithi022.stdout:Apr 01 20:09:30 smithi022 bash[347029]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-3 2024-04-01T20:09:31.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:30 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:30.821+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:31.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:30 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:30.978+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:31.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:31 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:31.180+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:31.625 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:31 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:31.400+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:31.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:31 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:31.309+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:31.762 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:31 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:31.266+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.605909+0000 front 2024-04-01T20:09:01.606000+0000 (oldest deadline 2024-04-01T20:09:25.705644+0000) 2024-04-01T20:09:32.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:31 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:31.855+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:32.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:31 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:31.944+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:32.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:32 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:32.220+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:32.625 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:32 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:32.446+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:32.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:32 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:32.359+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:32.762 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:32 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:32.288+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.605909+0000 front 2024-04-01T20:09:01.606000+0000 (oldest deadline 2024-04-01T20:09:25.705644+0000) 2024-04-01T20:09:32.832 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.3.service' 2024-04-01T20:09:32.873 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T20:09:32.873 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-01T20:09:32.873 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-01T20:09:32.873 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.4 2024-04-01T20:09:33.158 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:32 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:32.953+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:33.158 INFO:journalctl@ceph.osd.4.smithi062.stdout:Apr 01 20:09:32 smithi062 systemd[1]: Stopping Ceph osd.4 for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T20:09:33.192 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:32 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:32.895+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:33.512 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:33 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:33.321+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.605909+0000 front 2024-04-01T20:09:01.606000+0000 (oldest deadline 2024-04-01T20:09:25.705644+0000) 2024-04-01T20:09:33.512 INFO:journalctl@ceph.osd.4.smithi062.stdout:Apr 01 20:09:33 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-4[49665]: 2024-04-01T20:09:33.158+0000 7fd68dd6d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T20:09:33.512 INFO:journalctl@ceph.osd.4.smithi062.stdout:Apr 01 20:09:33 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-4[49665]: 2024-04-01T20:09:33.158+0000 7fd68dd6d700 -1 osd.4 906 *** Got signal Terminated *** 2024-04-01T20:09:33.512 INFO:journalctl@ceph.osd.4.smithi062.stdout:Apr 01 20:09:33 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-4[49665]: 2024-04-01T20:09:33.158+0000 7fd68dd6d700 -1 osd.4 906 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T20:09:33.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:33 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:33.193+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:33.625 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:33 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:33.396+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:33.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:33 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:33.400+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:34.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:33 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:33.853+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:34.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:33 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:33.934+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:34.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:34 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:34.239+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:34.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:34 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:34.377+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:34.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:34 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:34.435+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:34.762 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:34 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:34.289+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.605909+0000 front 2024-04-01T20:09:01.606000+0000 (oldest deadline 2024-04-01T20:09:25.705644+0000) 2024-04-01T20:09:35.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:34 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:34.835+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:35.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:34 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:34.892+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:35.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:34 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:34.892+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.036011+0000 front 2024-04-01T20:09:12.036043+0000 (oldest deadline 2024-04-01T20:09:34.336056+0000) 2024-04-01T20:09:35.625 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:35 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:35.331+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:35.626 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:35 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:35.265+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:35.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:35 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:35.480+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:35.762 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:35 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:35.320+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.605909+0000 front 2024-04-01T20:09:01.606000+0000 (oldest deadline 2024-04-01T20:09:25.705644+0000) 2024-04-01T20:09:35.762 INFO:journalctl@ceph.osd.4.smithi062.stdout:Apr 01 20:09:35 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-4[49665]: 2024-04-01T20:09:35.490+0000 7fd68a361700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:08.611664+0000 front 2024-04-01T20:09:08.611676+0000 (oldest deadline 2024-04-01T20:09:34.511660+0000) 2024-04-01T20:09:36.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:35 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:35.819+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:36.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:35 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:35.873+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:36.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:35 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:35.873+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.036011+0000 front 2024-04-01T20:09:12.036043+0000 (oldest deadline 2024-04-01T20:09:34.336056+0000) 2024-04-01T20:09:36.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:36 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:36.299+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:36.625 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:36 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:36.450+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:36.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:36 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:36.365+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:36.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:36 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:36.365+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:09:36.762 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:36 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:36.359+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.605909+0000 front 2024-04-01T20:09:01.606000+0000 (oldest deadline 2024-04-01T20:09:25.705644+0000) 2024-04-01T20:09:36.762 INFO:journalctl@ceph.osd.4.smithi062.stdout:Apr 01 20:09:36 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-4[49665]: 2024-04-01T20:09:36.482+0000 7fd68a361700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:08.611664+0000 front 2024-04-01T20:09:08.611676+0000 (oldest deadline 2024-04-01T20:09:34.511660+0000) 2024-04-01T20:09:37.126 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:36 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:36.854+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:37.126 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:36 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:36.854+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:09:37.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:36 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:36.832+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:37.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:36 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:36.832+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.036011+0000 front 2024-04-01T20:09:12.036043+0000 (oldest deadline 2024-04-01T20:09:34.336056+0000) 2024-04-01T20:09:37.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:37 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:37.261+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:37.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:37 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:37.374+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:37.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:37 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:37.374+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:09:37.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:37 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:37.481+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:37.762 INFO:journalctl@ceph.osd.4.smithi062.stdout:Apr 01 20:09:37 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-4[49665]: 2024-04-01T20:09:37.449+0000 7fd68a361700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:08.611664+0000 front 2024-04-01T20:09:08.611676+0000 (oldest deadline 2024-04-01T20:09:34.511660+0000) 2024-04-01T20:09:37.762 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:37 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:37.324+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.605909+0000 front 2024-04-01T20:09:01.606000+0000 (oldest deadline 2024-04-01T20:09:25.705644+0000) 2024-04-01T20:09:38.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:37 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:37.847+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:38.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:37 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:37.847+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:09:38.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:37 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:37.824+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:38.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:37 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:37.824+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.036011+0000 front 2024-04-01T20:09:12.036043+0000 (oldest deadline 2024-04-01T20:09:34.336056+0000) 2024-04-01T20:09:38.522 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:38 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:38.423+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:38.522 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:38 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:38.423+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:09:38.522 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:38 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:38.240+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:38.522 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:38 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:38.240+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:09:38.762 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:38 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:38.299+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.605909+0000 front 2024-04-01T20:09:01.606000+0000 (oldest deadline 2024-04-01T20:09:25.705644+0000) 2024-04-01T20:09:38.762 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:38 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:38.299+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.707527+0000 front 2024-04-01T20:09:12.707749+0000 (oldest deadline 2024-04-01T20:09:38.007547+0000) 2024-04-01T20:09:38.762 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:38 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:38.491+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:09:38.807 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:38 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:38.523+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:39.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:38 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:38.808+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:39.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:38 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:38.808+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:09:39.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:38 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:38.840+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:39.263 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:38 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:38.840+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.036011+0000 front 2024-04-01T20:09:12.036043+0000 (oldest deadline 2024-04-01T20:09:34.336056+0000) 2024-04-01T20:09:39.538 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:39 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:39.406+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:39.539 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:39 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:39.406+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:09:39.539 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:39 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:39.268+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:39.539 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:39 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:39.268+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:09:39.762 INFO:journalctl@ceph.osd.4.smithi062.stdout:Apr 01 20:09:39 smithi062 bash[192463]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-4 2024-04-01T20:09:39.762 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:39 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:39.330+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.605909+0000 front 2024-04-01T20:09:01.606000+0000 (oldest deadline 2024-04-01T20:09:25.705644+0000) 2024-04-01T20:09:39.763 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:39 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:39.330+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.707527+0000 front 2024-04-01T20:09:12.707749+0000 (oldest deadline 2024-04-01T20:09:38.007547+0000) 2024-04-01T20:09:39.763 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:39 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:39.478+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:09:39.816 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:39 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:39.539+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:40.119 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:39 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:39.852+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:40.120 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:39 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:39.852+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.036011+0000 front 2024-04-01T20:09:12.036043+0000 (oldest deadline 2024-04-01T20:09:34.336056+0000) 2024-04-01T20:09:40.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:39 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:39.816+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:40.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:39 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:39.816+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:09:40.431 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:40 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:40.291+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.605909+0000 front 2024-04-01T20:09:01.606000+0000 (oldest deadline 2024-04-01T20:09:25.705644+0000) 2024-04-01T20:09:40.431 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:40 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:40.291+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.707527+0000 front 2024-04-01T20:09:12.707749+0000 (oldest deadline 2024-04-01T20:09:38.007547+0000) 2024-04-01T20:09:40.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:40 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:40.301+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:40.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:40 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:40.301+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:09:40.625 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:40 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:40.545+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:40.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:40 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:40.449+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:40.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:40 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:40.449+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:09:40.762 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:40 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:40.431+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:09:41.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:40 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:40.809+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:41.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:40 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:40.809+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:09:41.208 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:40 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:40.834+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:41.208 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:40 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:40.834+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.036011+0000 front 2024-04-01T20:09:12.036043+0000 (oldest deadline 2024-04-01T20:09:34.336056+0000) 2024-04-01T20:09:41.503 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:41 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:41.418+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:09:41.503 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:41 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:41.291+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.605909+0000 front 2024-04-01T20:09:01.606000+0000 (oldest deadline 2024-04-01T20:09:25.705644+0000) 2024-04-01T20:09:41.504 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:41 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:41.291+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.707527+0000 front 2024-04-01T20:09:12.707749+0000 (oldest deadline 2024-04-01T20:09:38.007547+0000) 2024-04-01T20:09:41.512 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.4.service' 2024-04-01T20:09:41.543 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:41 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:41.478+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:41.543 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:41 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:41.478+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:09:41.544 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:41 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:41.288+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:41.544 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:41 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:41.288+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:09:41.554 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T20:09:41.554 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-01T20:09:41.554 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-01T20:09:41.554 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.5 2024-04-01T20:09:41.762 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:41 smithi062 systemd[1]: Stopping Ceph osd.5 for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T20:09:41.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:41 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:41.779+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:41.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:41 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:41.779+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:09:41.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:41 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:41.544+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:42.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:41 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:41.800+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:42.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:41 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:41.800+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.036011+0000 front 2024-04-01T20:09:12.036043+0000 (oldest deadline 2024-04-01T20:09:34.336056+0000) 2024-04-01T20:09:42.262 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:41 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:41.853+0000 7f23760c8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T20:09:42.263 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:41 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:41.853+0000 7f23760c8700 -1 osd.5 906 *** Got signal Terminated *** 2024-04-01T20:09:42.263 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:41 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:41.853+0000 7f23760c8700 -1 osd.5 906 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T20:09:42.588 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:42 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:42.302+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:42.588 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:42 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:42.302+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:09:42.588 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:42 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:42.454+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:42.588 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:42 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:42.454+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:09:42.588 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:42 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:42.454+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:09:42.762 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:42 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:42.436+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:09:42.762 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:42 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:42.284+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.605909+0000 front 2024-04-01T20:09:01.606000+0000 (oldest deadline 2024-04-01T20:09:25.705644+0000) 2024-04-01T20:09:42.762 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:42 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:42.284+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.707527+0000 front 2024-04-01T20:09:12.707749+0000 (oldest deadline 2024-04-01T20:09:38.007547+0000) 2024-04-01T20:09:42.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:42 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:42.766+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:42.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:42 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:42.766+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:09:42.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:42 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:42.766+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:09:42.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:42 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:42.589+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:43.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:42 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:42.841+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:43.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:42 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:42.841+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.036011+0000 front 2024-04-01T20:09:12.036043+0000 (oldest deadline 2024-04-01T20:09:34.336056+0000) 2024-04-01T20:09:43.547 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:43 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:43.284+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:43.547 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:43 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:43.284+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:09:43.547 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:43 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:43.284+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:09:43.547 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:43 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:43.458+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:43.548 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:43 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:43.458+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:09:43.548 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:43 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:43.458+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:09:43.762 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:43 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:43.405+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:09:43.762 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:43 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:43.405+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.302279+0000 front 2024-04-01T20:09:19.302083+0000 (oldest deadline 2024-04-01T20:09:42.802219+0000) 2024-04-01T20:09:43.762 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:43 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:43.270+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.605909+0000 front 2024-04-01T20:09:01.606000+0000 (oldest deadline 2024-04-01T20:09:25.705644+0000) 2024-04-01T20:09:43.762 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:43 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:43.270+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.707527+0000 front 2024-04-01T20:09:12.707749+0000 (oldest deadline 2024-04-01T20:09:38.007547+0000) 2024-04-01T20:09:43.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:43 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:43.548+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:43.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:43 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:43.765+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:43.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:43 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:43.765+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:09:43.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:43 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:43.765+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:09:44.250 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:43 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:43.822+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:44.251 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:43 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:43.822+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.036011+0000 front 2024-04-01T20:09:12.036043+0000 (oldest deadline 2024-04-01T20:09:34.336056+0000) 2024-04-01T20:09:44.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:44 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:44.386+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:09:44.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:44 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:44.386+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.302279+0000 front 2024-04-01T20:09:19.302083+0000 (oldest deadline 2024-04-01T20:09:42.802219+0000) 2024-04-01T20:09:44.512 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:44 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:44.251+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.605909+0000 front 2024-04-01T20:09:01.606000+0000 (oldest deadline 2024-04-01T20:09:25.705644+0000) 2024-04-01T20:09:44.512 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:44 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:44.251+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.707527+0000 front 2024-04-01T20:09:12.707749+0000 (oldest deadline 2024-04-01T20:09:38.007547+0000) 2024-04-01T20:09:44.592 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:44 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:44.309+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:44.592 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:44 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:44.309+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:09:44.592 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:44 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:44.309+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:09:44.592 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:44 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:44.432+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:44.592 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:44 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:44.432+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:09:44.592 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:44 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:44.432+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:09:44.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:44 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:44.793+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:44.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:44 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:44.793+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:09:44.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:44 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:44.793+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:09:44.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:44 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:44.591+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:44.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:44 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:44.591+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:09:45.221 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:44 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:44.869+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:45.221 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:44 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:44.869+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.036011+0000 front 2024-04-01T20:09:12.036043+0000 (oldest deadline 2024-04-01T20:09:34.336056+0000) 2024-04-01T20:09:45.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:45 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:45.341+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:09:45.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:45 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:45.341+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.302279+0000 front 2024-04-01T20:09:19.302083+0000 (oldest deadline 2024-04-01T20:09:42.802219+0000) 2024-04-01T20:09:45.512 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:45 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:45.222+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.605909+0000 front 2024-04-01T20:09:01.606000+0000 (oldest deadline 2024-04-01T20:09:25.705644+0000) 2024-04-01T20:09:45.512 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:45 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:45.222+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.707527+0000 front 2024-04-01T20:09:12.707749+0000 (oldest deadline 2024-04-01T20:09:38.007547+0000) 2024-04-01T20:09:45.562 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:45 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:45.277+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:45.563 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:45 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:45.277+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:09:45.563 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:45 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:45.277+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:09:45.563 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:45 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:45.395+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:45.563 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:45 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:45.395+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:09:45.563 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:45 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:45.395+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:09:45.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:45 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:45.757+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:45.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:45 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:45.757+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:09:45.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:45 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:45.757+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:09:45.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:45 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:45.563+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:45.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:45 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:45.563+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:09:46.173 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:45 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:45.874+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:46.173 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:45 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:45.874+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.036011+0000 front 2024-04-01T20:09:12.036043+0000 (oldest deadline 2024-04-01T20:09:34.336056+0000) 2024-04-01T20:09:46.173 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:45 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:45.874+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.537974+0000 front 2024-04-01T20:09:19.538042+0000 (oldest deadline 2024-04-01T20:09:45.437988+0000) 2024-04-01T20:09:46.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:46 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:46.338+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:09:46.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:46 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:46.338+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.302279+0000 front 2024-04-01T20:09:19.302083+0000 (oldest deadline 2024-04-01T20:09:42.802219+0000) 2024-04-01T20:09:46.512 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:46 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:46.173+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.605909+0000 front 2024-04-01T20:09:01.606000+0000 (oldest deadline 2024-04-01T20:09:25.705644+0000) 2024-04-01T20:09:46.512 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:46 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5[57477]: 2024-04-01T20:09:46.173+0000 7f23726bc700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.707527+0000 front 2024-04-01T20:09:12.707749+0000 (oldest deadline 2024-04-01T20:09:38.007547+0000) 2024-04-01T20:09:46.524 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:46 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:46.259+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:46.524 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:46 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:46.259+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:09:46.524 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:46 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:46.259+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:09:46.525 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:46 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:46.422+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:46.525 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:46 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:46.422+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:09:46.525 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:46 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:46.422+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:09:46.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:46 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:46.741+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:46.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:46 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:46.741+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:09:46.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:46 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:46.741+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:09:46.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:46 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:46.525+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:46.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:46 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:46.525+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:09:47.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:46 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:46.880+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:47.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:46 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:46.880+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.036011+0000 front 2024-04-01T20:09:12.036043+0000 (oldest deadline 2024-04-01T20:09:34.336056+0000) 2024-04-01T20:09:47.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:46 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:46.880+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.537974+0000 front 2024-04-01T20:09:19.538042+0000 (oldest deadline 2024-04-01T20:09:45.437988+0000) 2024-04-01T20:09:47.514 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:47.442+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:47.514 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:47.442+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:09:47.514 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:47.442+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:09:47.514 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:47.222+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:47.514 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:47.222+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:09:47.515 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:47.222+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:09:47.762 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:47 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:47.372+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:09:47.762 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:47 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:47.372+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.302279+0000 front 2024-04-01T20:09:19.302083+0000 (oldest deadline 2024-04-01T20:09:42.802219+0000) 2024-04-01T20:09:47.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:47.515+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:47.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:47.515+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:09:47.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:47.712+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:47.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:47.712+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:09:47.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:47 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:47.712+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:09:48.262 INFO:journalctl@ceph.osd.5.smithi062.stdout:Apr 01 20:09:48 smithi062 bash[192728]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-5 2024-04-01T20:09:48.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:47 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:47.892+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:48.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:47 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:47.892+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.036011+0000 front 2024-04-01T20:09:12.036043+0000 (oldest deadline 2024-04-01T20:09:34.336056+0000) 2024-04-01T20:09:48.263 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:47 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:47.892+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.537974+0000 front 2024-04-01T20:09:19.538042+0000 (oldest deadline 2024-04-01T20:09:45.437988+0000) 2024-04-01T20:09:48.501 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:48 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:48.485+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:48.502 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:48 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:48.485+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:09:48.502 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:48 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:48.485+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:09:48.502 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:48 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:48.243+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:48.502 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:48 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:48.243+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:09:48.502 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:48 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:48.243+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:09:48.732 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:48 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:48.332+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:09:48.732 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:48 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:48.332+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.302279+0000 front 2024-04-01T20:09:19.302083+0000 (oldest deadline 2024-04-01T20:09:42.802219+0000) 2024-04-01T20:09:48.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:48 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:48.502+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:48.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:48 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:48.502+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:09:48.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:48 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:48.710+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:48.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:48 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:48.710+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:09:48.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:48 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:48.710+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:09:49.012 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:48 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:48.912+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:49.012 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:48 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:48.912+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.036011+0000 front 2024-04-01T20:09:12.036043+0000 (oldest deadline 2024-04-01T20:09:34.336056+0000) 2024-04-01T20:09:49.012 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:48 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:48.912+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.537974+0000 front 2024-04-01T20:09:19.538042+0000 (oldest deadline 2024-04-01T20:09:45.437988+0000) 2024-04-01T20:09:49.429 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:49 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:49.308+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:09:49.429 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:49 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:49.308+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.302279+0000 front 2024-04-01T20:09:19.302083+0000 (oldest deadline 2024-04-01T20:09:42.802219+0000) 2024-04-01T20:09:49.496 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:49 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:49.232+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:49.496 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:49 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:49.232+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:09:49.496 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:49 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:49.232+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:09:49.750 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:49 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:49.506+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:49.750 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:49 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:49.506+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:09:49.751 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:49 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:49.497+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:49.751 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:49 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:49.497+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:09:49.751 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:49 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:49.497+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:09:49.814 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.5.service' 2024-04-01T20:09:49.855 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T20:09:49.855 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-01T20:09:49.855 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-04-01T20:09:49.855 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.6 2024-04-01T20:09:50.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:49 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:49.751+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:50.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:49 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:49.751+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:09:50.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:49 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:49.751+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:09:50.160 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:49 smithi062 systemd[1]: Stopping Ceph osd.6 for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T20:09:50.160 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:49 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:49.935+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:50.160 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:49 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:49.935+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.036011+0000 front 2024-04-01T20:09:12.036043+0000 (oldest deadline 2024-04-01T20:09:34.336056+0000) 2024-04-01T20:09:50.160 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:49 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:49.935+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.537974+0000 front 2024-04-01T20:09:19.538042+0000 (oldest deadline 2024-04-01T20:09:45.437988+0000) 2024-04-01T20:09:50.160 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:50 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:50.160+0000 7fee51c20700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T20:09:50.160 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:50 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:50.160+0000 7fee51c20700 -1 osd.6 906 *** Got signal Terminated *** 2024-04-01T20:09:50.494 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:50 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:50.206+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:50.494 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:50 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:50.206+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:09:50.494 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:50 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:50.206+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:09:50.512 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:50 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:50.160+0000 7fee51c20700 -1 osd.6 906 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T20:09:50.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:50 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:50.324+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:09:50.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:50 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:50.324+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.302279+0000 front 2024-04-01T20:09:19.302083+0000 (oldest deadline 2024-04-01T20:09:42.802219+0000) 2024-04-01T20:09:50.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:50 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:50.495+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:50.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:50 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:50.495+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:09:50.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:50 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:50.529+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:50.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:50 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:50.529+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:09:50.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:50 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:50.529+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:09:50.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:50 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:50.708+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:50.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:50 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:50.708+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:09:50.877 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:50 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:50.708+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:09:51.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:50 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:50.949+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:51.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:50 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:50.949+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.036011+0000 front 2024-04-01T20:09:12.036043+0000 (oldest deadline 2024-04-01T20:09:34.336056+0000) 2024-04-01T20:09:51.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:50 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:50.949+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.537974+0000 front 2024-04-01T20:09:19.538042+0000 (oldest deadline 2024-04-01T20:09:45.437988+0000) 2024-04-01T20:09:51.570 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:51 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:51.450+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:51.571 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:51 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:51.450+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:09:51.571 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:51 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:51.234+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:51.571 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:51 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:51.234+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:09:51.571 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:51 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:51.234+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:09:51.762 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:51 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:51.275+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:09:51.762 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:51 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:51.275+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.302279+0000 front 2024-04-01T20:09:19.302083+0000 (oldest deadline 2024-04-01T20:09:42.802219+0000) 2024-04-01T20:09:51.762 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:51 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:51.275+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:25.703421+0000 front 2024-04-01T20:09:25.703329+0000 (oldest deadline 2024-04-01T20:09:51.003405+0000) 2024-04-01T20:09:51.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:51 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:51.740+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:51.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:51 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:51.740+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:09:51.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:51 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:51.740+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:09:51.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:51 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:51.571+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:51.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:51 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:51.571+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:09:51.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:51 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:51.571+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:09:52.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:51 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:51.993+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:52.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:51 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:51.994+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.036011+0000 front 2024-04-01T20:09:12.036043+0000 (oldest deadline 2024-04-01T20:09:34.336056+0000) 2024-04-01T20:09:52.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:51 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:51.994+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.537974+0000 front 2024-04-01T20:09:19.538042+0000 (oldest deadline 2024-04-01T20:09:45.437988+0000) 2024-04-01T20:09:52.566 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:52 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:52.419+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:52.566 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:52 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:52.419+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:09:52.567 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:52 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:52.263+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:52.567 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:52 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:52.263+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:09:52.567 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:52 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:52.263+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:09:52.762 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:52 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:52.274+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:09:52.763 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:52 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:52.274+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.302279+0000 front 2024-04-01T20:09:19.302083+0000 (oldest deadline 2024-04-01T20:09:42.802219+0000) 2024-04-01T20:09:52.763 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:52 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:52.274+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:25.703421+0000 front 2024-04-01T20:09:25.703329+0000 (oldest deadline 2024-04-01T20:09:51.003405+0000) 2024-04-01T20:09:52.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:52 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:52.779+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:52.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:52 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:52.779+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:09:52.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:52 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:52.779+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:09:52.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:52 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:52.567+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:52.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:52 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:52.567+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:09:52.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:52 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:52.567+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:09:53.240 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:52 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:52.950+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:53.241 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:52 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:52.950+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.036011+0000 front 2024-04-01T20:09:12.036043+0000 (oldest deadline 2024-04-01T20:09:34.336056+0000) 2024-04-01T20:09:53.241 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:52 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:52.950+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.537974+0000 front 2024-04-01T20:09:19.538042+0000 (oldest deadline 2024-04-01T20:09:45.437988+0000) 2024-04-01T20:09:53.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:53 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:53.241+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:09:53.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:53 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:53.241+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.302279+0000 front 2024-04-01T20:09:19.302083+0000 (oldest deadline 2024-04-01T20:09:42.802219+0000) 2024-04-01T20:09:53.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:53 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:53.241+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:25.703421+0000 front 2024-04-01T20:09:25.703329+0000 (oldest deadline 2024-04-01T20:09:51.003405+0000) 2024-04-01T20:09:53.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:53 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:53.308+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:53.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:53 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:53.308+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:09:53.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:53 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:53.308+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:09:53.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:53 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:53.371+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:53.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:53 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:53.371+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:09:53.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:53 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:53.527+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:53.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:53 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:53.527+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:09:53.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:53 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:53.527+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:09:54.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:53 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:53.731+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:54.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:53 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:53.731+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:09:54.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:53 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:53.731+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:09:54.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:53 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:53.937+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:54.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:53 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:53.937+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.036011+0000 front 2024-04-01T20:09:12.036043+0000 (oldest deadline 2024-04-01T20:09:34.336056+0000) 2024-04-01T20:09:54.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:53 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:53.937+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.537974+0000 front 2024-04-01T20:09:19.538042+0000 (oldest deadline 2024-04-01T20:09:45.437988+0000) 2024-04-01T20:09:54.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:54 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:54.340+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:54.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:54 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:54.340+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:09:54.626 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:54 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:54.340+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:09:54.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:54 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:54.376+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:54.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:54 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:54.376+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:09:54.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:54 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:54.494+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:54.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:54 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:54.494+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:09:54.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:54 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:54.494+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:09:54.762 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:54 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:54.274+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:09:54.762 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:54 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:54.274+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.302279+0000 front 2024-04-01T20:09:19.302083+0000 (oldest deadline 2024-04-01T20:09:42.802219+0000) 2024-04-01T20:09:54.762 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:54 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:54.274+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:25.703421+0000 front 2024-04-01T20:09:25.703329+0000 (oldest deadline 2024-04-01T20:09:51.003405+0000) 2024-04-01T20:09:55.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:54 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:54.699+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:55.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:54 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:54.699+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:09:55.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:54 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:54.699+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:09:55.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:54 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:54.933+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.934293+0000 front 2024-04-01T20:09:03.934149+0000 (oldest deadline 2024-04-01T20:09:29.834170+0000) 2024-04-01T20:09:55.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:54 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:54.933+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.036011+0000 front 2024-04-01T20:09:12.036043+0000 (oldest deadline 2024-04-01T20:09:34.336056+0000) 2024-04-01T20:09:55.262 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:54 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6[135809]: 2024-04-01T20:09:54.933+0000 7fee4a20c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.537974+0000 front 2024-04-01T20:09:19.538042+0000 (oldest deadline 2024-04-01T20:09:45.437988+0000) 2024-04-01T20:09:55.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:55 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:55.367+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:55.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:55 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:55.367+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:09:55.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:55 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:55.367+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:09:55.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:55 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:55.423+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:55.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:55 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:55.423+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:09:55.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:55 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:55.495+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:55.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:55 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:55.495+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:09:55.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:55 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:55.495+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:09:55.762 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:55 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:55.285+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:09:55.762 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:55 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:55.285+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.302279+0000 front 2024-04-01T20:09:19.302083+0000 (oldest deadline 2024-04-01T20:09:42.802219+0000) 2024-04-01T20:09:55.762 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:55 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:55.285+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:25.703421+0000 front 2024-04-01T20:09:25.703329+0000 (oldest deadline 2024-04-01T20:09:51.003405+0000) 2024-04-01T20:09:56.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:55 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:55.736+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:56.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:55 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:55.736+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:09:56.126 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:55 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:55.736+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:09:56.512 INFO:journalctl@ceph.osd.6.smithi062.stdout:Apr 01 20:09:56 smithi062 bash[192993]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-6 2024-04-01T20:09:56.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:56 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:56.259+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:09:56.513 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:56 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:56.259+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.302279+0000 front 2024-04-01T20:09:19.302083+0000 (oldest deadline 2024-04-01T20:09:42.802219+0000) 2024-04-01T20:09:56.513 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:56 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:56.259+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:25.703421+0000 front 2024-04-01T20:09:25.703329+0000 (oldest deadline 2024-04-01T20:09:51.003405+0000) 2024-04-01T20:09:56.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:56 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:56.335+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:56.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:56 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:56.335+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:09:56.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:56 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:56.335+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:09:56.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:56 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:56.408+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:56.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:56 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:56.408+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:09:56.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:56 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:56.408+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:09:56.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:56 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:56.523+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:56.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:56 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:56.523+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:09:56.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:56 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:56.523+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:09:57.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:56 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:56.742+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:57.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:56 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:56.742+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:09:57.126 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:56 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:56.742+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:09:57.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:57 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:57.216+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:09:57.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:57 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:57.216+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.302279+0000 front 2024-04-01T20:09:19.302083+0000 (oldest deadline 2024-04-01T20:09:42.802219+0000) 2024-04-01T20:09:57.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:57 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:57.216+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:25.703421+0000 front 2024-04-01T20:09:25.703329+0000 (oldest deadline 2024-04-01T20:09:51.003405+0000) 2024-04-01T20:09:57.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:57 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:57.315+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:57.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:57 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:57.315+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:09:57.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:57 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:57.315+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:09:57.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:57 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:57.443+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:57.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:57 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:57.443+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:09:57.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:57 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:57.443+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:09:57.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:57 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:57.490+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:57.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:57 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:57.490+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:09:57.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:57 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:57.490+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:09:58.045 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.6.service' 2024-04-01T20:09:58.094 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T20:09:58.094 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-04-01T20:09:58.094 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-04-01T20:09:58.094 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.7 2024-04-01T20:09:58.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:57 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:57.694+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:58.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:57 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:57.694+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:09:58.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:57 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:57.694+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:09:58.400 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:58 smithi062 systemd[1]: Stopping Ceph osd.7 for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T20:09:58.400 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:58 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:58.186+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:09:58.400 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:58 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:58.186+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.302279+0000 front 2024-04-01T20:09:19.302083+0000 (oldest deadline 2024-04-01T20:09:42.802219+0000) 2024-04-01T20:09:58.400 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:58 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:58.186+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:25.703421+0000 front 2024-04-01T20:09:25.703329+0000 (oldest deadline 2024-04-01T20:09:51.003405+0000) 2024-04-01T20:09:58.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:58 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:58.353+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:58.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:58 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:58.353+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:09:58.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:58 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:58.353+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:09:58.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:58 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:58.461+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:58.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:58 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:58.461+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:09:58.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:58 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:58.461+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:09:58.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:58 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:58.506+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:58.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:58 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:58.506+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:09:58.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:58 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:58.506+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:09:58.762 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:58 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:58.400+0000 7f8accb22700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T20:09:58.762 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:58 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:58.400+0000 7f8accb22700 -1 osd.7 906 *** Got signal Terminated *** 2024-04-01T20:09:58.763 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:58 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:58.400+0000 7f8accb22700 -1 osd.7 906 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T20:09:59.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:58 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:58.645+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:09:59.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:58 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:58.645+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:09:59.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:58 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:58.645+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:09:59.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:59 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:59.157+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:09:59.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:59 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:59.157+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.302279+0000 front 2024-04-01T20:09:19.302083+0000 (oldest deadline 2024-04-01T20:09:42.802219+0000) 2024-04-01T20:09:59.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:09:59 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:09:59.157+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:25.703421+0000 front 2024-04-01T20:09:25.703329+0000 (oldest deadline 2024-04-01T20:09:51.003405+0000) 2024-04-01T20:09:59.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:59 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:59.347+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:09:59.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:59 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:59.347+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:09:59.625 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:59 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:59.347+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:09:59.626 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:09:59 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:09:59.347+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:38.078270+0000 front 2024-04-01T20:09:38.078326+0000 (oldest deadline 2024-04-01T20:09:59.178120+0000) 2024-04-01T20:09:59.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:59 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:59.504+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:09:59.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:59 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:59.504+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:09:59.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:59 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:59.504+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:09:59.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:09:59 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:09:59.504+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:09:59.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:59 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:59.500+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:09:59.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:59 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:59.500+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:09:59.627 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:59 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:59.500+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:09:59.627 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:09:59 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:09:59.500+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:00.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:59 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:59.683+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:10:00.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:59 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:59.683+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:10:00.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:09:59 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:09:59.683+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:10:00.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:10:00 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:10:00.177+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:10:00.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:10:00 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:10:00.177+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.302279+0000 front 2024-04-01T20:09:19.302083+0000 (oldest deadline 2024-04-01T20:09:42.802219+0000) 2024-04-01T20:10:00.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:10:00 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:10:00.177+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:25.703421+0000 front 2024-04-01T20:09:25.703329+0000 (oldest deadline 2024-04-01T20:09:51.003405+0000) 2024-04-01T20:10:00.708 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:00 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:00.512+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:00.708 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:00 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:00.512+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:00.708 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:00 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:00.512+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:00.708 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:00 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:00.512+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:00.709 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:00 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:00.390+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:10:00.709 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:00 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:00.390+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:10:00.709 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:00 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:00.390+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:10:00.709 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:00 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:00.390+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:38.078270+0000 front 2024-04-01T20:09:38.078326+0000 (oldest deadline 2024-04-01T20:09:59.178120+0000) 2024-04-01T20:10:00.709 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:00 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:00.473+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:00.709 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:00 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:00.473+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:00.709 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:00 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:00.473+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:00.709 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:00 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:00.473+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:01.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:00 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:00.709+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:10:01.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:00 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:00.709+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:10:01.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:00 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:00.709+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:10:01.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:00 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:00.709+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.724636+0000 front 2024-04-01T20:09:35.724653+0000 (oldest deadline 2024-04-01T20:09:59.824514+0000) 2024-04-01T20:10:01.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:10:01 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:10:01.130+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:10:01.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:10:01 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:10:01.130+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.302279+0000 front 2024-04-01T20:09:19.302083+0000 (oldest deadline 2024-04-01T20:09:42.802219+0000) 2024-04-01T20:10:01.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:10:01 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:10:01.130+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:25.703421+0000 front 2024-04-01T20:09:25.703329+0000 (oldest deadline 2024-04-01T20:09:51.003405+0000) 2024-04-01T20:10:01.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:10:01 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:10:01.130+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:37.405070+0000 front 2024-04-01T20:09:37.405208+0000 (oldest deadline 2024-04-01T20:10:00.305240+0000) 2024-04-01T20:10:01.692 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:01 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:01.497+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:01.692 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:01 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:01.497+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:01.692 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:01 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:01.497+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:01.692 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:01 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:01.497+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:01.692 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:01 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:01.501+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:01.693 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:01 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:01.501+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:01.693 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:01 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:01.501+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:01.693 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:01 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:01.502+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:01.693 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:01 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:01.383+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:10:01.693 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:01 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:01.384+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:10:01.693 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:01 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:01.384+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:10:01.693 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:01 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:01.384+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:38.078270+0000 front 2024-04-01T20:09:38.078326+0000 (oldest deadline 2024-04-01T20:09:59.178120+0000) 2024-04-01T20:10:02.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:01 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:01.692+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:10:02.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:01 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:01.692+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:10:02.126 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:01 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:01.692+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:10:02.126 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:01 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:01.692+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.724636+0000 front 2024-04-01T20:09:35.724653+0000 (oldest deadline 2024-04-01T20:09:59.824514+0000) 2024-04-01T20:10:02.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:10:02 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:10:02.080+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:10:02.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:10:02 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:10:02.080+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.302279+0000 front 2024-04-01T20:09:19.302083+0000 (oldest deadline 2024-04-01T20:09:42.802219+0000) 2024-04-01T20:10:02.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:10:02 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:10:02.080+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:25.703421+0000 front 2024-04-01T20:09:25.703329+0000 (oldest deadline 2024-04-01T20:09:51.003405+0000) 2024-04-01T20:10:02.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:10:02 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:10:02.080+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:37.405070+0000 front 2024-04-01T20:09:37.405208+0000 (oldest deadline 2024-04-01T20:10:00.305240+0000) 2024-04-01T20:10:02.695 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:02 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:02.547+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:02.695 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:02 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:02.547+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:02.696 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:02 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:02.547+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:02.696 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:02 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:02.547+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:02.696 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:02 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:02.380+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:10:02.696 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:02 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:02.380+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:10:02.696 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:02 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:02.380+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:10:02.696 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:02 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:02.380+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:38.078270+0000 front 2024-04-01T20:09:38.078326+0000 (oldest deadline 2024-04-01T20:09:59.178120+0000) 2024-04-01T20:10:02.696 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:02 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:02.503+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:02.697 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:02 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:02.503+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:02.697 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:02 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:02.503+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:02.697 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:02 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:02.503+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:03.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:02 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:02.696+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:10:03.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:02 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:02.696+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:10:03.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:02 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:02.696+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:10:03.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:02 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:02.696+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.724636+0000 front 2024-04-01T20:09:35.724653+0000 (oldest deadline 2024-04-01T20:09:59.824514+0000) 2024-04-01T20:10:03.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:10:03 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:10:03.075+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:12.301003+0000 front 2024-04-01T20:09:12.301076+0000 (oldest deadline 2024-04-01T20:09:37.600980+0000) 2024-04-01T20:10:03.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:10:03 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:10:03.075+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:19.302279+0000 front 2024-04-01T20:09:19.302083+0000 (oldest deadline 2024-04-01T20:09:42.802219+0000) 2024-04-01T20:10:03.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:10:03 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:10:03.075+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:25.703421+0000 front 2024-04-01T20:09:25.703329+0000 (oldest deadline 2024-04-01T20:09:51.003405+0000) 2024-04-01T20:10:03.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:10:03 smithi062 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7[73206]: 2024-04-01T20:10:03.075+0000 7f8ac9116700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:37.405070+0000 front 2024-04-01T20:09:37.405208+0000 (oldest deadline 2024-04-01T20:10:00.305240+0000) 2024-04-01T20:10:03.625 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:03 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:03.527+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:03.625 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:03 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:03.527+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:03.625 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:03 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:03.527+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:03.625 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:03 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:03.527+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:03.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:03 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:03.562+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:03.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:03 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:03.562+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:03.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:03 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:03.562+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:03.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:03 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:03.562+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:03.626 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:03 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:03.370+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:10:03.626 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:03 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:03.370+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:10:03.626 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:03 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:03.370+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:10:03.626 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:03 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:03.370+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:38.078270+0000 front 2024-04-01T20:09:38.078326+0000 (oldest deadline 2024-04-01T20:09:59.178120+0000) 2024-04-01T20:10:04.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:03 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:03.700+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:10:04.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:03 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:03.700+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:10:04.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:03 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:03.700+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:10:04.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:03 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:03.700+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.724636+0000 front 2024-04-01T20:09:35.724653+0000 (oldest deadline 2024-04-01T20:09:59.824514+0000) 2024-04-01T20:10:04.512 INFO:journalctl@ceph.osd.7.smithi062.stdout:Apr 01 20:10:04 smithi062 bash[193260]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-7 2024-04-01T20:10:04.625 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:04 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:04.515+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:04.625 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:04 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:04.515+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:04.625 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:04 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:04.515+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:04.626 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:04 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:04.515+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:04.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:04 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:04.574+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:04.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:04 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:04.574+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:04.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:04 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:04.574+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:04.626 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:04 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:04.574+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:04.626 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:04 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:04.354+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:10:04.626 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:04 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:04.354+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:10:04.626 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:04 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:04.354+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:10:04.627 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:04 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:04.354+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:38.078270+0000 front 2024-04-01T20:09:38.078326+0000 (oldest deadline 2024-04-01T20:09:59.178120+0000) 2024-04-01T20:10:05.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:04 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:04.709+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:10:05.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:04 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:04.709+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:10:05.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:04 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:04.709+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:10:05.126 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:04 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:04.709+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.724636+0000 front 2024-04-01T20:09:35.724653+0000 (oldest deadline 2024-04-01T20:09:59.824514+0000) 2024-04-01T20:10:05.699 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:05 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:05.382+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:10:05.699 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:05 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:05.382+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:10:05.699 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:05 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:05.382+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:10:05.700 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:05 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:05.382+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:38.078270+0000 front 2024-04-01T20:09:38.078326+0000 (oldest deadline 2024-04-01T20:09:59.178120+0000) 2024-04-01T20:10:05.700 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:05 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:05.560+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:05.700 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:05 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:05.560+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:05.700 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:05 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:05.560+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:05.700 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:05 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:05.560+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:05.700 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:05 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:05.467+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:05.701 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:05 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:05.467+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:05.701 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:05 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:05.467+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:05.701 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:05 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:05.467+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:06.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:05 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:05.700+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:10:06.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:05 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:05.700+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:10:06.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:05 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:05.700+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:10:06.125 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:05 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:05.700+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.724636+0000 front 2024-04-01T20:09:35.724653+0000 (oldest deadline 2024-04-01T20:09:59.824514+0000) 2024-04-01T20:10:06.227 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.7.service' 2024-04-01T20:10:06.267 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T20:10:06.267 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-04-01T20:10:06.268 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-04-01T20:10:06.268 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.8 2024-04-01T20:10:06.548 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:06 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:06.431+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:06.548 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:06 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:06.431+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:06.548 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:06 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:06.431+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:06.548 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:06 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:06.431+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:06.549 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:06 smithi188 systemd[1]: Stopping Ceph osd.8 for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T20:10:06.549 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:06 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:06.421+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:10:06.549 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:06 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:06.421+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:10:06.549 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:06 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:06.421+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:10:06.549 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:06 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:06.421+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:38.078270+0000 front 2024-04-01T20:09:38.078326+0000 (oldest deadline 2024-04-01T20:09:59.178120+0000) 2024-04-01T20:10:06.549 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:06 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:06.549+0000 7f7846331700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T20:10:06.549 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:06 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:06.549+0000 7f7846331700 -1 osd.8 906 *** Got signal Terminated *** 2024-04-01T20:10:06.875 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:06 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:06.549+0000 7f7846331700 -1 osd.8 906 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T20:10:06.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:06 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:06.598+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:06.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:06 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:06.598+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:06.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:06 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:06.598+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:06.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:06 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:06.598+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:06.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:06 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:06.653+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:10:06.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:06 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:06.653+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:10:06.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:06 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:06.653+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:10:06.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:06 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:06.653+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.724636+0000 front 2024-04-01T20:09:35.724653+0000 (oldest deadline 2024-04-01T20:09:59.824514+0000) 2024-04-01T20:10:07.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:07 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:07.569+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:07.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:07 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:07.569+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:07.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:07 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:07.569+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:07.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:07 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:07.569+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:07.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:07 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:07.422+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:07.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:07 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:07.422+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:07.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:07 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:07.422+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:07.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:07 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:07.422+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:07.877 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:07 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:07.436+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:10:07.877 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:07 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:07.436+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:10:07.877 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:07 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:07.436+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:10:07.877 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:07 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:07.436+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:38.078270+0000 front 2024-04-01T20:09:38.078326+0000 (oldest deadline 2024-04-01T20:09:59.178120+0000) 2024-04-01T20:10:07.877 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:07 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:07.665+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:10:07.877 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:07 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:07.665+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:10:07.878 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:07 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:07.665+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:10:07.878 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:07 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:07.665+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.724636+0000 front 2024-04-01T20:09:35.724653+0000 (oldest deadline 2024-04-01T20:09:59.824514+0000) 2024-04-01T20:10:08.875 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:08 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:08.427+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:10:08.876 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:08 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:08.427+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:10:08.876 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:08 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:08.427+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:10:08.876 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:08 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:08.427+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:38.078270+0000 front 2024-04-01T20:09:38.078326+0000 (oldest deadline 2024-04-01T20:09:59.178120+0000) 2024-04-01T20:10:08.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:08 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:08.549+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:08.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:08 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:08.549+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:08.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:08 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:08.549+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:08.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:08 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:08.549+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:08.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:08 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:08.549+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:08.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:08 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:08.454+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:08.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:08 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:08.454+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:08.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:08 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:08.454+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:08.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:08 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:08.454+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:08.877 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:08 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:08.614+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:10:08.877 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:08 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:08.614+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:10:08.878 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:08 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:08.614+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:10:08.878 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:08 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:08.614+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.724636+0000 front 2024-04-01T20:09:35.724653+0000 (oldest deadline 2024-04-01T20:09:59.824514+0000) 2024-04-01T20:10:08.878 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:08 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:08.614+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.725919+0000 front 2024-04-01T20:09:42.725933+0000 (oldest deadline 2024-04-01T20:10:08.025615+0000) 2024-04-01T20:10:09.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:09 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:09.537+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:09.909 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:09 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:09.537+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:09.909 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:09 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:09.537+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:09.909 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:09 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:09.537+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:09.909 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:09 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:09.537+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:09.909 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:09 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:09.486+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:09.910 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:09 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:09.486+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:09.910 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:09 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:09.486+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:09.910 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:09 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:09.486+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:09.910 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:09 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:09.416+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:10:09.910 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:09 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:09.416+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:10:09.910 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:09 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:09.416+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:10:09.910 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:09 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:09.416+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:38.078270+0000 front 2024-04-01T20:09:38.078326+0000 (oldest deadline 2024-04-01T20:09:59.178120+0000) 2024-04-01T20:10:09.910 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:09 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:09.416+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:43.779702+0000 front 2024-04-01T20:09:43.779789+0000 (oldest deadline 2024-04-01T20:10:08.479616+0000) 2024-04-01T20:10:09.911 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:09 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:09.628+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:10:09.911 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:09 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:09.628+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:10:09.911 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:09 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:09.628+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:10:09.911 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:09 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:09.628+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.724636+0000 front 2024-04-01T20:09:35.724653+0000 (oldest deadline 2024-04-01T20:09:59.824514+0000) 2024-04-01T20:10:09.911 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:09 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:09.628+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.725919+0000 front 2024-04-01T20:09:42.725933+0000 (oldest deadline 2024-04-01T20:10:08.025615+0000) 2024-04-01T20:10:10.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:10 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:10.543+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:10.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:10 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:10.543+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:10.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:10 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:10.543+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:10.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:10 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:10.543+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:10.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:10 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:10.543+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:10.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:10 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:10.517+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:10.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:10 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:10.517+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:10.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:10 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:10.517+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:10.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:10 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:10.517+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:10.877 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:10 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:10.395+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:10:10.877 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:10 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:10.395+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:10:10.877 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:10 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:10.395+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:10:10.877 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:10 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:10.395+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:38.078270+0000 front 2024-04-01T20:09:38.078326+0000 (oldest deadline 2024-04-01T20:09:59.178120+0000) 2024-04-01T20:10:10.877 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:10 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:10.395+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:43.779702+0000 front 2024-04-01T20:09:43.779789+0000 (oldest deadline 2024-04-01T20:10:08.479616+0000) 2024-04-01T20:10:10.877 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:10 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:10.631+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:10:10.877 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:10 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:10.631+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:10:10.877 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:10 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:10.631+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:10:10.877 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:10 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:10.631+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.724636+0000 front 2024-04-01T20:09:35.724653+0000 (oldest deadline 2024-04-01T20:09:59.824514+0000) 2024-04-01T20:10:10.877 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:10 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:10.631+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.725919+0000 front 2024-04-01T20:09:42.725933+0000 (oldest deadline 2024-04-01T20:10:08.025615+0000) 2024-04-01T20:10:11.669 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:11 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:11.508+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:11.669 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:11 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:11.508+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:11.670 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:11 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:11.508+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:11.670 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:11 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:11.508+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:11.670 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:11 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:11.508+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:11.670 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:11 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:11.412+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:03.970826+0000 front 2024-04-01T20:09:03.970756+0000 (oldest deadline 2024-04-01T20:09:26.870866+0000) 2024-04-01T20:10:11.670 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:11 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:11.412+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.472544+0000 front 2024-04-01T20:09:11.472494+0000 (oldest deadline 2024-04-01T20:09:37.372641+0000) 2024-04-01T20:10:11.670 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:11 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:11.412+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:21.473908+0000 front 2024-04-01T20:09:21.473853+0000 (oldest deadline 2024-04-01T20:09:42.573718+0000) 2024-04-01T20:10:11.670 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:11 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:11.412+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:38.078270+0000 front 2024-04-01T20:09:38.078326+0000 (oldest deadline 2024-04-01T20:09:59.178120+0000) 2024-04-01T20:10:11.671 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:11 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8[91683]: 2024-04-01T20:10:11.412+0000 7f783e91d700 -1 osd.8 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:43.779702+0000 front 2024-04-01T20:09:43.779789+0000 (oldest deadline 2024-04-01T20:10:08.479616+0000) 2024-04-01T20:10:11.671 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:11 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:11.534+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:11.671 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:11 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:11.534+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:11.671 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:11 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:11.534+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:11.671 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:11 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:11.534+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:11.671 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:11 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:11.534+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:46.616180+0000 front 2024-04-01T20:09:46.616035+0000 (oldest deadline 2024-04-01T20:10:11.316044+0000) 2024-04-01T20:10:12.126 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:11 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:11.669+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:10:12.126 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:11 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:11.669+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:10:12.126 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:11 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:11.669+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:10:12.126 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:11 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:11.669+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.724636+0000 front 2024-04-01T20:09:35.724653+0000 (oldest deadline 2024-04-01T20:09:59.824514+0000) 2024-04-01T20:10:12.126 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:11 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:11.669+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.725919+0000 front 2024-04-01T20:09:42.725933+0000 (oldest deadline 2024-04-01T20:10:08.025615+0000) 2024-04-01T20:10:12.459 INFO:journalctl@ceph.osd.8.smithi188.stdout:Apr 01 20:10:12 smithi188 bash[189165]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-8 2024-04-01T20:10:12.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:12 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:12.459+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:12.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:12 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:12.459+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:12.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:12 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:12.459+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:12.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:12 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:12.459+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:12.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:12 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:12.459+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:12.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:12 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:12.563+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:12.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:12 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:12.563+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:12.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:12 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:12.563+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:12.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:12 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:12.563+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:12.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:12 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:12.563+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:46.616180+0000 front 2024-04-01T20:09:46.616035+0000 (oldest deadline 2024-04-01T20:10:11.316044+0000) 2024-04-01T20:10:12.877 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:12 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:12.654+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:10:12.877 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:12 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:12.654+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:10:12.877 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:12 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:12.654+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:10:12.877 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:12 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:12.654+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.724636+0000 front 2024-04-01T20:09:35.724653+0000 (oldest deadline 2024-04-01T20:09:59.824514+0000) 2024-04-01T20:10:12.877 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:12 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:12.654+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.725919+0000 front 2024-04-01T20:09:42.725933+0000 (oldest deadline 2024-04-01T20:10:08.025615+0000) 2024-04-01T20:10:13.787 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:13 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:13.467+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:13.788 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:13 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:13.467+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:13.788 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:13 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:13.467+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:13.788 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:13 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:13.467+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:13.788 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:13 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:13.467+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:13.789 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:13 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:13.598+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:13.789 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:13 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:13.598+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:13.789 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:13 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:13.598+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:13.789 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:13 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:13.598+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:13.789 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:13 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:13.598+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:46.616180+0000 front 2024-04-01T20:09:46.616035+0000 (oldest deadline 2024-04-01T20:10:11.316044+0000) 2024-04-01T20:10:13.789 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:13 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:13.635+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:10:13.789 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:13 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:13.635+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:10:13.789 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:13 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:13.635+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:10:13.789 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:13 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:13.635+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.724636+0000 front 2024-04-01T20:09:35.724653+0000 (oldest deadline 2024-04-01T20:09:59.824514+0000) 2024-04-01T20:10:13.789 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:13 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:13.635+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.725919+0000 front 2024-04-01T20:09:42.725933+0000 (oldest deadline 2024-04-01T20:10:08.025615+0000) 2024-04-01T20:10:14.343 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.8.service' 2024-04-01T20:10:14.382 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T20:10:14.382 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-04-01T20:10:14.382 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-04-01T20:10:14.382 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.9 2024-04-01T20:10:14.602 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:14 smithi188 systemd[1]: Stopping Ceph osd.9 for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T20:10:14.602 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:14 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:14.601+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:10:14.602 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:14 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:14.481+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:14.602 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:14 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:14.481+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:14.602 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:14 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:14.481+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:14.602 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:14 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:14.481+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:14.602 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:14 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:14.481+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:14.875 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:14 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:14.646+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:14.875 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:14 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:14.646+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:14.875 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:14 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:14.646+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:14.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:14 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:14.646+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:14.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:14 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:14.646+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:46.616180+0000 front 2024-04-01T20:09:46.616035+0000 (oldest deadline 2024-04-01T20:10:11.316044+0000) 2024-04-01T20:10:14.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:14 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:14.601+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:10:14.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:14 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:14.601+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:10:14.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:14 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:14.601+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.724636+0000 front 2024-04-01T20:09:35.724653+0000 (oldest deadline 2024-04-01T20:09:59.824514+0000) 2024-04-01T20:10:14.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:14 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:14.601+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.725919+0000 front 2024-04-01T20:09:42.725933+0000 (oldest deadline 2024-04-01T20:10:08.025615+0000) 2024-04-01T20:10:14.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:14 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:14.700+0000 7f0ce245d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T20:10:14.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:14 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:14.700+0000 7f0ce245d700 -1 osd.9 906 *** Got signal Terminated *** 2024-04-01T20:10:14.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:14 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:14.700+0000 7f0ce245d700 -1 osd.9 906 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T20:10:15.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:15 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:15.640+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:10:15.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:15 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:15.640+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:10:15.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:15 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:15.640+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:10:15.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:15 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:15.640+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.724636+0000 front 2024-04-01T20:09:35.724653+0000 (oldest deadline 2024-04-01T20:09:59.824514+0000) 2024-04-01T20:10:15.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:15 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:15.640+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.725919+0000 front 2024-04-01T20:09:42.725933+0000 (oldest deadline 2024-04-01T20:10:08.025615+0000) 2024-04-01T20:10:15.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:15 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:15.513+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:15.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:15 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:15.513+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:15.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:15 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:15.513+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:15.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:15 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:15.513+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:15.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:15 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:15.513+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:15.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:15 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:15.680+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:15.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:15 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:15.680+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:15.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:15 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:15.680+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:15.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:15 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:15.680+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:15.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:15 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:15.680+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:46.616180+0000 front 2024-04-01T20:09:46.616035+0000 (oldest deadline 2024-04-01T20:10:11.316044+0000) 2024-04-01T20:10:16.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:16 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:16.595+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:10:16.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:16 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:16.595+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:10:16.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:16 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:16.595+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:10:16.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:16 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:16.595+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.724636+0000 front 2024-04-01T20:09:35.724653+0000 (oldest deadline 2024-04-01T20:09:59.824514+0000) 2024-04-01T20:10:16.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:16 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:16.595+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.725919+0000 front 2024-04-01T20:09:42.725933+0000 (oldest deadline 2024-04-01T20:10:08.025615+0000) 2024-04-01T20:10:16.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:16 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:16.477+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:16.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:16 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:16.477+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:16.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:16 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:16.477+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:16.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:16 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:16.477+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:16.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:16 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:16.477+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:16.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:16 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:16.477+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:54.753482+0000 front 2024-04-01T20:09:54.753571+0000 (oldest deadline 2024-04-01T20:10:16.453421+0000) 2024-04-01T20:10:16.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:16 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:16.700+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:16.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:16 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:16.700+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:16.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:16 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:16.700+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:16.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:16 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:16.700+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:16.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:16 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:16.700+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:46.616180+0000 front 2024-04-01T20:09:46.616035+0000 (oldest deadline 2024-04-01T20:10:11.316044+0000) 2024-04-01T20:10:16.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:16 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:16.700+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:51.817380+0000 front 2024-04-01T20:09:51.817392+0000 (oldest deadline 2024-04-01T20:10:16.517153+0000) 2024-04-01T20:10:17.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:17 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:17.598+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:10:17.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:17 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:17.598+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:10:17.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:17 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:17.598+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:10:17.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:17 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:17.598+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.724636+0000 front 2024-04-01T20:09:35.724653+0000 (oldest deadline 2024-04-01T20:09:59.824514+0000) 2024-04-01T20:10:17.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:17 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:17.598+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.725919+0000 front 2024-04-01T20:09:42.725933+0000 (oldest deadline 2024-04-01T20:10:08.025615+0000) 2024-04-01T20:10:17.877 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:17 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:17.518+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:17.877 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:17 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:17.518+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:17.877 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:17 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:17.518+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:17.877 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:17 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:17.518+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:17.877 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:17 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:17.518+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:17.877 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:17 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:17.518+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:54.753482+0000 front 2024-04-01T20:09:54.753571+0000 (oldest deadline 2024-04-01T20:10:16.453421+0000) 2024-04-01T20:10:17.878 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:17 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:17.659+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:17.878 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:17 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:17.659+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:17.878 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:17 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:17.659+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:17.878 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:17 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:17.659+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:17.878 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:17 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:17.659+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:46.616180+0000 front 2024-04-01T20:09:46.616035+0000 (oldest deadline 2024-04-01T20:10:11.316044+0000) 2024-04-01T20:10:17.878 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:17 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:17.659+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:51.817380+0000 front 2024-04-01T20:09:51.817392+0000 (oldest deadline 2024-04-01T20:10:16.517153+0000) 2024-04-01T20:10:18.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:18 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:18.645+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:10:18.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:18 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:18.645+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:10:18.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:18 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:18.645+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:10:18.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:18 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:18.645+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.724636+0000 front 2024-04-01T20:09:35.724653+0000 (oldest deadline 2024-04-01T20:09:59.824514+0000) 2024-04-01T20:10:18.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:18 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:18.645+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.725919+0000 front 2024-04-01T20:09:42.725933+0000 (oldest deadline 2024-04-01T20:10:08.025615+0000) 2024-04-01T20:10:18.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:18 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:18.645+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:55.027331+0000 front 2024-04-01T20:09:55.027258+0000 (oldest deadline 2024-04-01T20:10:18.527132+0000) 2024-04-01T20:10:18.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:18 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:18.471+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:18.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:18 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:18.471+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:18.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:18 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:18.471+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:18.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:18 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:18.471+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:18.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:18 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:18.471+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:18.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:18 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:18.471+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:54.753482+0000 front 2024-04-01T20:09:54.753571+0000 (oldest deadline 2024-04-01T20:10:16.453421+0000) 2024-04-01T20:10:18.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:18 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:18.688+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:18.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:18 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:18.688+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:18.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:18 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:18.688+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:18.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:18 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:18.688+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:18.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:18 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:18.688+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:46.616180+0000 front 2024-04-01T20:09:46.616035+0000 (oldest deadline 2024-04-01T20:10:11.316044+0000) 2024-04-01T20:10:18.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:18 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:18.688+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:51.817380+0000 front 2024-04-01T20:09:51.817392+0000 (oldest deadline 2024-04-01T20:10:16.517153+0000) 2024-04-01T20:10:19.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:19 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:19.611+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.518100+0000 front 2024-04-01T20:09:04.518146+0000 (oldest deadline 2024-04-01T20:09:26.217991+0000) 2024-04-01T20:10:19.875 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:19 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:19.611+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:09.119127+0000 front 2024-04-01T20:09:09.119230+0000 (oldest deadline 2024-04-01T20:09:36.719614+0000) 2024-04-01T20:10:19.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:19 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:19.611+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:18.221960+0000 front 2024-04-01T20:09:18.221990+0000 (oldest deadline 2024-04-01T20:09:42.321609+0000) 2024-04-01T20:10:19.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:19 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:19.611+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.724636+0000 front 2024-04-01T20:09:35.724653+0000 (oldest deadline 2024-04-01T20:09:59.824514+0000) 2024-04-01T20:10:19.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:19 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:19.611+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.725919+0000 front 2024-04-01T20:09:42.725933+0000 (oldest deadline 2024-04-01T20:10:08.025615+0000) 2024-04-01T20:10:19.876 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:19 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9[56809]: 2024-04-01T20:10:19.611+0000 7f0cdaa49700 -1 osd.9 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:55.027331+0000 front 2024-04-01T20:09:55.027258+0000 (oldest deadline 2024-04-01T20:10:18.527132+0000) 2024-04-01T20:10:19.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:19 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:19.511+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:19.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:19 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:19.511+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:19.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:19 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:19.511+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:19.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:19 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:19.511+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:19.877 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:19 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:19.511+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:19.877 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:19 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:19.511+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:54.753482+0000 front 2024-04-01T20:09:54.753571+0000 (oldest deadline 2024-04-01T20:10:16.453421+0000) 2024-04-01T20:10:19.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:19 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:19.689+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:19.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:19 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:19.689+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:19.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:19 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:19.689+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:19.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:19 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:19.689+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:19.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:19 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:19.689+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:46.616180+0000 front 2024-04-01T20:09:46.616035+0000 (oldest deadline 2024-04-01T20:10:11.316044+0000) 2024-04-01T20:10:19.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:19 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:19.689+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:51.817380+0000 front 2024-04-01T20:09:51.817392+0000 (oldest deadline 2024-04-01T20:10:16.517153+0000) 2024-04-01T20:10:20.658 INFO:journalctl@ceph.osd.9.smithi188.stdout:Apr 01 20:10:20 smithi188 bash[189432]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-9 2024-04-01T20:10:20.659 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:20 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:20.558+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:20.659 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:20 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:20.558+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:20.659 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:20 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:20.558+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:20.660 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:20 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:20.558+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:20.660 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:20 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:20.558+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:20.660 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:20 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:20.558+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:54.753482+0000 front 2024-04-01T20:09:54.753571+0000 (oldest deadline 2024-04-01T20:10:16.453421+0000) 2024-04-01T20:10:21.078 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:20 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:20.658+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:21.078 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:20 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:20.658+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:21.079 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:20 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:20.658+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:21.079 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:20 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:20.658+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:21.079 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:20 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:20.658+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:46.616180+0000 front 2024-04-01T20:09:46.616035+0000 (oldest deadline 2024-04-01T20:10:11.316044+0000) 2024-04-01T20:10:21.079 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:20 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:20.658+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:51.817380+0000 front 2024-04-01T20:09:51.817392+0000 (oldest deadline 2024-04-01T20:10:16.517153+0000) 2024-04-01T20:10:21.851 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:21 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:21.531+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:21.852 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:21 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:21.531+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:21.852 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:21 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:21.531+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:21.852 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:21 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:21.531+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:21.852 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:21 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:21.531+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:21.852 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:21 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:21.531+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:54.753482+0000 front 2024-04-01T20:09:54.753571+0000 (oldest deadline 2024-04-01T20:10:16.453421+0000) 2024-04-01T20:10:21.852 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:21 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:21.670+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:21.852 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:21 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:21.670+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:21.852 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:21 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:21.670+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:21.852 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:21 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:21.670+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:21.852 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:21 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:21.670+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:46.616180+0000 front 2024-04-01T20:09:46.616035+0000 (oldest deadline 2024-04-01T20:10:11.316044+0000) 2024-04-01T20:10:21.853 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:21 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:21.670+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:51.817380+0000 front 2024-04-01T20:09:51.817392+0000 (oldest deadline 2024-04-01T20:10:16.517153+0000) 2024-04-01T20:10:22.120 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.9.service' 2024-04-01T20:10:22.161 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T20:10:22.162 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-04-01T20:10:22.162 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-04-01T20:10:22.162 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.10 2024-04-01T20:10:22.375 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:22 smithi188 systemd[1]: Stopping Ceph osd.10 for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T20:10:22.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:22 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:22.580+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:22.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:22 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:22.580+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:22.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:22 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:22.580+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:22.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:22 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:22.580+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:22.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:22 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:22.580+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:22.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:22 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:22.580+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:54.753482+0000 front 2024-04-01T20:09:54.753571+0000 (oldest deadline 2024-04-01T20:10:16.453421+0000) 2024-04-01T20:10:22.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:22 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:22.470+0000 7fa8056c6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T20:10:22.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:22 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:22.470+0000 7fa8056c6700 -1 osd.10 906 *** Got signal Terminated *** 2024-04-01T20:10:22.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:22 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:22.470+0000 7fa8056c6700 -1 osd.10 906 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T20:10:22.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:22 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:22.621+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:22.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:22 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:22.621+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:22.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:22 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:22.621+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:22.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:22 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:22.621+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:22.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:22 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:22.621+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:46.616180+0000 front 2024-04-01T20:09:46.616035+0000 (oldest deadline 2024-04-01T20:10:11.316044+0000) 2024-04-01T20:10:22.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:22 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:22.621+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:51.817380+0000 front 2024-04-01T20:09:51.817392+0000 (oldest deadline 2024-04-01T20:10:16.517153+0000) 2024-04-01T20:10:23.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:23 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:23.619+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:23.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:23 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:23.619+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:23.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:23 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:23.619+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:23.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:23 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:23.619+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:23.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:23 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:23.619+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:23.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:23 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:23.619+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:54.753482+0000 front 2024-04-01T20:09:54.753571+0000 (oldest deadline 2024-04-01T20:10:16.453421+0000) 2024-04-01T20:10:23.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:23 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:23.585+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:23.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:23 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:23.585+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:23.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:23 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:23.585+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:23.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:23 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:23.585+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:23.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:23 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:23.585+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:46.616180+0000 front 2024-04-01T20:09:46.616035+0000 (oldest deadline 2024-04-01T20:10:11.316044+0000) 2024-04-01T20:10:23.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:23 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:23.585+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:51.817380+0000 front 2024-04-01T20:09:51.817392+0000 (oldest deadline 2024-04-01T20:10:16.517153+0000) 2024-04-01T20:10:24.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:24 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:24.607+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:24.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:24 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:24.607+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:24.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:24 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:24.607+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:24.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:24 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:24.607+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:24.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:24 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:24.607+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:24.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:24 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:24.607+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:54.753482+0000 front 2024-04-01T20:09:54.753571+0000 (oldest deadline 2024-04-01T20:10:16.453421+0000) 2024-04-01T20:10:24.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:24 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:24.539+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:24.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:24 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:24.539+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:24.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:24 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:24.539+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:24.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:24 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:24.539+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:24.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:24 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:24.539+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:46.616180+0000 front 2024-04-01T20:09:46.616035+0000 (oldest deadline 2024-04-01T20:10:11.316044+0000) 2024-04-01T20:10:24.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:24 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:24.539+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:51.817380+0000 front 2024-04-01T20:09:51.817392+0000 (oldest deadline 2024-04-01T20:10:16.517153+0000) 2024-04-01T20:10:25.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:25 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:25.608+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:25.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:25 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:25.608+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:25.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:25 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:25.608+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:25.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:25 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:25.608+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:25.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:25 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:25.608+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:25.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:25 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:25.608+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:54.753482+0000 front 2024-04-01T20:09:54.753571+0000 (oldest deadline 2024-04-01T20:10:16.453421+0000) 2024-04-01T20:10:25.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:25 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:25.588+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:25.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:25 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:25.588+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:25.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:25 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:25.588+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:25.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:25 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:25.588+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:25.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:25 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:25.588+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:46.616180+0000 front 2024-04-01T20:09:46.616035+0000 (oldest deadline 2024-04-01T20:10:11.316044+0000) 2024-04-01T20:10:25.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:25 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:25.588+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:51.817380+0000 front 2024-04-01T20:09:51.817392+0000 (oldest deadline 2024-04-01T20:10:16.517153+0000) 2024-04-01T20:10:26.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:26 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:26.618+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:26.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:26 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:26.618+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:26.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:26 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:26.618+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:26.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:26 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:26.618+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:26.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:26 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:26.618+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:26.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:26 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:26.618+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:54.753482+0000 front 2024-04-01T20:09:54.753571+0000 (oldest deadline 2024-04-01T20:10:16.453421+0000) 2024-04-01T20:10:26.876 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:26 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:26.595+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:04.407498+0000 front 2024-04-01T20:09:04.407742+0000 (oldest deadline 2024-04-01T20:09:26.707602+0000) 2024-04-01T20:10:26.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:26 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:26.595+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6807 osd.1 since back 2024-04-01T20:09:11.408812+0000 front 2024-04-01T20:09:11.408842+0000 (oldest deadline 2024-04-01T20:09:35.508817+0000) 2024-04-01T20:10:26.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:26 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:26.595+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.710395+0000 front 2024-04-01T20:09:20.710543+0000 (oldest deadline 2024-04-01T20:09:42.410449+0000) 2024-04-01T20:10:26.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:26 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:26.595+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.014065+0000 front 2024-04-01T20:09:35.013998+0000 (oldest deadline 2024-04-01T20:09:59.113909+0000) 2024-04-01T20:10:26.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:26 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:26.595+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:46.616180+0000 front 2024-04-01T20:09:46.616035+0000 (oldest deadline 2024-04-01T20:10:11.316044+0000) 2024-04-01T20:10:26.877 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:26 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10[175345]: 2024-04-01T20:10:26.595+0000 7fa7fdcb2700 -1 osd.10 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:51.817380+0000 front 2024-04-01T20:09:51.817392+0000 (oldest deadline 2024-04-01T20:10:16.517153+0000) 2024-04-01T20:10:27.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:27 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:27.572+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:27.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:27 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:27.572+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:27.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:27 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:27.572+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:27.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:27 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:27.572+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:27.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:27 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:27.572+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:27.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:27 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:27.572+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:54.753482+0000 front 2024-04-01T20:09:54.753571+0000 (oldest deadline 2024-04-01T20:10:16.453421+0000) 2024-04-01T20:10:27.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:27 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:27.572+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6814 osd.7 since back 2024-04-01T20:10:01.154441+0000 front 2024-04-01T20:10:01.154468+0000 (oldest deadline 2024-04-01T20:10:27.054231+0000) 2024-04-01T20:10:28.572 INFO:journalctl@ceph.osd.10.smithi188.stdout:Apr 01 20:10:28 smithi188 bash[189696]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-10 2024-04-01T20:10:28.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:28 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:28.573+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:28.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:28 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:28.573+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:28.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:28 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:28.573+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:28.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:28 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:28.573+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:28.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:28 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:28.573+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:28.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:28 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:28.573+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:54.753482+0000 front 2024-04-01T20:09:54.753571+0000 (oldest deadline 2024-04-01T20:10:16.453421+0000) 2024-04-01T20:10:28.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:28 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:28.573+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6814 osd.7 since back 2024-04-01T20:10:01.154441+0000 front 2024-04-01T20:10:01.154468+0000 (oldest deadline 2024-04-01T20:10:27.054231+0000) 2024-04-01T20:10:29.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:29 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:29.548+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:29.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:29 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:29.548+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:29.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:29 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:29.548+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:29.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:29 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:29.548+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:29.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:29 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:29.548+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:29.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:29 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:29.548+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:54.753482+0000 front 2024-04-01T20:09:54.753571+0000 (oldest deadline 2024-04-01T20:10:16.453421+0000) 2024-04-01T20:10:29.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:29 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:29.548+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6814 osd.7 since back 2024-04-01T20:10:01.154441+0000 front 2024-04-01T20:10:01.154468+0000 (oldest deadline 2024-04-01T20:10:27.054231+0000) 2024-04-01T20:10:30.264 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.10.service' 2024-04-01T20:10:30.303 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T20:10:30.304 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-04-01T20:10:30.304 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-04-01T20:10:30.304 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.11 2024-04-01T20:10:30.512 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:30 smithi188 systemd[1]: Stopping Ceph osd.11 for 09f6b846-f05c-11ee-b647-cb9ed24678a4... 2024-04-01T20:10:30.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:30 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:30.511+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:30.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:30 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:30.511+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:30.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:30 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:30.511+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:30.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:30 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:30.511+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:30.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:30 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:30.511+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:30.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:30 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:30.511+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:54.753482+0000 front 2024-04-01T20:09:54.753571+0000 (oldest deadline 2024-04-01T20:10:16.453421+0000) 2024-04-01T20:10:30.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:30 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:30.511+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6814 osd.7 since back 2024-04-01T20:10:01.154441+0000 front 2024-04-01T20:10:01.154468+0000 (oldest deadline 2024-04-01T20:10:27.054231+0000) 2024-04-01T20:10:30.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:30 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:30.638+0000 7fdaf3235700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T20:10:30.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:30 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:30.638+0000 7fdaf3235700 -1 osd.11 906 *** Got signal Terminated *** 2024-04-01T20:10:30.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:30 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:30.638+0000 7fdaf3235700 -1 osd.11 906 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T20:10:31.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:31 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:31.546+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:31.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:31 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:31.546+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:31.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:31 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:31.546+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:31.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:31 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:31.546+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:31.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:31 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:31.546+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:31.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:31 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:31.546+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:54.753482+0000 front 2024-04-01T20:09:54.753571+0000 (oldest deadline 2024-04-01T20:10:16.453421+0000) 2024-04-01T20:10:31.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:31 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:31.546+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6814 osd.7 since back 2024-04-01T20:10:01.154441+0000 front 2024-04-01T20:10:01.154468+0000 (oldest deadline 2024-04-01T20:10:27.054231+0000) 2024-04-01T20:10:32.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:32 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:32.567+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:32.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:32 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:32.567+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:32.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:32 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:32.567+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:32.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:32 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:32.567+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:32.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:32 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:32.567+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:32.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:32 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:32.567+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:54.753482+0000 front 2024-04-01T20:09:54.753571+0000 (oldest deadline 2024-04-01T20:10:16.453421+0000) 2024-04-01T20:10:32.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:32 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:32.567+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6814 osd.7 since back 2024-04-01T20:10:01.154441+0000 front 2024-04-01T20:10:01.154468+0000 (oldest deadline 2024-04-01T20:10:27.054231+0000) 2024-04-01T20:10:33.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:33 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:33.586+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:33.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:33 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:33.586+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:33.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:33 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:33.586+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:33.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:33 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:33.586+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:33.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:33 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:33.586+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:33.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:33 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:33.586+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:54.753482+0000 front 2024-04-01T20:09:54.753571+0000 (oldest deadline 2024-04-01T20:10:16.453421+0000) 2024-04-01T20:10:33.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:33 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:33.586+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6814 osd.7 since back 2024-04-01T20:10:01.154441+0000 front 2024-04-01T20:10:01.154468+0000 (oldest deadline 2024-04-01T20:10:27.054231+0000) 2024-04-01T20:10:33.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:33 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:33.586+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.188:6802 osd.8 since back 2024-04-01T20:10:07.054569+0000 front 2024-04-01T20:10:07.054671+0000 (oldest deadline 2024-04-01T20:10:32.855075+0000) 2024-04-01T20:10:34.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:34 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:34.624+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:34.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:34 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:34.624+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:34.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:34 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:34.624+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:34.875 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:34 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:34.624+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:34.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:34 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:34.624+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:34.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:34 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:34.624+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:54.753482+0000 front 2024-04-01T20:09:54.753571+0000 (oldest deadline 2024-04-01T20:10:16.453421+0000) 2024-04-01T20:10:34.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:34 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:34.624+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6814 osd.7 since back 2024-04-01T20:10:01.154441+0000 front 2024-04-01T20:10:01.154468+0000 (oldest deadline 2024-04-01T20:10:27.054231+0000) 2024-04-01T20:10:34.876 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:34 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:34.624+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.188:6802 osd.8 since back 2024-04-01T20:10:07.054569+0000 front 2024-04-01T20:10:07.054671+0000 (oldest deadline 2024-04-01T20:10:32.855075+0000) 2024-04-01T20:10:36.125 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:35 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:35.629+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6803 osd.0 since back 2024-04-01T20:09:01.244113+0000 front 2024-04-01T20:09:01.244043+0000 (oldest deadline 2024-04-01T20:09:27.143871+0000) 2024-04-01T20:10:36.125 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:35 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:35.629+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6811 osd.2 since back 2024-04-01T20:09:20.347606+0000 front 2024-04-01T20:09:20.347737+0000 (oldest deadline 2024-04-01T20:09:43.847709+0000) 2024-04-01T20:10:36.125 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:35 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:35.629+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.22:6815 osd.3 since back 2024-04-01T20:09:29.649316+0000 front 2024-04-01T20:09:29.649331+0000 (oldest deadline 2024-04-01T20:09:55.549274+0000) 2024-04-01T20:10:36.125 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:35 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:35.629+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6802 osd.4 since back 2024-04-01T20:09:35.550080+0000 front 2024-04-01T20:09:35.549963+0000 (oldest deadline 2024-04-01T20:09:59.049844+0000) 2024-04-01T20:10:36.125 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:35 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:35.629+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6806 osd.5 since back 2024-04-01T20:09:42.551137+0000 front 2024-04-01T20:09:42.551212+0000 (oldest deadline 2024-04-01T20:10:08.351684+0000) 2024-04-01T20:10:36.126 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:35 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:35.629+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6810 osd.6 since back 2024-04-01T20:09:54.753482+0000 front 2024-04-01T20:09:54.753571+0000 (oldest deadline 2024-04-01T20:10:16.453421+0000) 2024-04-01T20:10:36.126 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:35 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:35.629+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.62:6814 osd.7 since back 2024-04-01T20:10:01.154441+0000 front 2024-04-01T20:10:01.154468+0000 (oldest deadline 2024-04-01T20:10:27.054231+0000) 2024-04-01T20:10:36.126 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:35 smithi188 ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11[71142]: 2024-04-01T20:10:35.629+0000 7fdaeb821700 -1 osd.11 906 heartbeat_check: no reply from 172.21.15.188:6802 osd.8 since back 2024-04-01T20:10:07.054569+0000 front 2024-04-01T20:10:07.054671+0000 (oldest deadline 2024-04-01T20:10:32.855075+0000) 2024-04-01T20:10:36.750 INFO:journalctl@ceph.osd.11.smithi188.stdout:Apr 01 20:10:36 smithi188 bash[189957]: ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4-osd-11 2024-04-01T20:10:38.244 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-09f6b846-f05c-11ee-b647-cb9ed24678a4@osd.11.service' 2024-04-01T20:10:38.283 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T20:10:38.283 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-04-01T20:10:38.283 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 --force --keep-logs 2024-04-01T20:10:38.523 INFO:teuthology.orchestra.run.smithi022.stdout:Deleting cluster with fsid: 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T20:10:39.788 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 --force --keep-logs 2024-04-01T20:10:40.033 INFO:teuthology.orchestra.run.smithi062.stdout:Deleting cluster with fsid: 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T20:10:41.384 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 --force --keep-logs 2024-04-01T20:10:41.614 INFO:teuthology.orchestra.run.smithi188.stdout:Deleting cluster with fsid: 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T20:10:42.629 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-01T20:10:42.667 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-01T20:10:42.704 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-01T20:10:42.734 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-01T20:10:42.737 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/crash to /home/teuthworker/archive/lflores-2024-04-01_18:07:25-rados-wip-yuri8-testing-2024-03-25-1419-distro-default-smithi/7634085/remote/smithi022/crash 2024-04-01T20:10:42.738 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/crash -- . 2024-04-01T20:10:42.811 INFO:teuthology.orchestra.run.smithi022.stderr:tar: /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/crash: Cannot open: No such file or directory 2024-04-01T20:10:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:tar: Error is not recoverable: exiting now 2024-04-01T20:10:42.813 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/crash to /home/teuthworker/archive/lflores-2024-04-01_18:07:25-rados-wip-yuri8-testing-2024-03-25-1419-distro-default-smithi/7634085/remote/smithi062/crash 2024-04-01T20:10:42.814 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/crash -- . 2024-04-01T20:10:42.876 INFO:teuthology.orchestra.run.smithi062.stderr:tar: /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/crash: Cannot open: No such file or directory 2024-04-01T20:10:42.876 INFO:teuthology.orchestra.run.smithi062.stderr:tar: Error is not recoverable: exiting now 2024-04-01T20:10:42.878 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/crash to /home/teuthworker/archive/lflores-2024-04-01_18:07:25-rados-wip-yuri8-testing-2024-03-25-1419-distro-default-smithi/7634085/remote/smithi188/crash 2024-04-01T20:10:42.879 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/crash -- . 2024-04-01T20:10:42.923 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /var/lib/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/crash: Cannot open: No such file or directory 2024-04-01T20:10:42.923 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2024-04-01T20:10:42.924 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-01T20:10:42.924 DEBUG:teuthology.orchestra.run.smithi022:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(REQUEST_STUCK\)' | egrep -v '\(MON_DOWN\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v osd_map_cache_size | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-01T20:10:43.018 INFO:teuthology.orchestra.run.smithi022.stdout:2024-04-01T19:30:00.000125+0000 mon.a (mon.0) 1202 : cluster [WRN] Health detail: HEALTH_WARN nodeep-scrub flag(s) set 2024-04-01T20:10:43.018 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-04-01T20:10:43.019 DEBUG:teuthology.orchestra.run.smithi022:> sudo egrep '\[SEC\]' /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(REQUEST_STUCK\)' | egrep -v '\(MON_DOWN\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v osd_map_cache_size | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-01T20:10:43.062 DEBUG:teuthology.orchestra.run.smithi022:> sudo egrep '\[ERR\]' /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(REQUEST_STUCK\)' | egrep -v '\(MON_DOWN\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v osd_map_cache_size | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-01T20:10:43.143 DEBUG:teuthology.orchestra.run.smithi022:> sudo egrep '\[WRN\]' /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(REQUEST_STUCK\)' | egrep -v '\(MON_DOWN\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v osd_map_cache_size | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-01T20:10:43.222 INFO:teuthology.orchestra.run.smithi022.stdout:2024-04-01T19:30:00.000125+0000 mon.a (mon.0) 1202 : cluster [WRN] Health detail: HEALTH_WARN nodeep-scrub flag(s) set 2024-04-01T20:10:43.222 INFO:tasks.cephadm:Compressing logs... 2024-04-01T20:10:43.222 DEBUG:teuthology.orchestra.run.smithi022:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-01T20:10:43.265 DEBUG:teuthology.orchestra.run.smithi062:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-01T20:10:43.267 DEBUG:teuthology.orchestra.run.smithi188:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-01T20:10:43.296 INFO:teuthology.orchestra.run.smithi022.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-volume.log 2024-04-01T20:10:43.296 INFO:teuthology.orchestra.run.smithi022.stderr:: No such file or directory 2024-04-01T20:10:43.300 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.2.log 2024-04-01T20:10:43.300 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-mgr.y.log 2024-04-01T20:10:43.300 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.audit.log 2024-04-01T20:10:43.302 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.cephadm.log 2024-04-01T20:10:43.302 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-mgr.y.log: /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.3.log 2024-04-01T20:10:43.302 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.0.log 2024-04-01T20:10:43.303 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/objectstore_tool.6.log 2024-04-01T20:10:43.303 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/objectstore_tool.7.log 2024-04-01T20:10:43.303 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-mon.a.log 2024-04-01T20:10:43.303 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.log 2024-04-01T20:10:43.303 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.1.log 2024-04-01T20:10:43.303 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-01T20:10:43.311 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-01T20:10:43.312 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.11.log 2024-04-01T20:10:43.317 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-volume.log 2024-04-01T20:10:43.321 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.audit.log 2024-04-01T20:10:43.321 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.11.log: /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.cephadm.log 2024-04-01T20:10:43.321 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/objectstore_tool.6.log 2024-04-01T20:10:43.321 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.audit.log: /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.10.log 2024-04-01T20:10:43.321 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/objectstore_tool.6.log: gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.8.log 2024-04-01T20:10:43.321 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/objectstore_tool.7.log 2024-04-01T20:10:43.321 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-mon.c.log 2024-04-01T20:10:43.321 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/objectstore_tool.7.log: gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.9.log 2024-04-01T20:10:43.321 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.log 2024-04-01T20:10:43.321 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-01T20:10:43.340 INFO:teuthology.orchestra.run.smithi062.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-01T20:10:43.341 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.6.log 2024-04-01T20:10:43.346 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-volume.log 2024-04-01T20:10:43.347 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.audit.log 2024-04-01T20:10:43.347 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.cephadm.log 2024-04-01T20:10:43.347 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.7.log 2024-04-01T20:10:43.349 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-mgr.x.log 2024-04-01T20:10:43.349 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/objectstore_tool.7.log 2024-04-01T20:10:43.349 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-mon.b.log 2024-04-01T20:10:43.349 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/objectstore_tool.7.log: gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.log 2024-04-01T20:10:43.349 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.4.log 2024-04-01T20:10:43.350 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.log: gzip -5 --verbose -- /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.5.log 2024-04-01T20:10:43.350 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-01T20:10:43.356 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.4.log: /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.5.log: /var/log/ceph/cephadm.log: 93.3% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-mgr.x.log.gz 2024-04-01T20:10:43.444 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.log: /var/log/ceph/cephadm.log: 95.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-01T20:10:43.455 INFO:teuthology.orchestra.run.smithi062.stderr: 95.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-01T20:10:43.477 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.0.log: /var/log/ceph/cephadm.log: /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/objectstore_tool.6.log: /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/objectstore_tool.7.log: /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-mon.a.log: /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.log: /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.1.log: 89.6% 91.4% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.audit.log.gz -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-volume.log.gz 2024-04-01T20:10:43.477 INFO:teuthology.orchestra.run.smithi022.stderr: 2024-04-01T20:10:43.489 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.log.gz 2024-04-01T20:10:43.497 INFO:teuthology.orchestra.run.smithi188.stderr: 82.6% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.cephadm.log.gz 2024-04-01T20:10:43.520 INFO:teuthology.orchestra.run.smithi022.stderr: 96.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-01T20:10:43.538 INFO:teuthology.orchestra.run.smithi062.stderr: 89.6% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.audit.log.gz 2024-04-01T20:10:43.551 INFO:teuthology.orchestra.run.smithi022.stderr: 83.4% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.cephadm.log.gz 2024-04-01T20:10:43.567 INFO:teuthology.orchestra.run.smithi188.stderr: 94.2% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/objectstore_tool.6.log.gz 2024-04-01T20:10:43.749 INFO:teuthology.orchestra.run.smithi188.stderr: 89.6% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.audit.log.gz 2024-04-01T20:10:43.864 INFO:teuthology.orchestra.run.smithi188.stderr: 87.8% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.log.gz 2024-04-01T20:10:44.045 INFO:teuthology.orchestra.run.smithi188.stderr: 91.2% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-volume.log.gz 2024-04-01T20:10:44.046 INFO:teuthology.orchestra.run.smithi062.stderr: 82.6% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.cephadm.log.gz 2024-04-01T20:10:44.304 INFO:teuthology.orchestra.run.smithi062.stderr: 91.4% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-volume.log.gz 2024-04-01T20:10:44.386 INFO:teuthology.orchestra.run.smithi022.stderr: 94.1% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/objectstore_tool.6.log.gz 2024-04-01T20:10:44.482 INFO:teuthology.orchestra.run.smithi022.stderr: 94.4% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/objectstore_tool.7.log.gz 2024-04-01T20:10:44.853 INFO:teuthology.orchestra.run.smithi188.stderr: 94.8% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/objectstore_tool.7.log.gz 2024-04-01T20:10:44.944 INFO:teuthology.orchestra.run.smithi062.stderr: 87.8% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph.log.gz 2024-04-01T20:10:45.346 INFO:teuthology.orchestra.run.smithi062.stderr: 94.6% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/objectstore_tool.7.log.gz 2024-04-01T20:10:45.421 INFO:teuthology.orchestra.run.smithi022.stderr: 91.3% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-mgr.y.log.gz 2024-04-01T20:10:46.716 INFO:teuthology.orchestra.run.smithi188.stderr: 90.7% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-mon.c.log.gz 2024-04-01T20:10:48.473 INFO:teuthology.orchestra.run.smithi062.stderr: 90.5% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-mon.b.log.gz 2024-04-01T20:10:50.495 INFO:teuthology.orchestra.run.smithi022.stderr: 89.8% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-mon.a.log.gz 2024-04-01T20:13:11.875 INFO:teuthology.orchestra.run.smithi188.stderr: 93.6% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.10.log.gz 2024-04-01T20:13:29.456 INFO:teuthology.orchestra.run.smithi062.stderr: 94.7% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.6.log.gz 2024-04-01T20:13:34.283 INFO:teuthology.orchestra.run.smithi188.stderr: 93.8% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.8.log.gz 2024-04-01T20:13:40.176 INFO:teuthology.orchestra.run.smithi022.stderr: 94.4% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.2.log.gz 2024-04-01T20:14:08.858 INFO:teuthology.orchestra.run.smithi188.stderr: 93.8% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.9.log.gz 2024-04-01T20:14:26.661 INFO:teuthology.orchestra.run.smithi022.stderr: 94.2% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.3.log.gz 2024-04-01T20:15:00.906 INFO:teuthology.orchestra.run.smithi022.stderr: 93.6% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.1.log.gz 2024-04-01T20:15:19.723 INFO:teuthology.orchestra.run.smithi062.stderr: 93.4% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.7.log.gz 2024-04-01T20:15:41.079 INFO:teuthology.orchestra.run.smithi022.stderr: 92.5% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.0.log.gz 2024-04-01T20:15:41.091 INFO:teuthology.orchestra.run.smithi022.stderr: 2024-04-01T20:15:41.091 INFO:teuthology.orchestra.run.smithi022.stderr:real 4m57.810s 2024-04-01T20:15:41.091 INFO:teuthology.orchestra.run.smithi022.stderr:user 6m31.504s 2024-04-01T20:15:41.091 INFO:teuthology.orchestra.run.smithi022.stderr:sys 0m15.239s 2024-04-01T20:15:51.796 INFO:teuthology.orchestra.run.smithi188.stderr: 92.7% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.11.log.gz 2024-04-01T20:15:51.798 INFO:teuthology.orchestra.run.smithi188.stderr: 2024-04-01T20:15:51.798 INFO:teuthology.orchestra.run.smithi188.stderr:real 5m8.512s 2024-04-01T20:15:51.798 INFO:teuthology.orchestra.run.smithi188.stderr:user 6m15.207s 2024-04-01T20:15:51.798 INFO:teuthology.orchestra.run.smithi188.stderr:sys 0m16.170s 2024-04-01T20:15:55.406 INFO:teuthology.orchestra.run.smithi062.stderr: 92.5% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.4.log.gz 2024-04-01T20:17:09.786 INFO:teuthology.orchestra.run.smithi062.stderr: 92.6% -- replaced with /var/log/ceph/09f6b846-f05c-11ee-b647-cb9ed24678a4/ceph-osd.5.log.gz 2024-04-01T20:17:09.788 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-04-01T20:17:09.788 INFO:teuthology.orchestra.run.smithi062.stderr:real 6m26.501s 2024-04-01T20:17:09.788 INFO:teuthology.orchestra.run.smithi062.stderr:user 7m59.520s 2024-04-01T20:17:09.788 INFO:teuthology.orchestra.run.smithi062.stderr:sys 0m18.216s 2024-04-01T20:17:09.788 INFO:tasks.cephadm:Archiving logs... 2024-04-01T20:17:09.789 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/log/ceph to /home/teuthworker/archive/lflores-2024-04-01_18:07:25-rados-wip-yuri8-testing-2024-03-25-1419-distro-default-smithi/7634085/remote/smithi022/log 2024-04-01T20:17:09.790 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-01T20:18:08.351 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/log/ceph to /home/teuthworker/archive/lflores-2024-04-01_18:07:25-rados-wip-yuri8-testing-2024-03-25-1419-distro-default-smithi/7634085/remote/smithi062/log 2024-04-01T20:18:08.352 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-01T20:19:23.532 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/log/ceph to /home/teuthworker/archive/lflores-2024-04-01_18:07:25-rados-wip-yuri8-testing-2024-03-25-1419-distro-default-smithi/7634085/remote/smithi188/log 2024-04-01T20:19:23.533 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-01T20:20:25.666 INFO:tasks.cephadm:Removing cluster... 2024-04-01T20:20:25.667 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 --force 2024-04-01T20:20:26.070 INFO:teuthology.orchestra.run.smithi022.stdout:Deleting cluster with fsid: 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T20:20:26.743 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 --force 2024-04-01T20:20:27.141 INFO:teuthology.orchestra.run.smithi062.stdout:Deleting cluster with fsid: 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T20:20:27.902 DEBUG:teuthology.orchestra.run.smithi188:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 09f6b846-f05c-11ee-b647-cb9ed24678a4 --force 2024-04-01T20:20:28.554 INFO:teuthology.orchestra.run.smithi188.stdout:Deleting cluster with fsid: 09f6b846-f05c-11ee-b647-cb9ed24678a4 2024-04-01T20:20:29.243 INFO:tasks.cephadm:Removing cephadm ... 2024-04-01T20:20:29.244 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-01T20:20:29.273 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-01T20:20:29.304 DEBUG:teuthology.orchestra.run.smithi188:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-01T20:20:29.329 INFO:tasks.cephadm:Teardown complete 2024-04-01T20:20:29.330 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-01T20:20:29.343 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-01T20:20:29.343 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-01T20:20:29.346 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-01T20:20:29.349 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-01T20:20:29.512 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-01T20:20:29.521 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-01T20:20:29.522 DEBUG:teuthology.orchestra.run.smithi022:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T20:20:29.525 DEBUG:teuthology.orchestra.run.smithi062:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T20:20:29.527 DEBUG:teuthology.orchestra.run.smithi188:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T20:20:29.543 INFO:teuthology.orchestra.run.smithi022.stderr:bash: ntpq: command not found 2024-04-01T20:20:29.544 INFO:teuthology.orchestra.run.smithi188.stderr:bash: ntpq: command not found 2024-04-01T20:20:29.545 INFO:teuthology.orchestra.run.smithi062.stderr:bash: ntpq: command not found 2024-04-01T20:20:29.568 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T20:20:29.568 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-04-01T20:20:29.568 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 14 -107us[ -107us] +/- 74ms 2024-04-01T20:20:29.568 INFO:teuthology.orchestra.run.smithi062.stdout:^* hv02.front.sepia.ceph.com 3 6 377 16 -229us[ -218us] +/- 57ms 2024-04-01T20:20:29.568 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 +530us[ +530us] +/- 79ms 2024-04-01T20:20:29.568 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T20:20:29.575 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T20:20:29.575 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2024-04-01T20:20:29.575 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 15 -121us[ -121us] +/- 74ms 2024-04-01T20:20:29.575 INFO:teuthology.orchestra.run.smithi022.stdout:^* hv02.front.sepia.ceph.com 3 6 377 15 -215us[ -186us] +/- 57ms 2024-04-01T20:20:29.576 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 +499us[ +499us] +/- 79ms 2024-04-01T20:20:29.576 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T20:20:29.591 INFO:teuthology.orchestra.run.smithi188.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T20:20:29.591 INFO:teuthology.orchestra.run.smithi188.stdout:=============================================================================== 2024-04-01T20:20:29.592 INFO:teuthology.orchestra.run.smithi188.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 11 -105us[ -105us] +/- 74ms 2024-04-01T20:20:29.592 INFO:teuthology.orchestra.run.smithi188.stdout:^* hv02.front.sepia.ceph.com 3 6 377 13 -237us[ -230us] +/- 57ms 2024-04-01T20:20:29.592 INFO:teuthology.orchestra.run.smithi188.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 +531us[ +531us] +/- 79ms 2024-04-01T20:20:29.592 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T20:20:29.593 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-01T20:20:29.602 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-01T20:20:29.602 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-01T20:20:29.667 DEBUG:teuthology.orchestra.run.smithi022:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-01T20:20:29.772 DEBUG:teuthology.orchestra.run.smithi062:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-01T20:20:29.862 DEBUG:teuthology.orchestra.run.smithi188:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-01T20:20:29.951 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-01T20:20:29.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T20:20:29.987 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-01T20:20:30.020 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T20:20:30.021 DEBUG:teuthology.orchestra.run.smithi188:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-01T20:20:30.049 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T20:20:30.050 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-01T20:20:30.059 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-01T20:20:30.108 INFO:teuthology.task.internal:Duration was 4528.212159 seconds 2024-04-01T20:20:30.108 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-01T20:20:30.118 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-01T20:20:30.118 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-01T20:20:30.121 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-01T20:20:30.123 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-01T20:20:30.201 INFO:teuthology.orchestra.run.smithi188.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T20:20:30.211 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T20:20:30.221 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T20:20:30.663 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-01T20:20:30.664 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi022.front.sepia.ceph.com 2024-04-01T20:20:30.664 DEBUG:teuthology.orchestra.run.smithi022:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-01T20:20:30.704 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi062.front.sepia.ceph.com 2024-04-01T20:20:30.704 DEBUG:teuthology.orchestra.run.smithi062:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-01T20:20:30.751 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi188.front.sepia.ceph.com 2024-04-01T20:20:30.751 DEBUG:teuthology.orchestra.run.smithi188:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-01T20:20:30.786 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-01T20:20:30.786 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-01T20:20:30.789 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-01T20:20:30.792 DEBUG:teuthology.orchestra.run.smithi188:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-01T20:20:30.933 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-01T20:20:30.933 DEBUG:teuthology.orchestra.run.smithi022:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-01T20:20:30.936 DEBUG:teuthology.orchestra.run.smithi062:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-01T20:20:30.938 DEBUG:teuthology.orchestra.run.smithi188:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-01T20:20:31.209 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-01T20:20:31.220 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-01T20:20:31.220 DEBUG:teuthology.orchestra.run.smithi022:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-01T20:20:31.266 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-01T20:20:31.326 DEBUG:teuthology.orchestra.run.smithi188:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-01T20:20:31.378 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-01T20:20:31.391 DEBUG:teuthology.orchestra.run.smithi022:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-01T20:20:31.394 DEBUG:teuthology.orchestra.run.smithi062:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-01T20:20:31.396 DEBUG:teuthology.orchestra.run.smithi188:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-01T20:20:31.425 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = core 2024-04-01T20:20:31.426 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = core 2024-04-01T20:20:31.429 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = core 2024-04-01T20:20:31.443 DEBUG:teuthology.orchestra.run.smithi022:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-01T20:20:31.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T20:20:31.498 DEBUG:teuthology.orchestra.run.smithi062:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-01T20:20:31.515 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T20:20:31.516 DEBUG:teuthology.orchestra.run.smithi188:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-01T20:20:31.533 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T20:20:31.533 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-01T20:20:31.544 INFO:teuthology.task.internal:Transferring archived files... 2024-04-01T20:20:31.545 DEBUG:teuthology.misc:Transferring archived files from smithi022:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/lflores-2024-04-01_18:07:25-rados-wip-yuri8-testing-2024-03-25-1419-distro-default-smithi/7634085/remote/smithi022 2024-04-01T20:20:31.545 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-01T20:20:31.605 DEBUG:teuthology.misc:Transferring archived files from smithi062:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/lflores-2024-04-01_18:07:25-rados-wip-yuri8-testing-2024-03-25-1419-distro-default-smithi/7634085/remote/smithi062 2024-04-01T20:20:31.605 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-01T20:20:31.652 DEBUG:teuthology.misc:Transferring archived files from smithi188:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/lflores-2024-04-01_18:07:25-rados-wip-yuri8-testing-2024-03-25-1419-distro-default-smithi/7634085/remote/smithi188 2024-04-01T20:20:31.652 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-01T20:20:31.699 INFO:teuthology.task.internal:Removing archive directory... 2024-04-01T20:20:31.699 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-01T20:20:31.703 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-01T20:20:31.705 DEBUG:teuthology.orchestra.run.smithi188:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-01T20:20:31.749 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-01T20:20:31.763 INFO:teuthology.task.internal:Not uploading archives. 2024-04-01T20:20:31.763 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-01T20:20:31.820 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-01T20:20:31.820 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-01T20:20:31.823 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-01T20:20:31.826 DEBUG:teuthology.orchestra.run.smithi188:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-01T20:20:31.839 INFO:teuthology.orchestra.run.smithi022.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 1 20:20 /home/ubuntu/cephtest 2024-04-01T20:20:31.841 INFO:teuthology.orchestra.run.smithi062.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 1 20:20 /home/ubuntu/cephtest 2024-04-01T20:20:31.843 INFO:teuthology.orchestra.run.smithi188.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 1 20:20 /home/ubuntu/cephtest 2024-04-01T20:20:31.844 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-01T20:20:31.858 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-01T20:20:31.951 INFO:teuthology.nuke:Checking targets against current locks 2024-04-01T20:20:31.983 DEBUG:teuthology.nuke:shortname: smithi022 2024-04-01T20:20:31.984 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-01T20:20:32.030 DEBUG:teuthology.nuke:shortname: smithi062 2024-04-01T20:20:32.030 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-01T20:20:32.051 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-04-01_18:07:25-rados-wip-yuri8-testing-2024-03-25-1419-distro-default-smithi/7634085', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 18:56:27.009722', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL3B9TtcQuNj1cc6k5Zi2wTmAHzazC3Lbyp2jBJlw7Go7YvNG0g7YIIcL/GRb1i0UXE5D/1tiGZUhvtk5N4XHD0='} 2024-04-01T20:20:32.074 DEBUG:teuthology.nuke:shortname: smithi188 2024-04-01T20:20:32.075 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-01T20:20:32.088 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-04-01_18:07:25-rados-wip-yuri8-testing-2024-03-25-1419-distro-default-smithi/7634085', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 18:56:27.010850', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMn1aqZNxsGFja+d3n+U7smqmDwlNh0H6se6X3nqixSF/bHkGQNCt1oN6CB2nJ+prLBTLpk6pdH9SBby6YgMAnM='} 2024-04-01T20:20:32.131 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-04-01_18:07:25-rados-wip-yuri8-testing-2024-03-25-1419-distro-default-smithi/7634085', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 18:56:27.007453', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHm5gNcPYRhquJDz3z10kDYUFmOVxzpVEiI6fusN4kgdmPSbKls5kf0/AsSmUhw6il3CZxePI2Xx3CdbifZ4rpk='} 2024-04-01T20:20:32.148 INFO:teuthology.orchestra.console.smithi022:Power off 2024-04-01T20:20:32.148 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T20:20:32.196 INFO:teuthology.orchestra.console.smithi062:Power off 2024-04-01T20:20:32.196 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T20:20:32.217 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2024-04-01T20:20:32.218 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T20:20:32.243 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off 2024-04-01T20:20:32.244 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T20:20:32.258 INFO:teuthology.orchestra.console.smithi188:Power off 2024-04-01T20:20:32.258 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T20:20:32.266 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2024-04-01T20:20:32.295 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2024-04-01T20:20:32.306 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off 2024-04-01T20:20:32.306 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T20:20:32.360 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2024-04-01T20:20:36.268 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T20:20:36.296 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T20:20:36.361 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T20:20:36.378 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2024-04-01T20:20:36.406 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2024-04-01T20:20:36.471 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2024-04-01T20:20:40.381 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T20:20:40.408 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T20:20:40.472 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T20:20:40.491 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2024-04-01T20:20:40.518 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2024-04-01T20:20:40.583 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2024-04-01T20:20:40.593 INFO:teuthology.orchestra.console.smithi022:Power off completed 2024-04-01T20:20:40.619 INFO:teuthology.orchestra.console.smithi062:Power off completed 2024-04-01T20:20:44.588 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T20:20:44.698 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2024-04-01T20:20:44.799 INFO:teuthology.orchestra.console.smithi188:Power off completed 2024-04-01T20:20:44.903 INFO:teuthology.run:Summary data: description: rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/radosbench} duration: 4528.212159156799 failure_reason: '"2024-04-01T19:30:00.000125+0000 mon.a (mon.0) 1202 : cluster [WRN] Health detail: HEALTH_WARN nodeep-scrub flag(s) set" in cluster log' flavor: default owner: scheduled_lflores@teuthology success: false 2024-04-01T20:20:44.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T20:20:44.991 INFO:teuthology.run:FAIL